2019-11-28T09:46:50.654 INFO:root:teuthology version: 1.0.0-e749e7b 2019-11-28T09:46:50.655 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.Tqyfnh.tmp -- --verbose --lock --description kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml} --name pdonnell-2019-11-27_23:36:14-kcephfs-wip-pdonnell-testing-20191127.175901-distro-basic-smithi --block --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2019-11-27_23:36:14-kcephfs-wip-pdonnell-testing-20191127.175901-distro-basic-smithi/4548252 2019-11-28T09:46:50.696 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-28T09:46:50.790 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2019-11-27_23:36:14-kcephfs-wip-pdonnell-testing-20191127.175901-distro-basic-smithi/4548252 branch: wip-pdonnell-testing-20191127.175901 description: kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml} email: pdonnell@redhat.com first_in_suite: false job_id: '4548252' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2019-11-27_23:36:14-kcephfs-wip-pdonnell-testing-20191127.175901-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: rhel os_version: '7.7' overrides: admin_socket: branch: wip-pdonnell-testing-20191127.175901 ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - but it is still running - slow request - evicting unresponsive client sha1: 6882af39b535c578d64a14ae5fc1b517ba8bdb9b ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 6882af39b535c578d64a14ae5fc1b517ba8bdb9b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20191127.175901 sha1: 6882af39b535c578d64a14ae5fc1b517ba8bdb9b owner: scheduled_pdonnell@teuthology priority: 76 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.b - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.c - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 - - client.2 - - client.3 sha1: 6882af39b535c578d64a14ae5fc1b517ba8bdb9b suite: kcephfs suite_branch: wip-pdonnell-testing-20191127.175901 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 6882af39b535c578d64a14ae5fc1b517ba8bdb9b tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_client_recovery teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.9225 2019-11-28T09:46:50.790 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa; will attempt to use it 2019-11-28T09:46:50.791 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks 2019-11-28T09:46:50.791 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-11-28T09:46:50.793 INFO:teuthology.task.internal:Checking packages... 2019-11-28T09:46:50.805 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash '6882af39b535c578d64a14ae5fc1b517ba8bdb9b' 2019-11-28T09:46:50.805 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-11-28T09:46:50.806 INFO:teuthology.packaging:ref: None 2019-11-28T09:46:50.806 INFO:teuthology.packaging:tag: None 2019-11-28T09:46:50.806 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20191127.175901 2019-11-28T09:46:50.806 INFO:teuthology.packaging:sha1: 6882af39b535c578d64a14ae5fc1b517ba8bdb9b 2019-11-28T09:46:50.806 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-pdonnell-testing-20191127.175901 2019-11-28T09:46:50.964 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-7798.g6882af3 2019-11-28T09:46:50.964 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-11-28T09:46:50.979 INFO:teuthology.task.internal:no buildpackages task found 2019-11-28T09:46:50.979 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-11-28T09:46:50.995 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-11-28T09:46:50.995 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-28T09:46:51.054 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T09:47:01.067 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T09:47:11.084 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T09:47:21.099 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T09:47:31.115 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T09:47:41.136 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T09:47:51.153 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:48:01.169 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:48:11.185 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:48:21.200 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:48:31.216 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:48:41.234 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:48:51.254 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:49:01.269 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:49:11.286 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:49:21.299 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:49:31.315 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:49:41.331 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:49:51.343 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:50:01.361 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:50:11.375 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:50:21.393 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:50:31.409 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:50:41.425 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:50:51.442 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:51:01.455 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:51:11.467 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:51:21.483 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:51:31.500 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:51:41.517 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:51:51.532 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:52:01.553 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:52:11.570 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:52:21.584 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:52:31.602 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:52:41.622 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:52:51.635 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:53:01.651 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:53:11.668 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:53:21.677 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:53:31.686 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:53:41.701 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:53:51.755 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:54:01.775 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:54:11.794 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:54:21.812 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:54:31.829 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:54:41.846 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:54:51.865 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:55:01.883 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:55:11.901 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:55:21.916 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:55:31.932 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:55:41.948 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:55:51.967 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:56:01.983 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:56:12.006 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:56:22.024 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:56:32.039 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:56:42.057 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:56:52.077 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:57:02.093 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:57:12.115 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:57:22.132 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:57:32.149 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:57:42.165 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:57:52.187 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:58:02.203 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:58:12.221 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:58:22.234 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:58:32.248 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:58:42.268 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:58:52.284 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:59:02.300 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:59:12.315 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:59:22.332 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:59:32.357 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:59:42.375 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T09:59:52.394 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:00:02.408 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:00:12.425 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:00:22.435 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:00:32.447 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:00:42.464 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:00:52.479 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:01:02.491 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:01:12.509 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:01:22.526 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:01:32.539 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:01:42.556 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:01:52.572 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:02:02.588 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:02:12.608 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:02:22.625 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:02:32.641 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:02:42.653 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:02:52.669 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:03:02.684 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:03:12.700 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:03:22.719 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:03:32.734 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:03:42.760 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:03:52.771 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:04:02.788 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:04:12.805 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:04:22.823 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:04:32.850 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:04:42.864 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:04:52.880 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:05:02.907 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:05:12.923 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:05:22.939 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:05:32.956 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:05:42.970 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 6)... 2019-11-28T10:05:52.989 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:06:03.004 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:06:13.019 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:06:23.036 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:06:33.056 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:06:43.073 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:06:53.090 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:07:03.110 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:07:13.129 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:07:23.145 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:07:33.185 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:07:43.209 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:07:53.225 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:08:03.234 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:08:13.250 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:08:23.270 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:08:33.295 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:08:43.309 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:08:53.324 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:09:03.341 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:09:13.359 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:09:23.374 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:09:33.401 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:09:43.418 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:09:53.435 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:10:03.456 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:10:13.478 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:10:23.504 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 0)... 2019-11-28T10:10:33.521 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:10:43.535 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 6)... 2019-11-28T10:10:53.554 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:11:03.572 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:11:13.591 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:11:23.604 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:11:33.622 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:11:43.649 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:11:53.665 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:12:03.682 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:12:13.697 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:12:23.713 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:12:33.730 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:12:43.748 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:12:53.766 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:13:03.794 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:13:13.844 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:13:23.860 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:13:33.875 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:13:43.892 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:13:53.901 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:14:03.909 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:14:13.954 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:14:23.970 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:14:33.985 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:14:44.003 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:14:54.021 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:15:04.036 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:15:14.056 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:15:24.072 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:15:34.102 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:15:44.117 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:15:54.150 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:16:04.165 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:16:14.180 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:16:24.200 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:16:34.223 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:16:44.241 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:16:54.261 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:17:04.277 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:17:14.301 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:17:24.317 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:17:34.340 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 6)... 2019-11-28T10:17:44.362 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:17:54.377 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:18:04.405 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:18:14.421 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:18:24.440 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:18:34.459 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:18:44.475 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:18:54.494 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:19:04.508 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:19:14.528 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:19:24.545 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:19:34.597 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:19:44.612 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:19:54.629 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:20:04.645 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:20:14.665 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:20:24.680 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:20:34.706 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:20:44.722 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:20:54.737 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:21:04.766 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:21:14.781 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:21:24.797 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:21:34.813 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:21:44.837 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:21:54.856 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:22:04.885 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:22:14.901 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:22:24.920 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:22:34.956 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:22:44.973 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:22:54.989 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:23:05.004 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:23:15.020 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:23:25.036 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:23:35.056 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:23:45.076 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:23:55.092 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:24:05.125 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:24:15.144 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:24:25.161 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:24:35.171 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:24:45.188 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:24:55.208 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:25:05.224 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:25:15.240 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:25:25.252 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:25:35.269 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:25:45.287 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:25:55.302 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:26:05.327 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:26:15.345 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:26:25.366 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:26:35.385 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:26:45.403 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:26:55.424 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:27:05.439 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:27:15.456 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:27:25.472 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:27:35.491 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 5)... 2019-11-28T10:27:45.504 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:27:55.523 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:28:05.551 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:28:15.593 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:28:25.684 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 5)... 2019-11-28T10:28:35.702 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:28:45.725 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:28:55.761 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:29:05.770 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:29:15.780 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:29:25.796 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:29:35.811 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:29:45.830 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:29:55.848 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:30:05.870 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:30:15.887 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:30:25.908 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:30:35.925 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:30:45.971 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:30:55.988 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:31:06.007 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:31:16.024 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:31:26.034 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:31:36.048 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:31:46.088 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:31:56.105 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 6)... 2019-11-28T10:32:06.120 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:32:16.130 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:32:26.144 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:32:36.162 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:32:46.175 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 0)... 2019-11-28T10:32:56.188 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 0)... 2019-11-28T10:33:06.204 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 0)... 2019-11-28T10:33:16.219 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 0)... 2019-11-28T10:33:26.243 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 0)... 2019-11-28T10:33:36.260 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:33:46.279 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:33:56.302 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 6)... 2019-11-28T10:34:06.322 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:34:16.337 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:34:26.358 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:34:36.375 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:34:46.387 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:34:56.402 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:35:06.422 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 6)... 2019-11-28T10:35:17.785 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:35:27.802 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:35:37.819 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:35:47.836 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:35:57.853 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:36:07.878 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:36:17.893 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:36:27.911 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:36:37.927 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:36:47.944 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:36:57.961 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:37:07.979 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:37:17.995 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:37:28.013 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:37:38.031 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:37:48.051 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:37:58.068 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:38:08.083 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:38:18.093 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:38:28.109 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 6)... 2019-11-28T10:38:38.126 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:38:48.140 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:38:58.162 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:39:08.178 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:39:18.196 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:39:28.207 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:39:38.224 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:39:48.241 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:39:58.258 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:40:08.272 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:40:18.287 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:40:28.309 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:40:38.318 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:40:48.332 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:40:58.349 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:41:08.364 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:41:18.380 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:41:28.394 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:41:38.412 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:41:48.430 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:41:58.746 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:42:08.763 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:42:18.781 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:42:28.796 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:42:38.822 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:42:48.836 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:42:58.852 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:43:08.868 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:43:18.886 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:43:28.900 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:43:38.915 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:43:48.933 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:43:58.952 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:44:08.969 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:44:18.984 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:44:29.002 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:44:39.016 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:44:49.032 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:44:59.048 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:45:09.065 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:45:19.083 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 5)... 2019-11-28T10:45:29.101 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:45:39.118 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:45:49.131 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:45:59.153 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:46:09.172 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 5)... 2019-11-28T10:46:19.191 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 5)... 2019-11-28T10:46:29.213 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 5)... 2019-11-28T10:46:39.229 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 5)... 2019-11-28T10:46:49.251 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:46:59.282 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:47:09.302 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:47:19.317 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:47:31.887 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:47:43.976 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:47:53.992 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:48:04.008 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:48:14.025 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:48:24.043 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:48:34.067 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:48:44.085 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:48:54.103 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:49:04.118 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 3)... 2019-11-28T10:49:14.140 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:49:24.157 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:49:34.174 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 7)... 2019-11-28T10:49:44.193 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 7)... 2019-11-28T10:49:54.208 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 7)... 2019-11-28T10:50:04.223 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 7)... 2019-11-28T10:50:14.240 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 7)... 2019-11-28T10:50:24.258 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:50:34.279 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:50:44.297 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:50:54.314 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:51:04.328 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:51:14.347 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:51:25.321 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:51:35.338 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:51:45.362 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:51:55.385 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:52:05.402 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:52:15.419 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:52:25.439 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:52:35.455 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:52:45.468 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:52:55.489 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:53:05.505 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 7)... 2019-11-28T10:53:15.521 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:53:25.539 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:53:35.557 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:53:45.572 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:53:55.590 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:54:05.614 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:54:15.629 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:54:25.644 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:54:35.660 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:54:45.678 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:54:55.694 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:55:05.708 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:55:15.741 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:55:25.763 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:55:35.778 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:55:45.796 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:55:55.813 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:56:05.849 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 4)... 2019-11-28T10:56:15.866 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:56:26.165 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 5)... 2019-11-28T10:56:36.179 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:56:46.203 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:56:59.276 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:57:09.299 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:57:19.316 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:57:29.331 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:57:39.348 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:57:49.367 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:57:59.385 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:58:09.418 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:58:19.457 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:58:29.479 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 6, have 2)... 2019-11-28T10:58:39.498 DEBUG:teuthology.lock.ops:lock_many request: {'count': 6, 'locked_by': 'scheduled_pdonnell@teuthology', 'description': '/home/teuthworker/archive/pdonnell-2019-11-27_23:36:14-kcephfs-wip-pdonnell-testing-20191127.175901-distro-basic-smithi/4548252', 'machine_type': 'smithi'} 2019-11-28T10:58:39.522 DEBUG:teuthology.lock.ops:locked ubuntu@smithi080.front.sepia.ceph.com, ubuntu@smithi174.front.sepia.ceph.com, ubuntu@smithi075.front.sepia.ceph.com, ubuntu@smithi133.front.sepia.ceph.com, ubuntu@smithi016.front.sepia.ceph.com, ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T10:58:40.085 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-11-28T10:58:40.395 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of rhel 7.7 2019-11-28T10:58:40.415 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of rhel 7.7 2019-11-28T10:58:40.439 INFO:teuthology.provision.fog.smithi076:Scheduling deploy of rhel 7.7 2019-11-28T10:58:40.444 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of rhel 7.7 2019-11-28T10:58:40.448 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of rhel 7.7 2019-11-28T10:58:40.453 INFO:teuthology.provision.fog.smithi075:Scheduling deploy of rhel 7.7 2019-11-28T10:58:41.275 INFO:teuthology.orchestra.console:Power off smithi133 2019-11-28T10:58:41.347 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-28T10:58:41.466 INFO:teuthology.orchestra.console:Power off smithi075 2019-11-28T10:58:41.467 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi075.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-28T10:58:41.549 INFO:teuthology.orchestra.console:Power off smithi076 2019-11-28T10:58:41.550 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-28T10:58:41.637 INFO:teuthology.orchestra.console:Power off smithi080 2019-11-28T10:58:41.639 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-28T10:58:41.727 INFO:teuthology.orchestra.console:Power off smithi016 2019-11-28T10:58:41.728 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-28T10:58:41.767 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:41.796 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi075.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:41.885 INFO:teuthology.orchestra.console:Power off smithi174 2019-11-28T10:58:41.886 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-28T10:58:41.918 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:41.955 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:42.006 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:42.037 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:46.008 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi075.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:46.049 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:46.084 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:46.129 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:46.173 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:46.201 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:50.240 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi075.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:50.292 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:50.330 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:50.369 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:50.402 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:50.433 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:50.570 INFO:teuthology.orchestra.console:Power off for smithi075 completed 2019-11-28T10:58:50.573 INFO:teuthology.orchestra.console:Power off for smithi133 completed 2019-11-28T10:58:50.573 INFO:teuthology.orchestra.console:Power off for smithi080 completed 2019-11-28T10:58:50.606 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2019-11-28T10:58:50.636 INFO:teuthology.orchestra.console:Power off for smithi076 completed 2019-11-28T10:58:50.669 INFO:teuthology.orchestra.console:Power off for smithi174 completed 2019-11-28T10:58:50.671 INFO:teuthology.orchestra.console:Power on smithi075 2019-11-28T10:58:50.671 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi075.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-28T10:58:50.719 INFO:teuthology.orchestra.console:Power on smithi133 2019-11-28T10:58:50.720 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-28T10:58:50.754 INFO:teuthology.orchestra.console:Power on smithi080 2019-11-28T10:58:50.755 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-28T10:58:50.797 INFO:teuthology.orchestra.console:Power on smithi016 2019-11-28T10:58:50.797 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-28T10:58:50.842 INFO:teuthology.orchestra.console:Power on smithi076 2019-11-28T10:58:50.843 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-28T10:58:50.877 INFO:teuthology.orchestra.console:Power on smithi174 2019-11-28T10:58:50.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-28T10:58:50.911 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:50.954 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:51.008 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi075.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:51.057 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:51.112 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:51.155 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:55.156 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:55.198 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi075.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:55.235 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:55.265 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:55.295 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:55.335 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T10:58:55.468 INFO:teuthology.orchestra.console:Power on for smithi080 completed 2019-11-28T10:58:55.469 INFO:teuthology.orchestra.console:Power on for smithi075 completed 2019-11-28T10:58:55.470 INFO:teuthology.orchestra.console:Power on for smithi133 completed 2019-11-28T10:58:55.497 INFO:teuthology.orchestra.console:Power on for smithi076 completed 2019-11-28T10:58:55.539 INFO:teuthology.orchestra.console:Power on for smithi016 completed 2019-11-28T10:58:55.566 INFO:teuthology.orchestra.console:Power on for smithi174 completed 2019-11-28T10:58:55.570 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish 2019-11-28T10:58:55.573 INFO:teuthology.provision.fog.smithi075:Waiting for deploy to finish 2019-11-28T10:58:55.575 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2019-11-28T10:58:55.598 INFO:teuthology.provision.fog.smithi076:Waiting for deploy to finish 2019-11-28T10:58:55.640 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2019-11-28T10:58:55.667 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2019-11-28T11:01:27.266 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:01:36.333 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:01:42.311 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:01:42.355 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:01:45.385 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:01:51.370 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:01:51.433 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:01:54.446 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:01:57.441 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi075.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:01:57.462 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi080.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:00.428 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:00.489 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:03.497 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:06.507 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi075.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:06.541 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi080.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:09.483 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:09.545 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:12.486 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:12.553 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:15.561 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi075.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:15.593 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi080.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:18.539 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:18.602 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:21.546 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:24.617 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi075.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:24.651 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi080.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:27.596 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:27.657 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:30.602 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:33.673 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi075.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:33.706 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi080.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:36.651 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:36.714 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:39.658 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:42.729 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi075.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:42.761 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi080.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:48.715 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:51.785 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi075.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:51.838 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi080.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:02:57.770 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:03:00.841 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi075.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:03:00.906 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi080.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:03:06.826 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:03:08.458 INFO:teuthology.orchestra.run.smithi174:> hostname 2019-11-28T11:03:08.945 INFO:teuthology.orchestra.run.smithi174.stdout:smithi090 2019-11-28T11:03:08.946 INFO:teuthology.orchestra.run.smithi174:> grep smithi090 /etc/hosts 2019-11-28T11:03:08.992 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2019-11-28T11:03:08.993 INFO:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2019-11-28T11:03:09.084 INFO:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi090/smithi174/g' /etc/hosts 2019-11-28T11:03:09.139 INFO:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.90/172.21.15.174/g' /etc/hosts 2019-11-28T11:03:09.193 INFO:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi090/smithi174/g' /etc/hostname 2019-11-28T11:03:09.247 INFO:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2019-11-28T11:03:09.300 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2019-11-28T11:03:09.302 DEBUG:teuthology.parallel:result is None 2019-11-28T11:03:09.900 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi075.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:03:09.961 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi080.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:03:15.882 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:03:18.557 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:03:18.790 INFO:teuthology.orchestra.run.smithi016:> hostname 2019-11-28T11:03:19.224 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2019-11-28T11:03:19.224 INFO:teuthology.orchestra.run.smithi016:> grep smithi016.front.sepia.ceph.com /etc/hosts 2019-11-28T11:03:19.275 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2019-11-28T11:03:19.276 INFO:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2019-11-28T11:03:19.408 INFO:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hosts 2019-11-28T11:03:19.474 INFO:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/172.21.15.16/172.21.15.16/g' /etc/hosts 2019-11-28T11:03:19.533 INFO:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hostname 2019-11-28T11:03:19.592 INFO:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2019-11-28T11:03:19.653 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2019-11-28T11:03:19.654 DEBUG:teuthology.parallel:result is None 2019-11-28T11:03:24.945 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:03:34.029 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:03:42.654 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:03:42.850 INFO:teuthology.orchestra.run.smithi133:> hostname 2019-11-28T11:03:43.309 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133 2019-11-28T11:03:43.310 INFO:teuthology.orchestra.run.smithi133:> grep smithi133 /etc/hosts 2019-11-28T11:03:43.351 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2019-11-28T11:03:43.352 INFO:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2019-11-28T11:03:43.502 INFO:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133/smithi133/g' /etc/hosts 2019-11-28T11:03:43.559 INFO:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2019-11-28T11:03:43.622 INFO:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133/smithi133/g' /etc/hostname 2019-11-28T11:03:43.674 INFO:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2019-11-28T11:03:43.732 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2019-11-28T11:03:43.736 DEBUG:teuthology.parallel:result is None 2019-11-28T11:03:47.505 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi075.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:03:47.731 INFO:teuthology.orchestra.run.smithi075:> hostname 2019-11-28T11:03:48.180 INFO:teuthology.orchestra.run.smithi075.stdout:smithi090 2019-11-28T11:03:48.180 INFO:teuthology.orchestra.run.smithi075:> grep smithi090 /etc/hosts 2019-11-28T11:03:48.227 INFO:teuthology.orchestra.run.smithi075.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2019-11-28T11:03:48.227 INFO:teuthology.orchestra.run.smithi075:> sudo hostname smithi075 2019-11-28T11:03:48.321 INFO:teuthology.orchestra.run.smithi075:> sudo sed -i -e 's/smithi090/smithi075/g' /etc/hosts 2019-11-28T11:03:48.377 INFO:teuthology.orchestra.run.smithi075:> sudo sed -i -e 's/172.21.15.90/172.21.15.75/g' /etc/hosts 2019-11-28T11:03:48.436 INFO:teuthology.orchestra.run.smithi075:> sudo sed -i -e 's/smithi090/smithi075/g' /etc/hostname 2019-11-28T11:03:48.489 INFO:teuthology.orchestra.run.smithi075:> sudo hostname smithi075 2019-11-28T11:03:48.542 INFO:teuthology.provision.fog.smithi075:Deploy complete! 2019-11-28T11:03:48.544 DEBUG:teuthology.parallel:result is None 2019-11-28T11:04:15.983 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi080.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:04:16.254 INFO:teuthology.orchestra.run.smithi080:> hostname 2019-11-28T11:04:16.629 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com 2019-11-28T11:04:16.630 INFO:teuthology.orchestra.run.smithi080:> grep smithi080.front.sepia.ceph.com /etc/hosts 2019-11-28T11:04:16.671 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080 2019-11-28T11:04:16.671 INFO:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2019-11-28T11:04:16.825 INFO:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hosts 2019-11-28T11:04:16.883 INFO:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/172.21.15.80/172.21.15.80/g' /etc/hosts 2019-11-28T11:04:16.937 INFO:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hostname 2019-11-28T11:04:16.990 INFO:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2019-11-28T11:04:17.041 INFO:teuthology.provision.fog.smithi080:Deploy complete! 2019-11-28T11:04:17.043 DEBUG:teuthology.parallel:result is None 2019-11-28T11:04:40.058 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:04:40.258 INFO:teuthology.orchestra.run.smithi076:> hostname 2019-11-28T11:04:40.688 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076 2019-11-28T11:04:40.689 INFO:teuthology.orchestra.run.smithi076:> grep smithi076 /etc/hosts 2019-11-28T11:04:40.730 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076 2019-11-28T11:04:40.730 INFO:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2019-11-28T11:04:40.886 INFO:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076/smithi076/g' /etc/hosts 2019-11-28T11:04:40.945 INFO:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/172.21.15.76/172.21.15.76/g' /etc/hosts 2019-11-28T11:04:40.997 INFO:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076/smithi076/g' /etc/hostname 2019-11-28T11:04:41.049 INFO:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2019-11-28T11:04:41.105 INFO:teuthology.provision.fog.smithi076:Deploy complete! 2019-11-28T11:04:41.107 DEBUG:teuthology.parallel:result is None 2019-11-28T11:04:41.482 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com 2019-11-28T11:04:41.483 INFO:teuthology.lock.ops:New key found. Updating... 2019-11-28T11:04:41.498 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2019-11-28T11:04:41.499 INFO:teuthology.lock.ops:New key found. Updating... 2019-11-28T11:04:41.511 INFO:teuthology.lock.ops:Checking smithi075.front.sepia.ceph.com 2019-11-28T11:04:41.512 INFO:teuthology.lock.ops:New key found. Updating... 2019-11-28T11:04:41.521 INFO:teuthology.lock.ops:Checking smithi076.front.sepia.ceph.com 2019-11-28T11:04:41.521 INFO:teuthology.lock.ops:New key found. Updating... 2019-11-28T11:04:41.529 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2019-11-28T11:04:41.530 INFO:teuthology.lock.ops:New key found. Updating... 2019-11-28T11:04:41.539 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2019-11-28T11:04:41.539 INFO:teuthology.lock.ops:New key found. Updating... 2019-11-28T11:04:41.554 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server 2019-11-28T11:04:41.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:04:41.555 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi080.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:04:41.640 INFO:teuthology.orchestra.run.smithi080:> true 2019-11-28T11:04:41.898 INFO:teuthology.orchestra.run.smithi080:> uname -m 2019-11-28T11:04:41.939 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2019-11-28T11:04:41.940 INFO:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2019-11-28T11:04:42.042 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Red Hat Enterprise Linux Server" 2019-11-28T11:04:42.043 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="7.7 (Maipo)" 2019-11-28T11:04:42.043 INFO:teuthology.orchestra.run.smithi080.stdout:ID="rhel" 2019-11-28T11:04:42.043 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="fedora" 2019-11-28T11:04:42.043 INFO:teuthology.orchestra.run.smithi080.stdout:VARIANT="Server" 2019-11-28T11:04:42.043 INFO:teuthology.orchestra.run.smithi080.stdout:VARIANT_ID="server" 2019-11-28T11:04:42.043 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="7.7" 2019-11-28T11:04:42.043 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Employee SKU" 2019-11-28T11:04:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2019-11-28T11:04:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.7:GA:server" 2019-11-28T11:04:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.redhat.com/" 2019-11-28T11:04:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2019-11-28T11:04:42.044 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:04:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2019-11-28T11:04:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.7 2019-11-28T11:04:42.045 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2019-11-28T11:04:42.045 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.7" 2019-11-28T11:04:42.046 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2019-11-28T11:04:42.058 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2019-11-28T11:04:42.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:04:42.059 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:04:42.149 INFO:teuthology.orchestra.run.smithi174:> true 2019-11-28T11:04:42.409 INFO:teuthology.orchestra.run.smithi174:> uname -m 2019-11-28T11:04:42.455 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2019-11-28T11:04:42.455 INFO:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2019-11-28T11:04:42.568 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux Server" 2019-11-28T11:04:42.568 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="7.7 (Maipo)" 2019-11-28T11:04:42.569 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel" 2019-11-28T11:04:42.569 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora" 2019-11-28T11:04:42.569 INFO:teuthology.orchestra.run.smithi174.stdout:VARIANT="Server" 2019-11-28T11:04:42.569 INFO:teuthology.orchestra.run.smithi174.stdout:VARIANT_ID="server" 2019-11-28T11:04:42.569 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="7.7" 2019-11-28T11:04:42.569 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Employee SKU" 2019-11-28T11:04:42.570 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2019-11-28T11:04:42.570 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.7:GA:server" 2019-11-28T11:04:42.570 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/" 2019-11-28T11:04:42.570 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2019-11-28T11:04:42.570 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-28T11:04:42.570 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2019-11-28T11:04:42.570 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.7 2019-11-28T11:04:42.571 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2019-11-28T11:04:42.571 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.7" 2019-11-28T11:04:42.571 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2019-11-28T11:04:42.587 INFO:teuthology.lock.ops:Updating [smithi075.front.sepia.ceph.com]: set os type and version on server 2019-11-28T11:04:42.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:04:42.588 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi075.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:04:42.677 INFO:teuthology.orchestra.run.smithi075:> true 2019-11-28T11:04:42.956 INFO:teuthology.orchestra.run.smithi075:> uname -m 2019-11-28T11:04:42.998 INFO:teuthology.orchestra.run.smithi075.stdout:x86_64 2019-11-28T11:04:42.999 INFO:teuthology.orchestra.run.smithi075:> cat /etc/os-release 2019-11-28T11:04:43.104 INFO:teuthology.orchestra.run.smithi075.stdout:NAME="Red Hat Enterprise Linux Server" 2019-11-28T11:04:43.105 INFO:teuthology.orchestra.run.smithi075.stdout:VERSION="7.7 (Maipo)" 2019-11-28T11:04:43.105 INFO:teuthology.orchestra.run.smithi075.stdout:ID="rhel" 2019-11-28T11:04:43.105 INFO:teuthology.orchestra.run.smithi075.stdout:ID_LIKE="fedora" 2019-11-28T11:04:43.105 INFO:teuthology.orchestra.run.smithi075.stdout:VARIANT="Server" 2019-11-28T11:04:43.105 INFO:teuthology.orchestra.run.smithi075.stdout:VARIANT_ID="server" 2019-11-28T11:04:43.106 INFO:teuthology.orchestra.run.smithi075.stdout:VERSION_ID="7.7" 2019-11-28T11:04:43.106 INFO:teuthology.orchestra.run.smithi075.stdout:PRETTY_NAME="Employee SKU" 2019-11-28T11:04:43.106 INFO:teuthology.orchestra.run.smithi075.stdout:ANSI_COLOR="0;31" 2019-11-28T11:04:43.107 INFO:teuthology.orchestra.run.smithi075.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.7:GA:server" 2019-11-28T11:04:43.107 INFO:teuthology.orchestra.run.smithi075.stdout:HOME_URL="https://www.redhat.com/" 2019-11-28T11:04:43.108 INFO:teuthology.orchestra.run.smithi075.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2019-11-28T11:04:43.108 INFO:teuthology.orchestra.run.smithi075.stdout: 2019-11-28T11:04:43.108 INFO:teuthology.orchestra.run.smithi075.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2019-11-28T11:04:43.108 INFO:teuthology.orchestra.run.smithi075.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.7 2019-11-28T11:04:43.108 INFO:teuthology.orchestra.run.smithi075.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2019-11-28T11:04:43.108 INFO:teuthology.orchestra.run.smithi075.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.7" 2019-11-28T11:04:43.110 INFO:teuthology.lock.ops:Updating smithi075.front.sepia.ceph.com on lock server 2019-11-28T11:04:43.126 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: set os type and version on server 2019-11-28T11:04:43.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:04:43.127 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:04:43.213 INFO:teuthology.orchestra.run.smithi076:> true 2019-11-28T11:04:43.473 INFO:teuthology.orchestra.run.smithi076:> uname -m 2019-11-28T11:04:43.517 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2019-11-28T11:04:43.518 INFO:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2019-11-28T11:04:43.622 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Red Hat Enterprise Linux Server" 2019-11-28T11:04:43.622 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="7.7 (Maipo)" 2019-11-28T11:04:43.623 INFO:teuthology.orchestra.run.smithi076.stdout:ID="rhel" 2019-11-28T11:04:43.623 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="fedora" 2019-11-28T11:04:43.623 INFO:teuthology.orchestra.run.smithi076.stdout:VARIANT="Server" 2019-11-28T11:04:43.623 INFO:teuthology.orchestra.run.smithi076.stdout:VARIANT_ID="server" 2019-11-28T11:04:43.623 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="7.7" 2019-11-28T11:04:43.623 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Employee SKU" 2019-11-28T11:04:43.623 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2019-11-28T11:04:43.624 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.7:GA:server" 2019-11-28T11:04:43.624 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.redhat.com/" 2019-11-28T11:04:43.624 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2019-11-28T11:04:43.624 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:04:43.624 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2019-11-28T11:04:43.624 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.7 2019-11-28T11:04:43.624 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2019-11-28T11:04:43.625 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.7" 2019-11-28T11:04:43.625 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2019-11-28T11:04:43.640 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2019-11-28T11:04:43.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:04:43.641 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:04:43.726 INFO:teuthology.orchestra.run.smithi016:> true 2019-11-28T11:04:43.994 INFO:teuthology.orchestra.run.smithi016:> uname -m 2019-11-28T11:04:44.038 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2019-11-28T11:04:44.038 INFO:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2019-11-28T11:04:44.142 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux Server" 2019-11-28T11:04:44.142 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="7.7 (Maipo)" 2019-11-28T11:04:44.142 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel" 2019-11-28T11:04:44.143 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora" 2019-11-28T11:04:44.143 INFO:teuthology.orchestra.run.smithi016.stdout:VARIANT="Server" 2019-11-28T11:04:44.143 INFO:teuthology.orchestra.run.smithi016.stdout:VARIANT_ID="server" 2019-11-28T11:04:44.143 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="7.7" 2019-11-28T11:04:44.143 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Employee SKU" 2019-11-28T11:04:44.143 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2019-11-28T11:04:44.143 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.7:GA:server" 2019-11-28T11:04:44.144 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/" 2019-11-28T11:04:44.144 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2019-11-28T11:04:44.144 INFO:teuthology.orchestra.run.smithi016.stdout: 2019-11-28T11:04:44.144 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2019-11-28T11:04:44.144 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.7 2019-11-28T11:04:44.144 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2019-11-28T11:04:44.144 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.7" 2019-11-28T11:04:44.146 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2019-11-28T11:04:44.160 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2019-11-28T11:04:44.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:04:44.160 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:04:44.245 INFO:teuthology.orchestra.run.smithi133:> true 2019-11-28T11:04:44.505 INFO:teuthology.orchestra.run.smithi133:> uname -m 2019-11-28T11:04:44.554 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2019-11-28T11:04:44.564 INFO:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2019-11-28T11:04:44.644 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux Server" 2019-11-28T11:04:44.645 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="7.7 (Maipo)" 2019-11-28T11:04:44.645 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel" 2019-11-28T11:04:44.652 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora" 2019-11-28T11:04:44.652 INFO:teuthology.orchestra.run.smithi133.stdout:VARIANT="Server" 2019-11-28T11:04:44.652 INFO:teuthology.orchestra.run.smithi133.stdout:VARIANT_ID="server" 2019-11-28T11:04:44.653 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="7.7" 2019-11-28T11:04:44.654 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Employee SKU" 2019-11-28T11:04:44.654 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2019-11-28T11:04:44.655 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.7:GA:server" 2019-11-28T11:04:44.656 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/" 2019-11-28T11:04:44.657 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2019-11-28T11:04:44.658 INFO:teuthology.orchestra.run.smithi133.stdout: 2019-11-28T11:04:44.659 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2019-11-28T11:04:44.659 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.7 2019-11-28T11:04:44.660 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2019-11-28T11:04:44.660 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.7" 2019-11-28T11:04:44.663 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2019-11-28T11:04:44.684 INFO:teuthology.task.internal.lock_machines:6 smithi machines locked this try, 6/6 locked so far 2019-11-28T11:04:44.775 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi016.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoCOWkCHcGObvU6EGzQiBzsFcb2bXtEHBwYu8v2PX3Rvo37GCYPru4tllszBnrEWTuE7MxRcwAFbMrUrW/7C56SP6Z6xNFQBupFfSOfuaAZoDN3fI0I174WRPO+LqYQSzynAlmgo+nyRSCERIclDW2Of8k+roEsM62li8MfcU6WRo2GTA2mZSom0TWm/rY8yzzqHURKwXURTcofYNp2X+Gl8p5AsVyK+fTyQKIrvpLoHX3n/+RKnVWRHhUs4TWGJt0AMiNIe1a/wid4Ewsty4DycSzFuTREPZWf5eZ6pTf+Mg6MBm35NwEWIsZpFaBmIoa1fVKNF8JEVBYPLlIXPXz smithi075.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCZDUaUr01PRhqSB/sVlELxWV4SRYzMm6uMlLyGGO57lzroeKm24XHcsaRa3w5FAjtW+lfkc89as4ZCMHq4b4GWi4jvQ4xsVc4aP43ww5fI71CS3oPW/Z7elfnZW9q0e5a14vqzFGoSxi7FFQ3NbquCnHFhMdbtwXsAMmmf0VMr/gYmL21Y1F18mheTgBaQx9jAzVokKZdV45Ovfsx0Fvbi3bAs5AX9X8yNADqDiurDyIJo9jxJRvPvTjEGN/i05yImKHdmY9fPmUxseUsOz6w7xdhvyNcpyiVhI4d5EhG9KgObvGLStbHKatTdcEz3RC82kNDzpwUzmawE816F+o8H smithi076.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDp81+uHeoTP8kIgyPhhVkW/TvGf+yqpQpO0SGDJcCbSYSLu6EFbD3rZWmec69wI3mN2nHUCMPH0Tuww71tmN6VvYvkJe8JESCWr4w4D2RRcBH8witFl8VsQTYBGTGRlDExuaOqbSHL5592DdgJQRk1iTbQqGebFqi0wTY87Jzun+JOk/t9AJsIEh9cj2xktMKTPBMFEtoUmCU2o44UsBtH3LKar2cEDII8sB5pwMLMQ7mLjihTgJochId4o9JnbShk71y43ltOrURp8oJs2bMpBCYhPUioY94tDQ/7X7EW4gHHA1/0h5KIjpos1ObvRSuELycuDvhmRqMvGkUTYuf7 smithi080.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9Hjbu3OGUxZJN1rV9I17TIRPE/wYHV57JQ2DEoTuhzteanYh15ofK1kzAujggDui/0R3UwbfcX65QFpfdYGEeKP0YtqH7LSsCPh7ISUz6OASUlL7Q81QtAqrb7flzKYeIn/Xhq6mhKU0x7MYKaTY4oFu7b85zORLoiZBoRKHR/r+MEC3NPXC18XJ1EwukX5dOE6vsumOgeT+5Yv1JeN3lQah6ewBDd7Jkb2tio7CMxeayNrjcuiaGTWtz7uosQoAwODL1l6niR0T1NnOs/TIXowSDXTFcpiVT+H4/A0gkwKgEpQfuNfYQrv1YP04P9oae1L86+is/JN8U8suOg/f/ smithi133.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo55AOXymOH1SjtyUZPfJsaG2fOMvmVvB710TveOyU3H/3OniF9tpYT+DlLB+Oe8tc3a11oxHxGWdeou9mCepLemVSxgA/8jl0cab48RyJWroL/dNJA5tgBfzBT9PNODLs6k/NyHcqXIinkvxcbOdj86HXX+K+cN7EQpVCRbsNPRS6hDyIiVjZb+6RiHmke+nOm7oxiArcU5oK+EWTZyAmb9Dqv5ZECFrqmMlkyTHsXbW+1RKKJC+NukeLhs5tAzHKBrCPzXOaapXcxuO/8nJ9OM7vEVlHQcwQS8RAWuyKOeLKNVqbesrm63evStTQ8GjQacGMEZvss9HSqrK1XnRd smithi174.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4b57fbVM9U1QGyPoKlUB3RN9HalUyRZesxl84qPzIvkzhlPknHjley0eciF1sS6A4zB/+0gpgCjxM9sDnNdyibcrfmYuAuK7Mfat+pz4aDDAdIEpUKXVKrg8ENxSHbYcs1kCcSfT30kPT++o8+oqNfGAqXaljsHNUP9RbvqetaNBWonfc3RWxGMwXQT80zbD26n6rg9TJ3cnwPaQWZg09U3Yp02D74whzUuQ2ahGo+z+myaWWX3rVi2KPpLgqIddsFdBvsySPMug/+ZMxNTvWscpr3F8eNfvx+Ewsppagv+HBKj1VI/QW4PYDhMHVCGqpD2co/NI8J5CnuSXiLOy/ 2019-11-28T11:04:44.775 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-28T11:04:44.834 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-11-28T11:04:44.852 INFO:teuthology.task.internal:Saving configuration 2019-11-28T11:04:44.881 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-11-28T11:04:44.892 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-11-28T11:04:44.906 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-28 10:58:39.509055', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi080.front.sepia.ceph.com', u'os_version': u'7.7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'rhel', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHqUJuGqJAFyl6axPmrc5uYOuTG7PEse9UWGJC2DcdKSf5+AGHpFBPnyPYb4Dh6liXE7klhXDqNFrhy3/h6z/Rs=', u'description': u'/home/teuthworker/archive/pdonnell-2019-11-27_23:36:14-kcephfs-wip-pdonnell-testing-20191127.175901-distro-basic-smithi/4548252'} 2019-11-28T11:04:44.919 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-28 10:58:39.509069', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi174.front.sepia.ceph.com', u'os_version': u'7.7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'rhel', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAXM9pNzqV8ATB+qQAu8o/W24XPBVxPnqEr6tjo61F9Q5SaMZXcSZTnafAjta4hCoYI1y2fGVJBTg5tkXdp0IbM=', u'description': u'/home/teuthworker/archive/pdonnell-2019-11-27_23:36:14-kcephfs-wip-pdonnell-testing-20191127.175901-distro-basic-smithi/4548252'} 2019-11-28T11:04:44.932 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-28 10:58:39.509084', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi076.front.sepia.ceph.com', u'os_version': u'7.7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'rhel', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKlYlpBAmW/VclHioL5rw1zK8pI295X2XempGZM52bk0Onw62PsCglKNeQFAM0Plz2ry83XNYd+UxVsmH+wCRS0=', u'description': u'/home/teuthworker/archive/pdonnell-2019-11-27_23:36:14-kcephfs-wip-pdonnell-testing-20191127.175901-distro-basic-smithi/4548252'} 2019-11-28T11:04:44.944 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-28 10:58:39.509098', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi016.front.sepia.ceph.com', u'os_version': u'7.7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'rhel', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHWA/qha5lvloV6QXRKGsA52iG5zK2IraxQYwRKoQz3HswaV/nha2UpBRHSxs9QQqOV0geEz1fM4c8NnHYbt11k=', u'description': u'/home/teuthworker/archive/pdonnell-2019-11-27_23:36:14-kcephfs-wip-pdonnell-testing-20191127.175901-distro-basic-smithi/4548252'} 2019-11-28T11:04:44.958 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-28 10:58:39.509040', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi075.front.sepia.ceph.com', u'os_version': u'7.7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'rhel', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAQdgN1dYXwomAx7L3JSszvur/lixPfIJyqhezjJ2NOxYBfE59mI0HouP5gxFf2WikWZFpGincjWUqiFkQywHwk=', u'description': u'/home/teuthworker/archive/pdonnell-2019-11-27_23:36:14-kcephfs-wip-pdonnell-testing-20191127.175901-distro-basic-smithi/4548252'} 2019-11-28T11:04:44.974 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-28 10:58:39.509020', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi133.front.sepia.ceph.com', u'os_version': u'7.7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'rhel', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBFS21cL5gZ+zwrzrkwB9RFpYle953N1Sq/2LhtcvFjr26snSqwdHqMGoxKteuTZUbeINTVxda+i+IHkeClE53o=', u'description': u'/home/teuthworker/archive/pdonnell-2019-11-27_23:36:14-kcephfs-wip-pdonnell-testing-20191127.175901-distro-basic-smithi/4548252'} 2019-11-28T11:04:44.975 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-11-28T11:04:44.989 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.b', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2019-11-28T11:04:44.989 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.c', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2019-11-28T11:04:44.989 INFO:teuthology.task.internal:roles: ubuntu@smithi076.front.sepia.ceph.com - ['client.0'] 2019-11-28T11:04:44.989 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['client.1'] 2019-11-28T11:04:44.989 INFO:teuthology.task.internal:roles: ubuntu@smithi075.front.sepia.ceph.com - ['client.2'] 2019-11-28T11:04:44.990 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['client.3'] 2019-11-28T11:04:44.990 INFO:teuthology.run_tasks:Running task console_log... 2019-11-28T11:04:45.482 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-11-28T11:04:45.483 INFO:teuthology.run_tasks:Running task internal.connect... 2019-11-28T11:04:45.494 INFO:teuthology.task.internal:Opening connections... 2019-11-28T11:04:45.494 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:04:45.495 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:04:45.611 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2019-11-28T11:04:45.613 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:04:45.732 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2019-11-28T11:04:45.733 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:04:45.818 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi075.front.sepia.ceph.com 2019-11-28T11:04:45.819 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi075.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:04:45.904 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2019-11-28T11:04:45.905 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:04:45.999 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2019-11-28T11:04:46.000 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi080.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:04:46.093 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-11-28T11:04:46.102 INFO:teuthology.orchestra.run.smithi076:> uname -m 2019-11-28T11:04:46.163 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2019-11-28T11:04:46.163 INFO:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2019-11-28T11:04:46.204 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Red Hat Enterprise Linux Server" 2019-11-28T11:04:46.204 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="7.7 (Maipo)" 2019-11-28T11:04:46.204 INFO:teuthology.orchestra.run.smithi076.stdout:ID="rhel" 2019-11-28T11:04:46.205 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="fedora" 2019-11-28T11:04:46.205 INFO:teuthology.orchestra.run.smithi076.stdout:VARIANT="Server" 2019-11-28T11:04:46.205 INFO:teuthology.orchestra.run.smithi076.stdout:VARIANT_ID="server" 2019-11-28T11:04:46.205 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="7.7" 2019-11-28T11:04:46.206 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Employee SKU" 2019-11-28T11:04:46.206 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2019-11-28T11:04:46.206 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.7:GA:server" 2019-11-28T11:04:46.206 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.redhat.com/" 2019-11-28T11:04:46.206 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2019-11-28T11:04:46.207 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:04:46.207 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2019-11-28T11:04:46.207 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.7 2019-11-28T11:04:46.207 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2019-11-28T11:04:46.207 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.7" 2019-11-28T11:04:46.208 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2019-11-28T11:04:46.222 INFO:teuthology.orchestra.run.smithi133:> uname -m 2019-11-28T11:04:46.285 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2019-11-28T11:04:46.286 INFO:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2019-11-28T11:04:46.327 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux Server" 2019-11-28T11:04:46.327 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="7.7 (Maipo)" 2019-11-28T11:04:46.327 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel" 2019-11-28T11:04:46.327 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora" 2019-11-28T11:04:46.327 INFO:teuthology.orchestra.run.smithi133.stdout:VARIANT="Server" 2019-11-28T11:04:46.327 INFO:teuthology.orchestra.run.smithi133.stdout:VARIANT_ID="server" 2019-11-28T11:04:46.328 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="7.7" 2019-11-28T11:04:46.328 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Employee SKU" 2019-11-28T11:04:46.328 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2019-11-28T11:04:46.328 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.7:GA:server" 2019-11-28T11:04:46.328 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/" 2019-11-28T11:04:46.328 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2019-11-28T11:04:46.329 INFO:teuthology.orchestra.run.smithi133.stdout: 2019-11-28T11:04:46.329 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2019-11-28T11:04:46.329 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.7 2019-11-28T11:04:46.329 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2019-11-28T11:04:46.329 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.7" 2019-11-28T11:04:46.329 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2019-11-28T11:04:46.341 INFO:teuthology.orchestra.run.smithi174:> uname -m 2019-11-28T11:04:46.403 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2019-11-28T11:04:46.403 INFO:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2019-11-28T11:04:46.444 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux Server" 2019-11-28T11:04:46.444 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="7.7 (Maipo)" 2019-11-28T11:04:46.445 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel" 2019-11-28T11:04:46.445 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora" 2019-11-28T11:04:46.445 INFO:teuthology.orchestra.run.smithi174.stdout:VARIANT="Server" 2019-11-28T11:04:46.445 INFO:teuthology.orchestra.run.smithi174.stdout:VARIANT_ID="server" 2019-11-28T11:04:46.445 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="7.7" 2019-11-28T11:04:46.446 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Employee SKU" 2019-11-28T11:04:46.446 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2019-11-28T11:04:46.446 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.7:GA:server" 2019-11-28T11:04:46.446 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/" 2019-11-28T11:04:46.446 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2019-11-28T11:04:46.447 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-28T11:04:46.447 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2019-11-28T11:04:46.447 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.7 2019-11-28T11:04:46.448 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2019-11-28T11:04:46.448 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.7" 2019-11-28T11:04:46.448 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2019-11-28T11:04:46.465 INFO:teuthology.orchestra.run.smithi075:> uname -m 2019-11-28T11:04:46.530 INFO:teuthology.orchestra.run.smithi075.stdout:x86_64 2019-11-28T11:04:46.530 INFO:teuthology.orchestra.run.smithi075:> cat /etc/os-release 2019-11-28T11:04:46.571 INFO:teuthology.orchestra.run.smithi075.stdout:NAME="Red Hat Enterprise Linux Server" 2019-11-28T11:04:46.571 INFO:teuthology.orchestra.run.smithi075.stdout:VERSION="7.7 (Maipo)" 2019-11-28T11:04:46.571 INFO:teuthology.orchestra.run.smithi075.stdout:ID="rhel" 2019-11-28T11:04:46.572 INFO:teuthology.orchestra.run.smithi075.stdout:ID_LIKE="fedora" 2019-11-28T11:04:46.572 INFO:teuthology.orchestra.run.smithi075.stdout:VARIANT="Server" 2019-11-28T11:04:46.572 INFO:teuthology.orchestra.run.smithi075.stdout:VARIANT_ID="server" 2019-11-28T11:04:46.572 INFO:teuthology.orchestra.run.smithi075.stdout:VERSION_ID="7.7" 2019-11-28T11:04:46.572 INFO:teuthology.orchestra.run.smithi075.stdout:PRETTY_NAME="Employee SKU" 2019-11-28T11:04:46.572 INFO:teuthology.orchestra.run.smithi075.stdout:ANSI_COLOR="0;31" 2019-11-28T11:04:46.573 INFO:teuthology.orchestra.run.smithi075.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.7:GA:server" 2019-11-28T11:04:46.573 INFO:teuthology.orchestra.run.smithi075.stdout:HOME_URL="https://www.redhat.com/" 2019-11-28T11:04:46.573 INFO:teuthology.orchestra.run.smithi075.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2019-11-28T11:04:46.573 INFO:teuthology.orchestra.run.smithi075.stdout: 2019-11-28T11:04:46.573 INFO:teuthology.orchestra.run.smithi075.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2019-11-28T11:04:46.574 INFO:teuthology.orchestra.run.smithi075.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.7 2019-11-28T11:04:46.574 INFO:teuthology.orchestra.run.smithi075.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2019-11-28T11:04:46.574 INFO:teuthology.orchestra.run.smithi075.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.7" 2019-11-28T11:04:46.575 INFO:teuthology.lock.ops:Updating smithi075.front.sepia.ceph.com on lock server 2019-11-28T11:04:46.597 INFO:teuthology.orchestra.run.smithi016:> uname -m 2019-11-28T11:04:46.662 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2019-11-28T11:04:46.663 INFO:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2019-11-28T11:04:46.706 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux Server" 2019-11-28T11:04:46.706 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="7.7 (Maipo)" 2019-11-28T11:04:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel" 2019-11-28T11:04:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora" 2019-11-28T11:04:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:VARIANT="Server" 2019-11-28T11:04:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:VARIANT_ID="server" 2019-11-28T11:04:46.707 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="7.7" 2019-11-28T11:04:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Employee SKU" 2019-11-28T11:04:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2019-11-28T11:04:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.7:GA:server" 2019-11-28T11:04:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/" 2019-11-28T11:04:46.708 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2019-11-28T11:04:46.709 INFO:teuthology.orchestra.run.smithi016.stdout: 2019-11-28T11:04:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2019-11-28T11:04:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.7 2019-11-28T11:04:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2019-11-28T11:04:46.710 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.7" 2019-11-28T11:04:46.710 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2019-11-28T11:04:46.723 INFO:teuthology.orchestra.run.smithi080:> uname -m 2019-11-28T11:04:46.782 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2019-11-28T11:04:46.783 INFO:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2019-11-28T11:04:46.823 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Red Hat Enterprise Linux Server" 2019-11-28T11:04:46.823 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="7.7 (Maipo)" 2019-11-28T11:04:46.823 INFO:teuthology.orchestra.run.smithi080.stdout:ID="rhel" 2019-11-28T11:04:46.824 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="fedora" 2019-11-28T11:04:46.824 INFO:teuthology.orchestra.run.smithi080.stdout:VARIANT="Server" 2019-11-28T11:04:46.824 INFO:teuthology.orchestra.run.smithi080.stdout:VARIANT_ID="server" 2019-11-28T11:04:46.824 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="7.7" 2019-11-28T11:04:46.824 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Employee SKU" 2019-11-28T11:04:46.824 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2019-11-28T11:04:46.824 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.7:GA:server" 2019-11-28T11:04:46.825 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.redhat.com/" 2019-11-28T11:04:46.825 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2019-11-28T11:04:46.825 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:04:46.825 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2019-11-28T11:04:46.825 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.7 2019-11-28T11:04:46.825 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2019-11-28T11:04:46.826 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.7" 2019-11-28T11:04:46.827 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2019-11-28T11:04:46.839 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-11-28T11:04:46.877 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-11-28T11:04:46.886 INFO:teuthology.task.internal:Checking for old test directory... 2019-11-28T11:04:46.887 INFO:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2019-11-28T11:04:46.891 INFO:teuthology.orchestra.run.smithi075:> test '!' -e /home/ubuntu/cephtest 2019-11-28T11:04:46.896 INFO:teuthology.orchestra.run.smithi076:> test '!' -e /home/ubuntu/cephtest 2019-11-28T11:04:46.900 INFO:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2019-11-28T11:04:46.905 INFO:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2019-11-28T11:04:46.910 INFO:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2019-11-28T11:04:46.951 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-11-28T11:04:46.967 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-11-28T11:04:46.967 INFO:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2019-11-28T11:04:46.972 INFO:teuthology.orchestra.run.smithi075:> test -z $(ls -A /var/lib/ceph) 2019-11-28T11:04:46.977 INFO:teuthology.orchestra.run.smithi076:> test -z $(ls -A /var/lib/ceph) 2019-11-28T11:04:46.981 INFO:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2019-11-28T11:04:46.986 INFO:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2019-11-28T11:04:46.996 INFO:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2019-11-28T11:04:47.049 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-11-28T11:04:47.150 INFO:teuthology.run_tasks:Running task kernel... 2019-11-28T11:04:47.171 DEBUG:teuthology.task.kernel:normalized config {'client.3': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.0': {'sha1': 'distro'}} 2019-11-28T11:04:47.172 INFO:teuthology.task.kernel:config {'client.3': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.0': {'sha1': 'distro'}}, timeout 300 2019-11-28T11:04:47.172 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:04:47.173 INFO:teuthology.orchestra.run.smithi076:> sudo package-cleanup -y --oldkernels 2019-11-28T11:04:48.216 INFO:teuthology.orchestra.run.smithi076.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription- 2019-11-28T11:04:48.216 INFO:teuthology.orchestra.run.smithi076.stdout: : manager 2019-11-28T11:04:48.594 INFO:teuthology.orchestra.run.smithi076.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2019-11-28T11:04:50.356 INFO:teuthology.orchestra.run.smithi076.stdout:No old kernels to remove 2019-11-28T11:04:50.374 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi133.front.sepia.ceph.com 2019-11-28T11:04:50.375 INFO:teuthology.orchestra.run.smithi133:> sudo package-cleanup -y --oldkernels 2019-11-28T11:04:51.340 INFO:teuthology.orchestra.run.smithi133.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription- 2019-11-28T11:04:51.340 INFO:teuthology.orchestra.run.smithi133.stdout: : manager 2019-11-28T11:04:51.659 INFO:teuthology.orchestra.run.smithi133.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2019-11-28T11:04:53.392 INFO:teuthology.orchestra.run.smithi133.stdout:No old kernels to remove 2019-11-28T11:04:53.407 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi174.front.sepia.ceph.com 2019-11-28T11:04:53.407 INFO:teuthology.orchestra.run.smithi174:> sudo package-cleanup -y --oldkernels 2019-11-28T11:04:54.499 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription- 2019-11-28T11:04:54.500 INFO:teuthology.orchestra.run.smithi174.stdout: : manager 2019-11-28T11:04:54.920 INFO:teuthology.orchestra.run.smithi174.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2019-11-28T11:04:56.662 INFO:teuthology.orchestra.run.smithi174.stdout:No old kernels to remove 2019-11-28T11:04:56.673 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi075.front.sepia.ceph.com 2019-11-28T11:04:56.673 INFO:teuthology.orchestra.run.smithi075:> sudo package-cleanup -y --oldkernels 2019-11-28T11:04:57.765 INFO:teuthology.orchestra.run.smithi075.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription- 2019-11-28T11:04:57.765 INFO:teuthology.orchestra.run.smithi075.stdout: : manager 2019-11-28T11:04:58.076 INFO:teuthology.orchestra.run.smithi075.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2019-11-28T11:04:59.812 INFO:teuthology.orchestra.run.smithi075.stdout:No old kernels to remove 2019-11-28T11:04:59.827 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi016.front.sepia.ceph.com 2019-11-28T11:04:59.828 INFO:teuthology.orchestra.run.smithi016:> sudo package-cleanup -y --oldkernels 2019-11-28T11:05:00.889 INFO:teuthology.orchestra.run.smithi016.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription- 2019-11-28T11:05:00.889 INFO:teuthology.orchestra.run.smithi016.stdout: : manager 2019-11-28T11:05:01.237 INFO:teuthology.orchestra.run.smithi016.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2019-11-28T11:05:03.116 INFO:teuthology.orchestra.run.smithi016.stdout:No old kernels to remove 2019-11-28T11:05:03.133 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi080.front.sepia.ceph.com 2019-11-28T11:05:03.133 INFO:teuthology.orchestra.run.smithi080:> sudo package-cleanup -y --oldkernels 2019-11-28T11:05:04.190 INFO:teuthology.orchestra.run.smithi080.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription- 2019-11-28T11:05:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: : manager 2019-11-28T11:05:04.454 INFO:teuthology.orchestra.run.smithi080.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2019-11-28T11:05:06.269 INFO:teuthology.orchestra.run.smithi080.stdout:No old kernels to remove 2019-11-28T11:05:06.285 INFO:teuthology.orchestra.run.smithi133:> uname -r 2019-11-28T11:05:06.338 INFO:teuthology.orchestra.run.smithi133.stdout:3.10.0-1062.4.1.el7.x86_64 2019-11-28T11:05:06.338 INFO:teuthology.task.kernel:Running kernel on smithi133: 3.10.0-1062.4.1.el7.x86_64 2019-11-28T11:05:06.339 INFO:teuthology.orchestra.run.smithi133:> sudo yum install -y kernel 2019-11-28T11:05:06.569 INFO:teuthology.orchestra.run.smithi133.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:05:06.569 INFO:teuthology.orchestra.run.smithi133.stdout: : disabled-repos, subscription-manager 2019-11-28T11:05:06.764 INFO:teuthology.orchestra.run.smithi133.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2019-11-28T11:05:06.770 INFO:teuthology.orchestra.run.smithi133.stdout:Determining fastest mirrors 2019-11-28T11:05:06.845 INFO:teuthology.orchestra.run.smithi133.stdout: * epel: ftp.linux.ncsu.edu 2019-11-28T11:05:07.801 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do 2019-11-28T11:05:07.818 INFO:teuthology.orchestra.run.smithi133:> echo no | sudo yum reinstall kernel || true 2019-11-28T11:05:08.009 INFO:teuthology.orchestra.run.smithi133.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:05:08.009 INFO:teuthology.orchestra.run.smithi133.stdout: : disabled-repos, subscription-manager 2019-11-28T11:05:08.244 INFO:teuthology.orchestra.run.smithi133.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2019-11-28T11:05:08.288 INFO:teuthology.orchestra.run.smithi133.stderr:Skipping the running kernel: kernel-3.10.0-1062.4.1.el7.x86_64 2019-11-28T11:05:08.308 INFO:teuthology.orchestra.run.smithi133.stdout:Loading mirror speeds from cached hostfile 2019-11-28T11:05:08.309 INFO:teuthology.orchestra.run.smithi133.stdout: * epel: ftp.linux.ncsu.edu 2019-11-28T11:05:08.313 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-3.10.0-1062.el7.x86_64 (from anaconda) not available. 2019-11-28T11:05:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:Error: Nothing to do 2019-11-28T11:05:08.330 INFO:teuthology.orchestra.run.smithi133:> rpm -q kernel --last | head -n 1 2019-11-28T11:05:08.527 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-3.10.0-1062.4.1.el7.x86_64 Tue 05 Nov 2019 03:48:11 PM UTC 2019-11-28T11:05:08.528 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.1.el7.x86_64 2019-11-28T11:05:08.528 INFO:teuthology.orchestra.run.smithi075:> uname -r 2019-11-28T11:05:08.578 INFO:teuthology.orchestra.run.smithi075.stdout:3.10.0-1062.4.1.el7.x86_64 2019-11-28T11:05:08.578 INFO:teuthology.task.kernel:Running kernel on smithi075: 3.10.0-1062.4.1.el7.x86_64 2019-11-28T11:05:08.579 INFO:teuthology.orchestra.run.smithi075:> sudo yum install -y kernel 2019-11-28T11:05:08.791 INFO:teuthology.orchestra.run.smithi075.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:05:08.792 INFO:teuthology.orchestra.run.smithi075.stdout: : disabled-repos, subscription-manager 2019-11-28T11:05:09.018 INFO:teuthology.orchestra.run.smithi075.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2019-11-28T11:05:09.024 INFO:teuthology.orchestra.run.smithi075.stdout:Determining fastest mirrors 2019-11-28T11:05:09.099 INFO:teuthology.orchestra.run.smithi075.stdout: * epel: ftp.linux.ncsu.edu 2019-11-28T11:05:10.028 INFO:teuthology.orchestra.run.smithi075.stdout:Nothing to do 2019-11-28T11:05:10.045 INFO:teuthology.orchestra.run.smithi075:> echo no | sudo yum reinstall kernel || true 2019-11-28T11:05:10.242 INFO:teuthology.orchestra.run.smithi075.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:05:10.242 INFO:teuthology.orchestra.run.smithi075.stdout: : disabled-repos, subscription-manager 2019-11-28T11:05:10.493 INFO:teuthology.orchestra.run.smithi075.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2019-11-28T11:05:10.537 INFO:teuthology.orchestra.run.smithi075.stderr:Skipping the running kernel: kernel-3.10.0-1062.4.1.el7.x86_64 2019-11-28T11:05:10.556 INFO:teuthology.orchestra.run.smithi075.stdout:Loading mirror speeds from cached hostfile 2019-11-28T11:05:10.556 INFO:teuthology.orchestra.run.smithi075.stdout: * epel: ftp.linux.ncsu.edu 2019-11-28T11:05:10.560 INFO:teuthology.orchestra.run.smithi075.stdout:Installed package kernel-3.10.0-1062.el7.x86_64 (from anaconda) not available. 2019-11-28T11:05:10.560 INFO:teuthology.orchestra.run.smithi075.stderr:Error: Nothing to do 2019-11-28T11:05:10.576 INFO:teuthology.orchestra.run.smithi075:> rpm -q kernel --last | head -n 1 2019-11-28T11:05:10.761 INFO:teuthology.orchestra.run.smithi075.stdout:kernel-3.10.0-1062.4.1.el7.x86_64 Tue 05 Nov 2019 03:48:11 PM UTC 2019-11-28T11:05:10.762 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.1.el7.x86_64 2019-11-28T11:05:10.763 INFO:teuthology.orchestra.run.smithi016:> uname -r 2019-11-28T11:05:10.814 INFO:teuthology.orchestra.run.smithi016.stdout:3.10.0-1062.4.1.el7.x86_64 2019-11-28T11:05:10.815 INFO:teuthology.task.kernel:Running kernel on smithi016: 3.10.0-1062.4.1.el7.x86_64 2019-11-28T11:05:10.815 INFO:teuthology.orchestra.run.smithi016:> sudo yum install -y kernel 2019-11-28T11:05:11.044 INFO:teuthology.orchestra.run.smithi016.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:05:11.044 INFO:teuthology.orchestra.run.smithi016.stdout: : disabled-repos, subscription-manager 2019-11-28T11:05:11.277 INFO:teuthology.orchestra.run.smithi016.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2019-11-28T11:05:11.282 INFO:teuthology.orchestra.run.smithi016.stdout:Determining fastest mirrors 2019-11-28T11:05:11.357 INFO:teuthology.orchestra.run.smithi016.stdout: * epel: ftp.linux.ncsu.edu 2019-11-28T11:05:12.344 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do 2019-11-28T11:05:12.363 INFO:teuthology.orchestra.run.smithi016:> echo no | sudo yum reinstall kernel || true 2019-11-28T11:05:12.571 INFO:teuthology.orchestra.run.smithi016.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:05:12.571 INFO:teuthology.orchestra.run.smithi016.stdout: : disabled-repos, subscription-manager 2019-11-28T11:05:12.797 INFO:teuthology.orchestra.run.smithi016.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2019-11-28T11:05:12.843 INFO:teuthology.orchestra.run.smithi016.stderr:Skipping the running kernel: kernel-3.10.0-1062.4.1.el7.x86_64 2019-11-28T11:05:12.865 INFO:teuthology.orchestra.run.smithi016.stdout:Loading mirror speeds from cached hostfile 2019-11-28T11:05:12.866 INFO:teuthology.orchestra.run.smithi016.stdout: * epel: ftp.linux.ncsu.edu 2019-11-28T11:05:12.871 INFO:teuthology.orchestra.run.smithi016.stdout:Installed package kernel-3.10.0-1062.el7.x86_64 (from anaconda) not available. 2019-11-28T11:05:12.871 INFO:teuthology.orchestra.run.smithi016.stderr:Error: Nothing to do 2019-11-28T11:05:12.893 INFO:teuthology.orchestra.run.smithi016:> rpm -q kernel --last | head -n 1 2019-11-28T11:05:13.101 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-3.10.0-1062.4.1.el7.x86_64 Tue 05 Nov 2019 03:48:11 PM UTC 2019-11-28T11:05:13.103 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.1.el7.x86_64 2019-11-28T11:05:13.103 INFO:teuthology.orchestra.run.smithi076:> uname -r 2019-11-28T11:05:13.167 INFO:teuthology.orchestra.run.smithi076.stdout:3.10.0-1062.4.1.el7.x86_64 2019-11-28T11:05:13.167 INFO:teuthology.task.kernel:Running kernel on smithi076: 3.10.0-1062.4.1.el7.x86_64 2019-11-28T11:05:13.168 INFO:teuthology.orchestra.run.smithi076:> sudo yum install -y kernel 2019-11-28T11:05:13.393 INFO:teuthology.orchestra.run.smithi076.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:05:13.393 INFO:teuthology.orchestra.run.smithi076.stdout: : disabled-repos, subscription-manager 2019-11-28T11:05:13.532 INFO:teuthology.orchestra.run.smithi076.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2019-11-28T11:05:13.538 INFO:teuthology.orchestra.run.smithi076.stdout:Determining fastest mirrors 2019-11-28T11:05:13.613 INFO:teuthology.orchestra.run.smithi076.stdout: * epel: ftp.linux.ncsu.edu 2019-11-28T11:05:14.537 INFO:teuthology.orchestra.run.smithi076.stdout:Nothing to do 2019-11-28T11:05:14.554 INFO:teuthology.orchestra.run.smithi076:> echo no | sudo yum reinstall kernel || true 2019-11-28T11:05:14.747 INFO:teuthology.orchestra.run.smithi076.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:05:14.747 INFO:teuthology.orchestra.run.smithi076.stdout: : disabled-repos, subscription-manager 2019-11-28T11:05:14.857 INFO:teuthology.orchestra.run.smithi076.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2019-11-28T11:05:14.902 INFO:teuthology.orchestra.run.smithi076.stderr:Skipping the running kernel: kernel-3.10.0-1062.4.1.el7.x86_64 2019-11-28T11:05:14.931 INFO:teuthology.orchestra.run.smithi076.stdout:Loading mirror speeds from cached hostfile 2019-11-28T11:05:14.931 INFO:teuthology.orchestra.run.smithi076.stdout: * epel: ftp.linux.ncsu.edu 2019-11-28T11:05:14.936 INFO:teuthology.orchestra.run.smithi076.stdout:Installed package kernel-3.10.0-1062.el7.x86_64 (from anaconda) not available. 2019-11-28T11:05:14.936 INFO:teuthology.orchestra.run.smithi076.stderr:Error: Nothing to do 2019-11-28T11:05:14.952 INFO:teuthology.orchestra.run.smithi076:> rpm -q kernel --last | head -n 1 2019-11-28T11:05:15.142 INFO:teuthology.orchestra.run.smithi076.stdout:kernel-3.10.0-1062.4.1.el7.x86_64 Tue 05 Nov 2019 03:48:11 PM UTC 2019-11-28T11:05:15.145 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.1.el7.x86_64 2019-11-28T11:05:15.145 INFO:teuthology.run_tasks:Running task internal.base... 2019-11-28T11:05:15.188 INFO:teuthology.task.internal:Creating test directory... 2019-11-28T11:05:15.188 INFO:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-28T11:05:15.198 INFO:teuthology.orchestra.run.smithi075:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-28T11:05:15.209 INFO:teuthology.orchestra.run.smithi076:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-28T11:05:15.217 INFO:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-28T11:05:15.229 INFO:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-28T11:05:15.241 INFO:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-28T11:05:15.301 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-11-28T11:05:15.313 INFO:teuthology.run_tasks:Running task internal.archive... 2019-11-28T11:05:15.330 INFO:teuthology.task.internal:Creating archive directory... 2019-11-28T11:05:15.331 INFO:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-28T11:05:15.336 INFO:teuthology.orchestra.run.smithi075:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-28T11:05:15.340 INFO:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-28T11:05:15.351 INFO:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-28T11:05:15.355 INFO:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-28T11:05:15.359 INFO:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-28T11:05:15.415 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-11-28T11:05:15.426 INFO:teuthology.task.internal:Enabling coredump saving... 2019-11-28T11:05:15.427 INFO:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-28T11:05:15.431 INFO:teuthology.orchestra.run.smithi075:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-28T11:05:15.435 INFO:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-28T11:05:15.439 INFO:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-28T11:05:15.444 INFO:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-28T11:05:15.448 INFO:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-28T11:05:15.486 INFO:teuthology.orchestra.run.smithi075.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-28T11:05:15.487 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-28T11:05:15.488 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-28T11:05:15.496 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-28T11:05:15.498 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-28T11:05:15.508 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-28T11:05:15.511 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-11-28T11:05:15.524 INFO:teuthology.task.internal:Configuring sudo... 2019-11-28T11:05:15.524 INFO:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-28T11:05:15.529 INFO:teuthology.orchestra.run.smithi075:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-28T11:05:15.533 INFO:teuthology.orchestra.run.smithi076:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-28T11:05:15.537 INFO:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-28T11:05:15.541 INFO:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-28T11:05:15.546 INFO:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-28T11:05:15.601 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-11-28T11:05:15.616 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-11-28T11:05:15.617 INFO:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-28T11:05:15.621 INFO:teuthology.orchestra.run.smithi075:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-28T11:05:15.625 INFO:teuthology.orchestra.run.smithi076:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-28T11:05:15.629 INFO:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-28T11:05:15.633 INFO:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-28T11:05:15.637 INFO:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-28T11:05:15.678 INFO:teuthology.orchestra.run.smithi076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-28T11:05:15.765 INFO:teuthology.orchestra.run.smithi076:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-28T11:05:15.854 INFO:teuthology.orchestra.run.smithi076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-28T11:05:15.912 INFO:teuthology.orchestra.run.smithi076:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-28T11:05:15.995 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-28T11:05:16.048 INFO:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-28T11:05:16.106 INFO:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-28T11:05:16.203 INFO:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-28T11:05:16.263 INFO:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-28T11:05:16.349 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-28T11:05:16.409 INFO:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-28T11:05:16.471 INFO:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-28T11:05:16.574 INFO:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-28T11:05:16.633 INFO:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-28T11:05:16.718 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-28T11:05:16.771 INFO:teuthology.orchestra.run.smithi075:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-28T11:05:16.835 INFO:teuthology.orchestra.run.smithi075:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-28T11:05:16.927 INFO:teuthology.orchestra.run.smithi075:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-28T11:05:16.995 INFO:teuthology.orchestra.run.smithi075:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-28T11:05:17.067 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-28T11:05:17.128 INFO:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-28T11:05:17.196 INFO:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-28T11:05:17.263 INFO:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-28T11:05:17.321 INFO:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-28T11:05:17.379 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-28T11:05:17.436 INFO:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-28T11:05:17.496 INFO:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-28T11:05:17.576 INFO:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-28T11:05:17.633 INFO:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-28T11:05:17.716 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-28T11:05:17.770 INFO:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2019-11-28T11:05:17.775 INFO:teuthology.orchestra.run.smithi075:> sudo service rsyslog restart 2019-11-28T11:05:17.780 INFO:teuthology.orchestra.run.smithi076:> sudo service rsyslog restart 2019-11-28T11:05:17.790 INFO:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2019-11-28T11:05:17.825 INFO:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2019-11-28T11:05:17.830 INFO:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2019-11-28T11:05:17.854 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-28T11:05:17.856 INFO:teuthology.orchestra.run.smithi075.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-28T11:05:17.857 INFO:teuthology.orchestra.run.smithi076.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-28T11:05:17.901 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-28T11:05:17.907 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-28T11:05:17.926 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-28T11:05:17.978 INFO:teuthology.run_tasks:Running task internal.timer... 2019-11-28T11:05:17.998 INFO:teuthology.task.internal:Starting timer... 2019-11-28T11:05:17.998 INFO:teuthology.run_tasks:Running task pcp... 2019-11-28T11:05:18.047 INFO:teuthology.run_tasks:Running task selinux... 2019-11-28T11:05:18.066 INFO:teuthology.orchestra.run.smithi016:> sudo service auditd rotate 2019-11-28T11:05:18.153 INFO:teuthology.orchestra.run.smithi016.stdout:Rotating logs: [ OK ] 2019-11-28T11:05:18.155 INFO:teuthology.orchestra.run.smithi075:> sudo service auditd rotate 2019-11-28T11:05:18.243 INFO:teuthology.orchestra.run.smithi075.stdout:Rotating logs: [ OK ] 2019-11-28T11:05:18.245 INFO:teuthology.orchestra.run.smithi076:> sudo service auditd rotate 2019-11-28T11:05:18.331 INFO:teuthology.orchestra.run.smithi076.stdout:Rotating logs: [ OK ] 2019-11-28T11:05:18.331 INFO:teuthology.orchestra.run.smithi080:> sudo service auditd rotate 2019-11-28T11:05:18.422 INFO:teuthology.orchestra.run.smithi080.stdout:Rotating logs: [ OK ] 2019-11-28T11:05:18.424 INFO:teuthology.orchestra.run.smithi133:> sudo service auditd rotate 2019-11-28T11:05:18.517 INFO:teuthology.orchestra.run.smithi133.stdout:Rotating logs: [ OK ] 2019-11-28T11:05:18.518 INFO:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2019-11-28T11:05:18.614 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: [ OK ] 2019-11-28T11:05:18.616 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-11-28T11:05:18.616 INFO:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2019-11-28T11:05:18.666 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2019-11-28T11:05:18.667 INFO:teuthology.orchestra.run.smithi133:> /usr/sbin/getenforce 2019-11-28T11:05:18.737 INFO:teuthology.orchestra.run.smithi133.stdout:Permissive 2019-11-28T11:05:18.738 INFO:teuthology.orchestra.run.smithi076:> /usr/sbin/getenforce 2019-11-28T11:05:18.792 INFO:teuthology.orchestra.run.smithi076.stdout:Permissive 2019-11-28T11:05:18.793 INFO:teuthology.orchestra.run.smithi075:> /usr/sbin/getenforce 2019-11-28T11:05:18.857 INFO:teuthology.orchestra.run.smithi075.stdout:Permissive 2019-11-28T11:05:18.857 INFO:teuthology.orchestra.run.smithi016:> /usr/sbin/getenforce 2019-11-28T11:05:18.910 INFO:teuthology.orchestra.run.smithi016.stdout:Permissive 2019-11-28T11:05:18.910 INFO:teuthology.orchestra.run.smithi080:> /usr/sbin/getenforce 2019-11-28T11:05:18.958 INFO:teuthology.orchestra.run.smithi080.stdout:Permissive 2019-11-28T11:05:18.959 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi080.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi174.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi075.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi133.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi016.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi076.front.sepia.ceph.com': 'permissive'} 2019-11-28T11:05:18.959 INFO:teuthology.orchestra.run.smithi174:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-28T11:05:19.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-28T11:05:19.015 INFO:teuthology.orchestra.run.smithi133:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-28T11:05:19.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-28T11:05:19.074 INFO:teuthology.orchestra.run.smithi076:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-28T11:05:19.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-28T11:05:19.132 INFO:teuthology.orchestra.run.smithi075:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-28T11:05:19.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-28T11:05:19.188 INFO:teuthology.orchestra.run.smithi016:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-28T11:05:19.266 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-28T11:05:19.267 INFO:teuthology.orchestra.run.smithi080:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-28T11:05:19.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-28T11:05:19.322 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-11-28T11:05:19.323 INFO:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2019-11-28T11:05:19.385 INFO:teuthology.orchestra.run.smithi133:> sudo /usr/sbin/setenforce permissive 2019-11-28T11:05:19.455 INFO:teuthology.orchestra.run.smithi076:> sudo /usr/sbin/setenforce permissive 2019-11-28T11:05:19.526 INFO:teuthology.orchestra.run.smithi075:> sudo /usr/sbin/setenforce permissive 2019-11-28T11:05:19.589 INFO:teuthology.orchestra.run.smithi016:> sudo /usr/sbin/setenforce permissive 2019-11-28T11:05:19.666 INFO:teuthology.orchestra.run.smithi080:> sudo /usr/sbin/setenforce permissive 2019-11-28T11:05:19.736 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-11-28T11:05:19.746 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2019-11-28T11:05:19.746 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2019-11-28T11:05:19.788 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-11-28T11:05:19.792 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi076.front.sepia.ceph.com,smithi133.front.sepia.ceph.com,smithi174.front.sepia.ceph.com,smithi075.front.sepia.ceph.com,smithi016.front.sepia.ceph.com,smithi080.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-11-28T11:05:20.201 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-11-28T11:05:24.026 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-11-28T11:05:24.051 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:24 +0000 (0:00:00.068) 0:00:00.068 ***** 2019-11-28T11:05:24.063 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:24 +0000 (0:00:00.012) 0:00:00.080 ***** 2019-11-28T11:05:24.076 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:24 +0000 (0:00:00.011) 0:00:00.092 ***** 2019-11-28T11:05:24.088 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:24 +0000 (0:00:00.011) 0:00:00.104 ***** 2019-11-28T11:05:24.099 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:24 +0000 (0:00:00.011) 0:00:00.116 ***** 2019-11-28T11:05:24.124 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:24 +0000 (0:00:00.012) 0:00:00.128 ***** 2019-11-28T11:05:26.674 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi075.front.sepia.ceph.com] 2019-11-28T11:05:26.700 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] 2019-11-28T11:05:26.712 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] 2019-11-28T11:05:26.809 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] 2019-11-28T11:05:26.819 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] 2019-11-28T11:05:26.881 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:26 +0000 (0:00:02.770) 0:00:02.899 ***** 2019-11-28T11:05:26.936 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:26 +0000 (0:00:00.054) 0:00:02.953 ***** 2019-11-28T11:05:26.972 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:26 +0000 (0:00:00.036) 0:00:02.990 ***** 2019-11-28T11:05:27.023 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:27 +0000 (0:00:00.050) 0:00:03.040 ***** 2019-11-28T11:05:27.066 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:27 +0000 (0:00:00.043) 0:00:03.083 ***** 2019-11-28T11:05:27.201 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-11-28T11:05:27.204 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-28T11:05:27.205 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-28T11:05:27.206 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-28T11:05:27.251 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:27 +0000 (0:00:00.184) 0:00:03.268 ***** 2019-11-28T11:05:27.302 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:27 +0000 (0:00:00.049) 0:00:03.318 ***** 2019-11-28T11:05:27.335 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:27 +0000 (0:00:00.034) 0:00:03.352 ***** 2019-11-28T11:05:27.349 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-28T11:05:27.380 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:27 +0000 (0:00:00.045) 0:00:03.398 ***** 2019-11-28T11:05:27.386 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-28T11:05:27.423 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:27 +0000 (0:00:00.042) 0:00:03.440 ***** 2019-11-28T11:05:27.829 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi080.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} ok: [smithi133.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-28T11:05:27.872 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:27 +0000 (0:00:00.448) 0:00:03.889 ***** 2019-11-28T11:05:27.906 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:27 +0000 (0:00:00.034) 0:00:03.923 ***** 2019-11-28T11:05:27.912 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-28T11:05:27.914 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-28T11:05:27.915 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-11-28T11:05:27.916 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:27.954 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:27 +0000 (0:00:00.048) 0:00:03.971 ***** 2019-11-28T11:05:27.989 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:27 +0000 (0:00:00.034) 0:00:04.006 ***** 2019-11-28T11:05:28.026 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:28 +0000 (0:00:00.037) 0:00:04.043 ***** 2019-11-28T11:05:28.031 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:28.032 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:28.034 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:28.078 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:28 +0000 (0:00:00.045) 0:00:04.089 ***** 2019-11-28T11:05:28.107 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:28 +0000 (0:00:00.033) 0:00:04.122 ***** 2019-11-28T11:05:28.142 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:28 +0000 (0:00:00.036) 0:00:04.159 ***** 2019-11-28T11:05:28.152 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-11-28T11:05:28.153 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-28T11:05:28.196 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:28 +0000 (0:00:00.054) 0:00:04.213 ***** 2019-11-28T11:05:28.364 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-11-28T11:05:28.365 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:05:28.367 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:05:28.368 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:05:28.415 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:28 +0000 (0:00:00.218) 0:00:04.432 ***** 2019-11-28T11:05:28.462 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:28 +0000 (0:00:00.046) 0:00:04.479 ***** 2019-11-28T11:05:28.498 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:28 +0000 (0:00:00.036) 0:00:04.516 ***** 2019-11-28T11:05:28.505 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-11-28T11:05:28.506 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:28.547 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:28 +0000 (0:00:00.048) 0:00:04.564 ***** 2019-11-28T11:05:28.582 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:28 +0000 (0:00:00.034) 0:00:04.599 ***** 2019-11-28T11:05:28.948 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi174.front.sepia.ceph.com] 2019-11-28T11:05:29.041 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:29 +0000 (0:00:00.459) 0:00:05.058 ***** 2019-11-28T11:05:29.109 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-11-28T11:05:29.111 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:05:29.151 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:29 +0000 (0:00:00.109) 0:00:05.168 ***** 2019-11-28T11:05:29.298 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-11-28T11:05:29.299 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-28T11:05:29.335 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:29 +0000 (0:00:00.183) 0:00:05.352 ***** 2019-11-28T11:05:29.392 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2019-11-28T11:05:29.396 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939128.43-168661730828218/source", "state": "file", "uid": 0} changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939128.48-158134156195106/source", "state": "file", "uid": 0} 2019-11-28T11:05:29.437 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:29 +0000 (0:00:00.102) 0:00:05.455 ***** 2019-11-28T11:05:29.470 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:29 +0000 (0:00:00.032) 0:00:05.487 ***** 2019-11-28T11:05:29.487 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939128.57-239077802478459/source", "state": "file", "uid": 0} changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939128.51-104220118874476/source", "state": "file", "uid": 0} 2019-11-28T11:05:29.516 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:29 +0000 (0:00:00.045) 0:00:05.533 ***** 2019-11-28T11:05:29.552 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:29 +0000 (0:00:00.036) 0:00:05.570 ***** 2019-11-28T11:05:29.617 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-11-28T11:05:29.617 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-28T11:05:29.658 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:29 +0000 (0:00:00.105) 0:00:05.675 ***** 2019-11-28T11:05:29.982 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2019-11-28T11:05:29.988 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2019-11-28T11:05:29.997 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939129.3-22899079267658/source", "state": "file", "uid": 0} 2019-11-28T11:05:30.004 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi016.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn 2019-11-28T11:05:30.006 INFO:teuthology.task.ansible.out:0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJX 2019-11-28T11:05:30.010 INFO:teuthology.task.ansible.out:Yw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:30.040 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:30 +0000 (0:00:00.382) 0:00:06.057 ***** 2019-11-28T11:05:30.046 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-11-28T11:05:30.052 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:30.089 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:30 +0000 (0:00:00.048) 0:00:06.106 ***** 2019-11-28T11:05:31.128 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi075.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/P 2019-11-28T11:05:31.130 INFO:teuthology.task.ansible.out:ySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:31.134 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => 2019-11-28T11:05:31.136 INFO:teuthology.task.ansible.out:{"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:31.157 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:31.158 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:31.159 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:31.161 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:31.162 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+ 2019-11-28T11:05:31.164 INFO:teuthology.task.ansible.out:zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+ 2019-11-28T11:05:31.165 INFO:teuthology.task.ansible.out:qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": nu 2019-11-28T11:05:31.167 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6 2019-11-28T11:05:31.169 INFO:teuthology.task.ansible.out:tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA 2019-11-28T11:05:31.170 INFO:teuthology.task.ansible.out:/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+ 2019-11-28T11:05:31.172 INFO:teuthology.task.ansible.out:5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:31.179 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:31.181 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "change 2019-11-28T11:05:31.183 INFO:teuthology.task.ansible.out:d": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa 2019-11-28T11:05:31.184 INFO:teuthology.task.ansible.out:AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, 2019-11-28T11:05:31.186 INFO:teuthology.task.ansible.out: "state": "present", "user": "cm", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57 2019-11-28T11:05:31.187 INFO:teuthology.task.ansible.out:L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBs 2019-11-28T11:05:31.189 INFO:teuthology.task.ansible.out:GWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/h 2019-11-28T11:05:31.192 INFO:teuthology.task.ansible.out:ome/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfM 2019-11-28T11:05:31.193 INFO:teuthology.task.ansible.out:gZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:31.195 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:31.285 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:31.288 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:31.413 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi076.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:31.490 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:31 +0000 (0:00:01.399) 0:00:07.506 ***** 2019-11-28T11:05:32.128 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2019-11-28T11:05:32.130 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939131.5-273764995555574/source", "state": "file", "uid": 0} 2019-11-28T11:05:32.165 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:32 +0000 (0:00:00.676) 0:00:08.182 ***** 2019-11-28T11:05:32.389 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2019-11-28T11:05:32.390 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:32.551 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:32.729 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:32.906 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:33.073 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:33.264 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:33.456 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T11:05:33.563 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2019-11-28T11:05:33.572 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2019-11-28T11:05:33.762 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:33 +0000 (0:00:01.596) 0:00:09.779 ***** 2019-11-28T11:05:33.794 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:33 +0000 (0:00:00.032) 0:00:09.811 ***** 2019-11-28T11:05:33.827 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:33 +0000 (0:00:00.032) 0:00:09.844 ***** 2019-11-28T11:05:33.861 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:33 +0000 (0:00:00.033) 0:00:09.878 ***** 2019-11-28T11:05:33.897 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:33 +0000 (0:00:00.036) 0:00:09.915 ***** 2019-11-28T11:05:33.931 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:33 +0000 (0:00:00.033) 0:00:09.948 ***** 2019-11-28T11:05:34.370 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi075.front.sepia.ceph.com] 2019-11-28T11:05:34.385 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] 2019-11-28T11:05:34.418 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] 2019-11-28T11:05:34.527 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] 2019-11-28T11:05:34.537 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] 2019-11-28T11:05:34.579 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2019-11-28T11:05:34.581 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:34 +0000 (0:00:00.648) 0:00:10.597 ***** 2019-11-28T11:05:34.618 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:34 +0000 (0:00:00.038) 0:00:10.635 ***** 2019-11-28T11:05:34.657 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:34 +0000 (0:00:00.039) 0:00:10.675 ***** 2019-11-28T11:05:34.766 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:34 +0000 (0:00:00.108) 0:00:10.783 ***** 2019-11-28T11:05:34.804 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:34 +0000 (0:00:00.038) 0:00:10.822 ***** 2019-11-28T11:05:34.993 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] 2019-11-28T11:05:35.088 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:35 +0000 (0:00:00.283) 0:00:11.105 ***** 2019-11-28T11:05:35.289 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi076.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.228933", "end": "2019-11-28 11:05:35.246922", "rc": 0, "start": "2019-11-28 11:05:35.017989", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} changed: [smithi016.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.267664", "end": "2019-11-28 11:05:35.256118", "rc": 0, "start": "2019-11-28 11:05:34.988454", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} 2019-11-28T11:05:35.318 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:35 +0000 (0:00:00.230) 0:00:11.336 ***** 2019-11-28T11:05:35.355 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:35 +0000 (0:00:00.035) 0:00:11.372 ***** 2019-11-28T11:05:35.360 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.301571", "end": "2019-11-28 11:05:35.295532", "rc": 0, "start": "2019-11-28 11:05:34.993961", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} 2019-11-28T11:05:35.361 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.292003", "end": "2019-11-28 11:05:35.306927", "rc": 0, "start": "2019-11-28 11:05:35.014924", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} 2019-11-28T11:05:35.409 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:35 +0000 (0:00:00.052) 0:00:11.424 ***** 2019-11-28T11:05:35.444 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:35 +0000 (0:00:00.037) 0:00:11.461 ***** 2019-11-28T11:05:35.453 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.221329", "end": "2019-11-28 11:05:35.340189", "rc": 0, "start": "2019-11-28 11:05:35.118860", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} 2019-11-28T11:05:35.496 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:35 +0000 (0:00:00.052) 0:00:11.513 ***** 2019-11-28T11:05:35.532 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-11-28T11:05:35.532 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.007449", "end": "2019-11-28 11:05:35.501379", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:05:35.493930", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-28T11:05:35.583 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:35 +0000 (0:00:00.086) 0:00:11.600 ***** 2019-11-28T11:05:35.591 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.012916", "end": "2019-11-28 11:05:35.541126", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:05:35.528210", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-28T11:05:35.630 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:35 +0000 (0:00:00.047) 0:00:11.647 ***** 2019-11-28T11:05:35.637 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-11-28T11:05:35.638 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:35.686 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:35 +0000 (0:00:00.056) 0:00:11.704 ***** 2019-11-28T11:05:35.692 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-11-28T11:05:35.693 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.007469", "end": "2019-11-28 11:05:35.625181", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:05:35.617712", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-28T11:05:35.695 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:35.696 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi174.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.215715", "end": "2019-11-28 11:05:35.643566", "rc": 0, "start": "2019-11-28 11:05:35.427851", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} 2019-11-28T11:05:35.697 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.093742", "end": "2019-11-28 11:05:35.658577", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:05:35.564835", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-28T11:05:35.749 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:35 +0000 (0:00:00.062) 0:00:11.766 ***** 2019-11-28T11:05:35.787 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:35 +0000 (0:00:00.036) 0:00:11.803 ***** 2019-11-28T11:05:35.826 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:35 +0000 (0:00:00.037) 0:00:11.841 ***** 2019-11-28T11:05:35.862 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:35 +0000 (0:00:00.038) 0:00:11.880 ***** 2019-11-28T11:05:35.870 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014075", "end": "2019-11-28 11:05:35.701245", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:05:35.687170", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-28T11:05:35.879 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:35.911 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:35 +0000 (0:00:00.049) 0:00:11.929 ***** 2019-11-28T11:05:35.946 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:35 +0000 (0:00:00.034) 0:00:11.964 ***** 2019-11-28T11:05:35.989 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:35 +0000 (0:00:00.042) 0:00:12.006 ***** 2019-11-28T11:05:36.029 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.039) 0:00:12.046 ***** 2019-11-28T11:05:36.066 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.037) 0:00:12.084 ***** 2019-11-28T11:05:36.072 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-11-28T11:05:36.081 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.006576", "end": "2019-11-28 11:05:36.037047", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:05:36.030471", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:36.118 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.050) 0:00:12.134 ***** 2019-11-28T11:05:36.152 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.035) 0:00:12.169 ***** 2019-11-28T11:05:36.190 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.037) 0:00:12.206 ***** 2019-11-28T11:05:36.244 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.054) 0:00:12.261 ***** 2019-11-28T11:05:36.283 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.039) 0:00:12.300 ***** 2019-11-28T11:05:36.289 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:36.297 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:36.329 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.045) 0:00:12.346 ***** 2019-11-28T11:05:36.372 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.033) 0:00:12.379 ***** 2019-11-28T11:05:36.398 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.035) 0:00:12.415 ***** 2019-11-28T11:05:36.434 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.035) 0:00:12.451 ***** 2019-11-28T11:05:36.482 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.036) 0:00:12.487 ***** TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:36.519 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.046) 0:00:12.534 ***** 2019-11-28T11:05:36.551 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.032) 0:00:12.566 ***** 2019-11-28T11:05:36.584 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.035) 0:00:12.602 ***** 2019-11-28T11:05:36.619 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.035) 0:00:12.637 ***** 2019-11-28T11:05:36.652 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.032) 0:00:12.669 ***** 2019-11-28T11:05:36.657 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-11-28T11:05:36.660 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:36.660 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:36.662 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:36.701 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.049) 0:00:12.719 ***** 2019-11-28T11:05:36.747 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.042) 0:00:12.761 ***** 2019-11-28T11:05:36.799 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.055) 0:00:12.816 ***** 2019-11-28T11:05:36.805 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-11-28T11:05:36.806 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:05:36.808 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:05:36.856 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.056) 0:00:12.873 ***** 2019-11-28T11:05:36.893 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.036) 0:00:12.910 ***** 2019-11-28T11:05:36.895 INFO:teuthology.task.ansible.out: 2019-11-28T11:05:36.932 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.039) 0:00:12.949 ***** 2019-11-28T11:05:36.938 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-11-28T11:05:36.941 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* 2019-11-28T11:05:36.948 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:05:37.010 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:36 +0000 (0:00:00.072) 0:00:13.022 ***** 2019-11-28T11:05:37.046 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:37 +0000 (0:00:00.041) 0:00:13.063 ***** 2019-11-28T11:05:37.053 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-11-28T11:05:37.053 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:37.055 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi080.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:05:37.096 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:37 +0000 (0:00:00.048) 0:00:13.112 ***** 2019-11-28T11:05:37.136 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:37 +0000 (0:00:00.037) 0:00:13.150 ***** 2019-11-28T11:05:37.154 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:37.159 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-28T11:05:37.196 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:37 +0000 (0:00:00.063) 0:00:13.213 ***** 2019-11-28T11:05:37.203 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:37.246 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:37 +0000 (0:00:00.046) 0:00:13.260 ***** 2019-11-28T11:05:37.252 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:37.260 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-28T11:05:37.302 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:37 +0000 (0:00:00.060) 0:00:13.320 ***** 2019-11-28T11:05:37.309 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-11-28T11:05:37.310 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:05:37.352 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:37 +0000 (0:00:00.049) 0:00:13.370 ***** 2019-11-28T11:05:37.508 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-28T11:05:37.510 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-28T11:05:37.512 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-28T11:05:37.513 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-28T11:05:37.515 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi133.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:05:37.555 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:37 +0000 (0:00:00.202) 0:00:13.572 ***** 2019-11-28T11:05:37.722 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-28T11:05:37.724 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-28T11:05:37.735 INFO:teuthology.task.ansible.out: ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-28T11:05:37.737 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-28T11:05:37.739 INFO:teuthology.task.ansible.out: 2019-11-28T11:05:37.741 INFO:teuthology.task.ansible.out:TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:05:37.742 INFO:teuthology.task.ansible.out: 2019-11-28T11:05:37.744 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-28T11:05:37.748 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-28T11:05:37.749 INFO:teuthology.task.ansible.out: 2019-11-28T11:05:37.752 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-11-28T11:05:37.754 INFO:teuthology.task.ansible.out: 2019-11-28T11:05:37.800 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:05:37 +0000 (0:00:00.244) 0:00:13.817 ***** 2019-11-28T11:06:00.939 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\nd 2019-11-28T11:06:00.940 INFO:teuthology.task.ansible.out:mick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-11-28T11:06:00.944 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-28T11:06:00.948 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48 2019-11-28T11:06:00.952 INFO:teuthology.task.ansible.out:cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansib 2019-11-28T11:06:00.955 INFO:teuthology.task.ansible.out:le_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVE 2019-11-28T11:06:00.964 INFO:teuthology.task.ansible.out:xt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': 2019-11-28T11:06:00.965 INFO:teuthology.task.ansible.out:u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": " 2019-11-28T11:06:00.966 INFO:teuthology.task.ansible.out:dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} ok: [smithi075 2019-11-28T11:06:00.968 INFO:teuthology.task.ansible.out:.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-11-28T11:06:00.970 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-11-28T11:06:00.986 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-11-28T11:06:00.989 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-11-28T11:06:00.991 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-11-28T11:06:00.993 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-11-28T11:06:00.994 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-11-28T11:06:00.996 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-11-28T11:06:01.000 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"a 2019-11-28T11:06:01.002 INFO:teuthology.task.ansible.out:nsible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} ok: 2019-11-28T11:06:01.004 INFO:teuthology.task.ansible.out:[smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmben 2019-11-28T11:06:01.005 INFO:teuthology.task.ansible.out:jamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrR 2019-11-28T11:06:01.007 INFO:teuthology.task.ansible.out:we0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-28T11:06:01.008 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-28T11:06:01.010 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-11-28T11:06:01.011 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-28T11:06:01.012 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-11-28T11:06:01.014 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-28T11:06:01.015 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-28T11:06:01.017 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-28T11:06:01.018 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-11-28T11:06:01.019 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-28T11:06:01.021 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-28T11:06:01.022 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-28T11:06:01.024 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-11-28T11:06:01.025 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-28T11:06:01.026 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-28T11:06:01.028 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-28T11:06:01.030 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-28T11:06:01.031 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-11-28T11:06:01.032 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-28T11:06:01.034 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-28T11:06:01.035 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-28T11:06:01.037 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-28T11:06:01.038 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-28T11:06:01.039 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-28T11:06:01.041 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-28T11:06:01.042 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-28T11:06:01.044 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-28T11:06:01.045 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-28T11:06:01.047 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-28T11:06:01.048 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-28T11:06:01.049 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-28T11:06:01.051 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-28T11:06:01.052 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-28T11:06:01.054 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-28T11:06:01.055 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-28T11:06:01.063 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/96 2019-11-28T11:06:01.065 INFO:teuthology.task.ansible.out:93sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafm 2019-11-28T11:06:01.068 INFO:teuthology.task.ansible.out:an@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", 2019-11-28T11:06:01.074 INFO:teuthology.task.ansible.out:"uid": 1120} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, 2019-11-28T11:06:01.075 INFO:teuthology.task.ansible.out:"groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/g 2019-11-28T11:06:01.079 INFO:teuthology.task.ansible.out:meno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 2019-11-28T11:06:01.081 INFO:teuthology.task.ansible.out: 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-11-28T11:06:01.083 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-11-28T11:06:01.086 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-11-28T11:06:01.089 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7 2019-11-28T11:06:01.094 INFO:teuthology.task.ansible.out:bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-11-28T11:06:01.097 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansi 2019-11-28T11:06:01.099 INFO:teuthology.task.ansible.out:ble_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-11-28T11:06:01.100 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-11-28T11:06:01.105 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318 2019-11-28T11:06:01.107 INFO:teuthology.task.ansible.out:441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-11-28T11:06:01.117 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "presen 2019-11-28T11:06:01.119 INFO:teuthology.task.ansible.out:t", "uid": 1124} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-11-28T11:06:01.122 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} ok: [smithi080.f 2019-11-28T11:06:01.125 INFO:teuthology.task.ansible.out:ront.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-11-28T11:06:01.127 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-11-28T11:06:01.129 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-11-28T11:06:01.130 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-11-28T11:06:01.132 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-11-28T11:06:01.133 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-11-28T11:06:01.134 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-11-28T11:06:01.136 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-11-28T11:06:01.137 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-11-28T11:06:01.140 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-11-28T11:06:01.141 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-11-28T11:06:01.143 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-11-28T11:06:01.145 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-11-28T11:06:01.147 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-11-28T11:06:01.148 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-11-28T11:06:01.152 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-11-28T11:06:01.159 INFO:teuthology.task.ansible.out: ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-11-28T11:06:01.167 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", " 2019-11-28T11:06:01.169 INFO:teuthology.task.ansible.out:home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-11-28T11:06:01.175 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b 2019-11-28T11:06:01.177 INFO:teuthology.task.ansible.out:9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-11-28T11:06:01.179 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-11-28T11:06:01.184 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-11-28T11:06:01.186 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-11-28T11:06:01.191 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-11-28T11:06:01.193 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-11-28T11:06:01.200 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-11-28T11:06:01.202 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-11-28T11:06:01.206 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-11-28T11:06:01.208 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-11-28T11:06:01.210 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-11-28T11:06:01.213 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-11-28T11:06:01.215 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-11-28T11:06:01.217 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-11-28T11:06:01.220 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-11-28T11:06:01.221 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-11-28T11:06:01.223 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-11-28T11:06:01.225 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-11-28T11:06:01.227 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-11-28T11:06:01.229 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-11-28T11:06:01.231 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-11-28T11:06:01.237 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90d 2019-11-28T11:06:01.239 INFO:teuthology.task.ansible.out:f7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": f 2019-11-28T11:06:01.241 INFO:teuthology.task.ansible.out:alse, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-28T11:06:01.243 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-28T11:06:01.245 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-28T11:06:01.247 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-11-28T11:06:01.249 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-11-28T11:06:01.251 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-11-28T11:06:01.253 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-28T11:06:01.255 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-28T11:06:01.257 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-28T11:06:01.258 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-28T11:06:01.260 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-11-28T11:06:01.262 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-28T11:06:01.264 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-11-28T11:06:01.265 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-11-28T11:06:01.267 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-28T11:06:01.269 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-11-28T11:06:01.271 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-28T11:06:01.273 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-28T11:06:01.275 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-28T11:06:01.277 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-28T11:06:01.279 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-28T11:06:01.280 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-11-28T11:06:01.282 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-28T11:06:01.286 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-11-28T11:06:01.288 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-28T11:06:01.290 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-28T11:06:01.292 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-11-28T11:06:01.293 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-11-28T11:06:01.295 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-28T11:06:01.297 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-11-28T11:06:01.299 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-11-28T11:06:01.301 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-11-28T11:06:01.303 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-11-28T11:06:01.305 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-11-28T11:06:01.307 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-11-28T11:06:01.309 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-11-28T11:06:01.311 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-11-28T11:06:01.313 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-11-28T11:06:01.315 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-11-28T11:06:01.317 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-11-28T11:06:01.321 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-11-28T11:06:01.323 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-11-28T11:06:01.326 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-11-28T11:06:01.328 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-11-28T11:06:01.330 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-11-28T11:06:01.332 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-11-28T11:06:01.334 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-11-28T11:06:01.336 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-11-28T11:06:01.338 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-11-28T11:06:01.340 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-11-28T11:06:01.342 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-11-28T11:06:01.344 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-11-28T11:06:01.347 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-11-28T11:06:01.348 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-28T11:06:01.351 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-28T11:06:01.352 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-28T11:06:01.354 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-11-28T11:06:01.356 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-11-28T11:06:01.360 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-28T11:06:01.361 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-28T11:06:01.364 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-28T11:06:01.365 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-28T11:06:01.371 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton" 2019-11-28T11:06:01.372 INFO:teuthology.task.ansible.out:, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-28T11:06:01.374 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-11-28T11:06:01.375 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-28T11:06:01.377 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-11-28T11:06:01.378 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-11-28T11:06:01.380 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-11-28T11:06:01.381 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-28T11:06:01.383 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-11-28T11:06:01.384 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-11-28T11:06:01.386 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-11-28T11:06:01.387 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-11-28T11:06:01.389 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-28T11:06:01.390 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-11-28T11:06:01.392 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-11-28T11:06:01.396 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-11-28T11:06:01.400 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-11-28T11:06:01.402 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-11-28T11:06:01.403 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-11-28T11:06:01.406 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-11-28T11:06:01.408 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-11-28T11:06:01.413 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-11-28T11:06:01.416 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-11-28T11:06:01.424 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "g 2019-11-28T11:06:01.428 INFO:teuthology.task.ansible.out:roup": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present" 2019-11-28T11:06:01.430 INFO:teuthology.task.ansible.out:, "uid": 1162} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-11-28T11:06:01.433 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-11-28T11:06:01.436 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-11-28T11:06:01.438 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-28T11:06:01.439 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-28T11:06:01.442 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-11-28T11:06:01.444 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-11-28T11:06:01.445 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-11-28T11:06:01.447 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-11-28T11:06:01.448 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-11-28T11:06:01.450 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-11-28T11:06:01.451 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-11-28T11:06:01.453 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-11-28T11:06:01.454 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-28T11:06:01.456 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-11-28T11:06:01.457 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-11-28T11:06:01.459 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-11-28T11:06:01.460 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-11-28T11:06:01.462 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-11-28T11:06:01.463 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-28T11:06:01.466 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-11-28T11:06:01.467 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-11-28T11:06:01.469 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-11-28T11:06:01.474 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-11-28T11:06:01.476 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-28T11:06:01.478 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-11-28T11:06:01.486 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-28T11:06:01.488 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-11-28T11:06:01.490 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-28T11:06:01.492 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-28T11:06:01.493 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-28T11:06:01.494 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-11-28T11:06:01.496 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-11-28T11:06:01.497 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-11-28T11:06:01.499 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-11-28T11:06:01.500 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-11-28T11:06:01.502 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-28T11:06:01.503 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-11-28T11:06:01.505 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-11-28T11:06:01.507 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-11-28T11:06:01.508 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-28T11:06:01.509 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-28T11:06:01.511 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-28T11:06:01.512 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-28T11:06:01.514 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-11-28T11:06:01.516 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-28T11:06:01.517 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-28T11:06:01.519 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-28T11:06:01.520 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-28T11:06:01.521 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-11-28T11:06:01.523 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-11-28T11:06:01.524 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-11-28T11:06:01.527 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-11-28T11:06:01.528 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-11-28T11:06:01.530 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-28T11:06:01.531 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-11-28T11:06:01.533 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-11-28T11:06:01.540 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clac 2019-11-28T11:06:01.543 INFO:teuthology.task.ansible.out:roix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} ok: [smith 2019-11-28T11:06:01.544 INFO:teuthology.task.ansible.out:i133.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-11-28T11:06:01.548 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-28T11:06:01.551 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-11-28T11:06:01.554 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-28T11:06:01.556 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-11-28T11:06:01.558 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-11-28T11:06:01.559 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-11-28T11:06:01.564 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-11-28T11:06:01.569 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef 2019-11-28T11:06:01.573 INFO:teuthology.task.ansible.out:7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3 2019-11-28T11:06:01.574 INFO:teuthology.task.ansible.out:e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-11-28T11:06:01.577 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-11-28T11:06:01.578 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-11-28T11:06:01.579 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-11-28T11:06:01.581 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-11-28T11:06:01.583 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-11-28T11:06:01.584 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-11-28T11:06:01.585 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-11-28T11:06:01.587 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-11-28T11:06:01.588 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-11-28T11:06:01.597 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-11-28T11:06:01.604 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-11-28T11:06:01.607 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-11-28T11:06:01.613 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-11-28T11:06:01.616 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-11-28T11:06:01.618 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-11-28T11:06:01.620 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-11-28T11:06:01.625 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-11-28T11:06:01.630 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-11-28T11:06:01.632 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-11-28T11:06:01.634 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-11-28T11:06:01.639 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-11-28T11:06:01.640 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-11-28T11:06:01.646 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-11-28T11:06:01.648 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-11-28T11:06:01.650 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-11-28T11:06:01.651 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-11-28T11:06:01.653 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-11-28T11:06:01.665 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": " 2019-11-28T11:06:01.674 INFO:teuthology.task.ansible.out:sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} ok: [smithi133 2019-11-28T11:06:01.685 INFO:teuthology.task.ansible.out:.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "gr 2019-11-28T11:06:01.686 INFO:teuthology.task.ansible.out:oup": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, 2019-11-28T11:06:01.688 INFO:teuthology.task.ansible.out: "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', 2019-11-28T11:06:01.690 INFO:teuthology.task.ansible.out: u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062 2019-11-28T11:06:01.692 INFO:teuthology.task.ansible.out:ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-11-28T11:06:01.693 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-11-28T11:06:01.695 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-11-28T11:06:01.697 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-11-28T11:06:01.699 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-11-28T11:06:01.700 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-11-28T11:06:01.702 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-11-28T11:06:01.716 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7 2019-11-28T11:06:01.719 INFO:teuthology.task.ansible.out:ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd 2019-11-28T11:06:01.720 INFO:teuthology.task.ansible.out:09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) 2019-11-28T11:06:01.722 INFO:teuthology.task.ansible.out:=> {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f 2019-11-28T11:06:01.723 INFO:teuthology.task.ansible.out:736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa0112 2019-11-28T11:06:01.725 INFO:teuthology.task.ansible.out:3ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-11-28T11:06:01.726 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-11-28T11:06:01.733 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "ch 2019-11-28T11:06:01.736 INFO:teuthology.task.ansible.out:anged": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} ok: [smithi133.front.sep 2019-11-28T11:06:01.738 INFO:teuthology.task.ansible.out:ia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-11-28T11:06:01.739 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-11-28T11:06:01.741 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-11-28T11:06:01.743 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-11-28T11:06:01.744 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-11-28T11:06:01.746 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-11-28T11:06:01.748 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-11-28T11:06:01.749 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-11-28T11:06:01.750 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-28T11:06:01.752 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-28T11:06:01.754 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-11-28T11:06:01.755 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-11-28T11:06:01.757 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-11-28T11:06:01.760 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-28T11:06:01.761 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-11-28T11:06:01.763 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-11-28T11:06:01.764 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-11-28T11:06:01.769 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-11-28T11:06:01.770 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-11-28T11:06:01.772 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-11-28T11:06:01.773 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-11-28T11:06:01.775 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-11-28T11:06:01.776 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-11-28T11:06:01.778 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-28T11:06:01.780 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-11-28T11:06:01.781 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-11-28T11:06:01.783 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-11-28T11:06:01.784 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-28T11:06:01.786 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-28T11:06:01.787 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-11-28T11:06:01.789 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-28T11:06:01.791 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-11-28T11:06:01.793 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-28T11:06:01.794 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-28T11:06:01.796 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-11-28T11:06:01.797 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-11-28T11:06:01.800 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-28T11:06:01.804 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-28T11:06:01.806 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-28T11:06:01.807 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-11-28T11:06:01.808 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-28T11:06:01.810 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1215} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-11-28T11:06:01.812 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1215} 2019-11-28T11:06:01.815 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-28T11:06:01.816 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-11-28T11:06:01.818 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1215} 2019-11-28T11:06:01.820 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-11-28T11:06:01.822 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} changed: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2019-11-28T11:06:01.898 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2019-11-28T11:06:01.900 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-11-28T11:06:01.986 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1215} 2019-11-28T11:06:01.988 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2019-11-28T11:06:02.073 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-28T11:06:02.075 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-28T11:06:02.076 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-28T11:06:02.078 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-28T11:06:02.079 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2019-11-28T11:06:02.160 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-28T11:06:02.162 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-11-28T11:06:02.163 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-11-28T11:06:02.165 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-28T11:06:02.166 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-11-28T11:06:02.168 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1215} 2019-11-28T11:06:02.208 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:02 +0000 (0:00:24.406) 0:00:38.224 ***** 2019-11-28T11:06:02.254 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:02 +0000 (0:00:00.046) 0:00:38.271 ***** 2019-11-28T11:06:02.290 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:02 +0000 (0:00:00.036) 0:00:38.307 ***** 2019-11-28T11:06:02.327 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:02 +0000 (0:00:00.036) 0:00:38.344 ***** 2019-11-28T11:06:02.334 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-11-28T11:06:02.336 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-11-28T11:06:02.393 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:02 +0000 (0:00:00.066) 0:00:38.411 ***** 2019-11-28T11:06:02.433 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:02 +0000 (0:00:00.036) 0:00:38.447 ***** 2019-11-28T11:06:02.438 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-28T11:06:02.439 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-11-28T11:06:02.440 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-11-28T11:06:02.479 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:02 +0000 (0:00:00.049) 0:00:38.496 ***** 2019-11-28T11:06:02.514 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:02 +0000 (0:00:00.034) 0:00:38.532 ***** 2019-11-28T11:06:02.527 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-11-28T11:06:02.533 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-11-28T11:06:02.537 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04 2019-11-28T11:06:02.540 INFO:teuthology.task.ansible.out:okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "jos 2019-11-28T11:06:02.542 INFO:teuthology.task.ansible.out:hd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jo 2019-11-28T11:06:02.544 INFO:teuthology.task.ansible.out:wilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f 2019-11-28T11:06:02.546 INFO:teuthology.task.ansible.out:966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 39 2019-11-28T11:06:02.547 INFO:teuthology.task.ansible.out:5884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar 2019-11-28T11:06:02.549 INFO:teuthology.task.ansible.out:.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"nam 2019-11-28T11:06:02.550 INFO:teuthology.task.ansible.out:e": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b1 2019-11-28T11:06:02.552 INFO:teuthology.task.ansible.out:1f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg 2019-11-28T11:06:02.555 INFO:teuthology.task.ansible.out:b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqR 2019-11-28T11:06:02.556 INFO:teuthology.task.ansible.out:XlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c 2019-11-28T11:06:02.561 INFO:teuthology.task.ansible.out:7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f 2019-11-28T11:06:02.567 INFO:teuthology.task.ansible.out:5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ 2019-11-28T11:06:02.570 INFO:teuthology.task.ansible.out:ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQR 2019-11-28T11:06:02.572 INFO:teuthology.task.ansible.out:WbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d1 2019-11-28T11:06:02.575 INFO:teuthology.task.ansible.out:3dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQ 2019-11-28T11:06:02.578 INFO:teuthology.task.ansible.out:ob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b 2019-11-28T11:06:02.580 INFO:teuthology.task.ansible.out:4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3 2019-11-28T11:06:02.584 INFO:teuthology.task.ansible.out:ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b5 2019-11-28T11:06:02.588 INFO:teuthology.task.ansible.out:8174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliams 2019-11-28T11:06:02.589 INFO:teuthology.task.ansible.out:on", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", 2019-11-28T11:06:02.591 INFO:teuthology.task.ansible.out: "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2c 2019-11-28T11:06:02.600 INFO:teuthology.task.ansible.out:a7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a196 2019-11-28T11:06:02.608 INFO:teuthology.task.ansible.out:4a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69 2019-11-28T11:06:02.610 INFO:teuthology.task.ansible.out:088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-11-28T11:06:02.618 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-11-28T11:06:02.620 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04 2019-11-28T11:06:02.621 INFO:teuthology.task.ansible.out:okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "jos 2019-11-28T11:06:02.623 INFO:teuthology.task.ansible.out:hd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jo 2019-11-28T11:06:02.625 INFO:teuthology.task.ansible.out:wilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f 2019-11-28T11:06:02.626 INFO:teuthology.task.ansible.out:966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h 2019-11-28T11:06:02.628 INFO:teuthology.task.ansible.out:7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6 2019-11-28T11:06:02.629 INFO:teuthology.task.ansible.out:c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa 2019-11-28T11:06:02.631 INFO:teuthology.task.ansible.out:2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db2 2019-11-28T11:06:02.632 INFO:teuthology.task.ansible.out:93dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.red 2019-11-28T11:06:02.634 INFO:teuthology.task.ansible.out:hat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f 2019-11-28T11:06:02.636 INFO:teuthology.task.ansible.out:57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a270 2019-11-28T11:06:02.638 INFO:teuthology.task.ansible.out:45"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} TASK [users : Merge managed_users and managed_admin users] ********************* ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf1 2019-11-28T11:06:02.639 INFO:teuthology.task.ansible.out:3888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W 2019-11-28T11:06:02.641 INFO:teuthology.task.ansible.out:6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff 2019-11-28T11:06:02.643 INFO:teuthology.task.ansible.out:8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73ecca 2019-11-28T11:06:02.645 INFO:teuthology.task.ansible.out:d2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37 2019-11-28T11:06:02.647 INFO:teuthology.task.ansible.out:b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abh 2019-11-28T11:06:02.649 INFO:teuthology.task.ansible.out:ishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6 2019-11-28T11:06:02.651 INFO:teuthology.task.ansible.out:c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa 2019-11-28T11:06:02.652 INFO:teuthology.task.ansible.out:2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db2 2019-11-28T11:06:02.653 INFO:teuthology.task.ansible.out:93dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.red 2019-11-28T11:06:02.655 INFO:teuthology.task.ansible.out:hat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f 2019-11-28T11:06:02.656 INFO:teuthology.task.ansible.out:57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-11-28T11:06:02.709 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:02 +0000 (0:00:00.194) 0:00:38.726 ***** 2019-11-28T11:06:02.756 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:02 +0000 (0:00:00.047) 0:00:38.774 ***** 2019-11-28T11:06:02.820 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:02 +0000 (0:00:00.063) 0:00:38.837 ***** 2019-11-28T11:06:02.868 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:02 +0000 (0:00:00.048) 0:00:38.886 ***** 2019-11-28T11:06:02.876 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-28T11:06:02.879 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2019-11-28T11:06:03.037 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-11-28T11:06:03.038 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-11-28T11:06:03.083 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:03 +0000 (0:00:00.214) 0:00:39.100 ***** 2019-11-28T11:06:03.930 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-11-28T11:06:03.932 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-28T11:06:03.934 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-28T11:06:03.935 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-28T11:06:03.949 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi075.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} 2019-11-28T11:06:03.989 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:03 +0000 (0:00:00.905) 0:00:40.006 ***** 2019-11-28T11:06:03.997 INFO:teuthology.task.ansible.out:FAILED - RETRYING: Clone the keys repo (5 retries left). TASK [users : Create all users without sudo access.] *************************** 2019-11-28T11:06:04.000 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi133.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} 2019-11-28T11:06:04.064 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:04 +0000 (0:00:00.072) 0:00:40.078 ***** 2019-11-28T11:06:04.130 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:04 +0000 (0:00:00.068) 0:00:40.147 ***** 2019-11-28T11:06:04.137 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} 2019-11-28T11:06:04.141 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-28T11:06:04.142 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-28T11:06:04.146 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-11-28T11:06:04.153 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-11-28T11:06:04.156 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04 2019-11-28T11:06:04.158 INFO:teuthology.task.ansible.out:okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "jos 2019-11-28T11:06:04.160 INFO:teuthology.task.ansible.out:hd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jo 2019-11-28T11:06:04.162 INFO:teuthology.task.ansible.out:wilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f 2019-11-28T11:06:04.164 INFO:teuthology.task.ansible.out:966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h 2019-11-28T11:06:04.166 INFO:teuthology.task.ansible.out:7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6 2019-11-28T11:06:04.168 INFO:teuthology.task.ansible.out:c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa 2019-11-28T11:06:04.170 INFO:teuthology.task.ansible.out:2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db2 2019-11-28T11:06:04.172 INFO:teuthology.task.ansible.out:93dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.red 2019-11-28T11:06:04.174 INFO:teuthology.task.ansible.out:hat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f 2019-11-28T11:06:04.176 INFO:teuthology.task.ansible.out:57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-11-28T11:06:04.236 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:04 +0000 (0:00:00.096) 0:00:40.243 ***** 2019-11-28T11:06:04.290 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:04 +0000 (0:00:00.063) 0:00:40.307 ***** 2019-11-28T11:06:06.857 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:06.858 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-11-28T11:06:06.860 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-28T11:06:06.861 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-28T11:06:06.870 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:06.871 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ 2019-11-28T11:06:06.873 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-28T11:06:06.875 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-11-28T11:06:06.876 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-11-28T11:06:06.878 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-11-28T11:06:06.880 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-28T11:06:06.882 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:06.883 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-11-28T11:06:06.885 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-11-28T11:06:06.887 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-28T11:06:06.888 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-11-28T11:06:06.892 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ 2019-11-28T11:06:06.893 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:06.895 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-11-28T11:06:06.897 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-11-28T11:06:06.899 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-11-28T11:06:06.900 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-11-28T11:06:06.902 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-11-28T11:06:06.906 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, " 2019-11-28T11:06:06.908 INFO:teuthology.task.ansible.out:path": null, "state": "present", "user": "sage", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": nul 2019-11-28T11:06:06.910 INFO:teuthology.task.ansible.out:l, "state": "present", "user": "sage", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gR 2019-11-28T11:06:06.912 INFO:teuthology.task.ansible.out:OzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8 2019-11-28T11:06:06.914 INFO:teuthology.task.ansible.out:U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ 2019-11-28T11:06:06.915 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-11-28T11:06:06.917 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-11-28T11:06:06.919 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-11-28T11:06:06.921 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-11-28T11:06:06.923 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:06.924 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-11-28T11:06:06.926 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:06.928 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-11-28T11:06:06.930 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:06.931 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-28T11:06:06.933 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:06.935 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-11-28T11:06:06.936 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML 2019-11-28T11:06:06.938 INFO:teuthology.task.ansible.out:7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason" 2019-11-28T11:06:06.940 INFO:teuthology.task.ansible.out:: "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:06.942 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-11-28T11:06:06.943 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name' 2019-11-28T11:06:06.945 INFO:teuthology.task.ansible.out:: u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (i 2019-11-28T11:06:06.948 INFO:teuthology.task.ansible.out:tem={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7T 2019-11-28T11:06:06.950 INFO:teuthology.task.ansible.out:CNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f 2019-11-28T11:06:06.951 INFO:teuthology.task.ansible.out:9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d8 2019-11-28T11:06:06.954 INFO:teuthology.task.ansible.out:73325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7IN 2019-11-28T11:06:06.955 INFO:teuthology.task.ansible.out:pSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1 2019-11-28T11:06:06.957 INFO:teuthology.task.ansible.out:f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5 2019-11-28T11:06:06.959 INFO:teuthology.task.ansible.out:EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfi 2019-11-28T11:06:06.961 INFO:teuthology.task.ansible.out:le": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} TASK [users : Clone the keys repo] ********************************************* ok: [smithi016.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775D 2019-11-28T11:06:06.962 INFO:teuthology.task.ansible.out:PeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-11-28T11:06:07.010 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:07 +0000 (0:00:02.720) 0:00:43.027 ***** 2019-11-28T11:06:14.909 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u 2019-11-28T11:06:14.911 INFO:teuthology.task.ansible.out:'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-11-28T11:06:14.913 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:14.916 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-11-28T11:06:14.917 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-11-28T11:06:14.920 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-11-28T11:06:14.924 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-11-28T11:06:14.926 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-11-28T11:06:14.931 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12 2019-11-28T11:06:14.936 INFO:teuthology.task.ansible.out:ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-11-28T11:06:14.938 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-11-28T11:06:14.939 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-11-28T11:06:14.941 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-11-28T11:06:14.942 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-11-28T11:06:14.947 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ad 2019-11-28T11:06:14.949 INFO:teuthology.task.ansible.out:eza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-11-28T11:06:14.951 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-11-28T11:06:14.953 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-11-28T11:06:14.955 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-11-28T11:06:14.957 INFO:teuthology.task.ansible.out:lidate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzek 2019-11-28T11:06:14.959 INFO:teuthology.task.ansible.out:TH2fTcxdAAquFn1SjPhws1Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ 2019-11-28T11:06:14.960 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-11-28T11:06:14.962 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL u 2019-11-28T11:06:14.963 INFO:teuthology.task.ansible.out:buntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-11-28T11:06:14.967 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-11-28T11:06:14.968 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-11-28T11:06:14.970 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-11-28T11:06:14.972 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABA 2019-11-28T11:06:14.973 INFO:teuthology.task.ansible.out:QC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFv 2019-11-28T11:06:14.975 INFO:teuthology.task.ansible.out:NQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-11-28T11:06:14.977 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "ex 2019-11-28T11:06:14.979 INFO:teuthology.task.ansible.out:clusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-11-28T11:06:14.981 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-28T11:06:14.983 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-11-28T11:06:14.985 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path" 2019-11-28T11:06:14.987 INFO:teuthology.task.ansible.out:: null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-11-28T11:06:14.989 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} TASK [users : Update authorized_keys using the keys repo] *************** 2019-11-28T11:06:14.991 INFO:teuthology.task.ansible.out:******* 2019-11-28T11:06:14.994 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-11-28T11:06:14.997 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AA 2019-11-28T11:06:14.998 INFO:teuthology.task.ansible.out:AAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": 2019-11-28T11:06:15.000 INFO:teuthology.task.ansible.out:{"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u 2019-11-28T11:06:15.001 INFO:teuthology.task.ansible.out:/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN 2019-11-28T11:06:15.003 INFO:teuthology.task.ansible.out:7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn" 2019-11-28T11:06:15.005 INFO:teuthology.task.ansible.out:: "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/hom 2019-11-28T11:06:15.007 INFO:teuthology.task.ansible.out:e/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAA 2019-11-28T11:06:15.008 INFO:teuthology.task.ansible.out:ADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAA 2019-11-28T11:06:15.010 INFO:teuthology.task.ansible.out:AABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": 2019-11-28T11:06:15.011 INFO:teuthology.task.ansible.out: "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADA 2019-11-28T11:06:15.013 INFO:teuthology.task.ansible.out:QABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, 2019-11-28T11:06:15.015 INFO:teuthology.task.ansible.out: "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-11-28T11:06:15.019 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhI 2019-11-28T11:06:15.021 INFO:teuthology.task.ansible.out:zMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-11-28T11:06:15.022 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u 2019-11-28T11:06:15.024 INFO:teuthology.task.ansible.out:'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b45421 2019-11-28T11:06:15.026 INFO:teuthology.task.ansible.out:62\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", 2019-11-28T11:06:15.028 INFO:teuthology.task.ansible.out: "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee 2019-11-28T11:06:15.033 INFO:teuthology.task.ansible.out:041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": n 2019-11-28T11:06:15.035 INFO:teuthology.task.ansible.out:ull, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/ 2019-11-28T11:06:15.038 INFO:teuthology.task.ansible.out:awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 114 2019-11-28T11:06:15.040 INFO:teuthology.task.ansible.out:6} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398 2019-11-28T11:06:15.042 INFO:teuthology.task.ansible.out:dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204 2019-11-28T11:06:15.044 INFO:teuthology.task.ansible.out:b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp 2019-11-28T11:06:15.046 INFO:teuthology.task.ansible.out:6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+i 2019-11-28T11:06:15.047 INFO:teuthology.task.ansible.out:Khyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@d 2019-11-28T11:06:15.049 INFO:teuthology.task.ansible.out:aq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "ch 2019-11-28T11:06:15.051 INFO:teuthology.task.ansible.out:anged": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0 2019-11-28T11:06:15.053 INFO:teuthology.task.ansible.out:AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "ke 2019-11-28T11:06:15.056 INFO:teuthology.task.ansible.out:yfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBN 2019-11-28T11:06:15.060 INFO:teuthology.task.ansible.out:DSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present" 2019-11-28T11:06:15.064 INFO:teuthology.task.ansible.out:, "user": "jlopez", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e 2019-11-28T11:06:15.066 INFO:teuthology.task.ansible.out:76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W 2019-11-28T11:06:15.067 INFO:teuthology.task.ansible.out:/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [ 2019-11-28T11:06:15.069 INFO:teuthology.task.ansible.out:smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRj 2019-11-28T11:06:15.071 INFO:teuthology.task.ansible.out:h5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c 2019-11-28T11:06:15.075 INFO:teuthology.task.ansible.out:29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c 2019-11-28T11:06:15.076 INFO:teuthology.task.ansible.out:3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:15.078 INFO:teuthology.task.ansible.out: ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm 2019-11-28T11:06:15.080 INFO:teuthology.task.ansible.out:/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn 2019-11-28T11:06:15.082 INFO:teuthology.task.ansible.out:": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-28T11:06:15.084 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:15.086 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-28T11:06:15.087 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-11-28T11:06:15.089 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-11-28T11:06:15.090 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-28T11:06:15.092 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:15.094 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-11-28T11:06:15.096 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-11-28T11:06:15.104 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-11-28T11:06:15.111 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": 2019-11-28T11:06:15.114 INFO:teuthology.task.ansible.out: "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc00 2019-11-28T11:06:15.119 INFO:teuthology.task.ansible.out:99d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvh 2019-11-28T11:06:15.122 INFO:teuthology.task.ansible.out:kM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-11-28T11:06:15.130 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-11-28T11:06:15.131 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3 2019-11-28T11:06:15.133 INFO:teuthology.task.ansible.out:iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8 2019-11-28T11:06:15.134 INFO:teuthology.task.ansible.out:eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz 2019-11-28T11:06:15.136 INFO:teuthology.task.ansible.out:4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} TASK [users : Update authorized_keys using the keys repo] ***************** 2019-11-28T11:06:15.137 INFO:teuthology.task.ansible.out:***** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCC 2019-11-28T11:06:15.139 INFO:teuthology.task.ansible.out:Y4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqn 2019-11-28T11:06:15.140 INFO:teuthology.task.ansible.out:DZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "valid 2019-11-28T11:06:15.142 INFO:teuthology.task.ansible.out:ate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5 2019-11-28T11:06:15.144 INFO:teuthology.task.ansible.out:ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x jua 2019-11-28T11:06:15.145 INFO:teuthology.task.ansible.out:njose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'sh 2019-11-28T11:06:15.147 INFO:teuthology.task.ansible.out:ehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WE 2019-11-28T11:06:15.148 INFO:teuthology.task.ansible.out:latf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path 2019-11-28T11:06:15.149 INFO:teuthology.task.ansible.out:": null, "state": "present", "user": "cbodley", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_opti 2019-11-28T11:06:15.151 INFO:teuthology.task.ansible.out:ons": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-11-28T11:06:15.153 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-11-28T11:06:15.154 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-11-28T11:06:15.156 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-11-28T11:06:15.157 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-11-28T11:06:15.159 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-11-28T11:06:15.161 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:15.163 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_cer 2019-11-28T11:06:15.164 INFO:teuthology.task.ansible.out:ts": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-11-28T11:06:15.166 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-11-28T11:06:15.167 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-11-28T11:06:15.170 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-28T11:06:15.173 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:15.181 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} ok 2019-11-28T11:06:15.184 INFO:teuthology.task.ansible.out:: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": 2019-11-28T11:06:15.189 INFO:teuthology.task.ansible.out:null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsK 2019-11-28T11:06:15.192 INFO:teuthology.task.ansible.out:oq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "use 2019-11-28T11:06:15.195 INFO:teuthology.task.ansible.out:r": "prsrivas", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_opt 2019-11-28T11:06:15.198 INFO:teuthology.task.ansible.out:ions": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3 2019-11-28T11:06:15.201 INFO:teuthology.task.ansible.out:LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2 2019-11-28T11:06:15.204 INFO:teuthology.task.ansible.out:XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy4 2019-11-28T11:06:15.206 INFO:teuthology.task.ansible.out:4wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLq 2019-11-28T11:06:15.207 INFO:teuthology.task.ansible.out:BHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6 2019-11-28T11:06:15.210 INFO:teuthology.task.ansible.out:cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK 2019-11-28T11:06:15.212 INFO:teuthology.task.ansible.out:2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} TASK [users : Clone the keys repo] ********************************************* ok: [smithi076.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 2, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22 2019-11-28T11:06:15.215 INFO:teuthology.task.ansible.out:OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-11-28T11:06:15.217 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144 2019-11-28T11:06:15.220 INFO:teuthology.task.ansible.out:dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} TASK [users : Create all admin users with sudo 2019-11-28T11:06:15.222 INFO:teuthology.task.ansible.out: access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": 2019-11-28T11:06:15.223 INFO:teuthology.task.ansible.out: false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-11-28T11:06:15.263 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:15 +0000 (0:00:08.252) 0:00:51.280 ***** 2019-11-28T11:06:25.138 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-11-28T11:06:25.140 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-11-28T11:06:25.144 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-28T11:06:25.145 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:25.148 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-11-28T11:06:25.150 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7Odu 2019-11-28T11:06:25.151 INFO:teuthology.task.ansible.out:ogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702 2019-11-28T11:06:25.153 INFO:teuthology.task.ansible.out:b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed" 2019-11-28T11:06:25.154 INFO:teuthology.task.ansible.out:: false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-28T11:06:25.156 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOIm 2019-11-28T11:06:25.158 INFO:teuthology.task.ansible.out:wCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": 2019-11-28T11:06:25.160 INFO:teuthology.task.ansible.out:null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDL 2019-11-28T11:06:25.161 INFO:teuthology.task.ansible.out:u3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmj 2019-11-28T11:06:25.166 INFO:teuthology.task.ansible.out:bF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smith 2019-11-28T11:06:25.168 INFO:teuthology.task.ansible.out:i174.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj 2019-11-28T11:06:25.170 INFO:teuthology.task.ansible.out:", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present 2019-11-28T11:06:25.171 INFO:teuthology.task.ansible.out:", "user": "nojha", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "st 2019-11-28T11:06:25.173 INFO:teuthology.task.ansible.out:ate": "present", "uid": 1142} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfi 2019-11-28T11:06:25.174 INFO:teuthology.task.ansible.out:le": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2019-11-28T11:06:25.176 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-11-28T11:06:25.177 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-11-28T11:06:25.179 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-28T11:06:25.180 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:25.182 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} ok: [smith 2019-11-28T11:06:25.184 INFO:teuthology.task.ansible.out:i075.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs 2019-11-28T11:06:25.188 INFO:teuthology.task.ansible.out:": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c540801303 2019-11-28T11:06:25.197 INFO:teuthology.task.ansible.out:42dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} ok: [smithi075. 2019-11-28T11:06:25.205 INFO:teuthology.task.ansible.out:front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": 2019-11-28T11:06:25.207 INFO:teuthology.task.ansible.out:false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC 2019-11-28T11:06:25.229 INFO:teuthology.task.ansible.out:mp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3 2019-11-28T11:06:25.233 INFO:teuthology.task.ansible.out:VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUM 2019-11-28T11:06:25.234 INFO:teuthology.task.ansible.out:MFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gabrioux", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} TASK [use 2019-11-28T11:06:25.236 INFO:teuthology.task.ansible.out:rs : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/auth 2019-11-28T11:06:25.239 INFO:teuthology.task.ansible.out:orized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gabrioux", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_key 2019-11-28T11:06:25.241 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudM 2019-11-28T11:06:25.242 INFO:teuthology.task.ansible.out:zeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_k 2019-11-28T11:06:25.244 INFO:teuthology.task.ansible.out:eys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6 2019-11-28T11:06:25.246 INFO:teuthology.task.ansible.out:rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9Fjc 2019-11-28T11:06:25.248 INFO:teuthology.task.ansible.out:JJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjami 2019-11-28T11:06:25.250 INFO:teuthology.task.ansible.out:n@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerso 2019-11-28T11:06:25.252 INFO:teuthology.task.ansible.out:n@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ***************** 2019-11-28T11:06:25.253 INFO:teuthology.task.ansible.out:******* ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 2019-11-28T11:06:25.255 INFO:teuthology.task.ansible.out:6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": n 2019-11-28T11:06:25.257 INFO:teuthology.task.ansible.out:ull, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKc 2019-11-28T11:06:25.259 INFO:teuthology.task.ansible.out:zX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIe 2019-11-28T11:06:25.260 INFO:teuthology.task.ansible.out:ArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MG 2019-11-28T11:06:25.262 INFO:teuthology.task.ansible.out:uzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbc 2019-11-28T11:06:25.264 INFO:teuthology.task.ansible.out:c0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixv 2019-11-28T11:06:25.266 INFO:teuthology.task.ansible.out:U/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYh 2019-11-28T11:06:25.267 INFO:teuthology.task.ansible.out:ZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKO 2019-11-28T11:06:25.269 INFO:teuthology.task.ansible.out:hFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3 2019-11-28T11:06:25.271 INFO:teuthology.task.ansible.out:QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMf 2019-11-28T11:06:25.273 INFO:teuthology.task.ansible.out:kSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa 2019-11-28T11:06:25.274 INFO:teuthology.task.ansible.out:53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph 2019-11-28T11:06:25.276 INFO:teuthology.task.ansible.out:.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53 2019-11-28T11:06:25.278 INFO:teuthology.task.ansible.out:', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb 2019-11-28T11:06:25.280 INFO:teuthology.task.ansible.out:54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e1 2019-11-28T11:06:25.282 INFO:teuthology.task.ansible.out:1aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2 2019-11-28T11:06:25.284 INFO:teuthology.task.ansible.out:xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b9716865 2019-11-28T11:06:25.285 INFO:teuthology.task.ansible.out:75cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": 2019-11-28T11:06:25.287 INFO:teuthology.task.ansible.out:"sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwM 2019-11-28T11:06:25.289 INFO:teuthology.task.ansible.out:rqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkP 2019-11-28T11:06:25.291 INFO:teuthology.task.ansible.out:vDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} TASK [users : 2019-11-28T11:06:25.293 INFO:teuthology.task.ansible.out:Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABA 2019-11-28T11:06:25.295 INFO:teuthology.task.ansible.out:AABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key" 2019-11-28T11:06:25.296 INFO:teuthology.task.ansible.out:: "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": 2019-11-28T11:06:25.298 INFO:teuthology.task.ansible.out: {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authori 2019-11-28T11:06:25.300 INFO:teuthology.task.ansible.out:zed_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoX 2019-11-28T11:06:25.302 INFO:teuthology.task.ansible.out:yDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBx 2019-11-28T11:06:25.304 INFO:teuthology.task.ansible.out:e1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5A 2019-11-28T11:06:25.306 INFO:teuthology.task.ansible.out:uiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix" 2019-11-28T11:06:25.308 INFO:teuthology.task.ansible.out:, "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan" 2019-11-28T11:06:25.310 INFO:teuthology.task.ansible.out:, "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false 2019-11-28T11:06:25.312 INFO:teuthology.task.ansible.out:, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile 2019-11-28T11:06:25.314 INFO:teuthology.task.ansible.out:": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBND 2019-11-28T11:06:25.316 INFO:teuthology.task.ansible.out:SqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansibl 2019-11-28T11:06:25.317 INFO:teuthology.task.ansible.out:e_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef33 2019-11-28T11:06:25.319 INFO:teuthology.task.ansible.out:15', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrU 2019-11-28T11:06:25.321 INFO:teuthology.task.ansible.out:Lzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx1 2019-11-28T11:06:25.323 INFO:teuthology.task.ansible.out:9mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSr 2019-11-28T11:06:25.325 INFO:teuthology.task.ansible.out:HklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ********************* 2019-11-28T11:06:25.335 INFO:teuthology.task.ansible.out:*** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPA 2019-11-28T11:06:25.339 INFO:teuthology.task.ansible.out:RrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gabrioux", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": 2019-11-28T11:06:25.341 INFO:teuthology.task.ansible.out:"/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options 2019-11-28T11:06:25.344 INFO:teuthology.task.ansible.out:": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df 2019-11-28T11:06:25.346 INFO:teuthology.task.ansible.out:5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'l 2019-11-28T11:06:25.348 INFO:teuthology.task.ansible.out:aura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura 2019-11-28T11:06:25.349 INFO:teuthology.task.ansible.out:", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQAB 2019-11-28T11:06:25.351 INFO:teuthology.task.ansible.out:AAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmD 2019-11-28T11:06:25.353 INFO:teuthology.task.ansible.out:wc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-11-28T11:06:25.356 INFO:teuthology.task.ansible.out: ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} 2019-11-28T11:06:25.357 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx 2019-11-28T11:06:25.359 INFO:teuthology.task.ansible.out:8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-11-28T11:06:25.361 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-11-28T11:06:25.363 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile" 2019-11-28T11:06:25.365 INFO:teuthology.task.ansible.out:: "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9 2019-11-28T11:06:25.367 INFO:teuthology.task.ansible.out:d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-11-28T11:06:25.369 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-11-28T11:06:25.370 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:25.372 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzne 2019-11-28T11:06:25.374 INFO:teuthology.task.ansible.out:r", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "commen 2019-11-28T11:06:25.376 INFO:teuthology.task.ansible.out:t": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": " 2019-11-28T11:06:25.378 INFO:teuthology.task.ansible.out:item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile" 2019-11-28T11:06:25.380 INFO:teuthology.task.ansible.out:: "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-11-28T11:06:25.384 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsA 2019-11-28T11:06:25.386 INFO:teuthology.task.ansible.out:ex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjar 2019-11-28T11:06:25.388 INFO:teuthology.task.ansible.out:a", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB 2019-11-28T11:06:25.390 INFO:teuthology.task.ansible.out:3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "sman 2019-11-28T11:06:25.402 INFO:teuthology.task.ansible.out:jara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_ 2019-11-28T11:06:25.407 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/h 2019-11-28T11:06:25.408 INFO:teuthology.task.ansible.out:ome/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQ 2019-11-28T11:06:25.410 INFO:teuthology.task.ansible.out:mLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com 2019-11-28T11:06:25.411 INFO:teuthology.task.ansible.out:\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} ok: [smithi075.front.sep 2019-11-28T11:06:25.413 INFO:teuthology.task.ansible.out:ia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs 2019-11-28T11:06:25.416 INFO:teuthology.task.ansible.out:+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6m 2019-11-28T11:06:25.418 INFO:teuthology.task.ansible.out:vATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXh 2019-11-28T11:06:25.425 INFO:teuthology.task.ansible.out:uqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQ 2019-11-28T11:06:25.427 INFO:teuthology.task.ansible.out:tazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-11-28T11:06:25.428 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-11-28T11:06:25.435 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'nam 2019-11-28T11:06:25.437 INFO:teuthology.task.ansible.out:e': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34 2019-11-28T11:06:25.438 INFO:teuthology.task.ansible.out:bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => 2019-11-28T11:06:25.440 INFO:teuthology.task.ansible.out:(item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} ok: [smithi0 2019-11-28T11:06:25.442 INFO:teuthology.task.ansible.out:75.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5x 2019-11-28T11:06:25.444 INFO:teuthology.task.ansible.out:NyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EA 2019-11-28T11:06:25.450 INFO:teuthology.task.ansible.out:AAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-11-28T11:06:25.457 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLP 2019-11-28T11:06:25.465 INFO:teuthology.task.ansible.out:CzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGm 2019-11-28T11:06:25.469 INFO:teuthology.task.ansible.out:KBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f7 2019-11-28T11:06:25.472 INFO:teuthology.task.ansible.out:4d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@ 2019-11-28T11:06:25.475 INFO:teuthology.task.ansible.out:private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts 2019-11-28T11:06:25.477 INFO:teuthology.task.ansible.out:7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852" 2019-11-28T11:06:25.479 INFO:teuthology.task.ansible.out:}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/h 2019-11-28T11:06:25.484 INFO:teuthology.task.ansible.out:ome/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_l 2019-11-28T11:06:25.487 INFO:teuthology.task.ansible.out:oop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff134 2019-11-28T11:06:25.489 INFO:teuthology.task.ansible.out:9349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-r 2019-11-28T11:06:25.491 INFO:teuthology.task.ansible.out:sa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} TASK [users : Create al 2019-11-28T11:06:25.493 INFO:teuthology.task.ansible.out:l admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRX 2019-11-28T11:06:25.495 INFO:teuthology.task.ansible.out:pnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, " 2019-11-28T11:06:25.498 INFO:teuthology.task.ansible.out:comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml 2019-11-28T11:06:25.500 INFO:teuthology.task.ansible.out:3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "ke 2019-11-28T11:06:25.503 INFO:teuthology.task.ansible.out:y_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dH 2019-11-28T11:06:25.506 INFO:teuthology.task.ansible.out:f4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzr 2019-11-28T11:06:25.508 INFO:teuthology.task.ansible.out:HE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB1 2019-11-28T11:06:25.510 INFO:teuthology.task.ansible.out:0ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "sta 2019-11-28T11:06:25.512 INFO:teuthology.task.ansible.out:te": "present", "user": "rpavani1998", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e 2019-11-28T11:06:25.514 INFO:teuthology.task.ansible.out:+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a 2019-11-28T11:06:25.516 INFO:teuthology.task.ansible.out:15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-11-28T11:06:25.518 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} 2019-11-28T11:06:25.520 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-11-28T11:06:25.523 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} TASK [us 2019-11-28T11:06:25.524 INFO:teuthology.task.ansible.out:ers : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "pre 2019-11-28T11:06:25.526 INFO:teuthology.task.ansible.out:sent", "user": "skrah", "validate_certs": true} 2019-11-28T11:06:25.530 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-11-28T11:06:25.532 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-11-28T11:06:25.533 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-11-28T11:06:25.535 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", " 2019-11-28T11:06:25.537 INFO:teuthology.task.ansible.out:uid": 1215} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AA 2019-11-28T11:06:25.539 INFO:teuthology.task.ansible.out:AAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4Quza 2019-11-28T11:06:25.542 INFO:teuthology.task.ansible.out:UhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name 2019-11-28T11:06:25.544 INFO:teuthology.task.ansible.out:': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'} 2019-11-28T11:06:25.545 INFO:teuthology.task.ansible.out:) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+j 2019-11-28T11:06:25.547 INFO:teuthology.task.ansible.out:pPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-11-28T11:06:25.549 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "ch 2019-11-28T11:06:25.550 INFO:teuthology.task.ansible.out:anged": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": 2019-11-28T11:06:25.552 INFO:teuthology.task.ansible.out:"/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} TASK [users : Create all admin users with sudo access.] ************************ 2019-11-28T11:06:25.553 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2019-11-28T11:06:25.639 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-11-28T11:06:25.640 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-11-28T11:06:25.641 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-11-28T11:06:25.643 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-11-28T11:06:25.645 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn 2019-11-28T11:06:25.646 INFO:teuthology.task.ansible.out:/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-11-28T11:06:25.648 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+ 2019-11-28T11:06:25.650 INFO:teuthology.task.ansible.out:miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-11-28T11:06:25.651 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUl 2019-11-28T11:06:25.653 INFO:teuthology.task.ansible.out:xtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-11-28T11:06:25.655 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-11-28T11:06:25.703 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:25 +0000 (0:00:10.439) 0:01:01.720 ***** 2019-11-28T11:06:27.557 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-11-28T11:06:27.558 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-11-28T11:06:27.560 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-11-28T11:06:27.562 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-11-28T11:06:27.563 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-11-28T11:06:27.565 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-11-28T11:06:27.566 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_ 2019-11-28T11:06:27.568 INFO:teuthology.task.ansible.out:dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-11-28T11:06:27.569 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} 2019-11-28T11:06:27.571 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": 2019-11-28T11:06:27.572 INFO:teuthology.task.ansible.out: true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-11-28T11:06:27.574 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-11-28T11:06:27.576 INFO:teuthology.task.ansible.out:lidate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redh 2019-11-28T11:06:27.578 INFO:teuthology.task.ansible.out:at.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZ 2019-11-28T11:06:27.579 INFO:teuthology.task.ansible.out:L/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-11-28T11:06:27.581 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-11-28T11:06:27.583 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-11-28T11:06:27.584 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-11-28T11:06:27.586 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1 2019-11-28T11:06:27.587 INFO:teuthology.task.ansible.out:d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment 2019-11-28T11:06:27.589 INFO:teuthology.task.ansible.out:": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d 2019-11-28T11:06:27.591 INFO:teuthology.task.ansible.out:57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8 2019-11-28T11:06:27.592 INFO:teuthology.task.ansible.out:oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSq 2019-11-28T11:06:27.596 INFO:teuthology.task.ansible.out:diOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elT 2019-11-28T11:06:27.598 INFO:teuthology.task.ansible.out:bz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/ 2019-11-28T11:06:27.599 INFO:teuthology.task.ansible.out:eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f1 2019-11-28T11:06:27.601 INFO:teuthology.task.ansible.out:4cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcR 2019-11-28T11:06:27.602 INFO:teuthology.task.ansible.out:kilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ans 2019-11-28T11:06:27.604 INFO:teuthology.task.ansible.out:ible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSv 2019-11-28T11:06:27.605 INFO:teuthology.task.ansible.out:doIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": 2019-11-28T11:06:27.607 INFO:teuthology.task.ansible.out: false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb75 2019-11-28T11:06:27.608 INFO:teuthology.task.ansible.out:02a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "s 2019-11-28T11:06:27.610 INFO:teuthology.task.ansible.out:tate": "present", "user": "mbenjamin", "validate_certs": true} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rs 2019-11-28T11:06:27.611 INFO:teuthology.task.ansible.out:a AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': 2019-11-28T11:06:27.613 INFO:teuthology.task.ansible.out: u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd3 2019-11-28T11:06:27.614 INFO:teuthology.task.ansible.out:8865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcX 2019-11-28T11:06:27.616 INFO:teuthology.task.ansible.out:JNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} changed: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, 2019-11-28T11:06:27.617 INFO:teuthology.task.ansible.out: "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-28T11:06:27.682 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-11-28T11:06:27.683 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:27.685 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} changed: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/X 2019-11-28T11:06:27.686 INFO:teuthology.task.ansible.out:agFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-28T11:06:27.756 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-11-28T11:06:27.757 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-11-28T11:06:27.802 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:27 +0000 (0:00:02.099) 0:01:03.819 ***** 2019-11-28T11:06:27.847 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:27 +0000 (0:00:00.044) 0:01:03.864 ***** 2019-11-28T11:06:27.895 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:27 +0000 (0:00:00.048) 0:01:03.913 ***** 2019-11-28T11:06:30.033 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-11-28T11:06:30.037 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f75 2019-11-28T11:06:30.038 INFO:teuthology.task.ansible.out:6860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-11-28T11:06:30.041 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.044 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.046 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.050 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDS 2019-11-28T11:06:30.052 INFO:teuthology.task.ansible.out:on5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.059 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.063 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": 2019-11-28T11:06:30.069 INFO:teuthology.task.ansible.out: "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJ 2019-11-28T11:06:30.073 INFO:teuthology.task.ansible.out:S6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.cep 2019-11-28T11:06:30.078 INFO:teuthology.task.ansible.out:h.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, " 2019-11-28T11:06:30.084 INFO:teuthology.task.ansible.out:exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3 2019-11-28T11:06:30.086 INFO:teuthology.task.ansible.out:wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5 2019-11-28T11:06:30.087 INFO:teuthology.task.ansible.out:b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} TASK [users : Update authorized_keys using the keys repo] ***** 2019-11-28T11:06:30.089 INFO:teuthology.task.ansible.out:***************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi133.front.sepia.ceph. 2019-11-28T11:06:30.090 INFO:teuthology.task.ansible.out:com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com 2019-11-28T11:06:30.092 INFO:teuthology.task.ansible.out:", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1y 2019-11-28T11:06:30.093 INFO:teuthology.task.ansible.out:c2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH 2019-11-28T11:06:30.095 INFO:teuthology.task.ansible.out:4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "pr 2019-11-28T11:06:30.097 INFO:teuthology.task.ansible.out:esent", "user": "gmeno", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+ 2019-11-28T11:06:30.098 INFO:teuthology.task.ansible.out:tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4 2019-11-28T11:06:30.100 INFO:teuthology.task.ansible.out:gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, 2019-11-28T11:06:30.101 INFO:teuthology.task.ansible.out: "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWS 2019-11-28T11:06:30.103 INFO:teuthology.task.ansible.out:dLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPC 2019-11-28T11:06:30.105 INFO:teuthology.task.ansible.out:y04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/h 2019-11-28T11:06:30.106 INFO:teuthology.task.ansible.out:ome/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} TASK [users : Update authorized_keys using the k 2019-11-28T11:06:30.108 INFO:teuthology.task.ansible.out:eys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV 2019-11-28T11:06:30.109 INFO:teuthology.task.ansible.out:8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SY 2019-11-28T11:06:30.131 INFO:teuthology.task.ansible.out:NxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gabrioux", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd 2019-11-28T11:06:30.133 INFO:teuthology.task.ansible.out:444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} ok: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6 2019-11-28T11:06:30.134 INFO:teuthology.task.ansible.out:qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/Z 2019-11-28T11:06:30.136 INFO:teuthology.task.ansible.out:lqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7O 2019-11-28T11:06:30.138 INFO:teuthology.task.ansible.out:k9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305 2019-11-28T11:06:30.139 INFO:teuthology.task.ansible.out:ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac9 2019-11-28T11:06:30.141 INFO:teuthology.task.ansible.out:79501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip 2019-11-28T11:06:30.142 INFO:teuthology.task.ansible.out:_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.144 INFO:teuthology.task.ansible.out: skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.145 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e8 2019-11-28T11:06:30.147 INFO:teuthology.task.ansible.out:31a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": 2019-11-28T11:06:30.148 INFO:teuthology.task.ansible.out:{"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.150 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.151 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-28T11:06:30.153 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.154 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.156 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3 2019-11-28T11:06:30.159 INFO:teuthology.task.ansible.out:ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lese 2019-11-28T11:06:30.161 INFO:teuthology.task.ansible.out:b", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.162 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQ 2019-11-28T11:06:30.164 INFO:teuthology.task.ansible.out:eREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'joao 2019-11-28T11:06:30.165 INFO:teuthology.task.ansible.out:@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.167 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.169 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24 2019-11-28T11:06:30.170 INFO:teuthology.task.ansible.out:a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.172 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.174 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.175 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.178 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn 2019-11-28T11:06:30.180 INFO:teuthology.task.ansible.out:': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.181 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.184 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqY 2019-11-28T11:06:30.185 INFO:teuthology.task.ansible.out:AARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr 2019-11-28T11:06:30.187 INFO:teuthology.task.ansible.out:+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f 2019-11-28T11:06:30.189 INFO:teuthology.task.ansible.out:64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@ 2019-11-28T11:06:30.190 INFO:teuthology.task.ansible.out:smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.192 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.195 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.197 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.198 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.200 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.201 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.204 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fc 2019-11-28T11:06:30.205 INFO:teuthology.task.ansible.out:a"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheply 2019-11-28T11:06:30.207 INFO:teuthology.task.ansible.out:akov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.208 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.210 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.211 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.214 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item" 2019-11-28T11:06:30.217 INFO:teuthology.task.ansible.out:: {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov 2019-11-28T11:06:30.219 INFO:teuthology.task.ansible.out:201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3Vdv 2019-11-28T11:06:30.221 INFO:teuthology.task.ansible.out:tfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f82 2019-11-28T11:06:30.223 INFO:teuthology.task.ansible.out:6aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result 2019-11-28T11:06:30.225 INFO:teuthology.task.ansible.out:was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.235 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_c 2019-11-28T11:06:30.237 INFO:teuthology.task.ansible.out:li0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5 2019-11-28T11:06:30.238 INFO:teuthology.task.ansible.out:xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJM 2019-11-28T11:06:30.240 INFO:teuthology.task.ansible.out:G+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d552 2019-11-28T11:06:30.241 INFO:teuthology.task.ansible.out:4863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn 2019-11-28T11:06:30.248 INFO:teuthology.task.ansible.out:': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => ( 2019-11-28T11:06:30.251 INFO:teuthology.task.ansible.out:item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagn 2019-11-28T11:06:30.256 INFO:teuthology.task.ansible.out:er", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.s 2019-11-28T11:06:30.258 INFO:teuthology.task.ansible.out:epia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7 2019-11-28T11:06:30.260 INFO:teuthology.task.ansible.out:oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678 2019-11-28T11:06:30.263 INFO:teuthology.task.ansible.out:e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu 2019-11-28T11:06:30.268 INFO:teuthology.task.ansible.out:7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} s 2019-11-28T11:06:30.271 INFO:teuthology.task.ansible.out:kipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e77 2019-11-28T11:06:30.276 INFO:teuthology.task.ansible.out:4707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 2019-11-28T11:06:30.278 INFO:teuthology.task.ansible.out: 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes L 2019-11-28T11:06:30.280 INFO:teuthology.task.ansible.out:MS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1 2019-11-28T11:06:30.281 INFO:teuthology.task.ansible.out:f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhX 2019-11-28T11:06:30.283 INFO:teuthology.task.ansible.out:akU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "s 2019-11-28T11:06:30.284 INFO:teuthology.task.ansible.out:kip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"a 2019-11-28T11:06:30.286 INFO:teuthology.task.ansible.out:nsible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com 2019-11-28T11:06:30.287 INFO:teuthology.task.ansible.out:] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name 2019-11-28T11:06:30.289 INFO:teuthology.task.ansible.out:": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.290 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.310 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.311 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:30.313 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi075.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:30.337 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-11-28T11:06:30.340 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-11-28T11:06:30.342 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04 2019-11-28T11:06:30.344 INFO:teuthology.task.ansible.out:okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "jos 2019-11-28T11:06:30.346 INFO:teuthology.task.ansible.out:hd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jo 2019-11-28T11:06:30.347 INFO:teuthology.task.ansible.out:wilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f 2019-11-28T11:06:30.349 INFO:teuthology.task.ansible.out:966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h 2019-11-28T11:06:30.351 INFO:teuthology.task.ansible.out:7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6 2019-11-28T11:06:30.354 INFO:teuthology.task.ansible.out:c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa 2019-11-28T11:06:30.356 INFO:teuthology.task.ansible.out:2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db2 2019-11-28T11:06:30.358 INFO:teuthology.task.ansible.out:93dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.red 2019-11-28T11:06:30.360 INFO:teuthology.task.ansible.out:hat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f 2019-11-28T11:06:30.362 INFO:teuthology.task.ansible.out:57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EA 2019-11-28T11:06:30.363 INFO:teuthology.task.ansible.out:AAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d76 2019-11-28T11:06:30.370 INFO:teuthology.task.ansible.out:1bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4H 2019-11-28T11:06:30.373 INFO:teuthology.task.ansible.out:cWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-11-28T11:06:30.417 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:30 +0000 (0:00:02.522) 0:01:06.435 ***** 2019-11-28T11:06:30.462 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:30 +0000 (0:00:00.044) 0:01:06.479 ***** 2019-11-28T11:06:30.558 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:30 +0000 (0:00:00.095) 0:01:06.575 ***** 2019-11-28T11:06:30.566 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-11-28T11:06:30.569 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:30.571 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-11-28T11:06:30.572 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-28T11:06:30.628 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-11-28T11:06:30.630 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-11-28T11:06:30.675 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:30 +0000 (0:00:00.116) 0:01:06.692 ***** 2019-11-28T11:06:30.711 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:30 +0000 (0:00:00.036) 0:01:06.729 ***** 2019-11-28T11:06:30.754 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:30 +0000 (0:00:00.042) 0:01:06.771 ***** 2019-11-28T11:06:31.409 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} 2019-11-28T11:06:31.416 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8a 2019-11-28T11:06:31.418 INFO:teuthology.task.ansible.out:cf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a02962 2019-11-28T11:06:31.421 INFO:teuthology.task.ansible.out:33ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "i 2019-11-28T11:06:31.429 INFO:teuthology.task.ansible.out:tem", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": nul 2019-11-28T11:06:31.432 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXm 2019-11-28T11:06:31.437 INFO:teuthology.task.ansible.out:DA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7Ds 2019-11-28T11:06:31.439 INFO:teuthology.task.ansible.out:MoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ 2019-11-28T11:06:31.442 INFO:teuthology.task.ansible.out:1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAA 2019-11-28T11:06:31.445 INFO:teuthology.task.ansible.out:B3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h 2019-11-28T11:06:31.451 INFO:teuthology.task.ansible.out:2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_l 2019-11-28T11:06:31.453 INFO:teuthology.task.ansible.out:oop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} TASK [users : Clone the keys repo] ********************************************* ok: [smithi174.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\ 2019-11-28T11:06:31.457 INFO:teuthology.task.ansible.out:n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} 2019-11-28T11:06:31.499 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:31 +0000 (0:00:00.744) 0:01:07.516 ***** 2019-11-28T11:06:32.964 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-11-28T11:06:32.966 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-11-28T11:06:32.968 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} 2019-11-28T11:06:32.969 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:32.971 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-11-28T11:06:32.972 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-11-28T11:06:32.974 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-11-28T11:06:32.976 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-11-28T11:06:32.982 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": 2019-11-28T11:06:32.983 INFO:teuthology.task.ansible.out: null, "state": "present", "user": "tserlin", "validate_certs": true} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd 2019-11-28T11:06:32.985 INFO:teuthology.task.ansible.out:6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu- 2019-11-28T11:06:32.987 INFO:teuthology.task.ansible.out:laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080. 2019-11-28T11:06:32.989 INFO:teuthology.task.ansible.out:front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'y 2019-11-28T11:06:32.990 INFO:teuthology.task.ansible.out:uriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-11-28T11:06:32.992 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:32.993 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:32.995 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:32.997 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifY 2019-11-28T11:06:32.999 INFO:teuthology.task.ansible.out:NDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090e 2019-11-28T11:06:33.000 INFO:teuthology.task.ansible.out:a4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.002 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-11-28T11:06:33.003 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.005 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-11-28T11:06:33.008 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.011 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj 2019-11-28T11:06:33.013 INFO:teuthology.task.ansible.out:@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:33.016 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95eh 2019-11-28T11:06:33.018 INFO:teuthology.task.ansible.out:Ww f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyn 2019-11-28T11:06:33.020 INFO:teuthology.task.ansible.out:s@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-11-28T11:06:33.022 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.023 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-28T11:06:33.025 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-11-28T11:06:33.027 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.028 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.030 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.032 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-28T11:06:33.034 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.035 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.038 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.040 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.042 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.044 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.045 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.047 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-11-28T11:06:33.048 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:33.050 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-28T11:06:33.052 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.053 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.055 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.056 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.058 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:33.060 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.061 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.063 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-11-28T11:06:33.064 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.066 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.069 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.071 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.072 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-28T11:06:33.074 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-28T11:06:33.077 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.079 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.080 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.082 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.083 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.085 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.086 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.088 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.089 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:33.114 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:33.115 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-11-28T11:06:33.125 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-11-28T11:06:33.168 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:33 +0000 (0:00:01.669) 0:01:09.186 ***** 2019-11-28T11:06:35.990 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:35.992 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-11-28T11:06:35.995 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-11-28T11:06:35.998 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-11-28T11:06:36.002 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:36.004 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7Nm 2019-11-28T11:06:36.005 INFO:teuthology.task.ansible.out:bR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-11-28T11:06:36.007 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:36.012 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBw 2019-11-28T11:06:36.014 INFO:teuthology.task.ansible.out:JCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-28T11:06:36.016 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-11-28T11:06:36.017 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXG 2019-11-28T11:06:36.019 INFO:teuthology.task.ansible.out:XmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "i 2019-11-28T11:06:36.020 INFO:teuthology.task.ansible.out:tem", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-11-28T11:06:36.023 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:36.024 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-11-28T11:06:36.026 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-11-28T11:06:36.027 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-11-28T11:06:36.029 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-11-28T11:06:36.030 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-11-28T11:06:36.032 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:36.036 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoS 2019-11-28T11:06:36.038 INFO:teuthology.task.ansible.out:BW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRy 2019-11-28T11:06:36.040 INFO:teuthology.task.ansible.out:GELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:36.045 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FY 2019-11-28T11:06:36.047 INFO:teuthology.task.ansible.out:v7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-11-28T11:06:36.049 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh 2019-11-28T11:06:36.051 INFO:teuthology.task.ansible.out:8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-11-28T11:06:36.058 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSx 2019-11-28T11:06:36.062 INFO:teuthology.task.ansible.out:Vr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk 2019-11-28T11:06:36.070 INFO:teuthology.task.ansible.out:3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "fol 2019-11-28T11:06:36.073 INFO:teuthology.task.ansible.out:low": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2 2019-11-28T11:06:36.077 INFO:teuthology.task.ansible.out:ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, 2019-11-28T11:06:36.079 INFO:teuthology.task.ansible.out: "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": tru 2019-11-28T11:06:36.090 INFO:teuthology.task.ansible.out:e, "path": null, "state": "present", "user": "trociny", "validate_certs": true} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dc 2019-11-28T11:06:36.101 INFO:teuthology.task.ansible.out:RTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR 2019-11-28T11:06:36.105 INFO:teuthology.task.ansible.out:/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc 2019-11-28T11:06:36.120 INFO:teuthology.task.ansible.out:35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFK 2019-11-28T11:06:36.122 INFO:teuthology.task.ansible.out:h/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CG 2019-11-28T11:06:36.124 INFO:teuthology.task.ansible.out:BuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df 2019-11-28T11:06:36.125 INFO:teuthology.task.ansible.out:4a5"}, "skip_reason": "Conditional result was False"} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} ok: [smithi133.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d7 2019-11-28T11:06:36.127 INFO:teuthology.task.ansible.out:4c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io 2019-11-28T11:06:36.129 INFO:teuthology.task.ansible.out: RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9 2019-11-28T11:06:36.131 INFO:teuthology.task.ansible.out:FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOr 2019-11-28T11:06:36.135 INFO:teuthology.task.ansible.out:Zru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV 2019-11-28T11:06:36.142 INFO:teuthology.task.ansible.out:1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "sta 2019-11-28T11:06:36.145 INFO:teuthology.task.ansible.out:te": "present", "user": "mchangir", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWo 2019-11-28T11:06:36.147 INFO:teuthology.task.ansible.out:pjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403 2019-11-28T11:06:36.149 INFO:teuthology.task.ansible.out:sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-a 2019-11-28T11:06:36.151 INFO:teuthology.task.ansible.out:ngeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hw 2019-11-28T11:06:36.153 INFO:teuthology.task.ansible.out:XJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u 2019-11-28T11:06:36.154 INFO:teuthology.task.ansible.out:'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "chan 2019-11-28T11:06:36.156 INFO:teuthology.task.ansible.out:ged": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => ( 2019-11-28T11:06:36.158 INFO:teuthology.task.ansible.out:item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi075.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-28T11:06:36.166 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-11-28T11:06:36.168 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-11-28T11:06:36.170 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-11-28T11:06:36.172 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-11-28T11:06:36.212 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:36 +0000 (0:00:03.043) 0:01:12.230 ***** 2019-11-28T11:06:36.266 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:36 +0000 (0:00:00.053) 0:01:12.283 ***** 2019-11-28T11:06:36.631 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:36.633 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:36.635 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_c 2019-11-28T11:06:36.637 INFO:teuthology.task.ansible.out:erts": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/a 2019-11-28T11:06:36.639 INFO:teuthology.task.ansible.out:uthorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present" 2019-11-28T11:06:36.641 INFO:teuthology.task.ansible.out:, "user": "wusui", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-11-28T11:06:36.642 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0im 2019-11-28T11:06:36.644 INFO:teuthology.task.ansible.out:oTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi133.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-28T11:06:36.714 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:36 +0000 (0:00:00.448) 0:01:12.731 ***** 2019-11-28T11:06:36.909 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:36.910 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-11-28T11:06:36.912 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-11-28T11:06:36.914 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-11-28T11:06:36.916 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-11-28T11:06:36.918 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939196.24-5131022546708/source", "state": "file", "uid": 0} 2019-11-28T11:06:36.969 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:36 +0000 (0:00:00.254) 0:01:12.986 ***** 2019-11-28T11:06:37.643 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:37.645 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-11-28T11:06:37.660 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxw 2019-11-28T11:06:37.663 INFO:teuthology.task.ansible.out:ai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "chan 2019-11-28T11:06:37.665 INFO:teuthology.task.ansible.out:ged": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EA 2019-11-28T11:06:37.667 INFO:teuthology.task.ansible.out:AAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4C 2019-11-28T11:06:37.669 INFO:teuthology.task.ansible.out:t+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "b 2019-11-28T11:06:37.673 INFO:teuthology.task.ansible.out:hubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad 2019-11-28T11:06:37.675 INFO:teuthology.task.ansible.out:", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} 2019-11-28T11:06:37.679 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939196.94-96622231644161/source", "state": "file", "uid": 0} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVt 2019-11-28T11:06:37.681 INFO:teuthology.task.ansible.out:aZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-11-28T11:06:37.746 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:37 +0000 (0:00:00.777) 0:01:13.764 ***** 2019-11-28T11:06:37.754 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi075.front.sepia.ceph.com] => { "msg": "Host smithi075.front.sepia.ceph.com is running RedHat 7.7 (Maipo)" } 2019-11-28T11:06:37.755 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-11-28T11:06:37.810 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:37 +0000 (0:00:00.063) 0:01:13.827 ***** 2019-11-28T11:06:37.824 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} TASK [common : Log the OS name, version and release] *************************** ok: [smithi133.front.sepia.ceph.com] => { "msg": "Host smithi133.front.sepia.ceph.com is running RedHat 7.7 (Maipo)" } TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjo 2019-11-28T11:06:37.826 INFO:teuthology.task.ansible.out:v+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gabrioux", "validate_certs": true} 2019-11-28T11:06:37.893 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:37 +0000 (0:00:00.082) 0:01:13.910 ***** 2019-11-28T11:06:38.139 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi075.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml) => {"ansible_facts": {"rhsm_repos": ["rhel-7-server-rpms", "rhel-7-server-optional-rpms", "rhel-7-server-extras-rpms", "rhel-ha-for-rhel-7-server-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm 2019-11-28T11:06:38.141 INFO:teuthology.task.ansible.out:5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} Thursday 28 November 2019 11:06:37 +0000 (0:00:00.050) 0:01:13.960 ***** TASK [common : Including major version specific variables.] ******************** ok: [smithi133.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml) => {"ansible_facts": {"rhsm_repos": ["rhel-7-server-rpms", "rhel-7-server-optional-rpms", "rhel-7-server-extras-rpms", "rhel-ha-for-rhel-7-server-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml"} TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} Thursday 28 November 2019 11:06:38 +0000 (0:00:00.062) 0:01:14.023 ***** TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 28 November 2019 11:06:38 +0000 (0:00:00.049) 0:01:14.072 ***** skipping 2019-11-28T11:06:38.142 INFO:teuthology.task.ansible.out:: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp 2019-11-28T11:06:38.144 INFO:teuthology.task.ansible.out:-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} Thursday 28 November 2019 11:06:38 +0000 (0:00:00.054) 0:01:14.127 ***** 2019-11-28T11:06:38.352 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-11-28T11:06:38.354 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-11-28T11:06:38.356 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-11-28T11:06:38.357 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-11-28T11:06:38.360 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:38.361 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-11-28T11:06:38.363 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.085360", "end": "2019-11-28 11:06:38.321960", "rc": 0, "start": "2019-11-28 11:06:38.236600", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-28T11:06:38.408 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:38 +0000 (0:00:00.298) 0:01:14.425 ***** 2019-11-28T11:06:38.625 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:38.627 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-11-28T11:06:38.628 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-11-28T11:06:38.630 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-11-28T11:06:38.632 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-11-28T11:06:38.633 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.084053", "end": "2019-11-28 11:06:38.600852", "rc": 0, "start": "2019-11-28 11:06:38.516799", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-28T11:06:38.635 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-11-28T11:06:38.637 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-11-28T11:06:38.674 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:38 +0000 (0:00:00.266) 0:01:14.692 ***** 2019-11-28T11:06:38.682 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-11-28T11:06:38.684 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:38.685 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-28T11:06:38.740 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:38 +0000 (0:00:00.064) 0:01:14.757 ***** 2019-11-28T11:06:38.765 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-11-28T11:06:38.799 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:38 +0000 (0:00:00.058) 0:01:14.816 ***** 2019-11-28T11:06:38.808 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-11-28T11:06:38.810 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:38.852 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:38 +0000 (0:00:00.052) 0:01:14.869 ***** 2019-11-28T11:06:38.860 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:38.862 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-11-28T11:06:38.863 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:38.865 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoy 2019-11-28T11:06:38.866 INFO:teuthology.task.ansible.out:wLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-11-28T11:06:38.920 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:38 +0000 (0:00:00.068) 0:01:14.937 ***** 2019-11-28T11:06:38.926 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-11-28T11:06:38.928 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-11-28T11:06:38.967 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:38 +0000 (0:00:00.047) 0:01:14.985 ***** 2019-11-28T11:06:38.975 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:38.976 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-11-28T11:06:38.978 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:39.024 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:39 +0000 (0:00:00.052) 0:01:15.038 ***** 2019-11-28T11:06:39.032 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJ 2019-11-28T11:06:39.034 INFO:teuthology.task.ansible.out:sm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} 2019-11-28T11:06:39.080 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:39 +0000 (0:00:00.059) 0:01:15.097 ***** 2019-11-28T11:06:39.085 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-11-28T11:06:39.086 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:39.088 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-11-28T11:06:39.136 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:39 +0000 (0:00:00.056) 0:01:15.153 ***** 2019-11-28T11:06:39.143 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-11-28T11:06:39.145 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-11-28T11:06:39.189 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:39 +0000 (0:00:00.053) 0:01:15.206 ***** 2019-11-28T11:06:39.197 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-11-28T11:06:39.199 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:39.265 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:39 +0000 (0:00:00.073) 0:01:15.280 ***** 2019-11-28T11:06:39.269 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-11-28T11:06:39.270 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** ok: [smithi075.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2019-11-28T11:06:39.272 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:39.274 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-11-28T11:06:39.314 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:39 +0000 (0:00:00.052) 0:01:15.332 ***** 2019-11-28T11:06:39.324 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2019-11-28T11:06:39.361 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:39 +0000 (0:00:00.046) 0:01:15.378 ***** 2019-11-28T11:06:39.371 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:39.374 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-11-28T11:06:39.377 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} TASK [common : Include Red Hat encrypted variables.] *************************** ok: [smithi075.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi075.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T11:06:39.423 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:39 +0000 (0:00:00.061) 0:01:15.440 ***** 2019-11-28T11:06:39.432 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-11-28T11:06:39.437 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** ok: [smithi133.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi133.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} 2019-11-28T11:06:39.443 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-11-28T11:06:39.478 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:39 +0000 (0:00:00.055) 0:01:15.496 ***** 2019-11-28T11:06:39.485 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-11-28T11:06:39.486 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2019-11-28T11:06:39.525 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:39 +0000 (0:00:00.046) 0:01:15.542 ***** 2019-11-28T11:06:39.527 INFO:teuthology.task.ansible.out: 2019-11-28T11:06:39.535 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2019-11-28T11:06:39.578 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:39 +0000 (0:00:00.052) 0:01:15.595 ***** 2019-11-28T11:06:39.836 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:39.837 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-11-28T11:06:39.839 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-11-28T11:06:39.840 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-11-28T11:06:39.842 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4 2019-11-28T11:06:39.844 INFO:teuthology.task.ansible.out:qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} changed: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-28T11:06:39.896 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:39.905 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} 2019-11-28T11:06:39.941 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:39 +0000 (0:00:00.362) 0:01:15.957 ***** 2019-11-28T11:06:41.790 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8P 2019-11-28T11:06:41.792 INFO:teuthology.task.ansible.out:U30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-11-28T11:06:41.793 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:41.795 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-11-28T11:06:41.797 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-11-28T11:06:41.799 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-11-28T11:06:41.801 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-11-28T11:06:41.802 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-11-28T11:06:41.804 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-11-28T11:06:41.806 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-11-28T11:06:41.807 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} 2019-11-28T11:06:41.809 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-11-28T11:06:41.810 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-11-28T11:06:41.812 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-11-28T11:06:41.814 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-11-28T11:06:41.816 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1m 2019-11-28T11:06:41.818 INFO:teuthology.task.ansible.out:IGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} 2019-11-28T11:06:41.820 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-11-28T11:06:41.822 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-11-28T11:06:41.823 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:41.826 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} 2019-11-28T11:06:41.827 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-3.noarch providing /root/.ansible/tmp/ansible-moduletmp-1574939200.69-B8l4cH/katello-ca-consumer-latest.noarch3yCADM.rpm is already installed"]} 2019-11-28T11:06:41.874 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:41 +0000 (0:00:01.934) 0:01:17.892 ***** 2019-11-28T11:06:41.883 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-28T11:06:41.886 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:41.888 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-11-28T11:06:41.893 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-3.noarch providing /root/.ansible/tmp/ansible-moduletmp-1574939200.68-fU5itL/katello-ca-consumer-latest.noarchXziw3l.rpm is already installed"]} 2019-11-28T11:06:41.894 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:41.897 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-28T11:06:41.901 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d2 2019-11-28T11:06:41.903 INFO:teuthology.task.ansible.out:49450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:41.939 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:41 +0000 (0:00:00.064) 0:01:17.957 ***** 2019-11-28T11:06:41.996 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:41.999 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-11-28T11:06:42.001 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi080.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-28T11:06:42.054 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:42 +0000 (0:00:00.115) 0:01:18.072 ***** 2019-11-28T11:06:42.542 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:42.546 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-11-28T11:06:42.552 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-11-28T11:06:42.557 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:42.560 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-11-28T11:06:42.564 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-11-28T11:06:42.566 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-28T11:06:42.569 INFO:teuthology.task.ansible.out: ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-11-28T11:06:42.571 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-11-28T11:06:42.573 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-11-28T11:06:42.577 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** fatal: [smithi075.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2019-11-28T11:06:42.579 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-28T11:06:42.588 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} 2019-11-28T11:06:42.642 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:42 +0000 (0:00:00.583) 0:01:18.655 ***** 2019-11-28T11:06:42.699 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:42.700 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-11-28T11:06:42.710 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-11-28T11:06:42.712 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** fatal: [smithi133.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2019-11-28T11:06:42.767 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:42 +0000 (0:00:00.127) 0:01:18.783 ***** 2019-11-28T11:06:42.776 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** ok: [smithi075.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2019-11-28T11:06:42.778 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-11-28T11:06:42.826 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:42 +0000 (0:00:00.056) 0:01:18.840 ***** 2019-11-28T11:06:42.835 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} 2019-11-28T11:06:42.886 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:42 +0000 (0:00:00.063) 0:01:18.904 ***** 2019-11-28T11:06:43.237 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-11-28T11:06:43.239 INFO:teuthology.task.ansible.out: 2019-11-28T11:06:43.241 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-28T11:06:43.243 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-11-28T11:06:43.245 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.246 INFO:teuthology.task.ansible.out: 2019-11-28T11:06:43.248 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjI 2019-11-28T11:06:43.251 INFO:teuthology.task.ansible.out:ibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-28T11:06:43.263 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.265 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", 2019-11-28T11:06:43.267 INFO:teuthology.task.ansible.out:"changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.269 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.271 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.276 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.278 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.280 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.287 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.289 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-11-28T11:06:43.291 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939202.58-244996559475388/source", "state": "file", "uid": 0} TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:43.293 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-11-28T11:06:43.294 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-11-28T11:06:43.296 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-11-28T11:06:43.299 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-11-28T11:06:43.300 INFO:teuthology.task.ansible.out: 2019-11-28T11:06:43.302 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.313 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.315 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.317 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.319 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.321 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.322 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.324 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.325 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.404 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:43 +0000 (0:00:00.517) 0:01:19.421 ***** 2019-11-28T11:06:43.992 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.997 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:43.998 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:44.000 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:44.002 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:44.003 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:44.005 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:44.008 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jj 2019-11-28T11:06:44.010 INFO:teuthology.task.ansible.out:atdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:44.015 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:44.017 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi016.front. 2019-11-28T11:06:44.018 INFO:teuthology.task.ansible.out:sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:44.020 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:44.030 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": { 2019-11-28T11:06:44.035 INFO:teuthology.task.ansible.out:"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@ear 2019-11-28T11:06:44.042 INFO:teuthology.task.ansible.out:th +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6 2019-11-28T11:06:44.047 INFO:teuthology.task.ansible.out:f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi016.front.sepia.ceph.com] => (item={u 2019-11-28T11:06:44.050 INFO:teuthology.task.ansible.out:'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/ 2019-11-28T11:06:44.052 INFO:teuthology.task.ansible.out:nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b7783845 2019-11-28T11:06:44.054 INFO:teuthology.task.ansible.out:9ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result 2019-11-28T11:06:44.055 INFO:teuthology.task.ansible.out:was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "s 2019-11-28T11:06:44.057 INFO:teuthology.task.ansible.out:manjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front 2019-11-28T11:06:44.059 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var" 2019-11-28T11:06:44.061 INFO:teuthology.task.ansible.out:: "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjj 2019-11-28T11:06:44.062 INFO:teuthology.task.ansible.out:JhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) 2019-11-28T11:06:44.064 INFO:teuthology.task.ansible.out:=> {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@su 2019-11-28T11:06:44.065 INFO:teuthology.task.ansible.out:se Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf287 2019-11-28T11:06:44.067 INFO:teuthology.task.ansible.out:75813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:44.070 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": " 2019-11-28T11:06:44.072 INFO:teuthology.task.ansible.out:rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:44.088 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-11-28T11:06:44.090 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => { "msg": "Host smithi080.front.sepia.ceph.com is running RedHat 7.7 (Maipo)" } TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc 2019-11-28T11:06:44.103 INFO:teuthology.task.ansible.out:/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-11-28T11:06:44.127 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:44 +0000 (0:00:00.722) 0:01:20.144 ***** 2019-11-28T11:06:44.165 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:44 +0000 (0:00:00.037) 0:01:20.182 ***** 2019-11-28T11:06:44.171 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-11-28T11:06:44.173 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:44.211 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:44 +0000 (0:00:00.047) 0:01:20.229 ***** 2019-11-28T11:06:44.219 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi080.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml) => {"ansible_facts": {"rhsm_repos": ["rhel-7-server-rpms", "rhel-7-server-optional-rpms", "rhel-7-server-extras-rpms", "rhel-ha-for-rhel-7-server-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml"} 2019-11-28T11:06:44.271 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:44 +0000 (0:00:00.059) 0:01:20.288 ***** 2019-11-28T11:06:48.195 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:48.257 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M 2019-11-28T11:06:48.266 INFO:teuthology.task.ansible.out:4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"a 2019-11-28T11:06:48.267 INFO:teuthology.task.ansible.out:nsible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/Qlr 2019-11-28T11:06:48.269 INFO:teuthology.task.ansible.out:varCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757m 2019-11-28T11:06:48.271 INFO:teuthology.task.ansible.out:NuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": " 2019-11-28T11:06:48.273 INFO:teuthology.task.ansible.out:present", "user": "ifed01", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SI 2019-11-28T11:06:48.274 INFO:teuthology.task.ansible.out:kdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFik 2019-11-28T11:06:48.276 INFO:teuthology.task.ansible.out:kXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595f 2019-11-28T11:06:48.289 INFO:teuthology.task.ansible.out:e0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0 2019-11-28T11:06:48.296 INFO:teuthology.task.ansible.out:cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gab 2019-11-28T11:06:48.305 INFO:teuthology.task.ansible.out:rioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gabrioux", "validate_certs": true} ok: [smithi076.front. 2019-11-28T11:06:48.309 INFO:teuthology.task.ansible.out:sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9 2019-11-28T11:06:48.311 INFO:teuthology.task.ansible.out:MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49 2019-11-28T11:06:48.312 INFO:teuthology.task.ansible.out:901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDx 2019-11-28T11:06:48.314 INFO:teuthology.task.ansible.out:qmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2 2019-11-28T11:06:48.315 INFO:teuthology.task.ansible.out:ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b0 2019-11-28T11:06:48.317 INFO:teuthology.task.ansible.out:2ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+l 2019-11-28T11:06:48.319 INFO:teuthology.task.ansible.out:HRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd 2019-11-28T11:06:48.320 INFO:teuthology.task.ansible.out:711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path 2019-11-28T11:06:48.322 INFO:teuthology.task.ansible.out:": null, "state": "present", "user": "ksirivad", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC 2019-11-28T11:06:48.324 INFO:teuthology.task.ansible.out:2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item" 2019-11-28T11:06:48.325 INFO:teuthology.task.ansible.out:, "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", 2019-11-28T11:06:48.327 INFO:teuthology.task.ansible.out: "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-11-28T11:06:48.328 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcn 2019-11-28T11:06:48.330 INFO:teuthology.task.ansible.out:rbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9 2019-11-28T11:06:48.333 INFO:teuthology.task.ansible.out:994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-11-28T11:06:48.334 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ry 2019-11-28T11:06:48.336 INFO:teuthology.task.ansible.out:g@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_cert 2019-11-28T11:06:48.338 INFO:teuthology.task.ansible.out:s": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/aut 2019-11-28T11:06:48.340 INFO:teuthology.task.ansible.out:horized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3n 2019-11-28T11:06:48.341 INFO:teuthology.task.ansible.out:nZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:48.343 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} changed: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3 2019-11-28T11:06:48.345 INFO:teuthology.task.ansible.out:e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-28T11:06:48.393 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:48.395 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-11-28T11:06:48.397 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-11-28T11:06:48.435 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:48 +0000 (0:00:04.164) 0:01:24.452 ***** 2019-11-28T11:06:48.485 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:48 +0000 (0:00:00.049) 0:01:24.502 ***** 2019-11-28T11:06:49.754 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:49.755 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-11-28T11:06:49.757 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:49.759 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:49.760 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:49.762 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d2 2019-11-28T11:06:49.763 INFO:teuthology.task.ansible.out:49450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:49.765 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:49.766 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:49.770 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-11-28T11:06:49.771 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:49.772 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-28T11:06:49.776 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-11-28T11:06:49.778 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:49.779 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-11-28T11:06:49.781 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-11-28T11:06:49.782 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-11-28T11:06:49.784 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:49.786 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-11-28T11:06:49.787 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:49.789 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-11-28T11:06:49.791 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-28T11:06:49.792 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": fa 2019-11-28T11:06:49.794 INFO:teuthology.task.ansible.out:lse, "item": "amarango", "name": "amarango", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:49.796 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easys 2019-11-28T11:06:49.797 INFO:teuthology.task.ansible.out:treet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83e 2019-11-28T11:06:49.799 INFO:teuthology.task.ansible.out:d149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-11-28T11:06:49.801 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:49.802 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:49.804 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:49.805 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:49.807 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c0125 2019-11-28T11:06:49.808 INFO:teuthology.task.ansible.out:8aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZ 2019-11-28T11:06:49.810 INFO:teuthology.task.ansible.out:QGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:49.811 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:49.813 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:49.814 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:49.816 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi016.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-28T11:06:49.836 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:49.843 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"nam 2019-11-28T11:06:49.853 INFO:teuthology.task.ansible.out:e": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrsh 2019-11-28T11:06:49.855 INFO:teuthology.task.ansible.out:ny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3 2019-11-28T11:06:49.865 INFO:teuthology.task.ansible.out:NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:49.899 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:49 +0000 (0:00:01.412) 0:01:25.915 ***** 2019-11-28T11:06:50.032 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.034 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.036 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.038 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.040 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.041 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.044 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.046 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.049 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.079493", "end": "2019-11-28 11:06:49.995997", "rc": 0, "start": "2019-11-28 11:06:49.916504", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-28T11:06:50.050 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-11-28T11:06:50.052 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.053 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.112 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:50 +0000 (0:00:00.214) 0:01:26.130 ***** 2019-11-28T11:06:50.531 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.533 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.535 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.537 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.543 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.543 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.545 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.547 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.553 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.556 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.561 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.563 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.565 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.566 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.568 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.570 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.579 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.581 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.585 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.586 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-11-28T11:06:50.594 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744 2019-11-28T11:06:50.596 INFO:teuthology.task.ansible.out:f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Con 2019-11-28T11:06:50.598 INFO:teuthology.task.ansible.out:ditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'ry 2019-11-28T11:06:50.601 INFO:teuthology.task.ansible.out:g@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.622 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-11-28T11:06:50.654 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:50 +0000 (0:00:00.541) 0:01:26.671 ***** 2019-11-28T11:06:50.692 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:50 +0000 (0:00:00.038) 0:01:26.709 ***** 2019-11-28T11:06:50.700 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-11-28T11:06:50.700 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.754 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:50 +0000 (0:00:00.058) 0:01:26.768 ***** 2019-11-28T11:06:50.771 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939210.06-166139579137521/source", "state": "file", "uid": 0} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.809 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:50 +0000 (0:00:00.057) 0:01:26.826 ***** 2019-11-28T11:06:50.850 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:50 +0000 (0:00:00.041) 0:01:26.867 ***** 2019-11-28T11:06:50.863 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:50.865 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-11-28T11:06:50.867 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi016.front.sepia.ceph.com] => { "msg": "Host smithi016.front.sepia.ceph.com is running RedHat 7.7 (Maipo)" } 2019-11-28T11:06:50.907 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:50 +0000 (0:00:00.056) 0:01:26.924 ***** 2019-11-28T11:06:50.913 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-11-28T11:06:50.915 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:50.956 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:50 +0000 (0:00:00.048) 0:01:26.973 ***** 2019-11-28T11:06:50.962 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-11-28T11:06:50.964 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml) => {"ansible_facts": {"rhsm_repos": ["rhel-7-server-rpms", "rhel-7-server-optional-rpms", "rhel-7-server-extras-rpms", "rhel-ha-for-rhel-7-server-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml"} 2019-11-28T11:06:51.005 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:50 +0000 (0:00:00.048) 0:01:27.021 ***** 2019-11-28T11:06:51.011 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:51.013 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-11-28T11:06:51.015 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-11-28T11:06:51.052 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:51 +0000 (0:00:00.048) 0:01:27.070 ***** 2019-11-28T11:06:51.059 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-11-28T11:06:51.061 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:51.097 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:51 +0000 (0:00:00.044) 0:01:27.114 ***** 2019-11-28T11:06:51.104 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-11-28T11:06:51.106 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:51.146 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:51 +0000 (0:00:00.048) 0:01:27.163 ***** 2019-11-28T11:06:51.389 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:51.392 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:51.394 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-11-28T11:06:51.396 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-11-28T11:06:51.399 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-11-28T11:06:51.401 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.086488", "end": "2019-11-28 11:06:51.358733", "rc": 0, "start": "2019-11-28 11:06:51.272245", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-11-28T11:06:51.439 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:51 +0000 (0:00:00.293) 0:01:27.456 ***** 2019-11-28T11:06:51.446 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-11-28T11:06:51.448 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2019-11-28T11:06:51.492 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:51 +0000 (0:00:00.053) 0:01:27.509 ***** 2019-11-28T11:06:51.499 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-11-28T11:06:51.500 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:51.502 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-11-28T11:06:51.540 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:51 +0000 (0:00:00.048) 0:01:27.558 ***** 2019-11-28T11:06:51.554 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-11-28T11:06:51.557 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi080.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T11:06:51.601 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:51 +0000 (0:00:00.060) 0:01:27.618 ***** 2019-11-28T11:06:51.608 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:51.611 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:51.655 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:51 +0000 (0:00:00.054) 0:01:27.673 ***** 2019-11-28T11:06:51.663 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-11-28T11:06:51.665 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2019-11-28T11:06:51.704 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:51 +0000 (0:00:00.048) 0:01:27.721 ***** 2019-11-28T11:06:51.710 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:51.713 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:51.751 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:51 +0000 (0:00:00.047) 0:01:27.768 ***** 2019-11-28T11:06:54.067 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:54.073 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-11-28T11:06:54.075 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQ 2019-11-28T11:06:54.080 INFO:teuthology.task.ansible.out:CYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika 2019-11-28T11:06:54.082 INFO:teuthology.task.ansible.out:@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIv 2019-11-28T11:06:54.084 INFO:teuthology.task.ansible.out:HnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-11-28T11:06:54.086 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-11-28T11:06:54.088 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-11-28T11:06:54.090 INFO:teuthology.task.ansible.out: 2019-11-28T11:06:54.092 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-11-28T11:06:54.094 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-28T11:06:54.095 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-11-28T11:06:54.097 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-11-28T11:06:54.099 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-11-28T11:06:54.101 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-11-28T11:06:54.103 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-11-28T11:06:54.105 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-11-28T11:06:54.106 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-11-28T11:06:54.108 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-11-28T11:06:54.110 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-11-28T11:06:54.111 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-11-28T11:06:54.113 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-11-28T11:06:54.115 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-11-28T11:06:54.117 INFO:teuthology.task.ansible.out:TASK [common : Install CA Cert from Satellite Server] ************************** ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-3.noarch providing /root/.ansible/tmp/ansible-moduletmp-1574939212.89-H3ggGo/katello-ca-consumer-latest.noarch0XSMo4.rpm is already installed"]} 2019-11-28T11:06:54.119 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-11-28T11:06:54.121 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-11-28T11:06:54.122 INFO:teuthology.task.ansible.out:TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:54.164 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:54 +0000 (0:00:02.412) 0:01:30.181 ***** 2019-11-28T11:06:54.206 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:54 +0000 (0:00:00.041) 0:01:30.223 ***** 2019-11-28T11:06:54.213 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-11-28T11:06:54.215 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:54.256 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:54 +0000 (0:00:00.050) 0:01:30.274 ***** 2019-11-28T11:06:54.883 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:54.884 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-11-28T11:06:54.885 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-11-28T11:06:54.887 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-11-28T11:06:54.889 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-11-28T11:06:54.890 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-11-28T11:06:54.892 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-11-28T11:06:54.893 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-11-28T11:06:54.896 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:54.898 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-11-28T11:06:54.899 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} TASK [common : Determine if node is registered with subscription-manager.] ***** fatal: [smithi080.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2019-11-28T11:06:54.952 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:54 +0000 (0:00:00.695) 0:01:30.969 ***** 2019-11-28T11:06:54.964 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2019-11-28T11:06:55.005 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:55 +0000 (0:00:00.053) 0:01:31.022 ***** 2019-11-28T11:06:55.013 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:55.014 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-11-28T11:06:55.016 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** ok: [smithi080.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2019-11-28T11:06:55.056 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:55 +0000 (0:00:00.050) 0:01:31.073 ***** 2019-11-28T11:06:55.062 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T11:06:55.064 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} TASK [common : Include Red Hat encrypted variables.] *************************** ok: [smithi016.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T11:06:55.066 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T11:06:55.107 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:55 +0000 (0:00:00.051) 0:01:31.125 ***** 2019-11-28T11:06:55.264 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:55.265 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-11-28T11:06:55.267 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-28T11:06:55.328 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-11-28T11:06:55.330 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-11-28T11:06:55.388 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:55 +0000 (0:00:00.266) 0:01:31.391 ***** 2019-11-28T11:06:55.418 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:55 +0000 (0:00:00.043) 0:01:31.435 ***** 2019-11-28T11:06:55.875 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-11-28T11:06:55.897 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} ok: [smithi076.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-28T11:06:55.952 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:55 +0000 (0:00:00.534) 0:01:31.969 ***** 2019-11-28T11:06:57.427 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-28T11:06:57.428 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.430 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.431 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.434 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.435 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.436 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.438 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2Vj 2019-11-28T11:06:57.440 INFO:teuthology.task.ansible.out:QgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-11-28T11:06:57.441 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y 2019-11-28T11:06:57.444 INFO:teuthology.task.ansible.out:6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeAC 2019-11-28T11:06:57.446 INFO:teuthology.task.ansible.out:SZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa A 2019-11-28T11:06:57.447 INFO:teuthology.task.ansible.out:AAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWP 2019-11-28T11:06:57.449 INFO:teuthology.task.ansible.out:uERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a 2019-11-28T11:06:57.451 INFO:teuthology.task.ansible.out:393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.452 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.454 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.456 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.458 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.459 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.462 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.464 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.465 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.467 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.468 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.470 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.472 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.473 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.475 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.476 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.479 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.479 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.481 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.482 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.484 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.486 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.487 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.491 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.492 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.494 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.496 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.498 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-3.noarch providing /root/.ansible/tmp/ansible-moduletmp-1574939216.41-AohdRk/katello-ca-consumer-latest.noarchgfcxjD.rpm is already installed"]} 2019-11-28T11:06:57.500 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.502 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.504 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.506 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.507 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.509 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.525 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.567 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:57 +0000 (0:00:01.613) 0:01:33.583 ***** 2019-11-28T11:06:57.866 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.868 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.871 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.875 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.879 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ov 2019-11-28T11:06:57.881 INFO:teuthology.task.ansible.out:pn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.883 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.884 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.886 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.888 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.892 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.896 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.904 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "i 2019-11-28T11:06:57.906 INFO:teuthology.task.ansible.out:tem": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpa 2019-11-28T11:06:57.908 INFO:teuthology.task.ansible.out:dp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:57.966 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:57 +0000 (0:00:00.399) 0:01:33.983 ***** 2019-11-28T11:06:57.975 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** changed: [smithi133.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T11:06:58.016 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:58 +0000 (0:00:00.050) 0:01:34.033 ***** 2019-11-28T11:06:58.022 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-11-28T11:06:58.023 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:58.067 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:58 +0000 (0:00:00.051) 0:01:34.085 ***** 2019-11-28T11:06:58.072 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-11-28T11:06:58.073 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2019-11-28T11:06:58.075 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939217.45-184677183648782/source", "state": "file", "uid": 0} 2019-11-28T11:06:58.116 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:58 +0000 (0:00:00.048) 0:01:34.133 ***** 2019-11-28T11:06:58.160 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:58 +0000 (0:00:00.040) 0:01:34.174 ***** 2019-11-28T11:06:58.165 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi076.front.sepia.ceph.com] => { "msg": "Host smithi076.front.sepia.ceph.com is running RedHat 7.7 (Maipo)" } 2019-11-28T11:06:58.203 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:58 +0000 (0:00:00.047) 0:01:34.221 ***** 2019-11-28T11:06:58.554 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:58.557 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-11-28T11:06:58.559 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-11-28T11:06:58.561 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** changed: [smithi075.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T11:06:58.607 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:58 +0000 (0:00:00.403) 0:01:34.624 ***** 2019-11-28T11:06:58.616 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-11-28T11:06:58.618 INFO:teuthology.task.ansible.out:fatal: [smithi016.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring TASK [common : Including major version specific variables.] ******************** 2019-11-28T11:06:58.620 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml) => {"ansible_facts": {"rhsm_repos": ["rhel-7-server-rpms", "rhel-7-server-optional-rpms", "rhel-7-server-extras-rpms", "rhel-ha-for-rhel-7-server-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml"} 2019-11-28T11:06:58.662 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:58 +0000 (0:00:00.055) 0:01:34.679 ***** 2019-11-28T11:06:58.697 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:58 +0000 (0:00:00.034) 0:01:34.714 ***** 2019-11-28T11:06:58.704 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:58.708 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-11-28T11:06:58.710 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** ok: [smithi075.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2019-11-28T11:06:58.754 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:58 +0000 (0:00:00.056) 0:01:34.771 ***** 2019-11-28T11:06:58.761 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-11-28T11:06:58.777 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:58.801 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:58 +0000 (0:00:00.047) 0:01:34.819 ***** 2019-11-28T11:06:58.838 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:58 +0000 (0:00:00.036) 0:01:34.855 ***** 2019-11-28T11:06:59.101 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:59.103 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} ok: [smithi174.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-11-28T11:06:59.104 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.741396", "end": "2019-11-28 11:06:59.070438", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:06:58.329042", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7Server\n8\n8.0\n8.1", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7Server", "8", "8.0", "8.1"]} 2019-11-28T11:06:59.149 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:59 +0000 (0:00:00.310) 0:01:35.166 ***** 2019-11-28T11:06:59.385 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:59.387 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} ok: [smithi174.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-11-28T11:06:59.389 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.085144", "end": "2019-11-28 11:06:59.361949", "rc": 0, "start": "2019-11-28 11:06:59.276805", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-28T11:06:59.430 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:59 +0000 (0:00:00.281) 0:01:35.448 ***** 2019-11-28T11:06:59.438 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:59.477 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:59 +0000 (0:00:00.046) 0:01:35.495 ***** 2019-11-28T11:06:59.484 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-11-28T11:06:59.485 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:59.524 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:59 +0000 (0:00:00.047) 0:01:35.542 ***** 2019-11-28T11:06:59.532 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:59.575 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:59 +0000 (0:00:00.050) 0:01:35.592 ***** 2019-11-28T11:06:59.581 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T11:06:59.583 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:59.625 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:59 +0000 (0:00:00.045) 0:01:35.638 ***** 2019-11-28T11:06:59.628 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-11-28T11:06:59.629 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T11:06:59.666 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:59 +0000 (0:00:00.045) 0:01:35.683 ***** 2019-11-28T11:06:59.672 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-11-28T11:06:59.674 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:59.717 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:59 +0000 (0:00:00.051) 0:01:35.735 ***** 2019-11-28T11:06:59.722 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-11-28T11:06:59.727 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.766470", "end": "2019-11-28 11:06:59.689883", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:06:58.923413", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7Server\n8\n8.0\n8.1", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7Server", "8", "8.0", "8.1"]} TASK [users : Remove revoked users] ******************************************** ok: [smithi174.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-11-28T11:06:59.766 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:59 +0000 (0:00:00.048) 0:01:35.783 ***** 2019-11-28T11:06:59.811 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:59 +0000 (0:00:00.044) 0:01:35.828 ***** 2019-11-28T11:06:59.817 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-11-28T11:06:59.819 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-11-28T11:06:59.820 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:06:59.859 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:59 +0000 (0:00:00.048) 0:01:35.877 ***** 2019-11-28T11:06:59.894 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:59 +0000 (0:00:00.034) 0:01:35.911 ***** 2019-11-28T11:06:59.901 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-11-28T11:06:59.903 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi174.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-11-28T11:06:59.950 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:06:59 +0000 (0:00:00.055) 0:01:35.967 ***** 2019-11-28T11:06:59.992 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:00.006 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:00 +0000 (0:00:00.056) 0:01:36.024 ***** 2019-11-28T11:07:00.014 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi075.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T11:07:00.053 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:00 +0000 (0:00:00.046) 0:01:36.071 ***** 2019-11-28T11:07:00.067 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2019-11-28T11:07:00.109 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:00 +0000 (0:00:00.055) 0:01:36.126 ***** 2019-11-28T11:07:00.115 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-11-28T11:07:00.117 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi174.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-28T11:07:00.161 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:00 +0000 (0:00:00.051) 0:01:36.177 ***** 2019-11-28T11:07:00.166 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-11-28T11:07:00.167 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T11:07:00.169 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T11:07:00.205 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:00 +0000 (0:00:00.044) 0:01:36.222 ***** 2019-11-28T11:07:03.096 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi174.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} ok: [smithi174.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} ok: [smithi174.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} ok: [smithi174.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-11-28T11:07:03.098 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-11-28T11:07:03.101 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} ok: [smithi174.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} ok: [smithi174.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-11-28T11:07:03.103 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} ok: [smithi174.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-11-28T11:07:03.105 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-11-28T11:07:03.106 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} ok: [smithi174.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-11-28T11:07:03.108 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-11-28T11:07:03.109 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-11-28T11:07:03.111 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-11-28T11:07:03.113 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-28T11:07:03.171 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:03 +0000 (0:00:02.966) 0:01:39.188 ***** 2019-11-28T11:07:03.178 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-11-28T11:07:03.180 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2019-11-28T11:07:03.221 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:03 +0000 (0:00:00.049) 0:01:39.238 ***** 2019-11-28T11:07:03.817 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939223.2-256979156116233/source", "state": "file", "uid": 0} 2019-11-28T11:07:03.865 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:03 +0000 (0:00:00.644) 0:01:39.882 ***** 2019-11-28T11:07:06.260 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-11-28T11:07:06.262 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-3.noarch providing /root/.ansible/tmp/ansible-moduletmp-1574939225.24-iEzz6e/katello-ca-consumer-latest.noarchC_2BoH.rpm is already installed"]} 2019-11-28T11:07:06.305 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:06 +0000 (0:00:02.439) 0:01:42.322 ***** 2019-11-28T11:07:06.311 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-11-28T11:07:06.315 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => { "msg": "Host smithi174.front.sepia.ceph.com is running RedHat 7.7 (Maipo)" } 2019-11-28T11:07:06.352 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:06 +0000 (0:00:00.046) 0:01:42.369 ***** 2019-11-28T11:07:07.009 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-11-28T11:07:07.011 INFO:teuthology.task.ansible.out:fatal: [smithi076.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2019-11-28T11:07:07.052 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:07 +0000 (0:00:00.700) 0:01:43.069 ***** 2019-11-28T11:07:07.063 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml) => {"ansible_facts": {"rhsm_repos": ["rhel-7-server-rpms", "rhel-7-server-optional-rpms", "rhel-7-server-extras-rpms", "rhel-ha-for-rhel-7-server-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_7.yml"} 2019-11-28T11:07:07.112 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:07 +0000 (0:00:00.060) 0:01:43.129 ***** 2019-11-28T11:07:07.119 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-11-28T11:07:07.120 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2019-11-28T11:07:07.122 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** changed: [smithi080.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T11:07:07.172 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:07 +0000 (0:00:00.060) 0:01:43.190 ***** 2019-11-28T11:07:07.208 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:07 +0000 (0:00:00.035) 0:01:43.225 ***** 2019-11-28T11:07:07.221 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:07.255 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:07 +0000 (0:00:00.047) 0:01:43.273 ***** 2019-11-28T11:07:07.262 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-11-28T11:07:07.264 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2019-11-28T11:07:07.302 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:07 +0000 (0:00:00.046) 0:01:43.319 ***** 2019-11-28T11:07:07.404 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:07.387994", "end": "2019-11-28 11:07:07.369972", "rc": 0, "start": "2019-11-28 11:06:59.981978", "stderr": "", "stderr_lines": [], "stdout": "rhel-7-server-rpms", "stdout_lines": ["rhel-7-server-rpms"]} 2019-11-28T11:07:07.452 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:07 +0000 (0:00:00.149) 0:01:43.469 ***** 2019-11-28T11:07:07.535 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-11-28T11:07:07.537 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.083627", "end": "2019-11-28 11:07:07.503978", "rc": 0, "start": "2019-11-28 11:07:07.420351", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-28T11:07:07.579 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:07 +0000 (0:00:00.126) 0:01:43.595 ***** 2019-11-28T11:07:07.602 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-7-server-rpms"]}, "changed": false} 2019-11-28T11:07:07.637 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:07 +0000 (0:00:00.058) 0:01:43.654 ***** 2019-11-28T11:07:07.644 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:07.685 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:07 +0000 (0:00:00.048) 0:01:43.702 ***** 2019-11-28T11:07:07.691 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-11-28T11:07:07.692 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:07.303841", "end": "2019-11-28 11:07:07.629190", "rc": 0, "start": "2019-11-28 11:07:00.325349", "stderr": "", "stderr_lines": [], "stdout": "rhel-7-server-rpms", "stdout_lines": ["rhel-7-server-rpms"]} 2019-11-28T11:07:07.698 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:07.737 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:07 +0000 (0:00:00.051) 0:01:43.753 ***** 2019-11-28T11:07:07.772 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:07 +0000 (0:00:00.035) 0:01:43.789 ***** 2019-11-28T11:07:07.781 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-11-28T11:07:07.782 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:07.785 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ ok: [smithi075.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-7-server-rpms"]}, "changed": false} 2019-11-28T11:07:07.825 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:07 +0000 (0:00:00.052) 0:01:43.842 ***** 2019-11-28T11:07:07.864 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:07 +0000 (0:00:00.038) 0:01:43.881 ***** 2019-11-28T11:07:07.872 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-11-28T11:07:07.874 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:07.920 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:07 +0000 (0:00:00.053) 0:01:43.934 ***** 2019-11-28T11:07:07.962 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:07 +0000 (0:00:00.044) 0:01:43.979 ***** 2019-11-28T11:07:07.970 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-11-28T11:07:07.972 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** ok: [smithi075.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2019-11-28T11:07:08.017 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:08 +0000 (0:00:00.055) 0:01:44.034 ***** 2019-11-28T11:07:08.059 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:08 +0000 (0:00:00.041) 0:01:44.076 ***** 2019-11-28T11:07:08.066 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-11-28T11:07:08.068 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} ok: [smithi075.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2019-11-28T11:07:08.112 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:08 +0000 (0:00:00.053) 0:01:44.129 ***** 2019-11-28T11:07:08.152 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:08 +0000 (0:00:00.039) 0:01:44.169 ***** 2019-11-28T11:07:08.159 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-11-28T11:07:08.163 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:08.204 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:08 +0000 (0:00:00.050) 0:01:44.220 ***** 2019-11-28T11:07:08.419 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-11-28T11:07:08.421 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.810758", "end": "2019-11-28 11:07:08.381608", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:07:07.570850", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7Server\n8\n8.0\n8.1", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7Server", "8", "8.0", "8.1"]} 2019-11-28T11:07:08.466 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:08 +0000 (0:00:00.263) 0:01:44.483 ***** 2019-11-28T11:07:08.481 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:08.528 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:08 +0000 (0:00:00.057) 0:01:44.541 ***** 2019-11-28T11:07:08.531 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:08.575 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:08 +0000 (0:00:00.050) 0:01:44.591 ***** 2019-11-28T11:07:08.580 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-11-28T11:07:08.581 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2019-11-28T11:07:08.622 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:08 +0000 (0:00:00.048) 0:01:44.639 ***** 2019-11-28T11:07:08.634 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:08.676 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:08 +0000 (0:00:00.053) 0:01:44.693 ***** 2019-11-28T11:07:08.684 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-11-28T11:07:08.685 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T11:07:08.687 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T11:07:08.725 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:08 +0000 (0:00:00.049) 0:01:44.743 ***** 2019-11-28T11:07:08.731 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-11-28T11:07:08.734 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T11:07:08.784 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:08 +0000 (0:00:00.054) 0:01:44.797 ***** 2019-11-28T11:07:08.787 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-11-28T11:07:08.788 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2019-11-28T11:07:08.827 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:08 +0000 (0:00:00.046) 0:01:44.844 ***** 2019-11-28T11:07:08.832 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-11-28T11:07:08.837 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:08.877 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:08 +0000 (0:00:00.045) 0:01:44.889 ***** 2019-11-28T11:07:11.025 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-11-28T11:07:11.033 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-3.noarch providing /root/.ansible/tmp/ansible-moduletmp-1574939229.97-AR09iw/katello-ca-consumer-latest.noarchWBNrC2.rpm is already installed"]} 2019-11-28T11:07:11.066 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:11 +0000 (0:00:02.193) 0:01:47.083 ***** 2019-11-28T11:07:12.000 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-11-28T11:07:16.164 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} Thursday 28 November 2019 11:07:12 +0000 (0:00:00.989) 0:01:48.073 ***** TASK [common : Determine if node is registered with subscription-manager.] ***** fatal: [smithi174.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring Thursday 28 November 2019 11:07:12 +0000 (0:00:00.698) 0:01:48.772 ***** TASK [common : Set rhsm_registered if we just registered] ********************** ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} Thursday 28 November 2019 11:07:12 +0000 (0:00:00.053) 0:01:48.825 ***** TASK [common : Set rhsm_registered if we're already registered] **************** ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} Thursday 28 November 2019 11:07:12 +0000 (0:00:00.050) 0:01:48.876 ***** TASK [common : List CDN releases available to system] ************************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.736860", "end": "2019-11-28 11:07:13.739642", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:07:13.002782", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7Server\n8\n8.0\n8.1", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7Server", "8", "8.0", "8.1"]} Thursday 28 November 2019 11:07:13 +0000 (0:00:00.974) 0:01:49.851 ***** TASK [common : Disable all rhsm repos] ***************************************** changed: [smithi075.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result" 2019-11-28T11:07:16.167 INFO:teuthology.task.ansible.out:, "changed": true} Thursday 28 November 2019 11:07:15 +0000 (0:00:01.580) 0:01:51.431 ***** TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 28 November 2019 11:07:15 +0000 (0:00:00.053) 0:01:51.484 ***** TASK [common : Disable all rhsm repos] ***************************************** changed: [smithi133.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} Thursday 28 November 2019 11:07:15 +0000 (0:00:00.303) 0:01:51.788 ***** TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 28 November 2019 11:07:15 +0000 (0:00:00.047) 0:01:51.835 ***** 2019-11-28T11:07:18.892 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-11-28T11:07:18.896 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:07.651558", "end": "2019-11-28 11:07:18.866467", "rc": 0, "start": "2019-11-28 11:07:11.214909", "stderr": "", "stderr_lines": [], "stdout": "rhel-7-server-rpms", "stdout_lines": ["rhel-7-server-rpms"]} 2019-11-28T11:07:18.955 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:18 +0000 (0:00:03.136) 0:01:54.972 ***** 2019-11-28T11:07:18.962 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-11-28T11:07:18.964 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T11:07:19.024 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:19 +0000 (0:00:00.069) 0:01:55.041 ***** 2019-11-28T11:07:19.031 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-11-28T11:07:19.032 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-7-server-rpms"]}, "changed": false} 2019-11-28T11:07:19.082 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:19 +0000 (0:00:00.057) 0:01:55.099 ***** 2019-11-28T11:07:19.091 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:19.134 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:19 +0000 (0:00:00.052) 0:01:55.152 ***** 2019-11-28T11:07:19.142 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-11-28T11:07:19.143 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:19.180 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:19 +0000 (0:00:00.045) 0:01:55.198 ***** 2019-11-28T11:07:21.273 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-11-28T11:07:21.275 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T11:07:21.317 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:21 +0000 (0:00:02.136) 0:01:57.335 ***** 2019-11-28T11:07:21.324 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-11-28T11:07:21.327 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2019-11-28T11:07:21.365 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:21 +0000 (0:00:00.047) 0:01:57.382 ***** 2019-11-28T11:07:21.371 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-11-28T11:07:21.373 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2019-11-28T11:07:21.411 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:21 +0000 (0:00:00.045) 0:01:57.428 ***** 2019-11-28T11:07:21.419 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* ok: [smithi080.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2019-11-28T11:07:21.457 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:21 +0000 (0:00:00.046) 0:01:57.475 ***** 2019-11-28T11:07:22.513 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-11-28T11:07:22.514 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.868437", "end": "2019-11-28 11:07:22.470321", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:07:21.601884", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7Server\n8\n8.0\n8.1", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7Server", "8", "8.0", "8.1"]} 2019-11-28T11:07:22.554 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:22 +0000 (0:00:01.097) 0:01:58.572 ***** 2019-11-28T11:07:25.872 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ changed: [smithi075.front.sepia.ceph.com] => (item=rhel-7-server-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-rpms"], "delta": "0:00:06.987180", "end": "2019-11-28 11:07:22.628008", "item": "rhel-7-server-rpms", "rc": 0, "start": "2019-11-28 11:07:15.640828", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/18ee35a5 1cb1 4338 ba7f 694aa56a81d3\n\nRepository 'rhel-7-server-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/18ee35a5 1cb1 4338 ba7f 694aa56a81d3", "", "Repository 'rhel-7-server-rpms' is enabled for this system."]} changed: [smithi133.front.sepia.ceph.com] => (item=rhel-7-server-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-rpms"], "delta": "0:00:06.756825", "end": "2019-11-28 11:07:22.729296", "item": "rhel-7-server-rpms", "rc": 0, "start": "2019-11-28 11:07:15.972471", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/606a1df7 d94c 4c10 a108 f789986debdd\n\nRepository 'rhel-7-server-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required loc 2019-11-28T11:07:25.878 INFO:teuthology.task.ansible.out:k is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/606a1df7 d94c 4c10 a108 f789986debdd", "", "Repository 'rhel-7-server-rpms' is enabled for this system."]} TASK [common : Register with subscription-manager.] **************************** changed: [smithi174.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T11:07:25.914 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:25 +0000 (0:00:03.359) 0:02:01.931 ***** 2019-11-28T11:07:25.921 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:25.960 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:25 +0000 (0:00:00.046) 0:02:01.977 ***** 2019-11-28T11:07:25.967 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-11-28T11:07:25.969 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2019-11-28T11:07:26.014 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:26 +0000 (0:00:00.054) 0:02:02.032 ***** 2019-11-28T11:07:26.020 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-11-28T11:07:26.022 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:26.061 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:26 +0000 (0:00:00.046) 0:02:02.078 ***** 2019-11-28T11:07:27.056 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.677642", "end": "2019-11-28 11:07:26.862094", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:07:26.184452", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7Server\n8\n8.0\n8.1", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7Server", "8", "8.0", "8.1"]} 2019-11-28T11:07:27.230 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:27 +0000 (0:00:01.169) 0:02:03.248 ***** 2019-11-28T11:07:27.242 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi076.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T11:07:27.284 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:27 +0000 (0:00:00.047) 0:02:03.296 ***** 2019-11-28T11:07:27.287 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:27.327 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:27 +0000 (0:00:00.049) 0:02:03.345 ***** 2019-11-28T11:07:27.334 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-11-28T11:07:27.335 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:27.375 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:27 +0000 (0:00:00.047) 0:02:03.392 ***** 2019-11-28T11:07:27.385 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:27.424 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:27 +0000 (0:00:00.049) 0:02:03.441 ***** 2019-11-28T11:07:27.776 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-11-28T11:07:27.779 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:08.424035", "end": "2019-11-28 11:07:27.751796", "rc": 0, "start": "2019-11-28 11:07:19.327761", "stderr": "", "stderr_lines": [], "stdout": "rhel-7-server-rpms", "stdout_lines": ["rhel-7-server-rpms"]} 2019-11-28T11:07:27.830 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:27 +0000 (0:00:00.405) 0:02:03.847 ***** 2019-11-28T11:07:27.841 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-11-28T11:07:27.844 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T11:07:27.889 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:27 +0000 (0:00:00.058) 0:02:03.906 ***** 2019-11-28T11:07:27.898 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-7-server-rpms"]}, "changed": false} 2019-11-28T11:07:27.941 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:27 +0000 (0:00:00.044) 0:02:03.951 ***** 2019-11-28T11:07:27.943 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:27.986 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:27 +0000 (0:00:00.052) 0:02:04.003 ***** 2019-11-28T11:07:27.994 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-11-28T11:07:27.996 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:28.040 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:28 +0000 (0:00:00.054) 0:02:04.058 ***** 2019-11-28T11:07:30.635 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-11-28T11:07:30.637 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T11:07:30.691 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:30 +0000 (0:00:02.650) 0:02:06.708 ***** 2019-11-28T11:07:30.702 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2019-11-28T11:07:30.743 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:30 +0000 (0:00:00.051) 0:02:06.760 ***** 2019-11-28T11:07:35.054 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ changed: [smithi133.front.sepia.ceph.com] => (item=rhel-7-server-optional-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-optional-rpms"], "delta": "0:00:10.025026", "end": "2019-11-28 11:07:32.943288", "item": "rhel-7-server-optional-rpms", "rc": 0, "start": "2019-11-28 11:07:22.918262", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/606a1df7 d94c 4c10 a108 f789986debdd\n\nRepository 'rhel-7-server-optional-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/606a1df7 d94c 4c10 a108 f789986debdd", "", "Repository 'rhel-7-server-optional-rpms' is enabled for this system."]} changed: [smithi075.front.sepia.ceph.com] => (item=rhel-7-server-optional-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-optional-rpms"], "delta": "0:00:10.196793", "end": "2019-11-28 11:07:32.999491", "item": "rhel-7-server-optional-rpms", "rc": 0, "start": "2019-11-28 11:07:22.802698", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/18ee35a5 1cb1 4338 ba7f 694aa56a81d3\n\nRepository 'rhel-7-server-optional-rpms' is 2019-11-28T11:07:35.056 INFO:teuthology.task.ansible.out:enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/18ee35a5 1cb1 4338 ba7f 694aa56a81d3", "", "Repository 'rhel-7-server-optional-rpms' is enabled for this system."]} 2019-11-28T11:07:35.058 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:07.459550", "end": "2019-11-28 11:07:35.025044", "rc": 0, "start": "2019-11-28 11:07:27.565494", "stderr": "", "stderr_lines": [], "stdout": "rhel-7-server-rpms", "stdout_lines": ["rhel-7-server-rpms"]} 2019-11-28T11:07:35.103 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:35 +0000 (0:00:04.360) 0:02:11.121 ***** 2019-11-28T11:07:35.105 INFO:teuthology.task.ansible.out: 2019-11-28T11:07:35.110 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-11-28T11:07:35.111 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2019-11-28T11:07:35.157 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:35 +0000 (0:00:00.049) 0:02:11.171 ***** 2019-11-28T11:07:35.203 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-7-server-rpms"]}, "changed": false} 2019-11-28T11:07:35.206 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:35 +0000 (0:00:00.052) 0:02:11.223 ***** 2019-11-28T11:07:36.037 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-11-28T11:07:36.038 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:07.845442", "end": "2019-11-28 11:07:36.011498", "rc": 0, "start": "2019-11-28 11:07:28.166056", "stderr": "", "stderr_lines": [], "stdout": "rhel-7-server-rpms", "stdout_lines": ["rhel-7-server-rpms"]} 2019-11-28T11:07:36.095 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:36 +0000 (0:00:00.889) 0:02:12.112 ***** 2019-11-28T11:07:36.100 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-11-28T11:07:36.102 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:36.145 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:36 +0000 (0:00:00.050) 0:02:12.162 ***** 2019-11-28T11:07:36.152 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-11-28T11:07:36.154 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-7-server-rpms"]}, "changed": false} 2019-11-28T11:07:36.195 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:36 +0000 (0:00:00.048) 0:02:12.211 ***** 2019-11-28T11:07:36.199 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-11-28T11:07:36.200 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2019-11-28T11:07:36.239 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:36 +0000 (0:00:00.045) 0:02:12.257 ***** 2019-11-28T11:07:36.246 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-11-28T11:07:36.247 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:07:36.286 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:36 +0000 (0:00:00.046) 0:02:12.303 ***** 2019-11-28T11:07:36.292 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-11-28T11:07:36.293 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2019-11-28T11:07:36.333 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:36 +0000 (0:00:00.045) 0:02:12.349 ***** 2019-11-28T11:07:36.339 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-11-28T11:07:36.340 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2019-11-28T11:07:36.377 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:36 +0000 (0:00:00.045) 0:02:12.395 ***** 2019-11-28T11:07:43.704 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ changed: [smithi080.front.sepia.ceph.com] => (item=rhel-7-server-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-rpms"], "delta": "0:00:07.692139", "end": "2019-11-28 11:07:38.569958", "item": "rhel-7-server-rpms", "rc": 0, "start": "2019-11-28 11:07:30.877819", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/ff67d2e3 9d9c 4488 a44d e49aa063129d\n\nRepository 'rhel-7-server-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/ff67d2e3 9d9c 4488 a44d e49aa063129d", "", "Repository 'rhel-7-server-rpms' is enabled for this system."]} 2019-11-28T11:07:43.707 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-11-28T11:07:43.709 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T11:07:43.749 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:43 +0000 (0:00:07.372) 0:02:19.767 ***** 2019-11-28T11:07:43.756 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-11-28T11:07:43.758 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2019-11-28T11:07:43.797 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:43 +0000 (0:00:00.047) 0:02:19.814 ***** 2019-11-28T11:07:44.807 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-28T11:07:44.808 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item=rhel-7-server-extras-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-extras-rpms"], "delta": "0:00:10.888879", "end": "2019-11-28 11:07:44.059228", "item": "rhel-7-server-extras-rpms", "rc": 0, "start": "2019-11-28 11:07:33.170349", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/18ee35a5 1cb1 4338 ba7f 694aa56a81d3\n\nRepository 'rhel-7-server-extras-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/18ee35a5 1cb1 4338 ba7f 694aa56a81d3", "", "Repository 'rhel-7-server-extras-rpms' is enabled for this system."]} 2019-11-28T11:07:44.810 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item=rhel-7-server-extras-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-extras-rpms"], "delta": "0:00:11.005746", "end": "2019-11-28 11:07:44.129699", "item": "rhel-7-server-extras-rpms", "rc": 0, "start": "2019-11-28 11:07:33.123953", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/606a1df7 d94c 4c10 a108 f789986debdd\n\nRepository 'rhel-7-server-extras-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/606a1df7 d94c 4c10 a108 f789986debdd", "", "Repository 'rhel-7-server-extras-rpms' is enabled for this system."]} TASK [common : Disable all rhsm repos] ***************************************** 2019-11-28T11:07:44.812 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T11:07:44.860 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:44 +0000 (0:00:01.054) 0:02:20.869 ***** 2019-11-28T11:07:52.398 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-28T11:07:52.400 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item=rhel-7-server-optional-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-optional-rpms"], "delta": "0:00:09.712135", "end": "2019-11-28 11:07:48.468844", "item": "rhel-7-server-optional-rpms", "rc": 0, "start": "2019-11-28 11:07:38.756709", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/ff67d2e3 9d9c 4488 a44d e49aa063129d\n\nRepository 'rhel-7-server-optional-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/ff67d2e3 9d9c 4488 a44d e49aa063129d", "", "Repository 'rhel-7-server-optional-rpms' is enabled for this system."]} changed: [smithi016.front.sepia.ceph.com] => (item=rhel-7-server-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-rpms"], "delta": "0:00:07.988336", "end": "2019-11-28 11:07:51.933583", "item": "rhel-7-server-rpms", "rc": 0, "start": "2019-11-28 11:07:43.945247", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/b5bccc16 2070 468d 9c50 54a6e9b0a550\n\nRepository 'rhel-7-server-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tas 2019-11-28T11:07:52.409 INFO:teuthology.task.ansible.out:ks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/b5bccc16 2070 468d 9c50 54a6e9b0a550", "", "Repository 'rhel-7-server-rpms' is enabled for this system."]} TASK [common : Disable all rhsm repos] ***************************************** changed: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T11:07:52.449 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:52 +0000 (0:00:07.596) 0:02:28.466 ***** 2019-11-28T11:07:56.166 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-28T11:07:56.168 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item=rhel-ha-for-rhel-7-server-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-ha-for-rhel-7-server-rpms"], "delta": "0:00:11.830147", "end": "2019-11-28 11:07:56.137446", "item": "rhel-ha-for-rhel-7-server-rpms", "rc": 0, "start": "2019-11-28 11:07:44.307299", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/606a1df7 d94c 4c10 a108 f789986debdd\n\nRepository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/606a1df7 d94c 4c10 a108 f789986debdd", "", "Repository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system."]} 2019-11-28T11:07:56.221 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:56 +0000 (0:00:03.772) 0:02:32.238 ***** 2019-11-28T11:07:56.261 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item=rhel-ha-for-rhel-7-server-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-ha-for-rhel-7-server-rpms"], "delta": "0:00:11.988207", "end": "2019-11-28 11:07:56.222496", "item": "rhel-ha-for-rhel-7-server-rpms", "rc": 0, "start": "2019-11-28 11:07:44.234289", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/18ee35a5 1cb1 4338 ba7f 694aa56a81d3\n\nRepository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/18ee35a5 1cb1 4338 ba7f 694aa56a81d3", "", "Repository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system."]} 2019-11-28T11:07:56.308 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:56 +0000 (0:00:00.085) 0:02:32.324 ***** 2019-11-28T11:07:56.609 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2019-11-28T11:07:56.651 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:56 +0000 (0:00:00.344) 0:02:32.669 ***** 2019-11-28T11:07:56.817 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2019-11-28T11:07:56.884 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:56 +0000 (0:00:00.228) 0:02:32.898 ***** 2019-11-28T11:07:57.007 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-11-28T11:07:57.008 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:07:57.060 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:57 +0000 (0:00:00.179) 0:02:33.077 ***** 2019-11-28T11:07:57.185 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:07:57.245 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:57 +0000 (0:00:00.185) 0:02:33.262 ***** 2019-11-28T11:07:58.231 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-28T11:07:58.234 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-11-28T11:07:58.238 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ changed: [smithi080.front.sepia.ceph.com] => (item=rhel-7-server-extras-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-extras-rpms"], "delta": "0:00:09.503991", "end": "2019-11-28 11:07:58.148334", "item": "rhel-7-server-extras-rpms", "rc": 0, "start": "2019-11-28 11:07:48.644343", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/ff67d2e3 9d9c 4488 a44d e49aa063129d\n\nRepository 'rhel-7-server-extras-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/ff67d2e3 9d9c 4488 a44d e49aa063129d", "", "Repository 'rhel-7-server-extras-rpms' is enabled for this system."]} 2019-11-28T11:07:58.245 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-28T11:07:58.247 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-28T11:07:58.319 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:58 +0000 (0:00:01.073) 0:02:34.336 ***** 2019-11-28T11:07:59.340 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} ok: [smithi075.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-28T11:07:59.395 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:07:59 +0000 (0:00:01.065) 0:02:35.401 ***** 2019-11-28T11:08:00.712 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ changed: [smithi076.front.sepia.ceph.com] => (item=rhel-7-server-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-rpms"], "delta": "0:00:06.847613", "end": "2019-11-28 11:07:59.431017", "item": "rhel-7-server-rpms", "rc": 0, "start": "2019-11-28 11:07:52.583404", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/8adb5b83 d47b 4207 8530 f10bf0dd5d32\n\nRepository 'rhel-7-server-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/8adb5b83 d47b 4207 8530 f10bf0dd5d32", "", "Repository 'rhel-7-server-rpms' is enabled for this system."]} 2019-11-28T11:08:00.715 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-11-28T11:08:00.716 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939279.37-204959269337225/source", "state": "file", "uid": 0} 2019-11-28T11:08:00.718 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939280.07-48422205493754/source", "state": "file", "uid": 0} 2019-11-28T11:08:00.824 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:00 +0000 (0:00:01.440) 0:02:36.841 ***** 2019-11-28T11:08:02.095 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-28T11:08:02.097 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item=rhel-7-server-optional-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-optional-rpms"], "delta": "0:00:08.617857", "end": "2019-11-28 11:08:00.754762", "item": "rhel-7-server-optional-rpms", "rc": 0, "start": "2019-11-28 11:07:52.136905", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/b5bccc16 2070 468d 9c50 54a6e9b0a550\n\nRepository 'rhel-7-server-optional-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/b5bccc16 2070 468d 9c50 54a6e9b0a550", "", "Repository 'rhel-7-server-optional-rpms' is enabled for this system."]} 2019-11-28T11:08:02.098 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* changed: [smithi075.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939280.77-52851087467428/source", "state": "file", "uid": 0} 2019-11-28T11:08:02.100 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939281.46-34059811428971/source", "state": "file", "uid": 0} 2019-11-28T11:08:02.150 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:02 +0000 (0:00:01.318) 0:02:38.160 ***** 2019-11-28T11:08:02.664 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-28T11:08:02.671 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-28T11:08:02.714 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:02 +0000 (0:00:00.571) 0:02:38.731 ***** 2019-11-28T11:08:03.041 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-28T11:08:03.043 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-28T11:08:03.084 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:03 +0000 (0:00:00.370) 0:02:39.101 ***** 2019-11-28T11:08:08.332 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-28T11:08:08.334 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item=rhel-7-server-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-rpms"], "delta": "0:00:06.883697", "end": "2019-11-28 11:08:03.231419", "item": "rhel-7-server-rpms", "rc": 0, "start": "2019-11-28 11:07:56.347722", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/68b4890f 6394 400b 9b98 8d47cdd7605c\n\nRepository 'rhel-7-server-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/68b4890f 6394 400b 9b98 8d47cdd7605c", "", "Repository 'rhel-7-server-rpms' is enabled for this system."]} changed: [smithi076.front.sepia.ceph.com] => (item=rhel-7-server-optional-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-optional-rpms"], "delta": "0:00:07.746374", "end": "2019-11-28 11:08:07.411027", "item": "rhel-7-server-optional-rpms", "rc": 0, "start": "2019-11-28 11:07:59.664653", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/8adb5b83 d47b 4207 8530 f10bf0dd5d32\n\nRepository 'rhel-7-server-optional-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Pl 2019-11-28T11:08:08.336 INFO:teuthology.task.ansible.out:ease inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/8adb5b83 d47b 4207 8530 f10bf0dd5d32", "", "Repository 'rhel-7-server-optional-rpms' is enabled for this system."]} changed: [smithi080.front.sepia.ceph.com] => (item=rhel-ha-for-rhel-7-server-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-ha-for-rhel-7-server-rpms"], "delta": "0:00:09.957151", "end": "2019-11-28 11:08:08.303332", "item": "rhel-ha-for-rhel-7-server-rpms", "rc": 0, "start": "2019-11-28 11:07:58.346181", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/ff67d2e3 9d9c 4488 a44d e49aa063129d\n\nRepository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/ff67d2e3 9d9c 4488 a44d e49aa063129d", "", "Repository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system."]} 2019-11-28T11:08:08.378 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:08 +0000 (0:00:05.294) 0:02:44.396 ***** 2019-11-28T11:08:24.846 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item=rhel-7-server-extras-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-extras-rpms"], "delta": "0:00:09.852288", "end": "2019-11-28 11:08:10.815386", "item": "rhel-7-server-extras-rpms", "rc": 0, "start": "2019-11-28 11:08:00.963098", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/b5bccc16 2070 468d 9c50 54a6e9b0a550\n\nRepository 'rhel-7-server-extras-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/b5bccc16 2070 468d 9c50 54a6e9b0a550", "", "Repository 'rhel-7-server-extras-rpms' is enabled for this system."]} 2019-11-28T11:08:24.848 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item=rhel-7-server-optional-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-optional-rpms"], "delta": "0:00:09.161307", "end": "2019-11-28 11:08:12.624798", "item": "rhel-7-server-optional-rpms", "rc": 0, "start": "2019-11-28 11:08:03.463491", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/68b4890f 6394 400b 9b98 8d47cdd7605c\n\nRepository 'rhel-7-server-optional-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/68b4890f 6394 400b 9b98 8d47cdd7605c", "", "Repository 'rhel-7-server-optional-rpms' is enabled for this system."]} 2019-11-28T11:08:24.856 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item=rhel-7-server-extras-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-extras-rpms"], "delta": "0:00:11.965300", "end": "2019-11-28 11:08:19.567559", "item": "rhel-7-server-extras-rpms", "rc": 0, "start": "2019-11-28 11:08:07.602259", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/8adb5b83 d47b 4207 8530 f10bf0dd5d32\n\nRepository 'rhel-7-server-extras-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/8adb5b83 d47b 4207 8530 f10bf0dd5d32", "", "Repository 'rhel-7-server-extras-rpms' is enabled for this system."]} 2019-11-28T11:08:24.858 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item=rhel-7-server-extras-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-7-server-extras-rpms"], "delta": "0:00:11.250399", "end": "2019-11-28 11:08:24.071243", "item": "rhel-7-server-extras-rpms", "rc": 0, "start": "2019-11-28 11:08:12.820844", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/68b4890f 6394 400b 9b98 8d47cdd7605c\n\nRepository 'rhel-7-server-extras-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/68b4890f 6394 400b 9b98 8d47cdd7605c", "", "Repository 'rhel-7-server-extras-rpms' is enabled for this system."]} 2019-11-28T11:08:24.860 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item=rhel-ha-for-rhel-7-server-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-ha-for-rhel-7-server-rpms"], "delta": "0:00:13.795209", "end": "2019-11-28 11:08:24.814667", "item": "rhel-ha-for-rhel-7-server-rpms", "rc": 0, "start": "2019-11-28 11:08:11.019458", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/b5bccc16 2070 468d 9c50 54a6e9b0a550\n\nRepository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/b5bccc16 2070 468d 9c50 54a6e9b0a550", "", "Repository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system."]} 2019-11-28T11:08:24.902 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:24 +0000 (0:00:16.523) 0:03:00.919 ***** 2019-11-28T11:08:25.034 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-11-28T11:08:25.036 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2019-11-28T11:08:25.078 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:25 +0000 (0:00:00.176) 0:03:01.096 ***** 2019-11-28T11:08:25.240 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2019-11-28T11:08:25.282 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:25 +0000 (0:00:00.204) 0:03:01.300 ***** 2019-11-28T11:08:25.425 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-11-28T11:08:25.427 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:08:25.472 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:25 +0000 (0:00:00.189) 0:03:01.489 ***** 2019-11-28T11:08:25.626 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:08:25.628 INFO:teuthology.task.ansible.out: 2019-11-28T11:08:25.672 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:25 +0000 (0:00:00.199) 0:03:01.689 ***** 2019-11-28T11:08:26.754 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-28T11:08:26.756 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-11-28T11:08:26.760 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-28T11:08:26.807 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:26 +0000 (0:00:01.135) 0:03:02.824 ***** 2019-11-28T11:08:27.893 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} ok: [smithi016.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-28T11:08:27.947 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:27 +0000 (0:00:01.139) 0:03:03.964 ***** 2019-11-28T11:08:29.168 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-11-28T11:08:29.172 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939307.93-205053071716919/source", "state": "file", "uid": 0} changed: [smithi080.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939308.56-115811154359919/source", "state": "file", "uid": 0} 2019-11-28T11:08:29.228 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:29 +0000 (0:00:01.281) 0:03:05.245 ***** 2019-11-28T11:08:30.551 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939309.21-160012372943083/source", "state": "file", "uid": 0} 2019-11-28T11:08:30.561 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939309.89-60613664011007/source", "state": "file", "uid": 0} 2019-11-28T11:08:30.596 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:30 +0000 (0:00:01.367) 0:03:06.613 ***** 2019-11-28T11:08:30.928 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-11-28T11:08:30.930 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-28T11:08:30.932 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-28T11:08:30.980 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:30 +0000 (0:00:00.384) 0:03:06.997 ***** 2019-11-28T11:08:31.360 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-28T11:08:31.362 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-28T11:08:31.421 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:31 +0000 (0:00:00.440) 0:03:07.437 ***** 2019-11-28T11:08:33.952 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-28T11:08:33.955 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item=rhel-ha-for-rhel-7-server-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-ha-for-rhel-7-server-rpms"], "delta": "0:00:14.156802", "end": "2019-11-28 11:08:33.922378", "item": "rhel-ha-for-rhel-7-server-rpms", "rc": 0, "start": "2019-11-28 11:08:19.765576", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/8adb5b83 d47b 4207 8530 f10bf0dd5d32\n\nRepository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/8adb5b83 d47b 4207 8530 f10bf0dd5d32", "", "Repository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system."]} 2019-11-28T11:08:34.010 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:34 +0000 (0:00:02.590) 0:03:10.028 ***** 2019-11-28T11:08:36.559 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item=rhel-ha-for-rhel-7-server-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-ha-for-rhel-7-server-rpms"], "delta": "0:00:12.273811", "end": "2019-11-28 11:08:36.528440", "item": "rhel-ha-for-rhel-7-server-rpms", "rc": 0, "start": "2019-11-28 11:08:24.254629", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/68b4890f 6394 400b 9b98 8d47cdd7605c\n\nRepository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/68b4890f 6394 400b 9b98 8d47cdd7605c", "", "Repository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system."]} 2019-11-28T11:08:36.607 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:36 +0000 (0:00:02.596) 0:03:12.624 ***** 2019-11-28T11:08:36.771 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-11-28T11:08:36.773 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2019-11-28T11:08:36.816 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:36 +0000 (0:00:00.205) 0:03:12.830 ***** 2019-11-28T11:08:36.973 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2019-11-28T11:08:37.020 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:37 +0000 (0:00:00.207) 0:03:13.037 ***** 2019-11-28T11:08:37.176 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi076.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:08:37.227 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:37 +0000 (0:00:00.207) 0:03:13.245 ***** 2019-11-28T11:08:37.373 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:08:37.429 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:37 +0000 (0:00:00.201) 0:03:13.446 ***** 2019-11-28T11:08:38.447 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-28T11:08:38.450 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-11-28T11:08:38.460 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-28T11:08:38.516 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:38 +0000 (0:00:01.086) 0:03:14.533 ***** 2019-11-28T11:08:39.556 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-11-28T11:08:39.560 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-28T11:08:39.615 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:39 +0000 (0:00:01.098) 0:03:15.632 ***** 2019-11-28T11:08:40.909 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-11-28T11:08:40.912 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939319.58-256345166341844/source", "state": "file", "uid": 0} changed: [smithi076.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939320.27-105238662404763/source", "state": "file", "uid": 0} 2019-11-28T11:08:40.961 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:40 +0000 (0:00:01.346) 0:03:16.978 ***** 2019-11-28T11:08:42.197 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939320.94-64068908578571/source", "state": "file", "uid": 0} 2019-11-28T11:08:42.204 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939321.58-88019070814780/source", "state": "file", "uid": 0} 2019-11-28T11:08:42.267 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:42 +0000 (0:00:01.306) 0:03:18.285 ***** 2019-11-28T11:08:42.594 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-28T11:08:42.597 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-28T11:08:42.648 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:42 +0000 (0:00:00.380) 0:03:18.665 ***** 2019-11-28T11:08:42.976 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-28T11:08:43.015 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:08:43 +0000 (0:00:00.367) 0:03:19.033 ***** 2019-11-28T11:09:30.370 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-11-28T11:09:30.372 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2019-11-28T11:09:30.373 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:01:21.848674", "end": "2019-11-28 11:09:30.340419", "rc": 0, "start": "2019-11-28 11:08:08.491745", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nCleaning repos: epel lab-extras rhel-7-fcgi-ceph rhel-7-server-extras-rpms\n : rhel-7-server-optional-rpms rhel-7-server-rpms\n : rhel-ha-for-rhel-7-server-rpms\nLoaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nDetermining fastest mirrors\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-", " : disabled-repos, subscription-manager", "Cleaning repos: epel lab-extras rhel-7-fcgi-ceph rhel-7-server-extras-rpms", " : rhel-7-server-optional-rpms rhel-7-server-rpms", " : rhel-ha-for-rhel-7-server-rpms", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-", " : disabled-repos, subscription-manager", "Determining fastest mirrors", "Metadata Cache Created"]} 2019-11-28T11:09:30.431 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:30 +0000 (0:00:47.415) 0:04:06.448 ***** 2019-11-28T11:09:42.868 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:01:39.631603", "end": "2019-11-28 11:09:42.834727", "rc": 0, "start": "2019-11-28 11:08:03.203124", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nCleaning repos: epel lab-extras rhel-7-fcgi-ceph rhel-7-server-extras-rpms\n : rhel-7-server-optional-rpms rhel-7-server-rpms\n : rhel-ha-for-rhel-7-server-rpms\nLoaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nDetermining fastest mirrors\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-", " : disabled-repos, subscription-manager", "Cleaning repos: epel lab-extras rhel-7-fcgi-ceph rhel-7-server-extras-rpms", " : rhel-7-server-optional-rpms rhel-7-server-rpms", " : rhel-ha-for-rhel-7-server-rpms", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-", " : disabled-repos, subscription-manager", "Determining fastest mirrors", "Metadata Cache Created"]} 2019-11-28T11:09:42.903 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:42 +0000 (0:00:12.471) 0:04:18.920 ***** 2019-11-28T11:09:43.508 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-28T11:09:43.563 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:43 +0000 (0:00:00.660) 0:04:19.581 ***** 2019-11-28T11:09:43.896 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-28T11:09:43.942 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:43 +0000 (0:00:00.372) 0:04:19.954 ***** 2019-11-28T11:09:43.947 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:43.984 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:43 +0000 (0:00:00.047) 0:04:20.001 ***** 2019-11-28T11:09:43.992 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:44.034 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:44 +0000 (0:00:00.049) 0:04:20.051 ***** 2019-11-28T11:09:44.043 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:44.082 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:44 +0000 (0:00:00.047) 0:04:20.099 ***** 2019-11-28T11:09:44.090 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:44.130 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:44 +0000 (0:00:00.048) 0:04:20.147 ***** 2019-11-28T11:09:44.148 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:44.183 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:44 +0000 (0:00:00.053) 0:04:20.201 ***** 2019-11-28T11:09:44.200 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:44.232 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:44 +0000 (0:00:00.048) 0:04:20.250 ***** 2019-11-28T11:09:44.239 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-28T11:09:44.241 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:44.281 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:44 +0000 (0:00:00.047) 0:04:20.297 ***** 2019-11-28T11:09:44.286 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:44.325 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:44 +0000 (0:00:00.045) 0:04:20.342 ***** 2019-11-28T11:09:44.336 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:44.371 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:44 +0000 (0:00:00.046) 0:04:20.389 ***** 2019-11-28T11:09:44.380 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:44.420 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:44 +0000 (0:00:00.048) 0:04:20.437 ***** 2019-11-28T11:09:44.427 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-11-28T11:09:44.429 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:44.469 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:44 +0000 (0:00:00.047) 0:04:20.484 ***** 2019-11-28T11:09:44.474 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:44.515 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:44 +0000 (0:00:00.047) 0:04:20.532 ***** 2019-11-28T11:09:44.524 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:44.562 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:44 +0000 (0:00:00.046) 0:04:20.579 ***** 2019-11-28T11:09:44.573 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:44.608 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:44 +0000 (0:00:00.046) 0:04:20.625 ***** 2019-11-28T11:09:44.614 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-11-28T11:09:44.616 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:44.656 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:44 +0000 (0:00:00.046) 0:04:20.671 ***** 2019-11-28T11:09:44.662 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:44.699 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:44 +0000 (0:00:00.045) 0:04:20.717 ***** 2019-11-28T11:09:47.277 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-11-28T11:09:47.279 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:02.431494", "end": "2019-11-28 11:09:47.252042", "rc": 0, "start": "2019-11-28 11:09:44.820548", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:09:47.340 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:47 +0000 (0:00:02.640) 0:04:23.358 ***** 2019-11-28T11:09:48.529 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.074258", "end": "2019-11-28 11:09:48.500305", "rc": 0, "start": "2019-11-28 11:09:47.426047", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:09:48.580 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:48 +0000 (0:00:01.239) 0:04:24.597 ***** 2019-11-28T11:09:48.589 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:01:17.034619", "end": "2019-11-28 11:09:48.543528", "rc": 0, "start": "2019-11-28 11:08:31.508909", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nCleaning repos: epel lab-extras rhel-7-fcgi-ceph rhel-7-server-extras-rpms\n : rhel-7-server-optional-rpms rhel-7-server-rpms\n : rhel-ha-for-rhel-7-server-rpms\nLoaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nDetermining fastest mirrors\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-", " : disabled-repos, subscription-manager", "Cleaning repos: epel lab-extras rhel-7-fcgi-ceph rhel-7-server-extras-rpms", " : rhel-7-server-optional-rpms rhel-7-server-rpms", " : rhel-ha-for-rhel-7-server-rpms", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-", " : disabled-repos, subscription-manager", "Determining fastest mirrors", "Metadata Cache Created"]} 2019-11-28T11:09:48.635 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:48 +0000 (0:00:00.054) 0:04:24.652 ***** 2019-11-28T11:09:51.780 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-11-28T11:09:51.782 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-28T11:09:51.835 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:51 +0000 (0:00:03.200) 0:04:27.853 ***** 2019-11-28T11:09:51.860 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-28T11:09:51.896 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:51 +0000 (0:00:00.059) 0:04:27.912 ***** 2019-11-28T11:09:51.906 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:51.956 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:51 +0000 (0:00:00.059) 0:04:27.972 ***** 2019-11-28T11:09:51.964 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:52.009 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:52 +0000 (0:00:00.053) 0:04:28.026 ***** 2019-11-28T11:09:52.016 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-11-28T11:09:52.021 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:52.054 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:52 +0000 (0:00:00.045) 0:04:28.072 ***** 2019-11-28T11:09:52.062 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:52.100 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:52 +0000 (0:00:00.045) 0:04:28.118 ***** 2019-11-28T11:09:52.107 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-11-28T11:09:52.109 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:52.147 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:52 +0000 (0:00:00.046) 0:04:28.165 ***** 2019-11-28T11:09:52.155 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:52.197 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:52 +0000 (0:00:00.049) 0:04:28.214 ***** 2019-11-28T11:09:52.204 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-11-28T11:09:52.206 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:52.248 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:52 +0000 (0:00:00.051) 0:04:28.265 ***** 2019-11-28T11:09:52.265 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-28T11:09:52.266 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-28T11:09:52.268 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:52.306 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:52 +0000 (0:00:00.057) 0:04:28.323 ***** 2019-11-28T11:09:52.421 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-28T11:09:52.423 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-28T11:09:52.469 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:52 +0000 (0:00:00.162) 0:04:28.486 ***** 2019-11-28T11:09:52.790 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-11-28T11:09:52.791 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-28T11:09:52.837 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:52 +0000 (0:00:00.367) 0:04:28.854 ***** 2019-11-28T11:09:52.843 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-28T11:09:52.846 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:52.892 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:52 +0000 (0:00:00.053) 0:04:28.908 ***** 2019-11-28T11:09:52.978 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-28T11:09:53.031 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:53 +0000 (0:00:00.128) 0:04:29.037 ***** 2019-11-28T11:09:53.035 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:09:53.087 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:09:53 +0000 (0:00:00.067) 0:04:29.104 ***** 2019-11-28T11:10:02.461 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-11-28T11:10:02.463 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:01:19.307745", "end": "2019-11-28 11:10:02.431286", "rc": 0, "start": "2019-11-28 11:08:43.123541", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nCleaning repos: epel lab-extras rhel-7-fcgi-ceph rhel-7-server-extras-rpms\n : rhel-7-server-optional-rpms rhel-7-server-rpms\n : rhel-ha-for-rhel-7-server-rpms\nLoaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nDetermining fastest mirrors\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-", " : disabled-repos, subscription-manager", "Cleaning repos: epel lab-extras rhel-7-fcgi-ceph rhel-7-server-extras-rpms", " : rhel-7-server-optional-rpms rhel-7-server-rpms", " : rhel-ha-for-rhel-7-server-rpms", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-", " : disabled-repos, subscription-manager", "Determining fastest mirrors", "Metadata Cache Created"]} 2019-11-28T11:10:02.520 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:02 +0000 (0:00:09.432) 0:04:38.537 ***** 2019-11-28T11:10:02.528 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-11-28T11:10:02.530 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:02.581 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:02 +0000 (0:00:00.061) 0:04:38.599 ***** 2019-11-28T11:10:02.912 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-28T11:10:02.920 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-28T11:10:02.964 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:02 +0000 (0:00:00.381) 0:04:38.980 ***** 2019-11-28T11:10:02.972 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-28T11:10:02.973 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:03.029 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:03 +0000 (0:00:00.065) 0:04:39.046 ***** 2019-11-28T11:10:03.036 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-28T11:10:03.041 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:03.078 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:03 +0000 (0:00:00.048) 0:04:39.095 ***** 2019-11-28T11:10:03.084 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-11-28T11:10:03.086 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:03.132 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:03 +0000 (0:00:00.054) 0:04:39.149 ***** 2019-11-28T11:10:03.138 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-11-28T11:10:03.140 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:03.179 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:03 +0000 (0:00:00.046) 0:04:39.196 ***** 2019-11-28T11:10:03.186 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-11-28T11:10:03.187 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:03.225 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:03 +0000 (0:00:00.046) 0:04:39.242 ***** 2019-11-28T11:10:03.231 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-11-28T11:10:03.233 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:03.289 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:03 +0000 (0:00:00.050) 0:04:39.293 ***** TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:03.328 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:03 +0000 (0:00:00.050) 0:04:39.344 ***** 2019-11-28T11:10:03.335 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-28T11:10:03.337 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:03.382 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:03 +0000 (0:00:00.054) 0:04:39.399 ***** 2019-11-28T11:10:03.388 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-11-28T11:10:03.390 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:03.427 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:03 +0000 (0:00:00.044) 0:04:39.444 ***** 2019-11-28T11:10:03.433 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-11-28T11:10:03.436 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:03.475 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:03 +0000 (0:00:00.048) 0:04:39.493 ***** 2019-11-28T11:10:03.661 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-28T11:10:03.701 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:03 +0000 (0:00:00.225) 0:04:39.719 ***** 2019-11-28T11:10:03.714 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:03.755 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:03 +0000 (0:00:00.054) 0:04:39.773 ***** 2019-11-28T11:10:03.831 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-28T11:10:03.882 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:03 +0000 (0:00:00.126) 0:04:39.900 ***** 2019-11-28T11:10:03.888 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-11-28T11:10:03.891 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:03.938 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:03 +0000 (0:00:00.054) 0:04:39.954 ***** 2019-11-28T11:10:05.359 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-28T11:10:05.360 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-28T11:10:05.362 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-28T11:10:05.364 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-11-28T11:10:05.366 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-11-28T11:10:05.368 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-28T11:10:05.421 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:05 +0000 (0:00:01.480) 0:04:41.435 ***** 2019-11-28T11:10:05.427 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-11-28T11:10:05.429 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-28T11:10:05.431 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-28T11:10:05.470 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:05 +0000 (0:00:00.052) 0:04:41.487 ***** 2019-11-28T11:10:05.508 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:05 +0000 (0:00:00.038) 0:04:41.526 ***** 2019-11-28T11:10:05.598 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-11-28T11:10:05.599 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T11:10:05.649 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:05 +0000 (0:00:00.140) 0:04:41.667 ***** 2019-11-28T11:10:05.673 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:02.010199", "end": "2019-11-28 11:10:05.610226", "rc": 0, "start": "2019-11-28 11:10:03.600027", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T11:10:05.713 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:05 +0000 (0:00:00.060) 0:04:41.727 ***** 2019-11-28T11:10:05.746 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:05 +0000 (0:00:00.035) 0:04:41.763 ***** 2019-11-28T11:10:07.155 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi133.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-11-28T11:10:07.166 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-11-28T11:10:07.172 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} ok: [smithi075.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-11-28T11:10:07.175 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-28T11:10:07.181 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-28T11:10:07.232 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:07 +0000 (0:00:01.486) 0:04:43.250 ***** 2019-11-28T11:10:07.271 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:07 +0000 (0:00:00.039) 0:04:43.289 ***** 2019-11-28T11:10:07.280 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-11-28T11:10:07.282 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:07.333 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:07 +0000 (0:00:00.061) 0:04:43.350 ***** 2019-11-28T11:10:07.351 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:07.393 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:07 +0000 (0:00:00.060) 0:04:43.410 ***** 2019-11-28T11:10:07.400 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-11-28T11:10:07.401 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-28T11:10:07.451 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:07 +0000 (0:00:00.047) 0:04:43.458 ***** ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-28T11:10:07.490 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:07 +0000 (0:00:00.049) 0:04:43.508 ***** 2019-11-28T11:10:07.631 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-11-28T11:10:07.633 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T11:10:07.684 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:07 +0000 (0:00:00.191) 0:04:43.699 ***** 2019-11-28T11:10:07.732 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-11-28T11:10:07.737 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.951091", "end": "2019-11-28 11:10:07.697170", "rc": 0, "start": "2019-11-28 11:10:05.746079", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:10:07.783 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:07 +0000 (0:00:00.101) 0:04:43.800 ***** 2019-11-28T11:10:07.820 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-11-28T11:10:07.823 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T11:10:07.825 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T11:10:07.827 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi133.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} TASK [common : Install nrpe without epel] ************************************** skipping: [smithi075.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T11:10:07.875 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:07 +0000 (0:00:00.083) 0:04:43.883 ***** 2019-11-28T11:10:07.923 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:07 +0000 (0:00:00.057) 0:04:43.940 ***** 2019-11-28T11:10:07.968 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T11:10:07.970 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T11:10:07.972 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T11:10:08.015 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:08 +0000 (0:00:00.092) 0:04:44.032 ***** 2019-11-28T11:10:09.786 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-11-28T11:10:09.788 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-28T11:10:09.829 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:09 +0000 (0:00:01.813) 0:04:45.846 ***** 2019-11-28T11:10:13.592 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-28T11:10:13.645 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:13 +0000 (0:00:03.815) 0:04:49.662 ***** 2019-11-28T11:10:13.651 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-11-28T11:10:13.654 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:13.699 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:13 +0000 (0:00:00.054) 0:04:49.717 ***** 2019-11-28T11:10:13.707 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:13.745 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:13 +0000 (0:00:00.045) 0:04:49.762 ***** 2019-11-28T11:10:13.752 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-11-28T11:10:13.754 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:13.791 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:13 +0000 (0:00:00.045) 0:04:49.808 ***** 2019-11-28T11:10:13.799 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:13.837 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:13 +0000 (0:00:00.046) 0:04:49.854 ***** 2019-11-28T11:10:13.843 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-11-28T11:10:13.845 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:13.882 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:13 +0000 (0:00:00.045) 0:04:49.899 ***** 2019-11-28T11:10:13.889 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:13.931 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:13 +0000 (0:00:00.048) 0:04:49.948 ***** 2019-11-28T11:10:13.938 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-11-28T11:10:13.940 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:13.979 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:13 +0000 (0:00:00.046) 0:04:49.995 ***** 2019-11-28T11:10:13.984 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:14.025 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:14 +0000 (0:00:00.045) 0:04:50.041 ***** 2019-11-28T11:10:14.513 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-11-28T11:10:14.514 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-28T11:10:14.555 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:14 +0000 (0:00:00.531) 0:04:50.572 ***** 2019-11-28T11:10:15.013 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-28T11:10:15.089 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:15 +0000 (0:00:00.531) 0:04:51.104 ***** 2019-11-28T11:10:17.548 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-11-28T11:10:17.549 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:01:43.396652", "end": "2019-11-28 11:10:17.521361", "rc": 0, "start": "2019-11-28 11:08:34.124709", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nCleaning repos: epel lab-extras rhel-7-fcgi-ceph rhel-7-server-extras-rpms\n : rhel-7-server-optional-rpms rhel-7-server-rpms\n : rhel-ha-for-rhel-7-server-rpms\nLoaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nDetermining fastest mirrors\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-", " : disabled-repos, subscription-manager", "Cleaning repos: epel lab-extras rhel-7-fcgi-ceph rhel-7-server-extras-rpms", " : rhel-7-server-optional-rpms rhel-7-server-rpms", " : rhel-ha-for-rhel-7-server-rpms", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-", " : disabled-repos, subscription-manager", "Determining fastest mirrors", "Metadata Cache Created"]} 2019-11-28T11:10:17.592 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:17 +0000 (0:00:02.505) 0:04:53.609 ***** 2019-11-28T11:10:25.110 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-11-28T11:10:25.113 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-28T11:10:25.153 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:25 +0000 (0:00:07.561) 0:05:01.170 ***** 2019-11-28T11:10:25.558 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-28T11:10:25.559 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-28T11:10:25.561 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-28T11:10:25.610 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:25 +0000 (0:00:00.457) 0:05:01.627 ***** 2019-11-28T11:10:26.505 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-28T11:10:26.509 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-28T11:10:26.555 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:26 +0000 (0:00:00.941) 0:05:02.569 ***** 2019-11-28T11:10:26.559 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-28T11:10:26.563 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:26.601 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:26 +0000 (0:00:00.049) 0:05:02.618 ***** 2019-11-28T11:10:26.612 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:26.650 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:26 +0000 (0:00:00.049) 0:05:02.668 ***** 2019-11-28T11:10:26.661 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi080.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-11-28T11:10:26.699 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:26 +0000 (0:00:00.049) 0:05:02.717 ***** 2019-11-28T11:10:27.170 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-28T11:10:27.177 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-11-28T11:10:27.178 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-11-28T11:10:27.218 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:27 +0000 (0:00:00.518) 0:05:03.236 ***** 2019-11-28T11:10:27.260 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:27 +0000 (0:00:00.039) 0:05:03.276 ***** 2019-11-28T11:10:27.266 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:27.311 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:27 +0000 (0:00:00.051) 0:05:03.328 ***** 2019-11-28T11:10:27.446 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-11-28T11:10:27.447 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T11:10:27.487 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:27 +0000 (0:00:00.176) 0:05:03.504 ***** 2019-11-28T11:10:27.495 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-28T11:10:27.496 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:27.549 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:27 +0000 (0:00:00.051) 0:05:03.555 ***** 2019-11-28T11:10:27.727 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-28T11:10:27.773 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:27 +0000 (0:00:00.235) 0:05:03.791 ***** 2019-11-28T11:10:27.784 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:27.824 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:27 +0000 (0:00:00.048) 0:05:03.839 ***** 2019-11-28T11:10:27.837 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:27.875 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:27 +0000 (0:00:00.053) 0:05:03.893 ***** 2019-11-28T11:10:27.888 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:27.925 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:27 +0000 (0:00:00.049) 0:05:03.942 ***** 2019-11-28T11:10:28.088 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi080.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi075.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-28T11:10:28.131 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:28 +0000 (0:00:00.206) 0:05:04.149 ***** 2019-11-28T11:10:28.171 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:28 +0000 (0:00:00.039) 0:05:04.188 ***** 2019-11-28T11:10:28.183 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:28.229 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:28 +0000 (0:00:00.055) 0:05:04.244 ***** 2019-11-28T11:10:28.236 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:28.279 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:28 +0000 (0:00:00.052) 0:05:04.296 ***** 2019-11-28T11:10:28.286 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-11-28T11:10:28.288 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:28.340 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:28 +0000 (0:00:00.056) 0:05:04.353 ***** 2019-11-28T11:10:28.356 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi075.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-11-28T11:10:28.390 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:28 +0000 (0:00:00.054) 0:05:04.407 ***** 2019-11-28T11:10:28.804 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-11-28T11:10:28.913 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} Thursday 28 November 2019 11:10:28 +0000 (0:00:00.456) 0:05:04.864 ***** TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 28 November 2019 11:10:28 +0000 (0:00:00.046) 0:05:04.910 ***** 2019-11-28T11:10:29.003 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-11-28T11:10:29.005 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-28T11:10:29.050 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:29 +0000 (0:00:00.157) 0:05:05.068 ***** 2019-11-28T11:10:29.404 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-28T11:10:29.447 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:29 +0000 (0:00:00.396) 0:05:05.465 ***** 2019-11-28T11:10:29.453 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-11-28T11:10:29.454 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:29.502 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:29 +0000 (0:00:00.055) 0:05:05.520 ***** 2019-11-28T11:10:29.509 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-11-28T11:10:29.517 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:29.557 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:29 +0000 (0:00:00.054) 0:05:05.575 ***** 2019-11-28T11:10:29.563 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-11-28T11:10:29.565 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.980959", "end": "2019-11-28 11:10:29.500316", "rc": 0, "start": "2019-11-28 11:10:28.519357", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:10:29.567 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi080.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-28T11:10:29.609 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:29 +0000 (0:00:00.048) 0:05:05.623 ***** 2019-11-28T11:10:29.645 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:29 +0000 (0:00:00.039) 0:05:05.662 ***** 2019-11-28T11:10:29.686 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:29 +0000 (0:00:00.041) 0:05:05.703 ***** 2019-11-28T11:10:29.763 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi133.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:10:29.805 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:29 +0000 (0:00:00.118) 0:05:05.822 ***** 2019-11-28T11:10:29.989 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-11-28T11:10:29.993 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T11:10:30.034 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:30 +0000 (0:00:00.229) 0:05:06.051 ***** 2019-11-28T11:10:30.135 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-11-28T11:10:30.137 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-28T11:10:30.179 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:30 +0000 (0:00:00.144) 0:05:06.196 ***** 2019-11-28T11:10:30.217 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi080.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T11:10:30.219 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T11:10:30.224 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi133.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring TASK [common : Install nrpe without epel] ************************************** skipping: [smithi080.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T11:10:30.269 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:30 +0000 (0:00:00.090) 0:05:06.286 ***** 2019-11-28T11:10:30.277 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T11:10:30.324 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:30 +0000 (0:00:00.053) 0:05:06.340 ***** 2019-11-28T11:10:30.330 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-11-28T11:10:30.331 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:30.370 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:30 +0000 (0:00:00.047) 0:05:06.387 ***** 2019-11-28T11:10:30.637 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-11-28T11:10:30.639 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2019-11-28 11:03:42 UTC", "ActiveEnterTimestampMonotonic": "19965894", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target var-run.mount systemd-journald.socket local-fs.target nss-lookup.target system.slice basic.target network.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-11-28 11:03:42 UTC", "AssertTimestampMonotonic": "19960628", "Before": "xdm.service shutdown.target multi-user.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-11-28 11:03:42 UTC", "ConditionTimestampMonotonic": "19960628", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2091", "ExecMainStartTimestamp": "Thu 2019-11-28 11:03:42 UTC", "ExecMainStartTimestampMonotonic": "19965844", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-11-28T11:10:30.641 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Thu 2019-11-28 11:03:42 UTC] ; stop_time=[n/a] ; pid=2091 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-11-28 11:03:42 UTC", "InactiveExitTimestampMonotonic": "19965894", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "2091", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-11-28T11:10:30.642 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Thu 2019-11-28 11:03:42 UTC", "WatchdogTimestampMonotonic": "19965877", "WatchdogUSec": "0"}} 2019-11-28T11:10:30.680 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:30 +0000 (0:00:00.310) 0:05:06.698 ***** 2019-11-28T11:10:31.179 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi076.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-28T11:10:31.180 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-11-28T11:10:31.182 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-28T11:10:31.234 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:31 +0000 (0:00:00.553) 0:05:07.252 ***** 2019-11-28T11:10:31.356 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-28T11:10:31.359 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} TASK [common : Get SELinux status] ********************************************* changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001899", "end": "2019-11-28 11:10:31.330683", "rc": 0, "start": "2019-11-28 11:10:31.328784", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-28T11:10:31.411 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:31 +0000 (0:00:00.176) 0:05:07.429 ***** 2019-11-28T11:10:31.635 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-11-28T11:10:31.637 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2019-11-28 11:03:10 UTC", "ActiveEnterTimestampMonotonic": "22293065", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target network.target var-run.mount local-fs.target systemd-journald.socket basic.target nss-lookup.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-11-28 11:03:10 UTC", "AssertTimestampMonotonic": "22264072", "Before": "getty@tty1.service xdm.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": 2019-11-28T11:10:31.638 INFO:teuthology.task.ansible.out:"18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-11-28 11:03:10 UTC", "ConditionTimestampMonotonic": "22264072", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2123", "ExecMainStartTimestamp": "Thu 2019-11-28 11:03:10 UTC", "ExecMainStartTimestampMonotonic": "22293000", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Thu 2019-11-28 11:03:10 UTC] ; stop_time=[n/a] ; pid=2123 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-11-28 11:03:10 UTC", "InactiveExitTimestampMonotonic": "22293065", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLO 2019-11-28T11:10:31.640 INFO:teuthology.task.ansible.out:CK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "2123", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "network-online.target basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestam 2019-11-28T11:10:31.648 INFO:teuthology.task.ansible.out:p": "Thu 2019-11-28 11:03:10 UTC", "WatchdogTimestampMonotonic": "22293044", "WatchdogUSec": "0"}} 2019-11-28T11:10:31.681 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:31 +0000 (0:00:00.269) 0:05:07.699 ***** 2019-11-28T11:10:31.978 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-28T11:10:31.980 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-28T11:10:32.054 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:32 +0000 (0:00:00.372) 0:05:08.071 ***** 2019-11-28T11:10:32.168 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-11-28T11:10:32.169 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001931", "end": "2019-11-28 11:10:32.127233", "rc": 0, "start": "2019-11-28 11:10:32.125302", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-28T11:10:32.219 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:32 +0000 (0:00:00.165) 0:05:08.236 ***** 2019-11-28T11:10:32.349 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-11-28T11:10:32.351 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T11:10:32.420 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:32 +0000 (0:00:00.198) 0:05:08.435 ***** 2019-11-28T11:10:32.783 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-11-28T11:10:32.793 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-28T11:10:32.835 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:32 +0000 (0:00:00.417) 0:05:08.852 ***** 2019-11-28T11:10:34.309 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi076.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-11-28T11:10:34.311 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-11-28T11:10:34.313 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-28T11:10:34.356 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:34 +0000 (0:00:01.517) 0:05:10.370 ***** 2019-11-28T11:10:34.360 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-11-28T11:10:34.362 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:34.411 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:34 +0000 (0:00:00.057) 0:05:10.428 ***** 2019-11-28T11:10:34.429 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:34.458 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:34 +0000 (0:00:00.047) 0:05:10.476 ***** 2019-11-28T11:10:34.466 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-11-28T11:10:34.476 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:34.511 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:34 +0000 (0:00:00.053) 0:05:10.529 ***** 2019-11-28T11:10:34.519 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-11-28T11:10:34.520 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-28T11:10:34.561 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:34 +0000 (0:00:00.049) 0:05:10.578 ***** 2019-11-28T11:10:34.573 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:34.608 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:34 +0000 (0:00:00.047) 0:05:10.626 ***** 2019-11-28T11:10:34.743 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-11-28T11:10:34.745 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T11:10:34.787 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:34 +0000 (0:00:00.179) 0:05:10.805 ***** 2019-11-28T11:10:34.800 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:34.838 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:34 +0000 (0:00:00.050) 0:05:10.855 ***** 2019-11-28T11:10:34.903 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-11-28T11:10:34.905 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T11:10:34.907 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T11:10:34.954 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:34 +0000 (0:00:00.116) 0:05:10.971 ***** 2019-11-28T11:10:35.451 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-28T11:10:35.490 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:35 +0000 (0:00:00.536) 0:05:11.508 ***** 2019-11-28T11:10:36.093 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-33.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-28T11:10:36.132 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:36 +0000 (0:00:00.642) 0:05:12.150 ***** 2019-11-28T11:10:36.716 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-33.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-28T11:10:36.769 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:36 +0000 (0:00:00.636) 0:05:12.786 ***** 2019-11-28T11:10:46.572 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-28T11:10:46.628 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:46 +0000 (0:00:09.851) 0:05:22.638 ***** 2019-11-28T11:10:48.180 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-11-28T11:10:48.186 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-28T11:10:48.229 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:48 +0000 (0:00:01.608) 0:05:24.246 ***** 2019-11-28T11:10:50.078 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-28T11:10:50.081 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-28T11:10:50.085 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} ok: [smithi016.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-28T11:10:50.127 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:50 +0000 (0:00:01.898) 0:05:26.145 ***** 2019-11-28T11:10:50.135 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:50.181 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:50 +0000 (0:00:00.052) 0:05:26.198 ***** 2019-11-28T11:10:50.316 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-11-28T11:10:50.318 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T11:10:50.368 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:50 +0000 (0:00:00.185) 0:05:26.383 ***** 2019-11-28T11:10:50.864 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-11-28T11:10:50.865 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-11-28T11:10:50.907 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:50 +0000 (0:00:00.540) 0:05:26.923 ***** 2019-11-28T11:10:52.447 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi016.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-11-28T11:10:52.455 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-11-28T11:10:52.459 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-28T11:10:52.527 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:52 +0000 (0:00:01.620) 0:05:28.544 ***** 2019-11-28T11:10:52.881 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-28T11:10:52.915 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:52 +0000 (0:00:00.388) 0:05:28.933 ***** 2019-11-28T11:10:52.925 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-11-28T11:10:52.935 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:52.964 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:52 +0000 (0:00:00.048) 0:05:28.981 ***** 2019-11-28T11:10:52.971 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-11-28T11:10:52.973 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:52.975 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-11-28T11:10:52.977 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-28T11:10:53.014 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:53 +0000 (0:00:00.050) 0:05:29.032 ***** 2019-11-28T11:10:53.050 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:53 +0000 (0:00:00.035) 0:05:29.067 ***** 2019-11-28T11:10:53.061 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-11-28T11:10:53.062 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-28T11:10:53.111 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:53 +0000 (0:00:00.058) 0:05:29.125 ***** 2019-11-28T11:10:53.116 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:53.159 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:53 +0000 (0:00:00.049) 0:05:29.175 ***** 2019-11-28T11:10:53.313 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-11-28T11:10:53.314 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T11:10:53.353 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:53 +0000 (0:00:00.194) 0:05:29.370 ***** 2019-11-28T11:10:53.502 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-11-28T11:10:53.504 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:10:53.558 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:53 +0000 (0:00:00.204) 0:05:29.575 ***** 2019-11-28T11:10:53.572 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} TASK [common : Install nrpe without epel] ************************************** skipping: [smithi016.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T11:10:53.613 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:53 +0000 (0:00:00.055) 0:05:29.630 ***** 2019-11-28T11:10:53.620 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T11:10:53.659 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:53 +0000 (0:00:00.045) 0:05:29.676 ***** 2019-11-28T11:10:53.778 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi080.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T11:10:53.780 INFO:teuthology.task.ansible.out:...ignoring 2019-11-28T11:10:53.823 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:53 +0000 (0:00:00.164) 0:05:29.841 ***** 2019-11-28T11:10:54.141 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-11-28T11:10:54.143 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-28T11:10:54.186 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:54 +0000 (0:00:00.362) 0:05:30.203 ***** 2019-11-28T11:10:54.197 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-11-28T11:10:54.200 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:54.241 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:54 +0000 (0:00:00.055) 0:05:30.258 ***** 2019-11-28T11:10:54.248 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-11-28T11:10:54.252 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:54.306 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:54 +0000 (0:00:00.065) 0:05:30.324 ***** 2019-11-28T11:10:54.774 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-28T11:10:54.813 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:54 +0000 (0:00:00.506) 0:05:30.830 ***** 2019-11-28T11:10:54.960 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi076.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:10:55.003 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:54 +0000 (0:00:00.190) 0:05:31.021 ***** 2019-11-28T11:10:55.210 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-11-28T11:10:55.212 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2019-11-28 11:03:44 UTC", "ActiveEnterTimestampMonotonic": "20173506", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice network.target basic.target nss-lookup.target local-fs.target var-run.mount systemd-journald.socket time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-11-28 11:03:44 UTC", "AssertTimestampMonotonic": "20163208", "Before": "multi-user.target getty@tty1.service xdm.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-11-28 11:03:44 UTC", "ConditionTimestampMonotonic": "20163208", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2117", "ExecMainStartTimestamp": "Thu 2019-11-28 11:03:44 UTC", "ExecMainStartTimestampMonotonic": "20172682", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-11-28T11:10:55.214 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Thu 2019-11-28 11:03:44 UTC] ; stop_time=[n/a] ; pid=2117 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-11-28 11:03:44 UTC", "InactiveExitTimestampMonotonic": "20173506", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "2117", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-11-28T11:10:55.215 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Thu 2019-11-28 11:03:44 UTC", "WatchdogTimestampMonotonic": "20173482", "WatchdogUSec": "0"}} 2019-11-28T11:10:55.251 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:55 +0000 (0:00:00.247) 0:05:31.269 ***** 2019-11-28T11:10:55.435 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi076.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-11-28T11:10:55.475 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:55 +0000 (0:00:00.223) 0:05:31.492 ***** 2019-11-28T11:10:55.620 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-11-28T11:10:55.622 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001923", "end": "2019-11-28 11:10:55.591882", "rc": 0, "start": "2019-11-28 11:10:55.589959", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-28T11:10:55.671 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:55 +0000 (0:00:00.195) 0:05:31.688 ***** 2019-11-28T11:10:55.677 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-11-28T11:10:55.679 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:10:55.721 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:55 +0000 (0:00:00.050) 0:05:31.738 ***** 2019-11-28T11:10:58.482 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-11-28T11:10:58.483 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-33.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-28T11:10:58.532 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:58 +0000 (0:00:02.811) 0:05:34.549 ***** 2019-11-28T11:10:59.019 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-11-28T11:10:59.023 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-28T11:10:59.071 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:10:59 +0000 (0:00:00.538) 0:05:35.088 ***** 2019-11-28T11:11:02.266 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-11-28T11:11:02.268 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:01:31.706803", "end": "2019-11-28 11:11:02.239496", "rc": 0, "start": "2019-11-28 11:09:30.532693", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nCleaning repos: epel lab-extras rhel-7-fcgi-ceph rhel-7-server-extras-rpms\n : rhel-7-server-optional-rpms rhel-7-server-rpms\n : rhel-ha-for-rhel-7-server-rpms\nLoaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nDetermining fastest mirrors\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-", " : disabled-repos, subscription-manager", "Cleaning repos: epel lab-extras rhel-7-fcgi-ceph rhel-7-server-extras-rpms", " : rhel-7-server-optional-rpms rhel-7-server-rpms", " : rhel-ha-for-rhel-7-server-rpms", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-", " : disabled-repos, subscription-manager", "Determining fastest mirrors", "Metadata Cache Created"]} 2019-11-28T11:11:02.321 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:02 +0000 (0:00:03.250) 0:05:38.339 ***** 2019-11-28T11:11:02.546 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-11-28T11:11:02.549 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2019-11-28 11:04:07 UTC", "ActiveEnterTimestampMonotonic": "21000204", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target system.slice basic.target systemd-journald.socket local-fs.target nss-lookup.target network.target var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-11-28 11:04:07 UTC", "AssertTimestampMonotonic": "20991652", "Before": "multi-user.target getty@tty1.service shutdown.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-11-28 11:04:07 UTC", "ConditionTimestampMonotonic": "20991652", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2109", "ExecMainStartTimestamp": "Thu 2019-11-28 11:04:07 UTC", "ExecMainStartTimestampMonotonic": "21000154", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-11-28T11:11:02.551 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Thu 2019-11-28 11:04:07 UTC] ; stop_time=[n/a] ; pid=2109 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-11-28 11:04:07 UTC", "InactiveExitTimestampMonotonic": "21000204", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "2109", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-11-28T11:11:02.553 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Thu 2019-11-28 11:04:07 UTC", "WatchdogTimestampMonotonic": "21000185", "WatchdogUSec": "0"}} 2019-11-28T11:11:02.611 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:02 +0000 (0:00:00.289) 0:05:38.628 ***** 2019-11-28T11:11:02.972 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-28T11:11:02.974 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-28T11:11:02.975 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-28T11:11:03.036 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:03 +0000 (0:00:00.425) 0:05:39.054 ***** 2019-11-28T11:11:03.157 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-11-28T11:11:03.158 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001911", "end": "2019-11-28 11:11:03.132400", "rc": 0, "start": "2019-11-28 11:11:03.130489", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-28T11:11:03.197 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:03 +0000 (0:00:00.160) 0:05:39.214 ***** 2019-11-28T11:11:03.210 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-28T11:11:03.212 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:03.249 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:03 +0000 (0:00:00.052) 0:05:39.267 ***** 2019-11-28T11:11:06.482 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-11-28T11:11:06.484 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-33.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-28T11:11:06.528 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:06 +0000 (0:00:03.278) 0:05:42.546 ***** 2019-11-28T11:11:06.536 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-11-28T11:11:06.538 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:06.581 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:06 +0000 (0:00:00.052) 0:05:42.599 ***** 2019-11-28T11:11:09.450 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-11-28T11:11:09.454 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from rhel-7-server-rpms"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 rhel-7-server-rpms 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 rhel-7-server-rpms 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 2019-11-28T11:11:09.456 INFO:teuthology.task.ansible.out: 30 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-11-28T11:11:09.496 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:09 +0000 (0:00:02.913) 0:05:45.512 ***** 2019-11-28T11:11:09.504 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-11-28T11:11:09.506 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:09.554 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:09 +0000 (0:00:00.059) 0:05:45.572 ***** 2019-11-28T11:11:10.095 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-11-28T11:11:10.097 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-11-28T11:11:10.139 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:10 +0000 (0:00:00.584) 0:05:46.156 ***** 2019-11-28T11:11:10.154 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:10.192 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:10 +0000 (0:00:00.053) 0:05:46.209 ***** 2019-11-28T11:11:11.319 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-28T11:11:11.368 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:11 +0000 (0:00:01.172) 0:05:47.381 ***** 2019-11-28T11:11:11.377 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:11.421 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:11 +0000 (0:00:00.056) 0:05:47.438 ***** 2019-11-28T11:11:11.427 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-11-28T11:11:11.430 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:11.468 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:11 +0000 (0:00:00.046) 0:05:47.484 ***** 2019-11-28T11:11:11.474 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-11-28T11:11:11.476 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:11.519 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:11 +0000 (0:00:00.046) 0:05:47.531 ***** 2019-11-28T11:11:12.026 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-11-28T11:11:12.064 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:12 +0000 (0:00:00.549) 0:05:48.081 ***** 2019-11-28T11:11:12.073 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:12.122 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:12 +0000 (0:00:00.053) 0:05:48.135 ***** 2019-11-28T11:11:12.641 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-28T11:11:12.727 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:12 +0000 (0:00:00.570) 0:05:48.706 ***** TASK [common : Refresh repos] ************************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:12.745 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:12 +0000 (0:00:00.056) 0:05:48.762 ***** 2019-11-28T11:11:12.751 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-11-28T11:11:12.753 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:12.821 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:12 +0000 (0:00:00.067) 0:05:48.830 ***** 2019-11-28T11:11:13.526 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.593218", "end": "2019-11-28 11:11:13.500307", "rc": 0, "start": "2019-11-28 11:11:12.907089", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:11:13.571 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:13 +0000 (0:00:00.758) 0:05:49.588 ***** 2019-11-28T11:11:13.726 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:11:13.790 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:13 +0000 (0:00:00.219) 0:05:49.807 ***** 2019-11-28T11:11:16.465 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-11-28T11:11:16.467 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-28T11:11:16.517 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:16 +0000 (0:00:02.723) 0:05:52.530 ***** 2019-11-28T11:11:16.710 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-11-28T11:11:16.712 INFO:teuthology.task.ansible.out:fatal: [smithi016.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-11-28T11:11:16.751 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:16 +0000 (0:00:00.238) 0:05:52.769 ***** 2019-11-28T11:11:16.758 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-11-28T11:11:16.760 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:16.800 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:16 +0000 (0:00:00.048) 0:05:52.817 ***** 2019-11-28T11:11:16.806 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-11-28T11:11:16.808 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:16.849 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:16 +0000 (0:00:00.048) 0:05:52.866 ***** 2019-11-28T11:11:16.856 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-11-28T11:11:16.858 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:16.898 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:16 +0000 (0:00:00.049) 0:05:52.915 ***** 2019-11-28T11:11:17.389 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-11-28T11:11:17.391 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-28T11:11:17.436 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:17 +0000 (0:00:00.535) 0:05:53.451 ***** 2019-11-28T11:11:17.440 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:17.481 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:17 +0000 (0:00:00.047) 0:05:53.498 ***** 2019-11-28T11:11:17.716 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-11-28T11:11:17.718 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.397222", "end": "2019-11-28 11:11:17.689651", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:11:10.292429", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-28T11:11:17.764 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:17 +0000 (0:00:00.280) 0:05:53.779 ***** 2019-11-28T11:11:17.770 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-11-28T11:11:17.775 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2019-11-28 11:02:48 UTC", "ActiveEnterTimestampMonotonic": "20004719", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket local-fs.target system.slice var-run.mount basic.target network.target time-sync.target nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-11-28 11:02:48 UTC", "AssertTimestampMonotonic": "19963472", "Before": "multi-user.target getty@tty1.service shutdown.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-11-28 11:02:48 UTC", "ConditionTimestampMonotonic": "19963472", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2093", "ExecMainStartTimestamp": "Thu 2019-11-28 11:02:48 UTC", "ExecMainStartTimestampMonotonic": "20004220", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-11-28T11:11:17.777 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Thu 2019-11-28 11:02:48 UTC] ; stop_time=[n/a] ; pid=2093 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-11-28 11:02:48 UTC", "InactiveExitTimestampMonotonic": "20004719", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "2093", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-11-28T11:11:17.779 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Thu 2019-11-28 11:02:48 UTC", "WatchdogTimestampMonotonic": "20004689", "WatchdogUSec": "0"}} TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:17.815 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:17 +0000 (0:00:00.053) 0:05:53.832 ***** 2019-11-28T11:11:17.853 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:17 +0000 (0:00:00.037) 0:05:53.870 ***** 2019-11-28T11:11:18.016 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.002218", "end": "2019-11-28 11:11:17.986676", "rc": 0, "start": "2019-11-28 11:11:17.984458", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-28T11:11:18.060 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:18 +0000 (0:00:00.202) 0:05:54.073 ***** 2019-11-28T11:11:18.416 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "md5sum": "286c682fc73965c17876891a4581da3e", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_tmp_t:s0", "size": 934, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939477.79-95989574284174/source", "state": "file", "uid": 0} 2019-11-28T11:11:18.453 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:18 +0000 (0:00:00.397) 0:05:54.471 ***** 2019-11-28T11:11:18.538 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-11-28T11:11:18.540 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-28T11:11:18.593 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:18 +0000 (0:00:00.137) 0:05:54.608 ***** 2019-11-28T11:11:18.726 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-11-28T11:11:18.728 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.010105", "end": "2019-11-28 11:11:18.695880", "rc": 0, "start": "2019-11-28 11:11:18.685775", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-28T11:11:18.758 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from rhel-7-server-rpms"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 rhel-7-server-rpms 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 rhel-7-server-rpms 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n------------------------------------------------- 2019-11-28T11:11:18.761 INFO:teuthology.task.ansible.out:-------------------------------\nTotal 35 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-11-28T11:11:18.781 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:18 +0000 (0:00:00.189) 0:05:54.798 ***** 2019-11-28T11:11:18.815 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:18 +0000 (0:00:00.034) 0:05:54.833 ***** 2019-11-28T11:11:18.980 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-11-28T11:11:18.981 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.017995", "end": "2019-11-28 11:11:18.957978", "rc": 0, "start": "2019-11-28 11:11:18.939983", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:11:19.021 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:19 +0000 (0:00:00.205) 0:05:55.039 ***** 2019-11-28T11:11:19.300 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-11-28T11:11:19.340 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:19 +0000 (0:00:00.317) 0:05:55.356 ***** 2019-11-28T11:11:22.339 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-33.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-28T11:11:22.380 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:22 +0000 (0:00:03.037) 0:05:58.394 ***** 2019-11-28T11:11:26.863 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-11-28T11:11:26.865 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.385655", "end": "2019-11-28 11:11:26.837726", "rc": 0, "start": "2019-11-28 11:11:19.452071", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:11:26.906 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:26 +0000 (0:00:04.528) 0:06:02.923 ***** 2019-11-28T11:11:29.083 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-11-28T11:11:29.086 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-28T11:11:29.128 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:29 +0000 (0:00:02.218) 0:06:05.141 ***** 2019-11-28T11:11:29.307 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-28T11:11:29.351 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:29 +0000 (0:00:00.226) 0:06:05.368 ***** 2019-11-28T11:11:29.962 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-28T11:11:29.963 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-28T11:11:29.965 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.435283", "end": "2019-11-28 11:11:29.925442", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:11:22.490159", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-28T11:11:30.026 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:30 +0000 (0:00:00.674) 0:06:06.043 ***** 2019-11-28T11:11:30.033 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-11-28T11:11:30.035 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-28T11:11:30.075 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:30 +0000 (0:00:00.049) 0:06:06.092 ***** 2019-11-28T11:11:30.690 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi174.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-11-28T11:11:30.692 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "md5sum": "286c682fc73965c17876891a4581da3e", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_tmp_t:s0", "size": 934, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939490.05-58129740684392/source", "state": "file", "uid": 0} 2019-11-28T11:11:30.733 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:30 +0000 (0:00:00.657) 0:06:06.750 ***** 2019-11-28T11:11:30.758 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi075.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-28T11:11:30.807 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:30 +0000 (0:00:00.074) 0:06:06.825 ***** 2019-11-28T11:11:30.858 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-28T11:11:30.860 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-28T11:11:30.906 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:30 +0000 (0:00:00.098) 0:06:06.923 ***** 2019-11-28T11:11:30.915 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-11-28T11:11:30.916 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/rhel7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}, "rhel-7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "RHEL 7 Local fastcgi Repo"}}, "epel_packages": ["cryptopp-devel", "cryptopp", "dbench", "fcgi", "fuse-sshfs", "perl-JSON-XS", "leveldb", "xmlstarlet"], "nfs_service": "nfs-server", "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "xfsprogs-devel", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "lvm2", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "ant", "lsof", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN", "podman"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml"} 2019-11-28T11:11:30.959 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:30 +0000 (0:00:00.052) 0:06:06.976 ***** 2019-11-28T11:11:30.968 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.020047", "end": "2019-11-28 11:11:30.929019", "rc": 0, "start": "2019-11-28 11:11:30.908972", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-28T11:11:31.010 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:31 +0000 (0:00:00.051) 0:06:07.027 ***** 2019-11-28T11:11:31.017 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-11-28T11:11:31.017 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-28T11:11:31.061 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:31 +0000 (0:00:00.051) 0:06:07.078 ***** 2019-11-28T11:11:31.087 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-11-28T11:11:31.089 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T11:11:31.148 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:31 +0000 (0:00:00.080) 0:06:07.159 ***** 2019-11-28T11:11:31.179 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-11-28T11:11:31.185 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from rhel-7-server-rpms"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 rhel-7-server-rpms 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 rhel-7-server-rpms 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 2019-11-28T11:11:31.187 INFO:teuthology.task.ansible.out: 38 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-11-28T11:11:31.230 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:31 +0000 (0:00:00.088) 0:06:07.247 ***** 2019-11-28T11:11:31.236 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-11-28T11:11:31.238 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.011294", "end": "2019-11-28 11:11:31.179828", "rc": 0, "start": "2019-11-28 11:11:31.168534", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:11:31.305 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:31 +0000 (0:00:00.075) 0:06:07.323 ***** 2019-11-28T11:11:31.316 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-28T11:11:31.364 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:31 +0000 (0:00:00.049) 0:06:07.372 ***** 2019-11-28T11:11:31.568 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-11-28T11:11:31.573 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-11-28T11:11:31.636 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:31 +0000 (0:00:00.280) 0:06:07.653 ***** 2019-11-28T11:11:31.753 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-11-28T11:11:31.757 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "name": "ubuntu", "state": "present", "system": false} 2019-11-28T11:11:31.809 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:31 +0000 (0:00:00.172) 0:06:07.826 ***** 2019-11-28T11:11:32.731 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-11-28T11:11:32.734 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-11-28T11:11:32.735 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-28T11:11:32.808 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:32 +0000 (0:00:01.000) 0:06:08.826 ***** 2019-11-28T11:11:32.818 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-11-28T11:11:32.819 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:32.876 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:32 +0000 (0:00:00.065) 0:06:08.891 ***** 2019-11-28T11:11:32.896 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:32.943 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:32 +0000 (0:00:00.068) 0:06:08.960 ***** 2019-11-28T11:11:32.948 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-11-28T11:11:32.951 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:32.996 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:32 +0000 (0:00:00.048) 0:06:09.008 ***** 2019-11-28T11:11:33.009 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-28T11:11:33.051 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:33 +0000 (0:00:00.060) 0:06:09.068 ***** 2019-11-28T11:11:33.205 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-11-28T11:11:33.207 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-28T11:11:33.267 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:33 +0000 (0:00:00.216) 0:06:09.284 ***** 2019-11-28T11:11:33.387 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-11-28T11:11:33.393 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T11:11:33.437 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:33 +0000 (0:00:00.170) 0:06:09.455 ***** 2019-11-28T11:11:34.009 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-11-28T11:11:34.011 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-28T11:11:34.053 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:34 +0000 (0:00:00.615) 0:06:10.070 ***** 2019-11-28T11:11:34.094 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-11-28T11:11:34.097 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T11:11:34.100 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T11:11:34.141 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:34 +0000 (0:00:00.087) 0:06:10.158 ***** 2019-11-28T11:11:34.147 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-11-28T11:11:34.150 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi075"}, "changed": false} 2019-11-28T11:11:34.204 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:34 +0000 (0:00:00.063) 0:06:10.221 ***** 2019-11-28T11:11:38.868 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from rhel-7-server-rpms"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 rhel-7-server-rpms 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 rhel-7-server-rpms 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n------------------------------------------------- 2019-11-28T11:11:38.871 INFO:teuthology.task.ansible.out:-------------------------------\nTotal 33 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-11-28T11:11:38.904 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:38 +0000 (0:00:04.700) 0:06:14.921 ***** 2019-11-28T11:11:38.962 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.463777", "end": "2019-11-28 11:11:38.928902", "rc": 0, "start": "2019-11-28 11:11:31.465125", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:11:39.000 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:38 +0000 (0:00:00.095) 0:06:15.017 ***** 2019-11-28T11:11:39.297 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-11-28T11:11:39.301 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-11-28T11:11:39.363 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:39 +0000 (0:00:00.358) 0:06:15.376 ***** 2019-11-28T11:11:39.370 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-11-28T11:11:39.372 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.401349", "end": "2019-11-28 11:11:39.307198", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:11:31.905849", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-28T11:11:39.451 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:39 +0000 (0:00:00.092) 0:06:15.468 ***** 2019-11-28T11:11:39.510 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-11-28T11:11:39.515 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-28T11:11:39.569 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:39 +0000 (0:00:00.118) 0:06:15.586 ***** 2019-11-28T11:11:39.919 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-11-28T11:11:39.920 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi075.front.sepia.ceph.com", "ansible_hostname": "smithi075", "ansible_nodename": "smithi075"}, "changed": false, "name": "smithi075"} 2019-11-28T11:11:39.965 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:39 +0000 (0:00:00.392) 0:06:15.979 ***** 2019-11-28T11:11:39.971 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-11-28T11:11:39.973 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-28T11:11:40.033 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:40 +0000 (0:00:00.071) 0:06:16.050 ***** 2019-11-28T11:11:40.262 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-11-28T11:11:40.263 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "md5sum": "286c682fc73965c17876891a4581da3e", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_tmp_t:s0", "size": 934, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939499.55-95117126500898/source", "state": "file", "uid": 0} 2019-11-28T11:11:40.337 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:40 +0000 (0:00:00.303) 0:06:16.354 ***** 2019-11-28T11:11:40.356 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-11-28T11:11:40.362 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-28T11:11:40.422 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:40 +0000 (0:00:00.085) 0:06:16.440 ***** 2019-11-28T11:11:40.568 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-11-28T11:11:40.570 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.013689", "end": "2019-11-28 11:11:40.531777", "rc": 0, "start": "2019-11-28 11:11:40.518088", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-11-28T11:11:40.572 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2019-11-28T11:11:40.614 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:40 +0000 (0:00:00.191) 0:06:16.631 ***** 2019-11-28T11:11:40.655 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:40 +0000 (0:00:00.040) 0:06:16.672 ***** 2019-11-28T11:11:40.662 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-11-28T11:11:40.664 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/rhel7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}, "rhel-7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "RHEL 7 Local fastcgi Repo"}}, "epel_packages": ["cryptopp-devel", "cryptopp", "dbench", "fcgi", "fuse-sshfs", "perl-JSON-XS", "leveldb", "xmlstarlet"], "nfs_service": "nfs-server", "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "xfsprogs-devel", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "lvm2", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "ant", "lsof", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN", "podman"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml"} 2019-11-28T11:11:40.717 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:40 +0000 (0:00:00.063) 0:06:16.735 ***** 2019-11-28T11:11:40.870 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.010218", "end": "2019-11-28 11:11:40.819678", "rc": 0, "start": "2019-11-28 11:11:40.809460", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:11:40.903 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:40 +0000 (0:00:00.185) 0:06:16.920 ***** 2019-11-28T11:11:40.911 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-11-28T11:11:40.914 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-28T11:11:40.955 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:40 +0000 (0:00:00.051) 0:06:16.972 ***** 2019-11-28T11:11:41.146 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-11-28T11:11:41.148 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-28T11:11:41.220 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:41 +0000 (0:00:00.261) 0:06:17.233 ***** 2019-11-28T11:11:41.340 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-28T11:11:41.397 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:41 +0000 (0:00:00.180) 0:06:17.414 ***** 2019-11-28T11:11:41.909 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-11-28T11:11:41.911 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-28T11:11:41.957 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:41 +0000 (0:00:00.559) 0:06:17.974 ***** 2019-11-28T11:11:42.108 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "name": "ubuntu", "state": "present", "system": false} 2019-11-28T11:11:42.160 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:42 +0000 (0:00:00.202) 0:06:18.177 ***** 2019-11-28T11:11:42.658 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-11-28T11:11:42.659 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-28T11:11:42.698 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:42 +0000 (0:00:00.538) 0:06:18.716 ***** 2019-11-28T11:11:42.706 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-11-28T11:11:42.708 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:42.748 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:42 +0000 (0:00:00.048) 0:06:18.764 ***** 2019-11-28T11:11:42.891 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-28T11:11:42.939 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:42 +0000 (0:00:00.190) 0:06:18.954 ***** 2019-11-28T11:11:42.950 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:42.984 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:42 +0000 (0:00:00.047) 0:06:19.002 ***** 2019-11-28T11:11:43.122 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-28T11:11:43.125 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "kvm", "state": "present", "system": false} 2019-11-28T11:11:43.163 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:43 +0000 (0:00:00.178) 0:06:19.180 ***** 2019-11-28T11:11:43.342 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi133.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-28T11:11:43.382 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:43 +0000 (0:00:00.219) 0:06:19.399 ***** 2019-11-28T11:11:43.555 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi075.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1216, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-28T11:11:43.601 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:43 +0000 (0:00:00.218) 0:06:19.618 ***** 2019-11-28T11:11:44.180 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-28T11:11:44.231 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:44 +0000 (0:00:00.630) 0:06:20.249 ***** 2019-11-28T11:11:44.727 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-28T11:11:44.729 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-28T11:11:44.789 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:44 +0000 (0:00:00.555) 0:06:20.804 ***** 2019-11-28T11:11:44.798 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-11-28T11:11:44.800 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi133"}, "changed": false} 2019-11-28T11:11:44.858 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:44 +0000 (0:00:00.071) 0:06:20.875 ***** 2019-11-28T11:11:45.340 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-28T11:11:45.341 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-28T11:11:45.398 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:45 +0000 (0:00:00.539) 0:06:21.415 ***** 2019-11-28T11:11:45.702 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-11-28T11:11:45.705 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi133.front.sepia.ceph.com", "ansible_hostname": "smithi133", "ansible_nodename": "smithi133"}, "changed": false, "name": "smithi133"} 2019-11-28T11:11:45.748 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:45 +0000 (0:00:00.350) 0:06:21.766 ***** 2019-11-28T11:11:46.998 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-11-28T11:11:47.009 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.432889", "end": "2019-11-28 11:11:46.973120", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:11:39.540231", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-28T11:11:47.068 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:47 +0000 (0:00:01.319) 0:06:23.085 ***** 2019-11-28T11:11:47.537 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2019-11-28T11:11:47.597 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:47 +0000 (0:00:00.529) 0:06:23.615 ***** 2019-11-28T11:11:47.658 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-28T11:11:47.659 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.769369", "end": "2019-11-28 11:11:47.632708", "rc": 0, "start": "2019-11-28 11:11:45.863339", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:11:47.716 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:47 +0000 (0:00:00.118) 0:06:23.733 ***** 2019-11-28T11:11:48.193 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-11-28T11:11:48.194 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "md5sum": "286c682fc73965c17876891a4581da3e", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_tmp_t:s0", "size": 934, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939507.55-277498379732069/source", "state": "file", "uid": 0} 2019-11-28T11:11:48.197 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-28T11:11:48.247 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:48 +0000 (0:00:00.527) 0:06:24.260 ***** 2019-11-28T11:11:48.294 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:48 +0000 (0:00:00.050) 0:06:24.310 ***** 2019-11-28T11:11:48.440 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-11-28T11:11:48.442 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.010016", "end": "2019-11-28 11:11:48.414250", "rc": 0, "start": "2019-11-28 11:11:48.404234", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-28T11:11:48.499 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:48 +0000 (0:00:00.205) 0:06:24.516 ***** 2019-11-28T11:11:48.513 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-11-28T11:11:48.515 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.423031", "end": "2019-11-28 11:11:48.481540", "rc": 0, "start": "2019-11-28 11:11:41.058509", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:11:48.559 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:48 +0000 (0:00:00.059) 0:06:24.576 ***** 2019-11-28T11:11:48.714 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.012785", "end": "2019-11-28 11:11:48.682891", "rc": 0, "start": "2019-11-28 11:11:48.670106", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:11:48.759 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:48 +0000 (0:00:00.199) 0:06:24.776 ***** 2019-11-28T11:11:48.924 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-28T11:11:48.927 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'RHEL 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/'}, 'key': u'rhel-7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e6aba9c9ab05e27255ed430f065502af284a869b", "dest": "/etc/yum.repos.d/rhel-7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "rhel-7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "RHEL 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/rhel-7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 245, "state": "file", "uid": 0} 2019-11-28T11:11:48.933 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-28T11:11:48.972 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:48 +0000 (0:00:00.212) 0:06:24.989 ***** 2019-11-28T11:11:48.995 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-11-28T11:11:48.996 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-28T11:11:49.044 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:49 +0000 (0:00:00.070) 0:06:25.060 ***** 2019-11-28T11:11:49.051 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi080.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-28T11:11:49.091 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:49 +0000 (0:00:00.048) 0:06:25.108 ***** 2019-11-28T11:11:49.286 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-28T11:11:49.287 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e3b44e00721d55ceb436a2b7c0ec58cd5bc39dc9", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 207, "state": "file", "uid": 0} 2019-11-28T11:11:49.334 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:49 +0000 (0:00:00.243) 0:06:25.352 ***** 2019-11-28T11:11:49.349 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi080.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-28T11:11:49.388 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:49 +0000 (0:00:00.053) 0:06:25.405 ***** 2019-11-28T11:11:49.395 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-28T11:11:49.457 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:49 +0000 (0:00:00.069) 0:06:25.475 ***** 2019-11-28T11:11:49.467 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-11-28T11:11:49.469 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/rhel7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}, "rhel-7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "RHEL 7 Local fastcgi Repo"}}, "epel_packages": ["cryptopp-devel", "cryptopp", "dbench", "fcgi", "fuse-sshfs", "perl-JSON-XS", "leveldb", "xmlstarlet"], "nfs_service": "nfs-server", "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "xfsprogs-devel", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "lvm2", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "ant", "lsof", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN", "podman"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml"} 2019-11-28T11:11:49.534 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:49 +0000 (0:00:00.074) 0:06:25.549 ***** 2019-11-28T11:11:49.541 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:49.600 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:49 +0000 (0:00:00.068) 0:06:25.618 ***** 2019-11-28T11:11:49.608 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-11-28T11:11:49.609 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-28T11:11:49.611 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-11-28T11:11:49.613 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-28T11:11:49.653 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:49 +0000 (0:00:00.052) 0:06:25.670 ***** 2019-11-28T11:11:49.696 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:49 +0000 (0:00:00.042) 0:06:25.713 ***** 2019-11-28T11:11:49.703 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-11-28T11:11:49.706 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-28T11:11:49.748 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:49 +0000 (0:00:00.051) 0:06:25.765 ***** 2019-11-28T11:11:49.858 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-28T11:11:49.897 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:49 +0000 (0:00:00.148) 0:06:25.914 ***** 2019-11-28T11:11:49.904 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-28T11:11:49.905 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-28T11:11:49.907 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:49.957 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:49 +0000 (0:00:00.059) 0:06:25.974 ***** 2019-11-28T11:11:50.006 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:50 +0000 (0:00:00.048) 0:06:26.023 ***** 2019-11-28T11:11:50.018 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:50.067 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:50 +0000 (0:00:00.060) 0:06:26.083 ***** 2019-11-28T11:11:50.092 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-11-28T11:11:50.094 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "name": "ubuntu", "state": "present", "system": false} 2019-11-28T11:11:50.134 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:50 +0000 (0:00:00.067) 0:06:26.151 ***** 2019-11-28T11:11:50.195 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-28T11:11:50.219 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "kvm", "state": "present", "system": false} 2019-11-28T11:11:50.236 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:50 +0000 (0:00:00.102) 0:06:26.253 ***** 2019-11-28T11:11:50.243 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-11-28T11:11:50.245 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:50.285 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:50 +0000 (0:00:00.047) 0:06:26.301 ***** 2019-11-28T11:11:50.448 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi133.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1216, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-28T11:11:50.484 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:50 +0000 (0:00:00.200) 0:06:26.502 ***** 2019-11-28T11:11:50.501 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-11-28T11:11:50.503 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:50.542 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:50 +0000 (0:00:00.057) 0:06:26.560 ***** 2019-11-28T11:11:51.017 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-28T11:11:51.019 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-28T11:11:51.088 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:51 +0000 (0:00:00.545) 0:06:27.105 ***** 2019-11-28T11:11:51.215 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-11-28T11:11:51.217 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-28T11:11:51.273 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:51 +0000 (0:00:00.184) 0:06:27.290 ***** 2019-11-28T11:11:51.755 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-28T11:11:51.757 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-28T11:11:51.826 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:51 +0000 (0:00:00.539) 0:06:27.830 ***** 2019-11-28T11:11:52.371 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-11-28T11:11:52.372 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-28T11:11:52.417 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:52 +0000 (0:00:00.603) 0:06:28.434 ***** 2019-11-28T11:11:52.857 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-11-28T11:11:53.036 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-52.el7.noarch providing yum-utils is already installed"]} Thursday 28 November 2019 11:11:52 +0000 (0:00:00.482) 0:06:28.916 ***** TASK [testnode : Set hostname var] ********************************************* ok: [smithi080.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi080"}, "changed": false} Thursday 28 November 2019 11:11:52 +0000 (0:00:00.049) 0:06:28.966 ***** 2019-11-28T11:11:54.306 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-28T11:11:54.308 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.757372", "end": "2019-11-28 11:11:54.281804", "rc": 0, "start": "2019-11-28 11:11:52.524432", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:11:54.352 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:54 +0000 (0:00:01.403) 0:06:30.369 ***** 2019-11-28T11:11:54.358 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-11-28T11:11:54.363 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:01.256254", "end": "2019-11-28 11:11:54.330202", "rc": 0, "start": "2019-11-28 11:11:53.073948", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-\n : manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-", " : manager", "Loading mirror speeds from cached hostfile", " * epel: download-cc-rdu01.fedoraproject.org", "No unfinished transactions left."]} 2019-11-28T11:11:54.403 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:54 +0000 (0:00:00.051) 0:06:30.421 ***** 2019-11-28T11:11:54.619 INFO:teuthology.task.ansible.out: 2019-11-28T11:11:54.627 INFO:teuthology.task.ansible.out:TASK [testnode : Set the system's hostname] ************************************ ok: [smithi080.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi080", "ansible_hostname": "smithi080", "ansible_nodename": "smithi080"}, "changed": false, "name": "smithi080"} 2019-11-28T11:11:54.641 INFO:teuthology.task.ansible.out: 2019-11-28T11:11:54.694 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:54 +0000 (0:00:00.291) 0:06:30.712 ***** 2019-11-28T11:11:54.698 INFO:teuthology.task.ansible.out: 2019-11-28T11:11:54.704 INFO:teuthology.task.ansible.out: 2019-11-28T11:11:54.707 INFO:teuthology.task.ansible.out:TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-28T11:11:54.747 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:54 +0000 (0:00:00.052) 0:06:30.764 ***** 2019-11-28T11:11:54.837 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* fatal: [smithi075.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.023073", "end": "2019-11-28 11:11:54.798750", "msg": "non-zero return code", "rc": 1, "start": "2019-11-28 11:11:54.775677", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-28T11:11:54.892 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:54 +0000 (0:00:00.141) 0:06:30.906 ***** 2019-11-28T11:11:54.896 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-11-28T11:11:54.898 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:54.960 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:54 +0000 (0:00:00.065) 0:06:30.971 ***** 2019-11-28T11:11:54.965 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* ok: [smithi133.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'RHEL 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/'}, 'key': u'rhel-7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e6aba9c9ab05e27255ed430f065502af284a869b", "dest": "/etc/yum.repos.d/rhel-7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "rhel-7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "RHEL 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/rhel-7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 245, "state": "file", "uid": 0} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:55.006 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:55 +0000 (0:00:00.052) 0:06:31.023 ***** 2019-11-28T11:11:55.270 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-11-28T11:11:55.272 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2019-11-28T11:11:55.342 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:55 +0000 (0:00:00.335) 0:06:31.359 ***** 2019-11-28T11:11:55.444 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* ok: [smithi133.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e3b44e00721d55ceb436a2b7c0ec58cd5bc39dc9", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 207, "state": "file", "uid": 0} 2019-11-28T11:11:55.492 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:55 +0000 (0:00:00.150) 0:06:31.510 ***** 2019-11-28T11:11:55.511 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-11-28T11:11:55.565 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:55 +0000 (0:00:00.068) 0:06:31.579 ***** 2019-11-28T11:11:55.570 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-28T11:11:55.610 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:55 +0000 (0:00:00.048) 0:06:31.627 ***** 2019-11-28T11:11:55.983 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-11-28T11:11:55.984 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-28T11:11:56.026 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:56 +0000 (0:00:00.415) 0:06:32.043 ***** 2019-11-28T11:11:56.032 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-11-28T11:11:56.032 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:56.093 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:56 +0000 (0:00:00.067) 0:06:32.110 ***** 2019-11-28T11:11:56.099 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-11-28T11:11:56.101 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-28T11:11:56.146 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:56 +0000 (0:00:00.053) 0:06:32.164 ***** 2019-11-28T11:11:56.152 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-11-28T11:11:56.153 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-28T11:11:56.156 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-28T11:11:56.197 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:56 +0000 (0:00:00.050) 0:06:32.214 ***** 2019-11-28T11:11:56.205 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-11-28T11:11:56.207 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:56.279 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:56 +0000 (0:00:00.081) 0:06:32.296 ***** 2019-11-28T11:11:56.287 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-11-28T11:11:56.291 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:56.330 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:56 +0000 (0:00:00.049) 0:06:32.345 ***** 2019-11-28T11:11:56.456 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-11-28T11:11:56.458 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.344366", "end": "2019-11-28 11:11:56.420734", "rc": 0, "start": "2019-11-28 11:11:49.076368", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:11:56.467 INFO:teuthology.task.ansible.out: 2019-11-28T11:11:56.476 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-11-28T11:11:56.478 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:11:56.515 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:56 +0000 (0:00:00.187) 0:06:32.533 ***** 2019-11-28T11:11:56.560 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:56 +0000 (0:00:00.044) 0:06:32.577 ***** 2019-11-28T11:11:56.566 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:11:56.568 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:56.607 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:56 +0000 (0:00:00.047) 0:06:32.625 ***** 2019-11-28T11:11:56.614 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-11-28T11:11:56.615 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-28T11:11:56.666 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:56 +0000 (0:00:00.058) 0:06:32.683 ***** 2019-11-28T11:11:56.750 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-11-28T11:11:56.751 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-28T11:11:56.800 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:56 +0000 (0:00:00.133) 0:06:32.817 ***** 2019-11-28T11:11:56.807 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi174.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T11:11:56.809 INFO:teuthology.task.ansible.out:...ignoring 2019-11-28T11:11:56.855 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:56 +0000 (0:00:00.055) 0:06:32.873 ***** 2019-11-28T11:11:56.862 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-11-28T11:11:56.863 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-28T11:11:56.912 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:56 +0000 (0:00:00.056) 0:06:32.929 ***** 2019-11-28T11:11:56.920 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:56.965 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:56 +0000 (0:00:00.052) 0:06:32.982 ***** 2019-11-28T11:11:57.040 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi076.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-28T11:11:57.100 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:57 +0000 (0:00:00.135) 0:06:33.117 ***** 2019-11-28T11:11:57.418 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-11-28T11:11:57.420 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-28T11:11:57.460 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:57 +0000 (0:00:00.360) 0:06:33.478 ***** 2019-11-28T11:11:57.507 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi076.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/rhel7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}, "rhel-7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "RHEL 7 Local fastcgi Repo"}}, "epel_packages": ["cryptopp-devel", "cryptopp", "dbench", "fcgi", "fuse-sshfs", "perl-JSON-XS", "leveldb", "xmlstarlet"], "nfs_service": "nfs-server", "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "xfsprogs-devel", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "lvm2", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "ant", "lsof", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN", "podman"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml"} 2019-11-28T11:11:57.552 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:57 +0000 (0:00:00.092) 0:06:33.570 ***** 2019-11-28T11:11:57.624 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-28T11:11:57.670 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:57 +0000 (0:00:00.117) 0:06:33.687 ***** 2019-11-28T11:11:57.678 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-11-28T11:11:57.680 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-28T11:11:57.682 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-28T11:11:57.683 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-28T11:11:57.722 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:57 +0000 (0:00:00.052) 0:06:33.739 ***** 2019-11-28T11:11:57.758 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:57 +0000 (0:00:00.035) 0:06:33.775 ***** 2019-11-28T11:11:57.915 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-28T11:11:57.986 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:57 +0000 (0:00:00.228) 0:06:34.003 ***** 2019-11-28T11:11:57.999 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-11-28T11:11:58.003 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2019-11-28 11:03:07 UTC", "ActiveEnterTimestampMonotonic": "20077767", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target basic.target nss-lookup.target network.target system.slice time-sync.target systemd-journald.socket var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-11-28 11:03:07 UTC", "AssertTimestampMonotonic": "20042521", "Before": "xdm.service multi-user.target shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-11-28 11:03:07 UTC", "ConditionTimestampMonotonic": "20042520", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2130", "ExecMainStartTimestamp": "Thu 2019-11-28 11:03:07 UTC", "ExecMainStartTimestampMonotonic": "20077712", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-11-28T11:11:58.005 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Thu 2019-11-28 11:03:07 UTC] ; stop_time=[n/a] ; pid=2130 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-11-28 11:03:07 UTC", "InactiveExitTimestampMonotonic": "20077767", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "2130", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-11-28T11:11:58.007 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Thu 2019-11-28 11:03:07 UTC", "WatchdogTimestampMonotonic": "20077747", "WatchdogUSec": "0"}} 2019-11-28T11:11:58.054 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:58 +0000 (0:00:00.068) 0:06:34.072 ***** 2019-11-28T11:11:58.099 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-28T11:11:58.100 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "kvm", "state": "present", "system": false} 2019-11-28T11:11:58.140 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:58 +0000 (0:00:00.085) 0:06:34.157 ***** 2019-11-28T11:11:58.182 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-11-28T11:11:58.184 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "name": "ubuntu", "state": "present", "system": false} 2019-11-28T11:11:58.223 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:58 +0000 (0:00:00.082) 0:06:34.240 ***** 2019-11-28T11:11:58.282 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-11-28T11:11:58.283 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001921", "end": "2019-11-28 11:11:58.256959", "rc": 0, "start": "2019-11-28 11:11:58.255038", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-28T11:11:58.330 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:58 +0000 (0:00:00.107) 0:06:34.347 ***** 2019-11-28T11:11:58.336 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:58.383 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:58 +0000 (0:00:00.052) 0:06:34.400 ***** 2019-11-28T11:11:58.389 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-28T11:11:58.390 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1216, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-28T11:11:58.429 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:58 +0000 (0:00:00.046) 0:06:34.447 ***** 2019-11-28T11:11:58.436 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-11-28T11:11:58.439 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:11:58.476 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:58 +0000 (0:00:00.046) 0:06:34.493 ***** 2019-11-28T11:11:58.947 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-28T11:11:58.948 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-28T11:11:58.992 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:58 +0000 (0:00:00.512) 0:06:35.006 ***** 2019-11-28T11:11:59.146 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-11-28T11:11:59.147 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-28T11:11:59.186 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:59 +0000 (0:00:00.197) 0:06:35.204 ***** 2019-11-28T11:11:59.676 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-28T11:11:59.723 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:11:59 +0000 (0:00:00.528) 0:06:35.732 ***** 2019-11-28T11:12:00.244 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-11-28T11:12:00.245 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-52.el7.noarch providing yum-utils is already installed"]} 2019-11-28T11:12:00.290 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:00 +0000 (0:00:00.575) 0:06:36.308 ***** 2019-11-28T11:12:00.301 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-28T11:12:00.344 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:00 +0000 (0:00:00.053) 0:06:36.361 ***** 2019-11-28T11:12:02.308 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-28T11:12:02.310 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.886334", "end": "2019-11-28 11:12:02.278175", "rc": 0, "start": "2019-11-28 11:12:00.391841", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:12:02.348 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:02 +0000 (0:00:02.003) 0:06:38.365 ***** 2019-11-28T11:12:02.353 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-11-28T11:12:02.355 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi076"}, "changed": false} 2019-11-28T11:12:02.393 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:02 +0000 (0:00:00.043) 0:06:38.409 ***** 2019-11-28T11:12:02.712 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-11-28T11:12:02.713 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:02.212429", "end": "2019-11-28 11:12:02.676613", "rc": 0, "start": "2019-11-28 11:12:00.464184", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-\n : manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-", " : manager", "Loading mirror speeds from cached hostfile", " * epel: download-cc-rdu01.fedoraproject.org", "No unfinished transactions left."]} 2019-11-28T11:12:02.747 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:02 +0000 (0:00:00.355) 0:06:38.765 ***** 2019-11-28T11:12:03.035 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-28T11:12:03.037 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'RHEL 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/'}, 'key': u'rhel-7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e6aba9c9ab05e27255ed430f065502af284a869b", "dest": "/etc/yum.repos.d/rhel-7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "rhel-7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "RHEL 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/rhel-7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 245, "state": "file", "uid": 0} 2019-11-28T11:12:03.044 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi076.front.sepia.ceph.com", "ansible_hostname": "smithi076", "ansible_nodename": "smithi076"}, "changed": false, "name": "smithi076"} 2019-11-28T11:12:03.080 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:03 +0000 (0:00:00.332) 0:06:39.098 ***** 2019-11-28T11:12:03.254 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-11-28T11:12:03.262 INFO:teuthology.task.ansible.out:fatal: [smithi133.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.023060", "end": "2019-11-28 11:12:03.220735", "msg": "non-zero return code", "rc": 1, "start": "2019-11-28 11:12:03.197675", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-28T11:12:03.303 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:03 +0000 (0:00:00.222) 0:06:39.320 ***** 2019-11-28T11:12:03.423 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-28T11:12:03.425 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e3b44e00721d55ceb436a2b7c0ec58cd5bc39dc9", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 207, "state": "file", "uid": 0} 2019-11-28T11:12:03.469 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:03 +0000 (0:00:00.165) 0:06:39.485 ***** 2019-11-28T11:12:03.475 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-11-28T11:12:03.475 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:12:03.515 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:03 +0000 (0:00:00.047) 0:06:39.532 ***** 2019-11-28T11:12:03.522 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-28T11:12:03.562 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:03 +0000 (0:00:00.046) 0:06:39.579 ***** 2019-11-28T11:12:03.779 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-11-28T11:12:03.781 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2019-11-28T11:12:03.832 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:03 +0000 (0:00:00.270) 0:06:39.849 ***** 2019-11-28T11:12:03.839 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-11-28T11:12:03.841 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-11-28T11:12:03.843 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from rhel-7-server-rpms"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 rhel-7-server-rpms 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 rhel-7-server-rpms 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 2019-11-28T11:12:03.845 INFO:teuthology.task.ansible.out: 33 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-11-28T11:12:03.881 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:03 +0000 (0:00:00.049) 0:06:39.899 ***** 2019-11-28T11:12:03.917 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:03 +0000 (0:00:00.035) 0:06:39.935 ***** 2019-11-28T11:12:04.240 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-11-28T11:12:04.242 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-11-28T11:12:04.283 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:04 +0000 (0:00:00.365) 0:06:40.300 ***** 2019-11-28T11:12:04.290 INFO:teuthology.task.ansible.out: 2019-11-28T11:12:04.292 INFO:teuthology.task.ansible.out:TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi080.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-28T11:12:04.343 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:04 +0000 (0:00:00.060) 0:06:40.360 ***** 2019-11-28T11:12:04.351 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-11-28T11:12:04.353 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-28T11:12:04.391 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:04 +0000 (0:00:00.047) 0:06:40.408 ***** 2019-11-28T11:12:04.399 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-11-28T11:12:04.401 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:12:04.447 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:04 +0000 (0:00:00.048) 0:06:40.457 ***** TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-11-28T11:12:04.449 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-33.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-28T11:12:04.487 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:04 +0000 (0:00:00.047) 0:06:40.505 ***** 2019-11-28T11:12:04.494 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:12:04.494 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:12:04.533 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:04 +0000 (0:00:00.045) 0:06:40.550 ***** 2019-11-28T11:12:04.947 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-11-28T11:12:04.949 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-28T11:12:04.986 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:04 +0000 (0:00:00.453) 0:06:41.004 ***** 2019-11-28T11:12:09.877 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-11-28T11:12:09.880 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-52.el7.noarch providing yum-utils is already installed"]} 2019-11-28T11:12:09.917 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:09 +0000 (0:00:04.930) 0:06:45.934 ***** 2019-11-28T11:12:10.401 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-11-28T11:12:10.402 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-28T11:12:10.447 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:10 +0000 (0:00:00.530) 0:06:46.464 ***** 2019-11-28T11:12:12.281 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-11-28T11:12:12.282 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:01.670897", "end": "2019-11-28 11:12:12.240245", "rc": 0, "start": "2019-11-28 11:12:10.569348", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-\n : manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-", " : manager", "Loading mirror speeds from cached hostfile", " * epel: download-cc-rdu01.fedoraproject.org", "No unfinished transactions left."]} 2019-11-28T11:12:12.321 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:12 +0000 (0:00:01.873) 0:06:48.338 ***** 2019-11-28T11:12:12.485 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-28T11:12:12.487 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-28T11:12:12.579 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:12 +0000 (0:00:00.254) 0:06:48.592 ***** 2019-11-28T11:12:12.619 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-11-28T11:12:12.620 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:08.133854", "end": "2019-11-28 11:12:12.585383", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:12:04.451529", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-28T11:12:12.659 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:12 +0000 (0:00:00.084) 0:06:48.677 ***** 2019-11-28T11:12:12.735 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-11-28T11:12:12.737 INFO:teuthology.task.ansible.out:fatal: [smithi080.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.023550", "end": "2019-11-28 11:12:12.705033", "msg": "non-zero return code", "rc": 1, "start": "2019-11-28 11:12:12.681483", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-28T11:12:12.776 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:12 +0000 (0:00:00.116) 0:06:48.793 ***** 2019-11-28T11:12:12.819 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-28T11:12:12.822 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "kvm", "state": "present", "system": false} 2019-11-28T11:12:12.886 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:12 +0000 (0:00:00.107) 0:06:48.901 ***** 2019-11-28T11:12:12.894 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-11-28T11:12:12.897 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:12:12.938 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:12 +0000 (0:00:00.054) 0:06:48.956 ***** 2019-11-28T11:12:13.099 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-28T11:12:13.100 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1216, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-28T11:12:13.153 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:13 +0000 (0:00:00.214) 0:06:49.171 ***** 2019-11-28T11:12:13.419 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-11-28T11:12:13.421 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "md5sum": "286c682fc73965c17876891a4581da3e", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_tmp_t:s0", "size": 934, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939532.75-162186623646079/source", "state": "file", "uid": 0} 2019-11-28T11:12:13.486 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:13 +0000 (0:00:00.332) 0:06:49.503 ***** 2019-11-28T11:12:13.947 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-28T11:12:13.949 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-28T11:12:14.008 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:14 +0000 (0:00:00.522) 0:06:50.025 ***** 2019-11-28T11:12:14.157 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-11-28T11:12:14.158 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.014778", "end": "2019-11-28 11:12:14.131832", "rc": 0, "start": "2019-11-28 11:12:14.117054", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-28T11:12:14.214 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:14 +0000 (0:00:00.206) 0:06:50.231 ***** 2019-11-28T11:12:14.688 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-28T11:12:14.689 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-28T11:12:14.734 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:14 +0000 (0:00:00.520) 0:06:50.751 ***** 2019-11-28T11:12:14.885 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-11-28T11:12:14.887 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.010845", "end": "2019-11-28 11:12:14.859197", "rc": 0, "start": "2019-11-28 11:12:14.848352", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:12:14.934 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:14 +0000 (0:00:00.199) 0:06:50.951 ***** 2019-11-28T11:12:16.961 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.901638", "end": "2019-11-28 11:12:16.934562", "rc": 0, "start": "2019-11-28 11:12:15.032924", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:12:17.004 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:16 +0000 (0:00:02.070) 0:06:53.021 ***** 2019-11-28T11:12:25.352 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-11-28T11:12:25.353 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:08.197404", "end": "2019-11-28 11:12:25.325399", "rc": 0, "start": "2019-11-28 11:12:17.127995", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:12:25.400 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:25 +0000 (0:00:08.387) 0:07:01.409 ***** 2019-11-28T11:12:26.385 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-28T11:12:26.387 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'RHEL 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/'}, 'key': u'rhel-7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e6aba9c9ab05e27255ed430f065502af284a869b", "dest": "/etc/yum.repos.d/rhel-7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "rhel-7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "RHEL 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/rhel-7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 245, "state": "file", "uid": 0} 2019-11-28T11:12:26.389 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e3b44e00721d55ceb436a2b7c0ec58cd5bc39dc9", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 207, "state": "file", "uid": 0} 2019-11-28T11:12:26.431 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:26 +0000 (0:00:01.038) 0:07:02.448 ***** 2019-11-28T11:12:26.611 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-11-28T11:12:26.612 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-28T11:12:26.651 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:26 +0000 (0:00:00.221) 0:07:02.669 ***** 2019-11-28T11:12:26.659 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-28T11:12:26.698 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:26 +0000 (0:00:00.046) 0:07:02.716 ***** 2019-11-28T11:12:26.705 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-11-28T11:12:26.706 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-28T11:12:26.747 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:26 +0000 (0:00:00.048) 0:07:02.764 ***** 2019-11-28T11:12:26.753 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-11-28T11:12:26.755 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:12:26.793 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:26 +0000 (0:00:00.046) 0:07:02.811 ***** 2019-11-28T11:12:26.800 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-11-28T11:12:26.803 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-28T11:12:26.847 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:26 +0000 (0:00:00.053) 0:07:02.864 ***** 2019-11-28T11:12:26.853 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-11-28T11:12:26.855 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-28T11:12:26.898 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:26 +0000 (0:00:00.050) 0:07:02.915 ***** 2019-11-28T11:12:26.905 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-11-28T11:12:26.907 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/rhel7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}, "rhel-7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "RHEL 7 Local fastcgi Repo"}}, "epel_packages": ["cryptopp-devel", "cryptopp", "dbench", "fcgi", "fuse-sshfs", "perl-JSON-XS", "leveldb", "xmlstarlet"], "nfs_service": "nfs-server", "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "xfsprogs-devel", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "lvm2", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "ant", "lsof", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN", "podman"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml"} 2019-11-28T11:12:26.947 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:26 +0000 (0:00:00.048) 0:07:02.964 ***** 2019-11-28T11:12:26.954 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-11-28T11:12:26.956 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:12:27.003 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:26 +0000 (0:00:00.056) 0:07:03.021 ***** 2019-11-28T11:12:27.012 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-11-28T11:12:27.013 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-28T11:12:27.056 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:27 +0000 (0:00:00.052) 0:07:03.074 ***** 2019-11-28T11:12:27.065 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:12:27.067 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:12:27.111 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:27 +0000 (0:00:00.054) 0:07:03.129 ***** 2019-11-28T11:12:27.266 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-11-28T11:12:27.268 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-28T11:12:27.304 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:27 +0000 (0:00:00.193) 0:07:03.322 ***** 2019-11-28T11:12:30.846 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-28T11:12:30.848 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7 will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7 @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @rhel-7-server-r 2019-11-28T11:12:30.849 INFO:teuthology.task.ansible.out:pms 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 @rhel-7-server-rpms 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 @rhel-7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 3/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 4/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Verifying : iozone-3.424-2_ceph.el7.x86_64 6/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0: 2019-11-28T11:12:30.851 INFO:teuthology.task.ansible.out:3.424-2_ceph.el7 librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-28T11:12:30.886 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:30 +0000 (0:00:03.581) 0:07:06.904 ***** 2019-11-28T11:12:31.038 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-11-28T11:12:31.040 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "name": "ubuntu", "state": "present", "system": false} 2019-11-28T11:12:31.079 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:31 +0000 (0:00:00.192) 0:07:07.096 ***** 2019-11-28T11:12:31.628 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-11-28T11:12:31.629 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-52.el7.noarch providing yum-utils is already installed"]} 2019-11-28T11:12:31.667 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:31 +0000 (0:00:00.588) 0:07:07.685 ***** 2019-11-28T11:12:31.675 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-11-28T11:12:31.677 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:12:31.724 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:31 +0000 (0:00:00.047) 0:07:07.733 ***** 2019-11-28T11:12:33.902 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-11-28T11:12:33.903 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:02.024620", "end": "2019-11-28 11:12:33.873967", "rc": 0, "start": "2019-11-28 11:12:31.849347", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-\n : manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-", " : manager", "Loading mirror speeds from cached hostfile", " * epel: download-cc-rdu01.fedoraproject.org", "No unfinished transactions left."]} 2019-11-28T11:12:33.940 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:33 +0000 (0:00:02.225) 0:07:09.958 ***** 2019-11-28T11:12:33.947 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-11-28T11:12:33.949 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:12:33.987 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:33 +0000 (0:00:00.046) 0:07:10.004 ***** 2019-11-28T11:12:34.148 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-11-28T11:12:34.150 INFO:teuthology.task.ansible.out:fatal: [smithi076.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.023285", "end": "2019-11-28 11:12:34.125677", "msg": "non-zero return code", "rc": 1, "start": "2019-11-28 11:12:34.102392", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-28T11:12:34.187 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:34 +0000 (0:00:00.200) 0:07:10.205 ***** 2019-11-28T11:12:34.365 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-11-28T11:12:34.366 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-28T11:12:34.416 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:34 +0000 (0:00:00.228) 0:07:10.433 ***** 2019-11-28T11:12:34.423 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-11-28T11:12:34.425 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:12:34.462 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:34 +0000 (0:00:00.046) 0:07:10.480 ***** 2019-11-28T11:12:35.044 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-28T11:12:35.086 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:35 +0000 (0:00:00.618) 0:07:11.098 ***** 2019-11-28T11:12:42.304 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-11-28T11:12:42.305 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from rhel-7-server-rpms"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 rhel-7-server-rpms 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 rhel-7-server-rpms 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 2019-11-28T11:12:42.307 INFO:teuthology.task.ansible.out: 33 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-11-28T11:12:42.347 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:42 +0000 (0:00:07.266) 0:07:18.364 ***** 2019-11-28T11:12:42.353 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-11-28T11:12:42.354 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi016"}, "changed": false} 2019-11-28T11:12:42.392 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:42 +0000 (0:00:00.045) 0:07:18.410 ***** 2019-11-28T11:12:42.685 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-11-28T11:12:42.688 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-11-28T11:12:42.726 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:42 +0000 (0:00:00.333) 0:07:18.743 ***** 2019-11-28T11:12:43.011 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-11-28T11:12:43.012 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi016", "ansible_hostname": "smithi016", "ansible_nodename": "smithi016"}, "changed": false, "name": "smithi016"} 2019-11-28T11:12:43.052 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:43 +0000 (0:00:00.325) 0:07:19.069 ***** 2019-11-28T11:12:43.172 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-28T11:12:43.175 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7 will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7 @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @rhel-7-server-r 2019-11-28T11:12:43.176 INFO:teuthology.task.ansible.out:pms 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 @rhel-7-server-rpms 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 @rhel-7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 3/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 4/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Verifying : iozone-3.424-2_ceph.el7.x86_64 6/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0: 2019-11-28T11:12:43.178 INFO:teuthology.task.ansible.out:3.424-2_ceph.el7 librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-28T11:12:43.214 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:43 +0000 (0:00:00.162) 0:07:19.232 ***** 2019-11-28T11:12:43.709 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-11-28T11:12:43.710 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2019-11-28T11:12:43.749 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:43 +0000 (0:00:00.534) 0:07:19.766 ***** 2019-11-28T11:12:50.592 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-11-28T11:12:50.596 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.407369", "end": "2019-11-28 11:12:50.566320", "failed_when_result": false, "rc": 0, "start": "2019-11-28 11:12:43.158951", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-28T11:12:50.635 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:50 +0000 (0:00:06.886) 0:07:26.653 ***** 2019-11-28T11:12:51.132 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-28T11:12:51.161 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:51 +0000 (0:00:00.525) 0:07:27.178 ***** 2019-11-28T11:12:51.774 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-11-28T11:12:51.776 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "md5sum": "286c682fc73965c17876891a4581da3e", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_tmp_t:s0", "size": 934, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574939571.14-276557815086900/source", "state": "file", "uid": 0} 2019-11-28T11:12:51.815 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:51 +0000 (0:00:00.653) 0:07:27.832 ***** 2019-11-28T11:12:52.363 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-11-28T11:12:52.364 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-28T11:12:52.403 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:52 +0000 (0:00:00.588) 0:07:28.421 ***** 2019-11-28T11:12:52.564 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-11-28T11:12:52.565 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.009707", "end": "2019-11-28 11:12:52.528133", "rc": 0, "start": "2019-11-28 11:12:52.518426", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-28T11:12:52.606 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:52 +0000 (0:00:00.202) 0:07:28.623 ***** 2019-11-28T11:12:53.008 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-28T11:12:53.010 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7 will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7 @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @rhel-7-server-r 2019-11-28T11:12:53.011 INFO:teuthology.task.ansible.out:pms 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 @rhel-7-server-rpms 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 @rhel-7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 3/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 4/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Verifying : iozone-3.424-2_ceph.el7.x86_64 6/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0: 2019-11-28T11:12:53.013 INFO:teuthology.task.ansible.out:3.424-2_ceph.el7 librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-28T11:12:53.054 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:53 +0000 (0:00:00.447) 0:07:29.071 ***** 2019-11-28T11:12:53.132 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-11-28T11:12:53.134 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-28T11:12:53.176 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:53 +0000 (0:00:00.122) 0:07:29.193 ***** 2019-11-28T11:12:53.235 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-11-28T11:12:53.236 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.033031", "end": "2019-11-28 11:12:53.212031", "rc": 0, "start": "2019-11-28 11:12:53.179000", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:12:53.292 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:53 +0000 (0:00:00.115) 0:07:29.309 ***** 2019-11-28T11:12:53.427 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-28T11:12:53.429 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-28T11:12:53.483 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:12:53 +0000 (0:00:00.188) 0:07:29.498 ***** 2019-11-28T11:13:01.068 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-11-28T11:13:01.070 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.464165", "end": "2019-11-28 11:13:01.040011", "rc": 0, "start": "2019-11-28 11:12:53.575846", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:13:01.110 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:01 +0000 (0:00:07.628) 0:07:37.127 ***** 2019-11-28T11:13:01.269 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-28T11:13:01.275 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "kvm", "state": "present", "system": false} 2019-11-28T11:13:01.307 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:01 +0000 (0:00:00.197) 0:07:37.325 ***** 2019-11-28T11:13:01.472 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-28T11:13:01.511 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:01 +0000 (0:00:00.204) 0:07:37.529 ***** 2019-11-28T11:13:01.675 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-28T11:13:01.676 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1216, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-28T11:13:01.720 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:01 +0000 (0:00:00.206) 0:07:37.735 ***** 2019-11-28T11:13:01.728 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-28T11:13:01.766 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:01 +0000 (0:00:00.048) 0:07:37.783 ***** 2019-11-28T11:13:02.270 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-28T11:13:02.271 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-28T11:13:02.313 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:02 +0000 (0:00:00.547) 0:07:38.331 ***** 2019-11-28T11:13:02.322 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-11-28T11:13:02.323 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-28T11:13:02.372 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:02 +0000 (0:00:00.058) 0:07:38.389 ***** 2019-11-28T11:13:02.875 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-28T11:13:02.876 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-28T11:13:02.926 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:02 +0000 (0:00:00.553) 0:07:38.943 ***** 2019-11-28T11:13:02.935 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-11-28T11:13:02.938 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/rhel7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}, "rhel-7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "RHEL 7 Local fastcgi Repo"}}, "epel_packages": ["cryptopp-devel", "cryptopp", "dbench", "fcgi", "fuse-sshfs", "perl-JSON-XS", "leveldb", "xmlstarlet"], "nfs_service": "nfs-server", "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "xfsprogs-devel", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "lvm2", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "ant", "lsof", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN", "podman"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_7.yml"} 2019-11-28T11:13:02.982 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:02 +0000 (0:00:00.056) 0:07:38.999 ***** 2019-11-28T11:13:04.115 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-28T11:13:04.117 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "leveldb", "xmlstarlet", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n---> Package leveldb.x86_64 0:1.12.0-11.el7 will be erased\n---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @rhel-7-server-rpms 28 k\n leveldb x86_64 1.12.0-11.el7 @epel 439 k\n xmlstarlet x86_64 1.6.1-1.el7 @epel 192 k\n\nTransaction Summary\n================================================================================\nRemove 3 Packages\n\nInstalled size: 659 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : xmlstarlet-1.6.1-1.el7.x86_64 1/3 \n Erasing : leveldb-1.12.0-11.el7.x86_64 2/3 \n Erasing : boost-random-1.53.0-27.el7.x86_64 2019-11-28T11:13:04.119 INFO:teuthology.task.ansible.out: 3/3 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/3 \n Verifying : leveldb-1.12.0-11.el7.x86_64 2/3 \n Verifying : xmlstarlet-1.6.1-1.el7.x86_64 3/3 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 leveldb.x86_64 0:1.12.0-11.el7 \n xmlstarlet.x86_64 0:1.6.1-1.el7 \n\nComplete!\n"]} 2019-11-28T11:13:04.161 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:04 +0000 (0:00:01.179) 0:07:40.179 ***** 2019-11-28T11:13:04.167 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-11-28T11:13:04.169 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-28T11:13:04.209 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:04 +0000 (0:00:00.048) 0:07:40.227 ***** 2019-11-28T11:13:05.098 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-28T11:13:05.100 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.969115", "end": "2019-11-28 11:13:05.058123", "rc": 0, "start": "2019-11-28 11:13:03.089008", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:13:05.140 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:05 +0000 (0:00:00.930) 0:07:41.157 ***** 2019-11-28T11:13:05.288 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-11-28T11:13:05.293 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-28T11:13:05.335 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:05 +0000 (0:00:00.194) 0:07:41.352 ***** 2019-11-28T11:13:06.396 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-28T11:13:06.398 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'RHEL 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/'}, 'key': u'rhel-7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e6aba9c9ab05e27255ed430f065502af284a869b", "dest": "/etc/yum.repos.d/rhel-7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "rhel-7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "RHEL 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/rhel-7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 245, "state": "file", "uid": 0} 2019-11-28T11:13:06.400 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e3b44e00721d55ceb436a2b7c0ec58cd5bc39dc9", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 207, "state": "file", "uid": 0} 2019-11-28T11:13:06.472 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:06 +0000 (0:00:01.138) 0:07:42.490 ***** 2019-11-28T11:13:06.589 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-11-28T11:13:06.591 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "name": "ubuntu", "state": "present", "system": false} 2019-11-28T11:13:06.648 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:06 +0000 (0:00:00.175) 0:07:42.665 ***** 2019-11-28T11:13:06.655 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-28T11:13:06.695 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:06 +0000 (0:00:00.047) 0:07:42.713 ***** 2019-11-28T11:13:06.703 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-11-28T11:13:06.706 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:13:06.748 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:06 +0000 (0:00:00.051) 0:07:42.764 ***** 2019-11-28T11:13:06.757 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-11-28T11:13:06.758 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:13:06.814 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:06 +0000 (0:00:00.067) 0:07:42.832 ***** 2019-11-28T11:13:06.822 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-11-28T11:13:06.824 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:13:06.866 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:06 +0000 (0:00:00.051) 0:07:42.883 ***** 2019-11-28T11:13:06.874 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-11-28T11:13:06.876 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-28T11:13:06.921 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:06 +0000 (0:00:00.054) 0:07:42.938 ***** 2019-11-28T11:13:07.070 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-11-28T11:13:07.072 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-28T11:13:07.114 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:07 +0000 (0:00:00.190) 0:07:43.129 ***** 2019-11-28T11:13:07.123 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:13:07.158 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:07 +0000 (0:00:00.046) 0:07:43.175 ***** 2019-11-28T11:13:07.764 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-11-28T11:13:07.765 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-28T11:13:07.805 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:07 +0000 (0:00:00.646) 0:07:43.822 ***** 2019-11-28T11:13:07.812 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:13:07.815 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:13:07.857 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:07 +0000 (0:00:00.052) 0:07:43.875 ***** 2019-11-28T11:13:07.865 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-11-28T11:13:07.867 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi174"}, "changed": false} 2019-11-28T11:13:07.907 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:07 +0000 (0:00:00.049) 0:07:43.924 ***** 2019-11-28T11:13:12.024 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-11-28T11:13:12.026 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-52.el7.noarch providing yum-utils is already installed"]} 2019-11-28T11:13:12.081 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:12 +0000 (0:00:04.170) 0:07:48.095 ***** 2019-11-28T11:13:12.369 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-11-28T11:13:12.371 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi174.front.sepia.ceph.com", "ansible_hostname": "smithi174", "ansible_nodename": "smithi174"}, "changed": false, "name": "smithi174"} 2019-11-28T11:13:12.430 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:12 +0000 (0:00:00.352) 0:07:48.447 ***** 2019-11-28T11:13:14.601 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-11-28T11:13:14.603 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:02.014280", "end": "2019-11-28 11:13:14.566830", "rc": 0, "start": "2019-11-28 11:13:12.552550", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-\n : manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-", " : manager", "Loading mirror speeds from cached hostfile", " * epel: download-cc-rdu01.fedoraproject.org", "No unfinished transactions left."]} 2019-11-28T11:13:14.646 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:14 +0000 (0:00:02.216) 0:07:50.664 ***** 2019-11-28T11:13:14.683 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-28T11:13:14.685 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7 will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7 @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @rhel-7-server-r 2019-11-28T11:13:14.686 INFO:teuthology.task.ansible.out:pms 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 @rhel-7-server-rpms 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 @rhel-7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 3/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 4/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Verifying : iozone-3.424-2_ceph.el7.x86_64 6/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0: 2019-11-28T11:13:14.688 INFO:teuthology.task.ansible.out:3.424-2_ceph.el7 librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-28T11:13:14.727 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:14 +0000 (0:00:00.080) 0:07:50.744 ***** 2019-11-28T11:13:14.898 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-11-28T11:13:14.900 INFO:teuthology.task.ansible.out:fatal: [smithi016.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.025458", "end": "2019-11-28 11:13:14.870258", "msg": "non-zero return code", "rc": 1, "start": "2019-11-28 11:13:14.844800", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-28T11:13:14.944 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:14 +0000 (0:00:00.216) 0:07:50.961 ***** 2019-11-28T11:13:15.119 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-11-28T11:13:15.121 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2019-11-28T11:13:15.178 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:15 +0000 (0:00:00.234) 0:07:51.195 ***** 2019-11-28T11:13:15.186 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-11-28T11:13:15.188 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:13:15.230 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:15 +0000 (0:00:00.052) 0:07:51.248 ***** 2019-11-28T11:13:15.714 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-11-28T11:13:15.716 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-28T11:13:15.774 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:15 +0000 (0:00:00.538) 0:07:51.787 ***** 2019-11-28T11:13:17.053 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-28T11:13:17.055 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "leveldb", "xmlstarlet", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n---> Package leveldb.x86_64 0:1.12.0-11.el7 will be erased\n---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @rhel-7-server-rpms 28 k\n leveldb x86_64 1.12.0-11.el7 @epel 439 k\n xmlstarlet x86_64 1.6.1-1.el7 @epel 192 k\n\nTransaction Summary\n================================================================================\nRemove 3 Packages\n\nInstalled size: 659 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : xmlstarlet-1.6.1-1.el7.x86_64 1/3 \n Erasing : leveldb-1.12.0-11.el7.x86_64 2/3 \n Erasing : boost-random-1.53.0-27.el7.x86_64 2019-11-28T11:13:17.056 INFO:teuthology.task.ansible.out: 3/3 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/3 \n Verifying : leveldb-1.12.0-11.el7.x86_64 2/3 \n Verifying : xmlstarlet-1.6.1-1.el7.x86_64 3/3 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 leveldb.x86_64 0:1.12.0-11.el7 \n xmlstarlet.x86_64 0:1.6.1-1.el7 \n\nComplete!\n"]} 2019-11-28T11:13:17.097 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:17 +0000 (0:00:01.327) 0:07:53.114 ***** 2019-11-28T11:13:17.671 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-11-28T11:13:17.672 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-28T11:13:17.751 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:17 +0000 (0:00:00.653) 0:07:53.768 ***** 2019-11-28T11:13:25.824 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-28T11:13:25.826 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "leveldb", "xmlstarlet", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n---> Package leveldb.x86_64 0:1.12.0-11.el7 will be erased\n---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @rhel-7-server-rpms 28 k\n leveldb x86_64 1.12.0-11.el7 @epel 439 k\n xmlstarlet x86_64 1.6.1-1.el7 @epel 192 k\n\nTransaction Summary\n================================================================================\nRemove 3 Packages\n\nInstalled size: 659 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : xmlstarlet-1.6.1-1.el7.x86_64 1/3 \n Erasing : leveldb-1.12.0-11.el7.x86_64 2/3 \n Erasing : boost-random-1.53.0-27.el7.x86_64 2019-11-28T11:13:25.828 INFO:teuthology.task.ansible.out: 3/3 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/3 \n Verifying : leveldb-1.12.0-11.el7.x86_64 2/3 \n Verifying : xmlstarlet-1.6.1-1.el7.x86_64 3/3 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 leveldb.x86_64 0:1.12.0-11.el7 \n xmlstarlet.x86_64 0:1.6.1-1.el7 \n\nComplete!\n"]} 2019-11-28T11:13:25.873 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:25 +0000 (0:00:08.120) 0:08:01.889 ***** 2019-11-28T11:13:26.362 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-11-28T11:13:26.364 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-28T11:13:26.417 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:26 +0000 (0:00:00.545) 0:08:02.434 ***** 2019-11-28T11:13:40.657 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-28T11:13:40.659 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "leveldb", "xmlstarlet", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n---> Package leveldb.x86_64 0:1.12.0-11.el7 will be erased\n---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @rhel-7-server-rpms 28 k\n leveldb x86_64 1.12.0-11.el7 @epel 439 k\n xmlstarlet x86_64 1.6.1-1.el7 @epel 192 k\n\nTransaction Summary\n================================================================================\nRemove 3 Packages\n\nInstalled size: 659 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : xmlstarlet-1.6.1-1.el7.x86_64 1/3 \n Erasing : leveldb-1.12.0-11.el7.x86_64 2/3 \n Erasing : boost-random-1.53.0-27.el7.x86_64 2019-11-28T11:13:40.660 INFO:teuthology.task.ansible.out: 3/3 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/3 \n Verifying : leveldb-1.12.0-11.el7.x86_64 2/3 \n Verifying : xmlstarlet-1.6.1-1.el7.x86_64 3/3 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 leveldb.x86_64 0:1.12.0-11.el7 \n xmlstarlet.x86_64 0:1.6.1-1.el7 \n\nComplete!\n"]} 2019-11-28T11:13:40.703 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:40 +0000 (0:00:14.286) 0:08:16.721 ***** 2019-11-28T11:13:40.855 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-28T11:13:40.857 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-28T11:13:40.901 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:40 +0000 (0:00:00.198) 0:08:16.919 ***** 2019-11-28T11:13:49.084 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7 will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7 @lab-extras 2019-11-28T11:13:49.086 INFO:teuthology.task.ansible.out: 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @rhel-7-server-rpms 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 @rhel-7-server-rpms 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 @rhel-7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 3/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 4/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Verifying : iozone-3.424-2_ceph.el7.x86_64 6/7 \n Verifying : 10:qemu-img-1 2019-11-28T11:13:49.088 INFO:teuthology.task.ansible.out:.5.3-167.el7_7.1.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7 librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-28T11:13:49.131 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:49 +0000 (0:00:08.229) 0:08:25.148 ***** 2019-11-28T11:13:49.267 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-28T11:13:49.269 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "kvm", "state": "present", "system": false} 2019-11-28T11:13:49.309 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:13:49 +0000 (0:00:00.178) 0:08:25.326 ***** 2019-11-28T11:14:21.499 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-28T11:14:21.501 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "leveldb", "xmlstarlet", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n---> Package leveldb.x86_64 0:1.12.0-11.el7 will be erased\n---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @rhel-7-server-rpms 28 k\n leveldb x86_64 1.12.0-11.el7 @epel 439 k\n xmlstarlet x86_64 1.6.1-1.el7 @epel 192 k\n\nTransaction Summary\n================================================================================\nRemove 3 Packages\n\nInstalled size: 659 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : xmlstarlet-1.6.1-1.el7.x86_64 1/3 \n Erasing : leveldb-1.12.0-11.el7.x86_64 2/3 \n Erasing : boost-random-1.53.0-27.el7.x86_64 2019-11-28T11:14:21.503 INFO:teuthology.task.ansible.out: 3/3 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/3 \n Verifying : leveldb-1.12.0-11.el7.x86_64 2/3 \n Verifying : xmlstarlet-1.6.1-1.el7.x86_64 3/3 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 leveldb.x86_64 0:1.12.0-11.el7 \n xmlstarlet.x86_64 0:1.6.1-1.el7 \n\nComplete!\n"]} 2019-11-28T11:14:21.542 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:14:21 +0000 (0:00:32.232) 0:08:57.559 ***** 2019-11-28T11:14:21.717 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-28T11:14:21.718 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1216, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-28T11:14:21.761 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:14:21 +0000 (0:00:00.219) 0:08:57.779 ***** 2019-11-28T11:15:35.322 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T11:15:35.326 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7"]}, "msg": "Warning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-52.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-18.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-115.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed", "parted-3.1-31.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "7:lvm2-2.02.185-2.el7.x86_64 providing lvm2 is already installed", "1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed", "attr-2.4.46- 2019-11-28T11:15:35.328 INFO:teuthology.task.ansible.out:13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "lsof-4.87-6.el7.x86_64 providing lsof is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "n 2019-11-28T11:15:35.330 INFO:teuthology.task.ansible.out:curses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "podman-1.4.4-4.el7.x86_64 providing podman is already installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7 will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Versi 2019-11-28T11:15:35.332 INFO:teuthology.task.ansible.out:on Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7 lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 rhel-7-server-rpms 39 k\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 24 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.x86_64 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5- 2019-11-28T11:15:35.334 INFO:teuthology.task.ansible.out:4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 3/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 4/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/8 \n Verifying : iozone-3.424-2_ceph.el7.x86_64 6/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 7/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7 mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-28T11:15:35.380 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:35 +0000 (0:01:13.619) 0:10:11.398 ***** 2019-11-28T11:15:37.221 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-28T11:15:37.224 INFO:teuthology.task.ansible.out: 2019-11-28T11:15:37.276 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:37 +0000 (0:00:01.895) 0:10:13.293 ***** 2019-11-28T11:15:42.816 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T11:15:42.819 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7"]}, "msg": "Warning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-52.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-18.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-115.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed", "parted-3.1-31.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "7:lvm2-2.02.185-2.el7.x86_64 providing lvm2 is already installed", "1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed", "attr-2.4.46- 2019-11-28T11:15:42.821 INFO:teuthology.task.ansible.out:13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "lsof-4.87-6.el7.x86_64 providing lsof is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "n 2019-11-28T11:15:42.825 INFO:teuthology.task.ansible.out:curses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "podman-1.4.4-4.el7.x86_64 providing podman is already installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7 will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Versi 2019-11-28T11:15:42.828 INFO:teuthology.task.ansible.out:on Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7 lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 rhel-7-server-rpms 39 k\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 25 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.x86_64 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5- 2019-11-28T11:15:42.830 INFO:teuthology.task.ansible.out:4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 3/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 4/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/8 \n Verifying : iozone-3.424-2_ceph.el7.x86_64 6/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 7/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7 mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-28T11:15:42.869 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:42 +0000 (0:00:05.591) 0:10:18.885 ***** 2019-11-28T11:15:43.367 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-28T11:15:43.441 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:43 +0000 (0:00:00.573) 0:10:19.458 ***** 2019-11-28T11:15:47.293 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7"]}, "msg": "Warning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-52.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-18.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-115.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed", "parted-3.1-31.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "7:lvm2-2.02.185-2.el7.x86_64 providing lvm2 is already installed", "1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs 2019-11-28T11:15:47.295 INFO:teuthology.task.ansible.out:-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "lsof-4.87-6.el7.x86_64 providing lsof is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed", "junit-4.11-8.el7.noarch providing junit4 is already installe 2019-11-28T11:15:47.296 INFO:teuthology.task.ansible.out:d", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "podman-1.4.4-4.el7.x86_64 providing podman is already installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7 will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n=============================== 2019-11-28T11:15:47.298 INFO:teuthology.task.ansible.out:=================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7 lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 rhel-7-server-rpms 39 k\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 26 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.x86_64 7/8 \n Installing : mod_fastcgi-2.4 2019-11-28T11:15:47.300 INFO:teuthology.task.ansible.out:.7-1.ceph.el7.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 3/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 4/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/8 \n Verifying : iozone-3.424-2_ceph.el7.x86_64 6/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 7/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7 mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-28T11:15:47.349 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:47 +0000 (0:00:03.902) 0:10:23.361 ***** 2019-11-28T11:15:49.245 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.774705", "end": "2019-11-28 11:15:49.212382", "rc": 0, "start": "2019-11-28 11:15:47.437677", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:15:49.306 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:49 +0000 (0:00:01.962) 0:10:25.324 ***** 2019-11-28T11:15:52.041 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-11-28T11:15:52.042 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": ["leveldb", "xmlstarlet"]}, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed\n---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n leveldb x86_64 1.12.0-11.el7 epel 161 k\n xmlstarlet x86_64 1.6.1-1.el7 epel 62 k\n\nTransaction Summary\n================================================================================\nInstall 2 Packages\n\nTotal download size: 223 k\nInstalled size: 631 k\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 547 kB/s | 223 kB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : xmlstarlet-1.6.1-1.el7.x86_64 2019-11-28T11:15:52.044 INFO:teuthology.task.ansible.out: 1/2 \n Installing : leveldb-1.12.0-11.el7.x86_64 2/2 \n Verifying : leveldb-1.12.0-11.el7.x86_64 1/2 \n Verifying : xmlstarlet-1.6.1-1.el7.x86_64 2/2 \n\nInstalled:\n leveldb.x86_64 0:1.12.0-11.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 \n\nComplete!\n"]} 2019-11-28T11:15:52.120 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:52 +0000 (0:00:02.813) 0:10:28.137 ***** 2019-11-28T11:15:53.129 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-28T11:15:53.131 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'RHEL 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/'}, 'key': u'rhel-7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e6aba9c9ab05e27255ed430f065502af284a869b", "dest": "/etc/yum.repos.d/rhel-7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "rhel-7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "RHEL 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/rhel-7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 245, "state": "file", "uid": 0} 2019-11-28T11:15:53.132 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e3b44e00721d55ceb436a2b7c0ec58cd5bc39dc9", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 207, "state": "file", "uid": 0} 2019-11-28T11:15:53.174 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:53 +0000 (0:00:01.054) 0:10:29.192 ***** 2019-11-28T11:15:54.517 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-28T11:15:54.519 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-28T11:15:54.556 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:54 +0000 (0:00:01.381) 0:10:30.573 ***** 2019-11-28T11:15:54.566 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-28T11:15:54.612 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:54 +0000 (0:00:00.054) 0:10:30.628 ***** 2019-11-28T11:15:54.623 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:15:54.665 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:54 +0000 (0:00:00.049) 0:10:30.678 ***** 2019-11-28T11:15:54.669 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-11-28T11:15:54.672 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:15:54.709 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:54 +0000 (0:00:00.048) 0:10:30.727 ***** 2019-11-28T11:15:54.883 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7"]}, "msg": "Warning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-52.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-18.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-115.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed", "parted-3.1-31.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "7:lvm2-2.02.185-2.el7.x86_64 providing lvm2 is already installed", "1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs 2019-11-28T11:15:54.886 INFO:teuthology.task.ansible.out:-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "lsof-4.87-6.el7.x86_64 providing lsof is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed", "junit-4.11-8.el7.noarch providing junit4 is already installe 2019-11-28T11:15:54.890 INFO:teuthology.task.ansible.out:d", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "podman-1.4.4-4.el7.x86_64 providing podman is already installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7 will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n=============================== 2019-11-28T11:15:54.892 INFO:teuthology.task.ansible.out:=================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7 lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 rhel-7-server-rpms 39 k\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 25 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.x86_64 7/8 \n Installing : mod_fastcgi-2.4 2019-11-28T11:15:54.894 INFO:teuthology.task.ansible.out:.7-1.ceph.el7.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 3/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 4/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/8 \n Verifying : iozone-3.424-2_ceph.el7.x86_64 6/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 7/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7 mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-28T11:15:54.932 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:54 +0000 (0:00:00.222) 0:10:30.950 ***** 2019-11-28T11:15:54.941 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-11-28T11:15:54.943 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service basic.target dbus.service system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ebtables.service ip6tables.service ipset.service iptables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-28T11:15:54.946 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-28T11:15:54.949 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi174.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-28T11:15:55.017 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:55 +0000 (0:00:00.084) 0:10:31.034 ***** 2019-11-28T11:15:55.069 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:55 +0000 (0:00:00.043) 0:10:31.078 ***** 2019-11-28T11:15:55.278 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi075.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-28T11:15:55.325 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:55 +0000 (0:00:00.264) 0:10:31.342 ***** 2019-11-28T11:15:55.333 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:15:55.376 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:55 +0000 (0:00:00.048) 0:10:31.390 ***** 2019-11-28T11:15:56.085 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-11-28T11:15:56.117 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:56 +0000 (0:00:00.743) 0:10:32.134 ***** 2019-11-28T11:15:56.128 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:15:56.129 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:15:56.174 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:56 +0000 (0:00:00.057) 0:10:32.192 ***** 2019-11-28T11:15:56.180 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-11-28T11:15:56.183 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:15:56.222 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:56 +0000 (0:00:00.047) 0:10:32.239 ***** 2019-11-28T11:15:57.401 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-11-28T11:15:57.403 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": ["leveldb", "xmlstarlet"]}, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed\n---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n leveldb x86_64 1.12.0-11.el7 epel 161 k\n xmlstarlet x86_64 1.6.1-1.el7 epel 62 k\n\nTransaction Summary\n================================================================================\nInstall 2 Packages\n\nTotal download size: 223 k\nInstalled size: 631 k\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 562 kB/s | 223 kB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : xmlstarlet-1.6.1-1.el7.x86_64 2019-11-28T11:15:57.405 INFO:teuthology.task.ansible.out: 1/2 \n Installing : leveldb-1.12.0-11.el7.x86_64 2/2 \n Verifying : leveldb-1.12.0-11.el7.x86_64 1/2 \n Verifying : xmlstarlet-1.6.1-1.el7.x86_64 2/2 \n\nInstalled:\n leveldb.x86_64 0:1.12.0-11.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 \n\nComplete!\n"]} 2019-11-28T11:15:57.448 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:57 +0000 (0:00:01.225) 0:10:33.465 ***** 2019-11-28T11:15:57.456 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-11-28T11:15:57.499 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:57 +0000 (0:00:00.048) 0:10:33.514 ***** 2019-11-28T11:15:58.170 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-52.el7.noarch providing yum-utils is already installed"]} 2019-11-28T11:15:58.228 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:58 +0000 (0:00:00.731) 0:10:34.245 ***** 2019-11-28T11:15:58.236 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-11-28T11:15:58.237 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:15:58.302 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:58 +0000 (0:00:00.074) 0:10:34.320 ***** 2019-11-28T11:15:59.112 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-28T11:15:59.113 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-28T11:15:59.159 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:59 +0000 (0:00:00.856) 0:10:35.176 ***** 2019-11-28T11:15:59.166 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-11-28T11:15:59.168 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:15:59.207 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:59 +0000 (0:00:00.048) 0:10:35.225 ***** 2019-11-28T11:15:59.215 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-28T11:15:59.217 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:15:59.260 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:59 +0000 (0:00:00.052) 0:10:35.277 ***** 2019-11-28T11:15:59.268 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* skipping: [smithi075.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-28T11:15:59.269 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-28T11:15:59.310 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:59 +0000 (0:00:00.049) 0:10:35.327 ***** 2019-11-28T11:15:59.530 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-11-28T11:15:59.532 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.service basic.target system.slice polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ipset.service ebtables.service shutdown.target ip6tables.service iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-28T11:15:59.534 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-28T11:15:59.535 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "system.slice network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T11:15:59.577 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:59 +0000 (0:00:00.263) 0:10:35.591 ***** 2019-11-28T11:15:59.581 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:15:59.629 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:59 +0000 (0:00:00.055) 0:10:35.646 ***** 2019-11-28T11:15:59.665 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-11-28T11:15:59.666 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:01.234526", "end": "2019-11-28 11:15:59.631611", "rc": 0, "start": "2019-11-28 11:15:58.397085", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-\n : manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, subscription-", " : manager", "Loading mirror speeds from cached hostfile", " * epel: download-cc-rdu01.fedoraproject.org", "No unfinished transactions left."]} 2019-11-28T11:15:59.712 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:59 +0000 (0:00:00.077) 0:10:35.724 ***** 2019-11-28T11:15:59.715 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-11-28T11:15:59.770 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:59 +0000 (0:00:00.062) 0:10:35.786 ***** 2019-11-28T11:15:59.819 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-11-28T11:15:59.821 INFO:teuthology.task.ansible.out:fatal: [smithi133.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-28T11:15:59.859 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:59 +0000 (0:00:00.089) 0:10:35.876 ***** 2019-11-28T11:15:59.865 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-11-28T11:15:59.867 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:15:59.906 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:59 +0000 (0:00:00.045) 0:10:35.921 ***** 2019-11-28T11:15:59.928 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-11-28T11:15:59.930 INFO:teuthology.task.ansible.out:fatal: [smithi174.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.023140", "end": "2019-11-28 11:15:59.897181", "msg": "non-zero return code", "rc": 1, "start": "2019-11-28 11:15:59.874041", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-28T11:15:59.966 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:15:59 +0000 (0:00:00.062) 0:10:35.984 ***** 2019-11-28T11:15:59.973 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-11-28T11:15:59.975 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.033 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.066) 0:10:36.050 ***** 2019-11-28T11:16:00.041 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-11-28T11:16:00.043 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.086 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.052) 0:10:36.103 ***** 2019-11-28T11:16:00.091 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-11-28T11:16:00.101 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-11-28T11:16:00.138 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.050) 0:10:36.154 ***** 2019-11-28T11:16:00.177 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.040) 0:10:36.195 ***** 2019-11-28T11:16:00.183 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-28T11:16:00.185 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.223 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.045) 0:10:36.241 ***** 2019-11-28T11:16:00.230 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-11-28T11:16:00.232 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.270 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.047) 0:10:36.288 ***** 2019-11-28T11:16:00.277 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-11-28T11:16:00.278 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.315 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.044) 0:10:36.332 ***** 2019-11-28T11:16:00.321 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-11-28T11:16:00.359 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.044) 0:10:36.377 ***** 2019-11-28T11:16:00.368 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T11:16:00.370 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.404 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.045) 0:10:36.422 ***** 2019-11-28T11:16:00.411 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-11-28T11:16:00.413 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.450 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.045) 0:10:36.468 ***** 2019-11-28T11:16:00.466 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-11-28T11:16:00.470 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.502 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.052) 0:10:36.520 ***** 2019-11-28T11:16:00.509 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-11-28T11:16:00.512 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.548 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.045) 0:10:36.565 ***** 2019-11-28T11:16:00.554 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-11-28T11:16:00.556 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.597 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.049) 0:10:36.615 ***** 2019-11-28T11:16:00.604 INFO:teuthology.task.ansible.out: 2019-11-28T11:16:00.606 INFO:teuthology.task.ansible.out:TASK [testnode : Install apt keys] ********************************************* skipping: [smithi133.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.646 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.048) 0:10:36.663 ***** 2019-11-28T11:16:00.652 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-11-28T11:16:00.654 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.690 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.044) 0:10:36.708 ***** 2019-11-28T11:16:00.705 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.740 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.046) 0:10:36.754 ***** 2019-11-28T11:16:00.745 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-11-28T11:16:00.746 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.784 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.046) 0:10:36.801 ***** 2019-11-28T11:16:00.791 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-11-28T11:16:00.830 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.046) 0:10:36.847 ***** 2019-11-28T11:16:00.853 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.877 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.047) 0:10:36.895 ***** 2019-11-28T11:16:00.885 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.924 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.046) 0:10:36.941 ***** 2019-11-28T11:16:00.929 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-11-28T11:16:00.931 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:00.970 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:00 +0000 (0:00:00.046) 0:10:36.987 ***** 2019-11-28T11:16:00.977 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-11-28T11:16:00.979 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:01.016 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:01 +0000 (0:00:00.046) 0:10:37.034 ***** 2019-11-28T11:16:01.024 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-11-28T11:16:01.026 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:01.066 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:01 +0000 (0:00:00.049) 0:10:37.083 ***** 2019-11-28T11:16:01.073 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-11-28T11:16:01.075 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:01.113 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:01 +0000 (0:00:00.045) 0:10:37.129 ***** 2019-11-28T11:16:01.119 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-11-28T11:16:01.124 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:01.165 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:01 +0000 (0:00:00.048) 0:10:37.178 ***** 2019-11-28T11:16:01.180 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:01.229 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:01 +0000 (0:00:00.067) 0:10:37.246 ***** 2019-11-28T11:16:01.238 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:01.275 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:01 +0000 (0:00:00.045) 0:10:37.292 ***** 2019-11-28T11:16:01.281 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-11-28T11:16:01.283 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:01.320 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:01 +0000 (0:00:00.045) 0:10:37.337 ***** 2019-11-28T11:16:01.326 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-28T11:16:01.328 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:01.369 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:01 +0000 (0:00:00.049) 0:10:37.387 ***** 2019-11-28T11:16:01.376 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T11:16:01.379 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:01.414 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:01 +0000 (0:00:00.045) 0:10:37.432 ***** 2019-11-28T11:16:01.421 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-28T11:16:01.423 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:01.460 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:01 +0000 (0:00:00.045) 0:10:37.477 ***** 2019-11-28T11:16:01.467 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-11-28T11:16:01.469 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:01.504 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:01 +0000 (0:00:00.044) 0:10:37.522 ***** 2019-11-28T11:16:01.513 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-28T11:16:01.515 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:01.553 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:01 +0000 (0:00:00.048) 0:10:37.570 ***** 2019-11-28T11:16:01.559 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-11-28T11:16:01.561 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:01.608 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:01 +0000 (0:00:00.046) 0:10:37.617 ***** TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-28T11:16:01.615 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:01.651 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:01 +0000 (0:00:00.052) 0:10:37.669 ***** 2019-11-28T11:16:01.659 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-11-28T11:16:01.665 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:01.701 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:01 +0000 (0:00:00.049) 0:10:37.718 ***** 2019-11-28T11:16:01.836 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-28T11:16:01.838 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.025 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.324) 0:10:38.042 ***** 2019-11-28T11:16:02.040 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.073 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.048) 0:10:38.091 ***** 2019-11-28T11:16:02.080 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-28T11:16:02.082 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.118 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.044) 0:10:38.135 ***** 2019-11-28T11:16:02.125 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-11-28T11:16:02.126 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.166 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.048) 0:10:38.184 ***** 2019-11-28T11:16:02.174 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-28T11:16:02.175 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.217 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.050) 0:10:38.234 ***** 2019-11-28T11:16:02.225 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-11-28T11:16:02.227 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.275 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.058) 0:10:38.293 ***** 2019-11-28T11:16:02.292 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.325 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.049) 0:10:38.342 ***** 2019-11-28T11:16:02.335 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.375 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.049) 0:10:38.392 ***** 2019-11-28T11:16:02.381 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T11:16:02.384 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.426 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.046) 0:10:38.439 ***** 2019-11-28T11:16:02.429 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-11-28T11:16:02.432 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.479 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.048) 0:10:38.488 ***** 2019-11-28T11:16:02.481 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-28T11:16:02.484 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.526 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.055) 0:10:38.543 ***** 2019-11-28T11:16:02.533 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-28T11:16:02.535 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.576 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.050) 0:10:38.594 ***** 2019-11-28T11:16:02.585 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-28T11:16:02.589 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.629 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.052) 0:10:38.646 ***** 2019-11-28T11:16:02.645 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.680 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.051) 0:10:38.697 ***** 2019-11-28T11:16:02.688 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.729 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.048) 0:10:38.746 ***** 2019-11-28T11:16:02.736 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-28T11:16:02.738 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.782 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.052) 0:10:38.799 ***** 2019-11-28T11:16:02.789 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-11-28T11:16:02.790 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": ["leveldb", "xmlstarlet"]}, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed\n---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n leveldb x86_64 1.12.0-11.el7 epel 161 k\n xmlstarlet x86_64 1.6.1-1.el7 epel 62 k\n\nTransaction Summary\n================================================================================\nInstall 2 Packages\n\nTotal download size: 223 k\nInstalled size: 631 k\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 562 kB/s | 223 kB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : xmlstarlet-1.6.1-1.el7.x86_64 2019-11-28T11:16:02.792 INFO:teuthology.task.ansible.out: 1/2 \n Installing : leveldb-1.12.0-11.el7.x86_64 2/2 \n Verifying : leveldb-1.12.0-11.el7.x86_64 1/2 \n Verifying : xmlstarlet-1.6.1-1.el7.x86_64 2/2 \n\nInstalled:\n leveldb.x86_64 0:1.12.0-11.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 \n\nComplete!\n"]} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.831 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.048) 0:10:38.847 ***** 2019-11-28T11:16:02.867 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.037) 0:10:38.885 ***** 2019-11-28T11:16:02.873 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.875 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:02.915 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.048) 0:10:38.933 ***** 2019-11-28T11:16:02.948 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:02 +0000 (0:00:00.032) 0:10:38.966 ***** 2019-11-28T11:16:03.439 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-28T11:16:03.444 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "secontext": "system_u:object_r:exports_t:s0", "size": 578, "state": "file", "uid": 0} 2019-11-28T11:16:03.495 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:03 +0000 (0:00:00.546) 0:10:39.512 ***** 2019-11-28T11:16:03.503 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-28T11:16:03.504 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:03.547 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:03 +0000 (0:00:00.052) 0:10:39.565 ***** 2019-11-28T11:16:03.763 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-28T11:16:03.768 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nfs-server", "status": {"ActiveEnterTimestamp": "Thu 2019-11-28 11:03:42 UTC", "ActiveEnterTimestampMonotonic": "20356175", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket rpc-statd.service rpcbind.socket gssproxy.service -.mount tmp.mount rpc-gssd.service nfs-idmapd.service proc-fs-nfsd.mount local-fs.target system.slice nfs-config.service network-online.target nfs-mountd.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-11-28 11:03:42 UTC", "AssertTimestampMonotonic": "20106520", "Before": "rpc-statd-notify.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BoundBy": "nfs-idmapd.service nfs-mountd.service", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-11-28 11:03:42 UTC", "ConditionTimestampMonotonic": "20106519", "ControlGroup": "/system.slice/nfs-server.service", "ControlPID": "0", "DefaultDependencies": "no", "Delegate": "no", "Description": "NFS server and services", "DevicePolicy": "auto", "DropInPaths": "/run/systemd/generator/nfs-server.service.d/order-with-mounts.conf", "EnvironmentFile": "/run/sysconfig/nfs-utils (ignore_errors=yes)", "ExecMainCode": "1", "ExecMainExitTimestamp": "Thu 2019-11-28 11:03:42 UTC", "ExecMainExitTimestampMonotonic": "20309593", "ExecMainPID": "2161", "ExecMainStartTimestamp": "Thu 2019-11-28 11:03:42 UTC", "ExecMainStartTimestampMonotonic": "20160618", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -r ; ignore_errors=yes ; start_time=[n/a] ; stop 2019-11-28T11:16:03.770 INFO:teuthology.task.ansible.out:_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/rpc.nfsd ; argv[]=/usr/sbin/rpc.nfsd $RPCNFSDARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/bin/sh ; argv[]=/bin/sh -c if systemctl -q is-active gssproxy; then systemctl reload gssproxy ; fi ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPre": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -r ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/rpc.nfsd ; argv[]=/usr/sbin/rpc.nfsd 0 ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nfs-server.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nfs-server.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-11-28 11:03:42 UTC", "InactiveExitTimestampMonotonic": "20107146", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "Me 2019-11-28T11:16:03.772 INFO:teuthology.task.ansible.out:moryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nfs-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "yes", "Requires": "network.target -.mount tmp.mount proc-fs-nfsd.mount nfs-mountd.service", "RequiresMountsFor": "/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "exited", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "0", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "oneshot", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice rpc-statd.service rpc-statd-notify.service nfs-config.service network-online.target nfs-idmapd.service rpcbind.socket auth-rpcgss-module.service", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T11:16:03.807 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:03 +0000 (0:00:00.259) 0:10:39.825 ***** 2019-11-28T11:16:03.816 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-28T11:16:03.817 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:03.869 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:03 +0000 (0:00:00.061) 0:10:39.886 ***** 2019-11-28T11:16:03.877 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-28T11:16:03.879 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:03.933 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:03 +0000 (0:00:00.064) 0:10:39.951 ***** 2019-11-28T11:16:03.943 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-28T11:16:03.944 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:03.994 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:03 +0000 (0:00:00.057) 0:10:40.008 ***** 2019-11-28T11:16:04.000 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.051 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.056) 0:10:40.065 ***** 2019-11-28T11:16:04.059 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-28T11:16:04.060 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.101 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.053) 0:10:40.119 ***** 2019-11-28T11:16:04.112 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T11:16:04.113 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.152 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.050) 0:10:40.170 ***** 2019-11-28T11:16:04.164 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.202 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.049) 0:10:40.220 ***** 2019-11-28T11:16:04.210 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.262 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.059) 0:10:40.279 ***** 2019-11-28T11:16:04.273 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.311 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.048) 0:10:40.327 ***** 2019-11-28T11:16:04.317 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-28T11:16:04.318 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.359 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.045) 0:10:40.373 ***** 2019-11-28T11:16:04.365 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.404 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.048) 0:10:40.421 ***** 2019-11-28T11:16:04.412 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T11:16:04.414 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.452 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.047) 0:10:40.469 ***** 2019-11-28T11:16:04.469 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.503 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.051) 0:10:40.521 ***** 2019-11-28T11:16:04.510 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.549 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.045) 0:10:40.566 ***** 2019-11-28T11:16:04.562 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.602 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.051) 0:10:40.618 ***** 2019-11-28T11:16:04.612 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-11-28T11:16:04.613 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.659 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.057) 0:10:40.675 ***** 2019-11-28T11:16:04.666 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T11:16:04.668 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.712 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.054) 0:10:40.730 ***** 2019-11-28T11:16:04.720 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.766 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.054) 0:10:40.784 ***** 2019-11-28T11:16:04.776 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T11:16:04.780 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.819 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.052) 0:10:40.836 ***** 2019-11-28T11:16:04.828 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-28T11:16:04.831 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:04.869 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:04 +0000 (0:00:00.049) 0:10:40.886 ***** 2019-11-28T11:16:05.044 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-28T11:16:05.046 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-28T11:16:05.084 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:05 +0000 (0:00:00.215) 0:10:41.102 ***** 2019-11-28T11:16:05.093 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:05.131 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:05 +0000 (0:00:00.047) 0:10:41.149 ***** 2019-11-28T11:16:05.139 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-28T11:16:05.142 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:05.190 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:05 +0000 (0:00:00.055) 0:10:41.205 ***** 2019-11-28T11:16:05.198 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:05.236 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:05 +0000 (0:00:00.046) 0:10:41.251 ***** 2019-11-28T11:16:05.388 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-28T11:16:05.393 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "secontext": "system_u:object_r:exports_t:s0", "size": 578, "state": "file", "uid": 0} 2019-11-28T11:16:05.445 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:05 +0000 (0:00:00.210) 0:10:41.462 ***** 2019-11-28T11:16:05.454 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:05.511 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:05 +0000 (0:00:00.066) 0:10:41.528 ***** 2019-11-28T11:16:05.519 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-11-28T11:16:05.523 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.service system.slice polkit.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ipset.service ip6tables.service ebtables.service iptables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-28T11:16:05.525 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-28T11:16:05.527 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "system.slice network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T11:16:05.564 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:05 +0000 (0:00:00.052) 0:10:41.581 ***** 2019-11-28T11:16:05.572 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:05.619 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:05 +0000 (0:00:00.054) 0:10:41.636 ***** 2019-11-28T11:16:05.762 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-28T11:16:05.765 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nfs-server", "status": {"ActiveEnterTimestamp": "Thu 2019-11-28 11:03:10 UTC", "ActiveEnterTimestampMonotonic": "22741444", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nfs-idmapd.service proc-fs-nfsd.mount nfs-config.service rpc-gssd.service rpcbind.socket local-fs.target nfs-mountd.service -.mount network-online.target system.slice tmp.mount rpc-statd.service systemd-journald.socket gssproxy.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-11-28 11:03:10 UTC", "AssertTimestampMonotonic": "22538356", "Before": "rpc-statd-notify.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BoundBy": "nfs-idmapd.service nfs-mountd.service", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-11-28 11:03:10 UTC", "ConditionTimestampMonotonic": "22538356", "ControlGroup": "/system.slice/nfs-server.service", "ControlPID": "0", "DefaultDependencies": "no", "Delegate": "no", "Description": "NFS server and services", "DevicePolicy": "auto", "DropInPaths": "/run/systemd/generator/nfs-server.service.d/order-with-mounts.conf", "EnvironmentFile": "/run/sysconfig/nfs-utils (ignore_errors=yes)", "ExecMainCode": "1", "ExecMainExitTimestamp": "Thu 2019-11-28 11:03:10 UTC", "ExecMainExitTimestampMonotonic": "22708830", "ExecMainPID": "2257", "ExecMainStartTimestamp": "Thu 2019-11-28 11:03:10 UTC", "ExecMainStartTimestampMonotonic": "22608369", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -r ; ignore_errors=yes ; start_time=[n/a] ; stop 2019-11-28T11:16:05.767 INFO:teuthology.task.ansible.out:_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/rpc.nfsd ; argv[]=/usr/sbin/rpc.nfsd $RPCNFSDARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/bin/sh ; argv[]=/bin/sh -c if systemctl -q is-active gssproxy; then systemctl reload gssproxy ; fi ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPre": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -r ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/rpc.nfsd ; argv[]=/usr/sbin/rpc.nfsd 0 ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nfs-server.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nfs-server.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-11-28 11:03:10 UTC", "InactiveExitTimestampMonotonic": "22539151", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "Me 2019-11-28T11:16:05.769 INFO:teuthology.task.ansible.out:moryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nfs-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "yes", "Requires": "nfs-mountd.service proc-fs-nfsd.mount -.mount tmp.mount network.target", "RequiresMountsFor": "/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "exited", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "0", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "oneshot", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "nfs-config.service nfs-idmapd.service rpc-statd-notify.service rpcbind.socket auth-rpcgss-module.service system.slice rpc-statd.service network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T11:16:05.805 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:05 +0000 (0:00:00.186) 0:10:41.822 ***** 2019-11-28T11:16:05.812 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-11-28T11:16:05.816 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi080.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-28T11:16:05.853 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:05 +0000 (0:00:00.047) 0:10:41.870 ***** 2019-11-28T11:16:05.889 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:05 +0000 (0:00:00.036) 0:10:41.906 ***** 2019-11-28T11:16:05.897 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:05.898 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:05.938 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:05 +0000 (0:00:00.048) 0:10:41.955 ***** 2019-11-28T11:16:05.974 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:05 +0000 (0:00:00.036) 0:10:41.991 ***** 2019-11-28T11:16:05.981 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-11-28T11:16:05.993 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:06.033 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.059) 0:10:42.051 ***** 2019-11-28T11:16:06.044 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:06.084 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.050) 0:10:42.101 ***** 2019-11-28T11:16:06.090 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-11-28T11:16:06.092 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:06.131 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.047) 0:10:42.148 ***** 2019-11-28T11:16:06.140 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T11:16:06.142 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:06.143 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-11-28T11:16:06.216 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.064) 0:10:42.213 ***** 2019-11-28T11:16:06.234 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.037) 0:10:42.251 ***** 2019-11-28T11:16:06.241 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-11-28T11:16:06.243 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for custom repos] *************************************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:06.285 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.051) 0:10:42.302 ***** 2019-11-28T11:16:06.323 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.037) 0:10:42.340 ***** 2019-11-28T11:16:06.330 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T11:16:06.333 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:06.370 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.047) 0:10:42.387 ***** 2019-11-28T11:16:06.407 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.037) 0:10:42.425 ***** 2019-11-28T11:16:06.420 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** TASK [testnode : set_fact] ***************************************************** ok: [smithi075.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-28T11:16:06.455 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.047) 0:10:42.472 ***** 2019-11-28T11:16:06.491 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.035) 0:10:42.508 ***** 2019-11-28T11:16:06.502 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-28T11:16:06.504 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi075.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:06.548 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.056) 0:10:42.565 ***** 2019-11-28T11:16:06.557 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} TASK [testnode : Set apt preferences] ****************************************** 2019-11-28T11:16:06.560 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi075.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:06.563 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:06.600 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.052) 0:10:42.618 ***** 2019-11-28T11:16:06.608 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:06.613 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:06.652 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.052) 0:10:42.670 ***** 2019-11-28T11:16:06.697 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.037) 0:10:42.707 ***** TASK [testnode : Add sources list] ********************************************* skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:06.739 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.049) 0:10:42.756 ***** 2019-11-28T11:16:06.751 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T11:16:06.753 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:06.801 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.062) 0:10:42.819 ***** 2019-11-28T11:16:06.808 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-11-28T11:16:06.809 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:06.811 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:06.851 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.050) 0:10:42.869 ***** 2019-11-28T11:16:06.857 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-11-28T11:16:06.859 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** 2019-11-28T11:16:06.861 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004031", "end": "2019-11-28 11:16:06.827131", "rc": 0, "start": "2019-11-28 11:16:06.823100", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-28T11:16:06.908 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.056) 0:10:42.926 ***** 2019-11-28T11:16:06.944 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.035) 0:10:42.961 ***** 2019-11-28T11:16:06.956 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:06.991 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:06 +0000 (0:00:00.046) 0:10:43.008 ***** 2019-11-28T11:16:07.002 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:07.046 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.055) 0:10:43.063 ***** 2019-11-28T11:16:07.081 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.034) 0:10:43.098 ***** 2019-11-28T11:16:07.089 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:07.143 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.061) 0:10:43.159 ***** 2019-11-28T11:16:07.181 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.037) 0:10:43.197 ***** 2019-11-28T11:16:07.186 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-28T11:16:07.188 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:07.227 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.047) 0:10:43.244 ***** 2019-11-28T11:16:07.263 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.036) 0:10:43.281 ***** 2019-11-28T11:16:07.273 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-11-28T11:16:07.274 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:07.276 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:07.326 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.062) 0:10:43.343 ***** 2019-11-28T11:16:07.364 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.038) 0:10:43.381 ***** 2019-11-28T11:16:07.375 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:07.420 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.056) 0:10:43.438 ***** 2019-11-28T11:16:07.428 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:07.470 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.049) 0:10:43.488 ***** 2019-11-28T11:16:07.477 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-11-28T11:16:07.479 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:07.528 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.057) 0:10:43.545 ***** 2019-11-28T11:16:07.539 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-11-28T11:16:07.541 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:07.584 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.056) 0:10:43.602 ***** 2019-11-28T11:16:07.591 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-11-28T11:16:07.594 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:07.633 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.049) 0:10:43.651 ***** 2019-11-28T11:16:07.642 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:07.681 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.047) 0:10:43.698 ***** 2019-11-28T11:16:07.695 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-11-28T11:16:07.699 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:07.740 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.058) 0:10:43.757 ***** 2019-11-28T11:16:07.752 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:07.800 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.060) 0:10:43.818 ***** 2019-11-28T11:16:07.808 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-11-28T11:16:07.810 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:07.854 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.053) 0:10:43.871 ***** 2019-11-28T11:16:07.861 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T11:16:07.863 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:07.904 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.050) 0:10:43.921 ***** 2019-11-28T11:16:07.911 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-11-28T11:16:07.914 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:07.950 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.046) 0:10:43.968 ***** 2019-11-28T11:16:07.957 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-11-28T11:16:07.960 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:08.011 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:07 +0000 (0:00:00.048) 0:10:44.017 ***** 2019-11-28T11:16:08.066 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 28 November 2019 11:16:08 +0000 (0:00:00.054) 0:10:44.071 ***** TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:08.113 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:08 +0000 (0:00:00.053) 0:10:44.125 ***** 2019-11-28T11:16:08.116 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-11-28T11:16:08.118 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:08.156 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:08 +0000 (0:00:00.048) 0:10:44.173 ***** 2019-11-28T11:16:08.165 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:08.206 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:08 +0000 (0:00:00.050) 0:10:44.224 ***** 2019-11-28T11:16:08.216 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-11-28T11:16:08.219 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:08.268 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:08 +0000 (0:00:00.058) 0:10:44.283 ***** 2019-11-28T11:16:08.273 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-11-28T11:16:08.275 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:08.316 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:08 +0000 (0:00:00.050) 0:10:44.334 ***** 2019-11-28T11:16:08.325 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-11-28T11:16:08.328 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:08.368 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:08 +0000 (0:00:00.051) 0:10:44.385 ***** 2019-11-28T11:16:08.376 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-11-28T11:16:08.379 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:08.452 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:08 +0000 (0:00:00.082) 0:10:44.468 ***** 2019-11-28T11:16:08.469 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:16:08.471 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-28T11:16:08.521 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:08 +0000 (0:00:00.070) 0:10:44.538 ***** 2019-11-28T11:16:08.533 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-11-28T11:16:08.536 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:08.581 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:08 +0000 (0:00:00.058) 0:10:44.597 ***** 2019-11-28T11:16:08.658 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-11-28T11:16:08.659 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:08.662 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi133.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:08.665 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:08.712 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:08 +0000 (0:00:00.132) 0:10:44.729 ***** 2019-11-28T11:16:08.719 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-11-28T11:16:08.721 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:08.766 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:08 +0000 (0:00:00.049) 0:10:44.779 ***** 2019-11-28T11:16:08.869 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-11-28T11:16:08.871 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004972", "end": "2019-11-28 11:16:08.837757", "rc": 0, "start": "2019-11-28 11:16:08.832785", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-28T11:16:08.919 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:08 +0000 (0:00:00.156) 0:10:44.936 ***** 2019-11-28T11:16:08.928 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-11-28T11:16:08.931 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:08.976 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:08 +0000 (0:00:00.057) 0:10:44.993 ***** 2019-11-28T11:16:08.983 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-11-28T11:16:08.985 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:09.037 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:09 +0000 (0:00:00.061) 0:10:45.054 ***** 2019-11-28T11:16:09.046 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:09.099 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:09 +0000 (0:00:00.060) 0:10:45.115 ***** 2019-11-28T11:16:09.105 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-11-28T11:16:09.107 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:09.164 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:09 +0000 (0:00:00.066) 0:10:45.181 ***** 2019-11-28T11:16:09.173 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:09.211 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:09 +0000 (0:00:00.047) 0:10:45.228 ***** 2019-11-28T11:16:09.224 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:09.259 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:09 +0000 (0:00:00.047) 0:10:45.276 ***** 2019-11-28T11:16:09.266 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-28T11:16:09.268 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:09.317 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:09 +0000 (0:00:00.046) 0:10:45.323 ***** TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:09.356 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:09 +0000 (0:00:00.050) 0:10:45.374 ***** 2019-11-28T11:16:09.364 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-28T11:16:09.365 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:09.410 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:09 +0000 (0:00:00.049) 0:10:45.424 ***** 2019-11-28T11:16:10.195 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-11-28T11:16:10.196 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.158-2.el7.x86_64 providing device-mapper is already installed"]} 2019-11-28T11:16:10.236 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:10 +0000 (0:00:00.829) 0:10:46.254 ***** 2019-11-28T11:16:10.245 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:10.297 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:10 +0000 (0:00:00.060) 0:10:46.314 ***** 2019-11-28T11:16:10.305 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-28T11:16:10.307 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item={u'block_used': 13578591, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745893, u'size_available': 928751177728, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968939, u'device': u'/dev/sda1', u'inode_used': 86037, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745893, "block_size": 4096, "block_total": 240324484, "block_used": 13578591, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968939, "inode_total": 61054976, "inode_used": 86037, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751177728, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}} 2019-11-28T11:16:10.360 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:10 +0000 (0:00:00.060) 0:10:46.375 ***** 2019-11-28T11:16:10.369 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-28T11:16:10.372 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:10.426 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:10 +0000 (0:00:00.067) 0:10:46.442 ***** 2019-11-28T11:16:10.563 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005534", "end": "2019-11-28 11:16:10.531717", "rc": 0, "start": "2019-11-28 11:16:10.526183", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:10.609 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:10 +0000 (0:00:00.184) 0:10:46.626 ***** 2019-11-28T11:16:10.617 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-28T11:16:10.619 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:10.657 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:10 +0000 (0:00:00.047) 0:10:46.674 ***** 2019-11-28T11:16:10.679 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-11-28T11:16:10.681 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'block_used': 13578591, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745893, u'size_available': 928751177728, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968939, u'device': u'/dev/sda1', u'inode_used': 86037, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745893, "block_size": 4096, "block_total": 240324484, "block_used": 13578591, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968939, "inode_total": 61054976, "inode_used": 86037, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751177728, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:10.720 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:10 +0000 (0:00:00.062) 0:10:46.737 ***** 2019-11-28T11:16:10.728 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-28T11:16:10.730 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:10.770 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:10 +0000 (0:00:00.049) 0:10:46.787 ***** 2019-11-28T11:16:10.783 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-11-28T11:16:10.817 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:10 +0000 (0:00:00.047) 0:10:46.834 ***** 2019-11-28T11:16:10.824 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:10.866 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:10 +0000 (0:00:00.048) 0:10:46.883 ***** 2019-11-28T11:16:10.982 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi075.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QEJS', u'wwn-0x5000c50091e02c9b'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QEJS', u'wwn': u'0x5000c50091e02c9b', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QEJS-part1', u'wwn-0x5000c50091e02c9b-part1'], u'uuids': [u'd74b555f-5ed5-42c3-b456-f59429ca50cb']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QEJS", "wwn-0x5000c50091e02c9b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QEJS-part1", "wwn-0x5000c50091e02c9b-part1"], "labels": [], "masters": [], "uuids": ["d74b555f-5ed5-42c3-b456-f59429ca50cb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": " 2019-11-28T11:16:10.992 INFO:teuthology.task.ansible.out:512", "serial": "Z1W5QEJS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e02c9b"}}, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": ["leveldb", "xmlstarlet"]}, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed\n---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n leveldb x86_64 1.12.0-11.el7 epel 161 k\n xmlstarlet x86_64 1.6.1-1.el7 epel 62 k\n\nTransaction Summary\n================================================================================\nInstall 2 Packages\n\nTotal download size: 223 k\nInstalled size: 631 k\nDownloading packages:\n---------------------------------------------------------- 2019-11-28T11:16:10.994 INFO:teuthology.task.ansible.out:----------------------\nTotal 559 kB/s | 223 kB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/2 \n Installing : leveldb-1.12.0-11.el7.x86_64 2/2 \n Verifying : leveldb-1.12.0-11.el7.x86_64 1/2 \n Verifying : xmlstarlet-1.6.1-1.el7.x86_64 2/2 \n\nInstalled:\n leveldb.x86_64 0:1.12.0-11.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 \n\nComplete!\n"]} 2019-11-28T11:16:11.024 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:11 +0000 (0:00:00.158) 0:10:47.041 ***** 2019-11-28T11:16:11.043 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T11:16:11.045 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:11.100 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:11 +0000 (0:00:00.073) 0:10:47.115 ***** 2019-11-28T11:16:12.015 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-11-28T11:16:12.026 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.158-2.el7.x86_64 providing device-mapper is already installed"]} 2019-11-28T11:16:12.030 INFO:teuthology.task.ansible.out: 2019-11-28T11:16:12.071 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:12 +0000 (0:00:00.970) 0:10:48.085 ***** 2019-11-28T11:16:12.076 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:12.118 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:12 +0000 (0:00:00.050) 0:10:48.136 ***** 2019-11-28T11:16:12.128 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-28T11:16:12.130 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={u'block_used': 13578587, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745897, u'size_available': 928751194112, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968939, u'device': u'/dev/sda1', u'inode_used': 86037, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745897, "block_size": 4096, "block_total": 240324484, "block_used": 13578587, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968939, "inode_total": 61054976, "inode_used": 86037, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751194112, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}} 2019-11-28T11:16:12.171 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:12 +0000 (0:00:00.052) 0:10:48.189 ***** 2019-11-28T11:16:12.178 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-28T11:16:12.180 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:12.237 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:12 +0000 (0:00:00.048) 0:10:48.237 ***** 2019-11-28T11:16:12.368 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:16:12.373 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-eHlpT3-mKuY-DY13-zQXO-14yL-vv65-mURwYu', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400PG400BGN', u'nvme-nvme.8086-50484654363230343030504734303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.240907", "end": "2019-11-28 11:16:12.247435", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-eHlpT3-mKuY-DY13-zQXO-14yL-vv65-mURwYu", "nvme-INTEL_SSDPEDMD400G4_PHFT620400PG400BGN", "nvme-nvme.8086-50484654363230343030504734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:11.006528", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-11-28T11:16:12.376 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005643", "end": "2019-11-28 11:16:12.333752", "rc": 0, "start": "2019-11-28 11:16:12.328109", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:12.423 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:12 +0000 (0:00:00.202) 0:10:48.439 ***** 2019-11-28T11:16:12.429 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:12.476 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:12 +0000 (0:00:00.053) 0:10:48.493 ***** 2019-11-28T11:16:12.483 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi133.front.sepia.ceph.com] => (item={u'block_used': 13578587, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745897, u'size_available': 928751194112, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968939, u'device': u'/dev/sda1', u'inode_used': 86037, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745897, "block_size": 4096, "block_total": 240324484, "block_used": 13578587, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968939, "inode_total": 61054976, "inode_used": 86037, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751194112, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:12.524 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:12 +0000 (0:00:00.048) 0:10:48.541 ***** 2019-11-28T11:16:12.530 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T11:16:12.532 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:12.585 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:12 +0000 (0:00:00.060) 0:10:48.602 ***** 2019-11-28T11:16:12.594 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-11-28T11:16:12.597 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-28T11:16:12.599 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-28T11:16:12.653 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:12 +0000 (0:00:00.067) 0:10:48.670 ***** 2019-11-28T11:16:12.716 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:12 +0000 (0:00:00.058) 0:10:48.729 ***** 2019-11-28T11:16:12.724 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T11:16:12.729 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:12.772 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:12 +0000 (0:00:00.059) 0:10:48.789 ***** 2019-11-28T11:16:12.824 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:12 +0000 (0:00:00.050) 0:10:48.840 ***** 2019-11-28T11:16:13.051 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:16:13.053 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XPD9', u'wwn-0x5000c50092928ee8'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XPD9', u'wwn': u'0x5000c50092928ee8', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XPD9-part1', u'wwn-0x5000c50092928ee8-part1'], u'uuids': [u'd74b555f-5ed5-42c3-b456-f59429ca50cb']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XPD9", "wwn-0x5000c50092928ee8"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XPD9-part1", "wwn-0x5000c50092928ee8-part1"], "labels": [], "masters": [], "uuids": ["d74b555f-5ed5-42c3-b456-f59429ca50cb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XPD9", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-28T11:16:13.055 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50092928ee8"}}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:13.057 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-11-28T11:16:13.060 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice polkit.service dbus.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ipset.service ip6tables.service shutdown.target ebtables.service iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-28T11:16:13.063 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-28T11:16:13.064 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T11:16:13.106 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:13 +0000 (0:00:00.283) 0:10:49.123 ***** 2019-11-28T11:16:13.569 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRVt3pXh7VW0LfnWKe931bnb4fDaYLY0y0'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.048308", "end": "2019-11-28 11:16:13.516009", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRVt3pXh7VW0LfnWKe931bnb4fDaYLY0y0"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:12.467701", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-28T11:16:13.578 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "secontext": "system_u:object_r:exports_t:s0", "size": 578, "state": "file", "uid": 0} 2019-11-28T11:16:13.625 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:13 +0000 (0:00:00.518) 0:10:49.642 ***** 2019-11-28T11:16:13.849 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-11-28T11:16:13.851 INFO:teuthology.task.ansible.out:fatal: [smithi076.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-28T11:16:13.916 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:13 +0000 (0:00:00.287) 0:10:49.930 ***** 2019-11-28T11:16:14.114 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-28T11:16:14.117 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nfs-server", "status": {"ActiveEnterTimestamp": "Thu 2019-11-28 11:03:44 UTC", "ActiveEnterTimestampMonotonic": "20488887", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket nfs-config.service nfs-mountd.service rpcbind.socket tmp.mount system.slice -.mount local-fs.target rpc-statd.service nfs-idmapd.service gssproxy.service proc-fs-nfsd.mount network-online.target rpc-gssd.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-11-28 11:03:44 UTC", "AssertTimestampMonotonic": "20312507", "Before": "rpc-statd-notify.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BoundBy": "nfs-mountd.service nfs-idmapd.service", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-11-28 11:03:44 UTC", "ConditionTimestampMonotonic": "20312507", "ControlGroup": "/system.slice/nfs-server.service", "ControlPID": "0", "DefaultDependencies": "no", "Delegate": "no", "Description": "NFS server and services", "DevicePolicy": "auto", "DropInPaths": "/run/systemd/generator/nfs-server.service.d/order-with-mounts.conf", "EnvironmentFile": "/run/sysconfig/nfs-utils (ignore_errors=yes)", "ExecMainCode": "1", "ExecMainExitTimestamp": "Thu 2019-11-28 11:03:44 UTC", "ExecMainExitTimestampMonotonic": "20455657", "ExecMainPID": "2228", "ExecMainStartTimestamp": "Thu 2019-11-28 11:03:44 UTC", "ExecMainStartTimestampMonotonic": "20356807", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -r ; ignore_errors=yes ; start_time=[n/a] ; stop 2019-11-28T11:16:14.119 INFO:teuthology.task.ansible.out:_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/rpc.nfsd ; argv[]=/usr/sbin/rpc.nfsd $RPCNFSDARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/bin/sh ; argv[]=/bin/sh -c if systemctl -q is-active gssproxy; then systemctl reload gssproxy ; fi ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPre": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -r ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/rpc.nfsd ; argv[]=/usr/sbin/rpc.nfsd 0 ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nfs-server.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nfs-server.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-11-28 11:03:44 UTC", "InactiveExitTimestampMonotonic": "20313274", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "Me 2019-11-28T11:16:14.121 INFO:teuthology.task.ansible.out:moryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nfs-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "yes", "Requires": "tmp.mount -.mount network.target nfs-mountd.service proc-fs-nfsd.mount", "RequiresMountsFor": "/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "exited", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "0", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "oneshot", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "rpc-statd.service system.slice nfs-idmapd.service rpcbind.socket auth-rpcgss-module.service network-online.target rpc-statd-notify.service nfs-config.service", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T11:16:14.161 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:14 +0000 (0:00:00.248) 0:10:50.179 ***** 2019-11-28T11:16:14.354 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:16:14.356 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-DvE40c-l2cd-ZG0w-mciF-yW3O-JUhK-kaz9dI', u'nvme-INTEL_SSDPEDMD400G4_PHFT620401AQ400BGN', u'nvme-nvme.8086-50484654363230343031415134303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.266203", "end": "2019-11-28 11:16:14.171738", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-DvE40c-l2cd-ZG0w-mciF-yW3O-JUhK-kaz9dI", "nvme-INTEL_SSDPEDMD400G4_PHFT620401AQ400BGN", "nvme-nvme.8086-50484654363230343031415134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:12.905535", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-11-28T11:16:14.358 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Enable SELinux] *********************************************** ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-11-28T11:16:14.397 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:14 +0000 (0:00:00.235) 0:10:50.414 ***** 2019-11-28T11:16:14.403 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:14.444 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:14 +0000 (0:00:00.047) 0:10:50.461 ***** 2019-11-28T11:16:14.452 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-11-28T11:16:14.457 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:14.498 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:14 +0000 (0:00:00.054) 0:10:50.515 ***** 2019-11-28T11:16:14.508 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:14.550 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:14 +0000 (0:00:00.052) 0:10:50.568 ***** 2019-11-28T11:16:14.558 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-11-28T11:16:14.601 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:14 +0000 (0:00:00.050) 0:10:50.618 ***** 2019-11-28T11:16:14.609 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T11:16:14.611 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:14.655 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:14 +0000 (0:00:00.053) 0:10:50.672 ***** 2019-11-28T11:16:14.664 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-11-28T11:16:14.667 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:14.704 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:14 +0000 (0:00:00.049) 0:10:50.721 ***** 2019-11-28T11:16:14.713 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:14.759 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:14 +0000 (0:00:00.054) 0:10:50.776 ***** 2019-11-28T11:16:14.766 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-11-28T11:16:14.767 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:14.807 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:14 +0000 (0:00:00.048) 0:10:50.824 ***** 2019-11-28T11:16:14.812 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-28T11:16:14.814 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:16:14.816 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRh0pPjT1trPiGQB0IS74USIogpbzBvJzQ'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.046182", "end": "2019-11-28 11:16:14.763948", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRh0pPjT1trPiGQB0IS74USIogpbzBvJzQ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:13.717766", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:16:14.872 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:14 +0000 (0:00:00.064) 0:10:50.889 ***** 2019-11-28T11:16:14.885 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* skipping: [smithi076.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:14.925 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:14 +0000 (0:00:00.053) 0:10:50.943 ***** 2019-11-28T11:16:14.932 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T11:16:14.936 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:14.973 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:14 +0000 (0:00:00.047) 0:10:50.990 ***** 2019-11-28T11:16:14.984 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-11-28T11:16:14.986 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.025 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.051) 0:10:51.042 ***** 2019-11-28T11:16:15.032 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T11:16:15.035 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.076 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.051) 0:10:51.093 ***** 2019-11-28T11:16:15.085 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-11-28T11:16:15.123 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.047) 0:10:51.141 ***** 2019-11-28T11:16:15.130 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-11-28T11:16:15.132 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.173 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.047) 0:10:51.189 ***** 2019-11-28T11:16:15.181 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.220 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.048) 0:10:51.237 ***** 2019-11-28T11:16:15.228 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-11-28T11:16:15.230 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.269 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.047) 0:10:51.285 ***** 2019-11-28T11:16:15.278 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.317 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.049) 0:10:51.334 ***** 2019-11-28T11:16:15.325 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-28T11:16:15.327 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.366 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.049) 0:10:51.383 ***** 2019-11-28T11:16:15.375 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.417 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.050) 0:10:51.434 ***** 2019-11-28T11:16:15.425 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.469 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.051) 0:10:51.486 ***** 2019-11-28T11:16:15.484 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WJsLEaGuivL8c5JADcISvXWEM2vcix3tP'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.042403", "end": "2019-11-28 11:16:15.421044", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WJsLEaGuivL8c5JADcISvXWEM2vcix3tP"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:14.378641", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Upgrade packages] ********************************************* skipping: [ 2019-11-28T11:16:15.499 INFO:teuthology.task.ansible.out:smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.533 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.064) 0:10:51.551 ***** 2019-11-28T11:16:15.540 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-11-28T11:16:15.543 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.581 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.048) 0:10:51.599 ***** 2019-11-28T11:16:15.595 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.632 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.050) 0:10:51.649 ***** 2019-11-28T11:16:15.639 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-11-28T11:16:15.641 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.681 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.048) 0:10:51.698 ***** 2019-11-28T11:16:15.689 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T11:16:15.691 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.732 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.048) 0:10:51.746 ***** 2019-11-28T11:16:15.741 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.784 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.046) 0:10:51.792 ***** TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.828 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.052) 0:10:51.845 ***** 2019-11-28T11:16:15.835 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-11-28T11:16:15.840 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.875 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.046) 0:10:51.892 ***** 2019-11-28T11:16:15.884 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-11-28T11:16:15.887 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.922 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.047) 0:10:51.939 ***** 2019-11-28T11:16:15.929 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-11-28T11:16:15.931 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:15.982 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:15 +0000 (0:00:00.060) 0:10:52.000 ***** 2019-11-28T11:16:16.004 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:16.038 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:16 +0000 (0:00:00.056) 0:10:52.056 ***** 2019-11-28T11:16:16.047 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:16:16.049 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRnsHn0ZRssfxsAsAi3W16dXzKmiMCt87l'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.049663", "end": "2019-11-28 11:16:15.982026", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRnsHn0ZRssfxsAsAi3W16dXzKmiMCt87l"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:14.932363", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:16:16.051 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:16.098 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:16 +0000 (0:00:00.059) 0:10:52.116 ***** 2019-11-28T11:16:16.106 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-11-28T11:16:16.107 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:16.146 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:16 +0000 (0:00:00.047) 0:10:52.163 ***** 2019-11-28T11:16:16.153 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-11-28T11:16:16.155 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:16.207 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:16 +0000 (0:00:00.057) 0:10:52.221 ***** 2019-11-28T11:16:16.213 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:16.251 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:16 +0000 (0:00:00.047) 0:10:52.268 ***** 2019-11-28T11:16:16.258 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-11-28T11:16:16.266 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:16.299 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:16 +0000 (0:00:00.048) 0:10:52.317 ***** 2019-11-28T11:16:16.310 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-11-28T11:16:16.312 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:16.359 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:16 +0000 (0:00:00.059) 0:10:52.376 ***** 2019-11-28T11:16:16.366 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-11-28T11:16:16.369 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:16.428 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:16 +0000 (0:00:00.069) 0:10:52.445 ***** 2019-11-28T11:16:16.447 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:16.499 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:16 +0000 (0:00:00.071) 0:10:52.516 ***** 2019-11-28T11:16:16.512 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi080.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-28T11:16:16.549 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:16 +0000 (0:00:00.050) 0:10:52.567 ***** 2019-11-28T11:16:16.562 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:16.605 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:16 +0000 (0:00:00.055) 0:10:52.622 ***** 2019-11-28T11:16:16.675 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-11-28T11:16:16.677 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:16.678 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi080.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:16.682 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:16.693 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:16:16.695 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WsSwT4ua29zETOXE1DxPEm2SPSUzYCkH5'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.044999", "end": "2019-11-28 11:16:16.649405", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WsSwT4ua29zETOXE1DxPEm2SPSUzYCkH5"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:15.604406", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:16:16.697 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:16.747 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:16 +0000 (0:00:00.141) 0:10:52.763 ***** 2019-11-28T11:16:16.809 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:16 +0000 (0:00:00.058) 0:10:52.822 ***** 2019-11-28T11:16:16.818 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:16.866 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:16 +0000 (0:00:00.059) 0:10:52.881 ***** 2019-11-28T11:16:16.981 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-11-28T11:16:16.984 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.006044", "end": "2019-11-28 11:16:16.945398", "rc": 0, "start": "2019-11-28 11:16:16.939354", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-28T11:16:17.025 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:17 +0000 (0:00:00.160) 0:10:53.042 ***** 2019-11-28T11:16:17.032 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-28T11:16:17.034 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:17.072 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:17 +0000 (0:00:00.047) 0:10:53.089 ***** 2019-11-28T11:16:17.080 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-11-28T11:16:17.082 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:17.136 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:17 +0000 (0:00:00.054) 0:10:53.144 ***** TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:17.181 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:17 +0000 (0:00:00.051) 0:10:53.196 ***** 2019-11-28T11:16:17.189 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:17.227 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:17 +0000 (0:00:00.048) 0:10:53.245 ***** 2019-11-28T11:16:17.237 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:17.290 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:17 +0000 (0:00:00.061) 0:10:53.306 ***** 2019-11-28T11:16:17.296 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:17.338 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:17 +0000 (0:00:00.049) 0:10:53.355 ***** 2019-11-28T11:16:17.346 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-28T11:16:17.348 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:17.394 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:17 +0000 (0:00:00.050) 0:10:53.406 ***** 2019-11-28T11:16:17.399 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:17.467 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:17 +0000 (0:00:00.074) 0:10:53.480 ***** 2019-11-28T11:16:17.474 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRkgoDiHd5BbkcPLK8nu9nogLJC0Xr91Ik'], u'uuids': [u'e73d2ddc-1c7b-4d81-bc59-702383f60618']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.225221", "end": "2019-11-28 11:16:17.381655", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRkgoDiHd5BbkcPLK8nu9nogLJC0Xr91Ik"], "labels": [], "masters": [], "uuids": ["e73d2ddc-1c7b-4d81-bc59-702383f60618"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:16.156434", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using th 2019-11-28T11:16:17.477 INFO:teuthology.task.ansible.out:e old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:16:17.528 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:17 +0000 (0:00:00.064) 0:10:53.545 ***** 2019-11-28T11:16:18.868 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WW05DGyiaJKVSAOQ5CuVCRvojttviM1Cr'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.050076", "end": "2019-11-28 11:16:17.905124", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WW05DGyiaJKVSAOQ5CuVCRvojttviM1Cr"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:16.855048", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u 2019-11-28T11:16:18.872 INFO:teuthology.task.ansible.out:'dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRAvCWesTmplnzbpew1IPKlDKLrKGKrnpl'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.222602", "end": "2019-11-28 11:16:18.805852", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRAvCWesTmplnzbpew1IPKlDKLrKGKrnpl"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:17.583250", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:16:18.879 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-28T11:16:18.881 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:18.924 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:18 +0000 (0:00:01.390) 0:10:54.935 ***** 2019-11-28T11:16:18.957 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:18 +0000 (0:00:00.038) 0:10:54.974 ***** 2019-11-28T11:16:20.268 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi075.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QEJS', u'wwn-0x5000c50091e02c9b'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QEJS', u'wwn': u'0x5000c50091e02c9b', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QEJS-part1', u'wwn-0x5000c50091e02c9b-part1'], u'uuids': [u'd74b555f-5ed5-42c3-b456-f59429ca50cb']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QEJS", "wwn-0x5000c50091e02c9b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QEJS-part1", "wwn-0x5000c50091e02c9b-part1"], "labels": [], "masters": [], "uuids": ["d74b555f-5ed5-42c3-b456-f59429ca50cb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": " 2019-11-28T11:16:20.272 INFO:teuthology.task.ansible.out:512", "serial": "Z1W5QEJS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e02c9b"}}, "skip_reason": "Conditional result was False"} changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-eHlpT3-mKuY-DY13-zQXO-14yL-vv65-mURwYu', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400PG400BGN', u'nvme-nvme.8086-50484654363230343030504734303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.038855", "end": "2019-11-28 11:16:19.145997", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-eHlpT3-mKuY-DY13-zQXO-14yL-vv65-mURwYu", "nvme-INTEL_SSDPEDMD400G4_PHFT620400PG400BGN", "nvme-nvme.8086-50484654363230343030504734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB" 2019-11-28T11:16:20.278 INFO:teuthology.task.ansible.out:, "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:19.107142", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.035957 s, 3.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.035957 s, 3.2 GB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WdDwzngaOUFx9MCd3BWi5igpQLhq6jFtR'], u'uuids': [u'af4bdd46-3fa8-4293-9e88-29488dd74537']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.078919", "end": "2019-11-28 11:16:19.177052", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WdDwzngaOUFx9MCd3BWi5igpQLhq6jFtR"], "labels": [], "masters": [], "uuids": ["af4bdd46-3fa8-4293-9e88-29488dd74537"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:18.098133", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data struct 2019-11-28T11:16:20.280 INFO:teuthology.task.ansible.out:ures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRVt3pXh7VW0LfnWKe931bnb4fDaYLY0y0'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.155890", "end": "2019-11-28 11:16:19.476572", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRVt3pXh7VW0LfnWKe931bnb4fDaYLY0y0"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:19.320682", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.153117 s, 753 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.153117 s, 753 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:20.282 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRh0pPjT1trPiGQB0IS74USIogpbzBvJzQ'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.144379", "end": "2019-11-28 11:16:19.803544", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRh0pPjT1trPiGQB0IS74USIogpbzBvJzQ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:19.659165", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.141697 s, 814 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.141697 s, 814 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:20.284 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRnsHn0ZRssfxsAsAi3W16dXzKmiMCt87l'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.146969", "end": "2019-11-28 11:16:20.120019", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRnsHn0ZRssfxsAsAi3W16dXzKmiMCt87l"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:19.973050", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.144238 s, 800 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.144238 s, 800 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:20.286 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.158-2.el7.x86_64 providing device-mapper is already installed"]} 2019-11-28T11:16:20.287 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:20.334 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:20 +0000 (0:00:01.375) 0:10:56.349 ***** 2019-11-28T11:16:20.372 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:20 +0000 (0:00:00.040) 0:10:56.390 ***** 2019-11-28T11:16:20.380 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T11:16:20.382 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:20.432 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:20 +0000 (0:00:00.059) 0:10:56.449 ***** 2019-11-28T11:16:20.440 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-28T11:16:20.441 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item={u'block_used': 13578582, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745902, u'size_available': 928751214592, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968939, u'device': u'/dev/sda1', u'inode_used': 86037, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745902, "block_size": 4096, "block_total": 240324484, "block_used": 13578582, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968939, "inode_total": 61054976, "inode_used": 86037, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751214592, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}} 2019-11-28T11:16:20.488 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:20 +0000 (0:00:00.055) 0:10:56.505 ***** 2019-11-28T11:16:20.495 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T11:16:20.497 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRkgoDiHd5BbkcPLK8nu9nogLJC0Xr91Ik'], u'uuids': [u'e73d2ddc-1c7b-4d81-bc59-702383f60618']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.148285", "end": "2019-11-28 11:16:20.429498", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRkgoDiHd5BbkcPLK8nu9nogLJC0Xr91Ik"], "labels": [], "masters": [], "uuids": ["e73d2ddc-1c7b-4d81-bc59-702383f60618"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:20.281213", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.145548 s, 792 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.145548 s, 792 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:20.499 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:16:20.503 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WkoZQ151rvLD7ENZaNkI0Bxaul20O5n2V'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.058265", "end": "2019-11-28 11:16:20.437410", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WkoZQ151rvLD7ENZaNkI0Bxaul20O5n2V"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:19.379145", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:16:20.551 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:20 +0000 (0:00:00.063) 0:10:56.568 ***** 2019-11-28T11:16:20.591 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:20 +0000 (0:00:00.038) 0:10:56.607 ***** 2019-11-28T11:16:20.598 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-28T11:16:20.601 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:20.647 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:20 +0000 (0:00:00.057) 0:10:56.664 ***** 2019-11-28T11:16:20.685 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T11:16:20.687 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XPD9', u'wwn-0x5000c50092928ee8'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XPD9', u'wwn': u'0x5000c50092928ee8', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XPD9-part1', u'wwn-0x5000c50092928ee8-part1'], u'uuids': [u'd74b555f-5ed5-42c3-b456-f59429ca50cb']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XPD9", "wwn-0x5000c50092928ee8"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XPD9-part1", "wwn-0x5000c50092928ee8-part1"], "labels": [], "masters": [], "uuids": ["d74b555f-5ed5-42c3-b456-f59429ca50cb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XPD9", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-28T11:16:20.689 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50092928ee8"}}, "skip_reason": "Conditional result was False"} TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005722", "end": "2019-11-28 11:16:20.658145", "rc": 0, "start": "2019-11-28 11:16:20.652423", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:20.732 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:20 +0000 (0:00:00.083) 0:10:56.748 ***** 2019-11-28T11:16:20.740 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:20.784 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:20 +0000 (0:00:00.054) 0:10:56.802 ***** 2019-11-28T11:16:20.791 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-11-28T11:16:20.792 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'block_used': 13578582, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745902, u'size_available': 928751214592, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968939, u'device': u'/dev/sda1', u'inode_used': 86037, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745902, "block_size": 4096, "block_total": 240324484, "block_used": 13578582, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968939, "inode_total": 61054976, "inode_used": 86037, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751214592, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:20.798 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T11:16:20.800 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRAvCWesTmplnzbpew1IPKlDKLrKGKrnpl'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.143678", "end": "2019-11-28 11:16:20.752368", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-qUC1sDtjmyewm9P3Gowcw8fOrhCqIlxRAvCWesTmplnzbpew1IPKlDKLrKGKrnpl"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:20.608690", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.140921 s, 818 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.140921 s, 818 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:20.851 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:20 +0000 (0:00:00.066) 0:10:56.869 ***** 2019-11-28T11:16:20.897 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:20 +0000 (0:00:00.045) 0:10:56.914 ***** 2019-11-28T11:16:20.907 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T11:16:20.913 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-DvE40c-l2cd-ZG0w-mciF-yW3O-JUhK-kaz9dI', u'nvme-INTEL_SSDPEDMD400G4_PHFT620401AQ400BGN', u'nvme-nvme.8086-50484654363230343031415134303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.038462", "end": "2019-11-28 11:16:20.816088", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-DvE40c-l2cd-ZG0w-mciF-yW3O-JUhK-kaz9dI", "nvme-INTEL_SSDPEDMD400G4_PHFT620401AQ400BGN", "nvme-nvme.8086-50484654363230343031415134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:20.777626", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) co 2019-11-28T11:16:20.918 INFO:teuthology.task.ansible.out:pied, 0.0356492 s, 3.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0356492 s, 3.2 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:20.948 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:20 +0000 (0:00:00.051) 0:10:56.966 ***** 2019-11-28T11:16:20.955 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-11-28T11:16:21.001 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:20 +0000 (0:00:00.047) 0:10:57.013 ***** 2019-11-28T11:16:21.009 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:21.046 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:21 +0000 (0:00:00.050) 0:10:57.063 ***** 2019-11-28T11:16:21.117 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:16:21.119 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5R0PW', u'wwn-0x5000c50091e2e714'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5R0PW', u'wwn': u'0x5000c50091e2e714', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5R0PW-part1', u'wwn-0x5000c50091e2e714-part1'], u'uuids': [u'd74b555f-5ed5-42c3-b456-f59429ca50cb']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5R0PW", "wwn-0x5000c50091e2e714"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5R0PW-part1", "wwn-0x5000c50091e2e714-part1"], "labels": [], "masters": [], "uuids": ["d74b555f-5ed5-42c3-b456-f59429ca50cb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5R0PW", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-28T11:16:21.121 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50091e2e714"}}, "skip_reason": "Conditional result was False"} TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi075.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.082739", "end": "2019-11-28 11:16:21.086568", "rc": 0, "start": "2019-11-28 11:16:21.003829", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:21.182 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:21 +0000 (0:00:00.136) 0:10:57.199 ***** 2019-11-28T11:16:21.643 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T11:16:21.646 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WJsLEaGuivL8c5JADcISvXWEM2vcix3tP'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.144588", "end": "2019-11-28 11:16:21.128368", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WJsLEaGuivL8c5JADcISvXWEM2vcix3tP"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:20.983780", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.141853 s, 813 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.141853 s, 813 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:21.648 INFO:teuthology.task.ansible.out: 2019-11-28T11:16:21.658 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WsSwT4ua29zETOXE1DxPEm2SPSUzYCkH5'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.145198", "end": "2019-11-28 11:16:21.435214", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WsSwT4ua29zETOXE1DxPEm2SPSUzYCkH5"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:21.290016", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.142457 s, 810 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.142457 s, 810 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:21.666 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-28T11:16:21.672 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "secontext": "system_u:object_r:exports_t:s0", "size": 578, "state": "file", "uid": 0} 2019-11-28T11:16:21.709 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:21 +0000 (0:00:00.527) 0:10:57.727 ***** 2019-11-28T11:16:21.862 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T11:16:21.866 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WW05DGyiaJKVSAOQ5CuVCRvojttviM1Cr'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.141952", "end": "2019-11-28 11:16:21.762716", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WW05DGyiaJKVSAOQ5CuVCRvojttviM1Cr"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:21.620764", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.139233 s, 828 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.139233 s, 828 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:21.875 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-11-28T11:16:21.878 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.037629", "end": "2019-11-28 11:16:21.824467", "rc": 0, "start": "2019-11-28 11:16:21.786838", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:21.929 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:21 +0000 (0:00:00.219) 0:10:57.946 ***** 2019-11-28T11:16:22.163 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T11:16:22.165 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WdDwzngaOUFx9MCd3BWi5igpQLhq6jFtR'], u'uuids': [u'af4bdd46-3fa8-4293-9e88-29488dd74537']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.146045", "end": "2019-11-28 11:16:22.073603", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WdDwzngaOUFx9MCd3BWi5igpQLhq6jFtR"], "labels": [], "masters": [], "uuids": ["af4bdd46-3fa8-4293-9e88-29488dd74537"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:21.927558", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.143331 s, 805 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.143331 s, 805 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:22.168 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-28T11:16:22.170 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nfs-server", "status": {"ActiveEnterTimestamp": "Thu 2019-11-28 11:04:07 UTC", "ActiveEnterTimestampMonotonic": "21399248", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "gssproxy.service -.mount local-fs.target nfs-config.service system.slice rpc-gssd.service rpcbind.socket rpc-statd.service systemd-journald.socket tmp.mount nfs-mountd.service proc-fs-nfsd.mount network-online.target nfs-idmapd.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-11-28 11:04:07 UTC", "AssertTimestampMonotonic": "21145231", "Before": "rpc-statd-notify.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BoundBy": "nfs-mountd.service nfs-idmapd.service", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-11-28 11:04:07 UTC", "ConditionTimestampMonotonic": "21145231", "ControlGroup": "/system.slice/nfs-server.service", "ControlPID": "0", "DefaultDependencies": "no", "Delegate": "no", "Description": "NFS server and services", "DevicePolicy": "auto", "DropInPaths": "/run/systemd/generator/nfs-server.service.d/order-with-mounts.conf", "EnvironmentFile": "/run/sysconfig/nfs-utils (ignore_errors=yes)", "ExecMainCode": "1", "ExecMainExitTimestamp": "Thu 2019-11-28 11:04:07 UTC", "ExecMainExitTimestampMonotonic": "21358007", "ExecMainPID": "2161", "ExecMainStartTimestamp": "Thu 2019-11-28 11:04:07 UTC", "ExecMainStartTimestampMonotonic": "21206079", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -r ; ignore_errors=yes ; start_time=[n/a] ; stop 2019-11-28T11:16:22.171 INFO:teuthology.task.ansible.out:_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/rpc.nfsd ; argv[]=/usr/sbin/rpc.nfsd $RPCNFSDARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/bin/sh ; argv[]=/bin/sh -c if systemctl -q is-active gssproxy; then systemctl reload gssproxy ; fi ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPre": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -r ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/rpc.nfsd ; argv[]=/usr/sbin/rpc.nfsd 0 ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nfs-server.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nfs-server.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-11-28 11:04:07 UTC", "InactiveExitTimestampMonotonic": "21145862", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "Me 2019-11-28T11:16:22.173 INFO:teuthology.task.ansible.out:moryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nfs-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "yes", "Requires": "-.mount tmp.mount nfs-mountd.service proc-fs-nfsd.mount network.target", "RequiresMountsFor": "/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "exited", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "0", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "oneshot", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "nfs-idmapd.service nfs-config.service network-online.target rpcbind.socket rpc-statd-notify.service auth-rpcgss-module.service rpc-statd.service system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Remove physical volumes] ********************************** 2019-11-28T11:16:22.175 INFO:teuthology.task.ansible.out:**** 2019-11-28T11:16:22.213 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:22 +0000 (0:00:00.283) 0:10:58.230 ***** 2019-11-28T11:16:22.253 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:22 +0000 (0:00:00.040) 0:10:58.271 ***** 2019-11-28T11:16:22.261 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-11-28T11:16:22.263 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:22.312 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:22 +0000 (0:00:00.058) 0:10:58.329 ***** 2019-11-28T11:16:22.320 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-28T11:16:22.322 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7 will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7 @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @rhel-7-server-r 2019-11-28T11:16:22.324 INFO:teuthology.task.ansible.out:pms 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 @rhel-7-server-rpms 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 @rhel-7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @rhel-7-server-rpms 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 3/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 4/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Verifying : iozone-3.424-2_ceph.el7.x86_64 6/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0: 2019-11-28T11:16:22.326 INFO:teuthology.task.ansible.out:3.424-2_ceph.el7 librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:22.365 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:22 +0000 (0:00:00.052) 0:10:58.382 ***** 2019-11-28T11:16:22.408 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:22 +0000 (0:00:00.038) 0:10:58.421 ***** 2019-11-28T11:16:22.415 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-11-28T11:16:22.416 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:22.418 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-28T11:16:22.420 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T11:16:22.422 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WkoZQ151rvLD7ENZaNkI0Bxaul20O5n2V'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.149816", "end": "2019-11-28 11:16:22.388875", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-zoIvDWCAq1EaOemZthuLsFdYAtCmBN6WkoZQ151rvLD7ENZaNkI0Bxaul20O5n2V"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:22.239059", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.147084 s, 784 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.147084 s, 784 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:22.468 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:22 +0000 (0:00:00.064) 0:10:58.485 ***** 2019-11-28T11:16:22.507 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:22 +0000 (0:00:00.038) 0:10:58.524 ***** 2019-11-28T11:16:22.543 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:22 +0000 (0:00:00.036) 0:10:58.561 ***** 2019-11-28T11:16:22.552 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:16:22.553 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-gbOAem-V4g3-ijzu-ttgA-JtIF-xwtg-xNTuF7', u'nvme-INTEL_SSDPEDMD400G4_PHFT6204014T400BGN', u'nvme-nvme.8086-50484654363230343031345434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.207372", "end": "2019-11-28 11:16:22.399848", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-gbOAem-V4g3-ijzu-ttgA-JtIF-xwtg-xNTuF7", "nvme-INTEL_SSDPEDMD400G4_PHFT6204014T400BGN", "nvme-nvme.8086-50484654363230343031345434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:21.192476", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-11-28T11:16:22.555 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-28T11:16:22.556 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:22.597 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:22 +0000 (0:00:00.053) 0:10:58.614 ***** 2019-11-28T11:16:22.637 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:22 +0000 (0:00:00.039) 0:10:58.654 ***** 2019-11-28T11:16:22.646 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-11-28T11:16:22.669 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:22.691 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:22 +0000 (0:00:00.054) 0:10:58.709 ***** 2019-11-28T11:16:22.699 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T11:16:22.702 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:22.741 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:22 +0000 (0:00:00.049) 0:10:58.758 ***** 2019-11-28T11:16:22.808 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-11-28T11:16:22.809 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.073012", "end": "2019-11-28 11:16:22.774401", "rc": 0, "start": "2019-11-28 11:16:22.701389", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:22.854 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:22 +0000 (0:00:00.113) 0:10:58.871 ***** 2019-11-28T11:16:22.861 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-28T11:16:22.865 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:22.903 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:22 +0000 (0:00:00.048) 0:10:58.920 ***** 2019-11-28T11:16:22.911 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-11-28T11:16:22.914 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:16:22.953 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:22 +0000 (0:00:00.049) 0:10:58.970 ***** 2019-11-28T11:16:22.961 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T11:16:22.963 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:23.005 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:22 +0000 (0:00:00.051) 0:10:59.022 ***** 2019-11-28T11:16:23.012 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-28T11:16:23.015 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={u'block_used': 13578591, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745893, u'size_available': 928751177728, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968939, u'device': u'/dev/sda1', u'inode_used': 86037, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745893, "block_size": 4096, "block_total": 240324484, "block_used": 13578591, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968939, "inode_total": 61054976, "inode_used": 86037, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751177728, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:23.055 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.049) 0:10:59.071 ***** 2019-11-28T11:16:23.062 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T11:16:23.064 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:23.073 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.039337", "end": "2019-11-28 11:16:23.048540", "rc": 0, "start": "2019-11-28 11:16:23.009203", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:23.105 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.051) 0:10:59.123 ***** 2019-11-28T11:16:23.142 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.036) 0:10:59.159 ***** 2019-11-28T11:16:23.149 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-11-28T11:16:23.151 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set grub config.] ********************************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:23.192 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.050) 0:10:59.210 ***** 2019-11-28T11:16:23.231 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.038) 0:10:59.248 ***** 2019-11-28T11:16:23.239 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-11-28T11:16:23.240 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:23.284 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.053) 0:10:59.301 ***** 2019-11-28T11:16:23.345 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.059) 0:10:59.361 ***** 2019-11-28T11:16:23.353 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-11-28T11:16:23.354 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:23.356 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:23.396 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.052) 0:10:59.414 ***** 2019-11-28T11:16:23.440 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.043) 0:10:59.457 ***** 2019-11-28T11:16:23.448 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-11-28T11:16:23.449 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:23.452 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:23.490 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.050) 0:10:59.508 ***** 2019-11-28T11:16:23.534 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.043) 0:10:59.552 ***** 2019-11-28T11:16:23.542 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-28T11:16:23.547 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:23.594 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.059) 0:10:59.611 ***** 2019-11-28T11:16:23.632 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.038) 0:10:59.650 ***** 2019-11-28T11:16:23.640 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-11-28T11:16:23.643 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:23.687 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.053) 0:10:59.703 ***** 2019-11-28T11:16:23.724 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.038) 0:10:59.741 ***** 2019-11-28T11:16:23.730 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-28T11:16:23.732 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:16:23.748 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gusBlId7qpAzvkYWxAKZ6xgWQV55WiKDFRI'], u'uuids': [u'7be1d844-022f-4076-a641-1058029e4d5d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.057018", "end": "2019-11-28 11:16:23.670037", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gusBlId7qpAzvkYWxAKZ6xgWQV55WiKDFRI"], "labels": [], "masters": [], "uuids": ["7be1d844-022f-4076-a641-1058029e4d5d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:22.613019", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:16:23.779 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.055) 0:10:59.797 ***** 2019-11-28T11:16:23.786 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-28T11:16:23.788 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:23.842 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.061) 0:10:59.858 ***** 2019-11-28T11:16:23.849 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:23.893 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.052) 0:10:59.911 ***** 2019-11-28T11:16:23.902 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-11-28T11:16:23.904 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:23.953 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:23 +0000 (0:00:00.059) 0:10:59.970 ***** 2019-11-28T11:16:23.963 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T11:16:23.965 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7"]}, "msg": "Warning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-52.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-18.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-115.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed", "parted-3.1-31.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "7:lvm2-2.02.185-2.el7.x86_64 providing lvm2 is already installed", "1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed", "attr-2.4.46- 2019-11-28T11:16:23.967 INFO:teuthology.task.ansible.out:13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "lsof-4.87-6.el7.x86_64 providing lsof is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "n 2019-11-28T11:16:23.968 INFO:teuthology.task.ansible.out:curses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "podman-1.4.4-4.el7.x86_64 providing podman is already installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7 will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Versi 2019-11-28T11:16:23.970 INFO:teuthology.task.ansible.out:on Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7 lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 rhel-7-server-rpms 39 k\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 23 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.x86_64 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5- 2019-11-28T11:16:23.972 INFO:teuthology.task.ansible.out:4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 3/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 4/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/8 \n Verifying : iozone-3.424-2_ceph.el7.x86_64 6/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 7/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7 mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:24.019 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.063) 0:11:00.034 ***** 2019-11-28T11:16:24.060 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.043) 0:11:00.077 ***** 2019-11-28T11:16:24.153 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-11-28T11:16:24.154 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:16:24.195 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.134) 0:11:00.212 ***** 2019-11-28T11:16:24.202 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-11-28T11:16:24.205 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:24.247 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.050) 0:11:00.262 ***** 2019-11-28T11:16:24.259 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-28T11:16:24.260 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={u'block_used': 13578587, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745897, u'size_available': 928751194112, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968939, u'device': u'/dev/sda1', u'inode_used': 86037, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745897, "block_size": 4096, "block_total": 240324484, "block_used": 13578587, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968939, "inode_total": 61054976, "inode_used": 86037, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751194112, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:24.304 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.058) 0:11:00.321 ***** 2019-11-28T11:16:24.310 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-11-28T11:16:24.312 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:24.355 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.050) 0:11:00.372 ***** 2019-11-28T11:16:24.361 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-11-28T11:16:24.363 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:24.403 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.049) 0:11:00.421 ***** 2019-11-28T11:16:24.410 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-11-28T11:16:24.411 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-28T11:16:24.413 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:24.462 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.058) 0:11:00.479 ***** 2019-11-28T11:16:24.513 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.050) 0:11:00.530 ***** 2019-11-28T11:16:24.524 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:16:24.526 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:24.582 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.069) 0:11:00.599 ***** 2019-11-28T11:16:24.591 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:24.632 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.049) 0:11:00.649 ***** 2019-11-28T11:16:24.642 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:16:24.646 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:24.705 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.073) 0:11:00.722 ***** 2019-11-28T11:16:24.712 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-11-28T11:16:24.722 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:24.756 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.050) 0:11:00.773 ***** 2019-11-28T11:16:24.767 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:24.808 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.052) 0:11:00.825 ***** 2019-11-28T11:16:24.819 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:24.878 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.070) 0:11:00.896 ***** 2019-11-28T11:16:24.886 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-11-28T11:16:24.899 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:24.940 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.061) 0:11:00.957 ***** 2019-11-28T11:16:24.955 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gusDOxbFOpOILaElsYDChVXSLmWspYB77ve'], u'uuids': [u'4051fdd6-65f5-4b8e-b9ce-3815fb0e2b49']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.049559", "end": "2019-11-28 11:16:24.885477", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gusDOxbFOpOILaElsYDChVXSLmWspYB77ve"], "labels": [], "masters": [], "uuids": ["4051fdd6-65f5-4b8e-b9ce-3815fb0e2b49"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:23.835918", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : 2019-11-28T11:16:24.958 INFO:teuthology.task.ansible.out: Update /etc/profile if needed.] ******************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:24.996 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:24 +0000 (0:00:00.055) 0:11:01.013 ***** 2019-11-28T11:16:25.006 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-11-28T11:16:25.008 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:25.056 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:25 +0000 (0:00:00.055) 0:11:01.068 ***** 2019-11-28T11:16:25.059 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-28T11:16:25.100 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:25 +0000 (0:00:00.049) 0:11:01.117 ***** 2019-11-28T11:16:25.441 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-28T11:16:25.443 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:16:25.445 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Create volume group(s)] *************************************** changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-28T11:16:25.524 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:25 +0000 (0:00:00.419) 0:11:01.537 ***** 2019-11-28T11:16:25.557 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-11-28T11:16:25.560 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:25.561 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-11-28T11:16:25.563 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:25.565 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:25.567 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:25.568 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:25.625 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:25 +0000 (0:00:00.104) 0:11:01.641 ***** 2019-11-28T11:16:26.275 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-28T11:16:26.277 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:16:26.288 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gusBYbcjxl3uc8FGMlAUfmdtPjhcDc1sopJ'], u'uuids': [u'27a10bed-f737-4c6a-add8-d9e3400a14a5']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.046418", "end": "2019-11-28 11:16:26.118431", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gusBYbcjxl3uc8FGMlAUfmdtPjhcDc1sopJ"], "labels": [], "masters": [], "uuids": ["27a10bed-f737-4c6a-add8-d9e3400a14a5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:25.072013", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother 2019-11-28T11:16:26.290 INFO:teuthology.task.ansible.out:utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:16:26.328 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:26 +0000 (0:00:00.704) 0:11:02.346 ***** 2019-11-28T11:16:26.416 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-11-28T11:16:26.418 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004148", "end": "2019-11-28 11:16:26.379901", "rc": 0, "start": "2019-11-28 11:16:26.375753", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-28T11:16:26.482 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:26 +0000 (0:00:00.153) 0:11:02.499 ***** 2019-11-28T11:16:26.594 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-28T11:16:26.596 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:16:26.598 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-28T11:16:26.642 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:26 +0000 (0:00:00.160) 0:11:02.660 ***** 2019-11-28T11:16:26.650 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-11-28T11:16:26.653 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:26.708 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:26 +0000 (0:00:00.065) 0:11:02.725 ***** 2019-11-28T11:16:27.014 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-28T11:16:27.015 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:27.017 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:16:27.026 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-28T11:16:27.027 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:16:27.056 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:27.100 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:27 +0000 (0:00:00.391) 0:11:03.117 ***** 2019-11-28T11:16:27.140 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:27 +0000 (0:00:00.039) 0:11:03.157 ***** 2019-11-28T11:16:27.149 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-11-28T11:16:27.151 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:27.191 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:27 +0000 (0:00:00.051) 0:11:03.208 ***** 2019-11-28T11:16:27.341 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-28T11:16:27.342 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:16:27.344 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-28T11:16:27.386 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:27 +0000 (0:00:00.194) 0:11:03.403 ***** 2019-11-28T11:16:27.400 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:27.402 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:16:27.404 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gus2QdS8bHchBTVdhtV9fLEssKovPgwJdbJ'], u'uuids': [u'5c310ce0-4c81-4935-bd95-061a18977521']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.039713", "end": "2019-11-28 11:16:27.344861", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gus2QdS8bHchBTVdhtV9fLEssKovPgwJdbJ"], "labels": [], "masters": [], "uuids": ["5c310ce0-4c81-4935-bd95-061a18977521"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:26.305148", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:16:27.406 INFO:teuthology.task.ansible.out: 2019-11-28T11:16:27.408 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-28T11:16:27.410 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:16:27.468 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:27 +0000 (0:00:00.077) 0:11:03.480 ***** 2019-11-28T11:16:27.511 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:27 +0000 (0:00:00.047) 0:11:03.528 ***** 2019-11-28T11:16:27.672 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:27.675 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:16:27.676 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T11:16:27.718 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:27 +0000 (0:00:00.207) 0:11:03.735 ***** 2019-11-28T11:16:28.148 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} changed: [smithi133.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:16:28.195 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:28 +0000 (0:00:00.476) 0:11:04.212 ***** 2019-11-28T11:16:28.203 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-28T11:16:28.204 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:28.257 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:28 +0000 (0:00:00.060) 0:11:04.273 ***** 2019-11-28T11:16:28.388 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T11:16:28.429 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:28 +0000 (0:00:00.173) 0:11:04.446 ***** 2019-11-28T11:16:28.613 INFO:teuthology.task.ansible.out: 2019-11-28T11:16:28.615 INFO:teuthology.task.ansible.out:TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:16:28.626 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gusjtgiQdbiuJgW1byvLfYUK9OwOVpKgUs1'], u'uuids': [u'b04e1d87-3baf-472f-9b8d-de4fcafcefc6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.039853", "end": "2019-11-28 11:16:28.568469", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gusjtgiQdbiuJgW1byvLfYUK9OwOVpKgUs1"], "labels": [], "masters": [], "uuids": ["b04e1d87-3baf-472f-9b8d-de4fcafcefc6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:27.528616", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:16:28.654 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-28T11:16:28.656 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:28.702 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:28 +0000 (0:00:00.272) 0:11:04.719 ***** 2019-11-28T11:16:28.764 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:28 +0000 (0:00:00.055) 0:11:04.774 ***** 2019-11-28T11:16:28.957 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T11:16:28.960 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5R0PW', u'wwn-0x5000c50091e2e714'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5R0PW', u'wwn': u'0x5000c50091e2e714', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5R0PW-part1', u'wwn-0x5000c50091e2e714-part1'], u'uuids': [u'd74b555f-5ed5-42c3-b456-f59429ca50cb']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5R0PW", "wwn-0x5000c50091e2e714"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5R0PW-part1", "wwn-0x5000c50091e2e714-part1"], "labels": [], "masters": [], "uuids": ["d74b555f-5ed5-42c3-b456-f59429ca50cb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5R0PW", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-28T11:16:28.961 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50091e2e714"}}, "skip_reason": "Conditional result was False"} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi075.front.sepia.ceph.com] => {"changed": true} 2019-11-28T11:16:29.006 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:29 +0000 (0:00:00.248) 0:11:05.023 ***** 2019-11-28T11:16:29.249 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T11:16:29.253 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-gbOAem-V4g3-ijzu-ttgA-JtIF-xwtg-xNTuF7', u'nvme-INTEL_SSDPEDMD400G4_PHFT6204014T400BGN', u'nvme-nvme.8086-50484654363230343031345434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.038723", "end": "2019-11-28 11:16:28.939696", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-gbOAem-V4g3-ijzu-ttgA-JtIF-xwtg-xNTuF7", "nvme-INTEL_SSDPEDMD400G4_PHFT6204014T400BGN", "nvme-nvme.8086-50484654363230343031345434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:28.900973", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) co 2019-11-28T11:16:29.257 INFO:teuthology.task.ansible.out:pied, 0.0358424 s, 3.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0358424 s, 3.2 GB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi133.front.sepia.ceph.com] => {"changed": true} 2019-11-28T11:16:29.292 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:29 +0000 (0:00:00.286) 0:11:05.309 ***** 2019-11-28T11:16:29.837 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T11:16:29.840 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gusBlId7qpAzvkYWxAKZ6xgWQV55WiKDFRI'], u'uuids': [u'7be1d844-022f-4076-a641-1058029e4d5d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.159806", "end": "2019-11-28 11:16:29.285208", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gusBlId7qpAzvkYWxAKZ6xgWQV55WiKDFRI"], "labels": [], "masters": [], "uuids": ["7be1d844-022f-4076-a641-1058029e4d5d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:29.125402", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.157025 s, 735 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.157025 s, 735 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:29.848 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gusDOxbFOpOILaElsYDChVXSLmWspYB77ve'], u'uuids': [u'4051fdd6-65f5-4b8e-b9ce-3815fb0e2b49']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.148892", "end": "2019-11-28 11:16:29.623398", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gusDOxbFOpOILaElsYDChVXSLmWspYB77ve"], "labels": [], "masters": [], "uuids": ["4051fdd6-65f5-4b8e-b9ce-3815fb0e2b49"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:29.474506", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.14616 s, 789 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.14616 s, 789 MB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-11-28T11:16:29.892 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:29 +0000 (0:00:00.599) 0:11:05.909 ***** 2019-11-28T11:16:30.128 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gusBYbcjxl3uc8FGMlAUfmdtPjhcDc1sopJ'], u'uuids': [u'27a10bed-f737-4c6a-add8-d9e3400a14a5']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.150863", "end": "2019-11-28 11:16:29.940622", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gusBYbcjxl3uc8FGMlAUfmdtPjhcDc1sopJ"], "labels": [], "masters": [], "uuids": ["27a10bed-f737-4c6a-add8-d9e3400a14a5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:29.789759", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.148169 s, 778 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.148169 s, 778 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:30.130 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-11-28T11:16:30.174 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.281) 0:11:06.191 ***** 2019-11-28T11:16:30.181 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-11-28T11:16:30.183 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:30.227 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.053) 0:11:06.244 ***** 2019-11-28T11:16:30.239 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:30.278 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.050) 0:11:06.295 ***** 2019-11-28T11:16:30.285 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:30.286 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.158-2.el7.x86_64 providing device-mapper is already installed"]} 2019-11-28T11:16:30.288 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T11:16:30.289 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gus2QdS8bHchBTVdhtV9fLEssKovPgwJdbJ'], u'uuids': [u'5c310ce0-4c81-4935-bd95-061a18977521']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.147404", "end": "2019-11-28 11:16:30.261468", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gus2QdS8bHchBTVdhtV9fLEssKovPgwJdbJ"], "labels": [], "masters": [], "uuids": ["5c310ce0-4c81-4935-bd95-061a18977521"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:30.114064", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.144675 s, 797 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.144675 s, 797 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:30.329 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.051) 0:11:06.346 ***** 2019-11-28T11:16:30.368 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.039) 0:11:06.385 ***** 2019-11-28T11:16:30.376 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-11-28T11:16:30.378 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:30.421 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.052) 0:11:06.438 ***** 2019-11-28T11:16:30.457 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.035) 0:11:06.474 ***** 2019-11-28T11:16:30.463 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-28T11:16:30.465 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={u'block_used': 13578595, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745889, u'size_available': 928751161344, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968939, u'device': u'/dev/sda1', u'inode_used': 86037, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745889, "block_size": 4096, "block_total": 240324484, "block_used": 13578595, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968939, "inode_total": 61054976, "inode_used": 86037, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751161344, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}} 2019-11-28T11:16:30.467 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:30.518 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.061) 0:11:06.536 ***** 2019-11-28T11:16:30.560 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.041) 0:11:06.577 ***** 2019-11-28T11:16:30.567 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-11-28T11:16:30.569 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:30.615 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.055) 0:11:06.633 ***** 2019-11-28T11:16:30.663 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.045) 0:11:06.678 ***** 2019-11-28T11:16:30.668 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T11:16:30.670 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gusjtgiQdbiuJgW1byvLfYUK9OwOVpKgUs1'], u'uuids': [u'b04e1d87-3baf-472f-9b8d-de4fcafcefc6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.146837", "end": "2019-11-28 11:16:30.576669", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ngntAcQRZBB7L0K01oShyoIoed791gusjtgiQdbiuJgW1byvLfYUK9OwOVpKgUs1"], "labels": [], "masters": [], "uuids": ["b04e1d87-3baf-472f-9b8d-de4fcafcefc6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:30.429832", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.144128 s, 800 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.144128 s, 800 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:30.679 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-11-28T11:16:30.681 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:30.718 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.056) 0:11:06.735 ***** 2019-11-28T11:16:30.757 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.039) 0:11:06.774 ***** 2019-11-28T11:16:30.764 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-11-28T11:16:30.766 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Compile list of non-root partitions] ************************** 2019-11-28T11:16:30.768 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005700", "end": "2019-11-28 11:16:30.728249", "rc": 0, "start": "2019-11-28 11:16:30.722549", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:30.814 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.056) 0:11:06.831 ***** 2019-11-28T11:16:30.872 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.058) 0:11:06.889 ***** 2019-11-28T11:16:30.933 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.061) 0:11:06.951 ***** 2019-11-28T11:16:30.952 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-11-28T11:16:30.954 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={u'block_used': 13578595, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745889, u'size_available': 928751161344, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968939, u'device': u'/dev/sda1', u'inode_used': 86037, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745889, "block_size": 4096, "block_total": 240324484, "block_used": 13578595, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968939, "inode_total": 61054976, "inode_used": 86037, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751161344, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:30.995 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:30 +0000 (0:00:00.062) 0:11:07.013 ***** 2019-11-28T11:16:31.002 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-11-28T11:16:31.004 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:31.053 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:31 +0000 (0:00:00.057) 0:11:07.071 ***** 2019-11-28T11:16:31.060 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-11-28T11:16:31.062 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi080.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.078281", "end": "2019-11-28 11:16:31.001527", "rc": 0, "start": "2019-11-28 11:16:30.923246", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:31.109 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:31 +0000 (0:00:00.048) 0:11:07.119 ***** 2019-11-28T11:16:31.137 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:31 +0000 (0:00:00.035) 0:11:07.155 ***** 2019-11-28T11:16:31.144 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-11-28T11:16:31.148 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:31.198 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:31 +0000 (0:00:00.060) 0:11:07.215 ***** 2019-11-28T11:16:31.401 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi076.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QC9K', u'wwn-0x5000c50091e06051'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QC9K', u'wwn': u'0x5000c50091e06051', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QC9K-part1', u'wwn-0x5000c50091e06051-part1'], u'uuids': [u'd74b555f-5ed5-42c3-b456-f59429ca50cb']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QC9K", "wwn-0x5000c50091e06051"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QC9K-part1", "wwn-0x5000c50091e06051-part1"], "labels": [], "masters": [], "uuids": ["d74b555f-5ed5-42c3-b456-f59429ca50cb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": " 2019-11-28T11:16:31.409 INFO:teuthology.task.ansible.out:512", "serial": "Z1W5QC9K", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e06051"}}, "skip_reason": "Conditional result was False"} TASK [testnode : Check for physical volumes] *********************************** changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.057911", "end": "2019-11-28 11:16:31.366505", "rc": 0, "start": "2019-11-28 11:16:31.308594", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:31.458 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:31 +0000 (0:00:00.259) 0:11:07.475 ***** 2019-11-28T11:16:31.465 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-11-28T11:16:31.468 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:31.505 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:31 +0000 (0:00:00.047) 0:11:07.523 ***** 2019-11-28T11:16:31.512 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-11-28T11:16:31.558 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:31 +0000 (0:00:00.052) 0:11:07.575 ***** 2019-11-28T11:16:35.348 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-l32aRU-av4p-Pqxe-ayIB-z5zj-cGkK-4aKPBt', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400U4400BGN', u'nvme-nvme.8086-50484654363230343030553434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.199976", "end": "2019-11-28 11:16:32.494438", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-l32aRU-av4p-Pqxe-ayIB-z5zj-cGkK-4aKPBt", "nvme-INTEL_SSDPEDMD400G4_PHFT620400U4400BGN", "nvme-nvme.8086-50484654363230343030553434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019- 2019-11-28T11:16:35.350 INFO:teuthology.task.ansible.out:11-28 11:16:31.294462", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9eaJrkK2NwuscMeNVe9KfxbG9IHnnOwAS'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.035532", "end": "2019-11-28 11:16:33.709145", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9eaJrkK2NwuscMeNVe9KfxbG9IHnnOwAS"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:32.673613", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition 2019-11-28T11:16:35.352 INFO:teuthology.task.ansible.out: table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9sl0mr6DH8OhL3AtAMAI1dxY9oZtMHM5O'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.048862", "end": "2019-11-28 11:16:34.930318", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9sl0mr6DH8OhL3AtAMAI1dxY9oZtMHM5O"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:33.881456", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode 2019-11-28T11:16:35.354 INFO:teuthology.task.ansible.out:: Install ntp package on rpm based systems.] ******************** ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-29.el7.x86_64 providing ntp is already installed"]} 2019-11-28T11:16:35.390 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:35 +0000 (0:00:03.832) 0:11:11.408 ***** 2019-11-28T11:16:35.404 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:35.442 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:35 +0000 (0:00:00.050) 0:11:11.458 ***** 2019-11-28T11:16:35.448 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-11-28T11:16:35.450 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:35.498 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:35 +0000 (0:00:00.056) 0:11:11.515 ***** 2019-11-28T11:16:35.512 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:35.553 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:35 +0000 (0:00:00.055) 0:11:11.571 ***** 2019-11-28T11:16:35.567 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:35.601 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:35 +0000 (0:00:00.047) 0:11:11.618 ***** 2019-11-28T11:16:35.608 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-28T11:16:35.611 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:35.652 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:35 +0000 (0:00:00.050) 0:11:11.669 ***** 2019-11-28T11:16:36.012 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-11-28T11:16:36.014 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-29.el7.x86_64 providing ntp is already installed"]} 2019-11-28T11:16:36.053 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:36 +0000 (0:00:00.400) 0:11:12.070 ***** 2019-11-28T11:16:36.060 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-11-28T11:16:36.061 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:36.101 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:36 +0000 (0:00:00.048) 0:11:12.118 ***** 2019-11-28T11:16:36.108 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-11-28T11:16:36.109 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:36.148 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:36 +0000 (0:00:00.047) 0:11:12.166 ***** 2019-11-28T11:16:36.155 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-11-28T11:16:36.157 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-28T11:16:36.197 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:36 +0000 (0:00:00.048) 0:11:12.214 ***** 2019-11-28T11:16:36.204 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-11-28T11:16:36.206 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:16:36.208 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9FVBpWk6UCjmgrsisibmt1DWiwBHhApUB'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.055539", "end": "2019-11-28 11:16:36.150443", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9FVBpWk6UCjmgrsisibmt1DWiwBHhApUB"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:35.094904", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:16:36.246 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:36 +0000 (0:00:00.048) 0:11:12.263 ***** 2019-11-28T11:16:36.252 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-11-28T11:16:36.254 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:36.292 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:36 +0000 (0:00:00.046) 0:11:12.310 ***** 2019-11-28T11:16:36.300 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-11-28T11:16:36.302 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:16:36.341 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:36 +0000 (0:00:00.048) 0:11:12.358 ***** 2019-11-28T11:16:36.597 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-11-28T11:16:36.600 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "ntpdate.service tmp.mount systemd-journald.socket syslog.target basic.target sntp.service -.mount system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target chronyd.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-11-28T11:16:36.602 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-11-28T11:16:36.604 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T11:16:36.647 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:36 +0000 (0:00:00.305) 0:11:12.664 ***** 2019-11-28T11:16:36.654 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-28T11:16:36.656 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={u'block_used': 13578582, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745902, u'size_available': 928751214592, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968939, u'device': u'/dev/sda1', u'inode_used': 86037, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745902, "block_size": 4096, "block_total": 240324484, "block_used": 13578582, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968939, "inode_total": 61054976, "inode_used": 86037, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751214592, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:36.698 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:36 +0000 (0:00:00.051) 0:11:12.715 ***** 2019-11-28T11:16:36.780 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-28T11:16:36.821 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:36 +0000 (0:00:00.122) 0:11:12.838 ***** 2019-11-28T11:16:36.830 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-11-28T11:16:36.833 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:36.872 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:36 +0000 (0:00:00.051) 0:11:12.889 ***** 2019-11-28T11:16:36.880 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-11-28T11:16:36.882 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:36.920 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:36 +0000 (0:00:00.047) 0:11:12.937 ***** 2019-11-28T11:16:36.927 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:36.969 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:36 +0000 (0:00:00.049) 0:11:12.986 ***** 2019-11-28T11:16:37.240 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-11-28T11:16:37.242 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "-.mount ntpdate.service system.slice basic.target syslog.target sntp.service systemd-journald.socket tmp.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target multi-user.target chronyd.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-11-28T11:16:37.244 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-11-28T11:16:37.246 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T11:16:37.284 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:37 +0000 (0:00:00.314) 0:11:13.301 ***** 2019-11-28T11:16:37.291 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:16:37.293 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:37.332 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:37 +0000 (0:00:00.048) 0:11:13.349 ***** 2019-11-28T11:16:38.640 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:16:38.642 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9E0CloP1cxBYrPQjbfEtrY1d6JLuyYyWg'], u'uuids': [u'b858d9f1-6207-4157-adf9-13644b2075a1']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.053611", "end": "2019-11-28 11:16:37.392056", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9E0CloP1cxBYrPQjbfEtrY1d6JLuyYyWg"], "labels": [], "masters": [], "uuids": ["b858d9f1-6207-4157-adf9-13644b2075a1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:36.338445", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:16:38.644 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9gQfQGuRerY0vRNV0FxbPLMDZlRbmAi39'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.036392", "end": "2019-11-28 11:16:38.600601", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9gQfQGuRerY0vRNV0FxbPLMDZlRbmAi39"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:37.564209", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:16:38.704 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:38 +0000 (0:00:01.365) 0:11:14.715 ***** 2019-11-28T11:16:38.709 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-11-28T11:16:38.711 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:38.775 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:38 +0000 (0:00:00.076) 0:11:14.792 ***** 2019-11-28T11:16:40.663 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi076.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QC9K', u'wwn-0x5000c50091e06051'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QC9K', u'wwn': u'0x5000c50091e06051', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QC9K-part1', u'wwn-0x5000c50091e06051-part1'], u'uuids': [u'd74b555f-5ed5-42c3-b456-f59429ca50cb']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QC9K", "wwn-0x5000c50091e06051"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QC9K-part1", "wwn-0x5000c50091e06051-part1"], "labels": [], "masters": [], "uuids": ["d74b555f-5ed5-42c3-b456-f59429ca50cb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": " 2019-11-28T11:16:40.669 INFO:teuthology.task.ansible.out:512", "serial": "Z1W5QC9K", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e06051"}}, "skip_reason": "Conditional result was False"} changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-l32aRU-av4p-Pqxe-ayIB-z5zj-cGkK-4aKPBt', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400U4400BGN', u'nvme-nvme.8086-50484654363230343030553434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.038691", "end": "2019-11-28 11:16:38.958674", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-l32aRU-av4p-Pqxe-ayIB-z5zj-cGkK-4aKPBt", "nvme-INTEL_SSDPEDMD400G4_PHFT620400U4400BGN", "nvme-nvme.8086-50484654363230343030553434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB" 2019-11-28T11:16:40.674 INFO:teuthology.task.ansible.out:, "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:38.919983", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0357955 s, 3.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0357955 s, 3.2 GB/s"], "stdout": "", "stdout_lines": []} changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9eaJrkK2NwuscMeNVe9KfxbG9IHnnOwAS'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.155620", "end": "2019-11-28 11:16:39.308848", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9eaJrkK2NwuscMeNVe9KfxbG9IHnnOwAS"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:39.153228", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.152841 s, 755 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.152841 s, 755 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:40.678 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9sl0mr6DH8OhL3AtAMAI1dxY9oZtMHM5O'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.144971", "end": "2019-11-28 11:16:39.642633", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9sl0mr6DH8OhL3AtAMAI1dxY9oZtMHM5O"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:39.497662", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.142328 s, 810 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.142328 s, 810 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:40.681 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9FVBpWk6UCjmgrsisibmt1DWiwBHhApUB'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.145178", "end": "2019-11-28 11:16:39.953978", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9FVBpWk6UCjmgrsisibmt1DWiwBHhApUB"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": 2019-11-28T11:16:40.682 INFO:teuthology.task.ansible.out:"0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:39.808800", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.142465 s, 810 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.142465 s, 810 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:40.685 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9E0CloP1cxBYrPQjbfEtrY1d6JLuyYyWg'], u'uuids': [u'b858d9f1-6207-4157-adf9-13644b2075a1']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.146516", "end": "2019-11-28 11:16:40.271968", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9E0CloP1cxBYrPQjbfEtrY1d6JLuyYyWg"], "labels": [], "masters": [], "uuids": ["b858d9f1-6207-4157-adf9-13644b2075a1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:40.125452", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.143764 s, 802 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.143764 s, 802 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:40.687 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9gQfQGuRerY0vRNV0FxbPLMDZlRbmAi39'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.147027", "end": "2019-11-28 11:16:40.594353", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-AIP1crH85u5FrE6dwzqGsCXqG9QPVcO9gQfQGuRerY0vRNV0FxbPLMDZlRbmAi39"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:16:40.447326", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.144201 s, 800 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.144201 s, 800 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:40.697 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-11-28T11:16:40.699 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:40.735 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:40 +0000 (0:00:01.960) 0:11:16.752 ***** 2019-11-28T11:16:40.777 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:40 +0000 (0:00:00.037) 0:11:16.789 ***** 2019-11-28T11:16:40.996 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-11-28T11:16:40.998 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.081923", "end": "2019-11-28 11:16:40.967852", "rc": 0, "start": "2019-11-28 11:16:40.885929", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:41.041 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:41 +0000 (0:00:00.268) 0:11:17.058 ***** 2019-11-28T11:16:41.058 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-11-28T11:16:41.060 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:41.100 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:41 +0000 (0:00:00.058) 0:11:17.117 ***** 2019-11-28T11:16:41.281 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-11-28T11:16:41.283 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.037253", "end": "2019-11-28 11:16:41.243781", "rc": 0, "start": "2019-11-28 11:16:41.206528", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:41.324 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:41 +0000 (0:00:00.223) 0:11:17.341 ***** 2019-11-28T11:16:41.649 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-11-28T11:16:41.650 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-28T11:16:41.697 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:41 +0000 (0:00:00.372) 0:11:17.714 ***** 2019-11-28T11:16:41.704 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-11-28T11:16:41.746 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:41 +0000 (0:00:00.049) 0:11:17.763 ***** 2019-11-28T11:16:42.079 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-28T11:16:42.080 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:16:42.082 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-28T11:16:42.084 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "leveldb", "xmlstarlet", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n---> Package leveldb.x86_64 0:1.12.0-11.el7 will be erased\n---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @rhel-7-server-rpms 28 k\n leveldb x86_64 1.12.0-11.el7 @epel 439 k\n xmlstarlet x86_64 1.6.1-1.el7 @epel 192 k\n\nTransaction Summary\n================================================================================\nRemove 3 Packages\n\nInstalled size: 659 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : xmlstarlet-1.6.1-1.el7.x86_64 1/3 \n Erasing : leveldb-1.12.0-11.el7.x86_64 2/3 \n Erasing : boost-random-1.53.0-27.el7.x86_64 2019-11-28T11:16:42.085 INFO:teuthology.task.ansible.out: 3/3 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/3 \n Verifying : leveldb-1.12.0-11.el7.x86_64 2/3 \n Verifying : xmlstarlet-1.6.1-1.el7.x86_64 3/3 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 leveldb.x86_64 0:1.12.0-11.el7 \n xmlstarlet.x86_64 0:1.6.1-1.el7 \n\nComplete!\n"]} 2019-11-28T11:16:42.133 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:42 +0000 (0:00:00.387) 0:11:18.151 ***** 2019-11-28T11:16:42.147 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:42.182 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:42 +0000 (0:00:00.048) 0:11:18.199 ***** 2019-11-28T11:16:43.069 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-28T11:16:43.070 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:16:43.072 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:16:43.073 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:16:43.075 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-28T11:16:43.077 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:16:43.078 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-28T11:16:43.080 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-28T11:16:43.120 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:43 +0000 (0:00:00.937) 0:11:19.137 ***** 2019-11-28T11:16:43.159 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:43 +0000 (0:00:00.038) 0:11:19.176 ***** 2019-11-28T11:16:43.194 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:43 +0000 (0:00:00.034) 0:11:19.211 ***** 2019-11-28T11:16:43.201 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:43.204 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-11-28T11:16:43.207 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:43.250 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:43 +0000 (0:00:00.052) 0:11:19.264 ***** 2019-11-28T11:16:43.281 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:43 +0000 (0:00:00.034) 0:11:19.298 ***** 2019-11-28T11:16:43.287 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:43.330 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:43 +0000 (0:00:00.047) 0:11:19.346 ***** 2019-11-28T11:16:43.340 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": ["leveldb", "xmlstarlet"]}, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed\n---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n leveldb x86_64 1.12.0-11.el7 epel 161 k\n xmlstarlet x86_64 1.6.1-1.el7 epel 62 k\n\nTransaction Summary\n================================================================================\nInstall 2 Packages\n\nTotal download size: 223 k\nInstalled size: 631 k\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 561 kB/s | 223 kB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeed 2019-11-28T11:16:43.343 INFO:teuthology.task.ansible.out:ed\nRunning transaction\n Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/2 \n Installing : leveldb-1.12.0-11.el7.x86_64 2/2 \n Verifying : leveldb-1.12.0-11.el7.x86_64 1/2 \n Verifying : xmlstarlet-1.6.1-1.el7.x86_64 2/2 \n\nInstalled:\n leveldb.x86_64 0:1.12.0-11.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 \n\nComplete!\n"]} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:43.377 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:43 +0000 (0:00:00.048) 0:11:19.394 ***** 2019-11-28T11:16:43.423 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:43 +0000 (0:00:00.045) 0:11:19.440 ***** 2019-11-28T11:16:43.431 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-28T11:16:43.433 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-28T11:16:43.436 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-28T11:16:43.475 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:43 +0000 (0:00:00.052) 0:11:19.492 ***** 2019-11-28T11:16:43.511 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:43 +0000 (0:00:00.036) 0:11:19.529 ***** 2019-11-28T11:16:43.519 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-11-28T11:16:43.521 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:43.562 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:43 +0000 (0:00:00.050) 0:11:19.579 ***** 2019-11-28T11:16:43.568 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-11-28T11:16:43.569 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-28T11:16:43.571 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** skipping: [smithi080.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:43.610 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:43 +0000 (0:00:00.047) 0:11:19.627 ***** 2019-11-28T11:16:43.768 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:16:43.772 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi076.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:16:43.838 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:43 +0000 (0:00:00.228) 0:11:19.856 ***** 2019-11-28T11:16:44.034 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-28T11:16:44.035 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:16:44.037 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-28T11:16:44.091 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:44 +0000 (0:00:00.252) 0:11:20.108 ***** 2019-11-28T11:16:44.102 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:16:44.109 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi076.front.sepia.ceph.com] => (item={u'block_used': 13578595, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745889, u'size_available': 928751161344, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968939, u'device': u'/dev/sda1', u'inode_used': 86037, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745889, "block_size": 4096, "block_total": 240324484, "block_used": 13578595, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968939, "inode_total": 61054976, "inode_used": 86037, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751161344, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:44.148 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:44 +0000 (0:00:00.057) 0:11:20.165 ***** 2019-11-28T11:16:44.269 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-28T11:16:44.271 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:16:44.318 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:44 +0000 (0:00:00.169) 0:11:20.335 ***** 2019-11-28T11:16:44.326 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-11-28T11:16:44.327 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-28T11:16:44.329 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:44.370 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:44 +0000 (0:00:00.051) 0:11:20.387 ***** 2019-11-28T11:16:44.413 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:44 +0000 (0:00:00.042) 0:11:20.430 ***** 2019-11-28T11:16:44.419 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:16:44.421 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:44.463 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:44 +0000 (0:00:00.050) 0:11:20.481 ***** 2019-11-28T11:16:44.512 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-11-28T11:16:44.513 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T11:16:44.552 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:44 +0000 (0:00:00.089) 0:11:20.570 ***** 2019-11-28T11:16:44.560 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:16:44.562 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:44.604 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:44 +0000 (0:00:00.051) 0:11:20.622 ***** 2019-11-28T11:16:44.611 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-28T11:16:44.614 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:44.654 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:44 +0000 (0:00:00.049) 0:11:20.671 ***** 2019-11-28T11:16:44.661 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-11-28T11:16:44.663 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:44.701 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:44 +0000 (0:00:00.047) 0:11:20.718 ***** 2019-11-28T11:16:44.958 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi080.front.sepia.ceph.com] => {"changed": true} 2019-11-28T11:16:45.007 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.305) 0:11:21.024 ***** 2019-11-28T11:16:45.014 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-11-28T11:16:45.016 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:45.066 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.059) 0:11:21.084 ***** 2019-11-28T11:16:45.289 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-11-28T11:16:45.291 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-11-28T11:16:45.334 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.264) 0:11:21.349 ***** 2019-11-28T11:16:45.340 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:45.394 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.062) 0:11:21.411 ***** 2019-11-28T11:16:45.405 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-11-28T11:16:45.408 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages via pip] ************************************* 2019-11-28T11:16:45.410 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-28T11:16:45.412 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-28T11:16:45.453 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.058) 0:11:21.470 ***** 2019-11-28T11:16:45.490 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.036) 0:11:21.507 ***** 2019-11-28T11:16:45.524 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.034) 0:11:21.541 ***** 2019-11-28T11:16:45.530 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-11-28T11:16:45.531 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:45.533 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:45.571 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.046) 0:11:21.588 ***** 2019-11-28T11:16:45.610 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.039) 0:11:21.627 ***** 2019-11-28T11:16:45.618 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-11-28T11:16:45.620 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set interface] ************************************************ ok: [smithi075.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-11-28T11:16:45.657 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.046) 0:11:21.674 ***** 2019-11-28T11:16:45.692 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.034) 0:11:21.709 ***** 2019-11-28T11:16:45.697 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-11-28T11:16:45.699 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:45.744 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.051) 0:11:21.761 ***** 2019-11-28T11:16:45.753 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-11-28T11:16:45.754 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-11-28T11:16:45.796 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.051) 0:11:21.813 ***** 2019-11-28T11:16:45.802 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-11-28T11:16:45.804 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create volume group(s)] *************************************** changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-28T11:16:45.844 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.047) 0:11:21.861 ***** 2019-11-28T11:16:45.890 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.046) 0:11:21.908 ***** 2019-11-28T11:16:45.901 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi075.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-28T11:16:45.944 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.053) 0:11:21.961 ***** 2019-11-28T11:16:45.982 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:45 +0000 (0:00:00.037) 0:11:21.999 ***** 2019-11-28T11:16:45.989 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-11-28T11:16:45.992 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-11-28T11:16:45.994 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-28T11:16:46.044 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.062) 0:11:22.062 ***** 2019-11-28T11:16:46.101 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.047) 0:11:22.110 ***** 2019-11-28T11:16:46.132 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.039) 0:11:22.149 ***** 2019-11-28T11:16:46.139 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-11-28T11:16:46.142 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:46.183 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.050) 0:11:22.200 ***** 2019-11-28T11:16:46.224 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.040) 0:11:22.241 ***** 2019-11-28T11:16:46.231 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-11-28T11:16:46.237 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi075.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-28T11:16:46.273 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.049) 0:11:22.290 ***** 2019-11-28T11:16:46.312 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.039) 0:11:22.329 ***** 2019-11-28T11:16:46.319 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-11-28T11:16:46.321 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:46.374 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.059) 0:11:22.389 ***** 2019-11-28T11:16:46.412 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.041) 0:11:22.430 ***** 2019-11-28T11:16:46.419 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-11-28T11:16:46.421 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service system.slice dbus.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ebtables.service ipset.service ip6tables.service iptables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-28T11:16:46.423 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-28T11:16:46.425 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "system.slice network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-28T11:16:46.469 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.056) 0:11:22.486 ***** 2019-11-28T11:16:46.508 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.039) 0:11:22.525 ***** 2019-11-28T11:16:46.574 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-28T11:16:46.575 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:16:46.577 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi075.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-28T11:16:46.617 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.108) 0:11:22.634 ***** 2019-11-28T11:16:46.626 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:46.675 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.058) 0:11:22.693 ***** 2019-11-28T11:16:46.724 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-11-28T11:16:46.726 INFO:teuthology.task.ansible.out:fatal: [smithi016.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-28T11:16:46.764 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.088) 0:11:22.781 ***** 2019-11-28T11:16:46.812 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:16:46.814 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi075.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-28T11:16:46.859 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.094) 0:11:22.876 ***** 2019-11-28T11:16:46.912 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-11-28T11:16:46.915 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-28T11:16:46.955 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.096) 0:11:22.972 ***** 2019-11-28T11:16:46.962 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-11-28T11:16:46.964 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.004 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:46 +0000 (0:00:00.049) 0:11:23.022 ***** 2019-11-28T11:16:47.068 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-28T11:16:47.070 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Enable SELinux] *********************************************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-11-28T11:16:47.120 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.115) 0:11:23.137 ***** 2019-11-28T11:16:47.127 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-11-28T11:16:47.128 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.130 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.132 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.175 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.055) 0:11:23.193 ***** 2019-11-28T11:16:47.184 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-11-28T11:16:47.185 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-28T11:16:47.187 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.226 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.051) 0:11:23.244 ***** 2019-11-28T11:16:47.268 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.038) 0:11:23.282 ***** 2019-11-28T11:16:47.271 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-11-28T11:16:47.273 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.274 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi075.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.276 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.277 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-11-28T11:16:47.317 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.051) 0:11:23.334 ***** 2019-11-28T11:16:47.353 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.036) 0:11:23.370 ***** 2019-11-28T11:16:47.360 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-11-28T11:16:47.361 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.363 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:16:47.366 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-11-28T11:16:47.367 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.406 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.052) 0:11:23.423 ***** 2019-11-28T11:16:47.444 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.037) 0:11:23.461 ***** 2019-11-28T11:16:47.481 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.037) 0:11:23.499 ***** 2019-11-28T11:16:47.487 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:16:47.489 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add sources list] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.530 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.048) 0:11:23.548 ***** 2019-11-28T11:16:47.587 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.056) 0:11:23.604 ***** 2019-11-28T11:16:47.595 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-11-28T11:16:47.596 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.599 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.602 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} TASK [testnode : Install apt keys] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.656 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.069) 0:11:23.673 ***** 2019-11-28T11:16:47.697 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.041) 0:11:23.714 ***** 2019-11-28T11:16:47.705 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-11-28T11:16:47.707 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-28T11:16:47.721 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.763 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.065) 0:11:23.780 ***** 2019-11-28T11:16:47.800 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.036) 0:11:23.817 ***** 2019-11-28T11:16:47.849 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.049) 0:11:23.867 ***** 2019-11-28T11:16:47.857 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-11-28T11:16:47.858 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.860 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.862 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.864 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-11-28T11:16:47.865 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:47.911 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.061) 0:11:23.928 ***** 2019-11-28T11:16:47.955 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.044) 0:11:23.973 ***** 2019-11-28T11:16:47.998 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:47 +0000 (0:00:00.042) 0:11:24.015 ***** 2019-11-28T11:16:48.007 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-28T11:16:48.008 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:48.011 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:48.056 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.058) 0:11:24.074 ***** 2019-11-28T11:16:48.095 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.038) 0:11:24.113 ***** 2019-11-28T11:16:48.106 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:16:48.109 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:48.146 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.051) 0:11:24.164 ***** 2019-11-28T11:16:48.192 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.045) 0:11:24.209 ***** 2019-11-28T11:16:48.198 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-11-28T11:16:48.207 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:48.245 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.051) 0:11:24.261 ***** 2019-11-28T11:16:48.282 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.038) 0:11:24.299 ***** 2019-11-28T11:16:48.290 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-11-28T11:16:48.292 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:16:48.294 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:48.332 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.050) 0:11:24.350 ***** 2019-11-28T11:16:48.369 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.036) 0:11:24.386 ***** 2019-11-28T11:16:48.376 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-28T11:16:48.378 INFO:teuthology.task.ansible.out:skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:48.416 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.047) 0:11:24.433 ***** 2019-11-28T11:16:48.471 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.053) 0:11:24.487 ***** 2019-11-28T11:16:48.481 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Install packages] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:48.521 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.051) 0:11:24.538 ***** 2019-11-28T11:16:48.567 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.043) 0:11:24.582 ***** 2019-11-28T11:16:48.572 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:48.574 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:48.623 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.056) 0:11:24.639 ***** 2019-11-28T11:16:48.659 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.037) 0:11:24.676 ***** 2019-11-28T11:16:48.668 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi076.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:16:48.673 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:48.710 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.051) 0:11:24.728 ***** 2019-11-28T11:16:48.756 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.044) 0:11:24.772 ***** 2019-11-28T11:16:48.791 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.036) 0:11:24.809 ***** 2019-11-28T11:16:48.798 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi075.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:48.799 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:48.840 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.048) 0:11:24.857 ***** 2019-11-28T11:16:48.879 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.039) 0:11:24.897 ***** 2019-11-28T11:16:48.887 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-11-28T11:16:48.890 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:48.891 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:48.943 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.064) 0:11:24.961 ***** 2019-11-28T11:16:48.992 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:48 +0000 (0:00:00.048) 0:11:25.009 ***** 2019-11-28T11:16:48.999 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-11-28T11:16:49.001 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T11:16:49.003 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-11-28T11:16:49.004 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:49.042 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.050) 0:11:25.060 ***** 2019-11-28T11:16:49.095 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.050) 0:11:25.111 ***** 2019-11-28T11:16:49.102 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-28T11:16:49.109 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi075.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.007381", "end": "2019-11-28 11:16:49.063749", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-28 11:16:49.056368", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:49.154 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.060) 0:11:25.171 ***** 2019-11-28T11:16:49.194 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.039) 0:11:25.211 ***** 2019-11-28T11:16:49.201 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-28T11:16:49.203 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:49.248 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.054) 0:11:25.265 ***** 2019-11-28T11:16:49.287 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.039) 0:11:25.305 ***** 2019-11-28T11:16:49.294 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:49.296 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi075.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003081", "end": "2019-11-28 11:16:49.245414", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-28 11:16:49.242333", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:49.298 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:49.337 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.049) 0:11:25.354 ***** 2019-11-28T11:16:49.385 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.041) 0:11:25.396 ***** TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-28T11:16:49.388 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:49.426 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.047) 0:11:25.443 ***** 2019-11-28T11:16:49.436 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:49.475 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.049) 0:11:25.493 ***** 2019-11-28T11:16:49.482 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-28T11:16:49.483 INFO:teuthology.task.ansible.out:ok: [smithi075.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002934", "end": "2019-11-28 11:16:49.410205", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-28 11:16:49.407271", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:49.486 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:49.525 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.049) 0:11:25.542 ***** 2019-11-28T11:16:49.591 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-11-28T11:16:49.593 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true} 2019-11-28T11:16:49.639 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.114) 0:11:25.657 ***** 2019-11-28T11:16:49.647 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-28T11:16:49.649 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi075.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003546", "end": "2019-11-28 11:16:49.581716", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-28 11:16:49.578170", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:49.703 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.064) 0:11:25.721 ***** 2019-11-28T11:16:49.747 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.036) 0:11:25.757 ***** 2019-11-28T11:16:49.749 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.006795", "end": "2019-11-28 11:16:49.656258", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-28 11:16:49.649463", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:49.752 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:49.793 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.053) 0:11:25.810 ***** 2019-11-28T11:16:49.806 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-11-28T11:16:49.854 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.060) 0:11:25.871 ***** 2019-11-28T11:16:49.861 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-28T11:16:49.864 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:49.903 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.048) 0:11:25.920 ***** 2019-11-28T11:16:49.952 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-28T11:16:49.953 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003128", "end": "2019-11-28 11:16:49.831225", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-28 11:16:49.828097", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:49.955 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-11-28T11:16:49.994 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:49 +0000 (0:00:00.091) 0:11:26.012 ***** 2019-11-28T11:16:50.002 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-28T11:16:50.005 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:50.046 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.051) 0:11:26.064 ***** 2019-11-28T11:16:50.055 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-11-28T11:16:50.057 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-11-28T11:16:50.059 INFO:teuthology.task.ansible.out:changed: [smithi075.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-28T11:16:50.124 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.077) 0:11:26.142 ***** 2019-11-28T11:16:50.132 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-28T11:16:50.134 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:50.171 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.046) 0:11:26.188 ***** 2019-11-28T11:16:50.208 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:50.211 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:50.253 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.082) 0:11:26.271 ***** 2019-11-28T11:16:50.293 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.038) 0:11:26.309 ***** 2019-11-28T11:16:50.300 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-28T11:16:50.303 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:50.340 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.048) 0:11:26.358 ***** 2019-11-28T11:16:50.349 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:50.388 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.048) 0:11:26.406 ***** 2019-11-28T11:16:50.397 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T11:16:50.399 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:50.435 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.046) 0:11:26.453 ***** 2019-11-28T11:16:50.443 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-11-28T11:16:50.445 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:50.482 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.046) 0:11:26.499 ***** 2019-11-28T11:16:50.497 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:50.531 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.048) 0:11:26.548 ***** 2019-11-28T11:16:50.539 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-11-28T11:16:50.541 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:50.579 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.047) 0:11:26.596 ***** 2019-11-28T11:16:50.586 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-28T11:16:50.589 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:50.627 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.047) 0:11:26.644 ***** 2019-11-28T11:16:50.635 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-11-28T11:16:50.637 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:50.675 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.048) 0:11:26.692 ***** 2019-11-28T11:16:50.683 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-28T11:16:50.685 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:50.726 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.051) 0:11:26.744 ***** 2019-11-28T11:16:50.738 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-11-28T11:16:50.741 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:50.778 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.051) 0:11:26.796 ***** 2019-11-28T11:16:50.788 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T11:16:50.789 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:50.830 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.052) 0:11:26.848 ***** 2019-11-28T11:16:50.871 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T11:16:50.873 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:50.925 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:50 +0000 (0:00:00.091) 0:11:26.939 ***** 2019-11-28T11:16:51.059 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-28T11:16:51.060 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:01.004169", "end": "2019-11-28 11:16:51.014062", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-28 11:16:50.009893", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:51.234 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003645", "end": "2019-11-28 11:16:51.207779", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-28 11:16:51.204134", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:16:51.278 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:51 +0000 (0:00:00.356) 0:11:27.296 ***** 2019-11-28T11:16:51.309 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-11-28T11:16:51.349 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:51 +0000 (0:00:00.070) 0:11:27.367 ***** 2019-11-28T11:16:51.516 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "secontext": "system_u:object_r:exports_t:s0", "size": 578, "state": "file", "uid": 0} 2019-11-28T11:16:51.554 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:51 +0000 (0:00:00.204) 0:11:27.571 ***** 2019-11-28T11:16:51.564 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-11-28T11:16:51.566 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-28T11:16:51.843 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-28T11:16:51.846 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nfs-server", "status": {"ActiveEnterTimestamp": "Thu 2019-11-28 11:02:48 UTC", "ActiveEnterTimestampMonotonic": "20352612", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network-online.target -.mount rpc-statd.service rpcbind.socket nfs-config.service nfs-idmapd.service gssproxy.service local-fs.target proc-fs-nfsd.mount nfs-mountd.service systemd-journald.socket tmp.mount rpc-gssd.service system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-11-28 11:02:48 UTC", "AssertTimestampMonotonic": "20128676", "Before": "rpc-statd-notify.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BoundBy": "nfs-idmapd.service nfs-mountd.service", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-11-28 11:02:48 UTC", "ConditionTimestampMonotonic": "20128676", "ControlGroup": "/system.slice/nfs-server.service", "ControlPID": "0", "DefaultDependencies": "no", "Delegate": "no", "Description": "NFS server and services", "DevicePolicy": "auto", "DropInPaths": "/run/systemd/generator/nfs-server.service.d/order-with-mounts.conf", "EnvironmentFile": "/run/sysconfig/nfs-utils (ignore_errors=yes)", "ExecMainCode": "1", "ExecMainExitTimestamp": "Thu 2019-11-28 11:02:48 UTC", "ExecMainExitTimestampMonotonic": "20323926", "ExecMainPID": "2153", "ExecMainStartTimestamp": "Thu 2019-11-28 11:02:48 UTC", "ExecMainStartTimestampMonotonic": "20220032", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -r ; ignore_errors=yes ; start_time=[n/a] ; stop 2019-11-28T11:16:51.847 INFO:teuthology.task.ansible.out:_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/rpc.nfsd ; argv[]=/usr/sbin/rpc.nfsd $RPCNFSDARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/bin/sh ; argv[]=/bin/sh -c if systemctl -q is-active gssproxy; then systemctl reload gssproxy ; fi ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPre": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -r ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/rpc.nfsd ; argv[]=/usr/sbin/rpc.nfsd 0 ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nfs-server.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nfs-server.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-11-28 11:02:48 UTC", "InactiveExitTimestampMonotonic": "20129386", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "Me 2019-11-28T11:16:51.849 INFO:teuthology.task.ansible.out:moryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nfs-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "yes", "Requires": "-.mount network.target nfs-mountd.service tmp.mount proc-fs-nfsd.mount", "RequiresMountsFor": "/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "exited", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "0", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "oneshot", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "nfs-idmapd.service rpc-statd.service rpcbind.socket auth-rpcgss-module.service network-online.target rpc-statd-notify.service nfs-config.service system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T11:16:51.881 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:51 +0000 (0:00:00.326) 0:11:27.898 ***** 2019-11-28T11:16:51.911 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-28T11:16:51.914 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:51.952 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:51 +0000 (0:00:00.071) 0:11:27.969 ***** 2019-11-28T11:16:51.991 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-28T11:16:51.994 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:52.029 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:52 +0000 (0:00:00.077) 0:11:28.047 ***** 2019-11-28T11:16:52.059 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:52.098 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:52 +0000 (0:00:00.068) 0:11:28.115 ***** 2019-11-28T11:16:52.129 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T11:16:52.131 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:52.171 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:52 +0000 (0:00:00.072) 0:11:28.188 ***** 2019-11-28T11:16:52.211 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-28T11:16:52.213 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:52.249 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:52 +0000 (0:00:00.077) 0:11:28.266 ***** 2019-11-28T11:16:52.279 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T11:16:52.281 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:52.315 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:52 +0000 (0:00:00.066) 0:11:28.332 ***** 2019-11-28T11:16:52.334 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-11-28T11:16:52.336 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-29.el7.x86_64 providing ntp is already installed"]} 2019-11-28T11:16:52.372 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:52 +0000 (0:00:00.057) 0:11:28.390 ***** 2019-11-28T11:16:52.379 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T11:16:52.381 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:52.428 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:52 +0000 (0:00:00.055) 0:11:28.445 ***** 2019-11-28T11:16:52.435 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-11-28T11:16:52.438 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:52.474 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:52 +0000 (0:00:00.047) 0:11:28.492 ***** 2019-11-28T11:16:52.482 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:52.520 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:52 +0000 (0:00:00.045) 0:11:28.538 ***** 2019-11-28T11:16:52.527 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-11-28T11:16:52.530 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:52.571 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:52 +0000 (0:00:00.051) 0:11:28.589 ***** 2019-11-28T11:16:52.579 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-11-28T11:16:52.583 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:52.618 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:52 +0000 (0:00:00.046) 0:11:28.635 ***** 2019-11-28T11:16:52.647 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-28T11:16:52.650 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:52.684 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:52 +0000 (0:00:00.066) 0:11:28.702 ***** 2019-11-28T11:16:52.723 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-28T11:16:52.726 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:52.776 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:52 +0000 (0:00:00.083) 0:11:28.786 ***** 2019-11-28T11:16:52.803 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:52.842 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:52 +0000 (0:00:00.073) 0:11:28.859 ***** 2019-11-28T11:16:52.871 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-11-28T11:16:52.873 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:52.909 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:52 +0000 (0:00:00.066) 0:11:28.926 ***** 2019-11-28T11:16:52.938 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-11-28T11:16:52.940 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:52.974 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:52 +0000 (0:00:00.064) 0:11:28.991 ***** 2019-11-28T11:16:53.013 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-11-28T11:16:53.016 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:53.054 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:53 +0000 (0:00:00.080) 0:11:29.071 ***** 2019-11-28T11:16:53.093 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-11-28T11:16:53.095 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:53.147 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:53 +0000 (0:00:00.093) 0:11:29.165 ***** 2019-11-28T11:16:53.160 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-11-28T11:16:53.164 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-28T11:16:53.202 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:53 +0000 (0:00:00.054) 0:11:29.219 ***** 2019-11-28T11:16:53.213 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:53.256 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:53 +0000 (0:00:00.053) 0:11:29.273 ***** 2019-11-28T11:16:53.265 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-11-28T11:16:53.266 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:53.312 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:53 +0000 (0:00:00.052) 0:11:29.325 ***** 2019-11-28T11:16:53.315 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-11-28T11:16:53.316 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:53.364 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:53 +0000 (0:00:00.055) 0:11:29.381 ***** 2019-11-28T11:16:53.393 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-11-28T11:16:53.395 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:53.436 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:53 +0000 (0:00:00.071) 0:11:29.452 ***** 2019-11-28T11:16:53.464 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-11-28T11:16:53.467 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:53.510 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:53 +0000 (0:00:00.075) 0:11:29.527 ***** 2019-11-28T11:16:53.549 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:16:53.552 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-28T11:16:53.589 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:53 +0000 (0:00:00.078) 0:11:29.606 ***** 2019-11-28T11:16:53.628 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi016.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:53.640 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-11-28T11:16:53.651 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:53.663 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:53.664 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:53.675 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:53.687 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-28T11:16:53.732 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:53 +0000 (0:00:00.144) 0:11:29.750 ***** 2019-11-28T11:16:53.904 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-11-28T11:16:53.905 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003471", "end": "2019-11-28 11:16:53.877710", "rc": 0, "start": "2019-11-28 11:16:53.874239", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-28T11:16:53.957 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:53 +0000 (0:00:00.223) 0:11:29.974 ***** 2019-11-28T11:16:53.991 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:54.054 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:54 +0000 (0:00:00.095) 0:11:30.069 ***** 2019-11-28T11:16:54.093 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-11-28T11:16:54.096 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:54.147 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:54 +0000 (0:00:00.094) 0:11:30.164 ***** 2019-11-28T11:16:54.177 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-11-28T11:16:54.180 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:54.215 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:54 +0000 (0:00:00.068) 0:11:30.233 ***** 2019-11-28T11:16:54.246 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-11-28T11:16:54.249 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:54.286 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:54 +0000 (0:00:00.070) 0:11:30.304 ***** 2019-11-28T11:16:54.614 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-11-28T11:16:54.616 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "syslog.target -.mount system.slice basic.target tmp.mount sntp.service ntpdate.service systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "chronyd.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-11-28T11:16:54.619 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-11-28T11:16:54.621 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T11:16:54.672 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:54 +0000 (0:00:00.373) 0:11:30.677 ***** 2019-11-28T11:16:56.346 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-11-28T11:16:56.348 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-29.el7.x86_64 providing ntp is already installed"]} 2019-11-28T11:16:56.401 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:56 +0000 (0:00:01.741) 0:11:32.418 ***** 2019-11-28T11:16:56.442 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-11-28T11:16:56.444 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:56.485 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:56 +0000 (0:00:00.084) 0:11:32.503 ***** 2019-11-28T11:16:56.515 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-11-28T11:16:56.518 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:56.554 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:56 +0000 (0:00:00.068) 0:11:32.571 ***** 2019-11-28T11:16:57.092 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-28T11:16:57.132 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:57 +0000 (0:00:00.576) 0:11:33.147 ***** 2019-11-28T11:16:57.159 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:16:57.202 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:57 +0000 (0:00:00.069) 0:11:33.217 ***** 2019-11-28T11:16:57.491 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-11-28T11:16:57.493 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sntp.service basic.target ntpdate.service systemd-journald.socket tmp.mount syslog.target system.slice -.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target chronyd.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-11-28T11:16:57.496 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-11-28T11:16:57.499 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T11:16:57.533 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:57 +0000 (0:00:00.333) 0:11:33.550 ***** 2019-11-28T11:16:59.799 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-11-28T11:16:59.801 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.158-2.el7.x86_64 providing device-mapper is already installed"]} 2019-11-28T11:16:59.863 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:59 +0000 (0:00:02.330) 0:11:35.880 ***** 2019-11-28T11:16:59.914 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-28T11:16:59.916 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={u'block_used': 13578597, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745887, u'size_available': 928751153152, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968937, u'device': u'/dev/sda1', u'inode_used': 86039, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745887, "block_size": 4096, "block_total": 240324484, "block_used": 13578597, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968937, "inode_total": 61054976, "inode_used": 86039, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751153152, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}} 2019-11-28T11:16:59.955 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:16:59 +0000 (0:00:00.092) 0:11:35.973 ***** 2019-11-28T11:17:00.156 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-11-28T11:17:00.158 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.006230", "end": "2019-11-28 11:17:00.129735", "rc": 0, "start": "2019-11-28 11:17:00.123505", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:00.199 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:00 +0000 (0:00:00.243) 0:11:36.216 ***** 2019-11-28T11:17:00.266 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi016.front.sepia.ceph.com] => (item={u'block_used': 13578597, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745887, u'size_available': 928751153152, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968937, u'device': u'/dev/sda1', u'inode_used': 86039, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745887, "block_size": 4096, "block_total": 240324484, "block_used": 13578597, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968937, "inode_total": 61054976, "inode_used": 86039, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751153152, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:00.304 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:00 +0000 (0:00:00.105) 0:11:36.321 ***** 2019-11-28T11:17:00.343 INFO:teuthology.task.ansible.out: 2019-11-28T11:17:00.345 INFO:teuthology.task.ansible.out:TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-11-28T11:17:00.383 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:00 +0000 (0:00:00.079) 0:11:36.401 ***** 2019-11-28T11:17:00.436 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:17:00.438 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HKZ5', u'wwn-0x5000c50087198ecb'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4HKZ5', u'wwn': u'0x5000c50087198ecb', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HKZ5-part1', u'wwn-0x5000c50087198ecb-part1'], u'uuids': [u'd74b555f-5ed5-42c3-b456-f59429ca50cb']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HKZ5", "wwn-0x5000c50087198ecb"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HKZ5-part1", "wwn-0x5000c50087198ecb-part1"], "labels": [], "masters": [], "uuids": ["d74b555f-5ed5-42c3-b456-f59429ca50cb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HKZ5", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-28T11:17:00.439 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50087198ecb"}}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:01.337 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-11-28T11:17:01.340 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-28T11:17:01.380 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:01 +0000 (0:00:00.996) 0:11:37.398 ***** 2019-11-28T11:17:01.419 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-11-28T11:17:01.422 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:01.466 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:01 +0000 (0:00:00.085) 0:11:37.483 ***** 2019-11-28T11:17:01.651 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-11-28T11:17:01.653 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-28T11:17:01.714 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:01 +0000 (0:00:00.247) 0:11:37.731 ***** 2019-11-28T11:17:01.775 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:17:01.777 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-JigW1N-KmmT-Zp3B-BDCz-IdTY-JejE-kwQccX', u'nvme-INTEL_SSDPED1D480GA_PHMB7513002C480DGN', u'nvme-nvme.8086-50484d42373531333030324334383044474e-494e54454c2053534450454431443438304741-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', u'support_discard': u'512', u'model': u'INTEL SSDPED1D480GA', u'size': u'447.13 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'937703088', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.155753", "end": "2019-11-28 11:17:01.739799", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-JigW1N-KmmT-Zp3B-BDCz-IdTY-JejE-kwQccX", "nvme-INTEL_SSDPED1D480GA_PHMB7513002C480DGN", "nvme-nvme.8086-50484d42373531333030324334383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:17:00.584046", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGP 2019-11-28T11:17:01.780 INFO:teuthology.task.ansible.out:T data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:17:02.253 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-28T11:17:02.308 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:02 +0000 (0:00:00.584) 0:11:38.316 ***** 2019-11-28T11:17:03.012 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTt39R3LwHcfM8sVYpkZUKe4IkNkUUl2fP'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.037476", "end": "2019-11-28 11:17:02.976355", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTt39R3LwHcfM8sVYpkZUKe4IkNkUUl2fP"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:17:01.938879", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:17:03.321 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-11-28T11:17:03.324 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-28T11:17:03.360 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:03 +0000 (0:00:01.061) 0:11:39.377 ***** 2019-11-28T11:17:03.388 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-11-28T11:17:03.391 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:03.441 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:03 +0000 (0:00:00.075) 0:11:39.452 ***** 2019-11-28T11:17:03.475 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-11-28T11:17:03.478 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-11-28T11:17:03.533 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:03 +0000 (0:00:00.097) 0:11:39.550 ***** 2019-11-28T11:17:03.556 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-11-28T11:17:03.559 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-28T11:17:03.606 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:03 +0000 (0:00:00.073) 0:11:39.624 ***** 2019-11-28T11:17:03.652 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:03.691 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:03 +0000 (0:00:00.085) 0:11:39.709 ***** 2019-11-28T11:17:03.721 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-11-28T11:17:03.723 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-28T11:17:03.772 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:03 +0000 (0:00:00.075) 0:11:39.785 ***** 2019-11-28T11:17:03.798 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-11-28T11:17:03.800 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:03.839 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:03 +0000 (0:00:00.071) 0:11:39.857 ***** 2019-11-28T11:17:03.869 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-11-28T11:17:03.872 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-28T11:17:03.909 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:03 +0000 (0:00:00.070) 0:11:39.927 ***** 2019-11-28T11:17:03.916 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-11-28T11:17:03.920 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-28T11:17:03.963 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:03 +0000 (0:00:00.053) 0:11:39.980 ***** 2019-11-28T11:17:03.971 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-11-28T11:17:03.972 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:04.013 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:04 +0000 (0:00:00.048) 0:11:40.029 ***** 2019-11-28T11:17:04.194 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi080.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-28T11:17:04.240 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:04 +0000 (0:00:00.228) 0:11:40.257 ***** 2019-11-28T11:17:04.247 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:17:04.249 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTdIeAesDXAl1ckB1PTs87w5EYJUyeIYfa'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.051159", "end": "2019-11-28 11:17:04.218651", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTdIeAesDXAl1ckB1PTs87w5EYJUyeIYfa"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:17:03.167492", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:17:04.412 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-11-28T11:17:04.414 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-28T11:17:04.456 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:04 +0000 (0:00:00.215) 0:11:40.473 ***** 2019-11-28T11:17:04.474 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-11-28T11:17:04.476 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-28T11:17:04.512 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:04 +0000 (0:00:00.056) 0:11:40.530 ***** 2019-11-28T11:17:04.519 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-11-28T11:17:04.521 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:04.558 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:04 +0000 (0:00:00.045) 0:11:40.576 ***** 2019-11-28T11:17:04.598 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-11-28T11:17:04.600 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-11-28T11:17:04.610 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-11-28T11:17:04.612 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-11-28T11:17:04.622 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-11-28T11:17:04.665 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:04 +0000 (0:00:00.106) 0:11:40.683 ***** 2019-11-28T11:17:04.707 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-11-28T11:17:04.708 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:04.710 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:04.712 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:04.724 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi080.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:04.768 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:04 +0000 (0:00:00.102) 0:11:40.785 ***** 2019-11-28T11:17:04.798 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:04.843 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:04 +0000 (0:00:00.075) 0:11:40.861 ***** 2019-11-28T11:17:04.874 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-11-28T11:17:04.877 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:04.920 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:04 +0000 (0:00:00.076) 0:11:40.937 ***** 2019-11-28T11:17:04.950 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-11-28T11:17:04.952 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:04.999 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:04 +0000 (0:00:00.077) 0:11:41.014 ***** 2019-11-28T11:17:05.029 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-11-28T11:17:05.032 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:05.075 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:05 +0000 (0:00:00.078) 0:11:41.093 ***** 2019-11-28T11:17:05.106 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-11-28T11:17:05.108 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:05.156 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:05 +0000 (0:00:00.080) 0:11:41.173 ***** 2019-11-28T11:17:05.186 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:05.232 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:05 +0000 (0:00:00.076) 0:11:41.249 ***** 2019-11-28T11:17:05.263 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-11-28T11:17:05.265 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:05.312 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:05 +0000 (0:00:00.079) 0:11:41.329 ***** 2019-11-28T11:17:05.341 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-28T11:17:05.344 INFO:teuthology.task.ansible.out:skipping: [smithi080.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:05.388 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:05 +0000 (0:00:00.076) 0:11:41.405 ***** 2019-11-28T11:17:05.482 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:17:05.484 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTq8jCzG7d7PrRSflLBcKWqd4y37VHivBe'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.048019", "end": "2019-11-28 11:17:05.451708", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTq8jCzG7d7PrRSflLBcKWqd4y37VHivBe"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:17:04.403689", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:17:05.527 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-11-28T11:17:05.528 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-28T11:17:05.567 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:05 +0000 (0:00:00.179) 0:11:41.585 ***** 2019-11-28T11:17:05.597 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-28T11:17:05.598 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.006826", "end": "2019-11-28 11:17:05.558003", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-28 11:17:05.551177", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Purge resolvconf] ********************************************* 2019-11-28T11:17:05.600 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:05.641 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:05 +0000 (0:00:00.073) 0:11:41.658 ***** 2019-11-28T11:17:05.671 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-11-28T11:17:05.673 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-11-28T11:17:05.714 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:05 +0000 (0:00:00.071) 0:11:41.730 ***** 2019-11-28T11:17:05.785 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-28T11:17:05.786 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003225", "end": "2019-11-28 11:17:05.754716", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-28 11:17:05.751491", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:05.903 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-28T11:17:05.950 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:05 +0000 (0:00:00.237) 0:11:41.967 ***** 2019-11-28T11:17:05.978 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-11-28T11:17:05.980 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:06.020 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:06 +0000 (0:00:00.070) 0:11:42.038 ***** 2019-11-28T11:17:06.060 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-11-28T11:17:06.062 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-28T11:17:06.100 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:06 +0000 (0:00:00.079) 0:11:42.117 ***** 2019-11-28T11:17:06.129 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-11-28T11:17:06.131 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:06.169 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:06 +0000 (0:00:00.069) 0:11:42.186 ***** 2019-11-28T11:17:06.356 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-11-28T11:17:06.357 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-28T11:17:06.394 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:06 +0000 (0:00:00.225) 0:11:42.412 ***** 2019-11-28T11:17:06.579 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi076.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-28T11:17:06.614 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:06 +0000 (0:00:00.219) 0:11:42.632 ***** 2019-11-28T11:17:06.654 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-11-28T11:17:06.656 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:06.692 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:06 +0000 (0:00:00.077) 0:11:42.710 ***** 2019-11-28T11:17:06.722 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:17:06.724 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTkCipVg6XehcaM16HrJtYr7OL0DbafX5M'], u'uuids': [u'cfcb414a-d94a-435c-a47b-4dac8a48cfcc']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.038263", "end": "2019-11-28 11:17:06.684410", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTkCipVg6XehcaM16HrJtYr7OL0DbafX5M"], "labels": [], "masters": [], "uuids": ["cfcb414a-d94a-435c-a47b-4dac8a48cfcc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:17:05.646147", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:17:06.727 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi076.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-11-28T11:17:06.736 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-11-28T11:17:06.737 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-11-28T11:17:06.748 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-11-28T11:17:06.750 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-11-28T11:17:06.787 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:06 +0000 (0:00:00.094) 0:11:42.804 ***** 2019-11-28T11:17:06.827 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-11-28T11:17:06.830 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:06.841 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:06.852 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:06.854 INFO:teuthology.task.ansible.out: 2019-11-28T11:17:06.893 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:06 +0000 (0:00:00.105) 0:11:42.910 ***** 2019-11-28T11:17:06.921 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:17:06.925 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:06.964 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:06 +0000 (0:00:00.069) 0:11:42.980 ***** 2019-11-28T11:17:06.982 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi080.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:01.004115", "end": "2019-11-28 11:17:06.933156", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-28 11:17:05.929041", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:06.993 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-11-28T11:17:06.995 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:07.031 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:07 +0000 (0:00:00.068) 0:11:43.048 ***** 2019-11-28T11:17:07.060 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:07.100 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:07 +0000 (0:00:00.068) 0:11:43.117 ***** 2019-11-28T11:17:07.129 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-11-28T11:17:07.132 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:07.168 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:07 +0000 (0:00:00.067) 0:11:43.184 ***** 2019-11-28T11:17:07.174 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-28T11:17:07.176 INFO:teuthology.task.ansible.out:ok: [smithi080.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003577", "end": "2019-11-28 11:17:07.140691", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-28 11:17:07.137114", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:07.220 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:07 +0000 (0:00:00.050) 0:11:43.235 ***** 2019-11-28T11:17:07.225 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-11-28T11:17:07.227 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:07.268 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:07 +0000 (0:00:00.050) 0:11:43.285 ***** 2019-11-28T11:17:07.275 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-11-28T11:17:07.314 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:07 +0000 (0:00:00.046) 0:11:43.331 ***** 2019-11-28T11:17:07.321 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-28T11:17:07.323 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:07.365 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:07 +0000 (0:00:00.050) 0:11:43.382 ***** 2019-11-28T11:17:07.395 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-11-28T11:17:07.397 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:07.435 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:07 +0000 (0:00:00.070) 0:11:43.452 ***** 2019-11-28T11:17:07.463 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-28T11:17:07.466 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:07.503 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:07 +0000 (0:00:00.067) 0:11:43.520 ***** 2019-11-28T11:17:07.509 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-11-28T11:17:07.511 INFO:teuthology.task.ansible.out:changed: [smithi080.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-28T11:17:07.711 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-28T11:17:07.713 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.007060", "end": "2019-11-28 11:17:07.677350", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-28 11:17:07.670290", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:07.892 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003226", "end": "2019-11-28 11:17:07.849321", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-28 11:17:07.846095", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:07.946 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T11:17:07.963 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTS2pY2EBX7qQfiTF5AxcCDW5sqg1xaFIN'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.037068", "end": "2019-11-28 11:17:07.917862", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTS2pY2EBX7qQfiTF5AxcCDW5sqg1xaFIN"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:17:06.880794", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:17:08.010 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:08 +0000 (0:00:00.506) 0:11:44.026 ***** 2019-11-28T11:17:08.059 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-28T11:17:08.060 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.003065", "end": "2019-11-28 11:17:08.030732", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-28 11:17:08.027667", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:08.062 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi016.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HKZ5', u'wwn-0x5000c50087198ecb'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4HKZ5', u'wwn': u'0x5000c50087198ecb', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HKZ5-part1', u'wwn-0x5000c50087198ecb-part1'], u'uuids': [u'd74b555f-5ed5-42c3-b456-f59429ca50cb']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HKZ5", "wwn-0x5000c50087198ecb"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HKZ5-part1", "wwn-0x5000c50087198ecb-part1"], "labels": [], "masters": [], "uuids": ["d74b555f-5ed5-42c3-b456-f59429ca50cb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": " 2019-11-28T11:17:08.065 INFO:teuthology.task.ansible.out:512", "serial": "Z1W4HKZ5", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087198ecb"}}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:08.284 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-JigW1N-KmmT-Zp3B-BDCz-IdTY-JejE-kwQccX', u'nvme-INTEL_SSDPED1D480GA_PHMB7513002C480DGN', u'nvme-nvme.8086-50484d42373531333030324334383044474e-494e54454c2053534450454431443438304741-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', u'support_discard': u'512', u'model': u'INTEL SSDPED1D480GA', u'size': u'447.13 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'937703088', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.039037", "end": "2019-11-28 11:17:08.259459", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-JigW1N-KmmT-Zp3B-BDCz-IdTY-JejE-kwQccX", "nvme-INTEL_SSDPED1D480GA_PHMB7513002C480DGN", "nvme-nvme.8086-50484d42373531333030324334383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:17:08.220422", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.035763 2019-11-28T11:17:08.287 INFO:teuthology.task.ansible.out:7 s, 3.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0357637 s, 3.2 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:08.557 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTt39R3LwHcfM8sVYpkZUKe4IkNkUUl2fP'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.099202", "end": "2019-11-28 11:17:08.535176", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTt39R3LwHcfM8sVYpkZUKe4IkNkUUl2fP"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:17:08.435974", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0961749 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0961749 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:08.841 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTdIeAesDXAl1ckB1PTs87w5EYJUyeIYfa'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.098916", "end": "2019-11-28 11:17:08.809323", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTdIeAesDXAl1ckB1PTs87w5EYJUyeIYfa"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:17:08.710407", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0958265 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0958265 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:09.116 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTq8jCzG7d7PrRSflLBcKWqd4y37VHivBe'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.099142", "end": "2019-11-28 11:17:09.084278", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTq8jCzG7d7PrRSflLBcKWqd4y37VHivBe"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:17:08.985136", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0961025 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0961025 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:09.230 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-28T11:17:09.232 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:01.004637", "end": "2019-11-28 11:17:09.198633", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-28 11:17:08.193996", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:09.287 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:09 +0000 (0:00:01.278) 0:11:45.304 ***** 2019-11-28T11:17:09.328 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-11-28T11:17:09.381 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:09 +0000 (0:00:00.093) 0:11:45.398 ***** 2019-11-28T11:17:09.399 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T11:17:09.401 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTkCipVg6XehcaM16HrJtYr7OL0DbafX5M'], u'uuids': [u'cfcb414a-d94a-435c-a47b-4dac8a48cfcc']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.100139", "end": "2019-11-28 11:17:09.368593", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTkCipVg6XehcaM16HrJtYr7OL0DbafX5M"], "labels": [], "masters": [], "uuids": ["cfcb414a-d94a-435c-a47b-4dac8a48cfcc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:17:09.268454", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0970721 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0970721 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:09.568 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-11-28T11:17:09.570 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-28T11:17:09.739 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T11:17:09.741 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTS2pY2EBX7qQfiTF5AxcCDW5sqg1xaFIN'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.099443", "end": "2019-11-28 11:17:09.671836", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Y44KNvzwcKbqfI4QVtbeauyyGgXXUTKTS2pY2EBX7qQfiTF5AxcCDW5sqg1xaFIN"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:17:09.572393", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0963393 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0963393 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:09.787 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:09 +0000 (0:00:00.406) 0:11:45.804 ***** 2019-11-28T11:17:10.069 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi016.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.079845", "end": "2019-11-28 11:17:10.042649", "rc": 0, "start": "2019-11-28 11:17:09.962804", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:10.109 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:10 +0000 (0:00:00.322) 0:11:46.127 ***** 2019-11-28T11:17:10.349 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-11-28T11:17:10.352 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.047534", "end": "2019-11-28 11:17:10.326596", "rc": 0, "start": "2019-11-28 11:17:10.279062", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:10.392 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:10 +0000 (0:00:00.282) 0:11:46.410 ***** 2019-11-28T11:17:10.445 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-11-28T11:17:10.497 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:10 +0000 (0:00:00.104) 0:11:46.514 ***** 2019-11-28T11:17:10.538 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-11-28T11:17:10.540 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:10.609 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:10 +0000 (0:00:00.111) 0:11:46.626 ***** 2019-11-28T11:17:10.641 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-11-28T11:17:10.643 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:10.682 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:10 +0000 (0:00:00.073) 0:11:46.700 ***** 2019-11-28T11:17:10.711 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-28T11:17:10.714 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:10.779 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:10 +0000 (0:00:00.096) 0:11:46.796 ***** 2019-11-28T11:17:10.828 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-11-28T11:17:10.830 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:10.872 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:10 +0000 (0:00:00.088) 0:11:46.885 ***** 2019-11-28T11:17:11.057 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-11-28T11:17:11.059 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:17:11.096 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:11 +0000 (0:00:00.228) 0:11:47.113 ***** 2019-11-28T11:17:11.138 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-28T11:17:11.139 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={u'block_used': 13578597, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745887, u'size_available': 928751153152, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968937, u'device': u'/dev/sda1', u'inode_used': 86039, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745887, "block_size": 4096, "block_total": 240324484, "block_used": 13578597, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968937, "inode_total": 61054976, "inode_used": 86039, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751153152, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:11.184 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:11 +0000 (0:00:00.088) 0:11:47.202 ***** 2019-11-28T11:17:11.215 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-11-28T11:17:11.219 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:11.265 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:11 +0000 (0:00:00.080) 0:11:47.283 ***** 2019-11-28T11:17:11.306 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:17:11.308 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:11.358 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:11 +0000 (0:00:00.092) 0:11:47.375 ***** 2019-11-28T11:17:11.398 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:17:11.400 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:11.451 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:11 +0000 (0:00:00.093) 0:11:47.469 ***** 2019-11-28T11:17:11.484 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-11-28T11:17:11.486 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:11.526 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:11 +0000 (0:00:00.074) 0:11:47.543 ***** 2019-11-28T11:17:11.582 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-11-28T11:17:11.584 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:11.626 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:11 +0000 (0:00:00.099) 0:11:47.643 ***** 2019-11-28T11:17:11.659 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-11-28T11:17:11.662 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:11.698 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:11 +0000 (0:00:00.072) 0:11:47.715 ***** 2019-11-28T11:17:12.068 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-28T11:17:12.110 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:12 +0000 (0:00:00.411) 0:11:48.127 ***** 2019-11-28T11:17:12.435 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:17:12.723 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:17:13.011 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:17:13.298 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:17:13.583 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:17:13.628 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:13 +0000 (0:00:01.512) 0:11:49.640 ***** 2019-11-28T11:17:13.825 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-28T11:17:13.863 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:13 +0000 (0:00:00.240) 0:11:49.880 ***** 2019-11-28T11:17:13.914 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-28T11:17:13.915 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:14.087 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:17:14.269 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:17:14.452 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:17:14.639 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:17:14.686 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:14 +0000 (0:00:00.823) 0:11:50.704 ***** 2019-11-28T11:17:14.690 INFO:teuthology.task.ansible.out: 2019-11-28T11:17:14.879 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-11-28T11:17:14.880 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T11:17:14.921 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:14 +0000 (0:00:00.234) 0:11:50.939 ***** 2019-11-28T11:17:14.951 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-28T11:17:14.953 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:15.001 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:14 +0000 (0:00:00.079) 0:11:51.018 ***** 2019-11-28T11:17:15.234 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-11-28T11:17:15.236 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true} 2019-11-28T11:17:15.278 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:15 +0000 (0:00:00.277) 0:11:51.296 ***** 2019-11-28T11:17:15.568 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-11-28T11:17:15.570 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-11-28T11:17:15.622 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:15 +0000 (0:00:00.344) 0:11:51.640 ***** 2019-11-28T11:17:15.663 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-11-28T11:17:15.665 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:15.703 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:15 +0000 (0:00:00.080) 0:11:51.721 ***** 2019-11-28T11:17:15.742 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-11-28T11:17:15.744 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:15.786 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:15 +0000 (0:00:00.083) 0:11:51.804 ***** 2019-11-28T11:17:15.816 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-11-28T11:17:15.818 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:15.859 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:15 +0000 (0:00:00.073) 0:11:51.877 ***** 2019-11-28T11:17:15.886 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-11-28T11:17:15.888 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:15.928 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:15 +0000 (0:00:00.068) 0:11:51.946 ***** 2019-11-28T11:17:15.957 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-11-28T11:17:15.960 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:16.000 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:15 +0000 (0:00:00.071) 0:11:52.017 ***** 2019-11-28T11:17:16.031 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-11-28T11:17:16.034 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:16.073 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:16 +0000 (0:00:00.073) 0:11:52.090 ***** 2019-11-28T11:17:16.102 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-11-28T11:17:16.105 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:16.159 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:16 +0000 (0:00:00.086) 0:11:52.177 ***** 2019-11-28T11:17:19.738 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-11-28T11:17:19.740 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-29.el7.x86_64 providing ntp is already installed"]} 2019-11-28T11:17:19.784 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:19 +0000 (0:00:03.624) 0:11:55.801 ***** 2019-11-28T11:17:19.814 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-11-28T11:17:19.817 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:19.863 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:19 +0000 (0:00:00.079) 0:11:55.880 ***** 2019-11-28T11:17:19.894 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-11-28T11:17:19.896 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:19.941 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:19 +0000 (0:00:00.078) 0:11:55.958 ***** 2019-11-28T11:17:20.495 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-11-28T11:17:20.496 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-28T11:17:20.540 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:20 +0000 (0:00:00.598) 0:11:56.557 ***** 2019-11-28T11:17:20.566 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-11-28T11:17:20.567 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:20.620 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:20 +0000 (0:00:00.080) 0:11:56.637 ***** 2019-11-28T11:17:20.933 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-11-28T11:17:20.935 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sntp.service syslog.target ntpdate.service -.mount tmp.mount systemd-journald.socket basic.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target chronyd.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-11-28T11:17:20.943 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-11-28T11:17:20.945 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T11:17:20.975 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:20 +0000 (0:00:00.354) 0:11:56.992 ***** 2019-11-28T11:17:26.759 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-11-28T11:17:26.761 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-28T11:17:26.803 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:26 +0000 (0:00:05.827) 0:12:02.820 ***** 2019-11-28T11:17:26.837 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:26.886 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:26 +0000 (0:00:00.083) 0:12:02.904 ***** 2019-11-28T11:17:27.084 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-11-28T11:17:27.086 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-28T11:17:27.141 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:27 +0000 (0:00:00.255) 0:12:03.159 ***** 2019-11-28T11:17:27.692 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-11-28T11:17:27.693 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-28T11:17:27.735 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:27 +0000 (0:00:00.593) 0:12:03.752 ***** 2019-11-28T11:17:28.784 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-28T11:17:28.824 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:28 +0000 (0:00:01.089) 0:12:04.842 ***** 2019-11-28T11:17:28.853 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:28.902 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:28 +0000 (0:00:00.078) 0:12:04.920 ***** 2019-11-28T11:17:28.943 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2019-11-28T11:17:28.986 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:28 +0000 (0:00:00.083) 0:12:05.003 ***** 2019-11-28T11:17:29.185 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-11-28T11:17:29.187 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-28T11:17:29.224 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:29 +0000 (0:00:00.238) 0:12:05.241 ***** 2019-11-28T11:17:29.253 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-11-28T11:17:29.255 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:29.293 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:29 +0000 (0:00:00.067) 0:12:05.309 ***** 2019-11-28T11:17:29.320 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-28T11:17:29.361 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:29 +0000 (0:00:00.069) 0:12:05.378 ***** 2019-11-28T11:17:29.388 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-11-28T11:17:29.391 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:29.434 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:29 +0000 (0:00:00.073) 0:12:05.451 ***** 2019-11-28T11:17:29.630 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-28T11:17:29.667 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:29 +0000 (0:00:00.233) 0:12:05.684 ***** 2019-11-28T11:17:29.849 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-11-28T11:17:29.851 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-28T11:17:29.889 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:29 +0000 (0:00:00.222) 0:12:05.907 ***** 2019-11-28T11:17:29.945 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.029 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:30 +0000 (0:00:00.117) 0:12:06.024 ***** 2019-11-28T11:17:30.060 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-11-28T11:17:30.063 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.072 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.083 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.086 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.125 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:30 +0000 (0:00:00.118) 0:12:06.143 ***** 2019-11-28T11:17:30.168 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi016.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.180 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.191 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.193 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.203 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.251 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:30 +0000 (0:00:00.124) 0:12:06.267 ***** 2019-11-28T11:17:30.278 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.332 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:30 +0000 (0:00:00.082) 0:12:06.349 ***** 2019-11-28T11:17:30.364 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-11-28T11:17:30.366 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.420 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:30 +0000 (0:00:00.088) 0:12:06.438 ***** 2019-11-28T11:17:30.449 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.490 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:30 +0000 (0:00:00.069) 0:12:06.507 ***** 2019-11-28T11:17:30.518 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-11-28T11:17:30.520 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.562 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:30 +0000 (0:00:00.066) 0:12:06.574 ***** 2019-11-28T11:17:30.588 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.626 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:30 +0000 (0:00:00.068) 0:12:06.643 ***** 2019-11-28T11:17:30.654 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-28T11:17:30.655 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.699 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:30 +0000 (0:00:00.071) 0:12:06.714 ***** 2019-11-28T11:17:30.725 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-11-28T11:17:30.741 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.767 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:30 +0000 (0:00:00.069) 0:12:06.784 ***** 2019-11-28T11:17:30.795 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-28T11:17:30.797 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:17:30.832 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:30 +0000 (0:00:00.065) 0:12:06.849 ***** 2019-11-28T11:17:31.051 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-28T11:17:31.052 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.007540", "end": "2019-11-28 11:17:31.017092", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-28 11:17:31.009552", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:31.239 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003555", "end": "2019-11-28 11:17:31.203897", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-28 11:17:31.200342", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:31.412 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.003396", "end": "2019-11-28 11:17:31.380061", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-28 11:17:31.376665", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:31.597 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003879", "end": "2019-11-28 11:17:31.568406", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-28 11:17:31.564527", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:17:31.645 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:31 +0000 (0:00:00.805) 0:12:07.655 ***** 2019-11-28T11:17:31.666 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-11-28T11:17:31.706 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:17:31 +0000 (0:00:00.068) 0:12:07.724 ***** 2019-11-28T11:17:31.901 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-11-28T11:17:31.903 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-28T11:18:37.658 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T11:18:37.660 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7"]}, "msg": "Warning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-52.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-18.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-115.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed", "parted-3.1-31.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "7:lvm2-2.02.185-2.el7.x86_64 providing lvm2 is already installed", "1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed", "attr-2.4.46- 2019-11-28T11:18:37.661 INFO:teuthology.task.ansible.out:13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "lsof-4.87-6.el7.x86_64 providing lsof is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "n 2019-11-28T11:18:37.663 INFO:teuthology.task.ansible.out:curses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "podman-1.4.4-4.el7.x86_64 providing podman is already installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7 will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Versi 2019-11-28T11:18:37.666 INFO:teuthology.task.ansible.out:on Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7 lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 rhel-7-server-rpms 39 k\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 rhel-7-server-rpms 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 25 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.x86_64 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5- 2019-11-28T11:18:37.669 INFO:teuthology.task.ansible.out:4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.x86_64 3/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 4/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/8 \n Verifying : iozone-3.424-2_ceph.el7.x86_64 6/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 7/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7 mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-28T11:18:37.697 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:37 +0000 (0:01:05.990) 0:13:13.714 ***** 2019-11-28T11:18:52.648 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-11-28T11:18:52.649 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": ["leveldb", "xmlstarlet"]}, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed", "Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\n * epel: download-cc-rdu01.fedoraproject.org\nResolving Dependencies\n--> Running transaction check\n---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed\n---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n leveldb x86_64 1.12.0-11.el7 epel 161 k\n xmlstarlet x86_64 1.6.1-1.el7 epel 62 k\n\nTransaction Summary\n================================================================================\nInstall 2 Packages\n\nTotal download size: 223 k\nInstalled size: 631 k\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 565 kB/s | 223 kB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : xmlstarlet-1.6.1-1.el7.x86_64 2019-11-28T11:18:52.651 INFO:teuthology.task.ansible.out: 1/2 \n Installing : leveldb-1.12.0-11.el7.x86_64 2/2 \n Verifying : leveldb-1.12.0-11.el7.x86_64 1/2 \n Verifying : xmlstarlet-1.6.1-1.el7.x86_64 2/2 \n\nInstalled:\n leveldb.x86_64 0:1.12.0-11.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 \n\nComplete!\n"]} 2019-11-28T11:18:52.689 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:52 +0000 (0:00:14.992) 0:13:28.707 ***** 2019-11-28T11:18:54.239 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-28T11:18:54.240 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-28T11:18:54.278 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:54 +0000 (0:00:01.588) 0:13:30.296 ***** 2019-11-28T11:18:54.307 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-28T11:18:54.310 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:54.356 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:54 +0000 (0:00:00.078) 0:13:30.374 ***** 2019-11-28T11:18:54.604 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-11-28T11:18:54.606 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target system.slice dbus.service polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ebtables.service ipset.service shutdown.target ip6tables.service iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-28T11:18:54.608 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-28T11:18:54.609 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T11:18:54.645 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:54 +0000 (0:00:00.288) 0:13:30.662 ***** 2019-11-28T11:18:54.879 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-11-28T11:18:54.882 INFO:teuthology.task.ansible.out:fatal: [smithi174.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-28T11:18:54.921 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:54 +0000 (0:00:00.276) 0:13:30.939 ***** 2019-11-28T11:18:55.147 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-11-28T11:18:55.150 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-11-28T11:18:55.196 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:55 +0000 (0:00:00.275) 0:13:31.214 ***** 2019-11-28T11:18:55.223 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-11-28T11:18:55.225 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:55.262 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:55 +0000 (0:00:00.065) 0:13:31.279 ***** 2019-11-28T11:18:55.289 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-11-28T11:18:55.326 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:55 +0000 (0:00:00.064) 0:13:31.343 ***** 2019-11-28T11:18:55.362 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-11-28T11:18:55.364 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:55.399 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:55 +0000 (0:00:00.072) 0:13:31.416 ***** 2019-11-28T11:18:55.437 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-11-28T11:18:55.440 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:55.483 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:55 +0000 (0:00:00.083) 0:13:31.500 ***** 2019-11-28T11:18:55.646 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-11-28T11:18:55.648 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-28T11:18:55.685 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:55 +0000 (0:00:00.202) 0:13:31.702 ***** 2019-11-28T11:18:55.713 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-11-28T11:18:55.716 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:55.752 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:55 +0000 (0:00:00.066) 0:13:31.769 ***** 2019-11-28T11:18:55.782 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-11-28T11:18:55.824 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:55 +0000 (0:00:00.072) 0:13:31.842 ***** 2019-11-28T11:18:55.853 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:55.893 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:55 +0000 (0:00:00.069) 0:13:31.911 ***** 2019-11-28T11:18:56.047 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-11-28T11:18:56.049 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:56.203 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:56 +0000 (0:00:00.309) 0:13:32.220 ***** 2019-11-28T11:18:56.231 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-11-28T11:18:56.233 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:56.278 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:56 +0000 (0:00:00.074) 0:13:32.295 ***** 2019-11-28T11:18:56.305 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-28T11:18:56.308 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:56.345 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:56 +0000 (0:00:00.067) 0:13:32.362 ***** 2019-11-28T11:18:56.374 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-11-28T11:18:56.376 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:56.416 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:56 +0000 (0:00:00.071) 0:13:32.433 ***** 2019-11-28T11:18:56.444 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T11:18:56.446 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:56.496 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:56 +0000 (0:00:00.080) 0:13:32.513 ***** 2019-11-28T11:18:56.527 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:56.565 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:56 +0000 (0:00:00.069) 0:13:32.583 ***** 2019-11-28T11:18:56.593 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-11-28T11:18:56.595 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:56.632 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:56 +0000 (0:00:00.066) 0:13:32.649 ***** 2019-11-28T11:18:56.660 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-11-28T11:18:56.662 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:56.699 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:56 +0000 (0:00:00.067) 0:13:32.717 ***** 2019-11-28T11:18:56.727 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-11-28T11:18:56.729 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:56.767 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:56 +0000 (0:00:00.067) 0:13:32.784 ***** 2019-11-28T11:18:56.794 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-11-28T11:18:56.797 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:56.834 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:56 +0000 (0:00:00.066) 0:13:32.851 ***** 2019-11-28T11:18:56.861 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:56.903 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:56 +0000 (0:00:00.068) 0:13:32.920 ***** 2019-11-28T11:18:56.930 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-11-28T11:18:56.932 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:56.969 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:56 +0000 (0:00:00.065) 0:13:32.986 ***** 2019-11-28T11:18:56.996 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-11-28T11:18:56.999 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:57.035 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:57 +0000 (0:00:00.066) 0:13:33.053 ***** 2019-11-28T11:18:57.064 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:57.105 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:57 +0000 (0:00:00.069) 0:13:33.122 ***** 2019-11-28T11:18:57.132 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-28T11:18:57.135 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:57.170 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:57 +0000 (0:00:00.064) 0:13:33.187 ***** 2019-11-28T11:18:57.197 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:57.236 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:57 +0000 (0:00:00.066) 0:13:33.254 ***** 2019-11-28T11:18:57.263 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-28T11:18:57.265 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:57.303 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:57 +0000 (0:00:00.066) 0:13:33.320 ***** 2019-11-28T11:18:57.330 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-28T11:18:57.332 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:57.367 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:57 +0000 (0:00:00.064) 0:13:33.384 ***** 2019-11-28T11:18:57.393 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-28T11:18:57.396 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:57.430 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:57 +0000 (0:00:00.063) 0:13:33.448 ***** 2019-11-28T11:18:57.458 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:57.495 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:57 +0000 (0:00:00.064) 0:13:33.512 ***** 2019-11-28T11:18:57.523 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:57.560 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:57 +0000 (0:00:00.064) 0:13:33.577 ***** 2019-11-28T11:18:57.587 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-28T11:18:57.589 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:57.625 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:57 +0000 (0:00:00.064) 0:13:33.642 ***** 2019-11-28T11:18:57.652 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T11:18:57.654 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:57.689 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:57 +0000 (0:00:00.064) 0:13:33.707 ***** 2019-11-28T11:18:57.719 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-28T11:18:57.721 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:57.758 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:57 +0000 (0:00:00.068) 0:13:33.776 ***** 2019-11-28T11:18:57.787 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-28T11:18:57.789 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:57.825 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:57 +0000 (0:00:00.067) 0:13:33.843 ***** 2019-11-28T11:18:57.853 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-28T11:18:57.855 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:57.897 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:57 +0000 (0:00:00.071) 0:13:33.915 ***** 2019-11-28T11:18:57.925 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T11:18:57.927 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:57.965 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:57 +0000 (0:00:00.067) 0:13:33.982 ***** 2019-11-28T11:18:57.992 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T11:18:57.994 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:58.032 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:58 +0000 (0:00:00.067) 0:13:34.049 ***** 2019-11-28T11:18:58.539 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-28T11:18:58.540 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "secontext": "system_u:object_r:exports_t:s0", "size": 578, "state": "file", "uid": 0} 2019-11-28T11:18:58.599 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:58 +0000 (0:00:00.567) 0:13:34.616 ***** 2019-11-28T11:18:58.861 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-28T11:18:58.863 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nfs-server", "status": {"ActiveEnterTimestamp": "Thu 2019-11-28 11:03:07 UTC", "ActiveEnterTimestampMonotonic": "20320544", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network-online.target nfs-idmapd.service system.slice nfs-mountd.service tmp.mount rpc-gssd.service nfs-config.service gssproxy.service rpcbind.socket local-fs.target systemd-journald.socket proc-fs-nfsd.mount rpc-statd.service -.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-11-28 11:03:07 UTC", "AssertTimestampMonotonic": "20178765", "Before": "rpc-statd-notify.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BoundBy": "nfs-idmapd.service nfs-mountd.service", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-11-28 11:03:07 UTC", "ConditionTimestampMonotonic": "20178764", "ControlGroup": "/system.slice/nfs-server.service", "ControlPID": "0", "DefaultDependencies": "no", "Delegate": "no", "Description": "NFS server and services", "DevicePolicy": "auto", "DropInPaths": "/run/systemd/generator/nfs-server.service.d/order-with-mounts.conf", "EnvironmentFile": "/run/sysconfig/nfs-utils (ignore_errors=yes)", "ExecMainCode": "1", "ExecMainExitTimestamp": "Thu 2019-11-28 11:03:07 UTC", "ExecMainExitTimestampMonotonic": "20289496", "ExecMainPID": "2159", "ExecMainStartTimestamp": "Thu 2019-11-28 11:03:07 UTC", "ExecMainStartTimestampMonotonic": "20189933", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -r ; ignore_errors=yes ; start_time=[n/a] ; stop 2019-11-28T11:18:58.865 INFO:teuthology.task.ansible.out:_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/rpc.nfsd ; argv[]=/usr/sbin/rpc.nfsd $RPCNFSDARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/bin/sh ; argv[]=/bin/sh -c if systemctl -q is-active gssproxy; then systemctl reload gssproxy ; fi ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPre": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -r ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/rpc.nfsd ; argv[]=/usr/sbin/rpc.nfsd 0 ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/usr/sbin/exportfs ; argv[]=/usr/sbin/exportfs -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nfs-server.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nfs-server.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-11-28 11:03:07 UTC", "InactiveExitTimestampMonotonic": "20179435", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "Me 2019-11-28T11:18:58.866 INFO:teuthology.task.ansible.out:moryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nfs-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "yes", "Requires": "network.target nfs-mountd.service proc-fs-nfsd.mount tmp.mount -.mount", "RequiresMountsFor": "/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "exited", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "0", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "oneshot", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "nfs-idmapd.service network-online.target rpc-statd-notify.service auth-rpcgss-module.service nfs-config.service system.slice rpcbind.socket rpc-statd.service", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T11:18:58.904 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:58 +0000 (0:00:00.304) 0:13:34.921 ***** 2019-11-28T11:18:58.931 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-28T11:18:58.933 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:58.968 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:58 +0000 (0:00:00.064) 0:13:34.986 ***** 2019-11-28T11:18:58.996 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-28T11:18:58.998 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:59.033 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:59 +0000 (0:00:00.064) 0:13:35.051 ***** 2019-11-28T11:18:59.060 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T11:18:59.063 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:59.100 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:59 +0000 (0:00:00.066) 0:13:35.117 ***** 2019-11-28T11:18:59.139 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T11:18:59.141 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:59.183 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:59 +0000 (0:00:00.078) 0:13:35.196 ***** 2019-11-28T11:18:59.207 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:59.246 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:59 +0000 (0:00:00.067) 0:13:35.264 ***** 2019-11-28T11:18:59.274 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T11:18:59.276 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:59.311 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:59 +0000 (0:00:00.064) 0:13:35.329 ***** 2019-11-28T11:18:59.338 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T11:18:59.340 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:59.375 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:59 +0000 (0:00:00.064) 0:13:35.393 ***** 2019-11-28T11:18:59.403 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:59.442 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:59 +0000 (0:00:00.066) 0:13:35.459 ***** 2019-11-28T11:18:59.469 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-11-28T11:18:59.471 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:59.508 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:59 +0000 (0:00:00.066) 0:13:35.526 ***** 2019-11-28T11:18:59.535 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-28T11:18:59.537 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:59.574 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:59 +0000 (0:00:00.065) 0:13:35.591 ***** 2019-11-28T11:18:59.601 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-28T11:18:59.603 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:59.639 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:59 +0000 (0:00:00.065) 0:13:35.656 ***** 2019-11-28T11:18:59.666 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-11-28T11:18:59.668 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:59.706 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:59 +0000 (0:00:00.066) 0:13:35.723 ***** 2019-11-28T11:18:59.732 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-11-28T11:18:59.734 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:59.771 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:59 +0000 (0:00:00.065) 0:13:35.788 ***** 2019-11-28T11:18:59.804 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-11-28T11:18:59.806 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:59.842 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:59 +0000 (0:00:00.071) 0:13:35.860 ***** 2019-11-28T11:18:59.869 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-11-28T11:18:59.872 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:59.910 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:59 +0000 (0:00:00.067) 0:13:35.928 ***** 2019-11-28T11:18:59.937 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-11-28T11:18:59.939 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:18:59.976 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:18:59 +0000 (0:00:00.065) 0:13:35.993 ***** 2019-11-28T11:19:00.003 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-11-28T11:19:00.005 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:00.041 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:00 +0000 (0:00:00.064) 0:13:36.058 ***** 2019-11-28T11:19:00.068 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-11-28T11:19:00.070 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:00.106 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:00 +0000 (0:00:00.065) 0:13:36.124 ***** 2019-11-28T11:19:00.133 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-11-28T11:19:00.136 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:00.173 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:00 +0000 (0:00:00.066) 0:13:36.190 ***** 2019-11-28T11:19:00.200 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-11-28T11:19:00.202 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:00.238 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:00 +0000 (0:00:00.065) 0:13:36.256 ***** 2019-11-28T11:19:00.269 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-28T11:19:00.303 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:00 +0000 (0:00:00.064) 0:13:36.321 ***** 2019-11-28T11:19:00.351 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-11-28T11:19:00.353 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-28T11:19:00.363 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-11-28T11:19:00.374 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-11-28T11:19:00.385 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-11-28T11:19:00.387 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-11-28T11:19:00.404 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-11-28T11:19:00.408 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-28T11:19:00.449 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:00 +0000 (0:00:00.146) 0:13:36.467 ***** 2019-11-28T11:19:00.613 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-11-28T11:19:00.616 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004180", "end": "2019-11-28 11:19:00.590606", "rc": 0, "start": "2019-11-28 11:19:00.586426", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-28T11:19:00.656 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:00 +0000 (0:00:00.206) 0:13:36.673 ***** 2019-11-28T11:19:00.694 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-11-28T11:19:00.698 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:00.743 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:00 +0000 (0:00:00.079) 0:13:36.753 ***** 2019-11-28T11:19:00.772 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-11-28T11:19:00.774 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:00.813 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:00 +0000 (0:00:00.076) 0:13:36.829 ***** 2019-11-28T11:19:00.850 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-11-28T11:19:00.852 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:00.888 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:00 +0000 (0:00:00.075) 0:13:36.905 ***** 2019-11-28T11:19:00.915 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-11-28T11:19:00.917 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:00.952 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:00 +0000 (0:00:00.064) 0:13:36.970 ***** 2019-11-28T11:19:04.211 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-11-28T11:19:04.213 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.158-2.el7.x86_64 providing device-mapper is already installed"]} 2019-11-28T11:19:04.250 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:04 +0000 (0:00:03.297) 0:13:40.268 ***** 2019-11-28T11:19:04.309 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-28T11:19:04.311 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'block_used': 13578576, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745908, u'size_available': 928751239168, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968939, u'device': u'/dev/sda1', u'inode_used': 86037, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745908, "block_size": 4096, "block_total": 240324484, "block_used": 13578576, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968939, "inode_total": 61054976, "inode_used": 86037, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751239168, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}} 2019-11-28T11:19:04.352 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:04 +0000 (0:00:00.101) 0:13:40.370 ***** 2019-11-28T11:19:04.547 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-11-28T11:19:04.550 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005629", "end": "2019-11-28 11:19:04.522569", "rc": 0, "start": "2019-11-28 11:19:04.516940", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:19:04.591 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:04 +0000 (0:00:00.238) 0:13:40.608 ***** 2019-11-28T11:19:04.641 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-11-28T11:19:04.642 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'block_used': 13578576, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745908, u'size_available': 928751239168, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968939, u'device': u'/dev/sda1', u'inode_used': 86037, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745908, "block_size": 4096, "block_total": 240324484, "block_used": 13578576, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968939, "inode_total": 61054976, "inode_used": 86037, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751239168, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:04.684 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:04 +0000 (0:00:00.093) 0:13:40.702 ***** 2019-11-28T11:19:04.718 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-11-28T11:19:04.760 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:04 +0000 (0:00:00.075) 0:13:40.778 ***** 2019-11-28T11:19:04.813 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XN3Z', u'wwn-0x5000c50092940234'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XN3Z', u'wwn': u'0x5000c50092940234', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XN3Z-part1', u'wwn-0x5000c50092940234-part1'], u'uuids': [u'd74b555f-5ed5-42c3-b456-f59429ca50cb']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XN3Z", "wwn-0x5000c50092940234"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XN3Z-part1", "wwn-0x5000c50092940234-part1"], "labels": [], "masters": [], "uuids": ["d74b555f-5ed5-42c3-b456-f59429ca50cb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": " 2019-11-28T11:19:04.815 INFO:teuthology.task.ansible.out:512", "serial": "Z1W5XN3Z", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092940234"}}, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:06.242 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-3xX1MQ-1aHR-GlKe-92Jd-cxRQ-UcZV-Ave49E', u'nvme-INTEL_SSDPEDMD400G4_PHFT62050074400BGN', u'nvme-nvme.8086-50484654363230353030373434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.270753", "end": "2019-11-28 11:19:06.215830", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-3xX1MQ-1aHR-GlKe-92Jd-cxRQ-UcZV-Ave49E", "nvme-INTEL_SSDPEDMD400G4_PHFT62050074400BGN", "nvme-nvme.8086-50484654363230353030373434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:19:04.945077", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-11-28T11:19:06.244 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:19:07.519 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8CeWC3MnYm461a3sB0mgDKlS6XDlra7lg'], u'uuids': [u'fe408c70-255d-48e2-bc69-0c33c92cb5a2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.082429", "end": "2019-11-28 11:19:07.487822", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8CeWC3MnYm461a3sB0mgDKlS6XDlra7lg"], "labels": [], "masters": [], "uuids": ["fe408c70-255d-48e2-bc69-0c33c92cb5a2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:19:06.405393", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:19:08.752 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8sdgy5nwZOASIgYYdeQgLEym50UoZ8dRH'], u'uuids': [u'a1a06111-3177-49ce-8b36-80a2ebe93863']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.054345", "end": "2019-11-28 11:19:08.725309", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8sdgy5nwZOASIgYYdeQgLEym50UoZ8dRH"], "labels": [], "masters": [], "uuids": ["a1a06111-3177-49ce-8b36-80a2ebe93863"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:19:07.670964", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:19:09.994 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8sowMuzj7txn3KNQzZJfc4aUh6yj0a9zs'], u'uuids': [u'882f94ca-4d58-4a1c-b443-c63b9490f039']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.060928", "end": "2019-11-28 11:19:09.959637", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8sowMuzj7txn3KNQzZJfc4aUh6yj0a9zs"], "labels": [], "masters": [], "uuids": ["882f94ca-4d58-4a1c-b443-c63b9490f039"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:19:08.898709", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:19:11.217 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8mpqeLYdhS8Q4fhAHJxlpkty9BwDjMyul'], u'uuids': [u'8715e1b3-a348-44f6-bfe8-17c9051b719e']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.051024", "end": "2019-11-28 11:19:11.192790", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8mpqeLYdhS8Q4fhAHJxlpkty9BwDjMyul"], "labels": [], "masters": [], "uuids": ["8715e1b3-a348-44f6-bfe8-17c9051b719e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:19:10.141766", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:19:12.465 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8Yn5IjEEBfOMjxFynbMgek5JvNm555bRk'], u'uuids': [u'5719f28e-07e3-41a1-9115-ca133545fd52']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.068776", "end": "2019-11-28 11:19:12.434218", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8Yn5IjEEBfOMjxFynbMgek5JvNm555bRk"], "labels": [], "masters": [], "uuids": ["5719f28e-07e3-41a1-9115-ca133545fd52"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:19:11.365442", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T11:19:12.521 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:12 +0000 (0:00:07.760) 0:13:48.538 ***** 2019-11-28T11:19:12.560 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T11:19:12.562 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XN3Z', u'wwn-0x5000c50092940234'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XN3Z', u'wwn': u'0x5000c50092940234', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XN3Z-part1', u'wwn-0x5000c50092940234-part1'], u'uuids': [u'd74b555f-5ed5-42c3-b456-f59429ca50cb']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XN3Z", "wwn-0x5000c50092940234"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XN3Z-part1", "wwn-0x5000c50092940234-part1"], "labels": [], "masters": [], "uuids": ["d74b555f-5ed5-42c3-b456-f59429ca50cb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XN3Z", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-28T11:19:12.563 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50092940234"}}, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:12.772 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-3xX1MQ-1aHR-GlKe-92Jd-cxRQ-UcZV-Ave49E', u'nvme-INTEL_SSDPEDMD400G4_PHFT62050074400BGN', u'nvme-nvme.8086-50484654363230353030373434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.039588", "end": "2019-11-28 11:19:12.748480", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-3xX1MQ-1aHR-GlKe-92Jd-cxRQ-UcZV-Ave49E", "nvme-INTEL_SSDPEDMD400G4_PHFT62050074400BGN", "nvme-nvme.8086-50484654363230353030373434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:19:12.708892", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) co 2019-11-28T11:19:12.774 INFO:teuthology.task.ansible.out:pied, 0.0366239 s, 3.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0366239 s, 3.1 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:19:13.079 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8CeWC3MnYm461a3sB0mgDKlS6XDlra7lg'], u'uuids': [u'fe408c70-255d-48e2-bc69-0c33c92cb5a2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.144385", "end": "2019-11-28 11:19:13.053250", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8CeWC3MnYm461a3sB0mgDKlS6XDlra7lg"], "labels": [], "masters": [], "uuids": ["fe408c70-255d-48e2-bc69-0c33c92cb5a2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:19:12.908865", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.141624 s, 814 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.141624 s, 814 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:19:13.387 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8sdgy5nwZOASIgYYdeQgLEym50UoZ8dRH'], u'uuids': [u'a1a06111-3177-49ce-8b36-80a2ebe93863']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.144523", "end": "2019-11-28 11:19:13.358853", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8sdgy5nwZOASIgYYdeQgLEym50UoZ8dRH"], "labels": [], "masters": [], "uuids": ["a1a06111-3177-49ce-8b36-80a2ebe93863"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:19:13.214330", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.141793 s, 813 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.141793 s, 813 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:19:13.690 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8sowMuzj7txn3KNQzZJfc4aUh6yj0a9zs'], u'uuids': [u'882f94ca-4d58-4a1c-b443-c63b9490f039']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.143628", "end": "2019-11-28 11:19:13.662470", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8sowMuzj7txn3KNQzZJfc4aUh6yj0a9zs"], "labels": [], "masters": [], "uuids": ["882f94ca-4d58-4a1c-b443-c63b9490f039"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:19:13.518842", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.140873 s, 819 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.140873 s, 819 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:19:14.007 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8mpqeLYdhS8Q4fhAHJxlpkty9BwDjMyul'], u'uuids': [u'8715e1b3-a348-44f6-bfe8-17c9051b719e']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.158264", "end": "2019-11-28 11:19:13.981956", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8mpqeLYdhS8Q4fhAHJxlpkty9BwDjMyul"], "labels": [], "masters": [], "uuids": ["8715e1b3-a348-44f6-bfe8-17c9051b719e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:19:13.823692", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.155482 s, 742 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.155482 s, 742 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:19:14.316 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8Yn5IjEEBfOMjxFynbMgek5JvNm555bRk'], u'uuids': [u'5719f28e-07e3-41a1-9115-ca133545fd52']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.143052", "end": "2019-11-28 11:19:14.287006", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-OQIc9TU7Pb4T3iJzG7KhuqB5gs1gMjE8Yn5IjEEBfOMjxFynbMgek5JvNm555bRk"], "labels": [], "masters": [], "uuids": ["5719f28e-07e3-41a1-9115-ca133545fd52"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 11:19:14.143954", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.140324 s, 822 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.140324 s, 822 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T11:19:14.373 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:14 +0000 (0:00:01.844) 0:13:50.383 ***** 2019-11-28T11:19:14.623 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-11-28T11:19:14.625 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.078712", "end": "2019-11-28 11:19:14.596222", "rc": 0, "start": "2019-11-28 11:19:14.517510", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:19:14.661 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:14 +0000 (0:00:00.295) 0:13:50.678 ***** 2019-11-28T11:19:14.860 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-11-28T11:19:14.863 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.031206", "end": "2019-11-28 11:19:14.843226", "rc": 0, "start": "2019-11-28 11:19:14.812020", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:19:14.900 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:14 +0000 (0:00:00.239) 0:13:50.918 ***** 2019-11-28T11:19:14.929 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-11-28T11:19:14.969 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:14 +0000 (0:00:00.068) 0:13:50.987 ***** 2019-11-28T11:19:14.996 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-11-28T11:19:14.999 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:15.038 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:15 +0000 (0:00:00.068) 0:13:51.055 ***** 2019-11-28T11:19:15.066 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:15.109 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:15 +0000 (0:00:00.071) 0:13:51.127 ***** 2019-11-28T11:19:15.112 INFO:teuthology.task.ansible.out: 2019-11-28T11:19:15.137 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-28T11:19:15.139 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:15.180 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:15 +0000 (0:00:00.070) 0:13:51.197 ***** 2019-11-28T11:19:15.213 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:15.402 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:15 +0000 (0:00:00.068) 0:13:51.265 ***** 2019-11-28T11:19:15.434 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-11-28T11:19:15.437 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T11:19:15.482 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:15 +0000 (0:00:00.234) 0:13:51.500 ***** 2019-11-28T11:19:15.522 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-28T11:19:15.524 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'block_used': 13578576, u'uuid': u'd74b555f-5ed5-42c3-b456-f59429ca50cb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 226745908, u'size_available': 928751239168, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60968939, u'device': u'/dev/sda1', u'inode_used': 86037, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226745908, "block_size": 4096, "block_total": 240324484, "block_used": 13578576, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60968939, "inode_total": 61054976, "inode_used": 86037, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 928751239168, "size_total": 984369086464, "uuid": "d74b555f-5ed5-42c3-b456-f59429ca50cb"}, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:15.565 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:15 +0000 (0:00:00.082) 0:13:51.583 ***** 2019-11-28T11:19:15.592 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-11-28T11:19:15.595 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:15.635 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:15 +0000 (0:00:00.069) 0:13:51.652 ***** 2019-11-28T11:19:15.662 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:19:15.665 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:15.706 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:15 +0000 (0:00:00.071) 0:13:51.724 ***** 2019-11-28T11:19:15.734 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:19:15.737 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:15.778 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:15 +0000 (0:00:00.071) 0:13:51.795 ***** 2019-11-28T11:19:15.822 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:15.850 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:15 +0000 (0:00:00.071) 0:13:51.867 ***** 2019-11-28T11:19:15.885 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:15.921 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:15 +0000 (0:00:00.070) 0:13:51.938 ***** 2019-11-28T11:19:15.949 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:15.987 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:15 +0000 (0:00:00.066) 0:13:52.005 ***** 2019-11-28T11:19:16.358 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-11-28T11:19:16.361 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-28T11:19:16.400 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:16 +0000 (0:00:00.412) 0:13:52.417 ***** 2019-11-28T11:19:16.713 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-28T11:19:16.715 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:19:17.009 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:19:17.284 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:19:17.547 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:19:17.819 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T11:19:17.862 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:17 +0000 (0:00:01.461) 0:13:53.879 ***** 2019-11-28T11:19:18.037 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-28T11:19:18.039 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-28T11:19:18.079 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:18 +0000 (0:00:00.217) 0:13:54.096 ***** 2019-11-28T11:19:18.128 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-28T11:19:18.130 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:18.300 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:19:18.467 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:19:18.635 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:19:18.792 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T11:19:18.831 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:18 +0000 (0:00:00.752) 0:13:54.849 ***** 2019-11-28T11:19:19.025 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-11-28T11:19:19.027 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T11:19:19.062 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:19 +0000 (0:00:00.230) 0:13:55.079 ***** 2019-11-28T11:19:19.099 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-28T11:19:19.101 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:19.140 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:19 +0000 (0:00:00.075) 0:13:55.155 ***** 2019-11-28T11:19:19.425 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-11-28T11:19:19.427 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true} 2019-11-28T11:19:19.462 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:19 +0000 (0:00:00.324) 0:13:55.479 ***** 2019-11-28T11:19:19.748 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-11-28T11:19:19.750 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-11-28T11:19:19.794 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:19 +0000 (0:00:00.332) 0:13:55.812 ***** 2019-11-28T11:19:19.822 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-11-28T11:19:19.828 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:19.874 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:19 +0000 (0:00:00.080) 0:13:55.892 ***** 2019-11-28T11:19:19.902 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-11-28T11:19:19.904 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:19.945 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:19 +0000 (0:00:00.070) 0:13:55.962 ***** 2019-11-28T11:19:19.982 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:20.037 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:20 +0000 (0:00:00.092) 0:13:56.055 ***** 2019-11-28T11:19:20.066 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-11-28T11:19:20.068 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:20.109 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:20 +0000 (0:00:00.072) 0:13:56.127 ***** 2019-11-28T11:19:20.138 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-11-28T11:19:20.141 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:20.179 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:20 +0000 (0:00:00.069) 0:13:56.196 ***** 2019-11-28T11:19:20.207 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-11-28T11:19:20.209 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:20.247 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:20 +0000 (0:00:00.068) 0:13:56.264 ***** 2019-11-28T11:19:20.275 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-11-28T11:19:20.278 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:20.314 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:20 +0000 (0:00:00.066) 0:13:56.331 ***** 2019-11-28T11:19:22.863 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-29.el7.x86_64 providing ntp is already installed"]} 2019-11-28T11:19:22.900 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:22 +0000 (0:00:02.586) 0:13:58.918 ***** 2019-11-28T11:19:22.928 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-11-28T11:19:22.930 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:22.967 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:22 +0000 (0:00:00.066) 0:13:58.984 ***** 2019-11-28T11:19:22.995 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-11-28T11:19:22.998 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:23.033 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:23 +0000 (0:00:00.066) 0:13:59.050 ***** 2019-11-28T11:19:23.556 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-11-28T11:19:23.558 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-28T11:19:23.595 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:23 +0000 (0:00:00.561) 0:13:59.612 ***** 2019-11-28T11:19:23.623 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-11-28T11:19:23.625 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:23.665 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:23 +0000 (0:00:00.070) 0:13:59.682 ***** 2019-11-28T11:19:23.954 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-11-28T11:19:23.957 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "syslog.target ntpdate.service tmp.mount basic.target sntp.service systemd-journald.socket system.slice -.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target chronyd.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-11-28T11:19:23.959 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-11-28T11:19:23.961 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T11:19:24.014 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:24 +0000 (0:00:00.349) 0:14:00.031 ***** 2019-11-28T11:19:29.030 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-11-28T11:19:29.033 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-28T11:19:29.074 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:29 +0000 (0:00:05.059) 0:14:05.091 ***** 2019-11-28T11:19:29.102 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-11-28T11:19:29.104 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:29.140 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:29 +0000 (0:00:00.066) 0:14:05.158 ***** 2019-11-28T11:19:29.326 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-11-28T11:19:29.328 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-28T11:19:29.366 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:29 +0000 (0:00:00.225) 0:14:05.383 ***** 2019-11-28T11:19:29.888 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-11-28T11:19:29.890 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-28T11:19:29.935 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:29 +0000 (0:00:00.569) 0:14:05.953 ***** 2019-11-28T11:19:30.872 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-11-28T11:19:30.874 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-28T11:19:30.912 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:30 +0000 (0:00:00.976) 0:14:06.929 ***** 2019-11-28T11:19:30.940 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:30.977 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:30 +0000 (0:00:00.064) 0:14:06.994 ***** 2019-11-28T11:19:31.005 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-11-28T11:19:31.008 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-11-28T11:19:31.056 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:31 +0000 (0:00:00.067) 0:14:07.061 ***** 2019-11-28T11:19:31.217 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-11-28T11:19:31.220 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-28T11:19:31.256 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:31 +0000 (0:00:00.211) 0:14:07.273 ***** 2019-11-28T11:19:31.284 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-11-28T11:19:31.286 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:31.321 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:31 +0000 (0:00:00.065) 0:14:07.339 ***** 2019-11-28T11:19:31.369 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-11-28T11:19:31.371 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-28T11:19:31.410 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:31 +0000 (0:00:00.088) 0:14:07.427 ***** 2019-11-28T11:19:31.437 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-11-28T11:19:31.439 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:31.493 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:31 +0000 (0:00:00.077) 0:14:07.505 ***** 2019-11-28T11:19:31.665 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-11-28T11:19:31.666 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-28T11:19:31.728 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:31 +0000 (0:00:00.240) 0:14:07.745 ***** 2019-11-28T11:19:31.910 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-11-28T11:19:31.912 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-28T11:19:31.974 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:31 +0000 (0:00:00.246) 0:14:07.992 ***** 2019-11-28T11:19:32.005 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-11-28T11:19:32.007 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.047 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:32 +0000 (0:00:00.072) 0:14:08.064 ***** 2019-11-28T11:19:32.087 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-11-28T11:19:32.089 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.110 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.116 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.117 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.163 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:32 +0000 (0:00:00.116) 0:14:08.180 ***** 2019-11-28T11:19:32.203 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-11-28T11:19:32.204 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.206 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.217 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.219 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.230 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.299 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:32 +0000 (0:00:00.136) 0:14:08.316 ***** 2019-11-28T11:19:32.331 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T11:19:32.332 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.399 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:32 +0000 (0:00:00.099) 0:14:08.416 ***** 2019-11-28T11:19:32.428 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.464 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:32 +0000 (0:00:00.065) 0:14:08.481 ***** 2019-11-28T11:19:32.491 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-11-28T11:19:32.493 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.531 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:32 +0000 (0:00:00.067) 0:14:08.548 ***** 2019-11-28T11:19:32.559 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-11-28T11:19:32.561 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.597 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:32 +0000 (0:00:00.065) 0:14:08.614 ***** 2019-11-28T11:19:32.632 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.669 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:32 +0000 (0:00:00.072) 0:14:08.686 ***** 2019-11-28T11:19:32.697 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-28T11:19:32.699 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.738 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:32 +0000 (0:00:00.069) 0:14:08.756 ***** 2019-11-28T11:19:32.765 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-11-28T11:19:32.768 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.805 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:32 +0000 (0:00:00.067) 0:14:08.823 ***** 2019-11-28T11:19:32.833 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-28T11:19:32.835 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T11:19:32.870 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:32 +0000 (0:00:00.064) 0:14:08.887 ***** 2019-11-28T11:19:33.075 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-28T11:19:33.077 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.006719", "end": "2019-11-28 11:19:33.044043", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-28 11:19:33.037324", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:19:33.242 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003186", "end": "2019-11-28 11:19:33.216071", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-28 11:19:33.212885", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:19:34.416 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:01.004139", "end": "2019-11-28 11:19:34.387582", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-28 11:19:33.383443", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-28T11:19:34.594 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003585", "end": "2019-11-28 11:19:34.562895", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-28 11:19:34.559310", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T11:19:35.528 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 11:19:34 +0000 (0:00:01.775) 0:14:10.662 ***** TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** Thursday 28 November 2019 11:19:34 +0000 (0:00:00.065) 0:14:10.728 ***** TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} PLAY [cobbler] ***************************************************************** skipping: no hosts matched PLAY [paddles] ***************************************************************** skipping: no hosts matched PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi016.front.sepia.ceph.com : ok=134 changed=44 unreachable=0 failed=0 skipped=146 rescued=0 ignored=4 smithi075.front.sepia.ceph.com : ok=134 changed=44 unreachable=0 failed=0 skipped=146 rescued=0 ignored=4 smithi076.front.sepia.ceph.com : ok=134 changed=44 unreachable=0 failed=0 skipped=146 rescued=0 ignored=4 smithi080.front.sepia.ceph.com : ok=134 changed=44 unreachable=0 failed=0 skipped=146 rescued=0 ignored=4 smithi133.front.sepia.ceph.com : ok=134 changed=44 unreachable=0 failed=0 skipped=146 rescued=0 ignored=4 smithi174.front.sepia.ceph.com : ok=134 changed=44 unreachable=0 failed=0 skipped=146 rescued=0 ignored=4 Thursday 28 November 2019 11:19:34 +0000 (0:00:00.293) 0:14:11.021 ***** =============================================================================== testnode : Configure /etc/sudoers. ------------------------------------- 73.62s common : Update yum 2019-11-28T11:19:35.530 INFO:teuthology.task.ansible.out:cache ---------------------------------------------- 47.42s testnode : Add the teuthology user to groups kvm,disk ------------------ 32.23s users : Create all admin users with sudo access. ----------------------- 24.41s testnode : Install epel packages --------------------------------------- 14.99s testnode : Set mode on /etc/fuse.conf ---------------------------------- 14.29s testnode : Ensure the group kvm exists. --------------------------------- 8.23s testnode : Create remote.conf ------------------------------------------- 8.12s testnode : Zap all non-root disks --------------------------------------- 7.76s common : Set replace_repos true if newly-subscribed --------------------- 7.37s testnode : Configure /etc/security/limits.conf -------------------------- 5.59s testnode : Install python-pip on rpm based systems. --------------------- 5.06s testnode : Set the system's hostname ------------------------------------ 4.17s testnode : Rebuild rpmdb ------------------------------------------------ 3.90s common : Enable necessary rhsm repos ------------------------------------ 3.77s testnode : Make sure rpm dependencies are installed --------------------- 3.30s common : Set the timezone in /etc/timezone ------------------------------ 3.28s common : Inform the OS of the new timezone ------------------------------ 2.91s testnode : Configure common additional repos in /etc/yum.repos.d/ ------- 2.81s Gathering Facts --------------------------------------------------------- 2.77s 2019-11-28T11:19:35.633 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi076.front.sepia.ceph.com'), Remote(name='ubuntu@smithi133.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com'), Remote(name='ubuntu@smithi075.front.sepia.ceph.com'), Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi080.front.sepia.ceph.com')] 2019-11-28T11:19:35.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:19:35.636 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:19:35.727 INFO:teuthology.orchestra.run.smithi076:> true 2019-11-28T11:19:35.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:19:35.990 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:19:36.098 INFO:teuthology.orchestra.run.smithi133:> true 2019-11-28T11:19:36.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:19:36.328 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:19:36.412 INFO:teuthology.orchestra.run.smithi174:> true 2019-11-28T11:19:36.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:19:36.661 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi075.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:19:36.747 INFO:teuthology.orchestra.run.smithi075:> true 2019-11-28T11:19:37.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:19:37.009 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:19:37.111 INFO:teuthology.orchestra.run.smithi016:> true 2019-11-28T11:19:37.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:19:37.377 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi080.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:19:37.484 INFO:teuthology.orchestra.run.smithi080:> true 2019-11-28T11:19:37.717 INFO:teuthology.run_tasks:Running task clock... 2019-11-28T11:19:37.725 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-11-28T11:19:37.726 INFO:teuthology.orchestra.run.smithi076:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-28T11:19:37.796 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-28T11:19:47.846 INFO:teuthology.orchestra.run.smithi076.stdout:ntpd: time slew -0.005315s 2019-11-28T11:19:47.862 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to start ntp.service: Unit not found. 2019-11-28T11:19:47.929 INFO:teuthology.orchestra.run.smithi076.stdout: remote refid st t when poll reach delay offset jitter 2019-11-28T11:19:47.929 INFO:teuthology.orchestra.run.smithi076.stdout:============================================================================== 2019-11-28T11:19:47.929 INFO:teuthology.orchestra.run.smithi076.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:19:47.929 INFO:teuthology.orchestra.run.smithi076.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:19:47.929 INFO:teuthology.orchestra.run.smithi076.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:19:47.930 INFO:teuthology.orchestra.run.smithi076.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:19:47.930 INFO:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-28T11:19:48.002 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-28T11:19:58.055 INFO:teuthology.orchestra.run.smithi133.stdout:ntpd: time slew -0.003958s 2019-11-28T11:19:58.074 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntp.service: Unit not found. 2019-11-28T11:19:58.148 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2019-11-28T11:19:58.148 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2019-11-28T11:19:58.148 INFO:teuthology.orchestra.run.smithi133.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:19:58.148 INFO:teuthology.orchestra.run.smithi133.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:19:58.148 INFO:teuthology.orchestra.run.smithi133.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:19:58.148 INFO:teuthology.orchestra.run.smithi133.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:19:58.149 INFO:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-28T11:19:58.223 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-28T11:20:08.279 INFO:teuthology.orchestra.run.smithi174.stdout:ntpd: time slew -0.000207s 2019-11-28T11:20:08.300 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit not found. 2019-11-28T11:20:08.347 INFO:teuthology.orchestra.run.smithi174.stdout: remote refid st t when poll reach delay offset jitter 2019-11-28T11:20:08.347 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================== 2019-11-28T11:20:08.347 INFO:teuthology.orchestra.run.smithi174.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:20:08.347 INFO:teuthology.orchestra.run.smithi174.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:20:08.347 INFO:teuthology.orchestra.run.smithi174.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:20:08.347 INFO:teuthology.orchestra.run.smithi174.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:20:08.348 INFO:teuthology.orchestra.run.smithi075:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-28T11:20:08.430 INFO:teuthology.orchestra.run.smithi075.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-28T11:20:18.482 INFO:teuthology.orchestra.run.smithi075.stdout:ntpd: time slew -0.003234s 2019-11-28T11:20:18.498 INFO:teuthology.orchestra.run.smithi075.stderr:Failed to start ntp.service: Unit not found. 2019-11-28T11:20:18.547 INFO:teuthology.orchestra.run.smithi075.stdout: remote refid st t when poll reach delay offset jitter 2019-11-28T11:20:18.548 INFO:teuthology.orchestra.run.smithi075.stdout:============================================================================== 2019-11-28T11:20:18.548 INFO:teuthology.orchestra.run.smithi075.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:20:18.548 INFO:teuthology.orchestra.run.smithi075.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:20:18.548 INFO:teuthology.orchestra.run.smithi075.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:20:18.548 INFO:teuthology.orchestra.run.smithi075.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:20:18.548 INFO:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-28T11:20:18.639 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-28T11:20:28.697 INFO:teuthology.orchestra.run.smithi016.stdout:ntpd: time slew -0.002917s 2019-11-28T11:20:28.717 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntp.service: Unit not found. 2019-11-28T11:20:28.770 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2019-11-28T11:20:28.771 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2019-11-28T11:20:28.771 INFO:teuthology.orchestra.run.smithi016.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:20:28.771 INFO:teuthology.orchestra.run.smithi016.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:20:28.771 INFO:teuthology.orchestra.run.smithi016.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:20:28.771 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:20:28.772 INFO:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-28T11:20:28.852 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-28T11:20:38.911 INFO:teuthology.orchestra.run.smithi080.stdout:ntpd: time slew +0.016852s 2019-11-28T11:20:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntp.service: Unit not found. 2019-11-28T11:20:38.966 INFO:teuthology.orchestra.run.smithi080.stdout: remote refid st t when poll reach delay offset jitter 2019-11-28T11:20:38.967 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================== 2019-11-28T11:20:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:20:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:20:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:20:38.967 INFO:teuthology.orchestra.run.smithi080.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T11:20:38.967 INFO:teuthology.run_tasks:Running task install... 2019-11-28T11:20:39.154 DEBUG:teuthology.task.install:project ceph 2019-11-28T11:20:39.155 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '6882af39b535c578d64a14ae5fc1b517ba8bdb9b'}} 2019-11-28T11:20:39.155 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': '6882af39b535c578d64a14ae5fc1b517ba8bdb9b'} 2019-11-28T11:20:39.155 INFO:teuthology.task.install:Using flavor: basic 2019-11-28T11:20:39.159 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-daemon', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-daemon', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2019-11-28T11:20:39.159 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2019-11-28T11:20:39.160 INFO:teuthology.orchestra.run.smithi076:> sudo lsb_release -is 2019-11-28T11:20:39.262 INFO:teuthology.orchestra.run.smithi076.stdout:RedHatEnterpriseServer 2019-11-28T11:20:39.262 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:20:39.263 INFO:teuthology.orchestra.run.smithi133:> sudo lsb_release -is 2019-11-28T11:20:39.263 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '6882af39b535c578d64a14ae5fc1b517ba8bdb9b', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel']}, 'flavor': 'basic', 'extras': None} 2019-11-28T11:20:39.264 INFO:teuthology.orchestra.run.smithi076:> sudo lsb_release -is 2019-11-28T11:20:39.350 INFO:teuthology.orchestra.run.smithi076.stdout:RedHatEnterpriseServer 2019-11-28T11:20:39.351 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:20:39.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=6882af39b535c578d64a14ae5fc1b517ba8bdb9b 2019-11-28T11:20:39.370 INFO:teuthology.orchestra.run.smithi133.stdout:RedHatEnterpriseServer 2019-11-28T11:20:39.371 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:20:39.372 INFO:teuthology.orchestra.run.smithi174:> sudo lsb_release -is 2019-11-28T11:20:39.372 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '6882af39b535c578d64a14ae5fc1b517ba8bdb9b', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel']}, 'flavor': 'basic', 'extras': None} 2019-11-28T11:20:39.372 INFO:teuthology.orchestra.run.smithi133:> sudo lsb_release -is 2019-11-28T11:20:39.442 INFO:teuthology.orchestra.run.smithi133.stdout:RedHatEnterpriseServer 2019-11-28T11:20:39.443 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:20:39.443 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=6882af39b535c578d64a14ae5fc1b517ba8bdb9b 2019-11-28T11:20:39.463 INFO:teuthology.orchestra.run.smithi174.stdout:RedHatEnterpriseServer 2019-11-28T11:20:39.466 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:20:39.466 INFO:teuthology.orchestra.run.smithi075:> sudo lsb_release -is 2019-11-28T11:20:39.467 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '6882af39b535c578d64a14ae5fc1b517ba8bdb9b', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel']}, 'flavor': 'basic', 'extras': None} 2019-11-28T11:20:39.467 INFO:teuthology.orchestra.run.smithi174:> sudo lsb_release -is 2019-11-28T11:20:39.529 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191127.175901/6882af39b535c578d64a14ae5fc1b517ba8bdb9b/centos/7/flavors/default/ 2019-11-28T11:20:39.529 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7798.g6882af3 2019-11-28T11:20:39.548 INFO:teuthology.orchestra.run.smithi174.stdout:RedHatEnterpriseServer 2019-11-28T11:20:39.548 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:20:39.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=6882af39b535c578d64a14ae5fc1b517ba8bdb9b 2019-11-28T11:20:39.571 INFO:teuthology.orchestra.run.smithi075.stdout:RedHatEnterpriseServer 2019-11-28T11:20:39.571 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:20:39.571 INFO:teuthology.orchestra.run.smithi016:> sudo lsb_release -is 2019-11-28T11:20:39.572 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '6882af39b535c578d64a14ae5fc1b517ba8bdb9b', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel']}, 'flavor': 'basic', 'extras': None} 2019-11-28T11:20:39.572 INFO:teuthology.orchestra.run.smithi075:> sudo lsb_release -is 2019-11-28T11:20:39.664 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191127.175901/6882af39b535c578d64a14ae5fc1b517ba8bdb9b/centos/7/flavors/default/ 2019-11-28T11:20:39.665 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7798.g6882af3 2019-11-28T11:20:39.676 INFO:teuthology.orchestra.run.smithi016.stdout:RedHatEnterpriseServer 2019-11-28T11:20:39.676 INFO:teuthology.orchestra.run.smithi075.stdout:RedHatEnterpriseServer 2019-11-28T11:20:39.677 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:20:39.677 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=6882af39b535c578d64a14ae5fc1b517ba8bdb9b 2019-11-28T11:20:39.680 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:20:39.680 INFO:teuthology.orchestra.run.smithi080:> sudo lsb_release -is 2019-11-28T11:20:39.681 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '6882af39b535c578d64a14ae5fc1b517ba8bdb9b', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel']}, 'flavor': 'basic', 'extras': None} 2019-11-28T11:20:39.681 INFO:teuthology.orchestra.run.smithi016:> sudo lsb_release -is 2019-11-28T11:20:39.691 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-28T11:20:39.765 INFO:teuthology.orchestra.run.smithi016.stdout:RedHatEnterpriseServer 2019-11-28T11:20:39.766 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:20:39.767 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=6882af39b535c578d64a14ae5fc1b517ba8bdb9b 2019-11-28T11:20:39.772 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel on remote rpm x86_64 2019-11-28T11:20:39.773 INFO:teuthology.orchestra.run.smithi076:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6882af39b535c578d64a14ae5fc1b517ba8bdb9b/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-28T11:20:39.774 INFO:teuthology.orchestra.run.smithi080.stdout:RedHatEnterpriseServer 2019-11-28T11:20:39.774 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:20:39.774 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '6882af39b535c578d64a14ae5fc1b517ba8bdb9b', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel']}, 'flavor': 'basic', 'extras': None} 2019-11-28T11:20:39.774 INFO:teuthology.orchestra.run.smithi080:> sudo lsb_release -is 2019-11-28T11:20:39.778 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191127.175901/6882af39b535c578d64a14ae5fc1b517ba8bdb9b/centos/7/flavors/default/ 2019-11-28T11:20:39.778 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7798.g6882af3 2019-11-28T11:20:39.848 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-28T11:20:39.863 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191127.175901/6882af39b535c578d64a14ae5fc1b517ba8bdb9b/centos/7/flavors/default/ 2019-11-28T11:20:39.863 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7798.g6882af3 2019-11-28T11:20:39.874 INFO:teuthology.orchestra.run.smithi080.stdout:RedHatEnterpriseServer 2019-11-28T11:20:39.874 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:20:39.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=6882af39b535c578d64a14ae5fc1b517ba8bdb9b 2019-11-28T11:20:39.933 INFO:teuthology.orchestra.run.smithi076:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-28T11:20:39.937 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191127.175901/6882af39b535c578d64a14ae5fc1b517ba8bdb9b/centos/7/flavors/default/ 2019-11-28T11:20:39.937 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7798.g6882af3 2019-11-28T11:20:39.943 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel on remote rpm x86_64 2019-11-28T11:20:39.943 INFO:teuthology.orchestra.run.smithi133:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6882af39b535c578d64a14ae5fc1b517ba8bdb9b/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-28T11:20:39.984 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-28T11:20:40.029 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-28T11:20:40.034 INFO:teuthology.orchestra.run.smithi076:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-28T11:20:40.046 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel on remote rpm x86_64 2019-11-28T11:20:40.046 INFO:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6882af39b535c578d64a14ae5fc1b517ba8bdb9b/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-28T11:20:40.062 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191127.175901/6882af39b535c578d64a14ae5fc1b517ba8bdb9b/centos/7/flavors/default/ 2019-11-28T11:20:40.062 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7798.g6882af3 2019-11-28T11:20:40.069 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-28T11:20:40.071 INFO:teuthology.orchestra.run.smithi133:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-28T11:20:40.097 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel on remote rpm x86_64 2019-11-28T11:20:40.097 INFO:teuthology.orchestra.run.smithi075:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6882af39b535c578d64a14ae5fc1b517ba8bdb9b/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-28T11:20:40.104 INFO:teuthology.orchestra.run.smithi076.stdout:check_obsoletes = 1 2019-11-28T11:20:40.105 INFO:teuthology.orchestra.run.smithi076:> sudo yum clean all 2019-11-28T11:20:40.128 INFO:teuthology.orchestra.run.smithi133:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-28T11:20:40.134 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel on remote rpm x86_64 2019-11-28T11:20:40.135 INFO:teuthology.orchestra.run.smithi016:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6882af39b535c578d64a14ae5fc1b517ba8bdb9b/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-28T11:20:40.171 INFO:teuthology.orchestra.run.smithi174:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-28T11:20:40.182 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-28T11:20:40.191 INFO:teuthology.orchestra.run.smithi133.stdout:check_obsoletes = 1 2019-11-28T11:20:40.192 INFO:teuthology.orchestra.run.smithi133:> sudo yum clean all 2019-11-28T11:20:40.219 INFO:teuthology.orchestra.run.smithi075:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-28T11:20:40.226 INFO:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-28T11:20:40.237 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel, bison, flex, elfutils-libelf-devel, openssl-devel on remote rpm x86_64 2019-11-28T11:20:40.237 INFO:teuthology.orchestra.run.smithi080:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6882af39b535c578d64a14ae5fc1b517ba8bdb9b/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-28T11:20:40.260 INFO:teuthology.orchestra.run.smithi016:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-28T11:20:40.271 INFO:teuthology.orchestra.run.smithi075:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-28T11:20:40.286 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2019-11-28T11:20:40.287 INFO:teuthology.orchestra.run.smithi174:> sudo yum clean all 2019-11-28T11:20:40.301 INFO:teuthology.orchestra.run.smithi076.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:20:40.301 INFO:teuthology.orchestra.run.smithi076.stdout: : disabled-repos, subscription-manager 2019-11-28T11:20:40.324 INFO:teuthology.orchestra.run.smithi016:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-28T11:20:40.337 INFO:teuthology.orchestra.run.smithi075.stdout:check_obsoletes = 1 2019-11-28T11:20:40.337 INFO:teuthology.orchestra.run.smithi075:> sudo yum clean all 2019-11-28T11:20:40.358 INFO:teuthology.orchestra.run.smithi080:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-28T11:20:40.384 INFO:teuthology.orchestra.run.smithi133.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:20:40.388 INFO:teuthology.orchestra.run.smithi133.stdout: : disabled-repos, subscription-manager 2019-11-28T11:20:40.399 INFO:teuthology.orchestra.run.smithi016.stdout:check_obsoletes = 1 2019-11-28T11:20:40.400 INFO:teuthology.orchestra.run.smithi016:> sudo yum clean all 2019-11-28T11:20:40.410 INFO:teuthology.orchestra.run.smithi080:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-28T11:20:40.465 INFO:teuthology.orchestra.run.smithi080.stdout:check_obsoletes = 1 2019-11-28T11:20:40.466 INFO:teuthology.orchestra.run.smithi080:> sudo yum clean all 2019-11-28T11:20:40.479 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:20:40.479 INFO:teuthology.orchestra.run.smithi174.stdout: : disabled-repos, subscription-manager 2019-11-28T11:20:40.529 INFO:teuthology.orchestra.run.smithi075.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:20:40.529 INFO:teuthology.orchestra.run.smithi075.stdout: : disabled-repos, subscription-manager 2019-11-28T11:20:40.608 INFO:teuthology.orchestra.run.smithi016.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:20:40.608 INFO:teuthology.orchestra.run.smithi016.stdout: : disabled-repos, subscription-manager 2019-11-28T11:20:40.656 INFO:teuthology.orchestra.run.smithi080.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:20:40.657 INFO:teuthology.orchestra.run.smithi080.stdout: : disabled-repos, subscription-manager 2019-11-28T11:20:41.063 INFO:teuthology.orchestra.run.smithi076.stdout:Cleaning repos: ceph ceph-noarch ceph-source epel lab-extras rhel-7-fcgi-ceph 2019-11-28T11:20:41.063 INFO:teuthology.orchestra.run.smithi076.stdout: : rhel-7-server-extras-rpms rhel-7-server-optional-rpms 2019-11-28T11:20:41.063 INFO:teuthology.orchestra.run.smithi076.stdout: : rhel-7-server-rpms rhel-ha-for-rhel-7-server-rpms 2019-11-28T11:20:41.160 INFO:teuthology.orchestra.run.smithi174.stdout:Cleaning repos: ceph ceph-noarch ceph-source epel lab-extras rhel-7-fcgi-ceph 2019-11-28T11:20:41.160 INFO:teuthology.orchestra.run.smithi174.stdout: : rhel-7-server-extras-rpms rhel-7-server-optional-rpms 2019-11-28T11:20:41.160 INFO:teuthology.orchestra.run.smithi174.stdout: : rhel-7-server-rpms rhel-ha-for-rhel-7-server-rpms 2019-11-28T11:20:41.161 INFO:teuthology.orchestra.run.smithi133.stdout:Cleaning repos: ceph ceph-noarch ceph-source epel lab-extras rhel-7-fcgi-ceph 2019-11-28T11:20:41.161 INFO:teuthology.orchestra.run.smithi133.stdout: : rhel-7-server-extras-rpms rhel-7-server-optional-rpms 2019-11-28T11:20:41.161 INFO:teuthology.orchestra.run.smithi133.stdout: : rhel-7-server-rpms rhel-ha-for-rhel-7-server-rpms 2019-11-28T11:20:41.268 INFO:teuthology.orchestra.run.smithi075.stdout:Cleaning repos: ceph ceph-noarch ceph-source epel lab-extras rhel-7-fcgi-ceph 2019-11-28T11:20:41.268 INFO:teuthology.orchestra.run.smithi075.stdout: : rhel-7-server-extras-rpms rhel-7-server-optional-rpms 2019-11-28T11:20:41.269 INFO:teuthology.orchestra.run.smithi075.stdout: : rhel-7-server-rpms rhel-ha-for-rhel-7-server-rpms 2019-11-28T11:20:41.316 INFO:teuthology.orchestra.run.smithi016.stdout:Cleaning repos: ceph ceph-noarch ceph-source epel lab-extras rhel-7-fcgi-ceph 2019-11-28T11:20:41.316 INFO:teuthology.orchestra.run.smithi016.stdout: : rhel-7-server-extras-rpms rhel-7-server-optional-rpms 2019-11-28T11:20:41.317 INFO:teuthology.orchestra.run.smithi016.stdout: : rhel-7-server-rpms rhel-ha-for-rhel-7-server-rpms 2019-11-28T11:20:41.350 INFO:teuthology.orchestra.run.smithi080.stdout:Cleaning repos: ceph ceph-noarch ceph-source epel lab-extras rhel-7-fcgi-ceph 2019-11-28T11:20:41.351 INFO:teuthology.orchestra.run.smithi080.stdout: : rhel-7-server-extras-rpms rhel-7-server-optional-rpms 2019-11-28T11:20:41.351 INFO:teuthology.orchestra.run.smithi080.stdout: : rhel-7-server-rpms rhel-ha-for-rhel-7-server-rpms 2019-11-28T11:20:41.689 INFO:teuthology.orchestra.run.smithi076.stdout:Cleaning up list of fastest mirrors 2019-11-28T11:20:41.690 INFO:teuthology.orchestra.run.smithi076.stdout:Other repos take up 1.6 M of disk space (use --verbose for details) 2019-11-28T11:20:41.709 INFO:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-daemon ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-ssh ceph-fuse libcephfs2 libcephfs-devel librados2 librbd1 python-ceph rbd-fuse python3-cephfs bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel 2019-11-28T11:20:41.796 INFO:teuthology.orchestra.run.smithi174.stdout:Cleaning up list of fastest mirrors 2019-11-28T11:20:41.797 INFO:teuthology.orchestra.run.smithi174.stdout:Other repos take up 1.6 M of disk space (use --verbose for details) 2019-11-28T11:20:41.810 INFO:teuthology.orchestra.run.smithi133.stdout:Cleaning up list of fastest mirrors 2019-11-28T11:20:41.811 INFO:teuthology.orchestra.run.smithi133.stdout:Other repos take up 1.6 M of disk space (use --verbose for details) 2019-11-28T11:20:41.817 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-daemon ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-ssh ceph-fuse libcephfs2 libcephfs-devel librados2 librbd1 python-ceph rbd-fuse python3-cephfs bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel 2019-11-28T11:20:41.847 INFO:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-daemon ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-ssh ceph-fuse libcephfs2 libcephfs-devel librados2 librbd1 python-ceph rbd-fuse python3-cephfs bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel 2019-11-28T11:20:41.899 INFO:teuthology.orchestra.run.smithi075.stdout:Cleaning up list of fastest mirrors 2019-11-28T11:20:41.900 INFO:teuthology.orchestra.run.smithi075.stdout:Other repos take up 1.6 M of disk space (use --verbose for details) 2019-11-28T11:20:41.901 INFO:teuthology.orchestra.run.smithi076.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:20:41.901 INFO:teuthology.orchestra.run.smithi076.stdout: : disabled-repos, subscription-manager 2019-11-28T11:20:41.921 INFO:teuthology.orchestra.run.smithi075:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-daemon ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-ssh ceph-fuse libcephfs2 libcephfs-devel librados2 librbd1 python-ceph rbd-fuse python3-cephfs bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel 2019-11-28T11:20:41.981 INFO:teuthology.orchestra.run.smithi080.stdout:Cleaning up list of fastest mirrors 2019-11-28T11:20:41.982 INFO:teuthology.orchestra.run.smithi080.stdout:Other repos take up 1.6 M of disk space (use --verbose for details) 2019-11-28T11:20:41.984 INFO:teuthology.orchestra.run.smithi016.stdout:Cleaning up list of fastest mirrors 2019-11-28T11:20:41.985 INFO:teuthology.orchestra.run.smithi016.stdout:Other repos take up 1.6 M of disk space (use --verbose for details) 2019-11-28T11:20:42.001 INFO:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-daemon ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-ssh ceph-fuse libcephfs2 libcephfs-devel librados2 librbd1 python-ceph rbd-fuse python3-cephfs bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel 2019-11-28T11:20:42.003 INFO:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-daemon ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-ssh ceph-fuse libcephfs2 libcephfs-devel librados2 librbd1 python-ceph rbd-fuse python3-cephfs bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel bison flex elfutils-libelf-devel openssl-devel 2019-11-28T11:20:42.008 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:20:42.009 INFO:teuthology.orchestra.run.smithi174.stdout: : disabled-repos, subscription-manager 2019-11-28T11:20:42.045 INFO:teuthology.orchestra.run.smithi133.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:20:42.045 INFO:teuthology.orchestra.run.smithi133.stdout: : disabled-repos, subscription-manager 2019-11-28T11:20:42.116 INFO:teuthology.orchestra.run.smithi075.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:20:42.116 INFO:teuthology.orchestra.run.smithi075.stdout: : disabled-repos, subscription-manager 2019-11-28T11:20:42.192 INFO:teuthology.orchestra.run.smithi080.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:20:42.193 INFO:teuthology.orchestra.run.smithi080.stdout: : disabled-repos, subscription-manager 2019-11-28T11:20:42.212 INFO:teuthology.orchestra.run.smithi016.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2019-11-28T11:20:42.212 INFO:teuthology.orchestra.run.smithi016.stdout: : disabled-repos, subscription-manager 2019-11-28T11:20:42.603 INFO:teuthology.orchestra.run.smithi076.stdout:Determining fastest mirrors 2019-11-28T11:20:42.679 INFO:teuthology.orchestra.run.smithi076.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T11:20:42.732 INFO:teuthology.orchestra.run.smithi133.stdout:Determining fastest mirrors 2019-11-28T11:20:42.735 INFO:teuthology.orchestra.run.smithi174.stdout:Determining fastest mirrors 2019-11-28T11:20:42.739 INFO:teuthology.orchestra.run.smithi075.stdout:Determining fastest mirrors 2019-11-28T11:20:42.750 INFO:teuthology.orchestra.run.smithi080.stdout:Determining fastest mirrors 2019-11-28T11:20:42.810 INFO:teuthology.orchestra.run.smithi133.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T11:20:42.811 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T11:20:42.816 INFO:teuthology.orchestra.run.smithi075.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T11:20:42.825 INFO:teuthology.orchestra.run.smithi080.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T11:20:42.835 INFO:teuthology.orchestra.run.smithi016.stdout:Determining fastest mirrors 2019-11-28T11:20:42.910 INFO:teuthology.orchestra.run.smithi016.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T11:21:13.314 INFO:teuthology.orchestra.run.smithi174.stdout:29 packages excluded due to repository priority protections 2019-11-28T11:21:13.375 INFO:teuthology.orchestra.run.smithi075.stdout:29 packages excluded due to repository priority protections 2019-11-28T11:21:13.727 INFO:teuthology.orchestra.run.smithi076.stdout:29 packages excluded due to repository priority protections 2019-11-28T11:21:15.083 INFO:teuthology.orchestra.run.smithi080.stdout:29 packages excluded due to repository priority protections 2019-11-28T11:21:16.374 INFO:teuthology.orchestra.run.smithi133.stdout:29 packages excluded due to repository priority protections 2019-11-28T11:21:16.574 INFO:teuthology.orchestra.run.smithi016.stdout:29 packages excluded due to repository priority protections 2019-11-28T11:21:25.958 INFO:teuthology.orchestra.run.smithi075.stdout:No package python3-cephfs available. 2019-11-28T11:21:26.587 INFO:teuthology.orchestra.run.smithi174.stdout:No package python3-cephfs available. 2019-11-28T11:21:26.587 INFO:teuthology.orchestra.run.smithi076.stdout:No package python3-cephfs available. 2019-11-28T11:21:27.652 INFO:teuthology.orchestra.run.smithi080.stdout:No package python3-cephfs available. 2019-11-28T11:21:29.364 INFO:teuthology.orchestra.run.smithi133.stdout:No package python3-cephfs available. 2019-11-28T11:21:29.729 INFO:teuthology.orchestra.run.smithi016.stdout:No package python3-cephfs available. 2019-11-28T11:21:58.216 INFO:teuthology.orchestra.run.smithi075.stdout:Resolving Dependencies 2019-11-28T11:21:58.216 INFO:teuthology.orchestra.run.smithi075.stdout:--> Running transaction check 2019-11-28T11:21:58.217 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package bison.x86_64 0:3.0.4-2.el7 will be installed 2019-11-28T11:21:58.225 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.226 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.227 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.228 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.230 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.232 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.240 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python36 for package: 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.243 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.244 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.246 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.248 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.250 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.251 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.252 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.253 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.254 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.255 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:58.256 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:58.257 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.257 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.257 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:58.259 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.259 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:58.260 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.261 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:58.262 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.265 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.266 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.267 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.269 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.271 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.272 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-test.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.276 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.277 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.278 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.280 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.281 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package elfutils-libelf-devel.x86_64 0:0.176-2.el7 will be installed 2019-11-28T11:21:58.282 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: pkgconfig(zlib) for package: elfutils-libelf-devel-0.176-2.el7.x86_64 2019-11-28T11:21:58.287 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package flex.x86_64 0:2.5.37-6.el7 will be installed 2019-11-28T11:21:58.287 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.288 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7798.g6882af3.el7 for package: 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.289 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.290 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-28T11:21:58.290 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package librados2.x86_64 2:15.0.0-7798.g6882af3.el7 will be an update 2019-11-28T11:21:58.292 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.293 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-28T11:21:58.293 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package librbd1.x86_64 2:15.0.0-7798.g6882af3.el7 will be an update 2019-11-28T11:21:58.294 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package openssl-devel.x86_64 1:1.0.2k-19.el7 will be installed 2019-11-28T11:21:58.294 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: krb5-devel(x86-64) for package: 1:openssl-devel-1.0.2k-19.el7.x86_64 2019-11-28T11:21:58.301 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.301 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.302 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.303 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.304 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.305 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.306 INFO:teuthology.orchestra.run.smithi075.stdout:--> Running transaction check 2019-11-28T11:21:58.306 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-base.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.312 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.315 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.315 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.316 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.317 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.320 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.320 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.321 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.321 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.321 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.322 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.325 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-28T11:21:58.325 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-28T11:21:58.327 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package krb5-devel.x86_64 0:1.15.1-37.el7_7.2 will be installed 2019-11-28T11:21:58.330 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: libverto-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:21:58.332 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: libselinux-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:21:58.338 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: libcom_err-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:21:58.348 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: keyutils-libs-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:21:58.351 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-28T11:21:58.351 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-28T11:21:58.352 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package librados-devel.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.352 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.352 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-28T11:21:58.353 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package librgw2.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.354 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-28T11:21:58.355 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-28T11:21:58.357 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-28T11:21:58.357 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.357 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-28T11:21:58.357 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-28T11:21:58.357 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:21:58.358 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:21:58.359 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:21:58.361 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:21:58.362 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:21:58.362 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-rados.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.363 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-rbd.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.364 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-28T11:21:58.364 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-28T11:21:58.364 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-28T11:21:58.365 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-28T11:21:58.367 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-rgw.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.368 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-28T11:21:58.368 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-28T11:21:58.369 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-28T11:21:58.369 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-28T11:21:58.369 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-28T11:21:58.370 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-28T11:21:58.371 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:21:58.372 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:21:58.373 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:21:58.374 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:21:58.377 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-28T11:21:58.378 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:21:58.380 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:21:58.381 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:21:58.382 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:21:58.382 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-28T11:21:58.385 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:21:58.388 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:21:58.389 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:21:58.389 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-28T11:21:58.391 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed 2019-11-28T11:21:58.391 INFO:teuthology.orchestra.run.smithi075.stdout:--> Running transaction check 2019-11-28T11:21:58.391 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package keyutils-libs-devel.x86_64 0:1.5.8-3.el7 will be installed 2019-11-28T11:21:58.391 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-28T11:21:58.396 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package libcom_err-devel.x86_64 0:1.42.9-16.el7 will be installed 2019-11-28T11:21:58.397 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package libselinux-devel.x86_64 0:2.5-14.1.el7 will be installed 2019-11-28T11:21:58.397 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: libsepol-devel(x86-64) >= 2.5-10 for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:21:58.397 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: pkgconfig(libsepol) for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:21:58.397 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: pkgconfig(libpcre) for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:21:58.401 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package libverto-devel.x86_64 0:0.2.5-4.el7 will be installed 2019-11-28T11:21:58.402 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-28T11:21:58.403 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-28T11:21:58.403 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.404 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.404 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-28T11:21:58.404 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-28T11:21:58.404 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-28T11:21:58.405 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-28T11:21:58.405 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-28T11:21:58.406 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-28T11:21:58.406 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-28T11:21:58.407 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-28T11:21:58.407 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-28T11:21:58.407 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-28T11:21:58.407 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-28T11:21:58.407 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-28T11:21:58.407 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-28T11:21:58.408 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-28T11:21:58.411 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:21:58.412 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:21:58.412 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:21:58.413 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-28T11:21:58.414 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-28T11:21:58.414 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-28T11:21:58.414 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-28T11:21:58.416 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-28T11:21:58.416 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-28T11:21:58.416 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-28T11:21:58.417 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-28T11:21:58.419 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-28T11:21:58.420 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-28T11:21:58.420 INFO:teuthology.orchestra.run.smithi075.stdout:--> Running transaction check 2019-11-28T11:21:58.420 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package libsepol-devel.x86_64 0:2.5-10.el7 will be installed 2019-11-28T11:21:58.421 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package pcre-devel.x86_64 0:8.32-17.el7 will be installed 2019-11-28T11:21:58.421 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-28T11:21:58.422 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-28T11:21:58.423 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-28T11:21:58.423 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-28T11:21:58.423 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-28T11:21:58.423 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-28T11:21:58.424 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-28T11:21:58.425 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-28T11:21:58.425 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-28T11:21:58.426 INFO:teuthology.orchestra.run.smithi075.stdout:--> Running transaction check 2019-11-28T11:21:58.426 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-28T11:21:58.426 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-28T11:21:58.426 INFO:teuthology.orchestra.run.smithi075.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-28T11:21:58.427 INFO:teuthology.orchestra.run.smithi075.stdout:--> Running transaction check 2019-11-28T11:21:58.427 INFO:teuthology.orchestra.run.smithi075.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-28T11:21:58.676 INFO:teuthology.orchestra.run.smithi076.stdout:Resolving Dependencies 2019-11-28T11:21:58.685 INFO:teuthology.orchestra.run.smithi076.stdout:--> Running transaction check 2019-11-28T11:21:58.685 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package bison.x86_64 0:3.0.4-2.el7 will be installed 2019-11-28T11:21:58.685 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.686 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.686 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.686 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.686 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.687 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.703 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python36 for package: 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.703 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.704 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.704 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.704 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.704 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.704 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.705 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.705 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.706 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.706 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:58.707 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:58.709 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.709 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.709 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:58.711 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.711 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:58.712 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.713 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:58.715 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.717 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.718 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.719 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.722 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.723 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.724 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-test.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.728 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.730 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.730 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.733 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.733 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package elfutils-libelf-devel.x86_64 0:0.176-2.el7 will be installed 2019-11-28T11:21:58.734 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: pkgconfig(zlib) for package: elfutils-libelf-devel-0.176-2.el7.x86_64 2019-11-28T11:21:58.739 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package flex.x86_64 0:2.5.37-6.el7 will be installed 2019-11-28T11:21:58.740 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.740 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7798.g6882af3.el7 for package: 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.741 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.742 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-28T11:21:58.745 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package librados2.x86_64 2:15.0.0-7798.g6882af3.el7 will be an update 2019-11-28T11:21:58.745 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.746 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-28T11:21:58.746 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package librbd1.x86_64 2:15.0.0-7798.g6882af3.el7 will be an update 2019-11-28T11:21:58.747 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package openssl-devel.x86_64 1:1.0.2k-19.el7 will be installed 2019-11-28T11:21:58.747 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: krb5-devel(x86-64) for package: 1:openssl-devel-1.0.2k-19.el7.x86_64 2019-11-28T11:21:58.753 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.753 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.754 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.780 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.783 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.783 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.783 INFO:teuthology.orchestra.run.smithi076.stdout:--> Running transaction check 2019-11-28T11:21:58.784 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-base.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.784 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.784 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.784 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.784 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.785 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.785 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:58.785 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.785 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.786 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.786 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.787 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.787 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-28T11:21:58.787 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-28T11:21:58.788 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package krb5-devel.x86_64 0:1.15.1-37.el7_7.2 will be installed 2019-11-28T11:21:58.789 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: libverto-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:21:58.789 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: libselinux-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:21:58.791 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: libcom_err-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:21:58.817 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: keyutils-libs-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:21:58.818 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-28T11:21:58.818 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-28T11:21:58.818 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package librados-devel.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.823 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.823 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-28T11:21:58.823 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package librgw2.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.824 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-28T11:21:58.824 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-28T11:21:58.824 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-28T11:21:58.824 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.825 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-28T11:21:58.826 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-28T11:21:58.826 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:21:58.827 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:21:58.827 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:21:58.827 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:21:58.827 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:21:58.827 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-rados.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.828 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-rbd.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.828 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-28T11:21:58.828 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-28T11:21:58.829 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-28T11:21:58.832 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-28T11:21:58.832 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-rgw.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.832 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-28T11:21:58.833 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-28T11:21:58.834 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-28T11:21:58.834 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-28T11:21:58.834 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-28T11:21:58.834 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-28T11:21:58.834 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:21:58.834 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:21:58.835 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:21:58.835 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:21:58.835 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-28T11:21:58.835 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:21:58.836 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:21:58.836 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:21:58.836 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:21:58.836 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-28T11:21:58.839 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:21:58.841 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:21:58.842 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:21:58.843 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-28T11:21:58.844 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed 2019-11-28T11:21:58.844 INFO:teuthology.orchestra.run.smithi076.stdout:--> Running transaction check 2019-11-28T11:21:58.846 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package keyutils-libs-devel.x86_64 0:1.5.8-3.el7 will be installed 2019-11-28T11:21:58.846 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-28T11:21:58.847 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package libcom_err-devel.x86_64 0:1.42.9-16.el7 will be installed 2019-11-28T11:21:58.847 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package libselinux-devel.x86_64 0:2.5-14.1.el7 will be installed 2019-11-28T11:21:58.847 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: libsepol-devel(x86-64) >= 2.5-10 for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:21:58.849 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: pkgconfig(libsepol) for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:21:58.850 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: pkgconfig(libpcre) for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:21:58.856 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package libverto-devel.x86_64 0:0.2.5-4.el7 will be installed 2019-11-28T11:21:58.856 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-28T11:21:58.857 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-28T11:21:58.858 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.858 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:58.858 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-28T11:21:58.859 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-28T11:21:58.859 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-28T11:21:58.861 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-28T11:21:58.861 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-28T11:21:58.861 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-28T11:21:58.861 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-28T11:21:58.861 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-28T11:21:58.861 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-28T11:21:58.861 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-28T11:21:58.862 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-28T11:21:58.862 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-28T11:21:58.862 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-28T11:21:58.862 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-28T11:21:58.863 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:21:58.863 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:21:58.864 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:21:58.864 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-28T11:21:58.865 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-28T11:21:58.867 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-28T11:21:58.867 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-28T11:21:58.870 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-28T11:21:58.871 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-28T11:21:58.871 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-28T11:21:58.872 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-28T11:21:58.874 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-28T11:21:58.874 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-28T11:21:58.874 INFO:teuthology.orchestra.run.smithi076.stdout:--> Running transaction check 2019-11-28T11:21:58.875 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package libsepol-devel.x86_64 0:2.5-10.el7 will be installed 2019-11-28T11:21:58.875 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package pcre-devel.x86_64 0:8.32-17.el7 will be installed 2019-11-28T11:21:58.875 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-28T11:21:58.876 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-28T11:21:58.876 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-28T11:21:58.876 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-28T11:21:58.877 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-28T11:21:58.877 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-28T11:21:58.879 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-28T11:21:58.879 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-28T11:21:58.879 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-28T11:21:58.880 INFO:teuthology.orchestra.run.smithi076.stdout:--> Running transaction check 2019-11-28T11:21:58.881 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-28T11:21:58.881 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-28T11:21:58.881 INFO:teuthology.orchestra.run.smithi076.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-28T11:21:58.881 INFO:teuthology.orchestra.run.smithi076.stdout:--> Running transaction check 2019-11-28T11:21:58.881 INFO:teuthology.orchestra.run.smithi076.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-28T11:21:59.120 INFO:teuthology.orchestra.run.smithi075.stdout:--> Finished Dependency Resolution 2019-11-28T11:21:59.202 INFO:teuthology.orchestra.run.smithi075.stdout: 2019-11-28T11:21:59.202 INFO:teuthology.orchestra.run.smithi075.stdout:Dependencies Resolved 2019-11-28T11:21:59.213 INFO:teuthology.orchestra.run.smithi075.stdout: 2019-11-28T11:21:59.213 INFO:teuthology.orchestra.run.smithi075.stdout:================================================================================ 2019-11-28T11:21:59.213 INFO:teuthology.orchestra.run.smithi075.stdout: Package Arch Version Repository Size 2019-11-28T11:21:59.213 INFO:teuthology.orchestra.run.smithi075.stdout:================================================================================ 2019-11-28T11:21:59.214 INFO:teuthology.orchestra.run.smithi075.stdout:Installing: 2019-11-28T11:21:59.214 INFO:teuthology.orchestra.run.smithi075.stdout: bison x86_64 3.0.4-2.el7 rhel-7-server-rpms 674 k 2019-11-28T11:21:59.214 INFO:teuthology.orchestra.run.smithi075.stdout: ceph x86_64 2:15.0.0-7798.g6882af3.el7 ceph 2.0 k 2019-11-28T11:21:59.214 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-daemon x86_64 2:15.0.0-7798.g6882af3.el7 ceph 17 k 2019-11-28T11:21:59.214 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-fuse x86_64 2:15.0.0-7798.g6882af3.el7 ceph 547 k 2019-11-28T11:21:59.214 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-mgr x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.7 M 2019-11-28T11:21:59.214 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 3.9 M 2019-11-28T11:21:59.215 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-mgr-diskprediction-cloud 2019-11-28T11:21:59.215 INFO:teuthology.orchestra.run.smithi075.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 82 k 2019-11-28T11:21:59.215 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-mgr-diskprediction-local 2019-11-28T11:21:59.215 INFO:teuthology.orchestra.run.smithi075.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 8.6 M 2019-11-28T11:21:59.215 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-mgr-rook noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 23 k 2019-11-28T11:21:59.215 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-mgr-ssh noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 33 k 2019-11-28T11:21:59.215 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-radosgw x86_64 2:15.0.0-7798.g6882af3.el7 ceph 6.1 M 2019-11-28T11:21:59.216 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-test x86_64 2:15.0.0-7798.g6882af3.el7 ceph 37 M 2019-11-28T11:21:59.216 INFO:teuthology.orchestra.run.smithi075.stdout: elfutils-libelf-devel 2019-11-28T11:21:59.216 INFO:teuthology.orchestra.run.smithi075.stdout: x86_64 0.176-2.el7 rhel-7-server-rpms 39 k 2019-11-28T11:21:59.216 INFO:teuthology.orchestra.run.smithi075.stdout: flex x86_64 2.5.37-6.el7 rhel-7-server-rpms 293 k 2019-11-28T11:21:59.216 INFO:teuthology.orchestra.run.smithi075.stdout: libcephfs-devel x86_64 2:15.0.0-7798.g6882af3.el7 ceph 17 k 2019-11-28T11:21:59.216 INFO:teuthology.orchestra.run.smithi075.stdout: libcephfs2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 483 k 2019-11-28T11:21:59.216 INFO:teuthology.orchestra.run.smithi075.stdout: openssl-devel x86_64 1:1.0.2k-19.el7 rhel-7-server-rpms 1.5 M 2019-11-28T11:21:59.217 INFO:teuthology.orchestra.run.smithi075.stdout: python-ceph-compat x86_64 2:15.0.0-7798.g6882af3.el7 ceph 2.2 k 2019-11-28T11:21:59.217 INFO:teuthology.orchestra.run.smithi075.stdout: rbd-fuse x86_64 2:15.0.0-7798.g6882af3.el7 ceph 68 k 2019-11-28T11:21:59.217 INFO:teuthology.orchestra.run.smithi075.stdout:Updating: 2019-11-28T11:21:59.217 INFO:teuthology.orchestra.run.smithi075.stdout: librados2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 3.5 M 2019-11-28T11:21:59.217 INFO:teuthology.orchestra.run.smithi075.stdout: librbd1 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.7 M 2019-11-28T11:21:59.217 INFO:teuthology.orchestra.run.smithi075.stdout:Installing for dependencies: 2019-11-28T11:21:59.217 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-base x86_64 2:15.0.0-7798.g6882af3.el7 ceph 5.6 M 2019-11-28T11:21:59.218 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-common x86_64 2:15.0.0-7798.g6882af3.el7 ceph 19 M 2019-11-28T11:21:59.218 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-grafana-dashboards 2019-11-28T11:21:59.218 INFO:teuthology.orchestra.run.smithi075.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 18 k 2019-11-28T11:21:59.218 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-mds x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.9 M 2019-11-28T11:21:59.219 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-mon x86_64 2:15.0.0-7798.g6882af3.el7 ceph 4.3 M 2019-11-28T11:21:59.219 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-osd x86_64 2:15.0.0-7798.g6882af3.el7 ceph 16 M 2019-11-28T11:21:59.219 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-selinux x86_64 2:15.0.0-7798.g6882af3.el7 ceph 20 k 2019-11-28T11:21:59.219 INFO:teuthology.orchestra.run.smithi075.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-28T11:21:59.219 INFO:teuthology.orchestra.run.smithi075.stdout: keyutils-libs-devel x86_64 1.5.8-3.el7 rhel-7-server-rpms 37 k 2019-11-28T11:21:59.219 INFO:teuthology.orchestra.run.smithi075.stdout: krb5-devel x86_64 1.15.1-37.el7_7.2 rhel-7-server-rpms 272 k 2019-11-28T11:21:59.219 INFO:teuthology.orchestra.run.smithi075.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-28T11:21:59.220 INFO:teuthology.orchestra.run.smithi075.stdout: libcom_err-devel x86_64 1.42.9-16.el7 rhel-7-server-rpms 32 k 2019-11-28T11:21:59.220 INFO:teuthology.orchestra.run.smithi075.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-28T11:21:59.220 INFO:teuthology.orchestra.run.smithi075.stdout: librabbitmq x86_64 0.8.0-2.el7 rhel-7-server-rpms 37 k 2019-11-28T11:21:59.220 INFO:teuthology.orchestra.run.smithi075.stdout: librados-devel x86_64 2:15.0.0-7798.g6882af3.el7 ceph 153 k 2019-11-28T11:21:59.220 INFO:teuthology.orchestra.run.smithi075.stdout: libradosstriper1 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 361 k 2019-11-28T11:21:59.220 INFO:teuthology.orchestra.run.smithi075.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-28T11:21:59.220 INFO:teuthology.orchestra.run.smithi075.stdout: librgw2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 5.4 M 2019-11-28T11:21:59.221 INFO:teuthology.orchestra.run.smithi075.stdout: libselinux-devel x86_64 2.5-14.1.el7 rhel-7-server-rpms 187 k 2019-11-28T11:21:59.221 INFO:teuthology.orchestra.run.smithi075.stdout: libsepol-devel x86_64 2.5-10.el7 rhel-7-server-rpms 77 k 2019-11-28T11:21:59.221 INFO:teuthology.orchestra.run.smithi075.stdout: libverto-devel x86_64 0.2.5-4.el7 rhel-7-server-rpms 12 k 2019-11-28T11:21:59.221 INFO:teuthology.orchestra.run.smithi075.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-28T11:21:59.221 INFO:teuthology.orchestra.run.smithi075.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 rhel-7-server-rpms 206 k 2019-11-28T11:21:59.221 INFO:teuthology.orchestra.run.smithi075.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-28T11:21:59.221 INFO:teuthology.orchestra.run.smithi075.stdout: pcre-devel x86_64 8.32-17.el7 rhel-7-server-rpms 480 k 2019-11-28T11:21:59.222 INFO:teuthology.orchestra.run.smithi075.stdout: python-beaker noarch 1.5.4-10.el7 rhel-7-server-rpms 80 k 2019-11-28T11:21:59.222 INFO:teuthology.orchestra.run.smithi075.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-28T11:21:59.222 INFO:teuthology.orchestra.run.smithi075.stdout: python-ceph-argparse 2019-11-28T11:21:59.222 INFO:teuthology.orchestra.run.smithi075.stdout: x86_64 2:15.0.0-7798.g6882af3.el7 ceph 35 k 2019-11-28T11:21:59.222 INFO:teuthology.orchestra.run.smithi075.stdout: python-ceph-common x86_64 2:15.0.0-7798.g6882af3.el7 ceph 42 k 2019-11-28T11:21:59.222 INFO:teuthology.orchestra.run.smithi075.stdout: python-cephfs x86_64 2:15.0.0-7798.g6882af3.el7 ceph 102 k 2019-11-28T11:21:59.222 INFO:teuthology.orchestra.run.smithi075.stdout: python-cherrypy noarch 3.2.2-4.el7 rhel-7-server-rpms 422 k 2019-11-28T11:21:59.223 INFO:teuthology.orchestra.run.smithi075.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-28T11:21:59.223 INFO:teuthology.orchestra.run.smithi075.stdout: python-jwcrypto noarch 0.4.2-1.el7 rhel-7-server-rpms 57 k 2019-11-28T11:21:59.223 INFO:teuthology.orchestra.run.smithi075.stdout: python-mako noarch 0.8.1-2.el7 rhel-7-server-rpms 307 k 2019-11-28T11:21:59.223 INFO:teuthology.orchestra.run.smithi075.stdout: python-markupsafe x86_64 0.11-10.el7 rhel-7-server-rpms 25 k 2019-11-28T11:21:59.223 INFO:teuthology.orchestra.run.smithi075.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 2019-11-28T11:21:59.223 INFO:teuthology.orchestra.run.smithi075.stdout: rhel-7-server-rpms 866 k 2019-11-28T11:21:59.223 INFO:teuthology.orchestra.run.smithi075.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-28T11:21:59.224 INFO:teuthology.orchestra.run.smithi075.stdout: python-prettytable noarch 0.7.2-3.el7 rhel-7-server-rpms 37 k 2019-11-28T11:21:59.224 INFO:teuthology.orchestra.run.smithi075.stdout: python-rados x86_64 2:15.0.0-7798.g6882af3.el7 ceph 209 k 2019-11-28T11:21:59.224 INFO:teuthology.orchestra.run.smithi075.stdout: python-rbd x86_64 2:15.0.0-7798.g6882af3.el7 ceph 199 k 2019-11-28T11:21:59.224 INFO:teuthology.orchestra.run.smithi075.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-28T11:21:59.224 INFO:teuthology.orchestra.run.smithi075.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-28T11:21:59.224 INFO:teuthology.orchestra.run.smithi075.stdout: python-requests noarch 2.6.0-7.el7_7 rhel-7-server-rpms 95 k 2019-11-28T11:21:59.224 INFO:teuthology.orchestra.run.smithi075.stdout: python-rgw x86_64 2:15.0.0-7798.g6882af3.el7 ceph 77 k 2019-11-28T11:21:59.225 INFO:teuthology.orchestra.run.smithi075.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-28T11:21:59.225 INFO:teuthology.orchestra.run.smithi075.stdout: python-simplegeneric 2019-11-28T11:21:59.225 INFO:teuthology.orchestra.run.smithi075.stdout: noarch 0.8-7.el7 epel 12 k 2019-11-28T11:21:59.225 INFO:teuthology.orchestra.run.smithi075.stdout: python-singledispatch 2019-11-28T11:21:59.225 INFO:teuthology.orchestra.run.smithi075.stdout: noarch 3.4.0.2-2.el7 epel 18 k 2019-11-28T11:21:59.225 INFO:teuthology.orchestra.run.smithi075.stdout: python-tempita noarch 0.5.1-6.el7 rhel-7-server-rpms 33 k 2019-11-28T11:21:59.225 INFO:teuthology.orchestra.run.smithi075.stdout: python-urllib3 noarch 1.10.2-7.el7 rhel-7-server-rpms 103 k 2019-11-28T11:21:59.226 INFO:teuthology.orchestra.run.smithi075.stdout: python-webob noarch 1.2.3-7.el7 rhel-7-server-optional-rpms 2019-11-28T11:21:59.226 INFO:teuthology.orchestra.run.smithi075.stdout: 202 k 2019-11-28T11:21:59.226 INFO:teuthology.orchestra.run.smithi075.stdout: python-websocket-client 2019-11-28T11:21:59.226 INFO:teuthology.orchestra.run.smithi075.stdout: noarch 0.56.0-3.git3c25814.el7 rhel-7-server-extras-rpms 2019-11-28T11:21:59.226 INFO:teuthology.orchestra.run.smithi075.stdout: 66 k 2019-11-28T11:21:59.226 INFO:teuthology.orchestra.run.smithi075.stdout: python-webtest noarch 1.3.4-6.el7 rhel-7-server-optional-rpms 2019-11-28T11:21:59.226 INFO:teuthology.orchestra.run.smithi075.stdout: 102 k 2019-11-28T11:21:59.227 INFO:teuthology.orchestra.run.smithi075.stdout: python-werkzeug noarch 0.9.1-2.el7 rhel-7-server-extras-rpms 2019-11-28T11:21:59.227 INFO:teuthology.orchestra.run.smithi075.stdout: 562 k 2019-11-28T11:21:59.227 INFO:teuthology.orchestra.run.smithi075.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-28T11:21:59.227 INFO:teuthology.orchestra.run.smithi075.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-28T11:21:59.227 INFO:teuthology.orchestra.run.smithi075.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-28T11:21:59.227 INFO:teuthology.orchestra.run.smithi075.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-28T11:21:59.227 INFO:teuthology.orchestra.run.smithi075.stdout: python2-oauthlib noarch 2.0.1-8.el7 rhel-7-server-rpms 146 k 2019-11-28T11:21:59.228 INFO:teuthology.orchestra.run.smithi075.stdout: python2-pyasn1-modules 2019-11-28T11:21:59.228 INFO:teuthology.orchestra.run.smithi075.stdout: noarch 0.1.9-7.el7 rhel-7-server-optional-rpms 2019-11-28T11:21:59.228 INFO:teuthology.orchestra.run.smithi075.stdout: 59 k 2019-11-28T11:21:59.228 INFO:teuthology.orchestra.run.smithi075.stdout: python2-requests-oauthlib 2019-11-28T11:21:59.228 INFO:teuthology.orchestra.run.smithi075.stdout: noarch 0.8.0-5.el7 rhel-7-server-rpms 35 k 2019-11-28T11:21:59.229 INFO:teuthology.orchestra.run.smithi075.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-28T11:21:59.229 INFO:teuthology.orchestra.run.smithi075.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-28T11:21:59.229 INFO:teuthology.orchestra.run.smithi075.stdout: python3 x86_64 3.6.8-10.el7 rhel-7-server-rpms 69 k 2019-11-28T11:21:59.229 INFO:teuthology.orchestra.run.smithi075.stdout: python3-libs x86_64 3.6.8-10.el7 rhel-7-server-rpms 7.0 M 2019-11-28T11:21:59.229 INFO:teuthology.orchestra.run.smithi075.stdout: python3-pip noarch 9.0.3-5.el7 rhel-7-server-rpms 1.8 M 2019-11-28T11:21:59.229 INFO:teuthology.orchestra.run.smithi075.stdout: python3-setuptools noarch 39.2.0-10.el7 rhel-7-server-rpms 629 k 2019-11-28T11:21:59.230 INFO:teuthology.orchestra.run.smithi075.stdout: scipy x86_64 0.12.1-6.el7 rhel-7-server-rpms 9.3 M 2019-11-28T11:21:59.230 INFO:teuthology.orchestra.run.smithi075.stdout: socat x86_64 1.7.3.2-2.el7 rhel-7-server-rpms 290 k 2019-11-28T11:21:59.230 INFO:teuthology.orchestra.run.smithi075.stdout: suitesparse x86_64 4.0.2-10.el7 rhel-7-server-rpms 928 k 2019-11-28T11:21:59.230 INFO:teuthology.orchestra.run.smithi075.stdout: tbb x86_64 4.1-9.20130314.el7 rhel-7-server-rpms 124 k 2019-11-28T11:21:59.230 INFO:teuthology.orchestra.run.smithi075.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-28T11:21:59.230 INFO:teuthology.orchestra.run.smithi075.stdout: zlib-devel x86_64 1.2.7-18.el7 rhel-7-server-rpms 50 k 2019-11-28T11:21:59.230 INFO:teuthology.orchestra.run.smithi075.stdout: 2019-11-28T11:21:59.231 INFO:teuthology.orchestra.run.smithi075.stdout:Transaction Summary 2019-11-28T11:21:59.231 INFO:teuthology.orchestra.run.smithi075.stdout:================================================================================ 2019-11-28T11:21:59.231 INFO:teuthology.orchestra.run.smithi075.stdout:Install 19 Packages (+72 Dependent packages) 2019-11-28T11:21:59.231 INFO:teuthology.orchestra.run.smithi075.stdout:Upgrade 2 Packages 2019-11-28T11:21:59.231 INFO:teuthology.orchestra.run.smithi075.stdout: 2019-11-28T11:21:59.231 INFO:teuthology.orchestra.run.smithi075.stdout:Total download size: 148 M 2019-11-28T11:21:59.231 INFO:teuthology.orchestra.run.smithi075.stdout:Downloading packages: 2019-11-28T11:21:59.232 INFO:teuthology.orchestra.run.smithi075.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-28T11:21:59.583 INFO:teuthology.orchestra.run.smithi076.stdout:--> Finished Dependency Resolution 2019-11-28T11:21:59.665 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:21:59.665 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies Resolved 2019-11-28T11:21:59.677 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:21:59.677 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2019-11-28T11:21:59.678 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repository Size 2019-11-28T11:21:59.678 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2019-11-28T11:21:59.678 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2019-11-28T11:21:59.678 INFO:teuthology.orchestra.run.smithi076.stdout: bison x86_64 3.0.4-2.el7 rhel-7-server-rpms 674 k 2019-11-28T11:21:59.679 INFO:teuthology.orchestra.run.smithi076.stdout: ceph x86_64 2:15.0.0-7798.g6882af3.el7 ceph 2.0 k 2019-11-28T11:21:59.679 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-daemon x86_64 2:15.0.0-7798.g6882af3.el7 ceph 17 k 2019-11-28T11:21:59.679 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-fuse x86_64 2:15.0.0-7798.g6882af3.el7 ceph 547 k 2019-11-28T11:21:59.680 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.7 M 2019-11-28T11:21:59.680 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 3.9 M 2019-11-28T11:21:59.680 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-cloud 2019-11-28T11:21:59.680 INFO:teuthology.orchestra.run.smithi076.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 82 k 2019-11-28T11:21:59.681 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-local 2019-11-28T11:21:59.681 INFO:teuthology.orchestra.run.smithi076.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 8.6 M 2019-11-28T11:21:59.681 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-rook noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 23 k 2019-11-28T11:21:59.681 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-ssh noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 33 k 2019-11-28T11:21:59.682 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-radosgw x86_64 2:15.0.0-7798.g6882af3.el7 ceph 6.1 M 2019-11-28T11:21:59.682 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-test x86_64 2:15.0.0-7798.g6882af3.el7 ceph 37 M 2019-11-28T11:21:59.682 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libelf-devel 2019-11-28T11:21:59.682 INFO:teuthology.orchestra.run.smithi076.stdout: x86_64 0.176-2.el7 rhel-7-server-rpms 39 k 2019-11-28T11:21:59.683 INFO:teuthology.orchestra.run.smithi076.stdout: flex x86_64 2.5.37-6.el7 rhel-7-server-rpms 293 k 2019-11-28T11:21:59.683 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs-devel x86_64 2:15.0.0-7798.g6882af3.el7 ceph 17 k 2019-11-28T11:21:59.683 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 483 k 2019-11-28T11:21:59.683 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-devel x86_64 1:1.0.2k-19.el7 rhel-7-server-rpms 1.5 M 2019-11-28T11:21:59.684 INFO:teuthology.orchestra.run.smithi076.stdout: python-ceph-compat x86_64 2:15.0.0-7798.g6882af3.el7 ceph 2.2 k 2019-11-28T11:21:59.684 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-fuse x86_64 2:15.0.0-7798.g6882af3.el7 ceph 68 k 2019-11-28T11:21:59.684 INFO:teuthology.orchestra.run.smithi076.stdout:Updating: 2019-11-28T11:21:59.685 INFO:teuthology.orchestra.run.smithi076.stdout: librados2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 3.5 M 2019-11-28T11:21:59.685 INFO:teuthology.orchestra.run.smithi076.stdout: librbd1 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.7 M 2019-11-28T11:21:59.685 INFO:teuthology.orchestra.run.smithi076.stdout:Installing for dependencies: 2019-11-28T11:21:59.685 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-base x86_64 2:15.0.0-7798.g6882af3.el7 ceph 5.6 M 2019-11-28T11:21:59.686 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-common x86_64 2:15.0.0-7798.g6882af3.el7 ceph 19 M 2019-11-28T11:21:59.686 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-grafana-dashboards 2019-11-28T11:21:59.687 INFO:teuthology.orchestra.run.smithi076.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 18 k 2019-11-28T11:21:59.687 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mds x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.9 M 2019-11-28T11:21:59.687 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mon x86_64 2:15.0.0-7798.g6882af3.el7 ceph 4.3 M 2019-11-28T11:21:59.687 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-osd x86_64 2:15.0.0-7798.g6882af3.el7 ceph 16 M 2019-11-28T11:21:59.688 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-selinux x86_64 2:15.0.0-7798.g6882af3.el7 ceph 20 k 2019-11-28T11:21:59.688 INFO:teuthology.orchestra.run.smithi076.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-28T11:21:59.688 INFO:teuthology.orchestra.run.smithi076.stdout: keyutils-libs-devel x86_64 1.5.8-3.el7 rhel-7-server-rpms 37 k 2019-11-28T11:21:59.688 INFO:teuthology.orchestra.run.smithi076.stdout: krb5-devel x86_64 1.15.1-37.el7_7.2 rhel-7-server-rpms 272 k 2019-11-28T11:21:59.689 INFO:teuthology.orchestra.run.smithi076.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-28T11:21:59.689 INFO:teuthology.orchestra.run.smithi076.stdout: libcom_err-devel x86_64 1.42.9-16.el7 rhel-7-server-rpms 32 k 2019-11-28T11:21:59.689 INFO:teuthology.orchestra.run.smithi076.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-28T11:21:59.690 INFO:teuthology.orchestra.run.smithi076.stdout: librabbitmq x86_64 0.8.0-2.el7 rhel-7-server-rpms 37 k 2019-11-28T11:21:59.690 INFO:teuthology.orchestra.run.smithi076.stdout: librados-devel x86_64 2:15.0.0-7798.g6882af3.el7 ceph 153 k 2019-11-28T11:21:59.690 INFO:teuthology.orchestra.run.smithi076.stdout: libradosstriper1 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 361 k 2019-11-28T11:21:59.690 INFO:teuthology.orchestra.run.smithi076.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-28T11:21:59.691 INFO:teuthology.orchestra.run.smithi076.stdout: librgw2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 5.4 M 2019-11-28T11:21:59.691 INFO:teuthology.orchestra.run.smithi076.stdout: libselinux-devel x86_64 2.5-14.1.el7 rhel-7-server-rpms 187 k 2019-11-28T11:21:59.691 INFO:teuthology.orchestra.run.smithi076.stdout: libsepol-devel x86_64 2.5-10.el7 rhel-7-server-rpms 77 k 2019-11-28T11:21:59.691 INFO:teuthology.orchestra.run.smithi076.stdout: libverto-devel x86_64 0.2.5-4.el7 rhel-7-server-rpms 12 k 2019-11-28T11:21:59.692 INFO:teuthology.orchestra.run.smithi076.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-28T11:21:59.692 INFO:teuthology.orchestra.run.smithi076.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 rhel-7-server-rpms 206 k 2019-11-28T11:21:59.692 INFO:teuthology.orchestra.run.smithi076.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-28T11:21:59.692 INFO:teuthology.orchestra.run.smithi076.stdout: pcre-devel x86_64 8.32-17.el7 rhel-7-server-rpms 480 k 2019-11-28T11:21:59.693 INFO:teuthology.orchestra.run.smithi076.stdout: python-beaker noarch 1.5.4-10.el7 rhel-7-server-rpms 80 k 2019-11-28T11:21:59.693 INFO:teuthology.orchestra.run.smithi076.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-28T11:21:59.693 INFO:teuthology.orchestra.run.smithi076.stdout: python-ceph-argparse 2019-11-28T11:21:59.693 INFO:teuthology.orchestra.run.smithi076.stdout: x86_64 2:15.0.0-7798.g6882af3.el7 ceph 35 k 2019-11-28T11:21:59.694 INFO:teuthology.orchestra.run.smithi076.stdout: python-ceph-common x86_64 2:15.0.0-7798.g6882af3.el7 ceph 42 k 2019-11-28T11:21:59.694 INFO:teuthology.orchestra.run.smithi076.stdout: python-cephfs x86_64 2:15.0.0-7798.g6882af3.el7 ceph 102 k 2019-11-28T11:21:59.694 INFO:teuthology.orchestra.run.smithi076.stdout: python-cherrypy noarch 3.2.2-4.el7 rhel-7-server-rpms 422 k 2019-11-28T11:21:59.694 INFO:teuthology.orchestra.run.smithi076.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-28T11:21:59.695 INFO:teuthology.orchestra.run.smithi076.stdout: python-jwcrypto noarch 0.4.2-1.el7 rhel-7-server-rpms 57 k 2019-11-28T11:21:59.695 INFO:teuthology.orchestra.run.smithi076.stdout: python-mako noarch 0.8.1-2.el7 rhel-7-server-rpms 307 k 2019-11-28T11:21:59.695 INFO:teuthology.orchestra.run.smithi076.stdout: python-markupsafe x86_64 0.11-10.el7 rhel-7-server-rpms 25 k 2019-11-28T11:21:59.695 INFO:teuthology.orchestra.run.smithi076.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 2019-11-28T11:21:59.696 INFO:teuthology.orchestra.run.smithi076.stdout: rhel-7-server-rpms 866 k 2019-11-28T11:21:59.696 INFO:teuthology.orchestra.run.smithi076.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-28T11:21:59.696 INFO:teuthology.orchestra.run.smithi076.stdout: python-prettytable noarch 0.7.2-3.el7 rhel-7-server-rpms 37 k 2019-11-28T11:21:59.696 INFO:teuthology.orchestra.run.smithi076.stdout: python-rados x86_64 2:15.0.0-7798.g6882af3.el7 ceph 209 k 2019-11-28T11:21:59.697 INFO:teuthology.orchestra.run.smithi076.stdout: python-rbd x86_64 2:15.0.0-7798.g6882af3.el7 ceph 199 k 2019-11-28T11:21:59.698 INFO:teuthology.orchestra.run.smithi076.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-28T11:21:59.698 INFO:teuthology.orchestra.run.smithi076.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-28T11:21:59.698 INFO:teuthology.orchestra.run.smithi076.stdout: python-requests noarch 2.6.0-7.el7_7 rhel-7-server-rpms 95 k 2019-11-28T11:21:59.699 INFO:teuthology.orchestra.run.smithi076.stdout: python-rgw x86_64 2:15.0.0-7798.g6882af3.el7 ceph 77 k 2019-11-28T11:21:59.699 INFO:teuthology.orchestra.run.smithi076.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-28T11:21:59.699 INFO:teuthology.orchestra.run.smithi076.stdout: python-simplegeneric 2019-11-28T11:21:59.699 INFO:teuthology.orchestra.run.smithi076.stdout: noarch 0.8-7.el7 epel 12 k 2019-11-28T11:21:59.700 INFO:teuthology.orchestra.run.smithi076.stdout: python-singledispatch 2019-11-28T11:21:59.700 INFO:teuthology.orchestra.run.smithi076.stdout: noarch 3.4.0.2-2.el7 epel 18 k 2019-11-28T11:21:59.700 INFO:teuthology.orchestra.run.smithi076.stdout: python-tempita noarch 0.5.1-6.el7 rhel-7-server-rpms 33 k 2019-11-28T11:21:59.700 INFO:teuthology.orchestra.run.smithi076.stdout: python-urllib3 noarch 1.10.2-7.el7 rhel-7-server-rpms 103 k 2019-11-28T11:21:59.701 INFO:teuthology.orchestra.run.smithi076.stdout: python-webob noarch 1.2.3-7.el7 rhel-7-server-optional-rpms 2019-11-28T11:21:59.701 INFO:teuthology.orchestra.run.smithi076.stdout: 202 k 2019-11-28T11:21:59.701 INFO:teuthology.orchestra.run.smithi076.stdout: python-websocket-client 2019-11-28T11:21:59.701 INFO:teuthology.orchestra.run.smithi076.stdout: noarch 0.56.0-3.git3c25814.el7 rhel-7-server-extras-rpms 2019-11-28T11:21:59.701 INFO:teuthology.orchestra.run.smithi076.stdout: 66 k 2019-11-28T11:21:59.702 INFO:teuthology.orchestra.run.smithi076.stdout: python-webtest noarch 1.3.4-6.el7 rhel-7-server-optional-rpms 2019-11-28T11:21:59.702 INFO:teuthology.orchestra.run.smithi076.stdout: 102 k 2019-11-28T11:21:59.702 INFO:teuthology.orchestra.run.smithi076.stdout: python-werkzeug noarch 0.9.1-2.el7 rhel-7-server-extras-rpms 2019-11-28T11:21:59.702 INFO:teuthology.orchestra.run.smithi076.stdout: 562 k 2019-11-28T11:21:59.702 INFO:teuthology.orchestra.run.smithi076.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-28T11:21:59.703 INFO:teuthology.orchestra.run.smithi076.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-28T11:21:59.703 INFO:teuthology.orchestra.run.smithi076.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-28T11:21:59.703 INFO:teuthology.orchestra.run.smithi076.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-28T11:21:59.703 INFO:teuthology.orchestra.run.smithi076.stdout: python2-oauthlib noarch 2.0.1-8.el7 rhel-7-server-rpms 146 k 2019-11-28T11:21:59.703 INFO:teuthology.orchestra.run.smithi076.stdout: python2-pyasn1-modules 2019-11-28T11:21:59.704 INFO:teuthology.orchestra.run.smithi076.stdout: noarch 0.1.9-7.el7 rhel-7-server-optional-rpms 2019-11-28T11:21:59.704 INFO:teuthology.orchestra.run.smithi076.stdout: 59 k 2019-11-28T11:21:59.704 INFO:teuthology.orchestra.run.smithi076.stdout: python2-requests-oauthlib 2019-11-28T11:21:59.704 INFO:teuthology.orchestra.run.smithi076.stdout: noarch 0.8.0-5.el7 rhel-7-server-rpms 35 k 2019-11-28T11:21:59.704 INFO:teuthology.orchestra.run.smithi076.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-28T11:21:59.705 INFO:teuthology.orchestra.run.smithi076.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-28T11:21:59.705 INFO:teuthology.orchestra.run.smithi076.stdout: python3 x86_64 3.6.8-10.el7 rhel-7-server-rpms 69 k 2019-11-28T11:21:59.705 INFO:teuthology.orchestra.run.smithi076.stdout: python3-libs x86_64 3.6.8-10.el7 rhel-7-server-rpms 7.0 M 2019-11-28T11:21:59.705 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pip noarch 9.0.3-5.el7 rhel-7-server-rpms 1.8 M 2019-11-28T11:21:59.705 INFO:teuthology.orchestra.run.smithi076.stdout: python3-setuptools noarch 39.2.0-10.el7 rhel-7-server-rpms 629 k 2019-11-28T11:21:59.706 INFO:teuthology.orchestra.run.smithi076.stdout: scipy x86_64 0.12.1-6.el7 rhel-7-server-rpms 9.3 M 2019-11-28T11:21:59.706 INFO:teuthology.orchestra.run.smithi076.stdout: socat x86_64 1.7.3.2-2.el7 rhel-7-server-rpms 290 k 2019-11-28T11:21:59.706 INFO:teuthology.orchestra.run.smithi076.stdout: suitesparse x86_64 4.0.2-10.el7 rhel-7-server-rpms 928 k 2019-11-28T11:21:59.706 INFO:teuthology.orchestra.run.smithi076.stdout: tbb x86_64 4.1-9.20130314.el7 rhel-7-server-rpms 124 k 2019-11-28T11:21:59.706 INFO:teuthology.orchestra.run.smithi076.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-28T11:21:59.707 INFO:teuthology.orchestra.run.smithi076.stdout: zlib-devel x86_64 1.2.7-18.el7 rhel-7-server-rpms 50 k 2019-11-28T11:21:59.707 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:21:59.707 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2019-11-28T11:21:59.708 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2019-11-28T11:21:59.708 INFO:teuthology.orchestra.run.smithi076.stdout:Install 19 Packages (+72 Dependent packages) 2019-11-28T11:21:59.708 INFO:teuthology.orchestra.run.smithi076.stdout:Upgrade 2 Packages 2019-11-28T11:21:59.708 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:21:59.709 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 148 M 2019-11-28T11:21:59.709 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading packages: 2019-11-28T11:21:59.710 INFO:teuthology.orchestra.run.smithi076.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-28T11:21:59.858 INFO:teuthology.orchestra.run.smithi174.stdout:Resolving Dependencies 2019-11-28T11:21:59.860 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-28T11:21:59.860 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package bison.x86_64 0:3.0.4-2.el7 will be installed 2019-11-28T11:21:59.867 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.868 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.870 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.871 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.872 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.874 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.882 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python36 for package: 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.885 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.886 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.888 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.890 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.892 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.893 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.894 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.895 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.896 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.897 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:59.897 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:59.898 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.899 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.899 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:59.902 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.902 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:59.902 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.903 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:59.904 INFO:teuthology.orchestra.run.smithi080.stdout:Resolving Dependencies 2019-11-28T11:21:59.905 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.905 INFO:teuthology.orchestra.run.smithi080.stdout:--> Running transaction check 2019-11-28T11:21:59.905 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package bison.x86_64 0:3.0.4-2.el7 will be installed 2019-11-28T11:21:59.907 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.908 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.909 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.911 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.912 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.913 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.913 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-test.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.914 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.915 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.916 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.917 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.918 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.919 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.919 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.920 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.921 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.923 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package elfutils-libelf-devel.x86_64 0:0.176-2.el7 will be installed 2019-11-28T11:21:59.923 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: pkgconfig(zlib) for package: elfutils-libelf-devel-0.176-2.el7.x86_64 2019-11-28T11:21:59.927 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python36 for package: 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.928 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package flex.x86_64 0:2.5.37-6.el7 will be installed 2019-11-28T11:21:59.929 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.929 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7798.g6882af3.el7 for package: 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.930 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.931 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.931 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-28T11:21:59.932 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.932 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package librados2.x86_64 2:15.0.0-7798.g6882af3.el7 will be an update 2019-11-28T11:21:59.933 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.934 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.935 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-28T11:21:59.935 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package librbd1.x86_64 2:15.0.0-7798.g6882af3.el7 will be an update 2019-11-28T11:21:59.936 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.937 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package openssl-devel.x86_64 1:1.0.2k-19.el7 will be installed 2019-11-28T11:21:59.937 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: krb5-devel(x86-64) for package: 1:openssl-devel-1.0.2k-19.el7.x86_64 2019-11-28T11:21:59.937 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.938 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.939 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.940 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.941 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.942 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:59.942 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.943 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.945 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:59.945 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.945 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.946 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:59.946 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.946 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.948 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.948 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:59.949 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.949 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.949 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.949 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-28T11:21:59.951 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-base.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.952 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:21:59.952 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.953 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.953 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.954 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.955 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.955 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.957 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.957 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.958 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.958 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.958 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.960 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-test.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.960 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.960 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.960 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.961 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.961 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.962 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.963 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.964 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.965 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.966 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-28T11:21:59.966 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-28T11:21:59.967 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.968 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package krb5-devel.x86_64 0:1.15.1-37.el7_7.2 will be installed 2019-11-28T11:21:59.968 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package elfutils-libelf-devel.x86_64 0:0.176-2.el7 will be installed 2019-11-28T11:21:59.969 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: pkgconfig(zlib) for package: elfutils-libelf-devel-0.176-2.el7.x86_64 2019-11-28T11:21:59.970 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libverto-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:21:59.975 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package flex.x86_64 0:2.5.37-6.el7 will be installed 2019-11-28T11:21:59.975 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.976 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7798.g6882af3.el7 for package: 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.976 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libselinux-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:21:59.978 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.978 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-28T11:21:59.978 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package librados2.x86_64 2:15.0.0-7798.g6882af3.el7 will be an update 2019-11-28T11:21:59.978 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.979 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libcom_err-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:21:59.979 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-28T11:21:59.979 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package librbd1.x86_64 2:15.0.0-7798.g6882af3.el7 will be an update 2019-11-28T11:21:59.980 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package openssl-devel.x86_64 1:1.0.2k-19.el7 will be installed 2019-11-28T11:21:59.980 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: krb5-devel(x86-64) for package: 1:openssl-devel-1.0.2k-19.el7.x86_64 2019-11-28T11:21:59.986 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.987 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.988 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.988 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: keyutils-libs-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:21:59.989 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.991 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-28T11:21:59.992 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-28T11:21:59.992 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:21:59.992 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.992 INFO:teuthology.orchestra.run.smithi080.stdout:--> Running transaction check 2019-11-28T11:21:59.992 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-base.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.993 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package librados-devel.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.993 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.993 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-28T11:21:59.994 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package librgw2.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.994 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-28T11:21:59.995 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-28T11:21:59.996 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-28T11:21:59.996 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.997 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-28T11:21:59.997 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-28T11:21:59.999 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:21:59.999 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:21:59.999 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:21:59.999 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:00.000 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:00.001 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:00.001 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:00.001 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:00.002 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:00.002 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-rados.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.003 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:00.003 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-rbd.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.003 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-28T11:22:00.004 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-28T11:22:00.005 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:00.005 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.005 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.005 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.005 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-28T11:22:00.005 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-28T11:22:00.006 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.007 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-rgw.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.007 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-28T11:22:00.007 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-28T11:22:00.008 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.009 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-28T11:22:00.009 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-28T11:22:00.009 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-28T11:22:00.010 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-28T11:22:00.010 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-28T11:22:00.010 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-28T11:22:00.011 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:22:00.012 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package krb5-devel.x86_64 0:1.15.1-37.el7_7.2 will be installed 2019-11-28T11:22:00.012 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:22:00.012 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:22:00.013 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:22:00.014 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: libverto-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:22:00.017 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-28T11:22:00.018 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: libselinux-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:22:00.018 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:22:00.019 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:22:00.020 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:22:00.021 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:22:00.022 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-28T11:22:00.023 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: libcom_err-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:22:00.024 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:22:00.026 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:22:00.028 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:22:00.028 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-28T11:22:00.031 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed 2019-11-28T11:22:00.031 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-28T11:22:00.032 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package keyutils-libs-devel.x86_64 0:1.5.8-3.el7 will be installed 2019-11-28T11:22:00.032 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-28T11:22:00.033 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: keyutils-libs-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:22:00.034 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package libcom_err-devel.x86_64 0:1.42.9-16.el7 will be installed 2019-11-28T11:22:00.034 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package libselinux-devel.x86_64 0:2.5-14.1.el7 will be installed 2019-11-28T11:22:00.035 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libsepol-devel(x86-64) >= 2.5-10 for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:22:00.038 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-28T11:22:00.039 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-28T11:22:00.039 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package librados-devel.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.039 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.041 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-28T11:22:00.041 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: pkgconfig(libsepol) for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:22:00.042 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: pkgconfig(libpcre) for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:22:00.057 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package librgw2.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.057 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-28T11:22:00.058 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-28T11:22:00.058 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-28T11:22:00.058 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.059 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-28T11:22:00.059 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-28T11:22:00.060 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:00.060 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:00.060 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:00.061 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:00.061 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:00.062 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-rados.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.063 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-rbd.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.063 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-28T11:22:00.063 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-28T11:22:00.064 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package libverto-devel.x86_64 0:0.2.5-4.el7 will be installed 2019-11-28T11:22:00.064 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-28T11:22:00.065 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-28T11:22:00.065 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.066 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.066 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-28T11:22:00.066 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-28T11:22:00.067 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-28T11:22:00.067 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-28T11:22:00.067 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-28T11:22:00.068 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-28T11:22:00.068 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-28T11:22:00.068 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-28T11:22:00.069 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-28T11:22:00.069 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-28T11:22:00.069 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-28T11:22:00.070 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-28T11:22:00.070 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-28T11:22:00.070 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-28T11:22:00.071 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:22:00.071 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:22:00.071 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:22:00.072 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-28T11:22:00.072 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-28T11:22:00.073 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-28T11:22:00.074 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-28T11:22:00.074 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-28T11:22:00.074 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-28T11:22:00.074 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-28T11:22:00.075 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-28T11:22:00.089 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-28T11:22:00.089 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-28T11:22:00.090 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-rgw.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.090 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-28T11:22:00.090 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-28T11:22:00.090 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-28T11:22:00.091 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-28T11:22:00.091 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-28T11:22:00.091 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-28T11:22:00.091 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:22:00.092 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:22:00.092 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:22:00.092 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:22:00.092 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-28T11:22:00.093 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:22:00.093 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:22:00.093 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:22:00.093 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:22:00.094 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-28T11:22:00.094 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:22:00.094 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:22:00.094 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:22:00.094 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-28T11:22:00.095 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed 2019-11-28T11:22:00.095 INFO:teuthology.orchestra.run.smithi080.stdout:--> Running transaction check 2019-11-28T11:22:00.095 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package keyutils-libs-devel.x86_64 0:1.5.8-3.el7 will be installed 2019-11-28T11:22:00.095 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-28T11:22:00.096 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package libcom_err-devel.x86_64 0:1.42.9-16.el7 will be installed 2019-11-28T11:22:00.096 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package libselinux-devel.x86_64 0:2.5-14.1.el7 will be installed 2019-11-28T11:22:00.096 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: libsepol-devel(x86-64) >= 2.5-10 for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:22:00.096 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: pkgconfig(libsepol) for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:22:00.097 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: pkgconfig(libpcre) for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:22:00.097 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-28T11:22:00.097 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-28T11:22:00.097 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-28T11:22:00.098 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package libsepol-devel.x86_64 0:2.5-10.el7 will be installed 2019-11-28T11:22:00.098 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package pcre-devel.x86_64 0:8.32-17.el7 will be installed 2019-11-28T11:22:00.098 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-28T11:22:00.098 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-28T11:22:00.099 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-28T11:22:00.099 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-28T11:22:00.100 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-28T11:22:00.100 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-28T11:22:00.100 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-28T11:22:00.100 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-28T11:22:00.101 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-28T11:22:00.101 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-28T11:22:00.101 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-28T11:22:00.101 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-28T11:22:00.102 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-28T11:22:00.102 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-28T11:22:00.102 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-28T11:22:00.111 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package libverto-devel.x86_64 0:0.2.5-4.el7 will be installed 2019-11-28T11:22:00.111 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-28T11:22:00.112 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-28T11:22:00.112 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.112 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:00.112 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-28T11:22:00.113 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-28T11:22:00.113 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-28T11:22:00.113 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-28T11:22:00.113 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-28T11:22:00.114 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-28T11:22:00.114 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-28T11:22:00.114 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-28T11:22:00.114 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-28T11:22:00.115 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-28T11:22:00.115 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-28T11:22:00.115 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-28T11:22:00.115 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-28T11:22:00.116 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-28T11:22:00.116 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:22:00.116 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:22:00.116 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:22:00.117 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-28T11:22:00.117 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-28T11:22:00.117 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-28T11:22:00.117 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-28T11:22:00.117 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-28T11:22:00.118 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-28T11:22:00.118 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-28T11:22:00.118 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-28T11:22:00.118 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-28T11:22:00.119 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-28T11:22:00.119 INFO:teuthology.orchestra.run.smithi080.stdout:--> Running transaction check 2019-11-28T11:22:00.119 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package libsepol-devel.x86_64 0:2.5-10.el7 will be installed 2019-11-28T11:22:00.119 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package pcre-devel.x86_64 0:8.32-17.el7 will be installed 2019-11-28T11:22:00.120 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-28T11:22:00.120 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-28T11:22:00.121 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-28T11:22:00.121 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-28T11:22:00.121 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-28T11:22:00.121 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-28T11:22:00.122 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-28T11:22:00.122 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-28T11:22:00.122 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-28T11:22:00.122 INFO:teuthology.orchestra.run.smithi080.stdout:--> Running transaction check 2019-11-28T11:22:00.123 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-28T11:22:00.123 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-28T11:22:00.123 INFO:teuthology.orchestra.run.smithi080.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-28T11:22:00.123 INFO:teuthology.orchestra.run.smithi080.stdout:--> Running transaction check 2019-11-28T11:22:00.124 INFO:teuthology.orchestra.run.smithi080.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-28T11:22:00.760 INFO:teuthology.orchestra.run.smithi174.stdout:--> Finished Dependency Resolution 2019-11-28T11:22:00.800 INFO:teuthology.orchestra.run.smithi080.stdout:--> Finished Dependency Resolution 2019-11-28T11:22:00.841 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-28T11:22:00.841 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies Resolved 2019-11-28T11:22:00.853 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-28T11:22:00.853 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-28T11:22:00.853 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2019-11-28T11:22:00.853 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-28T11:22:00.853 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2019-11-28T11:22:00.853 INFO:teuthology.orchestra.run.smithi174.stdout: bison x86_64 3.0.4-2.el7 rhel-7-server-rpms 674 k 2019-11-28T11:22:00.854 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_64 2:15.0.0-7798.g6882af3.el7 ceph 2.0 k 2019-11-28T11:22:00.854 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-daemon x86_64 2:15.0.0-7798.g6882af3.el7 ceph 17 k 2019-11-28T11:22:00.854 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_64 2:15.0.0-7798.g6882af3.el7 ceph 547 k 2019-11-28T11:22:00.854 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.7 M 2019-11-28T11:22:00.854 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 3.9 M 2019-11-28T11:22:00.854 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-cloud 2019-11-28T11:22:00.854 INFO:teuthology.orchestra.run.smithi174.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 82 k 2019-11-28T11:22:00.855 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local 2019-11-28T11:22:00.855 INFO:teuthology.orchestra.run.smithi174.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 8.6 M 2019-11-28T11:22:00.855 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 23 k 2019-11-28T11:22:00.855 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-ssh noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 33 k 2019-11-28T11:22:00.855 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_64 2:15.0.0-7798.g6882af3.el7 ceph 6.1 M 2019-11-28T11:22:00.855 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_64 2:15.0.0-7798.g6882af3.el7 ceph 37 M 2019-11-28T11:22:00.855 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel 2019-11-28T11:22:00.856 INFO:teuthology.orchestra.run.smithi174.stdout: x86_64 0.176-2.el7 rhel-7-server-rpms 39 k 2019-11-28T11:22:00.856 INFO:teuthology.orchestra.run.smithi174.stdout: flex x86_64 2.5.37-6.el7 rhel-7-server-rpms 293 k 2019-11-28T11:22:00.856 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_64 2:15.0.0-7798.g6882af3.el7 ceph 17 k 2019-11-28T11:22:00.856 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 483 k 2019-11-28T11:22:00.856 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel x86_64 1:1.0.2k-19.el7 rhel-7-server-rpms 1.5 M 2019-11-28T11:22:00.856 INFO:teuthology.orchestra.run.smithi174.stdout: python-ceph-compat x86_64 2:15.0.0-7798.g6882af3.el7 ceph 2.2 k 2019-11-28T11:22:00.856 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_64 2:15.0.0-7798.g6882af3.el7 ceph 68 k 2019-11-28T11:22:00.857 INFO:teuthology.orchestra.run.smithi174.stdout:Updating: 2019-11-28T11:22:00.857 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 3.5 M 2019-11-28T11:22:00.857 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.7 M 2019-11-28T11:22:00.857 INFO:teuthology.orchestra.run.smithi174.stdout:Installing for dependencies: 2019-11-28T11:22:00.857 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_64 2:15.0.0-7798.g6882af3.el7 ceph 5.6 M 2019-11-28T11:22:00.857 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_64 2:15.0.0-7798.g6882af3.el7 ceph 19 M 2019-11-28T11:22:00.857 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards 2019-11-28T11:22:00.858 INFO:teuthology.orchestra.run.smithi174.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 18 k 2019-11-28T11:22:00.858 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.9 M 2019-11-28T11:22:00.858 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_64 2:15.0.0-7798.g6882af3.el7 ceph 4.3 M 2019-11-28T11:22:00.858 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_64 2:15.0.0-7798.g6882af3.el7 ceph 16 M 2019-11-28T11:22:00.858 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_64 2:15.0.0-7798.g6882af3.el7 ceph 20 k 2019-11-28T11:22:00.858 INFO:teuthology.orchestra.run.smithi174.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-28T11:22:00.858 INFO:teuthology.orchestra.run.smithi174.stdout: keyutils-libs-devel x86_64 1.5.8-3.el7 rhel-7-server-rpms 37 k 2019-11-28T11:22:00.859 INFO:teuthology.orchestra.run.smithi174.stdout: krb5-devel x86_64 1.15.1-37.el7_7.2 rhel-7-server-rpms 272 k 2019-11-28T11:22:00.859 INFO:teuthology.orchestra.run.smithi174.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-28T11:22:00.859 INFO:teuthology.orchestra.run.smithi174.stdout: libcom_err-devel x86_64 1.42.9-16.el7 rhel-7-server-rpms 32 k 2019-11-28T11:22:00.859 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-28T11:22:00.859 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_64 0.8.0-2.el7 rhel-7-server-rpms 37 k 2019-11-28T11:22:00.859 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_64 2:15.0.0-7798.g6882af3.el7 ceph 153 k 2019-11-28T11:22:00.859 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 361 k 2019-11-28T11:22:00.859 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-28T11:22:00.860 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 5.4 M 2019-11-28T11:22:00.860 INFO:teuthology.orchestra.run.smithi174.stdout: libselinux-devel x86_64 2.5-14.1.el7 rhel-7-server-rpms 187 k 2019-11-28T11:22:00.860 INFO:teuthology.orchestra.run.smithi174.stdout: libsepol-devel x86_64 2.5-10.el7 rhel-7-server-rpms 77 k 2019-11-28T11:22:00.860 INFO:teuthology.orchestra.run.smithi174.stdout: libverto-devel x86_64 0.2.5-4.el7 rhel-7-server-rpms 12 k 2019-11-28T11:22:00.860 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-28T11:22:00.860 INFO:teuthology.orchestra.run.smithi174.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 rhel-7-server-rpms 206 k 2019-11-28T11:22:00.860 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-28T11:22:00.861 INFO:teuthology.orchestra.run.smithi174.stdout: pcre-devel x86_64 8.32-17.el7 rhel-7-server-rpms 480 k 2019-11-28T11:22:00.861 INFO:teuthology.orchestra.run.smithi174.stdout: python-beaker noarch 1.5.4-10.el7 rhel-7-server-rpms 80 k 2019-11-28T11:22:00.861 INFO:teuthology.orchestra.run.smithi174.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-28T11:22:00.861 INFO:teuthology.orchestra.run.smithi174.stdout: python-ceph-argparse 2019-11-28T11:22:00.861 INFO:teuthology.orchestra.run.smithi174.stdout: x86_64 2:15.0.0-7798.g6882af3.el7 ceph 35 k 2019-11-28T11:22:00.861 INFO:teuthology.orchestra.run.smithi174.stdout: python-ceph-common x86_64 2:15.0.0-7798.g6882af3.el7 ceph 42 k 2019-11-28T11:22:00.861 INFO:teuthology.orchestra.run.smithi174.stdout: python-cephfs x86_64 2:15.0.0-7798.g6882af3.el7 ceph 102 k 2019-11-28T11:22:00.862 INFO:teuthology.orchestra.run.smithi174.stdout: python-cherrypy noarch 3.2.2-4.el7 rhel-7-server-rpms 422 k 2019-11-28T11:22:00.862 INFO:teuthology.orchestra.run.smithi174.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-28T11:22:00.862 INFO:teuthology.orchestra.run.smithi174.stdout: python-jwcrypto noarch 0.4.2-1.el7 rhel-7-server-rpms 57 k 2019-11-28T11:22:00.862 INFO:teuthology.orchestra.run.smithi174.stdout: python-mako noarch 0.8.1-2.el7 rhel-7-server-rpms 307 k 2019-11-28T11:22:00.862 INFO:teuthology.orchestra.run.smithi174.stdout: python-markupsafe x86_64 0.11-10.el7 rhel-7-server-rpms 25 k 2019-11-28T11:22:00.862 INFO:teuthology.orchestra.run.smithi174.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 2019-11-28T11:22:00.862 INFO:teuthology.orchestra.run.smithi174.stdout: rhel-7-server-rpms 866 k 2019-11-28T11:22:00.863 INFO:teuthology.orchestra.run.smithi174.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-28T11:22:00.863 INFO:teuthology.orchestra.run.smithi174.stdout: python-prettytable noarch 0.7.2-3.el7 rhel-7-server-rpms 37 k 2019-11-28T11:22:00.863 INFO:teuthology.orchestra.run.smithi174.stdout: python-rados x86_64 2:15.0.0-7798.g6882af3.el7 ceph 209 k 2019-11-28T11:22:00.863 INFO:teuthology.orchestra.run.smithi174.stdout: python-rbd x86_64 2:15.0.0-7798.g6882af3.el7 ceph 199 k 2019-11-28T11:22:00.863 INFO:teuthology.orchestra.run.smithi174.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-28T11:22:00.863 INFO:teuthology.orchestra.run.smithi174.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-28T11:22:00.863 INFO:teuthology.orchestra.run.smithi174.stdout: python-requests noarch 2.6.0-7.el7_7 rhel-7-server-rpms 95 k 2019-11-28T11:22:00.864 INFO:teuthology.orchestra.run.smithi174.stdout: python-rgw x86_64 2:15.0.0-7798.g6882af3.el7 ceph 77 k 2019-11-28T11:22:00.864 INFO:teuthology.orchestra.run.smithi174.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-28T11:22:00.864 INFO:teuthology.orchestra.run.smithi174.stdout: python-simplegeneric 2019-11-28T11:22:00.864 INFO:teuthology.orchestra.run.smithi174.stdout: noarch 0.8-7.el7 epel 12 k 2019-11-28T11:22:00.864 INFO:teuthology.orchestra.run.smithi174.stdout: python-singledispatch 2019-11-28T11:22:00.864 INFO:teuthology.orchestra.run.smithi174.stdout: noarch 3.4.0.2-2.el7 epel 18 k 2019-11-28T11:22:00.864 INFO:teuthology.orchestra.run.smithi174.stdout: python-tempita noarch 0.5.1-6.el7 rhel-7-server-rpms 33 k 2019-11-28T11:22:00.865 INFO:teuthology.orchestra.run.smithi174.stdout: python-urllib3 noarch 1.10.2-7.el7 rhel-7-server-rpms 103 k 2019-11-28T11:22:00.865 INFO:teuthology.orchestra.run.smithi174.stdout: python-webob noarch 1.2.3-7.el7 rhel-7-server-optional-rpms 2019-11-28T11:22:00.865 INFO:teuthology.orchestra.run.smithi174.stdout: 202 k 2019-11-28T11:22:00.865 INFO:teuthology.orchestra.run.smithi174.stdout: python-websocket-client 2019-11-28T11:22:00.865 INFO:teuthology.orchestra.run.smithi174.stdout: noarch 0.56.0-3.git3c25814.el7 rhel-7-server-extras-rpms 2019-11-28T11:22:00.865 INFO:teuthology.orchestra.run.smithi174.stdout: 66 k 2019-11-28T11:22:00.865 INFO:teuthology.orchestra.run.smithi174.stdout: python-webtest noarch 1.3.4-6.el7 rhel-7-server-optional-rpms 2019-11-28T11:22:00.866 INFO:teuthology.orchestra.run.smithi174.stdout: 102 k 2019-11-28T11:22:00.866 INFO:teuthology.orchestra.run.smithi174.stdout: python-werkzeug noarch 0.9.1-2.el7 rhel-7-server-extras-rpms 2019-11-28T11:22:00.866 INFO:teuthology.orchestra.run.smithi174.stdout: 562 k 2019-11-28T11:22:00.866 INFO:teuthology.orchestra.run.smithi174.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-28T11:22:00.866 INFO:teuthology.orchestra.run.smithi174.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-28T11:22:00.866 INFO:teuthology.orchestra.run.smithi174.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-28T11:22:00.866 INFO:teuthology.orchestra.run.smithi174.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-28T11:22:00.866 INFO:teuthology.orchestra.run.smithi174.stdout: python2-oauthlib noarch 2.0.1-8.el7 rhel-7-server-rpms 146 k 2019-11-28T11:22:00.867 INFO:teuthology.orchestra.run.smithi174.stdout: python2-pyasn1-modules 2019-11-28T11:22:00.867 INFO:teuthology.orchestra.run.smithi174.stdout: noarch 0.1.9-7.el7 rhel-7-server-optional-rpms 2019-11-28T11:22:00.867 INFO:teuthology.orchestra.run.smithi174.stdout: 59 k 2019-11-28T11:22:00.867 INFO:teuthology.orchestra.run.smithi174.stdout: python2-requests-oauthlib 2019-11-28T11:22:00.867 INFO:teuthology.orchestra.run.smithi174.stdout: noarch 0.8.0-5.el7 rhel-7-server-rpms 35 k 2019-11-28T11:22:00.867 INFO:teuthology.orchestra.run.smithi174.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-28T11:22:00.867 INFO:teuthology.orchestra.run.smithi174.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-28T11:22:00.868 INFO:teuthology.orchestra.run.smithi174.stdout: python3 x86_64 3.6.8-10.el7 rhel-7-server-rpms 69 k 2019-11-28T11:22:00.868 INFO:teuthology.orchestra.run.smithi174.stdout: python3-libs x86_64 3.6.8-10.el7 rhel-7-server-rpms 7.0 M 2019-11-28T11:22:00.868 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pip noarch 9.0.3-5.el7 rhel-7-server-rpms 1.8 M 2019-11-28T11:22:00.868 INFO:teuthology.orchestra.run.smithi174.stdout: python3-setuptools noarch 39.2.0-10.el7 rhel-7-server-rpms 629 k 2019-11-28T11:22:00.868 INFO:teuthology.orchestra.run.smithi174.stdout: scipy x86_64 0.12.1-6.el7 rhel-7-server-rpms 9.3 M 2019-11-28T11:22:00.868 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_64 1.7.3.2-2.el7 rhel-7-server-rpms 290 k 2019-11-28T11:22:00.868 INFO:teuthology.orchestra.run.smithi174.stdout: suitesparse x86_64 4.0.2-10.el7 rhel-7-server-rpms 928 k 2019-11-28T11:22:00.869 INFO:teuthology.orchestra.run.smithi174.stdout: tbb x86_64 4.1-9.20130314.el7 rhel-7-server-rpms 124 k 2019-11-28T11:22:00.869 INFO:teuthology.orchestra.run.smithi174.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-28T11:22:00.869 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel x86_64 1.2.7-18.el7 rhel-7-server-rpms 50 k 2019-11-28T11:22:00.869 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-28T11:22:00.869 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2019-11-28T11:22:00.869 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-28T11:22:00.870 INFO:teuthology.orchestra.run.smithi174.stdout:Install 19 Packages (+72 Dependent packages) 2019-11-28T11:22:00.870 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 2 Packages 2019-11-28T11:22:00.870 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-28T11:22:00.871 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 148 M 2019-11-28T11:22:00.871 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading packages: 2019-11-28T11:22:00.871 INFO:teuthology.orchestra.run.smithi174.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-28T11:22:00.880 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:22:00.881 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies Resolved 2019-11-28T11:22:00.892 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:22:00.893 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2019-11-28T11:22:00.893 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2019-11-28T11:22:00.893 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2019-11-28T11:22:00.893 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2019-11-28T11:22:00.893 INFO:teuthology.orchestra.run.smithi080.stdout: bison x86_64 3.0.4-2.el7 rhel-7-server-rpms 674 k 2019-11-28T11:22:00.893 INFO:teuthology.orchestra.run.smithi080.stdout: ceph x86_64 2:15.0.0-7798.g6882af3.el7 ceph 2.0 k 2019-11-28T11:22:00.894 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-daemon x86_64 2:15.0.0-7798.g6882af3.el7 ceph 17 k 2019-11-28T11:22:00.894 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse x86_64 2:15.0.0-7798.g6882af3.el7 ceph 547 k 2019-11-28T11:22:00.894 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.7 M 2019-11-28T11:22:00.894 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 3.9 M 2019-11-28T11:22:00.894 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-cloud 2019-11-28T11:22:00.894 INFO:teuthology.orchestra.run.smithi080.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 82 k 2019-11-28T11:22:00.894 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local 2019-11-28T11:22:00.895 INFO:teuthology.orchestra.run.smithi080.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 8.6 M 2019-11-28T11:22:00.895 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 23 k 2019-11-28T11:22:00.895 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-ssh noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 33 k 2019-11-28T11:22:00.895 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw x86_64 2:15.0.0-7798.g6882af3.el7 ceph 6.1 M 2019-11-28T11:22:00.895 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test x86_64 2:15.0.0-7798.g6882af3.el7 ceph 37 M 2019-11-28T11:22:00.895 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel 2019-11-28T11:22:00.895 INFO:teuthology.orchestra.run.smithi080.stdout: x86_64 0.176-2.el7 rhel-7-server-rpms 39 k 2019-11-28T11:22:00.896 INFO:teuthology.orchestra.run.smithi080.stdout: flex x86_64 2.5.37-6.el7 rhel-7-server-rpms 293 k 2019-11-28T11:22:00.896 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel x86_64 2:15.0.0-7798.g6882af3.el7 ceph 17 k 2019-11-28T11:22:00.896 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 483 k 2019-11-28T11:22:00.896 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel x86_64 1:1.0.2k-19.el7 rhel-7-server-rpms 1.5 M 2019-11-28T11:22:00.896 INFO:teuthology.orchestra.run.smithi080.stdout: python-ceph-compat x86_64 2:15.0.0-7798.g6882af3.el7 ceph 2.2 k 2019-11-28T11:22:00.897 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse x86_64 2:15.0.0-7798.g6882af3.el7 ceph 68 k 2019-11-28T11:22:00.897 INFO:teuthology.orchestra.run.smithi080.stdout:Updating: 2019-11-28T11:22:00.897 INFO:teuthology.orchestra.run.smithi080.stdout: librados2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 3.5 M 2019-11-28T11:22:00.897 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.7 M 2019-11-28T11:22:00.897 INFO:teuthology.orchestra.run.smithi080.stdout:Installing for dependencies: 2019-11-28T11:22:00.897 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base x86_64 2:15.0.0-7798.g6882af3.el7 ceph 5.6 M 2019-11-28T11:22:00.897 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common x86_64 2:15.0.0-7798.g6882af3.el7 ceph 19 M 2019-11-28T11:22:00.898 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards 2019-11-28T11:22:00.898 INFO:teuthology.orchestra.run.smithi080.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 18 k 2019-11-28T11:22:00.898 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.9 M 2019-11-28T11:22:00.898 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon x86_64 2:15.0.0-7798.g6882af3.el7 ceph 4.3 M 2019-11-28T11:22:00.898 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd x86_64 2:15.0.0-7798.g6882af3.el7 ceph 16 M 2019-11-28T11:22:00.898 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux x86_64 2:15.0.0-7798.g6882af3.el7 ceph 20 k 2019-11-28T11:22:00.898 INFO:teuthology.orchestra.run.smithi080.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-28T11:22:00.899 INFO:teuthology.orchestra.run.smithi080.stdout: keyutils-libs-devel x86_64 1.5.8-3.el7 rhel-7-server-rpms 37 k 2019-11-28T11:22:00.899 INFO:teuthology.orchestra.run.smithi080.stdout: krb5-devel x86_64 1.15.1-37.el7_7.2 rhel-7-server-rpms 272 k 2019-11-28T11:22:00.899 INFO:teuthology.orchestra.run.smithi080.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-28T11:22:00.899 INFO:teuthology.orchestra.run.smithi080.stdout: libcom_err-devel x86_64 1.42.9-16.el7 rhel-7-server-rpms 32 k 2019-11-28T11:22:00.899 INFO:teuthology.orchestra.run.smithi080.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-28T11:22:00.899 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq x86_64 0.8.0-2.el7 rhel-7-server-rpms 37 k 2019-11-28T11:22:00.899 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel x86_64 2:15.0.0-7798.g6882af3.el7 ceph 153 k 2019-11-28T11:22:00.900 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 361 k 2019-11-28T11:22:00.900 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-28T11:22:00.900 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 5.4 M 2019-11-28T11:22:00.900 INFO:teuthology.orchestra.run.smithi080.stdout: libselinux-devel x86_64 2.5-14.1.el7 rhel-7-server-rpms 187 k 2019-11-28T11:22:00.900 INFO:teuthology.orchestra.run.smithi080.stdout: libsepol-devel x86_64 2.5-10.el7 rhel-7-server-rpms 77 k 2019-11-28T11:22:00.900 INFO:teuthology.orchestra.run.smithi080.stdout: libverto-devel x86_64 0.2.5-4.el7 rhel-7-server-rpms 12 k 2019-11-28T11:22:00.900 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-28T11:22:00.900 INFO:teuthology.orchestra.run.smithi080.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 rhel-7-server-rpms 206 k 2019-11-28T11:22:00.901 INFO:teuthology.orchestra.run.smithi080.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-28T11:22:00.901 INFO:teuthology.orchestra.run.smithi080.stdout: pcre-devel x86_64 8.32-17.el7 rhel-7-server-rpms 480 k 2019-11-28T11:22:00.901 INFO:teuthology.orchestra.run.smithi080.stdout: python-beaker noarch 1.5.4-10.el7 rhel-7-server-rpms 80 k 2019-11-28T11:22:00.901 INFO:teuthology.orchestra.run.smithi080.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-28T11:22:00.901 INFO:teuthology.orchestra.run.smithi080.stdout: python-ceph-argparse 2019-11-28T11:22:00.901 INFO:teuthology.orchestra.run.smithi080.stdout: x86_64 2:15.0.0-7798.g6882af3.el7 ceph 35 k 2019-11-28T11:22:00.901 INFO:teuthology.orchestra.run.smithi080.stdout: python-ceph-common x86_64 2:15.0.0-7798.g6882af3.el7 ceph 42 k 2019-11-28T11:22:00.902 INFO:teuthology.orchestra.run.smithi080.stdout: python-cephfs x86_64 2:15.0.0-7798.g6882af3.el7 ceph 102 k 2019-11-28T11:22:00.902 INFO:teuthology.orchestra.run.smithi080.stdout: python-cherrypy noarch 3.2.2-4.el7 rhel-7-server-rpms 422 k 2019-11-28T11:22:00.902 INFO:teuthology.orchestra.run.smithi080.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-28T11:22:00.902 INFO:teuthology.orchestra.run.smithi080.stdout: python-jwcrypto noarch 0.4.2-1.el7 rhel-7-server-rpms 57 k 2019-11-28T11:22:00.902 INFO:teuthology.orchestra.run.smithi080.stdout: python-mako noarch 0.8.1-2.el7 rhel-7-server-rpms 307 k 2019-11-28T11:22:00.902 INFO:teuthology.orchestra.run.smithi080.stdout: python-markupsafe x86_64 0.11-10.el7 rhel-7-server-rpms 25 k 2019-11-28T11:22:00.902 INFO:teuthology.orchestra.run.smithi080.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 2019-11-28T11:22:00.903 INFO:teuthology.orchestra.run.smithi080.stdout: rhel-7-server-rpms 866 k 2019-11-28T11:22:00.903 INFO:teuthology.orchestra.run.smithi080.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-28T11:22:00.903 INFO:teuthology.orchestra.run.smithi080.stdout: python-prettytable noarch 0.7.2-3.el7 rhel-7-server-rpms 37 k 2019-11-28T11:22:00.903 INFO:teuthology.orchestra.run.smithi080.stdout: python-rados x86_64 2:15.0.0-7798.g6882af3.el7 ceph 209 k 2019-11-28T11:22:00.903 INFO:teuthology.orchestra.run.smithi080.stdout: python-rbd x86_64 2:15.0.0-7798.g6882af3.el7 ceph 199 k 2019-11-28T11:22:00.903 INFO:teuthology.orchestra.run.smithi080.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-28T11:22:00.903 INFO:teuthology.orchestra.run.smithi080.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-28T11:22:00.904 INFO:teuthology.orchestra.run.smithi080.stdout: python-requests noarch 2.6.0-7.el7_7 rhel-7-server-rpms 95 k 2019-11-28T11:22:00.904 INFO:teuthology.orchestra.run.smithi080.stdout: python-rgw x86_64 2:15.0.0-7798.g6882af3.el7 ceph 77 k 2019-11-28T11:22:00.904 INFO:teuthology.orchestra.run.smithi080.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-28T11:22:00.904 INFO:teuthology.orchestra.run.smithi080.stdout: python-simplegeneric 2019-11-28T11:22:00.904 INFO:teuthology.orchestra.run.smithi080.stdout: noarch 0.8-7.el7 epel 12 k 2019-11-28T11:22:00.904 INFO:teuthology.orchestra.run.smithi080.stdout: python-singledispatch 2019-11-28T11:22:00.904 INFO:teuthology.orchestra.run.smithi080.stdout: noarch 3.4.0.2-2.el7 epel 18 k 2019-11-28T11:22:00.904 INFO:teuthology.orchestra.run.smithi080.stdout: python-tempita noarch 0.5.1-6.el7 rhel-7-server-rpms 33 k 2019-11-28T11:22:00.905 INFO:teuthology.orchestra.run.smithi080.stdout: python-urllib3 noarch 1.10.2-7.el7 rhel-7-server-rpms 103 k 2019-11-28T11:22:00.905 INFO:teuthology.orchestra.run.smithi080.stdout: python-webob noarch 1.2.3-7.el7 rhel-7-server-optional-rpms 2019-11-28T11:22:00.905 INFO:teuthology.orchestra.run.smithi080.stdout: 202 k 2019-11-28T11:22:00.905 INFO:teuthology.orchestra.run.smithi080.stdout: python-websocket-client 2019-11-28T11:22:00.905 INFO:teuthology.orchestra.run.smithi080.stdout: noarch 0.56.0-3.git3c25814.el7 rhel-7-server-extras-rpms 2019-11-28T11:22:00.905 INFO:teuthology.orchestra.run.smithi080.stdout: 66 k 2019-11-28T11:22:00.905 INFO:teuthology.orchestra.run.smithi080.stdout: python-webtest noarch 1.3.4-6.el7 rhel-7-server-optional-rpms 2019-11-28T11:22:00.906 INFO:teuthology.orchestra.run.smithi080.stdout: 102 k 2019-11-28T11:22:00.906 INFO:teuthology.orchestra.run.smithi080.stdout: python-werkzeug noarch 0.9.1-2.el7 rhel-7-server-extras-rpms 2019-11-28T11:22:00.906 INFO:teuthology.orchestra.run.smithi080.stdout: 562 k 2019-11-28T11:22:00.906 INFO:teuthology.orchestra.run.smithi080.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-28T11:22:00.906 INFO:teuthology.orchestra.run.smithi080.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-28T11:22:00.906 INFO:teuthology.orchestra.run.smithi080.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-28T11:22:00.906 INFO:teuthology.orchestra.run.smithi080.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-28T11:22:00.907 INFO:teuthology.orchestra.run.smithi080.stdout: python2-oauthlib noarch 2.0.1-8.el7 rhel-7-server-rpms 146 k 2019-11-28T11:22:00.907 INFO:teuthology.orchestra.run.smithi080.stdout: python2-pyasn1-modules 2019-11-28T11:22:00.907 INFO:teuthology.orchestra.run.smithi080.stdout: noarch 0.1.9-7.el7 rhel-7-server-optional-rpms 2019-11-28T11:22:00.907 INFO:teuthology.orchestra.run.smithi080.stdout: 59 k 2019-11-28T11:22:00.907 INFO:teuthology.orchestra.run.smithi080.stdout: python2-requests-oauthlib 2019-11-28T11:22:00.907 INFO:teuthology.orchestra.run.smithi080.stdout: noarch 0.8.0-5.el7 rhel-7-server-rpms 35 k 2019-11-28T11:22:00.907 INFO:teuthology.orchestra.run.smithi080.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-28T11:22:00.907 INFO:teuthology.orchestra.run.smithi080.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-28T11:22:00.908 INFO:teuthology.orchestra.run.smithi080.stdout: python3 x86_64 3.6.8-10.el7 rhel-7-server-rpms 69 k 2019-11-28T11:22:00.908 INFO:teuthology.orchestra.run.smithi080.stdout: python3-libs x86_64 3.6.8-10.el7 rhel-7-server-rpms 7.0 M 2019-11-28T11:22:00.908 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pip noarch 9.0.3-5.el7 rhel-7-server-rpms 1.8 M 2019-11-28T11:22:00.908 INFO:teuthology.orchestra.run.smithi080.stdout: python3-setuptools noarch 39.2.0-10.el7 rhel-7-server-rpms 629 k 2019-11-28T11:22:00.908 INFO:teuthology.orchestra.run.smithi080.stdout: scipy x86_64 0.12.1-6.el7 rhel-7-server-rpms 9.3 M 2019-11-28T11:22:00.908 INFO:teuthology.orchestra.run.smithi080.stdout: socat x86_64 1.7.3.2-2.el7 rhel-7-server-rpms 290 k 2019-11-28T11:22:00.908 INFO:teuthology.orchestra.run.smithi080.stdout: suitesparse x86_64 4.0.2-10.el7 rhel-7-server-rpms 928 k 2019-11-28T11:22:00.909 INFO:teuthology.orchestra.run.smithi080.stdout: tbb x86_64 4.1-9.20130314.el7 rhel-7-server-rpms 124 k 2019-11-28T11:22:00.909 INFO:teuthology.orchestra.run.smithi080.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-28T11:22:00.909 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel x86_64 1.2.7-18.el7 rhel-7-server-rpms 50 k 2019-11-28T11:22:00.909 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:22:00.909 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2019-11-28T11:22:00.909 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2019-11-28T11:22:00.909 INFO:teuthology.orchestra.run.smithi080.stdout:Install 19 Packages (+72 Dependent packages) 2019-11-28T11:22:00.910 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrade 2 Packages 2019-11-28T11:22:00.910 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:22:00.911 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 148 M 2019-11-28T11:22:00.911 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading packages: 2019-11-28T11:22:00.911 INFO:teuthology.orchestra.run.smithi080.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-28T11:22:02.478 INFO:teuthology.orchestra.run.smithi133.stdout:Resolving Dependencies 2019-11-28T11:22:02.479 INFO:teuthology.orchestra.run.smithi133.stdout:--> Running transaction check 2019-11-28T11:22:02.480 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package bison.x86_64 0:3.0.4-2.el7 will be installed 2019-11-28T11:22:02.484 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.486 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.487 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.489 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.490 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.492 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.500 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python36 for package: 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.503 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.504 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.506 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.508 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.510 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.511 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.512 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.513 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.514 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.515 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:22:02.516 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:22:02.517 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.517 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.517 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:22:02.519 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.520 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:22:02.521 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.521 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:22:02.522 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.526 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.527 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.529 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.530 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.531 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.532 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-test.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.537 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.538 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.539 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.541 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.542 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package elfutils-libelf-devel.x86_64 0:0.176-2.el7 will be installed 2019-11-28T11:22:02.543 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: pkgconfig(zlib) for package: elfutils-libelf-devel-0.176-2.el7.x86_64 2019-11-28T11:22:02.548 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package flex.x86_64 0:2.5.37-6.el7 will be installed 2019-11-28T11:22:02.548 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.549 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7798.g6882af3.el7 for package: 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.549 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.550 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-28T11:22:02.551 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package librados2.x86_64 2:15.0.0-7798.g6882af3.el7 will be an update 2019-11-28T11:22:02.552 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.553 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-28T11:22:02.554 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package librbd1.x86_64 2:15.0.0-7798.g6882af3.el7 will be an update 2019-11-28T11:22:02.554 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package openssl-devel.x86_64 1:1.0.2k-19.el7 will be installed 2019-11-28T11:22:02.555 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: krb5-devel(x86-64) for package: 1:openssl-devel-1.0.2k-19.el7.x86_64 2019-11-28T11:22:02.562 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.562 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.563 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.564 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.565 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.566 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.567 INFO:teuthology.orchestra.run.smithi133.stdout:--> Running transaction check 2019-11-28T11:22:02.567 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-base.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.573 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.575 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.577 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.577 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.578 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.579 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:02.580 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.580 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.580 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.581 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.584 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.589 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-28T11:22:02.589 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-28T11:22:02.590 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package krb5-devel.x86_64 0:1.15.1-37.el7_7.2 will be installed 2019-11-28T11:22:02.591 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: libverto-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:22:02.594 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: libselinux-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:22:02.599 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: libcom_err-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:22:02.610 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: keyutils-libs-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:22:02.612 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-28T11:22:02.612 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-28T11:22:02.612 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package librados-devel.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.613 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.613 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-28T11:22:02.616 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package librgw2.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.616 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-28T11:22:02.616 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-28T11:22:02.617 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-28T11:22:02.618 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.618 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-28T11:22:02.618 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-28T11:22:02.619 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:02.620 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:02.620 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:02.623 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:02.623 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:02.624 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-rados.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.624 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-rbd.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.624 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-28T11:22:02.625 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-28T11:22:02.625 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-28T11:22:02.626 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-28T11:22:02.629 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-rgw.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.629 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-28T11:22:02.629 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-28T11:22:02.630 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-28T11:22:02.630 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-28T11:22:02.630 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-28T11:22:02.631 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-28T11:22:02.632 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:22:02.632 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:22:02.633 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:22:02.634 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:22:02.638 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-28T11:22:02.639 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:22:02.640 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:22:02.641 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:22:02.642 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:22:02.643 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-28T11:22:02.646 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:22:02.647 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:22:02.649 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:22:02.649 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-28T11:22:02.651 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed 2019-11-28T11:22:02.652 INFO:teuthology.orchestra.run.smithi133.stdout:--> Running transaction check 2019-11-28T11:22:02.652 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package keyutils-libs-devel.x86_64 0:1.5.8-3.el7 will be installed 2019-11-28T11:22:02.652 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-28T11:22:02.654 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package libcom_err-devel.x86_64 0:1.42.9-16.el7 will be installed 2019-11-28T11:22:02.654 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package libselinux-devel.x86_64 0:2.5-14.1.el7 will be installed 2019-11-28T11:22:02.654 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: libsepol-devel(x86-64) >= 2.5-10 for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:22:02.656 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: pkgconfig(libsepol) for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:22:02.656 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: pkgconfig(libpcre) for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:22:02.662 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package libverto-devel.x86_64 0:0.2.5-4.el7 will be installed 2019-11-28T11:22:02.662 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-28T11:22:02.663 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-28T11:22:02.664 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.664 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:02.664 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-28T11:22:02.664 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-28T11:22:02.664 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-28T11:22:02.665 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-28T11:22:02.665 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-28T11:22:02.666 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-28T11:22:02.666 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-28T11:22:02.666 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-28T11:22:02.666 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-28T11:22:02.667 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-28T11:22:02.667 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-28T11:22:02.667 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-28T11:22:02.667 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-28T11:22:02.667 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-28T11:22:02.668 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:22:02.668 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:22:02.671 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:22:02.671 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-28T11:22:02.671 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-28T11:22:02.672 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-28T11:22:02.672 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-28T11:22:02.676 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-28T11:22:02.677 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-28T11:22:02.677 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-28T11:22:02.677 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-28T11:22:02.679 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-28T11:22:02.680 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-28T11:22:02.680 INFO:teuthology.orchestra.run.smithi133.stdout:--> Running transaction check 2019-11-28T11:22:02.680 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package libsepol-devel.x86_64 0:2.5-10.el7 will be installed 2019-11-28T11:22:02.683 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package pcre-devel.x86_64 0:8.32-17.el7 will be installed 2019-11-28T11:22:02.684 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-28T11:22:02.684 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-28T11:22:02.684 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-28T11:22:02.684 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-28T11:22:02.685 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-28T11:22:02.685 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-28T11:22:02.687 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-28T11:22:02.687 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-28T11:22:02.687 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-28T11:22:02.689 INFO:teuthology.orchestra.run.smithi133.stdout:--> Running transaction check 2019-11-28T11:22:02.689 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-28T11:22:02.689 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-28T11:22:02.690 INFO:teuthology.orchestra.run.smithi133.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-28T11:22:02.690 INFO:teuthology.orchestra.run.smithi133.stdout:--> Running transaction check 2019-11-28T11:22:02.690 INFO:teuthology.orchestra.run.smithi133.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-28T11:22:03.199 INFO:teuthology.orchestra.run.smithi016.stdout:Resolving Dependencies 2019-11-28T11:22:03.199 INFO:teuthology.orchestra.run.smithi016.stdout:--> Running transaction check 2019-11-28T11:22:03.199 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package bison.x86_64 0:3.0.4-2.el7 will be installed 2019-11-28T11:22:03.208 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.209 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.211 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.212 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.214 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.216 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.225 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python36 for package: 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.228 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.229 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.231 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.233 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.236 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.237 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.238 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.239 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.240 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.240 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:22:03.242 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:22:03.243 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.243 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.243 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:22:03.245 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.246 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:22:03.247 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.247 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 2019-11-28T11:22:03.248 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.252 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.253 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.254 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.256 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.258 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.259 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-test.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.264 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.265 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.266 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.268 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.269 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package elfutils-libelf-devel.x86_64 0:0.176-2.el7 will be installed 2019-11-28T11:22:03.270 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: pkgconfig(zlib) for package: elfutils-libelf-devel-0.176-2.el7.x86_64 2019-11-28T11:22:03.276 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package flex.x86_64 0:2.5.37-6.el7 will be installed 2019-11-28T11:22:03.276 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.277 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7798.g6882af3.el7 for package: 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.278 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.278 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-28T11:22:03.279 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package librados2.x86_64 2:15.0.0-7798.g6882af3.el7 will be an update 2019-11-28T11:22:03.281 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.282 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-28T11:22:03.282 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package librbd1.x86_64 2:15.0.0-7798.g6882af3.el7 will be an update 2019-11-28T11:22:03.283 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package openssl-devel.x86_64 1:1.0.2k-19.el7 will be installed 2019-11-28T11:22:03.283 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: krb5-devel(x86-64) for package: 1:openssl-devel-1.0.2k-19.el7.x86_64 2019-11-28T11:22:03.291 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.291 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.293 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.293 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.294 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7798.g6882af3.el7 for package: 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.295 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.296 INFO:teuthology.orchestra.run.smithi016.stdout:--> Running transaction check 2019-11-28T11:22:03.296 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-base.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.302 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.305 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.306 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7798.g6882af3.el7 for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.307 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.308 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.309 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 2019-11-28T11:22:03.310 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.310 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.310 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.311 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.313 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.316 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-28T11:22:03.316 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-28T11:22:03.333 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package krb5-devel.x86_64 0:1.15.1-37.el7_7.2 will be installed 2019-11-28T11:22:03.333 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: libverto-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:22:03.335 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: libselinux-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:22:03.335 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: libcom_err-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:22:03.344 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: keyutils-libs-devel for package: krb5-devel-1.15.1-37.el7_7.2.x86_64 2019-11-28T11:22:03.345 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-28T11:22:03.345 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-28T11:22:03.345 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package librados-devel.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.346 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.346 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-28T11:22:03.348 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package librgw2.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.349 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-28T11:22:03.349 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-28T11:22:03.350 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-28T11:22:03.351 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.351 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-28T11:22:03.351 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-28T11:22:03.352 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:03.352 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:03.353 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:03.355 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:03.356 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T11:22:03.357 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-rados.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.358 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-rbd.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.358 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-28T11:22:03.358 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-28T11:22:03.359 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-28T11:22:03.360 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-28T11:22:03.362 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-rgw.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.363 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-28T11:22:03.363 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-28T11:22:03.364 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-28T11:22:03.364 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-28T11:22:03.364 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-28T11:22:03.365 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-28T11:22:03.366 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:22:03.367 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:22:03.368 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:22:03.369 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T11:22:03.373 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-28T11:22:03.374 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:22:03.376 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:22:03.377 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:22:03.378 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-28T11:22:03.379 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-28T11:22:03.380 INFO:teuthology.orchestra.run.smithi133.stdout:--> Finished Dependency Resolution 2019-11-28T11:22:03.382 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:22:03.384 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:22:03.387 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T11:22:03.387 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-28T11:22:03.387 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed 2019-11-28T11:22:03.388 INFO:teuthology.orchestra.run.smithi016.stdout:--> Running transaction check 2019-11-28T11:22:03.388 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package keyutils-libs-devel.x86_64 0:1.5.8-3.el7 will be installed 2019-11-28T11:22:03.390 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-28T11:22:03.391 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package libcom_err-devel.x86_64 0:1.42.9-16.el7 will be installed 2019-11-28T11:22:03.391 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package libselinux-devel.x86_64 0:2.5-14.1.el7 will be installed 2019-11-28T11:22:03.391 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: libsepol-devel(x86-64) >= 2.5-10 for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:22:03.392 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: pkgconfig(libsepol) for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:22:03.393 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: pkgconfig(libpcre) for package: libselinux-devel-2.5-14.1.el7.x86_64 2019-11-28T11:22:03.399 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package libverto-devel.x86_64 0:0.2.5-4.el7 will be installed 2019-11-28T11:22:03.400 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-28T11:22:03.401 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-28T11:22:03.401 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.401 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 will be installed 2019-11-28T11:22:03.401 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-28T11:22:03.402 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-28T11:22:03.402 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-28T11:22:03.402 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-28T11:22:03.403 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-28T11:22:03.404 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-28T11:22:03.404 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-28T11:22:03.404 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-28T11:22:03.404 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-28T11:22:03.405 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-28T11:22:03.405 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-28T11:22:03.405 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-28T11:22:03.406 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-28T11:22:03.406 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-28T11:22:03.406 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:22:03.406 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:22:03.408 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T11:22:03.409 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-28T11:22:03.409 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-28T11:22:03.410 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-28T11:22:03.411 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-28T11:22:03.415 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-28T11:22:03.415 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-28T11:22:03.415 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-28T11:22:03.416 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-28T11:22:03.418 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-28T11:22:03.419 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-28T11:22:03.419 INFO:teuthology.orchestra.run.smithi016.stdout:--> Running transaction check 2019-11-28T11:22:03.419 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package libsepol-devel.x86_64 0:2.5-10.el7 will be installed 2019-11-28T11:22:03.419 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package pcre-devel.x86_64 0:8.32-17.el7 will be installed 2019-11-28T11:22:03.420 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-28T11:22:03.420 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-28T11:22:03.421 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-28T11:22:03.421 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-28T11:22:03.422 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-28T11:22:03.422 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-28T11:22:03.423 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-28T11:22:03.424 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-28T11:22:03.424 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-28T11:22:03.425 INFO:teuthology.orchestra.run.smithi016.stdout:--> Running transaction check 2019-11-28T11:22:03.425 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-28T11:22:03.425 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-28T11:22:03.425 INFO:teuthology.orchestra.run.smithi016.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-28T11:22:03.429 INFO:teuthology.orchestra.run.smithi016.stdout:--> Running transaction check 2019-11-28T11:22:03.431 INFO:teuthology.orchestra.run.smithi016.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-28T11:22:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: 2019-11-28T11:22:03.465 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies Resolved 2019-11-28T11:22:03.489 INFO:teuthology.orchestra.run.smithi133.stdout: 2019-11-28T11:22:03.491 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2019-11-28T11:22:03.491 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2019-11-28T11:22:03.491 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2019-11-28T11:22:03.491 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2019-11-28T11:22:03.492 INFO:teuthology.orchestra.run.smithi133.stdout: bison x86_64 3.0.4-2.el7 rhel-7-server-rpms 674 k 2019-11-28T11:22:03.492 INFO:teuthology.orchestra.run.smithi133.stdout: ceph x86_64 2:15.0.0-7798.g6882af3.el7 ceph 2.0 k 2019-11-28T11:22:03.493 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-daemon x86_64 2:15.0.0-7798.g6882af3.el7 ceph 17 k 2019-11-28T11:22:03.493 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse x86_64 2:15.0.0-7798.g6882af3.el7 ceph 547 k 2019-11-28T11:22:03.493 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.7 M 2019-11-28T11:22:03.494 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 3.9 M 2019-11-28T11:22:03.494 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-cloud 2019-11-28T11:22:03.494 INFO:teuthology.orchestra.run.smithi133.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 82 k 2019-11-28T11:22:03.495 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local 2019-11-28T11:22:03.495 INFO:teuthology.orchestra.run.smithi133.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 8.6 M 2019-11-28T11:22:03.495 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 23 k 2019-11-28T11:22:03.496 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-ssh noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 33 k 2019-11-28T11:22:03.496 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw x86_64 2:15.0.0-7798.g6882af3.el7 ceph 6.1 M 2019-11-28T11:22:03.497 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test x86_64 2:15.0.0-7798.g6882af3.el7 ceph 37 M 2019-11-28T11:22:03.498 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel 2019-11-28T11:22:03.498 INFO:teuthology.orchestra.run.smithi133.stdout: x86_64 0.176-2.el7 rhel-7-server-rpms 39 k 2019-11-28T11:22:03.498 INFO:teuthology.orchestra.run.smithi133.stdout: flex x86_64 2.5.37-6.el7 rhel-7-server-rpms 293 k 2019-11-28T11:22:03.498 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel x86_64 2:15.0.0-7798.g6882af3.el7 ceph 17 k 2019-11-28T11:22:03.498 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 483 k 2019-11-28T11:22:03.498 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel x86_64 1:1.0.2k-19.el7 rhel-7-server-rpms 1.5 M 2019-11-28T11:22:03.499 INFO:teuthology.orchestra.run.smithi133.stdout: python-ceph-compat x86_64 2:15.0.0-7798.g6882af3.el7 ceph 2.2 k 2019-11-28T11:22:03.499 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse x86_64 2:15.0.0-7798.g6882af3.el7 ceph 68 k 2019-11-28T11:22:03.499 INFO:teuthology.orchestra.run.smithi133.stdout:Updating: 2019-11-28T11:22:03.499 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 3.5 M 2019-11-28T11:22:03.500 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.7 M 2019-11-28T11:22:03.500 INFO:teuthology.orchestra.run.smithi133.stdout:Installing for dependencies: 2019-11-28T11:22:03.500 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base x86_64 2:15.0.0-7798.g6882af3.el7 ceph 5.6 M 2019-11-28T11:22:03.500 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common x86_64 2:15.0.0-7798.g6882af3.el7 ceph 19 M 2019-11-28T11:22:03.500 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards 2019-11-28T11:22:03.501 INFO:teuthology.orchestra.run.smithi133.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 18 k 2019-11-28T11:22:03.501 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.9 M 2019-11-28T11:22:03.501 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon x86_64 2:15.0.0-7798.g6882af3.el7 ceph 4.3 M 2019-11-28T11:22:03.501 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd x86_64 2:15.0.0-7798.g6882af3.el7 ceph 16 M 2019-11-28T11:22:03.501 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux x86_64 2:15.0.0-7798.g6882af3.el7 ceph 20 k 2019-11-28T11:22:03.501 INFO:teuthology.orchestra.run.smithi133.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-28T11:22:03.501 INFO:teuthology.orchestra.run.smithi133.stdout: keyutils-libs-devel x86_64 1.5.8-3.el7 rhel-7-server-rpms 37 k 2019-11-28T11:22:03.502 INFO:teuthology.orchestra.run.smithi133.stdout: krb5-devel x86_64 1.15.1-37.el7_7.2 rhel-7-server-rpms 272 k 2019-11-28T11:22:03.502 INFO:teuthology.orchestra.run.smithi133.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-28T11:22:03.502 INFO:teuthology.orchestra.run.smithi133.stdout: libcom_err-devel x86_64 1.42.9-16.el7 rhel-7-server-rpms 32 k 2019-11-28T11:22:03.502 INFO:teuthology.orchestra.run.smithi133.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-28T11:22:03.502 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq x86_64 0.8.0-2.el7 rhel-7-server-rpms 37 k 2019-11-28T11:22:03.502 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel x86_64 2:15.0.0-7798.g6882af3.el7 ceph 153 k 2019-11-28T11:22:03.502 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 361 k 2019-11-28T11:22:03.503 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-28T11:22:03.503 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 5.4 M 2019-11-28T11:22:03.503 INFO:teuthology.orchestra.run.smithi133.stdout: libselinux-devel x86_64 2.5-14.1.el7 rhel-7-server-rpms 187 k 2019-11-28T11:22:03.503 INFO:teuthology.orchestra.run.smithi133.stdout: libsepol-devel x86_64 2.5-10.el7 rhel-7-server-rpms 77 k 2019-11-28T11:22:03.503 INFO:teuthology.orchestra.run.smithi133.stdout: libverto-devel x86_64 0.2.5-4.el7 rhel-7-server-rpms 12 k 2019-11-28T11:22:03.503 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-28T11:22:03.503 INFO:teuthology.orchestra.run.smithi133.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 rhel-7-server-rpms 206 k 2019-11-28T11:22:03.504 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-28T11:22:03.504 INFO:teuthology.orchestra.run.smithi133.stdout: pcre-devel x86_64 8.32-17.el7 rhel-7-server-rpms 480 k 2019-11-28T11:22:03.504 INFO:teuthology.orchestra.run.smithi133.stdout: python-beaker noarch 1.5.4-10.el7 rhel-7-server-rpms 80 k 2019-11-28T11:22:03.504 INFO:teuthology.orchestra.run.smithi133.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-28T11:22:03.504 INFO:teuthology.orchestra.run.smithi133.stdout: python-ceph-argparse 2019-11-28T11:22:03.504 INFO:teuthology.orchestra.run.smithi133.stdout: x86_64 2:15.0.0-7798.g6882af3.el7 ceph 35 k 2019-11-28T11:22:03.504 INFO:teuthology.orchestra.run.smithi133.stdout: python-ceph-common x86_64 2:15.0.0-7798.g6882af3.el7 ceph 42 k 2019-11-28T11:22:03.505 INFO:teuthology.orchestra.run.smithi133.stdout: python-cephfs x86_64 2:15.0.0-7798.g6882af3.el7 ceph 102 k 2019-11-28T11:22:03.505 INFO:teuthology.orchestra.run.smithi133.stdout: python-cherrypy noarch 3.2.2-4.el7 rhel-7-server-rpms 422 k 2019-11-28T11:22:03.505 INFO:teuthology.orchestra.run.smithi133.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-28T11:22:03.505 INFO:teuthology.orchestra.run.smithi133.stdout: python-jwcrypto noarch 0.4.2-1.el7 rhel-7-server-rpms 57 k 2019-11-28T11:22:03.505 INFO:teuthology.orchestra.run.smithi133.stdout: python-mako noarch 0.8.1-2.el7 rhel-7-server-rpms 307 k 2019-11-28T11:22:03.505 INFO:teuthology.orchestra.run.smithi133.stdout: python-markupsafe x86_64 0.11-10.el7 rhel-7-server-rpms 25 k 2019-11-28T11:22:03.506 INFO:teuthology.orchestra.run.smithi133.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 2019-11-28T11:22:03.506 INFO:teuthology.orchestra.run.smithi133.stdout: rhel-7-server-rpms 866 k 2019-11-28T11:22:03.507 INFO:teuthology.orchestra.run.smithi133.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-28T11:22:03.507 INFO:teuthology.orchestra.run.smithi133.stdout: python-prettytable noarch 0.7.2-3.el7 rhel-7-server-rpms 37 k 2019-11-28T11:22:03.507 INFO:teuthology.orchestra.run.smithi133.stdout: python-rados x86_64 2:15.0.0-7798.g6882af3.el7 ceph 209 k 2019-11-28T11:22:03.507 INFO:teuthology.orchestra.run.smithi133.stdout: python-rbd x86_64 2:15.0.0-7798.g6882af3.el7 ceph 199 k 2019-11-28T11:22:03.508 INFO:teuthology.orchestra.run.smithi133.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-28T11:22:03.508 INFO:teuthology.orchestra.run.smithi133.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-28T11:22:03.508 INFO:teuthology.orchestra.run.smithi133.stdout: python-requests noarch 2.6.0-7.el7_7 rhel-7-server-rpms 95 k 2019-11-28T11:22:03.508 INFO:teuthology.orchestra.run.smithi133.stdout: python-rgw x86_64 2:15.0.0-7798.g6882af3.el7 ceph 77 k 2019-11-28T11:22:03.508 INFO:teuthology.orchestra.run.smithi133.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-28T11:22:03.508 INFO:teuthology.orchestra.run.smithi133.stdout: python-simplegeneric 2019-11-28T11:22:03.509 INFO:teuthology.orchestra.run.smithi133.stdout: noarch 0.8-7.el7 epel 12 k 2019-11-28T11:22:03.509 INFO:teuthology.orchestra.run.smithi133.stdout: python-singledispatch 2019-11-28T11:22:03.509 INFO:teuthology.orchestra.run.smithi133.stdout: noarch 3.4.0.2-2.el7 epel 18 k 2019-11-28T11:22:03.509 INFO:teuthology.orchestra.run.smithi133.stdout: python-tempita noarch 0.5.1-6.el7 rhel-7-server-rpms 33 k 2019-11-28T11:22:03.509 INFO:teuthology.orchestra.run.smithi133.stdout: python-urllib3 noarch 1.10.2-7.el7 rhel-7-server-rpms 103 k 2019-11-28T11:22:03.509 INFO:teuthology.orchestra.run.smithi133.stdout: python-webob noarch 1.2.3-7.el7 rhel-7-server-optional-rpms 2019-11-28T11:22:03.509 INFO:teuthology.orchestra.run.smithi133.stdout: 202 k 2019-11-28T11:22:03.510 INFO:teuthology.orchestra.run.smithi133.stdout: python-websocket-client 2019-11-28T11:22:03.510 INFO:teuthology.orchestra.run.smithi133.stdout: noarch 0.56.0-3.git3c25814.el7 rhel-7-server-extras-rpms 2019-11-28T11:22:03.510 INFO:teuthology.orchestra.run.smithi133.stdout: 66 k 2019-11-28T11:22:03.510 INFO:teuthology.orchestra.run.smithi133.stdout: python-webtest noarch 1.3.4-6.el7 rhel-7-server-optional-rpms 2019-11-28T11:22:03.510 INFO:teuthology.orchestra.run.smithi133.stdout: 102 k 2019-11-28T11:22:03.510 INFO:teuthology.orchestra.run.smithi133.stdout: python-werkzeug noarch 0.9.1-2.el7 rhel-7-server-extras-rpms 2019-11-28T11:22:03.510 INFO:teuthology.orchestra.run.smithi133.stdout: 562 k 2019-11-28T11:22:03.510 INFO:teuthology.orchestra.run.smithi133.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-28T11:22:03.511 INFO:teuthology.orchestra.run.smithi133.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-28T11:22:03.511 INFO:teuthology.orchestra.run.smithi133.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-28T11:22:03.511 INFO:teuthology.orchestra.run.smithi133.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-28T11:22:03.511 INFO:teuthology.orchestra.run.smithi133.stdout: python2-oauthlib noarch 2.0.1-8.el7 rhel-7-server-rpms 146 k 2019-11-28T11:22:03.511 INFO:teuthology.orchestra.run.smithi133.stdout: python2-pyasn1-modules 2019-11-28T11:22:03.511 INFO:teuthology.orchestra.run.smithi133.stdout: noarch 0.1.9-7.el7 rhel-7-server-optional-rpms 2019-11-28T11:22:03.511 INFO:teuthology.orchestra.run.smithi133.stdout: 59 k 2019-11-28T11:22:03.512 INFO:teuthology.orchestra.run.smithi133.stdout: python2-requests-oauthlib 2019-11-28T11:22:03.512 INFO:teuthology.orchestra.run.smithi133.stdout: noarch 0.8.0-5.el7 rhel-7-server-rpms 35 k 2019-11-28T11:22:03.512 INFO:teuthology.orchestra.run.smithi133.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-28T11:22:03.512 INFO:teuthology.orchestra.run.smithi133.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-28T11:22:03.513 INFO:teuthology.orchestra.run.smithi133.stdout: python3 x86_64 3.6.8-10.el7 rhel-7-server-rpms 69 k 2019-11-28T11:22:03.513 INFO:teuthology.orchestra.run.smithi133.stdout: python3-libs x86_64 3.6.8-10.el7 rhel-7-server-rpms 7.0 M 2019-11-28T11:22:03.513 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pip noarch 9.0.3-5.el7 rhel-7-server-rpms 1.8 M 2019-11-28T11:22:03.513 INFO:teuthology.orchestra.run.smithi133.stdout: python3-setuptools noarch 39.2.0-10.el7 rhel-7-server-rpms 629 k 2019-11-28T11:22:03.513 INFO:teuthology.orchestra.run.smithi133.stdout: scipy x86_64 0.12.1-6.el7 rhel-7-server-rpms 9.3 M 2019-11-28T11:22:03.514 INFO:teuthology.orchestra.run.smithi133.stdout: socat x86_64 1.7.3.2-2.el7 rhel-7-server-rpms 290 k 2019-11-28T11:22:03.514 INFO:teuthology.orchestra.run.smithi133.stdout: suitesparse x86_64 4.0.2-10.el7 rhel-7-server-rpms 928 k 2019-11-28T11:22:03.514 INFO:teuthology.orchestra.run.smithi133.stdout: tbb x86_64 4.1-9.20130314.el7 rhel-7-server-rpms 124 k 2019-11-28T11:22:03.514 INFO:teuthology.orchestra.run.smithi133.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-28T11:22:03.514 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel x86_64 1.2.7-18.el7 rhel-7-server-rpms 50 k 2019-11-28T11:22:03.514 INFO:teuthology.orchestra.run.smithi133.stdout: 2019-11-28T11:22:03.514 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2019-11-28T11:22:03.515 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2019-11-28T11:22:03.515 INFO:teuthology.orchestra.run.smithi133.stdout:Install 19 Packages (+72 Dependent packages) 2019-11-28T11:22:03.515 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrade 2 Packages 2019-11-28T11:22:03.515 INFO:teuthology.orchestra.run.smithi133.stdout: 2019-11-28T11:22:03.515 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 148 M 2019-11-28T11:22:03.516 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading packages: 2019-11-28T11:22:03.516 INFO:teuthology.orchestra.run.smithi133.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-28T11:22:04.181 INFO:teuthology.orchestra.run.smithi016.stdout:--> Finished Dependency Resolution 2019-11-28T11:22:04.267 INFO:teuthology.orchestra.run.smithi016.stdout: 2019-11-28T11:22:04.267 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies Resolved 2019-11-28T11:22:04.280 INFO:teuthology.orchestra.run.smithi016.stdout: 2019-11-28T11:22:04.281 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2019-11-28T11:22:04.281 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2019-11-28T11:22:04.281 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2019-11-28T11:22:04.281 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2019-11-28T11:22:04.281 INFO:teuthology.orchestra.run.smithi016.stdout: bison x86_64 3.0.4-2.el7 rhel-7-server-rpms 674 k 2019-11-28T11:22:04.281 INFO:teuthology.orchestra.run.smithi016.stdout: ceph x86_64 2:15.0.0-7798.g6882af3.el7 ceph 2.0 k 2019-11-28T11:22:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-daemon x86_64 2:15.0.0-7798.g6882af3.el7 ceph 17 k 2019-11-28T11:22:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse x86_64 2:15.0.0-7798.g6882af3.el7 ceph 547 k 2019-11-28T11:22:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.7 M 2019-11-28T11:22:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 3.9 M 2019-11-28T11:22:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-cloud 2019-11-28T11:22:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 82 k 2019-11-28T11:22:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local 2019-11-28T11:22:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 8.6 M 2019-11-28T11:22:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 23 k 2019-11-28T11:22:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-ssh noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 33 k 2019-11-28T11:22:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw x86_64 2:15.0.0-7798.g6882af3.el7 ceph 6.1 M 2019-11-28T11:22:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test x86_64 2:15.0.0-7798.g6882af3.el7 ceph 37 M 2019-11-28T11:22:04.283 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-devel 2019-11-28T11:22:04.284 INFO:teuthology.orchestra.run.smithi016.stdout: x86_64 0.176-2.el7 rhel-7-server-rpms 39 k 2019-11-28T11:22:04.284 INFO:teuthology.orchestra.run.smithi016.stdout: flex x86_64 2.5.37-6.el7 rhel-7-server-rpms 293 k 2019-11-28T11:22:04.284 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel x86_64 2:15.0.0-7798.g6882af3.el7 ceph 17 k 2019-11-28T11:22:04.284 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 483 k 2019-11-28T11:22:04.284 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-devel x86_64 1:1.0.2k-19.el7 rhel-7-server-rpms 1.5 M 2019-11-28T11:22:04.284 INFO:teuthology.orchestra.run.smithi016.stdout: python-ceph-compat x86_64 2:15.0.0-7798.g6882af3.el7 ceph 2.2 k 2019-11-28T11:22:04.284 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse x86_64 2:15.0.0-7798.g6882af3.el7 ceph 68 k 2019-11-28T11:22:04.285 INFO:teuthology.orchestra.run.smithi016.stdout:Updating: 2019-11-28T11:22:04.285 INFO:teuthology.orchestra.run.smithi016.stdout: librados2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 3.5 M 2019-11-28T11:22:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.7 M 2019-11-28T11:22:04.286 INFO:teuthology.orchestra.run.smithi016.stdout:Installing for dependencies: 2019-11-28T11:22:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base x86_64 2:15.0.0-7798.g6882af3.el7 ceph 5.6 M 2019-11-28T11:22:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common x86_64 2:15.0.0-7798.g6882af3.el7 ceph 19 M 2019-11-28T11:22:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards 2019-11-28T11:22:04.286 INFO:teuthology.orchestra.run.smithi016.stdout: noarch 2:15.0.0-7798.g6882af3.el7 ceph-noarch 18 k 2019-11-28T11:22:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds x86_64 2:15.0.0-7798.g6882af3.el7 ceph 1.9 M 2019-11-28T11:22:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon x86_64 2:15.0.0-7798.g6882af3.el7 ceph 4.3 M 2019-11-28T11:22:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd x86_64 2:15.0.0-7798.g6882af3.el7 ceph 16 M 2019-11-28T11:22:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux x86_64 2:15.0.0-7798.g6882af3.el7 ceph 20 k 2019-11-28T11:22:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-28T11:22:04.287 INFO:teuthology.orchestra.run.smithi016.stdout: keyutils-libs-devel x86_64 1.5.8-3.el7 rhel-7-server-rpms 37 k 2019-11-28T11:22:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: krb5-devel x86_64 1.15.1-37.el7_7.2 rhel-7-server-rpms 272 k 2019-11-28T11:22:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-28T11:22:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: libcom_err-devel x86_64 1.42.9-16.el7 rhel-7-server-rpms 32 k 2019-11-28T11:22:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-28T11:22:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq x86_64 0.8.0-2.el7 rhel-7-server-rpms 37 k 2019-11-28T11:22:04.288 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel x86_64 2:15.0.0-7798.g6882af3.el7 ceph 153 k 2019-11-28T11:22:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 361 k 2019-11-28T11:22:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-28T11:22:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2 x86_64 2:15.0.0-7798.g6882af3.el7 ceph 5.4 M 2019-11-28T11:22:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: libselinux-devel x86_64 2.5-14.1.el7 rhel-7-server-rpms 187 k 2019-11-28T11:22:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: libsepol-devel x86_64 2.5-10.el7 rhel-7-server-rpms 77 k 2019-11-28T11:22:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: libverto-devel x86_64 0.2.5-4.el7 rhel-7-server-rpms 12 k 2019-11-28T11:22:04.289 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-28T11:22:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 rhel-7-server-rpms 206 k 2019-11-28T11:22:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-28T11:22:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: pcre-devel x86_64 8.32-17.el7 rhel-7-server-rpms 480 k 2019-11-28T11:22:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: python-beaker noarch 1.5.4-10.el7 rhel-7-server-rpms 80 k 2019-11-28T11:22:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-28T11:22:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: python-ceph-argparse 2019-11-28T11:22:04.290 INFO:teuthology.orchestra.run.smithi016.stdout: x86_64 2:15.0.0-7798.g6882af3.el7 ceph 35 k 2019-11-28T11:22:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: python-ceph-common x86_64 2:15.0.0-7798.g6882af3.el7 ceph 42 k 2019-11-28T11:22:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: python-cephfs x86_64 2:15.0.0-7798.g6882af3.el7 ceph 102 k 2019-11-28T11:22:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: python-cherrypy noarch 3.2.2-4.el7 rhel-7-server-rpms 422 k 2019-11-28T11:22:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-28T11:22:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: python-jwcrypto noarch 0.4.2-1.el7 rhel-7-server-rpms 57 k 2019-11-28T11:22:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: python-mako noarch 0.8.1-2.el7 rhel-7-server-rpms 307 k 2019-11-28T11:22:04.291 INFO:teuthology.orchestra.run.smithi016.stdout: python-markupsafe x86_64 0.11-10.el7 rhel-7-server-rpms 25 k 2019-11-28T11:22:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 2019-11-28T11:22:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: rhel-7-server-rpms 866 k 2019-11-28T11:22:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-28T11:22:04.292 INFO:teuthology.orchestra.run.smithi016.stdout: python-prettytable noarch 0.7.2-3.el7 rhel-7-server-rpms 37 k 2019-11-28T11:22:04.293 INFO:teuthology.orchestra.run.smithi016.stdout: python-rados x86_64 2:15.0.0-7798.g6882af3.el7 ceph 209 k 2019-11-28T11:22:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: python-rbd x86_64 2:15.0.0-7798.g6882af3.el7 ceph 199 k 2019-11-28T11:22:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-28T11:22:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-28T11:22:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: python-requests noarch 2.6.0-7.el7_7 rhel-7-server-rpms 95 k 2019-11-28T11:22:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: python-rgw x86_64 2:15.0.0-7798.g6882af3.el7 ceph 77 k 2019-11-28T11:22:04.294 INFO:teuthology.orchestra.run.smithi016.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-28T11:22:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: python-simplegeneric 2019-11-28T11:22:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: noarch 0.8-7.el7 epel 12 k 2019-11-28T11:22:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: python-singledispatch 2019-11-28T11:22:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: noarch 3.4.0.2-2.el7 epel 18 k 2019-11-28T11:22:04.296 INFO:teuthology.orchestra.run.smithi016.stdout: python-tempita noarch 0.5.1-6.el7 rhel-7-server-rpms 33 k 2019-11-28T11:22:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: python-urllib3 noarch 1.10.2-7.el7 rhel-7-server-rpms 103 k 2019-11-28T11:22:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: python-webob noarch 1.2.3-7.el7 rhel-7-server-optional-rpms 2019-11-28T11:22:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: 202 k 2019-11-28T11:22:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: python-websocket-client 2019-11-28T11:22:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: noarch 0.56.0-3.git3c25814.el7 rhel-7-server-extras-rpms 2019-11-28T11:22:04.297 INFO:teuthology.orchestra.run.smithi016.stdout: 66 k 2019-11-28T11:22:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: python-webtest noarch 1.3.4-6.el7 rhel-7-server-optional-rpms 2019-11-28T11:22:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: 102 k 2019-11-28T11:22:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: python-werkzeug noarch 0.9.1-2.el7 rhel-7-server-extras-rpms 2019-11-28T11:22:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: 562 k 2019-11-28T11:22:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-28T11:22:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-28T11:22:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-28T11:22:04.298 INFO:teuthology.orchestra.run.smithi016.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-28T11:22:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: python2-oauthlib noarch 2.0.1-8.el7 rhel-7-server-rpms 146 k 2019-11-28T11:22:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: python2-pyasn1-modules 2019-11-28T11:22:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: noarch 0.1.9-7.el7 rhel-7-server-optional-rpms 2019-11-28T11:22:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: 59 k 2019-11-28T11:22:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: python2-requests-oauthlib 2019-11-28T11:22:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: noarch 0.8.0-5.el7 rhel-7-server-rpms 35 k 2019-11-28T11:22:04.299 INFO:teuthology.orchestra.run.smithi016.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-28T11:22:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-28T11:22:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: python3 x86_64 3.6.8-10.el7 rhel-7-server-rpms 69 k 2019-11-28T11:22:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: python3-libs x86_64 3.6.8-10.el7 rhel-7-server-rpms 7.0 M 2019-11-28T11:22:04.300 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pip noarch 9.0.3-5.el7 rhel-7-server-rpms 1.8 M 2019-11-28T11:22:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: python3-setuptools noarch 39.2.0-10.el7 rhel-7-server-rpms 629 k 2019-11-28T11:22:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: scipy x86_64 0.12.1-6.el7 rhel-7-server-rpms 9.3 M 2019-11-28T11:22:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: socat x86_64 1.7.3.2-2.el7 rhel-7-server-rpms 290 k 2019-11-28T11:22:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: suitesparse x86_64 4.0.2-10.el7 rhel-7-server-rpms 928 k 2019-11-28T11:22:04.301 INFO:teuthology.orchestra.run.smithi016.stdout: tbb x86_64 4.1-9.20130314.el7 rhel-7-server-rpms 124 k 2019-11-28T11:22:04.302 INFO:teuthology.orchestra.run.smithi016.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-28T11:22:04.302 INFO:teuthology.orchestra.run.smithi016.stdout: zlib-devel x86_64 1.2.7-18.el7 rhel-7-server-rpms 50 k 2019-11-28T11:22:04.302 INFO:teuthology.orchestra.run.smithi016.stdout: 2019-11-28T11:22:04.302 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2019-11-28T11:22:04.302 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2019-11-28T11:22:04.303 INFO:teuthology.orchestra.run.smithi016.stdout:Install 19 Packages (+72 Dependent packages) 2019-11-28T11:22:04.303 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrade 2 Packages 2019-11-28T11:22:04.303 INFO:teuthology.orchestra.run.smithi016.stdout: 2019-11-28T11:22:04.305 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 148 M 2019-11-28T11:22:04.305 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading packages: 2019-11-28T11:22:04.305 INFO:teuthology.orchestra.run.smithi016.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-28T11:22:54.740 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2019-11-28T11:22:54.765 INFO:teuthology.orchestra.run.smithi174.stdout:Total 2.7 MB/s | 148 MB 00:53 2019-11-28T11:22:54.788 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2019-11-28T11:22:54.849 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2019-11-28T11:22:55.328 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded 2019-11-28T11:22:55.328 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2019-11-28T11:22:55.732 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2019-11-28T11:22:55.732 INFO:teuthology.orchestra.run.smithi133.stdout:Total 2.8 MB/s | 148 MB 00:52 2019-11-28T11:22:55.780 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2019-11-28T11:22:55.841 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2019-11-28T11:22:55.993 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2019-11-28T11:22:55.994 INFO:teuthology.orchestra.run.smithi080.stdout:Total 2.7 MB/s | 148 MB 00:55 2019-11-28T11:22:56.041 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2019-11-28T11:22:56.056 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/95 2019-11-28T11:22:56.102 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2019-11-28T11:22:56.317 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded 2019-11-28T11:22:56.317 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2019-11-28T11:22:56.377 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 2/95 2019-11-28T11:22:56.583 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded 2019-11-28T11:22:56.583 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2019-11-28T11:22:56.614 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2019-11-28T11:22:56.615 INFO:teuthology.orchestra.run.smithi076.stdout:Total 2.6 MB/s | 148 MB 00:56 2019-11-28T11:22:56.663 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2019-11-28T11:22:56.724 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2019-11-28T11:22:56.907 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2019-11-28T11:22:56.921 INFO:teuthology.orchestra.run.smithi016.stdout:Total 2.8 MB/s | 148 MB 00:52 2019-11-28T11:22:56.959 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2019-11-28T11:22:57.024 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2019-11-28T11:22:57.071 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/95 2019-11-28T11:22:57.227 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded 2019-11-28T11:22:57.229 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2019-11-28T11:22:57.349 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 2/95 2019-11-28T11:22:57.373 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/95 2019-11-28T11:22:57.543 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded 2019-11-28T11:22:57.544 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2019-11-28T11:22:57.677 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 2/95 2019-11-28T11:22:57.958 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/95 2019-11-28T11:22:58.004 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 3/95 2019-11-28T11:22:58.286 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 2/95 2019-11-28T11:22:58.348 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/95 2019-11-28T11:22:58.369 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 4/95 2019-11-28T11:22:58.657 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 2/95 2019-11-28T11:22:58.813 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-3.6.8-10.el7.x86_64 5/95 2019-11-28T11:22:59.012 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 3/95 2019-11-28T11:22:59.290 INFO:teuthology.orchestra.run.smithi075.stdout:-------------------------------------------------------------------------------- 2019-11-28T11:22:59.290 INFO:teuthology.orchestra.run.smithi075.stdout:Total 2.5 MB/s | 148 MB 01:00 2019-11-28T11:22:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 3/95 2019-11-28T11:22:59.338 INFO:teuthology.orchestra.run.smithi075.stdout:Running transaction check 2019-11-28T11:22:59.395 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 4/95 2019-11-28T11:22:59.399 INFO:teuthology.orchestra.run.smithi075.stdout:Running transaction test 2019-11-28T11:22:59.486 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 6/95 2019-11-28T11:22:59.719 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 4/95 2019-11-28T11:22:59.829 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-3.6.8-10.el7.x86_64 5/95 2019-11-28T11:22:59.851 INFO:teuthology.orchestra.run.smithi075.stdout:Transaction test succeeded 2019-11-28T11:22:59.852 INFO:teuthology.orchestra.run.smithi075.stdout:Running transaction 2019-11-28T11:22:59.902 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 7/95 2019-11-28T11:22:59.932 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 3/95 2019-11-28T11:23:00.126 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-3.6.8-10.el7.x86_64 5/95 2019-11-28T11:23:00.131 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:python-ceph-argparse-15.0.0-7798.g6882af3.el7.x86_64 8/95 2019-11-28T11:23:00.328 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 4/95 2019-11-28T11:23:00.427 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-six-1.9.0-0.el7.noarch 9/95 2019-11-28T11:23:00.539 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 3/95 2019-11-28T11:23:00.565 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 6/95 2019-11-28T11:23:00.593 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/95 2019-11-28T11:23:00.771 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-3.6.8-10.el7.x86_64 5/95 2019-11-28T11:23:00.800 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 10/95 2019-11-28T11:23:00.895 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 6/95 2019-11-28T11:23:00.913 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 2/95 2019-11-28T11:23:00.943 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 7/95 2019-11-28T11:23:00.956 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 4/95 2019-11-28T11:23:01.128 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 11/95 2019-11-28T11:23:01.172 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:python-ceph-argparse-15.0.0-7798.g6882af3.el7.x86_64 8/95 2019-11-28T11:23:01.242 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 7/95 2019-11-28T11:23:01.372 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-3.6.8-10.el7.x86_64 5/95 2019-11-28T11:23:01.421 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-webob-1.2.3-7.el7.noarch 12/95 2019-11-28T11:23:01.477 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python2-six-1.9.0-0.el7.noarch 9/95 2019-11-28T11:23:01.480 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:python-ceph-argparse-15.0.0-7798.g6882af3.el7.x86_64 8/95 2019-11-28T11:23:01.514 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 6/95 2019-11-28T11:23:01.683 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : zlib-devel-1.2.7-18.el7.x86_64 13/95 2019-11-28T11:23:01.771 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python2-six-1.9.0-0.el7.noarch 9/95 2019-11-28T11:23:01.859 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 10/95 2019-11-28T11:23:01.918 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 7/95 2019-11-28T11:23:02.041 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/95 2019-11-28T11:23:02.154 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 6/95 2019-11-28T11:23:02.168 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 10/95 2019-11-28T11:23:02.171 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:python-ceph-argparse-15.0.0-7798.g6882af3.el7.x86_64 8/95 2019-11-28T11:23:02.204 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 11/95 2019-11-28T11:23:02.337 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/95 2019-11-28T11:23:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 11/95 2019-11-28T11:23:02.498 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python2-six-1.9.0-0.el7.noarch 9/95 2019-11-28T11:23:02.503 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-webob-1.2.3-7.el7.noarch 12/95 2019-11-28T11:23:02.548 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 7/95 2019-11-28T11:23:02.573 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 3/95 2019-11-28T11:23:02.686 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 16/95 2019-11-28T11:23:02.784 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-webob-1.2.3-7.el7.noarch 12/95 2019-11-28T11:23:02.785 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:python-ceph-argparse-15.0.0-7798.g6882af3.el7.x86_64 8/95 2019-11-28T11:23:02.825 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : zlib-devel-1.2.7-18.el7.x86_64 13/95 2019-11-28T11:23:02.842 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 10/95 2019-11-28T11:23:02.937 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 4/95 2019-11-28T11:23:03.001 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 17/95 2019-11-28T11:23:03.084 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : zlib-devel-1.2.7-18.el7.x86_64 13/95 2019-11-28T11:23:03.136 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python2-six-1.9.0-0.el7.noarch 9/95 2019-11-28T11:23:03.167 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/95 2019-11-28T11:23:03.168 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 11/95 2019-11-28T11:23:03.321 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python3-3.6.8-10.el7.x86_64 5/95 2019-11-28T11:23:03.361 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/95 2019-11-28T11:23:03.428 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 18/95 2019-11-28T11:23:03.451 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-webob-1.2.3-7.el7.noarch 12/95 2019-11-28T11:23:03.487 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/95 2019-11-28T11:23:03.512 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 10/95 2019-11-28T11:23:03.674 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/95 2019-11-28T11:23:03.734 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 19/95 2019-11-28T11:23:03.775 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : zlib-devel-1.2.7-18.el7.x86_64 13/95 2019-11-28T11:23:03.779 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 16/95 2019-11-28T11:23:03.844 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 11/95 2019-11-28T11:23:03.907 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 16/95 2019-11-28T11:23:04.066 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/95 2019-11-28T11:23:04.089 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 6/95 2019-11-28T11:23:04.196 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 20/95 2019-11-28T11:23:04.205 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-webob-1.2.3-7.el7.noarch 12/95 2019-11-28T11:23:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 17/95 2019-11-28T11:23:04.404 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/95 2019-11-28T11:23:04.421 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 17/95 2019-11-28T11:23:04.426 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 7/95 2019-11-28T11:23:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : zlib-devel-1.2.7-18.el7.x86_64 13/95 2019-11-28T11:23:04.537 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 21/95 2019-11-28T11:23:04.622 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:python-ceph-argparse-15.0.0-7798.g6882af3.el7.x86_64 8/95 2019-11-28T11:23:04.664 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 18/95 2019-11-28T11:23:04.670 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 16/95 2019-11-28T11:23:04.815 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 22/95 2019-11-28T11:23:04.839 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 18/95 2019-11-28T11:23:04.882 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/95 2019-11-28T11:23:04.916 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python2-six-1.9.0-0.el7.noarch 9/95 2019-11-28T11:23:04.971 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 19/95 2019-11-28T11:23:05.017 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 17/95 2019-11-28T11:23:05.175 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 23/95 2019-11-28T11:23:05.235 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 19/95 2019-11-28T11:23:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/95 2019-11-28T11:23:05.285 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 10/95 2019-11-28T11:23:05.398 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 20/95 2019-11-28T11:23:05.431 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:python-ceph-common-15.0.0-7798.g6882af3.el7.x86_64 24/95 2019-11-28T11:23:05.452 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 18/95 2019-11-28T11:23:05.526 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 16/95 2019-11-28T11:23:05.619 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 11/95 2019-11-28T11:23:05.670 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 20/95 2019-11-28T11:23:05.725 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 21/95 2019-11-28T11:23:05.772 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 25/95 2019-11-28T11:23:05.814 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 19/95 2019-11-28T11:23:05.841 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 17/95 2019-11-28T11:23:05.926 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-webob-1.2.3-7.el7.noarch 12/95 2019-11-28T11:23:05.978 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 22/95 2019-11-28T11:23:05.980 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 21/95 2019-11-28T11:23:06.052 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 26/95 2019-11-28T11:23:06.224 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : zlib-devel-1.2.7-18.el7.x86_64 13/95 2019-11-28T11:23:06.274 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 18/95 2019-11-28T11:23:06.296 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 22/95 2019-11-28T11:23:06.329 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 23/95 2019-11-28T11:23:06.341 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 27/95 2019-11-28T11:23:06.545 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 20/95 2019-11-28T11:23:06.557 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/95 2019-11-28T11:23:06.591 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 23/95 2019-11-28T11:23:06.622 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:python-ceph-common-15.0.0-7798.g6882af3.el7.x86_64 24/95 2019-11-28T11:23:06.625 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7798.g6882af3.el7.noarc 28/95 2019-11-28T11:23:06.665 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 19/95 2019-11-28T11:23:06.837 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/95 2019-11-28T11:23:06.861 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 21/95 2019-11-28T11:23:06.897 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:python-ceph-common-15.0.0-7798.g6882af3.el7.x86_64 24/95 2019-11-28T11:23:06.969 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 25/95 2019-11-28T11:23:07.012 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 29/95 2019-11-28T11:23:07.062 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 16/95 2019-11-28T11:23:07.151 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 20/95 2019-11-28T11:23:07.182 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 22/95 2019-11-28T11:23:07.249 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 25/95 2019-11-28T11:23:07.258 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 26/95 2019-11-28T11:23:07.350 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 17/95 2019-11-28T11:23:07.367 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 30/95 2019-11-28T11:23:07.504 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 21/95 2019-11-28T11:23:07.525 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 23/95 2019-11-28T11:23:07.539 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 27/95 2019-11-28T11:23:07.554 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 26/95 2019-11-28T11:23:07.715 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 31/95 2019-11-28T11:23:07.766 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 18/95 2019-11-28T11:23:07.785 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 22/95 2019-11-28T11:23:07.797 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:python-ceph-common-15.0.0-7798.g6882af3.el7.x86_64 24/95 2019-11-28T11:23:07.831 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7798.g6882af3.el7.noarc 28/95 2019-11-28T11:23:07.859 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 27/95 2019-11-28T11:23:07.967 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pcre-devel-8.32-17.el7.x86_64 32/95 2019-11-28T11:23:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 23/95 2019-11-28T11:23:08.142 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 19/95 2019-11-28T11:23:08.151 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7798.g6882af3.el7.noarc 28/95 2019-11-28T11:23:08.184 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 25/95 2019-11-28T11:23:08.197 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 29/95 2019-11-28T11:23:08.234 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcom_err-devel-1.42.9-16.el7.x86_64 33/95 2019-11-28T11:23:08.416 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:python-ceph-common-15.0.0-7798.g6882af3.el7.x86_64 24/95 2019-11-28T11:23:08.452 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 26/95 2019-11-28T11:23:08.496 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 29/95 2019-11-28T11:23:08.556 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 30/95 2019-11-28T11:23:08.560 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 20/95 2019-11-28T11:23:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 25/95 2019-11-28T11:23:08.793 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 27/95 2019-11-28T11:23:08.852 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 30/95 2019-11-28T11:23:08.853 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 21/95 2019-11-28T11:23:08.898 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 31/95 2019-11-28T11:23:09.064 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 26/95 2019-11-28T11:23:09.092 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7798.g6882af3.el7.noarc 28/95 2019-11-28T11:23:09.115 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 22/95 2019-11-28T11:23:09.161 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : pcre-devel-8.32-17.el7.x86_64 32/95 2019-11-28T11:23:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 31/95 2019-11-28T11:23:09.360 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 27/95 2019-11-28T11:23:09.441 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pcre-devel-8.32-17.el7.x86_64 32/95 2019-11-28T11:23:09.514 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 29/95 2019-11-28T11:23:09.515 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 23/95 2019-11-28T11:23:09.515 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcom_err-devel-1.42.9-16.el7.x86_64 33/95 2019-11-28T11:23:09.618 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7798.g6882af3.el7.noarc 28/95 2019-11-28T11:23:09.694 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:python-ceph-common-15.0.0-7798.g6882af3.el7.x86_64 24/95 2019-11-28T11:23:09.755 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcom_err-devel-1.42.9-16.el7.x86_64 33/95 2019-11-28T11:23:09.824 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 34/95 2019-11-28T11:23:09.850 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 30/95 2019-11-28T11:23:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 29/95 2019-11-28T11:23:10.056 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 25/95 2019-11-28T11:23:10.158 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : scipy-0.12.1-6.el7.x86_64 35/95 2019-11-28T11:23:10.230 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 31/95 2019-11-28T11:23:10.373 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 26/95 2019-11-28T11:23:10.386 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 30/95 2019-11-28T11:23:10.389 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 36/95 2019-11-28T11:23:10.486 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : pcre-devel-8.32-17.el7.x86_64 32/95 2019-11-28T11:23:10.631 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 37/95 2019-11-28T11:23:10.666 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 27/95 2019-11-28T11:23:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 31/95 2019-11-28T11:23:10.817 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcom_err-devel-1.42.9-16.el7.x86_64 33/95 2019-11-28T11:23:10.883 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 38/95 2019-11-28T11:23:10.942 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7798.g6882af3.el7.noarc 28/95 2019-11-28T11:23:11.080 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : pcre-devel-8.32-17.el7.x86_64 32/95 2019-11-28T11:23:11.082 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 34/95 2019-11-28T11:23:11.226 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 39/95 2019-11-28T11:23:11.283 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 34/95 2019-11-28T11:23:11.304 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 29/95 2019-11-28T11:23:11.389 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcom_err-devel-1.42.9-16.el7.x86_64 33/95 2019-11-28T11:23:11.492 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : scipy-0.12.1-6.el7.x86_64 35/95 2019-11-28T11:23:11.559 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 40/95 2019-11-28T11:23:11.637 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 30/95 2019-11-28T11:23:11.738 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : scipy-0.12.1-6.el7.x86_64 35/95 2019-11-28T11:23:11.774 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 36/95 2019-11-28T11:23:11.870 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 41/95 2019-11-28T11:23:11.964 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 31/95 2019-11-28T11:23:12.019 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 36/95 2019-11-28T11:23:12.065 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 37/95 2019-11-28T11:23:12.319 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 37/95 2019-11-28T11:23:12.357 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : pcre-devel-8.32-17.el7.x86_64 32/95 2019-11-28T11:23:12.359 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 38/95 2019-11-28T11:23:12.587 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 38/95 2019-11-28T11:23:12.663 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 34/95 2019-11-28T11:23:12.675 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : libcom_err-devel-1.42.9-16.el7.x86_64 33/95 2019-11-28T11:23:12.713 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 39/95 2019-11-28T11:23:12.911 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 39/95 2019-11-28T11:23:12.921 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 42/95 2019-11-28T11:23:13.052 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 40/95 2019-11-28T11:23:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 34/95 2019-11-28T11:23:13.083 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : scipy-0.12.1-6.el7.x86_64 35/95 2019-11-28T11:23:13.214 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 43/95 2019-11-28T11:23:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 40/95 2019-11-28T11:23:13.313 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 41/95 2019-11-28T11:23:13.330 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 36/95 2019-11-28T11:23:13.472 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : scipy-0.12.1-6.el7.x86_64 35/95 2019-11-28T11:23:13.534 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 41/95 2019-11-28T11:23:13.606 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 37/95 2019-11-28T11:23:13.686 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 44/95 2019-11-28T11:23:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 36/95 2019-11-28T11:23:13.867 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 38/95 2019-11-28T11:23:13.971 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-daemon-15.0.0-7798.g6882af3.el7.x86_64 45/95 2019-11-28T11:23:14.136 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 37/95 2019-11-28T11:23:14.193 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 34/95 2019-11-28T11:23:14.200 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : keyutils-libs-devel-1.5.8-3.el7.x86_64 46/95 2019-11-28T11:23:14.223 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 39/95 2019-11-28T11:23:14.394 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 42/95 2019-11-28T11:23:15.195 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 42/95 2019-11-28T11:23:15.196 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 43/95 2019-11-28T11:23:15.196 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 38/95 2019-11-28T11:23:15.196 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 39/95 2019-11-28T11:23:15.196 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : scipy-0.12.1-6.el7.x86_64 35/95 2019-11-28T11:23:15.196 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 36/95 2019-11-28T11:23:15.197 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 37/95 2019-11-28T11:23:15.197 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 40/95 2019-11-28T11:23:15.197 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 41/95 2019-11-28T11:23:15.198 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 47/95 2019-11-28T11:23:15.198 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 48/95 2019-11-28T11:23:15.198 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : jq-1.5-1.el7.x86_64 49/95 2019-11-28T11:23:15.198 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 43/95 2019-11-28T11:23:15.353 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 40/95 2019-11-28T11:23:15.354 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 44/95 2019-11-28T11:23:15.390 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 50/95 2019-11-28T11:23:15.435 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 38/95 2019-11-28T11:23:15.495 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 44/95 2019-11-28T11:23:15.593 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-daemon-15.0.0-7798.g6882af3.el7.x86_64 45/95 2019-11-28T11:23:15.676 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 41/95 2019-11-28T11:23:15.732 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 39/95 2019-11-28T11:23:15.788 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-daemon-15.0.0-7798.g6882af3.el7.x86_64 45/95 2019-11-28T11:23:15.854 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : keyutils-libs-devel-1.5.8-3.el7.x86_64 46/95 2019-11-28T11:23:15.985 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 42/95 2019-11-28T11:23:16.034 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 51/95 2019-11-28T11:23:16.034 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : keyutils-libs-devel-1.5.8-3.el7.x86_64 46/95 2019-11-28T11:23:16.043 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 40/95 2019-11-28T11:23:16.117 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 47/95 2019-11-28T11:23:16.332 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 41/95 2019-11-28T11:23:16.336 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 47/95 2019-11-28T11:23:16.405 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 43/95 2019-11-28T11:23:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 48/95 2019-11-28T11:23:16.468 INFO:teuthology.orchestra.run.smithi174.stdout: Updating : 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 52/95 2019-11-28T11:23:16.701 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 48/95 2019-11-28T11:23:16.753 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : jq-1.5-1.el7.x86_64 49/95 2019-11-28T11:23:16.762 INFO:teuthology.orchestra.run.smithi174.stdout: Updating : 2:librbd1-15.0.0-7798.g6882af3.el7.x86_64 53/95 2019-11-28T11:23:16.790 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 42/95 2019-11-28T11:23:16.913 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 44/95 2019-11-28T11:23:17.021 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 50/95 2019-11-28T11:23:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : jq-1.5-1.el7.x86_64 49/95 2019-11-28T11:23:17.040 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:libcephfs2-15.0.0-7798.g6882af3.el7.x86_64 54/95 2019-11-28T11:23:17.142 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 43/95 2019-11-28T11:23:17.263 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-daemon-15.0.0-7798.g6882af3.el7.x86_64 45/95 2019-11-28T11:23:17.355 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 50/95 2019-11-28T11:23:17.396 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 42/95 2019-11-28T11:23:17.458 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : keyutils-libs-devel-1.5.8-3.el7.x86_64 46/95 2019-11-28T11:23:17.683 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 51/95 2019-11-28T11:23:17.722 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 47/95 2019-11-28T11:23:17.749 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 44/95 2019-11-28T11:23:17.792 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:python-rados-15.0.0-7798.g6882af3.el7.x86_64 55/95 2019-11-28T11:23:18.017 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 51/95 2019-11-28T11:23:18.035 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-daemon-15.0.0-7798.g6882af3.el7.x86_64 45/95 2019-11-28T11:23:18.046 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 48/95 2019-11-28T11:23:18.078 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:librgw2-15.0.0-7798.g6882af3.el7.x86_64 56/95 2019-11-28T11:23:18.124 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 43/95 2019-11-28T11:23:18.182 INFO:teuthology.orchestra.run.smithi080.stdout: Updating : 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 52/95 2019-11-28T11:23:18.256 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : keyutils-libs-devel-1.5.8-3.el7.x86_64 46/95 2019-11-28T11:23:18.421 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : jq-1.5-1.el7.x86_64 49/95 2019-11-28T11:23:18.422 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:python-rgw-15.0.0-7798.g6882af3.el7.x86_64 57/95 2019-11-28T11:23:18.510 INFO:teuthology.orchestra.run.smithi080.stdout: Updating : 2:librbd1-15.0.0-7798.g6882af3.el7.x86_64 53/95 2019-11-28T11:23:18.524 INFO:teuthology.orchestra.run.smithi133.stdout: Updating : 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 52/95 2019-11-28T11:23:18.544 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 47/95 2019-11-28T11:23:18.633 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 44/95 2019-11-28T11:23:18.714 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:python-cephfs-15.0.0-7798.g6882af3.el7.x86_64 58/95 2019-11-28T11:23:18.741 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 50/95 2019-11-28T11:23:18.834 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:libcephfs2-15.0.0-7798.g6882af3.el7.x86_64 54/95 2019-11-28T11:23:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 48/95 2019-11-28T11:23:18.907 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-daemon-15.0.0-7798.g6882af3.el7.x86_64 45/95 2019-11-28T11:23:19.005 INFO:teuthology.orchestra.run.smithi133.stdout: Updating : 2:librbd1-15.0.0-7798.g6882af3.el7.x86_64 53/95 2019-11-28T11:23:19.009 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:python-rbd-15.0.0-7798.g6882af3.el7.x86_64 59/95 2019-11-28T11:23:19.129 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : keyutils-libs-devel-1.5.8-3.el7.x86_64 46/95 2019-11-28T11:23:19.325 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:libcephfs2-15.0.0-7798.g6882af3.el7.x86_64 54/95 2019-11-28T11:23:19.383 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 47/95 2019-11-28T11:23:19.428 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 51/95 2019-11-28T11:23:19.573 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:python-rados-15.0.0-7798.g6882af3.el7.x86_64 55/95 2019-11-28T11:23:19.673 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 48/95 2019-11-28T11:23:19.695 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : jq-1.5-1.el7.x86_64 49/95 2019-11-28T11:23:19.890 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:librgw2-15.0.0-7798.g6882af3.el7.x86_64 56/95 2019-11-28T11:23:20.227 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:python-rados-15.0.0-7798.g6882af3.el7.x86_64 55/95 2019-11-28T11:23:20.228 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 50/95 2019-11-28T11:23:20.228 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : jq-1.5-1.el7.x86_64 49/95 2019-11-28T11:23:20.228 INFO:teuthology.orchestra.run.smithi076.stdout: Updating : 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 52/95 2019-11-28T11:23:20.228 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:python-rgw-15.0.0-7798.g6882af3.el7.x86_64 57/95 2019-11-28T11:23:20.255 INFO:teuthology.orchestra.run.smithi076.stdout: Updating : 2:librbd1-15.0.0-7798.g6882af3.el7.x86_64 53/95 2019-11-28T11:23:20.304 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 50/95 2019-11-28T11:23:20.439 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:librgw2-15.0.0-7798.g6882af3.el7.x86_64 56/95 2019-11-28T11:23:20.489 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:python-cephfs-15.0.0-7798.g6882af3.el7.x86_64 58/95 2019-11-28T11:23:20.594 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:libcephfs2-15.0.0-7798.g6882af3.el7.x86_64 54/95 2019-11-28T11:23:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 51/95 2019-11-28T11:23:20.750 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:python-rbd-15.0.0-7798.g6882af3.el7.x86_64 59/95 2019-11-28T11:23:20.769 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:python-rgw-15.0.0-7798.g6882af3.el7.x86_64 57/95 2019-11-28T11:23:20.931 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 51/95 2019-11-28T11:23:21.045 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:python-cephfs-15.0.0-7798.g6882af3.el7.x86_64 58/95 2019-11-28T11:23:21.193 INFO:teuthology.orchestra.run.smithi016.stdout: Updating : 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 52/95 2019-11-28T11:23:21.326 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:libradosstriper1-15.0.0-7798.g6882af3.el7.x86_64 60/95 2019-11-28T11:23:21.361 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:python-rbd-15.0.0-7798.g6882af3.el7.x86_64 59/95 2019-11-28T11:23:21.389 INFO:teuthology.orchestra.run.smithi075.stdout: Updating : 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 52/95 2019-11-28T11:23:21.438 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:python-rados-15.0.0-7798.g6882af3.el7.x86_64 55/95 2019-11-28T11:23:21.557 INFO:teuthology.orchestra.run.smithi016.stdout: Updating : 2:librbd1-15.0.0-7798.g6882af3.el7.x86_64 53/95 2019-11-28T11:23:21.718 INFO:teuthology.orchestra.run.smithi075.stdout: Updating : 2:librbd1-15.0.0-7798.g6882af3.el7.x86_64 53/95 2019-11-28T11:23:21.784 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:librgw2-15.0.0-7798.g6882af3.el7.x86_64 56/95 2019-11-28T11:23:21.902 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:libcephfs2-15.0.0-7798.g6882af3.el7.x86_64 54/95 2019-11-28T11:23:21.989 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:libcephfs2-15.0.0-7798.g6882af3.el7.x86_64 54/95 2019-11-28T11:23:22.080 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:python-rgw-15.0.0-7798.g6882af3.el7.x86_64 57/95 2019-11-28T11:23:22.296 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 61/95 2019-11-28T11:23:22.373 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:python-cephfs-15.0.0-7798.g6882af3.el7.x86_64 58/95 2019-11-28T11:23:22.671 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:python-rbd-15.0.0-7798.g6882af3.el7.x86_64 59/95 2019-11-28T11:23:22.729 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:python-rados-15.0.0-7798.g6882af3.el7.x86_64 55/95 2019-11-28T11:23:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:python-rados-15.0.0-7798.g6882af3.el7.x86_64 55/95 2019-11-28T11:23:22.780 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-base-15.0.0-7798.g6882af3.el7.x86_64 62/95 2019-11-28T11:23:22.981 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:libradosstriper1-15.0.0-7798.g6882af3.el7.x86_64 60/95 2019-11-28T11:23:23.004 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:librgw2-15.0.0-7798.g6882af3.el7.x86_64 56/95 2019-11-28T11:23:23.047 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:librgw2-15.0.0-7798.g6882af3.el7.x86_64 56/95 2019-11-28T11:23:23.292 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:python-rgw-15.0.0-7798.g6882af3.el7.x86_64 57/95 2019-11-28T11:23:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:python-rgw-15.0.0-7798.g6882af3.el7.x86_64 57/95 2019-11-28T11:23:23.551 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:python-cephfs-15.0.0-7798.g6882af3.el7.x86_64 58/95 2019-11-28T11:23:23.622 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:python-cephfs-15.0.0-7798.g6882af3.el7.x86_64 58/95 2019-11-28T11:23:23.690 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:libradosstriper1-15.0.0-7798.g6882af3.el7.x86_64 60/95 2019-11-28T11:23:23.839 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:python-rbd-15.0.0-7798.g6882af3.el7.x86_64 59/95 2019-11-28T11:23:23.962 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 61/95 2019-11-28T11:23:23.985 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:python-rbd-15.0.0-7798.g6882af3.el7.x86_64 59/95 2019-11-28T11:23:24.465 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-base-15.0.0-7798.g6882af3.el7.x86_64 62/95 2019-11-28T11:23:24.803 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 61/95 2019-11-28T11:23:24.943 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:libradosstriper1-15.0.0-7798.g6882af3.el7.x86_64 60/95 2019-11-28T11:23:25.251 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-base-15.0.0-7798.g6882af3.el7.x86_64 62/95 2019-11-28T11:23:25.913 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 61/95 2019-11-28T11:23:26.169 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:libradosstriper1-15.0.0-7798.g6882af3.el7.x86_64 60/95 2019-11-28T11:23:26.350 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-base-15.0.0-7798.g6882af3.el7.x86_64 62/95 2019-11-28T11:23:26.433 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:libradosstriper1-15.0.0-7798.g6882af3.el7.x86_64 60/95 2019-11-28T11:23:27.100 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 61/95 2019-11-28T11:23:27.421 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 61/95 2019-11-28T11:23:27.792 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-base-15.0.0-7798.g6882af3.el7.x86_64 62/95 2019-11-28T11:23:27.895 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-base-15.0.0-7798.g6882af3.el7.x86_64 62/95 2019-11-28T11:23:31.802 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-selinux-15.0.0-7798.g6882af3.el7.x86_64 63/95 2019-11-28T11:23:33.048 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-selinux-15.0.0-7798.g6882af3.el7.x86_64 63/95 2019-11-28T11:23:33.545 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-mon-15.0.0-7798.g6882af3.el7.x86_64 64/95 2019-11-28T11:23:33.870 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-selinux-15.0.0-7798.g6882af3.el7.x86_64 63/95 2019-11-28T11:23:34.036 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-osd-15.0.0-7798.g6882af3.el7.x86_64 65/95 2019-11-28T11:23:34.400 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-mds-15.0.0-7798.g6882af3.el7.x86_64 66/95 2019-11-28T11:23:34.739 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:librados-devel-15.0.0-7798.g6882af3.el7.x86_64 67/95 2019-11-28T11:23:34.829 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-mon-15.0.0-7798.g6882af3.el7.x86_64 64/95 2019-11-28T11:23:34.972 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-selinux-15.0.0-7798.g6882af3.el7.x86_64 63/95 2019-11-28T11:23:35.093 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libsepol-devel-2.5-10.el7.x86_64 68/95 2019-11-28T11:23:35.331 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-osd-15.0.0-7798.g6882af3.el7.x86_64 65/95 2019-11-28T11:23:35.368 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libselinux-devel-2.5-14.1.el7.x86_64 69/95 2019-11-28T11:23:35.649 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-mds-15.0.0-7798.g6882af3.el7.x86_64 66/95 2019-11-28T11:23:35.696 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 70/95 2019-11-28T11:23:35.947 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:librados-devel-15.0.0-7798.g6882af3.el7.x86_64 67/95 2019-11-28T11:23:36.158 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-routes-1.13-2.el7.noarch 71/95 2019-11-28T11:23:36.256 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-mon-15.0.0-7798.g6882af3.el7.x86_64 64/95 2019-11-28T11:23:36.278 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libsepol-devel-2.5-10.el7.x86_64 68/95 2019-11-28T11:23:36.316 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-selinux-15.0.0-7798.g6882af3.el7.x86_64 63/95 2019-11-28T11:23:36.521 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 72/95 2019-11-28T11:23:36.684 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libselinux-devel-2.5-14.1.el7.x86_64 69/95 2019-11-28T11:23:36.756 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-osd-15.0.0-7798.g6882af3.el7.x86_64 65/95 2019-11-28T11:23:36.759 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-mon-15.0.0-7798.g6882af3.el7.x86_64 64/95 2019-11-28T11:23:36.859 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 70/95 2019-11-28T11:23:36.925 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-mako-0.8.1-2.el7.noarch 73/95 2019-11-28T11:23:37.073 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-mds-15.0.0-7798.g6882af3.el7.x86_64 66/95 2019-11-28T11:23:37.173 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-routes-1.13-2.el7.noarch 71/95 2019-11-28T11:23:37.244 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-selinux-15.0.0-7798.g6882af3.el7.x86_64 63/95 2019-11-28T11:23:37.259 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-osd-15.0.0-7798.g6882af3.el7.x86_64 65/95 2019-11-28T11:23:37.423 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:librados-devel-15.0.0-7798.g6882af3.el7.x86_64 67/95 2019-11-28T11:23:37.492 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 74/95 2019-11-28T11:23:37.573 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 72/95 2019-11-28T11:23:37.608 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-mds-15.0.0-7798.g6882af3.el7.x86_64 66/95 2019-11-28T11:23:37.815 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libsepol-devel-2.5-10.el7.x86_64 68/95 2019-11-28T11:23:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 75/95 2019-11-28T11:23:37.923 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:librados-devel-15.0.0-7798.g6882af3.el7.x86_64 67/95 2019-11-28T11:23:37.997 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-mako-0.8.1-2.el7.noarch 73/95 2019-11-28T11:23:38.063 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-mon-15.0.0-7798.g6882af3.el7.x86_64 64/95 2019-11-28T11:23:38.110 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libselinux-devel-2.5-14.1.el7.x86_64 69/95 2019-11-28T11:23:38.178 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libverto-devel-0.2.5-4.el7.x86_64 76/95 2019-11-28T11:23:38.284 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libsepol-devel-2.5-10.el7.x86_64 68/95 2019-11-28T11:23:38.427 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 70/95 2019-11-28T11:23:38.570 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-osd-15.0.0-7798.g6882af3.el7.x86_64 65/95 2019-11-28T11:23:38.601 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libselinux-devel-2.5-14.1.el7.x86_64 69/95 2019-11-28T11:23:38.606 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 74/95 2019-11-28T11:23:38.759 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-routes-1.13-2.el7.noarch 71/95 2019-11-28T11:23:38.832 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : krb5-devel-1.15.1-37.el7_7.2.x86_64 77/95 2019-11-28T11:23:38.917 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-mds-15.0.0-7798.g6882af3.el7.x86_64 66/95 2019-11-28T11:23:38.919 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 70/95 2019-11-28T11:23:38.965 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 75/95 2019-11-28T11:23:39.084 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 72/95 2019-11-28T11:23:39.146 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-mon-15.0.0-7798.g6882af3.el7.x86_64 64/95 2019-11-28T11:23:39.185 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:librados-devel-15.0.0-7798.g6882af3.el7.x86_64 67/95 2019-11-28T11:23:39.198 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-routes-1.13-2.el7.noarch 71/95 2019-11-28T11:23:39.425 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libverto-devel-0.2.5-4.el7.x86_64 76/95 2019-11-28T11:23:39.509 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : libsepol-devel-2.5-10.el7.x86_64 68/95 2019-11-28T11:23:39.572 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 72/95 2019-11-28T11:23:39.717 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-mako-0.8.1-2.el7.noarch 73/95 2019-11-28T11:23:39.810 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : libselinux-devel-2.5-14.1.el7.x86_64 69/95 2019-11-28T11:23:39.865 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-osd-15.0.0-7798.g6882af3.el7.x86_64 65/95 2019-11-28T11:23:39.958 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-mako-0.8.1-2.el7.noarch 73/95 2019-11-28T11:23:40.083 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : krb5-devel-1.15.1-37.el7_7.2.x86_64 77/95 2019-11-28T11:23:40.145 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 70/95 2019-11-28T11:23:40.220 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-mds-15.0.0-7798.g6882af3.el7.x86_64 66/95 2019-11-28T11:23:40.312 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 74/95 2019-11-28T11:23:40.340 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 1:openssl-devel-1.0.2k-19.el7.x86_64 78/95 2019-11-28T11:23:40.457 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-routes-1.13-2.el7.noarch 71/95 2019-11-28T11:23:40.522 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 74/95 2019-11-28T11:23:40.623 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7 79/95 2019-11-28T11:23:40.652 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 75/95 2019-11-28T11:23:40.706 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:librados-devel-15.0.0-7798.g6882af3.el7.x86_64 67/95 2019-11-28T11:23:40.794 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 72/95 2019-11-28T11:23:40.875 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 75/95 2019-11-28T11:23:40.941 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libverto-devel-0.2.5-4.el7.x86_64 76/95 2019-11-28T11:23:41.117 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libsepol-devel-2.5-10.el7.x86_64 68/95 2019-11-28T11:23:41.182 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-mako-0.8.1-2.el7.noarch 73/95 2019-11-28T11:23:41.239 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 80/95 2019-11-28T11:23:41.365 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libverto-devel-0.2.5-4.el7.x86_64 76/95 2019-11-28T11:23:41.413 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libselinux-devel-2.5-14.1.el7.x86_64 69/95 2019-11-28T11:23:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 1:openssl-devel-1.0.2k-19.el7.x86_64 78/95 2019-11-28T11:23:41.641 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : krb5-devel-1.15.1-37.el7_7.2.x86_64 77/95 2019-11-28T11:23:41.746 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 70/95 2019-11-28T11:23:41.750 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 74/95 2019-11-28T11:23:41.869 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7 79/95 2019-11-28T11:23:42.042 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : krb5-devel-1.15.1-37.el7_7.2.x86_64 77/95 2019-11-28T11:23:42.092 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 75/95 2019-11-28T11:23:42.093 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-routes-1.13-2.el7.noarch 71/95 2019-11-28T11:23:42.163 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 80/95 2019-11-28T11:23:42.165 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 81/95 2019-11-28T11:23:42.365 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : libverto-devel-0.2.5-4.el7.x86_64 76/95 2019-11-28T11:23:42.480 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 72/95 2019-11-28T11:23:42.531 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 82/95 2019-11-28T11:23:42.814 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 83/95 2019-11-28T11:23:42.926 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-mako-0.8.1-2.el7.noarch 73/95 2019-11-28T11:23:43.055 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 81/95 2019-11-28T11:23:43.117 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7798.g6882af3.el7 84/95 2019-11-28T11:23:43.117 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 1:openssl-devel-1.0.2k-19.el7.x86_64 78/95 2019-11-28T11:23:43.209 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : krb5-devel-1.15.1-37.el7_7.2.x86_64 77/95 2019-11-28T11:23:43.437 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 82/95 2019-11-28T11:23:43.478 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7 79/95 2019-11-28T11:23:43.524 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 74/95 2019-11-28T11:23:43.569 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 1:openssl-devel-1.0.2k-19.el7.x86_64 78/95 2019-11-28T11:23:43.726 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 83/95 2019-11-28T11:23:43.791 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 80/95 2019-11-28T11:23:43.865 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 75/95 2019-11-28T11:23:43.884 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7 79/95 2019-11-28T11:23:43.974 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 85/95 2019-11-28T11:23:44.018 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7798.g6882af3.el7 84/95 2019-11-28T11:23:44.156 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 80/95 2019-11-28T11:23:44.158 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libverto-devel-0.2.5-4.el7.x86_64 76/95 2019-11-28T11:23:44.673 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 1:openssl-devel-1.0.2k-19.el7.x86_64 78/95 2019-11-28T11:23:44.720 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 81/95 2019-11-28T11:23:44.998 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7 79/95 2019-11-28T11:23:45.097 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 82/95 2019-11-28T11:23:45.119 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 81/95 2019-11-28T11:23:45.269 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 80/95 2019-11-28T11:23:45.410 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : krb5-devel-1.15.1-37.el7_7.2.x86_64 77/95 2019-11-28T11:23:45.427 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 83/95 2019-11-28T11:23:45.505 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 85/95 2019-11-28T11:23:45.530 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 82/95 2019-11-28T11:23:45.778 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7798.g6882af3.el7 84/95 2019-11-28T11:23:45.834 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 83/95 2019-11-28T11:23:46.201 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 81/95 2019-11-28T11:23:46.589 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 85/95 2019-11-28T11:23:46.589 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 82/95 2019-11-28T11:23:46.897 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 83/95 2019-11-28T11:23:47.111 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 1:openssl-devel-1.0.2k-19.el7.x86_64 78/95 2019-11-28T11:23:47.167 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7798.g6882af3.el7 84/95 2019-11-28T11:23:47.230 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7798.g6882af3.el7 84/95 2019-11-28T11:23:47.447 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7 79/95 2019-11-28T11:23:47.741 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 86/95 2019-11-28T11:23:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 80/95 2019-11-28T11:23:48.001 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 85/95 2019-11-28T11:23:48.011 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 87/95 2019-11-28T11:23:48.235 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 88/95 2019-11-28T11:23:48.534 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 85/95 2019-11-28T11:23:48.569 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:rbd-fuse-15.0.0-7798.g6882af3.el7.x86_64 89/95 2019-11-28T11:23:48.791 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 81/95 2019-11-28T11:23:48.875 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 90/95 2019-11-28T11:23:49.195 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 82/95 2019-11-28T11:23:49.226 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : elfutils-libelf-devel-0.176-2.el7.x86_64 91/95 2019-11-28T11:23:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 86/95 2019-11-28T11:23:49.554 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : bison-3.0.4-2.el7.x86_64 92/95 2019-11-28T11:23:49.807 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flex-2.5.37-6.el7.x86_64 93/95 2019-11-28T11:23:49.871 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 87/95 2019-11-28T11:23:50.061 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 94/95 2019-11-28T11:23:50.090 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 88/95 2019-11-28T11:23:50.115 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 83/95 2019-11-28T11:23:50.314 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 95/95 2019-11-28T11:23:50.381 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:rbd-fuse-15.0.0-7798.g6882af3.el7.x86_64 89/95 2019-11-28T11:23:50.400 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 86/95 2019-11-28T11:23:50.436 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/95 2019-11-28T11:23:50.470 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7798.g6882af3.el7 84/95 2019-11-28T11:23:50.553 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 2/95 2019-11-28T11:23:50.636 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 90/95 2019-11-28T11:23:50.683 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-routes-1.13-2.el7.noarch 3/95 2019-11-28T11:23:50.687 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 87/95 2019-11-28T11:23:50.796 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-mon-15.0.0-7798.g6882af3.el7.x86_64 4/95 2019-11-28T11:23:50.975 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 88/95 2019-11-28T11:23:51.015 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : elfutils-libelf-devel-0.176-2.el7.x86_64 91/95 2019-11-28T11:23:51.245 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:rbd-fuse-15.0.0-7798.g6882af3.el7.x86_64 89/95 2019-11-28T11:23:51.374 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 85/95 2019-11-28T11:23:51.391 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : bison-3.0.4-2.el7.x86_64 92/95 2019-11-28T11:23:51.576 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 90/95 2019-11-28T11:23:51.579 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 5/95 2019-11-28T11:23:51.647 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flex-2.5.37-6.el7.x86_64 93/95 2019-11-28T11:23:51.673 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 6/95 2019-11-28T11:23:51.764 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libverto-devel-0.2.5-4.el7.x86_64 7/95 2019-11-28T11:23:51.814 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 86/95 2019-11-28T11:23:51.864 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : zlib-devel-1.2.7-18.el7.x86_64 8/95 2019-11-28T11:23:51.903 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 94/95 2019-11-28T11:23:51.945 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : elfutils-libelf-devel-0.176-2.el7.x86_64 91/95 2019-11-28T11:23:51.976 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 9/95 2019-11-28T11:23:52.082 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : jq-1.5-1.el7.x86_64 10/95 2019-11-28T11:23:52.168 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 87/95 2019-11-28T11:23:52.186 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 11/95 2019-11-28T11:23:52.186 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 95/95 2019-11-28T11:23:52.289 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 12/95 2019-11-28T11:23:52.316 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : bison-3.0.4-2.el7.x86_64 92/95 2019-11-28T11:23:52.323 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 86/95 2019-11-28T11:23:52.338 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/95 2019-11-28T11:23:52.374 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 88/95 2019-11-28T11:23:52.425 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:librados-devel-15.0.0-7798.g6882af3.el7.x86_64 13/95 2019-11-28T11:23:52.473 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 2/95 2019-11-28T11:23:52.543 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 14/95 2019-11-28T11:23:52.579 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flex-2.5.37-6.el7.x86_64 93/95 2019-11-28T11:23:52.597 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-routes-1.13-2.el7.noarch 3/95 2019-11-28T11:23:52.668 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7 15/95 2019-11-28T11:23:52.693 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:rbd-fuse-15.0.0-7798.g6882af3.el7.x86_64 89/95 2019-11-28T11:23:52.715 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-mon-15.0.0-7798.g6882af3.el7.x86_64 4/95 2019-11-28T11:23:52.802 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libsepol-devel-2.5-10.el7.x86_64 16/95 2019-11-28T11:23:52.874 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 5/95 2019-11-28T11:23:52.889 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 94/95 2019-11-28T11:23:52.919 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-3.6.8-10.el7.x86_64 17/95 2019-11-28T11:23:52.956 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 90/95 2019-11-28T11:23:52.997 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 6/95 2019-11-28T11:23:53.036 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 18/95 2019-11-28T11:23:53.097 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libverto-devel-0.2.5-4.el7.x86_64 7/95 2019-11-28T11:23:53.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 19/95 2019-11-28T11:23:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : zlib-devel-1.2.7-18.el7.x86_64 8/95 2019-11-28T11:23:53.197 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 95/95 2019-11-28T11:23:53.237 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 87/95 2019-11-28T11:23:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 9/95 2019-11-28T11:23:53.279 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 20/95 2019-11-28T11:23:53.321 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/95 2019-11-28T11:23:53.329 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : elfutils-libelf-devel-0.176-2.el7.x86_64 91/95 2019-11-28T11:23:53.396 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 21/95 2019-11-28T11:23:53.401 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : jq-1.5-1.el7.x86_64 10/95 2019-11-28T11:23:53.421 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 2/95 2019-11-28T11:23:53.502 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 11/95 2019-11-28T11:23:53.513 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 22/95 2019-11-28T11:23:53.522 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-routes-1.13-2.el7.noarch 3/95 2019-11-28T11:23:53.600 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 88/95 2019-11-28T11:23:53.603 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 12/95 2019-11-28T11:23:53.605 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libselinux-devel-2.5-14.1.el7.x86_64 23/95 2019-11-28T11:23:53.605 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-mon-15.0.0-7798.g6882af3.el7.x86_64 4/95 2019-11-28T11:23:53.695 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:librados-devel-15.0.0-7798.g6882af3.el7.x86_64 13/95 2019-11-28T11:23:53.698 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 5/95 2019-11-28T11:23:53.705 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:librbd1-15.0.0-7798.g6882af3.el7.x86_64 24/95 2019-11-28T11:23:53.729 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : bison-3.0.4-2.el7.x86_64 92/95 2019-11-28T11:23:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 14/95 2019-11-28T11:23:53.806 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 25/95 2019-11-28T11:23:53.832 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 6/95 2019-11-28T11:23:53.856 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:rbd-fuse-15.0.0-7798.g6882af3.el7.x86_64 89/95 2019-11-28T11:23:53.915 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-osd-15.0.0-7798.g6882af3.el7.x86_64 26/95 2019-11-28T11:23:53.954 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7 15/95 2019-11-28T11:23:53.966 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libverto-devel-0.2.5-4.el7.x86_64 7/95 2019-11-28T11:23:54.001 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : flex-2.5.37-6.el7.x86_64 93/95 2019-11-28T11:23:54.016 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 27/95 2019-11-28T11:23:54.079 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libsepol-devel-2.5-10.el7.x86_64 16/95 2019-11-28T11:23:54.091 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : zlib-devel-1.2.7-18.el7.x86_64 8/95 2019-11-28T11:23:54.129 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 90/95 2019-11-28T11:23:54.133 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : keyutils-libs-devel-1.5.8-3.el7.x86_64 28/95 2019-11-28T11:23:54.209 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 9/95 2019-11-28T11:23:54.213 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-3.6.8-10.el7.x86_64 17/95 2019-11-28T11:23:54.234 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-daemon-15.0.0-7798.g6882af3.el7.x86_64 29/95 2019-11-28T11:23:54.261 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 94/95 2019-11-28T11:23:54.359 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 30/95 2019-11-28T11:23:54.459 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : elfutils-libelf-devel-0.176-2.el7.x86_64 91/95 2019-11-28T11:23:54.517 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 31/95 2019-11-28T11:23:54.536 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 95/95 2019-11-28T11:23:54.651 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 32/95 2019-11-28T11:23:54.668 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/95 2019-11-28T11:23:54.768 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 2/95 2019-11-28T11:23:54.769 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 33/95 2019-11-28T11:23:54.851 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : bison-3.0.4-2.el7.x86_64 92/95 2019-11-28T11:23:54.885 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 34/95 2019-11-28T11:23:54.894 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-routes-1.13-2.el7.noarch 3/95 2019-11-28T11:23:55.003 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 35/95 2019-11-28T11:23:55.019 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-mon-15.0.0-7798.g6882af3.el7.x86_64 4/95 2019-11-28T11:23:55.115 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 18/95 2019-11-28T11:23:55.136 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 36/95 2019-11-28T11:23:55.140 INFO:teuthology.orchestra.run.smithi075.stdout: Installing : flex-2.5.37-6.el7.x86_64 93/95 2019-11-28T11:23:55.145 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 5/95 2019-11-28T11:23:55.168 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : jq-1.5-1.el7.x86_64 10/95 2019-11-28T11:23:55.254 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 37/95 2019-11-28T11:23:55.265 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 19/95 2019-11-28T11:23:55.308 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 6/95 2019-11-28T11:23:55.319 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 11/95 2019-11-28T11:23:55.363 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 38/95 2019-11-28T11:23:55.376 INFO:teuthology.orchestra.run.smithi075.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 94/95 2019-11-28T11:23:55.390 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 20/95 2019-11-28T11:23:55.394 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 86/95 2019-11-28T11:23:55.430 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libverto-devel-0.2.5-4.el7.x86_64 7/95 2019-11-28T11:23:55.436 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 12/95 2019-11-28T11:23:55.458 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:python-cephfs-15.0.0-7798.g6882af3.el7.x86_64 39/95 2019-11-28T11:23:55.491 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 21/95 2019-11-28T11:23:55.520 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:librados-devel-15.0.0-7798.g6882af3.el7.x86_64 13/95 2019-11-28T11:23:55.549 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 40/95 2019-11-28T11:23:55.549 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : zlib-devel-1.2.7-18.el7.x86_64 8/95 2019-11-28T11:23:55.577 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 22/95 2019-11-28T11:23:55.612 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 14/95 2019-11-28T11:23:55.650 INFO:teuthology.orchestra.run.smithi075.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 95/95 2019-11-28T11:23:55.664 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 9/95 2019-11-28T11:23:55.672 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 41/95 2019-11-28T11:23:55.696 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7 15/95 2019-11-28T11:23:55.709 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libselinux-devel-2.5-14.1.el7.x86_64 23/95 2019-11-28T11:23:55.720 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 87/95 2019-11-28T11:23:55.764 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/95 2019-11-28T11:23:55.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 42/95 2019-11-28T11:23:55.790 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : jq-1.5-1.el7.x86_64 10/95 2019-11-28T11:23:55.809 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:librbd1-15.0.0-7798.g6882af3.el7.x86_64 24/95 2019-11-28T11:23:55.829 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libsepol-devel-2.5-10.el7.x86_64 16/95 2019-11-28T11:23:55.881 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 11/95 2019-11-28T11:23:55.889 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 2/95 2019-11-28T11:23:55.898 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 43/95 2019-11-28T11:23:55.913 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 25/95 2019-11-28T11:23:55.929 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-3.6.8-10.el7.x86_64 17/95 2019-11-28T11:23:55.954 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 88/95 2019-11-28T11:23:55.982 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 12/95 2019-11-28T11:23:56.007 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 44/95 2019-11-28T11:23:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-osd-15.0.0-7798.g6882af3.el7.x86_64 26/95 2019-11-28T11:23:56.015 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-routes-1.13-2.el7.noarch 3/95 2019-11-28T11:23:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 18/95 2019-11-28T11:23:56.074 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:librados-devel-15.0.0-7798.g6882af3.el7.x86_64 13/95 2019-11-28T11:23:56.119 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 27/95 2019-11-28T11:23:56.130 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 19/95 2019-11-28T11:23:56.141 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-mon-15.0.0-7798.g6882af3.el7.x86_64 4/95 2019-11-28T11:23:56.167 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 14/95 2019-11-28T11:23:56.217 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:rbd-fuse-15.0.0-7798.g6882af3.el7.x86_64 89/95 2019-11-28T11:23:56.222 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 20/95 2019-11-28T11:23:56.268 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 5/95 2019-11-28T11:23:56.269 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : keyutils-libs-devel-1.5.8-3.el7.x86_64 28/95 2019-11-28T11:23:56.300 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7 15/95 2019-11-28T11:23:56.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 21/95 2019-11-28T11:23:56.378 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-daemon-15.0.0-7798.g6882af3.el7.x86_64 29/95 2019-11-28T11:23:56.393 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libsepol-devel-2.5-10.el7.x86_64 16/95 2019-11-28T11:23:56.400 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 6/95 2019-11-28T11:23:56.498 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 22/95 2019-11-28T11:23:56.504 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 30/95 2019-11-28T11:23:56.517 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : libverto-devel-0.2.5-4.el7.x86_64 7/95 2019-11-28T11:23:56.624 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libselinux-devel-2.5-14.1.el7.x86_64 23/95 2019-11-28T11:23:56.643 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : zlib-devel-1.2.7-18.el7.x86_64 8/95 2019-11-28T11:23:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 31/95 2019-11-28T11:23:56.687 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 90/95 2019-11-28T11:23:56.735 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 9/95 2019-11-28T11:23:56.758 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:librbd1-15.0.0-7798.g6882af3.el7.x86_64 24/95 2019-11-28T11:23:56.822 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 32/95 2019-11-28T11:23:56.827 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 45/95 2019-11-28T11:23:56.827 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : jq-1.5-1.el7.x86_64 10/95 2019-11-28T11:23:56.908 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 25/95 2019-11-28T11:23:56.911 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 11/95 2019-11-28T11:23:56.953 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 46/95 2019-11-28T11:23:56.955 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 33/95 2019-11-28T11:23:57.012 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 12/95 2019-11-28T11:23:57.034 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-osd-15.0.0-7798.g6882af3.el7.x86_64 26/95 2019-11-28T11:23:57.064 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : elfutils-libelf-devel-0.176-2.el7.x86_64 91/95 2019-11-28T11:23:57.070 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcom_err-devel-1.42.9-16.el7.x86_64 47/95 2019-11-28T11:23:57.081 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 34/95 2019-11-28T11:23:57.112 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:librados-devel-15.0.0-7798.g6882af3.el7.x86_64 13/95 2019-11-28T11:23:57.159 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 27/95 2019-11-28T11:23:57.195 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 48/95 2019-11-28T11:23:57.206 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 35/95 2019-11-28T11:23:57.212 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 14/95 2019-11-28T11:23:57.277 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : keyutils-libs-devel-1.5.8-3.el7.x86_64 28/95 2019-11-28T11:23:57.287 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 49/95 2019-11-28T11:23:57.313 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7 15/95 2019-11-28T11:23:57.349 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 36/95 2019-11-28T11:23:57.372 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pcre-devel-8.32-17.el7.x86_64 50/95 2019-11-28T11:23:57.410 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-daemon-15.0.0-7798.g6882af3.el7.x86_64 29/95 2019-11-28T11:23:57.429 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-3.6.8-10.el7.x86_64 17/95 2019-11-28T11:23:57.430 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : libsepol-devel-2.5-10.el7.x86_64 16/95 2019-11-28T11:23:57.442 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : bison-3.0.4-2.el7.x86_64 92/95 2019-11-28T11:23:57.449 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 37/95 2019-11-28T11:23:57.455 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 51/95 2019-11-28T11:23:57.502 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 30/95 2019-11-28T11:23:57.533 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 38/95 2019-11-28T11:23:57.539 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 52/95 2019-11-28T11:23:57.546 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 18/95 2019-11-28T11:23:57.556 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python3-3.6.8-10.el7.x86_64 17/95 2019-11-28T11:23:57.588 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 31/95 2019-11-28T11:23:57.617 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:python-cephfs-15.0.0-7798.g6882af3.el7.x86_64 39/95 2019-11-28T11:23:57.640 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 53/95 2019-11-28T11:23:57.678 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 32/95 2019-11-28T11:23:57.681 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 18/95 2019-11-28T11:23:57.707 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 19/95 2019-11-28T11:23:57.709 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 40/95 2019-11-28T11:23:57.740 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 54/95 2019-11-28T11:23:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flex-2.5.37-6.el7.x86_64 93/95 2019-11-28T11:23:57.770 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 33/95 2019-11-28T11:23:57.806 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 20/95 2019-11-28T11:23:57.807 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 19/95 2019-11-28T11:23:57.840 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-base-15.0.0-7798.g6882af3.el7.x86_64 55/95 2019-11-28T11:23:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 41/95 2019-11-28T11:23:57.896 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 34/95 2019-11-28T11:23:57.898 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 21/95 2019-11-28T11:23:57.962 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 42/95 2019-11-28T11:23:57.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 35/95 2019-11-28T11:23:57.990 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 22/95 2019-11-28T11:23:57.999 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 56/95 2019-11-28T11:23:58.022 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 94/95 2019-11-28T11:23:58.069 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 43/95 2019-11-28T11:23:58.081 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 36/95 2019-11-28T11:23:58.082 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libselinux-devel-2.5-14.1.el7.x86_64 23/95 2019-11-28T11:23:58.112 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 57/95 2019-11-28T11:23:58.178 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 44/95 2019-11-28T11:23:58.189 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 37/95 2019-11-28T11:23:58.225 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:librbd1-15.0.0-7798.g6882af3.el7.x86_64 24/95 2019-11-28T11:23:58.234 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flex-2.5.37-6.el7.x86_64 58/95 2019-11-28T11:23:58.302 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 95/95 2019-11-28T11:23:58.310 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 45/95 2019-11-28T11:23:58.328 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 25/95 2019-11-28T11:23:58.349 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 38/95 2019-11-28T11:23:58.351 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 59/95 2019-11-28T11:23:58.417 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-osd-15.0.0-7798.g6882af3.el7.x86_64 26/95 2019-11-28T11:23:58.430 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/95 2019-11-28T11:23:58.468 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-mds-15.0.0-7798.g6882af3.el7.x86_64 60/95 2019-11-28T11:23:58.474 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:python-cephfs-15.0.0-7798.g6882af3.el7.x86_64 39/95 2019-11-28T11:23:58.487 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 46/95 2019-11-28T11:23:58.518 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 27/95 2019-11-28T11:23:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 2/95 2019-11-28T11:23:58.568 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:libcephfs2-15.0.0-7798.g6882af3.el7.x86_64 61/95 2019-11-28T11:23:58.599 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 40/95 2019-11-28T11:23:58.621 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcom_err-devel-1.42.9-16.el7.x86_64 47/95 2019-11-28T11:23:58.643 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : keyutils-libs-devel-1.5.8-3.el7.x86_64 28/95 2019-11-28T11:23:58.686 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 62/95 2019-11-28T11:23:58.704 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-routes-1.13-2.el7.noarch 3/95 2019-11-28T11:23:58.726 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 41/95 2019-11-28T11:23:58.744 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 20/95 2019-11-28T11:23:58.763 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 48/95 2019-11-28T11:23:58.794 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 63/95 2019-11-28T11:23:58.802 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-daemon-15.0.0-7798.g6882af3.el7.x86_64 29/95 2019-11-28T11:23:58.817 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-mon-15.0.0-7798.g6882af3.el7.x86_64 4/95 2019-11-28T11:23:58.836 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 21/95 2019-11-28T11:23:58.876 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 42/95 2019-11-28T11:23:58.910 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 49/95 2019-11-28T11:23:58.922 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 64/95 2019-11-28T11:23:58.928 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 30/95 2019-11-28T11:23:58.933 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 5/95 2019-11-28T11:23:58.936 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 22/95 2019-11-28T11:23:58.994 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 43/95 2019-11-28T11:23:59.023 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : pcre-devel-8.32-17.el7.x86_64 50/95 2019-11-28T11:23:59.029 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 65/95 2019-11-28T11:23:59.037 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : libselinux-devel-2.5-14.1.el7.x86_64 23/95 2019-11-28T11:23:59.053 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 31/95 2019-11-28T11:23:59.058 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 6/95 2019-11-28T11:23:59.110 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 44/95 2019-11-28T11:23:59.121 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : krb5-devel-1.15.1-37.el7_7.2.x86_64 66/95 2019-11-28T11:23:59.129 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:librbd1-15.0.0-7798.g6882af3.el7.x86_64 24/95 2019-11-28T11:23:59.140 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 51/95 2019-11-28T11:23:59.151 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libverto-devel-0.2.5-4.el7.x86_64 7/95 2019-11-28T11:23:59.179 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 32/95 2019-11-28T11:23:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 45/95 2019-11-28T11:23:59.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 67/95 2019-11-28T11:23:59.238 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 52/95 2019-11-28T11:23:59.239 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 25/95 2019-11-28T11:23:59.256 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : zlib-devel-1.2.7-18.el7.x86_64 8/95 2019-11-28T11:23:59.288 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7798.g6882af3.el7.noarc 68/95 2019-11-28T11:23:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 53/95 2019-11-28T11:23:59.336 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 46/95 2019-11-28T11:23:59.337 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 33/95 2019-11-28T11:23:59.338 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-osd-15.0.0-7798.g6882af3.el7.x86_64 26/95 2019-11-28T11:23:59.376 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 9/95 2019-11-28T11:23:59.389 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 69/95 2019-11-28T11:23:59.436 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcom_err-devel-1.42.9-16.el7.x86_64 47/95 2019-11-28T11:23:59.457 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 34/95 2019-11-28T11:23:59.465 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 27/95 2019-11-28T11:23:59.478 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : jq-1.5-1.el7.x86_64 10/95 2019-11-28T11:23:59.481 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-selinux-15.0.0-7798.g6882af3.el7.x86_64 70/95 2019-11-28T11:23:59.538 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 48/95 2019-11-28T11:23:59.553 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 54/95 2019-11-28T11:23:59.555 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 35/95 2019-11-28T11:23:59.577 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 11/95 2019-11-28T11:23:59.598 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : keyutils-libs-devel-1.5.8-3.el7.x86_64 28/95 2019-11-28T11:23:59.599 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 71/95 2019-11-28T11:23:59.630 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 49/95 2019-11-28T11:23:59.644 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-base-15.0.0-7798.g6882af3.el7.x86_64 55/95 2019-11-28T11:23:59.648 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 36/95 2019-11-28T11:23:59.699 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 72/95 2019-11-28T11:23:59.723 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-daemon-15.0.0-7798.g6882af3.el7.x86_64 29/95 2019-11-28T11:23:59.752 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 37/95 2019-11-28T11:23:59.770 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 56/95 2019-11-28T11:23:59.816 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 73/95 2019-11-28T11:23:59.874 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 30/95 2019-11-28T11:23:59.874 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 38/95 2019-11-28T11:23:59.912 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 57/95 2019-11-28T11:23:59.942 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 74/95 2019-11-28T11:23:59.949 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pcre-devel-8.32-17.el7.x86_64 50/95 2019-11-28T11:23:59.975 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:python-cephfs-15.0.0-7798.g6882af3.el7.x86_64 39/95 2019-11-28T11:24:00.011 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 31/95 2019-11-28T11:24:00.042 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:libradosstriper1-15.0.0-7798.g6882af3.el7.x86_64 75/95 2019-11-28T11:24:00.072 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flex-2.5.37-6.el7.x86_64 58/95 2019-11-28T11:24:00.075 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 51/95 2019-11-28T11:24:00.076 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 40/95 2019-11-28T11:24:00.128 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 32/95 2019-11-28T11:24:00.176 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 41/95 2019-11-28T11:24:00.176 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 76/95 2019-11-28T11:24:00.200 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 52/95 2019-11-28T11:24:00.205 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 59/95 2019-11-28T11:24:00.226 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 33/95 2019-11-28T11:24:00.293 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 42/95 2019-11-28T11:24:00.293 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:python-rbd-15.0.0-7798.g6882af3.el7.x86_64 77/95 2019-11-28T11:24:00.318 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 34/95 2019-11-28T11:24:00.330 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-mds-15.0.0-7798.g6882af3.el7.x86_64 60/95 2019-11-28T11:24:00.339 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 12/95 2019-11-28T11:24:00.352 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 53/95 2019-11-28T11:24:00.410 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7798.g6882af3.el7.x86_64 78/95 2019-11-28T11:24:00.418 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 35/95 2019-11-28T11:24:00.439 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:libcephfs2-15.0.0-7798.g6882af3.el7.x86_64 61/95 2019-11-28T11:24:00.452 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 43/95 2019-11-28T11:24:00.457 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:librados-devel-15.0.0-7798.g6882af3.el7.x86_64 13/95 2019-11-28T11:24:00.477 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 54/95 2019-11-28T11:24:00.511 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 36/95 2019-11-28T11:24:00.519 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:rbd-fuse-15.0.0-7798.g6882af3.el7.x86_64 79/95 2019-11-28T11:24:00.564 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-base-15.0.0-7798.g6882af3.el7.x86_64 55/95 2019-11-28T11:24:00.582 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 62/95 2019-11-28T11:24:00.582 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 14/95 2019-11-28T11:24:00.588 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 44/95 2019-11-28T11:24:00.611 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 37/95 2019-11-28T11:24:00.620 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:librgw2-15.0.0-7798.g6882af3.el7.x86_64 80/95 2019-11-28T11:24:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 56/95 2019-11-28T11:24:00.690 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 63/95 2019-11-28T11:24:00.711 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 45/95 2019-11-28T11:24:00.712 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 38/95 2019-11-28T11:24:00.712 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:python-rados-15.0.0-7798.g6882af3.el7.x86_64 81/95 2019-11-28T11:24:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7798.g6882af3.el7 15/95 2019-11-28T11:24:00.728 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 57/95 2019-11-28T11:24:00.783 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 64/95 2019-11-28T11:24:00.804 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:python-cephfs-15.0.0-7798.g6882af3.el7.x86_64 39/95 2019-11-28T11:24:00.804 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-devel-0.176-2.el7.x86_64 82/95 2019-11-28T11:24:00.808 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libsepol-devel-2.5-10.el7.x86_64 16/95 2019-11-28T11:24:00.845 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flex-2.5.37-6.el7.x86_64 58/95 2019-11-28T11:24:00.845 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 46/95 2019-11-28T11:24:00.884 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 65/95 2019-11-28T11:24:00.896 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 83/95 2019-11-28T11:24:00.909 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-3.6.8-10.el7.x86_64 17/95 2019-11-28T11:24:00.909 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 40/95 2019-11-28T11:24:00.945 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 59/95 2019-11-28T11:24:00.980 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:python-rgw-15.0.0-7798.g6882af3.el7.x86_64 84/95 2019-11-28T11:24:00.992 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : krb5-devel-1.15.1-37.el7_7.2.x86_64 66/95 2019-11-28T11:24:00.995 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcom_err-devel-1.42.9-16.el7.x86_64 47/95 2019-11-28T11:24:01.032 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 41/95 2019-11-28T11:24:01.039 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-test-15.0.0-7798.g6882af3.el7.x86_64 18/95 2019-11-28T11:24:01.045 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-mds-15.0.0-7798.g6882af3.el7.x86_64 60/95 2019-11-28T11:24:01.073 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:python-ceph-common-15.0.0-7798.g6882af3.el7.x86_64 85/95 2019-11-28T11:24:01.113 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 48/95 2019-11-28T11:24:01.129 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:libcephfs2-15.0.0-7798.g6882af3.el7.x86_64 61/95 2019-11-28T11:24:01.142 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 67/95 2019-11-28T11:24:01.143 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 19/95 2019-11-28T11:24:01.155 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 42/95 2019-11-28T11:24:01.199 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 86/95 2019-11-28T11:24:01.231 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 62/95 2019-11-28T11:24:01.231 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 49/95 2019-11-28T11:24:01.237 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 20/95 2019-11-28T11:24:01.243 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7798.g6882af3.el7.noarc 68/95 2019-11-28T11:24:01.282 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 43/95 2019-11-28T11:24:01.317 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : pcre-devel-8.32-17.el7.x86_64 50/95 2019-11-28T11:24:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:python-ceph-compat-15.0.0-7798.g6882af3.el7.x86_64 21/95 2019-11-28T11:24:01.348 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : bison-3.0.4-2.el7.x86_64 87/95 2019-11-28T11:24:01.358 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 69/95 2019-11-28T11:24:01.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 63/95 2019-11-28T11:24:01.398 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 51/95 2019-11-28T11:24:01.440 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 44/95 2019-11-28T11:24:01.461 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-selinux-15.0.0-7798.g6882af3.el7.x86_64 70/95 2019-11-28T11:24:01.465 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 88/95 2019-11-28T11:24:01.486 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 22/95 2019-11-28T11:24:01.498 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 64/95 2019-11-28T11:24:01.533 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 52/95 2019-11-28T11:24:01.565 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 45/95 2019-11-28T11:24:01.574 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 89/95 2019-11-28T11:24:01.586 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 71/95 2019-11-28T11:24:01.587 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libselinux-devel-2.5-14.1.el7.x86_64 23/95 2019-11-28T11:24:01.624 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 53/95 2019-11-28T11:24:01.632 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 65/95 2019-11-28T11:24:01.701 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 46/95 2019-11-28T11:24:01.701 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 1:openssl-devel-1.0.2k-19.el7.x86_64 90/95 2019-11-28T11:24:01.725 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 54/95 2019-11-28T11:24:01.737 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:librbd1-15.0.0-7798.g6882af3.el7.x86_64 24/95 2019-11-28T11:24:01.765 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : krb5-devel-1.15.1-37.el7_7.2.x86_64 66/95 2019-11-28T11:24:01.770 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 72/95 2019-11-28T11:24:01.800 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : libcom_err-devel-1.42.9-16.el7.x86_64 47/95 2019-11-28T11:24:01.825 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-base-15.0.0-7798.g6882af3.el7.x86_64 55/95 2019-11-28T11:24:01.826 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7798.g6882af3.el7 91/95 2019-11-28T11:24:01.877 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 25/95 2019-11-28T11:24:01.901 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 48/95 2019-11-28T11:24:01.904 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 73/95 2019-11-28T11:24:01.925 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 67/95 2019-11-28T11:24:01.942 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 56/95 2019-11-28T11:24:01.943 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 92/95 2019-11-28T11:24:01.980 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-osd-15.0.0-7798.g6882af3.el7.x86_64 26/95 2019-11-28T11:24:02.002 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 49/95 2019-11-28T11:24:02.038 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 74/95 2019-11-28T11:24:02.050 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7798.g6882af3.el7.noarc 68/95 2019-11-28T11:24:02.060 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 93/95 2019-11-28T11:24:02.060 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 94/95 2019-11-28T11:24:02.095 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : pcre-devel-8.32-17.el7.x86_64 50/95 2019-11-28T11:24:02.101 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 57/95 2019-11-28T11:24:02.122 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 27/95 2019-11-28T11:24:02.147 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:libradosstriper1-15.0.0-7798.g6882af3.el7.x86_64 75/95 2019-11-28T11:24:02.167 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 69/95 2019-11-28T11:24:02.177 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 51/95 2019-11-28T11:24:02.227 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : flex-2.5.37-6.el7.x86_64 58/95 2019-11-28T11:24:02.239 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : keyutils-libs-devel-1.5.8-3.el7.x86_64 28/95 2019-11-28T11:24:02.287 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-selinux-15.0.0-7798.g6882af3.el7.x86_64 70/95 2019-11-28T11:24:02.287 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 52/95 2019-11-28T11:24:02.297 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 76/95 2019-11-28T11:24:02.352 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 59/95 2019-11-28T11:24:02.370 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 53/95 2019-11-28T11:24:02.382 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-daemon-15.0.0-7798.g6882af3.el7.x86_64 29/95 2019-11-28T11:24:02.416 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:python-rbd-15.0.0-7798.g6882af3.el7.x86_64 77/95 2019-11-28T11:24:02.418 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 71/95 2019-11-28T11:24:02.431 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 95/95 2019-11-28T11:24:02.431 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-28T11:24:02.432 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2019-11-28T11:24:02.432 INFO:teuthology.orchestra.run.smithi174.stdout: bison.x86_64 0:3.0.4-2.el7 2019-11-28T11:24:02.433 INFO:teuthology.orchestra.run.smithi174.stdout: ceph.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.433 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-daemon.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.433 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.433 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.433 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.433 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.434 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.434 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.434 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.434 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.434 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.434 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel.x86_64 0:0.176-2.el7 2019-11-28T11:24:02.434 INFO:teuthology.orchestra.run.smithi174.stdout: flex.x86_64 0:2.5.37-6.el7 2019-11-28T11:24:02.435 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.435 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.435 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel.x86_64 1:1.0.2k-19.el7 2019-11-28T11:24:02.435 INFO:teuthology.orchestra.run.smithi174.stdout: python-ceph-compat.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.435 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.435 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-28T11:24:02.436 INFO:teuthology.orchestra.run.smithi174.stdout:Dependency Installed: 2019-11-28T11:24:02.436 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.436 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.436 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.437 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.437 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.437 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.437 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.437 INFO:teuthology.orchestra.run.smithi174.stdout: jq.x86_64 0:1.5-1.el7 2019-11-28T11:24:02.437 INFO:teuthology.orchestra.run.smithi174.stdout: keyutils-libs-devel.x86_64 0:1.5.8-3.el7 2019-11-28T11:24:02.437 INFO:teuthology.orchestra.run.smithi174.stdout: krb5-devel.x86_64 0:1.15.1-37.el7_7.2 2019-11-28T11:24:02.438 INFO:teuthology.orchestra.run.smithi174.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-28T11:24:02.438 INFO:teuthology.orchestra.run.smithi174.stdout: libcom_err-devel.x86_64 0:1.42.9-16.el7 2019-11-28T11:24:02.438 INFO:teuthology.orchestra.run.smithi174.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-28T11:24:02.438 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-28T11:24:02.438 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.438 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.439 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-28T11:24:02.439 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.439 INFO:teuthology.orchestra.run.smithi174.stdout: libselinux-devel.x86_64 0:2.5-14.1.el7 2019-11-28T11:24:02.439 INFO:teuthology.orchestra.run.smithi174.stdout: libsepol-devel.x86_64 0:2.5-10.el7 2019-11-28T11:24:02.440 INFO:teuthology.orchestra.run.smithi174.stdout: libverto-devel.x86_64 0:0.2.5-4.el7 2019-11-28T11:24:02.440 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-28T11:24:02.440 INFO:teuthology.orchestra.run.smithi174.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 2019-11-28T11:24:02.440 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma.x86_64 0:5.9.5-3.el7 2019-11-28T11:24:02.440 INFO:teuthology.orchestra.run.smithi174.stdout: pcre-devel.x86_64 0:8.32-17.el7 2019-11-28T11:24:02.441 INFO:teuthology.orchestra.run.smithi174.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-28T11:24:02.441 INFO:teuthology.orchestra.run.smithi174.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-28T11:24:02.441 INFO:teuthology.orchestra.run.smithi174.stdout: python-ceph-argparse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.441 INFO:teuthology.orchestra.run.smithi174.stdout: python-ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.441 INFO:teuthology.orchestra.run.smithi174.stdout: python-cephfs.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.441 INFO:teuthology.orchestra.run.smithi174.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-28T11:24:02.442 INFO:teuthology.orchestra.run.smithi174.stdout: python-execnet.noarch 0:1.2.0-7.el7 2019-11-28T11:24:02.442 INFO:teuthology.orchestra.run.smithi174.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-28T11:24:02.442 INFO:teuthology.orchestra.run.smithi174.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-28T11:24:02.442 INFO:teuthology.orchestra.run.smithi174.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-28T11:24:02.442 INFO:teuthology.orchestra.run.smithi174.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-28T11:24:02.442 INFO:teuthology.orchestra.run.smithi174.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-28T11:24:02.442 INFO:teuthology.orchestra.run.smithi174.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-28T11:24:02.443 INFO:teuthology.orchestra.run.smithi174.stdout: python-rados.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.443 INFO:teuthology.orchestra.run.smithi174.stdout: python-rbd.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.443 INFO:teuthology.orchestra.run.smithi174.stdout: python-remoto.noarch 0:0.0.25-1.el7 2019-11-28T11:24:02.443 INFO:teuthology.orchestra.run.smithi174.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-28T11:24:02.443 INFO:teuthology.orchestra.run.smithi174.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-28T11:24:02.443 INFO:teuthology.orchestra.run.smithi174.stdout: python-rgw.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.444 INFO:teuthology.orchestra.run.smithi174.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-28T11:24:02.444 INFO:teuthology.orchestra.run.smithi174.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-28T11:24:02.444 INFO:teuthology.orchestra.run.smithi174.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-28T11:24:02.444 INFO:teuthology.orchestra.run.smithi174.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-28T11:24:02.444 INFO:teuthology.orchestra.run.smithi174.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-28T11:24:02.444 INFO:teuthology.orchestra.run.smithi174.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-28T11:24:02.445 INFO:teuthology.orchestra.run.smithi174.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-28T11:24:02.445 INFO:teuthology.orchestra.run.smithi174.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-28T11:24:02.445 INFO:teuthology.orchestra.run.smithi174.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-28T11:24:02.445 INFO:teuthology.orchestra.run.smithi174.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-28T11:24:02.445 INFO:teuthology.orchestra.run.smithi174.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-28T11:24:02.445 INFO:teuthology.orchestra.run.smithi174.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-28T11:24:02.445 INFO:teuthology.orchestra.run.smithi174.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-28T11:24:02.446 INFO:teuthology.orchestra.run.smithi174.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-28T11:24:02.446 INFO:teuthology.orchestra.run.smithi174.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-28T11:24:02.446 INFO:teuthology.orchestra.run.smithi174.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-28T11:24:02.447 INFO:teuthology.orchestra.run.smithi174.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-28T11:24:02.447 INFO:teuthology.orchestra.run.smithi174.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-28T11:24:02.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3.x86_64 0:3.6.8-10.el7 2019-11-28T11:24:02.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-libs.x86_64 0:3.6.8-10.el7 2019-11-28T11:24:02.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pip.noarch 0:9.0.3-5.el7 2019-11-28T11:24:02.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-28T11:24:02.448 INFO:teuthology.orchestra.run.smithi174.stdout: scipy.x86_64 0:0.12.1-6.el7 2019-11-28T11:24:02.448 INFO:teuthology.orchestra.run.smithi174.stdout: socat.x86_64 0:1.7.3.2-2.el7 2019-11-28T11:24:02.449 INFO:teuthology.orchestra.run.smithi174.stdout: suitesparse.x86_64 0:4.0.2-10.el7 2019-11-28T11:24:02.451 INFO:teuthology.orchestra.run.smithi174.stdout: tbb.x86_64 0:4.1-9.20130314.el7 2019-11-28T11:24:02.451 INFO:teuthology.orchestra.run.smithi174.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-28T11:24:02.451 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel.x86_64 0:1.2.7-18.el7 2019-11-28T11:24:02.451 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-28T11:24:02.451 INFO:teuthology.orchestra.run.smithi174.stdout:Updated: 2019-11-28T11:24:02.451 INFO:teuthology.orchestra.run.smithi174.stdout: librados2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.452 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:02.452 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-28T11:24:02.452 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2019-11-28T11:24:02.476 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 54/95 2019-11-28T11:24:02.485 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-mds-15.0.0-7798.g6882af3.el7.x86_64 60/95 2019-11-28T11:24:02.507 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7798.g6882af3.el7.x86_64 78/95 2019-11-28T11:24:02.507 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7798.g6882af3.el7.noarch 30/95 2019-11-28T11:24:02.510 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 72/95 2019-11-28T11:24:02.588 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-base-15.0.0-7798.g6882af3.el7.x86_64 55/95 2019-11-28T11:24:02.590 DEBUG:teuthology.parallel:result is None 2019-11-28T11:24:02.591 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 31/95 2019-11-28T11:24:02.591 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:rbd-fuse-15.0.0-7798.g6882af3.el7.x86_64 79/95 2019-11-28T11:24:02.602 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 73/95 2019-11-28T11:24:02.629 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:libcephfs2-15.0.0-7798.g6882af3.el7.x86_64 61/95 2019-11-28T11:24:02.683 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 32/95 2019-11-28T11:24:02.703 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 74/95 2019-11-28T11:24:02.713 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 56/95 2019-11-28T11:24:02.724 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:librgw2-15.0.0-7798.g6882af3.el7.x86_64 80/95 2019-11-28T11:24:02.757 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 62/95 2019-11-28T11:24:02.797 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:libradosstriper1-15.0.0-7798.g6882af3.el7.x86_64 75/95 2019-11-28T11:24:02.825 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-mgr-15.0.0-7798.g6882af3.el7.x86_64 33/95 2019-11-28T11:24:02.835 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:python-rados-15.0.0-7798.g6882af3.el7.x86_64 81/95 2019-11-28T11:24:02.864 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 57/95 2019-11-28T11:24:02.877 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 63/95 2019-11-28T11:24:02.909 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 34/95 2019-11-28T11:24:02.937 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 76/95 2019-11-28T11:24:02.942 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libelf-devel-0.176-2.el7.x86_64 82/95 2019-11-28T11:24:02.973 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 64/95 2019-11-28T11:24:02.993 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : flex-2.5.37-6.el7.x86_64 58/95 2019-11-28T11:24:03.020 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 35/95 2019-11-28T11:24:03.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:python-rbd-15.0.0-7798.g6882af3.el7.x86_64 77/95 2019-11-28T11:24:03.051 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 83/95 2019-11-28T11:24:03.080 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 65/95 2019-11-28T11:24:03.120 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 59/95 2019-11-28T11:24:03.141 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7798.g6882af3.el7.x86_64 78/95 2019-11-28T11:24:03.157 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:python-rgw-15.0.0-7798.g6882af3.el7.x86_64 84/95 2019-11-28T11:24:03.158 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-15.0.0-7798.g6882af3.el7.x86_64 36/95 2019-11-28T11:24:03.174 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : krb5-devel-1.15.1-37.el7_7.2.x86_64 66/95 2019-11-28T11:24:03.241 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-mds-15.0.0-7798.g6882af3.el7.x86_64 60/95 2019-11-28T11:24:03.244 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7798.g6882af3.el7.noarch 37/95 2019-11-28T11:24:03.264 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:rbd-fuse-15.0.0-7798.g6882af3.el7.x86_64 79/95 2019-11-28T11:24:03.274 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 67/95 2019-11-28T11:24:03.285 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:python-ceph-common-15.0.0-7798.g6882af3.el7.x86_64 85/95 2019-11-28T11:24:03.353 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 38/95 2019-11-28T11:24:03.374 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7798.g6882af3.el7.noarc 68/95 2019-11-28T11:24:03.374 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:libcephfs2-15.0.0-7798.g6882af3.el7.x86_64 61/95 2019-11-28T11:24:03.410 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 86/95 2019-11-28T11:24:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:librgw2-15.0.0-7798.g6882af3.el7.x86_64 80/95 2019-11-28T11:24:03.466 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 69/95 2019-11-28T11:24:03.475 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 62/95 2019-11-28T11:24:03.496 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:python-cephfs-15.0.0-7798.g6882af3.el7.x86_64 39/95 2019-11-28T11:24:03.544 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : bison-3.0.4-2.el7.x86_64 87/95 2019-11-28T11:24:03.548 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:python-rados-15.0.0-7798.g6882af3.el7.x86_64 81/95 2019-11-28T11:24:03.567 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-selinux-15.0.0-7798.g6882af3.el7.x86_64 70/95 2019-11-28T11:24:03.575 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 63/95 2019-11-28T11:24:03.615 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 40/95 2019-11-28T11:24:03.668 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 64/95 2019-11-28T11:24:03.673 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-devel-0.176-2.el7.x86_64 82/95 2019-11-28T11:24:03.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 88/95 2019-11-28T11:24:03.709 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 71/95 2019-11-28T11:24:03.761 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 65/95 2019-11-28T11:24:03.763 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 41/95 2019-11-28T11:24:03.799 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 83/95 2019-11-28T11:24:03.834 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 72/95 2019-11-28T11:24:03.845 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 89/95 2019-11-28T11:24:03.862 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : krb5-devel-1.15.1-37.el7_7.2.x86_64 66/95 2019-11-28T11:24:03.881 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 42/95 2019-11-28T11:24:03.950 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:python-rgw-15.0.0-7798.g6882af3.el7.x86_64 84/95 2019-11-28T11:24:03.953 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 67/95 2019-11-28T11:24:03.968 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 73/95 2019-11-28T11:24:03.980 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 1:openssl-devel-1.0.2k-19.el7.x86_64 90/95 2019-11-28T11:24:03.998 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 43/95 2019-11-28T11:24:04.053 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7798.g6882af3.el7.noarc 68/95 2019-11-28T11:24:04.067 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:python-ceph-common-15.0.0-7798.g6882af3.el7.x86_64 85/95 2019-11-28T11:24:04.094 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 74/95 2019-11-28T11:24:04.109 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7798.g6882af3.el7 91/95 2019-11-28T11:24:04.137 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 69/95 2019-11-28T11:24:04.148 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 44/95 2019-11-28T11:24:04.176 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 86/95 2019-11-28T11:24:04.229 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 92/95 2019-11-28T11:24:04.246 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:libradosstriper1-15.0.0-7798.g6882af3.el7.x86_64 75/95 2019-11-28T11:24:04.262 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 45/95 2019-11-28T11:24:04.277 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : bison-3.0.4-2.el7.x86_64 87/95 2019-11-28T11:24:04.288 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-selinux-15.0.0-7798.g6882af3.el7.x86_64 70/95 2019-11-28T11:24:04.356 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 93/95 2019-11-28T11:24:04.356 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 94/95 2019-11-28T11:24:04.357 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 46/95 2019-11-28T11:24:04.370 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 76/95 2019-11-28T11:24:04.416 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 71/95 2019-11-28T11:24:04.434 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 88/95 2019-11-28T11:24:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcom_err-devel-1.42.9-16.el7.x86_64 47/95 2019-11-28T11:24:04.494 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 89/95 2019-11-28T11:24:04.495 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:python-rbd-15.0.0-7798.g6882af3.el7.x86_64 77/95 2019-11-28T11:24:04.539 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 72/95 2019-11-28T11:24:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 48/95 2019-11-28T11:24:04.594 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 1:openssl-devel-1.0.2k-19.el7.x86_64 90/95 2019-11-28T11:24:04.613 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7798.g6882af3.el7.x86_64 78/95 2019-11-28T11:24:04.665 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 73/95 2019-11-28T11:24:04.690 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 49/95 2019-11-28T11:24:04.695 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7798.g6882af3.el7 91/95 2019-11-28T11:24:04.731 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:rbd-fuse-15.0.0-7798.g6882af3.el7.x86_64 79/95 2019-11-28T11:24:04.791 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 74/95 2019-11-28T11:24:04.822 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:librgw2-15.0.0-7798.g6882af3.el7.x86_64 80/95 2019-11-28T11:24:04.854 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : pcre-devel-8.32-17.el7.x86_64 50/95 2019-11-28T11:24:04.908 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:libradosstriper1-15.0.0-7798.g6882af3.el7.x86_64 75/95 2019-11-28T11:24:04.914 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:python-rados-15.0.0-7798.g6882af3.el7.x86_64 81/95 2019-11-28T11:24:04.948 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-radosgw-15.0.0-7798.g6882af3.el7.x86_64 51/95 2019-11-28T11:24:05.015 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : elfutils-libelf-devel-0.176-2.el7.x86_64 82/95 2019-11-28T11:24:05.033 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 76/95 2019-11-28T11:24:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 52/95 2019-11-28T11:24:05.116 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 83/95 2019-11-28T11:24:05.133 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:python-rbd-15.0.0-7798.g6882af3.el7.x86_64 77/95 2019-11-28T11:24:05.180 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 53/95 2019-11-28T11:24:05.208 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:python-rgw-15.0.0-7798.g6882af3.el7.x86_64 84/95 2019-11-28T11:24:05.225 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7798.g6882af3.el7.x86_64 78/95 2019-11-28T11:24:05.265 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 92/95 2019-11-28T11:24:05.296 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-fuse-15.0.0-7798.g6882af3.el7.x86_64 54/95 2019-11-28T11:24:05.318 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:rbd-fuse-15.0.0-7798.g6882af3.el7.x86_64 79/95 2019-11-28T11:24:05.342 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:python-ceph-common-15.0.0-7798.g6882af3.el7.x86_64 85/95 2019-11-28T11:24:05.363 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 95/95 2019-11-28T11:24:05.363 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:24:05.364 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2019-11-28T11:24:05.364 INFO:teuthology.orchestra.run.smithi080.stdout: bison.x86_64 0:3.0.4-2.el7 2019-11-28T11:24:05.364 INFO:teuthology.orchestra.run.smithi080.stdout: ceph.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.364 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-daemon.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.365 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.365 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.365 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.365 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.365 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.365 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.366 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.366 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.366 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.366 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel.x86_64 0:0.176-2.el7 2019-11-28T11:24:05.366 INFO:teuthology.orchestra.run.smithi080.stdout: flex.x86_64 0:2.5.37-6.el7 2019-11-28T11:24:05.366 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.367 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.367 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel.x86_64 1:1.0.2k-19.el7 2019-11-28T11:24:05.367 INFO:teuthology.orchestra.run.smithi080.stdout: python-ceph-compat.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.367 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.367 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:24:05.367 INFO:teuthology.orchestra.run.smithi080.stdout:Dependency Installed: 2019-11-28T11:24:05.367 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.368 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.368 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.368 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.368 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.368 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.368 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.368 INFO:teuthology.orchestra.run.smithi080.stdout: jq.x86_64 0:1.5-1.el7 2019-11-28T11:24:05.369 INFO:teuthology.orchestra.run.smithi080.stdout: keyutils-libs-devel.x86_64 0:1.5.8-3.el7 2019-11-28T11:24:05.369 INFO:teuthology.orchestra.run.smithi080.stdout: krb5-devel.x86_64 0:1.15.1-37.el7_7.2 2019-11-28T11:24:05.369 INFO:teuthology.orchestra.run.smithi080.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-28T11:24:05.369 INFO:teuthology.orchestra.run.smithi080.stdout: libcom_err-devel.x86_64 0:1.42.9-16.el7 2019-11-28T11:24:05.369 INFO:teuthology.orchestra.run.smithi080.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-28T11:24:05.369 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-28T11:24:05.369 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.370 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.370 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-28T11:24:05.370 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.370 INFO:teuthology.orchestra.run.smithi080.stdout: libselinux-devel.x86_64 0:2.5-14.1.el7 2019-11-28T11:24:05.370 INFO:teuthology.orchestra.run.smithi080.stdout: libsepol-devel.x86_64 0:2.5-10.el7 2019-11-28T11:24:05.371 INFO:teuthology.orchestra.run.smithi080.stdout: libverto-devel.x86_64 0:0.2.5-4.el7 2019-11-28T11:24:05.371 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-28T11:24:05.371 INFO:teuthology.orchestra.run.smithi080.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 2019-11-28T11:24:05.371 INFO:teuthology.orchestra.run.smithi080.stdout: oniguruma.x86_64 0:5.9.5-3.el7 2019-11-28T11:24:05.372 INFO:teuthology.orchestra.run.smithi080.stdout: pcre-devel.x86_64 0:8.32-17.el7 2019-11-28T11:24:05.372 INFO:teuthology.orchestra.run.smithi080.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-28T11:24:05.372 INFO:teuthology.orchestra.run.smithi080.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-28T11:24:05.373 INFO:teuthology.orchestra.run.smithi080.stdout: python-ceph-argparse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.373 INFO:teuthology.orchestra.run.smithi080.stdout: python-ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.373 INFO:teuthology.orchestra.run.smithi080.stdout: python-cephfs.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.374 INFO:teuthology.orchestra.run.smithi080.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-28T11:24:05.374 INFO:teuthology.orchestra.run.smithi080.stdout: python-execnet.noarch 0:1.2.0-7.el7 2019-11-28T11:24:05.374 INFO:teuthology.orchestra.run.smithi080.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-28T11:24:05.374 INFO:teuthology.orchestra.run.smithi080.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-28T11:24:05.374 INFO:teuthology.orchestra.run.smithi080.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-28T11:24:05.374 INFO:teuthology.orchestra.run.smithi080.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-28T11:24:05.374 INFO:teuthology.orchestra.run.smithi080.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-28T11:24:05.375 INFO:teuthology.orchestra.run.smithi080.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-28T11:24:05.375 INFO:teuthology.orchestra.run.smithi080.stdout: python-rados.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.375 INFO:teuthology.orchestra.run.smithi080.stdout: python-rbd.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.375 INFO:teuthology.orchestra.run.smithi080.stdout: python-remoto.noarch 0:0.0.25-1.el7 2019-11-28T11:24:05.375 INFO:teuthology.orchestra.run.smithi080.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-28T11:24:05.376 INFO:teuthology.orchestra.run.smithi080.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-28T11:24:05.376 INFO:teuthology.orchestra.run.smithi080.stdout: python-rgw.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.376 INFO:teuthology.orchestra.run.smithi080.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-28T11:24:05.376 INFO:teuthology.orchestra.run.smithi080.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-28T11:24:05.376 INFO:teuthology.orchestra.run.smithi080.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-28T11:24:05.377 INFO:teuthology.orchestra.run.smithi080.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-28T11:24:05.377 INFO:teuthology.orchestra.run.smithi080.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-28T11:24:05.377 INFO:teuthology.orchestra.run.smithi080.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-28T11:24:05.377 INFO:teuthology.orchestra.run.smithi080.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-28T11:24:05.377 INFO:teuthology.orchestra.run.smithi080.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-28T11:24:05.378 INFO:teuthology.orchestra.run.smithi080.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-28T11:24:05.378 INFO:teuthology.orchestra.run.smithi080.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-28T11:24:05.378 INFO:teuthology.orchestra.run.smithi080.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-28T11:24:05.378 INFO:teuthology.orchestra.run.smithi080.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-28T11:24:05.378 INFO:teuthology.orchestra.run.smithi080.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-28T11:24:05.378 INFO:teuthology.orchestra.run.smithi080.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-28T11:24:05.379 INFO:teuthology.orchestra.run.smithi080.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-28T11:24:05.379 INFO:teuthology.orchestra.run.smithi080.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-28T11:24:05.379 INFO:teuthology.orchestra.run.smithi080.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-28T11:24:05.379 INFO:teuthology.orchestra.run.smithi080.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-28T11:24:05.379 INFO:teuthology.orchestra.run.smithi080.stdout: python3.x86_64 0:3.6.8-10.el7 2019-11-28T11:24:05.380 INFO:teuthology.orchestra.run.smithi080.stdout: python3-libs.x86_64 0:3.6.8-10.el7 2019-11-28T11:24:05.380 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pip.noarch 0:9.0.3-5.el7 2019-11-28T11:24:05.380 INFO:teuthology.orchestra.run.smithi080.stdout: python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-28T11:24:05.380 INFO:teuthology.orchestra.run.smithi080.stdout: scipy.x86_64 0:0.12.1-6.el7 2019-11-28T11:24:05.381 INFO:teuthology.orchestra.run.smithi080.stdout: socat.x86_64 0:1.7.3.2-2.el7 2019-11-28T11:24:05.381 INFO:teuthology.orchestra.run.smithi080.stdout: suitesparse.x86_64 0:4.0.2-10.el7 2019-11-28T11:24:05.381 INFO:teuthology.orchestra.run.smithi080.stdout: tbb.x86_64 0:4.1-9.20130314.el7 2019-11-28T11:24:05.381 INFO:teuthology.orchestra.run.smithi080.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-28T11:24:05.381 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel.x86_64 0:1.2.7-18.el7 2019-11-28T11:24:05.382 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:24:05.382 INFO:teuthology.orchestra.run.smithi080.stdout:Updated: 2019-11-28T11:24:05.382 INFO:teuthology.orchestra.run.smithi080.stdout: librados2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.382 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.382 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:24:05.383 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2019-11-28T11:24:05.383 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 93/95 2019-11-28T11:24:05.384 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 94/95 2019-11-28T11:24:05.404 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-base-15.0.0-7798.g6882af3.el7.x86_64 55/95 2019-11-28T11:24:05.418 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:librgw2-15.0.0-7798.g6882af3.el7.x86_64 80/95 2019-11-28T11:24:05.459 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 86/95 2019-11-28T11:24:05.519 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:python-rados-15.0.0-7798.g6882af3.el7.x86_64 81/95 2019-11-28T11:24:05.543 DEBUG:teuthology.parallel:result is None 2019-11-28T11:24:05.555 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:libcephfs-devel-15.0.0-7798.g6882af3.el7.x86_64 56/95 2019-11-28T11:24:05.585 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : bison-3.0.4-2.el7.x86_64 87/95 2019-11-28T11:24:05.619 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : elfutils-libelf-devel-0.176-2.el7.x86_64 82/95 2019-11-28T11:24:05.672 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 57/95 2019-11-28T11:24:05.710 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 95/95 2019-11-28T11:24:05.710 INFO:teuthology.orchestra.run.smithi133.stdout: 2019-11-28T11:24:05.711 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2019-11-28T11:24:05.711 INFO:teuthology.orchestra.run.smithi133.stdout: bison.x86_64 0:3.0.4-2.el7 2019-11-28T11:24:05.711 INFO:teuthology.orchestra.run.smithi133.stdout: ceph.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.711 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-daemon.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.711 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.711 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.711 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.712 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.712 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.712 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.712 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.712 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.712 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.713 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel.x86_64 0:0.176-2.el7 2019-11-28T11:24:05.713 INFO:teuthology.orchestra.run.smithi133.stdout: flex.x86_64 0:2.5.37-6.el7 2019-11-28T11:24:05.713 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.713 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.713 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel.x86_64 1:1.0.2k-19.el7 2019-11-28T11:24:05.713 INFO:teuthology.orchestra.run.smithi133.stdout: python-ceph-compat.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.713 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.714 INFO:teuthology.orchestra.run.smithi133.stdout: 2019-11-28T11:24:05.714 INFO:teuthology.orchestra.run.smithi133.stdout:Dependency Installed: 2019-11-28T11:24:05.714 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.714 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.714 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.714 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.714 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.715 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.715 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.715 INFO:teuthology.orchestra.run.smithi133.stdout: jq.x86_64 0:1.5-1.el7 2019-11-28T11:24:05.715 INFO:teuthology.orchestra.run.smithi133.stdout: keyutils-libs-devel.x86_64 0:1.5.8-3.el7 2019-11-28T11:24:05.715 INFO:teuthology.orchestra.run.smithi133.stdout: krb5-devel.x86_64 0:1.15.1-37.el7_7.2 2019-11-28T11:24:05.715 INFO:teuthology.orchestra.run.smithi133.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-28T11:24:05.715 INFO:teuthology.orchestra.run.smithi133.stdout: libcom_err-devel.x86_64 0:1.42.9-16.el7 2019-11-28T11:24:05.716 INFO:teuthology.orchestra.run.smithi133.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-28T11:24:05.716 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-28T11:24:05.716 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.716 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.716 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-28T11:24:05.716 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.717 INFO:teuthology.orchestra.run.smithi133.stdout: libselinux-devel.x86_64 0:2.5-14.1.el7 2019-11-28T11:24:05.717 INFO:teuthology.orchestra.run.smithi133.stdout: libsepol-devel.x86_64 0:2.5-10.el7 2019-11-28T11:24:05.717 INFO:teuthology.orchestra.run.smithi133.stdout: libverto-devel.x86_64 0:0.2.5-4.el7 2019-11-28T11:24:05.717 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-28T11:24:05.717 INFO:teuthology.orchestra.run.smithi133.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 2019-11-28T11:24:05.717 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma.x86_64 0:5.9.5-3.el7 2019-11-28T11:24:05.717 INFO:teuthology.orchestra.run.smithi133.stdout: pcre-devel.x86_64 0:8.32-17.el7 2019-11-28T11:24:05.718 INFO:teuthology.orchestra.run.smithi133.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-28T11:24:05.718 INFO:teuthology.orchestra.run.smithi133.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-28T11:24:05.718 INFO:teuthology.orchestra.run.smithi133.stdout: python-ceph-argparse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.718 INFO:teuthology.orchestra.run.smithi133.stdout: python-ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.718 INFO:teuthology.orchestra.run.smithi133.stdout: python-cephfs.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.718 INFO:teuthology.orchestra.run.smithi133.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-28T11:24:05.718 INFO:teuthology.orchestra.run.smithi133.stdout: python-execnet.noarch 0:1.2.0-7.el7 2019-11-28T11:24:05.719 INFO:teuthology.orchestra.run.smithi133.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-28T11:24:05.719 INFO:teuthology.orchestra.run.smithi133.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-28T11:24:05.719 INFO:teuthology.orchestra.run.smithi133.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-28T11:24:05.719 INFO:teuthology.orchestra.run.smithi133.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-28T11:24:05.719 INFO:teuthology.orchestra.run.smithi133.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-28T11:24:05.719 INFO:teuthology.orchestra.run.smithi133.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-28T11:24:05.719 INFO:teuthology.orchestra.run.smithi133.stdout: python-rados.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.720 INFO:teuthology.orchestra.run.smithi133.stdout: python-rbd.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.720 INFO:teuthology.orchestra.run.smithi133.stdout: python-remoto.noarch 0:0.0.25-1.el7 2019-11-28T11:24:05.720 INFO:teuthology.orchestra.run.smithi133.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-28T11:24:05.720 INFO:teuthology.orchestra.run.smithi133.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-28T11:24:05.720 INFO:teuthology.orchestra.run.smithi133.stdout: python-rgw.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.720 INFO:teuthology.orchestra.run.smithi133.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-28T11:24:05.720 INFO:teuthology.orchestra.run.smithi133.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-28T11:24:05.721 INFO:teuthology.orchestra.run.smithi133.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-28T11:24:05.721 INFO:teuthology.orchestra.run.smithi133.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-28T11:24:05.721 INFO:teuthology.orchestra.run.smithi133.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-28T11:24:05.721 INFO:teuthology.orchestra.run.smithi133.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-28T11:24:05.721 INFO:teuthology.orchestra.run.smithi133.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-28T11:24:05.721 INFO:teuthology.orchestra.run.smithi133.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-28T11:24:05.721 INFO:teuthology.orchestra.run.smithi133.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-28T11:24:05.722 INFO:teuthology.orchestra.run.smithi133.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-28T11:24:05.722 INFO:teuthology.orchestra.run.smithi133.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-28T11:24:05.722 INFO:teuthology.orchestra.run.smithi133.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-28T11:24:05.722 INFO:teuthology.orchestra.run.smithi133.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-28T11:24:05.722 INFO:teuthology.orchestra.run.smithi133.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-28T11:24:05.722 INFO:teuthology.orchestra.run.smithi133.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-28T11:24:05.722 INFO:teuthology.orchestra.run.smithi133.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-28T11:24:05.723 INFO:teuthology.orchestra.run.smithi133.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-28T11:24:05.723 INFO:teuthology.orchestra.run.smithi133.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-28T11:24:05.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3.x86_64 0:3.6.8-10.el7 2019-11-28T11:24:05.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-libs.x86_64 0:3.6.8-10.el7 2019-11-28T11:24:05.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pip.noarch 0:9.0.3-5.el7 2019-11-28T11:24:05.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-28T11:24:05.723 INFO:teuthology.orchestra.run.smithi133.stdout: scipy.x86_64 0:0.12.1-6.el7 2019-11-28T11:24:05.724 INFO:teuthology.orchestra.run.smithi133.stdout: socat.x86_64 0:1.7.3.2-2.el7 2019-11-28T11:24:05.724 INFO:teuthology.orchestra.run.smithi133.stdout: suitesparse.x86_64 0:4.0.2-10.el7 2019-11-28T11:24:05.724 INFO:teuthology.orchestra.run.smithi133.stdout: tbb.x86_64 0:4.1-9.20130314.el7 2019-11-28T11:24:05.724 INFO:teuthology.orchestra.run.smithi133.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-28T11:24:05.724 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel.x86_64 0:1.2.7-18.el7 2019-11-28T11:24:05.724 INFO:teuthology.orchestra.run.smithi133.stdout: 2019-11-28T11:24:05.725 INFO:teuthology.orchestra.run.smithi133.stdout:Updated: 2019-11-28T11:24:05.725 INFO:teuthology.orchestra.run.smithi133.stdout: librados2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.725 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:05.725 INFO:teuthology.orchestra.run.smithi133.stdout: 2019-11-28T11:24:05.725 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2019-11-28T11:24:05.726 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 88/95 2019-11-28T11:24:05.736 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 83/95 2019-11-28T11:24:05.830 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flex-2.5.37-6.el7.x86_64 58/95 2019-11-28T11:24:05.868 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:python-rgw-15.0.0-7798.g6882af3.el7.x86_64 84/95 2019-11-28T11:24:05.870 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 89/95 2019-11-28T11:24:05.887 DEBUG:teuthology.parallel:result is None 2019-11-28T11:24:05.940 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 59/95 2019-11-28T11:24:05.946 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:python-ceph-common-15.0.0-7798.g6882af3.el7.x86_64 85/95 2019-11-28T11:24:05.994 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 1:openssl-devel-1.0.2k-19.el7.x86_64 90/95 2019-11-28T11:24:06.052 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-mds-15.0.0-7798.g6882af3.el7.x86_64 60/95 2019-11-28T11:24:06.071 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 86/95 2019-11-28T11:24:06.120 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7798.g6882af3.el7 91/95 2019-11-28T11:24:06.167 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:libcephfs2-15.0.0-7798.g6882af3.el7.x86_64 61/95 2019-11-28T11:24:06.198 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : bison-3.0.4-2.el7.x86_64 87/95 2019-11-28T11:24:06.237 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 92/95 2019-11-28T11:24:06.251 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-common-15.0.0-7798.g6882af3.el7.x86_64 62/95 2019-11-28T11:24:06.342 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:librados2-15.0.0-7798.g6882af3.el7.x86_64 63/95 2019-11-28T11:24:06.371 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 88/95 2019-11-28T11:24:06.379 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 93/95 2019-11-28T11:24:06.380 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 94/95 2019-11-28T11:24:06.471 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 64/95 2019-11-28T11:24:06.491 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 89/95 2019-11-28T11:24:06.568 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 65/95 2019-11-28T11:24:06.607 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 1:openssl-devel-1.0.2k-19.el7.x86_64 90/95 2019-11-28T11:24:06.660 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : krb5-devel-1.15.1-37.el7_7.2.x86_64 66/95 2019-11-28T11:24:06.685 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 95/95 2019-11-28T11:24:06.685 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:24:06.685 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2019-11-28T11:24:06.685 INFO:teuthology.orchestra.run.smithi076.stdout: bison.x86_64 0:3.0.4-2.el7 2019-11-28T11:24:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: ceph.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-daemon.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.686 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-rook.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-radosgw.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-test.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libelf-devel.x86_64 0:0.176-2.el7 2019-11-28T11:24:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: flex.x86_64 0:2.5.37-6.el7 2019-11-28T11:24:06.687 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs-devel.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-devel.x86_64 1:1.0.2k-19.el7 2019-11-28T11:24:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: python-ceph-compat.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.688 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:24:06.688 INFO:teuthology.orchestra.run.smithi076.stdout:Dependency Installed: 2019-11-28T11:24:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-base.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mds.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mon.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-osd.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.689 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-selinux.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: jq.x86_64 0:1.5-1.el7 2019-11-28T11:24:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: keyutils-libs-devel.x86_64 0:1.5.8-3.el7 2019-11-28T11:24:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: krb5-devel.x86_64 0:1.15.1-37.el7_7.2 2019-11-28T11:24:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-28T11:24:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: libcom_err-devel.x86_64 0:1.42.9-16.el7 2019-11-28T11:24:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-28T11:24:06.690 INFO:teuthology.orchestra.run.smithi076.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-28T11:24:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: librados-devel.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: libradosstriper1.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-28T11:24:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: librgw2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: libselinux-devel.x86_64 0:2.5-14.1.el7 2019-11-28T11:24:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: libsepol-devel.x86_64 0:2.5-10.el7 2019-11-28T11:24:06.691 INFO:teuthology.orchestra.run.smithi076.stdout: libverto-devel.x86_64 0:0.2.5-4.el7 2019-11-28T11:24:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-28T11:24:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 2019-11-28T11:24:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: oniguruma.x86_64 0:5.9.5-3.el7 2019-11-28T11:24:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: pcre-devel.x86_64 0:8.32-17.el7 2019-11-28T11:24:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-28T11:24:06.692 INFO:teuthology.orchestra.run.smithi076.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-28T11:24:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: python-ceph-argparse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: python-ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: python-cephfs.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-28T11:24:06.693 INFO:teuthology.orchestra.run.smithi076.stdout: python-execnet.noarch 0:1.2.0-7.el7 2019-11-28T11:24:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-28T11:24:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-28T11:24:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-28T11:24:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-28T11:24:06.694 INFO:teuthology.orchestra.run.smithi076.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-28T11:24:06.695 INFO:teuthology.orchestra.run.smithi076.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-28T11:24:06.695 INFO:teuthology.orchestra.run.smithi076.stdout: python-rados.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.695 INFO:teuthology.orchestra.run.smithi076.stdout: python-rbd.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.696 INFO:teuthology.orchestra.run.smithi076.stdout: python-remoto.noarch 0:0.0.25-1.el7 2019-11-28T11:24:06.696 INFO:teuthology.orchestra.run.smithi076.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-28T11:24:06.696 INFO:teuthology.orchestra.run.smithi076.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-28T11:24:06.697 INFO:teuthology.orchestra.run.smithi076.stdout: python-rgw.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.697 INFO:teuthology.orchestra.run.smithi076.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-28T11:24:06.697 INFO:teuthology.orchestra.run.smithi076.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-28T11:24:06.697 INFO:teuthology.orchestra.run.smithi076.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-28T11:24:06.697 INFO:teuthology.orchestra.run.smithi076.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-28T11:24:06.698 INFO:teuthology.orchestra.run.smithi076.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-28T11:24:06.698 INFO:teuthology.orchestra.run.smithi076.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-28T11:24:06.698 INFO:teuthology.orchestra.run.smithi076.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-28T11:24:06.698 INFO:teuthology.orchestra.run.smithi076.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-28T11:24:06.698 INFO:teuthology.orchestra.run.smithi076.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-28T11:24:06.699 INFO:teuthology.orchestra.run.smithi076.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-28T11:24:06.699 INFO:teuthology.orchestra.run.smithi076.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-28T11:24:06.699 INFO:teuthology.orchestra.run.smithi076.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-28T11:24:06.699 INFO:teuthology.orchestra.run.smithi076.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-28T11:24:06.699 INFO:teuthology.orchestra.run.smithi076.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-28T11:24:06.699 INFO:teuthology.orchestra.run.smithi076.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-28T11:24:06.700 INFO:teuthology.orchestra.run.smithi076.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-28T11:24:06.700 INFO:teuthology.orchestra.run.smithi076.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-28T11:24:06.700 INFO:teuthology.orchestra.run.smithi076.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-28T11:24:06.700 INFO:teuthology.orchestra.run.smithi076.stdout: python3.x86_64 0:3.6.8-10.el7 2019-11-28T11:24:06.700 INFO:teuthology.orchestra.run.smithi076.stdout: python3-libs.x86_64 0:3.6.8-10.el7 2019-11-28T11:24:06.700 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pip.noarch 0:9.0.3-5.el7 2019-11-28T11:24:06.701 INFO:teuthology.orchestra.run.smithi076.stdout: python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-28T11:24:06.701 INFO:teuthology.orchestra.run.smithi076.stdout: scipy.x86_64 0:0.12.1-6.el7 2019-11-28T11:24:06.701 INFO:teuthology.orchestra.run.smithi076.stdout: socat.x86_64 0:1.7.3.2-2.el7 2019-11-28T11:24:06.701 INFO:teuthology.orchestra.run.smithi076.stdout: suitesparse.x86_64 0:4.0.2-10.el7 2019-11-28T11:24:06.701 INFO:teuthology.orchestra.run.smithi076.stdout: tbb.x86_64 0:4.1-9.20130314.el7 2019-11-28T11:24:06.702 INFO:teuthology.orchestra.run.smithi076.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-28T11:24:06.702 INFO:teuthology.orchestra.run.smithi076.stdout: zlib-devel.x86_64 0:1.2.7-18.el7 2019-11-28T11:24:06.702 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:24:06.702 INFO:teuthology.orchestra.run.smithi076.stdout:Updated: 2019-11-28T11:24:06.702 INFO:teuthology.orchestra.run.smithi076.stdout: librados2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.702 INFO:teuthology.orchestra.run.smithi076.stdout: librbd1.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:06.703 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:24:06.703 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2019-11-28T11:24:06.756 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7798.g6882af3.el7 91/95 2019-11-28T11:24:06.758 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 67/95 2019-11-28T11:24:06.840 DEBUG:teuthology.parallel:result is None 2019-11-28T11:24:06.842 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 92/95 2019-11-28T11:24:06.904 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7798.g6882af3.el7.noarc 68/95 2019-11-28T11:24:06.934 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 93/95 2019-11-28T11:24:06.934 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 94/95 2019-11-28T11:24:07.012 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 69/95 2019-11-28T11:24:07.154 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-selinux-15.0.0-7798.g6882af3.el7.x86_64 70/95 2019-11-28T11:24:07.239 INFO:teuthology.orchestra.run.smithi075.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 95/95 2019-11-28T11:24:07.239 INFO:teuthology.orchestra.run.smithi075.stdout: 2019-11-28T11:24:07.240 INFO:teuthology.orchestra.run.smithi075.stdout:Installed: 2019-11-28T11:24:07.240 INFO:teuthology.orchestra.run.smithi075.stdout: bison.x86_64 0:3.0.4-2.el7 2019-11-28T11:24:07.240 INFO:teuthology.orchestra.run.smithi075.stdout: ceph.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.240 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-daemon.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.240 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.240 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-mgr.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.241 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.241 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.241 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.241 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-mgr-rook.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.241 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.242 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-radosgw.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.242 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-test.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.243 INFO:teuthology.orchestra.run.smithi075.stdout: elfutils-libelf-devel.x86_64 0:0.176-2.el7 2019-11-28T11:24:07.243 INFO:teuthology.orchestra.run.smithi075.stdout: flex.x86_64 0:2.5.37-6.el7 2019-11-28T11:24:07.243 INFO:teuthology.orchestra.run.smithi075.stdout: libcephfs-devel.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.243 INFO:teuthology.orchestra.run.smithi075.stdout: libcephfs2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.243 INFO:teuthology.orchestra.run.smithi075.stdout: openssl-devel.x86_64 1:1.0.2k-19.el7 2019-11-28T11:24:07.243 INFO:teuthology.orchestra.run.smithi075.stdout: python-ceph-compat.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.244 INFO:teuthology.orchestra.run.smithi075.stdout: rbd-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.244 INFO:teuthology.orchestra.run.smithi075.stdout: 2019-11-28T11:24:07.244 INFO:teuthology.orchestra.run.smithi075.stdout:Dependency Installed: 2019-11-28T11:24:07.244 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-base.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.245 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.245 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.245 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-mds.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.245 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-mon.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.245 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-osd.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.245 INFO:teuthology.orchestra.run.smithi075.stdout: ceph-selinux.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.245 INFO:teuthology.orchestra.run.smithi075.stdout: jq.x86_64 0:1.5-1.el7 2019-11-28T11:24:07.246 INFO:teuthology.orchestra.run.smithi075.stdout: keyutils-libs-devel.x86_64 0:1.5.8-3.el7 2019-11-28T11:24:07.246 INFO:teuthology.orchestra.run.smithi075.stdout: krb5-devel.x86_64 0:1.15.1-37.el7_7.2 2019-11-28T11:24:07.246 INFO:teuthology.orchestra.run.smithi075.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-28T11:24:07.246 INFO:teuthology.orchestra.run.smithi075.stdout: libcom_err-devel.x86_64 0:1.42.9-16.el7 2019-11-28T11:24:07.246 INFO:teuthology.orchestra.run.smithi075.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-28T11:24:07.247 INFO:teuthology.orchestra.run.smithi075.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-28T11:24:07.247 INFO:teuthology.orchestra.run.smithi075.stdout: librados-devel.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.248 INFO:teuthology.orchestra.run.smithi075.stdout: libradosstriper1.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.248 INFO:teuthology.orchestra.run.smithi075.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-28T11:24:07.248 INFO:teuthology.orchestra.run.smithi075.stdout: librgw2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.248 INFO:teuthology.orchestra.run.smithi075.stdout: libselinux-devel.x86_64 0:2.5-14.1.el7 2019-11-28T11:24:07.248 INFO:teuthology.orchestra.run.smithi075.stdout: libsepol-devel.x86_64 0:2.5-10.el7 2019-11-28T11:24:07.249 INFO:teuthology.orchestra.run.smithi075.stdout: libverto-devel.x86_64 0:0.2.5-4.el7 2019-11-28T11:24:07.249 INFO:teuthology.orchestra.run.smithi075.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-28T11:24:07.249 INFO:teuthology.orchestra.run.smithi075.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 2019-11-28T11:24:07.249 INFO:teuthology.orchestra.run.smithi075.stdout: oniguruma.x86_64 0:5.9.5-3.el7 2019-11-28T11:24:07.249 INFO:teuthology.orchestra.run.smithi075.stdout: pcre-devel.x86_64 0:8.32-17.el7 2019-11-28T11:24:07.249 INFO:teuthology.orchestra.run.smithi075.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-28T11:24:07.250 INFO:teuthology.orchestra.run.smithi075.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-28T11:24:07.250 INFO:teuthology.orchestra.run.smithi075.stdout: python-ceph-argparse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.251 INFO:teuthology.orchestra.run.smithi075.stdout: python-ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.251 INFO:teuthology.orchestra.run.smithi075.stdout: python-cephfs.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.251 INFO:teuthology.orchestra.run.smithi075.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-28T11:24:07.251 INFO:teuthology.orchestra.run.smithi075.stdout: python-execnet.noarch 0:1.2.0-7.el7 2019-11-28T11:24:07.251 INFO:teuthology.orchestra.run.smithi075.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-28T11:24:07.251 INFO:teuthology.orchestra.run.smithi075.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-28T11:24:07.251 INFO:teuthology.orchestra.run.smithi075.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-28T11:24:07.252 INFO:teuthology.orchestra.run.smithi075.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-28T11:24:07.252 INFO:teuthology.orchestra.run.smithi075.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-28T11:24:07.252 INFO:teuthology.orchestra.run.smithi075.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-28T11:24:07.252 INFO:teuthology.orchestra.run.smithi075.stdout: python-rados.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.252 INFO:teuthology.orchestra.run.smithi075.stdout: python-rbd.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.253 INFO:teuthology.orchestra.run.smithi075.stdout: python-remoto.noarch 0:0.0.25-1.el7 2019-11-28T11:24:07.253 INFO:teuthology.orchestra.run.smithi075.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-28T11:24:07.253 INFO:teuthology.orchestra.run.smithi075.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-28T11:24:07.253 INFO:teuthology.orchestra.run.smithi075.stdout: python-rgw.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.253 INFO:teuthology.orchestra.run.smithi075.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-28T11:24:07.253 INFO:teuthology.orchestra.run.smithi075.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-28T11:24:07.253 INFO:teuthology.orchestra.run.smithi075.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-28T11:24:07.254 INFO:teuthology.orchestra.run.smithi075.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-28T11:24:07.254 INFO:teuthology.orchestra.run.smithi075.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-28T11:24:07.254 INFO:teuthology.orchestra.run.smithi075.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-28T11:24:07.254 INFO:teuthology.orchestra.run.smithi075.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-28T11:24:07.254 INFO:teuthology.orchestra.run.smithi075.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-28T11:24:07.254 INFO:teuthology.orchestra.run.smithi075.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-28T11:24:07.254 INFO:teuthology.orchestra.run.smithi075.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-28T11:24:07.255 INFO:teuthology.orchestra.run.smithi075.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-28T11:24:07.255 INFO:teuthology.orchestra.run.smithi075.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-28T11:24:07.255 INFO:teuthology.orchestra.run.smithi075.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-28T11:24:07.255 INFO:teuthology.orchestra.run.smithi075.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-28T11:24:07.255 INFO:teuthology.orchestra.run.smithi075.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-28T11:24:07.255 INFO:teuthology.orchestra.run.smithi075.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-28T11:24:07.255 INFO:teuthology.orchestra.run.smithi075.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-28T11:24:07.256 INFO:teuthology.orchestra.run.smithi075.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-28T11:24:07.256 INFO:teuthology.orchestra.run.smithi075.stdout: python3.x86_64 0:3.6.8-10.el7 2019-11-28T11:24:07.256 INFO:teuthology.orchestra.run.smithi075.stdout: python3-libs.x86_64 0:3.6.8-10.el7 2019-11-28T11:24:07.256 INFO:teuthology.orchestra.run.smithi075.stdout: python3-pip.noarch 0:9.0.3-5.el7 2019-11-28T11:24:07.256 INFO:teuthology.orchestra.run.smithi075.stdout: python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-28T11:24:07.256 INFO:teuthology.orchestra.run.smithi075.stdout: scipy.x86_64 0:0.12.1-6.el7 2019-11-28T11:24:07.256 INFO:teuthology.orchestra.run.smithi075.stdout: socat.x86_64 0:1.7.3.2-2.el7 2019-11-28T11:24:07.257 INFO:teuthology.orchestra.run.smithi075.stdout: suitesparse.x86_64 0:4.0.2-10.el7 2019-11-28T11:24:07.257 INFO:teuthology.orchestra.run.smithi075.stdout: tbb.x86_64 0:4.1-9.20130314.el7 2019-11-28T11:24:07.257 INFO:teuthology.orchestra.run.smithi075.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-28T11:24:07.257 INFO:teuthology.orchestra.run.smithi075.stdout: zlib-devel.x86_64 0:1.2.7-18.el7 2019-11-28T11:24:07.257 INFO:teuthology.orchestra.run.smithi075.stdout: 2019-11-28T11:24:07.257 INFO:teuthology.orchestra.run.smithi075.stdout:Updated: 2019-11-28T11:24:07.257 INFO:teuthology.orchestra.run.smithi075.stdout: librados2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.257 INFO:teuthology.orchestra.run.smithi075.stdout: librbd1.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:07.258 INFO:teuthology.orchestra.run.smithi075.stdout: 2019-11-28T11:24:07.258 INFO:teuthology.orchestra.run.smithi075.stdout:Complete! 2019-11-28T11:24:07.279 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 71/95 2019-11-28T11:24:07.401 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 72/95 2019-11-28T11:24:07.405 DEBUG:teuthology.parallel:result is None 2019-11-28T11:24:07.549 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 73/95 2019-11-28T11:24:07.656 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7798.g6882af3.el7.noarch 74/95 2019-11-28T11:24:07.748 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:libradosstriper1-15.0.0-7798.g6882af3.el7.x86_64 75/95 2019-11-28T11:24:07.868 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 76/95 2019-11-28T11:24:07.950 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:python-rbd-15.0.0-7798.g6882af3.el7.x86_64 77/95 2019-11-28T11:24:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7798.g6882af3.el7.x86_64 78/95 2019-11-28T11:24:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:rbd-fuse-15.0.0-7798.g6882af3.el7.x86_64 79/95 2019-11-28T11:24:08.268 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:librgw2-15.0.0-7798.g6882af3.el7.x86_64 80/95 2019-11-28T11:24:08.361 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:python-rados-15.0.0-7798.g6882af3.el7.x86_64 81/95 2019-11-28T11:24:08.452 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : elfutils-libelf-devel-0.176-2.el7.x86_64 82/95 2019-11-28T11:24:08.594 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 83/95 2019-11-28T11:24:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:python-rgw-15.0.0-7798.g6882af3.el7.x86_64 84/95 2019-11-28T11:24:08.853 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:python-ceph-common-15.0.0-7798.g6882af3.el7.x86_64 85/95 2019-11-28T11:24:08.990 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 86/95 2019-11-28T11:24:09.111 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : bison-3.0.4-2.el7.x86_64 87/95 2019-11-28T11:24:09.272 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 88/95 2019-11-28T11:24:09.381 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 89/95 2019-11-28T11:24:09.490 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 1:openssl-devel-1.0.2k-19.el7.x86_64 90/95 2019-11-28T11:24:09.607 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7798.g6882af3.el7 91/95 2019-11-28T11:24:09.699 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 92/95 2019-11-28T11:24:09.783 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 93/95 2019-11-28T11:24:09.783 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 94/95 2019-11-28T11:24:10.631 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 95/95 2019-11-28T11:24:10.631 INFO:teuthology.orchestra.run.smithi016.stdout: 2019-11-28T11:24:10.632 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2019-11-28T11:24:10.632 INFO:teuthology.orchestra.run.smithi016.stdout: bison.x86_64 0:3.0.4-2.el7 2019-11-28T11:24:10.632 INFO:teuthology.orchestra.run.smithi016.stdout: ceph.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.632 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-daemon.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.632 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.633 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.634 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.634 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.634 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.634 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.634 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.634 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.634 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.635 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-devel.x86_64 0:0.176-2.el7 2019-11-28T11:24:10.635 INFO:teuthology.orchestra.run.smithi016.stdout: flex.x86_64 0:2.5.37-6.el7 2019-11-28T11:24:10.635 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.635 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.635 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-devel.x86_64 1:1.0.2k-19.el7 2019-11-28T11:24:10.635 INFO:teuthology.orchestra.run.smithi016.stdout: python-ceph-compat.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.635 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.636 INFO:teuthology.orchestra.run.smithi016.stdout: 2019-11-28T11:24:10.636 INFO:teuthology.orchestra.run.smithi016.stdout:Dependency Installed: 2019-11-28T11:24:10.636 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.636 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.636 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.636 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.636 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.637 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.637 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.637 INFO:teuthology.orchestra.run.smithi016.stdout: jq.x86_64 0:1.5-1.el7 2019-11-28T11:24:10.637 INFO:teuthology.orchestra.run.smithi016.stdout: keyutils-libs-devel.x86_64 0:1.5.8-3.el7 2019-11-28T11:24:10.637 INFO:teuthology.orchestra.run.smithi016.stdout: krb5-devel.x86_64 0:1.15.1-37.el7_7.2 2019-11-28T11:24:10.637 INFO:teuthology.orchestra.run.smithi016.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-28T11:24:10.637 INFO:teuthology.orchestra.run.smithi016.stdout: libcom_err-devel.x86_64 0:1.42.9-16.el7 2019-11-28T11:24:10.638 INFO:teuthology.orchestra.run.smithi016.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-28T11:24:10.638 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-28T11:24:10.638 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.638 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.638 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-28T11:24:10.638 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.638 INFO:teuthology.orchestra.run.smithi016.stdout: libselinux-devel.x86_64 0:2.5-14.1.el7 2019-11-28T11:24:10.639 INFO:teuthology.orchestra.run.smithi016.stdout: libsepol-devel.x86_64 0:2.5-10.el7 2019-11-28T11:24:10.639 INFO:teuthology.orchestra.run.smithi016.stdout: libverto-devel.x86_64 0:0.2.5-4.el7 2019-11-28T11:24:10.639 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-28T11:24:10.640 INFO:teuthology.orchestra.run.smithi016.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 2019-11-28T11:24:10.640 INFO:teuthology.orchestra.run.smithi016.stdout: oniguruma.x86_64 0:5.9.5-3.el7 2019-11-28T11:24:10.640 INFO:teuthology.orchestra.run.smithi016.stdout: pcre-devel.x86_64 0:8.32-17.el7 2019-11-28T11:24:10.640 INFO:teuthology.orchestra.run.smithi016.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-28T11:24:10.640 INFO:teuthology.orchestra.run.smithi016.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-28T11:24:10.640 INFO:teuthology.orchestra.run.smithi016.stdout: python-ceph-argparse.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.640 INFO:teuthology.orchestra.run.smithi016.stdout: python-ceph-common.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.641 INFO:teuthology.orchestra.run.smithi016.stdout: python-cephfs.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.641 INFO:teuthology.orchestra.run.smithi016.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-28T11:24:10.641 INFO:teuthology.orchestra.run.smithi016.stdout: python-execnet.noarch 0:1.2.0-7.el7 2019-11-28T11:24:10.641 INFO:teuthology.orchestra.run.smithi016.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-28T11:24:10.641 INFO:teuthology.orchestra.run.smithi016.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-28T11:24:10.641 INFO:teuthology.orchestra.run.smithi016.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-28T11:24:10.641 INFO:teuthology.orchestra.run.smithi016.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-28T11:24:10.642 INFO:teuthology.orchestra.run.smithi016.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-28T11:24:10.642 INFO:teuthology.orchestra.run.smithi016.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-28T11:24:10.642 INFO:teuthology.orchestra.run.smithi016.stdout: python-rados.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.642 INFO:teuthology.orchestra.run.smithi016.stdout: python-rbd.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.642 INFO:teuthology.orchestra.run.smithi016.stdout: python-remoto.noarch 0:0.0.25-1.el7 2019-11-28T11:24:10.642 INFO:teuthology.orchestra.run.smithi016.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-28T11:24:10.642 INFO:teuthology.orchestra.run.smithi016.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-28T11:24:10.643 INFO:teuthology.orchestra.run.smithi016.stdout: python-rgw.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.643 INFO:teuthology.orchestra.run.smithi016.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-28T11:24:10.643 INFO:teuthology.orchestra.run.smithi016.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-28T11:24:10.643 INFO:teuthology.orchestra.run.smithi016.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-28T11:24:10.644 INFO:teuthology.orchestra.run.smithi016.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-28T11:24:10.644 INFO:teuthology.orchestra.run.smithi016.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-28T11:24:10.644 INFO:teuthology.orchestra.run.smithi016.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-28T11:24:10.644 INFO:teuthology.orchestra.run.smithi016.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-28T11:24:10.644 INFO:teuthology.orchestra.run.smithi016.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-28T11:24:10.644 INFO:teuthology.orchestra.run.smithi016.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-28T11:24:10.644 INFO:teuthology.orchestra.run.smithi016.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-28T11:24:10.645 INFO:teuthology.orchestra.run.smithi016.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-28T11:24:10.645 INFO:teuthology.orchestra.run.smithi016.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-28T11:24:10.645 INFO:teuthology.orchestra.run.smithi016.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-28T11:24:10.645 INFO:teuthology.orchestra.run.smithi016.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-28T11:24:10.645 INFO:teuthology.orchestra.run.smithi016.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-28T11:24:10.646 INFO:teuthology.orchestra.run.smithi016.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-28T11:24:10.646 INFO:teuthology.orchestra.run.smithi016.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-28T11:24:10.646 INFO:teuthology.orchestra.run.smithi016.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-28T11:24:10.646 INFO:teuthology.orchestra.run.smithi016.stdout: python3.x86_64 0:3.6.8-10.el7 2019-11-28T11:24:10.646 INFO:teuthology.orchestra.run.smithi016.stdout: python3-libs.x86_64 0:3.6.8-10.el7 2019-11-28T11:24:10.646 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pip.noarch 0:9.0.3-5.el7 2019-11-28T11:24:10.647 INFO:teuthology.orchestra.run.smithi016.stdout: python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-28T11:24:10.647 INFO:teuthology.orchestra.run.smithi016.stdout: scipy.x86_64 0:0.12.1-6.el7 2019-11-28T11:24:10.647 INFO:teuthology.orchestra.run.smithi016.stdout: socat.x86_64 0:1.7.3.2-2.el7 2019-11-28T11:24:10.647 INFO:teuthology.orchestra.run.smithi016.stdout: suitesparse.x86_64 0:4.0.2-10.el7 2019-11-28T11:24:10.647 INFO:teuthology.orchestra.run.smithi016.stdout: tbb.x86_64 0:4.1-9.20130314.el7 2019-11-28T11:24:10.647 INFO:teuthology.orchestra.run.smithi016.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-28T11:24:10.647 INFO:teuthology.orchestra.run.smithi016.stdout: zlib-devel.x86_64 0:1.2.7-18.el7 2019-11-28T11:24:10.648 INFO:teuthology.orchestra.run.smithi016.stdout: 2019-11-28T11:24:10.648 INFO:teuthology.orchestra.run.smithi016.stdout:Updated: 2019-11-28T11:24:10.648 INFO:teuthology.orchestra.run.smithi016.stdout: librados2.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.648 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1.x86_64 2:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:10.648 INFO:teuthology.orchestra.run.smithi016.stdout: 2019-11-28T11:24:10.648 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2019-11-28T11:24:10.816 DEBUG:teuthology.parallel:result is None 2019-11-28T11:24:10.816 INFO:teuthology.orchestra.run.smithi076:> sudo lsb_release -is 2019-11-28T11:24:10.921 INFO:teuthology.orchestra.run.smithi076.stdout:RedHatEnterpriseServer 2019-11-28T11:24:10.923 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:24:10.923 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=6882af39b535c578d64a14ae5fc1b517ba8bdb9b 2019-11-28T11:24:11.081 INFO:teuthology.orchestra.run.smithi076:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-28T11:24:11.151 INFO:teuthology.orchestra.run.smithi076.stdout:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:11.151 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7798.g6882af3.el7 2019-11-28T11:24:11.152 INFO:teuthology.task.install:The correct ceph version 15.0.0-7798.g6882af3 is installed. 2019-11-28T11:24:11.152 INFO:teuthology.orchestra.run.smithi133:> sudo lsb_release -is 2019-11-28T11:24:11.265 INFO:teuthology.orchestra.run.smithi133.stdout:RedHatEnterpriseServer 2019-11-28T11:24:11.266 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:24:11.267 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=6882af39b535c578d64a14ae5fc1b517ba8bdb9b 2019-11-28T11:24:11.452 INFO:teuthology.orchestra.run.smithi133:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-28T11:24:11.523 INFO:teuthology.orchestra.run.smithi133.stdout:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:11.524 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7798.g6882af3.el7 2019-11-28T11:24:11.524 INFO:teuthology.task.install:The correct ceph version 15.0.0-7798.g6882af3 is installed. 2019-11-28T11:24:11.525 INFO:teuthology.orchestra.run.smithi174:> sudo lsb_release -is 2019-11-28T11:24:11.634 INFO:teuthology.orchestra.run.smithi174.stdout:RedHatEnterpriseServer 2019-11-28T11:24:11.635 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:24:11.635 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=6882af39b535c578d64a14ae5fc1b517ba8bdb9b 2019-11-28T11:24:11.802 INFO:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-28T11:24:11.875 INFO:teuthology.orchestra.run.smithi174.stdout:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:11.974 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7798.g6882af3.el7 2019-11-28T11:24:11.974 INFO:teuthology.task.install:The correct ceph version 15.0.0-7798.g6882af3 is installed. 2019-11-28T11:24:11.975 INFO:teuthology.orchestra.run.smithi075:> sudo lsb_release -is 2019-11-28T11:24:12.094 INFO:teuthology.orchestra.run.smithi075.stdout:RedHatEnterpriseServer 2019-11-28T11:24:12.094 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:24:12.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=6882af39b535c578d64a14ae5fc1b517ba8bdb9b 2019-11-28T11:24:12.272 INFO:teuthology.orchestra.run.smithi075:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-28T11:24:12.340 INFO:teuthology.orchestra.run.smithi075.stdout:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:12.340 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7798.g6882af3.el7 2019-11-28T11:24:12.340 INFO:teuthology.task.install:The correct ceph version 15.0.0-7798.g6882af3 is installed. 2019-11-28T11:24:12.341 INFO:teuthology.orchestra.run.smithi016:> sudo lsb_release -is 2019-11-28T11:24:12.455 INFO:teuthology.orchestra.run.smithi016.stdout:RedHatEnterpriseServer 2019-11-28T11:24:12.457 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:24:12.457 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=6882af39b535c578d64a14ae5fc1b517ba8bdb9b 2019-11-28T11:24:12.627 INFO:teuthology.orchestra.run.smithi016:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-28T11:24:12.700 INFO:teuthology.orchestra.run.smithi016.stdout:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:12.700 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7798.g6882af3.el7 2019-11-28T11:24:12.700 INFO:teuthology.task.install:The correct ceph version 15.0.0-7798.g6882af3 is installed. 2019-11-28T11:24:12.701 INFO:teuthology.orchestra.run.smithi080:> sudo lsb_release -is 2019-11-28T11:24:12.806 INFO:teuthology.orchestra.run.smithi080.stdout:RedHatEnterpriseServer 2019-11-28T11:24:12.808 DEBUG:teuthology.misc:System to be installed: RedHatEnterpriseServer 2019-11-28T11:24:12.808 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=6882af39b535c578d64a14ae5fc1b517ba8bdb9b 2019-11-28T11:24:12.976 INFO:teuthology.orchestra.run.smithi080:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-28T11:24:13.043 INFO:teuthology.orchestra.run.smithi080.stdout:15.0.0-7798.g6882af3.el7 2019-11-28T11:24:13.043 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7798.g6882af3.el7 2019-11-28T11:24:13.044 INFO:teuthology.task.install:The correct ceph version 15.0.0-7798.g6882af3 is installed. 2019-11-28T11:24:13.044 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-11-28T11:24:13.044 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-28T11:24:13.107 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-28T11:24:13.169 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-28T11:24:13.231 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-28T11:24:13.294 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-28T11:24:13.367 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-28T11:24:13.437 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-11-28T11:24:13.437 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-28T11:24:13.521 INFO:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-28T11:24:13.599 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-28T11:24:13.677 INFO:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-28T11:24:13.805 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-28T11:24:13.874 INFO:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-28T11:24:13.996 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-28T11:24:14.061 INFO:teuthology.orchestra.run.smithi075:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-28T11:24:14.115 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-28T11:24:14.181 INFO:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-28T11:24:14.242 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-28T11:24:14.302 INFO:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-28T11:24:14.357 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-11-28T11:24:14.358 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-28T11:24:14.417 INFO:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-28T11:24:14.538 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-28T11:24:14.600 INFO:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-28T11:24:14.721 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-28T11:24:14.785 INFO:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-28T11:24:14.905 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-28T11:24:14.965 INFO:teuthology.orchestra.run.smithi075:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-28T11:24:15.086 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-28T11:24:15.152 INFO:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-28T11:24:15.278 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-28T11:24:15.338 INFO:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-28T11:24:15.436 INFO:teuthology.run_tasks:Running task ceph... 2019-11-28T11:24:15.545 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2019-11-28T11:24:15.545 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 777 /var/log/ceph 2019-11-28T11:24:15.550 INFO:teuthology.orchestra.run.smithi075:> sudo chmod 777 /var/log/ceph 2019-11-28T11:24:15.555 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 777 /var/log/ceph 2019-11-28T11:24:15.560 INFO:teuthology.orchestra.run.smithi080:> sudo chmod 777 /var/log/ceph 2019-11-28T11:24:15.565 INFO:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2019-11-28T11:24:15.571 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 777 /var/log/ceph 2019-11-28T11:24:15.637 INFO:tasks.ceph:Disabling ceph logrotate... 2019-11-28T11:24:15.638 INFO:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-28T11:24:15.643 INFO:teuthology.orchestra.run.smithi075:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-28T11:24:15.659 INFO:teuthology.orchestra.run.smithi076:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-28T11:24:15.664 INFO:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-28T11:24:15.669 INFO:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-28T11:24:15.673 INFO:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-28T11:24:15.732 INFO:tasks.ceph:Creating extra log directories... 2019-11-28T11:24:15.732 INFO:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-28T11:24:15.744 INFO:teuthology.orchestra.run.smithi075:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-28T11:24:15.749 INFO:teuthology.orchestra.run.smithi076:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-28T11:24:15.757 INFO:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-28T11:24:15.762 INFO:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-28T11:24:15.767 INFO:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-28T11:24:15.821 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2019-11-28T11:24:15.822 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2019-11-28T11:24:15.822 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2019-11-28T11:24:15.822 INFO:teuthology.orchestra.run.smithi076:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2019-11-28T11:24:15.870 INFO:teuthology.orchestra.run.smithi076:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:16.014 INFO:teuthology.orchestra.run.smithi076:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:16.067 INFO:teuthology.orchestra.run.smithi133:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2019-11-28T11:24:16.113 INFO:teuthology.orchestra.run.smithi133:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:16.269 INFO:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:16.321 INFO:teuthology.orchestra.run.smithi174:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2019-11-28T11:24:16.366 INFO:teuthology.orchestra.run.smithi174:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:16.530 INFO:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:16.583 INFO:teuthology.orchestra.run.smithi075:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2019-11-28T11:24:16.629 INFO:teuthology.orchestra.run.smithi075:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:16.789 INFO:teuthology.orchestra.run.smithi075:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:16.842 INFO:teuthology.orchestra.run.smithi016:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2019-11-28T11:24:16.890 INFO:teuthology.orchestra.run.smithi016:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:17.068 INFO:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:17.127 INFO:teuthology.orchestra.run.smithi080:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2019-11-28T11:24:17.173 INFO:teuthology.orchestra.run.smithi080:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:17.335 INFO:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:17.389 INFO:tasks.ceph:Creating ceph cluster ceph... 2019-11-28T11:24:17.389 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'but it is still running', 'slow request', 'evicting unresponsive client'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'global': {'ms die on skipped message': False}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'bluestore compression mode': 'aggressive', 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'osd op complaint time': 180}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}}} 2019-11-28T11:24:17.389 INFO:tasks.ceph:ctx.config {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (6, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': '6882af39b535c578d64a14ae5fc1b517ba8bdb9b'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_client_recovery'], 'fail_on_skip': False}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.9225', 'owner': 'scheduled_pdonnell@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'targets': {'smithi080.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9Hjbu3OGUxZJN1rV9I17TIRPE/wYHV57JQ2DEoTuhzteanYh15ofK1kzAujggDui/0R3UwbfcX65QFpfdYGEeKP0YtqH7LSsCPh7ISUz6OASUlL7Q81QtAqrb7flzKYeIn/Xhq6mhKU0x7MYKaTY4oFu7b85zORLoiZBoRKHR/r+MEC3NPXC18XJ1EwukX5dOE6vsumOgeT+5Yv1JeN3lQah6ewBDd7Jkb2tio7CMxeayNrjcuiaGTWtz7uosQoAwODL1l6niR0T1NnOs/TIXowSDXTFcpiVT+H4/A0gkwKgEpQfuNfYQrv1YP04P9oae1L86+is/JN8U8suOg/f/', 'smithi174.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4b57fbVM9U1QGyPoKlUB3RN9HalUyRZesxl84qPzIvkzhlPknHjley0eciF1sS6A4zB/+0gpgCjxM9sDnNdyibcrfmYuAuK7Mfat+pz4aDDAdIEpUKXVKrg8ENxSHbYcs1kCcSfT30kPT++o8+oqNfGAqXaljsHNUP9RbvqetaNBWonfc3RWxGMwXQT80zbD26n6rg9TJ3cnwPaQWZg09U3Yp02D74whzUuQ2ahGo+z+myaWWX3rVi2KPpLgqIddsFdBvsySPMug/+ZMxNTvWscpr3F8eNfvx+Ewsppagv+HBKj1VI/QW4PYDhMHVCGqpD2co/NI8J5CnuSXiLOy/', 'smithi076.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDp81+uHeoTP8kIgyPhhVkW/TvGf+yqpQpO0SGDJcCbSYSLu6EFbD3rZWmec69wI3mN2nHUCMPH0Tuww71tmN6VvYvkJe8JESCWr4w4D2RRcBH8witFl8VsQTYBGTGRlDExuaOqbSHL5592DdgJQRk1iTbQqGebFqi0wTY87Jzun+JOk/t9AJsIEh9cj2xktMKTPBMFEtoUmCU2o44UsBtH3LKar2cEDII8sB5pwMLMQ7mLjihTgJochId4o9JnbShk71y43ltOrURp8oJs2bMpBCYhPUioY94tDQ/7X7EW4gHHA1/0h5KIjpos1ObvRSuELycuDvhmRqMvGkUTYuf7', 'smithi016.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoCOWkCHcGObvU6EGzQiBzsFcb2bXtEHBwYu8v2PX3Rvo37GCYPru4tllszBnrEWTuE7MxRcwAFbMrUrW/7C56SP6Z6xNFQBupFfSOfuaAZoDN3fI0I174WRPO+LqYQSzynAlmgo+nyRSCERIclDW2Of8k+roEsM62li8MfcU6WRo2GTA2mZSom0TWm/rY8yzzqHURKwXURTcofYNp2X+Gl8p5AsVyK+fTyQKIrvpLoHX3n/+RKnVWRHhUs4TWGJt0AMiNIe1a/wid4Ewsty4DycSzFuTREPZWf5eZ6pTf+Mg6MBm35NwEWIsZpFaBmIoa1fVKNF8JEVBYPLlIXPXz', 'smithi075.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCZDUaUr01PRhqSB/sVlELxWV4SRYzMm6uMlLyGGO57lzroeKm24XHcsaRa3w5FAjtW+lfkc89as4ZCMHq4b4GWi4jvQ4xsVc4aP43ww5fI71CS3oPW/Z7elfnZW9q0e5a14vqzFGoSxi7FFQ3NbquCnHFhMdbtwXsAMmmf0VMr/gYmL21Y1F18mheTgBaQx9jAzVokKZdV45Ovfsx0Fvbi3bAs5AX9X8yNADqDiurDyIJo9jxJRvPvTjEGN/i05yImKHdmY9fPmUxseUsOz6w7xdhvyNcpyiVhI4d5EhG9KgObvGLStbHKatTdcEz3RC82kNDzpwUzmawE816F+o8H', 'smithi133.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo55AOXymOH1SjtyUZPfJsaG2fOMvmVvB710TveOyU3H/3OniF9tpYT+DlLB+Oe8tc3a11oxHxGWdeou9mCepLemVSxgA/8jl0cab48RyJWroL/dNJA5tgBfzBT9PNODLs6k/NyHcqXIinkvxcbOdj86HXX+K+cN7EQpVCRbsNPRS6hDyIiVjZb+6RiHmke+nOm7oxiArcU5oK+EWTZyAmb9Dqv5ZECFrqmMlkyTHsXbW+1RKKJC+NukeLhs5tAzHKBrCPzXOaapXcxuO/8nJ9OM7vEVlHQcwQS8RAWuyKOeLKNVqbesrm63evStTQ8GjQacGMEZvss9HSqrK1XnRd'}, 'job_id': '4548252', 'tube': 'smithi', 'suite_branch': 'wip-pdonnell-testing-20191127.175901', 'priority': 76, 'os_version': '7.7', 'first_in_suite': False, 'branch': 'wip-pdonnell-testing-20191127.175901', 'suite': 'kcephfs', 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'email': 'pdonnell@redhat.com', 'archive_path': '/home/teuthworker/archive/pdonnell-2019-11-27_23:36:14-kcephfs-wip-pdonnell-testing-20191127.175901-distro-basic-smithi/4548252', 'description': 'kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '6882af39b535c578d64a14ae5fc1b517ba8bdb9b', 'name': 'pdonnell-2019-11-27_23:36:14-kcephfs-wip-pdonnell-testing-20191127.175901-distro-basic-smithi', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.b', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.c', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1'], ['client.2'], ['client.3']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'overrides': {'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'but it is still running', 'slow request', 'evicting unresponsive client'], 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'global': {'ms die on skipped message': False}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'bluestore compression mode': 'aggressive', 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'osd op complaint time': 180}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}}, 'fs': 'xfs', 'sha1': '6882af39b535c578d64a14ae5fc1b517ba8bdb9b'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '6882af39b535c578d64a14ae5fc1b517ba8bdb9b'}}, 'admin_socket': {'branch': 'wip-pdonnell-testing-20191127.175901'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}, 'workunit': {'sha1': '6882af39b535c578d64a14ae5fc1b517ba8bdb9b', 'branch': 'wip-pdonnell-testing-20191127.175901'}}, 'os_type': 'rhel', 'suite_sha1': '6882af39b535c578d64a14ae5fc1b517ba8bdb9b'} 2019-11-28T11:24:17.390 INFO:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-28T11:24:17.394 INFO:teuthology.orchestra.run.smithi075:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-28T11:24:17.398 INFO:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-28T11:24:17.403 INFO:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-28T11:24:17.408 INFO:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-28T11:24:17.418 INFO:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-28T11:24:17.467 INFO:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/run/ceph 2019-11-28T11:24:17.486 INFO:teuthology.orchestra.run.smithi075:> sudo install -d -m0777 -- /var/run/ceph 2019-11-28T11:24:17.490 INFO:teuthology.orchestra.run.smithi076:> sudo install -d -m0777 -- /var/run/ceph 2019-11-28T11:24:17.495 INFO:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/run/ceph 2019-11-28T11:24:17.500 INFO:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2019-11-28T11:24:17.504 INFO:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2019-11-28T11:24:17.607 DEBUG:teuthology.orchestra.remote:smithi174:/scratch_devs is 72B 2019-11-28T11:24:17.655 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-28T11:24:17.655 INFO:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-11-28T11:24:17.695 INFO:teuthology.orchestra.run.smithi174.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-11-28T11:24:17.695 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-28T11:24:17.696 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 100119 Links: 1 2019-11-28T11:24:17.696 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-28T11:24:17.696 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2019-11-28T11:24:17.696 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2019-11-28 11:23:44.161759229 +0000 2019-11-28T11:24:17.696 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2019-11-28 11:19:16.992295502 +0000 2019-11-28T11:24:17.696 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2019-11-28 11:19:16.992295502 +0000 2019-11-28T11:24:17.697 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2019-11-28T11:24:17.707 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2019-11-28T11:24:17.708 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2019-11-28T11:24:17.708 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes (512 B) copied, 0.000280378 s, 1.8 MB/s 2019-11-28T11:24:17.710 INFO:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-11-28T11:24:17.818 INFO:teuthology.orchestra.run.smithi174.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-11-28T11:24:17.818 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-28T11:24:17.818 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 94993 Links: 1 2019-11-28T11:24:17.818 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-28T11:24:17.818 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2019-11-28T11:24:17.819 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2019-11-28 11:23:44.161759229 +0000 2019-11-28T11:24:17.819 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2019-11-28 11:19:17.259291718 +0000 2019-11-28T11:24:17.819 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2019-11-28 11:19:17.259291718 +0000 2019-11-28T11:24:17.819 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2019-11-28T11:24:17.827 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2019-11-28T11:24:17.828 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2019-11-28T11:24:17.828 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes (512 B) copied, 0.000266136 s, 1.9 MB/s 2019-11-28T11:24:17.830 INFO:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-11-28T11:24:17.945 INFO:teuthology.orchestra.run.smithi174.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-11-28T11:24:17.946 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-28T11:24:17.946 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 98868 Links: 1 2019-11-28T11:24:17.946 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-28T11:24:17.946 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2019-11-28T11:24:17.947 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2019-11-28 11:23:44.161759229 +0000 2019-11-28T11:24:17.947 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2019-11-28 11:19:17.525287948 +0000 2019-11-28T11:24:17.947 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2019-11-28 11:19:17.525287948 +0000 2019-11-28T11:24:17.948 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2019-11-28T11:24:17.952 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2019-11-28T11:24:17.952 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2019-11-28T11:24:17.952 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes (512 B) copied, 0.000223299 s, 2.3 MB/s 2019-11-28T11:24:17.954 INFO:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-11-28T11:24:18.058 INFO:teuthology.orchestra.run.smithi174.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-11-28T11:24:18.058 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-28T11:24:18.059 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 97999 Links: 1 2019-11-28T11:24:18.059 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-28T11:24:18.059 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2019-11-28T11:24:18.059 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2019-11-28 11:23:44.162759218 +0000 2019-11-28T11:24:18.059 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2019-11-28 11:19:17.793284151 +0000 2019-11-28T11:24:18.060 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2019-11-28 11:19:17.793284151 +0000 2019-11-28T11:24:18.060 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2019-11-28T11:24:18.070 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2019-11-28T11:24:18.070 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2019-11-28T11:24:18.071 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes (512 B) copied, 0.000426458 s, 1.2 MB/s 2019-11-28T11:24:18.073 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-11-28T11:24:18.073 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-28T11:24:18.073 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-11-28T11:24:18.073 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-28T11:24:18.119 DEBUG:teuthology.orchestra.remote:smithi080:/scratch_devs is 72B 2019-11-28T11:24:18.167 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-28T11:24:18.167 INFO:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-11-28T11:24:18.207 INFO:teuthology.orchestra.run.smithi080.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-11-28T11:24:18.208 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-28T11:24:18.209 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 96904 Links: 1 2019-11-28T11:24:18.209 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-28T11:24:18.209 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2019-11-28T11:24:18.209 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2019-11-28 11:23:45.659222802 +0000 2019-11-28T11:24:18.209 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2019-11-28 11:16:42.241140213 +0000 2019-11-28T11:24:18.209 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2019-11-28 11:16:42.241140213 +0000 2019-11-28T11:24:18.210 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2019-11-28T11:24:18.219 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2019-11-28T11:24:18.220 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2019-11-28T11:24:18.220 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes (512 B) copied, 0.000245826 s, 2.1 MB/s 2019-11-28T11:24:18.222 INFO:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-11-28T11:24:18.330 INFO:teuthology.orchestra.run.smithi080.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-11-28T11:24:18.331 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-28T11:24:18.331 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 98872 Links: 1 2019-11-28T11:24:18.331 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-28T11:24:18.331 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2019-11-28T11:24:18.331 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2019-11-28 11:23:45.659222802 +0000 2019-11-28T11:24:18.332 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2019-11-28 11:16:42.534133592 +0000 2019-11-28T11:24:18.332 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2019-11-28 11:16:42.534133592 +0000 2019-11-28T11:24:18.332 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2019-11-28T11:24:18.342 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2019-11-28T11:24:18.343 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2019-11-28T11:24:18.343 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes (512 B) copied, 0.000260171 s, 2.0 MB/s 2019-11-28T11:24:18.345 INFO:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-11-28T11:24:18.451 INFO:teuthology.orchestra.run.smithi080.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-11-28T11:24:18.451 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-28T11:24:18.451 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 99597 Links: 1 2019-11-28T11:24:18.452 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-28T11:24:18.453 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2019-11-28T11:24:18.453 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2019-11-28 11:23:45.659222802 +0000 2019-11-28T11:24:18.453 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2019-11-28 11:16:42.795127695 +0000 2019-11-28T11:24:18.453 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2019-11-28 11:16:42.795127695 +0000 2019-11-28T11:24:18.453 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2019-11-28T11:24:18.463 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2019-11-28T11:24:18.463 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2019-11-28T11:24:18.463 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes (512 B) copied, 0.000255932 s, 2.0 MB/s 2019-11-28T11:24:18.465 INFO:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-11-28T11:24:18.569 INFO:teuthology.orchestra.run.smithi080.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-11-28T11:24:18.569 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-28T11:24:18.569 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 99636 Links: 1 2019-11-28T11:24:18.570 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-28T11:24:18.570 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2019-11-28T11:24:18.571 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2019-11-28 11:23:45.659222802 +0000 2019-11-28T11:24:18.571 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2019-11-28 11:16:43.051121910 +0000 2019-11-28T11:24:18.571 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2019-11-28 11:16:43.051121910 +0000 2019-11-28T11:24:18.571 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2019-11-28T11:24:18.581 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2019-11-28T11:24:18.581 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2019-11-28T11:24:18.581 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes (512 B) copied, 0.000277931 s, 1.8 MB/s 2019-11-28T11:24:18.583 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-11-28T11:24:18.584 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-28T11:24:18.584 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-11-28T11:24:18.584 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-28T11:24:18.584 INFO:tasks.ceph:Generating config... 2019-11-28T11:24:18.585 INFO:tasks.ceph:[mds] mds debug frag = True 2019-11-28T11:24:18.585 INFO:tasks.ceph:[mds] mds bal split bits = 3 2019-11-28T11:24:18.585 INFO:tasks.ceph:[mds] mds bal split size = 100 2019-11-28T11:24:18.586 INFO:tasks.ceph:[mds] debug mds = 20 2019-11-28T11:24:18.586 INFO:tasks.ceph:[mds] mds bal merge size = 5 2019-11-28T11:24:18.586 INFO:tasks.ceph:[mds] debug ms = 1 2019-11-28T11:24:18.586 INFO:tasks.ceph:[mds] mds bal frag = True 2019-11-28T11:24:18.586 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2019-11-28T11:24:18.586 INFO:tasks.ceph:[mds] mds op complaint time = 180 2019-11-28T11:24:18.589 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2019-11-28T11:24:18.589 INFO:tasks.ceph:[mds] osd op complaint time = 180 2019-11-28T11:24:18.589 INFO:tasks.ceph:[mds] mds verify scatter = True 2019-11-28T11:24:18.589 INFO:tasks.ceph:[global] ms die on skipped message = False 2019-11-28T11:24:18.590 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2019-11-28T11:24:18.590 INFO:tasks.ceph:[osd] debug ms = 1 2019-11-28T11:24:18.590 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2019-11-28T11:24:18.590 INFO:tasks.ceph:[osd] debug osd = 25 2019-11-28T11:24:18.590 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2019-11-28T11:24:18.590 INFO:tasks.ceph:[osd] debug bluestore = 20 2019-11-28T11:24:18.590 INFO:tasks.ceph:[osd] debug bluefs = 20 2019-11-28T11:24:18.591 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2019-11-28T11:24:18.591 INFO:tasks.ceph:[osd] debug rocksdb = 10 2019-11-28T11:24:18.591 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2019-11-28T11:24:18.591 INFO:tasks.ceph:[osd] debug journal = 20 2019-11-28T11:24:18.591 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2019-11-28T11:24:18.592 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2019-11-28T11:24:18.592 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2019-11-28T11:24:18.592 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2019-11-28T11:24:18.592 INFO:tasks.ceph:[osd] debug filestore = 20 2019-11-28T11:24:18.593 INFO:tasks.ceph:[osd] osd op complaint time = 180 2019-11-28T11:24:18.593 INFO:tasks.ceph:[mon] debug mon = 20 2019-11-28T11:24:18.593 INFO:tasks.ceph:[mon] debug paxos = 20 2019-11-28T11:24:18.593 INFO:tasks.ceph:[mon] mon op complaint time = 120 2019-11-28T11:24:18.593 INFO:tasks.ceph:[mon] debug ms = 1 2019-11-28T11:24:18.594 INFO:tasks.ceph:[client] debug ms = 1 2019-11-28T11:24:18.594 INFO:tasks.ceph:[client] debug client = 20 2019-11-28T11:24:18.594 INFO:tasks.ceph:[client] client mount timeout = 600 2019-11-28T11:24:18.594 INFO:tasks.ceph:Setting up mon.a... 2019-11-28T11:24:18.594 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2019-11-28T11:24:18.745 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.keyring 2019-11-28T11:24:18.748 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2019-11-28T11:24:18.815 INFO:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-28T11:24:18.871 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.80'), ('mon.c', '[v2:172.21.15.174:3301,v1:172.21.15.174:6790]'), ('mon.b', '172.21.15.174')] 2019-11-28T11:24:18.871 INFO:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.80 --addv c '[v2:172.21.15.174:3301,v1:172.21.15.174:6790]' --add b 172.21.15.174 --print /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:18.937 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:18.938 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: generated fsid 4d210428-f562-4c8d-978b-869be7a63ed0 2019-11-28T11:24:18.938 INFO:teuthology.orchestra.run.smithi080.stdout:epoch 0 2019-11-28T11:24:18.938 INFO:teuthology.orchestra.run.smithi080.stdout:fsid 4d210428-f562-4c8d-978b-869be7a63ed0 2019-11-28T11:24:18.938 INFO:teuthology.orchestra.run.smithi080.stdout:last_changed 2019-11-28T11:24:18.921015+0000 2019-11-28T11:24:18.938 INFO:teuthology.orchestra.run.smithi080.stdout:created 2019-11-28T11:24:18.921015+0000 2019-11-28T11:24:18.938 INFO:teuthology.orchestra.run.smithi080.stdout:min_mon_release 0 (unknown) 2019-11-28T11:24:18.938 INFO:teuthology.orchestra.run.smithi080.stdout:0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2019-11-28T11:24:18.939 INFO:teuthology.orchestra.run.smithi080.stdout:1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.b 2019-11-28T11:24:18.939 INFO:teuthology.orchestra.run.smithi080.stdout:2: [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] mon.c 2019-11-28T11:24:18.939 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2019-11-28T11:24:18.940 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4d210428-f562-4c8d-978b-869be7a63ed0... 2019-11-28T11:24:18.941 INFO:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-28T11:24:18.947 INFO:teuthology.orchestra.run.smithi075:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-28T11:24:18.964 INFO:teuthology.orchestra.run.smithi076:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-28T11:24:18.969 INFO:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-28T11:24:18.973 INFO:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-28T11:24:18.977 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-28T11:24:19.090 INFO:tasks.ceph:Creating admin key on mon.a... 2019-11-28T11:24:19.090 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2019-11-28T11:24:19.170 INFO:tasks.ceph:Copying monmap to all nodes... 2019-11-28T11:24:19.214 DEBUG:teuthology.orchestra.remote:smithi080:/etc/ceph/ceph.keyring is 206B 2019-11-28T11:24:19.311 DEBUG:teuthology.orchestra.remote:smithi080:/home/ubuntu/cephtest/ceph.monmap is 379B 2019-11-28T11:24:19.361 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:24:19.362 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-28T11:24:19.433 INFO:teuthology.orchestra.run.smithi076:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:19.545 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2019-11-28T11:24:19.546 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-28T11:24:19.620 INFO:teuthology.orchestra.run.smithi133:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:19.750 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2019-11-28T11:24:19.750 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-28T11:24:19.846 INFO:teuthology.orchestra.run.smithi174:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:19.978 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi075.front.sepia.ceph.com 2019-11-28T11:24:19.978 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-28T11:24:20.088 INFO:teuthology.orchestra.run.smithi075:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:20.207 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi016.front.sepia.ceph.com 2019-11-28T11:24:20.207 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-28T11:24:20.301 INFO:teuthology.orchestra.run.smithi016:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:20.412 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi080.front.sepia.ceph.com 2019-11-28T11:24:20.413 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-28T11:24:20.495 INFO:teuthology.orchestra.run.smithi080:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:20.608 INFO:tasks.ceph:Setting up mon nodes... 2019-11-28T11:24:20.608 INFO:tasks.ceph:Setting up mgr nodes... 2019-11-28T11:24:20.608 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2019-11-28T11:24:20.797 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2019-11-28T11:24:20.798 INFO:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2019-11-28T11:24:20.897 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2019-11-28T11:24:20.898 INFO:tasks.ceph:Setting up mds nodes... 2019-11-28T11:24:20.898 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2019-11-28T11:24:20.986 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2019-11-28T11:24:20.989 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2019-11-28T11:24:21.044 INFO:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2019-11-28T11:24:21.125 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2019-11-28T11:24:21.127 INFO:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2019-11-28T11:24:21.180 INFO:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2019-11-28T11:24:21.261 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2019-11-28T11:24:21.262 INFO:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2019-11-28T11:24:21.328 INFO:tasks.ceph_client:Setting up client nodes... 2019-11-28T11:24:21.328 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2019-11-28T11:24:21.421 INFO:teuthology.orchestra.run.smithi076.stdout:creating /etc/ceph/ceph.client.0.keyring 2019-11-28T11:24:21.433 INFO:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2019-11-28T11:24:21.532 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.3.keyring 2019-11-28T11:24:21.555 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2019-11-28T11:24:21.653 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.1.keyring 2019-11-28T11:24:21.673 INFO:teuthology.orchestra.run.smithi075:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2019-11-28T11:24:21.779 INFO:teuthology.orchestra.run.smithi075.stdout:creating /etc/ceph/ceph.client.2.keyring 2019-11-28T11:24:21.794 INFO:tasks.ceph:Running mkfs on osd nodes... 2019-11-28T11:24:21.794 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}} 2019-11-28T11:24:21.795 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2019-11-28T11:24:21.858 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-28T11:24:21.858 INFO:tasks.ceph:{} 2019-11-28T11:24:21.858 INFO:tasks.ceph:osd.4 2019-11-28T11:24:21.859 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com 2019-11-28T11:24:21.859 INFO:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-11-28T11:24:22.400 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-11-28T11:24:22.401 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-28T11:24:22.401 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=0, sparse=0 2019-11-28T11:24:22.401 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-28T11:24:22.401 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2019-11-28T11:24:22.401 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-28T11:24:22.401 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-28T11:24:22.402 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-28T11:24:22.402 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-28T11:24:22.403 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2019-11-28T11:24:22.403 INFO:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2019-11-28T11:24:22.516 INFO:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2019-11-28T11:24:22.575 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2019-11-28T11:24:22.629 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-28T11:24:22.629 INFO:tasks.ceph:{} 2019-11-28T11:24:22.629 INFO:tasks.ceph:osd.5 2019-11-28T11:24:22.629 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com 2019-11-28T11:24:22.629 INFO:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-11-28T11:24:23.134 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-11-28T11:24:23.134 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-28T11:24:23.135 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=0, sparse=0 2019-11-28T11:24:23.135 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-28T11:24:23.135 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2019-11-28T11:24:23.135 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-28T11:24:23.135 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-28T11:24:23.135 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-28T11:24:23.135 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-28T11:24:23.136 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2019-11-28T11:24:23.137 INFO:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2019-11-28T11:24:23.205 INFO:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2019-11-28T11:24:23.260 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2019-11-28T11:24:23.312 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-28T11:24:23.312 INFO:tasks.ceph:{} 2019-11-28T11:24:23.312 INFO:tasks.ceph:osd.6 2019-11-28T11:24:23.313 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com 2019-11-28T11:24:23.313 INFO:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-11-28T11:24:23.865 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-11-28T11:24:23.866 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-28T11:24:23.866 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=0, sparse=0 2019-11-28T11:24:23.866 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-28T11:24:23.867 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2019-11-28T11:24:23.867 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-28T11:24:23.867 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-28T11:24:23.867 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-28T11:24:23.868 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-28T11:24:23.868 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2019-11-28T11:24:23.869 INFO:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2019-11-28T11:24:23.958 INFO:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2019-11-28T11:24:24.015 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2019-11-28T11:24:24.070 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-28T11:24:24.077 INFO:tasks.ceph:{} 2019-11-28T11:24:24.077 INFO:tasks.ceph:osd.7 2019-11-28T11:24:24.078 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com 2019-11-28T11:24:24.078 INFO:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-11-28T11:24:24.621 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-11-28T11:24:24.621 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-28T11:24:24.621 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=0, sparse=0 2019-11-28T11:24:24.621 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-28T11:24:24.622 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2019-11-28T11:24:24.622 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-28T11:24:24.622 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-28T11:24:24.622 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-28T11:24:24.622 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-28T11:24:24.629 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2019-11-28T11:24:24.630 INFO:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2019-11-28T11:24:24.769 INFO:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2019-11-28T11:24:24.858 INFO:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:25.008 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:25.001+0000 7fcf487a4bc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2019-11-28T11:24:25.010 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:25.004+0000 7fcf487a4bc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2019-11-28T11:24:25.011 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:25.004+0000 7fcf487a4bc0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-11-28T11:24:25.011 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:25.004+0000 7fcf487a4bc0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-11-28T11:24:25.011 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:25.004+0000 7fcf487a4bc0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-11-28T11:24:25.018 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:25.011+0000 7fcf487a4bc0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2019-11-28T11:24:27.304 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2019-11-28T11:24:27.363 INFO:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:27.442 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:27.439+0000 7efd96da3bc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2019-11-28T11:24:27.442 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:27.439+0000 7efd96da3bc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2019-11-28T11:24:27.442 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:27.439+0000 7efd96da3bc0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-11-28T11:24:27.443 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:27.439+0000 7efd96da3bc0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-11-28T11:24:27.443 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:27.439+0000 7efd96da3bc0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-11-28T11:24:27.443 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:27.439+0000 7efd96da3bc0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2019-11-28T11:24:29.728 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2019-11-28T11:24:29.789 INFO:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:29.885 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:29.875+0000 7f904995dbc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2019-11-28T11:24:29.886 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:29.875+0000 7f904995dbc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2019-11-28T11:24:29.886 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:29.875+0000 7f904995dbc0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-11-28T11:24:29.886 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:29.875+0000 7f904995dbc0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-11-28T11:24:29.886 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:29.875+0000 7f904995dbc0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-11-28T11:24:29.887 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:29.876+0000 7f904995dbc0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2019-11-28T11:24:32.165 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2019-11-28T11:24:32.224 INFO:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:32.296 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:32.298+0000 7f7481177bc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2019-11-28T11:24:32.297 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:32.298+0000 7f7481177bc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2019-11-28T11:24:32.298 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:32.298+0000 7f7481177bc0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-11-28T11:24:32.298 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:32.298+0000 7f7481177bc0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-11-28T11:24:32.298 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:32.298+0000 7f7481177bc0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-11-28T11:24:32.298 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-28T11:24:32.299+0000 7f7481177bc0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2019-11-28T11:24:34.592 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2019-11-28T11:24:34.646 INFO:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2019-11-28T11:24:34.707 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-28T11:24:34.707 INFO:tasks.ceph:{} 2019-11-28T11:24:34.708 INFO:tasks.ceph:osd.0 2019-11-28T11:24:34.708 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi080.front.sepia.ceph.com 2019-11-28T11:24:34.708 INFO:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-11-28T11:24:35.267 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-11-28T11:24:35.268 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-28T11:24:35.268 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=0, sparse=0 2019-11-28T11:24:35.268 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-28T11:24:35.268 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2019-11-28T11:24:35.268 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-28T11:24:35.268 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-28T11:24:35.269 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-28T11:24:35.269 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-28T11:24:35.270 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2019-11-28T11:24:35.270 INFO:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2019-11-28T11:24:35.397 INFO:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2019-11-28T11:24:35.459 INFO:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2019-11-28T11:24:35.513 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-28T11:24:35.513 INFO:tasks.ceph:{} 2019-11-28T11:24:35.514 INFO:tasks.ceph:osd.1 2019-11-28T11:24:35.514 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com 2019-11-28T11:24:35.514 INFO:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-11-28T11:24:36.023 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-11-28T11:24:36.024 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-28T11:24:36.024 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=0, sparse=0 2019-11-28T11:24:36.024 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-28T11:24:36.024 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2019-11-28T11:24:36.024 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-28T11:24:36.025 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-28T11:24:36.025 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-28T11:24:36.025 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-28T11:24:36.026 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2019-11-28T11:24:36.026 INFO:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2019-11-28T11:24:36.104 INFO:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2019-11-28T11:24:36.159 INFO:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2019-11-28T11:24:36.217 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-28T11:24:36.218 INFO:tasks.ceph:{} 2019-11-28T11:24:36.218 INFO:tasks.ceph:osd.2 2019-11-28T11:24:36.218 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com 2019-11-28T11:24:36.219 INFO:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-11-28T11:24:36.794 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-11-28T11:24:36.794 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-28T11:24:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=0, sparse=0 2019-11-28T11:24:36.795 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-28T11:24:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2019-11-28T11:24:36.795 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-28T11:24:36.799 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-28T11:24:36.799 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-28T11:24:36.799 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-28T11:24:36.801 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2019-11-28T11:24:36.801 INFO:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2019-11-28T11:24:36.913 INFO:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2019-11-28T11:24:36.969 INFO:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2019-11-28T11:24:37.022 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-28T11:24:37.023 INFO:tasks.ceph:{} 2019-11-28T11:24:37.023 INFO:tasks.ceph:osd.3 2019-11-28T11:24:37.023 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi080.front.sepia.ceph.com 2019-11-28T11:24:37.023 INFO:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-11-28T11:24:37.560 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-11-28T11:24:37.560 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-28T11:24:37.560 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=0, sparse=0 2019-11-28T11:24:37.560 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-28T11:24:37.560 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2019-11-28T11:24:37.561 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-28T11:24:37.561 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-28T11:24:37.561 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-28T11:24:37.561 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-28T11:24:37.562 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2019-11-28T11:24:37.563 INFO:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2019-11-28T11:24:37.672 INFO:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2019-11-28T11:24:37.728 INFO:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:37.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:37.780+0000 7f9aafabcbc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2019-11-28T11:24:37.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:37.780+0000 7f9aafabcbc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2019-11-28T11:24:37.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:37.780+0000 7f9aafabcbc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-11-28T11:24:37.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:37.780+0000 7f9aafabcbc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-11-28T11:24:37.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:37.780+0000 7f9aafabcbc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-11-28T11:24:37.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:37.781+0000 7f9aafabcbc0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2019-11-28T11:24:40.096 INFO:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2019-11-28T11:24:40.161 INFO:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:40.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:40.224+0000 7feded747bc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2019-11-28T11:24:40.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:40.224+0000 7feded747bc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2019-11-28T11:24:40.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:40.224+0000 7feded747bc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-11-28T11:24:40.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:40.224+0000 7feded747bc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-11-28T11:24:40.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:40.224+0000 7feded747bc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-11-28T11:24:40.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:40.225+0000 7feded747bc0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2019-11-28T11:24:42.532 INFO:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2019-11-28T11:24:42.595 INFO:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:42.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:42.656+0000 7fbc0952ebc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2019-11-28T11:24:42.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:42.656+0000 7fbc0952ebc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2019-11-28T11:24:42.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:42.656+0000 7fbc0952ebc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-11-28T11:24:42.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:42.656+0000 7fbc0952ebc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-11-28T11:24:42.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:42.656+0000 7fbc0952ebc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-11-28T11:24:42.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:42.657+0000 7fbc0952ebc0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2019-11-28T11:24:44.966 INFO:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2019-11-28T11:24:45.319 INFO:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:45.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:45.375+0000 7f8123f13bc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2019-11-28T11:24:45.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:45.375+0000 7f8123f13bc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2019-11-28T11:24:45.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:45.375+0000 7f8123f13bc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-11-28T11:24:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:45.375+0000 7f8123f13bc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-11-28T11:24:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:45.375+0000 7f8123f13bc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-11-28T11:24:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:45.376+0000 7f8123f13bc0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2019-11-28T11:24:47.392 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:47.398 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:47.405 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:47.411 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:47.416 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:47.420 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:24:47.683 INFO:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2019-11-28T11:24:47.737 INFO:tasks.ceph:Reading keys from all nodes... 2019-11-28T11:24:47.737 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-28T11:24:47.786 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.iokbXCqzUV 2019-11-28T11:24:47.787 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.iokbXCqzUV 2019-11-28T11:24:47.843 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.iokbXCqzUV 2019-11-28T11:24:47.960 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.iokbXCqzUV is 56B 2019-11-28T11:24:48.010 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.iokbXCqzUV 2019-11-28T11:24:48.050 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-28T11:24:48.155 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.mEyrGmbDo0 2019-11-28T11:24:48.155 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/mds/ceph-c/keyring /tmp/tmp.mEyrGmbDo0 2019-11-28T11:24:48.272 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.mEyrGmbDo0 2019-11-28T11:24:48.376 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.mEyrGmbDo0 is 56B 2019-11-28T11:24:48.426 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.mEyrGmbDo0 2019-11-28T11:24:48.490 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-28T11:24:48.578 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.Q1CcJEiz0x 2019-11-28T11:24:48.579 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.Q1CcJEiz0x 2019-11-28T11:24:48.698 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.Q1CcJEiz0x 2019-11-28T11:24:48.800 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.Q1CcJEiz0x is 56B 2019-11-28T11:24:48.848 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.Q1CcJEiz0x 2019-11-28T11:24:48.889 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-28T11:24:49.016 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.8Sh4Ou1mpN 2019-11-28T11:24:49.016 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.8Sh4Ou1mpN 2019-11-28T11:24:49.138 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.8Sh4Ou1mpN 2019-11-28T11:24:49.234 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.8Sh4Ou1mpN is 56B 2019-11-28T11:24:49.284 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.8Sh4Ou1mpN 2019-11-28T11:24:49.326 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-28T11:24:49.433 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.5GEIsdGPxn 2019-11-28T11:24:49.433 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.5GEIsdGPxn 2019-11-28T11:24:49.552 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.5GEIsdGPxn 2019-11-28T11:24:49.651 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.5GEIsdGPxn is 56B 2019-11-28T11:24:49.723 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.5GEIsdGPxn 2019-11-28T11:24:49.768 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-28T11:24:49.876 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.ED8TQcPql8 2019-11-28T11:24:49.877 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.ED8TQcPql8 2019-11-28T11:24:49.996 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.ED8TQcPql8 2019-11-28T11:24:50.104 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.ED8TQcPql8 is 56B 2019-11-28T11:24:50.155 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.ED8TQcPql8 2019-11-28T11:24:50.196 INFO:teuthology.orchestra.run.smithi080:> mktemp 2019-11-28T11:24:50.242 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.9TOt7191Fe 2019-11-28T11:24:50.243 INFO:teuthology.orchestra.run.smithi080:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.9TOt7191Fe 2019-11-28T11:24:50.364 INFO:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.9TOt7191Fe 2019-11-28T11:24:50.465 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.9TOt7191Fe is 56B 2019-11-28T11:24:50.519 INFO:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.9TOt7191Fe 2019-11-28T11:24:50.562 INFO:teuthology.orchestra.run.smithi080:> mktemp 2019-11-28T11:24:50.669 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.ZVWpBLHUBC 2019-11-28T11:24:50.670 INFO:teuthology.orchestra.run.smithi080:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.ZVWpBLHUBC 2019-11-28T11:24:50.790 INFO:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.ZVWpBLHUBC 2019-11-28T11:24:50.907 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.ZVWpBLHUBC is 56B 2019-11-28T11:24:50.957 INFO:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.ZVWpBLHUBC 2019-11-28T11:24:50.998 INFO:teuthology.orchestra.run.smithi080:> mktemp 2019-11-28T11:24:51.105 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.Q2KbwA5PXR 2019-11-28T11:24:51.106 INFO:teuthology.orchestra.run.smithi080:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.Q2KbwA5PXR 2019-11-28T11:24:51.230 INFO:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.Q2KbwA5PXR 2019-11-28T11:24:51.443 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.Q2KbwA5PXR is 56B 2019-11-28T11:24:51.504 INFO:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.Q2KbwA5PXR 2019-11-28T11:24:51.551 INFO:teuthology.orchestra.run.smithi080:> mktemp 2019-11-28T11:24:51.656 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.3JJqhcOVfb 2019-11-28T11:24:51.657 INFO:teuthology.orchestra.run.smithi080:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.3JJqhcOVfb 2019-11-28T11:24:51.779 INFO:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.3JJqhcOVfb 2019-11-28T11:24:51.949 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.3JJqhcOVfb is 56B 2019-11-28T11:24:51.998 INFO:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.3JJqhcOVfb 2019-11-28T11:24:52.043 INFO:teuthology.orchestra.run.smithi080:> mktemp 2019-11-28T11:24:52.158 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.o8B0zOKWbQ 2019-11-28T11:24:52.158 INFO:teuthology.orchestra.run.smithi080:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.o8B0zOKWbQ 2019-11-28T11:24:52.280 INFO:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.o8B0zOKWbQ 2019-11-28T11:24:52.378 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.o8B0zOKWbQ is 56B 2019-11-28T11:24:52.425 INFO:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.o8B0zOKWbQ 2019-11-28T11:24:52.466 INFO:teuthology.orchestra.run.smithi080:> mktemp 2019-11-28T11:24:52.571 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.Fjvg5DAaNk 2019-11-28T11:24:52.571 INFO:teuthology.orchestra.run.smithi080:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.Fjvg5DAaNk 2019-11-28T11:24:52.689 INFO:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.Fjvg5DAaNk 2019-11-28T11:24:52.821 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.Fjvg5DAaNk is 56B 2019-11-28T11:24:52.870 INFO:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.Fjvg5DAaNk 2019-11-28T11:24:52.911 INFO:teuthology.orchestra.run.smithi080:> mktemp 2019-11-28T11:24:53.018 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.Ea9hT9IL2P 2019-11-28T11:24:53.018 INFO:teuthology.orchestra.run.smithi080:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.Ea9hT9IL2P 2019-11-28T11:24:53.135 INFO:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.Ea9hT9IL2P 2019-11-28T11:24:53.233 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.Ea9hT9IL2P is 56B 2019-11-28T11:24:53.281 INFO:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.Ea9hT9IL2P 2019-11-28T11:24:53.373 DEBUG:teuthology.orchestra.remote:smithi076:/etc/ceph/ceph.client.0.keyring is 59B 2019-11-28T11:24:53.506 DEBUG:teuthology.orchestra.remote:smithi133:/etc/ceph/ceph.client.3.keyring is 59B 2019-11-28T11:24:53.632 DEBUG:teuthology.orchestra.remote:smithi075:/etc/ceph/ceph.client.2.keyring is 59B 2019-11-28T11:24:53.733 DEBUG:teuthology.orchestra.remote:smithi016:/etc/ceph/ceph.client.1.keyring is 59B 2019-11-28T11:24:53.785 INFO:tasks.ceph:Adding keys to all mons... 2019-11-28T11:24:53.785 INFO:teuthology.orchestra.run.smithi080:> sudo tee -a /etc/ceph/ceph.keyring 2019-11-28T11:24:53.789 INFO:teuthology.orchestra.run.smithi174:> sudo tee -a /etc/ceph/ceph.keyring 2019-11-28T11:24:53.837 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.x] 2019-11-28T11:24:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA== 2019-11-28T11:24:53.838 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.c] 2019-11-28T11:24:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg== 2019-11-28T11:24:53.838 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.4] 2019-11-28T11:24:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg== 2019-11-28T11:24:53.838 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.5] 2019-11-28T11:24:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig== 2019-11-28T11:24:53.839 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.6] 2019-11-28T11:24:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg== 2019-11-28T11:24:53.839 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.7] 2019-11-28T11:24:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw== 2019-11-28T11:24:53.839 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.y] 2019-11-28T11:24:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg== 2019-11-28T11:24:53.839 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.a] 2019-11-28T11:24:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q== 2019-11-28T11:24:53.840 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.b] 2019-11-28T11:24:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw== 2019-11-28T11:24:53.840 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.0] 2019-11-28T11:24:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g== 2019-11-28T11:24:53.840 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.1] 2019-11-28T11:24:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw== 2019-11-28T11:24:53.841 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.2] 2019-11-28T11:24:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw== 2019-11-28T11:24:53.841 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.3] 2019-11-28T11:24:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA== 2019-11-28T11:24:53.841 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2019-11-28T11:24:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA== 2019-11-28T11:24:53.841 INFO:teuthology.orchestra.run.smithi080.stdout:[client.3] 2019-11-28T11:24:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA== 2019-11-28T11:24:53.842 INFO:teuthology.orchestra.run.smithi080.stdout:[client.2] 2019-11-28T11:24:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ== 2019-11-28T11:24:53.842 INFO:teuthology.orchestra.run.smithi080.stdout:[client.1] 2019-11-28T11:24:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg== 2019-11-28T11:24:53.848 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.x] 2019-11-28T11:24:53.848 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA== 2019-11-28T11:24:53.849 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2019-11-28T11:24:53.849 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg== 2019-11-28T11:24:53.849 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.4] 2019-11-28T11:24:53.849 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg== 2019-11-28T11:24:53.850 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.5] 2019-11-28T11:24:53.850 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig== 2019-11-28T11:24:53.850 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.6] 2019-11-28T11:24:53.850 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg== 2019-11-28T11:24:53.851 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.7] 2019-11-28T11:24:53.851 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw== 2019-11-28T11:24:53.851 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.y] 2019-11-28T11:24:53.852 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg== 2019-11-28T11:24:53.852 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2019-11-28T11:24:53.852 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q== 2019-11-28T11:24:53.853 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2019-11-28T11:24:53.853 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw== 2019-11-28T11:24:53.853 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.0] 2019-11-28T11:24:53.853 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g== 2019-11-28T11:24:53.854 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.1] 2019-11-28T11:24:53.854 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw== 2019-11-28T11:24:53.854 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.2] 2019-11-28T11:24:53.854 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw== 2019-11-28T11:24:53.855 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.3] 2019-11-28T11:24:53.855 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA== 2019-11-28T11:24:53.855 INFO:teuthology.orchestra.run.smithi174.stdout:[client.0] 2019-11-28T11:24:53.855 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA== 2019-11-28T11:24:53.855 INFO:teuthology.orchestra.run.smithi174.stdout:[client.3] 2019-11-28T11:24:53.856 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA== 2019-11-28T11:24:53.856 INFO:teuthology.orchestra.run.smithi174.stdout:[client.2] 2019-11-28T11:24:53.856 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ== 2019-11-28T11:24:53.856 INFO:teuthology.orchestra.run.smithi174.stdout:[client.1] 2019-11-28T11:24:53.857 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg== 2019-11-28T11:24:53.859 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-28T11:24:53.896 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-28T11:24:53.981 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2019-11-28T11:24:53.986 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2019-11-28T11:24:54.067 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T11:24:54.072 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T11:24:54.163 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T11:24:54.167 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T11:24:54.244 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T11:24:54.248 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T11:24:54.325 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T11:24:54.330 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T11:24:54.407 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-28T11:24:54.412 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-28T11:24:54.489 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2019-11-28T11:24:54.493 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2019-11-28T11:24:54.573 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2019-11-28T11:24:54.577 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2019-11-28T11:24:54.657 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T11:24:54.662 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T11:24:54.740 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T11:24:55.018 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T11:24:55.096 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T11:24:55.101 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T11:24:55.188 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T11:24:55.192 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T11:24:55.269 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-28T11:24:55.275 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-28T11:24:55.355 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-28T11:24:55.373 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-28T11:24:55.453 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-28T11:24:55.457 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-28T11:24:55.538 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-28T11:24:55.542 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-28T11:24:55.623 INFO:tasks.ceph:Running mkfs on mon nodes... 2019-11-28T11:24:55.623 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2019-11-28T11:24:55.680 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-28T11:24:55.764 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2019-11-28T11:24:55.823 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2019-11-28T11:24:55.884 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-28T11:24:55.970 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2019-11-28T11:24:56.051 INFO:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2019-11-28T11:24:56.111 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-28T11:24:56.263 INFO:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2019-11-28T11:24:56.315 INFO:teuthology.orchestra.run.smithi080:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:56.319 INFO:teuthology.orchestra.run.smithi174:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-11-28T11:24:56.362 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2019-11-28T11:24:56.362 INFO:tasks.ceph.mon.b:Restarting daemon 2019-11-28T11:24:56.363 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2019-11-28T11:24:56.439 INFO:tasks.ceph.mon.b:Started 2019-11-28T11:24:56.440 INFO:tasks.ceph.mon.c:Restarting daemon 2019-11-28T11:24:56.440 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2019-11-28T11:24:56.444 INFO:tasks.ceph.mon.c:Started 2019-11-28T11:24:56.445 INFO:tasks.ceph.mon.a:Restarting daemon 2019-11-28T11:24:56.445 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2019-11-28T11:24:56.450 INFO:tasks.ceph.mon.a:Started 2019-11-28T11:24:56.450 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2019-11-28T11:24:56.450 INFO:tasks.ceph.mgr.x:Restarting daemon 2019-11-28T11:24:56.451 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2019-11-28T11:24:56.455 INFO:tasks.ceph.mgr.x:Started 2019-11-28T11:24:56.455 INFO:tasks.ceph.mgr.y:Restarting daemon 2019-11-28T11:24:56.456 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2019-11-28T11:24:56.459 INFO:tasks.ceph.mgr.y:Started 2019-11-28T11:24:56.460 INFO:tasks.ceph:Setting crush tunables to default 2019-11-28T11:24:56.460 INFO:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd crush tunables default 2019-11-28T11:24:56.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.564+0000 7f965aede700 1 Processor -- start 2019-11-28T11:24:56.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.565+0000 7f965aede700 1 -- start start 2019-11-28T11:24:56.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f965aede700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f965406c0a0 0x7f9654072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:24:56.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f965aede700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96540734e0 0x7f9654071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:24:56.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f965aede700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f965406db00 con 0x7f9654072360 2019-11-28T11:24:56.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f965aede700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965406fd60 con 0x7f965406c0a0 2019-11-28T11:24:56.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f965aede700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9654070030 con 0x7f96540734e0 2019-11-28T11:24:56.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f965947b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f965406c0a0 0x7f9654072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:24:56.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f965947b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f965406c0a0 0x7f9654072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58546/0 (socket says 172.21.15.80:58546) 2019-11-28T11:24:56.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f965947b700 1 -- 172.21.15.80:0/2719464691 learned_addr learned my addr 172.21.15.80:0/2719464691 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:24:56.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f9658c7a700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96540734e0 0x7f9654071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:24:56.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f965947b700 1 -- 172.21.15.80:0/2719464691 >> v2:172.21.15.80:3300/0 conn(0x7f965406c0a0 msgr2=0x7f9654072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2019-11-28T11:24:56.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f965947b700 1 -- 172.21.15.80:0/2719464691 >> v2:172.21.15.80:3300/0 conn(0x7f965406c0a0 msgr2=0x7f9654072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2019-11-28T11:24:56.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f965947b700 1 --2- 172.21.15.80:0/2719464691 >> v2:172.21.15.80:3300/0 conn(0x7f965406c0a0 0x7f9654072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2019-11-28T11:24:56.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f965947b700 1 --2- 172.21.15.80:0/2719464691 >> v2:172.21.15.80:3300/0 conn(0x7f965406c0a0 0x7f9654072fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2019-11-28T11:24:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f9658c7a700 1 -- 172.21.15.80:0/2719464691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96540734e0 msgr2=0x7f9654071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2019-11-28T11:24:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f9658c7a700 1 -- 172.21.15.80:0/2719464691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96540734e0 msgr2=0x7f9654071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2019-11-28T11:24:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f9658c7a700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96540734e0 0x7f9654071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2019-11-28T11:24:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.566+0000 7f9658c7a700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96540734e0 0x7f9654071e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2019-11-28T11:24:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.573+0000 7f9647fff700 1 -- 172.21.15.80:0/2719464691 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273677421 0 0) 0x7f964c000d30 con 0x7f9654072360 2019-11-28T11:24:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.573+0000 7f9647fff700 1 -- 172.21.15.80:0/2719464691 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9640002e80 con 0x7f9654072360 2019-11-28T11:24:56.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.573+0000 7f9647fff700 1 -- 172.21.15.80:0/2719464691 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2427562809 0 0) 0x7f964c0013e0 con 0x7f9654072360 2019-11-28T11:24:56.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.573+0000 7f9647fff700 1 -- 172.21.15.80:0/2719464691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96540734e0 msgr2=0x7f9654071e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2019-11-28T11:24:56.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.573+0000 7f9647fff700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96540734e0 0x7f9654071e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:24:56.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.573+0000 7f9647fff700 1 -- 172.21.15.80:0/2719464691 >> v2:172.21.15.80:3300/0 conn(0x7f965406c0a0 msgr2=0x7f9654072fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2019-11-28T11:24:56.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.573+0000 7f9647fff700 1 --2- 172.21.15.80:0/2719464691 >> v2:172.21.15.80:3300/0 conn(0x7f965406c0a0 0x7f9654072fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:24:56.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.573+0000 7f9647fff700 1 -- 172.21.15.80:0/2719464691 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96540706c0 con 0x7f9654072360 2019-11-28T11:24:56.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.573+0000 7f9647fff700 1 -- 172.21.15.80:0/2719464691 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f964c0017f0 con 0x7f9654072360 2019-11-28T11:24:56.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.573+0000 7f9647fff700 1 -- 172.21.15.80:0/2719464691 >> v1:172.21.15.174:6789/0 conn(0x7f9654072360 legacy=0x7f965406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:24:56.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.573+0000 7f9647fff700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96400479e0 0x7f9640049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:24:56.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.573+0000 7f9647fff700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f964004a5c0 0x7f964004ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:24:56.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.573+0000 7f9647fff700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f964004d2f0 0x7f964004f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:24:56.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.573+0000 7f9647fff700 1 -- 172.21.15.80:0/2719464691 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964004ff40 con 0x7f964004a5c0 2019-11-28T11:24:56.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.573+0000 7f9647fff700 1 -- 172.21.15.80:0/2719464691 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9640050130 con 0x7f96400479e0 2019-11-28T11:24:56.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.573+0000 7f9647fff700 1 -- 172.21.15.80:0/2719464691 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9640050360 con 0x7f964004d2f0 2019-11-28T11:24:56.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.574+0000 7f9658c7a700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f964004a5c0 0x7f964004ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:24:56.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.574+0000 7f965947b700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96400479e0 0x7f9640049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:24:56.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.574+0000 7f9659c7c700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f964004d2f0 0x7f964004f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:24:56.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.574+0000 7f9658c7a700 1 -- 172.21.15.80:0/2719464691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f964004d2f0 msgr2=0x7f964004f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:24:56.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.574+0000 7f9658c7a700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f964004d2f0 0x7f964004f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:24:56.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.574+0000 7f9658c7a700 1 -- 172.21.15.80:0/2719464691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96400479e0 msgr2=0x7f9640049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:24:56.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.574+0000 7f9658c7a700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96400479e0 0x7f9640049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:24:56.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.574+0000 7f9658c7a700 1 -- 172.21.15.80:0/2719464691 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9640050610 con 0x7f964004a5c0 2019-11-28T11:24:56.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.574+0000 7f9658c7a700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f964004a5c0 0x7f964004ca90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f965000afc0 tx=0x7f965000b2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:24:56.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.574+0000 7f9658c7a700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f964004a5c0 0x7f964004ca90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f965000afc0 tx=0x7f965000b2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:24:56.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.574+0000 7f9658c7a700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f964004a5c0 0x7f964004ca90 secure :-1 s=READY pgs=3 cs=0 l=1 rx=0x7f965000afc0 tx=0x7f965000b2c0).ready entity=mon.0 client_cookie=341d0a18ec906efb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:24:56.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.575+0000 7f9658c7a700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f964004a5c0 0x7f964004ca90 secure :-1 s=THROTTLE_DONE pgs=3 cs=0 l=1 rx=0x7f965000afc0 tx=0x7f965000b2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:24:56.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.575+0000 7f9647fff700 1 -- 172.21.15.80:0/2719464691 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9650000ff0 con 0x7f964004a5c0 2019-11-28T11:24:56.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.575+0000 7f9658c7a700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f964004a5c0 0x7f964004ca90 secure :-1 s=THROTTLE_DONE pgs=3 cs=0 l=1 rx=0x7f965000afc0 tx=0x7f965000b2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:24:56.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.575+0000 7f9658c7a700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f964004a5c0 0x7f964004ca90 secure :-1 s=THROTTLE_DONE pgs=3 cs=0 l=1 rx=0x7f965000afc0 tx=0x7f965000b2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:24:56.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.575+0000 7f9647fff700 1 -- 172.21.15.80:0/2719464691 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9650000bc0 con 0x7f964004a5c0 2019-11-28T11:24:56.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.575+0000 7f9647fff700 1 -- 172.21.15.80:0/2719464691 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96500015d0 con 0x7f964004a5c0 2019-11-28T11:24:56.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.575+0000 7f965aede700 1 -- 172.21.15.80:0/2719464691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f964004a5c0 msgr2=0x7f964004ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:24:56.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.575+0000 7f965aede700 1 --2- 172.21.15.80:0/2719464691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f964004a5c0 0x7f964004ca90 secure :-1 s=READY pgs=3 cs=0 l=1 rx=0x7f965000afc0 tx=0x7f965000b2c0).stop 2019-11-28T11:24:56.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.575+0000 7f9659c7c700 1 -- 172.21.15.80:0/2719464691 reap_dead start 2019-11-28T11:24:56.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.575+0000 7f965aede700 1 -- 172.21.15.80:0/2719464691 shutdown_connections 2019-11-28T11:24:56.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.576+0000 7f965aede700 1 -- 172.21.15.80:0/2719464691 shutdown_connections 2019-11-28T11:24:56.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.576+0000 7f965aede700 1 -- 172.21.15.80:0/2719464691 wait complete. 2019-11-28T11:24:56.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.576+0000 7f965aede700 1 -- 172.21.15.80:0/2719464691 >> 172.21.15.80:0/2719464691 conn(0x7f9654061cf0 msgr2=0x7f9654064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:24:56.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.578+0000 7f965aede700 1 Processor -- start 2019-11-28T11:24:56.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.578+0000 7f965aede700 1 -- start start 2019-11-28T11:24:56.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.579+0000 7f965aede700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f96541061f0 0x7f965410f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:24:56.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.579+0000 7f965aede700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9654107940 con 0x7f9654165d70 2019-11-28T11:24:56.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.579+0000 7f965aede700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f965410fa60 con 0x7f965413a350 2019-11-28T11:24:56.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.579+0000 7f965aede700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965410c300 con 0x7f96541061f0 2019-11-28T11:24:56.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.579+0000 7f965947b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f96541061f0 0x7f965410f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:24:56.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.579+0000 7f9659c7c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9654165d70 0x7f9654168170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:57878/0 (socket says 172.21.15.80:57878) 2019-11-28T11:24:56.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.579+0000 7f965947b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f96541061f0 0x7f965410f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58558/0 (socket says 172.21.15.80:58558) 2019-11-28T11:24:56.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.579+0000 7f9659c7c700 1 -- 172.21.15.80:0/3713885995 learned_addr learned my addr 172.21.15.80:0/3713885995 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:24:56.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.580+0000 7f965947b700 1 -- 172.21.15.80:0/3713885995 >> v1:172.21.15.174:6789/0 conn(0x7f965413a350 legacy=0x7f965413a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:24:56.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.580+0000 7f965947b700 1 -- 172.21.15.80:0/3713885995 >> v1:172.21.15.80:6789/0 conn(0x7f9654165d70 legacy=0x7f9654168170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:24:56.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.580+0000 7f965947b700 1 -- 172.21.15.80:0/3713885995 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965410cc60 con 0x7f96541061f0 2019-11-28T11:24:56.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.580+0000 7f965947b700 1 --2- 172.21.15.80:0/3713885995 >> v2:172.21.15.80:3300/0 conn(0x7f96541061f0 0x7f965410f520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96480103c0 tx=0x7f9648010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:24:56.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.580+0000 7f965947b700 1 --2- 172.21.15.80:0/3713885995 >> v2:172.21.15.80:3300/0 conn(0x7f96541061f0 0x7f965410f520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96480103c0 tx=0x7f9648010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:24:56.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.580+0000 7f965947b700 1 --2- 172.21.15.80:0/3713885995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96541061f0 0x7f965410f520 secure :-1 s=READY pgs=5 cs=0 l=1 rx=0x7f96480103c0 tx=0x7f9648010760).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:24:56.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.580+0000 7f965947b700 1 --2- 172.21.15.80:0/3713885995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96541061f0 0x7f965410f520 secure :-1 s=THROTTLE_DONE pgs=5 cs=0 l=1 rx=0x7f96480103c0 tx=0x7f9648010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:24:56.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.580+0000 7f965947b700 1 --2- 172.21.15.80:0/3713885995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96541061f0 0x7f965410f520 secure :-1 s=THROTTLE_DONE pgs=5 cs=0 l=1 rx=0x7f96480103c0 tx=0x7f9648010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:24:56.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.580+0000 7f965947b700 1 --2- 172.21.15.80:0/3713885995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96541061f0 0x7f965410f520 secure :-1 s=THROTTLE_DONE pgs=5 cs=0 l=1 rx=0x7f96480103c0 tx=0x7f9648010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:24:56.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.580+0000 7f9645ffb700 1 -- 172.21.15.80:0/3713885995 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96480009b0 con 0x7f96541061f0 2019-11-28T11:24:56.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.580+0000 7f9645ffb700 1 -- 172.21.15.80:0/3713885995 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9648000c90 con 0x7f96541061f0 2019-11-28T11:24:56.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.580+0000 7f965aede700 1 -- 172.21.15.80:0/3713885995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965410cfe0 con 0x7f96541061f0 2019-11-28T11:24:56.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.580+0000 7f9645ffb700 1 -- 172.21.15.80:0/3713885995 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9648001360 con 0x7f96541061f0 2019-11-28T11:24:56.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.580+0000 7f965aede700 1 -- 172.21.15.80:0/3713885995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965410cc60 con 0x7f96541061f0 2019-11-28T11:24:56.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.581+0000 7f965947b700 1 --2- 172.21.15.80:0/3713885995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96541061f0 0x7f965410f520 secure :-1 s=THROTTLE_DONE pgs=5 cs=0 l=1 rx=0x7f96480103c0 tx=0x7f9648010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:24:56.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.581+0000 7f965947b700 1 --2- 172.21.15.80:0/3713885995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96541061f0 0x7f965410f520 secure :-1 s=THROTTLE_DONE pgs=5 cs=0 l=1 rx=0x7f96480103c0 tx=0x7f9648010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:24:56.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.581+0000 7f9645ffb700 1 -- 172.21.15.80:0/3713885995 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 341+0+0 (secure 0 0 0) 0x7f9648000e80 con 0x7f96541061f0 2019-11-28T11:24:56.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.581+0000 7f9645ffb700 1 -- 172.21.15.80:0/3713885995 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f96480009b0 con 0x7f96541061f0 2019-11-28T11:24:56.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.596+0000 7f965aede700 1 -- 172.21.15.80:0/3713885995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965410cfe0 con 0x7f96541061f0 2019-11-28T11:24:56.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.598+0000 7f965947b700 1 --2- 172.21.15.80:0/3713885995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96541061f0 0x7f965410f520 secure :-1 s=THROTTLE_DONE pgs=5 cs=0 l=1 rx=0x7f96480103c0 tx=0x7f9648010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:24:56.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.598+0000 7f9645ffb700 1 -- 172.21.15.80:0/3713885995 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66539 (secure 0 0 0) 0x7f96480072a0 con 0x7f96541061f0 2019-11-28T11:24:56.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.688+0000 7f965aede700 1 -- 172.21.15.80:0/3713885995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"profile": "default", "prefix": "osd crush tunables"} v 0) v1 -- 0x7f965410cc60 con 0x7f96541061f0 2019-11-28T11:24:56.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.690+0000 7f965947b700 1 --2- 172.21.15.80:0/3713885995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96541061f0 0x7f965410f520 secure :-1 s=THROTTLE_DONE pgs=5 cs=0 l=1 rx=0x7f96480103c0 tx=0x7f9648010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:24:56.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.690+0000 7f9645ffb700 1 -- 172.21.15.80:0/3713885995 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"profile": "default", "prefix": "osd crush tunables"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f96480079c0 con 0x7f96541061f0 2019-11-28T11:24:56.710 INFO:teuthology.orchestra.run.smithi080.stderr:adjusted tunables profile to default 2019-11-28T11:24:56.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.692+0000 7f965aede700 1 -- 172.21.15.80:0/3713885995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96541061f0 msgr2=0x7f965410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:24:56.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.692+0000 7f965aede700 1 --2- 172.21.15.80:0/3713885995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96541061f0 0x7f965410f520 secure :-1 s=READY pgs=5 cs=0 l=1 rx=0x7f96480103c0 tx=0x7f9648010760).stop 2019-11-28T11:24:56.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.692+0000 7f965aede700 1 -- 172.21.15.80:0/3713885995 shutdown_connections 2019-11-28T11:24:56.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.692+0000 7f965aede700 1 --2- 172.21.15.80:0/3713885995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96541061f0 0x7f965410f520 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:24:56.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.692+0000 7f965aede700 1 -- 172.21.15.80:0/3713885995 shutdown_connections 2019-11-28T11:24:56.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.692+0000 7f965aede700 1 -- 172.21.15.80:0/3713885995 wait complete. 2019-11-28T11:24:56.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:24:56.692+0000 7f965aede700 1 -- 172.21.15.80:0/3713885995 >> 172.21.15.80:0/3713885995 conn(0x7f9654142090 msgr2=0x7f965410ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:24:56.721 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2019-11-28T11:24:56.721 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-28T11:24:56.797 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.qV0RSVcqtq 2019-11-28T11:24:56.798 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.qV0RSVcqtq 2019-11-28T11:24:56.918 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.qV0RSVcqtq 2019-11-28T11:24:57.044 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.qV0RSVcqtq is 37B 2019-11-28T11:24:57.096 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.qV0RSVcqtq 2019-11-28T11:24:57.139 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-28T11:24:57.244 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.CjpaVdGJmN 2019-11-28T11:24:57.244 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.CjpaVdGJmN 2019-11-28T11:24:57.365 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.CjpaVdGJmN 2019-11-28T11:24:57.511 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.CjpaVdGJmN is 37B 2019-11-28T11:24:57.637 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.CjpaVdGJmN 2019-11-28T11:24:57.692 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-28T11:24:57.817 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.fHGp82JLYx 2019-11-28T11:24:57.818 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.fHGp82JLYx 2019-11-28T11:24:57.937 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.fHGp82JLYx 2019-11-28T11:24:58.037 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.fHGp82JLYx is 37B 2019-11-28T11:24:58.088 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.fHGp82JLYx 2019-11-28T11:24:58.129 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-28T11:24:58.235 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.7hY9bCk4eE 2019-11-28T11:24:58.236 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.7hY9bCk4eE 2019-11-28T11:24:58.355 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.7hY9bCk4eE 2019-11-28T11:24:58.454 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.7hY9bCk4eE is 37B 2019-11-28T11:24:58.503 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.7hY9bCk4eE 2019-11-28T11:24:58.545 INFO:teuthology.orchestra.run.smithi080:> mktemp 2019-11-28T11:24:58.599 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.gMqxAoFp1n 2019-11-28T11:24:58.599 INFO:teuthology.orchestra.run.smithi080:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.gMqxAoFp1n 2019-11-28T11:24:58.728 INFO:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.gMqxAoFp1n 2019-11-28T11:24:58.902 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.gMqxAoFp1n is 37B 2019-11-28T11:24:58.972 INFO:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.gMqxAoFp1n 2019-11-28T11:24:59.014 INFO:teuthology.orchestra.run.smithi080:> mktemp 2019-11-28T11:24:59.093 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.8dpIoUeKfD 2019-11-28T11:24:59.094 INFO:teuthology.orchestra.run.smithi080:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.8dpIoUeKfD 2019-11-28T11:24:59.209 INFO:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.8dpIoUeKfD 2019-11-28T11:24:59.315 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.8dpIoUeKfD is 37B 2019-11-28T11:24:59.364 INFO:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.8dpIoUeKfD 2019-11-28T11:24:59.405 INFO:teuthology.orchestra.run.smithi080:> mktemp 2019-11-28T11:24:59.510 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.rHOhbYQm4N 2019-11-28T11:24:59.511 INFO:teuthology.orchestra.run.smithi080:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.rHOhbYQm4N 2019-11-28T11:24:59.627 INFO:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.rHOhbYQm4N 2019-11-28T11:24:59.726 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.rHOhbYQm4N is 37B 2019-11-28T11:24:59.783 INFO:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.rHOhbYQm4N 2019-11-28T11:24:59.827 INFO:teuthology.orchestra.run.smithi080:> mktemp 2019-11-28T11:24:59.933 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.D1vZ193UtH 2019-11-28T11:24:59.933 INFO:teuthology.orchestra.run.smithi080:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.D1vZ193UtH 2019-11-28T11:25:00.054 INFO:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.D1vZ193UtH 2019-11-28T11:25:00.154 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.D1vZ193UtH is 37B 2019-11-28T11:25:00.206 INFO:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.D1vZ193UtH 2019-11-28T11:25:00.249 INFO:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new 9a5b82f5-994b-42f6-82f9-82cf5ff644a5 0 2019-11-28T11:25:00.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.414+0000 7f10bd3bf700 1 Processor -- start 2019-11-28T11:25:00.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.414+0000 7f10bd3bf700 1 -- start start 2019-11-28T11:25:00.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10bd3bf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f10b806c0a0 0x7f10b8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:00.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10bd3bf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10b80734e0 0x7f10b8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:00.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10bd3bf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10b8072360 0x7f10b8072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:00.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10bd3bf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b806fd60 con 0x7f10b80734e0 2019-11-28T11:25:00.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10bd3bf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b8070030 con 0x7f10b806c0a0 2019-11-28T11:25:00.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10bd3bf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b806f330 con 0x7f10b8072360 2019-11-28T11:25:00.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10b6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10b80734e0 0x7f10b8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:00.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10b6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10b80734e0 0x7f10b8071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58582/0 (socket says 172.21.15.80:58582) 2019-11-28T11:25:00.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10b6ffd700 1 -- 172.21.15.80:0/3544363973 learned_addr learned my addr 172.21.15.80:0/3544363973 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:00.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10b77fe700 1 --2- 172.21.15.80:0/3544363973 >> v2:172.21.15.174:3300/0 conn(0x7f10b806c0a0 0x7f10b8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:00.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10b7fff700 1 --2- 172.21.15.80:0/3544363973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10b8072360 0x7f10b8072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:00.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10b6ffd700 1 -- 172.21.15.80:0/3544363973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10b8072360 msgr2=0x7f10b8072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:00.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10b6ffd700 1 --2- 172.21.15.80:0/3544363973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10b8072360 0x7f10b8072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:00.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10b6ffd700 1 -- 172.21.15.80:0/3544363973 >> v2:172.21.15.174:3300/0 conn(0x7f10b806c0a0 msgr2=0x7f10b8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:00.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10b6ffd700 1 --2- 172.21.15.80:0/3544363973 >> v2:172.21.15.174:3300/0 conn(0x7f10b806c0a0 0x7f10b8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:00.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10b6ffd700 1 -- 172.21.15.80:0/3544363973 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b80706c0 con 0x7f10b80734e0 2019-11-28T11:25:00.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10b77fe700 1 --2- 172.21.15.80:0/3544363973 >> v2:172.21.15.174:3300/0 conn(0x7f10b806c0a0 0x7f10b8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:00.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.415+0000 7f10b7fff700 1 --2- 172.21.15.80:0/3544363973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10b8072360 0x7f10b8072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:00.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.416+0000 7f10b6ffd700 1 --2- 172.21.15.80:0/3544363973 >> v2:172.21.15.80:3300/0 conn(0x7f10b80734e0 0x7f10b8071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f10a000fac0 tx=0x7f10a000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:00.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.416+0000 7f10b6ffd700 1 --2- 172.21.15.80:0/3544363973 >> v2:172.21.15.80:3300/0 conn(0x7f10b80734e0 0x7f10b8071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f10a000fac0 tx=0x7f10a000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:00.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.416+0000 7f10b6ffd700 1 --2- 172.21.15.80:0/3544363973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b80734e0 0x7f10b8071e20 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7f10a000fac0 tx=0x7f10a000fe60).ready entity=mon.0 client_cookie=5dcebaa4674587df server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:00.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.416+0000 7f10b6ffd700 1 --2- 172.21.15.80:0/3544363973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b80734e0 0x7f10b8071e20 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7f10a000fac0 tx=0x7f10a000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:00.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.416+0000 7f10b6ffd700 1 --2- 172.21.15.80:0/3544363973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b80734e0 0x7f10b8071e20 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7f10a000fac0 tx=0x7f10a000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:00.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.416+0000 7f10b67fc700 1 -- 172.21.15.80:0/3544363973 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10a0000ce0 con 0x7f10b80734e0 2019-11-28T11:25:00.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.416+0000 7f10b6ffd700 1 --2- 172.21.15.80:0/3544363973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b80734e0 0x7f10b8071e20 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7f10a000fac0 tx=0x7f10a000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:00.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.416+0000 7f10b67fc700 1 -- 172.21.15.80:0/3544363973 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a0001200 con 0x7f10b80734e0 2019-11-28T11:25:00.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.416+0000 7f10b67fc700 1 -- 172.21.15.80:0/3544363973 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10a0001950 con 0x7f10b80734e0 2019-11-28T11:25:00.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.416+0000 7f10bd3bf700 1 -- 172.21.15.80:0/3544363973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b80734e0 msgr2=0x7f10b8071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:00.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.416+0000 7f10bd3bf700 1 --2- 172.21.15.80:0/3544363973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b80734e0 0x7f10b8071e20 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7f10a000fac0 tx=0x7f10a000fe60).stop 2019-11-28T11:25:00.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.416+0000 7f10bd3bf700 1 -- 172.21.15.80:0/3544363973 shutdown_connections 2019-11-28T11:25:00.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.416+0000 7f10bd3bf700 1 --2- 172.21.15.80:0/3544363973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10b8072360 0x7f10b8072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:00.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.416+0000 7f10bd3bf700 1 --2- 172.21.15.80:0/3544363973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b80734e0 0x7f10b8071e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:00.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.416+0000 7f10bd3bf700 1 --2- 172.21.15.80:0/3544363973 >> v2:172.21.15.174:3300/0 conn(0x7f10b806c0a0 0x7f10b8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:00.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.417+0000 7f10bd3bf700 1 -- 172.21.15.80:0/3544363973 shutdown_connections 2019-11-28T11:25:00.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.417+0000 7f10bd3bf700 1 -- 172.21.15.80:0/3544363973 wait complete. 2019-11-28T11:25:00.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.417+0000 7f10bd3bf700 1 -- 172.21.15.80:0/3544363973 >> 172.21.15.80:0/3544363973 conn(0x7f10b8061cf0 msgr2=0x7f10b8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:00.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.419+0000 7f10bd3bf700 1 Processor -- start 2019-11-28T11:25:00.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.419+0000 7f10bd3bf700 1 -- start start 2019-11-28T11:25:00.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.420+0000 7f10bd3bf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10b813e320 0x7f10b813e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:00.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.420+0000 7f10bd3bf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10b812a3c0 0x7f10b812a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.420+0000 7f10bd3bf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b8139e00 con 0x7f10b815fdf0 2019-11-28T11:25:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.420+0000 7f10bd3bf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b8108820 con 0x7f10b812a3c0 2019-11-28T11:25:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.420+0000 7f10bd3bf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b8108af0 con 0x7f10b813e320 2019-11-28T11:25:00.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.420+0000 7f10b7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10b812a3c0 0x7f10b812a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:00.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.420+0000 7f10b7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10b812a3c0 0x7f10b812a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58584/0 (socket says 172.21.15.80:58584) 2019-11-28T11:25:00.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.420+0000 7f10b7fff700 1 -- 172.21.15.80:0/3710570820 learned_addr learned my addr 172.21.15.80:0/3710570820 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.420+0000 7f10b6ffd700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10b813e320 0x7f10b813e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.420+0000 7f10b7fff700 1 -- 172.21.15.80:0/3710570820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10b813e320 msgr2=0x7f10b813e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.420+0000 7f10b7fff700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10b813e320 0x7f10b813e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:00.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.420+0000 7f10b7fff700 1 -- 172.21.15.80:0/3710570820 >> v1:172.21.15.174:6789/0 conn(0x7f10b815fdf0 legacy=0x7f10b812b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.420+0000 7f10b7fff700 1 -- 172.21.15.80:0/3710570820 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b810a8c0 con 0x7f10b812a3c0 2019-11-28T11:25:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.420+0000 7f10b7fff700 1 --2- 172.21.15.80:0/3710570820 >> v2:172.21.15.80:3300/0 conn(0x7f10b812a3c0 0x7f10b812a810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10b0010480 tx=0x7f10b0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.421+0000 7f10b7fff700 1 --2- 172.21.15.80:0/3710570820 >> v2:172.21.15.80:3300/0 conn(0x7f10b812a3c0 0x7f10b812a810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10b0010480 tx=0x7f10b0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.421+0000 7f10b7fff700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b812a3c0 0x7f10b812a810 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7f10b0010480 tx=0x7f10b0010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.421+0000 7f10b7fff700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b812a3c0 0x7f10b812a810 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f10b0010480 tx=0x7f10b0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:00.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.421+0000 7f10b7fff700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b812a3c0 0x7f10b812a810 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f10b0010480 tx=0x7f10b0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.421+0000 7f10affff700 1 -- 172.21.15.80:0/3710570820 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10b0008480 con 0x7f10b812a3c0 2019-11-28T11:25:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.421+0000 7f10b7fff700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b812a3c0 0x7f10b812a810 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f10b0010480 tx=0x7f10b0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.421+0000 7f10affff700 1 -- 172.21.15.80:0/3710570820 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b0009a80 con 0x7f10b812a3c0 2019-11-28T11:25:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.421+0000 7f10bd3bf700 1 -- 172.21.15.80:0/3710570820 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b810a8c0 con 0x7f10b812a3c0 2019-11-28T11:25:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.421+0000 7f10affff700 1 -- 172.21.15.80:0/3710570820 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10b000a1b0 con 0x7f10b812a3c0 2019-11-28T11:25:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.421+0000 7f10bd3bf700 1 -- 172.21.15.80:0/3710570820 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b810a8c0 con 0x7f10b812a3c0 2019-11-28T11:25:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.421+0000 7f10b7fff700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b812a3c0 0x7f10b812a810 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f10b0010480 tx=0x7f10b0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.421+0000 7f10affff700 1 -- 172.21.15.80:0/3710570820 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f10b0000a70 con 0x7f10b812a3c0 2019-11-28T11:25:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.421+0000 7f10b7fff700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b812a3c0 0x7f10b812a810 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f10b0010480 tx=0x7f10b0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.421+0000 7f10affff700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1090018730 0x7f109001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.422+0000 7f10affff700 1 -- 172.21.15.80:0/3710570820 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f10b0031a90 con 0x7f10b812a3c0 2019-11-28T11:25:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.422+0000 7f10b77fe700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1090018730 0x7f109001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.422+0000 7f10b77fe700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1090018730 0x7f109001abc0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.429+0000 7f10bd3bf700 1 -- 172.21.15.80:0/3710570820 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b8109180 con 0x7f10b812a3c0 2019-11-28T11:25:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.433+0000 7f10b7fff700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b812a3c0 0x7f10b812a810 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f10b0010480 tx=0x7f10b0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.433+0000 7f10affff700 1 -- 172.21.15.80:0/3710570820 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f10b00095e0 con 0x7f10b812a3c0 2019-11-28T11:25:00.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.619+0000 7f10bd3bf700 1 -- 172.21.15.80:0/3710570820 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", "id": 0} v 0) v1 -- 0x7f10b8109500 con 0x7f10b812a3c0 2019-11-28T11:25:01.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.622+0000 7f10b7fff700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b812a3c0 0x7f10b812a810 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f10b0010480 tx=0x7f10b0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.622+0000 7f10affff700 1 -- 172.21.15.80:0/3710570820 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f10b0000a70 con 0x7f10b812a3c0 2019-11-28T11:25:01.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.628+0000 7f10bd3bf700 1 -- 172.21.15.80:0/3710570820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1090018730 msgr2=0x7f109001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:01.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.628+0000 7f10bd3bf700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1090018730 0x7f109001abc0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:01.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.628+0000 7f10bd3bf700 1 -- 172.21.15.80:0/3710570820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b812a3c0 msgr2=0x7f10b812a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:01.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.628+0000 7f10bd3bf700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b812a3c0 0x7f10b812a810 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7f10b0010480 tx=0x7f10b0010280).stop 2019-11-28T11:25:01.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.628+0000 7f10bd3bf700 1 -- 172.21.15.80:0/3710570820 shutdown_connections 2019-11-28T11:25:01.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.628+0000 7f10bd3bf700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10b812a3c0 0x7f10b812a810 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:01.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.628+0000 7f10bd3bf700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10b813e320 0x7f10b813e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:01.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.628+0000 7f10bd3bf700 1 --2- 172.21.15.80:0/3710570820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1090018730 0x7f109001abc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:01.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.628+0000 7f10bd3bf700 1 -- 172.21.15.80:0/3710570820 shutdown_connections 2019-11-28T11:25:01.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.628+0000 7f10bd3bf700 1 -- 172.21.15.80:0/3710570820 wait complete. 2019-11-28T11:25:01.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:00.628+0000 7f10bd3bf700 1 -- 172.21.15.80:0/3710570820 >> 172.21.15.80:0/3710570820 conn(0x7f10b8127dc0 msgr2=0x7f10b8141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:01.254 INFO:teuthology.orchestra.run.smithi080.stdout:0 2019-11-28T11:25:01.254 INFO:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new 59f860a3-5032-4948-9d92-2b02d89ea495 1 2019-11-28T11:25:01.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.363+0000 7fd0c035c700 1 Processor -- start 2019-11-28T11:25:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.363+0000 7fd0c035c700 1 -- start start 2019-11-28T11:25:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.364+0000 7fd0c035c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0b806c0a0 0x7fd0b8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.364+0000 7fd0c035c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd0b8072620 0x7fd0b8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.364+0000 7fd0c035c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b806db00 con 0x7fd0b80734e0 2019-11-28T11:25:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.364+0000 7fd0c035c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b806f330 con 0x7fd0b8072620 2019-11-28T11:25:01.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.364+0000 7fd0c035c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80706c0 con 0x7fd0b806c0a0 2019-11-28T11:25:01.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.364+0000 7fd0be0f8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd0b80734e0 0x7fd0b8071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:57910/0 (socket says 172.21.15.80:57910) 2019-11-28T11:25:01.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.364+0000 7fd0be0f8700 1 -- 172.21.15.80:0/631762685 learned_addr learned my addr 172.21.15.80:0/631762685 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:01.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.364+0000 7fd0be8f9700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0b806c0a0 0x7fd0b8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:01.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.364+0000 7fd0bf0fa700 1 --2- 172.21.15.80:0/631762685 >> v2:172.21.15.174:3300/0 conn(0x7fd0b8072620 0x7fd0b8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:01.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.364+0000 7fd0bd8f7700 1 -- 172.21.15.80:0/631762685 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668778605 0 0) 0x7fd0ac001070 con 0x7fd0b80734e0 2019-11-28T11:25:01.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.364+0000 7fd0bd8f7700 1 -- 172.21.15.80:0/631762685 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0a0002e80 con 0x7fd0b80734e0 2019-11-28T11:25:01.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 -- 172.21.15.80:0/631762685 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4238287437 0 0) 0x7fd0ac001050 con 0x7fd0b80734e0 2019-11-28T11:25:01.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 -- 172.21.15.80:0/631762685 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0b806c0a0 msgr2=0x7fd0b8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:01.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0b806c0a0 0x7fd0b8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:01.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 -- 172.21.15.80:0/631762685 >> v2:172.21.15.174:3300/0 conn(0x7fd0b8072620 msgr2=0x7fd0b8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:01.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 --2- 172.21.15.80:0/631762685 >> v2:172.21.15.174:3300/0 conn(0x7fd0b8072620 0x7fd0b8164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:01.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 -- 172.21.15.80:0/631762685 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b8070a40 con 0x7fd0b80734e0 2019-11-28T11:25:01.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 -- 172.21.15.80:0/631762685 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd0ac001580 con 0x7fd0b80734e0 2019-11-28T11:25:01.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 -- 172.21.15.80:0/631762685 >> v1:172.21.15.80:6789/0 conn(0x7fd0b80734e0 legacy=0x7fd0b8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:01.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0a00479e0 0x7fd0a0049e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:01.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a004a5a0 0x7fd0a004ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:01.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0a004d270 0x7fd0a004f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:01.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 -- 172.21.15.80:0/631762685 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a004ff50 con 0x7fd0a004a5a0 2019-11-28T11:25:01.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 -- 172.21.15.80:0/631762685 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0050140 con 0x7fd0a004d270 2019-11-28T11:25:01.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 -- 172.21.15.80:0/631762685 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0050370 con 0x7fd0a00479e0 2019-11-28T11:25:01.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a004a5a0 0x7fd0a004ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:01.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0be8f9700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0a00479e0 0x7fd0a0049e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:01.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bf0fa700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0a004d270 0x7fd0a004f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:01.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0be0f8700 1 -- 172.21.15.80:0/631762685 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0a00479e0 msgr2=0x7fd0a0049e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:01.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0a00479e0 0x7fd0a0049e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:01.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0be0f8700 1 -- 172.21.15.80:0/631762685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0a004d270 msgr2=0x7fd0a004f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:01.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0a004d270 0x7fd0a004f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0be0f8700 1 -- 172.21.15.80:0/631762685 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a0050620 con 0x7fd0a004a5a0 2019-11-28T11:25:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a004a5a0 0x7fd0a004ca70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd0ac00f880 tx=0x7fd0ac00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a004a5a0 0x7fd0a004ca70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd0ac00f880 tx=0x7fd0ac00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a004a5a0 0x7fd0a004ca70 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fd0ac00f880 tx=0x7fd0ac00f780).ready entity=mon.0 client_cookie=cb03d04722b1ea41 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a004a5a0 0x7fd0a004ca70 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fd0ac00f880 tx=0x7fd0ac00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 -- 172.21.15.80:0/631762685 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0ac001600 con 0x7fd0a004a5a0 2019-11-28T11:25:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a004a5a0 0x7fd0a004ca70 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fd0ac00f880 tx=0x7fd0ac00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a004a5a0 0x7fd0a004ca70 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fd0ac00f880 tx=0x7fd0ac00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 -- 172.21.15.80:0/631762685 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac004280 con 0x7fd0a004a5a0 2019-11-28T11:25:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bd8f7700 1 -- 172.21.15.80:0/631762685 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0ac0049d0 con 0x7fd0a004a5a0 2019-11-28T11:25:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0c035c700 1 -- 172.21.15.80:0/631762685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a004a5a0 msgr2=0x7fd0a004ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:01.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0c035c700 1 --2- 172.21.15.80:0/631762685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a004a5a0 0x7fd0a004ca70 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fd0ac00f880 tx=0x7fd0ac00f780).stop 2019-11-28T11:25:01.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.365+0000 7fd0bf0fa700 1 -- 172.21.15.80:0/631762685 reap_dead start 2019-11-28T11:25:01.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.366+0000 7fd0c035c700 1 -- 172.21.15.80:0/631762685 shutdown_connections 2019-11-28T11:25:01.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.366+0000 7fd0c035c700 1 -- 172.21.15.80:0/631762685 shutdown_connections 2019-11-28T11:25:01.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.366+0000 7fd0c035c700 1 -- 172.21.15.80:0/631762685 wait complete. 2019-11-28T11:25:01.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.366+0000 7fd0c035c700 1 -- 172.21.15.80:0/631762685 >> 172.21.15.80:0/631762685 conn(0x7fd0b8061cf0 msgr2=0x7fd0b8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:01.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.369+0000 7fd0c035c700 1 Processor -- start 2019-11-28T11:25:01.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.369+0000 7fd0c035c700 1 -- start start 2019-11-28T11:25:01.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.369+0000 7fd0c035c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd0b8106c20 0x7fd0b81155f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:01.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.369+0000 7fd0c035c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd0b8115b30 0x7fd0b811caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:01.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.369+0000 7fd0c035c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b811dd50 con 0x7fd0b811cfe0 2019-11-28T11:25:01.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0c035c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b81126a0 con 0x7fd0b8115b30 2019-11-28T11:25:01.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0c035c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b811f570 con 0x7fd0b8106c20 2019-11-28T11:25:01.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0be0f8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd0b8115b30 0x7fd0b811caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:01.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0be0f8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd0b8115b30 0x7fd0b811caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58606/0 (socket says 172.21.15.80:58606) 2019-11-28T11:25:01.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0be0f8700 1 -- 172.21.15.80:0/3948289877 learned_addr learned my addr 172.21.15.80:0/3948289877 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:01.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0be8f9700 1 --2- 172.21.15.80:0/3948289877 >> v2:172.21.15.174:3300/0 conn(0x7fd0b8106c20 0x7fd0b81155f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:01.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0be0f8700 1 -- 172.21.15.80:0/3948289877 >> v2:172.21.15.174:3300/0 conn(0x7fd0b8106c20 msgr2=0x7fd0b81155f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:01.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/3948289877 >> v2:172.21.15.174:3300/0 conn(0x7fd0b8106c20 0x7fd0b81155f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:01.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0be0f8700 1 -- 172.21.15.80:0/3948289877 >> v1:172.21.15.174:6789/0 conn(0x7fd0b811cfe0 legacy=0x7fd0b8114470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:01.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0be0f8700 1 -- 172.21.15.80:0/3948289877 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b8112d30 con 0x7fd0b8115b30 2019-11-28T11:25:01.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/3948289877 >> v2:172.21.15.80:3300/0 conn(0x7fd0b8115b30 0x7fd0b811caa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0ac010400 tx=0x7fd0ac0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/3948289877 >> v2:172.21.15.80:3300/0 conn(0x7fd0b8115b30 0x7fd0b811caa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0ac010400 tx=0x7fd0ac0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/3948289877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0b8115b30 0x7fd0b811caa0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fd0ac010400 tx=0x7fd0ac0102b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:01.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/3948289877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0b8115b30 0x7fd0b811caa0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fd0ac010400 tx=0x7fd0ac0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/3948289877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0b8115b30 0x7fd0b811caa0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fd0ac010400 tx=0x7fd0ac0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0b77fe700 1 -- 172.21.15.80:0/3948289877 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0ac004250 con 0x7fd0b8115b30 2019-11-28T11:25:01.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/3948289877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0b8115b30 0x7fd0b811caa0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fd0ac010400 tx=0x7fd0ac0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0b77fe700 1 -- 172.21.15.80:0/3948289877 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac004660 con 0x7fd0b8115b30 2019-11-28T11:25:01.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0c035c700 1 -- 172.21.15.80:0/3948289877 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b81130b0 con 0x7fd0b8115b30 2019-11-28T11:25:01.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0b77fe700 1 -- 172.21.15.80:0/3948289877 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0ac004d30 con 0x7fd0b8115b30 2019-11-28T11:25:01.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.370+0000 7fd0c035c700 1 -- 172.21.15.80:0/3948289877 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b8112d30 con 0x7fd0b8115b30 2019-11-28T11:25:01.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.371+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/3948289877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0b8115b30 0x7fd0b811caa0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fd0ac010400 tx=0x7fd0ac0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.371+0000 7fd0b77fe700 1 -- 172.21.15.80:0/3948289877 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd0ac004210 con 0x7fd0b8115b30 2019-11-28T11:25:01.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.371+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/3948289877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0b8115b30 0x7fd0b811caa0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fd0ac010400 tx=0x7fd0ac0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.371+0000 7fd0b77fe700 1 --2- 172.21.15.80:0/3948289877 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd098018730 0x7fd09801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:01.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.371+0000 7fd0b77fe700 1 -- 172.21.15.80:0/3948289877 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fd0ac031a90 con 0x7fd0b8115b30 2019-11-28T11:25:01.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.371+0000 7fd0be8f9700 1 --2- 172.21.15.80:0/3948289877 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd098018730 0x7fd09801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:01.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.371+0000 7fd0be8f9700 1 --2- 172.21.15.80:0/3948289877 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd098018730 0x7fd09801abc0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:01.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.378+0000 7fd0c035c700 1 -- 172.21.15.80:0/3948289877 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b81130b0 con 0x7fd0b8115b30 2019-11-28T11:25:01.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.382+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/3948289877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0b8115b30 0x7fd0b811caa0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fd0ac010400 tx=0x7fd0ac0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.382+0000 7fd0b77fe700 1 -- 172.21.15.80:0/3948289877 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd0ac000c50 con 0x7fd0b8115b30 2019-11-28T11:25:01.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.568+0000 7fd0c035c700 1 -- 172.21.15.80:0/3948289877 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd new", "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", "id": 1} v 0) v1 -- 0x7fd0b8112d30 con 0x7fd0b8115b30 2019-11-28T11:25:01.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.570+0000 7fd0be0f8700 1 --2- 172.21.15.80:0/3948289877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0b8115b30 0x7fd0b811caa0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fd0ac010400 tx=0x7fd0ac0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.570+0000 7fd0b77fe700 1 -- 172.21.15.80:0/3948289877 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd0ac004210 con 0x7fd0b8115b30 2019-11-28T11:25:01.589 INFO:teuthology.orchestra.run.smithi080.stdout:1 2019-11-28T11:25:01.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.573+0000 7fd0c035c700 1 -- 172.21.15.80:0/3948289877 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd098018730 msgr2=0x7fd09801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:01.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.573+0000 7fd0c035c700 1 --2- 172.21.15.80:0/3948289877 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd098018730 0x7fd09801abc0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:01.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.573+0000 7fd0c035c700 1 -- 172.21.15.80:0/3948289877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0b8115b30 msgr2=0x7fd0b811caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:01.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.573+0000 7fd0c035c700 1 --2- 172.21.15.80:0/3948289877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0b8115b30 0x7fd0b811caa0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fd0ac010400 tx=0x7fd0ac0102b0).stop 2019-11-28T11:25:01.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.573+0000 7fd0c035c700 1 -- 172.21.15.80:0/3948289877 shutdown_connections 2019-11-28T11:25:01.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.573+0000 7fd0c035c700 1 --2- 172.21.15.80:0/3948289877 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd098018730 0x7fd09801abc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:01.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.573+0000 7fd0c035c700 1 --2- 172.21.15.80:0/3948289877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0b8115b30 0x7fd0b811caa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:01.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.573+0000 7fd0c035c700 1 --2- 172.21.15.80:0/3948289877 >> v2:172.21.15.174:3300/0 conn(0x7fd0b8106c20 0x7fd0b81155f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:01.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.573+0000 7fd0c035c700 1 -- 172.21.15.80:0/3948289877 shutdown_connections 2019-11-28T11:25:01.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.573+0000 7fd0c035c700 1 -- 172.21.15.80:0/3948289877 wait complete. 2019-11-28T11:25:01.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.573+0000 7fd0c035c700 1 -- 172.21.15.80:0/3948289877 >> 172.21.15.80:0/3948289877 conn(0x7fd0b8141d10 msgr2=0x7fd0b813ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:01.602 INFO:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new 01501801-5512-4f8e-a689-d7a5220c8389 2 2019-11-28T11:25:01.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.702+0000 7f09d0e9f700 1 Processor -- start 2019-11-28T11:25:01.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.702+0000 7f09d0e9f700 1 -- start start 2019-11-28T11:25:01.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09d0e9f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09cc06c490 0x7f09cc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:01.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09d0e9f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09cc06ce60 0x7f09cc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:01.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09d0e9f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09cc06db00 con 0x7f09cc06c0a0 2019-11-28T11:25:01.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09d0e9f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09cc06fd60 con 0x7f09cc06c490 2019-11-28T11:25:01.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09d0e9f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc070030 con 0x7f09cc06ce60 2019-11-28T11:25:01.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09ca59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09cc06c490 0x7f09cc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:01.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09ca59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09cc06c490 0x7f09cc06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58614/0 (socket says 172.21.15.80:58614) 2019-11-28T11:25:01.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09ca59c700 1 -- 172.21.15.80:0/3042685650 learned_addr learned my addr 172.21.15.80:0/3042685650 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:01.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09cb59e700 1 --2- 172.21.15.80:0/3042685650 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09cc06ce60 0x7f09cc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:01.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09ca59c700 1 -- 172.21.15.80:0/3042685650 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09cc06ce60 msgr2=0x7f09cc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:01.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09ca59c700 1 --2- 172.21.15.80:0/3042685650 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09cc06ce60 0x7f09cc164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:01.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09ca59c700 1 -- 172.21.15.80:0/3042685650 >> v1:172.21.15.174:6789/0 conn(0x7f09cc06c0a0 legacy=0x7f09cc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:01.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09ca59c700 1 -- 172.21.15.80:0/3042685650 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc0706c0 con 0x7f09cc06c490 2019-11-28T11:25:01.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09ca59c700 1 --2- 172.21.15.80:0/3042685650 >> v2:172.21.15.80:3300/0 conn(0x7f09cc06c490 0x7f09cc06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f09bc00f740 tx=0x7f09bc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09ca59c700 1 --2- 172.21.15.80:0/3042685650 >> v2:172.21.15.80:3300/0 conn(0x7f09cc06c490 0x7f09cc06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f09bc00f740 tx=0x7f09bc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09ca59c700 1 --2- 172.21.15.80:0/3042685650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09cc06c490 0x7f09cc06c920 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f09bc00f740 tx=0x7f09bc00f570).ready entity=mon.0 client_cookie=2ff8e7173c344627 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:01.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09ca59c700 1 --2- 172.21.15.80:0/3042685650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09cc06c490 0x7f09cc06c920 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f09bc00f740 tx=0x7f09bc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09ca59c700 1 --2- 172.21.15.80:0/3042685650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09cc06c490 0x7f09cc06c920 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f09bc00f740 tx=0x7f09bc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09c9d9b700 1 -- 172.21.15.80:0/3042685650 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09bc000960 con 0x7f09cc06c490 2019-11-28T11:25:01.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09ca59c700 1 --2- 172.21.15.80:0/3042685650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09cc06c490 0x7f09cc06c920 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f09bc00f740 tx=0x7f09bc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09c9d9b700 1 -- 172.21.15.80:0/3042685650 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09bc000c90 con 0x7f09cc06c490 2019-11-28T11:25:01.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.703+0000 7f09c9d9b700 1 -- 172.21.15.80:0/3042685650 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09bc0013a0 con 0x7f09cc06c490 2019-11-28T11:25:01.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.704+0000 7f09d0e9f700 1 -- 172.21.15.80:0/3042685650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09cc06c490 msgr2=0x7f09cc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:01.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.704+0000 7f09d0e9f700 1 --2- 172.21.15.80:0/3042685650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09cc06c490 0x7f09cc06c920 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f09bc00f740 tx=0x7f09bc00f570).stop 2019-11-28T11:25:01.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.704+0000 7f09d0e9f700 1 -- 172.21.15.80:0/3042685650 shutdown_connections 2019-11-28T11:25:01.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.704+0000 7f09d0e9f700 1 --2- 172.21.15.80:0/3042685650 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09cc06ce60 0x7f09cc164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:01.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.704+0000 7f09d0e9f700 1 --2- 172.21.15.80:0/3042685650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09cc06c490 0x7f09cc06c920 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:01.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.704+0000 7f09d0e9f700 1 -- 172.21.15.80:0/3042685650 shutdown_connections 2019-11-28T11:25:01.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.704+0000 7f09d0e9f700 1 -- 172.21.15.80:0/3042685650 wait complete. 2019-11-28T11:25:01.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.704+0000 7f09d0e9f700 1 -- 172.21.15.80:0/3042685650 >> 172.21.15.80:0/3042685650 conn(0x7f09cc061cf0 msgr2=0x7f09cc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:01.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.707+0000 7f09d0e9f700 1 Processor -- start 2019-11-28T11:25:01.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.707+0000 7f09d0e9f700 1 -- start start 2019-11-28T11:25:01.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09d0e9f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f09cc1209a0 0x7f09cc120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:01.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09d0e9f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09cc13a490 0x7f09cc13a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:01.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09d0e9f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09cc139df0 con 0x7f09cc13e900 2019-11-28T11:25:01.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09d0e9f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09cc128920 con 0x7f09cc1209a0 2019-11-28T11:25:01.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09d0e9f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc13b850 con 0x7f09cc13a490 2019-11-28T11:25:01.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09ca59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f09cc1209a0 0x7f09cc120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:01.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09cad9d700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f09cc13e900 0x7f09cc121750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:45244/0 (socket says 172.21.15.80:45244) 2019-11-28T11:25:01.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09ca59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f09cc1209a0 0x7f09cc120e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:45272/0 (socket says 172.21.15.80:45272) 2019-11-28T11:25:01.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09cad9d700 1 -- 172.21.15.80:0/1373612449 learned_addr learned my addr 172.21.15.80:0/1373612449 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:01.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09cb59e700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09cc13a490 0x7f09cc13a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:01.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09ca59c700 1 -- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09cc13a490 msgr2=0x7f09cc13a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:01.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09ca59c700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09cc13a490 0x7f09cc13a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:01.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09ca59c700 1 -- 172.21.15.80:0/1373612449 >> v1:172.21.15.174:6789/0 conn(0x7f09cc13e900 legacy=0x7f09cc121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:01.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09ca59c700 1 -- 172.21.15.80:0/1373612449 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc128fb0 con 0x7f09cc1209a0 2019-11-28T11:25:01.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09c37fe700 1 -- 172.21.15.80:0/1373612449 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627527814 0 0) 0x7f09b4001400 con 0x7f09cc13e900 2019-11-28T11:25:01.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09cb59e700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09cc13a490 0x7f09cc13a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:01.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09ca59c700 1 --2- 172.21.15.80:0/1373612449 >> v2:172.21.15.174:3300/0 conn(0x7f09cc1209a0 0x7f09cc120e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f09bc007bb0 tx=0x7f09bc0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09ca59c700 1 --2- 172.21.15.80:0/1373612449 >> v2:172.21.15.174:3300/0 conn(0x7f09cc1209a0 0x7f09cc120e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f09bc007bb0 tx=0x7f09bc0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09ca59c700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09cc1209a0 0x7f09cc120e30 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f09bc007bb0 tx=0x7f09bc0106f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:01.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09ca59c700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09cc1209a0 0x7f09cc120e30 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f09bc007bb0 tx=0x7f09bc0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09c37fe700 1 -- 172.21.15.80:0/1373612449 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09bc0075d0 con 0x7f09cc1209a0 2019-11-28T11:25:01.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.708+0000 7f09ca59c700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09cc1209a0 0x7f09cc120e30 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f09bc007bb0 tx=0x7f09bc0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.709+0000 7f09c37fe700 1 -- 172.21.15.80:0/1373612449 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09bc005580 con 0x7f09cc1209a0 2019-11-28T11:25:01.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.709+0000 7f09ca59c700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09cc1209a0 0x7f09cc120e30 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f09bc007bb0 tx=0x7f09bc0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.709+0000 7f09d0e9f700 1 -- 172.21.15.80:0/1373612449 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09cc129330 con 0x7f09cc1209a0 2019-11-28T11:25:01.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.709+0000 7f09c37fe700 1 -- 172.21.15.80:0/1373612449 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09bc007db0 con 0x7f09cc1209a0 2019-11-28T11:25:01.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.709+0000 7f09d0e9f700 1 -- 172.21.15.80:0/1373612449 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09cc1281b0 con 0x7f09cc1209a0 2019-11-28T11:25:01.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.709+0000 7f09ca59c700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09cc1209a0 0x7f09cc120e30 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f09bc007bb0 tx=0x7f09bc0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.709+0000 7f09ca59c700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09cc1209a0 0x7f09cc120e30 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f09bc007bb0 tx=0x7f09bc0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.709+0000 7f09c37fe700 1 -- 172.21.15.80:0/1373612449 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f09bc005770 con 0x7f09cc1209a0 2019-11-28T11:25:01.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.709+0000 7f09c37fe700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f09a4018730 0x7f09a401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:01.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.709+0000 7f09c37fe700 1 -- 172.21.15.80:0/1373612449 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f09bc031a50 con 0x7f09cc1209a0 2019-11-28T11:25:01.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.709+0000 7f09cad9d700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f09a4018730 0x7f09a401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:01.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.710+0000 7f09cad9d700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f09a4018730 0x7f09a401abc0 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:01.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.717+0000 7f09d0e9f700 1 -- 172.21.15.80:0/1373612449 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09cc128fb0 con 0x7f09cc1209a0 2019-11-28T11:25:01.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.721+0000 7f09ca59c700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09cc1209a0 0x7f09cc120e30 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f09bc007bb0 tx=0x7f09bc0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.721+0000 7f09c37fe700 1 -- 172.21.15.80:0/1373612449 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f09bc02dfe0 con 0x7f09cc1209a0 2019-11-28T11:25:01.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.908+0000 7f09d0e9f700 1 -- 172.21.15.80:0/1373612449 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", "id": 2} v 0) v1 -- 0x7f09cc129330 con 0x7f09cc1209a0 2019-11-28T11:25:01.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.912+0000 7f09ca59c700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09cc1209a0 0x7f09cc120e30 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f09bc007bb0 tx=0x7f09bc0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:01.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.912+0000 7f09c37fe700 1 -- 172.21.15.80:0/1373612449 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f09bc02dfe0 con 0x7f09cc1209a0 2019-11-28T11:25:01.933 INFO:teuthology.orchestra.run.smithi080.stdout:2 2019-11-28T11:25:01.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.917+0000 7f09d0e9f700 1 -- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f09a4018730 msgr2=0x7f09a401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:01.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.917+0000 7f09d0e9f700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f09a4018730 0x7f09a401abc0 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:01.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.917+0000 7f09d0e9f700 1 -- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09cc1209a0 msgr2=0x7f09cc120e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:01.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.917+0000 7f09d0e9f700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09cc1209a0 0x7f09cc120e30 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f09bc007bb0 tx=0x7f09bc0106f0).stop 2019-11-28T11:25:01.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.918+0000 7f09d0e9f700 1 -- 172.21.15.80:0/1373612449 shutdown_connections 2019-11-28T11:25:01.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.918+0000 7f09d0e9f700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09cc13a490 0x7f09cc13a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:01.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.918+0000 7f09d0e9f700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09cc1209a0 0x7f09cc120e30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:01.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.918+0000 7f09d0e9f700 1 --2- 172.21.15.80:0/1373612449 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f09a4018730 0x7f09a401abc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:01.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.918+0000 7f09d0e9f700 1 -- 172.21.15.80:0/1373612449 shutdown_connections 2019-11-28T11:25:01.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.918+0000 7f09d0e9f700 1 -- 172.21.15.80:0/1373612449 wait complete. 2019-11-28T11:25:01.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:01.918+0000 7f09d0e9f700 1 -- 172.21.15.80:0/1373612449 >> 172.21.15.80:0/1373612449 conn(0x7f09cc127dc0 msgr2=0x7f09cc141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:01.948 INFO:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new 3a0ffd4c-5f68-42f0-b51a-69e873715619 3 2019-11-28T11:25:02.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.050+0000 7fb959739700 1 Processor -- start 2019-11-28T11:25:02.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.050+0000 7fb959739700 1 -- start start 2019-11-28T11:25:02.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb959739700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb95406c0a0 0x7fb954072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:02.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb959739700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb9540734e0 0x7fb954071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:02.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb959739700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb954072360 0x7fb954072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:02.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb959739700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95406fd60 con 0x7fb95406c0a0 2019-11-28T11:25:02.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb959739700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb954070030 con 0x7fb9540734e0 2019-11-28T11:25:02.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb959739700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95406f330 con 0x7fb954072360 2019-11-28T11:25:02.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb9537fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb95406c0a0 0x7fb954072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb9537fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb95406c0a0 0x7fb954072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58624/0 (socket says 172.21.15.80:58624) 2019-11-28T11:25:02.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb9537fe700 1 -- 172.21.15.80:0/3056412425 learned_addr learned my addr 172.21.15.80:0/3056412425 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:02.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb952ffd700 1 --2- 172.21.15.80:0/3056412425 >> v2:172.21.15.174:3300/0 conn(0x7fb9540734e0 0x7fb954071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb953fff700 1 --2- 172.21.15.80:0/3056412425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb954072360 0x7fb954072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb9537fe700 1 -- 172.21.15.80:0/3056412425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb954072360 msgr2=0x7fb954072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:02.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb9537fe700 1 --2- 172.21.15.80:0/3056412425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb954072360 0x7fb954072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:02.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb9537fe700 1 -- 172.21.15.80:0/3056412425 >> v2:172.21.15.174:3300/0 conn(0x7fb9540734e0 msgr2=0x7fb954071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:02.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb9537fe700 1 --2- 172.21.15.80:0/3056412425 >> v2:172.21.15.174:3300/0 conn(0x7fb9540734e0 0x7fb954071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb9537fe700 1 -- 172.21.15.80:0/3056412425 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9540706c0 con 0x7fb95406c0a0 2019-11-28T11:25:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb952ffd700 1 --2- 172.21.15.80:0/3056412425 >> v2:172.21.15.174:3300/0 conn(0x7fb9540734e0 0x7fb954071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb9537fe700 1 --2- 172.21.15.80:0/3056412425 >> v2:172.21.15.80:3300/0 conn(0x7fb95406c0a0 0x7fb954072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb93c00f6c0 tx=0x7fb93c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb9537fe700 1 --2- 172.21.15.80:0/3056412425 >> v2:172.21.15.80:3300/0 conn(0x7fb95406c0a0 0x7fb954072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb93c00f6c0 tx=0x7fb93c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.051+0000 7fb9537fe700 1 --2- 172.21.15.80:0/3056412425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb95406c0a0 0x7fb954072fa0 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fb93c00f6c0 tx=0x7fb93c00fa60).ready entity=mon.0 client_cookie=5c1d411918c642f5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:02.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.052+0000 7fb9537fe700 1 --2- 172.21.15.80:0/3056412425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb95406c0a0 0x7fb954072fa0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fb93c00f6c0 tx=0x7fb93c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.052+0000 7fb9537fe700 1 --2- 172.21.15.80:0/3056412425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb95406c0a0 0x7fb954072fa0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fb93c00f6c0 tx=0x7fb93c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.052+0000 7fb9537fe700 1 --2- 172.21.15.80:0/3056412425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb95406c0a0 0x7fb954072fa0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fb93c00f6c0 tx=0x7fb93c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.052+0000 7fb9527fc700 1 -- 172.21.15.80:0/3056412425 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb93c000960 con 0x7fb95406c0a0 2019-11-28T11:25:02.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.052+0000 7fb9527fc700 1 -- 172.21.15.80:0/3056412425 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93c000c90 con 0x7fb95406c0a0 2019-11-28T11:25:02.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.052+0000 7fb9527fc700 1 -- 172.21.15.80:0/3056412425 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb93c001440 con 0x7fb95406c0a0 2019-11-28T11:25:02.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.052+0000 7fb959739700 1 -- 172.21.15.80:0/3056412425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb95406c0a0 msgr2=0x7fb954072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.052+0000 7fb959739700 1 --2- 172.21.15.80:0/3056412425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb95406c0a0 0x7fb954072fa0 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fb93c00f6c0 tx=0x7fb93c00fa60).stop 2019-11-28T11:25:02.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.052+0000 7fb959739700 1 -- 172.21.15.80:0/3056412425 shutdown_connections 2019-11-28T11:25:02.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.052+0000 7fb959739700 1 --2- 172.21.15.80:0/3056412425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb954072360 0x7fb954072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:02.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.052+0000 7fb959739700 1 --2- 172.21.15.80:0/3056412425 >> v2:172.21.15.174:3300/0 conn(0x7fb9540734e0 0x7fb954071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:02.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.052+0000 7fb959739700 1 --2- 172.21.15.80:0/3056412425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb95406c0a0 0x7fb954072fa0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:02.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.052+0000 7fb959739700 1 -- 172.21.15.80:0/3056412425 shutdown_connections 2019-11-28T11:25:02.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.052+0000 7fb959739700 1 -- 172.21.15.80:0/3056412425 wait complete. 2019-11-28T11:25:02.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.052+0000 7fb959739700 1 -- 172.21.15.80:0/3056412425 >> 172.21.15.80:0/3056412425 conn(0x7fb954061cf0 msgr2=0x7fb954064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:02.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.055+0000 7fb959739700 1 Processor -- start 2019-11-28T11:25:02.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.055+0000 7fb959739700 1 -- start start 2019-11-28T11:25:02.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb959739700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb95413e9e0 0x7fb954108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:02.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb959739700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9541066e0 con 0x7fb95413e5f0 2019-11-28T11:25:02.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb959739700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb95410ce40 con 0x7fb954109430 2019-11-28T11:25:02.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb959739700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95410e060 con 0x7fb95413e9e0 2019-11-28T11:25:02.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb9537fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb95413e5f0 0x7fb95410a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:57946/0 (socket says 172.21.15.80:57946) 2019-11-28T11:25:02.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb9537fe700 1 -- 172.21.15.80:0/3906161087 learned_addr learned my addr 172.21.15.80:0/3906161087 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:02.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431178736 0 0) 0x7fb93c008020 con 0x7fb95413e5f0 2019-11-28T11:25:02.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb92c002e80 con 0x7fb95413e5f0 2019-11-28T11:25:02.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb952ffd700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb95413e9e0 0x7fb954108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2947860406 0 0) 0x7fb93c0081e0 con 0x7fb95413e5f0 2019-11-28T11:25:02.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb92c0032e0 con 0x7fb95413e5f0 2019-11-28T11:25:02.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fb93c007820 con 0x7fb95413e5f0 2019-11-28T11:25:02.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb95413e9e0 msgr2=0x7fb954108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb94bfff700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb95413e9e0 0x7fb954108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:02.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 >> v1:172.21.15.174:6789/0 conn(0x7fb954109430 legacy=0x7fb954168ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 >> v1:172.21.15.80:6789/0 conn(0x7fb95413e5f0 legacy=0x7fb95410a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb94bfff700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb92c003330 0x7fb92c003740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:02.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb94bfff700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb92c003c80 0x7fb92c004120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:02.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb94bfff700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb92c004920 0x7fb92c004de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:02.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c00bbf0 con 0x7fb92c003c80 2019-11-28T11:25:02.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c00bde0 con 0x7fb92c004920 2019-11-28T11:25:02.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c00c010 con 0x7fb92c003330 2019-11-28T11:25:02.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.056+0000 7fb952ffd700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb92c003c80 0x7fb92c004120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb953fff700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb92c004920 0x7fb92c004de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb9537fe700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb92c003330 0x7fb92c003740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb952ffd700 1 -- 172.21.15.80:0/3906161087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb92c003330 msgr2=0x7fb92c003740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb952ffd700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb92c003330 0x7fb92c003740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:02.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb952ffd700 1 -- 172.21.15.80:0/3906161087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb92c004920 msgr2=0x7fb92c004de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb952ffd700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb92c004920 0x7fb92c004de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:02.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb952ffd700 1 -- 172.21.15.80:0/3906161087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92c00c2c0 con 0x7fb92c003c80 2019-11-28T11:25:02.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb959739700 1 -- 172.21.15.80:0/3906161087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95410ed40 con 0x7fb92c003c80 2019-11-28T11:25:02.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb952ffd700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb92c003c80 0x7fb92c004120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb94c010730 tx=0x7fb94c0105b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb959739700 1 -- 172.21.15.80:0/3906161087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95410e9c0 con 0x7fb92c003c80 2019-11-28T11:25:02.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb952ffd700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb92c003c80 0x7fb92c004120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb94c010730 tx=0x7fb94c0105b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb952ffd700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb92c003c80 0x7fb92c004120 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7fb94c010730 tx=0x7fb94c0105b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:02.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb952ffd700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb92c003c80 0x7fb92c004120 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fb94c010730 tx=0x7fb94c0105b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb94c000cc0 con 0x7fb92c003c80 2019-11-28T11:25:02.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb952ffd700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb92c003c80 0x7fb92c004120 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fb94c010730 tx=0x7fb94c0105b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb952ffd700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb92c003c80 0x7fb92c004120 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fb94c010730 tx=0x7fb94c0105b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c00f210 con 0x7fb92c003c80 2019-11-28T11:25:02.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb94c00f820 con 0x7fb92c003c80 2019-11-28T11:25:02.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.057+0000 7fb952ffd700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb92c003c80 0x7fb92c004120 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fb94c010730 tx=0x7fb94c0105b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.058+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb94c00fa40 con 0x7fb92c003c80 2019-11-28T11:25:02.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.058+0000 7fb952ffd700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb92c003c80 0x7fb92c004120 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fb94c010730 tx=0x7fb94c0105b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.058+0000 7fb94bfff700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb92c020bc0 0x7fb92c022ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:02.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.058+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7fb94c031f20 con 0x7fb92c003c80 2019-11-28T11:25:02.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.058+0000 7fb9537fe700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb92c020bc0 0x7fb92c022ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.058+0000 7fb9537fe700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb92c020bc0 0x7fb92c022ff0 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:02.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.065+0000 7fb959739700 1 -- 172.21.15.80:0/3906161087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb930002e60 con 0x7fb92c003c80 2019-11-28T11:25:02.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.068+0000 7fb952ffd700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb92c003c80 0x7fb92c004120 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fb94c010730 tx=0x7fb94c0105b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.069+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb94c00f210 con 0x7fb92c003c80 2019-11-28T11:25:02.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.255+0000 7fb959739700 1 -- 172.21.15.80:0/3906161087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", "id": 3} v 0) v1 -- 0x7fb930001d30 con 0x7fb92c003c80 2019-11-28T11:25:02.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.262+0000 7fb952ffd700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb92c003c80 0x7fb92c004120 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fb94c010730 tx=0x7fb94c0105b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.262+0000 7fb94bfff700 1 -- 172.21.15.80:0/3906161087 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb94c00ee10 con 0x7fb92c003c80 2019-11-28T11:25:02.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.272+0000 7fb959739700 1 -- 172.21.15.80:0/3906161087 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb92c020bc0 msgr2=0x7fb92c022ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.272+0000 7fb959739700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb92c020bc0 0x7fb92c022ff0 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:02.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.272+0000 7fb959739700 1 -- 172.21.15.80:0/3906161087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb92c003c80 msgr2=0x7fb92c004120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.272+0000 7fb959739700 1 --2- 172.21.15.80:0/3906161087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb92c003c80 0x7fb92c004120 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7fb94c010730 tx=0x7fb94c0105b0).stop 2019-11-28T11:25:02.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.272+0000 7fb953fff700 1 -- 172.21.15.80:0/3906161087 reap_dead start 2019-11-28T11:25:02.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.272+0000 7fb953fff700 1 -- 172.21.15.80:0/3906161087 reap_dead start 2019-11-28T11:25:02.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.272+0000 7fb959739700 1 -- 172.21.15.80:0/3906161087 shutdown_connections 2019-11-28T11:25:02.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.272+0000 7fb959739700 1 -- 172.21.15.80:0/3906161087 shutdown_connections 2019-11-28T11:25:02.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.272+0000 7fb959739700 1 -- 172.21.15.80:0/3906161087 wait complete. 2019-11-28T11:25:02.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.272+0000 7fb959739700 1 -- 172.21.15.80:0/3906161087 >> 172.21.15.80:0/3906161087 conn(0x7fb95413d620 msgr2=0x7fb95413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:02.379 INFO:teuthology.orchestra.run.smithi080.stdout:3 2019-11-28T11:25:02.380 INFO:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new fe40502b-24da-4e32-a3ae-709eddfaa03a 4 2019-11-28T11:25:02.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.481+0000 7ff020ea1700 1 Processor -- start 2019-11-28T11:25:02.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.481+0000 7ff020ea1700 1 -- start start 2019-11-28T11:25:02.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.482+0000 7ff020ea1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff01c06c0a0 0x7ff01c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:02.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.482+0000 7ff020ea1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01c06db00 con 0x7ff01c072620 2019-11-28T11:25:02.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.482+0000 7ff020ea1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01c06e000 con 0x7ff01c0734e0 2019-11-28T11:25:02.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.482+0000 7ff020ea1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c06fd60 con 0x7ff01c06c0a0 2019-11-28T11:25:02.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.482+0000 7ff01ad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff01c06c0a0 0x7ff01c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.482+0000 7ff01ad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff01c06c0a0 0x7ff01c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58644/0 (socket says 172.21.15.80:58644) 2019-11-28T11:25:02.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.482+0000 7ff01ad9d700 1 -- 172.21.15.80:0/4261849823 learned_addr learned my addr 172.21.15.80:0/4261849823 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:02.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.482+0000 7ff01b59e700 1 --1- 172.21.15.80:0/4261849823 >> v1:172.21.15.80:6789/0 conn(0x7ff01c072620 0x7ff01c164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:57962/0 (socket says 172.21.15.80:57962) 2019-11-28T11:25:02.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.482+0000 7ff019d9b700 1 -- 172.21.15.80:0/4261849823 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451211045 0 0) 0x7ff00c001080 con 0x7ff01c0734e0 2019-11-28T11:25:02.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.482+0000 7ff019d9b700 1 -- 172.21.15.80:0/4261849823 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feffc002e80 con 0x7ff01c0734e0 2019-11-28T11:25:02.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.482+0000 7ff01ad9d700 1 -- 172.21.15.80:0/4261849823 >> v1:172.21.15.174:6789/0 conn(0x7ff01c0734e0 legacy=0x7ff01c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.482+0000 7ff01ad9d700 1 -- 172.21.15.80:0/4261849823 >> v1:172.21.15.80:6789/0 conn(0x7ff01c072620 legacy=0x7ff01c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.482+0000 7ff019d9b700 1 -- 172.21.15.80:0/4261849823 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641321491 0 0) 0x7ff014000d30 con 0x7ff01c072620 2019-11-28T11:25:02.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.482+0000 7ff01ad9d700 1 -- 172.21.15.80:0/4261849823 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c0706c0 con 0x7ff01c06c0a0 2019-11-28T11:25:02.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.483+0000 7ff01ad9d700 1 --2- 172.21.15.80:0/4261849823 >> v2:172.21.15.80:3300/0 conn(0x7ff01c06c0a0 0x7ff01c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff00400f740 tx=0x7ff00400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.483+0000 7ff01ad9d700 1 --2- 172.21.15.80:0/4261849823 >> v2:172.21.15.80:3300/0 conn(0x7ff01c06c0a0 0x7ff01c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff00400f740 tx=0x7ff00400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.483+0000 7ff01ad9d700 1 --2- 172.21.15.80:0/4261849823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c06c0a0 0x7ff01c072fa0 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7ff00400f740 tx=0x7ff00400fae0).ready entity=mon.0 client_cookie=887e543c19a164e5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:02.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.483+0000 7ff01ad9d700 1 --2- 172.21.15.80:0/4261849823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c06c0a0 0x7ff01c072fa0 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7ff00400f740 tx=0x7ff00400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.483+0000 7ff019d9b700 1 -- 172.21.15.80:0/4261849823 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff004000960 con 0x7ff01c06c0a0 2019-11-28T11:25:02.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.483+0000 7ff01ad9d700 1 --2- 172.21.15.80:0/4261849823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c06c0a0 0x7ff01c072fa0 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7ff00400f740 tx=0x7ff00400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.483+0000 7ff01ad9d700 1 --2- 172.21.15.80:0/4261849823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c06c0a0 0x7ff01c072fa0 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7ff00400f740 tx=0x7ff00400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.483+0000 7ff019d9b700 1 -- 172.21.15.80:0/4261849823 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff004000c90 con 0x7ff01c06c0a0 2019-11-28T11:25:02.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.483+0000 7ff019d9b700 1 -- 172.21.15.80:0/4261849823 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff004001360 con 0x7ff01c06c0a0 2019-11-28T11:25:02.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.483+0000 7ff020ea1700 1 -- 172.21.15.80:0/4261849823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c06c0a0 msgr2=0x7ff01c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.483+0000 7ff020ea1700 1 --2- 172.21.15.80:0/4261849823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c06c0a0 0x7ff01c072fa0 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7ff00400f740 tx=0x7ff00400fae0).stop 2019-11-28T11:25:02.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.484+0000 7ff020ea1700 1 -- 172.21.15.80:0/4261849823 shutdown_connections 2019-11-28T11:25:02.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.484+0000 7ff020ea1700 1 --2- 172.21.15.80:0/4261849823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c06c0a0 0x7ff01c072fa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:02.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.484+0000 7ff020ea1700 1 -- 172.21.15.80:0/4261849823 shutdown_connections 2019-11-28T11:25:02.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.484+0000 7ff020ea1700 1 -- 172.21.15.80:0/4261849823 wait complete. 2019-11-28T11:25:02.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.484+0000 7ff020ea1700 1 -- 172.21.15.80:0/4261849823 >> 172.21.15.80:0/4261849823 conn(0x7ff01c061cf0 msgr2=0x7ff01c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:02.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.486+0000 7ff020ea1700 1 Processor -- start 2019-11-28T11:25:02.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.486+0000 7ff020ea1700 1 -- start start 2019-11-28T11:25:02.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff020ea1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff01c111db0 0x7ff01c1238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:02.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff020ea1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff01c165a00 0x7ff01c167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:02.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff020ea1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01c124260 con 0x7ff01c12cea0 2019-11-28T11:25:02.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff020ea1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c121040 con 0x7ff01c111db0 2019-11-28T11:25:02.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff020ea1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c121310 con 0x7ff01c165a00 2019-11-28T11:25:02.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff01a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff01c111db0 0x7ff01c1238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff01ad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff01c12cea0 0x7ff01c1230e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:57966/0 (socket says 172.21.15.80:57966) 2019-11-28T11:25:02.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff01ad9d700 1 -- 172.21.15.80:0/436185019 learned_addr learned my addr 172.21.15.80:0/436185019 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:02.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff01b59e700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff01c165a00 0x7ff01c167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff01a59c700 1 -- 172.21.15.80:0/436185019 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff01c165a00 msgr2=0x7ff01c167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff01a59c700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff01c165a00 0x7ff01c167e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff01a59c700 1 -- 172.21.15.80:0/436185019 >> v1:172.21.15.80:6789/0 conn(0x7ff01c12cea0 legacy=0x7ff01c1230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff01a59c700 1 -- 172.21.15.80:0/436185019 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c1219a0 con 0x7ff01c111db0 2019-11-28T11:25:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff0137fe700 1 -- 172.21.15.80:0/436185019 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338553112 0 0) 0x7ff0040075d0 con 0x7ff01c12cea0 2019-11-28T11:25:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff01a59c700 1 --2- 172.21.15.80:0/436185019 >> v2:172.21.15.80:3300/0 conn(0x7ff01c111db0 0x7ff01c1238e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff00c010340 tx=0x7ff00c0106e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff01a59c700 1 --2- 172.21.15.80:0/436185019 >> v2:172.21.15.80:3300/0 conn(0x7ff01c111db0 0x7ff01c1238e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff00c010340 tx=0x7ff00c0106e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.487+0000 7ff01a59c700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c111db0 0x7ff01c1238e0 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7ff00c010340 tx=0x7ff00c0106e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:02.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.488+0000 7ff01a59c700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c111db0 0x7ff01c1238e0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7ff00c010340 tx=0x7ff00c0106e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.488+0000 7ff0137fe700 1 -- 172.21.15.80:0/436185019 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff00c00ec40 con 0x7ff01c111db0 2019-11-28T11:25:02.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.488+0000 7ff01a59c700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c111db0 0x7ff01c1238e0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7ff00c010340 tx=0x7ff00c0106e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.488+0000 7ff01a59c700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c111db0 0x7ff01c1238e0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7ff00c010340 tx=0x7ff00c0106e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.488+0000 7ff0137fe700 1 -- 172.21.15.80:0/436185019 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c000be0 con 0x7ff01c111db0 2019-11-28T11:25:02.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.488+0000 7ff020ea1700 1 -- 172.21.15.80:0/436185019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01c121d20 con 0x7ff01c111db0 2019-11-28T11:25:02.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.488+0000 7ff0137fe700 1 -- 172.21.15.80:0/436185019 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff00c00f3c0 con 0x7ff01c111db0 2019-11-28T11:25:02.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.488+0000 7ff020ea1700 1 -- 172.21.15.80:0/436185019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01c1219a0 con 0x7ff01c111db0 2019-11-28T11:25:02.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.488+0000 7ff01a59c700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c111db0 0x7ff01c1238e0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7ff00c010340 tx=0x7ff00c0106e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.488+0000 7ff0137fe700 1 -- 172.21.15.80:0/436185019 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff00c00f480 con 0x7ff01c111db0 2019-11-28T11:25:02.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.488+0000 7ff01a59c700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c111db0 0x7ff01c1238e0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7ff00c010340 tx=0x7ff00c0106e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.488+0000 7ff0137fe700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feff4018730 0x7feff401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:02.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.488+0000 7ff0137fe700 1 -- 172.21.15.80:0/436185019 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7ff00c031a60 con 0x7ff01c111db0 2019-11-28T11:25:02.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.488+0000 7ff01ad9d700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feff4018730 0x7feff401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.489+0000 7ff01ad9d700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feff4018730 0x7feff401abc0 crc :-1 s=READY pgs=11 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:02.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.496+0000 7ff020ea1700 1 -- 172.21.15.80:0/436185019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01c121d20 con 0x7ff01c111db0 2019-11-28T11:25:02.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.500+0000 7ff01a59c700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c111db0 0x7ff01c1238e0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7ff00c010340 tx=0x7ff00c0106e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.500+0000 7ff0137fe700 1 -- 172.21.15.80:0/436185019 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff00c00f1d0 con 0x7ff01c111db0 2019-11-28T11:25:02.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.688+0000 7ff020ea1700 1 -- 172.21.15.80:0/436185019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", "id": 4} v 0) v1 -- 0x7ff01c1219a0 con 0x7ff01c111db0 2019-11-28T11:25:02.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.695+0000 7ff01a59c700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c111db0 0x7ff01c1238e0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7ff00c010340 tx=0x7ff00c0106e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.695+0000 7ff0137fe700 1 -- 172.21.15.80:0/436185019 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff00c00f3e0 con 0x7ff01c111db0 2019-11-28T11:25:02.724 INFO:teuthology.orchestra.run.smithi080.stdout:4 2019-11-28T11:25:02.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.705+0000 7ff020ea1700 1 -- 172.21.15.80:0/436185019 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feff4018730 msgr2=0x7feff401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.705+0000 7ff020ea1700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feff4018730 0x7feff401abc0 crc :-1 s=READY pgs=11 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:02.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.705+0000 7ff020ea1700 1 -- 172.21.15.80:0/436185019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c111db0 msgr2=0x7ff01c1238e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.705+0000 7ff020ea1700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c111db0 0x7ff01c1238e0 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7ff00c010340 tx=0x7ff00c0106e0).stop 2019-11-28T11:25:02.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.705+0000 7ff020ea1700 1 -- 172.21.15.80:0/436185019 shutdown_connections 2019-11-28T11:25:02.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.705+0000 7ff020ea1700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feff4018730 0x7feff401abc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:02.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.705+0000 7ff020ea1700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff01c165a00 0x7ff01c167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:02.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.705+0000 7ff020ea1700 1 --2- 172.21.15.80:0/436185019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff01c111db0 0x7ff01c1238e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:02.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.705+0000 7ff020ea1700 1 -- 172.21.15.80:0/436185019 shutdown_connections 2019-11-28T11:25:02.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.705+0000 7ff020ea1700 1 -- 172.21.15.80:0/436185019 wait complete. 2019-11-28T11:25:02.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.705+0000 7ff020ea1700 1 -- 172.21.15.80:0/436185019 >> 172.21.15.80:0/436185019 conn(0x7ff01c1426c0 msgr2=0x7ff01c110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:02.733 INFO:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new 4aba29c2-abad-41d2-97a9-cac1f5f7454a 5 2019-11-28T11:25:02.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.833+0000 7fb74a539700 1 Processor -- start 2019-11-28T11:25:02.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.833+0000 7fb74a539700 1 -- start start 2019-11-28T11:25:02.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.834+0000 7fb74a539700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb74406c0a0 0x7fb744072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:02.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.834+0000 7fb74a539700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:02.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.834+0000 7fb74a539700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74406db00 con 0x7fb7440734e0 2019-11-28T11:25:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.834+0000 7fb74a539700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74406fd60 con 0x7fb74406c0a0 2019-11-28T11:25:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.834+0000 7fb74a539700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb744070030 con 0x7fb744072620 2019-11-28T11:25:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.834+0000 7fb7492d7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.834+0000 7fb748ad6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb74406c0a0 0x7fb744072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.834+0000 7fb7492d7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:60922/0 (socket says 172.21.15.80:60922) 2019-11-28T11:25:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.834+0000 7fb748ad6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb74406c0a0 0x7fb744072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:45312/0 (socket says 172.21.15.80:45312) 2019-11-28T11:25:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.834+0000 7fb7492d7700 1 -- 172.21.15.80:0/3402985798 learned_addr learned my addr 172.21.15.80:0/3402985798 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.834+0000 7fb743fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fb7440734e0 0x7fb744071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:45286/0 (socket says 172.21.15.80:45286) 2019-11-28T11:25:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.834+0000 7fb7492d7700 1 -- 172.21.15.80:0/3402985798 >> v2:172.21.15.174:3300/0 conn(0x7fb74406c0a0 msgr2=0x7fb744072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.834+0000 7fb7492d7700 1 --2- 172.21.15.80:0/3402985798 >> v2:172.21.15.174:3300/0 conn(0x7fb74406c0a0 0x7fb744072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.834+0000 7fb7492d7700 1 -- 172.21.15.80:0/3402985798 >> v1:172.21.15.174:6789/0 conn(0x7fb7440734e0 legacy=0x7fb744071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.834+0000 7fb7492d7700 1 -- 172.21.15.80:0/3402985798 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7440706c0 con 0x7fb744072620 2019-11-28T11:25:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.834+0000 7fb748ad6700 1 --2- 172.21.15.80:0/3402985798 >> v2:172.21.15.174:3300/0 conn(0x7fb74406c0a0 0x7fb744072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.835+0000 7fb7492d7700 1 --2- 172.21.15.80:0/3402985798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb73c00f760 tx=0x7fb73c00fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.835+0000 7fb7492d7700 1 --2- 172.21.15.80:0/3402985798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb73c00f760 tx=0x7fb73c00fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.835+0000 7fb7492d7700 1 --2- 172.21.15.80:0/3402985798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7fb73c00f760 tx=0x7fb73c00fb00).ready entity=mon.2 client_cookie=7fab7a30a71a305e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.835+0000 7fb7492d7700 1 --2- 172.21.15.80:0/3402985798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fb73c00f760 tx=0x7fb73c00fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.835+0000 7fb7492d7700 1 --2- 172.21.15.80:0/3402985798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fb73c00f760 tx=0x7fb73c00fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.835+0000 7fb7492d7700 1 --2- 172.21.15.80:0/3402985798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fb73c00f760 tx=0x7fb73c00fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.835+0000 7fb7437fe700 1 -- 172.21.15.80:0/3402985798 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb73c000a70 con 0x7fb744072620 2019-11-28T11:25:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.835+0000 7fb7437fe700 1 -- 172.21.15.80:0/3402985798 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c000e70 con 0x7fb744072620 2019-11-28T11:25:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.835+0000 7fb7437fe700 1 -- 172.21.15.80:0/3402985798 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb73c001500 con 0x7fb744072620 2019-11-28T11:25:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.835+0000 7fb74a539700 1 -- 172.21.15.80:0/3402985798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 msgr2=0x7fb744164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.835+0000 7fb74a539700 1 --2- 172.21.15.80:0/3402985798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7fb73c00f760 tx=0x7fb73c00fb00).stop 2019-11-28T11:25:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.835+0000 7fb74a539700 1 -- 172.21.15.80:0/3402985798 shutdown_connections 2019-11-28T11:25:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.835+0000 7fb74a539700 1 --2- 172.21.15.80:0/3402985798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.835+0000 7fb74a539700 1 --2- 172.21.15.80:0/3402985798 >> v2:172.21.15.174:3300/0 conn(0x7fb74406c0a0 0x7fb744072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.836+0000 7fb74a539700 1 -- 172.21.15.80:0/3402985798 shutdown_connections 2019-11-28T11:25:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.836+0000 7fb74a539700 1 -- 172.21.15.80:0/3402985798 wait complete. 2019-11-28T11:25:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.836+0000 7fb74a539700 1 -- 172.21.15.80:0/3402985798 >> 172.21.15.80:0/3402985798 conn(0x7fb744061cf0 msgr2=0x7fb744064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.838+0000 7fb74a539700 1 Processor -- start 2019-11-28T11:25:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.838+0000 7fb74a539700 1 -- start start 2019-11-28T11:25:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.839+0000 7fb74a539700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb74413e9e0 0x7fb744108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.839+0000 7fb74a539700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744109430 0x7fb7441098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.839+0000 7fb74a539700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7441066e0 con 0x7fb74413e5f0 2019-11-28T11:25:02.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.839+0000 7fb74a539700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74410e060 con 0x7fb74413e9e0 2019-11-28T11:25:02.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.839+0000 7fb74a539700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74410e330 con 0x7fb744109430 2019-11-28T11:25:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.839+0000 7fb748ad6700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb74413e5f0 0x7fb74410a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:57980/0 (socket says 172.21.15.80:57980) 2019-11-28T11:25:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.839+0000 7fb748ad6700 1 -- 172.21.15.80:0/2267949519 learned_addr learned my addr 172.21.15.80:0/2267949519 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.839+0000 7fb743fff700 1 --2- 172.21.15.80:0/2267949519 >> v2:172.21.15.174:3300/0 conn(0x7fb74413e9e0 0x7fb744108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.839+0000 7fb7492d7700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744109430 0x7fb7441098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.839+0000 7fb7417fa700 1 -- 172.21.15.80:0/2267949519 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852446958 0 0) 0x7fb73400e110 con 0x7fb74413e5f0 2019-11-28T11:25:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.839+0000 7fb7417fa700 1 -- 172.21.15.80:0/2267949519 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb724002e80 con 0x7fb74413e5f0 2019-11-28T11:25:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.839+0000 7fb743fff700 1 -- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744109430 msgr2=0x7fb7441098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.839+0000 7fb743fff700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744109430 0x7fb7441098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.839+0000 7fb743fff700 1 -- 172.21.15.80:0/2267949519 >> v1:172.21.15.80:6789/0 conn(0x7fb74413e5f0 legacy=0x7fb74410a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.839+0000 7fb743fff700 1 -- 172.21.15.80:0/2267949519 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74410e9c0 con 0x7fb74413e9e0 2019-11-28T11:25:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.840+0000 7fb743fff700 1 --2- 172.21.15.80:0/2267949519 >> v2:172.21.15.174:3300/0 conn(0x7fb74413e9e0 0x7fb744108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb738010360 tx=0x7fb7380101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.840+0000 7fb743fff700 1 --2- 172.21.15.80:0/2267949519 >> v2:172.21.15.174:3300/0 conn(0x7fb74413e9e0 0x7fb744108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb738010360 tx=0x7fb7380101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.840+0000 7fb743fff700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74413e9e0 0x7fb744108ef0 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7fb738010360 tx=0x7fb7380101e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.840+0000 7fb743fff700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74413e9e0 0x7fb744108ef0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fb738010360 tx=0x7fb7380101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.840+0000 7fb7417fa700 1 -- 172.21.15.80:0/2267949519 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb738001240 con 0x7fb74413e9e0 2019-11-28T11:25:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.840+0000 7fb743fff700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74413e9e0 0x7fb744108ef0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fb738010360 tx=0x7fb7380101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.840+0000 7fb743fff700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74413e9e0 0x7fb744108ef0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fb738010360 tx=0x7fb7380101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.840+0000 7fb7417fa700 1 -- 172.21.15.80:0/2267949519 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7380041c0 con 0x7fb74413e9e0 2019-11-28T11:25:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.840+0000 7fb7417fa700 1 -- 172.21.15.80:0/2267949519 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb738004890 con 0x7fb74413e9e0 2019-11-28T11:25:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.840+0000 7fb74a539700 1 -- 172.21.15.80:0/2267949519 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74410ed40 con 0x7fb74413e9e0 2019-11-28T11:25:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.840+0000 7fb74a539700 1 -- 172.21.15.80:0/2267949519 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74410e9c0 con 0x7fb74413e9e0 2019-11-28T11:25:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.840+0000 7fb743fff700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74413e9e0 0x7fb744108ef0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fb738010360 tx=0x7fb7380101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.841+0000 7fb7417fa700 1 -- 172.21.15.80:0/2267949519 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb7380043b0 con 0x7fb74413e9e0 2019-11-28T11:25:02.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.841+0000 7fb743fff700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74413e9e0 0x7fb744108ef0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fb738010360 tx=0x7fb7380101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.841+0000 7fb7417fa700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb724018770 0x7fb72401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:02.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.841+0000 7fb7417fa700 1 -- 172.21.15.80:0/2267949519 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fb7380319a0 con 0x7fb74413e9e0 2019-11-28T11:25:02.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.841+0000 7fb748ad6700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb724018770 0x7fb72401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:02.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.841+0000 7fb748ad6700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb724018770 0x7fb72401abe0 crc :-1 s=READY pgs=12 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.848+0000 7fb74a539700 1 -- 172.21.15.80:0/2267949519 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74410ed40 con 0x7fb74413e9e0 2019-11-28T11:25:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.852+0000 7fb743fff700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74413e9e0 0x7fb744108ef0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fb738010360 tx=0x7fb7380101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:02.852+0000 7fb7417fa700 1 -- 172.21.15.80:0/2267949519 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb738020f80 con 0x7fb74413e9e0 2019-11-28T11:25:03.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.038+0000 7fb74a539700 1 -- 172.21.15.80:0/2267949519 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", "id": 5} v 0) v1 -- 0x7fb74410e9c0 con 0x7fb74413e9e0 2019-11-28T11:25:03.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.046+0000 7fb743fff700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74413e9e0 0x7fb744108ef0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fb738010360 tx=0x7fb7380101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.046+0000 7fb7417fa700 1 -- 172.21.15.80:0/2267949519 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb738020f80 con 0x7fb74413e9e0 2019-11-28T11:25:03.071 INFO:teuthology.orchestra.run.smithi080.stdout:5 2019-11-28T11:25:03.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.055+0000 7fb74a539700 1 -- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb724018770 msgr2=0x7fb72401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:03.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.055+0000 7fb74a539700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb724018770 0x7fb72401abe0 crc :-1 s=READY pgs=12 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:03.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.055+0000 7fb74a539700 1 -- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74413e9e0 msgr2=0x7fb744108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:03.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.055+0000 7fb74a539700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74413e9e0 0x7fb744108ef0 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7fb738010360 tx=0x7fb7380101e0).stop 2019-11-28T11:25:03.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.055+0000 7fb74a539700 1 -- 172.21.15.80:0/2267949519 shutdown_connections 2019-11-28T11:25:03.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.055+0000 7fb74a539700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb724018770 0x7fb72401abe0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:03.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.055+0000 7fb74a539700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744109430 0x7fb7441098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:03.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.055+0000 7fb74a539700 1 --2- 172.21.15.80:0/2267949519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74413e9e0 0x7fb744108ef0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:03.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.055+0000 7fb74a539700 1 -- 172.21.15.80:0/2267949519 shutdown_connections 2019-11-28T11:25:03.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.055+0000 7fb74a539700 1 -- 172.21.15.80:0/2267949519 wait complete. 2019-11-28T11:25:03.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.055+0000 7fb74a539700 1 -- 172.21.15.80:0/2267949519 >> 172.21.15.80:0/2267949519 conn(0x7fb74413d620 msgr2=0x7fb74413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:03.083 INFO:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new 8cd8b938-4ac2-40f4-a7b0-b01afb88b878 6 2019-11-28T11:25:03.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.191+0000 7f0f0ddb9700 1 Processor -- start 2019-11-28T11:25:03.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.191+0000 7f0f0ddb9700 1 -- start start 2019-11-28T11:25:03.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0f0ddb9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0806c0a0 0x7f0f08072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:03.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0f0ddb9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f080734e0 0x7f0f08071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:03.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0f0ddb9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0f08072360 0x7f0f080727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:03.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0f0ddb9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0806f330 con 0x7f0f080734e0 2019-11-28T11:25:03.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0f0ddb9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f080706c0 con 0x7f0f08072360 2019-11-28T11:25:03.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0f0ddb9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f08070a40 con 0x7f0f0806c0a0 2019-11-28T11:25:03.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0efffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f080734e0 0x7f0f08071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:03.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0efffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f080734e0 0x7f0f08071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58672/0 (socket says 172.21.15.80:58672) 2019-11-28T11:25:03.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0efffff700 1 -- 172.21.15.80:0/3647522804 learned_addr learned my addr 172.21.15.80:0/3647522804 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:03.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0f07fff700 1 --2- 172.21.15.80:0/3647522804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0806c0a0 0x7f0f08072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:03.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0f0cb57700 1 --2- 172.21.15.80:0/3647522804 >> v2:172.21.15.174:3300/0 conn(0x7f0f08072360 0x7f0f080727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:03.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0efffff700 1 -- 172.21.15.80:0/3647522804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0806c0a0 msgr2=0x7f0f08072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:03.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0efffff700 1 --2- 172.21.15.80:0/3647522804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0806c0a0 0x7f0f08072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:03.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0efffff700 1 -- 172.21.15.80:0/3647522804 >> v2:172.21.15.174:3300/0 conn(0x7f0f08072360 msgr2=0x7f0f080727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:03.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0efffff700 1 --2- 172.21.15.80:0/3647522804 >> v2:172.21.15.174:3300/0 conn(0x7f0f08072360 0x7f0f080727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:03.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0efffff700 1 -- 172.21.15.80:0/3647522804 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0806db00 con 0x7f0f080734e0 2019-11-28T11:25:03.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0f07fff700 1 --2- 172.21.15.80:0/3647522804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0806c0a0 0x7f0f08072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:25:03.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0f0cb57700 1 --2- 172.21.15.80:0/3647522804 >> v2:172.21.15.174:3300/0 conn(0x7f0f08072360 0x7f0f080727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:25:03.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0efffff700 1 --2- 172.21.15.80:0/3647522804 >> v2:172.21.15.80:3300/0 conn(0x7f0f080734e0 0x7f0f08071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0ef000f740 tx=0x7f0ef000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0efffff700 1 --2- 172.21.15.80:0/3647522804 >> v2:172.21.15.80:3300/0 conn(0x7f0f080734e0 0x7f0f08071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0ef000f740 tx=0x7f0ef000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0efffff700 1 --2- 172.21.15.80:0/3647522804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f080734e0 0x7f0f08071e20 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f0ef000f740 tx=0x7f0ef000fae0).ready entity=mon.0 client_cookie=c55f7fd76c0995bd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:03.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0efffff700 1 --2- 172.21.15.80:0/3647522804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f080734e0 0x7f0f08071e20 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f0ef000f740 tx=0x7f0ef000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0efffff700 1 --2- 172.21.15.80:0/3647522804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f080734e0 0x7f0f08071e20 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f0ef000f740 tx=0x7f0ef000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0f077fe700 1 -- 172.21.15.80:0/3647522804 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ef0000960 con 0x7f0f080734e0 2019-11-28T11:25:03.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0efffff700 1 --2- 172.21.15.80:0/3647522804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f080734e0 0x7f0f08071e20 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f0ef000f740 tx=0x7f0ef000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0f077fe700 1 -- 172.21.15.80:0/3647522804 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef0000e80 con 0x7f0f080734e0 2019-11-28T11:25:03.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0f077fe700 1 -- 172.21.15.80:0/3647522804 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ef00015d0 con 0x7f0f080734e0 2019-11-28T11:25:03.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0f0ddb9700 1 -- 172.21.15.80:0/3647522804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f080734e0 msgr2=0x7f0f08071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:03.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.192+0000 7f0f0ddb9700 1 --2- 172.21.15.80:0/3647522804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f080734e0 0x7f0f08071e20 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f0ef000f740 tx=0x7f0ef000fae0).stop 2019-11-28T11:25:03.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.193+0000 7f0f0ddb9700 1 -- 172.21.15.80:0/3647522804 shutdown_connections 2019-11-28T11:25:03.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.193+0000 7f0f0ddb9700 1 --2- 172.21.15.80:0/3647522804 >> v2:172.21.15.174:3300/0 conn(0x7f0f08072360 0x7f0f080727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:03.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.193+0000 7f0f0ddb9700 1 --2- 172.21.15.80:0/3647522804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f080734e0 0x7f0f08071e20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:03.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.193+0000 7f0f0ddb9700 1 --2- 172.21.15.80:0/3647522804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0806c0a0 0x7f0f08072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:03.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.193+0000 7f0f0ddb9700 1 -- 172.21.15.80:0/3647522804 shutdown_connections 2019-11-28T11:25:03.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.193+0000 7f0f0ddb9700 1 -- 172.21.15.80:0/3647522804 wait complete. 2019-11-28T11:25:03.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.193+0000 7f0f0ddb9700 1 -- 172.21.15.80:0/3647522804 >> 172.21.15.80:0/3647522804 conn(0x7f0f08061cf0 msgr2=0x7f0f08064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:03.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.196+0000 7f0f0ddb9700 1 Processor -- start 2019-11-28T11:25:03.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.196+0000 7f0f0ddb9700 1 -- start start 2019-11-28T11:25:03.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.196+0000 7f0f0ddb9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0f0815fdf0 0x7f0f0812b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:03.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.196+0000 7f0f0ddb9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f0812b8a0 0x7f0f0813e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:03.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.196+0000 7f0f0ddb9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f08139e00 con 0x7f0f0813e860 2019-11-28T11:25:03.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.196+0000 7f0f0ddb9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f08108820 con 0x7f0f0812b8a0 2019-11-28T11:25:03.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.196+0000 7f0f0ddb9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f08108af0 con 0x7f0f0815fdf0 2019-11-28T11:25:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.196+0000 7f0efffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f0812b8a0 0x7f0f0813e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.196+0000 7f0efffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f0812b8a0 0x7f0f0813e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58680/0 (socket says 172.21.15.80:58680) 2019-11-28T11:25:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.196+0000 7f0efffff700 1 -- 172.21.15.80:0/4191193421 learned_addr learned my addr 172.21.15.80:0/4191193421 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:03.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0f07fff700 1 --2- 172.21.15.80:0/4191193421 >> v2:172.21.15.174:3300/0 conn(0x7f0f0815fdf0 0x7f0f0812b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:03.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0efffff700 1 -- 172.21.15.80:0/4191193421 >> v2:172.21.15.174:3300/0 conn(0x7f0f0815fdf0 msgr2=0x7f0f0812b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:03.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0efffff700 1 --2- 172.21.15.80:0/4191193421 >> v2:172.21.15.174:3300/0 conn(0x7f0f0815fdf0 0x7f0f0812b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:03.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0efffff700 1 -- 172.21.15.80:0/4191193421 >> v1:172.21.15.174:6789/0 conn(0x7f0f0813e860 legacy=0x7f0f0812a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:03.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0efffff700 1 -- 172.21.15.80:0/4191193421 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0810a8c0 con 0x7f0f0812b8a0 2019-11-28T11:25:03.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0f07fff700 1 --2- 172.21.15.80:0/4191193421 >> v2:172.21.15.174:3300/0 conn(0x7f0f0815fdf0 0x7f0f0812b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:25:03.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0efffff700 1 --2- 172.21.15.80:0/4191193421 >> v2:172.21.15.80:3300/0 conn(0x7f0f0812b8a0 0x7f0f0813e320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ef0010470 tx=0x7f0ef0010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0efffff700 1 --2- 172.21.15.80:0/4191193421 >> v2:172.21.15.80:3300/0 conn(0x7f0f0812b8a0 0x7f0f0813e320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ef0010470 tx=0x7f0ef0010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0efffff700 1 --2- 172.21.15.80:0/4191193421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0812b8a0 0x7f0f0813e320 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f0ef0010470 tx=0x7f0ef0010810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:03.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0efffff700 1 --2- 172.21.15.80:0/4191193421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0812b8a0 0x7f0f0813e320 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f0ef0010470 tx=0x7f0ef0010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0efffff700 1 --2- 172.21.15.80:0/4191193421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0812b8a0 0x7f0f0813e320 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f0ef0010470 tx=0x7f0ef0010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0efffff700 1 --2- 172.21.15.80:0/4191193421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0812b8a0 0x7f0f0813e320 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f0ef0010470 tx=0x7f0ef0010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0f057fa700 1 -- 172.21.15.80:0/4191193421 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ef0005770 con 0x7f0f0812b8a0 2019-11-28T11:25:03.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0f057fa700 1 -- 172.21.15.80:0/4191193421 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef0005390 con 0x7f0f0812b8a0 2019-11-28T11:25:03.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0f0ddb9700 1 -- 172.21.15.80:0/4191193421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0810a8c0 con 0x7f0f0812b8a0 2019-11-28T11:25:03.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0f057fa700 1 -- 172.21.15.80:0/4191193421 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ef0005d50 con 0x7f0f0812b8a0 2019-11-28T11:25:03.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0f0ddb9700 1 -- 172.21.15.80:0/4191193421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0810a8c0 con 0x7f0f0812b8a0 2019-11-28T11:25:03.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.197+0000 7f0efffff700 1 --2- 172.21.15.80:0/4191193421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0812b8a0 0x7f0f0813e320 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f0ef0010470 tx=0x7f0ef0010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.198+0000 7f0f057fa700 1 -- 172.21.15.80:0/4191193421 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0ef0005580 con 0x7f0f0812b8a0 2019-11-28T11:25:03.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.198+0000 7f0efffff700 1 --2- 172.21.15.80:0/4191193421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0812b8a0 0x7f0f0813e320 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f0ef0010470 tx=0x7f0ef0010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.198+0000 7f0f057fa700 1 --2- 172.21.15.80:0/4191193421 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0eec018730 0x7f0eec01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:03.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.198+0000 7f0f057fa700 1 -- 172.21.15.80:0/4191193421 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f0ef0031b60 con 0x7f0f0812b8a0 2019-11-28T11:25:03.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.198+0000 7f0f07fff700 1 --2- 172.21.15.80:0/4191193421 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0eec018730 0x7f0eec01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:03.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.198+0000 7f0f07fff700 1 --2- 172.21.15.80:0/4191193421 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0eec018730 0x7f0eec01abc0 crc :-1 s=READY pgs=13 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:03.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.206+0000 7f0f0ddb9700 1 -- 172.21.15.80:0/4191193421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f08109180 con 0x7f0f0812b8a0 2019-11-28T11:25:03.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.209+0000 7f0efffff700 1 --2- 172.21.15.80:0/4191193421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0812b8a0 0x7f0f0813e320 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f0ef0010470 tx=0x7f0ef0010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.209+0000 7f0f057fa700 1 -- 172.21.15.80:0/4191193421 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0ef0005180 con 0x7f0f0812b8a0 2019-11-28T11:25:03.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.394+0000 7f0f0ddb9700 1 -- 172.21.15.80:0/4191193421 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", "id": 6} v 0) v1 -- 0x7f0f08109500 con 0x7f0f0812b8a0 2019-11-28T11:25:03.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.400+0000 7f0efffff700 1 --2- 172.21.15.80:0/4191193421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0812b8a0 0x7f0f0813e320 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f0ef0010470 tx=0x7f0ef0010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.400+0000 7f0f057fa700 1 -- 172.21.15.80:0/4191193421 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0ef0005580 con 0x7f0f0812b8a0 2019-11-28T11:25:03.420 INFO:teuthology.orchestra.run.smithi080.stdout:6 2019-11-28T11:25:03.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.403+0000 7f0f0ddb9700 1 -- 172.21.15.80:0/4191193421 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0eec018730 msgr2=0x7f0eec01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:03.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.403+0000 7f0f0ddb9700 1 --2- 172.21.15.80:0/4191193421 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0eec018730 0x7f0eec01abc0 crc :-1 s=READY pgs=13 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:03.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.403+0000 7f0f0ddb9700 1 -- 172.21.15.80:0/4191193421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0812b8a0 msgr2=0x7f0f0813e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:03.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.403+0000 7f0f0ddb9700 1 --2- 172.21.15.80:0/4191193421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0812b8a0 0x7f0f0813e320 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f0ef0010470 tx=0x7f0ef0010810).stop 2019-11-28T11:25:03.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.403+0000 7f0f0ddb9700 1 -- 172.21.15.80:0/4191193421 shutdown_connections 2019-11-28T11:25:03.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.403+0000 7f0f0ddb9700 1 --2- 172.21.15.80:0/4191193421 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0eec018730 0x7f0eec01abc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:03.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.403+0000 7f0f0ddb9700 1 --2- 172.21.15.80:0/4191193421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0812b8a0 0x7f0f0813e320 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:03.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.403+0000 7f0f0ddb9700 1 --2- 172.21.15.80:0/4191193421 >> v2:172.21.15.174:3300/0 conn(0x7f0f0815fdf0 0x7f0f0812b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:03.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.403+0000 7f0f0ddb9700 1 -- 172.21.15.80:0/4191193421 shutdown_connections 2019-11-28T11:25:03.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.403+0000 7f0f0ddb9700 1 -- 172.21.15.80:0/4191193421 wait complete. 2019-11-28T11:25:03.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.403+0000 7f0f0ddb9700 1 -- 172.21.15.80:0/4191193421 >> 172.21.15.80:0/4191193421 conn(0x7f0f08127dc0 msgr2=0x7f0f08141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:03.432 INFO:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new 5aba17ce-f3d9-46c6-a034-a8657647719a 7 2019-11-28T11:25:03.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.565+0000 7fe89cbc0700 1 Processor -- start 2019-11-28T11:25:03.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.565+0000 7fe89cbc0700 1 -- start start 2019-11-28T11:25:03.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.566+0000 7fe89cbc0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe89806c0a0 0x7fe898072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:03.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.566+0000 7fe89cbc0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe8980734e0 0x7fe898071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:03.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.566+0000 7fe89cbc0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe898072360 0x7fe8980727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:03.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.566+0000 7fe89cbc0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89806f330 con 0x7fe898072360 2019-11-28T11:25:03.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.566+0000 7fe89cbc0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8980706c0 con 0x7fe8980734e0 2019-11-28T11:25:03.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.566+0000 7fe89cbc0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe898070a40 con 0x7fe89806c0a0 2019-11-28T11:25:03.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.566+0000 7fe89759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe898072360 0x7fe8980727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:03.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.566+0000 7fe89759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe898072360 0x7fe8980727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58688/0 (socket says 172.21.15.80:58688) 2019-11-28T11:25:03.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.566+0000 7fe89759e700 1 -- 172.21.15.80:0/4164001754 learned_addr learned my addr 172.21.15.80:0/4164001754 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:03.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.566+0000 7fe896d9d700 1 --2- 172.21.15.80:0/4164001754 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe89806c0a0 0x7fe898072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:03.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.566+0000 7fe89659c700 1 --2- 172.21.15.80:0/4164001754 >> v2:172.21.15.174:3300/0 conn(0x7fe8980734e0 0x7fe898071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:03.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.567+0000 7fe89759e700 1 -- 172.21.15.80:0/4164001754 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe89806c0a0 msgr2=0x7fe898072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:03.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.567+0000 7fe89759e700 1 --2- 172.21.15.80:0/4164001754 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe89806c0a0 0x7fe898072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:03.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.567+0000 7fe89759e700 1 -- 172.21.15.80:0/4164001754 >> v2:172.21.15.174:3300/0 conn(0x7fe8980734e0 msgr2=0x7fe898071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:03.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.567+0000 7fe89759e700 1 --2- 172.21.15.80:0/4164001754 >> v2:172.21.15.174:3300/0 conn(0x7fe8980734e0 0x7fe898071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:03.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.567+0000 7fe89759e700 1 -- 172.21.15.80:0/4164001754 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89806db00 con 0x7fe898072360 2019-11-28T11:25:03.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.567+0000 7fe89759e700 1 --2- 172.21.15.80:0/4164001754 >> v2:172.21.15.80:3300/0 conn(0x7fe898072360 0x7fe8980727e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe89000f6b0 tx=0x7fe890007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.567+0000 7fe89759e700 1 --2- 172.21.15.80:0/4164001754 >> v2:172.21.15.80:3300/0 conn(0x7fe898072360 0x7fe8980727e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe89000f6b0 tx=0x7fe890007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.567+0000 7fe89759e700 1 --2- 172.21.15.80:0/4164001754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe898072360 0x7fe8980727e0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fe89000f6b0 tx=0x7fe890007d50).ready entity=mon.0 client_cookie=59ee0be3cee67ec0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:03.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.567+0000 7fe89759e700 1 --2- 172.21.15.80:0/4164001754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe898072360 0x7fe8980727e0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe89000f6b0 tx=0x7fe890007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.567+0000 7fe895d9b700 1 -- 172.21.15.80:0/4164001754 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe890000a70 con 0x7fe898072360 2019-11-28T11:25:03.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.567+0000 7fe89759e700 1 --2- 172.21.15.80:0/4164001754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe898072360 0x7fe8980727e0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe89000f6b0 tx=0x7fe890007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.567+0000 7fe89759e700 1 --2- 172.21.15.80:0/4164001754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe898072360 0x7fe8980727e0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe89000f6b0 tx=0x7fe890007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.567+0000 7fe895d9b700 1 -- 172.21.15.80:0/4164001754 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8900010e0 con 0x7fe898072360 2019-11-28T11:25:03.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.567+0000 7fe895d9b700 1 -- 172.21.15.80:0/4164001754 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe890001830 con 0x7fe898072360 2019-11-28T11:25:03.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.567+0000 7fe89cbc0700 1 -- 172.21.15.80:0/4164001754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe898072360 msgr2=0x7fe8980727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:03.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.567+0000 7fe89cbc0700 1 --2- 172.21.15.80:0/4164001754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe898072360 0x7fe8980727e0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fe89000f6b0 tx=0x7fe890007d50).stop 2019-11-28T11:25:03.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.568+0000 7fe89cbc0700 1 -- 172.21.15.80:0/4164001754 shutdown_connections 2019-11-28T11:25:03.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.568+0000 7fe89cbc0700 1 --2- 172.21.15.80:0/4164001754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe898072360 0x7fe8980727e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:03.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.568+0000 7fe89cbc0700 1 --2- 172.21.15.80:0/4164001754 >> v2:172.21.15.174:3300/0 conn(0x7fe8980734e0 0x7fe898071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:03.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.568+0000 7fe89cbc0700 1 --2- 172.21.15.80:0/4164001754 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe89806c0a0 0x7fe898072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:03.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.568+0000 7fe89cbc0700 1 -- 172.21.15.80:0/4164001754 shutdown_connections 2019-11-28T11:25:03.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.568+0000 7fe89cbc0700 1 -- 172.21.15.80:0/4164001754 wait complete. 2019-11-28T11:25:03.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.568+0000 7fe89cbc0700 1 -- 172.21.15.80:0/4164001754 >> 172.21.15.80:0/4164001754 conn(0x7fe898061cf0 msgr2=0x7fe898064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:03.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.570+0000 7fe89cbc0700 1 Processor -- start 2019-11-28T11:25:03.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.570+0000 7fe89cbc0700 1 -- start start 2019-11-28T11:25:03.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.571+0000 7fe89cbc0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe89813e8e0 0x7fe89814fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:03.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.571+0000 7fe89cbc0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8981500d0 0x7fe898105fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:03.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.571+0000 7fe89cbc0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89813bd00 con 0x7fe8981064e0 2019-11-28T11:25:03.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.571+0000 7fe89cbc0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89810df40 con 0x7fe89813e8e0 2019-11-28T11:25:03.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.571+0000 7fe89cbc0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe898104240 con 0x7fe8981500d0 2019-11-28T11:25:03.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.571+0000 7fe896d9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe89813e8e0 0x7fe89814fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:03.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.571+0000 7fe89659c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8981500d0 0x7fe898105fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:03.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.571+0000 7fe89759e700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe8981064e0 0x7fe89810e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:45322/0 (socket says 172.21.15.80:45322) 2019-11-28T11:25:03.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.571+0000 7fe89759e700 1 -- 172.21.15.80:0/3618590525 learned_addr learned my addr 172.21.15.80:0/3618590525 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:03.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe89659c700 1 -- 172.21.15.80:0/3618590525 >> v2:172.21.15.174:3300/0 conn(0x7fe89813e8e0 msgr2=0x7fe89814fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:03.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe89659c700 1 --2- 172.21.15.80:0/3618590525 >> v2:172.21.15.174:3300/0 conn(0x7fe89813e8e0 0x7fe89814fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:03.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe89659c700 1 -- 172.21.15.80:0/3618590525 >> v1:172.21.15.174:6789/0 conn(0x7fe8981064e0 legacy=0x7fe89810e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:03.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe89659c700 1 -- 172.21.15.80:0/3618590525 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8981048d0 con 0x7fe8981500d0 2019-11-28T11:25:03.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe88f7fe700 1 -- 172.21.15.80:0/3618590525 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215787286 0 0) 0x7fe890000be0 con 0x7fe8981064e0 2019-11-28T11:25:03.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe896d9d700 1 --2- 172.21.15.80:0/3618590525 >> v2:172.21.15.174:3300/0 conn(0x7fe89813e8e0 0x7fe89814fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:03.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe89659c700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8981500d0 0x7fe898105fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe880010390 tx=0x7fe880010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe89659c700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8981500d0 0x7fe898105fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe880010390 tx=0x7fe880010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe89659c700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8981500d0 0x7fe898105fa0 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7fe880010390 tx=0x7fe880010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:03.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe89659c700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8981500d0 0x7fe898105fa0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fe880010390 tx=0x7fe880010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe88f7fe700 1 -- 172.21.15.80:0/3618590525 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe880000940 con 0x7fe8981500d0 2019-11-28T11:25:03.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe89659c700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8981500d0 0x7fe898105fa0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fe880010390 tx=0x7fe880010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe89659c700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8981500d0 0x7fe898105fa0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fe880010390 tx=0x7fe880010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe88f7fe700 1 -- 172.21.15.80:0/3618590525 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe880009bd0 con 0x7fe8981500d0 2019-11-28T11:25:03.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe89cbc0700 1 -- 172.21.15.80:0/3618590525 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe898104c50 con 0x7fe8981500d0 2019-11-28T11:25:03.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe88f7fe700 1 -- 172.21.15.80:0/3618590525 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe88000a1a0 con 0x7fe8981500d0 2019-11-28T11:25:03.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe89cbc0700 1 -- 172.21.15.80:0/3618590525 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8981048d0 con 0x7fe8981500d0 2019-11-28T11:25:03.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.572+0000 7fe89659c700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8981500d0 0x7fe898105fa0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fe880010390 tx=0x7fe880010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.573+0000 7fe88f7fe700 1 -- 172.21.15.80:0/3618590525 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe880009660 con 0x7fe8981500d0 2019-11-28T11:25:03.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.573+0000 7fe89659c700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8981500d0 0x7fe898105fa0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fe880010390 tx=0x7fe880010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.573+0000 7fe88f7fe700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe87c018730 0x7fe87c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:03.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.573+0000 7fe88f7fe700 1 -- 172.21.15.80:0/3618590525 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7fe880031a10 con 0x7fe8981500d0 2019-11-28T11:25:03.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.573+0000 7fe896d9d700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe87c018730 0x7fe87c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:03.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.573+0000 7fe896d9d700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe87c018730 0x7fe87c01abc0 crc :-1 s=READY pgs=14 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:03.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.580+0000 7fe89cbc0700 1 -- 172.21.15.80:0/3618590525 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe898104c50 con 0x7fe8981500d0 2019-11-28T11:25:03.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.585+0000 7fe89659c700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8981500d0 0x7fe898105fa0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fe880010390 tx=0x7fe880010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.585+0000 7fe88f7fe700 1 -- 172.21.15.80:0/3618590525 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe88002a4f0 con 0x7fe8981500d0 2019-11-28T11:25:03.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.768+0000 7fe89cbc0700 1 -- 172.21.15.80:0/3618590525 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", "id": 7} v 0) v1 -- 0x7fe8981048d0 con 0x7fe8981500d0 2019-11-28T11:25:03.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.776+0000 7fe89659c700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8981500d0 0x7fe898105fa0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fe880010390 tx=0x7fe880010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:03.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.776+0000 7fe88f7fe700 1 -- 172.21.15.80:0/3618590525 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe880009640 con 0x7fe8981500d0 2019-11-28T11:25:03.802 INFO:teuthology.orchestra.run.smithi080.stdout:7 2019-11-28T11:25:03.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.785+0000 7fe89cbc0700 1 -- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe87c018730 msgr2=0x7fe87c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:03.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.785+0000 7fe89cbc0700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe87c018730 0x7fe87c01abc0 crc :-1 s=READY pgs=14 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:03.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.785+0000 7fe89cbc0700 1 -- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8981500d0 msgr2=0x7fe898105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:03.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.785+0000 7fe89cbc0700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8981500d0 0x7fe898105fa0 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7fe880010390 tx=0x7fe880010730).stop 2019-11-28T11:25:03.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.785+0000 7fe89cbc0700 1 -- 172.21.15.80:0/3618590525 shutdown_connections 2019-11-28T11:25:03.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.785+0000 7fe89cbc0700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe87c018730 0x7fe87c01abc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:03.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.785+0000 7fe89cbc0700 1 --2- 172.21.15.80:0/3618590525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8981500d0 0x7fe898105fa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:03.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.785+0000 7fe89cbc0700 1 --2- 172.21.15.80:0/3618590525 >> v2:172.21.15.174:3300/0 conn(0x7fe89813e8e0 0x7fe89814fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:03.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.785+0000 7fe89cbc0700 1 -- 172.21.15.80:0/3618590525 shutdown_connections 2019-11-28T11:25:03.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.785+0000 7fe89cbc0700 1 -- 172.21.15.80:0/3618590525 wait complete. 2019-11-28T11:25:03.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:03.785+0000 7fe89cbc0700 1 -- 172.21.15.80:0/3618590525 >> 172.21.15.80:0/3618590525 conn(0x7fe89813d620 msgr2=0x7fe89813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:03.815 INFO:tasks.ceph.osd.4:Restarting daemon 2019-11-28T11:25:03.816 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2019-11-28T11:25:03.827 INFO:tasks.ceph.osd.4:Started 2019-11-28T11:25:03.828 INFO:tasks.ceph.osd.5:Restarting daemon 2019-11-28T11:25:03.828 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2019-11-28T11:25:03.841 INFO:tasks.ceph.osd.5:Started 2019-11-28T11:25:03.841 INFO:tasks.ceph.osd.6:Restarting daemon 2019-11-28T11:25:03.841 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2019-11-28T11:25:03.857 INFO:tasks.ceph.osd.6:Started 2019-11-28T11:25:03.858 INFO:tasks.ceph.osd.7:Restarting daemon 2019-11-28T11:25:03.858 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2019-11-28T11:25:03.873 INFO:tasks.ceph.osd.7:Started 2019-11-28T11:25:03.874 INFO:tasks.ceph.osd.0:Restarting daemon 2019-11-28T11:25:03.874 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2019-11-28T11:25:03.886 INFO:tasks.ceph.osd.0:Started 2019-11-28T11:25:03.886 INFO:tasks.ceph.osd.1:Restarting daemon 2019-11-28T11:25:03.887 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2019-11-28T11:25:03.893 INFO:tasks.ceph.osd.1:Started 2019-11-28T11:25:03.894 INFO:tasks.ceph.osd.2:Restarting daemon 2019-11-28T11:25:03.894 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2019-11-28T11:25:03.902 INFO:tasks.ceph.osd.2:Started 2019-11-28T11:25:03.902 INFO:tasks.ceph.osd.3:Restarting daemon 2019-11-28T11:25:03.902 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2019-11-28T11:25:03.914 INFO:tasks.ceph.osd.3:Started 2019-11-28T11:25:03.915 INFO:tasks.ceph:Waiting for OSDs to come up 2019-11-28T11:25:04.420 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-28T11:25:04.422+0000 7f532d796bc0 -1 Falling back to public interface 2019-11-28T11:25:04.432 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-28T11:25:04.433+0000 7f2d226a5bc0 -1 Falling back to public interface 2019-11-28T11:25:04.455 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-28T11:25:04.456+0000 7fbcd28c4bc0 -1 Falling back to public interface 2019-11-28T11:25:04.467 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-28T11:25:04.468+0000 7fda02853bc0 -1 Falling back to public interface 2019-11-28T11:25:04.484 INFO:tasks.ceph.osd.0.smithi080.stderr:2019-11-28T11:25:04.461+0000 7fc5a05fbbc0 -1 Falling back to public interface 2019-11-28T11:25:04.493 INFO:tasks.ceph.osd.1.smithi080.stderr:2019-11-28T11:25:04.474+0000 7f7b91558bc0 -1 Falling back to public interface 2019-11-28T11:25:04.512 INFO:tasks.ceph.osd.2.smithi080.stderr:2019-11-28T11:25:04.482+0000 7f2c08affbc0 -1 Falling back to public interface 2019-11-28T11:25:04.512 INFO:tasks.ceph.osd.3.smithi080.stderr:2019-11-28T11:25:04.491+0000 7fdd84989bc0 -1 Falling back to public interface 2019-11-28T11:25:04.723 INFO:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:04.840 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.816+0000 7f285421d700 1 Processor -- start 2019-11-28T11:25:04.840 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.816+0000 7f285421d700 1 -- start start 2019-11-28T11:25:04.840 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.817+0000 7f285421d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f284c06c490 0x7f284c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:04.840 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.817+0000 7f285421d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284c06ce60 0x7f284c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:04.841 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.817+0000 7f285421d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c06db00 con 0x7f284c06c0a0 2019-11-28T11:25:04.841 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.817+0000 7f285421d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c06fd60 con 0x7f284c06c490 2019-11-28T11:25:04.841 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.817+0000 7f285421d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c070030 con 0x7f284c06ce60 2019-11-28T11:25:04.841 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.817+0000 7f28527ba700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f284c06c0a0 0x7f284c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58038/0 (socket says 172.21.15.80:58038) 2019-11-28T11:25:04.842 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.817+0000 7f28527ba700 1 -- 172.21.15.80:0/1226784434 learned_addr learned my addr 172.21.15.80:0/1226784434 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:04.842 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f2852fbb700 1 --2- 172.21.15.80:0/1226784434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284c06ce60 0x7f284c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:04.842 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f2851fb9700 1 --2- 172.21.15.80:0/1226784434 >> v2:172.21.15.174:3300/0 conn(0x7f284c06c490 0x7f284c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:04.842 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f28517b8700 1 -- 172.21.15.80:0/1226784434 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837325987 0 0) 0x7f2840001170 con 0x7f284c06c0a0 2019-11-28T11:25:04.844 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f28517b8700 1 -- 172.21.15.80:0/1226784434 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2838002e80 con 0x7f284c06c0a0 2019-11-28T11:25:04.844 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f2852fbb700 1 -- 172.21.15.80:0/1226784434 >> v2:172.21.15.174:3300/0 conn(0x7f284c06c490 msgr2=0x7f284c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:04.844 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f2852fbb700 1 --2- 172.21.15.80:0/1226784434 >> v2:172.21.15.174:3300/0 conn(0x7f284c06c490 0x7f284c06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:04.844 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f2852fbb700 1 -- 172.21.15.80:0/1226784434 >> v1:172.21.15.80:6789/0 conn(0x7f284c06c0a0 legacy=0x7f284c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:04.851 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f2852fbb700 1 -- 172.21.15.80:0/1226784434 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c0706c0 con 0x7f284c06ce60 2019-11-28T11:25:04.851 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f2852fbb700 1 --2- 172.21.15.80:0/1226784434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284c06ce60 0x7f284c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f284400b300 tx=0x7f284400b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:04.852 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f2852fbb700 1 --2- 172.21.15.80:0/1226784434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284c06ce60 0x7f284c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f284400b300 tx=0x7f284400b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:04.852 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f2852fbb700 1 --2- 172.21.15.80:0/1226784434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284c06ce60 0x7f284c164d70 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f284400b300 tx=0x7f284400b600).ready entity=mon.2 client_cookie=172b7af8f27f5065 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:04.854 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f2852fbb700 1 --2- 172.21.15.80:0/1226784434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284c06ce60 0x7f284c164d70 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f284400b300 tx=0x7f284400b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:04.854 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f28517b8700 1 -- 172.21.15.80:0/1226784434 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28440075c0 con 0x7f284c06ce60 2019-11-28T11:25:04.854 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f2852fbb700 1 --2- 172.21.15.80:0/1226784434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284c06ce60 0x7f284c164d70 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f284400b300 tx=0x7f284400b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:04.854 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f2852fbb700 1 --2- 172.21.15.80:0/1226784434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284c06ce60 0x7f284c164d70 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f284400b300 tx=0x7f284400b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:04.854 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f28517b8700 1 -- 172.21.15.80:0/1226784434 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2844000e90 con 0x7f284c06ce60 2019-11-28T11:25:04.855 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f28517b8700 1 -- 172.21.15.80:0/1226784434 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f284400a220 con 0x7f284c06ce60 2019-11-28T11:25:04.855 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f285421d700 1 -- 172.21.15.80:0/1226784434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284c06ce60 msgr2=0x7f284c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:04.855 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.818+0000 7f285421d700 1 --2- 172.21.15.80:0/1226784434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284c06ce60 0x7f284c164d70 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f284400b300 tx=0x7f284400b600).stop 2019-11-28T11:25:04.855 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.819+0000 7f285421d700 1 -- 172.21.15.80:0/1226784434 shutdown_connections 2019-11-28T11:25:04.855 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.819+0000 7f285421d700 1 --2- 172.21.15.80:0/1226784434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284c06ce60 0x7f284c164d70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:04.856 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.819+0000 7f285421d700 1 --2- 172.21.15.80:0/1226784434 >> v2:172.21.15.174:3300/0 conn(0x7f284c06c490 0x7f284c06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:04.856 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.819+0000 7f285421d700 1 -- 172.21.15.80:0/1226784434 shutdown_connections 2019-11-28T11:25:04.856 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.819+0000 7f285421d700 1 -- 172.21.15.80:0/1226784434 wait complete. 2019-11-28T11:25:04.856 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.819+0000 7f285421d700 1 -- 172.21.15.80:0/1226784434 >> 172.21.15.80:0/1226784434 conn(0x7f284c061cf0 msgr2=0x7f284c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:04.861 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.822+0000 7f285421d700 1 Processor -- start 2019-11-28T11:25:04.861 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.822+0000 7f285421d700 1 -- start start 2019-11-28T11:25:04.861 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f285421d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f284c13eb40 0x7f284c10afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:04.861 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f285421d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f284c10b500 0x7f284c1629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:04.865 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f285421d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c13f1e0 con 0x7f284c162f30 2019-11-28T11:25:04.865 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f285421d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c1234c0 con 0x7f284c13eb40 2019-11-28T11:25:04.865 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f285421d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c13e0d0 con 0x7f284c10b500 2019-11-28T11:25:04.865 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f28527ba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f284c13eb40 0x7f284c10afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:04.865 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f28527ba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f284c13eb40 0x7f284c10afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58728/0 (socket says 172.21.15.80:58728) 2019-11-28T11:25:04.866 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f28527ba700 1 -- 172.21.15.80:0/11190176 learned_addr learned my addr 172.21.15.80:0/11190176 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:04.866 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f2851fb9700 1 --2- 172.21.15.80:0/11190176 >> v2:172.21.15.174:3300/0 conn(0x7f284c10b500 0x7f284c1629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:04.866 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f28527ba700 1 -- 172.21.15.80:0/11190176 >> v2:172.21.15.174:3300/0 conn(0x7f284c10b500 msgr2=0x7f284c1629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:04.866 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f28527ba700 1 --2- 172.21.15.80:0/11190176 >> v2:172.21.15.174:3300/0 conn(0x7f284c10b500 0x7f284c1629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:04.867 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f28527ba700 1 -- 172.21.15.80:0/11190176 >> v1:172.21.15.80:6789/0 conn(0x7f284c162f30 legacy=0x7f284c109e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:04.867 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f28527ba700 1 -- 172.21.15.80:0/11190176 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c108700 con 0x7f284c13eb40 2019-11-28T11:25:04.867 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f28527ba700 1 --2- 172.21.15.80:0/11190176 >> v2:172.21.15.80:3300/0 conn(0x7f284c13eb40 0x7f284c10afc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28400103e0 tx=0x7f2840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:04.867 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f28527ba700 1 --2- 172.21.15.80:0/11190176 >> v2:172.21.15.80:3300/0 conn(0x7f284c13eb40 0x7f284c10afc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28400103e0 tx=0x7f2840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:04.868 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f28527ba700 1 --2- 172.21.15.80:0/11190176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f284c13eb40 0x7f284c10afc0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f28400103e0 tx=0x7f2840010780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:04.868 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f28527ba700 1 --2- 172.21.15.80:0/11190176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f284c13eb40 0x7f284c10afc0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f28400103e0 tx=0x7f2840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:04.868 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f28527ba700 1 --2- 172.21.15.80:0/11190176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f284c13eb40 0x7f284c10afc0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f28400103e0 tx=0x7f2840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:04.868 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f28527ba700 1 --2- 172.21.15.80:0/11190176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f284c13eb40 0x7f284c10afc0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f28400103e0 tx=0x7f2840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:04.869 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f283effd700 1 -- 172.21.15.80:0/11190176 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2840000c90 con 0x7f284c13eb40 2019-11-28T11:25:04.869 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f283effd700 1 -- 172.21.15.80:0/11190176 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2840001140 con 0x7f284c13eb40 2019-11-28T11:25:04.869 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.823+0000 7f283effd700 1 -- 172.21.15.80:0/11190176 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28400017d0 con 0x7f284c13eb40 2019-11-28T11:25:04.869 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.824+0000 7f285421d700 1 -- 172.21.15.80:0/11190176 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284c108a80 con 0x7f284c13eb40 2019-11-28T11:25:04.870 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.824+0000 7f285421d700 1 -- 172.21.15.80:0/11190176 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c108700 con 0x7f284c13eb40 2019-11-28T11:25:04.870 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.824+0000 7f28527ba700 1 --2- 172.21.15.80:0/11190176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f284c13eb40 0x7f284c10afc0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f28400103e0 tx=0x7f2840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:04.870 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.824+0000 7f283effd700 1 -- 172.21.15.80:0/11190176 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2840000c90 con 0x7f284c13eb40 2019-11-28T11:25:04.870 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.824+0000 7f28527ba700 1 --2- 172.21.15.80:0/11190176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f284c13eb40 0x7f284c10afc0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f28400103e0 tx=0x7f2840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:04.870 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.824+0000 7f283effd700 1 --2- 172.21.15.80:0/11190176 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2834018730 0x7f283401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:04.871 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.825+0000 7f283effd700 1 -- 172.21.15.80:0/11190176 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f2840031a40 con 0x7f284c13eb40 2019-11-28T11:25:04.871 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.825+0000 7f2851fb9700 1 --2- 172.21.15.80:0/11190176 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2834018730 0x7f283401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:04.871 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.825+0000 7f2851fb9700 1 --2- 172.21.15.80:0/11190176 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2834018730 0x7f283401abc0 crc :-1 s=READY pgs=15 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:04.871 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.831+0000 7f285421d700 1 -- 172.21.15.80:0/11190176 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c108a80 con 0x7f284c13eb40 2019-11-28T11:25:04.871 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.838+0000 7f28527ba700 1 --2- 172.21.15.80:0/11190176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f284c13eb40 0x7f284c10afc0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f28400103e0 tx=0x7f2840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:04.872 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:04.838+0000 7f283effd700 1 -- 172.21.15.80:0/11190176 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f28400075d0 con 0x7f284c13eb40 2019-11-28T11:25:05.031 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:05.011+0000 7f285421d700 1 -- 172.21.15.80:0/11190176 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f284c108700 con 0x7f284c13eb40 2019-11-28T11:25:05.031 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:05.011+0000 7f28527ba700 1 --2- 172.21.15.80:0/11190176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f284c13eb40 0x7f284c10afc0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f28400103e0 tx=0x7f2840010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:05.032 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:05.011+0000 7f283effd700 1 -- 172.21.15.80:0/11190176 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6849 (secure 0 0 0) 0x7f2840000c90 con 0x7f284c13eb40 2019-11-28T11:25:05.032 INFO:teuthology.misc.health.smithi080.stdout: 2019-11-28T11:25:05.038 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":10,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:03.770218+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:05.051 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:05.014+0000 7f285421d700 1 -- 172.21.15.80:0/11190176 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2834018730 msgr2=0x7f283401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:05.051 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:05.014+0000 7f285421d700 1 --2- 172.21.15.80:0/11190176 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2834018730 0x7f283401abc0 crc :-1 s=READY pgs=15 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:05.052 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:05.014+0000 7f285421d700 1 -- 172.21.15.80:0/11190176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f284c13eb40 msgr2=0x7f284c10afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:05.052 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:05.014+0000 7f285421d700 1 --2- 172.21.15.80:0/11190176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f284c13eb40 0x7f284c10afc0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f28400103e0 tx=0x7f2840010780).stop 2019-11-28T11:25:05.052 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:05.014+0000 7f285421d700 1 -- 172.21.15.80:0/11190176 shutdown_connections 2019-11-28T11:25:05.052 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:05.014+0000 7f285421d700 1 --2- 172.21.15.80:0/11190176 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2834018730 0x7f283401abc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:05.053 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:05.014+0000 7f285421d700 1 --2- 172.21.15.80:0/11190176 >> v2:172.21.15.174:3300/0 conn(0x7f284c10b500 0x7f284c1629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:05.053 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:05.014+0000 7f285421d700 1 --2- 172.21.15.80:0/11190176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f284c13eb40 0x7f284c10afc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:05.053 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:05.014+0000 7f285421d700 1 -- 172.21.15.80:0/11190176 shutdown_connections 2019-11-28T11:25:05.054 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:05.014+0000 7f285421d700 1 -- 172.21.15.80:0/11190176 wait complete. 2019-11-28T11:25:05.054 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:05.014+0000 7f285421d700 1 -- 172.21.15.80:0/11190176 >> 172.21.15.80:0/11190176 conn(0x7f284c11bfc0 msgr2=0x7f284c141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:05.056 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-11-28T11:25:05.457 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-28T11:25:05.455+0000 7f532d796bc0 -1 osd.4 0 log_to_monitors {default=true} 2019-11-28T11:25:05.478 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-28T11:25:05.479+0000 7f2d226a5bc0 -1 osd.5 0 log_to_monitors {default=true} 2019-11-28T11:25:05.496 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-28T11:25:05.498+0000 7fbcd28c4bc0 -1 osd.6 0 log_to_monitors {default=true} 2019-11-28T11:25:05.508 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-28T11:25:05.510+0000 7fda02853bc0 -1 osd.7 0 log_to_monitors {default=true} 2019-11-28T11:25:05.522 INFO:tasks.ceph.osd.0.smithi080.stderr:2019-11-28T11:25:05.499+0000 7fc5a05fbbc0 -1 osd.0 0 log_to_monitors {default=true} 2019-11-28T11:25:05.539 INFO:tasks.ceph.osd.1.smithi080.stderr:2019-11-28T11:25:05.520+0000 7f7b91558bc0 -1 osd.1 0 log_to_monitors {default=true} 2019-11-28T11:25:05.546 INFO:tasks.ceph.osd.2.smithi080.stderr:2019-11-28T11:25:05.527+0000 7f2c08affbc0 -1 osd.2 0 log_to_monitors {default=true} 2019-11-28T11:25:05.554 INFO:tasks.ceph.osd.3.smithi080.stderr:2019-11-28T11:25:05.535+0000 7fdd84989bc0 -1 osd.3 0 log_to_monitors {default=true} 2019-11-28T11:25:06.570 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-28T11:25:06.566+0000 7fbcbaecc700 -1 osd.6 0 waiting for initial osdmap 2019-11-28T11:25:06.571 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-28T11:25:06.566+0000 7f5315d9e700 -1 osd.4 0 waiting for initial osdmap 2019-11-28T11:25:06.572 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-28T11:25:06.567+0000 7fd9eae5b700 -1 osd.7 0 waiting for initial osdmap 2019-11-28T11:25:06.572 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-28T11:25:06.566+0000 7f2d0acad700 -1 osd.5 0 waiting for initial osdmap 2019-11-28T11:25:06.572 INFO:tasks.ceph.osd.1.smithi080.stderr:2019-11-28T11:25:06.542+0000 7f7b79b60700 -1 osd.1 0 waiting for initial osdmap 2019-11-28T11:25:06.573 INFO:tasks.ceph.osd.0.smithi080.stderr:2019-11-28T11:25:06.542+0000 7fc588c03700 -1 osd.0 0 waiting for initial osdmap 2019-11-28T11:25:06.573 INFO:tasks.ceph.osd.2.smithi080.stderr:2019-11-28T11:25:06.546+0000 7f2bf1107700 -1 osd.2 0 waiting for initial osdmap 2019-11-28T11:25:07.562 INFO:tasks.ceph.osd.3.smithi080.stderr:2019-11-28T11:25:07.544+0000 7fdd6cf91700 -1 osd.3 0 waiting for initial osdmap 2019-11-28T11:25:11.862 INFO:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:11.984 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.960+0000 7f78585d3700 1 Processor -- start 2019-11-28T11:25:11.984 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.960+0000 7f78585d3700 1 -- start start 2019-11-28T11:25:11.985 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.961+0000 7f78585d3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f785006c0a0 0x7f7850072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:11.985 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.961+0000 7f78585d3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7850072620 0x7f7850164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:11.985 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.961+0000 7f78585d3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785006db00 con 0x7f78500734e0 2019-11-28T11:25:11.985 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.961+0000 7f78585d3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f785006fd60 con 0x7f785006c0a0 2019-11-28T11:25:11.985 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.961+0000 7f78585d3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7850070030 con 0x7f7850072620 2019-11-28T11:25:11.986 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7856b70700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f785006c0a0 0x7f7850072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:11.986 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7856b70700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f785006c0a0 0x7f7850072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58886/0 (socket says 172.21.15.80:58886) 2019-11-28T11:25:11.986 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7856b70700 1 -- 172.21.15.80:0/918833716 learned_addr learned my addr 172.21.15.80:0/918833716 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:11.986 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7857371700 1 --2- 172.21.15.80:0/918833716 >> v2:172.21.15.174:3300/0 conn(0x7f7850072620 0x7f7850164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:11.986 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7856b70700 1 -- 172.21.15.80:0/918833716 >> v2:172.21.15.174:3300/0 conn(0x7f7850072620 msgr2=0x7f7850164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:11.987 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7856b70700 1 --2- 172.21.15.80:0/918833716 >> v2:172.21.15.174:3300/0 conn(0x7f7850072620 0x7f7850164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:11.987 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7856b70700 1 -- 172.21.15.80:0/918833716 >> v1:172.21.15.174:6789/0 conn(0x7f78500734e0 legacy=0x7f7850071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:11.987 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7856b70700 1 -- 172.21.15.80:0/918833716 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78500706c0 con 0x7f785006c0a0 2019-11-28T11:25:11.987 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7856b70700 1 --2- 172.21.15.80:0/918833716 >> v2:172.21.15.80:3300/0 conn(0x7f785006c0a0 0x7f7850072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f784400f6c0 tx=0x7f784400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:11.987 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7856b70700 1 --2- 172.21.15.80:0/918833716 >> v2:172.21.15.80:3300/0 conn(0x7f785006c0a0 0x7f7850072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f784400f6c0 tx=0x7f784400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:11.987 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7856b70700 1 --2- 172.21.15.80:0/918833716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785006c0a0 0x7f7850072fa0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f784400f6c0 tx=0x7f784400fa60).ready entity=mon.0 client_cookie=d4fe363f2741562d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:11.988 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7856b70700 1 --2- 172.21.15.80:0/918833716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785006c0a0 0x7f7850072fa0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f784400f6c0 tx=0x7f784400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:11.988 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7856b70700 1 --2- 172.21.15.80:0/918833716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785006c0a0 0x7f7850072fa0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f784400f6c0 tx=0x7f784400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:11.988 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7855b6e700 1 -- 172.21.15.80:0/918833716 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7844000960 con 0x7f785006c0a0 2019-11-28T11:25:11.988 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7856b70700 1 --2- 172.21.15.80:0/918833716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785006c0a0 0x7f7850072fa0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f784400f6c0 tx=0x7f784400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:11.988 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7855b6e700 1 -- 172.21.15.80:0/918833716 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7844000c90 con 0x7f785006c0a0 2019-11-28T11:25:11.988 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.962+0000 7f7855b6e700 1 -- 172.21.15.80:0/918833716 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78440013a0 con 0x7f785006c0a0 2019-11-28T11:25:11.989 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.963+0000 7f78585d3700 1 -- 172.21.15.80:0/918833716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785006c0a0 msgr2=0x7f7850072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:11.989 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.963+0000 7f78585d3700 1 --2- 172.21.15.80:0/918833716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785006c0a0 0x7f7850072fa0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f784400f6c0 tx=0x7f784400fa60).stop 2019-11-28T11:25:11.989 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.963+0000 7f78585d3700 1 -- 172.21.15.80:0/918833716 shutdown_connections 2019-11-28T11:25:11.989 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.963+0000 7f78585d3700 1 --2- 172.21.15.80:0/918833716 >> v2:172.21.15.174:3300/0 conn(0x7f7850072620 0x7f7850164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:11.989 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.963+0000 7f78585d3700 1 --2- 172.21.15.80:0/918833716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f785006c0a0 0x7f7850072fa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:11.989 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.963+0000 7f78585d3700 1 -- 172.21.15.80:0/918833716 shutdown_connections 2019-11-28T11:25:11.990 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.963+0000 7f78585d3700 1 -- 172.21.15.80:0/918833716 wait complete. 2019-11-28T11:25:11.990 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.963+0000 7f78585d3700 1 -- 172.21.15.80:0/918833716 >> 172.21.15.80:0/918833716 conn(0x7f7850061cf0 msgr2=0x7f7850064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:11.994 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.966+0000 7f78585d3700 1 Processor -- start 2019-11-28T11:25:11.994 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.966+0000 7f78585d3700 1 -- start start 2019-11-28T11:25:11.994 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f78585d3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f785013e8e0 0x7f785007b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:11.995 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f78585d3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f785007ba00 0x7f78501293f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:11.995 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f78585d3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785013f190 con 0x7f7850129930 2019-11-28T11:25:11.995 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f78585d3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7850142320 con 0x7f785007ba00 2019-11-28T11:25:11.995 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f78585d3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7850078c00 con 0x7f785013e8e0 2019-11-28T11:25:11.995 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f7857371700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7850129930 0x7f7850111010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58212/0 (socket says 172.21.15.80:58212) 2019-11-28T11:25:11.996 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f7857371700 1 -- 172.21.15.80:0/1096567469 learned_addr learned my addr 172.21.15.80:0/1096567469 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:11.996 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f7856b70700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f785013e8e0 0x7f785007b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:11.996 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f785636f700 1 --2- 172.21.15.80:0/1096567469 >> v2:172.21.15.174:3300/0 conn(0x7f785007ba00 0x7f78501293f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:11.996 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f784f7fe700 1 -- 172.21.15.80:0/1096567469 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970878731 0 0) 0x7f7848005c50 con 0x7f7850129930 2019-11-28T11:25:12.006 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f784f7fe700 1 -- 172.21.15.80:0/1096567469 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7830002e80 con 0x7f7850129930 2019-11-28T11:25:12.006 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f7856b70700 1 -- 172.21.15.80:0/1096567469 >> v2:172.21.15.174:3300/0 conn(0x7f785007ba00 msgr2=0x7f78501293f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:12.006 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f7856b70700 1 --2- 172.21.15.80:0/1096567469 >> v2:172.21.15.174:3300/0 conn(0x7f785007ba00 0x7f78501293f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:12.006 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f7856b70700 1 -- 172.21.15.80:0/1096567469 >> v1:172.21.15.80:6789/0 conn(0x7f7850129930 legacy=0x7f7850111010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:12.006 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f7856b70700 1 -- 172.21.15.80:0/1096567469 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7850078f80 con 0x7f785013e8e0 2019-11-28T11:25:12.006 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f7856b70700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f785013e8e0 0x7f785007b4c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78440103a0 tx=0x7f78440101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.007 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f7856b70700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f785013e8e0 0x7f785007b4c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78440103a0 tx=0x7f78440101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.007 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.967+0000 7f7856b70700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f785013e8e0 0x7f785007b4c0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f78440103a0 tx=0x7f78440101d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:12.007 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.968+0000 7f7856b70700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f785013e8e0 0x7f785007b4c0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f78440103a0 tx=0x7f78440101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.007 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.968+0000 7f784f7fe700 1 -- 172.21.15.80:0/1096567469 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7844005560 con 0x7f785013e8e0 2019-11-28T11:25:12.007 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.968+0000 7f7856b70700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f785013e8e0 0x7f785007b4c0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f78440103a0 tx=0x7f78440101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.007 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.968+0000 7f784f7fe700 1 -- 172.21.15.80:0/1096567469 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7844005180 con 0x7f785013e8e0 2019-11-28T11:25:12.008 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.968+0000 7f78585d3700 1 -- 172.21.15.80:0/1096567469 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7850078f80 con 0x7f785013e8e0 2019-11-28T11:25:12.008 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.968+0000 7f7856b70700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f785013e8e0 0x7f785007b4c0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f78440103a0 tx=0x7f78440101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.008 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.968+0000 7f784f7fe700 1 -- 172.21.15.80:0/1096567469 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7844005370 con 0x7f785013e8e0 2019-11-28T11:25:12.008 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.968+0000 7f78585d3700 1 -- 172.21.15.80:0/1096567469 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7850078f80 con 0x7f785013e8e0 2019-11-28T11:25:12.009 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.968+0000 7f7856b70700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f785013e8e0 0x7f785007b4c0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f78440103a0 tx=0x7f78440101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.009 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.968+0000 7f784f7fe700 1 -- 172.21.15.80:0/1096567469 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7844005370 con 0x7f785013e8e0 2019-11-28T11:25:12.009 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.968+0000 7f7856b70700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f785013e8e0 0x7f785007b4c0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f78440103a0 tx=0x7f78440101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.009 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.968+0000 7f784f7fe700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7830018770 0x7f783001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:12.009 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.968+0000 7f784f7fe700 1 -- 172.21.15.80:0/1096567469 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4500+0+0 (secure 0 0 0) 0x7f7844031990 con 0x7f785013e8e0 2019-11-28T11:25:12.010 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.969+0000 7f785636f700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7830018770 0x7f783001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:12.010 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.969+0000 7f785636f700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7830018770 0x7f783001abe0 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:12.011 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.976+0000 7f78585d3700 1 -- 172.21.15.80:0/1096567469 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7850078f80 con 0x7f785013e8e0 2019-11-28T11:25:12.011 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.980+0000 7f7856b70700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f785013e8e0 0x7f785007b4c0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f78440103a0 tx=0x7f78440101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.011 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:11.980+0000 7f784f7fe700 1 -- 172.21.15.80:0/1096567469 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7844007310 con 0x7f785013e8e0 2019-11-28T11:25:12.175 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:12.156+0000 7f78585d3700 1 -- 172.21.15.80:0/1096567469 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7850078c00 con 0x7f785013e8e0 2019-11-28T11:25:12.176 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:12.157+0000 7f7856b70700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f785013e8e0 0x7f785007b4c0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f78440103a0 tx=0x7f78440101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.176 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:12.157+0000 7f784f7fe700 1 -- 172.21.15.80:0/1096567469 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10391 (secure 0 0 0) 0x7f7844005370 con 0x7f785013e8e0 2019-11-28T11:25:12.178 INFO:teuthology.misc.health.smithi080.stdout: 2019-11-28T11:25:12.178 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":15,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:09.553429+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:12.181 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:12.161+0000 7f78585d3700 1 -- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7830018770 msgr2=0x7f783001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:12.181 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:12.161+0000 7f78585d3700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7830018770 0x7f783001abe0 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:12.181 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:12.161+0000 7f78585d3700 1 -- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f785013e8e0 msgr2=0x7f785007b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:12.181 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:12.161+0000 7f78585d3700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f785013e8e0 0x7f785007b4c0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f78440103a0 tx=0x7f78440101d0).stop 2019-11-28T11:25:12.181 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:12.161+0000 7f78585d3700 1 -- 172.21.15.80:0/1096567469 shutdown_connections 2019-11-28T11:25:12.181 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:12.161+0000 7f78585d3700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7830018770 0x7f783001abe0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:12.182 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:12.161+0000 7f78585d3700 1 --2- 172.21.15.80:0/1096567469 >> v2:172.21.15.174:3300/0 conn(0x7f785007ba00 0x7f78501293f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:12.182 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:12.161+0000 7f78585d3700 1 --2- 172.21.15.80:0/1096567469 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f785013e8e0 0x7f785007b4c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:12.182 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:12.161+0000 7f78585d3700 1 -- 172.21.15.80:0/1096567469 shutdown_connections 2019-11-28T11:25:12.182 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:12.161+0000 7f78585d3700 1 -- 172.21.15.80:0/1096567469 wait complete. 2019-11-28T11:25:12.182 INFO:teuthology.misc.health.smithi080.stderr:2019-11-28T11:25:12.161+0000 7f78585d3700 1 -- 172.21.15.80:0/1096567469 >> 172.21.15.80:0/1096567469 conn(0x7f785013b860 msgr2=0x7f78501050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:12.189 DEBUG:teuthology.misc:8 of 8 OSDs are up 2019-11-28T11:25:12.190 INFO:tasks.ceph:Creating RBD pool 2019-11-28T11:25:12.190 INFO:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd pool create rbd 8 2019-11-28T11:25:12.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.289+0000 7f0d62d64700 1 Processor -- start 2019-11-28T11:25:12.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.289+0000 7f0d62d64700 1 -- start start 2019-11-28T11:25:12.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.290+0000 7f0d62d64700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0d5c15f100 0x7f0d5c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:12.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.290+0000 7f0d62d64700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5c06db60 con 0x7f0d5c15ed10 2019-11-28T11:25:12.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.290+0000 7f0d62d64700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5c06e060 con 0x7f0d5c06c2f0 2019-11-28T11:25:12.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.290+0000 7f0d62d64700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5c06fe00 con 0x7f0d5c15f100 2019-11-28T11:25:12.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.290+0000 7f0d61301700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0d5c15ed10 0x7f0d5c073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58216/0 (socket says 172.21.15.80:58216) 2019-11-28T11:25:12.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d61301700 1 -- 172.21.15.80:0/2211640688 learned_addr learned my addr 172.21.15.80:0/2211640688 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:12.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d60b00700 1 --2- 172.21.15.80:0/2211640688 >> v2:172.21.15.174:3300/0 conn(0x7f0d5c15f100 0x7f0d5c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:12.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d5bfff700 1 -- 172.21.15.80:0/2211640688 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594973180 0 0) 0x7f0d4c001150 con 0x7f0d5c15ed10 2019-11-28T11:25:12.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d5bfff700 1 -- 172.21.15.80:0/2211640688 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d44002e80 con 0x7f0d5c15ed10 2019-11-28T11:25:12.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d5bfff700 1 -- 172.21.15.80:0/2211640688 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3507390352 0 0) 0x7f0d4c001130 con 0x7f0d5c15ed10 2019-11-28T11:25:12.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d5bfff700 1 -- 172.21.15.80:0/2211640688 >> v2:172.21.15.174:3300/0 conn(0x7f0d5c15f100 msgr2=0x7f0d5c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:12.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d5bfff700 1 --2- 172.21.15.80:0/2211640688 >> v2:172.21.15.174:3300/0 conn(0x7f0d5c15f100 0x7f0d5c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:12.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d5bfff700 1 -- 172.21.15.80:0/2211640688 >> v1:172.21.15.174:6789/0 conn(0x7f0d5c06c2f0 legacy=0x7f0d5c06c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:12.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d5bfff700 1 -- 172.21.15.80:0/2211640688 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c070760 con 0x7f0d5c15ed10 2019-11-28T11:25:12.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d5bfff700 1 -- 172.21.15.80:0/2211640688 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f0d4c001660 con 0x7f0d5c15ed10 2019-11-28T11:25:12.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d5bfff700 1 -- 172.21.15.80:0/2211640688 >> v1:172.21.15.80:6789/0 conn(0x7f0d5c15ed10 legacy=0x7f0d5c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:12.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d5bfff700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d44003b20 0x7f0d44005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:12.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d5bfff700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d44006730 0x7f0d44008be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:12.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d5bfff700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d44009440 0x7f0d4400b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:12.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d5bfff700 1 -- 172.21.15.80:0/2211640688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4400c0c0 con 0x7f0d44009440 2019-11-28T11:25:12.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d5bfff700 1 -- 172.21.15.80:0/2211640688 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440502c0 con 0x7f0d44006730 2019-11-28T11:25:12.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d5bfff700 1 -- 172.21.15.80:0/2211640688 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440504f0 con 0x7f0d44003b20 2019-11-28T11:25:12.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d60b00700 1 --2- 172.21.15.80:0/2211640688 >> v2:172.21.15.174:3300/0 conn(0x7f0d5c15f100 0x7f0d5c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:12.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d61b02700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d44009440 0x7f0d4400b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:12.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d61301700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d44003b20 0x7f0d44005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:12.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d60b00700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d44006730 0x7f0d44008be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:12.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d61b02700 1 -- 172.21.15.80:0/2211640688 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d44003b20 msgr2=0x7f0d44005f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:12.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d61b02700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d44003b20 0x7f0d44005f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:12.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d61b02700 1 -- 172.21.15.80:0/2211640688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d44006730 msgr2=0x7f0d44008be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:12.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.291+0000 7f0d61b02700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d44006730 0x7f0d44008be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:12.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.292+0000 7f0d61b02700 1 -- 172.21.15.80:0/2211640688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d440507a0 con 0x7f0d44009440 2019-11-28T11:25:12.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.292+0000 7f0d60b00700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d44006730 0x7f0d44008be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:25:12.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.292+0000 7f0d61b02700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d44009440 0x7f0d4400b910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0d5400b2e0 tx=0x7f0d5400ba70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.292+0000 7f0d61b02700 1 -- 172.21.15.80:0/2211640688 reap_dead start 2019-11-28T11:25:12.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.292+0000 7f0d61b02700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d44009440 0x7f0d4400b910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0d5400b2e0 tx=0x7f0d5400ba70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.292+0000 7f0d61b02700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d44009440 0x7f0d4400b910 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f0d5400b2e0 tx=0x7f0d5400ba70).ready entity=mon.0 client_cookie=68cde3eca7279b9c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:12.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.292+0000 7f0d61b02700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d44009440 0x7f0d4400b910 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f0d5400b2e0 tx=0x7f0d5400ba70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.292+0000 7f0d5bfff700 1 -- 172.21.15.80:0/2211640688 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d54000e90 con 0x7f0d44009440 2019-11-28T11:25:12.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.292+0000 7f0d61b02700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d44009440 0x7f0d4400b910 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f0d5400b2e0 tx=0x7f0d5400ba70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.292+0000 7f0d61b02700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d44009440 0x7f0d4400b910 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f0d5400b2e0 tx=0x7f0d5400ba70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.292+0000 7f0d5bfff700 1 -- 172.21.15.80:0/2211640688 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d54009d10 con 0x7f0d44009440 2019-11-28T11:25:12.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.292+0000 7f0d5bfff700 1 -- 172.21.15.80:0/2211640688 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d54000e70 con 0x7f0d44009440 2019-11-28T11:25:12.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.292+0000 7f0d62d64700 1 -- 172.21.15.80:0/2211640688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d44009440 msgr2=0x7f0d4400b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:12.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.292+0000 7f0d62d64700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d44009440 0x7f0d4400b910 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f0d5400b2e0 tx=0x7f0d5400ba70).stop 2019-11-28T11:25:12.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.292+0000 7f0d62d64700 1 -- 172.21.15.80:0/2211640688 shutdown_connections 2019-11-28T11:25:12.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.292+0000 7f0d62d64700 1 --2- 172.21.15.80:0/2211640688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d44009440 0x7f0d4400b910 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:12.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.293+0000 7f0d62d64700 1 -- 172.21.15.80:0/2211640688 shutdown_connections 2019-11-28T11:25:12.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.293+0000 7f0d62d64700 1 -- 172.21.15.80:0/2211640688 wait complete. 2019-11-28T11:25:12.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.293+0000 7f0d62d64700 1 -- 172.21.15.80:0/2211640688 >> 172.21.15.80:0/2211640688 conn(0x7f0d5c061d20 msgr2=0x7f0d5c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:12.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.295+0000 7f0d62d64700 1 Processor -- start 2019-11-28T11:25:12.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.295+0000 7f0d62d64700 1 -- start start 2019-11-28T11:25:12.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.296+0000 7f0d62d64700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0d5c108630 0x7f0d5c151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:12.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.296+0000 7f0d62d64700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d5c151740 0x7f0d5c1502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:12.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.296+0000 7f0d62d64700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5c133a20 con 0x7f0d5c150820 2019-11-28T11:25:12.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.296+0000 7f0d62d64700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5c131980 con 0x7f0d5c108630 2019-11-28T11:25:12.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.296+0000 7f0d62d64700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c131c50 con 0x7f0d5c151740 2019-11-28T11:25:12.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.296+0000 7f0d61301700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0d5c108630 0x7f0d5c151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:12.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.296+0000 7f0d61301700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0d5c108630 0x7f0d5c151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58912/0 (socket says 172.21.15.80:58912) 2019-11-28T11:25:12.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.296+0000 7f0d61301700 1 -- 172.21.15.80:0/2223435750 learned_addr learned my addr 172.21.15.80:0/2223435750 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:12.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.296+0000 7f0d60b00700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d5c151740 0x7f0d5c1502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:12.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.296+0000 7f0d61301700 1 -- 172.21.15.80:0/2223435750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d5c151740 msgr2=0x7f0d5c1502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:12.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.296+0000 7f0d61301700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d5c151740 0x7f0d5c1502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:12.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.296+0000 7f0d61301700 1 -- 172.21.15.80:0/2223435750 >> v1:172.21.15.174:6789/0 conn(0x7f0d5c150820 legacy=0x7f0d5c12fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:12.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.296+0000 7f0d61301700 1 -- 172.21.15.80:0/2223435750 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c1322e0 con 0x7f0d5c108630 2019-11-28T11:25:12.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.296+0000 7f0d60b00700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d5c151740 0x7f0d5c1502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:12.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.296+0000 7f0d61301700 1 --2- 172.21.15.80:0/2223435750 >> v2:172.21.15.80:3300/0 conn(0x7f0d5c108630 0x7f0d5c151200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0d4c010440 tx=0x7f0d4c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.297+0000 7f0d61301700 1 --2- 172.21.15.80:0/2223435750 >> v2:172.21.15.80:3300/0 conn(0x7f0d5c108630 0x7f0d5c151200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0d4c010440 tx=0x7f0d4c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.297+0000 7f0d61301700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d5c108630 0x7f0d5c151200 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f0d4c010440 tx=0x7f0d4c0107e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:12.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.297+0000 7f0d61301700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d5c108630 0x7f0d5c151200 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f0d4c010440 tx=0x7f0d4c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.297+0000 7f0d61301700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d5c108630 0x7f0d5c151200 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f0d4c010440 tx=0x7f0d4c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.297+0000 7f0d59ffb700 1 -- 172.21.15.80:0/2223435750 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d4c001c40 con 0x7f0d5c108630 2019-11-28T11:25:12.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.297+0000 7f0d61301700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d5c108630 0x7f0d5c151200 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f0d4c010440 tx=0x7f0d4c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.297+0000 7f0d59ffb700 1 -- 172.21.15.80:0/2223435750 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c004430 con 0x7f0d5c108630 2019-11-28T11:25:12.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.297+0000 7f0d62d64700 1 -- 172.21.15.80:0/2223435750 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5c132660 con 0x7f0d5c108630 2019-11-28T11:25:12.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.297+0000 7f0d59ffb700 1 -- 172.21.15.80:0/2223435750 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d4c004ac0 con 0x7f0d5c108630 2019-11-28T11:25:12.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.297+0000 7f0d62d64700 1 -- 172.21.15.80:0/2223435750 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c1322e0 con 0x7f0d5c108630 2019-11-28T11:25:12.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.297+0000 7f0d61301700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d5c108630 0x7f0d5c151200 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f0d4c010440 tx=0x7f0d4c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.297+0000 7f0d59ffb700 1 -- 172.21.15.80:0/2223435750 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0d4c004620 con 0x7f0d5c108630 2019-11-28T11:25:12.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.297+0000 7f0d61301700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d5c108630 0x7f0d5c151200 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f0d4c010440 tx=0x7f0d4c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.297+0000 7f0d59ffb700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d3c018730 0x7f0d3c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:12.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.297+0000 7f0d59ffb700 1 -- 172.21.15.80:0/2223435750 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4500+0+0 (secure 0 0 0) 0x7f0d4c031d40 con 0x7f0d5c108630 2019-11-28T11:25:12.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.298+0000 7f0d60b00700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d3c018730 0x7f0d3c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:12.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.298+0000 7f0d60b00700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d3c018730 0x7f0d3c01abc0 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:12.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.305+0000 7f0d62d64700 1 -- 172.21.15.80:0/2223435750 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5c132660 con 0x7f0d5c108630 2019-11-28T11:25:12.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.308+0000 7f0d61301700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d5c108630 0x7f0d5c151200 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f0d4c010440 tx=0x7f0d4c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.308+0000 7f0d59ffb700 1 -- 172.21.15.80:0/2223435750 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0d4c001060 con 0x7f0d5c108630 2019-11-28T11:25:12.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.476+0000 7f0d62d64700 1 -- 172.21.15.80:0/2223435750 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "rbd"} v 0) v1 -- 0x7f0d5c1322e0 con 0x7f0d5c108630 2019-11-28T11:25:12.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.534+0000 7f0d61301700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d5c108630 0x7f0d5c151200 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f0d4c010440 tx=0x7f0d4c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.534+0000 7f0d59ffb700 1 -- 172.21.15.80:0/2223435750 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "rbd"}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f0d4c004430 con 0x7f0d5c108630 2019-11-28T11:25:12.559 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'rbd' created 2019-11-28T11:25:12.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.542+0000 7f0d62d64700 1 -- 172.21.15.80:0/2223435750 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d3c018730 msgr2=0x7f0d3c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:12.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.542+0000 7f0d62d64700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d3c018730 0x7f0d3c01abc0 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:12.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.542+0000 7f0d62d64700 1 -- 172.21.15.80:0/2223435750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d5c108630 msgr2=0x7f0d5c151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:12.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.542+0000 7f0d62d64700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d5c108630 0x7f0d5c151200 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f0d4c010440 tx=0x7f0d4c0107e0).stop 2019-11-28T11:25:12.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.542+0000 7f0d62d64700 1 -- 172.21.15.80:0/2223435750 shutdown_connections 2019-11-28T11:25:12.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.542+0000 7f0d62d64700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d3c018730 0x7f0d3c01abc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:12.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.542+0000 7f0d62d64700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d5c151740 0x7f0d5c1502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:12.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.542+0000 7f0d62d64700 1 --2- 172.21.15.80:0/2223435750 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d5c108630 0x7f0d5c151200 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:12.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.542+0000 7f0d62d64700 1 -- 172.21.15.80:0/2223435750 shutdown_connections 2019-11-28T11:25:12.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.542+0000 7f0d62d64700 1 -- 172.21.15.80:0/2223435750 wait complete. 2019-11-28T11:25:12.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.542+0000 7f0d62d64700 1 -- 172.21.15.80:0/2223435750 >> 172.21.15.80:0/2223435750 conn(0x7f0d5c14dbb0 msgr2=0x7f0d5c142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:12.571 INFO:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2019-11-28T11:25:12.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.680+0000 7f25a1d7d700 1 Processor -- start 2019-11-28T11:25:12.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.680+0000 7f25a1d7d700 1 -- start start 2019-11-28T11:25:12.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.680+0000 7f25a1d7d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f259c15ed10 0x7f259c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:12.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f25a1d7d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259c06db60 con 0x7f259c073020 2019-11-28T11:25:12.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f25a1d7d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259c06e060 con 0x7f259c0734b0 2019-11-28T11:25:12.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f25a1d7d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259c06fe00 con 0x7f259c15ed10 2019-11-28T11:25:12.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f259bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f259c15ed10 0x7f259c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:12.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f259bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f259c15ed10 0x7f259c15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58922/0 (socket says 172.21.15.80:58922) 2019-11-28T11:25:12.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f2593fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f259c073020 0x7f259c071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58238/0 (socket says 172.21.15.80:58238) 2019-11-28T11:25:12.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f259bfff700 1 -- 172.21.15.80:0/2413191525 learned_addr learned my addr 172.21.15.80:0/2413191525 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:12.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f259bfff700 1 -- 172.21.15.80:0/2413191525 >> v1:172.21.15.174:6789/0 conn(0x7f259c0734b0 legacy=0x7f259c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:12.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f259bfff700 1 -- 172.21.15.80:0/2413191525 >> v1:172.21.15.80:6789/0 conn(0x7f259c073020 legacy=0x7f259c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:12.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f259bfff700 1 -- 172.21.15.80:0/2413191525 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c070760 con 0x7f259c15ed10 2019-11-28T11:25:12.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f259b7fe700 1 -- 172.21.15.80:0/2413191525 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556611205 0 0) 0x7f2584001100 con 0x7f259c073020 2019-11-28T11:25:12.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f259bfff700 1 --2- 172.21.15.80:0/2413191525 >> v2:172.21.15.80:3300/0 conn(0x7f259c15ed10 0x7f259c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f258c00f740 tx=0x7f258c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f259bfff700 1 --2- 172.21.15.80:0/2413191525 >> v2:172.21.15.80:3300/0 conn(0x7f259c15ed10 0x7f259c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f258c00f740 tx=0x7f258c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f259bfff700 1 --2- 172.21.15.80:0/2413191525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c15ed10 0x7f259c15f100 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f258c00f740 tx=0x7f258c00fae0).ready entity=mon.0 client_cookie=1ad0cbf898bbbe23 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:12.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f259bfff700 1 --2- 172.21.15.80:0/2413191525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c15ed10 0x7f259c15f100 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f258c00f740 tx=0x7f258c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f259b7fe700 1 -- 172.21.15.80:0/2413191525 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f258c000960 con 0x7f259c15ed10 2019-11-28T11:25:12.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f259bfff700 1 --2- 172.21.15.80:0/2413191525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c15ed10 0x7f259c15f100 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f258c00f740 tx=0x7f258c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f259b7fe700 1 -- 172.21.15.80:0/2413191525 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258c000960 con 0x7f259c15ed10 2019-11-28T11:25:12.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f259bfff700 1 --2- 172.21.15.80:0/2413191525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c15ed10 0x7f259c15f100 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f258c00f740 tx=0x7f258c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f259b7fe700 1 -- 172.21.15.80:0/2413191525 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f258c001070 con 0x7f259c15ed10 2019-11-28T11:25:12.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f25a1d7d700 1 -- 172.21.15.80:0/2413191525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c15ed10 msgr2=0x7f259c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:12.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.681+0000 7f25a1d7d700 1 --2- 172.21.15.80:0/2413191525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c15ed10 0x7f259c15f100 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f258c00f740 tx=0x7f258c00fae0).stop 2019-11-28T11:25:12.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.682+0000 7f25a1d7d700 1 -- 172.21.15.80:0/2413191525 shutdown_connections 2019-11-28T11:25:12.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.682+0000 7f25a1d7d700 1 --2- 172.21.15.80:0/2413191525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c15ed10 0x7f259c15f100 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:12.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.682+0000 7f25a1d7d700 1 -- 172.21.15.80:0/2413191525 shutdown_connections 2019-11-28T11:25:12.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.682+0000 7f25a1d7d700 1 -- 172.21.15.80:0/2413191525 wait complete. 2019-11-28T11:25:12.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.682+0000 7f25a1d7d700 1 -- 172.21.15.80:0/2413191525 >> 172.21.15.80:0/2413191525 conn(0x7f259c061d20 msgr2=0x7f259c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:12.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.684+0000 7f25a1d7d700 1 Processor -- start 2019-11-28T11:25:12.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.685+0000 7f25a1d7d700 1 -- start start 2019-11-28T11:25:12.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.685+0000 7f25a1d7d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f259c10ed60 0x7f259c10f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:12.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.685+0000 7f25a1d7d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f259c10f730 0x7f259c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:12.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.685+0000 7f25a1d7d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259c10c250 con 0x7f259c10e970 2019-11-28T11:25:12.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.685+0000 7f25a1d7d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259c10e430 con 0x7f259c10f730 2019-11-28T11:25:12.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.685+0000 7f25a1d7d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c105860 con 0x7f259c10ed60 2019-11-28T11:25:12.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.685+0000 7f25a0b1b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f259c10f730 0x7f259c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:12.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25a0b1b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f259c10f730 0x7f259c167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58932/0 (socket says 172.21.15.80:58932) 2019-11-28T11:25:12.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25a0b1b700 1 -- 172.21.15.80:0/3171213427 learned_addr learned my addr 172.21.15.80:0/3171213427 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:12.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f2593fff700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f259c10ed60 0x7f259c10f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:12.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25a0b1b700 1 -- 172.21.15.80:0/3171213427 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f259c10ed60 msgr2=0x7f259c10f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:12.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25a0b1b700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f259c10ed60 0x7f259c10f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:12.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25a0b1b700 1 -- 172.21.15.80:0/3171213427 >> v1:172.21.15.174:6789/0 conn(0x7f259c10e970 legacy=0x7f259c1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:12.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25a0b1b700 1 -- 172.21.15.80:0/3171213427 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c105ef0 con 0x7f259c10f730 2019-11-28T11:25:12.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25a0b1b700 1 --2- 172.21.15.80:0/3171213427 >> v2:172.21.15.80:3300/0 conn(0x7f259c10f730 0x7f259c167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25940107a0 tx=0x7f2594010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25a0b1b700 1 --2- 172.21.15.80:0/3171213427 >> v2:172.21.15.80:3300/0 conn(0x7f259c10f730 0x7f259c167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25940107a0 tx=0x7f2594010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25a0b1b700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c10f730 0x7f259c167d70 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f25940107a0 tx=0x7f2594010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:12.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25a0b1b700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c10f730 0x7f259c167d70 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f25940107a0 tx=0x7f2594010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25a0b1b700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c10f730 0x7f259c167d70 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f25940107a0 tx=0x7f2594010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25a0b1b700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c10f730 0x7f259c167d70 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f25940107a0 tx=0x7f2594010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25997fa700 1 -- 172.21.15.80:0/3171213427 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2594001410 con 0x7f259c10f730 2019-11-28T11:25:12.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25997fa700 1 -- 172.21.15.80:0/3171213427 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2594000df0 con 0x7f259c10f730 2019-11-28T11:25:12.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25a1d7d700 1 -- 172.21.15.80:0/3171213427 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259c106270 con 0x7f259c10f730 2019-11-28T11:25:12.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25997fa700 1 -- 172.21.15.80:0/3171213427 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25940019f0 con 0x7f259c10f730 2019-11-28T11:25:12.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.686+0000 7f25a1d7d700 1 -- 172.21.15.80:0/3171213427 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259c105ef0 con 0x7f259c10f730 2019-11-28T11:25:12.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.687+0000 7f25a0b1b700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c10f730 0x7f259c167d70 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f25940107a0 tx=0x7f2594010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.687+0000 7f25997fa700 1 -- 172.21.15.80:0/3171213427 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2594001220 con 0x7f259c10f730 2019-11-28T11:25:12.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.687+0000 7f25a0b1b700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c10f730 0x7f259c167d70 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f25940107a0 tx=0x7f2594010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.687+0000 7f25997fa700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2580018730 0x7f258001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:12.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.687+0000 7f25997fa700 1 -- 172.21.15.80:0/3171213427 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4842+0+0 (secure 0 0 0) 0x7f2594031df0 con 0x7f259c10f730 2019-11-28T11:25:12.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.687+0000 7f259bfff700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2580018730 0x7f258001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:12.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.687+0000 7f259bfff700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2580018730 0x7f258001abc0 crc :-1 s=READY pgs=37 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:12.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.695+0000 7f25a1d7d700 1 -- 172.21.15.80:0/3171213427 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259c106270 con 0x7f259c10f730 2019-11-28T11:25:12.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.698+0000 7f25a0b1b700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c10f730 0x7f259c167d70 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f25940107a0 tx=0x7f2594010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:12.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.698+0000 7f25997fa700 1 -- 172.21.15.80:0/3171213427 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2594007910 con 0x7f259c10f730 2019-11-28T11:25:12.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:12.864+0000 7f25a1d7d700 1 -- 172.21.15.80:0/3171213427 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool application enable", "app": "rbd", "pool": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f259c105ef0 con 0x7f259c10f730 2019-11-28T11:25:13.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.536+0000 7f25a0b1b700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c10f730 0x7f259c167d70 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f25940107a0 tx=0x7f2594010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:13.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.536+0000 7f25997fa700 1 -- 172.21.15.80:0/3171213427 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "app": "rbd", "pool": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f25940179d0 con 0x7f259c10f730 2019-11-28T11:25:13.598 INFO:teuthology.orchestra.run.smithi080.stderr:enabled application 'rbd' on pool 'rbd' 2019-11-28T11:25:13.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.581+0000 7f25a1d7d700 1 -- 172.21.15.80:0/3171213427 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2580018730 msgr2=0x7f258001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:13.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.581+0000 7f25a1d7d700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2580018730 0x7f258001abc0 crc :-1 s=READY pgs=37 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:13.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.581+0000 7f25a1d7d700 1 -- 172.21.15.80:0/3171213427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c10f730 msgr2=0x7f259c167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:13.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.581+0000 7f25a1d7d700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c10f730 0x7f259c167d70 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f25940107a0 tx=0x7f2594010600).stop 2019-11-28T11:25:13.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.581+0000 7f25a1d7d700 1 -- 172.21.15.80:0/3171213427 shutdown_connections 2019-11-28T11:25:13.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.581+0000 7f25a1d7d700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f259c10f730 0x7f259c167d70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:13.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.581+0000 7f25a1d7d700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f259c10ed60 0x7f259c10f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:13.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.581+0000 7f25a1d7d700 1 --2- 172.21.15.80:0/3171213427 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2580018730 0x7f258001abc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:13.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.581+0000 7f25a1d7d700 1 -- 172.21.15.80:0/3171213427 shutdown_connections 2019-11-28T11:25:13.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.581+0000 7f25a1d7d700 1 -- 172.21.15.80:0/3171213427 wait complete. 2019-11-28T11:25:13.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.581+0000 7f25a1d7d700 1 -- 172.21.15.80:0/3171213427 >> 172.21.15.80:0/3171213427 conn(0x7f259c15e2d0 msgr2=0x7f259c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:13.611 INFO:tasks.ceph:Setting up CephFS filesystem... 2019-11-28T11:25:13.611 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:13.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.711+0000 7f0818b79700 1 Processor -- start 2019-11-28T11:25:13.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.711+0000 7f0818b79700 1 -- start start 2019-11-28T11:25:13.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f0818b79700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f081406c0a0 0x7f0814072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:13.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f0818b79700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08140734e0 0x7f0814071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:13.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f0818b79700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0814072360 0x7f0814072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:13.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f0818b79700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081406fd60 con 0x7f0814072360 2019-11-28T11:25:13.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f0818b79700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0814070030 con 0x7f081406c0a0 2019-11-28T11:25:13.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f0818b79700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081406f330 con 0x7f08140734e0 2019-11-28T11:25:13.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f081359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0814072360 0x7f0814072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:13.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f081359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0814072360 0x7f0814072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58990/0 (socket says 172.21.15.80:58990) 2019-11-28T11:25:13.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f081359e700 1 -- 172.21.15.80:0/1573198334 learned_addr learned my addr 172.21.15.80:0/1573198334 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:13.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f081259c700 1 --2- 172.21.15.80:0/1573198334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08140734e0 0x7f0814071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:13.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f0812d9d700 1 --2- 172.21.15.80:0/1573198334 >> v2:172.21.15.174:3300/0 conn(0x7f081406c0a0 0x7f0814072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:13.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f081359e700 1 -- 172.21.15.80:0/1573198334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08140734e0 msgr2=0x7f0814071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:13.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f081359e700 1 --2- 172.21.15.80:0/1573198334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08140734e0 0x7f0814071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:13.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f081359e700 1 -- 172.21.15.80:0/1573198334 >> v2:172.21.15.174:3300/0 conn(0x7f081406c0a0 msgr2=0x7f0814072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:13.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f081359e700 1 --2- 172.21.15.80:0/1573198334 >> v2:172.21.15.174:3300/0 conn(0x7f081406c0a0 0x7f0814072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:13.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f081359e700 1 -- 172.21.15.80:0/1573198334 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08140706c0 con 0x7f0814072360 2019-11-28T11:25:13.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f0812d9d700 1 --2- 172.21.15.80:0/1573198334 >> v2:172.21.15.174:3300/0 conn(0x7f081406c0a0 0x7f0814072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:13.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f081259c700 1 --2- 172.21.15.80:0/1573198334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08140734e0 0x7f0814071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:13.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.712+0000 7f081359e700 1 --2- 172.21.15.80:0/1573198334 >> v2:172.21.15.80:3300/0 conn(0x7f0814072360 0x7f0814072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f080c00fab0 tx=0x7f080c00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:13.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.713+0000 7f081359e700 1 --2- 172.21.15.80:0/1573198334 >> v2:172.21.15.80:3300/0 conn(0x7f0814072360 0x7f0814072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f080c00fab0 tx=0x7f080c00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:13.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.713+0000 7f081359e700 1 --2- 172.21.15.80:0/1573198334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0814072360 0x7f0814072800 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f080c00fab0 tx=0x7f080c00fe50).ready entity=mon.0 client_cookie=cb5377167c169ff server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:13.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.713+0000 7f081359e700 1 --2- 172.21.15.80:0/1573198334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0814072360 0x7f0814072800 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f080c00fab0 tx=0x7f080c00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:13.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.713+0000 7f081359e700 1 --2- 172.21.15.80:0/1573198334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0814072360 0x7f0814072800 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f080c00fab0 tx=0x7f080c00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:13.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.713+0000 7f0811d9b700 1 -- 172.21.15.80:0/1573198334 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080c001460 con 0x7f0814072360 2019-11-28T11:25:13.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.713+0000 7f081359e700 1 --2- 172.21.15.80:0/1573198334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0814072360 0x7f0814072800 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f080c00fab0 tx=0x7f080c00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:13.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.713+0000 7f0811d9b700 1 -- 172.21.15.80:0/1573198334 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c000f10 con 0x7f0814072360 2019-11-28T11:25:13.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.713+0000 7f0811d9b700 1 -- 172.21.15.80:0/1573198334 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080c001a40 con 0x7f0814072360 2019-11-28T11:25:13.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.713+0000 7f0818b79700 1 -- 172.21.15.80:0/1573198334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0814072360 msgr2=0x7f0814072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:13.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.713+0000 7f0818b79700 1 --2- 172.21.15.80:0/1573198334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0814072360 0x7f0814072800 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f080c00fab0 tx=0x7f080c00fe50).stop 2019-11-28T11:25:13.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.713+0000 7f0818b79700 1 -- 172.21.15.80:0/1573198334 shutdown_connections 2019-11-28T11:25:13.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.714+0000 7f0818b79700 1 --2- 172.21.15.80:0/1573198334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0814072360 0x7f0814072800 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:13.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.714+0000 7f0818b79700 1 --2- 172.21.15.80:0/1573198334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08140734e0 0x7f0814071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.714+0000 7f0818b79700 1 --2- 172.21.15.80:0/1573198334 >> v2:172.21.15.174:3300/0 conn(0x7f081406c0a0 0x7f0814072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.714+0000 7f0818b79700 1 -- 172.21.15.80:0/1573198334 shutdown_connections 2019-11-28T11:25:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.714+0000 7f0818b79700 1 -- 172.21.15.80:0/1573198334 wait complete. 2019-11-28T11:25:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.714+0000 7f0818b79700 1 -- 172.21.15.80:0/1573198334 >> 172.21.15.80:0/1573198334 conn(0x7f0814061cf0 msgr2=0x7f0814064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:13.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.716+0000 7f0818b79700 1 Processor -- start 2019-11-28T11:25:13.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.716+0000 7f0818b79700 1 -- start start 2019-11-28T11:25:13.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.717+0000 7f0818b79700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f081413eb40 0x7f081410afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:13.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.717+0000 7f0818b79700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f081410b500 0x7f08141629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:13.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.717+0000 7f0818b79700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081413f1e0 con 0x7f0814162f30 2019-11-28T11:25:13.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.717+0000 7f0818b79700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08141234c0 con 0x7f081410b500 2019-11-28T11:25:13.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.717+0000 7f0818b79700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081413d6a0 con 0x7f081413eb40 2019-11-28T11:25:13.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.717+0000 7f081359e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0814162f30 0x7f0814109e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58314/0 (socket says 172.21.15.80:58314) 2019-11-28T11:25:13.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.717+0000 7f081359e700 1 -- 172.21.15.80:0/2563396112 learned_addr learned my addr 172.21.15.80:0/2563396112 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:13.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.717+0000 7f0812d9d700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f081413eb40 0x7f081410afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:13.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.717+0000 7f081259c700 1 --2- 172.21.15.80:0/2563396112 >> v2:172.21.15.174:3300/0 conn(0x7f081410b500 0x7f08141629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:13.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.717+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456756121 0 0) 0x7f080c000f10 con 0x7f0814162f30 2019-11-28T11:25:13.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.717+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07ec002e80 con 0x7f0814162f30 2019-11-28T11:25:13.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.717+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4077930137 0 0) 0x7f080c008500 con 0x7f0814162f30 2019-11-28T11:25:13.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.717+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f07ec0032e0 con 0x7f0814162f30 2019-11-28T11:25:13.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.717+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f080c007f70 con 0x7f0814162f30 2019-11-28T11:25:13.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f081413eb40 msgr2=0x7f081410afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:13.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f080b7fe700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f081413eb40 0x7f081410afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:13.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 >> v2:172.21.15.174:3300/0 conn(0x7f081410b500 msgr2=0x7f08141629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:13.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f080b7fe700 1 --2- 172.21.15.80:0/2563396112 >> v2:172.21.15.174:3300/0 conn(0x7f081410b500 0x7f08141629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:13.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 >> v1:172.21.15.80:6789/0 conn(0x7f0814162f30 legacy=0x7f0814109e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:13.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f080b7fe700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07ec0033f0 0x7f07ec003800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:13.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f080b7fe700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07ec003d40 0x7f07ec0041e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:13.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f080b7fe700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07ec004830 0x7f07ec004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:13.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec00bb60 con 0x7f07ec003d40 2019-11-28T11:25:13.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec00bd60 con 0x7f07ec004830 2019-11-28T11:25:13.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec00bf90 con 0x7f07ec0033f0 2019-11-28T11:25:13.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f081259c700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07ec003d40 0x7f07ec0041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:13.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f0812d9d700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07ec0033f0 0x7f07ec003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:13.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f081359e700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07ec004830 0x7f07ec004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:13.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f081259c700 1 -- 172.21.15.80:0/2563396112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07ec0033f0 msgr2=0x7f07ec003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:13.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f081259c700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07ec0033f0 0x7f07ec003800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:13.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f081259c700 1 -- 172.21.15.80:0/2563396112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07ec004830 msgr2=0x7f07ec004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:13.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f081259c700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07ec004830 0x7f07ec004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:13.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f081259c700 1 -- 172.21.15.80:0/2563396112 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec00c240 con 0x7f07ec003d40 2019-11-28T11:25:13.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f0818b79700 1 -- 172.21.15.80:0/2563396112 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0814108a80 con 0x7f07ec003d40 2019-11-28T11:25:13.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f081259c700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07ec003d40 0x7f07ec0041e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f07fc0105b0 tx=0x7f07fc010430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:13.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f0818b79700 1 -- 172.21.15.80:0/2563396112 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0814108700 con 0x7f07ec003d40 2019-11-28T11:25:13.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f081259c700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07ec003d40 0x7f07ec0041e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f07fc0105b0 tx=0x7f07fc010430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:13.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f081259c700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07ec003d40 0x7f07ec0041e0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f07fc0105b0 tx=0x7f07fc010430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:13.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f081259c700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07ec003d40 0x7f07ec0041e0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f07fc0105b0 tx=0x7f07fc010430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:13.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07fc009740 con 0x7f07ec003d40 2019-11-28T11:25:13.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f081259c700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07ec003d40 0x7f07ec0041e0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f07fc0105b0 tx=0x7f07fc010430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:13.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f081259c700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07ec003d40 0x7f07ec0041e0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f07fc0105b0 tx=0x7f07fc010430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:13.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc000ba0 con 0x7f07ec003d40 2019-11-28T11:25:13.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.718+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07fc009740 con 0x7f07ec003d40 2019-11-28T11:25:13.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.719+0000 7f081259c700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07ec003d40 0x7f07ec0041e0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f07fc0105b0 tx=0x7f07fc010430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:13.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.719+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f07fc000d90 con 0x7f07ec003d40 2019-11-28T11:25:13.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.719+0000 7f081259c700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07ec003d40 0x7f07ec0041e0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f07fc0105b0 tx=0x7f07fc010430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:13.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.719+0000 7f080b7fe700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07ec020ae0 0x7f07ec022f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:13.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.719+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f07fc031ed0 con 0x7f07ec003d40 2019-11-28T11:25:13.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.719+0000 7f0812d9d700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07ec020ae0 0x7f07ec022f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:13.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.719+0000 7f0812d9d700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07ec020ae0 0x7f07ec022f10 crc :-1 s=READY pgs=38 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:13.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.726+0000 7f0818b79700 1 -- 172.21.15.80:0/2563396112 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0814108a80 con 0x7f07ec003d40 2019-11-28T11:25:13.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.730+0000 7f081259c700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07ec003d40 0x7f07ec0041e0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f07fc0105b0 tx=0x7f07fc010430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:13.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.730+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f07fc002a40 con 0x7f07ec003d40 2019-11-28T11:25:13.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.904+0000 7f0818b79700 1 -- 172.21.15.80:0/2563396112 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0814108700 con 0x7f07ec003d40 2019-11-28T11:25:13.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.905+0000 7f081259c700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07ec003d40 0x7f07ec0041e0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f07fc0105b0 tx=0x7f07fc010430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:13.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.905+0000 7f080b7fe700 1 -- 172.21.15.80:0/2563396112 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11778 (secure 0 0 0) 0x7f07fc017600 con 0x7f07ec003d40 2019-11-28T11:25:13.934 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:13.935 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":17,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:13.533786+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:13.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.907+0000 7f0818b79700 1 -- 172.21.15.80:0/2563396112 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07ec020ae0 msgr2=0x7f07ec022f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:13.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.907+0000 7f0818b79700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07ec020ae0 0x7f07ec022f10 crc :-1 s=READY pgs=38 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:13.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.907+0000 7f0818b79700 1 -- 172.21.15.80:0/2563396112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07ec003d40 msgr2=0x7f07ec0041e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:13.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.907+0000 7f0818b79700 1 --2- 172.21.15.80:0/2563396112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07ec003d40 0x7f07ec0041e0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f07fc0105b0 tx=0x7f07fc010430).stop 2019-11-28T11:25:13.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.907+0000 7f081359e700 1 -- 172.21.15.80:0/2563396112 reap_dead start 2019-11-28T11:25:13.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.907+0000 7f081359e700 1 -- 172.21.15.80:0/2563396112 reap_dead start 2019-11-28T11:25:13.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.907+0000 7f0818b79700 1 -- 172.21.15.80:0/2563396112 shutdown_connections 2019-11-28T11:25:13.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.907+0000 7f0818b79700 1 -- 172.21.15.80:0/2563396112 shutdown_connections 2019-11-28T11:25:13.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.907+0000 7f0818b79700 1 -- 172.21.15.80:0/2563396112 wait complete. 2019-11-28T11:25:13.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:13.907+0000 7f0818b79700 1 -- 172.21.15.80:0/2563396112 >> 172.21.15.80:0/2563396112 conn(0x7f081411bfc0 msgr2=0x7f0814141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:13.944 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:25:13.945 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:25:14.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.068+0000 7f771b33c700 1 Processor -- start 2019-11-28T11:25:14.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.068+0000 7f771b33c700 1 -- start start 2019-11-28T11:25:14.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.069+0000 7f771b33c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f771415ed10 0x7f771415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:14.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.069+0000 7f771b33c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f77140734b0 0x7f77140726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:14.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.069+0000 7f771b33c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771406db60 con 0x7f7714073020 2019-11-28T11:25:14.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.069+0000 7f771b33c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771406f3d0 con 0x7f77140734b0 2019-11-28T11:25:14.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.069+0000 7f771b33c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771406fe00 con 0x7f771415ed10 2019-11-28T11:25:14.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.069+0000 7f771a0da700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f77140734b0 0x7f77140726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:14.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.069+0000 7f771a0da700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f77140734b0 0x7f77140726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59010/0 (socket says 172.21.15.80:59010) 2019-11-28T11:25:14.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.069+0000 7f771a0da700 1 -- 172.21.15.80:0/315041975 learned_addr learned my addr 172.21.15.80:0/315041975 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:14.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.069+0000 7f77198d9700 1 --2- 172.21.15.80:0/315041975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f771415ed10 0x7f771415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:14.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.069+0000 7f771a0da700 1 -- 172.21.15.80:0/315041975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f771415ed10 msgr2=0x7f771415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:14.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.069+0000 7f771a0da700 1 --2- 172.21.15.80:0/315041975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f771415ed10 0x7f771415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:14.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.069+0000 7f771a0da700 1 -- 172.21.15.80:0/315041975 >> v1:172.21.15.174:6789/0 conn(0x7f7714073020 legacy=0x7f7714071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:14.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.069+0000 7f771a0da700 1 -- 172.21.15.80:0/315041975 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7714070760 con 0x7f77140734b0 2019-11-28T11:25:14.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.069+0000 7f771a0da700 1 --2- 172.21.15.80:0/315041975 >> v2:172.21.15.80:3300/0 conn(0x7f77140734b0 0x7f77140726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f770c00fab0 tx=0x7f770c0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.070+0000 7f771a0da700 1 --2- 172.21.15.80:0/315041975 >> v2:172.21.15.80:3300/0 conn(0x7f77140734b0 0x7f77140726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f770c00fab0 tx=0x7f770c0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.070+0000 7f771a0da700 1 --2- 172.21.15.80:0/315041975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77140734b0 0x7f77140726a0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f770c00fab0 tx=0x7f770c0080d0).ready entity=mon.0 client_cookie=575745bc67eafe2d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:14.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.070+0000 7f771a0da700 1 --2- 172.21.15.80:0/315041975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77140734b0 0x7f77140726a0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f770c00fab0 tx=0x7f770c0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.070+0000 7f77188d7700 1 -- 172.21.15.80:0/315041975 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f770c000df0 con 0x7f77140734b0 2019-11-28T11:25:14.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.070+0000 7f771a0da700 1 --2- 172.21.15.80:0/315041975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77140734b0 0x7f77140726a0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f770c00fab0 tx=0x7f770c0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.070+0000 7f771a0da700 1 --2- 172.21.15.80:0/315041975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77140734b0 0x7f77140726a0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f770c00fab0 tx=0x7f770c0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.070+0000 7f77188d7700 1 -- 172.21.15.80:0/315041975 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c001460 con 0x7f77140734b0 2019-11-28T11:25:14.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.070+0000 7f77188d7700 1 -- 172.21.15.80:0/315041975 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f770c001b30 con 0x7f77140734b0 2019-11-28T11:25:14.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.070+0000 7f771b33c700 1 -- 172.21.15.80:0/315041975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77140734b0 msgr2=0x7f77140726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:14.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.070+0000 7f771b33c700 1 --2- 172.21.15.80:0/315041975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77140734b0 0x7f77140726a0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f770c00fab0 tx=0x7f770c0080d0).stop 2019-11-28T11:25:14.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.070+0000 7f771b33c700 1 -- 172.21.15.80:0/315041975 shutdown_connections 2019-11-28T11:25:14.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.070+0000 7f771b33c700 1 --2- 172.21.15.80:0/315041975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77140734b0 0x7f77140726a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:14.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.070+0000 7f771b33c700 1 --2- 172.21.15.80:0/315041975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f771415ed10 0x7f771415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:14.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.071+0000 7f771b33c700 1 -- 172.21.15.80:0/315041975 shutdown_connections 2019-11-28T11:25:14.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.071+0000 7f771b33c700 1 -- 172.21.15.80:0/315041975 wait complete. 2019-11-28T11:25:14.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.071+0000 7f771b33c700 1 -- 172.21.15.80:0/315041975 >> 172.21.15.80:0/315041975 conn(0x7f7714061d20 msgr2=0x7f77140641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:14.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.073+0000 7f771b33c700 1 Processor -- start 2019-11-28T11:25:14.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.073+0000 7f771b33c700 1 -- start start 2019-11-28T11:25:14.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771b33c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7714167d80 0x7f771416a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:14.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771b33c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7714148e00 con 0x7f77141079b0 2019-11-28T11:25:14.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771b33c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7714108b10 con 0x7f7714148320 2019-11-28T11:25:14.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771b33c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771413aa20 con 0x7f7714167d80 2019-11-28T11:25:14.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771a0da700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7714167d80 0x7f771416a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:14.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771a0da700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7714167d80 0x7f771416a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59018/0 (socket says 172.21.15.80:59018) 2019-11-28T11:25:14.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771a0da700 1 -- 172.21.15.80:0/2924768165 learned_addr learned my addr 172.21.15.80:0/2924768165 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:14.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f77190d8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f77141079b0 0x7f7714107e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58332/0 (socket says 172.21.15.80:58332) 2019-11-28T11:25:14.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771a0da700 1 -- 172.21.15.80:0/2924768165 >> v1:172.21.15.174:6789/0 conn(0x7f7714148320 legacy=0x7f771410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771a0da700 1 -- 172.21.15.80:0/2924768165 >> v1:172.21.15.80:6789/0 conn(0x7f77141079b0 legacy=0x7f7714107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f770a7fc700 1 -- 172.21.15.80:0/2924768165 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152333483 0 0) 0x7f7710001020 con 0x7f77141079b0 2019-11-28T11:25:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771a0da700 1 -- 172.21.15.80:0/2924768165 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771410c490 con 0x7f7714167d80 2019-11-28T11:25:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771a0da700 1 --2- 172.21.15.80:0/2924768165 >> v2:172.21.15.80:3300/0 conn(0x7f7714167d80 0x7f771416a180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f770c010800 tx=0x7f770c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771a0da700 1 --2- 172.21.15.80:0/2924768165 >> v2:172.21.15.80:3300/0 conn(0x7f7714167d80 0x7f771416a180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f770c010800 tx=0x7f770c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771a0da700 1 --2- 172.21.15.80:0/2924768165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7714167d80 0x7f771416a180 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f770c010800 tx=0x7f770c010ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771a0da700 1 --2- 172.21.15.80:0/2924768165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7714167d80 0x7f771416a180 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f770c010800 tx=0x7f770c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f770a7fc700 1 -- 172.21.15.80:0/2924768165 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f770c001910 con 0x7f7714167d80 2019-11-28T11:25:14.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771a0da700 1 --2- 172.21.15.80:0/2924768165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7714167d80 0x7f771416a180 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f770c010800 tx=0x7f770c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771a0da700 1 --2- 172.21.15.80:0/2924768165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7714167d80 0x7f771416a180 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f770c010800 tx=0x7f770c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f770a7fc700 1 -- 172.21.15.80:0/2924768165 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c001530 con 0x7f7714167d80 2019-11-28T11:25:14.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f770a7fc700 1 -- 172.21.15.80:0/2924768165 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f770c001720 con 0x7f7714167d80 2019-11-28T11:25:14.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.074+0000 7f771b33c700 1 -- 172.21.15.80:0/2924768165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771410c810 con 0x7f7714167d80 2019-11-28T11:25:14.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.075+0000 7f771b33c700 1 -- 172.21.15.80:0/2924768165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771410c490 con 0x7f7714167d80 2019-11-28T11:25:14.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.075+0000 7f771a0da700 1 --2- 172.21.15.80:0/2924768165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7714167d80 0x7f771416a180 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f770c010800 tx=0x7f770c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.075+0000 7f770a7fc700 1 -- 172.21.15.80:0/2924768165 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f770c001230 con 0x7f7714167d80 2019-11-28T11:25:14.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.075+0000 7f771a0da700 1 --2- 172.21.15.80:0/2924768165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7714167d80 0x7f771416a180 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f770c010800 tx=0x7f770c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.075+0000 7f770a7fc700 1 --2- 172.21.15.80:0/2924768165 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f76fc018730 0x7f76fc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:14.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.075+0000 7f770a7fc700 1 -- 172.21.15.80:0/2924768165 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f770c031f00 con 0x7f7714167d80 2019-11-28T11:25:14.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.075+0000 7f77198d9700 1 --2- 172.21.15.80:0/2924768165 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f76fc018730 0x7f76fc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:14.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.076+0000 7f77198d9700 1 --2- 172.21.15.80:0/2924768165 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f76fc018730 0x7f76fc01abc0 crc :-1 s=READY pgs=39 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:14.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.083+0000 7f771b33c700 1 -- 172.21.15.80:0/2924768165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771410c810 con 0x7f7714167d80 2019-11-28T11:25:14.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.087+0000 7f771a0da700 1 --2- 172.21.15.80:0/2924768165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7714167d80 0x7f771416a180 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f770c010800 tx=0x7f770c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.087+0000 7f770a7fc700 1 -- 172.21.15.80:0/2924768165 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f770c017840 con 0x7f7714167d80 2019-11-28T11:25:14.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.254+0000 7f771b33c700 1 -- 172.21.15.80:0/2924768165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f771410c490 con 0x7f7714167d80 2019-11-28T11:25:14.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.254+0000 7f771a0da700 1 --2- 172.21.15.80:0/2924768165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7714167d80 0x7f771416a180 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f770c010800 tx=0x7f770c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.254+0000 7f770a7fc700 1 -- 172.21.15.80:0/2924768165 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f770c001230 con 0x7f7714167d80 2019-11-28T11:25:14.276 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:14.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.256+0000 7f771b33c700 1 -- 172.21.15.80:0/2924768165 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f76fc018730 msgr2=0x7f76fc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:14.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.256+0000 7f771b33c700 1 --2- 172.21.15.80:0/2924768165 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f76fc018730 0x7f76fc01abc0 crc :-1 s=READY pgs=39 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:14.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.256+0000 7f771b33c700 1 -- 172.21.15.80:0/2924768165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7714167d80 msgr2=0x7f771416a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:14.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.256+0000 7f771b33c700 1 --2- 172.21.15.80:0/2924768165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7714167d80 0x7f771416a180 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f770c010800 tx=0x7f770c010ba0).stop 2019-11-28T11:25:14.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.256+0000 7f771b33c700 1 -- 172.21.15.80:0/2924768165 shutdown_connections 2019-11-28T11:25:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.256+0000 7f771b33c700 1 --2- 172.21.15.80:0/2924768165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7714167d80 0x7f771416a180 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:14.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.256+0000 7f771b33c700 1 --2- 172.21.15.80:0/2924768165 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f76fc018730 0x7f76fc01abc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.256+0000 7f771b33c700 1 -- 172.21.15.80:0/2924768165 shutdown_connections 2019-11-28T11:25:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.256+0000 7f771b33c700 1 -- 172.21.15.80:0/2924768165 wait complete. 2019-11-28T11:25:14.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.256+0000 7f771b33c700 1 -- 172.21.15.80:0/2924768165 >> 172.21.15.80:0/2924768165 conn(0x7f771415e2d0 msgr2=0x7f7714147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:14.288 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:25:14.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.395+0000 7fe13a27a700 1 Processor -- start 2019-11-28T11:25:14.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.395+0000 7fe13a27a700 1 -- start start 2019-11-28T11:25:14.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe13a27a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe13406c0a0 0x7fe134072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:14.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe13a27a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe134072620 0x7fe134164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:14.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe13a27a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13406db00 con 0x7fe1340734e0 2019-11-28T11:25:14.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe13a27a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe13406fd60 con 0x7fe134072620 2019-11-28T11:25:14.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe13a27a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe134070030 con 0x7fe13406c0a0 2019-11-28T11:25:14.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe139018700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe134072620 0x7fe134164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:14.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe139018700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe134072620 0x7fe134164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59022/0 (socket says 172.21.15.80:59022) 2019-11-28T11:25:14.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe139018700 1 -- 172.21.15.80:0/2510724012 learned_addr learned my addr 172.21.15.80:0/2510724012 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:14.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe138817700 1 --2- 172.21.15.80:0/2510724012 >> v2:172.21.15.174:3300/0 conn(0x7fe13406c0a0 0x7fe134072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:14.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe139018700 1 -- 172.21.15.80:0/2510724012 >> v2:172.21.15.174:3300/0 conn(0x7fe13406c0a0 msgr2=0x7fe134072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:14.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe139018700 1 --2- 172.21.15.80:0/2510724012 >> v2:172.21.15.174:3300/0 conn(0x7fe13406c0a0 0x7fe134072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:14.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe139018700 1 -- 172.21.15.80:0/2510724012 >> v1:172.21.15.174:6789/0 conn(0x7fe1340734e0 legacy=0x7fe134071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:14.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe139018700 1 -- 172.21.15.80:0/2510724012 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1340706c0 con 0x7fe134072620 2019-11-28T11:25:14.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe139018700 1 --2- 172.21.15.80:0/2510724012 >> v2:172.21.15.80:3300/0 conn(0x7fe134072620 0x7fe134164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe12c00f730 tx=0x7fe12c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe139018700 1 --2- 172.21.15.80:0/2510724012 >> v2:172.21.15.80:3300/0 conn(0x7fe134072620 0x7fe134164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe12c00f730 tx=0x7fe12c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe139018700 1 --2- 172.21.15.80:0/2510724012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe134072620 0x7fe134164d70 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7fe12c00f730 tx=0x7fe12c007d50).ready entity=mon.0 client_cookie=fbb9c2e5d271dcd4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:14.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe139018700 1 --2- 172.21.15.80:0/2510724012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe134072620 0x7fe134164d70 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7fe12c00f730 tx=0x7fe12c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe139018700 1 --2- 172.21.15.80:0/2510724012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe134072620 0x7fe134164d70 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7fe12c00f730 tx=0x7fe12c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe1337fe700 1 -- 172.21.15.80:0/2510724012 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe12c000a70 con 0x7fe134072620 2019-11-28T11:25:14.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe139018700 1 --2- 172.21.15.80:0/2510724012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe134072620 0x7fe134164d70 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7fe12c00f730 tx=0x7fe12c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe1337fe700 1 -- 172.21.15.80:0/2510724012 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12c0010e0 con 0x7fe134072620 2019-11-28T11:25:14.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe1337fe700 1 -- 172.21.15.80:0/2510724012 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe12c0017b0 con 0x7fe134072620 2019-11-28T11:25:14.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe13a27a700 1 -- 172.21.15.80:0/2510724012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe134072620 msgr2=0x7fe134164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:14.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.396+0000 7fe13a27a700 1 --2- 172.21.15.80:0/2510724012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe134072620 0x7fe134164d70 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7fe12c00f730 tx=0x7fe12c007d50).stop 2019-11-28T11:25:14.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.397+0000 7fe13a27a700 1 -- 172.21.15.80:0/2510724012 shutdown_connections 2019-11-28T11:25:14.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.397+0000 7fe13a27a700 1 --2- 172.21.15.80:0/2510724012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe134072620 0x7fe134164d70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:14.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.397+0000 7fe13a27a700 1 --2- 172.21.15.80:0/2510724012 >> v2:172.21.15.174:3300/0 conn(0x7fe13406c0a0 0x7fe134072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:14.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.397+0000 7fe13a27a700 1 -- 172.21.15.80:0/2510724012 shutdown_connections 2019-11-28T11:25:14.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.397+0000 7fe13a27a700 1 -- 172.21.15.80:0/2510724012 wait complete. 2019-11-28T11:25:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.397+0000 7fe13a27a700 1 -- 172.21.15.80:0/2510724012 >> 172.21.15.80:0/2510724012 conn(0x7fe134061cf0 msgr2=0x7fe134064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.399+0000 7fe13a27a700 1 Processor -- start 2019-11-28T11:25:14.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.399+0000 7fe13a27a700 1 -- start start 2019-11-28T11:25:14.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.400+0000 7fe13a27a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe134104c10 0x7fe1341050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:14.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.400+0000 7fe13a27a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13413bcd0 con 0x7fe1341055e0 2019-11-28T11:25:14.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.400+0000 7fe13a27a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe134105ea0 con 0x7fe134104820 2019-11-28T11:25:14.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.400+0000 7fe13a27a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe134109130 con 0x7fe134104c10 2019-11-28T11:25:14.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe139018700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe1341055e0 0x7fe134167a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58344/0 (socket says 172.21.15.80:58344) 2019-11-28T11:25:14.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe139018700 1 -- 172.21.15.80:0/3690252928 learned_addr learned my addr 172.21.15.80:0/3690252928 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:14.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe133fff700 1 --2- 172.21.15.80:0/3690252928 >> v2:172.21.15.174:3300/0 conn(0x7fe134104c10 0x7fe1341050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:14.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe1317fa700 1 -- 172.21.15.80:0/3690252928 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598909406 0 0) 0x7fe12c0079e0 con 0x7fe1341055e0 2019-11-28T11:25:14.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe1317fa700 1 -- 172.21.15.80:0/3690252928 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe118002e80 con 0x7fe1341055e0 2019-11-28T11:25:14.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe1317fa700 1 -- 172.21.15.80:0/3690252928 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3420612108 0 0) 0x7fe12c007580 con 0x7fe1341055e0 2019-11-28T11:25:14.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe1317fa700 1 -- 172.21.15.80:0/3690252928 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe1180032e0 con 0x7fe1341055e0 2019-11-28T11:25:14.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe1317fa700 1 -- 172.21.15.80:0/3690252928 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fe12c000b50 con 0x7fe1341055e0 2019-11-28T11:25:14.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe133fff700 1 -- 172.21.15.80:0/3690252928 >> v1:172.21.15.174:6789/0 conn(0x7fe134104820 legacy=0x7fe13410c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:14.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe133fff700 1 -- 172.21.15.80:0/3690252928 >> v1:172.21.15.80:6789/0 conn(0x7fe1341055e0 legacy=0x7fe134167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:14.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe133fff700 1 -- 172.21.15.80:0/3690252928 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe134109a90 con 0x7fe134104c10 2019-11-28T11:25:14.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe133fff700 1 --2- 172.21.15.80:0/3690252928 >> v2:172.21.15.174:3300/0 conn(0x7fe134104c10 0x7fe1341050a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe11c0103a0 tx=0x7fe11c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe133fff700 1 --2- 172.21.15.80:0/3690252928 >> v2:172.21.15.174:3300/0 conn(0x7fe134104c10 0x7fe1341050a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe11c0103a0 tx=0x7fe11c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe133fff700 1 --2- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe134104c10 0x7fe1341050a0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fe11c0103a0 tx=0x7fe11c010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:14.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe133fff700 1 --2- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe134104c10 0x7fe1341050a0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fe11c0103a0 tx=0x7fe11c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe1317fa700 1 -- 172.21.15.80:0/3690252928 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe11c009b70 con 0x7fe134104c10 2019-11-28T11:25:14.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe13a27a700 1 -- 172.21.15.80:0/3690252928 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe134109e10 con 0x7fe134104c10 2019-11-28T11:25:14.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe133fff700 1 --2- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe134104c10 0x7fe1341050a0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fe11c0103a0 tx=0x7fe11c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe1317fa700 1 -- 172.21.15.80:0/3690252928 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c007210 con 0x7fe134104c10 2019-11-28T11:25:14.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe133fff700 1 --2- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe134104c10 0x7fe1341050a0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fe11c0103a0 tx=0x7fe11c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.401+0000 7fe1317fa700 1 -- 172.21.15.80:0/3690252928 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe11c009d10 con 0x7fe134104c10 2019-11-28T11:25:14.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.402+0000 7fe13a27a700 1 -- 172.21.15.80:0/3690252928 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe134109a90 con 0x7fe134104c10 2019-11-28T11:25:14.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.402+0000 7fe133fff700 1 --2- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe134104c10 0x7fe1341050a0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fe11c0103a0 tx=0x7fe11c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.402+0000 7fe1317fa700 1 -- 172.21.15.80:0/3690252928 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe11c0098d0 con 0x7fe134104c10 2019-11-28T11:25:14.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.402+0000 7fe133fff700 1 --2- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe134104c10 0x7fe1341050a0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fe11c0103a0 tx=0x7fe11c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.402+0000 7fe1317fa700 1 --2- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe118018770 0x7fe11801ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:14.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.402+0000 7fe1317fa700 1 -- 172.21.15.80:0/3690252928 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe11c031a80 con 0x7fe134104c10 2019-11-28T11:25:14.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.403+0000 7fe138817700 1 --2- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe118018770 0x7fe11801ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:14.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.403+0000 7fe138817700 1 --2- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe118018770 0x7fe11801ac00 crc :-1 s=READY pgs=40 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:14.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.410+0000 7fe13a27a700 1 -- 172.21.15.80:0/3690252928 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe134109e10 con 0x7fe134104c10 2019-11-28T11:25:14.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.414+0000 7fe133fff700 1 --2- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe134104c10 0x7fe1341050a0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fe11c0103a0 tx=0x7fe11c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.414+0000 7fe1317fa700 1 -- 172.21.15.80:0/3690252928 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe11c009580 con 0x7fe134104c10 2019-11-28T11:25:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.581+0000 7fe13a27a700 1 -- 172.21.15.80:0/3690252928 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe134109a90 con 0x7fe134104c10 2019-11-28T11:25:14.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.581+0000 7fe133fff700 1 --2- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe134104c10 0x7fe1341050a0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fe11c0103a0 tx=0x7fe11c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.581+0000 7fe1317fa700 1 -- 172.21.15.80:0/3690252928 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+64 (secure 0 0 0) 0x7fe11c009830 con 0x7fe134104c10 2019-11-28T11:25:14.601 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:14.601 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:25:14.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:14.601 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:25:14.602 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:25:14.602 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:14.602 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:25:14.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.584+0000 7fe13a27a700 1 -- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe118018770 msgr2=0x7fe11801ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:14.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.584+0000 7fe13a27a700 1 --2- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe118018770 0x7fe11801ac00 crc :-1 s=READY pgs=40 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:14.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.584+0000 7fe13a27a700 1 -- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe134104c10 msgr2=0x7fe1341050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.584+0000 7fe13a27a700 1 --2- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe134104c10 0x7fe1341050a0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fe11c0103a0 tx=0x7fe11c010740).stop 2019-11-28T11:25:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.584+0000 7fe13a27a700 1 -- 172.21.15.80:0/3690252928 shutdown_connections 2019-11-28T11:25:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.584+0000 7fe13a27a700 1 --2- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe134104c10 0x7fe1341050a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.584+0000 7fe13a27a700 1 --2- 172.21.15.80:0/3690252928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe118018770 0x7fe11801ac00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.584+0000 7fe13a27a700 1 -- 172.21.15.80:0/3690252928 shutdown_connections 2019-11-28T11:25:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.584+0000 7fe13a27a700 1 -- 172.21.15.80:0/3690252928 wait complete. 2019-11-28T11:25:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.584+0000 7fe13a27a700 1 -- 172.21.15.80:0/3690252928 >> 172.21.15.80:0/3690252928 conn(0x7fe13413d620 msgr2=0x7fe13413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:14.613 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:25:14.613 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:25:14.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.716+0000 7f3173fc2700 1 Processor -- start 2019-11-28T11:25:14.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.716+0000 7f3173fc2700 1 -- start start 2019-11-28T11:25:14.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.717+0000 7f3173fc2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f316c1639f0 0x7f316c165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:14.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.717+0000 7f3173fc2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316c06db60 con 0x7f316c15ed10 2019-11-28T11:25:14.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.717+0000 7f3173fc2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316c06e060 con 0x7f316c15f100 2019-11-28T11:25:14.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.717+0000 7f3173fc2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316c06fe00 con 0x7f316c1639f0 2019-11-28T11:25:14.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.717+0000 7f3172d60700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f316c1639f0 0x7f316c165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:14.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.717+0000 7f3172d60700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f316c1639f0 0x7f316c165df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59036/0 (socket says 172.21.15.80:59036) 2019-11-28T11:25:14.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.717+0000 7f3172d60700 1 -- 172.21.15.80:0/1628485907 learned_addr learned my addr 172.21.15.80:0/1628485907 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:14.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.717+0000 7f317255f700 1 --1- 172.21.15.80:0/1628485907 >> v1:172.21.15.80:6789/0 conn(0x7f316c15ed10 0x7f316c073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58350/0 (socket says 172.21.15.80:58350) 2019-11-28T11:25:14.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.717+0000 7f3172d60700 1 -- 172.21.15.80:0/1628485907 >> v1:172.21.15.174:6789/0 conn(0x7f316c15f100 legacy=0x7f316c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:14.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.717+0000 7f3172d60700 1 -- 172.21.15.80:0/1628485907 >> v1:172.21.15.80:6789/0 conn(0x7f316c15ed10 legacy=0x7f316c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:14.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.717+0000 7f3172d60700 1 -- 172.21.15.80:0/1628485907 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c070760 con 0x7f316c1639f0 2019-11-28T11:25:14.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.717+0000 7f317155d700 1 -- 172.21.15.80:0/1628485907 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176590411 0 0) 0x7f3160001100 con 0x7f316c15ed10 2019-11-28T11:25:14.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.718+0000 7f3172d60700 1 --2- 172.21.15.80:0/1628485907 >> v2:172.21.15.80:3300/0 conn(0x7f316c1639f0 0x7f316c165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f316400f730 tx=0x7f316400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.718+0000 7f3172d60700 1 --2- 172.21.15.80:0/1628485907 >> v2:172.21.15.80:3300/0 conn(0x7f316c1639f0 0x7f316c165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f316400f730 tx=0x7f316400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.718+0000 7f3172d60700 1 --2- 172.21.15.80:0/1628485907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c1639f0 0x7f316c165df0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f316400f730 tx=0x7f316400fad0).ready entity=mon.0 client_cookie=d2f329c2e8ac443d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:14.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.718+0000 7f3172d60700 1 --2- 172.21.15.80:0/1628485907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c1639f0 0x7f316c165df0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f316400f730 tx=0x7f316400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.718+0000 7f317155d700 1 -- 172.21.15.80:0/1628485907 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3164000a70 con 0x7f316c1639f0 2019-11-28T11:25:14.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.718+0000 7f3172d60700 1 --2- 172.21.15.80:0/1628485907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c1639f0 0x7f316c165df0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f316400f730 tx=0x7f316400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.718+0000 7f3172d60700 1 --2- 172.21.15.80:0/1628485907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c1639f0 0x7f316c165df0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f316400f730 tx=0x7f316400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.718+0000 7f317155d700 1 -- 172.21.15.80:0/1628485907 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31640010e0 con 0x7f316c1639f0 2019-11-28T11:25:14.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.718+0000 7f317155d700 1 -- 172.21.15.80:0/1628485907 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31640017b0 con 0x7f316c1639f0 2019-11-28T11:25:14.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.718+0000 7f3173fc2700 1 -- 172.21.15.80:0/1628485907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c1639f0 msgr2=0x7f316c165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:14.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.718+0000 7f3173fc2700 1 --2- 172.21.15.80:0/1628485907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c1639f0 0x7f316c165df0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f316400f730 tx=0x7f316400fad0).stop 2019-11-28T11:25:14.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.719+0000 7f3173fc2700 1 -- 172.21.15.80:0/1628485907 shutdown_connections 2019-11-28T11:25:14.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.719+0000 7f3173fc2700 1 --2- 172.21.15.80:0/1628485907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c1639f0 0x7f316c165df0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:14.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.719+0000 7f3173fc2700 1 -- 172.21.15.80:0/1628485907 shutdown_connections 2019-11-28T11:25:14.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.719+0000 7f3173fc2700 1 -- 172.21.15.80:0/1628485907 wait complete. 2019-11-28T11:25:14.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.719+0000 7f3173fc2700 1 -- 172.21.15.80:0/1628485907 >> 172.21.15.80:0/1628485907 conn(0x7f316c061d20 msgr2=0x7f316c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:14.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.721+0000 7f3173fc2700 1 Processor -- start 2019-11-28T11:25:14.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.721+0000 7f3173fc2700 1 -- start start 2019-11-28T11:25:14.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3173fc2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f316c10ed60 0x7f316c10f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:14.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3173fc2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f316c10f730 0x7f316c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:14.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3173fc2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316c10c250 con 0x7f316c10e970 2019-11-28T11:25:14.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3173fc2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316c10e430 con 0x7f316c10ed60 2019-11-28T11:25:14.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3173fc2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316c105860 con 0x7f316c10f730 2019-11-28T11:25:14.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3171d5e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f316c10ed60 0x7f316c10f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:14.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3171d5e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f316c10ed60 0x7f316c10f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59042/0 (socket says 172.21.15.80:59042) 2019-11-28T11:25:14.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3171d5e700 1 -- 172.21.15.80:0/1344188888 learned_addr learned my addr 172.21.15.80:0/1344188888 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:14.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3172d60700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f316c10f730 0x7f316c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:14.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3171d5e700 1 -- 172.21.15.80:0/1344188888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f316c10f730 msgr2=0x7f316c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:14.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3171d5e700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f316c10f730 0x7f316c167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:14.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3171d5e700 1 -- 172.21.15.80:0/1344188888 >> v1:172.21.15.174:6789/0 conn(0x7f316c10e970 legacy=0x7f316c1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:14.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3171d5e700 1 -- 172.21.15.80:0/1344188888 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c105ef0 con 0x7f316c10ed60 2019-11-28T11:25:14.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3171d5e700 1 --2- 172.21.15.80:0/1344188888 >> v2:172.21.15.80:3300/0 conn(0x7f316c10ed60 0x7f316c10f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f315c010790 tx=0x7f315c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3171d5e700 1 --2- 172.21.15.80:0/1344188888 >> v2:172.21.15.80:3300/0 conn(0x7f316c10ed60 0x7f316c10f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f315c010790 tx=0x7f315c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3171d5e700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c10ed60 0x7f316c10f1f0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f315c010790 tx=0x7f315c0105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:14.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3171d5e700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c10ed60 0x7f316c10f1f0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f315c010790 tx=0x7f315c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3171d5e700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c10ed60 0x7f316c10f1f0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f315c010790 tx=0x7f315c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f3171d5e700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c10ed60 0x7f316c10f1f0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f315c010790 tx=0x7f315c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f316affd700 1 -- 172.21.15.80:0/1344188888 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f315c000f90 con 0x7f316c10ed60 2019-11-28T11:25:14.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.722+0000 7f316affd700 1 -- 172.21.15.80:0/1344188888 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c001420 con 0x7f316c10ed60 2019-11-28T11:25:14.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.723+0000 7f3173fc2700 1 -- 172.21.15.80:0/1344188888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316c106270 con 0x7f316c10ed60 2019-11-28T11:25:14.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.723+0000 7f316affd700 1 -- 172.21.15.80:0/1344188888 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f315c001b70 con 0x7f316c10ed60 2019-11-28T11:25:14.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.723+0000 7f3173fc2700 1 -- 172.21.15.80:0/1344188888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316c105ef0 con 0x7f316c10ed60 2019-11-28T11:25:14.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.723+0000 7f3171d5e700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c10ed60 0x7f316c10f1f0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f315c010790 tx=0x7f315c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.724+0000 7f316affd700 1 -- 172.21.15.80:0/1344188888 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f315c001230 con 0x7f316c10ed60 2019-11-28T11:25:14.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.724+0000 7f3171d5e700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c10ed60 0x7f316c10f1f0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f315c010790 tx=0x7f315c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.724+0000 7f316affd700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f314c018730 0x7f314c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:14.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.724+0000 7f316affd700 1 -- 172.21.15.80:0/1344188888 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f315c031e90 con 0x7f316c10ed60 2019-11-28T11:25:14.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.724+0000 7f317255f700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f314c018730 0x7f314c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:14.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.724+0000 7f317255f700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f314c018730 0x7f314c01abc0 crc :-1 s=READY pgs=41 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:14.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.731+0000 7f3173fc2700 1 -- 172.21.15.80:0/1344188888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316c106270 con 0x7f316c10ed60 2019-11-28T11:25:14.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.735+0000 7f3171d5e700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c10ed60 0x7f316c10f1f0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f315c010790 tx=0x7f315c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:14.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.735+0000 7f316affd700 1 -- 172.21.15.80:0/1344188888 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f315c000cc0 con 0x7f316c10ed60 2019-11-28T11:25:14.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:14.902+0000 7f3173fc2700 1 -- 172.21.15.80:0/1344188888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f316c105ef0 con 0x7f316c10ed60 2019-11-28T11:25:15.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.553+0000 7f3171d5e700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c10ed60 0x7f316c10f1f0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f315c010790 tx=0x7f315c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:15.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.553+0000 7f316affd700 1 -- 172.21.15.80:0/1344188888 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7f315c000cc0 con 0x7f316c10ed60 2019-11-28T11:25:15.586 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:25:15.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.569+0000 7f3173fc2700 1 -- 172.21.15.80:0/1344188888 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f314c018730 msgr2=0x7f314c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:15.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.569+0000 7f3173fc2700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f314c018730 0x7f314c01abc0 crc :-1 s=READY pgs=41 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:15.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.569+0000 7f3173fc2700 1 -- 172.21.15.80:0/1344188888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c10ed60 msgr2=0x7f316c10f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:15.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.569+0000 7f3173fc2700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c10ed60 0x7f316c10f1f0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f315c010790 tx=0x7f315c0105f0).stop 2019-11-28T11:25:15.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.569+0000 7f3173fc2700 1 -- 172.21.15.80:0/1344188888 shutdown_connections 2019-11-28T11:25:15.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.569+0000 7f3173fc2700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f316c10f730 0x7f316c167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:15.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.569+0000 7f3173fc2700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f316c10ed60 0x7f316c10f1f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:15.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.569+0000 7f3173fc2700 1 --2- 172.21.15.80:0/1344188888 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f314c018730 0x7f314c01abc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:15.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.569+0000 7f3173fc2700 1 -- 172.21.15.80:0/1344188888 shutdown_connections 2019-11-28T11:25:15.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.569+0000 7f3173fc2700 1 -- 172.21.15.80:0/1344188888 wait complete. 2019-11-28T11:25:15.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.569+0000 7f3173fc2700 1 -- 172.21.15.80:0/1344188888 >> 172.21.15.80:0/1344188888 conn(0x7f316c15e2d0 msgr2=0x7f316c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:15.598 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2019-11-28T11:25:15.598 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2019-11-28T11:25:15.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.710+0000 7fb4ebeb0700 1 Processor -- start 2019-11-28T11:25:15.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.710+0000 7fb4ebeb0700 1 -- start start 2019-11-28T11:25:15.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.711+0000 7fb4ebeb0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4e415ed10 0x7fb4e415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:15.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.711+0000 7fb4ebeb0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e406db60 con 0x7fb4e4073020 2019-11-28T11:25:15.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.711+0000 7fb4ebeb0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e406e060 con 0x7fb4e40734b0 2019-11-28T11:25:15.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.711+0000 7fb4ebeb0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e406f3d0 con 0x7fb4e415ed10 2019-11-28T11:25:15.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e9c4c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb4e4073020 0x7fb4e4071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58368/0 (socket says 172.21.15.80:58368) 2019-11-28T11:25:15.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e9c4c700 1 -- 172.21.15.80:0/779432300 learned_addr learned my addr 172.21.15.80:0/779432300 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:15.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4ea44d700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4e415ed10 0x7fb4e415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:15.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e944b700 1 -- 172.21.15.80:0/779432300 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685646198 0 0) 0x7fb4d4001070 con 0x7fb4e4073020 2019-11-28T11:25:15.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e944b700 1 -- 172.21.15.80:0/779432300 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4d0002e80 con 0x7fb4e4073020 2019-11-28T11:25:15.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e944b700 1 -- 172.21.15.80:0/779432300 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3570625225 0 0) 0x7fb4d4001050 con 0x7fb4e4073020 2019-11-28T11:25:15.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e944b700 1 -- 172.21.15.80:0/779432300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4e415ed10 msgr2=0x7fb4e415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:15.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e944b700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4e415ed10 0x7fb4e415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:15.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e944b700 1 -- 172.21.15.80:0/779432300 >> v1:172.21.15.174:6789/0 conn(0x7fb4e40734b0 legacy=0x7fb4e40726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:15.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e944b700 1 -- 172.21.15.80:0/779432300 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e4070760 con 0x7fb4e4073020 2019-11-28T11:25:15.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e944b700 1 -- 172.21.15.80:0/779432300 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fb4d4001580 con 0x7fb4e4073020 2019-11-28T11:25:15.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e944b700 1 -- 172.21.15.80:0/779432300 >> v1:172.21.15.80:6789/0 conn(0x7fb4e4073020 legacy=0x7fb4e4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:15.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e944b700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d0003ab0 0x7fb4d0005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:15.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e944b700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4d0006690 0x7fb4d0008af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:15.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e944b700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4d00092f0 0x7fb4d000b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:15.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e944b700 1 -- 172.21.15.80:0/779432300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d000bfd0 con 0x7fb4d0003ab0 2019-11-28T11:25:15.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4ea44d700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d0003ab0 0x7fb4d0005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:15.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e944b700 1 -- 172.21.15.80:0/779432300 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d00501d0 con 0x7fb4d00092f0 2019-11-28T11:25:15.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e944b700 1 -- 172.21.15.80:0/779432300 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d0050400 con 0x7fb4d0006690 2019-11-28T11:25:15.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4e9c4c700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4d0006690 0x7fb4d0008af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:15.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.712+0000 7fb4eac4e700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4d00092f0 0x7fb4d000b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:15.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4ea44d700 1 -- 172.21.15.80:0/779432300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4d0006690 msgr2=0x7fb4d0008af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:15.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4ea44d700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4d0006690 0x7fb4d0008af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:15.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4ea44d700 1 -- 172.21.15.80:0/779432300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4d00092f0 msgr2=0x7fb4d000b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:15.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4ea44d700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4d00092f0 0x7fb4d000b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:15.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4ea44d700 1 -- 172.21.15.80:0/779432300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d00506b0 con 0x7fb4d0003ab0 2019-11-28T11:25:15.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4ea44d700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d0003ab0 0x7fb4d0005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb4dc00b3b0 tx=0x7fb4dc00b6b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:15.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4ea44d700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d0003ab0 0x7fb4d0005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb4dc00b3b0 tx=0x7fb4dc00b6b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:15.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4ea44d700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d0003ab0 0x7fb4d0005f10 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7fb4dc00b3b0 tx=0x7fb4dc00b6b0).ready entity=mon.0 client_cookie=f5025f228961f4ed server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:15.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4ea44d700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d0003ab0 0x7fb4d0005f10 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fb4dc00b3b0 tx=0x7fb4dc00b6b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:15.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4e944b700 1 -- 172.21.15.80:0/779432300 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4dc0058e0 con 0x7fb4d0003ab0 2019-11-28T11:25:15.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4ea44d700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d0003ab0 0x7fb4d0005f10 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fb4dc00b3b0 tx=0x7fb4dc00b6b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:15.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4ea44d700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d0003ab0 0x7fb4d0005f10 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fb4dc00b3b0 tx=0x7fb4dc00b6b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:15.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4e944b700 1 -- 172.21.15.80:0/779432300 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc005500 con 0x7fb4d0003ab0 2019-11-28T11:25:15.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4e944b700 1 -- 172.21.15.80:0/779432300 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4dc0056f0 con 0x7fb4d0003ab0 2019-11-28T11:25:15.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4ebeb0700 1 -- 172.21.15.80:0/779432300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d0003ab0 msgr2=0x7fb4d0005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:15.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4ebeb0700 1 --2- 172.21.15.80:0/779432300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4d0003ab0 0x7fb4d0005f10 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7fb4dc00b3b0 tx=0x7fb4dc00b6b0).stop 2019-11-28T11:25:15.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.713+0000 7fb4eac4e700 1 -- 172.21.15.80:0/779432300 reap_dead start 2019-11-28T11:25:15.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.714+0000 7fb4ebeb0700 1 -- 172.21.15.80:0/779432300 shutdown_connections 2019-11-28T11:25:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.714+0000 7fb4ebeb0700 1 -- 172.21.15.80:0/779432300 shutdown_connections 2019-11-28T11:25:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.714+0000 7fb4ebeb0700 1 -- 172.21.15.80:0/779432300 wait complete. 2019-11-28T11:25:15.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.714+0000 7fb4ebeb0700 1 -- 172.21.15.80:0/779432300 >> 172.21.15.80:0/779432300 conn(0x7fb4e4061d20 msgr2=0x7fb4e40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.716+0000 7fb4ebeb0700 1 Processor -- start 2019-11-28T11:25:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.716+0000 7fb4ebeb0700 1 -- start start 2019-11-28T11:25:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.717+0000 7fb4ebeb0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb4e41502e0 0x7fb4e4150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:15.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.717+0000 7fb4ebeb0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4e4150cb0 0x7fb4e4167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:15.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.717+0000 7fb4ebeb0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e4133a20 con 0x7fb4e4108630 2019-11-28T11:25:15.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.717+0000 7fb4ebeb0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e4131980 con 0x7fb4e41502e0 2019-11-28T11:25:15.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.717+0000 7fb4ebeb0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4131c50 con 0x7fb4e4150cb0 2019-11-28T11:25:15.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.717+0000 7fb4ea44d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb4e4108630 0x7fb4e4151200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58376/0 (socket says 172.21.15.80:58376) 2019-11-28T11:25:15.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.717+0000 7fb4ea44d700 1 -- 172.21.15.80:0/1892960760 learned_addr learned my addr 172.21.15.80:0/1892960760 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:15.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.717+0000 7fb4e9c4c700 1 --2- 172.21.15.80:0/1892960760 >> v2:172.21.15.80:3300/0 conn(0x7fb4e41502e0 0x7fb4e4150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:15.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.717+0000 7fb4eac4e700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4e4150cb0 0x7fb4e4167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:15.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.717+0000 7fb4e9c4c700 1 -- 172.21.15.80:0/1892960760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4e4150cb0 msgr2=0x7fb4e4167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:15.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.717+0000 7fb4e9c4c700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4e4150cb0 0x7fb4e4167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:15.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.717+0000 7fb4e9c4c700 1 -- 172.21.15.80:0/1892960760 >> v1:172.21.15.80:6789/0 conn(0x7fb4e4108630 legacy=0x7fb4e4151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:15.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.717+0000 7fb4e2ffd700 1 -- 172.21.15.80:0/1892960760 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289903434 0 0) 0x7fb4dc005b30 con 0x7fb4e4108630 2019-11-28T11:25:15.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.717+0000 7fb4e9c4c700 1 -- 172.21.15.80:0/1892960760 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e41322e0 con 0x7fb4e41502e0 2019-11-28T11:25:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.717+0000 7fb4e9c4c700 1 --2- 172.21.15.80:0/1892960760 >> v2:172.21.15.80:3300/0 conn(0x7fb4e41502e0 0x7fb4e4150770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb4d40103a0 tx=0x7fb4d40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.718+0000 7fb4e9c4c700 1 --2- 172.21.15.80:0/1892960760 >> v2:172.21.15.80:3300/0 conn(0x7fb4e41502e0 0x7fb4e4150770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb4d40103a0 tx=0x7fb4d40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.718+0000 7fb4e9c4c700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4e41502e0 0x7fb4e4150770 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fb4d40103a0 tx=0x7fb4d40101d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:15.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.718+0000 7fb4e9c4c700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4e41502e0 0x7fb4e4150770 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fb4d40103a0 tx=0x7fb4d40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:15.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.718+0000 7fb4e2ffd700 1 -- 172.21.15.80:0/1892960760 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4d4000c90 con 0x7fb4e41502e0 2019-11-28T11:25:15.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.718+0000 7fb4e9c4c700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4e41502e0 0x7fb4e4150770 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fb4d40103a0 tx=0x7fb4d40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:15.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.718+0000 7fb4e9c4c700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4e41502e0 0x7fb4e4150770 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fb4d40103a0 tx=0x7fb4d40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:15.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.718+0000 7fb4e2ffd700 1 -- 172.21.15.80:0/1892960760 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d4000e90 con 0x7fb4e41502e0 2019-11-28T11:25:15.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.718+0000 7fb4e2ffd700 1 -- 172.21.15.80:0/1892960760 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4d4000c90 con 0x7fb4e41502e0 2019-11-28T11:25:15.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.718+0000 7fb4ebeb0700 1 -- 172.21.15.80:0/1892960760 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e4132660 con 0x7fb4e41502e0 2019-11-28T11:25:15.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.718+0000 7fb4ebeb0700 1 -- 172.21.15.80:0/1892960760 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e41322e0 con 0x7fb4e41502e0 2019-11-28T11:25:15.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.718+0000 7fb4e9c4c700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4e41502e0 0x7fb4e4150770 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fb4d40103a0 tx=0x7fb4d40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:15.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.719+0000 7fb4e2ffd700 1 -- 172.21.15.80:0/1892960760 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb4d4000c90 con 0x7fb4e41502e0 2019-11-28T11:25:15.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.719+0000 7fb4e9c4c700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4e41502e0 0x7fb4e4150770 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fb4d40103a0 tx=0x7fb4d40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:15.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.719+0000 7fb4e2ffd700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb4c8018730 0x7fb4c801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:15.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.719+0000 7fb4e2ffd700 1 -- 172.21.15.80:0/1892960760 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5207+0+0 (secure 0 0 0) 0x7fb4d40319c0 con 0x7fb4e41502e0 2019-11-28T11:25:15.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.719+0000 7fb4ea44d700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb4c8018730 0x7fb4c801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:15.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.719+0000 7fb4ea44d700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb4c8018730 0x7fb4c801abc0 crc :-1 s=READY pgs=42 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:15.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.726+0000 7fb4ebeb0700 1 -- 172.21.15.80:0/1892960760 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e4132660 con 0x7fb4e41502e0 2019-11-28T11:25:15.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.729+0000 7fb4e9c4c700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4e41502e0 0x7fb4e4150770 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fb4d40103a0 tx=0x7fb4d40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:15.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.730+0000 7fb4e2ffd700 1 -- 172.21.15.80:0/1892960760 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb4d4001270 con 0x7fb4e41502e0 2019-11-28T11:25:15.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:15.899+0000 7fb4ebeb0700 1 -- 172.21.15.80:0/1892960760 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"profile": ["m=2", "k=2", "crush-failure-domain=osd"], "prefix": "osd erasure-code-profile set", "name": "cephfs_data"} v 0) v1 -- 0x7fb4e41322e0 con 0x7fb4e41502e0 2019-11-28T11:25:16.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.557+0000 7fb4e9c4c700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4e41502e0 0x7fb4e4150770 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fb4d40103a0 tx=0x7fb4d40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:16.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.557+0000 7fb4e2ffd700 1 -- 172.21.15.80:0/1892960760 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"profile": ["m=2", "k=2", "crush-failure-domain=osd"], "prefix": "osd erasure-code-profile set", "name": "cephfs_data"}]=0 v20) v1 ==== 154+0+0 (secure 0 0 0) 0x7fb4d4000c90 con 0x7fb4e41502e0 2019-11-28T11:25:16.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.567+0000 7fb4ebeb0700 1 -- 172.21.15.80:0/1892960760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb4c8018730 msgr2=0x7fb4c801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:16.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.567+0000 7fb4ebeb0700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb4c8018730 0x7fb4c801abc0 crc :-1 s=READY pgs=42 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:16.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.567+0000 7fb4ebeb0700 1 -- 172.21.15.80:0/1892960760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4e41502e0 msgr2=0x7fb4e4150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:16.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.567+0000 7fb4ebeb0700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4e41502e0 0x7fb4e4150770 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fb4d40103a0 tx=0x7fb4d40101d0).stop 2019-11-28T11:25:16.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.567+0000 7fb4ebeb0700 1 -- 172.21.15.80:0/1892960760 shutdown_connections 2019-11-28T11:25:16.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.567+0000 7fb4ebeb0700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb4c8018730 0x7fb4c801abc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:16.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.567+0000 7fb4ebeb0700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4e4150cb0 0x7fb4e4167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:16.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.567+0000 7fb4ebeb0700 1 --2- 172.21.15.80:0/1892960760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4e41502e0 0x7fb4e4150770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:16.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.567+0000 7fb4ebeb0700 1 -- 172.21.15.80:0/1892960760 shutdown_connections 2019-11-28T11:25:16.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.567+0000 7fb4ebeb0700 1 -- 172.21.15.80:0/1892960760 wait complete. 2019-11-28T11:25:16.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.567+0000 7fb4ebeb0700 1 -- 172.21.15.80:0/1892960760 >> 172.21.15.80:0/1892960760 conn(0x7fb4e414dbb0 msgr2=0x7fb4e4142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:16.597 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 erasure cephfs_data 2019-11-28T11:25:16.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.714+0000 7fd1ce71c700 1 Processor -- start 2019-11-28T11:25:16.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.714+0000 7fd1ce71c700 1 -- start start 2019-11-28T11:25:16.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.715+0000 7fd1ce71c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd1c815ed10 0x7fd1c815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:16.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.715+0000 7fd1ce71c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c806db60 con 0x7fd1c8073020 2019-11-28T11:25:16.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.715+0000 7fd1ce71c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c806e060 con 0x7fd1c80734b0 2019-11-28T11:25:16.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.715+0000 7fd1ce71c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c806fe00 con 0x7fd1c815ed10 2019-11-28T11:25:16.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.715+0000 7fd1cccb9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd1c815ed10 0x7fd1c815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:16.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.715+0000 7fd1cccb9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd1c815ed10 0x7fd1c815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59068/0 (socket says 172.21.15.80:59068) 2019-11-28T11:25:16.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.715+0000 7fd1c7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd1c8073020 0x7fd1c8071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58384/0 (socket says 172.21.15.80:58384) 2019-11-28T11:25:16.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.715+0000 7fd1cccb9700 1 -- 172.21.15.80:0/633870625 learned_addr learned my addr 172.21.15.80:0/633870625 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:16.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.715+0000 7fd1cccb9700 1 -- 172.21.15.80:0/633870625 >> v1:172.21.15.174:6789/0 conn(0x7fd1c80734b0 legacy=0x7fd1c80726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:16.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.715+0000 7fd1cccb9700 1 -- 172.21.15.80:0/633870625 >> v1:172.21.15.80:6789/0 conn(0x7fd1c8073020 legacy=0x7fd1c8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:16.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.715+0000 7fd1cccb9700 1 -- 172.21.15.80:0/633870625 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c8070760 con 0x7fd1c815ed10 2019-11-28T11:25:16.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.715+0000 7fd1cccb9700 1 --2- 172.21.15.80:0/633870625 >> v2:172.21.15.80:3300/0 conn(0x7fd1c815ed10 0x7fd1c815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd1b000f740 tx=0x7fd1b000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:16.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.715+0000 7fd1cccb9700 1 --2- 172.21.15.80:0/633870625 >> v2:172.21.15.80:3300/0 conn(0x7fd1c815ed10 0x7fd1c815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd1b000f740 tx=0x7fd1b000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:16.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.715+0000 7fd1cccb9700 1 --2- 172.21.15.80:0/633870625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c815ed10 0x7fd1c815f100 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fd1b000f740 tx=0x7fd1b000fae0).ready entity=mon.0 client_cookie=96190fc9b65553e6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:16.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.716+0000 7fd1cccb9700 1 --2- 172.21.15.80:0/633870625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c815ed10 0x7fd1c815f100 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fd1b000f740 tx=0x7fd1b000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:16.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.716+0000 7fd1cccb9700 1 --2- 172.21.15.80:0/633870625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c815ed10 0x7fd1c815f100 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fd1b000f740 tx=0x7fd1b000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:16.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.716+0000 7fd1c77fe700 1 -- 172.21.15.80:0/633870625 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1b0000960 con 0x7fd1c815ed10 2019-11-28T11:25:16.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.716+0000 7fd1cccb9700 1 --2- 172.21.15.80:0/633870625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c815ed10 0x7fd1c815f100 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fd1b000f740 tx=0x7fd1b000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:16.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.716+0000 7fd1c77fe700 1 -- 172.21.15.80:0/633870625 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b0000c90 con 0x7fd1c815ed10 2019-11-28T11:25:16.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.716+0000 7fd1c77fe700 1 -- 172.21.15.80:0/633870625 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1b0001360 con 0x7fd1c815ed10 2019-11-28T11:25:16.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.716+0000 7fd1ce71c700 1 -- 172.21.15.80:0/633870625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c815ed10 msgr2=0x7fd1c815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:16.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.716+0000 7fd1ce71c700 1 --2- 172.21.15.80:0/633870625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c815ed10 0x7fd1c815f100 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fd1b000f740 tx=0x7fd1b000fae0).stop 2019-11-28T11:25:16.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.716+0000 7fd1ce71c700 1 -- 172.21.15.80:0/633870625 shutdown_connections 2019-11-28T11:25:16.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.716+0000 7fd1ce71c700 1 --2- 172.21.15.80:0/633870625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c815ed10 0x7fd1c815f100 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:16.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.716+0000 7fd1ce71c700 1 -- 172.21.15.80:0/633870625 shutdown_connections 2019-11-28T11:25:16.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.716+0000 7fd1ce71c700 1 -- 172.21.15.80:0/633870625 wait complete. 2019-11-28T11:25:16.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.716+0000 7fd1ce71c700 1 -- 172.21.15.80:0/633870625 >> 172.21.15.80:0/633870625 conn(0x7fd1c8061d20 msgr2=0x7fd1c80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:16.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.719+0000 7fd1ce71c700 1 Processor -- start 2019-11-28T11:25:16.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.719+0000 7fd1ce71c700 1 -- start start 2019-11-28T11:25:16.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1ce71c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd1c8079370 0x7fd1c8077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:16.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1ce71c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c8078080 0x7fd1c812e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:16.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1ce71c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c8162b20 con 0x7fd1c8106870 2019-11-28T11:25:16.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1ce71c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c8075aa0 con 0x7fd1c8079370 2019-11-28T11:25:16.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1ce71c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c8075d70 con 0x7fd1c8078080 2019-11-28T11:25:16.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1cccb9700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd1c8106870 0x7fd1c8079b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:45700/0 (socket says 172.21.15.80:45700) 2019-11-28T11:25:16.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1cccb9700 1 -- 172.21.15.80:0/2694270724 learned_addr learned my addr 172.21.15.80:0/2694270724 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:16.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1cd4ba700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c8078080 0x7fd1c812e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:16.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1c7fff700 1 --2- 172.21.15.80:0/2694270724 >> v2:172.21.15.174:3300/0 conn(0x7fd1c8079370 0x7fd1c8077b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:16.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1c57fa700 1 -- 172.21.15.80:0/2694270724 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744322135 0 0) 0x7fd1b0007920 con 0x7fd1c8106870 2019-11-28T11:25:16.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1c57fa700 1 -- 172.21.15.80:0/2694270724 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1ac002e80 con 0x7fd1c8106870 2019-11-28T11:25:16.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1cd4ba700 1 -- 172.21.15.80:0/2694270724 >> v2:172.21.15.174:3300/0 conn(0x7fd1c8079370 msgr2=0x7fd1c8077b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:16.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1cd4ba700 1 --2- 172.21.15.80:0/2694270724 >> v2:172.21.15.174:3300/0 conn(0x7fd1c8079370 0x7fd1c8077b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:16.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1cd4ba700 1 -- 172.21.15.80:0/2694270724 >> v1:172.21.15.174:6789/0 conn(0x7fd1c8106870 legacy=0x7fd1c8079b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:16.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1cd4ba700 1 -- 172.21.15.80:0/2694270724 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c8076400 con 0x7fd1c8078080 2019-11-28T11:25:16.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1c7fff700 1 --2- 172.21.15.80:0/2694270724 >> v2:172.21.15.174:3300/0 conn(0x7fd1c8079370 0x7fd1c8077b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:16.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.720+0000 7fd1cd4ba700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c8078080 0x7fd1c812e340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd1c00103a0 tx=0x7fd1c0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:16.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.721+0000 7fd1cd4ba700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c8078080 0x7fd1c812e340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd1c00103a0 tx=0x7fd1c0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:16.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.721+0000 7fd1cd4ba700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c8078080 0x7fd1c812e340 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7fd1c00103a0 tx=0x7fd1c0010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:16.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.721+0000 7fd1cd4ba700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c8078080 0x7fd1c812e340 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fd1c00103a0 tx=0x7fd1c0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:16.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.721+0000 7fd1c57fa700 1 -- 172.21.15.80:0/2694270724 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1c0000960 con 0x7fd1c8078080 2019-11-28T11:25:16.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.721+0000 7fd1cd4ba700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c8078080 0x7fd1c812e340 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fd1c00103a0 tx=0x7fd1c0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:16.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.721+0000 7fd1ce71c700 1 -- 172.21.15.80:0/2694270724 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c8076780 con 0x7fd1c8078080 2019-11-28T11:25:16.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.721+0000 7fd1c57fa700 1 -- 172.21.15.80:0/2694270724 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c0000960 con 0x7fd1c8078080 2019-11-28T11:25:16.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.721+0000 7fd1cd4ba700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c8078080 0x7fd1c812e340 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fd1c00103a0 tx=0x7fd1c0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:16.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.721+0000 7fd1c57fa700 1 -- 172.21.15.80:0/2694270724 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1c0009c10 con 0x7fd1c8078080 2019-11-28T11:25:16.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.721+0000 7fd1ce71c700 1 -- 172.21.15.80:0/2694270724 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c8076400 con 0x7fd1c8078080 2019-11-28T11:25:16.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.721+0000 7fd1cd4ba700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c8078080 0x7fd1c812e340 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fd1c00103a0 tx=0x7fd1c0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:16.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.721+0000 7fd1c57fa700 1 -- 172.21.15.80:0/2694270724 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd1c0009830 con 0x7fd1c8078080 2019-11-28T11:25:16.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.721+0000 7fd1cd4ba700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c8078080 0x7fd1c812e340 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fd1c00103a0 tx=0x7fd1c0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:16.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.722+0000 7fd1c57fa700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1ac018770 0x7fd1ac01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:16.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.722+0000 7fd1c57fa700 1 -- 172.21.15.80:0/2694270724 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5463+0+0 (secure 0 0 0) 0x7fd1c0031a20 con 0x7fd1c8078080 2019-11-28T11:25:16.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.722+0000 7fd1cccb9700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1ac018770 0x7fd1ac01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:16.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.722+0000 7fd1cccb9700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1ac018770 0x7fd1ac01abe0 crc :-1 s=READY pgs=43 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:16.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.729+0000 7fd1ce71c700 1 -- 172.21.15.80:0/2694270724 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c8076780 con 0x7fd1c8078080 2019-11-28T11:25:16.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.733+0000 7fd1cd4ba700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c8078080 0x7fd1c812e340 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fd1c00103a0 tx=0x7fd1c0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:16.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.733+0000 7fd1c57fa700 1 -- 172.21.15.80:0/2694270724 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd1c0009580 con 0x7fd1c8078080 2019-11-28T11:25:16.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:16.901+0000 7fd1ce71c700 1 -- 172.21.15.80:0/2694270724 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"pool_type": "erasure", "prefix": "osd pool create", "pg_num": 8, "erasure_code_profile": "cephfs_data", "pool": "cephfs_data"} v 0) v1 -- 0x7fd1c8076400 con 0x7fd1c8078080 2019-11-28T11:25:17.532 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:25:17.538 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:25:17.566 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:25:17.594 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:25:17.599 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:25:17.603 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:25:18.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.561+0000 7fd1cd4ba700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c8078080 0x7fd1c812e340 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fd1c00103a0 tx=0x7fd1c0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:18.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.561+0000 7fd1c57fa700 1 -- 172.21.15.80:0/2694270724 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"pool_type": "erasure", "prefix": "osd pool create", "pg_num": 8, "erasure_code_profile": "cephfs_data", "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v22) v1 ==== 188+0+0 (secure 0 0 0) 0x7fd1c0009bc0 con 0x7fd1c8078080 2019-11-28T11:25:18.626 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:25:18.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.570+0000 7fd1ce71c700 1 -- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1ac018770 msgr2=0x7fd1ac01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:18.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.570+0000 7fd1ce71c700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1ac018770 0x7fd1ac01abe0 crc :-1 s=READY pgs=43 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:18.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.570+0000 7fd1ce71c700 1 -- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c8078080 msgr2=0x7fd1c812e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.570+0000 7fd1ce71c700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c8078080 0x7fd1c812e340 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7fd1c00103a0 tx=0x7fd1c0010740).stop 2019-11-28T11:25:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.570+0000 7fd1ce71c700 1 -- 172.21.15.80:0/2694270724 shutdown_connections 2019-11-28T11:25:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.570+0000 7fd1ce71c700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c8078080 0x7fd1c812e340 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:18.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.570+0000 7fd1ce71c700 1 --2- 172.21.15.80:0/2694270724 >> v2:172.21.15.174:3300/0 conn(0x7fd1c8079370 0x7fd1c8077b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:18.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.570+0000 7fd1ce71c700 1 --2- 172.21.15.80:0/2694270724 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1ac018770 0x7fd1ac01abe0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:18.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.570+0000 7fd1ce71c700 1 -- 172.21.15.80:0/2694270724 shutdown_connections 2019-11-28T11:25:18.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.570+0000 7fd1ce71c700 1 -- 172.21.15.80:0/2694270724 wait complete. 2019-11-28T11:25:18.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.570+0000 7fd1ce71c700 1 -- 172.21.15.80:0/2694270724 >> 172.21.15.80:0/2694270724 conn(0x7fd1c8166440 msgr2=0x7fd1c81494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:18.629 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true 2019-11-28T11:25:18.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.743+0000 7ff451582700 1 Processor -- start 2019-11-28T11:25:18.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.743+0000 7ff451582700 1 -- start start 2019-11-28T11:25:18.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.744+0000 7ff451582700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff44c15f100 0x7ff44c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:18.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.744+0000 7ff451582700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff44c06c2f0 0x7ff44c06c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:18.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.744+0000 7ff451582700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44c06db60 con 0x7ff44c15ed10 2019-11-28T11:25:18.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.744+0000 7ff451582700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c06fe00 con 0x7ff44c15f100 2019-11-28T11:25:18.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.744+0000 7ff451582700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0700d0 con 0x7ff44c06c2f0 2019-11-28T11:25:18.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.744+0000 7ff44bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff44c06c2f0 0x7ff44c06c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:18.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.744+0000 7ff44affd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff44c15f100 0x7ff44c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:18.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.744+0000 7ff44bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff44c06c2f0 0x7ff44c06c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:33110/0 (socket says 172.21.15.80:33110) 2019-11-28T11:25:18.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.744+0000 7ff44bfff700 1 -- 172.21.15.80:0/31489636 learned_addr learned my addr 172.21.15.80:0/31489636 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:18.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.744+0000 7ff44bfff700 1 -- 172.21.15.80:0/31489636 >> v2:172.21.15.174:3300/0 conn(0x7ff44c15f100 msgr2=0x7ff44c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:18.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.744+0000 7ff44bfff700 1 --2- 172.21.15.80:0/31489636 >> v2:172.21.15.174:3300/0 conn(0x7ff44c15f100 0x7ff44c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:18.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.744+0000 7ff44bfff700 1 -- 172.21.15.80:0/31489636 >> v1:172.21.15.174:6789/0 conn(0x7ff44c15ed10 legacy=0x7ff44c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:18.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.744+0000 7ff44bfff700 1 -- 172.21.15.80:0/31489636 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c070760 con 0x7ff44c06c2f0 2019-11-28T11:25:18.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.744+0000 7ff44bfff700 1 --2- 172.21.15.80:0/31489636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff44c06c2f0 0x7ff44c06c740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff44400f760 tx=0x7ff44400f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:18.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.745+0000 7ff44bfff700 1 --2- 172.21.15.80:0/31489636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff44c06c2f0 0x7ff44c06c740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff44400f760 tx=0x7ff44400f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:18.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.745+0000 7ff44bfff700 1 --2- 172.21.15.80:0/31489636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff44c06c2f0 0x7ff44c06c740 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7ff44400f760 tx=0x7ff44400f590).ready entity=mon.2 client_cookie=83aab32fe90b6cd4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:18.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.745+0000 7ff44bfff700 1 --2- 172.21.15.80:0/31489636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff44c06c2f0 0x7ff44c06c740 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7ff44400f760 tx=0x7ff44400f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:18.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.745+0000 7ff44a7fc700 1 -- 172.21.15.80:0/31489636 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff444000a70 con 0x7ff44c06c2f0 2019-11-28T11:25:18.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.745+0000 7ff44bfff700 1 --2- 172.21.15.80:0/31489636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff44c06c2f0 0x7ff44c06c740 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7ff44400f760 tx=0x7ff44400f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:18.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.745+0000 7ff44bfff700 1 --2- 172.21.15.80:0/31489636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff44c06c2f0 0x7ff44c06c740 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7ff44400f760 tx=0x7ff44400f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:18.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.745+0000 7ff44a7fc700 1 -- 172.21.15.80:0/31489636 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff444000e70 con 0x7ff44c06c2f0 2019-11-28T11:25:18.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.745+0000 7ff44a7fc700 1 -- 172.21.15.80:0/31489636 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff444001500 con 0x7ff44c06c2f0 2019-11-28T11:25:18.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.745+0000 7ff451582700 1 -- 172.21.15.80:0/31489636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff44c06c2f0 msgr2=0x7ff44c06c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:18.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.745+0000 7ff451582700 1 --2- 172.21.15.80:0/31489636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff44c06c2f0 0x7ff44c06c740 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7ff44400f760 tx=0x7ff44400f590).stop 2019-11-28T11:25:18.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.746+0000 7ff451582700 1 -- 172.21.15.80:0/31489636 shutdown_connections 2019-11-28T11:25:18.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.746+0000 7ff451582700 1 --2- 172.21.15.80:0/31489636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff44c06c2f0 0x7ff44c06c740 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:18.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.746+0000 7ff451582700 1 --2- 172.21.15.80:0/31489636 >> v2:172.21.15.174:3300/0 conn(0x7ff44c15f100 0x7ff44c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:18.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.746+0000 7ff451582700 1 -- 172.21.15.80:0/31489636 shutdown_connections 2019-11-28T11:25:18.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.746+0000 7ff451582700 1 -- 172.21.15.80:0/31489636 wait complete. 2019-11-28T11:25:18.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.746+0000 7ff451582700 1 -- 172.21.15.80:0/31489636 >> 172.21.15.80:0/31489636 conn(0x7ff44c061d20 msgr2=0x7ff44c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:18.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.748+0000 7ff451582700 1 Processor -- start 2019-11-28T11:25:18.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.748+0000 7ff451582700 1 -- start start 2019-11-28T11:25:18.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.749+0000 7ff451582700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff44c10e970 0x7ff44c1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:18.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.749+0000 7ff451582700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff44c107e30 0x7ff44c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:18.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.749+0000 7ff451582700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44c10c250 con 0x7ff44c108cf0 2019-11-28T11:25:18.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.749+0000 7ff451582700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c10e430 con 0x7ff44c107e30 2019-11-28T11:25:18.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.749+0000 7ff451582700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c105860 con 0x7ff44c10e970 2019-11-28T11:25:18.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.749+0000 7ff44bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff44c107e30 0x7ff44c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:18.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.749+0000 7ff44bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff44c107e30 0x7ff44c167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59090/0 (socket says 172.21.15.80:59090) 2019-11-28T11:25:18.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.749+0000 7ff44bfff700 1 -- 172.21.15.80:0/3817276122 learned_addr learned my addr 172.21.15.80:0/3817276122 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:18.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.749+0000 7ff44b7fe700 1 --2- 172.21.15.80:0/3817276122 >> v2:172.21.15.174:3300/0 conn(0x7ff44c10e970 0x7ff44c1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:18.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.749+0000 7ff44bfff700 1 -- 172.21.15.80:0/3817276122 >> v2:172.21.15.174:3300/0 conn(0x7ff44c10e970 msgr2=0x7ff44c1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:18.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.749+0000 7ff44bfff700 1 --2- 172.21.15.80:0/3817276122 >> v2:172.21.15.174:3300/0 conn(0x7ff44c10e970 0x7ff44c1087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:18.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.749+0000 7ff44bfff700 1 -- 172.21.15.80:0/3817276122 >> v1:172.21.15.174:6789/0 conn(0x7ff44c108cf0 legacy=0x7ff44c107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:18.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.749+0000 7ff443fff700 1 -- 172.21.15.80:0/3817276122 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758737185 0 0) 0x7ff434000c90 con 0x7ff44c108cf0 2019-11-28T11:25:18.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.749+0000 7ff44bfff700 1 -- 172.21.15.80:0/3817276122 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c105ef0 con 0x7ff44c107e30 2019-11-28T11:25:18.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.749+0000 7ff44bfff700 1 --2- 172.21.15.80:0/3817276122 >> v2:172.21.15.80:3300/0 conn(0x7ff44c107e30 0x7ff44c167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff444010470 tx=0x7ff4440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:18.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.750+0000 7ff44bfff700 1 --2- 172.21.15.80:0/3817276122 >> v2:172.21.15.80:3300/0 conn(0x7ff44c107e30 0x7ff44c167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff444010470 tx=0x7ff4440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:18.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.750+0000 7ff44bfff700 1 --2- 172.21.15.80:0/3817276122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff44c107e30 0x7ff44c167d70 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7ff444010470 tx=0x7ff4440102a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:18.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.750+0000 7ff44bfff700 1 --2- 172.21.15.80:0/3817276122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff44c107e30 0x7ff44c167d70 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7ff444010470 tx=0x7ff4440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:18.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.750+0000 7ff443fff700 1 -- 172.21.15.80:0/3817276122 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4440081b0 con 0x7ff44c107e30 2019-11-28T11:25:18.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.750+0000 7ff451582700 1 -- 172.21.15.80:0/3817276122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44c106270 con 0x7ff44c107e30 2019-11-28T11:25:18.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.750+0000 7ff44bfff700 1 --2- 172.21.15.80:0/3817276122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff44c107e30 0x7ff44c167d70 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7ff444010470 tx=0x7ff4440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:18.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.750+0000 7ff443fff700 1 -- 172.21.15.80:0/3817276122 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff444007e40 con 0x7ff44c107e30 2019-11-28T11:25:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.750+0000 7ff44bfff700 1 --2- 172.21.15.80:0/3817276122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff44c107e30 0x7ff44c167d70 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7ff444010470 tx=0x7ff4440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.750+0000 7ff451582700 1 -- 172.21.15.80:0/3817276122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44c105ef0 con 0x7ff44c107e30 2019-11-28T11:25:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.750+0000 7ff443fff700 1 -- 172.21.15.80:0/3817276122 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff444008250 con 0x7ff44c107e30 2019-11-28T11:25:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.750+0000 7ff44bfff700 1 --2- 172.21.15.80:0/3817276122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff44c107e30 0x7ff44c167d70 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7ff444010470 tx=0x7ff4440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.751+0000 7ff443fff700 1 -- 172.21.15.80:0/3817276122 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff444000e70 con 0x7ff44c107e30 2019-11-28T11:25:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.751+0000 7ff44bfff700 1 --2- 172.21.15.80:0/3817276122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff44c107e30 0x7ff44c167d70 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7ff444010470 tx=0x7ff4440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:18.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.751+0000 7ff443fff700 1 --2- 172.21.15.80:0/3817276122 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff424018730 0x7ff42401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:18.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.751+0000 7ff443fff700 1 -- 172.21.15.80:0/3817276122 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5915+0+0 (secure 0 0 0) 0x7ff444031ae0 con 0x7ff44c107e30 2019-11-28T11:25:18.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.751+0000 7ff44b7fe700 1 --2- 172.21.15.80:0/3817276122 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff424018730 0x7ff42401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:18.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.751+0000 7ff44b7fe700 1 --2- 172.21.15.80:0/3817276122 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff424018730 0x7ff42401abc0 crc :-1 s=READY pgs=44 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:18.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.758+0000 7ff451582700 1 -- 172.21.15.80:0/3817276122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44c106270 con 0x7ff44c107e30 2019-11-28T11:25:18.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.761+0000 7ff44bfff700 1 --2- 172.21.15.80:0/3817276122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff44c107e30 0x7ff44c167d70 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7ff444010470 tx=0x7ff4440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:18.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.761+0000 7ff443fff700 1 -- 172.21.15.80:0/3817276122 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff44402aff0 con 0x7ff44c107e30 2019-11-28T11:25:18.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:18.927+0000 7ff451582700 1 -- 172.21.15.80:0/3817276122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "allow_ec_overwrites", "prefix": "osd pool set", "pool": "cephfs_data", "val": "true"} v 0) v1 -- 0x7ff44c105ef0 con 0x7ff44c107e30 2019-11-28T11:25:19.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.562+0000 7ff44bfff700 1 --2- 172.21.15.80:0/3817276122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff44c107e30 0x7ff44c167d70 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7ff444010470 tx=0x7ff4440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:19.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.562+0000 7ff443fff700 1 -- 172.21.15.80:0/3817276122 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "allow_ec_overwrites", "prefix": "osd pool set", "pool": "cephfs_data", "val": "true"}]=0 set pool 3 allow_ec_overwrites to true v23) v1 ==== 166+0+0 (secure 0 0 0) 0x7ff444000e50 con 0x7ff44c107e30 2019-11-28T11:25:19.627 INFO:teuthology.orchestra.run.smithi080.stderr:set pool 3 allow_ec_overwrites to true 2019-11-28T11:25:19.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.594+0000 7ff451582700 1 -- 172.21.15.80:0/3817276122 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff424018730 msgr2=0x7ff42401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:19.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.594+0000 7ff451582700 1 --2- 172.21.15.80:0/3817276122 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff424018730 0x7ff42401abc0 crc :-1 s=READY pgs=44 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:19.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.594+0000 7ff451582700 1 -- 172.21.15.80:0/3817276122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff44c107e30 msgr2=0x7ff44c167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:19.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.594+0000 7ff451582700 1 --2- 172.21.15.80:0/3817276122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff44c107e30 0x7ff44c167d70 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7ff444010470 tx=0x7ff4440102a0).stop 2019-11-28T11:25:19.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.594+0000 7ff451582700 1 -- 172.21.15.80:0/3817276122 shutdown_connections 2019-11-28T11:25:19.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.594+0000 7ff451582700 1 --2- 172.21.15.80:0/3817276122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff44c107e30 0x7ff44c167d70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:19.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.594+0000 7ff451582700 1 --2- 172.21.15.80:0/3817276122 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff424018730 0x7ff42401abc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:19.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.594+0000 7ff451582700 1 --2- 172.21.15.80:0/3817276122 >> v2:172.21.15.174:3300/0 conn(0x7ff44c10e970 0x7ff44c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.594+0000 7ff451582700 1 -- 172.21.15.80:0/3817276122 shutdown_connections 2019-11-28T11:25:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.594+0000 7ff451582700 1 -- 172.21.15.80:0/3817276122 wait complete. 2019-11-28T11:25:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.594+0000 7ff451582700 1 -- 172.21.15.80:0/3817276122 >> 172.21.15.80:0/3817276122 conn(0x7ff44c15e2d0 msgr2=0x7ff44c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:19.640 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:25:19.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.744+0000 7f4200b74700 1 Processor -- start 2019-11-28T11:25:19.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.744+0000 7f4200b74700 1 -- start start 2019-11-28T11:25:19.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.745+0000 7f4200b74700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41fc1639f0 0x7f41fc165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:19.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.745+0000 7f4200b74700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41fc06db60 con 0x7f41fc15f100 2019-11-28T11:25:19.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.745+0000 7f4200b74700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41fc06e060 con 0x7f41fc15ed10 2019-11-28T11:25:19.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.745+0000 7f4200b74700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41fc06fe00 con 0x7f41fc1639f0 2019-11-28T11:25:19.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.745+0000 7f41fb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41fc1639f0 0x7f41fc165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:19.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.745+0000 7f41fa59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f41fc15f100 0x7f41fc06bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58414/0 (socket says 172.21.15.80:58414) 2019-11-28T11:25:19.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.745+0000 7f41fb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41fc1639f0 0x7f41fc165df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59096/0 (socket says 172.21.15.80:59096) 2019-11-28T11:25:19.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.745+0000 7f41fb59e700 1 -- 172.21.15.80:0/1306032950 learned_addr learned my addr 172.21.15.80:0/1306032950 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:19.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.745+0000 7f41fb59e700 1 -- 172.21.15.80:0/1306032950 >> v1:172.21.15.174:6789/0 conn(0x7f41fc15ed10 legacy=0x7f41fc073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:19.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.745+0000 7f41fb59e700 1 -- 172.21.15.80:0/1306032950 >> v1:172.21.15.80:6789/0 conn(0x7f41fc15f100 legacy=0x7f41fc06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:19.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.746+0000 7f41fb59e700 1 -- 172.21.15.80:0/1306032950 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc070760 con 0x7f41fc1639f0 2019-11-28T11:25:19.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.745+0000 7f41f9d9b700 1 -- 172.21.15.80:0/1306032950 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25106825 0 0) 0x7f41e4001070 con 0x7f41fc15f100 2019-11-28T11:25:19.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.746+0000 7f41fb59e700 1 --2- 172.21.15.80:0/1306032950 >> v2:172.21.15.80:3300/0 conn(0x7f41fc1639f0 0x7f41fc165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f41f400fab0 tx=0x7f41f400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:19.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.746+0000 7f41fb59e700 1 --2- 172.21.15.80:0/1306032950 >> v2:172.21.15.80:3300/0 conn(0x7f41fc1639f0 0x7f41fc165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f41f400fab0 tx=0x7f41f400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:19.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.746+0000 7f41fb59e700 1 --2- 172.21.15.80:0/1306032950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc1639f0 0x7f41fc165df0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f41f400fab0 tx=0x7f41f400fe50).ready entity=mon.0 client_cookie=ca2caa23cbfcb8a1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:19.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.746+0000 7f41fb59e700 1 --2- 172.21.15.80:0/1306032950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc1639f0 0x7f41fc165df0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f41f400fab0 tx=0x7f41f400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:19.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.746+0000 7f41f9d9b700 1 -- 172.21.15.80:0/1306032950 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41f4000df0 con 0x7f41fc1639f0 2019-11-28T11:25:19.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.746+0000 7f41fb59e700 1 --2- 172.21.15.80:0/1306032950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc1639f0 0x7f41fc165df0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f41f400fab0 tx=0x7f41f400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:19.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.746+0000 7f41fb59e700 1 --2- 172.21.15.80:0/1306032950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc1639f0 0x7f41fc165df0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f41f400fab0 tx=0x7f41f400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:19.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.746+0000 7f41f9d9b700 1 -- 172.21.15.80:0/1306032950 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f4001460 con 0x7f41fc1639f0 2019-11-28T11:25:19.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.746+0000 7f41f9d9b700 1 -- 172.21.15.80:0/1306032950 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41f4001b30 con 0x7f41fc1639f0 2019-11-28T11:25:19.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.746+0000 7f4200b74700 1 -- 172.21.15.80:0/1306032950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc1639f0 msgr2=0x7f41fc165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:19.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.746+0000 7f4200b74700 1 --2- 172.21.15.80:0/1306032950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc1639f0 0x7f41fc165df0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f41f400fab0 tx=0x7f41f400fe50).stop 2019-11-28T11:25:19.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.747+0000 7f4200b74700 1 -- 172.21.15.80:0/1306032950 shutdown_connections 2019-11-28T11:25:19.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.747+0000 7f4200b74700 1 --2- 172.21.15.80:0/1306032950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc1639f0 0x7f41fc165df0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:19.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.747+0000 7f4200b74700 1 -- 172.21.15.80:0/1306032950 shutdown_connections 2019-11-28T11:25:19.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.747+0000 7f4200b74700 1 -- 172.21.15.80:0/1306032950 wait complete. 2019-11-28T11:25:19.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.747+0000 7f4200b74700 1 -- 172.21.15.80:0/1306032950 >> 172.21.15.80:0/1306032950 conn(0x7f41fc061d20 msgr2=0x7f41fc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:19.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.749+0000 7f4200b74700 1 Processor -- start 2019-11-28T11:25:19.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.749+0000 7f4200b74700 1 -- start start 2019-11-28T11:25:19.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f4200b74700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f41fc10e970 0x7f41fc1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:19.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f4200b74700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41fc108cf0 0x7f41fc107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:19.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f4200b74700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41fc10c250 con 0x7f41fc107b70 2019-11-28T11:25:19.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f4200b74700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41fc10e430 con 0x7f41fc108cf0 2019-11-28T11:25:19.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f4200b74700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41fc105860 con 0x7f41fc10e970 2019-11-28T11:25:19.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f41fa59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41fc108cf0 0x7f41fc107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:19.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f41fa59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41fc108cf0 0x7f41fc107630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59102/0 (socket says 172.21.15.80:59102) 2019-11-28T11:25:19.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f41fa59c700 1 -- 172.21.15.80:0/1609017530 learned_addr learned my addr 172.21.15.80:0/1609017530 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:19.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f41fa59c700 1 -- 172.21.15.80:0/1609017530 >> v2:172.21.15.174:3300/0 conn(0x7f41fc10e970 msgr2=0x7f41fc1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:19.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f41fad9d700 1 --2- 172.21.15.80:0/1609017530 >> v2:172.21.15.174:3300/0 conn(0x7f41fc10e970 0x7f41fc1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:19.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f41fa59c700 1 --2- 172.21.15.80:0/1609017530 >> v2:172.21.15.174:3300/0 conn(0x7f41fc10e970 0x7f41fc1087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:19.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f41fa59c700 1 -- 172.21.15.80:0/1609017530 >> v1:172.21.15.174:6789/0 conn(0x7f41fc107b70 legacy=0x7f41fc10ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:19.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f41fa59c700 1 -- 172.21.15.80:0/1609017530 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc105ef0 con 0x7f41fc108cf0 2019-11-28T11:25:19.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f41fa59c700 1 --2- 172.21.15.80:0/1609017530 >> v2:172.21.15.80:3300/0 conn(0x7f41fc108cf0 0x7f41fc107630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41e4010440 tx=0x7f41e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:19.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f41fa59c700 1 --2- 172.21.15.80:0/1609017530 >> v2:172.21.15.80:3300/0 conn(0x7f41fc108cf0 0x7f41fc107630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41e4010440 tx=0x7f41e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:19.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f41fa59c700 1 --2- 172.21.15.80:0/1609017530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc108cf0 0x7f41fc107630 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f41e4010440 tx=0x7f41e4010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:19.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.750+0000 7f41fa59c700 1 --2- 172.21.15.80:0/1609017530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc108cf0 0x7f41fc107630 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f41e4010440 tx=0x7f41e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:19.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.751+0000 7f41fa59c700 1 --2- 172.21.15.80:0/1609017530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc108cf0 0x7f41fc107630 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f41e4010440 tx=0x7f41e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:19.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.751+0000 7f41f37fe700 1 -- 172.21.15.80:0/1609017530 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41e4000d50 con 0x7f41fc108cf0 2019-11-28T11:25:19.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.751+0000 7f41fa59c700 1 --2- 172.21.15.80:0/1609017530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc108cf0 0x7f41fc107630 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f41e4010440 tx=0x7f41e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:19.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.751+0000 7f41f37fe700 1 -- 172.21.15.80:0/1609017530 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e4003fe0 con 0x7f41fc108cf0 2019-11-28T11:25:19.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.751+0000 7f4200b74700 1 -- 172.21.15.80:0/1609017530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41fc106270 con 0x7f41fc108cf0 2019-11-28T11:25:19.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.751+0000 7f41f37fe700 1 -- 172.21.15.80:0/1609017530 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41e4004670 con 0x7f41fc108cf0 2019-11-28T11:25:19.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.751+0000 7f4200b74700 1 -- 172.21.15.80:0/1609017530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41fc105ef0 con 0x7f41fc108cf0 2019-11-28T11:25:19.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.751+0000 7f41fa59c700 1 --2- 172.21.15.80:0/1609017530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc108cf0 0x7f41fc107630 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f41e4010440 tx=0x7f41e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:19.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.751+0000 7f41f37fe700 1 -- 172.21.15.80:0/1609017530 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f41e4000d30 con 0x7f41fc108cf0 2019-11-28T11:25:19.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.751+0000 7f41fa59c700 1 --2- 172.21.15.80:0/1609017530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc108cf0 0x7f41fc107630 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f41e4010440 tx=0x7f41e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:19.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.751+0000 7f41f37fe700 1 --2- 172.21.15.80:0/1609017530 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f41d4018730 0x7f41d401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:19.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.751+0000 7f41f37fe700 1 -- 172.21.15.80:0/1609017530 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5915+0+0 (secure 0 0 0) 0x7f41e4031a90 con 0x7f41fc108cf0 2019-11-28T11:25:19.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.752+0000 7f41fad9d700 1 --2- 172.21.15.80:0/1609017530 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f41d4018730 0x7f41d401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:19.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.752+0000 7f41fad9d700 1 --2- 172.21.15.80:0/1609017530 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f41d4018730 0x7f41d401abc0 crc :-1 s=READY pgs=45 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:19.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.759+0000 7f4200b74700 1 -- 172.21.15.80:0/1609017530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41fc106270 con 0x7f41fc108cf0 2019-11-28T11:25:19.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.763+0000 7f41fa59c700 1 --2- 172.21.15.80:0/1609017530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc108cf0 0x7f41fc107630 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f41e4010440 tx=0x7f41e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:19.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.763+0000 7f41f37fe700 1 -- 172.21.15.80:0/1609017530 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f41e4000940 con 0x7f41fc108cf0 2019-11-28T11:25:19.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.930+0000 7f4200b74700 1 -- 172.21.15.80:0/1609017530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f41fc105ef0 con 0x7f41fc108cf0 2019-11-28T11:25:19.955 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:25:19.930+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:25:19.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.933+0000 7f41fa59c700 1 --2- 172.21.15.80:0/1609017530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc108cf0 0x7f41fc107630 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f41e4010440 tx=0x7f41e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:19.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.933+0000 7f41f37fe700 1 -- 172.21.15.80:0/1609017530 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 2 and data pool 3 v2) v1 ==== 172+0+0 (secure 0 0 0) 0x7f41e401f8b0 con 0x7f41fc108cf0 2019-11-28T11:25:19.962 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 2 and data pool 3 2019-11-28T11:25:19.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.939+0000 7f4200b74700 1 -- 172.21.15.80:0/1609017530 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f41d4018730 msgr2=0x7f41d401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:19.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.939+0000 7f4200b74700 1 --2- 172.21.15.80:0/1609017530 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f41d4018730 0x7f41d401abc0 crc :-1 s=READY pgs=45 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:19.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.939+0000 7f4200b74700 1 -- 172.21.15.80:0/1609017530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc108cf0 msgr2=0x7f41fc107630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:19.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.939+0000 7f4200b74700 1 --2- 172.21.15.80:0/1609017530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc108cf0 0x7f41fc107630 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f41e4010440 tx=0x7f41e4010270).stop 2019-11-28T11:25:19.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.940+0000 7f4200b74700 1 -- 172.21.15.80:0/1609017530 shutdown_connections 2019-11-28T11:25:19.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.940+0000 7f4200b74700 1 --2- 172.21.15.80:0/1609017530 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f41d4018730 0x7f41d401abc0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:19.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.940+0000 7f4200b74700 1 --2- 172.21.15.80:0/1609017530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41fc108cf0 0x7f41fc107630 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:19.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.940+0000 7f4200b74700 1 --2- 172.21.15.80:0/1609017530 >> v2:172.21.15.174:3300/0 conn(0x7f41fc10e970 0x7f41fc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:19.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.940+0000 7f4200b74700 1 -- 172.21.15.80:0/1609017530 shutdown_connections 2019-11-28T11:25:19.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.940+0000 7f4200b74700 1 -- 172.21.15.80:0/1609017530 wait complete. 2019-11-28T11:25:19.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:19.940+0000 7f4200b74700 1 -- 172.21.15.80:0/1609017530 >> 172.21.15.80:0/1609017530 conn(0x7f41fc15e2d0 msgr2=0x7f41fc147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:19.978 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:20.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.097+0000 7f6b484f7700 1 Processor -- start 2019-11-28T11:25:20.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.098+0000 7f6b484f7700 1 -- start start 2019-11-28T11:25:20.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b484f7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6b4006c490 0x7f6b4006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:20.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b484f7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6b4006ce60 0x7f6b40164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:20.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b484f7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4006db00 con 0x7f6b4006c0a0 2019-11-28T11:25:20.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b484f7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4006fd60 con 0x7f6b4006c490 2019-11-28T11:25:20.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b484f7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b40070030 con 0x7f6b4006ce60 2019-11-28T11:25:20.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b46293700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6b4006c490 0x7f6b4006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:20.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b46293700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6b4006c490 0x7f6b4006c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59110/0 (socket says 172.21.15.80:59110) 2019-11-28T11:25:20.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b46293700 1 -- 172.21.15.80:0/2180403164 learned_addr learned my addr 172.21.15.80:0/2180403164 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:20.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b47295700 1 --2- 172.21.15.80:0/2180403164 >> v2:172.21.15.174:3300/0 conn(0x7f6b4006ce60 0x7f6b40164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:20.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b46293700 1 -- 172.21.15.80:0/2180403164 >> v2:172.21.15.174:3300/0 conn(0x7f6b4006ce60 msgr2=0x7f6b40164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:20.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b46293700 1 --2- 172.21.15.80:0/2180403164 >> v2:172.21.15.174:3300/0 conn(0x7f6b4006ce60 0x7f6b40164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:20.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b46293700 1 -- 172.21.15.80:0/2180403164 >> v1:172.21.15.80:6789/0 conn(0x7f6b4006c0a0 legacy=0x7f6b40072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:20.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b45a92700 1 -- 172.21.15.80:0/2180403164 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853836657 0 0) 0x7f6b38001480 con 0x7f6b4006c0a0 2019-11-28T11:25:20.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b46293700 1 -- 172.21.15.80:0/2180403164 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b400706c0 con 0x7f6b4006c490 2019-11-28T11:25:20.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b46293700 1 --2- 172.21.15.80:0/2180403164 >> v2:172.21.15.80:3300/0 conn(0x7f6b4006c490 0x7f6b4006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6b3400f6c0 tx=0x7f6b3400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b46293700 1 --2- 172.21.15.80:0/2180403164 >> v2:172.21.15.80:3300/0 conn(0x7f6b4006c490 0x7f6b4006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6b3400f6c0 tx=0x7f6b3400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b46293700 1 --2- 172.21.15.80:0/2180403164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4006c490 0x7f6b4006c920 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f6b3400f6c0 tx=0x7f6b3400fa60).ready entity=mon.0 client_cookie=699db423bac5f157 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:20.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b46293700 1 --2- 172.21.15.80:0/2180403164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4006c490 0x7f6b4006c920 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6b3400f6c0 tx=0x7f6b3400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b45a92700 1 -- 172.21.15.80:0/2180403164 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b34000960 con 0x7f6b4006c490 2019-11-28T11:25:20.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b46293700 1 --2- 172.21.15.80:0/2180403164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4006c490 0x7f6b4006c920 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6b3400f6c0 tx=0x7f6b3400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b46293700 1 --2- 172.21.15.80:0/2180403164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4006c490 0x7f6b4006c920 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6b3400f6c0 tx=0x7f6b3400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b45a92700 1 -- 172.21.15.80:0/2180403164 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b34000c90 con 0x7f6b4006c490 2019-11-28T11:25:20.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.099+0000 7f6b45a92700 1 -- 172.21.15.80:0/2180403164 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b340013a0 con 0x7f6b4006c490 2019-11-28T11:25:20.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.100+0000 7f6b484f7700 1 -- 172.21.15.80:0/2180403164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4006c490 msgr2=0x7f6b4006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:20.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.100+0000 7f6b484f7700 1 --2- 172.21.15.80:0/2180403164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4006c490 0x7f6b4006c920 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f6b3400f6c0 tx=0x7f6b3400fa60).stop 2019-11-28T11:25:20.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.100+0000 7f6b484f7700 1 -- 172.21.15.80:0/2180403164 shutdown_connections 2019-11-28T11:25:20.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.100+0000 7f6b484f7700 1 --2- 172.21.15.80:0/2180403164 >> v2:172.21.15.174:3300/0 conn(0x7f6b4006ce60 0x7f6b40164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:20.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.100+0000 7f6b484f7700 1 --2- 172.21.15.80:0/2180403164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4006c490 0x7f6b4006c920 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:20.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.100+0000 7f6b484f7700 1 -- 172.21.15.80:0/2180403164 shutdown_connections 2019-11-28T11:25:20.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.100+0000 7f6b484f7700 1 -- 172.21.15.80:0/2180403164 wait complete. 2019-11-28T11:25:20.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.100+0000 7f6b484f7700 1 -- 172.21.15.80:0/2180403164 >> 172.21.15.80:0/2180403164 conn(0x7f6b40061cf0 msgr2=0x7f6b40064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:20.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.103+0000 7f6b484f7700 1 Processor -- start 2019-11-28T11:25:20.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.103+0000 7f6b484f7700 1 -- start start 2019-11-28T11:25:20.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.103+0000 7f6b484f7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6b40117650 0x7f6b40117ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.103+0000 7f6b484f7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4013e0c0 con 0x7f6b40118020 2019-11-28T11:25:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.103+0000 7f6b484f7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b401564e0 con 0x7f6b4013a850 2019-11-28T11:25:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.103+0000 7f6b484f7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b40155140 con 0x7f6b40117650 2019-11-28T11:25:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b46293700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6b40117650 0x7f6b40117ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b47295700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6b40118020 0x7f6b40168e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58432/0 (socket says 172.21.15.80:58432) 2019-11-28T11:25:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b47295700 1 -- 172.21.15.80:0/4209180957 learned_addr learned my addr 172.21.15.80:0/4209180957 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b46293700 1 -- 172.21.15.80:0/4209180957 >> v1:172.21.15.174:6789/0 conn(0x7f6b4013a850 legacy=0x7f6b40118760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:20.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b46293700 1 -- 172.21.15.80:0/4209180957 >> v1:172.21.15.80:6789/0 conn(0x7f6b40118020 legacy=0x7f6b40168e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:20.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b46293700 1 -- 172.21.15.80:0/4209180957 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b401557d0 con 0x7f6b40117650 2019-11-28T11:25:20.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b3f7fe700 1 -- 172.21.15.80:0/4209180957 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961437099 0 0) 0x7f6b30001150 con 0x7f6b40118020 2019-11-28T11:25:20.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b46293700 1 --2- 172.21.15.80:0/4209180957 >> v2:172.21.15.80:3300/0 conn(0x7f6b40117650 0x7f6b40117ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b340103a0 tx=0x7f6b34010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b46293700 1 --2- 172.21.15.80:0/4209180957 >> v2:172.21.15.80:3300/0 conn(0x7f6b40117650 0x7f6b40117ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b340103a0 tx=0x7f6b34010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b46293700 1 --2- 172.21.15.80:0/4209180957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b40117650 0x7f6b40117ae0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f6b340103a0 tx=0x7f6b34010740).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b46293700 1 --2- 172.21.15.80:0/4209180957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b40117650 0x7f6b40117ae0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f6b340103a0 tx=0x7f6b34010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b3f7fe700 1 -- 172.21.15.80:0/4209180957 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b340078e0 con 0x7f6b40117650 2019-11-28T11:25:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b46293700 1 --2- 172.21.15.80:0/4209180957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b40117650 0x7f6b40117ae0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f6b340103a0 tx=0x7f6b34010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b3f7fe700 1 -- 172.21.15.80:0/4209180957 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b34000e60 con 0x7f6b40117650 2019-11-28T11:25:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b484f7700 1 -- 172.21.15.80:0/4209180957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b40155b50 con 0x7f6b40117650 2019-11-28T11:25:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b46293700 1 --2- 172.21.15.80:0/4209180957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b40117650 0x7f6b40117ae0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f6b340103a0 tx=0x7f6b34010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b3f7fe700 1 -- 172.21.15.80:0/4209180957 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b340078e0 con 0x7f6b40117650 2019-11-28T11:25:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b484f7700 1 -- 172.21.15.80:0/4209180957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b401557d0 con 0x7f6b40117650 2019-11-28T11:25:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.104+0000 7f6b46293700 1 --2- 172.21.15.80:0/4209180957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b40117650 0x7f6b40117ae0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f6b340103a0 tx=0x7f6b34010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.105+0000 7f6b3f7fe700 1 -- 172.21.15.80:0/4209180957 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6b34007810 con 0x7f6b40117650 2019-11-28T11:25:20.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.105+0000 7f6b46293700 1 --2- 172.21.15.80:0/4209180957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b40117650 0x7f6b40117ae0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f6b340103a0 tx=0x7f6b34010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.105+0000 7f6b3f7fe700 1 --2- 172.21.15.80:0/4209180957 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6b20018730 0x7f6b2001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:20.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.105+0000 7f6b3f7fe700 1 -- 172.21.15.80:0/4209180957 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f6b34031a50 con 0x7f6b40117650 2019-11-28T11:25:20.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.105+0000 7f6b46a94700 1 --2- 172.21.15.80:0/4209180957 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6b20018730 0x7f6b2001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:20.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.105+0000 7f6b46a94700 1 --2- 172.21.15.80:0/4209180957 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6b20018730 0x7f6b2001abc0 crc :-1 s=READY pgs=46 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:20.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.113+0000 7f6b484f7700 1 -- 172.21.15.80:0/4209180957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b40155b50 con 0x7f6b40117650 2019-11-28T11:25:20.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.116+0000 7f6b46293700 1 --2- 172.21.15.80:0/4209180957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b40117650 0x7f6b40117ae0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f6b340103a0 tx=0x7f6b34010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.116+0000 7f6b3f7fe700 1 -- 172.21.15.80:0/4209180957 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6b34000c50 con 0x7f6b40117650 2019-11-28T11:25:20.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.290+0000 7f6b484f7700 1 -- 172.21.15.80:0/4209180957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b401557d0 con 0x7f6b40117650 2019-11-28T11:25:20.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.291+0000 7f6b46293700 1 --2- 172.21.15.80:0/4209180957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b40117650 0x7f6b40117ae0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f6b340103a0 tx=0x7f6b34010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.291+0000 7f6b3f7fe700 1 -- 172.21.15.80:0/4209180957 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14898 (secure 0 0 0) 0x7f6b34007810 con 0x7f6b40117650 2019-11-28T11:25:20.316 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:20.316 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:19.931551+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:25:14.914696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-11-28T11:25:17.566323+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:20.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.293+0000 7f6b484f7700 1 -- 172.21.15.80:0/4209180957 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6b20018730 msgr2=0x7f6b2001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:20.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.293+0000 7f6b484f7700 1 --2- 172.21.15.80:0/4209180957 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6b20018730 0x7f6b2001abc0 crc :-1 s=READY pgs=46 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:20.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.293+0000 7f6b484f7700 1 -- 172.21.15.80:0/4209180957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b40117650 msgr2=0x7f6b40117ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:20.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.293+0000 7f6b484f7700 1 --2- 172.21.15.80:0/4209180957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b40117650 0x7f6b40117ae0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f6b340103a0 tx=0x7f6b34010740).stop 2019-11-28T11:25:20.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.293+0000 7f6b484f7700 1 -- 172.21.15.80:0/4209180957 shutdown_connections 2019-11-28T11:25:20.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.293+0000 7f6b484f7700 1 --2- 172.21.15.80:0/4209180957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b40117650 0x7f6b40117ae0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:20.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.293+0000 7f6b484f7700 1 --2- 172.21.15.80:0/4209180957 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6b20018730 0x7f6b2001abc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:20.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.293+0000 7f6b484f7700 1 -- 172.21.15.80:0/4209180957 shutdown_connections 2019-11-28T11:25:20.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.293+0000 7f6b484f7700 1 -- 172.21.15.80:0/4209180957 wait complete. 2019-11-28T11:25:20.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.293+0000 7f6b484f7700 1 -- 172.21.15.80:0/4209180957 >> 172.21.15.80:0/4209180957 conn(0x7f6b4011a910 msgr2=0x7f6b401413c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:20.323 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:20.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.425+0000 7f2b13ce1700 1 Processor -- start 2019-11-28T11:25:20.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.425+0000 7f2b13ce1700 1 -- start start 2019-11-28T11:25:20.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.426+0000 7f2b13ce1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b0c06c0a0 0x7f2b0c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:20.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.426+0000 7f2b13ce1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b0c0734e0 0x7f2b0c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:20.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.426+0000 7f2b13ce1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2b0c072360 0x7f2b0c0727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:20.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.426+0000 7f2b13ce1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0c06f330 con 0x7f2b0c0734e0 2019-11-28T11:25:20.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.426+0000 7f2b13ce1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0c0706c0 con 0x7f2b0c072360 2019-11-28T11:25:20.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.426+0000 7f2b13ce1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c070a40 con 0x7f2b0c06c0a0 2019-11-28T11:25:20.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.426+0000 7f2b11a7d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b0c0734e0 0x7f2b0c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:20.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.426+0000 7f2b11a7d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b0c0734e0 0x7f2b0c071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59126/0 (socket says 172.21.15.80:59126) 2019-11-28T11:25:20.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.426+0000 7f2b11a7d700 1 -- 172.21.15.80:0/1987828631 learned_addr learned my addr 172.21.15.80:0/1987828631 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:20.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.426+0000 7f2b12a7f700 1 --2- 172.21.15.80:0/1987828631 >> v2:172.21.15.174:3300/0 conn(0x7f2b0c072360 0x7f2b0c0727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:20.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.426+0000 7f2b1227e700 1 --2- 172.21.15.80:0/1987828631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b0c06c0a0 0x7f2b0c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:20.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.427+0000 7f2b11a7d700 1 -- 172.21.15.80:0/1987828631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b0c06c0a0 msgr2=0x7f2b0c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:20.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.427+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1987828631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b0c06c0a0 0x7f2b0c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:20.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.427+0000 7f2b11a7d700 1 -- 172.21.15.80:0/1987828631 >> v2:172.21.15.174:3300/0 conn(0x7f2b0c072360 msgr2=0x7f2b0c0727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:20.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.427+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1987828631 >> v2:172.21.15.174:3300/0 conn(0x7f2b0c072360 0x7f2b0c0727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:20.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.427+0000 7f2b11a7d700 1 -- 172.21.15.80:0/1987828631 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c06db00 con 0x7f2b0c0734e0 2019-11-28T11:25:20.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.427+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1987828631 >> v2:172.21.15.80:3300/0 conn(0x7f2b0c0734e0 0x7f2b0c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2afc00f6c0 tx=0x7f2afc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.427+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1987828631 >> v2:172.21.15.80:3300/0 conn(0x7f2b0c0734e0 0x7f2b0c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2afc00f6c0 tx=0x7f2afc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.427+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1987828631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c0734e0 0x7f2b0c071e20 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f2afc00f6c0 tx=0x7f2afc00f570).ready entity=mon.0 client_cookie=6a5ffa015caebe4b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:20.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.427+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1987828631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c0734e0 0x7f2b0c071e20 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2afc00f6c0 tx=0x7f2afc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.427+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1987828631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c0734e0 0x7f2b0c071e20 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2afc00f6c0 tx=0x7f2afc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.427+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1987828631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c0734e0 0x7f2b0c071e20 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2afc00f6c0 tx=0x7f2afc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.427+0000 7f2b1127c700 1 -- 172.21.15.80:0/1987828631 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2afc000960 con 0x7f2b0c0734e0 2019-11-28T11:25:20.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.427+0000 7f2b1127c700 1 -- 172.21.15.80:0/1987828631 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc000c90 con 0x7f2b0c0734e0 2019-11-28T11:25:20.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.427+0000 7f2b1127c700 1 -- 172.21.15.80:0/1987828631 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2afc0013a0 con 0x7f2b0c0734e0 2019-11-28T11:25:20.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.427+0000 7f2b13ce1700 1 -- 172.21.15.80:0/1987828631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c0734e0 msgr2=0x7f2b0c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:20.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.427+0000 7f2b13ce1700 1 --2- 172.21.15.80:0/1987828631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c0734e0 0x7f2b0c071e20 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f2afc00f6c0 tx=0x7f2afc00f570).stop 2019-11-28T11:25:20.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.428+0000 7f2b13ce1700 1 -- 172.21.15.80:0/1987828631 shutdown_connections 2019-11-28T11:25:20.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.428+0000 7f2b13ce1700 1 --2- 172.21.15.80:0/1987828631 >> v2:172.21.15.174:3300/0 conn(0x7f2b0c072360 0x7f2b0c0727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:20.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.428+0000 7f2b13ce1700 1 --2- 172.21.15.80:0/1987828631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c0734e0 0x7f2b0c071e20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:20.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.428+0000 7f2b13ce1700 1 --2- 172.21.15.80:0/1987828631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b0c06c0a0 0x7f2b0c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:20.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.428+0000 7f2b13ce1700 1 -- 172.21.15.80:0/1987828631 shutdown_connections 2019-11-28T11:25:20.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.428+0000 7f2b13ce1700 1 -- 172.21.15.80:0/1987828631 wait complete. 2019-11-28T11:25:20.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.428+0000 7f2b13ce1700 1 -- 172.21.15.80:0/1987828631 >> 172.21.15.80:0/1987828631 conn(0x7f2b0c061cf0 msgr2=0x7f2b0c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:20.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.430+0000 7f2b13ce1700 1 Processor -- start 2019-11-28T11:25:20.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.430+0000 7f2b13ce1700 1 -- start start 2019-11-28T11:25:20.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.431+0000 7f2b13ce1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2b0c15fdf0 0x7f2b0c12b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:20.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.431+0000 7f2b13ce1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b0c12b8a0 0x7f2b0c13e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:20.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.431+0000 7f2b13ce1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0c139e00 con 0x7f2b0c13e860 2019-11-28T11:25:20.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.431+0000 7f2b13ce1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0c108820 con 0x7f2b0c12b8a0 2019-11-28T11:25:20.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.431+0000 7f2b13ce1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0c108af0 con 0x7f2b0c15fdf0 2019-11-28T11:25:20.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.431+0000 7f2b11a7d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b0c12b8a0 0x7f2b0c13e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:20.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.431+0000 7f2b11a7d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b0c12b8a0 0x7f2b0c13e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59128/0 (socket says 172.21.15.80:59128) 2019-11-28T11:25:20.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.431+0000 7f2b11a7d700 1 -- 172.21.15.80:0/1372700739 learned_addr learned my addr 172.21.15.80:0/1372700739 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:20.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.431+0000 7f2b1227e700 1 --2- 172.21.15.80:0/1372700739 >> v2:172.21.15.174:3300/0 conn(0x7f2b0c15fdf0 0x7f2b0c12b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:20.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b11a7d700 1 -- 172.21.15.80:0/1372700739 >> v2:172.21.15.174:3300/0 conn(0x7f2b0c15fdf0 msgr2=0x7f2b0c12b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:20.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1372700739 >> v2:172.21.15.174:3300/0 conn(0x7f2b0c15fdf0 0x7f2b0c12b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:20.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b11a7d700 1 -- 172.21.15.80:0/1372700739 >> v1:172.21.15.174:6789/0 conn(0x7f2b0c13e860 legacy=0x7f2b0c12a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:20.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b11a7d700 1 -- 172.21.15.80:0/1372700739 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c10a8c0 con 0x7f2b0c12b8a0 2019-11-28T11:25:20.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b1227e700 1 --2- 172.21.15.80:0/1372700739 >> v2:172.21.15.174:3300/0 conn(0x7f2b0c15fdf0 0x7f2b0c12b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:20.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1372700739 >> v2:172.21.15.80:3300/0 conn(0x7f2b0c12b8a0 0x7f2b0c13e320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2afc054470 tx=0x7f2afc054810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1372700739 >> v2:172.21.15.80:3300/0 conn(0x7f2b0c12b8a0 0x7f2b0c13e320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2afc054470 tx=0x7f2afc054810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1372700739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c12b8a0 0x7f2b0c13e320 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f2afc054470 tx=0x7f2afc054810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:20.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1372700739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c12b8a0 0x7f2b0c13e320 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f2afc054470 tx=0x7f2afc054810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1372700739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c12b8a0 0x7f2b0c13e320 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f2afc054470 tx=0x7f2afc054810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b0affd700 1 -- 172.21.15.80:0/1372700739 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2afc005180 con 0x7f2b0c12b8a0 2019-11-28T11:25:20.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1372700739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c12b8a0 0x7f2b0c13e320 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f2afc054470 tx=0x7f2afc054810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b0affd700 1 -- 172.21.15.80:0/1372700739 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc007d40 con 0x7f2b0c12b8a0 2019-11-28T11:25:20.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b13ce1700 1 -- 172.21.15.80:0/1372700739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0c10a8c0 con 0x7f2b0c12b8a0 2019-11-28T11:25:20.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b0affd700 1 -- 172.21.15.80:0/1372700739 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2afc005760 con 0x7f2b0c12b8a0 2019-11-28T11:25:20.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b13ce1700 1 -- 172.21.15.80:0/1372700739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0c10a8c0 con 0x7f2b0c12b8a0 2019-11-28T11:25:20.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.432+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1372700739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c12b8a0 0x7f2b0c13e320 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f2afc054470 tx=0x7f2afc054810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.433+0000 7f2b0affd700 1 -- 172.21.15.80:0/1372700739 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2afc005180 con 0x7f2b0c12b8a0 2019-11-28T11:25:20.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.433+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1372700739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c12b8a0 0x7f2b0c13e320 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f2afc054470 tx=0x7f2afc054810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.433+0000 7f2b0affd700 1 --2- 172.21.15.80:0/1372700739 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2af0018730 0x7f2af001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:20.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.433+0000 7f2b0affd700 1 -- 172.21.15.80:0/1372700739 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2afc075b00 con 0x7f2b0c12b8a0 2019-11-28T11:25:20.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.433+0000 7f2b1227e700 1 --2- 172.21.15.80:0/1372700739 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2af0018730 0x7f2af001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:20.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.433+0000 7f2b1227e700 1 --2- 172.21.15.80:0/1372700739 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2af0018730 0x7f2af001abc0 crc :-1 s=READY pgs=47 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:20.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.441+0000 7f2b13ce1700 1 -- 172.21.15.80:0/1372700739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0c109180 con 0x7f2b0c12b8a0 2019-11-28T11:25:20.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.445+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1372700739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c12b8a0 0x7f2b0c13e320 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f2afc054470 tx=0x7f2afc054810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.445+0000 7f2b0affd700 1 -- 172.21.15.80:0/1372700739 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2afc000940 con 0x7f2b0c12b8a0 2019-11-28T11:25:20.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.620+0000 7f2b13ce1700 1 -- 172.21.15.80:0/1372700739 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b0c109500 con 0x7f2b0c12b8a0 2019-11-28T11:25:20.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.621+0000 7f2b11a7d700 1 --2- 172.21.15.80:0/1372700739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c12b8a0 0x7f2b0c13e320 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f2afc054470 tx=0x7f2afc054810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.621+0000 7f2b0affd700 1 -- 172.21.15.80:0/1372700739 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14898 (secure 0 0 0) 0x7f2afc0654a0 con 0x7f2b0c12b8a0 2019-11-28T11:25:20.641 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:20.641 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:19.931551+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:25:14.914696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-11-28T11:25:17.566323+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:20.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.623+0000 7f2b13ce1700 1 -- 172.21.15.80:0/1372700739 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2af0018730 msgr2=0x7f2af001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:20.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.623+0000 7f2b13ce1700 1 --2- 172.21.15.80:0/1372700739 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2af0018730 0x7f2af001abc0 crc :-1 s=READY pgs=47 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:20.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.623+0000 7f2b13ce1700 1 -- 172.21.15.80:0/1372700739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c12b8a0 msgr2=0x7f2b0c13e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:20.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.623+0000 7f2b13ce1700 1 --2- 172.21.15.80:0/1372700739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c12b8a0 0x7f2b0c13e320 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f2afc054470 tx=0x7f2afc054810).stop 2019-11-28T11:25:20.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.623+0000 7f2b13ce1700 1 -- 172.21.15.80:0/1372700739 shutdown_connections 2019-11-28T11:25:20.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.623+0000 7f2b13ce1700 1 --2- 172.21.15.80:0/1372700739 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2af0018730 0x7f2af001abc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:20.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.623+0000 7f2b13ce1700 1 --2- 172.21.15.80:0/1372700739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b0c12b8a0 0x7f2b0c13e320 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:20.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.623+0000 7f2b13ce1700 1 --2- 172.21.15.80:0/1372700739 >> v2:172.21.15.174:3300/0 conn(0x7f2b0c15fdf0 0x7f2b0c12b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:20.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.623+0000 7f2b13ce1700 1 -- 172.21.15.80:0/1372700739 shutdown_connections 2019-11-28T11:25:20.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.623+0000 7f2b13ce1700 1 -- 172.21.15.80:0/1372700739 wait complete. 2019-11-28T11:25:20.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.623+0000 7f2b13ce1700 1 -- 172.21.15.80:0/1372700739 >> 172.21.15.80:0/1372700739 conn(0x7f2b0c127dc0 msgr2=0x7f2b0c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:20.653 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:25:20.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.757+0000 7f2aef637700 1 Processor -- start 2019-11-28T11:25:20.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.757+0000 7f2aef637700 1 -- start start 2019-11-28T11:25:20.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.758+0000 7f2aef637700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2ae815ed10 0x7f2ae815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:20.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.758+0000 7f2aef637700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ae8073020 0x7f2ae8071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:20.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.758+0000 7f2aef637700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ae80734b0 0x7f2ae80723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:20.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.758+0000 7f2aef637700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae806fe00 con 0x7f2ae8073020 2019-11-28T11:25:20.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.758+0000 7f2aef637700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae80700d0 con 0x7f2ae815ed10 2019-11-28T11:25:20.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.758+0000 7f2aef637700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae806f3d0 con 0x7f2ae80734b0 2019-11-28T11:25:20.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aed3d3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ae8073020 0x7f2ae8071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:20.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aed3d3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ae8073020 0x7f2ae8071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59140/0 (socket says 172.21.15.80:59140) 2019-11-28T11:25:20.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aed3d3700 1 -- 172.21.15.80:0/84359631 learned_addr learned my addr 172.21.15.80:0/84359631 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:20.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aee3d5700 1 --2- 172.21.15.80:0/84359631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ae80734b0 0x7f2ae80723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:20.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aedbd4700 1 --2- 172.21.15.80:0/84359631 >> v2:172.21.15.174:3300/0 conn(0x7f2ae815ed10 0x7f2ae815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:20.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aed3d3700 1 -- 172.21.15.80:0/84359631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ae80734b0 msgr2=0x7f2ae80723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:20.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/84359631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ae80734b0 0x7f2ae80723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:20.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aed3d3700 1 -- 172.21.15.80:0/84359631 >> v2:172.21.15.174:3300/0 conn(0x7f2ae815ed10 msgr2=0x7f2ae815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:20.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/84359631 >> v2:172.21.15.174:3300/0 conn(0x7f2ae815ed10 0x7f2ae815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:20.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aed3d3700 1 -- 172.21.15.80:0/84359631 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae8070760 con 0x7f2ae8073020 2019-11-28T11:25:20.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/84359631 >> v2:172.21.15.80:3300/0 conn(0x7f2ae8073020 0x7f2ae8071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2ae400f6c0 tx=0x7f2ae400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/84359631 >> v2:172.21.15.80:3300/0 conn(0x7f2ae8073020 0x7f2ae8071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2ae400f6c0 tx=0x7f2ae400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/84359631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8073020 0x7f2ae8071ea0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f2ae400f6c0 tx=0x7f2ae400f570).ready entity=mon.0 client_cookie=16e3621078e92366 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:20.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/84359631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8073020 0x7f2ae8071ea0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f2ae400f6c0 tx=0x7f2ae400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/84359631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8073020 0x7f2ae8071ea0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f2ae400f6c0 tx=0x7f2ae400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aecbd2700 1 -- 172.21.15.80:0/84359631 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae4000960 con 0x7f2ae8073020 2019-11-28T11:25:20.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/84359631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8073020 0x7f2ae8071ea0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f2ae400f6c0 tx=0x7f2ae400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aecbd2700 1 -- 172.21.15.80:0/84359631 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae4000c90 con 0x7f2ae8073020 2019-11-28T11:25:20.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aecbd2700 1 -- 172.21.15.80:0/84359631 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae40013a0 con 0x7f2ae8073020 2019-11-28T11:25:20.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aef637700 1 -- 172.21.15.80:0/84359631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8073020 msgr2=0x7f2ae8071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:20.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.759+0000 7f2aef637700 1 --2- 172.21.15.80:0/84359631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8073020 0x7f2ae8071ea0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f2ae400f6c0 tx=0x7f2ae400f570).stop 2019-11-28T11:25:20.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.760+0000 7f2aef637700 1 -- 172.21.15.80:0/84359631 shutdown_connections 2019-11-28T11:25:20.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.760+0000 7f2aef637700 1 --2- 172.21.15.80:0/84359631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ae80734b0 0x7f2ae80723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:20.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.760+0000 7f2aef637700 1 --2- 172.21.15.80:0/84359631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8073020 0x7f2ae8071ea0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:20.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.760+0000 7f2aef637700 1 --2- 172.21.15.80:0/84359631 >> v2:172.21.15.174:3300/0 conn(0x7f2ae815ed10 0x7f2ae815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:20.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.760+0000 7f2aef637700 1 -- 172.21.15.80:0/84359631 shutdown_connections 2019-11-28T11:25:20.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.760+0000 7f2aef637700 1 -- 172.21.15.80:0/84359631 wait complete. 2019-11-28T11:25:20.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.760+0000 7f2aef637700 1 -- 172.21.15.80:0/84359631 >> 172.21.15.80:0/84359631 conn(0x7f2ae8061d20 msgr2=0x7f2ae80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:20.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.763+0000 7f2aef637700 1 Processor -- start 2019-11-28T11:25:20.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.763+0000 7f2aef637700 1 -- start start 2019-11-28T11:25:20.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.763+0000 7f2aef637700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2ae8153890 0x7f2ae8115020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:20.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.763+0000 7f2aef637700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ae8115560 0x7f2ae812e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:20.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.763+0000 7f2aef637700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae81542b0 con 0x7f2ae812e670 2019-11-28T11:25:20.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.763+0000 7f2aef637700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae8110bb0 con 0x7f2ae8115560 2019-11-28T11:25:20.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.763+0000 7f2aef637700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae8110e80 con 0x7f2ae8153890 2019-11-28T11:25:20.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.763+0000 7f2aed3d3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ae8115560 0x7f2ae812e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:20.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.763+0000 7f2aed3d3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ae8115560 0x7f2ae812e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59142/0 (socket says 172.21.15.80:59142) 2019-11-28T11:25:20.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.763+0000 7f2aed3d3700 1 -- 172.21.15.80:0/3545062727 learned_addr learned my addr 172.21.15.80:0/3545062727 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:20.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2aedbd4700 1 --2- 172.21.15.80:0/3545062727 >> v2:172.21.15.174:3300/0 conn(0x7f2ae8153890 0x7f2ae8115020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:20.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2aed3d3700 1 -- 172.21.15.80:0/3545062727 >> v2:172.21.15.174:3300/0 conn(0x7f2ae8153890 msgr2=0x7f2ae8115020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:20.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/3545062727 >> v2:172.21.15.174:3300/0 conn(0x7f2ae8153890 0x7f2ae8115020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:20.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2aed3d3700 1 -- 172.21.15.80:0/3545062727 >> v1:172.21.15.174:6789/0 conn(0x7f2ae812e670 legacy=0x7f2ae8113ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:20.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2aed3d3700 1 -- 172.21.15.80:0/3545062727 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae8112760 con 0x7f2ae8115560 2019-11-28T11:25:20.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/3545062727 >> v2:172.21.15.80:3300/0 conn(0x7f2ae8115560 0x7f2ae812e130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ae4010450 tx=0x7f2ae4010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/3545062727 >> v2:172.21.15.80:3300/0 conn(0x7f2ae8115560 0x7f2ae812e130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ae4010450 tx=0x7f2ae4010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/3545062727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8115560 0x7f2ae812e130 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f2ae4010450 tx=0x7f2ae4010250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:20.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/3545062727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8115560 0x7f2ae812e130 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f2ae4010450 tx=0x7f2ae4010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/3545062727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8115560 0x7f2ae812e130 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f2ae4010450 tx=0x7f2ae4010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2ade7fc700 1 -- 172.21.15.80:0/3545062727 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae4001050 con 0x7f2ae8115560 2019-11-28T11:25:20.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/3545062727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8115560 0x7f2ae812e130 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f2ae4010450 tx=0x7f2ae4010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2ade7fc700 1 -- 172.21.15.80:0/3545062727 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae4007a60 con 0x7f2ae8115560 2019-11-28T11:25:20.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2aef637700 1 -- 172.21.15.80:0/3545062727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae8112ae0 con 0x7f2ae8115560 2019-11-28T11:25:20.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2ade7fc700 1 -- 172.21.15.80:0/3545062727 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae4001630 con 0x7f2ae8115560 2019-11-28T11:25:20.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2aef637700 1 -- 172.21.15.80:0/3545062727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae8112760 con 0x7f2ae8115560 2019-11-28T11:25:20.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.764+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/3545062727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8115560 0x7f2ae812e130 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f2ae4010450 tx=0x7f2ae4010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.765+0000 7f2ade7fc700 1 -- 172.21.15.80:0/3545062727 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2ae4000e60 con 0x7f2ae8115560 2019-11-28T11:25:20.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.765+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/3545062727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8115560 0x7f2ae812e130 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f2ae4010450 tx=0x7f2ae4010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.765+0000 7f2ade7fc700 1 --2- 172.21.15.80:0/3545062727 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ad0018730 0x7f2ad001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:20.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.765+0000 7f2ade7fc700 1 -- 172.21.15.80:0/3545062727 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2ae4031d40 con 0x7f2ae8115560 2019-11-28T11:25:20.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.765+0000 7f2aedbd4700 1 --2- 172.21.15.80:0/3545062727 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ad0018730 0x7f2ad001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:20.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.765+0000 7f2aedbd4700 1 --2- 172.21.15.80:0/3545062727 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ad0018730 0x7f2ad001abe0 crc :-1 s=READY pgs=48 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:20.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.773+0000 7f2aef637700 1 -- 172.21.15.80:0/3545062727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae8112ae0 con 0x7f2ae8115560 2019-11-28T11:25:20.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.776+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/3545062727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8115560 0x7f2ae812e130 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f2ae4010450 tx=0x7f2ae4010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:20.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.776+0000 7f2ade7fc700 1 -- 172.21.15.80:0/3545062727 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2ae4000c50 con 0x7f2ae8115560 2019-11-28T11:25:20.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:20.952+0000 7f2aef637700 1 -- 172.21.15.80:0/3545062727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f2ae8112760 con 0x7f2ae8115560 2019-11-28T11:25:21.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:21.944+0000 7f2aed3d3700 1 --2- 172.21.15.80:0/3545062727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8115560 0x7f2ae812e130 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f2ae4010450 tx=0x7f2ae4010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:21.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:21.944+0000 7f2ade7fc700 1 -- 172.21.15.80:0/3545062727 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2ae4007a60 con 0x7f2ae8115560 2019-11-28T11:25:21.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:21.970+0000 7f2aef637700 1 -- 172.21.15.80:0/3545062727 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ad0018730 msgr2=0x7f2ad001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:21.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:21.970+0000 7f2aef637700 1 --2- 172.21.15.80:0/3545062727 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ad0018730 0x7f2ad001abe0 crc :-1 s=READY pgs=48 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:21.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:21.970+0000 7f2aef637700 1 -- 172.21.15.80:0/3545062727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8115560 msgr2=0x7f2ae812e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:21.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:21.970+0000 7f2aef637700 1 --2- 172.21.15.80:0/3545062727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8115560 0x7f2ae812e130 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f2ae4010450 tx=0x7f2ae4010250).stop 2019-11-28T11:25:21.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:21.970+0000 7f2aef637700 1 -- 172.21.15.80:0/3545062727 shutdown_connections 2019-11-28T11:25:21.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:21.970+0000 7f2aef637700 1 --2- 172.21.15.80:0/3545062727 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ad0018730 0x7f2ad001abe0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:21.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:21.970+0000 7f2aef637700 1 --2- 172.21.15.80:0/3545062727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ae8115560 0x7f2ae812e130 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:21.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:21.970+0000 7f2aef637700 1 --2- 172.21.15.80:0/3545062727 >> v2:172.21.15.174:3300/0 conn(0x7f2ae8153890 0x7f2ae8115020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:21.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:21.970+0000 7f2aef637700 1 -- 172.21.15.80:0/3545062727 shutdown_connections 2019-11-28T11:25:21.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:21.970+0000 7f2aef637700 1 -- 172.21.15.80:0/3545062727 wait complete. 2019-11-28T11:25:21.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:21.970+0000 7f2aef637700 1 -- 172.21.15.80:0/3545062727 >> 172.21.15.80:0/3545062727 conn(0x7f2ae814f9f0 msgr2=0x7f2ae8111c60 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:21.998 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:25:22.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.099+0000 7f3f71d07700 1 Processor -- start 2019-11-28T11:25:22.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.099+0000 7f3f71d07700 1 -- start start 2019-11-28T11:25:22.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f71d07700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f6c06c0a0 0x7f3f6c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:22.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f71d07700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3f6c072620 0x7f3f6c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:22.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f71d07700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6c06db00 con 0x7f3f6c0734e0 2019-11-28T11:25:22.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f71d07700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f6c06f330 con 0x7f3f6c072620 2019-11-28T11:25:22.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f71d07700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c0706c0 con 0x7f3f6c06c0a0 2019-11-28T11:25:22.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f63fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3f6c0734e0 0x7f3f6c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58466/0 (socket says 172.21.15.80:58466) 2019-11-28T11:25:22.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f63fff700 1 -- 172.21.15.80:0/2036677202 learned_addr learned my addr 172.21.15.80:0/2036677202 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:22.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f70aa5700 1 --2- 172.21.15.80:0/2036677202 >> v2:172.21.15.174:3300/0 conn(0x7f3f6c072620 0x7f3f6c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:22.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/2036677202 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f6c06c0a0 0x7f3f6c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:22.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f6b7fe700 1 -- 172.21.15.80:0/2036677202 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786282788 0 0) 0x7f3f54001170 con 0x7f3f6c0734e0 2019-11-28T11:25:22.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f6b7fe700 1 -- 172.21.15.80:0/2036677202 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f58002e80 con 0x7f3f6c0734e0 2019-11-28T11:25:22.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f6bfff700 1 -- 172.21.15.80:0/2036677202 >> v2:172.21.15.174:3300/0 conn(0x7f3f6c072620 msgr2=0x7f3f6c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:22.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/2036677202 >> v2:172.21.15.174:3300/0 conn(0x7f3f6c072620 0x7f3f6c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:22.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f6bfff700 1 -- 172.21.15.80:0/2036677202 >> v1:172.21.15.80:6789/0 conn(0x7f3f6c0734e0 legacy=0x7f3f6c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f6bfff700 1 -- 172.21.15.80:0/2036677202 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c070a40 con 0x7f3f6c06c0a0 2019-11-28T11:25:22.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f70aa5700 1 --2- 172.21.15.80:0/2036677202 >> v2:172.21.15.174:3300/0 conn(0x7f3f6c072620 0x7f3f6c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:22.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.100+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/2036677202 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f6c06c0a0 0x7f3f6c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3f5c00af50 tx=0x7f3f5c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.101+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/2036677202 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f6c06c0a0 0x7f3f6c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3f5c00af50 tx=0x7f3f5c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.101+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/2036677202 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f6c06c0a0 0x7f3f6c072fa0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f3f5c00af50 tx=0x7f3f5c00b760).ready entity=mon.2 client_cookie=809b10b58662046d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:22.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.101+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/2036677202 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f6c06c0a0 0x7f3f6c072fa0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f3f5c00af50 tx=0x7f3f5c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.101+0000 7f3f6b7fe700 1 -- 172.21.15.80:0/2036677202 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f5c007210 con 0x7f3f6c06c0a0 2019-11-28T11:25:22.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.101+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/2036677202 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f6c06c0a0 0x7f3f6c072fa0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f3f5c00af50 tx=0x7f3f5c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.101+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/2036677202 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f6c06c0a0 0x7f3f6c072fa0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f3f5c00af50 tx=0x7f3f5c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.101+0000 7f3f6b7fe700 1 -- 172.21.15.80:0/2036677202 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c007210 con 0x7f3f6c06c0a0 2019-11-28T11:25:22.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.101+0000 7f3f6b7fe700 1 -- 172.21.15.80:0/2036677202 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f5c009ba0 con 0x7f3f6c06c0a0 2019-11-28T11:25:22.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.101+0000 7f3f71d07700 1 -- 172.21.15.80:0/2036677202 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f6c06c0a0 msgr2=0x7f3f6c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.101+0000 7f3f71d07700 1 --2- 172.21.15.80:0/2036677202 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f6c06c0a0 0x7f3f6c072fa0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f3f5c00af50 tx=0x7f3f5c00b760).stop 2019-11-28T11:25:22.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.102+0000 7f3f71d07700 1 -- 172.21.15.80:0/2036677202 shutdown_connections 2019-11-28T11:25:22.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.102+0000 7f3f71d07700 1 --2- 172.21.15.80:0/2036677202 >> v2:172.21.15.174:3300/0 conn(0x7f3f6c072620 0x7f3f6c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:22.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.102+0000 7f3f71d07700 1 --2- 172.21.15.80:0/2036677202 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f6c06c0a0 0x7f3f6c072fa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:22.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.102+0000 7f3f71d07700 1 -- 172.21.15.80:0/2036677202 shutdown_connections 2019-11-28T11:25:22.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.102+0000 7f3f71d07700 1 -- 172.21.15.80:0/2036677202 wait complete. 2019-11-28T11:25:22.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.102+0000 7f3f71d07700 1 -- 172.21.15.80:0/2036677202 >> 172.21.15.80:0/2036677202 conn(0x7f3f6c061cf0 msgr2=0x7f3f6c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:22.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.104+0000 7f3f71d07700 1 Processor -- start 2019-11-28T11:25:22.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.104+0000 7f3f71d07700 1 -- start start 2019-11-28T11:25:22.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.105+0000 7f3f71d07700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3f6c104820 0x7f3f6c10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:22.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.105+0000 7f3f71d07700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6c13bcd0 con 0x7f3f6c10c890 2019-11-28T11:25:22.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.105+0000 7f3f71d07700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6c105ea0 con 0x7f3f6c10b9d0 2019-11-28T11:25:22.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.105+0000 7f3f71d07700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f6c109130 con 0x7f3f6c104820 2019-11-28T11:25:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.105+0000 7f3f63fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3f6c10c890 0x7f3f6c10b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58472/0 (socket says 172.21.15.80:58472) 2019-11-28T11:25:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.105+0000 7f3f63fff700 1 -- 172.21.15.80:0/1913100498 learned_addr learned my addr 172.21.15.80:0/1913100498 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.105+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/1913100498 >> v2:172.21.15.174:3300/0 conn(0x7f3f6c104820 0x7f3f6c10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.105+0000 7f3f697fa700 1 -- 172.21.15.80:0/1913100498 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973627238 0 0) 0x7f3f54001150 con 0x7f3f6c10c890 2019-11-28T11:25:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.105+0000 7f3f697fa700 1 -- 172.21.15.80:0/1913100498 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f50002e80 con 0x7f3f6c10c890 2019-11-28T11:25:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.105+0000 7f3f697fa700 1 -- 172.21.15.80:0/1913100498 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047580576 0 0) 0x7f3f6400ab90 con 0x7f3f6c10b9d0 2019-11-28T11:25:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.105+0000 7f3f697fa700 1 -- 172.21.15.80:0/1913100498 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f500030b0 con 0x7f3f6c10b9d0 2019-11-28T11:25:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.105+0000 7f3f697fa700 1 -- 172.21.15.80:0/1913100498 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3367626988 0 0) 0x7f3f54001350 con 0x7f3f6c10c890 2019-11-28T11:25:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.105+0000 7f3f6bfff700 1 -- 172.21.15.80:0/1913100498 >> v1:172.21.15.174:6789/0 conn(0x7f3f6c10b9d0 legacy=0x7f3f6c167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.105+0000 7f3f6bfff700 1 -- 172.21.15.80:0/1913100498 >> v1:172.21.15.80:6789/0 conn(0x7f3f6c10c890 legacy=0x7f3f6c10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.105+0000 7f3f6bfff700 1 -- 172.21.15.80:0/1913100498 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c109a90 con 0x7f3f6c104820 2019-11-28T11:25:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.106+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/1913100498 >> v2:172.21.15.174:3300/0 conn(0x7f3f6c104820 0x7f3f6c10c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3f5c0103a0 tx=0x7f3f5c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.106+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/1913100498 >> v2:172.21.15.174:3300/0 conn(0x7f3f6c104820 0x7f3f6c10c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3f5c0103a0 tx=0x7f3f5c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.106+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f6c104820 0x7f3f6c10c350 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f3f5c0103a0 tx=0x7f3f5c010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:22.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.106+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f6c104820 0x7f3f6c10c350 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f3f5c0103a0 tx=0x7f3f5c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.106+0000 7f3f697fa700 1 -- 172.21.15.80:0/1913100498 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f5c000940 con 0x7f3f6c104820 2019-11-28T11:25:22.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.106+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f6c104820 0x7f3f6c10c350 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f3f5c0103a0 tx=0x7f3f5c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.106+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f6c104820 0x7f3f6c10c350 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f3f5c0103a0 tx=0x7f3f5c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.106+0000 7f3f697fa700 1 -- 172.21.15.80:0/1913100498 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c00b250 con 0x7f3f6c104820 2019-11-28T11:25:22.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.106+0000 7f3f71d07700 1 -- 172.21.15.80:0/1913100498 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6c109e10 con 0x7f3f6c104820 2019-11-28T11:25:22.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.106+0000 7f3f697fa700 1 -- 172.21.15.80:0/1913100498 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f5c009d60 con 0x7f3f6c104820 2019-11-28T11:25:22.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.106+0000 7f3f71d07700 1 -- 172.21.15.80:0/1913100498 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6c109a90 con 0x7f3f6c104820 2019-11-28T11:25:22.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.106+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f6c104820 0x7f3f6c10c350 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f3f5c0103a0 tx=0x7f3f5c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.106+0000 7f3f697fa700 1 -- 172.21.15.80:0/1913100498 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3f5c00a1f0 con 0x7f3f6c104820 2019-11-28T11:25:22.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.106+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f6c104820 0x7f3f6c10c350 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f3f5c0103a0 tx=0x7f3f5c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.106+0000 7f3f697fa700 1 --2- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f50018750 0x7f3f5001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:22.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.107+0000 7f3f697fa700 1 -- 172.21.15.80:0/1913100498 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f3f5c031af0 con 0x7f3f6c104820 2019-11-28T11:25:22.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.107+0000 7f3f63fff700 1 --2- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f50018750 0x7f3f5001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:22.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.107+0000 7f3f63fff700 1 --2- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f50018750 0x7f3f5001abe0 crc :-1 s=READY pgs=49 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:22.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.114+0000 7f3f71d07700 1 -- 172.21.15.80:0/1913100498 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6c109e10 con 0x7f3f6c104820 2019-11-28T11:25:22.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.118+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f6c104820 0x7f3f6c10c350 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f3f5c0103a0 tx=0x7f3f5c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.118+0000 7f3f697fa700 1 -- 172.21.15.80:0/1913100498 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3f5c009fe0 con 0x7f3f6c104820 2019-11-28T11:25:22.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.289+0000 7f3f71d07700 1 -- 172.21.15.80:0/1913100498 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f6c109a90 con 0x7f3f6c104820 2019-11-28T11:25:22.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.290+0000 7f3f6bfff700 1 --2- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f6c104820 0x7f3f6c10c350 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f3f5c0103a0 tx=0x7f3f5c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.290+0000 7f3f697fa700 1 -- 172.21.15.80:0/1913100498 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1420 (secure 0 0 0) 0x7f3f5c017aa0 con 0x7f3f6c104820 2019-11-28T11:25:22.309 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 3 2019-11-28T11:25:22.309 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:22.309 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:25:19.931718+0000","modified":"2019-11-28T11:25:21.939704+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-11-28T11:25:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.292+0000 7f3f71d07700 1 -- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f50018750 msgr2=0x7f3f5001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.292+0000 7f3f71d07700 1 --2- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f50018750 0x7f3f5001abe0 crc :-1 s=READY pgs=49 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.292+0000 7f3f71d07700 1 -- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f6c104820 msgr2=0x7f3f6c10c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.292+0000 7f3f71d07700 1 --2- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f6c104820 0x7f3f6c10c350 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f3f5c0103a0 tx=0x7f3f5c010740).stop 2019-11-28T11:25:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.292+0000 7f3f71d07700 1 -- 172.21.15.80:0/1913100498 shutdown_connections 2019-11-28T11:25:22.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.292+0000 7f3f71d07700 1 --2- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f50018750 0x7f3f5001abe0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:22.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.292+0000 7f3f71d07700 1 --2- 172.21.15.80:0/1913100498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f6c104820 0x7f3f6c10c350 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:22.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.292+0000 7f3f71d07700 1 -- 172.21.15.80:0/1913100498 shutdown_connections 2019-11-28T11:25:22.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.292+0000 7f3f71d07700 1 -- 172.21.15.80:0/1913100498 wait complete. 2019-11-28T11:25:22.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.292+0000 7f3f71d07700 1 -- 172.21.15.80:0/1913100498 >> 172.21.15.80:0/1913100498 conn(0x7f3f6c13d620 msgr2=0x7f3f6c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:22.320 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:22.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.421+0000 7f3105f05700 1 Processor -- start 2019-11-28T11:25:22.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.421+0000 7f3105f05700 1 -- start start 2019-11-28T11:25:22.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f3105f05700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f310006c490 0x7f310006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:22.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f3105f05700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f310006db00 con 0x7f310006ce60 2019-11-28T11:25:22.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f3105f05700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f310006e000 con 0x7f310006c0a0 2019-11-28T11:25:22.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f3105f05700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310006fd60 con 0x7f310006c490 2019-11-28T11:25:22.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f3104ca3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f310006ce60 0x7f3100164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58484/0 (socket says 172.21.15.80:58484) 2019-11-28T11:25:22.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f3104ca3700 1 -- 172.21.15.80:0/2658510344 learned_addr learned my addr 172.21.15.80:0/2658510344 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:22.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f30f7fff700 1 --2- 172.21.15.80:0/2658510344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f310006c490 0x7f310006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:22.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f30ff7fe700 1 -- 172.21.15.80:0/2658510344 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311773396 0 0) 0x7f30f80014d0 con 0x7f310006ce60 2019-11-28T11:25:22.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f30ff7fe700 1 -- 172.21.15.80:0/2658510344 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30ec002e80 con 0x7f310006ce60 2019-11-28T11:25:22.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f30ff7fe700 1 -- 172.21.15.80:0/2658510344 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672664605 0 0) 0x7f30f0001080 con 0x7f310006c0a0 2019-11-28T11:25:22.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f30ff7fe700 1 -- 172.21.15.80:0/2658510344 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30ec0030b0 con 0x7f310006c0a0 2019-11-28T11:25:22.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f30ff7fe700 1 -- 172.21.15.80:0/2658510344 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1590649868 0 0) 0x7f30f80014b0 con 0x7f310006ce60 2019-11-28T11:25:22.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f30f7fff700 1 -- 172.21.15.80:0/2658510344 >> v1:172.21.15.174:6789/0 conn(0x7f310006c0a0 legacy=0x7f3100072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f30f7fff700 1 -- 172.21.15.80:0/2658510344 >> v1:172.21.15.80:6789/0 conn(0x7f310006ce60 legacy=0x7f3100164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f30f7fff700 1 -- 172.21.15.80:0/2658510344 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31000706c0 con 0x7f310006c490 2019-11-28T11:25:22.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f30f7fff700 1 --2- 172.21.15.80:0/2658510344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f310006c490 0x7f310006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f30e800af50 tx=0x7f30e800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f30f7fff700 1 --2- 172.21.15.80:0/2658510344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f310006c490 0x7f310006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f30e800af50 tx=0x7f30e800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.422+0000 7f30f7fff700 1 --2- 172.21.15.80:0/2658510344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f310006c490 0x7f310006c920 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f30e800af50 tx=0x7f30e800b760).ready entity=mon.2 client_cookie=1dccdb23f15b24a0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:22.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.423+0000 7f30f7fff700 1 --2- 172.21.15.80:0/2658510344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f310006c490 0x7f310006c920 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f30e800af50 tx=0x7f30e800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.423+0000 7f30ff7fe700 1 -- 172.21.15.80:0/2658510344 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e8000960 con 0x7f310006c490 2019-11-28T11:25:22.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.423+0000 7f30f7fff700 1 --2- 172.21.15.80:0/2658510344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f310006c490 0x7f310006c920 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f30e800af50 tx=0x7f30e800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.423+0000 7f30f7fff700 1 --2- 172.21.15.80:0/2658510344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f310006c490 0x7f310006c920 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f30e800af50 tx=0x7f30e800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.423+0000 7f30ff7fe700 1 -- 172.21.15.80:0/2658510344 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e8009860 con 0x7f310006c490 2019-11-28T11:25:22.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.423+0000 7f30ff7fe700 1 -- 172.21.15.80:0/2658510344 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e8009f30 con 0x7f310006c490 2019-11-28T11:25:22.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.423+0000 7f3105f05700 1 -- 172.21.15.80:0/2658510344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f310006c490 msgr2=0x7f310006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.423+0000 7f3105f05700 1 --2- 172.21.15.80:0/2658510344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f310006c490 0x7f310006c920 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f30e800af50 tx=0x7f30e800b760).stop 2019-11-28T11:25:22.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.423+0000 7f3105f05700 1 -- 172.21.15.80:0/2658510344 shutdown_connections 2019-11-28T11:25:22.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.423+0000 7f3105f05700 1 --2- 172.21.15.80:0/2658510344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f310006c490 0x7f310006c920 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:22.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.423+0000 7f3105f05700 1 -- 172.21.15.80:0/2658510344 shutdown_connections 2019-11-28T11:25:22.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.423+0000 7f3105f05700 1 -- 172.21.15.80:0/2658510344 wait complete. 2019-11-28T11:25:22.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.423+0000 7f3105f05700 1 -- 172.21.15.80:0/2658510344 >> 172.21.15.80:0/2658510344 conn(0x7f3100061cf0 msgr2=0x7f3100064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:22.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.426+0000 7f3105f05700 1 Processor -- start 2019-11-28T11:25:22.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.426+0000 7f3105f05700 1 -- start start 2019-11-28T11:25:22.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f3105f05700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f310013f580 0x7f3100114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:22.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f3105f05700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3100114670 0x7f310011e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:22.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f3105f05700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f310013fc20 con 0x7f310011eaf0 2019-11-28T11:25:22.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f3105f05700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31001236b0 con 0x7f310013f580 2019-11-28T11:25:22.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f3105f05700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3100123980 con 0x7f3100114670 2019-11-28T11:25:22.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f310013f580 0x7f3100114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:22.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f310013f580 0x7f3100114130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59170/0 (socket says 172.21.15.80:59170) 2019-11-28T11:25:22.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fffff700 1 -- 172.21.15.80:0/1129013711 learned_addr learned my addr 172.21.15.80:0/1129013711 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:22.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30f7fff700 1 --2- 172.21.15.80:0/1129013711 >> v2:172.21.15.174:3300/0 conn(0x7f3100114670 0x7f310011e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:22.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fffff700 1 -- 172.21.15.80:0/1129013711 >> v2:172.21.15.174:3300/0 conn(0x7f3100114670 msgr2=0x7f310011e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fffff700 1 --2- 172.21.15.80:0/1129013711 >> v2:172.21.15.174:3300/0 conn(0x7f3100114670 0x7f310011e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:22.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fffff700 1 -- 172.21.15.80:0/1129013711 >> v1:172.21.15.80:6789/0 conn(0x7f310011eaf0 legacy=0x7f3100112fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fffff700 1 -- 172.21.15.80:0/1129013711 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3100124010 con 0x7f310013f580 2019-11-28T11:25:22.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fd7fa700 1 -- 172.21.15.80:0/1129013711 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758251945 0 0) 0x7f30f8001480 con 0x7f310011eaf0 2019-11-28T11:25:22.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fffff700 1 --2- 172.21.15.80:0/1129013711 >> v2:172.21.15.80:3300/0 conn(0x7f310013f580 0x7f3100114130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f30f0010410 tx=0x7f30f0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fffff700 1 --2- 172.21.15.80:0/1129013711 >> v2:172.21.15.80:3300/0 conn(0x7f310013f580 0x7f3100114130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f30f0010410 tx=0x7f30f0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fffff700 1 --2- 172.21.15.80:0/1129013711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310013f580 0x7f3100114130 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f30f0010410 tx=0x7f30f0010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fffff700 1 --2- 172.21.15.80:0/1129013711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310013f580 0x7f3100114130 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f30f0010410 tx=0x7f30f0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fd7fa700 1 -- 172.21.15.80:0/1129013711 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f0005770 con 0x7f310013f580 2019-11-28T11:25:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fffff700 1 --2- 172.21.15.80:0/1129013711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310013f580 0x7f3100114130 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f30f0010410 tx=0x7f30f0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fd7fa700 1 -- 172.21.15.80:0/1129013711 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f0000b90 con 0x7f310013f580 2019-11-28T11:25:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fffff700 1 --2- 172.21.15.80:0/1129013711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310013f580 0x7f3100114130 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f30f0010410 tx=0x7f30f0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f3105f05700 1 -- 172.21.15.80:0/1129013711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3100124010 con 0x7f310013f580 2019-11-28T11:25:22.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f30fd7fa700 1 -- 172.21.15.80:0/1129013711 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f0005810 con 0x7f310013f580 2019-11-28T11:25:22.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.427+0000 7f3105f05700 1 -- 172.21.15.80:0/1129013711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3100124010 con 0x7f310013f580 2019-11-28T11:25:22.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.428+0000 7f30fffff700 1 --2- 172.21.15.80:0/1129013711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310013f580 0x7f3100114130 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f30f0010410 tx=0x7f30f0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.428+0000 7f30fd7fa700 1 -- 172.21.15.80:0/1129013711 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f30f00054d0 con 0x7f310013f580 2019-11-28T11:25:22.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.428+0000 7f30fffff700 1 --2- 172.21.15.80:0/1129013711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310013f580 0x7f3100114130 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f30f0010410 tx=0x7f30f0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.428+0000 7f30fd7fa700 1 --2- 172.21.15.80:0/1129013711 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f30e4018730 0x7f30e401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:22.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.428+0000 7f30fd7fa700 1 -- 172.21.15.80:0/1129013711 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f30f0031a30 con 0x7f310013f580 2019-11-28T11:25:22.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.428+0000 7f30f7fff700 1 --2- 172.21.15.80:0/1129013711 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f30e4018730 0x7f30e401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:22.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.429+0000 7f30f7fff700 1 --2- 172.21.15.80:0/1129013711 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f30e4018730 0x7f30e401abc0 crc :-1 s=READY pgs=50 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:22.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.436+0000 7f3105f05700 1 -- 172.21.15.80:0/1129013711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3100124010 con 0x7f310013f580 2019-11-28T11:25:22.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.439+0000 7f30fffff700 1 --2- 172.21.15.80:0/1129013711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310013f580 0x7f3100114130 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f30f0010410 tx=0x7f30f0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.439+0000 7f30fd7fa700 1 -- 172.21.15.80:0/1129013711 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f30f00075a0 con 0x7f310013f580 2019-11-28T11:25:22.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.614+0000 7f3105f05700 1 -- 172.21.15.80:0/1129013711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3100124010 con 0x7f310013f580 2019-11-28T11:25:22.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.615+0000 7f30fffff700 1 --2- 172.21.15.80:0/1129013711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310013f580 0x7f3100114130 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f30f0010410 tx=0x7f30f0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.615+0000 7f30fd7fa700 1 -- 172.21.15.80:0/1129013711 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14885 (secure 0 0 0) 0x7f30f0017400 con 0x7f310013f580 2019-11-28T11:25:22.634 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:22.634 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:20.933435+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:25:14.914696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-11-28T11:25:17.566323+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.617+0000 7f3105f05700 1 -- 172.21.15.80:0/1129013711 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f30e4018730 msgr2=0x7f30e401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.617+0000 7f3105f05700 1 --2- 172.21.15.80:0/1129013711 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f30e4018730 0x7f30e401abc0 crc :-1 s=READY pgs=50 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.617+0000 7f3105f05700 1 -- 172.21.15.80:0/1129013711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310013f580 msgr2=0x7f3100114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.617+0000 7f3105f05700 1 --2- 172.21.15.80:0/1129013711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310013f580 0x7f3100114130 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f30f0010410 tx=0x7f30f0010290).stop 2019-11-28T11:25:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.617+0000 7f3105f05700 1 -- 172.21.15.80:0/1129013711 shutdown_connections 2019-11-28T11:25:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.617+0000 7f3105f05700 1 --2- 172.21.15.80:0/1129013711 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f30e4018730 0x7f30e401abc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:22.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.617+0000 7f3105f05700 1 --2- 172.21.15.80:0/1129013711 >> v2:172.21.15.174:3300/0 conn(0x7f3100114670 0x7f310011e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:22.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.617+0000 7f3105f05700 1 --2- 172.21.15.80:0/1129013711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310013f580 0x7f3100114130 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:22.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.617+0000 7f3105f05700 1 -- 172.21.15.80:0/1129013711 shutdown_connections 2019-11-28T11:25:22.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.617+0000 7f3105f05700 1 -- 172.21.15.80:0/1129013711 wait complete. 2019-11-28T11:25:22.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.617+0000 7f3105f05700 1 -- 172.21.15.80:0/1129013711 >> 172.21.15.80:0/1129013711 conn(0x7f31001426c0 msgr2=0x7f3100110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:22.646 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2019-11-28T11:25:22.646 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:25:22.646 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:25:22.650 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:25:22.651 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:25:22.651 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:25:22.655 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:25:22.655 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:25:22.655 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:25:22.658 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:25:22.659 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:22.660 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2019-11-28T11:25:22.738 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:25:22.742 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:25:22.745 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:25:22.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.764+0000 7f32519b8700 1 Processor -- start 2019-11-28T11:25:22.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.764+0000 7f32519b8700 1 -- start start 2019-11-28T11:25:22.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f32519b8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f324c06c0a0 0x7f324c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:22.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f32519b8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c0734e0 0x7f324c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:22.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f32519b8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c06db00 con 0x7f324c072360 2019-11-28T11:25:22.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f32519b8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324c06fd60 con 0x7f324c06c0a0 2019-11-28T11:25:22.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f32519b8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c070030 con 0x7f324c0734e0 2019-11-28T11:25:22.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324b7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f324c06c0a0 0x7f324c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:22.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324b7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f324c06c0a0 0x7f324c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59200/0 (socket says 172.21.15.80:59200) 2019-11-28T11:25:22.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f324c072360 0x7f324c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58518/0 (socket says 172.21.15.80:58518) 2019-11-28T11:25:22.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324b7fe700 1 -- 172.21.15.80:0/2066107768 learned_addr learned my addr 172.21.15.80:0/2066107768 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:22.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324affd700 1 --2- 172.21.15.80:0/2066107768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c0734e0 0x7f324c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:22.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324b7fe700 1 -- 172.21.15.80:0/2066107768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c0734e0 msgr2=0x7f324c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:22.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324b7fe700 1 --2- 172.21.15.80:0/2066107768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c0734e0 0x7f324c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:22.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324b7fe700 1 -- 172.21.15.80:0/2066107768 >> v1:172.21.15.80:6789/0 conn(0x7f324c072360 legacy=0x7f324c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324b7fe700 1 -- 172.21.15.80:0/2066107768 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c0706c0 con 0x7f324c06c0a0 2019-11-28T11:25:22.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324a7fc700 1 -- 172.21.15.80:0/2066107768 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441780576 0 0) 0x7f32440009b0 con 0x7f324c072360 2019-11-28T11:25:22.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324b7fe700 1 --2- 172.21.15.80:0/2066107768 >> v2:172.21.15.80:3300/0 conn(0x7f324c06c0a0 0x7f324c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f323c00f6c0 tx=0x7f323c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324b7fe700 1 --2- 172.21.15.80:0/2066107768 >> v2:172.21.15.80:3300/0 conn(0x7f324c06c0a0 0x7f324c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f323c00f6c0 tx=0x7f323c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324b7fe700 1 --2- 172.21.15.80:0/2066107768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324c06c0a0 0x7f324c072fa0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f323c00f6c0 tx=0x7f323c00fa60).ready entity=mon.0 client_cookie=50020481a8e4ea99 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:22.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324b7fe700 1 --2- 172.21.15.80:0/2066107768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324c06c0a0 0x7f324c072fa0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f323c00f6c0 tx=0x7f323c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324a7fc700 1 -- 172.21.15.80:0/2066107768 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f323c000960 con 0x7f324c06c0a0 2019-11-28T11:25:22.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324b7fe700 1 --2- 172.21.15.80:0/2066107768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324c06c0a0 0x7f324c072fa0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f323c00f6c0 tx=0x7f323c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324b7fe700 1 --2- 172.21.15.80:0/2066107768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324c06c0a0 0x7f324c072fa0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f323c00f6c0 tx=0x7f323c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324a7fc700 1 -- 172.21.15.80:0/2066107768 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c000c90 con 0x7f324c06c0a0 2019-11-28T11:25:22.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f324a7fc700 1 -- 172.21.15.80:0/2066107768 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f323c0013a0 con 0x7f324c06c0a0 2019-11-28T11:25:22.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f32519b8700 1 -- 172.21.15.80:0/2066107768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324c06c0a0 msgr2=0x7f324c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.765+0000 7f32519b8700 1 --2- 172.21.15.80:0/2066107768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324c06c0a0 0x7f324c072fa0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f323c00f6c0 tx=0x7f323c00fa60).stop 2019-11-28T11:25:22.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.766+0000 7f32519b8700 1 -- 172.21.15.80:0/2066107768 shutdown_connections 2019-11-28T11:25:22.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.766+0000 7f32519b8700 1 --2- 172.21.15.80:0/2066107768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c0734e0 0x7f324c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:22.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.766+0000 7f32519b8700 1 --2- 172.21.15.80:0/2066107768 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324c06c0a0 0x7f324c072fa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:22.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.766+0000 7f32519b8700 1 -- 172.21.15.80:0/2066107768 shutdown_connections 2019-11-28T11:25:22.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.766+0000 7f32519b8700 1 -- 172.21.15.80:0/2066107768 wait complete. 2019-11-28T11:25:22.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.766+0000 7f32519b8700 1 -- 172.21.15.80:0/2066107768 >> 172.21.15.80:0/2066107768 conn(0x7f324c061cf0 msgr2=0x7f324c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:22.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.768+0000 7f32519b8700 1 Processor -- start 2019-11-28T11:25:22.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.769+0000 7f32519b8700 1 -- start start 2019-11-28T11:25:22.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f32519b8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c167c30 0x7f324c16a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:22.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f32519b8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c13f1e0 con 0x7f324c13eb40 2019-11-28T11:25:22.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f32519b8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c131a30 con 0x7f324c109e40 2019-11-28T11:25:22.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f32519b8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c1234c0 con 0x7f324c167c30 2019-11-28T11:25:22.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f324b7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f324c13eb40 0x7f324c10afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58522/0 (socket says 172.21.15.80:58522) 2019-11-28T11:25:22.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f324b7fe700 1 -- 172.21.15.80:0/468345400 learned_addr learned my addr 172.21.15.80:0/468345400 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:22.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f324bfff700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c167c30 0x7f324c16a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:22.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f3243fff700 1 -- 172.21.15.80:0/468345400 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683082058 0 0) 0x7f323c0080b0 con 0x7f324c13eb40 2019-11-28T11:25:22.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f3243fff700 1 -- 172.21.15.80:0/468345400 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3224002e80 con 0x7f324c13eb40 2019-11-28T11:25:22.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f3243fff700 1 -- 172.21.15.80:0/468345400 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445124720 0 0) 0x7f3234001220 con 0x7f324c109e40 2019-11-28T11:25:22.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f3243fff700 1 -- 172.21.15.80:0/468345400 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32240030b0 con 0x7f324c109e40 2019-11-28T11:25:22.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f3243fff700 1 -- 172.21.15.80:0/468345400 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3529101074 0 0) 0x7f323c007580 con 0x7f324c13eb40 2019-11-28T11:25:22.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f324bfff700 1 -- 172.21.15.80:0/468345400 >> v1:172.21.15.174:6789/0 conn(0x7f324c109e40 legacy=0x7f324c10a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f324bfff700 1 -- 172.21.15.80:0/468345400 >> v1:172.21.15.80:6789/0 conn(0x7f324c13eb40 legacy=0x7f324c10afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f324bfff700 1 -- 172.21.15.80:0/468345400 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c108700 con 0x7f324c167c30 2019-11-28T11:25:22.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f324bfff700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c167c30 0x7f324c16a030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3244010380 tx=0x7f3244010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f324bfff700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c167c30 0x7f324c16a030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3244010380 tx=0x7f3244010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f324bfff700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c167c30 0x7f324c16a030 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f3244010380 tx=0x7f3244010720).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:22.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f324bfff700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c167c30 0x7f324c16a030 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3244010380 tx=0x7f3244010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f3243fff700 1 -- 172.21.15.80:0/468345400 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3244000940 con 0x7f324c167c30 2019-11-28T11:25:22.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f324bfff700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c167c30 0x7f324c16a030 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3244010380 tx=0x7f3244010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f324bfff700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c167c30 0x7f324c16a030 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3244010380 tx=0x7f3244010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.770+0000 7f3243fff700 1 -- 172.21.15.80:0/468345400 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3244001470 con 0x7f324c167c30 2019-11-28T11:25:22.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.771+0000 7f3243fff700 1 -- 172.21.15.80:0/468345400 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3244001b40 con 0x7f324c167c30 2019-11-28T11:25:22.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.771+0000 7f32519b8700 1 -- 172.21.15.80:0/468345400 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f324c108a80 con 0x7f324c167c30 2019-11-28T11:25:22.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.771+0000 7f32519b8700 1 -- 172.21.15.80:0/468345400 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f324c108700 con 0x7f324c167c30 2019-11-28T11:25:22.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.771+0000 7f324bfff700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c167c30 0x7f324c16a030 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3244010380 tx=0x7f3244010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.771+0000 7f3243fff700 1 -- 172.21.15.80:0/468345400 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3244001010 con 0x7f324c167c30 2019-11-28T11:25:22.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.771+0000 7f324bfff700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c167c30 0x7f324c16a030 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3244010380 tx=0x7f3244010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.771+0000 7f3243fff700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3224018750 0x7f322401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:22.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.771+0000 7f3243fff700 1 -- 172.21.15.80:0/468345400 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f3244031a60 con 0x7f324c167c30 2019-11-28T11:25:22.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.771+0000 7f324b7fe700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3224018750 0x7f322401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:22.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.772+0000 7f324b7fe700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3224018750 0x7f322401abe0 crc :-1 s=READY pgs=51 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:22.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.779+0000 7f32519b8700 1 -- 172.21.15.80:0/468345400 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f324c108a80 con 0x7f324c167c30 2019-11-28T11:25:22.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.783+0000 7f324bfff700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c167c30 0x7f324c16a030 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3244010380 tx=0x7f3244010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.783+0000 7f3243fff700 1 -- 172.21.15.80:0/468345400 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3244000940 con 0x7f324c167c30 2019-11-28T11:25:22.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.957+0000 7f32519b8700 1 -- 172.21.15.80:0/468345400 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f324c108700 con 0x7f324c167c30 2019-11-28T11:25:22.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.958+0000 7f324bfff700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c167c30 0x7f324c16a030 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3244010380 tx=0x7f3244010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:22.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.958+0000 7f3243fff700 1 -- 172.21.15.80:0/468345400 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14885 (secure 0 0 0) 0x7f3244000ff0 con 0x7f324c167c30 2019-11-28T11:25:22.977 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:22.977 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:20.933435+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:25:14.914696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-11-28T11:25:17.566323+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:22.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.960+0000 7f32519b8700 1 -- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3224018750 msgr2=0x7f322401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.960+0000 7f32519b8700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3224018750 0x7f322401abe0 crc :-1 s=READY pgs=51 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:22.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.960+0000 7f32519b8700 1 -- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c167c30 msgr2=0x7f324c16a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:22.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.960+0000 7f32519b8700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c167c30 0x7f324c16a030 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f3244010380 tx=0x7f3244010720).stop 2019-11-28T11:25:22.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.960+0000 7f32519b8700 1 -- 172.21.15.80:0/468345400 shutdown_connections 2019-11-28T11:25:22.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.960+0000 7f32519b8700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f324c167c30 0x7f324c16a030 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:22.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.960+0000 7f32519b8700 1 --2- 172.21.15.80:0/468345400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3224018750 0x7f322401abe0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:22.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.960+0000 7f32519b8700 1 -- 172.21.15.80:0/468345400 shutdown_connections 2019-11-28T11:25:22.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.960+0000 7f32519b8700 1 -- 172.21.15.80:0/468345400 wait complete. 2019-11-28T11:25:22.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:22.960+0000 7f32519b8700 1 -- 172.21.15.80:0/468345400 >> 172.21.15.80:0/468345400 conn(0x7f324c11bfc0 msgr2=0x7f324c141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:22.990 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:14.914696+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:17.566323+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:25:22.991 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:25:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.095+0000 7f9749b85700 1 Processor -- start 2019-11-28T11:25:23.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.095+0000 7f9749b85700 1 -- start start 2019-11-28T11:25:23.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.096+0000 7f9749b85700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f974415ed10 0x7f974415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:23.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.096+0000 7f9749b85700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9744073020 0x7f9744071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:23.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.096+0000 7f9749b85700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974406db60 con 0x7f97440734b0 2019-11-28T11:25:23.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.096+0000 7f9749b85700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974406fe00 con 0x7f974415ed10 2019-11-28T11:25:23.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.096+0000 7f9749b85700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97440700d0 con 0x7f9744073020 2019-11-28T11:25:23.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.096+0000 7f9743fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f974415ed10 0x7f974415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:23.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.096+0000 7f973bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9744073020 0x7f9744071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:23.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.096+0000 7f9743fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f974415ed10 0x7f974415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:45868/0 (socket says 172.21.15.80:45868) 2019-11-28T11:25:23.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.096+0000 7f973bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9744073020 0x7f9744071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:33242/0 (socket says 172.21.15.80:33242) 2019-11-28T11:25:23.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.096+0000 7f9743fff700 1 -- 172.21.15.80:0/2202386610 learned_addr learned my addr 172.21.15.80:0/2202386610 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:23.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f9743fff700 1 -- 172.21.15.80:0/2202386610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9744073020 msgr2=0x7f9744071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:23.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f9743fff700 1 --2- 172.21.15.80:0/2202386610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9744073020 0x7f9744071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:23.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f9743fff700 1 -- 172.21.15.80:0/2202386610 >> v1:172.21.15.174:6789/0 conn(0x7f97440734b0 legacy=0x7f97440723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f9743fff700 1 -- 172.21.15.80:0/2202386610 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9744070760 con 0x7f974415ed10 2019-11-28T11:25:23.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f97437fe700 1 -- 172.21.15.80:0/2202386610 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989675830 0 0) 0x7f973c001400 con 0x7f97440734b0 2019-11-28T11:25:23.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f973bfff700 1 --2- 172.21.15.80:0/2202386610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9744073020 0x7f9744071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:23.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f9743fff700 1 --2- 172.21.15.80:0/2202386610 >> v2:172.21.15.174:3300/0 conn(0x7f974415ed10 0x7f974415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f973400f740 tx=0x7f973400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f9743fff700 1 --2- 172.21.15.80:0/2202386610 >> v2:172.21.15.174:3300/0 conn(0x7f974415ed10 0x7f974415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f973400f740 tx=0x7f973400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f9743fff700 1 --2- 172.21.15.80:0/2202386610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f974415ed10 0x7f974415f100 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f973400f740 tx=0x7f973400fae0).ready entity=mon.1 client_cookie=be55ce3fed5b2eed server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:23.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f9743fff700 1 --2- 172.21.15.80:0/2202386610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f974415ed10 0x7f974415f100 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f973400f740 tx=0x7f973400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f97437fe700 1 -- 172.21.15.80:0/2202386610 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9734000960 con 0x7f974415ed10 2019-11-28T11:25:23.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f9743fff700 1 --2- 172.21.15.80:0/2202386610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f974415ed10 0x7f974415f100 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f973400f740 tx=0x7f973400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f9743fff700 1 --2- 172.21.15.80:0/2202386610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f974415ed10 0x7f974415f100 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f973400f740 tx=0x7f973400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f97437fe700 1 -- 172.21.15.80:0/2202386610 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9734000c90 con 0x7f974415ed10 2019-11-28T11:25:23.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f97437fe700 1 -- 172.21.15.80:0/2202386610 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97340013a0 con 0x7f974415ed10 2019-11-28T11:25:23.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f9749b85700 1 -- 172.21.15.80:0/2202386610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f974415ed10 msgr2=0x7f974415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.097+0000 7f9749b85700 1 --2- 172.21.15.80:0/2202386610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f974415ed10 0x7f974415f100 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f973400f740 tx=0x7f973400fae0).stop 2019-11-28T11:25:23.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.098+0000 7f9749b85700 1 -- 172.21.15.80:0/2202386610 shutdown_connections 2019-11-28T11:25:23.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.098+0000 7f9749b85700 1 --2- 172.21.15.80:0/2202386610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9744073020 0x7f9744071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:23.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.098+0000 7f9749b85700 1 --2- 172.21.15.80:0/2202386610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f974415ed10 0x7f974415f100 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:23.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.098+0000 7f9749b85700 1 -- 172.21.15.80:0/2202386610 shutdown_connections 2019-11-28T11:25:23.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.098+0000 7f9749b85700 1 -- 172.21.15.80:0/2202386610 wait complete. 2019-11-28T11:25:23.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.098+0000 7f9749b85700 1 -- 172.21.15.80:0/2202386610 >> 172.21.15.80:0/2202386610 conn(0x7f9744061d20 msgr2=0x7f97440641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:23.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.100+0000 7f9749b85700 1 Processor -- start 2019-11-28T11:25:23.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.100+0000 7f9749b85700 1 -- start start 2019-11-28T11:25:23.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.101+0000 7f9749b85700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9744148320 0x7f974410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:23.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.101+0000 7f9749b85700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f974410e3d0 0x7f9744168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:23.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.101+0000 7f9749b85700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9744148e00 con 0x7f974410f290 2019-11-28T11:25:23.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.101+0000 7f9749b85700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974413aa20 con 0x7f9744148320 2019-11-28T11:25:23.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.101+0000 7f9749b85700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974413acf0 con 0x7f974410e3d0 2019-11-28T11:25:23.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.101+0000 7f9743fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9744148320 0x7f974410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:23.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.101+0000 7f9743fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9744148320 0x7f974410ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59220/0 (socket says 172.21.15.80:59220) 2019-11-28T11:25:23.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.101+0000 7f9743fff700 1 -- 172.21.15.80:0/3707950756 learned_addr learned my addr 172.21.15.80:0/3707950756 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:23.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.101+0000 7f9748923700 1 --2- 172.21.15.80:0/3707950756 >> v2:172.21.15.174:3300/0 conn(0x7f974410e3d0 0x7f9744168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:23.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f9743fff700 1 -- 172.21.15.80:0/3707950756 >> v2:172.21.15.174:3300/0 conn(0x7f974410e3d0 msgr2=0x7f9744168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f9743fff700 1 --2- 172.21.15.80:0/3707950756 >> v2:172.21.15.174:3300/0 conn(0x7f974410e3d0 0x7f9744168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:23.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f97417fa700 1 -- 172.21.15.80:0/3707950756 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914972648 0 0) 0x7f972c00db80 con 0x7f974410f290 2019-11-28T11:25:23.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f9743fff700 1 -- 172.21.15.80:0/3707950756 >> v1:172.21.15.174:6789/0 conn(0x7f974410f290 legacy=0x7f974410dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f9743fff700 1 -- 172.21.15.80:0/3707950756 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974410c490 con 0x7f9744148320 2019-11-28T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f9743fff700 1 --2- 172.21.15.80:0/3707950756 >> v2:172.21.15.80:3300/0 conn(0x7f9744148320 0x7f974410ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9734010440 tx=0x7f97340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f9743fff700 1 --2- 172.21.15.80:0/3707950756 >> v2:172.21.15.80:3300/0 conn(0x7f9744148320 0x7f974410ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9734010440 tx=0x7f97340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f9743fff700 1 --2- 172.21.15.80:0/3707950756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9744148320 0x7f974410ed50 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f9734010440 tx=0x7f97340102f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f9743fff700 1 --2- 172.21.15.80:0/3707950756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9744148320 0x7f974410ed50 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f9734010440 tx=0x7f97340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f97417fa700 1 -- 172.21.15.80:0/3707950756 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9734000940 con 0x7f9744148320 2019-11-28T11:25:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f9743fff700 1 --2- 172.21.15.80:0/3707950756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9744148320 0x7f974410ed50 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f9734010440 tx=0x7f97340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f97417fa700 1 -- 172.21.15.80:0/3707950756 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9734000940 con 0x7f9744148320 2019-11-28T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f9743fff700 1 --2- 172.21.15.80:0/3707950756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9744148320 0x7f974410ed50 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f9734010440 tx=0x7f97340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f9749b85700 1 -- 172.21.15.80:0/3707950756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974410c810 con 0x7f9744148320 2019-11-28T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f97417fa700 1 -- 172.21.15.80:0/3707950756 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9734001140 con 0x7f9744148320 2019-11-28T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f9749b85700 1 -- 172.21.15.80:0/3707950756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974410c490 con 0x7f9744148320 2019-11-28T11:25:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.102+0000 7f9743fff700 1 --2- 172.21.15.80:0/3707950756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9744148320 0x7f974410ed50 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f9734010440 tx=0x7f97340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.103+0000 7f97417fa700 1 -- 172.21.15.80:0/3707950756 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9734000d60 con 0x7f9744148320 2019-11-28T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.103+0000 7f9743fff700 1 --2- 172.21.15.80:0/3707950756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9744148320 0x7f974410ed50 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f9734010440 tx=0x7f97340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.103+0000 7f97417fa700 1 --2- 172.21.15.80:0/3707950756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f971c018730 0x7f971c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.103+0000 7f97417fa700 1 -- 172.21.15.80:0/3707950756 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f9734031ab0 con 0x7f9744148320 2019-11-28T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.103+0000 7f973bfff700 1 --2- 172.21.15.80:0/3707950756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f971c018730 0x7f971c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.103+0000 7f973bfff700 1 --2- 172.21.15.80:0/3707950756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f971c018730 0x7f971c01abc0 crc :-1 s=READY pgs=52 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.110+0000 7f9749b85700 1 -- 172.21.15.80:0/3707950756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f974410c810 con 0x7f9744148320 2019-11-28T11:25:23.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.114+0000 7f9743fff700 1 --2- 172.21.15.80:0/3707950756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9744148320 0x7f974410ed50 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f9734010440 tx=0x7f97340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.114+0000 7f97417fa700 1 -- 172.21.15.80:0/3707950756 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9734000b50 con 0x7f9744148320 2019-11-28T11:25:23.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.281+0000 7f9749b85700 1 -- 172.21.15.80:0/3707950756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f974410c490 con 0x7f9744148320 2019-11-28T11:25:23.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.281+0000 7f9743fff700 1 --2- 172.21.15.80:0/3707950756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9744148320 0x7f974410ed50 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f9734010440 tx=0x7f97340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.281+0000 7f97417fa700 1 -- 172.21.15.80:0/3707950756 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9734000d60 con 0x7f9744148320 2019-11-28T11:25:23.303 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:23.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.284+0000 7f9749b85700 1 -- 172.21.15.80:0/3707950756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f971c018730 msgr2=0x7f971c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.284+0000 7f9749b85700 1 --2- 172.21.15.80:0/3707950756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f971c018730 0x7f971c01abc0 crc :-1 s=READY pgs=52 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:23.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.284+0000 7f9749b85700 1 -- 172.21.15.80:0/3707950756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9744148320 msgr2=0x7f974410ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.284+0000 7f9749b85700 1 --2- 172.21.15.80:0/3707950756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9744148320 0x7f974410ed50 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f9734010440 tx=0x7f97340102f0).stop 2019-11-28T11:25:23.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.284+0000 7f9749b85700 1 -- 172.21.15.80:0/3707950756 shutdown_connections 2019-11-28T11:25:23.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.284+0000 7f9749b85700 1 --2- 172.21.15.80:0/3707950756 >> v2:172.21.15.174:3300/0 conn(0x7f974410e3d0 0x7f9744168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:23.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.284+0000 7f9749b85700 1 --2- 172.21.15.80:0/3707950756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f971c018730 0x7f971c01abc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:23.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.284+0000 7f9749b85700 1 --2- 172.21.15.80:0/3707950756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9744148320 0x7f974410ed50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:23.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.284+0000 7f9749b85700 1 -- 172.21.15.80:0/3707950756 shutdown_connections 2019-11-28T11:25:23.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.284+0000 7f9749b85700 1 -- 172.21.15.80:0/3707950756 wait complete. 2019-11-28T11:25:23.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.284+0000 7f9749b85700 1 -- 172.21.15.80:0/3707950756 >> 172.21.15.80:0/3707950756 conn(0x7f974415e2d0 msgr2=0x7f9744147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:23.318 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:25:23.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.434+0000 7fbb6cf2d700 1 Processor -- start 2019-11-28T11:25:23.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.434+0000 7fbb6cf2d700 1 -- start start 2019-11-28T11:25:23.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.435+0000 7fbb6cf2d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb6815f100 0x7fbb6806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:23.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.435+0000 7fbb6cf2d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbb6806c2f0 0x7fbb6806c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:23.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.435+0000 7fbb6cf2d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6806db60 con 0x7fbb6815ed10 2019-11-28T11:25:23.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.435+0000 7fbb6cf2d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6806fe00 con 0x7fbb6815f100 2019-11-28T11:25:23.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.435+0000 7fbb6cf2d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb680700d0 con 0x7fbb6806c2f0 2019-11-28T11:25:23.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.435+0000 7fbb6659c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb6815f100 0x7fbb6806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:23.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.435+0000 7fbb66d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbb6815ed10 0x7fbb68073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58544/0 (socket says 172.21.15.80:58544) 2019-11-28T11:25:23.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.435+0000 7fbb6659c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb6815f100 0x7fbb6806bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59232/0 (socket says 172.21.15.80:59232) 2019-11-28T11:25:23.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.435+0000 7fbb66d9d700 1 -- 172.21.15.80:0/2279561726 learned_addr learned my addr 172.21.15.80:0/2279561726 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:23.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.435+0000 7fbb6759e700 1 --2- 172.21.15.80:0/2279561726 >> v2:172.21.15.174:3300/0 conn(0x7fbb6806c2f0 0x7fbb6806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:23.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.436+0000 7fbb6659c700 1 -- 172.21.15.80:0/2279561726 >> v2:172.21.15.174:3300/0 conn(0x7fbb6806c2f0 msgr2=0x7fbb6806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:23.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.436+0000 7fbb6659c700 1 --2- 172.21.15.80:0/2279561726 >> v2:172.21.15.174:3300/0 conn(0x7fbb6806c2f0 0x7fbb6806c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:23.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.436+0000 7fbb6659c700 1 -- 172.21.15.80:0/2279561726 >> v1:172.21.15.80:6789/0 conn(0x7fbb6815ed10 legacy=0x7fbb68073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.436+0000 7fbb65d9b700 1 -- 172.21.15.80:0/2279561726 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694647419 0 0) 0x7fbb58001150 con 0x7fbb6815ed10 2019-11-28T11:25:23.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.436+0000 7fbb6659c700 1 -- 172.21.15.80:0/2279561726 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb68070760 con 0x7fbb6815f100 2019-11-28T11:25:23.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.436+0000 7fbb6659c700 1 --2- 172.21.15.80:0/2279561726 >> v2:172.21.15.80:3300/0 conn(0x7fbb6815f100 0x7fbb6806bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbb5000af50 tx=0x7fbb5000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.436+0000 7fbb6659c700 1 --2- 172.21.15.80:0/2279561726 >> v2:172.21.15.80:3300/0 conn(0x7fbb6815f100 0x7fbb6806bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbb5000af50 tx=0x7fbb5000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.436+0000 7fbb6659c700 1 --2- 172.21.15.80:0/2279561726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb6815f100 0x7fbb6806bdb0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fbb5000af50 tx=0x7fbb5000b6e0).ready entity=mon.0 client_cookie=c3852ad9296ec6c5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:23.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.436+0000 7fbb6659c700 1 --2- 172.21.15.80:0/2279561726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb6815f100 0x7fbb6806bdb0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fbb5000af50 tx=0x7fbb5000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.436+0000 7fbb65d9b700 1 -- 172.21.15.80:0/2279561726 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb50007210 con 0x7fbb6815f100 2019-11-28T11:25:23.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.436+0000 7fbb6659c700 1 --2- 172.21.15.80:0/2279561726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb6815f100 0x7fbb6806bdb0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fbb5000af50 tx=0x7fbb5000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.436+0000 7fbb6659c700 1 --2- 172.21.15.80:0/2279561726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb6815f100 0x7fbb6806bdb0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fbb5000af50 tx=0x7fbb5000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.436+0000 7fbb65d9b700 1 -- 172.21.15.80:0/2279561726 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb500099b0 con 0x7fbb6815f100 2019-11-28T11:25:23.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.436+0000 7fbb65d9b700 1 -- 172.21.15.80:0/2279561726 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb5000a080 con 0x7fbb6815f100 2019-11-28T11:25:23.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.436+0000 7fbb6cf2d700 1 -- 172.21.15.80:0/2279561726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb6815f100 msgr2=0x7fbb6806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.436+0000 7fbb6cf2d700 1 --2- 172.21.15.80:0/2279561726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb6815f100 0x7fbb6806bdb0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fbb5000af50 tx=0x7fbb5000b6e0).stop 2019-11-28T11:25:23.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.437+0000 7fbb6cf2d700 1 -- 172.21.15.80:0/2279561726 shutdown_connections 2019-11-28T11:25:23.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.437+0000 7fbb6cf2d700 1 --2- 172.21.15.80:0/2279561726 >> v2:172.21.15.174:3300/0 conn(0x7fbb6806c2f0 0x7fbb6806c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:23.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.437+0000 7fbb6cf2d700 1 --2- 172.21.15.80:0/2279561726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb6815f100 0x7fbb6806bdb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:23.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.437+0000 7fbb6cf2d700 1 -- 172.21.15.80:0/2279561726 shutdown_connections 2019-11-28T11:25:23.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.437+0000 7fbb6cf2d700 1 -- 172.21.15.80:0/2279561726 wait complete. 2019-11-28T11:25:23.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.437+0000 7fbb6cf2d700 1 -- 172.21.15.80:0/2279561726 >> 172.21.15.80:0/2279561726 conn(0x7fbb68061d20 msgr2=0x7fbb680641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:23.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.439+0000 7fbb6cf2d700 1 Processor -- start 2019-11-28T11:25:23.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.439+0000 7fbb6cf2d700 1 -- start start 2019-11-28T11:25:23.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.440+0000 7fbb6cf2d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb6810e970 0x7fbb681087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:23.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.440+0000 7fbb6cf2d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6810c250 con 0x7fbb68108cf0 2019-11-28T11:25:23.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.440+0000 7fbb6cf2d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6810c6d0 con 0x7fbb68107e30 2019-11-28T11:25:23.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.440+0000 7fbb6cf2d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6810da00 con 0x7fbb6810e970 2019-11-28T11:25:23.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.440+0000 7fbb6659c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbb68108cf0 0x7fbb68107630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58554/0 (socket says 172.21.15.80:58554) 2019-11-28T11:25:23.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.440+0000 7fbb6659c700 1 -- 172.21.15.80:0/4137095925 learned_addr learned my addr 172.21.15.80:0/4137095925 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:23.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.440+0000 7fbb66d9d700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb6810e970 0x7fbb681087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:23.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.440+0000 7fbb5f7fe700 1 -- 172.21.15.80:0/4137095925 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270640349 0 0) 0x7fbb500099a0 con 0x7fbb68108cf0 2019-11-28T11:25:23.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.440+0000 7fbb5f7fe700 1 -- 172.21.15.80:0/4137095925 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb4c002e80 con 0x7fbb68108cf0 2019-11-28T11:25:23.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.440+0000 7fbb5f7fe700 1 -- 172.21.15.80:0/4137095925 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591857382 0 0) 0x7fbb60001400 con 0x7fbb68107e30 2019-11-28T11:25:23.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.440+0000 7fbb5f7fe700 1 -- 172.21.15.80:0/4137095925 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb4c0030b0 con 0x7fbb68107e30 2019-11-28T11:25:23.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.441+0000 7fbb66d9d700 1 -- 172.21.15.80:0/4137095925 >> v1:172.21.15.174:6789/0 conn(0x7fbb68107e30 legacy=0x7fbb68167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.441+0000 7fbb5f7fe700 1 -- 172.21.15.80:0/4137095925 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2003066492 0 0) 0x7fbb50009ba0 con 0x7fbb68108cf0 2019-11-28T11:25:23.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.441+0000 7fbb66d9d700 1 -- 172.21.15.80:0/4137095925 >> v1:172.21.15.80:6789/0 conn(0x7fbb68108cf0 legacy=0x7fbb68107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.441+0000 7fbb66d9d700 1 -- 172.21.15.80:0/4137095925 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb68105ef0 con 0x7fbb6810e970 2019-11-28T11:25:23.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.441+0000 7fbb66d9d700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb6810e970 0x7fbb681087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb58010370 tx=0x7fbb58010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.441+0000 7fbb66d9d700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb6810e970 0x7fbb681087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb58010370 tx=0x7fbb58010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.441+0000 7fbb66d9d700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb6810e970 0x7fbb681087b0 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7fbb58010370 tx=0x7fbb58010710).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:23.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.441+0000 7fbb66d9d700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb6810e970 0x7fbb681087b0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fbb58010370 tx=0x7fbb58010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.441+0000 7fbb5f7fe700 1 -- 172.21.15.80:0/4137095925 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb58000ef0 con 0x7fbb6810e970 2019-11-28T11:25:23.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.441+0000 7fbb66d9d700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb6810e970 0x7fbb681087b0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fbb58010370 tx=0x7fbb58010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.441+0000 7fbb66d9d700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb6810e970 0x7fbb681087b0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fbb58010370 tx=0x7fbb58010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.441+0000 7fbb5f7fe700 1 -- 172.21.15.80:0/4137095925 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb58004240 con 0x7fbb6810e970 2019-11-28T11:25:23.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.441+0000 7fbb5f7fe700 1 -- 172.21.15.80:0/4137095925 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb58004910 con 0x7fbb6810e970 2019-11-28T11:25:23.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.441+0000 7fbb6cf2d700 1 -- 172.21.15.80:0/4137095925 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb68106270 con 0x7fbb6810e970 2019-11-28T11:25:23.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.441+0000 7fbb6cf2d700 1 -- 172.21.15.80:0/4137095925 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb68105ef0 con 0x7fbb6810e970 2019-11-28T11:25:23.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.441+0000 7fbb66d9d700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb6810e970 0x7fbb681087b0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fbb58010370 tx=0x7fbb58010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.442+0000 7fbb5f7fe700 1 -- 172.21.15.80:0/4137095925 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbb58004430 con 0x7fbb6810e970 2019-11-28T11:25:23.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.442+0000 7fbb66d9d700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb6810e970 0x7fbb681087b0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fbb58010370 tx=0x7fbb58010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.442+0000 7fbb5f7fe700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb4c018750 0x7fbb4c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:23.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.442+0000 7fbb5f7fe700 1 -- 172.21.15.80:0/4137095925 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fbb58031a60 con 0x7fbb6810e970 2019-11-28T11:25:23.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.442+0000 7fbb6659c700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb4c018750 0x7fbb4c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:23.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.442+0000 7fbb6659c700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb4c018750 0x7fbb4c01abe0 crc :-1 s=READY pgs=53 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.449+0000 7fbb6cf2d700 1 -- 172.21.15.80:0/4137095925 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb68106270 con 0x7fbb6810e970 2019-11-28T11:25:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.453+0000 7fbb66d9d700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb6810e970 0x7fbb681087b0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fbb58010370 tx=0x7fbb58010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.453+0000 7fbb5f7fe700 1 -- 172.21.15.80:0/4137095925 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbb58000c90 con 0x7fbb6810e970 2019-11-28T11:25:23.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.619+0000 7fbb6cf2d700 1 -- 172.21.15.80:0/4137095925 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fbb68105ef0 con 0x7fbb6810e970 2019-11-28T11:25:23.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.619+0000 7fbb66d9d700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb6810e970 0x7fbb681087b0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fbb58010370 tx=0x7fbb58010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.619+0000 7fbb5f7fe700 1 -- 172.21.15.80:0/4137095925 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fbb58004310 con 0x7fbb6810e970 2019-11-28T11:25:23.640 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.622+0000 7fbb6cf2d700 1 -- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb4c018750 msgr2=0x7fbb4c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.622+0000 7fbb6cf2d700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb4c018750 0x7fbb4c01abe0 crc :-1 s=READY pgs=53 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.622+0000 7fbb6cf2d700 1 -- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb6810e970 msgr2=0x7fbb681087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.622+0000 7fbb6cf2d700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb6810e970 0x7fbb681087b0 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7fbb58010370 tx=0x7fbb58010710).stop 2019-11-28T11:25:23.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.622+0000 7fbb6cf2d700 1 -- 172.21.15.80:0/4137095925 shutdown_connections 2019-11-28T11:25:23.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.622+0000 7fbb6cf2d700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb4c018750 0x7fbb4c01abe0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:23.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.622+0000 7fbb6cf2d700 1 --2- 172.21.15.80:0/4137095925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb6810e970 0x7fbb681087b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:23.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.622+0000 7fbb6cf2d700 1 -- 172.21.15.80:0/4137095925 shutdown_connections 2019-11-28T11:25:23.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.622+0000 7fbb6cf2d700 1 -- 172.21.15.80:0/4137095925 wait complete. 2019-11-28T11:25:23.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.622+0000 7fbb6cf2d700 1 -- 172.21.15.80:0/4137095925 >> 172.21.15.80:0/4137095925 conn(0x7fbb6815e2d0 msgr2=0x7fbb68147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:23.651 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:25:23.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.755+0000 7f76da80c700 1 Processor -- start 2019-11-28T11:25:23.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.755+0000 7f76da80c700 1 -- start start 2019-11-28T11:25:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.756+0000 7f76da80c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f76d415f100 0x7f76d406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.756+0000 7f76da80c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d406db60 con 0x7f76d415ed10 2019-11-28T11:25:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.756+0000 7f76da80c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d406e060 con 0x7f76d406c2f0 2019-11-28T11:25:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.756+0000 7f76da80c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d406fe00 con 0x7f76d415f100 2019-11-28T11:25:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.756+0000 7f76d3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f76d415f100 0x7f76d406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.756+0000 7f76d3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f76d415f100 0x7f76d406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59244/0 (socket says 172.21.15.80:59244) 2019-11-28T11:25:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.756+0000 7f76d3fff700 1 -- 172.21.15.80:0/2780584712 learned_addr learned my addr 172.21.15.80:0/2780584712 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.756+0000 7f76d8da9700 1 --1- 172.21.15.80:0/2780584712 >> v1:172.21.15.80:6789/0 conn(0x7f76d415ed10 0x7f76d4073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58558/0 (socket says 172.21.15.80:58558) 2019-11-28T11:25:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.757+0000 7f76d3fff700 1 -- 172.21.15.80:0/2780584712 >> v1:172.21.15.174:6789/0 conn(0x7f76d406c2f0 legacy=0x7f76d406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.757+0000 7f76d3fff700 1 -- 172.21.15.80:0/2780584712 >> v1:172.21.15.80:6789/0 conn(0x7f76d415ed10 legacy=0x7f76d4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.757+0000 7f76d3fff700 1 -- 172.21.15.80:0/2780584712 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d4070760 con 0x7f76d415f100 2019-11-28T11:25:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.757+0000 7f76d3fff700 1 --2- 172.21.15.80:0/2780584712 >> v2:172.21.15.80:3300/0 conn(0x7f76d415f100 0x7f76d406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f76c400fac0 tx=0x7f76c400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.757+0000 7f76d3fff700 1 --2- 172.21.15.80:0/2780584712 >> v2:172.21.15.80:3300/0 conn(0x7f76d415f100 0x7f76d406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f76c400fac0 tx=0x7f76c400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.757+0000 7f76d3fff700 1 --2- 172.21.15.80:0/2780584712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76d415f100 0x7f76d406bdb0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f76c400fac0 tx=0x7f76c400fe60).ready entity=mon.0 client_cookie=dcd7912b259cac18 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.757+0000 7f76d3fff700 1 --2- 172.21.15.80:0/2780584712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76d415f100 0x7f76d406bdb0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f76c400fac0 tx=0x7f76c400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.757+0000 7f76d3fff700 1 --2- 172.21.15.80:0/2780584712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76d415f100 0x7f76d406bdb0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f76c400fac0 tx=0x7f76c400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.757+0000 7f76d37fe700 1 -- 172.21.15.80:0/2780584712 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76c4000ce0 con 0x7f76d415f100 2019-11-28T11:25:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.757+0000 7f76d3fff700 1 --2- 172.21.15.80:0/2780584712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76d415f100 0x7f76d406bdb0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f76c400fac0 tx=0x7f76c400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.757+0000 7f76d37fe700 1 -- 172.21.15.80:0/2780584712 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c4001010 con 0x7f76d415f100 2019-11-28T11:25:23.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.757+0000 7f76d37fe700 1 -- 172.21.15.80:0/2780584712 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76c40016e0 con 0x7f76d415f100 2019-11-28T11:25:23.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.757+0000 7f76da80c700 1 -- 172.21.15.80:0/2780584712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76d415f100 msgr2=0x7f76d406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.757+0000 7f76da80c700 1 --2- 172.21.15.80:0/2780584712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76d415f100 0x7f76d406bdb0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f76c400fac0 tx=0x7f76c400fe60).stop 2019-11-28T11:25:23.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.758+0000 7f76da80c700 1 -- 172.21.15.80:0/2780584712 shutdown_connections 2019-11-28T11:25:23.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.758+0000 7f76da80c700 1 --2- 172.21.15.80:0/2780584712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76d415f100 0x7f76d406bdb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:23.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.758+0000 7f76da80c700 1 -- 172.21.15.80:0/2780584712 shutdown_connections 2019-11-28T11:25:23.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.758+0000 7f76da80c700 1 -- 172.21.15.80:0/2780584712 wait complete. 2019-11-28T11:25:23.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.758+0000 7f76da80c700 1 -- 172.21.15.80:0/2780584712 >> 172.21.15.80:0/2780584712 conn(0x7f76d4061d20 msgr2=0x7f76d40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:23.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.760+0000 7f76da80c700 1 Processor -- start 2019-11-28T11:25:23.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.760+0000 7f76da80c700 1 -- start start 2019-11-28T11:25:23.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.761+0000 7f76da80c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76d4165190 0x7f76d4165620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:23.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.761+0000 7f76da80c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d4162a90 con 0x7f76d4127280 2019-11-28T11:25:23.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.761+0000 7f76da80c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d4165e70 con 0x7f76d412e9a0 2019-11-28T11:25:23.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.761+0000 7f76da80c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d4075800 con 0x7f76d4165190 2019-11-28T11:25:23.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.761+0000 7f76d8da9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f76d4127280 0x7f76d4079840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58566/0 (socket says 172.21.15.80:58566) 2019-11-28T11:25:23.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.761+0000 7f76d8da9700 1 -- 172.21.15.80:0/4154366619 learned_addr learned my addr 172.21.15.80:0/4154366619 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:23.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d3fff700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76d4165190 0x7f76d4165620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:23.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d17fa700 1 -- 172.21.15.80:0/4154366619 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513538341 0 0) 0x7f76bc001100 con 0x7f76d4127280 2019-11-28T11:25:23.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d17fa700 1 -- 172.21.15.80:0/4154366619 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76b8002e80 con 0x7f76d4127280 2019-11-28T11:25:23.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d17fa700 1 -- 172.21.15.80:0/4154366619 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146961616 0 0) 0x7f76cc0009b0 con 0x7f76d412e9a0 2019-11-28T11:25:23.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d17fa700 1 -- 172.21.15.80:0/4154366619 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76b80030b0 con 0x7f76d412e9a0 2019-11-28T11:25:23.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d17fa700 1 -- 172.21.15.80:0/4154366619 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 97096205 0 0) 0x7f76bc001300 con 0x7f76d4127280 2019-11-28T11:25:23.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d3fff700 1 -- 172.21.15.80:0/4154366619 >> v1:172.21.15.174:6789/0 conn(0x7f76d412e9a0 legacy=0x7f76d4077830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d3fff700 1 -- 172.21.15.80:0/4154366619 >> v1:172.21.15.80:6789/0 conn(0x7f76d4127280 legacy=0x7f76d4079840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d3fff700 1 -- 172.21.15.80:0/4154366619 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d4076160 con 0x7f76d4165190 2019-11-28T11:25:23.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d3fff700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76d4165190 0x7f76d4165620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f76c4010710 tx=0x7f76c4010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d3fff700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76d4165190 0x7f76d4165620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f76c4010710 tx=0x7f76c4010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d3fff700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76d4165190 0x7f76d4165620 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f76c4010710 tx=0x7f76c4010ab0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:23.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d3fff700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76d4165190 0x7f76d4165620 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f76c4010710 tx=0x7f76c4010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d17fa700 1 -- 172.21.15.80:0/4154366619 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76c4005af0 con 0x7f76d4165190 2019-11-28T11:25:23.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d3fff700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76d4165190 0x7f76d4165620 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f76c4010710 tx=0x7f76c4010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d3fff700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76d4165190 0x7f76d4165620 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f76c4010710 tx=0x7f76c4010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d17fa700 1 -- 172.21.15.80:0/4154366619 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c4005710 con 0x7f76d4165190 2019-11-28T11:25:23.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76d17fa700 1 -- 172.21.15.80:0/4154366619 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76c40060d0 con 0x7f76d4165190 2019-11-28T11:25:23.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76da80c700 1 -- 172.21.15.80:0/4154366619 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d40764e0 con 0x7f76d4165190 2019-11-28T11:25:23.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.762+0000 7f76da80c700 1 -- 172.21.15.80:0/4154366619 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d4076160 con 0x7f76d4165190 2019-11-28T11:25:23.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.763+0000 7f76d3fff700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76d4165190 0x7f76d4165620 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f76c4010710 tx=0x7f76c4010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.763+0000 7f76d17fa700 1 -- 172.21.15.80:0/4154366619 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f76c4007af0 con 0x7f76d4165190 2019-11-28T11:25:23.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.763+0000 7f76d3fff700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76d4165190 0x7f76d4165620 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f76c4010710 tx=0x7f76c4010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.763+0000 7f76d17fa700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f76b8018750 0x7f76b801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:23.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.763+0000 7f76d17fa700 1 -- 172.21.15.80:0/4154366619 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f76c4031e60 con 0x7f76d4165190 2019-11-28T11:25:23.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.763+0000 7f76d8da9700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f76b8018750 0x7f76b801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:23.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.763+0000 7f76d8da9700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f76b8018750 0x7f76b801abe0 crc :-1 s=READY pgs=54 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:23.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.770+0000 7f76da80c700 1 -- 172.21.15.80:0/4154366619 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d40764e0 con 0x7f76d4165190 2019-11-28T11:25:23.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.774+0000 7f76d3fff700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76d4165190 0x7f76d4165620 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f76c4010710 tx=0x7f76c4010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.774+0000 7f76d17fa700 1 -- 172.21.15.80:0/4154366619 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f76c402dea0 con 0x7f76d4165190 2019-11-28T11:25:23.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.942+0000 7f76da80c700 1 -- 172.21.15.80:0/4154366619 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f76d4076160 con 0x7f76d4165190 2019-11-28T11:25:23.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.942+0000 7f76d3fff700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76d4165190 0x7f76d4165620 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f76c4010710 tx=0x7f76c4010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:23.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.942+0000 7f76d17fa700 1 -- 172.21.15.80:0/4154366619 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f76c4007af0 con 0x7f76d4165190 2019-11-28T11:25:23.963 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:23.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.944+0000 7f76da80c700 1 -- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f76b8018750 msgr2=0x7f76b801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.944+0000 7f76da80c700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f76b8018750 0x7f76b801abe0 crc :-1 s=READY pgs=54 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:23.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.944+0000 7f76da80c700 1 -- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76d4165190 msgr2=0x7f76d4165620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:23.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.944+0000 7f76da80c700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76d4165190 0x7f76d4165620 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f76c4010710 tx=0x7f76c4010ab0).stop 2019-11-28T11:25:23.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.945+0000 7f76da80c700 1 -- 172.21.15.80:0/4154366619 shutdown_connections 2019-11-28T11:25:23.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.945+0000 7f76da80c700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f76b8018750 0x7f76b801abe0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:23.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.945+0000 7f76da80c700 1 --2- 172.21.15.80:0/4154366619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76d4165190 0x7f76d4165620 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:23.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.945+0000 7f76da80c700 1 -- 172.21.15.80:0/4154366619 shutdown_connections 2019-11-28T11:25:23.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.945+0000 7f76da80c700 1 -- 172.21.15.80:0/4154366619 wait complete. 2019-11-28T11:25:23.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:23.945+0000 7f76da80c700 1 -- 172.21.15.80:0/4154366619 >> 172.21.15.80:0/4154366619 conn(0x7f76d4166440 msgr2=0x7f76d41494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:23.974 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2019-11-28T11:25:23.974 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2019-11-28T11:25:23.974 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2019-11-28T11:25:24.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.074+0000 7f346abbe700 1 Processor -- start 2019-11-28T11:25:24.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.074+0000 7f346abbe700 1 -- start start 2019-11-28T11:25:24.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f346abbe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346406c0a0 0x7f3464072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:24.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f346abbe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3464072620 0x7f3464164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:24.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f346abbe700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346406db00 con 0x7f34640734e0 2019-11-28T11:25:24.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f346abbe700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346406f330 con 0x7f3464072620 2019-11-28T11:25:24.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f346abbe700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34640706c0 con 0x7f346406c0a0 2019-11-28T11:25:24.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f346895a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f34640734e0 0x7f3464071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58576/0 (socket says 172.21.15.80:58576) 2019-11-28T11:25:24.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f346895a700 1 -- 172.21.15.80:0/2764623902 learned_addr learned my addr 172.21.15.80:0/2764623902 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:24.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f346995c700 1 --2- 172.21.15.80:0/2764623902 >> v2:172.21.15.174:3300/0 conn(0x7f3464072620 0x7f3464164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:24.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f346915b700 1 --2- 172.21.15.80:0/2764623902 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346406c0a0 0x7f3464072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:24.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f3463fff700 1 -- 172.21.15.80:0/2764623902 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137153338 0 0) 0x7f344c0013f0 con 0x7f34640734e0 2019-11-28T11:25:24.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f3463fff700 1 -- 172.21.15.80:0/2764623902 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3450002e80 con 0x7f34640734e0 2019-11-28T11:25:24.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f346995c700 1 -- 172.21.15.80:0/2764623902 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346406c0a0 msgr2=0x7f3464072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:24.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f346995c700 1 --2- 172.21.15.80:0/2764623902 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346406c0a0 0x7f3464072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:24.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f346995c700 1 -- 172.21.15.80:0/2764623902 >> v1:172.21.15.80:6789/0 conn(0x7f34640734e0 legacy=0x7f3464071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f3463fff700 1 -- 172.21.15.80:0/2764623902 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3524681079 0 0) 0x7f344c0013d0 con 0x7f34640734e0 2019-11-28T11:25:24.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f346995c700 1 -- 172.21.15.80:0/2764623902 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464070a40 con 0x7f3464072620 2019-11-28T11:25:24.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.075+0000 7f346995c700 1 --2- 172.21.15.80:0/2764623902 >> v2:172.21.15.174:3300/0 conn(0x7f3464072620 0x7f3464164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f345c00af80 tx=0x7f345c00b710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.076+0000 7f346995c700 1 --2- 172.21.15.80:0/2764623902 >> v2:172.21.15.174:3300/0 conn(0x7f3464072620 0x7f3464164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f345c00af80 tx=0x7f345c00b710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.076+0000 7f346995c700 1 --2- 172.21.15.80:0/2764623902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3464072620 0x7f3464164d70 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f345c00af80 tx=0x7f345c00b710).ready entity=mon.1 client_cookie=2d8cd1f2ba24799e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:24.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.076+0000 7f346995c700 1 --2- 172.21.15.80:0/2764623902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3464072620 0x7f3464164d70 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f345c00af80 tx=0x7f345c00b710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.076+0000 7f346995c700 1 --2- 172.21.15.80:0/2764623902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3464072620 0x7f3464164d70 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f345c00af80 tx=0x7f345c00b710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.076+0000 7f3463fff700 1 -- 172.21.15.80:0/2764623902 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f345c007240 con 0x7f3464072620 2019-11-28T11:25:24.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.076+0000 7f346995c700 1 --2- 172.21.15.80:0/2764623902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3464072620 0x7f3464164d70 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f345c00af80 tx=0x7f345c00b710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.076+0000 7f3463fff700 1 -- 172.21.15.80:0/2764623902 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c000b10 con 0x7f3464072620 2019-11-28T11:25:24.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.076+0000 7f3463fff700 1 -- 172.21.15.80:0/2764623902 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f345c009f50 con 0x7f3464072620 2019-11-28T11:25:24.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.076+0000 7f346abbe700 1 -- 172.21.15.80:0/2764623902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3464072620 msgr2=0x7f3464164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.076+0000 7f346abbe700 1 --2- 172.21.15.80:0/2764623902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3464072620 0x7f3464164d70 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f345c00af80 tx=0x7f345c00b710).stop 2019-11-28T11:25:24.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.076+0000 7f346abbe700 1 -- 172.21.15.80:0/2764623902 shutdown_connections 2019-11-28T11:25:24.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.076+0000 7f346abbe700 1 --2- 172.21.15.80:0/2764623902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3464072620 0x7f3464164d70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:24.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.076+0000 7f346abbe700 1 --2- 172.21.15.80:0/2764623902 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346406c0a0 0x7f3464072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:24.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.077+0000 7f346abbe700 1 -- 172.21.15.80:0/2764623902 shutdown_connections 2019-11-28T11:25:24.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.077+0000 7f346abbe700 1 -- 172.21.15.80:0/2764623902 wait complete. 2019-11-28T11:25:24.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.077+0000 7f346abbe700 1 -- 172.21.15.80:0/2764623902 >> 172.21.15.80:0/2764623902 conn(0x7f3464061cf0 msgr2=0x7f3464064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:24.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.079+0000 7f346abbe700 1 Processor -- start 2019-11-28T11:25:24.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.079+0000 7f346abbe700 1 -- start start 2019-11-28T11:25:24.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346abbe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f346413e5f0 0x7f346413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:24.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346abbe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346410a070 0x7f346410bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:24.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346abbe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f346410a4e0 0x7f346410c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:24.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346abbe700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346410e060 con 0x7f346410a4e0 2019-11-28T11:25:24.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346abbe700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346410e330 con 0x7f346413e5f0 2019-11-28T11:25:24.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346abbe700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346410d630 con 0x7f346410a070 2019-11-28T11:25:24.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346995c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f346410a4e0 0x7f346410c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:24.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346995c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f346410a4e0 0x7f346410c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59266/0 (socket says 172.21.15.80:59266) 2019-11-28T11:25:24.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346995c700 1 -- 172.21.15.80:0/1519536497 learned_addr learned my addr 172.21.15.80:0/1519536497 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:24.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346915b700 1 --2- 172.21.15.80:0/1519536497 >> v2:172.21.15.174:3300/0 conn(0x7f346413e5f0 0x7f346413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:24.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346895a700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346410a070 0x7f346410bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:24.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346995c700 1 -- 172.21.15.80:0/1519536497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346410a070 msgr2=0x7f346410bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346995c700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346410a070 0x7f346410bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:24.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346995c700 1 -- 172.21.15.80:0/1519536497 >> v2:172.21.15.174:3300/0 conn(0x7f346413e5f0 msgr2=0x7f346413e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346995c700 1 --2- 172.21.15.80:0/1519536497 >> v2:172.21.15.174:3300/0 conn(0x7f346413e5f0 0x7f346413e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:24.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346995c700 1 -- 172.21.15.80:0/1519536497 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346410e9c0 con 0x7f346410a4e0 2019-11-28T11:25:24.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.080+0000 7f346995c700 1 --2- 172.21.15.80:0/1519536497 >> v2:172.21.15.80:3300/0 conn(0x7f346410a4e0 0x7f346410c2f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f345c0103e0 tx=0x7f345c010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.081+0000 7f346995c700 1 --2- 172.21.15.80:0/1519536497 >> v2:172.21.15.80:3300/0 conn(0x7f346410a4e0 0x7f346410c2f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f345c0103e0 tx=0x7f345c010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.081+0000 7f346995c700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346410a4e0 0x7f346410c2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f345c0103e0 tx=0x7f345c010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:24.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.081+0000 7f346995c700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346410a4e0 0x7f346410c2f0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f345c0103e0 tx=0x7f345c010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.081+0000 7f3461ffb700 1 -- 172.21.15.80:0/1519536497 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f345c00a8e0 con 0x7f346410a4e0 2019-11-28T11:25:24.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.081+0000 7f346995c700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346410a4e0 0x7f346410c2f0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f345c0103e0 tx=0x7f345c010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.081+0000 7f3461ffb700 1 -- 172.21.15.80:0/1519536497 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c0099b0 con 0x7f346410a4e0 2019-11-28T11:25:24.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.081+0000 7f346995c700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346410a4e0 0x7f346410c2f0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f345c0103e0 tx=0x7f345c010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.081+0000 7f3461ffb700 1 -- 172.21.15.80:0/1519536497 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f345c009ba0 con 0x7f346410a4e0 2019-11-28T11:25:24.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.081+0000 7f346abbe700 1 -- 172.21.15.80:0/1519536497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346410ed40 con 0x7f346410a4e0 2019-11-28T11:25:24.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.081+0000 7f346abbe700 1 -- 172.21.15.80:0/1519536497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346410e9c0 con 0x7f346410a4e0 2019-11-28T11:25:24.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.081+0000 7f346995c700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346410a4e0 0x7f346410c2f0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f345c0103e0 tx=0x7f345c010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.081+0000 7f3461ffb700 1 -- 172.21.15.80:0/1519536497 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f345c00a840 con 0x7f346410a4e0 2019-11-28T11:25:24.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.081+0000 7f346995c700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346410a4e0 0x7f346410c2f0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f345c0103e0 tx=0x7f345c010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.081+0000 7f3461ffb700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3448018730 0x7f344801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:24.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.082+0000 7f3461ffb700 1 -- 172.21.15.80:0/1519536497 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f345c031a90 con 0x7f346410a4e0 2019-11-28T11:25:24.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.082+0000 7f346915b700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3448018730 0x7f344801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:24.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.082+0000 7f346915b700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3448018730 0x7f344801abc0 crc :-1 s=READY pgs=55 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:24.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.089+0000 7f346abbe700 1 -- 172.21.15.80:0/1519536497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346410ed40 con 0x7f346410a4e0 2019-11-28T11:25:24.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.092+0000 7f346995c700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346410a4e0 0x7f346410c2f0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f345c0103e0 tx=0x7f345c010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.092+0000 7f3461ffb700 1 -- 172.21.15.80:0/1519536497 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f345c02f630 con 0x7f346410a4e0 2019-11-28T11:25:24.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.315+0000 7f346abbe700 1 -- 172.21.15.80:0/1519536497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f346410e9c0 con 0x7f346410a4e0 2019-11-28T11:25:24.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.316+0000 7f346995c700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346410a4e0 0x7f346410c2f0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f345c0103e0 tx=0x7f345c010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.316+0000 7f3461ffb700 1 -- 172.21.15.80:0/1519536497 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v3) v1 ==== 74+0+70898 (secure 0 0 0) 0x7f345c02f630 con 0x7f346410a4e0 2019-11-28T11:25:24.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.320+0000 7f346abbe700 1 -- 172.21.15.80:0/1519536497 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3448018730 msgr2=0x7f344801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.320+0000 7f346abbe700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3448018730 0x7f344801abc0 crc :-1 s=READY pgs=55 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:24.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.320+0000 7f346abbe700 1 -- 172.21.15.80:0/1519536497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346410a4e0 msgr2=0x7f346410c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.320+0000 7f346abbe700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346410a4e0 0x7f346410c2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f345c0103e0 tx=0x7f345c010290).stop 2019-11-28T11:25:24.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.320+0000 7f346abbe700 1 -- 172.21.15.80:0/1519536497 shutdown_connections 2019-11-28T11:25:24.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.320+0000 7f346abbe700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3448018730 0x7f344801abc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:24.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.320+0000 7f346abbe700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346410a4e0 0x7f346410c2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:24.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.320+0000 7f346abbe700 1 --2- 172.21.15.80:0/1519536497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346410a070 0x7f346410bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:24.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.320+0000 7f346abbe700 1 --2- 172.21.15.80:0/1519536497 >> v2:172.21.15.174:3300/0 conn(0x7f346413e5f0 0x7f346413e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:24.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.320+0000 7f346abbe700 1 -- 172.21.15.80:0/1519536497 shutdown_connections 2019-11-28T11:25:24.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.320+0000 7f346abbe700 1 -- 172.21.15.80:0/1519536497 wait complete. 2019-11-28T11:25:24.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.320+0000 7f346abbe700 1 -- 172.21.15.80:0/1519536497 >> 172.21.15.80:0/1519536497 conn(0x7f346413d620 msgr2=0x7f346413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:24.356 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:24.358 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":3,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":36016},{"type":"v1","addr":"172.21.15.174:6801","nonce":36016}]},"active_addr":"172.21.15.174:6801/36016","active_change":"2019-11-28T11:24:58.053800+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"float","level":"advanced","flags":1,"default_value":"0.01","min":"0","max":"1","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the ratio between the fullest and least-full OSD is below this value then we stop trying to optimize placement.","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"float","level":"advanced","flags":1,"default_value":"0.01","min":"0","max":"1","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the ratio between the fullest and least-full OSD is below this value then we stop trying to optimize placement.","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]}} 2019-11-28T11:25:24.363 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2019-11-28T11:25:24.363 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2019-11-28T11:25:24.363 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:24.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.463+0000 7f5d16e92700 1 Processor -- start 2019-11-28T11:25:24.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.464+0000 7f5d16e92700 1 -- start start 2019-11-28T11:25:24.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d16e92700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5d1006c490 0x7f5d1006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:24.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d16e92700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1006db00 con 0x7f5d1006c0a0 2019-11-28T11:25:24.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d16e92700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1006e000 con 0x7f5d1006ce60 2019-11-28T11:25:24.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d16e92700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1006fd60 con 0x7f5d1006c490 2019-11-28T11:25:24.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d1542f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5d1006c0a0 0x7f5d10072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58586/0 (socket says 172.21.15.80:58586) 2019-11-28T11:25:24.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d1542f700 1 -- 172.21.15.80:0/313127499 learned_addr learned my addr 172.21.15.80:0/313127499 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:24.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d14c2e700 1 --2- 172.21.15.80:0/313127499 >> v2:172.21.15.174:3300/0 conn(0x7f5d1006c490 0x7f5d1006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:24.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d0ffff700 1 -- 172.21.15.80:0/313127499 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416737094 0 0) 0x7f5d040014d0 con 0x7f5d1006c0a0 2019-11-28T11:25:24.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d0ffff700 1 -- 172.21.15.80:0/313127499 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d00002e80 con 0x7f5d1006c0a0 2019-11-28T11:25:24.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d0ffff700 1 -- 172.21.15.80:0/313127499 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729508981 0 0) 0x7f5d08001080 con 0x7f5d1006ce60 2019-11-28T11:25:24.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d0ffff700 1 -- 172.21.15.80:0/313127499 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d000030b0 con 0x7f5d1006ce60 2019-11-28T11:25:24.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d14c2e700 1 -- 172.21.15.80:0/313127499 >> v1:172.21.15.174:6789/0 conn(0x7f5d1006ce60 legacy=0x7f5d10164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d14c2e700 1 -- 172.21.15.80:0/313127499 >> v1:172.21.15.80:6789/0 conn(0x7f5d1006c0a0 legacy=0x7f5d10072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d14c2e700 1 -- 172.21.15.80:0/313127499 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d100706c0 con 0x7f5d1006c490 2019-11-28T11:25:24.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d14c2e700 1 --2- 172.21.15.80:0/313127499 >> v2:172.21.15.174:3300/0 conn(0x7f5d1006c490 0x7f5d1006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5cfc00af50 tx=0x7f5cfc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d14c2e700 1 --2- 172.21.15.80:0/313127499 >> v2:172.21.15.174:3300/0 conn(0x7f5d1006c490 0x7f5d1006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5cfc00af50 tx=0x7f5cfc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d14c2e700 1 --2- 172.21.15.80:0/313127499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d1006c490 0x7f5d1006c920 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f5cfc00af50 tx=0x7f5cfc00b760).ready entity=mon.1 client_cookie=c4a61f42da076aec server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:24.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d14c2e700 1 --2- 172.21.15.80:0/313127499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d1006c490 0x7f5d1006c920 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f5cfc00af50 tx=0x7f5cfc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d0ffff700 1 -- 172.21.15.80:0/313127499 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cfc000960 con 0x7f5d1006c490 2019-11-28T11:25:24.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d14c2e700 1 --2- 172.21.15.80:0/313127499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d1006c490 0x7f5d1006c920 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f5cfc00af50 tx=0x7f5cfc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d14c2e700 1 --2- 172.21.15.80:0/313127499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d1006c490 0x7f5d1006c920 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f5cfc00af50 tx=0x7f5cfc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d0ffff700 1 -- 172.21.15.80:0/313127499 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc009860 con 0x7f5d1006c490 2019-11-28T11:25:24.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.465+0000 7f5d0ffff700 1 -- 172.21.15.80:0/313127499 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cfc009f30 con 0x7f5d1006c490 2019-11-28T11:25:24.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.466+0000 7f5d16e92700 1 -- 172.21.15.80:0/313127499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d1006c490 msgr2=0x7f5d1006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.466+0000 7f5d16e92700 1 --2- 172.21.15.80:0/313127499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d1006c490 0x7f5d1006c920 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f5cfc00af50 tx=0x7f5cfc00b760).stop 2019-11-28T11:25:24.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.466+0000 7f5d16e92700 1 -- 172.21.15.80:0/313127499 shutdown_connections 2019-11-28T11:25:24.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.466+0000 7f5d16e92700 1 --2- 172.21.15.80:0/313127499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d1006c490 0x7f5d1006c920 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:24.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.466+0000 7f5d16e92700 1 -- 172.21.15.80:0/313127499 shutdown_connections 2019-11-28T11:25:24.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.466+0000 7f5d16e92700 1 -- 172.21.15.80:0/313127499 wait complete. 2019-11-28T11:25:24.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.466+0000 7f5d16e92700 1 -- 172.21.15.80:0/313127499 >> 172.21.15.80:0/313127499 conn(0x7f5d10061cf0 msgr2=0x7f5d10064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:24.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.469+0000 7f5d16e92700 1 Processor -- start 2019-11-28T11:25:24.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.469+0000 7f5d16e92700 1 -- start start 2019-11-28T11:25:24.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d16e92700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5d101065d0 0x7f5d10138680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:24.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d16e92700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d1013eb00 0x7f5d1012d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:24.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d16e92700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d10106fc0 con 0x7f5d10138bc0 2019-11-28T11:25:24.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d16e92700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d10134680 con 0x7f5d101065d0 2019-11-28T11:25:24.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d16e92700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d10134950 con 0x7f5d1013eb00 2019-11-28T11:25:24.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d1542f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5d101065d0 0x7f5d10138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:24.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d1542f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5d101065d0 0x7f5d10138680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59276/0 (socket says 172.21.15.80:59276) 2019-11-28T11:25:24.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d1542f700 1 -- 172.21.15.80:0/2655123043 learned_addr learned my addr 172.21.15.80:0/2655123043 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:24.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d15c30700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d1013eb00 0x7f5d1012d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:24.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d0dffb700 1 -- 172.21.15.80:0/2655123043 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781973011 0 0) 0x7f5cfc00b3d0 con 0x7f5d10138bc0 2019-11-28T11:25:24.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d1542f700 1 -- 172.21.15.80:0/2655123043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d1013eb00 msgr2=0x7f5d1012d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d1542f700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d1013eb00 0x7f5d1012d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:24.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d1542f700 1 -- 172.21.15.80:0/2655123043 >> v1:172.21.15.174:6789/0 conn(0x7f5d10138bc0 legacy=0x7f5d1013e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d1542f700 1 -- 172.21.15.80:0/2655123043 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d10134fe0 con 0x7f5d101065d0 2019-11-28T11:25:24.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d1542f700 1 --2- 172.21.15.80:0/2655123043 >> v2:172.21.15.80:3300/0 conn(0x7f5d101065d0 0x7f5d10138680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5d04010760 tx=0x7f5d040105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d1542f700 1 --2- 172.21.15.80:0/2655123043 >> v2:172.21.15.80:3300/0 conn(0x7f5d101065d0 0x7f5d10138680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5d04010760 tx=0x7f5d040105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d1542f700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d101065d0 0x7f5d10138680 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f5d04010760 tx=0x7f5d040105e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:24.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d1542f700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d101065d0 0x7f5d10138680 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f5d04010760 tx=0x7f5d040105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.470+0000 7f5d0dffb700 1 -- 172.21.15.80:0/2655123043 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d04001010 con 0x7f5d101065d0 2019-11-28T11:25:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.471+0000 7f5d16e92700 1 -- 172.21.15.80:0/2655123043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d10135360 con 0x7f5d101065d0 2019-11-28T11:25:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.471+0000 7f5d1542f700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d101065d0 0x7f5d10138680 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f5d04010760 tx=0x7f5d040105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.471+0000 7f5d16e92700 1 -- 172.21.15.80:0/2655123043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d10136440 con 0x7f5d101065d0 2019-11-28T11:25:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.471+0000 7f5d1542f700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d101065d0 0x7f5d10138680 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f5d04010760 tx=0x7f5d040105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.471+0000 7f5d0dffb700 1 -- 172.21.15.80:0/2655123043 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d04007950 con 0x7f5d101065d0 2019-11-28T11:25:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.471+0000 7f5d0dffb700 1 -- 172.21.15.80:0/2655123043 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d04001010 con 0x7f5d101065d0 2019-11-28T11:25:24.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.471+0000 7f5d1542f700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d101065d0 0x7f5d10138680 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f5d04010760 tx=0x7f5d040105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.471+0000 7f5d0dffb700 1 -- 172.21.15.80:0/2655123043 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5d04001150 con 0x7f5d101065d0 2019-11-28T11:25:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.471+0000 7f5d1542f700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d101065d0 0x7f5d10138680 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f5d04010760 tx=0x7f5d040105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.471+0000 7f5d0dffb700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5cf0018730 0x7f5cf001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.471+0000 7f5d0dffb700 1 -- 172.21.15.80:0/2655123043 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f5d04032080 con 0x7f5d101065d0 2019-11-28T11:25:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.471+0000 7f5d14c2e700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5cf0018730 0x7f5cf001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:24.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.472+0000 7f5d14c2e700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5cf0018730 0x7f5cf001abc0 crc :-1 s=READY pgs=56 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:24.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.479+0000 7f5d16e92700 1 -- 172.21.15.80:0/2655123043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d10134fe0 con 0x7f5d101065d0 2019-11-28T11:25:24.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.482+0000 7f5d1542f700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d101065d0 0x7f5d10138680 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f5d04010760 tx=0x7f5d040105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.482+0000 7f5d0dffb700 1 -- 172.21.15.80:0/2655123043 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5d040178b0 con 0x7f5d101065d0 2019-11-28T11:25:24.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.659+0000 7f5d16e92700 1 -- 172.21.15.80:0/2655123043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d10135360 con 0x7f5d101065d0 2019-11-28T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.660+0000 7f5d1542f700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d101065d0 0x7f5d10138680 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f5d04010760 tx=0x7f5d040105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.660+0000 7f5d0dffb700 1 -- 172.21.15.80:0/2655123043 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14885 (secure 0 0 0) 0x7f5d04021480 con 0x7f5d101065d0 2019-11-28T11:25:24.680 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:24.681 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:20.933435+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:25:14.914696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-11-28T11:25:17.566323+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:24.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.662+0000 7f5d16e92700 1 -- 172.21.15.80:0/2655123043 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5cf0018730 msgr2=0x7f5cf001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.662+0000 7f5d16e92700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5cf0018730 0x7f5cf001abc0 crc :-1 s=READY pgs=56 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:24.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.662+0000 7f5d16e92700 1 -- 172.21.15.80:0/2655123043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d101065d0 msgr2=0x7f5d10138680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.662+0000 7f5d16e92700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d101065d0 0x7f5d10138680 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f5d04010760 tx=0x7f5d040105e0).stop 2019-11-28T11:25:24.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.662+0000 7f5d16e92700 1 -- 172.21.15.80:0/2655123043 shutdown_connections 2019-11-28T11:25:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.662+0000 7f5d16e92700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d1013eb00 0x7f5d1012d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.662+0000 7f5d16e92700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5cf0018730 0x7f5cf001abc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.662+0000 7f5d16e92700 1 --2- 172.21.15.80:0/2655123043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d101065d0 0x7f5d10138680 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.662+0000 7f5d16e92700 1 -- 172.21.15.80:0/2655123043 shutdown_connections 2019-11-28T11:25:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.662+0000 7f5d16e92700 1 -- 172.21.15.80:0/2655123043 wait complete. 2019-11-28T11:25:24.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.662+0000 7f5d16e92700 1 -- 172.21.15.80:0/2655123043 >> 172.21.15.80:0/2655123043 conn(0x7f5d1013d930 msgr2=0x7f5d10102360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:24.691 INFO:tasks.ceph.ceph_manager.ceph:all up! 2019-11-28T11:25:24.692 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:24.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.791+0000 7f68b8a0b700 1 Processor -- start 2019-11-28T11:25:24.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.791+0000 7f68b8a0b700 1 -- start start 2019-11-28T11:25:24.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.792+0000 7f68b8a0b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68b406c490 0x7f68b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:24.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.792+0000 7f68b8a0b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f68b406ce60 0x7f68b4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:24.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.792+0000 7f68b8a0b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b406db00 con 0x7f68b406c0a0 2019-11-28T11:25:24.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.792+0000 7f68b8a0b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b406fd60 con 0x7f68b406ce60 2019-11-28T11:25:24.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.792+0000 7f68b8a0b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b4070030 con 0x7f68b406c490 2019-11-28T11:25:24.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.792+0000 7f68b2d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f68b406c0a0 0x7f68b4072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58600/0 (socket says 172.21.15.80:58600) 2019-11-28T11:25:24.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.792+0000 7f68b2d9d700 1 -- 172.21.15.80:0/514110323 learned_addr learned my addr 172.21.15.80:0/514110323 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:24.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b259c700 1 --2- 172.21.15.80:0/514110323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68b406c490 0x7f68b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:24.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b359e700 1 --2- 172.21.15.80:0/514110323 >> v2:172.21.15.174:3300/0 conn(0x7f68b406ce60 0x7f68b4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:24.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b1d9b700 1 -- 172.21.15.80:0/514110323 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650019707 0 0) 0x7f68a4001150 con 0x7f68b406c0a0 2019-11-28T11:25:24.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b1d9b700 1 -- 172.21.15.80:0/514110323 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6894002e80 con 0x7f68b406c0a0 2019-11-28T11:25:24.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b259c700 1 -- 172.21.15.80:0/514110323 >> v2:172.21.15.174:3300/0 conn(0x7f68b406ce60 msgr2=0x7f68b4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:24.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b259c700 1 --2- 172.21.15.80:0/514110323 >> v2:172.21.15.174:3300/0 conn(0x7f68b406ce60 0x7f68b4164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:24.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b259c700 1 -- 172.21.15.80:0/514110323 >> v1:172.21.15.80:6789/0 conn(0x7f68b406c0a0 legacy=0x7f68b4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b259c700 1 -- 172.21.15.80:0/514110323 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b40706c0 con 0x7f68b406c490 2019-11-28T11:25:24.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b259c700 1 --2- 172.21.15.80:0/514110323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68b406c490 0x7f68b406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f689c00b2d0 tx=0x7f689c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b259c700 1 --2- 172.21.15.80:0/514110323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68b406c490 0x7f68b406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f689c00b2d0 tx=0x7f689c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b259c700 1 --2- 172.21.15.80:0/514110323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68b406c490 0x7f68b406c920 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f689c00b2d0 tx=0x7f689c00b5d0).ready entity=mon.2 client_cookie=9f04ea2cfb4326aa server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:24.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b259c700 1 --2- 172.21.15.80:0/514110323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68b406c490 0x7f68b406c920 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f689c00b2d0 tx=0x7f689c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b1d9b700 1 -- 172.21.15.80:0/514110323 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f689c007590 con 0x7f68b406c490 2019-11-28T11:25:24.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b259c700 1 --2- 172.21.15.80:0/514110323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68b406c490 0x7f68b406c920 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f689c00b2d0 tx=0x7f689c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b259c700 1 --2- 172.21.15.80:0/514110323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68b406c490 0x7f68b406c920 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f689c00b2d0 tx=0x7f689c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b1d9b700 1 -- 172.21.15.80:0/514110323 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c009d30 con 0x7f68b406c490 2019-11-28T11:25:24.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b1d9b700 1 -- 172.21.15.80:0/514110323 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f689c00a400 con 0x7f68b406c490 2019-11-28T11:25:24.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b8a0b700 1 -- 172.21.15.80:0/514110323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68b406c490 msgr2=0x7f68b406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.793+0000 7f68b8a0b700 1 --2- 172.21.15.80:0/514110323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68b406c490 0x7f68b406c920 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f689c00b2d0 tx=0x7f689c00b5d0).stop 2019-11-28T11:25:24.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.794+0000 7f68b8a0b700 1 -- 172.21.15.80:0/514110323 shutdown_connections 2019-11-28T11:25:24.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.794+0000 7f68b8a0b700 1 --2- 172.21.15.80:0/514110323 >> v2:172.21.15.174:3300/0 conn(0x7f68b406ce60 0x7f68b4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:24.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.794+0000 7f68b8a0b700 1 --2- 172.21.15.80:0/514110323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68b406c490 0x7f68b406c920 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:24.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.794+0000 7f68b8a0b700 1 -- 172.21.15.80:0/514110323 shutdown_connections 2019-11-28T11:25:24.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.794+0000 7f68b8a0b700 1 -- 172.21.15.80:0/514110323 wait complete. 2019-11-28T11:25:24.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.794+0000 7f68b8a0b700 1 -- 172.21.15.80:0/514110323 >> 172.21.15.80:0/514110323 conn(0x7f68b4061cf0 msgr2=0x7f68b4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:24.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.796+0000 7f68b8a0b700 1 Processor -- start 2019-11-28T11:25:24.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.796+0000 7f68b8a0b700 1 -- start start 2019-11-28T11:25:24.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.797+0000 7f68b8a0b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f68b4162fd0 0x7f68b41633c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:24.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.797+0000 7f68b8a0b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68b4115170 0x7f68b4114300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:24.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.797+0000 7f68b8a0b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b4131340 con 0x7f68b4114ce0 2019-11-28T11:25:24.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.797+0000 7f68b8a0b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b41234c0 con 0x7f68b4115170 2019-11-28T11:25:24.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.797+0000 7f68b8a0b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b413ef50 con 0x7f68b4162fd0 2019-11-28T11:25:24.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.797+0000 7f68b359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68b4115170 0x7f68b4114300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:24.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.797+0000 7f68b359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68b4115170 0x7f68b4114300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59294/0 (socket says 172.21.15.80:59294) 2019-11-28T11:25:24.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.797+0000 7f68b359e700 1 -- 172.21.15.80:0/1451125764 learned_addr learned my addr 172.21.15.80:0/1451125764 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:24.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.797+0000 7f68b2d9d700 1 --2- 172.21.15.80:0/1451125764 >> v2:172.21.15.174:3300/0 conn(0x7f68b4162fd0 0x7f68b41633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:24.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.798+0000 7f68b359e700 1 -- 172.21.15.80:0/1451125764 >> v2:172.21.15.174:3300/0 conn(0x7f68b4162fd0 msgr2=0x7f68b41633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.798+0000 7f68b359e700 1 --2- 172.21.15.80:0/1451125764 >> v2:172.21.15.174:3300/0 conn(0x7f68b4162fd0 0x7f68b41633c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:24.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.798+0000 7f68b359e700 1 -- 172.21.15.80:0/1451125764 >> v1:172.21.15.80:6789/0 conn(0x7f68b4114ce0 legacy=0x7f68b4113b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:24.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.798+0000 7f68b359e700 1 -- 172.21.15.80:0/1451125764 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b41123c0 con 0x7f68b4115170 2019-11-28T11:25:24.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.798+0000 7f68b359e700 1 --2- 172.21.15.80:0/1451125764 >> v2:172.21.15.80:3300/0 conn(0x7f68b4115170 0x7f68b4114300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68ac010450 tx=0x7f68ac010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.798+0000 7f68b359e700 1 --2- 172.21.15.80:0/1451125764 >> v2:172.21.15.80:3300/0 conn(0x7f68b4115170 0x7f68b4114300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68ac010450 tx=0x7f68ac010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.798+0000 7f68b359e700 1 --2- 172.21.15.80:0/1451125764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b4115170 0x7f68b4114300 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f68ac010450 tx=0x7f68ac010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:24.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.798+0000 7f68b359e700 1 --2- 172.21.15.80:0/1451125764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b4115170 0x7f68b4114300 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f68ac010450 tx=0x7f68ac010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.798+0000 7f68ab7fe700 1 -- 172.21.15.80:0/1451125764 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68ac00f090 con 0x7f68b4115170 2019-11-28T11:25:24.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.798+0000 7f68b359e700 1 --2- 172.21.15.80:0/1451125764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b4115170 0x7f68b4114300 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f68ac010450 tx=0x7f68ac010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.798+0000 7f68ab7fe700 1 -- 172.21.15.80:0/1451125764 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac000a70 con 0x7f68b4115170 2019-11-28T11:25:24.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.798+0000 7f68b8a0b700 1 -- 172.21.15.80:0/1451125764 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b4112740 con 0x7f68b4115170 2019-11-28T11:25:24.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.798+0000 7f68b359e700 1 --2- 172.21.15.80:0/1451125764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b4115170 0x7f68b4114300 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f68ac010450 tx=0x7f68ac010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.798+0000 7f68ab7fe700 1 -- 172.21.15.80:0/1451125764 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68ac00f1d0 con 0x7f68b4115170 2019-11-28T11:25:24.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.798+0000 7f68b8a0b700 1 -- 172.21.15.80:0/1451125764 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b41123c0 con 0x7f68b4115170 2019-11-28T11:25:24.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.798+0000 7f68b359e700 1 --2- 172.21.15.80:0/1451125764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b4115170 0x7f68b4114300 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f68ac010450 tx=0x7f68ac010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.799+0000 7f68ab7fe700 1 -- 172.21.15.80:0/1451125764 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f68ac00edf0 con 0x7f68b4115170 2019-11-28T11:25:24.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.799+0000 7f68b359e700 1 --2- 172.21.15.80:0/1451125764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b4115170 0x7f68b4114300 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f68ac010450 tx=0x7f68ac010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.799+0000 7f68ab7fe700 1 --2- 172.21.15.80:0/1451125764 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f688c018730 0x7f688c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:24.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.799+0000 7f68ab7fe700 1 -- 172.21.15.80:0/1451125764 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f68ac031ac0 con 0x7f68b4115170 2019-11-28T11:25:24.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.799+0000 7f68b2d9d700 1 --2- 172.21.15.80:0/1451125764 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f688c018730 0x7f688c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:24.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.799+0000 7f68b2d9d700 1 --2- 172.21.15.80:0/1451125764 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f688c018730 0x7f688c01abc0 crc :-1 s=READY pgs=57 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:24.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.806+0000 7f68b8a0b700 1 -- 172.21.15.80:0/1451125764 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b4112740 con 0x7f68b4115170 2019-11-28T11:25:24.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.810+0000 7f68b359e700 1 --2- 172.21.15.80:0/1451125764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b4115170 0x7f68b4114300 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f68ac010450 tx=0x7f68ac010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:24.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.810+0000 7f68ab7fe700 1 -- 172.21.15.80:0/1451125764 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f68ac00ea80 con 0x7f68b4115170 2019-11-28T11:25:25.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.985+0000 7f68b8a0b700 1 -- 172.21.15.80:0/1451125764 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68b41123c0 con 0x7f68b4115170 2019-11-28T11:25:25.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.986+0000 7f68b359e700 1 --2- 172.21.15.80:0/1451125764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b4115170 0x7f68b4114300 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f68ac010450 tx=0x7f68ac010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.986+0000 7f68ab7fe700 1 -- 172.21.15.80:0/1451125764 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14885 (secure 0 0 0) 0x7f68ac00ed50 con 0x7f68b4115170 2019-11-28T11:25:25.028 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:25.029 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:20.933435+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:25:14.914696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-11-28T11:25:17.566323+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:25.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.988+0000 7f68b8a0b700 1 -- 172.21.15.80:0/1451125764 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f688c018730 msgr2=0x7f688c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.988+0000 7f68b8a0b700 1 --2- 172.21.15.80:0/1451125764 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f688c018730 0x7f688c01abc0 crc :-1 s=READY pgs=57 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.988+0000 7f68b8a0b700 1 -- 172.21.15.80:0/1451125764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b4115170 msgr2=0x7f68b4114300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.988+0000 7f68b8a0b700 1 --2- 172.21.15.80:0/1451125764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b4115170 0x7f68b4114300 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f68ac010450 tx=0x7f68ac010280).stop 2019-11-28T11:25:25.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.988+0000 7f68b8a0b700 1 -- 172.21.15.80:0/1451125764 shutdown_connections 2019-11-28T11:25:25.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.988+0000 7f68b8a0b700 1 --2- 172.21.15.80:0/1451125764 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f688c018730 0x7f688c01abc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.988+0000 7f68b8a0b700 1 --2- 172.21.15.80:0/1451125764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b4115170 0x7f68b4114300 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.988+0000 7f68b8a0b700 1 --2- 172.21.15.80:0/1451125764 >> v2:172.21.15.174:3300/0 conn(0x7f68b4162fd0 0x7f68b41633c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.988+0000 7f68b8a0b700 1 -- 172.21.15.80:0/1451125764 shutdown_connections 2019-11-28T11:25:25.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.988+0000 7f68b8a0b700 1 -- 172.21.15.80:0/1451125764 wait complete. 2019-11-28T11:25:25.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:24.988+0000 7f68b8a0b700 1 -- 172.21.15.80:0/1451125764 >> 172.21.15.80:0/1451125764 conn(0x7f68b411bfc0 msgr2=0x7f68b4141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:25.032 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2019-11-28T11:25:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.150+0000 7f41fd8a8700 1 Processor -- start 2019-11-28T11:25:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.150+0000 7f41fd8a8700 1 -- start start 2019-11-28T11:25:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.151+0000 7f41fd8a8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41f806c0a0 0x7f41f8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.151+0000 7f41fd8a8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41f8072620 0x7f41f8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.151+0000 7f41fd8a8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f806db00 con 0x7f41f80734e0 2019-11-28T11:25:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.151+0000 7f41fd8a8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f806f330 con 0x7f41f8072620 2019-11-28T11:25:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.151+0000 7f41fd8a8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80706c0 con 0x7f41f806c0a0 2019-11-28T11:25:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.151+0000 7f41f7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41f8072620 0x7f41f8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.151+0000 7f41f7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41f8072620 0x7f41f8164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59300/0 (socket says 172.21.15.80:59300) 2019-11-28T11:25:25.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.151+0000 7f41f7fff700 1 -- 172.21.15.80:0/2079338672 learned_addr learned my addr 172.21.15.80:0/2079338672 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:25.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.151+0000 7f41f77fe700 1 --2- 172.21.15.80:0/2079338672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41f806c0a0 0x7f41f8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.152+0000 7f41f7fff700 1 -- 172.21.15.80:0/2079338672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41f806c0a0 msgr2=0x7f41f8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:25.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.152+0000 7f41f7fff700 1 --2- 172.21.15.80:0/2079338672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41f806c0a0 0x7f41f8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:25.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.152+0000 7f41f7fff700 1 -- 172.21.15.80:0/2079338672 >> v1:172.21.15.174:6789/0 conn(0x7f41f80734e0 legacy=0x7f41f8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.152+0000 7f41f7fff700 1 -- 172.21.15.80:0/2079338672 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f8070a40 con 0x7f41f8072620 2019-11-28T11:25:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.152+0000 7f41f7fff700 1 --2- 172.21.15.80:0/2079338672 >> v2:172.21.15.80:3300/0 conn(0x7f41f8072620 0x7f41f8164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f41f000f6b0 tx=0x7f41f000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.152+0000 7f41f7fff700 1 --2- 172.21.15.80:0/2079338672 >> v2:172.21.15.80:3300/0 conn(0x7f41f8072620 0x7f41f8164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f41f000f6b0 tx=0x7f41f000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.152+0000 7f41f7fff700 1 --2- 172.21.15.80:0/2079338672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41f8072620 0x7f41f8164d70 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f41f000f6b0 tx=0x7f41f000fa50).ready entity=mon.0 client_cookie=d86617c2cbaf15e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.152+0000 7f41f7fff700 1 --2- 172.21.15.80:0/2079338672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41f8072620 0x7f41f8164d70 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f41f000f6b0 tx=0x7f41f000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.152+0000 7f41f7fff700 1 --2- 172.21.15.80:0/2079338672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41f8072620 0x7f41f8164d70 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f41f000f6b0 tx=0x7f41f000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.152+0000 7f41f67fc700 1 -- 172.21.15.80:0/2079338672 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41f0000a70 con 0x7f41f8072620 2019-11-28T11:25:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.152+0000 7f41f7fff700 1 --2- 172.21.15.80:0/2079338672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41f8072620 0x7f41f8164d70 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f41f000f6b0 tx=0x7f41f000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.152+0000 7f41f67fc700 1 -- 172.21.15.80:0/2079338672 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f00010e0 con 0x7f41f8072620 2019-11-28T11:25:25.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.152+0000 7f41f67fc700 1 -- 172.21.15.80:0/2079338672 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41f00017b0 con 0x7f41f8072620 2019-11-28T11:25:25.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.152+0000 7f41fd8a8700 1 -- 172.21.15.80:0/2079338672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41f8072620 msgr2=0x7f41f8164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.152+0000 7f41fd8a8700 1 --2- 172.21.15.80:0/2079338672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41f8072620 0x7f41f8164d70 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f41f000f6b0 tx=0x7f41f000fa50).stop 2019-11-28T11:25:25.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.153+0000 7f41fd8a8700 1 -- 172.21.15.80:0/2079338672 shutdown_connections 2019-11-28T11:25:25.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.153+0000 7f41fd8a8700 1 --2- 172.21.15.80:0/2079338672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41f8072620 0x7f41f8164d70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.153+0000 7f41fd8a8700 1 --2- 172.21.15.80:0/2079338672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41f806c0a0 0x7f41f8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:25.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.153+0000 7f41fd8a8700 1 -- 172.21.15.80:0/2079338672 shutdown_connections 2019-11-28T11:25:25.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.153+0000 7f41fd8a8700 1 -- 172.21.15.80:0/2079338672 wait complete. 2019-11-28T11:25:25.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.153+0000 7f41fd8a8700 1 -- 172.21.15.80:0/2079338672 >> 172.21.15.80:0/2079338672 conn(0x7f41f8061cf0 msgr2=0x7f41f8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:25.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.155+0000 7f41fd8a8700 1 Processor -- start 2019-11-28T11:25:25.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.155+0000 7f41fd8a8700 1 -- start start 2019-11-28T11:25:25.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41fd8a8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41f813e5f0 0x7f41f813e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41fd8a8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41f810a070 0x7f41f810bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41fd8a8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f41f810a4e0 0x7f41f810c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41fd8a8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f810d630 con 0x7f41f810a070 2019-11-28T11:25:25.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41fd8a8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f810e060 con 0x7f41f810a4e0 2019-11-28T11:25:25.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41fd8a8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f813f1c0 con 0x7f41f813e5f0 2019-11-28T11:25:25.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41f6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41f810a070 0x7f41f810bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41f6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41f810a070 0x7f41f810bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59304/0 (socket says 172.21.15.80:59304) 2019-11-28T11:25:25.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41f6ffd700 1 -- 172.21.15.80:0/3501854361 learned_addr learned my addr 172.21.15.80:0/3501854361 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:25.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41f77fe700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41f813e5f0 0x7f41f813e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41f7fff700 1 --2- 172.21.15.80:0/3501854361 >> v2:172.21.15.174:3300/0 conn(0x7f41f810a4e0 0x7f41f810c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41f6ffd700 1 -- 172.21.15.80:0/3501854361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41f813e5f0 msgr2=0x7f41f813e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41f6ffd700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41f813e5f0 0x7f41f813e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41f6ffd700 1 -- 172.21.15.80:0/3501854361 >> v2:172.21.15.174:3300/0 conn(0x7f41f810a4e0 msgr2=0x7f41f810c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41f6ffd700 1 --2- 172.21.15.80:0/3501854361 >> v2:172.21.15.174:3300/0 conn(0x7f41f810a4e0 0x7f41f810c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41f6ffd700 1 -- 172.21.15.80:0/3501854361 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f810e9c0 con 0x7f41f810a070 2019-11-28T11:25:25.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.156+0000 7f41f6ffd700 1 --2- 172.21.15.80:0/3501854361 >> v2:172.21.15.80:3300/0 conn(0x7f41f810a070 0x7f41f810bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41e0010770 tx=0x7f41e0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.157+0000 7f41f6ffd700 1 --2- 172.21.15.80:0/3501854361 >> v2:172.21.15.80:3300/0 conn(0x7f41f810a070 0x7f41f810bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41e0010770 tx=0x7f41e0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.157+0000 7f41f6ffd700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41f810a070 0x7f41f810bdb0 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f41e0010770 tx=0x7f41e0010670).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.157+0000 7f41f6ffd700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41f810a070 0x7f41f810bdb0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f41e0010770 tx=0x7f41e0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.157+0000 7f41f6ffd700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41f810a070 0x7f41f810bdb0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f41e0010770 tx=0x7f41e0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.157+0000 7f41effff700 1 -- 172.21.15.80:0/3501854361 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41e0005af0 con 0x7f41f810a070 2019-11-28T11:25:25.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.157+0000 7f41f6ffd700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41f810a070 0x7f41f810bdb0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f41e0010770 tx=0x7f41e0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.157+0000 7f41effff700 1 -- 172.21.15.80:0/3501854361 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e0005710 con 0x7f41f810a070 2019-11-28T11:25:25.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.157+0000 7f41effff700 1 -- 172.21.15.80:0/3501854361 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41e00060d0 con 0x7f41f810a070 2019-11-28T11:25:25.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.157+0000 7f41fd8a8700 1 -- 172.21.15.80:0/3501854361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f810ed40 con 0x7f41f810a070 2019-11-28T11:25:25.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.157+0000 7f41fd8a8700 1 -- 172.21.15.80:0/3501854361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f810e9c0 con 0x7f41f810a070 2019-11-28T11:25:25.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.157+0000 7f41f6ffd700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41f810a070 0x7f41f810bdb0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f41e0010770 tx=0x7f41e0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.157+0000 7f41effff700 1 -- 172.21.15.80:0/3501854361 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f41e0005900 con 0x7f41f810a070 2019-11-28T11:25:25.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.157+0000 7f41f6ffd700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41f810a070 0x7f41f810bdb0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f41e0010770 tx=0x7f41e0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.157+0000 7f41effff700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f41dc018730 0x7f41dc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.158+0000 7f41effff700 1 -- 172.21.15.80:0/3501854361 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f41e0031db0 con 0x7f41f810a070 2019-11-28T11:25:25.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.158+0000 7f41f77fe700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f41dc018730 0x7f41dc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.158+0000 7f41f77fe700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f41dc018730 0x7f41dc01abc0 crc :-1 s=READY pgs=58 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.165+0000 7f41fd8a8700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.80:6800/6092,v1:172.21.15.80:6801/6092] conn(0x7f41f8108ef0 0x7f41f81092e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.165+0000 7f41fd8a8700 1 -- 172.21.15.80:0/3501854361 --> [v2:172.21.15.80:6800/6092,v1:172.21.15.80:6801/6092] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41f813f1c0 con 0x7f41f8108ef0 2019-11-28T11:25:25.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.166+0000 7f41f7fff700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.80:6800/6092,v1:172.21.15.80:6801/6092] conn(0x7f41f8108ef0 0x7f41f81092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.166+0000 7f41f7fff700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.80:6800/6092,v1:172.21.15.80:6801/6092] conn(0x7f41f8108ef0 0x7f41f81092e0 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.166+0000 7f41effff700 1 -- 172.21.15.80:0/3501854361 <== osd.0 v2:172.21.15.80:6800/6092 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23014 (crc 0 0 0) 0x7f41f00009c0 con 0x7f41f8108ef0 2019-11-28T11:25:25.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.187+0000 7f41fd8a8700 1 -- 172.21.15.80:0/3501854361 --> [v2:172.21.15.80:6800/6092,v1:172.21.15.80:6801/6092] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f41f810ed40 con 0x7f41f8108ef0 2019-11-28T11:25:25.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.187+0000 7f41effff700 1 -- 172.21.15.80:0/3501854361 <== osd.0 v2:172.21.15.80:6800/6092 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f41f0007580 con 0x7f41f8108ef0 2019-11-28T11:25:25.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.188+0000 7f41fd8a8700 1 -- 172.21.15.80:0/3501854361 >> [v2:172.21.15.80:6800/6092,v1:172.21.15.80:6801/6092] conn(0x7f41f8108ef0 msgr2=0x7f41f81092e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.188+0000 7f41fd8a8700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.80:6800/6092,v1:172.21.15.80:6801/6092] conn(0x7f41f8108ef0 0x7f41f81092e0 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.188+0000 7f41fd8a8700 1 -- 172.21.15.80:0/3501854361 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f41dc018730 msgr2=0x7f41dc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.188+0000 7f41fd8a8700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f41dc018730 0x7f41dc01abc0 crc :-1 s=READY pgs=58 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.188+0000 7f41fd8a8700 1 -- 172.21.15.80:0/3501854361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41f810a070 msgr2=0x7f41f810bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.188+0000 7f41fd8a8700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41f810a070 0x7f41f810bdb0 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f41e0010770 tx=0x7f41e0010670).stop 2019-11-28T11:25:25.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.188+0000 7f41f7fff700 1 -- 172.21.15.80:0/3501854361 reap_dead start 2019-11-28T11:25:25.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.189+0000 7f41fd8a8700 1 -- 172.21.15.80:0/3501854361 shutdown_connections 2019-11-28T11:25:25.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.189+0000 7f41fd8a8700 1 --2- 172.21.15.80:0/3501854361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41f810a070 0x7f41f810bdb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.189+0000 7f41fd8a8700 1 -- 172.21.15.80:0/3501854361 shutdown_connections 2019-11-28T11:25:25.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.189+0000 7f41fd8a8700 1 -- 172.21.15.80:0/3501854361 wait complete. 2019-11-28T11:25:25.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.189+0000 7f41fd8a8700 1 -- 172.21.15.80:0/3501854361 >> 172.21.15.80:0/3501854361 conn(0x7f41f813d620 msgr2=0x7f41f813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:25.217 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2019-11-28T11:25:25.218 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2019-11-28T11:25:25.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.340+0000 7f1441eab700 1 Processor -- start 2019-11-28T11:25:25.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.340+0000 7f1441eab700 1 -- start start 2019-11-28T11:25:25.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1441eab700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f143c06c0a0 0x7f143c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:25.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1441eab700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f143c0734e0 0x7f143c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:25.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1441eab700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143c06db00 con 0x7f143c072360 2019-11-28T11:25:25.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1441eab700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143c06fd60 con 0x7f143c0734e0 2019-11-28T11:25:25.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1441eab700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143c070030 con 0x7f143c06c0a0 2019-11-28T11:25:25.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1433fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f143c0734e0 0x7f143c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1433fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f143c0734e0 0x7f143c071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59314/0 (socket says 172.21.15.80:59314) 2019-11-28T11:25:25.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1440c49700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f143c072360 0x7f143c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58630/0 (socket says 172.21.15.80:58630) 2019-11-28T11:25:25.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1433fff700 1 -- 172.21.15.80:0/3246015415 learned_addr learned my addr 172.21.15.80:0/3246015415 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:25.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f143bfff700 1 --2- 172.21.15.80:0/3246015415 >> v2:172.21.15.174:3300/0 conn(0x7f143c06c0a0 0x7f143c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1433fff700 1 -- 172.21.15.80:0/3246015415 >> v2:172.21.15.174:3300/0 conn(0x7f143c06c0a0 msgr2=0x7f143c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:25.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1433fff700 1 --2- 172.21.15.80:0/3246015415 >> v2:172.21.15.174:3300/0 conn(0x7f143c06c0a0 0x7f143c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:25.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1433fff700 1 -- 172.21.15.80:0/3246015415 >> v1:172.21.15.80:6789/0 conn(0x7f143c072360 legacy=0x7f143c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f143b7fe700 1 -- 172.21.15.80:0/3246015415 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852707459 0 0) 0x7f1434000d30 con 0x7f143c072360 2019-11-28T11:25:25.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1433fff700 1 -- 172.21.15.80:0/3246015415 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c0706c0 con 0x7f143c0734e0 2019-11-28T11:25:25.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f143bfff700 1 --2- 172.21.15.80:0/3246015415 >> v2:172.21.15.174:3300/0 conn(0x7f143c06c0a0 0x7f143c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:25.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1433fff700 1 --2- 172.21.15.80:0/3246015415 >> v2:172.21.15.80:3300/0 conn(0x7f143c0734e0 0x7f143c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f142400f740 tx=0x7f142400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1433fff700 1 --2- 172.21.15.80:0/3246015415 >> v2:172.21.15.80:3300/0 conn(0x7f143c0734e0 0x7f143c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f142400f740 tx=0x7f142400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1433fff700 1 --2- 172.21.15.80:0/3246015415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c0734e0 0x7f143c071e20 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f142400f740 tx=0x7f142400fae0).ready entity=mon.0 client_cookie=46498191ee8e78e6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1433fff700 1 --2- 172.21.15.80:0/3246015415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c0734e0 0x7f143c071e20 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f142400f740 tx=0x7f142400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f143b7fe700 1 -- 172.21.15.80:0/3246015415 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1424000960 con 0x7f143c0734e0 2019-11-28T11:25:25.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1433fff700 1 --2- 172.21.15.80:0/3246015415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c0734e0 0x7f143c071e20 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f142400f740 tx=0x7f142400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f143b7fe700 1 -- 172.21.15.80:0/3246015415 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1424000960 con 0x7f143c0734e0 2019-11-28T11:25:25.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.341+0000 7f1433fff700 1 --2- 172.21.15.80:0/3246015415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c0734e0 0x7f143c071e20 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f142400f740 tx=0x7f142400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.342+0000 7f143b7fe700 1 -- 172.21.15.80:0/3246015415 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1424001070 con 0x7f143c0734e0 2019-11-28T11:25:25.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.342+0000 7f1441eab700 1 -- 172.21.15.80:0/3246015415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c0734e0 msgr2=0x7f143c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.342+0000 7f1441eab700 1 --2- 172.21.15.80:0/3246015415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c0734e0 0x7f143c071e20 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f142400f740 tx=0x7f142400fae0).stop 2019-11-28T11:25:25.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.342+0000 7f1441eab700 1 -- 172.21.15.80:0/3246015415 shutdown_connections 2019-11-28T11:25:25.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.342+0000 7f1441eab700 1 --2- 172.21.15.80:0/3246015415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c0734e0 0x7f143c071e20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.342+0000 7f1441eab700 1 --2- 172.21.15.80:0/3246015415 >> v2:172.21.15.174:3300/0 conn(0x7f143c06c0a0 0x7f143c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:25.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.342+0000 7f1441eab700 1 -- 172.21.15.80:0/3246015415 shutdown_connections 2019-11-28T11:25:25.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.342+0000 7f1441eab700 1 -- 172.21.15.80:0/3246015415 wait complete. 2019-11-28T11:25:25.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.342+0000 7f1441eab700 1 -- 172.21.15.80:0/3246015415 >> 172.21.15.80:0/3246015415 conn(0x7f143c061cf0 msgr2=0x7f143c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:25.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.345+0000 7f1441eab700 1 Processor -- start 2019-11-28T11:25:25.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.345+0000 7f1441eab700 1 -- start start 2019-11-28T11:25:25.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.345+0000 7f1441eab700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f143c1098d0 0x7f143c109d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1441eab700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f143c10a2a0 0x7f143c168ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1441eab700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143c139e00 con 0x7f143c12a6b0 2019-11-28T11:25:25.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1441eab700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143c107b00 con 0x7f143c10a2a0 2019-11-28T11:25:25.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1441eab700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143c13b350 con 0x7f143c1098d0 2019-11-28T11:25:25.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1440c49700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f143c10a2a0 0x7f143c168ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1440c49700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f143c10a2a0 0x7f143c168ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59322/0 (socket says 172.21.15.80:59322) 2019-11-28T11:25:25.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1440c49700 1 -- 172.21.15.80:0/3127330861 learned_addr learned my addr 172.21.15.80:0/3127330861 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:25.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1433fff700 1 --2- 172.21.15.80:0/3127330861 >> v2:172.21.15.174:3300/0 conn(0x7f143c1098d0 0x7f143c109d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1440c49700 1 -- 172.21.15.80:0/3127330861 >> v2:172.21.15.174:3300/0 conn(0x7f143c1098d0 msgr2=0x7f143c109d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1440c49700 1 --2- 172.21.15.80:0/3127330861 >> v2:172.21.15.174:3300/0 conn(0x7f143c1098d0 0x7f143c109d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1440c49700 1 -- 172.21.15.80:0/3127330861 >> v1:172.21.15.174:6789/0 conn(0x7f143c12a6b0 legacy=0x7f143c12b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1440c49700 1 -- 172.21.15.80:0/3127330861 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c108190 con 0x7f143c10a2a0 2019-11-28T11:25:25.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1440c49700 1 --2- 172.21.15.80:0/3127330861 >> v2:172.21.15.80:3300/0 conn(0x7f143c10a2a0 0x7f143c168ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1434010760 tx=0x7f14340105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1440c49700 1 --2- 172.21.15.80:0/3127330861 >> v2:172.21.15.80:3300/0 conn(0x7f143c10a2a0 0x7f143c168ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1434010760 tx=0x7f14340105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1440c49700 1 --2- 172.21.15.80:0/3127330861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c10a2a0 0x7f143c168ee0 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f1434010760 tx=0x7f14340105e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1440c49700 1 --2- 172.21.15.80:0/3127330861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c10a2a0 0x7f143c168ee0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f1434010760 tx=0x7f14340105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f14397fa700 1 -- 172.21.15.80:0/3127330861 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1434000cc0 con 0x7f143c10a2a0 2019-11-28T11:25:25.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1440c49700 1 --2- 172.21.15.80:0/3127330861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c10a2a0 0x7f143c168ee0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f1434010760 tx=0x7f14340105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1440c49700 1 --2- 172.21.15.80:0/3127330861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c10a2a0 0x7f143c168ee0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f1434010760 tx=0x7f14340105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f14397fa700 1 -- 172.21.15.80:0/3127330861 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1434001480 con 0x7f143c10a2a0 2019-11-28T11:25:25.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f14397fa700 1 -- 172.21.15.80:0/3127330861 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1434007950 con 0x7f143c10a2a0 2019-11-28T11:25:25.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1441eab700 1 -- 172.21.15.80:0/3127330861 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143c108510 con 0x7f143c10a2a0 2019-11-28T11:25:25.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.346+0000 7f1441eab700 1 -- 172.21.15.80:0/3127330861 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143c10a710 con 0x7f143c10a2a0 2019-11-28T11:25:25.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.347+0000 7f1440c49700 1 --2- 172.21.15.80:0/3127330861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c10a2a0 0x7f143c168ee0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f1434010760 tx=0x7f14340105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.347+0000 7f14397fa700 1 -- 172.21.15.80:0/3127330861 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1434000cc0 con 0x7f143c10a2a0 2019-11-28T11:25:25.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.347+0000 7f1440c49700 1 --2- 172.21.15.80:0/3127330861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c10a2a0 0x7f143c168ee0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f1434010760 tx=0x7f14340105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.347+0000 7f14397fa700 1 --2- 172.21.15.80:0/3127330861 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1420018730 0x7f142001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.347+0000 7f14397fa700 1 -- 172.21.15.80:0/3127330861 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f1434031dd0 con 0x7f143c10a2a0 2019-11-28T11:25:25.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.347+0000 7f143bfff700 1 --2- 172.21.15.80:0/3127330861 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1420018730 0x7f142001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.347+0000 7f143bfff700 1 --2- 172.21.15.80:0/3127330861 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1420018730 0x7f142001abc0 crc :-1 s=READY pgs=59 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.354+0000 7f1441eab700 1 --2- 172.21.15.80:0/3127330861 >> [v2:172.21.15.80:6808/6094,v1:172.21.15.80:6809/6094] conn(0x7f143c053480 0x7f143c053870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.354+0000 7f1441eab700 1 -- 172.21.15.80:0/3127330861 --> [v2:172.21.15.80:6808/6094,v1:172.21.15.80:6809/6094] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f143c108510 con 0x7f143c053480 2019-11-28T11:25:25.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.355+0000 7f1433fff700 1 --2- 172.21.15.80:0/3127330861 >> [v2:172.21.15.80:6808/6094,v1:172.21.15.80:6809/6094] conn(0x7f143c053480 0x7f143c053870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.355+0000 7f1433fff700 1 --2- 172.21.15.80:0/3127330861 >> [v2:172.21.15.80:6808/6094,v1:172.21.15.80:6809/6094] conn(0x7f143c053480 0x7f143c053870 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.355+0000 7f14397fa700 1 -- 172.21.15.80:0/3127330861 <== osd.1 v2:172.21.15.80:6808/6094 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23014 (crc 0 0 0) 0x7f1424007cd0 con 0x7f143c053480 2019-11-28T11:25:25.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.376+0000 7f1441eab700 1 -- 172.21.15.80:0/3127330861 --> [v2:172.21.15.80:6808/6094,v1:172.21.15.80:6809/6094] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f143c10a710 con 0x7f143c053480 2019-11-28T11:25:25.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.376+0000 7f14397fa700 1 -- 172.21.15.80:0/3127330861 <== osd.1 v2:172.21.15.80:6808/6094 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f14240075d0 con 0x7f143c053480 2019-11-28T11:25:25.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.377+0000 7f1441eab700 1 -- 172.21.15.80:0/3127330861 >> [v2:172.21.15.80:6808/6094,v1:172.21.15.80:6809/6094] conn(0x7f143c053480 msgr2=0x7f143c053870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.377+0000 7f1441eab700 1 --2- 172.21.15.80:0/3127330861 >> [v2:172.21.15.80:6808/6094,v1:172.21.15.80:6809/6094] conn(0x7f143c053480 0x7f143c053870 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.377+0000 7f1441eab700 1 -- 172.21.15.80:0/3127330861 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1420018730 msgr2=0x7f142001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.377+0000 7f1441eab700 1 --2- 172.21.15.80:0/3127330861 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1420018730 0x7f142001abc0 crc :-1 s=READY pgs=59 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.377+0000 7f1441eab700 1 -- 172.21.15.80:0/3127330861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c10a2a0 msgr2=0x7f143c168ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.377+0000 7f1441eab700 1 --2- 172.21.15.80:0/3127330861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c10a2a0 0x7f143c168ee0 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f1434010760 tx=0x7f14340105e0).stop 2019-11-28T11:25:25.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.377+0000 7f1440c49700 1 -- 172.21.15.80:0/3127330861 reap_dead start 2019-11-28T11:25:25.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.377+0000 7f1441eab700 1 -- 172.21.15.80:0/3127330861 shutdown_connections 2019-11-28T11:25:25.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.377+0000 7f1441eab700 1 --2- 172.21.15.80:0/3127330861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c10a2a0 0x7f143c168ee0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.377+0000 7f1441eab700 1 -- 172.21.15.80:0/3127330861 shutdown_connections 2019-11-28T11:25:25.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.377+0000 7f1441eab700 1 -- 172.21.15.80:0/3127330861 wait complete. 2019-11-28T11:25:25.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.378+0000 7f1441eab700 1 -- 172.21.15.80:0/3127330861 >> 172.21.15.80:0/3127330861 conn(0x7f143c127dc0 msgr2=0x7f143c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:25.406 INFO:teuthology.orchestra.run.smithi080.stdout:55834574854 2019-11-28T11:25:25.407 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2019-11-28T11:25:25.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.516+0000 7f4a70e22700 1 Processor -- start 2019-11-28T11:25:25.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.516+0000 7f4a70e22700 1 -- start start 2019-11-28T11:25:25.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.517+0000 7f4a70e22700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a6c06c0a0 0x7f4a6c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:25.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.517+0000 7f4a70e22700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4a6c072620 0x7f4a6c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:25.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.517+0000 7f4a70e22700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6c06db00 con 0x7f4a6c0734e0 2019-11-28T11:25:25.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.517+0000 7f4a70e22700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6c06f330 con 0x7f4a6c072620 2019-11-28T11:25:25.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.517+0000 7f4a70e22700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c0706c0 con 0x7f4a6c06c0a0 2019-11-28T11:25:25.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.517+0000 7f4a6a59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4a6c0734e0 0x7f4a6c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58648/0 (socket says 172.21.15.80:58648) 2019-11-28T11:25:25.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.517+0000 7f4a6a59c700 1 -- 172.21.15.80:0/3177520225 learned_addr learned my addr 172.21.15.80:0/3177520225 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:25.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.517+0000 7f4a6ad9d700 1 --2- 172.21.15.80:0/3177520225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a6c06c0a0 0x7f4a6c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.517+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/3177520225 >> v2:172.21.15.174:3300/0 conn(0x7f4a6c072620 0x7f4a6c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.517+0000 7f4a69d9b700 1 -- 172.21.15.80:0/3177520225 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473928665 0 0) 0x7f4a540013f0 con 0x7f4a6c0734e0 2019-11-28T11:25:25.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.517+0000 7f4a69d9b700 1 -- 172.21.15.80:0/3177520225 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a4c002e80 con 0x7f4a6c0734e0 2019-11-28T11:25:25.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a69d9b700 1 -- 172.21.15.80:0/3177520225 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3220502419 0 0) 0x7f4a540013d0 con 0x7f4a6c0734e0 2019-11-28T11:25:25.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a6b59e700 1 -- 172.21.15.80:0/3177520225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a6c06c0a0 msgr2=0x7f4a6c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:25.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/3177520225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a6c06c0a0 0x7f4a6c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:25.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a6b59e700 1 -- 172.21.15.80:0/3177520225 >> v1:172.21.15.80:6789/0 conn(0x7f4a6c0734e0 legacy=0x7f4a6c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a6b59e700 1 -- 172.21.15.80:0/3177520225 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c070a40 con 0x7f4a6c072620 2019-11-28T11:25:25.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a6ad9d700 1 --2- 172.21.15.80:0/3177520225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a6c06c0a0 0x7f4a6c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:25.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/3177520225 >> v2:172.21.15.174:3300/0 conn(0x7f4a6c072620 0x7f4a6c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4a6400af80 tx=0x7f4a6400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/3177520225 >> v2:172.21.15.174:3300/0 conn(0x7f4a6c072620 0x7f4a6c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4a6400af80 tx=0x7f4a6400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/3177520225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a6c072620 0x7f4a6c164d70 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f4a6400af80 tx=0x7f4a6400b790).ready entity=mon.1 client_cookie=9605bbed4cd54095 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/3177520225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a6c072620 0x7f4a6c164d70 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f4a6400af80 tx=0x7f4a6400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a69d9b700 1 -- 172.21.15.80:0/3177520225 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a64000bc0 con 0x7f4a6c072620 2019-11-28T11:25:25.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/3177520225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a6c072620 0x7f4a6c164d70 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f4a6400af80 tx=0x7f4a6400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/3177520225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a6c072620 0x7f4a6c164d70 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f4a6400af80 tx=0x7f4a6400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a69d9b700 1 -- 172.21.15.80:0/3177520225 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a640097f0 con 0x7f4a6c072620 2019-11-28T11:25:25.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a69d9b700 1 -- 172.21.15.80:0/3177520225 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a64009ec0 con 0x7f4a6c072620 2019-11-28T11:25:25.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a70e22700 1 -- 172.21.15.80:0/3177520225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a6c072620 msgr2=0x7f4a6c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.518+0000 7f4a70e22700 1 --2- 172.21.15.80:0/3177520225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a6c072620 0x7f4a6c164d70 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f4a6400af80 tx=0x7f4a6400b790).stop 2019-11-28T11:25:25.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.519+0000 7f4a70e22700 1 -- 172.21.15.80:0/3177520225 shutdown_connections 2019-11-28T11:25:25.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.519+0000 7f4a70e22700 1 --2- 172.21.15.80:0/3177520225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a6c072620 0x7f4a6c164d70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.519+0000 7f4a70e22700 1 --2- 172.21.15.80:0/3177520225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a6c06c0a0 0x7f4a6c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:25.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.519+0000 7f4a70e22700 1 -- 172.21.15.80:0/3177520225 shutdown_connections 2019-11-28T11:25:25.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.519+0000 7f4a70e22700 1 -- 172.21.15.80:0/3177520225 wait complete. 2019-11-28T11:25:25.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.519+0000 7f4a70e22700 1 -- 172.21.15.80:0/3177520225 >> 172.21.15.80:0/3177520225 conn(0x7f4a6c061cf0 msgr2=0x7f4a6c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:25.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.521+0000 7f4a70e22700 1 Processor -- start 2019-11-28T11:25:25.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.521+0000 7f4a70e22700 1 -- start start 2019-11-28T11:25:25.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.522+0000 7f4a70e22700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a6c104c10 0x7f4a6c1050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.522+0000 7f4a70e22700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4a6c1055e0 0x7f4a6c167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.522+0000 7f4a70e22700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6c105a30 con 0x7f4a6c104820 2019-11-28T11:25:25.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.522+0000 7f4a70e22700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6c109130 con 0x7f4a6c1055e0 2019-11-28T11:25:25.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.522+0000 7f4a70e22700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c109400 con 0x7f4a6c104c10 2019-11-28T11:25:25.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.522+0000 7f4a6b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4a6c1055e0 0x7f4a6c167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.522+0000 7f4a6b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4a6c1055e0 0x7f4a6c167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59338/0 (socket says 172.21.15.80:59338) 2019-11-28T11:25:25.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.522+0000 7f4a6b59e700 1 -- 172.21.15.80:0/2320787585 learned_addr learned my addr 172.21.15.80:0/2320787585 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:25.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.522+0000 7f4a6a59c700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a6c104c10 0x7f4a6c1050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.522+0000 7f4a6b59e700 1 -- 172.21.15.80:0/2320787585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a6c104c10 msgr2=0x7f4a6c1050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.522+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a6c104c10 0x7f4a6c1050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.522+0000 7f4a6b59e700 1 -- 172.21.15.80:0/2320787585 >> v1:172.21.15.174:6789/0 conn(0x7f4a6c104820 legacy=0x7f4a6c10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.522+0000 7f4a6b59e700 1 -- 172.21.15.80:0/2320787585 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c109a90 con 0x7f4a6c1055e0 2019-11-28T11:25:25.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.522+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/2320787585 >> v2:172.21.15.80:3300/0 conn(0x7f4a6c1055e0 0x7f4a6c167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a64010440 tx=0x7f4a64010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.523+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/2320787585 >> v2:172.21.15.80:3300/0 conn(0x7f4a6c1055e0 0x7f4a6c167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a64010440 tx=0x7f4a64010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.523+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a6c1055e0 0x7f4a6c167a10 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f4a64010440 tx=0x7f4a64010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.523+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a6c1055e0 0x7f4a6c167a10 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f4a64010440 tx=0x7f4a64010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.523+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a6c1055e0 0x7f4a6c167a10 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f4a64010440 tx=0x7f4a64010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.523+0000 7f4a637fe700 1 -- 172.21.15.80:0/2320787585 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a6400afe0 con 0x7f4a6c1055e0 2019-11-28T11:25:25.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.523+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a6c1055e0 0x7f4a6c167a10 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f4a64010440 tx=0x7f4a64010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.523+0000 7f4a637fe700 1 -- 172.21.15.80:0/2320787585 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a64009aa0 con 0x7f4a6c1055e0 2019-11-28T11:25:25.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.523+0000 7f4a70e22700 1 -- 172.21.15.80:0/2320787585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6c109e10 con 0x7f4a6c1055e0 2019-11-28T11:25:25.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.523+0000 7f4a637fe700 1 -- 172.21.15.80:0/2320787585 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a6400a1b0 con 0x7f4a6c1055e0 2019-11-28T11:25:25.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.523+0000 7f4a70e22700 1 -- 172.21.15.80:0/2320787585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6c109a90 con 0x7f4a6c1055e0 2019-11-28T11:25:25.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.523+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a6c1055e0 0x7f4a6c167a10 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f4a64010440 tx=0x7f4a64010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.523+0000 7f4a637fe700 1 -- 172.21.15.80:0/2320787585 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4a64009c90 con 0x7f4a6c1055e0 2019-11-28T11:25:25.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.523+0000 7f4a6b59e700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a6c1055e0 0x7f4a6c167a10 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f4a64010440 tx=0x7f4a64010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.523+0000 7f4a637fe700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4a44018730 0x7f4a4401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.523+0000 7f4a637fe700 1 -- 172.21.15.80:0/2320787585 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f4a64031ab0 con 0x7f4a6c1055e0 2019-11-28T11:25:25.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.524+0000 7f4a6ad9d700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4a44018730 0x7f4a4401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.524+0000 7f4a6ad9d700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4a44018730 0x7f4a4401abc0 crc :-1 s=READY pgs=60 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.531+0000 7f4a70e22700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.80:6816/6105,v1:172.21.15.80:6817/6105] conn(0x7f4a6c168530 0x7f4a6c168920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.531+0000 7f4a70e22700 1 -- 172.21.15.80:0/2320787585 --> [v2:172.21.15.80:6816/6105,v1:172.21.15.80:6817/6105] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a6c109a90 con 0x7f4a6c168530 2019-11-28T11:25:25.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.531+0000 7f4a6a59c700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.80:6816/6105,v1:172.21.15.80:6817/6105] conn(0x7f4a6c168530 0x7f4a6c168920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.531+0000 7f4a6a59c700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.80:6816/6105,v1:172.21.15.80:6817/6105] conn(0x7f4a6c168530 0x7f4a6c168920 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.532+0000 7f4a637fe700 1 -- 172.21.15.80:0/2320787585 <== osd.2 v2:172.21.15.80:6816/6105 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23014 (crc 0 0 0) 0x7f4a54000cc0 con 0x7f4a6c168530 2019-11-28T11:25:25.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.553+0000 7f4a70e22700 1 -- 172.21.15.80:0/2320787585 --> [v2:172.21.15.80:6816/6105,v1:172.21.15.80:6817/6105] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4a6c109a90 con 0x7f4a6c168530 2019-11-28T11:25:25.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.553+0000 7f4a637fe700 1 -- 172.21.15.80:0/2320787585 <== osd.2 v2:172.21.15.80:6816/6105 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4a54000cc0 con 0x7f4a6c168530 2019-11-28T11:25:25.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.554+0000 7f4a70e22700 1 -- 172.21.15.80:0/2320787585 >> [v2:172.21.15.80:6816/6105,v1:172.21.15.80:6817/6105] conn(0x7f4a6c168530 msgr2=0x7f4a6c168920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.554+0000 7f4a70e22700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.80:6816/6105,v1:172.21.15.80:6817/6105] conn(0x7f4a6c168530 0x7f4a6c168920 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.554+0000 7f4a70e22700 1 -- 172.21.15.80:0/2320787585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4a44018730 msgr2=0x7f4a4401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.554+0000 7f4a70e22700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4a44018730 0x7f4a4401abc0 crc :-1 s=READY pgs=60 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.554+0000 7f4a70e22700 1 -- 172.21.15.80:0/2320787585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a6c1055e0 msgr2=0x7f4a6c167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.554+0000 7f4a70e22700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a6c1055e0 0x7f4a6c167a10 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f4a64010440 tx=0x7f4a64010270).stop 2019-11-28T11:25:25.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.554+0000 7f4a6b59e700 1 -- 172.21.15.80:0/2320787585 reap_dead start 2019-11-28T11:25:25.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.554+0000 7f4a70e22700 1 -- 172.21.15.80:0/2320787585 shutdown_connections 2019-11-28T11:25:25.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.554+0000 7f4a70e22700 1 --2- 172.21.15.80:0/2320787585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a6c1055e0 0x7f4a6c167a10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.554+0000 7f4a70e22700 1 -- 172.21.15.80:0/2320787585 shutdown_connections 2019-11-28T11:25:25.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.555+0000 7f4a70e22700 1 -- 172.21.15.80:0/2320787585 wait complete. 2019-11-28T11:25:25.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.555+0000 7f4a70e22700 1 -- 172.21.15.80:0/2320787585 >> 172.21.15.80:0/2320787585 conn(0x7f4a6c13d620 msgr2=0x7f4a6c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:25.587 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2019-11-28T11:25:25.587 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2019-11-28T11:25:25.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.697+0000 7fb119281700 1 Processor -- start 2019-11-28T11:25:25.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.697+0000 7fb119281700 1 -- start start 2019-11-28T11:25:25.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.698+0000 7fb119281700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb11406c0a0 0x7fb114072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:25.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.698+0000 7fb119281700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1140734e0 0x7fb114071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:25.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.698+0000 7fb119281700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb114072360 0x7fb114072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:25.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.698+0000 7fb119281700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11406fd60 con 0x7fb114072360 2019-11-28T11:25:25.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.698+0000 7fb119281700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb114070030 con 0x7fb11406c0a0 2019-11-28T11:25:25.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.698+0000 7fb119281700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11406f330 con 0x7fb1140734e0 2019-11-28T11:25:25.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.698+0000 7fb113fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb114072360 0x7fb114072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.698+0000 7fb113fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb114072360 0x7fb114072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59346/0 (socket says 172.21.15.80:59346) 2019-11-28T11:25:25.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.698+0000 7fb113fff700 1 -- 172.21.15.80:0/1661990424 learned_addr learned my addr 172.21.15.80:0/1661990424 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:25.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.698+0000 7fb112ffd700 1 --2- 172.21.15.80:0/1661990424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1140734e0 0x7fb114071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.698+0000 7fb1137fe700 1 --2- 172.21.15.80:0/1661990424 >> v2:172.21.15.174:3300/0 conn(0x7fb11406c0a0 0x7fb114072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb113fff700 1 -- 172.21.15.80:0/1661990424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1140734e0 msgr2=0x7fb114071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:25.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb113fff700 1 --2- 172.21.15.80:0/1661990424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1140734e0 0x7fb114071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:25.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb113fff700 1 -- 172.21.15.80:0/1661990424 >> v2:172.21.15.174:3300/0 conn(0x7fb11406c0a0 msgr2=0x7fb114072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:25.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb113fff700 1 --2- 172.21.15.80:0/1661990424 >> v2:172.21.15.174:3300/0 conn(0x7fb11406c0a0 0x7fb114072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:25.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb113fff700 1 -- 172.21.15.80:0/1661990424 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1140706c0 con 0x7fb114072360 2019-11-28T11:25:25.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb1137fe700 1 --2- 172.21.15.80:0/1661990424 >> v2:172.21.15.174:3300/0 conn(0x7fb11406c0a0 0x7fb114072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:25.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb113fff700 1 --2- 172.21.15.80:0/1661990424 >> v2:172.21.15.80:3300/0 conn(0x7fb114072360 0x7fb114072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb10c00f6b0 tx=0x7fb10c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb113fff700 1 --2- 172.21.15.80:0/1661990424 >> v2:172.21.15.80:3300/0 conn(0x7fb114072360 0x7fb114072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb10c00f6b0 tx=0x7fb10c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb113fff700 1 --2- 172.21.15.80:0/1661990424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb114072360 0x7fb114072800 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7fb10c00f6b0 tx=0x7fb10c00fa50).ready entity=mon.0 client_cookie=3f43899dd8f265dd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb113fff700 1 --2- 172.21.15.80:0/1661990424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb114072360 0x7fb114072800 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fb10c00f6b0 tx=0x7fb10c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb113fff700 1 --2- 172.21.15.80:0/1661990424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb114072360 0x7fb114072800 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fb10c00f6b0 tx=0x7fb10c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb1127fc700 1 -- 172.21.15.80:0/1661990424 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb10c0010e0 con 0x7fb114072360 2019-11-28T11:25:25.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb113fff700 1 --2- 172.21.15.80:0/1661990424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb114072360 0x7fb114072800 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fb10c00f6b0 tx=0x7fb10c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb1127fc700 1 -- 172.21.15.80:0/1661990424 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c000b90 con 0x7fb114072360 2019-11-28T11:25:25.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb1127fc700 1 -- 172.21.15.80:0/1661990424 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb10c0016c0 con 0x7fb114072360 2019-11-28T11:25:25.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb119281700 1 -- 172.21.15.80:0/1661990424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb114072360 msgr2=0x7fb114072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.699+0000 7fb119281700 1 --2- 172.21.15.80:0/1661990424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb114072360 0x7fb114072800 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7fb10c00f6b0 tx=0x7fb10c00fa50).stop 2019-11-28T11:25:25.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.700+0000 7fb119281700 1 -- 172.21.15.80:0/1661990424 shutdown_connections 2019-11-28T11:25:25.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.700+0000 7fb119281700 1 --2- 172.21.15.80:0/1661990424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb114072360 0x7fb114072800 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.700+0000 7fb119281700 1 --2- 172.21.15.80:0/1661990424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1140734e0 0x7fb114071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:25.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.700+0000 7fb119281700 1 --2- 172.21.15.80:0/1661990424 >> v2:172.21.15.174:3300/0 conn(0x7fb11406c0a0 0x7fb114072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:25.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.700+0000 7fb119281700 1 -- 172.21.15.80:0/1661990424 shutdown_connections 2019-11-28T11:25:25.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.700+0000 7fb119281700 1 -- 172.21.15.80:0/1661990424 wait complete. 2019-11-28T11:25:25.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.700+0000 7fb119281700 1 -- 172.21.15.80:0/1661990424 >> 172.21.15.80:0/1661990424 conn(0x7fb114061cf0 msgr2=0x7fb114064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:25.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.702+0000 7fb119281700 1 Processor -- start 2019-11-28T11:25:25.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.702+0000 7fb119281700 1 -- start start 2019-11-28T11:25:25.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.703+0000 7fb119281700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb11413dc00 0x7fb114109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.703+0000 7fb119281700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1141094e0 0x7fb114167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.703+0000 7fb119281700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1141312c0 con 0x7fb11410a3a0 2019-11-28T11:25:25.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.703+0000 7fb119281700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb114105830 con 0x7fb11413dc00 2019-11-28T11:25:25.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.703+0000 7fb119281700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb114105b00 con 0x7fb1141094e0 2019-11-28T11:25:25.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.703+0000 7fb112ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb11410a3a0 0x7fb114108ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58666/0 (socket says 172.21.15.80:58666) 2019-11-28T11:25:25.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.703+0000 7fb112ffd700 1 -- 172.21.15.80:0/3172907201 learned_addr learned my addr 172.21.15.80:0/3172907201 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:25.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.703+0000 7fb1137fe700 1 --2- 172.21.15.80:0/3172907201 >> v2:172.21.15.174:3300/0 conn(0x7fb11413dc00 0x7fb114109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.703+0000 7fb113fff700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1141094e0 0x7fb114167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.703+0000 7fb10bfff700 1 -- 172.21.15.80:0/3172907201 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500925203 0 0) 0x7fb0fc0012f0 con 0x7fb11410a3a0 2019-11-28T11:25:25.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.703+0000 7fb10bfff700 1 -- 172.21.15.80:0/3172907201 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0ec002e80 con 0x7fb11410a3a0 2019-11-28T11:25:25.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb113fff700 1 -- 172.21.15.80:0/3172907201 >> v2:172.21.15.174:3300/0 conn(0x7fb11413dc00 msgr2=0x7fb114109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb113fff700 1 --2- 172.21.15.80:0/3172907201 >> v2:172.21.15.174:3300/0 conn(0x7fb11413dc00 0x7fb114109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb113fff700 1 -- 172.21.15.80:0/3172907201 >> v1:172.21.15.80:6789/0 conn(0x7fb11410a3a0 legacy=0x7fb114108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb113fff700 1 -- 172.21.15.80:0/3172907201 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb114106190 con 0x7fb1141094e0 2019-11-28T11:25:25.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb1137fe700 1 --2- 172.21.15.80:0/3172907201 >> v2:172.21.15.174:3300/0 conn(0x7fb11413dc00 0x7fb114109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:25.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb113fff700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1141094e0 0x7fb114167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb10c0543b0 tx=0x7fb10c054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb113fff700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1141094e0 0x7fb114167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb10c0543b0 tx=0x7fb10c054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb113fff700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1141094e0 0x7fb114167a10 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fb10c0543b0 tx=0x7fb10c054750).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb113fff700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1141094e0 0x7fb114167a10 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fb10c0543b0 tx=0x7fb10c054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb10bfff700 1 -- 172.21.15.80:0/3172907201 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb10c000bc0 con 0x7fb1141094e0 2019-11-28T11:25:25.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb113fff700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1141094e0 0x7fb114167a10 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fb10c0543b0 tx=0x7fb10c054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb10bfff700 1 -- 172.21.15.80:0/3172907201 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c0012b0 con 0x7fb1141094e0 2019-11-28T11:25:25.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb113fff700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1141094e0 0x7fb114167a10 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fb10c0543b0 tx=0x7fb10c054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb10bfff700 1 -- 172.21.15.80:0/3172907201 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb10c0081f0 con 0x7fb1141094e0 2019-11-28T11:25:25.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb119281700 1 -- 172.21.15.80:0/3172907201 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb114106510 con 0x7fb1141094e0 2019-11-28T11:25:25.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb119281700 1 -- 172.21.15.80:0/3172907201 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb114106190 con 0x7fb1141094e0 2019-11-28T11:25:25.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.704+0000 7fb113fff700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1141094e0 0x7fb114167a10 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fb10c0543b0 tx=0x7fb10c054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.705+0000 7fb10bfff700 1 -- 172.21.15.80:0/3172907201 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb10c000eb0 con 0x7fb1141094e0 2019-11-28T11:25:25.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.705+0000 7fb113fff700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1141094e0 0x7fb114167a10 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fb10c0543b0 tx=0x7fb10c054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.705+0000 7fb10bfff700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0ec018770 0x7fb0ec01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.705+0000 7fb10bfff700 1 -- 172.21.15.80:0/3172907201 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fb10c075a10 con 0x7fb1141094e0 2019-11-28T11:25:25.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.705+0000 7fb1137fe700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0ec018770 0x7fb0ec01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.705+0000 7fb1137fe700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0ec018770 0x7fb0ec01abe0 crc :-1 s=READY pgs=61 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.712+0000 7fb119281700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.80:6824/6126,v1:172.21.15.80:6825/6126] conn(0x7fb114167f50 0x7fb114168340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.712+0000 7fb119281700 1 -- 172.21.15.80:0/3172907201 --> [v2:172.21.15.80:6824/6126,v1:172.21.15.80:6825/6126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb114106190 con 0x7fb114167f50 2019-11-28T11:25:25.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.712+0000 7fb112ffd700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.80:6824/6126,v1:172.21.15.80:6825/6126] conn(0x7fb114167f50 0x7fb114168340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.713+0000 7fb112ffd700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.80:6824/6126,v1:172.21.15.80:6825/6126] conn(0x7fb114167f50 0x7fb114168340 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.713+0000 7fb10bfff700 1 -- 172.21.15.80:0/3172907201 <== osd.3 v2:172.21.15.80:6824/6126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23014 (crc 0 0 0) 0x7fb0fc000ce0 con 0x7fb114167f50 2019-11-28T11:25:25.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.734+0000 7fb119281700 1 -- 172.21.15.80:0/3172907201 --> [v2:172.21.15.80:6824/6126,v1:172.21.15.80:6825/6126] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb114106190 con 0x7fb114167f50 2019-11-28T11:25:25.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.734+0000 7fb10bfff700 1 -- 172.21.15.80:0/3172907201 <== osd.3 v2:172.21.15.80:6824/6126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb0fc002020 con 0x7fb114167f50 2019-11-28T11:25:25.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.735+0000 7fb119281700 1 -- 172.21.15.80:0/3172907201 >> [v2:172.21.15.80:6824/6126,v1:172.21.15.80:6825/6126] conn(0x7fb114167f50 msgr2=0x7fb114168340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.735+0000 7fb119281700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.80:6824/6126,v1:172.21.15.80:6825/6126] conn(0x7fb114167f50 0x7fb114168340 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.735+0000 7fb119281700 1 -- 172.21.15.80:0/3172907201 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0ec018770 msgr2=0x7fb0ec01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.735+0000 7fb119281700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0ec018770 0x7fb0ec01abe0 crc :-1 s=READY pgs=61 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.735+0000 7fb119281700 1 -- 172.21.15.80:0/3172907201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1141094e0 msgr2=0x7fb114167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.735+0000 7fb119281700 1 --2- 172.21.15.80:0/3172907201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1141094e0 0x7fb114167a10 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fb10c0543b0 tx=0x7fb10c054750).stop 2019-11-28T11:25:25.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.735+0000 7fb113fff700 1 -- 172.21.15.80:0/3172907201 reap_dead start 2019-11-28T11:25:25.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.735+0000 7fb119281700 1 -- 172.21.15.80:0/3172907201 shutdown_connections 2019-11-28T11:25:25.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.736+0000 7fb119281700 1 -- 172.21.15.80:0/3172907201 shutdown_connections 2019-11-28T11:25:25.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.736+0000 7fb119281700 1 -- 172.21.15.80:0/3172907201 wait complete. 2019-11-28T11:25:25.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.736+0000 7fb119281700 1 -- 172.21.15.80:0/3172907201 >> 172.21.15.80:0/3172907201 conn(0x7fb11411bfc0 msgr2=0x7fb114141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:25.777 INFO:teuthology.orchestra.run.smithi080.stdout:60129542149 2019-11-28T11:25:25.778 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2019-11-28T11:25:25.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.880+0000 7f9a6e472700 1 Processor -- start 2019-11-28T11:25:25.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.880+0000 7f9a6e472700 1 -- start start 2019-11-28T11:25:25.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.881+0000 7f9a6e472700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a6806c0a0 0x7f9a68072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:25.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.881+0000 7f9a6e472700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6806db00 con 0x7f9a68072620 2019-11-28T11:25:25.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.881+0000 7f9a6e472700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6806e000 con 0x7f9a680734e0 2019-11-28T11:25:25.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.881+0000 7f9a6e472700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6806f330 con 0x7f9a6806c0a0 2019-11-28T11:25:25.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.881+0000 7f9a6d210700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9a68072620 0x7f9a68164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58676/0 (socket says 172.21.15.80:58676) 2019-11-28T11:25:25.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.881+0000 7f9a6d210700 1 -- 172.21.15.80:0/3021715842 learned_addr learned my addr 172.21.15.80:0/3021715842 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:25.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a6ca0f700 1 --2- 172.21.15.80:0/3021715842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a6806c0a0 0x7f9a68072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a677fe700 1 -- 172.21.15.80:0/3021715842 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915729495 0 0) 0x7f9a60001150 con 0x7f9a68072620 2019-11-28T11:25:25.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a677fe700 1 -- 172.21.15.80:0/3021715842 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a54002e80 con 0x7f9a68072620 2019-11-28T11:25:25.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a677fe700 1 -- 172.21.15.80:0/3021715842 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923639097 0 0) 0x7f9a58001400 con 0x7f9a680734e0 2019-11-28T11:25:25.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a677fe700 1 -- 172.21.15.80:0/3021715842 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a54004170 con 0x7f9a680734e0 2019-11-28T11:25:25.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a6ca0f700 1 -- 172.21.15.80:0/3021715842 >> v1:172.21.15.174:6789/0 conn(0x7f9a680734e0 legacy=0x7f9a68071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a6ca0f700 1 -- 172.21.15.80:0/3021715842 >> v1:172.21.15.80:6789/0 conn(0x7f9a68072620 legacy=0x7f9a68164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a6ca0f700 1 -- 172.21.15.80:0/3021715842 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a680706c0 con 0x7f9a6806c0a0 2019-11-28T11:25:25.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a6ca0f700 1 --2- 172.21.15.80:0/3021715842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a6806c0a0 0x7f9a68072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9a5000af50 tx=0x7f9a5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a6ca0f700 1 --2- 172.21.15.80:0/3021715842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a6806c0a0 0x7f9a68072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9a5000af50 tx=0x7f9a5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a6ca0f700 1 --2- 172.21.15.80:0/3021715842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a6806c0a0 0x7f9a68072fa0 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f9a5000af50 tx=0x7f9a5000b760).ready entity=mon.2 client_cookie=2726759a7f4cb99e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a6ca0f700 1 --2- 172.21.15.80:0/3021715842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a6806c0a0 0x7f9a68072fa0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f9a5000af50 tx=0x7f9a5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a677fe700 1 -- 172.21.15.80:0/3021715842 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a50000960 con 0x7f9a6806c0a0 2019-11-28T11:25:25.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a6ca0f700 1 --2- 172.21.15.80:0/3021715842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a6806c0a0 0x7f9a68072fa0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f9a5000af50 tx=0x7f9a5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a6ca0f700 1 --2- 172.21.15.80:0/3021715842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a6806c0a0 0x7f9a68072fa0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f9a5000af50 tx=0x7f9a5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a677fe700 1 -- 172.21.15.80:0/3021715842 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a50009860 con 0x7f9a6806c0a0 2019-11-28T11:25:25.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a677fe700 1 -- 172.21.15.80:0/3021715842 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a50009f30 con 0x7f9a6806c0a0 2019-11-28T11:25:25.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a6e472700 1 -- 172.21.15.80:0/3021715842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a6806c0a0 msgr2=0x7f9a68072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.882+0000 7f9a6e472700 1 --2- 172.21.15.80:0/3021715842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a6806c0a0 0x7f9a68072fa0 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f9a5000af50 tx=0x7f9a5000b760).stop 2019-11-28T11:25:25.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.883+0000 7f9a6e472700 1 -- 172.21.15.80:0/3021715842 shutdown_connections 2019-11-28T11:25:25.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.883+0000 7f9a6e472700 1 --2- 172.21.15.80:0/3021715842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a6806c0a0 0x7f9a68072fa0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.883+0000 7f9a6e472700 1 -- 172.21.15.80:0/3021715842 shutdown_connections 2019-11-28T11:25:25.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.883+0000 7f9a6e472700 1 -- 172.21.15.80:0/3021715842 wait complete. 2019-11-28T11:25:25.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.883+0000 7f9a6e472700 1 -- 172.21.15.80:0/3021715842 >> 172.21.15.80:0/3021715842 conn(0x7f9a68061cf0 msgr2=0x7f9a68064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:25.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.885+0000 7f9a6e472700 1 Processor -- start 2019-11-28T11:25:25.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.885+0000 7f9a6e472700 1 -- start start 2019-11-28T11:25:25.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.886+0000 7f9a6e472700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a681346b0 0x7f9a68135040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.886+0000 7f9a6e472700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6813f410 con 0x7f9a681342c0 2019-11-28T11:25:25.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.886+0000 7f9a6e472700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6812ed00 con 0x7f9a68135580 2019-11-28T11:25:25.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.886+0000 7f9a6e472700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a68141670 con 0x7f9a681346b0 2019-11-28T11:25:25.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a6ca0f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9a681342c0 0x7f9a681361c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58680/0 (socket says 172.21.15.80:58680) 2019-11-28T11:25:25.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a6ca0f700 1 -- 172.21.15.80:0/3860685135 learned_addr learned my addr 172.21.15.80:0/3860685135 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:25.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a67fff700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a681346b0 0x7f9a68135040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a657fa700 1 -- 172.21.15.80:0/3860685135 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141458831 0 0) 0x7f9a5000b3d0 con 0x7f9a681342c0 2019-11-28T11:25:25.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a657fa700 1 -- 172.21.15.80:0/3860685135 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a4c002e80 con 0x7f9a681342c0 2019-11-28T11:25:25.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a657fa700 1 -- 172.21.15.80:0/3860685135 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289246439 0 0) 0x7f9a60001100 con 0x7f9a68135580 2019-11-28T11:25:25.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a657fa700 1 -- 172.21.15.80:0/3860685135 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a4c0030b0 con 0x7f9a68135580 2019-11-28T11:25:25.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a67fff700 1 -- 172.21.15.80:0/3860685135 >> v1:172.21.15.174:6789/0 conn(0x7f9a68135580 legacy=0x7f9a681ac5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a657fa700 1 -- 172.21.15.80:0/3860685135 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4282504745 0 0) 0x7f9a5000afc0 con 0x7f9a681342c0 2019-11-28T11:25:25.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a67fff700 1 -- 172.21.15.80:0/3860685135 >> v1:172.21.15.80:6789/0 conn(0x7f9a681342c0 legacy=0x7f9a681361c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a67fff700 1 -- 172.21.15.80:0/3860685135 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a68141fd0 con 0x7f9a681346b0 2019-11-28T11:25:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a67fff700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a681346b0 0x7f9a68135040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a58010720 tx=0x7f9a58010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a67fff700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a681346b0 0x7f9a68135040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a58010720 tx=0x7f9a58010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a67fff700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a681346b0 0x7f9a68135040 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f9a58010720 tx=0x7f9a58010ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a67fff700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a681346b0 0x7f9a68135040 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f9a58010720 tx=0x7f9a58010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a657fa700 1 -- 172.21.15.80:0/3860685135 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a58007590 con 0x7f9a681346b0 2019-11-28T11:25:25.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a67fff700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a681346b0 0x7f9a68135040 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f9a58010720 tx=0x7f9a58010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a657fa700 1 -- 172.21.15.80:0/3860685135 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a58009d00 con 0x7f9a681346b0 2019-11-28T11:25:25.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a67fff700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a681346b0 0x7f9a68135040 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f9a58010720 tx=0x7f9a58010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a6e472700 1 -- 172.21.15.80:0/3860685135 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a68142350 con 0x7f9a681346b0 2019-11-28T11:25:25.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a657fa700 1 -- 172.21.15.80:0/3860685135 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a58009ef0 con 0x7f9a681346b0 2019-11-28T11:25:25.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.887+0000 7f9a6e472700 1 -- 172.21.15.80:0/3860685135 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a68141fd0 con 0x7f9a681346b0 2019-11-28T11:25:25.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.888+0000 7f9a67fff700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a681346b0 0x7f9a68135040 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f9a58010720 tx=0x7f9a58010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.888+0000 7f9a657fa700 1 -- 172.21.15.80:0/3860685135 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9a58009ef0 con 0x7f9a681346b0 2019-11-28T11:25:25.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.888+0000 7f9a67fff700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a681346b0 0x7f9a68135040 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f9a58010720 tx=0x7f9a58010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:25.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.888+0000 7f9a657fa700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a4c018750 0x7f9a4c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.888+0000 7f9a657fa700 1 -- 172.21.15.80:0/3860685135 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f9a58031e10 con 0x7f9a681346b0 2019-11-28T11:25:25.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.888+0000 7f9a6ca0f700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a4c018750 0x7f9a4c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.888+0000 7f9a6ca0f700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a4c018750 0x7f9a4c01abe0 crc :-1 s=READY pgs=62 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.895+0000 7f9a6e472700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:6802/36920,v1:172.21.15.174:6803/36920] conn(0x7f9a68053990 0x7f9a68053d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:25.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.895+0000 7f9a6e472700 1 -- 172.21.15.80:0/3860685135 --> [v2:172.21.15.174:6802/36920,v1:172.21.15.174:6803/36920] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a68141fd0 con 0x7f9a68053990 2019-11-28T11:25:25.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.896+0000 7f9a6d210700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:6802/36920,v1:172.21.15.174:6803/36920] conn(0x7f9a68053990 0x7f9a68053d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:25.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.896+0000 7f9a6d210700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:6802/36920,v1:172.21.15.174:6803/36920] conn(0x7f9a68053990 0x7f9a68053d80 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:25.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.897+0000 7f9a657fa700 1 -- 172.21.15.80:0/3860685135 <== osd.4 v2:172.21.15.174:6802/36920 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23014 (crc 0 0 0) 0x7f9a60000940 con 0x7f9a68053990 2019-11-28T11:25:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.917+0000 7f9a6e472700 1 -- 172.21.15.80:0/3860685135 --> [v2:172.21.15.174:6802/36920,v1:172.21.15.174:6803/36920] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9a68141fd0 con 0x7f9a68053990 2019-11-28T11:25:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.917+0000 7f9a657fa700 1 -- 172.21.15.80:0/3860685135 <== osd.4 v2:172.21.15.174:6802/36920 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9a60004240 con 0x7f9a68053990 2019-11-28T11:25:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.918+0000 7f9a6e472700 1 -- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:6802/36920,v1:172.21.15.174:6803/36920] conn(0x7f9a68053990 msgr2=0x7f9a68053d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.918+0000 7f9a6e472700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:6802/36920,v1:172.21.15.174:6803/36920] conn(0x7f9a68053990 0x7f9a68053d80 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.918+0000 7f9a6e472700 1 -- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a4c018750 msgr2=0x7f9a4c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.918+0000 7f9a6e472700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a4c018750 0x7f9a4c01abe0 crc :-1 s=READY pgs=62 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.918+0000 7f9a6e472700 1 -- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a681346b0 msgr2=0x7f9a68135040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.918+0000 7f9a6e472700 1 --2- 172.21.15.80:0/3860685135 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a681346b0 0x7f9a68135040 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f9a58010720 tx=0x7f9a58010ac0).stop 2019-11-28T11:25:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.918+0000 7f9a6d210700 1 -- 172.21.15.80:0/3860685135 reap_dead start 2019-11-28T11:25:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.919+0000 7f9a6e472700 1 -- 172.21.15.80:0/3860685135 shutdown_connections 2019-11-28T11:25:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.919+0000 7f9a6e472700 1 -- 172.21.15.80:0/3860685135 shutdown_connections 2019-11-28T11:25:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.919+0000 7f9a6e472700 1 -- 172.21.15.80:0/3860685135 wait complete. 2019-11-28T11:25:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:25.919+0000 7f9a6e472700 1 -- 172.21.15.80:0/3860685135 >> 172.21.15.80:0/3860685135 conn(0x7f9a68159ae0 msgr2=0x7f9a6813d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:25.948 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2019-11-28T11:25:25.949 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2019-11-28T11:25:26.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.052+0000 7fa563926700 1 Processor -- start 2019-11-28T11:25:26.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.052+0000 7fa563926700 1 -- start start 2019-11-28T11:25:26.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.053+0000 7fa563926700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa55c06c0a0 0x7fa55c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:26.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.053+0000 7fa563926700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa55c0734e0 0x7fa55c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:26.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.053+0000 7fa563926700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c06db00 con 0x7fa55c072360 2019-11-28T11:25:26.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.053+0000 7fa563926700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c06fd60 con 0x7fa55c06c0a0 2019-11-28T11:25:26.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.053+0000 7fa563926700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c070030 con 0x7fa55c0734e0 2019-11-28T11:25:26.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa561ec3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa55c06c0a0 0x7fa55c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa5626c4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa55c072360 0x7fa55c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58692/0 (socket says 172.21.15.80:58692) 2019-11-28T11:25:26.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa5626c4700 1 -- 172.21.15.80:0/1907269112 learned_addr learned my addr 172.21.15.80:0/1907269112 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:26.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa5616c2700 1 --2- 172.21.15.80:0/1907269112 >> v2:172.21.15.174:3300/0 conn(0x7fa55c0734e0 0x7fa55c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa561ec3700 1 -- 172.21.15.80:0/1907269112 >> v2:172.21.15.174:3300/0 conn(0x7fa55c0734e0 msgr2=0x7fa55c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:26.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa561ec3700 1 --2- 172.21.15.80:0/1907269112 >> v2:172.21.15.174:3300/0 conn(0x7fa55c0734e0 0x7fa55c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:26.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa561ec3700 1 -- 172.21.15.80:0/1907269112 >> v1:172.21.15.80:6789/0 conn(0x7fa55c072360 legacy=0x7fa55c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa560ec1700 1 -- 172.21.15.80:0/1907269112 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332710850 0 0) 0x7fa554001150 con 0x7fa55c072360 2019-11-28T11:25:26.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa561ec3700 1 -- 172.21.15.80:0/1907269112 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0706c0 con 0x7fa55c06c0a0 2019-11-28T11:25:26.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa561ec3700 1 --2- 172.21.15.80:0/1907269112 >> v2:172.21.15.80:3300/0 conn(0x7fa55c06c0a0 0x7fa55c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa54c00af50 tx=0x7fa54c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa561ec3700 1 --2- 172.21.15.80:0/1907269112 >> v2:172.21.15.80:3300/0 conn(0x7fa55c06c0a0 0x7fa55c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa54c00af50 tx=0x7fa54c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa561ec3700 1 --2- 172.21.15.80:0/1907269112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa55c06c0a0 0x7fa55c072fa0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7fa54c00af50 tx=0x7fa54c00b6e0).ready entity=mon.0 client_cookie=b6d89b8032327d64 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:26.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa561ec3700 1 --2- 172.21.15.80:0/1907269112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa55c06c0a0 0x7fa55c072fa0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fa54c00af50 tx=0x7fa54c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa560ec1700 1 -- 172.21.15.80:0/1907269112 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54c007210 con 0x7fa55c06c0a0 2019-11-28T11:25:26.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa561ec3700 1 --2- 172.21.15.80:0/1907269112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa55c06c0a0 0x7fa55c072fa0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fa54c00af50 tx=0x7fa54c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa561ec3700 1 --2- 172.21.15.80:0/1907269112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa55c06c0a0 0x7fa55c072fa0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fa54c00af50 tx=0x7fa54c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa560ec1700 1 -- 172.21.15.80:0/1907269112 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c0099b0 con 0x7fa55c06c0a0 2019-11-28T11:25:26.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa560ec1700 1 -- 172.21.15.80:0/1907269112 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54c00a080 con 0x7fa55c06c0a0 2019-11-28T11:25:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa563926700 1 -- 172.21.15.80:0/1907269112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa55c06c0a0 msgr2=0x7fa55c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.054+0000 7fa563926700 1 --2- 172.21.15.80:0/1907269112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa55c06c0a0 0x7fa55c072fa0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7fa54c00af50 tx=0x7fa54c00b6e0).stop 2019-11-28T11:25:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.055+0000 7fa563926700 1 -- 172.21.15.80:0/1907269112 shutdown_connections 2019-11-28T11:25:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.055+0000 7fa563926700 1 --2- 172.21.15.80:0/1907269112 >> v2:172.21.15.174:3300/0 conn(0x7fa55c0734e0 0x7fa55c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:26.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.055+0000 7fa563926700 1 --2- 172.21.15.80:0/1907269112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa55c06c0a0 0x7fa55c072fa0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.055+0000 7fa563926700 1 -- 172.21.15.80:0/1907269112 shutdown_connections 2019-11-28T11:25:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.055+0000 7fa563926700 1 -- 172.21.15.80:0/1907269112 wait complete. 2019-11-28T11:25:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.055+0000 7fa563926700 1 -- 172.21.15.80:0/1907269112 >> 172.21.15.80:0/1907269112 conn(0x7fa55c061cf0 msgr2=0x7fa55c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.057+0000 7fa563926700 1 Processor -- start 2019-11-28T11:25:26.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.057+0000 7fa563926700 1 -- start start 2019-11-28T11:25:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.058+0000 7fa563926700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa55c13e5f0 0x7fa55c13e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.058+0000 7fa563926700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa55c10a070 0x7fa55c10bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.058+0000 7fa563926700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa55c10a4e0 0x7fa55c10c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.058+0000 7fa563926700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c10e060 con 0x7fa55c10a4e0 2019-11-28T11:25:26.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.058+0000 7fa563926700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c10e330 con 0x7fa55c13e5f0 2019-11-28T11:25:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.058+0000 7fa563926700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c10d630 con 0x7fa55c10a070 2019-11-28T11:25:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.058+0000 7fa5626c4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa55c10a4e0 0x7fa55c10c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.058+0000 7fa5626c4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa55c10a4e0 0x7fa55c10c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59384/0 (socket says 172.21.15.80:59384) 2019-11-28T11:25:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.058+0000 7fa5626c4700 1 -- 172.21.15.80:0/1232089481 learned_addr learned my addr 172.21.15.80:0/1232089481 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:26.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa561ec3700 1 --2- 172.21.15.80:0/1232089481 >> v2:172.21.15.174:3300/0 conn(0x7fa55c13e5f0 0x7fa55c13e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa5616c2700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa55c10a070 0x7fa55c10bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa5626c4700 1 -- 172.21.15.80:0/1232089481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa55c10a070 msgr2=0x7fa55c10bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa5626c4700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa55c10a070 0x7fa55c10bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa5626c4700 1 -- 172.21.15.80:0/1232089481 >> v2:172.21.15.174:3300/0 conn(0x7fa55c13e5f0 msgr2=0x7fa55c13e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa5626c4700 1 --2- 172.21.15.80:0/1232089481 >> v2:172.21.15.174:3300/0 conn(0x7fa55c13e5f0 0x7fa55c13e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa5626c4700 1 -- 172.21.15.80:0/1232089481 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c10e9c0 con 0x7fa55c10a4e0 2019-11-28T11:25:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa5616c2700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa55c10a070 0x7fa55c10bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:25:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa561ec3700 1 --2- 172.21.15.80:0/1232089481 >> v2:172.21.15.174:3300/0 conn(0x7fa55c13e5f0 0x7fa55c13e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:25:26.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa5626c4700 1 --2- 172.21.15.80:0/1232089481 >> v2:172.21.15.80:3300/0 conn(0x7fa55c10a4e0 0x7fa55c10c2f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa554010410 tx=0x7fa5540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa5626c4700 1 --2- 172.21.15.80:0/1232089481 >> v2:172.21.15.80:3300/0 conn(0x7fa55c10a4e0 0x7fa55c10c2f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa554010410 tx=0x7fa5540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa5626c4700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa55c10a4e0 0x7fa55c10c2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7fa554010410 tx=0x7fa5540107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:26.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa5626c4700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa55c10a4e0 0x7fa55c10c2f0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fa554010410 tx=0x7fa5540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa5626c4700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa55c10a4e0 0x7fa55c10c2f0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fa554010410 tx=0x7fa5540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa55a7fc700 1 -- 172.21.15.80:0/1232089481 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa554000940 con 0x7fa55c10a4e0 2019-11-28T11:25:26.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa5626c4700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa55c10a4e0 0x7fa55c10c2f0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fa554010410 tx=0x7fa5540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa55a7fc700 1 -- 172.21.15.80:0/1232089481 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5540010e0 con 0x7fa55c10a4e0 2019-11-28T11:25:26.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa563926700 1 -- 172.21.15.80:0/1232089481 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55c10ed40 con 0x7fa55c10a4e0 2019-11-28T11:25:26.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa55a7fc700 1 -- 172.21.15.80:0/1232089481 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa554001830 con 0x7fa55c10a4e0 2019-11-28T11:25:26.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa563926700 1 -- 172.21.15.80:0/1232089481 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c10e9c0 con 0x7fa55c10a4e0 2019-11-28T11:25:26.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.059+0000 7fa5626c4700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa55c10a4e0 0x7fa55c10c2f0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fa554010410 tx=0x7fa5540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.060+0000 7fa55a7fc700 1 -- 172.21.15.80:0/1232089481 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa554000940 con 0x7fa55c10a4e0 2019-11-28T11:25:26.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.060+0000 7fa5626c4700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa55c10a4e0 0x7fa55c10c2f0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fa554010410 tx=0x7fa5540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.060+0000 7fa55a7fc700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa540018730 0x7fa54001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.060+0000 7fa55a7fc700 1 -- 172.21.15.80:0/1232089481 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fa554031c50 con 0x7fa55c10a4e0 2019-11-28T11:25:26.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.060+0000 7fa561ec3700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa540018730 0x7fa54001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.060+0000 7fa561ec3700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa540018730 0x7fa54001abe0 crc :-1 s=READY pgs=63 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:26.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.068+0000 7fa563926700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.174:6810/36928,v1:172.21.15.174:6811/36928] conn(0x7fa55c108ef0 0x7fa55c1092e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.068+0000 7fa563926700 1 -- 172.21.15.80:0/1232089481 --> [v2:172.21.15.174:6810/36928,v1:172.21.15.174:6811/36928] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa55c10ed40 con 0x7fa55c108ef0 2019-11-28T11:25:26.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.068+0000 7fa5616c2700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.174:6810/36928,v1:172.21.15.174:6811/36928] conn(0x7fa55c108ef0 0x7fa55c1092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.068+0000 7fa5616c2700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.174:6810/36928,v1:172.21.15.174:6811/36928] conn(0x7fa55c108ef0 0x7fa55c1092e0 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:26.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.069+0000 7fa55a7fc700 1 -- 172.21.15.80:0/1232089481 <== osd.5 v2:172.21.15.174:6810/36928 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23014 (crc 0 0 0) 0x7fa544009900 con 0x7fa55c108ef0 2019-11-28T11:25:26.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.089+0000 7fa563926700 1 -- 172.21.15.80:0/1232089481 --> [v2:172.21.15.174:6810/36928,v1:172.21.15.174:6811/36928] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa55c10e9c0 con 0x7fa55c108ef0 2019-11-28T11:25:26.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.089+0000 7fa55a7fc700 1 -- 172.21.15.80:0/1232089481 <== osd.5 v2:172.21.15.174:6810/36928 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa544008d70 con 0x7fa55c108ef0 2019-11-28T11:25:26.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.090+0000 7fa563926700 1 -- 172.21.15.80:0/1232089481 >> [v2:172.21.15.174:6810/36928,v1:172.21.15.174:6811/36928] conn(0x7fa55c108ef0 msgr2=0x7fa55c1092e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.090+0000 7fa563926700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.174:6810/36928,v1:172.21.15.174:6811/36928] conn(0x7fa55c108ef0 0x7fa55c1092e0 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.091+0000 7fa563926700 1 -- 172.21.15.80:0/1232089481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa540018730 msgr2=0x7fa54001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.091+0000 7fa563926700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa540018730 0x7fa54001abe0 crc :-1 s=READY pgs=63 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.091+0000 7fa563926700 1 -- 172.21.15.80:0/1232089481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa55c10a4e0 msgr2=0x7fa55c10c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.091+0000 7fa563926700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa55c10a4e0 0x7fa55c10c2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7fa554010410 tx=0x7fa5540107b0).stop 2019-11-28T11:25:26.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.091+0000 7fa5626c4700 1 -- 172.21.15.80:0/1232089481 reap_dead start 2019-11-28T11:25:26.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.091+0000 7fa563926700 1 -- 172.21.15.80:0/1232089481 shutdown_connections 2019-11-28T11:25:26.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.091+0000 7fa563926700 1 --2- 172.21.15.80:0/1232089481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa55c10a4e0 0x7fa55c10c2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.091+0000 7fa563926700 1 -- 172.21.15.80:0/1232089481 shutdown_connections 2019-11-28T11:25:26.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.091+0000 7fa563926700 1 -- 172.21.15.80:0/1232089481 wait complete. 2019-11-28T11:25:26.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.091+0000 7fa563926700 1 -- 172.21.15.80:0/1232089481 >> 172.21.15.80:0/1232089481 conn(0x7fa55c13d620 msgr2=0x7fa55c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:26.124 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2019-11-28T11:25:26.125 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2019-11-28T11:25:26.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.230+0000 7f57a2395700 1 Processor -- start 2019-11-28T11:25:26.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.230+0000 7f57a2395700 1 -- start start 2019-11-28T11:25:26.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.231+0000 7f57a2395700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f579c06c0a0 0x7f579c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:26.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.231+0000 7f57a2395700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c0734e0 0x7f579c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:26.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.231+0000 7f57a2395700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579c06db00 con 0x7f579c072360 2019-11-28T11:25:26.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.231+0000 7f57a2395700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c06fd60 con 0x7f579c06c0a0 2019-11-28T11:25:26.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.231+0000 7f57a2395700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c070030 con 0x7f579c0734e0 2019-11-28T11:25:26.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.231+0000 7f57a0932700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f579c06c0a0 0x7f579c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.231+0000 7f57a0932700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f579c06c0a0 0x7f579c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59390/0 (socket says 172.21.15.80:59390) 2019-11-28T11:25:26.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.231+0000 7f57a0932700 1 -- 172.21.15.80:0/1072242799 learned_addr learned my addr 172.21.15.80:0/1072242799 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:26.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.232+0000 7f579bfff700 1 --2- 172.21.15.80:0/1072242799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c0734e0 0x7f579c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.232+0000 7f57a0932700 1 -- 172.21.15.80:0/1072242799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c0734e0 msgr2=0x7f579c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:26.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.232+0000 7f57a0932700 1 --2- 172.21.15.80:0/1072242799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c0734e0 0x7f579c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:26.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.232+0000 7f57a0932700 1 -- 172.21.15.80:0/1072242799 >> v1:172.21.15.174:6789/0 conn(0x7f579c072360 legacy=0x7f579c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:26.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.232+0000 7f57a0932700 1 -- 172.21.15.80:0/1072242799 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c0706c0 con 0x7f579c06c0a0 2019-11-28T11:25:26.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.232+0000 7f57a0932700 1 --2- 172.21.15.80:0/1072242799 >> v2:172.21.15.80:3300/0 conn(0x7f579c06c0a0 0x7f579c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f578400f6c0 tx=0x7f578400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.232+0000 7f57a0932700 1 --2- 172.21.15.80:0/1072242799 >> v2:172.21.15.80:3300/0 conn(0x7f579c06c0a0 0x7f579c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f578400f6c0 tx=0x7f578400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.232+0000 7f57a0932700 1 --2- 172.21.15.80:0/1072242799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579c06c0a0 0x7f579c072fa0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f578400f6c0 tx=0x7f578400fa60).ready entity=mon.0 client_cookie=dba33c8f0530201e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:26.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.232+0000 7f57a0932700 1 --2- 172.21.15.80:0/1072242799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579c06c0a0 0x7f579c072fa0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f578400f6c0 tx=0x7f578400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.232+0000 7f57a0932700 1 --2- 172.21.15.80:0/1072242799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579c06c0a0 0x7f579c072fa0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f578400f6c0 tx=0x7f578400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.232+0000 7f579b7fe700 1 -- 172.21.15.80:0/1072242799 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5784000960 con 0x7f579c06c0a0 2019-11-28T11:25:26.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.232+0000 7f57a0932700 1 --2- 172.21.15.80:0/1072242799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579c06c0a0 0x7f579c072fa0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f578400f6c0 tx=0x7f578400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.232+0000 7f579b7fe700 1 -- 172.21.15.80:0/1072242799 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5784000c90 con 0x7f579c06c0a0 2019-11-28T11:25:26.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.232+0000 7f579b7fe700 1 -- 172.21.15.80:0/1072242799 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57840013a0 con 0x7f579c06c0a0 2019-11-28T11:25:26.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.232+0000 7f57a2395700 1 -- 172.21.15.80:0/1072242799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579c06c0a0 msgr2=0x7f579c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.232+0000 7f57a2395700 1 --2- 172.21.15.80:0/1072242799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579c06c0a0 0x7f579c072fa0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f578400f6c0 tx=0x7f578400fa60).stop 2019-11-28T11:25:26.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.233+0000 7f57a2395700 1 -- 172.21.15.80:0/1072242799 shutdown_connections 2019-11-28T11:25:26.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.233+0000 7f57a2395700 1 --2- 172.21.15.80:0/1072242799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c0734e0 0x7f579c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:26.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.233+0000 7f57a2395700 1 --2- 172.21.15.80:0/1072242799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579c06c0a0 0x7f579c072fa0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.233+0000 7f57a2395700 1 -- 172.21.15.80:0/1072242799 shutdown_connections 2019-11-28T11:25:26.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.233+0000 7f57a2395700 1 -- 172.21.15.80:0/1072242799 wait complete. 2019-11-28T11:25:26.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.233+0000 7f57a2395700 1 -- 172.21.15.80:0/1072242799 >> 172.21.15.80:0/1072242799 conn(0x7f579c061cf0 msgr2=0x7f579c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:26.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.235+0000 7f57a2395700 1 Processor -- start 2019-11-28T11:25:26.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.235+0000 7f57a2395700 1 -- start start 2019-11-28T11:25:26.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.236+0000 7f57a2395700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c109e40 0x7f579c10a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.236+0000 7f57a2395700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579c13f1e0 con 0x7f579c10a810 2019-11-28T11:25:26.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.236+0000 7f57a2395700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579c131a30 con 0x7f579c13eb40 2019-11-28T11:25:26.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.236+0000 7f57a2395700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c1234c0 con 0x7f579c109e40 2019-11-28T11:25:26.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.236+0000 7f57a1133700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f579c10a810 0x7f579c105210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58714/0 (socket says 172.21.15.80:58714) 2019-11-28T11:25:26.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.236+0000 7f57a1133700 1 -- 172.21.15.80:0/4008951003 learned_addr learned my addr 172.21.15.80:0/4008951003 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:26.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.236+0000 7f579bfff700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c109e40 0x7f579c10a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f57997fa700 1 -- 172.21.15.80:0/4008951003 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608893920 0 0) 0x7f57940009b0 con 0x7f579c10a810 2019-11-28T11:25:26.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f57997fa700 1 -- 172.21.15.80:0/4008951003 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5780002e80 con 0x7f579c10a810 2019-11-28T11:25:26.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f57997fa700 1 -- 172.21.15.80:0/4008951003 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464588246 0 0) 0x7f5784007d20 con 0x7f579c13eb40 2019-11-28T11:25:26.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f57997fa700 1 -- 172.21.15.80:0/4008951003 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57800030b0 con 0x7f579c13eb40 2019-11-28T11:25:26.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f57997fa700 1 -- 172.21.15.80:0/4008951003 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3715314227 0 0) 0x7f57940012b0 con 0x7f579c10a810 2019-11-28T11:25:26.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f579bfff700 1 -- 172.21.15.80:0/4008951003 >> v1:172.21.15.174:6789/0 conn(0x7f579c13eb40 legacy=0x7f579c10afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f579bfff700 1 -- 172.21.15.80:0/4008951003 >> v1:172.21.15.80:6789/0 conn(0x7f579c10a810 legacy=0x7f579c105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f579bfff700 1 -- 172.21.15.80:0/4008951003 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c108700 con 0x7f579c109e40 2019-11-28T11:25:26.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f579bfff700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c109e40 0x7f579c10a2d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f578c0106f0 tx=0x7f578c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f579bfff700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c109e40 0x7f579c10a2d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f578c0106f0 tx=0x7f578c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f579bfff700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c109e40 0x7f579c10a2d0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f578c0106f0 tx=0x7f578c010a90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:26.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f579bfff700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c109e40 0x7f579c10a2d0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f578c0106f0 tx=0x7f578c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f57997fa700 1 -- 172.21.15.80:0/4008951003 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f578c00aa70 con 0x7f579c109e40 2019-11-28T11:25:26.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f579bfff700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c109e40 0x7f579c10a2d0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f578c0106f0 tx=0x7f578c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f57997fa700 1 -- 172.21.15.80:0/4008951003 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c00bee0 con 0x7f579c109e40 2019-11-28T11:25:26.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f579bfff700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c109e40 0x7f579c10a2d0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f578c0106f0 tx=0x7f578c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f57997fa700 1 -- 172.21.15.80:0/4008951003 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f578c00aa70 con 0x7f579c109e40 2019-11-28T11:25:26.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f57a2395700 1 -- 172.21.15.80:0/4008951003 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579c108a80 con 0x7f579c109e40 2019-11-28T11:25:26.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.237+0000 7f57a2395700 1 -- 172.21.15.80:0/4008951003 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579c108700 con 0x7f579c109e40 2019-11-28T11:25:26.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.238+0000 7f579bfff700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c109e40 0x7f579c10a2d0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f578c0106f0 tx=0x7f578c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.238+0000 7f57997fa700 1 -- 172.21.15.80:0/4008951003 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f578c00c0d0 con 0x7f579c109e40 2019-11-28T11:25:26.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.238+0000 7f579bfff700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c109e40 0x7f579c10a2d0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f578c0106f0 tx=0x7f578c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.238+0000 7f57997fa700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5780018750 0x7f578001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.238+0000 7f57997fa700 1 -- 172.21.15.80:0/4008951003 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f578c031e00 con 0x7f579c109e40 2019-11-28T11:25:26.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.238+0000 7f57a0932700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5780018750 0x7f578001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.238+0000 7f57a0932700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5780018750 0x7f578001abe0 crc :-1 s=READY pgs=64 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:26.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.245+0000 7f57a2395700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:6818/36962,v1:172.21.15.174:6819/36962] conn(0x7f579c13b870 0x7f579c053480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.245+0000 7f57a2395700 1 -- 172.21.15.80:0/4008951003 --> [v2:172.21.15.174:6818/36962,v1:172.21.15.174:6819/36962] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f579c108700 con 0x7f579c13b870 2019-11-28T11:25:26.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.246+0000 7f57a1133700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:6818/36962,v1:172.21.15.174:6819/36962] conn(0x7f579c13b870 0x7f579c053480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.246+0000 7f57a1133700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:6818/36962,v1:172.21.15.174:6819/36962] conn(0x7f579c13b870 0x7f579c053480 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:26.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.247+0000 7f57997fa700 1 -- 172.21.15.80:0/4008951003 <== osd.6 v2:172.21.15.174:6818/36962 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23014 (crc 0 0 0) 0x7f5794000960 con 0x7f579c13b870 2019-11-28T11:25:26.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.266+0000 7f57a2395700 1 -- 172.21.15.80:0/4008951003 --> [v2:172.21.15.174:6818/36962,v1:172.21.15.174:6819/36962] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f579c108700 con 0x7f579c13b870 2019-11-28T11:25:26.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.267+0000 7f57997fa700 1 -- 172.21.15.80:0/4008951003 <== osd.6 v2:172.21.15.174:6818/36962 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5794000ea0 con 0x7f579c13b870 2019-11-28T11:25:26.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.268+0000 7f57a2395700 1 -- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:6818/36962,v1:172.21.15.174:6819/36962] conn(0x7f579c13b870 msgr2=0x7f579c053480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.268+0000 7f57a2395700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:6818/36962,v1:172.21.15.174:6819/36962] conn(0x7f579c13b870 0x7f579c053480 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.268+0000 7f57a2395700 1 -- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5780018750 msgr2=0x7f578001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.268+0000 7f57a2395700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5780018750 0x7f578001abe0 crc :-1 s=READY pgs=64 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.268+0000 7f57a2395700 1 -- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c109e40 msgr2=0x7f579c10a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.268+0000 7f57a2395700 1 --2- 172.21.15.80:0/4008951003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579c109e40 0x7f579c10a2d0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f578c0106f0 tx=0x7f578c010a90).stop 2019-11-28T11:25:26.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.268+0000 7f57a1133700 1 -- 172.21.15.80:0/4008951003 reap_dead start 2019-11-28T11:25:26.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.268+0000 7f57a2395700 1 -- 172.21.15.80:0/4008951003 shutdown_connections 2019-11-28T11:25:26.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.268+0000 7f57a2395700 1 -- 172.21.15.80:0/4008951003 shutdown_connections 2019-11-28T11:25:26.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.268+0000 7f57a2395700 1 -- 172.21.15.80:0/4008951003 wait complete. 2019-11-28T11:25:26.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.268+0000 7f57a2395700 1 -- 172.21.15.80:0/4008951003 >> 172.21.15.80:0/4008951003 conn(0x7f579c11bfc0 msgr2=0x7f579c141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:26.297 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2019-11-28T11:25:26.298 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2019-11-28T11:25:26.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.401+0000 7f0f282ce700 1 Processor -- start 2019-11-28T11:25:26.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.401+0000 7f0f282ce700 1 -- start start 2019-11-28T11:25:26.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.402+0000 7f0f282ce700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f2006c0a0 0x7f0f20072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:26.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.402+0000 7f0f282ce700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f2006db00 con 0x7f0f200734e0 2019-11-28T11:25:26.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.402+0000 7f0f282ce700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f2006e000 con 0x7f0f20072620 2019-11-28T11:25:26.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.402+0000 7f0f282ce700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f2006fd60 con 0x7f0f2006c0a0 2019-11-28T11:25:26.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.402+0000 7f0f2686b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f2006c0a0 0x7f0f20072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.402+0000 7f0f2686b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f2006c0a0 0x7f0f20072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59404/0 (socket says 172.21.15.80:59404) 2019-11-28T11:25:26.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.402+0000 7f0f2686b700 1 -- 172.21.15.80:0/3720214755 learned_addr learned my addr 172.21.15.80:0/3720214755 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:26.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.402+0000 7f0f2606a700 1 --1- 172.21.15.80:0/3720214755 >> v1:172.21.15.80:6789/0 conn(0x7f0f200734e0 0x7f0f20071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58724/0 (socket says 172.21.15.80:58724) 2019-11-28T11:25:26.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.403+0000 7f0f2686b700 1 -- 172.21.15.80:0/3720214755 >> v1:172.21.15.174:6789/0 conn(0x7f0f20072620 legacy=0x7f0f20164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.403+0000 7f0f2686b700 1 -- 172.21.15.80:0/3720214755 >> v1:172.21.15.80:6789/0 conn(0x7f0f200734e0 legacy=0x7f0f20071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.403+0000 7f0f2686b700 1 -- 172.21.15.80:0/3720214755 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f200706c0 con 0x7f0f2006c0a0 2019-11-28T11:25:26.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.403+0000 7f0f25869700 1 -- 172.21.15.80:0/3720214755 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532184933 0 0) 0x7f0f10001070 con 0x7f0f200734e0 2019-11-28T11:25:26.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.403+0000 7f0f2686b700 1 --2- 172.21.15.80:0/3720214755 >> v2:172.21.15.80:3300/0 conn(0x7f0f2006c0a0 0x7f0f20072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0f0800fac0 tx=0x7f0f0800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.403+0000 7f0f2686b700 1 --2- 172.21.15.80:0/3720214755 >> v2:172.21.15.80:3300/0 conn(0x7f0f2006c0a0 0x7f0f20072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0f0800fac0 tx=0x7f0f0800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.403+0000 7f0f2686b700 1 --2- 172.21.15.80:0/3720214755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f2006c0a0 0x7f0f20072fa0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7f0f0800fac0 tx=0x7f0f0800fe60).ready entity=mon.0 client_cookie=c62af784451773ea server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:26.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.403+0000 7f0f2686b700 1 --2- 172.21.15.80:0/3720214755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f2006c0a0 0x7f0f20072fa0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f0f0800fac0 tx=0x7f0f0800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.403+0000 7f0f25869700 1 -- 172.21.15.80:0/3720214755 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f08000ce0 con 0x7f0f2006c0a0 2019-11-28T11:25:26.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.403+0000 7f0f2686b700 1 --2- 172.21.15.80:0/3720214755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f2006c0a0 0x7f0f20072fa0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f0f0800fac0 tx=0x7f0f0800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.403+0000 7f0f2686b700 1 --2- 172.21.15.80:0/3720214755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f2006c0a0 0x7f0f20072fa0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f0f0800fac0 tx=0x7f0f0800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.403+0000 7f0f25869700 1 -- 172.21.15.80:0/3720214755 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f08001010 con 0x7f0f2006c0a0 2019-11-28T11:25:26.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.403+0000 7f0f25869700 1 -- 172.21.15.80:0/3720214755 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f08001760 con 0x7f0f2006c0a0 2019-11-28T11:25:26.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.403+0000 7f0f282ce700 1 -- 172.21.15.80:0/3720214755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f2006c0a0 msgr2=0x7f0f20072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.403+0000 7f0f282ce700 1 --2- 172.21.15.80:0/3720214755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f2006c0a0 0x7f0f20072fa0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7f0f0800fac0 tx=0x7f0f0800fe60).stop 2019-11-28T11:25:26.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.404+0000 7f0f282ce700 1 -- 172.21.15.80:0/3720214755 shutdown_connections 2019-11-28T11:25:26.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.404+0000 7f0f282ce700 1 --2- 172.21.15.80:0/3720214755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f2006c0a0 0x7f0f20072fa0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.404+0000 7f0f282ce700 1 -- 172.21.15.80:0/3720214755 shutdown_connections 2019-11-28T11:25:26.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.404+0000 7f0f282ce700 1 -- 172.21.15.80:0/3720214755 wait complete. 2019-11-28T11:25:26.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.404+0000 7f0f282ce700 1 -- 172.21.15.80:0/3720214755 >> 172.21.15.80:0/3720214755 conn(0x7f0f20061cf0 msgr2=0x7f0f20064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:26.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.406+0000 7f0f282ce700 1 Processor -- start 2019-11-28T11:25:26.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.406+0000 7f0f282ce700 1 -- start start 2019-11-28T11:25:26.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.407+0000 7f0f282ce700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f201167a0 0x7f0f20121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.407+0000 7f0f282ce700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0f20121c90 0x7f0f2013efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.407+0000 7f0f282ce700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f20116b90 con 0x7f0f2013f4e0 2019-11-28T11:25:26.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.407+0000 7f0f282ce700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f201559c0 con 0x7f0f20121c90 2019-11-28T11:25:26.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.407+0000 7f0f282ce700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f20156d50 con 0x7f0f201167a0 2019-11-28T11:25:26.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.407+0000 7f0f2706c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0f2013f4e0 0x7f0f20164a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58730/0 (socket says 172.21.15.80:58730) 2019-11-28T11:25:26.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.407+0000 7f0f2706c700 1 -- 172.21.15.80:0/590199493 learned_addr learned my addr 172.21.15.80:0/590199493 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:26.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.407+0000 7f0f2606a700 1 --2- 172.21.15.80:0/590199493 >> v2:172.21.15.174:3300/0 conn(0x7f0f20121c90 0x7f0f2013efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.407+0000 7f0f2686b700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f201167a0 0x7f0f20121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.407+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116035434 0 0) 0x7f0f18000b90 con 0x7f0f2013f4e0 2019-11-28T11:25:26.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.407+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f04002e80 con 0x7f0f2013f4e0 2019-11-28T11:25:26.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.407+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4042651571 0 0) 0x7f0f180012b0 con 0x7f0f2013f4e0 2019-11-28T11:25:26.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.407+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0f040032e0 con 0x7f0f2013f4e0 2019-11-28T11:25:26.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.407+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f0f18001800 con 0x7f0f2013f4e0 2019-11-28T11:25:26.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.407+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f201167a0 msgr2=0x7f0f20121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.407+0000 7f0f1f7fe700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f201167a0 0x7f0f20121750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 >> v2:172.21.15.174:3300/0 conn(0x7f0f20121c90 msgr2=0x7f0f2013efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f1f7fe700 1 --2- 172.21.15.80:0/590199493 >> v2:172.21.15.174:3300/0 conn(0x7f0f20121c90 0x7f0f2013efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 >> v1:172.21.15.80:6789/0 conn(0x7f0f2013f4e0 legacy=0x7f0f20164a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f1f7fe700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f040033a0 0x7f0f040037f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f1f7fe700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f04003d30 0x7f0f040041a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f1f7fe700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f040048d0 0x7f0f04004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0400bbf0 con 0x7f0f040048d0 2019-11-28T11:25:26.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0400be20 con 0x7f0f040033a0 2019-11-28T11:25:26.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0400c050 con 0x7f0f04003d30 2019-11-28T11:25:26.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f2686b700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f040033a0 0x7f0f040037f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f2706c700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f040048d0 0x7f0f04004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f2606a700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f04003d30 0x7f0f040041a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f2706c700 1 -- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f04003d30 msgr2=0x7f0f040041a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f2706c700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f04003d30 0x7f0f040041a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f2706c700 1 -- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f040033a0 msgr2=0x7f0f040037f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f2706c700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f040033a0 0x7f0f040037f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f2706c700 1 -- 172.21.15.80:0/590199493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0400c300 con 0x7f0f040048d0 2019-11-28T11:25:26.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f282ce700 1 -- 172.21.15.80:0/590199493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f201570d0 con 0x7f0f040048d0 2019-11-28T11:25:26.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f2706c700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f040048d0 0x7f0f04004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f18010390 tx=0x7f0f18010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f2686b700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f040033a0 0x7f0f040037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:26.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f282ce700 1 -- 172.21.15.80:0/590199493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f20154730 con 0x7f0f040048d0 2019-11-28T11:25:26.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f2706c700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f040048d0 0x7f0f04004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f18010390 tx=0x7f0f18010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f2706c700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f040048d0 0x7f0f04004d90 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f0f18010390 tx=0x7f0f18010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:26.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f2706c700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f040048d0 0x7f0f04004d90 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f0f18010390 tx=0x7f0f18010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f180041f0 con 0x7f0f040048d0 2019-11-28T11:25:26.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f2706c700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f040048d0 0x7f0f04004d90 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f0f18010390 tx=0x7f0f18010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f2706c700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f040048d0 0x7f0f04004d90 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f0f18010390 tx=0x7f0f18010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f180012f0 con 0x7f0f040048d0 2019-11-28T11:25:26.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.408+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f180047d0 con 0x7f0f040048d0 2019-11-28T11:25:26.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.409+0000 7f0f2706c700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f040048d0 0x7f0f04004d90 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f0f18010390 tx=0x7f0f18010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.409+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0f180041f0 con 0x7f0f040048d0 2019-11-28T11:25:26.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.409+0000 7f0f2706c700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f040048d0 0x7f0f04004d90 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f0f18010390 tx=0x7f0f18010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.409+0000 7f0f1f7fe700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f04020b30 0x7f0f04022f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.409+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f0f18031c60 con 0x7f0f040048d0 2019-11-28T11:25:26.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.409+0000 7f0f2686b700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f04020b30 0x7f0f04022f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.409+0000 7f0f2686b700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f04020b30 0x7f0f04022f60 crc :-1 s=READY pgs=65 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:26.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.416+0000 7f0f282ce700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:6826/36964,v1:172.21.15.174:6827/36964] conn(0x7f0f201167a0 0x7f0f20142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.416+0000 7f0f282ce700 1 -- 172.21.15.80:0/590199493 --> [v2:172.21.15.174:6826/36964,v1:172.21.15.174:6827/36964] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f20154730 con 0x7f0f201167a0 2019-11-28T11:25:26.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.416+0000 7f0f2606a700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:6826/36964,v1:172.21.15.174:6827/36964] conn(0x7f0f201167a0 0x7f0f20142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.417+0000 7f0f2606a700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:6826/36964,v1:172.21.15.174:6827/36964] conn(0x7f0f201167a0 0x7f0f20142ab0 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:26.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.417+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 <== osd.7 v2:172.21.15.174:6826/36964 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23014 (crc 0 0 0) 0x7f0f10001710 con 0x7f0f201167a0 2019-11-28T11:25:26.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.437+0000 7f0f282ce700 1 -- 172.21.15.80:0/590199493 --> [v2:172.21.15.174:6826/36964,v1:172.21.15.174:6827/36964] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f20154730 con 0x7f0f201167a0 2019-11-28T11:25:26.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.438+0000 7f0f1f7fe700 1 -- 172.21.15.80:0/590199493 <== osd.7 v2:172.21.15.174:6826/36964 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0f10000e20 con 0x7f0f201167a0 2019-11-28T11:25:26.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.439+0000 7f0f282ce700 1 -- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:6826/36964,v1:172.21.15.174:6827/36964] conn(0x7f0f201167a0 msgr2=0x7f0f20142ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.439+0000 7f0f282ce700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:6826/36964,v1:172.21.15.174:6827/36964] conn(0x7f0f201167a0 0x7f0f20142ab0 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.439+0000 7f0f2706c700 1 -- 172.21.15.80:0/590199493 reap_dead start 2019-11-28T11:25:26.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.439+0000 7f0f282ce700 1 -- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f04020b30 msgr2=0x7f0f04022f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.439+0000 7f0f282ce700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f04020b30 0x7f0f04022f60 crc :-1 s=READY pgs=65 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.439+0000 7f0f282ce700 1 -- 172.21.15.80:0/590199493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f040048d0 msgr2=0x7f0f04004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.439+0000 7f0f282ce700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f040048d0 0x7f0f04004d90 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f0f18010390 tx=0x7f0f18010730).stop 2019-11-28T11:25:26.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.439+0000 7f0f282ce700 1 -- 172.21.15.80:0/590199493 shutdown_connections 2019-11-28T11:25:26.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.439+0000 7f0f282ce700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f04020b30 0x7f0f04022f60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.439+0000 7f0f282ce700 1 --2- 172.21.15.80:0/590199493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f040048d0 0x7f0f04004d90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.439+0000 7f0f282ce700 1 -- 172.21.15.80:0/590199493 shutdown_connections 2019-11-28T11:25:26.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.439+0000 7f0f282ce700 1 -- 172.21.15.80:0/590199493 wait complete. 2019-11-28T11:25:26.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.439+0000 7f0f282ce700 1 -- 172.21.15.80:0/590199493 >> 172.21.15.80:0/590199493 conn(0x7f0f201426c0 msgr2=0x7f0f20110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:26.471 INFO:teuthology.orchestra.run.smithi080.stdout:55834574854 2019-11-28T11:25:26.471 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-11-28T11:25:26.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.575+0000 7fd45d553700 1 Processor -- start 2019-11-28T11:25:26.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.575+0000 7fd45d553700 1 -- start start 2019-11-28T11:25:26.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.576+0000 7fd45d553700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd45806c490 0x7fd45806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:26.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.576+0000 7fd45d553700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45806db00 con 0x7fd45806c0a0 2019-11-28T11:25:26.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.576+0000 7fd45d553700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45806e000 con 0x7fd45806ce60 2019-11-28T11:25:26.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.576+0000 7fd45d553700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45806fd60 con 0x7fd45806c490 2019-11-28T11:25:26.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.576+0000 7fd456ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd45806c490 0x7fd45806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.576+0000 7fd456ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd45806c490 0x7fd45806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59430/0 (socket says 172.21.15.80:59430) 2019-11-28T11:25:26.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.576+0000 7fd456ffd700 1 -- 172.21.15.80:0/1596555340 learned_addr learned my addr 172.21.15.80:0/1596555340 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:26.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.576+0000 7fd4577fe700 1 --1- 172.21.15.80:0/1596555340 >> v1:172.21.15.80:6789/0 conn(0x7fd45806c0a0 0x7fd458072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58742/0 (socket says 172.21.15.80:58742) 2019-11-28T11:25:26.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.577+0000 7fd456ffd700 1 -- 172.21.15.80:0/1596555340 >> v1:172.21.15.174:6789/0 conn(0x7fd45806ce60 legacy=0x7fd458164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:26.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.577+0000 7fd456ffd700 1 -- 172.21.15.80:0/1596555340 >> v1:172.21.15.80:6789/0 conn(0x7fd45806c0a0 legacy=0x7fd458072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.577+0000 7fd456ffd700 1 -- 172.21.15.80:0/1596555340 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4580706c0 con 0x7fd45806c490 2019-11-28T11:25:26.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.577+0000 7fd4567fc700 1 -- 172.21.15.80:0/1596555340 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890949189 0 0) 0x7fd448001100 con 0x7fd45806c0a0 2019-11-28T11:25:26.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.577+0000 7fd456ffd700 1 --2- 172.21.15.80:0/1596555340 >> v2:172.21.15.80:3300/0 conn(0x7fd45806c490 0x7fd45806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd44000fac0 tx=0x7fd44000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.577+0000 7fd456ffd700 1 --2- 172.21.15.80:0/1596555340 >> v2:172.21.15.80:3300/0 conn(0x7fd45806c490 0x7fd45806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd44000fac0 tx=0x7fd44000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.577+0000 7fd456ffd700 1 --2- 172.21.15.80:0/1596555340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45806c490 0x7fd45806c920 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7fd44000fac0 tx=0x7fd44000fe60).ready entity=mon.0 client_cookie=7a9154e54c75c0cf server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:26.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.577+0000 7fd456ffd700 1 --2- 172.21.15.80:0/1596555340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45806c490 0x7fd45806c920 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fd44000fac0 tx=0x7fd44000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.577+0000 7fd4567fc700 1 -- 172.21.15.80:0/1596555340 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd440000ce0 con 0x7fd45806c490 2019-11-28T11:25:26.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.577+0000 7fd456ffd700 1 --2- 172.21.15.80:0/1596555340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45806c490 0x7fd45806c920 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fd44000fac0 tx=0x7fd44000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.577+0000 7fd456ffd700 1 --2- 172.21.15.80:0/1596555340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45806c490 0x7fd45806c920 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fd44000fac0 tx=0x7fd44000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.577+0000 7fd4567fc700 1 -- 172.21.15.80:0/1596555340 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd440001010 con 0x7fd45806c490 2019-11-28T11:25:26.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.577+0000 7fd4567fc700 1 -- 172.21.15.80:0/1596555340 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4400016e0 con 0x7fd45806c490 2019-11-28T11:25:26.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.577+0000 7fd45d553700 1 -- 172.21.15.80:0/1596555340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45806c490 msgr2=0x7fd45806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.577+0000 7fd45d553700 1 --2- 172.21.15.80:0/1596555340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45806c490 0x7fd45806c920 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7fd44000fac0 tx=0x7fd44000fe60).stop 2019-11-28T11:25:26.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.578+0000 7fd45d553700 1 -- 172.21.15.80:0/1596555340 shutdown_connections 2019-11-28T11:25:26.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.578+0000 7fd45d553700 1 --2- 172.21.15.80:0/1596555340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45806c490 0x7fd45806c920 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.578+0000 7fd45d553700 1 -- 172.21.15.80:0/1596555340 shutdown_connections 2019-11-28T11:25:26.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.578+0000 7fd45d553700 1 -- 172.21.15.80:0/1596555340 wait complete. 2019-11-28T11:25:26.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.578+0000 7fd45d553700 1 -- 172.21.15.80:0/1596555340 >> 172.21.15.80:0/1596555340 conn(0x7fd458061cf0 msgr2=0x7fd458064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:26.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.580+0000 7fd45d553700 1 Processor -- start 2019-11-28T11:25:26.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.580+0000 7fd45d553700 1 -- start start 2019-11-28T11:25:26.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.581+0000 7fd45d553700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd458167a20 0x7fd458169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.581+0000 7fd45d553700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45813fc50 con 0x7fd4581145b0 2019-11-28T11:25:26.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.581+0000 7fd45d553700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd458122ef0 con 0x7fd45813f580 2019-11-28T11:25:26.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.581+0000 7fd45d553700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd458112550 con 0x7fd458167a20 2019-11-28T11:25:26.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.581+0000 7fd456ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd4581145b0 0x7fd458114a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58750/0 (socket says 172.21.15.80:58750) 2019-11-28T11:25:26.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.581+0000 7fd456ffd700 1 -- 172.21.15.80:0/3851863186 learned_addr learned my addr 172.21.15.80:0/3851863186 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:26.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.581+0000 7fd457fff700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd458167a20 0x7fd458169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.581+0000 7fd44ffff700 1 -- 172.21.15.80:0/3851863186 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498530142 0 0) 0x7fd440007de0 con 0x7fd4581145b0 2019-11-28T11:25:26.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd44ffff700 1 -- 172.21.15.80:0/3851863186 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd430002e80 con 0x7fd4581145b0 2019-11-28T11:25:26.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd44ffff700 1 -- 172.21.15.80:0/3851863186 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870457294 0 0) 0x7fd448000ea0 con 0x7fd45813f580 2019-11-28T11:25:26.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd44ffff700 1 -- 172.21.15.80:0/3851863186 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd430004170 con 0x7fd45813f580 2019-11-28T11:25:26.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd457fff700 1 -- 172.21.15.80:0/3851863186 >> v1:172.21.15.174:6789/0 conn(0x7fd45813f580 legacy=0x7fd458115730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd457fff700 1 -- 172.21.15.80:0/3851863186 >> v1:172.21.15.80:6789/0 conn(0x7fd4581145b0 legacy=0x7fd458114a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd457fff700 1 -- 172.21.15.80:0/3851863186 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd458112eb0 con 0x7fd458167a20 2019-11-28T11:25:26.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd457fff700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd458167a20 0x7fd458169e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4500103b0 tx=0x7fd450010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd457fff700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd458167a20 0x7fd458169e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4500103b0 tx=0x7fd450010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd457fff700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd458167a20 0x7fd458169e20 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7fd4500103b0 tx=0x7fd450010750).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:26.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd457fff700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd458167a20 0x7fd458169e20 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7fd4500103b0 tx=0x7fd450010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd44ffff700 1 -- 172.21.15.80:0/3851863186 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd450000960 con 0x7fd458167a20 2019-11-28T11:25:26.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd457fff700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd458167a20 0x7fd458169e20 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7fd4500103b0 tx=0x7fd450010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd457fff700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd458167a20 0x7fd458169e20 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7fd4500103b0 tx=0x7fd450010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd44ffff700 1 -- 172.21.15.80:0/3851863186 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd450009990 con 0x7fd458167a20 2019-11-28T11:25:26.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd45d553700 1 -- 172.21.15.80:0/3851863186 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd458113230 con 0x7fd458167a20 2019-11-28T11:25:26.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd44ffff700 1 -- 172.21.15.80:0/3851863186 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd45000a0e0 con 0x7fd458167a20 2019-11-28T11:25:26.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd45d553700 1 -- 172.21.15.80:0/3851863186 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd458112eb0 con 0x7fd458167a20 2019-11-28T11:25:26.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.582+0000 7fd457fff700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd458167a20 0x7fd458169e20 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7fd4500103b0 tx=0x7fd450010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.583+0000 7fd44ffff700 1 -- 172.21.15.80:0/3851863186 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd450009b80 con 0x7fd458167a20 2019-11-28T11:25:26.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.583+0000 7fd457fff700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd458167a20 0x7fd458169e20 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7fd4500103b0 tx=0x7fd450010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.583+0000 7fd44ffff700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd430018750 0x7fd43001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:26.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.583+0000 7fd44ffff700 1 -- 172.21.15.80:0/3851863186 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fd450031ac0 con 0x7fd458167a20 2019-11-28T11:25:26.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.583+0000 7fd4577fe700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd430018750 0x7fd43001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:26.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.583+0000 7fd4577fe700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd430018750 0x7fd43001abe0 crc :-1 s=READY pgs=66 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:26.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.590+0000 7fd45d553700 1 -- 172.21.15.80:0/3851863186 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd458113230 con 0x7fd458167a20 2019-11-28T11:25:26.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.594+0000 7fd457fff700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd458167a20 0x7fd458169e20 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7fd4500103b0 tx=0x7fd450010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.594+0000 7fd44ffff700 1 -- 172.21.15.80:0/3851863186 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd450007120 con 0x7fd458167a20 2019-11-28T11:25:26.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.784+0000 7fd45d553700 1 -- 172.21.15.80:0/3851863186 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd458112eb0 con 0x7fd458167a20 2019-11-28T11:25:26.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.785+0000 7fd457fff700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd458167a20 0x7fd458169e20 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7fd4500103b0 tx=0x7fd450010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:26.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.785+0000 7fd44ffff700 1 -- 172.21.15.80:0/3851863186 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd450009590 con 0x7fd458167a20 2019-11-28T11:25:26.806 INFO:teuthology.orchestra.run.smithi080.stdout:55834574852 2019-11-28T11:25:26.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.787+0000 7fd45d553700 1 -- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd430018750 msgr2=0x7fd43001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.787+0000 7fd45d553700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd430018750 0x7fd43001abe0 crc :-1 s=READY pgs=66 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.787+0000 7fd45d553700 1 -- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd458167a20 msgr2=0x7fd458169e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:26.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.787+0000 7fd45d553700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd458167a20 0x7fd458169e20 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7fd4500103b0 tx=0x7fd450010750).stop 2019-11-28T11:25:26.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.787+0000 7fd45d553700 1 -- 172.21.15.80:0/3851863186 shutdown_connections 2019-11-28T11:25:26.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.787+0000 7fd45d553700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd458167a20 0x7fd458169e20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.787+0000 7fd45d553700 1 --2- 172.21.15.80:0/3851863186 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd430018750 0x7fd43001abe0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:26.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.788+0000 7fd45d553700 1 -- 172.21.15.80:0/3851863186 shutdown_connections 2019-11-28T11:25:26.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.788+0000 7fd45d553700 1 -- 172.21.15.80:0/3851863186 wait complete. 2019-11-28T11:25:26.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:26.788+0000 7fd45d553700 1 -- 172.21.15.80:0/3851863186 >> 172.21.15.80:0/3851863186 conn(0x7fd4581426c0 msgr2=0x7fd458110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:26.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2019-11-28T11:25:27.818 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-11-28T11:25:27.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.927+0000 7f3f95204700 1 Processor -- start 2019-11-28T11:25:27.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.927+0000 7f3f95204700 1 -- start start 2019-11-28T11:25:27.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.928+0000 7f3f95204700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9006c0a0 0x7f3f90072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:27.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.928+0000 7f3f95204700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3f900734e0 0x7f3f90071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:27.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.928+0000 7f3f95204700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9006db00 con 0x7f3f90072360 2019-11-28T11:25:27.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.928+0000 7f3f95204700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9006f330 con 0x7f3f900734e0 2019-11-28T11:25:27.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.928+0000 7f3f95204700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f900706c0 con 0x7f3f9006c0a0 2019-11-28T11:25:27.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.928+0000 7f3f8f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9006c0a0 0x7f3f90072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:27.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.928+0000 7f3f8ed9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3f900734e0 0x7f3f90071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:27.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.928+0000 7f3f8ed9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3f900734e0 0x7f3f90071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:46098/0 (socket says 172.21.15.80:46098) 2019-11-28T11:25:27.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.928+0000 7f3f8f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9006c0a0 0x7f3f90072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:33472/0 (socket says 172.21.15.80:33472) 2019-11-28T11:25:27.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.928+0000 7f3f8ed9d700 1 -- 172.21.15.80:0/2531979124 learned_addr learned my addr 172.21.15.80:0/2531979124 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:27.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.928+0000 7f3f8ed9d700 1 -- 172.21.15.80:0/2531979124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9006c0a0 msgr2=0x7f3f90072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:27.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.928+0000 7f3f8ed9d700 1 --2- 172.21.15.80:0/2531979124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9006c0a0 0x7f3f90072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:27.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.928+0000 7f3f8ed9d700 1 -- 172.21.15.80:0/2531979124 >> v1:172.21.15.174:6789/0 conn(0x7f3f90072360 legacy=0x7f3f9006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:27.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.928+0000 7f3f8e59c700 1 -- 172.21.15.80:0/2531979124 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509371520 0 0) 0x7f3f88000d30 con 0x7f3f90072360 2019-11-28T11:25:27.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.928+0000 7f3f8ed9d700 1 -- 172.21.15.80:0/2531979124 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f90070a40 con 0x7f3f900734e0 2019-11-28T11:25:27.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.929+0000 7f3f8f59e700 1 --2- 172.21.15.80:0/2531979124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9006c0a0 0x7f3f90072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:27.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.929+0000 7f3f8ed9d700 1 --2- 172.21.15.80:0/2531979124 >> v2:172.21.15.174:3300/0 conn(0x7f3f900734e0 0x7f3f90071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3f7800f740 tx=0x7f3f7800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:27.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.929+0000 7f3f8ed9d700 1 --2- 172.21.15.80:0/2531979124 >> v2:172.21.15.174:3300/0 conn(0x7f3f900734e0 0x7f3f90071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3f7800f740 tx=0x7f3f7800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:27.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.929+0000 7f3f8ed9d700 1 --2- 172.21.15.80:0/2531979124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f900734e0 0x7f3f90071e20 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f3f7800f740 tx=0x7f3f7800fae0).ready entity=mon.1 client_cookie=cf79ea545c2a5f3c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:27.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.929+0000 7f3f8ed9d700 1 --2- 172.21.15.80:0/2531979124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f900734e0 0x7f3f90071e20 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f3f7800f740 tx=0x7f3f7800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:27.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.929+0000 7f3f8e59c700 1 -- 172.21.15.80:0/2531979124 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f78000960 con 0x7f3f900734e0 2019-11-28T11:25:27.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.929+0000 7f3f8ed9d700 1 --2- 172.21.15.80:0/2531979124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f900734e0 0x7f3f90071e20 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f3f7800f740 tx=0x7f3f7800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:27.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.929+0000 7f3f8e59c700 1 -- 172.21.15.80:0/2531979124 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f78000c90 con 0x7f3f900734e0 2019-11-28T11:25:27.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.929+0000 7f3f8ed9d700 1 --2- 172.21.15.80:0/2531979124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f900734e0 0x7f3f90071e20 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f3f7800f740 tx=0x7f3f7800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:27.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.929+0000 7f3f8e59c700 1 -- 172.21.15.80:0/2531979124 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f78007210 con 0x7f3f900734e0 2019-11-28T11:25:27.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.929+0000 7f3f95204700 1 -- 172.21.15.80:0/2531979124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f900734e0 msgr2=0x7f3f90071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:27.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.929+0000 7f3f95204700 1 --2- 172.21.15.80:0/2531979124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f900734e0 0x7f3f90071e20 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f3f7800f740 tx=0x7f3f7800fae0).stop 2019-11-28T11:25:27.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.930+0000 7f3f95204700 1 -- 172.21.15.80:0/2531979124 shutdown_connections 2019-11-28T11:25:27.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.930+0000 7f3f95204700 1 --2- 172.21.15.80:0/2531979124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f900734e0 0x7f3f90071e20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:27.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.930+0000 7f3f95204700 1 --2- 172.21.15.80:0/2531979124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f9006c0a0 0x7f3f90072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:27.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.930+0000 7f3f95204700 1 -- 172.21.15.80:0/2531979124 shutdown_connections 2019-11-28T11:25:27.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.930+0000 7f3f95204700 1 -- 172.21.15.80:0/2531979124 wait complete. 2019-11-28T11:25:27.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.930+0000 7f3f95204700 1 -- 172.21.15.80:0/2531979124 >> 172.21.15.80:0/2531979124 conn(0x7f3f90061cf0 msgr2=0x7f3f90064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:27.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.932+0000 7f3f95204700 1 Processor -- start 2019-11-28T11:25:27.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.932+0000 7f3f95204700 1 -- start start 2019-11-28T11:25:27.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.933+0000 7f3f95204700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3f9015fdf0 0x7f3f9012b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:27.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.933+0000 7f3f95204700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3f9012b8a0 0x7f3f9013e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:27.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.933+0000 7f3f95204700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f90139e00 con 0x7f3f9013e860 2019-11-28T11:25:27.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.933+0000 7f3f95204700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f90108820 con 0x7f3f9015fdf0 2019-11-28T11:25:27.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.933+0000 7f3f95204700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f90108af0 con 0x7f3f9012b8a0 2019-11-28T11:25:27.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.933+0000 7f3f8f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3f9015fdf0 0x7f3f9012b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:27.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.933+0000 7f3f8f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3f9015fdf0 0x7f3f9012b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59450/0 (socket says 172.21.15.80:59450) 2019-11-28T11:25:27.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.933+0000 7f3f8f59e700 1 -- 172.21.15.80:0/3107490778 learned_addr learned my addr 172.21.15.80:0/3107490778 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:27.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.933+0000 7f3f8ed9d700 1 --2- 172.21.15.80:0/3107490778 >> v2:172.21.15.174:3300/0 conn(0x7f3f9012b8a0 0x7f3f9013e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:27.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.933+0000 7f3f8f59e700 1 -- 172.21.15.80:0/3107490778 >> v2:172.21.15.174:3300/0 conn(0x7f3f9012b8a0 msgr2=0x7f3f9013e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:27.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.933+0000 7f3f8f59e700 1 --2- 172.21.15.80:0/3107490778 >> v2:172.21.15.174:3300/0 conn(0x7f3f9012b8a0 0x7f3f9013e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:27.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.933+0000 7f3f8f59e700 1 -- 172.21.15.80:0/3107490778 >> v1:172.21.15.174:6789/0 conn(0x7f3f9013e860 legacy=0x7f3f9012a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:27.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.933+0000 7f3f8f59e700 1 -- 172.21.15.80:0/3107490778 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9010a8c0 con 0x7f3f9015fdf0 2019-11-28T11:25:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.933+0000 7f3f8f59e700 1 --2- 172.21.15.80:0/3107490778 >> v2:172.21.15.80:3300/0 conn(0x7f3f9015fdf0 0x7f3f9012b360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3f80010410 tx=0x7f3f80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.934+0000 7f3f8f59e700 1 --2- 172.21.15.80:0/3107490778 >> v2:172.21.15.80:3300/0 conn(0x7f3f9015fdf0 0x7f3f9012b360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3f80010410 tx=0x7f3f80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.934+0000 7f3f8f59e700 1 --2- 172.21.15.80:0/3107490778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f9015fdf0 0x7f3f9012b360 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f3f80010410 tx=0x7f3f80010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.934+0000 7f3f8f59e700 1 --2- 172.21.15.80:0/3107490778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f9015fdf0 0x7f3f9012b360 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f3f80010410 tx=0x7f3f80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.934+0000 7f3f87fff700 1 -- 172.21.15.80:0/3107490778 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f80000960 con 0x7f3f9015fdf0 2019-11-28T11:25:27.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.934+0000 7f3f8f59e700 1 --2- 172.21.15.80:0/3107490778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f9015fdf0 0x7f3f9012b360 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f3f80010410 tx=0x7f3f80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:27.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.934+0000 7f3f8f59e700 1 --2- 172.21.15.80:0/3107490778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f9015fdf0 0x7f3f9012b360 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f3f80010410 tx=0x7f3f80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:27.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.934+0000 7f3f87fff700 1 -- 172.21.15.80:0/3107490778 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f80009770 con 0x7f3f9015fdf0 2019-11-28T11:25:27.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.934+0000 7f3f95204700 1 -- 172.21.15.80:0/3107490778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9010a8c0 con 0x7f3f9015fdf0 2019-11-28T11:25:27.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.934+0000 7f3f87fff700 1 -- 172.21.15.80:0/3107490778 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f80009ec0 con 0x7f3f9015fdf0 2019-11-28T11:25:27.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.934+0000 7f3f95204700 1 -- 172.21.15.80:0/3107490778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9010a8c0 con 0x7f3f9015fdf0 2019-11-28T11:25:27.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.934+0000 7f3f8f59e700 1 --2- 172.21.15.80:0/3107490778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f9015fdf0 0x7f3f9012b360 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f3f80010410 tx=0x7f3f80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:27.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.934+0000 7f3f87fff700 1 -- 172.21.15.80:0/3107490778 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3f80009960 con 0x7f3f9015fdf0 2019-11-28T11:25:27.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.934+0000 7f3f8f59e700 1 --2- 172.21.15.80:0/3107490778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f9015fdf0 0x7f3f9012b360 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f3f80010410 tx=0x7f3f80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:27.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.934+0000 7f3f87fff700 1 --2- 172.21.15.80:0/3107490778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f74018730 0x7f3f7401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:27.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.934+0000 7f3f87fff700 1 -- 172.21.15.80:0/3107490778 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f3f80031a80 con 0x7f3f9015fdf0 2019-11-28T11:25:27.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.935+0000 7f3f8ed9d700 1 --2- 172.21.15.80:0/3107490778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f74018730 0x7f3f7401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:27.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.935+0000 7f3f8ed9d700 1 --2- 172.21.15.80:0/3107490778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f74018730 0x7f3f7401abc0 crc :-1 s=READY pgs=70 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:27.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.942+0000 7f3f95204700 1 -- 172.21.15.80:0/3107490778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f90109180 con 0x7f3f9015fdf0 2019-11-28T11:25:27.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.946+0000 7f3f8f59e700 1 --2- 172.21.15.80:0/3107490778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f9015fdf0 0x7f3f9012b360 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f3f80010410 tx=0x7f3f80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:27.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:27.946+0000 7f3f87fff700 1 -- 172.21.15.80:0/3107490778 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3f8002cd40 con 0x7f3f9015fdf0 2019-11-28T11:25:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.134+0000 7f3f95204700 1 -- 172.21.15.80:0/3107490778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3f90109500 con 0x7f3f9015fdf0 2019-11-28T11:25:28.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.134+0000 7f3f8f59e700 1 --2- 172.21.15.80:0/3107490778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f9015fdf0 0x7f3f9012b360 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f3f80010410 tx=0x7f3f80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.134+0000 7f3f87fff700 1 -- 172.21.15.80:0/3107490778 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f8002cd40 con 0x7f3f9015fdf0 2019-11-28T11:25:28.233 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2019-11-28T11:25:28.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.136+0000 7f3f95204700 1 -- 172.21.15.80:0/3107490778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f74018730 msgr2=0x7f3f7401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:28.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.136+0000 7f3f95204700 1 --2- 172.21.15.80:0/3107490778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f74018730 0x7f3f7401abc0 crc :-1 s=READY pgs=70 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:28.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.136+0000 7f3f95204700 1 -- 172.21.15.80:0/3107490778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f9015fdf0 msgr2=0x7f3f9012b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:28.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.136+0000 7f3f95204700 1 --2- 172.21.15.80:0/3107490778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f9015fdf0 0x7f3f9012b360 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f3f80010410 tx=0x7f3f80010290).stop 2019-11-28T11:25:28.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.136+0000 7f3f95204700 1 -- 172.21.15.80:0/3107490778 shutdown_connections 2019-11-28T11:25:28.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.136+0000 7f3f95204700 1 --2- 172.21.15.80:0/3107490778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f74018730 0x7f3f7401abc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:28.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.136+0000 7f3f95204700 1 --2- 172.21.15.80:0/3107490778 >> v2:172.21.15.174:3300/0 conn(0x7f3f9012b8a0 0x7f3f9013e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:28.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.137+0000 7f3f95204700 1 --2- 172.21.15.80:0/3107490778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f9015fdf0 0x7f3f9012b360 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:28.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.137+0000 7f3f95204700 1 -- 172.21.15.80:0/3107490778 shutdown_connections 2019-11-28T11:25:28.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.137+0000 7f3f95204700 1 -- 172.21.15.80:0/3107490778 wait complete. 2019-11-28T11:25:28.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.137+0000 7f3f95204700 1 -- 172.21.15.80:0/3107490778 >> 172.21.15.80:0/3107490778 conn(0x7f3f90127dc0 msgr2=0x7f3f90141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:28.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2019-11-28T11:25:28.239 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2019-11-28T11:25:28.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.355+0000 7f9340e95700 1 Processor -- start 2019-11-28T11:25:28.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.355+0000 7f9340e95700 1 -- start start 2019-11-28T11:25:28.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.356+0000 7f9340e95700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f933c06c0a0 0x7f933c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:28.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.356+0000 7f9340e95700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f933c0734e0 0x7f933c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:28.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.356+0000 7f9340e95700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933c06db00 con 0x7f933c072360 2019-11-28T11:25:28.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.356+0000 7f9340e95700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933c06fd60 con 0x7f933c06c0a0 2019-11-28T11:25:28.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.356+0000 7f9340e95700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c070030 con 0x7f933c0734e0 2019-11-28T11:25:28.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.356+0000 7f933ad9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f933c06c0a0 0x7f933c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:28.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.356+0000 7f933ad9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f933c06c0a0 0x7f933c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:46112/0 (socket says 172.21.15.80:46112) 2019-11-28T11:25:28.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.356+0000 7f933a59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f933c0734e0 0x7f933c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:28.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.356+0000 7f933ad9d700 1 -- 172.21.15.80:0/1670289195 learned_addr learned my addr 172.21.15.80:0/1670289195 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:28.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.356+0000 7f933b59e700 1 --1- 172.21.15.80:0/1670289195 >> v1:172.21.15.174:6789/0 conn(0x7f933c072360 0x7f933c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:46088/0 (socket says 172.21.15.80:46088) 2019-11-28T11:25:28.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.357+0000 7f933ad9d700 1 -- 172.21.15.80:0/1670289195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f933c0734e0 msgr2=0x7f933c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:28.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.357+0000 7f933ad9d700 1 --2- 172.21.15.80:0/1670289195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f933c0734e0 0x7f933c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:28.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.357+0000 7f933ad9d700 1 -- 172.21.15.80:0/1670289195 >> v1:172.21.15.174:6789/0 conn(0x7f933c072360 legacy=0x7f933c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:28.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.357+0000 7f933ad9d700 1 -- 172.21.15.80:0/1670289195 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c0706c0 con 0x7f933c06c0a0 2019-11-28T11:25:28.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.357+0000 7f933ad9d700 1 --2- 172.21.15.80:0/1670289195 >> v2:172.21.15.174:3300/0 conn(0x7f933c06c0a0 0x7f933c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f932c00f740 tx=0x7f932c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.357+0000 7f933ad9d700 1 --2- 172.21.15.80:0/1670289195 >> v2:172.21.15.174:3300/0 conn(0x7f933c06c0a0 0x7f933c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f932c00f740 tx=0x7f932c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.357+0000 7f933ad9d700 1 --2- 172.21.15.80:0/1670289195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f933c06c0a0 0x7f933c072fa0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f932c00f740 tx=0x7f932c00f570).ready entity=mon.1 client_cookie=d2ed16954b1a7090 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:28.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.357+0000 7f933ad9d700 1 --2- 172.21.15.80:0/1670289195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f933c06c0a0 0x7f933c072fa0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f932c00f740 tx=0x7f932c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.357+0000 7f933ad9d700 1 --2- 172.21.15.80:0/1670289195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f933c06c0a0 0x7f933c072fa0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f932c00f740 tx=0x7f932c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.357+0000 7f9339d9b700 1 -- 172.21.15.80:0/1670289195 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f932c000960 con 0x7f933c06c0a0 2019-11-28T11:25:28.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.357+0000 7f933ad9d700 1 --2- 172.21.15.80:0/1670289195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f933c06c0a0 0x7f933c072fa0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f932c00f740 tx=0x7f932c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.357+0000 7f9339d9b700 1 -- 172.21.15.80:0/1670289195 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c000c90 con 0x7f933c06c0a0 2019-11-28T11:25:28.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.357+0000 7f9339d9b700 1 -- 172.21.15.80:0/1670289195 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f932c0013a0 con 0x7f933c06c0a0 2019-11-28T11:25:28.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.357+0000 7f9340e95700 1 -- 172.21.15.80:0/1670289195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f933c06c0a0 msgr2=0x7f933c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:28.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.357+0000 7f9340e95700 1 --2- 172.21.15.80:0/1670289195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f933c06c0a0 0x7f933c072fa0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f932c00f740 tx=0x7f932c00f570).stop 2019-11-28T11:25:28.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.358+0000 7f9340e95700 1 -- 172.21.15.80:0/1670289195 shutdown_connections 2019-11-28T11:25:28.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.358+0000 7f9340e95700 1 --2- 172.21.15.80:0/1670289195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f933c0734e0 0x7f933c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.358+0000 7f9340e95700 1 --2- 172.21.15.80:0/1670289195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f933c06c0a0 0x7f933c072fa0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.358+0000 7f9340e95700 1 -- 172.21.15.80:0/1670289195 shutdown_connections 2019-11-28T11:25:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.358+0000 7f9340e95700 1 -- 172.21.15.80:0/1670289195 wait complete. 2019-11-28T11:25:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.358+0000 7f9340e95700 1 -- 172.21.15.80:0/1670289195 >> 172.21.15.80:0/1670289195 conn(0x7f933c061cf0 msgr2=0x7f933c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:28.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.360+0000 7f9340e95700 1 Processor -- start 2019-11-28T11:25:28.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.360+0000 7f9340e95700 1 -- start start 2019-11-28T11:25:28.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.361+0000 7f9340e95700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f933c12dc20 0x7f933c12e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.361+0000 7f9340e95700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933c13dd80 con 0x7f933c159850 2019-11-28T11:25:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.361+0000 7f9340e95700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933c15a4e0 con 0x7f933c143180 2019-11-28T11:25:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.361+0000 7f9340e95700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933c15c2e0 con 0x7f933c12dc20 2019-11-28T11:25:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.361+0000 7f933b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f933c12dc20 0x7f933c12e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.361+0000 7f933b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f933c12dc20 0x7f933c12e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59468/0 (socket says 172.21.15.80:59468) 2019-11-28T11:25:28.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.361+0000 7f933b59e700 1 -- 172.21.15.80:0/75589574 learned_addr learned my addr 172.21.15.80:0/75589574 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:28.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f93337fe700 1 -- 172.21.15.80:0/75589574 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758618737 0 0) 0x7f932c007580 con 0x7f933c143180 2019-11-28T11:25:28.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f93337fe700 1 -- 172.21.15.80:0/75589574 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9314002e80 con 0x7f933c143180 2019-11-28T11:25:28.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f93337fe700 1 -- 172.21.15.80:0/75589574 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723329040 0 0) 0x7f93240010b0 con 0x7f933c159850 2019-11-28T11:25:28.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f933b59e700 1 -- 172.21.15.80:0/75589574 >> v1:172.21.15.174:6789/0 conn(0x7f933c143180 legacy=0x7f933c15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:28.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f933b59e700 1 -- 172.21.15.80:0/75589574 >> v1:172.21.15.80:6789/0 conn(0x7f933c159850 legacy=0x7f933c159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:28.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f933b59e700 1 -- 172.21.15.80:0/75589574 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c15cc40 con 0x7f933c12dc20 2019-11-28T11:25:28.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f933b59e700 1 --2- 172.21.15.80:0/75589574 >> v2:172.21.15.80:3300/0 conn(0x7f933c12dc20 0x7f933c12e080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9334012920 tx=0x7f9334012cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f933b59e700 1 --2- 172.21.15.80:0/75589574 >> v2:172.21.15.80:3300/0 conn(0x7f933c12dc20 0x7f933c12e080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9334012920 tx=0x7f9334012cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f933b59e700 1 --2- 172.21.15.80:0/75589574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f933c12dc20 0x7f933c12e080 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f9334012920 tx=0x7f9334012cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:28.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f933b59e700 1 --2- 172.21.15.80:0/75589574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f933c12dc20 0x7f933c12e080 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f9334012920 tx=0x7f9334012cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f93337fe700 1 -- 172.21.15.80:0/75589574 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9334004730 con 0x7f933c12dc20 2019-11-28T11:25:28.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f933b59e700 1 --2- 172.21.15.80:0/75589574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f933c12dc20 0x7f933c12e080 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f9334012920 tx=0x7f9334012cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f9340e95700 1 -- 172.21.15.80:0/75589574 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933c15cfc0 con 0x7f933c12dc20 2019-11-28T11:25:28.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f93337fe700 1 -- 172.21.15.80:0/75589574 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93340011f0 con 0x7f933c12dc20 2019-11-28T11:25:28.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f933b59e700 1 --2- 172.21.15.80:0/75589574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f933c12dc20 0x7f933c12e080 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f9334012920 tx=0x7f9334012cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f93337fe700 1 -- 172.21.15.80:0/75589574 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9334004920 con 0x7f933c12dc20 2019-11-28T11:25:28.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f9340e95700 1 -- 172.21.15.80:0/75589574 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933c15cc40 con 0x7f933c12dc20 2019-11-28T11:25:28.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.362+0000 7f933b59e700 1 --2- 172.21.15.80:0/75589574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f933c12dc20 0x7f933c12e080 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f9334012920 tx=0x7f9334012cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.363+0000 7f93337fe700 1 -- 172.21.15.80:0/75589574 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9334004540 con 0x7f933c12dc20 2019-11-28T11:25:28.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.363+0000 7f933b59e700 1 --2- 172.21.15.80:0/75589574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f933c12dc20 0x7f933c12e080 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f9334012920 tx=0x7f9334012cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.363+0000 7f93337fe700 1 --2- 172.21.15.80:0/75589574 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9314018780 0x7f931401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:28.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.363+0000 7f93337fe700 1 -- 172.21.15.80:0/75589574 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f9334034320 con 0x7f933c12dc20 2019-11-28T11:25:28.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.363+0000 7f933ad9d700 1 --2- 172.21.15.80:0/75589574 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9314018780 0x7f931401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:28.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.363+0000 7f933ad9d700 1 --2- 172.21.15.80:0/75589574 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9314018780 0x7f931401abf0 crc :-1 s=READY pgs=71 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:28.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.371+0000 7f9340e95700 1 -- 172.21.15.80:0/75589574 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933c15cfc0 con 0x7f933c12dc20 2019-11-28T11:25:28.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.374+0000 7f933b59e700 1 --2- 172.21.15.80:0/75589574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f933c12dc20 0x7f933c12e080 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f9334012920 tx=0x7f9334012cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.374+0000 7f93337fe700 1 -- 172.21.15.80:0/75589574 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9334001670 con 0x7f933c12dc20 2019-11-28T11:25:28.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.567+0000 7f9340e95700 1 -- 172.21.15.80:0/75589574 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f933c15cc40 con 0x7f933c12dc20 2019-11-28T11:25:28.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.568+0000 7f933b59e700 1 --2- 172.21.15.80:0/75589574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f933c12dc20 0x7f933c12e080 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f9334012920 tx=0x7f9334012cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.568+0000 7f93337fe700 1 -- 172.21.15.80:0/75589574 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93340011f0 con 0x7f933c12dc20 2019-11-28T11:25:28.589 INFO:teuthology.orchestra.run.smithi080.stdout:55834574855 2019-11-28T11:25:28.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.571+0000 7f9340e95700 1 -- 172.21.15.80:0/75589574 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9314018780 msgr2=0x7f931401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:28.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.571+0000 7f9340e95700 1 --2- 172.21.15.80:0/75589574 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9314018780 0x7f931401abf0 crc :-1 s=READY pgs=71 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:28.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.571+0000 7f9340e95700 1 -- 172.21.15.80:0/75589574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f933c12dc20 msgr2=0x7f933c12e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:28.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.571+0000 7f9340e95700 1 --2- 172.21.15.80:0/75589574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f933c12dc20 0x7f933c12e080 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f9334012920 tx=0x7f9334012cc0).stop 2019-11-28T11:25:28.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.571+0000 7f9340e95700 1 -- 172.21.15.80:0/75589574 shutdown_connections 2019-11-28T11:25:28.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.571+0000 7f9340e95700 1 --2- 172.21.15.80:0/75589574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f933c12dc20 0x7f933c12e080 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:28.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.571+0000 7f9340e95700 1 --2- 172.21.15.80:0/75589574 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9314018780 0x7f931401abf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:28.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.571+0000 7f9340e95700 1 -- 172.21.15.80:0/75589574 shutdown_connections 2019-11-28T11:25:28.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.571+0000 7f9340e95700 1 -- 172.21.15.80:0/75589574 wait complete. 2019-11-28T11:25:28.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.571+0000 7f9340e95700 1 -- 172.21.15.80:0/75589574 >> 172.21.15.80:0/75589574 conn(0x7f933c13d620 msgr2=0x7f933c140470 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:28.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.1 2019-11-28T11:25:28.601 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2019-11-28T11:25:28.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.705+0000 7f5f61d0b700 1 Processor -- start 2019-11-28T11:25:28.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.705+0000 7f5f61d0b700 1 -- start start 2019-11-28T11:25:28.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f61d0b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f5c06d120 0x7f5f5c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:28.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f61d0b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5c06d5a0 con 0x7f5f5c06c490 2019-11-28T11:25:28.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f61d0b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5c06db00 con 0x7f5f5c06c0a0 2019-11-28T11:25:28.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f61d0b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5c06fd60 con 0x7f5f5c06d120 2019-11-28T11:25:28.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f60aa9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f5c06d120 0x7f5f5c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:28.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f53fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5f5c06c490 0x7f5f5c06c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58792/0 (socket says 172.21.15.80:58792) 2019-11-28T11:25:28.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f53fff700 1 -- 172.21.15.80:0/2721976163 learned_addr learned my addr 172.21.15.80:0/2721976163 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:28.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f60aa9700 1 -- 172.21.15.80:0/2721976163 >> v1:172.21.15.174:6789/0 conn(0x7f5f5c06c0a0 legacy=0x7f5f5c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:28.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f60aa9700 1 -- 172.21.15.80:0/2721976163 >> v1:172.21.15.80:6789/0 conn(0x7f5f5c06c490 legacy=0x7f5f5c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:28.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f5b7fe700 1 -- 172.21.15.80:0/2721976163 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035243726 0 0) 0x7f5f44001150 con 0x7f5f5c06c490 2019-11-28T11:25:28.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f60aa9700 1 -- 172.21.15.80:0/2721976163 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c0706c0 con 0x7f5f5c06d120 2019-11-28T11:25:28.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f60aa9700 1 --2- 172.21.15.80:0/2721976163 >> v2:172.21.15.80:3300/0 conn(0x7f5f5c06d120 0x7f5f5c165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5f5400b2d0 tx=0x7f5f5400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f60aa9700 1 --2- 172.21.15.80:0/2721976163 >> v2:172.21.15.80:3300/0 conn(0x7f5f5c06d120 0x7f5f5c165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5f5400b2d0 tx=0x7f5f5400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f60aa9700 1 --2- 172.21.15.80:0/2721976163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c06d120 0x7f5f5c165d80 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f5f5400b2d0 tx=0x7f5f5400bae0).ready entity=mon.0 client_cookie=2b43783b0807a1bb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:28.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f60aa9700 1 --2- 172.21.15.80:0/2721976163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c06d120 0x7f5f5c165d80 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f5f5400b2d0 tx=0x7f5f5400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f5b7fe700 1 -- 172.21.15.80:0/2721976163 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f54009f20 con 0x7f5f5c06d120 2019-11-28T11:25:28.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f60aa9700 1 --2- 172.21.15.80:0/2721976163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c06d120 0x7f5f5c165d80 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f5f5400b2d0 tx=0x7f5f5400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f60aa9700 1 --2- 172.21.15.80:0/2721976163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c06d120 0x7f5f5c165d80 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f5f5400b2d0 tx=0x7f5f5400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f5b7fe700 1 -- 172.21.15.80:0/2721976163 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f54000df0 con 0x7f5f5c06d120 2019-11-28T11:25:28.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f5b7fe700 1 -- 172.21.15.80:0/2721976163 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f5400a310 con 0x7f5f5c06d120 2019-11-28T11:25:28.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.706+0000 7f5f61d0b700 1 -- 172.21.15.80:0/2721976163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c06d120 msgr2=0x7f5f5c165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:28.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.707+0000 7f5f61d0b700 1 --2- 172.21.15.80:0/2721976163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c06d120 0x7f5f5c165d80 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f5f5400b2d0 tx=0x7f5f5400bae0).stop 2019-11-28T11:25:28.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.707+0000 7f5f61d0b700 1 -- 172.21.15.80:0/2721976163 shutdown_connections 2019-11-28T11:25:28.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.707+0000 7f5f61d0b700 1 --2- 172.21.15.80:0/2721976163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c06d120 0x7f5f5c165d80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:28.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.707+0000 7f5f61d0b700 1 -- 172.21.15.80:0/2721976163 shutdown_connections 2019-11-28T11:25:28.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.707+0000 7f5f61d0b700 1 -- 172.21.15.80:0/2721976163 wait complete. 2019-11-28T11:25:28.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.707+0000 7f5f61d0b700 1 -- 172.21.15.80:0/2721976163 >> 172.21.15.80:0/2721976163 conn(0x7f5f5c061cf0 msgr2=0x7f5f5c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:28.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.709+0000 7f5f61d0b700 1 Processor -- start 2019-11-28T11:25:28.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.710+0000 7f5f61d0b700 1 -- start start 2019-11-28T11:25:28.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.710+0000 7f5f61d0b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f5c15a890 0x7f5f5c15ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:28.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.710+0000 7f5f61d0b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5c125780 con 0x7f5f5c142d00 2019-11-28T11:25:28.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.710+0000 7f5f61d0b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5c102570 con 0x7f5f5c12dca0 2019-11-28T11:25:28.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.710+0000 7f5f61d0b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5c13b3b0 con 0x7f5f5c15a890 2019-11-28T11:25:28.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.710+0000 7f5f53fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f5c15a890 0x7f5f5c15ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:28.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.710+0000 7f5f53fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f5c15a890 0x7f5f5c15ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59482/0 (socket says 172.21.15.80:59482) 2019-11-28T11:25:28.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.710+0000 7f5f53fff700 1 -- 172.21.15.80:0/824632256 learned_addr learned my addr 172.21.15.80:0/824632256 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:28.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.711+0000 7f5f53fff700 1 -- 172.21.15.80:0/824632256 >> v1:172.21.15.174:6789/0 conn(0x7f5f5c12dca0 legacy=0x7f5f5c12e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:28.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.711+0000 7f5f53fff700 1 -- 172.21.15.80:0/824632256 >> v1:172.21.15.80:6789/0 conn(0x7f5f5c142d00 legacy=0x7f5f5c15b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:28.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.711+0000 7f5f53fff700 1 -- 172.21.15.80:0/824632256 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c158d10 con 0x7f5f5c15a890 2019-11-28T11:25:28.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.711+0000 7f5f53fff700 1 --2- 172.21.15.80:0/824632256 >> v2:172.21.15.80:3300/0 conn(0x7f5f5c15a890 0x7f5f5c15ad20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5f44010430 tx=0x7f5f440107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.711+0000 7f5f53fff700 1 --2- 172.21.15.80:0/824632256 >> v2:172.21.15.80:3300/0 conn(0x7f5f5c15a890 0x7f5f5c15ad20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5f44010430 tx=0x7f5f440107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.711+0000 7f5f53fff700 1 --2- 172.21.15.80:0/824632256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c15a890 0x7f5f5c15ad20 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7f5f44010430 tx=0x7f5f440107d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:28.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.711+0000 7f5f53fff700 1 --2- 172.21.15.80:0/824632256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c15a890 0x7f5f5c15ad20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f5f44010430 tx=0x7f5f440107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.711+0000 7f5f53fff700 1 --2- 172.21.15.80:0/824632256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c15a890 0x7f5f5c15ad20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f5f44010430 tx=0x7f5f440107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.711+0000 7f5f597fa700 1 -- 172.21.15.80:0/824632256 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f44000ef0 con 0x7f5f5c15a890 2019-11-28T11:25:28.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.711+0000 7f5f53fff700 1 --2- 172.21.15.80:0/824632256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c15a890 0x7f5f5c15ad20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f5f44010430 tx=0x7f5f440107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.711+0000 7f5f597fa700 1 -- 172.21.15.80:0/824632256 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f44004430 con 0x7f5f5c15a890 2019-11-28T11:25:28.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.711+0000 7f5f597fa700 1 -- 172.21.15.80:0/824632256 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f44004b00 con 0x7f5f5c15a890 2019-11-28T11:25:28.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.711+0000 7f5f61d0b700 1 -- 172.21.15.80:0/824632256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5c159090 con 0x7f5f5c15a890 2019-11-28T11:25:28.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.711+0000 7f5f61d0b700 1 -- 172.21.15.80:0/824632256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5c158d10 con 0x7f5f5c15a890 2019-11-28T11:25:28.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.711+0000 7f5f53fff700 1 --2- 172.21.15.80:0/824632256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c15a890 0x7f5f5c15ad20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f5f44010430 tx=0x7f5f440107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.712+0000 7f5f597fa700 1 -- 172.21.15.80:0/824632256 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5f44004620 con 0x7f5f5c15a890 2019-11-28T11:25:28.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.712+0000 7f5f53fff700 1 --2- 172.21.15.80:0/824632256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c15a890 0x7f5f5c15ad20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f5f44010430 tx=0x7f5f440107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.712+0000 7f5f597fa700 1 --2- 172.21.15.80:0/824632256 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f34018730 0x7f5f3401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:28.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.712+0000 7f5f597fa700 1 -- 172.21.15.80:0/824632256 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f5f44031b90 con 0x7f5f5c15a890 2019-11-28T11:25:28.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.712+0000 7f5f5bfff700 1 --2- 172.21.15.80:0/824632256 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f34018730 0x7f5f3401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:28.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.712+0000 7f5f5bfff700 1 --2- 172.21.15.80:0/824632256 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f34018730 0x7f5f3401abc0 crc :-1 s=READY pgs=74 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:28.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.720+0000 7f5f61d0b700 1 -- 172.21.15.80:0/824632256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f5c159090 con 0x7f5f5c15a890 2019-11-28T11:25:28.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.723+0000 7f5f53fff700 1 --2- 172.21.15.80:0/824632256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c15a890 0x7f5f5c15ad20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f5f44010430 tx=0x7f5f440107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.723+0000 7f5f597fa700 1 -- 172.21.15.80:0/824632256 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5f440012b0 con 0x7f5f5c15a890 2019-11-28T11:25:28.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.910+0000 7f5f61d0b700 1 -- 172.21.15.80:0/824632256 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5f5c158d10 con 0x7f5f5c15a890 2019-11-28T11:25:28.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.910+0000 7f5f53fff700 1 --2- 172.21.15.80:0/824632256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c15a890 0x7f5f5c15ad20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f5f44010430 tx=0x7f5f440107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:28.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.910+0000 7f5f597fa700 1 -- 172.21.15.80:0/824632256 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f44004620 con 0x7f5f5c15a890 2019-11-28T11:25:28.931 INFO:teuthology.orchestra.run.smithi080.stdout:55834574854 2019-11-28T11:25:28.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.913+0000 7f5f61d0b700 1 -- 172.21.15.80:0/824632256 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f34018730 msgr2=0x7f5f3401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:28.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.913+0000 7f5f61d0b700 1 --2- 172.21.15.80:0/824632256 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f34018730 0x7f5f3401abc0 crc :-1 s=READY pgs=74 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:28.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.913+0000 7f5f61d0b700 1 -- 172.21.15.80:0/824632256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c15a890 msgr2=0x7f5f5c15ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:28.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.913+0000 7f5f61d0b700 1 --2- 172.21.15.80:0/824632256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c15a890 0x7f5f5c15ad20 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7f5f44010430 tx=0x7f5f440107d0).stop 2019-11-28T11:25:28.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.913+0000 7f5f61d0b700 1 -- 172.21.15.80:0/824632256 shutdown_connections 2019-11-28T11:25:28.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.913+0000 7f5f61d0b700 1 --2- 172.21.15.80:0/824632256 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f34018730 0x7f5f3401abc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:28.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.913+0000 7f5f61d0b700 1 --2- 172.21.15.80:0/824632256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f5c15a890 0x7f5f5c15ad20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:28.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.913+0000 7f5f61d0b700 1 -- 172.21.15.80:0/824632256 shutdown_connections 2019-11-28T11:25:28.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.913+0000 7f5f61d0b700 1 -- 172.21.15.80:0/824632256 wait complete. 2019-11-28T11:25:28.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:28.913+0000 7f5f61d0b700 1 -- 172.21.15.80:0/824632256 >> 172.21.15.80:0/824632256 conn(0x7f5f5c07c680 msgr2=0x7f5f5c112150 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:28.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2019-11-28T11:25:28.945 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2019-11-28T11:25:29.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.053+0000 7f7ee7dba700 1 Processor -- start 2019-11-28T11:25:29.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.053+0000 7f7ee7dba700 1 -- start start 2019-11-28T11:25:29.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.054+0000 7f7ee7dba700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7ee006d120 0x7f7ee0165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:29.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.054+0000 7f7ee7dba700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee006d5a0 con 0x7f7ee006c0a0 2019-11-28T11:25:29.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.054+0000 7f7ee7dba700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee006db00 con 0x7f7ee006c490 2019-11-28T11:25:29.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.054+0000 7f7ee7dba700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee006fd60 con 0x7f7ee006d120 2019-11-28T11:25:29.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.054+0000 7f7ee6357700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7ee006c0a0 0x7f7ee0072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58804/0 (socket says 172.21.15.80:58804) 2019-11-28T11:25:29.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.054+0000 7f7ee6357700 1 -- 172.21.15.80:0/3787375372 learned_addr learned my addr 172.21.15.80:0/3787375372 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:29.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/3787375372 >> v2:172.21.15.174:3300/0 conn(0x7f7ee006d120 0x7f7ee0165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee5355700 1 -- 172.21.15.80:0/3787375372 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410721393 0 0) 0x7f7ec8001150 con 0x7f7ee006c0a0 2019-11-28T11:25:29.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee5355700 1 -- 172.21.15.80:0/3787375372 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ecc002e80 con 0x7f7ee006c0a0 2019-11-28T11:25:29.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee5355700 1 -- 172.21.15.80:0/3787375372 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1251113903 0 0) 0x7f7ec8001130 con 0x7f7ee006c0a0 2019-11-28T11:25:29.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee5355700 1 -- 172.21.15.80:0/3787375372 >> v2:172.21.15.174:3300/0 conn(0x7f7ee006d120 msgr2=0x7f7ee0165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:29.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee5355700 1 --2- 172.21.15.80:0/3787375372 >> v2:172.21.15.174:3300/0 conn(0x7f7ee006d120 0x7f7ee0165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:29.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee5355700 1 -- 172.21.15.80:0/3787375372 >> v1:172.21.15.174:6789/0 conn(0x7f7ee006c490 legacy=0x7f7ee006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee5355700 1 -- 172.21.15.80:0/3787375372 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee00706c0 con 0x7f7ee006c0a0 2019-11-28T11:25:29.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee5355700 1 -- 172.21.15.80:0/3787375372 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f7ec8001660 con 0x7f7ee006c0a0 2019-11-28T11:25:29.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee5355700 1 -- 172.21.15.80:0/3787375372 >> v1:172.21.15.80:6789/0 conn(0x7f7ee006c0a0 legacy=0x7f7ee0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee5355700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ecc003ab0 0x7f7ecc005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:29.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee5355700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ecc006690 0x7f7ecc008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:29.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee5355700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ecc009380 0x7f7ecc00b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:29.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee5355700 1 -- 172.21.15.80:0/3787375372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc00c000 con 0x7f7ecc009380 2019-11-28T11:25:29.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee5355700 1 -- 172.21.15.80:0/3787375372 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc050200 con 0x7f7ecc006690 2019-11-28T11:25:29.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee5355700 1 -- 172.21.15.80:0/3787375372 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc050430 con 0x7f7ecc003ab0 2019-11-28T11:25:29.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ecc009380 0x7f7ecc00b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee5b56700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ecc006690 0x7f7ecc008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee6357700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ecc003ab0 0x7f7ecc005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee6b58700 1 -- 172.21.15.80:0/3787375372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ecc003ab0 msgr2=0x7f7ecc005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:29.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ecc003ab0 0x7f7ecc005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:29.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee6b58700 1 -- 172.21.15.80:0/3787375372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ecc006690 msgr2=0x7f7ecc008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:29.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ecc006690 0x7f7ecc008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:29.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee6b58700 1 -- 172.21.15.80:0/3787375372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc0506e0 con 0x7f7ecc009380 2019-11-28T11:25:29.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee6357700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ecc003ab0 0x7f7ecc005f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:29.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ecc009380 0x7f7ecc00b850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ed800e470 tx=0x7f7ed800e7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.055+0000 7f7ee6b58700 1 -- 172.21.15.80:0/3787375372 reap_dead start 2019-11-28T11:25:29.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.056+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ecc009380 0x7f7ecc00b850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ed800e470 tx=0x7f7ed800e7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.056+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ecc009380 0x7f7ecc00b850 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f7ed800e470 tx=0x7f7ed800e7f0).ready entity=mon.0 client_cookie=624552c5e166aaa2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:29.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.056+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ecc009380 0x7f7ecc00b850 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f7ed800e470 tx=0x7f7ed800e7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.056+0000 7f7ee5355700 1 -- 172.21.15.80:0/3787375372 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed800ee80 con 0x7f7ecc009380 2019-11-28T11:25:29.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.056+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ecc009380 0x7f7ecc00b850 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f7ed800e470 tx=0x7f7ed800e7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.056+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ecc009380 0x7f7ecc00b850 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f7ed800e470 tx=0x7f7ed800e7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.056+0000 7f7ee5355700 1 -- 172.21.15.80:0/3787375372 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed800eaa0 con 0x7f7ecc009380 2019-11-28T11:25:29.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.056+0000 7f7ee5355700 1 -- 172.21.15.80:0/3787375372 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed800ec90 con 0x7f7ecc009380 2019-11-28T11:25:29.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.056+0000 7f7ee7dba700 1 -- 172.21.15.80:0/3787375372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ecc009380 msgr2=0x7f7ecc00b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.056+0000 7f7ee7dba700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ecc009380 0x7f7ecc00b850 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f7ed800e470 tx=0x7f7ed800e7f0).stop 2019-11-28T11:25:29.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.056+0000 7f7ee7dba700 1 -- 172.21.15.80:0/3787375372 shutdown_connections 2019-11-28T11:25:29.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.056+0000 7f7ee7dba700 1 --2- 172.21.15.80:0/3787375372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ecc009380 0x7f7ecc00b850 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.056+0000 7f7ee7dba700 1 -- 172.21.15.80:0/3787375372 shutdown_connections 2019-11-28T11:25:29.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.056+0000 7f7ee7dba700 1 -- 172.21.15.80:0/3787375372 wait complete. 2019-11-28T11:25:29.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.056+0000 7f7ee7dba700 1 -- 172.21.15.80:0/3787375372 >> 172.21.15.80:0/3787375372 conn(0x7f7ee0061cf0 msgr2=0x7f7ee0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:29.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.059+0000 7f7ee7dba700 1 Processor -- start 2019-11-28T11:25:29.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.059+0000 7f7ee7dba700 1 -- start start 2019-11-28T11:25:29.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee7dba700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ee0077040 0x7f7ee01574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:29.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee7dba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ee0075210 0x7f7ee016aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:29.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee7dba700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee0140820 con 0x7f7ee0157a00 2019-11-28T11:25:29.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee7dba700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee01366e0 con 0x7f7ee0075210 2019-11-28T11:25:29.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee7dba700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee01360e0 con 0x7f7ee0077040 2019-11-28T11:25:29.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee6b58700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ee0075210 0x7f7ee016aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee6b58700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ee0075210 0x7f7ee016aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59504/0 (socket says 172.21.15.80:59504) 2019-11-28T11:25:29.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee6b58700 1 -- 172.21.15.80:0/2129913282 learned_addr learned my addr 172.21.15.80:0/2129913282 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:29.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee6357700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ee0077040 0x7f7ee01574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee6b58700 1 -- 172.21.15.80:0/2129913282 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ee0077040 msgr2=0x7f7ee01574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ee0077040 0x7f7ee01574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee6b58700 1 -- 172.21.15.80:0/2129913282 >> v1:172.21.15.174:6789/0 conn(0x7f7ee0157a00 legacy=0x7f7ee0074a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee6b58700 1 -- 172.21.15.80:0/2129913282 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0137a70 con 0x7f7ee0075210 2019-11-28T11:25:29.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/2129913282 >> v2:172.21.15.80:3300/0 conn(0x7f7ee0075210 0x7f7ee016aee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ed8010470 tx=0x7f7ed800dba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/2129913282 >> v2:172.21.15.80:3300/0 conn(0x7f7ee0075210 0x7f7ee016aee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ed8010470 tx=0x7f7ed800dba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ee0075210 0x7f7ee016aee0 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f7ed8010470 tx=0x7f7ed800dba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:29.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ee0075210 0x7f7ee016aee0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f7ed8010470 tx=0x7f7ed800dba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ee0075210 0x7f7ee016aee0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f7ed8010470 tx=0x7f7ed800dba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7edeffd700 1 -- 172.21.15.80:0/2129913282 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed800e4c0 con 0x7f7ee0075210 2019-11-28T11:25:29.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ee0075210 0x7f7ee016aee0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f7ed8010470 tx=0x7f7ed800dba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7edeffd700 1 -- 172.21.15.80:0/2129913282 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed800eaf0 con 0x7f7ee0075210 2019-11-28T11:25:29.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7edeffd700 1 -- 172.21.15.80:0/2129913282 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed800f180 con 0x7f7ee0075210 2019-11-28T11:25:29.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee7dba700 1 -- 172.21.15.80:0/2129913282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee0137df0 con 0x7f7ee0075210 2019-11-28T11:25:29.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.060+0000 7f7ee7dba700 1 -- 172.21.15.80:0/2129913282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee0137a70 con 0x7f7ee0075210 2019-11-28T11:25:29.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.061+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ee0075210 0x7f7ee016aee0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f7ed8010470 tx=0x7f7ed800dba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.061+0000 7f7edeffd700 1 -- 172.21.15.80:0/2129913282 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7ed800ece0 con 0x7f7ee0075210 2019-11-28T11:25:29.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.061+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ee0075210 0x7f7ee016aee0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f7ed8010470 tx=0x7f7ed800dba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.061+0000 7f7edeffd700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ec4018730 0x7f7ec401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:29.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.061+0000 7f7edeffd700 1 -- 172.21.15.80:0/2129913282 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f7ed8031a60 con 0x7f7ee0075210 2019-11-28T11:25:29.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.061+0000 7f7ee6357700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ec4018730 0x7f7ec401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.061+0000 7f7ee6357700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ec4018730 0x7f7ec401abc0 crc :-1 s=READY pgs=75 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:29.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.068+0000 7f7ee7dba700 1 -- 172.21.15.80:0/2129913282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee0137df0 con 0x7f7ee0075210 2019-11-28T11:25:29.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.072+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ee0075210 0x7f7ee016aee0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f7ed8010470 tx=0x7f7ed800dba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.072+0000 7f7edeffd700 1 -- 172.21.15.80:0/2129913282 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7ed8002c80 con 0x7f7ee0075210 2019-11-28T11:25:29.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.261+0000 7f7ee7dba700 1 -- 172.21.15.80:0/2129913282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7ee0137a70 con 0x7f7ee0075210 2019-11-28T11:25:29.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.261+0000 7f7ee6b58700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ee0075210 0x7f7ee016aee0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f7ed8010470 tx=0x7f7ed800dba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.261+0000 7f7edeffd700 1 -- 172.21.15.80:0/2129913282 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7ed800ece0 con 0x7f7ee0075210 2019-11-28T11:25:29.282 INFO:teuthology.orchestra.run.smithi080.stdout:60129542149 2019-11-28T11:25:29.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.264+0000 7f7ee7dba700 1 -- 172.21.15.80:0/2129913282 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ec4018730 msgr2=0x7f7ec401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.264+0000 7f7ee7dba700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ec4018730 0x7f7ec401abc0 crc :-1 s=READY pgs=75 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.264+0000 7f7ee7dba700 1 -- 172.21.15.80:0/2129913282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ee0075210 msgr2=0x7f7ee016aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.264+0000 7f7ee7dba700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ee0075210 0x7f7ee016aee0 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f7ed8010470 tx=0x7f7ed800dba0).stop 2019-11-28T11:25:29.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.264+0000 7f7ee7dba700 1 -- 172.21.15.80:0/2129913282 shutdown_connections 2019-11-28T11:25:29.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.264+0000 7f7ee7dba700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ee0075210 0x7f7ee016aee0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.264+0000 7f7ee7dba700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ec4018730 0x7f7ec401abc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.264+0000 7f7ee7dba700 1 --2- 172.21.15.80:0/2129913282 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ee0077040 0x7f7ee01574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.264+0000 7f7ee7dba700 1 -- 172.21.15.80:0/2129913282 shutdown_connections 2019-11-28T11:25:29.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.264+0000 7f7ee7dba700 1 -- 172.21.15.80:0/2129913282 wait complete. 2019-11-28T11:25:29.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.264+0000 7f7ee7dba700 1 -- 172.21.15.80:0/2129913282 >> 172.21.15.80:0/2129913282 conn(0x7f7ee013fa50 msgr2=0x7f7ee007c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:29.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2019-11-28T11:25:29.294 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2019-11-28T11:25:29.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.397+0000 7fb2db526700 1 Processor -- start 2019-11-28T11:25:29.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.397+0000 7fb2db526700 1 -- start start 2019-11-28T11:25:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.398+0000 7fb2db526700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb2d406c490 0x7fb2d406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:29.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.398+0000 7fb2db526700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb2d406ce60 0x7fb2d4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:29.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.398+0000 7fb2db526700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d406db00 con 0x7fb2d406c0a0 2019-11-28T11:25:29.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.398+0000 7fb2db526700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d406fd60 con 0x7fb2d406c490 2019-11-28T11:25:29.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.398+0000 7fb2db526700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d4070030 con 0x7fb2d406ce60 2019-11-28T11:25:29.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.398+0000 7fb2d92c2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb2d406c490 0x7fb2d406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.398+0000 7fb2d92c2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb2d406c490 0x7fb2d406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59512/0 (socket says 172.21.15.80:59512) 2019-11-28T11:25:29.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.398+0000 7fb2d92c2700 1 -- 172.21.15.80:0/386429879 learned_addr learned my addr 172.21.15.80:0/386429879 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:29.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.398+0000 7fb2da2c4700 1 --2- 172.21.15.80:0/386429879 >> v2:172.21.15.174:3300/0 conn(0x7fb2d406ce60 0x7fb2d4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.398+0000 7fb2d92c2700 1 -- 172.21.15.80:0/386429879 >> v2:172.21.15.174:3300/0 conn(0x7fb2d406ce60 msgr2=0x7fb2d4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:29.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.398+0000 7fb2d92c2700 1 --2- 172.21.15.80:0/386429879 >> v2:172.21.15.174:3300/0 conn(0x7fb2d406ce60 0x7fb2d4164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:29.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.398+0000 7fb2d92c2700 1 -- 172.21.15.80:0/386429879 >> v1:172.21.15.174:6789/0 conn(0x7fb2d406c0a0 legacy=0x7fb2d4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.398+0000 7fb2d92c2700 1 -- 172.21.15.80:0/386429879 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d40706c0 con 0x7fb2d406c490 2019-11-28T11:25:29.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.398+0000 7fb2d92c2700 1 --2- 172.21.15.80:0/386429879 >> v2:172.21.15.80:3300/0 conn(0x7fb2d406c490 0x7fb2d406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb2c800f6c0 tx=0x7fb2c800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.398+0000 7fb2d92c2700 1 --2- 172.21.15.80:0/386429879 >> v2:172.21.15.80:3300/0 conn(0x7fb2d406c490 0x7fb2d406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb2c800f6c0 tx=0x7fb2c800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.399+0000 7fb2d92c2700 1 --2- 172.21.15.80:0/386429879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d406c490 0x7fb2d406c920 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7fb2c800f6c0 tx=0x7fb2c800fa60).ready entity=mon.0 client_cookie=6875a38764b14f10 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:29.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.399+0000 7fb2d92c2700 1 --2- 172.21.15.80:0/386429879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d406c490 0x7fb2d406c920 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fb2c800f6c0 tx=0x7fb2c800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.399+0000 7fb2d92c2700 1 --2- 172.21.15.80:0/386429879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d406c490 0x7fb2d406c920 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fb2c800f6c0 tx=0x7fb2c800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.399+0000 7fb2d8ac1700 1 -- 172.21.15.80:0/386429879 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c8000960 con 0x7fb2d406c490 2019-11-28T11:25:29.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.399+0000 7fb2d92c2700 1 --2- 172.21.15.80:0/386429879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d406c490 0x7fb2d406c920 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fb2c800f6c0 tx=0x7fb2c800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.399+0000 7fb2d8ac1700 1 -- 172.21.15.80:0/386429879 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c8000c90 con 0x7fb2d406c490 2019-11-28T11:25:29.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.399+0000 7fb2d8ac1700 1 -- 172.21.15.80:0/386429879 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c80013a0 con 0x7fb2d406c490 2019-11-28T11:25:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.399+0000 7fb2db526700 1 -- 172.21.15.80:0/386429879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d406c490 msgr2=0x7fb2d406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.399+0000 7fb2db526700 1 --2- 172.21.15.80:0/386429879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d406c490 0x7fb2d406c920 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7fb2c800f6c0 tx=0x7fb2c800fa60).stop 2019-11-28T11:25:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.399+0000 7fb2db526700 1 -- 172.21.15.80:0/386429879 shutdown_connections 2019-11-28T11:25:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.399+0000 7fb2db526700 1 --2- 172.21.15.80:0/386429879 >> v2:172.21.15.174:3300/0 conn(0x7fb2d406ce60 0x7fb2d4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.399+0000 7fb2db526700 1 --2- 172.21.15.80:0/386429879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d406c490 0x7fb2d406c920 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.400+0000 7fb2db526700 1 -- 172.21.15.80:0/386429879 shutdown_connections 2019-11-28T11:25:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.400+0000 7fb2db526700 1 -- 172.21.15.80:0/386429879 wait complete. 2019-11-28T11:25:29.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.400+0000 7fb2db526700 1 -- 172.21.15.80:0/386429879 >> 172.21.15.80:0/386429879 conn(0x7fb2d4061cf0 msgr2=0x7fb2d4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:29.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.402+0000 7fb2db526700 1 Processor -- start 2019-11-28T11:25:29.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.402+0000 7fb2db526700 1 -- start start 2019-11-28T11:25:29.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2db526700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb2d413a780 0x7fb2d412d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:29.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2db526700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2d412d9c0 0x7fb2d412c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:29.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2db526700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb2d412c840 0x7fb2d412ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:29.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2db526700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d412a260 con 0x7fb2d412c840 2019-11-28T11:25:29.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2db526700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d412a530 con 0x7fb2d413a780 2019-11-28T11:25:29.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2db526700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d4129830 con 0x7fb2d412d9c0 2019-11-28T11:25:29.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2da2c4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb2d412c840 0x7fb2d412ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2da2c4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb2d412c840 0x7fb2d412ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59518/0 (socket says 172.21.15.80:59518) 2019-11-28T11:25:29.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2da2c4700 1 -- 172.21.15.80:0/3064748663 learned_addr learned my addr 172.21.15.80:0/3064748663 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:29.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2d92c2700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2d412d9c0 0x7fb2d412c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2d9ac3700 1 --2- 172.21.15.80:0/3064748663 >> v2:172.21.15.174:3300/0 conn(0x7fb2d413a780 0x7fb2d412d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2da2c4700 1 -- 172.21.15.80:0/3064748663 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2d412d9c0 msgr2=0x7fb2d412c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2da2c4700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2d412d9c0 0x7fb2d412c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2da2c4700 1 -- 172.21.15.80:0/3064748663 >> v2:172.21.15.174:3300/0 conn(0x7fb2d413a780 msgr2=0x7fb2d412d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2da2c4700 1 --2- 172.21.15.80:0/3064748663 >> v2:172.21.15.174:3300/0 conn(0x7fb2d413a780 0x7fb2d412d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2da2c4700 1 -- 172.21.15.80:0/3064748663 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d412abc0 con 0x7fb2d412c840 2019-11-28T11:25:29.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2d92c2700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2d412d9c0 0x7fb2d412c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:29.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2d9ac3700 1 --2- 172.21.15.80:0/3064748663 >> v2:172.21.15.174:3300/0 conn(0x7fb2d413a780 0x7fb2d412d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:29.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2da2c4700 1 --2- 172.21.15.80:0/3064748663 >> v2:172.21.15.80:3300/0 conn(0x7fb2d412c840 0x7fb2d412ccc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb2cc010420 tx=0x7fb2cc0107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2da2c4700 1 --2- 172.21.15.80:0/3064748663 >> v2:172.21.15.80:3300/0 conn(0x7fb2d412c840 0x7fb2d412ccc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb2cc010420 tx=0x7fb2cc0107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2da2c4700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d412c840 0x7fb2d412ccc0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fb2cc010420 tx=0x7fb2cc0107c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:29.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2da2c4700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d412c840 0x7fb2d412ccc0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fb2cc010420 tx=0x7fb2cc0107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2da2c4700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d412c840 0x7fb2d412ccc0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fb2cc010420 tx=0x7fb2cc0107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2d27fc700 1 -- 172.21.15.80:0/3064748663 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2cc0053e0 con 0x7fb2d412c840 2019-11-28T11:25:29.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2da2c4700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d412c840 0x7fb2d412ccc0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fb2cc010420 tx=0x7fb2cc0107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2d27fc700 1 -- 172.21.15.80:0/3064748663 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc0058b0 con 0x7fb2d412c840 2019-11-28T11:25:29.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2d27fc700 1 -- 172.21.15.80:0/3064748663 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2cc005ec0 con 0x7fb2d412c840 2019-11-28T11:25:29.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.403+0000 7fb2db526700 1 -- 172.21.15.80:0/3064748663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d412af40 con 0x7fb2d412c840 2019-11-28T11:25:29.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.404+0000 7fb2db526700 1 -- 172.21.15.80:0/3064748663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d412abc0 con 0x7fb2d412c840 2019-11-28T11:25:29.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.404+0000 7fb2da2c4700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d412c840 0x7fb2d412ccc0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fb2cc010420 tx=0x7fb2cc0107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.404+0000 7fb2d27fc700 1 -- 172.21.15.80:0/3064748663 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb2cc005aa0 con 0x7fb2d412c840 2019-11-28T11:25:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.404+0000 7fb2da2c4700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d412c840 0x7fb2d412ccc0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fb2cc010420 tx=0x7fb2cc0107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.404+0000 7fb2d27fc700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb2b4018730 0x7fb2b401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.404+0000 7fb2d27fc700 1 -- 172.21.15.80:0/3064748663 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fb2cc031a20 con 0x7fb2d412c840 2019-11-28T11:25:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.404+0000 7fb2d9ac3700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb2b4018730 0x7fb2b401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.405+0000 7fb2d9ac3700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb2b4018730 0x7fb2b401abc0 crc :-1 s=READY pgs=76 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:29.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.412+0000 7fb2db526700 1 -- 172.21.15.80:0/3064748663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d412af40 con 0x7fb2d412c840 2019-11-28T11:25:29.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.415+0000 7fb2da2c4700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d412c840 0x7fb2d412ccc0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fb2cc010420 tx=0x7fb2cc0107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.415+0000 7fb2d27fc700 1 -- 172.21.15.80:0/3064748663 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb2cc0051d0 con 0x7fb2d412c840 2019-11-28T11:25:29.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.606+0000 7fb2db526700 1 -- 172.21.15.80:0/3064748663 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb2d412abc0 con 0x7fb2d412c840 2019-11-28T11:25:29.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.606+0000 7fb2da2c4700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d412c840 0x7fb2d412ccc0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fb2cc010420 tx=0x7fb2cc0107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.607+0000 7fb2d27fc700 1 -- 172.21.15.80:0/3064748663 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb2cc005aa0 con 0x7fb2d412c840 2019-11-28T11:25:29.627 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2019-11-28T11:25:29.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.609+0000 7fb2db526700 1 -- 172.21.15.80:0/3064748663 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb2b4018730 msgr2=0x7fb2b401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.609+0000 7fb2db526700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb2b4018730 0x7fb2b401abc0 crc :-1 s=READY pgs=76 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.609+0000 7fb2db526700 1 -- 172.21.15.80:0/3064748663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d412c840 msgr2=0x7fb2d412ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.609+0000 7fb2db526700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d412c840 0x7fb2d412ccc0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fb2cc010420 tx=0x7fb2cc0107c0).stop 2019-11-28T11:25:29.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.609+0000 7fb2db526700 1 -- 172.21.15.80:0/3064748663 shutdown_connections 2019-11-28T11:25:29.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.609+0000 7fb2db526700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb2b4018730 0x7fb2b401abc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.609+0000 7fb2db526700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2d412c840 0x7fb2d412ccc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.609+0000 7fb2db526700 1 --2- 172.21.15.80:0/3064748663 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2d412d9c0 0x7fb2d412c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.609+0000 7fb2db526700 1 --2- 172.21.15.80:0/3064748663 >> v2:172.21.15.174:3300/0 conn(0x7fb2d413a780 0x7fb2d412d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.610+0000 7fb2db526700 1 -- 172.21.15.80:0/3064748663 shutdown_connections 2019-11-28T11:25:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.610+0000 7fb2db526700 1 -- 172.21.15.80:0/3064748663 wait complete. 2019-11-28T11:25:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.610+0000 7fb2db526700 1 -- 172.21.15.80:0/3064748663 >> 172.21.15.80:0/3064748663 conn(0x7fb2d4127dc0 msgr2=0x7fb2d4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:29.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2019-11-28T11:25:29.639 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2019-11-28T11:25:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.742+0000 7f45a1ed8700 1 Processor -- start 2019-11-28T11:25:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.742+0000 7f45a1ed8700 1 -- start start 2019-11-28T11:25:29.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.743+0000 7f45a1ed8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f459c06c0a0 0x7f459c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:29.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.743+0000 7f45a1ed8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f459c0734e0 0x7f459c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:29.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.743+0000 7f45a1ed8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c06db00 con 0x7f459c072360 2019-11-28T11:25:29.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.743+0000 7f45a1ed8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459c06fd60 con 0x7f459c06c0a0 2019-11-28T11:25:29.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.743+0000 7f45a1ed8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459c070030 con 0x7f459c0734e0 2019-11-28T11:25:29.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.743+0000 7f459bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f459c06c0a0 0x7f459c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.743+0000 7f45a0c76700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f459c072360 0x7f459c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58842/0 (socket says 172.21.15.80:58842) 2019-11-28T11:25:29.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.743+0000 7f45a0c76700 1 -- 172.21.15.80:0/4201147273 learned_addr learned my addr 172.21.15.80:0/4201147273 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:29.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f4593fff700 1 --2- 172.21.15.80:0/4201147273 >> v2:172.21.15.174:3300/0 conn(0x7f459c0734e0 0x7f459c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f459bfff700 1 -- 172.21.15.80:0/4201147273 >> v2:172.21.15.174:3300/0 conn(0x7f459c0734e0 msgr2=0x7f459c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:29.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f459bfff700 1 --2- 172.21.15.80:0/4201147273 >> v2:172.21.15.174:3300/0 conn(0x7f459c0734e0 0x7f459c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:29.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f459bfff700 1 -- 172.21.15.80:0/4201147273 >> v1:172.21.15.80:6789/0 conn(0x7f459c072360 legacy=0x7f459c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f459b7fe700 1 -- 172.21.15.80:0/4201147273 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129150618 0 0) 0x7f45940014d0 con 0x7f459c072360 2019-11-28T11:25:29.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f459bfff700 1 -- 172.21.15.80:0/4201147273 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c0706c0 con 0x7f459c06c0a0 2019-11-28T11:25:29.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f459bfff700 1 --2- 172.21.15.80:0/4201147273 >> v2:172.21.15.80:3300/0 conn(0x7f459c06c0a0 0x7f459c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f458c00af50 tx=0x7f458c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f459bfff700 1 --2- 172.21.15.80:0/4201147273 >> v2:172.21.15.80:3300/0 conn(0x7f459c06c0a0 0x7f459c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f458c00af50 tx=0x7f458c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f459bfff700 1 --2- 172.21.15.80:0/4201147273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c06c0a0 0x7f459c072fa0 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f458c00af50 tx=0x7f458c00b6e0).ready entity=mon.0 client_cookie=38c1bd828bfb4cbd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:29.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f459bfff700 1 --2- 172.21.15.80:0/4201147273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c06c0a0 0x7f459c072fa0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f458c00af50 tx=0x7f458c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f459b7fe700 1 -- 172.21.15.80:0/4201147273 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f458c007210 con 0x7f459c06c0a0 2019-11-28T11:25:29.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f459bfff700 1 --2- 172.21.15.80:0/4201147273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c06c0a0 0x7f459c072fa0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f458c00af50 tx=0x7f458c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f459bfff700 1 --2- 172.21.15.80:0/4201147273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c06c0a0 0x7f459c072fa0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f458c00af50 tx=0x7f458c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f459b7fe700 1 -- 172.21.15.80:0/4201147273 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c0099b0 con 0x7f459c06c0a0 2019-11-28T11:25:29.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f459b7fe700 1 -- 172.21.15.80:0/4201147273 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f458c00a080 con 0x7f459c06c0a0 2019-11-28T11:25:29.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f45a1ed8700 1 -- 172.21.15.80:0/4201147273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c06c0a0 msgr2=0x7f459c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.744+0000 7f45a1ed8700 1 --2- 172.21.15.80:0/4201147273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c06c0a0 0x7f459c072fa0 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f458c00af50 tx=0x7f458c00b6e0).stop 2019-11-28T11:25:29.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.745+0000 7f45a1ed8700 1 -- 172.21.15.80:0/4201147273 shutdown_connections 2019-11-28T11:25:29.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.745+0000 7f45a1ed8700 1 --2- 172.21.15.80:0/4201147273 >> v2:172.21.15.174:3300/0 conn(0x7f459c0734e0 0x7f459c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:29.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.745+0000 7f45a1ed8700 1 --2- 172.21.15.80:0/4201147273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c06c0a0 0x7f459c072fa0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.745+0000 7f45a1ed8700 1 -- 172.21.15.80:0/4201147273 shutdown_connections 2019-11-28T11:25:29.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.745+0000 7f45a1ed8700 1 -- 172.21.15.80:0/4201147273 wait complete. 2019-11-28T11:25:29.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.745+0000 7f45a1ed8700 1 -- 172.21.15.80:0/4201147273 >> 172.21.15.80:0/4201147273 conn(0x7f459c061cf0 msgr2=0x7f459c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:29.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.747+0000 7f45a1ed8700 1 Processor -- start 2019-11-28T11:25:29.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.747+0000 7f45a1ed8700 1 -- start start 2019-11-28T11:25:29.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.748+0000 7f45a1ed8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f459c104820 0x7f459c10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:29.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.748+0000 7f45a1ed8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f459c10c890 0x7f459c10b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:29.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.748+0000 7f45a1ed8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c13bcd0 con 0x7f459c10b710 2019-11-28T11:25:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.748+0000 7f45a1ed8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459c109130 con 0x7f459c10c890 2019-11-28T11:25:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.748+0000 7f45a1ed8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459c109400 con 0x7f459c104820 2019-11-28T11:25:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.748+0000 7f4593fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f459c10c890 0x7f459c10b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.748+0000 7f4593fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f459c10c890 0x7f459c10b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59528/0 (socket says 172.21.15.80:59528) 2019-11-28T11:25:29.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.748+0000 7f4593fff700 1 -- 172.21.15.80:0/1009038971 learned_addr learned my addr 172.21.15.80:0/1009038971 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:29.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.748+0000 7f45a0c76700 1 --1- 172.21.15.80:0/1009038971 >> v1:172.21.15.80:6789/0 conn(0x7f459c10b710 0x7f459c104c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58848/0 (socket says 172.21.15.80:58848) 2019-11-28T11:25:29.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.748+0000 7f459bfff700 1 --2- 172.21.15.80:0/1009038971 >> v2:172.21.15.174:3300/0 conn(0x7f459c104820 0x7f459c10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.748+0000 7f4593fff700 1 -- 172.21.15.80:0/1009038971 >> v2:172.21.15.174:3300/0 conn(0x7f459c104820 msgr2=0x7f459c10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.748+0000 7f4593fff700 1 --2- 172.21.15.80:0/1009038971 >> v2:172.21.15.174:3300/0 conn(0x7f459c104820 0x7f459c10c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.748+0000 7f4593fff700 1 -- 172.21.15.80:0/1009038971 >> v1:172.21.15.80:6789/0 conn(0x7f459c10b710 legacy=0x7f459c104c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.748+0000 7f4593fff700 1 -- 172.21.15.80:0/1009038971 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c109a90 con 0x7f459c10c890 2019-11-28T11:25:29.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.748+0000 7f45997fa700 1 -- 172.21.15.80:0/1009038971 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179756139 0 0) 0x7f45940012c0 con 0x7f459c10b710 2019-11-28T11:25:29.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.748+0000 7f4593fff700 1 --2- 172.21.15.80:0/1009038971 >> v2:172.21.15.80:3300/0 conn(0x7f459c10c890 0x7f459c10b1d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4584010380 tx=0x7f4584010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.749+0000 7f4593fff700 1 --2- 172.21.15.80:0/1009038971 >> v2:172.21.15.80:3300/0 conn(0x7f459c10c890 0x7f459c10b1d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4584010380 tx=0x7f4584010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.749+0000 7f4593fff700 1 --2- 172.21.15.80:0/1009038971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c10c890 0x7f459c10b1d0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f4584010380 tx=0x7f4584010720).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:29.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.749+0000 7f4593fff700 1 --2- 172.21.15.80:0/1009038971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c10c890 0x7f459c10b1d0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f4584010380 tx=0x7f4584010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.749+0000 7f45997fa700 1 -- 172.21.15.80:0/1009038971 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4584000940 con 0x7f459c10c890 2019-11-28T11:25:29.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.749+0000 7f4593fff700 1 --2- 172.21.15.80:0/1009038971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c10c890 0x7f459c10b1d0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f4584010380 tx=0x7f4584010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.749+0000 7f4593fff700 1 --2- 172.21.15.80:0/1009038971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c10c890 0x7f459c10b1d0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f4584010380 tx=0x7f4584010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.749+0000 7f45997fa700 1 -- 172.21.15.80:0/1009038971 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4584001090 con 0x7f459c10c890 2019-11-28T11:25:29.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.749+0000 7f45a1ed8700 1 -- 172.21.15.80:0/1009038971 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459c109e10 con 0x7f459c10c890 2019-11-28T11:25:29.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.749+0000 7f45997fa700 1 -- 172.21.15.80:0/1009038971 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45840075f0 con 0x7f459c10c890 2019-11-28T11:25:29.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.749+0000 7f45a1ed8700 1 -- 172.21.15.80:0/1009038971 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459c109a90 con 0x7f459c10c890 2019-11-28T11:25:29.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.749+0000 7f4593fff700 1 --2- 172.21.15.80:0/1009038971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c10c890 0x7f459c10b1d0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f4584010380 tx=0x7f4584010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.749+0000 7f45997fa700 1 -- 172.21.15.80:0/1009038971 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4584000c90 con 0x7f459c10c890 2019-11-28T11:25:29.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.749+0000 7f4593fff700 1 --2- 172.21.15.80:0/1009038971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c10c890 0x7f459c10b1d0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f4584010380 tx=0x7f4584010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.749+0000 7f45997fa700 1 --2- 172.21.15.80:0/1009038971 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4580018730 0x7f458001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:29.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.749+0000 7f45997fa700 1 -- 172.21.15.80:0/1009038971 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f4584031a80 con 0x7f459c10c890 2019-11-28T11:25:29.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.750+0000 7f459bfff700 1 --2- 172.21.15.80:0/1009038971 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4580018730 0x7f458001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:29.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.750+0000 7f459bfff700 1 --2- 172.21.15.80:0/1009038971 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4580018730 0x7f458001abc0 crc :-1 s=READY pgs=77 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:29.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.757+0000 7f45a1ed8700 1 -- 172.21.15.80:0/1009038971 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459c109e10 con 0x7f459c10c890 2019-11-28T11:25:29.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.761+0000 7f4593fff700 1 --2- 172.21.15.80:0/1009038971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c10c890 0x7f459c10b1d0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f4584010380 tx=0x7f4584010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.761+0000 7f45997fa700 1 -- 172.21.15.80:0/1009038971 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4584000940 con 0x7f459c10c890 2019-11-28T11:25:29.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.948+0000 7f45a1ed8700 1 -- 172.21.15.80:0/1009038971 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f459c109a90 con 0x7f459c10c890 2019-11-28T11:25:29.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.948+0000 7f4593fff700 1 --2- 172.21.15.80:0/1009038971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c10c890 0x7f459c10b1d0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f4584010380 tx=0x7f4584010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:29.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.948+0000 7f45997fa700 1 -- 172.21.15.80:0/1009038971 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4584000c90 con 0x7f459c10c890 2019-11-28T11:25:29.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.951+0000 7f45a1ed8700 1 -- 172.21.15.80:0/1009038971 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4580018730 msgr2=0x7f458001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.951+0000 7f45a1ed8700 1 --2- 172.21.15.80:0/1009038971 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4580018730 0x7f458001abc0 crc :-1 s=READY pgs=77 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.951+0000 7f45a1ed8700 1 -- 172.21.15.80:0/1009038971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c10c890 msgr2=0x7f459c10b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:29.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.951+0000 7f45a1ed8700 1 --2- 172.21.15.80:0/1009038971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c10c890 0x7f459c10b1d0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f4584010380 tx=0x7f4584010720).stop 2019-11-28T11:25:29.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.951+0000 7f45a1ed8700 1 -- 172.21.15.80:0/1009038971 shutdown_connections 2019-11-28T11:25:29.973 INFO:teuthology.orchestra.run.smithi080.stdout:55834574854 2019-11-28T11:25:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.951+0000 7f45a1ed8700 1 --2- 172.21.15.80:0/1009038971 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4580018730 0x7f458001abc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.951+0000 7f45a1ed8700 1 --2- 172.21.15.80:0/1009038971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f459c10c890 0x7f459c10b1d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.951+0000 7f45a1ed8700 1 --2- 172.21.15.80:0/1009038971 >> v2:172.21.15.174:3300/0 conn(0x7f459c104820 0x7f459c10c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.951+0000 7f45a1ed8700 1 -- 172.21.15.80:0/1009038971 shutdown_connections 2019-11-28T11:25:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.951+0000 7f45a1ed8700 1 -- 172.21.15.80:0/1009038971 wait complete. 2019-11-28T11:25:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:29.951+0000 7f45a1ed8700 1 -- 172.21.15.80:0/1009038971 >> 172.21.15.80:0/1009038971 conn(0x7f459c13d620 msgr2=0x7f459c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:29.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.5 2019-11-28T11:25:29.981 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2019-11-28T11:25:30.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.095+0000 7fca612e1700 1 Processor -- start 2019-11-28T11:25:30.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.095+0000 7fca612e1700 1 -- start start 2019-11-28T11:25:30.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca612e1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca5c06c0a0 0x7fca5c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:30.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca612e1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca5c0734e0 0x7fca5c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:30.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca612e1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5c06db00 con 0x7fca5c072360 2019-11-28T11:25:30.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca612e1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5c06f330 con 0x7fca5c0734e0 2019-11-28T11:25:30.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca612e1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c0706c0 con 0x7fca5c06c0a0 2019-11-28T11:25:30.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5affd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca5c0734e0 0x7fca5c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fca5c072360 0x7fca5c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58856/0 (socket says 172.21.15.80:58856) 2019-11-28T11:25:30.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5bfff700 1 -- 172.21.15.80:0/3257690435 learned_addr learned my addr 172.21.15.80:0/3257690435 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:30.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5b7fe700 1 --2- 172.21.15.80:0/3257690435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca5c06c0a0 0x7fca5c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5affd700 1 -- 172.21.15.80:0/3257690435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca5c06c0a0 msgr2=0x7fca5c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:30.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5affd700 1 --2- 172.21.15.80:0/3257690435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca5c06c0a0 0x7fca5c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:30.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5affd700 1 -- 172.21.15.80:0/3257690435 >> v1:172.21.15.80:6789/0 conn(0x7fca5c072360 legacy=0x7fca5c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:30.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5a7fc700 1 -- 172.21.15.80:0/3257690435 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246635858 0 0) 0x7fca54001150 con 0x7fca5c072360 2019-11-28T11:25:30.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5affd700 1 -- 172.21.15.80:0/3257690435 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c070a40 con 0x7fca5c0734e0 2019-11-28T11:25:30.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5affd700 1 --2- 172.21.15.80:0/3257690435 >> v2:172.21.15.80:3300/0 conn(0x7fca5c0734e0 0x7fca5c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fca4400af50 tx=0x7fca4400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5affd700 1 --2- 172.21.15.80:0/3257690435 >> v2:172.21.15.80:3300/0 conn(0x7fca5c0734e0 0x7fca5c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fca4400af50 tx=0x7fca4400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5affd700 1 --2- 172.21.15.80:0/3257690435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c0734e0 0x7fca5c071e20 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7fca4400af50 tx=0x7fca4400b6e0).ready entity=mon.0 client_cookie=d658b9bc5cb49258 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:30.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5affd700 1 --2- 172.21.15.80:0/3257690435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c0734e0 0x7fca5c071e20 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7fca4400af50 tx=0x7fca4400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5a7fc700 1 -- 172.21.15.80:0/3257690435 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca44007210 con 0x7fca5c0734e0 2019-11-28T11:25:30.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5affd700 1 --2- 172.21.15.80:0/3257690435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c0734e0 0x7fca5c071e20 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7fca4400af50 tx=0x7fca4400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5a7fc700 1 -- 172.21.15.80:0/3257690435 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca440099b0 con 0x7fca5c0734e0 2019-11-28T11:25:30.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.096+0000 7fca5affd700 1 --2- 172.21.15.80:0/3257690435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c0734e0 0x7fca5c071e20 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7fca4400af50 tx=0x7fca4400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.097+0000 7fca5a7fc700 1 -- 172.21.15.80:0/3257690435 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca44009ba0 con 0x7fca5c0734e0 2019-11-28T11:25:30.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.097+0000 7fca612e1700 1 -- 172.21.15.80:0/3257690435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c0734e0 msgr2=0x7fca5c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:30.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.097+0000 7fca612e1700 1 --2- 172.21.15.80:0/3257690435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c0734e0 0x7fca5c071e20 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7fca4400af50 tx=0x7fca4400b6e0).stop 2019-11-28T11:25:30.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.097+0000 7fca612e1700 1 -- 172.21.15.80:0/3257690435 shutdown_connections 2019-11-28T11:25:30.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.097+0000 7fca612e1700 1 --2- 172.21.15.80:0/3257690435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c0734e0 0x7fca5c071e20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.097+0000 7fca612e1700 1 --2- 172.21.15.80:0/3257690435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca5c06c0a0 0x7fca5c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:30.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.097+0000 7fca612e1700 1 -- 172.21.15.80:0/3257690435 shutdown_connections 2019-11-28T11:25:30.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.097+0000 7fca612e1700 1 -- 172.21.15.80:0/3257690435 wait complete. 2019-11-28T11:25:30.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.097+0000 7fca612e1700 1 -- 172.21.15.80:0/3257690435 >> 172.21.15.80:0/3257690435 conn(0x7fca5c061cf0 msgr2=0x7fca5c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:30.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.100+0000 7fca612e1700 1 Processor -- start 2019-11-28T11:25:30.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.100+0000 7fca612e1700 1 -- start start 2019-11-28T11:25:30.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca612e1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca5c0741a0 0x7fca5c117630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:30.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca612e1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fca5c117b70 0x7fca5c1164b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:30.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca612e1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca5c1169f0 0x7fca5c116e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:30.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca612e1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5c076410 con 0x7fca5c1169f0 2019-11-28T11:25:30.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca612e1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5c076e40 con 0x7fca5c117b70 2019-11-28T11:25:30.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca612e1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c0777a0 con 0x7fca5c0741a0 2019-11-28T11:25:30.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca5bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca5c1169f0 0x7fca5c116e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca5bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca5c1169f0 0x7fca5c116e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59546/0 (socket says 172.21.15.80:59546) 2019-11-28T11:25:30.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca5bfff700 1 -- 172.21.15.80:0/3136648326 learned_addr learned my addr 172.21.15.80:0/3136648326 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:30.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca5b7fe700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca5c0741a0 0x7fca5c117630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca5affd700 1 --2- 172.21.15.80:0/3136648326 >> v2:172.21.15.174:3300/0 conn(0x7fca5c117b70 0x7fca5c1164b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca5bfff700 1 -- 172.21.15.80:0/3136648326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca5c0741a0 msgr2=0x7fca5c117630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:30.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca5bfff700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca5c0741a0 0x7fca5c117630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca5bfff700 1 -- 172.21.15.80:0/3136648326 >> v2:172.21.15.174:3300/0 conn(0x7fca5c117b70 msgr2=0x7fca5c1164b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:30.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca5bfff700 1 --2- 172.21.15.80:0/3136648326 >> v2:172.21.15.174:3300/0 conn(0x7fca5c117b70 0x7fca5c1164b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca5bfff700 1 -- 172.21.15.80:0/3136648326 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c077b20 con 0x7fca5c1169f0 2019-11-28T11:25:30.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca5bfff700 1 --2- 172.21.15.80:0/3136648326 >> v2:172.21.15.80:3300/0 conn(0x7fca5c1169f0 0x7fca5c116e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca54010390 tx=0x7fca54010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca5bfff700 1 --2- 172.21.15.80:0/3136648326 >> v2:172.21.15.80:3300/0 conn(0x7fca5c1169f0 0x7fca5c116e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca54010390 tx=0x7fca54010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca5bfff700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c1169f0 0x7fca5c116e90 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7fca54010390 tx=0x7fca54010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:30.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca5bfff700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c1169f0 0x7fca5c116e90 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fca54010390 tx=0x7fca54010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca53fff700 1 -- 172.21.15.80:0/3136648326 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca54000940 con 0x7fca5c1169f0 2019-11-28T11:25:30.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca5bfff700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c1169f0 0x7fca5c116e90 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fca54010390 tx=0x7fca54010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca5bfff700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c1169f0 0x7fca5c116e90 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fca54010390 tx=0x7fca54010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca53fff700 1 -- 172.21.15.80:0/3136648326 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca540010e0 con 0x7fca5c1169f0 2019-11-28T11:25:30.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca53fff700 1 -- 172.21.15.80:0/3136648326 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca54001830 con 0x7fca5c1169f0 2019-11-28T11:25:30.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca612e1700 1 -- 172.21.15.80:0/3136648326 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca5c077b20 con 0x7fca5c1169f0 2019-11-28T11:25:30.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.101+0000 7fca612e1700 1 -- 172.21.15.80:0/3136648326 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca5c077b20 con 0x7fca5c1169f0 2019-11-28T11:25:30.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.102+0000 7fca5bfff700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c1169f0 0x7fca5c116e90 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fca54010390 tx=0x7fca54010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.102+0000 7fca53fff700 1 -- 172.21.15.80:0/3136648326 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fca54000940 con 0x7fca5c1169f0 2019-11-28T11:25:30.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.102+0000 7fca5bfff700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c1169f0 0x7fca5c116e90 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fca54010390 tx=0x7fca54010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.102+0000 7fca53fff700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca40018730 0x7fca4001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:30.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.102+0000 7fca53fff700 1 -- 172.21.15.80:0/3136648326 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fca54031a10 con 0x7fca5c1169f0 2019-11-28T11:25:30.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.102+0000 7fca5b7fe700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca40018730 0x7fca4001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.102+0000 7fca5b7fe700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca40018730 0x7fca4001abc0 crc :-1 s=READY pgs=78 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:30.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.110+0000 7fca612e1700 1 -- 172.21.15.80:0/3136648326 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5c077b20 con 0x7fca5c1169f0 2019-11-28T11:25:30.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.113+0000 7fca5bfff700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c1169f0 0x7fca5c116e90 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fca54010390 tx=0x7fca54010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.113+0000 7fca53fff700 1 -- 172.21.15.80:0/3136648326 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fca5402cf90 con 0x7fca5c1169f0 2019-11-28T11:25:30.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.300+0000 7fca612e1700 1 -- 172.21.15.80:0/3136648326 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fca5c0777a0 con 0x7fca5c1169f0 2019-11-28T11:25:30.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.301+0000 7fca5bfff700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c1169f0 0x7fca5c116e90 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fca54010390 tx=0x7fca54010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.301+0000 7fca53fff700 1 -- 172.21.15.80:0/3136648326 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fca5402cf90 con 0x7fca5c1169f0 2019-11-28T11:25:30.321 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2019-11-28T11:25:30.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.303+0000 7fca612e1700 1 -- 172.21.15.80:0/3136648326 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca40018730 msgr2=0x7fca4001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:30.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.303+0000 7fca612e1700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca40018730 0x7fca4001abc0 crc :-1 s=READY pgs=78 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.303+0000 7fca612e1700 1 -- 172.21.15.80:0/3136648326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c1169f0 msgr2=0x7fca5c116e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.303+0000 7fca612e1700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c1169f0 0x7fca5c116e90 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7fca54010390 tx=0x7fca54010270).stop 2019-11-28T11:25:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.303+0000 7fca612e1700 1 -- 172.21.15.80:0/3136648326 shutdown_connections 2019-11-28T11:25:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.303+0000 7fca612e1700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca40018730 0x7fca4001abc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.303+0000 7fca612e1700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca5c1169f0 0x7fca5c116e90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.303+0000 7fca612e1700 1 --2- 172.21.15.80:0/3136648326 >> v2:172.21.15.174:3300/0 conn(0x7fca5c117b70 0x7fca5c1164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.303+0000 7fca612e1700 1 --2- 172.21.15.80:0/3136648326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca5c0741a0 0x7fca5c117630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.303+0000 7fca612e1700 1 -- 172.21.15.80:0/3136648326 shutdown_connections 2019-11-28T11:25:30.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.303+0000 7fca612e1700 1 -- 172.21.15.80:0/3136648326 wait complete. 2019-11-28T11:25:30.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.303+0000 7fca612e1700 1 -- 172.21.15.80:0/3136648326 >> 172.21.15.80:0/3136648326 conn(0x7fca5c13d930 msgr2=0x7fca5c07b940 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:30.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2019-11-28T11:25:30.333 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2019-11-28T11:25:30.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.444+0000 7f5330410700 1 Processor -- start 2019-11-28T11:25:30.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.444+0000 7f5330410700 1 -- start start 2019-11-28T11:25:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.445+0000 7f5330410700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f532806c490 0x7f532806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.445+0000 7f5330410700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f532806ce60 0x7f5328164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.445+0000 7f5330410700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532806db00 con 0x7f532806c0a0 2019-11-28T11:25:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.445+0000 7f5330410700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532806fd60 con 0x7f532806c490 2019-11-28T11:25:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.445+0000 7f5330410700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5328070030 con 0x7f532806ce60 2019-11-28T11:25:30.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.445+0000 7f532e9ad700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f532806c0a0 0x7f5328072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58866/0 (socket says 172.21.15.80:58866) 2019-11-28T11:25:30.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.445+0000 7f532e1ac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f532806c490 0x7f532806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.445+0000 7f532e9ad700 1 -- 172.21.15.80:0/3166302699 learned_addr learned my addr 172.21.15.80:0/3166302699 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:30.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f532f1ae700 1 --2- 172.21.15.80:0/3166302699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f532806ce60 0x7f5328164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f532d9ab700 1 -- 172.21.15.80:0/3166302699 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030231681 0 0) 0x7f5318001150 con 0x7f532806c0a0 2019-11-28T11:25:30.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f532d9ab700 1 -- 172.21.15.80:0/3166302699 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5314002e80 con 0x7f532806c0a0 2019-11-28T11:25:30.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f532e1ac700 1 -- 172.21.15.80:0/3166302699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f532806ce60 msgr2=0x7f5328164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:30.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f532e1ac700 1 --2- 172.21.15.80:0/3166302699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f532806ce60 0x7f5328164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:30.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f532e1ac700 1 -- 172.21.15.80:0/3166302699 >> v1:172.21.15.80:6789/0 conn(0x7f532806c0a0 legacy=0x7f5328072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:30.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f532e1ac700 1 -- 172.21.15.80:0/3166302699 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53280706c0 con 0x7f532806c490 2019-11-28T11:25:30.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f532e1ac700 1 --2- 172.21.15.80:0/3166302699 >> v2:172.21.15.80:3300/0 conn(0x7f532806c490 0x7f532806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f531000b2d0 tx=0x7f531000b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f532e1ac700 1 --2- 172.21.15.80:0/3166302699 >> v2:172.21.15.80:3300/0 conn(0x7f532806c490 0x7f532806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f531000b2d0 tx=0x7f531000b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f532e1ac700 1 --2- 172.21.15.80:0/3166302699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532806c490 0x7f532806c920 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f531000b2d0 tx=0x7f531000b5d0).ready entity=mon.0 client_cookie=b8f723eb6ed4af7e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:30.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f532e1ac700 1 --2- 172.21.15.80:0/3166302699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532806c490 0x7f532806c920 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f531000b2d0 tx=0x7f531000b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f532d9ab700 1 -- 172.21.15.80:0/3166302699 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5310007590 con 0x7f532806c490 2019-11-28T11:25:30.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f532e1ac700 1 --2- 172.21.15.80:0/3166302699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532806c490 0x7f532806c920 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f531000b2d0 tx=0x7f531000b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f532e1ac700 1 --2- 172.21.15.80:0/3166302699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532806c490 0x7f532806c920 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f531000b2d0 tx=0x7f531000b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f532d9ab700 1 -- 172.21.15.80:0/3166302699 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5310009d30 con 0x7f532806c490 2019-11-28T11:25:30.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f532d9ab700 1 -- 172.21.15.80:0/3166302699 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f531000a400 con 0x7f532806c490 2019-11-28T11:25:30.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f5330410700 1 -- 172.21.15.80:0/3166302699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532806c490 msgr2=0x7f532806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:30.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.446+0000 7f5330410700 1 --2- 172.21.15.80:0/3166302699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532806c490 0x7f532806c920 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f531000b2d0 tx=0x7f531000b5d0).stop 2019-11-28T11:25:30.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.447+0000 7f5330410700 1 -- 172.21.15.80:0/3166302699 shutdown_connections 2019-11-28T11:25:30.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.447+0000 7f5330410700 1 --2- 172.21.15.80:0/3166302699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f532806ce60 0x7f5328164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:30.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.447+0000 7f5330410700 1 --2- 172.21.15.80:0/3166302699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532806c490 0x7f532806c920 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.447+0000 7f5330410700 1 -- 172.21.15.80:0/3166302699 shutdown_connections 2019-11-28T11:25:30.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.447+0000 7f5330410700 1 -- 172.21.15.80:0/3166302699 wait complete. 2019-11-28T11:25:30.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.447+0000 7f5330410700 1 -- 172.21.15.80:0/3166302699 >> 172.21.15.80:0/3166302699 conn(0x7f5328061cf0 msgr2=0x7f5328064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:30.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.449+0000 7f5330410700 1 Processor -- start 2019-11-28T11:25:30.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.449+0000 7f5330410700 1 -- start start 2019-11-28T11:25:30.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.450+0000 7f5330410700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f532810cfb0 0x7f532810d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:30.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.450+0000 7f5330410700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f532810d980 0x7f532812c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:30.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.450+0000 7f5330410700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5328135c60 con 0x7f5328104d10 2019-11-28T11:25:30.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.450+0000 7f5330410700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5328141e60 con 0x7f532810d980 2019-11-28T11:25:30.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.450+0000 7f5330410700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5328107cb0 con 0x7f532810cfb0 2019-11-28T11:25:30.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.450+0000 7f532f1ae700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f532810d980 0x7f532812c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.450+0000 7f532f1ae700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f532810d980 0x7f532812c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59560/0 (socket says 172.21.15.80:59560) 2019-11-28T11:25:30.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.450+0000 7f532f1ae700 1 -- 172.21.15.80:0/1925188101 learned_addr learned my addr 172.21.15.80:0/1925188101 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:30.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.450+0000 7f532e9ad700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5328104d10 0x7f532810e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58872/0 (socket says 172.21.15.80:58872) 2019-11-28T11:25:30.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f532e1ac700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f532810cfb0 0x7f532810d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f532f1ae700 1 -- 172.21.15.80:0/1925188101 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f532810cfb0 msgr2=0x7f532810d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:30.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f532f1ae700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f532810cfb0 0x7f532810d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f532f1ae700 1 -- 172.21.15.80:0/1925188101 >> v1:172.21.15.80:6789/0 conn(0x7f5328104d10 legacy=0x7f532810e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:30.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f532f1ae700 1 -- 172.21.15.80:0/1925188101 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53281424f0 con 0x7f532810d980 2019-11-28T11:25:30.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f53277fe700 1 -- 172.21.15.80:0/1925188101 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194203383 0 0) 0x7f5318001150 con 0x7f5328104d10 2019-11-28T11:25:30.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f532f1ae700 1 --2- 172.21.15.80:0/1925188101 >> v2:172.21.15.80:3300/0 conn(0x7f532810d980 0x7f532812c410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f53200103e0 tx=0x7f5320010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f532f1ae700 1 --2- 172.21.15.80:0/1925188101 >> v2:172.21.15.80:3300/0 conn(0x7f532810d980 0x7f532812c410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f53200103e0 tx=0x7f5320010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f532f1ae700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532810d980 0x7f532812c410 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f53200103e0 tx=0x7f5320010780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:30.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f532f1ae700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532810d980 0x7f532812c410 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f53200103e0 tx=0x7f5320010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f53277fe700 1 -- 172.21.15.80:0/1925188101 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f532000a6b0 con 0x7f532810d980 2019-11-28T11:25:30.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f532f1ae700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532810d980 0x7f532812c410 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f53200103e0 tx=0x7f5320010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f532f1ae700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532810d980 0x7f532812c410 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f53200103e0 tx=0x7f5320010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f53277fe700 1 -- 172.21.15.80:0/1925188101 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5320001060 con 0x7f532810d980 2019-11-28T11:25:30.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f53277fe700 1 -- 172.21.15.80:0/1925188101 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f532000a6b0 con 0x7f532810d980 2019-11-28T11:25:30.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f5330410700 1 -- 172.21.15.80:0/1925188101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53281424f0 con 0x7f532810d980 2019-11-28T11:25:30.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f5330410700 1 -- 172.21.15.80:0/1925188101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53281424f0 con 0x7f532810d980 2019-11-28T11:25:30.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.451+0000 7f532f1ae700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532810d980 0x7f532812c410 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f53200103e0 tx=0x7f5320010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.452+0000 7f53277fe700 1 -- 172.21.15.80:0/1925188101 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f532000a6b0 con 0x7f532810d980 2019-11-28T11:25:30.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.452+0000 7f532f1ae700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532810d980 0x7f532812c410 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f53200103e0 tx=0x7f5320010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.452+0000 7f53277fe700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f530c018730 0x7f530c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:30.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.452+0000 7f53277fe700 1 -- 172.21.15.80:0/1925188101 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f5320031ac0 con 0x7f532810d980 2019-11-28T11:25:30.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.452+0000 7f532e9ad700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f530c018730 0x7f530c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.452+0000 7f532e9ad700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f530c018730 0x7f530c01abc0 crc :-1 s=READY pgs=79 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:30.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.459+0000 7f5330410700 1 -- 172.21.15.80:0/1925188101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53281424f0 con 0x7f532810d980 2019-11-28T11:25:30.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.463+0000 7f532f1ae700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532810d980 0x7f532812c410 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f53200103e0 tx=0x7f5320010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.463+0000 7f53277fe700 1 -- 172.21.15.80:0/1925188101 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5320000a70 con 0x7f532810d980 2019-11-28T11:25:30.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.652+0000 7f5330410700 1 -- 172.21.15.80:0/1925188101 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f53281424f0 con 0x7f532810d980 2019-11-28T11:25:30.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.652+0000 7f532f1ae700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532810d980 0x7f532812c410 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f53200103e0 tx=0x7f5320010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.652+0000 7f53277fe700 1 -- 172.21.15.80:0/1925188101 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f532000a6b0 con 0x7f532810d980 2019-11-28T11:25:30.673 INFO:teuthology.orchestra.run.smithi080.stdout:55834574855 2019-11-28T11:25:30.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.655+0000 7f5330410700 1 -- 172.21.15.80:0/1925188101 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f530c018730 msgr2=0x7f530c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:30.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.655+0000 7f5330410700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f530c018730 0x7f530c01abc0 crc :-1 s=READY pgs=79 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.655+0000 7f5330410700 1 -- 172.21.15.80:0/1925188101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532810d980 msgr2=0x7f532812c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:30.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.655+0000 7f5330410700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532810d980 0x7f532812c410 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f53200103e0 tx=0x7f5320010780).stop 2019-11-28T11:25:30.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.655+0000 7f5330410700 1 -- 172.21.15.80:0/1925188101 shutdown_connections 2019-11-28T11:25:30.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.655+0000 7f5330410700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f530c018730 0x7f530c01abc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.655+0000 7f5330410700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f532810d980 0x7f532812c410 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.655+0000 7f5330410700 1 --2- 172.21.15.80:0/1925188101 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f532810cfb0 0x7f532810d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.655+0000 7f5330410700 1 -- 172.21.15.80:0/1925188101 shutdown_connections 2019-11-28T11:25:30.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.655+0000 7f5330410700 1 -- 172.21.15.80:0/1925188101 wait complete. 2019-11-28T11:25:30.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.655+0000 7f5330410700 1 -- 172.21.15.80:0/1925188101 >> 172.21.15.80:0/1925188101 conn(0x7f532815e210 msgr2=0x7f532810b140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:30.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2019-11-28T11:25:30.685 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2019-11-28T11:25:30.685 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-11-28T11:25:30.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.785+0000 7f2632006700 1 Processor -- start 2019-11-28T11:25:30.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.785+0000 7f2632006700 1 -- start start 2019-11-28T11:25:30.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f2632006700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f262c06c0a0 0x7f262c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:30.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f2632006700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f262c0734e0 0x7f262c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:30.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f2632006700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262c06db00 con 0x7f262c072360 2019-11-28T11:25:30.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f2632006700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c06fd60 con 0x7f262c0734e0 2019-11-28T11:25:30.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f2632006700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c070030 con 0x7f262c06c0a0 2019-11-28T11:25:30.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f2623fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f262c0734e0 0x7f262c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f2623fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f262c0734e0 0x7f262c071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59564/0 (socket says 172.21.15.80:59564) 2019-11-28T11:25:30.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f2623fff700 1 -- 172.21.15.80:0/2187070291 learned_addr learned my addr 172.21.15.80:0/2187070291 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:30.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f262bfff700 1 --2- 172.21.15.80:0/2187070291 >> v2:172.21.15.174:3300/0 conn(0x7f262c06c0a0 0x7f262c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f2623fff700 1 -- 172.21.15.80:0/2187070291 >> v2:172.21.15.174:3300/0 conn(0x7f262c06c0a0 msgr2=0x7f262c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:30.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f2623fff700 1 --2- 172.21.15.80:0/2187070291 >> v2:172.21.15.174:3300/0 conn(0x7f262c06c0a0 0x7f262c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:30.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f2623fff700 1 -- 172.21.15.80:0/2187070291 >> v1:172.21.15.174:6789/0 conn(0x7f262c072360 legacy=0x7f262c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:30.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f2623fff700 1 -- 172.21.15.80:0/2187070291 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c0706c0 con 0x7f262c0734e0 2019-11-28T11:25:30.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f262bfff700 1 --2- 172.21.15.80:0/2187070291 >> v2:172.21.15.174:3300/0 conn(0x7f262c06c0a0 0x7f262c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:30.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f2623fff700 1 --2- 172.21.15.80:0/2187070291 >> v2:172.21.15.80:3300/0 conn(0x7f262c0734e0 0x7f262c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f261400f740 tx=0x7f261400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f2623fff700 1 --2- 172.21.15.80:0/2187070291 >> v2:172.21.15.80:3300/0 conn(0x7f262c0734e0 0x7f262c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f261400f740 tx=0x7f261400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.786+0000 7f2623fff700 1 --2- 172.21.15.80:0/2187070291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c0734e0 0x7f262c071e20 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f261400f740 tx=0x7f261400fae0).ready entity=mon.0 client_cookie=6fc1ec3309ee1a9f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:30.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.787+0000 7f2623fff700 1 --2- 172.21.15.80:0/2187070291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c0734e0 0x7f262c071e20 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f261400f740 tx=0x7f261400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.787+0000 7f262b7fe700 1 -- 172.21.15.80:0/2187070291 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2614000960 con 0x7f262c0734e0 2019-11-28T11:25:30.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.787+0000 7f2623fff700 1 --2- 172.21.15.80:0/2187070291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c0734e0 0x7f262c071e20 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f261400f740 tx=0x7f261400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.787+0000 7f2623fff700 1 --2- 172.21.15.80:0/2187070291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c0734e0 0x7f262c071e20 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f261400f740 tx=0x7f261400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.787+0000 7f262b7fe700 1 -- 172.21.15.80:0/2187070291 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2614000c90 con 0x7f262c0734e0 2019-11-28T11:25:30.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.787+0000 7f262b7fe700 1 -- 172.21.15.80:0/2187070291 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26140013a0 con 0x7f262c0734e0 2019-11-28T11:25:30.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.787+0000 7f2632006700 1 -- 172.21.15.80:0/2187070291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c0734e0 msgr2=0x7f262c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:30.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.787+0000 7f2632006700 1 --2- 172.21.15.80:0/2187070291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c0734e0 0x7f262c071e20 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f261400f740 tx=0x7f261400fae0).stop 2019-11-28T11:25:30.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.787+0000 7f2632006700 1 -- 172.21.15.80:0/2187070291 shutdown_connections 2019-11-28T11:25:30.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.787+0000 7f2632006700 1 --2- 172.21.15.80:0/2187070291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c0734e0 0x7f262c071e20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.787+0000 7f2632006700 1 --2- 172.21.15.80:0/2187070291 >> v2:172.21.15.174:3300/0 conn(0x7f262c06c0a0 0x7f262c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:30.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.787+0000 7f2632006700 1 -- 172.21.15.80:0/2187070291 shutdown_connections 2019-11-28T11:25:30.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.787+0000 7f2632006700 1 -- 172.21.15.80:0/2187070291 wait complete. 2019-11-28T11:25:30.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.787+0000 7f2632006700 1 -- 172.21.15.80:0/2187070291 >> 172.21.15.80:0/2187070291 conn(0x7f262c061cf0 msgr2=0x7f262c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:30.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.790+0000 7f2632006700 1 Processor -- start 2019-11-28T11:25:30.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.790+0000 7f2632006700 1 -- start start 2019-11-28T11:25:30.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2632006700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f262c15fdf0 0x7f262c12b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:30.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2632006700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f262c12b8a0 0x7f262c13e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:30.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2632006700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f262c13e860 0x7f262c12a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:30.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2632006700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c107df0 con 0x7f262c13e860 2019-11-28T11:25:30.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2632006700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c107890 con 0x7f262c12b8a0 2019-11-28T11:25:30.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2632006700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c108820 con 0x7f262c15fdf0 2019-11-28T11:25:30.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2630da4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f262c13e860 0x7f262c12a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2630da4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f262c13e860 0x7f262c12a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59572/0 (socket says 172.21.15.80:59572) 2019-11-28T11:25:30.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2630da4700 1 -- 172.21.15.80:0/1202934983 learned_addr learned my addr 172.21.15.80:0/1202934983 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:30.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2623fff700 1 --2- 172.21.15.80:0/1202934983 >> v2:172.21.15.174:3300/0 conn(0x7f262c12b8a0 0x7f262c13e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f262bfff700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f262c15fdf0 0x7f262c12b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2630da4700 1 -- 172.21.15.80:0/1202934983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f262c15fdf0 msgr2=0x7f262c12b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:30.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2630da4700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f262c15fdf0 0x7f262c12b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2630da4700 1 -- 172.21.15.80:0/1202934983 >> v2:172.21.15.174:3300/0 conn(0x7f262c12b8a0 msgr2=0x7f262c13e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:30.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2630da4700 1 --2- 172.21.15.80:0/1202934983 >> v2:172.21.15.174:3300/0 conn(0x7f262c12b8a0 0x7f262c13e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:30.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2630da4700 1 -- 172.21.15.80:0/1202934983 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c10a8c0 con 0x7f262c13e860 2019-11-28T11:25:30.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2630da4700 1 --2- 172.21.15.80:0/1202934983 >> v2:172.21.15.80:3300/0 conn(0x7f262c13e860 0x7f262c12a3c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26240107a0 tx=0x7f2624010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2630da4700 1 --2- 172.21.15.80:0/1202934983 >> v2:172.21.15.80:3300/0 conn(0x7f262c13e860 0x7f262c12a3c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26240107a0 tx=0x7f2624010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2630da4700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c13e860 0x7f262c12a3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f26240107a0 tx=0x7f2624010680).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:30.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2630da4700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c13e860 0x7f262c12a3c0 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f26240107a0 tx=0x7f2624010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2630da4700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c13e860 0x7f262c12a3c0 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f26240107a0 tx=0x7f2624010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f26297fa700 1 -- 172.21.15.80:0/1202934983 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2624005ab0 con 0x7f262c13e860 2019-11-28T11:25:30.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2630da4700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c13e860 0x7f262c12a3c0 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f26240107a0 tx=0x7f2624010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f26297fa700 1 -- 172.21.15.80:0/1202934983 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26240056d0 con 0x7f262c13e860 2019-11-28T11:25:30.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2632006700 1 -- 172.21.15.80:0/1202934983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262c10a8c0 con 0x7f262c13e860 2019-11-28T11:25:30.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f26297fa700 1 -- 172.21.15.80:0/1202934983 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2624006090 con 0x7f262c13e860 2019-11-28T11:25:30.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.791+0000 7f2632006700 1 -- 172.21.15.80:0/1202934983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262c10a8c0 con 0x7f262c13e860 2019-11-28T11:25:30.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.792+0000 7f2630da4700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c13e860 0x7f262c12a3c0 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f26240107a0 tx=0x7f2624010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.792+0000 7f26297fa700 1 -- 172.21.15.80:0/1202934983 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f26240058c0 con 0x7f262c13e860 2019-11-28T11:25:30.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.792+0000 7f2630da4700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c13e860 0x7f262c12a3c0 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f26240107a0 tx=0x7f2624010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.792+0000 7f26297fa700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2610018730 0x7f261001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.792+0000 7f26297fa700 1 -- 172.21.15.80:0/1202934983 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2624031d80 con 0x7f262c13e860 2019-11-28T11:25:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.792+0000 7f262bfff700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2610018730 0x7f261001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.792+0000 7f262bfff700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2610018730 0x7f261001abc0 crc :-1 s=READY pgs=80 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.800+0000 7f2632006700 1 -- 172.21.15.80:0/1202934983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262c109180 con 0x7f262c13e860 2019-11-28T11:25:30.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.804+0000 7f2630da4700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c13e860 0x7f262c12a3c0 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f26240107a0 tx=0x7f2624010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:30.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.804+0000 7f26297fa700 1 -- 172.21.15.80:0/1202934983 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2624007910 con 0x7f262c13e860 2019-11-28T11:25:30.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.977+0000 7f2632006700 1 -- 172.21.15.80:0/1202934983 --> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f262c10a8c0 con 0x7f2610018730 2019-11-28T11:25:31.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.981+0000 7f26297fa700 1 -- 172.21.15.80:0/1202934983 <== mgr.4100 v2:172.21.15.174:6800/36016 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+80447 (crc 0 0 0) 0x7f261c009ae0 con 0x7f2610018730 2019-11-28T11:25:31.005 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2019-11-28T11:25:31.005 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:31.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.987+0000 7f2632006700 1 -- 172.21.15.80:0/1202934983 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2610018730 msgr2=0x7f261001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.987+0000 7f2632006700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2610018730 0x7f261001abc0 crc :-1 s=READY pgs=80 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.987+0000 7f2632006700 1 -- 172.21.15.80:0/1202934983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c13e860 msgr2=0x7f262c12a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.987+0000 7f2632006700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c13e860 0x7f262c12a3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f26240107a0 tx=0x7f2624010680).stop 2019-11-28T11:25:31.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.987+0000 7f2632006700 1 -- 172.21.15.80:0/1202934983 shutdown_connections 2019-11-28T11:25:31.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.987+0000 7f2632006700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2610018730 0x7f261001abc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.987+0000 7f2632006700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f262c13e860 0x7f262c12a3c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.987+0000 7f2632006700 1 --2- 172.21.15.80:0/1202934983 >> v2:172.21.15.174:3300/0 conn(0x7f262c12b8a0 0x7f262c13e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.987+0000 7f2632006700 1 --2- 172.21.15.80:0/1202934983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f262c15fdf0 0x7f262c12b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.987+0000 7f2632006700 1 -- 172.21.15.80:0/1202934983 shutdown_connections 2019-11-28T11:25:31.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.987+0000 7f2632006700 1 -- 172.21.15.80:0/1202934983 wait complete. 2019-11-28T11:25:31.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:30.987+0000 7f2632006700 1 -- 172.21.15.80:0/1202934983 >> 172.21.15.80:0/1202934983 conn(0x7f262c127dc0 msgr2=0x7f262c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:31.017 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2019-11-28T11:25:30.083877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390760,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583960,"statfs":{"total":773094113280,"available":764501975040,"internally_reserved":8589934592,"allocated":2138112,"data_stored":810454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000388"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.956938+0000","last_change":"2019-11-28T11:25:13.566811+0000","last_active":"2019-11-28T11:25:19.956938+0000","last_peered":"2019-11-28T11:25:19.956938+0000","last_clean":"2019-11-28T11:25:19.956938+0000","last_became_active":"2019-11-28T11:25:13.566432+0000","last_became_peered":"2019-11-28T11:25:13.566432+0000","last_unstale":"2019-11-28T11:25:19.956938+0000","last_undegraded":"2019-11-28T11:25:19.956938+0000","last_fullsized":"2019-11-28T11:25:19.956938+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_clean_scrub_stamp":"2019-11-28T11:25:12.530624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"25'8","reported_seq":"21","reported_epoch":"25","state":"active+clean","last_fresh":"2019-11-28T11:25:27.550378+0000","last_change":"2019-11-28T11:25:16.583106+0000","last_active":"2019-11-28T11:25:27.550378+0000","last_peered":"2019-11-28T11:25:27.550378+0000","last_clean":"2019-11-28T11:25:27.550378+0000","last_became_active":"2019-11-28T11:25:16.582759+0000","last_became_peered":"2019-11-28T11:25:16.582759+0000","last_unstale":"2019-11-28T11:25:27.550378+0000","last_undegraded":"2019-11-28T11:25:27.550378+0000","last_fullsized":"2019-11-28T11:25:27.550378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_clean_scrub_stamp":"2019-11-28T11:25:15.548474+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.959472+0000","last_change":"2019-11-28T11:25:19.959197+0000","last_active":"2019-11-28T11:25:19.959472+0000","last_peered":"2019-11-28T11:25:19.959472+0000","last_clean":"2019-11-28T11:25:19.959472+0000","last_became_active":"2019-11-28T11:25:19.958653+0000","last_became_peered":"2019-11-28T11:25:19.958653+0000","last_unstale":"2019-11-28T11:25:19.959472+0000","last_undegraded":"2019-11-28T11:25:19.959472+0000","last_fullsized":"2019-11-28T11:25:19.959472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_clean_scrub_stamp":"2019-11-28T11:25:18.557975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.956807+0000","last_change":"2019-11-28T11:25:14.534676+0000","last_active":"2019-11-28T11:25:19.956807+0000","last_peered":"2019-11-28T11:25:19.956807+0000","last_clean":"2019-11-28T11:25:19.956807+0000","last_became_active":"2019-11-28T11:25:14.534361+0000","last_became_peered":"2019-11-28T11:25:14.534361+0000","last_unstale":"2019-11-28T11:25:19.956807+0000","last_undegraded":"2019-11-28T11:25:19.956807+0000","last_fullsized":"2019-11-28T11:25:19.956807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_clean_scrub_stamp":"2019-11-28T11:25:12.530624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'6","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2019-11-28T11:25:27.572211+0000","last_change":"2019-11-28T11:25:16.603219+0000","last_active":"2019-11-28T11:25:27.572211+0000","last_peered":"2019-11-28T11:25:27.572211+0000","last_clean":"2019-11-28T11:25:27.572211+0000","last_became_active":"2019-11-28T11:25:16.602978+0000","last_became_peered":"2019-11-28T11:25:16.602978+0000","last_unstale":"2019-11-28T11:25:27.572211+0000","last_undegraded":"2019-11-28T11:25:27.572211+0000","last_fullsized":"2019-11-28T11:25:27.572211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_clean_scrub_stamp":"2019-11-28T11:25:15.548474+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.938055+0000","last_change":"2019-11-28T11:25:19.937831+0000","last_active":"2019-11-28T11:25:19.938055+0000","last_peered":"2019-11-28T11:25:19.938055+0000","last_clean":"2019-11-28T11:25:19.938055+0000","last_became_active":"2019-11-28T11:25:19.937451+0000","last_became_peered":"2019-11-28T11:25:19.937451+0000","last_unstale":"2019-11-28T11:25:19.938055+0000","last_undegraded":"2019-11-28T11:25:19.938055+0000","last_fullsized":"2019-11-28T11:25:19.938055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_clean_scrub_stamp":"2019-11-28T11:25:18.557975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:20.067163+0000","last_change":"2019-11-28T11:25:20.066869+0000","last_active":"2019-11-28T11:25:20.067163+0000","last_peered":"2019-11-28T11:25:20.067163+0000","last_clean":"2019-11-28T11:25:20.067163+0000","last_became_active":"2019-11-28T11:25:20.066277+0000","last_became_peered":"2019-11-28T11:25:20.066277+0000","last_unstale":"2019-11-28T11:25:20.067163+0000","last_undegraded":"2019-11-28T11:25:20.067163+0000","last_fullsized":"2019-11-28T11:25:20.067163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_clean_scrub_stamp":"2019-11-28T11:25:18.557975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:20.083818+0000","last_change":"2019-11-28T11:25:14.517290+0000","last_active":"2019-11-28T11:25:20.083818+0000","last_peered":"2019-11-28T11:25:20.083818+0000","last_clean":"2019-11-28T11:25:20.083818+0000","last_became_active":"2019-11-28T11:25:14.516896+0000","last_became_peered":"2019-11-28T11:25:14.516896+0000","last_unstale":"2019-11-28T11:25:20.083818+0000","last_undegraded":"2019-11-28T11:25:20.083818+0000","last_fullsized":"2019-11-28T11:25:20.083818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_clean_scrub_stamp":"2019-11-28T11:25:12.530624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2019-11-28T11:25:27.548556+0000","last_change":"2019-11-28T11:25:16.561718+0000","last_active":"2019-11-28T11:25:27.548556+0000","last_peered":"2019-11-28T11:25:27.548556+0000","last_clean":"2019-11-28T11:25:27.548556+0000","last_became_active":"2019-11-28T11:25:16.561371+0000","last_became_peered":"2019-11-28T11:25:16.561371+0000","last_unstale":"2019-11-28T11:25:27.548556+0000","last_undegraded":"2019-11-28T11:25:27.548556+0000","last_fullsized":"2019-11-28T11:25:27.548556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_clean_scrub_stamp":"2019-11-28T11:25:15.548474+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:20.067084+0000","last_change":"2019-11-28T11:25:20.066835+0000","last_active":"2019-11-28T11:25:20.067084+0000","last_peered":"2019-11-28T11:25:20.067084+0000","last_clean":"2019-11-28T11:25:20.067084+0000","last_became_active":"2019-11-28T11:25:20.066394+0000","last_became_peered":"2019-11-28T11:25:20.066394+0000","last_unstale":"2019-11-28T11:25:20.067084+0000","last_undegraded":"2019-11-28T11:25:20.067084+0000","last_fullsized":"2019-11-28T11:25:20.067084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_clean_scrub_stamp":"2019-11-28T11:25:18.557975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.934528+0000","last_change":"2019-11-28T11:25:13.546558+0000","last_active":"2019-11-28T11:25:19.934528+0000","last_peered":"2019-11-28T11:25:19.934528+0000","last_clean":"2019-11-28T11:25:19.934528+0000","last_became_active":"2019-11-28T11:25:13.546104+0000","last_became_peered":"2019-11-28T11:25:13.546104+0000","last_unstale":"2019-11-28T11:25:19.934528+0000","last_undegraded":"2019-11-28T11:25:19.934528+0000","last_fullsized":"2019-11-28T11:25:19.934528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_clean_scrub_stamp":"2019-11-28T11:25:12.530624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"25'7","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2019-11-28T11:25:27.571745+0000","last_change":"2019-11-28T11:25:16.584053+0000","last_active":"2019-11-28T11:25:27.571745+0000","last_peered":"2019-11-28T11:25:27.571745+0000","last_clean":"2019-11-28T11:25:27.571745+0000","last_became_active":"2019-11-28T11:25:16.583635+0000","last_became_peered":"2019-11-28T11:25:16.583635+0000","last_unstale":"2019-11-28T11:25:27.571745+0000","last_undegraded":"2019-11-28T11:25:27.571745+0000","last_fullsized":"2019-11-28T11:25:27.571745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_clean_scrub_stamp":"2019-11-28T11:25:15.548474+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:20.084627+0000","last_change":"2019-11-28T11:25:14.534916+0000","last_active":"2019-11-28T11:25:20.084627+0000","last_peered":"2019-11-28T11:25:20.084627+0000","last_clean":"2019-11-28T11:25:20.084627+0000","last_became_active":"2019-11-28T11:25:14.534426+0000","last_became_peered":"2019-11-28T11:25:14.534426+0000","last_unstale":"2019-11-28T11:25:20.084627+0000","last_undegraded":"2019-11-28T11:25:20.084627+0000","last_fullsized":"2019-11-28T11:25:20.084627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_clean_scrub_stamp":"2019-11-28T11:25:12.530624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'5","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2019-11-28T11:25:27.570232+0000","last_change":"2019-11-28T11:25:16.583159+0000","last_active":"2019-11-28T11:25:27.570232+0000","last_peered":"2019-11-28T11:25:27.570232+0000","last_clean":"2019-11-28T11:25:27.570232+0000","last_became_active":"2019-11-28T11:25:16.582849+0000","last_became_peered":"2019-11-28T11:25:16.582849+0000","last_unstale":"2019-11-28T11:25:27.570232+0000","last_undegraded":"2019-11-28T11:25:27.570232+0000","last_fullsized":"2019-11-28T11:25:27.570232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_clean_scrub_stamp":"2019-11-28T11:25:15.548474+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.934424+0000","last_change":"2019-11-28T11:25:19.568882+0000","last_active":"2019-11-28T11:25:19.934424+0000","last_peered":"2019-11-28T11:25:19.934424+0000","last_clean":"2019-11-28T11:25:19.934424+0000","last_became_active":"2019-11-28T11:25:19.568455+0000","last_became_peered":"2019-11-28T11:25:19.568455+0000","last_unstale":"2019-11-28T11:25:19.934424+0000","last_undegraded":"2019-11-28T11:25:19.934424+0000","last_fullsized":"2019-11-28T11:25:19.934424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_clean_scrub_stamp":"2019-11-28T11:25:18.557975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.958224+0000","last_change":"2019-11-28T11:25:14.534760+0000","last_active":"2019-11-28T11:25:19.958224+0000","last_peered":"2019-11-28T11:25:19.958224+0000","last_clean":"2019-11-28T11:25:19.958224+0000","last_became_active":"2019-11-28T11:25:14.534360+0000","last_became_peered":"2019-11-28T11:25:14.534360+0000","last_unstale":"2019-11-28T11:25:19.958224+0000","last_undegraded":"2019-11-28T11:25:19.958224+0000","last_fullsized":"2019-11-28T11:25:19.958224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_clean_scrub_stamp":"2019-11-28T11:25:12.530624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2019-11-28T11:25:20.962509+0000","last_change":"2019-11-28T11:25:16.582727+0000","last_active":"2019-11-28T11:25:20.962509+0000","last_peered":"2019-11-28T11:25:20.962509+0000","last_clean":"2019-11-28T11:25:20.962509+0000","last_became_active":"2019-11-28T11:25:16.582457+0000","last_became_peered":"2019-11-28T11:25:16.582457+0000","last_unstale":"2019-11-28T11:25:20.962509+0000","last_undegraded":"2019-11-28T11:25:20.962509+0000","last_fullsized":"2019-11-28T11:25:20.962509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_clean_scrub_stamp":"2019-11-28T11:25:15.548474+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:20.083838+0000","last_change":"2019-11-28T11:25:19.589148+0000","last_active":"2019-11-28T11:25:20.083838+0000","last_peered":"2019-11-28T11:25:20.083838+0000","last_clean":"2019-11-28T11:25:20.083838+0000","last_became_active":"2019-11-28T11:25:19.588612+0000","last_became_peered":"2019-11-28T11:25:19.588612+0000","last_unstale":"2019-11-28T11:25:20.083838+0000","last_undegraded":"2019-11-28T11:25:20.083838+0000","last_fullsized":"2019-11-28T11:25:20.083838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_clean_scrub_stamp":"2019-11-28T11:25:18.557975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.935923+0000","last_change":"2019-11-28T11:25:16.582994+0000","last_active":"2019-11-28T11:25:19.935923+0000","last_peered":"2019-11-28T11:25:19.935923+0000","last_clean":"2019-11-28T11:25:19.935923+0000","last_became_active":"2019-11-28T11:25:16.582601+0000","last_became_peered":"2019-11-28T11:25:16.582601+0000","last_unstale":"2019-11-28T11:25:19.935923+0000","last_undegraded":"2019-11-28T11:25:19.935923+0000","last_fullsized":"2019-11-28T11:25:19.935923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_clean_scrub_stamp":"2019-11-28T11:25:15.548474+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:20.084454+0000","last_change":"2019-11-28T11:25:14.535172+0000","last_active":"2019-11-28T11:25:20.084454+0000","last_peered":"2019-11-28T11:25:20.084454+0000","last_clean":"2019-11-28T11:25:20.084454+0000","last_became_active":"2019-11-28T11:25:14.534758+0000","last_became_peered":"2019-11-28T11:25:14.534758+0000","last_unstale":"2019-11-28T11:25:20.084454+0000","last_undegraded":"2019-11-28T11:25:20.084454+0000","last_fullsized":"2019-11-28T11:25:20.084454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_clean_scrub_stamp":"2019-11-28T11:25:12.530624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.938164+0000","last_change":"2019-11-28T11:25:19.937866+0000","last_active":"2019-11-28T11:25:19.938164+0000","last_peered":"2019-11-28T11:25:19.938164+0000","last_clean":"2019-11-28T11:25:19.938164+0000","last_became_active":"2019-11-28T11:25:19.937431+0000","last_became_peered":"2019-11-28T11:25:19.937431+0000","last_unstale":"2019-11-28T11:25:19.938164+0000","last_undegraded":"2019-11-28T11:25:19.938164+0000","last_fullsized":"2019-11-28T11:25:19.938164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_clean_scrub_stamp":"2019-11-28T11:25:18.557975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"25'8","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2019-11-28T11:25:27.573251+0000","last_change":"2019-11-28T11:25:16.583630+0000","last_active":"2019-11-28T11:25:27.573251+0000","last_peered":"2019-11-28T11:25:27.573251+0000","last_clean":"2019-11-28T11:25:27.573251+0000","last_became_active":"2019-11-28T11:25:16.583342+0000","last_became_peered":"2019-11-28T11:25:16.583342+0000","last_unstale":"2019-11-28T11:25:27.573251+0000","last_undegraded":"2019-11-28T11:25:27.573251+0000","last_fullsized":"2019-11-28T11:25:27.573251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_clean_scrub_stamp":"2019-11-28T11:25:15.548474+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.937161+0000","last_change":"2019-11-28T11:25:13.546443+0000","last_active":"2019-11-28T11:25:19.937161+0000","last_peered":"2019-11-28T11:25:19.937161+0000","last_clean":"2019-11-28T11:25:19.937161+0000","last_became_active":"2019-11-28T11:25:13.546118+0000","last_became_peered":"2019-11-28T11:25:13.546118+0000","last_unstale":"2019-11-28T11:25:19.937161+0000","last_undegraded":"2019-11-28T11:25:19.937161+0000","last_fullsized":"2019-11-28T11:25:19.937161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_clean_scrub_stamp":"2019-11-28T11:25:12.530624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:20.063616+0000","last_change":"2019-11-28T11:25:19.568692+0000","last_active":"2019-11-28T11:25:20.063616+0000","last_peered":"2019-11-28T11:25:20.063616+0000","last_clean":"2019-11-28T11:25:20.063616+0000","last_became_active":"2019-11-28T11:25:19.568364+0000","last_became_peered":"2019-11-28T11:25:19.568364+0000","last_unstale":"2019-11-28T11:25:20.063616+0000","last_undegraded":"2019-11-28T11:25:20.063616+0000","last_fullsized":"2019-11-28T11:25:20.063616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_clean_scrub_stamp":"2019-11-28T11:25:18.557975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":101236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.196}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.344}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.567}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.599}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.432}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":101236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.399}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.417}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.356}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.475}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.279}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.386}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.433}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":101802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.302}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.336}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.349}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.394}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.235}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.318}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.420}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":101236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.212}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.359}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.303}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.419}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.390}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.314}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.436}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":101236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.226}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.239}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.285}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.369}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.407}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.353}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":101236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.212}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.273}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.351}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.439}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.459}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.493}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":101236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.268}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.361}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.253}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.322}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.387}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.473}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":101236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.250}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.383}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.403}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.390}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.263}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.322}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.363}]}]}]}} 2019-11-28T11:25:31.021 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-11-28T11:25:31.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.120+0000 7f6af0f18700 1 Processor -- start 2019-11-28T11:25:31.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.120+0000 7f6af0f18700 1 -- start start 2019-11-28T11:25:31.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.121+0000 7f6af0f18700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6aec06c0a0 0x7f6aec072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:31.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.121+0000 7f6af0f18700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aec072620 0x7f6aec164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:31.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.121+0000 7f6af0f18700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec06db00 con 0x7f6aec0734e0 2019-11-28T11:25:31.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.121+0000 7f6af0f18700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec06fd60 con 0x7f6aec06c0a0 2019-11-28T11:25:31.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.121+0000 7f6af0f18700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec070030 con 0x7f6aec072620 2019-11-28T11:25:31.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.121+0000 7f6aead9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6aec06c0a0 0x7f6aec072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.121+0000 7f6aead9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6aec06c0a0 0x7f6aec072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59576/0 (socket says 172.21.15.80:59576) 2019-11-28T11:25:31.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.121+0000 7f6aead9d700 1 -- 172.21.15.80:0/2905576103 learned_addr learned my addr 172.21.15.80:0/2905576103 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:31.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.121+0000 7f6aeb59e700 1 --2- 172.21.15.80:0/2905576103 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aec072620 0x7f6aec164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.122+0000 7f6aead9d700 1 -- 172.21.15.80:0/2905576103 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aec072620 msgr2=0x7f6aec164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:31.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.122+0000 7f6aead9d700 1 --2- 172.21.15.80:0/2905576103 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aec072620 0x7f6aec164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:31.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.122+0000 7f6aead9d700 1 -- 172.21.15.80:0/2905576103 >> v1:172.21.15.174:6789/0 conn(0x7f6aec0734e0 legacy=0x7f6aec071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:31.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.122+0000 7f6aead9d700 1 -- 172.21.15.80:0/2905576103 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec0706c0 con 0x7f6aec06c0a0 2019-11-28T11:25:31.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.122+0000 7f6aeb59e700 1 --2- 172.21.15.80:0/2905576103 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aec072620 0x7f6aec164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:25:31.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.122+0000 7f6aead9d700 1 --2- 172.21.15.80:0/2905576103 >> v2:172.21.15.80:3300/0 conn(0x7f6aec06c0a0 0x7f6aec072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ae400f740 tx=0x7f6ae400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.122+0000 7f6aead9d700 1 --2- 172.21.15.80:0/2905576103 >> v2:172.21.15.80:3300/0 conn(0x7f6aec06c0a0 0x7f6aec072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ae400f740 tx=0x7f6ae400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.122+0000 7f6aead9d700 1 --2- 172.21.15.80:0/2905576103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec06c0a0 0x7f6aec072fa0 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f6ae400f740 tx=0x7f6ae400fae0).ready entity=mon.0 client_cookie=3f2ab4a49cc96aca server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:31.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.122+0000 7f6aead9d700 1 --2- 172.21.15.80:0/2905576103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec06c0a0 0x7f6aec072fa0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f6ae400f740 tx=0x7f6ae400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.122+0000 7f6aead9d700 1 --2- 172.21.15.80:0/2905576103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec06c0a0 0x7f6aec072fa0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f6ae400f740 tx=0x7f6ae400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.122+0000 7f6ae9d9b700 1 -- 172.21.15.80:0/2905576103 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ae4000960 con 0x7f6aec06c0a0 2019-11-28T11:25:31.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.122+0000 7f6aead9d700 1 --2- 172.21.15.80:0/2905576103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec06c0a0 0x7f6aec072fa0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f6ae400f740 tx=0x7f6ae400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.122+0000 7f6ae9d9b700 1 -- 172.21.15.80:0/2905576103 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae4000c90 con 0x7f6aec06c0a0 2019-11-28T11:25:31.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.122+0000 7f6ae9d9b700 1 -- 172.21.15.80:0/2905576103 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ae40013a0 con 0x7f6aec06c0a0 2019-11-28T11:25:31.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.122+0000 7f6af0f18700 1 -- 172.21.15.80:0/2905576103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec06c0a0 msgr2=0x7f6aec072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.122+0000 7f6af0f18700 1 --2- 172.21.15.80:0/2905576103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec06c0a0 0x7f6aec072fa0 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f6ae400f740 tx=0x7f6ae400fae0).stop 2019-11-28T11:25:31.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.123+0000 7f6af0f18700 1 -- 172.21.15.80:0/2905576103 shutdown_connections 2019-11-28T11:25:31.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.123+0000 7f6af0f18700 1 --2- 172.21.15.80:0/2905576103 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aec072620 0x7f6aec164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:31.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.123+0000 7f6af0f18700 1 --2- 172.21.15.80:0/2905576103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec06c0a0 0x7f6aec072fa0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.123+0000 7f6af0f18700 1 -- 172.21.15.80:0/2905576103 shutdown_connections 2019-11-28T11:25:31.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.123+0000 7f6af0f18700 1 -- 172.21.15.80:0/2905576103 wait complete. 2019-11-28T11:25:31.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.123+0000 7f6af0f18700 1 -- 172.21.15.80:0/2905576103 >> 172.21.15.80:0/2905576103 conn(0x7f6aec061cf0 msgr2=0x7f6aec064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:31.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.125+0000 7f6af0f18700 1 Processor -- start 2019-11-28T11:25:31.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.125+0000 7f6af0f18700 1 -- start start 2019-11-28T11:25:31.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.126+0000 7f6af0f18700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6aec104c10 0x7f6aec1050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:31.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.126+0000 7f6af0f18700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6aec1055e0 0x7f6aec167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:31.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.126+0000 7f6af0f18700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec13bcd0 con 0x7f6aec104820 2019-11-28T11:25:31.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.126+0000 7f6af0f18700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec109130 con 0x7f6aec1055e0 2019-11-28T11:25:31.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.126+0000 7f6af0f18700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec109400 con 0x7f6aec104c10 2019-11-28T11:25:31.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.126+0000 7f6aead9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6aec104820 0x7f6aec10c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58898/0 (socket says 172.21.15.80:58898) 2019-11-28T11:25:31.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.126+0000 7f6aead9d700 1 -- 172.21.15.80:0/338970652 learned_addr learned my addr 172.21.15.80:0/338970652 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:31.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.126+0000 7f6aeb59e700 1 --2- 172.21.15.80:0/338970652 >> v2:172.21.15.80:3300/0 conn(0x7f6aec1055e0 0x7f6aec167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.126+0000 7f6ae37fe700 1 -- 172.21.15.80:0/338970652 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964963233 0 0) 0x7f6ae4007e10 con 0x7f6aec104820 2019-11-28T11:25:31.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.126+0000 7f6ae37fe700 1 -- 172.21.15.80:0/338970652 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac4002e80 con 0x7f6aec104820 2019-11-28T11:25:31.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.126+0000 7f6aea59c700 1 --2- 172.21.15.80:0/338970652 >> v2:172.21.15.174:3300/0 conn(0x7f6aec104c10 0x7f6aec1050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.126+0000 7f6aeb59e700 1 -- 172.21.15.80:0/338970652 >> v2:172.21.15.174:3300/0 conn(0x7f6aec104c10 msgr2=0x7f6aec1050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.126+0000 7f6aeb59e700 1 --2- 172.21.15.80:0/338970652 >> v2:172.21.15.174:3300/0 conn(0x7f6aec104c10 0x7f6aec1050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.126+0000 7f6aeb59e700 1 -- 172.21.15.80:0/338970652 >> v1:172.21.15.80:6789/0 conn(0x7f6aec104820 legacy=0x7f6aec10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.126+0000 7f6aeb59e700 1 -- 172.21.15.80:0/338970652 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec109a90 con 0x7f6aec1055e0 2019-11-28T11:25:31.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.127+0000 7f6aeb59e700 1 --2- 172.21.15.80:0/338970652 >> v2:172.21.15.80:3300/0 conn(0x7f6aec1055e0 0x7f6aec167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6adc0103b0 tx=0x7f6adc00b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.127+0000 7f6aeb59e700 1 --2- 172.21.15.80:0/338970652 >> v2:172.21.15.80:3300/0 conn(0x7f6aec1055e0 0x7f6aec167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6adc0103b0 tx=0x7f6adc00b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.127+0000 7f6aeb59e700 1 --2- 172.21.15.80:0/338970652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec1055e0 0x7f6aec167a10 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f6adc0103b0 tx=0x7f6adc00b390).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:31.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.127+0000 7f6aeb59e700 1 --2- 172.21.15.80:0/338970652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec1055e0 0x7f6aec167a10 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f6adc0103b0 tx=0x7f6adc00b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.127+0000 7f6ae37fe700 1 -- 172.21.15.80:0/338970652 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6adc00bf80 con 0x7f6aec1055e0 2019-11-28T11:25:31.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.127+0000 7f6aeb59e700 1 --2- 172.21.15.80:0/338970652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec1055e0 0x7f6aec167a10 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f6adc0103b0 tx=0x7f6adc00b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.127+0000 7f6aeb59e700 1 --2- 172.21.15.80:0/338970652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec1055e0 0x7f6aec167a10 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f6adc0103b0 tx=0x7f6adc00b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.127+0000 7f6ae37fe700 1 -- 172.21.15.80:0/338970652 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6adc00bba0 con 0x7f6aec1055e0 2019-11-28T11:25:31.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.127+0000 7f6ae37fe700 1 -- 172.21.15.80:0/338970652 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6adc00c560 con 0x7f6aec1055e0 2019-11-28T11:25:31.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.127+0000 7f6af0f18700 1 -- 172.21.15.80:0/338970652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec109e10 con 0x7f6aec1055e0 2019-11-28T11:25:31.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.127+0000 7f6af0f18700 1 -- 172.21.15.80:0/338970652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec109a90 con 0x7f6aec1055e0 2019-11-28T11:25:31.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.127+0000 7f6aeb59e700 1 --2- 172.21.15.80:0/338970652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec1055e0 0x7f6aec167a10 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f6adc0103b0 tx=0x7f6adc00b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.127+0000 7f6ae37fe700 1 -- 172.21.15.80:0/338970652 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6adc00bd90 con 0x7f6aec1055e0 2019-11-28T11:25:31.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.127+0000 7f6aeb59e700 1 --2- 172.21.15.80:0/338970652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec1055e0 0x7f6aec167a10 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f6adc0103b0 tx=0x7f6adc00b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.128+0000 7f6ae37fe700 1 --2- 172.21.15.80:0/338970652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ac4018770 0x7f6ac401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:31.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.128+0000 7f6ae37fe700 1 -- 172.21.15.80:0/338970652 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f6adc031a10 con 0x7f6aec1055e0 2019-11-28T11:25:31.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.128+0000 7f6aead9d700 1 --2- 172.21.15.80:0/338970652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ac4018770 0x7f6ac401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.128+0000 7f6aead9d700 1 --2- 172.21.15.80:0/338970652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ac4018770 0x7f6ac401abe0 crc :-1 s=READY pgs=81 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:31.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.135+0000 7f6af0f18700 1 -- 172.21.15.80:0/338970652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aec109e10 con 0x7f6aec1055e0 2019-11-28T11:25:31.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.139+0000 7f6aeb59e700 1 --2- 172.21.15.80:0/338970652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec1055e0 0x7f6aec167a10 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f6adc0103b0 tx=0x7f6adc00b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.139+0000 7f6ae37fe700 1 -- 172.21.15.80:0/338970652 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6adc00b990 con 0x7f6aec1055e0 2019-11-28T11:25:31.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.313+0000 7f6af0f18700 1 -- 172.21.15.80:0/338970652 --> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6aec105a80 con 0x7f6ac4018770 2019-11-28T11:25:31.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.316+0000 7f6ae37fe700 1 -- 172.21.15.80:0/338970652 <== mgr.4100 v2:172.21.15.174:6800/36016 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+80447 (crc 0 0 0) 0x7f6ae4002a20 con 0x7f6ac4018770 2019-11-28T11:25:31.341 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2019-11-28T11:25:31.342 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:31.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.322+0000 7f6af0f18700 1 -- 172.21.15.80:0/338970652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ac4018770 msgr2=0x7f6ac401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.322+0000 7f6af0f18700 1 --2- 172.21.15.80:0/338970652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ac4018770 0x7f6ac401abe0 crc :-1 s=READY pgs=81 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.322+0000 7f6af0f18700 1 -- 172.21.15.80:0/338970652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec1055e0 msgr2=0x7f6aec167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.322+0000 7f6af0f18700 1 --2- 172.21.15.80:0/338970652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec1055e0 0x7f6aec167a10 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f6adc0103b0 tx=0x7f6adc00b390).stop 2019-11-28T11:25:31.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.322+0000 7f6af0f18700 1 -- 172.21.15.80:0/338970652 shutdown_connections 2019-11-28T11:25:31.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.322+0000 7f6af0f18700 1 --2- 172.21.15.80:0/338970652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ac4018770 0x7f6ac401abe0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.322+0000 7f6af0f18700 1 --2- 172.21.15.80:0/338970652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6aec1055e0 0x7f6aec167a10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.322+0000 7f6af0f18700 1 --2- 172.21.15.80:0/338970652 >> v2:172.21.15.174:3300/0 conn(0x7f6aec104c10 0x7f6aec1050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.323+0000 7f6af0f18700 1 -- 172.21.15.80:0/338970652 shutdown_connections 2019-11-28T11:25:31.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.323+0000 7f6af0f18700 1 -- 172.21.15.80:0/338970652 wait complete. 2019-11-28T11:25:31.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.323+0000 7f6af0f18700 1 -- 172.21.15.80:0/338970652 >> 172.21.15.80:0/338970652 conn(0x7f6aec13d620 msgr2=0x7f6aec13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:31.353 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2019-11-28T11:25:30.083877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390760,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583960,"statfs":{"total":773094113280,"available":764501975040,"internally_reserved":8589934592,"allocated":2138112,"data_stored":810454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000388"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.956938+0000","last_change":"2019-11-28T11:25:13.566811+0000","last_active":"2019-11-28T11:25:19.956938+0000","last_peered":"2019-11-28T11:25:19.956938+0000","last_clean":"2019-11-28T11:25:19.956938+0000","last_became_active":"2019-11-28T11:25:13.566432+0000","last_became_peered":"2019-11-28T11:25:13.566432+0000","last_unstale":"2019-11-28T11:25:19.956938+0000","last_undegraded":"2019-11-28T11:25:19.956938+0000","last_fullsized":"2019-11-28T11:25:19.956938+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_clean_scrub_stamp":"2019-11-28T11:25:12.530624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"25'8","reported_seq":"21","reported_epoch":"25","state":"active+clean","last_fresh":"2019-11-28T11:25:27.550378+0000","last_change":"2019-11-28T11:25:16.583106+0000","last_active":"2019-11-28T11:25:27.550378+0000","last_peered":"2019-11-28T11:25:27.550378+0000","last_clean":"2019-11-28T11:25:27.550378+0000","last_became_active":"2019-11-28T11:25:16.582759+0000","last_became_peered":"2019-11-28T11:25:16.582759+0000","last_unstale":"2019-11-28T11:25:27.550378+0000","last_undegraded":"2019-11-28T11:25:27.550378+0000","last_fullsized":"2019-11-28T11:25:27.550378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_clean_scrub_stamp":"2019-11-28T11:25:15.548474+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.959472+0000","last_change":"2019-11-28T11:25:19.959197+0000","last_active":"2019-11-28T11:25:19.959472+0000","last_peered":"2019-11-28T11:25:19.959472+0000","last_clean":"2019-11-28T11:25:19.959472+0000","last_became_active":"2019-11-28T11:25:19.958653+0000","last_became_peered":"2019-11-28T11:25:19.958653+0000","last_unstale":"2019-11-28T11:25:19.959472+0000","last_undegraded":"2019-11-28T11:25:19.959472+0000","last_fullsized":"2019-11-28T11:25:19.959472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_clean_scrub_stamp":"2019-11-28T11:25:18.557975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.956807+0000","last_change":"2019-11-28T11:25:14.534676+0000","last_active":"2019-11-28T11:25:19.956807+0000","last_peered":"2019-11-28T11:25:19.956807+0000","last_clean":"2019-11-28T11:25:19.956807+0000","last_became_active":"2019-11-28T11:25:14.534361+0000","last_became_peered":"2019-11-28T11:25:14.534361+0000","last_unstale":"2019-11-28T11:25:19.956807+0000","last_undegraded":"2019-11-28T11:25:19.956807+0000","last_fullsized":"2019-11-28T11:25:19.956807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_clean_scrub_stamp":"2019-11-28T11:25:12.530624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'6","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2019-11-28T11:25:27.572211+0000","last_change":"2019-11-28T11:25:16.603219+0000","last_active":"2019-11-28T11:25:27.572211+0000","last_peered":"2019-11-28T11:25:27.572211+0000","last_clean":"2019-11-28T11:25:27.572211+0000","last_became_active":"2019-11-28T11:25:16.602978+0000","last_became_peered":"2019-11-28T11:25:16.602978+0000","last_unstale":"2019-11-28T11:25:27.572211+0000","last_undegraded":"2019-11-28T11:25:27.572211+0000","last_fullsized":"2019-11-28T11:25:27.572211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_clean_scrub_stamp":"2019-11-28T11:25:15.548474+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.938055+0000","last_change":"2019-11-28T11:25:19.937831+0000","last_active":"2019-11-28T11:25:19.938055+0000","last_peered":"2019-11-28T11:25:19.938055+0000","last_clean":"2019-11-28T11:25:19.938055+0000","last_became_active":"2019-11-28T11:25:19.937451+0000","last_became_peered":"2019-11-28T11:25:19.937451+0000","last_unstale":"2019-11-28T11:25:19.938055+0000","last_undegraded":"2019-11-28T11:25:19.938055+0000","last_fullsized":"2019-11-28T11:25:19.938055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_clean_scrub_stamp":"2019-11-28T11:25:18.557975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:20.067163+0000","last_change":"2019-11-28T11:25:20.066869+0000","last_active":"2019-11-28T11:25:20.067163+0000","last_peered":"2019-11-28T11:25:20.067163+0000","last_clean":"2019-11-28T11:25:20.067163+0000","last_became_active":"2019-11-28T11:25:20.066277+0000","last_became_peered":"2019-11-28T11:25:20.066277+0000","last_unstale":"2019-11-28T11:25:20.067163+0000","last_undegraded":"2019-11-28T11:25:20.067163+0000","last_fullsized":"2019-11-28T11:25:20.067163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_clean_scrub_stamp":"2019-11-28T11:25:18.557975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:20.083818+0000","last_change":"2019-11-28T11:25:14.517290+0000","last_active":"2019-11-28T11:25:20.083818+0000","last_peered":"2019-11-28T11:25:20.083818+0000","last_clean":"2019-11-28T11:25:20.083818+0000","last_became_active":"2019-11-28T11:25:14.516896+0000","last_became_peered":"2019-11-28T11:25:14.516896+0000","last_unstale":"2019-11-28T11:25:20.083818+0000","last_undegraded":"2019-11-28T11:25:20.083818+0000","last_fullsized":"2019-11-28T11:25:20.083818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_clean_scrub_stamp":"2019-11-28T11:25:12.530624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2019-11-28T11:25:27.548556+0000","last_change":"2019-11-28T11:25:16.561718+0000","last_active":"2019-11-28T11:25:27.548556+0000","last_peered":"2019-11-28T11:25:27.548556+0000","last_clean":"2019-11-28T11:25:27.548556+0000","last_became_active":"2019-11-28T11:25:16.561371+0000","last_became_peered":"2019-11-28T11:25:16.561371+0000","last_unstale":"2019-11-28T11:25:27.548556+0000","last_undegraded":"2019-11-28T11:25:27.548556+0000","last_fullsized":"2019-11-28T11:25:27.548556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_clean_scrub_stamp":"2019-11-28T11:25:15.548474+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:20.067084+0000","last_change":"2019-11-28T11:25:20.066835+0000","last_active":"2019-11-28T11:25:20.067084+0000","last_peered":"2019-11-28T11:25:20.067084+0000","last_clean":"2019-11-28T11:25:20.067084+0000","last_became_active":"2019-11-28T11:25:20.066394+0000","last_became_peered":"2019-11-28T11:25:20.066394+0000","last_unstale":"2019-11-28T11:25:20.067084+0000","last_undegraded":"2019-11-28T11:25:20.067084+0000","last_fullsized":"2019-11-28T11:25:20.067084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_clean_scrub_stamp":"2019-11-28T11:25:18.557975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.934528+0000","last_change":"2019-11-28T11:25:13.546558+0000","last_active":"2019-11-28T11:25:19.934528+0000","last_peered":"2019-11-28T11:25:19.934528+0000","last_clean":"2019-11-28T11:25:19.934528+0000","last_became_active":"2019-11-28T11:25:13.546104+0000","last_became_peered":"2019-11-28T11:25:13.546104+0000","last_unstale":"2019-11-28T11:25:19.934528+0000","last_undegraded":"2019-11-28T11:25:19.934528+0000","last_fullsized":"2019-11-28T11:25:19.934528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_clean_scrub_stamp":"2019-11-28T11:25:12.530624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"25'7","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2019-11-28T11:25:27.571745+0000","last_change":"2019-11-28T11:25:16.584053+0000","last_active":"2019-11-28T11:25:27.571745+0000","last_peered":"2019-11-28T11:25:27.571745+0000","last_clean":"2019-11-28T11:25:27.571745+0000","last_became_active":"2019-11-28T11:25:16.583635+0000","last_became_peered":"2019-11-28T11:25:16.583635+0000","last_unstale":"2019-11-28T11:25:27.571745+0000","last_undegraded":"2019-11-28T11:25:27.571745+0000","last_fullsized":"2019-11-28T11:25:27.571745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_clean_scrub_stamp":"2019-11-28T11:25:15.548474+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:20.084627+0000","last_change":"2019-11-28T11:25:14.534916+0000","last_active":"2019-11-28T11:25:20.084627+0000","last_peered":"2019-11-28T11:25:20.084627+0000","last_clean":"2019-11-28T11:25:20.084627+0000","last_became_active":"2019-11-28T11:25:14.534426+0000","last_became_peered":"2019-11-28T11:25:14.534426+0000","last_unstale":"2019-11-28T11:25:20.084627+0000","last_undegraded":"2019-11-28T11:25:20.084627+0000","last_fullsized":"2019-11-28T11:25:20.084627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_clean_scrub_stamp":"2019-11-28T11:25:12.530624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'5","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2019-11-28T11:25:27.570232+0000","last_change":"2019-11-28T11:25:16.583159+0000","last_active":"2019-11-28T11:25:27.570232+0000","last_peered":"2019-11-28T11:25:27.570232+0000","last_clean":"2019-11-28T11:25:27.570232+0000","last_became_active":"2019-11-28T11:25:16.582849+0000","last_became_peered":"2019-11-28T11:25:16.582849+0000","last_unstale":"2019-11-28T11:25:27.570232+0000","last_undegraded":"2019-11-28T11:25:27.570232+0000","last_fullsized":"2019-11-28T11:25:27.570232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_clean_scrub_stamp":"2019-11-28T11:25:15.548474+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.934424+0000","last_change":"2019-11-28T11:25:19.568882+0000","last_active":"2019-11-28T11:25:19.934424+0000","last_peered":"2019-11-28T11:25:19.934424+0000","last_clean":"2019-11-28T11:25:19.934424+0000","last_became_active":"2019-11-28T11:25:19.568455+0000","last_became_peered":"2019-11-28T11:25:19.568455+0000","last_unstale":"2019-11-28T11:25:19.934424+0000","last_undegraded":"2019-11-28T11:25:19.934424+0000","last_fullsized":"2019-11-28T11:25:19.934424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_clean_scrub_stamp":"2019-11-28T11:25:18.557975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.958224+0000","last_change":"2019-11-28T11:25:14.534760+0000","last_active":"2019-11-28T11:25:19.958224+0000","last_peered":"2019-11-28T11:25:19.958224+0000","last_clean":"2019-11-28T11:25:19.958224+0000","last_became_active":"2019-11-28T11:25:14.534360+0000","last_became_peered":"2019-11-28T11:25:14.534360+0000","last_unstale":"2019-11-28T11:25:19.958224+0000","last_undegraded":"2019-11-28T11:25:19.958224+0000","last_fullsized":"2019-11-28T11:25:19.958224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_clean_scrub_stamp":"2019-11-28T11:25:12.530624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2019-11-28T11:25:20.962509+0000","last_change":"2019-11-28T11:25:16.582727+0000","last_active":"2019-11-28T11:25:20.962509+0000","last_peered":"2019-11-28T11:25:20.962509+0000","last_clean":"2019-11-28T11:25:20.962509+0000","last_became_active":"2019-11-28T11:25:16.582457+0000","last_became_peered":"2019-11-28T11:25:16.582457+0000","last_unstale":"2019-11-28T11:25:20.962509+0000","last_undegraded":"2019-11-28T11:25:20.962509+0000","last_fullsized":"2019-11-28T11:25:20.962509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_clean_scrub_stamp":"2019-11-28T11:25:15.548474+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:20.083838+0000","last_change":"2019-11-28T11:25:19.589148+0000","last_active":"2019-11-28T11:25:20.083838+0000","last_peered":"2019-11-28T11:25:20.083838+0000","last_clean":"2019-11-28T11:25:20.083838+0000","last_became_active":"2019-11-28T11:25:19.588612+0000","last_became_peered":"2019-11-28T11:25:19.588612+0000","last_unstale":"2019-11-28T11:25:20.083838+0000","last_undegraded":"2019-11-28T11:25:20.083838+0000","last_fullsized":"2019-11-28T11:25:20.083838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_clean_scrub_stamp":"2019-11-28T11:25:18.557975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.935923+0000","last_change":"2019-11-28T11:25:16.582994+0000","last_active":"2019-11-28T11:25:19.935923+0000","last_peered":"2019-11-28T11:25:19.935923+0000","last_clean":"2019-11-28T11:25:19.935923+0000","last_became_active":"2019-11-28T11:25:16.582601+0000","last_became_peered":"2019-11-28T11:25:16.582601+0000","last_unstale":"2019-11-28T11:25:19.935923+0000","last_undegraded":"2019-11-28T11:25:19.935923+0000","last_fullsized":"2019-11-28T11:25:19.935923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_clean_scrub_stamp":"2019-11-28T11:25:15.548474+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:20.084454+0000","last_change":"2019-11-28T11:25:14.535172+0000","last_active":"2019-11-28T11:25:20.084454+0000","last_peered":"2019-11-28T11:25:20.084454+0000","last_clean":"2019-11-28T11:25:20.084454+0000","last_became_active":"2019-11-28T11:25:14.534758+0000","last_became_peered":"2019-11-28T11:25:14.534758+0000","last_unstale":"2019-11-28T11:25:20.084454+0000","last_undegraded":"2019-11-28T11:25:20.084454+0000","last_fullsized":"2019-11-28T11:25:20.084454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_clean_scrub_stamp":"2019-11-28T11:25:12.530624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.938164+0000","last_change":"2019-11-28T11:25:19.937866+0000","last_active":"2019-11-28T11:25:19.938164+0000","last_peered":"2019-11-28T11:25:19.938164+0000","last_clean":"2019-11-28T11:25:19.938164+0000","last_became_active":"2019-11-28T11:25:19.937431+0000","last_became_peered":"2019-11-28T11:25:19.937431+0000","last_unstale":"2019-11-28T11:25:19.938164+0000","last_undegraded":"2019-11-28T11:25:19.938164+0000","last_fullsized":"2019-11-28T11:25:19.938164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_clean_scrub_stamp":"2019-11-28T11:25:18.557975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"25'8","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2019-11-28T11:25:27.573251+0000","last_change":"2019-11-28T11:25:16.583630+0000","last_active":"2019-11-28T11:25:27.573251+0000","last_peered":"2019-11-28T11:25:27.573251+0000","last_clean":"2019-11-28T11:25:27.573251+0000","last_became_active":"2019-11-28T11:25:16.583342+0000","last_became_peered":"2019-11-28T11:25:16.583342+0000","last_unstale":"2019-11-28T11:25:27.573251+0000","last_undegraded":"2019-11-28T11:25:27.573251+0000","last_fullsized":"2019-11-28T11:25:27.573251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:15.548474+0000","last_clean_scrub_stamp":"2019-11-28T11:25:15.548474+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:19.937161+0000","last_change":"2019-11-28T11:25:13.546443+0000","last_active":"2019-11-28T11:25:19.937161+0000","last_peered":"2019-11-28T11:25:19.937161+0000","last_clean":"2019-11-28T11:25:19.937161+0000","last_became_active":"2019-11-28T11:25:13.546118+0000","last_became_peered":"2019-11-28T11:25:13.546118+0000","last_unstale":"2019-11-28T11:25:19.937161+0000","last_undegraded":"2019-11-28T11:25:19.937161+0000","last_fullsized":"2019-11-28T11:25:19.937161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:12.530624+0000","last_clean_scrub_stamp":"2019-11-28T11:25:12.530624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-11-28T11:25:20.063616+0000","last_change":"2019-11-28T11:25:19.568692+0000","last_active":"2019-11-28T11:25:20.063616+0000","last_peered":"2019-11-28T11:25:20.063616+0000","last_clean":"2019-11-28T11:25:20.063616+0000","last_became_active":"2019-11-28T11:25:19.568364+0000","last_became_peered":"2019-11-28T11:25:19.568364+0000","last_unstale":"2019-11-28T11:25:20.063616+0000","last_undegraded":"2019-11-28T11:25:20.063616+0000","last_fullsized":"2019-11-28T11:25:20.063616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T11:25:18.557975+0000","last_clean_scrub_stamp":"2019-11-28T11:25:18.557975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":101236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.196}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.344}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.567}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.599}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.432}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":101236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.399}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.417}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.356}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.475}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.279}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.386}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.433}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":101802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.302}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.336}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.349}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.394}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.235}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.318}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.420}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":101236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.212}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.359}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.303}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.419}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.390}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.314}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.436}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":101236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.226}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.239}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.285}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.369}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.407}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.353}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":101236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.212}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.273}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.351}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.439}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.459}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.493}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":101236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.268}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.361}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.253}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.322}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.387}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.473}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":101236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.250}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.383}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.403}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.390}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.263}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.322}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.363}]}]}]}} 2019-11-28T11:25:31.356 INFO:tasks.ceph.ceph_manager.ceph:clean! 2019-11-28T11:25:31.357 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2019-11-28T11:25:31.357 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2019-11-28T11:25:31.357 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2019-11-28T11:25:31.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.456+0000 7fb5d685d700 1 Processor -- start 2019-11-28T11:25:31.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.456+0000 7fb5d685d700 1 -- start start 2019-11-28T11:25:31.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.457+0000 7fb5d685d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb5d006c490 0x7fb5d006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:31.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.457+0000 7fb5d685d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5d006ce60 0x7fb5d0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:31.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.457+0000 7fb5d685d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d006db00 con 0x7fb5d006c0a0 2019-11-28T11:25:31.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.457+0000 7fb5d685d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d006fd60 con 0x7fb5d006ce60 2019-11-28T11:25:31.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.457+0000 7fb5d685d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d0070030 con 0x7fb5d006c490 2019-11-28T11:25:31.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.457+0000 7fb5d55fb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5d006ce60 0x7fb5d0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5d55fb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5d006ce60 0x7fb5d0164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59590/0 (socket says 172.21.15.80:59590) 2019-11-28T11:25:31.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5d55fb700 1 -- 172.21.15.80:0/2397398904 learned_addr learned my addr 172.21.15.80:0/2397398904 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:31.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5d55fb700 1 -- 172.21.15.80:0/2397398904 >> v2:172.21.15.174:3300/0 conn(0x7fb5d006c490 msgr2=0x7fb5d006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:31.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5cffff700 1 --2- 172.21.15.80:0/2397398904 >> v2:172.21.15.174:3300/0 conn(0x7fb5d006c490 0x7fb5d006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5d55fb700 1 --2- 172.21.15.80:0/2397398904 >> v2:172.21.15.174:3300/0 conn(0x7fb5d006c490 0x7fb5d006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:31.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5d55fb700 1 -- 172.21.15.80:0/2397398904 >> v1:172.21.15.80:6789/0 conn(0x7fb5d006c0a0 legacy=0x7fb5d0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5cf7fe700 1 -- 172.21.15.80:0/2397398904 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434790942 0 0) 0x7fb5b8001100 con 0x7fb5d006c0a0 2019-11-28T11:25:31.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5d55fb700 1 -- 172.21.15.80:0/2397398904 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d00706c0 con 0x7fb5d006ce60 2019-11-28T11:25:31.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5cffff700 1 --2- 172.21.15.80:0/2397398904 >> v2:172.21.15.174:3300/0 conn(0x7fb5d006c490 0x7fb5d006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:25:31.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5d55fb700 1 --2- 172.21.15.80:0/2397398904 >> v2:172.21.15.80:3300/0 conn(0x7fb5d006ce60 0x7fb5d0164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb5c800f730 tx=0x7fb5c800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5d55fb700 1 --2- 172.21.15.80:0/2397398904 >> v2:172.21.15.80:3300/0 conn(0x7fb5d006ce60 0x7fb5d0164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb5c800f730 tx=0x7fb5c800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5d55fb700 1 --2- 172.21.15.80:0/2397398904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5d006ce60 0x7fb5d0164d70 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7fb5c800f730 tx=0x7fb5c800fad0).ready entity=mon.0 client_cookie=2b8111829f458725 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:31.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5d55fb700 1 --2- 172.21.15.80:0/2397398904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5d006ce60 0x7fb5d0164d70 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fb5c800f730 tx=0x7fb5c800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5cf7fe700 1 -- 172.21.15.80:0/2397398904 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5c8000b90 con 0x7fb5d006ce60 2019-11-28T11:25:31.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5d55fb700 1 --2- 172.21.15.80:0/2397398904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5d006ce60 0x7fb5d0164d70 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fb5c800f730 tx=0x7fb5c800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5cf7fe700 1 -- 172.21.15.80:0/2397398904 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c80010e0 con 0x7fb5d006ce60 2019-11-28T11:25:31.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5d55fb700 1 --2- 172.21.15.80:0/2397398904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5d006ce60 0x7fb5d0164d70 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fb5c800f730 tx=0x7fb5c800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5cf7fe700 1 -- 172.21.15.80:0/2397398904 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5c80012d0 con 0x7fb5d006ce60 2019-11-28T11:25:31.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5d685d700 1 -- 172.21.15.80:0/2397398904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5d006ce60 msgr2=0x7fb5d0164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.458+0000 7fb5d685d700 1 --2- 172.21.15.80:0/2397398904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5d006ce60 0x7fb5d0164d70 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7fb5c800f730 tx=0x7fb5c800fad0).stop 2019-11-28T11:25:31.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.459+0000 7fb5d685d700 1 -- 172.21.15.80:0/2397398904 shutdown_connections 2019-11-28T11:25:31.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.459+0000 7fb5d685d700 1 --2- 172.21.15.80:0/2397398904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5d006ce60 0x7fb5d0164d70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.459+0000 7fb5d685d700 1 --2- 172.21.15.80:0/2397398904 >> v2:172.21.15.174:3300/0 conn(0x7fb5d006c490 0x7fb5d006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:31.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.459+0000 7fb5d685d700 1 -- 172.21.15.80:0/2397398904 shutdown_connections 2019-11-28T11:25:31.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.459+0000 7fb5d685d700 1 -- 172.21.15.80:0/2397398904 wait complete. 2019-11-28T11:25:31.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.459+0000 7fb5d685d700 1 -- 172.21.15.80:0/2397398904 >> 172.21.15.80:0/2397398904 conn(0x7fb5d0061cf0 msgr2=0x7fb5d0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:31.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.461+0000 7fb5d685d700 1 Processor -- start 2019-11-28T11:25:31.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.461+0000 7fb5d685d700 1 -- start start 2019-11-28T11:25:31.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.462+0000 7fb5d685d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5d0128990 0x7fb5d0117fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:31.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.462+0000 7fb5d685d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d012ff40 con 0x7fb5d012e850 2019-11-28T11:25:31.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.462+0000 7fb5d685d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d010f340 con 0x7fb5d01184e0 2019-11-28T11:25:31.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5d685d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d0131240 con 0x7fb5d0128990 2019-11-28T11:25:31.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5d55fb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb5d012e850 0x7fb5d010d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58914/0 (socket says 172.21.15.80:58914) 2019-11-28T11:25:31.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5d55fb700 1 -- 172.21.15.80:0/4241883629 learned_addr learned my addr 172.21.15.80:0/4241883629 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:31.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824435561 0 0) 0x7fb5c8007900 con 0x7fb5d012e850 2019-11-28T11:25:31.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5b4002e80 con 0x7fb5d012e850 2019-11-28T11:25:31.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5d4dfa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5d0128990 0x7fb5d0117fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1763456615 0 0) 0x7fb5c8007990 con 0x7fb5d012e850 2019-11-28T11:25:31.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb5b40032e0 con 0x7fb5d012e850 2019-11-28T11:25:31.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fb5c8000940 con 0x7fb5d012e850 2019-11-28T11:25:31.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5d0128990 msgr2=0x7fb5d0117fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5cd7fa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5d0128990 0x7fb5d0117fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 >> v1:172.21.15.174:6789/0 conn(0x7fb5d01184e0 legacy=0x7fb5d012e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 >> v1:172.21.15.80:6789/0 conn(0x7fb5d012e850 legacy=0x7fb5d010d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5cd7fa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b4003400 0x7fb5b4003810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:31.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5cd7fa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5b4003d50 0x7fb5b40041c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:31.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5cd7fa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5b40048c0 0x7fb5b4004d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:31.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b400bbf0 con 0x7fb5b4003400 2019-11-28T11:25:31.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b400bdf0 con 0x7fb5b40048c0 2019-11-28T11:25:31.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b400c020 con 0x7fb5b4003d50 2019-11-28T11:25:31.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5d4dfa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b4003400 0x7fb5b4003810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5cffff700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5b4003d50 0x7fb5b40041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.463+0000 7fb5d55fb700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5b40048c0 0x7fb5b4004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5d4dfa700 1 -- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5b4003d50 msgr2=0x7fb5b40041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5d4dfa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5b4003d50 0x7fb5b40041c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5d4dfa700 1 -- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5b40048c0 msgr2=0x7fb5b4004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5d4dfa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5b40048c0 0x7fb5b4004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5d4dfa700 1 -- 172.21.15.80:0/4241883629 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b400c2d0 con 0x7fb5b4003400 2019-11-28T11:25:31.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5d55fb700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5b40048c0 0x7fb5b4004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:31.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5d685d700 1 -- 172.21.15.80:0/4241883629 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d0132950 con 0x7fb5b4003400 2019-11-28T11:25:31.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5d4dfa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b4003400 0x7fb5b4003810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb5b8010300 tx=0x7fb5b80106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5d685d700 1 -- 172.21.15.80:0/4241883629 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d01325d0 con 0x7fb5b4003400 2019-11-28T11:25:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5d4dfa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b4003400 0x7fb5b4003810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb5b8010300 tx=0x7fb5b80106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5d4dfa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b4003400 0x7fb5b4003810 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fb5b8010300 tx=0x7fb5b80106a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5d4dfa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b4003400 0x7fb5b4003810 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fb5b8010300 tx=0x7fb5b80106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b8000ce0 con 0x7fb5b4003400 2019-11-28T11:25:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5d4dfa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b4003400 0x7fb5b4003810 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fb5b8010300 tx=0x7fb5b80106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5d4dfa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b4003400 0x7fb5b4003810 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fb5b8010300 tx=0x7fb5b80106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b80056a0 con 0x7fb5b4003400 2019-11-28T11:25:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b8005db0 con 0x7fb5b4003400 2019-11-28T11:25:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5d4dfa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b4003400 0x7fb5b4003810 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fb5b8010300 tx=0x7fb5b80106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb5b8005890 con 0x7fb5b4003400 2019-11-28T11:25:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5d4dfa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b4003400 0x7fb5b4003810 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fb5b8010300 tx=0x7fb5b80106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5cd7fa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5b4020b90 0x7fb5b4022fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:31.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.464+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fb5b8031c10 con 0x7fb5b4003400 2019-11-28T11:25:31.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.465+0000 7fb5cffff700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5b4020b90 0x7fb5b4022fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.465+0000 7fb5cffff700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5b4020b90 0x7fb5b4022fc0 crc :-1 s=READY pgs=82 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:31.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.472+0000 7fb5d685d700 1 -- 172.21.15.80:0/4241883629 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a8002e60 con 0x7fb5b4003400 2019-11-28T11:25:31.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.475+0000 7fb5d4dfa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b4003400 0x7fb5b4003810 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fb5b8010300 tx=0x7fb5b80106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.475+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb5b80052a0 con 0x7fb5b4003400 2019-11-28T11:25:31.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.637+0000 7fb5d685d700 1 -- 172.21.15.80:0/4241883629 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb5a8001d10 con 0x7fb5b4003400 2019-11-28T11:25:31.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.637+0000 7fb5d4dfa700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b4003400 0x7fb5b4003810 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fb5b8010300 tx=0x7fb5b80106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.637+0000 7fb5cd7fa700 1 -- 172.21.15.80:0/4241883629 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fb5b80056a0 con 0x7fb5b4003400 2019-11-28T11:25:31.658 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:31.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.640+0000 7fb5d685d700 1 -- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5b4020b90 msgr2=0x7fb5b4022fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.640+0000 7fb5d685d700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5b4020b90 0x7fb5b4022fc0 crc :-1 s=READY pgs=82 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.640+0000 7fb5d685d700 1 -- 172.21.15.80:0/4241883629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b4003400 msgr2=0x7fb5b4003810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.640+0000 7fb5d685d700 1 --2- 172.21.15.80:0/4241883629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b4003400 0x7fb5b4003810 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fb5b8010300 tx=0x7fb5b80106a0).stop 2019-11-28T11:25:31.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.640+0000 7fb5d55fb700 1 -- 172.21.15.80:0/4241883629 reap_dead start 2019-11-28T11:25:31.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.640+0000 7fb5d55fb700 1 -- 172.21.15.80:0/4241883629 reap_dead start 2019-11-28T11:25:31.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.640+0000 7fb5d685d700 1 -- 172.21.15.80:0/4241883629 shutdown_connections 2019-11-28T11:25:31.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.640+0000 7fb5d685d700 1 -- 172.21.15.80:0/4241883629 shutdown_connections 2019-11-28T11:25:31.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.640+0000 7fb5d685d700 1 -- 172.21.15.80:0/4241883629 wait complete. 2019-11-28T11:25:31.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.640+0000 7fb5d685d700 1 -- 172.21.15.80:0/4241883629 >> 172.21.15.80:0/4241883629 conn(0x7fb5d007c6e0 msgr2=0x7fb5d01050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:31.669 INFO:teuthology.orchestra.run.smithi080.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-11-28T11:25:31.669 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2019-11-28T11:25:31.670 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:31.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.769+0000 7f71042b5700 1 Processor -- start 2019-11-28T11:25:31.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.769+0000 7f71042b5700 1 -- start start 2019-11-28T11:25:31.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.770+0000 7f71042b5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f70fc06c0a0 0x7f70fc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:31.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.770+0000 7f71042b5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f70fc072620 0x7f70fc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:31.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.770+0000 7f71042b5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc06db00 con 0x7f70fc0734e0 2019-11-28T11:25:31.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.770+0000 7f71042b5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc06fd60 con 0x7f70fc06c0a0 2019-11-28T11:25:31.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.770+0000 7f71042b5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc070030 con 0x7f70fc072620 2019-11-28T11:25:31.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.770+0000 7f7102852700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f70fc06c0a0 0x7f70fc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.770+0000 7f7102852700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f70fc06c0a0 0x7f70fc072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59608/0 (socket says 172.21.15.80:59608) 2019-11-28T11:25:31.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.770+0000 7f7102852700 1 -- 172.21.15.80:0/685339470 learned_addr learned my addr 172.21.15.80:0/685339470 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:31.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.770+0000 7f7103053700 1 --2- 172.21.15.80:0/685339470 >> v2:172.21.15.174:3300/0 conn(0x7f70fc072620 0x7f70fc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.771+0000 7f7102852700 1 -- 172.21.15.80:0/685339470 >> v2:172.21.15.174:3300/0 conn(0x7f70fc072620 msgr2=0x7f70fc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:31.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.771+0000 7f7102852700 1 --2- 172.21.15.80:0/685339470 >> v2:172.21.15.174:3300/0 conn(0x7f70fc072620 0x7f70fc164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:31.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.771+0000 7f7102852700 1 -- 172.21.15.80:0/685339470 >> v1:172.21.15.174:6789/0 conn(0x7f70fc0734e0 legacy=0x7f70fc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.771+0000 7f7102852700 1 -- 172.21.15.80:0/685339470 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc0706c0 con 0x7f70fc06c0a0 2019-11-28T11:25:31.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.771+0000 7f7102852700 1 --2- 172.21.15.80:0/685339470 >> v2:172.21.15.80:3300/0 conn(0x7f70fc06c0a0 0x7f70fc072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f70e400f740 tx=0x7f70e400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.771+0000 7f7102852700 1 --2- 172.21.15.80:0/685339470 >> v2:172.21.15.80:3300/0 conn(0x7f70fc06c0a0 0x7f70fc072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f70e400f740 tx=0x7f70e400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.771+0000 7f7102852700 1 --2- 172.21.15.80:0/685339470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc06c0a0 0x7f70fc072fa0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f70e400f740 tx=0x7f70e400f570).ready entity=mon.0 client_cookie=d3500b0d0ace4200 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:31.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.771+0000 7f7102852700 1 --2- 172.21.15.80:0/685339470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc06c0a0 0x7f70fc072fa0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f70e400f740 tx=0x7f70e400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.771+0000 7f7102852700 1 --2- 172.21.15.80:0/685339470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc06c0a0 0x7f70fc072fa0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f70e400f740 tx=0x7f70e400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.771+0000 7f7101850700 1 -- 172.21.15.80:0/685339470 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70e4000960 con 0x7f70fc06c0a0 2019-11-28T11:25:31.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.771+0000 7f7102852700 1 --2- 172.21.15.80:0/685339470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc06c0a0 0x7f70fc072fa0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f70e400f740 tx=0x7f70e400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.771+0000 7f7101850700 1 -- 172.21.15.80:0/685339470 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e4000c90 con 0x7f70fc06c0a0 2019-11-28T11:25:31.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.771+0000 7f7101850700 1 -- 172.21.15.80:0/685339470 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70e40013a0 con 0x7f70fc06c0a0 2019-11-28T11:25:31.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.771+0000 7f71042b5700 1 -- 172.21.15.80:0/685339470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc06c0a0 msgr2=0x7f70fc072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.771+0000 7f71042b5700 1 --2- 172.21.15.80:0/685339470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc06c0a0 0x7f70fc072fa0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f70e400f740 tx=0x7f70e400f570).stop 2019-11-28T11:25:31.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.772+0000 7f71042b5700 1 -- 172.21.15.80:0/685339470 shutdown_connections 2019-11-28T11:25:31.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.772+0000 7f71042b5700 1 --2- 172.21.15.80:0/685339470 >> v2:172.21.15.174:3300/0 conn(0x7f70fc072620 0x7f70fc164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:31.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.772+0000 7f71042b5700 1 --2- 172.21.15.80:0/685339470 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc06c0a0 0x7f70fc072fa0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.772+0000 7f71042b5700 1 -- 172.21.15.80:0/685339470 shutdown_connections 2019-11-28T11:25:31.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.772+0000 7f71042b5700 1 -- 172.21.15.80:0/685339470 wait complete. 2019-11-28T11:25:31.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.772+0000 7f71042b5700 1 -- 172.21.15.80:0/685339470 >> 172.21.15.80:0/685339470 conn(0x7f70fc061cf0 msgr2=0x7f70fc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:31.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.774+0000 7f71042b5700 1 Processor -- start 2019-11-28T11:25:31.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.774+0000 7f71042b5700 1 -- start start 2019-11-28T11:25:31.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.775+0000 7f71042b5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f70fc104820 0x7f70fc10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:31.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.775+0000 7f71042b5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f70fc10b9d0 0x7f70fc167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:31.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.775+0000 7f71042b5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc13bcd0 con 0x7f70fc10c890 2019-11-28T11:25:31.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.775+0000 7f71042b5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc109130 con 0x7f70fc10b9d0 2019-11-28T11:25:31.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.775+0000 7f71042b5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc109400 con 0x7f70fc104820 2019-11-28T11:25:31.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.775+0000 7f7103053700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f70fc10b9d0 0x7f70fc167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.775+0000 7f7102051700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f70fc10c890 0x7f70fc10b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58932/0 (socket says 172.21.15.80:58932) 2019-11-28T11:25:31.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.775+0000 7f7102051700 1 -- 172.21.15.80:0/1140555771 learned_addr learned my addr 172.21.15.80:0/1140555771 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:31.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.775+0000 7f7102852700 1 --2- 172.21.15.80:0/1140555771 >> v2:172.21.15.174:3300/0 conn(0x7f70fc104820 0x7f70fc10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.775+0000 7f7103053700 1 -- 172.21.15.80:0/1140555771 >> v2:172.21.15.174:3300/0 conn(0x7f70fc104820 msgr2=0x7f70fc10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.775+0000 7f7103053700 1 --2- 172.21.15.80:0/1140555771 >> v2:172.21.15.174:3300/0 conn(0x7f70fc104820 0x7f70fc10c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.775+0000 7f7103053700 1 -- 172.21.15.80:0/1140555771 >> v1:172.21.15.80:6789/0 conn(0x7f70fc10c890 legacy=0x7f70fc10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.775+0000 7f7103053700 1 -- 172.21.15.80:0/1140555771 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc109a90 con 0x7f70fc10b9d0 2019-11-28T11:25:31.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.775+0000 7f70fb7fe700 1 -- 172.21.15.80:0/1140555771 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815655051 0 0) 0x7f70ec001150 con 0x7f70fc10c890 2019-11-28T11:25:31.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.775+0000 7f7103053700 1 --2- 172.21.15.80:0/1140555771 >> v2:172.21.15.80:3300/0 conn(0x7f70fc10b9d0 0x7f70fc167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f70f400edc0 tx=0x7f70f40105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.775+0000 7f7103053700 1 --2- 172.21.15.80:0/1140555771 >> v2:172.21.15.80:3300/0 conn(0x7f70fc10b9d0 0x7f70fc167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f70f400edc0 tx=0x7f70f40105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.776+0000 7f7103053700 1 --2- 172.21.15.80:0/1140555771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc10b9d0 0x7f70fc167a10 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f70f400edc0 tx=0x7f70f40105c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:31.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.776+0000 7f7103053700 1 --2- 172.21.15.80:0/1140555771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc10b9d0 0x7f70fc167a10 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f70f400edc0 tx=0x7f70f40105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.776+0000 7f70fb7fe700 1 -- 172.21.15.80:0/1140555771 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f400f200 con 0x7f70fc10b9d0 2019-11-28T11:25:31.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.776+0000 7f7103053700 1 --2- 172.21.15.80:0/1140555771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc10b9d0 0x7f70fc167a10 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f70f400edc0 tx=0x7f70f40105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.776+0000 7f7103053700 1 --2- 172.21.15.80:0/1140555771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc10b9d0 0x7f70fc167a10 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f70f400edc0 tx=0x7f70f40105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.776+0000 7f70fb7fe700 1 -- 172.21.15.80:0/1140555771 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f400f400 con 0x7f70fc10b9d0 2019-11-28T11:25:31.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.776+0000 7f71042b5700 1 -- 172.21.15.80:0/1140555771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc109e10 con 0x7f70fc10b9d0 2019-11-28T11:25:31.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.776+0000 7f70fb7fe700 1 -- 172.21.15.80:0/1140555771 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f400f5f0 con 0x7f70fc10b9d0 2019-11-28T11:25:31.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.776+0000 7f71042b5700 1 -- 172.21.15.80:0/1140555771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc109a90 con 0x7f70fc10b9d0 2019-11-28T11:25:31.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.776+0000 7f7103053700 1 --2- 172.21.15.80:0/1140555771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc10b9d0 0x7f70fc167a10 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f70f400edc0 tx=0x7f70f40105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.776+0000 7f70fb7fe700 1 -- 172.21.15.80:0/1140555771 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f70f400ef60 con 0x7f70fc10b9d0 2019-11-28T11:25:31.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.776+0000 7f7103053700 1 --2- 172.21.15.80:0/1140555771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc10b9d0 0x7f70fc167a10 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f70f400edc0 tx=0x7f70f40105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.776+0000 7f70fb7fe700 1 --2- 172.21.15.80:0/1140555771 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70e0018730 0x7f70e001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:31.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.776+0000 7f70fb7fe700 1 -- 172.21.15.80:0/1140555771 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f70f4031d60 con 0x7f70fc10b9d0 2019-11-28T11:25:31.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.777+0000 7f7102852700 1 --2- 172.21.15.80:0/1140555771 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70e0018730 0x7f70e001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:31.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.777+0000 7f7102852700 1 --2- 172.21.15.80:0/1140555771 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70e0018730 0x7f70e001abc0 crc :-1 s=READY pgs=83 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:31.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.785+0000 7f71042b5700 1 -- 172.21.15.80:0/1140555771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc109e10 con 0x7f70fc10b9d0 2019-11-28T11:25:31.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.788+0000 7f7103053700 1 --2- 172.21.15.80:0/1140555771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc10b9d0 0x7f70fc167a10 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f70f400edc0 tx=0x7f70f40105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.788+0000 7f70fb7fe700 1 -- 172.21.15.80:0/1140555771 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f70f4000e80 con 0x7f70fc10b9d0 2019-11-28T11:25:31.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.963+0000 7f71042b5700 1 -- 172.21.15.80:0/1140555771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70fc109a90 con 0x7f70fc10b9d0 2019-11-28T11:25:31.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.964+0000 7f7103053700 1 --2- 172.21.15.80:0/1140555771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc10b9d0 0x7f70fc167a10 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f70f400edc0 tx=0x7f70f40105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:31.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.964+0000 7f70fb7fe700 1 -- 172.21.15.80:0/1140555771 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14885 (secure 0 0 0) 0x7f70f400f2f0 con 0x7f70fc10b9d0 2019-11-28T11:25:31.984 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:31.985 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:20.933435+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:25:14.914696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-11-28T11:25:17.566323+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:31.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.966+0000 7f71042b5700 1 -- 172.21.15.80:0/1140555771 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70e0018730 msgr2=0x7f70e001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.966+0000 7f71042b5700 1 --2- 172.21.15.80:0/1140555771 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70e0018730 0x7f70e001abc0 crc :-1 s=READY pgs=83 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.966+0000 7f71042b5700 1 -- 172.21.15.80:0/1140555771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc10b9d0 msgr2=0x7f70fc167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:31.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.966+0000 7f71042b5700 1 --2- 172.21.15.80:0/1140555771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc10b9d0 0x7f70fc167a10 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f70f400edc0 tx=0x7f70f40105c0).stop 2019-11-28T11:25:31.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.966+0000 7f71042b5700 1 -- 172.21.15.80:0/1140555771 shutdown_connections 2019-11-28T11:25:31.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.966+0000 7f71042b5700 1 --2- 172.21.15.80:0/1140555771 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70e0018730 0x7f70e001abc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.966+0000 7f71042b5700 1 --2- 172.21.15.80:0/1140555771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70fc10b9d0 0x7f70fc167a10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.966+0000 7f71042b5700 1 --2- 172.21.15.80:0/1140555771 >> v2:172.21.15.174:3300/0 conn(0x7f70fc104820 0x7f70fc10c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:31.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.966+0000 7f71042b5700 1 -- 172.21.15.80:0/1140555771 shutdown_connections 2019-11-28T11:25:31.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.966+0000 7f71042b5700 1 -- 172.21.15.80:0/1140555771 wait complete. 2019-11-28T11:25:31.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:31.966+0000 7f71042b5700 1 -- 172.21.15.80:0/1140555771 >> 172.21.15.80:0/1140555771 conn(0x7f70fc13d620 msgr2=0x7f70fc13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:31.999 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:14.914696+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:17.566323+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:25:31.999 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:25:32.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.103+0000 7f195225d700 1 Processor -- start 2019-11-28T11:25:32.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.103+0000 7f195225d700 1 -- start start 2019-11-28T11:25:32.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.104+0000 7f195225d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f194c1639f0 0x7f194c165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:32.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.104+0000 7f195225d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194c06db60 con 0x7f194c15f100 2019-11-28T11:25:32.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.104+0000 7f195225d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194c06e060 con 0x7f194c15ed10 2019-11-28T11:25:32.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.104+0000 7f195225d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194c06fe00 con 0x7f194c1639f0 2019-11-28T11:25:32.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f1950ffb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f194c1639f0 0x7f194c165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:32.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f1950ffb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f194c1639f0 0x7f194c165df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59624/0 (socket says 172.21.15.80:59624) 2019-11-28T11:25:32.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f1950ffb700 1 -- 172.21.15.80:0/3596287309 learned_addr learned my addr 172.21.15.80:0/3596287309 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:32.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f1950ffb700 1 -- 172.21.15.80:0/3596287309 >> v1:172.21.15.174:6789/0 conn(0x7f194c15ed10 legacy=0x7f194c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:32.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f1950ffb700 1 -- 172.21.15.80:0/3596287309 >> v1:172.21.15.80:6789/0 conn(0x7f194c15f100 legacy=0x7f194c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f1950ffb700 1 -- 172.21.15.80:0/3596287309 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c070760 con 0x7f194c1639f0 2019-11-28T11:25:32.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f194b7fe700 1 -- 172.21.15.80:0/3596287309 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184625443 0 0) 0x7f1934001100 con 0x7f194c15f100 2019-11-28T11:25:32.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f1950ffb700 1 --2- 172.21.15.80:0/3596287309 >> v2:172.21.15.80:3300/0 conn(0x7f194c1639f0 0x7f194c165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f194400fab0 tx=0x7f194400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f1950ffb700 1 --2- 172.21.15.80:0/3596287309 >> v2:172.21.15.80:3300/0 conn(0x7f194c1639f0 0x7f194c165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f194400fab0 tx=0x7f194400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f1950ffb700 1 --2- 172.21.15.80:0/3596287309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f194c1639f0 0x7f194c165df0 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f194400fab0 tx=0x7f194400fe50).ready entity=mon.0 client_cookie=c621776465c80aa0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:32.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f1950ffb700 1 --2- 172.21.15.80:0/3596287309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f194c1639f0 0x7f194c165df0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f194400fab0 tx=0x7f194400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f194b7fe700 1 -- 172.21.15.80:0/3596287309 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1944001460 con 0x7f194c1639f0 2019-11-28T11:25:32.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f1950ffb700 1 --2- 172.21.15.80:0/3596287309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f194c1639f0 0x7f194c165df0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f194400fab0 tx=0x7f194400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f194b7fe700 1 -- 172.21.15.80:0/3596287309 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1944000df0 con 0x7f194c1639f0 2019-11-28T11:25:32.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f1950ffb700 1 --2- 172.21.15.80:0/3596287309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f194c1639f0 0x7f194c165df0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f194400fab0 tx=0x7f194400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f194b7fe700 1 -- 172.21.15.80:0/3596287309 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1944001650 con 0x7f194c1639f0 2019-11-28T11:25:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f195225d700 1 -- 172.21.15.80:0/3596287309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f194c1639f0 msgr2=0x7f194c165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.105+0000 7f195225d700 1 --2- 172.21.15.80:0/3596287309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f194c1639f0 0x7f194c165df0 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f194400fab0 tx=0x7f194400fe50).stop 2019-11-28T11:25:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.106+0000 7f195225d700 1 -- 172.21.15.80:0/3596287309 shutdown_connections 2019-11-28T11:25:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.106+0000 7f195225d700 1 --2- 172.21.15.80:0/3596287309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f194c1639f0 0x7f194c165df0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.106+0000 7f195225d700 1 -- 172.21.15.80:0/3596287309 shutdown_connections 2019-11-28T11:25:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.106+0000 7f195225d700 1 -- 172.21.15.80:0/3596287309 wait complete. 2019-11-28T11:25:32.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.106+0000 7f195225d700 1 -- 172.21.15.80:0/3596287309 >> 172.21.15.80:0/3596287309 conn(0x7f194c061d20 msgr2=0x7f194c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:32.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.108+0000 7f195225d700 1 Processor -- start 2019-11-28T11:25:32.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.109+0000 7f195225d700 1 -- start start 2019-11-28T11:25:32.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.109+0000 7f195225d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f194c10e970 0x7f194c1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:32.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.109+0000 7f195225d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194c10c250 con 0x7f194c107e30 2019-11-28T11:25:32.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.109+0000 7f195225d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194c10c6d0 con 0x7f194c108cf0 2019-11-28T11:25:32.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.109+0000 7f195225d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194c10da00 con 0x7f194c10e970 2019-11-28T11:25:32.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.109+0000 7f1950ffb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f194c107e30 0x7f194c167d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58946/0 (socket says 172.21.15.80:58946) 2019-11-28T11:25:32.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.109+0000 7f1950ffb700 1 -- 172.21.15.80:0/3245267578 learned_addr learned my addr 172.21.15.80:0/3245267578 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:32.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f194bfff700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f194c10e970 0x7f194c1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:32.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f19497fa700 1 -- 172.21.15.80:0/3245267578 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267373873 0 0) 0x7f1944000cc0 con 0x7f194c107e30 2019-11-28T11:25:32.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f19497fa700 1 -- 172.21.15.80:0/3245267578 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1930002e80 con 0x7f194c107e30 2019-11-28T11:25:32.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f19497fa700 1 -- 172.21.15.80:0/3245267578 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116839435 0 0) 0x7f1934000c90 con 0x7f194c108cf0 2019-11-28T11:25:32.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f19497fa700 1 -- 172.21.15.80:0/3245267578 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19300030b0 con 0x7f194c108cf0 2019-11-28T11:25:32.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f19497fa700 1 -- 172.21.15.80:0/3245267578 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3006796949 0 0) 0x7f1944007900 con 0x7f194c107e30 2019-11-28T11:25:32.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f194bfff700 1 -- 172.21.15.80:0/3245267578 >> v1:172.21.15.174:6789/0 conn(0x7f194c108cf0 legacy=0x7f194c107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f194bfff700 1 -- 172.21.15.80:0/3245267578 >> v1:172.21.15.80:6789/0 conn(0x7f194c107e30 legacy=0x7f194c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f194bfff700 1 -- 172.21.15.80:0/3245267578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c105ef0 con 0x7f194c10e970 2019-11-28T11:25:32.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f194bfff700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f194c10e970 0x7f194c1087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f193c0103a0 tx=0x7f193c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f194bfff700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f194c10e970 0x7f194c1087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f193c0103a0 tx=0x7f193c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f194bfff700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f194c10e970 0x7f194c1087b0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f193c0103a0 tx=0x7f193c010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:32.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f194bfff700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f194c10e970 0x7f194c1087b0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f193c0103a0 tx=0x7f193c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f19497fa700 1 -- 172.21.15.80:0/3245267578 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f193c009b70 con 0x7f194c10e970 2019-11-28T11:25:32.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f194bfff700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f194c10e970 0x7f194c1087b0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f193c0103a0 tx=0x7f193c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f194bfff700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f194c10e970 0x7f194c1087b0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f193c0103a0 tx=0x7f193c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f19497fa700 1 -- 172.21.15.80:0/3245267578 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c009790 con 0x7f194c10e970 2019-11-28T11:25:32.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f19497fa700 1 -- 172.21.15.80:0/3245267578 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f193c009980 con 0x7f194c10e970 2019-11-28T11:25:32.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f195225d700 1 -- 172.21.15.80:0/3245267578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194c106270 con 0x7f194c10e970 2019-11-28T11:25:32.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.110+0000 7f195225d700 1 -- 172.21.15.80:0/3245267578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194c105ef0 con 0x7f194c10e970 2019-11-28T11:25:32.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.111+0000 7f194bfff700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f194c10e970 0x7f194c1087b0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f193c0103a0 tx=0x7f193c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.111+0000 7f19497fa700 1 -- 172.21.15.80:0/3245267578 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f193c009b40 con 0x7f194c10e970 2019-11-28T11:25:32.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.111+0000 7f194bfff700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f194c10e970 0x7f194c1087b0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f193c0103a0 tx=0x7f193c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.111+0000 7f19497fa700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1930018750 0x7f193001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:32.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.111+0000 7f19497fa700 1 -- 172.21.15.80:0/3245267578 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f193c031ab0 con 0x7f194c10e970 2019-11-28T11:25:32.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.111+0000 7f1943fff700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1930018750 0x7f193001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:32.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.112+0000 7f1943fff700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1930018750 0x7f193001abe0 crc :-1 s=READY pgs=84 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:32.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.118+0000 7f195225d700 1 -- 172.21.15.80:0/3245267578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194c106270 con 0x7f194c10e970 2019-11-28T11:25:32.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.122+0000 7f194bfff700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f194c10e970 0x7f194c1087b0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f193c0103a0 tx=0x7f193c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.122+0000 7f19497fa700 1 -- 172.21.15.80:0/3245267578 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f193c009580 con 0x7f194c10e970 2019-11-28T11:25:32.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.288+0000 7f195225d700 1 -- 172.21.15.80:0/3245267578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f194c105ef0 con 0x7f194c10e970 2019-11-28T11:25:32.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.288+0000 7f194bfff700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f194c10e970 0x7f194c1087b0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f193c0103a0 tx=0x7f193c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.288+0000 7f19497fa700 1 -- 172.21.15.80:0/3245267578 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f193c009980 con 0x7f194c10e970 2019-11-28T11:25:32.308 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:32.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.290+0000 7f195225d700 1 -- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1930018750 msgr2=0x7f193001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.290+0000 7f195225d700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1930018750 0x7f193001abe0 crc :-1 s=READY pgs=84 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:32.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.290+0000 7f195225d700 1 -- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f194c10e970 msgr2=0x7f194c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.290+0000 7f195225d700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f194c10e970 0x7f194c1087b0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f193c0103a0 tx=0x7f193c010740).stop 2019-11-28T11:25:32.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.290+0000 7f195225d700 1 -- 172.21.15.80:0/3245267578 shutdown_connections 2019-11-28T11:25:32.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.290+0000 7f195225d700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1930018750 0x7f193001abe0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:32.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.290+0000 7f195225d700 1 --2- 172.21.15.80:0/3245267578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f194c10e970 0x7f194c1087b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:32.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.290+0000 7f195225d700 1 -- 172.21.15.80:0/3245267578 shutdown_connections 2019-11-28T11:25:32.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.290+0000 7f195225d700 1 -- 172.21.15.80:0/3245267578 wait complete. 2019-11-28T11:25:32.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.290+0000 7f195225d700 1 -- 172.21.15.80:0/3245267578 >> 172.21.15.80:0/3245267578 conn(0x7f194c15e2d0 msgr2=0x7f194c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:32.321 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:25:32.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.429+0000 7f512102a700 1 Processor -- start 2019-11-28T11:25:32.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.429+0000 7f512102a700 1 -- start start 2019-11-28T11:25:32.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.430+0000 7f512102a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f511c1639f0 0x7f511c165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:32.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.430+0000 7f512102a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c06db60 con 0x7f511c15ed10 2019-11-28T11:25:32.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.430+0000 7f512102a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c06e060 con 0x7f511c15f100 2019-11-28T11:25:32.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.430+0000 7f512102a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c06fe00 con 0x7f511c1639f0 2019-11-28T11:25:32.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.430+0000 7f511b59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f511c15ed10 0x7f511c073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58950/0 (socket says 172.21.15.80:58950) 2019-11-28T11:25:32.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511b59e700 1 -- 172.21.15.80:0/1627338375 learned_addr learned my addr 172.21.15.80:0/1627338375 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:32.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f5120829700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f511c1639f0 0x7f511c165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:32.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 -- 172.21.15.80:0/1627338375 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997291402 0 0) 0x7f510c001150 con 0x7f511c15ed10 2019-11-28T11:25:32.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 -- 172.21.15.80:0/1627338375 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50fc002e80 con 0x7f511c15ed10 2019-11-28T11:25:32.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 -- 172.21.15.80:0/1627338375 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066731096 0 0) 0x7f5104001400 con 0x7f511c15f100 2019-11-28T11:25:32.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 -- 172.21.15.80:0/1627338375 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50fc0030b0 con 0x7f511c15f100 2019-11-28T11:25:32.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 -- 172.21.15.80:0/1627338375 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2596635139 0 0) 0x7f510c001130 con 0x7f511c15ed10 2019-11-28T11:25:32.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 -- 172.21.15.80:0/1627338375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f511c1639f0 msgr2=0x7f511c165df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:32.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f511c1639f0 0x7f511c165df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:32.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 -- 172.21.15.80:0/1627338375 >> v1:172.21.15.174:6789/0 conn(0x7f511c15f100 legacy=0x7f511c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 -- 172.21.15.80:0/1627338375 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c070760 con 0x7f511c15ed10 2019-11-28T11:25:32.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 -- 172.21.15.80:0/1627338375 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f510c001660 con 0x7f511c15ed10 2019-11-28T11:25:32.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 -- 172.21.15.80:0/1627338375 >> v1:172.21.15.80:6789/0 conn(0x7f511c15ed10 legacy=0x7f511c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50fc003b80 0x7f50fc005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:32.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50fc0066d0 0x7f50fc008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:32.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50fc04d320 0x7f50fc04f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:32.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 -- 172.21.15.80:0/1627338375 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc04ffd0 con 0x7f50fc04d320 2019-11-28T11:25:32.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 -- 172.21.15.80:0/1627338375 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc050200 con 0x7f50fc003b80 2019-11-28T11:25:32.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511a59c700 1 -- 172.21.15.80:0/1627338375 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc050430 con 0x7f50fc0066d0 2019-11-28T11:25:32.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f5120829700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50fc04d320 0x7f50fc04f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:32.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511b59e700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50fc003b80 0x7f50fc005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:32.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f511ad9d700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50fc0066d0 0x7f50fc008b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:32.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f5120829700 1 -- 172.21.15.80:0/1627338375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50fc0066d0 msgr2=0x7f50fc008b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:32.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f5120829700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f50fc0066d0 0x7f50fc008b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:32.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f5120829700 1 -- 172.21.15.80:0/1627338375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50fc003b80 msgr2=0x7f50fc005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:32.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f5120829700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50fc003b80 0x7f50fc005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:32.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.431+0000 7f5120829700 1 -- 172.21.15.80:0/1627338375 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc0506e0 con 0x7f50fc04d320 2019-11-28T11:25:32.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.432+0000 7f5120829700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50fc04d320 0x7f50fc04f7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f511400af90 tx=0x7f511400b290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.432+0000 7f5120829700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50fc04d320 0x7f50fc04f7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f511400af90 tx=0x7f511400b290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.432+0000 7f5120829700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50fc04d320 0x7f50fc04f7f0 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f511400af90 tx=0x7f511400b290).ready entity=mon.0 client_cookie=1537d6a034f88350 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:32.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.432+0000 7f5120829700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50fc04d320 0x7f50fc04f7f0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f511400af90 tx=0x7f511400b290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.432+0000 7f5120829700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50fc04d320 0x7f50fc04f7f0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f511400af90 tx=0x7f511400b290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.432+0000 7f511a59c700 1 -- 172.21.15.80:0/1627338375 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5114000bc0 con 0x7f50fc04d320 2019-11-28T11:25:32.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.432+0000 7f5120829700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50fc04d320 0x7f50fc04f7f0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f511400af90 tx=0x7f511400b290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.432+0000 7f511a59c700 1 -- 172.21.15.80:0/1627338375 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511400eea0 con 0x7f50fc04d320 2019-11-28T11:25:32.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.432+0000 7f511a59c700 1 -- 172.21.15.80:0/1627338375 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f511400f570 con 0x7f50fc04d320 2019-11-28T11:25:32.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.432+0000 7f512102a700 1 -- 172.21.15.80:0/1627338375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50fc04d320 msgr2=0x7f50fc04f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.432+0000 7f512102a700 1 --2- 172.21.15.80:0/1627338375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50fc04d320 0x7f50fc04f7f0 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f511400af90 tx=0x7f511400b290).stop 2019-11-28T11:25:32.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.432+0000 7f5120829700 1 -- 172.21.15.80:0/1627338375 reap_dead start 2019-11-28T11:25:32.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.432+0000 7f512102a700 1 -- 172.21.15.80:0/1627338375 shutdown_connections 2019-11-28T11:25:32.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.432+0000 7f512102a700 1 -- 172.21.15.80:0/1627338375 shutdown_connections 2019-11-28T11:25:32.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.432+0000 7f512102a700 1 -- 172.21.15.80:0/1627338375 wait complete. 2019-11-28T11:25:32.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.432+0000 7f512102a700 1 -- 172.21.15.80:0/1627338375 >> 172.21.15.80:0/1627338375 conn(0x7f511c061d20 msgr2=0x7f511c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:32.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.435+0000 7f512102a700 1 Processor -- start 2019-11-28T11:25:32.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.435+0000 7f512102a700 1 -- start start 2019-11-28T11:25:32.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f512102a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f511c108630 0x7f511c151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:32.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f512102a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f511c150ae0 0x7f511c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:32.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f512102a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c133a20 con 0x7f511c151740 2019-11-28T11:25:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f512102a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c130f50 con 0x7f511c150ae0 2019-11-28T11:25:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f512102a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c131980 con 0x7f511c108630 2019-11-28T11:25:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f5120829700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f511c150ae0 0x7f511c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f5120829700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f511c150ae0 0x7f511c167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59650/0 (socket says 172.21.15.80:59650) 2019-11-28T11:25:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f5120829700 1 -- 172.21.15.80:0/3401060684 learned_addr learned my addr 172.21.15.80:0/3401060684 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f511b59e700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f511c108630 0x7f511c151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:32.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f5120829700 1 -- 172.21.15.80:0/3401060684 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f511c108630 msgr2=0x7f511c151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f5120829700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f511c108630 0x7f511c151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:32.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f5120829700 1 -- 172.21.15.80:0/3401060684 >> v1:172.21.15.174:6789/0 conn(0x7f511c151740 legacy=0x7f511c1502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f5120829700 1 -- 172.21.15.80:0/3401060684 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c1322e0 con 0x7f511c150ae0 2019-11-28T11:25:32.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f5120829700 1 --2- 172.21.15.80:0/3401060684 >> v2:172.21.15.80:3300/0 conn(0x7f511c150ae0 0x7f511c167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51140104a0 tx=0x7f51140102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f5120829700 1 --2- 172.21.15.80:0/3401060684 >> v2:172.21.15.80:3300/0 conn(0x7f511c150ae0 0x7f511c167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51140104a0 tx=0x7f51140102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f5120829700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f511c150ae0 0x7f511c167d70 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f51140104a0 tx=0x7f51140102d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:32.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f5120829700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f511c150ae0 0x7f511c167d70 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f51140104a0 tx=0x7f51140102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f5120829700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f511c150ae0 0x7f511c167d70 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f51140104a0 tx=0x7f51140102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f5113fff700 1 -- 172.21.15.80:0/3401060684 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51140095b0 con 0x7f511c150ae0 2019-11-28T11:25:32.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f5120829700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f511c150ae0 0x7f511c167d70 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f51140104a0 tx=0x7f51140102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f5113fff700 1 -- 172.21.15.80:0/3401060684 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5114009c00 con 0x7f511c150ae0 2019-11-28T11:25:32.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f512102a700 1 -- 172.21.15.80:0/3401060684 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511c132660 con 0x7f511c150ae0 2019-11-28T11:25:32.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.436+0000 7f5113fff700 1 -- 172.21.15.80:0/3401060684 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f511400a2d0 con 0x7f511c150ae0 2019-11-28T11:25:32.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.437+0000 7f512102a700 1 -- 172.21.15.80:0/3401060684 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511c1322e0 con 0x7f511c150ae0 2019-11-28T11:25:32.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.437+0000 7f5120829700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f511c150ae0 0x7f511c167d70 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f51140104a0 tx=0x7f51140102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.437+0000 7f5113fff700 1 -- 172.21.15.80:0/3401060684 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5114009df0 con 0x7f511c150ae0 2019-11-28T11:25:32.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.437+0000 7f5120829700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f511c150ae0 0x7f511c167d70 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f51140104a0 tx=0x7f51140102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.437+0000 7f5113fff700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f50f4018730 0x7f50f401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:32.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.437+0000 7f5113fff700 1 -- 172.21.15.80:0/3401060684 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f5114031b10 con 0x7f511c150ae0 2019-11-28T11:25:32.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.437+0000 7f511b59e700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f50f4018730 0x7f50f401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:32.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.438+0000 7f511b59e700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f50f4018730 0x7f50f401abc0 crc :-1 s=READY pgs=85 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:32.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.445+0000 7f512102a700 1 -- 172.21.15.80:0/3401060684 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511c132660 con 0x7f511c150ae0 2019-11-28T11:25:32.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.448+0000 7f5120829700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f511c150ae0 0x7f511c167d70 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f51140104a0 tx=0x7f51140102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.448+0000 7f5113fff700 1 -- 172.21.15.80:0/3401060684 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f51140097a0 con 0x7f511c150ae0 2019-11-28T11:25:32.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.616+0000 7f512102a700 1 -- 172.21.15.80:0/3401060684 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f511c1322e0 con 0x7f511c150ae0 2019-11-28T11:25:32.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.617+0000 7f5120829700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f511c150ae0 0x7f511c167d70 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f51140104a0 tx=0x7f51140102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.617+0000 7f5113fff700 1 -- 172.21.15.80:0/3401060684 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5114009dd0 con 0x7f511c150ae0 2019-11-28T11:25:32.638 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.619+0000 7f512102a700 1 -- 172.21.15.80:0/3401060684 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f50f4018730 msgr2=0x7f50f401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.619+0000 7f512102a700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f50f4018730 0x7f50f401abc0 crc :-1 s=READY pgs=85 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.619+0000 7f512102a700 1 -- 172.21.15.80:0/3401060684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f511c150ae0 msgr2=0x7f511c167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.619+0000 7f512102a700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f511c150ae0 0x7f511c167d70 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f51140104a0 tx=0x7f51140102d0).stop 2019-11-28T11:25:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.619+0000 7f512102a700 1 -- 172.21.15.80:0/3401060684 shutdown_connections 2019-11-28T11:25:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.619+0000 7f512102a700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f511c150ae0 0x7f511c167d70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:32.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.619+0000 7f512102a700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f50f4018730 0x7f50f401abc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:32.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.619+0000 7f512102a700 1 --2- 172.21.15.80:0/3401060684 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f511c108630 0x7f511c151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:32.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.620+0000 7f512102a700 1 -- 172.21.15.80:0/3401060684 shutdown_connections 2019-11-28T11:25:32.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.620+0000 7f512102a700 1 -- 172.21.15.80:0/3401060684 wait complete. 2019-11-28T11:25:32.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.620+0000 7f512102a700 1 -- 172.21.15.80:0/3401060684 >> 172.21.15.80:0/3401060684 conn(0x7f511c14dbb0 msgr2=0x7f511c142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:32.649 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:25:32.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.752+0000 7f7c593f2700 1 Processor -- start 2019-11-28T11:25:32.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.752+0000 7f7c593f2700 1 -- start start 2019-11-28T11:25:32.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.753+0000 7f7c593f2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7c5415f100 0x7f7c5406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:32.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.753+0000 7f7c593f2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5406c2f0 0x7f7c5406c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:32.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.753+0000 7f7c593f2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5406db60 con 0x7f7c5415ed10 2019-11-28T11:25:32.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.753+0000 7f7c593f2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5406fe00 con 0x7f7c5415f100 2019-11-28T11:25:32.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.753+0000 7f7c593f2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540700d0 con 0x7f7c5406c2f0 2019-11-28T11:25:32.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c52ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7c5415f100 0x7f7c5406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:32.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c53fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5406c2f0 0x7f7c5406c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:32.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c52ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7c5415f100 0x7f7c5406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:46310/0 (socket says 172.21.15.80:46310) 2019-11-28T11:25:32.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c53fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5406c2f0 0x7f7c5406c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:33686/0 (socket says 172.21.15.80:33686) 2019-11-28T11:25:32.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c537fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f7c5415ed10 0x7f7c54073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:46282/0 (socket says 172.21.15.80:46282) 2019-11-28T11:25:32.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c52ffd700 1 -- 172.21.15.80:0/543890233 learned_addr learned my addr 172.21.15.80:0/543890233 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:32.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c52ffd700 1 -- 172.21.15.80:0/543890233 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5406c2f0 msgr2=0x7f7c5406c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:32.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c52ffd700 1 --2- 172.21.15.80:0/543890233 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5406c2f0 0x7f7c5406c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:32.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c52ffd700 1 -- 172.21.15.80:0/543890233 >> v1:172.21.15.174:6789/0 conn(0x7f7c5415ed10 legacy=0x7f7c54073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c527fc700 1 -- 172.21.15.80:0/543890233 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422985336 0 0) 0x7f7c44001080 con 0x7f7c5415ed10 2019-11-28T11:25:32.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c52ffd700 1 -- 172.21.15.80:0/543890233 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c54070760 con 0x7f7c5415f100 2019-11-28T11:25:32.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c53fff700 1 --2- 172.21.15.80:0/543890233 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5406c2f0 0x7f7c5406c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:32.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c52ffd700 1 --2- 172.21.15.80:0/543890233 >> v2:172.21.15.174:3300/0 conn(0x7f7c5415f100 0x7f7c5406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c3c00f740 tx=0x7f7c3c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c52ffd700 1 --2- 172.21.15.80:0/543890233 >> v2:172.21.15.174:3300/0 conn(0x7f7c5415f100 0x7f7c5406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c3c00f740 tx=0x7f7c3c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c52ffd700 1 --2- 172.21.15.80:0/543890233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c5415f100 0x7f7c5406bdb0 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f7c3c00f740 tx=0x7f7c3c00fae0).ready entity=mon.1 client_cookie=9e26e2a49d3a6077 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:32.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c52ffd700 1 --2- 172.21.15.80:0/543890233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c5415f100 0x7f7c5406bdb0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f7c3c00f740 tx=0x7f7c3c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c527fc700 1 -- 172.21.15.80:0/543890233 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c3c000960 con 0x7f7c5415f100 2019-11-28T11:25:32.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c52ffd700 1 --2- 172.21.15.80:0/543890233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c5415f100 0x7f7c5406bdb0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f7c3c00f740 tx=0x7f7c3c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.754+0000 7f7c52ffd700 1 --2- 172.21.15.80:0/543890233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c5415f100 0x7f7c5406bdb0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f7c3c00f740 tx=0x7f7c3c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.755+0000 7f7c527fc700 1 -- 172.21.15.80:0/543890233 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c000c90 con 0x7f7c5415f100 2019-11-28T11:25:32.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.755+0000 7f7c527fc700 1 -- 172.21.15.80:0/543890233 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c3c0013a0 con 0x7f7c5415f100 2019-11-28T11:25:32.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.755+0000 7f7c593f2700 1 -- 172.21.15.80:0/543890233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c5415f100 msgr2=0x7f7c5406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.755+0000 7f7c593f2700 1 --2- 172.21.15.80:0/543890233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c5415f100 0x7f7c5406bdb0 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f7c3c00f740 tx=0x7f7c3c00fae0).stop 2019-11-28T11:25:32.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.755+0000 7f7c593f2700 1 -- 172.21.15.80:0/543890233 shutdown_connections 2019-11-28T11:25:32.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.755+0000 7f7c593f2700 1 --2- 172.21.15.80:0/543890233 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5406c2f0 0x7f7c5406c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:32.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.755+0000 7f7c593f2700 1 --2- 172.21.15.80:0/543890233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c5415f100 0x7f7c5406bdb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:32.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.755+0000 7f7c593f2700 1 -- 172.21.15.80:0/543890233 shutdown_connections 2019-11-28T11:25:32.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.755+0000 7f7c593f2700 1 -- 172.21.15.80:0/543890233 wait complete. 2019-11-28T11:25:32.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.755+0000 7f7c593f2700 1 -- 172.21.15.80:0/543890233 >> 172.21.15.80:0/543890233 conn(0x7f7c54061d20 msgr2=0x7f7c540641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:32.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.758+0000 7f7c593f2700 1 Processor -- start 2019-11-28T11:25:32.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.758+0000 7f7c593f2700 1 -- start start 2019-11-28T11:25:32.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c593f2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5410ed60 0x7f7c5410f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:32.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c593f2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c5410f730 0x7f7c54167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:32.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c593f2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5410c250 con 0x7f7c5410e970 2019-11-28T11:25:32.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c593f2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5410e430 con 0x7f7c5410f730 2019-11-28T11:25:32.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c593f2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54105860 con 0x7f7c5410ed60 2019-11-28T11:25:32.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c53fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c5410f730 0x7f7c54167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:32.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c53fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c5410f730 0x7f7c54167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59664/0 (socket says 172.21.15.80:59664) 2019-11-28T11:25:32.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c53fff700 1 -- 172.21.15.80:0/1209459918 learned_addr learned my addr 172.21.15.80:0/1209459918 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:32.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c52ffd700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5410ed60 0x7f7c5410f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:32.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c53fff700 1 -- 172.21.15.80:0/1209459918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5410ed60 msgr2=0x7f7c5410f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c53fff700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5410ed60 0x7f7c5410f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:32.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c53fff700 1 -- 172.21.15.80:0/1209459918 >> v1:172.21.15.174:6789/0 conn(0x7f7c5410e970 legacy=0x7f7c541087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c53fff700 1 -- 172.21.15.80:0/1209459918 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c54105ef0 con 0x7f7c5410f730 2019-11-28T11:25:32.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c53fff700 1 --2- 172.21.15.80:0/1209459918 >> v2:172.21.15.80:3300/0 conn(0x7f7c5410f730 0x7f7c54167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c4c0107b0 tx=0x7f7c4c010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c53fff700 1 --2- 172.21.15.80:0/1209459918 >> v2:172.21.15.80:3300/0 conn(0x7f7c5410f730 0x7f7c54167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c4c0107b0 tx=0x7f7c4c010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c53fff700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c5410f730 0x7f7c54167d70 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f7c4c0107b0 tx=0x7f7c4c010630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:32.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c53fff700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c5410f730 0x7f7c54167d70 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f7c4c0107b0 tx=0x7f7c4c010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c4bfff700 1 -- 172.21.15.80:0/1209459918 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c4c00aad0 con 0x7f7c5410f730 2019-11-28T11:25:32.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c53fff700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c5410f730 0x7f7c54167d70 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f7c4c0107b0 tx=0x7f7c4c010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c53fff700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c5410f730 0x7f7c54167d70 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f7c4c0107b0 tx=0x7f7c4c010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c4bfff700 1 -- 172.21.15.80:0/1209459918 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c009930 con 0x7f7c5410f730 2019-11-28T11:25:32.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c4bfff700 1 -- 172.21.15.80:0/1209459918 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c4c009fc0 con 0x7f7c5410f730 2019-11-28T11:25:32.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c593f2700 1 -- 172.21.15.80:0/1209459918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c54106270 con 0x7f7c5410f730 2019-11-28T11:25:32.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.759+0000 7f7c593f2700 1 -- 172.21.15.80:0/1209459918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c54105ef0 con 0x7f7c5410f730 2019-11-28T11:25:32.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.760+0000 7f7c53fff700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c5410f730 0x7f7c54167d70 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f7c4c0107b0 tx=0x7f7c4c010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.760+0000 7f7c4bfff700 1 -- 172.21.15.80:0/1209459918 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7c4c0099d0 con 0x7f7c5410f730 2019-11-28T11:25:32.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.760+0000 7f7c53fff700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c5410f730 0x7f7c54167d70 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f7c4c0107b0 tx=0x7f7c4c010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.761+0000 7f7c4bfff700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7c38018730 0x7f7c3801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:32.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.761+0000 7f7c4bfff700 1 -- 172.21.15.80:0/1209459918 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f7c4c031db0 con 0x7f7c5410f730 2019-11-28T11:25:32.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.761+0000 7f7c537fe700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7c38018730 0x7f7c3801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:32.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.761+0000 7f7c537fe700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7c38018730 0x7f7c3801abc0 crc :-1 s=READY pgs=86 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:32.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.768+0000 7f7c593f2700 1 -- 172.21.15.80:0/1209459918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c54106270 con 0x7f7c5410f730 2019-11-28T11:25:32.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.771+0000 7f7c53fff700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c5410f730 0x7f7c54167d70 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f7c4c0107b0 tx=0x7f7c4c010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.771+0000 7f7c4bfff700 1 -- 172.21.15.80:0/1209459918 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7c4c000df0 con 0x7f7c5410f730 2019-11-28T11:25:32.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.938+0000 7f7c593f2700 1 -- 172.21.15.80:0/1209459918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f7c54105ef0 con 0x7f7c5410f730 2019-11-28T11:25:32.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.938+0000 7f7c53fff700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c5410f730 0x7f7c54167d70 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f7c4c0107b0 tx=0x7f7c4c010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:32.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.938+0000 7f7c4bfff700 1 -- 172.21.15.80:0/1209459918 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7c4c009930 con 0x7f7c5410f730 2019-11-28T11:25:32.958 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:32.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.940+0000 7f7c593f2700 1 -- 172.21.15.80:0/1209459918 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7c38018730 msgr2=0x7f7c3801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.940+0000 7f7c593f2700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7c38018730 0x7f7c3801abc0 crc :-1 s=READY pgs=86 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:32.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.940+0000 7f7c593f2700 1 -- 172.21.15.80:0/1209459918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c5410f730 msgr2=0x7f7c54167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:32.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.940+0000 7f7c593f2700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c5410f730 0x7f7c54167d70 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f7c4c0107b0 tx=0x7f7c4c010630).stop 2019-11-28T11:25:32.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.940+0000 7f7c593f2700 1 -- 172.21.15.80:0/1209459918 shutdown_connections 2019-11-28T11:25:32.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.940+0000 7f7c593f2700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c5410f730 0x7f7c54167d70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:32.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.940+0000 7f7c593f2700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c5410ed60 0x7f7c5410f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:32.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.940+0000 7f7c593f2700 1 --2- 172.21.15.80:0/1209459918 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7c38018730 0x7f7c3801abc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:32.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.941+0000 7f7c593f2700 1 -- 172.21.15.80:0/1209459918 shutdown_connections 2019-11-28T11:25:32.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.941+0000 7f7c593f2700 1 -- 172.21.15.80:0/1209459918 wait complete. 2019-11-28T11:25:32.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:32.941+0000 7f7c593f2700 1 -- 172.21.15.80:0/1209459918 >> 172.21.15.80:0/1209459918 conn(0x7f7c5415e2d0 msgr2=0x7f7c54147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:32.970 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:25:33.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.073+0000 7f1931bcb700 1 Processor -- start 2019-11-28T11:25:33.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.073+0000 7f1931bcb700 1 -- start start 2019-11-28T11:25:33.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.074+0000 7f1931bcb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f192c06c0a0 0x7f192c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:33.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.074+0000 7f1931bcb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f192c0734e0 0x7f192c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:33.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.074+0000 7f1931bcb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c072360 0x7f192c072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:33.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.074+0000 7f1931bcb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192c06fd60 con 0x7f192c06c0a0 2019-11-28T11:25:33.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.074+0000 7f1931bcb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192c070030 con 0x7f192c0734e0 2019-11-28T11:25:33.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.074+0000 7f1931bcb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192c06f330 con 0x7f192c072360 2019-11-28T11:25:33.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.074+0000 7f192bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f192c06c0a0 0x7f192c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:33.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.074+0000 7f192bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f192c06c0a0 0x7f192c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59668/0 (socket says 172.21.15.80:59668) 2019-11-28T11:25:33.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.074+0000 7f192bfff700 1 -- 172.21.15.80:0/942381274 learned_addr learned my addr 172.21.15.80:0/942381274 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:33.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f1930969700 1 --2- 172.21.15.80:0/942381274 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c072360 0x7f192c072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:33.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f1923fff700 1 --2- 172.21.15.80:0/942381274 >> v2:172.21.15.174:3300/0 conn(0x7f192c0734e0 0x7f192c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:33.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f192bfff700 1 -- 172.21.15.80:0/942381274 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c072360 msgr2=0x7f192c072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:33.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f192bfff700 1 --2- 172.21.15.80:0/942381274 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c072360 0x7f192c072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:33.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f192bfff700 1 -- 172.21.15.80:0/942381274 >> v2:172.21.15.174:3300/0 conn(0x7f192c0734e0 msgr2=0x7f192c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:33.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f192bfff700 1 --2- 172.21.15.80:0/942381274 >> v2:172.21.15.174:3300/0 conn(0x7f192c0734e0 0x7f192c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:33.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f192bfff700 1 -- 172.21.15.80:0/942381274 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c0706c0 con 0x7f192c06c0a0 2019-11-28T11:25:33.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f1930969700 1 --2- 172.21.15.80:0/942381274 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c072360 0x7f192c072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:25:33.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f1923fff700 1 --2- 172.21.15.80:0/942381274 >> v2:172.21.15.174:3300/0 conn(0x7f192c0734e0 0x7f192c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:25:33.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f192bfff700 1 --2- 172.21.15.80:0/942381274 >> v2:172.21.15.80:3300/0 conn(0x7f192c06c0a0 0x7f192c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f191c00f740 tx=0x7f191c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:33.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f192bfff700 1 --2- 172.21.15.80:0/942381274 >> v2:172.21.15.80:3300/0 conn(0x7f192c06c0a0 0x7f192c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f191c00f740 tx=0x7f191c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:33.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f192bfff700 1 --2- 172.21.15.80:0/942381274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f192c06c0a0 0x7f192c072fa0 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f191c00f740 tx=0x7f191c00fae0).ready entity=mon.0 client_cookie=46c58c8e0c089a3d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:33.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f192bfff700 1 --2- 172.21.15.80:0/942381274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f192c06c0a0 0x7f192c072fa0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f191c00f740 tx=0x7f191c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:33.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f192bfff700 1 --2- 172.21.15.80:0/942381274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f192c06c0a0 0x7f192c072fa0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f191c00f740 tx=0x7f191c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:33.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f192b7fe700 1 -- 172.21.15.80:0/942381274 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f191c000960 con 0x7f192c06c0a0 2019-11-28T11:25:33.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f192bfff700 1 --2- 172.21.15.80:0/942381274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f192c06c0a0 0x7f192c072fa0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f191c00f740 tx=0x7f191c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:33.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f192b7fe700 1 -- 172.21.15.80:0/942381274 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c000e80 con 0x7f192c06c0a0 2019-11-28T11:25:33.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f192b7fe700 1 -- 172.21.15.80:0/942381274 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f191c0015d0 con 0x7f192c06c0a0 2019-11-28T11:25:33.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f1931bcb700 1 -- 172.21.15.80:0/942381274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f192c06c0a0 msgr2=0x7f192c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:33.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.075+0000 7f1931bcb700 1 --2- 172.21.15.80:0/942381274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f192c06c0a0 0x7f192c072fa0 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f191c00f740 tx=0x7f191c00fae0).stop 2019-11-28T11:25:33.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.076+0000 7f1931bcb700 1 -- 172.21.15.80:0/942381274 shutdown_connections 2019-11-28T11:25:33.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.076+0000 7f1931bcb700 1 --2- 172.21.15.80:0/942381274 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c072360 0x7f192c072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:33.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.076+0000 7f1931bcb700 1 --2- 172.21.15.80:0/942381274 >> v2:172.21.15.174:3300/0 conn(0x7f192c0734e0 0x7f192c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:33.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.076+0000 7f1931bcb700 1 --2- 172.21.15.80:0/942381274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f192c06c0a0 0x7f192c072fa0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:33.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.076+0000 7f1931bcb700 1 -- 172.21.15.80:0/942381274 shutdown_connections 2019-11-28T11:25:33.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.076+0000 7f1931bcb700 1 -- 172.21.15.80:0/942381274 wait complete. 2019-11-28T11:25:33.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.076+0000 7f1931bcb700 1 -- 172.21.15.80:0/942381274 >> 172.21.15.80:0/942381274 conn(0x7f192c061cf0 msgr2=0x7f192c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:33.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.078+0000 7f1931bcb700 1 Processor -- start 2019-11-28T11:25:33.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.078+0000 7f1931bcb700 1 -- start start 2019-11-28T11:25:33.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.079+0000 7f1931bcb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c166a10 0x7f192c168e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:33.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.079+0000 7f1931bcb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192c13bcd0 con 0x7f192c104c10 2019-11-28T11:25:33.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.079+0000 7f1931bcb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192c105ea0 con 0x7f192c104820 2019-11-28T11:25:33.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.079+0000 7f1931bcb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192c109130 con 0x7f192c166a10 2019-11-28T11:25:33.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.079+0000 7f1923fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f192c104c10 0x7f192c1050a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:58994/0 (socket says 172.21.15.80:58994) 2019-11-28T11:25:33.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.079+0000 7f1923fff700 1 -- 172.21.15.80:0/1369458823 learned_addr learned my addr 172.21.15.80:0/1369458823 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:33.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.079+0000 7f1930969700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c166a10 0x7f192c168e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:33.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f19297fa700 1 -- 172.21.15.80:0/1369458823 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412561841 0 0) 0x7f1914000ea0 con 0x7f192c104c10 2019-11-28T11:25:33.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f19297fa700 1 -- 172.21.15.80:0/1369458823 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1910002e80 con 0x7f192c104c10 2019-11-28T11:25:33.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f19297fa700 1 -- 172.21.15.80:0/1369458823 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557020438 0 0) 0x7f191c008020 con 0x7f192c104820 2019-11-28T11:25:33.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f19297fa700 1 -- 172.21.15.80:0/1369458823 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1910004220 con 0x7f192c104820 2019-11-28T11:25:33.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f1930969700 1 -- 172.21.15.80:0/1369458823 >> v1:172.21.15.174:6789/0 conn(0x7f192c104820 legacy=0x7f192c10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:33.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f1930969700 1 -- 172.21.15.80:0/1369458823 >> v1:172.21.15.80:6789/0 conn(0x7f192c104c10 legacy=0x7f192c1050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:33.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f1930969700 1 -- 172.21.15.80:0/1369458823 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c109a90 con 0x7f192c166a10 2019-11-28T11:25:33.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f1930969700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c166a10 0x7f192c168e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1924010740 tx=0x7f1924010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:33.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f1930969700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c166a10 0x7f192c168e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1924010740 tx=0x7f1924010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:33.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f1930969700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c166a10 0x7f192c168e10 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f1924010740 tx=0x7f1924010ae0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:33.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f1930969700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c166a10 0x7f192c168e10 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1924010740 tx=0x7f1924010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:33.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f19297fa700 1 -- 172.21.15.80:0/1369458823 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f192400c300 con 0x7f192c166a10 2019-11-28T11:25:33.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f1930969700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c166a10 0x7f192c168e10 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1924010740 tx=0x7f1924010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:33.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f19297fa700 1 -- 172.21.15.80:0/1369458823 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192400bf20 con 0x7f192c166a10 2019-11-28T11:25:33.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f1930969700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c166a10 0x7f192c168e10 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1924010740 tx=0x7f1924010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:33.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f1931bcb700 1 -- 172.21.15.80:0/1369458823 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192c109e10 con 0x7f192c166a10 2019-11-28T11:25:33.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f19297fa700 1 -- 172.21.15.80:0/1369458823 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f192400c590 con 0x7f192c166a10 2019-11-28T11:25:33.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f1931bcb700 1 -- 172.21.15.80:0/1369458823 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192c109a90 con 0x7f192c166a10 2019-11-28T11:25:33.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.080+0000 7f1930969700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c166a10 0x7f192c168e10 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1924010740 tx=0x7f1924010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:33.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.081+0000 7f19297fa700 1 -- 172.21.15.80:0/1369458823 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f192400c1b0 con 0x7f192c166a10 2019-11-28T11:25:33.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.081+0000 7f1930969700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c166a10 0x7f192c168e10 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1924010740 tx=0x7f1924010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:33.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.081+0000 7f19297fa700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1910018750 0x7f191001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:33.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.081+0000 7f19297fa700 1 -- 172.21.15.80:0/1369458823 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f1924031e10 con 0x7f192c166a10 2019-11-28T11:25:33.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.081+0000 7f192bfff700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1910018750 0x7f191001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:33.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.081+0000 7f192bfff700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1910018750 0x7f191001abe0 crc :-1 s=READY pgs=87 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:33.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.088+0000 7f1931bcb700 1 -- 172.21.15.80:0/1369458823 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192c109e10 con 0x7f192c166a10 2019-11-28T11:25:33.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.092+0000 7f1930969700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c166a10 0x7f192c168e10 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1924010740 tx=0x7f1924010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:33.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.092+0000 7f19297fa700 1 -- 172.21.15.80:0/1369458823 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f192400bd10 con 0x7f192c166a10 2019-11-28T11:25:33.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.264+0000 7f1931bcb700 1 -- 172.21.15.80:0/1369458823 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f192c109a90 con 0x7f192c166a10 2019-11-28T11:25:33.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.265+0000 7f1930969700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c166a10 0x7f192c168e10 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f1924010740 tx=0x7f1924010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:33.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.265+0000 7f19297fa700 1 -- 172.21.15.80:0/1369458823 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2441 (secure 0 0 0) 0x7f192400c110 con 0x7f192c166a10 2019-11-28T11:25:33.286 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 6 2019-11-28T11:25:33.287 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:33.287 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/3100151299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3100151299},{"type":"v1","addr":"172.21.15.80:6833","nonce":3100151299}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4},{"gid":4359,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/4212336515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":4212336515},{"type":"v1","addr":"172.21.15.80:6835","nonce":4212336515}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:25:19.931718+0000","modified":"2019-11-28T11:25:28.542379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4229":{"gid":4229,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2081356472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2081356472},{"type":"v1","addr":"172.21.15.174:6835","nonce":2081356472}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-11-28T11:25:33.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.267+0000 7f1931bcb700 1 -- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1910018750 msgr2=0x7f191001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:33.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.267+0000 7f1931bcb700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1910018750 0x7f191001abe0 crc :-1 s=READY pgs=87 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:33.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.267+0000 7f1931bcb700 1 -- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c166a10 msgr2=0x7f192c168e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:33.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.267+0000 7f1931bcb700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c166a10 0x7f192c168e10 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f1924010740 tx=0x7f1924010ae0).stop 2019-11-28T11:25:33.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.267+0000 7f1931bcb700 1 -- 172.21.15.80:0/1369458823 shutdown_connections 2019-11-28T11:25:33.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.267+0000 7f1931bcb700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f192c166a10 0x7f192c168e10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:33.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.267+0000 7f1931bcb700 1 --2- 172.21.15.80:0/1369458823 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1910018750 0x7f191001abe0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:33.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.267+0000 7f1931bcb700 1 -- 172.21.15.80:0/1369458823 shutdown_connections 2019-11-28T11:25:33.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.267+0000 7f1931bcb700 1 -- 172.21.15.80:0/1369458823 wait complete. 2019-11-28T11:25:33.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:33.267+0000 7f1931bcb700 1 -- 172.21.15.80:0/1369458823 >> 172.21.15.80:0/1369458823 conn(0x7f192c13d620 msgr2=0x7f192c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:33.600 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4229}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4229': {u'export_targets': [], u'name': u'c', u'incarnation': 5, u'state_seq': 3, u'state': u'up:active', u'gid': 4229, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2081356472, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2081356472, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2081356472'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:25:19.931718+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:25:28.542379+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:25:33.601 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:25:33.601 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:25:33.741 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:25:33.741 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:25:33.741 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:25:33.741 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 4229, 2019-11-28T11:25:33.741 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:25:33.742 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:25:33.742 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 6.1800114439999998, 2019-11-28T11:25:33.742 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 6, 2019-11-28T11:25:33.742 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 25, 2019-11-28T11:25:33.742 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 25, 2019-11-28T11:25:33.742 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 11.001839255 2019-11-28T11:25:33.742 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:25:33.746 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 4229, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.1800114439999998, "mdsmap_epoch": 6, "osdmap_epoch": 25, "osdmap_epoch_barrier": 25, "uptime": 11.001839255 } 2019-11-28T11:25:33.747 INFO:teuthology.run_tasks:Running task kclient... 2019-11-28T11:25:34.246 INFO:tasks.kclient:Mounting kernel clients... 2019-11-28T11:25:34.247 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:34.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.347+0000 7fd401bfc700 1 Processor -- start 2019-11-28T11:25:34.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.347+0000 7fd401bfc700 1 -- start start 2019-11-28T11:25:34.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.348+0000 7fd401bfc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3fc06c0a0 0x7fd3fc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:34.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.348+0000 7fd401bfc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3fc072620 0x7fd3fc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:34.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.348+0000 7fd401bfc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3fc06db00 con 0x7fd3fc0734e0 2019-11-28T11:25:34.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.348+0000 7fd401bfc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3fc06fd60 con 0x7fd3fc06c0a0 2019-11-28T11:25:34.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.348+0000 7fd401bfc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc070030 con 0x7fd3fc072620 2019-11-28T11:25:34.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.348+0000 7fd3fbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3fc06c0a0 0x7fd3fc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:34.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.348+0000 7fd3fbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3fc06c0a0 0x7fd3fc072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59682/0 (socket says 172.21.15.80:59682) 2019-11-28T11:25:34.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.348+0000 7fd3fbfff700 1 -- 172.21.15.80:0/532276372 learned_addr learned my addr 172.21.15.80:0/532276372 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:34.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.348+0000 7fd40099a700 1 --2- 172.21.15.80:0/532276372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3fc072620 0x7fd3fc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:34.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.348+0000 7fd3fbfff700 1 -- 172.21.15.80:0/532276372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3fc072620 msgr2=0x7fd3fc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:34.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.348+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/532276372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3fc072620 0x7fd3fc164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:34.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.348+0000 7fd3fbfff700 1 -- 172.21.15.80:0/532276372 >> v1:172.21.15.174:6789/0 conn(0x7fd3fc0734e0 legacy=0x7fd3fc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:34.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.348+0000 7fd3fbfff700 1 -- 172.21.15.80:0/532276372 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc0706c0 con 0x7fd3fc06c0a0 2019-11-28T11:25:34.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.349+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/532276372 >> v2:172.21.15.80:3300/0 conn(0x7fd3fc06c0a0 0x7fd3fc072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd3ec00f6c0 tx=0x7fd3ec00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.349+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/532276372 >> v2:172.21.15.80:3300/0 conn(0x7fd3fc06c0a0 0x7fd3fc072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd3ec00f6c0 tx=0x7fd3ec00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.349+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/532276372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc06c0a0 0x7fd3fc072fa0 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7fd3ec00f6c0 tx=0x7fd3ec00fa60).ready entity=mon.0 client_cookie=9b126699bdd4e120 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:34.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.349+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/532276372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc06c0a0 0x7fd3fc072fa0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7fd3ec00f6c0 tx=0x7fd3ec00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.349+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/532276372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc06c0a0 0x7fd3fc072fa0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7fd3ec00f6c0 tx=0x7fd3ec00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.349+0000 7fd3fb7fe700 1 -- 172.21.15.80:0/532276372 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3ec000960 con 0x7fd3fc06c0a0 2019-11-28T11:25:34.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.349+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/532276372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc06c0a0 0x7fd3fc072fa0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7fd3ec00f6c0 tx=0x7fd3ec00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.349+0000 7fd3fb7fe700 1 -- 172.21.15.80:0/532276372 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec000c90 con 0x7fd3fc06c0a0 2019-11-28T11:25:34.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.349+0000 7fd3fb7fe700 1 -- 172.21.15.80:0/532276372 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3ec0013a0 con 0x7fd3fc06c0a0 2019-11-28T11:25:34.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.349+0000 7fd401bfc700 1 -- 172.21.15.80:0/532276372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc06c0a0 msgr2=0x7fd3fc072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:34.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.349+0000 7fd401bfc700 1 --2- 172.21.15.80:0/532276372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc06c0a0 0x7fd3fc072fa0 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7fd3ec00f6c0 tx=0x7fd3ec00fa60).stop 2019-11-28T11:25:34.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.350+0000 7fd401bfc700 1 -- 172.21.15.80:0/532276372 shutdown_connections 2019-11-28T11:25:34.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.350+0000 7fd401bfc700 1 --2- 172.21.15.80:0/532276372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3fc072620 0x7fd3fc164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:34.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.350+0000 7fd401bfc700 1 --2- 172.21.15.80:0/532276372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc06c0a0 0x7fd3fc072fa0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:34.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.350+0000 7fd401bfc700 1 -- 172.21.15.80:0/532276372 shutdown_connections 2019-11-28T11:25:34.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.350+0000 7fd401bfc700 1 -- 172.21.15.80:0/532276372 wait complete. 2019-11-28T11:25:34.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.350+0000 7fd401bfc700 1 -- 172.21.15.80:0/532276372 >> 172.21.15.80:0/532276372 conn(0x7fd3fc061cf0 msgr2=0x7fd3fc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:34.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.352+0000 7fd401bfc700 1 Processor -- start 2019-11-28T11:25:34.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.352+0000 7fd401bfc700 1 -- start start 2019-11-28T11:25:34.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd401bfc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3fc104820 0x7fd3fc10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:34.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd401bfc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd3fc10c890 0x7fd3fc10b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:34.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd401bfc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3fc13bcd0 con 0x7fd3fc10b710 2019-11-28T11:25:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd401bfc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3fc109130 con 0x7fd3fc104820 2019-11-28T11:25:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd401bfc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3fc109400 con 0x7fd3fc10c890 2019-11-28T11:25:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3fbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3fc104820 0x7fd3fc10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3fbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3fc104820 0x7fd3fc10c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59688/0 (socket says 172.21.15.80:59688) 2019-11-28T11:25:34.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3fbfff700 1 -- 172.21.15.80:0/3782610913 learned_addr learned my addr 172.21.15.80:0/3782610913 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:34.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3f3fff700 1 --2- 172.21.15.80:0/3782610913 >> v2:172.21.15.174:3300/0 conn(0x7fd3fc10c890 0x7fd3fc10b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:34.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3fbfff700 1 -- 172.21.15.80:0/3782610913 >> v2:172.21.15.174:3300/0 conn(0x7fd3fc10c890 msgr2=0x7fd3fc10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:34.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/3782610913 >> v2:172.21.15.174:3300/0 conn(0x7fd3fc10c890 0x7fd3fc10b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:34.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3fbfff700 1 -- 172.21.15.80:0/3782610913 >> v1:172.21.15.174:6789/0 conn(0x7fd3fc10b710 legacy=0x7fd3fc104c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:34.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3fbfff700 1 -- 172.21.15.80:0/3782610913 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc109a90 con 0x7fd3fc104820 2019-11-28T11:25:34.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/3782610913 >> v2:172.21.15.80:3300/0 conn(0x7fd3fc104820 0x7fd3fc10c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3ec010410 tx=0x7fd3ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/3782610913 >> v2:172.21.15.80:3300/0 conn(0x7fd3fc104820 0x7fd3fc10c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3ec010410 tx=0x7fd3ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/3782610913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc104820 0x7fd3fc10c350 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7fd3ec010410 tx=0x7fd3ec010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:34.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/3782610913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc104820 0x7fd3fc10c350 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fd3ec010410 tx=0x7fd3ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/3782610913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc104820 0x7fd3fc10c350 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fd3ec010410 tx=0x7fd3ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3f97fa700 1 -- 172.21.15.80:0/3782610913 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3ec005770 con 0x7fd3fc104820 2019-11-28T11:25:34.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/3782610913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc104820 0x7fd3fc10c350 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fd3ec010410 tx=0x7fd3ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3f97fa700 1 -- 172.21.15.80:0/3782610913 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec005390 con 0x7fd3fc104820 2019-11-28T11:25:34.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd3f97fa700 1 -- 172.21.15.80:0/3782610913 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3ec005d50 con 0x7fd3fc104820 2019-11-28T11:25:34.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd401bfc700 1 -- 172.21.15.80:0/3782610913 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3fc109e10 con 0x7fd3fc104820 2019-11-28T11:25:34.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.353+0000 7fd401bfc700 1 -- 172.21.15.80:0/3782610913 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3fc109a90 con 0x7fd3fc104820 2019-11-28T11:25:34.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.354+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/3782610913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc104820 0x7fd3fc10c350 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fd3ec010410 tx=0x7fd3ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.354+0000 7fd3f97fa700 1 -- 172.21.15.80:0/3782610913 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd3ec005580 con 0x7fd3fc104820 2019-11-28T11:25:34.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.354+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/3782610913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc104820 0x7fd3fc10c350 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fd3ec010410 tx=0x7fd3ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.354+0000 7fd3f97fa700 1 --2- 172.21.15.80:0/3782610913 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3d4018730 0x7fd3d401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:34.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.354+0000 7fd3f97fa700 1 -- 172.21.15.80:0/3782610913 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fd3ec031aa0 con 0x7fd3fc104820 2019-11-28T11:25:34.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.354+0000 7fd3f3fff700 1 --2- 172.21.15.80:0/3782610913 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3d4018730 0x7fd3d401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:34.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.355+0000 7fd3f3fff700 1 --2- 172.21.15.80:0/3782610913 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3d4018730 0x7fd3d401abc0 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:34.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.362+0000 7fd401bfc700 1 -- 172.21.15.80:0/3782610913 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3fc109e10 con 0x7fd3fc104820 2019-11-28T11:25:34.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.365+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/3782610913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc104820 0x7fd3fc10c350 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fd3ec010410 tx=0x7fd3ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.365+0000 7fd3f97fa700 1 -- 172.21.15.80:0/3782610913 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd3ec005180 con 0x7fd3fc104820 2019-11-28T11:25:34.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.541+0000 7fd401bfc700 1 -- 172.21.15.80:0/3782610913 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3fc109a90 con 0x7fd3fc104820 2019-11-28T11:25:34.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.542+0000 7fd3fbfff700 1 --2- 172.21.15.80:0/3782610913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc104820 0x7fd3fc10c350 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fd3ec010410 tx=0x7fd3ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.542+0000 7fd3f97fa700 1 -- 172.21.15.80:0/3782610913 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14885 (secure 0 0 0) 0x7fd3ec005580 con 0x7fd3fc104820 2019-11-28T11:25:34.562 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:34.564 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:20.933435+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:25:14.914696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-11-28T11:25:17.566323+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:34.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.544+0000 7fd401bfc700 1 -- 172.21.15.80:0/3782610913 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3d4018730 msgr2=0x7fd3d401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:34.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.544+0000 7fd401bfc700 1 --2- 172.21.15.80:0/3782610913 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3d4018730 0x7fd3d401abc0 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:34.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.544+0000 7fd401bfc700 1 -- 172.21.15.80:0/3782610913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc104820 msgr2=0x7fd3fc10c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:34.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.544+0000 7fd401bfc700 1 --2- 172.21.15.80:0/3782610913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc104820 0x7fd3fc10c350 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7fd3ec010410 tx=0x7fd3ec010290).stop 2019-11-28T11:25:34.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.544+0000 7fd401bfc700 1 -- 172.21.15.80:0/3782610913 shutdown_connections 2019-11-28T11:25:34.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.544+0000 7fd401bfc700 1 --2- 172.21.15.80:0/3782610913 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3d4018730 0x7fd3d401abc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:34.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.544+0000 7fd401bfc700 1 --2- 172.21.15.80:0/3782610913 >> v2:172.21.15.174:3300/0 conn(0x7fd3fc10c890 0x7fd3fc10b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:34.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.544+0000 7fd401bfc700 1 --2- 172.21.15.80:0/3782610913 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3fc104820 0x7fd3fc10c350 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:34.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.544+0000 7fd401bfc700 1 -- 172.21.15.80:0/3782610913 shutdown_connections 2019-11-28T11:25:34.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.544+0000 7fd401bfc700 1 -- 172.21.15.80:0/3782610913 wait complete. 2019-11-28T11:25:34.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.544+0000 7fd401bfc700 1 -- 172.21.15.80:0/3782610913 >> 172.21.15.80:0/3782610913 conn(0x7fd3fc13d620 msgr2=0x7fd3fc13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:34.574 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:14.914696+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:17.566323+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:25:34.575 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:25:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.678+0000 7f4f589d0700 1 Processor -- start 2019-11-28T11:25:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.678+0000 7f4f589d0700 1 -- start start 2019-11-28T11:25:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f589d0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4f5415ed10 0x7f4f5415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f589d0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f54073020 0x7f4f54071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f589d0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4f540734b0 0x7f4f540723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f589d0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5406fe00 con 0x7f4f5415ed10 2019-11-28T11:25:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f589d0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f540700d0 con 0x7f4f540734b0 2019-11-28T11:25:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f589d0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5406f3d0 con 0x7f4f54073020 2019-11-28T11:25:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f52d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4f5415ed10 0x7f4f5415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f52d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4f5415ed10 0x7f4f5415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59696/0 (socket says 172.21.15.80:59696) 2019-11-28T11:25:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f52d9d700 1 -- 172.21.15.80:0/3971662984 learned_addr learned my addr 172.21.15.80:0/3971662984 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f5359e700 1 --2- 172.21.15.80:0/3971662984 >> v2:172.21.15.174:3300/0 conn(0x7f4f540734b0 0x7f4f540723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f5259c700 1 --2- 172.21.15.80:0/3971662984 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f54073020 0x7f4f54071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f52d9d700 1 -- 172.21.15.80:0/3971662984 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f54073020 msgr2=0x7f4f54071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/3971662984 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f54073020 0x7f4f54071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f52d9d700 1 -- 172.21.15.80:0/3971662984 >> v2:172.21.15.174:3300/0 conn(0x7f4f540734b0 msgr2=0x7f4f540723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/3971662984 >> v2:172.21.15.174:3300/0 conn(0x7f4f540734b0 0x7f4f540723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f52d9d700 1 -- 172.21.15.80:0/3971662984 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f54070760 con 0x7f4f5415ed10 2019-11-28T11:25:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f5359e700 1 --2- 172.21.15.80:0/3971662984 >> v2:172.21.15.174:3300/0 conn(0x7f4f540734b0 0x7f4f540723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f5259c700 1 --2- 172.21.15.80:0/3971662984 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f54073020 0x7f4f54071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/3971662984 >> v2:172.21.15.80:3300/0 conn(0x7f4f5415ed10 0x7f4f5415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4f4800f740 tx=0x7f4f4800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/3971662984 >> v2:172.21.15.80:3300/0 conn(0x7f4f5415ed10 0x7f4f5415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4f4800f740 tx=0x7f4f4800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/3971662984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5415ed10 0x7f4f5415f100 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f4f4800f740 tx=0x7f4f4800fae0).ready entity=mon.0 client_cookie=6358943f8b790701 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/3971662984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5415ed10 0x7f4f5415f100 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f4f4800f740 tx=0x7f4f4800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/3971662984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5415ed10 0x7f4f5415f100 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f4f4800f740 tx=0x7f4f4800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/3971662984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5415ed10 0x7f4f5415f100 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f4f4800f740 tx=0x7f4f4800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.679+0000 7f4f51d9b700 1 -- 172.21.15.80:0/3971662984 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f48000960 con 0x7f4f5415ed10 2019-11-28T11:25:34.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.680+0000 7f4f51d9b700 1 -- 172.21.15.80:0/3971662984 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f48000e80 con 0x7f4f5415ed10 2019-11-28T11:25:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.680+0000 7f4f51d9b700 1 -- 172.21.15.80:0/3971662984 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f480015d0 con 0x7f4f5415ed10 2019-11-28T11:25:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.680+0000 7f4f589d0700 1 -- 172.21.15.80:0/3971662984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5415ed10 msgr2=0x7f4f5415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.680+0000 7f4f589d0700 1 --2- 172.21.15.80:0/3971662984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5415ed10 0x7f4f5415f100 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f4f4800f740 tx=0x7f4f4800fae0).stop 2019-11-28T11:25:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.680+0000 7f4f589d0700 1 -- 172.21.15.80:0/3971662984 shutdown_connections 2019-11-28T11:25:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.680+0000 7f4f589d0700 1 --2- 172.21.15.80:0/3971662984 >> v2:172.21.15.174:3300/0 conn(0x7f4f540734b0 0x7f4f540723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.680+0000 7f4f589d0700 1 --2- 172.21.15.80:0/3971662984 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f54073020 0x7f4f54071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.680+0000 7f4f589d0700 1 --2- 172.21.15.80:0/3971662984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5415ed10 0x7f4f5415f100 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:34.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.680+0000 7f4f589d0700 1 -- 172.21.15.80:0/3971662984 shutdown_connections 2019-11-28T11:25:34.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.680+0000 7f4f589d0700 1 -- 172.21.15.80:0/3971662984 wait complete. 2019-11-28T11:25:34.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.680+0000 7f4f589d0700 1 -- 172.21.15.80:0/3971662984 >> 172.21.15.80:0/3971662984 conn(0x7f4f54061d20 msgr2=0x7f4f540641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:34.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.683+0000 7f4f589d0700 1 Processor -- start 2019-11-28T11:25:34.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.683+0000 7f4f589d0700 1 -- start start 2019-11-28T11:25:34.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f589d0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4f54148320 0x7f4f5410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:34.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f589d0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5410f290 0x7f4f5410dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:34.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f589d0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4f5410e110 0x7f4f5410e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:34.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f589d0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5413aa20 con 0x7f4f54148320 2019-11-28T11:25:34.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f589d0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5413acf0 con 0x7f4f5410e110 2019-11-28T11:25:34.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f589d0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f54139ff0 con 0x7f4f5410f290 2019-11-28T11:25:34.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f52d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4f54148320 0x7f4f5410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:34.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f52d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4f54148320 0x7f4f5410ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59702/0 (socket says 172.21.15.80:59702) 2019-11-28T11:25:34.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f52d9d700 1 -- 172.21.15.80:0/829293429 learned_addr learned my addr 172.21.15.80:0/829293429 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f5359e700 1 --2- 172.21.15.80:0/829293429 >> v2:172.21.15.174:3300/0 conn(0x7f4f5410e110 0x7f4f5410e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f5259c700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5410f290 0x7f4f5410dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f52d9d700 1 -- 172.21.15.80:0/829293429 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5410f290 msgr2=0x7f4f5410dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:34.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5410f290 0x7f4f5410dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:34.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f52d9d700 1 -- 172.21.15.80:0/829293429 >> v2:172.21.15.174:3300/0 conn(0x7f4f5410e110 msgr2=0x7f4f5410e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:34.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/829293429 >> v2:172.21.15.174:3300/0 conn(0x7f4f5410e110 0x7f4f5410e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:34.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f52d9d700 1 -- 172.21.15.80:0/829293429 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5410c490 con 0x7f4f54148320 2019-11-28T11:25:34.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/829293429 >> v2:172.21.15.80:3300/0 conn(0x7f4f54148320 0x7f4f5410ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f48010470 tx=0x7f4f48010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/829293429 >> v2:172.21.15.80:3300/0 conn(0x7f4f54148320 0x7f4f5410ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f48010470 tx=0x7f4f48010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f54148320 0x7f4f5410ed50 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7f4f48010470 tx=0x7f4f48010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:34.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f54148320 0x7f4f5410ed50 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f4f48010470 tx=0x7f4f48010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f54148320 0x7f4f5410ed50 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f4f48010470 tx=0x7f4f48010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f54148320 0x7f4f5410ed50 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f4f48010470 tx=0x7f4f48010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f437fe700 1 -- 172.21.15.80:0/829293429 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f48007230 con 0x7f4f54148320 2019-11-28T11:25:34.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f437fe700 1 -- 172.21.15.80:0/829293429 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f48005580 con 0x7f4f54148320 2019-11-28T11:25:34.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f437fe700 1 -- 172.21.15.80:0/829293429 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f48005c50 con 0x7f4f54148320 2019-11-28T11:25:34.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f589d0700 1 -- 172.21.15.80:0/829293429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5410c810 con 0x7f4f54148320 2019-11-28T11:25:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.684+0000 7f4f589d0700 1 -- 172.21.15.80:0/829293429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5410c490 con 0x7f4f54148320 2019-11-28T11:25:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.685+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f54148320 0x7f4f5410ed50 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f4f48010470 tx=0x7f4f48010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.685+0000 7f4f437fe700 1 -- 172.21.15.80:0/829293429 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4f48007230 con 0x7f4f54148320 2019-11-28T11:25:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.685+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f54148320 0x7f4f5410ed50 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f4f48010470 tx=0x7f4f48010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.685+0000 7f4f437fe700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f38018730 0x7f4f3801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.685+0000 7f4f437fe700 1 -- 172.21.15.80:0/829293429 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f4f48031a40 con 0x7f4f54148320 2019-11-28T11:25:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.685+0000 7f4f5259c700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f38018730 0x7f4f3801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.686+0000 7f4f5259c700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f38018730 0x7f4f3801abc0 crc :-1 s=READY pgs=89 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.693+0000 7f4f589d0700 1 -- 172.21.15.80:0/829293429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5410c810 con 0x7f4f54148320 2019-11-28T11:25:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.696+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f54148320 0x7f4f5410ed50 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f4f48010470 tx=0x7f4f48010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.696+0000 7f4f437fe700 1 -- 172.21.15.80:0/829293429 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4f48005180 con 0x7f4f54148320 2019-11-28T11:25:34.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.865+0000 7f4f589d0700 1 -- 172.21.15.80:0/829293429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f4f5410c490 con 0x7f4f54148320 2019-11-28T11:25:34.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.866+0000 7f4f52d9d700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f54148320 0x7f4f5410ed50 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f4f48010470 tx=0x7f4f48010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:34.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.866+0000 7f4f437fe700 1 -- 172.21.15.80:0/829293429 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4f48007230 con 0x7f4f54148320 2019-11-28T11:25:34.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.868+0000 7f4f589d0700 1 -- 172.21.15.80:0/829293429 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f38018730 msgr2=0x7f4f3801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:34.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.868+0000 7f4f589d0700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f38018730 0x7f4f3801abc0 crc :-1 s=READY pgs=89 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:34.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.868+0000 7f4f589d0700 1 -- 172.21.15.80:0/829293429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f54148320 msgr2=0x7f4f5410ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:34.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.868+0000 7f4f589d0700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f54148320 0x7f4f5410ed50 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7f4f48010470 tx=0x7f4f48010270).stop 2019-11-28T11:25:34.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.868+0000 7f4f589d0700 1 -- 172.21.15.80:0/829293429 shutdown_connections 2019-11-28T11:25:34.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.868+0000 7f4f589d0700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f38018730 0x7f4f3801abc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:34.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.868+0000 7f4f589d0700 1 --2- 172.21.15.80:0/829293429 >> v2:172.21.15.174:3300/0 conn(0x7f4f5410e110 0x7f4f5410e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:34.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.868+0000 7f4f589d0700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5410f290 0x7f4f5410dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:34.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.868+0000 7f4f589d0700 1 --2- 172.21.15.80:0/829293429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f54148320 0x7f4f5410ed50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:34.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.868+0000 7f4f589d0700 1 -- 172.21.15.80:0/829293429 shutdown_connections 2019-11-28T11:25:34.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.868+0000 7f4f589d0700 1 -- 172.21.15.80:0/829293429 wait complete. 2019-11-28T11:25:34.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:34.868+0000 7f4f589d0700 1 -- 172.21.15.80:0/829293429 >> 172.21.15.80:0/829293429 conn(0x7f4f5415e2d0 msgr2=0x7f4f54147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:34.910 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:34.911 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:25:35.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.015+0000 7fb9b1e92700 1 Processor -- start 2019-11-28T11:25:35.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.015+0000 7fb9b1e92700 1 -- start start 2019-11-28T11:25:35.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.016+0000 7fb9b1e92700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15f100 0x7fb9ac06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:35.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.016+0000 7fb9b1e92700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac06db60 con 0x7fb9ac15ed10 2019-11-28T11:25:35.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.016+0000 7fb9b1e92700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac06e060 con 0x7fb9ac06c2f0 2019-11-28T11:25:35.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.016+0000 7fb9b1e92700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac06fe00 con 0x7fb9ac15f100 2019-11-28T11:25:35.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.016+0000 7fb9abfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb9ac15ed10 0x7fb9ac073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59026/0 (socket says 172.21.15.80:59026) 2019-11-28T11:25:35.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.016+0000 7fb9abfff700 1 -- 172.21.15.80:0/580246363 learned_addr learned my addr 172.21.15.80:0/580246363 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:35.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9ab7fe700 1 -- 172.21.15.80:0/580246363 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376244230 0 0) 0x7fb99c001150 con 0x7fb9ac15ed10 2019-11-28T11:25:35.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9a3fff700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15f100 0x7fb9ac06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9ab7fe700 1 -- 172.21.15.80:0/580246363 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb998002e80 con 0x7fb9ac15ed10 2019-11-28T11:25:35.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9ab7fe700 1 -- 172.21.15.80:0/580246363 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 526222719 0 0) 0x7fb99c001130 con 0x7fb9ac15ed10 2019-11-28T11:25:35.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9ab7fe700 1 -- 172.21.15.80:0/580246363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15f100 msgr2=0x7fb9ac06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:35.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9ab7fe700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15f100 0x7fb9ac06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:35.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9ab7fe700 1 -- 172.21.15.80:0/580246363 >> v1:172.21.15.174:6789/0 conn(0x7fb9ac06c2f0 legacy=0x7fb9ac06c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9ab7fe700 1 -- 172.21.15.80:0/580246363 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac070760 con 0x7fb9ac15ed10 2019-11-28T11:25:35.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9ab7fe700 1 -- 172.21.15.80:0/580246363 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fb99c0016c0 con 0x7fb9ac15ed10 2019-11-28T11:25:35.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9ab7fe700 1 -- 172.21.15.80:0/580246363 >> v1:172.21.15.80:6789/0 conn(0x7fb9ac15ed10 legacy=0x7fb9ac073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9ab7fe700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb998003a70 0x7fb998005ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:35.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9ab7fe700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb998006680 0x7fb998008b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:35.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9ab7fe700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb998009300 0x7fb99800b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:35.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9ab7fe700 1 -- 172.21.15.80:0/580246363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99800bfe0 con 0x7fb998009300 2019-11-28T11:25:35.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9ab7fe700 1 -- 172.21.15.80:0/580246363 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9980501e0 con 0x7fb998003a70 2019-11-28T11:25:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9ab7fe700 1 -- 172.21.15.80:0/580246363 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb998050410 con 0x7fb998006680 2019-11-28T11:25:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9b0c30700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb998009300 0x7fb99800b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9abfff700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb998003a70 0x7fb998005ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9a3fff700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb998006680 0x7fb998008b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9b0c30700 1 -- 172.21.15.80:0/580246363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb998006680 msgr2=0x7fb998008b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9b0c30700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb998006680 0x7fb998008b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9b0c30700 1 -- 172.21.15.80:0/580246363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb998003a70 msgr2=0x7fb998005ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9b0c30700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb998003a70 0x7fb998005ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9b0c30700 1 -- 172.21.15.80:0/580246363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9980506c0 con 0x7fb998009300 2019-11-28T11:25:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9b0c30700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb998009300 0x7fb99800b7d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb9a400b2d0 tx=0x7fb9a400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9b0c30700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb998009300 0x7fb99800b7d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb9a400b2d0 tx=0x7fb9a400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.017+0000 7fb9b0c30700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb998009300 0x7fb99800b7d0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7fb9a400b2d0 tx=0x7fb9a400b5d0).ready entity=mon.0 client_cookie=a1ade478b830675d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.018+0000 7fb9b0c30700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb998009300 0x7fb99800b7d0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fb9a400b2d0 tx=0x7fb9a400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.018+0000 7fb9ab7fe700 1 -- 172.21.15.80:0/580246363 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9a4009f20 con 0x7fb998009300 2019-11-28T11:25:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.018+0000 7fb9b0c30700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb998009300 0x7fb99800b7d0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fb9a400b2d0 tx=0x7fb9a400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.018+0000 7fb9b0c30700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb998009300 0x7fb99800b7d0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fb9a400b2d0 tx=0x7fb9a400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.018+0000 7fb9ab7fe700 1 -- 172.21.15.80:0/580246363 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a4009b40 con 0x7fb998009300 2019-11-28T11:25:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.018+0000 7fb9ab7fe700 1 -- 172.21.15.80:0/580246363 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9a400a690 con 0x7fb998009300 2019-11-28T11:25:35.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.018+0000 7fb9b1e92700 1 -- 172.21.15.80:0/580246363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb998009300 msgr2=0x7fb99800b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.018+0000 7fb9b1e92700 1 --2- 172.21.15.80:0/580246363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb998009300 0x7fb99800b7d0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7fb9a400b2d0 tx=0x7fb9a400b5d0).stop 2019-11-28T11:25:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.018+0000 7fb9b0c30700 1 -- 172.21.15.80:0/580246363 reap_dead start 2019-11-28T11:25:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.018+0000 7fb9b1e92700 1 -- 172.21.15.80:0/580246363 shutdown_connections 2019-11-28T11:25:35.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.018+0000 7fb9b1e92700 1 -- 172.21.15.80:0/580246363 shutdown_connections 2019-11-28T11:25:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.018+0000 7fb9b1e92700 1 -- 172.21.15.80:0/580246363 wait complete. 2019-11-28T11:25:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.018+0000 7fb9b1e92700 1 -- 172.21.15.80:0/580246363 >> 172.21.15.80:0/580246363 conn(0x7fb9ac061d20 msgr2=0x7fb9ac0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.021+0000 7fb9b1e92700 1 Processor -- start 2019-11-28T11:25:35.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.021+0000 7fb9b1e92700 1 -- start start 2019-11-28T11:25:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9b1e92700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15dd80 0x7fb9ac10f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9b1e92700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac119ad0 con 0x7fb9ac119180 2019-11-28T11:25:35.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9b1e92700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac119fd0 con 0x7fb9ac10ff10 2019-11-28T11:25:35.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9b1e92700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac14cec0 con 0x7fb9ac15dd80 2019-11-28T11:25:35.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9b0c30700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb9ac119180 0x7fb9ac16ada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59042/0 (socket says 172.21.15.80:59042) 2019-11-28T11:25:35.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9b0c30700 1 -- 172.21.15.80:0/1622322249 learned_addr learned my addr 172.21.15.80:0/1622322249 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:35.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9abfff700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15dd80 0x7fb9ac10f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9a97fa700 1 -- 172.21.15.80:0/1622322249 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570018164 0 0) 0x7fb9a4001080 con 0x7fb9ac119180 2019-11-28T11:25:35.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9a97fa700 1 -- 172.21.15.80:0/1622322249 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb990002e80 con 0x7fb9ac119180 2019-11-28T11:25:35.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9a97fa700 1 -- 172.21.15.80:0/1622322249 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290855841 0 0) 0x7fb994000c90 con 0x7fb9ac10ff10 2019-11-28T11:25:35.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9a97fa700 1 -- 172.21.15.80:0/1622322249 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9900030b0 con 0x7fb9ac10ff10 2019-11-28T11:25:35.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9abfff700 1 -- 172.21.15.80:0/1622322249 >> v1:172.21.15.174:6789/0 conn(0x7fb9ac10ff10 legacy=0x7fb9ac118980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9a97fa700 1 -- 172.21.15.80:0/1622322249 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2439221809 0 0) 0x7fb9a40016b0 con 0x7fb9ac119180 2019-11-28T11:25:35.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9abfff700 1 -- 172.21.15.80:0/1622322249 >> v1:172.21.15.80:6789/0 conn(0x7fb9ac119180 legacy=0x7fb9ac16ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9abfff700 1 -- 172.21.15.80:0/1622322249 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac10d500 con 0x7fb9ac15dd80 2019-11-28T11:25:35.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9abfff700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15dd80 0x7fb9ac10f9d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb99c010380 tx=0x7fb99c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9abfff700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15dd80 0x7fb9ac10f9d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb99c010380 tx=0x7fb99c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9abfff700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15dd80 0x7fb9ac10f9d0 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7fb99c010380 tx=0x7fb99c010720).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:35.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.022+0000 7fb9abfff700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15dd80 0x7fb9ac10f9d0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fb99c010380 tx=0x7fb99c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.023+0000 7fb9a97fa700 1 -- 172.21.15.80:0/1622322249 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb99c000c90 con 0x7fb9ac15dd80 2019-11-28T11:25:35.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.023+0000 7fb9abfff700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15dd80 0x7fb9ac10f9d0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fb99c010380 tx=0x7fb99c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.023+0000 7fb9b1e92700 1 -- 172.21.15.80:0/1622322249 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac10d500 con 0x7fb9ac15dd80 2019-11-28T11:25:35.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.023+0000 7fb9a97fa700 1 -- 172.21.15.80:0/1622322249 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99c000c90 con 0x7fb9ac15dd80 2019-11-28T11:25:35.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.023+0000 7fb9abfff700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15dd80 0x7fb9ac10f9d0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fb99c010380 tx=0x7fb99c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.023+0000 7fb9a97fa700 1 -- 172.21.15.80:0/1622322249 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb99c004430 con 0x7fb9ac15dd80 2019-11-28T11:25:35.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.023+0000 7fb9b1e92700 1 -- 172.21.15.80:0/1622322249 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac10d500 con 0x7fb9ac15dd80 2019-11-28T11:25:35.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.023+0000 7fb9abfff700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15dd80 0x7fb9ac10f9d0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fb99c010380 tx=0x7fb99c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.023+0000 7fb9a97fa700 1 -- 172.21.15.80:0/1622322249 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb99c004240 con 0x7fb9ac15dd80 2019-11-28T11:25:35.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.023+0000 7fb9abfff700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15dd80 0x7fb9ac10f9d0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fb99c010380 tx=0x7fb99c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.023+0000 7fb9a97fa700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb990018750 0x7fb99001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:35.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.023+0000 7fb9a97fa700 1 -- 172.21.15.80:0/1622322249 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fb99c031a80 con 0x7fb9ac15dd80 2019-11-28T11:25:35.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.024+0000 7fb9a3fff700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb990018750 0x7fb99001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.024+0000 7fb9a3fff700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb990018750 0x7fb99001abe0 crc :-1 s=READY pgs=90 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:35.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.030+0000 7fb9b1e92700 1 -- 172.21.15.80:0/1622322249 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ac10d500 con 0x7fb9ac15dd80 2019-11-28T11:25:35.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.034+0000 7fb9abfff700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15dd80 0x7fb9ac10f9d0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fb99c010380 tx=0x7fb99c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.034+0000 7fb9a97fa700 1 -- 172.21.15.80:0/1622322249 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb99c001170 con 0x7fb9ac15dd80 2019-11-28T11:25:35.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.202+0000 7fb9b1e92700 1 -- 172.21.15.80:0/1622322249 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fb9ac10d500 con 0x7fb9ac15dd80 2019-11-28T11:25:35.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.202+0000 7fb9abfff700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15dd80 0x7fb9ac10f9d0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fb99c010380 tx=0x7fb99c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.202+0000 7fb9a97fa700 1 -- 172.21.15.80:0/1622322249 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb99c004240 con 0x7fb9ac15dd80 2019-11-28T11:25:35.223 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:35.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.204+0000 7fb9b1e92700 1 -- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb990018750 msgr2=0x7fb99001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.204+0000 7fb9b1e92700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb990018750 0x7fb99001abe0 crc :-1 s=READY pgs=90 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:35.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.204+0000 7fb9b1e92700 1 -- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15dd80 msgr2=0x7fb9ac10f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.204+0000 7fb9b1e92700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15dd80 0x7fb9ac10f9d0 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7fb99c010380 tx=0x7fb99c010720).stop 2019-11-28T11:25:35.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.204+0000 7fb9b1e92700 1 -- 172.21.15.80:0/1622322249 shutdown_connections 2019-11-28T11:25:35.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.204+0000 7fb9b1e92700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb990018750 0x7fb99001abe0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:35.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.204+0000 7fb9b1e92700 1 --2- 172.21.15.80:0/1622322249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9ac15dd80 0x7fb9ac10f9d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:35.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.205+0000 7fb9b1e92700 1 -- 172.21.15.80:0/1622322249 shutdown_connections 2019-11-28T11:25:35.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.205+0000 7fb9b1e92700 1 -- 172.21.15.80:0/1622322249 wait complete. 2019-11-28T11:25:35.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.205+0000 7fb9b1e92700 1 -- 172.21.15.80:0/1622322249 >> 172.21.15.80:0/1622322249 conn(0x7fb9ac07c000 msgr2=0x7fb9ac14b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:35.234 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:25:35.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.375+0000 7f3c74bcc700 1 Processor -- start 2019-11-28T11:25:35.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.375+0000 7f3c74bcc700 1 -- start start 2019-11-28T11:25:35.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.376+0000 7f3c74bcc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c7015f100 0x7f3c7006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:35.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.376+0000 7f3c74bcc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7006db60 con 0x7f3c7015ed10 2019-11-28T11:25:35.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.376+0000 7f3c74bcc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7006e060 con 0x7f3c7006c2f0 2019-11-28T11:25:35.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.376+0000 7f3c74bcc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7006fe00 con 0x7f3c7015f100 2019-11-28T11:25:35.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.376+0000 7f3c6ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3c7015ed10 0x7f3c70073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59046/0 (socket says 172.21.15.80:59046) 2019-11-28T11:25:35.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6ed9d700 1 -- 172.21.15.80:0/1150683772 learned_addr learned my addr 172.21.15.80:0/1150683772 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:35.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6e59c700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c7015f100 0x7f3c7006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 -- 172.21.15.80:0/1150683772 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063120395 0 0) 0x7f3c64001150 con 0x7f3c7015ed10 2019-11-28T11:25:35.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 -- 172.21.15.80:0/1150683772 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c58002e80 con 0x7f3c7015ed10 2019-11-28T11:25:35.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 -- 172.21.15.80:0/1150683772 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259284120 0 0) 0x7f3c68001400 con 0x7f3c7006c2f0 2019-11-28T11:25:35.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 -- 172.21.15.80:0/1150683772 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c580030b0 con 0x7f3c7006c2f0 2019-11-28T11:25:35.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 -- 172.21.15.80:0/1150683772 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1782135873 0 0) 0x7f3c64001130 con 0x7f3c7015ed10 2019-11-28T11:25:35.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 -- 172.21.15.80:0/1150683772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c7015f100 msgr2=0x7f3c7006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:35.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c7015f100 0x7f3c7006bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:35.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 -- 172.21.15.80:0/1150683772 >> v1:172.21.15.174:6789/0 conn(0x7f3c7006c2f0 legacy=0x7f3c7006c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 -- 172.21.15.80:0/1150683772 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c70070760 con 0x7f3c7015ed10 2019-11-28T11:25:35.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 -- 172.21.15.80:0/1150683772 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f3c64001660 con 0x7f3c7015ed10 2019-11-28T11:25:35.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6e59c700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c7015f100 0x7f3c7006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:35.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 -- 172.21.15.80:0/1150683772 >> v1:172.21.15.80:6789/0 conn(0x7f3c7015ed10 legacy=0x7f3c70073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58003b80 0x7f3c58005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:35.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c58006690 0x7f3c58008b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:35.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5804d310 0x7f3c5804f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:35.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 -- 172.21.15.80:0/1150683772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5804fff0 con 0x7f3c58006690 2019-11-28T11:25:35.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 -- 172.21.15.80:0/1150683772 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c580501e0 con 0x7f3c5804d310 2019-11-28T11:25:35.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6dd9b700 1 -- 172.21.15.80:0/1150683772 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c58050410 con 0x7f3c58003b80 2019-11-28T11:25:35.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6e59c700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c58006690 0x7f3c58008b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6ed9d700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58003b80 0x7f3c58005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6f59e700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5804d310 0x7f3c5804f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6e59c700 1 -- 172.21.15.80:0/1150683772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58003b80 msgr2=0x7f3c58005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:35.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6e59c700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c58003b80 0x7f3c58005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:35.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6e59c700 1 -- 172.21.15.80:0/1150683772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5804d310 msgr2=0x7f3c5804f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:35.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6e59c700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5804d310 0x7f3c5804f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:35.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6e59c700 1 -- 172.21.15.80:0/1150683772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c580506c0 con 0x7f3c58006690 2019-11-28T11:25:35.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.377+0000 7f3c6e59c700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c58006690 0x7f3c58008b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3c60005b30 tx=0x7f3c60005e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.378+0000 7f3c6e59c700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c58006690 0x7f3c58008b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3c60005b30 tx=0x7f3c60005e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.378+0000 7f3c6e59c700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c58006690 0x7f3c58008b00 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f3c60005b30 tx=0x7f3c60005e90).ready entity=mon.0 client_cookie=9e4f5dbadfea36fc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:35.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.378+0000 7f3c6e59c700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c58006690 0x7f3c58008b00 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f3c60005b30 tx=0x7f3c60005e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.378+0000 7f3c6dd9b700 1 -- 172.21.15.80:0/1150683772 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c60000940 con 0x7f3c58006690 2019-11-28T11:25:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.378+0000 7f3c6e59c700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c58006690 0x7f3c58008b00 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f3c60005b30 tx=0x7f3c60005e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.378+0000 7f3c6e59c700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c58006690 0x7f3c58008b00 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f3c60005b30 tx=0x7f3c60005e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.378+0000 7f3c6dd9b700 1 -- 172.21.15.80:0/1150683772 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c60009620 con 0x7f3c58006690 2019-11-28T11:25:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.378+0000 7f3c6dd9b700 1 -- 172.21.15.80:0/1150683772 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c60000940 con 0x7f3c58006690 2019-11-28T11:25:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.378+0000 7f3c74bcc700 1 -- 172.21.15.80:0/1150683772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c58006690 msgr2=0x7f3c58008b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.378+0000 7f3c74bcc700 1 --2- 172.21.15.80:0/1150683772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c58006690 0x7f3c58008b00 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f3c60005b30 tx=0x7f3c60005e90).stop 2019-11-28T11:25:35.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.378+0000 7f3c6f59e700 1 -- 172.21.15.80:0/1150683772 reap_dead start 2019-11-28T11:25:35.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.378+0000 7f3c74bcc700 1 -- 172.21.15.80:0/1150683772 shutdown_connections 2019-11-28T11:25:35.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.379+0000 7f3c74bcc700 1 -- 172.21.15.80:0/1150683772 shutdown_connections 2019-11-28T11:25:35.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.379+0000 7f3c74bcc700 1 -- 172.21.15.80:0/1150683772 wait complete. 2019-11-28T11:25:35.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.379+0000 7f3c74bcc700 1 -- 172.21.15.80:0/1150683772 >> 172.21.15.80:0/1150683772 conn(0x7f3c70061d20 msgr2=0x7f3c700641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:35.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.381+0000 7f3c74bcc700 1 Processor -- start 2019-11-28T11:25:35.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.381+0000 7f3c74bcc700 1 -- start start 2019-11-28T11:25:35.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c74bcc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3c70108630 0x7f3c70151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:35.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c74bcc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c70133a20 con 0x7f3c70151740 2019-11-28T11:25:35.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c74bcc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c70109fc0 con 0x7f3c70150ae0 2019-11-28T11:25:35.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c74bcc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c70131980 con 0x7f3c70108630 2019-11-28T11:25:35.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c6ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3c70108630 0x7f3c70151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c6e59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3c70151740 0x7f3c701502e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59058/0 (socket says 172.21.15.80:59058) 2019-11-28T11:25:35.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c6e59c700 1 -- 172.21.15.80:0/1520808512 learned_addr learned my addr 172.21.15.80:0/1520808512 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:35.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c6ed9d700 1 -- 172.21.15.80:0/1520808512 >> v1:172.21.15.174:6789/0 conn(0x7f3c70150ae0 legacy=0x7f3c70167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c6ed9d700 1 -- 172.21.15.80:0/1520808512 >> v1:172.21.15.80:6789/0 conn(0x7f3c70151740 legacy=0x7f3c701502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c6ed9d700 1 -- 172.21.15.80:0/1520808512 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c701322e0 con 0x7f3c70108630 2019-11-28T11:25:35.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c5f7fe700 1 -- 172.21.15.80:0/1520808512 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585987128 0 0) 0x7f3c600055a0 con 0x7f3c70151740 2019-11-28T11:25:35.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c6ed9d700 1 --2- 172.21.15.80:0/1520808512 >> v2:172.21.15.80:3300/0 conn(0x7f3c70108630 0x7f3c70151200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c64010390 tx=0x7f3c64010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c6ed9d700 1 --2- 172.21.15.80:0/1520808512 >> v2:172.21.15.80:3300/0 conn(0x7f3c70108630 0x7f3c70151200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c64010390 tx=0x7f3c64010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c6ed9d700 1 --2- 172.21.15.80:0/1520808512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70108630 0x7f3c70151200 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f3c64010390 tx=0x7f3c64010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c6ed9d700 1 --2- 172.21.15.80:0/1520808512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70108630 0x7f3c70151200 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f3c64010390 tx=0x7f3c64010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c6ed9d700 1 --2- 172.21.15.80:0/1520808512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70108630 0x7f3c70151200 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f3c64010390 tx=0x7f3c64010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c5f7fe700 1 -- 172.21.15.80:0/1520808512 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c64001c60 con 0x7f3c70108630 2019-11-28T11:25:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c6ed9d700 1 --2- 172.21.15.80:0/1520808512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70108630 0x7f3c70151200 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f3c64010390 tx=0x7f3c64010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c5f7fe700 1 -- 172.21.15.80:0/1520808512 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c64004430 con 0x7f3c70108630 2019-11-28T11:25:35.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c74bcc700 1 -- 172.21.15.80:0/1520808512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c70132660 con 0x7f3c70108630 2019-11-28T11:25:35.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c5f7fe700 1 -- 172.21.15.80:0/1520808512 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c64004a80 con 0x7f3c70108630 2019-11-28T11:25:35.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.382+0000 7f3c74bcc700 1 -- 172.21.15.80:0/1520808512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c701322e0 con 0x7f3c70108630 2019-11-28T11:25:35.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.383+0000 7f3c6ed9d700 1 --2- 172.21.15.80:0/1520808512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70108630 0x7f3c70151200 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f3c64010390 tx=0x7f3c64010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.383+0000 7f3c5f7fe700 1 -- 172.21.15.80:0/1520808512 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3c64004620 con 0x7f3c70108630 2019-11-28T11:25:35.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.383+0000 7f3c6ed9d700 1 --2- 172.21.15.80:0/1520808512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70108630 0x7f3c70151200 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f3c64010390 tx=0x7f3c64010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.383+0000 7f3c5f7fe700 1 --2- 172.21.15.80:0/1520808512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3c54018730 0x7f3c5401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:35.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.383+0000 7f3c5f7fe700 1 -- 172.21.15.80:0/1520808512 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f3c64031ae0 con 0x7f3c70108630 2019-11-28T11:25:35.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.383+0000 7f3c6e59c700 1 --2- 172.21.15.80:0/1520808512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3c54018730 0x7f3c5401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.384+0000 7f3c6e59c700 1 --2- 172.21.15.80:0/1520808512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3c54018730 0x7f3c5401abc0 crc :-1 s=READY pgs=91 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:35.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.391+0000 7f3c74bcc700 1 -- 172.21.15.80:0/1520808512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c70132660 con 0x7f3c70108630 2019-11-28T11:25:35.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.394+0000 7f3c6ed9d700 1 --2- 172.21.15.80:0/1520808512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70108630 0x7f3c70151200 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f3c64010390 tx=0x7f3c64010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.394+0000 7f3c5f7fe700 1 -- 172.21.15.80:0/1520808512 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3c64026940 con 0x7f3c70108630 2019-11-28T11:25:35.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.562+0000 7f3c74bcc700 1 -- 172.21.15.80:0/1520808512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f3c701322e0 con 0x7f3c70108630 2019-11-28T11:25:35.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.563+0000 7f3c6ed9d700 1 --2- 172.21.15.80:0/1520808512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70108630 0x7f3c70151200 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f3c64010390 tx=0x7f3c64010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.563+0000 7f3c5f7fe700 1 -- 172.21.15.80:0/1520808512 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3c64026940 con 0x7f3c70108630 2019-11-28T11:25:35.584 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:35.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.566+0000 7f3c74bcc700 1 -- 172.21.15.80:0/1520808512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3c54018730 msgr2=0x7f3c5401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.566+0000 7f3c74bcc700 1 --2- 172.21.15.80:0/1520808512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3c54018730 0x7f3c5401abc0 crc :-1 s=READY pgs=91 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:35.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.566+0000 7f3c74bcc700 1 -- 172.21.15.80:0/1520808512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70108630 msgr2=0x7f3c70151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.566+0000 7f3c74bcc700 1 --2- 172.21.15.80:0/1520808512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70108630 0x7f3c70151200 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f3c64010390 tx=0x7f3c64010730).stop 2019-11-28T11:25:35.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.566+0000 7f3c74bcc700 1 -- 172.21.15.80:0/1520808512 shutdown_connections 2019-11-28T11:25:35.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.566+0000 7f3c74bcc700 1 --2- 172.21.15.80:0/1520808512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3c54018730 0x7f3c5401abc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:35.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.566+0000 7f3c74bcc700 1 --2- 172.21.15.80:0/1520808512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c70108630 0x7f3c70151200 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:35.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.566+0000 7f3c74bcc700 1 -- 172.21.15.80:0/1520808512 shutdown_connections 2019-11-28T11:25:35.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.566+0000 7f3c74bcc700 1 -- 172.21.15.80:0/1520808512 wait complete. 2019-11-28T11:25:35.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.566+0000 7f3c74bcc700 1 -- 172.21.15.80:0/1520808512 >> 172.21.15.80:0/1520808512 conn(0x7f3c7014dbb0 msgr2=0x7f3c70142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:35.595 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:25:35.596 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:25:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.702+0000 7f1f27908700 1 Processor -- start 2019-11-28T11:25:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.702+0000 7f1f27908700 1 -- start start 2019-11-28T11:25:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.703+0000 7f1f27908700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1f2006c0a0 0x7f1f20072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.703+0000 7f1f27908700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f200734e0 0x7f1f20071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.703+0000 7f1f27908700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2006db00 con 0x7f1f20072360 2019-11-28T11:25:35.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.703+0000 7f1f27908700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2006fd60 con 0x7f1f2006c0a0 2019-11-28T11:25:35.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.703+0000 7f1f27908700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f20070030 con 0x7f1f200734e0 2019-11-28T11:25:35.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.703+0000 7f1f266a6700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1f20072360 0x7f1f2006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59070/0 (socket says 172.21.15.80:59070) 2019-11-28T11:25:35.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.703+0000 7f1f266a6700 1 -- 172.21.15.80:0/3351244428 learned_addr learned my addr 172.21.15.80:0/3351244428 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:35.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.703+0000 7f1f25ea5700 1 --2- 172.21.15.80:0/3351244428 >> v2:172.21.15.174:3300/0 conn(0x7f1f2006c0a0 0x7f1f20072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.703+0000 7f1f256a4700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f200734e0 0x7f1f20071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.703+0000 7f1f24ea3700 1 -- 172.21.15.80:0/3351244428 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271936436 0 0) 0x7f1f18001150 con 0x7f1f20072360 2019-11-28T11:25:35.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f24ea3700 1 -- 172.21.15.80:0/3351244428 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f10002e80 con 0x7f1f20072360 2019-11-28T11:25:35.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f24ea3700 1 -- 172.21.15.80:0/3351244428 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2540272551 0 0) 0x7f1f18001130 con 0x7f1f20072360 2019-11-28T11:25:35.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f24ea3700 1 -- 172.21.15.80:0/3351244428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f200734e0 msgr2=0x7f1f20071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:35.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f24ea3700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f200734e0 0x7f1f20071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:35.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f24ea3700 1 -- 172.21.15.80:0/3351244428 >> v2:172.21.15.174:3300/0 conn(0x7f1f2006c0a0 msgr2=0x7f1f20072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:35.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f24ea3700 1 --2- 172.21.15.80:0/3351244428 >> v2:172.21.15.174:3300/0 conn(0x7f1f2006c0a0 0x7f1f20072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f24ea3700 1 -- 172.21.15.80:0/3351244428 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f200706c0 con 0x7f1f20072360 2019-11-28T11:25:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f24ea3700 1 -- 172.21.15.80:0/3351244428 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f1f18001660 con 0x7f1f20072360 2019-11-28T11:25:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f24ea3700 1 -- 172.21.15.80:0/3351244428 >> v1:172.21.15.80:6789/0 conn(0x7f1f20072360 legacy=0x7f1f2006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f24ea3700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f100479e0 0x7f1f10049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f24ea3700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f1004a5a0 0x7f1f1004ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f24ea3700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f1004d270 0x7f1f1004f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f24ea3700 1 -- 172.21.15.80:0/3351244428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1004ff50 con 0x7f1f1004d270 2019-11-28T11:25:35.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f24ea3700 1 -- 172.21.15.80:0/3351244428 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f10050140 con 0x7f1f1004a5a0 2019-11-28T11:25:35.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f24ea3700 1 -- 172.21.15.80:0/3351244428 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f10050370 con 0x7f1f100479e0 2019-11-28T11:25:35.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f266a6700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f1004d270 0x7f1f1004f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f25ea5700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f100479e0 0x7f1f10049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f256a4700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f1004a5a0 0x7f1f1004ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f266a6700 1 -- 172.21.15.80:0/3351244428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f100479e0 msgr2=0x7f1f10049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:35.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f266a6700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f100479e0 0x7f1f10049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:35.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f266a6700 1 -- 172.21.15.80:0/3351244428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f1004a5a0 msgr2=0x7f1f1004ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:35.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f266a6700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f1004a5a0 0x7f1f1004ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:35.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f266a6700 1 -- 172.21.15.80:0/3351244428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f10050620 con 0x7f1f1004d270 2019-11-28T11:25:35.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f266a6700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f1004d270 0x7f1f1004f740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1f1800f860 tx=0x7f1f1800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f266a6700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f1004d270 0x7f1f1004f740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1f1800f860 tx=0x7f1f1800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.704+0000 7f1f266a6700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f1004d270 0x7f1f1004f740 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7f1f1800f860 tx=0x7f1f1800f790).ready entity=mon.0 client_cookie=89cd4804613377b2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:35.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.705+0000 7f1f266a6700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f1004d270 0x7f1f1004f740 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f1f1800f860 tx=0x7f1f1800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.705+0000 7f1f24ea3700 1 -- 172.21.15.80:0/3351244428 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f18001830 con 0x7f1f1004d270 2019-11-28T11:25:35.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.705+0000 7f1f266a6700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f1004d270 0x7f1f1004f740 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f1f1800f860 tx=0x7f1f1800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.705+0000 7f1f266a6700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f1004d270 0x7f1f1004f740 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f1f1800f860 tx=0x7f1f1800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.705+0000 7f1f24ea3700 1 -- 172.21.15.80:0/3351244428 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f18004240 con 0x7f1f1004d270 2019-11-28T11:25:35.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.705+0000 7f1f24ea3700 1 -- 172.21.15.80:0/3351244428 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f18004950 con 0x7f1f1004d270 2019-11-28T11:25:35.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.705+0000 7f1f27908700 1 -- 172.21.15.80:0/3351244428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f1004d270 msgr2=0x7f1f1004f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.705+0000 7f1f27908700 1 --2- 172.21.15.80:0/3351244428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f1004d270 0x7f1f1004f740 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7f1f1800f860 tx=0x7f1f1800f790).stop 2019-11-28T11:25:35.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.705+0000 7f1f266a6700 1 -- 172.21.15.80:0/3351244428 reap_dead start 2019-11-28T11:25:35.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.705+0000 7f1f27908700 1 -- 172.21.15.80:0/3351244428 shutdown_connections 2019-11-28T11:25:35.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.705+0000 7f1f27908700 1 -- 172.21.15.80:0/3351244428 shutdown_connections 2019-11-28T11:25:35.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.705+0000 7f1f27908700 1 -- 172.21.15.80:0/3351244428 wait complete. 2019-11-28T11:25:35.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.705+0000 7f1f27908700 1 -- 172.21.15.80:0/3351244428 >> 172.21.15.80:0/3351244428 conn(0x7f1f20061cf0 msgr2=0x7f1f20064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:35.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.708+0000 7f1f27908700 1 Processor -- start 2019-11-28T11:25:35.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.708+0000 7f1f27908700 1 -- start start 2019-11-28T11:25:35.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f27908700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f201061f0 0x7f1f2010f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:35.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f27908700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1f2013a350 0x7f1f2013a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:35.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f27908700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1f2013ad20 0x7f1f2010e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:35.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f27908700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2013bf00 con 0x7f1f2013a350 2019-11-28T11:25:35.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f27908700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2010c300 con 0x7f1f2013ad20 2019-11-28T11:25:35.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f27908700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2010cc60 con 0x7f1f201061f0 2019-11-28T11:25:35.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f256a4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1f2013a350 0x7f1f2013a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f256a4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1f2013a350 0x7f1f2013a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59764/0 (socket says 172.21.15.80:59764) 2019-11-28T11:25:35.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f256a4700 1 -- 172.21.15.80:0/3711726325 learned_addr learned my addr 172.21.15.80:0/3711726325 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:35.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f266a6700 1 --2- 172.21.15.80:0/3711726325 >> v2:172.21.15.174:3300/0 conn(0x7f1f2013ad20 0x7f1f2010e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f25ea5700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f201061f0 0x7f1f2010f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f256a4700 1 -- 172.21.15.80:0/3711726325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f201061f0 msgr2=0x7f1f2010f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f256a4700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f201061f0 0x7f1f2010f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:35.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f256a4700 1 -- 172.21.15.80:0/3711726325 >> v2:172.21.15.174:3300/0 conn(0x7f1f2013ad20 msgr2=0x7f1f2010e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f256a4700 1 --2- 172.21.15.80:0/3711726325 >> v2:172.21.15.174:3300/0 conn(0x7f1f2013ad20 0x7f1f2010e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:35.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f256a4700 1 -- 172.21.15.80:0/3711726325 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2010cfe0 con 0x7f1f2013a350 2019-11-28T11:25:35.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f256a4700 1 --2- 172.21.15.80:0/3711726325 >> v2:172.21.15.80:3300/0 conn(0x7f1f2013a350 0x7f1f2013a7e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f0c0107d0 tx=0x7f1f0c010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f256a4700 1 --2- 172.21.15.80:0/3711726325 >> v2:172.21.15.80:3300/0 conn(0x7f1f2013a350 0x7f1f2013a7e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f0c0107d0 tx=0x7f1f0c010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f256a4700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2013a350 0x7f1f2013a7e0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f1f0c0107d0 tx=0x7f1f0c010680).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:35.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f256a4700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2013a350 0x7f1f2013a7e0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f1f0c0107d0 tx=0x7f1f0c010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f256a4700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2013a350 0x7f1f2013a7e0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f1f0c0107d0 tx=0x7f1f0c010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f1e7fc700 1 -- 172.21.15.80:0/3711726325 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f0c000ce0 con 0x7f1f2013a350 2019-11-28T11:25:35.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f256a4700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2013a350 0x7f1f2013a7e0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f1f0c0107d0 tx=0x7f1f0c010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f1e7fc700 1 -- 172.21.15.80:0/3711726325 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c001410 con 0x7f1f2013a350 2019-11-28T11:25:35.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f27908700 1 -- 172.21.15.80:0/3711726325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2010cfe0 con 0x7f1f2013a350 2019-11-28T11:25:35.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.709+0000 7f1f1e7fc700 1 -- 172.21.15.80:0/3711726325 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f0c001ae0 con 0x7f1f2013a350 2019-11-28T11:25:35.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.710+0000 7f1f27908700 1 -- 172.21.15.80:0/3711726325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2010cfe0 con 0x7f1f2013a350 2019-11-28T11:25:35.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.710+0000 7f1f256a4700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2013a350 0x7f1f2013a7e0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f1f0c0107d0 tx=0x7f1f0c010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.710+0000 7f1f1e7fc700 1 -- 172.21.15.80:0/3711726325 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1f0c001600 con 0x7f1f2013a350 2019-11-28T11:25:35.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.710+0000 7f1f256a4700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2013a350 0x7f1f2013a7e0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f1f0c0107d0 tx=0x7f1f0c010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.710+0000 7f1f1e7fc700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f08018730 0x7f1f0801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:35.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.710+0000 7f1f1e7fc700 1 -- 172.21.15.80:0/3711726325 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f1f0c031f20 con 0x7f1f2013a350 2019-11-28T11:25:35.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.710+0000 7f1f25ea5700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f08018730 0x7f1f0801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:35.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.710+0000 7f1f25ea5700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f08018730 0x7f1f0801abe0 crc :-1 s=READY pgs=92 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:35.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.717+0000 7f1f27908700 1 -- 172.21.15.80:0/3711726325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2010cfe0 con 0x7f1f2013a350 2019-11-28T11:25:35.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.721+0000 7f1f256a4700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2013a350 0x7f1f2013a7e0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f1f0c0107d0 tx=0x7f1f0c010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.721+0000 7f1f1e7fc700 1 -- 172.21.15.80:0/3711726325 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1f0c001010 con 0x7f1f2013a350 2019-11-28T11:25:35.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.892+0000 7f1f27908700 1 -- 172.21.15.80:0/3711726325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f2010cc60 con 0x7f1f2013a350 2019-11-28T11:25:35.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.893+0000 7f1f256a4700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2013a350 0x7f1f2013a7e0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f1f0c0107d0 tx=0x7f1f0c010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:35.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.893+0000 7f1f1e7fc700 1 -- 172.21.15.80:0/3711726325 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2441 (secure 0 0 0) 0x7f1f0c001410 con 0x7f1f2013a350 2019-11-28T11:25:35.914 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 6 2019-11-28T11:25:35.914 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:35.914 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/3100151299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3100151299},{"type":"v1","addr":"172.21.15.80:6833","nonce":3100151299}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4},{"gid":4359,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/4212336515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":4212336515},{"type":"v1","addr":"172.21.15.80:6835","nonce":4212336515}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:25:19.931718+0000","modified":"2019-11-28T11:25:28.542379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4229":{"gid":4229,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2081356472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2081356472},{"type":"v1","addr":"172.21.15.174:6835","nonce":2081356472}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-11-28T11:25:35.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.895+0000 7f1f27908700 1 -- 172.21.15.80:0/3711726325 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f08018730 msgr2=0x7f1f0801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.895+0000 7f1f27908700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f08018730 0x7f1f0801abe0 crc :-1 s=READY pgs=92 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:35.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.895+0000 7f1f27908700 1 -- 172.21.15.80:0/3711726325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2013a350 msgr2=0x7f1f2013a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:35.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.895+0000 7f1f27908700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2013a350 0x7f1f2013a7e0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f1f0c0107d0 tx=0x7f1f0c010680).stop 2019-11-28T11:25:35.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.895+0000 7f1f27908700 1 -- 172.21.15.80:0/3711726325 shutdown_connections 2019-11-28T11:25:35.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.895+0000 7f1f27908700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f08018730 0x7f1f0801abe0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:35.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.895+0000 7f1f27908700 1 --2- 172.21.15.80:0/3711726325 >> v2:172.21.15.174:3300/0 conn(0x7f1f2013ad20 0x7f1f2010e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:35.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.895+0000 7f1f27908700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f2013a350 0x7f1f2013a7e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:35.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.895+0000 7f1f27908700 1 --2- 172.21.15.80:0/3711726325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f201061f0 0x7f1f2010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:35.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.895+0000 7f1f27908700 1 -- 172.21.15.80:0/3711726325 shutdown_connections 2019-11-28T11:25:35.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.895+0000 7f1f27908700 1 -- 172.21.15.80:0/3711726325 wait complete. 2019-11-28T11:25:35.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:35.895+0000 7f1f27908700 1 -- 172.21.15.80:0/3711726325 >> 172.21.15.80:0/3711726325 conn(0x7f1f20142090 msgr2=0x7f1f2010ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:36.228 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4229}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4229': {u'export_targets': [], u'name': u'c', u'incarnation': 5, u'state_seq': 3, u'state': u'up:active', u'gid': 4229, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2081356472, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2081356472, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2081356472'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:25:19.931718+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:25:28.542379+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:25:36.228 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:25:36.229 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:25:36.356 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:25:36.357 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:25:36.357 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:25:36.357 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 4229, 2019-11-28T11:25:36.358 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:25:36.358 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:25:36.358 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 8.7955442369999997, 2019-11-28T11:25:36.358 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 6, 2019-11-28T11:25:36.359 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 25, 2019-11-28T11:25:36.359 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 25, 2019-11-28T11:25:36.359 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 13.617369527999999 2019-11-28T11:25:36.359 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:25:36.362 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 4229, "want_state": "up:active", "state": "up:active", "rank_uptime": 8.7955442369999997, "mdsmap_epoch": 6, "osdmap_epoch": 25, "osdmap_epoch_barrier": 25, "uptime": 13.617369527999999 } 2019-11-28T11:25:36.363 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:25:36.363 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:25:36.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:25:36.364 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:25:36.434 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:25:36.435 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:25:36.526 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:25:36.527 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:25:36.644 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:25:36.645 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:25:36.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:25:36.679 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:25:36.751 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:36.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.863+0000 7f2d2da0a700 1 Processor -- start 2019-11-28T11:25:36.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.863+0000 7f2d2da0a700 1 -- start start 2019-11-28T11:25:36.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.864+0000 7f2d2da0a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d2806c0a0 0x7f2d28072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:36.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.864+0000 7f2d2da0a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d280734e0 0x7f2d28071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:36.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.864+0000 7f2d2da0a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2806db00 con 0x7f2d28072360 2019-11-28T11:25:36.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.864+0000 7f2d2da0a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2806fd60 con 0x7f2d2806c0a0 2019-11-28T11:25:36.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.864+0000 7f2d2da0a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d28070030 con 0x7f2d280734e0 2019-11-28T11:25:36.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.864+0000 7f2d277fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d2806c0a0 0x7f2d28072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:36.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.864+0000 7f2d27fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2d28072360 0x7f2d2806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59088/0 (socket says 172.21.15.80:59088) 2019-11-28T11:25:36.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.864+0000 7f2d27fff700 1 -- 172.21.15.80:0/163308306 learned_addr learned my addr 172.21.15.80:0/163308306 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:36.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d26ffd700 1 --2- 172.21.15.80:0/163308306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d280734e0 0x7f2d28071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:36.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d277fe700 1 -- 172.21.15.80:0/163308306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d280734e0 msgr2=0x7f2d28071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:36.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d277fe700 1 --2- 172.21.15.80:0/163308306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d280734e0 0x7f2d28071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:36.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d277fe700 1 -- 172.21.15.80:0/163308306 >> v1:172.21.15.80:6789/0 conn(0x7f2d28072360 legacy=0x7f2d2806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:36.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d267fc700 1 -- 172.21.15.80:0/163308306 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615475820 0 0) 0x7f2d200014d0 con 0x7f2d28072360 2019-11-28T11:25:36.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d277fe700 1 -- 172.21.15.80:0/163308306 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d280706c0 con 0x7f2d2806c0a0 2019-11-28T11:25:36.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d277fe700 1 --2- 172.21.15.80:0/163308306 >> v2:172.21.15.80:3300/0 conn(0x7f2d2806c0a0 0x7f2d28072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2d1000af50 tx=0x7f2d1000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:36.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d277fe700 1 --2- 172.21.15.80:0/163308306 >> v2:172.21.15.80:3300/0 conn(0x7f2d2806c0a0 0x7f2d28072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2d1000af50 tx=0x7f2d1000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:36.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d277fe700 1 --2- 172.21.15.80:0/163308306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2806c0a0 0x7f2d28072fa0 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f2d1000af50 tx=0x7f2d1000b6e0).ready entity=mon.0 client_cookie=840410b13db9b91f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:36.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d277fe700 1 --2- 172.21.15.80:0/163308306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2806c0a0 0x7f2d28072fa0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f2d1000af50 tx=0x7f2d1000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:36.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d267fc700 1 -- 172.21.15.80:0/163308306 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d10007210 con 0x7f2d2806c0a0 2019-11-28T11:25:36.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d277fe700 1 --2- 172.21.15.80:0/163308306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2806c0a0 0x7f2d28072fa0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f2d1000af50 tx=0x7f2d1000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:36.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d277fe700 1 --2- 172.21.15.80:0/163308306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2806c0a0 0x7f2d28072fa0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f2d1000af50 tx=0x7f2d1000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:36.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d267fc700 1 -- 172.21.15.80:0/163308306 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d100099b0 con 0x7f2d2806c0a0 2019-11-28T11:25:36.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d267fc700 1 -- 172.21.15.80:0/163308306 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d1000a080 con 0x7f2d2806c0a0 2019-11-28T11:25:36.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d2da0a700 1 -- 172.21.15.80:0/163308306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2806c0a0 msgr2=0x7f2d28072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:36.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.865+0000 7f2d2da0a700 1 --2- 172.21.15.80:0/163308306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2806c0a0 0x7f2d28072fa0 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f2d1000af50 tx=0x7f2d1000b6e0).stop 2019-11-28T11:25:36.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.866+0000 7f2d2da0a700 1 -- 172.21.15.80:0/163308306 shutdown_connections 2019-11-28T11:25:36.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.866+0000 7f2d2da0a700 1 --2- 172.21.15.80:0/163308306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d280734e0 0x7f2d28071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:36.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.866+0000 7f2d2da0a700 1 --2- 172.21.15.80:0/163308306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2806c0a0 0x7f2d28072fa0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:36.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.866+0000 7f2d2da0a700 1 -- 172.21.15.80:0/163308306 shutdown_connections 2019-11-28T11:25:36.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.866+0000 7f2d2da0a700 1 -- 172.21.15.80:0/163308306 wait complete. 2019-11-28T11:25:36.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.866+0000 7f2d2da0a700 1 -- 172.21.15.80:0/163308306 >> 172.21.15.80:0/163308306 conn(0x7f2d28061cf0 msgr2=0x7f2d28064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:36.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.868+0000 7f2d2da0a700 1 Processor -- start 2019-11-28T11:25:36.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.868+0000 7f2d2da0a700 1 -- start start 2019-11-28T11:25:36.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.869+0000 7f2d2da0a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d2813dc00 0x7f2d28109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:36.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.869+0000 7f2d2da0a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d281312c0 con 0x7f2d281094e0 2019-11-28T11:25:36.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.869+0000 7f2d2da0a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d28104010 con 0x7f2d2810a3a0 2019-11-28T11:25:36.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.869+0000 7f2d2da0a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d28105830 con 0x7f2d2813dc00 2019-11-28T11:25:36.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.869+0000 7f2d277fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d2813dc00 0x7f2d28109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:36.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.869+0000 7f2d277fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d2813dc00 0x7f2d28109e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59776/0 (socket says 172.21.15.80:59776) 2019-11-28T11:25:36.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.869+0000 7f2d277fe700 1 -- 172.21.15.80:0/3422617711 learned_addr learned my addr 172.21.15.80:0/3422617711 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:36.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.870+0000 7f2d277fe700 1 -- 172.21.15.80:0/3422617711 >> v1:172.21.15.174:6789/0 conn(0x7f2d2810a3a0 legacy=0x7f2d28108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:36.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.870+0000 7f2d277fe700 1 -- 172.21.15.80:0/3422617711 >> v1:172.21.15.80:6789/0 conn(0x7f2d281094e0 legacy=0x7f2d28167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:36.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.870+0000 7f2d277fe700 1 -- 172.21.15.80:0/3422617711 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d28106190 con 0x7f2d2813dc00 2019-11-28T11:25:36.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.870+0000 7f2d277fe700 1 --2- 172.21.15.80:0/3422617711 >> v2:172.21.15.80:3300/0 conn(0x7f2d2813dc00 0x7f2d28109e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2d10010440 tx=0x7f2d100107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:36.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.870+0000 7f2d277fe700 1 --2- 172.21.15.80:0/3422617711 >> v2:172.21.15.80:3300/0 conn(0x7f2d2813dc00 0x7f2d28109e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2d10010440 tx=0x7f2d100107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:36.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.870+0000 7f2d277fe700 1 --2- 172.21.15.80:0/3422617711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2813dc00 0x7f2d28109e60 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f2d10010440 tx=0x7f2d100107e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:36.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.870+0000 7f2d277fe700 1 --2- 172.21.15.80:0/3422617711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2813dc00 0x7f2d28109e60 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f2d10010440 tx=0x7f2d100107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:36.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.870+0000 7f2d277fe700 1 --2- 172.21.15.80:0/3422617711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2813dc00 0x7f2d28109e60 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f2d10010440 tx=0x7f2d100107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:36.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.870+0000 7f2d277fe700 1 --2- 172.21.15.80:0/3422617711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2813dc00 0x7f2d28109e60 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f2d10010440 tx=0x7f2d100107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:36.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.870+0000 7f2d1ffff700 1 -- 172.21.15.80:0/3422617711 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d1000a9a0 con 0x7f2d2813dc00 2019-11-28T11:25:36.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.870+0000 7f2d1ffff700 1 -- 172.21.15.80:0/3422617711 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d100009e0 con 0x7f2d2813dc00 2019-11-28T11:25:36.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.870+0000 7f2d1ffff700 1 -- 172.21.15.80:0/3422617711 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d10009e00 con 0x7f2d2813dc00 2019-11-28T11:25:36.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.870+0000 7f2d2da0a700 1 -- 172.21.15.80:0/3422617711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d28106510 con 0x7f2d2813dc00 2019-11-28T11:25:36.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.870+0000 7f2d2da0a700 1 -- 172.21.15.80:0/3422617711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d28106190 con 0x7f2d2813dc00 2019-11-28T11:25:36.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.870+0000 7f2d277fe700 1 --2- 172.21.15.80:0/3422617711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2813dc00 0x7f2d28109e60 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f2d10010440 tx=0x7f2d100107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.871+0000 7f2d1ffff700 1 -- 172.21.15.80:0/3422617711 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2d10009790 con 0x7f2d2813dc00 2019-11-28T11:25:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.871+0000 7f2d277fe700 1 --2- 172.21.15.80:0/3422617711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2813dc00 0x7f2d28109e60 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f2d10010440 tx=0x7f2d100107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:36.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.871+0000 7f2d1ffff700 1 --2- 172.21.15.80:0/3422617711 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d00018730 0x7f2d0001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:36.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.871+0000 7f2d1ffff700 1 -- 172.21.15.80:0/3422617711 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2d10031b80 con 0x7f2d2813dc00 2019-11-28T11:25:36.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.871+0000 7f2d26ffd700 1 --2- 172.21.15.80:0/3422617711 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d00018730 0x7f2d0001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:36.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.871+0000 7f2d26ffd700 1 --2- 172.21.15.80:0/3422617711 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d00018730 0x7f2d0001abc0 crc :-1 s=READY pgs=93 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:36.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.879+0000 7f2d2da0a700 1 -- 172.21.15.80:0/3422617711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d28106510 con 0x7f2d2813dc00 2019-11-28T11:25:36.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.882+0000 7f2d277fe700 1 --2- 172.21.15.80:0/3422617711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2813dc00 0x7f2d28109e60 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f2d10010440 tx=0x7f2d100107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:36.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:36.882+0000 7f2d1ffff700 1 -- 172.21.15.80:0/3422617711 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2d10009580 con 0x7f2d2813dc00 2019-11-28T11:25:37.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.058+0000 7f2d2da0a700 1 -- 172.21.15.80:0/3422617711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d28106190 con 0x7f2d2813dc00 2019-11-28T11:25:37.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.059+0000 7f2d277fe700 1 --2- 172.21.15.80:0/3422617711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2813dc00 0x7f2d28109e60 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f2d10010440 tx=0x7f2d100107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.059+0000 7f2d1ffff700 1 -- 172.21.15.80:0/3422617711 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14885 (secure 0 0 0) 0x7f2d10009790 con 0x7f2d2813dc00 2019-11-28T11:25:37.080 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:37.081 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:20.933435+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:25:14.914696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-11-28T11:25:17.566323+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.061+0000 7f2d2da0a700 1 -- 172.21.15.80:0/3422617711 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d00018730 msgr2=0x7f2d0001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.061+0000 7f2d2da0a700 1 --2- 172.21.15.80:0/3422617711 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d00018730 0x7f2d0001abc0 crc :-1 s=READY pgs=93 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.061+0000 7f2d2da0a700 1 -- 172.21.15.80:0/3422617711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2813dc00 msgr2=0x7f2d28109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.061+0000 7f2d2da0a700 1 --2- 172.21.15.80:0/3422617711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2813dc00 0x7f2d28109e60 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f2d10010440 tx=0x7f2d100107e0).stop 2019-11-28T11:25:37.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.061+0000 7f2d2da0a700 1 -- 172.21.15.80:0/3422617711 shutdown_connections 2019-11-28T11:25:37.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.061+0000 7f2d2da0a700 1 --2- 172.21.15.80:0/3422617711 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d00018730 0x7f2d0001abc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.061+0000 7f2d2da0a700 1 --2- 172.21.15.80:0/3422617711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2813dc00 0x7f2d28109e60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.061+0000 7f2d2da0a700 1 -- 172.21.15.80:0/3422617711 shutdown_connections 2019-11-28T11:25:37.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.061+0000 7f2d2da0a700 1 -- 172.21.15.80:0/3422617711 wait complete. 2019-11-28T11:25:37.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.061+0000 7f2d2da0a700 1 -- 172.21.15.80:0/3422617711 >> 172.21.15.80:0/3422617711 conn(0x7f2d2811bfc0 msgr2=0x7f2d28141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:37.100 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:14.914696+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:17.566323+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:25:37.101 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:25:37.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.204+0000 7f7323e61700 1 Processor -- start 2019-11-28T11:25:37.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.204+0000 7f7323e61700 1 -- start start 2019-11-28T11:25:37.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.205+0000 7f7323e61700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f731c15ed10 0x7f731c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:37.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.205+0000 7f7323e61700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f731c0734b0 0x7f731c0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:37.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.205+0000 7f7323e61700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731c06db60 con 0x7f731c073020 2019-11-28T11:25:37.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.205+0000 7f7323e61700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731c06fe00 con 0x7f731c15ed10 2019-11-28T11:25:37.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.205+0000 7f7323e61700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0700d0 con 0x7f731c0734b0 2019-11-28T11:25:37.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.205+0000 7f73223fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f731c15ed10 0x7f731c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:37.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.205+0000 7f7321bfd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f731c073020 0x7f731c071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59104/0 (socket says 172.21.15.80:59104) 2019-11-28T11:25:37.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.205+0000 7f7321bfd700 1 -- 172.21.15.80:0/2615574121 learned_addr learned my addr 172.21.15.80:0/2615574121 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:37.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.205+0000 7f7322bff700 1 --2- 172.21.15.80:0/2615574121 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f731c0734b0 0x7f731c0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:37.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.206+0000 7f73223fe700 1 -- 172.21.15.80:0/2615574121 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f731c0734b0 msgr2=0x7f731c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:37.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.206+0000 7f73223fe700 1 --2- 172.21.15.80:0/2615574121 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f731c0734b0 0x7f731c0726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:37.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.206+0000 7f73223fe700 1 -- 172.21.15.80:0/2615574121 >> v1:172.21.15.80:6789/0 conn(0x7f731c073020 legacy=0x7f731c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.206+0000 7f73213fc700 1 -- 172.21.15.80:0/2615574121 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877841105 0 0) 0x7f730c001070 con 0x7f731c073020 2019-11-28T11:25:37.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.206+0000 7f73223fe700 1 -- 172.21.15.80:0/2615574121 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c070760 con 0x7f731c15ed10 2019-11-28T11:25:37.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.206+0000 7f73223fe700 1 --2- 172.21.15.80:0/2615574121 >> v2:172.21.15.80:3300/0 conn(0x7f731c15ed10 0x7f731c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f730400b2d0 tx=0x7f730400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.206+0000 7f73223fe700 1 --2- 172.21.15.80:0/2615574121 >> v2:172.21.15.80:3300/0 conn(0x7f731c15ed10 0x7f731c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f730400b2d0 tx=0x7f730400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.206+0000 7f73223fe700 1 --2- 172.21.15.80:0/2615574121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c15ed10 0x7f731c15f100 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7f730400b2d0 tx=0x7f730400ba60).ready entity=mon.0 client_cookie=274435f7c155eb9e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:37.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.206+0000 7f73223fe700 1 --2- 172.21.15.80:0/2615574121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c15ed10 0x7f731c15f100 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f730400b2d0 tx=0x7f730400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.206+0000 7f73213fc700 1 -- 172.21.15.80:0/2615574121 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7304007590 con 0x7f731c15ed10 2019-11-28T11:25:37.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.206+0000 7f73223fe700 1 --2- 172.21.15.80:0/2615574121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c15ed10 0x7f731c15f100 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f730400b2d0 tx=0x7f730400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.206+0000 7f73223fe700 1 --2- 172.21.15.80:0/2615574121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c15ed10 0x7f731c15f100 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f730400b2d0 tx=0x7f730400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.206+0000 7f73213fc700 1 -- 172.21.15.80:0/2615574121 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7304009d30 con 0x7f731c15ed10 2019-11-28T11:25:37.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.206+0000 7f73213fc700 1 -- 172.21.15.80:0/2615574121 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7304009f20 con 0x7f731c15ed10 2019-11-28T11:25:37.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.206+0000 7f7323e61700 1 -- 172.21.15.80:0/2615574121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c15ed10 msgr2=0x7f731c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.206+0000 7f7323e61700 1 --2- 172.21.15.80:0/2615574121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c15ed10 0x7f731c15f100 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7f730400b2d0 tx=0x7f730400ba60).stop 2019-11-28T11:25:37.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.207+0000 7f7323e61700 1 -- 172.21.15.80:0/2615574121 shutdown_connections 2019-11-28T11:25:37.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.207+0000 7f7323e61700 1 --2- 172.21.15.80:0/2615574121 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f731c0734b0 0x7f731c0726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:37.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.207+0000 7f7323e61700 1 --2- 172.21.15.80:0/2615574121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c15ed10 0x7f731c15f100 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.207+0000 7f7323e61700 1 -- 172.21.15.80:0/2615574121 shutdown_connections 2019-11-28T11:25:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.207+0000 7f7323e61700 1 -- 172.21.15.80:0/2615574121 wait complete. 2019-11-28T11:25:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.207+0000 7f7323e61700 1 -- 172.21.15.80:0/2615574121 >> 172.21.15.80:0/2615574121 conn(0x7f731c061d20 msgr2=0x7f731c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:37.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.209+0000 7f7323e61700 1 Processor -- start 2019-11-28T11:25:37.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.209+0000 7f7323e61700 1 -- start start 2019-11-28T11:25:37.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f7323e61700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f731c10e970 0x7f731c1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:37.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f7323e61700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f731c108cf0 0x7f731c107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:37.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f7323e61700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f731c107b70 0x7f731c107fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:37.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f7323e61700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731c10e430 con 0x7f731c10e970 2019-11-28T11:25:37.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f7323e61700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731c105860 con 0x7f731c107b70 2019-11-28T11:25:37.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f7323e61700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c10da00 con 0x7f731c108cf0 2019-11-28T11:25:37.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f73223fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f731c10e970 0x7f731c1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:37.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f73223fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f731c10e970 0x7f731c1087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59790/0 (socket says 172.21.15.80:59790) 2019-11-28T11:25:37.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f73223fe700 1 -- 172.21.15.80:0/2338858795 learned_addr learned my addr 172.21.15.80:0/2338858795 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:37.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f7321bfd700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f731c108cf0 0x7f731c107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:37.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f7322bff700 1 --2- 172.21.15.80:0/2338858795 >> v2:172.21.15.174:3300/0 conn(0x7f731c107b70 0x7f731c107fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:37.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f73223fe700 1 -- 172.21.15.80:0/2338858795 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f731c108cf0 msgr2=0x7f731c107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f73223fe700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f731c108cf0 0x7f731c107630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f73223fe700 1 -- 172.21.15.80:0/2338858795 >> v2:172.21.15.174:3300/0 conn(0x7f731c107b70 msgr2=0x7f731c107fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f73223fe700 1 --2- 172.21.15.80:0/2338858795 >> v2:172.21.15.174:3300/0 conn(0x7f731c107b70 0x7f731c107fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f73223fe700 1 -- 172.21.15.80:0/2338858795 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c105ef0 con 0x7f731c10e970 2019-11-28T11:25:37.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f7322bff700 1 --2- 172.21.15.80:0/2338858795 >> v2:172.21.15.174:3300/0 conn(0x7f731c107b70 0x7f731c107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:37.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f7321bfd700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f731c108cf0 0x7f731c107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:37.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.210+0000 7f73223fe700 1 --2- 172.21.15.80:0/2338858795 >> v2:172.21.15.80:3300/0 conn(0x7f731c10e970 0x7f731c1087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73040547c0 tx=0x7f7304054b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.211+0000 7f73223fe700 1 --2- 172.21.15.80:0/2338858795 >> v2:172.21.15.80:3300/0 conn(0x7f731c10e970 0x7f731c1087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73040547c0 tx=0x7f7304054b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.211+0000 7f73223fe700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c10e970 0x7f731c1087b0 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f73040547c0 tx=0x7f7304054b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:37.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.211+0000 7f73223fe700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c10e970 0x7f731c1087b0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f73040547c0 tx=0x7f7304054b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.211+0000 7f73223fe700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c10e970 0x7f731c1087b0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f73040547c0 tx=0x7f7304054b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.211+0000 7f731affd700 1 -- 172.21.15.80:0/2338858795 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7304009ce0 con 0x7f731c10e970 2019-11-28T11:25:37.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.211+0000 7f73223fe700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c10e970 0x7f731c1087b0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f73040547c0 tx=0x7f7304054b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.211+0000 7f731affd700 1 -- 172.21.15.80:0/2338858795 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7304009900 con 0x7f731c10e970 2019-11-28T11:25:37.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.211+0000 7f731affd700 1 -- 172.21.15.80:0/2338858795 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f730400a2c0 con 0x7f731c10e970 2019-11-28T11:25:37.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.211+0000 7f7323e61700 1 -- 172.21.15.80:0/2338858795 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731c106270 con 0x7f731c10e970 2019-11-28T11:25:37.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.211+0000 7f7323e61700 1 -- 172.21.15.80:0/2338858795 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c105ef0 con 0x7f731c10e970 2019-11-28T11:25:37.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.211+0000 7f73223fe700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c10e970 0x7f731c1087b0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f73040547c0 tx=0x7f7304054b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.211+0000 7f731affd700 1 -- 172.21.15.80:0/2338858795 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7304009af0 con 0x7f731c10e970 2019-11-28T11:25:37.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.211+0000 7f73223fe700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c10e970 0x7f731c1087b0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f73040547c0 tx=0x7f7304054b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.212+0000 7f731affd700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7300018730 0x7f730001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:37.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.212+0000 7f731affd700 1 -- 172.21.15.80:0/2338858795 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f7304075de0 con 0x7f731c10e970 2019-11-28T11:25:37.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.212+0000 7f7321bfd700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7300018730 0x7f730001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:37.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.212+0000 7f7321bfd700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7300018730 0x7f730001abc0 crc :-1 s=READY pgs=94 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:37.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.219+0000 7f7323e61700 1 -- 172.21.15.80:0/2338858795 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731c106270 con 0x7f731c10e970 2019-11-28T11:25:37.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.223+0000 7f73223fe700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c10e970 0x7f731c1087b0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f73040547c0 tx=0x7f7304054b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.223+0000 7f731affd700 1 -- 172.21.15.80:0/2338858795 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7304000cc0 con 0x7f731c10e970 2019-11-28T11:25:37.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.388+0000 7f7323e61700 1 -- 172.21.15.80:0/2338858795 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f731c105ef0 con 0x7f731c10e970 2019-11-28T11:25:37.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.389+0000 7f73223fe700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c10e970 0x7f731c1087b0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f73040547c0 tx=0x7f7304054b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.389+0000 7f731affd700 1 -- 172.21.15.80:0/2338858795 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7304009af0 con 0x7f731c10e970 2019-11-28T11:25:37.410 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:37.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.391+0000 7f7323e61700 1 -- 172.21.15.80:0/2338858795 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7300018730 msgr2=0x7f730001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.391+0000 7f7323e61700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7300018730 0x7f730001abc0 crc :-1 s=READY pgs=94 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.391+0000 7f7323e61700 1 -- 172.21.15.80:0/2338858795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c10e970 msgr2=0x7f731c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.391+0000 7f7323e61700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c10e970 0x7f731c1087b0 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f73040547c0 tx=0x7f7304054b60).stop 2019-11-28T11:25:37.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.391+0000 7f7323e61700 1 -- 172.21.15.80:0/2338858795 shutdown_connections 2019-11-28T11:25:37.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.391+0000 7f7323e61700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7300018730 0x7f730001abc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.391+0000 7f7323e61700 1 --2- 172.21.15.80:0/2338858795 >> v2:172.21.15.174:3300/0 conn(0x7f731c107b70 0x7f731c107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.391+0000 7f7323e61700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f731c108cf0 0x7f731c107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.391+0000 7f7323e61700 1 --2- 172.21.15.80:0/2338858795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f731c10e970 0x7f731c1087b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.392+0000 7f7323e61700 1 -- 172.21.15.80:0/2338858795 shutdown_connections 2019-11-28T11:25:37.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.392+0000 7f7323e61700 1 -- 172.21.15.80:0/2338858795 wait complete. 2019-11-28T11:25:37.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.392+0000 7f7323e61700 1 -- 172.21.15.80:0/2338858795 >> 172.21.15.80:0/2338858795 conn(0x7f731c15e2d0 msgr2=0x7f731c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:37.421 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:25:37.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.524+0000 7fdb9bc76700 1 Processor -- start 2019-11-28T11:25:37.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.524+0000 7fdb9bc76700 1 -- start start 2019-11-28T11:25:37.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.525+0000 7fdb9bc76700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdb9415f100 0x7fdb9406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:37.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.525+0000 7fdb9bc76700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb9406c2f0 0x7fdb9406c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:37.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.525+0000 7fdb9bc76700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9406db60 con 0x7fdb9415ed10 2019-11-28T11:25:37.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.525+0000 7fdb9bc76700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9406fe00 con 0x7fdb9415f100 2019-11-28T11:25:37.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.525+0000 7fdb9bc76700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb940700d0 con 0x7fdb9406c2f0 2019-11-28T11:25:37.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb9aa14700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb9406c2f0 0x7fdb9406c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:37.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb9aa14700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb9406c2f0 0x7fdb9406c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:33828/0 (socket says 172.21.15.80:33828) 2019-11-28T11:25:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb99a12700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdb9415f100 0x7fdb9406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb9aa14700 1 -- 172.21.15.80:0/1072369859 learned_addr learned my addr 172.21.15.80:0/1072369859 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb9aa14700 1 -- 172.21.15.80:0/1072369859 >> v2:172.21.15.174:3300/0 conn(0x7fdb9415f100 msgr2=0x7fdb9406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/1072369859 >> v2:172.21.15.174:3300/0 conn(0x7fdb9415f100 0x7fdb9406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb9aa14700 1 -- 172.21.15.80:0/1072369859 >> v1:172.21.15.174:6789/0 conn(0x7fdb9415ed10 legacy=0x7fdb94073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb9aa14700 1 -- 172.21.15.80:0/1072369859 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb94070760 con 0x7fdb9406c2f0 2019-11-28T11:25:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/1072369859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb9406c2f0 0x7fdb9406c740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdb8c00f6e0 tx=0x7fdb8c00fa80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/1072369859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb9406c2f0 0x7fdb9406c740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdb8c00f6e0 tx=0x7fdb8c00fa80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/1072369859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb9406c2f0 0x7fdb9406c740 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7fdb8c00f6e0 tx=0x7fdb8c00fa80).ready entity=mon.2 client_cookie=7eb3fff7bc05afe6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/1072369859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb9406c2f0 0x7fdb9406c740 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fdb8c00f6e0 tx=0x7fdb8c00fa80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb99211700 1 -- 172.21.15.80:0/1072369859 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb8c000a70 con 0x7fdb9406c2f0 2019-11-28T11:25:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/1072369859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb9406c2f0 0x7fdb9406c740 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fdb8c00f6e0 tx=0x7fdb8c00fa80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/1072369859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb9406c2f0 0x7fdb9406c740 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fdb8c00f6e0 tx=0x7fdb8c00fa80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb99211700 1 -- 172.21.15.80:0/1072369859 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c000e70 con 0x7fdb9406c2f0 2019-11-28T11:25:37.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb99211700 1 -- 172.21.15.80:0/1072369859 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb8c001500 con 0x7fdb9406c2f0 2019-11-28T11:25:37.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb9bc76700 1 -- 172.21.15.80:0/1072369859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb9406c2f0 msgr2=0x7fdb9406c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.526+0000 7fdb9bc76700 1 --2- 172.21.15.80:0/1072369859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb9406c2f0 0x7fdb9406c740 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7fdb8c00f6e0 tx=0x7fdb8c00fa80).stop 2019-11-28T11:25:37.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.527+0000 7fdb9bc76700 1 -- 172.21.15.80:0/1072369859 shutdown_connections 2019-11-28T11:25:37.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.527+0000 7fdb9bc76700 1 --2- 172.21.15.80:0/1072369859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb9406c2f0 0x7fdb9406c740 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.527+0000 7fdb9bc76700 1 --2- 172.21.15.80:0/1072369859 >> v2:172.21.15.174:3300/0 conn(0x7fdb9415f100 0x7fdb9406bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.527+0000 7fdb9bc76700 1 -- 172.21.15.80:0/1072369859 shutdown_connections 2019-11-28T11:25:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.527+0000 7fdb9bc76700 1 -- 172.21.15.80:0/1072369859 wait complete. 2019-11-28T11:25:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.527+0000 7fdb9bc76700 1 -- 172.21.15.80:0/1072369859 >> 172.21.15.80:0/1072369859 conn(0x7fdb94061d20 msgr2=0x7fdb940641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.530+0000 7fdb9bc76700 1 Processor -- start 2019-11-28T11:25:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.530+0000 7fdb9bc76700 1 -- start start 2019-11-28T11:25:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9bc76700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdb94148320 0x7fdb9410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9bc76700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdb9410e3d0 0x7fdb94168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9bc76700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb94148e00 con 0x7fdb9410f290 2019-11-28T11:25:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9bc76700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9413aa20 con 0x7fdb9410e3d0 2019-11-28T11:25:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9bc76700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9413acf0 con 0x7fdb94148320 2019-11-28T11:25:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9aa14700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdb9410e3d0 0x7fdb94168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb99a12700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdb9410f290 0x7fdb9410dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59122/0 (socket says 172.21.15.80:59122) 2019-11-28T11:25:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb99a12700 1 -- 172.21.15.80:0/2670316129 learned_addr learned my addr 172.21.15.80:0/2670316129 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9a213700 1 --2- 172.21.15.80:0/2670316129 >> v2:172.21.15.174:3300/0 conn(0x7fdb94148320 0x7fdb9410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9aa14700 1 -- 172.21.15.80:0/2670316129 >> v2:172.21.15.174:3300/0 conn(0x7fdb94148320 msgr2=0x7fdb9410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/2670316129 >> v2:172.21.15.174:3300/0 conn(0x7fdb94148320 0x7fdb9410ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9aa14700 1 -- 172.21.15.80:0/2670316129 >> v1:172.21.15.80:6789/0 conn(0x7fdb9410f290 legacy=0x7fdb9410dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb92ffd700 1 -- 172.21.15.80:0/2670316129 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851652517 0 0) 0x7fdb7c001330 con 0x7fdb9410f290 2019-11-28T11:25:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9aa14700 1 -- 172.21.15.80:0/2670316129 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9410c490 con 0x7fdb9410e3d0 2019-11-28T11:25:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/2670316129 >> v2:172.21.15.80:3300/0 conn(0x7fdb9410e3d0 0x7fdb94168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb8c0103b0 tx=0x7fdb8c0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/2670316129 >> v2:172.21.15.80:3300/0 conn(0x7fdb9410e3d0 0x7fdb94168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb8c0103b0 tx=0x7fdb8c0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/2670316129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb9410e3d0 0x7fdb94168d80 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7fdb8c0103b0 tx=0x7fdb8c0101e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:37.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/2670316129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb9410e3d0 0x7fdb94168d80 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fdb8c0103b0 tx=0x7fdb8c0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb92ffd700 1 -- 172.21.15.80:0/2670316129 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb8c0053c0 con 0x7fdb9410e3d0 2019-11-28T11:25:37.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/2670316129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb9410e3d0 0x7fdb94168d80 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fdb8c0103b0 tx=0x7fdb8c0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/2670316129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb9410e3d0 0x7fdb94168d80 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fdb8c0103b0 tx=0x7fdb8c0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb92ffd700 1 -- 172.21.15.80:0/2670316129 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c0072a0 con 0x7fdb9410e3d0 2019-11-28T11:25:37.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9bc76700 1 -- 172.21.15.80:0/2670316129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9410c810 con 0x7fdb9410e3d0 2019-11-28T11:25:37.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb92ffd700 1 -- 172.21.15.80:0/2670316129 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb8c0055b0 con 0x7fdb9410e3d0 2019-11-28T11:25:37.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.531+0000 7fdb9bc76700 1 -- 172.21.15.80:0/2670316129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9410c490 con 0x7fdb9410e3d0 2019-11-28T11:25:37.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.532+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/2670316129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb9410e3d0 0x7fdb94168d80 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fdb8c0103b0 tx=0x7fdb8c0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.532+0000 7fdb92ffd700 1 -- 172.21.15.80:0/2670316129 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fdb8c0051d0 con 0x7fdb9410e3d0 2019-11-28T11:25:37.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.532+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/2670316129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb9410e3d0 0x7fdb94168d80 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fdb8c0103b0 tx=0x7fdb8c0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.532+0000 7fdb92ffd700 1 --2- 172.21.15.80:0/2670316129 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdb78018730 0x7fdb7801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:37.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.532+0000 7fdb92ffd700 1 -- 172.21.15.80:0/2670316129 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fdb8c0319e0 con 0x7fdb9410e3d0 2019-11-28T11:25:37.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.532+0000 7fdb9a213700 1 --2- 172.21.15.80:0/2670316129 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdb78018730 0x7fdb7801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:37.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.533+0000 7fdb9a213700 1 --2- 172.21.15.80:0/2670316129 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdb78018730 0x7fdb7801abc0 crc :-1 s=READY pgs=95 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:37.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.539+0000 7fdb9bc76700 1 -- 172.21.15.80:0/2670316129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9410c810 con 0x7fdb9410e3d0 2019-11-28T11:25:37.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.543+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/2670316129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb9410e3d0 0x7fdb94168d80 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fdb8c0103b0 tx=0x7fdb8c0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.543+0000 7fdb92ffd700 1 -- 172.21.15.80:0/2670316129 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fdb8c007df0 con 0x7fdb9410e3d0 2019-11-28T11:25:37.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.709+0000 7fdb9bc76700 1 -- 172.21.15.80:0/2670316129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fdb9410c490 con 0x7fdb9410e3d0 2019-11-28T11:25:37.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.709+0000 7fdb9aa14700 1 --2- 172.21.15.80:0/2670316129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb9410e3d0 0x7fdb94168d80 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fdb8c0103b0 tx=0x7fdb8c0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.709+0000 7fdb92ffd700 1 -- 172.21.15.80:0/2670316129 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fdb8c017110 con 0x7fdb9410e3d0 2019-11-28T11:25:37.730 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:37.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.712+0000 7fdb9bc76700 1 -- 172.21.15.80:0/2670316129 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdb78018730 msgr2=0x7fdb7801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.712+0000 7fdb9bc76700 1 --2- 172.21.15.80:0/2670316129 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdb78018730 0x7fdb7801abc0 crc :-1 s=READY pgs=95 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.712+0000 7fdb9bc76700 1 -- 172.21.15.80:0/2670316129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb9410e3d0 msgr2=0x7fdb94168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.712+0000 7fdb9bc76700 1 --2- 172.21.15.80:0/2670316129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb9410e3d0 0x7fdb94168d80 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7fdb8c0103b0 tx=0x7fdb8c0101e0).stop 2019-11-28T11:25:37.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.712+0000 7fdb9bc76700 1 -- 172.21.15.80:0/2670316129 shutdown_connections 2019-11-28T11:25:37.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.712+0000 7fdb9bc76700 1 --2- 172.21.15.80:0/2670316129 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdb78018730 0x7fdb7801abc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.712+0000 7fdb9bc76700 1 --2- 172.21.15.80:0/2670316129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdb9410e3d0 0x7fdb94168d80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.712+0000 7fdb9bc76700 1 --2- 172.21.15.80:0/2670316129 >> v2:172.21.15.174:3300/0 conn(0x7fdb94148320 0x7fdb9410ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.712+0000 7fdb9bc76700 1 -- 172.21.15.80:0/2670316129 shutdown_connections 2019-11-28T11:25:37.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.712+0000 7fdb9bc76700 1 -- 172.21.15.80:0/2670316129 wait complete. 2019-11-28T11:25:37.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.712+0000 7fdb9bc76700 1 -- 172.21.15.80:0/2670316129 >> 172.21.15.80:0/2670316129 conn(0x7fdb9415e2d0 msgr2=0x7fdb94147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:37.742 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:25:37.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.845+0000 7f219760f700 1 Processor -- start 2019-11-28T11:25:37.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.845+0000 7f219760f700 1 -- start start 2019-11-28T11:25:37.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.846+0000 7f219760f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f219015f100 0x7f219006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:37.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.846+0000 7f219760f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f219006c2f0 0x7f219006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:37.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.846+0000 7f219760f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219006db60 con 0x7f219015ed10 2019-11-28T11:25:37.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.846+0000 7f219760f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f219006fe00 con 0x7f219006c2f0 2019-11-28T11:25:37.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.846+0000 7f219760f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21900700d0 con 0x7f219015f100 2019-11-28T11:25:37.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f21963ad700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f219006c2f0 0x7f219006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:37.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f21963ad700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f219006c2f0 0x7f219006c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59814/0 (socket says 172.21.15.80:59814) 2019-11-28T11:25:37.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f21963ad700 1 -- 172.21.15.80:0/1750908943 learned_addr learned my addr 172.21.15.80:0/1750908943 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:37.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f21953ab700 1 --2- 172.21.15.80:0/1750908943 >> v2:172.21.15.174:3300/0 conn(0x7f219015f100 0x7f219006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:37.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f21963ad700 1 -- 172.21.15.80:0/1750908943 >> v2:172.21.15.174:3300/0 conn(0x7f219015f100 msgr2=0x7f219006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:37.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f21963ad700 1 --2- 172.21.15.80:0/1750908943 >> v2:172.21.15.174:3300/0 conn(0x7f219015f100 0x7f219006bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:37.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f21963ad700 1 -- 172.21.15.80:0/1750908943 >> v1:172.21.15.174:6789/0 conn(0x7f219015ed10 legacy=0x7f2190073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f21963ad700 1 -- 172.21.15.80:0/1750908943 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2190070760 con 0x7f219006c2f0 2019-11-28T11:25:37.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f21963ad700 1 --2- 172.21.15.80:0/1750908943 >> v2:172.21.15.80:3300/0 conn(0x7f219006c2f0 0x7f219006c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f218800fa30 tx=0x7f218800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f21963ad700 1 --2- 172.21.15.80:0/1750908943 >> v2:172.21.15.80:3300/0 conn(0x7f219006c2f0 0x7f219006c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f218800fa30 tx=0x7f218800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f21963ad700 1 --2- 172.21.15.80:0/1750908943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f219006c2f0 0x7f219006c770 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f218800fa30 tx=0x7f218800fdd0).ready entity=mon.0 client_cookie=f473993450d3f38f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:37.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f21963ad700 1 --2- 172.21.15.80:0/1750908943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f219006c2f0 0x7f219006c770 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f218800fa30 tx=0x7f218800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f21963ad700 1 --2- 172.21.15.80:0/1750908943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f219006c2f0 0x7f219006c770 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f218800fa30 tx=0x7f218800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f21963ad700 1 --2- 172.21.15.80:0/1750908943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f219006c2f0 0x7f219006c770 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f218800fa30 tx=0x7f218800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f2194baa700 1 -- 172.21.15.80:0/1750908943 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2188000df0 con 0x7f219006c2f0 2019-11-28T11:25:37.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f2194baa700 1 -- 172.21.15.80:0/1750908943 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2188001460 con 0x7f219006c2f0 2019-11-28T11:25:37.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f2194baa700 1 -- 172.21.15.80:0/1750908943 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2188001b30 con 0x7f219006c2f0 2019-11-28T11:25:37.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f219760f700 1 -- 172.21.15.80:0/1750908943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f219006c2f0 msgr2=0x7f219006c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.847+0000 7f219760f700 1 --2- 172.21.15.80:0/1750908943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f219006c2f0 0x7f219006c770 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f218800fa30 tx=0x7f218800fdd0).stop 2019-11-28T11:25:37.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.848+0000 7f219760f700 1 -- 172.21.15.80:0/1750908943 shutdown_connections 2019-11-28T11:25:37.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.848+0000 7f219760f700 1 --2- 172.21.15.80:0/1750908943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f219006c2f0 0x7f219006c770 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:37.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.848+0000 7f219760f700 1 --2- 172.21.15.80:0/1750908943 >> v2:172.21.15.174:3300/0 conn(0x7f219015f100 0x7f219006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:37.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.848+0000 7f219760f700 1 -- 172.21.15.80:0/1750908943 shutdown_connections 2019-11-28T11:25:37.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.848+0000 7f219760f700 1 -- 172.21.15.80:0/1750908943 wait complete. 2019-11-28T11:25:37.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.848+0000 7f219760f700 1 -- 172.21.15.80:0/1750908943 >> 172.21.15.80:0/1750908943 conn(0x7f2190061d20 msgr2=0x7f21900641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:37.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.850+0000 7f219760f700 1 Processor -- start 2019-11-28T11:25:37.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.851+0000 7f219760f700 1 -- start start 2019-11-28T11:25:37.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.851+0000 7f219760f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2190148320 0x7f219010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:37.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.851+0000 7f219760f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2190148e00 con 0x7f219010e3d0 2019-11-28T11:25:37.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.851+0000 7f219760f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2190108b10 con 0x7f219010f290 2019-11-28T11:25:37.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.851+0000 7f219760f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f219013aa20 con 0x7f2190148320 2019-11-28T11:25:37.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.851+0000 7f2195bac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2190148320 0x7f219010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:37.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f2195bac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2190148320 0x7f219010ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59820/0 (socket says 172.21.15.80:59820) 2019-11-28T11:25:37.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f2195bac700 1 -- 172.21.15.80:0/3073490536 learned_addr learned my addr 172.21.15.80:0/3073490536 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:37.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f21963ad700 1 --1- 172.21.15.80:0/3073490536 >> v1:172.21.15.80:6789/0 conn(0x7f219010e3d0 0x7f2190168d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59138/0 (socket says 172.21.15.80:59138) 2019-11-28T11:25:37.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f2195bac700 1 -- 172.21.15.80:0/3073490536 >> v1:172.21.15.174:6789/0 conn(0x7f219010f290 legacy=0x7f219010dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f2195bac700 1 -- 172.21.15.80:0/3073490536 >> v1:172.21.15.80:6789/0 conn(0x7f219010e3d0 legacy=0x7f2190168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:37.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f2195bac700 1 -- 172.21.15.80:0/3073490536 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219010c490 con 0x7f2190148320 2019-11-28T11:25:37.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f218e7fc700 1 -- 172.21.15.80:0/3073490536 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151606593 0 0) 0x7f2178009790 con 0x7f219010f290 2019-11-28T11:25:37.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f2195bac700 1 --2- 172.21.15.80:0/3073490536 >> v2:172.21.15.80:3300/0 conn(0x7f2190148320 0x7f219010ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2180010410 tx=0x7f21800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f2195bac700 1 --2- 172.21.15.80:0/3073490536 >> v2:172.21.15.80:3300/0 conn(0x7f2190148320 0x7f219010ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2180010410 tx=0x7f21800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f2195bac700 1 --2- 172.21.15.80:0/3073490536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2190148320 0x7f219010ed50 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f2180010410 tx=0x7f21800107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:37.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f2195bac700 1 --2- 172.21.15.80:0/3073490536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2190148320 0x7f219010ed50 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f2180010410 tx=0x7f21800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f218e7fc700 1 -- 172.21.15.80:0/3073490536 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2180000960 con 0x7f2190148320 2019-11-28T11:25:37.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f2195bac700 1 --2- 172.21.15.80:0/3073490536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2190148320 0x7f219010ed50 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f2180010410 tx=0x7f21800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f219760f700 1 -- 172.21.15.80:0/3073490536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219010c810 con 0x7f2190148320 2019-11-28T11:25:37.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f218e7fc700 1 -- 172.21.15.80:0/3073490536 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2180000960 con 0x7f2190148320 2019-11-28T11:25:37.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f2195bac700 1 --2- 172.21.15.80:0/3073490536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2190148320 0x7f219010ed50 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f2180010410 tx=0x7f21800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f218e7fc700 1 -- 172.21.15.80:0/3073490536 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2180001290 con 0x7f2190148320 2019-11-28T11:25:37.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.852+0000 7f219760f700 1 -- 172.21.15.80:0/3073490536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219010c490 con 0x7f2190148320 2019-11-28T11:25:37.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.853+0000 7f2195bac700 1 --2- 172.21.15.80:0/3073490536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2190148320 0x7f219010ed50 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f2180010410 tx=0x7f21800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.853+0000 7f218e7fc700 1 -- 172.21.15.80:0/3073490536 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2180000eb0 con 0x7f2190148320 2019-11-28T11:25:37.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.853+0000 7f2195bac700 1 --2- 172.21.15.80:0/3073490536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2190148320 0x7f219010ed50 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f2180010410 tx=0x7f21800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.853+0000 7f218e7fc700 1 --2- 172.21.15.80:0/3073490536 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2174018730 0x7f217401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:37.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.853+0000 7f218e7fc700 1 -- 172.21.15.80:0/3073490536 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2180031d80 con 0x7f2190148320 2019-11-28T11:25:37.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.853+0000 7f21953ab700 1 --2- 172.21.15.80:0/3073490536 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2174018730 0x7f217401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:37.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.853+0000 7f21953ab700 1 --2- 172.21.15.80:0/3073490536 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2174018730 0x7f217401abe0 crc :-1 s=READY pgs=96 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:37.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.861+0000 7f219760f700 1 -- 172.21.15.80:0/3073490536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219010c810 con 0x7f2190148320 2019-11-28T11:25:37.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.864+0000 7f2195bac700 1 --2- 172.21.15.80:0/3073490536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2190148320 0x7f219010ed50 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f2180010410 tx=0x7f21800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:37.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:37.864+0000 7f218e7fc700 1 -- 172.21.15.80:0/3073490536 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2180000940 con 0x7f2190148320 2019-11-28T11:25:38.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.030+0000 7f219760f700 1 -- 172.21.15.80:0/3073490536 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f219010c490 con 0x7f2190148320 2019-11-28T11:25:38.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.031+0000 7f2195bac700 1 --2- 172.21.15.80:0/3073490536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2190148320 0x7f219010ed50 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f2180010410 tx=0x7f21800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:38.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.031+0000 7f218e7fc700 1 -- 172.21.15.80:0/3073490536 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f21800075b0 con 0x7f2190148320 2019-11-28T11:25:38.052 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:38.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.033+0000 7f219760f700 1 -- 172.21.15.80:0/3073490536 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2174018730 msgr2=0x7f217401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:38.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.033+0000 7f219760f700 1 --2- 172.21.15.80:0/3073490536 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2174018730 0x7f217401abe0 crc :-1 s=READY pgs=96 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:38.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.033+0000 7f219760f700 1 -- 172.21.15.80:0/3073490536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2190148320 msgr2=0x7f219010ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:38.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.033+0000 7f219760f700 1 --2- 172.21.15.80:0/3073490536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2190148320 0x7f219010ed50 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f2180010410 tx=0x7f21800107b0).stop 2019-11-28T11:25:38.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.033+0000 7f219760f700 1 -- 172.21.15.80:0/3073490536 shutdown_connections 2019-11-28T11:25:38.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.033+0000 7f219760f700 1 --2- 172.21.15.80:0/3073490536 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2174018730 0x7f217401abe0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:38.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.033+0000 7f219760f700 1 --2- 172.21.15.80:0/3073490536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2190148320 0x7f219010ed50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:38.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.033+0000 7f219760f700 1 -- 172.21.15.80:0/3073490536 shutdown_connections 2019-11-28T11:25:38.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.033+0000 7f219760f700 1 -- 172.21.15.80:0/3073490536 wait complete. 2019-11-28T11:25:38.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.033+0000 7f219760f700 1 -- 172.21.15.80:0/3073490536 >> 172.21.15.80:0/3073490536 conn(0x7f219015e2d0 msgr2=0x7f2190147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:38.063 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:25:38.064 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:25:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.163+0000 7fc2e0db5700 1 Processor -- start 2019-11-28T11:25:38.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.163+0000 7fc2e0db5700 1 -- start start 2019-11-28T11:25:38.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2e0db5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc2dc06c0a0 0x7fc2dc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:38.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2e0db5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2dc072620 0x7fc2dc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:38.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2e0db5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2dc06db00 con 0x7fc2dc0734e0 2019-11-28T11:25:38.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2e0db5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2dc06fd60 con 0x7fc2dc06c0a0 2019-11-28T11:25:38.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2e0db5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc070030 con 0x7fc2dc072620 2019-11-28T11:25:38.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2dad9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc2dc06c0a0 0x7fc2dc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:38.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2db59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2dc072620 0x7fc2dc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:38.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2dad9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc2dc06c0a0 0x7fc2dc072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:46480/0 (socket says 172.21.15.80:46480) 2019-11-28T11:25:38.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2db59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2dc072620 0x7fc2dc164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:33856/0 (socket says 172.21.15.80:33856) 2019-11-28T11:25:38.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2dad9d700 1 -- 172.21.15.80:0/175570951 learned_addr learned my addr 172.21.15.80:0/175570951 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:38.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2da59c700 1 --1- 172.21.15.80:0/175570951 >> v1:172.21.15.174:6789/0 conn(0x7fc2dc0734e0 0x7fc2dc071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:46458/0 (socket says 172.21.15.80:46458) 2019-11-28T11:25:38.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2dad9d700 1 -- 172.21.15.80:0/175570951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2dc072620 msgr2=0x7fc2dc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:38.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2dad9d700 1 --2- 172.21.15.80:0/175570951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2dc072620 0x7fc2dc164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:38.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2dad9d700 1 -- 172.21.15.80:0/175570951 >> v1:172.21.15.174:6789/0 conn(0x7fc2dc0734e0 legacy=0x7fc2dc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:38.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2dad9d700 1 -- 172.21.15.80:0/175570951 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc0706c0 con 0x7fc2dc06c0a0 2019-11-28T11:25:38.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2d9d9b700 1 -- 172.21.15.80:0/175570951 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533630795 0 0) 0x7fc2c40013f0 con 0x7fc2dc0734e0 2019-11-28T11:25:38.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.164+0000 7fc2db59e700 1 --2- 172.21.15.80:0/175570951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2dc072620 0x7fc2dc164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:38.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.165+0000 7fc2dad9d700 1 --2- 172.21.15.80:0/175570951 >> v2:172.21.15.174:3300/0 conn(0x7fc2dc06c0a0 0x7fc2dc072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc2cc00f740 tx=0x7fc2cc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:38.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.165+0000 7fc2dad9d700 1 --2- 172.21.15.80:0/175570951 >> v2:172.21.15.174:3300/0 conn(0x7fc2dc06c0a0 0x7fc2dc072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc2cc00f740 tx=0x7fc2cc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:38.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.165+0000 7fc2dad9d700 1 --2- 172.21.15.80:0/175570951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2dc06c0a0 0x7fc2dc072fa0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7fc2cc00f740 tx=0x7fc2cc00fae0).ready entity=mon.1 client_cookie=226c5b0165e477e5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:38.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.165+0000 7fc2dad9d700 1 --2- 172.21.15.80:0/175570951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2dc06c0a0 0x7fc2dc072fa0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fc2cc00f740 tx=0x7fc2cc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:38.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.165+0000 7fc2d9d9b700 1 -- 172.21.15.80:0/175570951 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2cc000960 con 0x7fc2dc06c0a0 2019-11-28T11:25:38.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.165+0000 7fc2dad9d700 1 --2- 172.21.15.80:0/175570951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2dc06c0a0 0x7fc2dc072fa0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fc2cc00f740 tx=0x7fc2cc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:38.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.165+0000 7fc2dad9d700 1 --2- 172.21.15.80:0/175570951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2dc06c0a0 0x7fc2dc072fa0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fc2cc00f740 tx=0x7fc2cc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:38.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.165+0000 7fc2d9d9b700 1 -- 172.21.15.80:0/175570951 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2cc007210 con 0x7fc2dc06c0a0 2019-11-28T11:25:38.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.165+0000 7fc2d9d9b700 1 -- 172.21.15.80:0/175570951 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2cc000e80 con 0x7fc2dc06c0a0 2019-11-28T11:25:38.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.165+0000 7fc2e0db5700 1 -- 172.21.15.80:0/175570951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2dc06c0a0 msgr2=0x7fc2dc072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:38.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.165+0000 7fc2e0db5700 1 --2- 172.21.15.80:0/175570951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2dc06c0a0 0x7fc2dc072fa0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7fc2cc00f740 tx=0x7fc2cc00fae0).stop 2019-11-28T11:25:38.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.166+0000 7fc2e0db5700 1 -- 172.21.15.80:0/175570951 shutdown_connections 2019-11-28T11:25:38.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.166+0000 7fc2e0db5700 1 --2- 172.21.15.80:0/175570951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2dc072620 0x7fc2dc164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:38.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.166+0000 7fc2e0db5700 1 --2- 172.21.15.80:0/175570951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2dc06c0a0 0x7fc2dc072fa0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:38.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.166+0000 7fc2e0db5700 1 -- 172.21.15.80:0/175570951 shutdown_connections 2019-11-28T11:25:38.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.166+0000 7fc2e0db5700 1 -- 172.21.15.80:0/175570951 wait complete. 2019-11-28T11:25:38.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.166+0000 7fc2e0db5700 1 -- 172.21.15.80:0/175570951 >> 172.21.15.80:0/175570951 conn(0x7fc2dc061cf0 msgr2=0x7fc2dc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:38.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.168+0000 7fc2e0db5700 1 Processor -- start 2019-11-28T11:25:38.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.168+0000 7fc2e0db5700 1 -- start start 2019-11-28T11:25:38.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.169+0000 7fc2e0db5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc2dc104c10 0x7fc2dc1050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:38.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.169+0000 7fc2e0db5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2dc13bcd0 con 0x7fc2dc104820 2019-11-28T11:25:38.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.169+0000 7fc2e0db5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2dc105ea0 con 0x7fc2dc1055e0 2019-11-28T11:25:38.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.169+0000 7fc2e0db5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2dc109130 con 0x7fc2dc104c10 2019-11-28T11:25:38.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.169+0000 7fc2da59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc2dc104c10 0x7fc2dc1050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:38.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.169+0000 7fc2da59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc2dc104c10 0x7fc2dc1050a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59834/0 (socket says 172.21.15.80:59834) 2019-11-28T11:25:38.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.169+0000 7fc2da59c700 1 -- 172.21.15.80:0/2524526380 learned_addr learned my addr 172.21.15.80:0/2524526380 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:38.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.169+0000 7fc2da59c700 1 -- 172.21.15.80:0/2524526380 >> v1:172.21.15.174:6789/0 conn(0x7fc2dc1055e0 legacy=0x7fc2dc167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:38.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.169+0000 7fc2da59c700 1 -- 172.21.15.80:0/2524526380 >> v1:172.21.15.80:6789/0 conn(0x7fc2dc104820 legacy=0x7fc2dc10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:38.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.169+0000 7fc2d37fe700 1 -- 172.21.15.80:0/2524526380 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859609550 0 0) 0x7fc2d40097c0 con 0x7fc2dc1055e0 2019-11-28T11:25:38.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.169+0000 7fc2da59c700 1 -- 172.21.15.80:0/2524526380 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc109a90 con 0x7fc2dc104c10 2019-11-28T11:25:38.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.169+0000 7fc2da59c700 1 --2- 172.21.15.80:0/2524526380 >> v2:172.21.15.80:3300/0 conn(0x7fc2dc104c10 0x7fc2dc1050a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc2c40107c0 tx=0x7fc2c4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:38.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.170+0000 7fc2da59c700 1 --2- 172.21.15.80:0/2524526380 >> v2:172.21.15.80:3300/0 conn(0x7fc2dc104c10 0x7fc2dc1050a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc2c40107c0 tx=0x7fc2c4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:38.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.170+0000 7fc2da59c700 1 --2- 172.21.15.80:0/2524526380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2dc104c10 0x7fc2dc1050a0 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7fc2c40107c0 tx=0x7fc2c4010b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:38.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.170+0000 7fc2da59c700 1 --2- 172.21.15.80:0/2524526380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2dc104c10 0x7fc2dc1050a0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fc2c40107c0 tx=0x7fc2c4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:38.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.170+0000 7fc2d37fe700 1 -- 172.21.15.80:0/2524526380 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2c4001670 con 0x7fc2dc104c10 2019-11-28T11:25:38.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.170+0000 7fc2da59c700 1 --2- 172.21.15.80:0/2524526380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2dc104c10 0x7fc2dc1050a0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fc2c40107c0 tx=0x7fc2c4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:38.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.170+0000 7fc2da59c700 1 --2- 172.21.15.80:0/2524526380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2dc104c10 0x7fc2dc1050a0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fc2c40107c0 tx=0x7fc2c4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:38.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.170+0000 7fc2d37fe700 1 -- 172.21.15.80:0/2524526380 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c40010d0 con 0x7fc2dc104c10 2019-11-28T11:25:38.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.170+0000 7fc2e0db5700 1 -- 172.21.15.80:0/2524526380 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2dc109e10 con 0x7fc2dc104c10 2019-11-28T11:25:38.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.170+0000 7fc2d37fe700 1 -- 172.21.15.80:0/2524526380 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2c4001670 con 0x7fc2dc104c10 2019-11-28T11:25:38.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.170+0000 7fc2e0db5700 1 -- 172.21.15.80:0/2524526380 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2dc109a90 con 0x7fc2dc104c10 2019-11-28T11:25:38.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.170+0000 7fc2da59c700 1 --2- 172.21.15.80:0/2524526380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2dc104c10 0x7fc2dc1050a0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fc2c40107c0 tx=0x7fc2c4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:38.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.170+0000 7fc2d37fe700 1 -- 172.21.15.80:0/2524526380 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc2c4004360 con 0x7fc2dc104c10 2019-11-28T11:25:38.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.170+0000 7fc2da59c700 1 --2- 172.21.15.80:0/2524526380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2dc104c10 0x7fc2dc1050a0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fc2c40107c0 tx=0x7fc2c4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:38.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.170+0000 7fc2d37fe700 1 --2- 172.21.15.80:0/2524526380 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc2b4018730 0x7fc2b401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:38.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.170+0000 7fc2d37fe700 1 -- 172.21.15.80:0/2524526380 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fc2c4031ec0 con 0x7fc2dc104c10 2019-11-28T11:25:38.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.171+0000 7fc2dad9d700 1 --2- 172.21.15.80:0/2524526380 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc2b4018730 0x7fc2b401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:38.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.171+0000 7fc2dad9d700 1 --2- 172.21.15.80:0/2524526380 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc2b4018730 0x7fc2b401abc0 crc :-1 s=READY pgs=97 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:38.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.178+0000 7fc2e0db5700 1 -- 172.21.15.80:0/2524526380 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2dc109e10 con 0x7fc2dc104c10 2019-11-28T11:25:38.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.182+0000 7fc2da59c700 1 --2- 172.21.15.80:0/2524526380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2dc104c10 0x7fc2dc1050a0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fc2c40107c0 tx=0x7fc2c4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:38.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.182+0000 7fc2d37fe700 1 -- 172.21.15.80:0/2524526380 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc2c4000cc0 con 0x7fc2dc104c10 2019-11-28T11:25:38.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.354+0000 7fc2e0db5700 1 -- 172.21.15.80:0/2524526380 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2dc109a90 con 0x7fc2dc104c10 2019-11-28T11:25:38.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.354+0000 7fc2da59c700 1 --2- 172.21.15.80:0/2524526380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2dc104c10 0x7fc2dc1050a0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fc2c40107c0 tx=0x7fc2c4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:38.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.354+0000 7fc2d37fe700 1 -- 172.21.15.80:0/2524526380 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2441 (secure 0 0 0) 0x7fc2c4004360 con 0x7fc2dc104c10 2019-11-28T11:25:38.375 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 6 2019-11-28T11:25:38.375 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:38.375 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/3100151299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3100151299},{"type":"v1","addr":"172.21.15.80:6833","nonce":3100151299}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4},{"gid":4359,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/4212336515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":4212336515},{"type":"v1","addr":"172.21.15.80:6835","nonce":4212336515}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:25:19.931718+0000","modified":"2019-11-28T11:25:28.542379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4229":{"gid":4229,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2081356472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2081356472},{"type":"v1","addr":"172.21.15.174:6835","nonce":2081356472}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-11-28T11:25:38.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.357+0000 7fc2e0db5700 1 -- 172.21.15.80:0/2524526380 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc2b4018730 msgr2=0x7fc2b401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:38.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.357+0000 7fc2e0db5700 1 --2- 172.21.15.80:0/2524526380 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc2b4018730 0x7fc2b401abc0 crc :-1 s=READY pgs=97 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:38.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.357+0000 7fc2e0db5700 1 -- 172.21.15.80:0/2524526380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2dc104c10 msgr2=0x7fc2dc1050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:38.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.357+0000 7fc2e0db5700 1 --2- 172.21.15.80:0/2524526380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2dc104c10 0x7fc2dc1050a0 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7fc2c40107c0 tx=0x7fc2c4010b60).stop 2019-11-28T11:25:38.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.357+0000 7fc2e0db5700 1 -- 172.21.15.80:0/2524526380 shutdown_connections 2019-11-28T11:25:38.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.357+0000 7fc2e0db5700 1 --2- 172.21.15.80:0/2524526380 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc2b4018730 0x7fc2b401abc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:38.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.357+0000 7fc2e0db5700 1 --2- 172.21.15.80:0/2524526380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2dc104c10 0x7fc2dc1050a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:38.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.357+0000 7fc2e0db5700 1 -- 172.21.15.80:0/2524526380 shutdown_connections 2019-11-28T11:25:38.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.357+0000 7fc2e0db5700 1 -- 172.21.15.80:0/2524526380 wait complete. 2019-11-28T11:25:38.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:38.357+0000 7fc2e0db5700 1 -- 172.21.15.80:0/2524526380 >> 172.21.15.80:0/2524526380 conn(0x7fc2dc13d620 msgr2=0x7fc2dc13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:38.690 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4229}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4229': {u'export_targets': [], u'name': u'c', u'incarnation': 5, u'state_seq': 3, u'state': u'up:active', u'gid': 4229, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2081356472, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2081356472, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2081356472'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:25:19.931718+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:25:28.542379+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:25:38.690 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:25:38.690 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:25:38.819 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:25:38.819 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:25:38.820 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:25:38.820 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 4229, 2019-11-28T11:25:38.820 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:25:38.820 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:25:38.820 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 11.258461178999999, 2019-11-28T11:25:38.820 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 6, 2019-11-28T11:25:38.821 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 25, 2019-11-28T11:25:38.821 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 25, 2019-11-28T11:25:38.821 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 16.080291627000001 2019-11-28T11:25:38.821 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:25:38.825 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 4229, "want_state": "up:active", "state": "up:active", "rank_uptime": 11.258461178999999, "mdsmap_epoch": 6, "osdmap_epoch": 25, "osdmap_epoch_barrier": 25, "uptime": 16.080291627000001 } 2019-11-28T11:25:38.825 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:25:38.825 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.3 at ubuntu@smithi133.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3... 2019-11-28T11:25:38.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:25:38.826 INFO:teuthology.orchestra.run.smithi133:> mkdir -- /home/ubuntu/cephtest/mnt.3 2019-11-28T11:25:38.897 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:25:38.898 INFO:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o name=3,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:25:38.971 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,name=3,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:25:39.045 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:25:39.088 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,name=3,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:25:39.088 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:25:39.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:25:39.105 INFO:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2019-11-28T11:25:39.182 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:39.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.283+0000 7fbfb3520700 1 Processor -- start 2019-11-28T11:25:39.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.283+0000 7fbfb3520700 1 -- start start 2019-11-28T11:25:39.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.284+0000 7fbfb3520700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbfac06c0a0 0x7fbfac072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:39.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.284+0000 7fbfb3520700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac0734e0 0x7fbfac071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:39.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.284+0000 7fbfb3520700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbfac072360 0x7fbfac072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:39.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.284+0000 7fbfb3520700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac06fd60 con 0x7fbfac072360 2019-11-28T11:25:39.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.284+0000 7fbfb3520700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac070030 con 0x7fbfac06c0a0 2019-11-28T11:25:39.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.284+0000 7fbfb3520700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac06f330 con 0x7fbfac0734e0 2019-11-28T11:25:39.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb22be700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbfac072360 0x7fbfac072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:39.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb22be700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbfac072360 0x7fbfac072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59842/0 (socket says 172.21.15.80:59842) 2019-11-28T11:25:39.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb22be700 1 -- 172.21.15.80:0/2514026117 learned_addr learned my addr 172.21.15.80:0/2514026117 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:39.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb12bc700 1 --2- 172.21.15.80:0/2514026117 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac0734e0 0x7fbfac071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:39.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb1abd700 1 --2- 172.21.15.80:0/2514026117 >> v2:172.21.15.174:3300/0 conn(0x7fbfac06c0a0 0x7fbfac072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:39.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb22be700 1 -- 172.21.15.80:0/2514026117 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac0734e0 msgr2=0x7fbfac071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:39.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb22be700 1 --2- 172.21.15.80:0/2514026117 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac0734e0 0x7fbfac071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:39.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb22be700 1 -- 172.21.15.80:0/2514026117 >> v2:172.21.15.174:3300/0 conn(0x7fbfac06c0a0 msgr2=0x7fbfac072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:39.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb22be700 1 --2- 172.21.15.80:0/2514026117 >> v2:172.21.15.174:3300/0 conn(0x7fbfac06c0a0 0x7fbfac072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:39.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb22be700 1 -- 172.21.15.80:0/2514026117 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac0706c0 con 0x7fbfac072360 2019-11-28T11:25:39.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb1abd700 1 --2- 172.21.15.80:0/2514026117 >> v2:172.21.15.174:3300/0 conn(0x7fbfac06c0a0 0x7fbfac072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:39.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb22be700 1 --2- 172.21.15.80:0/2514026117 >> v2:172.21.15.80:3300/0 conn(0x7fbfac072360 0x7fbfac072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbfa400fa30 tx=0x7fbfa400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb22be700 1 --2- 172.21.15.80:0/2514026117 >> v2:172.21.15.80:3300/0 conn(0x7fbfac072360 0x7fbfac072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbfa400fa30 tx=0x7fbfa400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb22be700 1 --2- 172.21.15.80:0/2514026117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac072360 0x7fbfac072800 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7fbfa400fa30 tx=0x7fbfa400fdd0).ready entity=mon.0 client_cookie=7e73c867cd06f004 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:39.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb22be700 1 --2- 172.21.15.80:0/2514026117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac072360 0x7fbfac072800 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fbfa400fa30 tx=0x7fbfa400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb22be700 1 --2- 172.21.15.80:0/2514026117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac072360 0x7fbfac072800 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fbfa400fa30 tx=0x7fbfa400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb0abb700 1 -- 172.21.15.80:0/2514026117 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfa4001460 con 0x7fbfac072360 2019-11-28T11:25:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb22be700 1 --2- 172.21.15.80:0/2514026117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac072360 0x7fbfac072800 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fbfa400fa30 tx=0x7fbfa400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb0abb700 1 -- 172.21.15.80:0/2514026117 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa4000f10 con 0x7fbfac072360 2019-11-28T11:25:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb0abb700 1 -- 172.21.15.80:0/2514026117 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfa4001a40 con 0x7fbfac072360 2019-11-28T11:25:39.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb3520700 1 -- 172.21.15.80:0/2514026117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac072360 msgr2=0x7fbfac072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.285+0000 7fbfb3520700 1 --2- 172.21.15.80:0/2514026117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac072360 0x7fbfac072800 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7fbfa400fa30 tx=0x7fbfa400fdd0).stop 2019-11-28T11:25:39.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.286+0000 7fbfb3520700 1 -- 172.21.15.80:0/2514026117 shutdown_connections 2019-11-28T11:25:39.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.286+0000 7fbfb3520700 1 --2- 172.21.15.80:0/2514026117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac072360 0x7fbfac072800 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:39.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.286+0000 7fbfb3520700 1 --2- 172.21.15.80:0/2514026117 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac0734e0 0x7fbfac071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:39.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.286+0000 7fbfb3520700 1 --2- 172.21.15.80:0/2514026117 >> v2:172.21.15.174:3300/0 conn(0x7fbfac06c0a0 0x7fbfac072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:39.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.286+0000 7fbfb3520700 1 -- 172.21.15.80:0/2514026117 shutdown_connections 2019-11-28T11:25:39.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.286+0000 7fbfb3520700 1 -- 172.21.15.80:0/2514026117 wait complete. 2019-11-28T11:25:39.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.286+0000 7fbfb3520700 1 -- 172.21.15.80:0/2514026117 >> 172.21.15.80:0/2514026117 conn(0x7fbfac061cf0 msgr2=0x7fbfac064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:39.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.288+0000 7fbfb3520700 1 Processor -- start 2019-11-28T11:25:39.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.288+0000 7fbfb3520700 1 -- start start 2019-11-28T11:25:39.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.289+0000 7fbfb3520700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac103000 0x7fbfac103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:39.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.289+0000 7fbfb3520700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfac1312c0 con 0x7fbfac13dc00 2019-11-28T11:25:39.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.289+0000 7fbfb3520700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfac131730 con 0x7fbfac1039d0 2019-11-28T11:25:39.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.289+0000 7fbfb3520700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac105830 con 0x7fbfac103000 2019-11-28T11:25:39.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.289+0000 7fbfb1abd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbfac13dc00 0x7fbfac109e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59162/0 (socket says 172.21.15.80:59162) 2019-11-28T11:25:39.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.289+0000 7fbfb1abd700 1 -- 172.21.15.80:0/1595421577 learned_addr learned my addr 172.21.15.80:0/1595421577 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:39.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.289+0000 7fbfb12bc700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac103000 0x7fbfac103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:39.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfaa7fc700 1 -- 172.21.15.80:0/1595421577 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539854213 0 0) 0x7fbf94009c90 con 0x7fbfac13dc00 2019-11-28T11:25:39.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfaa7fc700 1 -- 172.21.15.80:0/1595421577 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf90002e80 con 0x7fbfac13dc00 2019-11-28T11:25:39.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfaa7fc700 1 -- 172.21.15.80:0/1595421577 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249101797 0 0) 0x7fbfa4000f10 con 0x7fbfac1039d0 2019-11-28T11:25:39.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfaa7fc700 1 -- 172.21.15.80:0/1595421577 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf900030b0 con 0x7fbfac1039d0 2019-11-28T11:25:39.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfb12bc700 1 -- 172.21.15.80:0/1595421577 >> v1:172.21.15.174:6789/0 conn(0x7fbfac1039d0 legacy=0x7fbfac167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfb12bc700 1 -- 172.21.15.80:0/1595421577 >> v1:172.21.15.80:6789/0 conn(0x7fbfac13dc00 legacy=0x7fbfac109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfb12bc700 1 -- 172.21.15.80:0/1595421577 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac106190 con 0x7fbfac103000 2019-11-28T11:25:39.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfb12bc700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac103000 0x7fbfac103490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf9c010390 tx=0x7fbf9c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfb12bc700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac103000 0x7fbfac103490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf9c010390 tx=0x7fbf9c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfb12bc700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac103000 0x7fbfac103490 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7fbf9c010390 tx=0x7fbf9c010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfb12bc700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac103000 0x7fbfac103490 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7fbf9c010390 tx=0x7fbf9c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfaa7fc700 1 -- 172.21.15.80:0/1595421577 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf9c009640 con 0x7fbfac103000 2019-11-28T11:25:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfb12bc700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac103000 0x7fbfac103490 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7fbf9c010390 tx=0x7fbf9c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfb12bc700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac103000 0x7fbfac103490 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7fbf9c010390 tx=0x7fbf9c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfaa7fc700 1 -- 172.21.15.80:0/1595421577 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c000940 con 0x7fbfac103000 2019-11-28T11:25:39.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfb3520700 1 -- 172.21.15.80:0/1595421577 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac106510 con 0x7fbfac103000 2019-11-28T11:25:39.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfaa7fc700 1 -- 172.21.15.80:0/1595421577 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf9c00a0e0 con 0x7fbfac103000 2019-11-28T11:25:39.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfb3520700 1 -- 172.21.15.80:0/1595421577 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac106190 con 0x7fbfac103000 2019-11-28T11:25:39.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.290+0000 7fbfb12bc700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac103000 0x7fbfac103490 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7fbf9c010390 tx=0x7fbf9c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.291+0000 7fbfaa7fc700 1 -- 172.21.15.80:0/1595421577 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbf9c009a70 con 0x7fbfac103000 2019-11-28T11:25:39.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.291+0000 7fbfb12bc700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac103000 0x7fbfac103490 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7fbf9c010390 tx=0x7fbf9c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.291+0000 7fbfaa7fc700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbf90018750 0x7fbf9001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:39.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.291+0000 7fbfaa7fc700 1 -- 172.21.15.80:0/1595421577 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fbf9c031d00 con 0x7fbfac103000 2019-11-28T11:25:39.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.291+0000 7fbfb1abd700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbf90018750 0x7fbf9001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:39.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.291+0000 7fbfb1abd700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbf90018750 0x7fbf9001abe0 crc :-1 s=READY pgs=98 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:39.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.299+0000 7fbfb3520700 1 -- 172.21.15.80:0/1595421577 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac106510 con 0x7fbfac103000 2019-11-28T11:25:39.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.303+0000 7fbfb12bc700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac103000 0x7fbfac103490 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7fbf9c010390 tx=0x7fbf9c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.303+0000 7fbfaa7fc700 1 -- 172.21.15.80:0/1595421577 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbf9c009840 con 0x7fbfac103000 2019-11-28T11:25:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.479+0000 7fbfb3520700 1 -- 172.21.15.80:0/1595421577 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfac106190 con 0x7fbfac103000 2019-11-28T11:25:39.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.480+0000 7fbfb12bc700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac103000 0x7fbfac103490 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7fbf9c010390 tx=0x7fbf9c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.480+0000 7fbfaa7fc700 1 -- 172.21.15.80:0/1595421577 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14885 (secure 0 0 0) 0x7fbf9c009a50 con 0x7fbfac103000 2019-11-28T11:25:39.501 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:39.502 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:20.933435+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:25:14.914696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-11-28T11:25:17.566323+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:39.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.484+0000 7fbfb3520700 1 -- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbf90018750 msgr2=0x7fbf9001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.484+0000 7fbfb3520700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbf90018750 0x7fbf9001abe0 crc :-1 s=READY pgs=98 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.484+0000 7fbfb3520700 1 -- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac103000 msgr2=0x7fbfac103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.484+0000 7fbfb3520700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac103000 0x7fbfac103490 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7fbf9c010390 tx=0x7fbf9c010730).stop 2019-11-28T11:25:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.484+0000 7fbfb3520700 1 -- 172.21.15.80:0/1595421577 shutdown_connections 2019-11-28T11:25:39.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.484+0000 7fbfb3520700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbf90018750 0x7fbf9001abe0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.484+0000 7fbfb3520700 1 --2- 172.21.15.80:0/1595421577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfac103000 0x7fbfac103490 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.484+0000 7fbfb3520700 1 -- 172.21.15.80:0/1595421577 shutdown_connections 2019-11-28T11:25:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.484+0000 7fbfb3520700 1 -- 172.21.15.80:0/1595421577 wait complete. 2019-11-28T11:25:39.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.484+0000 7fbfb3520700 1 -- 172.21.15.80:0/1595421577 >> 172.21.15.80:0/1595421577 conn(0x7fbfac11bfc0 msgr2=0x7fbfac141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:39.516 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:14.914696+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:17.566323+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:25:39.517 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:25:39.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.624+0000 7f72ba476700 1 Processor -- start 2019-11-28T11:25:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.624+0000 7f72ba476700 1 -- start start 2019-11-28T11:25:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72ba476700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b415ed10 0x7f72b415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72ba476700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f72b4073020 0x7f72b4071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72ba476700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72b40734b0 0x7f72b40723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:39.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72ba476700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b406f3d0 con 0x7f72b40734b0 2019-11-28T11:25:39.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72ba476700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b406fe00 con 0x7f72b4073020 2019-11-28T11:25:39.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72ba476700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b4070760 con 0x7f72b415ed10 2019-11-28T11:25:39.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72b9214700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72b40734b0 0x7f72b40723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:39.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72b9214700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72b40734b0 0x7f72b40723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59856/0 (socket says 172.21.15.80:59856) 2019-11-28T11:25:39.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72b9214700 1 -- 172.21.15.80:0/819553631 learned_addr learned my addr 172.21.15.80:0/819553631 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:39.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72b3fff700 1 --2- 172.21.15.80:0/819553631 >> v2:172.21.15.174:3300/0 conn(0x7f72b4073020 0x7f72b4071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:39.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72b8a13700 1 --2- 172.21.15.80:0/819553631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b415ed10 0x7f72b415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:39.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72b9214700 1 -- 172.21.15.80:0/819553631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b415ed10 msgr2=0x7f72b415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:39.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72b9214700 1 --2- 172.21.15.80:0/819553631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b415ed10 0x7f72b415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:39.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72b9214700 1 -- 172.21.15.80:0/819553631 >> v2:172.21.15.174:3300/0 conn(0x7f72b4073020 msgr2=0x7f72b4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:39.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72b9214700 1 --2- 172.21.15.80:0/819553631 >> v2:172.21.15.174:3300/0 conn(0x7f72b4073020 0x7f72b4071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:39.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72b9214700 1 -- 172.21.15.80:0/819553631 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b4070ae0 con 0x7f72b40734b0 2019-11-28T11:25:39.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72b8a13700 1 --2- 172.21.15.80:0/819553631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b415ed10 0x7f72b415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:25:39.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72b3fff700 1 --2- 172.21.15.80:0/819553631 >> v2:172.21.15.174:3300/0 conn(0x7f72b4073020 0x7f72b4071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:25:39.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.625+0000 7f72b9214700 1 --2- 172.21.15.80:0/819553631 >> v2:172.21.15.80:3300/0 conn(0x7f72b40734b0 0x7f72b40723e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f72ac00fab0 tx=0x7f72ac00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72b9214700 1 --2- 172.21.15.80:0/819553631 >> v2:172.21.15.80:3300/0 conn(0x7f72b40734b0 0x7f72b40723e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f72ac00fab0 tx=0x7f72ac00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72b9214700 1 --2- 172.21.15.80:0/819553631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b40734b0 0x7f72b40723e0 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7f72ac00fab0 tx=0x7f72ac00fe50).ready entity=mon.0 client_cookie=5ca2d7a01b6adb84 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:39.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72b9214700 1 --2- 172.21.15.80:0/819553631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b40734b0 0x7f72b40723e0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f72ac00fab0 tx=0x7f72ac00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72b37fe700 1 -- 172.21.15.80:0/819553631 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72ac001460 con 0x7f72b40734b0 2019-11-28T11:25:39.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72b9214700 1 --2- 172.21.15.80:0/819553631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b40734b0 0x7f72b40723e0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f72ac00fab0 tx=0x7f72ac00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72b9214700 1 --2- 172.21.15.80:0/819553631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b40734b0 0x7f72b40723e0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f72ac00fab0 tx=0x7f72ac00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72b37fe700 1 -- 172.21.15.80:0/819553631 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac000f10 con 0x7f72b40734b0 2019-11-28T11:25:39.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72b37fe700 1 -- 172.21.15.80:0/819553631 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72ac001a40 con 0x7f72b40734b0 2019-11-28T11:25:39.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72ba476700 1 -- 172.21.15.80:0/819553631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b40734b0 msgr2=0x7f72b40723e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72ba476700 1 --2- 172.21.15.80:0/819553631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b40734b0 0x7f72b40723e0 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7f72ac00fab0 tx=0x7f72ac00fe50).stop 2019-11-28T11:25:39.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72ba476700 1 -- 172.21.15.80:0/819553631 shutdown_connections 2019-11-28T11:25:39.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72ba476700 1 --2- 172.21.15.80:0/819553631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b40734b0 0x7f72b40723e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:39.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72ba476700 1 --2- 172.21.15.80:0/819553631 >> v2:172.21.15.174:3300/0 conn(0x7f72b4073020 0x7f72b4071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:39.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72ba476700 1 --2- 172.21.15.80:0/819553631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b415ed10 0x7f72b415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:39.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72ba476700 1 -- 172.21.15.80:0/819553631 shutdown_connections 2019-11-28T11:25:39.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72ba476700 1 -- 172.21.15.80:0/819553631 wait complete. 2019-11-28T11:25:39.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.626+0000 7f72ba476700 1 -- 172.21.15.80:0/819553631 >> 172.21.15.80:0/819553631 conn(0x7f72b4061d20 msgr2=0x7f72b40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:39.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.629+0000 7f72ba476700 1 Processor -- start 2019-11-28T11:25:39.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.629+0000 7f72ba476700 1 -- start start 2019-11-28T11:25:39.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72ba476700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72b410ed60 0x7f72b410f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:39.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72ba476700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f72b410f730 0x7f72b4167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:39.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72ba476700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b410c250 con 0x7f72b410e970 2019-11-28T11:25:39.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72ba476700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b410e430 con 0x7f72b410ed60 2019-11-28T11:25:39.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72ba476700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b4105860 con 0x7f72b410f730 2019-11-28T11:25:39.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72b3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72b410ed60 0x7f72b410f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:39.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72b3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72b410ed60 0x7f72b410f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59860/0 (socket says 172.21.15.80:59860) 2019-11-28T11:25:39.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72b3fff700 1 -- 172.21.15.80:0/3451900591 learned_addr learned my addr 172.21.15.80:0/3451900591 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:39.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72b9214700 1 --2- 172.21.15.80:0/3451900591 >> v2:172.21.15.174:3300/0 conn(0x7f72b410f730 0x7f72b4167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:39.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72b3fff700 1 -- 172.21.15.80:0/3451900591 >> v2:172.21.15.174:3300/0 conn(0x7f72b410f730 msgr2=0x7f72b4167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72b3fff700 1 --2- 172.21.15.80:0/3451900591 >> v2:172.21.15.174:3300/0 conn(0x7f72b410f730 0x7f72b4167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:39.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72b3fff700 1 -- 172.21.15.80:0/3451900591 >> v1:172.21.15.80:6789/0 conn(0x7f72b410e970 legacy=0x7f72b41087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72b17fa700 1 -- 172.21.15.80:0/3451900591 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491312370 0 0) 0x7f729c007480 con 0x7f72b410e970 2019-11-28T11:25:39.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72b3fff700 1 -- 172.21.15.80:0/3451900591 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b4105ef0 con 0x7f72b410ed60 2019-11-28T11:25:39.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72b3fff700 1 --2- 172.21.15.80:0/3451900591 >> v2:172.21.15.80:3300/0 conn(0x7f72b410ed60 0x7f72b410f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f72a4010460 tx=0x7f72a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72b3fff700 1 --2- 172.21.15.80:0/3451900591 >> v2:172.21.15.80:3300/0 conn(0x7f72b410ed60 0x7f72b410f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f72a4010460 tx=0x7f72a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72b3fff700 1 --2- 172.21.15.80:0/3451900591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b410ed60 0x7f72b410f1f0 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f72a4010460 tx=0x7f72a4010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:39.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72b3fff700 1 --2- 172.21.15.80:0/3451900591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b410ed60 0x7f72b410f1f0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f72a4010460 tx=0x7f72a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72b17fa700 1 -- 172.21.15.80:0/3451900591 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a4000940 con 0x7f72b410ed60 2019-11-28T11:25:39.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.630+0000 7f72b3fff700 1 --2- 172.21.15.80:0/3451900591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b410ed60 0x7f72b410f1f0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f72a4010460 tx=0x7f72a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.631+0000 7f72b3fff700 1 --2- 172.21.15.80:0/3451900591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b410ed60 0x7f72b410f1f0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f72a4010460 tx=0x7f72a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.631+0000 7f72b17fa700 1 -- 172.21.15.80:0/3451900591 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a4001090 con 0x7f72b410ed60 2019-11-28T11:25:39.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.631+0000 7f72ba476700 1 -- 172.21.15.80:0/3451900591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b4106270 con 0x7f72b410ed60 2019-11-28T11:25:39.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.631+0000 7f72b17fa700 1 -- 172.21.15.80:0/3451900591 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a40016e0 con 0x7f72b410ed60 2019-11-28T11:25:39.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.631+0000 7f72ba476700 1 -- 172.21.15.80:0/3451900591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b4105ef0 con 0x7f72b410ed60 2019-11-28T11:25:39.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.631+0000 7f72b3fff700 1 --2- 172.21.15.80:0/3451900591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b410ed60 0x7f72b410f1f0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f72a4010460 tx=0x7f72a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.631+0000 7f72b17fa700 1 -- 172.21.15.80:0/3451900591 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f72a4001280 con 0x7f72b410ed60 2019-11-28T11:25:39.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.631+0000 7f72b3fff700 1 --2- 172.21.15.80:0/3451900591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b410ed60 0x7f72b410f1f0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f72a4010460 tx=0x7f72a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.631+0000 7f72b17fa700 1 --2- 172.21.15.80:0/3451900591 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7298018730 0x7f729801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:39.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.631+0000 7f72b17fa700 1 -- 172.21.15.80:0/3451900591 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f72a4031b00 con 0x7f72b410ed60 2019-11-28T11:25:39.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.632+0000 7f72b8a13700 1 --2- 172.21.15.80:0/3451900591 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7298018730 0x7f729801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:39.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.632+0000 7f72b8a13700 1 --2- 172.21.15.80:0/3451900591 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7298018730 0x7f729801abc0 crc :-1 s=READY pgs=99 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:39.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.639+0000 7f72ba476700 1 -- 172.21.15.80:0/3451900591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b4106270 con 0x7f72b410ed60 2019-11-28T11:25:39.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.643+0000 7f72b3fff700 1 --2- 172.21.15.80:0/3451900591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b410ed60 0x7f72b410f1f0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f72a4010460 tx=0x7f72a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.643+0000 7f72b17fa700 1 -- 172.21.15.80:0/3451900591 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f72a4000940 con 0x7f72b410ed60 2019-11-28T11:25:39.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.810+0000 7f72ba476700 1 -- 172.21.15.80:0/3451900591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f72b410fea0 con 0x7f72b410ed60 2019-11-28T11:25:39.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.811+0000 7f72b3fff700 1 --2- 172.21.15.80:0/3451900591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b410ed60 0x7f72b410f1f0 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f72a4010460 tx=0x7f72a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.811+0000 7f72b17fa700 1 -- 172.21.15.80:0/3451900591 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f72a4001280 con 0x7f72b410ed60 2019-11-28T11:25:39.837 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:39.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.813+0000 7f72ba476700 1 -- 172.21.15.80:0/3451900591 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7298018730 msgr2=0x7f729801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.813+0000 7f72ba476700 1 --2- 172.21.15.80:0/3451900591 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7298018730 0x7f729801abc0 crc :-1 s=READY pgs=99 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:39.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.813+0000 7f72ba476700 1 -- 172.21.15.80:0/3451900591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b410ed60 msgr2=0x7f72b410f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.813+0000 7f72ba476700 1 --2- 172.21.15.80:0/3451900591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b410ed60 0x7f72b410f1f0 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f72a4010460 tx=0x7f72a4010290).stop 2019-11-28T11:25:39.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.813+0000 7f72ba476700 1 -- 172.21.15.80:0/3451900591 shutdown_connections 2019-11-28T11:25:39.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.813+0000 7f72ba476700 1 --2- 172.21.15.80:0/3451900591 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7298018730 0x7f729801abc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:39.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.813+0000 7f72ba476700 1 --2- 172.21.15.80:0/3451900591 >> v2:172.21.15.174:3300/0 conn(0x7f72b410f730 0x7f72b4167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:39.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.813+0000 7f72ba476700 1 --2- 172.21.15.80:0/3451900591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b410ed60 0x7f72b410f1f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:39.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.813+0000 7f72ba476700 1 -- 172.21.15.80:0/3451900591 shutdown_connections 2019-11-28T11:25:39.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.813+0000 7f72ba476700 1 -- 172.21.15.80:0/3451900591 wait complete. 2019-11-28T11:25:39.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.813+0000 7f72ba476700 1 -- 172.21.15.80:0/3451900591 >> 172.21.15.80:0/3451900591 conn(0x7f72b415e2d0 msgr2=0x7f72b4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:39.845 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:25:39.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.950+0000 7f81a9bb3700 1 Processor -- start 2019-11-28T11:25:39.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.950+0000 7f81a9bb3700 1 -- start start 2019-11-28T11:25:39.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.951+0000 7f81a9bb3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f81a415ed10 0x7f81a415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:39.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.951+0000 7f81a9bb3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a406db60 con 0x7f81a40734b0 2019-11-28T11:25:39.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.951+0000 7f81a9bb3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a406e060 con 0x7f81a4073020 2019-11-28T11:25:39.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.951+0000 7f81a9bb3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a406fe00 con 0x7f81a415ed10 2019-11-28T11:25:39.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.951+0000 7f81a3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f81a415ed10 0x7f81a415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:39.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.951+0000 7f81a3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f81a415ed10 0x7f81a415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59866/0 (socket says 172.21.15.80:59866) 2019-11-28T11:25:39.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.951+0000 7f81a3fff700 1 -- 172.21.15.80:0/434569902 learned_addr learned my addr 172.21.15.80:0/434569902 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:39.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.952+0000 7f81a3fff700 1 -- 172.21.15.80:0/434569902 >> v1:172.21.15.174:6789/0 conn(0x7f81a4073020 legacy=0x7f81a4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.952+0000 7f81a3fff700 1 -- 172.21.15.80:0/434569902 >> v1:172.21.15.80:6789/0 conn(0x7f81a40734b0 legacy=0x7f81a40726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.952+0000 7f81a3fff700 1 -- 172.21.15.80:0/434569902 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a4070760 con 0x7f81a415ed10 2019-11-28T11:25:39.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.952+0000 7f81a37fe700 1 -- 172.21.15.80:0/434569902 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918751630 0 0) 0x7f819c001480 con 0x7f81a40734b0 2019-11-28T11:25:39.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.952+0000 7f81a3fff700 1 --2- 172.21.15.80:0/434569902 >> v2:172.21.15.80:3300/0 conn(0x7f81a415ed10 0x7f81a415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f819400f740 tx=0x7f819400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.952+0000 7f81a3fff700 1 --2- 172.21.15.80:0/434569902 >> v2:172.21.15.80:3300/0 conn(0x7f81a415ed10 0x7f81a415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f819400f740 tx=0x7f819400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.952+0000 7f81a3fff700 1 --2- 172.21.15.80:0/434569902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81a415ed10 0x7f81a415f100 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7f819400f740 tx=0x7f819400fae0).ready entity=mon.0 client_cookie=4d1c10e0a6c11816 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:39.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.952+0000 7f81a3fff700 1 --2- 172.21.15.80:0/434569902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81a415ed10 0x7f81a415f100 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f819400f740 tx=0x7f819400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.952+0000 7f81a37fe700 1 -- 172.21.15.80:0/434569902 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8194000960 con 0x7f81a415ed10 2019-11-28T11:25:39.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.952+0000 7f81a3fff700 1 --2- 172.21.15.80:0/434569902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81a415ed10 0x7f81a415f100 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f819400f740 tx=0x7f819400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.952+0000 7f81a3fff700 1 --2- 172.21.15.80:0/434569902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81a415ed10 0x7f81a415f100 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f819400f740 tx=0x7f819400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:39.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.952+0000 7f81a37fe700 1 -- 172.21.15.80:0/434569902 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8194000c90 con 0x7f81a415ed10 2019-11-28T11:25:39.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.952+0000 7f81a37fe700 1 -- 172.21.15.80:0/434569902 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8194000960 con 0x7f81a415ed10 2019-11-28T11:25:39.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.952+0000 7f81a9bb3700 1 -- 172.21.15.80:0/434569902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81a415ed10 msgr2=0x7f81a415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.952+0000 7f81a9bb3700 1 --2- 172.21.15.80:0/434569902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81a415ed10 0x7f81a415f100 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7f819400f740 tx=0x7f819400fae0).stop 2019-11-28T11:25:39.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.953+0000 7f81a9bb3700 1 -- 172.21.15.80:0/434569902 shutdown_connections 2019-11-28T11:25:39.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.953+0000 7f81a9bb3700 1 --2- 172.21.15.80:0/434569902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81a415ed10 0x7f81a415f100 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:39.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.953+0000 7f81a9bb3700 1 -- 172.21.15.80:0/434569902 shutdown_connections 2019-11-28T11:25:39.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.953+0000 7f81a9bb3700 1 -- 172.21.15.80:0/434569902 wait complete. 2019-11-28T11:25:39.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.953+0000 7f81a9bb3700 1 -- 172.21.15.80:0/434569902 >> 172.21.15.80:0/434569902 conn(0x7f81a4061d20 msgr2=0x7f81a40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:39.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.955+0000 7f81a9bb3700 1 Processor -- start 2019-11-28T11:25:39.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.955+0000 7f81a9bb3700 1 -- start start 2019-11-28T11:25:39.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.956+0000 7f81a9bb3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f81a412ead0 0x7f81a407c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:39.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.956+0000 7f81a9bb3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a4165990 con 0x7f81a4101e80 2019-11-28T11:25:39.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.956+0000 7f81a9bb3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a4106bb0 con 0x7f81a4128430 2019-11-28T11:25:39.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.956+0000 7f81a9bb3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a40793b0 con 0x7f81a412ead0 2019-11-28T11:25:39.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.956+0000 7f819bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f81a4101e80 0x7f81a407b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59190/0 (socket says 172.21.15.80:59190) 2019-11-28T11:25:39.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.956+0000 7f819bfff700 1 -- 172.21.15.80:0/2049587788 learned_addr learned my addr 172.21.15.80:0/2049587788 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:39.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.956+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2068607912 0 0) 0x7f818c001150 con 0x7f81a4101e80 2019-11-28T11:25:39.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.956+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f817c002e80 con 0x7f81a4101e80 2019-11-28T11:25:39.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.956+0000 7f81a8951700 1 --2- 172.21.15.80:0/2049587788 >> v2:172.21.15.174:3300/0 conn(0x7f81a412ead0 0x7f81a407c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:39.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 538486260 0 0) 0x7f818c0012c0 con 0x7f81a4101e80 2019-11-28T11:25:39.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f817c0032e0 con 0x7f81a4101e80 2019-11-28T11:25:39.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f818c001870 con 0x7f81a4101e80 2019-11-28T11:25:39.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 >> v2:172.21.15.174:3300/0 conn(0x7f81a412ead0 msgr2=0x7f81a407c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a17fa700 1 --2- 172.21.15.80:0/2049587788 >> v2:172.21.15.174:3300/0 conn(0x7f81a412ead0 0x7f81a407c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:39.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 >> v1:172.21.15.174:6789/0 conn(0x7f81a4128430 legacy=0x7f81a4165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 >> v1:172.21.15.80:6789/0 conn(0x7f81a4101e80 legacy=0x7f81a407b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a17fa700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f817c003330 0x7f817c003740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:39.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a17fa700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f817c003c80 0x7f817c004120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:39.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a17fa700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f817c004930 0x7f817c004df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:39.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c00bbf0 con 0x7f817c004930 2019-11-28T11:25:39.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0101f0 con 0x7f817c003330 2019-11-28T11:25:39.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0103e0 con 0x7f817c003c80 2019-11-28T11:25:39.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a8951700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f817c004930 0x7f817c004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:39.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f819bfff700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f817c003c80 0x7f817c004120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:39.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a3fff700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f817c003330 0x7f817c003740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:39.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a8951700 1 -- 172.21.15.80:0/2049587788 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f817c003c80 msgr2=0x7f817c004120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:39.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a8951700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f817c003c80 0x7f817c004120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a8951700 1 -- 172.21.15.80:0/2049587788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f817c003330 msgr2=0x7f817c003740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:40.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a8951700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f817c003330 0x7f817c003740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a8951700 1 -- 172.21.15.80:0/2049587788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c010690 con 0x7f817c004930 2019-11-28T11:25:40.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a9bb3700 1 -- 172.21.15.80:0/2049587788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a407a090 con 0x7f817c004930 2019-11-28T11:25:40.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a8951700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f817c004930 0x7f817c004df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f819c0109d0 tx=0x7f819c010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a9bb3700 1 -- 172.21.15.80:0/2049587788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a4079d10 con 0x7f817c004930 2019-11-28T11:25:40.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a8951700 1 -- 172.21.15.80:0/2049587788 reap_dead start 2019-11-28T11:25:40.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a8951700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f817c004930 0x7f817c004df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f819c0109d0 tx=0x7f819c010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a8951700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f817c004930 0x7f817c004df0 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f819c0109d0 tx=0x7f819c010850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:40.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a8951700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f817c004930 0x7f817c004df0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f819c0109d0 tx=0x7f819c010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f819c006530 con 0x7f817c004930 2019-11-28T11:25:40.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a8951700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f817c004930 0x7f817c004df0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f819c0109d0 tx=0x7f819c010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c0056f0 con 0x7f817c004930 2019-11-28T11:25:40.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a8951700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f817c004930 0x7f817c004df0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f819c0109d0 tx=0x7f819c010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.957+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f819c0058e0 con 0x7f817c004930 2019-11-28T11:25:40.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.958+0000 7f81a8951700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f817c004930 0x7f817c004df0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f819c0109d0 tx=0x7f819c010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.958+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f819c0058e0 con 0x7f817c004930 2019-11-28T11:25:40.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.958+0000 7f81a8951700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f817c004930 0x7f817c004df0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f819c0109d0 tx=0x7f819c010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.958+0000 7f81a17fa700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f817c01f8a0 0x7f817c021cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:40.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.958+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f819c031f20 con 0x7f817c004930 2019-11-28T11:25:40.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.958+0000 7f81a3fff700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f817c01f8a0 0x7f817c021cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:40.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.958+0000 7f81a3fff700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f817c01f8a0 0x7f817c021cf0 crc :-1 s=READY pgs=100 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:40.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.965+0000 7f81a9bb3700 1 -- 172.21.15.80:0/2049587788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8180002e60 con 0x7f817c004930 2019-11-28T11:25:40.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.969+0000 7f81a8951700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f817c004930 0x7f817c004df0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f819c0109d0 tx=0x7f819c010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:39.969+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f819c00aa50 con 0x7f817c004930 2019-11-28T11:25:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.135+0000 7f81a9bb3700 1 -- 172.21.15.80:0/2049587788 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f8180001d30 con 0x7f817c004930 2019-11-28T11:25:40.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.136+0000 7f81a8951700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f817c004930 0x7f817c004df0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f819c0109d0 tx=0x7f819c010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.136+0000 7f81a17fa700 1 -- 172.21.15.80:0/2049587788 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f819c0056f0 con 0x7f817c004930 2019-11-28T11:25:40.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.138+0000 7f81a9bb3700 1 -- 172.21.15.80:0/2049587788 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f817c01f8a0 msgr2=0x7f817c021cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:40.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.138+0000 7f81a9bb3700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f817c01f8a0 0x7f817c021cf0 crc :-1 s=READY pgs=100 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.138+0000 7f81a9bb3700 1 -- 172.21.15.80:0/2049587788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f817c004930 msgr2=0x7f817c004df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.138+0000 7f81a9bb3700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f817c004930 0x7f817c004df0 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f819c0109d0 tx=0x7f819c010850).stop 2019-11-28T11:25:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.138+0000 7f81a9bb3700 1 -- 172.21.15.80:0/2049587788 shutdown_connections 2019-11-28T11:25:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.138+0000 7f81a9bb3700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f817c01f8a0 0x7f817c021cf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.138+0000 7f81a9bb3700 1 --2- 172.21.15.80:0/2049587788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f817c004930 0x7f817c004df0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.138+0000 7f81a9bb3700 1 -- 172.21.15.80:0/2049587788 shutdown_connections 2019-11-28T11:25:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.138+0000 7f81a9bb3700 1 -- 172.21.15.80:0/2049587788 wait complete. 2019-11-28T11:25:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.138+0000 7f81a9bb3700 1 -- 172.21.15.80:0/2049587788 >> 172.21.15.80:0/2049587788 conn(0x7f81a4166440 msgr2=0x7f81a41494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:40.167 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:40.168 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:25:40.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.300+0000 7f57c616e700 1 Processor -- start 2019-11-28T11:25:40.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.300+0000 7f57c616e700 1 -- start start 2019-11-28T11:25:40.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.301+0000 7f57c616e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f57c015f100 0x7f57c006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:40.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.301+0000 7f57c616e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f57c006c2f0 0x7f57c006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:40.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.301+0000 7f57c616e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c006db60 con 0x7f57c015ed10 2019-11-28T11:25:40.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.301+0000 7f57c616e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c006fe00 con 0x7f57c006c2f0 2019-11-28T11:25:40.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.301+0000 7f57c616e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c00700d0 con 0x7f57c015f100 2019-11-28T11:25:40.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.301+0000 7f57c4f0c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f57c006c2f0 0x7f57c006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:40.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.301+0000 7f57c4f0c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f57c006c2f0 0x7f57c006c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59890/0 (socket says 172.21.15.80:59890) 2019-11-28T11:25:40.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.301+0000 7f57c4f0c700 1 -- 172.21.15.80:0/1933430003 learned_addr learned my addr 172.21.15.80:0/1933430003 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.302+0000 7f57b7fff700 1 --2- 172.21.15.80:0/1933430003 >> v2:172.21.15.174:3300/0 conn(0x7f57c015f100 0x7f57c006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.302+0000 7f57c4f0c700 1 -- 172.21.15.80:0/1933430003 >> v2:172.21.15.174:3300/0 conn(0x7f57c015f100 msgr2=0x7f57c006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.302+0000 7f57c4f0c700 1 --2- 172.21.15.80:0/1933430003 >> v2:172.21.15.174:3300/0 conn(0x7f57c015f100 0x7f57c006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.302+0000 7f57c4f0c700 1 -- 172.21.15.80:0/1933430003 >> v1:172.21.15.174:6789/0 conn(0x7f57c015ed10 legacy=0x7f57c0073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.302+0000 7f57c4f0c700 1 -- 172.21.15.80:0/1933430003 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c0070760 con 0x7f57c006c2f0 2019-11-28T11:25:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.302+0000 7f57c4f0c700 1 --2- 172.21.15.80:0/1933430003 >> v2:172.21.15.80:3300/0 conn(0x7f57c006c2f0 0x7f57c006c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f57b800fab0 tx=0x7f57b80080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.302+0000 7f57c4f0c700 1 --2- 172.21.15.80:0/1933430003 >> v2:172.21.15.80:3300/0 conn(0x7f57c006c2f0 0x7f57c006c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f57b800fab0 tx=0x7f57b80080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.302+0000 7f57c4f0c700 1 --2- 172.21.15.80:0/1933430003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c006c2f0 0x7f57c006c770 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f57b800fab0 tx=0x7f57b80080d0).ready entity=mon.0 client_cookie=72f53d7a395b3313 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.302+0000 7f57c4f0c700 1 --2- 172.21.15.80:0/1933430003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c006c2f0 0x7f57c006c770 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f57b800fab0 tx=0x7f57b80080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.302+0000 7f57c4f0c700 1 --2- 172.21.15.80:0/1933430003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c006c2f0 0x7f57c006c770 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f57b800fab0 tx=0x7f57b80080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.302+0000 7f57bf7fe700 1 -- 172.21.15.80:0/1933430003 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57b8000df0 con 0x7f57c006c2f0 2019-11-28T11:25:40.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.302+0000 7f57c4f0c700 1 --2- 172.21.15.80:0/1933430003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c006c2f0 0x7f57c006c770 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f57b800fab0 tx=0x7f57b80080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.302+0000 7f57bf7fe700 1 -- 172.21.15.80:0/1933430003 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b8001460 con 0x7f57c006c2f0 2019-11-28T11:25:40.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.302+0000 7f57bf7fe700 1 -- 172.21.15.80:0/1933430003 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57b8001b30 con 0x7f57c006c2f0 2019-11-28T11:25:40.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.302+0000 7f57c616e700 1 -- 172.21.15.80:0/1933430003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c006c2f0 msgr2=0x7f57c006c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:40.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.302+0000 7f57c616e700 1 --2- 172.21.15.80:0/1933430003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c006c2f0 0x7f57c006c770 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f57b800fab0 tx=0x7f57b80080d0).stop 2019-11-28T11:25:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.303+0000 7f57c616e700 1 -- 172.21.15.80:0/1933430003 shutdown_connections 2019-11-28T11:25:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.303+0000 7f57c616e700 1 --2- 172.21.15.80:0/1933430003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c006c2f0 0x7f57c006c770 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.303+0000 7f57c616e700 1 --2- 172.21.15.80:0/1933430003 >> v2:172.21.15.174:3300/0 conn(0x7f57c015f100 0x7f57c006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.303+0000 7f57c616e700 1 -- 172.21.15.80:0/1933430003 shutdown_connections 2019-11-28T11:25:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.303+0000 7f57c616e700 1 -- 172.21.15.80:0/1933430003 wait complete. 2019-11-28T11:25:40.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.303+0000 7f57c616e700 1 -- 172.21.15.80:0/1933430003 >> 172.21.15.80:0/1933430003 conn(0x7f57c0061d20 msgr2=0x7f57c00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:40.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.305+0000 7f57c616e700 1 Processor -- start 2019-11-28T11:25:40.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.305+0000 7f57c616e700 1 -- start start 2019-11-28T11:25:40.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.306+0000 7f57c616e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57c010e970 0x7f57c01087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:40.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.306+0000 7f57c616e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f57c0108cf0 0x7f57c0107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:40.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.306+0000 7f57c616e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c010c250 con 0x7f57c0107b70 2019-11-28T11:25:40.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.306+0000 7f57c616e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c010da00 con 0x7f57c0108cf0 2019-11-28T11:25:40.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.306+0000 7f57c616e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c010e430 con 0x7f57c010e970 2019-11-28T11:25:40.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.306+0000 7f57b7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f57c0108cf0 0x7f57c0107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:40.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.306+0000 7f57b7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f57c0108cf0 0x7f57c0107630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59894/0 (socket says 172.21.15.80:59894) 2019-11-28T11:25:40.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.306+0000 7f57b7fff700 1 -- 172.21.15.80:0/1771088031 learned_addr learned my addr 172.21.15.80:0/1771088031 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:40.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.306+0000 7f57bffff700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57c010e970 0x7f57c01087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:40.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.306+0000 7f57b7fff700 1 -- 172.21.15.80:0/1771088031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57c010e970 msgr2=0x7f57c01087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:40.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.306+0000 7f57b7fff700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57c010e970 0x7f57c01087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.307+0000 7f57b7fff700 1 -- 172.21.15.80:0/1771088031 >> v1:172.21.15.80:6789/0 conn(0x7f57c0107b70 legacy=0x7f57c010ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:40.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.307+0000 7f57b7fff700 1 -- 172.21.15.80:0/1771088031 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c0105ef0 con 0x7f57c0108cf0 2019-11-28T11:25:40.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.307+0000 7f57b7fff700 1 --2- 172.21.15.80:0/1771088031 >> v2:172.21.15.80:3300/0 conn(0x7f57c0108cf0 0x7f57c0107630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57a8010400 tx=0x7f57a80107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.307+0000 7f57bffff700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57c010e970 0x7f57c01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:25:40.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.307+0000 7f57b7fff700 1 --2- 172.21.15.80:0/1771088031 >> v2:172.21.15.80:3300/0 conn(0x7f57c0108cf0 0x7f57c0107630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57a8010400 tx=0x7f57a80107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.307+0000 7f57b7fff700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c0108cf0 0x7f57c0107630 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7f57a8010400 tx=0x7f57a80107a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:40.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.307+0000 7f57b7fff700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c0108cf0 0x7f57c0107630 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f57a8010400 tx=0x7f57a80107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.307+0000 7f57b7fff700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c0108cf0 0x7f57c0107630 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f57a8010400 tx=0x7f57a80107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.307+0000 7f57bd7fa700 1 -- 172.21.15.80:0/1771088031 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57a8000940 con 0x7f57c0108cf0 2019-11-28T11:25:40.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.307+0000 7f57b7fff700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c0108cf0 0x7f57c0107630 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f57a8010400 tx=0x7f57a80107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.307+0000 7f57bd7fa700 1 -- 172.21.15.80:0/1771088031 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a8000c90 con 0x7f57c0108cf0 2019-11-28T11:25:40.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.307+0000 7f57c616e700 1 -- 172.21.15.80:0/1771088031 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c0106270 con 0x7f57c0108cf0 2019-11-28T11:25:40.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.307+0000 7f57bd7fa700 1 -- 172.21.15.80:0/1771088031 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57a80012e0 con 0x7f57c0108cf0 2019-11-28T11:25:40.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.307+0000 7f57c616e700 1 -- 172.21.15.80:0/1771088031 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c0105ef0 con 0x7f57c0108cf0 2019-11-28T11:25:40.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.308+0000 7f57b7fff700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c0108cf0 0x7f57c0107630 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f57a8010400 tx=0x7f57a80107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.308+0000 7f57bd7fa700 1 -- 172.21.15.80:0/1771088031 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f57a8000c90 con 0x7f57c0108cf0 2019-11-28T11:25:40.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.308+0000 7f57b7fff700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c0108cf0 0x7f57c0107630 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f57a8010400 tx=0x7f57a80107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.308+0000 7f57bd7fa700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f57a4018730 0x7f57a401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:40.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.308+0000 7f57bd7fa700 1 -- 172.21.15.80:0/1771088031 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f57a8031a60 con 0x7f57c0108cf0 2019-11-28T11:25:40.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.308+0000 7f57bffff700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f57a4018730 0x7f57a401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:40.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.308+0000 7f57bffff700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f57a4018730 0x7f57a401abc0 crc :-1 s=READY pgs=101 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:40.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.315+0000 7f57c616e700 1 -- 172.21.15.80:0/1771088031 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c0106270 con 0x7f57c0108cf0 2019-11-28T11:25:40.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.319+0000 7f57b7fff700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c0108cf0 0x7f57c0107630 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f57a8010400 tx=0x7f57a80107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.319+0000 7f57bd7fa700 1 -- 172.21.15.80:0/1771088031 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f57a80071f0 con 0x7f57c0108cf0 2019-11-28T11:25:40.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.485+0000 7f57c616e700 1 -- 172.21.15.80:0/1771088031 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f57c0105ef0 con 0x7f57c0108cf0 2019-11-28T11:25:40.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.485+0000 7f57b7fff700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c0108cf0 0x7f57c0107630 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f57a8010400 tx=0x7f57a80107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.485+0000 7f57bd7fa700 1 -- 172.21.15.80:0/1771088031 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f57a8000c90 con 0x7f57c0108cf0 2019-11-28T11:25:40.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.487+0000 7f57c616e700 1 -- 172.21.15.80:0/1771088031 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f57a4018730 msgr2=0x7f57a401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:40.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.487+0000 7f57c616e700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f57a4018730 0x7f57a401abc0 crc :-1 s=READY pgs=101 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.487+0000 7f57c616e700 1 -- 172.21.15.80:0/1771088031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c0108cf0 msgr2=0x7f57c0107630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:40.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.487+0000 7f57c616e700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c0108cf0 0x7f57c0107630 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7f57a8010400 tx=0x7f57a80107a0).stop 2019-11-28T11:25:40.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.488+0000 7f57c616e700 1 -- 172.21.15.80:0/1771088031 shutdown_connections 2019-11-28T11:25:40.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.488+0000 7f57c616e700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f57a4018730 0x7f57a401abc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.511 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:40.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.488+0000 7f57c616e700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57c0108cf0 0x7f57c0107630 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.488+0000 7f57c616e700 1 --2- 172.21.15.80:0/1771088031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57c010e970 0x7f57c01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.488+0000 7f57c616e700 1 -- 172.21.15.80:0/1771088031 shutdown_connections 2019-11-28T11:25:40.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.488+0000 7f57c616e700 1 -- 172.21.15.80:0/1771088031 wait complete. 2019-11-28T11:25:40.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.488+0000 7f57c616e700 1 -- 172.21.15.80:0/1771088031 >> 172.21.15.80:0/1771088031 conn(0x7f57c015e2d0 msgr2=0x7f57c0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:40.530 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:25:40.531 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:25:40.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.649+0000 7f46f3dba700 1 Processor -- start 2019-11-28T11:25:40.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.649+0000 7f46f3dba700 1 -- start start 2019-11-28T11:25:40.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.650+0000 7f46f3dba700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f46ec06d120 0x7f46ec165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:40.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.650+0000 7f46f3dba700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ec06d5a0 con 0x7f46ec06c490 2019-11-28T11:25:40.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.650+0000 7f46f3dba700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ec06db00 con 0x7f46ec06c0a0 2019-11-28T11:25:40.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.650+0000 7f46f3dba700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec06fd60 con 0x7f46ec06d120 2019-11-28T11:25:40.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.650+0000 7f46f1b56700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f46ec06c490 0x7f46ec06c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59220/0 (socket says 172.21.15.80:59220) 2019-11-28T11:25:40.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.650+0000 7f46f1b56700 1 -- 172.21.15.80:0/274255140 learned_addr learned my addr 172.21.15.80:0/274255140 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:40.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f2b58700 1 --2- 172.21.15.80:0/274255140 >> v2:172.21.15.174:3300/0 conn(0x7f46ec06d120 0x7f46ec165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:40.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f1355700 1 -- 172.21.15.80:0/274255140 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108758837 0 0) 0x7f46dc001150 con 0x7f46ec06c490 2019-11-28T11:25:40.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f1355700 1 -- 172.21.15.80:0/274255140 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46d8002e80 con 0x7f46ec06c490 2019-11-28T11:25:40.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f1355700 1 -- 172.21.15.80:0/274255140 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1339803319 0 0) 0x7f46dc001130 con 0x7f46ec06c490 2019-11-28T11:25:40.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f1355700 1 -- 172.21.15.80:0/274255140 >> v2:172.21.15.174:3300/0 conn(0x7f46ec06d120 msgr2=0x7f46ec165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:40.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f1355700 1 --2- 172.21.15.80:0/274255140 >> v2:172.21.15.174:3300/0 conn(0x7f46ec06d120 0x7f46ec165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:40.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f1355700 1 -- 172.21.15.80:0/274255140 >> v1:172.21.15.174:6789/0 conn(0x7f46ec06c0a0 legacy=0x7f46ec072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:40.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f1355700 1 -- 172.21.15.80:0/274255140 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec0706c0 con 0x7f46ec06c490 2019-11-28T11:25:40.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f1355700 1 -- 172.21.15.80:0/274255140 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f46dc001660 con 0x7f46ec06c490 2019-11-28T11:25:40.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f1355700 1 -- 172.21.15.80:0/274255140 >> v1:172.21.15.80:6789/0 conn(0x7f46ec06c490 legacy=0x7f46ec06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:40.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f1355700 1 --2- 172.21.15.80:0/274255140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46d8003a80 0x7f46d8005ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:40.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f1355700 1 --2- 172.21.15.80:0/274255140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46d8006670 0x7f46d8008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:40.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f1355700 1 --2- 172.21.15.80:0/274255140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46d80093a0 0x7f46d800b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:40.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f1355700 1 -- 172.21.15.80:0/274255140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d800c020 con 0x7f46d8003a80 2019-11-28T11:25:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f1355700 1 -- 172.21.15.80:0/274255140 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d8050220 con 0x7f46d8006670 2019-11-28T11:25:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f1355700 1 -- 172.21.15.80:0/274255140 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d8050450 con 0x7f46d80093a0 2019-11-28T11:25:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f2357700 1 --2- 172.21.15.80:0/274255140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46d8003a80 0x7f46d8005ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f1b56700 1 --2- 172.21.15.80:0/274255140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46d8006670 0x7f46d8008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f2b58700 1 --2- 172.21.15.80:0/274255140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46d80093a0 0x7f46d800b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f2357700 1 -- 172.21.15.80:0/274255140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46d80093a0 msgr2=0x7f46d800b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:40.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f2357700 1 --2- 172.21.15.80:0/274255140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46d80093a0 0x7f46d800b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f2357700 1 -- 172.21.15.80:0/274255140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46d8006670 msgr2=0x7f46d8008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f2357700 1 --2- 172.21.15.80:0/274255140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46d8006670 0x7f46d8008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:40.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f2b58700 1 -- 172.21.15.80:0/274255140 reap_dead start 2019-11-28T11:25:40.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.651+0000 7f46f2357700 1 -- 172.21.15.80:0/274255140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d8050700 con 0x7f46d8003a80 2019-11-28T11:25:40.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.652+0000 7f46f2357700 1 --2- 172.21.15.80:0/274255140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46d8003a80 0x7f46d8005ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f46d400b2f0 tx=0x7f46d400b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.652+0000 7f46f2357700 1 --2- 172.21.15.80:0/274255140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46d8003a80 0x7f46d8005ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f46d400b2f0 tx=0x7f46d400b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.652+0000 7f46f2357700 1 --2- 172.21.15.80:0/274255140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46d8003a80 0x7f46d8005ec0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f46d400b2f0 tx=0x7f46d400b5f0).ready entity=mon.0 client_cookie=90b5734b2e7514a8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:40.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.652+0000 7f46f2357700 1 --2- 172.21.15.80:0/274255140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46d8003a80 0x7f46d8005ec0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f46d400b2f0 tx=0x7f46d400b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.652+0000 7f46f2357700 1 --2- 172.21.15.80:0/274255140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46d8003a80 0x7f46d8005ec0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f46d400b2f0 tx=0x7f46d400b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.652+0000 7f46f1355700 1 -- 172.21.15.80:0/274255140 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46d4009e40 con 0x7f46d8003a80 2019-11-28T11:25:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.652+0000 7f46f2357700 1 --2- 172.21.15.80:0/274255140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46d8003a80 0x7f46d8005ec0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f46d400b2f0 tx=0x7f46d400b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.652+0000 7f46f1355700 1 -- 172.21.15.80:0/274255140 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d40099c0 con 0x7f46d8003a80 2019-11-28T11:25:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.652+0000 7f46f1355700 1 -- 172.21.15.80:0/274255140 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46d400a420 con 0x7f46d8003a80 2019-11-28T11:25:40.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.652+0000 7f46f3dba700 1 -- 172.21.15.80:0/274255140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46d8003a80 msgr2=0x7f46d8005ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:40.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.652+0000 7f46f3dba700 1 --2- 172.21.15.80:0/274255140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46d8003a80 0x7f46d8005ec0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f46d400b2f0 tx=0x7f46d400b5f0).stop 2019-11-28T11:25:40.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.652+0000 7f46f3dba700 1 -- 172.21.15.80:0/274255140 shutdown_connections 2019-11-28T11:25:40.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.652+0000 7f46f3dba700 1 --2- 172.21.15.80:0/274255140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46d8003a80 0x7f46d8005ec0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.653+0000 7f46f3dba700 1 -- 172.21.15.80:0/274255140 shutdown_connections 2019-11-28T11:25:40.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.653+0000 7f46f3dba700 1 -- 172.21.15.80:0/274255140 wait complete. 2019-11-28T11:25:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.653+0000 7f46f3dba700 1 -- 172.21.15.80:0/274255140 >> 172.21.15.80:0/274255140 conn(0x7f46ec061cf0 msgr2=0x7f46ec064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.655+0000 7f46f3dba700 1 Processor -- start 2019-11-28T11:25:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.655+0000 7f46f3dba700 1 -- start start 2019-11-28T11:25:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f3dba700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f46ec074d00 0x7f46ec0750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f3dba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f46ec153040 0x7f46ec140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f3dba700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ec079230 con 0x7f46ec152bd0 2019-11-28T11:25:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f3dba700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec07ab30 con 0x7f46ec153040 2019-11-28T11:25:40.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f3dba700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec07ae00 con 0x7f46ec074d00 2019-11-28T11:25:40.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f2b58700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f46ec153040 0x7f46ec140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:40.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f2b58700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f46ec153040 0x7f46ec140c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59912/0 (socket says 172.21.15.80:59912) 2019-11-28T11:25:40.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f2b58700 1 -- 172.21.15.80:0/1385808433 learned_addr learned my addr 172.21.15.80:0/1385808433 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:40.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f2357700 1 --2- 172.21.15.80:0/1385808433 >> v2:172.21.15.174:3300/0 conn(0x7f46ec074d00 0x7f46ec0750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:40.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f2b58700 1 -- 172.21.15.80:0/1385808433 >> v2:172.21.15.174:3300/0 conn(0x7f46ec074d00 msgr2=0x7f46ec0750f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:40.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f2b58700 1 --2- 172.21.15.80:0/1385808433 >> v2:172.21.15.174:3300/0 conn(0x7f46ec074d00 0x7f46ec0750f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f2b58700 1 -- 172.21.15.80:0/1385808433 >> v1:172.21.15.80:6789/0 conn(0x7f46ec152bd0 legacy=0x7f46ec140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:40.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f2b58700 1 -- 172.21.15.80:0/1385808433 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec07b490 con 0x7f46ec153040 2019-11-28T11:25:40.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46eaffd700 1 -- 172.21.15.80:0/1385808433 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121074661 0 0) 0x7f46dc000f40 con 0x7f46ec152bd0 2019-11-28T11:25:40.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f2b58700 1 --2- 172.21.15.80:0/1385808433 >> v2:172.21.15.80:3300/0 conn(0x7f46ec153040 0x7f46ec140c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46e4010470 tx=0x7f46e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f2b58700 1 --2- 172.21.15.80:0/1385808433 >> v2:172.21.15.80:3300/0 conn(0x7f46ec153040 0x7f46ec140c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46e4010470 tx=0x7f46e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f2b58700 1 --2- 172.21.15.80:0/1385808433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46ec153040 0x7f46ec140c40 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f46e4010470 tx=0x7f46e4010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:40.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f2b58700 1 --2- 172.21.15.80:0/1385808433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46ec153040 0x7f46ec140c40 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f46e4010470 tx=0x7f46e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46eaffd700 1 -- 172.21.15.80:0/1385808433 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46e4000ab0 con 0x7f46ec153040 2019-11-28T11:25:40.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f2b58700 1 --2- 172.21.15.80:0/1385808433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46ec153040 0x7f46ec140c40 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f46e4010470 tx=0x7f46e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f2b58700 1 --2- 172.21.15.80:0/1385808433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46ec153040 0x7f46ec140c40 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f46e4010470 tx=0x7f46e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46eaffd700 1 -- 172.21.15.80:0/1385808433 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e40053e0 con 0x7f46ec153040 2019-11-28T11:25:40.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46eaffd700 1 -- 172.21.15.80:0/1385808433 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46e4005ab0 con 0x7f46ec153040 2019-11-28T11:25:40.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.656+0000 7f46f3dba700 1 -- 172.21.15.80:0/1385808433 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ec07b810 con 0x7f46ec153040 2019-11-28T11:25:40.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.657+0000 7f46f3dba700 1 -- 172.21.15.80:0/1385808433 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ec07b490 con 0x7f46ec153040 2019-11-28T11:25:40.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.657+0000 7f46f2b58700 1 --2- 172.21.15.80:0/1385808433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46ec153040 0x7f46ec140c40 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f46e4010470 tx=0x7f46e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.657+0000 7f46eaffd700 1 -- 172.21.15.80:0/1385808433 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f46e4000ab0 con 0x7f46ec153040 2019-11-28T11:25:40.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.657+0000 7f46f2b58700 1 --2- 172.21.15.80:0/1385808433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46ec153040 0x7f46ec140c40 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f46e4010470 tx=0x7f46e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.657+0000 7f46eaffd700 1 --2- 172.21.15.80:0/1385808433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f46d0018730 0x7f46d001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:40.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.657+0000 7f46eaffd700 1 -- 172.21.15.80:0/1385808433 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f46e4031b50 con 0x7f46ec153040 2019-11-28T11:25:40.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.658+0000 7f46f2357700 1 --2- 172.21.15.80:0/1385808433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f46d0018730 0x7f46d001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:40.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.658+0000 7f46f2357700 1 --2- 172.21.15.80:0/1385808433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f46d0018730 0x7f46d001abc0 crc :-1 s=READY pgs=102 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:40.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.665+0000 7f46f3dba700 1 -- 172.21.15.80:0/1385808433 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ec07b810 con 0x7f46ec153040 2019-11-28T11:25:40.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.668+0000 7f46f2b58700 1 --2- 172.21.15.80:0/1385808433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46ec153040 0x7f46ec140c40 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f46e4010470 tx=0x7f46e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.668+0000 7f46eaffd700 1 -- 172.21.15.80:0/1385808433 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f46e40172d0 con 0x7f46ec153040 2019-11-28T11:25:40.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.839+0000 7f46f3dba700 1 -- 172.21.15.80:0/1385808433 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46ec07b490 con 0x7f46ec153040 2019-11-28T11:25:40.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.839+0000 7f46f2b58700 1 --2- 172.21.15.80:0/1385808433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46ec153040 0x7f46ec140c40 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f46e4010470 tx=0x7f46e4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:40.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.839+0000 7f46eaffd700 1 -- 172.21.15.80:0/1385808433 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2441 (secure 0 0 0) 0x7f46e4000a70 con 0x7f46ec153040 2019-11-28T11:25:40.859 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 6 2019-11-28T11:25:40.859 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:40.860 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/3100151299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3100151299},{"type":"v1","addr":"172.21.15.80:6833","nonce":3100151299}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4},{"gid":4359,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/4212336515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":4212336515},{"type":"v1","addr":"172.21.15.80:6835","nonce":4212336515}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:25:19.931718+0000","modified":"2019-11-28T11:25:28.542379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4229":{"gid":4229,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2081356472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2081356472},{"type":"v1","addr":"172.21.15.174:6835","nonce":2081356472}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-11-28T11:25:40.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.842+0000 7f46f3dba700 1 -- 172.21.15.80:0/1385808433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f46d0018730 msgr2=0x7f46d001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:40.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.842+0000 7f46f3dba700 1 --2- 172.21.15.80:0/1385808433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f46d0018730 0x7f46d001abc0 crc :-1 s=READY pgs=102 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.842+0000 7f46f3dba700 1 -- 172.21.15.80:0/1385808433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46ec153040 msgr2=0x7f46ec140c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:40.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.842+0000 7f46f3dba700 1 --2- 172.21.15.80:0/1385808433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46ec153040 0x7f46ec140c40 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f46e4010470 tx=0x7f46e4010270).stop 2019-11-28T11:25:40.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.842+0000 7f46f3dba700 1 -- 172.21.15.80:0/1385808433 shutdown_connections 2019-11-28T11:25:40.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.842+0000 7f46f3dba700 1 --2- 172.21.15.80:0/1385808433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f46d0018730 0x7f46d001abc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.842+0000 7f46f3dba700 1 --2- 172.21.15.80:0/1385808433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46ec153040 0x7f46ec140c40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.842+0000 7f46f3dba700 1 --2- 172.21.15.80:0/1385808433 >> v2:172.21.15.174:3300/0 conn(0x7f46ec074d00 0x7f46ec0750f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:40.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.842+0000 7f46f3dba700 1 -- 172.21.15.80:0/1385808433 shutdown_connections 2019-11-28T11:25:40.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.842+0000 7f46f3dba700 1 -- 172.21.15.80:0/1385808433 wait complete. 2019-11-28T11:25:40.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:40.842+0000 7f46f3dba700 1 -- 172.21.15.80:0/1385808433 >> 172.21.15.80:0/1385808433 conn(0x7f46ec13fa50 msgr2=0x7f46ec07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:41.182 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4229}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4229': {u'export_targets': [], u'name': u'c', u'incarnation': 5, u'state_seq': 3, u'state': u'up:active', u'gid': 4229, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2081356472, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2081356472, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2081356472'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:25:19.931718+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:25:28.542379+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:25:41.182 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:25:41.184 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:25:41.322 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:25:41.322 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:25:41.322 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:25:41.322 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 4229, 2019-11-28T11:25:41.323 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:25:41.323 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:25:41.323 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 13.758758339, 2019-11-28T11:25:41.323 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 6, 2019-11-28T11:25:41.323 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 25, 2019-11-28T11:25:41.323 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 25, 2019-11-28T11:25:41.323 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 18.580588931000001 2019-11-28T11:25:41.324 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:25:41.332 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 4229, "want_state": "up:active", "state": "up:active", "rank_uptime": 13.758758339, "mdsmap_epoch": 6, "osdmap_epoch": 25, "osdmap_epoch_barrier": 25, "uptime": 18.580588931000001 } 2019-11-28T11:25:41.333 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:25:41.333 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.2 at ubuntu@smithi075.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2... 2019-11-28T11:25:41.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:25:41.334 INFO:teuthology.orchestra.run.smithi075:> mkdir -- /home/ubuntu/cephtest/mnt.2 2019-11-28T11:25:41.411 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:25:41.411 INFO:teuthology.orchestra.run.smithi075:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o name=2,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:25:41.535 INFO:teuthology.orchestra.run.smithi075.stdout:parsing options: rw,name=2,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:25:41.535 INFO:teuthology.orchestra.run.smithi075.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:25:41.569 INFO:teuthology.orchestra.run.smithi075.stdout:parsing options: rw,name=2,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:25:41.569 INFO:teuthology.orchestra.run.smithi075.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:25:41.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:25:41.586 INFO:teuthology.orchestra.run.smithi075:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2019-11-28T11:25:41.657 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:41.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.759+0000 7f6339505700 1 Processor -- start 2019-11-28T11:25:41.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.759+0000 7f6339505700 1 -- start start 2019-11-28T11:25:41.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.760+0000 7f6339505700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f633406c0a0 0x7f6334072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:41.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.760+0000 7f6339505700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f63340734e0 0x7f6334071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:41.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.760+0000 7f6339505700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633406db00 con 0x7f6334072360 2019-11-28T11:25:41.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.760+0000 7f6339505700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633406fd60 con 0x7f633406c0a0 2019-11-28T11:25:41.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.760+0000 7f6339505700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6334070030 con 0x7f63340734e0 2019-11-28T11:25:41.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.760+0000 7f63337fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f633406c0a0 0x7f6334072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:41.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.760+0000 7f63337fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f633406c0a0 0x7f6334072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59920/0 (socket says 172.21.15.80:59920) 2019-11-28T11:25:41.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.760+0000 7f63337fe700 1 -- 172.21.15.80:0/2375362191 learned_addr learned my addr 172.21.15.80:0/2375362191 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:41.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.760+0000 7f6332ffd700 1 --2- 172.21.15.80:0/2375362191 >> v2:172.21.15.174:3300/0 conn(0x7f63340734e0 0x7f6334071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:41.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.760+0000 7f63337fe700 1 -- 172.21.15.80:0/2375362191 >> v2:172.21.15.174:3300/0 conn(0x7f63340734e0 msgr2=0x7f6334071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:41.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.760+0000 7f63337fe700 1 --2- 172.21.15.80:0/2375362191 >> v2:172.21.15.174:3300/0 conn(0x7f63340734e0 0x7f6334071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:41.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.760+0000 7f63337fe700 1 -- 172.21.15.80:0/2375362191 >> v1:172.21.15.174:6789/0 conn(0x7f6334072360 legacy=0x7f633406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:41.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.760+0000 7f63327fc700 1 -- 172.21.15.80:0/2375362191 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804540805 0 0) 0x7f63240009b0 con 0x7f6334072360 2019-11-28T11:25:41.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.760+0000 7f63337fe700 1 -- 172.21.15.80:0/2375362191 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63340706c0 con 0x7f633406c0a0 2019-11-28T11:25:41.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.760+0000 7f63337fe700 1 --2- 172.21.15.80:0/2375362191 >> v2:172.21.15.80:3300/0 conn(0x7f633406c0a0 0x7f6334072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f632c00fa40 tx=0x7f632c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:41.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.760+0000 7f63337fe700 1 --2- 172.21.15.80:0/2375362191 >> v2:172.21.15.80:3300/0 conn(0x7f633406c0a0 0x7f6334072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f632c00fa40 tx=0x7f632c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:41.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.761+0000 7f63337fe700 1 --2- 172.21.15.80:0/2375362191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633406c0a0 0x7f6334072fa0 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7f632c00fa40 tx=0x7f632c00fde0).ready entity=mon.0 client_cookie=ea3bca4a4dd019ca server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:41.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.761+0000 7f63337fe700 1 --2- 172.21.15.80:0/2375362191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633406c0a0 0x7f6334072fa0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f632c00fa40 tx=0x7f632c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:41.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.761+0000 7f63327fc700 1 -- 172.21.15.80:0/2375362191 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f632c000ce0 con 0x7f633406c0a0 2019-11-28T11:25:41.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.761+0000 7f63337fe700 1 --2- 172.21.15.80:0/2375362191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633406c0a0 0x7f6334072fa0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f632c00fa40 tx=0x7f632c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:41.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.761+0000 7f63337fe700 1 --2- 172.21.15.80:0/2375362191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633406c0a0 0x7f6334072fa0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f632c00fa40 tx=0x7f632c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:41.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.761+0000 7f63327fc700 1 -- 172.21.15.80:0/2375362191 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c001010 con 0x7f633406c0a0 2019-11-28T11:25:41.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.761+0000 7f63327fc700 1 -- 172.21.15.80:0/2375362191 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f632c000ce0 con 0x7f633406c0a0 2019-11-28T11:25:41.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.761+0000 7f6339505700 1 -- 172.21.15.80:0/2375362191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633406c0a0 msgr2=0x7f6334072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:41.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.761+0000 7f6339505700 1 --2- 172.21.15.80:0/2375362191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633406c0a0 0x7f6334072fa0 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7f632c00fa40 tx=0x7f632c00fde0).stop 2019-11-28T11:25:41.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.761+0000 7f6339505700 1 -- 172.21.15.80:0/2375362191 shutdown_connections 2019-11-28T11:25:41.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.761+0000 7f6339505700 1 --2- 172.21.15.80:0/2375362191 >> v2:172.21.15.174:3300/0 conn(0x7f63340734e0 0x7f6334071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:41.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.761+0000 7f6339505700 1 --2- 172.21.15.80:0/2375362191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633406c0a0 0x7f6334072fa0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:41.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.761+0000 7f6339505700 1 -- 172.21.15.80:0/2375362191 shutdown_connections 2019-11-28T11:25:41.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.761+0000 7f6339505700 1 -- 172.21.15.80:0/2375362191 wait complete. 2019-11-28T11:25:41.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.761+0000 7f6339505700 1 -- 172.21.15.80:0/2375362191 >> 172.21.15.80:0/2375362191 conn(0x7f6334061cf0 msgr2=0x7f6334064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:41.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.764+0000 7f6339505700 1 Processor -- start 2019-11-28T11:25:41.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.764+0000 7f6339505700 1 -- start start 2019-11-28T11:25:41.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6339505700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f633410ab00 0x7f633410bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:41.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6339505700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f633410c500 0x7f633412e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:41.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6339505700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f633412e590 0x7f633412e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:41.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6339505700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633415ad20 con 0x7f633410c500 2019-11-28T11:25:41.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6339505700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633415aff0 con 0x7f633410ab00 2019-11-28T11:25:41.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6339505700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633415a2f0 con 0x7f633412e590 2019-11-28T11:25:41.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6332ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f633410c500 0x7f633412e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:41.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6332ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f633410c500 0x7f633412e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59928/0 (socket says 172.21.15.80:59928) 2019-11-28T11:25:41.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6332ffd700 1 -- 172.21.15.80:0/845333509 learned_addr learned my addr 172.21.15.80:0/845333509 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:41.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6333fff700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f633412e590 0x7f633412e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:41.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f63337fe700 1 --2- 172.21.15.80:0/845333509 >> v2:172.21.15.174:3300/0 conn(0x7f633410ab00 0x7f633410bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:41.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6332ffd700 1 -- 172.21.15.80:0/845333509 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f633412e590 msgr2=0x7f633412e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:41.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6332ffd700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f633412e590 0x7f633412e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:41.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6332ffd700 1 -- 172.21.15.80:0/845333509 >> v2:172.21.15.174:3300/0 conn(0x7f633410ab00 msgr2=0x7f633410bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:41.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6332ffd700 1 --2- 172.21.15.80:0/845333509 >> v2:172.21.15.174:3300/0 conn(0x7f633410ab00 0x7f633410bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:41.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6332ffd700 1 -- 172.21.15.80:0/845333509 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633415b680 con 0x7f633410c500 2019-11-28T11:25:41.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6332ffd700 1 --2- 172.21.15.80:0/845333509 >> v2:172.21.15.80:3300/0 conn(0x7f633410c500 0x7f633412e050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f631c0103d0 tx=0x7f631c010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:41.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6332ffd700 1 --2- 172.21.15.80:0/845333509 >> v2:172.21.15.80:3300/0 conn(0x7f633410c500 0x7f633412e050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f631c0103d0 tx=0x7f631c010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:41.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.765+0000 7f6332ffd700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633410c500 0x7f633412e050 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f631c0103d0 tx=0x7f631c010250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:41.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.766+0000 7f6332ffd700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633410c500 0x7f633412e050 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f631c0103d0 tx=0x7f631c010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:41.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.766+0000 7f632bfff700 1 -- 172.21.15.80:0/845333509 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f631c005770 con 0x7f633410c500 2019-11-28T11:25:41.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.766+0000 7f6332ffd700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633410c500 0x7f633412e050 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f631c0103d0 tx=0x7f631c010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:41.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.766+0000 7f6332ffd700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633410c500 0x7f633412e050 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f631c0103d0 tx=0x7f631c010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:41.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.766+0000 7f632bfff700 1 -- 172.21.15.80:0/845333509 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c005390 con 0x7f633410c500 2019-11-28T11:25:41.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.766+0000 7f632bfff700 1 -- 172.21.15.80:0/845333509 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f631c005d50 con 0x7f633410c500 2019-11-28T11:25:41.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.766+0000 7f6339505700 1 -- 172.21.15.80:0/845333509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633415ba00 con 0x7f633410c500 2019-11-28T11:25:41.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.766+0000 7f6339505700 1 -- 172.21.15.80:0/845333509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633415b680 con 0x7f633410c500 2019-11-28T11:25:41.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.766+0000 7f6332ffd700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633410c500 0x7f633412e050 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f631c0103d0 tx=0x7f631c010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:41.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.766+0000 7f632bfff700 1 -- 172.21.15.80:0/845333509 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f631c005580 con 0x7f633410c500 2019-11-28T11:25:41.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.766+0000 7f6332ffd700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633410c500 0x7f633412e050 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f631c0103d0 tx=0x7f631c010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:41.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.766+0000 7f632bfff700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6318018730 0x7f631801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:41.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.766+0000 7f632bfff700 1 -- 172.21.15.80:0/845333509 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f631c0319a0 con 0x7f633410c500 2019-11-28T11:25:41.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.766+0000 7f63337fe700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6318018730 0x7f631801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:41.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.767+0000 7f63337fe700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6318018730 0x7f631801abc0 crc :-1 s=READY pgs=103 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:41.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.774+0000 7f6339505700 1 -- 172.21.15.80:0/845333509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633415ba00 con 0x7f633410c500 2019-11-28T11:25:41.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.777+0000 7f6332ffd700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633410c500 0x7f633412e050 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f631c0103d0 tx=0x7f631c010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:41.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.777+0000 7f632bfff700 1 -- 172.21.15.80:0/845333509 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f631c005180 con 0x7f633410c500 2019-11-28T11:25:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.953+0000 7f6339505700 1 -- 172.21.15.80:0/845333509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f633415b680 con 0x7f633410c500 2019-11-28T11:25:41.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.954+0000 7f6332ffd700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633410c500 0x7f633412e050 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f631c0103d0 tx=0x7f631c010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:41.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.954+0000 7f632bfff700 1 -- 172.21.15.80:0/845333509 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14885 (secure 0 0 0) 0x7f631c0173c0 con 0x7f633410c500 2019-11-28T11:25:41.975 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:41.975 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:20.933435+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:25:14.914696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-11-28T11:25:17.566323+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:41.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.956+0000 7f6339505700 1 -- 172.21.15.80:0/845333509 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6318018730 msgr2=0x7f631801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:41.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.956+0000 7f6339505700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6318018730 0x7f631801abc0 crc :-1 s=READY pgs=103 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:41.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.956+0000 7f6339505700 1 -- 172.21.15.80:0/845333509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633410c500 msgr2=0x7f633412e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:41.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.956+0000 7f6339505700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633410c500 0x7f633412e050 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f631c0103d0 tx=0x7f631c010250).stop 2019-11-28T11:25:41.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.956+0000 7f6339505700 1 -- 172.21.15.80:0/845333509 shutdown_connections 2019-11-28T11:25:41.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.956+0000 7f6339505700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6318018730 0x7f631801abc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:41.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.956+0000 7f6339505700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f633412e590 0x7f633412e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:41.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.956+0000 7f6339505700 1 --2- 172.21.15.80:0/845333509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f633410c500 0x7f633412e050 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:41.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.956+0000 7f6339505700 1 --2- 172.21.15.80:0/845333509 >> v2:172.21.15.174:3300/0 conn(0x7f633410ab00 0x7f633410bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:41.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.956+0000 7f6339505700 1 -- 172.21.15.80:0/845333509 shutdown_connections 2019-11-28T11:25:41.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.956+0000 7f6339505700 1 -- 172.21.15.80:0/845333509 wait complete. 2019-11-28T11:25:41.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:41.956+0000 7f6339505700 1 -- 172.21.15.80:0/845333509 >> 172.21.15.80:0/845333509 conn(0x7f633413d930 msgr2=0x7f6334111550 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:41.987 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:14.914696+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:17.566323+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:25:41.987 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:25:42.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.090+0000 7f2258e6b700 1 Processor -- start 2019-11-28T11:25:42.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.090+0000 7f2258e6b700 1 -- start start 2019-11-28T11:25:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.091+0000 7f2258e6b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f225415ed10 0x7f225415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.091+0000 7f2258e6b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22540734b0 0x7f22540726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.091+0000 7f2258e6b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225406db60 con 0x7f2254073020 2019-11-28T11:25:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.091+0000 7f2258e6b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225406fe00 con 0x7f225415ed10 2019-11-28T11:25:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.091+0000 7f2258e6b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22540700d0 con 0x7f22540734b0 2019-11-28T11:25:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.091+0000 7f2252d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f225415ed10 0x7f225415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.091+0000 7f2252d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f225415ed10 0x7f225415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59934/0 (socket says 172.21.15.80:59934) 2019-11-28T11:25:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.091+0000 7f2252d9d700 1 -- 172.21.15.80:0/711669185 learned_addr learned my addr 172.21.15.80:0/711669185 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.091+0000 7f225359e700 1 --2- 172.21.15.80:0/711669185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22540734b0 0x7f22540726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.091+0000 7f2252d9d700 1 -- 172.21.15.80:0/711669185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22540734b0 msgr2=0x7f22540726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.091+0000 7f2252d9d700 1 --2- 172.21.15.80:0/711669185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22540734b0 0x7f22540726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.091+0000 7f2252d9d700 1 -- 172.21.15.80:0/711669185 >> v1:172.21.15.174:6789/0 conn(0x7f2254073020 legacy=0x7f2254071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.091+0000 7f2252d9d700 1 -- 172.21.15.80:0/711669185 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254070760 con 0x7f225415ed10 2019-11-28T11:25:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.091+0000 7f2252d9d700 1 --2- 172.21.15.80:0/711669185 >> v2:172.21.15.80:3300/0 conn(0x7f225415ed10 0x7f225415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f223c00f740 tx=0x7f223c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.091+0000 7f2252d9d700 1 --2- 172.21.15.80:0/711669185 >> v2:172.21.15.80:3300/0 conn(0x7f225415ed10 0x7f225415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f223c00f740 tx=0x7f223c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.091+0000 7f2252d9d700 1 --2- 172.21.15.80:0/711669185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f225415ed10 0x7f225415f100 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7f223c00f740 tx=0x7f223c00f570).ready entity=mon.0 client_cookie=3d374abe7d3bd8a8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:42.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.092+0000 7f2252d9d700 1 --2- 172.21.15.80:0/711669185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f225415ed10 0x7f225415f100 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f223c00f740 tx=0x7f223c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.092+0000 7f2251d9b700 1 -- 172.21.15.80:0/711669185 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f223c000960 con 0x7f225415ed10 2019-11-28T11:25:42.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.092+0000 7f2252d9d700 1 --2- 172.21.15.80:0/711669185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f225415ed10 0x7f225415f100 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f223c00f740 tx=0x7f223c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.092+0000 7f2252d9d700 1 --2- 172.21.15.80:0/711669185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f225415ed10 0x7f225415f100 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f223c00f740 tx=0x7f223c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.092+0000 7f2251d9b700 1 -- 172.21.15.80:0/711669185 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c000c90 con 0x7f225415ed10 2019-11-28T11:25:42.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.092+0000 7f2251d9b700 1 -- 172.21.15.80:0/711669185 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f223c0013a0 con 0x7f225415ed10 2019-11-28T11:25:42.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.092+0000 7f2258e6b700 1 -- 172.21.15.80:0/711669185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f225415ed10 msgr2=0x7f225415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.092+0000 7f2258e6b700 1 --2- 172.21.15.80:0/711669185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f225415ed10 0x7f225415f100 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7f223c00f740 tx=0x7f223c00f570).stop 2019-11-28T11:25:42.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.092+0000 7f2258e6b700 1 -- 172.21.15.80:0/711669185 shutdown_connections 2019-11-28T11:25:42.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.092+0000 7f2258e6b700 1 --2- 172.21.15.80:0/711669185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22540734b0 0x7f22540726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:42.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.092+0000 7f2258e6b700 1 --2- 172.21.15.80:0/711669185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f225415ed10 0x7f225415f100 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:42.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.092+0000 7f2258e6b700 1 -- 172.21.15.80:0/711669185 shutdown_connections 2019-11-28T11:25:42.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.092+0000 7f2258e6b700 1 -- 172.21.15.80:0/711669185 wait complete. 2019-11-28T11:25:42.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.093+0000 7f2258e6b700 1 -- 172.21.15.80:0/711669185 >> 172.21.15.80:0/711669185 conn(0x7f2254061d20 msgr2=0x7f22540641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.095+0000 7f2258e6b700 1 Processor -- start 2019-11-28T11:25:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.095+0000 7f2258e6b700 1 -- start start 2019-11-28T11:25:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f2258e6b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f225410e970 0x7f22541087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f2258e6b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225410c250 con 0x7f2254107e30 2019-11-28T11:25:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f2258e6b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225410c6d0 con 0x7f2254108cf0 2019-11-28T11:25:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f2258e6b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225410da00 con 0x7f225410e970 2019-11-28T11:25:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f225359e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2254107e30 0x7f2254167d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59260/0 (socket says 172.21.15.80:59260) 2019-11-28T11:25:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f225359e700 1 -- 172.21.15.80:0/2780067428 learned_addr learned my addr 172.21.15.80:0/2780067428 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732095618 0 0) 0x7f224c002180 con 0x7f2254107e30 2019-11-28T11:25:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f2252d9d700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f225410e970 0x7f22541087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f222c002e80 con 0x7f2254107e30 2019-11-28T11:25:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3499774276 0 0) 0x7f224c002590 con 0x7f2254107e30 2019-11-28T11:25:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f222c0032e0 con 0x7f2254107e30 2019-11-28T11:25:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f224c002b60 con 0x7f2254107e30 2019-11-28T11:25:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f225410e970 msgr2=0x7f22541087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f224b7fe700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f225410e970 0x7f22541087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 >> v1:172.21.15.174:6789/0 conn(0x7f2254108cf0 legacy=0x7f2254107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 >> v1:172.21.15.80:6789/0 conn(0x7f2254107e30 legacy=0x7f2254167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f224b7fe700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222c003330 0x7f222c003760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f224b7fe700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f222c003ca0 0x7f222c004120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f224b7fe700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f222c004930 0x7f222c004dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c00bbf0 con 0x7f222c003ca0 2019-11-28T11:25:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c00bde0 con 0x7f222c003330 2019-11-28T11:25:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.096+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222c00c010 con 0x7f222c004930 2019-11-28T11:25:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f225259c700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f222c003ca0 0x7f222c004120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:42.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f2252d9d700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222c003330 0x7f222c003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:42.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f225359e700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f222c004930 0x7f222c004dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:42.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f225259c700 1 -- 172.21.15.80:0/2780067428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f222c004930 msgr2=0x7f222c004dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f225259c700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f222c004930 0x7f222c004dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:42.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f225259c700 1 -- 172.21.15.80:0/2780067428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222c003330 msgr2=0x7f222c003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f225259c700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222c003330 0x7f222c003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:42.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f225259c700 1 -- 172.21.15.80:0/2780067428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c00c2c0 con 0x7f222c003ca0 2019-11-28T11:25:42.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f2258e6b700 1 -- 172.21.15.80:0/2780067428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2254106270 con 0x7f222c003ca0 2019-11-28T11:25:42.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f225259c700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f222c003ca0 0x7f222c004120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22440105d0 tx=0x7f224400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f2258e6b700 1 -- 172.21.15.80:0/2780067428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2254105ef0 con 0x7f222c003ca0 2019-11-28T11:25:42.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f225259c700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f222c003ca0 0x7f222c004120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22440105d0 tx=0x7f224400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f225259c700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f222c003ca0 0x7f222c004120 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7f22440105d0 tx=0x7f224400b660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:42.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f225259c700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f222c003ca0 0x7f222c004120 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f22440105d0 tx=0x7f224400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2244006fd0 con 0x7f222c003ca0 2019-11-28T11:25:42.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f225259c700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f222c003ca0 0x7f222c004120 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f22440105d0 tx=0x7f224400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f225259c700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f222c003ca0 0x7f222c004120 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f22440105d0 tx=0x7f224400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2244000ce0 con 0x7f222c003ca0 2019-11-28T11:25:42.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2244006bf0 con 0x7f222c003ca0 2019-11-28T11:25:42.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.097+0000 7f225259c700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f222c003ca0 0x7f222c004120 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f22440105d0 tx=0x7f224400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.098+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2244006d30 con 0x7f222c003ca0 2019-11-28T11:25:42.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.098+0000 7f225259c700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f222c003ca0 0x7f222c004120 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f22440105d0 tx=0x7f224400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.098+0000 7f224b7fe700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f222c020bc0 0x7f222c022ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:42.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.098+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2244034190 con 0x7f222c003ca0 2019-11-28T11:25:42.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.098+0000 7f2252d9d700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f222c020bc0 0x7f222c022ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:42.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.098+0000 7f2252d9d700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f222c020bc0 0x7f222c022ff0 crc :-1 s=READY pgs=104 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:42.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.105+0000 7f2258e6b700 1 -- 172.21.15.80:0/2780067428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2254106270 con 0x7f222c003ca0 2019-11-28T11:25:42.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.108+0000 7f225259c700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f222c003ca0 0x7f222c004120 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f22440105d0 tx=0x7f224400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.108+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2244006990 con 0x7f222c003ca0 2019-11-28T11:25:42.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.277+0000 7f2258e6b700 1 -- 172.21.15.80:0/2780067428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f2254105ef0 con 0x7f222c003ca0 2019-11-28T11:25:42.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.278+0000 7f225259c700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f222c003ca0 0x7f222c004120 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f22440105d0 tx=0x7f224400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.278+0000 7f224b7fe700 1 -- 172.21.15.80:0/2780067428 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2244000cc0 con 0x7f222c003ca0 2019-11-28T11:25:42.299 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:42.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.280+0000 7f2258e6b700 1 -- 172.21.15.80:0/2780067428 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f222c020bc0 msgr2=0x7f222c022ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.280+0000 7f2258e6b700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f222c020bc0 0x7f222c022ff0 crc :-1 s=READY pgs=104 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.280+0000 7f2258e6b700 1 -- 172.21.15.80:0/2780067428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f222c003ca0 msgr2=0x7f222c004120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.280+0000 7f2258e6b700 1 --2- 172.21.15.80:0/2780067428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f222c003ca0 0x7f222c004120 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7f22440105d0 tx=0x7f224400b660).stop 2019-11-28T11:25:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.280+0000 7f225359e700 1 -- 172.21.15.80:0/2780067428 reap_dead start 2019-11-28T11:25:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.280+0000 7f225359e700 1 -- 172.21.15.80:0/2780067428 reap_dead start 2019-11-28T11:25:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.281+0000 7f2258e6b700 1 -- 172.21.15.80:0/2780067428 shutdown_connections 2019-11-28T11:25:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.281+0000 7f2258e6b700 1 -- 172.21.15.80:0/2780067428 shutdown_connections 2019-11-28T11:25:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.281+0000 7f2258e6b700 1 -- 172.21.15.80:0/2780067428 wait complete. 2019-11-28T11:25:42.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.281+0000 7f2258e6b700 1 -- 172.21.15.80:0/2780067428 >> 172.21.15.80:0/2780067428 conn(0x7f225415e2d0 msgr2=0x7f2254147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:42.310 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:25:42.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.414+0000 7f1d5dbdf700 1 Processor -- start 2019-11-28T11:25:42.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.414+0000 7f1d5dbdf700 1 -- start start 2019-11-28T11:25:42.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.415+0000 7f1d5dbdf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1d5815ed10 0x7f1d5815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:42.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.415+0000 7f1d5dbdf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5806db60 con 0x7f1d580734b0 2019-11-28T11:25:42.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.415+0000 7f1d5dbdf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5806e060 con 0x7f1d58073020 2019-11-28T11:25:42.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.415+0000 7f1d5dbdf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d5806fe00 con 0x7f1d5815ed10 2019-11-28T11:25:42.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.415+0000 7f1d5c97d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1d580734b0 0x7f1d580726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59274/0 (socket says 172.21.15.80:59274) 2019-11-28T11:25:42.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.415+0000 7f1d5c97d700 1 -- 172.21.15.80:0/1176331022 learned_addr learned my addr 172.21.15.80:0/1176331022 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:42.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.415+0000 7f1d57fff700 1 --2- 172.21.15.80:0/1176331022 >> v2:172.21.15.174:3300/0 conn(0x7f1d5815ed10 0x7f1d5815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:42.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.415+0000 7f1d577fe700 1 -- 172.21.15.80:0/1176331022 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345018154 0 0) 0x7f1d500014d0 con 0x7f1d580734b0 2019-11-28T11:25:42.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.415+0000 7f1d577fe700 1 -- 172.21.15.80:0/1176331022 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d38002e80 con 0x7f1d580734b0 2019-11-28T11:25:42.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.415+0000 7f1d577fe700 1 -- 172.21.15.80:0/1176331022 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1107650464 0 0) 0x7f1d500014b0 con 0x7f1d580734b0 2019-11-28T11:25:42.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.415+0000 7f1d57fff700 1 -- 172.21.15.80:0/1176331022 >> v1:172.21.15.174:6789/0 conn(0x7f1d58073020 legacy=0x7f1d58071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.415+0000 7f1d57fff700 1 -- 172.21.15.80:0/1176331022 >> v1:172.21.15.80:6789/0 conn(0x7f1d580734b0 legacy=0x7f1d580726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.415+0000 7f1d57fff700 1 -- 172.21.15.80:0/1176331022 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d58070760 con 0x7f1d5815ed10 2019-11-28T11:25:42.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.416+0000 7f1d57fff700 1 --2- 172.21.15.80:0/1176331022 >> v2:172.21.15.174:3300/0 conn(0x7f1d5815ed10 0x7f1d5815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1d4800af50 tx=0x7f1d4800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.416+0000 7f1d57fff700 1 --2- 172.21.15.80:0/1176331022 >> v2:172.21.15.174:3300/0 conn(0x7f1d5815ed10 0x7f1d5815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1d4800af50 tx=0x7f1d4800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.416+0000 7f1d57fff700 1 --2- 172.21.15.80:0/1176331022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5815ed10 0x7f1d5815f100 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f1d4800af50 tx=0x7f1d4800b760).ready entity=mon.1 client_cookie=6133b0780c4016a3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:42.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.416+0000 7f1d57fff700 1 --2- 172.21.15.80:0/1176331022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5815ed10 0x7f1d5815f100 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f1d4800af50 tx=0x7f1d4800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.416+0000 7f1d577fe700 1 -- 172.21.15.80:0/1176331022 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d48000960 con 0x7f1d5815ed10 2019-11-28T11:25:42.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.416+0000 7f1d57fff700 1 --2- 172.21.15.80:0/1176331022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5815ed10 0x7f1d5815f100 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f1d4800af50 tx=0x7f1d4800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.416+0000 7f1d57fff700 1 --2- 172.21.15.80:0/1176331022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5815ed10 0x7f1d5815f100 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f1d4800af50 tx=0x7f1d4800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.416+0000 7f1d577fe700 1 -- 172.21.15.80:0/1176331022 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d48009860 con 0x7f1d5815ed10 2019-11-28T11:25:42.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.416+0000 7f1d577fe700 1 -- 172.21.15.80:0/1176331022 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d48009f30 con 0x7f1d5815ed10 2019-11-28T11:25:42.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.416+0000 7f1d5dbdf700 1 -- 172.21.15.80:0/1176331022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5815ed10 msgr2=0x7f1d5815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.416+0000 7f1d5dbdf700 1 --2- 172.21.15.80:0/1176331022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5815ed10 0x7f1d5815f100 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f1d4800af50 tx=0x7f1d4800b760).stop 2019-11-28T11:25:42.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.417+0000 7f1d5dbdf700 1 -- 172.21.15.80:0/1176331022 shutdown_connections 2019-11-28T11:25:42.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.417+0000 7f1d5dbdf700 1 --2- 172.21.15.80:0/1176331022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5815ed10 0x7f1d5815f100 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:42.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.417+0000 7f1d5dbdf700 1 -- 172.21.15.80:0/1176331022 shutdown_connections 2019-11-28T11:25:42.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.417+0000 7f1d5dbdf700 1 -- 172.21.15.80:0/1176331022 wait complete. 2019-11-28T11:25:42.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.417+0000 7f1d5dbdf700 1 -- 172.21.15.80:0/1176331022 >> 172.21.15.80:0/1176331022 conn(0x7f1d58061d20 msgr2=0x7f1d580641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:42.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.419+0000 7f1d5dbdf700 1 Processor -- start 2019-11-28T11:25:42.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.419+0000 7f1d5dbdf700 1 -- start start 2019-11-28T11:25:42.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d5dbdf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1d5810ed60 0x7f1d5810f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:42.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d5dbdf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d5810f730 0x7f1d58167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:42.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d5dbdf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5810c250 con 0x7f1d5810e970 2019-11-28T11:25:42.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d5dbdf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d5810e430 con 0x7f1d5810ed60 2019-11-28T11:25:42.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d5dbdf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d58105860 con 0x7f1d5810f730 2019-11-28T11:25:42.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d4ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1d5810ed60 0x7f1d5810f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:42.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d4ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1d5810ed60 0x7f1d5810f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59962/0 (socket says 172.21.15.80:59962) 2019-11-28T11:25:42.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d4ffff700 1 -- 172.21.15.80:0/2856731995 learned_addr learned my addr 172.21.15.80:0/2856731995 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:42.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d5c97d700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d5810f730 0x7f1d58167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:42.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d4ffff700 1 -- 172.21.15.80:0/2856731995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d5810f730 msgr2=0x7f1d58167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d4ffff700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d5810f730 0x7f1d58167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:42.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d4ffff700 1 -- 172.21.15.80:0/2856731995 >> v1:172.21.15.80:6789/0 conn(0x7f1d5810e970 legacy=0x7f1d581087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d4ffff700 1 -- 172.21.15.80:0/2856731995 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d58105ef0 con 0x7f1d5810ed60 2019-11-28T11:25:42.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d557fa700 1 -- 172.21.15.80:0/2856731995 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054558799 0 0) 0x7f1d4800ac20 con 0x7f1d5810e970 2019-11-28T11:25:42.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d4ffff700 1 --2- 172.21.15.80:0/2856731995 >> v2:172.21.15.80:3300/0 conn(0x7f1d5810ed60 0x7f1d5810f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d40010270 tx=0x7f1d400128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d4ffff700 1 --2- 172.21.15.80:0/2856731995 >> v2:172.21.15.80:3300/0 conn(0x7f1d5810ed60 0x7f1d5810f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d40010270 tx=0x7f1d400128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.420+0000 7f1d4ffff700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d5810ed60 0x7f1d5810f1f0 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7f1d40010270 tx=0x7f1d400128e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:42.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.421+0000 7f1d4ffff700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d5810ed60 0x7f1d5810f1f0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f1d40010270 tx=0x7f1d400128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.421+0000 7f1d557fa700 1 -- 172.21.15.80:0/2856731995 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d40005720 con 0x7f1d5810ed60 2019-11-28T11:25:42.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.421+0000 7f1d4ffff700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d5810ed60 0x7f1d5810f1f0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f1d40010270 tx=0x7f1d400128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.421+0000 7f1d557fa700 1 -- 172.21.15.80:0/2856731995 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d40005340 con 0x7f1d5810ed60 2019-11-28T11:25:42.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.421+0000 7f1d4ffff700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d5810ed60 0x7f1d5810f1f0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f1d40010270 tx=0x7f1d400128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.421+0000 7f1d557fa700 1 -- 172.21.15.80:0/2856731995 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d40005910 con 0x7f1d5810ed60 2019-11-28T11:25:42.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.421+0000 7f1d5dbdf700 1 -- 172.21.15.80:0/2856731995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d58106270 con 0x7f1d5810ed60 2019-11-28T11:25:42.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.421+0000 7f1d5dbdf700 1 -- 172.21.15.80:0/2856731995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d58105ef0 con 0x7f1d5810ed60 2019-11-28T11:25:42.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.421+0000 7f1d4ffff700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d5810ed60 0x7f1d5810f1f0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f1d40010270 tx=0x7f1d400128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.421+0000 7f1d557fa700 1 -- 172.21.15.80:0/2856731995 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1d40005530 con 0x7f1d5810ed60 2019-11-28T11:25:42.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.421+0000 7f1d4ffff700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d5810ed60 0x7f1d5810f1f0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f1d40010270 tx=0x7f1d400128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.421+0000 7f1d557fa700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d30018730 0x7f1d3001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.421+0000 7f1d557fa700 1 -- 172.21.15.80:0/2856731995 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f1d40033c80 con 0x7f1d5810ed60 2019-11-28T11:25:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.421+0000 7f1d57fff700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d30018730 0x7f1d3001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.422+0000 7f1d57fff700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d30018730 0x7f1d3001abc0 crc :-1 s=READY pgs=105 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:42.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.429+0000 7f1d5dbdf700 1 -- 172.21.15.80:0/2856731995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d58106270 con 0x7f1d5810ed60 2019-11-28T11:25:42.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.432+0000 7f1d4ffff700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d5810ed60 0x7f1d5810f1f0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f1d40010270 tx=0x7f1d400128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.432+0000 7f1d557fa700 1 -- 172.21.15.80:0/2856731995 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1d400075b0 con 0x7f1d5810ed60 2019-11-28T11:25:42.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.600+0000 7f1d5dbdf700 1 -- 172.21.15.80:0/2856731995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f1d58105ef0 con 0x7f1d5810ed60 2019-11-28T11:25:42.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.601+0000 7f1d4ffff700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d5810ed60 0x7f1d5810f1f0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f1d40010270 tx=0x7f1d400128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.601+0000 7f1d557fa700 1 -- 172.21.15.80:0/2856731995 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f1d40005530 con 0x7f1d5810ed60 2019-11-28T11:25:42.622 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:42.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.603+0000 7f1d5dbdf700 1 -- 172.21.15.80:0/2856731995 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d30018730 msgr2=0x7f1d3001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.603+0000 7f1d5dbdf700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d30018730 0x7f1d3001abc0 crc :-1 s=READY pgs=105 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:42.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.603+0000 7f1d5dbdf700 1 -- 172.21.15.80:0/2856731995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d5810ed60 msgr2=0x7f1d5810f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.603+0000 7f1d5dbdf700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d5810ed60 0x7f1d5810f1f0 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7f1d40010270 tx=0x7f1d400128e0).stop 2019-11-28T11:25:42.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.604+0000 7f1d5dbdf700 1 -- 172.21.15.80:0/2856731995 shutdown_connections 2019-11-28T11:25:42.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.604+0000 7f1d5dbdf700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d30018730 0x7f1d3001abc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:42.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.604+0000 7f1d5dbdf700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d5810f730 0x7f1d58167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:42.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.604+0000 7f1d5dbdf700 1 --2- 172.21.15.80:0/2856731995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d5810ed60 0x7f1d5810f1f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:42.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.604+0000 7f1d5dbdf700 1 -- 172.21.15.80:0/2856731995 shutdown_connections 2019-11-28T11:25:42.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.604+0000 7f1d5dbdf700 1 -- 172.21.15.80:0/2856731995 wait complete. 2019-11-28T11:25:42.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.604+0000 7f1d5dbdf700 1 -- 172.21.15.80:0/2856731995 >> 172.21.15.80:0/2856731995 conn(0x7f1d5815e2d0 msgr2=0x7f1d58147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:42.634 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:25:42.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.738+0000 7f5768235700 1 Processor -- start 2019-11-28T11:25:42.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.738+0000 7f5768235700 1 -- start start 2019-11-28T11:25:42.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.739+0000 7f5768235700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576015f100 0x7f576006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:42.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.739+0000 7f5768235700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f576006c2f0 0x7f576006c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:42.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.739+0000 7f5768235700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576006db60 con 0x7f576015ed10 2019-11-28T11:25:42.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.739+0000 7f5768235700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576006fe00 con 0x7f576006c2f0 2019-11-28T11:25:42.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.739+0000 7f5768235700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57600700d0 con 0x7f576015f100 2019-11-28T11:25:42.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.739+0000 7f5765fd1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576015f100 0x7f576006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:42.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f5766fd3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f576006c2f0 0x7f576006c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:42.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f5765fd1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576015f100 0x7f576006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:34000/0 (socket says 172.21.15.80:34000) 2019-11-28T11:25:42.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f5765fd1700 1 -- 172.21.15.80:0/3673560994 learned_addr learned my addr 172.21.15.80:0/3673560994 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:42.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f57667d2700 1 --1- 172.21.15.80:0/3673560994 >> v1:172.21.15.174:6789/0 conn(0x7f576015ed10 0x7f5760073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:46596/0 (socket says 172.21.15.80:46596) 2019-11-28T11:25:42.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f5765fd1700 1 -- 172.21.15.80:0/3673560994 >> v2:172.21.15.174:3300/0 conn(0x7f576006c2f0 msgr2=0x7f576006c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:42.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f5765fd1700 1 --2- 172.21.15.80:0/3673560994 >> v2:172.21.15.174:3300/0 conn(0x7f576006c2f0 0x7f576006c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:42.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f5765fd1700 1 -- 172.21.15.80:0/3673560994 >> v1:172.21.15.174:6789/0 conn(0x7f576015ed10 legacy=0x7f5760073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f5765fd1700 1 -- 172.21.15.80:0/3673560994 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5760070760 con 0x7f576015f100 2019-11-28T11:25:42.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f5766fd3700 1 --2- 172.21.15.80:0/3673560994 >> v2:172.21.15.174:3300/0 conn(0x7f576006c2f0 0x7f576006c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:42.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f5765fd1700 1 --2- 172.21.15.80:0/3673560994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576015f100 0x7f576006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f575000f740 tx=0x7f575000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f5765fd1700 1 --2- 172.21.15.80:0/3673560994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576015f100 0x7f576006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f575000f740 tx=0x7f575000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f5765fd1700 1 --2- 172.21.15.80:0/3673560994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576015f100 0x7f576006bdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f575000f740 tx=0x7f575000fae0).ready entity=mon.2 client_cookie=78021fd7c6ea7fc8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:42.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f5765fd1700 1 --2- 172.21.15.80:0/3673560994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576015f100 0x7f576006bdb0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f575000f740 tx=0x7f575000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f57657d0700 1 -- 172.21.15.80:0/3673560994 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5750000960 con 0x7f576015f100 2019-11-28T11:25:42.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f5765fd1700 1 --2- 172.21.15.80:0/3673560994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576015f100 0x7f576006bdb0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f575000f740 tx=0x7f575000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f5765fd1700 1 --2- 172.21.15.80:0/3673560994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576015f100 0x7f576006bdb0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f575000f740 tx=0x7f575000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f57657d0700 1 -- 172.21.15.80:0/3673560994 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5750000c90 con 0x7f576015f100 2019-11-28T11:25:42.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f57657d0700 1 -- 172.21.15.80:0/3673560994 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57500013a0 con 0x7f576015f100 2019-11-28T11:25:42.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f5768235700 1 -- 172.21.15.80:0/3673560994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576015f100 msgr2=0x7f576006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.740+0000 7f5768235700 1 --2- 172.21.15.80:0/3673560994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576015f100 0x7f576006bdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f575000f740 tx=0x7f575000fae0).stop 2019-11-28T11:25:42.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.741+0000 7f5768235700 1 -- 172.21.15.80:0/3673560994 shutdown_connections 2019-11-28T11:25:42.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.741+0000 7f5768235700 1 --2- 172.21.15.80:0/3673560994 >> v2:172.21.15.174:3300/0 conn(0x7f576006c2f0 0x7f576006c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:42.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.741+0000 7f5768235700 1 --2- 172.21.15.80:0/3673560994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f576015f100 0x7f576006bdb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:42.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.741+0000 7f5768235700 1 -- 172.21.15.80:0/3673560994 shutdown_connections 2019-11-28T11:25:42.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.741+0000 7f5768235700 1 -- 172.21.15.80:0/3673560994 wait complete. 2019-11-28T11:25:42.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.741+0000 7f5768235700 1 -- 172.21.15.80:0/3673560994 >> 172.21.15.80:0/3673560994 conn(0x7f5760061d20 msgr2=0x7f57600641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.744+0000 7f5768235700 1 Processor -- start 2019-11-28T11:25:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.744+0000 7f5768235700 1 -- start start 2019-11-28T11:25:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f5768235700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760153ea0 0x7f5760169780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:42.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f5768235700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576010bed0 con 0x7f5760169390 2019-11-28T11:25:42.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f5768235700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57601484b0 con 0x7f5760153520 2019-11-28T11:25:42.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f5768235700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57601241a0 con 0x7f5760153ea0 2019-11-28T11:25:42.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f57667d2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5760169390 0x7f5760152d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59290/0 (socket says 172.21.15.80:59290) 2019-11-28T11:25:42.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f57667d2700 1 -- 172.21.15.80:0/970781232 learned_addr learned my addr 172.21.15.80:0/970781232 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:42.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f5765fd1700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760153ea0 0x7f5760169780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:42.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f575effd700 1 -- 172.21.15.80:0/970781232 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562802848 0 0) 0x7f5748000cf0 con 0x7f5760169390 2019-11-28T11:25:42.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f575effd700 1 -- 172.21.15.80:0/970781232 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5744002e80 con 0x7f5760169390 2019-11-28T11:25:42.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f575effd700 1 -- 172.21.15.80:0/970781232 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903604624 0 0) 0x7f5758009b40 con 0x7f5760153520 2019-11-28T11:25:42.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f575effd700 1 -- 172.21.15.80:0/970781232 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57440030b0 con 0x7f5760153520 2019-11-28T11:25:42.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f5765fd1700 1 -- 172.21.15.80:0/970781232 >> v1:172.21.15.174:6789/0 conn(0x7f5760153520 legacy=0x7f576010b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f5765fd1700 1 -- 172.21.15.80:0/970781232 >> v1:172.21.15.80:6789/0 conn(0x7f5760169390 legacy=0x7f5760152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f5765fd1700 1 -- 172.21.15.80:0/970781232 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5760124b00 con 0x7f5760153ea0 2019-11-28T11:25:42.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f5765fd1700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760153ea0 0x7f5760169780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57500103a0 tx=0x7f5750010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f5765fd1700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760153ea0 0x7f5760169780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57500103a0 tx=0x7f5750010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f5765fd1700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760153ea0 0x7f5760169780 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f57500103a0 tx=0x7f5750010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f5765fd1700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760153ea0 0x7f5760169780 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f57500103a0 tx=0x7f5750010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f575effd700 1 -- 172.21.15.80:0/970781232 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5750000940 con 0x7f5760153ea0 2019-11-28T11:25:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f5765fd1700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760153ea0 0x7f5760169780 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f57500103a0 tx=0x7f5750010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f5765fd1700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760153ea0 0x7f5760169780 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f57500103a0 tx=0x7f5750010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f575effd700 1 -- 172.21.15.80:0/970781232 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5750000f50 con 0x7f5760153ea0 2019-11-28T11:25:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f5768235700 1 -- 172.21.15.80:0/970781232 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5760151960 con 0x7f5760153ea0 2019-11-28T11:25:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.745+0000 7f575effd700 1 -- 172.21.15.80:0/970781232 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57500016a0 con 0x7f5760153ea0 2019-11-28T11:25:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.746+0000 7f5768235700 1 -- 172.21.15.80:0/970781232 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5760124b00 con 0x7f5760153ea0 2019-11-28T11:25:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.746+0000 7f5765fd1700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760153ea0 0x7f5760169780 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f57500103a0 tx=0x7f5750010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.746+0000 7f575effd700 1 -- 172.21.15.80:0/970781232 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5750001140 con 0x7f5760153ea0 2019-11-28T11:25:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.746+0000 7f5765fd1700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760153ea0 0x7f5760169780 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f57500103a0 tx=0x7f5750010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.746+0000 7f575effd700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5744018750 0x7f574401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.746+0000 7f575effd700 1 -- 172.21.15.80:0/970781232 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f5750031a70 con 0x7f5760153ea0 2019-11-28T11:25:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.746+0000 7f57667d2700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5744018750 0x7f574401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.747+0000 7f57667d2700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5744018750 0x7f574401abe0 crc :-1 s=READY pgs=106 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.753+0000 7f5768235700 1 -- 172.21.15.80:0/970781232 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5760151960 con 0x7f5760153ea0 2019-11-28T11:25:42.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.757+0000 7f5765fd1700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760153ea0 0x7f5760169780 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f57500103a0 tx=0x7f5750010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.757+0000 7f575effd700 1 -- 172.21.15.80:0/970781232 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5750028fb0 con 0x7f5760153ea0 2019-11-28T11:25:42.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.925+0000 7f5768235700 1 -- 172.21.15.80:0/970781232 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f5760124b00 con 0x7f5760153ea0 2019-11-28T11:25:42.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.926+0000 7f5765fd1700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760153ea0 0x7f5760169780 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f57500103a0 tx=0x7f5750010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:42.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.926+0000 7f575effd700 1 -- 172.21.15.80:0/970781232 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5750028fb0 con 0x7f5760153ea0 2019-11-28T11:25:42.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.928+0000 7f5768235700 1 -- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5744018750 msgr2=0x7f574401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.928+0000 7f5768235700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5744018750 0x7f574401abe0 crc :-1 s=READY pgs=106 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:42.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.928+0000 7f5768235700 1 -- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760153ea0 msgr2=0x7f5760169780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:42.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.928+0000 7f5768235700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760153ea0 0x7f5760169780 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f57500103a0 tx=0x7f5750010740).stop 2019-11-28T11:25:42.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.928+0000 7f5768235700 1 -- 172.21.15.80:0/970781232 shutdown_connections 2019-11-28T11:25:42.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.928+0000 7f5768235700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5744018750 0x7f574401abe0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:42.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.928+0000 7f5768235700 1 --2- 172.21.15.80:0/970781232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5760153ea0 0x7f5760169780 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:42.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.928+0000 7f5768235700 1 -- 172.21.15.80:0/970781232 shutdown_connections 2019-11-28T11:25:42.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.928+0000 7f5768235700 1 -- 172.21.15.80:0/970781232 wait complete. 2019-11-28T11:25:42.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:42.928+0000 7f5768235700 1 -- 172.21.15.80:0/970781232 >> 172.21.15.80:0/970781232 conn(0x7f576007bac0 msgr2=0x7f576014b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:42.952 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:42.985 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:25:42.985 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:25:43.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.085+0000 7f2c6d90e700 1 Processor -- start 2019-11-28T11:25:43.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.085+0000 7f2c6d90e700 1 -- start start 2019-11-28T11:25:43.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c6d90e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2c6806c0a0 0x7f2c68072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:43.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c6d90e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c680734e0 0x7f2c68071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:43.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c6d90e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6806db00 con 0x7f2c68072360 2019-11-28T11:25:43.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c6d90e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6806fd60 con 0x7f2c680734e0 2019-11-28T11:25:43.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c6d90e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c68070030 con 0x7f2c6806c0a0 2019-11-28T11:25:43.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c66ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c680734e0 0x7f2c68071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:43.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c66ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c680734e0 0x7f2c68071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59982/0 (socket says 172.21.15.80:59982) 2019-11-28T11:25:43.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c66ffd700 1 -- 172.21.15.80:0/1914990834 learned_addr learned my addr 172.21.15.80:0/1914990834 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:43.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c66ffd700 1 -- 172.21.15.80:0/1914990834 >> v2:172.21.15.174:3300/0 conn(0x7f2c6806c0a0 msgr2=0x7f2c68072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:43.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c677fe700 1 --2- 172.21.15.80:0/1914990834 >> v2:172.21.15.174:3300/0 conn(0x7f2c6806c0a0 0x7f2c68072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:43.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c66ffd700 1 --2- 172.21.15.80:0/1914990834 >> v2:172.21.15.174:3300/0 conn(0x7f2c6806c0a0 0x7f2c68072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:43.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c66ffd700 1 -- 172.21.15.80:0/1914990834 >> v1:172.21.15.80:6789/0 conn(0x7f2c68072360 legacy=0x7f2c6806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:43.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c66ffd700 1 -- 172.21.15.80:0/1914990834 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c680706c0 con 0x7f2c680734e0 2019-11-28T11:25:43.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c667fc700 1 -- 172.21.15.80:0/1914990834 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263171253 0 0) 0x7f2c60000a40 con 0x7f2c68072360 2019-11-28T11:25:43.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c66ffd700 1 --2- 172.21.15.80:0/1914990834 >> v2:172.21.15.80:3300/0 conn(0x7f2c680734e0 0x7f2c68071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2c5000f6c0 tx=0x7f2c5000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:43.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c66ffd700 1 --2- 172.21.15.80:0/1914990834 >> v2:172.21.15.80:3300/0 conn(0x7f2c680734e0 0x7f2c68071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2c5000f6c0 tx=0x7f2c5000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:43.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c66ffd700 1 --2- 172.21.15.80:0/1914990834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c680734e0 0x7f2c68071e20 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f2c5000f6c0 tx=0x7f2c5000fa60).ready entity=mon.0 client_cookie=98a8e9ca10785a86 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:43.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c66ffd700 1 --2- 172.21.15.80:0/1914990834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c680734e0 0x7f2c68071e20 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f2c5000f6c0 tx=0x7f2c5000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:43.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c667fc700 1 -- 172.21.15.80:0/1914990834 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c50000960 con 0x7f2c680734e0 2019-11-28T11:25:43.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c66ffd700 1 --2- 172.21.15.80:0/1914990834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c680734e0 0x7f2c68071e20 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f2c5000f6c0 tx=0x7f2c5000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:43.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c66ffd700 1 --2- 172.21.15.80:0/1914990834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c680734e0 0x7f2c68071e20 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f2c5000f6c0 tx=0x7f2c5000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:43.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c667fc700 1 -- 172.21.15.80:0/1914990834 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c50000c90 con 0x7f2c680734e0 2019-11-28T11:25:43.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.086+0000 7f2c667fc700 1 -- 172.21.15.80:0/1914990834 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c500013a0 con 0x7f2c680734e0 2019-11-28T11:25:43.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.087+0000 7f2c6d90e700 1 -- 172.21.15.80:0/1914990834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c680734e0 msgr2=0x7f2c68071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:43.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.087+0000 7f2c6d90e700 1 --2- 172.21.15.80:0/1914990834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c680734e0 0x7f2c68071e20 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f2c5000f6c0 tx=0x7f2c5000fa60).stop 2019-11-28T11:25:43.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.087+0000 7f2c6d90e700 1 -- 172.21.15.80:0/1914990834 shutdown_connections 2019-11-28T11:25:43.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.087+0000 7f2c6d90e700 1 --2- 172.21.15.80:0/1914990834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c680734e0 0x7f2c68071e20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:43.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.087+0000 7f2c6d90e700 1 --2- 172.21.15.80:0/1914990834 >> v2:172.21.15.174:3300/0 conn(0x7f2c6806c0a0 0x7f2c68072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:43.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.087+0000 7f2c6d90e700 1 -- 172.21.15.80:0/1914990834 shutdown_connections 2019-11-28T11:25:43.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.087+0000 7f2c6d90e700 1 -- 172.21.15.80:0/1914990834 wait complete. 2019-11-28T11:25:43.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.087+0000 7f2c6d90e700 1 -- 172.21.15.80:0/1914990834 >> 172.21.15.80:0/1914990834 conn(0x7f2c68061cf0 msgr2=0x7f2c68064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:43.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.090+0000 7f2c6d90e700 1 Processor -- start 2019-11-28T11:25:43.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.090+0000 7f2c6d90e700 1 -- start start 2019-11-28T11:25:43.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c6d90e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c6813e320 0x7f2c6813e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:43.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c6d90e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c6812a3c0 0x7f2c6812a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:43.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c6d90e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c68139e00 con 0x7f2c6815fdf0 2019-11-28T11:25:43.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c6d90e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c68108820 con 0x7f2c6812a3c0 2019-11-28T11:25:43.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c6d90e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c68108af0 con 0x7f2c6813e320 2019-11-28T11:25:43.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c677fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2c6815fdf0 0x7f2c6812b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59302/0 (socket says 172.21.15.80:59302) 2019-11-28T11:25:43.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c677fe700 1 -- 172.21.15.80:0/3894347455 learned_addr learned my addr 172.21.15.80:0/3894347455 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:43.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c67fff700 1 --2- 172.21.15.80:0/3894347455 >> v2:172.21.15.80:3300/0 conn(0x7f2c6812a3c0 0x7f2c6812a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:43.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c5ffff700 1 -- 172.21.15.80:0/3894347455 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784005880 0 0) 0x7f2c58001430 con 0x7f2c6815fdf0 2019-11-28T11:25:43.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c66ffd700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c6813e320 0x7f2c6813e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:43.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c5ffff700 1 -- 172.21.15.80:0/3894347455 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c4c002e80 con 0x7f2c6815fdf0 2019-11-28T11:25:43.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c67fff700 1 -- 172.21.15.80:0/3894347455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c6813e320 msgr2=0x7f2c6813e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:43.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c67fff700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c6813e320 0x7f2c6813e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:43.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c67fff700 1 -- 172.21.15.80:0/3894347455 >> v1:172.21.15.80:6789/0 conn(0x7f2c6815fdf0 legacy=0x7f2c6812b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:43.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c67fff700 1 -- 172.21.15.80:0/3894347455 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6810a8c0 con 0x7f2c6812a3c0 2019-11-28T11:25:43.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c67fff700 1 --2- 172.21.15.80:0/3894347455 >> v2:172.21.15.80:3300/0 conn(0x7f2c6812a3c0 0x7f2c6812a810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2c600103c0 tx=0x7f2c6000b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:43.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c67fff700 1 --2- 172.21.15.80:0/3894347455 >> v2:172.21.15.80:3300/0 conn(0x7f2c6812a3c0 0x7f2c6812a810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2c600103c0 tx=0x7f2c6000b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:43.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c67fff700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6812a3c0 0x7f2c6812a810 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f2c600103c0 tx=0x7f2c6000b300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:43.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c67fff700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6812a3c0 0x7f2c6812a810 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f2c600103c0 tx=0x7f2c6000b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:43.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c5ffff700 1 -- 172.21.15.80:0/3894347455 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c6000ea20 con 0x7f2c6812a3c0 2019-11-28T11:25:43.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c67fff700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6812a3c0 0x7f2c6812a810 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f2c600103c0 tx=0x7f2c6000b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:43.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c5ffff700 1 -- 172.21.15.80:0/3894347455 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6000ee30 con 0x7f2c6812a3c0 2019-11-28T11:25:43.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c67fff700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6812a3c0 0x7f2c6812a810 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f2c600103c0 tx=0x7f2c6000b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:43.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c6d90e700 1 -- 172.21.15.80:0/3894347455 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6810a8c0 con 0x7f2c6812a3c0 2019-11-28T11:25:43.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c5ffff700 1 -- 172.21.15.80:0/3894347455 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c6000ec20 con 0x7f2c6812a3c0 2019-11-28T11:25:43.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.091+0000 7f2c6d90e700 1 -- 172.21.15.80:0/3894347455 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6810a8c0 con 0x7f2c6812a3c0 2019-11-28T11:25:43.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.092+0000 7f2c67fff700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6812a3c0 0x7f2c6812a810 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f2c600103c0 tx=0x7f2c6000b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:43.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.092+0000 7f2c5ffff700 1 -- 172.21.15.80:0/3894347455 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2c6000f020 con 0x7f2c6812a3c0 2019-11-28T11:25:43.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.092+0000 7f2c67fff700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6812a3c0 0x7f2c6812a810 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f2c600103c0 tx=0x7f2c6000b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:43.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.092+0000 7f2c5ffff700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c4c018770 0x7f2c4c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:43.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.092+0000 7f2c5ffff700 1 -- 172.21.15.80:0/3894347455 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2c600319f0 con 0x7f2c6812a3c0 2019-11-28T11:25:43.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.092+0000 7f2c677fe700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c4c018770 0x7f2c4c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:43.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.093+0000 7f2c677fe700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c4c018770 0x7f2c4c01abe0 crc :-1 s=READY pgs=107 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:43.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.100+0000 7f2c6d90e700 1 -- 172.21.15.80:0/3894347455 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c68109180 con 0x7f2c6812a3c0 2019-11-28T11:25:43.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.103+0000 7f2c67fff700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6812a3c0 0x7f2c6812a810 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f2c600103c0 tx=0x7f2c6000b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:43.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.103+0000 7f2c5ffff700 1 -- 172.21.15.80:0/3894347455 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2c6000ea20 con 0x7f2c6812a3c0 2019-11-28T11:25:43.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.277+0000 7f2c6d90e700 1 -- 172.21.15.80:0/3894347455 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c68109500 con 0x7f2c6812a3c0 2019-11-28T11:25:43.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.277+0000 7f2c67fff700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6812a3c0 0x7f2c6812a810 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f2c600103c0 tx=0x7f2c6000b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:43.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.277+0000 7f2c5ffff700 1 -- 172.21.15.80:0/3894347455 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2441 (secure 0 0 0) 0x7f2c6000ee30 con 0x7f2c6812a3c0 2019-11-28T11:25:43.298 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:43.298 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/3100151299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3100151299},{"type":"v1","addr":"172.21.15.80:6833","nonce":3100151299}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4},{"gid":4359,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/4212336515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":4212336515},{"type":"v1","addr":"172.21.15.80:6835","nonce":4212336515}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:25:19.931718+0000","modified":"2019-11-28T11:25:28.542379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4229":{"gid":4229,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2081356472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2081356472},{"type":"v1","addr":"172.21.15.174:6835","nonce":2081356472}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-11-28T11:25:43.299 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 6 2019-11-28T11:25:43.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.280+0000 7f2c6d90e700 1 -- 172.21.15.80:0/3894347455 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c4c018770 msgr2=0x7f2c4c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:43.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.280+0000 7f2c6d90e700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c4c018770 0x7f2c4c01abe0 crc :-1 s=READY pgs=107 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:43.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.280+0000 7f2c6d90e700 1 -- 172.21.15.80:0/3894347455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6812a3c0 msgr2=0x7f2c6812a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:43.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.280+0000 7f2c6d90e700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6812a3c0 0x7f2c6812a810 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f2c600103c0 tx=0x7f2c6000b300).stop 2019-11-28T11:25:43.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.280+0000 7f2c6d90e700 1 -- 172.21.15.80:0/3894347455 shutdown_connections 2019-11-28T11:25:43.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.280+0000 7f2c6d90e700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c4c018770 0x7f2c4c01abe0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:43.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.280+0000 7f2c6d90e700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c6812a3c0 0x7f2c6812a810 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:43.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.280+0000 7f2c6d90e700 1 --2- 172.21.15.80:0/3894347455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c6813e320 0x7f2c6813e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:43.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.280+0000 7f2c6d90e700 1 -- 172.21.15.80:0/3894347455 shutdown_connections 2019-11-28T11:25:43.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.280+0000 7f2c6d90e700 1 -- 172.21.15.80:0/3894347455 wait complete. 2019-11-28T11:25:43.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:43.280+0000 7f2c6d90e700 1 -- 172.21.15.80:0/3894347455 >> 172.21.15.80:0/3894347455 conn(0x7f2c68127dc0 msgr2=0x7f2c68141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:43.612 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4229}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4229': {u'export_targets': [], u'name': u'c', u'incarnation': 5, u'state_seq': 3, u'state': u'up:active', u'gid': 4229, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2081356472, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2081356472, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2081356472'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:25:19.931718+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:25:28.542379+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:25:43.612 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:25:43.612 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:25:43.746 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:25:43.747 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:25:43.749 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:25:43.749 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 4229, 2019-11-28T11:25:43.749 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:25:43.750 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:25:43.751 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 16.185298819, 2019-11-28T11:25:43.751 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 6, 2019-11-28T11:25:43.752 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 25, 2019-11-28T11:25:43.752 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 25, 2019-11-28T11:25:43.752 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 21.007125905999999 2019-11-28T11:25:43.753 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:25:43.754 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 4229, "want_state": "up:active", "state": "up:active", "rank_uptime": 16.185298819, "mdsmap_epoch": 6, "osdmap_epoch": 25, "osdmap_epoch_barrier": 25, "uptime": 21.007125905999999 } 2019-11-28T11:25:43.754 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:25:43.755 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:25:43.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:25:43.755 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:25:43.824 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:25:43.825 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:25:43.945 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:25:43.945 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:25:44.064 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:25:44.065 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:25:44.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:25:44.065 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:25:44.157 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2019-11-28T11:25:44.218 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:44.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.322+0000 7fc982297700 1 Processor -- start 2019-11-28T11:25:44.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.322+0000 7fc982297700 1 -- start start 2019-11-28T11:25:44.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.323+0000 7fc982297700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc97c06c0a0 0x7fc97c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:44.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.323+0000 7fc982297700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c06db00 con 0x7fc97c0734e0 2019-11-28T11:25:44.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.323+0000 7fc982297700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c06e000 con 0x7fc97c072620 2019-11-28T11:25:44.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.323+0000 7fc982297700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97c06fd60 con 0x7fc97c06c0a0 2019-11-28T11:25:44.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.323+0000 7fc980834700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc97c06c0a0 0x7fc97c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:44.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc980834700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc97c06c0a0 0x7fc97c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59994/0 (socket says 172.21.15.80:59994) 2019-11-28T11:25:44.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc97bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc97c0734e0 0x7fc97c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59310/0 (socket says 172.21.15.80:59310) 2019-11-28T11:25:44.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc980834700 1 -- 172.21.15.80:0/4099098420 learned_addr learned my addr 172.21.15.80:0/4099098420 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:44.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc980834700 1 -- 172.21.15.80:0/4099098420 >> v1:172.21.15.174:6789/0 conn(0x7fc97c072620 legacy=0x7fc97c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:44.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc980834700 1 -- 172.21.15.80:0/4099098420 >> v1:172.21.15.80:6789/0 conn(0x7fc97c0734e0 legacy=0x7fc97c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:44.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc980834700 1 -- 172.21.15.80:0/4099098420 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c0706c0 con 0x7fc97c06c0a0 2019-11-28T11:25:44.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc97b7fe700 1 -- 172.21.15.80:0/4099098420 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257111174 0 0) 0x7fc96c001480 con 0x7fc97c0734e0 2019-11-28T11:25:44.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc980834700 1 --2- 172.21.15.80:0/4099098420 >> v2:172.21.15.80:3300/0 conn(0x7fc97c06c0a0 0x7fc97c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc96400f740 tx=0x7fc96400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc980834700 1 --2- 172.21.15.80:0/4099098420 >> v2:172.21.15.80:3300/0 conn(0x7fc97c06c0a0 0x7fc97c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc96400f740 tx=0x7fc96400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc980834700 1 --2- 172.21.15.80:0/4099098420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97c06c0a0 0x7fc97c072fa0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7fc96400f740 tx=0x7fc96400fae0).ready entity=mon.0 client_cookie=a689da48ae90b61 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:44.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc980834700 1 --2- 172.21.15.80:0/4099098420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97c06c0a0 0x7fc97c072fa0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fc96400f740 tx=0x7fc96400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc97b7fe700 1 -- 172.21.15.80:0/4099098420 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc964000960 con 0x7fc97c06c0a0 2019-11-28T11:25:44.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc980834700 1 --2- 172.21.15.80:0/4099098420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97c06c0a0 0x7fc97c072fa0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fc96400f740 tx=0x7fc96400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc980834700 1 --2- 172.21.15.80:0/4099098420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97c06c0a0 0x7fc97c072fa0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fc96400f740 tx=0x7fc96400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc97b7fe700 1 -- 172.21.15.80:0/4099098420 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc964007210 con 0x7fc97c06c0a0 2019-11-28T11:25:44.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc97b7fe700 1 -- 172.21.15.80:0/4099098420 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc964000960 con 0x7fc97c06c0a0 2019-11-28T11:25:44.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc982297700 1 -- 172.21.15.80:0/4099098420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97c06c0a0 msgr2=0x7fc97c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:44.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.324+0000 7fc982297700 1 --2- 172.21.15.80:0/4099098420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97c06c0a0 0x7fc97c072fa0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7fc96400f740 tx=0x7fc96400fae0).stop 2019-11-28T11:25:44.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.325+0000 7fc982297700 1 -- 172.21.15.80:0/4099098420 shutdown_connections 2019-11-28T11:25:44.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.325+0000 7fc982297700 1 --2- 172.21.15.80:0/4099098420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97c06c0a0 0x7fc97c072fa0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:44.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.325+0000 7fc982297700 1 -- 172.21.15.80:0/4099098420 shutdown_connections 2019-11-28T11:25:44.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.325+0000 7fc982297700 1 -- 172.21.15.80:0/4099098420 wait complete. 2019-11-28T11:25:44.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.325+0000 7fc982297700 1 -- 172.21.15.80:0/4099098420 >> 172.21.15.80:0/4099098420 conn(0x7fc97c061cf0 msgr2=0x7fc97c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:44.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.327+0000 7fc982297700 1 Processor -- start 2019-11-28T11:25:44.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.327+0000 7fc982297700 1 -- start start 2019-11-28T11:25:44.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.328+0000 7fc982297700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc97c13f580 0x7fc97c114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:44.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.328+0000 7fc982297700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc97c11edb0 0x7fc97c168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:44.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.328+0000 7fc982297700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c13fc20 con 0x7fc97c114670 2019-11-28T11:25:44.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.328+0000 7fc982297700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97c122c80 con 0x7fc97c11edb0 2019-11-28T11:25:44.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.328+0000 7fc982297700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c122140 con 0x7fc97c13f580 2019-11-28T11:25:44.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.328+0000 7fc97bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc97c114670 0x7fc97c11e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59314/0 (socket says 172.21.15.80:59314) 2019-11-28T11:25:44.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.328+0000 7fc97bfff700 1 -- 172.21.15.80:0/2951967700 learned_addr learned my addr 172.21.15.80:0/2951967700 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:44.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc980834700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc97c13f580 0x7fc97c114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:44.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc981035700 1 --2- 172.21.15.80:0/2951967700 >> v2:172.21.15.174:3300/0 conn(0x7fc97c11edb0 0x7fc97c168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:44.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc9797fa700 1 -- 172.21.15.80:0/2951967700 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393971446 0 0) 0x7fc96c0014d0 con 0x7fc97c114670 2019-11-28T11:25:44.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc9797fa700 1 -- 172.21.15.80:0/2951967700 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc960002e80 con 0x7fc97c114670 2019-11-28T11:25:44.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc9797fa700 1 -- 172.21.15.80:0/2951967700 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4291378071 0 0) 0x7fc96c001680 con 0x7fc97c114670 2019-11-28T11:25:44.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc980834700 1 -- 172.21.15.80:0/2951967700 >> v2:172.21.15.174:3300/0 conn(0x7fc97c11edb0 msgr2=0x7fc97c168a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:44.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc980834700 1 --2- 172.21.15.80:0/2951967700 >> v2:172.21.15.174:3300/0 conn(0x7fc97c11edb0 0x7fc97c168a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:44.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc980834700 1 -- 172.21.15.80:0/2951967700 >> v1:172.21.15.80:6789/0 conn(0x7fc97c114670 legacy=0x7fc97c11e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:44.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc980834700 1 -- 172.21.15.80:0/2951967700 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c124010 con 0x7fc97c13f580 2019-11-28T11:25:44.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc981035700 1 --2- 172.21.15.80:0/2951967700 >> v2:172.21.15.174:3300/0 conn(0x7fc97c11edb0 0x7fc97c168a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:44.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc980834700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc97c13f580 0x7fc97c114130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc964010390 tx=0x7fc964010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc980834700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc97c13f580 0x7fc97c114130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc964010390 tx=0x7fc964010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc980834700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc97c13f580 0x7fc97c114130 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fc964010390 tx=0x7fc964010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:44.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc980834700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc97c13f580 0x7fc97c114130 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fc964010390 tx=0x7fc964010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc9797fa700 1 -- 172.21.15.80:0/2951967700 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc964000940 con 0x7fc97c13f580 2019-11-28T11:25:44.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc980834700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc97c13f580 0x7fc97c114130 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fc964010390 tx=0x7fc964010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc9797fa700 1 -- 172.21.15.80:0/2951967700 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc964000940 con 0x7fc97c13f580 2019-11-28T11:25:44.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc980834700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc97c13f580 0x7fc97c114130 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fc964010390 tx=0x7fc964010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc982297700 1 -- 172.21.15.80:0/2951967700 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97c124010 con 0x7fc97c13f580 2019-11-28T11:25:44.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc9797fa700 1 -- 172.21.15.80:0/2951967700 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc964001140 con 0x7fc97c13f580 2019-11-28T11:25:44.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.329+0000 7fc982297700 1 -- 172.21.15.80:0/2951967700 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97c124010 con 0x7fc97c13f580 2019-11-28T11:25:44.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.330+0000 7fc980834700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc97c13f580 0x7fc97c114130 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fc964010390 tx=0x7fc964010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.330+0000 7fc9797fa700 1 -- 172.21.15.80:0/2951967700 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc964000d60 con 0x7fc97c13f580 2019-11-28T11:25:44.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.330+0000 7fc980834700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc97c13f580 0x7fc97c114130 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fc964010390 tx=0x7fc964010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.330+0000 7fc9797fa700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc960018780 0x7fc96001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:44.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.330+0000 7fc9797fa700 1 -- 172.21.15.80:0/2951967700 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fc9640319d0 con 0x7fc97c13f580 2019-11-28T11:25:44.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.330+0000 7fc97bfff700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc960018780 0x7fc96001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:44.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.330+0000 7fc97bfff700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc960018780 0x7fc96001abf0 crc :-1 s=READY pgs=108 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:44.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.338+0000 7fc982297700 1 -- 172.21.15.80:0/2951967700 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97c124010 con 0x7fc97c13f580 2019-11-28T11:25:44.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.341+0000 7fc980834700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc97c13f580 0x7fc97c114130 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fc964010390 tx=0x7fc964010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.341+0000 7fc9797fa700 1 -- 172.21.15.80:0/2951967700 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc964022340 con 0x7fc97c13f580 2019-11-28T11:25:44.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.515+0000 7fc982297700 1 -- 172.21.15.80:0/2951967700 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc97c124010 con 0x7fc97c13f580 2019-11-28T11:25:44.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.516+0000 7fc980834700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc97c13f580 0x7fc97c114130 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fc964010390 tx=0x7fc964010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.516+0000 7fc9797fa700 1 -- 172.21.15.80:0/2951967700 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14885 (secure 0 0 0) 0x7fc964022340 con 0x7fc97c13f580 2019-11-28T11:25:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:44.538 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:20.933435+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:25:14.914696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-11-28T11:25:17.566323+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:44.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.518+0000 7fc982297700 1 -- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc960018780 msgr2=0x7fc96001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:44.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.518+0000 7fc982297700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc960018780 0x7fc96001abf0 crc :-1 s=READY pgs=108 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:44.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.518+0000 7fc982297700 1 -- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc97c13f580 msgr2=0x7fc97c114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:44.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.518+0000 7fc982297700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc97c13f580 0x7fc97c114130 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fc964010390 tx=0x7fc964010730).stop 2019-11-28T11:25:44.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.518+0000 7fc982297700 1 -- 172.21.15.80:0/2951967700 shutdown_connections 2019-11-28T11:25:44.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.518+0000 7fc982297700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc960018780 0x7fc96001abf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:44.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.518+0000 7fc982297700 1 --2- 172.21.15.80:0/2951967700 >> v2:172.21.15.174:3300/0 conn(0x7fc97c11edb0 0x7fc97c168a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:44.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.518+0000 7fc982297700 1 --2- 172.21.15.80:0/2951967700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc97c13f580 0x7fc97c114130 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:44.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.518+0000 7fc982297700 1 -- 172.21.15.80:0/2951967700 shutdown_connections 2019-11-28T11:25:44.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.518+0000 7fc982297700 1 -- 172.21.15.80:0/2951967700 wait complete. 2019-11-28T11:25:44.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.518+0000 7fc982297700 1 -- 172.21.15.80:0/2951967700 >> 172.21.15.80:0/2951967700 conn(0x7fc97c1426c0 msgr2=0x7fc97c110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:44.553 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:14.914696+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:17.566323+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:25:44.554 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:25:44.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.658+0000 7f9302fc7700 1 Processor -- start 2019-11-28T11:25:44.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.658+0000 7f9302fc7700 1 -- start start 2019-11-28T11:25:44.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9302fc7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f92fc15ed10 0x7f92fc15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:44.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9302fc7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92fc073020 0x7f92fc071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:44.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9302fc7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92fc06db60 con 0x7f92fc0734b0 2019-11-28T11:25:44.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9302fc7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92fc06fe00 con 0x7f92fc15ed10 2019-11-28T11:25:44.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9302fc7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc0700d0 con 0x7f92fc073020 2019-11-28T11:25:44.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9301564700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f92fc15ed10 0x7f92fc15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:44.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9300d63700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92fc073020 0x7f92fc071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:44.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9301d65700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f92fc0734b0 0x7f92fc0723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:46636/0 (socket says 172.21.15.80:46636) 2019-11-28T11:25:44.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9301564700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f92fc15ed10 0x7f92fc15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:46660/0 (socket says 172.21.15.80:46660) 2019-11-28T11:25:44.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9301d65700 1 -- 172.21.15.80:0/3053590750 learned_addr learned my addr 172.21.15.80:0/3053590750 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:44.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9300d63700 1 -- 172.21.15.80:0/3053590750 >> v2:172.21.15.174:3300/0 conn(0x7f92fc15ed10 msgr2=0x7f92fc15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:44.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9300d63700 1 --2- 172.21.15.80:0/3053590750 >> v2:172.21.15.174:3300/0 conn(0x7f92fc15ed10 0x7f92fc15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:44.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9300d63700 1 -- 172.21.15.80:0/3053590750 >> v1:172.21.15.174:6789/0 conn(0x7f92fc0734b0 legacy=0x7f92fc0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:44.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9300d63700 1 -- 172.21.15.80:0/3053590750 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc070760 con 0x7f92fc073020 2019-11-28T11:25:44.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9301564700 1 --2- 172.21.15.80:0/3053590750 >> v2:172.21.15.174:3300/0 conn(0x7f92fc15ed10 0x7f92fc15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:44.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9300d63700 1 --2- 172.21.15.80:0/3053590750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92fc073020 0x7f92fc071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f92ec00af50 tx=0x7f92ec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9300d63700 1 --2- 172.21.15.80:0/3053590750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92fc073020 0x7f92fc071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f92ec00af50 tx=0x7f92ec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.659+0000 7f9300d63700 1 --2- 172.21.15.80:0/3053590750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92fc073020 0x7f92fc071ea0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f92ec00af50 tx=0x7f92ec00b760).ready entity=mon.2 client_cookie=d353a648644893b7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:44.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.660+0000 7f9300d63700 1 --2- 172.21.15.80:0/3053590750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92fc073020 0x7f92fc071ea0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f92ec00af50 tx=0x7f92ec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.660+0000 7f9300d63700 1 --2- 172.21.15.80:0/3053590750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92fc073020 0x7f92fc071ea0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f92ec00af50 tx=0x7f92ec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.660+0000 7f92fbfff700 1 -- 172.21.15.80:0/3053590750 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92ec007210 con 0x7f92fc073020 2019-11-28T11:25:44.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.660+0000 7f9300d63700 1 --2- 172.21.15.80:0/3053590750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92fc073020 0x7f92fc071ea0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f92ec00af50 tx=0x7f92ec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.660+0000 7f92fbfff700 1 -- 172.21.15.80:0/3053590750 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec0099b0 con 0x7f92fc073020 2019-11-28T11:25:44.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.660+0000 7f92fbfff700 1 -- 172.21.15.80:0/3053590750 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92ec00a080 con 0x7f92fc073020 2019-11-28T11:25:44.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.660+0000 7f9302fc7700 1 -- 172.21.15.80:0/3053590750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92fc073020 msgr2=0x7f92fc071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:44.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.660+0000 7f9302fc7700 1 --2- 172.21.15.80:0/3053590750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92fc073020 0x7f92fc071ea0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f92ec00af50 tx=0x7f92ec00b760).stop 2019-11-28T11:25:44.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.660+0000 7f9302fc7700 1 -- 172.21.15.80:0/3053590750 shutdown_connections 2019-11-28T11:25:44.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.660+0000 7f9302fc7700 1 --2- 172.21.15.80:0/3053590750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92fc073020 0x7f92fc071ea0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:44.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.660+0000 7f9302fc7700 1 --2- 172.21.15.80:0/3053590750 >> v2:172.21.15.174:3300/0 conn(0x7f92fc15ed10 0x7f92fc15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:44.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.661+0000 7f9302fc7700 1 -- 172.21.15.80:0/3053590750 shutdown_connections 2019-11-28T11:25:44.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.661+0000 7f9302fc7700 1 -- 172.21.15.80:0/3053590750 wait complete. 2019-11-28T11:25:44.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.661+0000 7f9302fc7700 1 -- 172.21.15.80:0/3053590750 >> 172.21.15.80:0/3053590750 conn(0x7f92fc061d20 msgr2=0x7f92fc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:44.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.663+0000 7f9302fc7700 1 Processor -- start 2019-11-28T11:25:44.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.663+0000 7f9302fc7700 1 -- start start 2019-11-28T11:25:44.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.664+0000 7f9302fc7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f92fc148320 0x7f92fc10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:44.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.664+0000 7f9302fc7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92fc148e00 con 0x7f92fc10e3d0 2019-11-28T11:25:44.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.664+0000 7f9302fc7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92fc108b10 con 0x7f92fc10f290 2019-11-28T11:25:44.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.664+0000 7f9302fc7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92fc13aa20 con 0x7f92fc148320 2019-11-28T11:25:44.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.664+0000 7f9301564700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f92fc148320 0x7f92fc10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.664+0000 7f9301564700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f92fc148320 0x7f92fc10ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60012/0 (socket says 172.21.15.80:60012) 2019-11-28T11:25:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.664+0000 7f9301564700 1 -- 172.21.15.80:0/2515655387 learned_addr learned my addr 172.21.15.80:0/2515655387 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f9301564700 1 -- 172.21.15.80:0/2515655387 >> v1:172.21.15.174:6789/0 conn(0x7f92fc10f290 legacy=0x7f92fc10dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.664+0000 7f92f9ffb700 1 -- 172.21.15.80:0/2515655387 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243438279 0 0) 0x7f92ec00abb0 con 0x7f92fc10f290 2019-11-28T11:25:44.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f9301564700 1 -- 172.21.15.80:0/2515655387 >> v1:172.21.15.80:6789/0 conn(0x7f92fc10e3d0 legacy=0x7f92fc168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f9301564700 1 -- 172.21.15.80:0/2515655387 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc10c490 con 0x7f92fc148320 2019-11-28T11:25:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f9301564700 1 --2- 172.21.15.80:0/2515655387 >> v2:172.21.15.80:3300/0 conn(0x7f92fc148320 0x7f92fc10ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f92e4010790 tx=0x7f92e4010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f9301564700 1 --2- 172.21.15.80:0/2515655387 >> v2:172.21.15.80:3300/0 conn(0x7f92fc148320 0x7f92fc10ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f92e4010790 tx=0x7f92e4010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f9301564700 1 --2- 172.21.15.80:0/2515655387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92fc148320 0x7f92fc10ed50 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7f92e4010790 tx=0x7f92e4010b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:44.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f9301564700 1 --2- 172.21.15.80:0/2515655387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92fc148320 0x7f92fc10ed50 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f92e4010790 tx=0x7f92e4010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f92f9ffb700 1 -- 172.21.15.80:0/2515655387 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92e4000ce0 con 0x7f92fc148320 2019-11-28T11:25:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f9301564700 1 --2- 172.21.15.80:0/2515655387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92fc148320 0x7f92fc10ed50 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f92e4010790 tx=0x7f92e4010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f9301564700 1 --2- 172.21.15.80:0/2515655387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92fc148320 0x7f92fc10ed50 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f92e4010790 tx=0x7f92e4010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f92f9ffb700 1 -- 172.21.15.80:0/2515655387 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e400dec0 con 0x7f92fc148320 2019-11-28T11:25:44.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f9302fc7700 1 -- 172.21.15.80:0/2515655387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92fc10c810 con 0x7f92fc148320 2019-11-28T11:25:44.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f92f9ffb700 1 -- 172.21.15.80:0/2515655387 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92e400e610 con 0x7f92fc148320 2019-11-28T11:25:44.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f9302fc7700 1 -- 172.21.15.80:0/2515655387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92fc10c490 con 0x7f92fc148320 2019-11-28T11:25:44.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f9301564700 1 --2- 172.21.15.80:0/2515655387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92fc148320 0x7f92fc10ed50 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f92e4010790 tx=0x7f92e4010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f92f9ffb700 1 -- 172.21.15.80:0/2515655387 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f92e4009900 con 0x7f92fc148320 2019-11-28T11:25:44.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.665+0000 7f9301564700 1 --2- 172.21.15.80:0/2515655387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92fc148320 0x7f92fc10ed50 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f92e4010790 tx=0x7f92e4010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.666+0000 7f92f9ffb700 1 --2- 172.21.15.80:0/2515655387 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f92e0018730 0x7f92e001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:44.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.666+0000 7f92f9ffb700 1 -- 172.21.15.80:0/2515655387 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f92e4031ec0 con 0x7f92fc148320 2019-11-28T11:25:44.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.666+0000 7f9300d63700 1 --2- 172.21.15.80:0/2515655387 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f92e0018730 0x7f92e001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:44.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.666+0000 7f9300d63700 1 --2- 172.21.15.80:0/2515655387 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f92e0018730 0x7f92e001abc0 crc :-1 s=READY pgs=109 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:44.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.673+0000 7f9302fc7700 1 -- 172.21.15.80:0/2515655387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92fc10c810 con 0x7f92fc148320 2019-11-28T11:25:44.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.676+0000 7f9301564700 1 --2- 172.21.15.80:0/2515655387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92fc148320 0x7f92fc10ed50 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f92e4010790 tx=0x7f92e4010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.676+0000 7f92f9ffb700 1 -- 172.21.15.80:0/2515655387 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f92e400a930 con 0x7f92fc148320 2019-11-28T11:25:44.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.841+0000 7f9302fc7700 1 -- 172.21.15.80:0/2515655387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f92fc10c490 con 0x7f92fc148320 2019-11-28T11:25:44.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.841+0000 7f9301564700 1 --2- 172.21.15.80:0/2515655387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92fc148320 0x7f92fc10ed50 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f92e4010790 tx=0x7f92e4010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:44.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.842+0000 7f92f9ffb700 1 -- 172.21.15.80:0/2515655387 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f92e4009900 con 0x7f92fc148320 2019-11-28T11:25:44.863 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:44.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.844+0000 7f9302fc7700 1 -- 172.21.15.80:0/2515655387 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f92e0018730 msgr2=0x7f92e001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:44.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.844+0000 7f9302fc7700 1 --2- 172.21.15.80:0/2515655387 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f92e0018730 0x7f92e001abc0 crc :-1 s=READY pgs=109 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:44.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.844+0000 7f9302fc7700 1 -- 172.21.15.80:0/2515655387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92fc148320 msgr2=0x7f92fc10ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:44.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.844+0000 7f9302fc7700 1 --2- 172.21.15.80:0/2515655387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92fc148320 0x7f92fc10ed50 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7f92e4010790 tx=0x7f92e4010b30).stop 2019-11-28T11:25:44.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.844+0000 7f9302fc7700 1 -- 172.21.15.80:0/2515655387 shutdown_connections 2019-11-28T11:25:44.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.844+0000 7f9302fc7700 1 --2- 172.21.15.80:0/2515655387 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f92e0018730 0x7f92e001abc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:44.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.844+0000 7f9302fc7700 1 --2- 172.21.15.80:0/2515655387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92fc148320 0x7f92fc10ed50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:44.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.844+0000 7f9302fc7700 1 -- 172.21.15.80:0/2515655387 shutdown_connections 2019-11-28T11:25:44.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.844+0000 7f9302fc7700 1 -- 172.21.15.80:0/2515655387 wait complete. 2019-11-28T11:25:44.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.844+0000 7f9302fc7700 1 -- 172.21.15.80:0/2515655387 >> 172.21.15.80:0/2515655387 conn(0x7f92fc15e2d0 msgr2=0x7f92fc147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:44.881 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:25:45.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.984+0000 7f526d8d4700 1 Processor -- start 2019-11-28T11:25:45.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.984+0000 7f526d8d4700 1 -- start start 2019-11-28T11:25:45.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.985+0000 7f526d8d4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f526815ed10 0x7f526815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:45.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.985+0000 7f526d8d4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f52680734b0 0x7f52680726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:45.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.985+0000 7f526d8d4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526806db60 con 0x7f5268073020 2019-11-28T11:25:45.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.985+0000 7f526d8d4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526806fe00 con 0x7f52680734b0 2019-11-28T11:25:45.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.985+0000 7f526d8d4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52680700d0 con 0x7f526815ed10 2019-11-28T11:25:45.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.985+0000 7f5267fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f52680734b0 0x7f52680726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:45.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.985+0000 7f5267fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f52680734b0 0x7f52680726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60020/0 (socket says 172.21.15.80:60020) 2019-11-28T11:25:45.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.985+0000 7f5267fff700 1 -- 172.21.15.80:0/4204830564 learned_addr learned my addr 172.21.15.80:0/4204830564 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:45.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.985+0000 7f52677fe700 1 --2- 172.21.15.80:0/4204830564 >> v2:172.21.15.174:3300/0 conn(0x7f526815ed10 0x7f526815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:45.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.985+0000 7f5267fff700 1 -- 172.21.15.80:0/4204830564 >> v2:172.21.15.174:3300/0 conn(0x7f526815ed10 msgr2=0x7f526815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:45.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.985+0000 7f5267fff700 1 --2- 172.21.15.80:0/4204830564 >> v2:172.21.15.174:3300/0 conn(0x7f526815ed10 0x7f526815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:45.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.985+0000 7f5267fff700 1 -- 172.21.15.80:0/4204830564 >> v1:172.21.15.174:6789/0 conn(0x7f5268073020 legacy=0x7f5268071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.986+0000 7f5267fff700 1 -- 172.21.15.80:0/4204830564 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5268070760 con 0x7f52680734b0 2019-11-28T11:25:45.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.986+0000 7f5267fff700 1 --2- 172.21.15.80:0/4204830564 >> v2:172.21.15.80:3300/0 conn(0x7f52680734b0 0x7f52680726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f526000f730 tx=0x7f5260007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.986+0000 7f5267fff700 1 --2- 172.21.15.80:0/4204830564 >> v2:172.21.15.80:3300/0 conn(0x7f52680734b0 0x7f52680726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f526000f730 tx=0x7f5260007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.986+0000 7f5267fff700 1 --2- 172.21.15.80:0/4204830564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52680734b0 0x7f52680726a0 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f526000f730 tx=0x7f5260007d50).ready entity=mon.0 client_cookie=f720749d8b121da7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:45.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.986+0000 7f5267fff700 1 --2- 172.21.15.80:0/4204830564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52680734b0 0x7f52680726a0 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f526000f730 tx=0x7f5260007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.986+0000 7f52667fc700 1 -- 172.21.15.80:0/4204830564 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5260000a70 con 0x7f52680734b0 2019-11-28T11:25:45.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.986+0000 7f5267fff700 1 --2- 172.21.15.80:0/4204830564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52680734b0 0x7f52680726a0 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f526000f730 tx=0x7f5260007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.986+0000 7f5267fff700 1 --2- 172.21.15.80:0/4204830564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52680734b0 0x7f52680726a0 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f526000f730 tx=0x7f5260007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.986+0000 7f52667fc700 1 -- 172.21.15.80:0/4204830564 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52600010e0 con 0x7f52680734b0 2019-11-28T11:25:45.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.986+0000 7f52667fc700 1 -- 172.21.15.80:0/4204830564 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52600017b0 con 0x7f52680734b0 2019-11-28T11:25:45.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.986+0000 7f526d8d4700 1 -- 172.21.15.80:0/4204830564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52680734b0 msgr2=0x7f52680726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.986+0000 7f526d8d4700 1 --2- 172.21.15.80:0/4204830564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52680734b0 0x7f52680726a0 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f526000f730 tx=0x7f5260007d50).stop 2019-11-28T11:25:45.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.986+0000 7f526d8d4700 1 -- 172.21.15.80:0/4204830564 shutdown_connections 2019-11-28T11:25:45.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.986+0000 7f526d8d4700 1 --2- 172.21.15.80:0/4204830564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52680734b0 0x7f52680726a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:45.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.986+0000 7f526d8d4700 1 --2- 172.21.15.80:0/4204830564 >> v2:172.21.15.174:3300/0 conn(0x7f526815ed10 0x7f526815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:45.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.987+0000 7f526d8d4700 1 -- 172.21.15.80:0/4204830564 shutdown_connections 2019-11-28T11:25:45.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.987+0000 7f526d8d4700 1 -- 172.21.15.80:0/4204830564 wait complete. 2019-11-28T11:25:45.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.987+0000 7f526d8d4700 1 -- 172.21.15.80:0/4204830564 >> 172.21.15.80:0/4204830564 conn(0x7f5268061d20 msgr2=0x7f52680641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:45.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.989+0000 7f526d8d4700 1 Processor -- start 2019-11-28T11:25:45.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.989+0000 7f526d8d4700 1 -- start start 2019-11-28T11:25:45.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.990+0000 7f526d8d4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f52681079b0 0x7f5268107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:45.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.990+0000 7f526d8d4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5268108380 0x7f5268168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:45.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.990+0000 7f526d8d4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5268148e00 con 0x7f5268148320 2019-11-28T11:25:45.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.990+0000 7f526d8d4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526813aa20 con 0x7f52681079b0 2019-11-28T11:25:45.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.990+0000 7f526d8d4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526813acf0 con 0x7f5268108380 2019-11-28T11:25:45.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.990+0000 7f52677fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5268148320 0x7f526810ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59344/0 (socket says 172.21.15.80:59344) 2019-11-28T11:25:45.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.990+0000 7f52677fe700 1 -- 172.21.15.80:0/41831737 learned_addr learned my addr 172.21.15.80:0/41831737 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:45.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.990+0000 7f5266ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f52681079b0 0x7f5268107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:45.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.990+0000 7f5267fff700 1 --2- 172.21.15.80:0/41831737 >> v2:172.21.15.174:3300/0 conn(0x7f5268108380 0x7f5268168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:45.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.990+0000 7f525ffff700 1 -- 172.21.15.80:0/41831737 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146950673 0 0) 0x7f5258001430 con 0x7f5268148320 2019-11-28T11:25:45.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.990+0000 7f525ffff700 1 -- 172.21.15.80:0/41831737 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f524c002e80 con 0x7f5268148320 2019-11-28T11:25:45.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.990+0000 7f5266ffd700 1 -- 172.21.15.80:0/41831737 >> v2:172.21.15.174:3300/0 conn(0x7f5268108380 msgr2=0x7f5268168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.990+0000 7f5266ffd700 1 --2- 172.21.15.80:0/41831737 >> v2:172.21.15.174:3300/0 conn(0x7f5268108380 0x7f5268168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:45.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.990+0000 7f5266ffd700 1 -- 172.21.15.80:0/41831737 >> v1:172.21.15.80:6789/0 conn(0x7f5268148320 legacy=0x7f526810ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.990+0000 7f5266ffd700 1 -- 172.21.15.80:0/41831737 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526810c490 con 0x7f52681079b0 2019-11-28T11:25:45.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.990+0000 7f5267fff700 1 --2- 172.21.15.80:0/41831737 >> v2:172.21.15.174:3300/0 conn(0x7f5268108380 0x7f5268168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:45.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.991+0000 7f5266ffd700 1 --2- 172.21.15.80:0/41831737 >> v2:172.21.15.80:3300/0 conn(0x7f52681079b0 0x7f5268107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52500103b0 tx=0x7f5250010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.991+0000 7f5266ffd700 1 --2- 172.21.15.80:0/41831737 >> v2:172.21.15.80:3300/0 conn(0x7f52681079b0 0x7f5268107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52500103b0 tx=0x7f5250010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.991+0000 7f5266ffd700 1 --2- 172.21.15.80:0/41831737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52681079b0 0x7f5268107e40 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f52500103b0 tx=0x7f5250010750).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:45.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.991+0000 7f5266ffd700 1 --2- 172.21.15.80:0/41831737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52681079b0 0x7f5268107e40 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f52500103b0 tx=0x7f5250010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.991+0000 7f525ffff700 1 -- 172.21.15.80:0/41831737 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5250000a70 con 0x7f52681079b0 2019-11-28T11:25:45.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.991+0000 7f5266ffd700 1 --2- 172.21.15.80:0/41831737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52681079b0 0x7f5268107e40 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f52500103b0 tx=0x7f5250010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.991+0000 7f525ffff700 1 -- 172.21.15.80:0/41831737 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5250009990 con 0x7f52681079b0 2019-11-28T11:25:45.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.991+0000 7f5266ffd700 1 --2- 172.21.15.80:0/41831737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52681079b0 0x7f5268107e40 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f52500103b0 tx=0x7f5250010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.991+0000 7f526d8d4700 1 -- 172.21.15.80:0/41831737 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526810c810 con 0x7f52681079b0 2019-11-28T11:25:45.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.991+0000 7f525ffff700 1 -- 172.21.15.80:0/41831737 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5250000a70 con 0x7f52681079b0 2019-11-28T11:25:45.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.991+0000 7f526d8d4700 1 -- 172.21.15.80:0/41831737 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5268108820 con 0x7f52681079b0 2019-11-28T11:25:45.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.991+0000 7f5266ffd700 1 --2- 172.21.15.80:0/41831737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52681079b0 0x7f5268107e40 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f52500103b0 tx=0x7f5250010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.991+0000 7f525ffff700 1 -- 172.21.15.80:0/41831737 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5250009590 con 0x7f52681079b0 2019-11-28T11:25:45.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.991+0000 7f5266ffd700 1 --2- 172.21.15.80:0/41831737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52681079b0 0x7f5268107e40 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f52500103b0 tx=0x7f5250010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.992+0000 7f525ffff700 1 --2- 172.21.15.80:0/41831737 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f524c018770 0x7f524c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:45.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.992+0000 7f525ffff700 1 -- 172.21.15.80:0/41831737 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f5250031a30 con 0x7f52681079b0 2019-11-28T11:25:45.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.992+0000 7f52677fe700 1 --2- 172.21.15.80:0/41831737 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f524c018770 0x7f524c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:45.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.992+0000 7f52677fe700 1 --2- 172.21.15.80:0/41831737 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f524c018770 0x7f524c01abe0 crc :-1 s=READY pgs=110 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:45.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:44.999+0000 7f526d8d4700 1 -- 172.21.15.80:0/41831737 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526810c490 con 0x7f52681079b0 2019-11-28T11:25:45.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.003+0000 7f5266ffd700 1 --2- 172.21.15.80:0/41831737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52681079b0 0x7f5268107e40 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f52500103b0 tx=0x7f5250010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.003+0000 7f525ffff700 1 -- 172.21.15.80:0/41831737 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f525002dff0 con 0x7f52681079b0 2019-11-28T11:25:45.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.169+0000 7f526d8d4700 1 -- 172.21.15.80:0/41831737 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f526810c810 con 0x7f52681079b0 2019-11-28T11:25:45.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.170+0000 7f5266ffd700 1 --2- 172.21.15.80:0/41831737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52681079b0 0x7f5268107e40 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f52500103b0 tx=0x7f5250010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.170+0000 7f525ffff700 1 -- 172.21.15.80:0/41831737 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f525002dff0 con 0x7f52681079b0 2019-11-28T11:25:45.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.172+0000 7f526d8d4700 1 -- 172.21.15.80:0/41831737 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f524c018770 msgr2=0x7f524c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.172+0000 7f526d8d4700 1 --2- 172.21.15.80:0/41831737 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f524c018770 0x7f524c01abe0 crc :-1 s=READY pgs=110 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:45.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.172+0000 7f526d8d4700 1 -- 172.21.15.80:0/41831737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52681079b0 msgr2=0x7f5268107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.172+0000 7f526d8d4700 1 --2- 172.21.15.80:0/41831737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52681079b0 0x7f5268107e40 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f52500103b0 tx=0x7f5250010750).stop 2019-11-28T11:25:45.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.172+0000 7f526d8d4700 1 -- 172.21.15.80:0/41831737 shutdown_connections 2019-11-28T11:25:45.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.172+0000 7f526d8d4700 1 --2- 172.21.15.80:0/41831737 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f524c018770 0x7f524c01abe0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:45.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.172+0000 7f526d8d4700 1 --2- 172.21.15.80:0/41831737 >> v2:172.21.15.174:3300/0 conn(0x7f5268108380 0x7f5268168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:45.207 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:45.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.172+0000 7f526d8d4700 1 --2- 172.21.15.80:0/41831737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52681079b0 0x7f5268107e40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:45.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.172+0000 7f526d8d4700 1 -- 172.21.15.80:0/41831737 shutdown_connections 2019-11-28T11:25:45.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.172+0000 7f526d8d4700 1 -- 172.21.15.80:0/41831737 wait complete. 2019-11-28T11:25:45.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.172+0000 7f526d8d4700 1 -- 172.21.15.80:0/41831737 >> 172.21.15.80:0/41831737 conn(0x7f526815e2d0 msgr2=0x7f5268147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:45.210 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:25:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.319+0000 7f14a58db700 1 Processor -- start 2019-11-28T11:25:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.319+0000 7f14a58db700 1 -- start start 2019-11-28T11:25:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.320+0000 7f14a58db700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f14a015ed10 0x7f14a015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.320+0000 7f14a58db700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a006db60 con 0x7f14a0073020 2019-11-28T11:25:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.320+0000 7f14a58db700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a006e060 con 0x7f14a00734b0 2019-11-28T11:25:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.320+0000 7f14a58db700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a006fe00 con 0x7f14a015ed10 2019-11-28T11:25:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.320+0000 7f149effd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f14a0073020 0x7f14a0071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59354/0 (socket says 172.21.15.80:59354) 2019-11-28T11:25:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.320+0000 7f149effd700 1 -- 172.21.15.80:0/3595898952 learned_addr learned my addr 172.21.15.80:0/3595898952 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.320+0000 7f149f7fe700 1 --2- 172.21.15.80:0/3595898952 >> v2:172.21.15.174:3300/0 conn(0x7f14a015ed10 0x7f14a015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f149e7fc700 1 -- 172.21.15.80:0/3595898952 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383540619 0 0) 0x7f14880013f0 con 0x7f14a0073020 2019-11-28T11:25:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f149e7fc700 1 -- 172.21.15.80:0/3595898952 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1480002e80 con 0x7f14a0073020 2019-11-28T11:25:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f149e7fc700 1 -- 172.21.15.80:0/3595898952 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681894178 0 0) 0x7f14980009b0 con 0x7f14a00734b0 2019-11-28T11:25:45.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f149e7fc700 1 -- 172.21.15.80:0/3595898952 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1480004170 con 0x7f14a00734b0 2019-11-28T11:25:45.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f149f7fe700 1 -- 172.21.15.80:0/3595898952 >> v1:172.21.15.174:6789/0 conn(0x7f14a00734b0 legacy=0x7f14a00726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f149f7fe700 1 -- 172.21.15.80:0/3595898952 >> v1:172.21.15.80:6789/0 conn(0x7f14a0073020 legacy=0x7f14a0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f149f7fe700 1 -- 172.21.15.80:0/3595898952 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a0070760 con 0x7f14a015ed10 2019-11-28T11:25:45.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f149f7fe700 1 --2- 172.21.15.80:0/3595898952 >> v2:172.21.15.174:3300/0 conn(0x7f14a015ed10 0x7f14a015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f149000af50 tx=0x7f149000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f149f7fe700 1 --2- 172.21.15.80:0/3595898952 >> v2:172.21.15.174:3300/0 conn(0x7f14a015ed10 0x7f14a015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f149000af50 tx=0x7f149000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f149f7fe700 1 --2- 172.21.15.80:0/3595898952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a015ed10 0x7f14a015f100 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f149000af50 tx=0x7f149000b760).ready entity=mon.1 client_cookie=ab5185223cb39ebf server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:45.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f149f7fe700 1 --2- 172.21.15.80:0/3595898952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a015ed10 0x7f14a015f100 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f149000af50 tx=0x7f149000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f149e7fc700 1 -- 172.21.15.80:0/3595898952 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1490000960 con 0x7f14a015ed10 2019-11-28T11:25:45.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f149f7fe700 1 --2- 172.21.15.80:0/3595898952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a015ed10 0x7f14a015f100 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f149000af50 tx=0x7f149000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f149f7fe700 1 --2- 172.21.15.80:0/3595898952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a015ed10 0x7f14a015f100 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f149000af50 tx=0x7f149000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f149e7fc700 1 -- 172.21.15.80:0/3595898952 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1490009860 con 0x7f14a015ed10 2019-11-28T11:25:45.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f149e7fc700 1 -- 172.21.15.80:0/3595898952 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1490009f30 con 0x7f14a015ed10 2019-11-28T11:25:45.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f14a58db700 1 -- 172.21.15.80:0/3595898952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a015ed10 msgr2=0x7f14a015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.321+0000 7f14a58db700 1 --2- 172.21.15.80:0/3595898952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a015ed10 0x7f14a015f100 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f149000af50 tx=0x7f149000b760).stop 2019-11-28T11:25:45.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.322+0000 7f14a58db700 1 -- 172.21.15.80:0/3595898952 shutdown_connections 2019-11-28T11:25:45.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.322+0000 7f14a58db700 1 --2- 172.21.15.80:0/3595898952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a015ed10 0x7f14a015f100 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:45.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.322+0000 7f14a58db700 1 -- 172.21.15.80:0/3595898952 shutdown_connections 2019-11-28T11:25:45.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.322+0000 7f14a58db700 1 -- 172.21.15.80:0/3595898952 wait complete. 2019-11-28T11:25:45.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.322+0000 7f14a58db700 1 -- 172.21.15.80:0/3595898952 >> 172.21.15.80:0/3595898952 conn(0x7f14a0061d20 msgr2=0x7f14a00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:45.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.324+0000 7f14a58db700 1 Processor -- start 2019-11-28T11:25:45.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.324+0000 7f14a58db700 1 -- start start 2019-11-28T11:25:45.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.325+0000 7f14a58db700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a0165480 0x7f14a014b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:45.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.325+0000 7f14a58db700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f14a014b660 0x7f14a0077400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:45.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.325+0000 7f14a58db700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a0165da0 con 0x7f14a0077940 2019-11-28T11:25:45.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.325+0000 7f14a58db700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a0148d30 con 0x7f14a014b660 2019-11-28T11:25:45.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.325+0000 7f14a58db700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a0079980 con 0x7f14a0165480 2019-11-28T11:25:45.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.325+0000 7f149ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f14a0077940 0x7f14a007ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59360/0 (socket says 172.21.15.80:59360) 2019-11-28T11:25:45.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.325+0000 7f149ffff700 1 -- 172.21.15.80:0/1445493561 learned_addr learned my addr 172.21.15.80:0/1445493561 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:45.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.325+0000 7f149effd700 1 --2- 172.21.15.80:0/1445493561 >> v2:172.21.15.174:3300/0 conn(0x7f14a014b660 0x7f14a0077400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:45.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.325+0000 7f149f7fe700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a0165480 0x7f14a014b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:45.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.325+0000 7f1497fff700 1 -- 172.21.15.80:0/1445493561 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033800409 0 0) 0x7f1498001240 con 0x7f14a0077940 2019-11-28T11:25:45.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f1497fff700 1 -- 172.21.15.80:0/1445493561 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1478002e80 con 0x7f14a0077940 2019-11-28T11:25:45.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f1497fff700 1 -- 172.21.15.80:0/1445493561 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1072819860 0 0) 0x7f1498000940 con 0x7f14a0077940 2019-11-28T11:25:45.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f149f7fe700 1 -- 172.21.15.80:0/1445493561 >> v2:172.21.15.174:3300/0 conn(0x7f14a014b660 msgr2=0x7f14a0077400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f149f7fe700 1 --2- 172.21.15.80:0/1445493561 >> v2:172.21.15.174:3300/0 conn(0x7f14a014b660 0x7f14a0077400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:45.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f149f7fe700 1 -- 172.21.15.80:0/1445493561 >> v1:172.21.15.80:6789/0 conn(0x7f14a0077940 legacy=0x7f14a007ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f149f7fe700 1 -- 172.21.15.80:0/1445493561 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a007a2e0 con 0x7f14a0165480 2019-11-28T11:25:45.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f149effd700 1 --2- 172.21.15.80:0/1445493561 >> v2:172.21.15.174:3300/0 conn(0x7f14a014b660 0x7f14a0077400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:45.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f149f7fe700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a0165480 0x7f14a014b120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f14900103c0 tx=0x7f1490010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f149f7fe700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a0165480 0x7f14a014b120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f14900103c0 tx=0x7f1490010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f149f7fe700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a0165480 0x7f14a014b120 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f14900103c0 tx=0x7f1490010760).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:45.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f149f7fe700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a0165480 0x7f14a014b120 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f14900103c0 tx=0x7f1490010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f1497fff700 1 -- 172.21.15.80:0/1445493561 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1490000940 con 0x7f14a0165480 2019-11-28T11:25:45.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f149f7fe700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a0165480 0x7f14a014b120 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f14900103c0 tx=0x7f1490010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f149f7fe700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a0165480 0x7f14a014b120 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f14900103c0 tx=0x7f1490010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f1497fff700 1 -- 172.21.15.80:0/1445493561 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1490009980 con 0x7f14a0165480 2019-11-28T11:25:45.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f1497fff700 1 -- 172.21.15.80:0/1445493561 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1490000940 con 0x7f14a0165480 2019-11-28T11:25:45.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f14a58db700 1 -- 172.21.15.80:0/1445493561 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a007a660 con 0x7f14a0165480 2019-11-28T11:25:45.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.326+0000 7f14a58db700 1 -- 172.21.15.80:0/1445493561 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a007a2e0 con 0x7f14a0165480 2019-11-28T11:25:45.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.327+0000 7f149f7fe700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a0165480 0x7f14a014b120 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f14900103c0 tx=0x7f1490010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.327+0000 7f1497fff700 1 -- 172.21.15.80:0/1445493561 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1490009b70 con 0x7f14a0165480 2019-11-28T11:25:45.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.327+0000 7f149f7fe700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a0165480 0x7f14a014b120 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f14900103c0 tx=0x7f1490010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.327+0000 7f1497fff700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1478018780 0x7f147801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:45.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.327+0000 7f1497fff700 1 -- 172.21.15.80:0/1445493561 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f14900319b0 con 0x7f14a0165480 2019-11-28T11:25:45.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.327+0000 7f149effd700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1478018780 0x7f147801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:45.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.327+0000 7f149effd700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1478018780 0x7f147801abf0 crc :-1 s=READY pgs=111 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:45.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.334+0000 7f14a58db700 1 -- 172.21.15.80:0/1445493561 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a007a660 con 0x7f14a0165480 2019-11-28T11:25:45.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.338+0000 7f149f7fe700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a0165480 0x7f14a014b120 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f14900103c0 tx=0x7f1490010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.338+0000 7f1497fff700 1 -- 172.21.15.80:0/1445493561 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f14900284f0 con 0x7f14a0165480 2019-11-28T11:25:45.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.507+0000 7f14a58db700 1 -- 172.21.15.80:0/1445493561 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f14a007a2e0 con 0x7f14a0165480 2019-11-28T11:25:45.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.508+0000 7f149f7fe700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a0165480 0x7f14a014b120 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f14900103c0 tx=0x7f1490010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.508+0000 7f1497fff700 1 -- 172.21.15.80:0/1445493561 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1490009580 con 0x7f14a0165480 2019-11-28T11:25:45.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.510+0000 7f14a58db700 1 -- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1478018780 msgr2=0x7f147801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.510+0000 7f14a58db700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1478018780 0x7f147801abf0 crc :-1 s=READY pgs=111 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:45.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.510+0000 7f14a58db700 1 -- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a0165480 msgr2=0x7f14a014b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.510+0000 7f14a58db700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a0165480 0x7f14a014b120 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f14900103c0 tx=0x7f1490010760).stop 2019-11-28T11:25:45.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.510+0000 7f14a58db700 1 -- 172.21.15.80:0/1445493561 shutdown_connections 2019-11-28T11:25:45.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.510+0000 7f14a58db700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1478018780 0x7f147801abf0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:45.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.510+0000 7f14a58db700 1 --2- 172.21.15.80:0/1445493561 >> v2:172.21.15.174:3300/0 conn(0x7f14a014b660 0x7f14a0077400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:45.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.510+0000 7f14a58db700 1 --2- 172.21.15.80:0/1445493561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a0165480 0x7f14a014b120 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:45.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.510+0000 7f14a58db700 1 -- 172.21.15.80:0/1445493561 shutdown_connections 2019-11-28T11:25:45.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.510+0000 7f14a58db700 1 -- 172.21.15.80:0/1445493561 wait complete. 2019-11-28T11:25:45.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.510+0000 7f14a58db700 1 -- 172.21.15.80:0/1445493561 >> 172.21.15.80:0/1445493561 conn(0x7f14a0166440 msgr2=0x7f14a01494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:45.534 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:45.541 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:45.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.640+0000 7f297877d700 1 Processor -- start 2019-11-28T11:25:45.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.640+0000 7f297877d700 1 -- start start 2019-11-28T11:25:45.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.641+0000 7f297877d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f297006c0a0 0x7f2970072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:45.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.641+0000 7f297877d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29700734e0 0x7f2970071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:45.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.641+0000 7f297877d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2970072360 0x7f2970072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:45.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.641+0000 7f297877d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297006fd60 con 0x7f297006c0a0 2019-11-28T11:25:45.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.641+0000 7f297877d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2970070030 con 0x7f2970072360 2019-11-28T11:25:45.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.641+0000 7f297877d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297006f330 con 0x7f29700734e0 2019-11-28T11:25:45.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.641+0000 7f2976d1a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f297006c0a0 0x7f2970072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:45.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.641+0000 7f2976d1a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f297006c0a0 0x7f2970072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60048/0 (socket says 172.21.15.80:60048) 2019-11-28T11:25:45.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.641+0000 7f2976d1a700 1 -- 172.21.15.80:0/2287469898 learned_addr learned my addr 172.21.15.80:0/2287469898 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:45.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.641+0000 7f297751b700 1 --2- 172.21.15.80:0/2287469898 >> v2:172.21.15.174:3300/0 conn(0x7f2970072360 0x7f2970072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:45.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.641+0000 7f2976519700 1 --2- 172.21.15.80:0/2287469898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29700734e0 0x7f2970071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:45.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.642+0000 7f2976d1a700 1 -- 172.21.15.80:0/2287469898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29700734e0 msgr2=0x7f2970071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:45.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.642+0000 7f2976d1a700 1 --2- 172.21.15.80:0/2287469898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29700734e0 0x7f2970071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:45.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.642+0000 7f2976d1a700 1 -- 172.21.15.80:0/2287469898 >> v2:172.21.15.174:3300/0 conn(0x7f2970072360 msgr2=0x7f2970072800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:45.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.642+0000 7f2976d1a700 1 --2- 172.21.15.80:0/2287469898 >> v2:172.21.15.174:3300/0 conn(0x7f2970072360 0x7f2970072800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:45.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.642+0000 7f2976d1a700 1 -- 172.21.15.80:0/2287469898 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29700706c0 con 0x7f297006c0a0 2019-11-28T11:25:45.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.642+0000 7f2976d1a700 1 --2- 172.21.15.80:0/2287469898 >> v2:172.21.15.80:3300/0 conn(0x7f297006c0a0 0x7f2970072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f296000fa40 tx=0x7f296000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.642+0000 7f2976d1a700 1 --2- 172.21.15.80:0/2287469898 >> v2:172.21.15.80:3300/0 conn(0x7f297006c0a0 0x7f2970072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f296000fa40 tx=0x7f296000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.642+0000 7f2976d1a700 1 --2- 172.21.15.80:0/2287469898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297006c0a0 0x7f2970072fa0 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7f296000fa40 tx=0x7f296000f8f0).ready entity=mon.0 client_cookie=b17adf6a2dda95e1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:45.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.642+0000 7f2976d1a700 1 --2- 172.21.15.80:0/2287469898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297006c0a0 0x7f2970072fa0 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f296000fa40 tx=0x7f296000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.642+0000 7f2976d1a700 1 --2- 172.21.15.80:0/2287469898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297006c0a0 0x7f2970072fa0 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f296000fa40 tx=0x7f296000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.642+0000 7f2975d18700 1 -- 172.21.15.80:0/2287469898 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2960000ce0 con 0x7f297006c0a0 2019-11-28T11:25:45.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.642+0000 7f2976d1a700 1 --2- 172.21.15.80:0/2287469898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297006c0a0 0x7f2970072fa0 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f296000fa40 tx=0x7f296000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.642+0000 7f2975d18700 1 -- 172.21.15.80:0/2287469898 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2960001010 con 0x7f297006c0a0 2019-11-28T11:25:45.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.642+0000 7f2975d18700 1 -- 172.21.15.80:0/2287469898 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2960001720 con 0x7f297006c0a0 2019-11-28T11:25:45.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.642+0000 7f297877d700 1 -- 172.21.15.80:0/2287469898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297006c0a0 msgr2=0x7f2970072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.642+0000 7f297877d700 1 --2- 172.21.15.80:0/2287469898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297006c0a0 0x7f2970072fa0 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7f296000fa40 tx=0x7f296000f8f0).stop 2019-11-28T11:25:45.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.643+0000 7f297877d700 1 -- 172.21.15.80:0/2287469898 shutdown_connections 2019-11-28T11:25:45.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.643+0000 7f297877d700 1 --2- 172.21.15.80:0/2287469898 >> v2:172.21.15.174:3300/0 conn(0x7f2970072360 0x7f2970072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:45.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.643+0000 7f297877d700 1 --2- 172.21.15.80:0/2287469898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29700734e0 0x7f2970071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:45.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.643+0000 7f297877d700 1 --2- 172.21.15.80:0/2287469898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297006c0a0 0x7f2970072fa0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:45.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.643+0000 7f297877d700 1 -- 172.21.15.80:0/2287469898 shutdown_connections 2019-11-28T11:25:45.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.643+0000 7f297877d700 1 -- 172.21.15.80:0/2287469898 wait complete. 2019-11-28T11:25:45.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.643+0000 7f297877d700 1 -- 172.21.15.80:0/2287469898 >> 172.21.15.80:0/2287469898 conn(0x7f2970061cf0 msgr2=0x7f2970064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:45.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.645+0000 7f297877d700 1 Processor -- start 2019-11-28T11:25:45.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.645+0000 7f297877d700 1 -- start start 2019-11-28T11:25:45.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.646+0000 7f297877d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f297013dc00 0x7f2970109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:45.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.646+0000 7f297877d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29701312c0 con 0x7f29701094e0 2019-11-28T11:25:45.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.646+0000 7f297877d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2970104010 con 0x7f297010a3a0 2019-11-28T11:25:45.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.646+0000 7f297877d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2970104e00 con 0x7f297013dc00 2019-11-28T11:25:45.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.646+0000 7f297751b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f29701094e0 0x7f2970167a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59374/0 (socket says 172.21.15.80:59374) 2019-11-28T11:25:45.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.646+0000 7f297751b700 1 -- 172.21.15.80:0/1671857153 learned_addr learned my addr 172.21.15.80:0/1671857153 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:45.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.646+0000 7f2976d1a700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f297013dc00 0x7f2970109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:45.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f296f7fe700 1 -- 172.21.15.80:0/1671857153 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878816363 0 0) 0x7f2968001150 con 0x7f29701094e0 2019-11-28T11:25:45.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f296f7fe700 1 -- 172.21.15.80:0/1671857153 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2950002e80 con 0x7f29701094e0 2019-11-28T11:25:45.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f296f7fe700 1 -- 172.21.15.80:0/1671857153 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152461715 0 0) 0x7f2964000c90 con 0x7f297010a3a0 2019-11-28T11:25:45.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f296f7fe700 1 -- 172.21.15.80:0/1671857153 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2950004220 con 0x7f297010a3a0 2019-11-28T11:25:45.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f2976d1a700 1 -- 172.21.15.80:0/1671857153 >> v1:172.21.15.174:6789/0 conn(0x7f297010a3a0 legacy=0x7f2970108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f2976d1a700 1 -- 172.21.15.80:0/1671857153 >> v1:172.21.15.80:6789/0 conn(0x7f29701094e0 legacy=0x7f2970167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f2976d1a700 1 -- 172.21.15.80:0/1671857153 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2970106190 con 0x7f297013dc00 2019-11-28T11:25:45.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f2976d1a700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f297013dc00 0x7f2970109e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2960054740 tx=0x7f2960054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f2976d1a700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f297013dc00 0x7f2970109e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2960054740 tx=0x7f2960054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f2976d1a700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f297013dc00 0x7f2970109e60 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f2960054740 tx=0x7f2960054ae0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:45.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f2976d1a700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f297013dc00 0x7f2970109e60 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f2960054740 tx=0x7f2960054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f296f7fe700 1 -- 172.21.15.80:0/1671857153 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2960008050 con 0x7f297013dc00 2019-11-28T11:25:45.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f2976d1a700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f297013dc00 0x7f2970109e60 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f2960054740 tx=0x7f2960054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f296f7fe700 1 -- 172.21.15.80:0/1671857153 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2960005710 con 0x7f297013dc00 2019-11-28T11:25:45.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f2976d1a700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f297013dc00 0x7f2970109e60 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f2960054740 tx=0x7f2960054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f297877d700 1 -- 172.21.15.80:0/1671857153 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2970106510 con 0x7f297013dc00 2019-11-28T11:25:45.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f296f7fe700 1 -- 172.21.15.80:0/1671857153 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2960008250 con 0x7f297013dc00 2019-11-28T11:25:45.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f297877d700 1 -- 172.21.15.80:0/1671857153 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2970106190 con 0x7f297013dc00 2019-11-28T11:25:45.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.647+0000 7f2976d1a700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f297013dc00 0x7f2970109e60 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f2960054740 tx=0x7f2960054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.648+0000 7f296f7fe700 1 -- 172.21.15.80:0/1671857153 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2960008050 con 0x7f297013dc00 2019-11-28T11:25:45.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.648+0000 7f2976d1a700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f297013dc00 0x7f2970109e60 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f2960054740 tx=0x7f2960054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.648+0000 7f296f7fe700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2950018750 0x7f295001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:45.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.648+0000 7f296f7fe700 1 -- 172.21.15.80:0/1671857153 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2960075e00 con 0x7f297013dc00 2019-11-28T11:25:45.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.648+0000 7f2976519700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2950018750 0x7f295001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:45.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.648+0000 7f2976519700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2950018750 0x7f295001abe0 crc :-1 s=READY pgs=112 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:45.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.655+0000 7f297877d700 1 -- 172.21.15.80:0/1671857153 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2970106510 con 0x7f297013dc00 2019-11-28T11:25:45.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.659+0000 7f2976d1a700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f297013dc00 0x7f2970109e60 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f2960054740 tx=0x7f2960054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.659+0000 7f296f7fe700 1 -- 172.21.15.80:0/1671857153 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2960005500 con 0x7f297013dc00 2019-11-28T11:25:45.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.833+0000 7f297877d700 1 -- 172.21.15.80:0/1671857153 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2970106190 con 0x7f297013dc00 2019-11-28T11:25:45.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.834+0000 7f2976d1a700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f297013dc00 0x7f2970109e60 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f2960054740 tx=0x7f2960054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:45.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.834+0000 7f296f7fe700 1 -- 172.21.15.80:0/1671857153 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14885 (secure 0 0 0) 0x7f2960008050 con 0x7f297013dc00 2019-11-28T11:25:45.857 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:45.857 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:20.933435+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:25:14.914696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-11-28T11:25:17.566323+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.838+0000 7f297877d700 1 -- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2950018750 msgr2=0x7f295001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.838+0000 7f297877d700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2950018750 0x7f295001abe0 crc :-1 s=READY pgs=112 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.838+0000 7f297877d700 1 -- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f297013dc00 msgr2=0x7f2970109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.838+0000 7f297877d700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f297013dc00 0x7f2970109e60 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f2960054740 tx=0x7f2960054ae0).stop 2019-11-28T11:25:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.839+0000 7f297877d700 1 -- 172.21.15.80:0/1671857153 shutdown_connections 2019-11-28T11:25:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.839+0000 7f297877d700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2950018750 0x7f295001abe0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.839+0000 7f297877d700 1 --2- 172.21.15.80:0/1671857153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f297013dc00 0x7f2970109e60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.839+0000 7f297877d700 1 -- 172.21.15.80:0/1671857153 shutdown_connections 2019-11-28T11:25:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.839+0000 7f297877d700 1 -- 172.21.15.80:0/1671857153 wait complete. 2019-11-28T11:25:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.839+0000 7f297877d700 1 -- 172.21.15.80:0/1671857153 >> 172.21.15.80:0/1671857153 conn(0x7f297011bfc0 msgr2=0x7f2970141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:45.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:14.914696+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:17.566323+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:25:45.870 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:25:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.975+0000 7f6bd12b7700 1 Processor -- start 2019-11-28T11:25:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.975+0000 7f6bd12b7700 1 -- start start 2019-11-28T11:25:45.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bd12b7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc15ed10 0x7f6bcc15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bd12b7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6bcc073020 0x7f6bcc071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bd12b7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bcc06db60 con 0x7f6bcc0734b0 2019-11-28T11:25:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bd12b7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bcc06f3d0 con 0x7f6bcc073020 2019-11-28T11:25:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bd12b7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc06fe00 con 0x7f6bcc15ed10 2019-11-28T11:25:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bcaffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6bcc073020 0x7f6bcc071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bcaffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6bcc073020 0x7f6bcc071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60062/0 (socket says 172.21.15.80:60062) 2019-11-28T11:25:46.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bcaffd700 1 -- 172.21.15.80:0/1232095724 learned_addr learned my addr 172.21.15.80:0/1232095724 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:46.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bcbfff700 1 --1- 172.21.15.80:0/1232095724 >> v1:172.21.15.80:6789/0 conn(0x7f6bcc0734b0 0x7f6bcc0723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59378/0 (socket says 172.21.15.80:59378) 2019-11-28T11:25:46.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bcb7fe700 1 --2- 172.21.15.80:0/1232095724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc15ed10 0x7f6bcc15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bcaffd700 1 -- 172.21.15.80:0/1232095724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc15ed10 msgr2=0x7f6bcc15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:46.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bcaffd700 1 --2- 172.21.15.80:0/1232095724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc15ed10 0x7f6bcc15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:46.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bcaffd700 1 -- 172.21.15.80:0/1232095724 >> v1:172.21.15.80:6789/0 conn(0x7f6bcc0734b0 legacy=0x7f6bcc0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bcaffd700 1 -- 172.21.15.80:0/1232095724 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc070760 con 0x7f6bcc073020 2019-11-28T11:25:46.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bca7fc700 1 -- 172.21.15.80:0/1232095724 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085756452 0 0) 0x7f6bc40009b0 con 0x7f6bcc0734b0 2019-11-28T11:25:46.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bcb7fe700 1 --2- 172.21.15.80:0/1232095724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc15ed10 0x7f6bcc15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:46.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bcaffd700 1 --2- 172.21.15.80:0/1232095724 >> v2:172.21.15.80:3300/0 conn(0x7f6bcc073020 0x7f6bcc071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6bbc00fac0 tx=0x7f6bbc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bcaffd700 1 --2- 172.21.15.80:0/1232095724 >> v2:172.21.15.80:3300/0 conn(0x7f6bcc073020 0x7f6bcc071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6bbc00fac0 tx=0x7f6bbc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bcaffd700 1 --2- 172.21.15.80:0/1232095724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bcc073020 0x7f6bcc071ea0 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7f6bbc00fac0 tx=0x7f6bbc00fe60).ready entity=mon.0 client_cookie=a5ce3a897593ff83 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:46.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bcaffd700 1 --2- 172.21.15.80:0/1232095724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bcc073020 0x7f6bcc071ea0 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f6bbc00fac0 tx=0x7f6bbc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bca7fc700 1 -- 172.21.15.80:0/1232095724 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bbc000ce0 con 0x7f6bcc073020 2019-11-28T11:25:46.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bcaffd700 1 --2- 172.21.15.80:0/1232095724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bcc073020 0x7f6bcc071ea0 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f6bbc00fac0 tx=0x7f6bbc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bcaffd700 1 --2- 172.21.15.80:0/1232095724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bcc073020 0x7f6bcc071ea0 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f6bbc00fac0 tx=0x7f6bbc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bca7fc700 1 -- 172.21.15.80:0/1232095724 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc001010 con 0x7f6bcc073020 2019-11-28T11:25:46.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bca7fc700 1 -- 172.21.15.80:0/1232095724 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bbc001720 con 0x7f6bcc073020 2019-11-28T11:25:46.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bd12b7700 1 -- 172.21.15.80:0/1232095724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bcc073020 msgr2=0x7f6bcc071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.976+0000 7f6bd12b7700 1 --2- 172.21.15.80:0/1232095724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bcc073020 0x7f6bcc071ea0 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7f6bbc00fac0 tx=0x7f6bbc00fe60).stop 2019-11-28T11:25:46.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.977+0000 7f6bd12b7700 1 -- 172.21.15.80:0/1232095724 shutdown_connections 2019-11-28T11:25:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.977+0000 7f6bd12b7700 1 --2- 172.21.15.80:0/1232095724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bcc073020 0x7f6bcc071ea0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.977+0000 7f6bd12b7700 1 --2- 172.21.15.80:0/1232095724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc15ed10 0x7f6bcc15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.977+0000 7f6bd12b7700 1 -- 172.21.15.80:0/1232095724 shutdown_connections 2019-11-28T11:25:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.977+0000 7f6bd12b7700 1 -- 172.21.15.80:0/1232095724 wait complete. 2019-11-28T11:25:46.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.977+0000 7f6bd12b7700 1 -- 172.21.15.80:0/1232095724 >> 172.21.15.80:0/1232095724 conn(0x7f6bcc061d20 msgr2=0x7f6bcc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:46.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.979+0000 7f6bd12b7700 1 Processor -- start 2019-11-28T11:25:46.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.980+0000 7f6bd12b7700 1 -- start start 2019-11-28T11:25:46.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.980+0000 7f6bd12b7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6bcc10e970 0x7f6bcc1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:46.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bd12b7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc107e30 0x7f6bcc167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:46.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bd12b7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bcc10c250 con 0x7f6bcc108cf0 2019-11-28T11:25:46.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bd12b7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bcc10e430 con 0x7f6bcc10e970 2019-11-28T11:25:46.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bd12b7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc105860 con 0x7f6bcc107e30 2019-11-28T11:25:46.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bcbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc107e30 0x7f6bcc167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bcb7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6bcc10e970 0x7f6bcc1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bcbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc107e30 0x7f6bcc167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:34096/0 (socket says 172.21.15.80:34096) 2019-11-28T11:25:46.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bcb7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6bcc10e970 0x7f6bcc1087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:46720/0 (socket says 172.21.15.80:46720) 2019-11-28T11:25:46.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bcbfff700 1 -- 172.21.15.80:0/1996447316 learned_addr learned my addr 172.21.15.80:0/1996447316 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:46.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bcbfff700 1 -- 172.21.15.80:0/1996447316 >> v2:172.21.15.174:3300/0 conn(0x7f6bcc10e970 msgr2=0x7f6bcc1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bcbfff700 1 --2- 172.21.15.80:0/1996447316 >> v2:172.21.15.174:3300/0 conn(0x7f6bcc10e970 0x7f6bcc1087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bcbfff700 1 -- 172.21.15.80:0/1996447316 >> v1:172.21.15.174:6789/0 conn(0x7f6bcc108cf0 legacy=0x7f6bcc107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bcbfff700 1 -- 172.21.15.80:0/1996447316 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc105ef0 con 0x7f6bcc107e30 2019-11-28T11:25:46.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bcbfff700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc107e30 0x7f6bcc167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6bc40103e0 tx=0x7f6bc4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bcbfff700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc107e30 0x7f6bcc167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6bc40103e0 tx=0x7f6bc4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bcbfff700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc107e30 0x7f6bcc167d70 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f6bc40103e0 tx=0x7f6bc4010260).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bcbfff700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc107e30 0x7f6bcc167d70 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f6bc40103e0 tx=0x7f6bc4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bcbfff700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc107e30 0x7f6bcc167d70 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f6bc40103e0 tx=0x7f6bc4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bc3fff700 1 -- 172.21.15.80:0/1996447316 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bc4000940 con 0x7f6bcc107e30 2019-11-28T11:25:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bcbfff700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc107e30 0x7f6bcc167d70 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f6bc40103e0 tx=0x7f6bc4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bc3fff700 1 -- 172.21.15.80:0/1996447316 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc4001100 con 0x7f6bcc107e30 2019-11-28T11:25:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bd12b7700 1 -- 172.21.15.80:0/1996447316 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bcc106270 con 0x7f6bcc107e30 2019-11-28T11:25:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.981+0000 7f6bc3fff700 1 -- 172.21.15.80:0/1996447316 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bc40017d0 con 0x7f6bcc107e30 2019-11-28T11:25:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.982+0000 7f6bd12b7700 1 -- 172.21.15.80:0/1996447316 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc105ef0 con 0x7f6bcc107e30 2019-11-28T11:25:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.982+0000 7f6bcbfff700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc107e30 0x7f6bcc167d70 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f6bc40103e0 tx=0x7f6bc4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.982+0000 7f6bc3fff700 1 -- 172.21.15.80:0/1996447316 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6bc4000940 con 0x7f6bcc107e30 2019-11-28T11:25:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.982+0000 7f6bcbfff700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc107e30 0x7f6bcc167d70 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f6bc40103e0 tx=0x7f6bc4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.982+0000 7f6bc3fff700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bb0018730 0x7f6bb001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:46.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.982+0000 7f6bc3fff700 1 -- 172.21.15.80:0/1996447316 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f6bc4031a40 con 0x7f6bcc107e30 2019-11-28T11:25:46.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.982+0000 7f6bcb7fe700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bb0018730 0x7f6bb001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.983+0000 7f6bcb7fe700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bb0018730 0x7f6bb001abc0 crc :-1 s=READY pgs=113 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.990+0000 7f6bd12b7700 1 -- 172.21.15.80:0/1996447316 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bcc106270 con 0x7f6bcc107e30 2019-11-28T11:25:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.994+0000 7f6bcbfff700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc107e30 0x7f6bcc167d70 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f6bc40103e0 tx=0x7f6bc4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:45.994+0000 7f6bc3fff700 1 -- 172.21.15.80:0/1996447316 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6bc4000ef0 con 0x7f6bcc107e30 2019-11-28T11:25:46.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.160+0000 7f6bd12b7700 1 -- 172.21.15.80:0/1996447316 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f6bcc105ef0 con 0x7f6bcc107e30 2019-11-28T11:25:46.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.160+0000 7f6bcbfff700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc107e30 0x7f6bcc167d70 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f6bc40103e0 tx=0x7f6bc4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.160+0000 7f6bc3fff700 1 -- 172.21.15.80:0/1996447316 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6bc4000940 con 0x7f6bcc107e30 2019-11-28T11:25:46.181 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:46.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.162+0000 7f6bd12b7700 1 -- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bb0018730 msgr2=0x7f6bb001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.162+0000 7f6bd12b7700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bb0018730 0x7f6bb001abc0 crc :-1 s=READY pgs=113 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.162+0000 7f6bd12b7700 1 -- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc107e30 msgr2=0x7f6bcc167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.162+0000 7f6bd12b7700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc107e30 0x7f6bcc167d70 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f6bc40103e0 tx=0x7f6bc4010260).stop 2019-11-28T11:25:46.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.162+0000 7f6bd12b7700 1 -- 172.21.15.80:0/1996447316 shutdown_connections 2019-11-28T11:25:46.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.163+0000 7f6bd12b7700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bcc107e30 0x7f6bcc167d70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.163+0000 7f6bd12b7700 1 --2- 172.21.15.80:0/1996447316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bb0018730 0x7f6bb001abc0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.163+0000 7f6bd12b7700 1 --2- 172.21.15.80:0/1996447316 >> v2:172.21.15.174:3300/0 conn(0x7f6bcc10e970 0x7f6bcc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.163+0000 7f6bd12b7700 1 -- 172.21.15.80:0/1996447316 shutdown_connections 2019-11-28T11:25:46.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.163+0000 7f6bd12b7700 1 -- 172.21.15.80:0/1996447316 wait complete. 2019-11-28T11:25:46.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.163+0000 7f6bd12b7700 1 -- 172.21.15.80:0/1996447316 >> 172.21.15.80:0/1996447316 conn(0x7f6bcc15e2d0 msgr2=0x7f6bcc147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:46.193 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:25:46.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.296+0000 7fedfdc9f700 1 Processor -- start 2019-11-28T11:25:46.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.296+0000 7fedfdc9f700 1 -- start start 2019-11-28T11:25:46.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.297+0000 7fedfdc9f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fedf815f100 0x7fedf806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:46.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.297+0000 7fedfdc9f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedf806c2f0 0x7fedf806c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:46.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.297+0000 7fedfdc9f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf806db60 con 0x7fedf815ed10 2019-11-28T11:25:46.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.297+0000 7fedfdc9f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf806fe00 con 0x7fedf815f100 2019-11-28T11:25:46.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.297+0000 7fedfdc9f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80700d0 con 0x7fedf806c2f0 2019-11-28T11:25:46.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.297+0000 7fedf7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fedf815ed10 0x7fedf8073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59388/0 (socket says 172.21.15.80:59388) 2019-11-28T11:25:46.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.297+0000 7fedf7fff700 1 -- 172.21.15.80:0/3935582238 learned_addr learned my addr 172.21.15.80:0/3935582238 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:46.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedeffff700 1 --2- 172.21.15.80:0/3935582238 >> v2:172.21.15.174:3300/0 conn(0x7fedf815f100 0x7fedf806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedfca3d700 1 --2- 172.21.15.80:0/3935582238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedf806c2f0 0x7fedf806c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedf77fe700 1 -- 172.21.15.80:0/3935582238 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093135739 0 0) 0x7fede8001150 con 0x7fedf815ed10 2019-11-28T11:25:46.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedf77fe700 1 -- 172.21.15.80:0/3935582238 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedd8002e80 con 0x7fedf815ed10 2019-11-28T11:25:46.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedfca3d700 1 -- 172.21.15.80:0/3935582238 >> v2:172.21.15.174:3300/0 conn(0x7fedf815f100 msgr2=0x7fedf806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:46.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedfca3d700 1 --2- 172.21.15.80:0/3935582238 >> v2:172.21.15.174:3300/0 conn(0x7fedf815f100 0x7fedf806bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:46.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedfca3d700 1 -- 172.21.15.80:0/3935582238 >> v1:172.21.15.80:6789/0 conn(0x7fedf815ed10 legacy=0x7fedf8073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedfca3d700 1 -- 172.21.15.80:0/3935582238 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf8070760 con 0x7fedf806c2f0 2019-11-28T11:25:46.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedeffff700 1 --2- 172.21.15.80:0/3935582238 >> v2:172.21.15.174:3300/0 conn(0x7fedf815f100 0x7fedf806bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:46.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedfca3d700 1 --2- 172.21.15.80:0/3935582238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedf806c2f0 0x7fedf806c740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fedf000b300 tx=0x7fedf000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedfca3d700 1 --2- 172.21.15.80:0/3935582238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedf806c2f0 0x7fedf806c740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fedf000b300 tx=0x7fedf000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedfca3d700 1 --2- 172.21.15.80:0/3935582238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedf806c2f0 0x7fedf806c740 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fedf000b300 tx=0x7fedf000bb10).ready entity=mon.2 client_cookie=b4b4aad2afa6208b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:46.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedfca3d700 1 --2- 172.21.15.80:0/3935582238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedf806c2f0 0x7fedf806c740 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fedf000b300 tx=0x7fedf000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedfca3d700 1 --2- 172.21.15.80:0/3935582238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedf806c2f0 0x7fedf806c740 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fedf000b300 tx=0x7fedf000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedf77fe700 1 -- 172.21.15.80:0/3935582238 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedf0000f40 con 0x7fedf806c2f0 2019-11-28T11:25:46.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedfca3d700 1 --2- 172.21.15.80:0/3935582238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedf806c2f0 0x7fedf806c740 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fedf000b300 tx=0x7fedf000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedf77fe700 1 -- 172.21.15.80:0/3935582238 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf0009b70 con 0x7fedf806c2f0 2019-11-28T11:25:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedf77fe700 1 -- 172.21.15.80:0/3935582238 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedf000a240 con 0x7fedf806c2f0 2019-11-28T11:25:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedfdc9f700 1 -- 172.21.15.80:0/3935582238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedf806c2f0 msgr2=0x7fedf806c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.298+0000 7fedfdc9f700 1 --2- 172.21.15.80:0/3935582238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedf806c2f0 0x7fedf806c740 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fedf000b300 tx=0x7fedf000bb10).stop 2019-11-28T11:25:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.299+0000 7fedfdc9f700 1 -- 172.21.15.80:0/3935582238 shutdown_connections 2019-11-28T11:25:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.299+0000 7fedfdc9f700 1 --2- 172.21.15.80:0/3935582238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedf806c2f0 0x7fedf806c740 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.299+0000 7fedfdc9f700 1 --2- 172.21.15.80:0/3935582238 >> v2:172.21.15.174:3300/0 conn(0x7fedf815f100 0x7fedf806bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:46.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.299+0000 7fedfdc9f700 1 -- 172.21.15.80:0/3935582238 shutdown_connections 2019-11-28T11:25:46.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.299+0000 7fedfdc9f700 1 -- 172.21.15.80:0/3935582238 wait complete. 2019-11-28T11:25:46.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.299+0000 7fedfdc9f700 1 -- 172.21.15.80:0/3935582238 >> 172.21.15.80:0/3935582238 conn(0x7fedf8061d20 msgr2=0x7fedf80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:46.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.301+0000 7fedfdc9f700 1 Processor -- start 2019-11-28T11:25:46.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.301+0000 7fedfdc9f700 1 -- start start 2019-11-28T11:25:46.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.302+0000 7fedfdc9f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fedf81079b0 0x7fedf8107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:46.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.302+0000 7fedfdc9f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fedf8108380 0x7fedf8168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:46.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.302+0000 7fedfdc9f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf8148e00 con 0x7fedf8148320 2019-11-28T11:25:46.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.302+0000 7fedfdc9f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf813aa20 con 0x7fedf81079b0 2019-11-28T11:25:46.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.302+0000 7fedfdc9f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf813acf0 con 0x7fedf8108380 2019-11-28T11:25:46.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.302+0000 7fedeffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fedf81079b0 0x7fedf8107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.302+0000 7fedeffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fedf81079b0 0x7fedf8107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60080/0 (socket says 172.21.15.80:60080) 2019-11-28T11:25:46.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.302+0000 7fedeffff700 1 -- 172.21.15.80:0/1888400033 learned_addr learned my addr 172.21.15.80:0/1888400033 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:46.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.302+0000 7fedfca3d700 1 --2- 172.21.15.80:0/1888400033 >> v2:172.21.15.174:3300/0 conn(0x7fedf8108380 0x7fedf8168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.303+0000 7fedeffff700 1 -- 172.21.15.80:0/1888400033 >> v2:172.21.15.174:3300/0 conn(0x7fedf8108380 msgr2=0x7fedf8168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.303+0000 7fedeffff700 1 --2- 172.21.15.80:0/1888400033 >> v2:172.21.15.174:3300/0 conn(0x7fedf8108380 0x7fedf8168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.303+0000 7fedeffff700 1 -- 172.21.15.80:0/1888400033 >> v1:172.21.15.80:6789/0 conn(0x7fedf8148320 legacy=0x7fedf810ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.303+0000 7fedeffff700 1 -- 172.21.15.80:0/1888400033 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf810c490 con 0x7fedf81079b0 2019-11-28T11:25:46.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.303+0000 7fedeffff700 1 --2- 172.21.15.80:0/1888400033 >> v2:172.21.15.80:3300/0 conn(0x7fedf81079b0 0x7fedf8107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fede0010410 tx=0x7fede00107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.303+0000 7fedeffff700 1 --2- 172.21.15.80:0/1888400033 >> v2:172.21.15.80:3300/0 conn(0x7fedf81079b0 0x7fedf8107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fede0010410 tx=0x7fede00107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.303+0000 7fedeffff700 1 --2- 172.21.15.80:0/1888400033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedf81079b0 0x7fedf8107e40 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7fede0010410 tx=0x7fede00107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:46.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.303+0000 7fedeffff700 1 --2- 172.21.15.80:0/1888400033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedf81079b0 0x7fedf8107e40 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fede0010410 tx=0x7fede00107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.303+0000 7fedf57fa700 1 -- 172.21.15.80:0/1888400033 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fede000a8c0 con 0x7fedf81079b0 2019-11-28T11:25:46.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.303+0000 7fedeffff700 1 --2- 172.21.15.80:0/1888400033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedf81079b0 0x7fedf8107e40 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fede0010410 tx=0x7fede00107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.303+0000 7fedeffff700 1 --2- 172.21.15.80:0/1888400033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedf81079b0 0x7fedf8107e40 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fede0010410 tx=0x7fede00107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.303+0000 7fedf57fa700 1 -- 172.21.15.80:0/1888400033 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede0009770 con 0x7fedf81079b0 2019-11-28T11:25:46.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.303+0000 7fedf57fa700 1 -- 172.21.15.80:0/1888400033 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fede0009e00 con 0x7fedf81079b0 2019-11-28T11:25:46.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.303+0000 7fedfdc9f700 1 -- 172.21.15.80:0/1888400033 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf810c810 con 0x7fedf81079b0 2019-11-28T11:25:46.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.303+0000 7fedfdc9f700 1 -- 172.21.15.80:0/1888400033 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf8108820 con 0x7fedf81079b0 2019-11-28T11:25:46.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.303+0000 7fedeffff700 1 --2- 172.21.15.80:0/1888400033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedf81079b0 0x7fedf8107e40 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fede0010410 tx=0x7fede00107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.304+0000 7fedf57fa700 1 -- 172.21.15.80:0/1888400033 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fede0009960 con 0x7fedf81079b0 2019-11-28T11:25:46.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.304+0000 7fedeffff700 1 --2- 172.21.15.80:0/1888400033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedf81079b0 0x7fedf8107e40 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fede0010410 tx=0x7fede00107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.304+0000 7fedf57fa700 1 --2- 172.21.15.80:0/1888400033 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fedd0018730 0x7fedd001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:46.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.304+0000 7fedf57fa700 1 -- 172.21.15.80:0/1888400033 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fede0031b10 con 0x7fedf81079b0 2019-11-28T11:25:46.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.304+0000 7fedf7fff700 1 --2- 172.21.15.80:0/1888400033 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fedd0018730 0x7fedd001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.304+0000 7fedf7fff700 1 --2- 172.21.15.80:0/1888400033 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fedd0018730 0x7fedd001abc0 crc :-1 s=READY pgs=114 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:46.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.311+0000 7fedfdc9f700 1 -- 172.21.15.80:0/1888400033 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf810c490 con 0x7fedf81079b0 2019-11-28T11:25:46.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.315+0000 7fedeffff700 1 --2- 172.21.15.80:0/1888400033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedf81079b0 0x7fedf8107e40 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fede0010410 tx=0x7fede00107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.315+0000 7fedf57fa700 1 -- 172.21.15.80:0/1888400033 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fede00175c0 con 0x7fedf81079b0 2019-11-28T11:25:46.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.482+0000 7fedfdc9f700 1 -- 172.21.15.80:0/1888400033 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fedf810c810 con 0x7fedf81079b0 2019-11-28T11:25:46.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.483+0000 7fedeffff700 1 --2- 172.21.15.80:0/1888400033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedf81079b0 0x7fedf8107e40 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fede0010410 tx=0x7fede00107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.483+0000 7fedf57fa700 1 -- 172.21.15.80:0/1888400033 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fede0009960 con 0x7fedf81079b0 2019-11-28T11:25:46.504 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:46.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.485+0000 7fedfdc9f700 1 -- 172.21.15.80:0/1888400033 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fedd0018730 msgr2=0x7fedd001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.485+0000 7fedfdc9f700 1 --2- 172.21.15.80:0/1888400033 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fedd0018730 0x7fedd001abc0 crc :-1 s=READY pgs=114 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.485+0000 7fedfdc9f700 1 -- 172.21.15.80:0/1888400033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedf81079b0 msgr2=0x7fedf8107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.485+0000 7fedfdc9f700 1 --2- 172.21.15.80:0/1888400033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedf81079b0 0x7fedf8107e40 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7fede0010410 tx=0x7fede00107b0).stop 2019-11-28T11:25:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.485+0000 7fedfdc9f700 1 -- 172.21.15.80:0/1888400033 shutdown_connections 2019-11-28T11:25:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.485+0000 7fedfdc9f700 1 --2- 172.21.15.80:0/1888400033 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fedd0018730 0x7fedd001abc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.485+0000 7fedfdc9f700 1 --2- 172.21.15.80:0/1888400033 >> v2:172.21.15.174:3300/0 conn(0x7fedf8108380 0x7fedf8168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.485+0000 7fedfdc9f700 1 --2- 172.21.15.80:0/1888400033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedf81079b0 0x7fedf8107e40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.485+0000 7fedfdc9f700 1 -- 172.21.15.80:0/1888400033 shutdown_connections 2019-11-28T11:25:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.485+0000 7fedfdc9f700 1 -- 172.21.15.80:0/1888400033 wait complete. 2019-11-28T11:25:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.485+0000 7fedfdc9f700 1 -- 172.21.15.80:0/1888400033 >> 172.21.15.80:0/1888400033 conn(0x7fedf815e2d0 msgr2=0x7fedf8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:46.516 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:25:46.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.618+0000 7fa213a8b700 1 Processor -- start 2019-11-28T11:25:46.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.618+0000 7fa213a8b700 1 -- start start 2019-11-28T11:25:46.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.619+0000 7fa213a8b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa20c15f100 0x7fa20c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:46.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.619+0000 7fa213a8b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa20c06c2f0 0x7fa20c06c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:46.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.619+0000 7fa213a8b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20c06db60 con 0x7fa20c15ed10 2019-11-28T11:25:46.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.619+0000 7fa213a8b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20c06fe00 con 0x7fa20c15f100 2019-11-28T11:25:46.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.619+0000 7fa213a8b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c0700d0 con 0x7fa20c06c2f0 2019-11-28T11:25:46.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.619+0000 7fa212028700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa20c15ed10 0x7fa20c073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59402/0 (socket says 172.21.15.80:59402) 2019-11-28T11:25:46.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.619+0000 7fa212028700 1 -- 172.21.15.80:0/1922173548 learned_addr learned my addr 172.21.15.80:0/1922173548 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:46.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa212829700 1 --2- 172.21.15.80:0/1922173548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa20c06c2f0 0x7fa20c06c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa211827700 1 --2- 172.21.15.80:0/1922173548 >> v2:172.21.15.174:3300/0 conn(0x7fa20c15f100 0x7fa20c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa211026700 1 -- 172.21.15.80:0/1922173548 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740538912 0 0) 0x7fa1f40014d0 con 0x7fa20c15ed10 2019-11-28T11:25:46.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa211026700 1 -- 172.21.15.80:0/1922173548 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1f8002e80 con 0x7fa20c15ed10 2019-11-28T11:25:46.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa212829700 1 -- 172.21.15.80:0/1922173548 >> v2:172.21.15.174:3300/0 conn(0x7fa20c15f100 msgr2=0x7fa20c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:46.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa212829700 1 --2- 172.21.15.80:0/1922173548 >> v2:172.21.15.174:3300/0 conn(0x7fa20c15f100 0x7fa20c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:46.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa212829700 1 -- 172.21.15.80:0/1922173548 >> v1:172.21.15.80:6789/0 conn(0x7fa20c15ed10 legacy=0x7fa20c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa212829700 1 -- 172.21.15.80:0/1922173548 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c070760 con 0x7fa20c06c2f0 2019-11-28T11:25:46.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa211827700 1 --2- 172.21.15.80:0/1922173548 >> v2:172.21.15.174:3300/0 conn(0x7fa20c15f100 0x7fa20c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:46.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa212829700 1 --2- 172.21.15.80:0/1922173548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa20c06c2f0 0x7fa20c06c740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa20400af80 tx=0x7fa20400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa212829700 1 --2- 172.21.15.80:0/1922173548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa20c06c2f0 0x7fa20c06c740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa20400af80 tx=0x7fa20400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa212829700 1 --2- 172.21.15.80:0/1922173548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa20c06c2f0 0x7fa20c06c740 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fa20400af80 tx=0x7fa20400b790).ready entity=mon.2 client_cookie=ba8b9887db6a7bda server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:46.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa212829700 1 --2- 172.21.15.80:0/1922173548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa20c06c2f0 0x7fa20c06c740 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fa20400af80 tx=0x7fa20400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa211026700 1 -- 172.21.15.80:0/1922173548 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa204000bc0 con 0x7fa20c06c2f0 2019-11-28T11:25:46.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa212829700 1 --2- 172.21.15.80:0/1922173548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa20c06c2f0 0x7fa20c06c740 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fa20400af80 tx=0x7fa20400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa212829700 1 --2- 172.21.15.80:0/1922173548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa20c06c2f0 0x7fa20c06c740 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fa20400af80 tx=0x7fa20400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa211026700 1 -- 172.21.15.80:0/1922173548 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2040097f0 con 0x7fa20c06c2f0 2019-11-28T11:25:46.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa211026700 1 -- 172.21.15.80:0/1922173548 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa204009ec0 con 0x7fa20c06c2f0 2019-11-28T11:25:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa213a8b700 1 -- 172.21.15.80:0/1922173548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa20c06c2f0 msgr2=0x7fa20c06c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.620+0000 7fa213a8b700 1 --2- 172.21.15.80:0/1922173548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa20c06c2f0 0x7fa20c06c740 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fa20400af80 tx=0x7fa20400b790).stop 2019-11-28T11:25:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.621+0000 7fa213a8b700 1 -- 172.21.15.80:0/1922173548 shutdown_connections 2019-11-28T11:25:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.621+0000 7fa213a8b700 1 --2- 172.21.15.80:0/1922173548 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa20c06c2f0 0x7fa20c06c740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.621+0000 7fa213a8b700 1 --2- 172.21.15.80:0/1922173548 >> v2:172.21.15.174:3300/0 conn(0x7fa20c15f100 0x7fa20c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:46.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.621+0000 7fa213a8b700 1 -- 172.21.15.80:0/1922173548 shutdown_connections 2019-11-28T11:25:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.621+0000 7fa213a8b700 1 -- 172.21.15.80:0/1922173548 wait complete. 2019-11-28T11:25:46.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.621+0000 7fa213a8b700 1 -- 172.21.15.80:0/1922173548 >> 172.21.15.80:0/1922173548 conn(0x7fa20c061d20 msgr2=0x7fa20c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:46.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.623+0000 7fa213a8b700 1 Processor -- start 2019-11-28T11:25:46.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.623+0000 7fa213a8b700 1 -- start start 2019-11-28T11:25:46.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.624+0000 7fa213a8b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa20c10ed60 0x7fa20c10f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:46.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.624+0000 7fa213a8b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20c10c250 con 0x7fa20c10e970 2019-11-28T11:25:46.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.624+0000 7fa213a8b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20c10c6d0 con 0x7fa20c10f730 2019-11-28T11:25:46.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.624+0000 7fa213a8b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20c10e430 con 0x7fa20c10ed60 2019-11-28T11:25:46.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.624+0000 7fa212028700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa20c10e970 0x7fa20c1087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59408/0 (socket says 172.21.15.80:59408) 2019-11-28T11:25:46.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.624+0000 7fa212028700 1 -- 172.21.15.80:0/1588389768 learned_addr learned my addr 172.21.15.80:0/1588389768 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:46.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.624+0000 7fa211827700 1 --2- 172.21.15.80:0/1588389768 >> v2:172.21.15.174:3300/0 conn(0x7fa20c10ed60 0x7fa20c10f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa20affd700 1 -- 172.21.15.80:0/1588389768 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678864913 0 0) 0x7fa1f40014d0 con 0x7fa20c10e970 2019-11-28T11:25:46.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa20affd700 1 -- 172.21.15.80:0/1588389768 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1f0002e80 con 0x7fa20c10e970 2019-11-28T11:25:46.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa20affd700 1 -- 172.21.15.80:0/1588389768 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880205614 0 0) 0x7fa2040095b0 con 0x7fa20c10f730 2019-11-28T11:25:46.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa211827700 1 -- 172.21.15.80:0/1588389768 >> v1:172.21.15.174:6789/0 conn(0x7fa20c10f730 legacy=0x7fa20c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa211827700 1 -- 172.21.15.80:0/1588389768 >> v1:172.21.15.80:6789/0 conn(0x7fa20c10e970 legacy=0x7fa20c1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa211827700 1 -- 172.21.15.80:0/1588389768 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c105ef0 con 0x7fa20c10ed60 2019-11-28T11:25:46.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa211827700 1 --2- 172.21.15.80:0/1588389768 >> v2:172.21.15.174:3300/0 conn(0x7fa20c10ed60 0x7fa20c10f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1fc0103a0 tx=0x7fa1fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa211827700 1 --2- 172.21.15.80:0/1588389768 >> v2:172.21.15.174:3300/0 conn(0x7fa20c10ed60 0x7fa20c10f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1fc0103a0 tx=0x7fa1fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa211827700 1 --2- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20c10ed60 0x7fa20c10f1f0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fa1fc0103a0 tx=0x7fa1fc010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:46.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa211827700 1 --2- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20c10ed60 0x7fa20c10f1f0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fa1fc0103a0 tx=0x7fa1fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa20affd700 1 -- 172.21.15.80:0/1588389768 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1fc000940 con 0x7fa20c10ed60 2019-11-28T11:25:46.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa211827700 1 --2- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20c10ed60 0x7fa20c10f1f0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fa1fc0103a0 tx=0x7fa1fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa211827700 1 --2- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20c10ed60 0x7fa20c10f1f0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fa1fc0103a0 tx=0x7fa1fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa20affd700 1 -- 172.21.15.80:0/1588389768 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1fc00dff0 con 0x7fa20c10ed60 2019-11-28T11:25:46.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa213a8b700 1 -- 172.21.15.80:0/1588389768 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20c106270 con 0x7fa20c10ed60 2019-11-28T11:25:46.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa20affd700 1 -- 172.21.15.80:0/1588389768 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1fc00e6c0 con 0x7fa20c10ed60 2019-11-28T11:25:46.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.625+0000 7fa213a8b700 1 -- 172.21.15.80:0/1588389768 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20c105ef0 con 0x7fa20c10ed60 2019-11-28T11:25:46.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.626+0000 7fa211827700 1 --2- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20c10ed60 0x7fa20c10f1f0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fa1fc0103a0 tx=0x7fa1fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.626+0000 7fa20affd700 1 -- 172.21.15.80:0/1588389768 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa1fc00db00 con 0x7fa20c10ed60 2019-11-28T11:25:46.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.626+0000 7fa211827700 1 --2- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20c10ed60 0x7fa20c10f1f0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fa1fc0103a0 tx=0x7fa1fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.626+0000 7fa20affd700 1 --2- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa1f0018780 0x7fa1f001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:46.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.626+0000 7fa20affd700 1 -- 172.21.15.80:0/1588389768 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fa1fc031a20 con 0x7fa20c10ed60 2019-11-28T11:25:46.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.626+0000 7fa212028700 1 --2- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa1f0018780 0x7fa1f001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.626+0000 7fa212028700 1 --2- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa1f0018780 0x7fa1f001abf0 crc :-1 s=READY pgs=115 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:46.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.634+0000 7fa213a8b700 1 -- 172.21.15.80:0/1588389768 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20c106270 con 0x7fa20c10ed60 2019-11-28T11:25:46.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.637+0000 7fa211827700 1 --2- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20c10ed60 0x7fa20c10f1f0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fa1fc0103a0 tx=0x7fa1fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.637+0000 7fa20affd700 1 -- 172.21.15.80:0/1588389768 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa1fc000940 con 0x7fa20c10ed60 2019-11-28T11:25:46.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.803+0000 7fa213a8b700 1 -- 172.21.15.80:0/1588389768 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fa20c105ef0 con 0x7fa20c10ed60 2019-11-28T11:25:46.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.804+0000 7fa211827700 1 --2- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20c10ed60 0x7fa20c10f1f0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fa1fc0103a0 tx=0x7fa1fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.804+0000 7fa20affd700 1 -- 172.21.15.80:0/1588389768 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa1fc00da10 con 0x7fa20c10ed60 2019-11-28T11:25:46.830 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:46.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.806+0000 7fa213a8b700 1 -- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa1f0018780 msgr2=0x7fa1f001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.806+0000 7fa213a8b700 1 --2- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa1f0018780 0x7fa1f001abf0 crc :-1 s=READY pgs=115 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.806+0000 7fa213a8b700 1 -- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20c10ed60 msgr2=0x7fa20c10f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.806+0000 7fa213a8b700 1 --2- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20c10ed60 0x7fa20c10f1f0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fa1fc0103a0 tx=0x7fa1fc010740).stop 2019-11-28T11:25:46.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.806+0000 7fa213a8b700 1 -- 172.21.15.80:0/1588389768 shutdown_connections 2019-11-28T11:25:46.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.806+0000 7fa213a8b700 1 --2- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa1f0018780 0x7fa1f001abf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.806+0000 7fa213a8b700 1 --2- 172.21.15.80:0/1588389768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20c10ed60 0x7fa20c10f1f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.806+0000 7fa213a8b700 1 -- 172.21.15.80:0/1588389768 shutdown_connections 2019-11-28T11:25:46.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.806+0000 7fa213a8b700 1 -- 172.21.15.80:0/1588389768 wait complete. 2019-11-28T11:25:46.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.806+0000 7fa213a8b700 1 -- 172.21.15.80:0/1588389768 >> 172.21.15.80:0/1588389768 conn(0x7fa20c15e2d0 msgr2=0x7fa20c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:46.839 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:46.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.958+0000 7f6815b25700 1 Processor -- start 2019-11-28T11:25:46.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.958+0000 7f6815b25700 1 -- start start 2019-11-28T11:25:46.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.959+0000 7f6815b25700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f681006c0a0 0x7f6810072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:46.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.959+0000 7f6815b25700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68100734e0 0x7f6810071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:46.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.959+0000 7f6815b25700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f681006db00 con 0x7f6810072360 2019-11-28T11:25:46.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.959+0000 7f6815b25700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f681006fd60 con 0x7f681006c0a0 2019-11-28T11:25:46.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.959+0000 7f6815b25700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6810070030 con 0x7f68100734e0 2019-11-28T11:25:46.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.959+0000 7f68148c3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6810072360 0x7f681006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59420/0 (socket says 172.21.15.80:59420) 2019-11-28T11:25:46.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.959+0000 7f68148c3700 1 -- 172.21.15.80:0/61098015 learned_addr learned my addr 172.21.15.80:0/61098015 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:46.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.959+0000 7f680ffff700 1 --2- 172.21.15.80:0/61098015 >> v2:172.21.15.174:3300/0 conn(0x7f681006c0a0 0x7f6810072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.959+0000 7f6807fff700 1 --2- 172.21.15.80:0/61098015 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68100734e0 0x7f6810071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f680f7fe700 1 -- 172.21.15.80:0/61098015 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085077355 0 0) 0x7f68080014d0 con 0x7f6810072360 2019-11-28T11:25:46.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f680f7fe700 1 -- 172.21.15.80:0/61098015 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67fc002e80 con 0x7f6810072360 2019-11-28T11:25:46.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f680ffff700 1 -- 172.21.15.80:0/61098015 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68100734e0 msgr2=0x7f6810071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:46.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f680ffff700 1 --2- 172.21.15.80:0/61098015 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68100734e0 0x7f6810071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:46.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f680ffff700 1 -- 172.21.15.80:0/61098015 >> v1:172.21.15.80:6789/0 conn(0x7f6810072360 legacy=0x7f681006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f680ffff700 1 -- 172.21.15.80:0/61098015 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68100706c0 con 0x7f681006c0a0 2019-11-28T11:25:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f6807fff700 1 --2- 172.21.15.80:0/61098015 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68100734e0 0x7f6810071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f680ffff700 1 --2- 172.21.15.80:0/61098015 >> v2:172.21.15.174:3300/0 conn(0x7f681006c0a0 0x7f6810072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f680000af50 tx=0x7f680000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f680ffff700 1 --2- 172.21.15.80:0/61098015 >> v2:172.21.15.174:3300/0 conn(0x7f681006c0a0 0x7f6810072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f680000af50 tx=0x7f680000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f680ffff700 1 --2- 172.21.15.80:0/61098015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f681006c0a0 0x7f6810072fa0 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7f680000af50 tx=0x7f680000b760).ready entity=mon.1 client_cookie=b1321e88de1fb18d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f680ffff700 1 --2- 172.21.15.80:0/61098015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f681006c0a0 0x7f6810072fa0 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f680000af50 tx=0x7f680000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f680f7fe700 1 -- 172.21.15.80:0/61098015 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6800007210 con 0x7f681006c0a0 2019-11-28T11:25:46.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f680ffff700 1 --2- 172.21.15.80:0/61098015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f681006c0a0 0x7f6810072fa0 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f680000af50 tx=0x7f680000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f680ffff700 1 --2- 172.21.15.80:0/61098015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f681006c0a0 0x7f6810072fa0 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f680000af50 tx=0x7f680000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f680f7fe700 1 -- 172.21.15.80:0/61098015 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68000099b0 con 0x7f681006c0a0 2019-11-28T11:25:46.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f680f7fe700 1 -- 172.21.15.80:0/61098015 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f680000a080 con 0x7f681006c0a0 2019-11-28T11:25:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f6815b25700 1 -- 172.21.15.80:0/61098015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f681006c0a0 msgr2=0x7f6810072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.960+0000 7f6815b25700 1 --2- 172.21.15.80:0/61098015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f681006c0a0 0x7f6810072fa0 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7f680000af50 tx=0x7f680000b760).stop 2019-11-28T11:25:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.961+0000 7f6815b25700 1 -- 172.21.15.80:0/61098015 shutdown_connections 2019-11-28T11:25:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.961+0000 7f6815b25700 1 --2- 172.21.15.80:0/61098015 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68100734e0 0x7f6810071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.961+0000 7f6815b25700 1 --2- 172.21.15.80:0/61098015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f681006c0a0 0x7f6810072fa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.961+0000 7f6815b25700 1 -- 172.21.15.80:0/61098015 shutdown_connections 2019-11-28T11:25:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.961+0000 7f6815b25700 1 -- 172.21.15.80:0/61098015 wait complete. 2019-11-28T11:25:46.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.961+0000 7f6815b25700 1 -- 172.21.15.80:0/61098015 >> 172.21.15.80:0/61098015 conn(0x7f6810061cf0 msgr2=0x7f6810064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:46.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.963+0000 7f6815b25700 1 Processor -- start 2019-11-28T11:25:46.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.963+0000 7f6815b25700 1 -- start start 2019-11-28T11:25:46.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.964+0000 7f6815b25700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f681013dc00 0x7f6810109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:46.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.964+0000 7f6815b25700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f681010a3a0 0x7f6810108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:46.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.964+0000 7f6815b25700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6810109220 0x7f6810109680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:46.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.964+0000 7f6815b25700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6810104e00 con 0x7f681010a3a0 2019-11-28T11:25:46.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.964+0000 7f6815b25700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6810105830 con 0x7f6810109220 2019-11-28T11:25:46.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.964+0000 7f6815b25700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6810106190 con 0x7f681013dc00 2019-11-28T11:25:46.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.964+0000 7f6807fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f681010a3a0 0x7f6810108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.964+0000 7f6807fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f681010a3a0 0x7f6810108ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60108/0 (socket says 172.21.15.80:60108) 2019-11-28T11:25:46.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.964+0000 7f6807fff700 1 -- 172.21.15.80:0/1569976896 learned_addr learned my addr 172.21.15.80:0/1569976896 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:46.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.964+0000 7f680ffff700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f681013dc00 0x7f6810109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.964+0000 7f68148c3700 1 --2- 172.21.15.80:0/1569976896 >> v2:172.21.15.174:3300/0 conn(0x7f6810109220 0x7f6810109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:46.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f6807fff700 1 -- 172.21.15.80:0/1569976896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f681013dc00 msgr2=0x7f6810109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f6807fff700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f681013dc00 0x7f6810109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f6807fff700 1 -- 172.21.15.80:0/1569976896 >> v2:172.21.15.174:3300/0 conn(0x7f6810109220 msgr2=0x7f6810109680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:46.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f6807fff700 1 --2- 172.21.15.80:0/1569976896 >> v2:172.21.15.174:3300/0 conn(0x7f6810109220 0x7f6810109680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:46.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f6807fff700 1 -- 172.21.15.80:0/1569976896 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6810106510 con 0x7f681010a3a0 2019-11-28T11:25:46.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f680ffff700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f681013dc00 0x7f6810109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:46.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f68148c3700 1 --2- 172.21.15.80:0/1569976896 >> v2:172.21.15.174:3300/0 conn(0x7f6810109220 0x7f6810109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:46.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f6807fff700 1 --2- 172.21.15.80:0/1569976896 >> v2:172.21.15.80:3300/0 conn(0x7f681010a3a0 0x7f6810108ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f67f8010410 tx=0x7f67f80107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f6807fff700 1 --2- 172.21.15.80:0/1569976896 >> v2:172.21.15.80:3300/0 conn(0x7f681010a3a0 0x7f6810108ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f67f8010410 tx=0x7f67f80107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f6807fff700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f681010a3a0 0x7f6810108ce0 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7f67f8010410 tx=0x7f67f80107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:46.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f6807fff700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f681010a3a0 0x7f6810108ce0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f67f8010410 tx=0x7f67f80107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f680d7fa700 1 -- 172.21.15.80:0/1569976896 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67f8000940 con 0x7f681010a3a0 2019-11-28T11:25:46.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f6807fff700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f681010a3a0 0x7f6810108ce0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f67f8010410 tx=0x7f67f80107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f6807fff700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f681010a3a0 0x7f6810108ce0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f67f8010410 tx=0x7f67f80107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:46.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f680d7fa700 1 -- 172.21.15.80:0/1569976896 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f8009770 con 0x7f681010a3a0 2019-11-28T11:25:47.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f6815b25700 1 -- 172.21.15.80:0/1569976896 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6810106510 con 0x7f681010a3a0 2019-11-28T11:25:47.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f680d7fa700 1 -- 172.21.15.80:0/1569976896 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67f8009e00 con 0x7f681010a3a0 2019-11-28T11:25:47.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f6815b25700 1 -- 172.21.15.80:0/1569976896 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6810106510 con 0x7f681010a3a0 2019-11-28T11:25:47.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.965+0000 7f6807fff700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f681010a3a0 0x7f6810108ce0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f67f8010410 tx=0x7f67f80107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.966+0000 7f680d7fa700 1 -- 172.21.15.80:0/1569976896 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f67f8009960 con 0x7f681010a3a0 2019-11-28T11:25:47.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.966+0000 7f6807fff700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f681010a3a0 0x7f6810108ce0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f67f8010410 tx=0x7f67f80107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.966+0000 7f680d7fa700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67f4018730 0x7f67f401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:47.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.966+0000 7f680d7fa700 1 -- 172.21.15.80:0/1569976896 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f67f8031a20 con 0x7f681010a3a0 2019-11-28T11:25:47.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.966+0000 7f680ffff700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67f4018730 0x7f67f401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:47.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.966+0000 7f680ffff700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67f4018730 0x7f67f401abc0 crc :-1 s=READY pgs=116 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:47.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.973+0000 7f6815b25700 1 -- 172.21.15.80:0/1569976896 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6810106510 con 0x7f681010a3a0 2019-11-28T11:25:47.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.977+0000 7f6807fff700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f681010a3a0 0x7f6810108ce0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f67f8010410 tx=0x7f67f80107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:46.977+0000 7f680d7fa700 1 -- 172.21.15.80:0/1569976896 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f67f800a5b0 con 0x7f681010a3a0 2019-11-28T11:25:47.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.152+0000 7f6815b25700 1 -- 172.21.15.80:0/1569976896 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6810106510 con 0x7f681010a3a0 2019-11-28T11:25:47.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.153+0000 7f6807fff700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f681010a3a0 0x7f6810108ce0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f67f8010410 tx=0x7f67f80107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.153+0000 7f680d7fa700 1 -- 172.21.15.80:0/1569976896 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14885 (secure 0 0 0) 0x7f67f8009940 con 0x7f681010a3a0 2019-11-28T11:25:47.176 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:47.178 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:20.933435+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:25:14.914696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-11-28T11:25:17.566323+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:47.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.154+0000 7f6815b25700 1 -- 172.21.15.80:0/1569976896 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67f4018730 msgr2=0x7f67f401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:47.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.154+0000 7f6815b25700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67f4018730 0x7f67f401abc0 crc :-1 s=READY pgs=116 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.154+0000 7f6815b25700 1 -- 172.21.15.80:0/1569976896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f681010a3a0 msgr2=0x7f6810108ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:47.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.154+0000 7f6815b25700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f681010a3a0 0x7f6810108ce0 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7f67f8010410 tx=0x7f67f80107b0).stop 2019-11-28T11:25:47.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.155+0000 7f6815b25700 1 -- 172.21.15.80:0/1569976896 shutdown_connections 2019-11-28T11:25:47.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.155+0000 7f6815b25700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67f4018730 0x7f67f401abc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.155+0000 7f6815b25700 1 --2- 172.21.15.80:0/1569976896 >> v2:172.21.15.174:3300/0 conn(0x7f6810109220 0x7f6810109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.155+0000 7f6815b25700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f681010a3a0 0x7f6810108ce0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.155+0000 7f6815b25700 1 --2- 172.21.15.80:0/1569976896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f681013dc00 0x7f6810109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.155+0000 7f6815b25700 1 -- 172.21.15.80:0/1569976896 shutdown_connections 2019-11-28T11:25:47.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.155+0000 7f6815b25700 1 -- 172.21.15.80:0/1569976896 wait complete. 2019-11-28T11:25:47.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.155+0000 7f6815b25700 1 -- 172.21.15.80:0/1569976896 >> 172.21.15.80:0/1569976896 conn(0x7f681011bfc0 msgr2=0x7f6810141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:47.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:14.914696+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:17.566323+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:25:47.186 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:25:47.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.293+0000 7f46732d1700 1 Processor -- start 2019-11-28T11:25:47.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.293+0000 7f46732d1700 1 -- start start 2019-11-28T11:25:47.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.294+0000 7f46732d1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f466c15ed10 0x7f466c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:47.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.294+0000 7f46732d1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f466c0734b0 0x7f466c0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:47.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.294+0000 7f46732d1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466c06db60 con 0x7f466c073020 2019-11-28T11:25:47.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.294+0000 7f46732d1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466c06fe00 con 0x7f466c15ed10 2019-11-28T11:25:47.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.294+0000 7f46732d1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c0700d0 con 0x7f466c0734b0 2019-11-28T11:25:47.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.294+0000 7f467186e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f466c15ed10 0x7f466c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:47.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.294+0000 7f467106d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f466c073020 0x7f466c071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59434/0 (socket says 172.21.15.80:59434) 2019-11-28T11:25:47.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.294+0000 7f467106d700 1 -- 172.21.15.80:0/3406271382 learned_addr learned my addr 172.21.15.80:0/3406271382 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:47.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.294+0000 7f467206f700 1 --2- 172.21.15.80:0/3406271382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f466c0734b0 0x7f466c0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:47.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.294+0000 7f467186e700 1 -- 172.21.15.80:0/3406271382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f466c0734b0 msgr2=0x7f466c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:47.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.294+0000 7f467186e700 1 --2- 172.21.15.80:0/3406271382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f466c0734b0 0x7f466c0726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:47.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.295+0000 7f467186e700 1 -- 172.21.15.80:0/3406271382 >> v1:172.21.15.80:6789/0 conn(0x7f466c073020 legacy=0x7f466c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:47.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.295+0000 7f467186e700 1 -- 172.21.15.80:0/3406271382 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c070760 con 0x7f466c15ed10 2019-11-28T11:25:47.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.295+0000 7f467086c700 1 -- 172.21.15.80:0/3406271382 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4182652486 0 0) 0x7f46540013f0 con 0x7f466c073020 2019-11-28T11:25:47.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.295+0000 7f467186e700 1 --2- 172.21.15.80:0/3406271382 >> v2:172.21.15.80:3300/0 conn(0x7f466c15ed10 0x7f466c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f465c00af50 tx=0x7f465c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.295+0000 7f467186e700 1 --2- 172.21.15.80:0/3406271382 >> v2:172.21.15.80:3300/0 conn(0x7f466c15ed10 0x7f466c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f465c00af50 tx=0x7f465c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.295+0000 7f467186e700 1 --2- 172.21.15.80:0/3406271382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c15ed10 0x7f466c15f100 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f465c00af50 tx=0x7f465c00b6e0).ready entity=mon.0 client_cookie=fd02ab7c808a1d26 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:47.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.295+0000 7f467186e700 1 --2- 172.21.15.80:0/3406271382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c15ed10 0x7f466c15f100 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f465c00af50 tx=0x7f465c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.295+0000 7f467186e700 1 --2- 172.21.15.80:0/3406271382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c15ed10 0x7f466c15f100 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f465c00af50 tx=0x7f465c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.295+0000 7f467086c700 1 -- 172.21.15.80:0/3406271382 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f465c007210 con 0x7f466c15ed10 2019-11-28T11:25:47.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.295+0000 7f467186e700 1 --2- 172.21.15.80:0/3406271382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c15ed10 0x7f466c15f100 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f465c00af50 tx=0x7f465c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.295+0000 7f467086c700 1 -- 172.21.15.80:0/3406271382 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c0099b0 con 0x7f466c15ed10 2019-11-28T11:25:47.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.295+0000 7f467086c700 1 -- 172.21.15.80:0/3406271382 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f465c00a080 con 0x7f466c15ed10 2019-11-28T11:25:47.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.295+0000 7f46732d1700 1 -- 172.21.15.80:0/3406271382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c15ed10 msgr2=0x7f466c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:47.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.295+0000 7f46732d1700 1 --2- 172.21.15.80:0/3406271382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c15ed10 0x7f466c15f100 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f465c00af50 tx=0x7f465c00b6e0).stop 2019-11-28T11:25:47.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.296+0000 7f46732d1700 1 -- 172.21.15.80:0/3406271382 shutdown_connections 2019-11-28T11:25:47.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.296+0000 7f46732d1700 1 --2- 172.21.15.80:0/3406271382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f466c0734b0 0x7f466c0726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:47.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.296+0000 7f46732d1700 1 --2- 172.21.15.80:0/3406271382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f466c15ed10 0x7f466c15f100 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.296+0000 7f46732d1700 1 -- 172.21.15.80:0/3406271382 shutdown_connections 2019-11-28T11:25:47.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.296+0000 7f46732d1700 1 -- 172.21.15.80:0/3406271382 wait complete. 2019-11-28T11:25:47.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.296+0000 7f46732d1700 1 -- 172.21.15.80:0/3406271382 >> 172.21.15.80:0/3406271382 conn(0x7f466c061d20 msgr2=0x7f466c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:47.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.298+0000 7f46732d1700 1 Processor -- start 2019-11-28T11:25:47.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.298+0000 7f46732d1700 1 -- start start 2019-11-28T11:25:47.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.299+0000 7f46732d1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f466c148320 0x7f466c10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:47.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.299+0000 7f46732d1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f466c10e3d0 0x7f466c168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:47.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.299+0000 7f46732d1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466c148e00 con 0x7f466c10f290 2019-11-28T11:25:47.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.299+0000 7f46732d1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466c13aa20 con 0x7f466c148320 2019-11-28T11:25:47.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.299+0000 7f46732d1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c13acf0 con 0x7f466c10e3d0 2019-11-28T11:25:47.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.299+0000 7f467106d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f466c10f290 0x7f466c10dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59436/0 (socket says 172.21.15.80:59436) 2019-11-28T11:25:47.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.299+0000 7f467106d700 1 -- 172.21.15.80:0/3797121661 learned_addr learned my addr 172.21.15.80:0/3797121661 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:47.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.299+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209064924 0 0) 0x7f46540014e0 con 0x7f466c10f290 2019-11-28T11:25:47.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.299+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4650002e80 con 0x7f466c10f290 2019-11-28T11:25:47.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.299+0000 7f467186e700 1 --2- 172.21.15.80:0/3797121661 >> v2:172.21.15.174:3300/0 conn(0x7f466c148320 0x7f466c10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:47.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.299+0000 7f467206f700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f466c10e3d0 0x7f466c168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:47.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.299+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1161815696 0 0) 0x7f46540015b0 con 0x7f466c10f290 2019-11-28T11:25:47.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.299+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f46500032e0 con 0x7f466c10f290 2019-11-28T11:25:47.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f4654001ac0 con 0x7f466c10f290 2019-11-28T11:25:47.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f466c10e3d0 msgr2=0x7f466c168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:47.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f466a7fc700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f466c10e3d0 0x7f466c168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 >> v2:172.21.15.174:3300/0 conn(0x7f466c148320 msgr2=0x7f466c10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:47.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f466a7fc700 1 --2- 172.21.15.80:0/3797121661 >> v2:172.21.15.174:3300/0 conn(0x7f466c148320 0x7f466c10ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 >> v1:172.21.15.80:6789/0 conn(0x7f466c10f290 legacy=0x7f466c10dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:47.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f466a7fc700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4650003330 0x7f4650003780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:47.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f466a7fc700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4650003cc0 0x7f4650004130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:47.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f466a7fc700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650004820 0x7f4650004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:47.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465000bb60 con 0x7f4650004820 2019-11-28T11:25:47.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465000bd50 con 0x7f4650003330 2019-11-28T11:25:47.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465000bf80 con 0x7f4650003cc0 2019-11-28T11:25:47.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f467206f700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650004820 0x7f4650004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:47.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f467186e700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4650003330 0x7f4650003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:47.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f467106d700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4650003cc0 0x7f4650004130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:47.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f467206f700 1 -- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4650003cc0 msgr2=0x7f4650004130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:47.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f467206f700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4650003cc0 0x7f4650004130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f467206f700 1 -- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4650003330 msgr2=0x7f4650003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:47.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f467206f700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4650003330 0x7f4650003780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f467206f700 1 -- 172.21.15.80:0/3797121661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465000c230 con 0x7f4650004820 2019-11-28T11:25:47.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f46732d1700 1 -- 172.21.15.80:0/3797121661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466c10c810 con 0x7f4650004820 2019-11-28T11:25:47.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f467206f700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650004820 0x7f4650004ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46640102f0 tx=0x7f4664010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f467186e700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4650003330 0x7f4650003780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:47.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f467206f700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650004820 0x7f4650004ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46640102f0 tx=0x7f4664010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f467206f700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650004820 0x7f4650004ce0 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7f46640102f0 tx=0x7f4664010690).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:47.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f467206f700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650004820 0x7f4650004ce0 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7f46640102f0 tx=0x7f4664010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4664000a70 con 0x7f4650004820 2019-11-28T11:25:47.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f467206f700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650004820 0x7f4650004ce0 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7f46640102f0 tx=0x7f4664010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f467206f700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650004820 0x7f4650004ce0 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7f46640102f0 tx=0x7f4664010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466400e640 con 0x7f4650004820 2019-11-28T11:25:47.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f46732d1700 1 -- 172.21.15.80:0/3797121661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466c10c490 con 0x7f4650004820 2019-11-28T11:25:47.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.300+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4664000b50 con 0x7f4650004820 2019-11-28T11:25:47.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.301+0000 7f467206f700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650004820 0x7f4650004ce0 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7f46640102f0 tx=0x7f4664010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.301+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4664000a70 con 0x7f4650004820 2019-11-28T11:25:47.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.301+0000 7f467206f700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650004820 0x7f4650004ce0 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7f46640102f0 tx=0x7f4664010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.301+0000 7f466a7fc700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4650020b30 0x7f4650022f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:47.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.301+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f4664031b70 con 0x7f4650004820 2019-11-28T11:25:47.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.301+0000 7f467186e700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4650020b30 0x7f4650022f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:47.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.301+0000 7f467186e700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4650020b30 0x7f4650022f60 crc :-1 s=READY pgs=117 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:47.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.308+0000 7f46732d1700 1 -- 172.21.15.80:0/3797121661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4644002e60 con 0x7f4650004820 2019-11-28T11:25:47.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.312+0000 7f467206f700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650004820 0x7f4650004ce0 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7f46640102f0 tx=0x7f4664010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.312+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f46640174f0 con 0x7f4650004820 2019-11-28T11:25:47.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.478+0000 7f46732d1700 1 -- 172.21.15.80:0/3797121661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f4644001d20 con 0x7f4650004820 2019-11-28T11:25:47.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.478+0000 7f467206f700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650004820 0x7f4650004ce0 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7f46640102f0 tx=0x7f4664010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.478+0000 7f466a7fc700 1 -- 172.21.15.80:0/3797121661 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4664018df0 con 0x7f4650004820 2019-11-28T11:25:47.499 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:47.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.481+0000 7f46732d1700 1 -- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4650020b30 msgr2=0x7f4650022f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:47.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.481+0000 7f46732d1700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4650020b30 0x7f4650022f60 crc :-1 s=READY pgs=117 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.481+0000 7f46732d1700 1 -- 172.21.15.80:0/3797121661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650004820 msgr2=0x7f4650004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:47.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.481+0000 7f46732d1700 1 --2- 172.21.15.80:0/3797121661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4650004820 0x7f4650004ce0 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7f46640102f0 tx=0x7f4664010690).stop 2019-11-28T11:25:47.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.481+0000 7f467206f700 1 -- 172.21.15.80:0/3797121661 reap_dead start 2019-11-28T11:25:47.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.481+0000 7f467206f700 1 -- 172.21.15.80:0/3797121661 reap_dead start 2019-11-28T11:25:47.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.481+0000 7f46732d1700 1 -- 172.21.15.80:0/3797121661 shutdown_connections 2019-11-28T11:25:47.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.481+0000 7f46732d1700 1 -- 172.21.15.80:0/3797121661 shutdown_connections 2019-11-28T11:25:47.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.481+0000 7f46732d1700 1 -- 172.21.15.80:0/3797121661 wait complete. 2019-11-28T11:25:47.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.481+0000 7f46732d1700 1 -- 172.21.15.80:0/3797121661 >> 172.21.15.80:0/3797121661 conn(0x7f466c15e2d0 msgr2=0x7f466c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:47.511 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:25:47.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.615+0000 7fbb78cea700 1 Processor -- start 2019-11-28T11:25:47.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.615+0000 7fbb78cea700 1 -- start start 2019-11-28T11:25:47.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb78cea700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb7415ed10 0x7fbb7415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:47.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb78cea700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbb74073020 0x7fbb74071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:47.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb78cea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb740734b0 0x7fbb740723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:47.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb78cea700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb7406f3d0 con 0x7fbb740734b0 2019-11-28T11:25:47.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb78cea700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb7406fe00 con 0x7fbb74073020 2019-11-28T11:25:47.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb78cea700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb74070760 con 0x7fbb7415ed10 2019-11-28T11:25:47.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb7359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb740734b0 0x7fbb740723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:47.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb7359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb740734b0 0x7fbb740723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60136/0 (socket says 172.21.15.80:60136) 2019-11-28T11:25:47.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb7359e700 1 -- 172.21.15.80:0/77544794 learned_addr learned my addr 172.21.15.80:0/77544794 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:47.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb72d9d700 1 --2- 172.21.15.80:0/77544794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb7415ed10 0x7fbb7415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:47.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb7259c700 1 --2- 172.21.15.80:0/77544794 >> v2:172.21.15.174:3300/0 conn(0x7fbb74073020 0x7fbb74071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:47.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb7359e700 1 -- 172.21.15.80:0/77544794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb7415ed10 msgr2=0x7fbb7415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:47.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb7359e700 1 --2- 172.21.15.80:0/77544794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb7415ed10 0x7fbb7415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:47.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb7359e700 1 -- 172.21.15.80:0/77544794 >> v2:172.21.15.174:3300/0 conn(0x7fbb74073020 msgr2=0x7fbb74071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:47.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb7359e700 1 --2- 172.21.15.80:0/77544794 >> v2:172.21.15.174:3300/0 conn(0x7fbb74073020 0x7fbb74071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:47.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb7359e700 1 -- 172.21.15.80:0/77544794 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb74070ae0 con 0x7fbb740734b0 2019-11-28T11:25:47.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb7359e700 1 --2- 172.21.15.80:0/77544794 >> v2:172.21.15.80:3300/0 conn(0x7fbb740734b0 0x7fbb740723e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbb6c00fa30 tx=0x7fbb6c0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb7359e700 1 --2- 172.21.15.80:0/77544794 >> v2:172.21.15.80:3300/0 conn(0x7fbb740734b0 0x7fbb740723e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbb6c00fa30 tx=0x7fbb6c0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.616+0000 7fbb7359e700 1 --2- 172.21.15.80:0/77544794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740734b0 0x7fbb740723e0 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7fbb6c00fa30 tx=0x7fbb6c0080d0).ready entity=mon.0 client_cookie=b43f834d9a8f62fb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:47.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.617+0000 7fbb7359e700 1 --2- 172.21.15.80:0/77544794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740734b0 0x7fbb740723e0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fbb6c00fa30 tx=0x7fbb6c0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.617+0000 7fbb7359e700 1 --2- 172.21.15.80:0/77544794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740734b0 0x7fbb740723e0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fbb6c00fa30 tx=0x7fbb6c0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.617+0000 7fbb7359e700 1 --2- 172.21.15.80:0/77544794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740734b0 0x7fbb740723e0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fbb6c00fa30 tx=0x7fbb6c0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.617+0000 7fbb71d9b700 1 -- 172.21.15.80:0/77544794 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb6c000df0 con 0x7fbb740734b0 2019-11-28T11:25:47.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.617+0000 7fbb71d9b700 1 -- 172.21.15.80:0/77544794 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6c001460 con 0x7fbb740734b0 2019-11-28T11:25:47.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.617+0000 7fbb71d9b700 1 -- 172.21.15.80:0/77544794 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb6c001bb0 con 0x7fbb740734b0 2019-11-28T11:25:47.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.617+0000 7fbb78cea700 1 -- 172.21.15.80:0/77544794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740734b0 msgr2=0x7fbb740723e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:47.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.617+0000 7fbb78cea700 1 --2- 172.21.15.80:0/77544794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740734b0 0x7fbb740723e0 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7fbb6c00fa30 tx=0x7fbb6c0080d0).stop 2019-11-28T11:25:47.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.617+0000 7fbb78cea700 1 -- 172.21.15.80:0/77544794 shutdown_connections 2019-11-28T11:25:47.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.617+0000 7fbb78cea700 1 --2- 172.21.15.80:0/77544794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740734b0 0x7fbb740723e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.617+0000 7fbb78cea700 1 --2- 172.21.15.80:0/77544794 >> v2:172.21.15.174:3300/0 conn(0x7fbb74073020 0x7fbb74071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:47.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.617+0000 7fbb78cea700 1 --2- 172.21.15.80:0/77544794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb7415ed10 0x7fbb7415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:47.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.618+0000 7fbb78cea700 1 -- 172.21.15.80:0/77544794 shutdown_connections 2019-11-28T11:25:47.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.618+0000 7fbb78cea700 1 -- 172.21.15.80:0/77544794 wait complete. 2019-11-28T11:25:47.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.618+0000 7fbb78cea700 1 -- 172.21.15.80:0/77544794 >> 172.21.15.80:0/77544794 conn(0x7fbb74061d20 msgr2=0x7fbb740641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:47.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.620+0000 7fbb78cea700 1 Processor -- start 2019-11-28T11:25:47.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.620+0000 7fbb78cea700 1 -- start start 2019-11-28T11:25:47.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb78cea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb7410e970 0x7fbb741087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:47.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb78cea700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb74107e30 0x7fbb74167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:47.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb78cea700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7410c250 con 0x7fbb74108cf0 2019-11-28T11:25:47.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb78cea700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb7410e430 con 0x7fbb7410e970 2019-11-28T11:25:47.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb78cea700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb74105860 con 0x7fbb74107e30 2019-11-28T11:25:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb72d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb7410e970 0x7fbb741087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb7259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbb74108cf0 0x7fbb74107630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59458/0 (socket says 172.21.15.80:59458) 2019-11-28T11:25:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb7259c700 1 -- 172.21.15.80:0/1167601542 learned_addr learned my addr 172.21.15.80:0/1167601542 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb7359e700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb74107e30 0x7fbb74167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:47.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb72d9d700 1 -- 172.21.15.80:0/1167601542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb74107e30 msgr2=0x7fbb74167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:47.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb72d9d700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb74107e30 0x7fbb74167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb72d9d700 1 -- 172.21.15.80:0/1167601542 >> v1:172.21.15.80:6789/0 conn(0x7fbb74108cf0 legacy=0x7fbb74107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:47.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb72d9d700 1 -- 172.21.15.80:0/1167601542 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb74105ef0 con 0x7fbb7410e970 2019-11-28T11:25:47.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb6b7fe700 1 -- 172.21.15.80:0/1167601542 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862770760 0 0) 0x7fbb640010b0 con 0x7fbb74108cf0 2019-11-28T11:25:47.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb72d9d700 1 --2- 172.21.15.80:0/1167601542 >> v2:172.21.15.80:3300/0 conn(0x7fbb7410e970 0x7fbb741087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb5c010390 tx=0x7fbb5c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb72d9d700 1 --2- 172.21.15.80:0/1167601542 >> v2:172.21.15.80:3300/0 conn(0x7fbb7410e970 0x7fbb741087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb5c010390 tx=0x7fbb5c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb72d9d700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb7410e970 0x7fbb741087b0 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7fbb5c010390 tx=0x7fbb5c010190).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:47.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb72d9d700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb7410e970 0x7fbb741087b0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fbb5c010390 tx=0x7fbb5c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb6b7fe700 1 -- 172.21.15.80:0/1167601542 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb5c005770 con 0x7fbb7410e970 2019-11-28T11:25:47.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb72d9d700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb7410e970 0x7fbb741087b0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fbb5c010390 tx=0x7fbb5c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb72d9d700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb7410e970 0x7fbb741087b0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fbb5c010390 tx=0x7fbb5c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb6b7fe700 1 -- 172.21.15.80:0/1167601542 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5c005390 con 0x7fbb7410e970 2019-11-28T11:25:47.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb78cea700 1 -- 172.21.15.80:0/1167601542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb74106270 con 0x7fbb7410e970 2019-11-28T11:25:47.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.621+0000 7fbb6b7fe700 1 -- 172.21.15.80:0/1167601542 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb5c005d50 con 0x7fbb7410e970 2019-11-28T11:25:47.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.622+0000 7fbb78cea700 1 -- 172.21.15.80:0/1167601542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb74105ef0 con 0x7fbb7410e970 2019-11-28T11:25:47.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.622+0000 7fbb72d9d700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb7410e970 0x7fbb741087b0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fbb5c010390 tx=0x7fbb5c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.622+0000 7fbb6b7fe700 1 -- 172.21.15.80:0/1167601542 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbb5c005580 con 0x7fbb7410e970 2019-11-28T11:25:47.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.622+0000 7fbb72d9d700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb7410e970 0x7fbb741087b0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fbb5c010390 tx=0x7fbb5c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.622+0000 7fbb6b7fe700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb58018730 0x7fbb5801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:47.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.622+0000 7fbb6b7fe700 1 -- 172.21.15.80:0/1167601542 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fbb5c031c10 con 0x7fbb7410e970 2019-11-28T11:25:47.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.622+0000 7fbb7259c700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb58018730 0x7fbb5801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:47.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.623+0000 7fbb7259c700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb58018730 0x7fbb5801abe0 crc :-1 s=READY pgs=118 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:47.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.630+0000 7fbb78cea700 1 -- 172.21.15.80:0/1167601542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb74106270 con 0x7fbb7410e970 2019-11-28T11:25:47.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.634+0000 7fbb72d9d700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb7410e970 0x7fbb741087b0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fbb5c010390 tx=0x7fbb5c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.634+0000 7fbb6b7fe700 1 -- 172.21.15.80:0/1167601542 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbb5c005180 con 0x7fbb7410e970 2019-11-28T11:25:47.714 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:25:47.720 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:25:47.725 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:25:47.731 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:25:47.735 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:25:47.740 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:25:47.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.805+0000 7fbb78cea700 1 -- 172.21.15.80:0/1167601542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fbb74105ef0 con 0x7fbb7410e970 2019-11-28T11:25:47.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.805+0000 7fbb72d9d700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb7410e970 0x7fbb741087b0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fbb5c010390 tx=0x7fbb5c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:47.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.805+0000 7fbb6b7fe700 1 -- 172.21.15.80:0/1167601542 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fbb5c005390 con 0x7fbb7410e970 2019-11-28T11:25:47.828 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:47.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.808+0000 7fbb78cea700 1 -- 172.21.15.80:0/1167601542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb58018730 msgr2=0x7fbb5801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:47.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.808+0000 7fbb78cea700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb58018730 0x7fbb5801abe0 crc :-1 s=READY pgs=118 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.808+0000 7fbb78cea700 1 -- 172.21.15.80:0/1167601542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb7410e970 msgr2=0x7fbb741087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:47.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.808+0000 7fbb78cea700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb7410e970 0x7fbb741087b0 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7fbb5c010390 tx=0x7fbb5c010190).stop 2019-11-28T11:25:47.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.808+0000 7fbb78cea700 1 -- 172.21.15.80:0/1167601542 shutdown_connections 2019-11-28T11:25:47.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.808+0000 7fbb78cea700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb58018730 0x7fbb5801abe0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.808+0000 7fbb78cea700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb74107e30 0x7fbb74167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.808+0000 7fbb78cea700 1 --2- 172.21.15.80:0/1167601542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb7410e970 0x7fbb741087b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:47.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.808+0000 7fbb78cea700 1 -- 172.21.15.80:0/1167601542 shutdown_connections 2019-11-28T11:25:47.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.809+0000 7fbb78cea700 1 -- 172.21.15.80:0/1167601542 wait complete. 2019-11-28T11:25:47.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:47.809+0000 7fbb78cea700 1 -- 172.21.15.80:0/1167601542 >> 172.21.15.80:0/1167601542 conn(0x7fbb7415e2d0 msgr2=0x7fbb74147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:47.839 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:25:48.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.005+0000 7f3a09b88700 1 Processor -- start 2019-11-28T11:25:48.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.005+0000 7f3a09b88700 1 -- start start 2019-11-28T11:25:48.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.006+0000 7f3a09b88700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3a0415f100 0x7f3a0406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:48.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.006+0000 7f3a09b88700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a0406c2f0 0x7f3a0406c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:48.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.006+0000 7f3a09b88700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0406db60 con 0x7f3a0415ed10 2019-11-28T11:25:48.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.006+0000 7f3a09b88700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0406fe00 con 0x7f3a0406c2f0 2019-11-28T11:25:48.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.006+0000 7f3a09b88700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a040700d0 con 0x7f3a0415f100 2019-11-28T11:25:48.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.006+0000 7f3a08926700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a0406c2f0 0x7f3a0406c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.006+0000 7f3a08926700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a0406c2f0 0x7f3a0406c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60152/0 (socket says 172.21.15.80:60152) 2019-11-28T11:25:48.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.006+0000 7f3a08926700 1 -- 172.21.15.80:0/485165202 learned_addr learned my addr 172.21.15.80:0/485165202 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:48.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f39fbfff700 1 --2- 172.21.15.80:0/485165202 >> v2:172.21.15.174:3300/0 conn(0x7f3a0415f100 0x7f3a0406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f3a08926700 1 -- 172.21.15.80:0/485165202 >> v2:172.21.15.174:3300/0 conn(0x7f3a0415f100 msgr2=0x7f3a0406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:48.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f3a08926700 1 --2- 172.21.15.80:0/485165202 >> v2:172.21.15.174:3300/0 conn(0x7f3a0415f100 0x7f3a0406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:48.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f3a08926700 1 -- 172.21.15.80:0/485165202 >> v1:172.21.15.174:6789/0 conn(0x7f3a0415ed10 legacy=0x7f3a04073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f3a08926700 1 -- 172.21.15.80:0/485165202 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a04070760 con 0x7f3a0406c2f0 2019-11-28T11:25:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f39fbfff700 1 --2- 172.21.15.80:0/485165202 >> v2:172.21.15.174:3300/0 conn(0x7f3a0415f100 0x7f3a0406bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f3a08926700 1 --2- 172.21.15.80:0/485165202 >> v2:172.21.15.80:3300/0 conn(0x7f3a0406c2f0 0x7f3a0406c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f39fc00fab0 tx=0x7f39fc00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f3a08926700 1 --2- 172.21.15.80:0/485165202 >> v2:172.21.15.80:3300/0 conn(0x7f3a0406c2f0 0x7f3a0406c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f39fc00fab0 tx=0x7f39fc00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f3a08926700 1 --2- 172.21.15.80:0/485165202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0406c2f0 0x7f3a0406c770 secure :-1 s=READY pgs=264 cs=0 l=1 rx=0x7f39fc00fab0 tx=0x7f39fc00fe50).ready entity=mon.0 client_cookie=204842c6cf0f854a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f3a08926700 1 --2- 172.21.15.80:0/485165202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0406c2f0 0x7f3a0406c770 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f39fc00fab0 tx=0x7f39fc00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f3a08926700 1 --2- 172.21.15.80:0/485165202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0406c2f0 0x7f3a0406c770 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f39fc00fab0 tx=0x7f39fc00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f3a037fe700 1 -- 172.21.15.80:0/485165202 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39fc000f10 con 0x7f3a0406c2f0 2019-11-28T11:25:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f3a08926700 1 --2- 172.21.15.80:0/485165202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0406c2f0 0x7f3a0406c770 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f39fc00fab0 tx=0x7f39fc00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f3a037fe700 1 -- 172.21.15.80:0/485165202 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc001460 con 0x7f3a0406c2f0 2019-11-28T11:25:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f3a037fe700 1 -- 172.21.15.80:0/485165202 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39fc001bb0 con 0x7f3a0406c2f0 2019-11-28T11:25:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f3a09b88700 1 -- 172.21.15.80:0/485165202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0406c2f0 msgr2=0x7f3a0406c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.007+0000 7f3a09b88700 1 --2- 172.21.15.80:0/485165202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0406c2f0 0x7f3a0406c770 secure :-1 s=READY pgs=264 cs=0 l=1 rx=0x7f39fc00fab0 tx=0x7f39fc00fe50).stop 2019-11-28T11:25:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.008+0000 7f3a09b88700 1 -- 172.21.15.80:0/485165202 shutdown_connections 2019-11-28T11:25:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.008+0000 7f3a09b88700 1 --2- 172.21.15.80:0/485165202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0406c2f0 0x7f3a0406c770 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.008+0000 7f3a09b88700 1 --2- 172.21.15.80:0/485165202 >> v2:172.21.15.174:3300/0 conn(0x7f3a0415f100 0x7f3a0406bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.008+0000 7f3a09b88700 1 -- 172.21.15.80:0/485165202 shutdown_connections 2019-11-28T11:25:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.008+0000 7f3a09b88700 1 -- 172.21.15.80:0/485165202 wait complete. 2019-11-28T11:25:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.008+0000 7f3a09b88700 1 -- 172.21.15.80:0/485165202 >> 172.21.15.80:0/485165202 conn(0x7f3a04061d20 msgr2=0x7f3a040641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.010+0000 7f3a09b88700 1 Processor -- start 2019-11-28T11:25:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.010+0000 7f3a09b88700 1 -- start start 2019-11-28T11:25:48.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.011+0000 7f3a09b88700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a0410e970 0x7f3a041087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:48.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.011+0000 7f3a09b88700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3a04108cf0 0x7f3a04107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.011+0000 7f3a09b88700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0410c250 con 0x7f3a04107b70 2019-11-28T11:25:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.011+0000 7f3a09b88700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0410e430 con 0x7f3a0410e970 2019-11-28T11:25:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.011+0000 7f3a09b88700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a04105860 con 0x7f3a04108cf0 2019-11-28T11:25:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.011+0000 7f3a03fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a0410e970 0x7f3a041087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.011+0000 7f3a03fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a0410e970 0x7f3a041087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60156/0 (socket says 172.21.15.80:60156) 2019-11-28T11:25:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.011+0000 7f3a03fff700 1 -- 172.21.15.80:0/2714027925 learned_addr learned my addr 172.21.15.80:0/2714027925 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.011+0000 7f39fbfff700 1 --2- 172.21.15.80:0/2714027925 >> v2:172.21.15.174:3300/0 conn(0x7f3a04108cf0 0x7f3a04107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.011+0000 7f3a03fff700 1 -- 172.21.15.80:0/2714027925 >> v2:172.21.15.174:3300/0 conn(0x7f3a04108cf0 msgr2=0x7f3a04107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.011+0000 7f3a03fff700 1 --2- 172.21.15.80:0/2714027925 >> v2:172.21.15.174:3300/0 conn(0x7f3a04108cf0 0x7f3a04107630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.011+0000 7f3a03fff700 1 -- 172.21.15.80:0/2714027925 >> v1:172.21.15.174:6789/0 conn(0x7f3a04107b70 legacy=0x7f3a0410ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.011+0000 7f3a03fff700 1 -- 172.21.15.80:0/2714027925 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a04105ef0 con 0x7f3a0410e970 2019-11-28T11:25:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.011+0000 7f3a03fff700 1 --2- 172.21.15.80:0/2714027925 >> v2:172.21.15.80:3300/0 conn(0x7f3a0410e970 0x7f3a041087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f39f4010410 tx=0x7f39f4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.011+0000 7f3a03fff700 1 --2- 172.21.15.80:0/2714027925 >> v2:172.21.15.80:3300/0 conn(0x7f3a0410e970 0x7f3a041087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f39f4010410 tx=0x7f39f4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.011+0000 7f3a03fff700 1 --2- 172.21.15.80:0/2714027925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0410e970 0x7f3a041087b0 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f39f4010410 tx=0x7f39f4010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.012+0000 7f3a03fff700 1 --2- 172.21.15.80:0/2714027925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0410e970 0x7f3a041087b0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f39f4010410 tx=0x7f39f4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.012+0000 7f3a03fff700 1 --2- 172.21.15.80:0/2714027925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0410e970 0x7f3a041087b0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f39f4010410 tx=0x7f39f4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.012+0000 7f3a017fa700 1 -- 172.21.15.80:0/2714027925 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f4000960 con 0x7f3a0410e970 2019-11-28T11:25:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.012+0000 7f3a03fff700 1 --2- 172.21.15.80:0/2714027925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0410e970 0x7f3a041087b0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f39f4010410 tx=0x7f39f4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.012+0000 7f3a017fa700 1 -- 172.21.15.80:0/2714027925 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f40010a0 con 0x7f3a0410e970 2019-11-28T11:25:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.012+0000 7f3a09b88700 1 -- 172.21.15.80:0/2714027925 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a04106270 con 0x7f3a0410e970 2019-11-28T11:25:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.012+0000 7f3a017fa700 1 -- 172.21.15.80:0/2714027925 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f40017f0 con 0x7f3a0410e970 2019-11-28T11:25:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.012+0000 7f3a09b88700 1 -- 172.21.15.80:0/2714027925 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a04105ef0 con 0x7f3a0410e970 2019-11-28T11:25:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.012+0000 7f3a03fff700 1 --2- 172.21.15.80:0/2714027925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0410e970 0x7f3a041087b0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f39f4010410 tx=0x7f39f4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.013+0000 7f3a017fa700 1 -- 172.21.15.80:0/2714027925 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f39f4000eb0 con 0x7f3a0410e970 2019-11-28T11:25:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.013+0000 7f3a03fff700 1 --2- 172.21.15.80:0/2714027925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0410e970 0x7f3a041087b0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f39f4010410 tx=0x7f39f4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.013+0000 7f3a017fa700 1 --2- 172.21.15.80:0/2714027925 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f39dc018730 0x7f39dc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.013+0000 7f3a017fa700 1 -- 172.21.15.80:0/2714027925 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f39f4031ac0 con 0x7f3a0410e970 2019-11-28T11:25:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.013+0000 7f39fbfff700 1 --2- 172.21.15.80:0/2714027925 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f39dc018730 0x7f39dc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.013+0000 7f39fbfff700 1 --2- 172.21.15.80:0/2714027925 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f39dc018730 0x7f39dc01abc0 crc :-1 s=READY pgs=119 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.020+0000 7f3a09b88700 1 -- 172.21.15.80:0/2714027925 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a04106270 con 0x7f3a0410e970 2019-11-28T11:25:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.024+0000 7f3a03fff700 1 --2- 172.21.15.80:0/2714027925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0410e970 0x7f3a041087b0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f39f4010410 tx=0x7f39f4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.024+0000 7f3a017fa700 1 -- 172.21.15.80:0/2714027925 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f39f40075b0 con 0x7f3a0410e970 2019-11-28T11:25:48.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.194+0000 7f3a09b88700 1 -- 172.21.15.80:0/2714027925 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f3a04105ef0 con 0x7f3a0410e970 2019-11-28T11:25:48.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.194+0000 7f3a03fff700 1 --2- 172.21.15.80:0/2714027925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0410e970 0x7f3a041087b0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f39f4010410 tx=0x7f39f4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.194+0000 7f3a017fa700 1 -- 172.21.15.80:0/2714027925 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f39f4017400 con 0x7f3a0410e970 2019-11-28T11:25:48.215 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.197+0000 7f3a09b88700 1 -- 172.21.15.80:0/2714027925 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f39dc018730 msgr2=0x7f39dc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.197+0000 7f3a09b88700 1 --2- 172.21.15.80:0/2714027925 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f39dc018730 0x7f39dc01abc0 crc :-1 s=READY pgs=119 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.197+0000 7f3a09b88700 1 -- 172.21.15.80:0/2714027925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0410e970 msgr2=0x7f3a041087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.197+0000 7f3a09b88700 1 --2- 172.21.15.80:0/2714027925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0410e970 0x7f3a041087b0 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f39f4010410 tx=0x7f39f4010270).stop 2019-11-28T11:25:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.197+0000 7f3a09b88700 1 -- 172.21.15.80:0/2714027925 shutdown_connections 2019-11-28T11:25:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.197+0000 7f3a09b88700 1 --2- 172.21.15.80:0/2714027925 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f39dc018730 0x7f39dc01abc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.197+0000 7f3a09b88700 1 --2- 172.21.15.80:0/2714027925 >> v2:172.21.15.174:3300/0 conn(0x7f3a04108cf0 0x7f3a04107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.197+0000 7f3a09b88700 1 --2- 172.21.15.80:0/2714027925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a0410e970 0x7f3a041087b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.197+0000 7f3a09b88700 1 -- 172.21.15.80:0/2714027925 shutdown_connections 2019-11-28T11:25:48.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.197+0000 7f3a09b88700 1 -- 172.21.15.80:0/2714027925 wait complete. 2019-11-28T11:25:48.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.197+0000 7f3a09b88700 1 -- 172.21.15.80:0/2714027925 >> 172.21.15.80:0/2714027925 conn(0x7f3a0415e2d0 msgr2=0x7f3a04147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:48.227 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:25:48.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.326+0000 7f448294a700 1 Processor -- start 2019-11-28T11:25:48.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.326+0000 7f448294a700 1 -- start start 2019-11-28T11:25:48.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.327+0000 7f448294a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f447c06c0a0 0x7f447c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:48.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.327+0000 7f448294a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f447c072620 0x7f447c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:48.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.327+0000 7f448294a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447c06db00 con 0x7f447c0734e0 2019-11-28T11:25:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.327+0000 7f448294a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f447c06fd60 con 0x7f447c06c0a0 2019-11-28T11:25:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.327+0000 7f448294a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f447c070030 con 0x7f447c072620 2019-11-28T11:25:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.327+0000 7f4480ee7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f447c06c0a0 0x7f447c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.327+0000 7f447bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f447c0734e0 0x7f447c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59476/0 (socket says 172.21.15.80:59476) 2019-11-28T11:25:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.327+0000 7f447bfff700 1 -- 172.21.15.80:0/863445228 learned_addr learned my addr 172.21.15.80:0/863445228 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:48.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f44816e8700 1 --2- 172.21.15.80:0/863445228 >> v2:172.21.15.174:3300/0 conn(0x7f447c072620 0x7f447c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f4480ee7700 1 -- 172.21.15.80:0/863445228 >> v2:172.21.15.174:3300/0 conn(0x7f447c072620 msgr2=0x7f447c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:48.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f4480ee7700 1 --2- 172.21.15.80:0/863445228 >> v2:172.21.15.174:3300/0 conn(0x7f447c072620 0x7f447c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:48.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f4480ee7700 1 -- 172.21.15.80:0/863445228 >> v1:172.21.15.80:6789/0 conn(0x7f447c0734e0 legacy=0x7f447c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f447b7fe700 1 -- 172.21.15.80:0/863445228 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465737102 0 0) 0x7f446c001150 con 0x7f447c0734e0 2019-11-28T11:25:48.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f4480ee7700 1 -- 172.21.15.80:0/863445228 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c0706c0 con 0x7f447c06c0a0 2019-11-28T11:25:48.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f4480ee7700 1 --2- 172.21.15.80:0/863445228 >> v2:172.21.15.80:3300/0 conn(0x7f447c06c0a0 0x7f447c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f446400af50 tx=0x7f446400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f4480ee7700 1 --2- 172.21.15.80:0/863445228 >> v2:172.21.15.80:3300/0 conn(0x7f447c06c0a0 0x7f447c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f446400af50 tx=0x7f446400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f4480ee7700 1 --2- 172.21.15.80:0/863445228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f447c06c0a0 0x7f447c072fa0 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7f446400af50 tx=0x7f446400b250).ready entity=mon.0 client_cookie=6d8271aee7e32229 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:48.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f4480ee7700 1 --2- 172.21.15.80:0/863445228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f447c06c0a0 0x7f447c072fa0 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7f446400af50 tx=0x7f446400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f447b7fe700 1 -- 172.21.15.80:0/863445228 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4464007210 con 0x7f447c06c0a0 2019-11-28T11:25:48.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f4480ee7700 1 --2- 172.21.15.80:0/863445228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f447c06c0a0 0x7f447c072fa0 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7f446400af50 tx=0x7f446400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f4480ee7700 1 --2- 172.21.15.80:0/863445228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f447c06c0a0 0x7f447c072fa0 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7f446400af50 tx=0x7f446400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f447b7fe700 1 -- 172.21.15.80:0/863445228 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44640099b0 con 0x7f447c06c0a0 2019-11-28T11:25:48.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f447b7fe700 1 -- 172.21.15.80:0/863445228 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f446400a080 con 0x7f447c06c0a0 2019-11-28T11:25:48.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f448294a700 1 -- 172.21.15.80:0/863445228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f447c06c0a0 msgr2=0x7f447c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.328+0000 7f448294a700 1 --2- 172.21.15.80:0/863445228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f447c06c0a0 0x7f447c072fa0 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7f446400af50 tx=0x7f446400b250).stop 2019-11-28T11:25:48.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.329+0000 7f448294a700 1 -- 172.21.15.80:0/863445228 shutdown_connections 2019-11-28T11:25:48.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.329+0000 7f448294a700 1 --2- 172.21.15.80:0/863445228 >> v2:172.21.15.174:3300/0 conn(0x7f447c072620 0x7f447c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:48.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.329+0000 7f448294a700 1 --2- 172.21.15.80:0/863445228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f447c06c0a0 0x7f447c072fa0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.329+0000 7f448294a700 1 -- 172.21.15.80:0/863445228 shutdown_connections 2019-11-28T11:25:48.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.329+0000 7f448294a700 1 -- 172.21.15.80:0/863445228 wait complete. 2019-11-28T11:25:48.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.329+0000 7f448294a700 1 -- 172.21.15.80:0/863445228 >> 172.21.15.80:0/863445228 conn(0x7f447c061cf0 msgr2=0x7f447c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:48.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.331+0000 7f448294a700 1 Processor -- start 2019-11-28T11:25:48.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.331+0000 7f448294a700 1 -- start start 2019-11-28T11:25:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.332+0000 7f448294a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f447c104820 0x7f447c10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.332+0000 7f448294a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447c13bcd0 con 0x7f447c10b9d0 2019-11-28T11:25:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.332+0000 7f448294a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447c105ea0 con 0x7f447c10c890 2019-11-28T11:25:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.332+0000 7f448294a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f447c109130 con 0x7f447c104820 2019-11-28T11:25:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.332+0000 7f44816e8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f447c10b9d0 0x7f447c167a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59486/0 (socket says 172.21.15.80:59486) 2019-11-28T11:25:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.332+0000 7f44816e8700 1 -- 172.21.15.80:0/4128918106 learned_addr learned my addr 172.21.15.80:0/4128918106 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.332+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170838641 0 0) 0x7f44740014d0 con 0x7f447c10b9d0 2019-11-28T11:25:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f4480ee7700 1 --2- 172.21.15.80:0/4128918106 >> v2:172.21.15.174:3300/0 conn(0x7f447c104820 0x7f447c10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4460002e80 con 0x7f447c10b9d0 2019-11-28T11:25:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1842888163 0 0) 0x7f4474001600 con 0x7f447c10b9d0 2019-11-28T11:25:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f44600032e0 con 0x7f447c10b9d0 2019-11-28T11:25:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f4474001bb0 con 0x7f447c10b9d0 2019-11-28T11:25:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 >> v2:172.21.15.174:3300/0 conn(0x7f447c104820 msgr2=0x7f447c10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44797fa700 1 --2- 172.21.15.80:0/4128918106 >> v2:172.21.15.174:3300/0 conn(0x7f447c104820 0x7f447c10c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 >> v1:172.21.15.174:6789/0 conn(0x7f447c10c890 legacy=0x7f447c10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 >> v1:172.21.15.80:6789/0 conn(0x7f447c10b9d0 legacy=0x7f447c167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44797fa700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4460003870 0x7f4460003ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44797fa700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44600041e0 0x7f4460004660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44797fa700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4460004da0 0x7f446000b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446000bc40 con 0x7f4460004da0 2019-11-28T11:25:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446000be30 con 0x7f44600041e0 2019-11-28T11:25:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446000c060 con 0x7f4460003870 2019-11-28T11:25:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44816e8700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4460004da0 0x7f446000b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f447bfff700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44600041e0 0x7f4460004660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f4480ee7700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4460003870 0x7f4460003ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44816e8700 1 -- 172.21.15.80:0/4128918106 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4460003870 msgr2=0x7f4460003ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44816e8700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4460003870 0x7f4460003ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44816e8700 1 -- 172.21.15.80:0/4128918106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44600041e0 msgr2=0x7f4460004660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44816e8700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44600041e0 0x7f4460004660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44816e8700 1 -- 172.21.15.80:0/4128918106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446000c310 con 0x7f4460004da0 2019-11-28T11:25:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f448294a700 1 -- 172.21.15.80:0/4128918106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447c109e10 con 0x7f4460004da0 2019-11-28T11:25:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44816e8700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4460004da0 0x7f446000b700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f44740107f0 tx=0x7f44740106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f448294a700 1 -- 172.21.15.80:0/4128918106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447c109a90 con 0x7f4460004da0 2019-11-28T11:25:48.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44816e8700 1 -- 172.21.15.80:0/4128918106 reap_dead start 2019-11-28T11:25:48.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44816e8700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4460004da0 0x7f446000b700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f44740107f0 tx=0x7f44740106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.333+0000 7f44816e8700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4460004da0 0x7f446000b700 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7f44740107f0 tx=0x7f44740106a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:48.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.334+0000 7f44816e8700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4460004da0 0x7f446000b700 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f44740107f0 tx=0x7f44740106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.334+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4474002680 con 0x7f4460004da0 2019-11-28T11:25:48.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.334+0000 7f44816e8700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4460004da0 0x7f446000b700 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f44740107f0 tx=0x7f44740106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.334+0000 7f44816e8700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4460004da0 0x7f446000b700 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f44740107f0 tx=0x7f44740106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.334+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4474001400 con 0x7f4460004da0 2019-11-28T11:25:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.334+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4474001a90 con 0x7f4460004da0 2019-11-28T11:25:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.334+0000 7f44816e8700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4460004da0 0x7f446000b700 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f44740107f0 tx=0x7f44740106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.334+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f44740015f0 con 0x7f4460004da0 2019-11-28T11:25:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.334+0000 7f44816e8700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4460004da0 0x7f446000b700 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f44740107f0 tx=0x7f44740106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.334+0000 7f44797fa700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f446001f860 0x7f4460021cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:48.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.334+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f4474031f70 con 0x7f4460004da0 2019-11-28T11:25:48.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.334+0000 7f4480ee7700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f446001f860 0x7f4460021cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.335+0000 7f4480ee7700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f446001f860 0x7f4460021cb0 crc :-1 s=READY pgs=120 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.342+0000 7f448294a700 1 -- 172.21.15.80:0/4128918106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4454002e60 con 0x7f4460004da0 2019-11-28T11:25:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.345+0000 7f44816e8700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4460004da0 0x7f446000b700 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f44740107f0 tx=0x7f44740106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.345+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f44740011f0 con 0x7f4460004da0 2019-11-28T11:25:48.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.520+0000 7f448294a700 1 -- 172.21.15.80:0/4128918106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4454001d10 con 0x7f4460004da0 2019-11-28T11:25:48.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.521+0000 7f44816e8700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4460004da0 0x7f446000b700 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f44740107f0 tx=0x7f44740106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.521+0000 7f44797fa700 1 -- 172.21.15.80:0/4128918106 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+14885 (secure 0 0 0) 0x7f4474001400 con 0x7f4460004da0 2019-11-28T11:25:48.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.522+0000 7f448294a700 1 -- 172.21.15.80:0/4128918106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f446001f860 msgr2=0x7f4460021cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.522+0000 7f448294a700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f446001f860 0x7f4460021cb0 crc :-1 s=READY pgs=120 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.522+0000 7f448294a700 1 -- 172.21.15.80:0/4128918106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4460004da0 msgr2=0x7f446000b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.522+0000 7f448294a700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4460004da0 0x7f446000b700 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7f44740107f0 tx=0x7f44740106a0).stop 2019-11-28T11:25:48.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.523+0000 7f448294a700 1 -- 172.21.15.80:0/4128918106 shutdown_connections 2019-11-28T11:25:48.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.523+0000 7f448294a700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f446001f860 0x7f4460021cb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.523+0000 7f448294a700 1 --2- 172.21.15.80:0/4128918106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4460004da0 0x7f446000b700 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.523+0000 7f448294a700 1 -- 172.21.15.80:0/4128918106 shutdown_connections 2019-11-28T11:25:48.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.523+0000 7f448294a700 1 -- 172.21.15.80:0/4128918106 wait complete. 2019-11-28T11:25:48.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.523+0000 7f448294a700 1 -- 172.21.15.80:0/4128918106 >> 172.21.15.80:0/4128918106 conn(0x7f447c13d620 msgr2=0x7f447c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:48.547 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:48.547 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:20.933435+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:25:14.914696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-11-28T11:25:17.566323+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:25:48.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:14.914696+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:17.566323+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:25:48.559 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:25:48.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.665+0000 7fd38a884700 1 Processor -- start 2019-11-28T11:25:48.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.665+0000 7fd38a884700 1 -- start start 2019-11-28T11:25:48.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.666+0000 7fd38a884700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd38415ed10 0x7fd38415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:48.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.666+0000 7fd38a884700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3840734b0 0x7fd3840726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:48.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.666+0000 7fd38a884700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38406db60 con 0x7fd384073020 2019-11-28T11:25:48.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.666+0000 7fd38a884700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38406fe00 con 0x7fd38415ed10 2019-11-28T11:25:48.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.666+0000 7fd38a884700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840700d0 con 0x7fd3840734b0 2019-11-28T11:25:48.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.666+0000 7fd389622700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3840734b0 0x7fd3840726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.666+0000 7fd388e21700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd38415ed10 0x7fd38415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.666+0000 7fd389622700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3840734b0 0x7fd3840726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:34212/0 (socket says 172.21.15.80:34212) 2019-11-28T11:25:48.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.666+0000 7fd388e21700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd38415ed10 0x7fd38415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:46834/0 (socket says 172.21.15.80:46834) 2019-11-28T11:25:48.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.666+0000 7fd383fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd384073020 0x7fd384071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:46808/0 (socket says 172.21.15.80:46808) 2019-11-28T11:25:48.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.666+0000 7fd389622700 1 -- 172.21.15.80:0/3247002353 learned_addr learned my addr 172.21.15.80:0/3247002353 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:48.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.667+0000 7fd389622700 1 -- 172.21.15.80:0/3247002353 >> v2:172.21.15.174:3300/0 conn(0x7fd38415ed10 msgr2=0x7fd38415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:48.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.667+0000 7fd389622700 1 --2- 172.21.15.80:0/3247002353 >> v2:172.21.15.174:3300/0 conn(0x7fd38415ed10 0x7fd38415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:48.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.667+0000 7fd389622700 1 -- 172.21.15.80:0/3247002353 >> v1:172.21.15.174:6789/0 conn(0x7fd384073020 legacy=0x7fd384071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.667+0000 7fd389622700 1 -- 172.21.15.80:0/3247002353 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd384070760 con 0x7fd3840734b0 2019-11-28T11:25:48.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.667+0000 7fd389622700 1 --2- 172.21.15.80:0/3247002353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3840734b0 0x7fd3840726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd37c00fae0 tx=0x7fd37c00f910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.667+0000 7fd389622700 1 --2- 172.21.15.80:0/3247002353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3840734b0 0x7fd3840726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd37c00fae0 tx=0x7fd37c00f910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.667+0000 7fd389622700 1 --2- 172.21.15.80:0/3247002353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3840734b0 0x7fd3840726a0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fd37c00fae0 tx=0x7fd37c00f910).ready entity=mon.2 client_cookie=243c9778fb075c72 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:48.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.667+0000 7fd389622700 1 --2- 172.21.15.80:0/3247002353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3840734b0 0x7fd3840726a0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fd37c00fae0 tx=0x7fd37c00f910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.667+0000 7fd389622700 1 --2- 172.21.15.80:0/3247002353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3840734b0 0x7fd3840726a0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fd37c00fae0 tx=0x7fd37c00f910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.667+0000 7fd3837fe700 1 -- 172.21.15.80:0/3247002353 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd37c000df0 con 0x7fd3840734b0 2019-11-28T11:25:48.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.667+0000 7fd389622700 1 --2- 172.21.15.80:0/3247002353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3840734b0 0x7fd3840726a0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fd37c00fae0 tx=0x7fd37c00f910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.667+0000 7fd3837fe700 1 -- 172.21.15.80:0/3247002353 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c0011f0 con 0x7fd3840734b0 2019-11-28T11:25:48.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.667+0000 7fd3837fe700 1 -- 172.21.15.80:0/3247002353 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd37c001880 con 0x7fd3840734b0 2019-11-28T11:25:48.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.667+0000 7fd38a884700 1 -- 172.21.15.80:0/3247002353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3840734b0 msgr2=0x7fd3840726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.667+0000 7fd38a884700 1 --2- 172.21.15.80:0/3247002353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3840734b0 0x7fd3840726a0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fd37c00fae0 tx=0x7fd37c00f910).stop 2019-11-28T11:25:48.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.668+0000 7fd38a884700 1 -- 172.21.15.80:0/3247002353 shutdown_connections 2019-11-28T11:25:48.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.668+0000 7fd38a884700 1 --2- 172.21.15.80:0/3247002353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3840734b0 0x7fd3840726a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.668+0000 7fd38a884700 1 --2- 172.21.15.80:0/3247002353 >> v2:172.21.15.174:3300/0 conn(0x7fd38415ed10 0x7fd38415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:48.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.668+0000 7fd38a884700 1 -- 172.21.15.80:0/3247002353 shutdown_connections 2019-11-28T11:25:48.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.668+0000 7fd38a884700 1 -- 172.21.15.80:0/3247002353 wait complete. 2019-11-28T11:25:48.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.668+0000 7fd38a884700 1 -- 172.21.15.80:0/3247002353 >> 172.21.15.80:0/3247002353 conn(0x7fd384061d20 msgr2=0x7fd3840641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:48.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.670+0000 7fd38a884700 1 Processor -- start 2019-11-28T11:25:48.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.670+0000 7fd38a884700 1 -- start start 2019-11-28T11:25:48.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.671+0000 7fd38a884700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3841079b0 0x7fd384107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:48.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.671+0000 7fd38a884700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd384108380 0x7fd384168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:48.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.671+0000 7fd38a884700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3841087f0 con 0x7fd384148320 2019-11-28T11:25:48.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.671+0000 7fd38a884700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38413aa20 con 0x7fd3841079b0 2019-11-28T11:25:48.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.671+0000 7fd38a884700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38413acf0 con 0x7fd384108380 2019-11-28T11:25:48.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.671+0000 7fd383fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3841079b0 0x7fd384107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.671+0000 7fd383fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3841079b0 0x7fd384107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60186/0 (socket says 172.21.15.80:60186) 2019-11-28T11:25:48.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.671+0000 7fd383fff700 1 -- 172.21.15.80:0/1801200108 learned_addr learned my addr 172.21.15.80:0/1801200108 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:48.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd389622700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd384108380 0x7fd384168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd3817fa700 1 -- 172.21.15.80:0/1801200108 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326287825 0 0) 0x7fd36c000c90 con 0x7fd384148320 2019-11-28T11:25:48.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd383fff700 1 -- 172.21.15.80:0/1801200108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd384108380 msgr2=0x7fd384168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd383fff700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd384108380 0x7fd384168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd383fff700 1 -- 172.21.15.80:0/1801200108 >> v1:172.21.15.174:6789/0 conn(0x7fd384148320 legacy=0x7fd38410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd383fff700 1 -- 172.21.15.80:0/1801200108 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38410c490 con 0x7fd3841079b0 2019-11-28T11:25:48.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd383fff700 1 --2- 172.21.15.80:0/1801200108 >> v2:172.21.15.80:3300/0 conn(0x7fd3841079b0 0x7fd384107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3740103c0 tx=0x7fd374010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd383fff700 1 --2- 172.21.15.80:0/1801200108 >> v2:172.21.15.80:3300/0 conn(0x7fd3841079b0 0x7fd384107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3740103c0 tx=0x7fd374010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd383fff700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3841079b0 0x7fd384107e40 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7fd3740103c0 tx=0x7fd374010760).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:48.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd383fff700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3841079b0 0x7fd384107e40 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fd3740103c0 tx=0x7fd374010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd3817fa700 1 -- 172.21.15.80:0/1801200108 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd374000d00 con 0x7fd3841079b0 2019-11-28T11:25:48.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd383fff700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3841079b0 0x7fd384107e40 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fd3740103c0 tx=0x7fd374010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd38a884700 1 -- 172.21.15.80:0/1801200108 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38410c810 con 0x7fd3841079b0 2019-11-28T11:25:48.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd3817fa700 1 -- 172.21.15.80:0/1801200108 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd374000c60 con 0x7fd3841079b0 2019-11-28T11:25:48.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd383fff700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3841079b0 0x7fd384107e40 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fd3740103c0 tx=0x7fd374010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd3817fa700 1 -- 172.21.15.80:0/1801200108 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3740045a0 con 0x7fd3841079b0 2019-11-28T11:25:48.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd38a884700 1 -- 172.21.15.80:0/1801200108 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38410c490 con 0x7fd3841079b0 2019-11-28T11:25:48.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.672+0000 7fd383fff700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3841079b0 0x7fd384107e40 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fd3740103c0 tx=0x7fd374010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.673+0000 7fd3817fa700 1 -- 172.21.15.80:0/1801200108 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd3740041c0 con 0x7fd3841079b0 2019-11-28T11:25:48.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.673+0000 7fd383fff700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3841079b0 0x7fd384107e40 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fd3740103c0 tx=0x7fd374010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.673+0000 7fd3817fa700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd368018730 0x7fd36801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:48.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.673+0000 7fd3817fa700 1 -- 172.21.15.80:0/1801200108 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fd374031aa0 con 0x7fd3841079b0 2019-11-28T11:25:48.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.673+0000 7fd388e21700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd368018730 0x7fd36801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:48.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.673+0000 7fd388e21700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd368018730 0x7fd36801abc0 crc :-1 s=READY pgs=121 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:48.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.680+0000 7fd38a884700 1 -- 172.21.15.80:0/1801200108 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38410c810 con 0x7fd3841079b0 2019-11-28T11:25:48.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.684+0000 7fd383fff700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3841079b0 0x7fd384107e40 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fd3740103c0 tx=0x7fd374010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.684+0000 7fd3817fa700 1 -- 172.21.15.80:0/1801200108 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd37402df00 con 0x7fd3841079b0 2019-11-28T11:25:48.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.851+0000 7fd38a884700 1 -- 172.21.15.80:0/1801200108 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fd38410c490 con 0x7fd3841079b0 2019-11-28T11:25:48.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.852+0000 7fd383fff700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3841079b0 0x7fd384107e40 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fd3740103c0 tx=0x7fd374010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:48.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.852+0000 7fd3817fa700 1 -- 172.21.15.80:0/1801200108 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd37402df00 con 0x7fd3841079b0 2019-11-28T11:25:48.873 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.854+0000 7fd38a884700 1 -- 172.21.15.80:0/1801200108 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd368018730 msgr2=0x7fd36801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.854+0000 7fd38a884700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd368018730 0x7fd36801abc0 crc :-1 s=READY pgs=121 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.854+0000 7fd38a884700 1 -- 172.21.15.80:0/1801200108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3841079b0 msgr2=0x7fd384107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.854+0000 7fd38a884700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3841079b0 0x7fd384107e40 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7fd3740103c0 tx=0x7fd374010760).stop 2019-11-28T11:25:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.854+0000 7fd38a884700 1 -- 172.21.15.80:0/1801200108 shutdown_connections 2019-11-28T11:25:48.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.854+0000 7fd38a884700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd384108380 0x7fd384168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.854+0000 7fd38a884700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3841079b0 0x7fd384107e40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.854+0000 7fd38a884700 1 --2- 172.21.15.80:0/1801200108 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd368018730 0x7fd36801abc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:48.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.854+0000 7fd38a884700 1 -- 172.21.15.80:0/1801200108 shutdown_connections 2019-11-28T11:25:48.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.854+0000 7fd38a884700 1 -- 172.21.15.80:0/1801200108 wait complete. 2019-11-28T11:25:48.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.854+0000 7fd38a884700 1 -- 172.21.15.80:0/1801200108 >> 172.21.15.80:0/1801200108 conn(0x7fd38415e2d0 msgr2=0x7fd384147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:48.884 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:25:49.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.987+0000 7f91bb6e5700 1 Processor -- start 2019-11-28T11:25:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.987+0000 7f91bb6e5700 1 -- start start 2019-11-28T11:25:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.988+0000 7f91bb6e5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f91b415ed10 0x7f91b415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.988+0000 7f91bb6e5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91b4073020 0x7f91b4071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.988+0000 7f91bb6e5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b406db60 con 0x7f91b40734b0 2019-11-28T11:25:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.988+0000 7f91bb6e5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b406fe00 con 0x7f91b415ed10 2019-11-28T11:25:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.988+0000 7f91bb6e5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40700d0 con 0x7f91b4073020 2019-11-28T11:25:49.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.989+0000 7f91b9c82700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f91b415ed10 0x7f91b415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:49.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.989+0000 7f91b9481700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91b4073020 0x7f91b4071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:49.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.989+0000 7f91b9c82700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f91b415ed10 0x7f91b415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:46848/0 (socket says 172.21.15.80:46848) 2019-11-28T11:25:49.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.989+0000 7f91b9c82700 1 -- 172.21.15.80:0/3459088678 learned_addr learned my addr 172.21.15.80:0/3459088678 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:49.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.989+0000 7f91b9481700 1 -- 172.21.15.80:0/3459088678 >> v2:172.21.15.174:3300/0 conn(0x7f91b415ed10 msgr2=0x7f91b415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:49.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.989+0000 7f91b9481700 1 --2- 172.21.15.80:0/3459088678 >> v2:172.21.15.174:3300/0 conn(0x7f91b415ed10 0x7f91b415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:49.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.989+0000 7f91b9481700 1 -- 172.21.15.80:0/3459088678 >> v1:172.21.15.174:6789/0 conn(0x7f91b40734b0 legacy=0x7f91b40723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.989+0000 7f91b9481700 1 -- 172.21.15.80:0/3459088678 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b4070760 con 0x7f91b4073020 2019-11-28T11:25:49.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.989+0000 7f91b9c82700 1 --2- 172.21.15.80:0/3459088678 >> v2:172.21.15.174:3300/0 conn(0x7f91b415ed10 0x7f91b415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:49.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.989+0000 7f91b9481700 1 --2- 172.21.15.80:0/3459088678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91b4073020 0x7f91b4071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f919c00af50 tx=0x7f919c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.989+0000 7f91b9481700 1 --2- 172.21.15.80:0/3459088678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91b4073020 0x7f91b4071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f919c00af50 tx=0x7f919c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.989+0000 7f91b9481700 1 --2- 172.21.15.80:0/3459088678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91b4073020 0x7f91b4071ea0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f919c00af50 tx=0x7f919c00b760).ready entity=mon.2 client_cookie=d1f0d5956ceca58d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:49.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.990+0000 7f91b9481700 1 --2- 172.21.15.80:0/3459088678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91b4073020 0x7f91b4071ea0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f919c00af50 tx=0x7f919c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.990+0000 7f91b9481700 1 --2- 172.21.15.80:0/3459088678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91b4073020 0x7f91b4071ea0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f919c00af50 tx=0x7f919c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.990+0000 7f91b8c80700 1 -- 172.21.15.80:0/3459088678 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f919c007210 con 0x7f91b4073020 2019-11-28T11:25:49.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.990+0000 7f91b9481700 1 --2- 172.21.15.80:0/3459088678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91b4073020 0x7f91b4071ea0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f919c00af50 tx=0x7f919c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.990+0000 7f91b8c80700 1 -- 172.21.15.80:0/3459088678 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c0099b0 con 0x7f91b4073020 2019-11-28T11:25:49.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.990+0000 7f91b8c80700 1 -- 172.21.15.80:0/3459088678 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f919c00a080 con 0x7f91b4073020 2019-11-28T11:25:49.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.990+0000 7f91bb6e5700 1 -- 172.21.15.80:0/3459088678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91b4073020 msgr2=0x7f91b4071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.990+0000 7f91bb6e5700 1 --2- 172.21.15.80:0/3459088678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91b4073020 0x7f91b4071ea0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f919c00af50 tx=0x7f919c00b760).stop 2019-11-28T11:25:49.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.990+0000 7f91bb6e5700 1 -- 172.21.15.80:0/3459088678 shutdown_connections 2019-11-28T11:25:49.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.990+0000 7f91bb6e5700 1 --2- 172.21.15.80:0/3459088678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91b4073020 0x7f91b4071ea0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:49.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.990+0000 7f91bb6e5700 1 --2- 172.21.15.80:0/3459088678 >> v2:172.21.15.174:3300/0 conn(0x7f91b415ed10 0x7f91b415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:49.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.990+0000 7f91bb6e5700 1 -- 172.21.15.80:0/3459088678 shutdown_connections 2019-11-28T11:25:49.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.991+0000 7f91bb6e5700 1 -- 172.21.15.80:0/3459088678 wait complete. 2019-11-28T11:25:49.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.991+0000 7f91bb6e5700 1 -- 172.21.15.80:0/3459088678 >> 172.21.15.80:0/3459088678 conn(0x7f91b4061d20 msgr2=0x7f91b40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:49.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.993+0000 7f91bb6e5700 1 Processor -- start 2019-11-28T11:25:49.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.993+0000 7f91bb6e5700 1 -- start start 2019-11-28T11:25:49.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91bb6e5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91b415faf0 0x7f91b41573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91bb6e5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f91b41578e0 0x7f91b4148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91bb6e5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b4104420 con 0x7f91b4148580 2019-11-28T11:25:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91bb6e5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b4111980 con 0x7f91b415faf0 2019-11-28T11:25:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91bb6e5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b4111c50 con 0x7f91b41578e0 2019-11-28T11:25:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b9c82700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91b415faf0 0x7f91b41573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b9c82700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91b415faf0 0x7f91b41573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60202/0 (socket says 172.21.15.80:60202) 2019-11-28T11:25:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b9c82700 1 -- 172.21.15.80:0/1663366926 learned_addr learned my addr 172.21.15.80:0/1663366926 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:49.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b9481700 1 --2- 172.21.15.80:0/1663366926 >> v2:172.21.15.174:3300/0 conn(0x7f91b41578e0 0x7f91b4148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:49.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b9c82700 1 -- 172.21.15.80:0/1663366926 >> v2:172.21.15.174:3300/0 conn(0x7f91b41578e0 msgr2=0x7f91b4148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b9c82700 1 --2- 172.21.15.80:0/1663366926 >> v2:172.21.15.174:3300/0 conn(0x7f91b41578e0 0x7f91b4148040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:49.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b9c82700 1 -- 172.21.15.80:0/1663366926 >> v1:172.21.15.174:6789/0 conn(0x7f91b4148580 legacy=0x7f91b412bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b9c82700 1 -- 172.21.15.80:0/1663366926 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b41122e0 con 0x7f91b415faf0 2019-11-28T11:25:49.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b9c82700 1 --2- 172.21.15.80:0/1663366926 >> v2:172.21.15.80:3300/0 conn(0x7f91b415faf0 0x7f91b41573a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f91a4010460 tx=0x7f91a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b9c82700 1 --2- 172.21.15.80:0/1663366926 >> v2:172.21.15.80:3300/0 conn(0x7f91b415faf0 0x7f91b41573a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f91a4010460 tx=0x7f91a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b9c82700 1 --2- 172.21.15.80:0/1663366926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91b415faf0 0x7f91b41573a0 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7f91a4010460 tx=0x7f91a4010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:49.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b9c82700 1 --2- 172.21.15.80:0/1663366926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91b415faf0 0x7f91b41573a0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f91a4010460 tx=0x7f91a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b27fc700 1 -- 172.21.15.80:0/1663366926 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91a4000940 con 0x7f91b415faf0 2019-11-28T11:25:49.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b9c82700 1 --2- 172.21.15.80:0/1663366926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91b415faf0 0x7f91b41573a0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f91a4010460 tx=0x7f91a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b9c82700 1 --2- 172.21.15.80:0/1663366926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91b415faf0 0x7f91b41573a0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f91a4010460 tx=0x7f91a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b27fc700 1 -- 172.21.15.80:0/1663366926 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a4000e80 con 0x7f91b415faf0 2019-11-28T11:25:49.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91bb6e5700 1 -- 172.21.15.80:0/1663366926 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b4112660 con 0x7f91b415faf0 2019-11-28T11:25:49.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.994+0000 7f91b27fc700 1 -- 172.21.15.80:0/1663366926 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91a4001070 con 0x7f91b415faf0 2019-11-28T11:25:49.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.995+0000 7f91bb6e5700 1 -- 172.21.15.80:0/1663366926 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b41122e0 con 0x7f91b415faf0 2019-11-28T11:25:49.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.995+0000 7f91b9c82700 1 --2- 172.21.15.80:0/1663366926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91b415faf0 0x7f91b41573a0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f91a4010460 tx=0x7f91a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.995+0000 7f91b27fc700 1 -- 172.21.15.80:0/1663366926 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f91a4001070 con 0x7f91b415faf0 2019-11-28T11:25:49.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.995+0000 7f91b9c82700 1 --2- 172.21.15.80:0/1663366926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91b415faf0 0x7f91b41573a0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f91a4010460 tx=0x7f91a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.995+0000 7f91b27fc700 1 --2- 172.21.15.80:0/1663366926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9198018730 0x7f919801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:49.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.995+0000 7f91b27fc700 1 -- 172.21.15.80:0/1663366926 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f91a4031cf0 con 0x7f91b415faf0 2019-11-28T11:25:49.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.995+0000 7f91b9481700 1 --2- 172.21.15.80:0/1663366926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9198018730 0x7f919801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:49.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:48.996+0000 7f91b9481700 1 --2- 172.21.15.80:0/1663366926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9198018730 0x7f919801abe0 crc :-1 s=READY pgs=122 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:49.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.003+0000 7f91bb6e5700 1 -- 172.21.15.80:0/1663366926 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b4112660 con 0x7f91b415faf0 2019-11-28T11:25:49.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.006+0000 7f91b9c82700 1 --2- 172.21.15.80:0/1663366926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91b415faf0 0x7f91b41573a0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f91a4010460 tx=0x7f91a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.006+0000 7f91b27fc700 1 -- 172.21.15.80:0/1663366926 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f91a4007610 con 0x7f91b415faf0 2019-11-28T11:25:49.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.172+0000 7f91bb6e5700 1 -- 172.21.15.80:0/1663366926 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f91b41122e0 con 0x7f91b415faf0 2019-11-28T11:25:49.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.173+0000 7f91b9c82700 1 --2- 172.21.15.80:0/1663366926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91b415faf0 0x7f91b41573a0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f91a4010460 tx=0x7f91a4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.173+0000 7f91b27fc700 1 -- 172.21.15.80:0/1663366926 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f91a4017410 con 0x7f91b415faf0 2019-11-28T11:25:49.194 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:49.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.175+0000 7f91bb6e5700 1 -- 172.21.15.80:0/1663366926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9198018730 msgr2=0x7f919801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.175+0000 7f91bb6e5700 1 --2- 172.21.15.80:0/1663366926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9198018730 0x7f919801abe0 crc :-1 s=READY pgs=122 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:49.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.175+0000 7f91bb6e5700 1 -- 172.21.15.80:0/1663366926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91b415faf0 msgr2=0x7f91b41573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.175+0000 7f91bb6e5700 1 --2- 172.21.15.80:0/1663366926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91b415faf0 0x7f91b41573a0 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7f91a4010460 tx=0x7f91a4010290).stop 2019-11-28T11:25:49.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.175+0000 7f91bb6e5700 1 -- 172.21.15.80:0/1663366926 shutdown_connections 2019-11-28T11:25:49.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.175+0000 7f91bb6e5700 1 --2- 172.21.15.80:0/1663366926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9198018730 0x7f919801abe0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:49.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.175+0000 7f91bb6e5700 1 --2- 172.21.15.80:0/1663366926 >> v2:172.21.15.174:3300/0 conn(0x7f91b41578e0 0x7f91b4148040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:49.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.175+0000 7f91bb6e5700 1 --2- 172.21.15.80:0/1663366926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91b415faf0 0x7f91b41573a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:49.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.176+0000 7f91bb6e5700 1 -- 172.21.15.80:0/1663366926 shutdown_connections 2019-11-28T11:25:49.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.176+0000 7f91bb6e5700 1 -- 172.21.15.80:0/1663366926 wait complete. 2019-11-28T11:25:49.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.176+0000 7f91bb6e5700 1 -- 172.21.15.80:0/1663366926 >> 172.21.15.80:0/1663366926 conn(0x7f91b407c4f0 msgr2=0x7f91b415ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:49.206 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:25:49.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.308+0000 7f82b5842700 1 Processor -- start 2019-11-28T11:25:49.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.308+0000 7f82b5842700 1 -- start start 2019-11-28T11:25:49.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.309+0000 7f82b5842700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f82b015f100 0x7f82b006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:49.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.309+0000 7f82b5842700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b006db60 con 0x7f82b006c2f0 2019-11-28T11:25:49.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.309+0000 7f82b5842700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b006e060 con 0x7f82b015ed10 2019-11-28T11:25:49.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.309+0000 7f82b5842700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b006fe00 con 0x7f82b015f100 2019-11-28T11:25:49.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.309+0000 7f82aeffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f82b015f100 0x7f82b006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:49.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.309+0000 7f82af7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f82b015ed10 0x7f82b0073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:46836/0 (socket says 172.21.15.80:46836) 2019-11-28T11:25:49.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.309+0000 7f82af7fe700 1 -- 172.21.15.80:0/2415421725 learned_addr learned my addr 172.21.15.80:0/2415421725 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:49.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.309+0000 7f82aeffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f82b015f100 0x7f82b006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60212/0 (socket says 172.21.15.80:60212) 2019-11-28T11:25:49.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.309+0000 7f82affff700 1 --1- 172.21.15.80:0/2415421725 >> v1:172.21.15.80:6789/0 conn(0x7f82b006c2f0 0x7f82b006c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59526/0 (socket says 172.21.15.80:59526) 2019-11-28T11:25:49.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.309+0000 7f82ae7fc700 1 -- 172.21.15.80:0/2415421725 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351698729 0 0) 0x7f8298001100 con 0x7f82b015ed10 2019-11-28T11:25:49.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.310+0000 7f82ae7fc700 1 -- 172.21.15.80:0/2415421725 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8290002e80 con 0x7f82b015ed10 2019-11-28T11:25:49.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.310+0000 7f82aeffd700 1 -- 172.21.15.80:0/2415421725 >> v1:172.21.15.174:6789/0 conn(0x7f82b015ed10 legacy=0x7f82b0073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.310+0000 7f82ae7fc700 1 -- 172.21.15.80:0/2415421725 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705547066 0 0) 0x7f82a8000d30 con 0x7f82b006c2f0 2019-11-28T11:25:49.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.310+0000 7f82aeffd700 1 -- 172.21.15.80:0/2415421725 >> v1:172.21.15.80:6789/0 conn(0x7f82b006c2f0 legacy=0x7f82b006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.310+0000 7f82aeffd700 1 -- 172.21.15.80:0/2415421725 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b0070760 con 0x7f82b015f100 2019-11-28T11:25:49.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.310+0000 7f82aeffd700 1 --2- 172.21.15.80:0/2415421725 >> v2:172.21.15.80:3300/0 conn(0x7f82b015f100 0x7f82b006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f82a000af50 tx=0x7f82a000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.310+0000 7f82aeffd700 1 --2- 172.21.15.80:0/2415421725 >> v2:172.21.15.80:3300/0 conn(0x7f82b015f100 0x7f82b006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f82a000af50 tx=0x7f82a000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.310+0000 7f82aeffd700 1 --2- 172.21.15.80:0/2415421725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82b015f100 0x7f82b006bdb0 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f82a000af50 tx=0x7f82a000b760).ready entity=mon.0 client_cookie=a617eb9d407e29f1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:49.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.310+0000 7f82aeffd700 1 --2- 172.21.15.80:0/2415421725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82b015f100 0x7f82b006bdb0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f82a000af50 tx=0x7f82a000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.310+0000 7f82ae7fc700 1 -- 172.21.15.80:0/2415421725 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82a0000960 con 0x7f82b015f100 2019-11-28T11:25:49.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.310+0000 7f82aeffd700 1 --2- 172.21.15.80:0/2415421725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82b015f100 0x7f82b006bdb0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f82a000af50 tx=0x7f82a000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.310+0000 7f82ae7fc700 1 -- 172.21.15.80:0/2415421725 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a0009860 con 0x7f82b015f100 2019-11-28T11:25:49.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.310+0000 7f82aeffd700 1 --2- 172.21.15.80:0/2415421725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82b015f100 0x7f82b006bdb0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f82a000af50 tx=0x7f82a000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.310+0000 7f82ae7fc700 1 -- 172.21.15.80:0/2415421725 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82a0000960 con 0x7f82b015f100 2019-11-28T11:25:49.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.310+0000 7f82b5842700 1 -- 172.21.15.80:0/2415421725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82b015f100 msgr2=0x7f82b006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.310+0000 7f82b5842700 1 --2- 172.21.15.80:0/2415421725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82b015f100 0x7f82b006bdb0 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f82a000af50 tx=0x7f82a000b760).stop 2019-11-28T11:25:49.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.311+0000 7f82b5842700 1 -- 172.21.15.80:0/2415421725 shutdown_connections 2019-11-28T11:25:49.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.311+0000 7f82b5842700 1 --2- 172.21.15.80:0/2415421725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82b015f100 0x7f82b006bdb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:49.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.311+0000 7f82b5842700 1 -- 172.21.15.80:0/2415421725 shutdown_connections 2019-11-28T11:25:49.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.311+0000 7f82b5842700 1 -- 172.21.15.80:0/2415421725 wait complete. 2019-11-28T11:25:49.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.311+0000 7f82b5842700 1 -- 172.21.15.80:0/2415421725 >> 172.21.15.80:0/2415421725 conn(0x7f82b0061d20 msgr2=0x7f82b00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:49.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.313+0000 7f82b5842700 1 Processor -- start 2019-11-28T11:25:49.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.313+0000 7f82b5842700 1 -- start start 2019-11-28T11:25:49.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.314+0000 7f82b5842700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82b012ead0 0x7f82b007c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:49.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.314+0000 7f82b5842700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b0165990 con 0x7f82b0101e80 2019-11-28T11:25:49.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.314+0000 7f82b5842700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b0106bb0 con 0x7f82b0128430 2019-11-28T11:25:49.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.314+0000 7f82b5842700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00793b0 con 0x7f82b012ead0 2019-11-28T11:25:49.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.314+0000 7f82aeffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f82b0101e80 0x7f82b007b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59534/0 (socket says 172.21.15.80:59534) 2019-11-28T11:25:49.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.314+0000 7f82aeffd700 1 -- 172.21.15.80:0/2623958762 learned_addr learned my addr 172.21.15.80:0/2623958762 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:49.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.314+0000 7f82affff700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82b012ead0 0x7f82b007c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:49.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82a7fff700 1 -- 172.21.15.80:0/2623958762 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564605812 0 0) 0x7f82a000ac00 con 0x7f82b0101e80 2019-11-28T11:25:49.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82a7fff700 1 -- 172.21.15.80:0/2623958762 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8288002e80 con 0x7f82b0101e80 2019-11-28T11:25:49.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82a7fff700 1 -- 172.21.15.80:0/2623958762 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436355721 0 0) 0x7f8298000e70 con 0x7f82b0128430 2019-11-28T11:25:49.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82a7fff700 1 -- 172.21.15.80:0/2623958762 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82880030b0 con 0x7f82b0128430 2019-11-28T11:25:49.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82affff700 1 -- 172.21.15.80:0/2623958762 >> v1:172.21.15.174:6789/0 conn(0x7f82b0128430 legacy=0x7f82b0165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82affff700 1 -- 172.21.15.80:0/2623958762 >> v1:172.21.15.80:6789/0 conn(0x7f82b0101e80 legacy=0x7f82b007b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82affff700 1 -- 172.21.15.80:0/2623958762 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b0079d10 con 0x7f82b012ead0 2019-11-28T11:25:49.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82affff700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82b012ead0 0x7f82b007c5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f82a8010700 tx=0x7f82a8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82affff700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82b012ead0 0x7f82b007c5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f82a8010700 tx=0x7f82a8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82affff700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82b012ead0 0x7f82b007c5d0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f82a8010700 tx=0x7f82a8010aa0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:49.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82affff700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82b012ead0 0x7f82b007c5d0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f82a8010700 tx=0x7f82a8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82a7fff700 1 -- 172.21.15.80:0/2623958762 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82a8000cc0 con 0x7f82b012ead0 2019-11-28T11:25:49.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82affff700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82b012ead0 0x7f82b007c5d0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f82a8010700 tx=0x7f82a8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82affff700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82b012ead0 0x7f82b007c5d0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f82a8010700 tx=0x7f82a8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82a7fff700 1 -- 172.21.15.80:0/2623958762 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a80017f0 con 0x7f82b012ead0 2019-11-28T11:25:49.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82b5842700 1 -- 172.21.15.80:0/2623958762 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b007a090 con 0x7f82b012ead0 2019-11-28T11:25:49.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82a7fff700 1 -- 172.21.15.80:0/2623958762 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82a8001ec0 con 0x7f82b012ead0 2019-11-28T11:25:49.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82b5842700 1 -- 172.21.15.80:0/2623958762 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b0079d10 con 0x7f82b012ead0 2019-11-28T11:25:49.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.315+0000 7f82affff700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82b012ead0 0x7f82b007c5d0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f82a8010700 tx=0x7f82a8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.316+0000 7f82a7fff700 1 -- 172.21.15.80:0/2623958762 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f82a8001390 con 0x7f82b012ead0 2019-11-28T11:25:49.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.316+0000 7f82affff700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82b012ead0 0x7f82b007c5d0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f82a8010700 tx=0x7f82a8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.316+0000 7f82a7fff700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8288018750 0x7f828801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:49.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.316+0000 7f82a7fff700 1 -- 172.21.15.80:0/2623958762 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f82a8031e10 con 0x7f82b012ead0 2019-11-28T11:25:49.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.316+0000 7f82af7fe700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8288018750 0x7f828801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:49.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.316+0000 7f82af7fe700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8288018750 0x7f828801abe0 crc :-1 s=READY pgs=123 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:49.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.323+0000 7f82b5842700 1 -- 172.21.15.80:0/2623958762 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b007a090 con 0x7f82b012ead0 2019-11-28T11:25:49.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.327+0000 7f82affff700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82b012ead0 0x7f82b007c5d0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f82a8010700 tx=0x7f82a8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.327+0000 7f82a7fff700 1 -- 172.21.15.80:0/2623958762 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f82a8000cc0 con 0x7f82b012ead0 2019-11-28T11:25:49.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.495+0000 7f82b5842700 1 -- 172.21.15.80:0/2623958762 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f82b0079d10 con 0x7f82b012ead0 2019-11-28T11:25:49.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.495+0000 7f82affff700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82b012ead0 0x7f82b007c5d0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f82a8010700 tx=0x7f82a8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.496+0000 7f82a7fff700 1 -- 172.21.15.80:0/2623958762 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f82a8000f40 con 0x7f82b012ead0 2019-11-28T11:25:49.516 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:25:49.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.498+0000 7f82b5842700 1 -- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8288018750 msgr2=0x7f828801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.498+0000 7f82b5842700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8288018750 0x7f828801abe0 crc :-1 s=READY pgs=123 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:49.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.498+0000 7f82b5842700 1 -- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82b012ead0 msgr2=0x7f82b007c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.498+0000 7f82b5842700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82b012ead0 0x7f82b007c5d0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f82a8010700 tx=0x7f82a8010aa0).stop 2019-11-28T11:25:49.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.498+0000 7f82b5842700 1 -- 172.21.15.80:0/2623958762 shutdown_connections 2019-11-28T11:25:49.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.498+0000 7f82b5842700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82b012ead0 0x7f82b007c5d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:49.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.498+0000 7f82b5842700 1 --2- 172.21.15.80:0/2623958762 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8288018750 0x7f828801abe0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:49.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.498+0000 7f82b5842700 1 -- 172.21.15.80:0/2623958762 shutdown_connections 2019-11-28T11:25:49.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.498+0000 7f82b5842700 1 -- 172.21.15.80:0/2623958762 wait complete. 2019-11-28T11:25:49.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.498+0000 7f82b5842700 1 -- 172.21.15.80:0/2623958762 >> 172.21.15.80:0/2623958762 conn(0x7f82b0166440 msgr2=0x7f82b01494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:49.542 INFO:tasks.cephfs_test_runner:Starting test: test_network_death (tasks.cephfs.test_client_recovery.TestClientNetworkRecovery) 2019-11-28T11:25:49.543 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death' 2019-11-28T11:25:49.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.642+0000 7fac07cb8700 1 Processor -- start 2019-11-28T11:25:49.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.642+0000 7fac07cb8700 1 -- start start 2019-11-28T11:25:49.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac07cb8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fac0006c0a0 0x7fac00072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:49.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac07cb8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fac00072620 0x7fac00164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:49.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac07cb8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0006db00 con 0x7fac000734e0 2019-11-28T11:25:49.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac07cb8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0006fd60 con 0x7fac0006c0a0 2019-11-28T11:25:49.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac07cb8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac00070030 con 0x7fac00072620 2019-11-28T11:25:49.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac06255700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fac0006c0a0 0x7fac00072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:49.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac06255700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fac0006c0a0 0x7fac00072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60222/0 (socket says 172.21.15.80:60222) 2019-11-28T11:25:49.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac06255700 1 -- 172.21.15.80:0/2638689868 learned_addr learned my addr 172.21.15.80:0/2638689868 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:49.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac06a56700 1 --2- 172.21.15.80:0/2638689868 >> v2:172.21.15.174:3300/0 conn(0x7fac00072620 0x7fac00164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:49.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac06255700 1 -- 172.21.15.80:0/2638689868 >> v2:172.21.15.174:3300/0 conn(0x7fac00072620 msgr2=0x7fac00164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:49.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac06255700 1 --2- 172.21.15.80:0/2638689868 >> v2:172.21.15.174:3300/0 conn(0x7fac00072620 0x7fac00164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:49.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac06255700 1 -- 172.21.15.80:0/2638689868 >> v1:172.21.15.174:6789/0 conn(0x7fac000734e0 legacy=0x7fac00071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac06255700 1 -- 172.21.15.80:0/2638689868 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac000706c0 con 0x7fac0006c0a0 2019-11-28T11:25:49.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac06a56700 1 --2- 172.21.15.80:0/2638689868 >> v2:172.21.15.174:3300/0 conn(0x7fac00072620 0x7fac00164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:49.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac06255700 1 --2- 172.21.15.80:0/2638689868 >> v2:172.21.15.80:3300/0 conn(0x7fac0006c0a0 0x7fac00072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fabe800f740 tx=0x7fabe800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac06255700 1 --2- 172.21.15.80:0/2638689868 >> v2:172.21.15.80:3300/0 conn(0x7fac0006c0a0 0x7fac00072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fabe800f740 tx=0x7fabe800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac06255700 1 --2- 172.21.15.80:0/2638689868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac0006c0a0 0x7fac00072fa0 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7fabe800f740 tx=0x7fabe800fae0).ready entity=mon.0 client_cookie=b5d69c64e213abe8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:49.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac06255700 1 --2- 172.21.15.80:0/2638689868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac0006c0a0 0x7fac00072fa0 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fabe800f740 tx=0x7fabe800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.644+0000 7fac06255700 1 --2- 172.21.15.80:0/2638689868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac0006c0a0 0x7fac00072fa0 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fabe800f740 tx=0x7fabe800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.643+0000 7fac05253700 1 -- 172.21.15.80:0/2638689868 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabe8000960 con 0x7fac0006c0a0 2019-11-28T11:25:49.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.644+0000 7fac06255700 1 --2- 172.21.15.80:0/2638689868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac0006c0a0 0x7fac00072fa0 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fabe800f740 tx=0x7fabe800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.644+0000 7fac05253700 1 -- 172.21.15.80:0/2638689868 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe8000c90 con 0x7fac0006c0a0 2019-11-28T11:25:49.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.644+0000 7fac05253700 1 -- 172.21.15.80:0/2638689868 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabe80013a0 con 0x7fac0006c0a0 2019-11-28T11:25:49.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.644+0000 7fac07cb8700 1 -- 172.21.15.80:0/2638689868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac0006c0a0 msgr2=0x7fac00072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.644+0000 7fac07cb8700 1 --2- 172.21.15.80:0/2638689868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac0006c0a0 0x7fac00072fa0 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7fabe800f740 tx=0x7fabe800fae0).stop 2019-11-28T11:25:49.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.644+0000 7fac07cb8700 1 -- 172.21.15.80:0/2638689868 shutdown_connections 2019-11-28T11:25:49.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.644+0000 7fac07cb8700 1 --2- 172.21.15.80:0/2638689868 >> v2:172.21.15.174:3300/0 conn(0x7fac00072620 0x7fac00164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:49.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.644+0000 7fac07cb8700 1 --2- 172.21.15.80:0/2638689868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac0006c0a0 0x7fac00072fa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:49.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.644+0000 7fac07cb8700 1 -- 172.21.15.80:0/2638689868 shutdown_connections 2019-11-28T11:25:49.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.644+0000 7fac07cb8700 1 -- 172.21.15.80:0/2638689868 wait complete. 2019-11-28T11:25:49.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.644+0000 7fac07cb8700 1 -- 172.21.15.80:0/2638689868 >> 172.21.15.80:0/2638689868 conn(0x7fac00061cf0 msgr2=0x7fac00064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:49.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.647+0000 7fac07cb8700 1 Processor -- start 2019-11-28T11:25:49.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.647+0000 7fac07cb8700 1 -- start start 2019-11-28T11:25:49.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.648+0000 7fac07cb8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fac00129880 0x7fac0007ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:49.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.648+0000 7fac07cb8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0013f190 con 0x7fac0013e8e0 2019-11-28T11:25:49.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.648+0000 7fac07cb8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac001425f0 con 0x7fac001293f0 2019-11-28T11:25:49.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.648+0000 7fac07cb8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac00142d50 con 0x7fac00129880 2019-11-28T11:25:49.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.648+0000 7fac06255700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fac0013e8e0 0x7fac0007b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59544/0 (socket says 172.21.15.80:59544) 2019-11-28T11:25:49.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.648+0000 7fac06255700 1 -- 172.21.15.80:0/1178603160 learned_addr learned my addr 172.21.15.80:0/1178603160 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:49.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.648+0000 7fac06a56700 1 --2- 172.21.15.80:0/1178603160 >> v2:172.21.15.174:3300/0 conn(0x7fac00129880 0x7fac0007ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:49.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.648+0000 7fabfeffd700 1 -- 172.21.15.80:0/1178603160 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922954436 0 0) 0x7fabe8007e10 con 0x7fac0013e8e0 2019-11-28T11:25:49.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.648+0000 7fabfeffd700 1 -- 172.21.15.80:0/1178603160 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabe4002e80 con 0x7fac0013e8e0 2019-11-28T11:25:49.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.648+0000 7fabfeffd700 1 -- 172.21.15.80:0/1178603160 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3161448364 0 0) 0x7fabe80079e0 con 0x7fac0013e8e0 2019-11-28T11:25:49.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.648+0000 7fac06a56700 1 -- 172.21.15.80:0/1178603160 >> v1:172.21.15.174:6789/0 conn(0x7fac001293f0 legacy=0x7fac0007a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.648+0000 7fac06a56700 1 -- 172.21.15.80:0/1178603160 >> v1:172.21.15.80:6789/0 conn(0x7fac0013e8e0 legacy=0x7fac0007b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:49.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.648+0000 7fac06a56700 1 -- 172.21.15.80:0/1178603160 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac00078c00 con 0x7fac00129880 2019-11-28T11:25:49.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.648+0000 7fac06a56700 1 --2- 172.21.15.80:0/1178603160 >> v2:172.21.15.174:3300/0 conn(0x7fac00129880 0x7fac0007ab40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fabf80103a0 tx=0x7fabf8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.648+0000 7fac06a56700 1 --2- 172.21.15.80:0/1178603160 >> v2:172.21.15.174:3300/0 conn(0x7fac00129880 0x7fac0007ab40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fabf80103a0 tx=0x7fabf8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.648+0000 7fac06a56700 1 --2- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac00129880 0x7fac0007ab40 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7fabf80103a0 tx=0x7fabf8010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:49.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.649+0000 7fac06a56700 1 --2- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac00129880 0x7fac0007ab40 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fabf80103a0 tx=0x7fabf8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.649+0000 7fabfeffd700 1 -- 172.21.15.80:0/1178603160 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabf800ab90 con 0x7fac00129880 2019-11-28T11:25:49.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.649+0000 7fac06a56700 1 --2- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac00129880 0x7fac0007ab40 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fabf80103a0 tx=0x7fabf8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.649+0000 7fac06a56700 1 --2- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac00129880 0x7fac0007ab40 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fabf80103a0 tx=0x7fabf8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.649+0000 7fabfeffd700 1 -- 172.21.15.80:0/1178603160 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf80095b0 con 0x7fac00129880 2019-11-28T11:25:49.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.649+0000 7fac07cb8700 1 -- 172.21.15.80:0/1178603160 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac00078f80 con 0x7fac00129880 2019-11-28T11:25:49.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.649+0000 7fabfeffd700 1 -- 172.21.15.80:0/1178603160 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabf8009d00 con 0x7fac00129880 2019-11-28T11:25:49.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.649+0000 7fac07cb8700 1 -- 172.21.15.80:0/1178603160 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac00078c00 con 0x7fac00129880 2019-11-28T11:25:49.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.649+0000 7fac06a56700 1 --2- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac00129880 0x7fac0007ab40 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fabf80103a0 tx=0x7fabf8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.649+0000 7fabfeffd700 1 -- 172.21.15.80:0/1178603160 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fabf80097a0 con 0x7fac00129880 2019-11-28T11:25:49.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.649+0000 7fac06a56700 1 --2- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac00129880 0x7fac0007ab40 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fabf80103a0 tx=0x7fabf8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.649+0000 7fabfeffd700 1 --2- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fabe4018780 0x7fabe401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:49.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.649+0000 7fabfeffd700 1 -- 172.21.15.80:0/1178603160 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fabf8031a90 con 0x7fac00129880 2019-11-28T11:25:49.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.650+0000 7fac06255700 1 --2- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fabe4018780 0x7fabe401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:49.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.650+0000 7fac06255700 1 --2- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fabe4018780 0x7fabe401abf0 crc :-1 s=READY pgs=124 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:49.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.657+0000 7fac07cb8700 1 -- 172.21.15.80:0/1178603160 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac00078f80 con 0x7fac00129880 2019-11-28T11:25:49.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.661+0000 7fac06a56700 1 --2- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac00129880 0x7fac0007ab40 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fabf80103a0 tx=0x7fabf8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:49.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.661+0000 7fabfeffd700 1 -- 172.21.15.80:0/1178603160 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fabf802af40 con 0x7fac00129880 2019-11-28T11:25:49.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:49.833+0000 7fac07cb8700 1 -- 172.21.15.80:0/1178603160 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death"]} v 0) v1 -- 0x7fac00078c00 con 0x7fac00129880 2019-11-28T11:25:50.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:50.613+0000 7fac06a56700 1 --2- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac00129880 0x7fac0007ab40 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fabf80103a0 tx=0x7fabf8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:50.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:50.613+0000 7fabfeffd700 1 -- 172.21.15.80:0/1178603160 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death"]}]=0 v53) v1 ==== 160+0+0 (secure 0 0 0) 0x7fabf80097a0 con 0x7fac00129880 2019-11-28T11:25:50.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:50.651+0000 7fac07cb8700 1 -- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fabe4018780 msgr2=0x7fabe401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:50.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:50.651+0000 7fac07cb8700 1 --2- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fabe4018780 0x7fabe401abf0 crc :-1 s=READY pgs=124 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:50.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:50.651+0000 7fac07cb8700 1 -- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac00129880 msgr2=0x7fac0007ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:50.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:50.651+0000 7fac07cb8700 1 --2- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac00129880 0x7fac0007ab40 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7fabf80103a0 tx=0x7fabf8010740).stop 2019-11-28T11:25:50.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:50.651+0000 7fac07cb8700 1 -- 172.21.15.80:0/1178603160 shutdown_connections 2019-11-28T11:25:50.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:50.651+0000 7fac07cb8700 1 --2- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac00129880 0x7fac0007ab40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:50.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:50.651+0000 7fac07cb8700 1 --2- 172.21.15.80:0/1178603160 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fabe4018780 0x7fabe401abf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:50.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:50.651+0000 7fac07cb8700 1 -- 172.21.15.80:0/1178603160 shutdown_connections 2019-11-28T11:25:50.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:50.651+0000 7fac07cb8700 1 -- 172.21.15.80:0/1178603160 wait complete. 2019-11-28T11:25:50.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:50.651+0000 7fac07cb8700 1 -- 172.21.15.80:0/1178603160 >> 172.21.15.80:0/1178603160 conn(0x7fac0013b860 msgr2=0x7fac001050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:50.687 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:25:50.688 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:25:50.774 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:25:50.908 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:25:51.000 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:25:51.075 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:25:51.152 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:25:51.227 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:25:51.288 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:25:51.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:25:51.289 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2019-11-28T11:25:51.364 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:25:51.368 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:25:51.414 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:25:51.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:25:51.415 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2019-11-28T11:25:51.488 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:25:51.492 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:25:51.544 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2019-11-28T11:25:51.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:25:51.545 INFO:teuthology.orchestra.run.smithi075:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2019-11-28T11:25:51.615 INFO:teuthology.orchestra.run.smithi075:> rmdir -- /home/ubuntu/cephtest/mnt.2 2019-11-28T11:25:51.619 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:25:51.672 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2019-11-28T11:25:51.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:25:51.672 INFO:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2019-11-28T11:25:51.792 INFO:teuthology.orchestra.run.smithi133:> rmdir -- /home/ubuntu/cephtest/mnt.3 2019-11-28T11:25:51.796 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:25:51.849 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:25:51.849 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:25:51.850 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:25:51.850 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:25:51.850 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:25:51.850 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:25:51.855 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:25:51.856 DEBUG:teuthology.parallel:result is None 2019-11-28T11:25:51.858 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:25:51.858 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:25:51.859 DEBUG:teuthology.parallel:result is None 2019-11-28T11:25:51.859 DEBUG:teuthology.parallel:result is None 2019-11-28T11:25:51.859 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:25:51.860 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:25:51.860 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:25:52.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.040+0000 7feb32f53700 1 Processor -- start 2019-11-28T11:25:52.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.040+0000 7feb32f53700 1 -- start start 2019-11-28T11:25:52.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.041+0000 7feb32f53700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7feb2c06c0a0 0x7feb2c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:52.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.041+0000 7feb32f53700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb2c072620 0x7feb2c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:52.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.041+0000 7feb32f53700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2c06db00 con 0x7feb2c0734e0 2019-11-28T11:25:52.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.041+0000 7feb32f53700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2c06fd60 con 0x7feb2c06c0a0 2019-11-28T11:25:52.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.041+0000 7feb32f53700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c070030 con 0x7feb2c072620 2019-11-28T11:25:52.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7feb314f0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7feb2c06c0a0 0x7feb2c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7feb314f0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7feb2c06c0a0 0x7feb2c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:46898/0 (socket says 172.21.15.80:46898) 2019-11-28T11:25:52.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7feb30cef700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7feb2c0734e0 0x7feb2c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:46870/0 (socket says 172.21.15.80:46870) 2019-11-28T11:25:52.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7feb314f0700 1 -- 172.21.15.80:0/1000221720 learned_addr learned my addr 172.21.15.80:0/1000221720 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7feb31cf1700 1 --2- 172.21.15.80:0/1000221720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb2c072620 0x7feb2c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7feb314f0700 1 -- 172.21.15.80:0/1000221720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb2c072620 msgr2=0x7feb2c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7feb314f0700 1 --2- 172.21.15.80:0/1000221720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb2c072620 0x7feb2c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7feb314f0700 1 -- 172.21.15.80:0/1000221720 >> v1:172.21.15.174:6789/0 conn(0x7feb2c0734e0 legacy=0x7feb2c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7feb314f0700 1 -- 172.21.15.80:0/1000221720 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c0706c0 con 0x7feb2c06c0a0 2019-11-28T11:25:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7feb314f0700 1 --2- 172.21.15.80:0/1000221720 >> v2:172.21.15.174:3300/0 conn(0x7feb2c06c0a0 0x7feb2c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feb2000fa40 tx=0x7feb2000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7feb314f0700 1 --2- 172.21.15.80:0/1000221720 >> v2:172.21.15.174:3300/0 conn(0x7feb2c06c0a0 0x7feb2c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feb2000fa40 tx=0x7feb2000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7feb314f0700 1 --2- 172.21.15.80:0/1000221720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb2c06c0a0 0x7feb2c072fa0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7feb2000fa40 tx=0x7feb2000fde0).ready entity=mon.1 client_cookie=22a7e7126fc7a80c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7feb314f0700 1 --2- 172.21.15.80:0/1000221720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb2c06c0a0 0x7feb2c072fa0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7feb2000fa40 tx=0x7feb2000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7feb2bfff700 1 -- 172.21.15.80:0/1000221720 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb20000ce0 con 0x7feb2c06c0a0 2019-11-28T11:25:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7feb314f0700 1 --2- 172.21.15.80:0/1000221720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb2c06c0a0 0x7feb2c072fa0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7feb2000fa40 tx=0x7feb2000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7feb314f0700 1 --2- 172.21.15.80:0/1000221720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb2c06c0a0 0x7feb2c072fa0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7feb2000fa40 tx=0x7feb2000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7feb2bfff700 1 -- 172.21.15.80:0/1000221720 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb20001010 con 0x7feb2c06c0a0 2019-11-28T11:25:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7feb2bfff700 1 -- 172.21.15.80:0/1000221720 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb20001720 con 0x7feb2c06c0a0 2019-11-28T11:25:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7feb32f53700 1 -- 172.21.15.80:0/1000221720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb2c06c0a0 msgr2=0x7feb2c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7feb32f53700 1 --2- 172.21.15.80:0/1000221720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb2c06c0a0 0x7feb2c072fa0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7feb2000fa40 tx=0x7feb2000fde0).stop 2019-11-28T11:25:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.044+0000 7feb32f53700 1 -- 172.21.15.80:0/1000221720 shutdown_connections 2019-11-28T11:25:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.044+0000 7feb32f53700 1 --2- 172.21.15.80:0/1000221720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb2c072620 0x7feb2c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.044+0000 7feb32f53700 1 --2- 172.21.15.80:0/1000221720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb2c06c0a0 0x7feb2c072fa0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.044+0000 7feb32f53700 1 -- 172.21.15.80:0/1000221720 shutdown_connections 2019-11-28T11:25:52.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.044+0000 7feb32f53700 1 -- 172.21.15.80:0/1000221720 wait complete. 2019-11-28T11:25:52.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.044+0000 7feb32f53700 1 -- 172.21.15.80:0/1000221720 >> 172.21.15.80:0/1000221720 conn(0x7feb2c061cf0 msgr2=0x7feb2c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:52.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.046+0000 7feb32f53700 1 Processor -- start 2019-11-28T11:25:52.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.046+0000 7feb32f53700 1 -- start start 2019-11-28T11:25:52.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7feb32f53700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb2c13e8e0 0x7feb2c14fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:52.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7feb32f53700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb2c1500d0 0x7feb2c105fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:52.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7feb32f53700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7feb2c1064e0 0x7feb2c10e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:52.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7feb32f53700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2c10d240 con 0x7feb2c1500d0 2019-11-28T11:25:52.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7feb32f53700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2c10d510 con 0x7feb2c1064e0 2019-11-28T11:25:52.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7feb32f53700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c1048d0 con 0x7feb2c13e8e0 2019-11-28T11:25:52.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb30cef700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb2c1500d0 0x7feb2c105fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb314f0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb2c13e8e0 0x7feb2c14fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb30cef700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb2c1500d0 0x7feb2c105fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60272/0 (socket says 172.21.15.80:60272) 2019-11-28T11:25:52.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb30cef700 1 -- 172.21.15.80:0/1016701181 learned_addr learned my addr 172.21.15.80:0/1016701181 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:52.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb31cf1700 1 --2- 172.21.15.80:0/1016701181 >> v2:172.21.15.174:3300/0 conn(0x7feb2c1064e0 0x7feb2c10e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb30cef700 1 -- 172.21.15.80:0/1016701181 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb2c13e8e0 msgr2=0x7feb2c14fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb30cef700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb2c13e8e0 0x7feb2c14fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb30cef700 1 -- 172.21.15.80:0/1016701181 >> v2:172.21.15.174:3300/0 conn(0x7feb2c1064e0 msgr2=0x7feb2c10e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb30cef700 1 --2- 172.21.15.80:0/1016701181 >> v2:172.21.15.174:3300/0 conn(0x7feb2c1064e0 0x7feb2c10e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb30cef700 1 -- 172.21.15.80:0/1016701181 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c104c50 con 0x7feb2c1500d0 2019-11-28T11:25:52.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb30cef700 1 --2- 172.21.15.80:0/1016701181 >> v2:172.21.15.80:3300/0 conn(0x7feb2c1500d0 0x7feb2c105fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb18010440 tx=0x7feb18010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb30cef700 1 --2- 172.21.15.80:0/1016701181 >> v2:172.21.15.80:3300/0 conn(0x7feb2c1500d0 0x7feb2c105fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb18010440 tx=0x7feb18010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb30cef700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c1500d0 0x7feb2c105fa0 secure :-1 s=READY pgs=282 cs=0 l=1 rx=0x7feb18010440 tx=0x7feb18010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:52.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb30cef700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c1500d0 0x7feb2c105fa0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7feb18010440 tx=0x7feb18010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb29ffb700 1 -- 172.21.15.80:0/1016701181 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb180043b0 con 0x7feb2c1500d0 2019-11-28T11:25:52.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb32f53700 1 -- 172.21.15.80:0/1016701181 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2c104c50 con 0x7feb2c1500d0 2019-11-28T11:25:52.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7feb32f53700 1 -- 172.21.15.80:0/1016701181 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2c104c50 con 0x7feb2c1500d0 2019-11-28T11:25:52.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.049+0000 7feb30cef700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c1500d0 0x7feb2c105fa0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7feb18010440 tx=0x7feb18010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.049+0000 7feb30cef700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c1500d0 0x7feb2c105fa0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7feb18010440 tx=0x7feb18010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.049+0000 7feb29ffb700 1 -- 172.21.15.80:0/1016701181 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb18000c60 con 0x7feb2c1500d0 2019-11-28T11:25:52.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.049+0000 7feb29ffb700 1 -- 172.21.15.80:0/1016701181 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb180045a0 con 0x7feb2c1500d0 2019-11-28T11:25:52.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.050+0000 7feb30cef700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c1500d0 0x7feb2c105fa0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7feb18010440 tx=0x7feb18010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.050+0000 7feb29ffb700 1 -- 172.21.15.80:0/1016701181 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7feb180041c0 con 0x7feb2c1500d0 2019-11-28T11:25:52.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.050+0000 7feb30cef700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c1500d0 0x7feb2c105fa0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7feb18010440 tx=0x7feb18010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.050+0000 7feb29ffb700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb0c018730 0x7feb0c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:52.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.050+0000 7feb29ffb700 1 -- 172.21.15.80:0/1016701181 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7feb18031a00 con 0x7feb2c1500d0 2019-11-28T11:25:52.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.051+0000 7feb314f0700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb0c018730 0x7feb0c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.051+0000 7feb314f0700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb0c018730 0x7feb0c01abc0 crc :-1 s=READY pgs=127 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:52.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.056+0000 7feb32f53700 1 -- 172.21.15.80:0/1016701181 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb04002e60 con 0x7feb2c1500d0 2019-11-28T11:25:52.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.040+0000 7fe297a68700 1 Processor -- start 2019-11-28T11:25:52.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.040+0000 7fe297a68700 1 -- start start 2019-11-28T11:25:52.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.041+0000 7fe297a68700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe29006d120 0x7fe290165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:52.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.041+0000 7fe297a68700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29006d5a0 con 0x7fe29006c490 2019-11-28T11:25:52.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.041+0000 7fe297a68700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29005daa0 con 0x7fe29006c0a0 2019-11-28T11:25:52.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.041+0000 7fe297a68700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29006fd60 con 0x7fe29006d120 2019-11-28T11:25:52.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fe295804700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe29006c490 0x7fe29006c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59566/0 (socket says 172.21.15.80:59566) 2019-11-28T11:25:52.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fe295804700 1 -- 172.21.15.80:0/3536088772 learned_addr learned my addr 172.21.15.80:0/3536088772 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:52.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fe296806700 1 --2- 172.21.15.80:0/3536088772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe29006d120 0x7fe290165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fe296005700 1 --1- 172.21.15.80:0/3536088772 >> v1:172.21.15.174:6789/0 conn(0x7fe29006c0a0 0x7fe290072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:46876/0 (socket says 172.21.15.80:46876) 2019-11-28T11:25:52.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fe295003700 1 -- 172.21.15.80:0/3536088772 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046535191 0 0) 0x7fe284001100 con 0x7fe29006c490 2019-11-28T11:25:52.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fe295003700 1 -- 172.21.15.80:0/3536088772 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe278002e80 con 0x7fe29006c490 2019-11-28T11:25:52.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fe296806700 1 -- 172.21.15.80:0/3536088772 >> v1:172.21.15.174:6789/0 conn(0x7fe29006c0a0 legacy=0x7fe290072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fe296806700 1 -- 172.21.15.80:0/3536088772 >> v1:172.21.15.80:6789/0 conn(0x7fe29006c490 legacy=0x7fe29006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fe296806700 1 -- 172.21.15.80:0/3536088772 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2900706c0 con 0x7fe29006d120 2019-11-28T11:25:52.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fe296806700 1 --2- 172.21.15.80:0/3536088772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe29006d120 0x7fe290165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe28800af80 tx=0x7fe28800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fe296806700 1 --2- 172.21.15.80:0/3536088772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe29006d120 0x7fe290165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe28800af80 tx=0x7fe28800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fe296806700 1 --2- 172.21.15.80:0/3536088772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe29006d120 0x7fe290165d80 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7fe28800af80 tx=0x7fe28800b790).ready entity=mon.2 client_cookie=66bd5feb1ad4ac8f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:52.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fe296806700 1 --2- 172.21.15.80:0/3536088772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe29006d120 0x7fe290165d80 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fe28800af80 tx=0x7fe28800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fe295003700 1 -- 172.21.15.80:0/3536088772 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe288007240 con 0x7fe29006d120 2019-11-28T11:25:52.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fe296806700 1 --2- 172.21.15.80:0/3536088772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe29006d120 0x7fe290165d80 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fe28800af80 tx=0x7fe28800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fe295003700 1 -- 172.21.15.80:0/3536088772 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe288000bb0 con 0x7fe29006d120 2019-11-28T11:25:52.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fe296806700 1 --2- 172.21.15.80:0/3536088772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe29006d120 0x7fe290165d80 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fe28800af80 tx=0x7fe28800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fe295003700 1 -- 172.21.15.80:0/3536088772 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe288009c70 con 0x7fe29006d120 2019-11-28T11:25:52.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fe297a68700 1 -- 172.21.15.80:0/3536088772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe29006d120 msgr2=0x7fe290165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fe297a68700 1 --2- 172.21.15.80:0/3536088772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe29006d120 0x7fe290165d80 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7fe28800af80 tx=0x7fe28800b790).stop 2019-11-28T11:25:52.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.044+0000 7fe297a68700 1 -- 172.21.15.80:0/3536088772 shutdown_connections 2019-11-28T11:25:52.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.044+0000 7fe297a68700 1 --2- 172.21.15.80:0/3536088772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe29006d120 0x7fe290165d80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.044+0000 7fe297a68700 1 -- 172.21.15.80:0/3536088772 shutdown_connections 2019-11-28T11:25:52.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.044+0000 7fe297a68700 1 -- 172.21.15.80:0/3536088772 wait complete. 2019-11-28T11:25:52.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.044+0000 7fe297a68700 1 -- 172.21.15.80:0/3536088772 >> 172.21.15.80:0/3536088772 conn(0x7fe290061cf0 msgr2=0x7fe290064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:52.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.046+0000 7fe297a68700 1 Processor -- start 2019-11-28T11:25:52.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.046+0000 7fe297a68700 1 -- start start 2019-11-28T11:25:52.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fe297a68700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe290164ff0 0x7fe2901653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:52.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fe297a68700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe290078190 0x7fe290077380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:52.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fe297a68700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe290141bc0 con 0x7fe290077d00 2019-11-28T11:25:52.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fe297a68700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29012c5e0 con 0x7fe290078190 2019-11-28T11:25:52.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fe297a68700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29012d010 con 0x7fe290164ff0 2019-11-28T11:25:52.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fe296806700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe290078190 0x7fe290077380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fe296806700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe290078190 0x7fe290077380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60262/0 (socket says 172.21.15.80:60262) 2019-11-28T11:25:52.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fe296806700 1 -- 172.21.15.80:0/1166555114 learned_addr learned my addr 172.21.15.80:0/1166555114 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:52.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fe296005700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe290164ff0 0x7fe2901653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fe296806700 1 -- 172.21.15.80:0/1166555114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe290164ff0 msgr2=0x7fe2901653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fe296806700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe290164ff0 0x7fe2901653e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fe296806700 1 -- 172.21.15.80:0/1166555114 >> v1:172.21.15.174:6789/0 conn(0x7fe290077d00 legacy=0x7fe290076b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fe296806700 1 -- 172.21.15.80:0/1166555114 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29012d970 con 0x7fe290078190 2019-11-28T11:25:52.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fe296806700 1 --2- 172.21.15.80:0/1166555114 >> v2:172.21.15.80:3300/0 conn(0x7fe290078190 0x7fe290077380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe288010450 tx=0x7fe2880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fe296806700 1 --2- 172.21.15.80:0/1166555114 >> v2:172.21.15.80:3300/0 conn(0x7fe290078190 0x7fe290077380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe288010450 tx=0x7fe2880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fe296806700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe290078190 0x7fe290077380 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7fe288010450 tx=0x7fe2880107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:52.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fe296806700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe290078190 0x7fe290077380 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7fe288010450 tx=0x7fe2880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fe28effd700 1 -- 172.21.15.80:0/1166555114 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2880097c0 con 0x7fe290078190 2019-11-28T11:25:52.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fe296806700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe290078190 0x7fe290077380 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7fe288010450 tx=0x7fe2880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fe28effd700 1 -- 172.21.15.80:0/1166555114 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28800afe0 con 0x7fe290078190 2019-11-28T11:25:52.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fe296806700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe290078190 0x7fe290077380 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7fe288010450 tx=0x7fe2880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fe297a68700 1 -- 172.21.15.80:0/1166555114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29012dcf0 con 0x7fe290078190 2019-11-28T11:25:52.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fe28effd700 1 -- 172.21.15.80:0/1166555114 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe288009ba0 con 0x7fe290078190 2019-11-28T11:25:52.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fe297a68700 1 -- 172.21.15.80:0/1166555114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29012d970 con 0x7fe290078190 2019-11-28T11:25:52.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.049+0000 7fe296806700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe290078190 0x7fe290077380 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7fe288010450 tx=0x7fe2880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.049+0000 7fe28effd700 1 -- 172.21.15.80:0/1166555114 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe28800a280 con 0x7fe290078190 2019-11-28T11:25:52.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.049+0000 7fe296806700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe290078190 0x7fe290077380 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7fe288010450 tx=0x7fe2880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.049+0000 7fe28effd700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe270018730 0x7fe27001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:52.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.049+0000 7fe28effd700 1 -- 172.21.15.80:0/1166555114 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fe288031b20 con 0x7fe290078190 2019-11-28T11:25:52.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.050+0000 7fe296005700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe270018730 0x7fe27001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.050+0000 7fe296005700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe270018730 0x7fe27001abc0 crc :-1 s=READY pgs=125 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:52.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.056+0000 7fe297a68700 1 -- 172.21.15.80:0/1166555114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29012dcf0 con 0x7fe290078190 2019-11-28T11:25:52.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.040+0000 7fbf1f3c8700 1 Processor -- start 2019-11-28T11:25:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.040+0000 7fbf1f3c8700 1 -- start start 2019-11-28T11:25:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.041+0000 7fbf1f3c8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf1806d120 0x7fbf18165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.041+0000 7fbf1f3c8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1806d580 con 0x7fbf1806c490 2019-11-28T11:25:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.041+0000 7fbf1f3c8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1806db00 con 0x7fbf1806c0a0 2019-11-28T11:25:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.041+0000 7fbf1f3c8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1806fd60 con 0x7fbf1806d120 2019-11-28T11:25:52.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.041+0000 7fbf1d164700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbf1806c490 0x7fbf1806c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59556/0 (socket says 172.21.15.80:59556) 2019-11-28T11:25:52.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.041+0000 7fbf1d164700 1 -- 172.21.15.80:0/3158800974 learned_addr learned my addr 172.21.15.80:0/3158800974 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:52.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1e166700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf1806d120 0x7fbf18165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1c963700 1 -- 172.21.15.80:0/3158800974 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39529306 0 0) 0x7fbf0c001150 con 0x7fbf1806c490 2019-11-28T11:25:52.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1c963700 1 -- 172.21.15.80:0/3158800974 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf04002e80 con 0x7fbf1806c490 2019-11-28T11:25:52.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1c963700 1 -- 172.21.15.80:0/3158800974 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3911377733 0 0) 0x7fbf0c001130 con 0x7fbf1806c490 2019-11-28T11:25:52.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1c963700 1 -- 172.21.15.80:0/3158800974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf1806d120 msgr2=0x7fbf18165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:52.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1c963700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf1806d120 0x7fbf18165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:52.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1c963700 1 -- 172.21.15.80:0/3158800974 >> v1:172.21.15.174:6789/0 conn(0x7fbf1806c0a0 legacy=0x7fbf18072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1c963700 1 -- 172.21.15.80:0/3158800974 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf180706c0 con 0x7fbf1806c490 2019-11-28T11:25:52.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1c963700 1 -- 172.21.15.80:0/3158800974 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fbf0c0016c0 con 0x7fbf1806c490 2019-11-28T11:25:52.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1c963700 1 -- 172.21.15.80:0/3158800974 >> v1:172.21.15.80:6789/0 conn(0x7fbf1806c490 legacy=0x7fbf1806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1c963700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf04003a80 0x7fbf04005ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:52.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1c963700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf04006640 0x7fbf04008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:52.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1c963700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf04009310 0x7fbf0400b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:52.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1c963700 1 -- 172.21.15.80:0/3158800974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0400bff0 con 0x7fbf04006640 2019-11-28T11:25:52.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1d164700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf04006640 0x7fbf04008b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1c963700 1 -- 172.21.15.80:0/3158800974 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf040501f0 con 0x7fbf04009310 2019-11-28T11:25:52.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1c963700 1 -- 172.21.15.80:0/3158800974 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf04050420 con 0x7fbf04003a80 2019-11-28T11:25:52.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1d965700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf04003a80 0x7fbf04005ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.042+0000 7fbf1e166700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf04009310 0x7fbf0400b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1d164700 1 -- 172.21.15.80:0/3158800974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf04003a80 msgr2=0x7fbf04005ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:52.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1d164700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf04003a80 0x7fbf04005ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:52.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1d164700 1 -- 172.21.15.80:0/3158800974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf04009310 msgr2=0x7fbf0400b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:52.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1d164700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf04009310 0x7fbf0400b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:52.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1d164700 1 -- 172.21.15.80:0/3158800974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf040506d0 con 0x7fbf04006640 2019-11-28T11:25:52.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1e166700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf04009310 0x7fbf0400b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:52.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1d164700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf04006640 0x7fbf04008b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbf0c00f910 tx=0x7fbf0c001dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1d164700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf04006640 0x7fbf04008b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbf0c00f910 tx=0x7fbf0c001dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1d164700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf04006640 0x7fbf04008b10 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7fbf0c00f910 tx=0x7fbf0c001dc0).ready entity=mon.0 client_cookie=767e4a2960766e49 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:52.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1d164700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf04006640 0x7fbf04008b10 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7fbf0c00f910 tx=0x7fbf0c001dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1c963700 1 -- 172.21.15.80:0/3158800974 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf0c004430 con 0x7fbf04006640 2019-11-28T11:25:52.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1d164700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf04006640 0x7fbf04008b10 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7fbf0c00f910 tx=0x7fbf0c001dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1d164700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf04006640 0x7fbf04008b10 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7fbf0c00f910 tx=0x7fbf0c001dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1c963700 1 -- 172.21.15.80:0/3158800974 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c001130 con 0x7fbf04006640 2019-11-28T11:25:52.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1c963700 1 -- 172.21.15.80:0/3158800974 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf0c004a10 con 0x7fbf04006640 2019-11-28T11:25:52.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1f3c8700 1 -- 172.21.15.80:0/3158800974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf04006640 msgr2=0x7fbf04008b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1f3c8700 1 --2- 172.21.15.80:0/3158800974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf04006640 0x7fbf04008b10 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7fbf0c00f910 tx=0x7fbf0c001dc0).stop 2019-11-28T11:25:52.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.043+0000 7fbf1e166700 1 -- 172.21.15.80:0/3158800974 reap_dead start 2019-11-28T11:25:52.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.044+0000 7fbf1f3c8700 1 -- 172.21.15.80:0/3158800974 shutdown_connections 2019-11-28T11:25:52.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.044+0000 7fbf1f3c8700 1 -- 172.21.15.80:0/3158800974 shutdown_connections 2019-11-28T11:25:52.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.044+0000 7fbf1f3c8700 1 -- 172.21.15.80:0/3158800974 wait complete. 2019-11-28T11:25:52.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.044+0000 7fbf1f3c8700 1 -- 172.21.15.80:0/3158800974 >> 172.21.15.80:0/3158800974 conn(0x7fbf18061cf0 msgr2=0x7fbf18064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:52.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.046+0000 7fbf1f3c8700 1 Processor -- start 2019-11-28T11:25:52.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.046+0000 7fbf1f3c8700 1 -- start start 2019-11-28T11:25:52.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fbf1f3c8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf18074d00 0x7fbf1807aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:52.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fbf1f3c8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbf1807bba0 0x7fbf18167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:52.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fbf1f3c8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf180754d0 con 0x7fbf18150f50 2019-11-28T11:25:52.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fbf1f3c8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf18077f50 con 0x7fbf1807bba0 2019-11-28T11:25:52.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fbf1f3c8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf18078980 con 0x7fbf18074d00 2019-11-28T11:25:52.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fbf1e166700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbf1807bba0 0x7fbf18167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fbf1d164700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fbf18150f50 0x7fbf1807af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:46898/0 (socket says 172.21.15.80:46898) 2019-11-28T11:25:52.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fbf1d164700 1 -- 172.21.15.80:0/2953165713 learned_addr learned my addr 172.21.15.80:0/2953165713 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:52.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.047+0000 7fbf1d965700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf18074d00 0x7fbf1807aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fbf1e166700 1 -- 172.21.15.80:0/2953165713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf18074d00 msgr2=0x7fbf1807aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fbf1e166700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf18074d00 0x7fbf1807aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fbf1e166700 1 -- 172.21.15.80:0/2953165713 >> v1:172.21.15.174:6789/0 conn(0x7fbf18150f50 legacy=0x7fbf1807af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fbf1e166700 1 -- 172.21.15.80:0/2953165713 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf180792e0 con 0x7fbf1807bba0 2019-11-28T11:25:52.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fbf1e166700 1 --2- 172.21.15.80:0/2953165713 >> v2:172.21.15.80:3300/0 conn(0x7fbf1807bba0 0x7fbf18167c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf14010390 tx=0x7fbf14010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fbf1e166700 1 --2- 172.21.15.80:0/2953165713 >> v2:172.21.15.80:3300/0 conn(0x7fbf1807bba0 0x7fbf18167c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf14010390 tx=0x7fbf14010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fbf1e166700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf1807bba0 0x7fbf18167c20 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7fbf14010390 tx=0x7fbf14010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:52.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fbf1e166700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf1807bba0 0x7fbf18167c20 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fbf14010390 tx=0x7fbf14010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fbf0a7fc700 1 -- 172.21.15.80:0/2953165713 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf1400f090 con 0x7fbf1807bba0 2019-11-28T11:25:52.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.048+0000 7fbf1f3c8700 1 -- 172.21.15.80:0/2953165713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf18079660 con 0x7fbf1807bba0 2019-11-28T11:25:52.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.049+0000 7fbf1e166700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf1807bba0 0x7fbf18167c20 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fbf14010390 tx=0x7fbf14010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.049+0000 7fbf1e166700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf1807bba0 0x7fbf18167c20 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fbf14010390 tx=0x7fbf14010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.049+0000 7fbf1f3c8700 1 -- 172.21.15.80:0/2953165713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf180792e0 con 0x7fbf1807bba0 2019-11-28T11:25:52.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.049+0000 7fbf0a7fc700 1 -- 172.21.15.80:0/2953165713 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf140051d0 con 0x7fbf1807bba0 2019-11-28T11:25:52.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.049+0000 7fbf0a7fc700 1 -- 172.21.15.80:0/2953165713 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf14005860 con 0x7fbf1807bba0 2019-11-28T11:25:52.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.050+0000 7fbf1e166700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf1807bba0 0x7fbf18167c20 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fbf14010390 tx=0x7fbf14010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.050+0000 7fbf0a7fc700 1 -- 172.21.15.80:0/2953165713 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbf140051d0 con 0x7fbf1807bba0 2019-11-28T11:25:52.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.050+0000 7fbf0a7fc700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbf00018730 0x7fbf0001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:52.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.050+0000 7fbf1e166700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf1807bba0 0x7fbf18167c20 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fbf14010390 tx=0x7fbf14010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.050+0000 7fbf0a7fc700 1 -- 172.21.15.80:0/2953165713 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fbf140051d0 con 0x7fbf1807bba0 2019-11-28T11:25:52.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.050+0000 7fbf1d965700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbf00018730 0x7fbf0001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.050+0000 7fbf1d965700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbf00018730 0x7fbf0001abc0 crc :-1 s=READY pgs=126 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:52.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.056+0000 7fbf1f3c8700 1 -- 172.21.15.80:0/2953165713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef4002e60 con 0x7fbf1807bba0 2019-11-28T11:25:52.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.059+0000 7fbf1e166700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf1807bba0 0x7fbf18167c20 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fbf14010390 tx=0x7fbf14010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.059+0000 7fbf0a7fc700 1 -- 172.21.15.80:0/2953165713 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbf140051d0 con 0x7fbf1807bba0 2019-11-28T11:25:52.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.062+0000 7feb30cef700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c1500d0 0x7feb2c105fa0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7feb18010440 tx=0x7feb18010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.062+0000 7feb29ffb700 1 -- 172.21.15.80:0/1016701181 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7feb18000ed0 con 0x7feb2c1500d0 2019-11-28T11:25:52.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.065+0000 7fe296806700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe290078190 0x7fe290077380 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7fe288010450 tx=0x7fe2880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.065+0000 7fe28effd700 1 -- 172.21.15.80:0/1166555114 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe288009f60 con 0x7fe290078190 2019-11-28T11:25:52.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.248+0000 7fbf1f3c8700 1 -- 172.21.15.80:0/2953165713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7fbef4001d10 con 0x7fbf1807bba0 2019-11-28T11:25:52.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.249+0000 7feb32f53700 1 -- 172.21.15.80:0/1016701181 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7feb04001d10 con 0x7feb2c1500d0 2019-11-28T11:25:52.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.254+0000 7fe297a68700 1 -- 172.21.15.80:0/1166555114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fe29012d970 con 0x7fe290078190 2019-11-28T11:25:52.635 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:25:52.613+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:25:52.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.620+0000 7fbf1e166700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf1807bba0 0x7fbf18167c20 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fbf14010390 tx=0x7fbf14010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.620+0000 7fbf0a7fc700 1 -- 172.21.15.80:0/2953165713 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 4356 v7) v1 ==== 95+0+0 (secure 0 0 0) 0x7fbf14000a70 con 0x7fbf1807bba0 2019-11-28T11:25:52.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.620+0000 7feb30cef700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c1500d0 0x7feb2c105fa0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7feb18010440 tx=0x7feb18010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.620+0000 7feb29ffb700 1 -- 172.21.15.80:0/1016701181 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 4229 v7) v1 ==== 95+0+0 (secure 0 0 0) 0x7feb18000ed0 con 0x7feb2c1500d0 2019-11-28T11:25:52.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.620+0000 7fe296806700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe290078190 0x7fe290077380 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7fe288010450 tx=0x7fe2880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.620+0000 7fe28effd700 1 -- 172.21.15.80:0/1166555114 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 4359 v7) v1 ==== 95+0+0 (secure 0 0 0) 0x7fe28800a170 con 0x7fe290078190 2019-11-28T11:25:52.683 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 4356 2019-11-28T11:25:52.683 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 4229 2019-11-28T11:25:52.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.665+0000 7fbf1f3c8700 1 -- 172.21.15.80:0/2953165713 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbf00018730 msgr2=0x7fbf0001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.665+0000 7fbf1f3c8700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbf00018730 0x7fbf0001abc0 crc :-1 s=READY pgs=126 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.665+0000 7fbf1f3c8700 1 -- 172.21.15.80:0/2953165713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf1807bba0 msgr2=0x7fbf18167c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.665+0000 7fbf1f3c8700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf1807bba0 0x7fbf18167c20 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7fbf14010390 tx=0x7fbf14010730).stop 2019-11-28T11:25:52.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.665+0000 7fbf1f3c8700 1 -- 172.21.15.80:0/2953165713 shutdown_connections 2019-11-28T11:25:52.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.665+0000 7fbf1f3c8700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbf1807bba0 0x7fbf18167c20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.665+0000 7fbf1f3c8700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbf00018730 0x7fbf0001abc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.665+0000 7fbf1f3c8700 1 --2- 172.21.15.80:0/2953165713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf18074d00 0x7fbf1807aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.665+0000 7fbf1f3c8700 1 -- 172.21.15.80:0/2953165713 shutdown_connections 2019-11-28T11:25:52.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.665+0000 7fbf1f3c8700 1 -- 172.21.15.80:0/2953165713 wait complete. 2019-11-28T11:25:52.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.665+0000 7fbf1f3c8700 1 -- 172.21.15.80:0/2953165713 >> 172.21.15.80:0/2953165713 conn(0x7fbf1813fa50 msgr2=0x7fbf1807c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:52.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.665+0000 7feb32f53700 1 -- 172.21.15.80:0/1016701181 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb0c018730 msgr2=0x7feb0c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.665+0000 7feb32f53700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb0c018730 0x7feb0c01abc0 crc :-1 s=READY pgs=127 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.665+0000 7feb32f53700 1 -- 172.21.15.80:0/1016701181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c1500d0 msgr2=0x7feb2c105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.665+0000 7feb32f53700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c1500d0 0x7feb2c105fa0 secure :-1 s=READY pgs=282 cs=0 l=1 rx=0x7feb18010440 tx=0x7feb18010270).stop 2019-11-28T11:25:52.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.666+0000 7feb32f53700 1 -- 172.21.15.80:0/1016701181 shutdown_connections 2019-11-28T11:25:52.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.666+0000 7feb32f53700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb0c018730 0x7feb0c01abc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.666+0000 7feb32f53700 1 --2- 172.21.15.80:0/1016701181 >> v2:172.21.15.174:3300/0 conn(0x7feb2c1064e0 0x7feb2c10e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.666+0000 7feb32f53700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb2c1500d0 0x7feb2c105fa0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.666+0000 7feb32f53700 1 --2- 172.21.15.80:0/1016701181 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feb2c13e8e0 0x7feb2c14fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.666+0000 7feb32f53700 1 -- 172.21.15.80:0/1016701181 shutdown_connections 2019-11-28T11:25:52.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.666+0000 7feb32f53700 1 -- 172.21.15.80:0/1016701181 wait complete. 2019-11-28T11:25:52.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.666+0000 7feb32f53700 1 -- 172.21.15.80:0/1016701181 >> 172.21.15.80:0/1016701181 conn(0x7feb2c13d620 msgr2=0x7feb2c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:52.691 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 4359 2019-11-28T11:25:52.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.670+0000 7fe297a68700 1 -- 172.21.15.80:0/1166555114 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe270018730 msgr2=0x7fe27001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.670+0000 7fe297a68700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe270018730 0x7fe27001abc0 crc :-1 s=READY pgs=125 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.670+0000 7fe297a68700 1 -- 172.21.15.80:0/1166555114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe290078190 msgr2=0x7fe290077380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.670+0000 7fe297a68700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe290078190 0x7fe290077380 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7fe288010450 tx=0x7fe2880107f0).stop 2019-11-28T11:25:52.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.670+0000 7fe297a68700 1 -- 172.21.15.80:0/1166555114 shutdown_connections 2019-11-28T11:25:52.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.670+0000 7fe297a68700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe290078190 0x7fe290077380 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.670+0000 7fe297a68700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe270018730 0x7fe27001abc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.670+0000 7fe297a68700 1 --2- 172.21.15.80:0/1166555114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe290164ff0 0x7fe2901653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.671+0000 7fe297a68700 1 -- 172.21.15.80:0/1166555114 shutdown_connections 2019-11-28T11:25:52.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.671+0000 7fe297a68700 1 -- 172.21.15.80:0/1166555114 wait complete. 2019-11-28T11:25:52.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.671+0000 7fe297a68700 1 -- 172.21.15.80:0/1166555114 >> 172.21.15.80:0/1166555114 conn(0x7fe2901425d0 msgr2=0x7fe290101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:52.698 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:25:52.700 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:25:52.702 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:25:52.702 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:25:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.816+0000 7fd0712fb700 1 Processor -- start 2019-11-28T11:25:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.816+0000 7fd0712fb700 1 -- start start 2019-11-28T11:25:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.817+0000 7fd0712fb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd06c06c0a0 0x7fd06c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.817+0000 7fd0712fb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06c06db00 con 0x7fd06c0734e0 2019-11-28T11:25:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.817+0000 7fd0712fb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06c06e000 con 0x7fd06c072620 2019-11-28T11:25:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.817+0000 7fd0712fb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06c06fd60 con 0x7fd06c06c0a0 2019-11-28T11:25:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06affd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd06c0734e0 0x7fd06c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59600/0 (socket says 172.21.15.80:59600) 2019-11-28T11:25:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06affd700 1 -- 172.21.15.80:0/466553845 learned_addr learned my addr 172.21.15.80:0/466553845 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:52.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06b7fe700 1 --2- 172.21.15.80:0/466553845 >> v2:172.21.15.174:3300/0 conn(0x7fd06c06c0a0 0x7fd06c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06a7fc700 1 -- 172.21.15.80:0/466553845 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484967605 0 0) 0x7fd05c001150 con 0x7fd06c0734e0 2019-11-28T11:25:52.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06a7fc700 1 -- 172.21.15.80:0/466553845 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd058002e80 con 0x7fd06c0734e0 2019-11-28T11:25:52.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06a7fc700 1 -- 172.21.15.80:0/466553845 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572467687 0 0) 0x7fd064000d30 con 0x7fd06c072620 2019-11-28T11:25:52.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06a7fc700 1 -- 172.21.15.80:0/466553845 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0580030b0 con 0x7fd06c072620 2019-11-28T11:25:52.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06a7fc700 1 -- 172.21.15.80:0/466553845 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2922557457 0 0) 0x7fd05c001130 con 0x7fd06c0734e0 2019-11-28T11:25:52.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06b7fe700 1 -- 172.21.15.80:0/466553845 >> v1:172.21.15.174:6789/0 conn(0x7fd06c072620 legacy=0x7fd06c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06b7fe700 1 -- 172.21.15.80:0/466553845 >> v1:172.21.15.80:6789/0 conn(0x7fd06c0734e0 legacy=0x7fd06c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06b7fe700 1 -- 172.21.15.80:0/466553845 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c0706c0 con 0x7fd06c06c0a0 2019-11-28T11:25:52.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06b7fe700 1 --2- 172.21.15.80:0/466553845 >> v2:172.21.15.174:3300/0 conn(0x7fd06c06c0a0 0x7fd06c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd05400af50 tx=0x7fd05400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06b7fe700 1 --2- 172.21.15.80:0/466553845 >> v2:172.21.15.174:3300/0 conn(0x7fd06c06c0a0 0x7fd06c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd05400af50 tx=0x7fd05400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06b7fe700 1 --2- 172.21.15.80:0/466553845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd06c06c0a0 0x7fd06c072fa0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7fd05400af50 tx=0x7fd05400b760).ready entity=mon.1 client_cookie=847107989f918efa server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:52.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06b7fe700 1 --2- 172.21.15.80:0/466553845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd06c06c0a0 0x7fd06c072fa0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fd05400af50 tx=0x7fd05400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06a7fc700 1 -- 172.21.15.80:0/466553845 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd054000960 con 0x7fd06c06c0a0 2019-11-28T11:25:52.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06b7fe700 1 --2- 172.21.15.80:0/466553845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd06c06c0a0 0x7fd06c072fa0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fd05400af50 tx=0x7fd05400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06b7fe700 1 --2- 172.21.15.80:0/466553845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd06c06c0a0 0x7fd06c072fa0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fd05400af50 tx=0x7fd05400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06a7fc700 1 -- 172.21.15.80:0/466553845 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd054009860 con 0x7fd06c06c0a0 2019-11-28T11:25:52.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd06a7fc700 1 -- 172.21.15.80:0/466553845 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd054009f30 con 0x7fd06c06c0a0 2019-11-28T11:25:52.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd0712fb700 1 -- 172.21.15.80:0/466553845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd06c06c0a0 msgr2=0x7fd06c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.818+0000 7fd0712fb700 1 --2- 172.21.15.80:0/466553845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd06c06c0a0 0x7fd06c072fa0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7fd05400af50 tx=0x7fd05400b760).stop 2019-11-28T11:25:52.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.819+0000 7fd0712fb700 1 -- 172.21.15.80:0/466553845 shutdown_connections 2019-11-28T11:25:52.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.819+0000 7fd0712fb700 1 --2- 172.21.15.80:0/466553845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd06c06c0a0 0x7fd06c072fa0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.819+0000 7fd0712fb700 1 -- 172.21.15.80:0/466553845 shutdown_connections 2019-11-28T11:25:52.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.819+0000 7fd0712fb700 1 -- 172.21.15.80:0/466553845 wait complete. 2019-11-28T11:25:52.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.819+0000 7fd0712fb700 1 -- 172.21.15.80:0/466553845 >> 172.21.15.80:0/466553845 conn(0x7fd06c061cf0 msgr2=0x7fd06c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:52.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.821+0000 7fd0712fb700 1 Processor -- start 2019-11-28T11:25:52.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.822+0000 7fd0712fb700 1 -- start start 2019-11-28T11:25:52.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd0712fb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd06c112fb0 0x7fd06c113440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:52.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd0712fb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd06c113980 0x7fd06c168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd0712fb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06c13fc20 con 0x7fd06c13f580 2019-11-28T11:25:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd0712fb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06c1236b0 con 0x7fd06c113980 2019-11-28T11:25:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd0712fb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06c123980 con 0x7fd06c112fb0 2019-11-28T11:25:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd06b7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd06c13f580 0x7fd06c114130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59606/0 (socket says 172.21.15.80:59606) 2019-11-28T11:25:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd06b7fe700 1 -- 172.21.15.80:0/3852761946 learned_addr learned my addr 172.21.15.80:0/3852761946 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:52.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd06bfff700 1 --2- 172.21.15.80:0/3852761946 >> v2:172.21.15.80:3300/0 conn(0x7fd06c113980 0x7fd06c168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd06affd700 1 --2- 172.21.15.80:0/3852761946 >> v2:172.21.15.174:3300/0 conn(0x7fd06c112fb0 0x7fd06c113440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd063fff700 1 -- 172.21.15.80:0/3852761946 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945752021 0 0) 0x7fd05400b3d0 con 0x7fd06c13f580 2019-11-28T11:25:52.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd063fff700 1 -- 172.21.15.80:0/3852761946 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd050002e80 con 0x7fd06c13f580 2019-11-28T11:25:52.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd06bfff700 1 -- 172.21.15.80:0/3852761946 >> v2:172.21.15.174:3300/0 conn(0x7fd06c112fb0 msgr2=0x7fd06c113440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd06bfff700 1 --2- 172.21.15.80:0/3852761946 >> v2:172.21.15.174:3300/0 conn(0x7fd06c112fb0 0x7fd06c113440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:52.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd06bfff700 1 -- 172.21.15.80:0/3852761946 >> v1:172.21.15.80:6789/0 conn(0x7fd06c13f580 legacy=0x7fd06c114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:52.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd06bfff700 1 -- 172.21.15.80:0/3852761946 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c124010 con 0x7fd06c113980 2019-11-28T11:25:52.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd06bfff700 1 --2- 172.21.15.80:0/3852761946 >> v2:172.21.15.80:3300/0 conn(0x7fd06c113980 0x7fd06c168a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd064010740 tx=0x7fd064010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd06bfff700 1 --2- 172.21.15.80:0/3852761946 >> v2:172.21.15.80:3300/0 conn(0x7fd06c113980 0x7fd06c168a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd064010740 tx=0x7fd064010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd06bfff700 1 --2- 172.21.15.80:0/3852761946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd06c113980 0x7fd06c168a20 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7fd064010740 tx=0x7fd064010ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:52.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd06bfff700 1 --2- 172.21.15.80:0/3852761946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd06c113980 0x7fd06c168a20 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fd064010740 tx=0x7fd064010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd063fff700 1 -- 172.21.15.80:0/3852761946 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd064009f10 con 0x7fd06c113980 2019-11-28T11:25:52.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd06bfff700 1 --2- 172.21.15.80:0/3852761946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd06c113980 0x7fd06c168a20 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fd064010740 tx=0x7fd064010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd0712fb700 1 -- 172.21.15.80:0/3852761946 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06c124010 con 0x7fd06c113980 2019-11-28T11:25:52.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd063fff700 1 -- 172.21.15.80:0/3852761946 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd064009b30 con 0x7fd06c113980 2019-11-28T11:25:52.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd06bfff700 1 --2- 172.21.15.80:0/3852761946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd06c113980 0x7fd06c168a20 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fd064010740 tx=0x7fd064010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd063fff700 1 -- 172.21.15.80:0/3852761946 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd064009d20 con 0x7fd06c113980 2019-11-28T11:25:52.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.823+0000 7fd0712fb700 1 -- 172.21.15.80:0/3852761946 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06c113dd0 con 0x7fd06c113980 2019-11-28T11:25:52.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.824+0000 7fd06bfff700 1 --2- 172.21.15.80:0/3852761946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd06c113980 0x7fd06c168a20 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fd064010740 tx=0x7fd064010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.824+0000 7fd063fff700 1 -- 172.21.15.80:0/3852761946 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd064009d20 con 0x7fd06c113980 2019-11-28T11:25:52.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.824+0000 7fd06bfff700 1 --2- 172.21.15.80:0/3852761946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd06c113980 0x7fd06c168a20 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fd064010740 tx=0x7fd064010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.824+0000 7fd063fff700 1 --2- 172.21.15.80:0/3852761946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd050018770 0x7fd05001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:52.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.824+0000 7fd063fff700 1 -- 172.21.15.80:0/3852761946 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6117+0+0 (secure 0 0 0) 0x7fd064031e00 con 0x7fd06c113980 2019-11-28T11:25:52.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.824+0000 7fd06b7fe700 1 --2- 172.21.15.80:0/3852761946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd050018770 0x7fd05001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:52.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.825+0000 7fd06b7fe700 1 --2- 172.21.15.80:0/3852761946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd050018770 0x7fd05001abe0 crc :-1 s=READY pgs=128 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:52.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.832+0000 7fd0712fb700 1 -- 172.21.15.80:0/3852761946 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06c124010 con 0x7fd06c113980 2019-11-28T11:25:52.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.835+0000 7fd06bfff700 1 --2- 172.21.15.80:0/3852761946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd06c113980 0x7fd06c168a20 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fd064010740 tx=0x7fd064010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:52.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:52.835+0000 7fd063fff700 1 -- 172.21.15.80:0/3852761946 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd064009920 con 0x7fd06c113980 2019-11-28T11:25:53.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.008+0000 7fd0712fb700 1 -- 172.21.15.80:0/3852761946 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd06c124010 con 0x7fd06c113980 2019-11-28T11:25:53.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.009+0000 7fd06bfff700 1 --2- 172.21.15.80:0/3852761946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd06c113980 0x7fd06c168a20 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fd064010740 tx=0x7fd064010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.009+0000 7fd063fff700 1 -- 172.21.15.80:0/3852761946 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v28) v1 ==== 81+0+31791 (secure 0 0 0) 0x7fd064000cc0 con 0x7fd06c113980 2019-11-28T11:25:53.033 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:53.034 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:25:53.034 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 28, 2019-11-28T11:25:53.034 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:25:53.034 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:25:53.034 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:25:52.258909+0000", 2019-11-28T11:25:53.035 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:25:53.035 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:25:53.035 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:25:53.035 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:25:53.035 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:25:53.035 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:25:53.036 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:25:53.036 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:25:53.036 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:25:53.036 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:25:53.036 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:25:53.036 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:25:53.037 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:25:53.037 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:25:53.037 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:25:53.037 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 3, 2019-11-28T11:25:53.037 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:25:53.037 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:25:53.038 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:25:53.038 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:25:53.038 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:25:53.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.040 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:25:53.040 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:25:53.041 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:25:53.041 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:25:53.041 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:25:53.041 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:25:53.041 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:25:53.042 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:25:53.042 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:25:53.042 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:25:53.042 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:25:53.042 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:25:53.042 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:25:53.042 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:25:53.043 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:25:53.043 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:25:53.043 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:25:53.043 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:25:53.043 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:25:53.044 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:25:53.044 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:25:53.044 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:25:53.044 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:25:53.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.044 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:25:53.045 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:25:53.045 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:25:53.045 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:25:53.045 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:25:53.045 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:25:53.046 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:25:53.046 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:25:53.046 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:25:53.046 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:25:53.046 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:25:53.047 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:25:53.047 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:25:53.047 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:25:53.047 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:25:53.048 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:25:53.048 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:25:53.048 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:25:53.048 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:25:53.048 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:25:53.049 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:25:53.049 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:25:53.050 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:25:53.051 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:25:53.051 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:25:53.051 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:25:53.051 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:25:53.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.051 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:25:53.052 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:25:53.052 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:25:53.052 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:25:53.052 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:25:53.053 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:25:53.053 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:25:53.053 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:25:53.053 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:25:53.053 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:25:53.053 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:25:53.053 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:25:53.054 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:25:53.054 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:25:53.054 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.054 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 2, 2019-11-28T11:25:53.055 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:25:53.055 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:14.914696+0000", 2019-11-28T11:25:53.055 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:25:53.055 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:25:53.055 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:25:53.055 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:25:53.056 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:25:53.056 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:25:53.056 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:25:53.056 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:25:53.056 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:25:53.056 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:25:53.057 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:25:53.057 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:25:53.057 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:25:53.057 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:25:53.057 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:25:53.057 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:25:53.058 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:25:53.058 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:25:53.058 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:25:53.058 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:25:53.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.059 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "24", 2019-11-28T11:25:53.059 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:25:53.059 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:25:53.059 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:25:53.059 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:25:53.060 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:25:53.061 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:25:53.061 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:25:53.061 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:25:53.062 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:25:53.062 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:25:53.062 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:25:53.062 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:25:53.062 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:25:53.063 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:25:53.063 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:25:53.063 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:25:53.063 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:25:53.063 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:25:53.064 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:25:53.064 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:25:53.064 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:25:53.064 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:25:53.064 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:25:53.065 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:25:53.065 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:25:53.065 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:25:53.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.066 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:25:53.066 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:25:53.066 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:25:53.066 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:25:53.067 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:25:53.067 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:25:53.067 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:25:53.067 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:25:53.067 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:25:53.067 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:25:53.067 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:25:53.068 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:25:53.068 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:25:53.068 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:25:53.068 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:25:53.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.068 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:25:53.069 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:25:53.069 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:25:53.069 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.069 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.070 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 3, 2019-11-28T11:25:53.070 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:25:53.070 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:17.566323+0000", 2019-11-28T11:25:53.070 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 5, 2019-11-28T11:25:53.070 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool,ec_overwrites", 2019-11-28T11:25:53.072 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 3, 2019-11-28T11:25:53.072 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 4, 2019-11-28T11:25:53.072 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 3, 2019-11-28T11:25:53.072 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 1, 2019-11-28T11:25:53.073 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:25:53.073 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:25:53.073 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:25:53.073 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:25:53.073 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:25:53.074 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:25:53.074 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:25:53.074 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:25:53.074 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:25:53.074 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:25:53.075 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:25:53.075 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:25:53.075 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:25:53.075 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:25:53.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.076 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "25", 2019-11-28T11:25:53.076 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:25:53.076 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:25:53.076 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:25:53.076 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:25:53.076 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:25:53.077 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:25:53.077 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:25:53.077 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:25:53.077 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:25:53.077 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:25:53.077 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:25:53.078 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:25:53.078 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:25:53.078 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:25:53.078 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:25:53.078 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:25:53.078 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:25:53.078 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:25:53.079 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:25:53.079 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:25:53.079 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:25:53.079 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:25:53.080 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:25:53.080 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "cephfs_data", 2019-11-28T11:25:53.080 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:25:53.080 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:25:53.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.080 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:25:53.081 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:25:53.081 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:25:53.081 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:25:53.082 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:25:53.083 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:25:53.083 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:25:53.083 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:25:53.083 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 8192, 2019-11-28T11:25:53.083 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:25:53.083 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:25:53.084 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:25:53.084 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:25:53.084 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:25:53.084 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:25:53.084 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.085 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.085 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.085 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:25:53.085 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:25:53.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.086 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:25:53.086 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:25:53.086 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:25:53.086 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:25:53.086 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:25:53.086 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:25:53.087 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:25:53.087 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:25:53.087 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:25:53.087 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 22, 2019-11-28T11:25:53.087 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:25:53.088 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:25:53.088 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:25:53.088 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.088 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.089 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:25:53.089 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:25:53.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.089 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.089 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:25:53.090 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:25:53.090 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.090 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.090 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:25:53.091 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.091 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.091 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:25:53.091 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:25:53.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.093 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.094 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:25:53.094 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:25:53.094 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.094 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.094 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:25:53.095 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.095 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.095 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:25:53.096 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:25:53.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.096 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.096 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:25:53.097 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:25:53.097 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.097 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.097 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:25:53.097 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.098 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.098 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:25:53.098 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:25:53.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.099 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.099 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:25:53.099 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:25:53.099 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.099 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.100 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:25:53.100 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:25:53.100 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:25:53.100 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:25:53.101 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:25:53.101 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:25:53.101 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:25:53.101 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.102 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:25:53.102 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:25:53.102 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:25:53.102 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:25:53.102 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:25:53.104 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:25:53.104 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:25:53.104 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:25:53.105 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:25:53.105 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 22, 2019-11-28T11:25:53.105 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:25:53.105 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:25:53.105 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:25:53.105 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.106 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.106 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:25:53.106 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:25:53.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.107 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.107 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:25:53.107 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:25:53.108 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.108 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.108 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:25:53.108 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.109 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.109 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:25:53.109 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:25:53.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.110 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.110 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:25:53.110 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:25:53.110 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.111 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.111 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:25:53.111 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.112 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.112 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:25:53.112 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:25:53.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.112 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.113 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:25:53.113 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:25:53.113 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.113 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.115 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:25:53.115 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.115 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.116 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:25:53.116 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:25:53.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.116 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.117 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:25:53.117 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:25:53.117 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.117 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.117 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:25:53.118 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:25:53.118 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:25:53.118 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:25:53.118 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:25:53.118 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:25:53.119 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:25:53.119 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.120 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:25:53.120 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:25:53.120 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:25:53.120 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:25:53.120 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:25:53.120 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:25:53.121 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:25:53.121 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:25:53.121 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:25:53.121 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 19, 2019-11-28T11:25:53.121 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:25:53.121 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:25:53.122 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:25:53.122 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.122 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.122 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:25:53.122 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:25:53.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.123 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.123 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:25:53.123 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:25:53.123 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.124 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.124 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:25:53.124 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.125 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.125 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:25:53.125 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:25:53.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.125 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.125 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:25:53.126 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:25:53.126 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.126 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.126 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:25:53.126 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.127 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.127 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:25:53.127 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:25:53.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.127 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.127 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:25:53.128 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:25:53.128 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.128 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.128 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:25:53.128 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.129 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.129 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:25:53.129 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:25:53.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.129 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.129 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:25:53.129 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:25:53.130 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.130 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.130 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:25:53.130 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:25:53.130 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:25:53.130 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:25:53.131 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:25:53.131 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:25:53.131 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:25:53.131 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.131 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:25:53.132 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:25:53.132 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:25:53.132 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:25:53.132 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:25:53.132 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:25:53.132 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:25:53.132 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:25:53.133 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:25:53.133 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 22, 2019-11-28T11:25:53.133 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:25:53.133 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:25:53.133 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:25:53.133 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.133 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.134 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:25:53.134 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:25:53.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.134 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.134 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:25:53.136 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:25:53.137 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.137 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.137 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:25:53.137 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.137 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.138 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:25:53.138 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:25:53.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.138 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.138 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:25:53.138 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:25:53.139 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.139 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.139 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:25:53.139 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.139 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.140 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:25:53.140 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:25:53.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.140 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.140 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:25:53.140 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:25:53.141 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.141 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.141 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:25:53.141 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.141 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.141 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:25:53.142 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:25:53.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.142 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.142 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:25:53.142 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:25:53.142 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.143 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.143 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:25:53.143 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:25:53.143 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:25:53.143 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:25:53.143 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:25:53.144 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:25:53.144 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:25:53.144 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.144 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:25:53.144 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:25:53.145 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:25:53.145 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:25:53.145 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:25:53.145 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:25:53.145 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:25:53.145 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:25:53.145 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:25:53.145 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 22, 2019-11-28T11:25:53.146 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:25:53.146 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:25:53.146 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:25:53.146 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.146 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.146 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:25:53.147 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:25:53.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.147 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.147 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:25:53.147 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:25:53.147 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.148 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.148 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:25:53.148 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.148 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.148 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:25:53.148 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:25:53.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.149 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.149 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:25:53.149 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:25:53.149 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.149 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.150 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:25:53.150 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.150 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.150 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:25:53.150 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:25:53.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.151 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.151 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:25:53.151 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:25:53.151 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.151 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.152 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:25:53.152 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.152 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.152 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:25:53.152 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:25:53.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.153 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.153 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:25:53.153 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:25:53.153 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.153 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.154 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:25:53.154 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:25:53.154 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:25:53.154 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:25:53.154 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:25:53.154 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:25:53.154 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:25:53.154 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:25:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:25:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:25:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:25:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:25:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:25:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:25:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:25:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:25:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 22, 2019-11-28T11:25:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:25:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:25:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:25:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:25:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:25:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:25:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:25:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:25:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:25:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:25:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:25:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:25:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:25:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:25:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:25:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:25:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:25:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:25:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:25:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:25:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:25:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:25:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:25:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:25:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:25:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:25:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:25:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:25:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:25:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:25:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:25:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:25:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:25:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:25:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:25:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:25:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:25:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:25:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 19, 2019-11-28T11:25:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:25:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:25:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:25:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:25:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:25:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:25:53.169 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:25:53.169 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.169 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.169 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:25:53.169 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.169 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.170 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:25:53.170 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:25:53.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.170 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.170 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:25:53.170 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:25:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:25:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:25:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:25:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:25:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:25:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:25:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:25:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:25:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:25:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:25:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:25:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:25:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:25:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:25:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:25:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:25:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:25:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:25:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:25:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:25:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:25:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:25:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:25:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:25:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:25:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:25:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 19, 2019-11-28T11:25:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:25:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:25:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:25:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:25:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:25:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:25:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:25:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:25:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:25:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:25:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:25:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:25:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:25:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:25:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:25:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:25:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:25:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:25:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:25:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:25:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:25:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:25:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:25:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:25:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:25:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:25:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:25:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:25:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:25:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:25:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:25:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:25:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:25:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:25:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:25:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:25:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:25:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:25:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:25:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:25:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:25:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:25:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:25:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:25:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:25:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:25:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:25:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:25:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:25:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:25:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:25:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:25:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:25:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:25:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:25:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:25:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:25:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:25:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:25:53.192 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:25:53.192 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:25:53.192 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:25:53.192 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:25:53.192 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:25:53.192 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:25:53.192 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:25:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:25:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:25:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:25:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:25:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:25:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:25:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:25:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:25:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:25:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:25:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:25:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:25:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:25:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:25:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:25:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:25:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:25:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:25:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:25:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:25:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:25:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:25:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:25:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:25:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:25:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:25:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:25:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:25:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:25:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:25:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:25:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:25:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:25:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:25:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:25:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:25:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:25:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:25:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/2081356472": "2019-11-29T11:25:52.253058+0000", 2019-11-28T11:25:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/2081356472": "2019-11-29T11:25:52.253058+0000" 2019-11-28T11:25:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:25:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:25:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:25:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:25:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:25:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:25:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:25:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:25:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:25:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:25:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:25:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:25:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:25:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:25:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:25:53.202 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:25:53.202 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:25:53.202 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:25:53.202 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:25:53.202 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:53.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:53.202 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:25:53.203 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:25:53.203 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:25:53.203 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:25:53.203 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:25:53.203 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:25:53.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.013+0000 7fd0712fb700 1 -- 172.21.15.80:0/3852761946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd050018770 msgr2=0x7fd05001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:53.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.013+0000 7fd0712fb700 1 --2- 172.21.15.80:0/3852761946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd050018770 0x7fd05001abe0 crc :-1 s=READY pgs=128 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:53.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.013+0000 7fd0712fb700 1 -- 172.21.15.80:0/3852761946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd06c113980 msgr2=0x7fd06c168a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:53.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.013+0000 7fd0712fb700 1 --2- 172.21.15.80:0/3852761946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd06c113980 0x7fd06c168a20 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7fd064010740 tx=0x7fd064010ae0).stop 2019-11-28T11:25:53.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.013+0000 7fd0712fb700 1 -- 172.21.15.80:0/3852761946 shutdown_connections 2019-11-28T11:25:53.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.013+0000 7fd0712fb700 1 --2- 172.21.15.80:0/3852761946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd050018770 0x7fd05001abe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:53.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.013+0000 7fd0712fb700 1 --2- 172.21.15.80:0/3852761946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd06c113980 0x7fd06c168a20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:53.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.013+0000 7fd0712fb700 1 --2- 172.21.15.80:0/3852761946 >> v2:172.21.15.174:3300/0 conn(0x7fd06c112fb0 0x7fd06c113440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:53.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.014+0000 7fd0712fb700 1 -- 172.21.15.80:0/3852761946 shutdown_connections 2019-11-28T11:25:53.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.014+0000 7fd0712fb700 1 -- 172.21.15.80:0/3852761946 wait complete. 2019-11-28T11:25:53.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.014+0000 7fd0712fb700 1 -- 172.21.15.80:0/3852761946 >> 172.21.15.80:0/3852761946 conn(0x7fd06c1426c0 msgr2=0x7fd06c110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:53.206 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:25:53.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.303+0000 7f998c7a3700 1 Processor -- start 2019-11-28T11:25:53.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.303+0000 7f998c7a3700 1 -- start start 2019-11-28T11:25:53.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.304+0000 7f998c7a3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f998406c0a0 0x7f9984072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:53.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.304+0000 7f998c7a3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99840734e0 0x7f9984071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:53.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.304+0000 7f998c7a3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9984072360 0x7f99840727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:53.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.304+0000 7f998c7a3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998406f330 con 0x7f99840734e0 2019-11-28T11:25:53.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.304+0000 7f998c7a3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99840706c0 con 0x7f9984072360 2019-11-28T11:25:53.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.304+0000 7f998c7a3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9984070a40 con 0x7f998406c0a0 2019-11-28T11:25:53.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998a53f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99840734e0 0x7f9984071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:53.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998a53f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99840734e0 0x7f9984071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60302/0 (socket says 172.21.15.80:60302) 2019-11-28T11:25:53.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998a53f700 1 -- 172.21.15.80:0/2812236020 learned_addr learned my addr 172.21.15.80:0/2812236020 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:53.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998b541700 1 --2- 172.21.15.80:0/2812236020 >> v2:172.21.15.174:3300/0 conn(0x7f9984072360 0x7f99840727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:53.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998ad40700 1 --2- 172.21.15.80:0/2812236020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f998406c0a0 0x7f9984072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:53.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998a53f700 1 -- 172.21.15.80:0/2812236020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f998406c0a0 msgr2=0x7f9984072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:53.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998a53f700 1 --2- 172.21.15.80:0/2812236020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f998406c0a0 0x7f9984072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:53.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998a53f700 1 -- 172.21.15.80:0/2812236020 >> v2:172.21.15.174:3300/0 conn(0x7f9984072360 msgr2=0x7f99840727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:53.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998a53f700 1 --2- 172.21.15.80:0/2812236020 >> v2:172.21.15.174:3300/0 conn(0x7f9984072360 0x7f99840727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:53.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998a53f700 1 -- 172.21.15.80:0/2812236020 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998406db00 con 0x7f99840734e0 2019-11-28T11:25:53.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998a53f700 1 --2- 172.21.15.80:0/2812236020 >> v2:172.21.15.80:3300/0 conn(0x7f99840734e0 0x7f9984071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f997400fa40 tx=0x7f997400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998a53f700 1 --2- 172.21.15.80:0/2812236020 >> v2:172.21.15.80:3300/0 conn(0x7f99840734e0 0x7f9984071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f997400fa40 tx=0x7f997400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998a53f700 1 --2- 172.21.15.80:0/2812236020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99840734e0 0x7f9984071e20 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7f997400fa40 tx=0x7f997400f8f0).ready entity=mon.0 client_cookie=b74f345a84b2ffe server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:53.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998a53f700 1 --2- 172.21.15.80:0/2812236020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99840734e0 0x7f9984071e20 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7f997400fa40 tx=0x7f997400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998a53f700 1 --2- 172.21.15.80:0/2812236020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99840734e0 0x7f9984071e20 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7f997400fa40 tx=0x7f997400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f9989d3e700 1 -- 172.21.15.80:0/2812236020 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9974000ce0 con 0x7f99840734e0 2019-11-28T11:25:53.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998a53f700 1 --2- 172.21.15.80:0/2812236020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99840734e0 0x7f9984071e20 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7f997400fa40 tx=0x7f997400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f9989d3e700 1 -- 172.21.15.80:0/2812236020 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9974001010 con 0x7f99840734e0 2019-11-28T11:25:53.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f9989d3e700 1 -- 172.21.15.80:0/2812236020 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9974001720 con 0x7f99840734e0 2019-11-28T11:25:53.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998c7a3700 1 -- 172.21.15.80:0/2812236020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99840734e0 msgr2=0x7f9984071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:53.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.305+0000 7f998c7a3700 1 --2- 172.21.15.80:0/2812236020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99840734e0 0x7f9984071e20 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7f997400fa40 tx=0x7f997400f8f0).stop 2019-11-28T11:25:53.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.306+0000 7f998c7a3700 1 -- 172.21.15.80:0/2812236020 shutdown_connections 2019-11-28T11:25:53.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.306+0000 7f998c7a3700 1 --2- 172.21.15.80:0/2812236020 >> v2:172.21.15.174:3300/0 conn(0x7f9984072360 0x7f99840727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:53.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.306+0000 7f998c7a3700 1 --2- 172.21.15.80:0/2812236020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99840734e0 0x7f9984071e20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:53.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.306+0000 7f998c7a3700 1 --2- 172.21.15.80:0/2812236020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f998406c0a0 0x7f9984072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:53.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.306+0000 7f998c7a3700 1 -- 172.21.15.80:0/2812236020 shutdown_connections 2019-11-28T11:25:53.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.306+0000 7f998c7a3700 1 -- 172.21.15.80:0/2812236020 wait complete. 2019-11-28T11:25:53.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.306+0000 7f998c7a3700 1 -- 172.21.15.80:0/2812236020 >> 172.21.15.80:0/2812236020 conn(0x7f9984061cf0 msgr2=0x7f9984064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:53.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.309+0000 7f998c7a3700 1 Processor -- start 2019-11-28T11:25:53.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.309+0000 7f998c7a3700 1 -- start start 2019-11-28T11:25:53.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.309+0000 7f998c7a3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f998413a780 0x7f998412d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:53.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.309+0000 7f998c7a3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f998412cb00 0x7f9984167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:53.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.309+0000 7f998c7a3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9984139a60 con 0x7f998412d9c0 2019-11-28T11:25:53.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.309+0000 7f998c7a3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998412a260 con 0x7f998413a780 2019-11-28T11:25:53.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.309+0000 7f998c7a3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998412a530 con 0x7f998412cb00 2019-11-28T11:25:53.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998ad40700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f998413a780 0x7f998412d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:53.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998ad40700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f998413a780 0x7f998412d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60304/0 (socket says 172.21.15.80:60304) 2019-11-28T11:25:53.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998ad40700 1 -- 172.21.15.80:0/1484642746 learned_addr learned my addr 172.21.15.80:0/1484642746 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:53.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998b541700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f998412cb00 0x7f9984167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:53.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998ad40700 1 -- 172.21.15.80:0/1484642746 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f998412cb00 msgr2=0x7f9984167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:53.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998ad40700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f998412cb00 0x7f9984167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:53.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998ad40700 1 -- 172.21.15.80:0/1484642746 >> v1:172.21.15.174:6789/0 conn(0x7f998412d9c0 legacy=0x7f998412c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:53.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998ad40700 1 -- 172.21.15.80:0/1484642746 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998412abc0 con 0x7f998413a780 2019-11-28T11:25:53.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998b541700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f998412cb00 0x7f9984167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:53.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998ad40700 1 --2- 172.21.15.80:0/1484642746 >> v2:172.21.15.80:3300/0 conn(0x7f998413a780 0x7f998412d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f996c010450 tx=0x7f996c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998ad40700 1 --2- 172.21.15.80:0/1484642746 >> v2:172.21.15.80:3300/0 conn(0x7f998413a780 0x7f998412d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f996c010450 tx=0x7f996c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998ad40700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998413a780 0x7f998412d480 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7f996c010450 tx=0x7f996c0107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:53.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998ad40700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998413a780 0x7f998412d480 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f996c010450 tx=0x7f996c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998ad40700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998413a780 0x7f998412d480 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f996c010450 tx=0x7f996c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f99837fe700 1 -- 172.21.15.80:0/1484642746 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f996c005770 con 0x7f998413a780 2019-11-28T11:25:53.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998ad40700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998413a780 0x7f998412d480 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f996c010450 tx=0x7f996c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f99837fe700 1 -- 172.21.15.80:0/1484642746 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c005390 con 0x7f998413a780 2019-11-28T11:25:53.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f99837fe700 1 -- 172.21.15.80:0/1484642746 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f996c005d50 con 0x7f998413a780 2019-11-28T11:25:53.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998c7a3700 1 -- 172.21.15.80:0/1484642746 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998412af40 con 0x7f998413a780 2019-11-28T11:25:53.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998c7a3700 1 -- 172.21.15.80:0/1484642746 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998412abc0 con 0x7f998413a780 2019-11-28T11:25:53.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.310+0000 7f998ad40700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998413a780 0x7f998412d480 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f996c010450 tx=0x7f996c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.311+0000 7f99837fe700 1 -- 172.21.15.80:0/1484642746 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f996c005580 con 0x7f998413a780 2019-11-28T11:25:53.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.311+0000 7f998ad40700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998413a780 0x7f998412d480 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f996c010450 tx=0x7f996c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.311+0000 7f99837fe700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9968018730 0x7f996801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:53.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.311+0000 7f99837fe700 1 -- 172.21.15.80:0/1484642746 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6117+0+0 (secure 0 0 0) 0x7f996c031cd0 con 0x7f998413a780 2019-11-28T11:25:53.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.311+0000 7f998a53f700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9968018730 0x7f996801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:53.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.311+0000 7f998a53f700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9968018730 0x7f996801abc0 crc :-1 s=READY pgs=129 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:53.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.319+0000 7f998c7a3700 1 -- 172.21.15.80:0/1484642746 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998412af40 con 0x7f998413a780 2019-11-28T11:25:53.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.322+0000 7f998ad40700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998413a780 0x7f998412d480 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f996c010450 tx=0x7f996c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.322+0000 7f99837fe700 1 -- 172.21.15.80:0/1484642746 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f996c005180 con 0x7f998413a780 2019-11-28T11:25:53.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.497+0000 7f998c7a3700 1 -- 172.21.15.80:0/1484642746 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f998412abc0 con 0x7f998413a780 2019-11-28T11:25:53.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.498+0000 7f998ad40700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998413a780 0x7f998412d480 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f996c010450 tx=0x7f996c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.498+0000 7f99837fe700 1 -- 172.21.15.80:0/1484642746 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+1423 (secure 0 0 0) 0x7f996c005ee0 con 0x7f998413a780 2019-11-28T11:25:53.520 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 7 2019-11-28T11:25:53.520 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:53.521 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:25:19.931718+0000","modified":"2019-11-28T11:25:52.614547+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-11-28T11:25:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.500+0000 7f998c7a3700 1 -- 172.21.15.80:0/1484642746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9968018730 msgr2=0x7f996801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.500+0000 7f998c7a3700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9968018730 0x7f996801abc0 crc :-1 s=READY pgs=129 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.500+0000 7f998c7a3700 1 -- 172.21.15.80:0/1484642746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998413a780 msgr2=0x7f998412d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.500+0000 7f998c7a3700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998413a780 0x7f998412d480 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7f996c010450 tx=0x7f996c0107f0).stop 2019-11-28T11:25:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.501+0000 7f998c7a3700 1 -- 172.21.15.80:0/1484642746 shutdown_connections 2019-11-28T11:25:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.501+0000 7f998c7a3700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f998412cb00 0x7f9984167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.501+0000 7f998c7a3700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9968018730 0x7f996801abc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.501+0000 7f998c7a3700 1 --2- 172.21.15.80:0/1484642746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f998413a780 0x7f998412d480 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:53.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.501+0000 7f998c7a3700 1 -- 172.21.15.80:0/1484642746 shutdown_connections 2019-11-28T11:25:53.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.501+0000 7f998c7a3700 1 -- 172.21.15.80:0/1484642746 wait complete. 2019-11-28T11:25:53.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.501+0000 7f998c7a3700 1 -- 172.21.15.80:0/1484642746 >> 172.21.15.80:0/1484642746 conn(0x7f9984127dc0 msgr2=0x7f9984141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:53.531 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:25:53.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.635+0000 7f34b0ab5700 1 Processor -- start 2019-11-28T11:25:53.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.635+0000 7f34b0ab5700 1 -- start start 2019-11-28T11:25:53.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.636+0000 7f34b0ab5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac06c0a0 0x7f34ac072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:53.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.636+0000 7f34b0ab5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34ac072620 0x7f34ac164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:53.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.636+0000 7f34b0ab5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac06db00 con 0x7f34ac0734e0 2019-11-28T11:25:53.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.636+0000 7f34b0ab5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac06f330 con 0x7f34ac072620 2019-11-28T11:25:53.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.636+0000 7f34b0ab5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0706c0 con 0x7f34ac06c0a0 2019-11-28T11:25:53.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.636+0000 7f34ab59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34ac072620 0x7f34ac164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:53.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.636+0000 7f34ab59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34ac072620 0x7f34ac164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60314/0 (socket says 172.21.15.80:60314) 2019-11-28T11:25:53.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34ab59e700 1 -- 172.21.15.80:0/1868431297 learned_addr learned my addr 172.21.15.80:0/1868431297 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:53.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34aad9d700 1 --2- 172.21.15.80:0/1868431297 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac06c0a0 0x7f34ac072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:53.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34ab59e700 1 -- 172.21.15.80:0/1868431297 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac06c0a0 msgr2=0x7f34ac072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:53.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34ab59e700 1 --2- 172.21.15.80:0/1868431297 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac06c0a0 0x7f34ac072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:53.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34ab59e700 1 -- 172.21.15.80:0/1868431297 >> v1:172.21.15.174:6789/0 conn(0x7f34ac0734e0 legacy=0x7f34ac071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:53.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34ab59e700 1 -- 172.21.15.80:0/1868431297 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac070a40 con 0x7f34ac072620 2019-11-28T11:25:53.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34a9d9b700 1 -- 172.21.15.80:0/1868431297 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 758818693 0 0) 0x7f34940013b0 con 0x7f34ac0734e0 2019-11-28T11:25:53.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34ab59e700 1 --2- 172.21.15.80:0/1868431297 >> v2:172.21.15.80:3300/0 conn(0x7f34ac072620 0x7f34ac164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f34a400f6b0 tx=0x7f34a400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34ab59e700 1 --2- 172.21.15.80:0/1868431297 >> v2:172.21.15.80:3300/0 conn(0x7f34ac072620 0x7f34ac164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f34a400f6b0 tx=0x7f34a400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34ab59e700 1 --2- 172.21.15.80:0/1868431297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34ac072620 0x7f34ac164d70 secure :-1 s=READY pgs=288 cs=0 l=1 rx=0x7f34a400f6b0 tx=0x7f34a400fa50).ready entity=mon.0 client_cookie=a78638889bbce9fc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:53.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34ab59e700 1 --2- 172.21.15.80:0/1868431297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34ac072620 0x7f34ac164d70 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7f34a400f6b0 tx=0x7f34a400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34a9d9b700 1 -- 172.21.15.80:0/1868431297 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34a4000a70 con 0x7f34ac072620 2019-11-28T11:25:53.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34ab59e700 1 --2- 172.21.15.80:0/1868431297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34ac072620 0x7f34ac164d70 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7f34a400f6b0 tx=0x7f34a400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34a9d9b700 1 -- 172.21.15.80:0/1868431297 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a4000a70 con 0x7f34ac072620 2019-11-28T11:25:53.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34ab59e700 1 --2- 172.21.15.80:0/1868431297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34ac072620 0x7f34ac164d70 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7f34a400f6b0 tx=0x7f34a400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34a9d9b700 1 -- 172.21.15.80:0/1868431297 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34a40012d0 con 0x7f34ac072620 2019-11-28T11:25:53.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34b0ab5700 1 -- 172.21.15.80:0/1868431297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34ac072620 msgr2=0x7f34ac164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:53.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.637+0000 7f34b0ab5700 1 --2- 172.21.15.80:0/1868431297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34ac072620 0x7f34ac164d70 secure :-1 s=READY pgs=288 cs=0 l=1 rx=0x7f34a400f6b0 tx=0x7f34a400fa50).stop 2019-11-28T11:25:53.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.638+0000 7f34b0ab5700 1 -- 172.21.15.80:0/1868431297 shutdown_connections 2019-11-28T11:25:53.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.638+0000 7f34b0ab5700 1 --2- 172.21.15.80:0/1868431297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34ac072620 0x7f34ac164d70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:53.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.638+0000 7f34b0ab5700 1 --2- 172.21.15.80:0/1868431297 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac06c0a0 0x7f34ac072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:53.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.638+0000 7f34b0ab5700 1 -- 172.21.15.80:0/1868431297 shutdown_connections 2019-11-28T11:25:53.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.638+0000 7f34b0ab5700 1 -- 172.21.15.80:0/1868431297 wait complete. 2019-11-28T11:25:53.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.638+0000 7f34b0ab5700 1 -- 172.21.15.80:0/1868431297 >> 172.21.15.80:0/1868431297 conn(0x7f34ac061cf0 msgr2=0x7f34ac064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:53.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.640+0000 7f34b0ab5700 1 Processor -- start 2019-11-28T11:25:53.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.640+0000 7f34b0ab5700 1 -- start start 2019-11-28T11:25:53.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.641+0000 7f34b0ab5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac11b2e0 0x7f34ac11b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:53.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.641+0000 7f34b0ab5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f34ac11bea0 0x7f34ac13e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:53.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.641+0000 7f34b0ab5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac13f190 con 0x7f34ac1299b0 2019-11-28T11:25:53.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.641+0000 7f34b0ab5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac142d50 con 0x7f34ac11bea0 2019-11-28T11:25:53.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.641+0000 7f34b0ab5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac143020 con 0x7f34ac11b2e0 2019-11-28T11:25:53.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.641+0000 7f34ab59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f34ac11bea0 0x7f34ac13e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:53.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.641+0000 7f34aa59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac11b2e0 0x7f34ac11b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:53.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.641+0000 7f34ab59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f34ac11bea0 0x7f34ac13e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:46976/0 (socket says 172.21.15.80:46976) 2019-11-28T11:25:53.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.641+0000 7f34ab59e700 1 -- 172.21.15.80:0/1364375589 learned_addr learned my addr 172.21.15.80:0/1364375589 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:53.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34aa59c700 1 -- 172.21.15.80:0/1364375589 >> v2:172.21.15.174:3300/0 conn(0x7f34ac11bea0 msgr2=0x7f34ac13e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:53.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34aa59c700 1 --2- 172.21.15.80:0/1364375589 >> v2:172.21.15.174:3300/0 conn(0x7f34ac11bea0 0x7f34ac13e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:53.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34aa59c700 1 -- 172.21.15.80:0/1364375589 >> v1:172.21.15.174:6789/0 conn(0x7f34ac1299b0 legacy=0x7f34ac11c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:53.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34aa59c700 1 -- 172.21.15.80:0/1364375589 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac119ba0 con 0x7f34ac11b2e0 2019-11-28T11:25:53.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34ab59e700 1 --2- 172.21.15.80:0/1364375589 >> v2:172.21.15.174:3300/0 conn(0x7f34ac11bea0 0x7f34ac13e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:25:53.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34aa59c700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac11b2e0 0x7f34ac11b960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3494010740 tx=0x7f3494010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34aa59c700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac11b2e0 0x7f34ac11b960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3494010740 tx=0x7f3494010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34aa59c700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac11b2e0 0x7f34ac11b960 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f3494010740 tx=0x7f3494010ae0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:53.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34aa59c700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac11b2e0 0x7f34ac11b960 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f3494010740 tx=0x7f3494010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34a37fe700 1 -- 172.21.15.80:0/1364375589 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3494000df0 con 0x7f34ac11b2e0 2019-11-28T11:25:53.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34aa59c700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac11b2e0 0x7f34ac11b960 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f3494010740 tx=0x7f3494010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34aa59c700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac11b2e0 0x7f34ac11b960 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f3494010740 tx=0x7f3494010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34a37fe700 1 -- 172.21.15.80:0/1364375589 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349400f210 con 0x7f34ac11b2e0 2019-11-28T11:25:53.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34b0ab5700 1 -- 172.21.15.80:0/1364375589 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac119f20 con 0x7f34ac11b2e0 2019-11-28T11:25:53.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34a37fe700 1 -- 172.21.15.80:0/1364375589 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f349400f8a0 con 0x7f34ac11b2e0 2019-11-28T11:25:53.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34b0ab5700 1 -- 172.21.15.80:0/1364375589 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac119ba0 con 0x7f34ac11b2e0 2019-11-28T11:25:53.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.642+0000 7f34aa59c700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac11b2e0 0x7f34ac11b960 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f3494010740 tx=0x7f3494010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.643+0000 7f34a37fe700 1 -- 172.21.15.80:0/1364375589 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f349400f4a0 con 0x7f34ac11b2e0 2019-11-28T11:25:53.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.643+0000 7f34aa59c700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac11b2e0 0x7f34ac11b960 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f3494010740 tx=0x7f3494010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.643+0000 7f34a37fe700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3484018730 0x7f348401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:53.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.643+0000 7f34a37fe700 1 -- 172.21.15.80:0/1364375589 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6117+0+0 (secure 0 0 0) 0x7f3494031db0 con 0x7f34ac11b2e0 2019-11-28T11:25:53.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.643+0000 7f34aad9d700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3484018730 0x7f348401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:53.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.643+0000 7f34aad9d700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3484018730 0x7f348401abc0 crc :-1 s=READY pgs=130 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:53.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.651+0000 7f34b0ab5700 1 -- 172.21.15.80:0/1364375589 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac119f20 con 0x7f34ac11b2e0 2019-11-28T11:25:53.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.655+0000 7f34aa59c700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac11b2e0 0x7f34ac11b960 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f3494010740 tx=0x7f3494010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:53.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.655+0000 7f34a37fe700 1 -- 172.21.15.80:0/1364375589 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3494000dd0 con 0x7f34ac11b2e0 2019-11-28T11:25:53.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:53.820+0000 7f34b0ab5700 1 -- 172.21.15.80:0/1364375589 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f34ac119ba0 con 0x7f34ac11b2e0 2019-11-28T11:25:54.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.620+0000 7f34aa59c700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac11b2e0 0x7f34ac11b960 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f3494010740 tx=0x7f3494010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:54.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.620+0000 7f34a37fe700 1 -- 172.21.15.80:0/1364375589 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3494009920 con 0x7f34ac11b2e0 2019-11-28T11:25:54.656 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:25:54.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.637+0000 7f34b0ab5700 1 -- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3484018730 msgr2=0x7f348401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:54.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.637+0000 7f34b0ab5700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3484018730 0x7f348401abc0 crc :-1 s=READY pgs=130 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.637+0000 7f34b0ab5700 1 -- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac11b2e0 msgr2=0x7f34ac11b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.637+0000 7f34b0ab5700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac11b2e0 0x7f34ac11b960 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f3494010740 tx=0x7f3494010ae0).stop 2019-11-28T11:25:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.638+0000 7f34b0ab5700 1 -- 172.21.15.80:0/1364375589 shutdown_connections 2019-11-28T11:25:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.638+0000 7f34b0ab5700 1 --2- 172.21.15.80:0/1364375589 >> v2:172.21.15.174:3300/0 conn(0x7f34ac11bea0 0x7f34ac13e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.638+0000 7f34b0ab5700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34ac11b2e0 0x7f34ac11b960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:54.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.638+0000 7f34b0ab5700 1 --2- 172.21.15.80:0/1364375589 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3484018730 0x7f348401abc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:54.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.638+0000 7f34b0ab5700 1 -- 172.21.15.80:0/1364375589 shutdown_connections 2019-11-28T11:25:54.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.638+0000 7f34b0ab5700 1 -- 172.21.15.80:0/1364375589 wait complete. 2019-11-28T11:25:54.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.638+0000 7f34b0ab5700 1 -- 172.21.15.80:0/1364375589 >> 172.21.15.80:0/1364375589 conn(0x7f34ac13b860 msgr2=0x7f34ac1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:54.670 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:25:54.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.768+0000 7f7d68b88700 1 Processor -- start 2019-11-28T11:25:54.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.768+0000 7f7d68b88700 1 -- start start 2019-11-28T11:25:54.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.769+0000 7f7d68b88700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7d6406c0a0 0x7f7d64072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:54.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.769+0000 7f7d68b88700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7d64072620 0x7f7d64164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:54.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.769+0000 7f7d68b88700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d6406db00 con 0x7f7d640734e0 2019-11-28T11:25:54.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.769+0000 7f7d68b88700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6406fd60 con 0x7f7d64072620 2019-11-28T11:25:54.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.769+0000 7f7d68b88700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d64070030 con 0x7f7d6406c0a0 2019-11-28T11:25:54.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d6359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7d64072620 0x7f7d64164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:54.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d6359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7d64072620 0x7f7d64164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60328/0 (socket says 172.21.15.80:60328) 2019-11-28T11:25:54.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d6359e700 1 -- 172.21.15.80:0/3828291444 learned_addr learned my addr 172.21.15.80:0/3828291444 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:54.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d6259c700 1 --1- 172.21.15.80:0/3828291444 >> v1:172.21.15.80:6789/0 conn(0x7f7d640734e0 0x7f7d64071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59646/0 (socket says 172.21.15.80:59646) 2019-11-28T11:25:54.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d62d9d700 1 --2- 172.21.15.80:0/3828291444 >> v2:172.21.15.174:3300/0 conn(0x7f7d6406c0a0 0x7f7d64072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:54.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d6359e700 1 -- 172.21.15.80:0/3828291444 >> v2:172.21.15.174:3300/0 conn(0x7f7d6406c0a0 msgr2=0x7f7d64072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:54.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d6359e700 1 --2- 172.21.15.80:0/3828291444 >> v2:172.21.15.174:3300/0 conn(0x7f7d6406c0a0 0x7f7d64072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:54.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d6359e700 1 -- 172.21.15.80:0/3828291444 >> v1:172.21.15.80:6789/0 conn(0x7f7d640734e0 legacy=0x7f7d64071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:54.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d61d9b700 1 -- 172.21.15.80:0/3828291444 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613511547 0 0) 0x7f7d4c001480 con 0x7f7d640734e0 2019-11-28T11:25:54.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d6359e700 1 -- 172.21.15.80:0/3828291444 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d640706c0 con 0x7f7d64072620 2019-11-28T11:25:54.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d6359e700 1 --2- 172.21.15.80:0/3828291444 >> v2:172.21.15.80:3300/0 conn(0x7f7d64072620 0x7f7d64164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7d5c00f6b0 tx=0x7f7d5c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:54.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d6359e700 1 --2- 172.21.15.80:0/3828291444 >> v2:172.21.15.80:3300/0 conn(0x7f7d64072620 0x7f7d64164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7d5c00f6b0 tx=0x7f7d5c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:54.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d6359e700 1 --2- 172.21.15.80:0/3828291444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d64072620 0x7f7d64164d70 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7f7d5c00f6b0 tx=0x7f7d5c00fa50).ready entity=mon.0 client_cookie=dc9553caad0e8c6f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:54.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d6359e700 1 --2- 172.21.15.80:0/3828291444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d64072620 0x7f7d64164d70 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f7d5c00f6b0 tx=0x7f7d5c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:54.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d61d9b700 1 -- 172.21.15.80:0/3828291444 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d5c000a70 con 0x7f7d64072620 2019-11-28T11:25:54.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d6359e700 1 --2- 172.21.15.80:0/3828291444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d64072620 0x7f7d64164d70 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f7d5c00f6b0 tx=0x7f7d5c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:54.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d6359e700 1 --2- 172.21.15.80:0/3828291444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d64072620 0x7f7d64164d70 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f7d5c00f6b0 tx=0x7f7d5c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:54.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d61d9b700 1 -- 172.21.15.80:0/3828291444 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5c000a70 con 0x7f7d64072620 2019-11-28T11:25:54.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d61d9b700 1 -- 172.21.15.80:0/3828291444 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d5c0012d0 con 0x7f7d64072620 2019-11-28T11:25:54.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d68b88700 1 -- 172.21.15.80:0/3828291444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d64072620 msgr2=0x7f7d64164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:54.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.770+0000 7f7d68b88700 1 --2- 172.21.15.80:0/3828291444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d64072620 0x7f7d64164d70 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7f7d5c00f6b0 tx=0x7f7d5c00fa50).stop 2019-11-28T11:25:54.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.771+0000 7f7d68b88700 1 -- 172.21.15.80:0/3828291444 shutdown_connections 2019-11-28T11:25:54.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.771+0000 7f7d68b88700 1 --2- 172.21.15.80:0/3828291444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d64072620 0x7f7d64164d70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:54.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.771+0000 7f7d68b88700 1 --2- 172.21.15.80:0/3828291444 >> v2:172.21.15.174:3300/0 conn(0x7f7d6406c0a0 0x7f7d64072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:54.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.771+0000 7f7d68b88700 1 -- 172.21.15.80:0/3828291444 shutdown_connections 2019-11-28T11:25:54.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.771+0000 7f7d68b88700 1 -- 172.21.15.80:0/3828291444 wait complete. 2019-11-28T11:25:54.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.771+0000 7f7d68b88700 1 -- 172.21.15.80:0/3828291444 >> 172.21.15.80:0/3828291444 conn(0x7f7d64061cf0 msgr2=0x7f7d64064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:54.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.773+0000 7f7d68b88700 1 Processor -- start 2019-11-28T11:25:54.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.774+0000 7f7d68b88700 1 -- start start 2019-11-28T11:25:54.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.774+0000 7f7d68b88700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d6413e5f0 0x7f7d6413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:54.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.774+0000 7f7d68b88700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7d6410a070 0x7f7d6410bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:54.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.774+0000 7f7d68b88700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7d6410a4e0 0x7f7d6410c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:54.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.774+0000 7f7d68b88700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6410d630 con 0x7f7d6410a070 2019-11-28T11:25:54.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.774+0000 7f7d68b88700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6410e060 con 0x7f7d6410a4e0 2019-11-28T11:25:54.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.774+0000 7f7d68b88700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6413f1c0 con 0x7f7d6413e5f0 2019-11-28T11:25:54.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.774+0000 7f7d6259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7d6410a070 0x7f7d6410bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:54.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.774+0000 7f7d6259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7d6410a070 0x7f7d6410bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60332/0 (socket says 172.21.15.80:60332) 2019-11-28T11:25:54.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.774+0000 7f7d6259c700 1 -- 172.21.15.80:0/1526585467 learned_addr learned my addr 172.21.15.80:0/1526585467 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:54.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d6359e700 1 --2- 172.21.15.80:0/1526585467 >> v2:172.21.15.174:3300/0 conn(0x7f7d6410a4e0 0x7f7d6410c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:54.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d62d9d700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d6413e5f0 0x7f7d6413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:54.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d6259c700 1 -- 172.21.15.80:0/1526585467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d6413e5f0 msgr2=0x7f7d6413e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:54.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d6259c700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d6413e5f0 0x7f7d6413e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:54.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d6259c700 1 -- 172.21.15.80:0/1526585467 >> v2:172.21.15.174:3300/0 conn(0x7f7d6410a4e0 msgr2=0x7f7d6410c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:54.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d6259c700 1 --2- 172.21.15.80:0/1526585467 >> v2:172.21.15.174:3300/0 conn(0x7f7d6410a4e0 0x7f7d6410c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:54.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d6259c700 1 -- 172.21.15.80:0/1526585467 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6410e9c0 con 0x7f7d6410a070 2019-11-28T11:25:54.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d6259c700 1 --2- 172.21.15.80:0/1526585467 >> v2:172.21.15.80:3300/0 conn(0x7f7d6410a070 0x7f7d6410bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d4c0107b0 tx=0x7f7d4c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:54.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d6259c700 1 --2- 172.21.15.80:0/1526585467 >> v2:172.21.15.80:3300/0 conn(0x7f7d6410a070 0x7f7d6410bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d4c0107b0 tx=0x7f7d4c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:54.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d6259c700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d6410a070 0x7f7d6410bdb0 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7f7d4c0107b0 tx=0x7f7d4c010660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:54.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d6259c700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d6410a070 0x7f7d6410bdb0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f7d4c0107b0 tx=0x7f7d4c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:54.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d5b7fe700 1 -- 172.21.15.80:0/1526585467 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d4c001010 con 0x7f7d6410a070 2019-11-28T11:25:54.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d6259c700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d6410a070 0x7f7d6410bdb0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f7d4c0107b0 tx=0x7f7d4c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:54.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d6259c700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d6410a070 0x7f7d6410bdb0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f7d4c0107b0 tx=0x7f7d4c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:54.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d5b7fe700 1 -- 172.21.15.80:0/1526585467 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c0045c0 con 0x7f7d6410a070 2019-11-28T11:25:54.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d5b7fe700 1 -- 172.21.15.80:0/1526585467 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d4c004b90 con 0x7f7d6410a070 2019-11-28T11:25:54.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d68b88700 1 -- 172.21.15.80:0/1526585467 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6410ed40 con 0x7f7d6410a070 2019-11-28T11:25:54.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d68b88700 1 -- 172.21.15.80:0/1526585467 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6410e9c0 con 0x7f7d6410a070 2019-11-28T11:25:54.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.775+0000 7f7d6259c700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d6410a070 0x7f7d6410bdb0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f7d4c0107b0 tx=0x7f7d4c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:54.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.776+0000 7f7d6259c700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d6410a070 0x7f7d6410bdb0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f7d4c0107b0 tx=0x7f7d4c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:54.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.776+0000 7f7d5b7fe700 1 -- 172.21.15.80:0/1526585467 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7d4c0047b0 con 0x7f7d6410a070 2019-11-28T11:25:54.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.776+0000 7f7d5b7fe700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d3c018730 0x7f7d3c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:54.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.776+0000 7f7d5b7fe700 1 -- 172.21.15.80:0/1526585467 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6117+0+0 (secure 0 0 0) 0x7f7d4c031d80 con 0x7f7d6410a070 2019-11-28T11:25:54.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.776+0000 7f7d62d9d700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d3c018730 0x7f7d3c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:54.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.776+0000 7f7d62d9d700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d3c018730 0x7f7d3c01abc0 crc :-1 s=READY pgs=131 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:54.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.784+0000 7f7d68b88700 1 -- 172.21.15.80:0/1526585467 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d6410ed40 con 0x7f7d6410a070 2019-11-28T11:25:54.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.787+0000 7f7d6259c700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d6410a070 0x7f7d6410bdb0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f7d4c0107b0 tx=0x7f7d4c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:54.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.787+0000 7f7d5b7fe700 1 -- 172.21.15.80:0/1526585467 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7d4c001270 con 0x7f7d6410a070 2019-11-28T11:25:54.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.959+0000 7f7d68b88700 1 -- 172.21.15.80:0/1526585467 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d6410e9c0 con 0x7f7d6410a070 2019-11-28T11:25:54.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.959+0000 7f7d6259c700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d6410a070 0x7f7d6410bdb0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f7d4c0107b0 tx=0x7f7d4c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:54.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.959+0000 7f7d5b7fe700 1 -- 172.21.15.80:0/1526585467 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+1423 (secure 0 0 0) 0x7f7d4c020190 con 0x7f7d6410a070 2019-11-28T11:25:54.982 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 8 2019-11-28T11:25:54.982 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:54.982 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:25:19.931718+0000","modified":"2019-11-28T11:25:54.616949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-11-28T11:25:54.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.962+0000 7f7d68b88700 1 -- 172.21.15.80:0/1526585467 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d3c018730 msgr2=0x7f7d3c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:54.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.962+0000 7f7d68b88700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d3c018730 0x7f7d3c01abc0 crc :-1 s=READY pgs=131 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:54.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.962+0000 7f7d68b88700 1 -- 172.21.15.80:0/1526585467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d6410a070 msgr2=0x7f7d6410bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:54.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.962+0000 7f7d68b88700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d6410a070 0x7f7d6410bdb0 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7f7d4c0107b0 tx=0x7f7d4c010660).stop 2019-11-28T11:25:54.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.962+0000 7f7d68b88700 1 -- 172.21.15.80:0/1526585467 shutdown_connections 2019-11-28T11:25:54.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.962+0000 7f7d68b88700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d3c018730 0x7f7d3c01abc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:54.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.962+0000 7f7d68b88700 1 --2- 172.21.15.80:0/1526585467 >> v2:172.21.15.174:3300/0 conn(0x7f7d6410a4e0 0x7f7d6410c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:54.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.962+0000 7f7d68b88700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d6410a070 0x7f7d6410bdb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:54.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.962+0000 7f7d68b88700 1 --2- 172.21.15.80:0/1526585467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d6413e5f0 0x7f7d6413e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:54.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.962+0000 7f7d68b88700 1 -- 172.21.15.80:0/1526585467 shutdown_connections 2019-11-28T11:25:54.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.962+0000 7f7d68b88700 1 -- 172.21.15.80:0/1526585467 wait complete. 2019-11-28T11:25:54.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:54.962+0000 7f7d68b88700 1 -- 172.21.15.80:0/1526585467 >> 172.21.15.80:0/1526585467 conn(0x7f7d6413d620 msgr2=0x7f7d6413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:54.993 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:25:55.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.101+0000 7f2fcb614700 1 Processor -- start 2019-11-28T11:25:55.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.101+0000 7f2fcb614700 1 -- start start 2019-11-28T11:25:55.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.102+0000 7f2fcb614700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2fc406d120 0x7f2fc4165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:55.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.102+0000 7f2fcb614700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc406d580 con 0x7f2fc406c490 2019-11-28T11:25:55.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.102+0000 7f2fcb614700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc406db00 con 0x7f2fc406c0a0 2019-11-28T11:25:55.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.102+0000 7f2fcb614700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc406fd60 con 0x7f2fc406d120 2019-11-28T11:25:55.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.102+0000 7f2fc93b0700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2fc406c490 0x7f2fc406c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59660/0 (socket says 172.21.15.80:59660) 2019-11-28T11:25:55.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.102+0000 7f2fc93b0700 1 -- 172.21.15.80:0/3217024279 learned_addr learned my addr 172.21.15.80:0/3217024279 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:55.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.102+0000 7f2fca3b2700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2fc406d120 0x7f2fc4165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:55.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.102+0000 7f2fc8baf700 1 -- 172.21.15.80:0/3217024279 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592315494 0 0) 0x7f2fb4001150 con 0x7f2fc406c490 2019-11-28T11:25:55.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.102+0000 7f2fc8baf700 1 -- 172.21.15.80:0/3217024279 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb0002e80 con 0x7f2fc406c490 2019-11-28T11:25:55.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.102+0000 7f2fc8baf700 1 -- 172.21.15.80:0/3217024279 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3456782957 0 0) 0x7f2fb4001130 con 0x7f2fc406c490 2019-11-28T11:25:55.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc8baf700 1 -- 172.21.15.80:0/3217024279 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2fc406d120 msgr2=0x7f2fc4165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:55.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc8baf700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2fc406d120 0x7f2fc4165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:55.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc8baf700 1 -- 172.21.15.80:0/3217024279 >> v1:172.21.15.174:6789/0 conn(0x7f2fc406c0a0 legacy=0x7f2fc4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:55.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc8baf700 1 -- 172.21.15.80:0/3217024279 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc40706c0 con 0x7f2fc406c490 2019-11-28T11:25:55.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc8baf700 1 -- 172.21.15.80:0/3217024279 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f2fb4001660 con 0x7f2fc406c490 2019-11-28T11:25:55.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc8baf700 1 -- 172.21.15.80:0/3217024279 >> v1:172.21.15.80:6789/0 conn(0x7f2fc406c490 legacy=0x7f2fc406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:55.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc8baf700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb0003ab0 0x7f2fb0005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:55.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc8baf700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2fb0006670 0x7f2fb0008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:55.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc8baf700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2fb00093a0 0x7f2fb000b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:55.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc8baf700 1 -- 172.21.15.80:0/3217024279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb000bff0 con 0x7f2fb0003ab0 2019-11-28T11:25:55.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc8baf700 1 -- 172.21.15.80:0/3217024279 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00501f0 con 0x7f2fb0006670 2019-11-28T11:25:55.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc8baf700 1 -- 172.21.15.80:0/3217024279 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb0050420 con 0x7f2fb00093a0 2019-11-28T11:25:55.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc9bb1700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb0003ab0 0x7f2fb0005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:55.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc93b0700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2fb0006670 0x7f2fb0008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:55.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fca3b2700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2fb00093a0 0x7f2fb000b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:55.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc9bb1700 1 -- 172.21.15.80:0/3217024279 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2fb00093a0 msgr2=0x7f2fb000b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:55.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc9bb1700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2fb00093a0 0x7f2fb000b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:55.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc9bb1700 1 -- 172.21.15.80:0/3217024279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2fb0006670 msgr2=0x7f2fb0008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:55.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc9bb1700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2fb0006670 0x7f2fb0008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:55.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc9bb1700 1 -- 172.21.15.80:0/3217024279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00506d0 con 0x7f2fb0003ab0 2019-11-28T11:25:55.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc9bb1700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb0003ab0 0x7f2fb0005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2fc000b2f0 tx=0x7f2fc000b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc9bb1700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb0003ab0 0x7f2fb0005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2fc000b2f0 tx=0x7f2fc000b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc9bb1700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb0003ab0 0x7f2fb0005f10 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7f2fc000b2f0 tx=0x7f2fc000b5f0).ready entity=mon.0 client_cookie=3c8c17e430b996f5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:55.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc9bb1700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb0003ab0 0x7f2fb0005f10 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f2fc000b2f0 tx=0x7f2fc000b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc8baf700 1 -- 172.21.15.80:0/3217024279 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fc0009e70 con 0x7f2fb0003ab0 2019-11-28T11:25:55.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc9bb1700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb0003ab0 0x7f2fb0005f10 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f2fc000b2f0 tx=0x7f2fc000b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc8baf700 1 -- 172.21.15.80:0/3217024279 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc00099f0 con 0x7f2fb0003ab0 2019-11-28T11:25:55.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc9bb1700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb0003ab0 0x7f2fb0005f10 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f2fc000b2f0 tx=0x7f2fc000b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fc8baf700 1 -- 172.21.15.80:0/3217024279 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fc0009be0 con 0x7f2fb0003ab0 2019-11-28T11:25:55.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fcb614700 1 -- 172.21.15.80:0/3217024279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb0003ab0 msgr2=0x7f2fb0005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:55.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fcb614700 1 --2- 172.21.15.80:0/3217024279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fb0003ab0 0x7f2fb0005f10 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7f2fc000b2f0 tx=0x7f2fc000b5f0).stop 2019-11-28T11:25:55.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.103+0000 7f2fca3b2700 1 -- 172.21.15.80:0/3217024279 reap_dead start 2019-11-28T11:25:55.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.104+0000 7f2fcb614700 1 -- 172.21.15.80:0/3217024279 shutdown_connections 2019-11-28T11:25:55.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.104+0000 7f2fcb614700 1 -- 172.21.15.80:0/3217024279 shutdown_connections 2019-11-28T11:25:55.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.104+0000 7f2fcb614700 1 -- 172.21.15.80:0/3217024279 wait complete. 2019-11-28T11:25:55.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.104+0000 7f2fcb614700 1 -- 172.21.15.80:0/3217024279 >> 172.21.15.80:0/3217024279 conn(0x7f2fc4061cf0 msgr2=0x7f2fc4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:55.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.106+0000 7f2fcb614700 1 Processor -- start 2019-11-28T11:25:55.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.107+0000 7f2fcb614700 1 -- start start 2019-11-28T11:25:55.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.107+0000 7f2fcb614700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2fc4150f50 0x7f2fc407b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:55.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.107+0000 7f2fcb614700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc40754d0 con 0x7f2fc407bba0 2019-11-28T11:25:55.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.107+0000 7f2fcb614700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc412eb20 con 0x7f2fc4074d00 2019-11-28T11:25:55.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.107+0000 7f2fcb614700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc4078980 con 0x7f2fc4150f50 2019-11-28T11:25:55.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.107+0000 7f2fc93b0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2fc4150f50 0x7f2fc407b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:55.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.107+0000 7f2fc93b0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2fc4150f50 0x7f2fc407b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60354/0 (socket says 172.21.15.80:60354) 2019-11-28T11:25:55.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.107+0000 7f2fc93b0700 1 -- 172.21.15.80:0/2762586785 learned_addr learned my addr 172.21.15.80:0/2762586785 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:55.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.107+0000 7f2fca3b2700 1 --1- 172.21.15.80:0/2762586785 >> v1:172.21.15.80:6789/0 conn(0x7f2fc407bba0 0x7f2fc4167c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59672/0 (socket says 172.21.15.80:59672) 2019-11-28T11:25:55.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.108+0000 7f2fc93b0700 1 -- 172.21.15.80:0/2762586785 >> v1:172.21.15.174:6789/0 conn(0x7f2fc4074d00 legacy=0x7f2fc407aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:55.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.108+0000 7f2fc93b0700 1 -- 172.21.15.80:0/2762586785 >> v1:172.21.15.80:6789/0 conn(0x7f2fc407bba0 legacy=0x7f2fc4167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:55.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.108+0000 7f2fba7fc700 1 -- 172.21.15.80:0/2762586785 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687792914 0 0) 0x7f2fbc000a70 con 0x7f2fc407bba0 2019-11-28T11:25:55.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.108+0000 7f2fc93b0700 1 -- 172.21.15.80:0/2762586785 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc40792e0 con 0x7f2fc4150f50 2019-11-28T11:25:55.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.108+0000 7f2fc93b0700 1 --2- 172.21.15.80:0/2762586785 >> v2:172.21.15.80:3300/0 conn(0x7f2fc4150f50 0x7f2fc407b220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2fb4010430 tx=0x7f2fb40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.108+0000 7f2fc93b0700 1 --2- 172.21.15.80:0/2762586785 >> v2:172.21.15.80:3300/0 conn(0x7f2fc4150f50 0x7f2fc407b220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2fb4010430 tx=0x7f2fb40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.108+0000 7f2fc93b0700 1 --2- 172.21.15.80:0/2762586785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fc4150f50 0x7f2fc407b220 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7f2fb4010430 tx=0x7f2fb40107d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:55.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.108+0000 7f2fc93b0700 1 --2- 172.21.15.80:0/2762586785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fc4150f50 0x7f2fc407b220 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f2fb4010430 tx=0x7f2fb40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.108+0000 7f2fba7fc700 1 -- 172.21.15.80:0/2762586785 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fb4000d40 con 0x7f2fc4150f50 2019-11-28T11:25:55.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.108+0000 7f2fc93b0700 1 --2- 172.21.15.80:0/2762586785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fc4150f50 0x7f2fc407b220 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f2fb4010430 tx=0x7f2fb40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.108+0000 7f2fc93b0700 1 --2- 172.21.15.80:0/2762586785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fc4150f50 0x7f2fc407b220 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f2fb4010430 tx=0x7f2fb40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.108+0000 7f2fba7fc700 1 -- 172.21.15.80:0/2762586785 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb40013a0 con 0x7f2fc4150f50 2019-11-28T11:25:55.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.108+0000 7f2fcb614700 1 -- 172.21.15.80:0/2762586785 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc4079660 con 0x7f2fc4150f50 2019-11-28T11:25:55.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.108+0000 7f2fba7fc700 1 -- 172.21.15.80:0/2762586785 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fb4006a40 con 0x7f2fc4150f50 2019-11-28T11:25:55.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.108+0000 7f2fcb614700 1 -- 172.21.15.80:0/2762586785 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc40792e0 con 0x7f2fc4150f50 2019-11-28T11:25:55.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.108+0000 7f2fc93b0700 1 --2- 172.21.15.80:0/2762586785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fc4150f50 0x7f2fc407b220 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f2fb4010430 tx=0x7f2fb40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.109+0000 7f2fba7fc700 1 -- 172.21.15.80:0/2762586785 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2fb4004450 con 0x7f2fc4150f50 2019-11-28T11:25:55.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.109+0000 7f2fc93b0700 1 --2- 172.21.15.80:0/2762586785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fc4150f50 0x7f2fc407b220 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f2fb4010430 tx=0x7f2fb40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.109+0000 7f2fba7fc700 1 --2- 172.21.15.80:0/2762586785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2fac020f60 0x7f2fac0233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:55.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.109+0000 7f2fba7fc700 1 -- 172.21.15.80:0/2762586785 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6117+0+0 (secure 0 0 0) 0x7f2fb4031da0 con 0x7f2fc4150f50 2019-11-28T11:25:55.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.109+0000 7f2fc9bb1700 1 --2- 172.21.15.80:0/2762586785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2fac020f60 0x7f2fac0233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:55.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.109+0000 7f2fc9bb1700 1 --2- 172.21.15.80:0/2762586785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2fac020f60 0x7f2fac0233f0 crc :-1 s=READY pgs=132 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:55.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.116+0000 7f2fcb614700 1 -- 172.21.15.80:0/2762586785 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc4079660 con 0x7f2fc4150f50 2019-11-28T11:25:55.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.120+0000 7f2fc93b0700 1 --2- 172.21.15.80:0/2762586785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fc4150f50 0x7f2fc407b220 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f2fb4010430 tx=0x7f2fb40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.120+0000 7f2fba7fc700 1 -- 172.21.15.80:0/2762586785 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2fb4004240 con 0x7f2fc4150f50 2019-11-28T11:25:55.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.296+0000 7f2fcb614700 1 -- 172.21.15.80:0/2762586785 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2fc40792e0 con 0x7f2fc4150f50 2019-11-28T11:25:55.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.621+0000 7f2fc93b0700 1 --2- 172.21.15.80:0/2762586785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fc4150f50 0x7f2fc407b220 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f2fb4010430 tx=0x7f2fb40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.621+0000 7f2fba7fc700 1 -- 172.21.15.80:0/2762586785 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2fb4004450 con 0x7f2fc4150f50 2019-11-28T11:25:55.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.662+0000 7f2fcb614700 1 -- 172.21.15.80:0/2762586785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2fac020f60 msgr2=0x7f2fac0233f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:55.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.662+0000 7f2fcb614700 1 --2- 172.21.15.80:0/2762586785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2fac020f60 0x7f2fac0233f0 crc :-1 s=READY pgs=132 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:55.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.662+0000 7f2fcb614700 1 -- 172.21.15.80:0/2762586785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fc4150f50 msgr2=0x7f2fc407b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:55.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.662+0000 7f2fcb614700 1 --2- 172.21.15.80:0/2762586785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fc4150f50 0x7f2fc407b220 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7f2fb4010430 tx=0x7f2fb40107d0).stop 2019-11-28T11:25:55.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.662+0000 7f2fcb614700 1 -- 172.21.15.80:0/2762586785 shutdown_connections 2019-11-28T11:25:55.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.662+0000 7f2fcb614700 1 --2- 172.21.15.80:0/2762586785 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fc4150f50 0x7f2fc407b220 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:55.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.662+0000 7f2fcb614700 1 --2- 172.21.15.80:0/2762586785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2fac020f60 0x7f2fac0233f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:55.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.662+0000 7f2fcb614700 1 -- 172.21.15.80:0/2762586785 shutdown_connections 2019-11-28T11:25:55.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.662+0000 7f2fcb614700 1 -- 172.21.15.80:0/2762586785 wait complete. 2019-11-28T11:25:55.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.662+0000 7f2fcb614700 1 -- 172.21.15.80:0/2762586785 >> 172.21.15.80:0/2762586785 conn(0x7f2fc413fa50 msgr2=0x7f2fc407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:55.693 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:25:55.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.794+0000 7fdda4725700 1 Processor -- start 2019-11-28T11:25:55.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.794+0000 7fdda4725700 1 -- start start 2019-11-28T11:25:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.795+0000 7fdda4725700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdd9c15ed10 0x7fdd9c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.795+0000 7fdda4725700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd9c073020 0x7fdd9c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.795+0000 7fdda4725700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9c06db60 con 0x7fdd9c0734b0 2019-11-28T11:25:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.795+0000 7fdda4725700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9c06fe00 con 0x7fdd9c15ed10 2019-11-28T11:25:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.795+0000 7fdda4725700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0700d0 con 0x7fdd9c073020 2019-11-28T11:25:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.795+0000 7fdda2cc2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdd9c15ed10 0x7fdd9c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.795+0000 7fdda2cc2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdd9c15ed10 0x7fdd9c15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60360/0 (socket says 172.21.15.80:60360) 2019-11-28T11:25:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.795+0000 7fdda34c3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdd9c0734b0 0x7fdd9c0723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59678/0 (socket says 172.21.15.80:59678) 2019-11-28T11:25:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.795+0000 7fdda2cc2700 1 -- 172.21.15.80:0/2835416906 learned_addr learned my addr 172.21.15.80:0/2835416906 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda24c1700 1 --2- 172.21.15.80:0/2835416906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd9c073020 0x7fdd9c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda2cc2700 1 -- 172.21.15.80:0/2835416906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd9c073020 msgr2=0x7fdd9c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda2cc2700 1 --2- 172.21.15.80:0/2835416906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd9c073020 0x7fdd9c071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda2cc2700 1 -- 172.21.15.80:0/2835416906 >> v1:172.21.15.80:6789/0 conn(0x7fdd9c0734b0 legacy=0x7fdd9c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda1cc0700 1 -- 172.21.15.80:0/2835416906 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280269535 0 0) 0x7fdd940009b0 con 0x7fdd9c0734b0 2019-11-28T11:25:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda2cc2700 1 -- 172.21.15.80:0/2835416906 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c070760 con 0x7fdd9c15ed10 2019-11-28T11:25:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda24c1700 1 --2- 172.21.15.80:0/2835416906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd9c073020 0x7fdd9c071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda2cc2700 1 --2- 172.21.15.80:0/2835416906 >> v2:172.21.15.80:3300/0 conn(0x7fdd9c15ed10 0x7fdd9c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd8400fac0 tx=0x7fdd8400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda2cc2700 1 --2- 172.21.15.80:0/2835416906 >> v2:172.21.15.80:3300/0 conn(0x7fdd9c15ed10 0x7fdd9c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd8400fac0 tx=0x7fdd8400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda2cc2700 1 --2- 172.21.15.80:0/2835416906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd9c15ed10 0x7fdd9c15f100 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7fdd8400fac0 tx=0x7fdd8400fe60).ready entity=mon.0 client_cookie=93a47f015a8cddec server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda2cc2700 1 --2- 172.21.15.80:0/2835416906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd9c15ed10 0x7fdd9c15f100 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7fdd8400fac0 tx=0x7fdd8400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda1cc0700 1 -- 172.21.15.80:0/2835416906 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd84000ce0 con 0x7fdd9c15ed10 2019-11-28T11:25:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda2cc2700 1 --2- 172.21.15.80:0/2835416906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd9c15ed10 0x7fdd9c15f100 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7fdd8400fac0 tx=0x7fdd8400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda2cc2700 1 --2- 172.21.15.80:0/2835416906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd9c15ed10 0x7fdd9c15f100 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7fdd8400fac0 tx=0x7fdd8400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda1cc0700 1 -- 172.21.15.80:0/2835416906 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd84001010 con 0x7fdd9c15ed10 2019-11-28T11:25:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda1cc0700 1 -- 172.21.15.80:0/2835416906 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd84001720 con 0x7fdd9c15ed10 2019-11-28T11:25:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda4725700 1 -- 172.21.15.80:0/2835416906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd9c15ed10 msgr2=0x7fdd9c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.796+0000 7fdda4725700 1 --2- 172.21.15.80:0/2835416906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd9c15ed10 0x7fdd9c15f100 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7fdd8400fac0 tx=0x7fdd8400fe60).stop 2019-11-28T11:25:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.797+0000 7fdda4725700 1 -- 172.21.15.80:0/2835416906 shutdown_connections 2019-11-28T11:25:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.797+0000 7fdda4725700 1 --2- 172.21.15.80:0/2835416906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd9c073020 0x7fdd9c071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.797+0000 7fdda4725700 1 --2- 172.21.15.80:0/2835416906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd9c15ed10 0x7fdd9c15f100 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.797+0000 7fdda4725700 1 -- 172.21.15.80:0/2835416906 shutdown_connections 2019-11-28T11:25:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.797+0000 7fdda4725700 1 -- 172.21.15.80:0/2835416906 wait complete. 2019-11-28T11:25:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.797+0000 7fdda4725700 1 -- 172.21.15.80:0/2835416906 >> 172.21.15.80:0/2835416906 conn(0x7fdd9c061d20 msgr2=0x7fdd9c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.799+0000 7fdda4725700 1 Processor -- start 2019-11-28T11:25:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.799+0000 7fdda4725700 1 -- start start 2019-11-28T11:25:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.800+0000 7fdda4725700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd9c10cbb0 0x7fdd9c10d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.800+0000 7fdda4725700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdd9c10d580 0x7fdd9c16ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.800+0000 7fdda4725700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9c1057a0 con 0x7fdd9c153db0 2019-11-28T11:25:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.800+0000 7fdda4725700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9c106280 con 0x7fdd9c10d580 2019-11-28T11:25:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.800+0000 7fdda4725700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c106550 con 0x7fdd9c10cbb0 2019-11-28T11:25:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.800+0000 7fdda2cc2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdd9c153db0 0x7fdd9c10dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59682/0 (socket says 172.21.15.80:59682) 2019-11-28T11:25:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.800+0000 7fdda2cc2700 1 -- 172.21.15.80:0/508738313 learned_addr learned my addr 172.21.15.80:0/508738313 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.800+0000 7fdda34c3700 1 --2- 172.21.15.80:0/508738313 >> v2:172.21.15.174:3300/0 conn(0x7fdd9c10d580 0x7fdd9c16ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.800+0000 7fdda24c1700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd9c10cbb0 0x7fdd9c10d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.800+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763524679 0 0) 0x7fdd84008120 con 0x7fdd9c153db0 2019-11-28T11:25:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd80002e80 con 0x7fdd9c153db0 2019-11-28T11:25:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1806795895 0 0) 0x7fdd84008120 con 0x7fdd9c153db0 2019-11-28T11:25:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdd800032e0 con 0x7fdd9c153db0 2019-11-28T11:25:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fdd84000cc0 con 0x7fdd9c153db0 2019-11-28T11:25:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd9c10cbb0 msgr2=0x7fdd9c10d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd9c10cbb0 0x7fdd9c10d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 >> v2:172.21.15.174:3300/0 conn(0x7fdd9c10d580 msgr2=0x7fdd9c16ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 --2- 172.21.15.80:0/508738313 >> v2:172.21.15.174:3300/0 conn(0x7fdd9c10d580 0x7fdd9c16ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 >> v1:172.21.15.80:6789/0 conn(0x7fdd9c153db0 legacy=0x7fdd9c10dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd800033f0 0x7fdd80003840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd80003d80 0x7fdd80004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd800048d0 0x7fdd80004d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8000bb60 con 0x7fdd80003d80 2019-11-28T11:25:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8000bd50 con 0x7fdd800033f0 2019-11-28T11:25:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8000bf80 con 0x7fdd800048d0 2019-11-28T11:25:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdda24c1700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd80003d80 0x7fdd80004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdda2cc2700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd800033f0 0x7fdd80003840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdda34c3700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd800048d0 0x7fdd80004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdda24c1700 1 -- 172.21.15.80:0/508738313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd800048d0 msgr2=0x7fdd80004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdda24c1700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd800048d0 0x7fdd80004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdda24c1700 1 -- 172.21.15.80:0/508738313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd800033f0 msgr2=0x7fdd80003840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdda24c1700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd800033f0 0x7fdd80003840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:55.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdda24c1700 1 -- 172.21.15.80:0/508738313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8000c230 con 0x7fdd80003d80 2019-11-28T11:25:55.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdda4725700 1 -- 172.21.15.80:0/508738313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9c106f60 con 0x7fdd80003d80 2019-11-28T11:25:55.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdda24c1700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd80003d80 0x7fdd80004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd8c010390 tx=0x7fdd8c010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdda24c1700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd80003d80 0x7fdd80004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd8c010390 tx=0x7fdd8c010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdda4725700 1 -- 172.21.15.80:0/508738313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9c106be0 con 0x7fdd80003d80 2019-11-28T11:25:55.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdda24c1700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd80003d80 0x7fdd80004200 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7fdd8c010390 tx=0x7fdd8c010210).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:55.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdda24c1700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd80003d80 0x7fdd80004200 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7fdd8c010390 tx=0x7fdd8c010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd8c0095e0 con 0x7fdd80003d80 2019-11-28T11:25:55.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdda24c1700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd80003d80 0x7fdd80004200 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7fdd8c010390 tx=0x7fdd8c010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdda24c1700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd80003d80 0x7fdd80004200 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7fdd8c010390 tx=0x7fdd8c010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c000db0 con 0x7fdd80003d80 2019-11-28T11:25:55.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.801+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd8c001480 con 0x7fdd80003d80 2019-11-28T11:25:55.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.802+0000 7fdda24c1700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd80003d80 0x7fdd80004200 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7fdd8c010390 tx=0x7fdd8c010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.802+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fdd8c0095e0 con 0x7fdd80003d80 2019-11-28T11:25:55.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.802+0000 7fdda24c1700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd80003d80 0x7fdd80004200 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7fdd8c010390 tx=0x7fdd8c010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.802+0000 7fdd9b7fe700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdd80020b40 0x7fdd80022f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:55.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.802+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6117+0+0 (secure 0 0 0) 0x7fdd8c031bb0 con 0x7fdd80003d80 2019-11-28T11:25:55.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.802+0000 7fdda2cc2700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdd80020b40 0x7fdd80022f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:55.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.803+0000 7fdda2cc2700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdd80020b40 0x7fdd80022f70 crc :-1 s=READY pgs=133 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:55.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.810+0000 7fdda4725700 1 -- 172.21.15.80:0/508738313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9c106f60 con 0x7fdd80003d80 2019-11-28T11:25:55.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.813+0000 7fdda24c1700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd80003d80 0x7fdd80004200 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7fdd8c010390 tx=0x7fdd8c010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:55.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.813+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fdd8c0009b0 con 0x7fdd80003d80 2019-11-28T11:25:56.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:55.981+0000 7fdda4725700 1 -- 172.21.15.80:0/508738313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdd9c106be0 con 0x7fdd80003d80 2019-11-28T11:25:56.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.628+0000 7fdda24c1700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd80003d80 0x7fdd80004200 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7fdd8c010390 tx=0x7fdd8c010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:56.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.628+0000 7fdd9b7fe700 1 -- 172.21.15.80:0/508738313 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 185+0+0 (secure 0 0 0) 0x7fdd8c017380 con 0x7fdd80003d80 2019-11-28T11:25:56.666 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:25:56.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.648+0000 7fdda4725700 1 -- 172.21.15.80:0/508738313 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdd80020b40 msgr2=0x7fdd80022f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:56.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.648+0000 7fdda4725700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdd80020b40 0x7fdd80022f70 crc :-1 s=READY pgs=133 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:56.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.648+0000 7fdda4725700 1 -- 172.21.15.80:0/508738313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd80003d80 msgr2=0x7fdd80004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:56.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.648+0000 7fdda4725700 1 --2- 172.21.15.80:0/508738313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd80003d80 0x7fdd80004200 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7fdd8c010390 tx=0x7fdd8c010210).stop 2019-11-28T11:25:56.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.648+0000 7fdda34c3700 1 -- 172.21.15.80:0/508738313 reap_dead start 2019-11-28T11:25:56.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.648+0000 7fdda4725700 1 -- 172.21.15.80:0/508738313 shutdown_connections 2019-11-28T11:25:56.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.648+0000 7fdda4725700 1 -- 172.21.15.80:0/508738313 shutdown_connections 2019-11-28T11:25:56.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.648+0000 7fdda4725700 1 -- 172.21.15.80:0/508738313 wait complete. 2019-11-28T11:25:56.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.648+0000 7fdda4725700 1 -- 172.21.15.80:0/508738313 >> 172.21.15.80:0/508738313 conn(0x7fdd9c15e2d0 msgr2=0x7fdd9c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:56.679 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:25:56.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211c8b9700 1 Processor -- start 2019-11-28T11:25:56.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211c8b9700 1 -- start start 2019-11-28T11:25:56.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211c8b9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f211815f100 0x7f211806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:56.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211c8b9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f211806c2f0 0x7f211806c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:56.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211c8b9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211806db60 con 0x7f211815ed10 2019-11-28T11:25:56.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211c8b9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211806fe00 con 0x7f211806c2f0 2019-11-28T11:25:56.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211c8b9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21180700d0 con 0x7f211815f100 2019-11-28T11:25:56.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f211806c2f0 0x7f211806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:56.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f211806c2f0 0x7f211806c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60382/0 (socket says 172.21.15.80:60382) 2019-11-28T11:25:56.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211759e700 1 -- 172.21.15.80:0/2311920448 learned_addr learned my addr 172.21.15.80:0/2311920448 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:56.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211659c700 1 --2- 172.21.15.80:0/2311920448 >> v2:172.21.15.174:3300/0 conn(0x7f211815f100 0x7f211806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:56.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211759e700 1 -- 172.21.15.80:0/2311920448 >> v2:172.21.15.174:3300/0 conn(0x7f211815f100 msgr2=0x7f211806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:56.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211759e700 1 --2- 172.21.15.80:0/2311920448 >> v2:172.21.15.174:3300/0 conn(0x7f211815f100 0x7f211806bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:56.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211759e700 1 -- 172.21.15.80:0/2311920448 >> v1:172.21.15.174:6789/0 conn(0x7f211815ed10 legacy=0x7f2118073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:56.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211759e700 1 -- 172.21.15.80:0/2311920448 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2118070760 con 0x7f211806c2f0 2019-11-28T11:25:56.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211659c700 1 --2- 172.21.15.80:0/2311920448 >> v2:172.21.15.174:3300/0 conn(0x7f211815f100 0x7f211806bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:25:56.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211759e700 1 --2- 172.21.15.80:0/2311920448 >> v2:172.21.15.80:3300/0 conn(0x7f211806c2f0 0x7f211806c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f210800f730 tx=0x7f210800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:56.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211759e700 1 --2- 172.21.15.80:0/2311920448 >> v2:172.21.15.80:3300/0 conn(0x7f211806c2f0 0x7f211806c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f210800f730 tx=0x7f210800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:56.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.783+0000 7f211759e700 1 --2- 172.21.15.80:0/2311920448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211806c2f0 0x7f211806c770 secure :-1 s=READY pgs=300 cs=0 l=1 rx=0x7f210800f730 tx=0x7f210800fad0).ready entity=mon.0 client_cookie=b76956bf6bd9db2e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:56.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.784+0000 7f211759e700 1 --2- 172.21.15.80:0/2311920448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211806c2f0 0x7f211806c770 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f210800f730 tx=0x7f210800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:56.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.784+0000 7f211759e700 1 --2- 172.21.15.80:0/2311920448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211806c2f0 0x7f211806c770 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f210800f730 tx=0x7f210800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:56.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.784+0000 7f2115d9b700 1 -- 172.21.15.80:0/2311920448 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2108000b90 con 0x7f211806c2f0 2019-11-28T11:25:56.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.784+0000 7f211759e700 1 --2- 172.21.15.80:0/2311920448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211806c2f0 0x7f211806c770 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f210800f730 tx=0x7f210800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:56.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.784+0000 7f2115d9b700 1 -- 172.21.15.80:0/2311920448 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21080010e0 con 0x7f211806c2f0 2019-11-28T11:25:56.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.784+0000 7f2115d9b700 1 -- 172.21.15.80:0/2311920448 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2108001830 con 0x7f211806c2f0 2019-11-28T11:25:56.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.784+0000 7f211c8b9700 1 -- 172.21.15.80:0/2311920448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211806c2f0 msgr2=0x7f211806c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:56.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.784+0000 7f211c8b9700 1 --2- 172.21.15.80:0/2311920448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211806c2f0 0x7f211806c770 secure :-1 s=READY pgs=300 cs=0 l=1 rx=0x7f210800f730 tx=0x7f210800fad0).stop 2019-11-28T11:25:56.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.784+0000 7f211c8b9700 1 -- 172.21.15.80:0/2311920448 shutdown_connections 2019-11-28T11:25:56.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.784+0000 7f211c8b9700 1 --2- 172.21.15.80:0/2311920448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211806c2f0 0x7f211806c770 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:56.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.784+0000 7f211c8b9700 1 --2- 172.21.15.80:0/2311920448 >> v2:172.21.15.174:3300/0 conn(0x7f211815f100 0x7f211806bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:56.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.784+0000 7f211c8b9700 1 -- 172.21.15.80:0/2311920448 shutdown_connections 2019-11-28T11:25:56.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.784+0000 7f211c8b9700 1 -- 172.21.15.80:0/2311920448 wait complete. 2019-11-28T11:25:56.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.784+0000 7f211c8b9700 1 -- 172.21.15.80:0/2311920448 >> 172.21.15.80:0/2311920448 conn(0x7f2118061d20 msgr2=0x7f21180641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:56.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.787+0000 7f211c8b9700 1 Processor -- start 2019-11-28T11:25:56.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.787+0000 7f211c8b9700 1 -- start start 2019-11-28T11:25:56.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f211c8b9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2118148320 0x7f211810ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:56.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f211c8b9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2118148e00 con 0x7f211810f290 2019-11-28T11:25:56.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f211c8b9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2118108b10 con 0x7f211810e3d0 2019-11-28T11:25:56.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f211c8b9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211813aa20 con 0x7f2118148320 2019-11-28T11:25:56.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f2116d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2118148320 0x7f211810ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:56.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f211659c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f211810f290 0x7f211810dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59704/0 (socket says 172.21.15.80:59704) 2019-11-28T11:25:56.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f211659c700 1 -- 172.21.15.80:0/1527050512 learned_addr learned my addr 172.21.15.80:0/1527050512 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:56.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f2116d9d700 1 -- 172.21.15.80:0/1527050512 >> v1:172.21.15.174:6789/0 conn(0x7f211810e3d0 legacy=0x7f2118168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:56.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f2116d9d700 1 -- 172.21.15.80:0/1527050512 >> v1:172.21.15.80:6789/0 conn(0x7f211810f290 legacy=0x7f211810dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:56.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f2116d9d700 1 -- 172.21.15.80:0/1527050512 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211810c490 con 0x7f2118148320 2019-11-28T11:25:56.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f210f7fe700 1 -- 172.21.15.80:0/1527050512 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533606101 0 0) 0x7f2110000ea0 con 0x7f211810f290 2019-11-28T11:25:56.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f2116d9d700 1 --2- 172.21.15.80:0/1527050512 >> v2:172.21.15.80:3300/0 conn(0x7f2118148320 0x7f211810ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2100010720 tx=0x7f2100010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:56.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f2116d9d700 1 --2- 172.21.15.80:0/1527050512 >> v2:172.21.15.80:3300/0 conn(0x7f2118148320 0x7f211810ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2100010720 tx=0x7f2100010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:56.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f2116d9d700 1 --2- 172.21.15.80:0/1527050512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2118148320 0x7f211810ed50 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7f2100010720 tx=0x7f2100010ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:56.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f2116d9d700 1 --2- 172.21.15.80:0/1527050512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2118148320 0x7f211810ed50 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f2100010720 tx=0x7f2100010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:56.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f2116d9d700 1 --2- 172.21.15.80:0/1527050512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2118148320 0x7f211810ed50 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f2100010720 tx=0x7f2100010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:56.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f210f7fe700 1 -- 172.21.15.80:0/1527050512 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2100009b10 con 0x7f2118148320 2019-11-28T11:25:56.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f2116d9d700 1 --2- 172.21.15.80:0/1527050512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2118148320 0x7f211810ed50 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f2100010720 tx=0x7f2100010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:56.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f210f7fe700 1 -- 172.21.15.80:0/1527050512 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210000aa30 con 0x7f2118148320 2019-11-28T11:25:56.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f210f7fe700 1 -- 172.21.15.80:0/1527050512 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f210000a190 con 0x7f2118148320 2019-11-28T11:25:56.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f211c8b9700 1 -- 172.21.15.80:0/1527050512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211810c810 con 0x7f2118148320 2019-11-28T11:25:56.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.788+0000 7f211c8b9700 1 -- 172.21.15.80:0/1527050512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211810c490 con 0x7f2118148320 2019-11-28T11:25:56.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.789+0000 7f2116d9d700 1 --2- 172.21.15.80:0/1527050512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2118148320 0x7f211810ed50 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f2100010720 tx=0x7f2100010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:56.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.789+0000 7f210f7fe700 1 -- 172.21.15.80:0/1527050512 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2100009b10 con 0x7f2118148320 2019-11-28T11:25:56.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.789+0000 7f2116d9d700 1 --2- 172.21.15.80:0/1527050512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2118148320 0x7f211810ed50 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f2100010720 tx=0x7f2100010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:56.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.789+0000 7f210f7fe700 1 --2- 172.21.15.80:0/1527050512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f20f0018730 0x7f20f001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:56.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.789+0000 7f210f7fe700 1 -- 172.21.15.80:0/1527050512 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5679+0+0 (secure 0 0 0) 0x7f2100031e10 con 0x7f2118148320 2019-11-28T11:25:56.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.789+0000 7f211659c700 1 --2- 172.21.15.80:0/1527050512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f20f0018730 0x7f20f001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:56.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.790+0000 7f211659c700 1 --2- 172.21.15.80:0/1527050512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f20f0018730 0x7f20f001abc0 crc :-1 s=READY pgs=134 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:56.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.797+0000 7f211c8b9700 1 -- 172.21.15.80:0/1527050512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211810c810 con 0x7f2118148320 2019-11-28T11:25:56.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.800+0000 7f2116d9d700 1 --2- 172.21.15.80:0/1527050512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2118148320 0x7f211810ed50 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f2100010720 tx=0x7f2100010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:56.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.800+0000 7f210f7fe700 1 -- 172.21.15.80:0/1527050512 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2100009900 con 0x7f2118148320 2019-11-28T11:25:56.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:56.969+0000 7f211c8b9700 1 -- 172.21.15.80:0/1527050512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f211810c490 con 0x7f2118148320 2019-11-28T11:25:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.634+0000 7f2116d9d700 1 --2- 172.21.15.80:0/1527050512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2118148320 0x7f211810ed50 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f2100010720 tx=0x7f2100010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.635+0000 7f210f7fe700 1 -- 172.21.15.80:0/1527050512 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2100017790 con 0x7f2118148320 2019-11-28T11:25:57.703 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:25:57.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.685+0000 7f211c8b9700 1 -- 172.21.15.80:0/1527050512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f20f0018730 msgr2=0x7f20f001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:57.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.685+0000 7f211c8b9700 1 --2- 172.21.15.80:0/1527050512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f20f0018730 0x7f20f001abc0 crc :-1 s=READY pgs=134 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:57.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.686+0000 7f211c8b9700 1 -- 172.21.15.80:0/1527050512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2118148320 msgr2=0x7f211810ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:57.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.686+0000 7f211c8b9700 1 --2- 172.21.15.80:0/1527050512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2118148320 0x7f211810ed50 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7f2100010720 tx=0x7f2100010ac0).stop 2019-11-28T11:25:57.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.686+0000 7f211c8b9700 1 -- 172.21.15.80:0/1527050512 shutdown_connections 2019-11-28T11:25:57.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.686+0000 7f211c8b9700 1 --2- 172.21.15.80:0/1527050512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f20f0018730 0x7f20f001abc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:57.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.686+0000 7f211c8b9700 1 --2- 172.21.15.80:0/1527050512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2118148320 0x7f211810ed50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:57.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.686+0000 7f211c8b9700 1 -- 172.21.15.80:0/1527050512 shutdown_connections 2019-11-28T11:25:57.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.686+0000 7f211c8b9700 1 -- 172.21.15.80:0/1527050512 wait complete. 2019-11-28T11:25:57.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.686+0000 7f211c8b9700 1 -- 172.21.15.80:0/1527050512 >> 172.21.15.80:0/1527050512 conn(0x7f211815e2d0 msgr2=0x7f2118147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:57.715 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:25:57.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.820+0000 7fcc00f9f700 1 Processor -- start 2019-11-28T11:25:57.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.820+0000 7fcc00f9f700 1 -- start start 2019-11-28T11:25:57.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.821+0000 7fcc00f9f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcbfc06c0a0 0x7fcbfc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:57.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.821+0000 7fcc00f9f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbfc06db00 con 0x7fcbfc072620 2019-11-28T11:25:57.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.821+0000 7fcc00f9f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbfc06e000 con 0x7fcbfc0734e0 2019-11-28T11:25:57.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.821+0000 7fcc00f9f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbfc06fd60 con 0x7fcbfc06c0a0 2019-11-28T11:25:57.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.821+0000 7fcbfb59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcbfc072620 0x7fcbfc164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59710/0 (socket says 172.21.15.80:59710) 2019-11-28T11:25:57.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.821+0000 7fcbfb59e700 1 -- 172.21.15.80:0/4006056406 learned_addr learned my addr 172.21.15.80:0/4006056406 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:57.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.821+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/4006056406 >> v2:172.21.15.174:3300/0 conn(0x7fcbfc06c0a0 0x7fcbfc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:57.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.821+0000 7fcbf9d9b700 1 -- 172.21.15.80:0/4006056406 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620854219 0 0) 0x7fcbf4001150 con 0x7fcbfc072620 2019-11-28T11:25:57.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.821+0000 7fcbf9d9b700 1 -- 172.21.15.80:0/4006056406 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbdc002e80 con 0x7fcbfc072620 2019-11-28T11:25:57.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbf9d9b700 1 -- 172.21.15.80:0/4006056406 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1662480464 0 0) 0x7fcbf4001130 con 0x7fcbfc072620 2019-11-28T11:25:57.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbf9d9b700 1 -- 172.21.15.80:0/4006056406 >> v2:172.21.15.174:3300/0 conn(0x7fcbfc06c0a0 msgr2=0x7fcbfc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:57.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbf9d9b700 1 --2- 172.21.15.80:0/4006056406 >> v2:172.21.15.174:3300/0 conn(0x7fcbfc06c0a0 0x7fcbfc072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:57.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbf9d9b700 1 -- 172.21.15.80:0/4006056406 >> v1:172.21.15.174:6789/0 conn(0x7fcbfc0734e0 legacy=0x7fcbfc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:57.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbf9d9b700 1 -- 172.21.15.80:0/4006056406 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc0706c0 con 0x7fcbfc072620 2019-11-28T11:25:57.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbf9d9b700 1 -- 172.21.15.80:0/4006056406 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fcbf4001660 con 0x7fcbfc072620 2019-11-28T11:25:57.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbf9d9b700 1 -- 172.21.15.80:0/4006056406 >> v1:172.21.15.80:6789/0 conn(0x7fcbfc072620 legacy=0x7fcbfc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:57.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbf9d9b700 1 --2- 172.21.15.80:0/4006056406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbdc003ab0 0x7fcbdc005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:57.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbf9d9b700 1 --2- 172.21.15.80:0/4006056406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbdc006690 0x7fcbdc008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:57.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbf9d9b700 1 --2- 172.21.15.80:0/4006056406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbdc009380 0x7fcbdc00b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:57.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbf9d9b700 1 -- 172.21.15.80:0/4006056406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc00c000 con 0x7fcbdc003ab0 2019-11-28T11:25:57.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbf9d9b700 1 -- 172.21.15.80:0/4006056406 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc050200 con 0x7fcbdc009380 2019-11-28T11:25:57.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbf9d9b700 1 -- 172.21.15.80:0/4006056406 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc050430 con 0x7fcbdc006690 2019-11-28T11:25:57.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/4006056406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbdc003ab0 0x7fcbdc005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:57.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbfb59e700 1 --2- 172.21.15.80:0/4006056406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbdc009380 0x7fcbdc00b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:57.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbfa59c700 1 --2- 172.21.15.80:0/4006056406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbdc006690 0x7fcbdc008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:57.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbfad9d700 1 -- 172.21.15.80:0/4006056406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbdc006690 msgr2=0x7fcbdc008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:57.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/4006056406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbdc006690 0x7fcbdc008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:57.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbfad9d700 1 -- 172.21.15.80:0/4006056406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbdc009380 msgr2=0x7fcbdc00b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:57.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/4006056406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbdc009380 0x7fcbdc00b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:57.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbfb59e700 1 -- 172.21.15.80:0/4006056406 reap_dead start 2019-11-28T11:25:57.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbfad9d700 1 -- 172.21.15.80:0/4006056406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc0506e0 con 0x7fcbdc003ab0 2019-11-28T11:25:57.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/4006056406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbdc003ab0 0x7fcbdc005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcbe4007090 tx=0x7fcbe40077f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:57.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/4006056406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbdc003ab0 0x7fcbdc005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcbe4007090 tx=0x7fcbe40077f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:57.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/4006056406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbdc003ab0 0x7fcbdc005f10 secure :-1 s=READY pgs=304 cs=0 l=1 rx=0x7fcbe4007090 tx=0x7fcbe40077f0).ready entity=mon.0 client_cookie=cdc74c8c77cb69ae server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:57.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/4006056406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbdc003ab0 0x7fcbdc005f10 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fcbe4007090 tx=0x7fcbe40077f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:57.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbf9d9b700 1 -- 172.21.15.80:0/4006056406 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbe4006560 con 0x7fcbdc003ab0 2019-11-28T11:25:57.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/4006056406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbdc003ab0 0x7fcbdc005f10 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fcbe4007090 tx=0x7fcbe40077f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:57.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/4006056406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbdc003ab0 0x7fcbdc005f10 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fcbe4007090 tx=0x7fcbe40077f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:57.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbf9d9b700 1 -- 172.21.15.80:0/4006056406 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe40056f0 con 0x7fcbdc003ab0 2019-11-28T11:25:57.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcbf9d9b700 1 -- 172.21.15.80:0/4006056406 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbe4006560 con 0x7fcbdc003ab0 2019-11-28T11:25:57.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcc00f9f700 1 -- 172.21.15.80:0/4006056406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbdc003ab0 msgr2=0x7fcbdc005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:57.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.822+0000 7fcc00f9f700 1 --2- 172.21.15.80:0/4006056406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbdc003ab0 0x7fcbdc005f10 secure :-1 s=READY pgs=304 cs=0 l=1 rx=0x7fcbe4007090 tx=0x7fcbe40077f0).stop 2019-11-28T11:25:57.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.823+0000 7fcc00f9f700 1 -- 172.21.15.80:0/4006056406 shutdown_connections 2019-11-28T11:25:57.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.823+0000 7fcc00f9f700 1 --2- 172.21.15.80:0/4006056406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbdc003ab0 0x7fcbdc005f10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:57.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.823+0000 7fcc00f9f700 1 -- 172.21.15.80:0/4006056406 shutdown_connections 2019-11-28T11:25:57.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.823+0000 7fcc00f9f700 1 -- 172.21.15.80:0/4006056406 wait complete. 2019-11-28T11:25:57.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.823+0000 7fcc00f9f700 1 -- 172.21.15.80:0/4006056406 >> 172.21.15.80:0/4006056406 conn(0x7fcbfc061cf0 msgr2=0x7fcbfc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:57.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.826+0000 7fcc00f9f700 1 Processor -- start 2019-11-28T11:25:57.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.826+0000 7fcc00f9f700 1 -- start start 2019-11-28T11:25:57.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.826+0000 7fcc00f9f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcbfc074d00 0x7fcbfc0750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:57.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.826+0000 7fcc00f9f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbfc153040 0x7fcbfc140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:57.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.826+0000 7fcc00f9f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbfc079230 con 0x7fcbfc152bd0 2019-11-28T11:25:57.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.826+0000 7fcc00f9f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbfc07ab30 con 0x7fcbfc074d00 2019-11-28T11:25:57.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.826+0000 7fcc00f9f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc07ae00 con 0x7fcbfc153040 2019-11-28T11:25:57.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbfad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcbfc074d00 0x7fcbfc0750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:57.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbfa59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcbfc152bd0 0x7fcbfc140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59724/0 (socket says 172.21.15.80:59724) 2019-11-28T11:25:57.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbfa59c700 1 -- 172.21.15.80:0/258322700 learned_addr learned my addr 172.21.15.80:0/258322700 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:57.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbfb59e700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbfc153040 0x7fcbfc140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:57.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbfad9d700 1 -- 172.21.15.80:0/258322700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbfc153040 msgr2=0x7fcbfc140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:57.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbfc153040 0x7fcbfc140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:57.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbfad9d700 1 -- 172.21.15.80:0/258322700 >> v1:172.21.15.80:6789/0 conn(0x7fcbfc152bd0 legacy=0x7fcbfc140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:57.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbfad9d700 1 -- 172.21.15.80:0/258322700 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc07b490 con 0x7fcbfc074d00 2019-11-28T11:25:57.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbf37fe700 1 -- 172.21.15.80:0/258322700 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897809786 0 0) 0x7fcbec005730 con 0x7fcbfc152bd0 2019-11-28T11:25:57.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbfb59e700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbfc153040 0x7fcbfc140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:57.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/258322700 >> v2:172.21.15.80:3300/0 conn(0x7fcbfc074d00 0x7fcbfc0750f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcbe40106e0 tx=0x7fcbe4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:57.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/258322700 >> v2:172.21.15.80:3300/0 conn(0x7fcbfc074d00 0x7fcbfc0750f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcbe40106e0 tx=0x7fcbe4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:57.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc074d00 0x7fcbfc0750f0 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7fcbe40106e0 tx=0x7fcbe4010a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:57.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc074d00 0x7fcbfc0750f0 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7fcbe40106e0 tx=0x7fcbe4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:57.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc074d00 0x7fcbfc0750f0 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7fcbe40106e0 tx=0x7fcbe4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:57.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbf37fe700 1 -- 172.21.15.80:0/258322700 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbe4000cc0 con 0x7fcbfc074d00 2019-11-28T11:25:57.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc074d00 0x7fcbfc0750f0 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7fcbe40106e0 tx=0x7fcbe4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:57.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbf37fe700 1 -- 172.21.15.80:0/258322700 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe40056f0 con 0x7fcbfc074d00 2019-11-28T11:25:57.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcc00f9f700 1 -- 172.21.15.80:0/258322700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbfc07b810 con 0x7fcbfc074d00 2019-11-28T11:25:57.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbf37fe700 1 -- 172.21.15.80:0/258322700 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbe4005d80 con 0x7fcbfc074d00 2019-11-28T11:25:57.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcc00f9f700 1 -- 172.21.15.80:0/258322700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbfc07b490 con 0x7fcbfc074d00 2019-11-28T11:25:57.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.827+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc074d00 0x7fcbfc0750f0 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7fcbe40106e0 tx=0x7fcbe4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:57.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.828+0000 7fcbf37fe700 1 -- 172.21.15.80:0/258322700 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcbe40058e0 con 0x7fcbfc074d00 2019-11-28T11:25:57.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.828+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc074d00 0x7fcbfc0750f0 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7fcbe40106e0 tx=0x7fcbe4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:57.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.828+0000 7fcbf37fe700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcbd4018730 0x7fcbd401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:57.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.828+0000 7fcbf37fe700 1 -- 172.21.15.80:0/258322700 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5286+0+0 (secure 0 0 0) 0x7fcbe4031d80 con 0x7fcbfc074d00 2019-11-28T11:25:57.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.828+0000 7fcbfa59c700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcbd4018730 0x7fcbd401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:57.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.828+0000 7fcbfa59c700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcbd4018730 0x7fcbd401abc0 crc :-1 s=READY pgs=135 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:57.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.835+0000 7fcc00f9f700 1 -- 172.21.15.80:0/258322700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbfc07b810 con 0x7fcbfc074d00 2019-11-28T11:25:57.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.838+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc074d00 0x7fcbfc0750f0 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7fcbe40106e0 tx=0x7fcbe4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:57.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:57.839+0000 7fcbf37fe700 1 -- 172.21.15.80:0/258322700 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcbe4029eb0 con 0x7fcbfc074d00 2019-11-28T11:25:58.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.024+0000 7fcc00f9f700 1 -- 172.21.15.80:0/258322700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fcbfc07b490 con 0x7fcbfc074d00 2019-11-28T11:25:58.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.640+0000 7fcbfad9d700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc074d00 0x7fcbfc0750f0 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7fcbe40106e0 tx=0x7fcbe4010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:58.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.640+0000 7fcbf37fe700 1 -- 172.21.15.80:0/258322700 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcbe4029eb0 con 0x7fcbfc074d00 2019-11-28T11:25:58.708 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:25:58.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.691+0000 7fcc00f9f700 1 -- 172.21.15.80:0/258322700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcbd4018730 msgr2=0x7fcbd401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:58.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.691+0000 7fcc00f9f700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcbd4018730 0x7fcbd401abc0 crc :-1 s=READY pgs=135 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:58.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.691+0000 7fcc00f9f700 1 -- 172.21.15.80:0/258322700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc074d00 msgr2=0x7fcbfc0750f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:58.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.691+0000 7fcc00f9f700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc074d00 0x7fcbfc0750f0 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7fcbe40106e0 tx=0x7fcbe4010a80).stop 2019-11-28T11:25:58.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.691+0000 7fcc00f9f700 1 -- 172.21.15.80:0/258322700 shutdown_connections 2019-11-28T11:25:58.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.691+0000 7fcc00f9f700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcbd4018730 0x7fcbd401abc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:58.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.691+0000 7fcc00f9f700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbfc153040 0x7fcbfc140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:58.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.691+0000 7fcc00f9f700 1 --2- 172.21.15.80:0/258322700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc074d00 0x7fcbfc0750f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:58.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.691+0000 7fcc00f9f700 1 -- 172.21.15.80:0/258322700 shutdown_connections 2019-11-28T11:25:58.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.691+0000 7fcc00f9f700 1 -- 172.21.15.80:0/258322700 wait complete. 2019-11-28T11:25:58.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.691+0000 7fcc00f9f700 1 -- 172.21.15.80:0/258322700 >> 172.21.15.80:0/258322700 conn(0x7fcbfc13fa50 msgr2=0x7fcbfc07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:58.721 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:25:58.721 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:25:58.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.828+0000 7f272cb12700 1 Processor -- start 2019-11-28T11:25:58.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.828+0000 7f272cb12700 1 -- start start 2019-11-28T11:25:58.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.829+0000 7f272cb12700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f272806c490 0x7f272806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:58.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.829+0000 7f272cb12700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272806db00 con 0x7f272806ce60 2019-11-28T11:25:58.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.829+0000 7f272cb12700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272806e000 con 0x7f272806c0a0 2019-11-28T11:25:58.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.829+0000 7f272cb12700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272806fd60 con 0x7f272806c490 2019-11-28T11:25:58.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.829+0000 7f272759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f272806ce60 0x7f2728164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59732/0 (socket says 172.21.15.80:59732) 2019-11-28T11:25:58.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.829+0000 7f272759e700 1 -- 172.21.15.80:0/3897211380 learned_addr learned my addr 172.21.15.80:0/3897211380 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:58.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.829+0000 7f272659c700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f272806c490 0x7f272806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:58.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.829+0000 7f2725d9b700 1 -- 172.21.15.80:0/3897211380 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279161878 0 0) 0x7f2720001150 con 0x7f272806ce60 2019-11-28T11:25:58.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.829+0000 7f2725d9b700 1 -- 172.21.15.80:0/3897211380 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2708002e80 con 0x7f272806ce60 2019-11-28T11:25:58.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.829+0000 7f2725d9b700 1 -- 172.21.15.80:0/3897211380 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3679401326 0 0) 0x7f2720001130 con 0x7f272806ce60 2019-11-28T11:25:58.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f2725d9b700 1 -- 172.21.15.80:0/3897211380 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f272806c490 msgr2=0x7f272806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:58.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f2725d9b700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f272806c490 0x7f272806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:58.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f2725d9b700 1 -- 172.21.15.80:0/3897211380 >> v1:172.21.15.174:6789/0 conn(0x7f272806c0a0 legacy=0x7f2728072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:58.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f2725d9b700 1 -- 172.21.15.80:0/3897211380 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27280706c0 con 0x7f272806ce60 2019-11-28T11:25:58.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f2725d9b700 1 -- 172.21.15.80:0/3897211380 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f2720001660 con 0x7f272806ce60 2019-11-28T11:25:58.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f2725d9b700 1 -- 172.21.15.80:0/3897211380 >> v1:172.21.15.80:6789/0 conn(0x7f272806ce60 legacy=0x7f2728164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:58.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f2725d9b700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2708003ab0 0x7f2708005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:58.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f2725d9b700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2708006640 0x7f2708008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:58.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f2725d9b700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2708009310 0x7f270800b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:58.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f2725d9b700 1 -- 172.21.15.80:0/3897211380 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270800bff0 con 0x7f2708009310 2019-11-28T11:25:58.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f2725d9b700 1 -- 172.21.15.80:0/3897211380 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27080501f0 con 0x7f2708006640 2019-11-28T11:25:58.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f2725d9b700 1 -- 172.21.15.80:0/3897211380 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2708050420 con 0x7f2708003ab0 2019-11-28T11:25:58.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f272759e700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2708009310 0x7f270800b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:58.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f2726d9d700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2708003ab0 0x7f2708005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:58.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f272659c700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2708006640 0x7f2708008b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:58.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f272759e700 1 -- 172.21.15.80:0/3897211380 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2708003ab0 msgr2=0x7f2708005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:58.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f272759e700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2708003ab0 0x7f2708005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f272759e700 1 -- 172.21.15.80:0/3897211380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2708006640 msgr2=0x7f2708008b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f272759e700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2708006640 0x7f2708008b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f272759e700 1 -- 172.21.15.80:0/3897211380 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27080506d0 con 0x7f2708009310 2019-11-28T11:25:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f272759e700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2708009310 0x7f270800b7e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f272000f890 tx=0x7f2720001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:58.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f272759e700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2708009310 0x7f270800b7e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f272000f890 tx=0x7f2720001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:58.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f272759e700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2708009310 0x7f270800b7e0 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f272000f890 tx=0x7f2720001dd0).ready entity=mon.0 client_cookie=811c41e947e79854 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:58.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f272759e700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2708009310 0x7f270800b7e0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f272000f890 tx=0x7f2720001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:58.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f2725d9b700 1 -- 172.21.15.80:0/3897211380 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2720001130 con 0x7f2708009310 2019-11-28T11:25:58.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f272759e700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2708009310 0x7f270800b7e0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f272000f890 tx=0x7f2720001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:58.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f272759e700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2708009310 0x7f270800b7e0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f272000f890 tx=0x7f2720001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f2725d9b700 1 -- 172.21.15.80:0/3897211380 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2720004240 con 0x7f2708009310 2019-11-28T11:25:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f2725d9b700 1 -- 172.21.15.80:0/3897211380 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2720001130 con 0x7f2708009310 2019-11-28T11:25:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f272cb12700 1 -- 172.21.15.80:0/3897211380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2708009310 msgr2=0x7f270800b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f272cb12700 1 --2- 172.21.15.80:0/3897211380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2708009310 0x7f270800b7e0 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f272000f890 tx=0x7f2720001dd0).stop 2019-11-28T11:25:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.830+0000 7f272759e700 1 -- 172.21.15.80:0/3897211380 reap_dead start 2019-11-28T11:25:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.831+0000 7f272cb12700 1 -- 172.21.15.80:0/3897211380 shutdown_connections 2019-11-28T11:25:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.831+0000 7f272cb12700 1 -- 172.21.15.80:0/3897211380 shutdown_connections 2019-11-28T11:25:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.831+0000 7f272cb12700 1 -- 172.21.15.80:0/3897211380 wait complete. 2019-11-28T11:25:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.831+0000 7f272cb12700 1 -- 172.21.15.80:0/3897211380 >> 172.21.15.80:0/3897211380 conn(0x7f2728061cf0 msgr2=0x7f2728064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.834+0000 7f272cb12700 1 Processor -- start 2019-11-28T11:25:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.834+0000 7f272cb12700 1 -- start start 2019-11-28T11:25:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.834+0000 7f272cb12700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2728074d00 0x7f27280750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.834+0000 7f272cb12700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2728153040 0x7f2728140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f272cb12700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2728079230 con 0x7f2728152bd0 2019-11-28T11:25:58.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f272cb12700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272807ab30 con 0x7f2728074d00 2019-11-28T11:25:58.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f272cb12700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272807ae00 con 0x7f2728153040 2019-11-28T11:25:58.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f2726d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2728074d00 0x7f27280750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:58.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f2726d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2728074d00 0x7f27280750f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60426/0 (socket says 172.21.15.80:60426) 2019-11-28T11:25:58.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f2726d9d700 1 -- 172.21.15.80:0/2914918974 learned_addr learned my addr 172.21.15.80:0/2914918974 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:58.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f272759e700 1 --2- 172.21.15.80:0/2914918974 >> v2:172.21.15.174:3300/0 conn(0x7f2728153040 0x7f2728140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:58.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f2726d9d700 1 -- 172.21.15.80:0/2914918974 >> v2:172.21.15.174:3300/0 conn(0x7f2728153040 msgr2=0x7f2728140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:58.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f2726d9d700 1 --2- 172.21.15.80:0/2914918974 >> v2:172.21.15.174:3300/0 conn(0x7f2728153040 0x7f2728140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:58.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f2726d9d700 1 -- 172.21.15.80:0/2914918974 >> v1:172.21.15.80:6789/0 conn(0x7f2728152bd0 legacy=0x7f2728140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:58.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f2726d9d700 1 -- 172.21.15.80:0/2914918974 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272807b490 con 0x7f2728074d00 2019-11-28T11:25:58.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f272759e700 1 --2- 172.21.15.80:0/2914918974 >> v2:172.21.15.174:3300/0 conn(0x7f2728153040 0x7f2728140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:25:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f271f7fe700 1 -- 172.21.15.80:0/2914918974 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190151706 0 0) 0x7f27180010b0 con 0x7f2728152bd0 2019-11-28T11:25:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f2726d9d700 1 --2- 172.21.15.80:0/2914918974 >> v2:172.21.15.80:3300/0 conn(0x7f2728074d00 0x7f27280750f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27100107e0 tx=0x7f2710010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f2726d9d700 1 --2- 172.21.15.80:0/2914918974 >> v2:172.21.15.80:3300/0 conn(0x7f2728074d00 0x7f27280750f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27100107e0 tx=0x7f2710010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f2726d9d700 1 --2- 172.21.15.80:0/2914918974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2728074d00 0x7f27280750f0 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7f27100107e0 tx=0x7f2710010b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f2726d9d700 1 --2- 172.21.15.80:0/2914918974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2728074d00 0x7f27280750f0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f27100107e0 tx=0x7f2710010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f271f7fe700 1 -- 172.21.15.80:0/2914918974 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f271000f020 con 0x7f2728074d00 2019-11-28T11:25:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f2726d9d700 1 --2- 172.21.15.80:0/2914918974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2728074d00 0x7f27280750f0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f27100107e0 tx=0x7f2710010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f2726d9d700 1 --2- 172.21.15.80:0/2914918974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2728074d00 0x7f27280750f0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f27100107e0 tx=0x7f2710010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f271f7fe700 1 -- 172.21.15.80:0/2914918974 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271000dd40 con 0x7f2728074d00 2019-11-28T11:25:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f271f7fe700 1 -- 172.21.15.80:0/2914918974 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f271000f6a0 con 0x7f2728074d00 2019-11-28T11:25:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f272cb12700 1 -- 172.21.15.80:0/2914918974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272807b810 con 0x7f2728074d00 2019-11-28T11:25:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.835+0000 7f272cb12700 1 -- 172.21.15.80:0/2914918974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272807b490 con 0x7f2728074d00 2019-11-28T11:25:58.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.836+0000 7f2726d9d700 1 --2- 172.21.15.80:0/2914918974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2728074d00 0x7f27280750f0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f27100107e0 tx=0x7f2710010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:58.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.836+0000 7f271f7fe700 1 -- 172.21.15.80:0/2914918974 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f271000f020 con 0x7f2728074d00 2019-11-28T11:25:58.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.836+0000 7f2726d9d700 1 --2- 172.21.15.80:0/2914918974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2728074d00 0x7f27280750f0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f27100107e0 tx=0x7f2710010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:58.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.836+0000 7f271f7fe700 1 --2- 172.21.15.80:0/2914918974 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2700018730 0x7f270001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:58.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.836+0000 7f271f7fe700 1 -- 172.21.15.80:0/2914918974 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f2710031e40 con 0x7f2728074d00 2019-11-28T11:25:58.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.836+0000 7f272659c700 1 --2- 172.21.15.80:0/2914918974 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2700018730 0x7f270001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:58.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.836+0000 7f272659c700 1 --2- 172.21.15.80:0/2914918974 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2700018730 0x7f270001abc0 crc :-1 s=READY pgs=136 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:58.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.843+0000 7f272cb12700 1 -- 172.21.15.80:0/2914918974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272807b810 con 0x7f2728074d00 2019-11-28T11:25:58.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.847+0000 7f2726d9d700 1 --2- 172.21.15.80:0/2914918974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2728074d00 0x7f27280750f0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f27100107e0 tx=0x7f2710010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:58.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:58.847+0000 7f271f7fe700 1 -- 172.21.15.80:0/2914918974 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f271002df80 con 0x7f2728074d00 2019-11-28T11:25:59.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.016+0000 7f272cb12700 1 -- 172.21.15.80:0/2914918974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f272807b490 con 0x7f2728074d00 2019-11-28T11:25:59.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.016+0000 7f2726d9d700 1 --2- 172.21.15.80:0/2914918974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2728074d00 0x7f27280750f0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f27100107e0 tx=0x7f2710010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.016+0000 7f271f7fe700 1 -- 172.21.15.80:0/2914918974 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v5) v1 ==== 80+0+6201 (secure 0 0 0) 0x7f271002dbc0 con 0x7f2728074d00 2019-11-28T11:25:59.041 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:25:59.041 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:25:59.041 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:25:59.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.041 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:25:59.042 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:25:59.042 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.042 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:25:59.042 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:25:59.042 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:25:59.042 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:25:59.042 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.043 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:25:59.043 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:25:59.043 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.043 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:25:59.043 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:25:59.044 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:25:59.044 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:25:59.044 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.044 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:25:59.044 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:25:59.045 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.045 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:25:59.045 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:25:59.045 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:25:59.045 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:25:59.045 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.046 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:25:59.046 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:25:59.046 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.046 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:25:59.046 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:25:59.047 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:25:59.047 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.047 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:25:59.047 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:25:59.047 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.048 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:25:59.048 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:25:59.048 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:25:59.048 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.048 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:25:59.049 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:25:59.049 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.049 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:25:59.049 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:25:59.049 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:25:59.049 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.050 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:25:59.050 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:25:59.050 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.050 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:25:59.050 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:25:59.050 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:25:59.051 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.051 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:25:59.051 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:25:59.051 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.052 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:25:59.052 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:25:59.052 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:25:59.052 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.052 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:25:59.053 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:25:59.053 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.053 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:25:59.053 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:25:59.053 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:25:59.053 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.054 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:25:59.054 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:25:59.054 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.054 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:25:59.054 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:25:59.054 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:25:59.054 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.055 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:25:59.055 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:25:59.055 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.055 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:25:59.055 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:25:59.056 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:25:59.056 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.056 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:25:59.056 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:25:59.056 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.057 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:25:59.057 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2019-11-28T11:25:59.057 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2019-11-28T11:25:59.057 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2019-11-28T11:25:59.057 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.058 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:25:59.058 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:25:59.059 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.059 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:25:59.059 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2019-11-28T11:25:59.059 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2019-11-28T11:25:59.060 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2019-11-28T11:25:59.060 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.060 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:25:59.060 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:25:59.060 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.061 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:25:59.061 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2019-11-28T11:25:59.061 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2019-11-28T11:25:59.061 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2019-11-28T11:25:59.061 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.062 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:25:59.062 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:25:59.062 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:25:59.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2019-11-28T11:25:59.062 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2019-11-28T11:25:59.062 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2019-11-28T11:25:59.063 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.063 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:25:59.063 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:25:59.063 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.063 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:25:59.064 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:25:59.064 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:25:59.064 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:25:59.064 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.064 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-mds", 2019-11-28T11:25:59.065 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCIrt9dGP+7IBAAzIKxpeuKCJPzJrG9acbosw==", 2019-11-28T11:25:59.065 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.065 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-mds" 2019-11-28T11:25:59.065 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.065 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-mgr", 2019-11-28T11:25:59.065 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCIrt9dmge8IBAAQUG4csK5jfaRqLSW2c8tpQ==", 2019-11-28T11:25:59.066 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.066 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-mgr" 2019-11-28T11:25:59.066 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.066 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-osd", 2019-11-28T11:25:59.066 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCIrt9dbxC8IBAAT2gZCGHHizfXdyAYv2Jzuw==", 2019-11-28T11:25:59.067 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.067 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-osd" 2019-11-28T11:25:59.067 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.067 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-rbd", 2019-11-28T11:25:59.067 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCIrt9dwxi8IBAAaMVQQwHii/p7KJS634C6dw==", 2019-11-28T11:25:59.068 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.068 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-rbd" 2019-11-28T11:25:59.068 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.068 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-rbd-mirror", 2019-11-28T11:25:59.069 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCIrt9dMiG8IBAAfQlBkbLhpDFPy2q2xN4IkQ==", 2019-11-28T11:25:59.069 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.069 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2019-11-28T11:25:59.069 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.069 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-rgw", 2019-11-28T11:25:59.070 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCIrt9dgCm8IBAAQ62HzU0loifHA/dAz7Xang==", 2019-11-28T11:25:59.070 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.070 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-rgw" 2019-11-28T11:25:59.070 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.070 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:25:59.071 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:25:59.071 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.071 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:25:59.071 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:25:59.071 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:25:59.071 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:25:59.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:25:59.072 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:25:59.072 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:25:59.072 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:25:59.072 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:25:59.072 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:25:59.072 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:25:59.072 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.073 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:25:59.073 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:25:59.073 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:25:59.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.018+0000 7f272cb12700 1 -- 172.21.15.80:0/2914918974 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2700018730 msgr2=0x7f270001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.018+0000 7f272cb12700 1 --2- 172.21.15.80:0/2914918974 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2700018730 0x7f270001abc0 crc :-1 s=READY pgs=136 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.018+0000 7f272cb12700 1 -- 172.21.15.80:0/2914918974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2728074d00 msgr2=0x7f27280750f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.018+0000 7f272cb12700 1 --2- 172.21.15.80:0/2914918974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2728074d00 0x7f27280750f0 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7f27100107e0 tx=0x7f2710010b80).stop 2019-11-28T11:25:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.019+0000 7f272cb12700 1 -- 172.21.15.80:0/2914918974 shutdown_connections 2019-11-28T11:25:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.019+0000 7f272cb12700 1 --2- 172.21.15.80:0/2914918974 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2700018730 0x7f270001abc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.019+0000 7f272cb12700 1 --2- 172.21.15.80:0/2914918974 >> v2:172.21.15.174:3300/0 conn(0x7f2728153040 0x7f2728140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.019+0000 7f272cb12700 1 --2- 172.21.15.80:0/2914918974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2728074d00 0x7f27280750f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.019+0000 7f272cb12700 1 -- 172.21.15.80:0/2914918974 shutdown_connections 2019-11-28T11:25:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.019+0000 7f272cb12700 1 -- 172.21.15.80:0/2914918974 wait complete. 2019-11-28T11:25:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.019+0000 7f272cb12700 1 -- 172.21.15.80:0/2914918974 >> 172.21.15.80:0/2914918974 conn(0x7f272813fa50 msgr2=0x7f272807c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:59.077 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2019-11-28T11:25:59.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.186+0000 7f4fefc65700 1 Processor -- start 2019-11-28T11:25:59.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.187+0000 7f4fefc65700 1 -- start start 2019-11-28T11:25:59.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.188+0000 7f4fefc65700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4fe806c0a0 0x7f4fe8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:59.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.188+0000 7f4fefc65700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4fe80734e0 0x7f4fe8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:59.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.188+0000 7f4fefc65700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe806db00 con 0x7f4fe8072360 2019-11-28T11:25:59.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.188+0000 7f4fefc65700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe806fd60 con 0x7f4fe806c0a0 2019-11-28T11:25:59.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.188+0000 7f4fefc65700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe8070030 con 0x7f4fe80734e0 2019-11-28T11:25:59.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.188+0000 7f4fee202700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4fe806c0a0 0x7f4fe8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.188+0000 7f4feea03700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f4fe8072360 0x7f4fe806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:47062/0 (socket says 172.21.15.80:47062) 2019-11-28T11:25:59.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.188+0000 7f4feea03700 1 -- 172.21.15.80:0/1520728292 learned_addr learned my addr 172.21.15.80:0/1520728292 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:59.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.188+0000 7f4feda01700 1 --2- 172.21.15.80:0/1520728292 >> v2:172.21.15.174:3300/0 conn(0x7f4fe80734e0 0x7f4fe8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.188+0000 7f4fee202700 1 -- 172.21.15.80:0/1520728292 >> v2:172.21.15.174:3300/0 conn(0x7f4fe80734e0 msgr2=0x7f4fe8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:59.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.188+0000 7f4fee202700 1 --2- 172.21.15.80:0/1520728292 >> v2:172.21.15.174:3300/0 conn(0x7f4fe80734e0 0x7f4fe8071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:59.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.188+0000 7f4fed200700 1 -- 172.21.15.80:0/1520728292 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767872542 0 0) 0x7f4fe0001100 con 0x7f4fe8072360 2019-11-28T11:25:59.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.188+0000 7f4fee202700 1 -- 172.21.15.80:0/1520728292 >> v1:172.21.15.174:6789/0 conn(0x7f4fe8072360 legacy=0x7f4fe806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.188+0000 7f4fee202700 1 -- 172.21.15.80:0/1520728292 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe80706c0 con 0x7f4fe806c0a0 2019-11-28T11:25:59.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.188+0000 7f4fee202700 1 --2- 172.21.15.80:0/1520728292 >> v2:172.21.15.80:3300/0 conn(0x7f4fe806c0a0 0x7f4fe8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4fd000b2d0 tx=0x7f4fd000b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.189+0000 7f4fee202700 1 --2- 172.21.15.80:0/1520728292 >> v2:172.21.15.80:3300/0 conn(0x7f4fe806c0a0 0x7f4fe8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4fd000b2d0 tx=0x7f4fd000b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.189+0000 7f4fee202700 1 --2- 172.21.15.80:0/1520728292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe806c0a0 0x7f4fe8072fa0 secure :-1 s=READY pgs=311 cs=0 l=1 rx=0x7f4fd000b2d0 tx=0x7f4fd000b5d0).ready entity=mon.0 client_cookie=ddb216d8372ed7fa server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:59.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.189+0000 7f4fee202700 1 --2- 172.21.15.80:0/1520728292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe806c0a0 0x7f4fe8072fa0 secure :-1 s=THROTTLE_DONE pgs=311 cs=0 l=1 rx=0x7f4fd000b2d0 tx=0x7f4fd000b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.189+0000 7f4fed200700 1 -- 172.21.15.80:0/1520728292 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fd0007590 con 0x7f4fe806c0a0 2019-11-28T11:25:59.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.189+0000 7f4fee202700 1 --2- 172.21.15.80:0/1520728292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe806c0a0 0x7f4fe8072fa0 secure :-1 s=THROTTLE_DONE pgs=311 cs=0 l=1 rx=0x7f4fd000b2d0 tx=0x7f4fd000b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.189+0000 7f4fee202700 1 --2- 172.21.15.80:0/1520728292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe806c0a0 0x7f4fe8072fa0 secure :-1 s=THROTTLE_DONE pgs=311 cs=0 l=1 rx=0x7f4fd000b2d0 tx=0x7f4fd000b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.189+0000 7f4fed200700 1 -- 172.21.15.80:0/1520728292 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd0009d30 con 0x7f4fe806c0a0 2019-11-28T11:25:59.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.189+0000 7f4fed200700 1 -- 172.21.15.80:0/1520728292 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fd0009f20 con 0x7f4fe806c0a0 2019-11-28T11:25:59.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.189+0000 7f4fefc65700 1 -- 172.21.15.80:0/1520728292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe806c0a0 msgr2=0x7f4fe8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.189+0000 7f4fefc65700 1 --2- 172.21.15.80:0/1520728292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe806c0a0 0x7f4fe8072fa0 secure :-1 s=READY pgs=311 cs=0 l=1 rx=0x7f4fd000b2d0 tx=0x7f4fd000b5d0).stop 2019-11-28T11:25:59.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.190+0000 7f4fefc65700 1 -- 172.21.15.80:0/1520728292 shutdown_connections 2019-11-28T11:25:59.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.190+0000 7f4fefc65700 1 --2- 172.21.15.80:0/1520728292 >> v2:172.21.15.174:3300/0 conn(0x7f4fe80734e0 0x7f4fe8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:59.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.190+0000 7f4fefc65700 1 --2- 172.21.15.80:0/1520728292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe806c0a0 0x7f4fe8072fa0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.190+0000 7f4fefc65700 1 -- 172.21.15.80:0/1520728292 shutdown_connections 2019-11-28T11:25:59.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.190+0000 7f4fefc65700 1 -- 172.21.15.80:0/1520728292 wait complete. 2019-11-28T11:25:59.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.190+0000 7f4fefc65700 1 -- 172.21.15.80:0/1520728292 >> 172.21.15.80:0/1520728292 conn(0x7f4fe8061cf0 msgr2=0x7f4fe8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:59.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.192+0000 7f4fefc65700 1 Processor -- start 2019-11-28T11:25:59.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.192+0000 7f4fefc65700 1 -- start start 2019-11-28T11:25:59.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.193+0000 7f4fefc65700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4fe813e9e0 0x7f4fe8108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:59.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.193+0000 7f4fefc65700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fe8109430 0x7f4fe81098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:59.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.193+0000 7f4fefc65700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe81066e0 con 0x7f4fe813e5f0 2019-11-28T11:25:59.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.193+0000 7f4fefc65700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe810e060 con 0x7f4fe813e9e0 2019-11-28T11:25:59.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.193+0000 7f4fefc65700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe810e330 con 0x7f4fe8109430 2019-11-28T11:25:59.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.193+0000 7f4feda01700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4fe813e9e0 0x7f4fe8108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.193+0000 7f4feda01700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4fe813e9e0 0x7f4fe8108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60440/0 (socket says 172.21.15.80:60440) 2019-11-28T11:25:59.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.193+0000 7f4feda01700 1 -- 172.21.15.80:0/3837044705 learned_addr learned my addr 172.21.15.80:0/3837044705 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:59.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.193+0000 7f4feea03700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fe8109430 0x7f4fe81098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.194+0000 7f4feda01700 1 -- 172.21.15.80:0/3837044705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fe8109430 msgr2=0x7f4fe81098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.194+0000 7f4feda01700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fe8109430 0x7f4fe81098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.194+0000 7f4feda01700 1 -- 172.21.15.80:0/3837044705 >> v1:172.21.15.174:6789/0 conn(0x7f4fe813e5f0 legacy=0x7f4fe810a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.194+0000 7f4feda01700 1 -- 172.21.15.80:0/3837044705 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe810e9c0 con 0x7f4fe813e9e0 2019-11-28T11:25:59.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.194+0000 7f4feda01700 1 --2- 172.21.15.80:0/3837044705 >> v2:172.21.15.80:3300/0 conn(0x7f4fe813e9e0 0x7f4fe8108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4fd8010450 tx=0x7f4fd8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.194+0000 7f4feda01700 1 --2- 172.21.15.80:0/3837044705 >> v2:172.21.15.80:3300/0 conn(0x7f4fe813e9e0 0x7f4fe8108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4fd8010450 tx=0x7f4fd8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.194+0000 7f4feda01700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe813e9e0 0x7f4fe8108ef0 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7f4fd8010450 tx=0x7f4fd8010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:59.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.194+0000 7f4feda01700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe813e9e0 0x7f4fe8108ef0 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f4fd8010450 tx=0x7f4fd8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.194+0000 7f4feda01700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe813e9e0 0x7f4fe8108ef0 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f4fd8010450 tx=0x7f4fd8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.194+0000 7f4feda01700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe813e9e0 0x7f4fe8108ef0 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f4fd8010450 tx=0x7f4fd8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.194+0000 7f4fe6ffd700 1 -- 172.21.15.80:0/3837044705 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fd8000940 con 0x7f4fe813e9e0 2019-11-28T11:25:59.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.194+0000 7f4fe6ffd700 1 -- 172.21.15.80:0/3837044705 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd8000e80 con 0x7f4fe813e9e0 2019-11-28T11:25:59.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.194+0000 7f4fefc65700 1 -- 172.21.15.80:0/3837044705 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe810ed40 con 0x7f4fe813e9e0 2019-11-28T11:25:59.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.194+0000 7f4fe6ffd700 1 -- 172.21.15.80:0/3837044705 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fd80014d0 con 0x7f4fe813e9e0 2019-11-28T11:25:59.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.194+0000 7f4fefc65700 1 -- 172.21.15.80:0/3837044705 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe810e9c0 con 0x7f4fe813e9e0 2019-11-28T11:25:59.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.194+0000 7f4feda01700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe813e9e0 0x7f4fe8108ef0 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f4fd8010450 tx=0x7f4fd8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.195+0000 7f4fe6ffd700 1 -- 172.21.15.80:0/3837044705 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4fd8001070 con 0x7f4fe813e9e0 2019-11-28T11:25:59.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.195+0000 7f4feda01700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe813e9e0 0x7f4fe8108ef0 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f4fd8010450 tx=0x7f4fd8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.195+0000 7f4fe6ffd700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fcc018730 0x7f4fcc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:59.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.195+0000 7f4fe6ffd700 1 -- 172.21.15.80:0/3837044705 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f4fd8031af0 con 0x7f4fe813e9e0 2019-11-28T11:25:59.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.195+0000 7f4fee202700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fcc018730 0x7f4fcc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.195+0000 7f4fee202700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fcc018730 0x7f4fcc01abc0 crc :-1 s=READY pgs=137 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:59.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.202+0000 7f4fefc65700 1 -- 172.21.15.80:0/3837044705 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe810ed40 con 0x7f4fe813e9e0 2019-11-28T11:25:59.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.205+0000 7f4feda01700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe813e9e0 0x7f4fe8108ef0 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f4fd8010450 tx=0x7f4fd8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.205+0000 7f4fe6ffd700 1 -- 172.21.15.80:0/3837044705 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4fd8009250 con 0x7f4fe813e9e0 2019-11-28T11:25:59.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.383+0000 7f4fefc65700 1 -- 172.21.15.80:0/3837044705 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f4fe810e9c0 con 0x7f4fe813e9e0 2019-11-28T11:25:59.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.386+0000 7f4feda01700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe813e9e0 0x7f4fe8108ef0 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f4fd8010450 tx=0x7f4fd8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.386+0000 7f4fe6ffd700 1 -- 172.21.15.80:0/3837044705 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4fd8001070 con 0x7f4fe813e9e0 2019-11-28T11:25:59.411 INFO:teuthology.orchestra.run.smithi080.stderr:updated 2019-11-28T11:25:59.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.392+0000 7f4fefc65700 1 -- 172.21.15.80:0/3837044705 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fcc018730 msgr2=0x7f4fcc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.392+0000 7f4fefc65700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fcc018730 0x7f4fcc01abc0 crc :-1 s=READY pgs=137 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.392+0000 7f4fefc65700 1 -- 172.21.15.80:0/3837044705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe813e9e0 msgr2=0x7f4fe8108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.392+0000 7f4fefc65700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe813e9e0 0x7f4fe8108ef0 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7f4fd8010450 tx=0x7f4fd8010280).stop 2019-11-28T11:25:59.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.392+0000 7f4fefc65700 1 -- 172.21.15.80:0/3837044705 shutdown_connections 2019-11-28T11:25:59.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.392+0000 7f4fefc65700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fe8109430 0x7f4fe81098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.392+0000 7f4fefc65700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fe813e9e0 0x7f4fe8108ef0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.392+0000 7f4fefc65700 1 --2- 172.21.15.80:0/3837044705 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fcc018730 0x7f4fcc01abc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.392+0000 7f4fefc65700 1 -- 172.21.15.80:0/3837044705 shutdown_connections 2019-11-28T11:25:59.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.392+0000 7f4fefc65700 1 -- 172.21.15.80:0/3837044705 wait complete. 2019-11-28T11:25:59.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.392+0000 7f4fefc65700 1 -- 172.21.15.80:0/3837044705 >> 172.21.15.80:0/3837044705 conn(0x7f4fe813d620 msgr2=0x7f4fe813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:59.423 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2019-11-28T11:25:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.526+0000 7f07f0333700 1 Processor -- start 2019-11-28T11:25:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.526+0000 7f07f0333700 1 -- start start 2019-11-28T11:25:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.527+0000 7f07f0333700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07e806c0a0 0x7f07e8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.527+0000 7f07f0333700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e806db00 con 0x7f07e8072620 2019-11-28T11:25:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.527+0000 7f07f0333700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e806e000 con 0x7f07e80734e0 2019-11-28T11:25:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.527+0000 7f07f0333700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e806fd60 con 0x7f07e806c0a0 2019-11-28T11:25:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.527+0000 7f07ee8d0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07e806c0a0 0x7f07e8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.527+0000 7f07ef0d1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f07e8072620 0x7f07e8164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59766/0 (socket says 172.21.15.80:59766) 2019-11-28T11:25:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.527+0000 7f07ef0d1700 1 -- 172.21.15.80:0/1376935709 learned_addr learned my addr 172.21.15.80:0/1376935709 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.527+0000 7f07ee8d0700 1 -- 172.21.15.80:0/1376935709 >> v1:172.21.15.174:6789/0 conn(0x7f07e80734e0 legacy=0x7f07e8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.527+0000 7f07ee8d0700 1 -- 172.21.15.80:0/1376935709 >> v1:172.21.15.80:6789/0 conn(0x7f07e8072620 legacy=0x7f07e8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.527+0000 7f07ee8d0700 1 -- 172.21.15.80:0/1376935709 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e80706c0 con 0x7f07e806c0a0 2019-11-28T11:25:59.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.527+0000 7f07ed8ce700 1 -- 172.21.15.80:0/1376935709 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343501968 0 0) 0x7f07e0001150 con 0x7f07e8072620 2019-11-28T11:25:59.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.528+0000 7f07ee8d0700 1 --2- 172.21.15.80:0/1376935709 >> v2:172.21.15.80:3300/0 conn(0x7f07e806c0a0 0x7f07e8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f07d000b2d0 tx=0x7f07d000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.528+0000 7f07ee8d0700 1 --2- 172.21.15.80:0/1376935709 >> v2:172.21.15.80:3300/0 conn(0x7f07e806c0a0 0x7f07e8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f07d000b2d0 tx=0x7f07d000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.528+0000 7f07ee8d0700 1 --2- 172.21.15.80:0/1376935709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e806c0a0 0x7f07e8072fa0 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7f07d000b2d0 tx=0x7f07d000bae0).ready entity=mon.0 client_cookie=601e048424fe84fe server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:59.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.528+0000 7f07ee8d0700 1 --2- 172.21.15.80:0/1376935709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e806c0a0 0x7f07e8072fa0 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f07d000b2d0 tx=0x7f07d000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.528+0000 7f07ed8ce700 1 -- 172.21.15.80:0/1376935709 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07d0000ce0 con 0x7f07e806c0a0 2019-11-28T11:25:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.528+0000 7f07ee8d0700 1 --2- 172.21.15.80:0/1376935709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e806c0a0 0x7f07e8072fa0 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f07d000b2d0 tx=0x7f07d000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.528+0000 7f07ee8d0700 1 --2- 172.21.15.80:0/1376935709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e806c0a0 0x7f07e8072fa0 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f07d000b2d0 tx=0x7f07d000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.528+0000 7f07ed8ce700 1 -- 172.21.15.80:0/1376935709 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d0009be0 con 0x7f07e806c0a0 2019-11-28T11:25:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.528+0000 7f07ed8ce700 1 -- 172.21.15.80:0/1376935709 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07d000a2b0 con 0x7f07e806c0a0 2019-11-28T11:25:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.528+0000 7f07f0333700 1 -- 172.21.15.80:0/1376935709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e806c0a0 msgr2=0x7f07e8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.528+0000 7f07f0333700 1 --2- 172.21.15.80:0/1376935709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e806c0a0 0x7f07e8072fa0 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7f07d000b2d0 tx=0x7f07d000bae0).stop 2019-11-28T11:25:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.529+0000 7f07f0333700 1 -- 172.21.15.80:0/1376935709 shutdown_connections 2019-11-28T11:25:59.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.529+0000 7f07f0333700 1 --2- 172.21.15.80:0/1376935709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e806c0a0 0x7f07e8072fa0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.529+0000 7f07f0333700 1 -- 172.21.15.80:0/1376935709 shutdown_connections 2019-11-28T11:25:59.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.529+0000 7f07f0333700 1 -- 172.21.15.80:0/1376935709 wait complete. 2019-11-28T11:25:59.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.529+0000 7f07f0333700 1 -- 172.21.15.80:0/1376935709 >> 172.21.15.80:0/1376935709 conn(0x7f07e8061cf0 msgr2=0x7f07e8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:59.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.531+0000 7f07f0333700 1 Processor -- start 2019-11-28T11:25:59.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.531+0000 7f07f0333700 1 -- start start 2019-11-28T11:25:59.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.532+0000 7f07f0333700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07e813f580 0x7f07e8115730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:59.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.532+0000 7f07f0333700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f07e8115c70 0x7f07e8121e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:59.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.532+0000 7f07f0333700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e813fc50 con 0x7f07e81223a0 2019-11-28T11:25:59.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.532+0000 7f07f0333700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e8124220 con 0x7f07e8115c70 2019-11-28T11:25:59.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.532+0000 7f07f0333700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e8112eb0 con 0x7f07e813f580 2019-11-28T11:25:59.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.532+0000 7f07ef0d1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f07e81223a0 0x7f07e81145b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59772/0 (socket says 172.21.15.80:59772) 2019-11-28T11:25:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.532+0000 7f07ef0d1700 1 -- 172.21.15.80:0/1662099843 learned_addr learned my addr 172.21.15.80:0/1662099843 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.532+0000 7f07ee0cf700 1 --2- 172.21.15.80:0/1662099843 >> v2:172.21.15.174:3300/0 conn(0x7f07e8115c70 0x7f07e8121e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.532+0000 7f07ee8d0700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07e813f580 0x7f07e8115730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.532+0000 7f07e77fe700 1 -- 172.21.15.80:0/1662099843 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611455515 0 0) 0x7f07e0001170 con 0x7f07e81223a0 2019-11-28T11:25:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.532+0000 7f07e77fe700 1 -- 172.21.15.80:0/1662099843 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07cc002e80 con 0x7f07e81223a0 2019-11-28T11:25:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.532+0000 7f07ee0cf700 1 -- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07e813f580 msgr2=0x7f07e8115730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.532+0000 7f07e77fe700 1 -- 172.21.15.80:0/1662099843 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3647425011 0 0) 0x7f07e0000940 con 0x7f07e81223a0 2019-11-28T11:25:59.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.532+0000 7f07ee0cf700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07e813f580 0x7f07e8115730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.532+0000 7f07ee0cf700 1 -- 172.21.15.80:0/1662099843 >> v1:172.21.15.80:6789/0 conn(0x7f07e81223a0 legacy=0x7f07e81145b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.532+0000 7f07ee0cf700 1 -- 172.21.15.80:0/1662099843 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e8113230 con 0x7f07e8115c70 2019-11-28T11:25:59.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.533+0000 7f07ee0cf700 1 --2- 172.21.15.80:0/1662099843 >> v2:172.21.15.174:3300/0 conn(0x7f07e8115c70 0x7f07e8121e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f07d80103a0 tx=0x7f07d800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.533+0000 7f07ee0cf700 1 --2- 172.21.15.80:0/1662099843 >> v2:172.21.15.174:3300/0 conn(0x7f07e8115c70 0x7f07e8121e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f07d80103a0 tx=0x7f07d800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.533+0000 7f07ee0cf700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e8115c70 0x7f07e8121e60 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f07d80103a0 tx=0x7f07d800b2e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.533+0000 7f07ee0cf700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e8115c70 0x7f07e8121e60 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f07d80103a0 tx=0x7f07d800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.533+0000 7f07e77fe700 1 -- 172.21.15.80:0/1662099843 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07d8000960 con 0x7f07e8115c70 2019-11-28T11:25:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.533+0000 7f07ee0cf700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e8115c70 0x7f07e8121e60 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f07d80103a0 tx=0x7f07d800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.533+0000 7f07e77fe700 1 -- 172.21.15.80:0/1662099843 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d8000960 con 0x7f07e8115c70 2019-11-28T11:25:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.533+0000 7f07f0333700 1 -- 172.21.15.80:0/1662099843 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e8113230 con 0x7f07e8115c70 2019-11-28T11:25:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.533+0000 7f07ee0cf700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e8115c70 0x7f07e8121e60 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f07d80103a0 tx=0x7f07d800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.533+0000 7f07e77fe700 1 -- 172.21.15.80:0/1662099843 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07d8009a00 con 0x7f07e8115c70 2019-11-28T11:25:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.533+0000 7f07f0333700 1 -- 172.21.15.80:0/1662099843 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e8113230 con 0x7f07e8115c70 2019-11-28T11:25:59.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.533+0000 7f07ee0cf700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e8115c70 0x7f07e8121e60 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f07d80103a0 tx=0x7f07d800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.533+0000 7f07e77fe700 1 -- 172.21.15.80:0/1662099843 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f07d80099a0 con 0x7f07e8115c70 2019-11-28T11:25:59.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.534+0000 7f07ee0cf700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e8115c70 0x7f07e8121e60 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f07d80103a0 tx=0x7f07d800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.534+0000 7f07e77fe700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07cc018780 0x7f07cc01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:59.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.534+0000 7f07e77fe700 1 -- 172.21.15.80:0/1662099843 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f07d8031a10 con 0x7f07e8115c70 2019-11-28T11:25:59.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.534+0000 7f07ee8d0700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07cc018780 0x7f07cc01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.534+0000 7f07ee8d0700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07cc018780 0x7f07cc01abf0 crc :-1 s=READY pgs=138 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:59.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.541+0000 7f07f0333700 1 -- 172.21.15.80:0/1662099843 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e8113230 con 0x7f07e8115c70 2019-11-28T11:25:59.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.545+0000 7f07ee0cf700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e8115c70 0x7f07e8121e60 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f07d80103a0 tx=0x7f07d800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.545+0000 7f07e77fe700 1 -- 172.21.15.80:0/1662099843 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f07d8009770 con 0x7f07e8115c70 2019-11-28T11:25:59.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.717+0000 7f07f0333700 1 -- 172.21.15.80:0/1662099843 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f07e8112eb0 con 0x7f07e8115c70 2019-11-28T11:25:59.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.724+0000 7f07ee0cf700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e8115c70 0x7f07e8121e60 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f07d80103a0 tx=0x7f07d800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.724+0000 7f07e77fe700 1 -- 172.21.15.80:0/1662099843 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f07d8009980 con 0x7f07e8115c70 2019-11-28T11:25:59.745 INFO:teuthology.orchestra.run.smithi080.stderr:updated 2019-11-28T11:25:59.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.726+0000 7f07f0333700 1 -- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07cc018780 msgr2=0x7f07cc01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.726+0000 7f07f0333700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07cc018780 0x7f07cc01abf0 crc :-1 s=READY pgs=138 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.726+0000 7f07f0333700 1 -- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e8115c70 msgr2=0x7f07e8121e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.726+0000 7f07f0333700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e8115c70 0x7f07e8121e60 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f07d80103a0 tx=0x7f07d800b2e0).stop 2019-11-28T11:25:59.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.726+0000 7f07f0333700 1 -- 172.21.15.80:0/1662099843 shutdown_connections 2019-11-28T11:25:59.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.726+0000 7f07f0333700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07cc018780 0x7f07cc01abf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.726+0000 7f07f0333700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e8115c70 0x7f07e8121e60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.726+0000 7f07f0333700 1 --2- 172.21.15.80:0/1662099843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07e813f580 0x7f07e8115730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.726+0000 7f07f0333700 1 -- 172.21.15.80:0/1662099843 shutdown_connections 2019-11-28T11:25:59.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.726+0000 7f07f0333700 1 -- 172.21.15.80:0/1662099843 wait complete. 2019-11-28T11:25:59.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.726+0000 7f07f0333700 1 -- 172.21.15.80:0/1662099843 >> 172.21.15.80:0/1662099843 conn(0x7f07e81426c0 msgr2=0x7f07e8110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:59.757 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2019-11-28T11:25:59.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.858+0000 7f9757c23700 1 Processor -- start 2019-11-28T11:25:59.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.858+0000 7f9757c23700 1 -- start start 2019-11-28T11:25:59.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.859+0000 7f9757c23700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f975006c490 0x7f975006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:59.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.859+0000 7f9757c23700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f975006ce60 0x7f9750164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:25:59.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.859+0000 7f9757c23700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975006db00 con 0x7f975006c0a0 2019-11-28T11:25:59.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.859+0000 7f9757c23700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975006fd60 con 0x7f975006ce60 2019-11-28T11:25:59.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.859+0000 7f9757c23700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9750070030 con 0x7f975006c490 2019-11-28T11:25:59.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.859+0000 7f97569c1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f975006ce60 0x7f9750164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.859+0000 7f97569c1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f975006ce60 0x7f9750164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60464/0 (socket says 172.21.15.80:60464) 2019-11-28T11:25:59.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.859+0000 7f97561c0700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f975006c0a0 0x7f9750072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59778/0 (socket says 172.21.15.80:59778) 2019-11-28T11:25:59.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.859+0000 7f97569c1700 1 -- 172.21.15.80:0/2867545278 learned_addr learned my addr 172.21.15.80:0/2867545278 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:25:59.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f97559bf700 1 --2- 172.21.15.80:0/2867545278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f975006c490 0x7f975006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f97569c1700 1 -- 172.21.15.80:0/2867545278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f975006c490 msgr2=0x7f975006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:25:59.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f97569c1700 1 --2- 172.21.15.80:0/2867545278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f975006c490 0x7f975006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:59.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f97569c1700 1 -- 172.21.15.80:0/2867545278 >> v1:172.21.15.80:6789/0 conn(0x7f975006c0a0 legacy=0x7f9750072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f97551be700 1 -- 172.21.15.80:0/2867545278 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177122004 0 0) 0x7f9740001480 con 0x7f975006c0a0 2019-11-28T11:25:59.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f97569c1700 1 -- 172.21.15.80:0/2867545278 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500706c0 con 0x7f975006ce60 2019-11-28T11:25:59.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f97559bf700 1 --2- 172.21.15.80:0/2867545278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f975006c490 0x7f975006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:25:59.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f97569c1700 1 --2- 172.21.15.80:0/2867545278 >> v2:172.21.15.80:3300/0 conn(0x7f975006ce60 0x7f9750164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f974800f730 tx=0x7f974800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f97569c1700 1 --2- 172.21.15.80:0/2867545278 >> v2:172.21.15.80:3300/0 conn(0x7f975006ce60 0x7f9750164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f974800f730 tx=0x7f974800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f97569c1700 1 --2- 172.21.15.80:0/2867545278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f975006ce60 0x7f9750164d70 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7f974800f730 tx=0x7f974800fad0).ready entity=mon.0 client_cookie=3f6789d3cf76179e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:59.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f97569c1700 1 --2- 172.21.15.80:0/2867545278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f975006ce60 0x7f9750164d70 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f974800f730 tx=0x7f974800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f97551be700 1 -- 172.21.15.80:0/2867545278 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9748000b90 con 0x7f975006ce60 2019-11-28T11:25:59.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f97569c1700 1 --2- 172.21.15.80:0/2867545278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f975006ce60 0x7f9750164d70 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f974800f730 tx=0x7f974800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f97569c1700 1 --2- 172.21.15.80:0/2867545278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f975006ce60 0x7f9750164d70 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f974800f730 tx=0x7f974800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f97551be700 1 -- 172.21.15.80:0/2867545278 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97480010e0 con 0x7f975006ce60 2019-11-28T11:25:59.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f97551be700 1 -- 172.21.15.80:0/2867545278 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9748001830 con 0x7f975006ce60 2019-11-28T11:25:59.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f9757c23700 1 -- 172.21.15.80:0/2867545278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f975006ce60 msgr2=0x7f9750164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.860+0000 7f9757c23700 1 --2- 172.21.15.80:0/2867545278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f975006ce60 0x7f9750164d70 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7f974800f730 tx=0x7f974800fad0).stop 2019-11-28T11:25:59.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.861+0000 7f9757c23700 1 -- 172.21.15.80:0/2867545278 shutdown_connections 2019-11-28T11:25:59.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.861+0000 7f9757c23700 1 --2- 172.21.15.80:0/2867545278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f975006ce60 0x7f9750164d70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.861+0000 7f9757c23700 1 --2- 172.21.15.80:0/2867545278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f975006c490 0x7f975006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:25:59.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.861+0000 7f9757c23700 1 -- 172.21.15.80:0/2867545278 shutdown_connections 2019-11-28T11:25:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.861+0000 7f9757c23700 1 -- 172.21.15.80:0/2867545278 wait complete. 2019-11-28T11:25:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.861+0000 7f9757c23700 1 -- 172.21.15.80:0/2867545278 >> 172.21.15.80:0/2867545278 conn(0x7f9750061cf0 msgr2=0x7f9750064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:25:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.863+0000 7f9757c23700 1 Processor -- start 2019-11-28T11:25:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.863+0000 7f9757c23700 1 -- start start 2019-11-28T11:25:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.864+0000 7f9757c23700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f975013a780 0x7f975012d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.864+0000 7f9757c23700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f975012cb00 0x7f9750167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.864+0000 7f9757c23700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9750139a60 con 0x7f975012d9c0 2019-11-28T11:25:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.864+0000 7f9757c23700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975012a260 con 0x7f975013a780 2019-11-28T11:25:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.864+0000 7f9757c23700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975012a530 con 0x7f975012cb00 2019-11-28T11:25:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.864+0000 7f97559bf700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f975012d9c0 0x7f975012c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59786/0 (socket says 172.21.15.80:59786) 2019-11-28T11:25:59.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.864+0000 7f97559bf700 1 -- 172.21.15.80:0/292021068 learned_addr learned my addr 172.21.15.80:0/292021068 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:25:59.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838510816 0 0) 0x7f9738000ea0 con 0x7f975012d9c0 2019-11-28T11:25:59.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f97561c0700 1 --2- 172.21.15.80:0/292021068 >> v2:172.21.15.174:3300/0 conn(0x7f975013a780 0x7f975012d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9734002e80 con 0x7f975012d9c0 2019-11-28T11:25:59.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f97569c1700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f975012cb00 0x7f9750167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3984433418 0 0) 0x7f9738000940 con 0x7f975012d9c0 2019-11-28T11:25:59.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f97340032e0 con 0x7f975012d9c0 2019-11-28T11:25:59.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f97380012f0 con 0x7f975012d9c0 2019-11-28T11:25:59.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f975012cb00 msgr2=0x7f9750167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f974effd700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f975012cb00 0x7f9750167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 >> v2:172.21.15.174:3300/0 conn(0x7f975013a780 msgr2=0x7f975012d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f974effd700 1 --2- 172.21.15.80:0/292021068 >> v2:172.21.15.174:3300/0 conn(0x7f975013a780 0x7f975012d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 >> v1:172.21.15.80:6789/0 conn(0x7f975012d9c0 legacy=0x7f975012c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f974effd700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9734003330 0x7f9734003740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f974effd700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9734003c80 0x7f9734004100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f974effd700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9734004800 0x7f9734004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973400bb60 con 0x7f9734004800 2019-11-28T11:25:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973400df60 con 0x7f9734003c80 2019-11-28T11:25:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973400e150 con 0x7f9734003330 2019-11-28T11:25:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f97569c1700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9734004800 0x7f9734004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f97559bf700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9734003c80 0x7f9734004100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f97561c0700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9734003330 0x7f9734003740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f97569c1700 1 -- 172.21.15.80:0/292021068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9734003330 msgr2=0x7f9734003740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f97569c1700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9734003330 0x7f9734003740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f97569c1700 1 -- 172.21.15.80:0/292021068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9734003c80 msgr2=0x7f9734004100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:25:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f97569c1700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9734003c80 0x7f9734004100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:25:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f97569c1700 1 -- 172.21.15.80:0/292021068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973400e400 con 0x7f9734004800 2019-11-28T11:25:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f9757c23700 1 -- 172.21.15.80:0/292021068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975012af40 con 0x7f9734004800 2019-11-28T11:25:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f97569c1700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9734004800 0x7f9734004cc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9748010350 tx=0x7f9748010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f9757c23700 1 -- 172.21.15.80:0/292021068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975012abc0 con 0x7f9734004800 2019-11-28T11:25:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f97569c1700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9734004800 0x7f9734004cc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9748010350 tx=0x7f9748010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f97569c1700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9734004800 0x7f9734004cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f9748010350 tx=0x7f9748010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.865+0000 7f97569c1700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9734004800 0x7f9734004cc0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f9748010350 tx=0x7f9748010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.866+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9748005340 con 0x7f9734004800 2019-11-28T11:25:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.866+0000 7f97569c1700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9734004800 0x7f9734004cc0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f9748010350 tx=0x7f9748010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.866+0000 7f97569c1700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9734004800 0x7f9734004cc0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f9748010350 tx=0x7f9748010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.866+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9748005830 con 0x7f9734004800 2019-11-28T11:25:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.866+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9748005340 con 0x7f9734004800 2019-11-28T11:25:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.866+0000 7f97569c1700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9734004800 0x7f9734004cc0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f9748010350 tx=0x7f9748010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.866+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9748005a20 con 0x7f9734004800 2019-11-28T11:25:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.866+0000 7f97569c1700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9734004800 0x7f9734004cc0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f9748010350 tx=0x7f9748010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.866+0000 7f974effd700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9734022ce0 0x7f9734025110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:25:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.866+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f9748031b50 con 0x7f9734004800 2019-11-28T11:25:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.866+0000 7f97561c0700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9734022ce0 0x7f9734025110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:25:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.867+0000 7f97561c0700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9734022ce0 0x7f9734025110 crc :-1 s=READY pgs=139 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:25:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.874+0000 7f9757c23700 1 -- 172.21.15.80:0/292021068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975012af40 con 0x7f9734004800 2019-11-28T11:25:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.877+0000 7f97569c1700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9734004800 0x7f9734004cc0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f9748010350 tx=0x7f9748010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:25:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:25:59.877+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9748005620 con 0x7f9734004800 2019-11-28T11:26:00.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.046+0000 7f9757c23700 1 -- 172.21.15.80:0/292021068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f975012abc0 con 0x7f9734004800 2019-11-28T11:26:00.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.051+0000 7f97569c1700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9734004800 0x7f9734004cc0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f9748010350 tx=0x7f9748010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.051+0000 7f974effd700 1 -- 172.21.15.80:0/292021068 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9748005620 con 0x7f9734004800 2019-11-28T11:26:00.074 INFO:teuthology.orchestra.run.smithi080.stderr:updated 2019-11-28T11:26:00.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.056+0000 7f9757c23700 1 -- 172.21.15.80:0/292021068 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9734022ce0 msgr2=0x7f9734025110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.056+0000 7f9757c23700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9734022ce0 0x7f9734025110 crc :-1 s=READY pgs=139 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:00.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.056+0000 7f9757c23700 1 -- 172.21.15.80:0/292021068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9734004800 msgr2=0x7f9734004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.056+0000 7f9757c23700 1 --2- 172.21.15.80:0/292021068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9734004800 0x7f9734004cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f9748010350 tx=0x7f9748010280).stop 2019-11-28T11:26:00.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.056+0000 7f97569c1700 1 -- 172.21.15.80:0/292021068 reap_dead start 2019-11-28T11:26:00.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.056+0000 7f97569c1700 1 -- 172.21.15.80:0/292021068 reap_dead start 2019-11-28T11:26:00.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.056+0000 7f9757c23700 1 -- 172.21.15.80:0/292021068 shutdown_connections 2019-11-28T11:26:00.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.056+0000 7f9757c23700 1 -- 172.21.15.80:0/292021068 shutdown_connections 2019-11-28T11:26:00.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.056+0000 7f9757c23700 1 -- 172.21.15.80:0/292021068 wait complete. 2019-11-28T11:26:00.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.056+0000 7f9757c23700 1 -- 172.21.15.80:0/292021068 >> 172.21.15.80:0/292021068 conn(0x7f9750127dc0 msgr2=0x7f9750141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:00.087 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2019-11-28T11:26:00.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.189+0000 7f282b0e6700 1 Processor -- start 2019-11-28T11:26:00.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.189+0000 7f282b0e6700 1 -- start start 2019-11-28T11:26:00.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.190+0000 7f282b0e6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f282406c0a0 0x7f2824072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:00.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.190+0000 7f282b0e6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28240734e0 0x7f2824071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:00.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.190+0000 7f282b0e6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282406db00 con 0x7f2824072360 2019-11-28T11:26:00.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.190+0000 7f282b0e6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282406fd60 con 0x7f282406c0a0 2019-11-28T11:26:00.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.190+0000 7f282b0e6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2824070030 con 0x7f28240734e0 2019-11-28T11:26:00.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.190+0000 7f2829683700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f282406c0a0 0x7f2824072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:00.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.190+0000 7f2829683700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f282406c0a0 0x7f2824072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60482/0 (socket says 172.21.15.80:60482) 2019-11-28T11:26:00.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.190+0000 7f2829683700 1 -- 172.21.15.80:0/2216931669 learned_addr learned my addr 172.21.15.80:0/2216931669 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:00.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.191+0000 7f2828e82700 1 --2- 172.21.15.80:0/2216931669 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28240734e0 0x7f2824071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:00.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.191+0000 7f2829683700 1 -- 172.21.15.80:0/2216931669 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28240734e0 msgr2=0x7f2824071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:00.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.191+0000 7f2829683700 1 --2- 172.21.15.80:0/2216931669 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28240734e0 0x7f2824071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:00.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.191+0000 7f2829683700 1 -- 172.21.15.80:0/2216931669 >> v1:172.21.15.174:6789/0 conn(0x7f2824072360 legacy=0x7f282406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.191+0000 7f2829683700 1 -- 172.21.15.80:0/2216931669 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28240706c0 con 0x7f282406c0a0 2019-11-28T11:26:00.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.191+0000 7f2829683700 1 --2- 172.21.15.80:0/2216931669 >> v2:172.21.15.80:3300/0 conn(0x7f282406c0a0 0x7f2824072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f280c00fa40 tx=0x7f280c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.191+0000 7f2829683700 1 --2- 172.21.15.80:0/2216931669 >> v2:172.21.15.80:3300/0 conn(0x7f282406c0a0 0x7f2824072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f280c00fa40 tx=0x7f280c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.191+0000 7f2829683700 1 --2- 172.21.15.80:0/2216931669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f282406c0a0 0x7f2824072fa0 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7f280c00fa40 tx=0x7f280c00fde0).ready entity=mon.0 client_cookie=68c3e11884d04e4a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:00.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.191+0000 7f2829683700 1 --2- 172.21.15.80:0/2216931669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f282406c0a0 0x7f2824072fa0 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f280c00fa40 tx=0x7f280c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.191+0000 7f2829683700 1 --2- 172.21.15.80:0/2216931669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f282406c0a0 0x7f2824072fa0 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f280c00fa40 tx=0x7f280c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.191+0000 7f2829683700 1 --2- 172.21.15.80:0/2216931669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f282406c0a0 0x7f2824072fa0 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f280c00fa40 tx=0x7f280c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.191+0000 7f2823fff700 1 -- 172.21.15.80:0/2216931669 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f280c000ce0 con 0x7f282406c0a0 2019-11-28T11:26:00.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.191+0000 7f2823fff700 1 -- 172.21.15.80:0/2216931669 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280c001010 con 0x7f282406c0a0 2019-11-28T11:26:00.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.191+0000 7f2823fff700 1 -- 172.21.15.80:0/2216931669 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f280c001720 con 0x7f282406c0a0 2019-11-28T11:26:00.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.191+0000 7f282b0e6700 1 -- 172.21.15.80:0/2216931669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f282406c0a0 msgr2=0x7f2824072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.191+0000 7f282b0e6700 1 --2- 172.21.15.80:0/2216931669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f282406c0a0 0x7f2824072fa0 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7f280c00fa40 tx=0x7f280c00fde0).stop 2019-11-28T11:26:00.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.192+0000 7f282b0e6700 1 -- 172.21.15.80:0/2216931669 shutdown_connections 2019-11-28T11:26:00.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.192+0000 7f282b0e6700 1 --2- 172.21.15.80:0/2216931669 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28240734e0 0x7f2824071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:00.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.192+0000 7f282b0e6700 1 --2- 172.21.15.80:0/2216931669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f282406c0a0 0x7f2824072fa0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:00.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.192+0000 7f282b0e6700 1 -- 172.21.15.80:0/2216931669 shutdown_connections 2019-11-28T11:26:00.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.192+0000 7f282b0e6700 1 -- 172.21.15.80:0/2216931669 wait complete. 2019-11-28T11:26:00.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.192+0000 7f282b0e6700 1 -- 172.21.15.80:0/2216931669 >> 172.21.15.80:0/2216931669 conn(0x7f2824061cf0 msgr2=0x7f2824064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:00.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.194+0000 7f282b0e6700 1 Processor -- start 2019-11-28T11:26:00.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.194+0000 7f282b0e6700 1 -- start start 2019-11-28T11:26:00.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.195+0000 7f282b0e6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f282413dc00 0x7f2824109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:00.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.195+0000 7f282b0e6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28241094e0 0x7f2824167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:00.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.195+0000 7f282b0e6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28241312c0 con 0x7f282410a3a0 2019-11-28T11:26:00.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.195+0000 7f282b0e6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2824105830 con 0x7f28241094e0 2019-11-28T11:26:00.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.195+0000 7f282b0e6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2824105b00 con 0x7f282413dc00 2019-11-28T11:26:00.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.195+0000 7f2829e84700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28241094e0 0x7f2824167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:00.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.195+0000 7f2829e84700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28241094e0 0x7f2824167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60492/0 (socket says 172.21.15.80:60492) 2019-11-28T11:26:00.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.195+0000 7f2829e84700 1 -- 172.21.15.80:0/989223850 learned_addr learned my addr 172.21.15.80:0/989223850 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:00.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f2829683700 1 --2- 172.21.15.80:0/989223850 >> v2:172.21.15.174:3300/0 conn(0x7f282413dc00 0x7f2824109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:00.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f2829e84700 1 -- 172.21.15.80:0/989223850 >> v2:172.21.15.174:3300/0 conn(0x7f282413dc00 msgr2=0x7f2824109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f2829e84700 1 --2- 172.21.15.80:0/989223850 >> v2:172.21.15.174:3300/0 conn(0x7f282413dc00 0x7f2824109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:00.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f2829e84700 1 -- 172.21.15.80:0/989223850 >> v1:172.21.15.174:6789/0 conn(0x7f282410a3a0 legacy=0x7f2824108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f2829e84700 1 -- 172.21.15.80:0/989223850 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2824106190 con 0x7f28241094e0 2019-11-28T11:26:00.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f2829e84700 1 --2- 172.21.15.80:0/989223850 >> v2:172.21.15.80:3300/0 conn(0x7f28241094e0 0x7f2824167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f281c010420 tx=0x7f281c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f2829e84700 1 --2- 172.21.15.80:0/989223850 >> v2:172.21.15.80:3300/0 conn(0x7f28241094e0 0x7f2824167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f281c010420 tx=0x7f281c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f2829e84700 1 --2- 172.21.15.80:0/989223850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28241094e0 0x7f2824167a10 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7f281c010420 tx=0x7f281c010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:00.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f2829e84700 1 --2- 172.21.15.80:0/989223850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28241094e0 0x7f2824167a10 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f281c010420 tx=0x7f281c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f2821ffb700 1 -- 172.21.15.80:0/989223850 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f281c000960 con 0x7f28241094e0 2019-11-28T11:26:00.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f2829e84700 1 --2- 172.21.15.80:0/989223850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28241094e0 0x7f2824167a10 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f281c010420 tx=0x7f281c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f282b0e6700 1 -- 172.21.15.80:0/989223850 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2824106510 con 0x7f28241094e0 2019-11-28T11:26:00.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f2821ffb700 1 -- 172.21.15.80:0/989223850 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c000960 con 0x7f28241094e0 2019-11-28T11:26:00.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f2829e84700 1 --2- 172.21.15.80:0/989223850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28241094e0 0x7f2824167a10 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f281c010420 tx=0x7f281c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f2821ffb700 1 -- 172.21.15.80:0/989223850 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f281c001280 con 0x7f28241094e0 2019-11-28T11:26:00.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f282b0e6700 1 -- 172.21.15.80:0/989223850 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2824106190 con 0x7f28241094e0 2019-11-28T11:26:00.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.196+0000 7f2829e84700 1 --2- 172.21.15.80:0/989223850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28241094e0 0x7f2824167a10 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f281c010420 tx=0x7f281c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.197+0000 7f2821ffb700 1 -- 172.21.15.80:0/989223850 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f281c000ea0 con 0x7f28241094e0 2019-11-28T11:26:00.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.197+0000 7f2829e84700 1 --2- 172.21.15.80:0/989223850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28241094e0 0x7f2824167a10 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f281c010420 tx=0x7f281c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.197+0000 7f2821ffb700 1 --2- 172.21.15.80:0/989223850 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2808018730 0x7f280801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:00.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.197+0000 7f2821ffb700 1 -- 172.21.15.80:0/989223850 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f281c031af0 con 0x7f28241094e0 2019-11-28T11:26:00.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.197+0000 7f2829683700 1 --2- 172.21.15.80:0/989223850 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2808018730 0x7f280801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:00.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.197+0000 7f2829683700 1 --2- 172.21.15.80:0/989223850 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2808018730 0x7f280801abc0 crc :-1 s=READY pgs=140 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:00.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.204+0000 7f282b0e6700 1 -- 172.21.15.80:0/989223850 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2824106510 con 0x7f28241094e0 2019-11-28T11:26:00.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.208+0000 7f2829e84700 1 --2- 172.21.15.80:0/989223850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28241094e0 0x7f2824167a10 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f281c010420 tx=0x7f281c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.208+0000 7f2821ffb700 1 -- 172.21.15.80:0/989223850 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f281c007590 con 0x7f28241094e0 2019-11-28T11:26:00.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.376+0000 7f282b0e6700 1 -- 172.21.15.80:0/989223850 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f2824106190 con 0x7f28241094e0 2019-11-28T11:26:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.381+0000 7f2829e84700 1 --2- 172.21.15.80:0/989223850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28241094e0 0x7f2824167a10 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f281c010420 tx=0x7f281c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.381+0000 7f2821ffb700 1 -- 172.21.15.80:0/989223850 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f281c000ea0 con 0x7f28241094e0 2019-11-28T11:26:00.404 INFO:teuthology.orchestra.run.smithi080.stderr:updated 2019-11-28T11:26:00.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.385+0000 7f282b0e6700 1 -- 172.21.15.80:0/989223850 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2808018730 msgr2=0x7f280801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.385+0000 7f282b0e6700 1 --2- 172.21.15.80:0/989223850 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2808018730 0x7f280801abc0 crc :-1 s=READY pgs=140 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:00.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.385+0000 7f282b0e6700 1 -- 172.21.15.80:0/989223850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28241094e0 msgr2=0x7f2824167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.385+0000 7f282b0e6700 1 --2- 172.21.15.80:0/989223850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28241094e0 0x7f2824167a10 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7f281c010420 tx=0x7f281c010280).stop 2019-11-28T11:26:00.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.386+0000 7f282b0e6700 1 -- 172.21.15.80:0/989223850 shutdown_connections 2019-11-28T11:26:00.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.386+0000 7f282b0e6700 1 --2- 172.21.15.80:0/989223850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28241094e0 0x7f2824167a10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:00.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.386+0000 7f282b0e6700 1 --2- 172.21.15.80:0/989223850 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2808018730 0x7f280801abc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:00.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.386+0000 7f282b0e6700 1 --2- 172.21.15.80:0/989223850 >> v2:172.21.15.174:3300/0 conn(0x7f282413dc00 0x7f2824109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:00.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.386+0000 7f282b0e6700 1 -- 172.21.15.80:0/989223850 shutdown_connections 2019-11-28T11:26:00.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.386+0000 7f282b0e6700 1 -- 172.21.15.80:0/989223850 wait complete. 2019-11-28T11:26:00.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.386+0000 7f282b0e6700 1 -- 172.21.15.80:0/989223850 >> 172.21.15.80:0/989223850 conn(0x7f282411bfc0 msgr2=0x7f2824141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:00.416 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2019-11-28T11:26:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.519+0000 7f511f45f700 1 Processor -- start 2019-11-28T11:26:00.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.520+0000 7f511f45f700 1 -- start start 2019-11-28T11:26:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.521+0000 7f511f45f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f511806c0a0 0x7f5118072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.521+0000 7f511f45f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51180734e0 0x7f5118071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.521+0000 7f511f45f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511806db00 con 0x7f5118072360 2019-11-28T11:26:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.521+0000 7f511f45f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511806fd60 con 0x7f511806c0a0 2019-11-28T11:26:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.521+0000 7f511f45f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5118070030 con 0x7f51180734e0 2019-11-28T11:26:00.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.521+0000 7f511d1fb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51180734e0 0x7f5118071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.521+0000 7f511d9fc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f511806c0a0 0x7f5118072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.521+0000 7f511d1fb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51180734e0 0x7f5118071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:34528/0 (socket says 172.21.15.80:34528) 2019-11-28T11:26:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.521+0000 7f511e1fd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f5118072360 0x7f511806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:47126/0 (socket says 172.21.15.80:47126) 2019-11-28T11:26:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.521+0000 7f511d1fb700 1 -- 172.21.15.80:0/2799136702 learned_addr learned my addr 172.21.15.80:0/2799136702 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.521+0000 7f511c9fa700 1 -- 172.21.15.80:0/2799136702 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711655632 0 0) 0x7f51100009b0 con 0x7f5118072360 2019-11-28T11:26:00.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.521+0000 7f511d1fb700 1 -- 172.21.15.80:0/2799136702 >> v2:172.21.15.174:3300/0 conn(0x7f511806c0a0 msgr2=0x7f5118072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.521+0000 7f511d1fb700 1 --2- 172.21.15.80:0/2799136702 >> v2:172.21.15.174:3300/0 conn(0x7f511806c0a0 0x7f5118072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.521+0000 7f511d1fb700 1 -- 172.21.15.80:0/2799136702 >> v1:172.21.15.174:6789/0 conn(0x7f5118072360 legacy=0x7f511806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.521+0000 7f511d1fb700 1 -- 172.21.15.80:0/2799136702 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51180706c0 con 0x7f51180734e0 2019-11-28T11:26:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.522+0000 7f511d9fc700 1 --2- 172.21.15.80:0/2799136702 >> v2:172.21.15.174:3300/0 conn(0x7f511806c0a0 0x7f5118072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.522+0000 7f511d1fb700 1 --2- 172.21.15.80:0/2799136702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51180734e0 0x7f5118071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f510000f740 tx=0x7f510000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.522+0000 7f511d1fb700 1 --2- 172.21.15.80:0/2799136702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51180734e0 0x7f5118071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f510000f740 tx=0x7f510000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.522+0000 7f511d1fb700 1 --2- 172.21.15.80:0/2799136702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51180734e0 0x7f5118071e20 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f510000f740 tx=0x7f510000fae0).ready entity=mon.2 client_cookie=47b61abdea544514 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.522+0000 7f511d1fb700 1 --2- 172.21.15.80:0/2799136702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51180734e0 0x7f5118071e20 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f510000f740 tx=0x7f510000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.522+0000 7f511c9fa700 1 -- 172.21.15.80:0/2799136702 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5100000960 con 0x7f51180734e0 2019-11-28T11:26:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.522+0000 7f511d1fb700 1 --2- 172.21.15.80:0/2799136702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51180734e0 0x7f5118071e20 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f510000f740 tx=0x7f510000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.522+0000 7f511d1fb700 1 --2- 172.21.15.80:0/2799136702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51180734e0 0x7f5118071e20 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f510000f740 tx=0x7f510000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.522+0000 7f511c9fa700 1 -- 172.21.15.80:0/2799136702 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5100000c90 con 0x7f51180734e0 2019-11-28T11:26:00.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.522+0000 7f511c9fa700 1 -- 172.21.15.80:0/2799136702 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51000013a0 con 0x7f51180734e0 2019-11-28T11:26:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.522+0000 7f511f45f700 1 -- 172.21.15.80:0/2799136702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51180734e0 msgr2=0x7f5118071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.522+0000 7f511f45f700 1 --2- 172.21.15.80:0/2799136702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51180734e0 0x7f5118071e20 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f510000f740 tx=0x7f510000fae0).stop 2019-11-28T11:26:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.523+0000 7f511f45f700 1 -- 172.21.15.80:0/2799136702 shutdown_connections 2019-11-28T11:26:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.523+0000 7f511f45f700 1 --2- 172.21.15.80:0/2799136702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51180734e0 0x7f5118071e20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.523+0000 7f511f45f700 1 --2- 172.21.15.80:0/2799136702 >> v2:172.21.15.174:3300/0 conn(0x7f511806c0a0 0x7f5118072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:00.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.523+0000 7f511f45f700 1 -- 172.21.15.80:0/2799136702 shutdown_connections 2019-11-28T11:26:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.523+0000 7f511f45f700 1 -- 172.21.15.80:0/2799136702 wait complete. 2019-11-28T11:26:00.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.523+0000 7f511f45f700 1 -- 172.21.15.80:0/2799136702 >> 172.21.15.80:0/2799136702 conn(0x7f5118061cf0 msgr2=0x7f5118064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.525+0000 7f511f45f700 1 Processor -- start 2019-11-28T11:26:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.525+0000 7f511f45f700 1 -- start start 2019-11-28T11:26:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.526+0000 7f511f45f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5118109e40 0x7f511810a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.526+0000 7f511f45f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511813f1e0 con 0x7f511810a810 2019-11-28T11:26:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.526+0000 7f511f45f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5118131a30 con 0x7f511813eb40 2019-11-28T11:26:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.526+0000 7f511f45f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51181234c0 con 0x7f5118109e40 2019-11-28T11:26:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.526+0000 7f511e1fd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f511810a810 0x7f5118105210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59822/0 (socket says 172.21.15.80:59822) 2019-11-28T11:26:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.526+0000 7f511e1fd700 1 -- 172.21.15.80:0/105271323 learned_addr learned my addr 172.21.15.80:0/105271323 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.526+0000 7f511d1fb700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5118109e40 0x7f511810a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f51167fc700 1 -- 172.21.15.80:0/105271323 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058662434 0 0) 0x7f5110001290 con 0x7f511810a810 2019-11-28T11:26:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f51167fc700 1 -- 172.21.15.80:0/105271323 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50fc002e80 con 0x7f511810a810 2019-11-28T11:26:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f51167fc700 1 -- 172.21.15.80:0/105271323 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132363691 0 0) 0x7f51080012b0 con 0x7f511813eb40 2019-11-28T11:26:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f51167fc700 1 -- 172.21.15.80:0/105271323 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50fc0030b0 con 0x7f511813eb40 2019-11-28T11:26:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f511d1fb700 1 -- 172.21.15.80:0/105271323 >> v1:172.21.15.174:6789/0 conn(0x7f511813eb40 legacy=0x7f511810afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f511d1fb700 1 -- 172.21.15.80:0/105271323 >> v1:172.21.15.80:6789/0 conn(0x7f511810a810 legacy=0x7f5118105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f511d1fb700 1 -- 172.21.15.80:0/105271323 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5118108700 con 0x7f5118109e40 2019-11-28T11:26:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f511d1fb700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5118109e40 0x7f511810a2d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51000103a0 tx=0x7f5100010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f511d1fb700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5118109e40 0x7f511810a2d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51000103a0 tx=0x7f5100010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f511d1fb700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5118109e40 0x7f511810a2d0 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f51000103a0 tx=0x7f5100010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f511d1fb700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5118109e40 0x7f511810a2d0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f51000103a0 tx=0x7f5100010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f51167fc700 1 -- 172.21.15.80:0/105271323 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5100000940 con 0x7f5118109e40 2019-11-28T11:26:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f511d1fb700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5118109e40 0x7f511810a2d0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f51000103a0 tx=0x7f5100010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f511d1fb700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5118109e40 0x7f511810a2d0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f51000103a0 tx=0x7f5100010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f51167fc700 1 -- 172.21.15.80:0/105271323 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5100000f50 con 0x7f5118109e40 2019-11-28T11:26:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f511f45f700 1 -- 172.21.15.80:0/105271323 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5118108a80 con 0x7f5118109e40 2019-11-28T11:26:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f51167fc700 1 -- 172.21.15.80:0/105271323 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5100001140 con 0x7f5118109e40 2019-11-28T11:26:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.527+0000 7f511f45f700 1 -- 172.21.15.80:0/105271323 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5118108700 con 0x7f5118109e40 2019-11-28T11:26:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.528+0000 7f511d1fb700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5118109e40 0x7f511810a2d0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f51000103a0 tx=0x7f5100010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.528+0000 7f51167fc700 1 -- 172.21.15.80:0/105271323 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5100000940 con 0x7f5118109e40 2019-11-28T11:26:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.528+0000 7f511d1fb700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5118109e40 0x7f511810a2d0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f51000103a0 tx=0x7f5100010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.528+0000 7f51167fc700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f50fc018750 0x7f50fc01ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.528+0000 7f51167fc700 1 -- 172.21.15.80:0/105271323 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f5100031d80 con 0x7f5118109e40 2019-11-28T11:26:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.528+0000 7f511d9fc700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f50fc018750 0x7f50fc01ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.528+0000 7f511d9fc700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f50fc018750 0x7f50fc01ac00 crc :-1 s=READY pgs=141 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.535+0000 7f511f45f700 1 -- 172.21.15.80:0/105271323 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5118108a80 con 0x7f5118109e40 2019-11-28T11:26:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.539+0000 7f511d1fb700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5118109e40 0x7f511810a2d0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f51000103a0 tx=0x7f5100010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.539+0000 7f51167fc700 1 -- 172.21.15.80:0/105271323 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5100000b50 con 0x7f5118109e40 2019-11-28T11:26:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.710+0000 7f511f45f700 1 -- 172.21.15.80:0/105271323 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f5118108700 con 0x7f5118109e40 2019-11-28T11:26:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.713+0000 7f511d1fb700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5118109e40 0x7f511810a2d0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f51000103a0 tx=0x7f5100010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.713+0000 7f51167fc700 1 -- 172.21.15.80:0/105271323 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5100000940 con 0x7f5118109e40 2019-11-28T11:26:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:updated 2019-11-28T11:26:00.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.719+0000 7f511f45f700 1 -- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f50fc018750 msgr2=0x7f50fc01ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.719+0000 7f511f45f700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f50fc018750 0x7f50fc01ac00 crc :-1 s=READY pgs=141 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.719+0000 7f511f45f700 1 -- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5118109e40 msgr2=0x7f511810a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.719+0000 7f511f45f700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5118109e40 0x7f511810a2d0 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f51000103a0 tx=0x7f5100010740).stop 2019-11-28T11:26:00.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.719+0000 7f511f45f700 1 -- 172.21.15.80:0/105271323 shutdown_connections 2019-11-28T11:26:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.719+0000 7f511f45f700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5118109e40 0x7f511810a2d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.719+0000 7f511f45f700 1 --2- 172.21.15.80:0/105271323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f50fc018750 0x7f50fc01ac00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.719+0000 7f511f45f700 1 -- 172.21.15.80:0/105271323 shutdown_connections 2019-11-28T11:26:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.719+0000 7f511f45f700 1 -- 172.21.15.80:0/105271323 wait complete. 2019-11-28T11:26:00.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.719+0000 7f511f45f700 1 -- 172.21.15.80:0/105271323 >> 172.21.15.80:0/105271323 conn(0x7f511811bfc0 msgr2=0x7f5118141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:00.749 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2019-11-28T11:26:00.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.851+0000 7f2dcbd3e700 1 Processor -- start 2019-11-28T11:26:00.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.851+0000 7f2dcbd3e700 1 -- start start 2019-11-28T11:26:00.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dcbd3e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2dc406c490 0x7f2dc406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:00.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dcbd3e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2dc406ce60 0x7f2dc4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:00.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dcbd3e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc406db00 con 0x7f2dc406c0a0 2019-11-28T11:26:00.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dcbd3e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc406fd60 con 0x7f2dc406c490 2019-11-28T11:26:00.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dcbd3e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc4070030 con 0x7f2dc406ce60 2019-11-28T11:26:00.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dc9ada700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2dc406c490 0x7f2dc406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:00.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dca2db700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2dc406c0a0 0x7f2dc4072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59826/0 (socket says 172.21.15.80:59826) 2019-11-28T11:26:00.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dc9ada700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2dc406c490 0x7f2dc406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60514/0 (socket says 172.21.15.80:60514) 2019-11-28T11:26:00.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dca2db700 1 -- 172.21.15.80:0/2929782558 learned_addr learned my addr 172.21.15.80:0/2929782558 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:00.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dcaadc700 1 --2- 172.21.15.80:0/2929782558 >> v2:172.21.15.174:3300/0 conn(0x7f2dc406ce60 0x7f2dc4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:00.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dc9ada700 1 -- 172.21.15.80:0/2929782558 >> v2:172.21.15.174:3300/0 conn(0x7f2dc406ce60 msgr2=0x7f2dc4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:00.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/2929782558 >> v2:172.21.15.174:3300/0 conn(0x7f2dc406ce60 0x7f2dc4164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:00.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dc9ada700 1 -- 172.21.15.80:0/2929782558 >> v1:172.21.15.80:6789/0 conn(0x7f2dc406c0a0 legacy=0x7f2dc4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dc9ada700 1 -- 172.21.15.80:0/2929782558 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc40706c0 con 0x7f2dc406c490 2019-11-28T11:26:00.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dc92d9700 1 -- 172.21.15.80:0/2929782558 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664954999 0 0) 0x7f2dac0014d0 con 0x7f2dc406c0a0 2019-11-28T11:26:00.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/2929782558 >> v2:172.21.15.80:3300/0 conn(0x7f2dc406c490 0x7f2dc406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2dbc00af50 tx=0x7f2dbc00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/2929782558 >> v2:172.21.15.80:3300/0 conn(0x7f2dc406c490 0x7f2dc406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2dbc00af50 tx=0x7f2dbc00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/2929782558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dc406c490 0x7f2dc406c920 secure :-1 s=READY pgs=324 cs=0 l=1 rx=0x7f2dbc00af50 tx=0x7f2dbc00b6e0).ready entity=mon.0 client_cookie=397c59643fb102d1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:00.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/2929782558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dc406c490 0x7f2dc406c920 secure :-1 s=THROTTLE_DONE pgs=324 cs=0 l=1 rx=0x7f2dbc00af50 tx=0x7f2dbc00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dc92d9700 1 -- 172.21.15.80:0/2929782558 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dbc007210 con 0x7f2dc406c490 2019-11-28T11:26:00.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.852+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/2929782558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dc406c490 0x7f2dc406c920 secure :-1 s=THROTTLE_DONE pgs=324 cs=0 l=1 rx=0x7f2dbc00af50 tx=0x7f2dbc00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.853+0000 7f2dc92d9700 1 -- 172.21.15.80:0/2929782558 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc0097c0 con 0x7f2dc406c490 2019-11-28T11:26:00.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.853+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/2929782558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dc406c490 0x7f2dc406c920 secure :-1 s=THROTTLE_DONE pgs=324 cs=0 l=1 rx=0x7f2dbc00af50 tx=0x7f2dbc00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.853+0000 7f2dc92d9700 1 -- 172.21.15.80:0/2929782558 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dbc0099b0 con 0x7f2dc406c490 2019-11-28T11:26:00.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.853+0000 7f2dcbd3e700 1 -- 172.21.15.80:0/2929782558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dc406c490 msgr2=0x7f2dc406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.853+0000 7f2dcbd3e700 1 --2- 172.21.15.80:0/2929782558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dc406c490 0x7f2dc406c920 secure :-1 s=READY pgs=324 cs=0 l=1 rx=0x7f2dbc00af50 tx=0x7f2dbc00b6e0).stop 2019-11-28T11:26:00.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.853+0000 7f2dcbd3e700 1 -- 172.21.15.80:0/2929782558 shutdown_connections 2019-11-28T11:26:00.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.853+0000 7f2dcbd3e700 1 --2- 172.21.15.80:0/2929782558 >> v2:172.21.15.174:3300/0 conn(0x7f2dc406ce60 0x7f2dc4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:00.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.853+0000 7f2dcbd3e700 1 --2- 172.21.15.80:0/2929782558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dc406c490 0x7f2dc406c920 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:00.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.853+0000 7f2dcbd3e700 1 -- 172.21.15.80:0/2929782558 shutdown_connections 2019-11-28T11:26:00.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.853+0000 7f2dcbd3e700 1 -- 172.21.15.80:0/2929782558 wait complete. 2019-11-28T11:26:00.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.853+0000 7f2dcbd3e700 1 -- 172.21.15.80:0/2929782558 >> 172.21.15.80:0/2929782558 conn(0x7f2dc4061cf0 msgr2=0x7f2dc4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:00.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.856+0000 7f2dcbd3e700 1 Processor -- start 2019-11-28T11:26:00.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.856+0000 7f2dcbd3e700 1 -- start start 2019-11-28T11:26:00.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dcbd3e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2dc41281b0 0x7f2dc4128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:00.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dcbd3e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2dc4128b80 0x7f2dc4167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:00.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dcbd3e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc4139a60 con 0x7f2dc413a780 2019-11-28T11:26:00.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dcbd3e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc412a260 con 0x7f2dc41281b0 2019-11-28T11:26:00.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dcbd3e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc412a530 con 0x7f2dc4128b80 2019-11-28T11:26:00.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dca2db700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2dc413a780 0x7f2dc412d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59832/0 (socket says 172.21.15.80:59832) 2019-11-28T11:26:00.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dca2db700 1 -- 172.21.15.80:0/355079318 learned_addr learned my addr 172.21.15.80:0/355079318 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:00.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/355079318 >> v2:172.21.15.174:3300/0 conn(0x7f2dc41281b0 0x7f2dc4128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:00.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dcaadc700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2dc4128b80 0x7f2dc4167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:00.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dc2ffd700 1 -- 172.21.15.80:0/355079318 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3624526140 0 0) 0x7f2dac0014d0 con 0x7f2dc413a780 2019-11-28T11:26:00.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dc2ffd700 1 -- 172.21.15.80:0/355079318 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da8002e80 con 0x7f2dc413a780 2019-11-28T11:26:00.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dc9ada700 1 -- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2dc4128b80 msgr2=0x7f2dc4167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2dc4128b80 0x7f2dc4167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:00.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dc2ffd700 1 -- 172.21.15.80:0/355079318 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2426834048 0 0) 0x7f2dac001680 con 0x7f2dc413a780 2019-11-28T11:26:00.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dc9ada700 1 -- 172.21.15.80:0/355079318 >> v1:172.21.15.80:6789/0 conn(0x7f2dc413a780 legacy=0x7f2dc412d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:00.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dc9ada700 1 -- 172.21.15.80:0/355079318 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc412abc0 con 0x7f2dc41281b0 2019-11-28T11:26:00.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dcaadc700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2dc4128b80 0x7f2dc4167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:00.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/355079318 >> v2:172.21.15.174:3300/0 conn(0x7f2dc41281b0 0x7f2dc4128640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2dbc0543b0 tx=0x7f2dbc054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/355079318 >> v2:172.21.15.174:3300/0 conn(0x7f2dc41281b0 0x7f2dc4128640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2dbc0543b0 tx=0x7f2dbc054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.857+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2dc41281b0 0x7f2dc4128640 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f2dbc0543b0 tx=0x7f2dbc054750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:00.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.858+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2dc41281b0 0x7f2dc4128640 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2dbc0543b0 tx=0x7f2dbc054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.858+0000 7f2dc2ffd700 1 -- 172.21.15.80:0/355079318 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dbc00af60 con 0x7f2dc41281b0 2019-11-28T11:26:00.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.858+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2dc41281b0 0x7f2dc4128640 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2dbc0543b0 tx=0x7f2dbc054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.858+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2dc41281b0 0x7f2dc4128640 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2dbc0543b0 tx=0x7f2dbc054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.858+0000 7f2dc2ffd700 1 -- 172.21.15.80:0/355079318 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc009580 con 0x7f2dc41281b0 2019-11-28T11:26:00.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.858+0000 7f2dc2ffd700 1 -- 172.21.15.80:0/355079318 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dbc009c50 con 0x7f2dc41281b0 2019-11-28T11:26:00.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.858+0000 7f2dcbd3e700 1 -- 172.21.15.80:0/355079318 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc412af40 con 0x7f2dc41281b0 2019-11-28T11:26:00.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.858+0000 7f2dcbd3e700 1 -- 172.21.15.80:0/355079318 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc412abc0 con 0x7f2dc41281b0 2019-11-28T11:26:00.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.858+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2dc41281b0 0x7f2dc4128640 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2dbc0543b0 tx=0x7f2dbc054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.858+0000 7f2dc2ffd700 1 -- 172.21.15.80:0/355079318 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2dbc00abb0 con 0x7f2dc41281b0 2019-11-28T11:26:00.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.858+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2dc41281b0 0x7f2dc4128640 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2dbc0543b0 tx=0x7f2dbc054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.858+0000 7f2dc2ffd700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2da8018780 0x7f2da801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:00.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.858+0000 7f2dc2ffd700 1 -- 172.21.15.80:0/355079318 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f2dbc075a30 con 0x7f2dc41281b0 2019-11-28T11:26:00.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.859+0000 7f2dca2db700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2da8018780 0x7f2da801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:00.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.859+0000 7f2dca2db700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2da8018780 0x7f2da801abf0 crc :-1 s=READY pgs=142 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:00.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.866+0000 7f2dcbd3e700 1 -- 172.21.15.80:0/355079318 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc412af40 con 0x7f2dc41281b0 2019-11-28T11:26:00.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.870+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2dc41281b0 0x7f2dc4128640 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2dbc0543b0 tx=0x7f2dbc054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:00.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:00.870+0000 7f2dc2ffd700 1 -- 172.21.15.80:0/355079318 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2dbc068fa0 con 0x7f2dc41281b0 2019-11-28T11:26:01.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.040+0000 7f2dcbd3e700 1 -- 172.21.15.80:0/355079318 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f2dc412abc0 con 0x7f2dc41281b0 2019-11-28T11:26:01.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.044+0000 7f2dc9ada700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2dc41281b0 0x7f2dc4128640 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2dbc0543b0 tx=0x7f2dbc054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.044+0000 7f2dc2ffd700 1 -- 172.21.15.80:0/355079318 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2dbc068fa0 con 0x7f2dc41281b0 2019-11-28T11:26:01.068 INFO:teuthology.orchestra.run.smithi080.stderr:updated 2019-11-28T11:26:01.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.049+0000 7f2dcbd3e700 1 -- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2da8018780 msgr2=0x7f2da801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.049+0000 7f2dcbd3e700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2da8018780 0x7f2da801abf0 crc :-1 s=READY pgs=142 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.049+0000 7f2dcbd3e700 1 -- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2dc41281b0 msgr2=0x7f2dc4128640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.049+0000 7f2dcbd3e700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2dc41281b0 0x7f2dc4128640 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f2dbc0543b0 tx=0x7f2dbc054750).stop 2019-11-28T11:26:01.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.050+0000 7f2dcbd3e700 1 -- 172.21.15.80:0/355079318 shutdown_connections 2019-11-28T11:26:01.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.050+0000 7f2dcbd3e700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2da8018780 0x7f2da801abf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.050+0000 7f2dcbd3e700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2dc4128b80 0x7f2dc4167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.050+0000 7f2dcbd3e700 1 --2- 172.21.15.80:0/355079318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2dc41281b0 0x7f2dc4128640 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.050+0000 7f2dcbd3e700 1 -- 172.21.15.80:0/355079318 shutdown_connections 2019-11-28T11:26:01.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.050+0000 7f2dcbd3e700 1 -- 172.21.15.80:0/355079318 wait complete. 2019-11-28T11:26:01.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.050+0000 7f2dcbd3e700 1 -- 172.21.15.80:0/355079318 >> 172.21.15.80:0/355079318 conn(0x7f2dc4127dc0 msgr2=0x7f2dc4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:01.080 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:26:01.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.178+0000 7fd02157f700 1 Processor -- start 2019-11-28T11:26:01.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.178+0000 7fd02157f700 1 -- start start 2019-11-28T11:26:01.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.179+0000 7fd02157f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd01c06c490 0x7fd01c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:01.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.179+0000 7fd02157f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd01c06ce60 0x7fd01c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:01.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.179+0000 7fd02157f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01c06db00 con 0x7fd01c06c0a0 2019-11-28T11:26:01.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.179+0000 7fd02157f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01c06fd60 con 0x7fd01c06ce60 2019-11-28T11:26:01.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.179+0000 7fd02157f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01c070030 con 0x7fd01c06c490 2019-11-28T11:26:01.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd01c06ce60 0x7fd01c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd01c06ce60 0x7fd01c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60528/0 (socket says 172.21.15.80:60528) 2019-11-28T11:26:01.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01bfff700 1 -- 172.21.15.80:0/1600278296 learned_addr learned my addr 172.21.15.80:0/1600278296 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:01.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01affd700 1 --2- 172.21.15.80:0/1600278296 >> v2:172.21.15.174:3300/0 conn(0x7fd01c06c490 0x7fd01c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01bfff700 1 -- 172.21.15.80:0/1600278296 >> v2:172.21.15.174:3300/0 conn(0x7fd01c06c490 msgr2=0x7fd01c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:01.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01bfff700 1 --2- 172.21.15.80:0/1600278296 >> v2:172.21.15.174:3300/0 conn(0x7fd01c06c490 0x7fd01c06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:01.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01bfff700 1 -- 172.21.15.80:0/1600278296 >> v1:172.21.15.174:6789/0 conn(0x7fd01c06c0a0 legacy=0x7fd01c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01bfff700 1 -- 172.21.15.80:0/1600278296 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c0706c0 con 0x7fd01c06ce60 2019-11-28T11:26:01.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01bfff700 1 --2- 172.21.15.80:0/1600278296 >> v2:172.21.15.80:3300/0 conn(0x7fd01c06ce60 0x7fd01c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd00c00f6b0 tx=0x7fd00c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01bfff700 1 --2- 172.21.15.80:0/1600278296 >> v2:172.21.15.80:3300/0 conn(0x7fd01c06ce60 0x7fd01c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd00c00f6b0 tx=0x7fd00c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01bfff700 1 --2- 172.21.15.80:0/1600278296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd01c06ce60 0x7fd01c164d70 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7fd00c00f6b0 tx=0x7fd00c00fa50).ready entity=mon.0 client_cookie=d131d5f978e9edb1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:01.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01bfff700 1 --2- 172.21.15.80:0/1600278296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd01c06ce60 0x7fd01c164d70 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7fd00c00f6b0 tx=0x7fd00c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01bfff700 1 --2- 172.21.15.80:0/1600278296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd01c06ce60 0x7fd01c164d70 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7fd00c00f6b0 tx=0x7fd00c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01a7fc700 1 -- 172.21.15.80:0/1600278296 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd00c000a70 con 0x7fd01c06ce60 2019-11-28T11:26:01.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01bfff700 1 --2- 172.21.15.80:0/1600278296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd01c06ce60 0x7fd01c164d70 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7fd00c00f6b0 tx=0x7fd00c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01a7fc700 1 -- 172.21.15.80:0/1600278296 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c0010e0 con 0x7fd01c06ce60 2019-11-28T11:26:01.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd01a7fc700 1 -- 172.21.15.80:0/1600278296 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd00c0017b0 con 0x7fd01c06ce60 2019-11-28T11:26:01.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd02157f700 1 -- 172.21.15.80:0/1600278296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd01c06ce60 msgr2=0x7fd01c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.180+0000 7fd02157f700 1 --2- 172.21.15.80:0/1600278296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd01c06ce60 0x7fd01c164d70 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7fd00c00f6b0 tx=0x7fd00c00fa50).stop 2019-11-28T11:26:01.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.181+0000 7fd02157f700 1 -- 172.21.15.80:0/1600278296 shutdown_connections 2019-11-28T11:26:01.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.181+0000 7fd02157f700 1 --2- 172.21.15.80:0/1600278296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd01c06ce60 0x7fd01c164d70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.181+0000 7fd02157f700 1 --2- 172.21.15.80:0/1600278296 >> v2:172.21.15.174:3300/0 conn(0x7fd01c06c490 0x7fd01c06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:01.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.181+0000 7fd02157f700 1 -- 172.21.15.80:0/1600278296 shutdown_connections 2019-11-28T11:26:01.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.181+0000 7fd02157f700 1 -- 172.21.15.80:0/1600278296 wait complete. 2019-11-28T11:26:01.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.181+0000 7fd02157f700 1 -- 172.21.15.80:0/1600278296 >> 172.21.15.80:0/1600278296 conn(0x7fd01c061cf0 msgr2=0x7fd01c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:01.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.183+0000 7fd02157f700 1 Processor -- start 2019-11-28T11:26:01.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.184+0000 7fd02157f700 1 -- start start 2019-11-28T11:26:01.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.184+0000 7fd02157f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd01c13dc00 0x7fd01c109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:01.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.184+0000 7fd02157f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd01c10a3a0 0x7fd01c108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:01.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd02157f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01c1312c0 con 0x7fd01c109220 2019-11-28T11:26:01.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd02157f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01c104e00 con 0x7fd01c10a3a0 2019-11-28T11:26:01.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd02157f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c105830 con 0x7fd01c13dc00 2019-11-28T11:26:01.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd01bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd01c109220 0x7fd01c103000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59850/0 (socket says 172.21.15.80:59850) 2019-11-28T11:26:01.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd01bfff700 1 -- 172.21.15.80:0/1122921854 learned_addr learned my addr 172.21.15.80:0/1122921854 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:01.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd01affd700 1 --2- 172.21.15.80:0/1122921854 >> v2:172.21.15.174:3300/0 conn(0x7fd01c10a3a0 0x7fd01c108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd01b7fe700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd01c13dc00 0x7fd01c109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd013fff700 1 -- 172.21.15.80:0/1122921854 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041445189 0 0) 0x7fd00c000940 con 0x7fd01c109220 2019-11-28T11:26:01.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd013fff700 1 -- 172.21.15.80:0/1122921854 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd000002e80 con 0x7fd01c109220 2019-11-28T11:26:01.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd01affd700 1 -- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd01c13dc00 msgr2=0x7fd01c109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd01affd700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd01c13dc00 0x7fd01c109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd01affd700 1 -- 172.21.15.80:0/1122921854 >> v1:172.21.15.80:6789/0 conn(0x7fd01c109220 legacy=0x7fd01c103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd01affd700 1 -- 172.21.15.80:0/1122921854 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c106190 con 0x7fd01c10a3a0 2019-11-28T11:26:01.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd01affd700 1 --2- 172.21.15.80:0/1122921854 >> v2:172.21.15.174:3300/0 conn(0x7fd01c10a3a0 0x7fd01c108ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd014010730 tx=0x7fd014010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd01affd700 1 --2- 172.21.15.80:0/1122921854 >> v2:172.21.15.174:3300/0 conn(0x7fd01c10a3a0 0x7fd01c108ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd014010730 tx=0x7fd014010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd01affd700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01c10a3a0 0x7fd01c108ce0 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7fd014010730 tx=0x7fd014010530).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:01.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd01affd700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01c10a3a0 0x7fd01c108ce0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fd014010730 tx=0x7fd014010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd013fff700 1 -- 172.21.15.80:0/1122921854 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd014000cc0 con 0x7fd01c10a3a0 2019-11-28T11:26:01.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd01affd700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01c10a3a0 0x7fd01c108ce0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fd014010730 tx=0x7fd014010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd01affd700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01c10a3a0 0x7fd01c108ce0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fd014010730 tx=0x7fd014010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd013fff700 1 -- 172.21.15.80:0/1122921854 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd014005900 con 0x7fd01c10a3a0 2019-11-28T11:26:01.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd02157f700 1 -- 172.21.15.80:0/1122921854 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd01c106510 con 0x7fd01c10a3a0 2019-11-28T11:26:01.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd013fff700 1 -- 172.21.15.80:0/1122921854 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd014006010 con 0x7fd01c10a3a0 2019-11-28T11:26:01.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.185+0000 7fd02157f700 1 -- 172.21.15.80:0/1122921854 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01c106190 con 0x7fd01c10a3a0 2019-11-28T11:26:01.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.186+0000 7fd01affd700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01c10a3a0 0x7fd01c108ce0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fd014010730 tx=0x7fd014010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.186+0000 7fd013fff700 1 -- 172.21.15.80:0/1122921854 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd0140055a0 con 0x7fd01c10a3a0 2019-11-28T11:26:01.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.186+0000 7fd01affd700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01c10a3a0 0x7fd01c108ce0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fd014010730 tx=0x7fd014010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.186+0000 7fd013fff700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd000018770 0x7fd00001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:01.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.186+0000 7fd013fff700 1 -- 172.21.15.80:0/1122921854 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fd014031da0 con 0x7fd01c10a3a0 2019-11-28T11:26:01.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.186+0000 7fd01b7fe700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd000018770 0x7fd00001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.186+0000 7fd01b7fe700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd000018770 0x7fd00001abe0 crc :-1 s=READY pgs=143 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:01.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.194+0000 7fd02157f700 1 -- 172.21.15.80:0/1122921854 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01c106510 con 0x7fd01c10a3a0 2019-11-28T11:26:01.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.197+0000 7fd01affd700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01c10a3a0 0x7fd01c108ce0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fd014010730 tx=0x7fd014010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.197+0000 7fd013fff700 1 -- 172.21.15.80:0/1122921854 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd014000cc0 con 0x7fd01c10a3a0 2019-11-28T11:26:01.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.374+0000 7fd02157f700 1 -- 172.21.15.80:0/1122921854 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd01c106190 con 0x7fd01c10a3a0 2019-11-28T11:26:01.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.375+0000 7fd01affd700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01c10a3a0 0x7fd01c108ce0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fd014010730 tx=0x7fd014010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.375+0000 7fd013fff700 1 -- 172.21.15.80:0/1122921854 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12000 (secure 0 0 0) 0x7fd014005500 con 0x7fd01c10a3a0 2019-11-28T11:26:01.398 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:01.398 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":31,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:25:58.633308+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:26:01.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.379+0000 7fd02157f700 1 -- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd000018770 msgr2=0x7fd00001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.379+0000 7fd02157f700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd000018770 0x7fd00001abe0 crc :-1 s=READY pgs=143 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.379+0000 7fd02157f700 1 -- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01c10a3a0 msgr2=0x7fd01c108ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.379+0000 7fd02157f700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01c10a3a0 0x7fd01c108ce0 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7fd014010730 tx=0x7fd014010530).stop 2019-11-28T11:26:01.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.379+0000 7fd02157f700 1 -- 172.21.15.80:0/1122921854 shutdown_connections 2019-11-28T11:26:01.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.379+0000 7fd02157f700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd000018770 0x7fd00001abe0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.379+0000 7fd02157f700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01c10a3a0 0x7fd01c108ce0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.379+0000 7fd02157f700 1 --2- 172.21.15.80:0/1122921854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd01c13dc00 0x7fd01c109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.380+0000 7fd02157f700 1 -- 172.21.15.80:0/1122921854 shutdown_connections 2019-11-28T11:26:01.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.380+0000 7fd02157f700 1 -- 172.21.15.80:0/1122921854 wait complete. 2019-11-28T11:26:01.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.380+0000 7fd02157f700 1 -- 172.21.15.80:0/1122921854 >> 172.21.15.80:0/1122921854 conn(0x7fd01c11bfc0 msgr2=0x7fd01c141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:01.411 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:26:01.411 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:26:01.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.515+0000 7fbe199ad700 1 Processor -- start 2019-11-28T11:26:01.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.515+0000 7fbe199ad700 1 -- start start 2019-11-28T11:26:01.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.516+0000 7fbe199ad700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbe1415ed10 0x7fbe1415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:01.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.516+0000 7fbe199ad700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe14073020 0x7fbe14071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:01.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.516+0000 7fbe199ad700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1406db60 con 0x7fbe140734b0 2019-11-28T11:26:01.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.516+0000 7fbe199ad700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1406fe00 con 0x7fbe1415ed10 2019-11-28T11:26:01.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.516+0000 7fbe199ad700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe140700d0 con 0x7fbe14073020 2019-11-28T11:26:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.516+0000 7fbe12ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe14073020 0x7fbe14071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.516+0000 7fbe137fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbe1415ed10 0x7fbe1415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.516+0000 7fbe137fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbe1415ed10 0x7fbe1415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:47192/0 (socket says 172.21.15.80:47192) 2019-11-28T11:26:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.516+0000 7fbe12ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe14073020 0x7fbe14071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:34570/0 (socket says 172.21.15.80:34570) 2019-11-28T11:26:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.516+0000 7fbe13fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fbe140734b0 0x7fbe140723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:47168/0 (socket says 172.21.15.80:47168) 2019-11-28T11:26:01.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.516+0000 7fbe137fe700 1 -- 172.21.15.80:0/453862031 learned_addr learned my addr 172.21.15.80:0/453862031 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:01.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe12ffd700 1 -- 172.21.15.80:0/453862031 >> v2:172.21.15.174:3300/0 conn(0x7fbe1415ed10 msgr2=0x7fbe1415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:01.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe127fc700 1 -- 172.21.15.80:0/453862031 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684674102 0 0) 0x7fbe0c0009b0 con 0x7fbe140734b0 2019-11-28T11:26:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe12ffd700 1 --2- 172.21.15.80:0/453862031 >> v2:172.21.15.174:3300/0 conn(0x7fbe1415ed10 0x7fbe1415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe12ffd700 1 -- 172.21.15.80:0/453862031 >> v1:172.21.15.174:6789/0 conn(0x7fbe140734b0 legacy=0x7fbe140723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe12ffd700 1 -- 172.21.15.80:0/453862031 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe14070760 con 0x7fbe14073020 2019-11-28T11:26:01.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe137fe700 1 --2- 172.21.15.80:0/453862031 >> v2:172.21.15.174:3300/0 conn(0x7fbe1415ed10 0x7fbe1415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:01.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe12ffd700 1 --2- 172.21.15.80:0/453862031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe14073020 0x7fbe14071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbdfc00b2d0 tx=0x7fbdfc00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe12ffd700 1 --2- 172.21.15.80:0/453862031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe14073020 0x7fbe14071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbdfc00b2d0 tx=0x7fbdfc00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe12ffd700 1 --2- 172.21.15.80:0/453862031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe14073020 0x7fbe14071ea0 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fbdfc00b2d0 tx=0x7fbdfc00bae0).ready entity=mon.2 client_cookie=3c0b034f7de1645e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:01.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe12ffd700 1 --2- 172.21.15.80:0/453862031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe14073020 0x7fbe14071ea0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbdfc00b2d0 tx=0x7fbdfc00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe127fc700 1 -- 172.21.15.80:0/453862031 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdfc007590 con 0x7fbe14073020 2019-11-28T11:26:01.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe12ffd700 1 --2- 172.21.15.80:0/453862031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe14073020 0x7fbe14071ea0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbdfc00b2d0 tx=0x7fbdfc00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe127fc700 1 -- 172.21.15.80:0/453862031 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc009d30 con 0x7fbe14073020 2019-11-28T11:26:01.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe12ffd700 1 --2- 172.21.15.80:0/453862031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe14073020 0x7fbe14071ea0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbdfc00b2d0 tx=0x7fbdfc00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe127fc700 1 -- 172.21.15.80:0/453862031 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdfc007590 con 0x7fbe14073020 2019-11-28T11:26:01.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe199ad700 1 -- 172.21.15.80:0/453862031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe14073020 msgr2=0x7fbe14071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.517+0000 7fbe199ad700 1 --2- 172.21.15.80:0/453862031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe14073020 0x7fbe14071ea0 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fbdfc00b2d0 tx=0x7fbdfc00bae0).stop 2019-11-28T11:26:01.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.518+0000 7fbe199ad700 1 -- 172.21.15.80:0/453862031 shutdown_connections 2019-11-28T11:26:01.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.518+0000 7fbe199ad700 1 --2- 172.21.15.80:0/453862031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe14073020 0x7fbe14071ea0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.518+0000 7fbe199ad700 1 --2- 172.21.15.80:0/453862031 >> v2:172.21.15.174:3300/0 conn(0x7fbe1415ed10 0x7fbe1415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:01.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.518+0000 7fbe199ad700 1 -- 172.21.15.80:0/453862031 shutdown_connections 2019-11-28T11:26:01.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.518+0000 7fbe199ad700 1 -- 172.21.15.80:0/453862031 wait complete. 2019-11-28T11:26:01.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.518+0000 7fbe199ad700 1 -- 172.21.15.80:0/453862031 >> 172.21.15.80:0/453862031 conn(0x7fbe14061d20 msgr2=0x7fbe140641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:01.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.520+0000 7fbe199ad700 1 Processor -- start 2019-11-28T11:26:01.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.520+0000 7fbe199ad700 1 -- start start 2019-11-28T11:26:01.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.521+0000 7fbe199ad700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe1410e970 0x7fbe141087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:01.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.521+0000 7fbe199ad700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbe14107e30 0x7fbe14167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:01.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.521+0000 7fbe199ad700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1410c250 con 0x7fbe14108cf0 2019-11-28T11:26:01.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.521+0000 7fbe199ad700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1410da00 con 0x7fbe14107e30 2019-11-28T11:26:01.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.521+0000 7fbe199ad700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1410e430 con 0x7fbe1410e970 2019-11-28T11:26:01.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.521+0000 7fbe12ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbe14108cf0 0x7fbe14107630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59862/0 (socket says 172.21.15.80:59862) 2019-11-28T11:26:01.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.521+0000 7fbe12ffd700 1 -- 172.21.15.80:0/1357671864 learned_addr learned my addr 172.21.15.80:0/1357671864 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:01.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.521+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89426421 0 0) 0x7fbdfc009900 con 0x7fbe14108cf0 2019-11-28T11:26:01.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe13fff700 1 --2- 172.21.15.80:0/1357671864 >> v2:172.21.15.174:3300/0 conn(0x7fbe14107e30 0x7fbe14167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdec002e80 con 0x7fbe14108cf0 2019-11-28T11:26:01.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe137fe700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe1410e970 0x7fbe141087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3356447479 0 0) 0x7fbdfc009900 con 0x7fbe14108cf0 2019-11-28T11:26:01.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbdec0032e0 con 0x7fbe14108cf0 2019-11-28T11:26:01.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fbdfc009e90 con 0x7fbe14108cf0 2019-11-28T11:26:01.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe1410e970 msgr2=0x7fbe141087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe0bfff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe1410e970 0x7fbe141087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 >> v2:172.21.15.174:3300/0 conn(0x7fbe14107e30 msgr2=0x7fbe14167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe0bfff700 1 --2- 172.21.15.80:0/1357671864 >> v2:172.21.15.174:3300/0 conn(0x7fbe14107e30 0x7fbe14167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 >> v1:172.21.15.80:6789/0 conn(0x7fbe14108cf0 legacy=0x7fbe14107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe0bfff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdec0038b0 0x7fbdec003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:01.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe0bfff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdec004200 0x7fbdec004670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:01.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe0bfff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdec004c00 0x7fbdec00b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:01.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec005370 con 0x7fbdec004c00 2019-11-28T11:26:01.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec00bd30 con 0x7fbdec0038b0 2019-11-28T11:26:01.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec00bf60 con 0x7fbdec004200 2019-11-28T11:26:01.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe13fff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdec004c00 0x7fbdec00b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe137fe700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdec0038b0 0x7fbdec003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe12ffd700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdec004200 0x7fbdec004670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe13fff700 1 -- 172.21.15.80:0/1357671864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdec004200 msgr2=0x7fbdec004670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe13fff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdec004200 0x7fbdec004670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe13fff700 1 -- 172.21.15.80:0/1357671864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdec0038b0 msgr2=0x7fbdec003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe13fff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdec0038b0 0x7fbdec003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe13fff700 1 -- 172.21.15.80:0/1357671864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec00c210 con 0x7fbdec004c00 2019-11-28T11:26:01.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe199ad700 1 -- 172.21.15.80:0/1357671864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe14106270 con 0x7fbdec004c00 2019-11-28T11:26:01.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe13fff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdec004c00 0x7fbdec00b780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbe0c0105c0 tx=0x7fbe0c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe199ad700 1 -- 172.21.15.80:0/1357671864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe14105ef0 con 0x7fbdec004c00 2019-11-28T11:26:01.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe13fff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdec004c00 0x7fbdec00b780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbe0c0105c0 tx=0x7fbe0c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.522+0000 7fbe13fff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdec004c00 0x7fbdec00b780 secure :-1 s=READY pgs=329 cs=0 l=1 rx=0x7fbe0c0105c0 tx=0x7fbe0c010470).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:01.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.523+0000 7fbe13fff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdec004c00 0x7fbdec00b780 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7fbe0c0105c0 tx=0x7fbe0c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.523+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe0c000940 con 0x7fbdec004c00 2019-11-28T11:26:01.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.523+0000 7fbe13fff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdec004c00 0x7fbdec00b780 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7fbe0c0105c0 tx=0x7fbe0c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.523+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c009770 con 0x7fbdec004c00 2019-11-28T11:26:01.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.523+0000 7fbe13fff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdec004c00 0x7fbdec00b780 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7fbe0c0105c0 tx=0x7fbe0c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.523+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe0c009960 con 0x7fbdec004c00 2019-11-28T11:26:01.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.523+0000 7fbe13fff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdec004c00 0x7fbdec00b780 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7fbe0c0105c0 tx=0x7fbe0c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.523+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbe0c009960 con 0x7fbdec004c00 2019-11-28T11:26:01.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.523+0000 7fbe13fff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdec004c00 0x7fbdec00b780 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7fbe0c0105c0 tx=0x7fbe0c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.523+0000 7fbe0bfff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdec020b20 0x7fbdec022f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:01.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.523+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fbe0c031e50 con 0x7fbdec004c00 2019-11-28T11:26:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.523+0000 7fbe137fe700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdec020b20 0x7fbdec022f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.524+0000 7fbe137fe700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdec020b20 0x7fbdec022f50 crc :-1 s=READY pgs=144 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.530+0000 7fbe199ad700 1 -- 172.21.15.80:0/1357671864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf0002e60 con 0x7fbdec004c00 2019-11-28T11:26:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.534+0000 7fbe13fff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdec004c00 0x7fbdec00b780 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7fbe0c0105c0 tx=0x7fbe0c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.534+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbe0c0092a0 con 0x7fbdec004c00 2019-11-28T11:26:01.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.703+0000 7fbe199ad700 1 -- 172.21.15.80:0/1357671864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fbdf0001d20 con 0x7fbdec004c00 2019-11-28T11:26:01.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.703+0000 7fbe13fff700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdec004c00 0x7fbdec00b780 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7fbe0c0105c0 tx=0x7fbe0c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.703+0000 7fbe0bfff700 1 -- 172.21.15.80:0/1357671864 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbe0c009750 con 0x7fbdec004c00 2019-11-28T11:26:01.726 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:26:01.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.706+0000 7fbe199ad700 1 -- 172.21.15.80:0/1357671864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdec020b20 msgr2=0x7fbdec022f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.706+0000 7fbe199ad700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdec020b20 0x7fbdec022f50 crc :-1 s=READY pgs=144 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.706+0000 7fbe199ad700 1 -- 172.21.15.80:0/1357671864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdec004c00 msgr2=0x7fbdec00b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.706+0000 7fbe199ad700 1 --2- 172.21.15.80:0/1357671864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdec004c00 0x7fbdec00b780 secure :-1 s=READY pgs=329 cs=0 l=1 rx=0x7fbe0c0105c0 tx=0x7fbe0c010470).stop 2019-11-28T11:26:01.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.706+0000 7fbe13fff700 1 -- 172.21.15.80:0/1357671864 reap_dead start 2019-11-28T11:26:01.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.706+0000 7fbe13fff700 1 -- 172.21.15.80:0/1357671864 reap_dead start 2019-11-28T11:26:01.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.706+0000 7fbe199ad700 1 -- 172.21.15.80:0/1357671864 shutdown_connections 2019-11-28T11:26:01.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.706+0000 7fbe199ad700 1 -- 172.21.15.80:0/1357671864 shutdown_connections 2019-11-28T11:26:01.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.706+0000 7fbe199ad700 1 -- 172.21.15.80:0/1357671864 wait complete. 2019-11-28T11:26:01.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.706+0000 7fbe199ad700 1 -- 172.21.15.80:0/1357671864 >> 172.21.15.80:0/1357671864 conn(0x7fbe1415e2d0 msgr2=0x7fbe14147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:01.738 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:26:01.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.837+0000 7f3dac4ed700 1 Processor -- start 2019-11-28T11:26:01.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.837+0000 7f3dac4ed700 1 -- start start 2019-11-28T11:26:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.838+0000 7f3dac4ed700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3da406c0a0 0x7f3da4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.838+0000 7f3dac4ed700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da406db00 con 0x7f3da40734e0 2019-11-28T11:26:01.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.838+0000 7f3dac4ed700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da406e000 con 0x7f3da4072620 2019-11-28T11:26:01.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.838+0000 7f3dac4ed700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da406fd60 con 0x7f3da406c0a0 2019-11-28T11:26:01.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.838+0000 7f3daaa8a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3da406c0a0 0x7f3da4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.838+0000 7f3daaa8a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3da406c0a0 0x7f3da4072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60558/0 (socket says 172.21.15.80:60558) 2019-11-28T11:26:01.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.838+0000 7f3daa289700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3da40734e0 0x7f3da4071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59874/0 (socket says 172.21.15.80:59874) 2019-11-28T11:26:01.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.838+0000 7f3daaa8a700 1 -- 172.21.15.80:0/2417378174 learned_addr learned my addr 172.21.15.80:0/2417378174 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:01.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.838+0000 7f3daaa8a700 1 -- 172.21.15.80:0/2417378174 >> v1:172.21.15.174:6789/0 conn(0x7f3da4072620 legacy=0x7f3da4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.838+0000 7f3daaa8a700 1 -- 172.21.15.80:0/2417378174 >> v1:172.21.15.80:6789/0 conn(0x7f3da40734e0 legacy=0x7f3da4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.838+0000 7f3da9a88700 1 -- 172.21.15.80:0/2417378174 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223786769 0 0) 0x7f3da0001100 con 0x7f3da40734e0 2019-11-28T11:26:01.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.838+0000 7f3daaa8a700 1 -- 172.21.15.80:0/2417378174 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da40706c0 con 0x7f3da406c0a0 2019-11-28T11:26:01.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.838+0000 7f3daaa8a700 1 --2- 172.21.15.80:0/2417378174 >> v2:172.21.15.80:3300/0 conn(0x7f3da406c0a0 0x7f3da4072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3d94008400 tx=0x7f3d9400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.838+0000 7f3daaa8a700 1 --2- 172.21.15.80:0/2417378174 >> v2:172.21.15.80:3300/0 conn(0x7f3da406c0a0 0x7f3da4072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3d94008400 tx=0x7f3d9400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.838+0000 7f3daaa8a700 1 --2- 172.21.15.80:0/2417378174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da406c0a0 0x7f3da4072fa0 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7f3d94008400 tx=0x7f3d9400fad0).ready entity=mon.0 client_cookie=7be77797431cdfa2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:01.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.839+0000 7f3daaa8a700 1 --2- 172.21.15.80:0/2417378174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da406c0a0 0x7f3da4072fa0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f3d94008400 tx=0x7f3d9400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.839+0000 7f3da9a88700 1 -- 172.21.15.80:0/2417378174 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d94000960 con 0x7f3da406c0a0 2019-11-28T11:26:01.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.839+0000 7f3daaa8a700 1 --2- 172.21.15.80:0/2417378174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da406c0a0 0x7f3da4072fa0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f3d94008400 tx=0x7f3d9400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.839+0000 7f3daaa8a700 1 --2- 172.21.15.80:0/2417378174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da406c0a0 0x7f3da4072fa0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f3d94008400 tx=0x7f3d9400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.839+0000 7f3da9a88700 1 -- 172.21.15.80:0/2417378174 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d94000c90 con 0x7f3da406c0a0 2019-11-28T11:26:01.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.839+0000 7f3da9a88700 1 -- 172.21.15.80:0/2417378174 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d94001360 con 0x7f3da406c0a0 2019-11-28T11:26:01.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.839+0000 7f3dac4ed700 1 -- 172.21.15.80:0/2417378174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da406c0a0 msgr2=0x7f3da4072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.839+0000 7f3dac4ed700 1 --2- 172.21.15.80:0/2417378174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da406c0a0 0x7f3da4072fa0 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7f3d94008400 tx=0x7f3d9400fad0).stop 2019-11-28T11:26:01.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.839+0000 7f3dac4ed700 1 -- 172.21.15.80:0/2417378174 shutdown_connections 2019-11-28T11:26:01.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.839+0000 7f3dac4ed700 1 --2- 172.21.15.80:0/2417378174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da406c0a0 0x7f3da4072fa0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.840+0000 7f3dac4ed700 1 -- 172.21.15.80:0/2417378174 shutdown_connections 2019-11-28T11:26:01.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.840+0000 7f3dac4ed700 1 -- 172.21.15.80:0/2417378174 wait complete. 2019-11-28T11:26:01.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.840+0000 7f3dac4ed700 1 -- 172.21.15.80:0/2417378174 >> 172.21.15.80:0/2417378174 conn(0x7f3da4061cf0 msgr2=0x7f3da4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:01.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.842+0000 7f3dac4ed700 1 Processor -- start 2019-11-28T11:26:01.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.842+0000 7f3dac4ed700 1 -- start start 2019-11-28T11:26:01.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dac4ed700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3da412cea0 0x7f3da4111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:01.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dac4ed700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da41230e0 0x7f3da4123570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:01.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dac4ed700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3da4123ab0 0x7f3da412d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:01.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dac4ed700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da4121040 con 0x7f3da4123ab0 2019-11-28T11:26:01.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dac4ed700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da4121310 con 0x7f3da412cea0 2019-11-28T11:26:01.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dac4ed700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da4120610 con 0x7f3da41230e0 2019-11-28T11:26:01.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dab28b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3da4123ab0 0x7f3da412d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dab28b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3da4123ab0 0x7f3da412d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60566/0 (socket says 172.21.15.80:60566) 2019-11-28T11:26:01.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dab28b700 1 -- 172.21.15.80:0/3266967851 learned_addr learned my addr 172.21.15.80:0/3266967851 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3daaa8a700 1 --2- 172.21.15.80:0/3266967851 >> v2:172.21.15.174:3300/0 conn(0x7f3da412cea0 0x7f3da4111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3daa289700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da41230e0 0x7f3da4123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dab28b700 1 -- 172.21.15.80:0/3266967851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da41230e0 msgr2=0x7f3da4123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dab28b700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da41230e0 0x7f3da4123570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dab28b700 1 -- 172.21.15.80:0/3266967851 >> v2:172.21.15.174:3300/0 conn(0x7f3da412cea0 msgr2=0x7f3da4111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dab28b700 1 --2- 172.21.15.80:0/3266967851 >> v2:172.21.15.174:3300/0 conn(0x7f3da412cea0 0x7f3da4111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dab28b700 1 -- 172.21.15.80:0/3266967851 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da41219a0 con 0x7f3da4123ab0 2019-11-28T11:26:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dab28b700 1 --2- 172.21.15.80:0/3266967851 >> v2:172.21.15.80:3300/0 conn(0x7f3da4123ab0 0x7f3da412d290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3d9c0107c0 tx=0x7f3d9c010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dab28b700 1 --2- 172.21.15.80:0/3266967851 >> v2:172.21.15.80:3300/0 conn(0x7f3da4123ab0 0x7f3da412d290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3d9c0107c0 tx=0x7f3d9c010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dab28b700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da4123ab0 0x7f3da412d290 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f3d9c0107c0 tx=0x7f3d9c010670).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:01.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dab28b700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da4123ab0 0x7f3da412d290 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f3d9c0107c0 tx=0x7f3d9c010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3d9b7fe700 1 -- 172.21.15.80:0/3266967851 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d9c000cc0 con 0x7f3da4123ab0 2019-11-28T11:26:01.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dab28b700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da4123ab0 0x7f3da412d290 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f3d9c0107c0 tx=0x7f3d9c010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dab28b700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da4123ab0 0x7f3da412d290 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f3d9c0107c0 tx=0x7f3d9c010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3d9b7fe700 1 -- 172.21.15.80:0/3266967851 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c0015d0 con 0x7f3da4123ab0 2019-11-28T11:26:01.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3d9b7fe700 1 -- 172.21.15.80:0/3266967851 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d9c001c20 con 0x7f3da4123ab0 2019-11-28T11:26:01.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.843+0000 7f3dac4ed700 1 -- 172.21.15.80:0/3266967851 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da4121d20 con 0x7f3da4123ab0 2019-11-28T11:26:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.844+0000 7f3dac4ed700 1 -- 172.21.15.80:0/3266967851 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da41122f0 con 0x7f3da4123ab0 2019-11-28T11:26:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.844+0000 7f3dab28b700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da4123ab0 0x7f3da412d290 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f3d9c0107c0 tx=0x7f3d9c010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.844+0000 7f3d9b7fe700 1 -- 172.21.15.80:0/3266967851 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3d9c0017c0 con 0x7f3da4123ab0 2019-11-28T11:26:01.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.844+0000 7f3dab28b700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da4123ab0 0x7f3da412d290 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f3d9c0107c0 tx=0x7f3d9c010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.844+0000 7f3d9b7fe700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d8c018730 0x7f3d8c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.844+0000 7f3d9b7fe700 1 -- 172.21.15.80:0/3266967851 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f3d9c031d60 con 0x7f3da4123ab0 2019-11-28T11:26:01.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.844+0000 7f3daaa8a700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d8c018730 0x7f3d8c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.845+0000 7f3daaa8a700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d8c018730 0x7f3d8c01abc0 crc :-1 s=READY pgs=145 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.852+0000 7f3dac4ed700 1 -- 172.21.15.80:0/3266967851 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da41219a0 con 0x7f3da4123ab0 2019-11-28T11:26:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.855+0000 7f3dab28b700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da4123ab0 0x7f3da412d290 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f3d9c0107c0 tx=0x7f3d9c010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:01.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:01.855+0000 7f3d9b7fe700 1 -- 172.21.15.80:0/3266967851 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3d9c007930 con 0x7f3da4123ab0 2019-11-28T11:26:02.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.018+0000 7f3dac4ed700 1 -- 172.21.15.80:0/3266967851 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3da4121d20 con 0x7f3da4123ab0 2019-11-28T11:26:02.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.019+0000 7f3dab28b700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da4123ab0 0x7f3da412d290 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f3d9c0107c0 tx=0x7f3d9c010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.019+0000 7f3d9b7fe700 1 -- 172.21.15.80:0/3266967851 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+64 (secure 0 0 0) 0x7f3d9c0017c0 con 0x7f3da4123ab0 2019-11-28T11:26:02.042 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:02.043 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:26:02.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:26:02.044 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:26:02.044 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:26:02.044 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:26:02.045 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:26:02.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.021+0000 7f3dac4ed700 1 -- 172.21.15.80:0/3266967851 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d8c018730 msgr2=0x7f3d8c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:02.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.021+0000 7f3dac4ed700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d8c018730 0x7f3d8c01abc0 crc :-1 s=READY pgs=145 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.021+0000 7f3dac4ed700 1 -- 172.21.15.80:0/3266967851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da4123ab0 msgr2=0x7f3da412d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:02.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.021+0000 7f3dac4ed700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da4123ab0 0x7f3da412d290 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f3d9c0107c0 tx=0x7f3d9c010670).stop 2019-11-28T11:26:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.021+0000 7f3dac4ed700 1 -- 172.21.15.80:0/3266967851 shutdown_connections 2019-11-28T11:26:02.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.021+0000 7f3dac4ed700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d8c018730 0x7f3d8c01abc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.021+0000 7f3dac4ed700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da4123ab0 0x7f3da412d290 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:02.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.021+0000 7f3dac4ed700 1 --2- 172.21.15.80:0/3266967851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da41230e0 0x7f3da4123570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:02.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.021+0000 7f3dac4ed700 1 --2- 172.21.15.80:0/3266967851 >> v2:172.21.15.174:3300/0 conn(0x7f3da412cea0 0x7f3da4111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:02.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.022+0000 7f3dac4ed700 1 -- 172.21.15.80:0/3266967851 shutdown_connections 2019-11-28T11:26:02.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.022+0000 7f3dac4ed700 1 -- 172.21.15.80:0/3266967851 wait complete. 2019-11-28T11:26:02.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.022+0000 7f3dac4ed700 1 -- 172.21.15.80:0/3266967851 >> 172.21.15.80:0/3266967851 conn(0x7f3da41426c0 msgr2=0x7f3da4110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:02.055 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:26:02.055 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:26:02.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.158+0000 7f1fa5b40700 1 Processor -- start 2019-11-28T11:26:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.159+0000 7f1fa5b40700 1 -- start start 2019-11-28T11:26:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1fa5b40700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1fa015f100 0x7f1fa006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:02.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1fa5b40700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa006db60 con 0x7f1fa015ed10 2019-11-28T11:26:02.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1fa5b40700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa006e060 con 0x7f1fa006c2f0 2019-11-28T11:26:02.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1fa5b40700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa006fe00 con 0x7f1fa015f100 2019-11-28T11:26:02.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f97fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1fa015f100 0x7f1fa006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:02.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f9ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1fa015ed10 0x7f1fa0073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59888/0 (socket says 172.21.15.80:59888) 2019-11-28T11:26:02.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f97fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1fa015f100 0x7f1fa006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60574/0 (socket says 172.21.15.80:60574) 2019-11-28T11:26:02.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f9ffff700 1 -- 172.21.15.80:0/1637897833 learned_addr learned my addr 172.21.15.80:0/1637897833 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:02.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f97fff700 1 -- 172.21.15.80:0/1637897833 >> v1:172.21.15.174:6789/0 conn(0x7f1fa006c2f0 legacy=0x7f1fa006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:02.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f97fff700 1 -- 172.21.15.80:0/1637897833 >> v1:172.21.15.80:6789/0 conn(0x7f1fa015ed10 legacy=0x7f1fa0073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f97fff700 1 -- 172.21.15.80:0/1637897833 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa0070760 con 0x7f1fa015f100 2019-11-28T11:26:02.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f9f7fe700 1 -- 172.21.15.80:0/1637897833 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716094 0 0) 0x7f1f90001150 con 0x7f1fa015ed10 2019-11-28T11:26:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f97fff700 1 --2- 172.21.15.80:0/1637897833 >> v2:172.21.15.80:3300/0 conn(0x7f1fa015f100 0x7f1fa006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1f8800af50 tx=0x7f1f8800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f97fff700 1 --2- 172.21.15.80:0/1637897833 >> v2:172.21.15.80:3300/0 conn(0x7f1fa015f100 0x7f1fa006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1f8800af50 tx=0x7f1f8800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f97fff700 1 --2- 172.21.15.80:0/1637897833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fa015f100 0x7f1fa006bdb0 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7f1f8800af50 tx=0x7f1f8800b760).ready entity=mon.0 client_cookie=9812eba0240da56e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f97fff700 1 --2- 172.21.15.80:0/1637897833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fa015f100 0x7f1fa006bdb0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f1f8800af50 tx=0x7f1f8800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f9f7fe700 1 -- 172.21.15.80:0/1637897833 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f88007210 con 0x7f1fa015f100 2019-11-28T11:26:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f97fff700 1 --2- 172.21.15.80:0/1637897833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fa015f100 0x7f1fa006bdb0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f1f8800af50 tx=0x7f1f8800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f97fff700 1 --2- 172.21.15.80:0/1637897833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fa015f100 0x7f1fa006bdb0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f1f8800af50 tx=0x7f1f8800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f9f7fe700 1 -- 172.21.15.80:0/1637897833 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f880099b0 con 0x7f1fa015f100 2019-11-28T11:26:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1f9f7fe700 1 -- 172.21.15.80:0/1637897833 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f8800a080 con 0x7f1fa015f100 2019-11-28T11:26:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1fa5b40700 1 -- 172.21.15.80:0/1637897833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fa015f100 msgr2=0x7f1fa006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.160+0000 7f1fa5b40700 1 --2- 172.21.15.80:0/1637897833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fa015f100 0x7f1fa006bdb0 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7f1f8800af50 tx=0x7f1f8800b760).stop 2019-11-28T11:26:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.161+0000 7f1fa5b40700 1 -- 172.21.15.80:0/1637897833 shutdown_connections 2019-11-28T11:26:02.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.161+0000 7f1fa5b40700 1 --2- 172.21.15.80:0/1637897833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fa015f100 0x7f1fa006bdb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:02.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.161+0000 7f1fa5b40700 1 -- 172.21.15.80:0/1637897833 shutdown_connections 2019-11-28T11:26:02.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.161+0000 7f1fa5b40700 1 -- 172.21.15.80:0/1637897833 wait complete. 2019-11-28T11:26:02.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.161+0000 7f1fa5b40700 1 -- 172.21.15.80:0/1637897833 >> 172.21.15.80:0/1637897833 conn(0x7f1fa0061d20 msgr2=0x7f1fa00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:02.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.163+0000 7f1fa5b40700 1 Processor -- start 2019-11-28T11:26:02.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.163+0000 7f1fa5b40700 1 -- start start 2019-11-28T11:26:02.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.164+0000 7f1fa5b40700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1fa010e970 0x7f1fa01087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:02.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.164+0000 7f1fa5b40700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fa0107e30 0x7f1fa0167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:02.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.164+0000 7f1fa5b40700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa010c250 con 0x7f1fa0108cf0 2019-11-28T11:26:02.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.164+0000 7f1fa5b40700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa010e430 con 0x7f1fa010e970 2019-11-28T11:26:02.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.164+0000 7f1fa5b40700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa0105860 con 0x7f1fa0107e30 2019-11-28T11:26:02.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1f9ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1fa010e970 0x7f1fa01087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:02.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1fa48de700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fa0107e30 0x7f1fa0167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:02.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1f9ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1fa010e970 0x7f1fa01087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:47232/0 (socket says 172.21.15.80:47232) 2019-11-28T11:26:02.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1f9ffff700 1 -- 172.21.15.80:0/1415792877 learned_addr learned my addr 172.21.15.80:0/1415792877 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:02.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1fa48de700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fa0107e30 0x7f1fa0167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:34610/0 (socket says 172.21.15.80:34610) 2019-11-28T11:26:02.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1f9ffff700 1 -- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fa0107e30 msgr2=0x7f1fa0167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:02.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1f9ffff700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fa0107e30 0x7f1fa0167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:02.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1f9ffff700 1 -- 172.21.15.80:0/1415792877 >> v1:172.21.15.174:6789/0 conn(0x7f1fa0108cf0 legacy=0x7f1fa0107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:02.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1f9ffff700 1 -- 172.21.15.80:0/1415792877 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa0105ef0 con 0x7f1fa010e970 2019-11-28T11:26:02.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1fa48de700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fa0107e30 0x7f1fa0167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:02.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1f9ffff700 1 --2- 172.21.15.80:0/1415792877 >> v2:172.21.15.174:3300/0 conn(0x7f1fa010e970 0x7f1fa01087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f90010430 tx=0x7f1f900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1f9ffff700 1 --2- 172.21.15.80:0/1415792877 >> v2:172.21.15.174:3300/0 conn(0x7f1fa010e970 0x7f1fa01087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f90010430 tx=0x7f1f900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1f9ffff700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fa010e970 0x7f1fa01087b0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f1f90010430 tx=0x7f1f900107d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:02.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1f9ffff700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fa010e970 0x7f1fa01087b0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f1f90010430 tx=0x7f1f900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1f9d7fa700 1 -- 172.21.15.80:0/1415792877 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f90000ed0 con 0x7f1fa010e970 2019-11-28T11:26:02.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1f9ffff700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fa010e970 0x7f1fa01087b0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f1f90010430 tx=0x7f1f900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1f9ffff700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fa010e970 0x7f1fa01087b0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f1f90010430 tx=0x7f1f900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1f9d7fa700 1 -- 172.21.15.80:0/1415792877 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f90004430 con 0x7f1fa010e970 2019-11-28T11:26:02.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1f9d7fa700 1 -- 172.21.15.80:0/1415792877 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f90004a80 con 0x7f1fa010e970 2019-11-28T11:26:02.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1fa5b40700 1 -- 172.21.15.80:0/1415792877 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa0106270 con 0x7f1fa010e970 2019-11-28T11:26:02.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.165+0000 7f1fa5b40700 1 -- 172.21.15.80:0/1415792877 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa0105ef0 con 0x7f1fa010e970 2019-11-28T11:26:02.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.166+0000 7f1f9ffff700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fa010e970 0x7f1fa01087b0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f1f90010430 tx=0x7f1f900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.166+0000 7f1f9d7fa700 1 -- 172.21.15.80:0/1415792877 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1f90004620 con 0x7f1fa010e970 2019-11-28T11:26:02.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.166+0000 7f1f9ffff700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fa010e970 0x7f1fa01087b0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f1f90010430 tx=0x7f1f900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.166+0000 7f1f9d7fa700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f84018730 0x7f1f8401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:02.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.166+0000 7f1f9d7fa700 1 -- 172.21.15.80:0/1415792877 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f1f90031ae0 con 0x7f1fa010e970 2019-11-28T11:26:02.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.166+0000 7f1f97fff700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f84018730 0x7f1f8401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:02.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.166+0000 7f1f97fff700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f84018730 0x7f1f8401abc0 crc :-1 s=READY pgs=146 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:02.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.174+0000 7f1fa5b40700 1 -- 172.21.15.80:0/1415792877 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa0106270 con 0x7f1fa010e970 2019-11-28T11:26:02.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.177+0000 7f1f9ffff700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fa010e970 0x7f1fa01087b0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f1f90010430 tx=0x7f1f900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.177+0000 7f1f9d7fa700 1 -- 172.21.15.80:0/1415792877 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1f90020520 con 0x7f1fa010e970 2019-11-28T11:26:02.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.350+0000 7f1fa5b40700 1 -- 172.21.15.80:0/1415792877 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f1fa0105ef0 con 0x7f1fa010e970 2019-11-28T11:26:02.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.649+0000 7f1f9ffff700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fa010e970 0x7f1fa01087b0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f1f90010430 tx=0x7f1f900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.649+0000 7f1f9d7fa700 1 -- 172.21.15.80:0/1415792877 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v32) v1 ==== 133+0+0 (secure 0 0 0) 0x7f1f90020520 con 0x7f1fa010e970 2019-11-28T11:26:02.685 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:26:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.666+0000 7f1fa5b40700 1 -- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f84018730 msgr2=0x7f1f8401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:02.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.666+0000 7f1fa5b40700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f84018730 0x7f1f8401abc0 crc :-1 s=READY pgs=146 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:02.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.666+0000 7f1fa5b40700 1 -- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fa010e970 msgr2=0x7f1fa01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:02.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.666+0000 7f1fa5b40700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fa010e970 0x7f1fa01087b0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f1f90010430 tx=0x7f1f900107d0).stop 2019-11-28T11:26:02.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.666+0000 7f1fa5b40700 1 -- 172.21.15.80:0/1415792877 shutdown_connections 2019-11-28T11:26:02.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.666+0000 7f1fa5b40700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fa0107e30 0x7f1fa0167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:02.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.666+0000 7f1fa5b40700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f84018730 0x7f1f8401abc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:02.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.666+0000 7f1fa5b40700 1 --2- 172.21.15.80:0/1415792877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fa010e970 0x7f1fa01087b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.666+0000 7f1fa5b40700 1 -- 172.21.15.80:0/1415792877 shutdown_connections 2019-11-28T11:26:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.666+0000 7f1fa5b40700 1 -- 172.21.15.80:0/1415792877 wait complete. 2019-11-28T11:26:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.666+0000 7f1fa5b40700 1 -- 172.21.15.80:0/1415792877 >> 172.21.15.80:0/1415792877 conn(0x7f1fa015e2d0 msgr2=0x7f1fa0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:02.698 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:26:02.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.801+0000 7f148ee9b700 1 Processor -- start 2019-11-28T11:26:02.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.802+0000 7f148ee9b700 1 -- start start 2019-11-28T11:26:02.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f148ee9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148815f100 0x7f148806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:02.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f148ee9b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148806db60 con 0x7f148806c2f0 2019-11-28T11:26:02.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f148ee9b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148806e060 con 0x7f148815ed10 2019-11-28T11:26:02.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f148ee9b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148806fe00 con 0x7f148815f100 2019-11-28T11:26:02.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f148dc39700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f148806c2f0 0x7f148806c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59904/0 (socket says 172.21.15.80:59904) 2019-11-28T11:26:02.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f148dc39700 1 -- 172.21.15.80:0/2381979090 learned_addr learned my addr 172.21.15.80:0/2381979090 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:02.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f148cc37700 1 --2- 172.21.15.80:0/2381979090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148815f100 0x7f148806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:02.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f1487fff700 1 -- 172.21.15.80:0/2381979090 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34816034 0 0) 0x7f1470001400 con 0x7f148815ed10 2019-11-28T11:26:02.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f1487fff700 1 -- 172.21.15.80:0/2381979090 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1474002e80 con 0x7f148815ed10 2019-11-28T11:26:02.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f1487fff700 1 -- 172.21.15.80:0/2381979090 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615390008 0 0) 0x7f1480001150 con 0x7f148806c2f0 2019-11-28T11:26:02.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f1487fff700 1 -- 172.21.15.80:0/2381979090 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1474004170 con 0x7f148806c2f0 2019-11-28T11:26:02.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f148cc37700 1 -- 172.21.15.80:0/2381979090 >> v1:172.21.15.174:6789/0 conn(0x7f148815ed10 legacy=0x7f1488073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:02.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f148cc37700 1 -- 172.21.15.80:0/2381979090 >> v1:172.21.15.80:6789/0 conn(0x7f148806c2f0 legacy=0x7f148806c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:02.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f148cc37700 1 -- 172.21.15.80:0/2381979090 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1488070760 con 0x7f148815f100 2019-11-28T11:26:02.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f148cc37700 1 --2- 172.21.15.80:0/2381979090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148815f100 0x7f148806bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f147800af50 tx=0x7f147800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f148cc37700 1 --2- 172.21.15.80:0/2381979090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148815f100 0x7f148806bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f147800af50 tx=0x7f147800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.803+0000 7f148cc37700 1 --2- 172.21.15.80:0/2381979090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148815f100 0x7f148806bdb0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f147800af50 tx=0x7f147800b760).ready entity=mon.2 client_cookie=e802ecae0ff9346b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:02.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.804+0000 7f148cc37700 1 --2- 172.21.15.80:0/2381979090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148815f100 0x7f148806bdb0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f147800af50 tx=0x7f147800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.804+0000 7f1487fff700 1 -- 172.21.15.80:0/2381979090 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1478000960 con 0x7f148815f100 2019-11-28T11:26:02.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.804+0000 7f148cc37700 1 --2- 172.21.15.80:0/2381979090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148815f100 0x7f148806bdb0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f147800af50 tx=0x7f147800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.804+0000 7f1487fff700 1 -- 172.21.15.80:0/2381979090 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1478009860 con 0x7f148815f100 2019-11-28T11:26:02.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.804+0000 7f148cc37700 1 --2- 172.21.15.80:0/2381979090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148815f100 0x7f148806bdb0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f147800af50 tx=0x7f147800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.804+0000 7f1487fff700 1 -- 172.21.15.80:0/2381979090 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1478000960 con 0x7f148815f100 2019-11-28T11:26:02.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.804+0000 7f148ee9b700 1 -- 172.21.15.80:0/2381979090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148815f100 msgr2=0x7f148806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:02.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.804+0000 7f148ee9b700 1 --2- 172.21.15.80:0/2381979090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148815f100 0x7f148806bdb0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f147800af50 tx=0x7f147800b760).stop 2019-11-28T11:26:02.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.804+0000 7f148ee9b700 1 -- 172.21.15.80:0/2381979090 shutdown_connections 2019-11-28T11:26:02.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.804+0000 7f148ee9b700 1 --2- 172.21.15.80:0/2381979090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148815f100 0x7f148806bdb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:02.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.804+0000 7f148ee9b700 1 -- 172.21.15.80:0/2381979090 shutdown_connections 2019-11-28T11:26:02.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.804+0000 7f148ee9b700 1 -- 172.21.15.80:0/2381979090 wait complete. 2019-11-28T11:26:02.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.804+0000 7f148ee9b700 1 -- 172.21.15.80:0/2381979090 >> 172.21.15.80:0/2381979090 conn(0x7f1488061d20 msgr2=0x7f14880641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:02.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.807+0000 7f148ee9b700 1 Processor -- start 2019-11-28T11:26:02.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.807+0000 7f148ee9b700 1 -- start start 2019-11-28T11:26:02.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148ee9b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1488127280 0x7f1488079840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:02.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148ee9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1488079d80 0x7f148812e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:02.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148ee9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1488165190 0x7f1488165630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:02.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148ee9b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1488075800 con 0x7f1488127280 2019-11-28T11:26:02.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148ee9b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1488075ad0 con 0x7f1488165190 2019-11-28T11:26:02.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148ee9b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148814ce70 con 0x7f1488079d80 2019-11-28T11:26:02.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148d438700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1488127280 0x7f1488079840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:02.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148d438700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1488127280 0x7f1488079840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60592/0 (socket says 172.21.15.80:60592) 2019-11-28T11:26:02.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148d438700 1 -- 172.21.15.80:0/2684507914 learned_addr learned my addr 172.21.15.80:0/2684507914 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:02.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148cc37700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1488079d80 0x7f148812e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:02.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148dc39700 1 --2- 172.21.15.80:0/2684507914 >> v2:172.21.15.174:3300/0 conn(0x7f1488165190 0x7f1488165630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:02.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148d438700 1 -- 172.21.15.80:0/2684507914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1488079d80 msgr2=0x7f148812e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:02.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148d438700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1488079d80 0x7f148812e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:02.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148d438700 1 -- 172.21.15.80:0/2684507914 >> v2:172.21.15.174:3300/0 conn(0x7f1488165190 msgr2=0x7f1488165630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:02.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148d438700 1 --2- 172.21.15.80:0/2684507914 >> v2:172.21.15.174:3300/0 conn(0x7f1488165190 0x7f1488165630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:02.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148d438700 1 -- 172.21.15.80:0/2684507914 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1488076160 con 0x7f1488127280 2019-11-28T11:26:02.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148d438700 1 --2- 172.21.15.80:0/2684507914 >> v2:172.21.15.80:3300/0 conn(0x7f1488127280 0x7f1488079840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1470010790 tx=0x7f1470010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148d438700 1 --2- 172.21.15.80:0/2684507914 >> v2:172.21.15.80:3300/0 conn(0x7f1488127280 0x7f1488079840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1470010790 tx=0x7f1470010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148d438700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1488127280 0x7f1488079840 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7f1470010790 tx=0x7f1470010690).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:02.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f148d438700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1488127280 0x7f1488079840 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f1470010790 tx=0x7f1470010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.808+0000 7f1485ffb700 1 -- 172.21.15.80:0/2684507914 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1470005af0 con 0x7f1488127280 2019-11-28T11:26:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.809+0000 7f148d438700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1488127280 0x7f1488079840 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f1470010790 tx=0x7f1470010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.809+0000 7f148d438700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1488127280 0x7f1488079840 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f1470010790 tx=0x7f1470010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.809+0000 7f1485ffb700 1 -- 172.21.15.80:0/2684507914 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470005710 con 0x7f1488127280 2019-11-28T11:26:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.809+0000 7f1485ffb700 1 -- 172.21.15.80:0/2684507914 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1470000f10 con 0x7f1488127280 2019-11-28T11:26:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.809+0000 7f148ee9b700 1 -- 172.21.15.80:0/2684507914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14880764e0 con 0x7f1488127280 2019-11-28T11:26:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.809+0000 7f148ee9b700 1 -- 172.21.15.80:0/2684507914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1488076160 con 0x7f1488127280 2019-11-28T11:26:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.809+0000 7f148d438700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1488127280 0x7f1488079840 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f1470010790 tx=0x7f1470010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.809+0000 7f1485ffb700 1 -- 172.21.15.80:0/2684507914 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1470005900 con 0x7f1488127280 2019-11-28T11:26:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.809+0000 7f148d438700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1488127280 0x7f1488079840 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f1470010790 tx=0x7f1470010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.809+0000 7f1485ffb700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f146c018730 0x7f146c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:02.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.809+0000 7f1485ffb700 1 -- 172.21.15.80:0/2684507914 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f1470031db0 con 0x7f1488127280 2019-11-28T11:26:02.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.810+0000 7f148cc37700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f146c018730 0x7f146c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:02.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.810+0000 7f148cc37700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f146c018730 0x7f146c01abc0 crc :-1 s=READY pgs=147 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.817+0000 7f148ee9b700 1 -- 172.21.15.80:0/2684507914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14880764e0 con 0x7f1488127280 2019-11-28T11:26:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.820+0000 7f148d438700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1488127280 0x7f1488079840 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f1470010790 tx=0x7f1470010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.820+0000 7f1485ffb700 1 -- 172.21.15.80:0/2684507914 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1470000f10 con 0x7f1488127280 2019-11-28T11:26:03.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:02.988+0000 7f148ee9b700 1 -- 172.21.15.80:0/2684507914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f1488076160 con 0x7f1488127280 2019-11-28T11:26:03.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.652+0000 7f148d438700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1488127280 0x7f1488079840 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f1470010790 tx=0x7f1470010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:03.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.652+0000 7f1485ffb700 1 -- 172.21.15.80:0/2684507914 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v33) v1 ==== 125+0+0 (secure 0 0 0) 0x7f1470017740 con 0x7f1488127280 2019-11-28T11:26:03.703 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:26:03.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.657+0000 7f148ee9b700 1 -- 172.21.15.80:0/2684507914 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f146c018730 msgr2=0x7f146c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:03.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.657+0000 7f148ee9b700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f146c018730 0x7f146c01abc0 crc :-1 s=READY pgs=147 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:03.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.657+0000 7f148ee9b700 1 -- 172.21.15.80:0/2684507914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1488127280 msgr2=0x7f1488079840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:03.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.657+0000 7f148ee9b700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1488127280 0x7f1488079840 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7f1470010790 tx=0x7f1470010690).stop 2019-11-28T11:26:03.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.657+0000 7f148ee9b700 1 -- 172.21.15.80:0/2684507914 shutdown_connections 2019-11-28T11:26:03.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.657+0000 7f148ee9b700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f146c018730 0x7f146c01abc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:03.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.657+0000 7f148ee9b700 1 --2- 172.21.15.80:0/2684507914 >> v2:172.21.15.174:3300/0 conn(0x7f1488165190 0x7f1488165630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:03.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.657+0000 7f148ee9b700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1488079d80 0x7f148812e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:03.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.657+0000 7f148ee9b700 1 --2- 172.21.15.80:0/2684507914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1488127280 0x7f1488079840 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:03.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.657+0000 7f148ee9b700 1 -- 172.21.15.80:0/2684507914 shutdown_connections 2019-11-28T11:26:03.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.657+0000 7f148ee9b700 1 -- 172.21.15.80:0/2684507914 wait complete. 2019-11-28T11:26:03.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.657+0000 7f148ee9b700 1 -- 172.21.15.80:0/2684507914 >> 172.21.15.80:0/2684507914 conn(0x7f1488166440 msgr2=0x7f14881494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:03.712 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:26:03.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.818+0000 7ff3962ac700 1 Processor -- start 2019-11-28T11:26:03.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.818+0000 7ff3962ac700 1 -- start start 2019-11-28T11:26:03.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.819+0000 7ff3962ac700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff39015ed10 0x7ff39015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:03.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.819+0000 7ff3962ac700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390073020 0x7ff390071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:03.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.819+0000 7ff3962ac700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39006db60 con 0x7ff3900734b0 2019-11-28T11:26:03.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.819+0000 7ff3962ac700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39006fe00 con 0x7ff39015ed10 2019-11-28T11:26:03.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.819+0000 7ff3962ac700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3900700d0 con 0x7ff390073020 2019-11-28T11:26:03.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.819+0000 7ff39504a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff3900734b0 0x7ff3900723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59916/0 (socket says 172.21.15.80:59916) 2019-11-28T11:26:03.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.819+0000 7ff39504a700 1 -- 172.21.15.80:0/1452726392 learned_addr learned my addr 172.21.15.80:0/1452726392 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:03.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.819+0000 7ff394849700 1 --2- 172.21.15.80:0/1452726392 >> v2:172.21.15.174:3300/0 conn(0x7ff39015ed10 0x7ff39015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:03.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.819+0000 7ff38ffff700 1 --2- 172.21.15.80:0/1452726392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390073020 0x7ff390071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:03.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.819+0000 7ff38f7fe700 1 -- 172.21.15.80:0/1452726392 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406653738 0 0) 0x7ff388001150 con 0x7ff3900734b0 2019-11-28T11:26:03.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.819+0000 7ff38f7fe700 1 -- 172.21.15.80:0/1452726392 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff37c002e80 con 0x7ff3900734b0 2019-11-28T11:26:03.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.819+0000 7ff38f7fe700 1 -- 172.21.15.80:0/1452726392 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1657456377 0 0) 0x7ff388001130 con 0x7ff3900734b0 2019-11-28T11:26:03.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.819+0000 7ff38ffff700 1 -- 172.21.15.80:0/1452726392 >> v2:172.21.15.174:3300/0 conn(0x7ff39015ed10 msgr2=0x7ff39015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:03.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.819+0000 7ff38ffff700 1 --2- 172.21.15.80:0/1452726392 >> v2:172.21.15.174:3300/0 conn(0x7ff39015ed10 0x7ff39015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:03.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.819+0000 7ff38ffff700 1 -- 172.21.15.80:0/1452726392 >> v1:172.21.15.80:6789/0 conn(0x7ff3900734b0 legacy=0x7ff3900723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:03.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.819+0000 7ff38ffff700 1 -- 172.21.15.80:0/1452726392 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff390070760 con 0x7ff390073020 2019-11-28T11:26:03.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.820+0000 7ff394849700 1 --2- 172.21.15.80:0/1452726392 >> v2:172.21.15.174:3300/0 conn(0x7ff39015ed10 0x7ff39015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:03.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.820+0000 7ff38ffff700 1 --2- 172.21.15.80:0/1452726392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390073020 0x7ff390071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff38000b2d0 tx=0x7ff38000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:03.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.820+0000 7ff38ffff700 1 --2- 172.21.15.80:0/1452726392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390073020 0x7ff390071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff38000b2d0 tx=0x7ff38000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:03.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.820+0000 7ff38ffff700 1 --2- 172.21.15.80:0/1452726392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390073020 0x7ff390071ea0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7ff38000b2d0 tx=0x7ff38000bae0).ready entity=mon.2 client_cookie=eaa9c800b670db2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:03.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.820+0000 7ff38ffff700 1 --2- 172.21.15.80:0/1452726392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390073020 0x7ff390071ea0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7ff38000b2d0 tx=0x7ff38000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:03.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.820+0000 7ff38f7fe700 1 -- 172.21.15.80:0/1452726392 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff380007590 con 0x7ff390073020 2019-11-28T11:26:03.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.820+0000 7ff38ffff700 1 --2- 172.21.15.80:0/1452726392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390073020 0x7ff390071ea0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7ff38000b2d0 tx=0x7ff38000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:03.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.820+0000 7ff38ffff700 1 --2- 172.21.15.80:0/1452726392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390073020 0x7ff390071ea0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7ff38000b2d0 tx=0x7ff38000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:03.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.820+0000 7ff38f7fe700 1 -- 172.21.15.80:0/1452726392 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff380009d30 con 0x7ff390073020 2019-11-28T11:26:03.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.820+0000 7ff38f7fe700 1 -- 172.21.15.80:0/1452726392 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff38000a400 con 0x7ff390073020 2019-11-28T11:26:03.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.820+0000 7ff3962ac700 1 -- 172.21.15.80:0/1452726392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390073020 msgr2=0x7ff390071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:03.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.820+0000 7ff3962ac700 1 --2- 172.21.15.80:0/1452726392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390073020 0x7ff390071ea0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7ff38000b2d0 tx=0x7ff38000bae0).stop 2019-11-28T11:26:03.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.821+0000 7ff3962ac700 1 -- 172.21.15.80:0/1452726392 shutdown_connections 2019-11-28T11:26:03.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.821+0000 7ff3962ac700 1 --2- 172.21.15.80:0/1452726392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390073020 0x7ff390071ea0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:03.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.821+0000 7ff3962ac700 1 --2- 172.21.15.80:0/1452726392 >> v2:172.21.15.174:3300/0 conn(0x7ff39015ed10 0x7ff39015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:03.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.821+0000 7ff3962ac700 1 -- 172.21.15.80:0/1452726392 shutdown_connections 2019-11-28T11:26:03.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.821+0000 7ff3962ac700 1 -- 172.21.15.80:0/1452726392 wait complete. 2019-11-28T11:26:03.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.821+0000 7ff3962ac700 1 -- 172.21.15.80:0/1452726392 >> 172.21.15.80:0/1452726392 conn(0x7ff390061d20 msgr2=0x7ff3900641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:03.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.823+0000 7ff3962ac700 1 Processor -- start 2019-11-28T11:26:03.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.823+0000 7ff3962ac700 1 -- start start 2019-11-28T11:26:03.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.824+0000 7ff3962ac700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390148320 0x7ff39010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:03.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.824+0000 7ff3962ac700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff39010e3d0 0x7ff390168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:03.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.824+0000 7ff3962ac700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff390148e00 con 0x7ff39010f290 2019-11-28T11:26:03.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.824+0000 7ff3962ac700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff390139ff0 con 0x7ff39010e3d0 2019-11-28T11:26:03.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.824+0000 7ff3962ac700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39013aa20 con 0x7ff390148320 2019-11-28T11:26:03.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.824+0000 7ff394849700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390148320 0x7ff39010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:03.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.824+0000 7ff38ffff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff39010f290 0x7ff39010dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:47234/0 (socket says 172.21.15.80:47234) 2019-11-28T11:26:03.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.824+0000 7ff39504a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff39010e3d0 0x7ff390168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:03.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.824+0000 7ff38ffff700 1 -- 172.21.15.80:0/2002174005 learned_addr learned my addr 172.21.15.80:0/2002174005 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:03.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.824+0000 7ff38d7fa700 1 -- 172.21.15.80:0/2002174005 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775315452 0 0) 0x7ff380009900 con 0x7ff39010f290 2019-11-28T11:26:03.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.824+0000 7ff38d7fa700 1 -- 172.21.15.80:0/2002174005 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff374002e80 con 0x7ff39010f290 2019-11-28T11:26:03.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff394849700 1 -- 172.21.15.80:0/2002174005 >> v2:172.21.15.174:3300/0 conn(0x7ff39010e3d0 msgr2=0x7ff390168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:03.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff394849700 1 --2- 172.21.15.80:0/2002174005 >> v2:172.21.15.174:3300/0 conn(0x7ff39010e3d0 0x7ff390168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:03.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff394849700 1 -- 172.21.15.80:0/2002174005 >> v1:172.21.15.174:6789/0 conn(0x7ff39010f290 legacy=0x7ff39010dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:03.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff394849700 1 -- 172.21.15.80:0/2002174005 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39010c490 con 0x7ff390148320 2019-11-28T11:26:03.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff39504a700 1 --2- 172.21.15.80:0/2002174005 >> v2:172.21.15.174:3300/0 conn(0x7ff39010e3d0 0x7ff390168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:03.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff394849700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390148320 0x7ff39010ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff3780103a0 tx=0x7ff378010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:03.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff394849700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390148320 0x7ff39010ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff3780103a0 tx=0x7ff378010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:03.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff394849700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390148320 0x7ff39010ed50 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7ff3780103a0 tx=0x7ff378010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:03.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff394849700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390148320 0x7ff39010ed50 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7ff3780103a0 tx=0x7ff378010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:03.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff38d7fa700 1 -- 172.21.15.80:0/2002174005 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff378000940 con 0x7ff390148320 2019-11-28T11:26:03.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff394849700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390148320 0x7ff39010ed50 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7ff3780103a0 tx=0x7ff378010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:03.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff394849700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390148320 0x7ff39010ed50 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7ff3780103a0 tx=0x7ff378010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:03.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff38d7fa700 1 -- 172.21.15.80:0/2002174005 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37800dff0 con 0x7ff390148320 2019-11-28T11:26:03.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff38d7fa700 1 -- 172.21.15.80:0/2002174005 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff37800e680 con 0x7ff390148320 2019-11-28T11:26:03.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff3962ac700 1 -- 172.21.15.80:0/2002174005 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39010c810 con 0x7ff390148320 2019-11-28T11:26:03.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff3962ac700 1 -- 172.21.15.80:0/2002174005 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39010c490 con 0x7ff390148320 2019-11-28T11:26:03.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.825+0000 7ff394849700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390148320 0x7ff39010ed50 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7ff3780103a0 tx=0x7ff378010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:03.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.826+0000 7ff38d7fa700 1 -- 172.21.15.80:0/2002174005 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff37800db00 con 0x7ff390148320 2019-11-28T11:26:03.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.826+0000 7ff394849700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390148320 0x7ff39010ed50 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7ff3780103a0 tx=0x7ff378010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:03.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.826+0000 7ff38d7fa700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff374018770 0x7ff37401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:03.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.826+0000 7ff38d7fa700 1 -- 172.21.15.80:0/2002174005 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5904+0+0 (secure 0 0 0) 0x7ff3780319d0 con 0x7ff390148320 2019-11-28T11:26:03.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.826+0000 7ff38ffff700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff374018770 0x7ff37401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.826+0000 7ff38ffff700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff374018770 0x7ff37401abe0 crc :-1 s=READY pgs=148 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.833+0000 7ff3962ac700 1 -- 172.21.15.80:0/2002174005 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39010c810 con 0x7ff390148320 2019-11-28T11:26:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.837+0000 7ff394849700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390148320 0x7ff39010ed50 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7ff3780103a0 tx=0x7ff378010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:03.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:03.837+0000 7ff38d7fa700 1 -- 172.21.15.80:0/2002174005 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff378000940 con 0x7ff390148320 2019-11-28T11:26:04.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.002+0000 7ff3962ac700 1 -- 172.21.15.80:0/2002174005 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7ff39010c490 con 0x7ff390148320 2019-11-28T11:26:04.024 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:26:04.003+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:26:04.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.010+0000 7ff394849700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390148320 0x7ff39010ed50 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7ff3780103a0 tx=0x7ff378010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.010+0000 7ff38d7fa700 1 -- 172.21.15.80:0/2002174005 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 4 and data pool 5 v10) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff37800dc30 con 0x7ff390148320 2019-11-28T11:26:04.038 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 4 and data pool 5 2019-11-28T11:26:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.020+0000 7ff3962ac700 1 -- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff374018770 msgr2=0x7ff37401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.020+0000 7ff3962ac700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff374018770 0x7ff37401abe0 crc :-1 s=READY pgs=148 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.020+0000 7ff3962ac700 1 -- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390148320 msgr2=0x7ff39010ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.020+0000 7ff3962ac700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390148320 0x7ff39010ed50 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7ff3780103a0 tx=0x7ff378010740).stop 2019-11-28T11:26:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.020+0000 7ff3962ac700 1 -- 172.21.15.80:0/2002174005 shutdown_connections 2019-11-28T11:26:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.020+0000 7ff3962ac700 1 --2- 172.21.15.80:0/2002174005 >> v2:172.21.15.174:3300/0 conn(0x7ff39010e3d0 0x7ff390168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.020+0000 7ff3962ac700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff374018770 0x7ff37401abe0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.020+0000 7ff3962ac700 1 --2- 172.21.15.80:0/2002174005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff390148320 0x7ff39010ed50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.020+0000 7ff3962ac700 1 -- 172.21.15.80:0/2002174005 shutdown_connections 2019-11-28T11:26:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.020+0000 7ff3962ac700 1 -- 172.21.15.80:0/2002174005 wait complete. 2019-11-28T11:26:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.020+0000 7ff3962ac700 1 -- 172.21.15.80:0/2002174005 >> 172.21.15.80:0/2002174005 conn(0x7ff39015e2d0 msgr2=0x7ff390147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:04.050 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:26:04.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.149+0000 7f1611900700 1 Processor -- start 2019-11-28T11:26:04.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.149+0000 7f1611900700 1 -- start start 2019-11-28T11:26:04.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f1611900700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f160c06c0a0 0x7f160c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:04.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f1611900700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f160c072620 0x7f160c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f1611900700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160c06db00 con 0x7f160c0734e0 2019-11-28T11:26:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f1611900700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c06fd60 con 0x7f160c06c0a0 2019-11-28T11:26:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f1611900700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c070030 con 0x7f160c072620 2019-11-28T11:26:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160b7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f160c06c0a0 0x7f160c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160b7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f160c06c0a0 0x7f160c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60612/0 (socket says 172.21.15.80:60612) 2019-11-28T11:26:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160b7fe700 1 -- 172.21.15.80:0/2014018886 learned_addr learned my addr 172.21.15.80:0/2014018886 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:04.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160affd700 1 --1- 172.21.15.80:0/2014018886 >> v1:172.21.15.80:6789/0 conn(0x7f160c0734e0 0x7f160c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59928/0 (socket says 172.21.15.80:59928) 2019-11-28T11:26:04.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160bfff700 1 --2- 172.21.15.80:0/2014018886 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f160c072620 0x7f160c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160b7fe700 1 -- 172.21.15.80:0/2014018886 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f160c072620 msgr2=0x7f160c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:04.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160b7fe700 1 --2- 172.21.15.80:0/2014018886 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f160c072620 0x7f160c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:04.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160b7fe700 1 -- 172.21.15.80:0/2014018886 >> v1:172.21.15.80:6789/0 conn(0x7f160c0734e0 legacy=0x7f160c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160b7fe700 1 -- 172.21.15.80:0/2014018886 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c0706c0 con 0x7f160c06c0a0 2019-11-28T11:26:04.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160a7fc700 1 -- 172.21.15.80:0/2014018886 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349925763 0 0) 0x7f15f4001100 con 0x7f160c0734e0 2019-11-28T11:26:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160bfff700 1 --2- 172.21.15.80:0/2014018886 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f160c072620 0x7f160c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:26:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160b7fe700 1 --2- 172.21.15.80:0/2014018886 >> v2:172.21.15.80:3300/0 conn(0x7f160c06c0a0 0x7f160c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f160400f740 tx=0x7f160400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160b7fe700 1 --2- 172.21.15.80:0/2014018886 >> v2:172.21.15.80:3300/0 conn(0x7f160c06c0a0 0x7f160c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f160400f740 tx=0x7f160400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160b7fe700 1 --2- 172.21.15.80:0/2014018886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c06c0a0 0x7f160c072fa0 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7f160400f740 tx=0x7f160400fae0).ready entity=mon.0 client_cookie=6f8dee70600c38b1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160b7fe700 1 --2- 172.21.15.80:0/2014018886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c06c0a0 0x7f160c072fa0 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7f160400f740 tx=0x7f160400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160a7fc700 1 -- 172.21.15.80:0/2014018886 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1604000960 con 0x7f160c06c0a0 2019-11-28T11:26:04.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160b7fe700 1 --2- 172.21.15.80:0/2014018886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c06c0a0 0x7f160c072fa0 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7f160400f740 tx=0x7f160400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.150+0000 7f160b7fe700 1 --2- 172.21.15.80:0/2014018886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c06c0a0 0x7f160c072fa0 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7f160400f740 tx=0x7f160400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.151+0000 7f160a7fc700 1 -- 172.21.15.80:0/2014018886 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1604000c90 con 0x7f160c06c0a0 2019-11-28T11:26:04.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.151+0000 7f160a7fc700 1 -- 172.21.15.80:0/2014018886 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16040013a0 con 0x7f160c06c0a0 2019-11-28T11:26:04.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.151+0000 7f1611900700 1 -- 172.21.15.80:0/2014018886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c06c0a0 msgr2=0x7f160c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.151+0000 7f1611900700 1 --2- 172.21.15.80:0/2014018886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c06c0a0 0x7f160c072fa0 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7f160400f740 tx=0x7f160400fae0).stop 2019-11-28T11:26:04.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.151+0000 7f1611900700 1 -- 172.21.15.80:0/2014018886 shutdown_connections 2019-11-28T11:26:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.151+0000 7f1611900700 1 --2- 172.21.15.80:0/2014018886 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f160c072620 0x7f160c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.151+0000 7f1611900700 1 --2- 172.21.15.80:0/2014018886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c06c0a0 0x7f160c072fa0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.151+0000 7f1611900700 1 -- 172.21.15.80:0/2014018886 shutdown_connections 2019-11-28T11:26:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.151+0000 7f1611900700 1 -- 172.21.15.80:0/2014018886 wait complete. 2019-11-28T11:26:04.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.151+0000 7f1611900700 1 -- 172.21.15.80:0/2014018886 >> 172.21.15.80:0/2014018886 conn(0x7f160c061cf0 msgr2=0x7f160c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.154+0000 7f1611900700 1 Processor -- start 2019-11-28T11:26:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.154+0000 7f1611900700 1 -- start start 2019-11-28T11:26:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f1611900700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f160c104c10 0x7f160c1050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f1611900700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f160c1055e0 0x7f160c167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:04.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f1611900700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160c105a30 con 0x7f160c104820 2019-11-28T11:26:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f1611900700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c109130 con 0x7f160c1055e0 2019-11-28T11:26:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f1611900700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c109400 con 0x7f160c104c10 2019-11-28T11:26:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f160bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f160c1055e0 0x7f160c167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f160bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f160c1055e0 0x7f160c167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60622/0 (socket says 172.21.15.80:60622) 2019-11-28T11:26:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f160bfff700 1 -- 172.21.15.80:0/2042801025 learned_addr learned my addr 172.21.15.80:0/2042801025 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f160affd700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f160c104c10 0x7f160c1050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f160bfff700 1 -- 172.21.15.80:0/2042801025 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f160c104c10 msgr2=0x7f160c1050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f160bfff700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f160c104c10 0x7f160c1050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:04.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f160bfff700 1 -- 172.21.15.80:0/2042801025 >> v1:172.21.15.174:6789/0 conn(0x7f160c104820 legacy=0x7f160c10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f160bfff700 1 -- 172.21.15.80:0/2042801025 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c109a90 con 0x7f160c1055e0 2019-11-28T11:26:04.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f160affd700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f160c104c10 0x7f160c1050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:26:04.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f160bfff700 1 --2- 172.21.15.80:0/2042801025 >> v2:172.21.15.80:3300/0 conn(0x7f160c1055e0 0x7f160c167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15fc0107f0 tx=0x7f15fc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f160bfff700 1 --2- 172.21.15.80:0/2042801025 >> v2:172.21.15.80:3300/0 conn(0x7f160c1055e0 0x7f160c167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15fc0107f0 tx=0x7f15fc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f160bfff700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c1055e0 0x7f160c167a10 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7f15fc0107f0 tx=0x7f15fc010b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:04.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f160bfff700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c1055e0 0x7f160c167a10 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f15fc0107f0 tx=0x7f15fc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f160bfff700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c1055e0 0x7f160c167a10 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f15fc0107f0 tx=0x7f15fc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f1603fff700 1 -- 172.21.15.80:0/2042801025 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15fc0017e0 con 0x7f160c1055e0 2019-11-28T11:26:04.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f160bfff700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c1055e0 0x7f160c167a10 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f15fc0107f0 tx=0x7f15fc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f1603fff700 1 -- 172.21.15.80:0/2042801025 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc001400 con 0x7f160c1055e0 2019-11-28T11:26:04.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f1611900700 1 -- 172.21.15.80:0/2042801025 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160c109e10 con 0x7f160c1055e0 2019-11-28T11:26:04.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f1603fff700 1 -- 172.21.15.80:0/2042801025 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15fc001dc0 con 0x7f160c1055e0 2019-11-28T11:26:04.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.155+0000 7f1611900700 1 -- 172.21.15.80:0/2042801025 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c109a90 con 0x7f160c1055e0 2019-11-28T11:26:04.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.156+0000 7f160bfff700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c1055e0 0x7f160c167a10 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f15fc0107f0 tx=0x7f15fc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.156+0000 7f1603fff700 1 -- 172.21.15.80:0/2042801025 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f15fc0015f0 con 0x7f160c1055e0 2019-11-28T11:26:04.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.156+0000 7f160bfff700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c1055e0 0x7f160c167a10 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f15fc0107f0 tx=0x7f15fc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.156+0000 7f1603fff700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15f0018730 0x7f15f001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:04.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.156+0000 7f1603fff700 1 -- 172.21.15.80:0/2042801025 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f15fc031e40 con 0x7f160c1055e0 2019-11-28T11:26:04.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.156+0000 7f160b7fe700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15f0018730 0x7f15f001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.157+0000 7f160b7fe700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15f0018730 0x7f15f001abc0 crc :-1 s=READY pgs=149 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:04.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.164+0000 7f1611900700 1 -- 172.21.15.80:0/2042801025 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160c109e10 con 0x7f160c1055e0 2019-11-28T11:26:04.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.167+0000 7f160bfff700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c1055e0 0x7f160c167a10 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f15fc0107f0 tx=0x7f15fc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.167+0000 7f1603fff700 1 -- 172.21.15.80:0/2042801025 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f15fc02df50 con 0x7f160c1055e0 2019-11-28T11:26:04.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.342+0000 7f1611900700 1 -- 172.21.15.80:0/2042801025 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f160c109a90 con 0x7f160c1055e0 2019-11-28T11:26:04.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.343+0000 7f160bfff700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c1055e0 0x7f160c167a10 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f15fc0107f0 tx=0x7f15fc010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.343+0000 7f1603fff700 1 -- 172.21.15.80:0/2042801025 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+14883 (secure 0 0 0) 0x7f15fc02df50 con 0x7f160c1055e0 2019-11-28T11:26:04.365 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:04.365 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":34,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:26:04.004759+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:26:02.362569+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2019-11-28T11:26:03.001170+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:26:04.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.345+0000 7f1611900700 1 -- 172.21.15.80:0/2042801025 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15f0018730 msgr2=0x7f15f001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.345+0000 7f1611900700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15f0018730 0x7f15f001abc0 crc :-1 s=READY pgs=149 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:04.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.345+0000 7f1611900700 1 -- 172.21.15.80:0/2042801025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c1055e0 msgr2=0x7f160c167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.345+0000 7f1611900700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c1055e0 0x7f160c167a10 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7f15fc0107f0 tx=0x7f15fc010b90).stop 2019-11-28T11:26:04.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.345+0000 7f1611900700 1 -- 172.21.15.80:0/2042801025 shutdown_connections 2019-11-28T11:26:04.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.345+0000 7f1611900700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f160c1055e0 0x7f160c167a10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:04.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.345+0000 7f1611900700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f160c104c10 0x7f160c1050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:04.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.345+0000 7f1611900700 1 --2- 172.21.15.80:0/2042801025 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15f0018730 0x7f15f001abc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:04.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.345+0000 7f1611900700 1 -- 172.21.15.80:0/2042801025 shutdown_connections 2019-11-28T11:26:04.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.345+0000 7f1611900700 1 -- 172.21.15.80:0/2042801025 wait complete. 2019-11-28T11:26:04.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.345+0000 7f1611900700 1 -- 172.21.15.80:0/2042801025 >> 172.21.15.80:0/2042801025 conn(0x7f160c13d620 msgr2=0x7f160c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:04.377 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:26:04.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.476+0000 7f7887f0a700 1 Processor -- start 2019-11-28T11:26:04.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.476+0000 7f7887f0a700 1 -- start start 2019-11-28T11:26:04.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.477+0000 7f7887f0a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f788006c490 0x7f788006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:04.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.477+0000 7f7887f0a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f788006ce60 0x7f7880164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:04.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.477+0000 7f7887f0a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788006db00 con 0x7f788006c0a0 2019-11-28T11:26:04.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.477+0000 7f7887f0a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788006fd60 con 0x7f788006ce60 2019-11-28T11:26:04.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.477+0000 7f7887f0a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7880070030 con 0x7f788006c490 2019-11-28T11:26:04.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.477+0000 7f78864a7700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f788006c0a0 0x7f7880072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59942/0 (socket says 172.21.15.80:59942) 2019-11-28T11:26:04.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.477+0000 7f78864a7700 1 -- 172.21.15.80:0/36401573 learned_addr learned my addr 172.21.15.80:0/36401573 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:04.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.477+0000 7f7885ca6700 1 --2- 172.21.15.80:0/36401573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f788006c490 0x7f788006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.477+0000 7f7886ca8700 1 --2- 172.21.15.80:0/36401573 >> v2:172.21.15.174:3300/0 conn(0x7f788006ce60 0x7f7880164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.477+0000 7f78854a5700 1 -- 172.21.15.80:0/36401573 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091449654 0 0) 0x7f78680014d0 con 0x7f788006c0a0 2019-11-28T11:26:04.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.477+0000 7f78854a5700 1 -- 172.21.15.80:0/36401573 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f786c002e80 con 0x7f788006c0a0 2019-11-28T11:26:04.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f7886ca8700 1 -- 172.21.15.80:0/36401573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f788006c490 msgr2=0x7f788006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:04.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f7886ca8700 1 --2- 172.21.15.80:0/36401573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f788006c490 0x7f788006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:04.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f78854a5700 1 -- 172.21.15.80:0/36401573 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 981569887 0 0) 0x7f78680014b0 con 0x7f788006c0a0 2019-11-28T11:26:04.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f7886ca8700 1 -- 172.21.15.80:0/36401573 >> v1:172.21.15.80:6789/0 conn(0x7f788006c0a0 legacy=0x7f7880072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f7886ca8700 1 -- 172.21.15.80:0/36401573 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78800706c0 con 0x7f788006ce60 2019-11-28T11:26:04.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f7885ca6700 1 --2- 172.21.15.80:0/36401573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f788006c490 0x7f788006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:04.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f7886ca8700 1 --2- 172.21.15.80:0/36401573 >> v2:172.21.15.174:3300/0 conn(0x7f788006ce60 0x7f7880164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f787800af80 tx=0x7f787800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f7886ca8700 1 --2- 172.21.15.80:0/36401573 >> v2:172.21.15.174:3300/0 conn(0x7f788006ce60 0x7f7880164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f787800af80 tx=0x7f787800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f7886ca8700 1 --2- 172.21.15.80:0/36401573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f788006ce60 0x7f7880164d70 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7f787800af80 tx=0x7f787800b790).ready entity=mon.1 client_cookie=ddb1eeaba294759d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:04.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f7886ca8700 1 --2- 172.21.15.80:0/36401573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f788006ce60 0x7f7880164d70 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f787800af80 tx=0x7f787800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f78854a5700 1 -- 172.21.15.80:0/36401573 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7878000bc0 con 0x7f788006ce60 2019-11-28T11:26:04.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f7886ca8700 1 --2- 172.21.15.80:0/36401573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f788006ce60 0x7f7880164d70 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f787800af80 tx=0x7f787800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f7886ca8700 1 --2- 172.21.15.80:0/36401573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f788006ce60 0x7f7880164d70 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f787800af80 tx=0x7f787800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f78854a5700 1 -- 172.21.15.80:0/36401573 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78780097f0 con 0x7f788006ce60 2019-11-28T11:26:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f78854a5700 1 -- 172.21.15.80:0/36401573 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7878009ec0 con 0x7f788006ce60 2019-11-28T11:26:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f7887f0a700 1 -- 172.21.15.80:0/36401573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f788006ce60 msgr2=0x7f7880164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.478+0000 7f7887f0a700 1 --2- 172.21.15.80:0/36401573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f788006ce60 0x7f7880164d70 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7f787800af80 tx=0x7f787800b790).stop 2019-11-28T11:26:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.479+0000 7f7887f0a700 1 -- 172.21.15.80:0/36401573 shutdown_connections 2019-11-28T11:26:04.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.479+0000 7f7887f0a700 1 --2- 172.21.15.80:0/36401573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f788006ce60 0x7f7880164d70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:04.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.479+0000 7f7887f0a700 1 --2- 172.21.15.80:0/36401573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f788006c490 0x7f788006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:04.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.479+0000 7f7887f0a700 1 -- 172.21.15.80:0/36401573 shutdown_connections 2019-11-28T11:26:04.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.479+0000 7f7887f0a700 1 -- 172.21.15.80:0/36401573 wait complete. 2019-11-28T11:26:04.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.479+0000 7f7887f0a700 1 -- 172.21.15.80:0/36401573 >> 172.21.15.80:0/36401573 conn(0x7f7880061cf0 msgr2=0x7f7880064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:04.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.481+0000 7f7887f0a700 1 Processor -- start 2019-11-28T11:26:04.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.481+0000 7f7887f0a700 1 -- start start 2019-11-28T11:26:04.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.482+0000 7f7887f0a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f788013e320 0x7f788013e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:04.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.482+0000 7f7887f0a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7880139e00 con 0x7f788012a3c0 2019-11-28T11:26:04.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.482+0000 7f7887f0a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788013b4e0 con 0x7f788015fdf0 2019-11-28T11:26:04.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.482+0000 7f7887f0a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7880108820 con 0x7f788013e320 2019-11-28T11:26:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.482+0000 7f7886ca8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f788012a3c0 0x7f788012a810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59952/0 (socket says 172.21.15.80:59952) 2019-11-28T11:26:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.482+0000 7f7886ca8700 1 -- 172.21.15.80:0/3257828077 learned_addr learned my addr 172.21.15.80:0/3257828077 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.482+0000 7f7885ca6700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f788013e320 0x7f788013e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.482+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548751855 0 0) 0x7f787800aff0 con 0x7f788012a3c0 2019-11-28T11:26:04.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7864002e80 con 0x7f788012a3c0 2019-11-28T11:26:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239047430 0 0) 0x7f7868001480 con 0x7f788015fdf0 2019-11-28T11:26:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78640030b0 con 0x7f788015fdf0 2019-11-28T11:26:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2224044086 0 0) 0x7f787800acd0 con 0x7f788012a3c0 2019-11-28T11:26:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f78640033c0 con 0x7f788012a3c0 2019-11-28T11:26:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f7878009bb0 con 0x7f788012a3c0 2019-11-28T11:26:04.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f788013e320 msgr2=0x7f788013e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f787effd700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f788013e320 0x7f788013e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 >> v1:172.21.15.174:6789/0 conn(0x7f788015fdf0 legacy=0x7f788012b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 >> v1:172.21.15.80:6789/0 conn(0x7f788012a3c0 legacy=0x7f788012a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f787effd700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7864005d40 0x7f7864006130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f787effd700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78640046f0 0x7f7864004b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f787effd700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78640050d0 0x7f78640032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:04.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7864003940 con 0x7f78640050d0 2019-11-28T11:26:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7864003b70 con 0x7f7864005d40 2019-11-28T11:26:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7864003da0 con 0x7f78640046f0 2019-11-28T11:26:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f7886ca8700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78640050d0 0x7f78640032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f7885ca6700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78640046f0 0x7f7864004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f78864a7700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7864005d40 0x7f7864006130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f7886ca8700 1 -- 172.21.15.80:0/3257828077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78640046f0 msgr2=0x7f7864004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f7886ca8700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78640046f0 0x7f7864004b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f7886ca8700 1 -- 172.21.15.80:0/3257828077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7864005d40 msgr2=0x7f7864006130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f7886ca8700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7864005d40 0x7f7864006130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f7886ca8700 1 -- 172.21.15.80:0/3257828077 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7864004050 con 0x7f78640050d0 2019-11-28T11:26:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f7887f0a700 1 -- 172.21.15.80:0/3257828077 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788010a8c0 con 0x7f78640050d0 2019-11-28T11:26:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f7886ca8700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78640050d0 0x7f78640032e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7878010400 tx=0x7f7878010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f7887f0a700 1 -- 172.21.15.80:0/3257828077 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7880109180 con 0x7f78640050d0 2019-11-28T11:26:04.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f7886ca8700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78640050d0 0x7f78640032e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7878010400 tx=0x7f7878010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.483+0000 7f7886ca8700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78640050d0 0x7f78640032e0 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7f7878010400 tx=0x7f7878010330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.484+0000 7f7886ca8700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78640050d0 0x7f78640032e0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f7878010400 tx=0x7f7878010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.484+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7878002c30 con 0x7f78640050d0 2019-11-28T11:26:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.484+0000 7f7886ca8700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78640050d0 0x7f78640032e0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f7878010400 tx=0x7f7878010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.484+0000 7f7886ca8700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78640050d0 0x7f78640032e0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f7878010400 tx=0x7f7878010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.484+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787800acd0 con 0x7f78640050d0 2019-11-28T11:26:04.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.484+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7878009990 con 0x7f78640050d0 2019-11-28T11:26:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.484+0000 7f7886ca8700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78640050d0 0x7f78640032e0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f7878010400 tx=0x7f7878010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.484+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f78780095b0 con 0x7f78640050d0 2019-11-28T11:26:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.484+0000 7f7886ca8700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78640050d0 0x7f78640032e0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f7878010400 tx=0x7f7878010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.484+0000 7f787effd700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7864020b80 0x7f7864022fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.484+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7878031c50 con 0x7f78640050d0 2019-11-28T11:26:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.484+0000 7f78864a7700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7864020b80 0x7f7864022fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.485+0000 7f78864a7700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7864020b80 0x7f7864022fb0 crc :-1 s=READY pgs=150 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.491+0000 7f7887f0a700 1 -- 172.21.15.80:0/3257828077 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7858002e60 con 0x7f78640050d0 2019-11-28T11:26:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.495+0000 7f7886ca8700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78640050d0 0x7f78640032e0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f7878010400 tx=0x7f7878010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.495+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f787800aef0 con 0x7f78640050d0 2019-11-28T11:26:04.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.672+0000 7f7887f0a700 1 -- 172.21.15.80:0/3257828077 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7858001d10 con 0x7f78640050d0 2019-11-28T11:26:04.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.673+0000 7f7886ca8700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78640050d0 0x7f78640032e0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f7878010400 tx=0x7f7878010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.673+0000 7f787effd700 1 -- 172.21.15.80:0/3257828077 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+14883 (secure 0 0 0) 0x7f787800aef0 con 0x7f78640050d0 2019-11-28T11:26:04.710 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:04.711 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":34,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:26:04.004759+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:26:02.362569+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2019-11-28T11:26:03.001170+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:26:04.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.675+0000 7f7887f0a700 1 -- 172.21.15.80:0/3257828077 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7864020b80 msgr2=0x7f7864022fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.675+0000 7f7887f0a700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7864020b80 0x7f7864022fb0 crc :-1 s=READY pgs=150 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:04.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.675+0000 7f7887f0a700 1 -- 172.21.15.80:0/3257828077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78640050d0 msgr2=0x7f78640032e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.675+0000 7f7887f0a700 1 --2- 172.21.15.80:0/3257828077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78640050d0 0x7f78640032e0 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7f7878010400 tx=0x7f7878010330).stop 2019-11-28T11:26:04.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.675+0000 7f7886ca8700 1 -- 172.21.15.80:0/3257828077 reap_dead start 2019-11-28T11:26:04.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.675+0000 7f7886ca8700 1 -- 172.21.15.80:0/3257828077 reap_dead start 2019-11-28T11:26:04.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.675+0000 7f7887f0a700 1 -- 172.21.15.80:0/3257828077 shutdown_connections 2019-11-28T11:26:04.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.675+0000 7f7887f0a700 1 -- 172.21.15.80:0/3257828077 shutdown_connections 2019-11-28T11:26:04.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.675+0000 7f7887f0a700 1 -- 172.21.15.80:0/3257828077 wait complete. 2019-11-28T11:26:04.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.675+0000 7f7887f0a700 1 -- 172.21.15.80:0/3257828077 >> 172.21.15.80:0/3257828077 conn(0x7f7880127dc0 msgr2=0x7f7880141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:04.713 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:26:04.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.824+0000 7ff48eeb4700 1 Processor -- start 2019-11-28T11:26:04.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.824+0000 7ff48eeb4700 1 -- start start 2019-11-28T11:26:04.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.825+0000 7ff48eeb4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff48815ed10 0x7ff48815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:04.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.825+0000 7ff48eeb4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48806db60 con 0x7ff4880734b0 2019-11-28T11:26:04.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.825+0000 7ff48eeb4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48806e060 con 0x7ff488073020 2019-11-28T11:26:04.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.825+0000 7ff48eeb4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48806fe00 con 0x7ff48815ed10 2019-11-28T11:26:04.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.825+0000 7ff48dc52700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff4880734b0 0x7ff4880726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59962/0 (socket says 172.21.15.80:59962) 2019-11-28T11:26:04.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.825+0000 7ff48dc52700 1 -- 172.21.15.80:0/1568239330 learned_addr learned my addr 172.21.15.80:0/1568239330 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:04.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.825+0000 7ff48d451700 1 --2- 172.21.15.80:0/1568239330 >> v2:172.21.15.174:3300/0 conn(0x7ff48815ed10 0x7ff48815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 -- 172.21.15.80:0/1568239330 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028837718 0 0) 0x7ff480001150 con 0x7ff4880734b0 2019-11-28T11:26:04.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 -- 172.21.15.80:0/1568239330 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff474002e80 con 0x7ff4880734b0 2019-11-28T11:26:04.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 -- 172.21.15.80:0/1568239330 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055947447 0 0) 0x7ff478000ff0 con 0x7ff488073020 2019-11-28T11:26:04.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 -- 172.21.15.80:0/1568239330 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4740030b0 con 0x7ff488073020 2019-11-28T11:26:04.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 -- 172.21.15.80:0/1568239330 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1430824111 0 0) 0x7ff480001130 con 0x7ff4880734b0 2019-11-28T11:26:04.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 -- 172.21.15.80:0/1568239330 >> v2:172.21.15.174:3300/0 conn(0x7ff48815ed10 msgr2=0x7ff48815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:04.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 --2- 172.21.15.80:0/1568239330 >> v2:172.21.15.174:3300/0 conn(0x7ff48815ed10 0x7ff48815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:04.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 -- 172.21.15.80:0/1568239330 >> v1:172.21.15.174:6789/0 conn(0x7ff488073020 legacy=0x7ff488071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 -- 172.21.15.80:0/1568239330 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff488070760 con 0x7ff4880734b0 2019-11-28T11:26:04.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 -- 172.21.15.80:0/1568239330 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff480001660 con 0x7ff4880734b0 2019-11-28T11:26:04.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 -- 172.21.15.80:0/1568239330 >> v1:172.21.15.80:6789/0 conn(0x7ff4880734b0 legacy=0x7ff4880726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 --2- 172.21.15.80:0/1568239330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff474003b30 0x7ff474005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:04.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 --2- 172.21.15.80:0/1568239330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4740066c0 0x7ff474008b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:04.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 --2- 172.21.15.80:0/1568239330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff47404d3a0 0x7ff47404f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:04.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 -- 172.21.15.80:0/1568239330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47404fff0 con 0x7ff47404d3a0 2019-11-28T11:26:04.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 -- 172.21.15.80:0/1568239330 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff474050220 con 0x7ff4740066c0 2019-11-28T11:26:04.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff487fff700 1 -- 172.21.15.80:0/1568239330 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff474050450 con 0x7ff474003b30 2019-11-28T11:26:04.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff48dc52700 1 --2- 172.21.15.80:0/1568239330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff47404d3a0 0x7ff47404f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff48d451700 1 --2- 172.21.15.80:0/1568239330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff474003b30 0x7ff474005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff48cc50700 1 --2- 172.21.15.80:0/1568239330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4740066c0 0x7ff474008b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff48dc52700 1 -- 172.21.15.80:0/1568239330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff474003b30 msgr2=0x7ff474005f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:04.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff48dc52700 1 --2- 172.21.15.80:0/1568239330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff474003b30 0x7ff474005f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:04.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff48dc52700 1 -- 172.21.15.80:0/1568239330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4740066c0 msgr2=0x7ff474008b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:04.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff48dc52700 1 --2- 172.21.15.80:0/1568239330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4740066c0 0x7ff474008b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:04.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff48dc52700 1 -- 172.21.15.80:0/1568239330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff474050700 con 0x7ff47404d3a0 2019-11-28T11:26:04.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff48dc52700 1 --2- 172.21.15.80:0/1568239330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff47404d3a0 0x7ff47404f870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff48000f910 tx=0x7ff48000f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff48dc52700 1 -- 172.21.15.80:0/1568239330 reap_dead start 2019-11-28T11:26:04.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff48dc52700 1 --2- 172.21.15.80:0/1568239330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff47404d3a0 0x7ff47404f870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff48000f910 tx=0x7ff48000f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.826+0000 7ff48dc52700 1 --2- 172.21.15.80:0/1568239330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff47404d3a0 0x7ff47404f870 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7ff48000f910 tx=0x7ff48000f810).ready entity=mon.0 client_cookie=d23b08507a5500e7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:04.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.827+0000 7ff48dc52700 1 --2- 172.21.15.80:0/1568239330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff47404d3a0 0x7ff47404f870 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7ff48000f910 tx=0x7ff48000f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.827+0000 7ff48dc52700 1 --2- 172.21.15.80:0/1568239330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff47404d3a0 0x7ff47404f870 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7ff48000f910 tx=0x7ff48000f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.827+0000 7ff487fff700 1 -- 172.21.15.80:0/1568239330 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff480000980 con 0x7ff47404d3a0 2019-11-28T11:26:04.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.827+0000 7ff48dc52700 1 --2- 172.21.15.80:0/1568239330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff47404d3a0 0x7ff47404f870 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7ff48000f910 tx=0x7ff48000f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.827+0000 7ff487fff700 1 -- 172.21.15.80:0/1568239330 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff480004240 con 0x7ff47404d3a0 2019-11-28T11:26:04.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.827+0000 7ff487fff700 1 -- 172.21.15.80:0/1568239330 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff480004910 con 0x7ff47404d3a0 2019-11-28T11:26:04.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.827+0000 7ff48eeb4700 1 -- 172.21.15.80:0/1568239330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff47404d3a0 msgr2=0x7ff47404f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.827+0000 7ff48eeb4700 1 --2- 172.21.15.80:0/1568239330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff47404d3a0 0x7ff47404f870 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7ff48000f910 tx=0x7ff48000f810).stop 2019-11-28T11:26:04.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.827+0000 7ff48eeb4700 1 -- 172.21.15.80:0/1568239330 shutdown_connections 2019-11-28T11:26:04.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.827+0000 7ff48eeb4700 1 --2- 172.21.15.80:0/1568239330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff47404d3a0 0x7ff47404f870 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:04.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.827+0000 7ff48eeb4700 1 -- 172.21.15.80:0/1568239330 shutdown_connections 2019-11-28T11:26:04.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.827+0000 7ff48eeb4700 1 -- 172.21.15.80:0/1568239330 wait complete. 2019-11-28T11:26:04.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.827+0000 7ff48eeb4700 1 -- 172.21.15.80:0/1568239330 >> 172.21.15.80:0/1568239330 conn(0x7ff488061d20 msgr2=0x7ff4880641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:04.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.830+0000 7ff48eeb4700 1 Processor -- start 2019-11-28T11:26:04.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.830+0000 7ff48eeb4700 1 -- start start 2019-11-28T11:26:04.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.831+0000 7ff48eeb4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff4881502e0 0x7ff488150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:04.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.831+0000 7ff48eeb4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff488133a20 con 0x7ff488108630 2019-11-28T11:26:04.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.831+0000 7ff48eeb4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff488109fc0 con 0x7ff488150cb0 2019-11-28T11:26:04.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.831+0000 7ff48eeb4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff488131980 con 0x7ff4881502e0 2019-11-28T11:26:04.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.831+0000 7ff48cc50700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff4881502e0 0x7ff488150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.831+0000 7ff48d451700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff488108630 0x7ff488151200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59976/0 (socket says 172.21.15.80:59976) 2019-11-28T11:26:04.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.831+0000 7ff48cc50700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff4881502e0 0x7ff488150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60660/0 (socket says 172.21.15.80:60660) 2019-11-28T11:26:04.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.831+0000 7ff48d451700 1 -- 172.21.15.80:0/3684739491 learned_addr learned my addr 172.21.15.80:0/3684739491 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:04.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.831+0000 7ff48cc50700 1 -- 172.21.15.80:0/3684739491 >> v1:172.21.15.174:6789/0 conn(0x7ff488150cb0 legacy=0x7ff488167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.831+0000 7ff48cc50700 1 -- 172.21.15.80:0/3684739491 >> v1:172.21.15.80:6789/0 conn(0x7ff488108630 legacy=0x7ff488151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:04.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.831+0000 7ff485ffb700 1 -- 172.21.15.80:0/3684739491 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827855594 0 0) 0x7ff470001430 con 0x7ff488108630 2019-11-28T11:26:04.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.831+0000 7ff48cc50700 1 -- 172.21.15.80:0/3684739491 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4881322e0 con 0x7ff4881502e0 2019-11-28T11:26:04.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.831+0000 7ff48cc50700 1 --2- 172.21.15.80:0/3684739491 >> v2:172.21.15.80:3300/0 conn(0x7ff4881502e0 0x7ff488150770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4780124f0 tx=0x7ff478012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.831+0000 7ff48cc50700 1 --2- 172.21.15.80:0/3684739491 >> v2:172.21.15.80:3300/0 conn(0x7ff4881502e0 0x7ff488150770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4780124f0 tx=0x7ff478012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.831+0000 7ff48cc50700 1 --2- 172.21.15.80:0/3684739491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4881502e0 0x7ff488150770 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7ff4780124f0 tx=0x7ff478012890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:04.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.832+0000 7ff48cc50700 1 --2- 172.21.15.80:0/3684739491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4881502e0 0x7ff488150770 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7ff4780124f0 tx=0x7ff478012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.832+0000 7ff485ffb700 1 -- 172.21.15.80:0/3684739491 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff478000940 con 0x7ff4881502e0 2019-11-28T11:26:04.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.832+0000 7ff48cc50700 1 --2- 172.21.15.80:0/3684739491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4881502e0 0x7ff488150770 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7ff4780124f0 tx=0x7ff478012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.832+0000 7ff48cc50700 1 --2- 172.21.15.80:0/3684739491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4881502e0 0x7ff488150770 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7ff4780124f0 tx=0x7ff478012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.832+0000 7ff485ffb700 1 -- 172.21.15.80:0/3684739491 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4780053d0 con 0x7ff4881502e0 2019-11-28T11:26:04.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.832+0000 7ff48eeb4700 1 -- 172.21.15.80:0/3684739491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff488132660 con 0x7ff4881502e0 2019-11-28T11:26:04.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.832+0000 7ff485ffb700 1 -- 172.21.15.80:0/3684739491 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4780061f0 con 0x7ff4881502e0 2019-11-28T11:26:04.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.832+0000 7ff48eeb4700 1 -- 172.21.15.80:0/3684739491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4881322e0 con 0x7ff4881502e0 2019-11-28T11:26:04.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.832+0000 7ff48cc50700 1 --2- 172.21.15.80:0/3684739491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4881502e0 0x7ff488150770 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7ff4780124f0 tx=0x7ff478012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.833+0000 7ff485ffb700 1 -- 172.21.15.80:0/3684739491 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff47800ea70 con 0x7ff4881502e0 2019-11-28T11:26:04.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.833+0000 7ff48cc50700 1 --2- 172.21.15.80:0/3684739491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4881502e0 0x7ff488150770 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7ff4780124f0 tx=0x7ff478012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.833+0000 7ff485ffb700 1 --2- 172.21.15.80:0/3684739491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff46c018730 0x7ff46c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:04.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.833+0000 7ff485ffb700 1 -- 172.21.15.80:0/3684739491 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff478033c70 con 0x7ff4881502e0 2019-11-28T11:26:04.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.833+0000 7ff48d451700 1 --2- 172.21.15.80:0/3684739491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff46c018730 0x7ff46c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:04.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.833+0000 7ff48d451700 1 --2- 172.21.15.80:0/3684739491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff46c018730 0x7ff46c01abc0 crc :-1 s=READY pgs=151 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:04.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.839+0000 7ff48eeb4700 1 -- 172.21.15.80:0/3684739491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff488132660 con 0x7ff4881502e0 2019-11-28T11:26:04.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.843+0000 7ff48cc50700 1 --2- 172.21.15.80:0/3684739491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4881502e0 0x7ff488150770 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7ff4780124f0 tx=0x7ff478012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:04.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:04.843+0000 7ff485ffb700 1 -- 172.21.15.80:0/3684739491 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff4780051c0 con 0x7ff4881502e0 2019-11-28T11:26:05.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:05.017+0000 7ff48eeb4700 1 -- 172.21.15.80:0/3684739491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7ff4881322e0 con 0x7ff4881502e0 2019-11-28T11:26:06.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.010+0000 7ff48cc50700 1 --2- 172.21.15.80:0/3684739491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4881502e0 0x7ff488150770 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7ff4780124f0 tx=0x7ff478012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.010+0000 7ff485ffb700 1 -- 172.21.15.80:0/3684739491 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v11) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff47800ea70 con 0x7ff4881502e0 2019-11-28T11:26:06.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.034+0000 7ff48eeb4700 1 -- 172.21.15.80:0/3684739491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff46c018730 msgr2=0x7ff46c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.034+0000 7ff48eeb4700 1 --2- 172.21.15.80:0/3684739491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff46c018730 0x7ff46c01abc0 crc :-1 s=READY pgs=151 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:06.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.034+0000 7ff48eeb4700 1 -- 172.21.15.80:0/3684739491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4881502e0 msgr2=0x7ff488150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.034+0000 7ff48eeb4700 1 --2- 172.21.15.80:0/3684739491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4881502e0 0x7ff488150770 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7ff4780124f0 tx=0x7ff478012890).stop 2019-11-28T11:26:06.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.034+0000 7ff48eeb4700 1 -- 172.21.15.80:0/3684739491 shutdown_connections 2019-11-28T11:26:06.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.034+0000 7ff48eeb4700 1 --2- 172.21.15.80:0/3684739491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff46c018730 0x7ff46c01abc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:06.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.034+0000 7ff48eeb4700 1 --2- 172.21.15.80:0/3684739491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff4881502e0 0x7ff488150770 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:06.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.035+0000 7ff48eeb4700 1 -- 172.21.15.80:0/3684739491 shutdown_connections 2019-11-28T11:26:06.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.035+0000 7ff48eeb4700 1 -- 172.21.15.80:0/3684739491 wait complete. 2019-11-28T11:26:06.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.035+0000 7ff48eeb4700 1 -- 172.21.15.80:0/3684739491 >> 172.21.15.80:0/3684739491 conn(0x7ff48814dbb0 msgr2=0x7ff488142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:06.065 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:26:06.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.164+0000 7f4d59c6a700 1 Processor -- start 2019-11-28T11:26:06.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.164+0000 7f4d59c6a700 1 -- start start 2019-11-28T11:26:06.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d59c6a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4d5406c0a0 0x7f4d54072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:06.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d59c6a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d54072620 0x7f4d54164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:06.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d59c6a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5406db00 con 0x7f4d540734e0 2019-11-28T11:26:06.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d59c6a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5406fd60 con 0x7f4d5406c0a0 2019-11-28T11:26:06.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d59c6a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d54070030 con 0x7f4d54072620 2019-11-28T11:26:06.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d4bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4d540734e0 0x7f4d54071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59982/0 (socket says 172.21.15.80:59982) 2019-11-28T11:26:06.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d4bfff700 1 -- 172.21.15.80:0/781675175 learned_addr learned my addr 172.21.15.80:0/781675175 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:06.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d53fff700 1 --2- 172.21.15.80:0/781675175 >> v2:172.21.15.174:3300/0 conn(0x7f4d5406c0a0 0x7f4d54072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:06.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d58a08700 1 --2- 172.21.15.80:0/781675175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d54072620 0x7f4d54164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:06.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d537fe700 1 -- 172.21.15.80:0/781675175 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23588329 0 0) 0x7f4d3c001150 con 0x7f4d540734e0 2019-11-28T11:26:06.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d537fe700 1 -- 172.21.15.80:0/781675175 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d40002e80 con 0x7f4d540734e0 2019-11-28T11:26:06.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d58a08700 1 -- 172.21.15.80:0/781675175 >> v2:172.21.15.174:3300/0 conn(0x7f4d5406c0a0 msgr2=0x7f4d54072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:06.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d58a08700 1 --2- 172.21.15.80:0/781675175 >> v2:172.21.15.174:3300/0 conn(0x7f4d5406c0a0 0x7f4d54072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:06.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d537fe700 1 -- 172.21.15.80:0/781675175 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 270361797 0 0) 0x7f4d3c001130 con 0x7f4d540734e0 2019-11-28T11:26:06.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d58a08700 1 -- 172.21.15.80:0/781675175 >> v1:172.21.15.80:6789/0 conn(0x7f4d540734e0 legacy=0x7f4d54071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d58a08700 1 -- 172.21.15.80:0/781675175 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540706c0 con 0x7f4d54072620 2019-11-28T11:26:06.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.165+0000 7f4d53fff700 1 --2- 172.21.15.80:0/781675175 >> v2:172.21.15.174:3300/0 conn(0x7f4d5406c0a0 0x7f4d54072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:06.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.166+0000 7f4d58a08700 1 --2- 172.21.15.80:0/781675175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d54072620 0x7f4d54164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4d4c00b300 tx=0x7f4d4c00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.166+0000 7f4d58a08700 1 --2- 172.21.15.80:0/781675175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d54072620 0x7f4d54164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4d4c00b300 tx=0x7f4d4c00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.166+0000 7f4d58a08700 1 --2- 172.21.15.80:0/781675175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d54072620 0x7f4d54164d70 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f4d4c00b300 tx=0x7f4d4c00bb10).ready entity=mon.2 client_cookie=7212b03009913b21 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:06.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.166+0000 7f4d58a08700 1 --2- 172.21.15.80:0/781675175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d54072620 0x7f4d54164d70 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f4d4c00b300 tx=0x7f4d4c00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.166+0000 7f4d537fe700 1 -- 172.21.15.80:0/781675175 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d4c000f40 con 0x7f4d54072620 2019-11-28T11:26:06.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.166+0000 7f4d58a08700 1 --2- 172.21.15.80:0/781675175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d54072620 0x7f4d54164d70 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f4d4c00b300 tx=0x7f4d4c00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.166+0000 7f4d58a08700 1 --2- 172.21.15.80:0/781675175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d54072620 0x7f4d54164d70 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f4d4c00b300 tx=0x7f4d4c00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.166+0000 7f4d537fe700 1 -- 172.21.15.80:0/781675175 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c009b70 con 0x7f4d54072620 2019-11-28T11:26:06.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.166+0000 7f4d537fe700 1 -- 172.21.15.80:0/781675175 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d4c00a240 con 0x7f4d54072620 2019-11-28T11:26:06.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.166+0000 7f4d59c6a700 1 -- 172.21.15.80:0/781675175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d54072620 msgr2=0x7f4d54164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.166+0000 7f4d59c6a700 1 --2- 172.21.15.80:0/781675175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d54072620 0x7f4d54164d70 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f4d4c00b300 tx=0x7f4d4c00bb10).stop 2019-11-28T11:26:06.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.167+0000 7f4d59c6a700 1 -- 172.21.15.80:0/781675175 shutdown_connections 2019-11-28T11:26:06.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.167+0000 7f4d59c6a700 1 --2- 172.21.15.80:0/781675175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d54072620 0x7f4d54164d70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:06.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.167+0000 7f4d59c6a700 1 --2- 172.21.15.80:0/781675175 >> v2:172.21.15.174:3300/0 conn(0x7f4d5406c0a0 0x7f4d54072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:06.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.167+0000 7f4d59c6a700 1 -- 172.21.15.80:0/781675175 shutdown_connections 2019-11-28T11:26:06.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.167+0000 7f4d59c6a700 1 -- 172.21.15.80:0/781675175 wait complete. 2019-11-28T11:26:06.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.167+0000 7f4d59c6a700 1 -- 172.21.15.80:0/781675175 >> 172.21.15.80:0/781675175 conn(0x7f4d54061cf0 msgr2=0x7f4d54064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:06.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.169+0000 7f4d59c6a700 1 Processor -- start 2019-11-28T11:26:06.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.169+0000 7f4d59c6a700 1 -- start start 2019-11-28T11:26:06.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d59c6a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4d5413e5f0 0x7f4d5413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:06.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d59c6a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4d5410a4e0 0x7f4d5410c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:06.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d59c6a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d541066e0 con 0x7f4d5410a070 2019-11-28T11:26:06.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d59c6a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5410e060 con 0x7f4d5410a4e0 2019-11-28T11:26:06.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d59c6a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5410e330 con 0x7f4d5413e5f0 2019-11-28T11:26:06.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d58a08700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4d5410a4e0 0x7f4d5410c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:06.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d58a08700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4d5410a4e0 0x7f4d5410c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60676/0 (socket says 172.21.15.80:60676) 2019-11-28T11:26:06.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d58a08700 1 -- 172.21.15.80:0/2032643404 learned_addr learned my addr 172.21.15.80:0/2032643404 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:06.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d4bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4d5410a070 0x7f4d5410bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59988/0 (socket says 172.21.15.80:59988) 2019-11-28T11:26:06.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d53fff700 1 --2- 172.21.15.80:0/2032643404 >> v2:172.21.15.174:3300/0 conn(0x7f4d5413e5f0 0x7f4d5413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:06.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d58a08700 1 -- 172.21.15.80:0/2032643404 >> v2:172.21.15.174:3300/0 conn(0x7f4d5413e5f0 msgr2=0x7f4d5413e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d58a08700 1 --2- 172.21.15.80:0/2032643404 >> v2:172.21.15.174:3300/0 conn(0x7f4d5413e5f0 0x7f4d5413e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:06.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d58a08700 1 -- 172.21.15.80:0/2032643404 >> v1:172.21.15.80:6789/0 conn(0x7f4d5410a070 legacy=0x7f4d5410bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d517fa700 1 -- 172.21.15.80:0/2032643404 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040947342 0 0) 0x7f4d3c000f40 con 0x7f4d5410a070 2019-11-28T11:26:06.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d58a08700 1 -- 172.21.15.80:0/2032643404 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5410e9c0 con 0x7f4d5410a4e0 2019-11-28T11:26:06.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d58a08700 1 --2- 172.21.15.80:0/2032643404 >> v2:172.21.15.80:3300/0 conn(0x7f4d5410a4e0 0x7f4d5410c5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d4c0107d0 tx=0x7f4d4c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d58a08700 1 --2- 172.21.15.80:0/2032643404 >> v2:172.21.15.80:3300/0 conn(0x7f4d5410a4e0 0x7f4d5410c5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d4c0107d0 tx=0x7f4d4c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d58a08700 1 --2- 172.21.15.80:0/2032643404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d5410a4e0 0x7f4d5410c5b0 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f4d4c0107d0 tx=0x7f4d4c010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:06.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d58a08700 1 --2- 172.21.15.80:0/2032643404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d5410a4e0 0x7f4d5410c5b0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f4d4c0107d0 tx=0x7f4d4c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d517fa700 1 -- 172.21.15.80:0/2032643404 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d4c00b2e0 con 0x7f4d5410a4e0 2019-11-28T11:26:06.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d58a08700 1 --2- 172.21.15.80:0/2032643404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d5410a4e0 0x7f4d5410c5b0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f4d4c0107d0 tx=0x7f4d4c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.170+0000 7f4d59c6a700 1 -- 172.21.15.80:0/2032643404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5410ed40 con 0x7f4d5410a4e0 2019-11-28T11:26:06.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.171+0000 7f4d517fa700 1 -- 172.21.15.80:0/2032643404 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c00af60 con 0x7f4d5410a4e0 2019-11-28T11:26:06.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.171+0000 7f4d58a08700 1 --2- 172.21.15.80:0/2032643404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d5410a4e0 0x7f4d5410c5b0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f4d4c0107d0 tx=0x7f4d4c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.171+0000 7f4d517fa700 1 -- 172.21.15.80:0/2032643404 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d4c00a010 con 0x7f4d5410a4e0 2019-11-28T11:26:06.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.171+0000 7f4d59c6a700 1 -- 172.21.15.80:0/2032643404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5410e9c0 con 0x7f4d5410a4e0 2019-11-28T11:26:06.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.171+0000 7f4d58a08700 1 --2- 172.21.15.80:0/2032643404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d5410a4e0 0x7f4d5410c5b0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f4d4c0107d0 tx=0x7f4d4c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.171+0000 7f4d517fa700 1 -- 172.21.15.80:0/2032643404 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4d4c009c30 con 0x7f4d5410a4e0 2019-11-28T11:26:06.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.171+0000 7f4d58a08700 1 --2- 172.21.15.80:0/2032643404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d5410a4e0 0x7f4d5410c5b0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f4d4c0107d0 tx=0x7f4d4c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.171+0000 7f4d517fa700 1 --2- 172.21.15.80:0/2032643404 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d38018730 0x7f4d3801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:06.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.171+0000 7f4d517fa700 1 -- 172.21.15.80:0/2032643404 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4d4c031e80 con 0x7f4d5410a4e0 2019-11-28T11:26:06.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.172+0000 7f4d53fff700 1 --2- 172.21.15.80:0/2032643404 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d38018730 0x7f4d3801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:06.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.172+0000 7f4d53fff700 1 --2- 172.21.15.80:0/2032643404 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d38018730 0x7f4d3801abc0 crc :-1 s=READY pgs=152 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:06.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.179+0000 7f4d59c6a700 1 -- 172.21.15.80:0/2032643404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5410ed40 con 0x7f4d5410a4e0 2019-11-28T11:26:06.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.182+0000 7f4d58a08700 1 --2- 172.21.15.80:0/2032643404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d5410a4e0 0x7f4d5410c5b0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f4d4c0107d0 tx=0x7f4d4c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.182+0000 7f4d517fa700 1 -- 172.21.15.80:0/2032643404 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4d4c009990 con 0x7f4d5410a4e0 2019-11-28T11:26:06.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.356+0000 7f4d59c6a700 1 -- 172.21.15.80:0/2032643404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d5410e9c0 con 0x7f4d5410a4e0 2019-11-28T11:26:06.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.357+0000 7f4d58a08700 1 --2- 172.21.15.80:0/2032643404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d5410a4e0 0x7f4d5410c5b0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f4d4c0107d0 tx=0x7f4d4c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.357+0000 7f4d517fa700 1 -- 172.21.15.80:0/2032643404 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1422 (secure 0 0 0) 0x7f4d4c00a570 con 0x7f4d5410a4e0 2019-11-28T11:26:06.379 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 11 2019-11-28T11:26:06.379 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:06.379 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:06.009581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:26:06.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.359+0000 7f4d59c6a700 1 -- 172.21.15.80:0/2032643404 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d38018730 msgr2=0x7f4d3801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.359+0000 7f4d59c6a700 1 --2- 172.21.15.80:0/2032643404 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d38018730 0x7f4d3801abc0 crc :-1 s=READY pgs=152 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:06.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.359+0000 7f4d59c6a700 1 -- 172.21.15.80:0/2032643404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d5410a4e0 msgr2=0x7f4d5410c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.359+0000 7f4d59c6a700 1 --2- 172.21.15.80:0/2032643404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d5410a4e0 0x7f4d5410c5b0 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f4d4c0107d0 tx=0x7f4d4c010600).stop 2019-11-28T11:26:06.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.359+0000 7f4d59c6a700 1 -- 172.21.15.80:0/2032643404 shutdown_connections 2019-11-28T11:26:06.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.359+0000 7f4d59c6a700 1 --2- 172.21.15.80:0/2032643404 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d38018730 0x7f4d3801abc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:06.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.359+0000 7f4d59c6a700 1 --2- 172.21.15.80:0/2032643404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d5410a4e0 0x7f4d5410c5b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:06.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.359+0000 7f4d59c6a700 1 --2- 172.21.15.80:0/2032643404 >> v2:172.21.15.174:3300/0 conn(0x7f4d5413e5f0 0x7f4d5413e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:06.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.359+0000 7f4d59c6a700 1 -- 172.21.15.80:0/2032643404 shutdown_connections 2019-11-28T11:26:06.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.359+0000 7f4d59c6a700 1 -- 172.21.15.80:0/2032643404 wait complete. 2019-11-28T11:26:06.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.359+0000 7f4d59c6a700 1 -- 172.21.15.80:0/2032643404 >> 172.21.15.80:0/2032643404 conn(0x7f4d5413d620 msgr2=0x7f4d5413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:06.390 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:26:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.488+0000 7f90df275700 1 Processor -- start 2019-11-28T11:26:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.488+0000 7f90df275700 1 -- start start 2019-11-28T11:26:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.489+0000 7f90df275700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90d806c0a0 0x7f90d8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.489+0000 7f90df275700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d806db00 con 0x7f90d80734e0 2019-11-28T11:26:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.489+0000 7f90df275700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d806e000 con 0x7f90d8072620 2019-11-28T11:26:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.489+0000 7f90df275700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d806fd60 con 0x7f90d806c0a0 2019-11-28T11:26:06.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90dd812700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90d806c0a0 0x7f90d8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:06.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90dd011700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f90d80734e0 0x7f90d8071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60000/0 (socket says 172.21.15.80:60000) 2019-11-28T11:26:06.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90dd011700 1 -- 172.21.15.80:0/3858991315 learned_addr learned my addr 172.21.15.80:0/3858991315 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:06.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90dd812700 1 -- 172.21.15.80:0/3858991315 >> v1:172.21.15.174:6789/0 conn(0x7f90d8072620 legacy=0x7f90d8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90dd812700 1 -- 172.21.15.80:0/3858991315 >> v1:172.21.15.80:6789/0 conn(0x7f90d80734e0 legacy=0x7f90d8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90dd812700 1 -- 172.21.15.80:0/3858991315 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d80706c0 con 0x7f90d806c0a0 2019-11-28T11:26:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90dc810700 1 -- 172.21.15.80:0/3858991315 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108832809 0 0) 0x7f90c0001070 con 0x7f90d80734e0 2019-11-28T11:26:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90dd812700 1 --2- 172.21.15.80:0/3858991315 >> v2:172.21.15.80:3300/0 conn(0x7f90d806c0a0 0x7f90d8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f90c800b2d0 tx=0x7f90c800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90dd812700 1 --2- 172.21.15.80:0/3858991315 >> v2:172.21.15.80:3300/0 conn(0x7f90d806c0a0 0x7f90d8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f90c800b2d0 tx=0x7f90c800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90dd812700 1 --2- 172.21.15.80:0/3858991315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d806c0a0 0x7f90d8072fa0 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7f90c800b2d0 tx=0x7f90c800bae0).ready entity=mon.0 client_cookie=963b4bcc44eff442 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90dd812700 1 --2- 172.21.15.80:0/3858991315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d806c0a0 0x7f90d8072fa0 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7f90c800b2d0 tx=0x7f90c800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90dc810700 1 -- 172.21.15.80:0/3858991315 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c8000ce0 con 0x7f90d806c0a0 2019-11-28T11:26:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90dd812700 1 --2- 172.21.15.80:0/3858991315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d806c0a0 0x7f90d8072fa0 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7f90c800b2d0 tx=0x7f90c800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90dd812700 1 --2- 172.21.15.80:0/3858991315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d806c0a0 0x7f90d8072fa0 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7f90c800b2d0 tx=0x7f90c800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90dc810700 1 -- 172.21.15.80:0/3858991315 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c8009be0 con 0x7f90d806c0a0 2019-11-28T11:26:06.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90dc810700 1 -- 172.21.15.80:0/3858991315 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c800a2b0 con 0x7f90d806c0a0 2019-11-28T11:26:06.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90df275700 1 -- 172.21.15.80:0/3858991315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d806c0a0 msgr2=0x7f90d8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.490+0000 7f90df275700 1 --2- 172.21.15.80:0/3858991315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d806c0a0 0x7f90d8072fa0 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7f90c800b2d0 tx=0x7f90c800bae0).stop 2019-11-28T11:26:06.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.491+0000 7f90df275700 1 -- 172.21.15.80:0/3858991315 shutdown_connections 2019-11-28T11:26:06.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.491+0000 7f90df275700 1 --2- 172.21.15.80:0/3858991315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d806c0a0 0x7f90d8072fa0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:06.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.491+0000 7f90df275700 1 -- 172.21.15.80:0/3858991315 shutdown_connections 2019-11-28T11:26:06.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.491+0000 7f90df275700 1 -- 172.21.15.80:0/3858991315 wait complete. 2019-11-28T11:26:06.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.491+0000 7f90df275700 1 -- 172.21.15.80:0/3858991315 >> 172.21.15.80:0/3858991315 conn(0x7f90d8061cf0 msgr2=0x7f90d8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:06.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.493+0000 7f90df275700 1 Processor -- start 2019-11-28T11:26:06.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.494+0000 7f90df275700 1 -- start start 2019-11-28T11:26:06.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.494+0000 7f90df275700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90d8112fb0 0x7f90d8113440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:06.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.494+0000 7f90df275700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90d8113980 0x7f90d8168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.494+0000 7f90df275700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d8113db0 con 0x7f90d813f580 2019-11-28T11:26:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.494+0000 7f90df275700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d81236b0 con 0x7f90d8112fb0 2019-11-28T11:26:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.494+0000 7f90df275700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8123980 con 0x7f90d8113980 2019-11-28T11:26:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.494+0000 7f90dd812700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f90d813f580 0x7f90d8114130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60002/0 (socket says 172.21.15.80:60002) 2019-11-28T11:26:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.494+0000 7f90dd812700 1 -- 172.21.15.80:0/2973788182 learned_addr learned my addr 172.21.15.80:0/2973788182 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.494+0000 7f90dd011700 1 --2- 172.21.15.80:0/2973788182 >> v2:172.21.15.80:3300/0 conn(0x7f90d8112fb0 0x7f90d8113440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90dd011700 1 -- 172.21.15.80:0/2973788182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90d8113980 msgr2=0x7f90d8168a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90dd011700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90d8113980 0x7f90d8168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90dd011700 1 -- 172.21.15.80:0/2973788182 >> v1:172.21.15.80:6789/0 conn(0x7f90d813f580 legacy=0x7f90d8114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90dd011700 1 -- 172.21.15.80:0/2973788182 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d8124010 con 0x7f90d8112fb0 2019-11-28T11:26:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90d67fc700 1 -- 172.21.15.80:0/2973788182 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398120019 0 0) 0x7f90c800b750 con 0x7f90d813f580 2019-11-28T11:26:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90dd011700 1 --2- 172.21.15.80:0/2973788182 >> v2:172.21.15.80:3300/0 conn(0x7f90d8112fb0 0x7f90d8113440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f90c00103a0 tx=0x7f90c00101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90dd011700 1 --2- 172.21.15.80:0/2973788182 >> v2:172.21.15.80:3300/0 conn(0x7f90d8112fb0 0x7f90d8113440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f90c00103a0 tx=0x7f90c00101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90dd011700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d8112fb0 0x7f90d8113440 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7f90c00103a0 tx=0x7f90c00101d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:06.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90dd011700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d8112fb0 0x7f90d8113440 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7f90c00103a0 tx=0x7f90c00101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90d67fc700 1 -- 172.21.15.80:0/2973788182 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c0001230 con 0x7f90d8112fb0 2019-11-28T11:26:06.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90dd011700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d8112fb0 0x7f90d8113440 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7f90c00103a0 tx=0x7f90c00101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90dd011700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d8112fb0 0x7f90d8113440 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7f90c00103a0 tx=0x7f90c00101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90d67fc700 1 -- 172.21.15.80:0/2973788182 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c0003fe0 con 0x7f90d8112fb0 2019-11-28T11:26:06.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90df275700 1 -- 172.21.15.80:0/2973788182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d8124010 con 0x7f90d8112fb0 2019-11-28T11:26:06.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90d67fc700 1 -- 172.21.15.80:0/2973788182 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c0004730 con 0x7f90d8112fb0 2019-11-28T11:26:06.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90df275700 1 -- 172.21.15.80:0/2973788182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d8124010 con 0x7f90d8112fb0 2019-11-28T11:26:06.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.495+0000 7f90dd011700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d8112fb0 0x7f90d8113440 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7f90c00103a0 tx=0x7f90c00101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.496+0000 7f90d67fc700 1 -- 172.21.15.80:0/2973788182 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f90c0000dd0 con 0x7f90d8112fb0 2019-11-28T11:26:06.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.496+0000 7f90dd011700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d8112fb0 0x7f90d8113440 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7f90c00103a0 tx=0x7f90c00101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.496+0000 7f90d67fc700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90bc018730 0x7f90bc01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:06.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.496+0000 7f90d67fc700 1 -- 172.21.15.80:0/2973788182 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f90c0031c50 con 0x7f90d8112fb0 2019-11-28T11:26:06.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.496+0000 7f90dd812700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90bc018730 0x7f90bc01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:06.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.497+0000 7f90dd812700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90bc018730 0x7f90bc01abe0 crc :-1 s=READY pgs=153 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:06.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.504+0000 7f90df275700 1 -- 172.21.15.80:0/2973788182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d8124010 con 0x7f90d8112fb0 2019-11-28T11:26:06.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.507+0000 7f90dd011700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d8112fb0 0x7f90d8113440 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7f90c00103a0 tx=0x7f90c00101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.507+0000 7f90d67fc700 1 -- 172.21.15.80:0/2973788182 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f90c0000940 con 0x7f90d8112fb0 2019-11-28T11:26:06.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.683+0000 7f90df275700 1 -- 172.21.15.80:0/2973788182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90d8124010 con 0x7f90d8112fb0 2019-11-28T11:26:06.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.684+0000 7f90dd011700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d8112fb0 0x7f90d8113440 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7f90c00103a0 tx=0x7f90c00101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.684+0000 7f90d67fc700 1 -- 172.21.15.80:0/2973788182 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+14857 (secure 0 0 0) 0x7f90c0000d10 con 0x7f90d8112fb0 2019-11-28T11:26:06.705 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:06.706 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":36,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:26:06.009891+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:26:02.362569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2019-11-28T11:26:03.001170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:26:06.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.686+0000 7f90df275700 1 -- 172.21.15.80:0/2973788182 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90bc018730 msgr2=0x7f90bc01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.686+0000 7f90df275700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90bc018730 0x7f90bc01abe0 crc :-1 s=READY pgs=153 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:06.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.686+0000 7f90df275700 1 -- 172.21.15.80:0/2973788182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d8112fb0 msgr2=0x7f90d8113440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.686+0000 7f90df275700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d8112fb0 0x7f90d8113440 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7f90c00103a0 tx=0x7f90c00101d0).stop 2019-11-28T11:26:06.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.686+0000 7f90df275700 1 -- 172.21.15.80:0/2973788182 shutdown_connections 2019-11-28T11:26:06.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.686+0000 7f90df275700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90bc018730 0x7f90bc01abe0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:06.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.686+0000 7f90df275700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90d8113980 0x7f90d8168a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:06.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.686+0000 7f90df275700 1 --2- 172.21.15.80:0/2973788182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d8112fb0 0x7f90d8113440 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:06.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.686+0000 7f90df275700 1 -- 172.21.15.80:0/2973788182 shutdown_connections 2019-11-28T11:26:06.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.686+0000 7f90df275700 1 -- 172.21.15.80:0/2973788182 wait complete. 2019-11-28T11:26:06.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.686+0000 7f90df275700 1 -- 172.21.15.80:0/2973788182 >> 172.21.15.80:0/2973788182 conn(0x7f90d81426c0 msgr2=0x7f90d8110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:06.718 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:26:06.718 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:26:06.719 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:26:06.719 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:26:06.719 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:26:06.720 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:26:06.724 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:26:06.724 DEBUG:teuthology.parallel:result is None 2019-11-28T11:26:06.725 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:26:06.725 DEBUG:teuthology.parallel:result is None 2019-11-28T11:26:06.726 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:26:06.726 DEBUG:teuthology.parallel:result is None 2019-11-28T11:26:06.726 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:26:06.816 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:26:06.820 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:26:06.822 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:26:06.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.840+0000 7f3713cf4700 1 Processor -- start 2019-11-28T11:26:06.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.840+0000 7f3713cf4700 1 -- start start 2019-11-28T11:26:06.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.841+0000 7f3713cf4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f370c15f100 0x7f370c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:06.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.841+0000 7f3713cf4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370c06db60 con 0x7f370c15ed10 2019-11-28T11:26:06.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.841+0000 7f3713cf4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370c06e060 con 0x7f370c06c2f0 2019-11-28T11:26:06.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.841+0000 7f3713cf4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c06fe00 con 0x7f370c15f100 2019-11-28T11:26:06.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.841+0000 7f3712291700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f370c15ed10 0x7f370c073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60032/0 (socket says 172.21.15.80:60032) 2019-11-28T11:26:06.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.841+0000 7f3712291700 1 -- 172.21.15.80:0/781564804 learned_addr learned my addr 172.21.15.80:0/781564804 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:06.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.841+0000 7f3711a90700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f370c15f100 0x7f370c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:06.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.841+0000 7f371128f700 1 -- 172.21.15.80:0/781564804 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223275933 0 0) 0x7f36fc0014d0 con 0x7f370c15ed10 2019-11-28T11:26:06.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.841+0000 7f371128f700 1 -- 172.21.15.80:0/781564804 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36f4002e80 con 0x7f370c15ed10 2019-11-28T11:26:06.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f371128f700 1 -- 172.21.15.80:0/781564804 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2047545839 0 0) 0x7f36fc0014b0 con 0x7f370c15ed10 2019-11-28T11:26:06.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f371128f700 1 -- 172.21.15.80:0/781564804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f370c15f100 msgr2=0x7f370c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:06.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f371128f700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f370c15f100 0x7f370c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:06.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f371128f700 1 -- 172.21.15.80:0/781564804 >> v1:172.21.15.174:6789/0 conn(0x7f370c06c2f0 legacy=0x7f370c06c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f371128f700 1 -- 172.21.15.80:0/781564804 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c070760 con 0x7f370c15ed10 2019-11-28T11:26:06.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f371128f700 1 -- 172.21.15.80:0/781564804 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f36fc0019e0 con 0x7f370c15ed10 2019-11-28T11:26:06.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f371128f700 1 -- 172.21.15.80:0/781564804 >> v1:172.21.15.80:6789/0 conn(0x7f370c15ed10 legacy=0x7f370c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f371128f700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f36f4003ab0 0x7f36f4005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:06.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f371128f700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36f4006670 0x7f36f4008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f371128f700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36f40093a0 0x7f36f400b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f371128f700 1 -- 172.21.15.80:0/781564804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f400bff0 con 0x7f36f4006670 2019-11-28T11:26:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f371128f700 1 -- 172.21.15.80:0/781564804 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f40501f0 con 0x7f36f4003ab0 2019-11-28T11:26:06.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f371128f700 1 -- 172.21.15.80:0/781564804 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f4050420 con 0x7f36f40093a0 2019-11-28T11:26:06.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3711a90700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36f4006670 0x7f36f4008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:06.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3712291700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f36f4003ab0 0x7f36f4005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:06.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3712a92700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36f40093a0 0x7f36f400b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3711a90700 1 -- 172.21.15.80:0/781564804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36f40093a0 msgr2=0x7f36f400b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3711a90700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36f40093a0 0x7f36f400b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3711a90700 1 -- 172.21.15.80:0/781564804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f36f4003ab0 msgr2=0x7f36f4005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:06.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3711a90700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f36f4003ab0 0x7f36f4005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:06.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3711a90700 1 -- 172.21.15.80:0/781564804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f40506d0 con 0x7f36f4006670 2019-11-28T11:26:06.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3712a92700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36f40093a0 0x7f36f400b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:26:06.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3711a90700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36f4006670 0x7f36f4008b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f370000b3f0 tx=0x7f370000b2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3711a90700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36f4006670 0x7f36f4008b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f370000b3f0 tx=0x7f370000b2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3711a90700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36f4006670 0x7f36f4008b40 secure :-1 s=READY pgs=360 cs=0 l=1 rx=0x7f370000b3f0 tx=0x7f370000b2c0).ready entity=mon.0 client_cookie=ed87ca1625ad7224 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:06.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3711a90700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36f4006670 0x7f36f4008b40 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7f370000b3f0 tx=0x7f370000b2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f371128f700 1 -- 172.21.15.80:0/781564804 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3700000960 con 0x7f36f4006670 2019-11-28T11:26:06.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3711a90700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36f4006670 0x7f36f4008b40 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7f370000b3f0 tx=0x7f370000b2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3711a90700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36f4006670 0x7f36f4008b40 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7f370000b3f0 tx=0x7f370000b2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f371128f700 1 -- 172.21.15.80:0/781564804 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37000089c0 con 0x7f36f4006670 2019-11-28T11:26:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f371128f700 1 -- 172.21.15.80:0/781564804 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3700008bb0 con 0x7f36f4006670 2019-11-28T11:26:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3713cf4700 1 -- 172.21.15.80:0/781564804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36f4006670 msgr2=0x7f36f4008b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3713cf4700 1 --2- 172.21.15.80:0/781564804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36f4006670 0x7f36f4008b40 secure :-1 s=READY pgs=360 cs=0 l=1 rx=0x7f370000b3f0 tx=0x7f370000b2c0).stop 2019-11-28T11:26:06.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.842+0000 7f3712a92700 1 -- 172.21.15.80:0/781564804 reap_dead start 2019-11-28T11:26:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.843+0000 7f3713cf4700 1 -- 172.21.15.80:0/781564804 shutdown_connections 2019-11-28T11:26:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.843+0000 7f3713cf4700 1 -- 172.21.15.80:0/781564804 shutdown_connections 2019-11-28T11:26:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.843+0000 7f3713cf4700 1 -- 172.21.15.80:0/781564804 wait complete. 2019-11-28T11:26:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.843+0000 7f3713cf4700 1 -- 172.21.15.80:0/781564804 >> 172.21.15.80:0/781564804 conn(0x7f370c061d40 msgr2=0x7f370c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:06.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.845+0000 7f3713cf4700 1 Processor -- start 2019-11-28T11:26:06.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.846+0000 7f3713cf4700 1 -- start start 2019-11-28T11:26:06.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.846+0000 7f3713cf4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f370c12e180 0x7f370c12e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:06.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.846+0000 7f3713cf4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f370c12eb50 0x7f370c137d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:06.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.846+0000 7f3713cf4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370c14bd30 con 0x7f370c14b3d0 2019-11-28T11:26:06.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.846+0000 7f3713cf4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370c10b6e0 con 0x7f370c12eb50 2019-11-28T11:26:06.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.846+0000 7f3713cf4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c10b9b0 con 0x7f370c12e180 2019-11-28T11:26:06.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.846+0000 7f3712291700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f370c14b3d0 0x7f370c138eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60044/0 (socket says 172.21.15.80:60044) 2019-11-28T11:26:06.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.846+0000 7f3712291700 1 -- 172.21.15.80:0/2215145168 learned_addr learned my addr 172.21.15.80:0/2215145168 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:06.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.846+0000 7f3712a92700 1 --2- 172.21.15.80:0/2215145168 >> v2:172.21.15.80:3300/0 conn(0x7f370c12eb50 0x7f370c137d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:06.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f3711a90700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f370c12e180 0x7f370c12e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:06.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f370affd700 1 -- 172.21.15.80:0/2215145168 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481139114 0 0) 0x7f36fc001490 con 0x7f370c14b3d0 2019-11-28T11:26:06.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f370affd700 1 -- 172.21.15.80:0/2215145168 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36ec002e80 con 0x7f370c14b3d0 2019-11-28T11:26:06.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f3712a92700 1 -- 172.21.15.80:0/2215145168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f370c12e180 msgr2=0x7f370c12e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f3712a92700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f370c12e180 0x7f370c12e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:06.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f3712a92700 1 -- 172.21.15.80:0/2215145168 >> v1:172.21.15.80:6789/0 conn(0x7f370c14b3d0 legacy=0x7f370c138eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:06.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f3712a92700 1 -- 172.21.15.80:0/2215145168 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c10c040 con 0x7f370c12eb50 2019-11-28T11:26:06.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f3712a92700 1 --2- 172.21.15.80:0/2215145168 >> v2:172.21.15.80:3300/0 conn(0x7f370c12eb50 0x7f370c137d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3704010360 tx=0x7f37040101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f3712a92700 1 --2- 172.21.15.80:0/2215145168 >> v2:172.21.15.80:3300/0 conn(0x7f370c12eb50 0x7f370c137d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3704010360 tx=0x7f37040101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f3712a92700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370c12eb50 0x7f370c137d30 secure :-1 s=READY pgs=362 cs=0 l=1 rx=0x7f3704010360 tx=0x7f37040101e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f3712a92700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370c12eb50 0x7f370c137d30 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f3704010360 tx=0x7f37040101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f3712a92700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370c12eb50 0x7f370c137d30 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f3704010360 tx=0x7f37040101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f370affd700 1 -- 172.21.15.80:0/2215145168 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3704000d30 con 0x7f370c12eb50 2019-11-28T11:26:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f3712a92700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370c12eb50 0x7f370c137d30 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f3704010360 tx=0x7f37040101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f370affd700 1 -- 172.21.15.80:0/2215145168 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37040010c0 con 0x7f370c12eb50 2019-11-28T11:26:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f3713cf4700 1 -- 172.21.15.80:0/2215145168 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370c10c3c0 con 0x7f370c12eb50 2019-11-28T11:26:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f370affd700 1 -- 172.21.15.80:0/2215145168 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3704001710 con 0x7f370c12eb50 2019-11-28T11:26:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.847+0000 7f3713cf4700 1 -- 172.21.15.80:0/2215145168 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c10c040 con 0x7f370c12eb50 2019-11-28T11:26:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.848+0000 7f3712a92700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370c12eb50 0x7f370c137d30 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f3704010360 tx=0x7f37040101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.848+0000 7f370affd700 1 -- 172.21.15.80:0/2215145168 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f37040012b0 con 0x7f370c12eb50 2019-11-28T11:26:06.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.848+0000 7f3712a92700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370c12eb50 0x7f370c137d30 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f3704010360 tx=0x7f37040101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.848+0000 7f370affd700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36ec018770 0x7f36ec01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:06.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.848+0000 7f370affd700 1 -- 172.21.15.80:0/2215145168 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3704031a20 con 0x7f370c12eb50 2019-11-28T11:26:06.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.848+0000 7f3712291700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36ec018770 0x7f36ec01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:06.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.848+0000 7f3712291700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36ec018770 0x7f36ec01abe0 crc :-1 s=READY pgs=154 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.855+0000 7f3713cf4700 1 -- 172.21.15.80:0/2215145168 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370c10c3c0 con 0x7f370c12eb50 2019-11-28T11:26:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.859+0000 7f3712a92700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370c12eb50 0x7f370c137d30 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f3704010360 tx=0x7f37040101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:06.859+0000 7f370affd700 1 -- 172.21.15.80:0/2215145168 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3704000940 con 0x7f370c12eb50 2019-11-28T11:26:07.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.031+0000 7f3713cf4700 1 -- 172.21.15.80:0/2215145168 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f370c10c040 con 0x7f370c12eb50 2019-11-28T11:26:07.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.033+0000 7f3712a92700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370c12eb50 0x7f370c137d30 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f3704010360 tx=0x7f37040101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.033+0000 7f370affd700 1 -- 172.21.15.80:0/2215145168 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7f370401fa60 con 0x7f370c12eb50 2019-11-28T11:26:07.055 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:26:07.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.036+0000 7f3713cf4700 1 -- 172.21.15.80:0/2215145168 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36ec018770 msgr2=0x7f36ec01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.036+0000 7f3713cf4700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36ec018770 0x7f36ec01abe0 crc :-1 s=READY pgs=154 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.036+0000 7f3713cf4700 1 -- 172.21.15.80:0/2215145168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370c12eb50 msgr2=0x7f370c137d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.036+0000 7f3713cf4700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370c12eb50 0x7f370c137d30 secure :-1 s=READY pgs=362 cs=0 l=1 rx=0x7f3704010360 tx=0x7f37040101e0).stop 2019-11-28T11:26:07.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.036+0000 7f3713cf4700 1 -- 172.21.15.80:0/2215145168 shutdown_connections 2019-11-28T11:26:07.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.036+0000 7f3713cf4700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36ec018770 0x7f36ec01abe0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.036+0000 7f3713cf4700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370c12eb50 0x7f370c137d30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.036+0000 7f3713cf4700 1 --2- 172.21.15.80:0/2215145168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f370c12e180 0x7f370c12e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.036+0000 7f3713cf4700 1 -- 172.21.15.80:0/2215145168 shutdown_connections 2019-11-28T11:26:07.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.036+0000 7f3713cf4700 1 -- 172.21.15.80:0/2215145168 wait complete. 2019-11-28T11:26:07.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.036+0000 7f3713cf4700 1 -- 172.21.15.80:0/2215145168 >> 172.21.15.80:0/2215145168 conn(0x7f370c07c450 msgr2=0x7f370c118c60 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:07.067 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:26:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.177+0000 7ff5388a1700 1 Processor -- start 2019-11-28T11:26:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.177+0000 7ff5388a1700 1 -- start start 2019-11-28T11:26:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.178+0000 7ff5388a1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff53415f100 0x7ff53406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.178+0000 7ff5388a1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53406db60 con 0x7ff53415ed10 2019-11-28T11:26:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.178+0000 7ff5388a1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53406e060 con 0x7ff53406c2f0 2019-11-28T11:26:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.178+0000 7ff5388a1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53406fe00 con 0x7ff53415f100 2019-11-28T11:26:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.178+0000 7ff53259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff53415f100 0x7ff53406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.178+0000 7ff53259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff53415f100 0x7ff53406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60740/0 (socket says 172.21.15.80:60740) 2019-11-28T11:26:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.178+0000 7ff53259c700 1 -- 172.21.15.80:0/2381619863 learned_addr learned my addr 172.21.15.80:0/2381619863 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.178+0000 7ff532d9d700 1 --1- 172.21.15.80:0/2381619863 >> v1:172.21.15.80:6789/0 conn(0x7ff53415ed10 0x7ff534073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60052/0 (socket says 172.21.15.80:60052) 2019-11-28T11:26:07.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.178+0000 7ff53259c700 1 -- 172.21.15.80:0/2381619863 >> v1:172.21.15.174:6789/0 conn(0x7ff53406c2f0 legacy=0x7ff53406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:07.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.178+0000 7ff53259c700 1 -- 172.21.15.80:0/2381619863 >> v1:172.21.15.80:6789/0 conn(0x7ff53415ed10 legacy=0x7ff534073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.178+0000 7ff53259c700 1 -- 172.21.15.80:0/2381619863 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534070760 con 0x7ff53415f100 2019-11-28T11:26:07.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.178+0000 7ff531d9b700 1 -- 172.21.15.80:0/2381619863 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644005081 0 0) 0x7ff524001100 con 0x7ff53415ed10 2019-11-28T11:26:07.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.178+0000 7ff53259c700 1 --2- 172.21.15.80:0/2381619863 >> v2:172.21.15.80:3300/0 conn(0x7ff53415f100 0x7ff53406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff52800f740 tx=0x7ff52800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.179+0000 7ff53259c700 1 --2- 172.21.15.80:0/2381619863 >> v2:172.21.15.80:3300/0 conn(0x7ff53415f100 0x7ff53406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff52800f740 tx=0x7ff52800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.179+0000 7ff53259c700 1 --2- 172.21.15.80:0/2381619863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff53415f100 0x7ff53406bdb0 secure :-1 s=READY pgs=364 cs=0 l=1 rx=0x7ff52800f740 tx=0x7ff52800fae0).ready entity=mon.0 client_cookie=718e01037d92d23c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.179+0000 7ff53259c700 1 --2- 172.21.15.80:0/2381619863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff53415f100 0x7ff53406bdb0 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7ff52800f740 tx=0x7ff52800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.179+0000 7ff531d9b700 1 -- 172.21.15.80:0/2381619863 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff528000960 con 0x7ff53415f100 2019-11-28T11:26:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.179+0000 7ff53259c700 1 --2- 172.21.15.80:0/2381619863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff53415f100 0x7ff53406bdb0 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7ff52800f740 tx=0x7ff52800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.179+0000 7ff531d9b700 1 -- 172.21.15.80:0/2381619863 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff528007210 con 0x7ff53415f100 2019-11-28T11:26:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.179+0000 7ff53259c700 1 --2- 172.21.15.80:0/2381619863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff53415f100 0x7ff53406bdb0 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7ff52800f740 tx=0x7ff52800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.179+0000 7ff531d9b700 1 -- 172.21.15.80:0/2381619863 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff528000960 con 0x7ff53415f100 2019-11-28T11:26:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.179+0000 7ff5388a1700 1 -- 172.21.15.80:0/2381619863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff53415f100 msgr2=0x7ff53406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.179+0000 7ff5388a1700 1 --2- 172.21.15.80:0/2381619863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff53415f100 0x7ff53406bdb0 secure :-1 s=READY pgs=364 cs=0 l=1 rx=0x7ff52800f740 tx=0x7ff52800fae0).stop 2019-11-28T11:26:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.180+0000 7ff5388a1700 1 -- 172.21.15.80:0/2381619863 shutdown_connections 2019-11-28T11:26:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.180+0000 7ff5388a1700 1 --2- 172.21.15.80:0/2381619863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff53415f100 0x7ff53406bdb0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.180+0000 7ff5388a1700 1 -- 172.21.15.80:0/2381619863 shutdown_connections 2019-11-28T11:26:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.180+0000 7ff5388a1700 1 -- 172.21.15.80:0/2381619863 wait complete. 2019-11-28T11:26:07.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.180+0000 7ff5388a1700 1 -- 172.21.15.80:0/2381619863 >> 172.21.15.80:0/2381619863 conn(0x7ff534061d40 msgr2=0x7ff5340641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.182+0000 7ff5388a1700 1 Processor -- start 2019-11-28T11:26:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.182+0000 7ff5388a1700 1 -- start start 2019-11-28T11:26:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.183+0000 7ff5388a1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff534152750 0x7ff534135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.183+0000 7ff5388a1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff534165d60 0x7ff534168160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.183+0000 7ff5388a1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff534109d70 con 0x7ff534130dc0 2019-11-28T11:26:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.183+0000 7ff5388a1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff534132570 con 0x7ff534152750 2019-11-28T11:26:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.183+0000 7ff5388a1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff534132840 con 0x7ff534165d60 2019-11-28T11:26:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.183+0000 7ff532d9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff534152750 0x7ff534135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.183+0000 7ff53359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff534165d60 0x7ff534168160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:07.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.183+0000 7ff532d9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff534152750 0x7ff534135790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:47396/0 (socket says 172.21.15.80:47396) 2019-11-28T11:26:07.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.183+0000 7ff532d9d700 1 -- 172.21.15.80:0/799191778 learned_addr learned my addr 172.21.15.80:0/799191778 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:07.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.183+0000 7ff532d9d700 1 -- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff534165d60 msgr2=0x7ff534168160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.183+0000 7ff532d9d700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff534165d60 0x7ff534168160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.183+0000 7ff532d9d700 1 -- 172.21.15.80:0/799191778 >> v1:172.21.15.174:6789/0 conn(0x7ff534130dc0 legacy=0x7ff534131250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.183+0000 7ff532d9d700 1 -- 172.21.15.80:0/799191778 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534132ed0 con 0x7ff534152750 2019-11-28T11:26:07.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.183+0000 7ff53359e700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff534165d60 0x7ff534168160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:07.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.183+0000 7ff532d9d700 1 --2- 172.21.15.80:0/799191778 >> v2:172.21.15.174:3300/0 conn(0x7ff534152750 0x7ff534135790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff524010430 tx=0x7ff5240107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.184+0000 7ff532d9d700 1 --2- 172.21.15.80:0/799191778 >> v2:172.21.15.174:3300/0 conn(0x7ff534152750 0x7ff534135790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff524010430 tx=0x7ff5240107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.184+0000 7ff532d9d700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7ff524010430 tx=0x7ff5240107d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:07.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.184+0000 7ff532d9d700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ff524010430 tx=0x7ff5240107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.184+0000 7ff532d9d700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ff524010430 tx=0x7ff5240107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.184+0000 7ff5237fe700 1 -- 172.21.15.80:0/799191778 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff524000c90 con 0x7ff534152750 2019-11-28T11:26:07.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.184+0000 7ff532d9d700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ff524010430 tx=0x7ff5240107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.184+0000 7ff5237fe700 1 -- 172.21.15.80:0/799191778 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff524004240 con 0x7ff534152750 2019-11-28T11:26:07.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.184+0000 7ff5388a1700 1 -- 172.21.15.80:0/799191778 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff534133250 con 0x7ff534152750 2019-11-28T11:26:07.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.184+0000 7ff5237fe700 1 -- 172.21.15.80:0/799191778 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff524004810 con 0x7ff534152750 2019-11-28T11:26:07.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.184+0000 7ff5388a1700 1 -- 172.21.15.80:0/799191778 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff534132ed0 con 0x7ff534152750 2019-11-28T11:26:07.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.184+0000 7ff532d9d700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ff524010430 tx=0x7ff5240107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.184+0000 7ff5237fe700 1 -- 172.21.15.80:0/799191778 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff524004430 con 0x7ff534152750 2019-11-28T11:26:07.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.184+0000 7ff532d9d700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ff524010430 tx=0x7ff5240107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.184+0000 7ff5237fe700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff518018730 0x7ff51801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:07.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.185+0000 7ff5237fe700 1 -- 172.21.15.80:0/799191778 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff524031aa0 con 0x7ff534152750 2019-11-28T11:26:07.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.185+0000 7ff53259c700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff518018730 0x7ff51801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:07.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.185+0000 7ff53259c700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff518018730 0x7ff51801abc0 crc :-1 s=READY pgs=155 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:07.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.192+0000 7ff5388a1700 1 -- 172.21.15.80:0/799191778 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff534133250 con 0x7ff534152750 2019-11-28T11:26:07.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.196+0000 7ff532d9d700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ff524010430 tx=0x7ff5240107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.196+0000 7ff5237fe700 1 -- 172.21.15.80:0/799191778 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff524000ef0 con 0x7ff534152750 2019-11-28T11:26:07.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.366+0000 7ff5388a1700 1 -- 172.21.15.80:0/799191778 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff534132ed0 con 0x7ff534152750 2019-11-28T11:26:07.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.370+0000 7ff532d9d700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7ff524010430 tx=0x7ff5240107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.370+0000 7ff5237fe700 1 -- 172.21.15.80:0/799191778 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff52401f8c0 con 0x7ff534152750 2019-11-28T11:26:07.394 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:26:07.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.375+0000 7ff5388a1700 1 -- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff518018730 msgr2=0x7ff51801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.375+0000 7ff5388a1700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff518018730 0x7ff51801abc0 crc :-1 s=READY pgs=155 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.375+0000 7ff5388a1700 1 -- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff534152750 msgr2=0x7ff534135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.375+0000 7ff5388a1700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7ff524010430 tx=0x7ff5240107d0).stop 2019-11-28T11:26:07.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.375+0000 7ff5388a1700 1 -- 172.21.15.80:0/799191778 shutdown_connections 2019-11-28T11:26:07.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.375+0000 7ff5388a1700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff534165d60 0x7ff534168160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.375+0000 7ff5388a1700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff518018730 0x7ff51801abc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.375+0000 7ff5388a1700 1 --2- 172.21.15.80:0/799191778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff534152750 0x7ff534135790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.375+0000 7ff5388a1700 1 -- 172.21.15.80:0/799191778 shutdown_connections 2019-11-28T11:26:07.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.375+0000 7ff5388a1700 1 -- 172.21.15.80:0/799191778 wait complete. 2019-11-28T11:26:07.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.375+0000 7ff5388a1700 1 -- 172.21.15.80:0/799191778 >> 172.21.15.80:0/799191778 conn(0x7ff5341476e0 msgr2=0x7ff53412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:07.409 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:26:07.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.525+0000 7f9da9c68700 1 Processor -- start 2019-11-28T11:26:07.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.525+0000 7f9da9c68700 1 -- start start 2019-11-28T11:26:07.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da9c68700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da415ed10 0x7f9da415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:07.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da9c68700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9da40734b0 0x7f9da40726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:07.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da9c68700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da406db60 con 0x7f9da4073020 2019-11-28T11:26:07.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da9c68700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da406f3d0 con 0x7f9da40734b0 2019-11-28T11:26:07.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da9c68700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da406fe00 con 0x7f9da415ed10 2019-11-28T11:26:07.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da8a06700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9da40734b0 0x7f9da40726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:07.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da415ed10 0x7f9da415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:07.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da415ed10 0x7f9da415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:34778/0 (socket says 172.21.15.80:34778) 2019-11-28T11:26:07.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da8a06700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9da40734b0 0x7f9da40726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:47408/0 (socket says 172.21.15.80:47408) 2019-11-28T11:26:07.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da3fff700 1 -- 172.21.15.80:0/1142074756 learned_addr learned my addr 172.21.15.80:0/1142074756 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:07.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9d9bfff700 1 --1- 172.21.15.80:0/1142074756 >> v1:172.21.15.174:6789/0 conn(0x7f9da4073020 0x7f9da4071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:47378/0 (socket says 172.21.15.80:47378) 2019-11-28T11:26:07.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da3fff700 1 -- 172.21.15.80:0/1142074756 >> v2:172.21.15.174:3300/0 conn(0x7f9da40734b0 msgr2=0x7f9da40726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:07.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da3fff700 1 --2- 172.21.15.80:0/1142074756 >> v2:172.21.15.174:3300/0 conn(0x7f9da40734b0 0x7f9da40726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:07.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da3fff700 1 -- 172.21.15.80:0/1142074756 >> v1:172.21.15.174:6789/0 conn(0x7f9da4073020 legacy=0x7f9da4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da3fff700 1 -- 172.21.15.80:0/1142074756 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da4070760 con 0x7f9da415ed10 2019-11-28T11:26:07.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da37fe700 1 -- 172.21.15.80:0/1142074756 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703904900 0 0) 0x7f9d8c0010c0 con 0x7f9da4073020 2019-11-28T11:26:07.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da8a06700 1 --2- 172.21.15.80:0/1142074756 >> v2:172.21.15.174:3300/0 conn(0x7f9da40734b0 0x7f9da40726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:07.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da3fff700 1 --2- 172.21.15.80:0/1142074756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da415ed10 0x7f9da415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9d9400f740 tx=0x7f9d9400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da3fff700 1 --2- 172.21.15.80:0/1142074756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da415ed10 0x7f9da415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9d9400f740 tx=0x7f9d9400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.526+0000 7f9da3fff700 1 --2- 172.21.15.80:0/1142074756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da415ed10 0x7f9da415f100 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f9d9400f740 tx=0x7f9d9400fae0).ready entity=mon.2 client_cookie=a38035a15e839870 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.527+0000 7f9da3fff700 1 --2- 172.21.15.80:0/1142074756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da415ed10 0x7f9da415f100 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f9d9400f740 tx=0x7f9d9400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.527+0000 7f9da37fe700 1 -- 172.21.15.80:0/1142074756 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d94000960 con 0x7f9da415ed10 2019-11-28T11:26:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.527+0000 7f9da3fff700 1 --2- 172.21.15.80:0/1142074756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da415ed10 0x7f9da415f100 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f9d9400f740 tx=0x7f9d9400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.527+0000 7f9da3fff700 1 --2- 172.21.15.80:0/1142074756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da415ed10 0x7f9da415f100 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f9d9400f740 tx=0x7f9d9400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.527+0000 7f9da37fe700 1 -- 172.21.15.80:0/1142074756 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d94000c90 con 0x7f9da415ed10 2019-11-28T11:26:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.527+0000 7f9da37fe700 1 -- 172.21.15.80:0/1142074756 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d940013a0 con 0x7f9da415ed10 2019-11-28T11:26:07.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.527+0000 7f9da9c68700 1 -- 172.21.15.80:0/1142074756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da415ed10 msgr2=0x7f9da415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.527+0000 7f9da9c68700 1 --2- 172.21.15.80:0/1142074756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da415ed10 0x7f9da415f100 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f9d9400f740 tx=0x7f9d9400fae0).stop 2019-11-28T11:26:07.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.527+0000 7f9da9c68700 1 -- 172.21.15.80:0/1142074756 shutdown_connections 2019-11-28T11:26:07.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.527+0000 7f9da9c68700 1 --2- 172.21.15.80:0/1142074756 >> v2:172.21.15.174:3300/0 conn(0x7f9da40734b0 0x7f9da40726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:07.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.527+0000 7f9da9c68700 1 --2- 172.21.15.80:0/1142074756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da415ed10 0x7f9da415f100 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.527+0000 7f9da9c68700 1 -- 172.21.15.80:0/1142074756 shutdown_connections 2019-11-28T11:26:07.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.527+0000 7f9da9c68700 1 -- 172.21.15.80:0/1142074756 wait complete. 2019-11-28T11:26:07.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.527+0000 7f9da9c68700 1 -- 172.21.15.80:0/1142074756 >> 172.21.15.80:0/1142074756 conn(0x7f9da4061d40 msgr2=0x7f9da40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:07.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.530+0000 7f9da9c68700 1 Processor -- start 2019-11-28T11:26:07.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.530+0000 7f9da9c68700 1 -- start start 2019-11-28T11:26:07.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da9c68700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9da4114f60 0x7f9da4106b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:07.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da9c68700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9da41070d0 0x7f9da412e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:07.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da9c68700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da412e6e0 0x7f9da4152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:07.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da9c68700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da4148b60 con 0x7f9da4114f60 2019-11-28T11:26:07.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da9c68700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da4148e30 con 0x7f9da41070d0 2019-11-28T11:26:07.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da9c68700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da410a4b0 con 0x7f9da412e6e0 2019-11-28T11:26:07.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9da4114f60 0x7f9da4106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:07.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9da4114f60 0x7f9da4106b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60756/0 (socket says 172.21.15.80:60756) 2019-11-28T11:26:07.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da3fff700 1 -- 172.21.15.80:0/3102173328 learned_addr learned my addr 172.21.15.80:0/3102173328 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:07.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9d9bfff700 1 --2- 172.21.15.80:0/3102173328 >> v2:172.21.15.174:3300/0 conn(0x7f9da41070d0 0x7f9da412e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:07.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da8a06700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da412e6e0 0x7f9da4152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:07.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da3fff700 1 -- 172.21.15.80:0/3102173328 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da412e6e0 msgr2=0x7f9da4152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da3fff700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da412e6e0 0x7f9da4152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da3fff700 1 -- 172.21.15.80:0/3102173328 >> v2:172.21.15.174:3300/0 conn(0x7f9da41070d0 msgr2=0x7f9da412e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da3fff700 1 --2- 172.21.15.80:0/3102173328 >> v2:172.21.15.174:3300/0 conn(0x7f9da41070d0 0x7f9da412e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da3fff700 1 -- 172.21.15.80:0/3102173328 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da4104390 con 0x7f9da4114f60 2019-11-28T11:26:07.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da3fff700 1 --2- 172.21.15.80:0/3102173328 >> v2:172.21.15.80:3300/0 conn(0x7f9da4114f60 0x7f9da4106b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9d94010440 tx=0x7f9d94010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da3fff700 1 --2- 172.21.15.80:0/3102173328 >> v2:172.21.15.80:3300/0 conn(0x7f9da4114f60 0x7f9da4106b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9d94010440 tx=0x7f9d94010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da3fff700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9da4114f60 0x7f9da4106b90 secure :-1 s=READY pgs=365 cs=0 l=1 rx=0x7f9d94010440 tx=0x7f9d94010370).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:07.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da3fff700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9da4114f60 0x7f9da4106b90 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f9d94010440 tx=0x7f9d94010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da3fff700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9da4114f60 0x7f9da4106b90 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f9d94010440 tx=0x7f9d94010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da17fa700 1 -- 172.21.15.80:0/3102173328 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d94000940 con 0x7f9da4114f60 2019-11-28T11:26:07.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da3fff700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9da4114f60 0x7f9da4106b90 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f9d94010440 tx=0x7f9d94010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da17fa700 1 -- 172.21.15.80:0/3102173328 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d94000f50 con 0x7f9da4114f60 2019-11-28T11:26:07.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da17fa700 1 -- 172.21.15.80:0/3102173328 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d940015a0 con 0x7f9da4114f60 2019-11-28T11:26:07.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.531+0000 7f9da9c68700 1 -- 172.21.15.80:0/3102173328 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da4104710 con 0x7f9da4114f60 2019-11-28T11:26:07.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.532+0000 7f9da9c68700 1 -- 172.21.15.80:0/3102173328 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da4104390 con 0x7f9da4114f60 2019-11-28T11:26:07.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.532+0000 7f9da3fff700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9da4114f60 0x7f9da4106b90 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f9d94010440 tx=0x7f9d94010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.532+0000 7f9da17fa700 1 -- 172.21.15.80:0/3102173328 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9d94001140 con 0x7f9da4114f60 2019-11-28T11:26:07.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.532+0000 7f9da3fff700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9da4114f60 0x7f9da4106b90 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f9d94010440 tx=0x7f9d94010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.532+0000 7f9da17fa700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d88018730 0x7f9d8801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:07.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.532+0000 7f9da17fa700 1 -- 172.21.15.80:0/3102173328 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9d94031a30 con 0x7f9da4114f60 2019-11-28T11:26:07.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.532+0000 7f9d9bfff700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d88018730 0x7f9d8801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:07.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.533+0000 7f9d9bfff700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d88018730 0x7f9d8801abc0 crc :-1 s=READY pgs=156 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:07.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.540+0000 7f9da9c68700 1 -- 172.21.15.80:0/3102173328 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da4104710 con 0x7f9da4114f60 2019-11-28T11:26:07.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.543+0000 7f9da3fff700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9da4114f60 0x7f9da4106b90 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f9d94010440 tx=0x7f9d94010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.543+0000 7f9da17fa700 1 -- 172.21.15.80:0/3102173328 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9d94024fa0 con 0x7f9da4114f60 2019-11-28T11:26:07.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.713+0000 7f9da9c68700 1 -- 172.21.15.80:0/3102173328 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9da4104390 con 0x7f9da4114f60 2019-11-28T11:26:07.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.716+0000 7f9da3fff700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9da4114f60 0x7f9da4106b90 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f9d94010440 tx=0x7f9d94010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.716+0000 7f9da17fa700 1 -- 172.21.15.80:0/3102173328 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9d94001140 con 0x7f9da4114f60 2019-11-28T11:26:07.741 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:26:07.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.722+0000 7f9da9c68700 1 -- 172.21.15.80:0/3102173328 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d88018730 msgr2=0x7f9d8801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.722+0000 7f9da9c68700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d88018730 0x7f9d8801abc0 crc :-1 s=READY pgs=156 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.722+0000 7f9da9c68700 1 -- 172.21.15.80:0/3102173328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9da4114f60 msgr2=0x7f9da4106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.722+0000 7f9da9c68700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9da4114f60 0x7f9da4106b90 secure :-1 s=READY pgs=365 cs=0 l=1 rx=0x7f9d94010440 tx=0x7f9d94010370).stop 2019-11-28T11:26:07.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.722+0000 7f9da9c68700 1 -- 172.21.15.80:0/3102173328 shutdown_connections 2019-11-28T11:26:07.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.722+0000 7f9da9c68700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d88018730 0x7f9d8801abc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.722+0000 7f9da9c68700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9da412e6e0 0x7f9da4152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.722+0000 7f9da9c68700 1 --2- 172.21.15.80:0/3102173328 >> v2:172.21.15.174:3300/0 conn(0x7f9da41070d0 0x7f9da412e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.722+0000 7f9da9c68700 1 --2- 172.21.15.80:0/3102173328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9da4114f60 0x7f9da4106b90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.722+0000 7f9da9c68700 1 -- 172.21.15.80:0/3102173328 shutdown_connections 2019-11-28T11:26:07.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.722+0000 7f9da9c68700 1 -- 172.21.15.80:0/3102173328 wait complete. 2019-11-28T11:26:07.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.722+0000 7f9da9c68700 1 -- 172.21.15.80:0/3102173328 >> 172.21.15.80:0/3102173328 conn(0x7f9da41476e0 msgr2=0x7f9da412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:07.753 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:26:07.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.863+0000 7f14f1caa700 1 Processor -- start 2019-11-28T11:26:07.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.863+0000 7f14f1caa700 1 -- start start 2019-11-28T11:26:07.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.864+0000 7f14f1caa700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14ec15f100 0x7f14ec06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:07.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.864+0000 7f14f1caa700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f14ec06c2f0 0x7f14ec06c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:07.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.864+0000 7f14f1caa700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec06db60 con 0x7f14ec15ed10 2019-11-28T11:26:07.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.864+0000 7f14f1caa700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ec06fe00 con 0x7f14ec06c2f0 2019-11-28T11:26:07.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.864+0000 7f14f1caa700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec0700d0 con 0x7f14ec15f100 2019-11-28T11:26:07.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.864+0000 7f14f0a48700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f14ec06c2f0 0x7f14ec06c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:07.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.864+0000 7f14e3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14ec15f100 0x7f14ec06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:07.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.864+0000 7f14ebfff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f14ec15ed10 0x7f14ec073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:47392/0 (socket says 172.21.15.80:47392) 2019-11-28T11:26:07.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.864+0000 7f14ebfff700 1 -- 172.21.15.80:0/1598114017 learned_addr learned my addr 172.21.15.80:0/1598114017 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:07.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14eb7fe700 1 -- 172.21.15.80:0/1598114017 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190576934 0 0) 0x7f14dc001100 con 0x7f14ec15ed10 2019-11-28T11:26:07.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14eb7fe700 1 -- 172.21.15.80:0/1598114017 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14d8002e80 con 0x7f14ec15ed10 2019-11-28T11:26:07.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14e3fff700 1 -- 172.21.15.80:0/1598114017 >> v2:172.21.15.174:3300/0 conn(0x7f14ec06c2f0 msgr2=0x7f14ec06c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:07.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14e3fff700 1 --2- 172.21.15.80:0/1598114017 >> v2:172.21.15.174:3300/0 conn(0x7f14ec06c2f0 0x7f14ec06c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:07.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14e3fff700 1 -- 172.21.15.80:0/1598114017 >> v1:172.21.15.174:6789/0 conn(0x7f14ec15ed10 legacy=0x7f14ec073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14e3fff700 1 -- 172.21.15.80:0/1598114017 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec070760 con 0x7f14ec15f100 2019-11-28T11:26:07.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14f0a48700 1 --2- 172.21.15.80:0/1598114017 >> v2:172.21.15.174:3300/0 conn(0x7f14ec06c2f0 0x7f14ec06c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:07.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14e3fff700 1 --2- 172.21.15.80:0/1598114017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14ec15f100 0x7f14ec06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f14d400af50 tx=0x7f14d400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14e3fff700 1 --2- 172.21.15.80:0/1598114017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14ec15f100 0x7f14ec06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f14d400af50 tx=0x7f14d400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14e3fff700 1 --2- 172.21.15.80:0/1598114017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14ec15f100 0x7f14ec06bdb0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f14d400af50 tx=0x7f14d400b760).ready entity=mon.2 client_cookie=d4473880ce83c286 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:07.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14e3fff700 1 --2- 172.21.15.80:0/1598114017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14ec15f100 0x7f14ec06bdb0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f14d400af50 tx=0x7f14d400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14eb7fe700 1 -- 172.21.15.80:0/1598114017 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14d4007210 con 0x7f14ec15f100 2019-11-28T11:26:07.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14e3fff700 1 --2- 172.21.15.80:0/1598114017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14ec15f100 0x7f14ec06bdb0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f14d400af50 tx=0x7f14d400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14e3fff700 1 --2- 172.21.15.80:0/1598114017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14ec15f100 0x7f14ec06bdb0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f14d400af50 tx=0x7f14d400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14eb7fe700 1 -- 172.21.15.80:0/1598114017 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d40099b0 con 0x7f14ec15f100 2019-11-28T11:26:07.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14eb7fe700 1 -- 172.21.15.80:0/1598114017 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14d4009ba0 con 0x7f14ec15f100 2019-11-28T11:26:07.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14f1caa700 1 -- 172.21.15.80:0/1598114017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14ec15f100 msgr2=0x7f14ec06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.865+0000 7f14f1caa700 1 --2- 172.21.15.80:0/1598114017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14ec15f100 0x7f14ec06bdb0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f14d400af50 tx=0x7f14d400b760).stop 2019-11-28T11:26:07.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.866+0000 7f14f1caa700 1 -- 172.21.15.80:0/1598114017 shutdown_connections 2019-11-28T11:26:07.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.866+0000 7f14f1caa700 1 --2- 172.21.15.80:0/1598114017 >> v2:172.21.15.174:3300/0 conn(0x7f14ec06c2f0 0x7f14ec06c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:07.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.866+0000 7f14f1caa700 1 --2- 172.21.15.80:0/1598114017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14ec15f100 0x7f14ec06bdb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.866+0000 7f14f1caa700 1 -- 172.21.15.80:0/1598114017 shutdown_connections 2019-11-28T11:26:07.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.866+0000 7f14f1caa700 1 -- 172.21.15.80:0/1598114017 wait complete. 2019-11-28T11:26:07.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.866+0000 7f14f1caa700 1 -- 172.21.15.80:0/1598114017 >> 172.21.15.80:0/1598114017 conn(0x7f14ec061d40 msgr2=0x7f14ec0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:07.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.868+0000 7f14f1caa700 1 Processor -- start 2019-11-28T11:26:07.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.868+0000 7f14f1caa700 1 -- start start 2019-11-28T11:26:07.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.869+0000 7f14f1caa700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14ec114f60 0x7f14ec106b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:07.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.869+0000 7f14f1caa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f14ec12e9a0 0x7f14ec105a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:07.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.869+0000 7f14f1caa700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec130b20 con 0x7f14ec1070d0 2019-11-28T11:26:07.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.869+0000 7f14f1caa700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ec10a4b0 con 0x7f14ec12e9a0 2019-11-28T11:26:07.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.869+0000 7f14f1caa700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec148130 con 0x7f14ec114f60 2019-11-28T11:26:07.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.869+0000 7f14f0a48700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f14ec12e9a0 0x7f14ec105a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:07.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.869+0000 7f14f0a48700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f14ec12e9a0 0x7f14ec105a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60774/0 (socket says 172.21.15.80:60774) 2019-11-28T11:26:07.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.869+0000 7f14f0a48700 1 -- 172.21.15.80:0/972526289 learned_addr learned my addr 172.21.15.80:0/972526289 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:07.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.869+0000 7f14ebfff700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14ec114f60 0x7f14ec106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:07.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14e97fa700 1 -- 172.21.15.80:0/972526289 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832904554 0 0) 0x7f14d400adc0 con 0x7f14ec1070d0 2019-11-28T11:26:07.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14f0a48700 1 -- 172.21.15.80:0/972526289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14ec114f60 msgr2=0x7f14ec106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14f0a48700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14ec114f60 0x7f14ec106b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:07.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14f0a48700 1 -- 172.21.15.80:0/972526289 >> v1:172.21.15.174:6789/0 conn(0x7f14ec1070d0 legacy=0x7f14ec12e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:07.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14f0a48700 1 -- 172.21.15.80:0/972526289 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec104390 con 0x7f14ec12e9a0 2019-11-28T11:26:07.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14f0a48700 1 --2- 172.21.15.80:0/972526289 >> v2:172.21.15.80:3300/0 conn(0x7f14ec12e9a0 0x7f14ec105a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f14e40107b0 tx=0x7f14e4010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14f0a48700 1 --2- 172.21.15.80:0/972526289 >> v2:172.21.15.80:3300/0 conn(0x7f14ec12e9a0 0x7f14ec105a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f14e40107b0 tx=0x7f14e4010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14f0a48700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14ec12e9a0 0x7f14ec105a10 secure :-1 s=READY pgs=366 cs=0 l=1 rx=0x7f14e40107b0 tx=0x7f14e4010630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:07.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14f0a48700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14ec12e9a0 0x7f14ec105a10 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f14e40107b0 tx=0x7f14e4010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14e97fa700 1 -- 172.21.15.80:0/972526289 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14e400aad0 con 0x7f14ec12e9a0 2019-11-28T11:26:07.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14f0a48700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14ec12e9a0 0x7f14ec105a10 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f14e40107b0 tx=0x7f14e4010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14f0a48700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14ec12e9a0 0x7f14ec105a10 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f14e40107b0 tx=0x7f14e4010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14e97fa700 1 -- 172.21.15.80:0/972526289 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e400aad0 con 0x7f14ec12e9a0 2019-11-28T11:26:07.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14f1caa700 1 -- 172.21.15.80:0/972526289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ec104710 con 0x7f14ec12e9a0 2019-11-28T11:26:07.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14e97fa700 1 -- 172.21.15.80:0/972526289 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14e400af20 con 0x7f14ec12e9a0 2019-11-28T11:26:07.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14f1caa700 1 -- 172.21.15.80:0/972526289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ec104390 con 0x7f14ec12e9a0 2019-11-28T11:26:07.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.870+0000 7f14f0a48700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14ec12e9a0 0x7f14ec105a10 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f14e40107b0 tx=0x7f14e4010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.871+0000 7f14e97fa700 1 -- 172.21.15.80:0/972526289 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f14e40099d0 con 0x7f14ec12e9a0 2019-11-28T11:26:07.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.871+0000 7f14f0a48700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14ec12e9a0 0x7f14ec105a10 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f14e40107b0 tx=0x7f14e4010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.871+0000 7f14e97fa700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f14d0018730 0x7f14d001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:07.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.871+0000 7f14e97fa700 1 -- 172.21.15.80:0/972526289 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f14e4032040 con 0x7f14ec12e9a0 2019-11-28T11:26:07.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.871+0000 7f14ebfff700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f14d0018730 0x7f14d001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:07.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.871+0000 7f14ebfff700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f14d0018730 0x7f14d001abc0 crc :-1 s=READY pgs=157 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:07.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.878+0000 7f14f1caa700 1 -- 172.21.15.80:0/972526289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ec104710 con 0x7f14ec12e9a0 2019-11-28T11:26:07.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.882+0000 7f14f0a48700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14ec12e9a0 0x7f14ec105a10 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f14e40107b0 tx=0x7f14e4010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:07.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:07.882+0000 7f14e97fa700 1 -- 172.21.15.80:0/972526289 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f14e4000df0 con 0x7f14ec12e9a0 2019-11-28T11:26:08.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.053+0000 7f14f1caa700 1 -- 172.21.15.80:0/972526289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f14ec104390 con 0x7f14ec12e9a0 2019-11-28T11:26:08.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.056+0000 7f14f0a48700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14ec12e9a0 0x7f14ec105a10 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f14e40107b0 tx=0x7f14e4010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:08.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.056+0000 7f14e97fa700 1 -- 172.21.15.80:0/972526289 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7f14e4009a60 con 0x7f14ec12e9a0 2019-11-28T11:26:08.078 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:26:08.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.058+0000 7f14f1caa700 1 -- 172.21.15.80:0/972526289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f14d0018730 msgr2=0x7f14d001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:08.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.058+0000 7f14f1caa700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f14d0018730 0x7f14d001abc0 crc :-1 s=READY pgs=157 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:08.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.058+0000 7f14f1caa700 1 -- 172.21.15.80:0/972526289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14ec12e9a0 msgr2=0x7f14ec105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:08.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.058+0000 7f14f1caa700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14ec12e9a0 0x7f14ec105a10 secure :-1 s=READY pgs=366 cs=0 l=1 rx=0x7f14e40107b0 tx=0x7f14e4010630).stop 2019-11-28T11:26:08.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.059+0000 7f14f1caa700 1 -- 172.21.15.80:0/972526289 shutdown_connections 2019-11-28T11:26:08.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.059+0000 7f14f1caa700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14ec12e9a0 0x7f14ec105a10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:08.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.059+0000 7f14f1caa700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f14d0018730 0x7f14d001abc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:08.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.059+0000 7f14f1caa700 1 --2- 172.21.15.80:0/972526289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14ec114f60 0x7f14ec106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:08.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.059+0000 7f14f1caa700 1 -- 172.21.15.80:0/972526289 shutdown_connections 2019-11-28T11:26:08.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.059+0000 7f14f1caa700 1 -- 172.21.15.80:0/972526289 wait complete. 2019-11-28T11:26:08.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.059+0000 7f14f1caa700 1 -- 172.21.15.80:0/972526289 >> 172.21.15.80:0/972526289 conn(0x7f14ec1476e0 msgr2=0x7f14ec12fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:08.089 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:26:08.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.187+0000 7ff68e1d5700 1 Processor -- start 2019-11-28T11:26:08.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.187+0000 7ff68e1d5700 1 -- start start 2019-11-28T11:26:08.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.188+0000 7ff68e1d5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff68806c0a0 0x7ff688072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:08.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.188+0000 7ff68e1d5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff6880734e0 0x7ff688071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:08.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.188+0000 7ff68e1d5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff68806db00 con 0x7ff688072360 2019-11-28T11:26:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.188+0000 7ff68e1d5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff68806fd60 con 0x7ff68806c0a0 2019-11-28T11:26:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.188+0000 7ff68e1d5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff688070030 con 0x7ff6880734e0 2019-11-28T11:26:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.188+0000 7ff687fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff68806c0a0 0x7ff688072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.188+0000 7ff687fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff68806c0a0 0x7ff688072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60778/0 (socket says 172.21.15.80:60778) 2019-11-28T11:26:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.188+0000 7ff687fff700 1 -- 172.21.15.80:0/3034916243 learned_addr learned my addr 172.21.15.80:0/3034916243 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.188+0000 7ff67ffff700 1 --2- 172.21.15.80:0/3034916243 >> v2:172.21.15.174:3300/0 conn(0x7ff6880734e0 0x7ff688071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.188+0000 7ff687fff700 1 -- 172.21.15.80:0/3034916243 >> v2:172.21.15.174:3300/0 conn(0x7ff6880734e0 msgr2=0x7ff688071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.189+0000 7ff687fff700 1 --2- 172.21.15.80:0/3034916243 >> v2:172.21.15.174:3300/0 conn(0x7ff6880734e0 0x7ff688071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.189+0000 7ff687fff700 1 -- 172.21.15.80:0/3034916243 >> v1:172.21.15.80:6789/0 conn(0x7ff688072360 legacy=0x7ff68806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.189+0000 7ff6877fe700 1 -- 172.21.15.80:0/3034916243 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942895431 0 0) 0x7ff680001480 con 0x7ff688072360 2019-11-28T11:26:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.189+0000 7ff687fff700 1 -- 172.21.15.80:0/3034916243 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6880706c0 con 0x7ff68806c0a0 2019-11-28T11:26:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.189+0000 7ff687fff700 1 --2- 172.21.15.80:0/3034916243 >> v2:172.21.15.80:3300/0 conn(0x7ff68806c0a0 0x7ff688072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff67800f6c0 tx=0x7ff67800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.189+0000 7ff687fff700 1 --2- 172.21.15.80:0/3034916243 >> v2:172.21.15.80:3300/0 conn(0x7ff68806c0a0 0x7ff688072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff67800f6c0 tx=0x7ff67800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.189+0000 7ff687fff700 1 --2- 172.21.15.80:0/3034916243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff68806c0a0 0x7ff688072fa0 secure :-1 s=READY pgs=368 cs=0 l=1 rx=0x7ff67800f6c0 tx=0x7ff67800fa60).ready entity=mon.0 client_cookie=8624ab9b0a6c40f2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.189+0000 7ff687fff700 1 --2- 172.21.15.80:0/3034916243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff68806c0a0 0x7ff688072fa0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7ff67800f6c0 tx=0x7ff67800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.189+0000 7ff6877fe700 1 -- 172.21.15.80:0/3034916243 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff678000960 con 0x7ff68806c0a0 2019-11-28T11:26:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.189+0000 7ff687fff700 1 --2- 172.21.15.80:0/3034916243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff68806c0a0 0x7ff688072fa0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7ff67800f6c0 tx=0x7ff67800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.189+0000 7ff687fff700 1 --2- 172.21.15.80:0/3034916243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff68806c0a0 0x7ff688072fa0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7ff67800f6c0 tx=0x7ff67800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.189+0000 7ff6877fe700 1 -- 172.21.15.80:0/3034916243 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff678000c90 con 0x7ff68806c0a0 2019-11-28T11:26:08.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.189+0000 7ff6877fe700 1 -- 172.21.15.80:0/3034916243 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff678007210 con 0x7ff68806c0a0 2019-11-28T11:26:08.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.189+0000 7ff68e1d5700 1 -- 172.21.15.80:0/3034916243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff68806c0a0 msgr2=0x7ff688072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:08.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.189+0000 7ff68e1d5700 1 --2- 172.21.15.80:0/3034916243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff68806c0a0 0x7ff688072fa0 secure :-1 s=READY pgs=368 cs=0 l=1 rx=0x7ff67800f6c0 tx=0x7ff67800fa60).stop 2019-11-28T11:26:08.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.190+0000 7ff68e1d5700 1 -- 172.21.15.80:0/3034916243 shutdown_connections 2019-11-28T11:26:08.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.190+0000 7ff68e1d5700 1 --2- 172.21.15.80:0/3034916243 >> v2:172.21.15.174:3300/0 conn(0x7ff6880734e0 0x7ff688071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:08.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.190+0000 7ff68e1d5700 1 --2- 172.21.15.80:0/3034916243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff68806c0a0 0x7ff688072fa0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:08.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.190+0000 7ff68e1d5700 1 -- 172.21.15.80:0/3034916243 shutdown_connections 2019-11-28T11:26:08.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.190+0000 7ff68e1d5700 1 -- 172.21.15.80:0/3034916243 wait complete. 2019-11-28T11:26:08.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.190+0000 7ff68e1d5700 1 -- 172.21.15.80:0/3034916243 >> 172.21.15.80:0/3034916243 conn(0x7ff688061cf0 msgr2=0x7ff688064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:08.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.192+0000 7ff68e1d5700 1 Processor -- start 2019-11-28T11:26:08.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.192+0000 7ff68e1d5700 1 -- start start 2019-11-28T11:26:08.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff68e1d5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68810adf0 0x7ff6881592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:08.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff68e1d5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6881597f0 0x7ff688075a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:08.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff68e1d5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff688075f40 0x7ff68812a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:08.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff68e1d5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff688073960 con 0x7ff6881597f0 2019-11-28T11:26:08.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff68e1d5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6880742c0 con 0x7ff688075f40 2019-11-28T11:26:08.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff68e1d5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff688074640 con 0x7ff68810adf0 2019-11-28T11:26:08.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff67ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6881597f0 0x7ff688075a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:08.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff67ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6881597f0 0x7ff688075a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60786/0 (socket says 172.21.15.80:60786) 2019-11-28T11:26:08.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff67ffff700 1 -- 172.21.15.80:0/677093466 learned_addr learned my addr 172.21.15.80:0/677093466 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:08.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff68cf73700 1 --2- 172.21.15.80:0/677093466 >> v2:172.21.15.174:3300/0 conn(0x7ff688075f40 0x7ff68812a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:08.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff687fff700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68810adf0 0x7ff6881592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:08.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff67ffff700 1 -- 172.21.15.80:0/677093466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68810adf0 msgr2=0x7ff6881592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:08.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff67ffff700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68810adf0 0x7ff6881592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:08.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff67ffff700 1 -- 172.21.15.80:0/677093466 >> v2:172.21.15.174:3300/0 conn(0x7ff688075f40 msgr2=0x7ff68812a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:08.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff67ffff700 1 --2- 172.21.15.80:0/677093466 >> v2:172.21.15.174:3300/0 conn(0x7ff688075f40 0x7ff68812a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:08.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff67ffff700 1 -- 172.21.15.80:0/677093466 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6881141d0 con 0x7ff6881597f0 2019-11-28T11:26:08.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff68cf73700 1 --2- 172.21.15.80:0/677093466 >> v2:172.21.15.174:3300/0 conn(0x7ff688075f40 0x7ff68812a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:26:08.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff687fff700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68810adf0 0x7ff6881592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:26:08.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff67ffff700 1 --2- 172.21.15.80:0/677093466 >> v2:172.21.15.80:3300/0 conn(0x7ff6881597f0 0x7ff688075a00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff670010450 tx=0x7ff6700107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:08.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff67ffff700 1 --2- 172.21.15.80:0/677093466 >> v2:172.21.15.80:3300/0 conn(0x7ff6881597f0 0x7ff688075a00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff670010450 tx=0x7ff6700107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:08.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff67ffff700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6881597f0 0x7ff688075a00 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7ff670010450 tx=0x7ff6700107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:08.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff67ffff700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6881597f0 0x7ff688075a00 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7ff670010450 tx=0x7ff6700107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:08.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff67ffff700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6881597f0 0x7ff688075a00 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7ff670010450 tx=0x7ff6700107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:08.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff6857fa700 1 -- 172.21.15.80:0/677093466 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff670005770 con 0x7ff6881597f0 2019-11-28T11:26:08.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff67ffff700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6881597f0 0x7ff688075a00 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7ff670010450 tx=0x7ff6700107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:08.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff6857fa700 1 -- 172.21.15.80:0/677093466 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff670005390 con 0x7ff6881597f0 2019-11-28T11:26:08.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.193+0000 7ff68e1d5700 1 -- 172.21.15.80:0/677093466 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6881141d0 con 0x7ff6881597f0 2019-11-28T11:26:08.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.194+0000 7ff6857fa700 1 -- 172.21.15.80:0/677093466 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff670005d50 con 0x7ff6881597f0 2019-11-28T11:26:08.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.194+0000 7ff68e1d5700 1 -- 172.21.15.80:0/677093466 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6881141d0 con 0x7ff6881597f0 2019-11-28T11:26:08.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.194+0000 7ff67ffff700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6881597f0 0x7ff688075a00 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7ff670010450 tx=0x7ff6700107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:08.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.194+0000 7ff6857fa700 1 -- 172.21.15.80:0/677093466 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff670005580 con 0x7ff6881597f0 2019-11-28T11:26:08.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.194+0000 7ff67ffff700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6881597f0 0x7ff688075a00 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7ff670010450 tx=0x7ff6700107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:08.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.194+0000 7ff6857fa700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff66c018730 0x7ff66c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:08.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.194+0000 7ff6857fa700 1 -- 172.21.15.80:0/677093466 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff6700319b0 con 0x7ff6881597f0 2019-11-28T11:26:08.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.195+0000 7ff687fff700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff66c018730 0x7ff66c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:08.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.195+0000 7ff687fff700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff66c018730 0x7ff66c01abc0 crc :-1 s=READY pgs=158 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:08.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.202+0000 7ff68e1d5700 1 -- 172.21.15.80:0/677093466 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff688060450 con 0x7ff6881597f0 2019-11-28T11:26:08.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.206+0000 7ff67ffff700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6881597f0 0x7ff688075a00 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7ff670010450 tx=0x7ff6700107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:08.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.206+0000 7ff6857fa700 1 -- 172.21.15.80:0/677093466 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff670005180 con 0x7ff6881597f0 2019-11-28T11:26:08.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.377+0000 7ff68e1d5700 1 -- 172.21.15.80:0/677093466 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff688060450 con 0x7ff6881597f0 2019-11-28T11:26:08.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.378+0000 7ff67ffff700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6881597f0 0x7ff688075a00 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7ff670010450 tx=0x7ff6700107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:08.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.378+0000 7ff6857fa700 1 -- 172.21.15.80:0/677093466 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1422 (secure 0 0 0) 0x7ff670017960 con 0x7ff6881597f0 2019-11-28T11:26:08.400 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 11 2019-11-28T11:26:08.400 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:08.400 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:06.009581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:26:08.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.380+0000 7ff68e1d5700 1 -- 172.21.15.80:0/677093466 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff66c018730 msgr2=0x7ff66c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:08.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.380+0000 7ff68e1d5700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff66c018730 0x7ff66c01abc0 crc :-1 s=READY pgs=158 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:08.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.380+0000 7ff68e1d5700 1 -- 172.21.15.80:0/677093466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6881597f0 msgr2=0x7ff688075a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:08.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.380+0000 7ff68e1d5700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6881597f0 0x7ff688075a00 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7ff670010450 tx=0x7ff6700107f0).stop 2019-11-28T11:26:08.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.380+0000 7ff68e1d5700 1 -- 172.21.15.80:0/677093466 shutdown_connections 2019-11-28T11:26:08.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.380+0000 7ff68e1d5700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff66c018730 0x7ff66c01abc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:08.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.380+0000 7ff68e1d5700 1 --2- 172.21.15.80:0/677093466 >> v2:172.21.15.174:3300/0 conn(0x7ff688075f40 0x7ff68812a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:08.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.380+0000 7ff68e1d5700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6881597f0 0x7ff688075a00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:08.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.380+0000 7ff68e1d5700 1 --2- 172.21.15.80:0/677093466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff68810adf0 0x7ff6881592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:08.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.380+0000 7ff68e1d5700 1 -- 172.21.15.80:0/677093466 shutdown_connections 2019-11-28T11:26:08.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.380+0000 7ff68e1d5700 1 -- 172.21.15.80:0/677093466 wait complete. 2019-11-28T11:26:08.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:08.380+0000 7ff68e1d5700 1 -- 172.21.15.80:0/677093466 >> 172.21.15.80:0/677093466 conn(0x7ff68813d930 msgr2=0x7ff688111550 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:08.725 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 4, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [5], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:26:04.004932+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:26:06.009581+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:26:08.725 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:26:09.727 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:26:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.830+0000 7f2f73508700 1 Processor -- start 2019-11-28T11:26:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.830+0000 7f2f73508700 1 -- start start 2019-11-28T11:26:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f73508700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f6c06d120 0x7f2f6c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f73508700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c06d580 con 0x7f2f6c06c490 2019-11-28T11:26:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f73508700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c06db00 con 0x7f2f6c06c0a0 2019-11-28T11:26:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f73508700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c06fd60 con 0x7f2f6c06d120 2019-11-28T11:26:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f712a4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2f6c06c490 0x7f2f6c06c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60110/0 (socket says 172.21.15.80:60110) 2019-11-28T11:26:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f712a4700 1 -- 172.21.15.80:0/2700504854 learned_addr learned my addr 172.21.15.80:0/2700504854 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f722a6700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f6c06d120 0x7f2f6c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f70aa3700 1 -- 172.21.15.80:0/2700504854 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551405177 0 0) 0x7f2f54001150 con 0x7f2f6c06c490 2019-11-28T11:26:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f70aa3700 1 -- 172.21.15.80:0/2700504854 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f58002e80 con 0x7f2f6c06c490 2019-11-28T11:26:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f70aa3700 1 -- 172.21.15.80:0/2700504854 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601287724 0 0) 0x7f2f5c001080 con 0x7f2f6c06c0a0 2019-11-28T11:26:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f70aa3700 1 -- 172.21.15.80:0/2700504854 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f580030b0 con 0x7f2f6c06c0a0 2019-11-28T11:26:09.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f70aa3700 1 -- 172.21.15.80:0/2700504854 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1141951834 0 0) 0x7f2f54001130 con 0x7f2f6c06c490 2019-11-28T11:26:09.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f70aa3700 1 -- 172.21.15.80:0/2700504854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f6c06d120 msgr2=0x7f2f6c165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:09.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f70aa3700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f6c06d120 0x7f2f6c165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:09.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f70aa3700 1 -- 172.21.15.80:0/2700504854 >> v1:172.21.15.174:6789/0 conn(0x7f2f6c06c0a0 legacy=0x7f2f6c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:09.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f70aa3700 1 -- 172.21.15.80:0/2700504854 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c0706c0 con 0x7f2f6c06c490 2019-11-28T11:26:09.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f70aa3700 1 -- 172.21.15.80:0/2700504854 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f2f540016c0 con 0x7f2f6c06c490 2019-11-28T11:26:09.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f70aa3700 1 -- 172.21.15.80:0/2700504854 >> v1:172.21.15.80:6789/0 conn(0x7f2f6c06c490 legacy=0x7f2f6c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:09.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f70aa3700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f58003b80 0x7f2f58005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:09.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.831+0000 7f2f70aa3700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f580066b0 0x7f2f58008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:09.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f70aa3700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f5804d3b0 0x7f2f5804f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:09.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f70aa3700 1 -- 172.21.15.80:0/2700504854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5804ffd0 con 0x7f2f58003b80 2019-11-28T11:26:09.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f70aa3700 1 -- 172.21.15.80:0/2700504854 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58050200 con 0x7f2f580066b0 2019-11-28T11:26:09.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f58003b80 0x7f2f58005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:09.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f70aa3700 1 -- 172.21.15.80:0/2700504854 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58050430 con 0x7f2f5804d3b0 2019-11-28T11:26:09.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f712a4700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f580066b0 0x7f2f58008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:09.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f722a6700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f5804d3b0 0x7f2f5804f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:09.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f71aa5700 1 -- 172.21.15.80:0/2700504854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f5804d3b0 msgr2=0x7f2f5804f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:09.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f5804d3b0 0x7f2f5804f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:09.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f71aa5700 1 -- 172.21.15.80:0/2700504854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f580066b0 msgr2=0x7f2f58008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:09.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f580066b0 0x7f2f58008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:09.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f71aa5700 1 -- 172.21.15.80:0/2700504854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f580506e0 con 0x7f2f58003b80 2019-11-28T11:26:09.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f58003b80 0x7f2f58005fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2f5c00af70 tx=0x7f2f5c00b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:09.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f58003b80 0x7f2f58005fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2f5c00af70 tx=0x7f2f5c00b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:09.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f58003b80 0x7f2f58005fe0 secure :-1 s=READY pgs=371 cs=0 l=1 rx=0x7f2f5c00af70 tx=0x7f2f5c00b270).ready entity=mon.0 client_cookie=ea1bab9e54d537f1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:09.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f58003b80 0x7f2f58005fe0 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7f2f5c00af70 tx=0x7f2f5c00b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:09.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f70aa3700 1 -- 172.21.15.80:0/2700504854 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f5c009e30 con 0x7f2f58003b80 2019-11-28T11:26:09.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f58003b80 0x7f2f58005fe0 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7f2f5c00af70 tx=0x7f2f5c00b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:09.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f70aa3700 1 -- 172.21.15.80:0/2700504854 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c0095d0 con 0x7f2f58003b80 2019-11-28T11:26:09.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f58003b80 0x7f2f58005fe0 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7f2f5c00af70 tx=0x7f2f5c00b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:09.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f70aa3700 1 -- 172.21.15.80:0/2700504854 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f5c009ed0 con 0x7f2f58003b80 2019-11-28T11:26:09.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f73508700 1 -- 172.21.15.80:0/2700504854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f58003b80 msgr2=0x7f2f58005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:09.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f73508700 1 --2- 172.21.15.80:0/2700504854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f58003b80 0x7f2f58005fe0 secure :-1 s=READY pgs=371 cs=0 l=1 rx=0x7f2f5c00af70 tx=0x7f2f5c00b270).stop 2019-11-28T11:26:09.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.832+0000 7f2f722a6700 1 -- 172.21.15.80:0/2700504854 reap_dead start 2019-11-28T11:26:09.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.833+0000 7f2f73508700 1 -- 172.21.15.80:0/2700504854 shutdown_connections 2019-11-28T11:26:09.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.833+0000 7f2f73508700 1 -- 172.21.15.80:0/2700504854 shutdown_connections 2019-11-28T11:26:09.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.833+0000 7f2f73508700 1 -- 172.21.15.80:0/2700504854 wait complete. 2019-11-28T11:26:09.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.833+0000 7f2f73508700 1 -- 172.21.15.80:0/2700504854 >> 172.21.15.80:0/2700504854 conn(0x7f2f6c061cf0 msgr2=0x7f2f6c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:09.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.835+0000 7f2f73508700 1 Processor -- start 2019-11-28T11:26:09.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.835+0000 7f2f73508700 1 -- start start 2019-11-28T11:26:09.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.836+0000 7f2f73508700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2f6c074d00 0x7f2f6c07aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:09.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.836+0000 7f2f73508700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c0754d0 con 0x7f2f6c07bba0 2019-11-28T11:26:09.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.836+0000 7f2f73508700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c12eb20 con 0x7f2f6c150f50 2019-11-28T11:26:09.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.836+0000 7f2f73508700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6c078980 con 0x7f2f6c074d00 2019-11-28T11:26:09.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.836+0000 7f2f71aa5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2f6c074d00 0x7f2f6c07aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:09.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.836+0000 7f2f71aa5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2f6c074d00 0x7f2f6c07aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60808/0 (socket says 172.21.15.80:60808) 2019-11-28T11:26:09.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.836+0000 7f2f71aa5700 1 -- 172.21.15.80:0/1588854310 learned_addr learned my addr 172.21.15.80:0/1588854310 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:09.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f71aa5700 1 -- 172.21.15.80:0/1588854310 >> v1:172.21.15.174:6789/0 conn(0x7f2f6c150f50 legacy=0x7f2f6c07af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:09.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f71aa5700 1 -- 172.21.15.80:0/1588854310 >> v1:172.21.15.80:6789/0 conn(0x7f2f6c07bba0 legacy=0x7f2f6c167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:09.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f6a7fc700 1 -- 172.21.15.80:0/1588854310 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872961958 0 0) 0x7f2f64000df0 con 0x7f2f6c07bba0 2019-11-28T11:26:09.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f71aa5700 1 -- 172.21.15.80:0/1588854310 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c0792e0 con 0x7f2f6c074d00 2019-11-28T11:26:09.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/1588854310 >> v2:172.21.15.80:3300/0 conn(0x7f2f6c074d00 0x7f2f6c07aa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2f5c010440 tx=0x7f2f5c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:09.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/1588854310 >> v2:172.21.15.80:3300/0 conn(0x7f2f6c074d00 0x7f2f6c07aa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2f5c010440 tx=0x7f2f5c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:09.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/1588854310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c074d00 0x7f2f6c07aa20 secure :-1 s=READY pgs=373 cs=0 l=1 rx=0x7f2f5c010440 tx=0x7f2f5c0107e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:09.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/1588854310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c074d00 0x7f2f6c07aa20 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f2f5c010440 tx=0x7f2f5c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:09.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f6a7fc700 1 -- 172.21.15.80:0/1588854310 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f5c009ca0 con 0x7f2f6c074d00 2019-11-28T11:26:09.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/1588854310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c074d00 0x7f2f6c07aa20 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f2f5c010440 tx=0x7f2f5c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:09.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f6a7fc700 1 -- 172.21.15.80:0/1588854310 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c002e60 con 0x7f2f6c074d00 2019-11-28T11:26:09.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/1588854310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c074d00 0x7f2f6c07aa20 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f2f5c010440 tx=0x7f2f5c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:09.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f73508700 1 -- 172.21.15.80:0/1588854310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c079660 con 0x7f2f6c074d00 2019-11-28T11:26:09.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f6a7fc700 1 -- 172.21.15.80:0/1588854310 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f5c009ca0 con 0x7f2f6c074d00 2019-11-28T11:26:09.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f73508700 1 -- 172.21.15.80:0/1588854310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c0792e0 con 0x7f2f6c074d00 2019-11-28T11:26:09.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/1588854310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c074d00 0x7f2f6c07aa20 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f2f5c010440 tx=0x7f2f5c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:09.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.837+0000 7f2f6a7fc700 1 -- 172.21.15.80:0/1588854310 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2f5c009ca0 con 0x7f2f6c074d00 2019-11-28T11:26:09.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.838+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/1588854310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c074d00 0x7f2f6c07aa20 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f2f5c010440 tx=0x7f2f5c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:09.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.838+0000 7f2f6a7fc700 1 --2- 172.21.15.80:0/1588854310 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2f50018730 0x7f2f5001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:09.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.838+0000 7f2f6a7fc700 1 -- 172.21.15.80:0/1588854310 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2f5c031db0 con 0x7f2f6c074d00 2019-11-28T11:26:09.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.838+0000 7f2f712a4700 1 --2- 172.21.15.80:0/1588854310 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2f50018730 0x7f2f5001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:09.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.838+0000 7f2f712a4700 1 --2- 172.21.15.80:0/1588854310 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2f50018730 0x7f2f5001abe0 crc :-1 s=READY pgs=159 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:09.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.845+0000 7f2f73508700 1 -- 172.21.15.80:0/1588854310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c079660 con 0x7f2f6c074d00 2019-11-28T11:26:09.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.848+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/1588854310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c074d00 0x7f2f6c07aa20 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f2f5c010440 tx=0x7f2f5c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:09.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:09.848+0000 7f2f6a7fc700 1 -- 172.21.15.80:0/1588854310 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2f5c009a90 con 0x7f2f6c074d00 2019-11-28T11:26:10.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:10.020+0000 7f2f73508700 1 -- 172.21.15.80:0/1588854310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f6c0792e0 con 0x7f2f6c074d00 2019-11-28T11:26:10.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:10.020+0000 7f2f71aa5700 1 --2- 172.21.15.80:0/1588854310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c074d00 0x7f2f6c07aa20 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f2f5c010440 tx=0x7f2f5c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:10.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:10.020+0000 7f2f6a7fc700 1 -- 172.21.15.80:0/1588854310 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1422 (secure 0 0 0) 0x7f2f5c017ae0 con 0x7f2f6c074d00 2019-11-28T11:26:10.043 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 11 2019-11-28T11:26:10.043 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:10.043 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:06.009581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:26:10.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:10.023+0000 7f2f73508700 1 -- 172.21.15.80:0/1588854310 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2f50018730 msgr2=0x7f2f5001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:10.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:10.023+0000 7f2f73508700 1 --2- 172.21.15.80:0/1588854310 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2f50018730 0x7f2f5001abe0 crc :-1 s=READY pgs=159 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:10.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:10.023+0000 7f2f73508700 1 -- 172.21.15.80:0/1588854310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c074d00 msgr2=0x7f2f6c07aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:10.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:10.023+0000 7f2f73508700 1 --2- 172.21.15.80:0/1588854310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c074d00 0x7f2f6c07aa20 secure :-1 s=READY pgs=373 cs=0 l=1 rx=0x7f2f5c010440 tx=0x7f2f5c0107e0).stop 2019-11-28T11:26:10.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:10.023+0000 7f2f73508700 1 -- 172.21.15.80:0/1588854310 shutdown_connections 2019-11-28T11:26:10.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:10.023+0000 7f2f73508700 1 --2- 172.21.15.80:0/1588854310 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2f50018730 0x7f2f5001abe0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:10.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:10.023+0000 7f2f73508700 1 --2- 172.21.15.80:0/1588854310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f6c074d00 0x7f2f6c07aa20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:10.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:10.023+0000 7f2f73508700 1 -- 172.21.15.80:0/1588854310 shutdown_connections 2019-11-28T11:26:10.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:10.023+0000 7f2f73508700 1 -- 172.21.15.80:0/1588854310 wait complete. 2019-11-28T11:26:10.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:10.023+0000 7f2f73508700 1 -- 172.21.15.80:0/1588854310 >> 172.21.15.80:0/1588854310 conn(0x7f2f6c13fa50 msgr2=0x7f2f6c07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:10.356 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 4, u'failed': [], u'epoch': 11, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [5], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:26:04.004932+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:26:06.009581+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:26:10.356 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:26:11.357 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:26:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.456+0000 7fb5cae92700 1 Processor -- start 2019-11-28T11:26:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.456+0000 7fb5cae92700 1 -- start start 2019-11-28T11:26:11.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.457+0000 7fb5cae92700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5c406c0a0 0x7fb5c4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:11.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.457+0000 7fb5cae92700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb5c40734e0 0x7fb5c4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:11.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.457+0000 7fb5cae92700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c406db00 con 0x7fb5c4072360 2019-11-28T11:26:11.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.457+0000 7fb5cae92700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c406fd60 con 0x7fb5c406c0a0 2019-11-28T11:26:11.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.457+0000 7fb5cae92700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c4070030 con 0x7fb5c40734e0 2019-11-28T11:26:11.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.457+0000 7fb5c942f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5c406c0a0 0x7fb5c4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:11.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.457+0000 7fb5c942f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5c406c0a0 0x7fb5c4072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60816/0 (socket says 172.21.15.80:60816) 2019-11-28T11:26:11.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.457+0000 7fb5c942f700 1 -- 172.21.15.80:0/2863449135 learned_addr learned my addr 172.21.15.80:0/2863449135 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:11.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.457+0000 7fb5c8c2e700 1 --2- 172.21.15.80:0/2863449135 >> v2:172.21.15.174:3300/0 conn(0x7fb5c40734e0 0x7fb5c4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:11.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.457+0000 7fb5c942f700 1 -- 172.21.15.80:0/2863449135 >> v2:172.21.15.174:3300/0 conn(0x7fb5c40734e0 msgr2=0x7fb5c4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:11.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.457+0000 7fb5c942f700 1 --2- 172.21.15.80:0/2863449135 >> v2:172.21.15.174:3300/0 conn(0x7fb5c40734e0 0x7fb5c4071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:11.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.457+0000 7fb5c942f700 1 -- 172.21.15.80:0/2863449135 >> v1:172.21.15.174:6789/0 conn(0x7fb5c4072360 legacy=0x7fb5c406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:11.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.457+0000 7fb5c942f700 1 -- 172.21.15.80:0/2863449135 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c40706c0 con 0x7fb5c406c0a0 2019-11-28T11:26:11.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.457+0000 7fb5c8c2e700 1 --2- 172.21.15.80:0/2863449135 >> v2:172.21.15.174:3300/0 conn(0x7fb5c40734e0 0x7fb5c4071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:26:11.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.458+0000 7fb5c942f700 1 --2- 172.21.15.80:0/2863449135 >> v2:172.21.15.80:3300/0 conn(0x7fb5c406c0a0 0x7fb5c4072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb5c000f740 tx=0x7fb5c000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:11.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.458+0000 7fb5c942f700 1 --2- 172.21.15.80:0/2863449135 >> v2:172.21.15.80:3300/0 conn(0x7fb5c406c0a0 0x7fb5c4072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb5c000f740 tx=0x7fb5c000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:11.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.458+0000 7fb5c942f700 1 --2- 172.21.15.80:0/2863449135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c406c0a0 0x7fb5c4072fa0 secure :-1 s=READY pgs=374 cs=0 l=1 rx=0x7fb5c000f740 tx=0x7fb5c000fae0).ready entity=mon.0 client_cookie=6f2bab987b705ddc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:11.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.458+0000 7fb5c942f700 1 --2- 172.21.15.80:0/2863449135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c406c0a0 0x7fb5c4072fa0 secure :-1 s=THROTTLE_DONE pgs=374 cs=0 l=1 rx=0x7fb5c000f740 tx=0x7fb5c000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:11.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.458+0000 7fb5bbfff700 1 -- 172.21.15.80:0/2863449135 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5c0000960 con 0x7fb5c406c0a0 2019-11-28T11:26:11.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.458+0000 7fb5c942f700 1 --2- 172.21.15.80:0/2863449135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c406c0a0 0x7fb5c4072fa0 secure :-1 s=THROTTLE_DONE pgs=374 cs=0 l=1 rx=0x7fb5c000f740 tx=0x7fb5c000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:11.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.458+0000 7fb5c942f700 1 --2- 172.21.15.80:0/2863449135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c406c0a0 0x7fb5c4072fa0 secure :-1 s=THROTTLE_DONE pgs=374 cs=0 l=1 rx=0x7fb5c000f740 tx=0x7fb5c000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:11.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.458+0000 7fb5bbfff700 1 -- 172.21.15.80:0/2863449135 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c0000c90 con 0x7fb5c406c0a0 2019-11-28T11:26:11.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.458+0000 7fb5bbfff700 1 -- 172.21.15.80:0/2863449135 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5c00013a0 con 0x7fb5c406c0a0 2019-11-28T11:26:11.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.458+0000 7fb5cae92700 1 -- 172.21.15.80:0/2863449135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c406c0a0 msgr2=0x7fb5c4072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:11.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.458+0000 7fb5cae92700 1 --2- 172.21.15.80:0/2863449135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c406c0a0 0x7fb5c4072fa0 secure :-1 s=READY pgs=374 cs=0 l=1 rx=0x7fb5c000f740 tx=0x7fb5c000fae0).stop 2019-11-28T11:26:11.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.458+0000 7fb5cae92700 1 -- 172.21.15.80:0/2863449135 shutdown_connections 2019-11-28T11:26:11.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.459+0000 7fb5cae92700 1 --2- 172.21.15.80:0/2863449135 >> v2:172.21.15.174:3300/0 conn(0x7fb5c40734e0 0x7fb5c4071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:11.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.459+0000 7fb5cae92700 1 --2- 172.21.15.80:0/2863449135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c406c0a0 0x7fb5c4072fa0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:11.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.459+0000 7fb5cae92700 1 -- 172.21.15.80:0/2863449135 shutdown_connections 2019-11-28T11:26:11.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.459+0000 7fb5cae92700 1 -- 172.21.15.80:0/2863449135 wait complete. 2019-11-28T11:26:11.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.459+0000 7fb5cae92700 1 -- 172.21.15.80:0/2863449135 >> 172.21.15.80:0/2863449135 conn(0x7fb5c4061cf0 msgr2=0x7fb5c4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:11.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.461+0000 7fb5cae92700 1 Processor -- start 2019-11-28T11:26:11.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.461+0000 7fb5cae92700 1 -- start start 2019-11-28T11:26:11.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.462+0000 7fb5cae92700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb5c4105fa0 0x7fb5c4106430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:11.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.462+0000 7fb5cae92700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c413bd00 con 0x7fb5c4164c20 2019-11-28T11:26:11.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.462+0000 7fb5cae92700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c413ef90 con 0x7fb5c413e8e0 2019-11-28T11:26:11.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.462+0000 7fb5cae92700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c410df40 con 0x7fb5c4105fa0 2019-11-28T11:26:11.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.462+0000 7fb5c9c30700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb5c4164c20 0x7fb5c41650c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60142/0 (socket says 172.21.15.80:60142) 2019-11-28T11:26:11.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.462+0000 7fb5c9c30700 1 -- 172.21.15.80:0/3714187976 learned_addr learned my addr 172.21.15.80:0/3714187976 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:11.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.462+0000 7fb5c8c2e700 1 --2- 172.21.15.80:0/3714187976 >> v2:172.21.15.174:3300/0 conn(0x7fb5c4105fa0 0x7fb5c4106430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:11.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.462+0000 7fb5b9ffb700 1 -- 172.21.15.80:0/3714187976 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72657964 0 0) 0x7fb5bc000d30 con 0x7fb5c4164c20 2019-11-28T11:26:11.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.462+0000 7fb5b9ffb700 1 -- 172.21.15.80:0/3714187976 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5a4002e80 con 0x7fb5c4164c20 2019-11-28T11:26:11.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5b9ffb700 1 -- 172.21.15.80:0/3714187976 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205427017 0 0) 0x7fb5c0007d20 con 0x7fb5c413e8e0 2019-11-28T11:26:11.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5b9ffb700 1 -- 172.21.15.80:0/3714187976 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5a40030b0 con 0x7fb5c413e8e0 2019-11-28T11:26:11.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5b9ffb700 1 -- 172.21.15.80:0/3714187976 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3995749142 0 0) 0x7fb5bc001630 con 0x7fb5c4164c20 2019-11-28T11:26:11.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5b9ffb700 1 -- 172.21.15.80:0/3714187976 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb5a40033c0 con 0x7fb5c4164c20 2019-11-28T11:26:11.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5b9ffb700 1 -- 172.21.15.80:0/3714187976 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fb5bc001b60 con 0x7fb5c4164c20 2019-11-28T11:26:11.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5c8c2e700 1 -- 172.21.15.80:0/3714187976 >> v1:172.21.15.174:6789/0 conn(0x7fb5c413e8e0 legacy=0x7fb5c414fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:11.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5c8c2e700 1 -- 172.21.15.80:0/3714187976 >> v1:172.21.15.80:6789/0 conn(0x7fb5c4164c20 legacy=0x7fb5c41650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:11.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5c8c2e700 1 -- 172.21.15.80:0/3714187976 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c41048d0 con 0x7fb5c4105fa0 2019-11-28T11:26:11.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5c8c2e700 1 --2- 172.21.15.80:0/3714187976 >> v2:172.21.15.174:3300/0 conn(0x7fb5c4105fa0 0x7fb5c4106430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb5b4010380 tx=0x7fb5b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:11.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5c8c2e700 1 --2- 172.21.15.80:0/3714187976 >> v2:172.21.15.174:3300/0 conn(0x7fb5c4105fa0 0x7fb5c4106430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb5b4010380 tx=0x7fb5b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:11.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5c8c2e700 1 --2- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5c4105fa0 0x7fb5c4106430 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7fb5b4010380 tx=0x7fb5b4010720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:11.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5c8c2e700 1 --2- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5c4105fa0 0x7fb5c4106430 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fb5b4010380 tx=0x7fb5b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:11.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5b9ffb700 1 -- 172.21.15.80:0/3714187976 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b4001360 con 0x7fb5c4105fa0 2019-11-28T11:26:11.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5c8c2e700 1 --2- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5c4105fa0 0x7fb5c4106430 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fb5b4010380 tx=0x7fb5b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:11.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5cae92700 1 -- 172.21.15.80:0/3714187976 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c4104c50 con 0x7fb5c4105fa0 2019-11-28T11:26:11.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5b9ffb700 1 -- 172.21.15.80:0/3714187976 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b4000940 con 0x7fb5c4105fa0 2019-11-28T11:26:11.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5c8c2e700 1 --2- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5c4105fa0 0x7fb5c4106430 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fb5b4010380 tx=0x7fb5b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:11.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5b9ffb700 1 -- 172.21.15.80:0/3714187976 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b4001400 con 0x7fb5c4105fa0 2019-11-28T11:26:11.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.463+0000 7fb5cae92700 1 -- 172.21.15.80:0/3714187976 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c41048d0 con 0x7fb5c4105fa0 2019-11-28T11:26:11.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.464+0000 7fb5c8c2e700 1 --2- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5c4105fa0 0x7fb5c4106430 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fb5b4010380 tx=0x7fb5b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:11.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.464+0000 7fb5b9ffb700 1 -- 172.21.15.80:0/3714187976 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb5b4001020 con 0x7fb5c4105fa0 2019-11-28T11:26:11.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.464+0000 7fb5c8c2e700 1 --2- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5c4105fa0 0x7fb5c4106430 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fb5b4010380 tx=0x7fb5b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:11.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.464+0000 7fb5b9ffb700 1 --2- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5a40187a0 0x7fb5a401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:11.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.464+0000 7fb5b9ffb700 1 -- 172.21.15.80:0/3714187976 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb5b4031aa0 con 0x7fb5c4105fa0 2019-11-28T11:26:11.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.464+0000 7fb5c942f700 1 --2- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5a40187a0 0x7fb5a401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:11.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.465+0000 7fb5c942f700 1 --2- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5a40187a0 0x7fb5a401abf0 crc :-1 s=READY pgs=163 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:11.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.471+0000 7fb5cae92700 1 -- 172.21.15.80:0/3714187976 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c4104c50 con 0x7fb5c4105fa0 2019-11-28T11:26:11.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.475+0000 7fb5c8c2e700 1 --2- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5c4105fa0 0x7fb5c4106430 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fb5b4010380 tx=0x7fb5b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:11.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.475+0000 7fb5b9ffb700 1 -- 172.21.15.80:0/3714187976 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb5b40225a0 con 0x7fb5c4105fa0 2019-11-28T11:26:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.650+0000 7fb5cae92700 1 -- 172.21.15.80:0/3714187976 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5c41048d0 con 0x7fb5c4105fa0 2019-11-28T11:26:11.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.651+0000 7fb5c8c2e700 1 --2- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5c4105fa0 0x7fb5c4106430 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fb5b4010380 tx=0x7fb5b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:11.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.651+0000 7fb5b9ffb700 1 -- 172.21.15.80:0/3714187976 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2448 (secure 0 0 0) 0x7fb5b40225a0 con 0x7fb5c4105fa0 2019-11-28T11:26:11.673 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 13 2019-11-28T11:26:11.673 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:11.674 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:11.063737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:creating","state_seq":2,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:26:11.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.653+0000 7fb5cae92700 1 -- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5a40187a0 msgr2=0x7fb5a401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:11.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.653+0000 7fb5cae92700 1 --2- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5a40187a0 0x7fb5a401abf0 crc :-1 s=READY pgs=163 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:11.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.653+0000 7fb5cae92700 1 -- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5c4105fa0 msgr2=0x7fb5c4106430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:11.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.653+0000 7fb5cae92700 1 --2- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5c4105fa0 0x7fb5c4106430 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7fb5b4010380 tx=0x7fb5b4010720).stop 2019-11-28T11:26:11.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.653+0000 7fb5cae92700 1 -- 172.21.15.80:0/3714187976 shutdown_connections 2019-11-28T11:26:11.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.653+0000 7fb5cae92700 1 --2- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5c4105fa0 0x7fb5c4106430 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:11.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.653+0000 7fb5cae92700 1 --2- 172.21.15.80:0/3714187976 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5a40187a0 0x7fb5a401abf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:11.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.653+0000 7fb5cae92700 1 -- 172.21.15.80:0/3714187976 shutdown_connections 2019-11-28T11:26:11.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.653+0000 7fb5cae92700 1 -- 172.21.15.80:0/3714187976 wait complete. 2019-11-28T11:26:11.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:11.653+0000 7fb5cae92700 1 -- 172.21.15.80:0/3714187976 >> 172.21.15.80:0/3714187976 conn(0x7fb5c413d620 msgr2=0x7fb5c413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:11.986 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5008}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 4, u'failed': [], u'epoch': 13, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [5], u'info': {u'gid_5008': {u'export_targets': [], u'name': u'c', u'incarnation': 13, u'state_seq': 2, u'state': u'up:creating', u'gid': 5008, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2897820490, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2897820490, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2897820490'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:26:04.004932+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:26:11.063737+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:26:11.986 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5008:up:creating 2019-11-28T11:26:12.988 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:26:13.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.102+0000 7f877e112700 1 Processor -- start 2019-11-28T11:26:13.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.102+0000 7f877e112700 1 -- start start 2019-11-28T11:26:13.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.103+0000 7f877e112700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f877806c0a0 0x7f8778072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:13.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.103+0000 7f877e112700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8778072620 0x7f8778164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:13.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.103+0000 7f877e112700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877806db00 con 0x7f87780734e0 2019-11-28T11:26:13.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.103+0000 7f877e112700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877806f330 con 0x7f8778072620 2019-11-28T11:26:13.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.103+0000 7f877e112700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87780706c0 con 0x7f877806c0a0 2019-11-28T11:26:13.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f876ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f87780734e0 0x7f8778071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60150/0 (socket says 172.21.15.80:60150) 2019-11-28T11:26:13.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f876ffff700 1 -- 172.21.15.80:0/1955441012 learned_addr learned my addr 172.21.15.80:0/1955441012 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:13.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f8777fff700 1 --2- 172.21.15.80:0/1955441012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f877806c0a0 0x7f8778072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:13.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f877ceb0700 1 --2- 172.21.15.80:0/1955441012 >> v2:172.21.15.174:3300/0 conn(0x7f8778072620 0x7f8778164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:13.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f87777fe700 1 -- 172.21.15.80:0/1955441012 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957093537 0 0) 0x7f8760001150 con 0x7f87780734e0 2019-11-28T11:26:13.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f87777fe700 1 -- 172.21.15.80:0/1955441012 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8764002e80 con 0x7f87780734e0 2019-11-28T11:26:13.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f8777fff700 1 -- 172.21.15.80:0/1955441012 >> v2:172.21.15.174:3300/0 conn(0x7f8778072620 msgr2=0x7f8778164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:13.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f8777fff700 1 --2- 172.21.15.80:0/1955441012 >> v2:172.21.15.174:3300/0 conn(0x7f8778072620 0x7f8778164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:13.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f8777fff700 1 -- 172.21.15.80:0/1955441012 >> v1:172.21.15.80:6789/0 conn(0x7f87780734e0 legacy=0x7f8778071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:13.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f8777fff700 1 -- 172.21.15.80:0/1955441012 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778070a40 con 0x7f877806c0a0 2019-11-28T11:26:13.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f877ceb0700 1 --2- 172.21.15.80:0/1955441012 >> v2:172.21.15.174:3300/0 conn(0x7f8778072620 0x7f8778164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:13.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f8777fff700 1 --2- 172.21.15.80:0/1955441012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f877806c0a0 0x7f8778072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f876800af50 tx=0x7f876800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f8777fff700 1 --2- 172.21.15.80:0/1955441012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f877806c0a0 0x7f8778072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f876800af50 tx=0x7f876800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f8777fff700 1 --2- 172.21.15.80:0/1955441012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f877806c0a0 0x7f8778072fa0 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f876800af50 tx=0x7f876800b760).ready entity=mon.2 client_cookie=b083539e39c5dbc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:13.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f8777fff700 1 --2- 172.21.15.80:0/1955441012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f877806c0a0 0x7f8778072fa0 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f876800af50 tx=0x7f876800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f87777fe700 1 -- 172.21.15.80:0/1955441012 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8768007210 con 0x7f877806c0a0 2019-11-28T11:26:13.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f8777fff700 1 --2- 172.21.15.80:0/1955441012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f877806c0a0 0x7f8778072fa0 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f876800af50 tx=0x7f876800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f8777fff700 1 --2- 172.21.15.80:0/1955441012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f877806c0a0 0x7f8778072fa0 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f876800af50 tx=0x7f876800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f87777fe700 1 -- 172.21.15.80:0/1955441012 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87680099b0 con 0x7f877806c0a0 2019-11-28T11:26:13.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f87777fe700 1 -- 172.21.15.80:0/1955441012 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f876800a080 con 0x7f877806c0a0 2019-11-28T11:26:13.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f877e112700 1 -- 172.21.15.80:0/1955441012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f877806c0a0 msgr2=0x7f8778072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:13.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.104+0000 7f877e112700 1 --2- 172.21.15.80:0/1955441012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f877806c0a0 0x7f8778072fa0 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f876800af50 tx=0x7f876800b760).stop 2019-11-28T11:26:13.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.105+0000 7f877e112700 1 -- 172.21.15.80:0/1955441012 shutdown_connections 2019-11-28T11:26:13.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.105+0000 7f877e112700 1 --2- 172.21.15.80:0/1955441012 >> v2:172.21.15.174:3300/0 conn(0x7f8778072620 0x7f8778164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:13.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.105+0000 7f877e112700 1 --2- 172.21.15.80:0/1955441012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f877806c0a0 0x7f8778072fa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:13.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.105+0000 7f877e112700 1 -- 172.21.15.80:0/1955441012 shutdown_connections 2019-11-28T11:26:13.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.105+0000 7f877e112700 1 -- 172.21.15.80:0/1955441012 wait complete. 2019-11-28T11:26:13.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.105+0000 7f877e112700 1 -- 172.21.15.80:0/1955441012 >> 172.21.15.80:0/1955441012 conn(0x7f8778061cf0 msgr2=0x7f8778064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:13.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.108+0000 7f877e112700 1 Processor -- start 2019-11-28T11:26:13.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.108+0000 7f877e112700 1 -- start start 2019-11-28T11:26:13.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877e112700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f877813e5f0 0x7f877813e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:13.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877e112700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f877810a070 0x7f877810bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:13.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877e112700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f877810a4e0 0x7f877810c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:13.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877e112700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877810e060 con 0x7f877810a4e0 2019-11-28T11:26:13.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877e112700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877810e330 con 0x7f877813e5f0 2019-11-28T11:26:13.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877e112700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877810d630 con 0x7f877810a070 2019-11-28T11:26:13.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877ceb0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f877810a4e0 0x7f877810c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:13.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877ceb0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f877810a4e0 0x7f877810c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60840/0 (socket says 172.21.15.80:60840) 2019-11-28T11:26:13.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877ceb0700 1 -- 172.21.15.80:0/2994518189 learned_addr learned my addr 172.21.15.80:0/2994518189 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:13.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f876ffff700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f877810a070 0x7f877810bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:13.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f8777fff700 1 --2- 172.21.15.80:0/2994518189 >> v2:172.21.15.174:3300/0 conn(0x7f877813e5f0 0x7f877813e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:13.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877ceb0700 1 -- 172.21.15.80:0/2994518189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f877810a070 msgr2=0x7f877810bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:13.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877ceb0700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f877810a070 0x7f877810bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:13.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877ceb0700 1 -- 172.21.15.80:0/2994518189 >> v2:172.21.15.174:3300/0 conn(0x7f877813e5f0 msgr2=0x7f877813e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:13.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877ceb0700 1 --2- 172.21.15.80:0/2994518189 >> v2:172.21.15.174:3300/0 conn(0x7f877813e5f0 0x7f877813e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:13.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877ceb0700 1 -- 172.21.15.80:0/2994518189 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877810e9c0 con 0x7f877810a4e0 2019-11-28T11:26:13.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877ceb0700 1 --2- 172.21.15.80:0/2994518189 >> v2:172.21.15.80:3300/0 conn(0x7f877810a4e0 0x7f877810c2f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f87700107b0 tx=0x7f87700106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877ceb0700 1 --2- 172.21.15.80:0/2994518189 >> v2:172.21.15.80:3300/0 conn(0x7f877810a4e0 0x7f877810c2f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f87700107b0 tx=0x7f87700106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877ceb0700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877810a4e0 0x7f877810c2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rx=0x7f87700107b0 tx=0x7f87700106b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:13.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877ceb0700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877810a4e0 0x7f877810c2f0 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f87700107b0 tx=0x7f87700106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f87757fa700 1 -- 172.21.15.80:0/2994518189 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f877000ade0 con 0x7f877810a4e0 2019-11-28T11:26:13.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877ceb0700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877810a4e0 0x7f877810c2f0 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f87700107b0 tx=0x7f87700106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f87757fa700 1 -- 172.21.15.80:0/2994518189 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877000aad0 con 0x7f877810a4e0 2019-11-28T11:26:13.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877e112700 1 -- 172.21.15.80:0/2994518189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877810ed40 con 0x7f877810a4e0 2019-11-28T11:26:13.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877ceb0700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877810a4e0 0x7f877810c2f0 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f87700107b0 tx=0x7f87700106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f87757fa700 1 -- 172.21.15.80:0/2994518189 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f877000ae80 con 0x7f877810a4e0 2019-11-28T11:26:13.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.109+0000 7f877e112700 1 -- 172.21.15.80:0/2994518189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877810e9c0 con 0x7f877810a4e0 2019-11-28T11:26:13.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.110+0000 7f877ceb0700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877810a4e0 0x7f877810c2f0 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f87700107b0 tx=0x7f87700106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.110+0000 7f87757fa700 1 -- 172.21.15.80:0/2994518189 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f87700099d0 con 0x7f877810a4e0 2019-11-28T11:26:13.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.110+0000 7f877ceb0700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877810a4e0 0x7f877810c2f0 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f87700107b0 tx=0x7f87700106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.110+0000 7f87757fa700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f875c018730 0x7f875c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:13.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.110+0000 7f87757fa700 1 -- 172.21.15.80:0/2994518189 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8770031d80 con 0x7f877810a4e0 2019-11-28T11:26:13.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.110+0000 7f8777fff700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f875c018730 0x7f875c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:13.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.111+0000 7f8777fff700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f875c018730 0x7f875c01abc0 crc :-1 s=READY pgs=166 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:13.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.117+0000 7f877e112700 1 -- 172.21.15.80:0/2994518189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877810ed40 con 0x7f877810a4e0 2019-11-28T11:26:13.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.121+0000 7f877ceb0700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877810a4e0 0x7f877810c2f0 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f87700107b0 tx=0x7f87700106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.121+0000 7f87757fa700 1 -- 172.21.15.80:0/2994518189 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f877002dff0 con 0x7f877810a4e0 2019-11-28T11:26:13.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.296+0000 7f877e112700 1 -- 172.21.15.80:0/2994518189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f877810e9c0 con 0x7f877810a4e0 2019-11-28T11:26:13.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.296+0000 7f877ceb0700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877810a4e0 0x7f877810c2f0 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7f87700107b0 tx=0x7f87700106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.296+0000 7f87757fa700 1 -- 172.21.15.80:0/2994518189 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2446 (secure 0 0 0) 0x7f877002dff0 con 0x7f877810a4e0 2019-11-28T11:26:13.320 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2019-11-28T11:26:13.321 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:13.321 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:12.065616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:26:13.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.299+0000 7f877e112700 1 -- 172.21.15.80:0/2994518189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f875c018730 msgr2=0x7f875c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:13.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.299+0000 7f877e112700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f875c018730 0x7f875c01abc0 crc :-1 s=READY pgs=166 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:13.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.299+0000 7f877e112700 1 -- 172.21.15.80:0/2994518189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877810a4e0 msgr2=0x7f877810c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:13.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.299+0000 7f877e112700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877810a4e0 0x7f877810c2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rx=0x7f87700107b0 tx=0x7f87700106b0).stop 2019-11-28T11:26:13.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.299+0000 7f877e112700 1 -- 172.21.15.80:0/2994518189 shutdown_connections 2019-11-28T11:26:13.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.299+0000 7f877e112700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f875c018730 0x7f875c01abc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:13.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.299+0000 7f877e112700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f877810a4e0 0x7f877810c2f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:13.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.299+0000 7f877e112700 1 --2- 172.21.15.80:0/2994518189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f877810a070 0x7f877810bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:13.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.299+0000 7f877e112700 1 --2- 172.21.15.80:0/2994518189 >> v2:172.21.15.174:3300/0 conn(0x7f877813e5f0 0x7f877813e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:13.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.299+0000 7f877e112700 1 -- 172.21.15.80:0/2994518189 shutdown_connections 2019-11-28T11:26:13.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.299+0000 7f877e112700 1 -- 172.21.15.80:0/2994518189 wait complete. 2019-11-28T11:26:13.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.299+0000 7f877e112700 1 -- 172.21.15.80:0/2994518189 >> 172.21.15.80:0/2994518189 conn(0x7f877813d620 msgr2=0x7f877813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:13.639 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5008}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 4, u'failed': [], u'epoch': 14, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [5], u'info': {u'gid_5008': {u'export_targets': [], u'name': u'c', u'incarnation': 13, u'state_seq': 3, u'state': u'up:active', u'gid': 5008, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2897820490, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2897820490, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2897820490'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:26:04.004932+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:26:12.065616+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:26:13.639 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:26:13.640 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:26:13.776 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:26:13.777 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:26:13.777 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:26:13.777 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5008, 2019-11-28T11:26:13.777 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:26:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:26:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 2.6894017830000001, 2019-11-28T11:26:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 14, 2019-11-28T11:26:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 36, 2019-11-28T11:26:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 36, 2019-11-28T11:26:13.779 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 6.9580418079999999 2019-11-28T11:26:13.779 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:26:13.783 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5008, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.6894017830000001, "mdsmap_epoch": 14, "osdmap_epoch": 36, "osdmap_epoch_barrier": 36, "uptime": 6.9580418079999999 } 2019-11-28T11:26:13.783 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:26:13.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.884+0000 7efe9d224700 1 Processor -- start 2019-11-28T11:26:13.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.884+0000 7efe9d224700 1 -- start start 2019-11-28T11:26:13.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.885+0000 7efe9d224700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe9806c0a0 0x7efe98072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:13.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.885+0000 7efe9d224700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9806db00 con 0x7efe980734e0 2019-11-28T11:26:13.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.885+0000 7efe9d224700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9806e000 con 0x7efe98072620 2019-11-28T11:26:13.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.885+0000 7efe9d224700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9806f330 con 0x7efe9806c0a0 2019-11-28T11:26:13.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.885+0000 7efe96d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efe980734e0 0x7efe98071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60164/0 (socket says 172.21.15.80:60164) 2019-11-28T11:26:13.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.885+0000 7efe96d9d700 1 -- 172.21.15.80:0/3647808491 learned_addr learned my addr 172.21.15.80:0/3647808491 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:13.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.885+0000 7efe9759e700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe9806c0a0 0x7efe98072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:13.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.885+0000 7efe9659c700 1 -- 172.21.15.80:0/3647808491 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321320903 0 0) 0x7efe88001070 con 0x7efe980734e0 2019-11-28T11:26:13.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.885+0000 7efe9659c700 1 -- 172.21.15.80:0/3647808491 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe78002e80 con 0x7efe980734e0 2019-11-28T11:26:13.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9659c700 1 -- 172.21.15.80:0/3647808491 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3784673845 0 0) 0x7efe88001050 con 0x7efe980734e0 2019-11-28T11:26:13.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9659c700 1 -- 172.21.15.80:0/3647808491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe9806c0a0 msgr2=0x7efe98072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:13.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9659c700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe9806c0a0 0x7efe98072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:13.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9659c700 1 -- 172.21.15.80:0/3647808491 >> v1:172.21.15.174:6789/0 conn(0x7efe98072620 legacy=0x7efe98164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:13.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9659c700 1 -- 172.21.15.80:0/3647808491 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe980706c0 con 0x7efe980734e0 2019-11-28T11:26:13.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9659c700 1 -- 172.21.15.80:0/3647808491 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7efe88001580 con 0x7efe980734e0 2019-11-28T11:26:13.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9659c700 1 -- 172.21.15.80:0/3647808491 >> v1:172.21.15.80:6789/0 conn(0x7efe980734e0 legacy=0x7efe98071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:13.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9659c700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe78003ab0 0x7efe78005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:13.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9659c700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe78006650 0x7efe78008b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:13.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9659c700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe78009300 0x7efe7800b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:13.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9659c700 1 -- 172.21.15.80:0/3647808491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7800bfe0 con 0x7efe78009300 2019-11-28T11:26:13.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9659c700 1 -- 172.21.15.80:0/3647808491 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe78050220 con 0x7efe78006650 2019-11-28T11:26:13.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9659c700 1 -- 172.21.15.80:0/3647808491 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe78050410 con 0x7efe78003ab0 2019-11-28T11:26:13.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9ca23700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe78009300 0x7efe7800b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:13.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9759e700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe78003ab0 0x7efe78005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:13.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe96d9d700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe78006650 0x7efe78008b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:13.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9ca23700 1 -- 172.21.15.80:0/3647808491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe78003ab0 msgr2=0x7efe78005ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:13.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9ca23700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe78003ab0 0x7efe78005ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:13.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9ca23700 1 -- 172.21.15.80:0/3647808491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe78006650 msgr2=0x7efe78008b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:13.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9ca23700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe78006650 0x7efe78008b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:13.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9ca23700 1 -- 172.21.15.80:0/3647808491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe780506c0 con 0x7efe78009300 2019-11-28T11:26:13.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9ca23700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe78009300 0x7efe7800b7d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efe9000af80 tx=0x7efe9000b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9ca23700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe78009300 0x7efe7800b7d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efe9000af80 tx=0x7efe9000b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9ca23700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe78009300 0x7efe7800b7d0 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7efe9000af80 tx=0x7efe9000b300).ready entity=mon.0 client_cookie=1a7af4021267eb64 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:13.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9ca23700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe78009300 0x7efe7800b7d0 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7efe9000af80 tx=0x7efe9000b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9659c700 1 -- 172.21.15.80:0/3647808491 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe90009bb0 con 0x7efe78009300 2019-11-28T11:26:13.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9ca23700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe78009300 0x7efe7800b7d0 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7efe9000af80 tx=0x7efe9000b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9ca23700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe78009300 0x7efe7800b7d0 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7efe9000af80 tx=0x7efe9000b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9659c700 1 -- 172.21.15.80:0/3647808491 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe900097d0 con 0x7efe78009300 2019-11-28T11:26:13.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9659c700 1 -- 172.21.15.80:0/3647808491 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe900099c0 con 0x7efe78009300 2019-11-28T11:26:13.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9d224700 1 -- 172.21.15.80:0/3647808491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe78009300 msgr2=0x7efe7800b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9d224700 1 --2- 172.21.15.80:0/3647808491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe78009300 0x7efe7800b7d0 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7efe9000af80 tx=0x7efe9000b300).stop 2019-11-28T11:26:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.886+0000 7efe9ca23700 1 -- 172.21.15.80:0/3647808491 reap_dead start 2019-11-28T11:26:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.887+0000 7efe9d224700 1 -- 172.21.15.80:0/3647808491 shutdown_connections 2019-11-28T11:26:13.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.887+0000 7efe9d224700 1 -- 172.21.15.80:0/3647808491 shutdown_connections 2019-11-28T11:26:13.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.887+0000 7efe9d224700 1 -- 172.21.15.80:0/3647808491 wait complete. 2019-11-28T11:26:13.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.887+0000 7efe9d224700 1 -- 172.21.15.80:0/3647808491 >> 172.21.15.80:0/3647808491 conn(0x7efe98061cf0 msgr2=0x7efe98064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:13.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.889+0000 7efe9d224700 1 Processor -- start 2019-11-28T11:26:13.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.890+0000 7efe9d224700 1 -- start start 2019-11-28T11:26:13.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.890+0000 7efe9d224700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe98150f50 0x7efe9807b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:13.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.890+0000 7efe9d224700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe9807bba0 0x7efe98167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:13.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe9d224700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe980754d0 con 0x7efe98074d00 2019-11-28T11:26:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe9d224700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe98078980 con 0x7efe9807bba0 2019-11-28T11:26:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe9d224700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe98078c50 con 0x7efe98150f50 2019-11-28T11:26:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe9759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efe98074d00 0x7efe9807aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60172/0 (socket says 172.21.15.80:60172) 2019-11-28T11:26:13.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe9759e700 1 -- 172.21.15.80:0/788588617 learned_addr learned my addr 172.21.15.80:0/788588617 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:13.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe96d9d700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe98150f50 0x7efe9807b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:13.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe9ca23700 1 --2- 172.21.15.80:0/788588617 >> v2:172.21.15.174:3300/0 conn(0x7efe9807bba0 0x7efe98167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:13.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe8ffff700 1 -- 172.21.15.80:0/788588617 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306375332 0 0) 0x7efe80001430 con 0x7efe98074d00 2019-11-28T11:26:13.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe8ffff700 1 -- 172.21.15.80:0/788588617 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe70002e80 con 0x7efe98074d00 2019-11-28T11:26:13.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe8ffff700 1 -- 172.21.15.80:0/788588617 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 393658638 0 0) 0x7efe80001630 con 0x7efe98074d00 2019-11-28T11:26:13.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe96d9d700 1 -- 172.21.15.80:0/788588617 >> v2:172.21.15.174:3300/0 conn(0x7efe9807bba0 msgr2=0x7efe98167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:13.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe96d9d700 1 --2- 172.21.15.80:0/788588617 >> v2:172.21.15.174:3300/0 conn(0x7efe9807bba0 0x7efe98167c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:13.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe96d9d700 1 -- 172.21.15.80:0/788588617 >> v1:172.21.15.80:6789/0 conn(0x7efe98074d00 legacy=0x7efe9807aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:13.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe96d9d700 1 -- 172.21.15.80:0/788588617 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe980792e0 con 0x7efe98150f50 2019-11-28T11:26:13.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe9ca23700 1 --2- 172.21.15.80:0/788588617 >> v2:172.21.15.174:3300/0 conn(0x7efe9807bba0 0x7efe98167c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:13.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe96d9d700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe98150f50 0x7efe9807b220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe88010330 tx=0x7efe880106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe96d9d700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe98150f50 0x7efe9807b220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe88010330 tx=0x7efe880106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe96d9d700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe98150f50 0x7efe9807b220 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7efe88010330 tx=0x7efe880106d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:13.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe96d9d700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe98150f50 0x7efe9807b220 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7efe88010330 tx=0x7efe880106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe8ffff700 1 -- 172.21.15.80:0/788588617 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe880041d0 con 0x7efe98150f50 2019-11-28T11:26:13.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe96d9d700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe98150f50 0x7efe9807b220 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7efe88010330 tx=0x7efe880106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe96d9d700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe98150f50 0x7efe9807b220 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7efe88010330 tx=0x7efe880106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe8ffff700 1 -- 172.21.15.80:0/788588617 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe88000c90 con 0x7efe98150f50 2019-11-28T11:26:13.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe8ffff700 1 -- 172.21.15.80:0/788588617 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe88000f00 con 0x7efe98150f50 2019-11-28T11:26:13.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe9d224700 1 -- 172.21.15.80:0/788588617 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe98079660 con 0x7efe98150f50 2019-11-28T11:26:13.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.891+0000 7efe9d224700 1 -- 172.21.15.80:0/788588617 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe980792e0 con 0x7efe98150f50 2019-11-28T11:26:13.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.892+0000 7efe96d9d700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe98150f50 0x7efe9807b220 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7efe88010330 tx=0x7efe880106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.892+0000 7efe8ffff700 1 -- 172.21.15.80:0/788588617 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efe88003fe0 con 0x7efe98150f50 2019-11-28T11:26:13.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.892+0000 7efe96d9d700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe98150f50 0x7efe9807b220 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7efe88010330 tx=0x7efe880106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.892+0000 7efe8ffff700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe70018780 0x7efe7001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:13.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.892+0000 7efe8ffff700 1 -- 172.21.15.80:0/788588617 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7efe880319a0 con 0x7efe98150f50 2019-11-28T11:26:13.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.892+0000 7efe9759e700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe70018780 0x7efe7001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:13.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.893+0000 7efe9759e700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe70018780 0x7efe7001abf0 crc :-1 s=READY pgs=167 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:13.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.900+0000 7efe9d224700 1 -- 172.21.15.80:0/788588617 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe98079660 con 0x7efe98150f50 2019-11-28T11:26:13.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.903+0000 7efe96d9d700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe98150f50 0x7efe9807b220 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7efe88010330 tx=0x7efe880106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:13.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:13.903+0000 7efe8ffff700 1 -- 172.21.15.80:0/788588617 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efe880258d0 con 0x7efe98150f50 2019-11-28T11:26:14.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.078+0000 7efe9d224700 1 -- 172.21.15.80:0/788588617 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe980792e0 con 0x7efe98150f50 2019-11-28T11:26:14.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.080+0000 7efe96d9d700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe98150f50 0x7efe9807b220 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7efe88010330 tx=0x7efe880106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.080+0000 7efe8ffff700 1 -- 172.21.15.80:0/788588617 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+14857 (secure 0 0 0) 0x7efe880258d0 con 0x7efe98150f50 2019-11-28T11:26:14.102 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:14.102 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":36,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:26:06.009891+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:26:02.362569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2019-11-28T11:26:03.001170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:26:14.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.083+0000 7efe9d224700 1 -- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe70018780 msgr2=0x7efe7001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.083+0000 7efe9d224700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe70018780 0x7efe7001abf0 crc :-1 s=READY pgs=167 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:14.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.083+0000 7efe9d224700 1 -- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe98150f50 msgr2=0x7efe9807b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.083+0000 7efe9d224700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe98150f50 0x7efe9807b220 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7efe88010330 tx=0x7efe880106d0).stop 2019-11-28T11:26:14.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.083+0000 7efe9d224700 1 -- 172.21.15.80:0/788588617 shutdown_connections 2019-11-28T11:26:14.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.083+0000 7efe9d224700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe70018780 0x7efe7001abf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:14.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.083+0000 7efe9d224700 1 --2- 172.21.15.80:0/788588617 >> v2:172.21.15.174:3300/0 conn(0x7efe9807bba0 0x7efe98167c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.083+0000 7efe9d224700 1 --2- 172.21.15.80:0/788588617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe98150f50 0x7efe9807b220 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.084+0000 7efe9d224700 1 -- 172.21.15.80:0/788588617 shutdown_connections 2019-11-28T11:26:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.084+0000 7efe9d224700 1 -- 172.21.15.80:0/788588617 wait complete. 2019-11-28T11:26:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.084+0000 7efe9d224700 1 -- 172.21.15.80:0/788588617 >> 172.21.15.80:0/788588617 conn(0x7efe9813fa50 msgr2=0x7efe9807c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:14.116 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:26:02.362569+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'35', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:26:03.001170+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 5, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'36', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:26:14.117 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:26:14.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.220+0000 7fd3d2516700 1 Processor -- start 2019-11-28T11:26:14.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.220+0000 7fd3d2516700 1 -- start start 2019-11-28T11:26:14.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.221+0000 7fd3d2516700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd3cc15ed10 0x7fd3cc15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:14.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.221+0000 7fd3d2516700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc0734b0 0x7fd3cc0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:14.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.221+0000 7fd3d2516700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3cc06db60 con 0x7fd3cc073020 2019-11-28T11:26:14.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.221+0000 7fd3d2516700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc06fe00 con 0x7fd3cc15ed10 2019-11-28T11:26:14.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.221+0000 7fd3d2516700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0700d0 con 0x7fd3cc0734b0 2019-11-28T11:26:14.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.221+0000 7fd3d12b4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc0734b0 0x7fd3cc0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:14.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.221+0000 7fd3d0ab3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd3cc15ed10 0x7fd3cc15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:14.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.221+0000 7fd3d12b4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc0734b0 0x7fd3cc0726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:34894/0 (socket says 172.21.15.80:34894) 2019-11-28T11:26:14.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.221+0000 7fd3d12b4700 1 -- 172.21.15.80:0/1202800322 learned_addr learned my addr 172.21.15.80:0/1202800322 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:14.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.221+0000 7fd3d0ab3700 1 --2- 172.21.15.80:0/1202800322 >> v2:172.21.15.174:3300/0 conn(0x7fd3cc15ed10 0x7fd3cc15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:47518/0 (socket says 172.21.15.80:47518) 2019-11-28T11:26:14.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.221+0000 7fd3cbfff700 1 --1- 172.21.15.80:0/1202800322 >> v1:172.21.15.174:6789/0 conn(0x7fd3cc073020 0x7fd3cc071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:47492/0 (socket says 172.21.15.80:47492) 2019-11-28T11:26:14.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3d12b4700 1 -- 172.21.15.80:0/1202800322 >> v2:172.21.15.174:3300/0 conn(0x7fd3cc15ed10 msgr2=0x7fd3cc15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:14.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3d12b4700 1 --2- 172.21.15.80:0/1202800322 >> v2:172.21.15.174:3300/0 conn(0x7fd3cc15ed10 0x7fd3cc15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:14.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3d12b4700 1 -- 172.21.15.80:0/1202800322 >> v1:172.21.15.174:6789/0 conn(0x7fd3cc073020 legacy=0x7fd3cc071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3d12b4700 1 -- 172.21.15.80:0/1202800322 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc070760 con 0x7fd3cc0734b0 2019-11-28T11:26:14.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3cb7fe700 1 -- 172.21.15.80:0/1202800322 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428455743 0 0) 0x7fd3bc001080 con 0x7fd3cc073020 2019-11-28T11:26:14.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3d0ab3700 1 --2- 172.21.15.80:0/1202800322 >> v2:172.21.15.174:3300/0 conn(0x7fd3cc15ed10 0x7fd3cc15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:14.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3d12b4700 1 --2- 172.21.15.80:0/1202800322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc0734b0 0x7fd3cc0726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd3c400fae0 tx=0x7fd3c400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3d12b4700 1 --2- 172.21.15.80:0/1202800322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc0734b0 0x7fd3cc0726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd3c400fae0 tx=0x7fd3c400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3d12b4700 1 --2- 172.21.15.80:0/1202800322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc0734b0 0x7fd3cc0726a0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7fd3c400fae0 tx=0x7fd3c400fe80).ready entity=mon.2 client_cookie=f4996585334e7620 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:14.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3d12b4700 1 --2- 172.21.15.80:0/1202800322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc0734b0 0x7fd3cc0726a0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7fd3c400fae0 tx=0x7fd3c400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3cb7fe700 1 -- 172.21.15.80:0/1202800322 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3c4000df0 con 0x7fd3cc0734b0 2019-11-28T11:26:14.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3d12b4700 1 --2- 172.21.15.80:0/1202800322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc0734b0 0x7fd3cc0726a0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7fd3c400fae0 tx=0x7fd3c400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3d12b4700 1 --2- 172.21.15.80:0/1202800322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc0734b0 0x7fd3cc0726a0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7fd3c400fae0 tx=0x7fd3c400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3cb7fe700 1 -- 172.21.15.80:0/1202800322 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c40011f0 con 0x7fd3cc0734b0 2019-11-28T11:26:14.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3cb7fe700 1 -- 172.21.15.80:0/1202800322 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3c4001880 con 0x7fd3cc0734b0 2019-11-28T11:26:14.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3d2516700 1 -- 172.21.15.80:0/1202800322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc0734b0 msgr2=0x7fd3cc0726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.222+0000 7fd3d2516700 1 --2- 172.21.15.80:0/1202800322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc0734b0 0x7fd3cc0726a0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7fd3c400fae0 tx=0x7fd3c400fe80).stop 2019-11-28T11:26:14.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.223+0000 7fd3d2516700 1 -- 172.21.15.80:0/1202800322 shutdown_connections 2019-11-28T11:26:14.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.223+0000 7fd3d2516700 1 --2- 172.21.15.80:0/1202800322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc0734b0 0x7fd3cc0726a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:14.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.223+0000 7fd3d2516700 1 --2- 172.21.15.80:0/1202800322 >> v2:172.21.15.174:3300/0 conn(0x7fd3cc15ed10 0x7fd3cc15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:14.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.223+0000 7fd3d2516700 1 -- 172.21.15.80:0/1202800322 shutdown_connections 2019-11-28T11:26:14.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.223+0000 7fd3d2516700 1 -- 172.21.15.80:0/1202800322 wait complete. 2019-11-28T11:26:14.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.223+0000 7fd3d2516700 1 -- 172.21.15.80:0/1202800322 >> 172.21.15.80:0/1202800322 conn(0x7fd3cc061d20 msgr2=0x7fd3cc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:14.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.225+0000 7fd3d2516700 1 Processor -- start 2019-11-28T11:26:14.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.225+0000 7fd3d2516700 1 -- start start 2019-11-28T11:26:14.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.226+0000 7fd3d2516700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd3cc10ed60 0x7fd3cc10f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:14.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.226+0000 7fd3d2516700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc10f730 0x7fd3cc167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:14.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.226+0000 7fd3d2516700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3cc10c250 con 0x7fd3cc10e970 2019-11-28T11:26:14.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.226+0000 7fd3d2516700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc10e430 con 0x7fd3cc10ed60 2019-11-28T11:26:14.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.226+0000 7fd3d2516700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc105860 con 0x7fd3cc10f730 2019-11-28T11:26:14.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.226+0000 7fd3cbfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd3cc10ed60 0x7fd3cc10f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:14.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.226+0000 7fd3d12b4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc10f730 0x7fd3cc167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:14.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.226+0000 7fd3d12b4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc10f730 0x7fd3cc167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:34900/0 (socket says 172.21.15.80:34900) 2019-11-28T11:26:14.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.226+0000 7fd3d12b4700 1 -- 172.21.15.80:0/39149753 learned_addr learned my addr 172.21.15.80:0/39149753 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:14.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.227+0000 7fd3cbfff700 1 -- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc10f730 msgr2=0x7fd3cc167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.227+0000 7fd3cbfff700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc10f730 0x7fd3cc167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:14.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.227+0000 7fd3cbfff700 1 -- 172.21.15.80:0/39149753 >> v1:172.21.15.174:6789/0 conn(0x7fd3cc10e970 legacy=0x7fd3cc1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.227+0000 7fd3cbfff700 1 -- 172.21.15.80:0/39149753 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc105ef0 con 0x7fd3cc10ed60 2019-11-28T11:26:14.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.227+0000 7fd3cbfff700 1 --2- 172.21.15.80:0/39149753 >> v2:172.21.15.174:3300/0 conn(0x7fd3cc10ed60 0x7fd3cc10f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3bc010370 tx=0x7fd3bc0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.227+0000 7fd3cbfff700 1 --2- 172.21.15.80:0/39149753 >> v2:172.21.15.174:3300/0 conn(0x7fd3cc10ed60 0x7fd3cc10f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3bc010370 tx=0x7fd3bc0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.227+0000 7fd3cbfff700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3cc10ed60 0x7fd3cc10f1f0 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7fd3bc010370 tx=0x7fd3bc0101a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:14.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.227+0000 7fd3cbfff700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3cc10ed60 0x7fd3cc10f1f0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fd3bc010370 tx=0x7fd3bc0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.227+0000 7fd3cbfff700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3cc10ed60 0x7fd3cc10f1f0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fd3bc010370 tx=0x7fd3bc0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.227+0000 7fd3c97fa700 1 -- 172.21.15.80:0/39149753 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3bc000c10 con 0x7fd3cc10ed60 2019-11-28T11:26:14.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.227+0000 7fd3cbfff700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3cc10ed60 0x7fd3cc10f1f0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fd3bc010370 tx=0x7fd3bc0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.227+0000 7fd3c97fa700 1 -- 172.21.15.80:0/39149753 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc0041c0 con 0x7fd3cc10ed60 2019-11-28T11:26:14.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.227+0000 7fd3d2516700 1 -- 172.21.15.80:0/39149753 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc106270 con 0x7fd3cc10ed60 2019-11-28T11:26:14.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.227+0000 7fd3c97fa700 1 -- 172.21.15.80:0/39149753 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3bc004890 con 0x7fd3cc10ed60 2019-11-28T11:26:14.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.227+0000 7fd3d2516700 1 -- 172.21.15.80:0/39149753 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3cc105ef0 con 0x7fd3cc10ed60 2019-11-28T11:26:14.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.227+0000 7fd3cbfff700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3cc10ed60 0x7fd3cc10f1f0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fd3bc010370 tx=0x7fd3bc0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.228+0000 7fd3c97fa700 1 -- 172.21.15.80:0/39149753 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd3bc0043b0 con 0x7fd3cc10ed60 2019-11-28T11:26:14.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.228+0000 7fd3cbfff700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3cc10ed60 0x7fd3cc10f1f0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fd3bc010370 tx=0x7fd3bc0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.228+0000 7fd3c97fa700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3b0018730 0x7fd3b001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:14.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.228+0000 7fd3c97fa700 1 -- 172.21.15.80:0/39149753 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd3bc031a10 con 0x7fd3cc10ed60 2019-11-28T11:26:14.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.228+0000 7fd3d0ab3700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3b0018730 0x7fd3b001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:14.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.228+0000 7fd3d0ab3700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3b0018730 0x7fd3b001abc0 crc :-1 s=READY pgs=168 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:14.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.235+0000 7fd3d2516700 1 -- 172.21.15.80:0/39149753 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3cc106270 con 0x7fd3cc10ed60 2019-11-28T11:26:14.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.239+0000 7fd3cbfff700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3cc10ed60 0x7fd3cc10f1f0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fd3bc010370 tx=0x7fd3bc0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.239+0000 7fd3c97fa700 1 -- 172.21.15.80:0/39149753 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd3bc026a00 con 0x7fd3cc10ed60 2019-11-28T11:26:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.406+0000 7fd3d2516700 1 -- 172.21.15.80:0/39149753 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fd3cc105ef0 con 0x7fd3cc10ed60 2019-11-28T11:26:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.406+0000 7fd3cbfff700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3cc10ed60 0x7fd3cc10f1f0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fd3bc010370 tx=0x7fd3bc0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.407+0000 7fd3c97fa700 1 -- 172.21.15.80:0/39149753 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd3bc026a00 con 0x7fd3cc10ed60 2019-11-28T11:26:14.428 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:26:14.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.409+0000 7fd3d2516700 1 -- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3b0018730 msgr2=0x7fd3b001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.409+0000 7fd3d2516700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3b0018730 0x7fd3b001abc0 crc :-1 s=READY pgs=168 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:14.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.409+0000 7fd3d2516700 1 -- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3cc10ed60 msgr2=0x7fd3cc10f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.409+0000 7fd3d2516700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3cc10ed60 0x7fd3cc10f1f0 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7fd3bc010370 tx=0x7fd3bc0101a0).stop 2019-11-28T11:26:14.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.409+0000 7fd3d2516700 1 -- 172.21.15.80:0/39149753 shutdown_connections 2019-11-28T11:26:14.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.409+0000 7fd3d2516700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3cc10f730 0x7fd3cc167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:14.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.409+0000 7fd3d2516700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3cc10ed60 0x7fd3cc10f1f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:14.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.409+0000 7fd3d2516700 1 --2- 172.21.15.80:0/39149753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3b0018730 0x7fd3b001abc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:14.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.409+0000 7fd3d2516700 1 -- 172.21.15.80:0/39149753 shutdown_connections 2019-11-28T11:26:14.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.409+0000 7fd3d2516700 1 -- 172.21.15.80:0/39149753 wait complete. 2019-11-28T11:26:14.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.409+0000 7fd3d2516700 1 -- 172.21.15.80:0/39149753 >> 172.21.15.80:0/39149753 conn(0x7fd3cc15e2d0 msgr2=0x7fd3cc147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:14.439 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:26:14.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.542+0000 7fe0b3eef700 1 Processor -- start 2019-11-28T11:26:14.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.542+0000 7fe0b3eef700 1 -- start start 2019-11-28T11:26:14.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.543+0000 7fe0b3eef700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe0ac15ed10 0x7fe0ac15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:14.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.543+0000 7fe0b3eef700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0ac073020 0x7fe0ac071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:14.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.543+0000 7fe0b3eef700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac06db60 con 0x7fe0ac0734b0 2019-11-28T11:26:14.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.543+0000 7fe0b3eef700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ac06fe00 con 0x7fe0ac15ed10 2019-11-28T11:26:14.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.543+0000 7fe0b3eef700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac0700d0 con 0x7fe0ac073020 2019-11-28T11:26:14.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.543+0000 7fe0b248c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe0ac15ed10 0x7fe0ac15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:14.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.543+0000 7fe0b1c8b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0ac073020 0x7fe0ac071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:14.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.543+0000 7fe0b2c8d700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe0ac0734b0 0x7fe0ac0723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:47506/0 (socket says 172.21.15.80:47506) 2019-11-28T11:26:14.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.543+0000 7fe0b1c8b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0ac073020 0x7fe0ac071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:34908/0 (socket says 172.21.15.80:34908) 2019-11-28T11:26:14.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.543+0000 7fe0b2c8d700 1 -- 172.21.15.80:0/2823344194 learned_addr learned my addr 172.21.15.80:0/2823344194 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:14.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.543+0000 7fe0b248c700 1 -- 172.21.15.80:0/2823344194 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0ac073020 msgr2=0x7fe0ac071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:14.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.543+0000 7fe0b248c700 1 --2- 172.21.15.80:0/2823344194 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0ac073020 0x7fe0ac071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:14.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.543+0000 7fe0b248c700 1 -- 172.21.15.80:0/2823344194 >> v1:172.21.15.174:6789/0 conn(0x7fe0ac0734b0 legacy=0x7fe0ac0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.543+0000 7fe0b248c700 1 -- 172.21.15.80:0/2823344194 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac070760 con 0x7fe0ac15ed10 2019-11-28T11:26:14.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.543+0000 7fe0b148a700 1 -- 172.21.15.80:0/2823344194 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769811733 0 0) 0x7fe0a4001100 con 0x7fe0ac0734b0 2019-11-28T11:26:14.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.544+0000 7fe0b248c700 1 --2- 172.21.15.80:0/2823344194 >> v2:172.21.15.174:3300/0 conn(0x7fe0ac15ed10 0x7fe0ac15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe09400b2d0 tx=0x7fe09400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.544+0000 7fe0b248c700 1 --2- 172.21.15.80:0/2823344194 >> v2:172.21.15.174:3300/0 conn(0x7fe0ac15ed10 0x7fe0ac15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe09400b2d0 tx=0x7fe09400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.544+0000 7fe0b248c700 1 --2- 172.21.15.80:0/2823344194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0ac15ed10 0x7fe0ac15f100 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7fe09400b2d0 tx=0x7fe09400ba60).ready entity=mon.1 client_cookie=baa26cb390961304 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:14.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.544+0000 7fe0b248c700 1 --2- 172.21.15.80:0/2823344194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0ac15ed10 0x7fe0ac15f100 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7fe09400b2d0 tx=0x7fe09400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.544+0000 7fe0b148a700 1 -- 172.21.15.80:0/2823344194 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe094007590 con 0x7fe0ac15ed10 2019-11-28T11:26:14.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.544+0000 7fe0b248c700 1 --2- 172.21.15.80:0/2823344194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0ac15ed10 0x7fe0ac15f100 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7fe09400b2d0 tx=0x7fe09400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.544+0000 7fe0b248c700 1 --2- 172.21.15.80:0/2823344194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0ac15ed10 0x7fe0ac15f100 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7fe09400b2d0 tx=0x7fe09400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.544+0000 7fe0b148a700 1 -- 172.21.15.80:0/2823344194 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe094009d30 con 0x7fe0ac15ed10 2019-11-28T11:26:14.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.544+0000 7fe0b148a700 1 -- 172.21.15.80:0/2823344194 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe09400a400 con 0x7fe0ac15ed10 2019-11-28T11:26:14.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.544+0000 7fe0b3eef700 1 -- 172.21.15.80:0/2823344194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0ac15ed10 msgr2=0x7fe0ac15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.544+0000 7fe0b3eef700 1 --2- 172.21.15.80:0/2823344194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0ac15ed10 0x7fe0ac15f100 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7fe09400b2d0 tx=0x7fe09400ba60).stop 2019-11-28T11:26:14.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.545+0000 7fe0b3eef700 1 -- 172.21.15.80:0/2823344194 shutdown_connections 2019-11-28T11:26:14.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.545+0000 7fe0b3eef700 1 --2- 172.21.15.80:0/2823344194 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0ac073020 0x7fe0ac071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:14.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.545+0000 7fe0b3eef700 1 --2- 172.21.15.80:0/2823344194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0ac15ed10 0x7fe0ac15f100 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:14.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.545+0000 7fe0b3eef700 1 -- 172.21.15.80:0/2823344194 shutdown_connections 2019-11-28T11:26:14.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.545+0000 7fe0b3eef700 1 -- 172.21.15.80:0/2823344194 wait complete. 2019-11-28T11:26:14.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.545+0000 7fe0b3eef700 1 -- 172.21.15.80:0/2823344194 >> 172.21.15.80:0/2823344194 conn(0x7fe0ac061d20 msgr2=0x7fe0ac0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:14.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.547+0000 7fe0b3eef700 1 Processor -- start 2019-11-28T11:26:14.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.547+0000 7fe0b3eef700 1 -- start start 2019-11-28T11:26:14.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.548+0000 7fe0b3eef700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe0ac10f9f0 0x7fe0ac168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:14.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.548+0000 7fe0b3eef700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac10c250 con 0x7fe0ac10e970 2019-11-28T11:26:14.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.548+0000 7fe0b3eef700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac10fe70 con 0x7fe0ac10ed60 2019-11-28T11:26:14.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.548+0000 7fe0b3eef700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ac10e430 con 0x7fe0ac10f9f0 2019-11-28T11:26:14.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.548+0000 7fe0b2c8d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe0ac10f9f0 0x7fe0ac168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:14.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.548+0000 7fe0b248c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe0ac10e970 0x7fe0ac1087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60198/0 (socket says 172.21.15.80:60198) 2019-11-28T11:26:14.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.548+0000 7fe0b248c700 1 -- 172.21.15.80:0/231993598 learned_addr learned my addr 172.21.15.80:0/231993598 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:14.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.548+0000 7fe0b2c8d700 1 -- 172.21.15.80:0/231993598 >> v1:172.21.15.174:6789/0 conn(0x7fe0ac10ed60 legacy=0x7fe0ac10f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.548+0000 7fe0b2c8d700 1 -- 172.21.15.80:0/231993598 >> v1:172.21.15.80:6789/0 conn(0x7fe0ac10e970 legacy=0x7fe0ac1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.548+0000 7fe0aaffd700 1 -- 172.21.15.80:0/231993598 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423351317 0 0) 0x7fe09400b3a0 con 0x7fe0ac10e970 2019-11-28T11:26:14.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.548+0000 7fe0b2c8d700 1 -- 172.21.15.80:0/231993598 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac105ef0 con 0x7fe0ac10f9f0 2019-11-28T11:26:14.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.548+0000 7fe0b2c8d700 1 --2- 172.21.15.80:0/231993598 >> v2:172.21.15.80:3300/0 conn(0x7fe0ac10f9f0 0x7fe0ac168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0a40103b0 tx=0x7fe0a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.548+0000 7fe0b2c8d700 1 --2- 172.21.15.80:0/231993598 >> v2:172.21.15.80:3300/0 conn(0x7fe0ac10f9f0 0x7fe0ac168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0a40103b0 tx=0x7fe0a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.548+0000 7fe0b2c8d700 1 --2- 172.21.15.80:0/231993598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0ac10f9f0 0x7fe0ac168d80 secure :-1 s=READY pgs=382 cs=0 l=1 rx=0x7fe0a40103b0 tx=0x7fe0a4010750).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:14.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.549+0000 7fe0b2c8d700 1 --2- 172.21.15.80:0/231993598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0ac10f9f0 0x7fe0ac168d80 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fe0a40103b0 tx=0x7fe0a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.549+0000 7fe0aaffd700 1 -- 172.21.15.80:0/231993598 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0a4000ef0 con 0x7fe0ac10f9f0 2019-11-28T11:26:14.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.549+0000 7fe0b2c8d700 1 --2- 172.21.15.80:0/231993598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0ac10f9f0 0x7fe0ac168d80 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fe0a40103b0 tx=0x7fe0a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.549+0000 7fe0aaffd700 1 -- 172.21.15.80:0/231993598 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a40041c0 con 0x7fe0ac10f9f0 2019-11-28T11:26:14.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.549+0000 7fe0b2c8d700 1 --2- 172.21.15.80:0/231993598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0ac10f9f0 0x7fe0ac168d80 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fe0a40103b0 tx=0x7fe0a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.549+0000 7fe0b3eef700 1 -- 172.21.15.80:0/231993598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac106270 con 0x7fe0ac10f9f0 2019-11-28T11:26:14.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.549+0000 7fe0aaffd700 1 -- 172.21.15.80:0/231993598 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0a4000ef0 con 0x7fe0ac10f9f0 2019-11-28T11:26:14.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.549+0000 7fe0b3eef700 1 -- 172.21.15.80:0/231993598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ac105ef0 con 0x7fe0ac10f9f0 2019-11-28T11:26:14.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.549+0000 7fe0b2c8d700 1 --2- 172.21.15.80:0/231993598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0ac10f9f0 0x7fe0ac168d80 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fe0a40103b0 tx=0x7fe0a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.549+0000 7fe0aaffd700 1 -- 172.21.15.80:0/231993598 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe0a40043b0 con 0x7fe0ac10f9f0 2019-11-28T11:26:14.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.549+0000 7fe0b2c8d700 1 --2- 172.21.15.80:0/231993598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0ac10f9f0 0x7fe0ac168d80 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fe0a40103b0 tx=0x7fe0a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.549+0000 7fe0aaffd700 1 --2- 172.21.15.80:0/231993598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe090018730 0x7fe09001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:14.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.549+0000 7fe0aaffd700 1 -- 172.21.15.80:0/231993598 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe0a4031ad0 con 0x7fe0ac10f9f0 2019-11-28T11:26:14.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.550+0000 7fe0b248c700 1 --2- 172.21.15.80:0/231993598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe090018730 0x7fe09001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:14.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.550+0000 7fe0b248c700 1 --2- 172.21.15.80:0/231993598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe090018730 0x7fe09001abc0 crc :-1 s=READY pgs=169 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:14.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.557+0000 7fe0b3eef700 1 -- 172.21.15.80:0/231993598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ac106270 con 0x7fe0ac10f9f0 2019-11-28T11:26:14.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.561+0000 7fe0b2c8d700 1 --2- 172.21.15.80:0/231993598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0ac10f9f0 0x7fe0ac168d80 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fe0a40103b0 tx=0x7fe0a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.561+0000 7fe0aaffd700 1 -- 172.21.15.80:0/231993598 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe0a4001260 con 0x7fe0ac10f9f0 2019-11-28T11:26:14.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.726+0000 7fe0b3eef700 1 -- 172.21.15.80:0/231993598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fe0ac105ef0 con 0x7fe0ac10f9f0 2019-11-28T11:26:14.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.727+0000 7fe0b2c8d700 1 --2- 172.21.15.80:0/231993598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0ac10f9f0 0x7fe0ac168d80 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fe0a40103b0 tx=0x7fe0a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.727+0000 7fe0aaffd700 1 -- 172.21.15.80:0/231993598 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v36) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe0a4004390 con 0x7fe0ac10f9f0 2019-11-28T11:26:14.748 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:26:14.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.729+0000 7fe0b3eef700 1 -- 172.21.15.80:0/231993598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe090018730 msgr2=0x7fe09001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.729+0000 7fe0b3eef700 1 --2- 172.21.15.80:0/231993598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe090018730 0x7fe09001abc0 crc :-1 s=READY pgs=169 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:14.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.729+0000 7fe0b3eef700 1 -- 172.21.15.80:0/231993598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0ac10f9f0 msgr2=0x7fe0ac168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.729+0000 7fe0b3eef700 1 --2- 172.21.15.80:0/231993598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0ac10f9f0 0x7fe0ac168d80 secure :-1 s=READY pgs=382 cs=0 l=1 rx=0x7fe0a40103b0 tx=0x7fe0a4010750).stop 2019-11-28T11:26:14.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.729+0000 7fe0b3eef700 1 -- 172.21.15.80:0/231993598 shutdown_connections 2019-11-28T11:26:14.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.729+0000 7fe0b3eef700 1 --2- 172.21.15.80:0/231993598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0ac10f9f0 0x7fe0ac168d80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:14.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.729+0000 7fe0b3eef700 1 --2- 172.21.15.80:0/231993598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe090018730 0x7fe09001abc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:14.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.729+0000 7fe0b3eef700 1 -- 172.21.15.80:0/231993598 shutdown_connections 2019-11-28T11:26:14.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.729+0000 7fe0b3eef700 1 -- 172.21.15.80:0/231993598 wait complete. 2019-11-28T11:26:14.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.729+0000 7fe0b3eef700 1 -- 172.21.15.80:0/231993598 >> 172.21.15.80:0/231993598 conn(0x7fe0ac15e2d0 msgr2=0x7fe0ac147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:14.759 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:26:14.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.862+0000 7f2ad7598700 1 Processor -- start 2019-11-28T11:26:14.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.862+0000 7f2ad7598700 1 -- start start 2019-11-28T11:26:14.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.863+0000 7f2ad7598700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ad015ed10 0x7f2ad015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:14.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.863+0000 7f2ad7598700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2ad0073020 0x7f2ad0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:14.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.863+0000 7f2ad7598700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad006db60 con 0x7f2ad00734b0 2019-11-28T11:26:14.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.863+0000 7f2ad7598700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad006fe00 con 0x7f2ad015ed10 2019-11-28T11:26:14.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.863+0000 7f2ad7598700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad00700d0 con 0x7f2ad0073020 2019-11-28T11:26:14.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.863+0000 7f2ad5b35700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ad015ed10 0x7f2ad015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:14.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.863+0000 7f2ad5b35700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ad015ed10 0x7f2ad015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60890/0 (socket says 172.21.15.80:60890) 2019-11-28T11:26:14.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.863+0000 7f2ad6336700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2ad00734b0 0x7f2ad00723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60208/0 (socket says 172.21.15.80:60208) 2019-11-28T11:26:14.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.863+0000 7f2ad5b35700 1 -- 172.21.15.80:0/2923947955 learned_addr learned my addr 172.21.15.80:0/2923947955 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:14.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.863+0000 7f2ad5334700 1 --2- 172.21.15.80:0/2923947955 >> v2:172.21.15.174:3300/0 conn(0x7f2ad0073020 0x7f2ad0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:14.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.864+0000 7f2ad5b35700 1 -- 172.21.15.80:0/2923947955 >> v2:172.21.15.174:3300/0 conn(0x7f2ad0073020 msgr2=0x7f2ad0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:14.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.864+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/2923947955 >> v2:172.21.15.174:3300/0 conn(0x7f2ad0073020 0x7f2ad0071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:14.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.864+0000 7f2ad5b35700 1 -- 172.21.15.80:0/2923947955 >> v1:172.21.15.80:6789/0 conn(0x7f2ad00734b0 legacy=0x7f2ad00723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.864+0000 7f2ad5b35700 1 -- 172.21.15.80:0/2923947955 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad0070760 con 0x7f2ad015ed10 2019-11-28T11:26:14.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.864+0000 7f2ad4b33700 1 -- 172.21.15.80:0/2923947955 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529150129 0 0) 0x7f2ac80009b0 con 0x7f2ad00734b0 2019-11-28T11:26:14.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.864+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/2923947955 >> v2:172.21.15.80:3300/0 conn(0x7f2ad015ed10 0x7f2ad015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2ab800f6c0 tx=0x7f2ab800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.864+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/2923947955 >> v2:172.21.15.80:3300/0 conn(0x7f2ad015ed10 0x7f2ad015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2ab800f6c0 tx=0x7f2ab800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.864+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/2923947955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ad015ed10 0x7f2ad015f100 secure :-1 s=READY pgs=384 cs=0 l=1 rx=0x7f2ab800f6c0 tx=0x7f2ab800fa60).ready entity=mon.0 client_cookie=21f3079fad2778ba server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:14.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.864+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/2923947955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ad015ed10 0x7f2ad015f100 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f2ab800f6c0 tx=0x7f2ab800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.864+0000 7f2ad4b33700 1 -- 172.21.15.80:0/2923947955 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ab8000960 con 0x7f2ad015ed10 2019-11-28T11:26:14.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.864+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/2923947955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ad015ed10 0x7f2ad015f100 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f2ab800f6c0 tx=0x7f2ab800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.864+0000 7f2ad4b33700 1 -- 172.21.15.80:0/2923947955 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab8000c90 con 0x7f2ad015ed10 2019-11-28T11:26:14.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.864+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/2923947955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ad015ed10 0x7f2ad015f100 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f2ab800f6c0 tx=0x7f2ab800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.864+0000 7f2ad4b33700 1 -- 172.21.15.80:0/2923947955 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ab8007210 con 0x7f2ad015ed10 2019-11-28T11:26:14.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.864+0000 7f2ad7598700 1 -- 172.21.15.80:0/2923947955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ad015ed10 msgr2=0x7f2ad015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.864+0000 7f2ad7598700 1 --2- 172.21.15.80:0/2923947955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ad015ed10 0x7f2ad015f100 secure :-1 s=READY pgs=384 cs=0 l=1 rx=0x7f2ab800f6c0 tx=0x7f2ab800fa60).stop 2019-11-28T11:26:14.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.865+0000 7f2ad7598700 1 -- 172.21.15.80:0/2923947955 shutdown_connections 2019-11-28T11:26:14.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.865+0000 7f2ad7598700 1 --2- 172.21.15.80:0/2923947955 >> v2:172.21.15.174:3300/0 conn(0x7f2ad0073020 0x7f2ad0071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:14.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.865+0000 7f2ad7598700 1 --2- 172.21.15.80:0/2923947955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ad015ed10 0x7f2ad015f100 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:14.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.865+0000 7f2ad7598700 1 -- 172.21.15.80:0/2923947955 shutdown_connections 2019-11-28T11:26:14.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.865+0000 7f2ad7598700 1 -- 172.21.15.80:0/2923947955 wait complete. 2019-11-28T11:26:14.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.865+0000 7f2ad7598700 1 -- 172.21.15.80:0/2923947955 >> 172.21.15.80:0/2923947955 conn(0x7f2ad0061d20 msgr2=0x7f2ad00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:14.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.867+0000 7f2ad7598700 1 Processor -- start 2019-11-28T11:26:14.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.867+0000 7f2ad7598700 1 -- start start 2019-11-28T11:26:14.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.868+0000 7f2ad7598700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2ad010e970 0x7f2ad01087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:14.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.868+0000 7f2ad7598700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad0108cf0 0x7f2ad0107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:14.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.868+0000 7f2ad7598700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad010c250 con 0x7f2ad0107b70 2019-11-28T11:26:14.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.868+0000 7f2ad7598700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad010e430 con 0x7f2ad010e970 2019-11-28T11:26:14.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.868+0000 7f2ad7598700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad0105860 con 0x7f2ad0108cf0 2019-11-28T11:26:14.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.868+0000 7f2ad6336700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2ad0107b70 0x7f2ad010ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60216/0 (socket says 172.21.15.80:60216) 2019-11-28T11:26:14.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.868+0000 7f2ad6336700 1 -- 172.21.15.80:0/3429235526 learned_addr learned my addr 172.21.15.80:0/3429235526 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:14.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.868+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/3429235526 >> v2:172.21.15.174:3300/0 conn(0x7f2ad010e970 0x7f2ad01087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:14.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.868+0000 7f2ad5334700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad0108cf0 0x7f2ad0107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:14.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.868+0000 7f2ace7fc700 1 -- 172.21.15.80:0/3429235526 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186562388 0 0) 0x7f2ac8000f80 con 0x7f2ad0107b70 2019-11-28T11:26:14.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.868+0000 7f2ace7fc700 1 -- 172.21.15.80:0/3429235526 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ab4002e80 con 0x7f2ad0107b70 2019-11-28T11:26:14.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ace7fc700 1 -- 172.21.15.80:0/3429235526 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1234065026 0 0) 0x7f2ac8000940 con 0x7f2ad0107b70 2019-11-28T11:26:14.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ad5b35700 1 -- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad0108cf0 msgr2=0x7f2ad0107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad0108cf0 0x7f2ad0107630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:14.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ad5b35700 1 -- 172.21.15.80:0/3429235526 >> v1:172.21.15.80:6789/0 conn(0x7f2ad0107b70 legacy=0x7f2ad010ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:14.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ad5b35700 1 -- 172.21.15.80:0/3429235526 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad0105ef0 con 0x7f2ad010e970 2019-11-28T11:26:14.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ad5334700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad0108cf0 0x7f2ad0107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:14.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/3429235526 >> v2:172.21.15.174:3300/0 conn(0x7f2ad010e970 0x7f2ad01087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ab80103a0 tx=0x7f2ab8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/3429235526 >> v2:172.21.15.174:3300/0 conn(0x7f2ad010e970 0x7f2ad01087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ab80103a0 tx=0x7f2ab8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ad010e970 0x7f2ad01087b0 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7f2ab80103a0 tx=0x7f2ab8010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:14.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ad010e970 0x7f2ad01087b0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f2ab80103a0 tx=0x7f2ab8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ace7fc700 1 -- 172.21.15.80:0/3429235526 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ab80078e0 con 0x7f2ad010e970 2019-11-28T11:26:14.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ad010e970 0x7f2ad01087b0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f2ab80103a0 tx=0x7f2ab8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ad010e970 0x7f2ad01087b0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f2ab80103a0 tx=0x7f2ab8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ace7fc700 1 -- 172.21.15.80:0/3429235526 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab8001050 con 0x7f2ad010e970 2019-11-28T11:26:14.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ad7598700 1 -- 172.21.15.80:0/3429235526 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad0106270 con 0x7f2ad010e970 2019-11-28T11:26:14.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ace7fc700 1 -- 172.21.15.80:0/3429235526 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ab80016a0 con 0x7f2ad010e970 2019-11-28T11:26:14.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ad7598700 1 -- 172.21.15.80:0/3429235526 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad0105ef0 con 0x7f2ad010e970 2019-11-28T11:26:14.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.869+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ad010e970 0x7f2ad01087b0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f2ab80103a0 tx=0x7f2ab8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.870+0000 7f2ace7fc700 1 -- 172.21.15.80:0/3429235526 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2ab80078a0 con 0x7f2ad010e970 2019-11-28T11:26:14.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.870+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ad010e970 0x7f2ad01087b0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f2ab80103a0 tx=0x7f2ab8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.870+0000 7f2ace7fc700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ab4018780 0x7f2ab401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:14.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.870+0000 7f2ace7fc700 1 -- 172.21.15.80:0/3429235526 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2ab8031c80 con 0x7f2ad010e970 2019-11-28T11:26:14.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.870+0000 7f2ad5334700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ab4018780 0x7f2ab401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:14.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.870+0000 7f2ad5334700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ab4018780 0x7f2ab401abf0 crc :-1 s=READY pgs=170 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:14.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.877+0000 7f2ad7598700 1 -- 172.21.15.80:0/3429235526 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad0106270 con 0x7f2ad010e970 2019-11-28T11:26:14.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.881+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ad010e970 0x7f2ad01087b0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f2ab80103a0 tx=0x7f2ab8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:14.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:14.881+0000 7f2ace7fc700 1 -- 172.21.15.80:0/3429235526 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2ab8000c50 con 0x7f2ad010e970 2019-11-28T11:26:15.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.047+0000 7f2ad7598700 1 -- 172.21.15.80:0/3429235526 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f2ad0105ef0 con 0x7f2ad010e970 2019-11-28T11:26:15.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.048+0000 7f2ad5b35700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ad010e970 0x7f2ad01087b0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f2ab80103a0 tx=0x7f2ab8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:15.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.048+0000 7f2ace7fc700 1 -- 172.21.15.80:0/3429235526 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v36) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2ab80078a0 con 0x7f2ad010e970 2019-11-28T11:26:15.069 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:26:15.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.050+0000 7f2ad7598700 1 -- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ab4018780 msgr2=0x7f2ab401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:15.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.050+0000 7f2ad7598700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ab4018780 0x7f2ab401abf0 crc :-1 s=READY pgs=170 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:15.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.050+0000 7f2ad7598700 1 -- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ad010e970 msgr2=0x7f2ad01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:15.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.050+0000 7f2ad7598700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ad010e970 0x7f2ad01087b0 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7f2ab80103a0 tx=0x7f2ab8010740).stop 2019-11-28T11:26:15.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.050+0000 7f2ad7598700 1 -- 172.21.15.80:0/3429235526 shutdown_connections 2019-11-28T11:26:15.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.050+0000 7f2ad7598700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ab4018780 0x7f2ab401abf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:15.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.050+0000 7f2ad7598700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad0108cf0 0x7f2ad0107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:15.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.050+0000 7f2ad7598700 1 --2- 172.21.15.80:0/3429235526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ad010e970 0x7f2ad01087b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:15.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.050+0000 7f2ad7598700 1 -- 172.21.15.80:0/3429235526 shutdown_connections 2019-11-28T11:26:15.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.050+0000 7f2ad7598700 1 -- 172.21.15.80:0/3429235526 wait complete. 2019-11-28T11:26:15.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.050+0000 7f2ad7598700 1 -- 172.21.15.80:0/3429235526 >> 172.21.15.80:0/3429235526 conn(0x7f2ad015e2d0 msgr2=0x7f2ad0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:15.081 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:26:15.081 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:26:15.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.180+0000 7fa576f4e700 1 Processor -- start 2019-11-28T11:26:15.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.180+0000 7fa576f4e700 1 -- start start 2019-11-28T11:26:15.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.181+0000 7fa576f4e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa57006c490 0x7fa57006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:15.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.181+0000 7fa576f4e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa57006ce60 0x7fa570164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:15.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.181+0000 7fa576f4e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa57006db00 con 0x7fa57006c0a0 2019-11-28T11:26:15.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.181+0000 7fa576f4e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57006fd60 con 0x7fa57006ce60 2019-11-28T11:26:15.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.181+0000 7fa576f4e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa570070030 con 0x7fa57006c490 2019-11-28T11:26:15.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.181+0000 7fa575cec700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa57006ce60 0x7fa570164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:15.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.181+0000 7fa575cec700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa57006ce60 0x7fa570164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60906/0 (socket says 172.21.15.80:60906) 2019-11-28T11:26:15.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.181+0000 7fa575cec700 1 -- 172.21.15.80:0/857379349 learned_addr learned my addr 172.21.15.80:0/857379349 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:15.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.181+0000 7fa5754eb700 1 --1- 172.21.15.80:0/857379349 >> v1:172.21.15.80:6789/0 conn(0x7fa57006c0a0 0x7fa570072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60220/0 (socket says 172.21.15.80:60220) 2019-11-28T11:26:15.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.181+0000 7fa574cea700 1 --2- 172.21.15.80:0/857379349 >> v2:172.21.15.174:3300/0 conn(0x7fa57006c490 0x7fa57006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:15.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.181+0000 7fa575cec700 1 -- 172.21.15.80:0/857379349 >> v2:172.21.15.174:3300/0 conn(0x7fa57006c490 msgr2=0x7fa57006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:15.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.181+0000 7fa575cec700 1 --2- 172.21.15.80:0/857379349 >> v2:172.21.15.174:3300/0 conn(0x7fa57006c490 0x7fa57006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:15.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.181+0000 7fa575cec700 1 -- 172.21.15.80:0/857379349 >> v1:172.21.15.80:6789/0 conn(0x7fa57006c0a0 legacy=0x7fa570072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:15.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.181+0000 7fa56ffff700 1 -- 172.21.15.80:0/857379349 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293549338 0 0) 0x7fa560001100 con 0x7fa57006c0a0 2019-11-28T11:26:15.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.181+0000 7fa575cec700 1 -- 172.21.15.80:0/857379349 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5700706c0 con 0x7fa57006ce60 2019-11-28T11:26:15.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.182+0000 7fa575cec700 1 --2- 172.21.15.80:0/857379349 >> v2:172.21.15.80:3300/0 conn(0x7fa57006ce60 0x7fa570164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa56800fa30 tx=0x7fa56800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:15.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.182+0000 7fa575cec700 1 --2- 172.21.15.80:0/857379349 >> v2:172.21.15.80:3300/0 conn(0x7fa57006ce60 0x7fa570164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa56800fa30 tx=0x7fa56800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:15.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.182+0000 7fa575cec700 1 --2- 172.21.15.80:0/857379349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57006ce60 0x7fa570164d70 secure :-1 s=READY pgs=387 cs=0 l=1 rx=0x7fa56800fa30 tx=0x7fa56800fdd0).ready entity=mon.0 client_cookie=7ce68e4b15778cb0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:15.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.182+0000 7fa575cec700 1 --2- 172.21.15.80:0/857379349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57006ce60 0x7fa570164d70 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7fa56800fa30 tx=0x7fa56800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:15.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.182+0000 7fa56ffff700 1 -- 172.21.15.80:0/857379349 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa568000df0 con 0x7fa57006ce60 2019-11-28T11:26:15.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.182+0000 7fa575cec700 1 --2- 172.21.15.80:0/857379349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57006ce60 0x7fa570164d70 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7fa56800fa30 tx=0x7fa56800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:15.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.182+0000 7fa56ffff700 1 -- 172.21.15.80:0/857379349 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa568000ce0 con 0x7fa57006ce60 2019-11-28T11:26:15.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.182+0000 7fa575cec700 1 --2- 172.21.15.80:0/857379349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57006ce60 0x7fa570164d70 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7fa56800fa30 tx=0x7fa56800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:15.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.182+0000 7fa56ffff700 1 -- 172.21.15.80:0/857379349 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa568000ed0 con 0x7fa57006ce60 2019-11-28T11:26:15.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.182+0000 7fa576f4e700 1 -- 172.21.15.80:0/857379349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57006ce60 msgr2=0x7fa570164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:15.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.182+0000 7fa576f4e700 1 --2- 172.21.15.80:0/857379349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57006ce60 0x7fa570164d70 secure :-1 s=READY pgs=387 cs=0 l=1 rx=0x7fa56800fa30 tx=0x7fa56800fdd0).stop 2019-11-28T11:26:15.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.182+0000 7fa576f4e700 1 -- 172.21.15.80:0/857379349 shutdown_connections 2019-11-28T11:26:15.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.182+0000 7fa576f4e700 1 --2- 172.21.15.80:0/857379349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa57006ce60 0x7fa570164d70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:15.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.182+0000 7fa576f4e700 1 --2- 172.21.15.80:0/857379349 >> v2:172.21.15.174:3300/0 conn(0x7fa57006c490 0x7fa57006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:15.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.183+0000 7fa576f4e700 1 -- 172.21.15.80:0/857379349 shutdown_connections 2019-11-28T11:26:15.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.183+0000 7fa576f4e700 1 -- 172.21.15.80:0/857379349 wait complete. 2019-11-28T11:26:15.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.183+0000 7fa576f4e700 1 -- 172.21.15.80:0/857379349 >> 172.21.15.80:0/857379349 conn(0x7fa570061cf0 msgr2=0x7fa570064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:15.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.185+0000 7fa576f4e700 1 Processor -- start 2019-11-28T11:26:15.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.185+0000 7fa576f4e700 1 -- start start 2019-11-28T11:26:15.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.186+0000 7fa576f4e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa570167c30 0x7fa57016a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:15.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.186+0000 7fa576f4e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa57013f1e0 con 0x7fa570109e40 2019-11-28T11:26:15.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.186+0000 7fa576f4e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa570131a30 con 0x7fa57013eb40 2019-11-28T11:26:15.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.186+0000 7fa576f4e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5701234c0 con 0x7fa570167c30 2019-11-28T11:26:15.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.186+0000 7fa574cea700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa570109e40 0x7fa57010a2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60228/0 (socket says 172.21.15.80:60228) 2019-11-28T11:26:15.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.186+0000 7fa574cea700 1 -- 172.21.15.80:0/3979935137 learned_addr learned my addr 172.21.15.80:0/3979935137 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:15.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.186+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382546101 0 0) 0x7fa5580010b0 con 0x7fa570109e40 2019-11-28T11:26:15.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.186+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa554002e80 con 0x7fa570109e40 2019-11-28T11:26:15.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.186+0000 7fa575cec700 1 --2- 172.21.15.80:0/3979935137 >> v2:172.21.15.174:3300/0 conn(0x7fa570167c30 0x7fa57016a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:15.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3384303434 0 0) 0x7fa5580012b0 con 0x7fa570109e40 2019-11-28T11:26:15.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa5540032e0 con 0x7fa570109e40 2019-11-28T11:26:15.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fa558001800 con 0x7fa570109e40 2019-11-28T11:26:15.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 >> v2:172.21.15.174:3300/0 conn(0x7fa570167c30 msgr2=0x7fa57016a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:15.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa56dffb700 1 --2- 172.21.15.80:0/3979935137 >> v2:172.21.15.174:3300/0 conn(0x7fa570167c30 0x7fa57016a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:15.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 >> v1:172.21.15.174:6789/0 conn(0x7fa57013eb40 legacy=0x7fa57010afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:15.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 >> v1:172.21.15.80:6789/0 conn(0x7fa570109e40 legacy=0x7fa57010a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:15.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa56dffb700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa554003330 0x7fa554003740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:15.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa56dffb700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa554003c80 0x7fa554004140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:15.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa56dffb700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5540049a0 0x7fa554004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:15.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55400bbf0 con 0x7fa5540049a0 2019-11-28T11:26:15.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55400be20 con 0x7fa554003c80 2019-11-28T11:26:15.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55400c050 con 0x7fa554003330 2019-11-28T11:26:15.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa575cec700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5540049a0 0x7fa554004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:15.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa574cea700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa554003c80 0x7fa554004140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:15.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa5754eb700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa554003330 0x7fa554003740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:15.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa575cec700 1 -- 172.21.15.80:0/3979935137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa554003330 msgr2=0x7fa554003740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:15.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa575cec700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa554003330 0x7fa554003740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:15.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa575cec700 1 -- 172.21.15.80:0/3979935137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa554003c80 msgr2=0x7fa554004140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:15.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa575cec700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa554003c80 0x7fa554004140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:15.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa575cec700 1 -- 172.21.15.80:0/3979935137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55400c300 con 0x7fa5540049a0 2019-11-28T11:26:15.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa576f4e700 1 -- 172.21.15.80:0/3979935137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa570108a80 con 0x7fa5540049a0 2019-11-28T11:26:15.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa575cec700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5540049a0 0x7fa554004e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa5680549c0 tx=0x7fa568054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:15.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa576f4e700 1 -- 172.21.15.80:0/3979935137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa570108700 con 0x7fa5540049a0 2019-11-28T11:26:15.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa575cec700 1 -- 172.21.15.80:0/3979935137 reap_dead start 2019-11-28T11:26:15.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa575cec700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5540049a0 0x7fa554004e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa5680549c0 tx=0x7fa568054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:15.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa575cec700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5540049a0 0x7fa554004e60 secure :-1 s=READY pgs=389 cs=0 l=1 rx=0x7fa5680549c0 tx=0x7fa568054870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:15.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa575cec700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5540049a0 0x7fa554004e60 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7fa5680549c0 tx=0x7fa568054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:15.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa568007e70 con 0x7fa5540049a0 2019-11-28T11:26:15.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa575cec700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5540049a0 0x7fa554004e60 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7fa5680549c0 tx=0x7fa568054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:15.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa568001230 con 0x7fa5540049a0 2019-11-28T11:26:15.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa575cec700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5540049a0 0x7fa554004e60 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7fa5680549c0 tx=0x7fa568054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:15.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.187+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa568007e70 con 0x7fa5540049a0 2019-11-28T11:26:15.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.188+0000 7fa575cec700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5540049a0 0x7fa554004e60 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7fa5680549c0 tx=0x7fa568054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:15.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.188+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa568000cc0 con 0x7fa5540049a0 2019-11-28T11:26:15.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.188+0000 7fa575cec700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5540049a0 0x7fa554004e60 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7fa5680549c0 tx=0x7fa568054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:15.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.188+0000 7fa56dffb700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa55401b4b0 0x7fa55401d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:15.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.188+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa568075e90 con 0x7fa5540049a0 2019-11-28T11:26:15.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.188+0000 7fa5754eb700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa55401b4b0 0x7fa55401d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:15.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.188+0000 7fa5754eb700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa55401b4b0 0x7fa55401d8e0 crc :-1 s=READY pgs=171 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:15.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.195+0000 7fa576f4e700 1 -- 172.21.15.80:0/3979935137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa548002e60 con 0x7fa5540049a0 2019-11-28T11:26:15.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.199+0000 7fa575cec700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5540049a0 0x7fa554004e60 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7fa5680549c0 tx=0x7fa568054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:15.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.199+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa568007900 con 0x7fa5540049a0 2019-11-28T11:26:15.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.371+0000 7fa576f4e700 1 -- 172.21.15.80:0/3979935137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa548001d10 con 0x7fa5540049a0 2019-11-28T11:26:15.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.372+0000 7fa575cec700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5540049a0 0x7fa554004e60 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7fa5680549c0 tx=0x7fa568054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:15.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.372+0000 7fa56dffb700 1 -- 172.21.15.80:0/3979935137 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2446 (secure 0 0 0) 0x7fa568000cc0 con 0x7fa5540049a0 2019-11-28T11:26:15.471 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2019-11-28T11:26:15.472 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:15.479 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:12.065616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:26:15.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.374+0000 7fa576f4e700 1 -- 172.21.15.80:0/3979935137 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa55401b4b0 msgr2=0x7fa55401d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:15.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.374+0000 7fa576f4e700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa55401b4b0 0x7fa55401d8e0 crc :-1 s=READY pgs=171 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:15.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.374+0000 7fa576f4e700 1 -- 172.21.15.80:0/3979935137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5540049a0 msgr2=0x7fa554004e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:15.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.374+0000 7fa576f4e700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5540049a0 0x7fa554004e60 secure :-1 s=READY pgs=389 cs=0 l=1 rx=0x7fa5680549c0 tx=0x7fa568054870).stop 2019-11-28T11:26:15.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.374+0000 7fa576f4e700 1 -- 172.21.15.80:0/3979935137 shutdown_connections 2019-11-28T11:26:15.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.374+0000 7fa576f4e700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa55401b4b0 0x7fa55401d8e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:15.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.374+0000 7fa576f4e700 1 --2- 172.21.15.80:0/3979935137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5540049a0 0x7fa554004e60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:15.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.374+0000 7fa576f4e700 1 -- 172.21.15.80:0/3979935137 shutdown_connections 2019-11-28T11:26:15.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.374+0000 7fa576f4e700 1 -- 172.21.15.80:0/3979935137 wait complete. 2019-11-28T11:26:15.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:15.374+0000 7fa576f4e700 1 -- 172.21.15.80:0/3979935137 >> 172.21.15.80:0/3979935137 conn(0x7fa57011bfc0 msgr2=0x7fa570141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:15.785 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5008}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 4, u'failed': [], u'epoch': 14, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [5], u'info': {u'gid_5008': {u'export_targets': [], u'name': u'c', u'incarnation': 13, u'state_seq': 3, u'state': u'up:active', u'gid': 5008, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2897820490, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2897820490, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2897820490'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:26:04.004932+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:26:12.065616+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:26:15.785 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:26:15.786 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:26:15.912 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:26:15.912 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:26:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:26:15.913 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5008, 2019-11-28T11:26:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:26:15.914 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:26:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 4.8234279310000003, 2019-11-28T11:26:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 14, 2019-11-28T11:26:15.915 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 36, 2019-11-28T11:26:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 36, 2019-11-28T11:26:15.916 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 9.0920659260000001 2019-11-28T11:26:15.917 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:26:15.920 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5008, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.8234279310000003, "mdsmap_epoch": 14, "osdmap_epoch": 36, "osdmap_epoch_barrier": 36, "uptime": 9.0920659260000001 } 2019-11-28T11:26:15.921 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:26:15.922 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:26:15.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:26:15.922 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:26:15.993 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:26:15.994 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:26:16.114 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:26:16.115 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:26:16.115 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:26:16.115 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:26:16.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:26:16.116 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:26:16.186 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:26:16.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.284+0000 7fae906bb700 1 Processor -- start 2019-11-28T11:26:16.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.284+0000 7fae906bb700 1 -- start start 2019-11-28T11:26:16.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.285+0000 7fae906bb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fae8806d120 0x7fae88165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:16.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.285+0000 7fae906bb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8806d5a0 con 0x7fae8806c490 2019-11-28T11:26:16.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.285+0000 7fae906bb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8806db00 con 0x7fae8806c0a0 2019-11-28T11:26:16.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.285+0000 7fae906bb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8806fd60 con 0x7fae8806d120 2019-11-28T11:26:16.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.285+0000 7fae8f459700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fae8806d120 0x7fae88165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:16.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.285+0000 7fae8e457700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fae8806c490 0x7fae8806c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60244/0 (socket says 172.21.15.80:60244) 2019-11-28T11:26:16.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.285+0000 7fae8e457700 1 -- 172.21.15.80:0/1387388349 learned_addr learned my addr 172.21.15.80:0/1387388349 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:16.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.286+0000 7fae8f459700 1 -- 172.21.15.80:0/1387388349 >> v1:172.21.15.174:6789/0 conn(0x7fae8806c0a0 legacy=0x7fae88072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:16.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.286+0000 7fae8f459700 1 -- 172.21.15.80:0/1387388349 >> v1:172.21.15.80:6789/0 conn(0x7fae8806c490 legacy=0x7fae8806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.286+0000 7fae8f459700 1 -- 172.21.15.80:0/1387388349 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae880706c0 con 0x7fae8806d120 2019-11-28T11:26:16.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.286+0000 7fae8dc56700 1 -- 172.21.15.80:0/1387388349 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415945912 0 0) 0x7fae70001150 con 0x7fae8806c490 2019-11-28T11:26:16.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.286+0000 7fae8f459700 1 --2- 172.21.15.80:0/1387388349 >> v2:172.21.15.80:3300/0 conn(0x7fae8806d120 0x7fae88165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae8000af50 tx=0x7fae8000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.286+0000 7fae8f459700 1 --2- 172.21.15.80:0/1387388349 >> v2:172.21.15.80:3300/0 conn(0x7fae8806d120 0x7fae88165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae8000af50 tx=0x7fae8000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.286+0000 7fae8f459700 1 --2- 172.21.15.80:0/1387388349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae8806d120 0x7fae88165d80 secure :-1 s=READY pgs=391 cs=0 l=1 rx=0x7fae8000af50 tx=0x7fae8000b760).ready entity=mon.0 client_cookie=58dbe4183549da54 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:16.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.286+0000 7fae8f459700 1 --2- 172.21.15.80:0/1387388349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae8806d120 0x7fae88165d80 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7fae8000af50 tx=0x7fae8000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.286+0000 7fae8dc56700 1 -- 172.21.15.80:0/1387388349 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae80009ba0 con 0x7fae8806d120 2019-11-28T11:26:16.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.286+0000 7fae8f459700 1 --2- 172.21.15.80:0/1387388349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae8806d120 0x7fae88165d80 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7fae8000af50 tx=0x7fae8000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.286+0000 7fae8f459700 1 --2- 172.21.15.80:0/1387388349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae8806d120 0x7fae88165d80 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7fae8000af50 tx=0x7fae8000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.286+0000 7fae8dc56700 1 -- 172.21.15.80:0/1387388349 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae80000b10 con 0x7fae8806d120 2019-11-28T11:26:16.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.286+0000 7fae8dc56700 1 -- 172.21.15.80:0/1387388349 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae80009ba0 con 0x7fae8806d120 2019-11-28T11:26:16.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.286+0000 7fae906bb700 1 -- 172.21.15.80:0/1387388349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae8806d120 msgr2=0x7fae88165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.286+0000 7fae906bb700 1 --2- 172.21.15.80:0/1387388349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae8806d120 0x7fae88165d80 secure :-1 s=READY pgs=391 cs=0 l=1 rx=0x7fae8000af50 tx=0x7fae8000b760).stop 2019-11-28T11:26:16.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.287+0000 7fae906bb700 1 -- 172.21.15.80:0/1387388349 shutdown_connections 2019-11-28T11:26:16.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.287+0000 7fae906bb700 1 --2- 172.21.15.80:0/1387388349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae8806d120 0x7fae88165d80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:16.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.287+0000 7fae906bb700 1 -- 172.21.15.80:0/1387388349 shutdown_connections 2019-11-28T11:26:16.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.287+0000 7fae906bb700 1 -- 172.21.15.80:0/1387388349 wait complete. 2019-11-28T11:26:16.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.287+0000 7fae906bb700 1 -- 172.21.15.80:0/1387388349 >> 172.21.15.80:0/1387388349 conn(0x7fae88061cf0 msgr2=0x7fae88064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:16.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.289+0000 7fae906bb700 1 Processor -- start 2019-11-28T11:26:16.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.289+0000 7fae906bb700 1 -- start start 2019-11-28T11:26:16.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.290+0000 7fae906bb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae8812cea0 0x7fae88111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:16.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.290+0000 7fae906bb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae88165a00 0x7fae88167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:16.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.290+0000 7fae906bb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae88124260 con 0x7fae881230e0 2019-11-28T11:26:16.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.290+0000 7fae906bb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae88120610 con 0x7fae88165a00 2019-11-28T11:26:16.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.290+0000 7fae906bb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae88121040 con 0x7fae8812cea0 2019-11-28T11:26:16.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae8f459700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae88165a00 0x7fae88167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:16.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae8ec58700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae8812cea0 0x7fae88111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:16.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae8f459700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae88165a00 0x7fae88167e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:47586/0 (socket says 172.21.15.80:47586) 2019-11-28T11:26:16.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae8f459700 1 -- 172.21.15.80:0/4031483294 learned_addr learned my addr 172.21.15.80:0/4031483294 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:16.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae8f459700 1 -- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae8812cea0 msgr2=0x7fae88111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae8f459700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae8812cea0 0x7fae88111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:16.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae8f459700 1 -- 172.21.15.80:0/4031483294 >> v1:172.21.15.174:6789/0 conn(0x7fae881230e0 legacy=0x7fae88123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae8f459700 1 -- 172.21.15.80:0/4031483294 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae881219a0 con 0x7fae88165a00 2019-11-28T11:26:16.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae8ec58700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae8812cea0 0x7fae88111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:16.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae8f459700 1 --2- 172.21.15.80:0/4031483294 >> v2:172.21.15.174:3300/0 conn(0x7fae88165a00 0x7fae88167e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae80010400 tx=0x7fae800107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae8f459700 1 --2- 172.21.15.80:0/4031483294 >> v2:172.21.15.174:3300/0 conn(0x7fae88165a00 0x7fae88167e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae80010400 tx=0x7fae800107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae8f459700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae88165a00 0x7fae88167e00 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7fae80010400 tx=0x7fae800107a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:16.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae8f459700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae88165a00 0x7fae88167e00 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7fae80010400 tx=0x7fae800107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae8f459700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae88165a00 0x7fae88167e00 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7fae80010400 tx=0x7fae800107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae877fe700 1 -- 172.21.15.80:0/4031483294 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8000afb0 con 0x7fae88165a00 2019-11-28T11:26:16.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae8f459700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae88165a00 0x7fae88167e00 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7fae80010400 tx=0x7fae800107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae877fe700 1 -- 172.21.15.80:0/4031483294 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae80009770 con 0x7fae88165a00 2019-11-28T11:26:16.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae906bb700 1 -- 172.21.15.80:0/4031483294 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae88121d20 con 0x7fae88165a00 2019-11-28T11:26:16.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae877fe700 1 -- 172.21.15.80:0/4031483294 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae80009e40 con 0x7fae88165a00 2019-11-28T11:26:16.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.291+0000 7fae906bb700 1 -- 172.21.15.80:0/4031483294 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae881122f0 con 0x7fae88165a00 2019-11-28T11:26:16.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.292+0000 7fae8f459700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae88165a00 0x7fae88167e00 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7fae80010400 tx=0x7fae800107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.292+0000 7fae877fe700 1 -- 172.21.15.80:0/4031483294 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fae80009960 con 0x7fae88165a00 2019-11-28T11:26:16.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.292+0000 7fae8f459700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae88165a00 0x7fae88167e00 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7fae80010400 tx=0x7fae800107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.292+0000 7fae877fe700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae6c018730 0x7fae6c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:16.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.292+0000 7fae877fe700 1 -- 172.21.15.80:0/4031483294 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fae80031ac0 con 0x7fae88165a00 2019-11-28T11:26:16.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.292+0000 7fae8ec58700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae6c018730 0x7fae6c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:16.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.292+0000 7fae8ec58700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae6c018730 0x7fae6c01abc0 crc :-1 s=READY pgs=172 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:16.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.300+0000 7fae906bb700 1 -- 172.21.15.80:0/4031483294 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae881219a0 con 0x7fae88165a00 2019-11-28T11:26:16.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.303+0000 7fae8f459700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae88165a00 0x7fae88167e00 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7fae80010400 tx=0x7fae800107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.303+0000 7fae877fe700 1 -- 172.21.15.80:0/4031483294 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fae8000ac20 con 0x7fae88165a00 2019-11-28T11:26:16.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.481+0000 7fae906bb700 1 -- 172.21.15.80:0/4031483294 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae88121d20 con 0x7fae88165a00 2019-11-28T11:26:16.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.482+0000 7fae8f459700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae88165a00 0x7fae88167e00 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7fae80010400 tx=0x7fae800107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.482+0000 7fae877fe700 1 -- 172.21.15.80:0/4031483294 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+14857 (secure 0 0 0) 0x7fae80017750 con 0x7fae88165a00 2019-11-28T11:26:16.505 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:16.506 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":36,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:26:06.009891+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:26:02.362569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2019-11-28T11:26:03.001170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:26:16.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.486+0000 7fae906bb700 1 -- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae6c018730 msgr2=0x7fae6c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.486+0000 7fae906bb700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae6c018730 0x7fae6c01abc0 crc :-1 s=READY pgs=172 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:16.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.486+0000 7fae906bb700 1 -- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae88165a00 msgr2=0x7fae88167e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.486+0000 7fae906bb700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae88165a00 0x7fae88167e00 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7fae80010400 tx=0x7fae800107a0).stop 2019-11-28T11:26:16.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.486+0000 7fae906bb700 1 -- 172.21.15.80:0/4031483294 shutdown_connections 2019-11-28T11:26:16.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.486+0000 7fae906bb700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae88165a00 0x7fae88167e00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:16.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.486+0000 7fae906bb700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae6c018730 0x7fae6c01abc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:16.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.486+0000 7fae906bb700 1 --2- 172.21.15.80:0/4031483294 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae8812cea0 0x7fae88111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:16.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.486+0000 7fae906bb700 1 -- 172.21.15.80:0/4031483294 shutdown_connections 2019-11-28T11:26:16.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.486+0000 7fae906bb700 1 -- 172.21.15.80:0/4031483294 wait complete. 2019-11-28T11:26:16.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.486+0000 7fae906bb700 1 -- 172.21.15.80:0/4031483294 >> 172.21.15.80:0/4031483294 conn(0x7fae881426c0 msgr2=0x7fae88110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:16.518 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:26:02.362569+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'35', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:26:03.001170+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 5, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'36', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:26:16.519 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:26:16.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.621+0000 7f70aae84700 1 Processor -- start 2019-11-28T11:26:16.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.621+0000 7f70aae84700 1 -- start start 2019-11-28T11:26:16.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.622+0000 7f70aae84700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f70a41639f0 0x7f70a4165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:16.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.622+0000 7f70aae84700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a406db60 con 0x7f70a415f100 2019-11-28T11:26:16.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.622+0000 7f70aae84700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a406e060 con 0x7f70a415ed10 2019-11-28T11:26:16.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.622+0000 7f70aae84700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a406fe00 con 0x7f70a41639f0 2019-11-28T11:26:16.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.622+0000 7f70a8c20700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f70a415f100 0x7f70a406bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60256/0 (socket says 172.21.15.80:60256) 2019-11-28T11:26:16.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.622+0000 7f70a8c20700 1 -- 172.21.15.80:0/4255240302 learned_addr learned my addr 172.21.15.80:0/4255240302 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:16.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a9c22700 1 --2- 172.21.15.80:0/4255240302 >> v2:172.21.15.174:3300/0 conn(0x7f70a41639f0 0x7f70a4165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:16.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a3fff700 1 -- 172.21.15.80:0/4255240302 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636173158 0 0) 0x7f7094001150 con 0x7f70a415f100 2019-11-28T11:26:16.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a3fff700 1 -- 172.21.15.80:0/4255240302 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7090002e80 con 0x7f70a415f100 2019-11-28T11:26:16.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a3fff700 1 -- 172.21.15.80:0/4255240302 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3414541207 0 0) 0x7f7094001130 con 0x7f70a415f100 2019-11-28T11:26:16.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a3fff700 1 -- 172.21.15.80:0/4255240302 >> v2:172.21.15.174:3300/0 conn(0x7f70a41639f0 msgr2=0x7f70a4165df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:16.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a3fff700 1 --2- 172.21.15.80:0/4255240302 >> v2:172.21.15.174:3300/0 conn(0x7f70a41639f0 0x7f70a4165df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:16.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a3fff700 1 -- 172.21.15.80:0/4255240302 >> v1:172.21.15.174:6789/0 conn(0x7f70a415ed10 legacy=0x7f70a4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a3fff700 1 -- 172.21.15.80:0/4255240302 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a4070760 con 0x7f70a415f100 2019-11-28T11:26:16.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a3fff700 1 -- 172.21.15.80:0/4255240302 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f7094001660 con 0x7f70a415f100 2019-11-28T11:26:16.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a3fff700 1 -- 172.21.15.80:0/4255240302 >> v1:172.21.15.80:6789/0 conn(0x7f70a415f100 legacy=0x7f70a406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a3fff700 1 --2- 172.21.15.80:0/4255240302 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7090003ab0 0x7f7090005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:16.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a3fff700 1 --2- 172.21.15.80:0/4255240302 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7090006670 0x7f7090008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:16.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a3fff700 1 --2- 172.21.15.80:0/4255240302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70900093a0 0x7f709000b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:16.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a3fff700 1 -- 172.21.15.80:0/4255240302 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709000c020 con 0x7f70900093a0 2019-11-28T11:26:16.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a3fff700 1 -- 172.21.15.80:0/4255240302 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7090050220 con 0x7f7090003ab0 2019-11-28T11:26:16.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a3fff700 1 -- 172.21.15.80:0/4255240302 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7090050450 con 0x7f7090006670 2019-11-28T11:26:16.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a9c22700 1 --2- 172.21.15.80:0/4255240302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70900093a0 0x7f709000b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:16.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a9421700 1 --2- 172.21.15.80:0/4255240302 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7090003ab0 0x7f7090005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:16.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a8c20700 1 --2- 172.21.15.80:0/4255240302 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7090006670 0x7f7090008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:16.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a9c22700 1 -- 172.21.15.80:0/4255240302 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7090006670 msgr2=0x7f7090008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:16.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a9c22700 1 --2- 172.21.15.80:0/4255240302 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7090006670 0x7f7090008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a9c22700 1 -- 172.21.15.80:0/4255240302 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7090003ab0 msgr2=0x7f7090005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a9c22700 1 --2- 172.21.15.80:0/4255240302 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7090003ab0 0x7f7090005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a9c22700 1 -- 172.21.15.80:0/4255240302 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7090050700 con 0x7f70900093a0 2019-11-28T11:26:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a9c22700 1 --2- 172.21.15.80:0/4255240302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70900093a0 0x7f709000b870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f709c00e800 tx=0x7f709c00eb80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a9c22700 1 -- 172.21.15.80:0/4255240302 reap_dead start 2019-11-28T11:26:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.623+0000 7f70a9c22700 1 --2- 172.21.15.80:0/4255240302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70900093a0 0x7f709000b870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f709c00e800 tx=0x7f709c00eb80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.624+0000 7f70a9c22700 1 --2- 172.21.15.80:0/4255240302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70900093a0 0x7f709000b870 secure :-1 s=READY pgs=393 cs=0 l=1 rx=0x7f709c00e800 tx=0x7f709c00eb80).ready entity=mon.0 client_cookie=1b57cb6654769cd4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.624+0000 7f70a9c22700 1 --2- 172.21.15.80:0/4255240302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70900093a0 0x7f709000b870 secure :-1 s=THROTTLE_DONE pgs=393 cs=0 l=1 rx=0x7f709c00e800 tx=0x7f709c00eb80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.624+0000 7f70a9c22700 1 --2- 172.21.15.80:0/4255240302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70900093a0 0x7f709000b870 secure :-1 s=THROTTLE_DONE pgs=393 cs=0 l=1 rx=0x7f709c00e800 tx=0x7f709c00eb80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.624+0000 7f70a3fff700 1 -- 172.21.15.80:0/4255240302 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f709c00f1c0 con 0x7f70900093a0 2019-11-28T11:26:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.624+0000 7f70a9c22700 1 --2- 172.21.15.80:0/4255240302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70900093a0 0x7f709000b870 secure :-1 s=THROTTLE_DONE pgs=393 cs=0 l=1 rx=0x7f709c00e800 tx=0x7f709c00eb80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.624+0000 7f70a3fff700 1 -- 172.21.15.80:0/4255240302 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c00ede0 con 0x7f70900093a0 2019-11-28T11:26:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.624+0000 7f70a3fff700 1 -- 172.21.15.80:0/4255240302 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f709c00f840 con 0x7f70900093a0 2019-11-28T11:26:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.624+0000 7f70aae84700 1 -- 172.21.15.80:0/4255240302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70900093a0 msgr2=0x7f709000b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.624+0000 7f70aae84700 1 --2- 172.21.15.80:0/4255240302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70900093a0 0x7f709000b870 secure :-1 s=READY pgs=393 cs=0 l=1 rx=0x7f709c00e800 tx=0x7f709c00eb80).stop 2019-11-28T11:26:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.624+0000 7f70aae84700 1 -- 172.21.15.80:0/4255240302 shutdown_connections 2019-11-28T11:26:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.624+0000 7f70aae84700 1 --2- 172.21.15.80:0/4255240302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70900093a0 0x7f709000b870 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.624+0000 7f70aae84700 1 -- 172.21.15.80:0/4255240302 shutdown_connections 2019-11-28T11:26:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.624+0000 7f70aae84700 1 -- 172.21.15.80:0/4255240302 wait complete. 2019-11-28T11:26:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.624+0000 7f70aae84700 1 -- 172.21.15.80:0/4255240302 >> 172.21.15.80:0/4255240302 conn(0x7f70a4061d20 msgr2=0x7f70a40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.627+0000 7f70aae84700 1 Processor -- start 2019-11-28T11:26:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.627+0000 7f70aae84700 1 -- start start 2019-11-28T11:26:16.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.628+0000 7f70aae84700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f70a4108630 0x7f70a4152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:16.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.628+0000 7f70aae84700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a410a310 con 0x7f70a41527a0 2019-11-28T11:26:16.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.628+0000 7f70aae84700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a4109e50 con 0x7f70a412caa0 2019-11-28T11:26:16.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.628+0000 7f70aae84700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a412ee80 con 0x7f70a4108630 2019-11-28T11:26:16.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.628+0000 7f70a8c20700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f70a41527a0 0x7f70a412c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60268/0 (socket says 172.21.15.80:60268) 2019-11-28T11:26:16.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.628+0000 7f70a8c20700 1 -- 172.21.15.80:0/163038381 learned_addr learned my addr 172.21.15.80:0/163038381 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:16.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.628+0000 7f70a9421700 1 --2- 172.21.15.80:0/163038381 >> v2:172.21.15.174:3300/0 conn(0x7f70a4108630 0x7f70a4152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:16.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.628+0000 7f70a1ffb700 1 -- 172.21.15.80:0/163038381 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717411713 0 0) 0x7f7094001110 con 0x7f70a41527a0 2019-11-28T11:26:16.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.628+0000 7f70a1ffb700 1 -- 172.21.15.80:0/163038381 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7088002e80 con 0x7f70a41527a0 2019-11-28T11:26:16.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.629+0000 7f70a1ffb700 1 -- 172.21.15.80:0/163038381 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075870823 0 0) 0x7f709c000df0 con 0x7f70a412caa0 2019-11-28T11:26:16.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.629+0000 7f70a9421700 1 -- 172.21.15.80:0/163038381 >> v1:172.21.15.174:6789/0 conn(0x7f70a412caa0 legacy=0x7f70a41510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.629+0000 7f70a9421700 1 -- 172.21.15.80:0/163038381 >> v1:172.21.15.80:6789/0 conn(0x7f70a41527a0 legacy=0x7f70a412c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.629+0000 7f70a9421700 1 -- 172.21.15.80:0/163038381 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a4133350 con 0x7f70a4108630 2019-11-28T11:26:16.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.629+0000 7f70a9421700 1 --2- 172.21.15.80:0/163038381 >> v2:172.21.15.174:3300/0 conn(0x7f70a4108630 0x7f70a4152260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f708c010370 tx=0x7f708c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.629+0000 7f70a9421700 1 --2- 172.21.15.80:0/163038381 >> v2:172.21.15.174:3300/0 conn(0x7f70a4108630 0x7f70a4152260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f708c010370 tx=0x7f708c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.629+0000 7f70a9421700 1 --2- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70a4108630 0x7f70a4152260 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7f708c010370 tx=0x7f708c010710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:16.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.629+0000 7f70a9421700 1 --2- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70a4108630 0x7f70a4152260 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f708c010370 tx=0x7f708c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.629+0000 7f70a1ffb700 1 -- 172.21.15.80:0/163038381 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f708c009580 con 0x7f70a4108630 2019-11-28T11:26:16.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.629+0000 7f70a9421700 1 --2- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70a4108630 0x7f70a4152260 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f708c010370 tx=0x7f708c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.629+0000 7f70a9421700 1 --2- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70a4108630 0x7f70a4152260 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f708c010370 tx=0x7f708c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.629+0000 7f70a1ffb700 1 -- 172.21.15.80:0/163038381 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c009bf0 con 0x7f70a4108630 2019-11-28T11:26:16.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.629+0000 7f70a1ffb700 1 -- 172.21.15.80:0/163038381 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f708c00a200 con 0x7f70a4108630 2019-11-28T11:26:16.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.629+0000 7f70aae84700 1 -- 172.21.15.80:0/163038381 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a41336d0 con 0x7f70a4108630 2019-11-28T11:26:16.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.629+0000 7f70aae84700 1 -- 172.21.15.80:0/163038381 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a4133350 con 0x7f70a4108630 2019-11-28T11:26:16.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.629+0000 7f70a9421700 1 --2- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70a4108630 0x7f70a4152260 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f708c010370 tx=0x7f708c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.630+0000 7f70a1ffb700 1 -- 172.21.15.80:0/163038381 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f708c0097a0 con 0x7f70a4108630 2019-11-28T11:26:16.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.630+0000 7f70a9421700 1 --2- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70a4108630 0x7f70a4152260 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f708c010370 tx=0x7f708c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.630+0000 7f70a1ffb700 1 --2- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7088018780 0x7f708801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:16.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.630+0000 7f70a1ffb700 1 -- 172.21.15.80:0/163038381 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f708c031ab0 con 0x7f70a4108630 2019-11-28T11:26:16.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.630+0000 7f70a8c20700 1 --2- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7088018780 0x7f708801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:16.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.630+0000 7f70a8c20700 1 --2- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7088018780 0x7f708801abf0 crc :-1 s=READY pgs=173 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:16.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.636+0000 7f70aae84700 1 -- 172.21.15.80:0/163038381 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a41336d0 con 0x7f70a4108630 2019-11-28T11:26:16.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.640+0000 7f70a9421700 1 --2- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70a4108630 0x7f70a4152260 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f708c010370 tx=0x7f708c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.640+0000 7f70a1ffb700 1 -- 172.21.15.80:0/163038381 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f708c009580 con 0x7f70a4108630 2019-11-28T11:26:16.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.808+0000 7f70aae84700 1 -- 172.21.15.80:0/163038381 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f70a4133350 con 0x7f70a4108630 2019-11-28T11:26:16.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.809+0000 7f70a9421700 1 --2- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70a4108630 0x7f70a4152260 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f708c010370 tx=0x7f708c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.809+0000 7f70a1ffb700 1 -- 172.21.15.80:0/163038381 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7f708c0097a0 con 0x7f70a4108630 2019-11-28T11:26:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.811+0000 7f70aae84700 1 -- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7088018780 msgr2=0x7f708801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.811+0000 7f70aae84700 1 --2- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7088018780 0x7f708801abf0 crc :-1 s=READY pgs=173 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.811+0000 7f70aae84700 1 -- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70a4108630 msgr2=0x7f70a4152260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.811+0000 7f70aae84700 1 --2- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70a4108630 0x7f70a4152260 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7f708c010370 tx=0x7f708c010710).stop 2019-11-28T11:26:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.812+0000 7f70aae84700 1 -- 172.21.15.80:0/163038381 shutdown_connections 2019-11-28T11:26:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.812+0000 7f70aae84700 1 --2- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7088018780 0x7f708801abf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.812+0000 7f70aae84700 1 --2- 172.21.15.80:0/163038381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70a4108630 0x7f70a4152260 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.812+0000 7f70aae84700 1 -- 172.21.15.80:0/163038381 shutdown_connections 2019-11-28T11:26:16.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.812+0000 7f70aae84700 1 -- 172.21.15.80:0/163038381 wait complete. 2019-11-28T11:26:16.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.812+0000 7f70aae84700 1 -- 172.21.15.80:0/163038381 >> 172.21.15.80:0/163038381 conn(0x7f70a414dbb0 msgr2=0x7f70a4142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:16.843 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:26:16.845 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:26:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.947+0000 7f011a9f8700 1 Processor -- start 2019-11-28T11:26:16.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.947+0000 7f011a9f8700 1 -- start start 2019-11-28T11:26:16.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f011a9f8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01141639f0 0x7f0114165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:16.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f011a9f8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011406db60 con 0x7f011415ed10 2019-11-28T11:26:16.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f011a9f8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011406e060 con 0x7f011415f100 2019-11-28T11:26:16.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f011a9f8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f011406fe00 con 0x7f01141639f0 2019-11-28T11:26:16.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f0119796700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01141639f0 0x7f0114165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:16.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f0119796700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01141639f0 0x7f0114165df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60958/0 (socket says 172.21.15.80:60958) 2019-11-28T11:26:16.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f0119796700 1 -- 172.21.15.80:0/3595607596 learned_addr learned my addr 172.21.15.80:0/3595607596 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:16.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f0118f95700 1 --1- 172.21.15.80:0/3595607596 >> v1:172.21.15.80:6789/0 conn(0x7f011415ed10 0x7f0114073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60272/0 (socket says 172.21.15.80:60272) 2019-11-28T11:26:16.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f0119796700 1 -- 172.21.15.80:0/3595607596 >> v1:172.21.15.174:6789/0 conn(0x7f011415f100 legacy=0x7f011406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f0119796700 1 -- 172.21.15.80:0/3595607596 >> v1:172.21.15.80:6789/0 conn(0x7f011415ed10 legacy=0x7f0114073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f0119796700 1 -- 172.21.15.80:0/3595607596 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0114070760 con 0x7f01141639f0 2019-11-28T11:26:16.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f01137fe700 1 -- 172.21.15.80:0/3595607596 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404775818 0 0) 0x7f00fc001100 con 0x7f011415ed10 2019-11-28T11:26:16.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f0119796700 1 --2- 172.21.15.80:0/3595607596 >> v2:172.21.15.80:3300/0 conn(0x7f01141639f0 0x7f0114165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f010c00f730 tx=0x7f010c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f0119796700 1 --2- 172.21.15.80:0/3595607596 >> v2:172.21.15.80:3300/0 conn(0x7f01141639f0 0x7f0114165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f010c00f730 tx=0x7f010c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f0119796700 1 --2- 172.21.15.80:0/3595607596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01141639f0 0x7f0114165df0 secure :-1 s=READY pgs=396 cs=0 l=1 rx=0x7f010c00f730 tx=0x7f010c00fad0).ready entity=mon.0 client_cookie=492d7162e829c147 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:16.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f0119796700 1 --2- 172.21.15.80:0/3595607596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01141639f0 0x7f0114165df0 secure :-1 s=THROTTLE_DONE pgs=396 cs=0 l=1 rx=0x7f010c00f730 tx=0x7f010c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f01137fe700 1 -- 172.21.15.80:0/3595607596 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f010c0010e0 con 0x7f01141639f0 2019-11-28T11:26:16.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f0119796700 1 --2- 172.21.15.80:0/3595607596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01141639f0 0x7f0114165df0 secure :-1 s=THROTTLE_DONE pgs=396 cs=0 l=1 rx=0x7f010c00f730 tx=0x7f010c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f0119796700 1 --2- 172.21.15.80:0/3595607596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01141639f0 0x7f0114165df0 secure :-1 s=THROTTLE_DONE pgs=396 cs=0 l=1 rx=0x7f010c00f730 tx=0x7f010c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f01137fe700 1 -- 172.21.15.80:0/3595607596 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c000a70 con 0x7f01141639f0 2019-11-28T11:26:16.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.948+0000 7f01137fe700 1 -- 172.21.15.80:0/3595607596 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f010c0016c0 con 0x7f01141639f0 2019-11-28T11:26:16.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.949+0000 7f011a9f8700 1 -- 172.21.15.80:0/3595607596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01141639f0 msgr2=0x7f0114165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.949+0000 7f011a9f8700 1 --2- 172.21.15.80:0/3595607596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01141639f0 0x7f0114165df0 secure :-1 s=READY pgs=396 cs=0 l=1 rx=0x7f010c00f730 tx=0x7f010c00fad0).stop 2019-11-28T11:26:16.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.949+0000 7f011a9f8700 1 -- 172.21.15.80:0/3595607596 shutdown_connections 2019-11-28T11:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.949+0000 7f011a9f8700 1 --2- 172.21.15.80:0/3595607596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01141639f0 0x7f0114165df0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.949+0000 7f011a9f8700 1 -- 172.21.15.80:0/3595607596 shutdown_connections 2019-11-28T11:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.949+0000 7f011a9f8700 1 -- 172.21.15.80:0/3595607596 wait complete. 2019-11-28T11:26:16.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.949+0000 7f011a9f8700 1 -- 172.21.15.80:0/3595607596 >> 172.21.15.80:0/3595607596 conn(0x7f0114061d20 msgr2=0x7f01140641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:16.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.952+0000 7f011a9f8700 1 Processor -- start 2019-11-28T11:26:16.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.952+0000 7f011a9f8700 1 -- start start 2019-11-28T11:26:16.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f011a9f8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f011410ed60 0x7f011410f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:16.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f011a9f8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011410f730 0x7f0114167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:16.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f011a9f8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011410c250 con 0x7f011410e970 2019-11-28T11:26:16.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f011a9f8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f011410e430 con 0x7f011410ed60 2019-11-28T11:26:16.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f011a9f8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0114105860 con 0x7f011410f730 2019-11-28T11:26:16.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f0113fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f011410ed60 0x7f011410f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:16.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f0118f95700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f011410e970 0x7f01141087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60276/0 (socket says 172.21.15.80:60276) 2019-11-28T11:26:16.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f0118f95700 1 -- 172.21.15.80:0/37895128 learned_addr learned my addr 172.21.15.80:0/37895128 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:16.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f0119796700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011410f730 0x7f0114167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:16.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f0113fff700 1 -- 172.21.15.80:0/37895128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011410f730 msgr2=0x7f0114167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f0113fff700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011410f730 0x7f0114167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:16.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f0113fff700 1 -- 172.21.15.80:0/37895128 >> v1:172.21.15.80:6789/0 conn(0x7f011410e970 legacy=0x7f01141087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:16.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f01117fa700 1 -- 172.21.15.80:0/37895128 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898862618 0 0) 0x7f00fc001150 con 0x7f011410e970 2019-11-28T11:26:16.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f0113fff700 1 -- 172.21.15.80:0/37895128 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0114105ef0 con 0x7f011410ed60 2019-11-28T11:26:16.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f0113fff700 1 --2- 172.21.15.80:0/37895128 >> v2:172.21.15.80:3300/0 conn(0x7f011410ed60 0x7f011410f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0104010730 tx=0x7f0104010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f0113fff700 1 --2- 172.21.15.80:0/37895128 >> v2:172.21.15.80:3300/0 conn(0x7f011410ed60 0x7f011410f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0104010730 tx=0x7f0104010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f0113fff700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011410ed60 0x7f011410f1f0 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7f0104010730 tx=0x7f0104010560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:16.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f0113fff700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011410ed60 0x7f011410f1f0 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f0104010730 tx=0x7f0104010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f01117fa700 1 -- 172.21.15.80:0/37895128 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0104009ff0 con 0x7f011410ed60 2019-11-28T11:26:16.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f0113fff700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011410ed60 0x7f011410f1f0 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f0104010730 tx=0x7f0104010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f0113fff700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011410ed60 0x7f011410f1f0 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f0104010730 tx=0x7f0104010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f01117fa700 1 -- 172.21.15.80:0/37895128 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0104009b70 con 0x7f011410ed60 2019-11-28T11:26:16.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f01117fa700 1 -- 172.21.15.80:0/37895128 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f010400a5d0 con 0x7f011410ed60 2019-11-28T11:26:16.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f011a9f8700 1 -- 172.21.15.80:0/37895128 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0114106270 con 0x7f011410ed60 2019-11-28T11:26:16.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.953+0000 7f011a9f8700 1 -- 172.21.15.80:0/37895128 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0114105ef0 con 0x7f011410ed60 2019-11-28T11:26:16.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.954+0000 7f0113fff700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011410ed60 0x7f011410f1f0 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f0104010730 tx=0x7f0104010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.954+0000 7f01117fa700 1 -- 172.21.15.80:0/37895128 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0104009e00 con 0x7f011410ed60 2019-11-28T11:26:16.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.954+0000 7f0113fff700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011410ed60 0x7f011410f1f0 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f0104010730 tx=0x7f0104010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.954+0000 7f01117fa700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00f8018730 0x7f00f801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:16.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.954+0000 7f01117fa700 1 -- 172.21.15.80:0/37895128 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0104031d70 con 0x7f011410ed60 2019-11-28T11:26:16.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.954+0000 7f0118f95700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00f8018730 0x7f00f801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:16.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.954+0000 7f0118f95700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00f8018730 0x7f00f801abc0 crc :-1 s=READY pgs=174 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:16.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.962+0000 7f011a9f8700 1 -- 172.21.15.80:0/37895128 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0114106270 con 0x7f011410ed60 2019-11-28T11:26:16.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.965+0000 7f0113fff700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011410ed60 0x7f011410f1f0 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f0104010730 tx=0x7f0104010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:16.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:16.965+0000 7f01117fa700 1 -- 172.21.15.80:0/37895128 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0104009960 con 0x7f011410ed60 2019-11-28T11:26:17.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.134+0000 7f011a9f8700 1 -- 172.21.15.80:0/37895128 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f0114105ef0 con 0x7f011410ed60 2019-11-28T11:26:17.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.135+0000 7f0113fff700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011410ed60 0x7f011410f1f0 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f0104010730 tx=0x7f0104010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.135+0000 7f01117fa700 1 -- 172.21.15.80:0/37895128 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v36) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0104009c60 con 0x7f011410ed60 2019-11-28T11:26:17.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.137+0000 7f011a9f8700 1 -- 172.21.15.80:0/37895128 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00f8018730 msgr2=0x7f00f801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:17.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.137+0000 7f011a9f8700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00f8018730 0x7f00f801abc0 crc :-1 s=READY pgs=174 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:17.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.137+0000 7f011a9f8700 1 -- 172.21.15.80:0/37895128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011410ed60 msgr2=0x7f011410f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:17.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.137+0000 7f011a9f8700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011410ed60 0x7f011410f1f0 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7f0104010730 tx=0x7f0104010560).stop 2019-11-28T11:26:17.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.137+0000 7f011a9f8700 1 -- 172.21.15.80:0/37895128 shutdown_connections 2019-11-28T11:26:17.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.137+0000 7f011a9f8700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00f8018730 0x7f00f801abc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:17.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.137+0000 7f011a9f8700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011410f730 0x7f0114167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:17.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.137+0000 7f011a9f8700 1 --2- 172.21.15.80:0/37895128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011410ed60 0x7f011410f1f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:17.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.138+0000 7f011a9f8700 1 -- 172.21.15.80:0/37895128 shutdown_connections 2019-11-28T11:26:17.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.138+0000 7f011a9f8700 1 -- 172.21.15.80:0/37895128 wait complete. 2019-11-28T11:26:17.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.138+0000 7f011a9f8700 1 -- 172.21.15.80:0/37895128 >> 172.21.15.80:0/37895128 conn(0x7f011415e2d0 msgr2=0x7f0114147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:17.178 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:26:17.203 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:26:17.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.323+0000 7f1e5e743700 1 Processor -- start 2019-11-28T11:26:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.323+0000 7f1e5e743700 1 -- start start 2019-11-28T11:26:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.324+0000 7f1e5e743700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e5815ed10 0x7f1e5815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.324+0000 7f1e5e743700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e58073020 0x7f1e58071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.324+0000 7f1e5e743700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5806db60 con 0x7f1e580734b0 2019-11-28T11:26:17.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.324+0000 7f1e5e743700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e5806fe00 con 0x7f1e5815ed10 2019-11-28T11:26:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.324+0000 7f1e5e743700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e580700d0 con 0x7f1e58073020 2019-11-28T11:26:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.324+0000 7f1e5cce0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e5815ed10 0x7f1e5815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.324+0000 7f1e5cce0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e5815ed10 0x7f1e5815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60968/0 (socket says 172.21.15.80:60968) 2019-11-28T11:26:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.324+0000 7f1e5cce0700 1 -- 172.21.15.80:0/795268860 learned_addr learned my addr 172.21.15.80:0/795268860 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.324+0000 7f1e57fff700 1 --2- 172.21.15.80:0/795268860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e58073020 0x7f1e58071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:17.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.324+0000 7f1e5cce0700 1 -- 172.21.15.80:0/795268860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e58073020 msgr2=0x7f1e58071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.324+0000 7f1e5cce0700 1 --2- 172.21.15.80:0/795268860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e58073020 0x7f1e58071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.324+0000 7f1e5cce0700 1 -- 172.21.15.80:0/795268860 >> v1:172.21.15.174:6789/0 conn(0x7f1e580734b0 legacy=0x7f1e580723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.324+0000 7f1e5cce0700 1 -- 172.21.15.80:0/795268860 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e58070760 con 0x7f1e5815ed10 2019-11-28T11:26:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.324+0000 7f1e5cce0700 1 --2- 172.21.15.80:0/795268860 >> v2:172.21.15.80:3300/0 conn(0x7f1e5815ed10 0x7f1e5815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1e4000f6c0 tx=0x7f1e4000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.324+0000 7f1e5cce0700 1 --2- 172.21.15.80:0/795268860 >> v2:172.21.15.80:3300/0 conn(0x7f1e5815ed10 0x7f1e5815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1e4000f6c0 tx=0x7f1e4000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.324+0000 7f1e5cce0700 1 --2- 172.21.15.80:0/795268860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e5815ed10 0x7f1e5815f100 secure :-1 s=READY pgs=399 cs=0 l=1 rx=0x7f1e4000f6c0 tx=0x7f1e4000fa60).ready entity=mon.0 client_cookie=4a30fd2003b1ddf3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:17.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.325+0000 7f1e5cce0700 1 --2- 172.21.15.80:0/795268860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e5815ed10 0x7f1e5815f100 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7f1e4000f6c0 tx=0x7f1e4000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.325+0000 7f1e5cce0700 1 --2- 172.21.15.80:0/795268860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e5815ed10 0x7f1e5815f100 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7f1e4000f6c0 tx=0x7f1e4000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.325+0000 7f1e577fe700 1 -- 172.21.15.80:0/795268860 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e40000960 con 0x7f1e5815ed10 2019-11-28T11:26:17.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.325+0000 7f1e5cce0700 1 --2- 172.21.15.80:0/795268860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e5815ed10 0x7f1e5815f100 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7f1e4000f6c0 tx=0x7f1e4000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.325+0000 7f1e577fe700 1 -- 172.21.15.80:0/795268860 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e40000c90 con 0x7f1e5815ed10 2019-11-28T11:26:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.325+0000 7f1e577fe700 1 -- 172.21.15.80:0/795268860 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e400013a0 con 0x7f1e5815ed10 2019-11-28T11:26:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.325+0000 7f1e5e743700 1 -- 172.21.15.80:0/795268860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e5815ed10 msgr2=0x7f1e5815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.325+0000 7f1e5e743700 1 --2- 172.21.15.80:0/795268860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e5815ed10 0x7f1e5815f100 secure :-1 s=READY pgs=399 cs=0 l=1 rx=0x7f1e4000f6c0 tx=0x7f1e4000fa60).stop 2019-11-28T11:26:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.325+0000 7f1e5e743700 1 -- 172.21.15.80:0/795268860 shutdown_connections 2019-11-28T11:26:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.325+0000 7f1e5e743700 1 --2- 172.21.15.80:0/795268860 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e58073020 0x7f1e58071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:17.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.325+0000 7f1e5e743700 1 --2- 172.21.15.80:0/795268860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e5815ed10 0x7f1e5815f100 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.325+0000 7f1e5e743700 1 -- 172.21.15.80:0/795268860 shutdown_connections 2019-11-28T11:26:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.325+0000 7f1e5e743700 1 -- 172.21.15.80:0/795268860 wait complete. 2019-11-28T11:26:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.325+0000 7f1e5e743700 1 -- 172.21.15.80:0/795268860 >> 172.21.15.80:0/795268860 conn(0x7f1e58061d20 msgr2=0x7f1e580641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.328+0000 7f1e5e743700 1 Processor -- start 2019-11-28T11:26:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.328+0000 7f1e5e743700 1 -- start start 2019-11-28T11:26:17.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5e743700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e5810e970 0x7f1e581087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5e743700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e58107e30 0x7f1e58167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5e743700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5810c250 con 0x7f1e58108cf0 2019-11-28T11:26:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5e743700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e5810da00 con 0x7f1e58107e30 2019-11-28T11:26:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5e743700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5810e430 con 0x7f1e5810e970 2019-11-28T11:26:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5d4e1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e58107e30 0x7f1e58167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5d4e1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e58107e30 0x7f1e58167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60978/0 (socket says 172.21.15.80:60978) 2019-11-28T11:26:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5d4e1700 1 -- 172.21.15.80:0/3561268438 learned_addr learned my addr 172.21.15.80:0/3561268438 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5cce0700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e5810e970 0x7f1e581087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e557fa700 1 -- 172.21.15.80:0/3561268438 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399656289 0 0) 0x7f1e480012b0 con 0x7f1e58108cf0 2019-11-28T11:26:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5d4e1700 1 -- 172.21.15.80:0/3561268438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e5810e970 msgr2=0x7f1e581087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5d4e1700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e5810e970 0x7f1e581087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5d4e1700 1 -- 172.21.15.80:0/3561268438 >> v1:172.21.15.174:6789/0 conn(0x7f1e58108cf0 legacy=0x7f1e58107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5d4e1700 1 -- 172.21.15.80:0/3561268438 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e58105ef0 con 0x7f1e58107e30 2019-11-28T11:26:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5d4e1700 1 --2- 172.21.15.80:0/3561268438 >> v2:172.21.15.80:3300/0 conn(0x7f1e58107e30 0x7f1e58167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1e50010420 tx=0x7f1e50010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5d4e1700 1 --2- 172.21.15.80:0/3561268438 >> v2:172.21.15.80:3300/0 conn(0x7f1e58107e30 0x7f1e58167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1e50010420 tx=0x7f1e50010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5d4e1700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e58107e30 0x7f1e58167d70 secure :-1 s=READY pgs=400 cs=0 l=1 rx=0x7f1e50010420 tx=0x7f1e50010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5d4e1700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e58107e30 0x7f1e58167d70 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7f1e50010420 tx=0x7f1e50010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e557fa700 1 -- 172.21.15.80:0/3561268438 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e50000960 con 0x7f1e58107e30 2019-11-28T11:26:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5d4e1700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e58107e30 0x7f1e58167d70 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7f1e50010420 tx=0x7f1e50010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5d4e1700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e58107e30 0x7f1e58167d70 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7f1e50010420 tx=0x7f1e50010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e557fa700 1 -- 172.21.15.80:0/3561268438 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e50001090 con 0x7f1e58107e30 2019-11-28T11:26:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e557fa700 1 -- 172.21.15.80:0/3561268438 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e50001760 con 0x7f1e58107e30 2019-11-28T11:26:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.329+0000 7f1e5e743700 1 -- 172.21.15.80:0/3561268438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e58106270 con 0x7f1e58107e30 2019-11-28T11:26:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.330+0000 7f1e5e743700 1 -- 172.21.15.80:0/3561268438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e58105ef0 con 0x7f1e58107e30 2019-11-28T11:26:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.330+0000 7f1e5d4e1700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e58107e30 0x7f1e58167d70 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7f1e50010420 tx=0x7f1e50010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.330+0000 7f1e557fa700 1 -- 172.21.15.80:0/3561268438 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1e50000960 con 0x7f1e58107e30 2019-11-28T11:26:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.330+0000 7f1e5d4e1700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e58107e30 0x7f1e58167d70 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7f1e50010420 tx=0x7f1e50010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.330+0000 7f1e557fa700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e3c018730 0x7f1e3c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.330+0000 7f1e557fa700 1 -- 172.21.15.80:0/3561268438 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1e50031ad0 con 0x7f1e58107e30 2019-11-28T11:26:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.330+0000 7f1e5cce0700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e3c018730 0x7f1e3c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.331+0000 7f1e5cce0700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e3c018730 0x7f1e3c01abc0 crc :-1 s=READY pgs=175 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.338+0000 7f1e5e743700 1 -- 172.21.15.80:0/3561268438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e58106270 con 0x7f1e58107e30 2019-11-28T11:26:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.342+0000 7f1e5d4e1700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e58107e30 0x7f1e58167d70 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7f1e50010420 tx=0x7f1e50010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.342+0000 7f1e557fa700 1 -- 172.21.15.80:0/3561268438 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1e50007590 con 0x7f1e58107e30 2019-11-28T11:26:17.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.507+0000 7f1e5e743700 1 -- 172.21.15.80:0/3561268438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f1e58105ef0 con 0x7f1e58107e30 2019-11-28T11:26:17.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.508+0000 7f1e5d4e1700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e58107e30 0x7f1e58167d70 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7f1e50010420 tx=0x7f1e50010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.508+0000 7f1e557fa700 1 -- 172.21.15.80:0/3561268438 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v36) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1e50000940 con 0x7f1e58107e30 2019-11-28T11:26:17.530 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:26:17.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.510+0000 7f1e5e743700 1 -- 172.21.15.80:0/3561268438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e3c018730 msgr2=0x7f1e3c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:17.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.510+0000 7f1e5e743700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e3c018730 0x7f1e3c01abc0 crc :-1 s=READY pgs=175 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:17.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.510+0000 7f1e5e743700 1 -- 172.21.15.80:0/3561268438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e58107e30 msgr2=0x7f1e58167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:17.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.510+0000 7f1e5e743700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e58107e30 0x7f1e58167d70 secure :-1 s=READY pgs=400 cs=0 l=1 rx=0x7f1e50010420 tx=0x7f1e50010280).stop 2019-11-28T11:26:17.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.510+0000 7f1e5e743700 1 -- 172.21.15.80:0/3561268438 shutdown_connections 2019-11-28T11:26:17.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.510+0000 7f1e5e743700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e58107e30 0x7f1e58167d70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:17.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.510+0000 7f1e5e743700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e3c018730 0x7f1e3c01abc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:17.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.510+0000 7f1e5e743700 1 --2- 172.21.15.80:0/3561268438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e5810e970 0x7f1e581087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:17.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.510+0000 7f1e5e743700 1 -- 172.21.15.80:0/3561268438 shutdown_connections 2019-11-28T11:26:17.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.510+0000 7f1e5e743700 1 -- 172.21.15.80:0/3561268438 wait complete. 2019-11-28T11:26:17.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.510+0000 7f1e5e743700 1 -- 172.21.15.80:0/3561268438 >> 172.21.15.80:0/3561268438 conn(0x7f1e5815e2d0 msgr2=0x7f1e58147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:17.542 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:26:17.542 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:26:17.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.650+0000 7fa7b8f5f700 1 Processor -- start 2019-11-28T11:26:17.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.650+0000 7fa7b8f5f700 1 -- start start 2019-11-28T11:26:17.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.651+0000 7fa7b8f5f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa7b406c0a0 0x7fa7b4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:17.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.651+0000 7fa7b8f5f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa7b4072620 0x7fa7b4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:17.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.651+0000 7fa7b8f5f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b406db00 con 0x7fa7b40734e0 2019-11-28T11:26:17.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.651+0000 7fa7b8f5f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b406fd60 con 0x7fa7b406c0a0 2019-11-28T11:26:17.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.651+0000 7fa7b8f5f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b4070030 con 0x7fa7b4072620 2019-11-28T11:26:17.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.651+0000 7fa7b2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa7b406c0a0 0x7fa7b4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:17.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa7b40734e0 0x7fa7b4071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60302/0 (socket says 172.21.15.80:60302) 2019-11-28T11:26:17.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa7b406c0a0 0x7fa7b4072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60982/0 (socket says 172.21.15.80:60982) 2019-11-28T11:26:17.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b259c700 1 -- 172.21.15.80:0/2452563606 learned_addr learned my addr 172.21.15.80:0/2452563606 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:17.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b359e700 1 --2- 172.21.15.80:0/2452563606 >> v2:172.21.15.174:3300/0 conn(0x7fa7b4072620 0x7fa7b4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:17.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b2d9d700 1 -- 172.21.15.80:0/2452563606 >> v2:172.21.15.174:3300/0 conn(0x7fa7b4072620 msgr2=0x7fa7b4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:17.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b2d9d700 1 --2- 172.21.15.80:0/2452563606 >> v2:172.21.15.174:3300/0 conn(0x7fa7b4072620 0x7fa7b4164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:17.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b2d9d700 1 -- 172.21.15.80:0/2452563606 >> v1:172.21.15.80:6789/0 conn(0x7fa7b40734e0 legacy=0x7fa7b4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:17.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b1d9b700 1 -- 172.21.15.80:0/2452563606 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116759050 0 0) 0x7fa7a4001070 con 0x7fa7b40734e0 2019-11-28T11:26:17.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b2d9d700 1 -- 172.21.15.80:0/2452563606 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b40706c0 con 0x7fa7b406c0a0 2019-11-28T11:26:17.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b2d9d700 1 --2- 172.21.15.80:0/2452563606 >> v2:172.21.15.80:3300/0 conn(0x7fa7b406c0a0 0x7fa7b4072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa79c00b2d0 tx=0x7fa79c00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b2d9d700 1 --2- 172.21.15.80:0/2452563606 >> v2:172.21.15.80:3300/0 conn(0x7fa7b406c0a0 0x7fa7b4072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa79c00b2d0 tx=0x7fa79c00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b2d9d700 1 --2- 172.21.15.80:0/2452563606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b406c0a0 0x7fa7b4072fa0 secure :-1 s=READY pgs=402 cs=0 l=1 rx=0x7fa79c00b2d0 tx=0x7fa79c00ba60).ready entity=mon.0 client_cookie=d514da0f43a0620a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:17.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b2d9d700 1 --2- 172.21.15.80:0/2452563606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b406c0a0 0x7fa7b4072fa0 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7fa79c00b2d0 tx=0x7fa79c00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b1d9b700 1 -- 172.21.15.80:0/2452563606 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79c007590 con 0x7fa7b406c0a0 2019-11-28T11:26:17.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b2d9d700 1 --2- 172.21.15.80:0/2452563606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b406c0a0 0x7fa7b4072fa0 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7fa79c00b2d0 tx=0x7fa79c00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b2d9d700 1 --2- 172.21.15.80:0/2452563606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b406c0a0 0x7fa7b4072fa0 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7fa79c00b2d0 tx=0x7fa79c00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b1d9b700 1 -- 172.21.15.80:0/2452563606 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c009d30 con 0x7fa7b406c0a0 2019-11-28T11:26:17.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b1d9b700 1 -- 172.21.15.80:0/2452563606 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79c00a400 con 0x7fa7b406c0a0 2019-11-28T11:26:17.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b8f5f700 1 -- 172.21.15.80:0/2452563606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b406c0a0 msgr2=0x7fa7b4072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:17.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.652+0000 7fa7b8f5f700 1 --2- 172.21.15.80:0/2452563606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b406c0a0 0x7fa7b4072fa0 secure :-1 s=READY pgs=402 cs=0 l=1 rx=0x7fa79c00b2d0 tx=0x7fa79c00ba60).stop 2019-11-28T11:26:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.653+0000 7fa7b8f5f700 1 -- 172.21.15.80:0/2452563606 shutdown_connections 2019-11-28T11:26:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.653+0000 7fa7b8f5f700 1 --2- 172.21.15.80:0/2452563606 >> v2:172.21.15.174:3300/0 conn(0x7fa7b4072620 0x7fa7b4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.653+0000 7fa7b8f5f700 1 --2- 172.21.15.80:0/2452563606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b406c0a0 0x7fa7b4072fa0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.653+0000 7fa7b8f5f700 1 -- 172.21.15.80:0/2452563606 shutdown_connections 2019-11-28T11:26:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.653+0000 7fa7b8f5f700 1 -- 172.21.15.80:0/2452563606 wait complete. 2019-11-28T11:26:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.653+0000 7fa7b8f5f700 1 -- 172.21.15.80:0/2452563606 >> 172.21.15.80:0/2452563606 conn(0x7fa7b4061cf0 msgr2=0x7fa7b4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.655+0000 7fa7b8f5f700 1 Processor -- start 2019-11-28T11:26:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.656+0000 7fa7b8f5f700 1 -- start start 2019-11-28T11:26:17.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.656+0000 7fa7b8f5f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b413e9e0 0x7fa7b4108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.656+0000 7fa7b8f5f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa7b4109430 0x7fa7b41098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.656+0000 7fa7b8f5f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b41066e0 con 0x7fa7b413e5f0 2019-11-28T11:26:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.656+0000 7fa7b8f5f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b410e060 con 0x7fa7b4109430 2019-11-28T11:26:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.656+0000 7fa7b8f5f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b410e330 con 0x7fa7b413e9e0 2019-11-28T11:26:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b259c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b413e9e0 0x7fa7b4108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b359e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa7b4109430 0x7fa7b41098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b2d9d700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa7b413e5f0 0x7fa7b410a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:47616/0 (socket says 172.21.15.80:47616) 2019-11-28T11:26:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b359e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa7b4109430 0x7fa7b41098a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:47644/0 (socket says 172.21.15.80:47644) 2019-11-28T11:26:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b2d9d700 1 -- 172.21.15.80:0/2489769584 learned_addr learned my addr 172.21.15.80:0/2489769584 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b259c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b413e9e0 0x7fa7b4108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:35020/0 (socket says 172.21.15.80:35020) 2019-11-28T11:26:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b259c700 1 -- 172.21.15.80:0/2489769584 >> v2:172.21.15.174:3300/0 conn(0x7fa7b4109430 msgr2=0x7fa7b41098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:17.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b259c700 1 --2- 172.21.15.80:0/2489769584 >> v2:172.21.15.174:3300/0 conn(0x7fa7b4109430 0x7fa7b41098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:17.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b259c700 1 -- 172.21.15.80:0/2489769584 >> v1:172.21.15.174:6789/0 conn(0x7fa7b413e5f0 legacy=0x7fa7b410a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:17.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7ab7fe700 1 -- 172.21.15.80:0/2489769584 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263233392 0 0) 0x7fa79c00b3c0 con 0x7fa7b413e5f0 2019-11-28T11:26:17.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b259c700 1 -- 172.21.15.80:0/2489769584 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b410e9c0 con 0x7fa7b413e9e0 2019-11-28T11:26:17.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b359e700 1 --2- 172.21.15.80:0/2489769584 >> v2:172.21.15.174:3300/0 conn(0x7fa7b4109430 0x7fa7b41098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:17.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b259c700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b413e9e0 0x7fa7b4108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7a4010330 tx=0x7fa7a40106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b259c700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b413e9e0 0x7fa7b4108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7a4010330 tx=0x7fa7a40106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b259c700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b413e9e0 0x7fa7b4108ef0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7fa7a4010330 tx=0x7fa7a40106d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b259c700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b413e9e0 0x7fa7b4108ef0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fa7a4010330 tx=0x7fa7a40106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7ab7fe700 1 -- 172.21.15.80:0/2489769584 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7a4000d50 con 0x7fa7b413e9e0 2019-11-28T11:26:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b259c700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b413e9e0 0x7fa7b4108ef0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fa7a4010330 tx=0x7fa7a40106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b8f5f700 1 -- 172.21.15.80:0/2489769584 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b410ed40 con 0x7fa7b413e9e0 2019-11-28T11:26:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7ab7fe700 1 -- 172.21.15.80:0/2489769584 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a4000940 con 0x7fa7b413e9e0 2019-11-28T11:26:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b259c700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b413e9e0 0x7fa7b4108ef0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fa7a4010330 tx=0x7fa7a40106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7ab7fe700 1 -- 172.21.15.80:0/2489769584 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7a4000df0 con 0x7fa7b413e9e0 2019-11-28T11:26:17.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.657+0000 7fa7b8f5f700 1 -- 172.21.15.80:0/2489769584 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b410e9c0 con 0x7fa7b413e9e0 2019-11-28T11:26:17.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.658+0000 7fa7b259c700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b413e9e0 0x7fa7b4108ef0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fa7a4010330 tx=0x7fa7a40106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.658+0000 7fa7b259c700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b413e9e0 0x7fa7b4108ef0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fa7a4010330 tx=0x7fa7a40106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.658+0000 7fa7ab7fe700 1 -- 172.21.15.80:0/2489769584 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa7a4000d50 con 0x7fa7b413e9e0 2019-11-28T11:26:17.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.658+0000 7fa7ab7fe700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa78c018730 0x7fa78c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.658+0000 7fa7ab7fe700 1 -- 172.21.15.80:0/2489769584 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa7a40319b0 con 0x7fa7b413e9e0 2019-11-28T11:26:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.658+0000 7fa7b2d9d700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa78c018730 0x7fa78c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.658+0000 7fa7b2d9d700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa78c018730 0x7fa78c01abc0 crc :-1 s=READY pgs=176 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.666+0000 7fa7b8f5f700 1 -- 172.21.15.80:0/2489769584 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b410ed40 con 0x7fa7b413e9e0 2019-11-28T11:26:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.669+0000 7fa7b259c700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b413e9e0 0x7fa7b4108ef0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fa7a4010330 tx=0x7fa7a40106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.669+0000 7fa7ab7fe700 1 -- 172.21.15.80:0/2489769584 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa7a402df40 con 0x7fa7b413e9e0 2019-11-28T11:26:17.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.842+0000 7fa7b8f5f700 1 -- 172.21.15.80:0/2489769584 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7b410e9c0 con 0x7fa7b413e9e0 2019-11-28T11:26:17.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.843+0000 7fa7b259c700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b413e9e0 0x7fa7b4108ef0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fa7a4010330 tx=0x7fa7a40106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:17.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.843+0000 7fa7ab7fe700 1 -- 172.21.15.80:0/2489769584 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2446 (secure 0 0 0) 0x7fa7a402db50 con 0x7fa7b413e9e0 2019-11-28T11:26:17.865 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2019-11-28T11:26:17.865 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:17.866 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:12.065616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:26:17.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.845+0000 7fa7b8f5f700 1 -- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa78c018730 msgr2=0x7fa78c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:17.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.845+0000 7fa7b8f5f700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa78c018730 0x7fa78c01abc0 crc :-1 s=READY pgs=176 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:17.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.845+0000 7fa7b8f5f700 1 -- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b413e9e0 msgr2=0x7fa7b4108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:17.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.845+0000 7fa7b8f5f700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b413e9e0 0x7fa7b4108ef0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7fa7a4010330 tx=0x7fa7a40106d0).stop 2019-11-28T11:26:17.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.845+0000 7fa7b8f5f700 1 -- 172.21.15.80:0/2489769584 shutdown_connections 2019-11-28T11:26:17.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.845+0000 7fa7b8f5f700 1 --2- 172.21.15.80:0/2489769584 >> v2:172.21.15.174:3300/0 conn(0x7fa7b4109430 0x7fa7b41098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:17.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.845+0000 7fa7b8f5f700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b413e9e0 0x7fa7b4108ef0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:17.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.845+0000 7fa7b8f5f700 1 --2- 172.21.15.80:0/2489769584 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa78c018730 0x7fa78c01abc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:17.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.845+0000 7fa7b8f5f700 1 -- 172.21.15.80:0/2489769584 shutdown_connections 2019-11-28T11:26:17.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.845+0000 7fa7b8f5f700 1 -- 172.21.15.80:0/2489769584 wait complete. 2019-11-28T11:26:17.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:17.845+0000 7fa7b8f5f700 1 -- 172.21.15.80:0/2489769584 >> 172.21.15.80:0/2489769584 conn(0x7fa7b413d620 msgr2=0x7fa7b413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:17.886 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:26:17.890 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:26:17.895 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:26:17.899 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:26:17.903 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:26:17.909 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:26:18.183 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5008}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 4, u'failed': [], u'epoch': 14, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [5], u'info': {u'gid_5008': {u'export_targets': [], u'name': u'c', u'incarnation': 13, u'state_seq': 3, u'state': u'up:active', u'gid': 5008, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2897820490, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2897820490, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2897820490'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:26:04.004932+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:26:12.065616+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:26:18.183 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:26:18.184 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:26:18.309 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:26:18.309 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:26:18.310 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:26:18.310 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5008, 2019-11-28T11:26:18.310 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:26:18.310 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:26:18.311 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 7.2221128170000002, 2019-11-28T11:26:18.311 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 14, 2019-11-28T11:26:18.311 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 36, 2019-11-28T11:26:18.311 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 36, 2019-11-28T11:26:18.312 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 11.490751194 2019-11-28T11:26:18.312 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:26:18.315 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5008, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.2221128170000002, "mdsmap_epoch": 14, "osdmap_epoch": 36, "osdmap_epoch_barrier": 36, "uptime": 11.490751194 } 2019-11-28T11:26:18.315 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:26:18.316 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:26:18.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:26:18.316 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:26:18.387 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:26:18.387 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:26:18.515 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:26:18.515 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:26:18.516 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:26:18.516 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:26:18.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:26:18.516 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:26:18.598 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:26:18.721 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:26:18.722 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:26:18.722 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:26:18.726 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:26:18.726 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:26:18.848 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:26:18.849 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:26:18.849 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:26:18.854 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:26:18.855 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:26:18.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.953+0000 7f20b4fa6700 1 Processor -- start 2019-11-28T11:26:18.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.953+0000 7f20b4fa6700 1 -- start start 2019-11-28T11:26:18.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.954+0000 7f20b4fa6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20b006c490 0x7f20b006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:18.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.954+0000 7f20b4fa6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b006db00 con 0x7f20b006ce60 2019-11-28T11:26:18.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.954+0000 7f20b4fa6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b006e000 con 0x7f20b006c0a0 2019-11-28T11:26:18.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.954+0000 7f20b4fa6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b006fd60 con 0x7f20b006c490 2019-11-28T11:26:18.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.954+0000 7f20ae59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20b006c490 0x7f20b006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:18.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.954+0000 7f20ae59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20b006c490 0x7f20b006c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60996/0 (socket says 172.21.15.80:60996) 2019-11-28T11:26:18.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.954+0000 7f20af59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f20b006ce60 0x7f20b0164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60312/0 (socket says 172.21.15.80:60312) 2019-11-28T11:26:18.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.954+0000 7f20ae59c700 1 -- 172.21.15.80:0/247853941 learned_addr learned my addr 172.21.15.80:0/247853941 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:18.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.954+0000 7f20ae59c700 1 -- 172.21.15.80:0/247853941 >> v1:172.21.15.174:6789/0 conn(0x7f20b006c0a0 legacy=0x7f20b0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:18.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.954+0000 7f20ae59c700 1 -- 172.21.15.80:0/247853941 >> v1:172.21.15.80:6789/0 conn(0x7f20b006ce60 legacy=0x7f20b0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:18.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.954+0000 7f20ae59c700 1 -- 172.21.15.80:0/247853941 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b00706c0 con 0x7f20b006c490 2019-11-28T11:26:18.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.954+0000 7f20add9b700 1 -- 172.21.15.80:0/247853941 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937321238 0 0) 0x7f20a80009b0 con 0x7f20b006ce60 2019-11-28T11:26:18.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.954+0000 7f20ae59c700 1 --2- 172.21.15.80:0/247853941 >> v2:172.21.15.80:3300/0 conn(0x7f20b006c490 0x7f20b006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f20a000fac0 tx=0x7f20a000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:18.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.954+0000 7f20ae59c700 1 --2- 172.21.15.80:0/247853941 >> v2:172.21.15.80:3300/0 conn(0x7f20b006c490 0x7f20b006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f20a000fac0 tx=0x7f20a000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:18.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.954+0000 7f20ae59c700 1 --2- 172.21.15.80:0/247853941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b006c490 0x7f20b006c920 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7f20a000fac0 tx=0x7f20a000fe60).ready entity=mon.0 client_cookie=bbb96bbfa5bf3340 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:18.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.954+0000 7f20ae59c700 1 --2- 172.21.15.80:0/247853941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b006c490 0x7f20b006c920 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f20a000fac0 tx=0x7f20a000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:18.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.955+0000 7f20add9b700 1 -- 172.21.15.80:0/247853941 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a0000ce0 con 0x7f20b006c490 2019-11-28T11:26:18.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.955+0000 7f20ae59c700 1 --2- 172.21.15.80:0/247853941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b006c490 0x7f20b006c920 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f20a000fac0 tx=0x7f20a000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:18.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.955+0000 7f20add9b700 1 -- 172.21.15.80:0/247853941 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a0007590 con 0x7f20b006c490 2019-11-28T11:26:18.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.955+0000 7f20ae59c700 1 --2- 172.21.15.80:0/247853941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b006c490 0x7f20b006c920 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f20a000fac0 tx=0x7f20a000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:18.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.955+0000 7f20add9b700 1 -- 172.21.15.80:0/247853941 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a0000ce0 con 0x7f20b006c490 2019-11-28T11:26:18.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.955+0000 7f20b4fa6700 1 -- 172.21.15.80:0/247853941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b006c490 msgr2=0x7f20b006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:18.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.955+0000 7f20b4fa6700 1 --2- 172.21.15.80:0/247853941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b006c490 0x7f20b006c920 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7f20a000fac0 tx=0x7f20a000fe60).stop 2019-11-28T11:26:18.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.955+0000 7f20b4fa6700 1 -- 172.21.15.80:0/247853941 shutdown_connections 2019-11-28T11:26:18.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.955+0000 7f20b4fa6700 1 --2- 172.21.15.80:0/247853941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20b006c490 0x7f20b006c920 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:18.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.955+0000 7f20b4fa6700 1 -- 172.21.15.80:0/247853941 shutdown_connections 2019-11-28T11:26:18.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.955+0000 7f20b4fa6700 1 -- 172.21.15.80:0/247853941 wait complete. 2019-11-28T11:26:18.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.955+0000 7f20b4fa6700 1 -- 172.21.15.80:0/247853941 >> 172.21.15.80:0/247853941 conn(0x7f20b0061cf0 msgr2=0x7f20b0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:19.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.958+0000 7f20b4fa6700 1 Processor -- start 2019-11-28T11:26:19.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.958+0000 7f20b4fa6700 1 -- start start 2019-11-28T11:26:19.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f20b4fa6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20b0166a10 0x7f20b0168e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:19.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f20b4fa6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b0124260 con 0x7f20b0111db0 2019-11-28T11:26:19.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f20b4fa6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b012e5d0 con 0x7f20b012cea0 2019-11-28T11:26:19.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f20b4fa6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0121040 con 0x7f20b0166a10 2019-11-28T11:26:19.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f20ae59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f20b0111db0 0x7f20b01238e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60318/0 (socket says 172.21.15.80:60318) 2019-11-28T11:26:19.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f20ae59c700 1 -- 172.21.15.80:0/3034355361 learned_addr learned my addr 172.21.15.80:0/3034355361 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:19.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034770299 0 0) 0x7f20a0007cb0 con 0x7f20b0111db0 2019-11-28T11:26:19.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2094002e80 con 0x7f20b0111db0 2019-11-28T11:26:19.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f20af59e700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20b0166a10 0x7f20b0168e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:19.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1361158903 0 0) 0x7f20a0008530 con 0x7f20b0111db0 2019-11-28T11:26:19.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f20940032e0 con 0x7f20b0111db0 2019-11-28T11:26:19.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f20a0000cc0 con 0x7f20b0111db0 2019-11-28T11:26:19.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20b0166a10 msgr2=0x7f20b0168e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:19.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f209f7fe700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20b0166a10 0x7f20b0168e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:19.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 >> v1:172.21.15.174:6789/0 conn(0x7f20b012cea0 legacy=0x7f20b01230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:19.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 >> v1:172.21.15.80:6789/0 conn(0x7f20b0111db0 legacy=0x7f20b01238e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:19.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f209f7fe700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20940033b0 0x7f2094003800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:19.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f209f7fe700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2094003d40 0x7f2094004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:19.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f209f7fe700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2094004960 0x7f2094004e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:19.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209400bc50 con 0x7f2094003d40 2019-11-28T11:26:19.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209400be80 con 0x7f2094004960 2019-11-28T11:26:19.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209400c0b0 con 0x7f20940033b0 2019-11-28T11:26:19.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f20af59e700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20b0166a10 0x7f20b0168e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:26:19.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f20ae59c700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2094003d40 0x7f2094004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:19.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f20aed9d700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20940033b0 0x7f2094003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:19.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.959+0000 7f20af59e700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2094004960 0x7f2094004e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:19.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f20ae59c700 1 -- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20940033b0 msgr2=0x7f2094003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:19.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f20ae59c700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20940033b0 0x7f2094003800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:19.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f20ae59c700 1 -- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2094004960 msgr2=0x7f2094004e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:19.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f20ae59c700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2094004960 0x7f2094004e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:19.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f20ae59c700 1 -- 172.21.15.80:0/3034355361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209400c360 con 0x7f2094003d40 2019-11-28T11:26:19.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f20af59e700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2094004960 0x7f2094004e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:26:19.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f20b4fa6700 1 -- 172.21.15.80:0/3034355361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b0121d20 con 0x7f2094003d40 2019-11-28T11:26:19.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f20ae59c700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2094003d40 0x7f2094004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20a000c760 tx=0x7f20a0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f20b4fa6700 1 -- 172.21.15.80:0/3034355361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b01219a0 con 0x7f2094003d40 2019-11-28T11:26:19.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f20ae59c700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2094003d40 0x7f2094004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20a000c760 tx=0x7f20a0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f20ae59c700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2094003d40 0x7f2094004200 secure :-1 s=READY pgs=406 cs=0 l=1 rx=0x7f20a000c760 tx=0x7f20a0010ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:19.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f20ae59c700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2094003d40 0x7f2094004200 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f20a000c760 tx=0x7f20a0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a0008120 con 0x7f2094003d40 2019-11-28T11:26:19.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f20ae59c700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2094003d40 0x7f2094004200 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f20a000c760 tx=0x7f20a0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f20ae59c700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2094003d40 0x7f2094004200 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f20a000c760 tx=0x7f20a0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a0000cc0 con 0x7f2094003d40 2019-11-28T11:26:19.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a0001350 con 0x7f2094003d40 2019-11-28T11:26:19.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f20ae59c700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2094003d40 0x7f2094004200 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f20a000c760 tx=0x7f20a0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f20a0000eb0 con 0x7f2094003d40 2019-11-28T11:26:19.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f20ae59c700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2094003d40 0x7f2094004200 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f20a000c760 tx=0x7f20a0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.960+0000 7f209f7fe700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2094020bc0 0x7f2094022ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:19.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.961+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f20a00320a0 con 0x7f2094003d40 2019-11-28T11:26:19.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.961+0000 7f20aed9d700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2094020bc0 0x7f2094022ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:19.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.961+0000 7f20aed9d700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2094020bc0 0x7f2094022ff0 crc :-1 s=READY pgs=177 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:19.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.968+0000 7f20b4fa6700 1 -- 172.21.15.80:0/3034355361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b0121d20 con 0x7f2094003d40 2019-11-28T11:26:19.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.971+0000 7f20ae59c700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2094003d40 0x7f2094004200 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f20a000c760 tx=0x7f20a0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:18.971+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f20a0007950 con 0x7f2094003d40 2019-11-28T11:26:19.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.145+0000 7f20b4fa6700 1 -- 172.21.15.80:0/3034355361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20b01219a0 con 0x7f2094003d40 2019-11-28T11:26:19.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.145+0000 7f20ae59c700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2094003d40 0x7f2094004200 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f20a000c760 tx=0x7f20a0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.146+0000 7f209f7fe700 1 -- 172.21.15.80:0/3034355361 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2446 (secure 0 0 0) 0x7f20a0000cc0 con 0x7f2094003d40 2019-11-28T11:26:19.168 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2019-11-28T11:26:19.168 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:19.168 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:12.065616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:26:19.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.148+0000 7f20b4fa6700 1 -- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2094020bc0 msgr2=0x7f2094022ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:19.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.148+0000 7f20b4fa6700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2094020bc0 0x7f2094022ff0 crc :-1 s=READY pgs=177 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:19.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.148+0000 7f20b4fa6700 1 -- 172.21.15.80:0/3034355361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2094003d40 msgr2=0x7f2094004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:19.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.148+0000 7f20b4fa6700 1 --2- 172.21.15.80:0/3034355361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2094003d40 0x7f2094004200 secure :-1 s=READY pgs=406 cs=0 l=1 rx=0x7f20a000c760 tx=0x7f20a0010ba0).stop 2019-11-28T11:26:19.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.148+0000 7f20af59e700 1 -- 172.21.15.80:0/3034355361 reap_dead start 2019-11-28T11:26:19.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.148+0000 7f20b4fa6700 1 -- 172.21.15.80:0/3034355361 shutdown_connections 2019-11-28T11:26:19.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.148+0000 7f20b4fa6700 1 -- 172.21.15.80:0/3034355361 shutdown_connections 2019-11-28T11:26:19.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.148+0000 7f20b4fa6700 1 -- 172.21.15.80:0/3034355361 wait complete. 2019-11-28T11:26:19.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.148+0000 7f20b4fa6700 1 -- 172.21.15.80:0/3034355361 >> 172.21.15.80:0/3034355361 conn(0x7f20b01426c0 msgr2=0x7f20b0110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:19.180 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:26:19.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.279+0000 7fbd716fc700 1 Processor -- start 2019-11-28T11:26:19.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.279+0000 7fbd716fc700 1 -- start start 2019-11-28T11:26:19.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd716fc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbd6c06c490 0x7fbd6c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:19.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd716fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c06ce60 0x7fbd6c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:19.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd716fc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6c06db00 con 0x7fbd6c06c0a0 2019-11-28T11:26:19.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd716fc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6c06fd60 con 0x7fbd6c06c490 2019-11-28T11:26:19.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd716fc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c070030 con 0x7fbd6c06ce60 2019-11-28T11:26:19.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6b7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbd6c06c0a0 0x7fbd6c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60330/0 (socket says 172.21.15.80:60330) 2019-11-28T11:26:19.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6b7fe700 1 -- 172.21.15.80:0/4186435651 learned_addr learned my addr 172.21.15.80:0/4186435651 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:19.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6affd700 1 --2- 172.21.15.80:0/4186435651 >> v2:172.21.15.80:3300/0 conn(0x7fbd6c06c490 0x7fbd6c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:19.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6bfff700 1 --2- 172.21.15.80:0/4186435651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c06ce60 0x7fbd6c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:19.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6a7fc700 1 -- 172.21.15.80:0/4186435651 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239340794 0 0) 0x7fbd5c001150 con 0x7fbd6c06c0a0 2019-11-28T11:26:19.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6a7fc700 1 -- 172.21.15.80:0/4186435651 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd58002e80 con 0x7fbd6c06c0a0 2019-11-28T11:26:19.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6affd700 1 -- 172.21.15.80:0/4186435651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c06ce60 msgr2=0x7fbd6c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:19.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6affd700 1 --2- 172.21.15.80:0/4186435651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c06ce60 0x7fbd6c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:19.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6affd700 1 -- 172.21.15.80:0/4186435651 >> v1:172.21.15.80:6789/0 conn(0x7fbd6c06c0a0 legacy=0x7fbd6c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:19.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6affd700 1 -- 172.21.15.80:0/4186435651 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c0706c0 con 0x7fbd6c06c490 2019-11-28T11:26:19.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6affd700 1 --2- 172.21.15.80:0/4186435651 >> v2:172.21.15.80:3300/0 conn(0x7fbd6c06c490 0x7fbd6c06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbd5400af50 tx=0x7fbd5400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6affd700 1 --2- 172.21.15.80:0/4186435651 >> v2:172.21.15.80:3300/0 conn(0x7fbd6c06c490 0x7fbd6c06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbd5400af50 tx=0x7fbd5400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6affd700 1 --2- 172.21.15.80:0/4186435651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c06c490 0x7fbd6c06c920 secure :-1 s=READY pgs=408 cs=0 l=1 rx=0x7fbd5400af50 tx=0x7fbd5400b6e0).ready entity=mon.0 client_cookie=735a38868302e8f2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:19.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6affd700 1 --2- 172.21.15.80:0/4186435651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c06c490 0x7fbd6c06c920 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7fbd5400af50 tx=0x7fbd5400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6a7fc700 1 -- 172.21.15.80:0/4186435651 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd54007210 con 0x7fbd6c06c490 2019-11-28T11:26:19.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6affd700 1 --2- 172.21.15.80:0/4186435651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c06c490 0x7fbd6c06c920 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7fbd5400af50 tx=0x7fbd5400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6affd700 1 --2- 172.21.15.80:0/4186435651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c06c490 0x7fbd6c06c920 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7fbd5400af50 tx=0x7fbd5400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6a7fc700 1 -- 172.21.15.80:0/4186435651 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd540099b0 con 0x7fbd6c06c490 2019-11-28T11:26:19.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd6a7fc700 1 -- 172.21.15.80:0/4186435651 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd5400a080 con 0x7fbd6c06c490 2019-11-28T11:26:19.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd716fc700 1 -- 172.21.15.80:0/4186435651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c06c490 msgr2=0x7fbd6c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:19.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.280+0000 7fbd716fc700 1 --2- 172.21.15.80:0/4186435651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c06c490 0x7fbd6c06c920 secure :-1 s=READY pgs=408 cs=0 l=1 rx=0x7fbd5400af50 tx=0x7fbd5400b6e0).stop 2019-11-28T11:26:19.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.281+0000 7fbd716fc700 1 -- 172.21.15.80:0/4186435651 shutdown_connections 2019-11-28T11:26:19.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.281+0000 7fbd716fc700 1 --2- 172.21.15.80:0/4186435651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c06ce60 0x7fbd6c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:19.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.281+0000 7fbd716fc700 1 --2- 172.21.15.80:0/4186435651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c06c490 0x7fbd6c06c920 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:19.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.281+0000 7fbd716fc700 1 -- 172.21.15.80:0/4186435651 shutdown_connections 2019-11-28T11:26:19.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.281+0000 7fbd716fc700 1 -- 172.21.15.80:0/4186435651 wait complete. 2019-11-28T11:26:19.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.281+0000 7fbd716fc700 1 -- 172.21.15.80:0/4186435651 >> 172.21.15.80:0/4186435651 conn(0x7fbd6c061cf0 msgr2=0x7fbd6c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:19.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.283+0000 7fbd716fc700 1 Processor -- start 2019-11-28T11:26:19.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.284+0000 7fbd716fc700 1 -- start start 2019-11-28T11:26:19.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd716fc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbd6c1281b0 0x7fbd6c128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:19.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd716fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c128b80 0x7fbd6c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:19.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd716fc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6c139a60 con 0x7fbd6c13a780 2019-11-28T11:26:19.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd716fc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6c12a260 con 0x7fbd6c1281b0 2019-11-28T11:26:19.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd716fc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c12a530 con 0x7fbd6c128b80 2019-11-28T11:26:19.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd6affd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbd6c1281b0 0x7fbd6c128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:19.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd6affd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbd6c1281b0 0x7fbd6c128640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32790/0 (socket says 172.21.15.80:32790) 2019-11-28T11:26:19.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd6affd700 1 -- 172.21.15.80:0/3984365607 learned_addr learned my addr 172.21.15.80:0/3984365607 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:19.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd6bfff700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c128b80 0x7fbd6c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:19.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd6affd700 1 -- 172.21.15.80:0/3984365607 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c128b80 msgr2=0x7fbd6c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:19.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd6affd700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c128b80 0x7fbd6c167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:19.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd6affd700 1 -- 172.21.15.80:0/3984365607 >> v1:172.21.15.174:6789/0 conn(0x7fbd6c13a780 legacy=0x7fbd6c12d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:19.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd6affd700 1 -- 172.21.15.80:0/3984365607 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c12abc0 con 0x7fbd6c1281b0 2019-11-28T11:26:19.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd6affd700 1 --2- 172.21.15.80:0/3984365607 >> v2:172.21.15.80:3300/0 conn(0x7fbd6c1281b0 0x7fbd6c128640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd54054440 tx=0x7fbd540542c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd6affd700 1 --2- 172.21.15.80:0/3984365607 >> v2:172.21.15.80:3300/0 conn(0x7fbd6c1281b0 0x7fbd6c128640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd54054440 tx=0x7fbd540542c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd6affd700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c1281b0 0x7fbd6c128640 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7fbd54054440 tx=0x7fbd540542c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:19.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd6affd700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c1281b0 0x7fbd6c128640 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fbd54054440 tx=0x7fbd540542c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd6affd700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c1281b0 0x7fbd6c128640 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fbd54054440 tx=0x7fbd540542c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd6affd700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c1281b0 0x7fbd6c128640 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fbd54054440 tx=0x7fbd540542c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd63fff700 1 -- 172.21.15.80:0/3984365607 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd5400abb0 con 0x7fbd6c1281b0 2019-11-28T11:26:19.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd63fff700 1 -- 172.21.15.80:0/3984365607 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd54009770 con 0x7fbd6c1281b0 2019-11-28T11:26:19.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd716fc700 1 -- 172.21.15.80:0/3984365607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6c12af40 con 0x7fbd6c1281b0 2019-11-28T11:26:19.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd63fff700 1 -- 172.21.15.80:0/3984365607 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd54009e00 con 0x7fbd6c1281b0 2019-11-28T11:26:19.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.285+0000 7fbd716fc700 1 -- 172.21.15.80:0/3984365607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6c12abc0 con 0x7fbd6c1281b0 2019-11-28T11:26:19.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.286+0000 7fbd6affd700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c1281b0 0x7fbd6c128640 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fbd54054440 tx=0x7fbd540542c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.286+0000 7fbd63fff700 1 -- 172.21.15.80:0/3984365607 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbd5400af40 con 0x7fbd6c1281b0 2019-11-28T11:26:19.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.286+0000 7fbd6affd700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c1281b0 0x7fbd6c128640 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fbd54054440 tx=0x7fbd540542c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.286+0000 7fbd63fff700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbd50018730 0x7fbd5001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:19.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.286+0000 7fbd63fff700 1 -- 172.21.15.80:0/3984365607 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fbd54075b40 con 0x7fbd6c1281b0 2019-11-28T11:26:19.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.286+0000 7fbd6b7fe700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbd50018730 0x7fbd5001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:19.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.286+0000 7fbd6b7fe700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbd50018730 0x7fbd5001abc0 crc :-1 s=READY pgs=178 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:19.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.294+0000 7fbd716fc700 1 -- 172.21.15.80:0/3984365607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6c12af40 con 0x7fbd6c1281b0 2019-11-28T11:26:19.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.297+0000 7fbd6affd700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c1281b0 0x7fbd6c128640 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fbd54054440 tx=0x7fbd540542c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.297+0000 7fbd63fff700 1 -- 172.21.15.80:0/3984365607 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbd5400a2d0 con 0x7fbd6c1281b0 2019-11-28T11:26:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.469+0000 7fbd716fc700 1 -- 172.21.15.80:0/3984365607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd6c12abc0 con 0x7fbd6c1281b0 2019-11-28T11:26:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.469+0000 7fbd6affd700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c1281b0 0x7fbd6c128640 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fbd54054440 tx=0x7fbd540542c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.470+0000 7fbd63fff700 1 -- 172.21.15.80:0/3984365607 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2446 (secure 0 0 0) 0x7fbd5400a2d0 con 0x7fbd6c1281b0 2019-11-28T11:26:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2019-11-28T11:26:19.493 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:19.493 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:12.065616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:26:19.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.472+0000 7fbd716fc700 1 -- 172.21.15.80:0/3984365607 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbd50018730 msgr2=0x7fbd5001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:19.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.472+0000 7fbd716fc700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbd50018730 0x7fbd5001abc0 crc :-1 s=READY pgs=178 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.472+0000 7fbd716fc700 1 -- 172.21.15.80:0/3984365607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c1281b0 msgr2=0x7fbd6c128640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.472+0000 7fbd716fc700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c1281b0 0x7fbd6c128640 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7fbd54054440 tx=0x7fbd540542c0).stop 2019-11-28T11:26:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.472+0000 7fbd716fc700 1 -- 172.21.15.80:0/3984365607 shutdown_connections 2019-11-28T11:26:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.472+0000 7fbd716fc700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd6c128b80 0x7fbd6c167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:19.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.472+0000 7fbd716fc700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd6c1281b0 0x7fbd6c128640 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:19.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.472+0000 7fbd716fc700 1 --2- 172.21.15.80:0/3984365607 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbd50018730 0x7fbd5001abc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:19.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.472+0000 7fbd716fc700 1 -- 172.21.15.80:0/3984365607 shutdown_connections 2019-11-28T11:26:19.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.472+0000 7fbd716fc700 1 -- 172.21.15.80:0/3984365607 wait complete. 2019-11-28T11:26:19.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:19.472+0000 7fbd716fc700 1 -- 172.21.15.80:0/3984365607 >> 172.21.15.80:0/3984365607 conn(0x7fbd6c127dc0 msgr2=0x7fbd6c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:19.522 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config set mds_defer_session_stale false 2019-11-28T11:26:19.651 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:26:19.652 INFO:teuthology.orchestra.run.smithi174.stdout: "success": "mds_defer_session_stale = 'false' (not observed, change may require restart) " 2019-11-28T11:26:19.652 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:26:19.658 INFO:tasks.cephfs.filesystem:_json_asok output: { "success": "mds_defer_session_stale = 'false' (not observed, change may require restart) " } 2019-11-28T11:26:19.658 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:26:19.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:26:19.658 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:26:19.782 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:26:19.788 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:26:19.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:26:19.834 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:26:19.834 INFO:teuthology.orchestra.run.smithi076:> import glob 2019-11-28T11:26:19.834 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:26:19.834 INFO:teuthology.orchestra.run.smithi076:> import json 2019-11-28T11:26:19.834 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:26:19.834 INFO:teuthology.orchestra.run.smithi076:> def get_id_to_dir(): 2019-11-28T11:26:19.835 INFO:teuthology.orchestra.run.smithi076:> result = {} 2019-11-28T11:26:19.835 INFO:teuthology.orchestra.run.smithi076:> for dir in glob.glob("/sys/kernel/debug/ceph/*"): 2019-11-28T11:26:19.835 INFO:teuthology.orchestra.run.smithi076:> mds_sessions_lines = open(os.path.join(dir, "mds_sessions")).readlines() 2019-11-28T11:26:19.835 INFO:teuthology.orchestra.run.smithi076:> client_id = mds_sessions_lines[1].split()[1].strip('"'"'"'"'"') 2019-11-28T11:26:19.835 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:26:19.836 INFO:teuthology.orchestra.run.smithi076:> result[client_id] = dir 2019-11-28T11:26:19.836 INFO:teuthology.orchestra.run.smithi076:> return result 2019-11-28T11:26:19.836 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:26:19.836 INFO:teuthology.orchestra.run.smithi076:> print(json.dumps(get_id_to_dir())) 2019-11-28T11:26:19.836 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:26:19.913 INFO:teuthology.orchestra.run.smithi076.stdout:{"0": "/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client4676"} 2019-11-28T11:26:19.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:26:19.914 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:26:19.914 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:26:19.914 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:26:19.915 INFO:teuthology.orchestra.run.smithi076:> print(open(os.path.join("/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client4676", "mds_sessions")).read()) 2019-11-28T11:26:19.915 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:26:19.985 INFO:teuthology.orchestra.run.smithi076.stdout:global_id 4676 2019-11-28T11:26:19.986 INFO:teuthology.orchestra.run.smithi076.stdout:name "0" 2019-11-28T11:26:19.986 INFO:teuthology.orchestra.run.smithi076.stdout:mds.0 open 2019-11-28T11:26:19.986 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:26:19.987 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:26:20.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.086+0000 7f17d750e700 1 Processor -- start 2019-11-28T11:26:20.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.086+0000 7f17d750e700 1 -- start start 2019-11-28T11:26:20.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.087+0000 7f17d750e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d006c0a0 0x7f17d0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:20.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.087+0000 7f17d750e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17d00734e0 0x7f17d0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:20.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.087+0000 7f17d750e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d006db00 con 0x7f17d0072360 2019-11-28T11:26:20.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.087+0000 7f17d750e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d006f330 con 0x7f17d00734e0 2019-11-28T11:26:20.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.087+0000 7f17d750e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d00706c0 con 0x7f17d006c0a0 2019-11-28T11:26:20.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.087+0000 7f17d52aa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17d00734e0 0x7f17d0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:20.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.087+0000 7f17d62ac700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f17d0072360 0x7f17d006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60346/0 (socket says 172.21.15.80:60346) 2019-11-28T11:26:20.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.087+0000 7f17d52aa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17d00734e0 0x7f17d0071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32800/0 (socket says 172.21.15.80:32800) 2019-11-28T11:26:20.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.087+0000 7f17d62ac700 1 -- 172.21.15.80:0/1396042259 learned_addr learned my addr 172.21.15.80:0/1396042259 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:20.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.087+0000 7f17d5aab700 1 --2- 172.21.15.80:0/1396042259 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d006c0a0 0x7f17d0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:20.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.088+0000 7f17d52aa700 1 -- 172.21.15.80:0/1396042259 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d006c0a0 msgr2=0x7f17d0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:20.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.088+0000 7f17d52aa700 1 --2- 172.21.15.80:0/1396042259 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d006c0a0 0x7f17d0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:20.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.088+0000 7f17d4aa9700 1 -- 172.21.15.80:0/1396042259 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349416298 0 0) 0x7f17c8001150 con 0x7f17d0072360 2019-11-28T11:26:20.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.088+0000 7f17d52aa700 1 -- 172.21.15.80:0/1396042259 >> v1:172.21.15.80:6789/0 conn(0x7f17d0072360 legacy=0x7f17d006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:20.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.088+0000 7f17d52aa700 1 -- 172.21.15.80:0/1396042259 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d0070a40 con 0x7f17d00734e0 2019-11-28T11:26:20.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.088+0000 7f17d52aa700 1 --2- 172.21.15.80:0/1396042259 >> v2:172.21.15.80:3300/0 conn(0x7f17d00734e0 0x7f17d0071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f17b800b2d0 tx=0x7f17b800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.088+0000 7f17d52aa700 1 --2- 172.21.15.80:0/1396042259 >> v2:172.21.15.80:3300/0 conn(0x7f17d00734e0 0x7f17d0071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f17b800b2d0 tx=0x7f17b800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.088+0000 7f17d52aa700 1 --2- 172.21.15.80:0/1396042259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17d00734e0 0x7f17d0071e20 secure :-1 s=READY pgs=411 cs=0 l=1 rx=0x7f17b800b2d0 tx=0x7f17b800ba60).ready entity=mon.0 client_cookie=f2b7047bd0368af2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:20.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.088+0000 7f17d52aa700 1 --2- 172.21.15.80:0/1396042259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17d00734e0 0x7f17d0071e20 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f17b800b2d0 tx=0x7f17b800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.088+0000 7f17d4aa9700 1 -- 172.21.15.80:0/1396042259 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17b8007590 con 0x7f17d00734e0 2019-11-28T11:26:20.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.088+0000 7f17d52aa700 1 --2- 172.21.15.80:0/1396042259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17d00734e0 0x7f17d0071e20 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f17b800b2d0 tx=0x7f17b800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.088+0000 7f17d52aa700 1 --2- 172.21.15.80:0/1396042259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17d00734e0 0x7f17d0071e20 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f17b800b2d0 tx=0x7f17b800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.088+0000 7f17d4aa9700 1 -- 172.21.15.80:0/1396042259 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b8009d30 con 0x7f17d00734e0 2019-11-28T11:26:20.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.088+0000 7f17d4aa9700 1 -- 172.21.15.80:0/1396042259 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17b800a400 con 0x7f17d00734e0 2019-11-28T11:26:20.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.088+0000 7f17d750e700 1 -- 172.21.15.80:0/1396042259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17d00734e0 msgr2=0x7f17d0071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:20.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.088+0000 7f17d750e700 1 --2- 172.21.15.80:0/1396042259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17d00734e0 0x7f17d0071e20 secure :-1 s=READY pgs=411 cs=0 l=1 rx=0x7f17b800b2d0 tx=0x7f17b800ba60).stop 2019-11-28T11:26:20.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.089+0000 7f17d750e700 1 -- 172.21.15.80:0/1396042259 shutdown_connections 2019-11-28T11:26:20.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.089+0000 7f17d750e700 1 --2- 172.21.15.80:0/1396042259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17d00734e0 0x7f17d0071e20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:20.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.089+0000 7f17d750e700 1 --2- 172.21.15.80:0/1396042259 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d006c0a0 0x7f17d0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:20.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.089+0000 7f17d750e700 1 -- 172.21.15.80:0/1396042259 shutdown_connections 2019-11-28T11:26:20.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.089+0000 7f17d750e700 1 -- 172.21.15.80:0/1396042259 wait complete. 2019-11-28T11:26:20.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.089+0000 7f17d750e700 1 -- 172.21.15.80:0/1396042259 >> 172.21.15.80:0/1396042259 conn(0x7f17d0061cf0 msgr2=0x7f17d0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:20.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.091+0000 7f17d750e700 1 Processor -- start 2019-11-28T11:26:20.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.091+0000 7f17d750e700 1 -- start start 2019-11-28T11:26:20.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.092+0000 7f17d750e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d013e900 0x7f17d0121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:20.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.092+0000 7f17d750e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f17d0121c90 0x7f17d01209a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:20.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.092+0000 7f17d750e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d0139df0 con 0x7f17d0120ee0 2019-11-28T11:26:20.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.092+0000 7f17d750e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d013b850 con 0x7f17d0121c90 2019-11-28T11:26:20.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.092+0000 7f17d750e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d0128fb0 con 0x7f17d013e900 2019-11-28T11:26:20.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.092+0000 7f17d5aab700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d013e900 0x7f17d0121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:20.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.092+0000 7f17d5aab700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d013e900 0x7f17d0121750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:35062/0 (socket says 172.21.15.80:35062) 2019-11-28T11:26:20.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.092+0000 7f17d5aab700 1 -- 172.21.15.80:0/1235870810 learned_addr learned my addr 172.21.15.80:0/1235870810 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:20.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.092+0000 7f17d52aa700 1 --2- 172.21.15.80:0/1235870810 >> v2:172.21.15.174:3300/0 conn(0x7f17d0121c90 0x7f17d01209a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:20.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.093+0000 7f17d5aab700 1 -- 172.21.15.80:0/1235870810 >> v2:172.21.15.174:3300/0 conn(0x7f17d0121c90 msgr2=0x7f17d01209a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:20.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.093+0000 7f17d5aab700 1 --2- 172.21.15.80:0/1235870810 >> v2:172.21.15.174:3300/0 conn(0x7f17d0121c90 0x7f17d01209a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:20.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.093+0000 7f17d5aab700 1 -- 172.21.15.80:0/1235870810 >> v1:172.21.15.174:6789/0 conn(0x7f17d0120ee0 legacy=0x7f17d0164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:20.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.093+0000 7f17d5aab700 1 -- 172.21.15.80:0/1235870810 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d0129330 con 0x7f17d013e900 2019-11-28T11:26:20.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.093+0000 7f17d5aab700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d013e900 0x7f17d0121750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f17c0010460 tx=0x7f17c0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.093+0000 7f17d5aab700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d013e900 0x7f17d0121750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f17c0010460 tx=0x7f17c0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.093+0000 7f17d5aab700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d013e900 0x7f17d0121750 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f17c0010460 tx=0x7f17c0010290).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.093+0000 7f17d5aab700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d013e900 0x7f17d0121750 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f17c0010460 tx=0x7f17c0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.093+0000 7f17ce7fc700 1 -- 172.21.15.80:0/1235870810 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17c0005560 con 0x7f17d013e900 2019-11-28T11:26:20.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.093+0000 7f17d5aab700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d013e900 0x7f17d0121750 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f17c0010460 tx=0x7f17c0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.093+0000 7f17d5aab700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d013e900 0x7f17d0121750 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f17c0010460 tx=0x7f17c0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.093+0000 7f17ce7fc700 1 -- 172.21.15.80:0/1235870810 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c0005180 con 0x7f17d013e900 2019-11-28T11:26:20.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.093+0000 7f17d750e700 1 -- 172.21.15.80:0/1235870810 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d01281b0 con 0x7f17d013e900 2019-11-28T11:26:20.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.093+0000 7f17ce7fc700 1 -- 172.21.15.80:0/1235870810 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17c0005b40 con 0x7f17d013e900 2019-11-28T11:26:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.093+0000 7f17d750e700 1 -- 172.21.15.80:0/1235870810 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d0129330 con 0x7f17d013e900 2019-11-28T11:26:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.093+0000 7f17d5aab700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d013e900 0x7f17d0121750 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f17c0010460 tx=0x7f17c0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.094+0000 7f17ce7fc700 1 -- 172.21.15.80:0/1235870810 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f17c0005370 con 0x7f17d013e900 2019-11-28T11:26:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.094+0000 7f17d5aab700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d013e900 0x7f17d0121750 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f17c0010460 tx=0x7f17c0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.094+0000 7f17ce7fc700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17b4018730 0x7f17b401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.094+0000 7f17ce7fc700 1 -- 172.21.15.80:0/1235870810 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f17c0031d50 con 0x7f17d013e900 2019-11-28T11:26:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.094+0000 7f17d52aa700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17b4018730 0x7f17b401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.094+0000 7f17d52aa700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17b4018730 0x7f17b401abc0 crc :-1 s=READY pgs=179 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:20.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.102+0000 7f17d750e700 1 -- 172.21.15.80:0/1235870810 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d01281b0 con 0x7f17d013e900 2019-11-28T11:26:20.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.106+0000 7f17d5aab700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d013e900 0x7f17d0121750 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f17c0010460 tx=0x7f17c0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.106+0000 7f17ce7fc700 1 -- 172.21.15.80:0/1235870810 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f17c0009240 con 0x7f17d013e900 2019-11-28T11:26:20.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.279+0000 7f17d750e700 1 -- 172.21.15.80:0/1235870810 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17d0129330 con 0x7f17d013e900 2019-11-28T11:26:20.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.279+0000 7f17d5aab700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d013e900 0x7f17d0121750 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f17c0010460 tx=0x7f17c0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.279+0000 7f17ce7fc700 1 -- 172.21.15.80:0/1235870810 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2446 (secure 0 0 0) 0x7f17c0005180 con 0x7f17d013e900 2019-11-28T11:26:20.301 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2019-11-28T11:26:20.302 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:20.302 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:12.065616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:26:20.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.282+0000 7f17d750e700 1 -- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17b4018730 msgr2=0x7f17b401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:20.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.282+0000 7f17d750e700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17b4018730 0x7f17b401abc0 crc :-1 s=READY pgs=179 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:20.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.282+0000 7f17d750e700 1 -- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d013e900 msgr2=0x7f17d0121750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:20.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.282+0000 7f17d750e700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d013e900 0x7f17d0121750 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f17c0010460 tx=0x7f17c0010290).stop 2019-11-28T11:26:20.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.282+0000 7f17d750e700 1 -- 172.21.15.80:0/1235870810 shutdown_connections 2019-11-28T11:26:20.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.282+0000 7f17d750e700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17b4018730 0x7f17b401abc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:20.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.282+0000 7f17d750e700 1 --2- 172.21.15.80:0/1235870810 >> v2:172.21.15.174:3300/0 conn(0x7f17d0121c90 0x7f17d01209a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:20.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.282+0000 7f17d750e700 1 --2- 172.21.15.80:0/1235870810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d013e900 0x7f17d0121750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:20.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.282+0000 7f17d750e700 1 -- 172.21.15.80:0/1235870810 shutdown_connections 2019-11-28T11:26:20.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.282+0000 7f17d750e700 1 -- 172.21.15.80:0/1235870810 wait complete. 2019-11-28T11:26:20.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.282+0000 7f17d750e700 1 -- 172.21.15.80:0/1235870810 >> 172.21.15.80:0/1235870810 conn(0x7f17d0127dc0 msgr2=0x7f17d0141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:20.314 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session ls 2019-11-28T11:26:20.439 INFO:teuthology.orchestra.run.smithi174.stdout:[ 2019-11-28T11:26:20.440 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:26:20.440 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 4676, 2019-11-28T11:26:20.440 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:26:20.440 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:26:20.440 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:26:20.441 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 4676 2019-11-28T11:26:20.441 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:20.441 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:26:20.441 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:26:20.441 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.76:0", 2019-11-28T11:26:20.441 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 1347691556 2019-11-28T11:26:20.442 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:26:20.442 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:20.442 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:26:20.442 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:26:20.442 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 1, 2019-11-28T11:26:20.442 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 1, 2019-11-28T11:26:20.443 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 4.3539731210000001, 2019-11-28T11:26:20.443 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:26:20.443 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 1, 2019-11-28T11:26:20.443 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:26:20.443 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:26:20.443 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:26:20.444 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:26:20.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:20.444 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:26:20.444 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:26:20.444 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:26:20.444 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:20.445 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:26:20.445 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:26:20.445 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:26:20.445 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:20.445 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:26:20.445 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:26:20.446 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:26:20.446 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:20.446 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:26:20.446 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0.98999519141121894, 2019-11-28T11:26:20.446 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:26:20.446 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:20.447 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.4676 v1:172.21.15.76:0/1347691556", 2019-11-28T11:26:20.447 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [ 2019-11-28T11:26:20.447 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:26:20.447 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 2, 2019-11-28T11:26:20.447 INFO:teuthology.orchestra.run.smithi174.stdout: "created_ino": "0x0" 2019-11-28T11:26:20.447 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:26:20.448 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2019-11-28T11:26:20.448 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T11:26:20.448 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:26:20.448 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:26:20.448 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:26:20.448 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "0", 2019-11-28T11:26:20.449 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi076", 2019-11-28T11:26:20.449 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:26:20.449 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:26:20.449 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:26:20.449 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:26:20.449 INFO:teuthology.orchestra.run.smithi174.stdout:] 2019-11-28T11:26:20.451 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 4676, "entity": { "name": { "type": "client", "num": 4676 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 1347691556 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 1, "uptime": 4.3539731210000001, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.98999519141121894, "halflife": 300 }, "inst": "client.4676 v1:172.21.15.76:0/1347691556", "completed_requests": [ { "tid": 2, "created_ino": "0x0" } ], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:26:20.452 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:26:20.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.550+0000 7f8f1e456700 1 Processor -- start 2019-11-28T11:26:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.550+0000 7f8f1e456700 1 -- start start 2019-11-28T11:26:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.551+0000 7f8f1e456700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8f1806c0a0 0x7f8f18072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.551+0000 7f8f1e456700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8f180734e0 0x7f8f18071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.551+0000 7f8f1e456700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f18072360 0x7f8f18072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.551+0000 7f8f1e456700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1806fd60 con 0x7f8f1806c0a0 2019-11-28T11:26:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.551+0000 7f8f1e456700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f18070030 con 0x7f8f180734e0 2019-11-28T11:26:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.551+0000 7f8f1e456700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1806f330 con 0x7f8f18072360 2019-11-28T11:26:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.551+0000 7f8f1c9f3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8f1806c0a0 0x7f8f18072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.551+0000 7f8f1c9f3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8f1806c0a0 0x7f8f18072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32810/0 (socket says 172.21.15.80:32810) 2019-11-28T11:26:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.551+0000 7f8f1c9f3700 1 -- 172.21.15.80:0/2026393152 learned_addr learned my addr 172.21.15.80:0/2026393152 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.551+0000 7f8f17fff700 1 --2- 172.21.15.80:0/2026393152 >> v2:172.21.15.174:3300/0 conn(0x7f8f180734e0 0x7f8f18071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:20.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.551+0000 7f8f1d1f4700 1 --2- 172.21.15.80:0/2026393152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f18072360 0x7f8f18072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.551+0000 7f8f1c9f3700 1 -- 172.21.15.80:0/2026393152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f18072360 msgr2=0x7f8f18072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.551+0000 7f8f1c9f3700 1 --2- 172.21.15.80:0/2026393152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f18072360 0x7f8f18072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.551+0000 7f8f1c9f3700 1 -- 172.21.15.80:0/2026393152 >> v2:172.21.15.174:3300/0 conn(0x7f8f180734e0 msgr2=0x7f8f18071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.551+0000 7f8f1c9f3700 1 --2- 172.21.15.80:0/2026393152 >> v2:172.21.15.174:3300/0 conn(0x7f8f180734e0 0x7f8f18071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.551+0000 7f8f1c9f3700 1 -- 172.21.15.80:0/2026393152 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f180706c0 con 0x7f8f1806c0a0 2019-11-28T11:26:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.552+0000 7f8f1c9f3700 1 --2- 172.21.15.80:0/2026393152 >> v2:172.21.15.80:3300/0 conn(0x7f8f1806c0a0 0x7f8f18072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8f0800f6c0 tx=0x7f8f0800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.552+0000 7f8f1c9f3700 1 --2- 172.21.15.80:0/2026393152 >> v2:172.21.15.80:3300/0 conn(0x7f8f1806c0a0 0x7f8f18072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8f0800f6c0 tx=0x7f8f0800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.552+0000 7f8f1c9f3700 1 --2- 172.21.15.80:0/2026393152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f1806c0a0 0x7f8f18072fa0 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7f8f0800f6c0 tx=0x7f8f0800f570).ready entity=mon.0 client_cookie=33edb1aaa4a05359 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:20.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.552+0000 7f8f1c9f3700 1 --2- 172.21.15.80:0/2026393152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f1806c0a0 0x7f8f18072fa0 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f8f0800f6c0 tx=0x7f8f0800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.552+0000 7f8f1c9f3700 1 --2- 172.21.15.80:0/2026393152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f1806c0a0 0x7f8f18072fa0 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f8f0800f6c0 tx=0x7f8f0800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.552+0000 7f8f177fe700 1 -- 172.21.15.80:0/2026393152 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f08000960 con 0x7f8f1806c0a0 2019-11-28T11:26:20.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.552+0000 7f8f1c9f3700 1 --2- 172.21.15.80:0/2026393152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f1806c0a0 0x7f8f18072fa0 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f8f0800f6c0 tx=0x7f8f0800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.552+0000 7f8f177fe700 1 -- 172.21.15.80:0/2026393152 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f08000c90 con 0x7f8f1806c0a0 2019-11-28T11:26:20.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.552+0000 7f8f177fe700 1 -- 172.21.15.80:0/2026393152 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f080013a0 con 0x7f8f1806c0a0 2019-11-28T11:26:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.552+0000 7f8f1e456700 1 -- 172.21.15.80:0/2026393152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f1806c0a0 msgr2=0x7f8f18072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.552+0000 7f8f1e456700 1 --2- 172.21.15.80:0/2026393152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f1806c0a0 0x7f8f18072fa0 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7f8f0800f6c0 tx=0x7f8f0800f570).stop 2019-11-28T11:26:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.552+0000 7f8f1e456700 1 -- 172.21.15.80:0/2026393152 shutdown_connections 2019-11-28T11:26:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.552+0000 7f8f1e456700 1 --2- 172.21.15.80:0/2026393152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f18072360 0x7f8f18072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.552+0000 7f8f1e456700 1 --2- 172.21.15.80:0/2026393152 >> v2:172.21.15.174:3300/0 conn(0x7f8f180734e0 0x7f8f18071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.552+0000 7f8f1e456700 1 --2- 172.21.15.80:0/2026393152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f1806c0a0 0x7f8f18072fa0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:20.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.553+0000 7f8f1e456700 1 -- 172.21.15.80:0/2026393152 shutdown_connections 2019-11-28T11:26:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.553+0000 7f8f1e456700 1 -- 172.21.15.80:0/2026393152 wait complete. 2019-11-28T11:26:20.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.553+0000 7f8f1e456700 1 -- 172.21.15.80:0/2026393152 >> 172.21.15.80:0/2026393152 conn(0x7f8f18061cf0 msgr2=0x7f8f18064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:20.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.555+0000 7f8f1e456700 1 Processor -- start 2019-11-28T11:26:20.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.555+0000 7f8f1e456700 1 -- start start 2019-11-28T11:26:20.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.556+0000 7f8f1e456700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8f18104c10 0x7f8f181050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:20.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.556+0000 7f8f1e456700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8f181055e0 0x7f8f18167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.556+0000 7f8f1e456700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1813bcd0 con 0x7f8f18104820 2019-11-28T11:26:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.556+0000 7f8f1e456700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f18109130 con 0x7f8f18104c10 2019-11-28T11:26:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.556+0000 7f8f1e456700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f18109400 con 0x7f8f181055e0 2019-11-28T11:26:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.556+0000 7f8f1c9f3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8f18104820 0x7f8f1810c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60364/0 (socket says 172.21.15.80:60364) 2019-11-28T11:26:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.556+0000 7f8f1c9f3700 1 -- 172.21.15.80:0/4197720051 learned_addr learned my addr 172.21.15.80:0/4197720051 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.556+0000 7f8f17fff700 1 --2- 172.21.15.80:0/4197720051 >> v2:172.21.15.80:3300/0 conn(0x7f8f18104c10 0x7f8f181050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:20.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.556+0000 7f8f1d1f4700 1 --2- 172.21.15.80:0/4197720051 >> v2:172.21.15.174:3300/0 conn(0x7f8f181055e0 0x7f8f18167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:20.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.556+0000 7f8f17fff700 1 -- 172.21.15.80:0/4197720051 >> v2:172.21.15.174:3300/0 conn(0x7f8f181055e0 msgr2=0x7f8f18167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:20.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.556+0000 7f8f17fff700 1 --2- 172.21.15.80:0/4197720051 >> v2:172.21.15.174:3300/0 conn(0x7f8f181055e0 0x7f8f18167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:20.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.556+0000 7f8f17fff700 1 -- 172.21.15.80:0/4197720051 >> v1:172.21.15.80:6789/0 conn(0x7f8f18104820 legacy=0x7f8f1810c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:20.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.556+0000 7f8f17fff700 1 -- 172.21.15.80:0/4197720051 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f18109a90 con 0x7f8f18104c10 2019-11-28T11:26:20.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.556+0000 7f8f157fa700 1 -- 172.21.15.80:0/4197720051 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990980176 0 0) 0x7f8f08007910 con 0x7f8f18104820 2019-11-28T11:26:20.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.557+0000 7f8f17fff700 1 --2- 172.21.15.80:0/4197720051 >> v2:172.21.15.80:3300/0 conn(0x7f8f18104c10 0x7f8f181050a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8f0c010360 tx=0x7f8f0c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.557+0000 7f8f17fff700 1 --2- 172.21.15.80:0/4197720051 >> v2:172.21.15.80:3300/0 conn(0x7f8f18104c10 0x7f8f181050a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8f0c010360 tx=0x7f8f0c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.557+0000 7f8f17fff700 1 --2- 172.21.15.80:0/4197720051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f18104c10 0x7f8f181050a0 secure :-1 s=READY pgs=414 cs=0 l=1 rx=0x7f8f0c010360 tx=0x7f8f0c0101c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:20.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.557+0000 7f8f17fff700 1 --2- 172.21.15.80:0/4197720051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f18104c10 0x7f8f181050a0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f8f0c010360 tx=0x7f8f0c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.557+0000 7f8f157fa700 1 -- 172.21.15.80:0/4197720051 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f0c000940 con 0x7f8f18104c10 2019-11-28T11:26:20.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.557+0000 7f8f17fff700 1 --2- 172.21.15.80:0/4197720051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f18104c10 0x7f8f181050a0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f8f0c010360 tx=0x7f8f0c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.557+0000 7f8f17fff700 1 --2- 172.21.15.80:0/4197720051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f18104c10 0x7f8f181050a0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f8f0c010360 tx=0x7f8f0c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.557+0000 7f8f157fa700 1 -- 172.21.15.80:0/4197720051 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c000c90 con 0x7f8f18104c10 2019-11-28T11:26:20.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.557+0000 7f8f1e456700 1 -- 172.21.15.80:0/4197720051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f18109e10 con 0x7f8f18104c10 2019-11-28T11:26:20.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.557+0000 7f8f157fa700 1 -- 172.21.15.80:0/4197720051 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f0c001360 con 0x7f8f18104c10 2019-11-28T11:26:20.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.557+0000 7f8f1e456700 1 -- 172.21.15.80:0/4197720051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f18109a90 con 0x7f8f18104c10 2019-11-28T11:26:20.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.557+0000 7f8f17fff700 1 --2- 172.21.15.80:0/4197720051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f18104c10 0x7f8f181050a0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f8f0c010360 tx=0x7f8f0c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.557+0000 7f8f157fa700 1 -- 172.21.15.80:0/4197720051 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8f0c000e80 con 0x7f8f18104c10 2019-11-28T11:26:20.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.557+0000 7f8f17fff700 1 --2- 172.21.15.80:0/4197720051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f18104c10 0x7f8f181050a0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f8f0c010360 tx=0x7f8f0c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.558+0000 7f8f157fa700 1 --2- 172.21.15.80:0/4197720051 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ef8018730 0x7f8ef801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:20.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.558+0000 7f8f157fa700 1 -- 172.21.15.80:0/4197720051 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8f0c0319e0 con 0x7f8f18104c10 2019-11-28T11:26:20.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.558+0000 7f8f1c9f3700 1 --2- 172.21.15.80:0/4197720051 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ef8018730 0x7f8ef801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:20.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.558+0000 7f8f1c9f3700 1 --2- 172.21.15.80:0/4197720051 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ef8018730 0x7f8ef801abc0 crc :-1 s=READY pgs=180 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:20.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.565+0000 7f8f1e456700 1 -- 172.21.15.80:0/4197720051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f18109e10 con 0x7f8f18104c10 2019-11-28T11:26:20.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.569+0000 7f8f17fff700 1 --2- 172.21.15.80:0/4197720051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f18104c10 0x7f8f181050a0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f8f0c010360 tx=0x7f8f0c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.569+0000 7f8f157fa700 1 -- 172.21.15.80:0/4197720051 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8f0c009250 con 0x7f8f18104c10 2019-11-28T11:26:20.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.740+0000 7f8f1e456700 1 -- 172.21.15.80:0/4197720051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f18109a90 con 0x7f8f18104c10 2019-11-28T11:26:20.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.741+0000 7f8f17fff700 1 --2- 172.21.15.80:0/4197720051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f18104c10 0x7f8f181050a0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f8f0c010360 tx=0x7f8f0c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:20.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.741+0000 7f8f157fa700 1 -- 172.21.15.80:0/4197720051 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2446 (secure 0 0 0) 0x7f8f0c000e80 con 0x7f8f18104c10 2019-11-28T11:26:20.765 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2019-11-28T11:26:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.743+0000 7f8f1e456700 1 -- 172.21.15.80:0/4197720051 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ef8018730 msgr2=0x7f8ef801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.743+0000 7f8f1e456700 1 --2- 172.21.15.80:0/4197720051 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ef8018730 0x7f8ef801abc0 crc :-1 s=READY pgs=180 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:20.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.743+0000 7f8f1e456700 1 -- 172.21.15.80:0/4197720051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f18104c10 msgr2=0x7f8f181050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:20.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.743+0000 7f8f1e456700 1 --2- 172.21.15.80:0/4197720051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f18104c10 0x7f8f181050a0 secure :-1 s=READY pgs=414 cs=0 l=1 rx=0x7f8f0c010360 tx=0x7f8f0c0101c0).stop 2019-11-28T11:26:20.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.744+0000 7f8f1e456700 1 -- 172.21.15.80:0/4197720051 shutdown_connections 2019-11-28T11:26:20.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.744+0000 7f8f1e456700 1 --2- 172.21.15.80:0/4197720051 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ef8018730 0x7f8ef801abc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:20.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.744+0000 7f8f1e456700 1 --2- 172.21.15.80:0/4197720051 >> v2:172.21.15.174:3300/0 conn(0x7f8f181055e0 0x7f8f18167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:20.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.744+0000 7f8f1e456700 1 --2- 172.21.15.80:0/4197720051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f18104c10 0x7f8f181050a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:20.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.744+0000 7f8f1e456700 1 -- 172.21.15.80:0/4197720051 shutdown_connections 2019-11-28T11:26:20.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.744+0000 7f8f1e456700 1 -- 172.21.15.80:0/4197720051 wait complete. 2019-11-28T11:26:20.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:20.744+0000 7f8f1e456700 1 -- 172.21.15.80:0/4197720051 >> 172.21.15.80:0/4197720051 conn(0x7f8f1813d620 msgr2=0x7f8f1813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:20.770 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:20.770 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:12.065616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:26:20.775 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session ls 2019-11-28T11:26:20.914 INFO:teuthology.orchestra.run.smithi174.stdout:[ 2019-11-28T11:26:20.914 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:26:20.914 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 4676, 2019-11-28T11:26:20.914 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:26:20.914 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:26:20.914 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:26:20.915 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 4676 2019-11-28T11:26:20.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:20.915 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:26:20.915 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:26:20.915 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.76:0", 2019-11-28T11:26:20.916 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 1347691556 2019-11-28T11:26:20.916 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:26:20.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:20.916 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:26:20.916 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:26:20.916 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 1, 2019-11-28T11:26:20.916 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 1, 2019-11-28T11:26:20.917 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 4.8179702789999999, 2019-11-28T11:26:20.917 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:26:20.917 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 1, 2019-11-28T11:26:20.917 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:26:20.917 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:26:20.917 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:26:20.917 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:26:20.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:20.918 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:26:20.919 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:26:20.919 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:26:20.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:20.919 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:26:20.919 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:26:20.920 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:26:20.920 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:20.923 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:26:20.923 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:26:20.924 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:26:20.924 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:20.924 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:26:20.924 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0.98893213990402329, 2019-11-28T11:26:20.924 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:26:20.924 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:20.924 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.4676 v1:172.21.15.76:0/1347691556", 2019-11-28T11:26:20.925 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [ 2019-11-28T11:26:20.925 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:26:20.925 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 2, 2019-11-28T11:26:20.925 INFO:teuthology.orchestra.run.smithi174.stdout: "created_ino": "0x0" 2019-11-28T11:26:20.925 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:26:20.925 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2019-11-28T11:26:20.926 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T11:26:20.926 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:26:20.927 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:26:20.927 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:26:20.927 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "0", 2019-11-28T11:26:20.927 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi076", 2019-11-28T11:26:20.927 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:26:20.927 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:26:20.928 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:26:20.928 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:26:20.928 INFO:teuthology.orchestra.run.smithi174.stdout:] 2019-11-28T11:26:20.929 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 4676, "entity": { "name": { "type": "client", "num": 4676 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 1347691556 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 1, "uptime": 4.8179702789999999, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.98893213990402329, "halflife": 300 }, "inst": "client.4676 v1:172.21.15.76:0/1347691556", "completed_requests": [ { "tid": 2, "created_ino": "0x0" } ], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:26:20.929 INFO:tasks.cephfs.mount:Creating file a 2019-11-28T11:26:20.929 INFO:teuthology.orchestra.run.smithi076:> sudo touch /home/ubuntu/cephtest/mnt.0/a 2019-11-28T11:26:20.991 INFO:tasks.cephfs.mount:Creating file b 2019-11-28T11:26:21.003 INFO:teuthology.orchestra.run.smithi076:> sudo touch /home/ubuntu/cephtest/mnt.0/b 2019-11-28T11:26:21.059 INFO:tasks.cephfs.mount:Creating file c 2019-11-28T11:26:21.059 INFO:teuthology.orchestra.run.smithi076:> sudo touch /home/ubuntu/cephtest/mnt.0/c 2019-11-28T11:26:21.123 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:26:21.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.227+0000 7f7bce402700 1 Processor -- start 2019-11-28T11:26:21.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.227+0000 7f7bce402700 1 -- start start 2019-11-28T11:26:21.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bce402700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7bc806c490 0x7f7bc806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:21.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bce402700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bc806ce60 0x7f7bc8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:21.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bce402700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc806db00 con 0x7f7bc806c0a0 2019-11-28T11:26:21.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bce402700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc806fd60 con 0x7f7bc806c490 2019-11-28T11:26:21.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bce402700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc8070030 con 0x7f7bc806ce60 2019-11-28T11:26:21.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bcc99f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7bc806c0a0 0x7f7bc8072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60372/0 (socket says 172.21.15.80:60372) 2019-11-28T11:26:21.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bcc99f700 1 -- 172.21.15.80:0/2367160293 learned_addr learned my addr 172.21.15.80:0/2367160293 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:21.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bc7fff700 1 --2- 172.21.15.80:0/2367160293 >> v2:172.21.15.174:3300/0 conn(0x7f7bc806c490 0x7f7bc806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:21.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bcd1a0700 1 --2- 172.21.15.80:0/2367160293 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bc806ce60 0x7f7bc8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:21.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bc77fe700 1 -- 172.21.15.80:0/2367160293 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438357599 0 0) 0x7f7bb0001150 con 0x7f7bc806c0a0 2019-11-28T11:26:21.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bc77fe700 1 -- 172.21.15.80:0/2367160293 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bb4002e80 con 0x7f7bc806c0a0 2019-11-28T11:26:21.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bc7fff700 1 -- 172.21.15.80:0/2367160293 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bc806ce60 msgr2=0x7f7bc8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:21.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bc7fff700 1 --2- 172.21.15.80:0/2367160293 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bc806ce60 0x7f7bc8164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:21.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bc7fff700 1 -- 172.21.15.80:0/2367160293 >> v1:172.21.15.80:6789/0 conn(0x7f7bc806c0a0 legacy=0x7f7bc8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:21.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bc7fff700 1 -- 172.21.15.80:0/2367160293 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc80706c0 con 0x7f7bc806c490 2019-11-28T11:26:21.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bcd1a0700 1 --2- 172.21.15.80:0/2367160293 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bc806ce60 0x7f7bc8164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:21.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bc7fff700 1 --2- 172.21.15.80:0/2367160293 >> v2:172.21.15.174:3300/0 conn(0x7f7bc806c490 0x7f7bc806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7bb800af50 tx=0x7f7bb800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.228+0000 7f7bc7fff700 1 --2- 172.21.15.80:0/2367160293 >> v2:172.21.15.174:3300/0 conn(0x7f7bc806c490 0x7f7bc806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7bb800af50 tx=0x7f7bb800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.229+0000 7f7bc7fff700 1 --2- 172.21.15.80:0/2367160293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bc806c490 0x7f7bc806c920 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7f7bb800af50 tx=0x7f7bb800b760).ready entity=mon.1 client_cookie=6370bfba70b54802 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:21.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.229+0000 7f7bc7fff700 1 --2- 172.21.15.80:0/2367160293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bc806c490 0x7f7bc806c920 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f7bb800af50 tx=0x7f7bb800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.229+0000 7f7bc7fff700 1 --2- 172.21.15.80:0/2367160293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bc806c490 0x7f7bc806c920 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f7bb800af50 tx=0x7f7bb800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.229+0000 7f7bc77fe700 1 -- 172.21.15.80:0/2367160293 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bb8007210 con 0x7f7bc806c490 2019-11-28T11:26:21.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.229+0000 7f7bc7fff700 1 --2- 172.21.15.80:0/2367160293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bc806c490 0x7f7bc806c920 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f7bb800af50 tx=0x7f7bb800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.229+0000 7f7bc77fe700 1 -- 172.21.15.80:0/2367160293 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb80099b0 con 0x7f7bc806c490 2019-11-28T11:26:21.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.229+0000 7f7bc77fe700 1 -- 172.21.15.80:0/2367160293 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bb800a080 con 0x7f7bc806c490 2019-11-28T11:26:21.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.229+0000 7f7bce402700 1 -- 172.21.15.80:0/2367160293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bc806c490 msgr2=0x7f7bc806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:21.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.229+0000 7f7bce402700 1 --2- 172.21.15.80:0/2367160293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bc806c490 0x7f7bc806c920 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7f7bb800af50 tx=0x7f7bb800b760).stop 2019-11-28T11:26:21.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.229+0000 7f7bce402700 1 -- 172.21.15.80:0/2367160293 shutdown_connections 2019-11-28T11:26:21.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.229+0000 7f7bce402700 1 --2- 172.21.15.80:0/2367160293 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bc806ce60 0x7f7bc8164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:21.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.229+0000 7f7bce402700 1 --2- 172.21.15.80:0/2367160293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bc806c490 0x7f7bc806c920 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:21.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.229+0000 7f7bce402700 1 -- 172.21.15.80:0/2367160293 shutdown_connections 2019-11-28T11:26:21.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.229+0000 7f7bce402700 1 -- 172.21.15.80:0/2367160293 wait complete. 2019-11-28T11:26:21.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.229+0000 7f7bce402700 1 -- 172.21.15.80:0/2367160293 >> 172.21.15.80:0/2367160293 conn(0x7f7bc8061cf0 msgr2=0x7f7bc8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:21.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.232+0000 7f7bce402700 1 Processor -- start 2019-11-28T11:26:21.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.232+0000 7f7bce402700 1 -- start start 2019-11-28T11:26:21.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bce402700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7bc813a780 0x7f7bc812d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:21.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bce402700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7bc812cb00 0x7f7bc8167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:21.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bce402700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc8139a60 con 0x7f7bc812d9c0 2019-11-28T11:26:21.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bce402700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc812a260 con 0x7f7bc813a780 2019-11-28T11:26:21.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bce402700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc812a530 con 0x7f7bc812cb00 2019-11-28T11:26:21.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bcc99f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7bc813a780 0x7f7bc812d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:21.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bc7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7bc812d9c0 0x7f7bc812c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60380/0 (socket says 172.21.15.80:60380) 2019-11-28T11:26:21.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bc7fff700 1 -- 172.21.15.80:0/2890346184 learned_addr learned my addr 172.21.15.80:0/2890346184 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:21.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bcd1a0700 1 --2- 172.21.15.80:0/2890346184 >> v2:172.21.15.174:3300/0 conn(0x7f7bc812cb00 0x7f7bc8167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:21.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bc57fa700 1 -- 172.21.15.80:0/2890346184 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009542048 0 0) 0x7f7bb800abb0 con 0x7f7bc812d9c0 2019-11-28T11:26:21.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bc57fa700 1 -- 172.21.15.80:0/2890346184 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bac002e80 con 0x7f7bc812d9c0 2019-11-28T11:26:21.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bcc99f700 1 -- 172.21.15.80:0/2890346184 >> v2:172.21.15.174:3300/0 conn(0x7f7bc812cb00 msgr2=0x7f7bc8167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:21.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bcc99f700 1 --2- 172.21.15.80:0/2890346184 >> v2:172.21.15.174:3300/0 conn(0x7f7bc812cb00 0x7f7bc8167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:21.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bcc99f700 1 -- 172.21.15.80:0/2890346184 >> v1:172.21.15.80:6789/0 conn(0x7f7bc812d9c0 legacy=0x7f7bc812c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:21.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bcc99f700 1 -- 172.21.15.80:0/2890346184 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc812abc0 con 0x7f7bc813a780 2019-11-28T11:26:21.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bcc99f700 1 --2- 172.21.15.80:0/2890346184 >> v2:172.21.15.80:3300/0 conn(0x7f7bc813a780 0x7f7bc812d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7bb0010380 tx=0x7f7bb00101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bcc99f700 1 --2- 172.21.15.80:0/2890346184 >> v2:172.21.15.80:3300/0 conn(0x7f7bc813a780 0x7f7bc812d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7bb0010380 tx=0x7f7bb00101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bcc99f700 1 --2- 172.21.15.80:0/2890346184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bc813a780 0x7f7bc812d480 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7f7bb0010380 tx=0x7f7bb00101b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:21.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bcc99f700 1 --2- 172.21.15.80:0/2890346184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bc813a780 0x7f7bc812d480 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f7bb0010380 tx=0x7f7bb00101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bc57fa700 1 -- 172.21.15.80:0/2890346184 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bb0000d80 con 0x7f7bc813a780 2019-11-28T11:26:21.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bcc99f700 1 --2- 172.21.15.80:0/2890346184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bc813a780 0x7f7bc812d480 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f7bb0010380 tx=0x7f7bb00101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bc57fa700 1 -- 172.21.15.80:0/2890346184 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb0001380 con 0x7f7bc813a780 2019-11-28T11:26:21.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bcc99f700 1 --2- 172.21.15.80:0/2890346184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bc813a780 0x7f7bc812d480 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f7bb0010380 tx=0x7f7bb00101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bc57fa700 1 -- 172.21.15.80:0/2890346184 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bb0000c90 con 0x7f7bc813a780 2019-11-28T11:26:21.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bce402700 1 -- 172.21.15.80:0/2890346184 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc812af40 con 0x7f7bc813a780 2019-11-28T11:26:21.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.233+0000 7f7bce402700 1 -- 172.21.15.80:0/2890346184 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc812abc0 con 0x7f7bc813a780 2019-11-28T11:26:21.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.234+0000 7f7bcc99f700 1 --2- 172.21.15.80:0/2890346184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bc813a780 0x7f7bc812d480 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f7bb0010380 tx=0x7f7bb00101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.234+0000 7f7bc57fa700 1 -- 172.21.15.80:0/2890346184 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7bb0001570 con 0x7f7bc813a780 2019-11-28T11:26:21.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.234+0000 7f7bcc99f700 1 --2- 172.21.15.80:0/2890346184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bc813a780 0x7f7bc812d480 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f7bb0010380 tx=0x7f7bb00101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.234+0000 7f7bc57fa700 1 --2- 172.21.15.80:0/2890346184 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bac018770 0x7f7bac01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:21.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.234+0000 7f7bc57fa700 1 -- 172.21.15.80:0/2890346184 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7bb0031a20 con 0x7f7bc813a780 2019-11-28T11:26:21.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.234+0000 7f7bc7fff700 1 --2- 172.21.15.80:0/2890346184 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bac018770 0x7f7bac01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:21.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.235+0000 7f7bc7fff700 1 --2- 172.21.15.80:0/2890346184 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bac018770 0x7f7bac01abe0 crc :-1 s=READY pgs=181 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:21.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.242+0000 7f7bce402700 1 -- 172.21.15.80:0/2890346184 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc812af40 con 0x7f7bc813a780 2019-11-28T11:26:21.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.245+0000 7f7bcc99f700 1 --2- 172.21.15.80:0/2890346184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bc813a780 0x7f7bc812d480 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f7bb0010380 tx=0x7f7bb00101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.245+0000 7f7bc57fa700 1 -- 172.21.15.80:0/2890346184 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7bb0001a30 con 0x7f7bc813a780 2019-11-28T11:26:21.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.416+0000 7f7bce402700 1 -- 172.21.15.80:0/2890346184 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bc812abc0 con 0x7f7bc813a780 2019-11-28T11:26:21.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.416+0000 7f7bcc99f700 1 --2- 172.21.15.80:0/2890346184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bc813a780 0x7f7bc812d480 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7f7bb0010380 tx=0x7f7bb00101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.416+0000 7f7bc57fa700 1 -- 172.21.15.80:0/2890346184 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2446 (secure 0 0 0) 0x7f7bb0001570 con 0x7f7bc813a780 2019-11-28T11:26:21.440 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2019-11-28T11:26:21.441 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:21.441 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:12.065616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:26:21.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.419+0000 7f7bce402700 1 -- 172.21.15.80:0/2890346184 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bac018770 msgr2=0x7f7bac01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:21.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.419+0000 7f7bce402700 1 --2- 172.21.15.80:0/2890346184 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bac018770 0x7f7bac01abe0 crc :-1 s=READY pgs=181 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:21.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.419+0000 7f7bce402700 1 -- 172.21.15.80:0/2890346184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bc813a780 msgr2=0x7f7bc812d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:21.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.419+0000 7f7bce402700 1 --2- 172.21.15.80:0/2890346184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bc813a780 0x7f7bc812d480 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7f7bb0010380 tx=0x7f7bb00101b0).stop 2019-11-28T11:26:21.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.419+0000 7f7bce402700 1 -- 172.21.15.80:0/2890346184 shutdown_connections 2019-11-28T11:26:21.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.419+0000 7f7bce402700 1 --2- 172.21.15.80:0/2890346184 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bac018770 0x7f7bac01abe0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:21.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.419+0000 7f7bce402700 1 --2- 172.21.15.80:0/2890346184 >> v2:172.21.15.174:3300/0 conn(0x7f7bc812cb00 0x7f7bc8167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:21.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.419+0000 7f7bce402700 1 --2- 172.21.15.80:0/2890346184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7bc813a780 0x7f7bc812d480 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:21.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.419+0000 7f7bce402700 1 -- 172.21.15.80:0/2890346184 shutdown_connections 2019-11-28T11:26:21.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.419+0000 7f7bce402700 1 -- 172.21.15.80:0/2890346184 wait complete. 2019-11-28T11:26:21.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.419+0000 7f7bce402700 1 -- 172.21.15.80:0/2890346184 >> 172.21.15.80:0/2890346184 conn(0x7f7bc8127dc0 msgr2=0x7f7bc8141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:21.453 INFO:teuthology.orchestra.run.smithi174:> sudo iptables -A OUTPUT -p tcp --sport 6835 -j REJECT -m comment --comment teuthology 2019-11-28T11:26:21.556 INFO:teuthology.orchestra.run.smithi174:> sudo iptables -A INPUT -p tcp --dport 6835 -j REJECT -m comment --comment teuthology 2019-11-28T11:26:21.614 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:26:21.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.712+0000 7fe3aac37700 1 Processor -- start 2019-11-28T11:26:21.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.712+0000 7fe3aac37700 1 -- start start 2019-11-28T11:26:21.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.713+0000 7fe3aac37700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe3a406c0a0 0x7fe3a4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:21.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.713+0000 7fe3aac37700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a40734e0 0x7fe3a4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:21.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.713+0000 7fe3aac37700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a406db00 con 0x7fe3a4072360 2019-11-28T11:26:21.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.713+0000 7fe3aac37700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a406fd60 con 0x7fe3a406c0a0 2019-11-28T11:26:21.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.713+0000 7fe3aac37700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a4070030 con 0x7fe3a40734e0 2019-11-28T11:26:21.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a91d4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe3a406c0a0 0x7fe3a4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:21.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a89d3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a40734e0 0x7fe3a4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:21.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a89d3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a40734e0 0x7fe3a4071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:35102/0 (socket says 172.21.15.80:35102) 2019-11-28T11:26:21.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a91d4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe3a406c0a0 0x7fe3a4072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:47724/0 (socket says 172.21.15.80:47724) 2019-11-28T11:26:21.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a99d5700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe3a4072360 0x7fe3a406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:47700/0 (socket says 172.21.15.80:47700) 2019-11-28T11:26:21.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a89d3700 1 -- 172.21.15.80:0/2551010740 learned_addr learned my addr 172.21.15.80:0/2551010740 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:21.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a89d3700 1 -- 172.21.15.80:0/2551010740 >> v2:172.21.15.174:3300/0 conn(0x7fe3a406c0a0 msgr2=0x7fe3a4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:21.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a89d3700 1 --2- 172.21.15.80:0/2551010740 >> v2:172.21.15.174:3300/0 conn(0x7fe3a406c0a0 0x7fe3a4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:21.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a89d3700 1 -- 172.21.15.80:0/2551010740 >> v1:172.21.15.174:6789/0 conn(0x7fe3a4072360 legacy=0x7fe3a406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:21.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a3fff700 1 -- 172.21.15.80:0/2551010740 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104491491 0 0) 0x7fe39c0009b0 con 0x7fe3a4072360 2019-11-28T11:26:21.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a89d3700 1 -- 172.21.15.80:0/2551010740 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a40706c0 con 0x7fe3a40734e0 2019-11-28T11:26:21.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a91d4700 1 --2- 172.21.15.80:0/2551010740 >> v2:172.21.15.174:3300/0 conn(0x7fe3a406c0a0 0x7fe3a4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:26:21.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a89d3700 1 --2- 172.21.15.80:0/2551010740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a40734e0 0x7fe3a4071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe39400f740 tx=0x7fe39400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a89d3700 1 --2- 172.21.15.80:0/2551010740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a40734e0 0x7fe3a4071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe39400f740 tx=0x7fe39400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a89d3700 1 --2- 172.21.15.80:0/2551010740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a40734e0 0x7fe3a4071e20 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7fe39400f740 tx=0x7fe39400fae0).ready entity=mon.2 client_cookie=a24321cdc1b6a188 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:21.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a89d3700 1 --2- 172.21.15.80:0/2551010740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a40734e0 0x7fe3a4071e20 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fe39400f740 tx=0x7fe39400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a3fff700 1 -- 172.21.15.80:0/2551010740 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe394000960 con 0x7fe3a40734e0 2019-11-28T11:26:21.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.714+0000 7fe3a89d3700 1 --2- 172.21.15.80:0/2551010740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a40734e0 0x7fe3a4071e20 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fe39400f740 tx=0x7fe39400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.715+0000 7fe3a3fff700 1 -- 172.21.15.80:0/2551010740 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe394000c90 con 0x7fe3a40734e0 2019-11-28T11:26:21.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.715+0000 7fe3a89d3700 1 --2- 172.21.15.80:0/2551010740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a40734e0 0x7fe3a4071e20 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fe39400f740 tx=0x7fe39400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.715+0000 7fe3a3fff700 1 -- 172.21.15.80:0/2551010740 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe394007210 con 0x7fe3a40734e0 2019-11-28T11:26:21.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.715+0000 7fe3aac37700 1 -- 172.21.15.80:0/2551010740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a40734e0 msgr2=0x7fe3a4071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:21.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.715+0000 7fe3aac37700 1 --2- 172.21.15.80:0/2551010740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a40734e0 0x7fe3a4071e20 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7fe39400f740 tx=0x7fe39400fae0).stop 2019-11-28T11:26:21.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.715+0000 7fe3aac37700 1 -- 172.21.15.80:0/2551010740 shutdown_connections 2019-11-28T11:26:21.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.715+0000 7fe3aac37700 1 --2- 172.21.15.80:0/2551010740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a40734e0 0x7fe3a4071e20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:21.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.715+0000 7fe3aac37700 1 --2- 172.21.15.80:0/2551010740 >> v2:172.21.15.174:3300/0 conn(0x7fe3a406c0a0 0x7fe3a4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.715+0000 7fe3aac37700 1 -- 172.21.15.80:0/2551010740 shutdown_connections 2019-11-28T11:26:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.715+0000 7fe3aac37700 1 -- 172.21.15.80:0/2551010740 wait complete. 2019-11-28T11:26:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.715+0000 7fe3aac37700 1 -- 172.21.15.80:0/2551010740 >> 172.21.15.80:0/2551010740 conn(0x7fe3a4061cf0 msgr2=0x7fe3a4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.718+0000 7fe3aac37700 1 Processor -- start 2019-11-28T11:26:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.718+0000 7fe3aac37700 1 -- start start 2019-11-28T11:26:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3aac37700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a4115970 0x7fe3a4153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3aac37700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3a4116d70 0x7fe3a4152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3aac37700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a4079c30 con 0x7fe3a41536d0 2019-11-28T11:26:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3aac37700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a4079960 con 0x7fe3a4116d70 2019-11-28T11:26:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3aac37700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a4079320 con 0x7fe3a4115970 2019-11-28T11:26:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3a99d5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3a4116d70 0x7fe3a4152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3a89d3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe3a41536d0 0x7fe3a4152010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60392/0 (socket says 172.21.15.80:60392) 2019-11-28T11:26:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3a99d5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3a4116d70 0x7fe3a4152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32848/0 (socket says 172.21.15.80:32848) 2019-11-28T11:26:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3a89d3700 1 -- 172.21.15.80:0/495856373 learned_addr learned my addr 172.21.15.80:0/495856373 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3a91d4700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a4115970 0x7fe3a4153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3a99d5700 1 -- 172.21.15.80:0/495856373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a4115970 msgr2=0x7fe3a4153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3a99d5700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a4115970 0x7fe3a4153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3a99d5700 1 -- 172.21.15.80:0/495856373 >> v1:172.21.15.80:6789/0 conn(0x7fe3a41536d0 legacy=0x7fe3a4152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3a99d5700 1 -- 172.21.15.80:0/495856373 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a407acf0 con 0x7fe3a4116d70 2019-11-28T11:26:21.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3a1ffb700 1 -- 172.21.15.80:0/495856373 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211954633 0 0) 0x7fe394007da0 con 0x7fe3a41536d0 2019-11-28T11:26:21.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3a99d5700 1 --2- 172.21.15.80:0/495856373 >> v2:172.21.15.80:3300/0 conn(0x7fe3a4116d70 0x7fe3a4152810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe39c010370 tx=0x7fe39c0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3a99d5700 1 --2- 172.21.15.80:0/495856373 >> v2:172.21.15.80:3300/0 conn(0x7fe3a4116d70 0x7fe3a4152810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe39c010370 tx=0x7fe39c0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3a99d5700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a4116d70 0x7fe3a4152810 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7fe39c010370 tx=0x7fe39c0101a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:21.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3a99d5700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a4116d70 0x7fe3a4152810 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7fe39c010370 tx=0x7fe39c0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.719+0000 7fe3a1ffb700 1 -- 172.21.15.80:0/495856373 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe39c000940 con 0x7fe3a4116d70 2019-11-28T11:26:21.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.720+0000 7fe3a99d5700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a4116d70 0x7fe3a4152810 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7fe39c010370 tx=0x7fe39c0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.720+0000 7fe3a99d5700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a4116d70 0x7fe3a4152810 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7fe39c010370 tx=0x7fe39c0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.720+0000 7fe3a1ffb700 1 -- 172.21.15.80:0/495856373 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c0041c0 con 0x7fe3a4116d70 2019-11-28T11:26:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.720+0000 7fe3aac37700 1 -- 172.21.15.80:0/495856373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a407b070 con 0x7fe3a4116d70 2019-11-28T11:26:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.720+0000 7fe3a1ffb700 1 -- 172.21.15.80:0/495856373 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe39c001230 con 0x7fe3a4116d70 2019-11-28T11:26:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.720+0000 7fe3aac37700 1 -- 172.21.15.80:0/495856373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a407acf0 con 0x7fe3a4116d70 2019-11-28T11:26:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.720+0000 7fe3a99d5700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a4116d70 0x7fe3a4152810 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7fe39c010370 tx=0x7fe39c0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.720+0000 7fe3a1ffb700 1 -- 172.21.15.80:0/495856373 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe39c0043b0 con 0x7fe3a4116d70 2019-11-28T11:26:21.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.720+0000 7fe3a99d5700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a4116d70 0x7fe3a4152810 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7fe39c010370 tx=0x7fe39c0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.720+0000 7fe3a1ffb700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe388018730 0x7fe38801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:21.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.720+0000 7fe3a1ffb700 1 -- 172.21.15.80:0/495856373 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe39c031c10 con 0x7fe3a4116d70 2019-11-28T11:26:21.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.720+0000 7fe3a91d4700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe388018730 0x7fe38801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:21.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.721+0000 7fe3a91d4700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe388018730 0x7fe38801abc0 crc :-1 s=READY pgs=182 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:21.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.728+0000 7fe3aac37700 1 -- 172.21.15.80:0/495856373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a407b070 con 0x7fe3a4116d70 2019-11-28T11:26:21.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.731+0000 7fe3a99d5700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a4116d70 0x7fe3a4152810 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7fe39c010370 tx=0x7fe39c0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.731+0000 7fe3a1ffb700 1 -- 172.21.15.80:0/495856373 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe39c000e70 con 0x7fe3a4116d70 2019-11-28T11:26:21.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.908+0000 7fe3aac37700 1 -- 172.21.15.80:0/495856373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3a407acf0 con 0x7fe3a4116d70 2019-11-28T11:26:21.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.908+0000 7fe3a99d5700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a4116d70 0x7fe3a4152810 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7fe39c010370 tx=0x7fe39c0101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:21.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.908+0000 7fe3a1ffb700 1 -- 172.21.15.80:0/495856373 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2446 (secure 0 0 0) 0x7fe39c0041c0 con 0x7fe3a4116d70 2019-11-28T11:26:21.931 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2019-11-28T11:26:21.931 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:21.931 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:12.065616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:26:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.910+0000 7fe3aac37700 1 -- 172.21.15.80:0/495856373 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe388018730 msgr2=0x7fe38801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.910+0000 7fe3aac37700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe388018730 0x7fe38801abc0 crc :-1 s=READY pgs=182 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.910+0000 7fe3aac37700 1 -- 172.21.15.80:0/495856373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a4116d70 msgr2=0x7fe3a4152810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.910+0000 7fe3aac37700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a4116d70 0x7fe3a4152810 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7fe39c010370 tx=0x7fe39c0101a0).stop 2019-11-28T11:26:21.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.911+0000 7fe3aac37700 1 -- 172.21.15.80:0/495856373 shutdown_connections 2019-11-28T11:26:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.911+0000 7fe3aac37700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe388018730 0x7fe38801abc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.911+0000 7fe3aac37700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a4116d70 0x7fe3a4152810 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.911+0000 7fe3aac37700 1 --2- 172.21.15.80:0/495856373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a4115970 0x7fe3a4153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.911+0000 7fe3aac37700 1 -- 172.21.15.80:0/495856373 shutdown_connections 2019-11-28T11:26:21.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.911+0000 7fe3aac37700 1 -- 172.21.15.80:0/495856373 wait complete. 2019-11-28T11:26:21.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:21.911+0000 7fe3aac37700 1 -- 172.21.15.80:0/495856373 >> 172.21.15.80:0/495856373 conn(0x7fe3a41129c0 msgr2=0x7fe3a4112db0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:21.945 INFO:teuthology.orchestra.run.smithi080:> sudo iptables -A OUTPUT -p tcp --sport 6834 -j REJECT -m comment --comment teuthology 2019-11-28T11:26:22.050 INFO:teuthology.orchestra.run.smithi080:> sudo iptables -A INPUT -p tcp --dport 6834 -j REJECT -m comment --comment teuthology 2019-11-28T11:26:22.107 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:26:22.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.210+0000 7f04e8191700 1 Processor -- start 2019-11-28T11:26:22.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.210+0000 7f04e8191700 1 -- start start 2019-11-28T11:26:22.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.211+0000 7f04e8191700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f04e006c490 0x7f04e006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:22.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.211+0000 7f04e8191700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e006db00 con 0x7f04e006c0a0 2019-11-28T11:26:22.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.211+0000 7f04e8191700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e006e000 con 0x7f04e006ce60 2019-11-28T11:26:22.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.211+0000 7f04e8191700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e006fd60 con 0x7f04e006c490 2019-11-28T11:26:22.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.211+0000 7f04e672e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f04e006c0a0 0x7f04e0072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60400/0 (socket says 172.21.15.80:60400) 2019-11-28T11:26:22.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.211+0000 7f04e672e700 1 -- 172.21.15.80:0/2361992924 learned_addr learned my addr 172.21.15.80:0/2361992924 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:22.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.211+0000 7f04e5f2d700 1 --2- 172.21.15.80:0/2361992924 >> v2:172.21.15.174:3300/0 conn(0x7f04e006c490 0x7f04e006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:22.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e572c700 1 -- 172.21.15.80:0/2361992924 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852888850 0 0) 0x7f04dc0014d0 con 0x7f04e006c0a0 2019-11-28T11:26:22.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e572c700 1 -- 172.21.15.80:0/2361992924 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04cc002e80 con 0x7f04e006c0a0 2019-11-28T11:26:22.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e572c700 1 -- 172.21.15.80:0/2361992924 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604278575 0 0) 0x7f04d8001080 con 0x7f04e006ce60 2019-11-28T11:26:22.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e572c700 1 -- 172.21.15.80:0/2361992924 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04cc0030b0 con 0x7f04e006ce60 2019-11-28T11:26:22.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e572c700 1 -- 172.21.15.80:0/2361992924 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4171071817 0 0) 0x7f04dc0014b0 con 0x7f04e006c0a0 2019-11-28T11:26:22.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e5f2d700 1 -- 172.21.15.80:0/2361992924 >> v1:172.21.15.174:6789/0 conn(0x7f04e006ce60 legacy=0x7f04e0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:22.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e5f2d700 1 -- 172.21.15.80:0/2361992924 >> v1:172.21.15.80:6789/0 conn(0x7f04e006c0a0 legacy=0x7f04e0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:22.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e5f2d700 1 -- 172.21.15.80:0/2361992924 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e00706c0 con 0x7f04e006c490 2019-11-28T11:26:22.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e5f2d700 1 --2- 172.21.15.80:0/2361992924 >> v2:172.21.15.174:3300/0 conn(0x7f04e006c490 0x7f04e006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f04d000af50 tx=0x7f04d000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e5f2d700 1 --2- 172.21.15.80:0/2361992924 >> v2:172.21.15.174:3300/0 conn(0x7f04e006c490 0x7f04e006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f04d000af50 tx=0x7f04d000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e5f2d700 1 --2- 172.21.15.80:0/2361992924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04e006c490 0x7f04e006c920 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7f04d000af50 tx=0x7f04d000b760).ready entity=mon.1 client_cookie=528c9082ca962a24 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:22.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e5f2d700 1 --2- 172.21.15.80:0/2361992924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04e006c490 0x7f04e006c920 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f04d000af50 tx=0x7f04d000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e572c700 1 -- 172.21.15.80:0/2361992924 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d0000960 con 0x7f04e006c490 2019-11-28T11:26:22.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e5f2d700 1 --2- 172.21.15.80:0/2361992924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04e006c490 0x7f04e006c920 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f04d000af50 tx=0x7f04d000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e5f2d700 1 --2- 172.21.15.80:0/2361992924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04e006c490 0x7f04e006c920 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f04d000af50 tx=0x7f04d000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e572c700 1 -- 172.21.15.80:0/2361992924 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d0009860 con 0x7f04e006c490 2019-11-28T11:26:22.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e572c700 1 -- 172.21.15.80:0/2361992924 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d0000960 con 0x7f04e006c490 2019-11-28T11:26:22.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e8191700 1 -- 172.21.15.80:0/2361992924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04e006c490 msgr2=0x7f04e006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:22.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.212+0000 7f04e8191700 1 --2- 172.21.15.80:0/2361992924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04e006c490 0x7f04e006c920 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7f04d000af50 tx=0x7f04d000b760).stop 2019-11-28T11:26:22.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.213+0000 7f04e8191700 1 -- 172.21.15.80:0/2361992924 shutdown_connections 2019-11-28T11:26:22.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.213+0000 7f04e8191700 1 --2- 172.21.15.80:0/2361992924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04e006c490 0x7f04e006c920 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:22.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.213+0000 7f04e8191700 1 -- 172.21.15.80:0/2361992924 shutdown_connections 2019-11-28T11:26:22.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.213+0000 7f04e8191700 1 -- 172.21.15.80:0/2361992924 wait complete. 2019-11-28T11:26:22.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.213+0000 7f04e8191700 1 -- 172.21.15.80:0/2361992924 >> 172.21.15.80:0/2361992924 conn(0x7f04e0061cf0 msgr2=0x7f04e0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:22.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.215+0000 7f04e8191700 1 Processor -- start 2019-11-28T11:26:22.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.215+0000 7f04e8191700 1 -- start start 2019-11-28T11:26:22.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.216+0000 7f04e8191700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f04e012cea0 0x7f04e0111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:22.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.216+0000 7f04e8191700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e0124260 con 0x7f04e01230e0 2019-11-28T11:26:22.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.216+0000 7f04e8191700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e012e5d0 con 0x7f04e0165a00 2019-11-28T11:26:22.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.216+0000 7f04e8191700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e0121040 con 0x7f04e012cea0 2019-11-28T11:26:22.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.216+0000 7f04e672e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f04e012cea0 0x7f04e0111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:22.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.216+0000 7f04e5f2d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f04e01230e0 0x7f04e0123570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60408/0 (socket says 172.21.15.80:60408) 2019-11-28T11:26:22.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.216+0000 7f04e5f2d700 1 -- 172.21.15.80:0/1777636936 learned_addr learned my addr 172.21.15.80:0/1777636936 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:22.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04d6ffd700 1 -- 172.21.15.80:0/1777636936 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069037467 0 0) 0x7f04d000abb0 con 0x7f04e01230e0 2019-11-28T11:26:22.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04d6ffd700 1 -- 172.21.15.80:0/1777636936 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04c8002e80 con 0x7f04e01230e0 2019-11-28T11:26:22.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04d6ffd700 1 -- 172.21.15.80:0/1777636936 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037941392 0 0) 0x7f04d8001050 con 0x7f04e0165a00 2019-11-28T11:26:22.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04d6ffd700 1 -- 172.21.15.80:0/1777636936 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04c80030b0 con 0x7f04e0165a00 2019-11-28T11:26:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04e672e700 1 -- 172.21.15.80:0/1777636936 >> v1:172.21.15.174:6789/0 conn(0x7f04e0165a00 legacy=0x7f04e0167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04e672e700 1 -- 172.21.15.80:0/1777636936 >> v1:172.21.15.80:6789/0 conn(0x7f04e01230e0 legacy=0x7f04e0123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04e672e700 1 -- 172.21.15.80:0/1777636936 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e01219a0 con 0x7f04e012cea0 2019-11-28T11:26:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04e672e700 1 --2- 172.21.15.80:0/1777636936 >> v2:172.21.15.80:3300/0 conn(0x7f04e012cea0 0x7f04e0111db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f04dc010720 tx=0x7f04dc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04e672e700 1 --2- 172.21.15.80:0/1777636936 >> v2:172.21.15.80:3300/0 conn(0x7f04e012cea0 0x7f04e0111db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f04dc010720 tx=0x7f04dc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04e672e700 1 --2- 172.21.15.80:0/1777636936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04e012cea0 0x7f04e0111db0 secure :-1 s=READY pgs=422 cs=0 l=1 rx=0x7f04dc010720 tx=0x7f04dc010ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:22.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04e672e700 1 --2- 172.21.15.80:0/1777636936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04e012cea0 0x7f04e0111db0 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7f04dc010720 tx=0x7f04dc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04d6ffd700 1 -- 172.21.15.80:0/1777636936 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04dc001010 con 0x7f04e012cea0 2019-11-28T11:26:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04e672e700 1 --2- 172.21.15.80:0/1777636936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04e012cea0 0x7f04e0111db0 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7f04dc010720 tx=0x7f04dc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04e672e700 1 --2- 172.21.15.80:0/1777636936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04e012cea0 0x7f04e0111db0 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7f04dc010720 tx=0x7f04dc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04d6ffd700 1 -- 172.21.15.80:0/1777636936 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04dc0017f0 con 0x7f04e012cea0 2019-11-28T11:26:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04e8191700 1 -- 172.21.15.80:0/1777636936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e0121d20 con 0x7f04e012cea0 2019-11-28T11:26:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04d6ffd700 1 -- 172.21.15.80:0/1777636936 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04dc001f40 con 0x7f04e012cea0 2019-11-28T11:26:22.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04e8191700 1 -- 172.21.15.80:0/1777636936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e01122f0 con 0x7f04e012cea0 2019-11-28T11:26:22.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.217+0000 7f04e672e700 1 --2- 172.21.15.80:0/1777636936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04e012cea0 0x7f04e0111db0 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7f04dc010720 tx=0x7f04dc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.218+0000 7f04d6ffd700 1 -- 172.21.15.80:0/1777636936 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f04dc001430 con 0x7f04e012cea0 2019-11-28T11:26:22.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.218+0000 7f04e672e700 1 --2- 172.21.15.80:0/1777636936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04e012cea0 0x7f04e0111db0 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7f04dc010720 tx=0x7f04dc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.218+0000 7f04d6ffd700 1 --2- 172.21.15.80:0/1777636936 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f04c8018750 0x7f04c801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:22.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.218+0000 7f04d6ffd700 1 -- 172.21.15.80:0/1777636936 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f04dc031e70 con 0x7f04e012cea0 2019-11-28T11:26:22.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.218+0000 7f04e5f2d700 1 --2- 172.21.15.80:0/1777636936 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f04c8018750 0x7f04c801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:22.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.218+0000 7f04e5f2d700 1 --2- 172.21.15.80:0/1777636936 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f04c8018750 0x7f04c801abe0 crc :-1 s=READY pgs=183 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:22.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.225+0000 7f04e8191700 1 -- 172.21.15.80:0/1777636936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e01219a0 con 0x7f04e012cea0 2019-11-28T11:26:22.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.229+0000 7f04e672e700 1 --2- 172.21.15.80:0/1777636936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04e012cea0 0x7f04e0111db0 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7f04dc010720 tx=0x7f04dc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.229+0000 7f04d6ffd700 1 -- 172.21.15.80:0/1777636936 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f04dc02e010 con 0x7f04e012cea0 2019-11-28T11:26:22.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.401+0000 7f04e8191700 1 -- 172.21.15.80:0/1777636936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04e0121d20 con 0x7f04e012cea0 2019-11-28T11:26:22.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.401+0000 7f04e672e700 1 --2- 172.21.15.80:0/1777636936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04e012cea0 0x7f04e0111db0 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7f04dc010720 tx=0x7f04dc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.401+0000 7f04d6ffd700 1 -- 172.21.15.80:0/1777636936 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2446 (secure 0 0 0) 0x7f04dc02e010 con 0x7f04e012cea0 2019-11-28T11:26:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2019-11-28T11:26:22.424 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:22.424 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:12.065616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:26:22.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.404+0000 7f04e8191700 1 -- 172.21.15.80:0/1777636936 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f04c8018750 msgr2=0x7f04c801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:22.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.404+0000 7f04e8191700 1 --2- 172.21.15.80:0/1777636936 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f04c8018750 0x7f04c801abe0 crc :-1 s=READY pgs=183 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:22.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.404+0000 7f04e8191700 1 -- 172.21.15.80:0/1777636936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04e012cea0 msgr2=0x7f04e0111db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:22.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.404+0000 7f04e8191700 1 --2- 172.21.15.80:0/1777636936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04e012cea0 0x7f04e0111db0 secure :-1 s=READY pgs=422 cs=0 l=1 rx=0x7f04dc010720 tx=0x7f04dc010ac0).stop 2019-11-28T11:26:22.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.404+0000 7f04e8191700 1 -- 172.21.15.80:0/1777636936 shutdown_connections 2019-11-28T11:26:22.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.404+0000 7f04e8191700 1 --2- 172.21.15.80:0/1777636936 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f04c8018750 0x7f04c801abe0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:22.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.404+0000 7f04e8191700 1 --2- 172.21.15.80:0/1777636936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04e012cea0 0x7f04e0111db0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:22.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.404+0000 7f04e8191700 1 -- 172.21.15.80:0/1777636936 shutdown_connections 2019-11-28T11:26:22.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.404+0000 7f04e8191700 1 -- 172.21.15.80:0/1777636936 wait complete. 2019-11-28T11:26:22.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.404+0000 7f04e8191700 1 -- 172.21.15.80:0/1777636936 >> 172.21.15.80:0/1777636936 conn(0x7f04e01426c0 msgr2=0x7f04e0110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:22.435 INFO:teuthology.orchestra.run.smithi080:> sudo iptables -A OUTPUT -p tcp --sport 6835 -j REJECT -m comment --comment teuthology 2019-11-28T11:26:22.493 INFO:teuthology.orchestra.run.smithi080:> sudo iptables -A INPUT -p tcp --dport 6835 -j REJECT -m comment --comment teuthology 2019-11-28T11:26:22.638 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits daemon-helper kill python -c ' 2019-11-28T11:26:22.638 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:26:22.638 INFO:teuthology.orchestra.run.smithi076:> import time 2019-11-28T11:26:22.639 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:26:22.639 INFO:teuthology.orchestra.run.smithi076:> fd = os.open("/home/ubuntu/cephtest/mnt.0/background_file", os.O_RDWR | os.O_CREAT, 0644) 2019-11-28T11:26:22.639 INFO:teuthology.orchestra.run.smithi076:> try: 2019-11-28T11:26:22.639 INFO:teuthology.orchestra.run.smithi076:> while True: 2019-11-28T11:26:22.639 INFO:teuthology.orchestra.run.smithi076:> os.write(fd, '"'"'content'"'"') 2019-11-28T11:26:22.639 INFO:teuthology.orchestra.run.smithi076:> time.sleep(1) 2019-11-28T11:26:22.639 INFO:teuthology.orchestra.run.smithi076:> if not False: 2019-11-28T11:26:22.640 INFO:teuthology.orchestra.run.smithi076:> break 2019-11-28T11:26:22.640 INFO:teuthology.orchestra.run.smithi076:> except IOError, e: 2019-11-28T11:26:22.640 INFO:teuthology.orchestra.run.smithi076:> pass 2019-11-28T11:26:22.640 INFO:teuthology.orchestra.run.smithi076:> os.close(fd) 2019-11-28T11:26:22.640 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:26:22.766 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:26:22.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.876+0000 7ff816ee7700 1 Processor -- start 2019-11-28T11:26:22.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.876+0000 7ff816ee7700 1 -- start start 2019-11-28T11:26:22.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.877+0000 7ff816ee7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff81006c0a0 0x7ff810072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:22.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.877+0000 7ff816ee7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff810072620 0x7ff810164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:26:22.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.877+0000 7ff816ee7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff81006db00 con 0x7ff8100734e0 2019-11-28T11:26:22.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.877+0000 7ff816ee7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81006f330 con 0x7ff810072620 2019-11-28T11:26:22.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.877+0000 7ff816ee7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8100706c0 con 0x7ff81006c0a0 2019-11-28T11:26:22.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.877+0000 7ff815c85700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff810072620 0x7ff810164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:22.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.877+0000 7ff814c83700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff8100734e0 0x7ff810071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60418/0 (socket says 172.21.15.80:60418) 2019-11-28T11:26:22.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.877+0000 7ff814c83700 1 -- 172.21.15.80:0/3144454142 learned_addr learned my addr 172.21.15.80:0/3144454142 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:26:22.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff815484700 1 --2- 172.21.15.80:0/3144454142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff81006c0a0 0x7ff810072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:22.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff815c85700 1 -- 172.21.15.80:0/3144454142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff81006c0a0 msgr2=0x7ff810072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:26:22.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff815c85700 1 --2- 172.21.15.80:0/3144454142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff81006c0a0 0x7ff810072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:22.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff815c85700 1 -- 172.21.15.80:0/3144454142 >> v1:172.21.15.80:6789/0 conn(0x7ff8100734e0 legacy=0x7ff810071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:22.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff815c85700 1 -- 172.21.15.80:0/3144454142 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff810070a40 con 0x7ff810072620 2019-11-28T11:26:22.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff80ffff700 1 -- 172.21.15.80:0/3144454142 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777737884 0 0) 0x7ff7f80013f0 con 0x7ff8100734e0 2019-11-28T11:26:22.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff815484700 1 --2- 172.21.15.80:0/3144454142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff81006c0a0 0x7ff810072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:26:22.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff815c85700 1 --2- 172.21.15.80:0/3144454142 >> v2:172.21.15.80:3300/0 conn(0x7ff810072620 0x7ff810164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff80800af50 tx=0x7ff80800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff815c85700 1 --2- 172.21.15.80:0/3144454142 >> v2:172.21.15.80:3300/0 conn(0x7ff810072620 0x7ff810164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff80800af50 tx=0x7ff80800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff815c85700 1 --2- 172.21.15.80:0/3144454142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff810072620 0x7ff810164d70 secure :-1 s=READY pgs=424 cs=0 l=1 rx=0x7ff80800af50 tx=0x7ff80800b760).ready entity=mon.0 client_cookie=cbae645b1dc6f4b8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:22.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff815c85700 1 --2- 172.21.15.80:0/3144454142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff810072620 0x7ff810164d70 secure :-1 s=THROTTLE_DONE pgs=424 cs=0 l=1 rx=0x7ff80800af50 tx=0x7ff80800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff80ffff700 1 -- 172.21.15.80:0/3144454142 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff808009ba0 con 0x7ff810072620 2019-11-28T11:26:22.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff815c85700 1 --2- 172.21.15.80:0/3144454142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff810072620 0x7ff810164d70 secure :-1 s=THROTTLE_DONE pgs=424 cs=0 l=1 rx=0x7ff80800af50 tx=0x7ff80800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff815c85700 1 --2- 172.21.15.80:0/3144454142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff810072620 0x7ff810164d70 secure :-1 s=THROTTLE_DONE pgs=424 cs=0 l=1 rx=0x7ff80800af50 tx=0x7ff80800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff80ffff700 1 -- 172.21.15.80:0/3144454142 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8080097c0 con 0x7ff810072620 2019-11-28T11:26:22.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff80ffff700 1 -- 172.21.15.80:0/3144454142 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff808000bc0 con 0x7ff810072620 2019-11-28T11:26:22.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff816ee7700 1 -- 172.21.15.80:0/3144454142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff810072620 msgr2=0x7ff810164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:22.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.878+0000 7ff816ee7700 1 --2- 172.21.15.80:0/3144454142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff810072620 0x7ff810164d70 secure :-1 s=READY pgs=424 cs=0 l=1 rx=0x7ff80800af50 tx=0x7ff80800b760).stop 2019-11-28T11:26:22.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.879+0000 7ff816ee7700 1 -- 172.21.15.80:0/3144454142 shutdown_connections 2019-11-28T11:26:22.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.879+0000 7ff816ee7700 1 --2- 172.21.15.80:0/3144454142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff810072620 0x7ff810164d70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:22.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.879+0000 7ff816ee7700 1 --2- 172.21.15.80:0/3144454142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff81006c0a0 0x7ff810072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:26:22.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.879+0000 7ff816ee7700 1 -- 172.21.15.80:0/3144454142 shutdown_connections 2019-11-28T11:26:22.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.879+0000 7ff816ee7700 1 -- 172.21.15.80:0/3144454142 wait complete. 2019-11-28T11:26:22.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.879+0000 7ff816ee7700 1 -- 172.21.15.80:0/3144454142 >> 172.21.15.80:0/3144454142 conn(0x7ff810061cf0 msgr2=0x7ff810064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:22.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.881+0000 7ff816ee7700 1 Processor -- start 2019-11-28T11:26:22.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.881+0000 7ff816ee7700 1 -- start start 2019-11-28T11:26:22.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.882+0000 7ff816ee7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff810104c10 0x7ff8101050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:22.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.882+0000 7ff816ee7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8101055e0 0x7ff810167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:22.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.882+0000 7ff816ee7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff810105a30 con 0x7ff810104820 2019-11-28T11:26:22.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.882+0000 7ff816ee7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff810109130 con 0x7ff8101055e0 2019-11-28T11:26:22.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.882+0000 7ff816ee7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff810109400 con 0x7ff810104c10 2019-11-28T11:26:22.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff815c85700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8101055e0 0x7ff810167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:22.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff815c85700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8101055e0 0x7ff810167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32876/0 (socket says 172.21.15.80:32876) 2019-11-28T11:26:22.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff815c85700 1 -- 172.21.15.80:0/3826296642 learned_addr learned my addr 172.21.15.80:0/3826296642 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:26:22.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff814c83700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff810104c10 0x7ff8101050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:22.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff815c85700 1 -- 172.21.15.80:0/3826296642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff810104c10 msgr2=0x7ff8101050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:22.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff815c85700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff810104c10 0x7ff8101050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:22.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff815c85700 1 -- 172.21.15.80:0/3826296642 >> v1:172.21.15.174:6789/0 conn(0x7ff810104820 legacy=0x7ff81010c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:22.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff815c85700 1 -- 172.21.15.80:0/3826296642 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff810109a90 con 0x7ff8101055e0 2019-11-28T11:26:22.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff814c83700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff810104c10 0x7ff8101050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:26:22.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff815c85700 1 --2- 172.21.15.80:0/3826296642 >> v2:172.21.15.80:3300/0 conn(0x7ff8101055e0 0x7ff810167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff808010440 tx=0x7ff8080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff815c85700 1 --2- 172.21.15.80:0/3826296642 >> v2:172.21.15.80:3300/0 conn(0x7ff8101055e0 0x7ff810167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff808010440 tx=0x7ff8080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff815c85700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8101055e0 0x7ff810167a10 secure :-1 s=READY pgs=425 cs=0 l=1 rx=0x7ff808010440 tx=0x7ff8080107e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:22.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff815c85700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8101055e0 0x7ff810167a10 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7ff808010440 tx=0x7ff8080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff80dffb700 1 -- 172.21.15.80:0/3826296642 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff808009790 con 0x7ff8101055e0 2019-11-28T11:26:22.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff815c85700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8101055e0 0x7ff810167a10 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7ff808010440 tx=0x7ff8080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff815c85700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8101055e0 0x7ff810167a10 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7ff808010440 tx=0x7ff8080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff80dffb700 1 -- 172.21.15.80:0/3826296642 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff808000940 con 0x7ff8101055e0 2019-11-28T11:26:22.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff816ee7700 1 -- 172.21.15.80:0/3826296642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff810109e10 con 0x7ff8101055e0 2019-11-28T11:26:22.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff80dffb700 1 -- 172.21.15.80:0/3826296642 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff808009d70 con 0x7ff8101055e0 2019-11-28T11:26:22.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff816ee7700 1 -- 172.21.15.80:0/3826296642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff810109a90 con 0x7ff8101055e0 2019-11-28T11:26:22.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.883+0000 7ff815c85700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8101055e0 0x7ff810167a10 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7ff808010440 tx=0x7ff8080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.884+0000 7ff80dffb700 1 -- 172.21.15.80:0/3826296642 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff808009790 con 0x7ff8101055e0 2019-11-28T11:26:22.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.884+0000 7ff815c85700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8101055e0 0x7ff810167a10 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7ff808010440 tx=0x7ff8080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.884+0000 7ff80dffb700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7f4018730 0x7ff7f401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:26:22.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.884+0000 7ff80dffb700 1 -- 172.21.15.80:0/3826296642 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff808031ac0 con 0x7ff8101055e0 2019-11-28T11:26:22.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.884+0000 7ff815484700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7f4018730 0x7ff7f401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:26:22.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.884+0000 7ff815484700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7f4018730 0x7ff7f401abc0 crc :-1 s=READY pgs=184 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:26:22.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.892+0000 7ff816ee7700 1 -- 172.21.15.80:0/3826296642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff810109e10 con 0x7ff8101055e0 2019-11-28T11:26:22.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.895+0000 7ff815c85700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8101055e0 0x7ff810167a10 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7ff808010440 tx=0x7ff8080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:22.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:22.895+0000 7ff80dffb700 1 -- 172.21.15.80:0/3826296642 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff808009580 con 0x7ff8101055e0 2019-11-28T11:26:23.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:23.067+0000 7ff816ee7700 1 -- 172.21.15.80:0/3826296642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff810109a90 con 0x7ff8101055e0 2019-11-28T11:26:23.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:23.068+0000 7ff815c85700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8101055e0 0x7ff810167a10 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7ff808010440 tx=0x7ff8080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:26:23.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:23.068+0000 7ff80dffb700 1 -- 172.21.15.80:0/3826296642 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2446 (secure 0 0 0) 0x7ff808009790 con 0x7ff8101055e0 2019-11-28T11:26:23.095 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2019-11-28T11:26:23.096 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:26:23.096 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:12.065616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:26:23.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:23.070+0000 7ff816ee7700 1 -- 172.21.15.80:0/3826296642 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7f4018730 msgr2=0x7ff7f401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:23.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:23.070+0000 7ff816ee7700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7f4018730 0x7ff7f401abc0 crc :-1 s=READY pgs=184 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:23.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:23.070+0000 7ff816ee7700 1 -- 172.21.15.80:0/3826296642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8101055e0 msgr2=0x7ff810167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:26:23.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:23.070+0000 7ff816ee7700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8101055e0 0x7ff810167a10 secure :-1 s=READY pgs=425 cs=0 l=1 rx=0x7ff808010440 tx=0x7ff8080107e0).stop 2019-11-28T11:26:23.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:23.070+0000 7ff816ee7700 1 -- 172.21.15.80:0/3826296642 shutdown_connections 2019-11-28T11:26:23.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:23.070+0000 7ff816ee7700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8101055e0 0x7ff810167a10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:23.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:23.070+0000 7ff816ee7700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff810104c10 0x7ff8101050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:23.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:23.070+0000 7ff816ee7700 1 --2- 172.21.15.80:0/3826296642 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7f4018730 0x7ff7f401abc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:26:23.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:23.070+0000 7ff816ee7700 1 -- 172.21.15.80:0/3826296642 shutdown_connections 2019-11-28T11:26:23.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:23.070+0000 7ff816ee7700 1 -- 172.21.15.80:0/3826296642 wait complete. 2019-11-28T11:26:23.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:26:23.070+0000 7ff816ee7700 1 -- 172.21.15.80:0/3826296642 >> 172.21.15.80:0/3826296642 conn(0x7ff81013d620 msgr2=0x7ff81013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:26:23.102 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session ls 2019-11-28T11:26:23.256 INFO:teuthology.orchestra.run.smithi174.stdout:[ 2019-11-28T11:26:23.257 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:26:23.257 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 4676, 2019-11-28T11:26:23.257 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:26:23.257 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:26:23.257 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:26:23.258 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 4676 2019-11-28T11:26:23.258 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:23.258 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:26:23.258 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:26:23.258 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.76:0", 2019-11-28T11:26:23.259 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 1347691556 2019-11-28T11:26:23.259 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:26:23.259 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:23.259 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:26:23.259 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 3, 2019-11-28T11:26:23.259 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 4, 2019-11-28T11:26:23.259 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 5, 2019-11-28T11:26:23.260 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 7.1709559470000004, 2019-11-28T11:26:23.260 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:26:23.260 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 2, 2019-11-28T11:26:23.260 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:26:23.260 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:26:23.260 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:26:23.260 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:26:23.261 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:23.261 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:26:23.261 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:26:23.261 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:26:23.261 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:23.261 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:26:23.261 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:26:23.262 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:26:23.262 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:23.262 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:26:23.262 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:26:23.262 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:26:23.263 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:23.263 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:26:23.263 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 9.9379298336954811, 2019-11-28T11:26:23.263 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:26:23.263 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:23.264 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.4676 v1:172.21.15.76:0/1347691556", 2019-11-28T11:26:23.264 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [ 2019-11-28T11:26:23.264 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:26:23.264 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 5, 2019-11-28T11:26:23.265 INFO:teuthology.orchestra.run.smithi174.stdout: "created_ino": "0x10000000001" 2019-11-28T11:26:23.265 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:26:23.265 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:26:23.265 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 6, 2019-11-28T11:26:23.266 INFO:teuthology.orchestra.run.smithi174.stdout: "created_ino": "0x10000000002" 2019-11-28T11:26:23.266 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:26:23.266 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2019-11-28T11:26:23.266 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [ 2019-11-28T11:26:23.267 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:26:23.267 INFO:teuthology.orchestra.run.smithi174.stdout: "start": 1099511627779, 2019-11-28T11:26:23.267 INFO:teuthology.orchestra.run.smithi174.stdout: "length": 998 2019-11-28T11:26:23.267 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:26:23.267 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2019-11-28T11:26:23.268 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:26:23.268 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:26:23.268 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:26:23.268 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "0", 2019-11-28T11:26:23.268 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi076", 2019-11-28T11:26:23.268 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:26:23.268 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:26:23.269 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:26:23.269 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:26:23.269 INFO:teuthology.orchestra.run.smithi174.stdout:] 2019-11-28T11:26:23.270 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 4676, "entity": { "name": { "type": "client", "num": 4676 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 1347691556 } }, "state": "open", "num_leases": 3, "num_caps": 4, "request_load_avg": 5, "uptime": 7.1709559470000004, "requests_in_flight": 0, "completed_requests": 2, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 9.9379298336954811, "halflife": 300 }, "inst": "client.4676 v1:172.21.15.76:0/1347691556", "completed_requests": [ { "tid": 5, "created_ino": "0x10000000001" }, { "tid": 6, "created_ino": "0x10000000002" } ], "prealloc_inos": [ { "start": 1099511627779, "length": 998 } ], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:26:48.007 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:26:48.021 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:26:48.027 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:26:48.032 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:26:48.036 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:26:48.040 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:27:18.153 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:27:18.158 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:27:18.162 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:27:18.166 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:27:18.170 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:27:18.174 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:27:48.284 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:27:48.289 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:27:48.294 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:27:48.304 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:27:48.308 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:27:48.313 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:27:53.372 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:27:53.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.480+0000 7f1f3f148700 1 Processor -- start 2019-11-28T11:27:53.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.480+0000 7f1f3f148700 1 -- start start 2019-11-28T11:27:53.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.481+0000 7f1f3f148700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f3806c0a0 0x7f1f38072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:27:53.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.481+0000 7f1f3f148700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1f38072620 0x7f1f38164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:27:53.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.481+0000 7f1f3f148700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3806db00 con 0x7f1f380734e0 2019-11-28T11:27:53.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.481+0000 7f1f3f148700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3806f330 con 0x7f1f38072620 2019-11-28T11:27:53.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.481+0000 7f1f3f148700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380706c0 con 0x7f1f3806c0a0 2019-11-28T11:27:53.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.481+0000 7f1f3cee4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1f380734e0 0x7f1f38071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60428/0 (socket says 172.21.15.80:60428) 2019-11-28T11:27:53.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.481+0000 7f1f3cee4700 1 -- 172.21.15.80:0/4078768538 learned_addr learned my addr 172.21.15.80:0/4078768538 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:27:53.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.481+0000 7f1f3dee6700 1 --2- 172.21.15.80:0/4078768538 >> v2:172.21.15.174:3300/0 conn(0x7f1f38072620 0x7f1f38164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:27:53.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.481+0000 7f1f3d6e5700 1 --2- 172.21.15.80:0/4078768538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f3806c0a0 0x7f1f38072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:27:53.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.481+0000 7f1f37fff700 1 -- 172.21.15.80:0/4078768538 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145191576 0 0) 0x7f1f28001150 con 0x7f1f380734e0 2019-11-28T11:27:53.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.481+0000 7f1f37fff700 1 -- 172.21.15.80:0/4078768538 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f20002e80 con 0x7f1f380734e0 2019-11-28T11:27:53.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f37fff700 1 -- 172.21.15.80:0/4078768538 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3117549022 0 0) 0x7f1f28001130 con 0x7f1f380734e0 2019-11-28T11:27:53.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f3d6e5700 1 -- 172.21.15.80:0/4078768538 >> v2:172.21.15.174:3300/0 conn(0x7f1f38072620 msgr2=0x7f1f38164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:27:53.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f3d6e5700 1 --2- 172.21.15.80:0/4078768538 >> v2:172.21.15.174:3300/0 conn(0x7f1f38072620 0x7f1f38164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:27:53.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f3d6e5700 1 -- 172.21.15.80:0/4078768538 >> v1:172.21.15.80:6789/0 conn(0x7f1f380734e0 legacy=0x7f1f38071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:53.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f3d6e5700 1 -- 172.21.15.80:0/4078768538 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f38070a40 con 0x7f1f3806c0a0 2019-11-28T11:27:53.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f3dee6700 1 --2- 172.21.15.80:0/4078768538 >> v2:172.21.15.174:3300/0 conn(0x7f1f38072620 0x7f1f38164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:27:53.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f3d6e5700 1 --2- 172.21.15.80:0/4078768538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f3806c0a0 0x7f1f38072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1f2c00af50 tx=0x7f1f2c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f3d6e5700 1 --2- 172.21.15.80:0/4078768538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f3806c0a0 0x7f1f38072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1f2c00af50 tx=0x7f1f2c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f3d6e5700 1 --2- 172.21.15.80:0/4078768538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f3806c0a0 0x7f1f38072fa0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f1f2c00af50 tx=0x7f1f2c00b760).ready entity=mon.2 client_cookie=71a99298a10a266a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:27:53.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f3d6e5700 1 --2- 172.21.15.80:0/4078768538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f3806c0a0 0x7f1f38072fa0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f1f2c00af50 tx=0x7f1f2c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f37fff700 1 -- 172.21.15.80:0/4078768538 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f2c007210 con 0x7f1f3806c0a0 2019-11-28T11:27:53.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f3d6e5700 1 --2- 172.21.15.80:0/4078768538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f3806c0a0 0x7f1f38072fa0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f1f2c00af50 tx=0x7f1f2c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f3d6e5700 1 --2- 172.21.15.80:0/4078768538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f3806c0a0 0x7f1f38072fa0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f1f2c00af50 tx=0x7f1f2c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f37fff700 1 -- 172.21.15.80:0/4078768538 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c0099b0 con 0x7f1f3806c0a0 2019-11-28T11:27:53.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f37fff700 1 -- 172.21.15.80:0/4078768538 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f2c00a080 con 0x7f1f3806c0a0 2019-11-28T11:27:53.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f3f148700 1 -- 172.21.15.80:0/4078768538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f3806c0a0 msgr2=0x7f1f38072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:53.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.482+0000 7f1f3f148700 1 --2- 172.21.15.80:0/4078768538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f3806c0a0 0x7f1f38072fa0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f1f2c00af50 tx=0x7f1f2c00b760).stop 2019-11-28T11:27:53.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.483+0000 7f1f3f148700 1 -- 172.21.15.80:0/4078768538 shutdown_connections 2019-11-28T11:27:53.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.483+0000 7f1f3f148700 1 --2- 172.21.15.80:0/4078768538 >> v2:172.21.15.174:3300/0 conn(0x7f1f38072620 0x7f1f38164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:27:53.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.483+0000 7f1f3f148700 1 --2- 172.21.15.80:0/4078768538 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f3806c0a0 0x7f1f38072fa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:27:53.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.483+0000 7f1f3f148700 1 -- 172.21.15.80:0/4078768538 shutdown_connections 2019-11-28T11:27:53.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.483+0000 7f1f3f148700 1 -- 172.21.15.80:0/4078768538 wait complete. 2019-11-28T11:27:53.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.483+0000 7f1f3f148700 1 -- 172.21.15.80:0/4078768538 >> 172.21.15.80:0/4078768538 conn(0x7f1f38061cf0 msgr2=0x7f1f38064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:27:53.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.485+0000 7f1f3f148700 1 Processor -- start 2019-11-28T11:27:53.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.486+0000 7f1f3f148700 1 -- start start 2019-11-28T11:27:53.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f3f148700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1f38166a10 0x7f1f38168e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:27:53.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f3f148700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3813bcd0 con 0x7f1f38104c10 2019-11-28T11:27:53.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f3f148700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f38105ea0 con 0x7f1f38104820 2019-11-28T11:27:53.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f3f148700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f38109130 con 0x7f1f38166a10 2019-11-28T11:27:53.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f3cee4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1f38104c10 0x7f1f381050a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60436/0 (socket says 172.21.15.80:60436) 2019-11-28T11:27:53.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f3cee4700 1 -- 172.21.15.80:0/1657415988 learned_addr learned my addr 172.21.15.80:0/1657415988 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:27:53.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f3dee6700 1 --2- 172.21.15.80:0/1657415988 >> v2:172.21.15.174:3300/0 conn(0x7f1f38166a10 0x7f1f38168e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:27:53.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f35ffb700 1 -- 172.21.15.80:0/1657415988 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134582747 0 0) 0x7f1f28000fd0 con 0x7f1f38104c10 2019-11-28T11:27:53.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f35ffb700 1 -- 172.21.15.80:0/1657415988 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f18002e80 con 0x7f1f38104c10 2019-11-28T11:27:53.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f35ffb700 1 -- 172.21.15.80:0/1657415988 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626805780 0 0) 0x7f1f2c00b2e0 con 0x7f1f38104820 2019-11-28T11:27:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f35ffb700 1 -- 172.21.15.80:0/1657415988 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f180030b0 con 0x7f1f38104820 2019-11-28T11:27:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f35ffb700 1 -- 172.21.15.80:0/1657415988 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3533536388 0 0) 0x7f1f28000c90 con 0x7f1f38104c10 2019-11-28T11:27:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f35ffb700 1 -- 172.21.15.80:0/1657415988 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1f180033c0 con 0x7f1f38104c10 2019-11-28T11:27:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f35ffb700 1 -- 172.21.15.80:0/1657415988 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f1f28001890 con 0x7f1f38104c10 2019-11-28T11:27:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f3dee6700 1 -- 172.21.15.80:0/1657415988 >> v1:172.21.15.174:6789/0 conn(0x7f1f38104820 legacy=0x7f1f3810c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f3dee6700 1 -- 172.21.15.80:0/1657415988 >> v1:172.21.15.80:6789/0 conn(0x7f1f38104c10 legacy=0x7f1f381050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f3dee6700 1 -- 172.21.15.80:0/1657415988 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f38109a90 con 0x7f1f38166a10 2019-11-28T11:27:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f3dee6700 1 --2- 172.21.15.80:0/1657415988 >> v2:172.21.15.174:3300/0 conn(0x7f1f38166a10 0x7f1f38168e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f30010720 tx=0x7f1f30010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f3dee6700 1 --2- 172.21.15.80:0/1657415988 >> v2:172.21.15.174:3300/0 conn(0x7f1f38166a10 0x7f1f38168e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f30010720 tx=0x7f1f30010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.487+0000 7f1f3dee6700 1 --2- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f38166a10 0x7f1f38168e10 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7f1f30010720 tx=0x7f1f30010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:27:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.488+0000 7f1f3dee6700 1 --2- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f38166a10 0x7f1f38168e10 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f1f30010720 tx=0x7f1f30010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.488+0000 7f1f35ffb700 1 -- 172.21.15.80:0/1657415988 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f3000af10 con 0x7f1f38166a10 2019-11-28T11:27:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.488+0000 7f1f3dee6700 1 --2- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f38166a10 0x7f1f38168e10 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f1f30010720 tx=0x7f1f30010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.488+0000 7f1f35ffb700 1 -- 172.21.15.80:0/1657415988 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3000a9f0 con 0x7f1f38166a10 2019-11-28T11:27:53.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.488+0000 7f1f3dee6700 1 --2- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f38166a10 0x7f1f38168e10 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f1f30010720 tx=0x7f1f30010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.488+0000 7f1f3f148700 1 -- 172.21.15.80:0/1657415988 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f38109e10 con 0x7f1f38166a10 2019-11-28T11:27:53.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.488+0000 7f1f35ffb700 1 -- 172.21.15.80:0/1657415988 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f3000af10 con 0x7f1f38166a10 2019-11-28T11:27:53.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.488+0000 7f1f3f148700 1 -- 172.21.15.80:0/1657415988 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f38109a90 con 0x7f1f38166a10 2019-11-28T11:27:53.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.488+0000 7f1f3dee6700 1 --2- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f38166a10 0x7f1f38168e10 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f1f30010720 tx=0x7f1f30010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.488+0000 7f1f35ffb700 1 -- 172.21.15.80:0/1657415988 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1f30009930 con 0x7f1f38166a10 2019-11-28T11:27:53.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.488+0000 7f1f3dee6700 1 --2- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f38166a10 0x7f1f38168e10 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f1f30010720 tx=0x7f1f30010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.489+0000 7f1f35ffb700 1 --2- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f180187a0 0x7f1f1801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:27:53.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.489+0000 7f1f35ffb700 1 -- 172.21.15.80:0/1657415988 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1f30031dd0 con 0x7f1f38166a10 2019-11-28T11:27:53.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.489+0000 7f1f3d6e5700 1 --2- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f180187a0 0x7f1f1801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:27:53.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.489+0000 7f1f3d6e5700 1 --2- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f180187a0 0x7f1f1801abf0 crc :-1 s=READY pgs=185 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:27:53.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.495+0000 7f1f3f148700 1 -- 172.21.15.80:0/1657415988 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f38109e10 con 0x7f1f38166a10 2019-11-28T11:27:53.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.499+0000 7f1f3dee6700 1 --2- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f38166a10 0x7f1f38168e10 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f1f30010720 tx=0x7f1f30010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.499+0000 7f1f35ffb700 1 -- 172.21.15.80:0/1657415988 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1f30000df0 con 0x7f1f38166a10 2019-11-28T11:27:53.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.672+0000 7f1f3f148700 1 -- 172.21.15.80:0/1657415988 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f38109a90 con 0x7f1f38166a10 2019-11-28T11:27:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.673+0000 7f1f3dee6700 1 --2- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f38166a10 0x7f1f38168e10 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f1f30010720 tx=0x7f1f30010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.673+0000 7f1f35ffb700 1 -- 172.21.15.80:0/1657415988 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2446 (secure 0 0 0) 0x7f1f30017570 con 0x7f1f38166a10 2019-11-28T11:27:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2019-11-28T11:27:53.699 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:27:53.700 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:12.065616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:27:53.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.675+0000 7f1f3f148700 1 -- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f180187a0 msgr2=0x7f1f1801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:53.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.675+0000 7f1f3f148700 1 --2- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f180187a0 0x7f1f1801abf0 crc :-1 s=READY pgs=185 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:27:53.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.675+0000 7f1f3f148700 1 -- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f38166a10 msgr2=0x7f1f38168e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:53.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.675+0000 7f1f3f148700 1 --2- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f38166a10 0x7f1f38168e10 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7f1f30010720 tx=0x7f1f30010ac0).stop 2019-11-28T11:27:53.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.675+0000 7f1f3f148700 1 -- 172.21.15.80:0/1657415988 shutdown_connections 2019-11-28T11:27:53.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.675+0000 7f1f3f148700 1 --2- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f38166a10 0x7f1f38168e10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:27:53.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.675+0000 7f1f3f148700 1 --2- 172.21.15.80:0/1657415988 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f180187a0 0x7f1f1801abf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:27:53.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.675+0000 7f1f3f148700 1 -- 172.21.15.80:0/1657415988 shutdown_connections 2019-11-28T11:27:53.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.675+0000 7f1f3f148700 1 -- 172.21.15.80:0/1657415988 wait complete. 2019-11-28T11:27:53.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.675+0000 7f1f3f148700 1 -- 172.21.15.80:0/1657415988 >> 172.21.15.80:0/1657415988 conn(0x7f1f3813d620 msgr2=0x7f1f3813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:27:53.711 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session ls 2019-11-28T11:27:53.839 INFO:teuthology.orchestra.run.smithi174.stdout:[ 2019-11-28T11:27:53.839 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:27:53.839 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 4676, 2019-11-28T11:27:53.839 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:27:53.839 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:27:53.840 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:27:53.840 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 4676 2019-11-28T11:27:53.840 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:27:53.840 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:27:53.840 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:27:53.840 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.76:0", 2019-11-28T11:27:53.841 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 1347691556 2019-11-28T11:27:53.841 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:27:53.841 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:27:53.841 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "stale", 2019-11-28T11:27:53.841 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:27:53.841 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 4, 2019-11-28T11:27:53.842 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 0, 2019-11-28T11:27:53.842 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 97.753484620999998, 2019-11-28T11:27:53.842 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:27:53.842 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 2, 2019-11-28T11:27:53.842 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:27:53.842 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:27:53.843 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:27:53.843 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:27:53.843 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:27:53.843 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:27:53.843 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:27:53.843 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:27:53.843 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:27:53.844 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:27:53.844 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:27:53.844 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:27:53.844 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:27:53.844 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:27:53.844 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:27:53.844 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:27:53.845 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:27:53.845 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:27:53.845 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 8.0612501629437627, 2019-11-28T11:27:53.845 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:27:53.845 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:27:53.845 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.4676 v1:172.21.15.76:0/1347691556", 2019-11-28T11:27:53.845 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [ 2019-11-28T11:27:53.846 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:27:53.846 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 5, 2019-11-28T11:27:53.846 INFO:teuthology.orchestra.run.smithi174.stdout: "created_ino": "0x10000000001" 2019-11-28T11:27:53.846 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:27:53.846 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:27:53.846 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 6, 2019-11-28T11:27:53.846 INFO:teuthology.orchestra.run.smithi174.stdout: "created_ino": "0x10000000002" 2019-11-28T11:27:53.846 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:27:53.847 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2019-11-28T11:27:53.847 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [ 2019-11-28T11:27:53.847 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:27:53.847 INFO:teuthology.orchestra.run.smithi174.stdout: "start": 1099511627779, 2019-11-28T11:27:53.847 INFO:teuthology.orchestra.run.smithi174.stdout: "length": 998 2019-11-28T11:27:53.847 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:27:53.847 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2019-11-28T11:27:53.848 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:27:53.848 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:27:53.848 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:27:53.848 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "0", 2019-11-28T11:27:53.848 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi076", 2019-11-28T11:27:53.848 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:27:53.848 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:27:53.849 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:27:53.849 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:27:53.849 INFO:teuthology.orchestra.run.smithi174.stdout:] 2019-11-28T11:27:53.850 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 4676, "entity": { "name": { "type": "client", "num": 4676 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 1347691556 } }, "state": "stale", "num_leases": 0, "num_caps": 4, "request_load_avg": 0, "uptime": 97.753484620999998, "requests_in_flight": 0, "completed_requests": 2, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 8.0612501629437627, "halflife": 300 }, "inst": "client.4676 v1:172.21.15.76:0/1347691556", "completed_requests": [ { "tid": 5, "created_ino": "0x10000000001" }, { "tid": 6, "created_ino": "0x10000000002" } ], "prealloc_inos": [ { "start": 1099511627779, "length": 998 } ], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:27:53.850 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:27:53.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.944+0000 7f93be078700 1 Processor -- start 2019-11-28T11:27:53.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.944+0000 7f93be078700 1 -- start start 2019-11-28T11:27:53.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.945+0000 7f93be078700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93b806c0a0 0x7f93b8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:27:53.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.945+0000 7f93be078700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93b80734e0 0x7f93b8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:27:53.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.945+0000 7f93be078700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b806db00 con 0x7f93b8072360 2019-11-28T11:27:53.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.945+0000 7f93be078700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b806fd60 con 0x7f93b806c0a0 2019-11-28T11:27:53.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.945+0000 7f93be078700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8070030 con 0x7f93b80734e0 2019-11-28T11:27:53.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.945+0000 7f93b7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93b806c0a0 0x7f93b8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:27:53.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.945+0000 7f93b7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93b806c0a0 0x7f93b8072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32894/0 (socket says 172.21.15.80:32894) 2019-11-28T11:27:53.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.945+0000 7f93b7fff700 1 -- 172.21.15.80:0/542862969 learned_addr learned my addr 172.21.15.80:0/542862969 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:27:53.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.945+0000 7f93affff700 1 --2- 172.21.15.80:0/542862969 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93b80734e0 0x7f93b8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:27:53.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.945+0000 7f93b7fff700 1 -- 172.21.15.80:0/542862969 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93b80734e0 msgr2=0x7f93b8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:27:53.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.945+0000 7f93b7fff700 1 --2- 172.21.15.80:0/542862969 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93b80734e0 0x7f93b8071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:27:53.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.945+0000 7f93b7fff700 1 -- 172.21.15.80:0/542862969 >> v1:172.21.15.174:6789/0 conn(0x7f93b8072360 legacy=0x7f93b806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:53.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.946+0000 7f93b7fff700 1 -- 172.21.15.80:0/542862969 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b80706c0 con 0x7f93b806c0a0 2019-11-28T11:27:53.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.946+0000 7f93b7fff700 1 --2- 172.21.15.80:0/542862969 >> v2:172.21.15.80:3300/0 conn(0x7f93b806c0a0 0x7f93b8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f93a800f6c0 tx=0x7f93a800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.946+0000 7f93b7fff700 1 --2- 172.21.15.80:0/542862969 >> v2:172.21.15.80:3300/0 conn(0x7f93b806c0a0 0x7f93b8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f93a800f6c0 tx=0x7f93a800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.946+0000 7f93b7fff700 1 --2- 172.21.15.80:0/542862969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b806c0a0 0x7f93b8072fa0 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7f93a800f6c0 tx=0x7f93a800fa60).ready entity=mon.0 client_cookie=4db3ee4988f622f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:27:53.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.946+0000 7f93b7fff700 1 --2- 172.21.15.80:0/542862969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b806c0a0 0x7f93b8072fa0 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7f93a800f6c0 tx=0x7f93a800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.946+0000 7f93b77fe700 1 -- 172.21.15.80:0/542862969 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93a8000960 con 0x7f93b806c0a0 2019-11-28T11:27:53.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.946+0000 7f93b7fff700 1 --2- 172.21.15.80:0/542862969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b806c0a0 0x7f93b8072fa0 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7f93a800f6c0 tx=0x7f93a800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.946+0000 7f93b7fff700 1 --2- 172.21.15.80:0/542862969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b806c0a0 0x7f93b8072fa0 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7f93a800f6c0 tx=0x7f93a800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.946+0000 7f93b77fe700 1 -- 172.21.15.80:0/542862969 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a8000c90 con 0x7f93b806c0a0 2019-11-28T11:27:53.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.946+0000 7f93b77fe700 1 -- 172.21.15.80:0/542862969 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93a80013a0 con 0x7f93b806c0a0 2019-11-28T11:27:53.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.946+0000 7f93be078700 1 -- 172.21.15.80:0/542862969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b806c0a0 msgr2=0x7f93b8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:53.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.946+0000 7f93be078700 1 --2- 172.21.15.80:0/542862969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b806c0a0 0x7f93b8072fa0 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7f93a800f6c0 tx=0x7f93a800fa60).stop 2019-11-28T11:27:53.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.947+0000 7f93be078700 1 -- 172.21.15.80:0/542862969 shutdown_connections 2019-11-28T11:27:53.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.947+0000 7f93be078700 1 --2- 172.21.15.80:0/542862969 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93b80734e0 0x7f93b8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:27:53.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.947+0000 7f93be078700 1 --2- 172.21.15.80:0/542862969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b806c0a0 0x7f93b8072fa0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:27:53.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.947+0000 7f93be078700 1 -- 172.21.15.80:0/542862969 shutdown_connections 2019-11-28T11:27:53.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.947+0000 7f93be078700 1 -- 172.21.15.80:0/542862969 wait complete. 2019-11-28T11:27:53.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.947+0000 7f93be078700 1 -- 172.21.15.80:0/542862969 >> 172.21.15.80:0/542862969 conn(0x7f93b8061cf0 msgr2=0x7f93b8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:27:53.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.949+0000 7f93be078700 1 Processor -- start 2019-11-28T11:27:53.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.949+0000 7f93be078700 1 -- start start 2019-11-28T11:27:53.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93be078700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93b813dc00 0x7f93b8109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:27:53.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93be078700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b81312c0 con 0x7f93b810a3a0 2019-11-28T11:27:53.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93be078700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b8104010 con 0x7f93b81094e0 2019-11-28T11:27:53.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93be078700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b8105830 con 0x7f93b813dc00 2019-11-28T11:27:53.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93b7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93b813dc00 0x7f93b8109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:27:53.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93affff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f93b810a3a0 0x7f93b8108ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60448/0 (socket says 172.21.15.80:60448) 2019-11-28T11:27:53.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93affff700 1 -- 172.21.15.80:0/1763021214 learned_addr learned my addr 172.21.15.80:0/1763021214 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:27:53.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93b7fff700 1 -- 172.21.15.80:0/1763021214 >> v1:172.21.15.174:6789/0 conn(0x7f93b81094e0 legacy=0x7f93b8167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:53.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93b7fff700 1 -- 172.21.15.80:0/1763021214 >> v1:172.21.15.80:6789/0 conn(0x7f93b810a3a0 legacy=0x7f93b8108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:53.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93b7fff700 1 -- 172.21.15.80:0/1763021214 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b8106190 con 0x7f93b813dc00 2019-11-28T11:27:53.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93b57fa700 1 -- 172.21.15.80:0/1763021214 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641397691 0 0) 0x7f93a00010b0 con 0x7f93b810a3a0 2019-11-28T11:27:53.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93b7fff700 1 --2- 172.21.15.80:0/1763021214 >> v2:172.21.15.80:3300/0 conn(0x7f93b813dc00 0x7f93b8109e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f93a8010370 tx=0x7f93a8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93b7fff700 1 --2- 172.21.15.80:0/1763021214 >> v2:172.21.15.80:3300/0 conn(0x7f93b813dc00 0x7f93b8109e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f93a8010370 tx=0x7f93a8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93b7fff700 1 --2- 172.21.15.80:0/1763021214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b813dc00 0x7f93b8109e60 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7f93a8010370 tx=0x7f93a8010710).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:27:53.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93b7fff700 1 --2- 172.21.15.80:0/1763021214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b813dc00 0x7f93b8109e60 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7f93a8010370 tx=0x7f93a8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93b57fa700 1 -- 172.21.15.80:0/1763021214 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93a8005560 con 0x7f93b813dc00 2019-11-28T11:27:53.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93b7fff700 1 --2- 172.21.15.80:0/1763021214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b813dc00 0x7f93b8109e60 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7f93a8010370 tx=0x7f93a8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93b7fff700 1 --2- 172.21.15.80:0/1763021214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b813dc00 0x7f93b8109e60 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7f93a8010370 tx=0x7f93a8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93b57fa700 1 -- 172.21.15.80:0/1763021214 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a8005180 con 0x7f93b813dc00 2019-11-28T11:27:53.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93b57fa700 1 -- 172.21.15.80:0/1763021214 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93a8005b40 con 0x7f93b813dc00 2019-11-28T11:27:53.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93be078700 1 -- 172.21.15.80:0/1763021214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b8106510 con 0x7f93b813dc00 2019-11-28T11:27:53.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.950+0000 7f93be078700 1 -- 172.21.15.80:0/1763021214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b8106190 con 0x7f93b813dc00 2019-11-28T11:27:53.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.951+0000 7f93b7fff700 1 --2- 172.21.15.80:0/1763021214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b813dc00 0x7f93b8109e60 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7f93a8010370 tx=0x7f93a8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.951+0000 7f93b57fa700 1 -- 172.21.15.80:0/1763021214 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f93a8005370 con 0x7f93b813dc00 2019-11-28T11:27:53.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.951+0000 7f93b7fff700 1 --2- 172.21.15.80:0/1763021214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b813dc00 0x7f93b8109e60 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7f93a8010370 tx=0x7f93a8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.951+0000 7f93b57fa700 1 --2- 172.21.15.80:0/1763021214 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f939c018730 0x7f939c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:27:53.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.951+0000 7f93b57fa700 1 -- 172.21.15.80:0/1763021214 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f93a8031a50 con 0x7f93b813dc00 2019-11-28T11:27:53.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.951+0000 7f93affff700 1 --2- 172.21.15.80:0/1763021214 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f939c018730 0x7f939c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:27:53.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.952+0000 7f93affff700 1 --2- 172.21.15.80:0/1763021214 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f939c018730 0x7f939c01abc0 crc :-1 s=READY pgs=186 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:27:53.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.959+0000 7f93be078700 1 -- 172.21.15.80:0/1763021214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b8106510 con 0x7f93b813dc00 2019-11-28T11:27:53.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.962+0000 7f93b7fff700 1 --2- 172.21.15.80:0/1763021214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b813dc00 0x7f93b8109e60 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7f93a8010370 tx=0x7f93a8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:53.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:53.962+0000 7f93b57fa700 1 -- 172.21.15.80:0/1763021214 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f93a8013810 con 0x7f93b813dc00 2019-11-28T11:27:54.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.135+0000 7f93be078700 1 -- 172.21.15.80:0/1763021214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93b8106190 con 0x7f93b813dc00 2019-11-28T11:27:54.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.136+0000 7f93b7fff700 1 --2- 172.21.15.80:0/1763021214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b813dc00 0x7f93b8109e60 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7f93a8010370 tx=0x7f93a8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.136+0000 7f93b57fa700 1 -- 172.21.15.80:0/1763021214 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2446 (secure 0 0 0) 0x7f93a8013810 con 0x7f93b813dc00 2019-11-28T11:27:54.162 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2019-11-28T11:27:54.163 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:27:54.163 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:12.065616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:27:54.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.138+0000 7f93be078700 1 -- 172.21.15.80:0/1763021214 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f939c018730 msgr2=0x7f939c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:54.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.138+0000 7f93be078700 1 --2- 172.21.15.80:0/1763021214 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f939c018730 0x7f939c01abc0 crc :-1 s=READY pgs=186 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:27:54.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.138+0000 7f93be078700 1 -- 172.21.15.80:0/1763021214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b813dc00 msgr2=0x7f93b8109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:54.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.138+0000 7f93be078700 1 --2- 172.21.15.80:0/1763021214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b813dc00 0x7f93b8109e60 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7f93a8010370 tx=0x7f93a8010710).stop 2019-11-28T11:27:54.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.138+0000 7f93be078700 1 -- 172.21.15.80:0/1763021214 shutdown_connections 2019-11-28T11:27:54.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.138+0000 7f93be078700 1 --2- 172.21.15.80:0/1763021214 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f939c018730 0x7f939c01abc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:27:54.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.138+0000 7f93be078700 1 --2- 172.21.15.80:0/1763021214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93b813dc00 0x7f93b8109e60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:27:54.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.138+0000 7f93be078700 1 -- 172.21.15.80:0/1763021214 shutdown_connections 2019-11-28T11:27:54.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.138+0000 7f93be078700 1 -- 172.21.15.80:0/1763021214 wait complete. 2019-11-28T11:27:54.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.138+0000 7f93be078700 1 -- 172.21.15.80:0/1763021214 >> 172.21.15.80:0/1763021214 conn(0x7f93b811bfc0 msgr2=0x7f93b8141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:27:54.174 INFO:teuthology.orchestra.run.smithi174:> sudo iptables -D OUTPUT -p tcp --sport 6835 -j REJECT -m comment --comment teuthology 2019-11-28T11:27:54.228 INFO:teuthology.orchestra.run.smithi174:> sudo iptables -D INPUT -p tcp --dport 6835 -j REJECT -m comment --comment teuthology 2019-11-28T11:27:54.286 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:27:54.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.379+0000 7fd0af683700 1 Processor -- start 2019-11-28T11:27:54.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.379+0000 7fd0af683700 1 -- start start 2019-11-28T11:27:54.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.380+0000 7fd0af683700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd0a806d120 0x7fd0a8165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:27:54.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.380+0000 7fd0af683700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a806d5a0 con 0x7fd0a806c490 2019-11-28T11:27:54.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.380+0000 7fd0af683700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a806db00 con 0x7fd0a806c0a0 2019-11-28T11:27:54.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.380+0000 7fd0af683700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a806fd60 con 0x7fd0a806d120 2019-11-28T11:27:54.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.380+0000 7fd0ae421700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd0a806d120 0x7fd0a8165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:27:54.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.380+0000 7fd0ae421700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd0a806d120 0x7fd0a8165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32908/0 (socket says 172.21.15.80:32908) 2019-11-28T11:27:54.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.380+0000 7fd0ae421700 1 -- 172.21.15.80:0/3284426216 learned_addr learned my addr 172.21.15.80:0/3284426216 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:27:54.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.380+0000 7fd0ad41f700 1 --1- 172.21.15.80:0/3284426216 >> v1:172.21.15.80:6789/0 conn(0x7fd0a806c490 0x7fd0a806c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60458/0 (socket says 172.21.15.80:60458) 2019-11-28T11:27:54.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.381+0000 7fd0ae421700 1 -- 172.21.15.80:0/3284426216 >> v1:172.21.15.174:6789/0 conn(0x7fd0a806c0a0 legacy=0x7fd0a8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:54.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.381+0000 7fd0ae421700 1 -- 172.21.15.80:0/3284426216 >> v1:172.21.15.80:6789/0 conn(0x7fd0a806c490 legacy=0x7fd0a806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:54.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.381+0000 7fd0ae421700 1 -- 172.21.15.80:0/3284426216 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a80706c0 con 0x7fd0a806d120 2019-11-28T11:27:54.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.381+0000 7fd0acc1e700 1 -- 172.21.15.80:0/3284426216 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006192242 0 0) 0x7fd09c001100 con 0x7fd0a806c490 2019-11-28T11:27:54.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.381+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3284426216 >> v2:172.21.15.80:3300/0 conn(0x7fd0a806d120 0x7fd0a8165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd0a000f730 tx=0x7fd0a000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.381+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3284426216 >> v2:172.21.15.80:3300/0 conn(0x7fd0a806d120 0x7fd0a8165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd0a000f730 tx=0x7fd0a000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.381+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3284426216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a806d120 0x7fd0a8165d80 secure :-1 s=READY pgs=432 cs=0 l=1 rx=0x7fd0a000f730 tx=0x7fd0a000fad0).ready entity=mon.0 client_cookie=2f732765a47307cf server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:27:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.381+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3284426216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a806d120 0x7fd0a8165d80 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7fd0a000f730 tx=0x7fd0a000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.381+0000 7fd0acc1e700 1 -- 172.21.15.80:0/3284426216 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0a00010e0 con 0x7fd0a806d120 2019-11-28T11:27:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.381+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3284426216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a806d120 0x7fd0a8165d80 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7fd0a000f730 tx=0x7fd0a000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.381+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3284426216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a806d120 0x7fd0a8165d80 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7fd0a000f730 tx=0x7fd0a000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.381+0000 7fd0acc1e700 1 -- 172.21.15.80:0/3284426216 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a0000a70 con 0x7fd0a806d120 2019-11-28T11:27:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.381+0000 7fd0acc1e700 1 -- 172.21.15.80:0/3284426216 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0a00016c0 con 0x7fd0a806d120 2019-11-28T11:27:54.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.381+0000 7fd0af683700 1 -- 172.21.15.80:0/3284426216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a806d120 msgr2=0x7fd0a8165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:54.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.381+0000 7fd0af683700 1 --2- 172.21.15.80:0/3284426216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a806d120 0x7fd0a8165d80 secure :-1 s=READY pgs=432 cs=0 l=1 rx=0x7fd0a000f730 tx=0x7fd0a000fad0).stop 2019-11-28T11:27:54.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.382+0000 7fd0af683700 1 -- 172.21.15.80:0/3284426216 shutdown_connections 2019-11-28T11:27:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.382+0000 7fd0af683700 1 --2- 172.21.15.80:0/3284426216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a806d120 0x7fd0a8165d80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:27:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.382+0000 7fd0af683700 1 -- 172.21.15.80:0/3284426216 shutdown_connections 2019-11-28T11:27:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.382+0000 7fd0af683700 1 -- 172.21.15.80:0/3284426216 wait complete. 2019-11-28T11:27:54.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.382+0000 7fd0af683700 1 -- 172.21.15.80:0/3284426216 >> 172.21.15.80:0/3284426216 conn(0x7fd0a8061cf0 msgr2=0x7fd0a8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:27:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.384+0000 7fd0af683700 1 Processor -- start 2019-11-28T11:27:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.384+0000 7fd0af683700 1 -- start start 2019-11-28T11:27:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.385+0000 7fd0af683700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd0a8167a20 0x7fd0a8169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:27:54.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.385+0000 7fd0af683700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a813fc20 con 0x7fd0a813f580 2019-11-28T11:27:54.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.385+0000 7fd0af683700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a8122460 con 0x7fd0a8112fb0 2019-11-28T11:27:54.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.385+0000 7fd0af683700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a81236b0 con 0x7fd0a8167a20 2019-11-28T11:27:54.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.385+0000 7fd0adc20700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd0a813f580 0x7fd0a8114130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60460/0 (socket says 172.21.15.80:60460) 2019-11-28T11:27:54.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.385+0000 7fd0adc20700 1 -- 172.21.15.80:0/3935079028 learned_addr learned my addr 172.21.15.80:0/3935079028 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:27:54.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.385+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3935079028 >> v2:172.21.15.80:3300/0 conn(0x7fd0a8167a20 0x7fd0a8169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:27:54.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.385+0000 7fd0ae421700 1 -- 172.21.15.80:0/3935079028 >> v1:172.21.15.174:6789/0 conn(0x7fd0a8112fb0 legacy=0x7fd0a8113440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:54.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.385+0000 7fd0ae421700 1 -- 172.21.15.80:0/3935079028 >> v1:172.21.15.80:6789/0 conn(0x7fd0a813f580 legacy=0x7fd0a8114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:54.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.385+0000 7fd0ae421700 1 -- 172.21.15.80:0/3935079028 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a8124010 con 0x7fd0a8167a20 2019-11-28T11:27:54.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.385+0000 7fd0a67fc700 1 -- 172.21.15.80:0/3935079028 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455893926 0 0) 0x7fd0980014f0 con 0x7fd0a813f580 2019-11-28T11:27:54.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.385+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3935079028 >> v2:172.21.15.80:3300/0 conn(0x7fd0a8167a20 0x7fd0a8169e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0a00009c0 tx=0x7fd0a0010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.385+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3935079028 >> v2:172.21.15.80:3300/0 conn(0x7fd0a8167a20 0x7fd0a8169e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0a00009c0 tx=0x7fd0a0010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.385+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3935079028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a8167a20 0x7fd0a8169e20 secure :-1 s=READY pgs=434 cs=0 l=1 rx=0x7fd0a00009c0 tx=0x7fd0a0010770).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:27:54.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.386+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3935079028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a8167a20 0x7fd0a8169e20 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7fd0a00009c0 tx=0x7fd0a0010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.386+0000 7fd0a67fc700 1 -- 172.21.15.80:0/3935079028 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0a0007b00 con 0x7fd0a8167a20 2019-11-28T11:27:54.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.386+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3935079028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a8167a20 0x7fd0a8169e20 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7fd0a00009c0 tx=0x7fd0a0010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.386+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3935079028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a8167a20 0x7fd0a8169e20 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7fd0a00009c0 tx=0x7fd0a0010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.386+0000 7fd0a67fc700 1 -- 172.21.15.80:0/3935079028 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a00010c0 con 0x7fd0a8167a20 2019-11-28T11:27:54.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.386+0000 7fd0a67fc700 1 -- 172.21.15.80:0/3935079028 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0a0007b00 con 0x7fd0a8167a20 2019-11-28T11:27:54.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.386+0000 7fd0af683700 1 -- 172.21.15.80:0/3935079028 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a8124010 con 0x7fd0a8167a20 2019-11-28T11:27:54.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.386+0000 7fd0af683700 1 -- 172.21.15.80:0/3935079028 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a8124010 con 0x7fd0a8167a20 2019-11-28T11:27:54.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.386+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3935079028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a8167a20 0x7fd0a8169e20 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7fd0a00009c0 tx=0x7fd0a0010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.386+0000 7fd0a67fc700 1 -- 172.21.15.80:0/3935079028 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd0a00012b0 con 0x7fd0a8167a20 2019-11-28T11:27:54.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.386+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3935079028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a8167a20 0x7fd0a8169e20 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7fd0a00009c0 tx=0x7fd0a0010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.386+0000 7fd0a67fc700 1 --2- 172.21.15.80:0/3935079028 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd088018730 0x7fd08801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:27:54.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.386+0000 7fd0a67fc700 1 -- 172.21.15.80:0/3935079028 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd0a0031ac0 con 0x7fd0a8167a20 2019-11-28T11:27:54.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.387+0000 7fd0adc20700 1 --2- 172.21.15.80:0/3935079028 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd088018730 0x7fd08801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:27:54.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.387+0000 7fd0adc20700 1 --2- 172.21.15.80:0/3935079028 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd088018730 0x7fd08801abc0 crc :-1 s=READY pgs=187 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:27:54.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.394+0000 7fd0af683700 1 -- 172.21.15.80:0/3935079028 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a8124010 con 0x7fd0a8167a20 2019-11-28T11:27:54.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.398+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3935079028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a8167a20 0x7fd0a8169e20 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7fd0a00009c0 tx=0x7fd0a0010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.398+0000 7fd0a67fc700 1 -- 172.21.15.80:0/3935079028 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd0a0000eb0 con 0x7fd0a8167a20 2019-11-28T11:27:54.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.569+0000 7fd0af683700 1 -- 172.21.15.80:0/3935079028 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0a8124010 con 0x7fd0a8167a20 2019-11-28T11:27:54.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.570+0000 7fd0ae421700 1 --2- 172.21.15.80:0/3935079028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a8167a20 0x7fd0a8169e20 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7fd0a00009c0 tx=0x7fd0a0010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.570+0000 7fd0a67fc700 1 -- 172.21.15.80:0/3935079028 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2446 (secure 0 0 0) 0x7fd0a0001290 con 0x7fd0a8167a20 2019-11-28T11:27:54.596 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2019-11-28T11:27:54.597 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:27:54.599 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:12.065616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:27:54.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.572+0000 7fd0af683700 1 -- 172.21.15.80:0/3935079028 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd088018730 msgr2=0x7fd08801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:54.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.572+0000 7fd0af683700 1 --2- 172.21.15.80:0/3935079028 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd088018730 0x7fd08801abc0 crc :-1 s=READY pgs=187 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:27:54.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.572+0000 7fd0af683700 1 -- 172.21.15.80:0/3935079028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a8167a20 msgr2=0x7fd0a8169e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:54.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.572+0000 7fd0af683700 1 --2- 172.21.15.80:0/3935079028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a8167a20 0x7fd0a8169e20 secure :-1 s=READY pgs=434 cs=0 l=1 rx=0x7fd0a00009c0 tx=0x7fd0a0010770).stop 2019-11-28T11:27:54.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.572+0000 7fd0af683700 1 -- 172.21.15.80:0/3935079028 shutdown_connections 2019-11-28T11:27:54.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.572+0000 7fd0af683700 1 --2- 172.21.15.80:0/3935079028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0a8167a20 0x7fd0a8169e20 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:27:54.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.572+0000 7fd0af683700 1 --2- 172.21.15.80:0/3935079028 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd088018730 0x7fd08801abc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:27:54.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.572+0000 7fd0af683700 1 -- 172.21.15.80:0/3935079028 shutdown_connections 2019-11-28T11:27:54.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.572+0000 7fd0af683700 1 -- 172.21.15.80:0/3935079028 wait complete. 2019-11-28T11:27:54.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.572+0000 7fd0af683700 1 -- 172.21.15.80:0/3935079028 >> 172.21.15.80:0/3935079028 conn(0x7fd0a81426c0 msgr2=0x7fd0a8110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:27:54.608 INFO:teuthology.orchestra.run.smithi080:> sudo iptables -D OUTPUT -p tcp --sport 6834 -j REJECT -m comment --comment teuthology 2019-11-28T11:27:54.662 INFO:teuthology.orchestra.run.smithi080:> sudo iptables -D INPUT -p tcp --dport 6834 -j REJECT -m comment --comment teuthology 2019-11-28T11:27:54.716 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:27:54.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.808+0000 7fe2a6f05700 1 Processor -- start 2019-11-28T11:27:54.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.809+0000 7fe2a6f05700 1 -- start start 2019-11-28T11:27:54.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.809+0000 7fe2a6f05700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a006c0a0 0x7fe2a0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:27:54.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.809+0000 7fe2a6f05700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2a0072620 0x7fe2a0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:27:54.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.809+0000 7fe2a6f05700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a006db00 con 0x7fe2a00734e0 2019-11-28T11:27:54.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a6f05700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a006f330 con 0x7fe2a0072620 2019-11-28T11:27:54.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a6f05700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a00706c0 con 0x7fe2a006c0a0 2019-11-28T11:27:54.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a5ca3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2a0072620 0x7fe2a0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:27:54.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a5ca3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2a0072620 0x7fe2a0164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32924/0 (socket says 172.21.15.80:32924) 2019-11-28T11:27:54.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a5ca3700 1 -- 172.21.15.80:0/407486046 learned_addr learned my addr 172.21.15.80:0/407486046 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:27:54.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a54a2700 1 --2- 172.21.15.80:0/407486046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a006c0a0 0x7fe2a0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:27:54.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a5ca3700 1 -- 172.21.15.80:0/407486046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a006c0a0 msgr2=0x7fe2a0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:27:54.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/407486046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a006c0a0 0x7fe2a0072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:27:54.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a5ca3700 1 -- 172.21.15.80:0/407486046 >> v1:172.21.15.174:6789/0 conn(0x7fe2a00734e0 legacy=0x7fe2a0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:27:54.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a5ca3700 1 -- 172.21.15.80:0/407486046 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a0070a40 con 0x7fe2a0072620 2019-11-28T11:27:54.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/407486046 >> v2:172.21.15.80:3300/0 conn(0x7fe2a0072620 0x7fe2a0164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe29800f730 tx=0x7fe298007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/407486046 >> v2:172.21.15.80:3300/0 conn(0x7fe2a0072620 0x7fe2a0164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe29800f730 tx=0x7fe298007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/407486046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a0072620 0x7fe2a0164d70 secure :-1 s=READY pgs=435 cs=0 l=1 rx=0x7fe29800f730 tx=0x7fe298007d50).ready entity=mon.0 client_cookie=e6ff91c48d7b6f62 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:27:54.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/407486046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a0072620 0x7fe2a0164d70 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7fe29800f730 tx=0x7fe298007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/407486046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a0072620 0x7fe2a0164d70 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7fe29800f730 tx=0x7fe298007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe29ffff700 1 -- 172.21.15.80:0/407486046 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe298000a70 con 0x7fe2a0072620 2019-11-28T11:27:54.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/407486046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a0072620 0x7fe2a0164d70 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7fe29800f730 tx=0x7fe298007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe29ffff700 1 -- 172.21.15.80:0/407486046 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2980010e0 con 0x7fe2a0072620 2019-11-28T11:27:54.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe29ffff700 1 -- 172.21.15.80:0/407486046 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2980017b0 con 0x7fe2a0072620 2019-11-28T11:27:54.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a6f05700 1 -- 172.21.15.80:0/407486046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a0072620 msgr2=0x7fe2a0164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:54.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.810+0000 7fe2a6f05700 1 --2- 172.21.15.80:0/407486046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a0072620 0x7fe2a0164d70 secure :-1 s=READY pgs=435 cs=0 l=1 rx=0x7fe29800f730 tx=0x7fe298007d50).stop 2019-11-28T11:27:54.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.811+0000 7fe2a6f05700 1 -- 172.21.15.80:0/407486046 shutdown_connections 2019-11-28T11:27:54.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.811+0000 7fe2a6f05700 1 --2- 172.21.15.80:0/407486046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a0072620 0x7fe2a0164d70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:27:54.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.811+0000 7fe2a6f05700 1 --2- 172.21.15.80:0/407486046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a006c0a0 0x7fe2a0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:27:54.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.811+0000 7fe2a6f05700 1 -- 172.21.15.80:0/407486046 shutdown_connections 2019-11-28T11:27:54.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.811+0000 7fe2a6f05700 1 -- 172.21.15.80:0/407486046 wait complete. 2019-11-28T11:27:54.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.811+0000 7fe2a6f05700 1 -- 172.21.15.80:0/407486046 >> 172.21.15.80:0/407486046 conn(0x7fe2a0061cf0 msgr2=0x7fe2a0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:27:54.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.813+0000 7fe2a6f05700 1 Processor -- start 2019-11-28T11:27:54.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.813+0000 7fe2a6f05700 1 -- start start 2019-11-28T11:27:54.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.814+0000 7fe2a6f05700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a01096f0 0x7fe2a0169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:27:54.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.814+0000 7fe2a6f05700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a01066e0 con 0x7fe2a013e9e0 2019-11-28T11:27:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.814+0000 7fe2a6f05700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a010ce40 con 0x7fe2a013e5f0 2019-11-28T11:27:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.814+0000 7fe2a6f05700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a010e060 con 0x7fe2a01096f0 2019-11-28T11:27:54.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe2a4ca1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe2a013e9e0 0x7fe2a0108ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60476/0 (socket says 172.21.15.80:60476) 2019-11-28T11:27:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe2a4ca1700 1 -- 172.21.15.80:0/1168613785 learned_addr learned my addr 172.21.15.80:0/1168613785 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:27:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a01096f0 0x7fe2a0169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:27:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe29dffb700 1 -- 172.21.15.80:0/1168613785 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985218910 0 0) 0x7fe28c0014d0 con 0x7fe2a013e9e0 2019-11-28T11:27:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe29dffb700 1 -- 172.21.15.80:0/1168613785 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe280002e80 con 0x7fe2a013e9e0 2019-11-28T11:27:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe29dffb700 1 -- 172.21.15.80:0/1168613785 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033080388 0 0) 0x7fe294000c90 con 0x7fe2a013e5f0 2019-11-28T11:27:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe29dffb700 1 -- 172.21.15.80:0/1168613785 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2800030b0 con 0x7fe2a013e5f0 2019-11-28T11:27:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe2a5ca3700 1 -- 172.21.15.80:0/1168613785 >> v1:172.21.15.174:6789/0 conn(0x7fe2a013e5f0 legacy=0x7fe2a010a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe2a5ca3700 1 -- 172.21.15.80:0/1168613785 >> v1:172.21.15.80:6789/0 conn(0x7fe2a013e9e0 legacy=0x7fe2a0108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe29dffb700 1 -- 172.21.15.80:0/1168613785 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2235336907 0 0) 0x7fe28c001640 con 0x7fe2a013e9e0 2019-11-28T11:27:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe2a5ca3700 1 -- 172.21.15.80:0/1168613785 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a010e9c0 con 0x7fe2a01096f0 2019-11-28T11:27:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a01096f0 0x7fe2a0169ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe2980103a0 tx=0x7fe298010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a01096f0 0x7fe2a0169ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe2980103a0 tx=0x7fe298010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a01096f0 0x7fe2a0169ed0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fe2980103a0 tx=0x7fe298010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:27:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a01096f0 0x7fe2a0169ed0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fe2980103a0 tx=0x7fe298010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe29dffb700 1 -- 172.21.15.80:0/1168613785 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe298008180 con 0x7fe2a01096f0 2019-11-28T11:27:54.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a01096f0 0x7fe2a0169ed0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fe2980103a0 tx=0x7fe298010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe29dffb700 1 -- 172.21.15.80:0/1168613785 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe298007ef0 con 0x7fe2a01096f0 2019-11-28T11:27:54.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a01096f0 0x7fe2a0169ed0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fe2980103a0 tx=0x7fe298010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe2a6f05700 1 -- 172.21.15.80:0/1168613785 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a010ed40 con 0x7fe2a01096f0 2019-11-28T11:27:54.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe29dffb700 1 -- 172.21.15.80:0/1168613785 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2980014a0 con 0x7fe2a01096f0 2019-11-28T11:27:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.815+0000 7fe2a6f05700 1 -- 172.21.15.80:0/1168613785 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a010e9c0 con 0x7fe2a01096f0 2019-11-28T11:27:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.816+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a01096f0 0x7fe2a0169ed0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fe2980103a0 tx=0x7fe298010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.816+0000 7fe29dffb700 1 -- 172.21.15.80:0/1168613785 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe298001200 con 0x7fe2a01096f0 2019-11-28T11:27:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.816+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a01096f0 0x7fe2a0169ed0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fe2980103a0 tx=0x7fe298010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.816+0000 7fe29dffb700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe280018750 0x7fe28001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:27:54.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.816+0000 7fe29dffb700 1 -- 172.21.15.80:0/1168613785 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe298031a60 con 0x7fe2a01096f0 2019-11-28T11:27:54.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.816+0000 7fe2a54a2700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe280018750 0x7fe28001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:27:54.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.817+0000 7fe2a54a2700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe280018750 0x7fe28001abe0 crc :-1 s=READY pgs=188 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:27:54.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.824+0000 7fe2a6f05700 1 -- 172.21.15.80:0/1168613785 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a010ed40 con 0x7fe2a01096f0 2019-11-28T11:27:54.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.827+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a01096f0 0x7fe2a0169ed0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fe2980103a0 tx=0x7fe298010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:54.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:54.827+0000 7fe29dffb700 1 -- 172.21.15.80:0/1168613785 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe298000eb0 con 0x7fe2a01096f0 2019-11-28T11:27:55.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:55.000+0000 7fe2a6f05700 1 -- 172.21.15.80:0/1168613785 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2a010e9c0 con 0x7fe2a01096f0 2019-11-28T11:27:55.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:55.000+0000 7fe2a5ca3700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a01096f0 0x7fe2a0169ed0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fe2980103a0 tx=0x7fe298010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:27:55.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:55.000+0000 7fe29dffb700 1 -- 172.21.15.80:0/1168613785 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2446 (secure 0 0 0) 0x7fe298001160 con 0x7fe2a01096f0 2019-11-28T11:27:55.027 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2019-11-28T11:27:55.027 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:27:55.027 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:12.065616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:27:55.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:55.003+0000 7fe2a6f05700 1 -- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe280018750 msgr2=0x7fe28001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:55.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:55.003+0000 7fe2a6f05700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe280018750 0x7fe28001abe0 crc :-1 s=READY pgs=188 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:27:55.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:55.003+0000 7fe2a6f05700 1 -- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a01096f0 msgr2=0x7fe2a0169ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:27:55.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:55.003+0000 7fe2a6f05700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a01096f0 0x7fe2a0169ed0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fe2980103a0 tx=0x7fe298010740).stop 2019-11-28T11:27:55.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:55.003+0000 7fe2a6f05700 1 -- 172.21.15.80:0/1168613785 shutdown_connections 2019-11-28T11:27:55.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:55.003+0000 7fe2a6f05700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2a01096f0 0x7fe2a0169ed0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:27:55.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:55.003+0000 7fe2a6f05700 1 --2- 172.21.15.80:0/1168613785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe280018750 0x7fe28001abe0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:27:55.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:55.003+0000 7fe2a6f05700 1 -- 172.21.15.80:0/1168613785 shutdown_connections 2019-11-28T11:27:55.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:55.003+0000 7fe2a6f05700 1 -- 172.21.15.80:0/1168613785 wait complete. 2019-11-28T11:27:55.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:27:55.003+0000 7fe2a6f05700 1 -- 172.21.15.80:0/1168613785 >> 172.21.15.80:0/1168613785 conn(0x7fe2a013d620 msgr2=0x7fe2a013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:27:55.039 INFO:teuthology.orchestra.run.smithi080:> sudo iptables -D OUTPUT -p tcp --sport 6835 -j REJECT -m comment --comment teuthology 2019-11-28T11:27:55.098 INFO:teuthology.orchestra.run.smithi080:> sudo iptables -D INPUT -p tcp --dport 6835 -j REJECT -m comment --comment teuthology 2019-11-28T11:27:55.255 DEBUG:tasks.ceph_test_case:wait_until_true: waiting... 2019-11-28T11:28:00.356 DEBUG:tasks.ceph_test_case:wait_until_true: waiting... 2019-11-28T11:28:05.457 DEBUG:tasks.ceph_test_case:wait_until_true: waiting... 2019-11-28T11:28:10.458 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s 2019-11-28T11:28:10.458 INFO:tasks.cephfs.test_client_recovery:recovery time: 15.3043079376 2019-11-28T11:28:10.459 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:28:10.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.552+0000 7f184dc44700 1 Processor -- start 2019-11-28T11:28:10.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.552+0000 7f184dc44700 1 -- start start 2019-11-28T11:28:10.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f184dc44700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f184806c0a0 0x7f1848072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:10.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f184dc44700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18480734e0 0x7f1848071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:10.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f184dc44700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1848072360 0x7f1848072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:10.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f184dc44700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184806fd60 con 0x7f184806c0a0 2019-11-28T11:28:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f184dc44700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1848070030 con 0x7f1848072360 2019-11-28T11:28:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f184dc44700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184806f330 con 0x7f18480734e0 2019-11-28T11:28:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f1847fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f184806c0a0 0x7f1848072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:10.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f1847fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f184806c0a0 0x7f1848072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32934/0 (socket says 172.21.15.80:32934) 2019-11-28T11:28:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f1847fff700 1 -- 172.21.15.80:0/1805576968 learned_addr learned my addr 172.21.15.80:0/1805576968 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f184c9e2700 1 --2- 172.21.15.80:0/1805576968 >> v2:172.21.15.174:3300/0 conn(0x7f1848072360 0x7f1848072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f183ffff700 1 --2- 172.21.15.80:0/1805576968 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18480734e0 0x7f1848071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:10.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f1847fff700 1 -- 172.21.15.80:0/1805576968 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18480734e0 msgr2=0x7f1848071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:10.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f1847fff700 1 --2- 172.21.15.80:0/1805576968 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18480734e0 0x7f1848071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:10.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f1847fff700 1 -- 172.21.15.80:0/1805576968 >> v2:172.21.15.174:3300/0 conn(0x7f1848072360 msgr2=0x7f1848072800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:10.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f1847fff700 1 --2- 172.21.15.80:0/1805576968 >> v2:172.21.15.174:3300/0 conn(0x7f1848072360 0x7f1848072800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:10.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f1847fff700 1 -- 172.21.15.80:0/1805576968 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18480706c0 con 0x7f184806c0a0 2019-11-28T11:28:10.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.553+0000 7f183ffff700 1 --2- 172.21.15.80:0/1805576968 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18480734e0 0x7f1848071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:28:10.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.554+0000 7f1847fff700 1 --2- 172.21.15.80:0/1805576968 >> v2:172.21.15.80:3300/0 conn(0x7f184806c0a0 0x7f1848072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f183800f740 tx=0x7f183800f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:10.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.554+0000 7f1847fff700 1 --2- 172.21.15.80:0/1805576968 >> v2:172.21.15.80:3300/0 conn(0x7f184806c0a0 0x7f1848072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f183800f740 tx=0x7f183800f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:10.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.554+0000 7f1847fff700 1 --2- 172.21.15.80:0/1805576968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184806c0a0 0x7f1848072fa0 secure :-1 s=READY pgs=437 cs=0 l=1 rx=0x7f183800f740 tx=0x7f183800f5f0).ready entity=mon.0 client_cookie=5ea2d1412c26691b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:10.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.554+0000 7f1847fff700 1 --2- 172.21.15.80:0/1805576968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184806c0a0 0x7f1848072fa0 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f183800f740 tx=0x7f183800f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:10.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.554+0000 7f1847fff700 1 --2- 172.21.15.80:0/1805576968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184806c0a0 0x7f1848072fa0 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f183800f740 tx=0x7f183800f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:10.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.554+0000 7f18477fe700 1 -- 172.21.15.80:0/1805576968 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1838000960 con 0x7f184806c0a0 2019-11-28T11:28:10.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.554+0000 7f1847fff700 1 --2- 172.21.15.80:0/1805576968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184806c0a0 0x7f1848072fa0 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f183800f740 tx=0x7f183800f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:10.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.554+0000 7f18477fe700 1 -- 172.21.15.80:0/1805576968 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1838000c90 con 0x7f184806c0a0 2019-11-28T11:28:10.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.554+0000 7f18477fe700 1 -- 172.21.15.80:0/1805576968 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18380013a0 con 0x7f184806c0a0 2019-11-28T11:28:10.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.554+0000 7f184dc44700 1 -- 172.21.15.80:0/1805576968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184806c0a0 msgr2=0x7f1848072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:10.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.554+0000 7f184dc44700 1 --2- 172.21.15.80:0/1805576968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184806c0a0 0x7f1848072fa0 secure :-1 s=READY pgs=437 cs=0 l=1 rx=0x7f183800f740 tx=0x7f183800f5f0).stop 2019-11-28T11:28:10.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.554+0000 7f184dc44700 1 -- 172.21.15.80:0/1805576968 shutdown_connections 2019-11-28T11:28:10.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.554+0000 7f184dc44700 1 --2- 172.21.15.80:0/1805576968 >> v2:172.21.15.174:3300/0 conn(0x7f1848072360 0x7f1848072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:10.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.554+0000 7f184dc44700 1 --2- 172.21.15.80:0/1805576968 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18480734e0 0x7f1848071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.554+0000 7f184dc44700 1 --2- 172.21.15.80:0/1805576968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184806c0a0 0x7f1848072fa0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.555+0000 7f184dc44700 1 -- 172.21.15.80:0/1805576968 shutdown_connections 2019-11-28T11:28:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.555+0000 7f184dc44700 1 -- 172.21.15.80:0/1805576968 wait complete. 2019-11-28T11:28:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.555+0000 7f184dc44700 1 -- 172.21.15.80:0/1805576968 >> 172.21.15.80:0/1805576968 conn(0x7f1848061cf0 msgr2=0x7f1848064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.557+0000 7f184dc44700 1 Processor -- start 2019-11-28T11:28:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.557+0000 7f184dc44700 1 -- start start 2019-11-28T11:28:10.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.558+0000 7f184dc44700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1848103000 0x7f1848103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:10.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.558+0000 7f184dc44700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18481039d0 0x7f1848167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:10.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.558+0000 7f184dc44700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18481312c0 con 0x7f184813dc00 2019-11-28T11:28:10.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.558+0000 7f184dc44700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1848105830 con 0x7f1848103000 2019-11-28T11:28:10.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.558+0000 7f184dc44700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1848105b00 con 0x7f18481039d0 2019-11-28T11:28:10.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.558+0000 7f1847fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f184813dc00 0x7f1848109e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60488/0 (socket says 172.21.15.80:60488) 2019-11-28T11:28:10.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.558+0000 7f1847fff700 1 -- 172.21.15.80:0/3688645360 learned_addr learned my addr 172.21.15.80:0/3688645360 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:10.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.558+0000 7f183ffff700 1 --2- 172.21.15.80:0/3688645360 >> v2:172.21.15.174:3300/0 conn(0x7f1848103000 0x7f1848103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:10.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.558+0000 7f184c9e2700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18481039d0 0x7f1848167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:10.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.558+0000 7f18457fa700 1 -- 172.21.15.80:0/3688645360 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385207573 0 0) 0x7f1838007da0 con 0x7f184813dc00 2019-11-28T11:28:10.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.558+0000 7f18457fa700 1 -- 172.21.15.80:0/3688645360 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1820002e80 con 0x7f184813dc00 2019-11-28T11:28:10.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.559+0000 7f183ffff700 1 -- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18481039d0 msgr2=0x7f1848167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:10.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.559+0000 7f183ffff700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18481039d0 0x7f1848167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:10.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.559+0000 7f183ffff700 1 -- 172.21.15.80:0/3688645360 >> v1:172.21.15.80:6789/0 conn(0x7f184813dc00 legacy=0x7f1848109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:10.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.559+0000 7f183ffff700 1 -- 172.21.15.80:0/3688645360 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1848106190 con 0x7f1848103000 2019-11-28T11:28:10.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.559+0000 7f183ffff700 1 --2- 172.21.15.80:0/3688645360 >> v2:172.21.15.174:3300/0 conn(0x7f1848103000 0x7f1848103490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1830010380 tx=0x7f1830010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:10.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.559+0000 7f183ffff700 1 --2- 172.21.15.80:0/3688645360 >> v2:172.21.15.174:3300/0 conn(0x7f1848103000 0x7f1848103490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1830010380 tx=0x7f1830010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:10.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.559+0000 7f183ffff700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1848103000 0x7f1848103490 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7f1830010380 tx=0x7f1830010720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.559+0000 7f183ffff700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1848103000 0x7f1848103490 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f1830010380 tx=0x7f1830010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.559+0000 7f18457fa700 1 -- 172.21.15.80:0/3688645360 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1830000940 con 0x7f1848103000 2019-11-28T11:28:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.559+0000 7f183ffff700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1848103000 0x7f1848103490 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f1830010380 tx=0x7f1830010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.559+0000 7f18457fa700 1 -- 172.21.15.80:0/3688645360 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1830001090 con 0x7f1848103000 2019-11-28T11:28:10.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.559+0000 7f183ffff700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1848103000 0x7f1848103490 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f1830010380 tx=0x7f1830010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.559+0000 7f18457fa700 1 -- 172.21.15.80:0/3688645360 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1830001280 con 0x7f1848103000 2019-11-28T11:28:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.559+0000 7f184dc44700 1 -- 172.21.15.80:0/3688645360 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1848106510 con 0x7f1848103000 2019-11-28T11:28:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.559+0000 7f184dc44700 1 -- 172.21.15.80:0/3688645360 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1848106190 con 0x7f1848103000 2019-11-28T11:28:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.559+0000 7f183ffff700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1848103000 0x7f1848103490 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f1830010380 tx=0x7f1830010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.560+0000 7f18457fa700 1 -- 172.21.15.80:0/3688645360 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1830000c90 con 0x7f1848103000 2019-11-28T11:28:10.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.560+0000 7f183ffff700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1848103000 0x7f1848103490 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f1830010380 tx=0x7f1830010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:10.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.560+0000 7f18457fa700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1820018770 0x7f182001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:10.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.560+0000 7f18457fa700 1 -- 172.21.15.80:0/3688645360 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1830033bd0 con 0x7f1848103000 2019-11-28T11:28:10.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.560+0000 7f1847fff700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1820018770 0x7f182001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:10.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.560+0000 7f1847fff700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1820018770 0x7f182001abe0 crc :-1 s=READY pgs=189 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:10.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.567+0000 7f184dc44700 1 -- 172.21.15.80:0/3688645360 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1848106510 con 0x7f1848103000 2019-11-28T11:28:10.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.571+0000 7f183ffff700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1848103000 0x7f1848103490 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f1830010380 tx=0x7f1830010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:10.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.571+0000 7f18457fa700 1 -- 172.21.15.80:0/3688645360 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f183000c160 con 0x7f1848103000 2019-11-28T11:28:10.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.743+0000 7f184dc44700 1 -- 172.21.15.80:0/3688645360 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1848106190 con 0x7f1848103000 2019-11-28T11:28:10.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.745+0000 7f183ffff700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1848103000 0x7f1848103490 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f1830010380 tx=0x7f1830010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:10.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.745+0000 7f18457fa700 1 -- 172.21.15.80:0/3688645360 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2446 (secure 0 0 0) 0x7f183000c160 con 0x7f1848103000 2019-11-28T11:28:10.771 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2019-11-28T11:28:10.771 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:10.771 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1584076928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1584076928},{"type":"v1","addr":"172.21.15.80:6834","nonce":1584076928}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12},{"gid":5124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1509002812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1509002812},{"type":"v1","addr":"172.21.15.80:6835","nonce":1509002812}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:26:12.065616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2897820490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2897820490},{"type":"v1","addr":"172.21.15.174:6835","nonce":2897820490}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:28:10.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.746+0000 7f184dc44700 1 -- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1820018770 msgr2=0x7f182001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:10.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.746+0000 7f184dc44700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1820018770 0x7f182001abe0 crc :-1 s=READY pgs=189 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:10.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.746+0000 7f184dc44700 1 -- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1848103000 msgr2=0x7f1848103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:10.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.746+0000 7f184dc44700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1848103000 0x7f1848103490 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7f1830010380 tx=0x7f1830010720).stop 2019-11-28T11:28:10.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.746+0000 7f184dc44700 1 -- 172.21.15.80:0/3688645360 shutdown_connections 2019-11-28T11:28:10.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.746+0000 7f184dc44700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1820018770 0x7f182001abe0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:10.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.746+0000 7f184dc44700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18481039d0 0x7f1848167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:10.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.746+0000 7f184dc44700 1 --2- 172.21.15.80:0/3688645360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1848103000 0x7f1848103490 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:10.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.746+0000 7f184dc44700 1 -- 172.21.15.80:0/3688645360 shutdown_connections 2019-11-28T11:28:10.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.746+0000 7f184dc44700 1 -- 172.21.15.80:0/3688645360 wait complete. 2019-11-28T11:28:10.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:10.746+0000 7f184dc44700 1 -- 172.21.15.80:0/3688645360 >> 172.21.15.80:0/3688645360 conn(0x7f184811bfc0 msgr2=0x7f1848141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:10.785 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session ls 2019-11-28T11:28:10.926 INFO:teuthology.orchestra.run.smithi174.stdout:[ 2019-11-28T11:28:10.926 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:28:10.926 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 4676, 2019-11-28T11:28:10.926 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:28:10.927 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:28:10.927 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:28:10.927 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 4676 2019-11-28T11:28:10.927 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:28:10.927 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:28:10.927 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:28:10.928 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.76:0", 2019-11-28T11:28:10.928 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 1347691556 2019-11-28T11:28:10.928 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:28:10.928 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:28:10.928 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:28:10.929 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 1, 2019-11-28T11:28:10.929 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 5, 2019-11-28T11:28:10.929 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 0, 2019-11-28T11:28:10.929 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 114.841410948, 2019-11-28T11:28:10.929 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:28:10.929 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 3, 2019-11-28T11:28:10.930 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:28:10.930 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:28:10.930 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:28:10.930 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:28:10.931 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:28:10.931 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:28:10.931 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:28:10.932 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:28:10.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:28:10.932 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:28:10.932 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:28:10.932 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:28:10.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:28:10.933 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:28:10.933 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:28:10.933 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:28:10.940 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:28:10.940 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:28:10.940 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 13.716606462684664, 2019-11-28T11:28:10.941 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:28:10.941 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:28:10.941 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.4676 v1:172.21.15.76:0/1347691556", 2019-11-28T11:28:10.942 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [ 2019-11-28T11:28:10.942 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:28:10.942 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 5, 2019-11-28T11:28:10.942 INFO:teuthology.orchestra.run.smithi174.stdout: "created_ino": "0x10000000001" 2019-11-28T11:28:10.942 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:28:10.942 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:28:10.943 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 6, 2019-11-28T11:28:10.943 INFO:teuthology.orchestra.run.smithi174.stdout: "created_ino": "0x10000000002" 2019-11-28T11:28:10.943 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:28:10.943 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:28:10.943 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 7, 2019-11-28T11:28:10.943 INFO:teuthology.orchestra.run.smithi174.stdout: "created_ino": "0x100000003e9" 2019-11-28T11:28:10.944 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:28:10.944 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2019-11-28T11:28:10.944 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [ 2019-11-28T11:28:10.944 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:28:10.944 INFO:teuthology.orchestra.run.smithi174.stdout: "start": 1099511627779, 2019-11-28T11:28:10.944 INFO:teuthology.orchestra.run.smithi174.stdout: "length": 998 2019-11-28T11:28:10.945 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:28:10.945 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2019-11-28T11:28:10.945 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:28:10.945 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:28:10.945 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:28:10.945 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "0", 2019-11-28T11:28:10.946 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi076", 2019-11-28T11:28:10.946 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:28:10.946 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:28:10.946 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:28:10.946 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:28:10.946 INFO:teuthology.orchestra.run.smithi174.stdout:] 2019-11-28T11:28:10.948 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 4676, "entity": { "name": { "type": "client", "num": 4676 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 1347691556 } }, "state": "open", "num_leases": 1, "num_caps": 5, "request_load_avg": 0, "uptime": 114.841410948, "requests_in_flight": 0, "completed_requests": 3, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 13.716606462684664, "halflife": 300 }, "inst": "client.4676 v1:172.21.15.76:0/1347691556", "completed_requests": [ { "tid": 5, "created_ino": "0x10000000001" }, { "tid": 6, "created_ino": "0x10000000002" }, { "tid": 7, "created_ino": "0x100000003e9" } ], "prealloc_inos": [ { "start": 1099511627779, "length": 998 } ], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:28:10.949 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death' 2019-11-28T11:28:11.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.043+0000 7f7f31289700 1 Processor -- start 2019-11-28T11:28:11.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.043+0000 7f7f31289700 1 -- start start 2019-11-28T11:28:11.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f31289700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f2c06c0a0 0x7f7f2c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:11.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f31289700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7f2c072620 0x7f7f2c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:11.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f31289700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c06db00 con 0x7f7f2c0734e0 2019-11-28T11:28:11.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f31289700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c06f330 con 0x7f7f2c072620 2019-11-28T11:28:11.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f31289700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0706c0 con 0x7f7f2c06c0a0 2019-11-28T11:28:11.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7f2c072620 0x7f7f2c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:11.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7f2c072620 0x7f7f2c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32950/0 (socket says 172.21.15.80:32950) 2019-11-28T11:28:11.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2bfff700 1 -- 172.21.15.80:0/1507317456 learned_addr learned my addr 172.21.15.80:0/1507317456 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:11.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2b7fe700 1 --2- 172.21.15.80:0/1507317456 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f2c06c0a0 0x7f7f2c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2bfff700 1 -- 172.21.15.80:0/1507317456 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f2c06c0a0 msgr2=0x7f7f2c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1507317456 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f2c06c0a0 0x7f7f2c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2bfff700 1 -- 172.21.15.80:0/1507317456 >> v1:172.21.15.174:6789/0 conn(0x7f7f2c0734e0 legacy=0x7f7f2c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2bfff700 1 -- 172.21.15.80:0/1507317456 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c070a40 con 0x7f7f2c072620 2019-11-28T11:28:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1507317456 >> v2:172.21.15.80:3300/0 conn(0x7f7f2c072620 0x7f7f2c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7f2400f6b0 tx=0x7f7f2400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1507317456 >> v2:172.21.15.80:3300/0 conn(0x7f7f2c072620 0x7f7f2c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7f2400f6b0 tx=0x7f7f2400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1507317456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c072620 0x7f7f2c164d70 secure :-1 s=READY pgs=439 cs=0 l=1 rx=0x7f7f2400f6b0 tx=0x7f7f2400fa50).ready entity=mon.0 client_cookie=edd1b5930e8c7b92 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1507317456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c072620 0x7f7f2c164d70 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f7f2400f6b0 tx=0x7f7f2400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1507317456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c072620 0x7f7f2c164d70 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f7f2400f6b0 tx=0x7f7f2400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2a7fc700 1 -- 172.21.15.80:0/1507317456 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f24000a70 con 0x7f7f2c072620 2019-11-28T11:28:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1507317456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c072620 0x7f7f2c164d70 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f7f2400f6b0 tx=0x7f7f2400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2a7fc700 1 -- 172.21.15.80:0/1507317456 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f240010e0 con 0x7f7f2c072620 2019-11-28T11:28:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f2a7fc700 1 -- 172.21.15.80:0/1507317456 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f240017b0 con 0x7f7f2c072620 2019-11-28T11:28:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f31289700 1 -- 172.21.15.80:0/1507317456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c072620 msgr2=0x7f7f2c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.044+0000 7f7f31289700 1 --2- 172.21.15.80:0/1507317456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c072620 0x7f7f2c164d70 secure :-1 s=READY pgs=439 cs=0 l=1 rx=0x7f7f2400f6b0 tx=0x7f7f2400fa50).stop 2019-11-28T11:28:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.045+0000 7f7f31289700 1 -- 172.21.15.80:0/1507317456 shutdown_connections 2019-11-28T11:28:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.045+0000 7f7f31289700 1 --2- 172.21.15.80:0/1507317456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c072620 0x7f7f2c164d70 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.045+0000 7f7f31289700 1 --2- 172.21.15.80:0/1507317456 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f2c06c0a0 0x7f7f2c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.045+0000 7f7f31289700 1 -- 172.21.15.80:0/1507317456 shutdown_connections 2019-11-28T11:28:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.045+0000 7f7f31289700 1 -- 172.21.15.80:0/1507317456 wait complete. 2019-11-28T11:28:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.045+0000 7f7f31289700 1 -- 172.21.15.80:0/1507317456 >> 172.21.15.80:0/1507317456 conn(0x7f7f2c061cf0 msgr2=0x7f7f2c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:11.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.048+0000 7f7f31289700 1 Processor -- start 2019-11-28T11:28:11.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.048+0000 7f7f31289700 1 -- start start 2019-11-28T11:28:11.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f31289700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7f2c104820 0x7f7f2c10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:11.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f31289700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7f2c10b9d0 0x7f7f2c167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:11.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f31289700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c13bcd0 con 0x7f7f2c10c890 2019-11-28T11:28:11.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f31289700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c109130 con 0x7f7f2c10b9d0 2019-11-28T11:28:11.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f31289700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c109400 con 0x7f7f2c104820 2019-11-28T11:28:11.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f2bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7f2c10b9d0 0x7f7f2c167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:11.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f2bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7f2c10b9d0 0x7f7f2c167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32958/0 (socket says 172.21.15.80:32958) 2019-11-28T11:28:11.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f2bfff700 1 -- 172.21.15.80:0/1936178268 learned_addr learned my addr 172.21.15.80:0/1936178268 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:11.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f2b7fe700 1 --2- 172.21.15.80:0/1936178268 >> v2:172.21.15.174:3300/0 conn(0x7f7f2c104820 0x7f7f2c10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:11.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f2bfff700 1 -- 172.21.15.80:0/1936178268 >> v2:172.21.15.174:3300/0 conn(0x7f7f2c104820 msgr2=0x7f7f2c10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:11.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1936178268 >> v2:172.21.15.174:3300/0 conn(0x7f7f2c104820 0x7f7f2c10c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:11.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f2bfff700 1 -- 172.21.15.80:0/1936178268 >> v1:172.21.15.174:6789/0 conn(0x7f7f2c10c890 legacy=0x7f7f2c10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:11.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f2bfff700 1 -- 172.21.15.80:0/1936178268 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c109a90 con 0x7f7f2c10b9d0 2019-11-28T11:28:11.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1936178268 >> v2:172.21.15.80:3300/0 conn(0x7f7f2c10b9d0 0x7f7f2c167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7f24010430 tx=0x7f7f240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:11.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1936178268 >> v2:172.21.15.80:3300/0 conn(0x7f7f2c10b9d0 0x7f7f2c167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7f24010430 tx=0x7f7f240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:11.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1936178268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c10b9d0 0x7f7f2c167a10 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7f7f24010430 tx=0x7f7f240102b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:11.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1936178268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c10b9d0 0x7f7f2c167a10 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f7f24010430 tx=0x7f7f240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:11.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1936178268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c10b9d0 0x7f7f2c167a10 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f7f24010430 tx=0x7f7f240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:11.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f13fff700 1 -- 172.21.15.80:0/1936178268 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f240012b0 con 0x7f7f2c10b9d0 2019-11-28T11:28:11.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1936178268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c10b9d0 0x7f7f2c167a10 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f7f24010430 tx=0x7f7f240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:11.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f13fff700 1 -- 172.21.15.80:0/1936178268 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f24008180 con 0x7f7f2c10b9d0 2019-11-28T11:28:11.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f13fff700 1 -- 172.21.15.80:0/1936178268 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f24001890 con 0x7f7f2c10b9d0 2019-11-28T11:28:11.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f31289700 1 -- 172.21.15.80:0/1936178268 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2c109e10 con 0x7f7f2c10b9d0 2019-11-28T11:28:11.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.049+0000 7f7f31289700 1 -- 172.21.15.80:0/1936178268 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c109a90 con 0x7f7f2c10b9d0 2019-11-28T11:28:11.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.050+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1936178268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c10b9d0 0x7f7f2c167a10 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f7f24010430 tx=0x7f7f240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:11.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.050+0000 7f7f13fff700 1 -- 172.21.15.80:0/1936178268 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7f240010c0 con 0x7f7f2c10b9d0 2019-11-28T11:28:11.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.050+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1936178268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c10b9d0 0x7f7f2c167a10 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f7f24010430 tx=0x7f7f240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:11.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.050+0000 7f7f13fff700 1 --2- 172.21.15.80:0/1936178268 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7f0c018730 0x7f7f0c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:11.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.050+0000 7f7f13fff700 1 -- 172.21.15.80:0/1936178268 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7f24031b00 con 0x7f7f2c10b9d0 2019-11-28T11:28:11.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.050+0000 7f7f2b7fe700 1 --2- 172.21.15.80:0/1936178268 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7f0c018730 0x7f7f0c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:11.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.050+0000 7f7f2b7fe700 1 --2- 172.21.15.80:0/1936178268 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7f0c018730 0x7f7f0c01abc0 crc :-1 s=READY pgs=190 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:11.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.058+0000 7f7f31289700 1 -- 172.21.15.80:0/1936178268 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2c109e10 con 0x7f7f2c10b9d0 2019-11-28T11:28:11.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.061+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1936178268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c10b9d0 0x7f7f2c167a10 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f7f24010430 tx=0x7f7f240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:11.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.061+0000 7f7f13fff700 1 -- 172.21.15.80:0/1936178268 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7f2402e880 con 0x7f7f2c10b9d0 2019-11-28T11:28:11.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:11.234+0000 7f7f31289700 1 -- 172.21.15.80:0/1936178268 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death"]} v 0) v1 -- 0x7f7f2c109a90 con 0x7f7f2c10b9d0 2019-11-28T11:28:12.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:12.141+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/1936178268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c10b9d0 0x7f7f2c167a10 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f7f24010430 tx=0x7f7f240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:12.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:12.141+0000 7f7f13fff700 1 -- 172.21.15.80:0/1936178268 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death"]}]=0 v100) v1 ==== 157+0+0 (secure 0 0 0) 0x7f7f240010c0 con 0x7f7f2c10b9d0 2019-11-28T11:28:12.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:12.153+0000 7f7f31289700 1 -- 172.21.15.80:0/1936178268 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7f0c018730 msgr2=0x7f7f0c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:12.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:12.153+0000 7f7f31289700 1 --2- 172.21.15.80:0/1936178268 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7f0c018730 0x7f7f0c01abc0 crc :-1 s=READY pgs=190 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:12.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:12.153+0000 7f7f31289700 1 -- 172.21.15.80:0/1936178268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c10b9d0 msgr2=0x7f7f2c167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:12.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:12.153+0000 7f7f31289700 1 --2- 172.21.15.80:0/1936178268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c10b9d0 0x7f7f2c167a10 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7f7f24010430 tx=0x7f7f240102b0).stop 2019-11-28T11:28:12.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:12.153+0000 7f7f31289700 1 -- 172.21.15.80:0/1936178268 shutdown_connections 2019-11-28T11:28:12.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:12.153+0000 7f7f31289700 1 --2- 172.21.15.80:0/1936178268 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c10b9d0 0x7f7f2c167a10 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:12.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:12.153+0000 7f7f31289700 1 --2- 172.21.15.80:0/1936178268 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7f0c018730 0x7f7f0c01abc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:12.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:12.153+0000 7f7f31289700 1 --2- 172.21.15.80:0/1936178268 >> v2:172.21.15.174:3300/0 conn(0x7f7f2c104820 0x7f7f2c10c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:12.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:12.153+0000 7f7f31289700 1 -- 172.21.15.80:0/1936178268 shutdown_connections 2019-11-28T11:28:12.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:12.153+0000 7f7f31289700 1 -- 172.21.15.80:0/1936178268 wait complete. 2019-11-28T11:28:12.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:12.153+0000 7f7f31289700 1 -- 172.21.15.80:0/1936178268 >> 172.21.15.80:0/1936178268 conn(0x7f7f2c13d620 msgr2=0x7f7f2c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:12.188 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:28:12.188 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:12.255 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:12.320 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:12.381 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:12.436 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:12.500 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:12.560 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:28:12.560 INFO:tasks.cephfs.mount:Terminating background process 2019-11-28T11:28:12.560 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:28:12.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:28:12.560 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T11:28:16.852 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:28:16.865 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:28:16.909 INFO:tasks.cephfs_test_runner:test_network_death (tasks.cephfs.test_client_recovery.TestClientNetworkRecovery) ... ok 2019-11-28T11:28:16.909 INFO:tasks.cephfs_test_runner:Starting test: test_abort_conn (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T11:28:16.910 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn' 2019-11-28T11:28:17.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.008+0000 7fb1c163e700 1 Processor -- start 2019-11-28T11:28:17.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.008+0000 7fb1c163e700 1 -- start start 2019-11-28T11:28:17.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.009+0000 7fb1c163e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb1bc06c0a0 0x7fb1bc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:17.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.009+0000 7fb1c163e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1bc072620 0x7fb1bc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:17.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.009+0000 7fb1c163e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1bc06db00 con 0x7fb1bc0734e0 2019-11-28T11:28:17.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.009+0000 7fb1c163e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1bc06fd60 con 0x7fb1bc06c0a0 2019-11-28T11:28:17.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.009+0000 7fb1c163e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc070030 con 0x7fb1bc072620 2019-11-28T11:28:17.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1bb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb1bc06c0a0 0x7fb1bc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:17.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1bb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb1bc06c0a0 0x7fb1bc072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32962/0 (socket says 172.21.15.80:32962) 2019-11-28T11:28:17.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1bb7fe700 1 -- 172.21.15.80:0/1931451722 learned_addr learned my addr 172.21.15.80:0/1931451722 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:17.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1bbfff700 1 --2- 172.21.15.80:0/1931451722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1bc072620 0x7fb1bc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:17.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1bb7fe700 1 -- 172.21.15.80:0/1931451722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1bc072620 msgr2=0x7fb1bc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:17.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1bb7fe700 1 --2- 172.21.15.80:0/1931451722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1bc072620 0x7fb1bc164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:17.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1bb7fe700 1 -- 172.21.15.80:0/1931451722 >> v1:172.21.15.174:6789/0 conn(0x7fb1bc0734e0 legacy=0x7fb1bc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1bb7fe700 1 -- 172.21.15.80:0/1931451722 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc0706c0 con 0x7fb1bc06c0a0 2019-11-28T11:28:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1bbfff700 1 --2- 172.21.15.80:0/1931451722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1bc072620 0x7fb1bc164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1bb7fe700 1 --2- 172.21.15.80:0/1931451722 >> v2:172.21.15.80:3300/0 conn(0x7fb1bc06c0a0 0x7fb1bc072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb1a400f740 tx=0x7fb1a400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1bb7fe700 1 --2- 172.21.15.80:0/1931451722 >> v2:172.21.15.80:3300/0 conn(0x7fb1bc06c0a0 0x7fb1bc072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb1a400f740 tx=0x7fb1a400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1bb7fe700 1 --2- 172.21.15.80:0/1931451722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1bc06c0a0 0x7fb1bc072fa0 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7fb1a400f740 tx=0x7fb1a400fae0).ready entity=mon.0 client_cookie=7fac62b49e58f287 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1bb7fe700 1 --2- 172.21.15.80:0/1931451722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1bc06c0a0 0x7fb1bc072fa0 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7fb1a400f740 tx=0x7fb1a400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:17.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1bb7fe700 1 --2- 172.21.15.80:0/1931451722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1bc06c0a0 0x7fb1bc072fa0 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7fb1a400f740 tx=0x7fb1a400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:17.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1ba7fc700 1 -- 172.21.15.80:0/1931451722 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1a4000960 con 0x7fb1bc06c0a0 2019-11-28T11:28:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1bb7fe700 1 --2- 172.21.15.80:0/1931451722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1bc06c0a0 0x7fb1bc072fa0 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7fb1a400f740 tx=0x7fb1a400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1ba7fc700 1 -- 172.21.15.80:0/1931451722 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a4000c90 con 0x7fb1bc06c0a0 2019-11-28T11:28:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1ba7fc700 1 -- 172.21.15.80:0/1931451722 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1a40013a0 con 0x7fb1bc06c0a0 2019-11-28T11:28:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1c163e700 1 -- 172.21.15.80:0/1931451722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1bc06c0a0 msgr2=0x7fb1bc072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:17.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.010+0000 7fb1c163e700 1 --2- 172.21.15.80:0/1931451722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1bc06c0a0 0x7fb1bc072fa0 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7fb1a400f740 tx=0x7fb1a400fae0).stop 2019-11-28T11:28:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.011+0000 7fb1c163e700 1 -- 172.21.15.80:0/1931451722 shutdown_connections 2019-11-28T11:28:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.011+0000 7fb1c163e700 1 --2- 172.21.15.80:0/1931451722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1bc072620 0x7fb1bc164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.011+0000 7fb1c163e700 1 --2- 172.21.15.80:0/1931451722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb1bc06c0a0 0x7fb1bc072fa0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.011+0000 7fb1c163e700 1 -- 172.21.15.80:0/1931451722 shutdown_connections 2019-11-28T11:28:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.011+0000 7fb1c163e700 1 -- 172.21.15.80:0/1931451722 wait complete. 2019-11-28T11:28:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.011+0000 7fb1c163e700 1 -- 172.21.15.80:0/1931451722 >> 172.21.15.80:0/1931451722 conn(0x7fb1bc061cf0 msgr2=0x7fb1bc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.013+0000 7fb1c163e700 1 Processor -- start 2019-11-28T11:28:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.014+0000 7fb1c163e700 1 -- start start 2019-11-28T11:28:17.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1c163e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1bc1293f0 0x7fb1bc129880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:17.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1c163e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1bc07a340 0x7fb1bc07a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:17.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1c163e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1bc13f190 con 0x7fb1bc13e8e0 2019-11-28T11:28:17.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1c163e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1bc142d50 con 0x7fb1bc07a340 2019-11-28T11:28:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1c163e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc143020 con 0x7fb1bc1293f0 2019-11-28T11:28:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1bbfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1bc07a340 0x7fb1bc07a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1baffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1bc1293f0 0x7fb1bc129880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1bbfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1bc07a340 0x7fb1bc07a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:47858/0 (socket says 172.21.15.80:47858) 2019-11-28T11:28:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1bb7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fb1bc13e8e0 0x7fb1bc07b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:47828/0 (socket says 172.21.15.80:47828) 2019-11-28T11:28:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1bbfff700 1 -- 172.21.15.80:0/3042392683 learned_addr learned my addr 172.21.15.80:0/3042392683 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:17.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1bbfff700 1 -- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1bc1293f0 msgr2=0x7fb1bc129880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:17.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1bbfff700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1bc1293f0 0x7fb1bc129880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:17.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1bbfff700 1 -- 172.21.15.80:0/3042392683 >> v1:172.21.15.174:6789/0 conn(0x7fb1bc13e8e0 legacy=0x7fb1bc07b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:17.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1bbfff700 1 -- 172.21.15.80:0/3042392683 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc078c00 con 0x7fb1bc07a340 2019-11-28T11:28:17.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1b3fff700 1 -- 172.21.15.80:0/3042392683 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193399890 0 0) 0x7fb1a4008020 con 0x7fb1bc13e8e0 2019-11-28T11:28:17.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1baffd700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1bc1293f0 0x7fb1bc129880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:17.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.015+0000 7fb1bbfff700 1 --2- 172.21.15.80:0/3042392683 >> v2:172.21.15.174:3300/0 conn(0x7fb1bc07a340 0x7fb1bc07a7e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb1b4010460 tx=0x7fb1b4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:17.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.016+0000 7fb1bbfff700 1 --2- 172.21.15.80:0/3042392683 >> v2:172.21.15.174:3300/0 conn(0x7fb1bc07a340 0x7fb1bc07a7e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb1b4010460 tx=0x7fb1b4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:17.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.016+0000 7fb1bbfff700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc07a340 0x7fb1bc07a7e0 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7fb1b4010460 tx=0x7fb1b4010800).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:17.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.016+0000 7fb1bbfff700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc07a340 0x7fb1bc07a7e0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fb1b4010460 tx=0x7fb1b4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:17.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.016+0000 7fb1b3fff700 1 -- 172.21.15.80:0/3042392683 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1b4002b20 con 0x7fb1bc07a340 2019-11-28T11:28:17.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.016+0000 7fb1bbfff700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc07a340 0x7fb1bc07a7e0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fb1b4010460 tx=0x7fb1b4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:17.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.016+0000 7fb1c163e700 1 -- 172.21.15.80:0/3042392683 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1bc078f80 con 0x7fb1bc07a340 2019-11-28T11:28:17.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.016+0000 7fb1b3fff700 1 -- 172.21.15.80:0/3042392683 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b40051d0 con 0x7fb1bc07a340 2019-11-28T11:28:17.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.016+0000 7fb1bbfff700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc07a340 0x7fb1bc07a7e0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fb1b4010460 tx=0x7fb1b4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:17.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.016+0000 7fb1b3fff700 1 -- 172.21.15.80:0/3042392683 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1b4002b20 con 0x7fb1bc07a340 2019-11-28T11:28:17.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.016+0000 7fb1c163e700 1 -- 172.21.15.80:0/3042392683 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1bc078c00 con 0x7fb1bc07a340 2019-11-28T11:28:17.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.016+0000 7fb1bbfff700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc07a340 0x7fb1bc07a7e0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fb1b4010460 tx=0x7fb1b4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:17.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.016+0000 7fb1bbfff700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc07a340 0x7fb1bc07a7e0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fb1b4010460 tx=0x7fb1b4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:17.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.016+0000 7fb1b3fff700 1 -- 172.21.15.80:0/3042392683 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb1b4005630 con 0x7fb1bc07a340 2019-11-28T11:28:17.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.017+0000 7fb1b3fff700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb194018730 0x7fb19401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:17.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.017+0000 7fb1b3fff700 1 -- 172.21.15.80:0/3042392683 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb1b4031ad0 con 0x7fb1bc07a340 2019-11-28T11:28:17.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.017+0000 7fb1bb7fe700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb194018730 0x7fb19401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:17.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.017+0000 7fb1bb7fe700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb194018730 0x7fb19401abc0 crc :-1 s=READY pgs=191 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:17.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.024+0000 7fb1c163e700 1 -- 172.21.15.80:0/3042392683 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1bc078f80 con 0x7fb1bc07a340 2019-11-28T11:28:17.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.028+0000 7fb1bbfff700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc07a340 0x7fb1bc07a7e0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fb1b4010460 tx=0x7fb1b4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:17.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.028+0000 7fb1b3fff700 1 -- 172.21.15.80:0/3042392683 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb1b40174d0 con 0x7fb1bc07a340 2019-11-28T11:28:17.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.199+0000 7fb1c163e700 1 -- 172.21.15.80:0/3042392683 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn"]} v 0) v1 -- 0x7fb1bc078c00 con 0x7fb1bc07a340 2019-11-28T11:28:17.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.557+0000 7fb1bbfff700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc07a340 0x7fb1bc07a7e0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fb1b4010460 tx=0x7fb1b4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:17.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.557+0000 7fb1b3fff700 1 -- 172.21.15.80:0/3042392683 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn"]}]=0 v102) v1 ==== 150+0+0 (secure 0 0 0) 0x7fb1b40177f0 con 0x7fb1bc07a340 2019-11-28T11:28:17.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.566+0000 7fb1c163e700 1 -- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb194018730 msgr2=0x7fb19401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:17.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.566+0000 7fb1c163e700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb194018730 0x7fb19401abc0 crc :-1 s=READY pgs=191 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:17.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.566+0000 7fb1c163e700 1 -- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc07a340 msgr2=0x7fb1bc07a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:17.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.566+0000 7fb1c163e700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc07a340 0x7fb1bc07a7e0 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7fb1b4010460 tx=0x7fb1b4010800).stop 2019-11-28T11:28:17.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.566+0000 7fb1c163e700 1 -- 172.21.15.80:0/3042392683 shutdown_connections 2019-11-28T11:28:17.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.566+0000 7fb1c163e700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1bc07a340 0x7fb1bc07a7e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:17.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.566+0000 7fb1c163e700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1bc1293f0 0x7fb1bc129880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:17.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.566+0000 7fb1c163e700 1 --2- 172.21.15.80:0/3042392683 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb194018730 0x7fb19401abc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:17.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.566+0000 7fb1c163e700 1 -- 172.21.15.80:0/3042392683 shutdown_connections 2019-11-28T11:28:17.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.566+0000 7fb1c163e700 1 -- 172.21.15.80:0/3042392683 wait complete. 2019-11-28T11:28:17.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:17.566+0000 7fb1c163e700 1 -- 172.21.15.80:0/3042392683 >> 172.21.15.80:0/3042392683 conn(0x7fb1bc13b860 msgr2=0x7fb1bc1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:17.603 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:28:17.603 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:17.670 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:17.731 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:17.791 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:17.847 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:17.916 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:17.976 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:28:17.976 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:28:17.977 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:28:17.977 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:28:17.977 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:28:17.978 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:28:17.978 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:28:17.983 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:28:17.983 DEBUG:teuthology.parallel:result is None 2019-11-28T11:28:17.984 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:28:17.985 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:28:17.985 DEBUG:teuthology.parallel:result is None 2019-11-28T11:28:17.985 DEBUG:teuthology.parallel:result is None 2019-11-28T11:28:17.985 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:28:17.986 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:28:17.986 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:28:18.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.161+0000 7fd475813700 1 Processor -- start 2019-11-28T11:28:18.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.161+0000 7fd475813700 1 -- start start 2019-11-28T11:28:18.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7fd475813700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd47006c0a0 0x7fd470072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:18.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7fd475813700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47006db00 con 0x7fd470072620 2019-11-28T11:28:18.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7fd475813700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47006e000 con 0x7fd4700734e0 2019-11-28T11:28:18.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7fd475813700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47006fd60 con 0x7fd47006c0a0 2019-11-28T11:28:18.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7fd46ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd470072620 0x7fd470164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60538/0 (socket says 172.21.15.80:60538) 2019-11-28T11:28:18.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7fd46ffff700 1 -- 172.21.15.80:0/243894314 learned_addr learned my addr 172.21.15.80:0/243894314 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:18.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/243894314 >> v2:172.21.15.80:3300/0 conn(0x7fd47006c0a0 0x7fd470072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7fd46effd700 1 -- 172.21.15.80:0/243894314 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413562288 0 0) 0x7fd4680014d0 con 0x7fd470072620 2019-11-28T11:28:18.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7fd46effd700 1 -- 172.21.15.80:0/243894314 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd45c002e80 con 0x7fd470072620 2019-11-28T11:28:18.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7fd46f7fe700 1 -- 172.21.15.80:0/243894314 >> v1:172.21.15.174:6789/0 conn(0x7fd4700734e0 legacy=0x7fd470071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7fd46f7fe700 1 -- 172.21.15.80:0/243894314 >> v1:172.21.15.80:6789/0 conn(0x7fd470072620 legacy=0x7fd470164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7fd46f7fe700 1 -- 172.21.15.80:0/243894314 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4700706c0 con 0x7fd47006c0a0 2019-11-28T11:28:18.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/243894314 >> v2:172.21.15.80:3300/0 conn(0x7fd47006c0a0 0x7fd470072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd46000af50 tx=0x7fd46000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/243894314 >> v2:172.21.15.80:3300/0 conn(0x7fd47006c0a0 0x7fd470072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd46000af50 tx=0x7fd46000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/243894314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd47006c0a0 0x7fd470072fa0 secure :-1 s=READY pgs=445 cs=0 l=1 rx=0x7fd46000af50 tx=0x7fd46000b760).ready entity=mon.0 client_cookie=69f8fd0a0b76f7d6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:18.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/243894314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd47006c0a0 0x7fd470072fa0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7fd46000af50 tx=0x7fd46000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7fd46effd700 1 -- 172.21.15.80:0/243894314 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd460000960 con 0x7fd47006c0a0 2019-11-28T11:28:18.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/243894314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd47006c0a0 0x7fd470072fa0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7fd46000af50 tx=0x7fd46000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/243894314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd47006c0a0 0x7fd470072fa0 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7fd46000af50 tx=0x7fd46000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7fd46effd700 1 -- 172.21.15.80:0/243894314 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd460009860 con 0x7fd47006c0a0 2019-11-28T11:28:18.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7fd475813700 1 -- 172.21.15.80:0/243894314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd47006c0a0 msgr2=0x7fd470072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7fd46effd700 1 -- 172.21.15.80:0/243894314 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd460009f30 con 0x7fd47006c0a0 2019-11-28T11:28:18.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7fd475813700 1 --2- 172.21.15.80:0/243894314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd47006c0a0 0x7fd470072fa0 secure :-1 s=READY pgs=445 cs=0 l=1 rx=0x7fd46000af50 tx=0x7fd46000b760).stop 2019-11-28T11:28:18.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.164+0000 7fd475813700 1 -- 172.21.15.80:0/243894314 shutdown_connections 2019-11-28T11:28:18.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.164+0000 7fd475813700 1 --2- 172.21.15.80:0/243894314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd47006c0a0 0x7fd470072fa0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.164+0000 7fd475813700 1 -- 172.21.15.80:0/243894314 shutdown_connections 2019-11-28T11:28:18.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.164+0000 7fd475813700 1 -- 172.21.15.80:0/243894314 wait complete. 2019-11-28T11:28:18.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.164+0000 7fd475813700 1 -- 172.21.15.80:0/243894314 >> 172.21.15.80:0/243894314 conn(0x7fd470061cf0 msgr2=0x7fd470064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:18.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.167+0000 7fd475813700 1 Processor -- start 2019-11-28T11:28:18.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.167+0000 7fd475813700 1 -- start start 2019-11-28T11:28:18.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.161+0000 7f09fc1be700 1 Processor -- start 2019-11-28T11:28:18.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.161+0000 7f09fc1be700 1 -- start start 2019-11-28T11:28:18.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7f09fc1be700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f09f406c0a0 0x7f09f4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:18.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7f09fc1be700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40734e0 0x7f09f4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:18.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7f09fc1be700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f406db00 con 0x7f09f4072360 2019-11-28T11:28:18.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7f09fc1be700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f406fd60 con 0x7f09f406c0a0 2019-11-28T11:28:18.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7f09fc1be700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f4070030 con 0x7f09f40734e0 2019-11-28T11:28:18.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7f09faf5c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f09f4072360 0x7f09f406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60530/0 (socket says 172.21.15.80:60530) 2019-11-28T11:28:18.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7f09faf5c700 1 -- 172.21.15.80:0/2870018163 learned_addr learned my addr 172.21.15.80:0/2870018163 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:18.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/2870018163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40734e0 0x7f09f4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09fa75b700 1 --2- 172.21.15.80:0/2870018163 >> v2:172.21.15.174:3300/0 conn(0x7f09f406c0a0 0x7f09f4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09f9759700 1 -- 172.21.15.80:0/2870018163 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025407930 0 0) 0x7f09f0001170 con 0x7f09f4072360 2019-11-28T11:28:18.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09f9759700 1 -- 172.21.15.80:0/2870018163 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09e0002e80 con 0x7f09f4072360 2019-11-28T11:28:18.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09f9f5a700 1 -- 172.21.15.80:0/2870018163 >> v2:172.21.15.174:3300/0 conn(0x7f09f406c0a0 msgr2=0x7f09f4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:18.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/2870018163 >> v2:172.21.15.174:3300/0 conn(0x7f09f406c0a0 0x7f09f4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:18.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09f9f5a700 1 -- 172.21.15.80:0/2870018163 >> v1:172.21.15.80:6789/0 conn(0x7f09f4072360 legacy=0x7f09f406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09f9f5a700 1 -- 172.21.15.80:0/2870018163 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f40706c0 con 0x7f09f40734e0 2019-11-28T11:28:18.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/2870018163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40734e0 0x7f09f4071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f09e800b2d0 tx=0x7f09e800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/2870018163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40734e0 0x7f09f4071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f09e800b2d0 tx=0x7f09e800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/2870018163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40734e0 0x7f09f4071e20 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f09e800b2d0 tx=0x7f09e800b5d0).ready entity=mon.2 client_cookie=33068fbf9b75437e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:18.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/2870018163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40734e0 0x7f09f4071e20 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f09e800b2d0 tx=0x7f09e800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09f9759700 1 -- 172.21.15.80:0/2870018163 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09e8007590 con 0x7f09f40734e0 2019-11-28T11:28:18.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/2870018163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40734e0 0x7f09f4071e20 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f09e800b2d0 tx=0x7f09e800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/2870018163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40734e0 0x7f09f4071e20 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f09e800b2d0 tx=0x7f09e800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09f9759700 1 -- 172.21.15.80:0/2870018163 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e8009d30 con 0x7f09f40734e0 2019-11-28T11:28:18.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09f9759700 1 -- 172.21.15.80:0/2870018163 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09e8009f20 con 0x7f09f40734e0 2019-11-28T11:28:18.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09fc1be700 1 -- 172.21.15.80:0/2870018163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40734e0 msgr2=0x7f09f4071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f09fc1be700 1 --2- 172.21.15.80:0/2870018163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40734e0 0x7f09f4071e20 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f09e800b2d0 tx=0x7f09e800b5d0).stop 2019-11-28T11:28:18.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.165+0000 7f09fc1be700 1 -- 172.21.15.80:0/2870018163 shutdown_connections 2019-11-28T11:28:18.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.165+0000 7f09fc1be700 1 --2- 172.21.15.80:0/2870018163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f09f40734e0 0x7f09f4071e20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.165+0000 7f09fc1be700 1 --2- 172.21.15.80:0/2870018163 >> v2:172.21.15.174:3300/0 conn(0x7f09f406c0a0 0x7f09f4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:18.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.165+0000 7f09fc1be700 1 -- 172.21.15.80:0/2870018163 shutdown_connections 2019-11-28T11:28:18.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.165+0000 7f09fc1be700 1 -- 172.21.15.80:0/2870018163 wait complete. 2019-11-28T11:28:18.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.165+0000 7f09fc1be700 1 -- 172.21.15.80:0/2870018163 >> 172.21.15.80:0/2870018163 conn(0x7f09f4061cf0 msgr2=0x7f09f4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:18.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.167+0000 7f09fc1be700 1 Processor -- start 2019-11-28T11:28:18.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.167+0000 7f09fc1be700 1 -- start start 2019-11-28T11:28:18.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f09fc1be700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09f413dc00 0x7f09f4109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:18.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.161+0000 7f95b8fe9700 1 Processor -- start 2019-11-28T11:28:18.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.161+0000 7f95b8fe9700 1 -- start start 2019-11-28T11:28:18.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7f95b8fe9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f95b406c490 0x7f95b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:18.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7f95b8fe9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b405daa0 con 0x7f95b406ce60 2019-11-28T11:28:18.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7f95b8fe9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b406db00 con 0x7f95b406c0a0 2019-11-28T11:28:18.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7f95b8fe9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b406fd60 con 0x7f95b406c490 2019-11-28T11:28:18.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7f95b359e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f95b406ce60 0x7f95b4164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60540/0 (socket says 172.21.15.80:60540) 2019-11-28T11:28:18.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.162+0000 7f95b359e700 1 -- 172.21.15.80:0/1309398117 learned_addr learned my addr 172.21.15.80:0/1309398117 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:18.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f95b259c700 1 --2- 172.21.15.80:0/1309398117 >> v2:172.21.15.174:3300/0 conn(0x7f95b406c490 0x7f95b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f95b1d9b700 1 -- 172.21.15.80:0/1309398117 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854283975 0 0) 0x7f95ac0014d0 con 0x7f95b406ce60 2019-11-28T11:28:18.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f95b1d9b700 1 -- 172.21.15.80:0/1309398117 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f959c002e80 con 0x7f95b406ce60 2019-11-28T11:28:18.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f95b259c700 1 -- 172.21.15.80:0/1309398117 >> v1:172.21.15.174:6789/0 conn(0x7f95b406c0a0 legacy=0x7f95b4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f95b259c700 1 -- 172.21.15.80:0/1309398117 >> v1:172.21.15.80:6789/0 conn(0x7f95b406ce60 legacy=0x7f95b4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f95b259c700 1 -- 172.21.15.80:0/1309398117 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b40706c0 con 0x7f95b406c490 2019-11-28T11:28:18.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f95b259c700 1 --2- 172.21.15.80:0/1309398117 >> v2:172.21.15.174:3300/0 conn(0x7f95b406c490 0x7f95b406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f95a800af50 tx=0x7f95a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f95b259c700 1 --2- 172.21.15.80:0/1309398117 >> v2:172.21.15.174:3300/0 conn(0x7f95b406c490 0x7f95b406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f95a800af50 tx=0x7f95a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.163+0000 7f95b259c700 1 --2- 172.21.15.80:0/1309398117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95b406c490 0x7f95b406c920 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7f95a800af50 tx=0x7f95a800b760).ready entity=mon.1 client_cookie=89e3b8c16360c56b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:18.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.164+0000 7f95b259c700 1 --2- 172.21.15.80:0/1309398117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95b406c490 0x7f95b406c920 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f95a800af50 tx=0x7f95a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.164+0000 7f95b1d9b700 1 -- 172.21.15.80:0/1309398117 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95a8000960 con 0x7f95b406c490 2019-11-28T11:28:18.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.164+0000 7f95b259c700 1 --2- 172.21.15.80:0/1309398117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95b406c490 0x7f95b406c920 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f95a800af50 tx=0x7f95a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.164+0000 7f95b259c700 1 --2- 172.21.15.80:0/1309398117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95b406c490 0x7f95b406c920 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f95a800af50 tx=0x7f95a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.164+0000 7f95b1d9b700 1 -- 172.21.15.80:0/1309398117 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a8009860 con 0x7f95b406c490 2019-11-28T11:28:18.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.164+0000 7f95b1d9b700 1 -- 172.21.15.80:0/1309398117 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95a8009f30 con 0x7f95b406c490 2019-11-28T11:28:18.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.164+0000 7f95b8fe9700 1 -- 172.21.15.80:0/1309398117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95b406c490 msgr2=0x7f95b406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.164+0000 7f95b8fe9700 1 --2- 172.21.15.80:0/1309398117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95b406c490 0x7f95b406c920 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7f95a800af50 tx=0x7f95a800b760).stop 2019-11-28T11:28:18.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.165+0000 7f95b8fe9700 1 -- 172.21.15.80:0/1309398117 shutdown_connections 2019-11-28T11:28:18.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.165+0000 7f95b8fe9700 1 --2- 172.21.15.80:0/1309398117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95b406c490 0x7f95b406c920 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.165+0000 7f95b8fe9700 1 -- 172.21.15.80:0/1309398117 shutdown_connections 2019-11-28T11:28:18.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.165+0000 7f95b8fe9700 1 -- 172.21.15.80:0/1309398117 wait complete. 2019-11-28T11:28:18.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.165+0000 7f95b8fe9700 1 -- 172.21.15.80:0/1309398117 >> 172.21.15.80:0/1309398117 conn(0x7f95b4061cf0 msgr2=0x7f95b4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:18.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.167+0000 7f95b8fe9700 1 Processor -- start 2019-11-28T11:28:18.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.167+0000 7f95b8fe9700 1 -- start start 2019-11-28T11:28:18.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f09fc1be700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f09f410a3a0 0x7f09f4108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:18.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f09fc1be700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f41312c0 con 0x7f09f4109220 2019-11-28T11:28:18.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f09fc1be700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f4105830 con 0x7f09f413dc00 2019-11-28T11:28:18.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f09fc1be700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f4105b00 con 0x7f09f410a3a0 2019-11-28T11:28:18.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f09fa75b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09f413dc00 0x7f09f4109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f09fa75b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09f413dc00 0x7f09f4109e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32994/0 (socket says 172.21.15.80:32994) 2019-11-28T11:28:18.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f09faf5c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f09f4109220 0x7f09f4103000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60546/0 (socket says 172.21.15.80:60546) 2019-11-28T11:28:18.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f09fa75b700 1 -- 172.21.15.80:0/1009263923 learned_addr learned my addr 172.21.15.80:0/1009263923 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:18.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/1009263923 >> v2:172.21.15.174:3300/0 conn(0x7f09f410a3a0 0x7f09f4108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f09f9f5a700 1 -- 172.21.15.80:0/1009263923 >> v2:172.21.15.80:3300/0 conn(0x7f09f413dc00 msgr2=0x7f09f4109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/1009263923 >> v2:172.21.15.80:3300/0 conn(0x7f09f413dc00 0x7f09f4109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f09f9f5a700 1 -- 172.21.15.80:0/1009263923 >> v1:172.21.15.80:6789/0 conn(0x7f09f4109220 legacy=0x7f09f4103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f09f9f5a700 1 -- 172.21.15.80:0/1009263923 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f4106190 con 0x7f09f410a3a0 2019-11-28T11:28:18.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/1009263923 >> v2:172.21.15.174:3300/0 conn(0x7f09f410a3a0 0x7f09f4108ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f09e8054710 tx=0x7f09e800b510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/1009263923 >> v2:172.21.15.174:3300/0 conn(0x7f09f410a3a0 0x7f09f4108ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f09e8054710 tx=0x7f09e800b510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09f410a3a0 0x7f09f4108ce0 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7f09e8054710 tx=0x7f09e800b510).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:18.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09f410a3a0 0x7f09f4108ce0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f09e8054710 tx=0x7f09e800b510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09f410a3a0 0x7f09f4108ce0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f09e8054710 tx=0x7f09e800b510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09f410a3a0 0x7f09f4108ce0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f09e8054710 tx=0x7f09e800b510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f09e6ffd700 1 -- 172.21.15.80:0/1009263923 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09e8000cc0 con 0x7f09f410a3a0 2019-11-28T11:28:18.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f09e6ffd700 1 -- 172.21.15.80:0/1009263923 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e8009d00 con 0x7f09f410a3a0 2019-11-28T11:28:18.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f09fc1be700 1 -- 172.21.15.80:0/1009263923 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f4106510 con 0x7f09f410a3a0 2019-11-28T11:28:18.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f09e6ffd700 1 -- 172.21.15.80:0/1009263923 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09e800afb0 con 0x7f09f410a3a0 2019-11-28T11:28:18.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f09fc1be700 1 -- 172.21.15.80:0/1009263923 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f4106190 con 0x7f09f410a3a0 2019-11-28T11:28:18.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09f410a3a0 0x7f09f4108ce0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f09e8054710 tx=0x7f09e800b510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.170+0000 7f09e6ffd700 1 -- 172.21.15.80:0/1009263923 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f09e800af30 con 0x7f09f410a3a0 2019-11-28T11:28:18.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.170+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09f410a3a0 0x7f09f4108ce0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f09e8054710 tx=0x7f09e800b510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.170+0000 7f09e6ffd700 1 --2- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f09dc01cb50 0x7f09dc01f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:18.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.170+0000 7f09e6ffd700 1 -- 172.21.15.80:0/1009263923 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f09e8076060 con 0x7f09f410a3a0 2019-11-28T11:28:18.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.170+0000 7f09fa75b700 1 --2- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f09dc01cb50 0x7f09dc01f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.170+0000 7f09fa75b700 1 --2- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f09dc01cb50 0x7f09dc01f000 crc :-1 s=READY pgs=192 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:18.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.177+0000 7f09fc1be700 1 -- 172.21.15.80:0/1009263923 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f4106510 con 0x7f09f410a3a0 2019-11-28T11:28:18.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.181+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09f410a3a0 0x7f09f4108ce0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f09e8054710 tx=0x7f09e800b510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.181+0000 7f09e6ffd700 1 -- 172.21.15.80:0/1009263923 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f09e8009f70 con 0x7f09f410a3a0 2019-11-28T11:28:18.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7fd475813700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd470157100 0x7fd47007aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:18.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7fd475813700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd47007b1e0 0x7fd470126fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:18.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7fd475813700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47013dc70 con 0x7fd470127520 2019-11-28T11:28:18.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7fd475813700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47013a9b0 con 0x7fd470157100 2019-11-28T11:28:18.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7fd475813700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47013ac80 con 0x7fd47007b1e0 2019-11-28T11:28:18.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7fd46f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd470157100 0x7fd47007aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7fd46f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd470157100 0x7fd47007aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33000/0 (socket says 172.21.15.80:33000) 2019-11-28T11:28:18.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7fd46f7fe700 1 -- 172.21.15.80:0/2052782379 learned_addr learned my addr 172.21.15.80:0/2052782379 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:18.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7fd466ffd700 1 --2- 172.21.15.80:0/2052782379 >> v2:172.21.15.174:3300/0 conn(0x7fd47007b1e0 0x7fd470126fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7fd46f7fe700 1 -- 172.21.15.80:0/2052782379 >> v2:172.21.15.174:3300/0 conn(0x7fd47007b1e0 msgr2=0x7fd470126fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/2052782379 >> v2:172.21.15.174:3300/0 conn(0x7fd47007b1e0 0x7fd470126fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7fd46f7fe700 1 -- 172.21.15.80:0/2052782379 >> v1:172.21.15.80:6789/0 conn(0x7fd470127520 legacy=0x7fd470138340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7fd46f7fe700 1 -- 172.21.15.80:0/2052782379 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47013b310 con 0x7fd470157100 2019-11-28T11:28:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/2052782379 >> v2:172.21.15.80:3300/0 conn(0x7fd470157100 0x7fd47007aca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4600104a0 tx=0x7fd4600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/2052782379 >> v2:172.21.15.80:3300/0 conn(0x7fd470157100 0x7fd47007aca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4600104a0 tx=0x7fd4600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/2052782379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd470157100 0x7fd47007aca0 secure :-1 s=READY pgs=448 cs=0 l=1 rx=0x7fd4600104a0 tx=0x7fd4600102a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/2052782379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd470157100 0x7fd47007aca0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7fd4600104a0 tx=0x7fd4600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/2052782379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd470157100 0x7fd47007aca0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7fd4600104a0 tx=0x7fd4600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/2052782379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd470157100 0x7fd47007aca0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7fd4600104a0 tx=0x7fd4600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7fd46cff9700 1 -- 172.21.15.80:0/2052782379 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd460000940 con 0x7fd470157100 2019-11-28T11:28:18.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7fd46cff9700 1 -- 172.21.15.80:0/2052782379 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd460009980 con 0x7fd470157100 2019-11-28T11:28:18.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7fd46cff9700 1 -- 172.21.15.80:0/2052782379 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd46000a010 con 0x7fd470157100 2019-11-28T11:28:18.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.170+0000 7fd475813700 1 -- 172.21.15.80:0/2052782379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47013b690 con 0x7fd470157100 2019-11-28T11:28:18.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.170+0000 7fd475813700 1 -- 172.21.15.80:0/2052782379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47013b310 con 0x7fd470157100 2019-11-28T11:28:18.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.170+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/2052782379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd470157100 0x7fd47007aca0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7fd4600104a0 tx=0x7fd4600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.171+0000 7fd46cff9700 1 -- 172.21.15.80:0/2052782379 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd460009580 con 0x7fd470157100 2019-11-28T11:28:18.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.171+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/2052782379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd470157100 0x7fd47007aca0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7fd4600104a0 tx=0x7fd4600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.171+0000 7fd46cff9700 1 --2- 172.21.15.80:0/2052782379 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd454018730 0x7fd45401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:18.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.171+0000 7fd46cff9700 1 -- 172.21.15.80:0/2052782379 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd460031ad0 con 0x7fd470157100 2019-11-28T11:28:18.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.171+0000 7fd466ffd700 1 --2- 172.21.15.80:0/2052782379 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd454018730 0x7fd45401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.171+0000 7fd466ffd700 1 --2- 172.21.15.80:0/2052782379 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd454018730 0x7fd45401abc0 crc :-1 s=READY pgs=194 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:18.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.177+0000 7fd475813700 1 -- 172.21.15.80:0/2052782379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47013b690 con 0x7fd470157100 2019-11-28T11:28:18.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.180+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/2052782379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd470157100 0x7fd47007aca0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7fd4600104a0 tx=0x7fd4600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.180+0000 7fd46cff9700 1 -- 172.21.15.80:0/2052782379 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd46000a230 con 0x7fd470157100 2019-11-28T11:28:18.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f95b8fe9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b4111db0 0x7f95b41238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:18.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f95b8fe9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95b4165a00 0x7f95b4167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:18.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f95b8fe9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b4124260 con 0x7f95b412cea0 2019-11-28T11:28:18.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f95b8fe9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b4121040 con 0x7f95b4165a00 2019-11-28T11:28:18.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f95b8fe9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b4121310 con 0x7f95b4111db0 2019-11-28T11:28:18.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f95b359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95b4165a00 0x7f95b4167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f95b259c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b4111db0 0x7f95b41238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f95b359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95b4165a00 0x7f95b4167e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33006/0 (socket says 172.21.15.80:33006) 2019-11-28T11:28:18.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f95b259c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b4111db0 0x7f95b41238e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:35268/0 (socket says 172.21.15.80:35268) 2019-11-28T11:28:18.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.168+0000 7f95b359e700 1 -- 172.21.15.80:0/1692469577 learned_addr learned my addr 172.21.15.80:0/1692469577 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:18.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f95b259c700 1 -- 172.21.15.80:0/1692469577 >> v2:172.21.15.80:3300/0 conn(0x7f95b4165a00 msgr2=0x7f95b4167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f95b259c700 1 --2- 172.21.15.80:0/1692469577 >> v2:172.21.15.80:3300/0 conn(0x7f95b4165a00 0x7f95b4167e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f95b259c700 1 -- 172.21.15.80:0/1692469577 >> v1:172.21.15.174:6789/0 conn(0x7f95b412cea0 legacy=0x7f95b41230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f95b259c700 1 -- 172.21.15.80:0/1692469577 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b41219a0 con 0x7f95b4111db0 2019-11-28T11:28:18.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f95b259c700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b4111db0 0x7f95b41238e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f95a80103d0 tx=0x7f95a8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f95b259c700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b4111db0 0x7f95b41238e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f95a80103d0 tx=0x7f95a8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f95b259c700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b4111db0 0x7f95b41238e0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f95a80103d0 tx=0x7f95a8010770).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:18.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f95b259c700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b4111db0 0x7f95b41238e0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f95a80103d0 tx=0x7f95a8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f95b259c700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b4111db0 0x7f95b41238e0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f95a80103d0 tx=0x7f95a8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f95a37fe700 1 -- 172.21.15.80:0/1692469577 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95a8000940 con 0x7f95b4111db0 2019-11-28T11:28:18.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f95b259c700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b4111db0 0x7f95b41238e0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f95a80103d0 tx=0x7f95a8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f95a37fe700 1 -- 172.21.15.80:0/1692469577 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a8009980 con 0x7f95b4111db0 2019-11-28T11:28:18.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f95a37fe700 1 -- 172.21.15.80:0/1692469577 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95a800a050 con 0x7f95b4111db0 2019-11-28T11:28:18.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f95b8fe9700 1 -- 172.21.15.80:0/1692469577 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b4121d20 con 0x7f95b4111db0 2019-11-28T11:28:18.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.169+0000 7f95b8fe9700 1 -- 172.21.15.80:0/1692469577 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b41219a0 con 0x7f95b4111db0 2019-11-28T11:28:18.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.170+0000 7f95b259c700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b4111db0 0x7f95b41238e0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f95a80103d0 tx=0x7f95a8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.170+0000 7f95b259c700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b4111db0 0x7f95b41238e0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f95a80103d0 tx=0x7f95a8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.170+0000 7f95a37fe700 1 -- 172.21.15.80:0/1692469577 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f95a8009b70 con 0x7f95b4111db0 2019-11-28T11:28:18.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.170+0000 7f95a37fe700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9598018730 0x7f959801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:18.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.170+0000 7f95a37fe700 1 -- 172.21.15.80:0/1692469577 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f95a8031ce0 con 0x7f95b4111db0 2019-11-28T11:28:18.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.170+0000 7f95b2d9d700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9598018730 0x7f959801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.171+0000 7f95b2d9d700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9598018730 0x7f959801abe0 crc :-1 s=READY pgs=193 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:18.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.177+0000 7f95b8fe9700 1 -- 172.21.15.80:0/1692469577 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958c002e60 con 0x7f95b4111db0 2019-11-28T11:28:18.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.181+0000 7f95b259c700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b4111db0 0x7f95b41238e0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f95a80103d0 tx=0x7f95a8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.181+0000 7f95a37fe700 1 -- 172.21.15.80:0/1692469577 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f95a8031a30 con 0x7f95b4111db0 2019-11-28T11:28:18.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.363+0000 7f95b8fe9700 1 -- 172.21.15.80:0/1692469577 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f958c001d10 con 0x7f95b4111db0 2019-11-28T11:28:18.431 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:28:18.441 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:28:18.453 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:28:18.464 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:28:18.473 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:28:18.478 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:28:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.538+0000 7fd475813700 1 -- 172.21.15.80:0/2052782379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fd47013b310 con 0x7fd470157100 2019-11-28T11:28:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.539+0000 7f09fc1be700 1 -- 172.21.15.80:0/1009263923 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f09f4106190 con 0x7f09f410a3a0 2019-11-28T11:28:18.582 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:28:18.555+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:28:18.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.562+0000 7fd46f7fe700 1 --2- 172.21.15.80:0/2052782379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd470157100 0x7fd47007aca0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7fd4600104a0 tx=0x7fd4600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.562+0000 7fd46cff9700 1 -- 172.21.15.80:0/2052782379 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5124 v15) v1 ==== 95+0+0 (secure 0 0 0) 0x7fd460009580 con 0x7fd470157100 2019-11-28T11:28:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.563+0000 7f09f9f5a700 1 --2- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09f410a3a0 0x7f09f4108ce0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f09e8054710 tx=0x7f09e800b510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.563+0000 7f09e6ffd700 1 -- 172.21.15.80:0/1009263923 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 5121 v15) v1 ==== 95+0+0 (secure 0 0 0) 0x7f09e8009d00 con 0x7f09f410a3a0 2019-11-28T11:28:18.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.563+0000 7f95b259c700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b4111db0 0x7f95b41238e0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f95a80103d0 tx=0x7f95a8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.563+0000 7f95a37fe700 1 -- 172.21.15.80:0/1692469577 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 5008 v15) v1 ==== 95+0+0 (secure 0 0 0) 0x7f95a8009960 con 0x7f95b4111db0 2019-11-28T11:28:18.596 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 5124 2019-11-28T11:28:18.597 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 5121 2019-11-28T11:28:18.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.572+0000 7fd475813700 1 -- 172.21.15.80:0/2052782379 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd454018730 msgr2=0x7fd45401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.572+0000 7fd475813700 1 --2- 172.21.15.80:0/2052782379 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd454018730 0x7fd45401abc0 crc :-1 s=READY pgs=194 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.572+0000 7fd475813700 1 -- 172.21.15.80:0/2052782379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd470157100 msgr2=0x7fd47007aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.572+0000 7fd475813700 1 --2- 172.21.15.80:0/2052782379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd470157100 0x7fd47007aca0 secure :-1 s=READY pgs=448 cs=0 l=1 rx=0x7fd4600104a0 tx=0x7fd4600102a0).stop 2019-11-28T11:28:18.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.572+0000 7fd475813700 1 -- 172.21.15.80:0/2052782379 shutdown_connections 2019-11-28T11:28:18.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.572+0000 7fd475813700 1 --2- 172.21.15.80:0/2052782379 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd454018730 0x7fd45401abc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.572+0000 7fd475813700 1 --2- 172.21.15.80:0/2052782379 >> v2:172.21.15.174:3300/0 conn(0x7fd47007b1e0 0x7fd470126fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.572+0000 7fd475813700 1 --2- 172.21.15.80:0/2052782379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd470157100 0x7fd47007aca0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.572+0000 7fd475813700 1 -- 172.21.15.80:0/2052782379 shutdown_connections 2019-11-28T11:28:18.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.572+0000 7fd475813700 1 -- 172.21.15.80:0/2052782379 wait complete. 2019-11-28T11:28:18.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.572+0000 7fd475813700 1 -- 172.21.15.80:0/2052782379 >> 172.21.15.80:0/2052782379 conn(0x7fd4701414a0 msgr2=0x7fd470141890 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:18.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.573+0000 7f09fc1be700 1 -- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f09dc01cb50 msgr2=0x7f09dc01f000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.573+0000 7f09fc1be700 1 --2- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f09dc01cb50 0x7f09dc01f000 crc :-1 s=READY pgs=192 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.573+0000 7f09fc1be700 1 -- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09f410a3a0 msgr2=0x7f09f4108ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.573+0000 7f09fc1be700 1 --2- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09f410a3a0 0x7f09f4108ce0 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7f09e8054710 tx=0x7f09e800b510).stop 2019-11-28T11:28:18.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.573+0000 7f09fc1be700 1 -- 172.21.15.80:0/1009263923 shutdown_connections 2019-11-28T11:28:18.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.573+0000 7f09fc1be700 1 --2- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f09dc01cb50 0x7f09dc01f000 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.573+0000 7f09fc1be700 1 --2- 172.21.15.80:0/1009263923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f09f410a3a0 0x7f09f4108ce0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.573+0000 7f09fc1be700 1 --2- 172.21.15.80:0/1009263923 >> v2:172.21.15.80:3300/0 conn(0x7f09f413dc00 0x7f09f4109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.573+0000 7f09fc1be700 1 -- 172.21.15.80:0/1009263923 shutdown_connections 2019-11-28T11:28:18.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.573+0000 7f09fc1be700 1 -- 172.21.15.80:0/1009263923 wait complete. 2019-11-28T11:28:18.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.573+0000 7f09fc1be700 1 -- 172.21.15.80:0/1009263923 >> 172.21.15.80:0/1009263923 conn(0x7f09f411bfc0 msgr2=0x7f09f4141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:18.611 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 5008 2019-11-28T11:28:18.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.580+0000 7f95b8fe9700 1 -- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9598018730 msgr2=0x7f959801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.580+0000 7f95b8fe9700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9598018730 0x7f959801abe0 crc :-1 s=READY pgs=193 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.580+0000 7f95b8fe9700 1 -- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b4111db0 msgr2=0x7f95b41238e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.580+0000 7f95b8fe9700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b4111db0 0x7f95b41238e0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f95a80103d0 tx=0x7f95a8010770).stop 2019-11-28T11:28:18.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.580+0000 7f95b8fe9700 1 -- 172.21.15.80:0/1692469577 shutdown_connections 2019-11-28T11:28:18.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.580+0000 7f95b8fe9700 1 --2- 172.21.15.80:0/1692469577 >> v2:172.21.15.80:3300/0 conn(0x7f95b4165a00 0x7f95b4167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.580+0000 7f95b8fe9700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95b4111db0 0x7f95b41238e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.580+0000 7f95b8fe9700 1 --2- 172.21.15.80:0/1692469577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9598018730 0x7f959801abe0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.580+0000 7f95b8fe9700 1 -- 172.21.15.80:0/1692469577 shutdown_connections 2019-11-28T11:28:18.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.580+0000 7f95b8fe9700 1 -- 172.21.15.80:0/1692469577 wait complete. 2019-11-28T11:28:18.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.580+0000 7f95b8fe9700 1 -- 172.21.15.80:0/1692469577 >> 172.21.15.80:0/1692469577 conn(0x7f95b41426c0 msgr2=0x7f95b4110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:18.614 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:28:18.615 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:28:18.617 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:28:18.618 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:28:18.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.776+0000 7f9bc0c29700 1 Processor -- start 2019-11-28T11:28:18.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.776+0000 7f9bc0c29700 1 -- start start 2019-11-28T11:28:18.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.777+0000 7f9bc0c29700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9bbc06c490 0x7f9bbc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:18.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.777+0000 7f9bc0c29700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc06ce60 0x7f9bbc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:18.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.777+0000 7f9bc0c29700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc06db00 con 0x7f9bbc06c0a0 2019-11-28T11:28:18.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.777+0000 7f9bc0c29700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc06fd60 con 0x7f9bbc06c490 2019-11-28T11:28:18.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.777+0000 7f9bc0c29700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc070030 con 0x7f9bbc06ce60 2019-11-28T11:28:18.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.777+0000 7f9bbb59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc06ce60 0x7f9bbc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.777+0000 7f9bba59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9bbc06c490 0x7f9bbc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.777+0000 7f9bba59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9bbc06c490 0x7f9bbc06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:47908/0 (socket says 172.21.15.80:47908) 2019-11-28T11:28:18.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.777+0000 7f9bbb59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc06ce60 0x7f9bbc164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:35280/0 (socket says 172.21.15.80:35280) 2019-11-28T11:28:18.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.777+0000 7f9bba59c700 1 -- 172.21.15.80:0/2163510992 learned_addr learned my addr 172.21.15.80:0/2163510992 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:18.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.778+0000 7f9bbb59e700 1 -- 172.21.15.80:0/2163510992 >> v2:172.21.15.174:3300/0 conn(0x7f9bbc06c490 msgr2=0x7f9bbc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:18.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.778+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/2163510992 >> v2:172.21.15.174:3300/0 conn(0x7f9bbc06c490 0x7f9bbc06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:18.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.778+0000 7f9bbb59e700 1 -- 172.21.15.80:0/2163510992 >> v1:172.21.15.174:6789/0 conn(0x7f9bbc06c0a0 legacy=0x7f9bbc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.778+0000 7f9bbb59e700 1 -- 172.21.15.80:0/2163510992 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc0706c0 con 0x7f9bbc06ce60 2019-11-28T11:28:18.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.778+0000 7f9bba59c700 1 --2- 172.21.15.80:0/2163510992 >> v2:172.21.15.174:3300/0 conn(0x7f9bbc06c490 0x7f9bbc06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:18.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.778+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/2163510992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc06ce60 0x7f9bbc164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9bb400af80 tx=0x7f9bb400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.778+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/2163510992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc06ce60 0x7f9bbc164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9bb400af80 tx=0x7f9bb400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.778+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/2163510992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc06ce60 0x7f9bbc164d70 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f9bb400af80 tx=0x7f9bb400b790).ready entity=mon.2 client_cookie=44fcdd6156647ef server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:18.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.778+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/2163510992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc06ce60 0x7f9bbc164d70 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f9bb400af80 tx=0x7f9bb400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.778+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/2163510992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc06ce60 0x7f9bbc164d70 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f9bb400af80 tx=0x7f9bb400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.778+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/2163510992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc06ce60 0x7f9bbc164d70 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f9bb400af80 tx=0x7f9bb400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.778+0000 7f9bb9d9b700 1 -- 172.21.15.80:0/2163510992 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bb4000bc0 con 0x7f9bbc06ce60 2019-11-28T11:28:18.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.778+0000 7f9bb9d9b700 1 -- 172.21.15.80:0/2163510992 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb40097f0 con 0x7f9bbc06ce60 2019-11-28T11:28:18.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.778+0000 7f9bb9d9b700 1 -- 172.21.15.80:0/2163510992 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bb4009ec0 con 0x7f9bbc06ce60 2019-11-28T11:28:18.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.778+0000 7f9bc0c29700 1 -- 172.21.15.80:0/2163510992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc06ce60 msgr2=0x7f9bbc164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.778+0000 7f9bc0c29700 1 --2- 172.21.15.80:0/2163510992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc06ce60 0x7f9bbc164d70 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f9bb400af80 tx=0x7f9bb400b790).stop 2019-11-28T11:28:18.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.779+0000 7f9bc0c29700 1 -- 172.21.15.80:0/2163510992 shutdown_connections 2019-11-28T11:28:18.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.779+0000 7f9bc0c29700 1 --2- 172.21.15.80:0/2163510992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc06ce60 0x7f9bbc164d70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.779+0000 7f9bc0c29700 1 --2- 172.21.15.80:0/2163510992 >> v2:172.21.15.174:3300/0 conn(0x7f9bbc06c490 0x7f9bbc06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:18.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.779+0000 7f9bc0c29700 1 -- 172.21.15.80:0/2163510992 shutdown_connections 2019-11-28T11:28:18.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.779+0000 7f9bc0c29700 1 -- 172.21.15.80:0/2163510992 wait complete. 2019-11-28T11:28:18.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.779+0000 7f9bc0c29700 1 -- 172.21.15.80:0/2163510992 >> 172.21.15.80:0/2163510992 conn(0x7f9bbc061cf0 msgr2=0x7f9bbc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:18.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.782+0000 7f9bc0c29700 1 Processor -- start 2019-11-28T11:28:18.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.782+0000 7f9bc0c29700 1 -- start start 2019-11-28T11:28:18.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.782+0000 7f9bc0c29700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9bbc109e40 0x7f9bbc10a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:18.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.782+0000 7f9bc0c29700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc10a810 0x7f9bbc105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:18.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.782+0000 7f9bc0c29700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc13f1e0 con 0x7f9bbc13eb40 2019-11-28T11:28:18.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.782+0000 7f9bc0c29700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc1234c0 con 0x7f9bbc109e40 2019-11-28T11:28:18.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.782+0000 7f9bc0c29700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc13e0d0 con 0x7f9bbc10a810 2019-11-28T11:28:18.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.782+0000 7f9bbad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9bbc13eb40 0x7f9bbc10afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60572/0 (socket says 172.21.15.80:60572) 2019-11-28T11:28:18.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bbad9d700 1 -- 172.21.15.80:0/1441917826 learned_addr learned my addr 172.21.15.80:0/1441917826 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:18.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bba59c700 1 --2- 172.21.15.80:0/1441917826 >> v2:172.21.15.174:3300/0 conn(0x7f9bbc109e40 0x7f9bbc10a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc10a810 0x7f9bbc105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bab7fe700 1 -- 172.21.15.80:0/1441917826 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896849383 0 0) 0x7f9bb0001110 con 0x7f9bbc13eb40 2019-11-28T11:28:18.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bab7fe700 1 -- 172.21.15.80:0/1441917826 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba0002e80 con 0x7f9bbc13eb40 2019-11-28T11:28:18.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bbb59e700 1 -- 172.21.15.80:0/1441917826 >> v2:172.21.15.174:3300/0 conn(0x7f9bbc109e40 msgr2=0x7f9bbc10a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/1441917826 >> v2:172.21.15.174:3300/0 conn(0x7f9bbc109e40 0x7f9bbc10a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:18.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bbb59e700 1 -- 172.21.15.80:0/1441917826 >> v1:172.21.15.80:6789/0 conn(0x7f9bbc13eb40 legacy=0x7f9bbc10afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:18.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bbb59e700 1 -- 172.21.15.80:0/1441917826 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc108700 con 0x7f9bbc10a810 2019-11-28T11:28:18.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc10a810 0x7f9bbc105210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9bb40103f0 tx=0x7f9bb4010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc10a810 0x7f9bbc105210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9bb40103f0 tx=0x7f9bb4010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc10a810 0x7f9bbc105210 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f9bb40103f0 tx=0x7f9bb4010220).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:18.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc10a810 0x7f9bbc105210 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f9bb40103f0 tx=0x7f9bb4010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bab7fe700 1 -- 172.21.15.80:0/1441917826 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bb4009990 con 0x7f9bbc10a810 2019-11-28T11:28:18.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc10a810 0x7f9bbc105210 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f9bb40103f0 tx=0x7f9bb4010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bab7fe700 1 -- 172.21.15.80:0/1441917826 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb40095b0 con 0x7f9bbc10a810 2019-11-28T11:28:18.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc10a810 0x7f9bbc105210 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f9bb40103f0 tx=0x7f9bb4010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bc0c29700 1 -- 172.21.15.80:0/1441917826 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc108a80 con 0x7f9bbc10a810 2019-11-28T11:28:18.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bab7fe700 1 -- 172.21.15.80:0/1441917826 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bb4009990 con 0x7f9bbc10a810 2019-11-28T11:28:18.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.783+0000 7f9bc0c29700 1 -- 172.21.15.80:0/1441917826 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc108700 con 0x7f9bbc10a810 2019-11-28T11:28:18.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.784+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc10a810 0x7f9bbc105210 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f9bb40103f0 tx=0x7f9bb4010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.784+0000 7f9bab7fe700 1 -- 172.21.15.80:0/1441917826 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9bb4009840 con 0x7f9bbc10a810 2019-11-28T11:28:18.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.784+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc10a810 0x7f9bbc105210 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f9bb40103f0 tx=0x7f9bb4010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.784+0000 7f9bab7fe700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ba0018770 0x7f9ba001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:18.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.784+0000 7f9bab7fe700 1 -- 172.21.15.80:0/1441917826 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f9bb40319a0 con 0x7f9bbc10a810 2019-11-28T11:28:18.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.784+0000 7f9bbad9d700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ba0018770 0x7f9ba001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:18.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.784+0000 7f9bbad9d700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ba0018770 0x7f9ba001abe0 crc :-1 s=READY pgs=195 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:18.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.791+0000 7f9bc0c29700 1 -- 172.21.15.80:0/1441917826 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc108a80 con 0x7f9bbc10a810 2019-11-28T11:28:18.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.795+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc10a810 0x7f9bbc105210 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f9bb40103f0 tx=0x7f9bb4010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.795+0000 7f9bab7fe700 1 -- 172.21.15.80:0/1441917826 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9bb4002c30 con 0x7f9bbc10a810 2019-11-28T11:28:18.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.971+0000 7f9bc0c29700 1 -- 172.21.15.80:0/1441917826 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9bbc108700 con 0x7f9bbc10a810 2019-11-28T11:28:18.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.972+0000 7f9bbb59e700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc10a810 0x7f9bbc105210 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f9bb40103f0 tx=0x7f9bb4010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:18.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.972+0000 7f9bab7fe700 1 -- 172.21.15.80:0/1441917826 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v39) v1 ==== 81+0+31763 (secure 0 0 0) 0x7f9bb40097a0 con 0x7f9bbc10a810 2019-11-28T11:28:19.001 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:19.002 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:28:19.002 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 39, 2019-11-28T11:28:19.002 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:28:19.002 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:28:19.002 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:28:18.545342+0000", 2019-11-28T11:28:19.002 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:28:19.002 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:28:19.003 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:28:19.003 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:28:19.003 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:28:19.003 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:28:19.003 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:28:19.003 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:28:19.004 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:28:19.004 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:28:19.004 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:28:19.004 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:28:19.004 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:28:19.004 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:28:19.005 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:28:19.005 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 5, 2019-11-28T11:28:19.005 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:28:19.005 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:28:19.005 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:28:19.006 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:28:19.006 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:28:19.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.006 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:28:19.007 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:28:19.007 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:28:19.007 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:28:19.007 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:28:19.008 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:28:19.008 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:28:19.008 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:28:19.009 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:28:19.009 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:28:19.009 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:28:19.009 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:28:19.010 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:28:19.010 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:28:19.010 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:28:19.010 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:28:19.010 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:28:19.010 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:28:19.011 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:28:19.011 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:28:19.011 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:28:19.011 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:28:19.011 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:28:19.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.012 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:28:19.012 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:28:19.012 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:28:19.012 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:28:19.013 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:28:19.013 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:28:19.013 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:28:19.013 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:28:19.013 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:28:19.013 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:28:19.013 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:28:19.014 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:28:19.014 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:28:19.015 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:28:19.015 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:28:19.015 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:28:19.016 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:28:19.016 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:28:19.016 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:28:19.016 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:28:19.016 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:28:19.016 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:28:19.020 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:28:19.020 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:28:19.020 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:28:19.020 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:28:19.021 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:28:19.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.022 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:28:19.022 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:28:19.022 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:28:19.023 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:28:19.024 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:28:19.024 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:28:19.024 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:28:19.024 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:28:19.024 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:28:19.024 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:28:19.025 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:28:19.025 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:28:19.025 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:28:19.025 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:28:19.025 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.026 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 4, 2019-11-28T11:28:19.026 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:28:19.026 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:26:02.362569+0000", 2019-11-28T11:28:19.026 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:28:19.026 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:28:19.026 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:28:19.026 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:28:19.027 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:28:19.027 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:28:19.027 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:28:19.027 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:28:19.027 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:28:19.027 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:28:19.027 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:28:19.028 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:28:19.028 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:28:19.028 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:28:19.028 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:28:19.028 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:28:19.028 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:28:19.028 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:28:19.029 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:28:19.029 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:28:19.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.029 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "35", 2019-11-28T11:28:19.029 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:28:19.029 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:28:19.029 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:28:19.030 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:28:19.030 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:28:19.030 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:28:19.030 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:28:19.030 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:28:19.030 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:28:19.030 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:28:19.031 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:28:19.031 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:28:19.032 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:28:19.032 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:28:19.032 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:28:19.032 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:28:19.032 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:28:19.032 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:28:19.033 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:28:19.033 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:28:19.033 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:28:19.033 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:28:19.033 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:28:19.033 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:28:19.033 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:28:19.034 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:28:19.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.034 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:28:19.034 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:28:19.034 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:28:19.034 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:28:19.034 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:28:19.035 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:28:19.035 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:28:19.035 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:28:19.035 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:28:19.036 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:28:19.036 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:28:19.036 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:28:19.036 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:28:19.036 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:28:19.037 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:28:19.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.037 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:28:19.037 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:28:19.037 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:28:19.037 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.037 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.038 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 5, 2019-11-28T11:28:19.038 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:28:19.038 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:26:03.001170+0000", 2019-11-28T11:28:19.038 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:28:19.038 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:28:19.038 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:28:19.039 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:28:19.039 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:28:19.040 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:28:19.040 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:28:19.040 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:28:19.040 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:28:19.041 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:28:19.041 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:28:19.041 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:28:19.041 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:28:19.041 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:28:19.041 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:28:19.041 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:28:19.042 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:28:19.042 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:28:19.042 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:28:19.042 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:28:19.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.042 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "36", 2019-11-28T11:28:19.042 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:28:19.043 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:28:19.043 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:28:19.043 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:28:19.043 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:28:19.043 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:28:19.044 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:28:19.044 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:28:19.044 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:28:19.044 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:28:19.044 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:28:19.044 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:28:19.045 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:28:19.045 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:28:19.045 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:28:19.045 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:28:19.045 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:28:19.045 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:28:19.045 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:28:19.046 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:28:19.046 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:28:19.046 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:28:19.046 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:28:19.046 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:28:19.046 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:28:19.047 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:28:19.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.047 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:28:19.047 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:28:19.047 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:28:19.048 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:28:19.048 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:28:19.048 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:28:19.049 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:28:19.050 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:28:19.050 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:28:19.050 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:28:19.050 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:28:19.050 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:28:19.050 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:28:19.051 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:28:19.051 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:28:19.051 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.051 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.051 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.052 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:28:19.052 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:28:19.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.052 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:28:19.052 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:28:19.052 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:28:19.053 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:28:19.053 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:28:19.053 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:28:19.053 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:28:19.053 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:28:19.053 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:28:19.053 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 33, 2019-11-28T11:28:19.054 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:28:19.054 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:28:19.054 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:28:19.054 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.054 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.054 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:28:19.055 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:28:19.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.055 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.055 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:28:19.055 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:28:19.056 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.056 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.056 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:28:19.056 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.057 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.057 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:28:19.057 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:28:19.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:28:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:28:19.059 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.059 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.060 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:28:19.060 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.060 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.060 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:28:19.061 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:28:19.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.061 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.061 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:28:19.061 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:28:19.061 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.062 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.062 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:28:19.062 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.062 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.063 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:28:19.063 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:28:19.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.063 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.064 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:28:19.064 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:28:19.064 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.064 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.064 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:28:19.065 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:28:19.065 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:28:19.065 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:28:19.065 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:28:19.065 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:28:19.065 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:28:19.065 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.066 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:28:19.066 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:28:19.066 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:28:19.067 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:28:19.067 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:28:19.067 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:28:19.067 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:28:19.067 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:28:19.067 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:28:19.067 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 32, 2019-11-28T11:28:19.068 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:28:19.068 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:28:19.068 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:28:19.068 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.068 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.068 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:28:19.069 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:28:19.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.070 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.070 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:28:19.070 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:28:19.070 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.070 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.071 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:28:19.071 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.071 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.071 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:28:19.071 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:28:19.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.072 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.072 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:28:19.072 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:28:19.072 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.072 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.073 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:28:19.073 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.073 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.073 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:28:19.073 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:28:19.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.074 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.074 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:28:19.074 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:28:19.074 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.074 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.075 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:28:19.075 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.075 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.077 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:28:19.077 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:28:19.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.077 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.077 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:28:19.077 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:28:19.078 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.078 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.078 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:28:19.078 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:28:19.078 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:28:19.078 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:28:19.079 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:28:19.079 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:28:19.079 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:28:19.079 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.080 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:28:19.083 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:28:19.084 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:28:19.084 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:28:19.085 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:28:19.085 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:28:19.085 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:28:19.085 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:28:19.086 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:28:19.086 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 33, 2019-11-28T11:28:19.086 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:28:19.086 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:28:19.087 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:28:19.087 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.087 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.087 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:28:19.087 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:28:19.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.088 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.088 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:28:19.088 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:28:19.088 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.088 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.089 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:28:19.089 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.089 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.089 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:28:19.089 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:28:19.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.090 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.090 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:28:19.090 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:28:19.090 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.091 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.091 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:28:19.091 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.092 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.092 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:28:19.092 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:28:19.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.093 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.093 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:28:19.093 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:28:19.093 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.093 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.094 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:28:19.094 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.094 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.094 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:28:19.094 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:28:19.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.095 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.095 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:28:19.095 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:28:19.096 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.096 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.096 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:28:19.096 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:28:19.096 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:28:19.096 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:28:19.097 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:28:19.097 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:28:19.097 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:28:19.097 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.097 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:28:19.098 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:28:19.098 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:28:19.098 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:28:19.098 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:28:19.098 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:28:19.098 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:28:19.098 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:28:19.098 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:28:19.099 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 33, 2019-11-28T11:28:19.099 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:28:19.099 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:28:19.099 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:28:19.099 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.099 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.100 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:28:19.100 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:28:19.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.100 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.100 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:28:19.101 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:28:19.103 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.103 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.103 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:28:19.103 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.104 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.104 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:28:19.104 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:28:19.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.105 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.106 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:28:19.106 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:28:19.106 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.106 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.107 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:28:19.107 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.107 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.108 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:28:19.108 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:28:19.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.109 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.109 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:28:19.109 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:28:19.109 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.110 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.110 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:28:19.110 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.111 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.111 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:28:19.111 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:28:19.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.112 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.112 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:28:19.112 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:28:19.112 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.113 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.113 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:28:19.113 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:28:19.114 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:28:19.114 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:28:19.114 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:28:19.114 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:28:19.114 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:28:19.115 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.116 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:28:19.117 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:28:19.117 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:28:19.117 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:28:19.120 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:28:19.121 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:28:19.121 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:28:19.121 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:28:19.121 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:28:19.122 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 33, 2019-11-28T11:28:19.122 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:28:19.122 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:28:19.122 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:28:19.123 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.123 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.125 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:28:19.125 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:28:19.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.125 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.126 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:28:19.126 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:28:19.126 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.126 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.127 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:28:19.127 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.127 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.128 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:28:19.128 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:28:19.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.129 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.129 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:28:19.133 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:28:19.133 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.133 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.134 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:28:19.134 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.134 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.134 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:28:19.135 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:28:19.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.135 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.136 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:28:19.136 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:28:19.136 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.136 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.137 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:28:19.137 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.137 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.138 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:28:19.138 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:28:19.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.140 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.140 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:28:19.140 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:28:19.141 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.141 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.141 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:28:19.142 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:28:19.142 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:28:19.142 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:28:19.142 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:28:19.143 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:28:19.143 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:28:19.143 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.144 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:28:19.144 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:28:19.144 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:28:19.144 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:28:19.145 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:28:19.145 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:28:19.145 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:28:19.145 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:28:19.146 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:28:19.146 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 33, 2019-11-28T11:28:19.146 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:28:19.146 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:28:19.147 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:28:19.147 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.147 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.148 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:28:19.148 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:28:19.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.149 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.149 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:28:19.149 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:28:19.149 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.150 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.150 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:28:19.150 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.151 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.151 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:28:19.151 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:28:19.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.152 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.152 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:28:19.152 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:28:19.152 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.153 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.153 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:28:19.153 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.154 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.154 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:28:19.154 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:28:19.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.155 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.155 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:28:19.155 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:28:19.155 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.156 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.156 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:28:19.156 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.157 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.157 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:28:19.157 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:28:19.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.158 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.158 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:28:19.158 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:28:19.158 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.159 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.159 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:28:19.160 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:28:19.160 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:28:19.160 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:28:19.160 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:28:19.161 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:28:19.161 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:28:19.161 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.162 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:28:19.162 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:28:19.162 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:28:19.162 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:28:19.163 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:28:19.163 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:28:19.163 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:28:19.163 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:28:19.163 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:28:19.164 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 33, 2019-11-28T11:28:19.164 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:28:19.164 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:28:19.164 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:28:19.165 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.165 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.165 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:28:19.165 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:28:19.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.166 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.166 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:28:19.167 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:28:19.167 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.167 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.167 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:28:19.168 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.168 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.168 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:28:19.169 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:28:19.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.169 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.169 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:28:19.170 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:28:19.170 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.170 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.171 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:28:19.171 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.171 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.172 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:28:19.172 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:28:19.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.173 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.173 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:28:19.173 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:28:19.173 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.173 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.174 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:28:19.174 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.175 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.175 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:28:19.175 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:28:19.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.176 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.176 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:28:19.176 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:28:19.176 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.176 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.177 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:28:19.177 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:28:19.177 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:28:19.177 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:28:19.178 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:28:19.178 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:28:19.178 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:28:19.178 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.179 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:28:19.179 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:28:19.179 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:28:19.180 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:28:19.180 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:28:19.180 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:28:19.180 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:28:19.180 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:28:19.181 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:28:19.181 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 34, 2019-11-28T11:28:19.181 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:28:19.181 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:28:19.182 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:28:19.182 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.182 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.182 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:28:19.183 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:28:19.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.183 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.183 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:28:19.184 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:28:19.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.184 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.185 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:28:19.185 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.185 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.185 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:28:19.186 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:28:19.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.186 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.186 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:28:19.187 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:28:19.187 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.187 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.188 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:28:19.188 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.188 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.188 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:28:19.189 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:28:19.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.189 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.190 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:28:19.190 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:28:19.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.190 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.191 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:28:19.191 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:19.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.191 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:19.191 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:28:19.192 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:28:19.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.192 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:19.193 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:28:19.193 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:28:19.193 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.193 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.194 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:28:19.194 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:28:19.194 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:28:19.194 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:28:19.195 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:28:19.195 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:28:19.195 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:28:19.195 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:19.196 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.196 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:28:19.196 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:28:19.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.197 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:28:19.197 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:28:19.197 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:28:19.197 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:28:19.197 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:28:19.198 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:28:19.198 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:28:19.198 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:28:19.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.198 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:28:19.199 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:28:19.199 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:28:19.199 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:28:19.199 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:28:19.199 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:28:19.199 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:28:19.200 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:28:19.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.200 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:28:19.200 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:28:19.201 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:28:19.201 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:28:19.201 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:28:19.201 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:28:19.201 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:28:19.201 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:28:19.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.202 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:28:19.202 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:28:19.202 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:28:19.203 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:28:19.203 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:28:19.203 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:28:19.204 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:28:19.204 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:28:19.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.205 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:28:19.205 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:28:19.205 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:28:19.205 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:28:19.206 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:28:19.206 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:28:19.206 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:28:19.206 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:28:19.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.207 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:28:19.207 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:28:19.207 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:28:19.208 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:28:19.208 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:28:19.208 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:28:19.208 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:28:19.209 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:28:19.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.209 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:28:19.209 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:28:19.209 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:28:19.210 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:28:19.210 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:28:19.210 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:28:19.210 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:28:19.210 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:28:19.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:19.211 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:28:19.211 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:28:19.211 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:28:19.211 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:28:19.211 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:28:19.211 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:28:19.211 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:28:19.212 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:28:19.212 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.212 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:28:19.212 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:28:19.212 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:28:19.212 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:28:19.212 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:28:19.213 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:28:19.213 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/2897820490": "2019-11-29T11:28:18.365178+0000", 2019-11-28T11:28:19.213 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/2897820490": "2019-11-29T11:28:18.365178+0000" 2019-11-28T11:28:19.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.213 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:28:19.213 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:28:19.213 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:28:19.213 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:28:19.214 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:28:19.214 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:28:19.214 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:28:19.214 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:28:19.214 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:28:19.214 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:28:19.214 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:28:19.215 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:28:19.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.215 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:28:19.215 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:28:19.215 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:28:19.215 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:28:19.215 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:28:19.216 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:28:19.216 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:28:19.216 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:19.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:19.216 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:28:19.216 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:28:19.216 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:28:19.217 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:28:19.217 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:28:19.217 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:28:19.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.976+0000 7f9bc0c29700 1 -- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ba0018770 msgr2=0x7f9ba001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:19.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.976+0000 7f9bc0c29700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ba0018770 0x7f9ba001abe0 crc :-1 s=READY pgs=195 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:19.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.976+0000 7f9bc0c29700 1 -- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc10a810 msgr2=0x7f9bbc105210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:19.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.976+0000 7f9bc0c29700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc10a810 0x7f9bbc105210 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f9bb40103f0 tx=0x7f9bb4010220).stop 2019-11-28T11:28:19.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.976+0000 7f9bc0c29700 1 -- 172.21.15.80:0/1441917826 shutdown_connections 2019-11-28T11:28:19.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.976+0000 7f9bc0c29700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ba0018770 0x7f9ba001abe0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:19.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.976+0000 7f9bc0c29700 1 --2- 172.21.15.80:0/1441917826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9bbc10a810 0x7f9bbc105210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:19.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.976+0000 7f9bc0c29700 1 --2- 172.21.15.80:0/1441917826 >> v2:172.21.15.174:3300/0 conn(0x7f9bbc109e40 0x7f9bbc10a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:19.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.977+0000 7f9bc0c29700 1 -- 172.21.15.80:0/1441917826 shutdown_connections 2019-11-28T11:28:19.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.977+0000 7f9bc0c29700 1 -- 172.21.15.80:0/1441917826 wait complete. 2019-11-28T11:28:19.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:18.977+0000 7f9bc0c29700 1 -- 172.21.15.80:0/1441917826 >> 172.21.15.80:0/1441917826 conn(0x7f9bbc11bfc0 msgr2=0x7f9bbc141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:19.220 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:28:19.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.313+0000 7faa87b5c700 1 Processor -- start 2019-11-28T11:28:19.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.313+0000 7faa87b5c700 1 -- start start 2019-11-28T11:28:19.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.314+0000 7faa87b5c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faa8006c490 0x7faa8006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:19.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.314+0000 7faa87b5c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faa8006ce60 0x7faa80164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:19.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa87b5c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8006db00 con 0x7faa8006c0a0 2019-11-28T11:28:19.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa87b5c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8006fd60 con 0x7faa8006ce60 2019-11-28T11:28:19.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa87b5c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa80070030 con 0x7faa8006c490 2019-11-28T11:28:19.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa868fa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faa8006ce60 0x7faa80164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:19.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa868fa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faa8006ce60 0x7faa80164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33034/0 (socket says 172.21.15.80:33034) 2019-11-28T11:28:19.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa868fa700 1 -- 172.21.15.80:0/1643112799 learned_addr learned my addr 172.21.15.80:0/1643112799 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:19.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa860f9700 1 --1- 172.21.15.80:0/1643112799 >> v1:172.21.15.80:6789/0 conn(0x7faa8006c0a0 0x7faa80072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60580/0 (socket says 172.21.15.80:60580) 2019-11-28T11:28:19.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa858f8700 1 --2- 172.21.15.80:0/1643112799 >> v2:172.21.15.174:3300/0 conn(0x7faa8006c490 0x7faa8006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:19.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa868fa700 1 -- 172.21.15.80:0/1643112799 >> v2:172.21.15.174:3300/0 conn(0x7faa8006c490 msgr2=0x7faa8006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:19.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa868fa700 1 --2- 172.21.15.80:0/1643112799 >> v2:172.21.15.174:3300/0 conn(0x7faa8006c490 0x7faa8006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:19.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa868fa700 1 -- 172.21.15.80:0/1643112799 >> v1:172.21.15.80:6789/0 conn(0x7faa8006c0a0 legacy=0x7faa80072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:19.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa868fa700 1 -- 172.21.15.80:0/1643112799 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa800706c0 con 0x7faa8006ce60 2019-11-28T11:28:19.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa858f8700 1 --2- 172.21.15.80:0/1643112799 >> v2:172.21.15.174:3300/0 conn(0x7faa8006c490 0x7faa8006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:19.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa868fa700 1 --2- 172.21.15.80:0/1643112799 >> v2:172.21.15.80:3300/0 conn(0x7faa8006ce60 0x7faa80164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faa7800f730 tx=0x7faa7800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa868fa700 1 --2- 172.21.15.80:0/1643112799 >> v2:172.21.15.80:3300/0 conn(0x7faa8006ce60 0x7faa80164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faa7800f730 tx=0x7faa7800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa868fa700 1 --2- 172.21.15.80:0/1643112799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa8006ce60 0x7faa80164d70 secure :-1 s=READY pgs=451 cs=0 l=1 rx=0x7faa7800f730 tx=0x7faa7800fad0).ready entity=mon.0 client_cookie=d97e5d62085393e9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:19.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa868fa700 1 --2- 172.21.15.80:0/1643112799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa8006ce60 0x7faa80164d70 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7faa7800f730 tx=0x7faa7800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa868fa700 1 --2- 172.21.15.80:0/1643112799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa8006ce60 0x7faa80164d70 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7faa7800f730 tx=0x7faa7800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa850f7700 1 -- 172.21.15.80:0/1643112799 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa78000b90 con 0x7faa8006ce60 2019-11-28T11:28:19.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa868fa700 1 --2- 172.21.15.80:0/1643112799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa8006ce60 0x7faa80164d70 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7faa7800f730 tx=0x7faa7800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa850f7700 1 -- 172.21.15.80:0/1643112799 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa780010e0 con 0x7faa8006ce60 2019-11-28T11:28:19.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa850f7700 1 -- 172.21.15.80:0/1643112799 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa78001830 con 0x7faa8006ce60 2019-11-28T11:28:19.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa87b5c700 1 -- 172.21.15.80:0/1643112799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa8006ce60 msgr2=0x7faa80164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:19.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.315+0000 7faa87b5c700 1 --2- 172.21.15.80:0/1643112799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa8006ce60 0x7faa80164d70 secure :-1 s=READY pgs=451 cs=0 l=1 rx=0x7faa7800f730 tx=0x7faa7800fad0).stop 2019-11-28T11:28:19.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.316+0000 7faa87b5c700 1 -- 172.21.15.80:0/1643112799 shutdown_connections 2019-11-28T11:28:19.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.316+0000 7faa87b5c700 1 --2- 172.21.15.80:0/1643112799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa8006ce60 0x7faa80164d70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:19.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.316+0000 7faa87b5c700 1 --2- 172.21.15.80:0/1643112799 >> v2:172.21.15.174:3300/0 conn(0x7faa8006c490 0x7faa8006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:19.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.316+0000 7faa87b5c700 1 -- 172.21.15.80:0/1643112799 shutdown_connections 2019-11-28T11:28:19.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.316+0000 7faa87b5c700 1 -- 172.21.15.80:0/1643112799 wait complete. 2019-11-28T11:28:19.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.316+0000 7faa87b5c700 1 -- 172.21.15.80:0/1643112799 >> 172.21.15.80:0/1643112799 conn(0x7faa80061cf0 msgr2=0x7faa80064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:19.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.319+0000 7faa87b5c700 1 Processor -- start 2019-11-28T11:28:19.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.319+0000 7faa87b5c700 1 -- start start 2019-11-28T11:28:19.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.319+0000 7faa87b5c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faa80109e40 0x7faa8010a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:19.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.319+0000 7faa87b5c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8013f1e0 con 0x7faa8013eb40 2019-11-28T11:28:19.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.319+0000 7faa87b5c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa80131a30 con 0x7faa8010a810 2019-11-28T11:28:19.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.319+0000 7faa87b5c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa801234c0 con 0x7faa80109e40 2019-11-28T11:28:19.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa860f9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faa8013eb40 0x7faa8010afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60586/0 (socket says 172.21.15.80:60586) 2019-11-28T11:28:19.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa860f9700 1 -- 172.21.15.80:0/2867158358 learned_addr learned my addr 172.21.15.80:0/2867158358 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:19.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779363953 0 0) 0x7faa680014d0 con 0x7faa8013eb40 2019-11-28T11:28:19.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa64002e80 con 0x7faa8013eb40 2019-11-28T11:28:19.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa858f8700 1 --2- 172.21.15.80:0/2867158358 >> v2:172.21.15.174:3300/0 conn(0x7faa80109e40 0x7faa8010a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:19.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1020523342 0 0) 0x7faa68001680 con 0x7faa8013eb40 2019-11-28T11:28:19.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa640032e0 con 0x7faa8013eb40 2019-11-28T11:28:19.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7faa68001c30 con 0x7faa8013eb40 2019-11-28T11:28:19.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 >> v2:172.21.15.174:3300/0 conn(0x7faa80109e40 msgr2=0x7faa8010a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:19.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa7effd700 1 --2- 172.21.15.80:0/2867158358 >> v2:172.21.15.174:3300/0 conn(0x7faa80109e40 0x7faa8010a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:19.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 >> v1:172.21.15.174:6789/0 conn(0x7faa8010a810 legacy=0x7faa80105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:19.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 >> v1:172.21.15.80:6789/0 conn(0x7faa8013eb40 legacy=0x7faa8010afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:19.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa7effd700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa64003610 0x7faa64003a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:19.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa7effd700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa64003f60 0x7faa64004400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:19.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa7effd700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa64004b60 0x7faa6400b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:19.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64005290 con 0x7faa64003f60 2019-11-28T11:28:19.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64010270 con 0x7faa64004b60 2019-11-28T11:28:19.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa64010430 con 0x7faa64003610 2019-11-28T11:28:19.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa858f8700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa64003f60 0x7faa64004400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:19.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa860f9700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa64003610 0x7faa64003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:19.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa868fa700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa64004b60 0x7faa6400b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:19.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa858f8700 1 -- 172.21.15.80:0/2867158358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa64003610 msgr2=0x7faa64003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:19.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa858f8700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa64003610 0x7faa64003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:19.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.320+0000 7faa858f8700 1 -- 172.21.15.80:0/2867158358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa64004b60 msgr2=0x7faa6400b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:19.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa858f8700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa64004b60 0x7faa6400b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:19.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa868fa700 1 -- 172.21.15.80:0/2867158358 reap_dead start 2019-11-28T11:28:19.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa858f8700 1 -- 172.21.15.80:0/2867158358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa640106a0 con 0x7faa64003f60 2019-11-28T11:28:19.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa87b5c700 1 -- 172.21.15.80:0/2867158358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa80108a80 con 0x7faa64003f60 2019-11-28T11:28:19.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa858f8700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa64003f60 0x7faa64004400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faa70009660 tx=0x7faa70009cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa87b5c700 1 -- 172.21.15.80:0/2867158358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa80108700 con 0x7faa64003f60 2019-11-28T11:28:19.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa858f8700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa64003f60 0x7faa64004400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faa70009660 tx=0x7faa70009cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa858f8700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa64003f60 0x7faa64004400 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7faa70009660 tx=0x7faa70009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:19.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa858f8700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa64003f60 0x7faa64004400 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7faa70009660 tx=0x7faa70009cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa700096a0 con 0x7faa64003f60 2019-11-28T11:28:19.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa858f8700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa64003f60 0x7faa64004400 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7faa70009660 tx=0x7faa70009cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa700096a0 con 0x7faa64003f60 2019-11-28T11:28:19.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa858f8700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa64003f60 0x7faa64004400 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7faa70009660 tx=0x7faa70009cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa700091e0 con 0x7faa64003f60 2019-11-28T11:28:19.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa858f8700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa64003f60 0x7faa64004400 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7faa70009660 tx=0x7faa70009cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7faa700091e0 con 0x7faa64003f60 2019-11-28T11:28:19.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa858f8700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa64003f60 0x7faa64004400 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7faa70009660 tx=0x7faa70009cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.321+0000 7faa7effd700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa6401f940 0x7faa64021d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:19.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.322+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6106+0+0 (secure 0 0 0) 0x7faa700096a0 con 0x7faa64003f60 2019-11-28T11:28:19.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.322+0000 7faa860f9700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa6401f940 0x7faa64021d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:19.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.322+0000 7faa860f9700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa6401f940 0x7faa64021d70 crc :-1 s=READY pgs=196 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:19.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.329+0000 7faa87b5c700 1 -- 172.21.15.80:0/2867158358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa80108a80 con 0x7faa64003f60 2019-11-28T11:28:19.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.332+0000 7faa858f8700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa64003f60 0x7faa64004400 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7faa70009660 tx=0x7faa70009cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.332+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7faa70002a40 con 0x7faa64003f60 2019-11-28T11:28:19.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.504+0000 7faa87b5c700 1 -- 172.21.15.80:0/2867158358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa80108700 con 0x7faa64003f60 2019-11-28T11:28:19.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.505+0000 7faa858f8700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa64003f60 0x7faa64004400 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7faa70009660 tx=0x7faa70009cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.505+0000 7faa7effd700 1 -- 172.21.15.80:0/2867158358 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+1425 (secure 0 0 0) 0x7faa700178e0 con 0x7faa64003f60 2019-11-28T11:28:19.532 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 15 2019-11-28T11:28:19.533 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:19.533 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:28:18.556343+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:28:19.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.507+0000 7faa87b5c700 1 -- 172.21.15.80:0/2867158358 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa6401f940 msgr2=0x7faa64021d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:19.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.507+0000 7faa87b5c700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa6401f940 0x7faa64021d70 crc :-1 s=READY pgs=196 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:19.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.507+0000 7faa87b5c700 1 -- 172.21.15.80:0/2867158358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa64003f60 msgr2=0x7faa64004400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:19.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.507+0000 7faa87b5c700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa64003f60 0x7faa64004400 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7faa70009660 tx=0x7faa70009cb0).stop 2019-11-28T11:28:19.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.507+0000 7faa87b5c700 1 -- 172.21.15.80:0/2867158358 shutdown_connections 2019-11-28T11:28:19.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.507+0000 7faa87b5c700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa6401f940 0x7faa64021d70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:19.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.507+0000 7faa87b5c700 1 --2- 172.21.15.80:0/2867158358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa64003f60 0x7faa64004400 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:19.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.507+0000 7faa87b5c700 1 -- 172.21.15.80:0/2867158358 shutdown_connections 2019-11-28T11:28:19.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.507+0000 7faa87b5c700 1 -- 172.21.15.80:0/2867158358 wait complete. 2019-11-28T11:28:19.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.507+0000 7faa87b5c700 1 -- 172.21.15.80:0/2867158358 >> 172.21.15.80:0/2867158358 conn(0x7faa8011bfc0 msgr2=0x7faa80141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:19.544 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:28:19.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.641+0000 7f2acd782700 1 Processor -- start 2019-11-28T11:28:19.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.641+0000 7f2acd782700 1 -- start start 2019-11-28T11:28:19.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.642+0000 7f2acd782700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2ac806c0a0 0x7f2ac8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:19.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.642+0000 7f2acd782700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac806db00 con 0x7f2ac8072620 2019-11-28T11:28:19.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.642+0000 7f2acd782700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac806e000 con 0x7f2ac80734e0 2019-11-28T11:28:19.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.642+0000 7f2acd782700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac806fd60 con 0x7f2ac806c0a0 2019-11-28T11:28:19.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.642+0000 7f2ac7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2ac8072620 0x7f2ac8164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60602/0 (socket says 172.21.15.80:60602) 2019-11-28T11:28:19.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.642+0000 7f2ac7fff700 1 -- 172.21.15.80:0/2711886996 learned_addr learned my addr 172.21.15.80:0/2711886996 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:19.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.642+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2711886996 >> v2:172.21.15.174:3300/0 conn(0x7f2ac806c0a0 0x7f2ac8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:19.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.642+0000 7f2ac67fc700 1 -- 172.21.15.80:0/2711886996 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278445401 0 0) 0x7f2ac0001150 con 0x7f2ac8072620 2019-11-28T11:28:19.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.642+0000 7f2ac67fc700 1 -- 172.21.15.80:0/2711886996 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aa8002e80 con 0x7f2ac8072620 2019-11-28T11:28:19.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.642+0000 7f2ac67fc700 1 -- 172.21.15.80:0/2711886996 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1171076475 0 0) 0x7f2ac0001130 con 0x7f2ac8072620 2019-11-28T11:28:19.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.642+0000 7f2ac77fe700 1 -- 172.21.15.80:0/2711886996 >> v1:172.21.15.174:6789/0 conn(0x7f2ac80734e0 legacy=0x7f2ac8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:19.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.642+0000 7f2ac77fe700 1 -- 172.21.15.80:0/2711886996 >> v1:172.21.15.80:6789/0 conn(0x7f2ac8072620 legacy=0x7f2ac8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:19.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.642+0000 7f2ac77fe700 1 -- 172.21.15.80:0/2711886996 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac80706c0 con 0x7f2ac806c0a0 2019-11-28T11:28:19.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.642+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2711886996 >> v2:172.21.15.174:3300/0 conn(0x7f2ac806c0a0 0x7f2ac8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2ab000af50 tx=0x7f2ab000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.642+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2711886996 >> v2:172.21.15.174:3300/0 conn(0x7f2ac806c0a0 0x7f2ac8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2ab000af50 tx=0x7f2ab000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.642+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2711886996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ac806c0a0 0x7f2ac8072fa0 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7f2ab000af50 tx=0x7f2ab000b760).ready entity=mon.1 client_cookie=54cca11bb99943ad server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:19.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.643+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2711886996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ac806c0a0 0x7f2ac8072fa0 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7f2ab000af50 tx=0x7f2ab000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.643+0000 7f2ac67fc700 1 -- 172.21.15.80:0/2711886996 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ab0000960 con 0x7f2ac806c0a0 2019-11-28T11:28:19.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.643+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2711886996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ac806c0a0 0x7f2ac8072fa0 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7f2ab000af50 tx=0x7f2ab000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.643+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2711886996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ac806c0a0 0x7f2ac8072fa0 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7f2ab000af50 tx=0x7f2ab000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.643+0000 7f2ac67fc700 1 -- 172.21.15.80:0/2711886996 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab0009860 con 0x7f2ac806c0a0 2019-11-28T11:28:19.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.643+0000 7f2ac67fc700 1 -- 172.21.15.80:0/2711886996 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ab0009f30 con 0x7f2ac806c0a0 2019-11-28T11:28:19.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.643+0000 7f2acd782700 1 -- 172.21.15.80:0/2711886996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ac806c0a0 msgr2=0x7f2ac8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:19.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.643+0000 7f2acd782700 1 --2- 172.21.15.80:0/2711886996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ac806c0a0 0x7f2ac8072fa0 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7f2ab000af50 tx=0x7f2ab000b760).stop 2019-11-28T11:28:19.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.643+0000 7f2acd782700 1 -- 172.21.15.80:0/2711886996 shutdown_connections 2019-11-28T11:28:19.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.643+0000 7f2acd782700 1 --2- 172.21.15.80:0/2711886996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ac806c0a0 0x7f2ac8072fa0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:19.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.643+0000 7f2acd782700 1 -- 172.21.15.80:0/2711886996 shutdown_connections 2019-11-28T11:28:19.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.643+0000 7f2acd782700 1 -- 172.21.15.80:0/2711886996 wait complete. 2019-11-28T11:28:19.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.643+0000 7f2acd782700 1 -- 172.21.15.80:0/2711886996 >> 172.21.15.80:0/2711886996 conn(0x7f2ac8061cf0 msgr2=0x7f2ac8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:19.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.646+0000 7f2acd782700 1 Processor -- start 2019-11-28T11:28:19.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.646+0000 7f2acd782700 1 -- start start 2019-11-28T11:28:19.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2acd782700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ac812cea0 0x7f2ac8111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:19.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2acd782700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ac8165a00 0x7f2ac8167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:19.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2acd782700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac8124260 con 0x7f2ac81230e0 2019-11-28T11:28:19.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2acd782700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac8121040 con 0x7f2ac812cea0 2019-11-28T11:28:19.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2acd782700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8121310 con 0x7f2ac8165a00 2019-11-28T11:28:19.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2ac77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ac812cea0 0x7f2ac8111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:19.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2ac77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ac812cea0 0x7f2ac8111db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33058/0 (socket says 172.21.15.80:33058) 2019-11-28T11:28:19.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2ac77fe700 1 -- 172.21.15.80:0/2270839930 learned_addr learned my addr 172.21.15.80:0/2270839930 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:19.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2ac7fff700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ac8165a00 0x7f2ac8167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:19.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2ac77fe700 1 -- 172.21.15.80:0/2270839930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ac8165a00 msgr2=0x7f2ac8167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:19.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ac8165a00 0x7f2ac8167e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:19.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2ac77fe700 1 -- 172.21.15.80:0/2270839930 >> v1:172.21.15.80:6789/0 conn(0x7f2ac81230e0 legacy=0x7f2ac8123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:19.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2ac77fe700 1 -- 172.21.15.80:0/2270839930 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac81219a0 con 0x7f2ac812cea0 2019-11-28T11:28:19.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2270839930 >> v2:172.21.15.80:3300/0 conn(0x7f2ac812cea0 0x7f2ac8111db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ab00104a0 tx=0x7f2ab0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2270839930 >> v2:172.21.15.80:3300/0 conn(0x7f2ac812cea0 0x7f2ac8111db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ab00104a0 tx=0x7f2ab0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac812cea0 0x7f2ac8111db0 secure :-1 s=READY pgs=456 cs=0 l=1 rx=0x7f2ab00104a0 tx=0x7f2ab0010840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:19.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac812cea0 0x7f2ac8111db0 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7f2ab00104a0 tx=0x7f2ab0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2abffff700 1 -- 172.21.15.80:0/2270839930 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ab0000940 con 0x7f2ac812cea0 2019-11-28T11:28:19.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac812cea0 0x7f2ac8111db0 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7f2ab00104a0 tx=0x7f2ab0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac812cea0 0x7f2ac8111db0 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7f2ab00104a0 tx=0x7f2ab0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.647+0000 7f2abffff700 1 -- 172.21.15.80:0/2270839930 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab0009980 con 0x7f2ac812cea0 2019-11-28T11:28:19.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.648+0000 7f2acd782700 1 -- 172.21.15.80:0/2270839930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac8121d20 con 0x7f2ac812cea0 2019-11-28T11:28:19.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.648+0000 7f2abffff700 1 -- 172.21.15.80:0/2270839930 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ab0009ff0 con 0x7f2ac812cea0 2019-11-28T11:28:19.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.648+0000 7f2acd782700 1 -- 172.21.15.80:0/2270839930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac81122f0 con 0x7f2ac812cea0 2019-11-28T11:28:19.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.648+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac812cea0 0x7f2ac8111db0 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7f2ab00104a0 tx=0x7f2ab0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.648+0000 7f2abffff700 1 -- 172.21.15.80:0/2270839930 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2ab0009580 con 0x7f2ac812cea0 2019-11-28T11:28:19.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.648+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac812cea0 0x7f2ac8111db0 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7f2ab00104a0 tx=0x7f2ab0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.648+0000 7f2abffff700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2aa0018730 0x7f2aa001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:19.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.648+0000 7f2abffff700 1 -- 172.21.15.80:0/2270839930 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f2ab0031d40 con 0x7f2ac812cea0 2019-11-28T11:28:19.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.648+0000 7f2ac6ffd700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2aa0018730 0x7f2aa001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:19.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.649+0000 7f2ac6ffd700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2aa0018730 0x7f2aa001abc0 crc :-1 s=READY pgs=197 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:19.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.656+0000 7f2acd782700 1 -- 172.21.15.80:0/2270839930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac81219a0 con 0x7f2ac812cea0 2019-11-28T11:28:19.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.660+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac812cea0 0x7f2ac8111db0 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7f2ab00104a0 tx=0x7f2ab0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:19.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.660+0000 7f2abffff700 1 -- 172.21.15.80:0/2270839930 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2ab0009980 con 0x7f2ac812cea0 2019-11-28T11:28:19.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:19.824+0000 7f2acd782700 1 -- 172.21.15.80:0/2270839930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2ac8121d20 con 0x7f2ac812cea0 2019-11-28T11:28:20.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.567+0000 7f2ac77fe700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac812cea0 0x7f2ac8111db0 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7f2ab00104a0 tx=0x7f2ab0010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:20.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.567+0000 7f2abffff700 1 -- 172.21.15.80:0/2270839930 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2ab00096a0 con 0x7f2ac812cea0 2019-11-28T11:28:20.616 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:28:20.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.591+0000 7f2acd782700 1 -- 172.21.15.80:0/2270839930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2aa0018730 msgr2=0x7f2aa001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:20.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.591+0000 7f2acd782700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2aa0018730 0x7f2aa001abc0 crc :-1 s=READY pgs=197 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:20.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.591+0000 7f2acd782700 1 -- 172.21.15.80:0/2270839930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac812cea0 msgr2=0x7f2ac8111db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:20.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.591+0000 7f2acd782700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac812cea0 0x7f2ac8111db0 secure :-1 s=READY pgs=456 cs=0 l=1 rx=0x7f2ab00104a0 tx=0x7f2ab0010840).stop 2019-11-28T11:28:20.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.591+0000 7f2acd782700 1 -- 172.21.15.80:0/2270839930 shutdown_connections 2019-11-28T11:28:20.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.591+0000 7f2acd782700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2aa0018730 0x7f2aa001abc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:20.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.591+0000 7f2acd782700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ac8165a00 0x7f2ac8167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:20.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.591+0000 7f2acd782700 1 --2- 172.21.15.80:0/2270839930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ac812cea0 0x7f2ac8111db0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:20.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.592+0000 7f2acd782700 1 -- 172.21.15.80:0/2270839930 shutdown_connections 2019-11-28T11:28:20.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.592+0000 7f2acd782700 1 -- 172.21.15.80:0/2270839930 wait complete. 2019-11-28T11:28:20.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.592+0000 7f2acd782700 1 -- 172.21.15.80:0/2270839930 >> 172.21.15.80:0/2270839930 conn(0x7f2ac81426c0 msgr2=0x7f2ac8110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:20.629 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:28:20.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.729+0000 7f0883908700 1 Processor -- start 2019-11-28T11:28:20.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.729+0000 7f0883908700 1 -- start start 2019-11-28T11:28:20.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.730+0000 7f0883908700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f087c06c490 0x7f087c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:20.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.730+0000 7f0883908700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f087c06ce60 0x7f087c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:20.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.730+0000 7f0883908700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087c06db00 con 0x7f087c06c0a0 2019-11-28T11:28:20.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.730+0000 7f0883908700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087c06fd60 con 0x7f087c06c490 2019-11-28T11:28:20.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.730+0000 7f0883908700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087c070030 con 0x7f087c06ce60 2019-11-28T11:28:20.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.730+0000 7f0881ea5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f087c06c0a0 0x7f087c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60614/0 (socket says 172.21.15.80:60614) 2019-11-28T11:28:20.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.730+0000 7f0881ea5700 1 -- 172.21.15.80:0/3507825610 learned_addr learned my addr 172.21.15.80:0/3507825610 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:20.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.730+0000 7f08816a4700 1 --2- 172.21.15.80:0/3507825610 >> v2:172.21.15.174:3300/0 conn(0x7f087c06c490 0x7f087c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:20.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.730+0000 7f08826a6700 1 --2- 172.21.15.80:0/3507825610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f087c06ce60 0x7f087c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:20.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.730+0000 7f0880ea3700 1 -- 172.21.15.80:0/3507825610 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007281469 0 0) 0x7f086c001150 con 0x7f087c06c0a0 2019-11-28T11:28:20.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.730+0000 7f0880ea3700 1 -- 172.21.15.80:0/3507825610 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0864002e80 con 0x7f087c06c0a0 2019-11-28T11:28:20.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.731+0000 7f08826a6700 1 -- 172.21.15.80:0/3507825610 >> v2:172.21.15.174:3300/0 conn(0x7f087c06c490 msgr2=0x7f087c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:20.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.731+0000 7f08826a6700 1 --2- 172.21.15.80:0/3507825610 >> v2:172.21.15.174:3300/0 conn(0x7f087c06c490 0x7f087c06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:20.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.731+0000 7f08826a6700 1 -- 172.21.15.80:0/3507825610 >> v1:172.21.15.80:6789/0 conn(0x7f087c06c0a0 legacy=0x7f087c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:20.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.731+0000 7f0880ea3700 1 -- 172.21.15.80:0/3507825610 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2030007950 0 0) 0x7f086c001130 con 0x7f087c06c0a0 2019-11-28T11:28:20.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.731+0000 7f08826a6700 1 -- 172.21.15.80:0/3507825610 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c0706c0 con 0x7f087c06ce60 2019-11-28T11:28:20.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.731+0000 7f08826a6700 1 --2- 172.21.15.80:0/3507825610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f087c06ce60 0x7f087c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f087400b300 tx=0x7f087400ba90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:20.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.731+0000 7f08826a6700 1 --2- 172.21.15.80:0/3507825610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f087c06ce60 0x7f087c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f087400b300 tx=0x7f087400ba90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:20.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.731+0000 7f08826a6700 1 --2- 172.21.15.80:0/3507825610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f087c06ce60 0x7f087c164d70 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f087400b300 tx=0x7f087400ba90).ready entity=mon.2 client_cookie=158f9c383874699a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:20.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.731+0000 7f08826a6700 1 --2- 172.21.15.80:0/3507825610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f087c06ce60 0x7f087c164d70 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f087400b300 tx=0x7f087400ba90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:20.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.731+0000 7f0880ea3700 1 -- 172.21.15.80:0/3507825610 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08740075c0 con 0x7f087c06ce60 2019-11-28T11:28:20.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.731+0000 7f08826a6700 1 --2- 172.21.15.80:0/3507825610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f087c06ce60 0x7f087c164d70 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f087400b300 tx=0x7f087400ba90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:20.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.731+0000 7f0880ea3700 1 -- 172.21.15.80:0/3507825610 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0874000e90 con 0x7f087c06ce60 2019-11-28T11:28:20.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.731+0000 7f08826a6700 1 --2- 172.21.15.80:0/3507825610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f087c06ce60 0x7f087c164d70 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f087400b300 tx=0x7f087400ba90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:20.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.731+0000 7f0880ea3700 1 -- 172.21.15.80:0/3507825610 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0874009e40 con 0x7f087c06ce60 2019-11-28T11:28:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.731+0000 7f0883908700 1 -- 172.21.15.80:0/3507825610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f087c06ce60 msgr2=0x7f087c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.731+0000 7f0883908700 1 --2- 172.21.15.80:0/3507825610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f087c06ce60 0x7f087c164d70 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f087400b300 tx=0x7f087400ba90).stop 2019-11-28T11:28:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.732+0000 7f0883908700 1 -- 172.21.15.80:0/3507825610 shutdown_connections 2019-11-28T11:28:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.732+0000 7f0883908700 1 --2- 172.21.15.80:0/3507825610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f087c06ce60 0x7f087c164d70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.732+0000 7f0883908700 1 --2- 172.21.15.80:0/3507825610 >> v2:172.21.15.174:3300/0 conn(0x7f087c06c490 0x7f087c06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.732+0000 7f0883908700 1 -- 172.21.15.80:0/3507825610 shutdown_connections 2019-11-28T11:28:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.732+0000 7f0883908700 1 -- 172.21.15.80:0/3507825610 wait complete. 2019-11-28T11:28:20.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.732+0000 7f0883908700 1 -- 172.21.15.80:0/3507825610 >> 172.21.15.80:0/3507825610 conn(0x7f087c061cf0 msgr2=0x7f087c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:20.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.734+0000 7f0883908700 1 Processor -- start 2019-11-28T11:28:20.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.734+0000 7f0883908700 1 -- start start 2019-11-28T11:28:20.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.735+0000 7f0883908700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f087c103000 0x7f087c103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:20.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.735+0000 7f0883908700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f087c1039d0 0x7f087c167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:20.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.735+0000 7f0883908700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087c1312c0 con 0x7f087c13dc00 2019-11-28T11:28:20.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.735+0000 7f0883908700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087c105830 con 0x7f087c103000 2019-11-28T11:28:20.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.735+0000 7f0883908700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087c105b00 con 0x7f087c1039d0 2019-11-28T11:28:20.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.735+0000 7f08816a4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f087c103000 0x7f087c103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.735+0000 7f08816a4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f087c103000 0x7f087c103490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33074/0 (socket says 172.21.15.80:33074) 2019-11-28T11:28:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.735+0000 7f08816a4700 1 -- 172.21.15.80:0/4254644006 learned_addr learned my addr 172.21.15.80:0/4254644006 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.735+0000 7f08826a6700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f087c1039d0 0x7f087c167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.735+0000 7f08816a4700 1 -- 172.21.15.80:0/4254644006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f087c1039d0 msgr2=0x7f087c167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.735+0000 7f08816a4700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f087c1039d0 0x7f087c167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.735+0000 7f08816a4700 1 -- 172.21.15.80:0/4254644006 >> v1:172.21.15.174:6789/0 conn(0x7f087c13dc00 legacy=0x7f087c109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.735+0000 7f08816a4700 1 -- 172.21.15.80:0/4254644006 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c106190 con 0x7f087c103000 2019-11-28T11:28:20.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.735+0000 7f08816a4700 1 --2- 172.21.15.80:0/4254644006 >> v2:172.21.15.80:3300/0 conn(0x7f087c103000 0x7f087c103490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0870010450 tx=0x7f0870010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:20.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.735+0000 7f08816a4700 1 --2- 172.21.15.80:0/4254644006 >> v2:172.21.15.80:3300/0 conn(0x7f087c103000 0x7f087c103490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0870010450 tx=0x7f0870010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:20.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.735+0000 7f08816a4700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f087c103000 0x7f087c103490 secure :-1 s=READY pgs=458 cs=0 l=1 rx=0x7f0870010450 tx=0x7f0870010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:20.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.736+0000 7f08816a4700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f087c103000 0x7f087c103490 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f0870010450 tx=0x7f0870010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:20.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.736+0000 7f08816a4700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f087c103000 0x7f087c103490 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f0870010450 tx=0x7f0870010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:20.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.736+0000 7f087a7fc700 1 -- 172.21.15.80:0/4254644006 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0870000940 con 0x7f087c103000 2019-11-28T11:28:20.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.736+0000 7f08816a4700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f087c103000 0x7f087c103490 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f0870010450 tx=0x7f0870010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:20.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.736+0000 7f087a7fc700 1 -- 172.21.15.80:0/4254644006 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870000e80 con 0x7f087c103000 2019-11-28T11:28:20.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.736+0000 7f0883908700 1 -- 172.21.15.80:0/4254644006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087c106510 con 0x7f087c103000 2019-11-28T11:28:20.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.736+0000 7f087a7fc700 1 -- 172.21.15.80:0/4254644006 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08700014d0 con 0x7f087c103000 2019-11-28T11:28:20.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.736+0000 7f0883908700 1 -- 172.21.15.80:0/4254644006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087c106190 con 0x7f087c103000 2019-11-28T11:28:20.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.736+0000 7f08816a4700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f087c103000 0x7f087c103490 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f0870010450 tx=0x7f0870010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:20.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.736+0000 7f087a7fc700 1 -- 172.21.15.80:0/4254644006 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0870001070 con 0x7f087c103000 2019-11-28T11:28:20.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.736+0000 7f08816a4700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f087c103000 0x7f087c103490 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f0870010450 tx=0x7f0870010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:20.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.737+0000 7f087a7fc700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f085c018730 0x7f085c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:20.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.737+0000 7f087a7fc700 1 -- 172.21.15.80:0/4254644006 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f0870031d30 con 0x7f087c103000 2019-11-28T11:28:20.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.737+0000 7f0881ea5700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f085c018730 0x7f085c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:20.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.737+0000 7f0881ea5700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f085c018730 0x7f085c01abe0 crc :-1 s=READY pgs=198 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:20.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.744+0000 7f0883908700 1 -- 172.21.15.80:0/4254644006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087c106510 con 0x7f087c103000 2019-11-28T11:28:20.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.748+0000 7f08816a4700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f087c103000 0x7f087c103490 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f0870010450 tx=0x7f0870010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:20.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.748+0000 7f087a7fc700 1 -- 172.21.15.80:0/4254644006 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0870009250 con 0x7f087c103000 2019-11-28T11:28:20.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.921+0000 7f0883908700 1 -- 172.21.15.80:0/4254644006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f087c106190 con 0x7f087c103000 2019-11-28T11:28:20.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.921+0000 7f08816a4700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f087c103000 0x7f087c103490 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f0870010450 tx=0x7f0870010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:20.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.921+0000 7f087a7fc700 1 -- 172.21.15.80:0/4254644006 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+1425 (secure 0 0 0) 0x7f0870000e60 con 0x7f087c103000 2019-11-28T11:28:20.949 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 16 2019-11-28T11:28:20.949 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:20.949 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":16,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:26:04.004932+0000","modified":"2019-11-28T11:28:20.564760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-11-28T11:28:20.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.924+0000 7f0883908700 1 -- 172.21.15.80:0/4254644006 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f085c018730 msgr2=0x7f085c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:20.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.924+0000 7f0883908700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f085c018730 0x7f085c01abe0 crc :-1 s=READY pgs=198 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:20.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.924+0000 7f0883908700 1 -- 172.21.15.80:0/4254644006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f087c103000 msgr2=0x7f087c103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:20.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.924+0000 7f0883908700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f087c103000 0x7f087c103490 secure :-1 s=READY pgs=458 cs=0 l=1 rx=0x7f0870010450 tx=0x7f0870010280).stop 2019-11-28T11:28:20.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.924+0000 7f0883908700 1 -- 172.21.15.80:0/4254644006 shutdown_connections 2019-11-28T11:28:20.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.924+0000 7f0883908700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f087c1039d0 0x7f087c167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:20.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.924+0000 7f0883908700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f087c103000 0x7f087c103490 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:20.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.924+0000 7f0883908700 1 --2- 172.21.15.80:0/4254644006 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f085c018730 0x7f085c01abe0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:20.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.924+0000 7f0883908700 1 -- 172.21.15.80:0/4254644006 shutdown_connections 2019-11-28T11:28:20.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.924+0000 7f0883908700 1 -- 172.21.15.80:0/4254644006 wait complete. 2019-11-28T11:28:20.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:20.924+0000 7f0883908700 1 -- 172.21.15.80:0/4254644006 >> 172.21.15.80:0/4254644006 conn(0x7f087c11bfc0 msgr2=0x7f087c141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:20.961 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:28:21.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.057+0000 7ff725043700 1 Processor -- start 2019-11-28T11:28:21.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.057+0000 7ff725043700 1 -- start start 2019-11-28T11:28:21.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.058+0000 7ff725043700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff72006c490 0x7ff72006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:21.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.058+0000 7ff725043700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72006db00 con 0x7ff72006ce60 2019-11-28T11:28:21.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.058+0000 7ff725043700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72006e000 con 0x7ff72006c0a0 2019-11-28T11:28:21.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.058+0000 7ff725043700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72006fd60 con 0x7ff72006c490 2019-11-28T11:28:21.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.058+0000 7ff724842700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff72006ce60 0x7ff720164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60630/0 (socket says 172.21.15.80:60630) 2019-11-28T11:28:21.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.058+0000 7ff724842700 1 -- 172.21.15.80:0/4061974761 learned_addr learned my addr 172.21.15.80:0/4061974761 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:21.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.058+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/4061974761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff72006c490 0x7ff72006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:21.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.058+0000 7ff71e59c700 1 -- 172.21.15.80:0/4061974761 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704512846 0 0) 0x7ff718001150 con 0x7ff72006ce60 2019-11-28T11:28:21.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.058+0000 7ff71e59c700 1 -- 172.21.15.80:0/4061974761 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff700002e80 con 0x7ff72006ce60 2019-11-28T11:28:21.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.058+0000 7ff71e59c700 1 -- 172.21.15.80:0/4061974761 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53307307 0 0) 0x7ff708001080 con 0x7ff72006c0a0 2019-11-28T11:28:21.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.058+0000 7ff71e59c700 1 -- 172.21.15.80:0/4061974761 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff700004170 con 0x7ff72006c0a0 2019-11-28T11:28:21.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.058+0000 7ff71ed9d700 1 -- 172.21.15.80:0/4061974761 >> v1:172.21.15.174:6789/0 conn(0x7ff72006c0a0 legacy=0x7ff720072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:21.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.058+0000 7ff71ed9d700 1 -- 172.21.15.80:0/4061974761 >> v1:172.21.15.80:6789/0 conn(0x7ff72006ce60 legacy=0x7ff720164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:21.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.058+0000 7ff71e59c700 1 -- 172.21.15.80:0/4061974761 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4051110718 0 0) 0x7ff718001130 con 0x7ff72006ce60 2019-11-28T11:28:21.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.058+0000 7ff71ed9d700 1 -- 172.21.15.80:0/4061974761 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7200706c0 con 0x7ff72006c490 2019-11-28T11:28:21.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.058+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/4061974761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff72006c490 0x7ff72006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff71000b2d0 tx=0x7ff71000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.059+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/4061974761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff72006c490 0x7ff72006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff71000b2d0 tx=0x7ff71000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.059+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/4061974761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff72006c490 0x7ff72006c920 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7ff71000b2d0 tx=0x7ff71000bae0).ready entity=mon.2 client_cookie=7c0ec3f7ea8e552f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:21.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.059+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/4061974761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff72006c490 0x7ff72006c920 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7ff71000b2d0 tx=0x7ff71000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.059+0000 7ff71e59c700 1 -- 172.21.15.80:0/4061974761 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff710000ce0 con 0x7ff72006c490 2019-11-28T11:28:21.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.059+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/4061974761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff72006c490 0x7ff72006c920 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7ff71000b2d0 tx=0x7ff71000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.059+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/4061974761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff72006c490 0x7ff72006c920 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7ff71000b2d0 tx=0x7ff71000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.059+0000 7ff71e59c700 1 -- 172.21.15.80:0/4061974761 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff710009be0 con 0x7ff72006c490 2019-11-28T11:28:21.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.059+0000 7ff71e59c700 1 -- 172.21.15.80:0/4061974761 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff71000a2b0 con 0x7ff72006c490 2019-11-28T11:28:21.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.059+0000 7ff725043700 1 -- 172.21.15.80:0/4061974761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff72006c490 msgr2=0x7ff72006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:21.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.059+0000 7ff725043700 1 --2- 172.21.15.80:0/4061974761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff72006c490 0x7ff72006c920 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7ff71000b2d0 tx=0x7ff71000bae0).stop 2019-11-28T11:28:21.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.059+0000 7ff725043700 1 -- 172.21.15.80:0/4061974761 shutdown_connections 2019-11-28T11:28:21.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.059+0000 7ff725043700 1 --2- 172.21.15.80:0/4061974761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff72006c490 0x7ff72006c920 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:21.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.059+0000 7ff725043700 1 -- 172.21.15.80:0/4061974761 shutdown_connections 2019-11-28T11:28:21.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.059+0000 7ff725043700 1 -- 172.21.15.80:0/4061974761 wait complete. 2019-11-28T11:28:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.059+0000 7ff725043700 1 -- 172.21.15.80:0/4061974761 >> 172.21.15.80:0/4061974761 conn(0x7ff720061cf0 msgr2=0x7ff720064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.062+0000 7ff725043700 1 Processor -- start 2019-11-28T11:28:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.062+0000 7ff725043700 1 -- start start 2019-11-28T11:28:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.063+0000 7ff725043700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff720106140 0x7ff7201065d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.063+0000 7ff725043700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff720136480 con 0x7ff720135760 2019-11-28T11:28:21.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.063+0000 7ff725043700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7201033c0 con 0x7ff720106b10 2019-11-28T11:28:21.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.063+0000 7ff725043700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff720104370 con 0x7ff720106140 2019-11-28T11:28:21.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.063+0000 7ff71f59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff720135760 0x7ff720137480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60634/0 (socket says 172.21.15.80:60634) 2019-11-28T11:28:21.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.063+0000 7ff71f59e700 1 -- 172.21.15.80:0/1598287979 learned_addr learned my addr 172.21.15.80:0/1598287979 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:21.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.063+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/1598287979 >> v2:172.21.15.174:3300/0 conn(0x7ff720106140 0x7ff7201065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:21.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.063+0000 7ff717fff700 1 -- 172.21.15.80:0/1598287979 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299230145 0 0) 0x7ff708001240 con 0x7ff720135760 2019-11-28T11:28:21.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.063+0000 7ff717fff700 1 -- 172.21.15.80:0/1598287979 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6f8002e80 con 0x7ff720135760 2019-11-28T11:28:21.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.063+0000 7ff71ed9d700 1 -- 172.21.15.80:0/1598287979 >> v1:172.21.15.174:6789/0 conn(0x7ff720106b10 legacy=0x7ff7201330b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:21.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.063+0000 7ff717fff700 1 -- 172.21.15.80:0/1598287979 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2853307353 0 0) 0x7ff708001440 con 0x7ff720135760 2019-11-28T11:28:21.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.063+0000 7ff71ed9d700 1 -- 172.21.15.80:0/1598287979 >> v1:172.21.15.80:6789/0 conn(0x7ff720135760 legacy=0x7ff720137480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:21.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.063+0000 7ff71ed9d700 1 -- 172.21.15.80:0/1598287979 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff720104a00 con 0x7ff720106140 2019-11-28T11:28:21.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.063+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/1598287979 >> v2:172.21.15.174:3300/0 conn(0x7ff720106140 0x7ff7201065d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff710010750 tx=0x7ff710010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.064+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/1598287979 >> v2:172.21.15.174:3300/0 conn(0x7ff720106140 0x7ff7201065d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff710010750 tx=0x7ff710010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.064+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff720106140 0x7ff7201065d0 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7ff710010750 tx=0x7ff710010af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:21.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.064+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff720106140 0x7ff7201065d0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7ff710010750 tx=0x7ff710010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.064+0000 7ff717fff700 1 -- 172.21.15.80:0/1598287979 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff710000cc0 con 0x7ff720106140 2019-11-28T11:28:21.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.064+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff720106140 0x7ff7201065d0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7ff710010750 tx=0x7ff710010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.064+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff720106140 0x7ff7201065d0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7ff710010750 tx=0x7ff710010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.064+0000 7ff717fff700 1 -- 172.21.15.80:0/1598287979 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff710009d00 con 0x7ff720106140 2019-11-28T11:28:21.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.064+0000 7ff725043700 1 -- 172.21.15.80:0/1598287979 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff720104d80 con 0x7ff720106140 2019-11-28T11:28:21.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.064+0000 7ff717fff700 1 -- 172.21.15.80:0/1598287979 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff71000a3d0 con 0x7ff720106140 2019-11-28T11:28:21.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.064+0000 7ff725043700 1 -- 172.21.15.80:0/1598287979 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff720106f80 con 0x7ff720106140 2019-11-28T11:28:21.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.064+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff720106140 0x7ff7201065d0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7ff710010750 tx=0x7ff710010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.064+0000 7ff717fff700 1 -- 172.21.15.80:0/1598287979 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff710009900 con 0x7ff720106140 2019-11-28T11:28:21.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.064+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff720106140 0x7ff7201065d0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7ff710010750 tx=0x7ff710010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.064+0000 7ff717fff700 1 --2- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6f8018780 0x7ff6f801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:21.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.064+0000 7ff717fff700 1 -- 172.21.15.80:0/1598287979 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6106+0+0 (secure 0 0 0) 0x7ff710031e70 con 0x7ff720106140 2019-11-28T11:28:21.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.065+0000 7ff71f59e700 1 --2- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6f8018780 0x7ff6f801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:21.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.065+0000 7ff71f59e700 1 --2- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6f8018780 0x7ff6f801abf0 crc :-1 s=READY pgs=199 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:21.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.072+0000 7ff725043700 1 -- 172.21.15.80:0/1598287979 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff720104a00 con 0x7ff720106140 2019-11-28T11:28:21.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.076+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff720106140 0x7ff7201065d0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7ff710010750 tx=0x7ff710010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.076+0000 7ff717fff700 1 -- 172.21.15.80:0/1598287979 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff71002b380 con 0x7ff720106140 2019-11-28T11:28:21.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.250+0000 7ff725043700 1 -- 172.21.15.80:0/1598287979 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff720104d80 con 0x7ff720106140 2019-11-28T11:28:21.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.569+0000 7ff71ed9d700 1 --2- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff720106140 0x7ff7201065d0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7ff710010750 tx=0x7ff710010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.569+0000 7ff717fff700 1 -- 172.21.15.80:0/1598287979 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff71002b380 con 0x7ff720106140 2019-11-28T11:28:21.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.616+0000 7ff725043700 1 -- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6f8018780 msgr2=0x7ff6f801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:21.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.616+0000 7ff725043700 1 --2- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6f8018780 0x7ff6f801abf0 crc :-1 s=READY pgs=199 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:21.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.616+0000 7ff725043700 1 -- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff720106140 msgr2=0x7ff7201065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:21.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.616+0000 7ff725043700 1 --2- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff720106140 0x7ff7201065d0 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7ff710010750 tx=0x7ff710010af0).stop 2019-11-28T11:28:21.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.616+0000 7ff725043700 1 -- 172.21.15.80:0/1598287979 shutdown_connections 2019-11-28T11:28:21.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.616+0000 7ff725043700 1 --2- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6f8018780 0x7ff6f801abf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:21.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.616+0000 7ff725043700 1 --2- 172.21.15.80:0/1598287979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff720106140 0x7ff7201065d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:21.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.617+0000 7ff725043700 1 -- 172.21.15.80:0/1598287979 shutdown_connections 2019-11-28T11:28:21.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.617+0000 7ff725043700 1 -- 172.21.15.80:0/1598287979 wait complete. 2019-11-28T11:28:21.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.617+0000 7ff725043700 1 -- 172.21.15.80:0/1598287979 >> 172.21.15.80:0/1598287979 conn(0x7ff72013d930 msgr2=0x7ff720102360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:21.654 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:28:21.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.753+0000 7f8b54c6f700 1 Processor -- start 2019-11-28T11:28:21.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.753+0000 7f8b54c6f700 1 -- start start 2019-11-28T11:28:21.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.754+0000 7f8b54c6f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8b5015f100 0x7f8b5006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:21.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.754+0000 7f8b54c6f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b5006c2f0 0x7f8b5006c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:21.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.754+0000 7f8b54c6f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5006db60 con 0x7f8b5015ed10 2019-11-28T11:28:21.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.754+0000 7f8b54c6f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5006fe00 con 0x7f8b5015f100 2019-11-28T11:28:21.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.754+0000 7f8b54c6f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b500700d0 con 0x7f8b5006c2f0 2019-11-28T11:28:21.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.754+0000 7f8b4e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8b5015f100 0x7f8b5006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:21.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.754+0000 7f8b4e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8b5015f100 0x7f8b5006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33098/0 (socket says 172.21.15.80:33098) 2019-11-28T11:28:21.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.754+0000 7f8b4e59c700 1 -- 172.21.15.80:0/86130605 learned_addr learned my addr 172.21.15.80:0/86130605 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.754+0000 7f8b4f59e700 1 --2- 172.21.15.80:0/86130605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b5006c2f0 0x7f8b5006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.755+0000 7f8b4e59c700 1 -- 172.21.15.80:0/86130605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b5006c2f0 msgr2=0x7f8b5006c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.755+0000 7f8b4e59c700 1 --2- 172.21.15.80:0/86130605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b5006c2f0 0x7f8b5006c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.755+0000 7f8b4e59c700 1 -- 172.21.15.80:0/86130605 >> v1:172.21.15.174:6789/0 conn(0x7f8b5015ed10 legacy=0x7f8b50073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.755+0000 7f8b4dd9b700 1 -- 172.21.15.80:0/86130605 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343172046 0 0) 0x7f8b40001080 con 0x7f8b5015ed10 2019-11-28T11:28:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.755+0000 7f8b4e59c700 1 -- 172.21.15.80:0/86130605 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50070760 con 0x7f8b5015f100 2019-11-28T11:28:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.755+0000 7f8b4e59c700 1 --2- 172.21.15.80:0/86130605 >> v2:172.21.15.80:3300/0 conn(0x7f8b5015f100 0x7f8b5006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8b3800fa40 tx=0x7f8b3800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.755+0000 7f8b4e59c700 1 --2- 172.21.15.80:0/86130605 >> v2:172.21.15.80:3300/0 conn(0x7f8b5015f100 0x7f8b5006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8b3800fa40 tx=0x7f8b3800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.755+0000 7f8b4e59c700 1 --2- 172.21.15.80:0/86130605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5015f100 0x7f8b5006bdb0 secure :-1 s=READY pgs=461 cs=0 l=1 rx=0x7f8b3800fa40 tx=0x7f8b3800fde0).ready entity=mon.0 client_cookie=7d09e100b30055cb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.755+0000 7f8b4e59c700 1 --2- 172.21.15.80:0/86130605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5015f100 0x7f8b5006bdb0 secure :-1 s=THROTTLE_DONE pgs=461 cs=0 l=1 rx=0x7f8b3800fa40 tx=0x7f8b3800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.755+0000 7f8b4dd9b700 1 -- 172.21.15.80:0/86130605 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b38000ce0 con 0x7f8b5015f100 2019-11-28T11:28:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.755+0000 7f8b4e59c700 1 --2- 172.21.15.80:0/86130605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5015f100 0x7f8b5006bdb0 secure :-1 s=THROTTLE_DONE pgs=461 cs=0 l=1 rx=0x7f8b3800fa40 tx=0x7f8b3800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.755+0000 7f8b4e59c700 1 --2- 172.21.15.80:0/86130605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5015f100 0x7f8b5006bdb0 secure :-1 s=THROTTLE_DONE pgs=461 cs=0 l=1 rx=0x7f8b3800fa40 tx=0x7f8b3800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.755+0000 7f8b4dd9b700 1 -- 172.21.15.80:0/86130605 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b38001010 con 0x7f8b5015f100 2019-11-28T11:28:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.755+0000 7f8b4dd9b700 1 -- 172.21.15.80:0/86130605 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b38001720 con 0x7f8b5015f100 2019-11-28T11:28:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.755+0000 7f8b54c6f700 1 -- 172.21.15.80:0/86130605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5015f100 msgr2=0x7f8b5006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.755+0000 7f8b54c6f700 1 --2- 172.21.15.80:0/86130605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5015f100 0x7f8b5006bdb0 secure :-1 s=READY pgs=461 cs=0 l=1 rx=0x7f8b3800fa40 tx=0x7f8b3800fde0).stop 2019-11-28T11:28:21.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.756+0000 7f8b54c6f700 1 -- 172.21.15.80:0/86130605 shutdown_connections 2019-11-28T11:28:21.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.756+0000 7f8b54c6f700 1 --2- 172.21.15.80:0/86130605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b5006c2f0 0x7f8b5006c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:21.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.756+0000 7f8b54c6f700 1 --2- 172.21.15.80:0/86130605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5015f100 0x7f8b5006bdb0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:21.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.756+0000 7f8b54c6f700 1 -- 172.21.15.80:0/86130605 shutdown_connections 2019-11-28T11:28:21.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.756+0000 7f8b54c6f700 1 -- 172.21.15.80:0/86130605 wait complete. 2019-11-28T11:28:21.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.756+0000 7f8b54c6f700 1 -- 172.21.15.80:0/86130605 >> 172.21.15.80:0/86130605 conn(0x7f8b50061d20 msgr2=0x7f8b500641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:21.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.758+0000 7f8b54c6f700 1 Processor -- start 2019-11-28T11:28:21.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.758+0000 7f8b54c6f700 1 -- start start 2019-11-28T11:28:21.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.759+0000 7f8b54c6f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8b5010f9f0 0x7f8b50168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:21.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.759+0000 7f8b54c6f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5010c250 con 0x7f8b5010ed60 2019-11-28T11:28:21.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.759+0000 7f8b54c6f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5010fe70 con 0x7f8b5010e970 2019-11-28T11:28:21.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.759+0000 7f8b54c6f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5010e430 con 0x7f8b5010f9f0 2019-11-28T11:28:21.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.759+0000 7f8b4f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8b5010f9f0 0x7f8b50168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.759+0000 7f8b4f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8b5010f9f0 0x7f8b50168d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33104/0 (socket says 172.21.15.80:33104) 2019-11-28T11:28:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.759+0000 7f8b4e59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8b5010ed60 0x7f8b5010f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60648/0 (socket says 172.21.15.80:60648) 2019-11-28T11:28:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.759+0000 7f8b4f59e700 1 -- 172.21.15.80:0/4216377190 learned_addr learned my addr 172.21.15.80:0/4216377190 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.760+0000 7f8b4f59e700 1 -- 172.21.15.80:0/4216377190 >> v1:172.21.15.174:6789/0 conn(0x7f8b5010e970 legacy=0x7f8b501087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.760+0000 7f8b4f59e700 1 -- 172.21.15.80:0/4216377190 >> v1:172.21.15.80:6789/0 conn(0x7f8b5010ed60 legacy=0x7f8b5010f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.760+0000 7f8b4f59e700 1 -- 172.21.15.80:0/4216377190 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50105ef0 con 0x7f8b5010f9f0 2019-11-28T11:28:21.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.760+0000 7f8b477fe700 1 -- 172.21.15.80:0/4216377190 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546155762 0 0) 0x7f8b38007950 con 0x7f8b5010ed60 2019-11-28T11:28:21.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.760+0000 7f8b4f59e700 1 --2- 172.21.15.80:0/4216377190 >> v2:172.21.15.80:3300/0 conn(0x7f8b5010f9f0 0x7f8b50168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8b48010450 tx=0x7f8b480107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.760+0000 7f8b4f59e700 1 --2- 172.21.15.80:0/4216377190 >> v2:172.21.15.80:3300/0 conn(0x7f8b5010f9f0 0x7f8b50168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8b48010450 tx=0x7f8b480107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.760+0000 7f8b4f59e700 1 --2- 172.21.15.80:0/4216377190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5010f9f0 0x7f8b50168d80 secure :-1 s=READY pgs=463 cs=0 l=1 rx=0x7f8b48010450 tx=0x7f8b480107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:21.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.760+0000 7f8b4f59e700 1 --2- 172.21.15.80:0/4216377190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5010f9f0 0x7f8b50168d80 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f8b48010450 tx=0x7f8b480107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.760+0000 7f8b477fe700 1 -- 172.21.15.80:0/4216377190 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b4800f090 con 0x7f8b5010f9f0 2019-11-28T11:28:21.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.760+0000 7f8b4f59e700 1 --2- 172.21.15.80:0/4216377190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5010f9f0 0x7f8b50168d80 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f8b48010450 tx=0x7f8b480107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.760+0000 7f8b4f59e700 1 --2- 172.21.15.80:0/4216377190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5010f9f0 0x7f8b50168d80 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f8b48010450 tx=0x7f8b480107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.760+0000 7f8b477fe700 1 -- 172.21.15.80:0/4216377190 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b48000a70 con 0x7f8b5010f9f0 2019-11-28T11:28:21.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.760+0000 7f8b54c6f700 1 -- 172.21.15.80:0/4216377190 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b50106270 con 0x7f8b5010f9f0 2019-11-28T11:28:21.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.760+0000 7f8b477fe700 1 -- 172.21.15.80:0/4216377190 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b4800f670 con 0x7f8b5010f9f0 2019-11-28T11:28:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.760+0000 7f8b54c6f700 1 -- 172.21.15.80:0/4216377190 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b50105ef0 con 0x7f8b5010f9f0 2019-11-28T11:28:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.760+0000 7f8b4f59e700 1 --2- 172.21.15.80:0/4216377190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5010f9f0 0x7f8b50168d80 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f8b48010450 tx=0x7f8b480107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.761+0000 7f8b477fe700 1 -- 172.21.15.80:0/4216377190 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8b4800ed50 con 0x7f8b5010f9f0 2019-11-28T11:28:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.761+0000 7f8b4f59e700 1 --2- 172.21.15.80:0/4216377190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5010f9f0 0x7f8b50168d80 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f8b48010450 tx=0x7f8b480107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.761+0000 7f8b477fe700 1 --2- 172.21.15.80:0/4216377190 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b28018730 0x7f8b2801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:21.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.761+0000 7f8b477fe700 1 -- 172.21.15.80:0/4216377190 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8b48031b80 con 0x7f8b5010f9f0 2019-11-28T11:28:21.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.761+0000 7f8b4ed9d700 1 --2- 172.21.15.80:0/4216377190 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b28018730 0x7f8b2801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:21.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.761+0000 7f8b4ed9d700 1 --2- 172.21.15.80:0/4216377190 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b28018730 0x7f8b2801abc0 crc :-1 s=READY pgs=200 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:21.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.769+0000 7f8b54c6f700 1 -- 172.21.15.80:0/4216377190 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b50106270 con 0x7f8b5010f9f0 2019-11-28T11:28:21.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.772+0000 7f8b4f59e700 1 --2- 172.21.15.80:0/4216377190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5010f9f0 0x7f8b50168d80 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f8b48010450 tx=0x7f8b480107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:21.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.772+0000 7f8b477fe700 1 -- 172.21.15.80:0/4216377190 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8b4800ea80 con 0x7f8b5010f9f0 2019-11-28T11:28:21.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:21.941+0000 7f8b54c6f700 1 -- 172.21.15.80:0/4216377190 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8b50105ef0 con 0x7f8b5010f9f0 2019-11-28T11:28:22.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.577+0000 7f8b4f59e700 1 --2- 172.21.15.80:0/4216377190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5010f9f0 0x7f8b50168d80 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f8b48010450 tx=0x7f8b480107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:22.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.577+0000 7f8b477fe700 1 -- 172.21.15.80:0/4216377190 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) v1 ==== 185+0+0 (secure 0 0 0) 0x7f8b4800f0f0 con 0x7f8b5010f9f0 2019-11-28T11:28:22.633 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:28:22.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.608+0000 7f8b54c6f700 1 -- 172.21.15.80:0/4216377190 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b28018730 msgr2=0x7f8b2801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.608+0000 7f8b54c6f700 1 --2- 172.21.15.80:0/4216377190 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b28018730 0x7f8b2801abc0 crc :-1 s=READY pgs=200 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.608+0000 7f8b54c6f700 1 -- 172.21.15.80:0/4216377190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5010f9f0 msgr2=0x7f8b50168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.608+0000 7f8b54c6f700 1 --2- 172.21.15.80:0/4216377190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5010f9f0 0x7f8b50168d80 secure :-1 s=READY pgs=463 cs=0 l=1 rx=0x7f8b48010450 tx=0x7f8b480107f0).stop 2019-11-28T11:28:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.608+0000 7f8b54c6f700 1 -- 172.21.15.80:0/4216377190 shutdown_connections 2019-11-28T11:28:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.608+0000 7f8b54c6f700 1 --2- 172.21.15.80:0/4216377190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b5010f9f0 0x7f8b50168d80 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:22.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.608+0000 7f8b54c6f700 1 --2- 172.21.15.80:0/4216377190 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b28018730 0x7f8b2801abc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:22.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.608+0000 7f8b54c6f700 1 -- 172.21.15.80:0/4216377190 shutdown_connections 2019-11-28T11:28:22.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.608+0000 7f8b54c6f700 1 -- 172.21.15.80:0/4216377190 wait complete. 2019-11-28T11:28:22.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.608+0000 7f8b54c6f700 1 -- 172.21.15.80:0/4216377190 >> 172.21.15.80:0/4216377190 conn(0x7f8b5015e2d0 msgr2=0x7f8b50147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:22.645 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:28:22.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.741+0000 7fc7f18cf700 1 Processor -- start 2019-11-28T11:28:22.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.741+0000 7fc7f18cf700 1 -- start start 2019-11-28T11:28:22.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.742+0000 7fc7f18cf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7ec15f100 0x7fc7ec06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:22.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.742+0000 7fc7f18cf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ec06db60 con 0x7fc7ec06c2f0 2019-11-28T11:28:22.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.742+0000 7fc7f18cf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ec06e060 con 0x7fc7ec15ed10 2019-11-28T11:28:22.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.742+0000 7fc7f18cf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec06fe00 con 0x7fc7ec15f100 2019-11-28T11:28:22.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.742+0000 7fc7ebfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc7ec06c2f0 0x7fc7ec06c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60658/0 (socket says 172.21.15.80:60658) 2019-11-28T11:28:22.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.742+0000 7fc7ebfff700 1 -- 172.21.15.80:0/630064971 learned_addr learned my addr 172.21.15.80:0/630064971 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:22.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.742+0000 7fc7eaffd700 1 --2- 172.21.15.80:0/630064971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7ec15f100 0x7fc7ec06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:22.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.742+0000 7fc7ea7fc700 1 -- 172.21.15.80:0/630064971 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717904692 0 0) 0x7fc7e4001150 con 0x7fc7ec06c2f0 2019-11-28T11:28:22.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.742+0000 7fc7ea7fc700 1 -- 172.21.15.80:0/630064971 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7d8002e80 con 0x7fc7ec06c2f0 2019-11-28T11:28:22.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.742+0000 7fc7ea7fc700 1 -- 172.21.15.80:0/630064971 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945057249 0 0) 0x7fc7dc001400 con 0x7fc7ec15ed10 2019-11-28T11:28:22.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.742+0000 7fc7ea7fc700 1 -- 172.21.15.80:0/630064971 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7d80030b0 con 0x7fc7ec15ed10 2019-11-28T11:28:22.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.742+0000 7fc7ea7fc700 1 -- 172.21.15.80:0/630064971 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2338805788 0 0) 0x7fc7e4001130 con 0x7fc7ec06c2f0 2019-11-28T11:28:22.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.742+0000 7fc7eaffd700 1 -- 172.21.15.80:0/630064971 >> v1:172.21.15.174:6789/0 conn(0x7fc7ec15ed10 legacy=0x7fc7ec073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:22.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.743+0000 7fc7eaffd700 1 -- 172.21.15.80:0/630064971 >> v1:172.21.15.80:6789/0 conn(0x7fc7ec06c2f0 legacy=0x7fc7ec06c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:22.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.743+0000 7fc7eaffd700 1 -- 172.21.15.80:0/630064971 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec070760 con 0x7fc7ec15f100 2019-11-28T11:28:22.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.743+0000 7fc7eaffd700 1 --2- 172.21.15.80:0/630064971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7ec15f100 0x7fc7ec06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc7d400af50 tx=0x7fc7d400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:22.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.743+0000 7fc7eaffd700 1 --2- 172.21.15.80:0/630064971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7ec15f100 0x7fc7ec06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc7d400af50 tx=0x7fc7d400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:22.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.743+0000 7fc7eaffd700 1 --2- 172.21.15.80:0/630064971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7ec15f100 0x7fc7ec06bdb0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fc7d400af50 tx=0x7fc7d400b760).ready entity=mon.2 client_cookie=b9f5abe1f7fb2144 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:22.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.743+0000 7fc7eaffd700 1 --2- 172.21.15.80:0/630064971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7ec15f100 0x7fc7ec06bdb0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fc7d400af50 tx=0x7fc7d400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:22.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.743+0000 7fc7ea7fc700 1 -- 172.21.15.80:0/630064971 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7d4000960 con 0x7fc7ec15f100 2019-11-28T11:28:22.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.743+0000 7fc7eaffd700 1 --2- 172.21.15.80:0/630064971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7ec15f100 0x7fc7ec06bdb0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fc7d400af50 tx=0x7fc7d400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:22.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.743+0000 7fc7eaffd700 1 --2- 172.21.15.80:0/630064971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7ec15f100 0x7fc7ec06bdb0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fc7d400af50 tx=0x7fc7d400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:22.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.743+0000 7fc7ea7fc700 1 -- 172.21.15.80:0/630064971 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d4009860 con 0x7fc7ec15f100 2019-11-28T11:28:22.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.743+0000 7fc7ea7fc700 1 -- 172.21.15.80:0/630064971 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7d4009f30 con 0x7fc7ec15f100 2019-11-28T11:28:22.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.743+0000 7fc7f18cf700 1 -- 172.21.15.80:0/630064971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7ec15f100 msgr2=0x7fc7ec06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:22.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.743+0000 7fc7f18cf700 1 --2- 172.21.15.80:0/630064971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7ec15f100 0x7fc7ec06bdb0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fc7d400af50 tx=0x7fc7d400b760).stop 2019-11-28T11:28:22.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.744+0000 7fc7f18cf700 1 -- 172.21.15.80:0/630064971 shutdown_connections 2019-11-28T11:28:22.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.744+0000 7fc7f18cf700 1 --2- 172.21.15.80:0/630064971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7ec15f100 0x7fc7ec06bdb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:22.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.744+0000 7fc7f18cf700 1 -- 172.21.15.80:0/630064971 shutdown_connections 2019-11-28T11:28:22.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.744+0000 7fc7f18cf700 1 -- 172.21.15.80:0/630064971 wait complete. 2019-11-28T11:28:22.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.744+0000 7fc7f18cf700 1 -- 172.21.15.80:0/630064971 >> 172.21.15.80:0/630064971 conn(0x7fc7ec061d20 msgr2=0x7fc7ec0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:22.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.746+0000 7fc7f18cf700 1 Processor -- start 2019-11-28T11:28:22.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.746+0000 7fc7f18cf700 1 -- start start 2019-11-28T11:28:22.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.747+0000 7fc7f18cf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc7ec10f9f0 0x7fc7ec168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:22.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.747+0000 7fc7f18cf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ec10c250 con 0x7fc7ec10ed60 2019-11-28T11:28:22.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.747+0000 7fc7f18cf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ec10fe70 con 0x7fc7ec10e970 2019-11-28T11:28:22.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.747+0000 7fc7f18cf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ec10e430 con 0x7fc7ec10f9f0 2019-11-28T11:28:22.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.747+0000 7fc7eaffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc7ec10ed60 0x7fc7ec10f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60664/0 (socket says 172.21.15.80:60664) 2019-11-28T11:28:22.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.747+0000 7fc7eaffd700 1 -- 172.21.15.80:0/320927052 learned_addr learned my addr 172.21.15.80:0/320927052 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:22.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.747+0000 7fc7ebfff700 1 --2- 172.21.15.80:0/320927052 >> v2:172.21.15.174:3300/0 conn(0x7fc7ec10f9f0 0x7fc7ec168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:22.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.747+0000 7fc7e3fff700 1 -- 172.21.15.80:0/320927052 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263515502 0 0) 0x7fc7d4000940 con 0x7fc7ec10ed60 2019-11-28T11:28:22.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.747+0000 7fc7e3fff700 1 -- 172.21.15.80:0/320927052 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7d0002e80 con 0x7fc7ec10ed60 2019-11-28T11:28:22.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.747+0000 7fc7e3fff700 1 -- 172.21.15.80:0/320927052 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047534926 0 0) 0x7fc7dc0015c0 con 0x7fc7ec10e970 2019-11-28T11:28:22.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.747+0000 7fc7e3fff700 1 -- 172.21.15.80:0/320927052 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7d00030b0 con 0x7fc7ec10e970 2019-11-28T11:28:22.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.748+0000 7fc7ebfff700 1 -- 172.21.15.80:0/320927052 >> v1:172.21.15.174:6789/0 conn(0x7fc7ec10e970 legacy=0x7fc7ec1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:22.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.748+0000 7fc7ebfff700 1 -- 172.21.15.80:0/320927052 >> v1:172.21.15.80:6789/0 conn(0x7fc7ec10ed60 legacy=0x7fc7ec10f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:22.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.748+0000 7fc7e3fff700 1 -- 172.21.15.80:0/320927052 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1090221782 0 0) 0x7fc7d400ac00 con 0x7fc7ec10ed60 2019-11-28T11:28:22.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.748+0000 7fc7ebfff700 1 -- 172.21.15.80:0/320927052 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec105ef0 con 0x7fc7ec10f9f0 2019-11-28T11:28:22.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.748+0000 7fc7ebfff700 1 --2- 172.21.15.80:0/320927052 >> v2:172.21.15.174:3300/0 conn(0x7fc7ec10f9f0 0x7fc7ec168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7e4010370 tx=0x7fc7e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:22.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.748+0000 7fc7ebfff700 1 --2- 172.21.15.80:0/320927052 >> v2:172.21.15.174:3300/0 conn(0x7fc7ec10f9f0 0x7fc7ec168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7e4010370 tx=0x7fc7e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:22.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.748+0000 7fc7ebfff700 1 --2- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7ec10f9f0 0x7fc7ec168d80 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7fc7e4010370 tx=0x7fc7e4010710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:22.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.748+0000 7fc7ebfff700 1 --2- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7ec10f9f0 0x7fc7ec168d80 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fc7e4010370 tx=0x7fc7e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:22.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.748+0000 7fc7e3fff700 1 -- 172.21.15.80:0/320927052 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7e4000ef0 con 0x7fc7ec10f9f0 2019-11-28T11:28:22.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.748+0000 7fc7ebfff700 1 --2- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7ec10f9f0 0x7fc7ec168d80 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fc7e4010370 tx=0x7fc7e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:22.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.748+0000 7fc7ebfff700 1 --2- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7ec10f9f0 0x7fc7ec168d80 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fc7e4010370 tx=0x7fc7e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:22.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.748+0000 7fc7e3fff700 1 -- 172.21.15.80:0/320927052 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e4004430 con 0x7fc7ec10f9f0 2019-11-28T11:28:22.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.748+0000 7fc7f18cf700 1 -- 172.21.15.80:0/320927052 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ec106270 con 0x7fc7ec10f9f0 2019-11-28T11:28:22.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.748+0000 7fc7e3fff700 1 -- 172.21.15.80:0/320927052 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7e4004b00 con 0x7fc7ec10f9f0 2019-11-28T11:28:22.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.748+0000 7fc7f18cf700 1 -- 172.21.15.80:0/320927052 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ec105ef0 con 0x7fc7ec10f9f0 2019-11-28T11:28:22.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.748+0000 7fc7ebfff700 1 --2- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7ec10f9f0 0x7fc7ec168d80 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fc7e4010370 tx=0x7fc7e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:22.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.749+0000 7fc7e3fff700 1 -- 172.21.15.80:0/320927052 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc7e4004620 con 0x7fc7ec10f9f0 2019-11-28T11:28:22.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.749+0000 7fc7ebfff700 1 --2- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7ec10f9f0 0x7fc7ec168d80 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fc7e4010370 tx=0x7fc7e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:22.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.749+0000 7fc7e3fff700 1 --2- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7d0018750 0x7fc7d001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:22.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.749+0000 7fc7e3fff700 1 -- 172.21.15.80:0/320927052 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5668+0+0 (secure 0 0 0) 0x7fc7e4031a90 con 0x7fc7ec10f9f0 2019-11-28T11:28:22.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.749+0000 7fc7eb7fe700 1 --2- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7d0018750 0x7fc7d001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:22.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.749+0000 7fc7eb7fe700 1 --2- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7d0018750 0x7fc7d001abe0 crc :-1 s=READY pgs=201 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:22.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.756+0000 7fc7f18cf700 1 -- 172.21.15.80:0/320927052 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ec106270 con 0x7fc7ec10f9f0 2019-11-28T11:28:22.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.760+0000 7fc7ebfff700 1 --2- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7ec10f9f0 0x7fc7ec168d80 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fc7e4010370 tx=0x7fc7e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:22.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.760+0000 7fc7e3fff700 1 -- 172.21.15.80:0/320927052 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc7e4020ee0 con 0x7fc7ec10f9f0 2019-11-28T11:28:22.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:22.931+0000 7fc7f18cf700 1 -- 172.21.15.80:0/320927052 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc7ec105ef0 con 0x7fc7ec10f9f0 2019-11-28T11:28:23.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.579+0000 7fc7ebfff700 1 --2- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7ec10f9f0 0x7fc7ec168d80 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fc7e4010370 tx=0x7fc7e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:23.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.579+0000 7fc7e3fff700 1 -- 172.21.15.80:0/320927052 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc7e4020ee0 con 0x7fc7ec10f9f0 2019-11-28T11:28:23.622 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:28:23.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.598+0000 7fc7f18cf700 1 -- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7d0018750 msgr2=0x7fc7d001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:23.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.598+0000 7fc7f18cf700 1 --2- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7d0018750 0x7fc7d001abe0 crc :-1 s=READY pgs=201 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:23.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.598+0000 7fc7f18cf700 1 -- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7ec10f9f0 msgr2=0x7fc7ec168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:23.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.598+0000 7fc7f18cf700 1 --2- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7ec10f9f0 0x7fc7ec168d80 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7fc7e4010370 tx=0x7fc7e4010710).stop 2019-11-28T11:28:23.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.598+0000 7fc7f18cf700 1 -- 172.21.15.80:0/320927052 shutdown_connections 2019-11-28T11:28:23.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.598+0000 7fc7f18cf700 1 --2- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7ec10f9f0 0x7fc7ec168d80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:23.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.598+0000 7fc7f18cf700 1 --2- 172.21.15.80:0/320927052 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7d0018750 0x7fc7d001abe0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:23.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.598+0000 7fc7f18cf700 1 -- 172.21.15.80:0/320927052 shutdown_connections 2019-11-28T11:28:23.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.598+0000 7fc7f18cf700 1 -- 172.21.15.80:0/320927052 wait complete. 2019-11-28T11:28:23.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.598+0000 7fc7f18cf700 1 -- 172.21.15.80:0/320927052 >> 172.21.15.80:0/320927052 conn(0x7fc7ec15e2d0 msgr2=0x7fc7ec147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:23.635 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:28:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.731+0000 7fb7d83ec700 1 Processor -- start 2019-11-28T11:28:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.731+0000 7fb7d83ec700 1 -- start start 2019-11-28T11:28:23.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.732+0000 7fb7d83ec700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb7d006d120 0x7fb7d0165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:23.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.732+0000 7fb7d83ec700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d006d5a0 con 0x7fb7d006c490 2019-11-28T11:28:23.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.732+0000 7fb7d83ec700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d006db00 con 0x7fb7d006c0a0 2019-11-28T11:28:23.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.732+0000 7fb7d83ec700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d006fd60 con 0x7fb7d006d120 2019-11-28T11:28:23.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d718a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb7d006d120 0x7fb7d0165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:23.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d718a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb7d006d120 0x7fb7d0165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33124/0 (socket says 172.21.15.80:33124) 2019-11-28T11:28:23.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d718a700 1 -- 172.21.15.80:0/316018249 learned_addr learned my addr 172.21.15.80:0/316018249 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:23.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d718a700 1 -- 172.21.15.80:0/316018249 >> v1:172.21.15.174:6789/0 conn(0x7fb7d006c0a0 legacy=0x7fb7d0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:23.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d718a700 1 -- 172.21.15.80:0/316018249 >> v1:172.21.15.80:6789/0 conn(0x7fb7d006c490 legacy=0x7fb7d006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:23.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d5987700 1 -- 172.21.15.80:0/316018249 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525858355 0 0) 0x7fb7b8001480 con 0x7fb7d006c490 2019-11-28T11:28:23.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d718a700 1 -- 172.21.15.80:0/316018249 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d00706c0 con 0x7fb7d006d120 2019-11-28T11:28:23.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d718a700 1 --2- 172.21.15.80:0/316018249 >> v2:172.21.15.80:3300/0 conn(0x7fb7d006d120 0x7fb7d0165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb7c800f730 tx=0x7fb7c800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:23.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d718a700 1 --2- 172.21.15.80:0/316018249 >> v2:172.21.15.80:3300/0 conn(0x7fb7d006d120 0x7fb7d0165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb7c800f730 tx=0x7fb7c800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d718a700 1 --2- 172.21.15.80:0/316018249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7d006d120 0x7fb7d0165d80 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7fb7c800f730 tx=0x7fb7c800fad0).ready entity=mon.0 client_cookie=5510a55d1b6fc1bc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d718a700 1 --2- 172.21.15.80:0/316018249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7d006d120 0x7fb7d0165d80 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fb7c800f730 tx=0x7fb7c800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d5987700 1 -- 172.21.15.80:0/316018249 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7c80010e0 con 0x7fb7d006d120 2019-11-28T11:28:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d718a700 1 --2- 172.21.15.80:0/316018249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7d006d120 0x7fb7d0165d80 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fb7c800f730 tx=0x7fb7c800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d5987700 1 -- 172.21.15.80:0/316018249 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c8000a70 con 0x7fb7d006d120 2019-11-28T11:28:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d718a700 1 --2- 172.21.15.80:0/316018249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7d006d120 0x7fb7d0165d80 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fb7c800f730 tx=0x7fb7c800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d5987700 1 -- 172.21.15.80:0/316018249 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7c80012d0 con 0x7fb7d006d120 2019-11-28T11:28:23.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d83ec700 1 -- 172.21.15.80:0/316018249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7d006d120 msgr2=0x7fb7d0165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:23.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.733+0000 7fb7d83ec700 1 --2- 172.21.15.80:0/316018249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7d006d120 0x7fb7d0165d80 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7fb7c800f730 tx=0x7fb7c800fad0).stop 2019-11-28T11:28:23.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.734+0000 7fb7d83ec700 1 -- 172.21.15.80:0/316018249 shutdown_connections 2019-11-28T11:28:23.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.734+0000 7fb7d83ec700 1 --2- 172.21.15.80:0/316018249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7d006d120 0x7fb7d0165d80 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:23.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.734+0000 7fb7d83ec700 1 -- 172.21.15.80:0/316018249 shutdown_connections 2019-11-28T11:28:23.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.734+0000 7fb7d83ec700 1 -- 172.21.15.80:0/316018249 wait complete. 2019-11-28T11:28:23.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.734+0000 7fb7d83ec700 1 -- 172.21.15.80:0/316018249 >> 172.21.15.80:0/316018249 conn(0x7fb7d0061cf0 msgr2=0x7fb7d0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.737+0000 7fb7d83ec700 1 Processor -- start 2019-11-28T11:28:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.737+0000 7fb7d83ec700 1 -- start start 2019-11-28T11:28:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.737+0000 7fb7d83ec700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb7d012cea0 0x7fb7d0111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:23.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.737+0000 7fb7d83ec700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d0124260 con 0x7fb7d0165a00 2019-11-28T11:28:23.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.737+0000 7fb7d83ec700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d012e5d0 con 0x7fb7d01230e0 2019-11-28T11:28:23.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.737+0000 7fb7d83ec700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d0121040 con 0x7fb7d012cea0 2019-11-28T11:28:23.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7d718a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb7d0165a00 0x7fb7d0167e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60680/0 (socket says 172.21.15.80:60680) 2019-11-28T11:28:23.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7d718a700 1 -- 172.21.15.80:0/2741650996 learned_addr learned my addr 172.21.15.80:0/2741650996 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:23.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473105398 0 0) 0x7fb7c8007580 con 0x7fb7d0165a00 2019-11-28T11:28:23.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7b4002e80 con 0x7fb7d0165a00 2019-11-28T11:28:23.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7d6989700 1 --2- 172.21.15.80:0/2741650996 >> v2:172.21.15.174:3300/0 conn(0x7fb7d012cea0 0x7fb7d0111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:23.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1463902569 0 0) 0x7fb7c8007950 con 0x7fb7d0165a00 2019-11-28T11:28:23.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb7b40032e0 con 0x7fb7d0165a00 2019-11-28T11:28:23.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fb7c8007ee0 con 0x7fb7d0165a00 2019-11-28T11:28:23.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 >> v2:172.21.15.174:3300/0 conn(0x7fb7d012cea0 msgr2=0x7fb7d0111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:23.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7cf7fe700 1 --2- 172.21.15.80:0/2741650996 >> v2:172.21.15.174:3300/0 conn(0x7fb7d012cea0 0x7fb7d0111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:23.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 >> v1:172.21.15.174:6789/0 conn(0x7fb7d01230e0 legacy=0x7fb7d0123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:23.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 >> v1:172.21.15.80:6789/0 conn(0x7fb7d0165a00 legacy=0x7fb7d0167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:23.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7cf7fe700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7b40033b0 0x7fb7b40037c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:23.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7cf7fe700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7b4003d00 0x7fb7b40041c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:23.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7cf7fe700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7b4004950 0x7fb7b4004e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:23.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b400bbf0 con 0x7fb7b40033b0 2019-11-28T11:28:23.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b400be20 con 0x7fb7b4003d00 2019-11-28T11:28:23.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b400c050 con 0x7fb7b4004950 2019-11-28T11:28:23.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7d6989700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7b40033b0 0x7fb7b40037c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:23.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7d6188700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7b4003d00 0x7fb7b40041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:23.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.738+0000 7fb7d718a700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7b4004950 0x7fb7b4004e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:23.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d6989700 1 -- 172.21.15.80:0/2741650996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7b4004950 msgr2=0x7fb7b4004e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:23.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d6989700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7b4004950 0x7fb7b4004e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:23.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d6989700 1 -- 172.21.15.80:0/2741650996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7b4003d00 msgr2=0x7fb7b40041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:23.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d6989700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7b4003d00 0x7fb7b40041c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:23.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d6989700 1 -- 172.21.15.80:0/2741650996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b400c300 con 0x7fb7b40033b0 2019-11-28T11:28:23.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d83ec700 1 -- 172.21.15.80:0/2741650996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d0121d20 con 0x7fb7b40033b0 2019-11-28T11:28:23.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d718a700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7b4004950 0x7fb7b4004e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:23.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d6989700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7b40033b0 0x7fb7b40037c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb7c0010640 tx=0x7fb7c00104f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:23.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d718a700 1 -- 172.21.15.80:0/2741650996 reap_dead start 2019-11-28T11:28:23.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d83ec700 1 -- 172.21.15.80:0/2741650996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d01219a0 con 0x7fb7b40033b0 2019-11-28T11:28:23.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d6989700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7b40033b0 0x7fb7b40037c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb7c0010640 tx=0x7fb7c00104f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:23.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d6989700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7b40033b0 0x7fb7b40037c0 secure :-1 s=READY pgs=469 cs=0 l=1 rx=0x7fb7c0010640 tx=0x7fb7c00104f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:23.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d6989700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7b40033b0 0x7fb7b40037c0 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7fb7c0010640 tx=0x7fb7c00104f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:23.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7c0000960 con 0x7fb7b40033b0 2019-11-28T11:28:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d6989700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7b40033b0 0x7fb7b40037c0 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7fb7c0010640 tx=0x7fb7c00104f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c0000960 con 0x7fb7b40033b0 2019-11-28T11:28:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d6989700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7b40033b0 0x7fb7b40037c0 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7fb7c0010640 tx=0x7fb7c00104f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7c0009960 con 0x7fb7b40033b0 2019-11-28T11:28:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d6989700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7b40033b0 0x7fb7b40037c0 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7fb7c0010640 tx=0x7fb7c00104f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb7c0009580 con 0x7fb7b40033b0 2019-11-28T11:28:23.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7d6989700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7b40033b0 0x7fb7b40037c0 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7fb7c0010640 tx=0x7fb7c00104f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7cf7fe700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb7b401b490 0x7fb7b401d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.739+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5286+0+0 (secure 0 0 0) 0x7fb7c0031bf0 con 0x7fb7b40033b0 2019-11-28T11:28:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.740+0000 7fb7d6188700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb7b401b490 0x7fb7b401d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:23.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.740+0000 7fb7d6188700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb7b401b490 0x7fb7b401d900 crc :-1 s=READY pgs=202 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.746+0000 7fb7d83ec700 1 -- 172.21.15.80:0/2741650996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a8002e60 con 0x7fb7b40033b0 2019-11-28T11:28:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.750+0000 7fb7d6989700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7b40033b0 0x7fb7b40037c0 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7fb7c0010640 tx=0x7fb7c00104f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:23.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.750+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb7c000a690 con 0x7fb7b40033b0 2019-11-28T11:28:23.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:23.941+0000 7fb7d83ec700 1 -- 172.21.15.80:0/2741650996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fb7a8001d10 con 0x7fb7b40033b0 2019-11-28T11:28:24.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.588+0000 7fb7d6989700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7b40033b0 0x7fb7b40037c0 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7fb7c0010640 tx=0x7fb7c00104f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:24.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.588+0000 7fb7cf7fe700 1 -- 172.21.15.80:0/2741650996 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v42) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb7c0000940 con 0x7fb7b40033b0 2019-11-28T11:28:24.637 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:28:24.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.609+0000 7fb7d83ec700 1 -- 172.21.15.80:0/2741650996 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb7b401b490 msgr2=0x7fb7b401d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:24.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.609+0000 7fb7d83ec700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb7b401b490 0x7fb7b401d900 crc :-1 s=READY pgs=202 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:24.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.609+0000 7fb7d83ec700 1 -- 172.21.15.80:0/2741650996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7b40033b0 msgr2=0x7fb7b40037c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:24.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.609+0000 7fb7d83ec700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7b40033b0 0x7fb7b40037c0 secure :-1 s=READY pgs=469 cs=0 l=1 rx=0x7fb7c0010640 tx=0x7fb7c00104f0).stop 2019-11-28T11:28:24.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.609+0000 7fb7d83ec700 1 -- 172.21.15.80:0/2741650996 shutdown_connections 2019-11-28T11:28:24.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.609+0000 7fb7d83ec700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb7b401b490 0x7fb7b401d900 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:24.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.609+0000 7fb7d83ec700 1 --2- 172.21.15.80:0/2741650996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7b40033b0 0x7fb7b40037c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:24.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.609+0000 7fb7d83ec700 1 -- 172.21.15.80:0/2741650996 shutdown_connections 2019-11-28T11:28:24.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.609+0000 7fb7d83ec700 1 -- 172.21.15.80:0/2741650996 wait complete. 2019-11-28T11:28:24.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.609+0000 7fb7d83ec700 1 -- 172.21.15.80:0/2741650996 >> 172.21.15.80:0/2741650996 conn(0x7fb7d01426c0 msgr2=0x7fb7d0110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:24.653 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:28:24.653 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:28:24.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.750+0000 7fc3f1012700 1 Processor -- start 2019-11-28T11:28:24.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.750+0000 7fc3f1012700 1 -- start start 2019-11-28T11:28:24.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.751+0000 7fc3f1012700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3ec06d120 0x7fc3ec165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:24.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.751+0000 7fc3f1012700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec06d5a0 con 0x7fc3ec06c490 2019-11-28T11:28:24.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.751+0000 7fc3f1012700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec06db00 con 0x7fc3ec06c0a0 2019-11-28T11:28:24.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.751+0000 7fc3f1012700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ec06fd60 con 0x7fc3ec06d120 2019-11-28T11:28:24.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.751+0000 7fc3f0811700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3ec06d120 0x7fc3ec165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:24.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.751+0000 7fc3f0811700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3ec06d120 0x7fc3ec165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33144/0 (socket says 172.21.15.80:33144) 2019-11-28T11:28:24.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.751+0000 7fc3f0811700 1 -- 172.21.15.80:0/1741961687 learned_addr learned my addr 172.21.15.80:0/1741961687 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:24.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.752+0000 7fc3f0811700 1 -- 172.21.15.80:0/1741961687 >> v1:172.21.15.174:6789/0 conn(0x7fc3ec06c0a0 legacy=0x7fc3ec072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:24.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.752+0000 7fc3f0811700 1 -- 172.21.15.80:0/1741961687 >> v1:172.21.15.80:6789/0 conn(0x7fc3ec06c490 legacy=0x7fc3ec06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:24.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.752+0000 7fc3ea59c700 1 -- 172.21.15.80:0/1741961687 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890054229 0 0) 0x7fc3dc001080 con 0x7fc3ec06c0a0 2019-11-28T11:28:24.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.752+0000 7fc3f0811700 1 -- 172.21.15.80:0/1741961687 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec0706c0 con 0x7fc3ec06d120 2019-11-28T11:28:24.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.752+0000 7fc3f0811700 1 --2- 172.21.15.80:0/1741961687 >> v2:172.21.15.80:3300/0 conn(0x7fc3ec06d120 0x7fc3ec165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc3e400f730 tx=0x7fc3e400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:24.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.752+0000 7fc3f0811700 1 --2- 172.21.15.80:0/1741961687 >> v2:172.21.15.80:3300/0 conn(0x7fc3ec06d120 0x7fc3ec165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc3e400f730 tx=0x7fc3e400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:24.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.752+0000 7fc3f0811700 1 --2- 172.21.15.80:0/1741961687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec06d120 0x7fc3ec165d80 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7fc3e400f730 tx=0x7fc3e400fad0).ready entity=mon.0 client_cookie=8f40ff272b5d14c2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:24.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.752+0000 7fc3f0811700 1 --2- 172.21.15.80:0/1741961687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec06d120 0x7fc3ec165d80 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7fc3e400f730 tx=0x7fc3e400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:24.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.752+0000 7fc3ea59c700 1 -- 172.21.15.80:0/1741961687 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e40010e0 con 0x7fc3ec06d120 2019-11-28T11:28:24.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.752+0000 7fc3f0811700 1 --2- 172.21.15.80:0/1741961687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec06d120 0x7fc3ec165d80 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7fc3e400f730 tx=0x7fc3e400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:24.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.752+0000 7fc3f0811700 1 --2- 172.21.15.80:0/1741961687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec06d120 0x7fc3ec165d80 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7fc3e400f730 tx=0x7fc3e400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:24.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.752+0000 7fc3ea59c700 1 -- 172.21.15.80:0/1741961687 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e4000a70 con 0x7fc3ec06d120 2019-11-28T11:28:24.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.752+0000 7fc3ea59c700 1 -- 172.21.15.80:0/1741961687 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e40016c0 con 0x7fc3ec06d120 2019-11-28T11:28:24.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.752+0000 7fc3f1012700 1 -- 172.21.15.80:0/1741961687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec06d120 msgr2=0x7fc3ec165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:24.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.752+0000 7fc3f1012700 1 --2- 172.21.15.80:0/1741961687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec06d120 0x7fc3ec165d80 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7fc3e400f730 tx=0x7fc3e400fad0).stop 2019-11-28T11:28:24.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.753+0000 7fc3f1012700 1 -- 172.21.15.80:0/1741961687 shutdown_connections 2019-11-28T11:28:24.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.753+0000 7fc3f1012700 1 --2- 172.21.15.80:0/1741961687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec06d120 0x7fc3ec165d80 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:24.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.753+0000 7fc3f1012700 1 -- 172.21.15.80:0/1741961687 shutdown_connections 2019-11-28T11:28:24.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.753+0000 7fc3f1012700 1 -- 172.21.15.80:0/1741961687 wait complete. 2019-11-28T11:28:24.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.753+0000 7fc3f1012700 1 -- 172.21.15.80:0/1741961687 >> 172.21.15.80:0/1741961687 conn(0x7fc3ec061cf0 msgr2=0x7fc3ec064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:24.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.755+0000 7fc3f1012700 1 Processor -- start 2019-11-28T11:28:24.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.755+0000 7fc3f1012700 1 -- start start 2019-11-28T11:28:24.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.756+0000 7fc3f1012700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3ec12cea0 0x7fc3ec111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:24.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.756+0000 7fc3f1012700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3ec1230e0 0x7fc3ec123570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:24.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.756+0000 7fc3f1012700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec124260 con 0x7fc3ec123ab0 2019-11-28T11:28:24.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.756+0000 7fc3f1012700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ec120610 con 0x7fc3ec1230e0 2019-11-28T11:28:24.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.756+0000 7fc3f1012700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec121040 con 0x7fc3ec12cea0 2019-11-28T11:28:24.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.756+0000 7fc3ead9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3ec1230e0 0x7fc3ec123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:24.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.756+0000 7fc3ead9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3ec1230e0 0x7fc3ec123570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33150/0 (socket says 172.21.15.80:33150) 2019-11-28T11:28:24.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.756+0000 7fc3ead9d700 1 -- 172.21.15.80:0/2627245867 learned_addr learned my addr 172.21.15.80:0/2627245867 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:24.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.756+0000 7fc3eb59e700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3ec12cea0 0x7fc3ec111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:24.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.756+0000 7fc3e3fff700 1 -- 172.21.15.80:0/2627245867 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665639389 0 0) 0x7fc3e4000940 con 0x7fc3ec123ab0 2019-11-28T11:28:24.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.756+0000 7fc3ead9d700 1 -- 172.21.15.80:0/2627245867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3ec12cea0 msgr2=0x7fc3ec111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:24.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.756+0000 7fc3ead9d700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3ec12cea0 0x7fc3ec111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:24.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.756+0000 7fc3ead9d700 1 -- 172.21.15.80:0/2627245867 >> v1:172.21.15.174:6789/0 conn(0x7fc3ec123ab0 legacy=0x7fc3ec12d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:24.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.757+0000 7fc3ead9d700 1 -- 172.21.15.80:0/2627245867 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec1219a0 con 0x7fc3ec1230e0 2019-11-28T11:28:24.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.757+0000 7fc3ead9d700 1 --2- 172.21.15.80:0/2627245867 >> v2:172.21.15.80:3300/0 conn(0x7fc3ec1230e0 0x7fc3ec123570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc3d4010790 tx=0x7fc3d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:24.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.757+0000 7fc3ead9d700 1 --2- 172.21.15.80:0/2627245867 >> v2:172.21.15.80:3300/0 conn(0x7fc3ec1230e0 0x7fc3ec123570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc3d4010790 tx=0x7fc3d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:24.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.757+0000 7fc3ead9d700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec1230e0 0x7fc3ec123570 secure :-1 s=READY pgs=472 cs=0 l=1 rx=0x7fc3d4010790 tx=0x7fc3d40105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:24.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.757+0000 7fc3ead9d700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec1230e0 0x7fc3ec123570 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7fc3d4010790 tx=0x7fc3d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:24.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.757+0000 7fc3e3fff700 1 -- 172.21.15.80:0/2627245867 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3d4005aa0 con 0x7fc3ec1230e0 2019-11-28T11:28:24.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.757+0000 7fc3ead9d700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec1230e0 0x7fc3ec123570 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7fc3d4010790 tx=0x7fc3d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:24.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.757+0000 7fc3e3fff700 1 -- 172.21.15.80:0/2627245867 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d40056c0 con 0x7fc3ec1230e0 2019-11-28T11:28:24.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.757+0000 7fc3ead9d700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec1230e0 0x7fc3ec123570 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7fc3d4010790 tx=0x7fc3d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:24.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.757+0000 7fc3f1012700 1 -- 172.21.15.80:0/2627245867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ec121d20 con 0x7fc3ec1230e0 2019-11-28T11:28:24.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.757+0000 7fc3e3fff700 1 -- 172.21.15.80:0/2627245867 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3d4005aa0 con 0x7fc3ec1230e0 2019-11-28T11:28:24.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.757+0000 7fc3f1012700 1 -- 172.21.15.80:0/2627245867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ec1122f0 con 0x7fc3ec1230e0 2019-11-28T11:28:24.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.757+0000 7fc3ead9d700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec1230e0 0x7fc3ec123570 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7fc3d4010790 tx=0x7fc3d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:24.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.757+0000 7fc3e3fff700 1 -- 172.21.15.80:0/2627245867 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc3d40058b0 con 0x7fc3ec1230e0 2019-11-28T11:28:24.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.757+0000 7fc3ead9d700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec1230e0 0x7fc3ec123570 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7fc3d4010790 tx=0x7fc3d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:24.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.757+0000 7fc3e3fff700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3c4018730 0x7fc3c401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:24.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.758+0000 7fc3e3fff700 1 -- 172.21.15.80:0/2627245867 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fc3d4031e00 con 0x7fc3ec1230e0 2019-11-28T11:28:24.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.758+0000 7fc3eb59e700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3c4018730 0x7fc3c401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:24.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.758+0000 7fc3eb59e700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3c4018730 0x7fc3c401abc0 crc :-1 s=READY pgs=203 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:24.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.765+0000 7fc3f1012700 1 -- 172.21.15.80:0/2627245867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ec1219a0 con 0x7fc3ec1230e0 2019-11-28T11:28:24.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.769+0000 7fc3ead9d700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec1230e0 0x7fc3ec123570 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7fc3d4010790 tx=0x7fc3d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:24.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.769+0000 7fc3e3fff700 1 -- 172.21.15.80:0/2627245867 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc3d402e100 con 0x7fc3ec1230e0 2019-11-28T11:28:24.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.939+0000 7fc3f1012700 1 -- 172.21.15.80:0/2627245867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc3ec121d20 con 0x7fc3ec1230e0 2019-11-28T11:28:24.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.940+0000 7fc3ead9d700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec1230e0 0x7fc3ec123570 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7fc3d4010790 tx=0x7fc3d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:24.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.940+0000 7fc3e3fff700 1 -- 172.21.15.80:0/2627245867 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+4797 (secure 0 0 0) 0x7fc3d402e100 con 0x7fc3ec1230e0 2019-11-28T11:28:24.967 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:24.967 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:28:24.967 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:28:24.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.967 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:28:24.968 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:28:24.968 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.968 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:28:24.968 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:24.968 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:24.968 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:24.968 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.969 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:28:24.969 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:28:24.969 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.969 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:28:24.969 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:24.970 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:24.970 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:24.970 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.970 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:28:24.971 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:28:24.971 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.971 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:28:24.971 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:24.971 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:24.971 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:24.971 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.972 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:28:24.972 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:28:24.972 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.972 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:24.972 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:24.973 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:24.973 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.973 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:28:24.974 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:28:24.974 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.974 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:24.974 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:24.974 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:24.974 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.975 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:28:24.975 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:28:24.975 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.975 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:24.975 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:24.976 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:24.976 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.976 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:28:24.976 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:28:24.977 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.977 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:24.977 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:24.977 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:24.977 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.978 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:28:24.978 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:28:24.978 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.978 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:24.978 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:24.978 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:24.979 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.979 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:28:24.979 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:28:24.979 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.979 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:24.979 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:24.980 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:24.980 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.980 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:28:24.980 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:28:24.981 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.981 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:24.981 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:24.981 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:24.981 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.982 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:28:24.982 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:28:24.982 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.982 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:24.982 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:24.982 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:24.982 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.983 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:28:24.983 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:28:24.983 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.983 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:28:24.983 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:28:24.983 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:28:24.984 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.984 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:28:24.984 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:28:24.984 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.985 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:28:24.985 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:28:24.985 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:28:24.985 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.985 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:28:24.986 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:28:24.986 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.986 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:28:24.986 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:28:24.986 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:28:24.986 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.987 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:28:24.987 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:28:24.987 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.987 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:28:24.987 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:28:24.987 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:28:24.988 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.988 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:28:24.988 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:28:24.989 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.989 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:28:24.989 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:24.989 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:24.989 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:24.989 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.990 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:28:24.990 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:28:24.990 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.990 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:28:24.990 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:28:24.990 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:24.991 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:24.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:24.991 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:28:24.991 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:28:24.991 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:24.991 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:28:24.992 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:28:24.992 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:24.992 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.992 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:24.992 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:24.992 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:28:24.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.942+0000 7fc3f1012700 1 -- 172.21.15.80:0/2627245867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3c4018730 msgr2=0x7fc3c401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:24.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.942+0000 7fc3f1012700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3c4018730 0x7fc3c401abc0 crc :-1 s=READY pgs=203 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:24.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.942+0000 7fc3f1012700 1 -- 172.21.15.80:0/2627245867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec1230e0 msgr2=0x7fc3ec123570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:24.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.942+0000 7fc3f1012700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec1230e0 0x7fc3ec123570 secure :-1 s=READY pgs=472 cs=0 l=1 rx=0x7fc3d4010790 tx=0x7fc3d40105f0).stop 2019-11-28T11:28:24.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.942+0000 7fc3f1012700 1 -- 172.21.15.80:0/2627245867 shutdown_connections 2019-11-28T11:28:24.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.942+0000 7fc3f1012700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3c4018730 0x7fc3c401abc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:24.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.942+0000 7fc3f1012700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec1230e0 0x7fc3ec123570 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:24.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.942+0000 7fc3f1012700 1 --2- 172.21.15.80:0/2627245867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3ec12cea0 0x7fc3ec111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:24.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.943+0000 7fc3f1012700 1 -- 172.21.15.80:0/2627245867 shutdown_connections 2019-11-28T11:28:24.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.943+0000 7fc3f1012700 1 -- 172.21.15.80:0/2627245867 wait complete. 2019-11-28T11:28:24.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:24.943+0000 7fc3f1012700 1 -- 172.21.15.80:0/2627245867 >> 172.21.15.80:0/2627245867 conn(0x7fc3ec1426c0 msgr2=0x7fc3ec110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:24.996 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:28:25.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.090+0000 7fbcaea47700 1 Processor -- start 2019-11-28T11:28:25.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.090+0000 7fbcaea47700 1 -- start start 2019-11-28T11:28:25.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.091+0000 7fbcaea47700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca806c490 0x7fbca806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:25.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.091+0000 7fbcaea47700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca806db00 con 0x7fbca806ce60 2019-11-28T11:28:25.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.091+0000 7fbcaea47700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca806e000 con 0x7fbca806c0a0 2019-11-28T11:28:25.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.091+0000 7fbcaea47700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca806fd60 con 0x7fbca806c490 2019-11-28T11:28:25.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.091+0000 7fbcad7e5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbca806ce60 0x7fbca8164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60704/0 (socket says 172.21.15.80:60704) 2019-11-28T11:28:25.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.091+0000 7fbcad7e5700 1 -- 172.21.15.80:0/2803524227 learned_addr learned my addr 172.21.15.80:0/2803524227 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:25.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.091+0000 7fbca7fff700 1 --2- 172.21.15.80:0/2803524227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca806c490 0x7fbca806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:25.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.091+0000 7fbca77fe700 1 -- 172.21.15.80:0/2803524227 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732843906 0 0) 0x7fbca0001150 con 0x7fbca806ce60 2019-11-28T11:28:25.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.091+0000 7fbca77fe700 1 -- 172.21.15.80:0/2803524227 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc94002e80 con 0x7fbca806ce60 2019-11-28T11:28:25.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.091+0000 7fbca77fe700 1 -- 172.21.15.80:0/2803524227 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251182463 0 0) 0x7fbc90001080 con 0x7fbca806c0a0 2019-11-28T11:28:25.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.091+0000 7fbca77fe700 1 -- 172.21.15.80:0/2803524227 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc940030b0 con 0x7fbca806c0a0 2019-11-28T11:28:25.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.091+0000 7fbca7fff700 1 -- 172.21.15.80:0/2803524227 >> v1:172.21.15.174:6789/0 conn(0x7fbca806c0a0 legacy=0x7fbca8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.091+0000 7fbca7fff700 1 -- 172.21.15.80:0/2803524227 >> v1:172.21.15.80:6789/0 conn(0x7fbca806ce60 legacy=0x7fbca8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.091+0000 7fbca7fff700 1 -- 172.21.15.80:0/2803524227 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca80706c0 con 0x7fbca806c490 2019-11-28T11:28:25.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.092+0000 7fbca7fff700 1 --2- 172.21.15.80:0/2803524227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca806c490 0x7fbca806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbc9800b2d0 tx=0x7fbc9800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.092+0000 7fbca7fff700 1 --2- 172.21.15.80:0/2803524227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca806c490 0x7fbca806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbc9800b2d0 tx=0x7fbc9800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.092+0000 7fbca7fff700 1 --2- 172.21.15.80:0/2803524227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca806c490 0x7fbca806c920 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7fbc9800b2d0 tx=0x7fbc9800bae0).ready entity=mon.2 client_cookie=6f6d44421f853b9e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:25.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.092+0000 7fbca7fff700 1 --2- 172.21.15.80:0/2803524227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca806c490 0x7fbca806c920 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fbc9800b2d0 tx=0x7fbc9800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.092+0000 7fbca77fe700 1 -- 172.21.15.80:0/2803524227 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc98007590 con 0x7fbca806c490 2019-11-28T11:28:25.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.092+0000 7fbca7fff700 1 --2- 172.21.15.80:0/2803524227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca806c490 0x7fbca806c920 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fbc9800b2d0 tx=0x7fbc9800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.092+0000 7fbca7fff700 1 --2- 172.21.15.80:0/2803524227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca806c490 0x7fbca806c920 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fbc9800b2d0 tx=0x7fbc9800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.092+0000 7fbca77fe700 1 -- 172.21.15.80:0/2803524227 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc98009d30 con 0x7fbca806c490 2019-11-28T11:28:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.092+0000 7fbca77fe700 1 -- 172.21.15.80:0/2803524227 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc9800a380 con 0x7fbca806c490 2019-11-28T11:28:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.092+0000 7fbcaea47700 1 -- 172.21.15.80:0/2803524227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca806c490 msgr2=0x7fbca806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.092+0000 7fbcaea47700 1 --2- 172.21.15.80:0/2803524227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca806c490 0x7fbca806c920 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7fbc9800b2d0 tx=0x7fbc9800bae0).stop 2019-11-28T11:28:25.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.093+0000 7fbcaea47700 1 -- 172.21.15.80:0/2803524227 shutdown_connections 2019-11-28T11:28:25.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.093+0000 7fbcaea47700 1 --2- 172.21.15.80:0/2803524227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbca806c490 0x7fbca806c920 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:25.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.093+0000 7fbcaea47700 1 -- 172.21.15.80:0/2803524227 shutdown_connections 2019-11-28T11:28:25.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.093+0000 7fbcaea47700 1 -- 172.21.15.80:0/2803524227 wait complete. 2019-11-28T11:28:25.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.093+0000 7fbcaea47700 1 -- 172.21.15.80:0/2803524227 >> 172.21.15.80:0/2803524227 conn(0x7fbca8061cf0 msgr2=0x7fbca8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:25.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.095+0000 7fbcaea47700 1 Processor -- start 2019-11-28T11:28:25.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.095+0000 7fbcaea47700 1 -- start start 2019-11-28T11:28:25.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.096+0000 7fbcaea47700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbca81068c0 0x7fbca8137480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:25.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.096+0000 7fbcaea47700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbca81379c0 0x7fbca8128210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:25.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.096+0000 7fbcaea47700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca8106fc0 con 0x7fbca8128750 2019-11-28T11:28:25.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.096+0000 7fbcaea47700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca8133770 con 0x7fbca81068c0 2019-11-28T11:28:25.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.096+0000 7fbcaea47700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca8073ac0 con 0x7fbca81379c0 2019-11-28T11:28:25.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.096+0000 7fbcacfe4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbca81068c0 0x7fbca8137480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:25.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.096+0000 7fbcacfe4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbca81068c0 0x7fbca8137480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33160/0 (socket says 172.21.15.80:33160) 2019-11-28T11:28:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.096+0000 7fbcad7e5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbca8128750 0x7fbca812e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60710/0 (socket says 172.21.15.80:60710) 2019-11-28T11:28:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.096+0000 7fbcacfe4700 1 -- 172.21.15.80:0/2504170027 learned_addr learned my addr 172.21.15.80:0/2504170027 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.096+0000 7fbca7fff700 1 --2- 172.21.15.80:0/2504170027 >> v2:172.21.15.174:3300/0 conn(0x7fbca81379c0 0x7fbca8128210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbcacfe4700 1 -- 172.21.15.80:0/2504170027 >> v2:172.21.15.174:3300/0 conn(0x7fbca81379c0 msgr2=0x7fbca8128210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbcacfe4700 1 --2- 172.21.15.80:0/2504170027 >> v2:172.21.15.174:3300/0 conn(0x7fbca81379c0 0x7fbca8128210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbcacfe4700 1 -- 172.21.15.80:0/2504170027 >> v1:172.21.15.80:6789/0 conn(0x7fbca8128750 legacy=0x7fbca812e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbcacfe4700 1 -- 172.21.15.80:0/2504170027 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca8133e00 con 0x7fbca81068c0 2019-11-28T11:28:25.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbca57fa700 1 -- 172.21.15.80:0/2504170027 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113945208 0 0) 0x7fbca00009b0 con 0x7fbca8128750 2019-11-28T11:28:25.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbcacfe4700 1 --2- 172.21.15.80:0/2504170027 >> v2:172.21.15.80:3300/0 conn(0x7fbca81068c0 0x7fbca8137480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbc90010410 tx=0x7fbc90010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbcacfe4700 1 --2- 172.21.15.80:0/2504170027 >> v2:172.21.15.80:3300/0 conn(0x7fbca81068c0 0x7fbca8137480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbc90010410 tx=0x7fbc90010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbcacfe4700 1 --2- 172.21.15.80:0/2504170027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca81068c0 0x7fbca8137480 secure :-1 s=READY pgs=475 cs=0 l=1 rx=0x7fbc90010410 tx=0x7fbc90010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:25.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbcacfe4700 1 --2- 172.21.15.80:0/2504170027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca81068c0 0x7fbca8137480 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7fbc90010410 tx=0x7fbc90010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbca57fa700 1 -- 172.21.15.80:0/2504170027 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc90005770 con 0x7fbca81068c0 2019-11-28T11:28:25.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbcacfe4700 1 --2- 172.21.15.80:0/2504170027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca81068c0 0x7fbca8137480 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7fbc90010410 tx=0x7fbc90010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbca57fa700 1 -- 172.21.15.80:0/2504170027 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc90005390 con 0x7fbca81068c0 2019-11-28T11:28:25.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbcacfe4700 1 --2- 172.21.15.80:0/2504170027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca81068c0 0x7fbca8137480 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7fbc90010410 tx=0x7fbc90010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbca57fa700 1 -- 172.21.15.80:0/2504170027 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc90005960 con 0x7fbca81068c0 2019-11-28T11:28:25.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbcaea47700 1 -- 172.21.15.80:0/2504170027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca8134180 con 0x7fbca81068c0 2019-11-28T11:28:25.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbcaea47700 1 -- 172.21.15.80:0/2504170027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca81330b0 con 0x7fbca81068c0 2019-11-28T11:28:25.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.097+0000 7fbcacfe4700 1 --2- 172.21.15.80:0/2504170027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca81068c0 0x7fbca8137480 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7fbc90010410 tx=0x7fbc90010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.098+0000 7fbca57fa700 1 -- 172.21.15.80:0/2504170027 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbc90005580 con 0x7fbca81068c0 2019-11-28T11:28:25.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.098+0000 7fbcacfe4700 1 --2- 172.21.15.80:0/2504170027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca81068c0 0x7fbca8137480 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7fbc90010410 tx=0x7fbc90010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.098+0000 7fbca57fa700 1 --2- 172.21.15.80:0/2504170027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc8c018730 0x7fbc8c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:25.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.098+0000 7fbca57fa700 1 -- 172.21.15.80:0/2504170027 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fbc90031ab0 con 0x7fbca81068c0 2019-11-28T11:28:25.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.098+0000 7fbca7fff700 1 --2- 172.21.15.80:0/2504170027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc8c018730 0x7fbc8c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:25.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.098+0000 7fbca7fff700 1 --2- 172.21.15.80:0/2504170027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc8c018730 0x7fbc8c01abc0 crc :-1 s=READY pgs=204 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:25.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.105+0000 7fbcaea47700 1 -- 172.21.15.80:0/2504170027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca8133e00 con 0x7fbca81068c0 2019-11-28T11:28:25.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.109+0000 7fbcacfe4700 1 --2- 172.21.15.80:0/2504170027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca81068c0 0x7fbca8137480 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7fbc90010410 tx=0x7fbc90010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.109+0000 7fbca57fa700 1 -- 172.21.15.80:0/2504170027 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbc9002a920 con 0x7fbca81068c0 2019-11-28T11:28:25.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.284+0000 7fbcaea47700 1 -- 172.21.15.80:0/2504170027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbca8134180 con 0x7fbca81068c0 2019-11-28T11:28:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.285+0000 7fbcacfe4700 1 --2- 172.21.15.80:0/2504170027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca81068c0 0x7fbca8137480 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7fbc90010410 tx=0x7fbc90010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.285+0000 7fbca57fa700 1 -- 172.21.15.80:0/2504170027 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+12000 (secure 0 0 0) 0x7fbc9002a920 con 0x7fbca81068c0 2019-11-28T11:28:25.312 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:25.312 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":42,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:28:24.583381+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:28:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.287+0000 7fbcaea47700 1 -- 172.21.15.80:0/2504170027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc8c018730 msgr2=0x7fbc8c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.287+0000 7fbcaea47700 1 --2- 172.21.15.80:0/2504170027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc8c018730 0x7fbc8c01abc0 crc :-1 s=READY pgs=204 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.287+0000 7fbcaea47700 1 -- 172.21.15.80:0/2504170027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca81068c0 msgr2=0x7fbca8137480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.287+0000 7fbcaea47700 1 --2- 172.21.15.80:0/2504170027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca81068c0 0x7fbca8137480 secure :-1 s=READY pgs=475 cs=0 l=1 rx=0x7fbc90010410 tx=0x7fbc90010290).stop 2019-11-28T11:28:25.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.287+0000 7fbcaea47700 1 -- 172.21.15.80:0/2504170027 shutdown_connections 2019-11-28T11:28:25.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.287+0000 7fbcaea47700 1 --2- 172.21.15.80:0/2504170027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc8c018730 0x7fbc8c01abc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:25.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.287+0000 7fbcaea47700 1 --2- 172.21.15.80:0/2504170027 >> v2:172.21.15.174:3300/0 conn(0x7fbca81379c0 0x7fbca8128210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:25.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.287+0000 7fbcaea47700 1 --2- 172.21.15.80:0/2504170027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbca81068c0 0x7fbca8137480 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:25.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.287+0000 7fbcaea47700 1 -- 172.21.15.80:0/2504170027 shutdown_connections 2019-11-28T11:28:25.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.287+0000 7fbcaea47700 1 -- 172.21.15.80:0/2504170027 wait complete. 2019-11-28T11:28:25.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.287+0000 7fbcaea47700 1 -- 172.21.15.80:0/2504170027 >> 172.21.15.80:0/2504170027 conn(0x7fbca813d930 msgr2=0x7fbca8102360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:25.334 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:28:25.334 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:28:25.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.435+0000 7f424eacf700 1 Processor -- start 2019-11-28T11:28:25.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.435+0000 7f424eacf700 1 -- start start 2019-11-28T11:28:25.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.436+0000 7f424eacf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f424815ed10 0x7f424815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:25.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.436+0000 7f424eacf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4248073020 0x7f4248071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:25.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.436+0000 7f424eacf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f424806db60 con 0x7f42480734b0 2019-11-28T11:28:25.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.436+0000 7f424eacf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424806f3d0 con 0x7f4248073020 2019-11-28T11:28:25.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.436+0000 7f424eacf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424806fe00 con 0x7f424815ed10 2019-11-28T11:28:25.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.436+0000 7f424c86b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4248073020 0x7f4248071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:25.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.436+0000 7f424d86d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f42480734b0 0x7f42480723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60716/0 (socket says 172.21.15.80:60716) 2019-11-28T11:28:25.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.436+0000 7f424d86d700 1 -- 172.21.15.80:0/2708644595 learned_addr learned my addr 172.21.15.80:0/2708644595 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:25.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.436+0000 7f424d06c700 1 --2- 172.21.15.80:0/2708644595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f424815ed10 0x7f424815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:25.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.437+0000 7f424c86b700 1 -- 172.21.15.80:0/2708644595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f424815ed10 msgr2=0x7f424815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:25.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.437+0000 7f424c86b700 1 --2- 172.21.15.80:0/2708644595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f424815ed10 0x7f424815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:25.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.437+0000 7f424c86b700 1 -- 172.21.15.80:0/2708644595 >> v1:172.21.15.80:6789/0 conn(0x7f42480734b0 legacy=0x7f42480723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.437+0000 7f4247fff700 1 -- 172.21.15.80:0/2708644595 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341259653 0 0) 0x7f4240001150 con 0x7f42480734b0 2019-11-28T11:28:25.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.437+0000 7f424c86b700 1 -- 172.21.15.80:0/2708644595 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4248070760 con 0x7f4248073020 2019-11-28T11:28:25.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.437+0000 7f424c86b700 1 --2- 172.21.15.80:0/2708644595 >> v2:172.21.15.80:3300/0 conn(0x7f4248073020 0x7f4248071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f423000b2d0 tx=0x7f423000ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.437+0000 7f424c86b700 1 --2- 172.21.15.80:0/2708644595 >> v2:172.21.15.80:3300/0 conn(0x7f4248073020 0x7f4248071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f423000b2d0 tx=0x7f423000ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.437+0000 7f424c86b700 1 --2- 172.21.15.80:0/2708644595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248073020 0x7f4248071ea0 secure :-1 s=READY pgs=477 cs=0 l=1 rx=0x7f423000b2d0 tx=0x7f423000ba60).ready entity=mon.0 client_cookie=6ae521cc2688dedc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:25.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.437+0000 7f424c86b700 1 --2- 172.21.15.80:0/2708644595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248073020 0x7f4248071ea0 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f423000b2d0 tx=0x7f423000ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.437+0000 7f4247fff700 1 -- 172.21.15.80:0/2708644595 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4230007590 con 0x7f4248073020 2019-11-28T11:28:25.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.437+0000 7f424c86b700 1 --2- 172.21.15.80:0/2708644595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248073020 0x7f4248071ea0 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f423000b2d0 tx=0x7f423000ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.437+0000 7f424c86b700 1 --2- 172.21.15.80:0/2708644595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248073020 0x7f4248071ea0 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f423000b2d0 tx=0x7f423000ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.437+0000 7f4247fff700 1 -- 172.21.15.80:0/2708644595 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4230009d30 con 0x7f4248073020 2019-11-28T11:28:25.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.437+0000 7f4247fff700 1 -- 172.21.15.80:0/2708644595 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423000a400 con 0x7f4248073020 2019-11-28T11:28:25.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.437+0000 7f424eacf700 1 -- 172.21.15.80:0/2708644595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248073020 msgr2=0x7f4248071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.437+0000 7f424eacf700 1 --2- 172.21.15.80:0/2708644595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248073020 0x7f4248071ea0 secure :-1 s=READY pgs=477 cs=0 l=1 rx=0x7f423000b2d0 tx=0x7f423000ba60).stop 2019-11-28T11:28:25.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.438+0000 7f424eacf700 1 -- 172.21.15.80:0/2708644595 shutdown_connections 2019-11-28T11:28:25.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.438+0000 7f424eacf700 1 --2- 172.21.15.80:0/2708644595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248073020 0x7f4248071ea0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:25.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.438+0000 7f424eacf700 1 --2- 172.21.15.80:0/2708644595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f424815ed10 0x7f424815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:25.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.438+0000 7f424eacf700 1 -- 172.21.15.80:0/2708644595 shutdown_connections 2019-11-28T11:28:25.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.438+0000 7f424eacf700 1 -- 172.21.15.80:0/2708644595 wait complete. 2019-11-28T11:28:25.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.438+0000 7f424eacf700 1 -- 172.21.15.80:0/2708644595 >> 172.21.15.80:0/2708644595 conn(0x7f4248061d20 msgr2=0x7f42480641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:25.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.440+0000 7f424eacf700 1 Processor -- start 2019-11-28T11:28:25.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.440+0000 7f424eacf700 1 -- start start 2019-11-28T11:28:25.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.441+0000 7f424eacf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42481079b0 0x7f4248107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:25.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.441+0000 7f424eacf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4248108380 0x7f4248168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:25.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.441+0000 7f424eacf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4248148e00 con 0x7f4248148320 2019-11-28T11:28:25.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.441+0000 7f424eacf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424813aa20 con 0x7f42481079b0 2019-11-28T11:28:25.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.441+0000 7f424eacf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424813acf0 con 0x7f4248108380 2019-11-28T11:28:25.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.441+0000 7f424c86b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42481079b0 0x7f4248107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:25.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.441+0000 7f424c86b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42481079b0 0x7f4248107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33176/0 (socket says 172.21.15.80:33176) 2019-11-28T11:28:25.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.441+0000 7f424c86b700 1 -- 172.21.15.80:0/1347702824 learned_addr learned my addr 172.21.15.80:0/1347702824 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:25.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.441+0000 7f424d86d700 1 --2- 172.21.15.80:0/1347702824 >> v2:172.21.15.174:3300/0 conn(0x7f4248108380 0x7f4248168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:25.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.441+0000 7f424c86b700 1 -- 172.21.15.80:0/1347702824 >> v2:172.21.15.174:3300/0 conn(0x7f4248108380 msgr2=0x7f4248168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.441+0000 7f424c86b700 1 --2- 172.21.15.80:0/1347702824 >> v2:172.21.15.174:3300/0 conn(0x7f4248108380 0x7f4248168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:25.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.441+0000 7f424c86b700 1 -- 172.21.15.80:0/1347702824 >> v1:172.21.15.174:6789/0 conn(0x7f4248148320 legacy=0x7f424810ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.441+0000 7f424c86b700 1 -- 172.21.15.80:0/1347702824 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424810c490 con 0x7f42481079b0 2019-11-28T11:28:25.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.441+0000 7f424c86b700 1 --2- 172.21.15.80:0/1347702824 >> v2:172.21.15.80:3300/0 conn(0x7f42481079b0 0x7f4248107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42300107a0 tx=0x7f4230010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.442+0000 7f424c86b700 1 --2- 172.21.15.80:0/1347702824 >> v2:172.21.15.80:3300/0 conn(0x7f42481079b0 0x7f4248107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42300107a0 tx=0x7f4230010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.442+0000 7f424c86b700 1 --2- 172.21.15.80:0/1347702824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42481079b0 0x7f4248107e40 secure :-1 s=READY pgs=478 cs=0 l=1 rx=0x7f42300107a0 tx=0x7f4230010620).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:25.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.442+0000 7f424c86b700 1 --2- 172.21.15.80:0/1347702824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42481079b0 0x7f4248107e40 secure :-1 s=THROTTLE_DONE pgs=478 cs=0 l=1 rx=0x7f42300107a0 tx=0x7f4230010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.442+0000 7f424c86b700 1 --2- 172.21.15.80:0/1347702824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42481079b0 0x7f4248107e40 secure :-1 s=THROTTLE_DONE pgs=478 cs=0 l=1 rx=0x7f42300107a0 tx=0x7f4230010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.442+0000 7f4245ffb700 1 -- 172.21.15.80:0/1347702824 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4230000cc0 con 0x7f42481079b0 2019-11-28T11:28:25.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.442+0000 7f424c86b700 1 --2- 172.21.15.80:0/1347702824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42481079b0 0x7f4248107e40 secure :-1 s=THROTTLE_DONE pgs=478 cs=0 l=1 rx=0x7f42300107a0 tx=0x7f4230010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.442+0000 7f4245ffb700 1 -- 172.21.15.80:0/1347702824 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4230009af0 con 0x7f42481079b0 2019-11-28T11:28:25.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.442+0000 7f424eacf700 1 -- 172.21.15.80:0/1347702824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f424810c810 con 0x7f42481079b0 2019-11-28T11:28:25.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.442+0000 7f4245ffb700 1 -- 172.21.15.80:0/1347702824 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423000a240 con 0x7f42481079b0 2019-11-28T11:28:25.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.442+0000 7f424eacf700 1 -- 172.21.15.80:0/1347702824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4248108820 con 0x7f42481079b0 2019-11-28T11:28:25.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.442+0000 7f424c86b700 1 --2- 172.21.15.80:0/1347702824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42481079b0 0x7f4248107e40 secure :-1 s=THROTTLE_DONE pgs=478 cs=0 l=1 rx=0x7f42300107a0 tx=0x7f4230010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.442+0000 7f4245ffb700 1 -- 172.21.15.80:0/1347702824 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4230009ce0 con 0x7f42481079b0 2019-11-28T11:28:25.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.442+0000 7f424c86b700 1 --2- 172.21.15.80:0/1347702824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42481079b0 0x7f4248107e40 secure :-1 s=THROTTLE_DONE pgs=478 cs=0 l=1 rx=0x7f42300107a0 tx=0x7f4230010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.443+0000 7f4245ffb700 1 --2- 172.21.15.80:0/1347702824 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f422c018730 0x7f422c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:25.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.443+0000 7f4245ffb700 1 -- 172.21.15.80:0/1347702824 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f4230031e00 con 0x7f42481079b0 2019-11-28T11:28:25.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.443+0000 7f424d06c700 1 --2- 172.21.15.80:0/1347702824 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f422c018730 0x7f422c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:25.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.443+0000 7f424d06c700 1 --2- 172.21.15.80:0/1347702824 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f422c018730 0x7f422c01abc0 crc :-1 s=READY pgs=205 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:25.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.450+0000 7f424eacf700 1 -- 172.21.15.80:0/1347702824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f424810c490 con 0x7f42481079b0 2019-11-28T11:28:25.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.454+0000 7f424c86b700 1 --2- 172.21.15.80:0/1347702824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42481079b0 0x7f4248107e40 secure :-1 s=THROTTLE_DONE pgs=478 cs=0 l=1 rx=0x7f42300107a0 tx=0x7f4230010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.454+0000 7f4245ffb700 1 -- 172.21.15.80:0/1347702824 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f423000b2f0 con 0x7f42481079b0 2019-11-28T11:28:25.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.623+0000 7f424eacf700 1 -- 172.21.15.80:0/1347702824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f424810c810 con 0x7f42481079b0 2019-11-28T11:28:25.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.624+0000 7f424c86b700 1 --2- 172.21.15.80:0/1347702824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42481079b0 0x7f4248107e40 secure :-1 s=THROTTLE_DONE pgs=478 cs=0 l=1 rx=0x7f42300107a0 tx=0x7f4230010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.624+0000 7f4245ffb700 1 -- 172.21.15.80:0/1347702824 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7f423002b930 con 0x7f42481079b0 2019-11-28T11:28:25.653 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:28:25.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.627+0000 7f424eacf700 1 -- 172.21.15.80:0/1347702824 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f422c018730 msgr2=0x7f422c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.627+0000 7f424eacf700 1 --2- 172.21.15.80:0/1347702824 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f422c018730 0x7f422c01abc0 crc :-1 s=READY pgs=205 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:25.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.627+0000 7f424eacf700 1 -- 172.21.15.80:0/1347702824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42481079b0 msgr2=0x7f4248107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.627+0000 7f424eacf700 1 --2- 172.21.15.80:0/1347702824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42481079b0 0x7f4248107e40 secure :-1 s=READY pgs=478 cs=0 l=1 rx=0x7f42300107a0 tx=0x7f4230010620).stop 2019-11-28T11:28:25.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.627+0000 7f424eacf700 1 -- 172.21.15.80:0/1347702824 shutdown_connections 2019-11-28T11:28:25.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.627+0000 7f424eacf700 1 --2- 172.21.15.80:0/1347702824 >> v2:172.21.15.174:3300/0 conn(0x7f4248108380 0x7f4248168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:25.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.627+0000 7f424eacf700 1 --2- 172.21.15.80:0/1347702824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42481079b0 0x7f4248107e40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:25.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.627+0000 7f424eacf700 1 --2- 172.21.15.80:0/1347702824 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f422c018730 0x7f422c01abc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:25.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.627+0000 7f424eacf700 1 -- 172.21.15.80:0/1347702824 shutdown_connections 2019-11-28T11:28:25.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.627+0000 7f424eacf700 1 -- 172.21.15.80:0/1347702824 wait complete. 2019-11-28T11:28:25.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.627+0000 7f424eacf700 1 -- 172.21.15.80:0/1347702824 >> 172.21.15.80:0/1347702824 conn(0x7f424815e2d0 msgr2=0x7f4248147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:25.665 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:28:25.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.758+0000 7efc012fb700 1 Processor -- start 2019-11-28T11:28:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.758+0000 7efc012fb700 1 -- start start 2019-11-28T11:28:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efc012fb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbfc06c0a0 0x7efbfc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efc012fb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efbfc072620 0x7efbfc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efc012fb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc06db00 con 0x7efbfc0734e0 2019-11-28T11:28:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efc012fb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbfc06f330 con 0x7efbfc072620 2019-11-28T11:28:25.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efc012fb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc0706c0 con 0x7efbfc06c0a0 2019-11-28T11:28:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efbfaffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efbfc0734e0 0x7efbfc071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60730/0 (socket says 172.21.15.80:60730) 2019-11-28T11:28:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efbfaffd700 1 -- 172.21.15.80:0/713952152 learned_addr learned my addr 172.21.15.80:0/713952152 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efbfa7fc700 1 -- 172.21.15.80:0/713952152 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716078511 0 0) 0x7efbec0014d0 con 0x7efbfc0734e0 2019-11-28T11:28:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efbfbfff700 1 --2- 172.21.15.80:0/713952152 >> v2:172.21.15.174:3300/0 conn(0x7efbfc072620 0x7efbfc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efbfb7fe700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbfc06c0a0 0x7efbfc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efbfa7fc700 1 -- 172.21.15.80:0/713952152 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbdc002e80 con 0x7efbfc0734e0 2019-11-28T11:28:25.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efbfa7fc700 1 -- 172.21.15.80:0/713952152 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2560780063 0 0) 0x7efbec0014b0 con 0x7efbfc0734e0 2019-11-28T11:28:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efbfa7fc700 1 -- 172.21.15.80:0/713952152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbfc06c0a0 msgr2=0x7efbfc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efbfa7fc700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbfc06c0a0 0x7efbfc072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efbfa7fc700 1 -- 172.21.15.80:0/713952152 >> v2:172.21.15.174:3300/0 conn(0x7efbfc072620 msgr2=0x7efbfc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efbfa7fc700 1 --2- 172.21.15.80:0/713952152 >> v2:172.21.15.174:3300/0 conn(0x7efbfc072620 0x7efbfc164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efbfa7fc700 1 -- 172.21.15.80:0/713952152 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc070a40 con 0x7efbfc0734e0 2019-11-28T11:28:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efbfa7fc700 1 -- 172.21.15.80:0/713952152 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7efbec001a40 con 0x7efbfc0734e0 2019-11-28T11:28:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.759+0000 7efbfa7fc700 1 -- 172.21.15.80:0/713952152 >> v1:172.21.15.80:6789/0 conn(0x7efbfc0734e0 legacy=0x7efbfc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfa7fc700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efbdc0479e0 0x7efbdc049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfa7fc700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbdc04a5c0 0x7efbdc04ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfa7fc700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc04d2f0 0x7efbdc04f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfa7fc700 1 -- 172.21.15.80:0/713952152 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbdc04ff40 con 0x7efbdc04a5c0 2019-11-28T11:28:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfa7fc700 1 -- 172.21.15.80:0/713952152 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbdc050130 con 0x7efbdc0479e0 2019-11-28T11:28:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfa7fc700 1 -- 172.21.15.80:0/713952152 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbdc050360 con 0x7efbdc04d2f0 2019-11-28T11:28:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfaffd700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbdc04a5c0 0x7efbdc04ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfb7fe700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efbdc0479e0 0x7efbdc049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfbfff700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc04d2f0 0x7efbdc04f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfaffd700 1 -- 172.21.15.80:0/713952152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc04d2f0 msgr2=0x7efbdc04f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfaffd700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc04d2f0 0x7efbdc04f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfaffd700 1 -- 172.21.15.80:0/713952152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efbdc0479e0 msgr2=0x7efbdc049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfaffd700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efbdc0479e0 0x7efbdc049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfaffd700 1 -- 172.21.15.80:0/713952152 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbdc050610 con 0x7efbdc04a5c0 2019-11-28T11:28:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfaffd700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbdc04a5c0 0x7efbdc04ca90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efbec00fbe0 tx=0x7efbec0021e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfaffd700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbdc04a5c0 0x7efbdc04ca90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efbec00fbe0 tx=0x7efbec0021e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfaffd700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbdc04a5c0 0x7efbdc04ca90 secure :-1 s=READY pgs=480 cs=0 l=1 rx=0x7efbec00fbe0 tx=0x7efbec0021e0).ready entity=mon.0 client_cookie=d14144a6e302b468 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfaffd700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbdc04a5c0 0x7efbdc04ca90 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7efbec00fbe0 tx=0x7efbec0021e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfa7fc700 1 -- 172.21.15.80:0/713952152 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbec001010 con 0x7efbdc04a5c0 2019-11-28T11:28:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfaffd700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbdc04a5c0 0x7efbdc04ca90 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7efbec00fbe0 tx=0x7efbec0021e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfaffd700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbdc04a5c0 0x7efbdc04ca90 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7efbec00fbe0 tx=0x7efbec0021e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfa7fc700 1 -- 172.21.15.80:0/713952152 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec0045c0 con 0x7efbdc04a5c0 2019-11-28T11:28:25.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfa7fc700 1 -- 172.21.15.80:0/713952152 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbec001010 con 0x7efbdc04a5c0 2019-11-28T11:28:25.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efc012fb700 1 -- 172.21.15.80:0/713952152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbdc04a5c0 msgr2=0x7efbdc04ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efc012fb700 1 --2- 172.21.15.80:0/713952152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbdc04a5c0 0x7efbdc04ca90 secure :-1 s=READY pgs=480 cs=0 l=1 rx=0x7efbec00fbe0 tx=0x7efbec0021e0).stop 2019-11-28T11:28:25.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.760+0000 7efbfbfff700 1 -- 172.21.15.80:0/713952152 reap_dead start 2019-11-28T11:28:25.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.761+0000 7efc012fb700 1 -- 172.21.15.80:0/713952152 shutdown_connections 2019-11-28T11:28:25.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.761+0000 7efc012fb700 1 -- 172.21.15.80:0/713952152 shutdown_connections 2019-11-28T11:28:25.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.761+0000 7efc012fb700 1 -- 172.21.15.80:0/713952152 wait complete. 2019-11-28T11:28:25.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.761+0000 7efc012fb700 1 -- 172.21.15.80:0/713952152 >> 172.21.15.80:0/713952152 conn(0x7efbfc061cf0 msgr2=0x7efbfc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:25.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.763+0000 7efc012fb700 1 Processor -- start 2019-11-28T11:28:25.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.764+0000 7efc012fb700 1 -- start start 2019-11-28T11:28:25.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.764+0000 7efc012fb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efbfc106930 0x7efbfc13a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:25.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.764+0000 7efc012fb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc137060 con 0x7efbfc139e20 2019-11-28T11:28:25.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.764+0000 7efc012fb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc116530 con 0x7efbfc13aa40 2019-11-28T11:28:25.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.764+0000 7efc012fb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbfc114e70 con 0x7efbfc106930 2019-11-28T11:28:25.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.764+0000 7efbfb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efbfc106930 0x7efbfc13a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:25.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.764+0000 7efbfbfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efbfc139e20 0x7efbfc168eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60746/0 (socket says 172.21.15.80:60746) 2019-11-28T11:28:25.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.764+0000 7efbfbfff700 1 -- 172.21.15.80:0/3290243009 learned_addr learned my addr 172.21.15.80:0/3290243009 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:25.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.765+0000 7efbfb7fe700 1 -- 172.21.15.80:0/3290243009 >> v1:172.21.15.174:6789/0 conn(0x7efbfc13aa40 legacy=0x7efbfc139620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.765+0000 7efbfb7fe700 1 -- 172.21.15.80:0/3290243009 >> v1:172.21.15.80:6789/0 conn(0x7efbfc139e20 legacy=0x7efbfc168eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.765+0000 7efbf3fff700 1 -- 172.21.15.80:0/3290243009 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721678026 0 0) 0x7efbf4001290 con 0x7efbfc139e20 2019-11-28T11:28:25.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.765+0000 7efbfb7fe700 1 -- 172.21.15.80:0/3290243009 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc115500 con 0x7efbfc106930 2019-11-28T11:28:25.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.765+0000 7efbfb7fe700 1 --2- 172.21.15.80:0/3290243009 >> v2:172.21.15.80:3300/0 conn(0x7efbfc106930 0x7efbfc13a500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efbe4010390 tx=0x7efbe4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.765+0000 7efbfb7fe700 1 --2- 172.21.15.80:0/3290243009 >> v2:172.21.15.80:3300/0 conn(0x7efbfc106930 0x7efbfc13a500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efbe4010390 tx=0x7efbe4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.765+0000 7efbfb7fe700 1 --2- 172.21.15.80:0/3290243009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbfc106930 0x7efbfc13a500 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7efbe4010390 tx=0x7efbe4010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:25.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.765+0000 7efbfb7fe700 1 --2- 172.21.15.80:0/3290243009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbfc106930 0x7efbfc13a500 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7efbe4010390 tx=0x7efbe4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.765+0000 7efbf3fff700 1 -- 172.21.15.80:0/3290243009 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbe4000960 con 0x7efbfc106930 2019-11-28T11:28:25.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.765+0000 7efbfb7fe700 1 --2- 172.21.15.80:0/3290243009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbfc106930 0x7efbfc13a500 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7efbe4010390 tx=0x7efbe4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.765+0000 7efbfb7fe700 1 --2- 172.21.15.80:0/3290243009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbfc106930 0x7efbfc13a500 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7efbe4010390 tx=0x7efbe4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.765+0000 7efbf3fff700 1 -- 172.21.15.80:0/3290243009 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe4001090 con 0x7efbfc106930 2019-11-28T11:28:25.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.765+0000 7efc012fb700 1 -- 172.21.15.80:0/3290243009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbfc115880 con 0x7efbfc106930 2019-11-28T11:28:25.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.765+0000 7efbf3fff700 1 -- 172.21.15.80:0/3290243009 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbe40017e0 con 0x7efbfc106930 2019-11-28T11:28:25.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.765+0000 7efc012fb700 1 -- 172.21.15.80:0/3290243009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbfc1147b0 con 0x7efbfc106930 2019-11-28T11:28:25.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.765+0000 7efbfb7fe700 1 --2- 172.21.15.80:0/3290243009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbfc106930 0x7efbfc13a500 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7efbe4010390 tx=0x7efbe4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.766+0000 7efbf3fff700 1 -- 172.21.15.80:0/3290243009 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efbe4001280 con 0x7efbfc106930 2019-11-28T11:28:25.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.766+0000 7efbfb7fe700 1 --2- 172.21.15.80:0/3290243009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbfc106930 0x7efbfc13a500 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7efbe4010390 tx=0x7efbe4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.766+0000 7efbf3fff700 1 --2- 172.21.15.80:0/3290243009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbd4018730 0x7efbd401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:25.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.766+0000 7efbf3fff700 1 -- 172.21.15.80:0/3290243009 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5200+0+0 (secure 0 0 0) 0x7efbe4031ae0 con 0x7efbfc106930 2019-11-28T11:28:25.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.766+0000 7efbfaffd700 1 --2- 172.21.15.80:0/3290243009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbd4018730 0x7efbd401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:25.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.766+0000 7efbfaffd700 1 --2- 172.21.15.80:0/3290243009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbd4018730 0x7efbd401abc0 crc :-1 s=READY pgs=206 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.773+0000 7efc012fb700 1 -- 172.21.15.80:0/3290243009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbfc115500 con 0x7efbfc106930 2019-11-28T11:28:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.777+0000 7efbfb7fe700 1 --2- 172.21.15.80:0/3290243009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbfc106930 0x7efbfc13a500 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7efbe4010390 tx=0x7efbe4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.777+0000 7efbf3fff700 1 -- 172.21.15.80:0/3290243009 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efbe4000c90 con 0x7efbfc106930 2019-11-28T11:28:25.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.942+0000 7efc012fb700 1 -- 172.21.15.80:0/3290243009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efbfc115880 con 0x7efbfc106930 2019-11-28T11:28:25.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.942+0000 7efbfb7fe700 1 --2- 172.21.15.80:0/3290243009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbfc106930 0x7efbfc13a500 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7efbe4010390 tx=0x7efbe4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:25.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.942+0000 7efbf3fff700 1 -- 172.21.15.80:0/3290243009 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v42) v1 ==== 84+0+64 (secure 0 0 0) 0x7efbe4001280 con 0x7efbfc106930 2019-11-28T11:28:25.969 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:25.970 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:28:25.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:25.970 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:28:25.970 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:28:25.970 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:25.970 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:28:25.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.945+0000 7efc012fb700 1 -- 172.21.15.80:0/3290243009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbd4018730 msgr2=0x7efbd401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.945+0000 7efc012fb700 1 --2- 172.21.15.80:0/3290243009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbd4018730 0x7efbd401abc0 crc :-1 s=READY pgs=206 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:25.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.945+0000 7efc012fb700 1 -- 172.21.15.80:0/3290243009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbfc106930 msgr2=0x7efbfc13a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:25.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.945+0000 7efc012fb700 1 --2- 172.21.15.80:0/3290243009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbfc106930 0x7efbfc13a500 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7efbe4010390 tx=0x7efbe4010730).stop 2019-11-28T11:28:25.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.945+0000 7efc012fb700 1 -- 172.21.15.80:0/3290243009 shutdown_connections 2019-11-28T11:28:25.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.945+0000 7efc012fb700 1 --2- 172.21.15.80:0/3290243009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbd4018730 0x7efbd401abc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:25.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.945+0000 7efc012fb700 1 --2- 172.21.15.80:0/3290243009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbfc106930 0x7efbfc13a500 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:25.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.945+0000 7efc012fb700 1 -- 172.21.15.80:0/3290243009 shutdown_connections 2019-11-28T11:28:25.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.945+0000 7efc012fb700 1 -- 172.21.15.80:0/3290243009 wait complete. 2019-11-28T11:28:25.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:25.945+0000 7efc012fb700 1 -- 172.21.15.80:0/3290243009 >> 172.21.15.80:0/3290243009 conn(0x7efbfc141d10 msgr2=0x7efbfc13ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:25.985 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:28:25.985 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:28:26.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.083+0000 7fe7bda05700 1 Processor -- start 2019-11-28T11:28:26.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.083+0000 7fe7bda05700 1 -- start start 2019-11-28T11:28:26.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.084+0000 7fe7bda05700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe7b815ed10 0x7fe7b815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:26.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.084+0000 7fe7bda05700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b806db60 con 0x7fe7b80734b0 2019-11-28T11:28:26.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.084+0000 7fe7bda05700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b806e060 con 0x7fe7b8073020 2019-11-28T11:28:26.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.084+0000 7fe7bda05700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b806fe00 con 0x7fe7b815ed10 2019-11-28T11:28:26.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.084+0000 7fe7b7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe7b80734b0 0x7fe7b80726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60752/0 (socket says 172.21.15.80:60752) 2019-11-28T11:28:26.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.084+0000 7fe7b7fff700 1 -- 172.21.15.80:0/942071847 learned_addr learned my addr 172.21.15.80:0/942071847 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:26.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.084+0000 7fe7b77fe700 1 --2- 172.21.15.80:0/942071847 >> v2:172.21.15.174:3300/0 conn(0x7fe7b815ed10 0x7fe7b815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:26.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.084+0000 7fe7b67fc700 1 -- 172.21.15.80:0/942071847 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374091830 0 0) 0x7fe7b00014d0 con 0x7fe7b80734b0 2019-11-28T11:28:26.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 -- 172.21.15.80:0/942071847 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7a4002e80 con 0x7fe7b80734b0 2019-11-28T11:28:26.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 -- 172.21.15.80:0/942071847 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4056225551 0 0) 0x7fe7b00014b0 con 0x7fe7b80734b0 2019-11-28T11:28:26.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 -- 172.21.15.80:0/942071847 >> v2:172.21.15.174:3300/0 conn(0x7fe7b815ed10 msgr2=0x7fe7b815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:26.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 --2- 172.21.15.80:0/942071847 >> v2:172.21.15.174:3300/0 conn(0x7fe7b815ed10 0x7fe7b815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:26.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 -- 172.21.15.80:0/942071847 >> v1:172.21.15.174:6789/0 conn(0x7fe7b8073020 legacy=0x7fe7b8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:26.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 -- 172.21.15.80:0/942071847 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b8070760 con 0x7fe7b80734b0 2019-11-28T11:28:26.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 -- 172.21.15.80:0/942071847 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fe7b00019e0 con 0x7fe7b80734b0 2019-11-28T11:28:26.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 -- 172.21.15.80:0/942071847 >> v1:172.21.15.80:6789/0 conn(0x7fe7b80734b0 legacy=0x7fe7b80726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:26.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 --2- 172.21.15.80:0/942071847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7a4003ab0 0x7fe7a4005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:26.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 --2- 172.21.15.80:0/942071847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7a4006690 0x7fe7a4008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:26.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 --2- 172.21.15.80:0/942071847 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7a4009380 0x7fe7a400b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:26.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 -- 172.21.15.80:0/942071847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a400c000 con 0x7fe7a4006690 2019-11-28T11:28:26.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 -- 172.21.15.80:0/942071847 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a4050200 con 0x7fe7a4003ab0 2019-11-28T11:28:26.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 -- 172.21.15.80:0/942071847 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a4050430 con 0x7fe7a4009380 2019-11-28T11:28:26.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b6ffd700 1 --2- 172.21.15.80:0/942071847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7a4006690 0x7fe7a4008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:26.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b77fe700 1 --2- 172.21.15.80:0/942071847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7a4003ab0 0x7fe7a4005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:26.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b7fff700 1 --2- 172.21.15.80:0/942071847 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7a4009380 0x7fe7a400b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:26.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b6ffd700 1 -- 172.21.15.80:0/942071847 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7a4009380 msgr2=0x7fe7a400b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:26.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b6ffd700 1 --2- 172.21.15.80:0/942071847 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7a4009380 0x7fe7a400b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:26.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b6ffd700 1 -- 172.21.15.80:0/942071847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7a4003ab0 msgr2=0x7fe7a4005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:26.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b6ffd700 1 --2- 172.21.15.80:0/942071847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7a4003ab0 0x7fe7a4005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:26.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b6ffd700 1 -- 172.21.15.80:0/942071847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a40506e0 con 0x7fe7a4006690 2019-11-28T11:28:26.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b7fff700 1 -- 172.21.15.80:0/942071847 reap_dead start 2019-11-28T11:28:26.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b6ffd700 1 --2- 172.21.15.80:0/942071847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7a4006690 0x7fe7a4008b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe7a800af50 tx=0x7fe7a800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b6ffd700 1 --2- 172.21.15.80:0/942071847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7a4006690 0x7fe7a4008b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe7a800af50 tx=0x7fe7a800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b6ffd700 1 --2- 172.21.15.80:0/942071847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7a4006690 0x7fe7a4008b20 secure :-1 s=READY pgs=484 cs=0 l=1 rx=0x7fe7a800af50 tx=0x7fe7a800b250).ready entity=mon.0 client_cookie=c9e10b9083fba8d6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:26.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b6ffd700 1 --2- 172.21.15.80:0/942071847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7a4006690 0x7fe7a4008b20 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7fe7a800af50 tx=0x7fe7a800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 -- 172.21.15.80:0/942071847 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7a8000960 con 0x7fe7a4006690 2019-11-28T11:28:26.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b6ffd700 1 --2- 172.21.15.80:0/942071847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7a4006690 0x7fe7a4008b20 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7fe7a800af50 tx=0x7fe7a800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b6ffd700 1 --2- 172.21.15.80:0/942071847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7a4006690 0x7fe7a4008b20 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7fe7a800af50 tx=0x7fe7a800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 -- 172.21.15.80:0/942071847 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a8009980 con 0x7fe7a4006690 2019-11-28T11:28:26.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7b67fc700 1 -- 172.21.15.80:0/942071847 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7a8009b70 con 0x7fe7a4006690 2019-11-28T11:28:26.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7bda05700 1 -- 172.21.15.80:0/942071847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7a4006690 msgr2=0x7fe7a4008b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:26.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.085+0000 7fe7bda05700 1 --2- 172.21.15.80:0/942071847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7a4006690 0x7fe7a4008b20 secure :-1 s=READY pgs=484 cs=0 l=1 rx=0x7fe7a800af50 tx=0x7fe7a800b250).stop 2019-11-28T11:28:26.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.086+0000 7fe7bda05700 1 -- 172.21.15.80:0/942071847 shutdown_connections 2019-11-28T11:28:26.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.086+0000 7fe7bda05700 1 --2- 172.21.15.80:0/942071847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7a4006690 0x7fe7a4008b20 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:26.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.086+0000 7fe7bda05700 1 -- 172.21.15.80:0/942071847 shutdown_connections 2019-11-28T11:28:26.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.086+0000 7fe7bda05700 1 -- 172.21.15.80:0/942071847 wait complete. 2019-11-28T11:28:26.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.086+0000 7fe7bda05700 1 -- 172.21.15.80:0/942071847 >> 172.21.15.80:0/942071847 conn(0x7fe7b8061d20 msgr2=0x7fe7b80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:26.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.089+0000 7fe7bda05700 1 Processor -- start 2019-11-28T11:28:26.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.089+0000 7fe7bda05700 1 -- start start 2019-11-28T11:28:26.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7bda05700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe7b8108920 0x7fe7b8132610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:26.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7bda05700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe7b814b8e0 0x7fe7b816ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:26.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7bda05700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b815ddb0 con 0x7fe7b8132b50 2019-11-28T11:28:26.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7bda05700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b811ec40 con 0x7fe7b8108920 2019-11-28T11:28:26.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7bda05700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b81197e0 con 0x7fe7b814b8e0 2019-11-28T11:28:26.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7b77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe7b8108920 0x7fe7b8132610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:26.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7b77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe7b8108920 0x7fe7b8132610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33214/0 (socket says 172.21.15.80:33214) 2019-11-28T11:28:26.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7b77fe700 1 -- 172.21.15.80:0/1418275215 learned_addr learned my addr 172.21.15.80:0/1418275215 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:26.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7b7fff700 1 --2- 172.21.15.80:0/1418275215 >> v2:172.21.15.174:3300/0 conn(0x7fe7b814b8e0 0x7fe7b816ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:26.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7b77fe700 1 -- 172.21.15.80:0/1418275215 >> v2:172.21.15.174:3300/0 conn(0x7fe7b814b8e0 msgr2=0x7fe7b816ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:26.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7b77fe700 1 --2- 172.21.15.80:0/1418275215 >> v2:172.21.15.174:3300/0 conn(0x7fe7b814b8e0 0x7fe7b816ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:26.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7b77fe700 1 -- 172.21.15.80:0/1418275215 >> v1:172.21.15.174:6789/0 conn(0x7fe7b8132b50 legacy=0x7fe7b814b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:26.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7b77fe700 1 -- 172.21.15.80:0/1418275215 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b81300d0 con 0x7fe7b8108920 2019-11-28T11:28:26.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7b77fe700 1 --2- 172.21.15.80:0/1418275215 >> v2:172.21.15.80:3300/0 conn(0x7fe7b8108920 0x7fe7b8132610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe7a0010440 tx=0x7fe7a0010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7b77fe700 1 --2- 172.21.15.80:0/1418275215 >> v2:172.21.15.80:3300/0 conn(0x7fe7b8108920 0x7fe7b8132610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe7a0010440 tx=0x7fe7a0010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7b77fe700 1 --2- 172.21.15.80:0/1418275215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7b8108920 0x7fe7b8132610 secure :-1 s=READY pgs=485 cs=0 l=1 rx=0x7fe7a0010440 tx=0x7fe7a0010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:26.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7b77fe700 1 --2- 172.21.15.80:0/1418275215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7b8108920 0x7fe7b8132610 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7fe7a0010440 tx=0x7fe7a0010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7b77fe700 1 --2- 172.21.15.80:0/1418275215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7b8108920 0x7fe7b8132610 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7fe7a0010440 tx=0x7fe7a0010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7affff700 1 -- 172.21.15.80:0/1418275215 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7a0005770 con 0x7fe7b8108920 2019-11-28T11:28:26.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7b77fe700 1 --2- 172.21.15.80:0/1418275215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7b8108920 0x7fe7b8132610 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7fe7a0010440 tx=0x7fe7a0010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7affff700 1 -- 172.21.15.80:0/1418275215 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a0005390 con 0x7fe7b8108920 2019-11-28T11:28:26.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7bda05700 1 -- 172.21.15.80:0/1418275215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b811e510 con 0x7fe7b8108920 2019-11-28T11:28:26.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7affff700 1 -- 172.21.15.80:0/1418275215 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7a0005d50 con 0x7fe7b8108920 2019-11-28T11:28:26.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.090+0000 7fe7bda05700 1 -- 172.21.15.80:0/1418275215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b81300d0 con 0x7fe7b8108920 2019-11-28T11:28:26.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.091+0000 7fe7b77fe700 1 --2- 172.21.15.80:0/1418275215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7b8108920 0x7fe7b8132610 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7fe7a0010440 tx=0x7fe7a0010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.091+0000 7fe7affff700 1 -- 172.21.15.80:0/1418275215 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe7a0005580 con 0x7fe7b8108920 2019-11-28T11:28:26.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.091+0000 7fe7b77fe700 1 --2- 172.21.15.80:0/1418275215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7b8108920 0x7fe7b8132610 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7fe7a0010440 tx=0x7fe7a0010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.091+0000 7fe7affff700 1 --2- 172.21.15.80:0/1418275215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe79c018730 0x7fe79c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:26.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.091+0000 7fe7affff700 1 -- 172.21.15.80:0/1418275215 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fe7a0031cd0 con 0x7fe7b8108920 2019-11-28T11:28:26.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.091+0000 7fe7b6ffd700 1 --2- 172.21.15.80:0/1418275215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe79c018730 0x7fe79c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:26.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.091+0000 7fe7b6ffd700 1 --2- 172.21.15.80:0/1418275215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe79c018730 0x7fe79c01abc0 crc :-1 s=READY pgs=207 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:26.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.098+0000 7fe7bda05700 1 -- 172.21.15.80:0/1418275215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b811e510 con 0x7fe7b8108920 2019-11-28T11:28:26.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.102+0000 7fe7b77fe700 1 --2- 172.21.15.80:0/1418275215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7b8108920 0x7fe7b8132610 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7fe7a0010440 tx=0x7fe7a0010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.102+0000 7fe7affff700 1 -- 172.21.15.80:0/1418275215 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe7a0005180 con 0x7fe7b8108920 2019-11-28T11:28:26.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.271+0000 7fe7bda05700 1 -- 172.21.15.80:0/1418275215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7fe7b81300d0 con 0x7fe7b8108920 2019-11-28T11:28:26.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.592+0000 7fe7b77fe700 1 --2- 172.21.15.80:0/1418275215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7b8108920 0x7fe7b8132610 secure :-1 s=THROTTLE_DONE pgs=485 cs=0 l=1 rx=0x7fe7a0010440 tx=0x7fe7a0010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.592+0000 7fe7affff700 1 -- 172.21.15.80:0/1418275215 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v43) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe7a0005390 con 0x7fe7b8108920 2019-11-28T11:28:26.668 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:28:26.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.637+0000 7fe7bda05700 1 -- 172.21.15.80:0/1418275215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe79c018730 msgr2=0x7fe79c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:26.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.637+0000 7fe7bda05700 1 --2- 172.21.15.80:0/1418275215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe79c018730 0x7fe79c01abc0 crc :-1 s=READY pgs=207 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:26.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.637+0000 7fe7bda05700 1 -- 172.21.15.80:0/1418275215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7b8108920 msgr2=0x7fe7b8132610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:26.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.637+0000 7fe7bda05700 1 --2- 172.21.15.80:0/1418275215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7b8108920 0x7fe7b8132610 secure :-1 s=READY pgs=485 cs=0 l=1 rx=0x7fe7a0010440 tx=0x7fe7a0010270).stop 2019-11-28T11:28:26.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.637+0000 7fe7bda05700 1 -- 172.21.15.80:0/1418275215 shutdown_connections 2019-11-28T11:28:26.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.637+0000 7fe7bda05700 1 --2- 172.21.15.80:0/1418275215 >> v2:172.21.15.174:3300/0 conn(0x7fe7b814b8e0 0x7fe7b816ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:26.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.637+0000 7fe7bda05700 1 --2- 172.21.15.80:0/1418275215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe79c018730 0x7fe79c01abc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:26.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.637+0000 7fe7bda05700 1 --2- 172.21.15.80:0/1418275215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7b8108920 0x7fe7b8132610 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:26.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.637+0000 7fe7bda05700 1 -- 172.21.15.80:0/1418275215 shutdown_connections 2019-11-28T11:28:26.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.637+0000 7fe7bda05700 1 -- 172.21.15.80:0/1418275215 wait complete. 2019-11-28T11:28:26.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.637+0000 7fe7bda05700 1 -- 172.21.15.80:0/1418275215 >> 172.21.15.80:0/1418275215 conn(0x7fe7b814dbb0 msgr2=0x7fe7b8142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:26.677 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:28:26.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.779+0000 7fdf40833700 1 Processor -- start 2019-11-28T11:28:26.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.779+0000 7fdf40833700 1 -- start start 2019-11-28T11:28:26.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf40833700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdf3c15ed10 0x7fdf3c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:26.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf40833700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdf3c073020 0x7fdf3c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:26.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf40833700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf3c06db60 con 0x7fdf3c0734b0 2019-11-28T11:28:26.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf40833700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3c06fe00 con 0x7fdf3c073020 2019-11-28T11:28:26.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf40833700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3c0700d0 con 0x7fdf3c15ed10 2019-11-28T11:28:26.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf3a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdf3c073020 0x7fdf3c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:26.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf3b59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdf3c0734b0 0x7fdf3c0723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60770/0 (socket says 172.21.15.80:60770) 2019-11-28T11:28:26.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf3a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdf3c073020 0x7fdf3c071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33222/0 (socket says 172.21.15.80:33222) 2019-11-28T11:28:26.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf3b59e700 1 -- 172.21.15.80:0/3111254312 learned_addr learned my addr 172.21.15.80:0/3111254312 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:26.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf3ad9d700 1 --2- 172.21.15.80:0/3111254312 >> v2:172.21.15.174:3300/0 conn(0x7fdf3c15ed10 0x7fdf3c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:26.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf3a59c700 1 -- 172.21.15.80:0/3111254312 >> v2:172.21.15.174:3300/0 conn(0x7fdf3c15ed10 msgr2=0x7fdf3c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:26.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/3111254312 >> v2:172.21.15.174:3300/0 conn(0x7fdf3c15ed10 0x7fdf3c15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:26.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf3a59c700 1 -- 172.21.15.80:0/3111254312 >> v1:172.21.15.80:6789/0 conn(0x7fdf3c0734b0 legacy=0x7fdf3c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:26.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf3a59c700 1 -- 172.21.15.80:0/3111254312 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c070760 con 0x7fdf3c073020 2019-11-28T11:28:26.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf39d9b700 1 -- 172.21.15.80:0/3111254312 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028636167 0 0) 0x7fdf340014d0 con 0x7fdf3c0734b0 2019-11-28T11:28:26.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/3111254312 >> v2:172.21.15.80:3300/0 conn(0x7fdf3c073020 0x7fdf3c071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdf2400af50 tx=0x7fdf2400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/3111254312 >> v2:172.21.15.80:3300/0 conn(0x7fdf3c073020 0x7fdf3c071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdf2400af50 tx=0x7fdf2400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.780+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/3111254312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c073020 0x7fdf3c071ea0 secure :-1 s=READY pgs=487 cs=0 l=1 rx=0x7fdf2400af50 tx=0x7fdf2400b250).ready entity=mon.0 client_cookie=d0f63c5a68136a3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:26.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.781+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/3111254312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c073020 0x7fdf3c071ea0 secure :-1 s=THROTTLE_DONE pgs=487 cs=0 l=1 rx=0x7fdf2400af50 tx=0x7fdf2400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.781+0000 7fdf39d9b700 1 -- 172.21.15.80:0/3111254312 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf24007210 con 0x7fdf3c073020 2019-11-28T11:28:26.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.781+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/3111254312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c073020 0x7fdf3c071ea0 secure :-1 s=THROTTLE_DONE pgs=487 cs=0 l=1 rx=0x7fdf2400af50 tx=0x7fdf2400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.781+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/3111254312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c073020 0x7fdf3c071ea0 secure :-1 s=THROTTLE_DONE pgs=487 cs=0 l=1 rx=0x7fdf2400af50 tx=0x7fdf2400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.781+0000 7fdf39d9b700 1 -- 172.21.15.80:0/3111254312 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf240099b0 con 0x7fdf3c073020 2019-11-28T11:28:26.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.781+0000 7fdf39d9b700 1 -- 172.21.15.80:0/3111254312 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf24007210 con 0x7fdf3c073020 2019-11-28T11:28:26.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.781+0000 7fdf40833700 1 -- 172.21.15.80:0/3111254312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c073020 msgr2=0x7fdf3c071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:26.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.781+0000 7fdf40833700 1 --2- 172.21.15.80:0/3111254312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c073020 0x7fdf3c071ea0 secure :-1 s=READY pgs=487 cs=0 l=1 rx=0x7fdf2400af50 tx=0x7fdf2400b250).stop 2019-11-28T11:28:26.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.781+0000 7fdf40833700 1 -- 172.21.15.80:0/3111254312 shutdown_connections 2019-11-28T11:28:26.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.781+0000 7fdf40833700 1 --2- 172.21.15.80:0/3111254312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c073020 0x7fdf3c071ea0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:26.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.781+0000 7fdf40833700 1 --2- 172.21.15.80:0/3111254312 >> v2:172.21.15.174:3300/0 conn(0x7fdf3c15ed10 0x7fdf3c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:26.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.781+0000 7fdf40833700 1 -- 172.21.15.80:0/3111254312 shutdown_connections 2019-11-28T11:28:26.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.781+0000 7fdf40833700 1 -- 172.21.15.80:0/3111254312 wait complete. 2019-11-28T11:28:26.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.781+0000 7fdf40833700 1 -- 172.21.15.80:0/3111254312 >> 172.21.15.80:0/3111254312 conn(0x7fdf3c061d20 msgr2=0x7fdf3c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:26.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.784+0000 7fdf40833700 1 Processor -- start 2019-11-28T11:28:26.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.784+0000 7fdf40833700 1 -- start start 2019-11-28T11:28:26.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf40833700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdf3c1079b0 0x7fdf3c107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:26.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf40833700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdf3c108380 0x7fdf3c168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:26.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf40833700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf3c148e00 con 0x7fdf3c148320 2019-11-28T11:28:26.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf40833700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3c13aa20 con 0x7fdf3c1079b0 2019-11-28T11:28:26.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf40833700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3c13acf0 con 0x7fdf3c108380 2019-11-28T11:28:26.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf3a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdf3c1079b0 0x7fdf3c107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:26.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf3ad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdf3c148320 0x7fdf3c10ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60774/0 (socket says 172.21.15.80:60774) 2019-11-28T11:28:26.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf3ad9d700 1 -- 172.21.15.80:0/1106741359 learned_addr learned my addr 172.21.15.80:0/1106741359 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:26.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf3b59e700 1 --2- 172.21.15.80:0/1106741359 >> v2:172.21.15.174:3300/0 conn(0x7fdf3c108380 0x7fdf3c168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:26.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf3a59c700 1 -- 172.21.15.80:0/1106741359 >> v2:172.21.15.174:3300/0 conn(0x7fdf3c108380 msgr2=0x7fdf3c168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:26.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/1106741359 >> v2:172.21.15.174:3300/0 conn(0x7fdf3c108380 0x7fdf3c168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:26.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf337fe700 1 -- 172.21.15.80:0/1106741359 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718295708 0 0) 0x7fdf2c0010b0 con 0x7fdf3c148320 2019-11-28T11:28:26.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf3a59c700 1 -- 172.21.15.80:0/1106741359 >> v1:172.21.15.80:6789/0 conn(0x7fdf3c148320 legacy=0x7fdf3c10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:26.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf3a59c700 1 -- 172.21.15.80:0/1106741359 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c10c490 con 0x7fdf3c1079b0 2019-11-28T11:28:26.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/1106741359 >> v2:172.21.15.80:3300/0 conn(0x7fdf3c1079b0 0x7fdf3c107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf240103b0 tx=0x7fdf240101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/1106741359 >> v2:172.21.15.80:3300/0 conn(0x7fdf3c1079b0 0x7fdf3c107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf240103b0 tx=0x7fdf240101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/1106741359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c1079b0 0x7fdf3c107e40 secure :-1 s=READY pgs=489 cs=0 l=1 rx=0x7fdf240103b0 tx=0x7fdf240101b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:26.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/1106741359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c1079b0 0x7fdf3c107e40 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7fdf240103b0 tx=0x7fdf240101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf337fe700 1 -- 172.21.15.80:0/1106741359 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf24000940 con 0x7fdf3c1079b0 2019-11-28T11:28:26.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/1106741359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c1079b0 0x7fdf3c107e40 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7fdf240103b0 tx=0x7fdf240101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf40833700 1 -- 172.21.15.80:0/1106741359 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3c10c810 con 0x7fdf3c1079b0 2019-11-28T11:28:26.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf337fe700 1 -- 172.21.15.80:0/1106741359 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf24000940 con 0x7fdf3c1079b0 2019-11-28T11:28:26.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/1106741359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c1079b0 0x7fdf3c107e40 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7fdf240103b0 tx=0x7fdf240101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf337fe700 1 -- 172.21.15.80:0/1106741359 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf24009b70 con 0x7fdf3c1079b0 2019-11-28T11:28:26.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.785+0000 7fdf40833700 1 -- 172.21.15.80:0/1106741359 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3c108820 con 0x7fdf3c1079b0 2019-11-28T11:28:26.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.786+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/1106741359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c1079b0 0x7fdf3c107e40 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7fdf240103b0 tx=0x7fdf240101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.786+0000 7fdf337fe700 1 -- 172.21.15.80:0/1106741359 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fdf24009580 con 0x7fdf3c1079b0 2019-11-28T11:28:26.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.786+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/1106741359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c1079b0 0x7fdf3c107e40 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7fdf240103b0 tx=0x7fdf240101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.786+0000 7fdf337fe700 1 --2- 172.21.15.80:0/1106741359 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdf20018730 0x7fdf2001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:26.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.786+0000 7fdf337fe700 1 -- 172.21.15.80:0/1106741359 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fdf24031a40 con 0x7fdf3c1079b0 2019-11-28T11:28:26.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.786+0000 7fdf3ad9d700 1 --2- 172.21.15.80:0/1106741359 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdf20018730 0x7fdf2001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:26.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.787+0000 7fdf3ad9d700 1 --2- 172.21.15.80:0/1106741359 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdf20018730 0x7fdf2001abc0 crc :-1 s=READY pgs=208 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:26.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.794+0000 7fdf40833700 1 -- 172.21.15.80:0/1106741359 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf3c10c490 con 0x7fdf3c1079b0 2019-11-28T11:28:26.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.798+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/1106741359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c1079b0 0x7fdf3c107e40 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7fdf240103b0 tx=0x7fdf240101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:26.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.798+0000 7fdf337fe700 1 -- 172.21.15.80:0/1106741359 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fdf24007d10 con 0x7fdf3c1079b0 2019-11-28T11:28:26.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:26.966+0000 7fdf40833700 1 -- 172.21.15.80:0/1106741359 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7fdf3c10c810 con 0x7fdf3c1079b0 2019-11-28T11:28:27.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.594+0000 7fdf3a59c700 1 --2- 172.21.15.80:0/1106741359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c1079b0 0x7fdf3c107e40 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7fdf240103b0 tx=0x7fdf240101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:27.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.594+0000 7fdf337fe700 1 -- 172.21.15.80:0/1106741359 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v44) v1 ==== 125+0+0 (secure 0 0 0) 0x7fdf24007d10 con 0x7fdf3c1079b0 2019-11-28T11:28:27.658 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:28:27.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.633+0000 7fdf40833700 1 -- 172.21.15.80:0/1106741359 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdf20018730 msgr2=0x7fdf2001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:27.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.633+0000 7fdf40833700 1 --2- 172.21.15.80:0/1106741359 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdf20018730 0x7fdf2001abc0 crc :-1 s=READY pgs=208 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:27.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.633+0000 7fdf40833700 1 -- 172.21.15.80:0/1106741359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c1079b0 msgr2=0x7fdf3c107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:27.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.633+0000 7fdf40833700 1 --2- 172.21.15.80:0/1106741359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c1079b0 0x7fdf3c107e40 secure :-1 s=READY pgs=489 cs=0 l=1 rx=0x7fdf240103b0 tx=0x7fdf240101b0).stop 2019-11-28T11:28:27.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.633+0000 7fdf40833700 1 -- 172.21.15.80:0/1106741359 shutdown_connections 2019-11-28T11:28:27.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.633+0000 7fdf40833700 1 --2- 172.21.15.80:0/1106741359 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdf20018730 0x7fdf2001abc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:27.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.633+0000 7fdf40833700 1 --2- 172.21.15.80:0/1106741359 >> v2:172.21.15.174:3300/0 conn(0x7fdf3c108380 0x7fdf3c168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:27.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.633+0000 7fdf40833700 1 --2- 172.21.15.80:0/1106741359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf3c1079b0 0x7fdf3c107e40 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:27.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.633+0000 7fdf40833700 1 -- 172.21.15.80:0/1106741359 shutdown_connections 2019-11-28T11:28:27.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.633+0000 7fdf40833700 1 -- 172.21.15.80:0/1106741359 wait complete. 2019-11-28T11:28:27.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.633+0000 7fdf40833700 1 -- 172.21.15.80:0/1106741359 >> 172.21.15.80:0/1106741359 conn(0x7fdf3c15e2d0 msgr2=0x7fdf3c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:27.671 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:28:27.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.769+0000 7fc5024a0700 1 Processor -- start 2019-11-28T11:28:27.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.769+0000 7fc5024a0700 1 -- start start 2019-11-28T11:28:27.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.770+0000 7fc5024a0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc4fc15f100 0x7fc4fc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:27.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.770+0000 7fc5024a0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc4fc06c2f0 0x7fc4fc06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:27.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.770+0000 7fc5024a0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4fc06db60 con 0x7fc4fc15ed10 2019-11-28T11:28:27.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.770+0000 7fc5024a0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4fc06fe00 con 0x7fc4fc15f100 2019-11-28T11:28:27.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.770+0000 7fc5024a0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4fc0700d0 con 0x7fc4fc06c2f0 2019-11-28T11:28:27.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.770+0000 7fc4fbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc4fc15f100 0x7fc4fc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:27.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.770+0000 7fc500a3d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc4fc15ed10 0x7fc4fc073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60782/0 (socket says 172.21.15.80:60782) 2019-11-28T11:28:27.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.770+0000 7fc500a3d700 1 -- 172.21.15.80:0/2849584528 learned_addr learned my addr 172.21.15.80:0/2849584528 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:27.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.770+0000 7fc50123e700 1 --2- 172.21.15.80:0/2849584528 >> v2:172.21.15.174:3300/0 conn(0x7fc4fc06c2f0 0x7fc4fc06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:27.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.770+0000 7fc4fbfff700 1 -- 172.21.15.80:0/2849584528 >> v2:172.21.15.174:3300/0 conn(0x7fc4fc06c2f0 msgr2=0x7fc4fc06c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:27.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.770+0000 7fc4fbfff700 1 --2- 172.21.15.80:0/2849584528 >> v2:172.21.15.174:3300/0 conn(0x7fc4fc06c2f0 0x7fc4fc06c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:27.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.770+0000 7fc4fbfff700 1 -- 172.21.15.80:0/2849584528 >> v1:172.21.15.80:6789/0 conn(0x7fc4fc15ed10 legacy=0x7fc4fc073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:27.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.771+0000 7fc4fbfff700 1 -- 172.21.15.80:0/2849584528 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc070760 con 0x7fc4fc15f100 2019-11-28T11:28:27.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.770+0000 7fc4fb7fe700 1 -- 172.21.15.80:0/2849584528 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71348870 0 0) 0x7fc4e4001150 con 0x7fc4fc15ed10 2019-11-28T11:28:27.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.771+0000 7fc4fbfff700 1 --2- 172.21.15.80:0/2849584528 >> v2:172.21.15.80:3300/0 conn(0x7fc4fc15f100 0x7fc4fc06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc4ec00b2d0 tx=0x7fc4ec00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:27.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.771+0000 7fc4fbfff700 1 --2- 172.21.15.80:0/2849584528 >> v2:172.21.15.80:3300/0 conn(0x7fc4fc15f100 0x7fc4fc06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc4ec00b2d0 tx=0x7fc4ec00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:27.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.771+0000 7fc4fbfff700 1 --2- 172.21.15.80:0/2849584528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc15f100 0x7fc4fc06bdb0 secure :-1 s=READY pgs=491 cs=0 l=1 rx=0x7fc4ec00b2d0 tx=0x7fc4ec00ba60).ready entity=mon.0 client_cookie=786107eef31d5bcf server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:27.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.771+0000 7fc4fbfff700 1 --2- 172.21.15.80:0/2849584528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc15f100 0x7fc4fc06bdb0 secure :-1 s=THROTTLE_DONE pgs=491 cs=0 l=1 rx=0x7fc4ec00b2d0 tx=0x7fc4ec00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:27.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.771+0000 7fc4fb7fe700 1 -- 172.21.15.80:0/2849584528 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4ec007590 con 0x7fc4fc15f100 2019-11-28T11:28:27.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.771+0000 7fc4fbfff700 1 --2- 172.21.15.80:0/2849584528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc15f100 0x7fc4fc06bdb0 secure :-1 s=THROTTLE_DONE pgs=491 cs=0 l=1 rx=0x7fc4ec00b2d0 tx=0x7fc4ec00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:27.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.771+0000 7fc4fbfff700 1 --2- 172.21.15.80:0/2849584528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc15f100 0x7fc4fc06bdb0 secure :-1 s=THROTTLE_DONE pgs=491 cs=0 l=1 rx=0x7fc4ec00b2d0 tx=0x7fc4ec00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:27.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.771+0000 7fc4fb7fe700 1 -- 172.21.15.80:0/2849584528 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec009d30 con 0x7fc4fc15f100 2019-11-28T11:28:27.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.771+0000 7fc4fb7fe700 1 -- 172.21.15.80:0/2849584528 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4ec00a400 con 0x7fc4fc15f100 2019-11-28T11:28:27.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.771+0000 7fc5024a0700 1 -- 172.21.15.80:0/2849584528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc15f100 msgr2=0x7fc4fc06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:27.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.771+0000 7fc5024a0700 1 --2- 172.21.15.80:0/2849584528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc15f100 0x7fc4fc06bdb0 secure :-1 s=READY pgs=491 cs=0 l=1 rx=0x7fc4ec00b2d0 tx=0x7fc4ec00ba60).stop 2019-11-28T11:28:27.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.772+0000 7fc5024a0700 1 -- 172.21.15.80:0/2849584528 shutdown_connections 2019-11-28T11:28:27.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.772+0000 7fc5024a0700 1 --2- 172.21.15.80:0/2849584528 >> v2:172.21.15.174:3300/0 conn(0x7fc4fc06c2f0 0x7fc4fc06c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:27.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.772+0000 7fc5024a0700 1 --2- 172.21.15.80:0/2849584528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc15f100 0x7fc4fc06bdb0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:27.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.772+0000 7fc5024a0700 1 -- 172.21.15.80:0/2849584528 shutdown_connections 2019-11-28T11:28:27.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.772+0000 7fc5024a0700 1 -- 172.21.15.80:0/2849584528 wait complete. 2019-11-28T11:28:27.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.772+0000 7fc5024a0700 1 -- 172.21.15.80:0/2849584528 >> 172.21.15.80:0/2849584528 conn(0x7fc4fc061d20 msgr2=0x7fc4fc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:27.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.774+0000 7fc5024a0700 1 Processor -- start 2019-11-28T11:28:27.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.774+0000 7fc5024a0700 1 -- start start 2019-11-28T11:28:27.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.775+0000 7fc5024a0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc4fc148320 0x7fc4fc10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:27.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.775+0000 7fc5024a0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4fc148e00 con 0x7fc4fc10f290 2019-11-28T11:28:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.775+0000 7fc5024a0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4fc108b10 con 0x7fc4fc10e3d0 2019-11-28T11:28:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.775+0000 7fc5024a0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4fc13aa20 con 0x7fc4fc148320 2019-11-28T11:28:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.775+0000 7fc500a3d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc4fc148320 0x7fc4fc10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.775+0000 7fc4fbfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc4fc10f290 0x7fc4fc10dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60788/0 (socket says 172.21.15.80:60788) 2019-11-28T11:28:27.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.775+0000 7fc4fbfff700 1 -- 172.21.15.80:0/3276541406 learned_addr learned my addr 172.21.15.80:0/3276541406 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.775+0000 7fc500a3d700 1 -- 172.21.15.80:0/3276541406 >> v1:172.21.15.174:6789/0 conn(0x7fc4fc10e3d0 legacy=0x7fc4fc168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.775+0000 7fc500a3d700 1 -- 172.21.15.80:0/3276541406 >> v1:172.21.15.80:6789/0 conn(0x7fc4fc10f290 legacy=0x7fc4fc10dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.775+0000 7fc500a3d700 1 -- 172.21.15.80:0/3276541406 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc10c490 con 0x7fc4fc148320 2019-11-28T11:28:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.775+0000 7fc4f97fa700 1 -- 172.21.15.80:0/3276541406 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945701752 0 0) 0x7fc4ec009d20 con 0x7fc4fc10f290 2019-11-28T11:28:27.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.775+0000 7fc500a3d700 1 --2- 172.21.15.80:0/3276541406 >> v2:172.21.15.80:3300/0 conn(0x7fc4fc148320 0x7fc4fc10ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc4e4010370 tx=0x7fc4e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:27.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.776+0000 7fc500a3d700 1 --2- 172.21.15.80:0/3276541406 >> v2:172.21.15.80:3300/0 conn(0x7fc4fc148320 0x7fc4fc10ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc4e4010370 tx=0x7fc4e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:27.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.776+0000 7fc500a3d700 1 --2- 172.21.15.80:0/3276541406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc148320 0x7fc4fc10ed50 secure :-1 s=READY pgs=493 cs=0 l=1 rx=0x7fc4e4010370 tx=0x7fc4e4010710).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:27.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.776+0000 7fc500a3d700 1 --2- 172.21.15.80:0/3276541406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc148320 0x7fc4fc10ed50 secure :-1 s=THROTTLE_DONE pgs=493 cs=0 l=1 rx=0x7fc4e4010370 tx=0x7fc4e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:27.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.776+0000 7fc4f97fa700 1 -- 172.21.15.80:0/3276541406 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4e4000ef0 con 0x7fc4fc148320 2019-11-28T11:28:27.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.776+0000 7fc500a3d700 1 --2- 172.21.15.80:0/3276541406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc148320 0x7fc4fc10ed50 secure :-1 s=THROTTLE_DONE pgs=493 cs=0 l=1 rx=0x7fc4e4010370 tx=0x7fc4e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:27.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.776+0000 7fc500a3d700 1 --2- 172.21.15.80:0/3276541406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc148320 0x7fc4fc10ed50 secure :-1 s=THROTTLE_DONE pgs=493 cs=0 l=1 rx=0x7fc4e4010370 tx=0x7fc4e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:27.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.776+0000 7fc4f97fa700 1 -- 172.21.15.80:0/3276541406 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e4004240 con 0x7fc4fc148320 2019-11-28T11:28:27.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.776+0000 7fc5024a0700 1 -- 172.21.15.80:0/3276541406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4fc10c810 con 0x7fc4fc148320 2019-11-28T11:28:27.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.776+0000 7fc4f97fa700 1 -- 172.21.15.80:0/3276541406 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4e4001200 con 0x7fc4fc148320 2019-11-28T11:28:27.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.776+0000 7fc5024a0700 1 -- 172.21.15.80:0/3276541406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4fc10c490 con 0x7fc4fc148320 2019-11-28T11:28:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.776+0000 7fc500a3d700 1 --2- 172.21.15.80:0/3276541406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc148320 0x7fc4fc10ed50 secure :-1 s=THROTTLE_DONE pgs=493 cs=0 l=1 rx=0x7fc4e4010370 tx=0x7fc4e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.776+0000 7fc4f97fa700 1 -- 172.21.15.80:0/3276541406 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc4e4004430 con 0x7fc4fc148320 2019-11-28T11:28:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.776+0000 7fc500a3d700 1 --2- 172.21.15.80:0/3276541406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc148320 0x7fc4fc10ed50 secure :-1 s=THROTTLE_DONE pgs=493 cs=0 l=1 rx=0x7fc4e4010370 tx=0x7fc4e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.776+0000 7fc4f97fa700 1 --2- 172.21.15.80:0/3276541406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4e0018730 0x7fc4e001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.777+0000 7fc4f97fa700 1 -- 172.21.15.80:0/3276541406 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5904+0+0 (secure 0 0 0) 0x7fc4e4031a60 con 0x7fc4fc148320 2019-11-28T11:28:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.777+0000 7fc4fbfff700 1 --2- 172.21.15.80:0/3276541406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4e0018730 0x7fc4e001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.777+0000 7fc4fbfff700 1 --2- 172.21.15.80:0/3276541406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4e0018730 0x7fc4e001abc0 crc :-1 s=READY pgs=209 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.784+0000 7fc5024a0700 1 -- 172.21.15.80:0/3276541406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4fc10c810 con 0x7fc4fc148320 2019-11-28T11:28:27.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.788+0000 7fc500a3d700 1 --2- 172.21.15.80:0/3276541406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc148320 0x7fc4fc10ed50 secure :-1 s=THROTTLE_DONE pgs=493 cs=0 l=1 rx=0x7fc4e4010370 tx=0x7fc4e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:27.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.788+0000 7fc4f97fa700 1 -- 172.21.15.80:0/3276541406 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc4e4000c90 con 0x7fc4fc148320 2019-11-28T11:28:27.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.953+0000 7fc5024a0700 1 -- 172.21.15.80:0/3276541406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7fc4fc10c490 con 0x7fc4fc148320 2019-11-28T11:28:27.982 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:28:27.954+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:28:27.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.958+0000 7fc500a3d700 1 --2- 172.21.15.80:0/3276541406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc148320 0x7fc4fc10ed50 secure :-1 s=THROTTLE_DONE pgs=493 cs=0 l=1 rx=0x7fc4e4010370 tx=0x7fc4e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:27.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.958+0000 7fc4f97fa700 1 -- 172.21.15.80:0/3276541406 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 6 and data pool 7 v18) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc4e401f880 con 0x7fc4fc148320 2019-11-28T11:28:27.989 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 6 and data pool 7 2019-11-28T11:28:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.963+0000 7fc5024a0700 1 -- 172.21.15.80:0/3276541406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4e0018730 msgr2=0x7fc4e001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:27.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.963+0000 7fc5024a0700 1 --2- 172.21.15.80:0/3276541406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4e0018730 0x7fc4e001abc0 crc :-1 s=READY pgs=209 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:27.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.963+0000 7fc5024a0700 1 -- 172.21.15.80:0/3276541406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc148320 msgr2=0x7fc4fc10ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:27.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.963+0000 7fc5024a0700 1 --2- 172.21.15.80:0/3276541406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc148320 0x7fc4fc10ed50 secure :-1 s=READY pgs=493 cs=0 l=1 rx=0x7fc4e4010370 tx=0x7fc4e4010710).stop 2019-11-28T11:28:27.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.963+0000 7fc5024a0700 1 -- 172.21.15.80:0/3276541406 shutdown_connections 2019-11-28T11:28:27.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.963+0000 7fc5024a0700 1 --2- 172.21.15.80:0/3276541406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4e0018730 0x7fc4e001abc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:27.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.963+0000 7fc5024a0700 1 --2- 172.21.15.80:0/3276541406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4fc148320 0x7fc4fc10ed50 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:27.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.964+0000 7fc5024a0700 1 -- 172.21.15.80:0/3276541406 shutdown_connections 2019-11-28T11:28:27.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.964+0000 7fc5024a0700 1 -- 172.21.15.80:0/3276541406 wait complete. 2019-11-28T11:28:27.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:27.964+0000 7fc5024a0700 1 -- 172.21.15.80:0/3276541406 >> 172.21.15.80:0/3276541406 conn(0x7fc4fc15e2d0 msgr2=0x7fc4fc147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:28.001 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:28:28.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.093+0000 7f4266f88700 1 Processor -- start 2019-11-28T11:28:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.093+0000 7f4266f88700 1 -- start start 2019-11-28T11:28:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.094+0000 7f4266f88700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f426006c0a0 0x7f4260072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.094+0000 7f4266f88700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426006db00 con 0x7f42600734e0 2019-11-28T11:28:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.094+0000 7f4266f88700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426006e000 con 0x7f4260072620 2019-11-28T11:28:28.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.094+0000 7f4266f88700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426006fd60 con 0x7f426006c0a0 2019-11-28T11:28:28.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.094+0000 7f4264d24700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f42600734e0 0x7f4260071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60800/0 (socket says 172.21.15.80:60800) 2019-11-28T11:28:28.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.094+0000 7f4264d24700 1 -- 172.21.15.80:0/4051343563 learned_addr learned my addr 172.21.15.80:0/4051343563 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:28.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f4265525700 1 --2- 172.21.15.80:0/4051343563 >> v2:172.21.15.174:3300/0 conn(0x7f426006c0a0 0x7f4260072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f425ffff700 1 -- 172.21.15.80:0/4051343563 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052505841 0 0) 0x7f42500014d0 con 0x7f42600734e0 2019-11-28T11:28:28.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f425ffff700 1 -- 172.21.15.80:0/4051343563 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4248002e80 con 0x7f42600734e0 2019-11-28T11:28:28.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f425ffff700 1 -- 172.21.15.80:0/4051343563 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3260345730 0 0) 0x7f42500014b0 con 0x7f42600734e0 2019-11-28T11:28:28.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f425ffff700 1 -- 172.21.15.80:0/4051343563 >> v2:172.21.15.174:3300/0 conn(0x7f426006c0a0 msgr2=0x7f4260072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:28.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f425ffff700 1 --2- 172.21.15.80:0/4051343563 >> v2:172.21.15.174:3300/0 conn(0x7f426006c0a0 0x7f4260072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:28.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f425ffff700 1 -- 172.21.15.80:0/4051343563 >> v1:172.21.15.174:6789/0 conn(0x7f4260072620 legacy=0x7f4260164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f425ffff700 1 -- 172.21.15.80:0/4051343563 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42600706c0 con 0x7f42600734e0 2019-11-28T11:28:28.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f425ffff700 1 -- 172.21.15.80:0/4051343563 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f42500019e0 con 0x7f42600734e0 2019-11-28T11:28:28.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f425ffff700 1 -- 172.21.15.80:0/4051343563 >> v1:172.21.15.80:6789/0 conn(0x7f42600734e0 legacy=0x7f4260071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f425ffff700 1 --2- 172.21.15.80:0/4051343563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4248003ab0 0x7f4248005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:28.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f425ffff700 1 --2- 172.21.15.80:0/4051343563 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4248006690 0x7f4248008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:28.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f425ffff700 1 --2- 172.21.15.80:0/4051343563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248009380 0x7f424800b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:28.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f425ffff700 1 -- 172.21.15.80:0/4051343563 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424800c000 con 0x7f4248009380 2019-11-28T11:28:28.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f425ffff700 1 -- 172.21.15.80:0/4051343563 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4248050200 con 0x7f4248003ab0 2019-11-28T11:28:28.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f425ffff700 1 -- 172.21.15.80:0/4051343563 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4248050430 con 0x7f4248006690 2019-11-28T11:28:28.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f4265d26700 1 --2- 172.21.15.80:0/4051343563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248009380 0x7f424800b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f4265525700 1 --2- 172.21.15.80:0/4051343563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4248003ab0 0x7f4248005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f4264d24700 1 --2- 172.21.15.80:0/4051343563 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4248006690 0x7f4248008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f4265d26700 1 -- 172.21.15.80:0/4051343563 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4248006690 msgr2=0x7f4248008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:28.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f4265d26700 1 --2- 172.21.15.80:0/4051343563 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4248006690 0x7f4248008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:28.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f4265d26700 1 -- 172.21.15.80:0/4051343563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4248003ab0 msgr2=0x7f4248005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:28.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f4265d26700 1 --2- 172.21.15.80:0/4051343563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4248003ab0 0x7f4248005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:28.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f4265d26700 1 -- 172.21.15.80:0/4051343563 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42480506e0 con 0x7f4248009380 2019-11-28T11:28:28.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f4265d26700 1 --2- 172.21.15.80:0/4051343563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248009380 0x7f424800b850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f425800af60 tx=0x7f425800b260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f4265d26700 1 -- 172.21.15.80:0/4051343563 reap_dead start 2019-11-28T11:28:28.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f4265d26700 1 --2- 172.21.15.80:0/4051343563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248009380 0x7f424800b850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f425800af60 tx=0x7f425800b260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.095+0000 7f4265d26700 1 --2- 172.21.15.80:0/4051343563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248009380 0x7f424800b850 secure :-1 s=READY pgs=495 cs=0 l=1 rx=0x7f425800af60 tx=0x7f425800b260).ready entity=mon.0 client_cookie=a95de07c7f055468 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:28.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.096+0000 7f4265d26700 1 --2- 172.21.15.80:0/4051343563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248009380 0x7f424800b850 secure :-1 s=THROTTLE_DONE pgs=495 cs=0 l=1 rx=0x7f425800af60 tx=0x7f425800b260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.096+0000 7f425ffff700 1 -- 172.21.15.80:0/4051343563 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4258000bb0 con 0x7f4248009380 2019-11-28T11:28:28.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.096+0000 7f4265d26700 1 --2- 172.21.15.80:0/4051343563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248009380 0x7f424800b850 secure :-1 s=THROTTLE_DONE pgs=495 cs=0 l=1 rx=0x7f425800af60 tx=0x7f425800b260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.096+0000 7f4265d26700 1 --2- 172.21.15.80:0/4051343563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248009380 0x7f424800b850 secure :-1 s=THROTTLE_DONE pgs=495 cs=0 l=1 rx=0x7f425800af60 tx=0x7f425800b260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.096+0000 7f425ffff700 1 -- 172.21.15.80:0/4051343563 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4258009990 con 0x7f4248009380 2019-11-28T11:28:28.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.096+0000 7f425ffff700 1 -- 172.21.15.80:0/4051343563 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f425800a0c0 con 0x7f4248009380 2019-11-28T11:28:28.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.096+0000 7f4266f88700 1 -- 172.21.15.80:0/4051343563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248009380 msgr2=0x7f424800b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.096+0000 7f4266f88700 1 --2- 172.21.15.80:0/4051343563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248009380 0x7f424800b850 secure :-1 s=READY pgs=495 cs=0 l=1 rx=0x7f425800af60 tx=0x7f425800b260).stop 2019-11-28T11:28:28.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.096+0000 7f4266f88700 1 -- 172.21.15.80:0/4051343563 shutdown_connections 2019-11-28T11:28:28.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.096+0000 7f4266f88700 1 --2- 172.21.15.80:0/4051343563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4248009380 0x7f424800b850 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:28.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.096+0000 7f4266f88700 1 -- 172.21.15.80:0/4051343563 shutdown_connections 2019-11-28T11:28:28.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.096+0000 7f4266f88700 1 -- 172.21.15.80:0/4051343563 wait complete. 2019-11-28T11:28:28.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.096+0000 7f4266f88700 1 -- 172.21.15.80:0/4051343563 >> 172.21.15.80:0/4051343563 conn(0x7f4260061cf0 msgr2=0x7f4260064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:28.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.099+0000 7f4266f88700 1 Processor -- start 2019-11-28T11:28:28.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.099+0000 7f4266f88700 1 -- start start 2019-11-28T11:28:28.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4266f88700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4260077040 0x7f42601574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:28.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4266f88700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4260075210 0x7f426016aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:28.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4266f88700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4260140820 con 0x7f4260157a00 2019-11-28T11:28:28.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4266f88700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4260137110 con 0x7f4260077040 2019-11-28T11:28:28.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4266f88700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42601373e0 con 0x7f4260075210 2019-11-28T11:28:28.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4265525700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4260077040 0x7f42601574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4265525700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4260077040 0x7f42601574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33264/0 (socket says 172.21.15.80:33264) 2019-11-28T11:28:28.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4265525700 1 -- 172.21.15.80:0/4100209992 learned_addr learned my addr 172.21.15.80:0/4100209992 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:28.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4265d26700 1 --2- 172.21.15.80:0/4100209992 >> v2:172.21.15.174:3300/0 conn(0x7f4260075210 0x7f426016aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4265525700 1 -- 172.21.15.80:0/4100209992 >> v2:172.21.15.174:3300/0 conn(0x7f4260075210 msgr2=0x7f426016aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4265525700 1 --2- 172.21.15.80:0/4100209992 >> v2:172.21.15.174:3300/0 conn(0x7f4260075210 0x7f426016aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:28.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4265525700 1 -- 172.21.15.80:0/4100209992 >> v1:172.21.15.174:6789/0 conn(0x7f4260157a00 legacy=0x7f4260074a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4265525700 1 -- 172.21.15.80:0/4100209992 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4260137a70 con 0x7f4260077040 2019-11-28T11:28:28.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4265525700 1 --2- 172.21.15.80:0/4100209992 >> v2:172.21.15.80:3300/0 conn(0x7f4260077040 0x7f42601574c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4254010460 tx=0x7f4254010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4265525700 1 --2- 172.21.15.80:0/4100209992 >> v2:172.21.15.80:3300/0 conn(0x7f4260077040 0x7f42601574c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4254010460 tx=0x7f4254010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4265525700 1 --2- 172.21.15.80:0/4100209992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4260077040 0x7f42601574c0 secure :-1 s=READY pgs=496 cs=0 l=1 rx=0x7f4254010460 tx=0x7f4254010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4265525700 1 --2- 172.21.15.80:0/4100209992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4260077040 0x7f42601574c0 secure :-1 s=THROTTLE_DONE pgs=496 cs=0 l=1 rx=0x7f4254010460 tx=0x7f4254010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f4265525700 1 --2- 172.21.15.80:0/4100209992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4260077040 0x7f42601574c0 secure :-1 s=THROTTLE_DONE pgs=496 cs=0 l=1 rx=0x7f4254010460 tx=0x7f4254010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.100+0000 7f425dffb700 1 -- 172.21.15.80:0/4100209992 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4254000940 con 0x7f4260077040 2019-11-28T11:28:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.101+0000 7f4265525700 1 --2- 172.21.15.80:0/4100209992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4260077040 0x7f42601574c0 secure :-1 s=THROTTLE_DONE pgs=496 cs=0 l=1 rx=0x7f4254010460 tx=0x7f4254010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.101+0000 7f425dffb700 1 -- 172.21.15.80:0/4100209992 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4254009980 con 0x7f4260077040 2019-11-28T11:28:28.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.101+0000 7f425dffb700 1 -- 172.21.15.80:0/4100209992 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f425400a050 con 0x7f4260077040 2019-11-28T11:28:28.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.101+0000 7f4266f88700 1 -- 172.21.15.80:0/4100209992 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4260137df0 con 0x7f4260077040 2019-11-28T11:28:28.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.101+0000 7f4266f88700 1 -- 172.21.15.80:0/4100209992 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4260137a70 con 0x7f4260077040 2019-11-28T11:28:28.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.101+0000 7f4265525700 1 --2- 172.21.15.80:0/4100209992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4260077040 0x7f42601574c0 secure :-1 s=THROTTLE_DONE pgs=496 cs=0 l=1 rx=0x7f4254010460 tx=0x7f4254010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.101+0000 7f425dffb700 1 -- 172.21.15.80:0/4100209992 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4254009580 con 0x7f4260077040 2019-11-28T11:28:28.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.101+0000 7f4265525700 1 --2- 172.21.15.80:0/4100209992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4260077040 0x7f42601574c0 secure :-1 s=THROTTLE_DONE pgs=496 cs=0 l=1 rx=0x7f4254010460 tx=0x7f4254010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.101+0000 7f425dffb700 1 --2- 172.21.15.80:0/4100209992 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4240018730 0x7f424001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:28.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.101+0000 7f425dffb700 1 -- 172.21.15.80:0/4100209992 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4254031ac0 con 0x7f4260077040 2019-11-28T11:28:28.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.101+0000 7f4264d24700 1 --2- 172.21.15.80:0/4100209992 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4240018730 0x7f424001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.102+0000 7f4264d24700 1 --2- 172.21.15.80:0/4100209992 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4240018730 0x7f424001abc0 crc :-1 s=READY pgs=210 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:28.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.108+0000 7f4266f88700 1 -- 172.21.15.80:0/4100209992 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4260137df0 con 0x7f4260077040 2019-11-28T11:28:28.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.112+0000 7f4265525700 1 --2- 172.21.15.80:0/4100209992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4260077040 0x7f42601574c0 secure :-1 s=THROTTLE_DONE pgs=496 cs=0 l=1 rx=0x7f4254010460 tx=0x7f4254010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.112+0000 7f425dffb700 1 -- 172.21.15.80:0/4100209992 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4254000940 con 0x7f4260077040 2019-11-28T11:28:28.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.288+0000 7f4266f88700 1 -- 172.21.15.80:0/4100209992 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4260137a70 con 0x7f4260077040 2019-11-28T11:28:28.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.289+0000 7f4265525700 1 --2- 172.21.15.80:0/4100209992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4260077040 0x7f42601574c0 secure :-1 s=THROTTLE_DONE pgs=496 cs=0 l=1 rx=0x7f4254010460 tx=0x7f4254010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.289+0000 7f425dffb700 1 -- 172.21.15.80:0/4100209992 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+14883 (secure 0 0 0) 0x7f4254009580 con 0x7f4260077040 2019-11-28T11:28:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:28.318 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":45,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:28:27.955248+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:28:26.282940+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2019-11-28T11:28:26.978374+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:28:28.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.291+0000 7f4266f88700 1 -- 172.21.15.80:0/4100209992 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4240018730 msgr2=0x7f424001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.291+0000 7f4266f88700 1 --2- 172.21.15.80:0/4100209992 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4240018730 0x7f424001abc0 crc :-1 s=READY pgs=210 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.291+0000 7f4266f88700 1 -- 172.21.15.80:0/4100209992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4260077040 msgr2=0x7f42601574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.291+0000 7f4266f88700 1 --2- 172.21.15.80:0/4100209992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4260077040 0x7f42601574c0 secure :-1 s=READY pgs=496 cs=0 l=1 rx=0x7f4254010460 tx=0x7f4254010290).stop 2019-11-28T11:28:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.291+0000 7f4266f88700 1 -- 172.21.15.80:0/4100209992 shutdown_connections 2019-11-28T11:28:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.291+0000 7f4266f88700 1 --2- 172.21.15.80:0/4100209992 >> v2:172.21.15.174:3300/0 conn(0x7f4260075210 0x7f426016aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.291+0000 7f4266f88700 1 --2- 172.21.15.80:0/4100209992 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4240018730 0x7f424001abc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.291+0000 7f4266f88700 1 --2- 172.21.15.80:0/4100209992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4260077040 0x7f42601574c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.291+0000 7f4266f88700 1 -- 172.21.15.80:0/4100209992 shutdown_connections 2019-11-28T11:28:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.291+0000 7f4266f88700 1 -- 172.21.15.80:0/4100209992 wait complete. 2019-11-28T11:28:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.291+0000 7f4266f88700 1 -- 172.21.15.80:0/4100209992 >> 172.21.15.80:0/4100209992 conn(0x7f426013fa50 msgr2=0x7f426007c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:28.335 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:28:28.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.430+0000 7f6a53c2a700 1 Processor -- start 2019-11-28T11:28:28.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.430+0000 7f6a53c2a700 1 -- start start 2019-11-28T11:28:28.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.431+0000 7f6a53c2a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c06c490 0x7f6a4c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:28.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.431+0000 7f6a53c2a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6a4c06ce60 0x7f6a4c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:28.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a53c2a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4c06db00 con 0x7f6a4c06c0a0 2019-11-28T11:28:28.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a53c2a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4c06fd60 con 0x7f6a4c06ce60 2019-11-28T11:28:28.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a53c2a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c070030 con 0x7f6a4c06c490 2019-11-28T11:28:28.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a519c6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c06c490 0x7f6a4c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a529c8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6a4c06ce60 0x7f6a4c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a519c6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c06c490 0x7f6a4c06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:35530/0 (socket says 172.21.15.80:35530) 2019-11-28T11:28:28.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a519c6700 1 -- 172.21.15.80:0/4128167284 learned_addr learned my addr 172.21.15.80:0/4128167284 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:28.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a521c7700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f6a4c06c0a0 0x7f6a4c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:48128/0 (socket says 172.21.15.80:48128) 2019-11-28T11:28:28.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a529c8700 1 -- 172.21.15.80:0/4128167284 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c06c490 msgr2=0x7f6a4c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:28.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a529c8700 1 --2- 172.21.15.80:0/4128167284 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c06c490 0x7f6a4c06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:28.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a529c8700 1 -- 172.21.15.80:0/4128167284 >> v1:172.21.15.174:6789/0 conn(0x7f6a4c06c0a0 legacy=0x7f6a4c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a511c5700 1 -- 172.21.15.80:0/4128167284 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913787773 0 0) 0x7f6a3c001080 con 0x7f6a4c06c0a0 2019-11-28T11:28:28.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a529c8700 1 -- 172.21.15.80:0/4128167284 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c0706c0 con 0x7f6a4c06ce60 2019-11-28T11:28:28.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a519c6700 1 --2- 172.21.15.80:0/4128167284 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c06c490 0x7f6a4c06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:28.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a529c8700 1 --2- 172.21.15.80:0/4128167284 >> v2:172.21.15.174:3300/0 conn(0x7f6a4c06ce60 0x7f6a4c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6a4400af80 tx=0x7f6a4400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a529c8700 1 --2- 172.21.15.80:0/4128167284 >> v2:172.21.15.174:3300/0 conn(0x7f6a4c06ce60 0x7f6a4c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6a4400af80 tx=0x7f6a4400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.432+0000 7f6a529c8700 1 --2- 172.21.15.80:0/4128167284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a4c06ce60 0x7f6a4c164d70 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7f6a4400af80 tx=0x7f6a4400b790).ready entity=mon.1 client_cookie=c099072dfaebb1b2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:28.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.433+0000 7f6a529c8700 1 --2- 172.21.15.80:0/4128167284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a4c06ce60 0x7f6a4c164d70 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f6a4400af80 tx=0x7f6a4400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.433+0000 7f6a511c5700 1 -- 172.21.15.80:0/4128167284 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a44000bc0 con 0x7f6a4c06ce60 2019-11-28T11:28:28.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.433+0000 7f6a529c8700 1 --2- 172.21.15.80:0/4128167284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a4c06ce60 0x7f6a4c164d70 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f6a4400af80 tx=0x7f6a4400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.433+0000 7f6a529c8700 1 --2- 172.21.15.80:0/4128167284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a4c06ce60 0x7f6a4c164d70 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f6a4400af80 tx=0x7f6a4400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.433+0000 7f6a511c5700 1 -- 172.21.15.80:0/4128167284 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a44000bc0 con 0x7f6a4c06ce60 2019-11-28T11:28:28.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.433+0000 7f6a511c5700 1 -- 172.21.15.80:0/4128167284 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a44009bd0 con 0x7f6a4c06ce60 2019-11-28T11:28:28.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.433+0000 7f6a53c2a700 1 -- 172.21.15.80:0/4128167284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a4c06ce60 msgr2=0x7f6a4c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.433+0000 7f6a53c2a700 1 --2- 172.21.15.80:0/4128167284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a4c06ce60 0x7f6a4c164d70 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7f6a4400af80 tx=0x7f6a4400b790).stop 2019-11-28T11:28:28.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.433+0000 7f6a53c2a700 1 -- 172.21.15.80:0/4128167284 shutdown_connections 2019-11-28T11:28:28.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.433+0000 7f6a53c2a700 1 --2- 172.21.15.80:0/4128167284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a4c06ce60 0x7f6a4c164d70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:28.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.433+0000 7f6a53c2a700 1 --2- 172.21.15.80:0/4128167284 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c06c490 0x7f6a4c06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:28.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.434+0000 7f6a53c2a700 1 -- 172.21.15.80:0/4128167284 shutdown_connections 2019-11-28T11:28:28.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.434+0000 7f6a53c2a700 1 -- 172.21.15.80:0/4128167284 wait complete. 2019-11-28T11:28:28.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.434+0000 7f6a53c2a700 1 -- 172.21.15.80:0/4128167284 >> 172.21.15.80:0/4128167284 conn(0x7f6a4c061cf0 msgr2=0x7f6a4c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:28.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.436+0000 7f6a53c2a700 1 Processor -- start 2019-11-28T11:28:28.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.436+0000 7f6a53c2a700 1 -- start start 2019-11-28T11:28:28.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.437+0000 7f6a53c2a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6a4c13eb40 0x7f6a4c10afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:28.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.437+0000 7f6a53c2a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c1631f0 0x7f6a4c105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:28.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.437+0000 7f6a53c2a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4c13f1e0 con 0x7f6a4c10b500 2019-11-28T11:28:28.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.437+0000 7f6a53c2a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4c1234c0 con 0x7f6a4c13eb40 2019-11-28T11:28:28.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.437+0000 7f6a53c2a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c13e0d0 con 0x7f6a4c1631f0 2019-11-28T11:28:28.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.437+0000 7f6a521c7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6a4c13eb40 0x7f6a4c10afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.437+0000 7f6a529c8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c1631f0 0x7f6a4c105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.437+0000 7f6a519c6700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f6a4c10b500 0x7f6a4c1629f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:48136/0 (socket says 172.21.15.80:48136) 2019-11-28T11:28:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.437+0000 7f6a519c6700 1 -- 172.21.15.80:0/3033488119 learned_addr learned my addr 172.21.15.80:0/3033488119 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.437+0000 7f6a42ffd700 1 -- 172.21.15.80:0/3033488119 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991604194 0 0) 0x7f6a48007900 con 0x7f6a4c10b500 2019-11-28T11:28:28.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.437+0000 7f6a42ffd700 1 -- 172.21.15.80:0/3033488119 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a34002e80 con 0x7f6a4c10b500 2019-11-28T11:28:28.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.437+0000 7f6a529c8700 1 -- 172.21.15.80:0/3033488119 >> v2:172.21.15.174:3300/0 conn(0x7f6a4c13eb40 msgr2=0x7f6a4c10afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.437+0000 7f6a529c8700 1 --2- 172.21.15.80:0/3033488119 >> v2:172.21.15.174:3300/0 conn(0x7f6a4c13eb40 0x7f6a4c10afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:28.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.437+0000 7f6a529c8700 1 -- 172.21.15.80:0/3033488119 >> v1:172.21.15.174:6789/0 conn(0x7f6a4c10b500 legacy=0x7f6a4c1629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.437+0000 7f6a529c8700 1 -- 172.21.15.80:0/3033488119 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c108700 con 0x7f6a4c1631f0 2019-11-28T11:28:28.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.437+0000 7f6a529c8700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c1631f0 0x7f6a4c105210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6a440103f0 tx=0x7f6a44010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.438+0000 7f6a529c8700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c1631f0 0x7f6a4c105210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6a440103f0 tx=0x7f6a44010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.438+0000 7f6a529c8700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c1631f0 0x7f6a4c105210 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f6a440103f0 tx=0x7f6a44010220).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:28.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.438+0000 7f6a529c8700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c1631f0 0x7f6a4c105210 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f6a440103f0 tx=0x7f6a44010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.438+0000 7f6a42ffd700 1 -- 172.21.15.80:0/3033488119 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a44009990 con 0x7f6a4c1631f0 2019-11-28T11:28:28.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.438+0000 7f6a53c2a700 1 -- 172.21.15.80:0/3033488119 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4c108a80 con 0x7f6a4c1631f0 2019-11-28T11:28:28.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.438+0000 7f6a529c8700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c1631f0 0x7f6a4c105210 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f6a440103f0 tx=0x7f6a44010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.438+0000 7f6a42ffd700 1 -- 172.21.15.80:0/3033488119 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a440095b0 con 0x7f6a4c1631f0 2019-11-28T11:28:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.438+0000 7f6a529c8700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c1631f0 0x7f6a4c105210 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f6a440103f0 tx=0x7f6a44010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.438+0000 7f6a53c2a700 1 -- 172.21.15.80:0/3033488119 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4c108700 con 0x7f6a4c1631f0 2019-11-28T11:28:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.438+0000 7f6a42ffd700 1 -- 172.21.15.80:0/3033488119 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a440097a0 con 0x7f6a4c1631f0 2019-11-28T11:28:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.438+0000 7f6a529c8700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c1631f0 0x7f6a4c105210 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f6a440103f0 tx=0x7f6a44010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.439+0000 7f6a42ffd700 1 -- 172.21.15.80:0/3033488119 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6a440097a0 con 0x7f6a4c1631f0 2019-11-28T11:28:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.439+0000 7f6a529c8700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c1631f0 0x7f6a4c105210 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f6a440103f0 tx=0x7f6a44010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.439+0000 7f6a42ffd700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a34018770 0x7f6a3401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:28.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.439+0000 7f6a42ffd700 1 -- 172.21.15.80:0/3033488119 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6a44031a40 con 0x7f6a4c1631f0 2019-11-28T11:28:28.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.439+0000 7f6a521c7700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a34018770 0x7f6a3401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.439+0000 7f6a521c7700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a34018770 0x7f6a3401abe0 crc :-1 s=READY pgs=211 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:28.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.446+0000 7f6a53c2a700 1 -- 172.21.15.80:0/3033488119 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4c108a80 con 0x7f6a4c1631f0 2019-11-28T11:28:28.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.450+0000 7f6a529c8700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c1631f0 0x7f6a4c105210 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f6a440103f0 tx=0x7f6a44010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.450+0000 7f6a42ffd700 1 -- 172.21.15.80:0/3033488119 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6a44009cc0 con 0x7f6a4c1631f0 2019-11-28T11:28:28.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.626+0000 7f6a53c2a700 1 -- 172.21.15.80:0/3033488119 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a4c108700 con 0x7f6a4c1631f0 2019-11-28T11:28:28.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.627+0000 7f6a529c8700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c1631f0 0x7f6a4c105210 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f6a440103f0 tx=0x7f6a44010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.627+0000 7f6a42ffd700 1 -- 172.21.15.80:0/3033488119 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+14883 (secure 0 0 0) 0x7f6a4400ac60 con 0x7f6a4c1631f0 2019-11-28T11:28:28.657 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:28.657 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":45,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:28:27.955248+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:28:26.282940+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2019-11-28T11:28:26.978374+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:28:28.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.631+0000 7f6a53c2a700 1 -- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a34018770 msgr2=0x7f6a3401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.631+0000 7f6a53c2a700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a34018770 0x7f6a3401abe0 crc :-1 s=READY pgs=211 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:28.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.631+0000 7f6a53c2a700 1 -- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c1631f0 msgr2=0x7f6a4c105210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.631+0000 7f6a53c2a700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c1631f0 0x7f6a4c105210 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f6a440103f0 tx=0x7f6a44010220).stop 2019-11-28T11:28:28.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.631+0000 7f6a53c2a700 1 -- 172.21.15.80:0/3033488119 shutdown_connections 2019-11-28T11:28:28.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.631+0000 7f6a53c2a700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a4c1631f0 0x7f6a4c105210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:28.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.631+0000 7f6a53c2a700 1 --2- 172.21.15.80:0/3033488119 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a34018770 0x7f6a3401abe0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:28.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.631+0000 7f6a53c2a700 1 --2- 172.21.15.80:0/3033488119 >> v2:172.21.15.174:3300/0 conn(0x7f6a4c13eb40 0x7f6a4c10afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:28.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.631+0000 7f6a53c2a700 1 -- 172.21.15.80:0/3033488119 shutdown_connections 2019-11-28T11:28:28.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.632+0000 7f6a53c2a700 1 -- 172.21.15.80:0/3033488119 wait complete. 2019-11-28T11:28:28.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.632+0000 7f6a53c2a700 1 -- 172.21.15.80:0/3033488119 >> 172.21.15.80:0/3033488119 conn(0x7f6a4c11bfc0 msgr2=0x7f6a4c141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:28.669 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:28:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.764+0000 7fbbeebc9700 1 Processor -- start 2019-11-28T11:28:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.765+0000 7fbbeebc9700 1 -- start start 2019-11-28T11:28:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.766+0000 7fbbeebc9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbbe815ed10 0x7fbbe815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.766+0000 7fbbeebc9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbe80734b0 0x7fbbe80726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:28.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.766+0000 7fbbeebc9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe806db60 con 0x7fbbe8073020 2019-11-28T11:28:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.766+0000 7fbbeebc9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe806fe00 con 0x7fbbe815ed10 2019-11-28T11:28:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.766+0000 7fbbeebc9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80700d0 con 0x7fbbe80734b0 2019-11-28T11:28:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.766+0000 7fbbed166700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbbe815ed10 0x7fbbe815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.766+0000 7fbbed967700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbe80734b0 0x7fbbe80726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.766+0000 7fbbec965700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fbbe8073020 0x7fbbe8071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:48142/0 (socket says 172.21.15.80:48142) 2019-11-28T11:28:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.766+0000 7fbbed166700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbbe815ed10 0x7fbbe815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:48168/0 (socket says 172.21.15.80:48168) 2019-11-28T11:28:28.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.766+0000 7fbbec965700 1 -- 172.21.15.80:0/2484312318 learned_addr learned my addr 172.21.15.80:0/2484312318 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.766+0000 7fbbed166700 1 -- 172.21.15.80:0/2484312318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbe80734b0 msgr2=0x7fbbe80726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.766+0000 7fbbed166700 1 --2- 172.21.15.80:0/2484312318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbe80734b0 0x7fbbe80726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.766+0000 7fbbed166700 1 -- 172.21.15.80:0/2484312318 >> v1:172.21.15.174:6789/0 conn(0x7fbbe8073020 legacy=0x7fbbe8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.766+0000 7fbbe7fff700 1 -- 172.21.15.80:0/2484312318 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938331601 0 0) 0x7fbbd8001480 con 0x7fbbe8073020 2019-11-28T11:28:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.766+0000 7fbbed166700 1 -- 172.21.15.80:0/2484312318 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe8070760 con 0x7fbbe815ed10 2019-11-28T11:28:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.766+0000 7fbbed967700 1 --2- 172.21.15.80:0/2484312318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbe80734b0 0x7fbbe80726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:28.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.767+0000 7fbbed166700 1 --2- 172.21.15.80:0/2484312318 >> v2:172.21.15.174:3300/0 conn(0x7fbbe815ed10 0x7fbbe815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbbd000af50 tx=0x7fbbd000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.767+0000 7fbbed166700 1 --2- 172.21.15.80:0/2484312318 >> v2:172.21.15.174:3300/0 conn(0x7fbbe815ed10 0x7fbbe815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbbd000af50 tx=0x7fbbd000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.767+0000 7fbbed166700 1 --2- 172.21.15.80:0/2484312318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbe815ed10 0x7fbbe815f100 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7fbbd000af50 tx=0x7fbbd000b760).ready entity=mon.1 client_cookie=6cf6f0525c5d675d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:28.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.767+0000 7fbbed166700 1 --2- 172.21.15.80:0/2484312318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbe815ed10 0x7fbbe815f100 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7fbbd000af50 tx=0x7fbbd000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.767+0000 7fbbe7fff700 1 -- 172.21.15.80:0/2484312318 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbd0007210 con 0x7fbbe815ed10 2019-11-28T11:28:28.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.767+0000 7fbbed166700 1 --2- 172.21.15.80:0/2484312318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbe815ed10 0x7fbbe815f100 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7fbbd000af50 tx=0x7fbbd000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.767+0000 7fbbed166700 1 --2- 172.21.15.80:0/2484312318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbe815ed10 0x7fbbe815f100 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7fbbd000af50 tx=0x7fbbd000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.767+0000 7fbbe7fff700 1 -- 172.21.15.80:0/2484312318 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd00099b0 con 0x7fbbe815ed10 2019-11-28T11:28:28.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.767+0000 7fbbe7fff700 1 -- 172.21.15.80:0/2484312318 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbd000a080 con 0x7fbbe815ed10 2019-11-28T11:28:28.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.767+0000 7fbbeebc9700 1 -- 172.21.15.80:0/2484312318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbe815ed10 msgr2=0x7fbbe815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.767+0000 7fbbeebc9700 1 --2- 172.21.15.80:0/2484312318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbe815ed10 0x7fbbe815f100 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7fbbd000af50 tx=0x7fbbd000b760).stop 2019-11-28T11:28:28.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.767+0000 7fbbeebc9700 1 -- 172.21.15.80:0/2484312318 shutdown_connections 2019-11-28T11:28:28.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.767+0000 7fbbeebc9700 1 --2- 172.21.15.80:0/2484312318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbe80734b0 0x7fbbe80726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:28.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.767+0000 7fbbeebc9700 1 --2- 172.21.15.80:0/2484312318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbe815ed10 0x7fbbe815f100 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:28.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.768+0000 7fbbeebc9700 1 -- 172.21.15.80:0/2484312318 shutdown_connections 2019-11-28T11:28:28.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.768+0000 7fbbeebc9700 1 -- 172.21.15.80:0/2484312318 wait complete. 2019-11-28T11:28:28.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.768+0000 7fbbeebc9700 1 -- 172.21.15.80:0/2484312318 >> 172.21.15.80:0/2484312318 conn(0x7fbbe8061d20 msgr2=0x7fbbe80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:28.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.770+0000 7fbbeebc9700 1 Processor -- start 2019-11-28T11:28:28.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.770+0000 7fbbeebc9700 1 -- start start 2019-11-28T11:28:28.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.771+0000 7fbbeebc9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbbe810e970 0x7fbbe81087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:28.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.771+0000 7fbbeebc9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbbe8107e30 0x7fbbe8167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:28.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.771+0000 7fbbeebc9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe810c250 con 0x7fbbe8108cf0 2019-11-28T11:28:28.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.771+0000 7fbbeebc9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe810e430 con 0x7fbbe8107e30 2019-11-28T11:28:28.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.771+0000 7fbbeebc9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe8105860 con 0x7fbbe810e970 2019-11-28T11:28:28.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.771+0000 7fbbed967700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbbe8107e30 0x7fbbe8167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.771+0000 7fbbed967700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbbe8107e30 0x7fbbe8167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33292/0 (socket says 172.21.15.80:33292) 2019-11-28T11:28:28.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.771+0000 7fbbed967700 1 -- 172.21.15.80:0/2451137871 learned_addr learned my addr 172.21.15.80:0/2451137871 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:28.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.771+0000 7fbbed166700 1 --2- 172.21.15.80:0/2451137871 >> v2:172.21.15.174:3300/0 conn(0x7fbbe810e970 0x7fbbe81087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.772+0000 7fbbed967700 1 -- 172.21.15.80:0/2451137871 >> v2:172.21.15.174:3300/0 conn(0x7fbbe810e970 msgr2=0x7fbbe81087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.772+0000 7fbbed967700 1 --2- 172.21.15.80:0/2451137871 >> v2:172.21.15.174:3300/0 conn(0x7fbbe810e970 0x7fbbe81087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:28.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.772+0000 7fbbed967700 1 -- 172.21.15.80:0/2451137871 >> v1:172.21.15.174:6789/0 conn(0x7fbbe8108cf0 legacy=0x7fbbe8107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:28.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.772+0000 7fbbed967700 1 -- 172.21.15.80:0/2451137871 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe8105ef0 con 0x7fbbe8107e30 2019-11-28T11:28:28.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.772+0000 7fbbed967700 1 --2- 172.21.15.80:0/2451137871 >> v2:172.21.15.80:3300/0 conn(0x7fbbe8107e30 0x7fbbe8167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbbe0010430 tx=0x7fbbe00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.772+0000 7fbbed967700 1 --2- 172.21.15.80:0/2451137871 >> v2:172.21.15.80:3300/0 conn(0x7fbbe8107e30 0x7fbbe8167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbbe0010430 tx=0x7fbbe00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.772+0000 7fbbed967700 1 --2- 172.21.15.80:0/2451137871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbe8107e30 0x7fbbe8167d70 secure :-1 s=READY pgs=497 cs=0 l=1 rx=0x7fbbe0010430 tx=0x7fbbe00102b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:28.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.772+0000 7fbbed967700 1 --2- 172.21.15.80:0/2451137871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbe8107e30 0x7fbbe8167d70 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7fbbe0010430 tx=0x7fbbe00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.772+0000 7fbbe5ffb700 1 -- 172.21.15.80:0/2451137871 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbe000a750 con 0x7fbbe8107e30 2019-11-28T11:28:28.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.772+0000 7fbbed967700 1 --2- 172.21.15.80:0/2451137871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbe8107e30 0x7fbbe8167d70 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7fbbe0010430 tx=0x7fbbe00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.772+0000 7fbbed967700 1 --2- 172.21.15.80:0/2451137871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbe8107e30 0x7fbbe8167d70 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7fbbe0010430 tx=0x7fbbe00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.772+0000 7fbbe5ffb700 1 -- 172.21.15.80:0/2451137871 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe00095b0 con 0x7fbbe8107e30 2019-11-28T11:28:28.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.772+0000 7fbbeebc9700 1 -- 172.21.15.80:0/2451137871 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe8106270 con 0x7fbbe8107e30 2019-11-28T11:28:28.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.772+0000 7fbbe5ffb700 1 -- 172.21.15.80:0/2451137871 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbe0009c40 con 0x7fbbe8107e30 2019-11-28T11:28:28.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.772+0000 7fbbeebc9700 1 -- 172.21.15.80:0/2451137871 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe8105ef0 con 0x7fbbe8107e30 2019-11-28T11:28:28.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.772+0000 7fbbed967700 1 --2- 172.21.15.80:0/2451137871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbe8107e30 0x7fbbe8167d70 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7fbbe0010430 tx=0x7fbbe00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.773+0000 7fbbe5ffb700 1 -- 172.21.15.80:0/2451137871 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbbe000aa60 con 0x7fbbe8107e30 2019-11-28T11:28:28.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.773+0000 7fbbed967700 1 --2- 172.21.15.80:0/2451137871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbe8107e30 0x7fbbe8167d70 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7fbbe0010430 tx=0x7fbbe00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.773+0000 7fbbe5ffb700 1 --2- 172.21.15.80:0/2451137871 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbbcc018730 0x7fbbcc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:28.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.773+0000 7fbbe5ffb700 1 -- 172.21.15.80:0/2451137871 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fbbe0031d20 con 0x7fbbe8107e30 2019-11-28T11:28:28.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.773+0000 7fbbed166700 1 --2- 172.21.15.80:0/2451137871 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbbcc018730 0x7fbbcc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:28.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.773+0000 7fbbed166700 1 --2- 172.21.15.80:0/2451137871 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbbcc018730 0x7fbbcc01abc0 crc :-1 s=READY pgs=212 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:28.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.780+0000 7fbbeebc9700 1 -- 172.21.15.80:0/2451137871 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe8106270 con 0x7fbbe8107e30 2019-11-28T11:28:28.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.783+0000 7fbbed967700 1 --2- 172.21.15.80:0/2451137871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbe8107e30 0x7fbbe8167d70 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7fbbe0010430 tx=0x7fbbe00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:28.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.783+0000 7fbbe5ffb700 1 -- 172.21.15.80:0/2451137871 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbbe0000a70 con 0x7fbbe8107e30 2019-11-28T11:28:28.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:28.958+0000 7fbbeebc9700 1 -- 172.21.15.80:0/2451137871 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7fbbe8105ef0 con 0x7fbbe8107e30 2019-11-28T11:28:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.603+0000 7fbbed967700 1 --2- 172.21.15.80:0/2451137871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbe8107e30 0x7fbbe8167d70 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7fbbe0010430 tx=0x7fbbe00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.603+0000 7fbbe5ffb700 1 -- 172.21.15.80:0/2451137871 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v19) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbbe000aa60 con 0x7fbbe8107e30 2019-11-28T11:28:29.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.625+0000 7fbbeebc9700 1 -- 172.21.15.80:0/2451137871 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbbcc018730 msgr2=0x7fbbcc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:29.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.625+0000 7fbbeebc9700 1 --2- 172.21.15.80:0/2451137871 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbbcc018730 0x7fbbcc01abc0 crc :-1 s=READY pgs=212 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:29.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.625+0000 7fbbeebc9700 1 -- 172.21.15.80:0/2451137871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbe8107e30 msgr2=0x7fbbe8167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:29.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.625+0000 7fbbeebc9700 1 --2- 172.21.15.80:0/2451137871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbe8107e30 0x7fbbe8167d70 secure :-1 s=READY pgs=497 cs=0 l=1 rx=0x7fbbe0010430 tx=0x7fbbe00102b0).stop 2019-11-28T11:28:29.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.625+0000 7fbbeebc9700 1 -- 172.21.15.80:0/2451137871 shutdown_connections 2019-11-28T11:28:29.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.625+0000 7fbbeebc9700 1 --2- 172.21.15.80:0/2451137871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbe8107e30 0x7fbbe8167d70 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:29.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.625+0000 7fbbeebc9700 1 --2- 172.21.15.80:0/2451137871 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbbcc018730 0x7fbbcc01abc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:29.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.625+0000 7fbbeebc9700 1 --2- 172.21.15.80:0/2451137871 >> v2:172.21.15.174:3300/0 conn(0x7fbbe810e970 0x7fbbe81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:29.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.625+0000 7fbbeebc9700 1 -- 172.21.15.80:0/2451137871 shutdown_connections 2019-11-28T11:28:29.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.625+0000 7fbbeebc9700 1 -- 172.21.15.80:0/2451137871 wait complete. 2019-11-28T11:28:29.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.625+0000 7fbbeebc9700 1 -- 172.21.15.80:0/2451137871 >> 172.21.15.80:0/2451137871 conn(0x7fbbe815e2d0 msgr2=0x7fbbe8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:29.662 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:28:29.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.756+0000 7f4decc33700 1 Processor -- start 2019-11-28T11:28:29.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.756+0000 7f4decc33700 1 -- start start 2019-11-28T11:28:29.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.757+0000 7f4decc33700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de806c0a0 0x7f4de8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:29.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.757+0000 7f4decc33700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4de80734e0 0x7f4de8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:29.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.757+0000 7f4decc33700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de806db00 con 0x7f4de8072360 2019-11-28T11:28:29.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.757+0000 7f4decc33700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de806f330 con 0x7f4de80734e0 2019-11-28T11:28:29.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.757+0000 7f4decc33700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80706c0 con 0x7f4de806c0a0 2019-11-28T11:28:29.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.757+0000 7f4de6d9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de806c0a0 0x7f4de8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:29.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.757+0000 7f4de659c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4de80734e0 0x7f4de8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:29.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.757+0000 7f4de6d9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de806c0a0 0x7f4de8072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:35556/0 (socket says 172.21.15.80:35556) 2019-11-28T11:28:29.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.757+0000 7f4de6d9d700 1 -- 172.21.15.80:0/3894500767 learned_addr learned my addr 172.21.15.80:0/3894500767 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:29.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4de5d9b700 1 -- 172.21.15.80:0/3894500767 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254161919 0 0) 0x7f4de00009b0 con 0x7f4de8072360 2019-11-28T11:28:29.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4de6d9d700 1 -- 172.21.15.80:0/3894500767 >> v2:172.21.15.174:3300/0 conn(0x7f4de80734e0 msgr2=0x7f4de8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:29.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4de6d9d700 1 --2- 172.21.15.80:0/3894500767 >> v2:172.21.15.174:3300/0 conn(0x7f4de80734e0 0x7f4de8071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4de6d9d700 1 -- 172.21.15.80:0/3894500767 >> v1:172.21.15.174:6789/0 conn(0x7f4de8072360 legacy=0x7f4de806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4de6d9d700 1 -- 172.21.15.80:0/3894500767 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de8070a40 con 0x7f4de806c0a0 2019-11-28T11:28:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4de659c700 1 --2- 172.21.15.80:0/3894500767 >> v2:172.21.15.174:3300/0 conn(0x7f4de80734e0 0x7f4de8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4de6d9d700 1 --2- 172.21.15.80:0/3894500767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de806c0a0 0x7f4de8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4dd800f740 tx=0x7f4dd800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4de6d9d700 1 --2- 172.21.15.80:0/3894500767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de806c0a0 0x7f4de8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4dd800f740 tx=0x7f4dd800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4de6d9d700 1 --2- 172.21.15.80:0/3894500767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de806c0a0 0x7f4de8072fa0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f4dd800f740 tx=0x7f4dd800fae0).ready entity=mon.2 client_cookie=771b745c7a7cbaa8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4de6d9d700 1 --2- 172.21.15.80:0/3894500767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de806c0a0 0x7f4de8072fa0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f4dd800f740 tx=0x7f4dd800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:29.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4de5d9b700 1 -- 172.21.15.80:0/3894500767 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dd8000960 con 0x7f4de806c0a0 2019-11-28T11:28:29.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4de6d9d700 1 --2- 172.21.15.80:0/3894500767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de806c0a0 0x7f4de8072fa0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f4dd800f740 tx=0x7f4dd800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:29.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4de6d9d700 1 --2- 172.21.15.80:0/3894500767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de806c0a0 0x7f4de8072fa0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f4dd800f740 tx=0x7f4dd800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:29.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4de5d9b700 1 -- 172.21.15.80:0/3894500767 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd8000c90 con 0x7f4de806c0a0 2019-11-28T11:28:29.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4de5d9b700 1 -- 172.21.15.80:0/3894500767 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dd8007210 con 0x7f4de806c0a0 2019-11-28T11:28:29.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4decc33700 1 -- 172.21.15.80:0/3894500767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de806c0a0 msgr2=0x7f4de8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:29.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.758+0000 7f4decc33700 1 --2- 172.21.15.80:0/3894500767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de806c0a0 0x7f4de8072fa0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f4dd800f740 tx=0x7f4dd800fae0).stop 2019-11-28T11:28:29.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.759+0000 7f4decc33700 1 -- 172.21.15.80:0/3894500767 shutdown_connections 2019-11-28T11:28:29.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.759+0000 7f4decc33700 1 --2- 172.21.15.80:0/3894500767 >> v2:172.21.15.174:3300/0 conn(0x7f4de80734e0 0x7f4de8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:29.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.759+0000 7f4decc33700 1 --2- 172.21.15.80:0/3894500767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de806c0a0 0x7f4de8072fa0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:29.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.759+0000 7f4decc33700 1 -- 172.21.15.80:0/3894500767 shutdown_connections 2019-11-28T11:28:29.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.759+0000 7f4decc33700 1 -- 172.21.15.80:0/3894500767 wait complete. 2019-11-28T11:28:29.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.759+0000 7f4decc33700 1 -- 172.21.15.80:0/3894500767 >> 172.21.15.80:0/3894500767 conn(0x7f4de8061cf0 msgr2=0x7f4de8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:29.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.761+0000 7f4decc33700 1 Processor -- start 2019-11-28T11:28:29.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.761+0000 7f4decc33700 1 -- start start 2019-11-28T11:28:29.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.762+0000 7f4decc33700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de813e5f0 0x7f4de813e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:29.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.762+0000 7f4decc33700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4de810a070 0x7f4de810bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:29.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.762+0000 7f4decc33700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4de810a4e0 0x7f4de810c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:29.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.762+0000 7f4decc33700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de810d630 con 0x7f4de810a4e0 2019-11-28T11:28:29.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.762+0000 7f4decc33700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de810e060 con 0x7f4de810a070 2019-11-28T11:28:29.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.762+0000 7f4decc33700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de813f1c0 con 0x7f4de813e5f0 2019-11-28T11:28:29.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.762+0000 7f4de759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4de810a4e0 0x7f4de810c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:29.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.762+0000 7f4de759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4de810a4e0 0x7f4de810c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33306/0 (socket says 172.21.15.80:33306) 2019-11-28T11:28:29.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.762+0000 7f4de759e700 1 -- 172.21.15.80:0/3229298285 learned_addr learned my addr 172.21.15.80:0/3229298285 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:29.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4de6d9d700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de813e5f0 0x7f4de813e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:29.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4de659c700 1 --2- 172.21.15.80:0/3229298285 >> v2:172.21.15.174:3300/0 conn(0x7f4de810a070 0x7f4de810bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:29.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4de759e700 1 -- 172.21.15.80:0/3229298285 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de813e5f0 msgr2=0x7f4de813e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:29.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4de759e700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de813e5f0 0x7f4de813e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:29.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4de759e700 1 -- 172.21.15.80:0/3229298285 >> v2:172.21.15.174:3300/0 conn(0x7f4de810a070 msgr2=0x7f4de810bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:29.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4de759e700 1 --2- 172.21.15.80:0/3229298285 >> v2:172.21.15.174:3300/0 conn(0x7f4de810a070 0x7f4de810bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:29.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4de759e700 1 -- 172.21.15.80:0/3229298285 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de810e9c0 con 0x7f4de810a4e0 2019-11-28T11:28:29.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4de659c700 1 --2- 172.21.15.80:0/3229298285 >> v2:172.21.15.174:3300/0 conn(0x7f4de810a070 0x7f4de810bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:28:29.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4de759e700 1 --2- 172.21.15.80:0/3229298285 >> v2:172.21.15.80:3300/0 conn(0x7f4de810a4e0 0x7f4de810c2f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4de0010410 tx=0x7f4de0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:29.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4de759e700 1 --2- 172.21.15.80:0/3229298285 >> v2:172.21.15.80:3300/0 conn(0x7f4de810a4e0 0x7f4de810c2f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4de0010410 tx=0x7f4de0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:29.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4de759e700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de810a4e0 0x7f4de810c2f0 secure :-1 s=READY pgs=498 cs=0 l=1 rx=0x7f4de0010410 tx=0x7f4de0010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:29.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4de759e700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de810a4e0 0x7f4de810c2f0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7f4de0010410 tx=0x7f4de0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:29.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4ddf7fe700 1 -- 172.21.15.80:0/3229298285 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4de0000960 con 0x7f4de810a4e0 2019-11-28T11:28:29.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4de759e700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de810a4e0 0x7f4de810c2f0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7f4de0010410 tx=0x7f4de0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:29.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4de759e700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de810a4e0 0x7f4de810c2f0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7f4de0010410 tx=0x7f4de0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:29.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4ddf7fe700 1 -- 172.21.15.80:0/3229298285 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de0005580 con 0x7f4de810a4e0 2019-11-28T11:28:29.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4decc33700 1 -- 172.21.15.80:0/3229298285 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de810ed40 con 0x7f4de810a4e0 2019-11-28T11:28:29.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4ddf7fe700 1 -- 172.21.15.80:0/3229298285 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4de0005c10 con 0x7f4de810a4e0 2019-11-28T11:28:29.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4decc33700 1 -- 172.21.15.80:0/3229298285 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de810e9c0 con 0x7f4de810a4e0 2019-11-28T11:28:29.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.763+0000 7f4de759e700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de810a4e0 0x7f4de810c2f0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7f4de0010410 tx=0x7f4de0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:29.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.764+0000 7f4ddf7fe700 1 -- 172.21.15.80:0/3229298285 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4de0005770 con 0x7f4de810a4e0 2019-11-28T11:28:29.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.764+0000 7f4de759e700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de810a4e0 0x7f4de810c2f0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7f4de0010410 tx=0x7f4de0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:29.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.764+0000 7f4ddf7fe700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4dc0018730 0x7f4dc001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:29.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.764+0000 7f4ddf7fe700 1 -- 172.21.15.80:0/3229298285 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4de0031c30 con 0x7f4de810a4e0 2019-11-28T11:28:29.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.764+0000 7f4de6d9d700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4dc0018730 0x7f4dc001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:29.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.764+0000 7f4de6d9d700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4dc0018730 0x7f4dc001abe0 crc :-1 s=READY pgs=213 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:29.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.771+0000 7f4decc33700 1 -- 172.21.15.80:0/3229298285 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc4002e60 con 0x7f4de810a4e0 2019-11-28T11:28:29.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.775+0000 7f4de759e700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de810a4e0 0x7f4de810c2f0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7f4de0010410 tx=0x7f4de0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:29.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.775+0000 7f4ddf7fe700 1 -- 172.21.15.80:0/3229298285 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4de00075a0 con 0x7f4de810a4e0 2019-11-28T11:28:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.949+0000 7f4decc33700 1 -- 172.21.15.80:0/3229298285 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4dc4001d10 con 0x7f4de810a4e0 2019-11-28T11:28:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.950+0000 7f4de759e700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de810a4e0 0x7f4de810c2f0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7f4de0010410 tx=0x7f4de0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.950+0000 7f4ddf7fe700 1 -- 172.21.15.80:0/3229298285 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+1422 (secure 0 0 0) 0x7f4de0006110 con 0x7f4de810a4e0 2019-11-28T11:28:29.978 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 19 2019-11-28T11:28:29.978 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:29.979 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:27.955433+0000","modified":"2019-11-28T11:28:29.600529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2019-11-28T11:28:29.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.952+0000 7f4decc33700 1 -- 172.21.15.80:0/3229298285 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4dc0018730 msgr2=0x7f4dc001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:29.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.952+0000 7f4decc33700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4dc0018730 0x7f4dc001abe0 crc :-1 s=READY pgs=213 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:29.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.952+0000 7f4decc33700 1 -- 172.21.15.80:0/3229298285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de810a4e0 msgr2=0x7f4de810c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:29.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.952+0000 7f4decc33700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de810a4e0 0x7f4de810c2f0 secure :-1 s=READY pgs=498 cs=0 l=1 rx=0x7f4de0010410 tx=0x7f4de0010290).stop 2019-11-28T11:28:29.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.953+0000 7f4decc33700 1 -- 172.21.15.80:0/3229298285 shutdown_connections 2019-11-28T11:28:29.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.953+0000 7f4decc33700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4dc0018730 0x7f4dc001abe0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:29.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.953+0000 7f4decc33700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4de810a4e0 0x7f4de810c2f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:29.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.953+0000 7f4decc33700 1 --2- 172.21.15.80:0/3229298285 >> v2:172.21.15.174:3300/0 conn(0x7f4de810a070 0x7f4de810bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:29.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.953+0000 7f4decc33700 1 --2- 172.21.15.80:0/3229298285 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4de813e5f0 0x7f4de813e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:29.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.953+0000 7f4decc33700 1 -- 172.21.15.80:0/3229298285 shutdown_connections 2019-11-28T11:28:29.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.953+0000 7f4decc33700 1 -- 172.21.15.80:0/3229298285 wait complete. 2019-11-28T11:28:29.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:29.953+0000 7f4decc33700 1 -- 172.21.15.80:0/3229298285 >> 172.21.15.80:0/3229298285 conn(0x7f4de813d620 msgr2=0x7f4de813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:29.990 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:28:30.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.081+0000 7fe1b8d8c700 1 Processor -- start 2019-11-28T11:28:30.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.081+0000 7fe1b8d8c700 1 -- start start 2019-11-28T11:28:30.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b8d8c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe1b406c0a0 0x7fe1b4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:30.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b8d8c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe1b40734e0 0x7fe1b4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:30.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b8d8c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b406db00 con 0x7fe1b4072360 2019-11-28T11:28:30.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b8d8c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b406fd60 con 0x7fe1b40734e0 2019-11-28T11:28:30.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b8d8c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b4070030 con 0x7fe1b406c0a0 2019-11-28T11:28:30.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe1b40734e0 0x7fe1b4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:30.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe1b40734e0 0x7fe1b4071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33314/0 (socket says 172.21.15.80:33314) 2019-11-28T11:28:30.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b259c700 1 -- 172.21.15.80:0/3014745151 learned_addr learned my addr 172.21.15.80:0/3014745151 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:30.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b2d9d700 1 --2- 172.21.15.80:0/3014745151 >> v2:172.21.15.174:3300/0 conn(0x7fe1b406c0a0 0x7fe1b4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:30.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b259c700 1 -- 172.21.15.80:0/3014745151 >> v2:172.21.15.174:3300/0 conn(0x7fe1b406c0a0 msgr2=0x7fe1b4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:30.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b259c700 1 --2- 172.21.15.80:0/3014745151 >> v2:172.21.15.174:3300/0 conn(0x7fe1b406c0a0 0x7fe1b4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:30.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b259c700 1 -- 172.21.15.80:0/3014745151 >> v1:172.21.15.80:6789/0 conn(0x7fe1b4072360 legacy=0x7fe1b406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b259c700 1 -- 172.21.15.80:0/3014745151 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b40706c0 con 0x7fe1b40734e0 2019-11-28T11:28:30.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b259c700 1 --2- 172.21.15.80:0/3014745151 >> v2:172.21.15.80:3300/0 conn(0x7fe1b40734e0 0x7fe1b4071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe1a400f6c0 tx=0x7fe1a400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b259c700 1 --2- 172.21.15.80:0/3014745151 >> v2:172.21.15.80:3300/0 conn(0x7fe1b40734e0 0x7fe1b4071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe1a400f6c0 tx=0x7fe1a400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b259c700 1 --2- 172.21.15.80:0/3014745151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b40734e0 0x7fe1b4071e20 secure :-1 s=READY pgs=500 cs=0 l=1 rx=0x7fe1a400f6c0 tx=0x7fe1a400fa60).ready entity=mon.0 client_cookie=44e31b63a0ab2285 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:30.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b259c700 1 --2- 172.21.15.80:0/3014745151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b40734e0 0x7fe1b4071e20 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7fe1a400f6c0 tx=0x7fe1a400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b259c700 1 --2- 172.21.15.80:0/3014745151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b40734e0 0x7fe1b4071e20 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7fe1a400f6c0 tx=0x7fe1a400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b1d9b700 1 -- 172.21.15.80:0/3014745151 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1a4000960 con 0x7fe1b40734e0 2019-11-28T11:28:30.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b259c700 1 --2- 172.21.15.80:0/3014745151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b40734e0 0x7fe1b4071e20 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7fe1a400f6c0 tx=0x7fe1a400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b1d9b700 1 -- 172.21.15.80:0/3014745151 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a4000c90 con 0x7fe1b40734e0 2019-11-28T11:28:30.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b1d9b700 1 -- 172.21.15.80:0/3014745151 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1a40013a0 con 0x7fe1b40734e0 2019-11-28T11:28:30.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b8d8c700 1 -- 172.21.15.80:0/3014745151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b40734e0 msgr2=0x7fe1b4071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.083+0000 7fe1b8d8c700 1 --2- 172.21.15.80:0/3014745151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b40734e0 0x7fe1b4071e20 secure :-1 s=READY pgs=500 cs=0 l=1 rx=0x7fe1a400f6c0 tx=0x7fe1a400fa60).stop 2019-11-28T11:28:30.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.084+0000 7fe1b8d8c700 1 -- 172.21.15.80:0/3014745151 shutdown_connections 2019-11-28T11:28:30.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.084+0000 7fe1b8d8c700 1 --2- 172.21.15.80:0/3014745151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1b40734e0 0x7fe1b4071e20 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:30.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.084+0000 7fe1b8d8c700 1 --2- 172.21.15.80:0/3014745151 >> v2:172.21.15.174:3300/0 conn(0x7fe1b406c0a0 0x7fe1b4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:30.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.084+0000 7fe1b8d8c700 1 -- 172.21.15.80:0/3014745151 shutdown_connections 2019-11-28T11:28:30.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.084+0000 7fe1b8d8c700 1 -- 172.21.15.80:0/3014745151 wait complete. 2019-11-28T11:28:30.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.084+0000 7fe1b8d8c700 1 -- 172.21.15.80:0/3014745151 >> 172.21.15.80:0/3014745151 conn(0x7fe1b4061cf0 msgr2=0x7fe1b4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:30.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.087+0000 7fe1b8d8c700 1 Processor -- start 2019-11-28T11:28:30.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.087+0000 7fe1b8d8c700 1 -- start start 2019-11-28T11:28:30.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.087+0000 7fe1b8d8c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe1b413a780 0x7fe1b412d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:30.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.087+0000 7fe1b8d8c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1b412cb00 0x7fe1b4167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:30.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.087+0000 7fe1b8d8c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b4139a60 con 0x7fe1b412d9c0 2019-11-28T11:28:30.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.087+0000 7fe1b8d8c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b412a260 con 0x7fe1b413a780 2019-11-28T11:28:30.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.087+0000 7fe1b8d8c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b412a530 con 0x7fe1b412cb00 2019-11-28T11:28:30.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe1b412d9c0 0x7fe1b412c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60866/0 (socket says 172.21.15.80:60866) 2019-11-28T11:28:30.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b259c700 1 -- 172.21.15.80:0/1869668595 learned_addr learned my addr 172.21.15.80:0/1869668595 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:30.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b2d9d700 1 --2- 172.21.15.80:0/1869668595 >> v2:172.21.15.174:3300/0 conn(0x7fe1b413a780 0x7fe1b412d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:30.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b359e700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1b412cb00 0x7fe1b4167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:30.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1ab7fe700 1 -- 172.21.15.80:0/1869668595 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084440151 0 0) 0x7fe1a4007da0 con 0x7fe1b412d9c0 2019-11-28T11:28:30.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1ab7fe700 1 -- 172.21.15.80:0/1869668595 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe18c002e80 con 0x7fe1b412d9c0 2019-11-28T11:28:30.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b359e700 1 -- 172.21.15.80:0/1869668595 >> v2:172.21.15.174:3300/0 conn(0x7fe1b413a780 msgr2=0x7fe1b412d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b359e700 1 --2- 172.21.15.80:0/1869668595 >> v2:172.21.15.174:3300/0 conn(0x7fe1b413a780 0x7fe1b412d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:30.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b359e700 1 -- 172.21.15.80:0/1869668595 >> v1:172.21.15.80:6789/0 conn(0x7fe1b412d9c0 legacy=0x7fe1b412c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b359e700 1 -- 172.21.15.80:0/1869668595 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b412abc0 con 0x7fe1b412cb00 2019-11-28T11:28:30.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b2d9d700 1 --2- 172.21.15.80:0/1869668595 >> v2:172.21.15.174:3300/0 conn(0x7fe1b413a780 0x7fe1b412d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:30.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b359e700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1b412cb00 0x7fe1b4167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1ac0103a0 tx=0x7fe1ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b359e700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1b412cb00 0x7fe1b4167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1ac0103a0 tx=0x7fe1ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b359e700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1b412cb00 0x7fe1b4167d70 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fe1ac0103a0 tx=0x7fe1ac010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:30.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b359e700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1b412cb00 0x7fe1b4167d70 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe1ac0103a0 tx=0x7fe1ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1ab7fe700 1 -- 172.21.15.80:0/1869668595 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1ac000960 con 0x7fe1b412cb00 2019-11-28T11:28:30.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b359e700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1b412cb00 0x7fe1b4167d70 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe1ac0103a0 tx=0x7fe1ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b359e700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1b412cb00 0x7fe1b4167d70 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe1ac0103a0 tx=0x7fe1ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1ab7fe700 1 -- 172.21.15.80:0/1869668595 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac009980 con 0x7fe1b412cb00 2019-11-28T11:28:30.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b8d8c700 1 -- 172.21.15.80:0/1869668595 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b412af40 con 0x7fe1b412cb00 2019-11-28T11:28:30.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1ab7fe700 1 -- 172.21.15.80:0/1869668595 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1ac00a050 con 0x7fe1b412cb00 2019-11-28T11:28:30.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.088+0000 7fe1b8d8c700 1 -- 172.21.15.80:0/1869668595 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b412abc0 con 0x7fe1b412cb00 2019-11-28T11:28:30.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.089+0000 7fe1b359e700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1b412cb00 0x7fe1b4167d70 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe1ac0103a0 tx=0x7fe1ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.089+0000 7fe1ab7fe700 1 -- 172.21.15.80:0/1869668595 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe1ac009b70 con 0x7fe1b412cb00 2019-11-28T11:28:30.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.089+0000 7fe1b359e700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1b412cb00 0x7fe1b4167d70 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe1ac0103a0 tx=0x7fe1ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.089+0000 7fe1ab7fe700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe18c018770 0x7fe18c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:30.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.089+0000 7fe1ab7fe700 1 -- 172.21.15.80:0/1869668595 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe1ac031a00 con 0x7fe1b412cb00 2019-11-28T11:28:30.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.089+0000 7fe1b2d9d700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe18c018770 0x7fe18c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:30.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.089+0000 7fe1b2d9d700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe18c018770 0x7fe18c01abe0 crc :-1 s=READY pgs=214 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:30.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.097+0000 7fe1b8d8c700 1 -- 172.21.15.80:0/1869668595 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b412af40 con 0x7fe1b412cb00 2019-11-28T11:28:30.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.101+0000 7fe1b359e700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1b412cb00 0x7fe1b4167d70 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe1ac0103a0 tx=0x7fe1ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.101+0000 7fe1ab7fe700 1 -- 172.21.15.80:0/1869668595 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe1ac009580 con 0x7fe1b412cb00 2019-11-28T11:28:30.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.281+0000 7fe1b8d8c700 1 -- 172.21.15.80:0/1869668595 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1b412abc0 con 0x7fe1b412cb00 2019-11-28T11:28:30.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.282+0000 7fe1b359e700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1b412cb00 0x7fe1b4167d70 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe1ac0103a0 tx=0x7fe1ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.282+0000 7fe1ab7fe700 1 -- 172.21.15.80:0/1869668595 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+14857 (secure 0 0 0) 0x7fe1ac009b70 con 0x7fe1b412cb00 2019-11-28T11:28:30.310 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:30.310 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":47,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:28:29.965726+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:28:26.282940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2019-11-28T11:28:26.978374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:28:30.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.284+0000 7fe1b8d8c700 1 -- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe18c018770 msgr2=0x7fe18c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.284+0000 7fe1b8d8c700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe18c018770 0x7fe18c01abe0 crc :-1 s=READY pgs=214 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:30.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.284+0000 7fe1b8d8c700 1 -- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1b412cb00 msgr2=0x7fe1b4167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.284+0000 7fe1b8d8c700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1b412cb00 0x7fe1b4167d70 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fe1ac0103a0 tx=0x7fe1ac010740).stop 2019-11-28T11:28:30.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.284+0000 7fe1b8d8c700 1 -- 172.21.15.80:0/1869668595 shutdown_connections 2019-11-28T11:28:30.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.284+0000 7fe1b8d8c700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe18c018770 0x7fe18c01abe0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:30.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.284+0000 7fe1b8d8c700 1 --2- 172.21.15.80:0/1869668595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1b412cb00 0x7fe1b4167d70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:30.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.284+0000 7fe1b8d8c700 1 --2- 172.21.15.80:0/1869668595 >> v2:172.21.15.174:3300/0 conn(0x7fe1b413a780 0x7fe1b412d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:30.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.284+0000 7fe1b8d8c700 1 -- 172.21.15.80:0/1869668595 shutdown_connections 2019-11-28T11:28:30.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.284+0000 7fe1b8d8c700 1 -- 172.21.15.80:0/1869668595 wait complete. 2019-11-28T11:28:30.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.284+0000 7fe1b8d8c700 1 -- 172.21.15.80:0/1869668595 >> 172.21.15.80:0/1869668595 conn(0x7fe1b4127dc0 msgr2=0x7fe1b4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:30.322 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:28:30.322 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:28:30.323 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:28:30.323 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:28:30.323 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:28:30.323 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:28:30.327 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:28:30.328 DEBUG:teuthology.parallel:result is None 2019-11-28T11:28:30.328 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:28:30.329 DEBUG:teuthology.parallel:result is None 2019-11-28T11:28:30.329 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:28:30.329 DEBUG:teuthology.parallel:result is None 2019-11-28T11:28:30.330 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:28:30.413 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:28:30.425 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:28:30.425 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:28:30.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.439+0000 7ff1f1821700 1 Processor -- start 2019-11-28T11:28:30.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.439+0000 7ff1f1821700 1 -- start start 2019-11-28T11:28:30.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.440+0000 7ff1f1821700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec15ed10 0x7ff1ec15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:30.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.440+0000 7ff1f1821700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec06db60 con 0x7ff1ec0734b0 2019-11-28T11:28:30.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.440+0000 7ff1f1821700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec06e060 con 0x7ff1ec073020 2019-11-28T11:28:30.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.440+0000 7ff1f1821700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec06f3d0 con 0x7ff1ec15ed10 2019-11-28T11:28:30.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.440+0000 7ff1ebfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff1ec0734b0 0x7ff1ec0726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60898/0 (socket says 172.21.15.80:60898) 2019-11-28T11:28:30.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.440+0000 7ff1ebfff700 1 -- 172.21.15.80:0/878785114 learned_addr learned my addr 172.21.15.80:0/878785114 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:30.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/878785114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec15ed10 0x7ff1ec15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:30.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1ea7fc700 1 -- 172.21.15.80:0/878785114 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900189828 0 0) 0x7ff1e40014d0 con 0x7ff1ec0734b0 2019-11-28T11:28:30.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1ea7fc700 1 -- 172.21.15.80:0/878785114 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1cc002e80 con 0x7ff1ec0734b0 2019-11-28T11:28:30.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1ea7fc700 1 -- 172.21.15.80:0/878785114 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523534983 0 0) 0x7ff1d4001030 con 0x7ff1ec073020 2019-11-28T11:28:30.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1ea7fc700 1 -- 172.21.15.80:0/878785114 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1cc004170 con 0x7ff1ec073020 2019-11-28T11:28:30.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1eb7fe700 1 -- 172.21.15.80:0/878785114 >> v1:172.21.15.174:6789/0 conn(0x7ff1ec073020 legacy=0x7ff1ec071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1eb7fe700 1 -- 172.21.15.80:0/878785114 >> v1:172.21.15.80:6789/0 conn(0x7ff1ec0734b0 legacy=0x7ff1ec0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1eb7fe700 1 -- 172.21.15.80:0/878785114 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec070760 con 0x7ff1ec15ed10 2019-11-28T11:28:30.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/878785114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec15ed10 0x7ff1ec15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff1dc00af50 tx=0x7ff1dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/878785114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec15ed10 0x7ff1ec15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff1dc00af50 tx=0x7ff1dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/878785114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec15ed10 0x7ff1ec15f100 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7ff1dc00af50 tx=0x7ff1dc00b760).ready entity=mon.2 client_cookie=8493654e3f748614 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:30.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/878785114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec15ed10 0x7ff1ec15f100 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7ff1dc00af50 tx=0x7ff1dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1ea7fc700 1 -- 172.21.15.80:0/878785114 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1dc000960 con 0x7ff1ec15ed10 2019-11-28T11:28:30.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/878785114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec15ed10 0x7ff1ec15f100 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7ff1dc00af50 tx=0x7ff1dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/878785114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec15ed10 0x7ff1ec15f100 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7ff1dc00af50 tx=0x7ff1dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1ea7fc700 1 -- 172.21.15.80:0/878785114 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc009860 con 0x7ff1ec15ed10 2019-11-28T11:28:30.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1ea7fc700 1 -- 172.21.15.80:0/878785114 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1dc009f30 con 0x7ff1ec15ed10 2019-11-28T11:28:30.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1f1821700 1 -- 172.21.15.80:0/878785114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec15ed10 msgr2=0x7ff1ec15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.441+0000 7ff1f1821700 1 --2- 172.21.15.80:0/878785114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec15ed10 0x7ff1ec15f100 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7ff1dc00af50 tx=0x7ff1dc00b760).stop 2019-11-28T11:28:30.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.442+0000 7ff1f1821700 1 -- 172.21.15.80:0/878785114 shutdown_connections 2019-11-28T11:28:30.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.442+0000 7ff1f1821700 1 --2- 172.21.15.80:0/878785114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec15ed10 0x7ff1ec15f100 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.442+0000 7ff1f1821700 1 -- 172.21.15.80:0/878785114 shutdown_connections 2019-11-28T11:28:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.442+0000 7ff1f1821700 1 -- 172.21.15.80:0/878785114 wait complete. 2019-11-28T11:28:30.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.442+0000 7ff1f1821700 1 -- 172.21.15.80:0/878785114 >> 172.21.15.80:0/878785114 conn(0x7ff1ec061d40 msgr2=0x7ff1ec0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:30.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.444+0000 7ff1f1821700 1 Processor -- start 2019-11-28T11:28:30.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.445+0000 7ff1f1821700 1 -- start start 2019-11-28T11:28:30.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.445+0000 7ff1f1821700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1ec1273e0 0x7ff1ec101e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:30.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.445+0000 7ff1f1821700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff1ec114e00 0x7ff1ec12ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:30.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.445+0000 7ff1f1821700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec115830 con 0x7ff1ec114970 2019-11-28T11:28:30.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.445+0000 7ff1f1821700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ec137f90 con 0x7ff1ec1273e0 2019-11-28T11:28:30.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.445+0000 7ff1f1821700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ec113e00 con 0x7ff1ec114e00 2019-11-28T11:28:30.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1eb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1ec1273e0 0x7ff1ec101e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:30.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1eb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1ec1273e0 0x7ff1ec101e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33354/0 (socket says 172.21.15.80:33354) 2019-11-28T11:28:30.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1eb7fe700 1 -- 172.21.15.80:0/1488116760 learned_addr learned my addr 172.21.15.80:0/1488116760 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:30.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1ebfff700 1 --2- 172.21.15.80:0/1488116760 >> v2:172.21.15.174:3300/0 conn(0x7ff1ec114e00 0x7ff1ec12ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:30.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1eb7fe700 1 -- 172.21.15.80:0/1488116760 >> v2:172.21.15.174:3300/0 conn(0x7ff1ec114e00 msgr2=0x7ff1ec12ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/1488116760 >> v2:172.21.15.174:3300/0 conn(0x7ff1ec114e00 0x7ff1ec12ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:30.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1eb7fe700 1 -- 172.21.15.80:0/1488116760 >> v1:172.21.15.174:6789/0 conn(0x7ff1ec114970 legacy=0x7ff1ec111e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1eb7fe700 1 -- 172.21.15.80:0/1488116760 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec138620 con 0x7ff1ec1273e0 2019-11-28T11:28:30.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1e3fff700 1 -- 172.21.15.80:0/1488116760 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520466259 0 0) 0x7ff1d4000e20 con 0x7ff1ec114970 2019-11-28T11:28:30.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/1488116760 >> v2:172.21.15.80:3300/0 conn(0x7ff1ec1273e0 0x7ff1ec101e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff1dc010470 tx=0x7ff1dc0102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/1488116760 >> v2:172.21.15.80:3300/0 conn(0x7ff1ec1273e0 0x7ff1ec101e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff1dc010470 tx=0x7ff1dc0102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/1488116760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec1273e0 0x7ff1ec101e80 secure :-1 s=READY pgs=508 cs=0 l=1 rx=0x7ff1dc010470 tx=0x7ff1dc0102a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:30.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/1488116760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec1273e0 0x7ff1ec101e80 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7ff1dc010470 tx=0x7ff1dc0102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1e3fff700 1 -- 172.21.15.80:0/1488116760 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1dc000940 con 0x7ff1ec1273e0 2019-11-28T11:28:30.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/1488116760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec1273e0 0x7ff1ec101e80 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7ff1dc010470 tx=0x7ff1dc0102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/1488116760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec1273e0 0x7ff1ec101e80 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7ff1dc010470 tx=0x7ff1dc0102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1e3fff700 1 -- 172.21.15.80:0/1488116760 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc009980 con 0x7ff1ec1273e0 2019-11-28T11:28:30.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1f1821700 1 -- 172.21.15.80:0/1488116760 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ec1389a0 con 0x7ff1ec1273e0 2019-11-28T11:28:30.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1e3fff700 1 -- 172.21.15.80:0/1488116760 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1dc009b70 con 0x7ff1ec1273e0 2019-11-28T11:28:30.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.446+0000 7ff1f1821700 1 -- 172.21.15.80:0/1488116760 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ec138620 con 0x7ff1ec1273e0 2019-11-28T11:28:30.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.447+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/1488116760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec1273e0 0x7ff1ec101e80 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7ff1dc010470 tx=0x7ff1dc0102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.447+0000 7ff1e3fff700 1 -- 172.21.15.80:0/1488116760 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff1dc009790 con 0x7ff1ec1273e0 2019-11-28T11:28:30.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.447+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/1488116760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec1273e0 0x7ff1ec101e80 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7ff1dc010470 tx=0x7ff1dc0102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.447+0000 7ff1e3fff700 1 --2- 172.21.15.80:0/1488116760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1c4018740 0x7ff1c401abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:30.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.447+0000 7ff1e3fff700 1 -- 172.21.15.80:0/1488116760 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff1dc035e80 con 0x7ff1ec1273e0 2019-11-28T11:28:30.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.448+0000 7ff1eaffd700 1 --2- 172.21.15.80:0/1488116760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1c4018740 0x7ff1c401abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:30.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.448+0000 7ff1eaffd700 1 --2- 172.21.15.80:0/1488116760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1c4018740 0x7ff1c401abd0 crc :-1 s=READY pgs=215 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:30.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.455+0000 7ff1f1821700 1 -- 172.21.15.80:0/1488116760 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ec1389a0 con 0x7ff1ec1273e0 2019-11-28T11:28:30.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.458+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/1488116760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec1273e0 0x7ff1ec101e80 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7ff1dc010470 tx=0x7ff1dc0102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.458+0000 7ff1e3fff700 1 -- 172.21.15.80:0/1488116760 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff1dc009580 con 0x7ff1ec1273e0 2019-11-28T11:28:30.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.629+0000 7ff1f1821700 1 -- 172.21.15.80:0/1488116760 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff1ec138620 con 0x7ff1ec1273e0 2019-11-28T11:28:30.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.631+0000 7ff1eb7fe700 1 --2- 172.21.15.80:0/1488116760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec1273e0 0x7ff1ec101e80 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7ff1dc010470 tx=0x7ff1dc0102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.631+0000 7ff1e3fff700 1 -- 172.21.15.80:0/1488116760 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff1dc0098c0 con 0x7ff1ec1273e0 2019-11-28T11:28:30.659 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:28:30.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.634+0000 7ff1f1821700 1 -- 172.21.15.80:0/1488116760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1c4018740 msgr2=0x7ff1c401abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.634+0000 7ff1f1821700 1 --2- 172.21.15.80:0/1488116760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1c4018740 0x7ff1c401abd0 crc :-1 s=READY pgs=215 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:30.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.634+0000 7ff1f1821700 1 -- 172.21.15.80:0/1488116760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec1273e0 msgr2=0x7ff1ec101e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.634+0000 7ff1f1821700 1 --2- 172.21.15.80:0/1488116760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec1273e0 0x7ff1ec101e80 secure :-1 s=READY pgs=508 cs=0 l=1 rx=0x7ff1dc010470 tx=0x7ff1dc0102a0).stop 2019-11-28T11:28:30.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.634+0000 7ff1f1821700 1 -- 172.21.15.80:0/1488116760 shutdown_connections 2019-11-28T11:28:30.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.634+0000 7ff1f1821700 1 --2- 172.21.15.80:0/1488116760 >> v2:172.21.15.174:3300/0 conn(0x7ff1ec114e00 0x7ff1ec12ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:30.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.634+0000 7ff1f1821700 1 --2- 172.21.15.80:0/1488116760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1c4018740 0x7ff1c401abd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:30.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.634+0000 7ff1f1821700 1 --2- 172.21.15.80:0/1488116760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec1273e0 0x7ff1ec101e80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:30.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.634+0000 7ff1f1821700 1 -- 172.21.15.80:0/1488116760 shutdown_connections 2019-11-28T11:28:30.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.634+0000 7ff1f1821700 1 -- 172.21.15.80:0/1488116760 wait complete. 2019-11-28T11:28:30.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.634+0000 7ff1f1821700 1 -- 172.21.15.80:0/1488116760 >> 172.21.15.80:0/1488116760 conn(0x7ff1ec166610 msgr2=0x7ff1ec1473d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:30.672 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:28:30.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.775+0000 7f1e229d0700 1 Processor -- start 2019-11-28T11:28:30.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.775+0000 7f1e229d0700 1 -- start start 2019-11-28T11:28:30.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.776+0000 7f1e229d0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e1c15ed10 0x7f1e1c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:30.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.776+0000 7f1e229d0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c06db60 con 0x7f1e1c073020 2019-11-28T11:28:30.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.776+0000 7f1e229d0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c06e060 con 0x7f1e1c0734b0 2019-11-28T11:28:30.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.776+0000 7f1e229d0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c06fe00 con 0x7f1e1c15ed10 2019-11-28T11:28:30.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.776+0000 7f1e20f6d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e1c15ed10 0x7f1e1c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:30.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.776+0000 7f1e1bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1e1c073020 0x7f1e1c071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60910/0 (socket says 172.21.15.80:60910) 2019-11-28T11:28:30.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.776+0000 7f1e1bfff700 1 -- 172.21.15.80:0/3572050410 learned_addr learned my addr 172.21.15.80:0/3572050410 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:30.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.776+0000 7f1e20f6d700 1 -- 172.21.15.80:0/3572050410 >> v1:172.21.15.174:6789/0 conn(0x7f1e1c0734b0 legacy=0x7f1e1c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.776+0000 7f1e20f6d700 1 -- 172.21.15.80:0/3572050410 >> v1:172.21.15.80:6789/0 conn(0x7f1e1c073020 legacy=0x7f1e1c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.776+0000 7f1e20f6d700 1 -- 172.21.15.80:0/3572050410 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c070760 con 0x7f1e1c15ed10 2019-11-28T11:28:30.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.776+0000 7f1e1b7fe700 1 -- 172.21.15.80:0/3572050410 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57932780 0 0) 0x7f1e0c0014d0 con 0x7f1e1c073020 2019-11-28T11:28:30.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.777+0000 7f1e20f6d700 1 --2- 172.21.15.80:0/3572050410 >> v2:172.21.15.80:3300/0 conn(0x7f1e1c15ed10 0x7f1e1c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1e0400af50 tx=0x7f1e0400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.777+0000 7f1e20f6d700 1 --2- 172.21.15.80:0/3572050410 >> v2:172.21.15.80:3300/0 conn(0x7f1e1c15ed10 0x7f1e1c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1e0400af50 tx=0x7f1e0400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.777+0000 7f1e20f6d700 1 --2- 172.21.15.80:0/3572050410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c15ed10 0x7f1e1c15f100 secure :-1 s=READY pgs=510 cs=0 l=1 rx=0x7f1e0400af50 tx=0x7f1e0400b760).ready entity=mon.0 client_cookie=8a89dddd9864d42d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:30.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.777+0000 7f1e20f6d700 1 --2- 172.21.15.80:0/3572050410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c15ed10 0x7f1e1c15f100 secure :-1 s=THROTTLE_DONE pgs=510 cs=0 l=1 rx=0x7f1e0400af50 tx=0x7f1e0400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.777+0000 7f1e1b7fe700 1 -- 172.21.15.80:0/3572050410 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e04007210 con 0x7f1e1c15ed10 2019-11-28T11:28:30.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.777+0000 7f1e20f6d700 1 --2- 172.21.15.80:0/3572050410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c15ed10 0x7f1e1c15f100 secure :-1 s=THROTTLE_DONE pgs=510 cs=0 l=1 rx=0x7f1e0400af50 tx=0x7f1e0400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.777+0000 7f1e1b7fe700 1 -- 172.21.15.80:0/3572050410 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e040099b0 con 0x7f1e1c15ed10 2019-11-28T11:28:30.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.777+0000 7f1e20f6d700 1 --2- 172.21.15.80:0/3572050410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c15ed10 0x7f1e1c15f100 secure :-1 s=THROTTLE_DONE pgs=510 cs=0 l=1 rx=0x7f1e0400af50 tx=0x7f1e0400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.777+0000 7f1e1b7fe700 1 -- 172.21.15.80:0/3572050410 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e04009ba0 con 0x7f1e1c15ed10 2019-11-28T11:28:30.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.777+0000 7f1e229d0700 1 -- 172.21.15.80:0/3572050410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c15ed10 msgr2=0x7f1e1c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.777+0000 7f1e229d0700 1 --2- 172.21.15.80:0/3572050410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c15ed10 0x7f1e1c15f100 secure :-1 s=READY pgs=510 cs=0 l=1 rx=0x7f1e0400af50 tx=0x7f1e0400b760).stop 2019-11-28T11:28:30.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.777+0000 7f1e229d0700 1 -- 172.21.15.80:0/3572050410 shutdown_connections 2019-11-28T11:28:30.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.777+0000 7f1e229d0700 1 --2- 172.21.15.80:0/3572050410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c15ed10 0x7f1e1c15f100 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:30.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.778+0000 7f1e229d0700 1 -- 172.21.15.80:0/3572050410 shutdown_connections 2019-11-28T11:28:30.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.778+0000 7f1e229d0700 1 -- 172.21.15.80:0/3572050410 wait complete. 2019-11-28T11:28:30.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.778+0000 7f1e229d0700 1 -- 172.21.15.80:0/3572050410 >> 172.21.15.80:0/3572050410 conn(0x7f1e1c061d40 msgr2=0x7f1e1c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:30.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.780+0000 7f1e229d0700 1 Processor -- start 2019-11-28T11:28:30.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.780+0000 7f1e229d0700 1 -- start start 2019-11-28T11:28:30.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e229d0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e1c134610 0x7f1e1c134aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:30.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e229d0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1e1c134fe0 0x7f1e1c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:30.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e229d0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c135410 con 0x7f1e1c152750 2019-11-28T11:28:30.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e229d0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c132570 con 0x7f1e1c134fe0 2019-11-28T11:28:30.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e229d0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c132840 con 0x7f1e1c134610 2019-11-28T11:28:30.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e20f6d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1e1c152750 0x7f1e1c135790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60914/0 (socket says 172.21.15.80:60914) 2019-11-28T11:28:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e20f6d700 1 -- 172.21.15.80:0/803083900 learned_addr learned my addr 172.21.15.80:0/803083900 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e1bfff700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e1c134610 0x7f1e1c134aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e2176e700 1 --2- 172.21.15.80:0/803083900 >> v2:172.21.15.174:3300/0 conn(0x7f1e1c134fe0 0x7f1e1c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e197fa700 1 -- 172.21.15.80:0/803083900 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115005251 0 0) 0x7f1e0400abb0 con 0x7f1e1c152750 2019-11-28T11:28:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e197fa700 1 -- 172.21.15.80:0/803083900 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e00002e80 con 0x7f1e1c152750 2019-11-28T11:28:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e1bfff700 1 -- 172.21.15.80:0/803083900 >> v2:172.21.15.174:3300/0 conn(0x7f1e1c134fe0 msgr2=0x7f1e1c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e197fa700 1 -- 172.21.15.80:0/803083900 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3015663961 0 0) 0x7f1e0400abb0 con 0x7f1e1c152750 2019-11-28T11:28:30.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e1bfff700 1 --2- 172.21.15.80:0/803083900 >> v2:172.21.15.174:3300/0 conn(0x7f1e1c134fe0 0x7f1e1c167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:30.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e1bfff700 1 -- 172.21.15.80:0/803083900 >> v1:172.21.15.80:6789/0 conn(0x7f1e1c152750 legacy=0x7f1e1c135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:30.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e1bfff700 1 -- 172.21.15.80:0/803083900 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c132ed0 con 0x7f1e1c134610 2019-11-28T11:28:30.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e2176e700 1 --2- 172.21.15.80:0/803083900 >> v2:172.21.15.174:3300/0 conn(0x7f1e1c134fe0 0x7f1e1c167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:30.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.781+0000 7f1e1bfff700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e1c134610 0x7f1e1c134aa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1e0c0106f0 tx=0x7f1e0c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.782+0000 7f1e1bfff700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e1c134610 0x7f1e1c134aa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1e0c0106f0 tx=0x7f1e0c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.782+0000 7f1e1bfff700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e1c134610 0x7f1e1c134aa0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f1e0c0106f0 tx=0x7f1e0c010a90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:30.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.782+0000 7f1e1bfff700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e1c134610 0x7f1e1c134aa0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f1e0c0106f0 tx=0x7f1e0c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.782+0000 7f1e197fa700 1 -- 172.21.15.80:0/803083900 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e0c001270 con 0x7f1e1c134610 2019-11-28T11:28:30.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.782+0000 7f1e1bfff700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e1c134610 0x7f1e1c134aa0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f1e0c0106f0 tx=0x7f1e0c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.782+0000 7f1e1bfff700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e1c134610 0x7f1e1c134aa0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f1e0c0106f0 tx=0x7f1e0c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.782+0000 7f1e197fa700 1 -- 172.21.15.80:0/803083900 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c0045c0 con 0x7f1e1c134610 2019-11-28T11:28:30.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.782+0000 7f1e197fa700 1 -- 172.21.15.80:0/803083900 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e0c001580 con 0x7f1e1c134610 2019-11-28T11:28:30.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.782+0000 7f1e229d0700 1 -- 172.21.15.80:0/803083900 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c133250 con 0x7f1e1c134610 2019-11-28T11:28:30.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.782+0000 7f1e229d0700 1 -- 172.21.15.80:0/803083900 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c132ed0 con 0x7f1e1c134610 2019-11-28T11:28:30.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.782+0000 7f1e1bfff700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e1c134610 0x7f1e1c134aa0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f1e0c0106f0 tx=0x7f1e0c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.783+0000 7f1e197fa700 1 -- 172.21.15.80:0/803083900 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1e0c0047b0 con 0x7f1e1c134610 2019-11-28T11:28:30.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.783+0000 7f1e1bfff700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e1c134610 0x7f1e1c134aa0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f1e0c0106f0 tx=0x7f1e0c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.783+0000 7f1e197fa700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e00018780 0x7f1e0001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:30.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.783+0000 7f1e197fa700 1 -- 172.21.15.80:0/803083900 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1e0c031d90 con 0x7f1e1c134610 2019-11-28T11:28:30.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.783+0000 7f1e20f6d700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e00018780 0x7f1e0001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:30.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.783+0000 7f1e20f6d700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e00018780 0x7f1e0001abf0 crc :-1 s=READY pgs=216 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:30.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.790+0000 7f1e229d0700 1 -- 172.21.15.80:0/803083900 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c133250 con 0x7f1e1c134610 2019-11-28T11:28:30.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.794+0000 7f1e1bfff700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e1c134610 0x7f1e1c134aa0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f1e0c0106f0 tx=0x7f1e0c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:30.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.794+0000 7f1e197fa700 1 -- 172.21.15.80:0/803083900 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1e0c001010 con 0x7f1e1c134610 2019-11-28T11:28:30.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.965+0000 7f1e229d0700 1 -- 172.21.15.80:0/803083900 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1e1c132ed0 con 0x7f1e1c134610 2019-11-28T11:28:31.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.973+0000 7f1e1bfff700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e1c134610 0x7f1e1c134aa0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f1e0c0106f0 tx=0x7f1e0c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.973+0000 7f1e197fa700 1 -- 172.21.15.80:0/803083900 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1e0c004910 con 0x7f1e1c134610 2019-11-28T11:28:31.066 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:28:31.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.983+0000 7f1e229d0700 1 -- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e00018780 msgr2=0x7f1e0001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.983+0000 7f1e229d0700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e00018780 0x7f1e0001abf0 crc :-1 s=READY pgs=216 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.983+0000 7f1e229d0700 1 -- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e1c134610 msgr2=0x7f1e1c134aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.983+0000 7f1e229d0700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e1c134610 0x7f1e1c134aa0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f1e0c0106f0 tx=0x7f1e0c010a90).stop 2019-11-28T11:28:31.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.983+0000 7f1e229d0700 1 -- 172.21.15.80:0/803083900 shutdown_connections 2019-11-28T11:28:31.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.983+0000 7f1e229d0700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e00018780 0x7f1e0001abf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.983+0000 7f1e229d0700 1 --2- 172.21.15.80:0/803083900 >> v2:172.21.15.174:3300/0 conn(0x7f1e1c134fe0 0x7f1e1c167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.983+0000 7f1e229d0700 1 --2- 172.21.15.80:0/803083900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e1c134610 0x7f1e1c134aa0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.983+0000 7f1e229d0700 1 -- 172.21.15.80:0/803083900 shutdown_connections 2019-11-28T11:28:31.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.983+0000 7f1e229d0700 1 -- 172.21.15.80:0/803083900 wait complete. 2019-11-28T11:28:31.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:30.983+0000 7f1e229d0700 1 -- 172.21.15.80:0/803083900 >> 172.21.15.80:0/803083900 conn(0x7f1e1c1476e0 msgr2=0x7f1e1c12fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:31.069 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:28:31.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.196+0000 7fda4b3c7700 1 Processor -- start 2019-11-28T11:28:31.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.196+0000 7fda4b3c7700 1 -- start start 2019-11-28T11:28:31.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.197+0000 7fda4b3c7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda4415f100 0x7fda4406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:31.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.197+0000 7fda4b3c7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4406db60 con 0x7fda4406c2f0 2019-11-28T11:28:31.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.197+0000 7fda4b3c7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4406e060 con 0x7fda4415ed10 2019-11-28T11:28:31.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.197+0000 7fda4b3c7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4406fe00 con 0x7fda4415f100 2019-11-28T11:28:31.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.197+0000 7fda4a165700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fda4406c2f0 0x7fda4406c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60924/0 (socket says 172.21.15.80:60924) 2019-11-28T11:28:31.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.197+0000 7fda4a165700 1 -- 172.21.15.80:0/3865061466 learned_addr learned my addr 172.21.15.80:0/3865061466 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:31.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.197+0000 7fda49163700 1 --2- 172.21.15.80:0/3865061466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda4415f100 0x7fda4406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:31.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.197+0000 7fda48962700 1 -- 172.21.15.80:0/3865061466 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960988512 0 0) 0x7fda3c001150 con 0x7fda4406c2f0 2019-11-28T11:28:31.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.197+0000 7fda48962700 1 -- 172.21.15.80:0/3865061466 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda30002e80 con 0x7fda4406c2f0 2019-11-28T11:28:31.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.198+0000 7fda48962700 1 -- 172.21.15.80:0/3865061466 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761547525 0 0) 0x7fda2c001400 con 0x7fda4415ed10 2019-11-28T11:28:31.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.198+0000 7fda48962700 1 -- 172.21.15.80:0/3865061466 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda300030b0 con 0x7fda4415ed10 2019-11-28T11:28:31.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.198+0000 7fda49163700 1 -- 172.21.15.80:0/3865061466 >> v1:172.21.15.174:6789/0 conn(0x7fda4415ed10 legacy=0x7fda44073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.198+0000 7fda49163700 1 -- 172.21.15.80:0/3865061466 >> v1:172.21.15.80:6789/0 conn(0x7fda4406c2f0 legacy=0x7fda4406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.198+0000 7fda49163700 1 -- 172.21.15.80:0/3865061466 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda44070760 con 0x7fda4415f100 2019-11-28T11:28:31.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.198+0000 7fda49163700 1 --2- 172.21.15.80:0/3865061466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda4415f100 0x7fda4406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fda3400af50 tx=0x7fda3400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.198+0000 7fda49163700 1 --2- 172.21.15.80:0/3865061466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda4415f100 0x7fda4406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fda3400af50 tx=0x7fda3400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.198+0000 7fda49163700 1 --2- 172.21.15.80:0/3865061466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda4415f100 0x7fda4406bdb0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fda3400af50 tx=0x7fda3400b760).ready entity=mon.2 client_cookie=20169b10d7e2e87b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:31.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.198+0000 7fda49163700 1 --2- 172.21.15.80:0/3865061466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda4415f100 0x7fda4406bdb0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fda3400af50 tx=0x7fda3400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.198+0000 7fda48962700 1 -- 172.21.15.80:0/3865061466 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda34000960 con 0x7fda4415f100 2019-11-28T11:28:31.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.198+0000 7fda49163700 1 --2- 172.21.15.80:0/3865061466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda4415f100 0x7fda4406bdb0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fda3400af50 tx=0x7fda3400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.198+0000 7fda49163700 1 --2- 172.21.15.80:0/3865061466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda4415f100 0x7fda4406bdb0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fda3400af50 tx=0x7fda3400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.198+0000 7fda48962700 1 -- 172.21.15.80:0/3865061466 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda34009860 con 0x7fda4415f100 2019-11-28T11:28:31.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.198+0000 7fda48962700 1 -- 172.21.15.80:0/3865061466 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda34009f30 con 0x7fda4415f100 2019-11-28T11:28:31.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.198+0000 7fda4b3c7700 1 -- 172.21.15.80:0/3865061466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda4415f100 msgr2=0x7fda4406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.198+0000 7fda4b3c7700 1 --2- 172.21.15.80:0/3865061466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda4415f100 0x7fda4406bdb0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fda3400af50 tx=0x7fda3400b760).stop 2019-11-28T11:28:31.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.199+0000 7fda4b3c7700 1 -- 172.21.15.80:0/3865061466 shutdown_connections 2019-11-28T11:28:31.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.199+0000 7fda4b3c7700 1 --2- 172.21.15.80:0/3865061466 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda4415f100 0x7fda4406bdb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.199+0000 7fda4b3c7700 1 -- 172.21.15.80:0/3865061466 shutdown_connections 2019-11-28T11:28:31.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.199+0000 7fda4b3c7700 1 -- 172.21.15.80:0/3865061466 wait complete. 2019-11-28T11:28:31.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.199+0000 7fda4b3c7700 1 -- 172.21.15.80:0/3865061466 >> 172.21.15.80:0/3865061466 conn(0x7fda44061d40 msgr2=0x7fda440641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:31.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.201+0000 7fda4b3c7700 1 Processor -- start 2019-11-28T11:28:31.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.201+0000 7fda4b3c7700 1 -- start start 2019-11-28T11:28:31.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.202+0000 7fda4b3c7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fda441486b0 0x7fda44113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:31.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.202+0000 7fda4b3c7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda44114440 0x7fda44127e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:31.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.202+0000 7fda4b3c7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda44148aa0 con 0x7fda44128390 2019-11-28T11:28:31.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.202+0000 7fda4b3c7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda44156b70 con 0x7fda441486b0 2019-11-28T11:28:31.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.202+0000 7fda4b3c7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda44156e40 con 0x7fda44114440 2019-11-28T11:28:31.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.202+0000 7fda49964700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fda441486b0 0x7fda44113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:31.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.202+0000 7fda49964700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fda441486b0 0x7fda44113f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33380/0 (socket says 172.21.15.80:33380) 2019-11-28T11:28:31.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.202+0000 7fda4a165700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fda44128390 0x7fda4413a020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60932/0 (socket says 172.21.15.80:60932) 2019-11-28T11:28:31.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.202+0000 7fda49964700 1 -- 172.21.15.80:0/4265885292 learned_addr learned my addr 172.21.15.80:0/4265885292 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:31.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.202+0000 7fda49163700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda44114440 0x7fda44127e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:31.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda49964700 1 -- 172.21.15.80:0/4265885292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda44114440 msgr2=0x7fda44127e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda49964700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda44114440 0x7fda44127e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda49964700 1 -- 172.21.15.80:0/4265885292 >> v1:172.21.15.80:6789/0 conn(0x7fda44128390 legacy=0x7fda4413a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda49964700 1 -- 172.21.15.80:0/4265885292 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda441574d0 con 0x7fda441486b0 2019-11-28T11:28:31.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda427fc700 1 -- 172.21.15.80:0/4265885292 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123307455 0 0) 0x7fda3c0009b0 con 0x7fda44128390 2019-11-28T11:28:31.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda49964700 1 --2- 172.21.15.80:0/4265885292 >> v2:172.21.15.80:3300/0 conn(0x7fda441486b0 0x7fda44113f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fda2c010710 tx=0x7fda2c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda49964700 1 --2- 172.21.15.80:0/4265885292 >> v2:172.21.15.80:3300/0 conn(0x7fda441486b0 0x7fda44113f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fda2c010710 tx=0x7fda2c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda49964700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda441486b0 0x7fda44113f00 secure :-1 s=READY pgs=514 cs=0 l=1 rx=0x7fda2c010710 tx=0x7fda2c010ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:31.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda49964700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda441486b0 0x7fda44113f00 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7fda2c010710 tx=0x7fda2c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda427fc700 1 -- 172.21.15.80:0/4265885292 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda2c005af0 con 0x7fda441486b0 2019-11-28T11:28:31.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda49964700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda441486b0 0x7fda44113f00 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7fda2c010710 tx=0x7fda2c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda49964700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda441486b0 0x7fda44113f00 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7fda2c010710 tx=0x7fda2c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda427fc700 1 -- 172.21.15.80:0/4265885292 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2c005710 con 0x7fda441486b0 2019-11-28T11:28:31.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda427fc700 1 -- 172.21.15.80:0/4265885292 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda2c005900 con 0x7fda441486b0 2019-11-28T11:28:31.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda4b3c7700 1 -- 172.21.15.80:0/4265885292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda44157850 con 0x7fda441486b0 2019-11-28T11:28:31.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda4b3c7700 1 -- 172.21.15.80:0/4265885292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda441574d0 con 0x7fda441486b0 2019-11-28T11:28:31.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda49964700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda441486b0 0x7fda44113f00 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7fda2c010710 tx=0x7fda2c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.203+0000 7fda427fc700 1 -- 172.21.15.80:0/4265885292 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fda2c005900 con 0x7fda441486b0 2019-11-28T11:28:31.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.204+0000 7fda49964700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda441486b0 0x7fda44113f00 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7fda2c010710 tx=0x7fda2c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.204+0000 7fda427fc700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda28018730 0x7fda2801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:31.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.204+0000 7fda427fc700 1 -- 172.21.15.80:0/4265885292 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fda2c031dc0 con 0x7fda441486b0 2019-11-28T11:28:31.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.204+0000 7fda49163700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda28018730 0x7fda2801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:31.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.204+0000 7fda49163700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda28018730 0x7fda2801abc0 crc :-1 s=READY pgs=217 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:31.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.211+0000 7fda4b3c7700 1 -- 172.21.15.80:0/4265885292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda44157850 con 0x7fda441486b0 2019-11-28T11:28:31.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.215+0000 7fda49964700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda441486b0 0x7fda44113f00 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7fda2c010710 tx=0x7fda2c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.215+0000 7fda427fc700 1 -- 172.21.15.80:0/4265885292 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fda2c0251c0 con 0x7fda441486b0 2019-11-28T11:28:31.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.384+0000 7fda4b3c7700 1 -- 172.21.15.80:0/4265885292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fda441574d0 con 0x7fda441486b0 2019-11-28T11:28:31.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.387+0000 7fda49964700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda441486b0 0x7fda44113f00 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7fda2c010710 tx=0x7fda2c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.388+0000 7fda427fc700 1 -- 172.21.15.80:0/4265885292 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7fda2c0251c0 con 0x7fda441486b0 2019-11-28T11:28:31.419 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:28:31.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.394+0000 7fda4b3c7700 1 -- 172.21.15.80:0/4265885292 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda28018730 msgr2=0x7fda2801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.394+0000 7fda4b3c7700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda28018730 0x7fda2801abc0 crc :-1 s=READY pgs=217 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.394+0000 7fda4b3c7700 1 -- 172.21.15.80:0/4265885292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda441486b0 msgr2=0x7fda44113f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.394+0000 7fda4b3c7700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda441486b0 0x7fda44113f00 secure :-1 s=READY pgs=514 cs=0 l=1 rx=0x7fda2c010710 tx=0x7fda2c010ab0).stop 2019-11-28T11:28:31.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.394+0000 7fda4b3c7700 1 -- 172.21.15.80:0/4265885292 shutdown_connections 2019-11-28T11:28:31.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.394+0000 7fda4b3c7700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda28018730 0x7fda2801abc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.394+0000 7fda4b3c7700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda44114440 0x7fda44127e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.394+0000 7fda4b3c7700 1 --2- 172.21.15.80:0/4265885292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda441486b0 0x7fda44113f00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.394+0000 7fda4b3c7700 1 -- 172.21.15.80:0/4265885292 shutdown_connections 2019-11-28T11:28:31.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.394+0000 7fda4b3c7700 1 -- 172.21.15.80:0/4265885292 wait complete. 2019-11-28T11:28:31.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.394+0000 7fda4b3c7700 1 -- 172.21.15.80:0/4265885292 >> 172.21.15.80:0/4265885292 conn(0x7fda44166610 msgr2=0x7fda441473d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:31.431 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:28:31.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.534+0000 7f72b9c72700 1 Processor -- start 2019-11-28T11:28:31.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.535+0000 7f72b9c72700 1 -- start start 2019-11-28T11:28:31.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.535+0000 7f72b9c72700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b415ed10 0x7f72b415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:31.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.535+0000 7f72b9c72700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f72b40734b0 0x7f72b40726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:31.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b9c72700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b406db60 con 0x7f72b4073020 2019-11-28T11:28:31.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b9c72700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b406f3d0 con 0x7f72b40734b0 2019-11-28T11:28:31.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b9c72700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b406fe00 con 0x7f72b415ed10 2019-11-28T11:28:31.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b415ed10 0x7f72b415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:31.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b8a10700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f72b40734b0 0x7f72b40726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:31.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b415ed10 0x7f72b415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:35648/0 (socket says 172.21.15.80:35648) 2019-11-28T11:28:31.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b8a10700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f72b40734b0 0x7f72b40726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:48274/0 (socket says 172.21.15.80:48274) 2019-11-28T11:28:31.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b3fff700 1 -- 172.21.15.80:0/2665756948 learned_addr learned my addr 172.21.15.80:0/2665756948 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:31.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b8a10700 1 -- 172.21.15.80:0/2665756948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b415ed10 msgr2=0x7f72b415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:31.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b8a10700 1 --2- 172.21.15.80:0/2665756948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b415ed10 0x7f72b415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:31.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b8a10700 1 -- 172.21.15.80:0/2665756948 >> v1:172.21.15.174:6789/0 conn(0x7f72b4073020 legacy=0x7f72b4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b37fe700 1 -- 172.21.15.80:0/2665756948 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858660747 0 0) 0x7f729c001080 con 0x7f72b4073020 2019-11-28T11:28:31.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b8a10700 1 -- 172.21.15.80:0/2665756948 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b4070760 con 0x7f72b40734b0 2019-11-28T11:28:31.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b3fff700 1 --2- 172.21.15.80:0/2665756948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b415ed10 0x7f72b415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b8a10700 1 --2- 172.21.15.80:0/2665756948 >> v2:172.21.15.174:3300/0 conn(0x7f72b40734b0 0x7f72b40726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f72ac00b300 tx=0x7f72ac00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b8a10700 1 --2- 172.21.15.80:0/2665756948 >> v2:172.21.15.174:3300/0 conn(0x7f72b40734b0 0x7f72b40726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f72ac00b300 tx=0x7f72ac00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b8a10700 1 --2- 172.21.15.80:0/2665756948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72b40734b0 0x7f72b40726a0 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f72ac00b300 tx=0x7f72ac00bb10).ready entity=mon.1 client_cookie=23d24895f5ee6567 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b8a10700 1 --2- 172.21.15.80:0/2665756948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72b40734b0 0x7f72b40726a0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f72ac00b300 tx=0x7f72ac00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.536+0000 7f72b37fe700 1 -- 172.21.15.80:0/2665756948 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72ac000f40 con 0x7f72b40734b0 2019-11-28T11:28:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.537+0000 7f72b8a10700 1 --2- 172.21.15.80:0/2665756948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72b40734b0 0x7f72b40726a0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f72ac00b300 tx=0x7f72ac00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.537+0000 7f72b8a10700 1 --2- 172.21.15.80:0/2665756948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72b40734b0 0x7f72b40726a0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f72ac00b300 tx=0x7f72ac00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.537+0000 7f72b37fe700 1 -- 172.21.15.80:0/2665756948 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac009b70 con 0x7f72b40734b0 2019-11-28T11:28:31.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.537+0000 7f72b37fe700 1 -- 172.21.15.80:0/2665756948 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72ac00a240 con 0x7f72b40734b0 2019-11-28T11:28:31.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.537+0000 7f72b9c72700 1 -- 172.21.15.80:0/2665756948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72b40734b0 msgr2=0x7f72b40726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.537+0000 7f72b9c72700 1 --2- 172.21.15.80:0/2665756948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72b40734b0 0x7f72b40726a0 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f72ac00b300 tx=0x7f72ac00bb10).stop 2019-11-28T11:28:31.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.537+0000 7f72b9c72700 1 -- 172.21.15.80:0/2665756948 shutdown_connections 2019-11-28T11:28:31.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.537+0000 7f72b9c72700 1 --2- 172.21.15.80:0/2665756948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72b40734b0 0x7f72b40726a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.537+0000 7f72b9c72700 1 --2- 172.21.15.80:0/2665756948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b415ed10 0x7f72b415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:31.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.537+0000 7f72b9c72700 1 -- 172.21.15.80:0/2665756948 shutdown_connections 2019-11-28T11:28:31.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.537+0000 7f72b9c72700 1 -- 172.21.15.80:0/2665756948 wait complete. 2019-11-28T11:28:31.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.537+0000 7f72b9c72700 1 -- 172.21.15.80:0/2665756948 >> 172.21.15.80:0/2665756948 conn(0x7f72b4061d40 msgr2=0x7f72b40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:31.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.540+0000 7f72b9c72700 1 Processor -- start 2019-11-28T11:28:31.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.540+0000 7f72b9c72700 1 -- start start 2019-11-28T11:28:31.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72b9c72700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b4152750 0x7f72b4135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:31.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72b9c72700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72b4130dc0 0x7f72b4131250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:31.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72b9c72700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b4109d70 con 0x7f72b4131790 2019-11-28T11:28:31.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72b9c72700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b4131c10 con 0x7f72b4130dc0 2019-11-28T11:28:31.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72b9c72700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b410a460 con 0x7f72b4152750 2019-11-28T11:28:31.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72abfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72b4130dc0 0x7f72b4131250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:31.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72b3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b4152750 0x7f72b4135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:31.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72abfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72b4130dc0 0x7f72b4131250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33394/0 (socket says 172.21.15.80:33394) 2019-11-28T11:28:31.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72abfff700 1 -- 172.21.15.80:0/3720990369 learned_addr learned my addr 172.21.15.80:0/3720990369 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:31.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72b17fa700 1 -- 172.21.15.80:0/3720990369 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275065735 0 0) 0x7f72ac00af60 con 0x7f72b4131790 2019-11-28T11:28:31.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72b17fa700 1 -- 172.21.15.80:0/3720990369 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7298002e80 con 0x7f72b4131790 2019-11-28T11:28:31.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72abfff700 1 -- 172.21.15.80:0/3720990369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b4152750 msgr2=0x7f72b4135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72abfff700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b4152750 0x7f72b4135790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72abfff700 1 -- 172.21.15.80:0/3720990369 >> v1:172.21.15.174:6789/0 conn(0x7f72b4131790 legacy=0x7f72b4134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72abfff700 1 -- 172.21.15.80:0/3720990369 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b4132ed0 con 0x7f72b4130dc0 2019-11-28T11:28:31.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72b3fff700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b4152750 0x7f72b4135790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:31.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72abfff700 1 --2- 172.21.15.80:0/3720990369 >> v2:172.21.15.80:3300/0 conn(0x7f72b4130dc0 0x7f72b4131250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f729c010410 tx=0x7f729c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72abfff700 1 --2- 172.21.15.80:0/3720990369 >> v2:172.21.15.80:3300/0 conn(0x7f72b4130dc0 0x7f72b4131250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f729c010410 tx=0x7f729c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72abfff700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b4130dc0 0x7f72b4131250 secure :-1 s=READY pgs=515 cs=0 l=1 rx=0x7f729c010410 tx=0x7f729c0107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:31.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72abfff700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b4130dc0 0x7f72b4131250 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7f729c010410 tx=0x7f729c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72b17fa700 1 -- 172.21.15.80:0/3720990369 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f729c0055d0 con 0x7f72b4130dc0 2019-11-28T11:28:31.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72abfff700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b4130dc0 0x7f72b4131250 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7f729c010410 tx=0x7f729c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72b17fa700 1 -- 172.21.15.80:0/3720990369 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c000a60 con 0x7f72b4130dc0 2019-11-28T11:28:31.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72abfff700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b4130dc0 0x7f72b4131250 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7f729c010410 tx=0x7f729c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72b9c72700 1 -- 172.21.15.80:0/3720990369 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b4133250 con 0x7f72b4130dc0 2019-11-28T11:28:31.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72b17fa700 1 -- 172.21.15.80:0/3720990369 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f729c0057c0 con 0x7f72b4130dc0 2019-11-28T11:28:31.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.541+0000 7f72b9c72700 1 -- 172.21.15.80:0/3720990369 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b4132ed0 con 0x7f72b4130dc0 2019-11-28T11:28:31.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.542+0000 7f72abfff700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b4130dc0 0x7f72b4131250 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7f729c010410 tx=0x7f729c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.542+0000 7f72b17fa700 1 -- 172.21.15.80:0/3720990369 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f729c0053e0 con 0x7f72b4130dc0 2019-11-28T11:28:31.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.542+0000 7f72abfff700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b4130dc0 0x7f72b4131250 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7f729c010410 tx=0x7f729c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.542+0000 7f72b17fa700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7298018770 0x7f729801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:31.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.542+0000 7f72b17fa700 1 -- 172.21.15.80:0/3720990369 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f729c031b00 con 0x7f72b4130dc0 2019-11-28T11:28:31.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.542+0000 7f72b3fff700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7298018770 0x7f729801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:31.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.543+0000 7f72b3fff700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7298018770 0x7f729801abe0 crc :-1 s=READY pgs=218 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:31.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.550+0000 7f72b9c72700 1 -- 172.21.15.80:0/3720990369 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b4133250 con 0x7f72b4130dc0 2019-11-28T11:28:31.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.553+0000 7f72abfff700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b4130dc0 0x7f72b4131250 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7f729c010410 tx=0x7f729c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.553+0000 7f72b17fa700 1 -- 172.21.15.80:0/3720990369 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f729c007600 con 0x7f72b4130dc0 2019-11-28T11:28:31.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.729+0000 7f72b9c72700 1 -- 172.21.15.80:0/3720990369 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f72b4132ed0 con 0x7f72b4130dc0 2019-11-28T11:28:31.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.734+0000 7f72abfff700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b4130dc0 0x7f72b4131250 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7f729c010410 tx=0x7f729c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.734+0000 7f72b17fa700 1 -- 172.21.15.80:0/3720990369 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v19) v1 ==== 184+0+0 (secure 0 0 0) 0x7f729c017480 con 0x7f72b4130dc0 2019-11-28T11:28:31.764 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:28:31.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.738+0000 7f72b9c72700 1 -- 172.21.15.80:0/3720990369 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7298018770 msgr2=0x7f729801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.738+0000 7f72b9c72700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7298018770 0x7f729801abe0 crc :-1 s=READY pgs=218 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.738+0000 7f72b9c72700 1 -- 172.21.15.80:0/3720990369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b4130dc0 msgr2=0x7f72b4131250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.738+0000 7f72b9c72700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b4130dc0 0x7f72b4131250 secure :-1 s=READY pgs=515 cs=0 l=1 rx=0x7f729c010410 tx=0x7f729c0107b0).stop 2019-11-28T11:28:31.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.739+0000 7f72b9c72700 1 -- 172.21.15.80:0/3720990369 shutdown_connections 2019-11-28T11:28:31.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.739+0000 7f72b9c72700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7298018770 0x7f729801abe0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.739+0000 7f72b9c72700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72b4130dc0 0x7f72b4131250 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.739+0000 7f72b9c72700 1 --2- 172.21.15.80:0/3720990369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72b4152750 0x7f72b4135790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.739+0000 7f72b9c72700 1 -- 172.21.15.80:0/3720990369 shutdown_connections 2019-11-28T11:28:31.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.739+0000 7f72b9c72700 1 -- 172.21.15.80:0/3720990369 wait complete. 2019-11-28T11:28:31.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.739+0000 7f72b9c72700 1 -- 172.21.15.80:0/3720990369 >> 172.21.15.80:0/3720990369 conn(0x7f72b41476e0 msgr2=0x7f72b412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:31.777 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:28:31.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.870+0000 7f5c55671700 1 Processor -- start 2019-11-28T11:28:31.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.870+0000 7f5c55671700 1 -- start start 2019-11-28T11:28:31.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.871+0000 7f5c55671700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5006c0a0 0x7f5c50072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:31.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.871+0000 7f5c55671700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5006db00 con 0x7f5c50072620 2019-11-28T11:28:31.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.871+0000 7f5c55671700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5006e000 con 0x7f5c500734e0 2019-11-28T11:28:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.871+0000 7f5c55671700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5006f330 con 0x7f5c5006c0a0 2019-11-28T11:28:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.871+0000 7f5c4ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5c50072620 0x7f5c50164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60950/0 (socket says 172.21.15.80:60950) 2019-11-28T11:28:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.871+0000 7f5c4ffff700 1 -- 172.21.15.80:0/2895912318 learned_addr learned my addr 172.21.15.80:0/2895912318 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.871+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/2895912318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5006c0a0 0x7f5c50072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.871+0000 7f5c4e7fc700 1 -- 172.21.15.80:0/2895912318 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510184253 0 0) 0x7f5c480014d0 con 0x7f5c50072620 2019-11-28T11:28:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.871+0000 7f5c4e7fc700 1 -- 172.21.15.80:0/2895912318 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c3c002e80 con 0x7f5c50072620 2019-11-28T11:28:31.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.871+0000 7f5c4e7fc700 1 -- 172.21.15.80:0/2895912318 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465469465 0 0) 0x7f5c40001080 con 0x7f5c500734e0 2019-11-28T11:28:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.871+0000 7f5c4e7fc700 1 -- 172.21.15.80:0/2895912318 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c3c0030b0 con 0x7f5c500734e0 2019-11-28T11:28:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.871+0000 7f5c4f7fe700 1 -- 172.21.15.80:0/2895912318 >> v1:172.21.15.174:6789/0 conn(0x7f5c500734e0 legacy=0x7f5c50071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.871+0000 7f5c4f7fe700 1 -- 172.21.15.80:0/2895912318 >> v1:172.21.15.80:6789/0 conn(0x7f5c50072620 legacy=0x7f5c50164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.871+0000 7f5c4f7fe700 1 -- 172.21.15.80:0/2895912318 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c500706c0 con 0x7f5c5006c0a0 2019-11-28T11:28:31.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.872+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/2895912318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5006c0a0 0x7f5c50072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5c3800af50 tx=0x7f5c3800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.872+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/2895912318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5006c0a0 0x7f5c50072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5c3800af50 tx=0x7f5c3800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.872+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/2895912318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5006c0a0 0x7f5c50072fa0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f5c3800af50 tx=0x7f5c3800b760).ready entity=mon.2 client_cookie=dcd2885b90a5f198 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:31.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.872+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/2895912318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5006c0a0 0x7f5c50072fa0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f5c3800af50 tx=0x7f5c3800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.872+0000 7f5c4e7fc700 1 -- 172.21.15.80:0/2895912318 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c38000960 con 0x7f5c5006c0a0 2019-11-28T11:28:31.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.872+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/2895912318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5006c0a0 0x7f5c50072fa0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f5c3800af50 tx=0x7f5c3800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.872+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/2895912318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5006c0a0 0x7f5c50072fa0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f5c3800af50 tx=0x7f5c3800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.872+0000 7f5c4e7fc700 1 -- 172.21.15.80:0/2895912318 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c38009860 con 0x7f5c5006c0a0 2019-11-28T11:28:31.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.872+0000 7f5c4e7fc700 1 -- 172.21.15.80:0/2895912318 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c38009f30 con 0x7f5c5006c0a0 2019-11-28T11:28:31.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.872+0000 7f5c55671700 1 -- 172.21.15.80:0/2895912318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5006c0a0 msgr2=0x7f5c50072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.872+0000 7f5c55671700 1 --2- 172.21.15.80:0/2895912318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5006c0a0 0x7f5c50072fa0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f5c3800af50 tx=0x7f5c3800b760).stop 2019-11-28T11:28:31.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.872+0000 7f5c55671700 1 -- 172.21.15.80:0/2895912318 shutdown_connections 2019-11-28T11:28:31.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.872+0000 7f5c55671700 1 --2- 172.21.15.80:0/2895912318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5006c0a0 0x7f5c50072fa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.873+0000 7f5c55671700 1 -- 172.21.15.80:0/2895912318 shutdown_connections 2019-11-28T11:28:31.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.873+0000 7f5c55671700 1 -- 172.21.15.80:0/2895912318 wait complete. 2019-11-28T11:28:31.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.873+0000 7f5c55671700 1 -- 172.21.15.80:0/2895912318 >> 172.21.15.80:0/2895912318 conn(0x7f5c50061cf0 msgr2=0x7f5c50064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:31.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.875+0000 7f5c55671700 1 Processor -- start 2019-11-28T11:28:31.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.875+0000 7f5c55671700 1 -- start start 2019-11-28T11:28:31.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.876+0000 7f5c55671700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5013b5c0 0x7f5c5012cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:31.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.876+0000 7f5c55671700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5c5012d260 0x7f5c5012bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:31.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.876+0000 7f5c55671700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c50107930 con 0x7f5c5012c0e0 2019-11-28T11:28:31.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.876+0000 7f5c55671700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c50129160 con 0x7f5c5012d260 2019-11-28T11:28:31.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.876+0000 7f5c55671700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5013bc30 con 0x7f5c5013b5c0 2019-11-28T11:28:31.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.876+0000 7f5c4effd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5c5012d260 0x7f5c5012bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:31.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.876+0000 7f5c4f7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5013b5c0 0x7f5c5012cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:31.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.876+0000 7f5c4effd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5c5012d260 0x7f5c5012bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:48292/0 (socket says 172.21.15.80:48292) 2019-11-28T11:28:31.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.876+0000 7f5c4effd700 1 -- 172.21.15.80:0/3129361990 learned_addr learned my addr 172.21.15.80:0/3129361990 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:31.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.876+0000 7f5c4f7fe700 1 -- 172.21.15.80:0/3129361990 >> v2:172.21.15.174:3300/0 conn(0x7f5c5012d260 msgr2=0x7f5c5012bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.876+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/3129361990 >> v2:172.21.15.174:3300/0 conn(0x7f5c5012d260 0x7f5c5012bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:31.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.876+0000 7f5c4f7fe700 1 -- 172.21.15.80:0/3129361990 >> v1:172.21.15.174:6789/0 conn(0x7f5c5012c0e0 legacy=0x7f5c50127040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:31.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.876+0000 7f5c4f7fe700 1 -- 172.21.15.80:0/3129361990 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5012a4f0 con 0x7f5c5013b5c0 2019-11-28T11:28:31.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.876+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5013b5c0 0x7f5c5012cd20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c38010390 tx=0x7f5c38010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.877+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5013b5c0 0x7f5c5012cd20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c38010390 tx=0x7f5c38010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.877+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5013b5c0 0x7f5c5012cd20 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f5c38010390 tx=0x7f5c38010210).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:31.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.877+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5013b5c0 0x7f5c5012cd20 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f5c38010390 tx=0x7f5c38010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.877+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5013b5c0 0x7f5c5012cd20 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f5c38010390 tx=0x7f5c38010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.877+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5013b5c0 0x7f5c5012cd20 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f5c38010390 tx=0x7f5c38010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.877+0000 7f5c47fff700 1 -- 172.21.15.80:0/3129361990 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c38000940 con 0x7f5c5013b5c0 2019-11-28T11:28:31.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.877+0000 7f5c47fff700 1 -- 172.21.15.80:0/3129361990 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c38009980 con 0x7f5c5013b5c0 2019-11-28T11:28:31.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.877+0000 7f5c55671700 1 -- 172.21.15.80:0/3129361990 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5012a870 con 0x7f5c5013b5c0 2019-11-28T11:28:31.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.877+0000 7f5c47fff700 1 -- 172.21.15.80:0/3129361990 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c3800a0d0 con 0x7f5c5013b5c0 2019-11-28T11:28:31.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.877+0000 7f5c55671700 1 -- 172.21.15.80:0/3129361990 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5012a4f0 con 0x7f5c5013b5c0 2019-11-28T11:28:31.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.877+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5013b5c0 0x7f5c5012cd20 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f5c38010390 tx=0x7f5c38010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.877+0000 7f5c47fff700 1 -- 172.21.15.80:0/3129361990 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5c38009580 con 0x7f5c5013b5c0 2019-11-28T11:28:31.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.877+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5013b5c0 0x7f5c5012cd20 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f5c38010390 tx=0x7f5c38010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.877+0000 7f5c47fff700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c34018730 0x7f5c3401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:31.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.877+0000 7f5c47fff700 1 -- 172.21.15.80:0/3129361990 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5c38031a20 con 0x7f5c5013b5c0 2019-11-28T11:28:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.878+0000 7f5c4effd700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c34018730 0x7f5c3401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.878+0000 7f5c4effd700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c34018730 0x7f5c3401abc0 crc :-1 s=READY pgs=219 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.885+0000 7f5c55671700 1 -- 172.21.15.80:0/3129361990 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5012a870 con 0x7f5c5013b5c0 2019-11-28T11:28:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.889+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5013b5c0 0x7f5c5012cd20 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f5c38010390 tx=0x7f5c38010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:31.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:31.889+0000 7f5c47fff700 1 -- 172.21.15.80:0/3129361990 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5c38000940 con 0x7f5c5013b5c0 2019-11-28T11:28:32.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:32.062+0000 7f5c55671700 1 -- 172.21.15.80:0/3129361990 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c5012a4f0 con 0x7f5c5013b5c0 2019-11-28T11:28:32.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:32.062+0000 7f5c4f7fe700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5013b5c0 0x7f5c5012cd20 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f5c38010390 tx=0x7f5c38010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:32.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:32.062+0000 7f5c47fff700 1 -- 172.21.15.80:0/3129361990 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+1422 (secure 0 0 0) 0x7f5c3800a170 con 0x7f5c5013b5c0 2019-11-28T11:28:32.099 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 19 2019-11-28T11:28:32.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:32.065+0000 7f5c55671700 1 -- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c34018730 msgr2=0x7f5c3401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:32.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:32.065+0000 7f5c55671700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c34018730 0x7f5c3401abc0 crc :-1 s=READY pgs=219 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:32.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:32.065+0000 7f5c55671700 1 -- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5013b5c0 msgr2=0x7f5c5012cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:32.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:32.065+0000 7f5c55671700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5013b5c0 0x7f5c5012cd20 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f5c38010390 tx=0x7f5c38010210).stop 2019-11-28T11:28:32.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:32.065+0000 7f5c55671700 1 -- 172.21.15.80:0/3129361990 shutdown_connections 2019-11-28T11:28:32.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:32.065+0000 7f5c55671700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c34018730 0x7f5c3401abc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:32.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:32.065+0000 7f5c55671700 1 --2- 172.21.15.80:0/3129361990 >> v2:172.21.15.174:3300/0 conn(0x7f5c5012d260 0x7f5c5012bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:32.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:32.065+0000 7f5c55671700 1 --2- 172.21.15.80:0/3129361990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c5013b5c0 0x7f5c5012cd20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:32.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:32.065+0000 7f5c55671700 1 -- 172.21.15.80:0/3129361990 shutdown_connections 2019-11-28T11:28:32.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:32.065+0000 7f5c55671700 1 -- 172.21.15.80:0/3129361990 wait complete. 2019-11-28T11:28:32.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:32.065+0000 7f5c55671700 1 -- 172.21.15.80:0/3129361990 >> 172.21.15.80:0/3129361990 conn(0x7f5c501425d0 msgr2=0x7f5c50101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:32.101 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:32.101 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:27.955433+0000","modified":"2019-11-28T11:28:29.600529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2019-11-28T11:28:32.404 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 6, u'failed': [], u'epoch': 19, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [7], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:28:27.955433+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:28:29.600529+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:28:32.404 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:28:33.405 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:28:33.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.497+0000 7f83c15fb700 1 Processor -- start 2019-11-28T11:28:33.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.497+0000 7f83c15fb700 1 -- start start 2019-11-28T11:28:33.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.498+0000 7f83c15fb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f83bc06c490 0x7f83bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:33.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.498+0000 7f83c15fb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc06db00 con 0x7f83bc06c0a0 2019-11-28T11:28:33.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.498+0000 7f83c15fb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc06e000 con 0x7f83bc06ce60 2019-11-28T11:28:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.498+0000 7f83c15fb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc06fd60 con 0x7f83bc06c490 2019-11-28T11:28:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83bb7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f83bc06c0a0 0x7f83bc072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60962/0 (socket says 172.21.15.80:60962) 2019-11-28T11:28:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83bb7fe700 1 -- 172.21.15.80:0/64309975 learned_addr learned my addr 172.21.15.80:0/64309975 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83ba7fc700 1 -- 172.21.15.80:0/64309975 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520187418 0 0) 0x7f83a4001150 con 0x7f83bc06c0a0 2019-11-28T11:28:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83baffd700 1 --2- 172.21.15.80:0/64309975 >> v2:172.21.15.174:3300/0 conn(0x7f83bc06c490 0x7f83bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:33.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83ba7fc700 1 -- 172.21.15.80:0/64309975 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a8002e80 con 0x7f83bc06c0a0 2019-11-28T11:28:33.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83ba7fc700 1 -- 172.21.15.80:0/64309975 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 72059851 0 0) 0x7f83a4001130 con 0x7f83bc06c0a0 2019-11-28T11:28:33.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83ba7fc700 1 -- 172.21.15.80:0/64309975 >> v2:172.21.15.174:3300/0 conn(0x7f83bc06c490 msgr2=0x7f83bc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:33.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83ba7fc700 1 --2- 172.21.15.80:0/64309975 >> v2:172.21.15.174:3300/0 conn(0x7f83bc06c490 0x7f83bc06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:33.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83ba7fc700 1 -- 172.21.15.80:0/64309975 >> v1:172.21.15.174:6789/0 conn(0x7f83bc06ce60 legacy=0x7f83bc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:33.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83ba7fc700 1 -- 172.21.15.80:0/64309975 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc0706c0 con 0x7f83bc06c0a0 2019-11-28T11:28:33.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83ba7fc700 1 -- 172.21.15.80:0/64309975 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f83a4001660 con 0x7f83bc06c0a0 2019-11-28T11:28:33.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83ba7fc700 1 -- 172.21.15.80:0/64309975 >> v1:172.21.15.80:6789/0 conn(0x7f83bc06c0a0 legacy=0x7f83bc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:33.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83ba7fc700 1 --2- 172.21.15.80:0/64309975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83a8003ab0 0x7f83a8005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:33.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83ba7fc700 1 --2- 172.21.15.80:0/64309975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83a8006690 0x7f83a8008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:33.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83ba7fc700 1 --2- 172.21.15.80:0/64309975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83a80093a0 0x7f83a800b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:33.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83ba7fc700 1 -- 172.21.15.80:0/64309975 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a800c020 con 0x7f83a8003ab0 2019-11-28T11:28:33.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83ba7fc700 1 -- 172.21.15.80:0/64309975 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a8050220 con 0x7f83a80093a0 2019-11-28T11:28:33.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83ba7fc700 1 -- 172.21.15.80:0/64309975 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a8050450 con 0x7f83a8006690 2019-11-28T11:28:33.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/64309975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83a8003ab0 0x7f83a8005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:33.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83bbfff700 1 --2- 172.21.15.80:0/64309975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83a80093a0 0x7f83a800b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:33.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83baffd700 1 --2- 172.21.15.80:0/64309975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83a8006690 0x7f83a8008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:33.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83bb7fe700 1 -- 172.21.15.80:0/64309975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83a8006690 msgr2=0x7f83a8008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:33.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/64309975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83a8006690 0x7f83a8008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:33.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83bb7fe700 1 -- 172.21.15.80:0/64309975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83a80093a0 msgr2=0x7f83a800b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:33.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.499+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/64309975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83a80093a0 0x7f83a800b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:33.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83bbfff700 1 -- 172.21.15.80:0/64309975 reap_dead start 2019-11-28T11:28:33.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83bb7fe700 1 -- 172.21.15.80:0/64309975 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a8050700 con 0x7f83a8003ab0 2019-11-28T11:28:33.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/64309975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83a8003ab0 0x7f83a8005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f83a400f8e0 tx=0x7f83a400f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:33.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/64309975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83a8003ab0 0x7f83a8005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f83a400f8e0 tx=0x7f83a400f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:33.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/64309975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83a8003ab0 0x7f83a8005f10 secure :-1 s=READY pgs=518 cs=0 l=1 rx=0x7f83a400f8e0 tx=0x7f83a400f810).ready entity=mon.0 client_cookie=d52bf7a81e73f9b6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:33.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/64309975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83a8003ab0 0x7f83a8005f10 secure :-1 s=THROTTLE_DONE pgs=518 cs=0 l=1 rx=0x7f83a400f8e0 tx=0x7f83a400f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:33.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83ba7fc700 1 -- 172.21.15.80:0/64309975 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83a4004430 con 0x7f83a8003ab0 2019-11-28T11:28:33.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/64309975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83a8003ab0 0x7f83a8005f10 secure :-1 s=THROTTLE_DONE pgs=518 cs=0 l=1 rx=0x7f83a400f8e0 tx=0x7f83a400f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:33.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/64309975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83a8003ab0 0x7f83a8005f10 secure :-1 s=THROTTLE_DONE pgs=518 cs=0 l=1 rx=0x7f83a400f8e0 tx=0x7f83a400f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:33.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83ba7fc700 1 -- 172.21.15.80:0/64309975 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a4000c90 con 0x7f83a8003ab0 2019-11-28T11:28:33.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83ba7fc700 1 -- 172.21.15.80:0/64309975 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83a4004240 con 0x7f83a8003ab0 2019-11-28T11:28:33.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83c15fb700 1 -- 172.21.15.80:0/64309975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83a8003ab0 msgr2=0x7f83a8005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:33.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83c15fb700 1 --2- 172.21.15.80:0/64309975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83a8003ab0 0x7f83a8005f10 secure :-1 s=READY pgs=518 cs=0 l=1 rx=0x7f83a400f8e0 tx=0x7f83a400f810).stop 2019-11-28T11:28:33.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83c15fb700 1 -- 172.21.15.80:0/64309975 shutdown_connections 2019-11-28T11:28:33.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83c15fb700 1 --2- 172.21.15.80:0/64309975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83a8003ab0 0x7f83a8005f10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:33.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83c15fb700 1 -- 172.21.15.80:0/64309975 shutdown_connections 2019-11-28T11:28:33.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83c15fb700 1 -- 172.21.15.80:0/64309975 wait complete. 2019-11-28T11:28:33.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.500+0000 7f83c15fb700 1 -- 172.21.15.80:0/64309975 >> 172.21.15.80:0/64309975 conn(0x7f83bc061cf0 msgr2=0x7f83bc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:33.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.503+0000 7f83c15fb700 1 Processor -- start 2019-11-28T11:28:33.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.503+0000 7f83c15fb700 1 -- start start 2019-11-28T11:28:33.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83c15fb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83bc074d00 0x7f83bc0750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:33.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83c15fb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f83bc153040 0x7f83bc140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:33.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83c15fb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc079230 con 0x7f83bc152bd0 2019-11-28T11:28:33.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83c15fb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc07ab30 con 0x7f83bc074d00 2019-11-28T11:28:33.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83c15fb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc07ae00 con 0x7f83bc153040 2019-11-28T11:28:33.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83bb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83bc074d00 0x7f83bc0750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:33.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83bb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83bc074d00 0x7f83bc0750f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33426/0 (socket says 172.21.15.80:33426) 2019-11-28T11:28:33.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83bb7fe700 1 -- 172.21.15.80:0/1196922225 learned_addr learned my addr 172.21.15.80:0/1196922225 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:33.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83bbfff700 1 --2- 172.21.15.80:0/1196922225 >> v2:172.21.15.174:3300/0 conn(0x7f83bc153040 0x7f83bc140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:33.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83bb7fe700 1 -- 172.21.15.80:0/1196922225 >> v2:172.21.15.174:3300/0 conn(0x7f83bc153040 msgr2=0x7f83bc140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:33.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/1196922225 >> v2:172.21.15.174:3300/0 conn(0x7f83bc153040 0x7f83bc140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:33.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83bb7fe700 1 -- 172.21.15.80:0/1196922225 >> v1:172.21.15.174:6789/0 conn(0x7f83bc152bd0 legacy=0x7f83bc140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:33.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83bb7fe700 1 -- 172.21.15.80:0/1196922225 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc07b490 con 0x7f83bc074d00 2019-11-28T11:28:33.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/1196922225 >> v2:172.21.15.80:3300/0 conn(0x7f83bc074d00 0x7f83bc0750f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f83a4010450 tx=0x7f83a4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:33.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/1196922225 >> v2:172.21.15.80:3300/0 conn(0x7f83bc074d00 0x7f83bc0750f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f83a4010450 tx=0x7f83a4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:33.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/1196922225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83bc074d00 0x7f83bc0750f0 secure :-1 s=READY pgs=519 cs=0 l=1 rx=0x7f83a4010450 tx=0x7f83a4010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:33.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/1196922225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83bc074d00 0x7f83bc0750f0 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7f83a4010450 tx=0x7f83a4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:33.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83b3fff700 1 -- 172.21.15.80:0/1196922225 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83a4000c90 con 0x7f83bc074d00 2019-11-28T11:28:33.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/1196922225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83bc074d00 0x7f83bc0750f0 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7f83a4010450 tx=0x7f83a4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:33.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/1196922225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83bc074d00 0x7f83bc0750f0 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7f83a4010450 tx=0x7f83a4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:33.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83b3fff700 1 -- 172.21.15.80:0/1196922225 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a4004240 con 0x7f83bc074d00 2019-11-28T11:28:33.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.504+0000 7f83c15fb700 1 -- 172.21.15.80:0/1196922225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc07b810 con 0x7f83bc074d00 2019-11-28T11:28:33.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.505+0000 7f83b3fff700 1 -- 172.21.15.80:0/1196922225 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83a4004890 con 0x7f83bc074d00 2019-11-28T11:28:33.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.505+0000 7f83c15fb700 1 -- 172.21.15.80:0/1196922225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc07b490 con 0x7f83bc074d00 2019-11-28T11:28:33.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.505+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/1196922225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83bc074d00 0x7f83bc0750f0 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7f83a4010450 tx=0x7f83a4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:33.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.505+0000 7f83b3fff700 1 -- 172.21.15.80:0/1196922225 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f83a4004430 con 0x7f83bc074d00 2019-11-28T11:28:33.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.505+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/1196922225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83bc074d00 0x7f83bc0750f0 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7f83a4010450 tx=0x7f83a4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:33.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.505+0000 7f83b3fff700 1 --2- 172.21.15.80:0/1196922225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f83a0018730 0x7f83a001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:33.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.505+0000 7f83b3fff700 1 -- 172.21.15.80:0/1196922225 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f83a4031a80 con 0x7f83bc074d00 2019-11-28T11:28:33.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.505+0000 7f83baffd700 1 --2- 172.21.15.80:0/1196922225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f83a0018730 0x7f83a001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:33.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.506+0000 7f83baffd700 1 --2- 172.21.15.80:0/1196922225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f83a0018730 0x7f83a001abc0 crc :-1 s=READY pgs=220 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:33.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.513+0000 7f83c15fb700 1 -- 172.21.15.80:0/1196922225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc07b810 con 0x7f83bc074d00 2019-11-28T11:28:33.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.516+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/1196922225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83bc074d00 0x7f83bc0750f0 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7f83a4010450 tx=0x7f83a4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:33.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.516+0000 7f83b3fff700 1 -- 172.21.15.80:0/1196922225 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f83a40009e0 con 0x7f83bc074d00 2019-11-28T11:28:33.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.691+0000 7f83c15fb700 1 -- 172.21.15.80:0/1196922225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83bc07b490 con 0x7f83bc074d00 2019-11-28T11:28:33.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.691+0000 7f83bb7fe700 1 --2- 172.21.15.80:0/1196922225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83bc074d00 0x7f83bc0750f0 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7f83a4010450 tx=0x7f83a4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:33.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.691+0000 7f83b3fff700 1 -- 172.21.15.80:0/1196922225 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+1422 (secure 0 0 0) 0x7f83a401fec0 con 0x7f83bc074d00 2019-11-28T11:28:33.720 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 19 2019-11-28T11:28:33.720 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:33.720 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:27.955433+0000","modified":"2019-11-28T11:28:29.600529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2019-11-28T11:28:33.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.694+0000 7f83c15fb700 1 -- 172.21.15.80:0/1196922225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f83a0018730 msgr2=0x7f83a001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:33.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.694+0000 7f83c15fb700 1 --2- 172.21.15.80:0/1196922225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f83a0018730 0x7f83a001abc0 crc :-1 s=READY pgs=220 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:33.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.694+0000 7f83c15fb700 1 -- 172.21.15.80:0/1196922225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83bc074d00 msgr2=0x7f83bc0750f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:33.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.694+0000 7f83c15fb700 1 --2- 172.21.15.80:0/1196922225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83bc074d00 0x7f83bc0750f0 secure :-1 s=READY pgs=519 cs=0 l=1 rx=0x7f83a4010450 tx=0x7f83a4010280).stop 2019-11-28T11:28:33.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.694+0000 7f83c15fb700 1 -- 172.21.15.80:0/1196922225 shutdown_connections 2019-11-28T11:28:33.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.694+0000 7f83c15fb700 1 --2- 172.21.15.80:0/1196922225 >> v2:172.21.15.174:3300/0 conn(0x7f83bc153040 0x7f83bc140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:33.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.694+0000 7f83c15fb700 1 --2- 172.21.15.80:0/1196922225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f83a0018730 0x7f83a001abc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:33.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.694+0000 7f83c15fb700 1 --2- 172.21.15.80:0/1196922225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83bc074d00 0x7f83bc0750f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:33.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.694+0000 7f83c15fb700 1 -- 172.21.15.80:0/1196922225 shutdown_connections 2019-11-28T11:28:33.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.694+0000 7f83c15fb700 1 -- 172.21.15.80:0/1196922225 wait complete. 2019-11-28T11:28:33.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:33.694+0000 7f83c15fb700 1 -- 172.21.15.80:0/1196922225 >> 172.21.15.80:0/1196922225 conn(0x7f83bc13fa50 msgr2=0x7f83bc07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:34.033 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 6, u'failed': [], u'epoch': 19, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [7], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:28:27.955433+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:28:29.600529+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:28:34.033 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:28:35.034 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:28:35.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.138+0000 7f153ee73700 1 Processor -- start 2019-11-28T11:28:35.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.138+0000 7f153ee73700 1 -- start start 2019-11-28T11:28:35.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153ee73700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f153806c0a0 0x7f1538072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:35.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153ee73700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15380734e0 0x7f1538071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:35.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153ee73700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1538072360 0x7f1538072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:35.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153ee73700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153806fd60 con 0x7f153806c0a0 2019-11-28T11:28:35.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153ee73700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1538070030 con 0x7f1538072360 2019-11-28T11:28:35.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153ee73700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153806f330 con 0x7f15380734e0 2019-11-28T11:28:35.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153d410700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f153806c0a0 0x7f1538072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:35.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153d410700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f153806c0a0 0x7f1538072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33438/0 (socket says 172.21.15.80:33438) 2019-11-28T11:28:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153d410700 1 -- 172.21.15.80:0/626661491 learned_addr learned my addr 172.21.15.80:0/626661491 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153cc0f700 1 --2- 172.21.15.80:0/626661491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15380734e0 0x7f1538071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153dc11700 1 --2- 172.21.15.80:0/626661491 >> v2:172.21.15.174:3300/0 conn(0x7f1538072360 0x7f1538072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153d410700 1 -- 172.21.15.80:0/626661491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15380734e0 msgr2=0x7f1538071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153d410700 1 --2- 172.21.15.80:0/626661491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15380734e0 0x7f1538071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153d410700 1 -- 172.21.15.80:0/626661491 >> v2:172.21.15.174:3300/0 conn(0x7f1538072360 msgr2=0x7f1538072800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:35.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153d410700 1 --2- 172.21.15.80:0/626661491 >> v2:172.21.15.174:3300/0 conn(0x7f1538072360 0x7f1538072800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:35.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153d410700 1 -- 172.21.15.80:0/626661491 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15380706c0 con 0x7f153806c0a0 2019-11-28T11:28:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153dc11700 1 --2- 172.21.15.80:0/626661491 >> v2:172.21.15.174:3300/0 conn(0x7f1538072360 0x7f1538072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.139+0000 7f153cc0f700 1 --2- 172.21.15.80:0/626661491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15380734e0 0x7f1538071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:35.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.140+0000 7f153d410700 1 --2- 172.21.15.80:0/626661491 >> v2:172.21.15.80:3300/0 conn(0x7f153806c0a0 0x7f1538072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f152800f740 tx=0x7f152800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.140+0000 7f153d410700 1 --2- 172.21.15.80:0/626661491 >> v2:172.21.15.80:3300/0 conn(0x7f153806c0a0 0x7f1538072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f152800f740 tx=0x7f152800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.140+0000 7f153d410700 1 --2- 172.21.15.80:0/626661491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f153806c0a0 0x7f1538072fa0 secure :-1 s=READY pgs=520 cs=0 l=1 rx=0x7f152800f740 tx=0x7f152800fae0).ready entity=mon.0 client_cookie=23cbe3b62e769ca0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.140+0000 7f153d410700 1 --2- 172.21.15.80:0/626661491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f153806c0a0 0x7f1538072fa0 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7f152800f740 tx=0x7f152800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.140+0000 7f1537fff700 1 -- 172.21.15.80:0/626661491 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1528000960 con 0x7f153806c0a0 2019-11-28T11:28:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.140+0000 7f153d410700 1 --2- 172.21.15.80:0/626661491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f153806c0a0 0x7f1538072fa0 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7f152800f740 tx=0x7f152800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:35.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.140+0000 7f153d410700 1 --2- 172.21.15.80:0/626661491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f153806c0a0 0x7f1538072fa0 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7f152800f740 tx=0x7f152800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.140+0000 7f1537fff700 1 -- 172.21.15.80:0/626661491 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1528000e80 con 0x7f153806c0a0 2019-11-28T11:28:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.140+0000 7f1537fff700 1 -- 172.21.15.80:0/626661491 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15280015d0 con 0x7f153806c0a0 2019-11-28T11:28:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.140+0000 7f153ee73700 1 -- 172.21.15.80:0/626661491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f153806c0a0 msgr2=0x7f1538072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.140+0000 7f153ee73700 1 --2- 172.21.15.80:0/626661491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f153806c0a0 0x7f1538072fa0 secure :-1 s=READY pgs=520 cs=0 l=1 rx=0x7f152800f740 tx=0x7f152800fae0).stop 2019-11-28T11:28:35.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.140+0000 7f153ee73700 1 -- 172.21.15.80:0/626661491 shutdown_connections 2019-11-28T11:28:35.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.140+0000 7f153ee73700 1 --2- 172.21.15.80:0/626661491 >> v2:172.21.15.174:3300/0 conn(0x7f1538072360 0x7f1538072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:35.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.140+0000 7f153ee73700 1 --2- 172.21.15.80:0/626661491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15380734e0 0x7f1538071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:35.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.140+0000 7f153ee73700 1 --2- 172.21.15.80:0/626661491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f153806c0a0 0x7f1538072fa0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:35.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.141+0000 7f153ee73700 1 -- 172.21.15.80:0/626661491 shutdown_connections 2019-11-28T11:28:35.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.141+0000 7f153ee73700 1 -- 172.21.15.80:0/626661491 wait complete. 2019-11-28T11:28:35.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.141+0000 7f153ee73700 1 -- 172.21.15.80:0/626661491 >> 172.21.15.80:0/626661491 conn(0x7f1538061cf0 msgr2=0x7f1538064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:35.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.143+0000 7f153ee73700 1 Processor -- start 2019-11-28T11:28:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.143+0000 7f153ee73700 1 -- start start 2019-11-28T11:28:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.144+0000 7f153ee73700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1538109e40 0x7f153810a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.144+0000 7f153ee73700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153813f1e0 con 0x7f153810a810 2019-11-28T11:28:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.144+0000 7f153ee73700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1538131a30 con 0x7f153813eb40 2019-11-28T11:28:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.144+0000 7f153ee73700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15381234c0 con 0x7f1538109e40 2019-11-28T11:28:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.144+0000 7f153dc11700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f153810a810 0x7f1538105210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60996/0 (socket says 172.21.15.80:60996) 2019-11-28T11:28:35.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.144+0000 7f153dc11700 1 -- 172.21.15.80:0/3485989346 learned_addr learned my addr 172.21.15.80:0/3485989346 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:35.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.144+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022691621 0 0) 0x7f1530009b10 con 0x7f153810a810 2019-11-28T11:28:35.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.144+0000 7f153cc0f700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1538109e40 0x7f153810a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:35.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.144+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f151c002e80 con 0x7f153810a810 2019-11-28T11:28:35.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2809595715 0 0) 0x7f1530009890 con 0x7f153810a810 2019-11-28T11:28:35.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f151c0032e0 con 0x7f153810a810 2019-11-28T11:28:35.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f1530001290 con 0x7f153810a810 2019-11-28T11:28:35.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1538109e40 msgr2=0x7f153810a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:35.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f1535ffb700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1538109e40 0x7f153810a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:35.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 >> v1:172.21.15.174:6789/0 conn(0x7f153813eb40 legacy=0x7f153810afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:35.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 >> v1:172.21.15.80:6789/0 conn(0x7f153810a810 legacy=0x7f1538105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:35.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f1535ffb700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c003400 0x7f151c003830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:35.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f1535ffb700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151c003d70 0x7f151c0041a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:35.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f1535ffb700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f151c0048a0 0x7f151c004d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:35.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c00bbf0 con 0x7f151c003400 2019-11-28T11:28:35.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c00bde0 con 0x7f151c0048a0 2019-11-28T11:28:35.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151c00c010 con 0x7f151c003d70 2019-11-28T11:28:35.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f153d410700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c003400 0x7f151c003830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:35.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f153dc11700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f151c0048a0 0x7f151c004d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:35.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f153cc0f700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151c003d70 0x7f151c0041a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:35.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f153d410700 1 -- 172.21.15.80:0/3485989346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151c003d70 msgr2=0x7f151c0041a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:35.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f153d410700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f151c003d70 0x7f151c0041a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:35.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f153d410700 1 -- 172.21.15.80:0/3485989346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f151c0048a0 msgr2=0x7f151c004d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:35.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f153d410700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f151c0048a0 0x7f151c004d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:35.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f153d410700 1 -- 172.21.15.80:0/3485989346 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c00c2c0 con 0x7f151c003400 2019-11-28T11:28:35.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f153ee73700 1 -- 172.21.15.80:0/3485989346 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1538108a80 con 0x7f151c003400 2019-11-28T11:28:35.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f153d410700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c003400 0x7f151c003830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1528008100 tx=0x7f1528008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:35.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f153ee73700 1 -- 172.21.15.80:0/3485989346 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1538108700 con 0x7f151c003400 2019-11-28T11:28:35.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f153d410700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c003400 0x7f151c003830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1528008100 tx=0x7f1528008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:35.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f153d410700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c003400 0x7f151c003830 secure :-1 s=READY pgs=522 cs=0 l=1 rx=0x7f1528008100 tx=0x7f1528008020).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:35.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f153d410700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c003400 0x7f151c003830 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f1528008100 tx=0x7f1528008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:35.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.145+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1528008140 con 0x7f151c003400 2019-11-28T11:28:35.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.146+0000 7f153d410700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c003400 0x7f151c003830 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f1528008100 tx=0x7f1528008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:35.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.146+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1528000e20 con 0x7f151c003400 2019-11-28T11:28:35.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.146+0000 7f153d410700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c003400 0x7f151c003830 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f1528008100 tx=0x7f1528008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:35.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.146+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1528001340 con 0x7f151c003400 2019-11-28T11:28:35.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.146+0000 7f153d410700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c003400 0x7f151c003830 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f1528008100 tx=0x7f1528008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:35.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.146+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1528001010 con 0x7f151c003400 2019-11-28T11:28:35.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.146+0000 7f153d410700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c003400 0x7f151c003830 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f1528008100 tx=0x7f1528008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:35.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.146+0000 7f1535ffb700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f151c020be0 0x7f151c023010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:35.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.146+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1528075be0 con 0x7f151c003400 2019-11-28T11:28:35.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.146+0000 7f153cc0f700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f151c020be0 0x7f151c023010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:35.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.147+0000 7f153cc0f700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f151c020be0 0x7f151c023010 crc :-1 s=READY pgs=224 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:35.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.153+0000 7f153ee73700 1 -- 172.21.15.80:0/3485989346 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1510002e60 con 0x7f151c003400 2019-11-28T11:28:35.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.157+0000 7f153d410700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c003400 0x7f151c003830 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f1528008100 tx=0x7f1528008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:35.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.157+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f15280009d0 con 0x7f151c003400 2019-11-28T11:28:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.328+0000 7f153ee73700 1 -- 172.21.15.80:0/3485989346 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1510001d10 con 0x7f151c003400 2019-11-28T11:28:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.328+0000 7f153d410700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c003400 0x7f151c003830 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f1528008100 tx=0x7f1528008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.328+0000 7f1535ffb700 1 -- 172.21.15.80:0/3485989346 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2445 (secure 0 0 0) 0x7f1528001800 con 0x7f151c003400 2019-11-28T11:28:35.357 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 21 2019-11-28T11:28:35.357 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:35.358 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3295602533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3295602533},{"type":"v1","addr":"172.21.15.80:6834","nonce":3295602533}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":20},{"gid":5559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1936159041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1936159041},{"type":"v1","addr":"172.21.15.80:6835","nonce":1936159041}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:27.955433+0000","modified":"2019-11-28T11:28:34.745110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5401":{"gid":5401,"name":"c","rank":0,"incarnation":21,"state":"up:creating","state_seq":2,"addr":"172.21.15.174:6835/160551131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":160551131},{"type":"v1","addr":"172.21.15.174:6835","nonce":160551131}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2019-11-28T11:28:35.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.330+0000 7f153ee73700 1 -- 172.21.15.80:0/3485989346 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f151c020be0 msgr2=0x7f151c023010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:35.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.330+0000 7f153ee73700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f151c020be0 0x7f151c023010 crc :-1 s=READY pgs=224 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:35.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.330+0000 7f153ee73700 1 -- 172.21.15.80:0/3485989346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c003400 msgr2=0x7f151c003830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:35.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.331+0000 7f153ee73700 1 --2- 172.21.15.80:0/3485989346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c003400 0x7f151c003830 secure :-1 s=READY pgs=522 cs=0 l=1 rx=0x7f1528008100 tx=0x7f1528008020).stop 2019-11-28T11:28:35.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.331+0000 7f153dc11700 1 -- 172.21.15.80:0/3485989346 reap_dead start 2019-11-28T11:28:35.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.331+0000 7f153ee73700 1 -- 172.21.15.80:0/3485989346 shutdown_connections 2019-11-28T11:28:35.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.331+0000 7f153ee73700 1 -- 172.21.15.80:0/3485989346 shutdown_connections 2019-11-28T11:28:35.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.331+0000 7f153ee73700 1 -- 172.21.15.80:0/3485989346 wait complete. 2019-11-28T11:28:35.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:35.331+0000 7f153ee73700 1 -- 172.21.15.80:0/3485989346 >> 172.21.15.80:0/3485989346 conn(0x7f153811bfc0 msgr2=0x7f1538141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:35.673 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5401}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 6, u'failed': [], u'epoch': 21, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [7], u'info': {u'gid_5401': {u'export_targets': [], u'name': u'c', u'incarnation': 21, u'state_seq': 2, u'state': u'up:creating', u'gid': 5401, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 160551131, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 160551131, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/160551131'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:28:27.955433+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:28:34.745110+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:28:35.673 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5401:up:creating 2019-11-28T11:28:36.674 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:28:36.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.777+0000 7f9d61da7700 1 Processor -- start 2019-11-28T11:28:36.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.777+0000 7f9d61da7700 1 -- start start 2019-11-28T11:28:36.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.778+0000 7f9d61da7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d5c06c0a0 0x7f9d5c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:36.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.778+0000 7f9d61da7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9d5c0734e0 0x7f9d5c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:36.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.778+0000 7f9d61da7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c06db00 con 0x7f9d5c072360 2019-11-28T11:28:36.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.778+0000 7f9d61da7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c06f330 con 0x7f9d5c0734e0 2019-11-28T11:28:36.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.778+0000 7f9d61da7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0706c0 con 0x7f9d5c06c0a0 2019-11-28T11:28:36.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.778+0000 7f9d60b45700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9d5c072360 0x7f9d5c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32774/0 (socket says 172.21.15.80:32774) 2019-11-28T11:28:36.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.778+0000 7f9d60b45700 1 -- 172.21.15.80:0/2506258378 learned_addr learned my addr 172.21.15.80:0/2506258378 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:36.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.778+0000 7f9d53fff700 1 --2- 172.21.15.80:0/2506258378 >> v2:172.21.15.174:3300/0 conn(0x7f9d5c0734e0 0x7f9d5c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:36.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.778+0000 7f9d5bfff700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d5c06c0a0 0x7f9d5c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:36.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.778+0000 7f9d5b7fe700 1 -- 172.21.15.80:0/2506258378 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121864824 0 0) 0x7f9d540014d0 con 0x7f9d5c072360 2019-11-28T11:28:36.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.778+0000 7f9d5b7fe700 1 -- 172.21.15.80:0/2506258378 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d3c002e80 con 0x7f9d5c072360 2019-11-28T11:28:36.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 -- 172.21.15.80:0/2506258378 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2227655997 0 0) 0x7f9d540014b0 con 0x7f9d5c072360 2019-11-28T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 -- 172.21.15.80:0/2506258378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d5c06c0a0 msgr2=0x7f9d5c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d5c06c0a0 0x7f9d5c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 -- 172.21.15.80:0/2506258378 >> v2:172.21.15.174:3300/0 conn(0x7f9d5c0734e0 msgr2=0x7f9d5c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 --2- 172.21.15.80:0/2506258378 >> v2:172.21.15.174:3300/0 conn(0x7f9d5c0734e0 0x7f9d5c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 -- 172.21.15.80:0/2506258378 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c070a40 con 0x7f9d5c072360 2019-11-28T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 -- 172.21.15.80:0/2506258378 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f9d540019e0 con 0x7f9d5c072360 2019-11-28T11:28:36.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d53fff700 1 --2- 172.21.15.80:0/2506258378 >> v2:172.21.15.174:3300/0 conn(0x7f9d5c0734e0 0x7f9d5c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:36.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5bfff700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d5c06c0a0 0x7f9d5c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:36.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 -- 172.21.15.80:0/2506258378 >> v1:172.21.15.80:6789/0 conn(0x7f9d5c072360 legacy=0x7f9d5c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:36.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d3c0479e0 0x7f9d3c049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:36.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d3c04a5c0 0x7f9d3c04ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:36.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d3c04d260 0x7f9d3c04f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:36.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 -- 172.21.15.80:0/2506258378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c04ff40 con 0x7f9d3c04d260 2019-11-28T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 -- 172.21.15.80:0/2506258378 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c050100 con 0x7f9d3c0479e0 2019-11-28T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 -- 172.21.15.80:0/2506258378 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c050330 con 0x7f9d3c04a5c0 2019-11-28T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d60b45700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d3c04d260 0x7f9d3c04f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d53fff700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d3c04a5c0 0x7f9d3c04ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5bfff700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d3c0479e0 0x7f9d3c049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d60b45700 1 -- 172.21.15.80:0/2506258378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d3c04a5c0 msgr2=0x7f9d3c04ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:36.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d60b45700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d3c04a5c0 0x7f9d3c04ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d60b45700 1 -- 172.21.15.80:0/2506258378 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d3c0479e0 msgr2=0x7f9d3c049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d60b45700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d3c0479e0 0x7f9d3c049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d60b45700 1 -- 172.21.15.80:0/2506258378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c0505e0 con 0x7f9d3c04d260 2019-11-28T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5bfff700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d3c0479e0 0x7f9d3c049e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d60b45700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d3c04d260 0x7f9d3c04f730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9d5400fc90 tx=0x7f9d54001ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:36.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d60b45700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d3c04d260 0x7f9d3c04f730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9d5400fc90 tx=0x7f9d54001ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:36.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d60b45700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d3c04d260 0x7f9d3c04f730 secure :-1 s=READY pgs=524 cs=0 l=1 rx=0x7f9d5400fc90 tx=0x7f9d54001ad0).ready entity=mon.0 client_cookie=a51b416c2c5de3c4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:36.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d60b45700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d3c04d260 0x7f9d3c04f730 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7f9d5400fc90 tx=0x7f9d54001ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:36.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 -- 172.21.15.80:0/2506258378 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d54001c00 con 0x7f9d3c04d260 2019-11-28T11:28:36.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d60b45700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d3c04d260 0x7f9d3c04f730 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7f9d5400fc90 tx=0x7f9d54001ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:36.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d60b45700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d3c04d260 0x7f9d3c04f730 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7f9d5400fc90 tx=0x7f9d54001ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:36.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 -- 172.21.15.80:0/2506258378 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d540045c0 con 0x7f9d3c04d260 2019-11-28T11:28:36.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.779+0000 7f9d5b7fe700 1 -- 172.21.15.80:0/2506258378 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d54004c50 con 0x7f9d3c04d260 2019-11-28T11:28:36.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.780+0000 7f9d61da7700 1 -- 172.21.15.80:0/2506258378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d3c04d260 msgr2=0x7f9d3c04f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:36.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.780+0000 7f9d61da7700 1 --2- 172.21.15.80:0/2506258378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d3c04d260 0x7f9d3c04f730 secure :-1 s=READY pgs=524 cs=0 l=1 rx=0x7f9d5400fc90 tx=0x7f9d54001ad0).stop 2019-11-28T11:28:36.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.780+0000 7f9d60b45700 1 -- 172.21.15.80:0/2506258378 reap_dead start 2019-11-28T11:28:36.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.780+0000 7f9d61da7700 1 -- 172.21.15.80:0/2506258378 shutdown_connections 2019-11-28T11:28:36.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.780+0000 7f9d61da7700 1 -- 172.21.15.80:0/2506258378 shutdown_connections 2019-11-28T11:28:36.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.780+0000 7f9d61da7700 1 -- 172.21.15.80:0/2506258378 wait complete. 2019-11-28T11:28:36.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.780+0000 7f9d61da7700 1 -- 172.21.15.80:0/2506258378 >> 172.21.15.80:0/2506258378 conn(0x7f9d5c061cf0 msgr2=0x7f9d5c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:36.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.783+0000 7f9d61da7700 1 Processor -- start 2019-11-28T11:28:36.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.783+0000 7f9d61da7700 1 -- start start 2019-11-28T11:28:36.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.783+0000 7f9d61da7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d5c107940 0x7f9d5c10f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d61da7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9d5c10f7a0 0x7f9d5c1629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d61da7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c107110 con 0x7f9d5c13fb20 2019-11-28T11:28:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d61da7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c13b5e0 con 0x7f9d5c10f7a0 2019-11-28T11:28:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d61da7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c13b8b0 con 0x7f9d5c107940 2019-11-28T11:28:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d5bfff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f9d5c13fb20 0x7f9d5c1080b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:48328/0 (socket says 172.21.15.80:48328) 2019-11-28T11:28:36.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d60b45700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9d5c10f7a0 0x7f9d5c1629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:36.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d5bfff700 1 -- 172.21.15.80:0/4210124041 learned_addr learned my addr 172.21.15.80:0/4210124041 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:36.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d53fff700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d5c107940 0x7f9d5c10f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:36.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d60b45700 1 -- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d5c107940 msgr2=0x7f9d5c10f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:36.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d597fa700 1 -- 172.21.15.80:0/4210124041 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626124727 0 0) 0x7f9d4c009c00 con 0x7f9d5c13fb20 2019-11-28T11:28:36.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d60b45700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d5c107940 0x7f9d5c10f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:36.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d60b45700 1 -- 172.21.15.80:0/4210124041 >> v1:172.21.15.174:6789/0 conn(0x7f9d5c13fb20 legacy=0x7f9d5c1080b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:36.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d60b45700 1 -- 172.21.15.80:0/4210124041 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c13bf40 con 0x7f9d5c10f7a0 2019-11-28T11:28:36.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d53fff700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d5c107940 0x7f9d5c10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:36.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d60b45700 1 --2- 172.21.15.80:0/4210124041 >> v2:172.21.15.174:3300/0 conn(0x7f9d5c10f7a0 0x7f9d5c1629f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9d540106c0 tx=0x7f9d54010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:36.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d60b45700 1 --2- 172.21.15.80:0/4210124041 >> v2:172.21.15.174:3300/0 conn(0x7f9d5c10f7a0 0x7f9d5c1629f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9d540106c0 tx=0x7f9d54010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:36.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d60b45700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d5c10f7a0 0x7f9d5c1629f0 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7f9d540106c0 tx=0x7f9d54010a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:36.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d60b45700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d5c10f7a0 0x7f9d5c1629f0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f9d540106c0 tx=0x7f9d54010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:36.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d597fa700 1 -- 172.21.15.80:0/4210124041 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d54001960 con 0x7f9d5c10f7a0 2019-11-28T11:28:36.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d60b45700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d5c10f7a0 0x7f9d5c1629f0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f9d540106c0 tx=0x7f9d54010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:36.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d597fa700 1 -- 172.21.15.80:0/4210124041 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d540045c0 con 0x7f9d5c10f7a0 2019-11-28T11:28:36.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d60b45700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d5c10f7a0 0x7f9d5c1629f0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f9d540106c0 tx=0x7f9d54010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:36.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d597fa700 1 -- 172.21.15.80:0/4210124041 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d54001960 con 0x7f9d5c10f7a0 2019-11-28T11:28:36.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d61da7700 1 -- 172.21.15.80:0/4210124041 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c10dea0 con 0x7f9d5c10f7a0 2019-11-28T11:28:36.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.784+0000 7f9d61da7700 1 -- 172.21.15.80:0/4210124041 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5c13bf40 con 0x7f9d5c10f7a0 2019-11-28T11:28:36.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.785+0000 7f9d60b45700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d5c10f7a0 0x7f9d5c1629f0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f9d540106c0 tx=0x7f9d54010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:36.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.785+0000 7f9d597fa700 1 -- 172.21.15.80:0/4210124041 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9d540047b0 con 0x7f9d5c10f7a0 2019-11-28T11:28:36.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.785+0000 7f9d60b45700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d5c10f7a0 0x7f9d5c1629f0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f9d540106c0 tx=0x7f9d54010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:36.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.785+0000 7f9d597fa700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d34018730 0x7f9d3401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:36.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.785+0000 7f9d597fa700 1 -- 172.21.15.80:0/4210124041 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9d54031d70 con 0x7f9d5c10f7a0 2019-11-28T11:28:36.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.785+0000 7f9d5bfff700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d34018730 0x7f9d3401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:36.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.786+0000 7f9d5bfff700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d34018730 0x7f9d3401abc0 crc :-1 s=READY pgs=225 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:36.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.792+0000 7f9d61da7700 1 -- 172.21.15.80:0/4210124041 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5c10dea0 con 0x7f9d5c10f7a0 2019-11-28T11:28:36.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.796+0000 7f9d60b45700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d5c10f7a0 0x7f9d5c1629f0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f9d540106c0 tx=0x7f9d54010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:36.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.796+0000 7f9d597fa700 1 -- 172.21.15.80:0/4210124041 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9d54000f20 con 0x7f9d5c10f7a0 2019-11-28T11:28:36.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.966+0000 7f9d61da7700 1 -- 172.21.15.80:0/4210124041 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d5c13bf40 con 0x7f9d5c10f7a0 2019-11-28T11:28:36.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.966+0000 7f9d60b45700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d5c10f7a0 0x7f9d5c1629f0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f9d540106c0 tx=0x7f9d54010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:36.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.966+0000 7f9d597fa700 1 -- 172.21.15.80:0/4210124041 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+2443 (secure 0 0 0) 0x7f9d5401f990 con 0x7f9d5c10f7a0 2019-11-28T11:28:36.997 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 22 2019-11-28T11:28:36.997 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:36.998 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3295602533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3295602533},{"type":"v1","addr":"172.21.15.80:6834","nonce":3295602533}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":20},{"gid":5559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1936159041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1936159041},{"type":"v1","addr":"172.21.15.80:6835","nonce":1936159041}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:27.955433+0000","modified":"2019-11-28T11:28:35.746800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5401":{"gid":5401,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/160551131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":160551131},{"type":"v1","addr":"172.21.15.174:6835","nonce":160551131}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2019-11-28T11:28:37.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.968+0000 7f9d61da7700 1 -- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d34018730 msgr2=0x7f9d3401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.968+0000 7f9d61da7700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d34018730 0x7f9d3401abc0 crc :-1 s=READY pgs=225 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:37.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.968+0000 7f9d61da7700 1 -- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d5c10f7a0 msgr2=0x7f9d5c1629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.968+0000 7f9d61da7700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d5c10f7a0 0x7f9d5c1629f0 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7f9d540106c0 tx=0x7f9d54010a60).stop 2019-11-28T11:28:37.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.968+0000 7f9d61da7700 1 -- 172.21.15.80:0/4210124041 shutdown_connections 2019-11-28T11:28:37.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.968+0000 7f9d61da7700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d5c10f7a0 0x7f9d5c1629f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:37.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.968+0000 7f9d61da7700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d5c107940 0x7f9d5c10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:37.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.968+0000 7f9d61da7700 1 --2- 172.21.15.80:0/4210124041 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d34018730 0x7f9d3401abc0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:37.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.968+0000 7f9d61da7700 1 -- 172.21.15.80:0/4210124041 shutdown_connections 2019-11-28T11:28:37.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.968+0000 7f9d61da7700 1 -- 172.21.15.80:0/4210124041 wait complete. 2019-11-28T11:28:37.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:36.968+0000 7f9d61da7700 1 -- 172.21.15.80:0/4210124041 >> 172.21.15.80:0/4210124041 conn(0x7f9d5c142090 msgr2=0x7f9d5c10ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:37.322 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5401}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 6, u'failed': [], u'epoch': 22, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [7], u'info': {u'gid_5401': {u'export_targets': [], u'name': u'c', u'incarnation': 21, u'state_seq': 3, u'state': u'up:active', u'gid': 5401, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 160551131, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 160551131, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/160551131'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:28:27.955433+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:28:35.746800+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:28:37.322 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:28:37.323 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:28:37.458 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:28:37.458 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:28:37.459 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:28:37.459 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5401, 2019-11-28T11:28:37.459 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:28:37.459 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:28:37.460 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 2.6843609220000002, 2019-11-28T11:28:37.460 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 22, 2019-11-28T11:28:37.460 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 47, 2019-11-28T11:28:37.460 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 47, 2019-11-28T11:28:37.461 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 7.0438770980000003 2019-11-28T11:28:37.461 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:28:37.466 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5401, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.6843609220000002, "mdsmap_epoch": 22, "osdmap_epoch": 47, "osdmap_epoch_barrier": 47, "uptime": 7.0438770980000003 } 2019-11-28T11:28:37.466 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:28:37.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.558+0000 7f056a034700 1 Processor -- start 2019-11-28T11:28:37.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.558+0000 7f056a034700 1 -- start start 2019-11-28T11:28:37.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.559+0000 7f056a034700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f056406c490 0x7f056406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:37.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.559+0000 7f056a034700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056406db00 con 0x7f056406ce60 2019-11-28T11:28:37.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.559+0000 7f056a034700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056406e000 con 0x7f056406c0a0 2019-11-28T11:28:37.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.559+0000 7f056a034700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056406fd60 con 0x7f056406c490 2019-11-28T11:28:37.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.559+0000 7f0568dd2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f056406ce60 0x7f0564164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32796/0 (socket says 172.21.15.80:32796) 2019-11-28T11:28:37.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.559+0000 7f0568dd2700 1 -- 172.21.15.80:0/4276469353 learned_addr learned my addr 172.21.15.80:0/4276469353 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:37.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f055bfff700 1 --2- 172.21.15.80:0/4276469353 >> v2:172.21.15.174:3300/0 conn(0x7f056406c490 0x7f056406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:37.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f05637fe700 1 -- 172.21.15.80:0/4276469353 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972421141 0 0) 0x7f055c0014d0 con 0x7f056406ce60 2019-11-28T11:28:37.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f05637fe700 1 -- 172.21.15.80:0/4276469353 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0550002e80 con 0x7f056406ce60 2019-11-28T11:28:37.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f05637fe700 1 -- 172.21.15.80:0/4276469353 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3806816818 0 0) 0x7f055c0014b0 con 0x7f056406ce60 2019-11-28T11:28:37.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f05637fe700 1 -- 172.21.15.80:0/4276469353 >> v2:172.21.15.174:3300/0 conn(0x7f056406c490 msgr2=0x7f056406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:37.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f05637fe700 1 --2- 172.21.15.80:0/4276469353 >> v2:172.21.15.174:3300/0 conn(0x7f056406c490 0x7f056406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:37.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f05637fe700 1 -- 172.21.15.80:0/4276469353 >> v1:172.21.15.174:6789/0 conn(0x7f056406c0a0 legacy=0x7f0564072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f05637fe700 1 -- 172.21.15.80:0/4276469353 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05640706c0 con 0x7f056406ce60 2019-11-28T11:28:37.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f05637fe700 1 -- 172.21.15.80:0/4276469353 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f055c0019e0 con 0x7f056406ce60 2019-11-28T11:28:37.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f05637fe700 1 -- 172.21.15.80:0/4276469353 >> v1:172.21.15.80:6789/0 conn(0x7f056406ce60 legacy=0x7f0564164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f05637fe700 1 --2- 172.21.15.80:0/4276469353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0550003ab0 0x7f0550005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:37.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f05637fe700 1 --2- 172.21.15.80:0/4276469353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0550006690 0x7f0550008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:37.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f05637fe700 1 --2- 172.21.15.80:0/4276469353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0550009380 0x7f055000b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:37.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f05637fe700 1 -- 172.21.15.80:0/4276469353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055000c000 con 0x7f0550006690 2019-11-28T11:28:37.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f05637fe700 1 -- 172.21.15.80:0/4276469353 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0550050200 con 0x7f0550003ab0 2019-11-28T11:28:37.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f05637fe700 1 -- 172.21.15.80:0/4276469353 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0550050430 con 0x7f0550009380 2019-11-28T11:28:37.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f055bfff700 1 --2- 172.21.15.80:0/4276469353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0550006690 0x7f0550008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:37.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f0563fff700 1 --2- 172.21.15.80:0/4276469353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0550003ab0 0x7f0550005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:37.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f0568dd2700 1 --2- 172.21.15.80:0/4276469353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0550009380 0x7f055000b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:37.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f055bfff700 1 -- 172.21.15.80:0/4276469353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0550009380 msgr2=0x7f055000b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:37.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f055bfff700 1 --2- 172.21.15.80:0/4276469353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0550009380 0x7f055000b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:37.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f055bfff700 1 -- 172.21.15.80:0/4276469353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0550003ab0 msgr2=0x7f0550005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:37.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f055bfff700 1 --2- 172.21.15.80:0/4276469353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0550003ab0 0x7f0550005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:37.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f0568dd2700 1 -- 172.21.15.80:0/4276469353 reap_dead start 2019-11-28T11:28:37.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.560+0000 7f055bfff700 1 -- 172.21.15.80:0/4276469353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05500506e0 con 0x7f0550006690 2019-11-28T11:28:37.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.561+0000 7f055bfff700 1 --2- 172.21.15.80:0/4276469353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0550006690 0x7f0550008b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f054c00b660 tx=0x7f054c00aab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.561+0000 7f055bfff700 1 --2- 172.21.15.80:0/4276469353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0550006690 0x7f0550008b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f054c00b660 tx=0x7f054c00aab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.561+0000 7f055bfff700 1 --2- 172.21.15.80:0/4276469353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0550006690 0x7f0550008b20 secure :-1 s=READY pgs=526 cs=0 l=1 rx=0x7f054c00b660 tx=0x7f054c00aab0).ready entity=mon.0 client_cookie=34da040fd71a1623 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:37.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.561+0000 7f055bfff700 1 --2- 172.21.15.80:0/4276469353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0550006690 0x7f0550008b20 secure :-1 s=THROTTLE_DONE pgs=526 cs=0 l=1 rx=0x7f054c00b660 tx=0x7f054c00aab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.561+0000 7f05637fe700 1 -- 172.21.15.80:0/4276469353 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c000960 con 0x7f0550006690 2019-11-28T11:28:37.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.561+0000 7f055bfff700 1 --2- 172.21.15.80:0/4276469353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0550006690 0x7f0550008b20 secure :-1 s=THROTTLE_DONE pgs=526 cs=0 l=1 rx=0x7f054c00b660 tx=0x7f054c00aab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.561+0000 7f055bfff700 1 --2- 172.21.15.80:0/4276469353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0550006690 0x7f0550008b20 secure :-1 s=THROTTLE_DONE pgs=526 cs=0 l=1 rx=0x7f054c00b660 tx=0x7f054c00aab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.561+0000 7f05637fe700 1 -- 172.21.15.80:0/4276469353 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c009770 con 0x7f0550006690 2019-11-28T11:28:37.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.561+0000 7f05637fe700 1 -- 172.21.15.80:0/4276469353 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c009e80 con 0x7f0550006690 2019-11-28T11:28:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.561+0000 7f056a034700 1 -- 172.21.15.80:0/4276469353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0550006690 msgr2=0x7f0550008b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.561+0000 7f056a034700 1 --2- 172.21.15.80:0/4276469353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0550006690 0x7f0550008b20 secure :-1 s=READY pgs=526 cs=0 l=1 rx=0x7f054c00b660 tx=0x7f054c00aab0).stop 2019-11-28T11:28:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.561+0000 7f056a034700 1 -- 172.21.15.80:0/4276469353 shutdown_connections 2019-11-28T11:28:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.561+0000 7f056a034700 1 --2- 172.21.15.80:0/4276469353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0550006690 0x7f0550008b20 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.561+0000 7f056a034700 1 -- 172.21.15.80:0/4276469353 shutdown_connections 2019-11-28T11:28:37.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.561+0000 7f056a034700 1 -- 172.21.15.80:0/4276469353 wait complete. 2019-11-28T11:28:37.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.561+0000 7f056a034700 1 -- 172.21.15.80:0/4276469353 >> 172.21.15.80:0/4276469353 conn(0x7f0564061cf0 msgr2=0x7f0564064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:37.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.564+0000 7f056a034700 1 Processor -- start 2019-11-28T11:28:37.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.564+0000 7f056a034700 1 -- start start 2019-11-28T11:28:37.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.565+0000 7f056a034700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0564074d00 0x7f056407aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:37.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.565+0000 7f056a034700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05640754d0 con 0x7f056407bba0 2019-11-28T11:28:37.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.565+0000 7f056a034700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056412eb20 con 0x7f0564150f50 2019-11-28T11:28:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.565+0000 7f056a034700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0564077f50 con 0x7f0564074d00 2019-11-28T11:28:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.565+0000 7f0568dd2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f056407bba0 0x7f0564167c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32808/0 (socket says 172.21.15.80:32808) 2019-11-28T11:28:37.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.565+0000 7f0568dd2700 1 -- 172.21.15.80:0/137297917 learned_addr learned my addr 172.21.15.80:0/137297917 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:37.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.565+0000 7f0563fff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0564074d00 0x7f056407aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:37.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.565+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214106229 0 0) 0x7f055c0012c0 con 0x7f056407bba0 2019-11-28T11:28:37.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.565+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0548002e80 con 0x7f056407bba0 2019-11-28T11:28:37.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579889604 0 0) 0x7f054c009610 con 0x7f0564150f50 2019-11-28T11:28:37.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05480030b0 con 0x7f0564150f50 2019-11-28T11:28:37.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2337635641 0 0) 0x7f055c000cc0 con 0x7f056407bba0 2019-11-28T11:28:37.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f05480030b0 con 0x7f056407bba0 2019-11-28T11:28:37.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f055c001bf0 con 0x7f056407bba0 2019-11-28T11:28:37.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0564074d00 msgr2=0x7f056407aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0564074d00 0x7f056407aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:37.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 >> v1:172.21.15.174:6789/0 conn(0x7f0564150f50 legacy=0x7f056407af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 >> v1:172.21.15.80:6789/0 conn(0x7f056407bba0 legacy=0x7f0564167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0548005c60 0x7f0548006050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05480046d0 0x7f0548004b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0548003190 0x7f05480035e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0548003b20 con 0x7f05480046d0 2019-11-28T11:28:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0548003d50 con 0x7f0548005c60 2019-11-28T11:28:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0548003f80 con 0x7f0548003190 2019-11-28T11:28:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f0563fff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0564074d00 0x7f056407aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f055bfff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05480046d0 0x7f0548004b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f0568dd2700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0548003190 0x7f05480035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:37.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f0563fff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0548005c60 0x7f0548006050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:37.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f055bfff700 1 -- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0548003190 msgr2=0x7f05480035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f055bfff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0548003190 0x7f05480035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:37.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f055bfff700 1 -- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0548005c60 msgr2=0x7f0548006050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f055bfff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0548005c60 0x7f0548006050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:37.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f055bfff700 1 -- 172.21.15.80:0/137297917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548004230 con 0x7f05480046d0 2019-11-28T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f056a034700 1 -- 172.21.15.80:0/137297917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0564079660 con 0x7f05480046d0 2019-11-28T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f055bfff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05480046d0 0x7f0548004b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f056a034700 1 -- 172.21.15.80:0/137297917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05640792e0 con 0x7f05480046d0 2019-11-28T11:28:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f055bfff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05480046d0 0x7f0548004b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f055bfff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05480046d0 0x7f0548004b50 secure :-1 s=READY pgs=528 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010230).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f055bfff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05480046d0 0x7f0548004b50 secure :-1 s=THROTTLE_DONE pgs=528 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f055bfff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05480046d0 0x7f0548004b50 secure :-1 s=THROTTLE_DONE pgs=528 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c009580 con 0x7f05480046d0 2019-11-28T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f055bfff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05480046d0 0x7f0548004b50 secure :-1 s=THROTTLE_DONE pgs=528 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c009df0 con 0x7f05480046d0 2019-11-28T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.566+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c00a480 con 0x7f05480046d0 2019-11-28T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.567+0000 7f055bfff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05480046d0 0x7f0548004b50 secure :-1 s=THROTTLE_DONE pgs=528 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.567+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f054c009580 con 0x7f05480046d0 2019-11-28T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.567+0000 7f055bfff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05480046d0 0x7f0548004b50 secure :-1 s=THROTTLE_DONE pgs=528 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.567+0000 7f05617fa700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0548020ba0 0x7f0548022fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.567+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f054c031ba0 con 0x7f05480046d0 2019-11-28T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.567+0000 7f0563fff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0548020ba0 0x7f0548022fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.567+0000 7f0563fff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0548020ba0 0x7f0548022fd0 crc :-1 s=READY pgs=226 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.573+0000 7f056a034700 1 -- 172.21.15.80:0/137297917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053c002e60 con 0x7f05480046d0 2019-11-28T11:28:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.577+0000 7f055bfff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05480046d0 0x7f0548004b50 secure :-1 s=THROTTLE_DONE pgs=528 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.577+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f054c0099f0 con 0x7f05480046d0 2019-11-28T11:28:37.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.751+0000 7f056a034700 1 -- 172.21.15.80:0/137297917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f053c001d10 con 0x7f05480046d0 2019-11-28T11:28:37.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.752+0000 7f055bfff700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05480046d0 0x7f0548004b50 secure :-1 s=THROTTLE_DONE pgs=528 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.752+0000 7f05617fa700 1 -- 172.21.15.80:0/137297917 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+14857 (secure 0 0 0) 0x7f054c009580 con 0x7f05480046d0 2019-11-28T11:28:37.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.754+0000 7f056a034700 1 -- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0548020ba0 msgr2=0x7f0548022fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.754+0000 7f056a034700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0548020ba0 0x7f0548022fd0 crc :-1 s=READY pgs=226 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:37.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.754+0000 7f056a034700 1 -- 172.21.15.80:0/137297917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05480046d0 msgr2=0x7f0548004b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.754+0000 7f056a034700 1 --2- 172.21.15.80:0/137297917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05480046d0 0x7f0548004b50 secure :-1 s=READY pgs=528 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010230).stop 2019-11-28T11:28:37.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.754+0000 7f0568dd2700 1 -- 172.21.15.80:0/137297917 reap_dead start 2019-11-28T11:28:37.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.754+0000 7f0568dd2700 1 -- 172.21.15.80:0/137297917 reap_dead start 2019-11-28T11:28:37.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.754+0000 7f056a034700 1 -- 172.21.15.80:0/137297917 shutdown_connections 2019-11-28T11:28:37.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.754+0000 7f056a034700 1 -- 172.21.15.80:0/137297917 shutdown_connections 2019-11-28T11:28:37.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.754+0000 7f056a034700 1 -- 172.21.15.80:0/137297917 wait complete. 2019-11-28T11:28:37.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.754+0000 7f056a034700 1 -- 172.21.15.80:0/137297917 >> 172.21.15.80:0/137297917 conn(0x7f056413fa50 msgr2=0x7f056407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:37.797 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:37.797 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":47,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:28:29.965726+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:28:26.282940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2019-11-28T11:28:26.978374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:28:37.799 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:28:26.282940+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 6, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'46', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:28:26.978374+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 7, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'47', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:28:37.799 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:28:37.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.910+0000 7f2ba07fd700 1 Processor -- start 2019-11-28T11:28:37.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.910+0000 7f2ba07fd700 1 -- start start 2019-11-28T11:28:37.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.911+0000 7f2ba07fd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b9815ed10 0x7f2b9815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:37.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.911+0000 7f2ba07fd700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9806db60 con 0x7f2b980734b0 2019-11-28T11:28:37.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.911+0000 7f2ba07fd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9806e060 con 0x7f2b98073020 2019-11-28T11:28:37.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.911+0000 7f2ba07fd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9806f3d0 con 0x7f2b9815ed10 2019-11-28T11:28:37.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.911+0000 7f2b9f59b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2b980734b0 0x7f2b980726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32820/0 (socket says 172.21.15.80:32820) 2019-11-28T11:28:37.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.911+0000 7f2b9f59b700 1 -- 172.21.15.80:0/4230024377 learned_addr learned my addr 172.21.15.80:0/4230024377 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:37.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.911+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4230024377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b9815ed10 0x7f2b9815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:37.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2b9dd98700 1 -- 172.21.15.80:0/4230024377 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937036513 0 0) 0x7f2b90001150 con 0x7f2b980734b0 2019-11-28T11:28:37.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2b9dd98700 1 -- 172.21.15.80:0/4230024377 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b84002e80 con 0x7f2b980734b0 2019-11-28T11:28:37.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2b9dd98700 1 -- 172.21.15.80:0/4230024377 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349132421 0 0) 0x7f2b88001030 con 0x7f2b98073020 2019-11-28T11:28:37.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2b9dd98700 1 -- 172.21.15.80:0/4230024377 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b84004170 con 0x7f2b98073020 2019-11-28T11:28:37.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2b9ed9a700 1 -- 172.21.15.80:0/4230024377 >> v1:172.21.15.174:6789/0 conn(0x7f2b98073020 legacy=0x7f2b98071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2b9ed9a700 1 -- 172.21.15.80:0/4230024377 >> v1:172.21.15.80:6789/0 conn(0x7f2b980734b0 legacy=0x7f2b980726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2b9ed9a700 1 -- 172.21.15.80:0/4230024377 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b98070760 con 0x7f2b9815ed10 2019-11-28T11:28:37.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4230024377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b9815ed10 0x7f2b9815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2b8000b2d0 tx=0x7f2b8000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4230024377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b9815ed10 0x7f2b9815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2b8000b2d0 tx=0x7f2b8000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4230024377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b9815ed10 0x7f2b9815f100 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f2b8000b2d0 tx=0x7f2b8000bae0).ready entity=mon.2 client_cookie=2ac7071b362b8dfb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:37.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4230024377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b9815ed10 0x7f2b9815f100 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f2b8000b2d0 tx=0x7f2b8000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2b9dd98700 1 -- 172.21.15.80:0/4230024377 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b80000ce0 con 0x7f2b9815ed10 2019-11-28T11:28:37.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4230024377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b9815ed10 0x7f2b9815f100 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f2b8000b2d0 tx=0x7f2b8000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4230024377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b9815ed10 0x7f2b9815f100 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f2b8000b2d0 tx=0x7f2b8000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2b9dd98700 1 -- 172.21.15.80:0/4230024377 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b80009be0 con 0x7f2b9815ed10 2019-11-28T11:28:37.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2b9dd98700 1 -- 172.21.15.80:0/4230024377 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b8000a2b0 con 0x7f2b9815ed10 2019-11-28T11:28:37.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2ba07fd700 1 -- 172.21.15.80:0/4230024377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b9815ed10 msgr2=0x7f2b9815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.912+0000 7f2ba07fd700 1 --2- 172.21.15.80:0/4230024377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b9815ed10 0x7f2b9815f100 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f2b8000b2d0 tx=0x7f2b8000bae0).stop 2019-11-28T11:28:37.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.913+0000 7f2ba07fd700 1 -- 172.21.15.80:0/4230024377 shutdown_connections 2019-11-28T11:28:37.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.913+0000 7f2ba07fd700 1 --2- 172.21.15.80:0/4230024377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b9815ed10 0x7f2b9815f100 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:37.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.913+0000 7f2ba07fd700 1 -- 172.21.15.80:0/4230024377 shutdown_connections 2019-11-28T11:28:37.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.913+0000 7f2ba07fd700 1 -- 172.21.15.80:0/4230024377 wait complete. 2019-11-28T11:28:37.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.913+0000 7f2ba07fd700 1 -- 172.21.15.80:0/4230024377 >> 172.21.15.80:0/4230024377 conn(0x7f2b98061d20 msgr2=0x7f2b980641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:37.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.915+0000 7f2ba07fd700 1 Processor -- start 2019-11-28T11:28:37.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.915+0000 7f2ba07fd700 1 -- start start 2019-11-28T11:28:37.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.916+0000 7f2ba07fd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b98165480 0x7f2b9814b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:37.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.916+0000 7f2ba07fd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2b9814b660 0x7f2b98077400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:37.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.916+0000 7f2ba07fd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b98077940 0x7f2b98077d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:37.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.916+0000 7f2ba07fd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b98079980 con 0x7f2b98165480 2019-11-28T11:28:37.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.916+0000 7f2ba07fd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b98079c50 con 0x7f2b9814b660 2019-11-28T11:28:37.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.916+0000 7f2ba07fd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98148d30 con 0x7f2b98077940 2019-11-28T11:28:37.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.916+0000 7f2b9ed9a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b98165480 0x7f2b9814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:37.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.916+0000 7f2b9ed9a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b98165480 0x7f2b9814b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33512/0 (socket says 172.21.15.80:33512) 2019-11-28T11:28:37.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.916+0000 7f2b9ed9a700 1 -- 172.21.15.80:0/4170090840 learned_addr learned my addr 172.21.15.80:0/4170090840 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:37.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.916+0000 7f2b9f59b700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b98077940 0x7f2b98077d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:37.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.916+0000 7f2b9e599700 1 --2- 172.21.15.80:0/4170090840 >> v2:172.21.15.174:3300/0 conn(0x7f2b9814b660 0x7f2b98077400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:37.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2b9ed9a700 1 -- 172.21.15.80:0/4170090840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b98077940 msgr2=0x7f2b98077d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b98077940 0x7f2b98077d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:37.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2b9ed9a700 1 -- 172.21.15.80:0/4170090840 >> v2:172.21.15.174:3300/0 conn(0x7f2b9814b660 msgr2=0x7f2b98077400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:37.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4170090840 >> v2:172.21.15.174:3300/0 conn(0x7f2b9814b660 0x7f2b98077400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:37.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2b9ed9a700 1 -- 172.21.15.80:0/4170090840 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9807a2e0 con 0x7f2b98165480 2019-11-28T11:28:37.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4170090840 >> v2:172.21.15.80:3300/0 conn(0x7f2b98165480 0x7f2b9814b120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b80010770 tx=0x7f2b80010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4170090840 >> v2:172.21.15.80:3300/0 conn(0x7f2b98165480 0x7f2b9814b120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b80010770 tx=0x7f2b80010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b98165480 0x7f2b9814b120 secure :-1 s=READY pgs=530 cs=0 l=1 rx=0x7f2b80010770 tx=0x7f2b80010620).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:37.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b98165480 0x7f2b9814b120 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7f2b80010770 tx=0x7f2b80010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2b977fe700 1 -- 172.21.15.80:0/4170090840 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b80000cc0 con 0x7f2b98165480 2019-11-28T11:28:37.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b98165480 0x7f2b9814b120 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7f2b80010770 tx=0x7f2b80010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b98165480 0x7f2b9814b120 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7f2b80010770 tx=0x7f2b80010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2b977fe700 1 -- 172.21.15.80:0/4170090840 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b80009d00 con 0x7f2b98165480 2019-11-28T11:28:37.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2b977fe700 1 -- 172.21.15.80:0/4170090840 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b80009ef0 con 0x7f2b98165480 2019-11-28T11:28:37.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2ba07fd700 1 -- 172.21.15.80:0/4170090840 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9807a660 con 0x7f2b98165480 2019-11-28T11:28:37.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2ba07fd700 1 -- 172.21.15.80:0/4170090840 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9807a2e0 con 0x7f2b98165480 2019-11-28T11:28:37.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.917+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b98165480 0x7f2b9814b120 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7f2b80010770 tx=0x7f2b80010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.918+0000 7f2b977fe700 1 -- 172.21.15.80:0/4170090840 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2b80009ef0 con 0x7f2b98165480 2019-11-28T11:28:37.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.918+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b98165480 0x7f2b9814b120 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7f2b80010770 tx=0x7f2b80010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.918+0000 7f2b977fe700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b7c018730 0x7f2b7c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:37.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.918+0000 7f2b977fe700 1 -- 172.21.15.80:0/4170090840 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2b80031da0 con 0x7f2b98165480 2019-11-28T11:28:37.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.918+0000 7f2b9e599700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b7c018730 0x7f2b7c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:37.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.918+0000 7f2b9e599700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b7c018730 0x7f2b7c01abc0 crc :-1 s=READY pgs=227 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:37.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.926+0000 7f2ba07fd700 1 -- 172.21.15.80:0/4170090840 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b9807a660 con 0x7f2b98165480 2019-11-28T11:28:37.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.930+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b98165480 0x7f2b9814b120 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7f2b80010770 tx=0x7f2b80010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:37.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:37.930+0000 7f2b977fe700 1 -- 172.21.15.80:0/4170090840 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2b80025fa0 con 0x7f2b98165480 2019-11-28T11:28:38.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.096+0000 7f2ba07fd700 1 -- 172.21.15.80:0/4170090840 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f2b9807a2e0 con 0x7f2b98165480 2019-11-28T11:28:38.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.096+0000 7f2b9ed9a700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b98165480 0x7f2b9814b120 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7f2b80010770 tx=0x7f2b80010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.096+0000 7f2b977fe700 1 -- 172.21.15.80:0/4170090840 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2b80025fa0 con 0x7f2b98165480 2019-11-28T11:28:38.124 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:28:38.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.099+0000 7f2ba07fd700 1 -- 172.21.15.80:0/4170090840 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b7c018730 msgr2=0x7f2b7c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.099+0000 7f2ba07fd700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b7c018730 0x7f2b7c01abc0 crc :-1 s=READY pgs=227 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.099+0000 7f2ba07fd700 1 -- 172.21.15.80:0/4170090840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b98165480 msgr2=0x7f2b9814b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.099+0000 7f2ba07fd700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b98165480 0x7f2b9814b120 secure :-1 s=READY pgs=530 cs=0 l=1 rx=0x7f2b80010770 tx=0x7f2b80010620).stop 2019-11-28T11:28:38.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.099+0000 7f2ba07fd700 1 -- 172.21.15.80:0/4170090840 shutdown_connections 2019-11-28T11:28:38.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.099+0000 7f2ba07fd700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b7c018730 0x7f2b7c01abc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.099+0000 7f2ba07fd700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b98077940 0x7f2b98077d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.099+0000 7f2ba07fd700 1 --2- 172.21.15.80:0/4170090840 >> v2:172.21.15.174:3300/0 conn(0x7f2b9814b660 0x7f2b98077400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.099+0000 7f2ba07fd700 1 --2- 172.21.15.80:0/4170090840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b98165480 0x7f2b9814b120 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.099+0000 7f2ba07fd700 1 -- 172.21.15.80:0/4170090840 shutdown_connections 2019-11-28T11:28:38.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.099+0000 7f2ba07fd700 1 -- 172.21.15.80:0/4170090840 wait complete. 2019-11-28T11:28:38.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.099+0000 7f2ba07fd700 1 -- 172.21.15.80:0/4170090840 >> 172.21.15.80:0/4170090840 conn(0x7f2b98166440 msgr2=0x7f2b981494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:38.136 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:28:38.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.232+0000 7fb426f37700 1 Processor -- start 2019-11-28T11:28:38.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.232+0000 7fb426f37700 1 -- start start 2019-11-28T11:28:38.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.233+0000 7fb426f37700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb42015ed10 0x7fb42015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:38.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.233+0000 7fb426f37700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42006db60 con 0x7fb4200734b0 2019-11-28T11:28:38.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.233+0000 7fb426f37700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42006e060 con 0x7fb420073020 2019-11-28T11:28:38.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.233+0000 7fb426f37700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb42006fe00 con 0x7fb42015ed10 2019-11-28T11:28:38.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.233+0000 7fb4254d4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb42015ed10 0x7fb42015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.233+0000 7fb425cd5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb4200734b0 0x7fb4200726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32834/0 (socket says 172.21.15.80:32834) 2019-11-28T11:28:38.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.233+0000 7fb425cd5700 1 -- 172.21.15.80:0/2043302187 learned_addr learned my addr 172.21.15.80:0/2043302187 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:38.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.233+0000 7fb4254d4700 1 -- 172.21.15.80:0/2043302187 >> v1:172.21.15.174:6789/0 conn(0x7fb420073020 legacy=0x7fb420071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.233+0000 7fb4254d4700 1 -- 172.21.15.80:0/2043302187 >> v1:172.21.15.80:6789/0 conn(0x7fb4200734b0 legacy=0x7fb4200726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.233+0000 7fb4254d4700 1 -- 172.21.15.80:0/2043302187 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb420070760 con 0x7fb42015ed10 2019-11-28T11:28:38.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.233+0000 7fb41ffff700 1 -- 172.21.15.80:0/2043302187 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211102450 0 0) 0x7fb4180014d0 con 0x7fb4200734b0 2019-11-28T11:28:38.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.233+0000 7fb4254d4700 1 --2- 172.21.15.80:0/2043302187 >> v2:172.21.15.80:3300/0 conn(0x7fb42015ed10 0x7fb42015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb41000af50 tx=0x7fb41000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.234+0000 7fb4254d4700 1 --2- 172.21.15.80:0/2043302187 >> v2:172.21.15.80:3300/0 conn(0x7fb42015ed10 0x7fb42015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb41000af50 tx=0x7fb41000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.234+0000 7fb4254d4700 1 --2- 172.21.15.80:0/2043302187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb42015ed10 0x7fb42015f100 secure :-1 s=READY pgs=532 cs=0 l=1 rx=0x7fb41000af50 tx=0x7fb41000b760).ready entity=mon.0 client_cookie=1346637a174084b0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:38.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.234+0000 7fb4254d4700 1 --2- 172.21.15.80:0/2043302187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb42015ed10 0x7fb42015f100 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7fb41000af50 tx=0x7fb41000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.234+0000 7fb41ffff700 1 -- 172.21.15.80:0/2043302187 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb410000960 con 0x7fb42015ed10 2019-11-28T11:28:38.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.234+0000 7fb4254d4700 1 --2- 172.21.15.80:0/2043302187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb42015ed10 0x7fb42015f100 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7fb41000af50 tx=0x7fb41000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.234+0000 7fb4254d4700 1 --2- 172.21.15.80:0/2043302187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb42015ed10 0x7fb42015f100 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7fb41000af50 tx=0x7fb41000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.234+0000 7fb41ffff700 1 -- 172.21.15.80:0/2043302187 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb410009860 con 0x7fb42015ed10 2019-11-28T11:28:38.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.234+0000 7fb41ffff700 1 -- 172.21.15.80:0/2043302187 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb410009f30 con 0x7fb42015ed10 2019-11-28T11:28:38.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.234+0000 7fb426f37700 1 -- 172.21.15.80:0/2043302187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb42015ed10 msgr2=0x7fb42015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.234+0000 7fb426f37700 1 --2- 172.21.15.80:0/2043302187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb42015ed10 0x7fb42015f100 secure :-1 s=READY pgs=532 cs=0 l=1 rx=0x7fb41000af50 tx=0x7fb41000b760).stop 2019-11-28T11:28:38.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.234+0000 7fb426f37700 1 -- 172.21.15.80:0/2043302187 shutdown_connections 2019-11-28T11:28:38.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.234+0000 7fb426f37700 1 --2- 172.21.15.80:0/2043302187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb42015ed10 0x7fb42015f100 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.235+0000 7fb426f37700 1 -- 172.21.15.80:0/2043302187 shutdown_connections 2019-11-28T11:28:38.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.235+0000 7fb426f37700 1 -- 172.21.15.80:0/2043302187 wait complete. 2019-11-28T11:28:38.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.235+0000 7fb426f37700 1 -- 172.21.15.80:0/2043302187 >> 172.21.15.80:0/2043302187 conn(0x7fb420061d20 msgr2=0x7fb4200641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:38.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.237+0000 7fb426f37700 1 Processor -- start 2019-11-28T11:28:38.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.237+0000 7fb426f37700 1 -- start start 2019-11-28T11:28:38.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.238+0000 7fb426f37700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb420079370 0x7fb420077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:38.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.238+0000 7fb426f37700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb420078080 0x7fb42012e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:38.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.238+0000 7fb426f37700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb420162b20 con 0x7fb420106870 2019-11-28T11:28:38.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.238+0000 7fb426f37700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb420075aa0 con 0x7fb420079370 2019-11-28T11:28:38.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.238+0000 7fb426f37700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb420075d70 con 0x7fb420078080 2019-11-28T11:28:38.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.238+0000 7fb4254d4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb420106870 0x7fb420079b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32842/0 (socket says 172.21.15.80:32842) 2019-11-28T11:28:38.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.238+0000 7fb4254d4700 1 -- 172.21.15.80:0/1801181281 learned_addr learned my addr 172.21.15.80:0/1801181281 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:38.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.238+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053798320 0 0) 0x7fb41000b3d0 con 0x7fb420106870 2019-11-28T11:28:38.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.238+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb404002e80 con 0x7fb420106870 2019-11-28T11:28:38.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.238+0000 7fb424cd3700 1 --2- 172.21.15.80:0/1801181281 >> v2:172.21.15.174:3300/0 conn(0x7fb420079370 0x7fb420077b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.238+0000 7fb425cd5700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb420078080 0x7fb42012e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.238+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2515913691 0 0) 0x7fb410000940 con 0x7fb420106870 2019-11-28T11:28:38.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.238+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb4040032e0 con 0x7fb420106870 2019-11-28T11:28:38.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.238+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fb410009580 con 0x7fb420106870 2019-11-28T11:28:38.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb420078080 msgr2=0x7fb42012e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb41dffb700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb420078080 0x7fb42012e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 >> v2:172.21.15.174:3300/0 conn(0x7fb420079370 msgr2=0x7fb420077b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb41dffb700 1 --2- 172.21.15.80:0/1801181281 >> v2:172.21.15.174:3300/0 conn(0x7fb420079370 0x7fb420077b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 >> v1:172.21.15.80:6789/0 conn(0x7fb420106870 legacy=0x7fb420079b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb41dffb700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040039d0 0x7fb404005dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:38.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb41dffb700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb404006310 0x7fb404008710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:38.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb41dffb700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb404008e40 0x7fb40400b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:38.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40400bb00 con 0x7fb4040039d0 2019-11-28T11:28:38.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40400bd30 con 0x7fb404008e40 2019-11-28T11:28:38.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40400bf60 con 0x7fb404006310 2019-11-28T11:28:38.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb4254d4700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040039d0 0x7fb404005dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb424cd3700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb404006310 0x7fb404008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb425cd5700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb404008e40 0x7fb40400b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb4254d4700 1 -- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb404006310 msgr2=0x7fb404008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb4254d4700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb404006310 0x7fb404008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb4254d4700 1 -- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb404008e40 msgr2=0x7fb40400b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb4254d4700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb404008e40 0x7fb40400b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb4254d4700 1 -- 172.21.15.80:0/1801181281 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40400c210 con 0x7fb4040039d0 2019-11-28T11:28:38.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb425cd5700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb404008e40 0x7fb40400b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:38.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb426f37700 1 -- 172.21.15.80:0/1801181281 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb420076780 con 0x7fb4040039d0 2019-11-28T11:28:38.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb4254d4700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040039d0 0x7fb404005dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb410010470 tx=0x7fb4100102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb426f37700 1 -- 172.21.15.80:0/1801181281 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb420076400 con 0x7fb4040039d0 2019-11-28T11:28:38.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb4254d4700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040039d0 0x7fb404005dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb410010470 tx=0x7fb4100102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb4254d4700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040039d0 0x7fb404005dd0 secure :-1 s=READY pgs=534 cs=0 l=1 rx=0x7fb410010470 tx=0x7fb4100102a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:38.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb4254d4700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040039d0 0x7fb404005dd0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7fb410010470 tx=0x7fb4100102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb410009790 con 0x7fb4040039d0 2019-11-28T11:28:38.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb4254d4700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040039d0 0x7fb404005dd0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7fb410010470 tx=0x7fb4100102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41000b3d0 con 0x7fb4040039d0 2019-11-28T11:28:38.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb4254d4700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040039d0 0x7fb404005dd0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7fb410010470 tx=0x7fb4100102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb41000b5c0 con 0x7fb4040039d0 2019-11-28T11:28:38.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.239+0000 7fb4254d4700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040039d0 0x7fb404005dd0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7fb410010470 tx=0x7fb4100102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.240+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb410009790 con 0x7fb4040039d0 2019-11-28T11:28:38.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.240+0000 7fb4254d4700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040039d0 0x7fb404005dd0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7fb410010470 tx=0x7fb4100102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.240+0000 7fb41dffb700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb404020ad0 0x7fb404022f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:38.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.240+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb410031c60 con 0x7fb4040039d0 2019-11-28T11:28:38.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.240+0000 7fb424cd3700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb404020ad0 0x7fb404022f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.240+0000 7fb424cd3700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb404020ad0 0x7fb404022f00 crc :-1 s=READY pgs=228 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:38.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.247+0000 7fb426f37700 1 -- 172.21.15.80:0/1801181281 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f8002e60 con 0x7fb4040039d0 2019-11-28T11:28:38.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.251+0000 7fb4254d4700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040039d0 0x7fb404005dd0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7fb410010470 tx=0x7fb4100102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.251+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb410009580 con 0x7fb4040039d0 2019-11-28T11:28:38.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.423+0000 7fb426f37700 1 -- 172.21.15.80:0/1801181281 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fb3f8001d30 con 0x7fb4040039d0 2019-11-28T11:28:38.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.423+0000 7fb4254d4700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040039d0 0x7fb404005dd0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7fb410010470 tx=0x7fb4100102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.423+0000 7fb41dffb700 1 -- 172.21.15.80:0/1801181281 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v47) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb41000b3d0 con 0x7fb4040039d0 2019-11-28T11:28:38.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.426+0000 7fb426f37700 1 -- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb404020ad0 msgr2=0x7fb404022f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.426+0000 7fb426f37700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb404020ad0 0x7fb404022f00 crc :-1 s=READY pgs=228 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.426+0000 7fb426f37700 1 -- 172.21.15.80:0/1801181281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040039d0 msgr2=0x7fb404005dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.426+0000 7fb426f37700 1 --2- 172.21.15.80:0/1801181281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4040039d0 0x7fb404005dd0 secure :-1 s=READY pgs=534 cs=0 l=1 rx=0x7fb410010470 tx=0x7fb4100102a0).stop 2019-11-28T11:28:38.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.426+0000 7fb425cd5700 1 -- 172.21.15.80:0/1801181281 reap_dead start 2019-11-28T11:28:38.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.426+0000 7fb426f37700 1 -- 172.21.15.80:0/1801181281 shutdown_connections 2019-11-28T11:28:38.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.426+0000 7fb426f37700 1 -- 172.21.15.80:0/1801181281 shutdown_connections 2019-11-28T11:28:38.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.426+0000 7fb426f37700 1 -- 172.21.15.80:0/1801181281 wait complete. 2019-11-28T11:28:38.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.426+0000 7fb426f37700 1 -- 172.21.15.80:0/1801181281 >> 172.21.15.80:0/1801181281 conn(0x7fb420166440 msgr2=0x7fb4201494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:38.456 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:28:38.463 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:28:38.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.558+0000 7fd68a336700 1 Processor -- start 2019-11-28T11:28:38.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.558+0000 7fd68a336700 1 -- start start 2019-11-28T11:28:38.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd68a336700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd68415ed10 0x7fd68415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:38.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd68a336700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd684073020 0x7fd684071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:38.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd68a336700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68406db60 con 0x7fd6840734b0 2019-11-28T11:28:38.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd68a336700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68406fe00 con 0x7fd684073020 2019-11-28T11:28:38.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd68a336700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6840700d0 con 0x7fd68415ed10 2019-11-28T11:28:38.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd683fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd684073020 0x7fd684071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd683fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd684073020 0x7fd684071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33536/0 (socket says 172.21.15.80:33536) 2019-11-28T11:28:38.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd683fff700 1 -- 172.21.15.80:0/2913839456 learned_addr learned my addr 172.21.15.80:0/2913839456 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:38.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd6888d3700 1 --2- 172.21.15.80:0/2913839456 >> v2:172.21.15.174:3300/0 conn(0x7fd68415ed10 0x7fd68415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd683fff700 1 -- 172.21.15.80:0/2913839456 >> v2:172.21.15.174:3300/0 conn(0x7fd68415ed10 msgr2=0x7fd68415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:38.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd683fff700 1 --2- 172.21.15.80:0/2913839456 >> v2:172.21.15.174:3300/0 conn(0x7fd68415ed10 0x7fd68415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:38.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd683fff700 1 -- 172.21.15.80:0/2913839456 >> v1:172.21.15.80:6789/0 conn(0x7fd6840734b0 legacy=0x7fd6840723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd6837fe700 1 -- 172.21.15.80:0/2913839456 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108213307 0 0) 0x7fd67c000a40 con 0x7fd6840734b0 2019-11-28T11:28:38.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd683fff700 1 -- 172.21.15.80:0/2913839456 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd684070760 con 0x7fd684073020 2019-11-28T11:28:38.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd6888d3700 1 --2- 172.21.15.80:0/2913839456 >> v2:172.21.15.174:3300/0 conn(0x7fd68415ed10 0x7fd68415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:38.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd683fff700 1 --2- 172.21.15.80:0/2913839456 >> v2:172.21.15.80:3300/0 conn(0x7fd684073020 0x7fd684071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd67400fac0 tx=0x7fd67400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd683fff700 1 --2- 172.21.15.80:0/2913839456 >> v2:172.21.15.80:3300/0 conn(0x7fd684073020 0x7fd684071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd67400fac0 tx=0x7fd67400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.559+0000 7fd683fff700 1 --2- 172.21.15.80:0/2913839456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd684073020 0x7fd684071ea0 secure :-1 s=READY pgs=536 cs=0 l=1 rx=0x7fd67400fac0 tx=0x7fd67400fe60).ready entity=mon.0 client_cookie=8c643484dbd998ff server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:38.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.560+0000 7fd683fff700 1 --2- 172.21.15.80:0/2913839456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd684073020 0x7fd684071ea0 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7fd67400fac0 tx=0x7fd67400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.560+0000 7fd6837fe700 1 -- 172.21.15.80:0/2913839456 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd674000ce0 con 0x7fd684073020 2019-11-28T11:28:38.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.560+0000 7fd683fff700 1 --2- 172.21.15.80:0/2913839456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd684073020 0x7fd684071ea0 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7fd67400fac0 tx=0x7fd67400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.560+0000 7fd6837fe700 1 -- 172.21.15.80:0/2913839456 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd674001010 con 0x7fd684073020 2019-11-28T11:28:38.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.560+0000 7fd683fff700 1 --2- 172.21.15.80:0/2913839456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd684073020 0x7fd684071ea0 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7fd67400fac0 tx=0x7fd67400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.560+0000 7fd6837fe700 1 -- 172.21.15.80:0/2913839456 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd674007590 con 0x7fd684073020 2019-11-28T11:28:38.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.560+0000 7fd68a336700 1 -- 172.21.15.80:0/2913839456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd684073020 msgr2=0x7fd684071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.560+0000 7fd68a336700 1 --2- 172.21.15.80:0/2913839456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd684073020 0x7fd684071ea0 secure :-1 s=READY pgs=536 cs=0 l=1 rx=0x7fd67400fac0 tx=0x7fd67400fe60).stop 2019-11-28T11:28:38.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.560+0000 7fd68a336700 1 -- 172.21.15.80:0/2913839456 shutdown_connections 2019-11-28T11:28:38.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.560+0000 7fd68a336700 1 --2- 172.21.15.80:0/2913839456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd684073020 0x7fd684071ea0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.560+0000 7fd68a336700 1 --2- 172.21.15.80:0/2913839456 >> v2:172.21.15.174:3300/0 conn(0x7fd68415ed10 0x7fd68415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:38.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.560+0000 7fd68a336700 1 -- 172.21.15.80:0/2913839456 shutdown_connections 2019-11-28T11:28:38.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.560+0000 7fd68a336700 1 -- 172.21.15.80:0/2913839456 wait complete. 2019-11-28T11:28:38.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.560+0000 7fd68a336700 1 -- 172.21.15.80:0/2913839456 >> 172.21.15.80:0/2913839456 conn(0x7fd684061d20 msgr2=0x7fd6840641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:38.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.563+0000 7fd68a336700 1 Processor -- start 2019-11-28T11:28:38.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.563+0000 7fd68a336700 1 -- start start 2019-11-28T11:28:38.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd68a336700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd684148320 0x7fd68410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:38.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd68a336700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd68410f290 0x7fd68410dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:38.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd68a336700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd684148e00 con 0x7fd68410e110 2019-11-28T11:28:38.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd68a336700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68413aa20 con 0x7fd684148320 2019-11-28T11:28:38.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd68a336700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68413acf0 con 0x7fd68410f290 2019-11-28T11:28:38.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd6890d4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd68410e110 0x7fd6841079b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32860/0 (socket says 172.21.15.80:32860) 2019-11-28T11:28:38.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd6890d4700 1 -- 172.21.15.80:0/1521845169 learned_addr learned my addr 172.21.15.80:0/1521845169 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:38.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd6888d3700 1 --2- 172.21.15.80:0/1521845169 >> v2:172.21.15.174:3300/0 conn(0x7fd684148320 0x7fd68410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd683fff700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd68410f290 0x7fd68410dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd6817fa700 1 -- 172.21.15.80:0/1521845169 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506632244 0 0) 0x7fd67c001240 con 0x7fd68410e110 2019-11-28T11:28:38.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd6817fa700 1 -- 172.21.15.80:0/1521845169 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd668002e80 con 0x7fd68410e110 2019-11-28T11:28:38.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd6888d3700 1 -- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd68410f290 msgr2=0x7fd68410dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd6888d3700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd68410f290 0x7fd68410dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd6888d3700 1 -- 172.21.15.80:0/1521845169 >> v1:172.21.15.80:6789/0 conn(0x7fd68410e110 legacy=0x7fd6841079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd6817fa700 1 -- 172.21.15.80:0/1521845169 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2170062404 0 0) 0x7fd67c001440 con 0x7fd68410e110 2019-11-28T11:28:38.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd6888d3700 1 -- 172.21.15.80:0/1521845169 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68410c490 con 0x7fd684148320 2019-11-28T11:28:38.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd683fff700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd68410f290 0x7fd68410dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:38.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd6888d3700 1 --2- 172.21.15.80:0/1521845169 >> v2:172.21.15.174:3300/0 conn(0x7fd684148320 0x7fd68410ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd66c010350 tx=0x7fd66c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd6888d3700 1 --2- 172.21.15.80:0/1521845169 >> v2:172.21.15.174:3300/0 conn(0x7fd684148320 0x7fd68410ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd66c010350 tx=0x7fd66c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.564+0000 7fd6888d3700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd684148320 0x7fd68410ed50 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7fd66c010350 tx=0x7fd66c0106f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:38.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.565+0000 7fd6888d3700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd684148320 0x7fd68410ed50 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fd66c010350 tx=0x7fd66c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.565+0000 7fd6817fa700 1 -- 172.21.15.80:0/1521845169 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd66c0097a0 con 0x7fd684148320 2019-11-28T11:28:38.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.565+0000 7fd6888d3700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd684148320 0x7fd68410ed50 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fd66c010350 tx=0x7fd66c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.565+0000 7fd6817fa700 1 -- 172.21.15.80:0/1521845169 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c000bc0 con 0x7fd684148320 2019-11-28T11:28:38.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.565+0000 7fd6888d3700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd684148320 0x7fd68410ed50 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fd66c010350 tx=0x7fd66c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.565+0000 7fd68a336700 1 -- 172.21.15.80:0/1521845169 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68410c810 con 0x7fd684148320 2019-11-28T11:28:38.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.565+0000 7fd6817fa700 1 -- 172.21.15.80:0/1521845169 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd66c0097a0 con 0x7fd684148320 2019-11-28T11:28:38.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.565+0000 7fd68a336700 1 -- 172.21.15.80:0/1521845169 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68410c490 con 0x7fd684148320 2019-11-28T11:28:38.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.565+0000 7fd6888d3700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd684148320 0x7fd68410ed50 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fd66c010350 tx=0x7fd66c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.565+0000 7fd6817fa700 1 -- 172.21.15.80:0/1521845169 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd66c000db0 con 0x7fd684148320 2019-11-28T11:28:38.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.565+0000 7fd6888d3700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd684148320 0x7fd68410ed50 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fd66c010350 tx=0x7fd66c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.565+0000 7fd6817fa700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd668018780 0x7fd66801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:38.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.565+0000 7fd6817fa700 1 -- 172.21.15.80:0/1521845169 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd66c0319e0 con 0x7fd684148320 2019-11-28T11:28:38.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.565+0000 7fd683fff700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd668018780 0x7fd66801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.566+0000 7fd683fff700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd668018780 0x7fd66801abf0 crc :-1 s=READY pgs=229 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:38.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.573+0000 7fd68a336700 1 -- 172.21.15.80:0/1521845169 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68410c810 con 0x7fd684148320 2019-11-28T11:28:38.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.577+0000 7fd6888d3700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd684148320 0x7fd68410ed50 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fd66c010350 tx=0x7fd66c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.577+0000 7fd6817fa700 1 -- 172.21.15.80:0/1521845169 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd66c0097a0 con 0x7fd684148320 2019-11-28T11:28:38.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.743+0000 7fd68a336700 1 -- 172.21.15.80:0/1521845169 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fd68410c490 con 0x7fd684148320 2019-11-28T11:28:38.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.744+0000 7fd6888d3700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd684148320 0x7fd68410ed50 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7fd66c010350 tx=0x7fd66c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.744+0000 7fd6817fa700 1 -- 172.21.15.80:0/1521845169 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v47) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd66c000db0 con 0x7fd684148320 2019-11-28T11:28:38.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.746+0000 7fd68a336700 1 -- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd668018780 msgr2=0x7fd66801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.746+0000 7fd68a336700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd668018780 0x7fd66801abf0 crc :-1 s=READY pgs=229 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.746+0000 7fd68a336700 1 -- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd684148320 msgr2=0x7fd68410ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.746+0000 7fd68a336700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd684148320 0x7fd68410ed50 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7fd66c010350 tx=0x7fd66c0106f0).stop 2019-11-28T11:28:38.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.746+0000 7fd68a336700 1 -- 172.21.15.80:0/1521845169 shutdown_connections 2019-11-28T11:28:38.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.746+0000 7fd68a336700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd668018780 0x7fd66801abf0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.746+0000 7fd68a336700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd68410f290 0x7fd68410dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.746+0000 7fd68a336700 1 --2- 172.21.15.80:0/1521845169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd684148320 0x7fd68410ed50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.746+0000 7fd68a336700 1 -- 172.21.15.80:0/1521845169 shutdown_connections 2019-11-28T11:28:38.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.746+0000 7fd68a336700 1 -- 172.21.15.80:0/1521845169 wait complete. 2019-11-28T11:28:38.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.746+0000 7fd68a336700 1 -- 172.21.15.80:0/1521845169 >> 172.21.15.80:0/1521845169 conn(0x7fd68415e2d0 msgr2=0x7fd684147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:38.780 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:28:38.791 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:28:38.791 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:28:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.885+0000 7fc05f4a1700 1 Processor -- start 2019-11-28T11:28:38.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.885+0000 7fc05f4a1700 1 -- start start 2019-11-28T11:28:38.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.886+0000 7fc05f4a1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc05806c0a0 0x7fc058072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:38.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.886+0000 7fc05f4a1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc0580734e0 0x7fc058071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:38.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.886+0000 7fc05f4a1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05806db00 con 0x7fc058072360 2019-11-28T11:28:38.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.886+0000 7fc05f4a1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05806fd60 con 0x7fc05806c0a0 2019-11-28T11:28:38.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.886+0000 7fc05f4a1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc058070030 con 0x7fc0580734e0 2019-11-28T11:28:38.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.886+0000 7fc05da3e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc05806c0a0 0x7fc058072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.886+0000 7fc05da3e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc05806c0a0 0x7fc058072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33548/0 (socket says 172.21.15.80:33548) 2019-11-28T11:28:38.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.886+0000 7fc05da3e700 1 -- 172.21.15.80:0/181530459 learned_addr learned my addr 172.21.15.80:0/181530459 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:38.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.886+0000 7fc05d23d700 1 --2- 172.21.15.80:0/181530459 >> v2:172.21.15.174:3300/0 conn(0x7fc0580734e0 0x7fc058071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.887+0000 7fc05da3e700 1 -- 172.21.15.80:0/181530459 >> v2:172.21.15.174:3300/0 conn(0x7fc0580734e0 msgr2=0x7fc058071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:38.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.887+0000 7fc05da3e700 1 --2- 172.21.15.80:0/181530459 >> v2:172.21.15.174:3300/0 conn(0x7fc0580734e0 0x7fc058071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:38.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.887+0000 7fc05da3e700 1 -- 172.21.15.80:0/181530459 >> v1:172.21.15.174:6789/0 conn(0x7fc058072360 legacy=0x7fc05806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.887+0000 7fc05da3e700 1 -- 172.21.15.80:0/181530459 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0580706c0 con 0x7fc05806c0a0 2019-11-28T11:28:38.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.887+0000 7fc05da3e700 1 --2- 172.21.15.80:0/181530459 >> v2:172.21.15.80:3300/0 conn(0x7fc05806c0a0 0x7fc058072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc04800f6c0 tx=0x7fc04800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.887+0000 7fc05da3e700 1 --2- 172.21.15.80:0/181530459 >> v2:172.21.15.80:3300/0 conn(0x7fc05806c0a0 0x7fc058072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc04800f6c0 tx=0x7fc04800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.887+0000 7fc05da3e700 1 --2- 172.21.15.80:0/181530459 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05806c0a0 0x7fc058072fa0 secure :-1 s=READY pgs=538 cs=0 l=1 rx=0x7fc04800f6c0 tx=0x7fc04800fa60).ready entity=mon.0 client_cookie=422b11e4aa9c6405 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:38.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.887+0000 7fc05da3e700 1 --2- 172.21.15.80:0/181530459 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05806c0a0 0x7fc058072fa0 secure :-1 s=THROTTLE_DONE pgs=538 cs=0 l=1 rx=0x7fc04800f6c0 tx=0x7fc04800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.887+0000 7fc05ca3c700 1 -- 172.21.15.80:0/181530459 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc048000960 con 0x7fc05806c0a0 2019-11-28T11:28:38.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.887+0000 7fc05da3e700 1 --2- 172.21.15.80:0/181530459 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05806c0a0 0x7fc058072fa0 secure :-1 s=THROTTLE_DONE pgs=538 cs=0 l=1 rx=0x7fc04800f6c0 tx=0x7fc04800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.887+0000 7fc05da3e700 1 --2- 172.21.15.80:0/181530459 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05806c0a0 0x7fc058072fa0 secure :-1 s=THROTTLE_DONE pgs=538 cs=0 l=1 rx=0x7fc04800f6c0 tx=0x7fc04800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.887+0000 7fc05ca3c700 1 -- 172.21.15.80:0/181530459 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc048000c90 con 0x7fc05806c0a0 2019-11-28T11:28:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.887+0000 7fc05ca3c700 1 -- 172.21.15.80:0/181530459 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0480013a0 con 0x7fc05806c0a0 2019-11-28T11:28:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.887+0000 7fc05f4a1700 1 -- 172.21.15.80:0/181530459 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05806c0a0 msgr2=0x7fc058072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.887+0000 7fc05f4a1700 1 --2- 172.21.15.80:0/181530459 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05806c0a0 0x7fc058072fa0 secure :-1 s=READY pgs=538 cs=0 l=1 rx=0x7fc04800f6c0 tx=0x7fc04800fa60).stop 2019-11-28T11:28:38.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.888+0000 7fc05f4a1700 1 -- 172.21.15.80:0/181530459 shutdown_connections 2019-11-28T11:28:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.888+0000 7fc05f4a1700 1 --2- 172.21.15.80:0/181530459 >> v2:172.21.15.174:3300/0 conn(0x7fc0580734e0 0x7fc058071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.888+0000 7fc05f4a1700 1 --2- 172.21.15.80:0/181530459 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05806c0a0 0x7fc058072fa0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.888+0000 7fc05f4a1700 1 -- 172.21.15.80:0/181530459 shutdown_connections 2019-11-28T11:28:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.888+0000 7fc05f4a1700 1 -- 172.21.15.80:0/181530459 wait complete. 2019-11-28T11:28:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.888+0000 7fc05f4a1700 1 -- 172.21.15.80:0/181530459 >> 172.21.15.80:0/181530459 conn(0x7fc058061cf0 msgr2=0x7fc058064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:38.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.890+0000 7fc05f4a1700 1 Processor -- start 2019-11-28T11:28:38.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.890+0000 7fc05f4a1700 1 -- start start 2019-11-28T11:28:38.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.891+0000 7fc05f4a1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc05813e9e0 0x7fc058108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:38.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.891+0000 7fc05f4a1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc058109430 0x7fc0581098b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:38.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.891+0000 7fc05f4a1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0581066e0 con 0x7fc05813e5f0 2019-11-28T11:28:38.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.891+0000 7fc05f4a1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05810e060 con 0x7fc05813e9e0 2019-11-28T11:28:38.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.891+0000 7fc05f4a1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05810e330 con 0x7fc058109430 2019-11-28T11:28:38.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.891+0000 7fc05d23d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc05813e9e0 0x7fc058108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.891+0000 7fc05da3e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc05813e5f0 0x7fc05810a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32872/0 (socket says 172.21.15.80:32872) 2019-11-28T11:28:38.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.891+0000 7fc05da3e700 1 -- 172.21.15.80:0/3065050447 learned_addr learned my addr 172.21.15.80:0/3065050447 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:38.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.891+0000 7fc05d23d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc05813e9e0 0x7fc058108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33554/0 (socket says 172.21.15.80:33554) 2019-11-28T11:28:38.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.891+0000 7fc05e23f700 1 --2- 172.21.15.80:0/3065050447 >> v2:172.21.15.174:3300/0 conn(0x7fc058109430 0x7fc0581098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc05d23d700 1 -- 172.21.15.80:0/3065050447 >> v2:172.21.15.174:3300/0 conn(0x7fc058109430 msgr2=0x7fc0581098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc05d23d700 1 --2- 172.21.15.80:0/3065050447 >> v2:172.21.15.174:3300/0 conn(0x7fc058109430 0x7fc0581098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc05d23d700 1 -- 172.21.15.80:0/3065050447 >> v1:172.21.15.80:6789/0 conn(0x7fc05813e5f0 legacy=0x7fc05810a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc05d23d700 1 -- 172.21.15.80:0/3065050447 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05810e9c0 con 0x7fc05813e9e0 2019-11-28T11:28:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc0567fc700 1 -- 172.21.15.80:0/3065050447 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134766790 0 0) 0x7fc048007e10 con 0x7fc05813e5f0 2019-11-28T11:28:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc05d23d700 1 --2- 172.21.15.80:0/3065050447 >> v2:172.21.15.80:3300/0 conn(0x7fc05813e9e0 0x7fc058108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc040010710 tx=0x7fc040010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc05d23d700 1 --2- 172.21.15.80:0/3065050447 >> v2:172.21.15.80:3300/0 conn(0x7fc05813e9e0 0x7fc058108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc040010710 tx=0x7fc040010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc05d23d700 1 --2- 172.21.15.80:0/3065050447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05813e9e0 0x7fc058108ef0 secure :-1 s=READY pgs=540 cs=0 l=1 rx=0x7fc040010710 tx=0x7fc040010510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:38.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc05d23d700 1 --2- 172.21.15.80:0/3065050447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05813e9e0 0x7fc058108ef0 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7fc040010710 tx=0x7fc040010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc0567fc700 1 -- 172.21.15.80:0/3065050447 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc040005af0 con 0x7fc05813e9e0 2019-11-28T11:28:38.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc05d23d700 1 --2- 172.21.15.80:0/3065050447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05813e9e0 0x7fc058108ef0 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7fc040010710 tx=0x7fc040010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc0567fc700 1 -- 172.21.15.80:0/3065050447 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc040005710 con 0x7fc05813e9e0 2019-11-28T11:28:38.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc05f4a1700 1 -- 172.21.15.80:0/3065050447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05810ed40 con 0x7fc05813e9e0 2019-11-28T11:28:38.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc05d23d700 1 --2- 172.21.15.80:0/3065050447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05813e9e0 0x7fc058108ef0 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7fc040010710 tx=0x7fc040010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc0567fc700 1 -- 172.21.15.80:0/3065050447 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc040005900 con 0x7fc05813e9e0 2019-11-28T11:28:38.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc05f4a1700 1 -- 172.21.15.80:0/3065050447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05810e9c0 con 0x7fc05813e9e0 2019-11-28T11:28:38.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc05d23d700 1 --2- 172.21.15.80:0/3065050447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05813e9e0 0x7fc058108ef0 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7fc040010710 tx=0x7fc040010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.892+0000 7fc0567fc700 1 -- 172.21.15.80:0/3065050447 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc040005900 con 0x7fc05813e9e0 2019-11-28T11:28:38.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.893+0000 7fc05d23d700 1 --2- 172.21.15.80:0/3065050447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05813e9e0 0x7fc058108ef0 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7fc040010710 tx=0x7fc040010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.893+0000 7fc0567fc700 1 --2- 172.21.15.80:0/3065050447 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc03c018730 0x7fc03c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:38.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.893+0000 7fc0567fc700 1 -- 172.21.15.80:0/3065050447 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc040031f90 con 0x7fc05813e9e0 2019-11-28T11:28:38.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.893+0000 7fc05da3e700 1 --2- 172.21.15.80:0/3065050447 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc03c018730 0x7fc03c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:38.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.893+0000 7fc05da3e700 1 --2- 172.21.15.80:0/3065050447 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc03c018730 0x7fc03c01abe0 crc :-1 s=READY pgs=230 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:38.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.900+0000 7fc05f4a1700 1 -- 172.21.15.80:0/3065050447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05810ed40 con 0x7fc05813e9e0 2019-11-28T11:28:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.904+0000 7fc05d23d700 1 --2- 172.21.15.80:0/3065050447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05813e9e0 0x7fc058108ef0 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7fc040010710 tx=0x7fc040010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:38.904+0000 7fc0567fc700 1 -- 172.21.15.80:0/3065050447 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc040005500 con 0x7fc05813e9e0 2019-11-28T11:28:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.076+0000 7fc05f4a1700 1 -- 172.21.15.80:0/3065050447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc05810e9c0 con 0x7fc05813e9e0 2019-11-28T11:28:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.076+0000 7fc05d23d700 1 --2- 172.21.15.80:0/3065050447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05813e9e0 0x7fc058108ef0 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7fc040010710 tx=0x7fc040010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.076+0000 7fc0567fc700 1 -- 172.21.15.80:0/3065050447 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+2443 (secure 0 0 0) 0x7fc040005710 con 0x7fc05813e9e0 2019-11-28T11:28:39.104 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 22 2019-11-28T11:28:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:39.104 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3295602533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3295602533},{"type":"v1","addr":"172.21.15.80:6834","nonce":3295602533}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":20},{"gid":5559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1936159041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1936159041},{"type":"v1","addr":"172.21.15.80:6835","nonce":1936159041}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:27.955433+0000","modified":"2019-11-28T11:28:35.746800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5401":{"gid":5401,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/160551131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":160551131},{"type":"v1","addr":"172.21.15.174:6835","nonce":160551131}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2019-11-28T11:28:39.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.079+0000 7fc05f4a1700 1 -- 172.21.15.80:0/3065050447 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc03c018730 msgr2=0x7fc03c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:39.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.079+0000 7fc05f4a1700 1 --2- 172.21.15.80:0/3065050447 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc03c018730 0x7fc03c01abe0 crc :-1 s=READY pgs=230 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:39.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.079+0000 7fc05f4a1700 1 -- 172.21.15.80:0/3065050447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05813e9e0 msgr2=0x7fc058108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:39.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.079+0000 7fc05f4a1700 1 --2- 172.21.15.80:0/3065050447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05813e9e0 0x7fc058108ef0 secure :-1 s=READY pgs=540 cs=0 l=1 rx=0x7fc040010710 tx=0x7fc040010510).stop 2019-11-28T11:28:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.079+0000 7fc05f4a1700 1 -- 172.21.15.80:0/3065050447 shutdown_connections 2019-11-28T11:28:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.079+0000 7fc05f4a1700 1 --2- 172.21.15.80:0/3065050447 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc03c018730 0x7fc03c01abe0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.079+0000 7fc05f4a1700 1 --2- 172.21.15.80:0/3065050447 >> v2:172.21.15.174:3300/0 conn(0x7fc058109430 0x7fc0581098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.079+0000 7fc05f4a1700 1 --2- 172.21.15.80:0/3065050447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05813e9e0 0x7fc058108ef0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.079+0000 7fc05f4a1700 1 -- 172.21.15.80:0/3065050447 shutdown_connections 2019-11-28T11:28:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.079+0000 7fc05f4a1700 1 -- 172.21.15.80:0/3065050447 wait complete. 2019-11-28T11:28:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.079+0000 7fc05f4a1700 1 -- 172.21.15.80:0/3065050447 >> 172.21.15.80:0/3065050447 conn(0x7fc05813d620 msgr2=0x7fc05813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:39.424 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5401}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 6, u'failed': [], u'epoch': 22, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [7], u'info': {u'gid_5401': {u'export_targets': [], u'name': u'c', u'incarnation': 21, u'state_seq': 3, u'state': u'up:active', u'gid': 5401, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 160551131, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 160551131, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/160551131'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:28:27.955433+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:28:35.746800+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:28:39.425 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:28:39.425 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:28:39.552 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:28:39.552 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:28:39.552 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:28:39.553 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5401, 2019-11-28T11:28:39.553 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:28:39.553 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:28:39.553 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 4.7783880529999996, 2019-11-28T11:28:39.553 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 22, 2019-11-28T11:28:39.553 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 47, 2019-11-28T11:28:39.553 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 47, 2019-11-28T11:28:39.554 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 9.1379028160000004 2019-11-28T11:28:39.554 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:28:39.558 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5401, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.7783880529999996, "mdsmap_epoch": 22, "osdmap_epoch": 47, "osdmap_epoch_barrier": 47, "uptime": 9.1379028160000004 } 2019-11-28T11:28:39.558 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:28:39.558 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:28:39.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:28:39.559 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:28:39.629 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:28:39.630 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:28:39.750 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:28:39.750 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:28:39.750 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:28:39.750 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:28:39.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:28:39.751 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:28:39.822 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:28:39.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.916+0000 7f8f34495700 1 Processor -- start 2019-11-28T11:28:39.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.916+0000 7f8f34495700 1 -- start start 2019-11-28T11:28:39.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f34495700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8f2c06c0a0 0x7f8f2c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:39.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f34495700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c0734e0 0x7f8f2c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:39.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f34495700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8f2c072360 0x7f8f2c072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:39.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f34495700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c06fd60 con 0x7f8f2c06c0a0 2019-11-28T11:28:39.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f34495700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c070030 con 0x7f8f2c072360 2019-11-28T11:28:39.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f34495700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c06f330 con 0x7f8f2c0734e0 2019-11-28T11:28:39.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f32a32700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8f2c06c0a0 0x7f8f2c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:39.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f32a32700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8f2c06c0a0 0x7f8f2c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33562/0 (socket says 172.21.15.80:33562) 2019-11-28T11:28:39.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f32a32700 1 -- 172.21.15.80:0/2711890023 learned_addr learned my addr 172.21.15.80:0/2711890023 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:39.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f32231700 1 --2- 172.21.15.80:0/2711890023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c0734e0 0x7f8f2c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:39.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f33233700 1 --2- 172.21.15.80:0/2711890023 >> v2:172.21.15.174:3300/0 conn(0x7f8f2c072360 0x7f8f2c072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:39.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f32a32700 1 -- 172.21.15.80:0/2711890023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c0734e0 msgr2=0x7f8f2c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:39.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f32a32700 1 --2- 172.21.15.80:0/2711890023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c0734e0 0x7f8f2c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:39.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f32a32700 1 -- 172.21.15.80:0/2711890023 >> v2:172.21.15.174:3300/0 conn(0x7f8f2c072360 msgr2=0x7f8f2c072800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:39.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f32a32700 1 --2- 172.21.15.80:0/2711890023 >> v2:172.21.15.174:3300/0 conn(0x7f8f2c072360 0x7f8f2c072800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:39.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f32a32700 1 -- 172.21.15.80:0/2711890023 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c0706c0 con 0x7f8f2c06c0a0 2019-11-28T11:28:39.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f32a32700 1 --2- 172.21.15.80:0/2711890023 >> v2:172.21.15.80:3300/0 conn(0x7f8f2c06c0a0 0x7f8f2c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8f1400fac0 tx=0x7f8f1400f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:39.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f32a32700 1 --2- 172.21.15.80:0/2711890023 >> v2:172.21.15.80:3300/0 conn(0x7f8f2c06c0a0 0x7f8f2c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8f1400fac0 tx=0x7f8f1400f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:39.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f32a32700 1 --2- 172.21.15.80:0/2711890023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f2c06c0a0 0x7f8f2c072fa0 secure :-1 s=READY pgs=541 cs=0 l=1 rx=0x7f8f1400fac0 tx=0x7f8f1400f970).ready entity=mon.0 client_cookie=4f90225ec141a306 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:39.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f32a32700 1 --2- 172.21.15.80:0/2711890023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f2c06c0a0 0x7f8f2c072fa0 secure :-1 s=THROTTLE_DONE pgs=541 cs=0 l=1 rx=0x7f8f1400fac0 tx=0x7f8f1400f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:39.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f32a32700 1 --2- 172.21.15.80:0/2711890023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f2c06c0a0 0x7f8f2c072fa0 secure :-1 s=THROTTLE_DONE pgs=541 cs=0 l=1 rx=0x7f8f1400fac0 tx=0x7f8f1400f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:39.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f31a30700 1 -- 172.21.15.80:0/2711890023 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f14000ce0 con 0x7f8f2c06c0a0 2019-11-28T11:28:39.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f32a32700 1 --2- 172.21.15.80:0/2711890023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f2c06c0a0 0x7f8f2c072fa0 secure :-1 s=THROTTLE_DONE pgs=541 cs=0 l=1 rx=0x7f8f1400fac0 tx=0x7f8f1400f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:39.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f31a30700 1 -- 172.21.15.80:0/2711890023 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f14001010 con 0x7f8f2c06c0a0 2019-11-28T11:28:39.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f31a30700 1 -- 172.21.15.80:0/2711890023 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f14001720 con 0x7f8f2c06c0a0 2019-11-28T11:28:39.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f34495700 1 -- 172.21.15.80:0/2711890023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f2c06c0a0 msgr2=0x7f8f2c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:39.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.918+0000 7f8f34495700 1 --2- 172.21.15.80:0/2711890023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f2c06c0a0 0x7f8f2c072fa0 secure :-1 s=READY pgs=541 cs=0 l=1 rx=0x7f8f1400fac0 tx=0x7f8f1400f970).stop 2019-11-28T11:28:39.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.919+0000 7f8f34495700 1 -- 172.21.15.80:0/2711890023 shutdown_connections 2019-11-28T11:28:39.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.919+0000 7f8f34495700 1 --2- 172.21.15.80:0/2711890023 >> v2:172.21.15.174:3300/0 conn(0x7f8f2c072360 0x7f8f2c072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:39.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.919+0000 7f8f34495700 1 --2- 172.21.15.80:0/2711890023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c0734e0 0x7f8f2c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:39.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.919+0000 7f8f34495700 1 --2- 172.21.15.80:0/2711890023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f2c06c0a0 0x7f8f2c072fa0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:39.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.919+0000 7f8f34495700 1 -- 172.21.15.80:0/2711890023 shutdown_connections 2019-11-28T11:28:39.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.919+0000 7f8f34495700 1 -- 172.21.15.80:0/2711890023 wait complete. 2019-11-28T11:28:39.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.919+0000 7f8f34495700 1 -- 172.21.15.80:0/2711890023 >> 172.21.15.80:0/2711890023 conn(0x7f8f2c061cf0 msgr2=0x7f8f2c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:39.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.922+0000 7f8f34495700 1 Processor -- start 2019-11-28T11:28:39.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.922+0000 7f8f34495700 1 -- start start 2019-11-28T11:28:39.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.922+0000 7f8f34495700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c103000 0x7f8f2c103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:39.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.922+0000 7f8f34495700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2c1312c0 con 0x7f8f2c13dc00 2019-11-28T11:28:39.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.922+0000 7f8f34495700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2c131730 con 0x7f8f2c1039d0 2019-11-28T11:28:39.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.922+0000 7f8f34495700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c105830 con 0x7f8f2c103000 2019-11-28T11:28:39.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f32a32700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8f2c13dc00 0x7f8f2c109e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32884/0 (socket says 172.21.15.80:32884) 2019-11-28T11:28:39.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f32a32700 1 -- 172.21.15.80:0/3262343782 learned_addr learned my addr 172.21.15.80:0/3262343782 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:39.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f32231700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c103000 0x7f8f2c103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:39.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f2b7fe700 1 -- 172.21.15.80:0/3262343782 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543291646 0 0) 0x7f8f14007900 con 0x7f8f2c13dc00 2019-11-28T11:28:39.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f2b7fe700 1 -- 172.21.15.80:0/3262343782 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f10002e80 con 0x7f8f2c13dc00 2019-11-28T11:28:39.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f2b7fe700 1 -- 172.21.15.80:0/3262343782 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417552407 0 0) 0x7f8f240020d0 con 0x7f8f2c1039d0 2019-11-28T11:28:39.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f2b7fe700 1 -- 172.21.15.80:0/3262343782 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f100030b0 con 0x7f8f2c1039d0 2019-11-28T11:28:39.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f2b7fe700 1 -- 172.21.15.80:0/3262343782 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2181428878 0 0) 0x7f8f14007de0 con 0x7f8f2c13dc00 2019-11-28T11:28:39.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f32231700 1 -- 172.21.15.80:0/3262343782 >> v1:172.21.15.174:6789/0 conn(0x7f8f2c1039d0 legacy=0x7f8f2c167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:39.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f32231700 1 -- 172.21.15.80:0/3262343782 >> v1:172.21.15.80:6789/0 conn(0x7f8f2c13dc00 legacy=0x7f8f2c109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:39.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f32231700 1 -- 172.21.15.80:0/3262343782 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c106190 con 0x7f8f2c103000 2019-11-28T11:28:39.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f32231700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c103000 0x7f8f2c103490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8f1c010370 tx=0x7f8f1c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:39.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f32231700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c103000 0x7f8f2c103490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8f1c010370 tx=0x7f8f1c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:39.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f32231700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c103000 0x7f8f2c103490 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f8f1c010370 tx=0x7f8f1c010710).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:39.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f32231700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c103000 0x7f8f2c103490 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f8f1c010370 tx=0x7f8f1c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:39.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f2b7fe700 1 -- 172.21.15.80:0/3262343782 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f1c00a6f0 con 0x7f8f2c103000 2019-11-28T11:28:39.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f32231700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c103000 0x7f8f2c103490 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f8f1c010370 tx=0x7f8f1c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:39.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f32231700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c103000 0x7f8f2c103490 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f8f1c010370 tx=0x7f8f1c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:39.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f2b7fe700 1 -- 172.21.15.80:0/3262343782 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c00bb60 con 0x7f8f2c103000 2019-11-28T11:28:39.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f34495700 1 -- 172.21.15.80:0/3262343782 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c106510 con 0x7f8f2c103000 2019-11-28T11:28:39.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f2b7fe700 1 -- 172.21.15.80:0/3262343782 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f1c00c3c0 con 0x7f8f2c103000 2019-11-28T11:28:39.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.923+0000 7f8f34495700 1 -- 172.21.15.80:0/3262343782 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c106190 con 0x7f8f2c103000 2019-11-28T11:28:39.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.924+0000 7f8f32231700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c103000 0x7f8f2c103490 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f8f1c010370 tx=0x7f8f1c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:39.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.924+0000 7f8f2b7fe700 1 -- 172.21.15.80:0/3262343782 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8f1c00bd50 con 0x7f8f2c103000 2019-11-28T11:28:39.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.924+0000 7f8f32231700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c103000 0x7f8f2c103490 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f8f1c010370 tx=0x7f8f1c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:39.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.924+0000 7f8f2b7fe700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f10018750 0x7f8f1001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:39.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.924+0000 7f8f2b7fe700 1 -- 172.21.15.80:0/3262343782 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8f1c031a90 con 0x7f8f2c103000 2019-11-28T11:28:39.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.924+0000 7f8f32a32700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f10018750 0x7f8f1001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:39.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.925+0000 7f8f32a32700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f10018750 0x7f8f1001abe0 crc :-1 s=READY pgs=231 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:39.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.932+0000 7f8f34495700 1 -- 172.21.15.80:0/3262343782 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c106510 con 0x7f8f2c103000 2019-11-28T11:28:39.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.936+0000 7f8f32231700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c103000 0x7f8f2c103490 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f8f1c010370 tx=0x7f8f1c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:39.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:39.936+0000 7f8f2b7fe700 1 -- 172.21.15.80:0/3262343782 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8f1c00b950 con 0x7f8f2c103000 2019-11-28T11:28:40.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.111+0000 7f8f34495700 1 -- 172.21.15.80:0/3262343782 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f2c106190 con 0x7f8f2c103000 2019-11-28T11:28:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.112+0000 7f8f32231700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c103000 0x7f8f2c103490 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f8f1c010370 tx=0x7f8f1c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.112+0000 7f8f2b7fe700 1 -- 172.21.15.80:0/3262343782 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+14857 (secure 0 0 0) 0x7f8f1c00bd50 con 0x7f8f2c103000 2019-11-28T11:28:40.141 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:40.141 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":47,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:28:29.965726+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:28:26.282940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2019-11-28T11:28:26.978374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:28:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.114+0000 7f8f34495700 1 -- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f10018750 msgr2=0x7f8f1001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.114+0000 7f8f34495700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f10018750 0x7f8f1001abe0 crc :-1 s=READY pgs=231 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.114+0000 7f8f34495700 1 -- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c103000 msgr2=0x7f8f2c103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.114+0000 7f8f34495700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c103000 0x7f8f2c103490 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f8f1c010370 tx=0x7f8f1c010710).stop 2019-11-28T11:28:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.114+0000 7f8f34495700 1 -- 172.21.15.80:0/3262343782 shutdown_connections 2019-11-28T11:28:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.114+0000 7f8f34495700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f10018750 0x7f8f1001abe0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.114+0000 7f8f34495700 1 --2- 172.21.15.80:0/3262343782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f2c103000 0x7f8f2c103490 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.114+0000 7f8f34495700 1 -- 172.21.15.80:0/3262343782 shutdown_connections 2019-11-28T11:28:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.114+0000 7f8f34495700 1 -- 172.21.15.80:0/3262343782 wait complete. 2019-11-28T11:28:40.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.114+0000 7f8f34495700 1 -- 172.21.15.80:0/3262343782 >> 172.21.15.80:0/3262343782 conn(0x7f8f2c11bfc0 msgr2=0x7f8f2c141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:40.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:28:26.282940+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 6, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'46', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:28:26.978374+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 7, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'47', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:28:40.153 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:28:40.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.248+0000 7f47f70b9700 1 Processor -- start 2019-11-28T11:28:40.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.248+0000 7f47f70b9700 1 -- start start 2019-11-28T11:28:40.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.249+0000 7f47f70b9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47f01639f0 0x7f47f0165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:40.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.249+0000 7f47f70b9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f006db60 con 0x7f47f015ed10 2019-11-28T11:28:40.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.249+0000 7f47f70b9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f006e060 con 0x7f47f015f100 2019-11-28T11:28:40.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.249+0000 7f47f70b9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f006fe00 con 0x7f47f01639f0 2019-11-28T11:28:40.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47f5e57700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47f01639f0 0x7f47f0165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:40.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47f5e57700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47f01639f0 0x7f47f0165df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33578/0 (socket says 172.21.15.80:33578) 2019-11-28T11:28:40.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47f5e57700 1 -- 172.21.15.80:0/237531660 learned_addr learned my addr 172.21.15.80:0/237531660 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:40.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47f5e57700 1 -- 172.21.15.80:0/237531660 >> v1:172.21.15.174:6789/0 conn(0x7f47f015f100 legacy=0x7f47f006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47f5e57700 1 -- 172.21.15.80:0/237531660 >> v1:172.21.15.80:6789/0 conn(0x7f47f015ed10 legacy=0x7f47f0073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47effff700 1 -- 172.21.15.80:0/237531660 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524548931 0 0) 0x7f47d8001480 con 0x7f47f015ed10 2019-11-28T11:28:40.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47f5e57700 1 -- 172.21.15.80:0/237531660 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f0070760 con 0x7f47f01639f0 2019-11-28T11:28:40.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47f5e57700 1 --2- 172.21.15.80:0/237531660 >> v2:172.21.15.80:3300/0 conn(0x7f47f01639f0 0x7f47f0165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f47e800f730 tx=0x7f47e800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47f5e57700 1 --2- 172.21.15.80:0/237531660 >> v2:172.21.15.80:3300/0 conn(0x7f47f01639f0 0x7f47f0165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f47e800f730 tx=0x7f47e800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47f5e57700 1 --2- 172.21.15.80:0/237531660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f01639f0 0x7f47f0165df0 secure :-1 s=READY pgs=544 cs=0 l=1 rx=0x7f47e800f730 tx=0x7f47e800fad0).ready entity=mon.0 client_cookie=67b3f6ab9140c2b1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:40.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47f5e57700 1 --2- 172.21.15.80:0/237531660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f01639f0 0x7f47f0165df0 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f47e800f730 tx=0x7f47e800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47effff700 1 -- 172.21.15.80:0/237531660 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47e8000a70 con 0x7f47f01639f0 2019-11-28T11:28:40.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47f5e57700 1 --2- 172.21.15.80:0/237531660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f01639f0 0x7f47f0165df0 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f47e800f730 tx=0x7f47e800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47f5e57700 1 --2- 172.21.15.80:0/237531660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f01639f0 0x7f47f0165df0 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f47e800f730 tx=0x7f47e800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47effff700 1 -- 172.21.15.80:0/237531660 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e80010e0 con 0x7f47f01639f0 2019-11-28T11:28:40.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47effff700 1 -- 172.21.15.80:0/237531660 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47e80017b0 con 0x7f47f01639f0 2019-11-28T11:28:40.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47f70b9700 1 -- 172.21.15.80:0/237531660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f01639f0 msgr2=0x7f47f0165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.250+0000 7f47f70b9700 1 --2- 172.21.15.80:0/237531660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f01639f0 0x7f47f0165df0 secure :-1 s=READY pgs=544 cs=0 l=1 rx=0x7f47e800f730 tx=0x7f47e800fad0).stop 2019-11-28T11:28:40.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.251+0000 7f47f70b9700 1 -- 172.21.15.80:0/237531660 shutdown_connections 2019-11-28T11:28:40.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.251+0000 7f47f70b9700 1 --2- 172.21.15.80:0/237531660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f01639f0 0x7f47f0165df0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.251+0000 7f47f70b9700 1 -- 172.21.15.80:0/237531660 shutdown_connections 2019-11-28T11:28:40.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.251+0000 7f47f70b9700 1 -- 172.21.15.80:0/237531660 wait complete. 2019-11-28T11:28:40.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.251+0000 7f47f70b9700 1 -- 172.21.15.80:0/237531660 >> 172.21.15.80:0/237531660 conn(0x7f47f0061d20 msgr2=0x7f47f00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:40.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.253+0000 7f47f70b9700 1 Processor -- start 2019-11-28T11:28:40.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.254+0000 7f47f70b9700 1 -- start start 2019-11-28T11:28:40.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f70b9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47f012aa90 0x7f47f012ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:40.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f70b9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f47f00741e0 0x7f47f0073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:40.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f70b9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47f0074670 0x7f47f00735a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:40.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f70b9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f007a2c0 con 0x7f47f012aa90 2019-11-28T11:28:40.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f70b9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f007a590 con 0x7f47f00741e0 2019-11-28T11:28:40.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f70b9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f0079890 con 0x7f47f0074670 2019-11-28T11:28:40.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f5656700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47f012aa90 0x7f47f012ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:40.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f5656700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47f012aa90 0x7f47f012ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33582/0 (socket says 172.21.15.80:33582) 2019-11-28T11:28:40.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f5656700 1 -- 172.21.15.80:0/3715610067 learned_addr learned my addr 172.21.15.80:0/3715610067 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:40.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f5e57700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47f0074670 0x7f47f00735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:40.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f4e55700 1 --2- 172.21.15.80:0/3715610067 >> v2:172.21.15.174:3300/0 conn(0x7f47f00741e0 0x7f47f0073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:40.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f5656700 1 -- 172.21.15.80:0/3715610067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47f0074670 msgr2=0x7f47f00735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f5656700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47f0074670 0x7f47f00735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f5656700 1 -- 172.21.15.80:0/3715610067 >> v2:172.21.15.174:3300/0 conn(0x7f47f00741e0 msgr2=0x7f47f0073060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f5656700 1 --2- 172.21.15.80:0/3715610067 >> v2:172.21.15.174:3300/0 conn(0x7f47f00741e0 0x7f47f0073060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f5656700 1 -- 172.21.15.80:0/3715610067 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f007ac20 con 0x7f47f012aa90 2019-11-28T11:28:40.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f5656700 1 --2- 172.21.15.80:0/3715610067 >> v2:172.21.15.80:3300/0 conn(0x7f47f012aa90 0x7f47f012ae80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47d80107d0 tx=0x7f47d8010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f5656700 1 --2- 172.21.15.80:0/3715610067 >> v2:172.21.15.80:3300/0 conn(0x7f47f012aa90 0x7f47f012ae80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47d80107d0 tx=0x7f47d8010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f5656700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f012aa90 0x7f47f012ae80 secure :-1 s=READY pgs=545 cs=0 l=1 rx=0x7f47d80107d0 tx=0x7f47d8010650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:40.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f5656700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f012aa90 0x7f47f012ae80 secure :-1 s=THROTTLE_DONE pgs=545 cs=0 l=1 rx=0x7f47d80107d0 tx=0x7f47d8010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47edffb700 1 -- 172.21.15.80:0/3715610067 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47d8001040 con 0x7f47f012aa90 2019-11-28T11:28:40.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f5656700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f012aa90 0x7f47f012ae80 secure :-1 s=THROTTLE_DONE pgs=545 cs=0 l=1 rx=0x7f47d80107d0 tx=0x7f47d8010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47edffb700 1 -- 172.21.15.80:0/3715610067 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d8001040 con 0x7f47f012aa90 2019-11-28T11:28:40.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f70b9700 1 -- 172.21.15.80:0/3715610067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f007afa0 con 0x7f47f012aa90 2019-11-28T11:28:40.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f5656700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f012aa90 0x7f47f012ae80 secure :-1 s=THROTTLE_DONE pgs=545 cs=0 l=1 rx=0x7f47d80107d0 tx=0x7f47d8010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47edffb700 1 -- 172.21.15.80:0/3715610067 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47d800f3f0 con 0x7f47f012aa90 2019-11-28T11:28:40.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.255+0000 7f47f70b9700 1 -- 172.21.15.80:0/3715610067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f007ac20 con 0x7f47f012aa90 2019-11-28T11:28:40.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.256+0000 7f47f5656700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f012aa90 0x7f47f012ae80 secure :-1 s=THROTTLE_DONE pgs=545 cs=0 l=1 rx=0x7f47d80107d0 tx=0x7f47d8010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.256+0000 7f47edffb700 1 -- 172.21.15.80:0/3715610067 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f47d800fad0 con 0x7f47f012aa90 2019-11-28T11:28:40.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.256+0000 7f47f5656700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f012aa90 0x7f47f012ae80 secure :-1 s=THROTTLE_DONE pgs=545 cs=0 l=1 rx=0x7f47d80107d0 tx=0x7f47d8010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.256+0000 7f47edffb700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47d4018730 0x7f47d401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:40.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.256+0000 7f47edffb700 1 -- 172.21.15.80:0/3715610067 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f47d8031f90 con 0x7f47f012aa90 2019-11-28T11:28:40.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.256+0000 7f47f4e55700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47d4018730 0x7f47d401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:40.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.256+0000 7f47f4e55700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47d4018730 0x7f47d401abc0 crc :-1 s=READY pgs=232 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:40.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.264+0000 7f47f70b9700 1 -- 172.21.15.80:0/3715610067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f007afa0 con 0x7f47f012aa90 2019-11-28T11:28:40.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.267+0000 7f47f5656700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f012aa90 0x7f47f012ae80 secure :-1 s=THROTTLE_DONE pgs=545 cs=0 l=1 rx=0x7f47d80107d0 tx=0x7f47d8010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.267+0000 7f47edffb700 1 -- 172.21.15.80:0/3715610067 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f47d800f8c0 con 0x7f47f012aa90 2019-11-28T11:28:40.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.434+0000 7f47f70b9700 1 -- 172.21.15.80:0/3715610067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f47f007ac20 con 0x7f47f012aa90 2019-11-28T11:28:40.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.434+0000 7f47f5656700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f012aa90 0x7f47f012ae80 secure :-1 s=THROTTLE_DONE pgs=545 cs=0 l=1 rx=0x7f47d80107d0 tx=0x7f47d8010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.434+0000 7f47edffb700 1 -- 172.21.15.80:0/3715610067 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7f47d800fab0 con 0x7f47f012aa90 2019-11-28T11:28:40.463 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:28:40.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.436+0000 7f47f70b9700 1 -- 172.21.15.80:0/3715610067 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47d4018730 msgr2=0x7f47d401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.436+0000 7f47f70b9700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47d4018730 0x7f47d401abc0 crc :-1 s=READY pgs=232 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.437+0000 7f47f70b9700 1 -- 172.21.15.80:0/3715610067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f012aa90 msgr2=0x7f47f012ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.437+0000 7f47f70b9700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f012aa90 0x7f47f012ae80 secure :-1 s=READY pgs=545 cs=0 l=1 rx=0x7f47d80107d0 tx=0x7f47d8010650).stop 2019-11-28T11:28:40.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.437+0000 7f47f70b9700 1 -- 172.21.15.80:0/3715610067 shutdown_connections 2019-11-28T11:28:40.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.437+0000 7f47f70b9700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47d4018730 0x7f47d401abc0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.437+0000 7f47f70b9700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47f0074670 0x7f47f00735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.437+0000 7f47f70b9700 1 --2- 172.21.15.80:0/3715610067 >> v2:172.21.15.174:3300/0 conn(0x7f47f00741e0 0x7f47f0073060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.437+0000 7f47f70b9700 1 --2- 172.21.15.80:0/3715610067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f012aa90 0x7f47f012ae80 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.437+0000 7f47f70b9700 1 -- 172.21.15.80:0/3715610067 shutdown_connections 2019-11-28T11:28:40.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.437+0000 7f47f70b9700 1 -- 172.21.15.80:0/3715610067 wait complete. 2019-11-28T11:28:40.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.437+0000 7f47f70b9700 1 -- 172.21.15.80:0/3715610067 >> 172.21.15.80:0/3715610067 conn(0x7f47f0147670 msgr2=0x7f47f01641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:40.475 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:28:40.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.569+0000 7f181a092700 1 Processor -- start 2019-11-28T11:28:40.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.569+0000 7f181a092700 1 -- start start 2019-11-28T11:28:40.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.570+0000 7f181a092700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181415ed10 0x7f181415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:40.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.570+0000 7f181a092700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181406db60 con 0x7f18140734b0 2019-11-28T11:28:40.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.570+0000 7f181a092700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181406e060 con 0x7f1814073020 2019-11-28T11:28:40.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.570+0000 7f181a092700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181406f3d0 con 0x7f181415ed10 2019-11-28T11:28:40.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.570+0000 7f1818e30700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f18140734b0 0x7f18140726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32908/0 (socket says 172.21.15.80:32908) 2019-11-28T11:28:40.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.570+0000 7f1818e30700 1 -- 172.21.15.80:0/1541283569 learned_addr learned my addr 172.21.15.80:0/1541283569 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:40.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.570+0000 7f1813fff700 1 --2- 172.21.15.80:0/1541283569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181415ed10 0x7f181415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:40.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f18137fe700 1 -- 172.21.15.80:0/1541283569 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665527374 0 0) 0x7f180c0014d0 con 0x7f18140734b0 2019-11-28T11:28:40.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f18137fe700 1 -- 172.21.15.80:0/1541283569 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1800002e80 con 0x7f18140734b0 2019-11-28T11:28:40.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f18137fe700 1 -- 172.21.15.80:0/1541283569 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767542396 0 0) 0x7f17fc001080 con 0x7f1814073020 2019-11-28T11:28:40.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f18137fe700 1 -- 172.21.15.80:0/1541283569 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18000030b0 con 0x7f1814073020 2019-11-28T11:28:40.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f1813fff700 1 -- 172.21.15.80:0/1541283569 >> v1:172.21.15.174:6789/0 conn(0x7f1814073020 legacy=0x7f1814071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f1813fff700 1 -- 172.21.15.80:0/1541283569 >> v1:172.21.15.80:6789/0 conn(0x7f18140734b0 legacy=0x7f18140726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f1813fff700 1 -- 172.21.15.80:0/1541283569 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1814070760 con 0x7f181415ed10 2019-11-28T11:28:40.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f1813fff700 1 --2- 172.21.15.80:0/1541283569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181415ed10 0x7f181415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f180400af50 tx=0x7f180400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f1813fff700 1 --2- 172.21.15.80:0/1541283569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181415ed10 0x7f181415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f180400af50 tx=0x7f180400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f1813fff700 1 --2- 172.21.15.80:0/1541283569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181415ed10 0x7f181415f100 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f180400af50 tx=0x7f180400b760).ready entity=mon.2 client_cookie=3580e0b3ea3dca36 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:40.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f1813fff700 1 --2- 172.21.15.80:0/1541283569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181415ed10 0x7f181415f100 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f180400af50 tx=0x7f180400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f18137fe700 1 -- 172.21.15.80:0/1541283569 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1804000960 con 0x7f181415ed10 2019-11-28T11:28:40.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f1813fff700 1 --2- 172.21.15.80:0/1541283569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181415ed10 0x7f181415f100 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f180400af50 tx=0x7f180400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f1813fff700 1 --2- 172.21.15.80:0/1541283569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181415ed10 0x7f181415f100 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f180400af50 tx=0x7f180400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f18137fe700 1 -- 172.21.15.80:0/1541283569 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1804009860 con 0x7f181415ed10 2019-11-28T11:28:40.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f18137fe700 1 -- 172.21.15.80:0/1541283569 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1804009f30 con 0x7f181415ed10 2019-11-28T11:28:40.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f181a092700 1 -- 172.21.15.80:0/1541283569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181415ed10 msgr2=0x7f181415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.571+0000 7f181a092700 1 --2- 172.21.15.80:0/1541283569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181415ed10 0x7f181415f100 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f180400af50 tx=0x7f180400b760).stop 2019-11-28T11:28:40.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.572+0000 7f181a092700 1 -- 172.21.15.80:0/1541283569 shutdown_connections 2019-11-28T11:28:40.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.572+0000 7f181a092700 1 --2- 172.21.15.80:0/1541283569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181415ed10 0x7f181415f100 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.572+0000 7f181a092700 1 -- 172.21.15.80:0/1541283569 shutdown_connections 2019-11-28T11:28:40.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.572+0000 7f181a092700 1 -- 172.21.15.80:0/1541283569 wait complete. 2019-11-28T11:28:40.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.572+0000 7f181a092700 1 -- 172.21.15.80:0/1541283569 >> 172.21.15.80:0/1541283569 conn(0x7f1814061d20 msgr2=0x7f18140641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:40.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.574+0000 7f181a092700 1 Processor -- start 2019-11-28T11:28:40.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.574+0000 7f181a092700 1 -- start start 2019-11-28T11:28:40.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.575+0000 7f181a092700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1814165190 0x7f1814165620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:40.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.575+0000 7f181a092700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1814162a90 con 0x7f1814127280 2019-11-28T11:28:40.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.575+0000 7f181a092700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1814165e70 con 0x7f181412e9a0 2019-11-28T11:28:40.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.575+0000 7f181a092700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1814075800 con 0x7f1814165190 2019-11-28T11:28:40.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.575+0000 7f1813fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1814127280 0x7f1814079840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32912/0 (socket says 172.21.15.80:32912) 2019-11-28T11:28:40.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.575+0000 7f1813fff700 1 -- 172.21.15.80:0/364387641 learned_addr learned my addr 172.21.15.80:0/364387641 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:40.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.575+0000 7f180bfff700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1814165190 0x7f1814165620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:40.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.575+0000 7f18117fa700 1 -- 172.21.15.80:0/364387641 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539737353 0 0) 0x7f180400b3d0 con 0x7f1814127280 2019-11-28T11:28:40.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.575+0000 7f18117fa700 1 -- 172.21.15.80:0/364387641 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f8002e80 con 0x7f1814127280 2019-11-28T11:28:40.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f18117fa700 1 -- 172.21.15.80:0/364387641 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082096260 0 0) 0x7f180c001480 con 0x7f181412e9a0 2019-11-28T11:28:40.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f18117fa700 1 -- 172.21.15.80:0/364387641 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f80030b0 con 0x7f181412e9a0 2019-11-28T11:28:40.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f18117fa700 1 -- 172.21.15.80:0/364387641 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3724462877 0 0) 0x7f1804000940 con 0x7f1814127280 2019-11-28T11:28:40.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f180bfff700 1 -- 172.21.15.80:0/364387641 >> v1:172.21.15.174:6789/0 conn(0x7f181412e9a0 legacy=0x7f1814077830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f180bfff700 1 -- 172.21.15.80:0/364387641 >> v1:172.21.15.80:6789/0 conn(0x7f1814127280 legacy=0x7f1814079840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f180bfff700 1 -- 172.21.15.80:0/364387641 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1814076160 con 0x7f1814165190 2019-11-28T11:28:40.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f180bfff700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1814165190 0x7f1814165620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f17fc0103a0 tx=0x7f17fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f180bfff700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1814165190 0x7f1814165620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f17fc0103a0 tx=0x7f17fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f180bfff700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1814165190 0x7f1814165620 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f17fc0103a0 tx=0x7f17fc010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:40.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f180bfff700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1814165190 0x7f1814165620 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f17fc0103a0 tx=0x7f17fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f18117fa700 1 -- 172.21.15.80:0/364387641 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17fc000aa0 con 0x7f1814165190 2019-11-28T11:28:40.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f180bfff700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1814165190 0x7f1814165620 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f17fc0103a0 tx=0x7f17fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f180bfff700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1814165190 0x7f1814165620 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f17fc0103a0 tx=0x7f17fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f18117fa700 1 -- 172.21.15.80:0/364387641 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc009980 con 0x7f1814165190 2019-11-28T11:28:40.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f18117fa700 1 -- 172.21.15.80:0/364387641 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17fc00a090 con 0x7f1814165190 2019-11-28T11:28:40.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f181a092700 1 -- 172.21.15.80:0/364387641 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18140764e0 con 0x7f1814165190 2019-11-28T11:28:40.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f181a092700 1 -- 172.21.15.80:0/364387641 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1814076160 con 0x7f1814165190 2019-11-28T11:28:40.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.576+0000 7f180bfff700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1814165190 0x7f1814165620 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f17fc0103a0 tx=0x7f17fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.577+0000 7f18117fa700 1 -- 172.21.15.80:0/364387641 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f17fc000aa0 con 0x7f1814165190 2019-11-28T11:28:40.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.577+0000 7f180bfff700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1814165190 0x7f1814165620 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f17fc0103a0 tx=0x7f17fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.577+0000 7f18117fa700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17f8018750 0x7f17f801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:40.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.577+0000 7f18117fa700 1 -- 172.21.15.80:0/364387641 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f17fc031ae0 con 0x7f1814165190 2019-11-28T11:28:40.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.577+0000 7f1813fff700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17f8018750 0x7f17f801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:40.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.577+0000 7f1813fff700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17f8018750 0x7f17f801abe0 crc :-1 s=READY pgs=233 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:40.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.584+0000 7f181a092700 1 -- 172.21.15.80:0/364387641 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18140764e0 con 0x7f1814165190 2019-11-28T11:28:40.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.588+0000 7f180bfff700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1814165190 0x7f1814165620 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f17fc0103a0 tx=0x7f17fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.588+0000 7f18117fa700 1 -- 172.21.15.80:0/364387641 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f17fc00a560 con 0x7f1814165190 2019-11-28T11:28:40.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.753+0000 7f181a092700 1 -- 172.21.15.80:0/364387641 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f1814076160 con 0x7f1814165190 2019-11-28T11:28:40.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.754+0000 7f180bfff700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1814165190 0x7f1814165620 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f17fc0103a0 tx=0x7f17fc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.754+0000 7f18117fa700 1 -- 172.21.15.80:0/364387641 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v47) v1 ==== 104+0+10 (secure 0 0 0) 0x7f17fc000aa0 con 0x7f1814165190 2019-11-28T11:28:40.782 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:28:40.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.756+0000 7f181a092700 1 -- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17f8018750 msgr2=0x7f17f801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.756+0000 7f181a092700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17f8018750 0x7f17f801abe0 crc :-1 s=READY pgs=233 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.756+0000 7f181a092700 1 -- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1814165190 msgr2=0x7f1814165620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.756+0000 7f181a092700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1814165190 0x7f1814165620 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f17fc0103a0 tx=0x7f17fc010740).stop 2019-11-28T11:28:40.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.756+0000 7f181a092700 1 -- 172.21.15.80:0/364387641 shutdown_connections 2019-11-28T11:28:40.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.756+0000 7f181a092700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17f8018750 0x7f17f801abe0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.756+0000 7f181a092700 1 --2- 172.21.15.80:0/364387641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1814165190 0x7f1814165620 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.756+0000 7f181a092700 1 -- 172.21.15.80:0/364387641 shutdown_connections 2019-11-28T11:28:40.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.756+0000 7f181a092700 1 -- 172.21.15.80:0/364387641 wait complete. 2019-11-28T11:28:40.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.756+0000 7f181a092700 1 -- 172.21.15.80:0/364387641 >> 172.21.15.80:0/364387641 conn(0x7f1814166440 msgr2=0x7f18141494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:40.808 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:28:40.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.910+0000 7fd3c5c0b700 1 Processor -- start 2019-11-28T11:28:40.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.910+0000 7fd3c5c0b700 1 -- start start 2019-11-28T11:28:40.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3c5c0b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c015f100 0x7fd3c006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:40.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3c5c0b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c006db60 con 0x7fd3c006c2f0 2019-11-28T11:28:40.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3c5c0b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c006e060 con 0x7fd3c015ed10 2019-11-28T11:28:40.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3c5c0b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c006fe00 con 0x7fd3c015f100 2019-11-28T11:28:40.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3c49a9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd3c006c2f0 0x7fd3c006c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32924/0 (socket says 172.21.15.80:32924) 2019-11-28T11:28:40.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3c49a9700 1 -- 172.21.15.80:0/602807425 learned_addr learned my addr 172.21.15.80:0/602807425 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:40.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3b7fff700 1 --2- 172.21.15.80:0/602807425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c015f100 0x7fd3c006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:40.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3bf7fe700 1 -- 172.21.15.80:0/602807425 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164105414 0 0) 0x7fd3b80014d0 con 0x7fd3c006c2f0 2019-11-28T11:28:40.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3bf7fe700 1 -- 172.21.15.80:0/602807425 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3ac002e80 con 0x7fd3c006c2f0 2019-11-28T11:28:40.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3bf7fe700 1 -- 172.21.15.80:0/602807425 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271325109 0 0) 0x7fd3b0001080 con 0x7fd3c015ed10 2019-11-28T11:28:40.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3bf7fe700 1 -- 172.21.15.80:0/602807425 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3ac0030b0 con 0x7fd3c015ed10 2019-11-28T11:28:40.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3b7fff700 1 -- 172.21.15.80:0/602807425 >> v1:172.21.15.174:6789/0 conn(0x7fd3c015ed10 legacy=0x7fd3c0073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3b7fff700 1 -- 172.21.15.80:0/602807425 >> v1:172.21.15.80:6789/0 conn(0x7fd3c006c2f0 legacy=0x7fd3c006c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3b7fff700 1 -- 172.21.15.80:0/602807425 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c0070760 con 0x7fd3c015f100 2019-11-28T11:28:40.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3b7fff700 1 --2- 172.21.15.80:0/602807425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c015f100 0x7fd3c006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd3a800af50 tx=0x7fd3a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3b7fff700 1 --2- 172.21.15.80:0/602807425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c015f100 0x7fd3c006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd3a800af50 tx=0x7fd3a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.911+0000 7fd3b7fff700 1 --2- 172.21.15.80:0/602807425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c015f100 0x7fd3c006bdb0 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fd3a800af50 tx=0x7fd3a800b760).ready entity=mon.2 client_cookie=17678fd34289274c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:40.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.912+0000 7fd3b7fff700 1 --2- 172.21.15.80:0/602807425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c015f100 0x7fd3c006bdb0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fd3a800af50 tx=0x7fd3a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.912+0000 7fd3b7fff700 1 --2- 172.21.15.80:0/602807425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c015f100 0x7fd3c006bdb0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fd3a800af50 tx=0x7fd3a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.912+0000 7fd3bf7fe700 1 -- 172.21.15.80:0/602807425 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3a8000960 con 0x7fd3c015f100 2019-11-28T11:28:40.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.912+0000 7fd3b7fff700 1 --2- 172.21.15.80:0/602807425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c015f100 0x7fd3c006bdb0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fd3a800af50 tx=0x7fd3a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.912+0000 7fd3bf7fe700 1 -- 172.21.15.80:0/602807425 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a8009860 con 0x7fd3c015f100 2019-11-28T11:28:40.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.912+0000 7fd3bf7fe700 1 -- 172.21.15.80:0/602807425 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3a8009f30 con 0x7fd3c015f100 2019-11-28T11:28:40.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.912+0000 7fd3c5c0b700 1 -- 172.21.15.80:0/602807425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c015f100 msgr2=0x7fd3c006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.912+0000 7fd3c5c0b700 1 --2- 172.21.15.80:0/602807425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c015f100 0x7fd3c006bdb0 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fd3a800af50 tx=0x7fd3a800b760).stop 2019-11-28T11:28:40.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.912+0000 7fd3c5c0b700 1 -- 172.21.15.80:0/602807425 shutdown_connections 2019-11-28T11:28:40.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.912+0000 7fd3c5c0b700 1 --2- 172.21.15.80:0/602807425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c015f100 0x7fd3c006bdb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.912+0000 7fd3c5c0b700 1 -- 172.21.15.80:0/602807425 shutdown_connections 2019-11-28T11:28:40.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.912+0000 7fd3c5c0b700 1 -- 172.21.15.80:0/602807425 wait complete. 2019-11-28T11:28:40.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.912+0000 7fd3c5c0b700 1 -- 172.21.15.80:0/602807425 >> 172.21.15.80:0/602807425 conn(0x7fd3c0061d20 msgr2=0x7fd3c00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:40.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.915+0000 7fd3c5c0b700 1 Processor -- start 2019-11-28T11:28:40.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.915+0000 7fd3c5c0b700 1 -- start start 2019-11-28T11:28:40.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3c5c0b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd3c010e970 0x7fd3c01087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:40.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3c5c0b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c0107e30 0x7fd3c0167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:40.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3c5c0b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c010c250 con 0x7fd3c0108cf0 2019-11-28T11:28:40.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3c5c0b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c010e430 con 0x7fd3c010e970 2019-11-28T11:28:40.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3c5c0b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c0105860 con 0x7fd3c0107e30 2019-11-28T11:28:40.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3b7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd3c0108cf0 0x7fd3c0107630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32928/0 (socket says 172.21.15.80:32928) 2019-11-28T11:28:40.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3b7fff700 1 -- 172.21.15.80:0/166371330 learned_addr learned my addr 172.21.15.80:0/166371330 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:40.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3c49a9700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c0107e30 0x7fd3c0167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:40.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3bffff700 1 --2- 172.21.15.80:0/166371330 >> v2:172.21.15.174:3300/0 conn(0x7fd3c010e970 0x7fd3c01087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:40.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3bd7fa700 1 -- 172.21.15.80:0/166371330 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953835829 0 0) 0x7fd3a800b3d0 con 0x7fd3c0108cf0 2019-11-28T11:28:40.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3bd7fa700 1 -- 172.21.15.80:0/166371330 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3a4002e80 con 0x7fd3c0108cf0 2019-11-28T11:28:40.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3c49a9700 1 -- 172.21.15.80:0/166371330 >> v2:172.21.15.174:3300/0 conn(0x7fd3c010e970 msgr2=0x7fd3c01087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3c49a9700 1 --2- 172.21.15.80:0/166371330 >> v2:172.21.15.174:3300/0 conn(0x7fd3c010e970 0x7fd3c01087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:40.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3c49a9700 1 -- 172.21.15.80:0/166371330 >> v1:172.21.15.80:6789/0 conn(0x7fd3c0108cf0 legacy=0x7fd3c0107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:40.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3bd7fa700 1 -- 172.21.15.80:0/166371330 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3606688081 0 0) 0x7fd3a8000940 con 0x7fd3c0108cf0 2019-11-28T11:28:40.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3c49a9700 1 -- 172.21.15.80:0/166371330 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c0105ef0 con 0x7fd3c0107e30 2019-11-28T11:28:40.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3bffff700 1 --2- 172.21.15.80:0/166371330 >> v2:172.21.15.174:3300/0 conn(0x7fd3c010e970 0x7fd3c01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:40.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3c49a9700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c0107e30 0x7fd3c0167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3b80106f0 tx=0x7fd3b8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3c49a9700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c0107e30 0x7fd3c0167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3b80106f0 tx=0x7fd3b8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3c49a9700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c0107e30 0x7fd3c0167d70 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fd3b80106f0 tx=0x7fd3b8010a90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:40.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3c49a9700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c0107e30 0x7fd3c0167d70 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fd3b80106f0 tx=0x7fd3b8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.916+0000 7fd3bd7fa700 1 -- 172.21.15.80:0/166371330 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3b8001270 con 0x7fd3c0107e30 2019-11-28T11:28:40.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.917+0000 7fd3c49a9700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c0107e30 0x7fd3c0167d70 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fd3b80106f0 tx=0x7fd3b8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.917+0000 7fd3bd7fa700 1 -- 172.21.15.80:0/166371330 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b80045c0 con 0x7fd3c0107e30 2019-11-28T11:28:40.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.917+0000 7fd3c49a9700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c0107e30 0x7fd3c0167d70 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fd3b80106f0 tx=0x7fd3b8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.917+0000 7fd3bd7fa700 1 -- 172.21.15.80:0/166371330 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3b80047b0 con 0x7fd3c0107e30 2019-11-28T11:28:40.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.917+0000 7fd3c5c0b700 1 -- 172.21.15.80:0/166371330 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c0106270 con 0x7fd3c0107e30 2019-11-28T11:28:40.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.917+0000 7fd3c5c0b700 1 -- 172.21.15.80:0/166371330 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c0105ef0 con 0x7fd3c0107e30 2019-11-28T11:28:40.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.917+0000 7fd3c49a9700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c0107e30 0x7fd3c0167d70 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fd3b80106f0 tx=0x7fd3b8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.917+0000 7fd3bd7fa700 1 -- 172.21.15.80:0/166371330 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd3b8000ce0 con 0x7fd3c0107e30 2019-11-28T11:28:40.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.917+0000 7fd3c49a9700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c0107e30 0x7fd3c0167d70 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fd3b80106f0 tx=0x7fd3b8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.917+0000 7fd3bd7fa700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3a4018780 0x7fd3a401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:40.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.917+0000 7fd3bd7fa700 1 -- 172.21.15.80:0/166371330 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd3b8031d50 con 0x7fd3c0107e30 2019-11-28T11:28:40.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.917+0000 7fd3bffff700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3a4018780 0x7fd3a401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:40.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.918+0000 7fd3bffff700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3a4018780 0x7fd3a401abf0 crc :-1 s=READY pgs=234 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:40.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.925+0000 7fd3c5c0b700 1 -- 172.21.15.80:0/166371330 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c0106270 con 0x7fd3c0107e30 2019-11-28T11:28:40.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.929+0000 7fd3c49a9700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c0107e30 0x7fd3c0167d70 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fd3b80106f0 tx=0x7fd3b8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:40.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:40.929+0000 7fd3bd7fa700 1 -- 172.21.15.80:0/166371330 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd3b8001580 con 0x7fd3c0107e30 2019-11-28T11:28:41.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.095+0000 7fd3c5c0b700 1 -- 172.21.15.80:0/166371330 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fd3c0105ef0 con 0x7fd3c0107e30 2019-11-28T11:28:41.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.095+0000 7fd3c49a9700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c0107e30 0x7fd3c0167d70 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fd3b80106f0 tx=0x7fd3b8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:41.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.096+0000 7fd3bd7fa700 1 -- 172.21.15.80:0/166371330 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v47) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd3b8000ce0 con 0x7fd3c0107e30 2019-11-28T11:28:41.125 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:28:41.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.098+0000 7fd3c5c0b700 1 -- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3a4018780 msgr2=0x7fd3a401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:41.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.098+0000 7fd3c5c0b700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3a4018780 0x7fd3a401abf0 crc :-1 s=READY pgs=234 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:41.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.098+0000 7fd3c5c0b700 1 -- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c0107e30 msgr2=0x7fd3c0167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:41.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.098+0000 7fd3c5c0b700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c0107e30 0x7fd3c0167d70 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fd3b80106f0 tx=0x7fd3b8010a90).stop 2019-11-28T11:28:41.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.098+0000 7fd3c5c0b700 1 -- 172.21.15.80:0/166371330 shutdown_connections 2019-11-28T11:28:41.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.098+0000 7fd3c5c0b700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3a4018780 0x7fd3a401abf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:41.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.098+0000 7fd3c5c0b700 1 --2- 172.21.15.80:0/166371330 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3c0107e30 0x7fd3c0167d70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:41.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.098+0000 7fd3c5c0b700 1 --2- 172.21.15.80:0/166371330 >> v2:172.21.15.174:3300/0 conn(0x7fd3c010e970 0x7fd3c01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:41.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.098+0000 7fd3c5c0b700 1 -- 172.21.15.80:0/166371330 shutdown_connections 2019-11-28T11:28:41.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.098+0000 7fd3c5c0b700 1 -- 172.21.15.80:0/166371330 wait complete. 2019-11-28T11:28:41.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.098+0000 7fd3c5c0b700 1 -- 172.21.15.80:0/166371330 >> 172.21.15.80:0/166371330 conn(0x7fd3c015e2d0 msgr2=0x7fd3c0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:41.137 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:28:41.138 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:28:41.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.228+0000 7fc368632700 1 Processor -- start 2019-11-28T11:28:41.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.228+0000 7fc368632700 1 -- start start 2019-11-28T11:28:41.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.229+0000 7fc368632700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc36006c0a0 0x7fc360072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:41.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.229+0000 7fc368632700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3600734e0 0x7fc360071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:41.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.229+0000 7fc368632700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36006db00 con 0x7fc360072360 2019-11-28T11:28:41.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.229+0000 7fc368632700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36006fd60 con 0x7fc3600734e0 2019-11-28T11:28:41.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.229+0000 7fc368632700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc360070030 con 0x7fc36006c0a0 2019-11-28T11:28:41.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.229+0000 7fc3663ce700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3600734e0 0x7fc360071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:41.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.229+0000 7fc3663ce700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3600734e0 0x7fc360071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33622/0 (socket says 172.21.15.80:33622) 2019-11-28T11:28:41.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.229+0000 7fc3663ce700 1 -- 172.21.15.80:0/1980143571 learned_addr learned my addr 172.21.15.80:0/1980143571 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:41.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.229+0000 7fc366bcf700 1 --2- 172.21.15.80:0/1980143571 >> v2:172.21.15.174:3300/0 conn(0x7fc36006c0a0 0x7fc360072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:41.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.229+0000 7fc3663ce700 1 -- 172.21.15.80:0/1980143571 >> v2:172.21.15.174:3300/0 conn(0x7fc36006c0a0 msgr2=0x7fc360072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:41.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.229+0000 7fc3663ce700 1 --2- 172.21.15.80:0/1980143571 >> v2:172.21.15.174:3300/0 conn(0x7fc36006c0a0 0x7fc360072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:41.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.229+0000 7fc3663ce700 1 -- 172.21.15.80:0/1980143571 >> v1:172.21.15.174:6789/0 conn(0x7fc360072360 legacy=0x7fc36006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:41.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.229+0000 7fc3663ce700 1 -- 172.21.15.80:0/1980143571 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3600706c0 con 0x7fc3600734e0 2019-11-28T11:28:41.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.229+0000 7fc366bcf700 1 --2- 172.21.15.80:0/1980143571 >> v2:172.21.15.174:3300/0 conn(0x7fc36006c0a0 0x7fc360072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:28:41.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.230+0000 7fc3663ce700 1 --2- 172.21.15.80:0/1980143571 >> v2:172.21.15.80:3300/0 conn(0x7fc3600734e0 0x7fc360071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc34800f740 tx=0x7fc34800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:41.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.230+0000 7fc3663ce700 1 --2- 172.21.15.80:0/1980143571 >> v2:172.21.15.80:3300/0 conn(0x7fc3600734e0 0x7fc360071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc34800f740 tx=0x7fc34800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:41.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.230+0000 7fc3663ce700 1 --2- 172.21.15.80:0/1980143571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3600734e0 0x7fc360071e20 secure :-1 s=READY pgs=550 cs=0 l=1 rx=0x7fc34800f740 tx=0x7fc34800fae0).ready entity=mon.0 client_cookie=18e79db3b8a70d3b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:41.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.230+0000 7fc3663ce700 1 --2- 172.21.15.80:0/1980143571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3600734e0 0x7fc360071e20 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7fc34800f740 tx=0x7fc34800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:41.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.230+0000 7fc3663ce700 1 --2- 172.21.15.80:0/1980143571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3600734e0 0x7fc360071e20 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7fc34800f740 tx=0x7fc34800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:41.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.230+0000 7fc365bcd700 1 -- 172.21.15.80:0/1980143571 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc348000960 con 0x7fc3600734e0 2019-11-28T11:28:41.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.230+0000 7fc3663ce700 1 --2- 172.21.15.80:0/1980143571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3600734e0 0x7fc360071e20 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7fc34800f740 tx=0x7fc34800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:41.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.230+0000 7fc365bcd700 1 -- 172.21.15.80:0/1980143571 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc348000c90 con 0x7fc3600734e0 2019-11-28T11:28:41.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.230+0000 7fc365bcd700 1 -- 172.21.15.80:0/1980143571 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3480013a0 con 0x7fc3600734e0 2019-11-28T11:28:41.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.230+0000 7fc368632700 1 -- 172.21.15.80:0/1980143571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3600734e0 msgr2=0x7fc360071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:41.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.230+0000 7fc368632700 1 --2- 172.21.15.80:0/1980143571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3600734e0 0x7fc360071e20 secure :-1 s=READY pgs=550 cs=0 l=1 rx=0x7fc34800f740 tx=0x7fc34800fae0).stop 2019-11-28T11:28:41.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.231+0000 7fc368632700 1 -- 172.21.15.80:0/1980143571 shutdown_connections 2019-11-28T11:28:41.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.231+0000 7fc368632700 1 --2- 172.21.15.80:0/1980143571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3600734e0 0x7fc360071e20 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:41.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.231+0000 7fc368632700 1 --2- 172.21.15.80:0/1980143571 >> v2:172.21.15.174:3300/0 conn(0x7fc36006c0a0 0x7fc360072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:41.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.231+0000 7fc368632700 1 -- 172.21.15.80:0/1980143571 shutdown_connections 2019-11-28T11:28:41.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.231+0000 7fc368632700 1 -- 172.21.15.80:0/1980143571 wait complete. 2019-11-28T11:28:41.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.231+0000 7fc368632700 1 -- 172.21.15.80:0/1980143571 >> 172.21.15.80:0/1980143571 conn(0x7fc360061cf0 msgr2=0x7fc360064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:41.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.233+0000 7fc368632700 1 Processor -- start 2019-11-28T11:28:41.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.233+0000 7fc368632700 1 -- start start 2019-11-28T11:28:41.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc368632700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3601281b0 0x7fc360128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:41.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc368632700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc360128b80 0x7fc360167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:41.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc368632700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc360139a60 con 0x7fc36013a780 2019-11-28T11:28:41.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc368632700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36012a260 con 0x7fc3601281b0 2019-11-28T11:28:41.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc368632700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36012a530 con 0x7fc360128b80 2019-11-28T11:28:41.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc3663ce700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3601281b0 0x7fc360128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:41.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc366bcf700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc36013a780 0x7fc36012d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32940/0 (socket says 172.21.15.80:32940) 2019-11-28T11:28:41.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc366bcf700 1 -- 172.21.15.80:0/3583380128 learned_addr learned my addr 172.21.15.80:0/3583380128 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:41.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc3673d0700 1 --2- 172.21.15.80:0/3583380128 >> v2:172.21.15.174:3300/0 conn(0x7fc360128b80 0x7fc360167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:41.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc3663ce700 1 -- 172.21.15.80:0/3583380128 >> v2:172.21.15.174:3300/0 conn(0x7fc360128b80 msgr2=0x7fc360167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:41.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc3663ce700 1 --2- 172.21.15.80:0/3583380128 >> v2:172.21.15.174:3300/0 conn(0x7fc360128b80 0x7fc360167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:41.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc3663ce700 1 -- 172.21.15.80:0/3583380128 >> v1:172.21.15.80:6789/0 conn(0x7fc36013a780 legacy=0x7fc36012d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:41.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc3663ce700 1 -- 172.21.15.80:0/3583380128 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36012abc0 con 0x7fc3601281b0 2019-11-28T11:28:41.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc35f7fe700 1 -- 172.21.15.80:0/3583380128 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691960087 0 0) 0x7fc350000ea0 con 0x7fc36013a780 2019-11-28T11:28:41.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc3663ce700 1 --2- 172.21.15.80:0/3583380128 >> v2:172.21.15.80:3300/0 conn(0x7fc3601281b0 0x7fc360128640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc348010310 tx=0x7fc3480106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:41.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc3663ce700 1 --2- 172.21.15.80:0/3583380128 >> v2:172.21.15.80:3300/0 conn(0x7fc3601281b0 0x7fc360128640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc348010310 tx=0x7fc3480106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:41.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc3663ce700 1 --2- 172.21.15.80:0/3583380128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3601281b0 0x7fc360128640 secure :-1 s=READY pgs=552 cs=0 l=1 rx=0x7fc348010310 tx=0x7fc3480106b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:41.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc3663ce700 1 --2- 172.21.15.80:0/3583380128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3601281b0 0x7fc360128640 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7fc348010310 tx=0x7fc3480106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:41.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc35f7fe700 1 -- 172.21.15.80:0/3583380128 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc348000f50 con 0x7fc3601281b0 2019-11-28T11:28:41.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc3663ce700 1 --2- 172.21.15.80:0/3583380128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3601281b0 0x7fc360128640 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7fc348010310 tx=0x7fc3480106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:41.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc3663ce700 1 --2- 172.21.15.80:0/3583380128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3601281b0 0x7fc360128640 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7fc348010310 tx=0x7fc3480106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:41.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.234+0000 7fc35f7fe700 1 -- 172.21.15.80:0/3583380128 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc348000940 con 0x7fc3601281b0 2019-11-28T11:28:41.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.235+0000 7fc368632700 1 -- 172.21.15.80:0/3583380128 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36012af40 con 0x7fc3601281b0 2019-11-28T11:28:41.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.235+0000 7fc35f7fe700 1 -- 172.21.15.80:0/3583380128 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc348001530 con 0x7fc3601281b0 2019-11-28T11:28:41.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.235+0000 7fc368632700 1 -- 172.21.15.80:0/3583380128 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36012abc0 con 0x7fc3601281b0 2019-11-28T11:28:41.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.235+0000 7fc3663ce700 1 --2- 172.21.15.80:0/3583380128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3601281b0 0x7fc360128640 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7fc348010310 tx=0x7fc3480106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:41.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.235+0000 7fc35f7fe700 1 -- 172.21.15.80:0/3583380128 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc348000d60 con 0x7fc3601281b0 2019-11-28T11:28:41.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.235+0000 7fc3663ce700 1 --2- 172.21.15.80:0/3583380128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3601281b0 0x7fc360128640 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7fc348010310 tx=0x7fc3480106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:41.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.235+0000 7fc35f7fe700 1 --2- 172.21.15.80:0/3583380128 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc34401a940 0x7fc34401cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:41.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.235+0000 7fc35f7fe700 1 -- 172.21.15.80:0/3583380128 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc348031c20 con 0x7fc3601281b0 2019-11-28T11:28:41.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.235+0000 7fc366bcf700 1 --2- 172.21.15.80:0/3583380128 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc34401a940 0x7fc34401cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:41.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.236+0000 7fc366bcf700 1 --2- 172.21.15.80:0/3583380128 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc34401a940 0x7fc34401cdd0 crc :-1 s=READY pgs=235 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:41.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.243+0000 7fc368632700 1 -- 172.21.15.80:0/3583380128 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36012af40 con 0x7fc3601281b0 2019-11-28T11:28:41.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.247+0000 7fc3663ce700 1 --2- 172.21.15.80:0/3583380128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3601281b0 0x7fc360128640 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7fc348010310 tx=0x7fc3480106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:41.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.247+0000 7fc35f7fe700 1 -- 172.21.15.80:0/3583380128 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc348000b50 con 0x7fc3601281b0 2019-11-28T11:28:41.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.419+0000 7fc368632700 1 -- 172.21.15.80:0/3583380128 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc36012abc0 con 0x7fc3601281b0 2019-11-28T11:28:41.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.419+0000 7fc3663ce700 1 --2- 172.21.15.80:0/3583380128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3601281b0 0x7fc360128640 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7fc348010310 tx=0x7fc3480106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:41.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.420+0000 7fc35f7fe700 1 -- 172.21.15.80:0/3583380128 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+2443 (secure 0 0 0) 0x7fc348000b50 con 0x7fc3601281b0 2019-11-28T11:28:41.448 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:41.449 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3295602533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3295602533},{"type":"v1","addr":"172.21.15.80:6834","nonce":3295602533}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":20},{"gid":5559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1936159041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1936159041},{"type":"v1","addr":"172.21.15.80:6835","nonce":1936159041}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:27.955433+0000","modified":"2019-11-28T11:28:35.746800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5401":{"gid":5401,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/160551131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":160551131},{"type":"v1","addr":"172.21.15.174:6835","nonce":160551131}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2019-11-28T11:28:41.449 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 22 2019-11-28T11:28:41.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.422+0000 7fc368632700 1 -- 172.21.15.80:0/3583380128 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc34401a940 msgr2=0x7fc34401cdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:41.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.422+0000 7fc368632700 1 --2- 172.21.15.80:0/3583380128 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc34401a940 0x7fc34401cdd0 crc :-1 s=READY pgs=235 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:41.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.422+0000 7fc368632700 1 -- 172.21.15.80:0/3583380128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3601281b0 msgr2=0x7fc360128640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:41.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.422+0000 7fc368632700 1 --2- 172.21.15.80:0/3583380128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3601281b0 0x7fc360128640 secure :-1 s=READY pgs=552 cs=0 l=1 rx=0x7fc348010310 tx=0x7fc3480106b0).stop 2019-11-28T11:28:41.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.422+0000 7fc368632700 1 -- 172.21.15.80:0/3583380128 shutdown_connections 2019-11-28T11:28:41.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.422+0000 7fc368632700 1 --2- 172.21.15.80:0/3583380128 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc34401a940 0x7fc34401cdd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:41.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.422+0000 7fc368632700 1 --2- 172.21.15.80:0/3583380128 >> v2:172.21.15.174:3300/0 conn(0x7fc360128b80 0x7fc360167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:41.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.422+0000 7fc368632700 1 --2- 172.21.15.80:0/3583380128 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3601281b0 0x7fc360128640 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:41.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.422+0000 7fc368632700 1 -- 172.21.15.80:0/3583380128 shutdown_connections 2019-11-28T11:28:41.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.422+0000 7fc368632700 1 -- 172.21.15.80:0/3583380128 wait complete. 2019-11-28T11:28:41.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:41.422+0000 7fc368632700 1 -- 172.21.15.80:0/3583380128 >> 172.21.15.80:0/3583380128 conn(0x7fc360127dc0 msgr2=0x7fc360141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:41.761 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5401}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 6, u'failed': [], u'epoch': 22, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [7], u'info': {u'gid_5401': {u'export_targets': [], u'name': u'c', u'incarnation': 21, u'state_seq': 3, u'state': u'up:active', u'gid': 5401, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 160551131, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 160551131, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/160551131'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:28:27.955433+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:28:35.746800+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:28:41.762 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:28:41.762 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:28:41.888 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:28:41.888 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:28:41.888 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:28:41.889 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5401, 2019-11-28T11:28:41.889 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:28:41.889 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:28:41.889 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 7.1144552589999996, 2019-11-28T11:28:41.889 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 22, 2019-11-28T11:28:41.889 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 47, 2019-11-28T11:28:41.889 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 47, 2019-11-28T11:28:41.890 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 11.473970805 2019-11-28T11:28:41.890 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:28:41.894 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5401, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.1144552589999996, "mdsmap_epoch": 22, "osdmap_epoch": 47, "osdmap_epoch_barrier": 47, "uptime": 11.473970805 } 2019-11-28T11:28:41.894 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:28:41.894 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:28:41.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:28:41.894 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:28:41.963 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:28:41.964 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:28:42.045 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:28:42.045 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:28:42.078 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:28:42.079 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:28:42.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:28:42.096 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:28:42.169 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:28:42.291 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:28:42.292 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:28:42.292 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:28:42.303 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:28:42.303 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:28:42.424 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:28:42.425 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:28:42.425 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:28:42.430 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:28:42.431 INFO:tasks.cephfs_test_runner:test_abort_conn (tasks.cephfs.test_client_recovery.TestClientRecovery) ... skipped 'Testing libcephfs function' 2019-11-28T11:28:42.431 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn' 2019-11-28T11:28:42.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.522+0000 7fe794362700 1 Processor -- start 2019-11-28T11:28:42.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.522+0000 7fe794362700 1 -- start start 2019-11-28T11:28:42.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.523+0000 7fe794362700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe78c06c490 0x7fe78c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:42.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.523+0000 7fe794362700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe78c06ce60 0x7fe78c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:42.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.523+0000 7fe794362700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78c06db00 con 0x7fe78c06c0a0 2019-11-28T11:28:42.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.523+0000 7fe794362700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78c06fd60 con 0x7fe78c06c490 2019-11-28T11:28:42.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.523+0000 7fe794362700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78c070030 con 0x7fe78c06ce60 2019-11-28T11:28:42.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7920fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe78c06c490 0x7fe78c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:42.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7920fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe78c06c490 0x7fe78c06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33636/0 (socket says 172.21.15.80:33636) 2019-11-28T11:28:42.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7920fe700 1 -- 172.21.15.80:0/3452632201 learned_addr learned my addr 172.21.15.80:0/3452632201 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:42.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7928ff700 1 --1- 172.21.15.80:0/3452632201 >> v1:172.21.15.80:6789/0 conn(0x7fe78c06c0a0 0x7fe78c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32948/0 (socket says 172.21.15.80:32948) 2019-11-28T11:28:42.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe793100700 1 --2- 172.21.15.80:0/3452632201 >> v2:172.21.15.174:3300/0 conn(0x7fe78c06ce60 0x7fe78c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7920fe700 1 -- 172.21.15.80:0/3452632201 >> v2:172.21.15.174:3300/0 conn(0x7fe78c06ce60 msgr2=0x7fe78c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3452632201 >> v2:172.21.15.174:3300/0 conn(0x7fe78c06ce60 0x7fe78c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7920fe700 1 -- 172.21.15.80:0/3452632201 >> v1:172.21.15.80:6789/0 conn(0x7fe78c06c0a0 legacy=0x7fe78c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7920fe700 1 -- 172.21.15.80:0/3452632201 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c0706c0 con 0x7fe78c06c490 2019-11-28T11:28:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7918fd700 1 -- 172.21.15.80:0/3452632201 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518348832 0 0) 0x7fe77c001100 con 0x7fe78c06c0a0 2019-11-28T11:28:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3452632201 >> v2:172.21.15.80:3300/0 conn(0x7fe78c06c490 0x7fe78c06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe78000f6c0 tx=0x7fe78000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3452632201 >> v2:172.21.15.80:3300/0 conn(0x7fe78c06c490 0x7fe78c06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe78000f6c0 tx=0x7fe78000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3452632201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c06c490 0x7fe78c06c920 secure :-1 s=READY pgs=554 cs=0 l=1 rx=0x7fe78000f6c0 tx=0x7fe78000fa60).ready entity=mon.0 client_cookie=7eb8b36525329612 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3452632201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c06c490 0x7fe78c06c920 secure :-1 s=THROTTLE_DONE pgs=554 cs=0 l=1 rx=0x7fe78000f6c0 tx=0x7fe78000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7918fd700 1 -- 172.21.15.80:0/3452632201 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe780000960 con 0x7fe78c06c490 2019-11-28T11:28:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3452632201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c06c490 0x7fe78c06c920 secure :-1 s=THROTTLE_DONE pgs=554 cs=0 l=1 rx=0x7fe78000f6c0 tx=0x7fe78000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3452632201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c06c490 0x7fe78c06c920 secure :-1 s=THROTTLE_DONE pgs=554 cs=0 l=1 rx=0x7fe78000f6c0 tx=0x7fe78000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7918fd700 1 -- 172.21.15.80:0/3452632201 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe780000c90 con 0x7fe78c06c490 2019-11-28T11:28:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe7918fd700 1 -- 172.21.15.80:0/3452632201 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7800013a0 con 0x7fe78c06c490 2019-11-28T11:28:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe794362700 1 -- 172.21.15.80:0/3452632201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c06c490 msgr2=0x7fe78c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.524+0000 7fe794362700 1 --2- 172.21.15.80:0/3452632201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c06c490 0x7fe78c06c920 secure :-1 s=READY pgs=554 cs=0 l=1 rx=0x7fe78000f6c0 tx=0x7fe78000fa60).stop 2019-11-28T11:28:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.525+0000 7fe794362700 1 -- 172.21.15.80:0/3452632201 shutdown_connections 2019-11-28T11:28:42.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.525+0000 7fe794362700 1 --2- 172.21.15.80:0/3452632201 >> v2:172.21.15.174:3300/0 conn(0x7fe78c06ce60 0x7fe78c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:42.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.525+0000 7fe794362700 1 --2- 172.21.15.80:0/3452632201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c06c490 0x7fe78c06c920 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:42.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.525+0000 7fe794362700 1 -- 172.21.15.80:0/3452632201 shutdown_connections 2019-11-28T11:28:42.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.525+0000 7fe794362700 1 -- 172.21.15.80:0/3452632201 wait complete. 2019-11-28T11:28:42.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.525+0000 7fe794362700 1 -- 172.21.15.80:0/3452632201 >> 172.21.15.80:0/3452632201 conn(0x7fe78c061cf0 msgr2=0x7fe78c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:42.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.527+0000 7fe794362700 1 Processor -- start 2019-11-28T11:28:42.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.527+0000 7fe794362700 1 -- start start 2019-11-28T11:28:42.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.528+0000 7fe794362700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe78c1401d0 0x7fe78c109870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:42.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.528+0000 7fe794362700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe78c139300 0x7fe78c139790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:42.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.528+0000 7fe794362700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78c106a10 con 0x7fe78c139cd0 2019-11-28T11:28:42.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.528+0000 7fe794362700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78c13a150 con 0x7fe78c139300 2019-11-28T11:28:42.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.528+0000 7fe794362700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c13b210 con 0x7fe78c1401d0 2019-11-28T11:28:42.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.528+0000 7fe793100700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe78c139cd0 0x7fe78c1086f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32956/0 (socket says 172.21.15.80:32956) 2019-11-28T11:28:42.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.528+0000 7fe793100700 1 -- 172.21.15.80:0/3366967826 learned_addr learned my addr 172.21.15.80:0/3366967826 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:42.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.528+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3366967826 >> v2:172.21.15.80:3300/0 conn(0x7fe78c139300 0x7fe78c139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:42.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.528+0000 7fe7928ff700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe78c1401d0 0x7fe78c109870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:42.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe7920fe700 1 -- 172.21.15.80:0/3366967826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe78c1401d0 msgr2=0x7fe78c109870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe78c1401d0 0x7fe78c109870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe7920fe700 1 -- 172.21.15.80:0/3366967826 >> v1:172.21.15.80:6789/0 conn(0x7fe78c139cd0 legacy=0x7fe78c1086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe7920fe700 1 -- 172.21.15.80:0/3366967826 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c106fb0 con 0x7fe78c139300 2019-11-28T11:28:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe78b7fe700 1 -- 172.21.15.80:0/3366967826 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027652618 0 0) 0x7fe7840014d0 con 0x7fe78c139cd0 2019-11-28T11:28:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3366967826 >> v2:172.21.15.80:3300/0 conn(0x7fe78c139300 0x7fe78c139790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe780010320 tx=0x7fe7800106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3366967826 >> v2:172.21.15.80:3300/0 conn(0x7fe78c139300 0x7fe78c139790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe780010320 tx=0x7fe7800106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c139300 0x7fe78c139790 secure :-1 s=READY pgs=556 cs=0 l=1 rx=0x7fe780010320 tx=0x7fe7800106c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c139300 0x7fe78c139790 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7fe780010320 tx=0x7fe7800106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe78b7fe700 1 -- 172.21.15.80:0/3366967826 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7800078e0 con 0x7fe78c139300 2019-11-28T11:28:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c139300 0x7fe78c139790 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7fe780010320 tx=0x7fe7800106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c139300 0x7fe78c139790 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7fe780010320 tx=0x7fe7800106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe78b7fe700 1 -- 172.21.15.80:0/3366967826 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe780001050 con 0x7fe78c139300 2019-11-28T11:28:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe78b7fe700 1 -- 172.21.15.80:0/3366967826 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe780001240 con 0x7fe78c139300 2019-11-28T11:28:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe794362700 1 -- 172.21.15.80:0/3366967826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78c107330 con 0x7fe78c139300 2019-11-28T11:28:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe794362700 1 -- 172.21.15.80:0/3366967826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78c106fb0 con 0x7fe78c139300 2019-11-28T11:28:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.529+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c139300 0x7fe78c139790 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7fe780010320 tx=0x7fe7800106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.530+0000 7fe78b7fe700 1 -- 172.21.15.80:0/3366967826 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe780007810 con 0x7fe78c139300 2019-11-28T11:28:42.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.530+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c139300 0x7fe78c139790 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7fe780010320 tx=0x7fe7800106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:42.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.530+0000 7fe78b7fe700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe76c018730 0x7fe76c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:42.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.530+0000 7fe78b7fe700 1 -- 172.21.15.80:0/3366967826 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe7800319d0 con 0x7fe78c139300 2019-11-28T11:28:42.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.530+0000 7fe7928ff700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe76c018730 0x7fe76c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:42.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.530+0000 7fe7928ff700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe76c018730 0x7fe76c01abc0 crc :-1 s=READY pgs=236 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:42.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.538+0000 7fe794362700 1 -- 172.21.15.80:0/3366967826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78c107330 con 0x7fe78c139300 2019-11-28T11:28:42.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.541+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c139300 0x7fe78c139790 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7fe780010320 tx=0x7fe7800106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:42.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.541+0000 7fe78b7fe700 1 -- 172.21.15.80:0/3366967826 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe780018b80 con 0x7fe78c139300 2019-11-28T11:28:42.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.714+0000 7fe794362700 1 -- 172.21.15.80:0/3366967826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn"]} v 0) v1 -- 0x7fe78c106fb0 con 0x7fe78c139300 2019-11-28T11:28:42.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.771+0000 7fe7920fe700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c139300 0x7fe78c139790 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7fe780010320 tx=0x7fe7800106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:42.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.771+0000 7fe78b7fe700 1 -- 172.21.15.80:0/3366967826 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn"]}]=0 v126) v1 ==== 147+0+0 (secure 0 0 0) 0x7fe780007810 con 0x7fe78c139300 2019-11-28T11:28:42.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.780+0000 7fe794362700 1 -- 172.21.15.80:0/3366967826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe76c018730 msgr2=0x7fe76c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:42.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.780+0000 7fe794362700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe76c018730 0x7fe76c01abc0 crc :-1 s=READY pgs=236 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:42.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.780+0000 7fe794362700 1 -- 172.21.15.80:0/3366967826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c139300 msgr2=0x7fe78c139790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:42.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.780+0000 7fe794362700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c139300 0x7fe78c139790 secure :-1 s=READY pgs=556 cs=0 l=1 rx=0x7fe780010320 tx=0x7fe7800106c0).stop 2019-11-28T11:28:42.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.780+0000 7fe794362700 1 -- 172.21.15.80:0/3366967826 shutdown_connections 2019-11-28T11:28:42.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.780+0000 7fe794362700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe76c018730 0x7fe76c01abc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:42.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.780+0000 7fe794362700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe78c139300 0x7fe78c139790 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:42.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.780+0000 7fe794362700 1 --2- 172.21.15.80:0/3366967826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe78c1401d0 0x7fe78c109870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:42.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.780+0000 7fe794362700 1 -- 172.21.15.80:0/3366967826 shutdown_connections 2019-11-28T11:28:42.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.780+0000 7fe794362700 1 -- 172.21.15.80:0/3366967826 wait complete. 2019-11-28T11:28:42.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:42.780+0000 7fe794362700 1 -- 172.21.15.80:0/3366967826 >> 172.21.15.80:0/3366967826 conn(0x7fe78c1416d0 msgr2=0x7fe78c111c20 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:42.818 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:28:42.818 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:42.885 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:42.945 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:43.005 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:43.061 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:43.128 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:43.184 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:28:43.185 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:28:43.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:28:43.185 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T11:28:43.260 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:28:43.269 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:28:43.307 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:28:43.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:28:43.307 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:28:43.428 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:28:43.433 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:28:43.473 INFO:tasks.cephfs_test_runner:Starting test: test_basic (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T11:28:43.474 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic' 2019-11-28T11:28:43.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.564+0000 7f2543140700 1 Processor -- start 2019-11-28T11:28:43.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.564+0000 7f2543140700 1 -- start start 2019-11-28T11:28:43.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.565+0000 7f2543140700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f253c06c490 0x7f253c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:43.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.565+0000 7f2543140700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f253c06ce60 0x7f253c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:43.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.565+0000 7f2543140700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253c06db00 con 0x7f253c06c0a0 2019-11-28T11:28:43.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.565+0000 7f2543140700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253c06fd60 con 0x7f253c06c490 2019-11-28T11:28:43.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.565+0000 7f2543140700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253c070030 con 0x7f253c06ce60 2019-11-28T11:28:43.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.565+0000 7f2540edc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f253c06c490 0x7f253c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:43.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.565+0000 7f2540edc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f253c06c490 0x7f253c06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33650/0 (socket says 172.21.15.80:33650) 2019-11-28T11:28:43.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.565+0000 7f2540edc700 1 -- 172.21.15.80:0/570593666 learned_addr learned my addr 172.21.15.80:0/570593666 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:43.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.565+0000 7f25416dd700 1 --1- 172.21.15.80:0/570593666 >> v1:172.21.15.80:6789/0 conn(0x7f253c06c0a0 0x7f253c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32962/0 (socket says 172.21.15.80:32962) 2019-11-28T11:28:43.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.565+0000 7f2541ede700 1 --2- 172.21.15.80:0/570593666 >> v2:172.21.15.174:3300/0 conn(0x7f253c06ce60 0x7f253c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:43.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.566+0000 7f2540edc700 1 -- 172.21.15.80:0/570593666 >> v2:172.21.15.174:3300/0 conn(0x7f253c06ce60 msgr2=0x7f253c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:43.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.566+0000 7f2540edc700 1 --2- 172.21.15.80:0/570593666 >> v2:172.21.15.174:3300/0 conn(0x7f253c06ce60 0x7f253c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:43.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.566+0000 7f2540edc700 1 -- 172.21.15.80:0/570593666 >> v1:172.21.15.80:6789/0 conn(0x7f253c06c0a0 legacy=0x7f253c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:43.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.566+0000 7f2540edc700 1 -- 172.21.15.80:0/570593666 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c0706c0 con 0x7f253c06c490 2019-11-28T11:28:43.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.566+0000 7f253bfff700 1 -- 172.21.15.80:0/570593666 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631662379 0 0) 0x7f252c001100 con 0x7f253c06c0a0 2019-11-28T11:28:43.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.566+0000 7f2540edc700 1 --2- 172.21.15.80:0/570593666 >> v2:172.21.15.80:3300/0 conn(0x7f253c06c490 0x7f253c06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f252400fa40 tx=0x7f252400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:43.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.566+0000 7f2540edc700 1 --2- 172.21.15.80:0/570593666 >> v2:172.21.15.80:3300/0 conn(0x7f253c06c490 0x7f253c06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f252400fa40 tx=0x7f252400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:43.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.566+0000 7f2540edc700 1 --2- 172.21.15.80:0/570593666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f253c06c490 0x7f253c06c920 secure :-1 s=READY pgs=558 cs=0 l=1 rx=0x7f252400fa40 tx=0x7f252400fde0).ready entity=mon.0 client_cookie=db69281dbbf06439 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:43.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.566+0000 7f2540edc700 1 --2- 172.21.15.80:0/570593666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f253c06c490 0x7f253c06c920 secure :-1 s=THROTTLE_DONE pgs=558 cs=0 l=1 rx=0x7f252400fa40 tx=0x7f252400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:43.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.566+0000 7f253bfff700 1 -- 172.21.15.80:0/570593666 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2524000ce0 con 0x7f253c06c490 2019-11-28T11:28:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.566+0000 7f2540edc700 1 --2- 172.21.15.80:0/570593666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f253c06c490 0x7f253c06c920 secure :-1 s=THROTTLE_DONE pgs=558 cs=0 l=1 rx=0x7f252400fa40 tx=0x7f252400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.566+0000 7f2540edc700 1 --2- 172.21.15.80:0/570593666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f253c06c490 0x7f253c06c920 secure :-1 s=THROTTLE_DONE pgs=558 cs=0 l=1 rx=0x7f252400fa40 tx=0x7f252400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.566+0000 7f253bfff700 1 -- 172.21.15.80:0/570593666 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2524001010 con 0x7f253c06c490 2019-11-28T11:28:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.566+0000 7f253bfff700 1 -- 172.21.15.80:0/570593666 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2524000ce0 con 0x7f253c06c490 2019-11-28T11:28:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.566+0000 7f2543140700 1 -- 172.21.15.80:0/570593666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f253c06c490 msgr2=0x7f253c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.566+0000 7f2543140700 1 --2- 172.21.15.80:0/570593666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f253c06c490 0x7f253c06c920 secure :-1 s=READY pgs=558 cs=0 l=1 rx=0x7f252400fa40 tx=0x7f252400fde0).stop 2019-11-28T11:28:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.567+0000 7f2543140700 1 -- 172.21.15.80:0/570593666 shutdown_connections 2019-11-28T11:28:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.567+0000 7f2543140700 1 --2- 172.21.15.80:0/570593666 >> v2:172.21.15.174:3300/0 conn(0x7f253c06ce60 0x7f253c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.567+0000 7f2543140700 1 --2- 172.21.15.80:0/570593666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f253c06c490 0x7f253c06c920 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.567+0000 7f2543140700 1 -- 172.21.15.80:0/570593666 shutdown_connections 2019-11-28T11:28:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.567+0000 7f2543140700 1 -- 172.21.15.80:0/570593666 wait complete. 2019-11-28T11:28:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.567+0000 7f2543140700 1 -- 172.21.15.80:0/570593666 >> 172.21.15.80:0/570593666 conn(0x7f253c061cf0 msgr2=0x7f253c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.569+0000 7f2543140700 1 Processor -- start 2019-11-28T11:28:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.569+0000 7f2543140700 1 -- start start 2019-11-28T11:28:43.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.570+0000 7f2543140700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253c128e40 0x7f253c168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:43.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.570+0000 7f2543140700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253c139a60 con 0x7f253c13a780 2019-11-28T11:28:43.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.570+0000 7f2543140700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253c13b060 con 0x7f253c1281b0 2019-11-28T11:28:43.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.570+0000 7f2543140700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c12a260 con 0x7f253c128e40 2019-11-28T11:28:43.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.570+0000 7f25416dd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f253c13a780 0x7f253c12d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32968/0 (socket says 172.21.15.80:32968) 2019-11-28T11:28:43.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.570+0000 7f25416dd700 1 -- 172.21.15.80:0/37593828 learned_addr learned my addr 172.21.15.80:0/37593828 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:43.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2541ede700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253c128e40 0x7f253c168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:43.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2539ffb700 1 -- 172.21.15.80:0/37593828 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167374126 0 0) 0x7f252c001150 con 0x7f253c13a780 2019-11-28T11:28:43.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2539ffb700 1 -- 172.21.15.80:0/37593828 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2520002e80 con 0x7f253c13a780 2019-11-28T11:28:43.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2539ffb700 1 -- 172.21.15.80:0/37593828 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199625630 0 0) 0x7f2524007c80 con 0x7f253c1281b0 2019-11-28T11:28:43.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2539ffb700 1 -- 172.21.15.80:0/37593828 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25200030b0 con 0x7f253c1281b0 2019-11-28T11:28:43.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2541ede700 1 -- 172.21.15.80:0/37593828 >> v1:172.21.15.174:6789/0 conn(0x7f253c1281b0 legacy=0x7f253c128640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:43.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2539ffb700 1 -- 172.21.15.80:0/37593828 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4178478783 0 0) 0x7f252c001300 con 0x7f253c13a780 2019-11-28T11:28:43.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2541ede700 1 -- 172.21.15.80:0/37593828 >> v1:172.21.15.80:6789/0 conn(0x7f253c13a780 legacy=0x7f253c12d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:43.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2541ede700 1 -- 172.21.15.80:0/37593828 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c12abc0 con 0x7f253c128e40 2019-11-28T11:28:43.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2541ede700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253c128e40 0x7f253c168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2534010390 tx=0x7f2534010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:43.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2541ede700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253c128e40 0x7f253c168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2534010390 tx=0x7f2534010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:43.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2541ede700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253c128e40 0x7f253c168d80 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f2534010390 tx=0x7f2534010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:43.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2541ede700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253c128e40 0x7f253c168d80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2534010390 tx=0x7f2534010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:43.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2539ffb700 1 -- 172.21.15.80:0/37593828 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25340099b0 con 0x7f253c128e40 2019-11-28T11:28:43.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2541ede700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253c128e40 0x7f253c168d80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2534010390 tx=0x7f2534010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:43.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2539ffb700 1 -- 172.21.15.80:0/37593828 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2534000c00 con 0x7f253c128e40 2019-11-28T11:28:43.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2541ede700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253c128e40 0x7f253c168d80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2534010390 tx=0x7f2534010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:43.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2543140700 1 -- 172.21.15.80:0/37593828 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253c12af40 con 0x7f253c128e40 2019-11-28T11:28:43.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2539ffb700 1 -- 172.21.15.80:0/37593828 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2534009d40 con 0x7f253c128e40 2019-11-28T11:28:43.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.571+0000 7f2543140700 1 -- 172.21.15.80:0/37593828 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c12abc0 con 0x7f253c128e40 2019-11-28T11:28:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.572+0000 7f2541ede700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253c128e40 0x7f253c168d80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2534010390 tx=0x7f2534010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.572+0000 7f2539ffb700 1 -- 172.21.15.80:0/37593828 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f253400ea80 con 0x7f253c128e40 2019-11-28T11:28:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.572+0000 7f2541ede700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253c128e40 0x7f253c168d80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2534010390 tx=0x7f2534010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.572+0000 7f2539ffb700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2520018750 0x7f252001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.572+0000 7f2539ffb700 1 -- 172.21.15.80:0/37593828 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2534031a50 con 0x7f253c128e40 2019-11-28T11:28:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.572+0000 7f25416dd700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2520018750 0x7f252001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.572+0000 7f25416dd700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2520018750 0x7f252001abe0 crc :-1 s=READY pgs=237 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:43.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.579+0000 7f2543140700 1 -- 172.21.15.80:0/37593828 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253c12af40 con 0x7f253c128e40 2019-11-28T11:28:43.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.583+0000 7f2541ede700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253c128e40 0x7f253c168d80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2534010390 tx=0x7f2534010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:43.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.583+0000 7f2539ffb700 1 -- 172.21.15.80:0/37593828 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f25340095b0 con 0x7f253c128e40 2019-11-28T11:28:43.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.758+0000 7f2543140700 1 -- 172.21.15.80:0/37593828 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic"]} v 0) v1 -- 0x7f253c12abc0 con 0x7f253c128e40 2019-11-28T11:28:43.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.773+0000 7f2541ede700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253c128e40 0x7f253c168d80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2534010390 tx=0x7f2534010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:43.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.773+0000 7f2539ffb700 1 -- 172.21.15.80:0/37593828 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic"]}]=0 v127) v1 ==== 145+0+0 (secure 0 0 0) 0x7f253400ea80 con 0x7f253c128e40 2019-11-28T11:28:43.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.776+0000 7f2543140700 1 -- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2520018750 msgr2=0x7f252001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:43.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.776+0000 7f2543140700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2520018750 0x7f252001abe0 crc :-1 s=READY pgs=237 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:43.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.776+0000 7f2543140700 1 -- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253c128e40 msgr2=0x7f253c168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:43.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.776+0000 7f2543140700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253c128e40 0x7f253c168d80 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f2534010390 tx=0x7f2534010730).stop 2019-11-28T11:28:43.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.776+0000 7f2543140700 1 -- 172.21.15.80:0/37593828 shutdown_connections 2019-11-28T11:28:43.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.776+0000 7f2543140700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253c128e40 0x7f253c168d80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:43.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.776+0000 7f2543140700 1 --2- 172.21.15.80:0/37593828 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2520018750 0x7f252001abe0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:43.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.776+0000 7f2543140700 1 -- 172.21.15.80:0/37593828 shutdown_connections 2019-11-28T11:28:43.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.776+0000 7f2543140700 1 -- 172.21.15.80:0/37593828 wait complete. 2019-11-28T11:28:43.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:43.776+0000 7f2543140700 1 -- 172.21.15.80:0/37593828 >> 172.21.15.80:0/37593828 conn(0x7f253c127dc0 msgr2=0x7f253c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:43.814 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:28:43.814 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:43.880 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:43.940 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:44.001 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:44.056 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:44.117 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:28:44.173 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:28:44.173 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:28:44.173 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:28:44.174 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:28:44.174 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:28:44.174 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:28:44.174 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:28:44.179 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:28:44.179 DEBUG:teuthology.parallel:result is None 2019-11-28T11:28:44.180 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:28:44.181 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:28:44.181 DEBUG:teuthology.parallel:result is None 2019-11-28T11:28:44.181 DEBUG:teuthology.parallel:result is None 2019-11-28T11:28:44.182 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:28:44.182 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:28:44.183 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:28:44.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.358+0000 7f40c19d3700 1 Processor -- start 2019-11-28T11:28:44.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.358+0000 7f40c19d3700 1 -- start start 2019-11-28T11:28:44.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.359+0000 7f40c19d3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f40bc06c490 0x7f40bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:44.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.359+0000 7f40c19d3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f40bc06ce60 0x7f40bc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:44.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.359+0000 7f40c19d3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc06db00 con 0x7f40bc06c0a0 2019-11-28T11:28:44.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.359+0000 7f40c19d3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc06fd60 con 0x7f40bc06c490 2019-11-28T11:28:44.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.359+0000 7f40c19d3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc070030 con 0x7f40bc06ce60 2019-11-28T11:28:44.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40bb7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f40bc06c0a0 0x7f40bc072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:48520/0 (socket says 172.21.15.80:48520) 2019-11-28T11:28:44.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40b2ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f40bc06c490 0x7f40bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:44.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40bb7fe700 1 -- 172.21.15.80:0/1028160102 learned_addr learned my addr 172.21.15.80:0/1028160102 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:44.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40bbfff700 1 --2- 172.21.15.80:0/1028160102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f40bc06ce60 0x7f40bc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:44.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40b2ffd700 1 -- 172.21.15.80:0/1028160102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f40bc06ce60 msgr2=0x7f40bc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:44.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40b2ffd700 1 --2- 172.21.15.80:0/1028160102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f40bc06ce60 0x7f40bc164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:44.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40b2ffd700 1 -- 172.21.15.80:0/1028160102 >> v1:172.21.15.174:6789/0 conn(0x7f40bc06c0a0 legacy=0x7f40bc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40b2ffd700 1 -- 172.21.15.80:0/1028160102 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc0706c0 con 0x7f40bc06c490 2019-11-28T11:28:44.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40baffd700 1 -- 172.21.15.80:0/1028160102 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323675502 0 0) 0x7f40ac001100 con 0x7f40bc06c0a0 2019-11-28T11:28:44.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40b2ffd700 1 --2- 172.21.15.80:0/1028160102 >> v2:172.21.15.174:3300/0 conn(0x7f40bc06c490 0x7f40bc06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f40a400af50 tx=0x7f40a400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40b2ffd700 1 --2- 172.21.15.80:0/1028160102 >> v2:172.21.15.174:3300/0 conn(0x7f40bc06c490 0x7f40bc06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f40a400af50 tx=0x7f40a400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40b2ffd700 1 --2- 172.21.15.80:0/1028160102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40bc06c490 0x7f40bc06c920 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7f40a400af50 tx=0x7f40a400b250).ready entity=mon.1 client_cookie=b27ab200609079e9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:44.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40b2ffd700 1 --2- 172.21.15.80:0/1028160102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40bc06c490 0x7f40bc06c920 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f40a400af50 tx=0x7f40a400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40baffd700 1 -- 172.21.15.80:0/1028160102 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40a4007210 con 0x7f40bc06c490 2019-11-28T11:28:44.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40b2ffd700 1 --2- 172.21.15.80:0/1028160102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40bc06c490 0x7f40bc06c920 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f40a400af50 tx=0x7f40a400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40b2ffd700 1 --2- 172.21.15.80:0/1028160102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40bc06c490 0x7f40bc06c920 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f40a400af50 tx=0x7f40a400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40baffd700 1 -- 172.21.15.80:0/1028160102 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a40099b0 con 0x7f40bc06c490 2019-11-28T11:28:44.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f40baffd700 1 -- 172.21.15.80:0/1028160102 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40a400a080 con 0x7f40bc06c490 2019-11-28T11:28:44.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7f40c19d3700 1 -- 172.21.15.80:0/1028160102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40bc06c490 msgr2=0x7f40bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7f40c19d3700 1 --2- 172.21.15.80:0/1028160102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40bc06c490 0x7f40bc06c920 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7f40a400af50 tx=0x7f40a400b250).stop 2019-11-28T11:28:44.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7f40c19d3700 1 -- 172.21.15.80:0/1028160102 shutdown_connections 2019-11-28T11:28:44.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7f40c19d3700 1 --2- 172.21.15.80:0/1028160102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f40bc06ce60 0x7f40bc164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:44.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7f40c19d3700 1 --2- 172.21.15.80:0/1028160102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40bc06c490 0x7f40bc06c920 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7f40c19d3700 1 -- 172.21.15.80:0/1028160102 shutdown_connections 2019-11-28T11:28:44.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7f40c19d3700 1 -- 172.21.15.80:0/1028160102 wait complete. 2019-11-28T11:28:44.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7f40c19d3700 1 -- 172.21.15.80:0/1028160102 >> 172.21.15.80:0/1028160102 conn(0x7f40bc061cf0 msgr2=0x7f40bc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:44.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.364+0000 7f40c19d3700 1 Processor -- start 2019-11-28T11:28:44.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.364+0000 7f40c19d3700 1 -- start start 2019-11-28T11:28:44.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f40c19d3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f40bc1239b0 0x7f40bc116fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:44.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f40c19d3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f40bc1155b0 0x7f40bc139640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:44.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f40c19d3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc13aba0 con 0x7f40bc117510 2019-11-28T11:28:44.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f40c19d3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc112d10 con 0x7f40bc1155b0 2019-11-28T11:28:44.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f40c19d3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc112fe0 con 0x7f40bc1239b0 2019-11-28T11:28:44.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f40bbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f40bc1155b0 0x7f40bc139640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:44.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f40bb7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f40bc1239b0 0x7f40bc116fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:44.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f40bbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f40bc1155b0 0x7f40bc139640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33680/0 (socket says 172.21.15.80:33680) 2019-11-28T11:28:44.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f40bbfff700 1 -- 172.21.15.80:0/361734094 learned_addr learned my addr 172.21.15.80:0/361734094 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:44.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f40bbfff700 1 -- 172.21.15.80:0/361734094 >> v2:172.21.15.174:3300/0 conn(0x7f40bc1239b0 msgr2=0x7f40bc116fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f40bbfff700 1 --2- 172.21.15.80:0/361734094 >> v2:172.21.15.174:3300/0 conn(0x7f40bc1239b0 0x7f40bc116fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f40bbfff700 1 -- 172.21.15.80:0/361734094 >> v1:172.21.15.80:6789/0 conn(0x7f40bc117510 legacy=0x7f40bc114db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f40bbfff700 1 -- 172.21.15.80:0/361734094 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc113670 con 0x7f40bc1155b0 2019-11-28T11:28:44.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f40bbfff700 1 --2- 172.21.15.80:0/361734094 >> v2:172.21.15.80:3300/0 conn(0x7f40bc1155b0 0x7f40bc139640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f40b40107d0 tx=0x7f40b4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f40bbfff700 1 --2- 172.21.15.80:0/361734094 >> v2:172.21.15.80:3300/0 conn(0x7f40bc1155b0 0x7f40bc139640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f40b40107d0 tx=0x7f40b4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f40bbfff700 1 --2- 172.21.15.80:0/361734094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40bc1155b0 0x7f40bc139640 secure :-1 s=READY pgs=565 cs=0 l=1 rx=0x7f40b40107d0 tx=0x7f40b4010b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:44.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f40bbfff700 1 --2- 172.21.15.80:0/361734094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40bc1155b0 0x7f40bc139640 secure :-1 s=THROTTLE_DONE pgs=565 cs=0 l=1 rx=0x7f40b40107d0 tx=0x7f40b4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f40bbfff700 1 --2- 172.21.15.80:0/361734094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40bc1155b0 0x7f40bc139640 secure :-1 s=THROTTLE_DONE pgs=565 cs=0 l=1 rx=0x7f40b40107d0 tx=0x7f40b4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f40bbfff700 1 --2- 172.21.15.80:0/361734094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40bc1155b0 0x7f40bc139640 secure :-1 s=THROTTLE_DONE pgs=565 cs=0 l=1 rx=0x7f40b40107d0 tx=0x7f40b4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f40b8ff9700 1 -- 172.21.15.80:0/361734094 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40b4000e90 con 0x7f40bc1155b0 2019-11-28T11:28:44.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f40b8ff9700 1 -- 172.21.15.80:0/361734094 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b400f320 con 0x7f40bc1155b0 2019-11-28T11:28:44.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f40c19d3700 1 -- 172.21.15.80:0/361734094 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc1139f0 con 0x7f40bc1155b0 2019-11-28T11:28:44.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f40b8ff9700 1 -- 172.21.15.80:0/361734094 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40b400fa30 con 0x7f40bc1155b0 2019-11-28T11:28:44.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f40c19d3700 1 -- 172.21.15.80:0/361734094 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc113670 con 0x7f40bc1155b0 2019-11-28T11:28:44.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7f40bbfff700 1 --2- 172.21.15.80:0/361734094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40bc1155b0 0x7f40bc139640 secure :-1 s=THROTTLE_DONE pgs=565 cs=0 l=1 rx=0x7f40b40107d0 tx=0x7f40b4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7f40b8ff9700 1 -- 172.21.15.80:0/361734094 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f40b4000df0 con 0x7f40bc1155b0 2019-11-28T11:28:44.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7f40bbfff700 1 --2- 172.21.15.80:0/361734094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40bc1155b0 0x7f40bc139640 secure :-1 s=THROTTLE_DONE pgs=565 cs=0 l=1 rx=0x7f40b40107d0 tx=0x7f40b4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7f40b8ff9700 1 --2- 172.21.15.80:0/361734094 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f40a0018730 0x7f40a001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:44.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7f40b8ff9700 1 -- 172.21.15.80:0/361734094 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f40b4031e60 con 0x7f40bc1155b0 2019-11-28T11:28:44.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7f40bb7fe700 1 --2- 172.21.15.80:0/361734094 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f40a0018730 0x7f40a001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:44.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.368+0000 7f40bb7fe700 1 --2- 172.21.15.80:0/361734094 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f40a0018730 0x7f40a001abc0 crc :-1 s=READY pgs=239 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:44.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.374+0000 7f40c19d3700 1 -- 172.21.15.80:0/361734094 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40bc1139f0 con 0x7f40bc1155b0 2019-11-28T11:28:44.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.358+0000 7f4fc7af9700 1 Processor -- start 2019-11-28T11:28:44.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.358+0000 7f4fc7af9700 1 -- start start 2019-11-28T11:28:44.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.359+0000 7f4fc7af9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4fc006c0a0 0x7f4fc0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:44.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.359+0000 7f4fc7af9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc006db00 con 0x7f4fc00734e0 2019-11-28T11:28:44.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.359+0000 7f4fc7af9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc006e000 con 0x7f4fc0072620 2019-11-28T11:28:44.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.359+0000 7f4fc7af9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc006fd60 con 0x7f4fc006c0a0 2019-11-28T11:28:44.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.359+0000 7f4fc6096700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4fc006c0a0 0x7f4fc0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:44.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.359+0000 7f4fc5895700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4fc00734e0 0x7f4fc0071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32978/0 (socket says 172.21.15.80:32978) 2019-11-28T11:28:44.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.359+0000 7f4fc6096700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4fc006c0a0 0x7f4fc0072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33668/0 (socket says 172.21.15.80:33668) 2019-11-28T11:28:44.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.359+0000 7f4fc5895700 1 -- 172.21.15.80:0/2679605898 learned_addr learned my addr 172.21.15.80:0/2679605898 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:44.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f4fc6096700 1 -- 172.21.15.80:0/2679605898 >> v1:172.21.15.174:6789/0 conn(0x7f4fc0072620 legacy=0x7f4fc0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f4fc6096700 1 -- 172.21.15.80:0/2679605898 >> v1:172.21.15.80:6789/0 conn(0x7f4fc00734e0 legacy=0x7f4fc0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f4fc6096700 1 -- 172.21.15.80:0/2679605898 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc00706c0 con 0x7f4fc006c0a0 2019-11-28T11:28:44.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f4fc6096700 1 --2- 172.21.15.80:0/2679605898 >> v2:172.21.15.80:3300/0 conn(0x7f4fc006c0a0 0x7f4fc0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4fb000af50 tx=0x7f4fb000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f4fc6096700 1 --2- 172.21.15.80:0/2679605898 >> v2:172.21.15.80:3300/0 conn(0x7f4fc006c0a0 0x7f4fc0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4fb000af50 tx=0x7f4fb000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f4fc6096700 1 --2- 172.21.15.80:0/2679605898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fc006c0a0 0x7f4fc0072fa0 secure :-1 s=READY pgs=561 cs=0 l=1 rx=0x7f4fb000af50 tx=0x7f4fb000b760).ready entity=mon.0 client_cookie=aff957eef61579c8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:44.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f4fc6096700 1 --2- 172.21.15.80:0/2679605898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fc006c0a0 0x7f4fc0072fa0 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f4fb000af50 tx=0x7f4fb000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f4fc6096700 1 --2- 172.21.15.80:0/2679605898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fc006c0a0 0x7f4fc0072fa0 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f4fb000af50 tx=0x7f4fb000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f4fc6096700 1 --2- 172.21.15.80:0/2679605898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fc006c0a0 0x7f4fc0072fa0 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f4fb000af50 tx=0x7f4fb000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f4fc5094700 1 -- 172.21.15.80:0/2679605898 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb0000960 con 0x7f4fc006c0a0 2019-11-28T11:28:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f4fc5094700 1 -- 172.21.15.80:0/2679605898 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb0009860 con 0x7f4fc006c0a0 2019-11-28T11:28:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f4fc5094700 1 -- 172.21.15.80:0/2679605898 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb0009f30 con 0x7f4fc006c0a0 2019-11-28T11:28:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f4fc7af9700 1 -- 172.21.15.80:0/2679605898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fc006c0a0 msgr2=0x7f4fc0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7f4fc7af9700 1 --2- 172.21.15.80:0/2679605898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fc006c0a0 0x7f4fc0072fa0 secure :-1 s=READY pgs=561 cs=0 l=1 rx=0x7f4fb000af50 tx=0x7f4fb000b760).stop 2019-11-28T11:28:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7f4fc7af9700 1 -- 172.21.15.80:0/2679605898 shutdown_connections 2019-11-28T11:28:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7f4fc7af9700 1 --2- 172.21.15.80:0/2679605898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fc006c0a0 0x7f4fc0072fa0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7f4fc7af9700 1 -- 172.21.15.80:0/2679605898 shutdown_connections 2019-11-28T11:28:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7f4fc7af9700 1 -- 172.21.15.80:0/2679605898 wait complete. 2019-11-28T11:28:44.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7f4fc7af9700 1 -- 172.21.15.80:0/2679605898 >> 172.21.15.80:0/2679605898 conn(0x7f4fc0061cf0 msgr2=0x7f4fc0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:44.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.364+0000 7f4fc7af9700 1 Processor -- start 2019-11-28T11:28:44.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.364+0000 7f4fc7af9700 1 -- start start 2019-11-28T11:28:44.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f4fc7af9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4fc01342c0 0x7f4fc01346b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:44.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f4fc7af9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fc0136650 0x7f4fc015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:44.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f4fc7af9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc013f410 con 0x7f4fc01361c0 2019-11-28T11:28:44.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f4fc7af9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc0141670 con 0x7f4fc01342c0 2019-11-28T11:28:44.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f4fc7af9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0141940 con 0x7f4fc0136650 2019-11-28T11:28:44.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f4fc6096700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4fc01342c0 0x7f4fc01346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:44.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f4fc6096700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4fc01342c0 0x7f4fc01346b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:48570/0 (socket says 172.21.15.80:48570) 2019-11-28T11:28:44.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f4fc6096700 1 -- 172.21.15.80:0/3441004966 learned_addr learned my addr 172.21.15.80:0/3441004966 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:44.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.365+0000 7f4fc6897700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fc0136650 0x7f4fc015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:44.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f4fc6096700 1 -- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fc0136650 msgr2=0x7f4fc015d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f4fc6096700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fc0136650 0x7f4fc015d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f4fc6096700 1 -- 172.21.15.80:0/3441004966 >> v1:172.21.15.80:6789/0 conn(0x7f4fc01361c0 legacy=0x7f4fc015c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f4fc6096700 1 -- 172.21.15.80:0/3441004966 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0141fd0 con 0x7f4fc01342c0 2019-11-28T11:28:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f4fc6096700 1 --2- 172.21.15.80:0/3441004966 >> v2:172.21.15.174:3300/0 conn(0x7f4fc01342c0 0x7f4fc01346b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4fb00103f0 tx=0x7f4fb00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f4fc6096700 1 --2- 172.21.15.80:0/3441004966 >> v2:172.21.15.174:3300/0 conn(0x7f4fc01342c0 0x7f4fc01346b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4fb00103f0 tx=0x7f4fb00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f4fc6096700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc01342c0 0x7f4fc01346b0 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7f4fb00103f0 tx=0x7f4fb00102a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f4fc6096700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc01342c0 0x7f4fc01346b0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f4fb00103f0 tx=0x7f4fb00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f4fc6096700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc01342c0 0x7f4fc01346b0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f4fb00103f0 tx=0x7f4fb00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f4fb6ffd700 1 -- 172.21.15.80:0/3441004966 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb0000940 con 0x7f4fc01342c0 2019-11-28T11:28:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f4fc6096700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc01342c0 0x7f4fc01346b0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f4fb00103f0 tx=0x7f4fb00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f4fc7af9700 1 -- 172.21.15.80:0/3441004966 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc0142350 con 0x7f4fc01342c0 2019-11-28T11:28:44.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f4fb6ffd700 1 -- 172.21.15.80:0/3441004966 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb0009980 con 0x7f4fc01342c0 2019-11-28T11:28:44.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f4fc7af9700 1 -- 172.21.15.80:0/3441004966 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc0141fd0 con 0x7f4fc01342c0 2019-11-28T11:28:44.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f4fb6ffd700 1 -- 172.21.15.80:0/3441004966 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb000a010 con 0x7f4fc01342c0 2019-11-28T11:28:44.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7f4fc6096700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc01342c0 0x7f4fc01346b0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f4fb00103f0 tx=0x7f4fb00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7f4fb6ffd700 1 -- 172.21.15.80:0/3441004966 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4fb000a230 con 0x7f4fc01342c0 2019-11-28T11:28:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7f4fc6096700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc01342c0 0x7f4fc01346b0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f4fb00103f0 tx=0x7f4fb00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7f4fb6ffd700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fa8018730 0x7f4fa801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7f4fb6ffd700 1 -- 172.21.15.80:0/3441004966 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4fb0031d10 con 0x7f4fc01342c0 2019-11-28T11:28:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7f4fc5895700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fa8018730 0x7f4fa801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.368+0000 7f4fc5895700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fa8018730 0x7f4fa801abe0 crc :-1 s=READY pgs=238 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.374+0000 7f4fc7af9700 1 -- 172.21.15.80:0/3441004966 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc0142350 con 0x7f4fc01342c0 2019-11-28T11:28:44.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7fc02500b700 1 Processor -- start 2019-11-28T11:28:44.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.360+0000 7fc02500b700 1 -- start start 2019-11-28T11:28:44.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7fc02500b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc02006c490 0x7fc02006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:44.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7fc02500b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02006ce60 0x7fc020164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:44.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7fc02500b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02006db00 con 0x7fc02006c0a0 2019-11-28T11:28:44.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7fc02500b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02006fd60 con 0x7fc02006c490 2019-11-28T11:28:44.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7fc02500b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc020070030 con 0x7fc02006ce60 2019-11-28T11:28:44.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7fc01f59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc02006c0a0 0x7fc020072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32988/0 (socket says 172.21.15.80:32988) 2019-11-28T11:28:44.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7fc01f59e700 1 -- 172.21.15.80:0/3459029756 learned_addr learned my addr 172.21.15.80:0/3459029756 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:44.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7fc02480a700 1 --2- 172.21.15.80:0/3459029756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02006ce60 0x7fc020164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:44.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7fc01ed9d700 1 --2- 172.21.15.80:0/3459029756 >> v2:172.21.15.174:3300/0 conn(0x7fc02006c490 0x7fc02006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:44.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7fc01e59c700 1 -- 172.21.15.80:0/3459029756 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597566684 0 0) 0x7fc010001170 con 0x7fc02006c0a0 2019-11-28T11:28:44.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.361+0000 7fc01e59c700 1 -- 172.21.15.80:0/3459029756 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc00c002e80 con 0x7fc02006c0a0 2019-11-28T11:28:44.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.362+0000 7fc02480a700 1 -- 172.21.15.80:0/3459029756 >> v2:172.21.15.174:3300/0 conn(0x7fc02006c490 msgr2=0x7fc02006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:44.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.362+0000 7fc02480a700 1 --2- 172.21.15.80:0/3459029756 >> v2:172.21.15.174:3300/0 conn(0x7fc02006c490 0x7fc02006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:44.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.362+0000 7fc02480a700 1 -- 172.21.15.80:0/3459029756 >> v1:172.21.15.80:6789/0 conn(0x7fc02006c0a0 legacy=0x7fc020072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.362+0000 7fc02480a700 1 -- 172.21.15.80:0/3459029756 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0200706c0 con 0x7fc02006ce60 2019-11-28T11:28:44.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.362+0000 7fc02480a700 1 --2- 172.21.15.80:0/3459029756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02006ce60 0x7fc020164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc01800b300 tx=0x7fc01800b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.362+0000 7fc02480a700 1 --2- 172.21.15.80:0/3459029756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02006ce60 0x7fc020164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc01800b300 tx=0x7fc01800b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.362+0000 7fc02480a700 1 --2- 172.21.15.80:0/3459029756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02006ce60 0x7fc020164d70 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7fc01800b300 tx=0x7fc01800b600).ready entity=mon.2 client_cookie=4361ed5816c3ef27 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:44.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.362+0000 7fc02480a700 1 --2- 172.21.15.80:0/3459029756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02006ce60 0x7fc020164d70 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fc01800b300 tx=0x7fc01800b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.362+0000 7fc01e59c700 1 -- 172.21.15.80:0/3459029756 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0180075c0 con 0x7fc02006ce60 2019-11-28T11:28:44.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.362+0000 7fc02480a700 1 --2- 172.21.15.80:0/3459029756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02006ce60 0x7fc020164d70 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fc01800b300 tx=0x7fc01800b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.362+0000 7fc02480a700 1 --2- 172.21.15.80:0/3459029756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02006ce60 0x7fc020164d70 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fc01800b300 tx=0x7fc01800b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.362+0000 7fc01e59c700 1 -- 172.21.15.80:0/3459029756 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc018009d60 con 0x7fc02006ce60 2019-11-28T11:28:44.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.362+0000 7fc01e59c700 1 -- 172.21.15.80:0/3459029756 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc01800a430 con 0x7fc02006ce60 2019-11-28T11:28:44.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.362+0000 7fc02500b700 1 -- 172.21.15.80:0/3459029756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02006ce60 msgr2=0x7fc020164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.362+0000 7fc02500b700 1 --2- 172.21.15.80:0/3459029756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02006ce60 0x7fc020164d70 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7fc01800b300 tx=0x7fc01800b600).stop 2019-11-28T11:28:44.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.363+0000 7fc02500b700 1 -- 172.21.15.80:0/3459029756 shutdown_connections 2019-11-28T11:28:44.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.363+0000 7fc02500b700 1 --2- 172.21.15.80:0/3459029756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02006ce60 0x7fc020164d70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.363+0000 7fc02500b700 1 --2- 172.21.15.80:0/3459029756 >> v2:172.21.15.174:3300/0 conn(0x7fc02006c490 0x7fc02006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:44.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.363+0000 7fc02500b700 1 -- 172.21.15.80:0/3459029756 shutdown_connections 2019-11-28T11:28:44.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.363+0000 7fc02500b700 1 -- 172.21.15.80:0/3459029756 wait complete. 2019-11-28T11:28:44.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.363+0000 7fc02500b700 1 -- 172.21.15.80:0/3459029756 >> 172.21.15.80:0/3459029756 conn(0x7fc020061cf0 msgr2=0x7fc020064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:44.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7fc02500b700 1 Processor -- start 2019-11-28T11:28:44.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.366+0000 7fc02500b700 1 -- start start 2019-11-28T11:28:44.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc02500b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc02013d620 0x7fc0201337b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:44.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc02500b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc020133cf0 0x7fc020132630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:44.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc02500b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc020132b70 0x7fc020132fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:44.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc02500b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02010dd60 con 0x7fc02013d620 2019-11-28T11:28:44.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc02500b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02010e030 con 0x7fc020132b70 2019-11-28T11:28:44.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc02500b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02010d330 con 0x7fc020133cf0 2019-11-28T11:28:44.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc01ed9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc020133cf0 0x7fc020132630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:44.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc01ed9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc020133cf0 0x7fc020132630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:35950/0 (socket says 172.21.15.80:35950) 2019-11-28T11:28:44.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc01ed9d700 1 -- 172.21.15.80:0/513465938 learned_addr learned my addr 172.21.15.80:0/513465938 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:44.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc01f59e700 1 --2- 172.21.15.80:0/513465938 >> v2:172.21.15.80:3300/0 conn(0x7fc02013d620 0x7fc0201337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:44.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc02480a700 1 --2- 172.21.15.80:0/513465938 >> v2:172.21.15.174:3300/0 conn(0x7fc020132b70 0x7fc020132fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:44.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc01ed9d700 1 -- 172.21.15.80:0/513465938 >> v2:172.21.15.174:3300/0 conn(0x7fc020132b70 msgr2=0x7fc020132fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc01ed9d700 1 --2- 172.21.15.80:0/513465938 >> v2:172.21.15.174:3300/0 conn(0x7fc020132b70 0x7fc020132fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc01ed9d700 1 -- 172.21.15.80:0/513465938 >> v2:172.21.15.80:3300/0 conn(0x7fc02013d620 msgr2=0x7fc0201337b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc01ed9d700 1 --2- 172.21.15.80:0/513465938 >> v2:172.21.15.80:3300/0 conn(0x7fc02013d620 0x7fc0201337b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc01ed9d700 1 -- 172.21.15.80:0/513465938 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02010e6c0 con 0x7fc020133cf0 2019-11-28T11:28:44.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc01ed9d700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc020133cf0 0x7fc020132630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc008010450 tx=0x7fc008010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc01ed9d700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc020133cf0 0x7fc020132630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc008010450 tx=0x7fc008010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.367+0000 7fc01ed9d700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc020133cf0 0x7fc020132630 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7fc008010450 tx=0x7fc008010300).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:44.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.368+0000 7fc01ed9d700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc020133cf0 0x7fc020132630 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fc008010450 tx=0x7fc008010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.368+0000 7fc017fff700 1 -- 172.21.15.80:0/513465938 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc008000940 con 0x7fc020133cf0 2019-11-28T11:28:44.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.368+0000 7fc01ed9d700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc020133cf0 0x7fc020132630 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fc008010450 tx=0x7fc008010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.368+0000 7fc01ed9d700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc020133cf0 0x7fc020132630 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fc008010450 tx=0x7fc008010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.368+0000 7fc017fff700 1 -- 172.21.15.80:0/513465938 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0080088f0 con 0x7fc020133cf0 2019-11-28T11:28:44.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.368+0000 7fc017fff700 1 -- 172.21.15.80:0/513465938 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc008008f40 con 0x7fc020133cf0 2019-11-28T11:28:44.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.368+0000 7fc02500b700 1 -- 172.21.15.80:0/513465938 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02010ea40 con 0x7fc020133cf0 2019-11-28T11:28:44.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.368+0000 7fc02500b700 1 -- 172.21.15.80:0/513465938 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02010e6c0 con 0x7fc020133cf0 2019-11-28T11:28:44.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.368+0000 7fc01ed9d700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc020133cf0 0x7fc020132630 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fc008010450 tx=0x7fc008010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.368+0000 7fc017fff700 1 -- 172.21.15.80:0/513465938 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc0080084f0 con 0x7fc020133cf0 2019-11-28T11:28:44.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.368+0000 7fc01ed9d700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc020133cf0 0x7fc020132630 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fc008010450 tx=0x7fc008010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.368+0000 7fc017fff700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc004018730 0x7fc00401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:44.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.368+0000 7fc017fff700 1 -- 172.21.15.80:0/513465938 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc008031ca0 con 0x7fc020133cf0 2019-11-28T11:28:44.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.369+0000 7fc01f59e700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc004018730 0x7fc00401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:44.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.369+0000 7fc01f59e700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc004018730 0x7fc00401abc0 crc :-1 s=READY pgs=240 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:44.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.375+0000 7fc02500b700 1 -- 172.21.15.80:0/513465938 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02010ea40 con 0x7fc020133cf0 2019-11-28T11:28:44.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.379+0000 7fc01ed9d700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc020133cf0 0x7fc020132630 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fc008010450 tx=0x7fc008010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.379+0000 7fc017fff700 1 -- 172.21.15.80:0/513465938 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc008000940 con 0x7fc020133cf0 2019-11-28T11:28:44.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.377+0000 7f40bbfff700 1 --2- 172.21.15.80:0/361734094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40bc1155b0 0x7f40bc139640 secure :-1 s=THROTTLE_DONE pgs=565 cs=0 l=1 rx=0x7f40b40107d0 tx=0x7f40b4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.377+0000 7f40b8ff9700 1 -- 172.21.15.80:0/361734094 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f40b400ee00 con 0x7f40bc1155b0 2019-11-28T11:28:44.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.377+0000 7f4fc6096700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc01342c0 0x7f4fc01346b0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f4fb00103f0 tx=0x7f4fb00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.377+0000 7f4fb6ffd700 1 -- 172.21.15.80:0/3441004966 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4fb0009bf0 con 0x7f4fc01342c0 2019-11-28T11:28:44.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.565+0000 7f40c19d3700 1 -- 172.21.15.80:0/361734094 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f40bc113670 con 0x7f40bc1155b0 2019-11-28T11:28:44.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.566+0000 7fc02500b700 1 -- 172.21.15.80:0/513465938 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7fc02010e6c0 con 0x7fc020133cf0 2019-11-28T11:28:44.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.567+0000 7f4fc7af9700 1 -- 172.21.15.80:0/3441004966 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f4fc0141fd0 con 0x7f4fc01342c0 2019-11-28T11:28:44.800 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:28:44.772+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:28:44.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.776+0000 7f40bbfff700 1 --2- 172.21.15.80:0/361734094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40bc1155b0 0x7f40bc139640 secure :-1 s=THROTTLE_DONE pgs=565 cs=0 l=1 rx=0x7f40b40107d0 tx=0x7f40b4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.776+0000 7f40b8ff9700 1 -- 172.21.15.80:0/361734094 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5559 v23) v1 ==== 95+0+0 (secure 0 0 0) 0x7f40b4000df0 con 0x7f40bc1155b0 2019-11-28T11:28:44.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.776+0000 7fc01ed9d700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc020133cf0 0x7fc020132630 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fc008010450 tx=0x7fc008010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.776+0000 7fc017fff700 1 -- 172.21.15.80:0/513465938 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 5401 v23) v1 ==== 95+0+0 (secure 0 0 0) 0x7fc0080084f0 con 0x7fc020133cf0 2019-11-28T11:28:44.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.777+0000 7f4fc6096700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc01342c0 0x7f4fc01346b0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f4fb00103f0 tx=0x7f4fb00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:44.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.777+0000 7f4fb6ffd700 1 -- 172.21.15.80:0/3441004966 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 5556 v23) v1 ==== 95+0+0 (secure 0 0 0) 0x7f4fb000a230 con 0x7f4fc01342c0 2019-11-28T11:28:44.807 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 5559 2019-11-28T11:28:44.808 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 5401 2019-11-28T11:28:44.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.781+0000 7f40c19d3700 1 -- 172.21.15.80:0/361734094 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f40a0018730 msgr2=0x7f40a001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.781+0000 7f40c19d3700 1 --2- 172.21.15.80:0/361734094 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f40a0018730 0x7f40a001abc0 crc :-1 s=READY pgs=239 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.781+0000 7f40c19d3700 1 -- 172.21.15.80:0/361734094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40bc1155b0 msgr2=0x7f40bc139640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.781+0000 7f40c19d3700 1 --2- 172.21.15.80:0/361734094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40bc1155b0 0x7f40bc139640 secure :-1 s=READY pgs=565 cs=0 l=1 rx=0x7f40b40107d0 tx=0x7f40b4010b70).stop 2019-11-28T11:28:44.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.781+0000 7f40c19d3700 1 -- 172.21.15.80:0/361734094 shutdown_connections 2019-11-28T11:28:44.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.781+0000 7f40c19d3700 1 --2- 172.21.15.80:0/361734094 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f40a0018730 0x7f40a001abc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.781+0000 7f40c19d3700 1 --2- 172.21.15.80:0/361734094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40bc1155b0 0x7f40bc139640 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.781+0000 7f40c19d3700 1 --2- 172.21.15.80:0/361734094 >> v2:172.21.15.174:3300/0 conn(0x7f40bc1239b0 0x7f40bc116fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.782+0000 7f40c19d3700 1 -- 172.21.15.80:0/361734094 shutdown_connections 2019-11-28T11:28:44.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.782+0000 7f40c19d3700 1 -- 172.21.15.80:0/361734094 wait complete. 2019-11-28T11:28:44.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.782+0000 7f40c19d3700 1 -- 172.21.15.80:0/361734094 >> 172.21.15.80:0/361734094 conn(0x7f40bc1427c0 msgr2=0x7f40bc14fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:44.814 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 5556 2019-11-28T11:28:44.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.783+0000 7f4fc7af9700 1 -- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fa8018730 msgr2=0x7f4fa801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.783+0000 7f4fc7af9700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fa8018730 0x7f4fa801abe0 crc :-1 s=READY pgs=238 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.783+0000 7f4fc7af9700 1 -- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc01342c0 msgr2=0x7f4fc01346b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.783+0000 7f4fc7af9700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc01342c0 0x7f4fc01346b0 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7f4fb00103f0 tx=0x7f4fb00102a0).stop 2019-11-28T11:28:44.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.783+0000 7f4fc7af9700 1 -- 172.21.15.80:0/3441004966 shutdown_connections 2019-11-28T11:28:44.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.783+0000 7f4fc7af9700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fa8018730 0x7f4fa801abe0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.783+0000 7f4fc7af9700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fc0136650 0x7f4fc015d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.783+0000 7f4fc7af9700 1 --2- 172.21.15.80:0/3441004966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc01342c0 0x7f4fc01346b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.783+0000 7f4fc7af9700 1 -- 172.21.15.80:0/3441004966 shutdown_connections 2019-11-28T11:28:44.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.783+0000 7f4fc7af9700 1 -- 172.21.15.80:0/3441004966 wait complete. 2019-11-28T11:28:44.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.783+0000 7f4fc7af9700 1 -- 172.21.15.80:0/3441004966 >> 172.21.15.80:0/3441004966 conn(0x7f4fc0159ae0 msgr2=0x7f4fc013d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:44.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.782+0000 7fc02500b700 1 -- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc004018730 msgr2=0x7fc00401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.782+0000 7fc02500b700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc004018730 0x7fc00401abc0 crc :-1 s=READY pgs=240 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.782+0000 7fc02500b700 1 -- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc020133cf0 msgr2=0x7fc020132630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:44.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.782+0000 7fc02500b700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc020133cf0 0x7fc020132630 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7fc008010450 tx=0x7fc008010300).stop 2019-11-28T11:28:44.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.782+0000 7fc02500b700 1 -- 172.21.15.80:0/513465938 shutdown_connections 2019-11-28T11:28:44.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.782+0000 7fc02500b700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc004018730 0x7fc00401abc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.782+0000 7fc02500b700 1 --2- 172.21.15.80:0/513465938 >> v2:172.21.15.174:3300/0 conn(0x7fc020132b70 0x7fc020132fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.782+0000 7fc02500b700 1 --2- 172.21.15.80:0/513465938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc020133cf0 0x7fc020132630 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.782+0000 7fc02500b700 1 --2- 172.21.15.80:0/513465938 >> v2:172.21.15.80:3300/0 conn(0x7fc02013d620 0x7fc0201337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:44.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.782+0000 7fc02500b700 1 -- 172.21.15.80:0/513465938 shutdown_connections 2019-11-28T11:28:44.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.782+0000 7fc02500b700 1 -- 172.21.15.80:0/513465938 wait complete. 2019-11-28T11:28:44.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.782+0000 7fc02500b700 1 -- 172.21.15.80:0/513465938 >> 172.21.15.80:0/513465938 conn(0x7fc02011bfc0 msgr2=0x7fc020141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:44.820 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:28:44.821 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:28:44.822 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:28:44.822 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:28:45.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.979+0000 7f0481657700 1 Processor -- start 2019-11-28T11:28:45.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.979+0000 7f0481657700 1 -- start start 2019-11-28T11:28:45.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f0481657700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c06d120 0x7f047c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:45.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f0481657700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047c06d580 con 0x7f047c06c0a0 2019-11-28T11:28:45.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f0481657700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047c06db00 con 0x7f047c06c490 2019-11-28T11:28:45.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f0481657700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047c06fd60 con 0x7f047c06d120 2019-11-28T11:28:45.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047b7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f047c06c0a0 0x7f047c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33018/0 (socket says 172.21.15.80:33018) 2019-11-28T11:28:45.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047b7fe700 1 -- 172.21.15.80:0/3683702473 learned_addr learned my addr 172.21.15.80:0/3683702473 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:45.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047bfff700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c06d120 0x7f047c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:45.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 -- 172.21.15.80:0/3683702473 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605059329 0 0) 0x7f04640014d0 con 0x7f047c06c0a0 2019-11-28T11:28:45.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 -- 172.21.15.80:0/3683702473 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f045c002e80 con 0x7f047c06c0a0 2019-11-28T11:28:45.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 -- 172.21.15.80:0/3683702473 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589887835 0 0) 0x7f046c001080 con 0x7f047c06c490 2019-11-28T11:28:45.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 -- 172.21.15.80:0/3683702473 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f045c0030b0 con 0x7f047c06c490 2019-11-28T11:28:45.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 -- 172.21.15.80:0/3683702473 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2866494726 0 0) 0x7f04640014b0 con 0x7f047c06c0a0 2019-11-28T11:28:45.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 -- 172.21.15.80:0/3683702473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c06d120 msgr2=0x7f047c165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:45.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c06d120 0x7f047c165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:45.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 -- 172.21.15.80:0/3683702473 >> v1:172.21.15.174:6789/0 conn(0x7f047c06c490 legacy=0x7f047c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 -- 172.21.15.80:0/3683702473 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c0706c0 con 0x7f047c06c0a0 2019-11-28T11:28:45.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 -- 172.21.15.80:0/3683702473 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f04640019e0 con 0x7f047c06c0a0 2019-11-28T11:28:45.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 -- 172.21.15.80:0/3683702473 >> v1:172.21.15.80:6789/0 conn(0x7f047c06c0a0 legacy=0x7f047c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f045c003b80 0x7f045c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:45.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045c006690 0x7f045c008b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:45.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c04d310 0x7f045c04f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:45.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 -- 172.21.15.80:0/3683702473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c04fff0 con 0x7f045c04d310 2019-11-28T11:28:45.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 -- 172.21.15.80:0/3683702473 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c0501e0 con 0x7f045c006690 2019-11-28T11:28:45.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047a7fc700 1 -- 172.21.15.80:0/3683702473 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c050410 con 0x7f045c003b80 2019-11-28T11:28:45.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047b7fe700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f045c003b80 0x7f045c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:45.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047bfff700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c04d310 0x7f045c04f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:45.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.980+0000 7f047affd700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045c006690 0x7f045c008b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:45.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f047bfff700 1 -- 172.21.15.80:0/3683702473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f045c003b80 msgr2=0x7f045c005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:45.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f047bfff700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f045c003b80 0x7f045c005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:45.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f047bfff700 1 -- 172.21.15.80:0/3683702473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045c006690 msgr2=0x7f045c008b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:45.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f047bfff700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045c006690 0x7f045c008b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:45.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f047bfff700 1 -- 172.21.15.80:0/3683702473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c0506c0 con 0x7f045c04d310 2019-11-28T11:28:45.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f047bfff700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c04d310 0x7f045c04f7e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f04740029a0 tx=0x7f04740028a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f047bfff700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c04d310 0x7f045c04f7e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f04740029a0 tx=0x7f04740028a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f047bfff700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c04d310 0x7f045c04f7e0 secure :-1 s=READY pgs=567 cs=0 l=1 rx=0x7f04740029a0 tx=0x7f04740028a0).ready entity=mon.0 client_cookie=c15d98a3ca2d2098 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:45.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f047bfff700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c04d310 0x7f045c04f7e0 secure :-1 s=THROTTLE_DONE pgs=567 cs=0 l=1 rx=0x7f04740029a0 tx=0x7f04740028a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f047a7fc700 1 -- 172.21.15.80:0/3683702473 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0474000a70 con 0x7f045c04d310 2019-11-28T11:28:45.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f047bfff700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c04d310 0x7f045c04f7e0 secure :-1 s=THROTTLE_DONE pgs=567 cs=0 l=1 rx=0x7f04740029a0 tx=0x7f04740028a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f047bfff700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c04d310 0x7f045c04f7e0 secure :-1 s=THROTTLE_DONE pgs=567 cs=0 l=1 rx=0x7f04740029a0 tx=0x7f04740028a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f047a7fc700 1 -- 172.21.15.80:0/3683702473 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047400ec90 con 0x7f045c04d310 2019-11-28T11:28:45.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f047a7fc700 1 -- 172.21.15.80:0/3683702473 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f047400f360 con 0x7f045c04d310 2019-11-28T11:28:45.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f0481657700 1 -- 172.21.15.80:0/3683702473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c04d310 msgr2=0x7f045c04f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f0481657700 1 --2- 172.21.15.80:0/3683702473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c04d310 0x7f045c04f7e0 secure :-1 s=READY pgs=567 cs=0 l=1 rx=0x7f04740029a0 tx=0x7f04740028a0).stop 2019-11-28T11:28:45.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.981+0000 7f047bfff700 1 -- 172.21.15.80:0/3683702473 reap_dead start 2019-11-28T11:28:45.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.982+0000 7f0481657700 1 -- 172.21.15.80:0/3683702473 shutdown_connections 2019-11-28T11:28:45.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.982+0000 7f0481657700 1 -- 172.21.15.80:0/3683702473 shutdown_connections 2019-11-28T11:28:45.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.982+0000 7f0481657700 1 -- 172.21.15.80:0/3683702473 wait complete. 2019-11-28T11:28:45.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.982+0000 7f0481657700 1 -- 172.21.15.80:0/3683702473 >> 172.21.15.80:0/3683702473 conn(0x7f047c061cf0 msgr2=0x7f047c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:45.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.984+0000 7f0481657700 1 Processor -- start 2019-11-28T11:28:45.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.984+0000 7f0481657700 1 -- start start 2019-11-28T11:28:45.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.985+0000 7f0481657700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c167a20 0x7f047c169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:45.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.985+0000 7f0481657700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047c1414d0 con 0x7f047c078e30 2019-11-28T11:28:45.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.985+0000 7f0481657700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047c142120 con 0x7f047c112960 2019-11-28T11:28:45.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.985+0000 7f0481657700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047c1144b0 con 0x7f047c167a20 2019-11-28T11:28:45.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.985+0000 7f047affd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f047c078e30 0x7f047c0792c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33034/0 (socket says 172.21.15.80:33034) 2019-11-28T11:28:45.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.985+0000 7f047affd700 1 -- 172.21.15.80:0/3586613690 learned_addr learned my addr 172.21.15.80:0/3586613690 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:45.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.985+0000 7f047bfff700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c167a20 0x7f047c169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:45.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f0473fff700 1 -- 172.21.15.80:0/3586613690 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541180696 0 0) 0x7f046c0079b0 con 0x7f047c078e30 2019-11-28T11:28:45.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f0473fff700 1 -- 172.21.15.80:0/3586613690 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0454002e80 con 0x7f047c078e30 2019-11-28T11:28:45.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f0473fff700 1 -- 172.21.15.80:0/3586613690 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234844125 0 0) 0x7f0464001bd0 con 0x7f047c112960 2019-11-28T11:28:45.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f0473fff700 1 -- 172.21.15.80:0/3586613690 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04540030b0 con 0x7f047c112960 2019-11-28T11:28:45.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f047bfff700 1 -- 172.21.15.80:0/3586613690 >> v1:172.21.15.174:6789/0 conn(0x7f047c112960 legacy=0x7f047c1155e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f047bfff700 1 -- 172.21.15.80:0/3586613690 >> v1:172.21.15.80:6789/0 conn(0x7f047c078e30 legacy=0x7f047c0792c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f047bfff700 1 -- 172.21.15.80:0/3586613690 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c114e10 con 0x7f047c167a20 2019-11-28T11:28:45.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f047bfff700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c167a20 0x7f047c169e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0474001fc0 tx=0x7f0474010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f047bfff700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c167a20 0x7f047c169e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0474001fc0 tx=0x7f0474010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f047bfff700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c167a20 0x7f047c169e20 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f0474001fc0 tx=0x7f0474010700).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:45.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f047bfff700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c167a20 0x7f047c169e20 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f0474001fc0 tx=0x7f0474010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f0473fff700 1 -- 172.21.15.80:0/3586613690 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04740025c0 con 0x7f047c167a20 2019-11-28T11:28:45.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f047bfff700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c167a20 0x7f047c169e20 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f0474001fc0 tx=0x7f0474010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f0473fff700 1 -- 172.21.15.80:0/3586613690 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0474000c60 con 0x7f047c167a20 2019-11-28T11:28:45.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f047bfff700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c167a20 0x7f047c169e20 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f0474001fc0 tx=0x7f0474010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f0481657700 1 -- 172.21.15.80:0/3586613690 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047c115190 con 0x7f047c167a20 2019-11-28T11:28:45.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f0473fff700 1 -- 172.21.15.80:0/3586613690 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0474000e50 con 0x7f047c167a20 2019-11-28T11:28:45.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f0481657700 1 -- 172.21.15.80:0/3586613690 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f047c114e10 con 0x7f047c167a20 2019-11-28T11:28:45.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.986+0000 7f047bfff700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c167a20 0x7f047c169e20 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f0474001fc0 tx=0x7f0474010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.987+0000 7f0473fff700 1 -- 172.21.15.80:0/3586613690 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f04740027f0 con 0x7f047c167a20 2019-11-28T11:28:45.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.987+0000 7f047bfff700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c167a20 0x7f047c169e20 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f0474001fc0 tx=0x7f0474010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.987+0000 7f0473fff700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0454018750 0x7f045401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:45.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.987+0000 7f0473fff700 1 -- 172.21.15.80:0/3586613690 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f0474031ab0 con 0x7f047c167a20 2019-11-28T11:28:45.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.987+0000 7f047b7fe700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0454018750 0x7f045401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:45.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.987+0000 7f047b7fe700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0454018750 0x7f045401abe0 crc :-1 s=READY pgs=241 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:45.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.994+0000 7f0481657700 1 -- 172.21.15.80:0/3586613690 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047c115190 con 0x7f047c167a20 2019-11-28T11:28:45.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.998+0000 7f047bfff700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c167a20 0x7f047c169e20 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f0474001fc0 tx=0x7f0474010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:44.998+0000 7f0473fff700 1 -- 172.21.15.80:0/3586613690 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f04740176f0 con 0x7f047c167a20 2019-11-28T11:28:45.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.172+0000 7f0481657700 1 -- 172.21.15.80:0/3586613690 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f047c114e10 con 0x7f047c167a20 2019-11-28T11:28:45.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.173+0000 7f047bfff700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c167a20 0x7f047c169e20 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f0474001fc0 tx=0x7f0474010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.173+0000 7f0473fff700 1 -- 172.21.15.80:0/3586613690 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) v1 ==== 81+0+31761 (secure 0 0 0) 0x7f04740027f0 con 0x7f047c167a20 2019-11-28T11:28:45.203 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:45.203 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:28:45.204 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 50, 2019-11-28T11:28:45.204 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:28:45.204 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:28:45.204 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:28:44.572519+0000", 2019-11-28T11:28:45.204 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:28:45.205 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:28:45.205 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:28:45.205 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:28:45.205 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:28:45.205 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:28:45.205 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:28:45.205 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:28:45.206 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:28:45.215 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:28:45.215 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:28:45.215 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:28:45.215 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:28:45.215 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:28:45.216 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:28:45.216 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 7, 2019-11-28T11:28:45.216 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:28:45.216 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:28:45.216 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:28:45.217 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:28:45.217 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:28:45.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.217 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:28:45.217 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:28:45.217 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:28:45.218 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:28:45.218 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:28:45.218 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:28:45.218 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:28:45.219 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:28:45.219 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:28:45.227 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:28:45.227 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:28:45.227 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:28:45.228 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:28:45.228 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:28:45.228 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:28:45.228 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:28:45.229 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:28:45.229 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:28:45.229 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:28:45.229 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:28:45.238 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:28:45.238 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:28:45.238 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:28:45.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.238 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:28:45.238 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:28:45.239 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:28:45.239 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:28:45.239 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:28:45.239 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:28:45.239 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:28:45.239 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:28:45.239 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:28:45.240 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:28:45.240 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:28:45.240 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:28:45.240 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:28:45.240 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:28:45.240 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:28:45.240 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:28:45.241 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:28:45.241 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:28:45.241 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:28:45.241 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:28:45.241 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:28:45.241 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:28:45.241 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:28:45.242 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:28:45.242 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:28:45.242 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:28:45.242 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:28:45.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.242 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:28:45.242 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:28:45.243 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:28:45.243 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:28:45.243 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:28:45.243 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:28:45.243 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:28:45.243 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:28:45.243 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:28:45.243 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:28:45.244 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:28:45.244 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:28:45.244 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:28:45.244 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:28:45.244 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.245 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 6, 2019-11-28T11:28:45.245 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:28:45.245 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:28:26.282940+0000", 2019-11-28T11:28:45.245 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:28:45.245 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:28:45.245 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:28:45.245 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:28:45.246 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:28:45.246 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:28:45.246 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:28:45.246 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:28:45.246 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:28:45.246 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:28:45.246 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:28:45.247 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:28:45.247 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:28:45.247 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:28:45.247 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:28:45.247 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:28:45.247 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:28:45.247 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:28:45.247 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:28:45.248 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:28:45.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.248 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "46", 2019-11-28T11:28:45.248 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:28:45.248 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:28:45.248 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:28:45.248 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:28:45.249 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:28:45.249 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:28:45.249 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:28:45.249 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:28:45.249 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:28:45.249 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:28:45.249 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:28:45.250 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:28:45.250 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:28:45.250 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:28:45.250 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:28:45.250 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:28:45.250 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:28:45.250 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:28:45.250 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:28:45.251 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:28:45.251 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:28:45.251 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:28:45.251 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:28:45.251 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:28:45.251 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:28:45.251 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:28:45.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.252 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:28:45.252 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:28:45.252 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:28:45.252 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:28:45.252 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:28:45.252 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:28:45.253 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:28:45.253 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:28:45.253 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:28:45.253 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:28:45.253 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:28:45.253 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:28:45.253 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:28:45.254 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:28:45.254 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:28:45.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.254 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:28:45.254 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:28:45.254 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:28:45.255 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.255 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.255 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 7, 2019-11-28T11:28:45.255 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:28:45.255 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:28:26.978374+0000", 2019-11-28T11:28:45.256 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:28:45.256 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:28:45.256 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:28:45.256 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:28:45.256 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:28:45.256 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:28:45.256 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:28:45.256 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:28:45.257 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:28:45.257 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:28:45.257 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:28:45.257 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:28:45.257 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:28:45.257 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:28:45.257 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:28:45.258 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:28:45.258 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:28:45.258 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:28:45.258 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:28:45.258 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:28:45.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.258 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "47", 2019-11-28T11:28:45.259 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:28:45.259 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:28:45.259 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:28:45.259 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:28:45.259 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:28:45.259 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:28:45.259 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:28:45.259 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:28:45.260 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:28:45.260 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:28:45.260 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:28:45.260 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:28:45.260 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:28:45.260 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:28:45.260 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:28:45.261 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:28:45.261 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:28:45.261 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:28:45.262 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:28:45.262 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:28:45.262 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:28:45.262 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:28:45.262 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:28:45.262 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:28:45.262 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:28:45.263 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:28:45.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.263 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:28:45.263 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:28:45.263 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:28:45.263 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:28:45.263 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:28:45.263 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:28:45.264 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:28:45.264 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:28:45.264 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:28:45.264 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:28:45.264 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:28:45.264 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:28:45.264 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:28:45.265 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:28:45.265 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:28:45.265 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.265 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.265 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.265 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:28:45.265 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:28:45.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.266 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:28:45.266 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:28:45.266 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:28:45.266 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:28:45.266 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:28:45.266 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:28:45.267 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:28:45.267 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:28:45.267 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:28:45.267 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 44, 2019-11-28T11:28:45.267 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:28:45.267 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:28:45.267 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:28:45.268 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.268 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.268 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:28:45.268 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:28:45.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.268 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.269 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:28:45.269 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:28:45.269 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.269 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.269 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:28:45.269 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.270 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.270 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:28:45.270 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:28:45.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.270 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.271 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:28:45.271 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:28:45.271 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.271 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.271 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:28:45.271 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.272 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.272 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:28:45.272 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:28:45.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.273 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.273 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:28:45.273 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:28:45.273 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.273 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.274 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:28:45.274 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.274 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.274 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:28:45.274 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:28:45.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.275 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.275 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:28:45.275 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:28:45.275 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.275 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.276 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:28:45.276 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:28:45.276 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:28:45.276 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:28:45.276 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:28:45.276 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:28:45.277 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:28:45.277 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.277 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:28:45.277 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:28:45.277 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:28:45.278 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:28:45.278 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:28:45.278 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:28:45.278 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:28:45.278 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:28:45.278 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:28:45.278 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 43, 2019-11-28T11:28:45.279 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:28:45.279 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:28:45.279 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:28:45.279 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.279 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.279 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:28:45.280 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:28:45.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.280 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.280 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:28:45.280 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:28:45.280 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.281 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.281 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:28:45.281 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.281 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.282 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:28:45.282 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:28:45.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.282 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.282 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:28:45.282 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:28:45.283 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.283 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.283 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:28:45.283 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.283 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.283 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:28:45.284 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:28:45.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.284 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.285 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:28:45.285 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:28:45.285 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.285 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.285 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:28:45.285 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.286 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.286 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:28:45.286 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:28:45.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.286 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.286 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:28:45.287 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:28:45.287 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.287 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.287 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:28:45.287 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:28:45.287 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:28:45.288 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:28:45.288 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:28:45.288 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:28:45.288 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:28:45.288 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.289 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:28:45.289 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:28:45.289 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:28:45.289 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:28:45.289 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:28:45.289 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:28:45.290 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:28:45.290 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:28:45.290 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:28:45.290 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 33, 2019-11-28T11:28:45.290 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:28:45.290 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:28:45.290 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:28:45.291 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.291 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.291 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:28:45.291 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:28:45.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.292 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.292 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:28:45.292 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:28:45.292 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.292 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.293 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:28:45.293 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.293 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.294 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:28:45.294 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:28:45.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.294 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.295 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:28:45.295 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:28:45.295 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.295 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.295 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:28:45.295 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.296 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.296 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:28:45.296 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:28:45.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.296 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.297 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:28:45.297 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:28:45.297 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.297 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.297 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:28:45.297 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.298 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.298 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:28:45.298 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:28:45.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.298 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.298 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:28:45.299 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:28:45.299 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.299 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.299 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:28:45.299 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:28:45.299 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:28:45.300 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:28:45.300 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:28:45.300 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:28:45.300 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:28:45.300 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.301 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:28:45.301 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:28:45.301 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:28:45.301 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:28:45.301 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:28:45.301 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:28:45.301 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:28:45.301 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:28:45.302 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:28:45.302 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 44, 2019-11-28T11:28:45.302 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:28:45.302 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:28:45.302 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:28:45.302 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.303 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.303 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:28:45.303 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:28:45.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.303 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.303 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:28:45.304 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:28:45.306 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.306 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.307 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:28:45.307 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.307 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.307 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:28:45.307 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:28:45.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.308 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.308 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:28:45.308 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:28:45.309 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.309 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.309 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:28:45.309 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.309 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.310 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:28:45.310 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:28:45.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.310 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.310 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:28:45.310 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:28:45.311 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.311 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.311 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:28:45.311 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.311 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.312 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:28:45.312 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:28:45.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.312 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.312 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:28:45.312 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:28:45.313 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.313 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.313 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:28:45.313 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:28:45.313 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:28:45.313 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:28:45.313 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:28:45.314 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:28:45.314 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:28:45.314 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.314 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:28:45.314 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:28:45.315 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:28:45.315 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:28:45.315 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:28:45.315 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:28:45.315 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:28:45.315 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:28:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:28:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 44, 2019-11-28T11:28:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:28:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:28:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:28:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:28:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:28:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:28:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:28:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:28:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:28:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:28:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:28:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:28:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:28:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:28:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:28:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:28:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:28:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:28:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:28:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:28:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:28:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:28:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:28:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:28:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:28:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:28:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:28:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:28:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:28:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:28:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:28:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:28:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:28:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:28:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:28:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:28:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:28:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:28:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 44, 2019-11-28T11:28:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:28:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:28:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:28:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:28:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:28:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:28:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:28:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:28:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:28:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:28:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:28:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:28:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:28:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:28:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:28:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:28:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:28:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:28:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:28:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:28:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:28:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:28:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:28:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:28:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:28:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:28:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:28:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:28:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:28:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:28:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:28:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:28:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:28:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:28:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:28:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:28:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:28:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:28:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 45, 2019-11-28T11:28:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:28:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:28:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:28:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:28:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:28:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:28:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:28:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:28:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:28:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:28:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:28:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:28:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:28:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:28:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:28:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:28:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:28:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:28:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:28:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:28:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:28:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:28:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:28:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:28:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:28:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:28:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:28:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:28:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:28:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:28:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:28:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:28:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:28:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:28:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:28:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:28:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:28:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:28:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 44, 2019-11-28T11:28:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:28:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:28:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:28:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:28:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:28:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:28:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:28:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:28:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:28:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:28:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:28:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:28:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:28:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:28:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:28:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:28:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:28:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:28:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:28:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:28:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:28:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:28:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:28:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:28:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:28:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:28:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:28:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:28:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:28:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:28:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:28:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:28:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:28:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:28:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:28:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:28:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:28:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:28:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:28:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:28:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:28:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:28:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:28:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:28:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:28:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:28:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:28:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:28:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:28:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:28:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:28:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:28:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:28:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:28:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:28:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:28:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:28:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:28:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:28:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:28:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:28:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:28:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:28:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:28:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:28:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:28:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:28:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:28:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:28:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:28:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:28:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:28:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:28:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:28:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:28:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:28:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:28:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:28:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:28:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:28:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:28:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:28:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:28:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:28:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:28:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:28:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:28:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:28:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:28:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:28:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:28:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:28:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:28:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:28:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:28:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:28:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:28:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:28:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:28:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:28:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:28:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:28:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:28:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:28:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/160551131": "2019-11-29T11:28:44.569976+0000", 2019-11-28T11:28:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/160551131": "2019-11-29T11:28:44.569976+0000" 2019-11-28T11:28:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:28:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:28:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:28:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:28:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:28:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:28:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:28:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:28:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:28:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:28:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:28:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:28:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:28:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:28:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:28:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:28:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:28:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:28:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:28:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:28:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:28:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:28:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:28:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:28:45.375 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:28:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.176+0000 7f0481657700 1 -- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0454018750 msgr2=0x7f045401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.176+0000 7f0481657700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0454018750 0x7f045401abe0 crc :-1 s=READY pgs=241 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.176+0000 7f0481657700 1 -- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c167a20 msgr2=0x7f047c169e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.176+0000 7f0481657700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c167a20 0x7f047c169e20 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f0474001fc0 tx=0x7f0474010700).stop 2019-11-28T11:28:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.177+0000 7f0481657700 1 -- 172.21.15.80:0/3586613690 shutdown_connections 2019-11-28T11:28:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.177+0000 7f0481657700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f047c167a20 0x7f047c169e20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:45.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.177+0000 7f0481657700 1 --2- 172.21.15.80:0/3586613690 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0454018750 0x7f045401abe0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:45.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.177+0000 7f0481657700 1 -- 172.21.15.80:0/3586613690 shutdown_connections 2019-11-28T11:28:45.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.177+0000 7f0481657700 1 -- 172.21.15.80:0/3586613690 wait complete. 2019-11-28T11:28:45.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.177+0000 7f0481657700 1 -- 172.21.15.80:0/3586613690 >> 172.21.15.80:0/3586613690 conn(0x7f047c13fa50 msgr2=0x7f047c13ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:45.377 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:28:45.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.468+0000 7f910c8dd700 1 Processor -- start 2019-11-28T11:28:45.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.468+0000 7f910c8dd700 1 -- start start 2019-11-28T11:28:45.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f910c8dd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f910806c0a0 0x7f9108072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:45.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f910c8dd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f91080734e0 0x7f9108071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:45.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f910c8dd700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910806db00 con 0x7f9108072360 2019-11-28T11:28:45.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f910c8dd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910806fd60 con 0x7f910806c0a0 2019-11-28T11:28:45.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f910c8dd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9108070030 con 0x7f91080734e0 2019-11-28T11:28:45.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f9106d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f910806c0a0 0x7f9108072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:45.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f9106d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f910806c0a0 0x7f9108072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33722/0 (socket says 172.21.15.80:33722) 2019-11-28T11:28:45.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f9106d9d700 1 -- 172.21.15.80:0/2538805386 learned_addr learned my addr 172.21.15.80:0/2538805386 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:45.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f910759e700 1 --1- 172.21.15.80:0/2538805386 >> v1:172.21.15.80:6789/0 conn(0x7f9108072360 0x7f910806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33040/0 (socket says 172.21.15.80:33040) 2019-11-28T11:28:45.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f9106d9d700 1 -- 172.21.15.80:0/2538805386 >> v2:172.21.15.174:3300/0 conn(0x7f91080734e0 msgr2=0x7f9108071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:45.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f9106d9d700 1 --2- 172.21.15.80:0/2538805386 >> v2:172.21.15.174:3300/0 conn(0x7f91080734e0 0x7f9108071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:45.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f9106d9d700 1 -- 172.21.15.80:0/2538805386 >> v1:172.21.15.80:6789/0 conn(0x7f9108072360 legacy=0x7f910806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f9106d9d700 1 -- 172.21.15.80:0/2538805386 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91080706c0 con 0x7f910806c0a0 2019-11-28T11:28:45.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f9105d9b700 1 -- 172.21.15.80:0/2538805386 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845939251 0 0) 0x7f91000009b0 con 0x7f9108072360 2019-11-28T11:28:45.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f9106d9d700 1 --2- 172.21.15.80:0/2538805386 >> v2:172.21.15.80:3300/0 conn(0x7f910806c0a0 0x7f9108072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f90f000fa40 tx=0x7f90f000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f9106d9d700 1 --2- 172.21.15.80:0/2538805386 >> v2:172.21.15.80:3300/0 conn(0x7f910806c0a0 0x7f9108072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f90f000fa40 tx=0x7f90f000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f9106d9d700 1 --2- 172.21.15.80:0/2538805386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910806c0a0 0x7f9108072fa0 secure :-1 s=READY pgs=570 cs=0 l=1 rx=0x7f90f000fa40 tx=0x7f90f000fde0).ready entity=mon.0 client_cookie=977c366759c11759 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:45.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f9106d9d700 1 --2- 172.21.15.80:0/2538805386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910806c0a0 0x7f9108072fa0 secure :-1 s=THROTTLE_DONE pgs=570 cs=0 l=1 rx=0x7f90f000fa40 tx=0x7f90f000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.469+0000 7f9105d9b700 1 -- 172.21.15.80:0/2538805386 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90f0000ce0 con 0x7f910806c0a0 2019-11-28T11:28:45.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.470+0000 7f9106d9d700 1 --2- 172.21.15.80:0/2538805386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910806c0a0 0x7f9108072fa0 secure :-1 s=THROTTLE_DONE pgs=570 cs=0 l=1 rx=0x7f90f000fa40 tx=0x7f90f000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.470+0000 7f9106d9d700 1 --2- 172.21.15.80:0/2538805386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910806c0a0 0x7f9108072fa0 secure :-1 s=THROTTLE_DONE pgs=570 cs=0 l=1 rx=0x7f90f000fa40 tx=0x7f90f000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.470+0000 7f9105d9b700 1 -- 172.21.15.80:0/2538805386 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f0001010 con 0x7f910806c0a0 2019-11-28T11:28:45.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.470+0000 7f9105d9b700 1 -- 172.21.15.80:0/2538805386 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90f0001720 con 0x7f910806c0a0 2019-11-28T11:28:45.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.470+0000 7f910c8dd700 1 -- 172.21.15.80:0/2538805386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910806c0a0 msgr2=0x7f9108072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.470+0000 7f910c8dd700 1 --2- 172.21.15.80:0/2538805386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910806c0a0 0x7f9108072fa0 secure :-1 s=READY pgs=570 cs=0 l=1 rx=0x7f90f000fa40 tx=0x7f90f000fde0).stop 2019-11-28T11:28:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.470+0000 7f910c8dd700 1 -- 172.21.15.80:0/2538805386 shutdown_connections 2019-11-28T11:28:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.470+0000 7f910c8dd700 1 --2- 172.21.15.80:0/2538805386 >> v2:172.21.15.174:3300/0 conn(0x7f91080734e0 0x7f9108071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.470+0000 7f910c8dd700 1 --2- 172.21.15.80:0/2538805386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910806c0a0 0x7f9108072fa0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.470+0000 7f910c8dd700 1 -- 172.21.15.80:0/2538805386 shutdown_connections 2019-11-28T11:28:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.470+0000 7f910c8dd700 1 -- 172.21.15.80:0/2538805386 wait complete. 2019-11-28T11:28:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.470+0000 7f910c8dd700 1 -- 172.21.15.80:0/2538805386 >> 172.21.15.80:0/2538805386 conn(0x7f9108061cf0 msgr2=0x7f9108064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:45.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.473+0000 7f910c8dd700 1 Processor -- start 2019-11-28T11:28:45.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.473+0000 7f910c8dd700 1 -- start start 2019-11-28T11:28:45.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910c8dd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9108104820 0x7f910810c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:45.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910c8dd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f910810c890 0x7f910810b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:45.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910c8dd700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910813bcd0 con 0x7f910810b710 2019-11-28T11:28:45.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910c8dd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9108108700 con 0x7f910810c890 2019-11-28T11:28:45.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910c8dd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91081081f0 con 0x7f9108104820 2019-11-28T11:28:45.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910659c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f910810c890 0x7f910810b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:45.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f910810b710 0x7f9108104c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33048/0 (socket says 172.21.15.80:33048) 2019-11-28T11:28:45.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910759e700 1 -- 172.21.15.80:0/2459692923 learned_addr learned my addr 172.21.15.80:0/2459692923 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:45.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f9106d9d700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9108104820 0x7f910810c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:45.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910659c700 1 -- 172.21.15.80:0/2459692923 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9108104820 msgr2=0x7f910810c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910659c700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9108104820 0x7f910810c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:45.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910659c700 1 -- 172.21.15.80:0/2459692923 >> v1:172.21.15.80:6789/0 conn(0x7f910810b710 legacy=0x7f9108104c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f90ff7fe700 1 -- 172.21.15.80:0/2459692923 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927008149 0 0) 0x7f9100000f80 con 0x7f910810b710 2019-11-28T11:28:45.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910659c700 1 -- 172.21.15.80:0/2459692923 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9108109a90 con 0x7f910810c890 2019-11-28T11:28:45.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910659c700 1 --2- 172.21.15.80:0/2459692923 >> v2:172.21.15.80:3300/0 conn(0x7f910810c890 0x7f910810b1d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f90f8010390 tx=0x7f90f80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910659c700 1 --2- 172.21.15.80:0/2459692923 >> v2:172.21.15.80:3300/0 conn(0x7f910810c890 0x7f910810b1d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f90f8010390 tx=0x7f90f80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910659c700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910810c890 0x7f910810b1d0 secure :-1 s=READY pgs=572 cs=0 l=1 rx=0x7f90f8010390 tx=0x7f90f80101c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:45.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910659c700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910810c890 0x7f910810b1d0 secure :-1 s=THROTTLE_DONE pgs=572 cs=0 l=1 rx=0x7f90f8010390 tx=0x7f90f80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f90ff7fe700 1 -- 172.21.15.80:0/2459692923 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90f8000940 con 0x7f910810c890 2019-11-28T11:28:45.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910659c700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910810c890 0x7f910810b1d0 secure :-1 s=THROTTLE_DONE pgs=572 cs=0 l=1 rx=0x7f90f8010390 tx=0x7f90f80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910c8dd700 1 -- 172.21.15.80:0/2459692923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9108109e10 con 0x7f910810c890 2019-11-28T11:28:45.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f90ff7fe700 1 -- 172.21.15.80:0/2459692923 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f8007220 con 0x7f910810c890 2019-11-28T11:28:45.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910659c700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910810c890 0x7f910810b1d0 secure :-1 s=THROTTLE_DONE pgs=572 cs=0 l=1 rx=0x7f90f8010390 tx=0x7f90f80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f90ff7fe700 1 -- 172.21.15.80:0/2459692923 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90f8009bb0 con 0x7f910810c890 2019-11-28T11:28:45.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.474+0000 7f910c8dd700 1 -- 172.21.15.80:0/2459692923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9108109a90 con 0x7f910810c890 2019-11-28T11:28:45.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.475+0000 7f910659c700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910810c890 0x7f910810b1d0 secure :-1 s=THROTTLE_DONE pgs=572 cs=0 l=1 rx=0x7f90f8010390 tx=0x7f90f80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.475+0000 7f90ff7fe700 1 -- 172.21.15.80:0/2459692923 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f90f80097d0 con 0x7f910810c890 2019-11-28T11:28:45.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.475+0000 7f910659c700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910810c890 0x7f910810b1d0 secure :-1 s=THROTTLE_DONE pgs=572 cs=0 l=1 rx=0x7f90f8010390 tx=0x7f90f80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.475+0000 7f90ff7fe700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90e001a950 0x7f90e001cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:45.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.475+0000 7f90ff7fe700 1 -- 172.21.15.80:0/2459692923 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f90f8031a10 con 0x7f910810c890 2019-11-28T11:28:45.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.475+0000 7f9106d9d700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90e001a950 0x7f90e001cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:45.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.476+0000 7f9106d9d700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90e001a950 0x7f90e001cde0 crc :-1 s=READY pgs=242 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:45.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.483+0000 7f910c8dd700 1 -- 172.21.15.80:0/2459692923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9108109e10 con 0x7f910810c890 2019-11-28T11:28:45.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.486+0000 7f910659c700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910810c890 0x7f910810b1d0 secure :-1 s=THROTTLE_DONE pgs=572 cs=0 l=1 rx=0x7f90f8010390 tx=0x7f90f80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.486+0000 7f90ff7fe700 1 -- 172.21.15.80:0/2459692923 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f90f80095c0 con 0x7f910810c890 2019-11-28T11:28:45.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.659+0000 7f910c8dd700 1 -- 172.21.15.80:0/2459692923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9108109a90 con 0x7f910810c890 2019-11-28T11:28:45.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.660+0000 7f910659c700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910810c890 0x7f910810b1d0 secure :-1 s=THROTTLE_DONE pgs=572 cs=0 l=1 rx=0x7f90f8010390 tx=0x7f90f80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.660+0000 7f90ff7fe700 1 -- 172.21.15.80:0/2459692923 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+1425 (secure 0 0 0) 0x7f90f800a1d0 con 0x7f910810c890 2019-11-28T11:28:45.689 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 23 2019-11-28T11:28:45.689 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:45.689 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:27.955433+0000","modified":"2019-11-28T11:28:44.773253+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":49,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2019-11-28T11:28:45.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.662+0000 7f910c8dd700 1 -- 172.21.15.80:0/2459692923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90e001a950 msgr2=0x7f90e001cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.662+0000 7f910c8dd700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90e001a950 0x7f90e001cde0 crc :-1 s=READY pgs=242 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:45.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.662+0000 7f910c8dd700 1 -- 172.21.15.80:0/2459692923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910810c890 msgr2=0x7f910810b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.662+0000 7f910c8dd700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910810c890 0x7f910810b1d0 secure :-1 s=READY pgs=572 cs=0 l=1 rx=0x7f90f8010390 tx=0x7f90f80101c0).stop 2019-11-28T11:28:45.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.663+0000 7f910c8dd700 1 -- 172.21.15.80:0/2459692923 shutdown_connections 2019-11-28T11:28:45.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.663+0000 7f910c8dd700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90e001a950 0x7f90e001cde0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:45.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.663+0000 7f910c8dd700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f910810c890 0x7f910810b1d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:45.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.663+0000 7f910c8dd700 1 --2- 172.21.15.80:0/2459692923 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9108104820 0x7f910810c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:45.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.663+0000 7f910c8dd700 1 -- 172.21.15.80:0/2459692923 shutdown_connections 2019-11-28T11:28:45.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.663+0000 7f910c8dd700 1 -- 172.21.15.80:0/2459692923 wait complete. 2019-11-28T11:28:45.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.663+0000 7f910c8dd700 1 -- 172.21.15.80:0/2459692923 >> 172.21.15.80:0/2459692923 conn(0x7f910813d620 msgr2=0x7f910813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:45.701 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:28:45.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.797+0000 7f665a934700 1 Processor -- start 2019-11-28T11:28:45.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.797+0000 7f665a934700 1 -- start start 2019-11-28T11:28:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f665a934700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f665406c0a0 0x7f6654072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f665a934700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66540734e0 0x7f6654071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f665a934700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665406db00 con 0x7f6654072360 2019-11-28T11:28:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f665a934700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f665406f330 con 0x7f66540734e0 2019-11-28T11:28:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f665a934700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66540706c0 con 0x7f665406c0a0 2019-11-28T11:28:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f6653fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66540734e0 0x7f6654071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f66596d2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6654072360 0x7f665406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33056/0 (socket says 172.21.15.80:33056) 2019-11-28T11:28:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f66596d2700 1 -- 172.21.15.80:0/3389106445 learned_addr learned my addr 172.21.15.80:0/3389106445 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f6653fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66540734e0 0x7f6654071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33736/0 (socket says 172.21.15.80:33736) 2019-11-28T11:28:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f6658ed1700 1 --2- 172.21.15.80:0/3389106445 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f665406c0a0 0x7f6654072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f6653fff700 1 -- 172.21.15.80:0/3389106445 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f665406c0a0 msgr2=0x7f6654072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f6653fff700 1 --2- 172.21.15.80:0/3389106445 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f665406c0a0 0x7f6654072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f6653fff700 1 -- 172.21.15.80:0/3389106445 >> v1:172.21.15.80:6789/0 conn(0x7f6654072360 legacy=0x7f665406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f6653fff700 1 -- 172.21.15.80:0/3389106445 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6654070a40 con 0x7f66540734e0 2019-11-28T11:28:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f66537fe700 1 -- 172.21.15.80:0/3389106445 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573086640 0 0) 0x7f664c001150 con 0x7f6654072360 2019-11-28T11:28:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f6653fff700 1 --2- 172.21.15.80:0/3389106445 >> v2:172.21.15.80:3300/0 conn(0x7f66540734e0 0x7f6654071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f664400b2d0 tx=0x7f664400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f6653fff700 1 --2- 172.21.15.80:0/3389106445 >> v2:172.21.15.80:3300/0 conn(0x7f66540734e0 0x7f6654071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f664400b2d0 tx=0x7f664400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f6653fff700 1 --2- 172.21.15.80:0/3389106445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66540734e0 0x7f6654071e20 secure :-1 s=READY pgs=574 cs=0 l=1 rx=0x7f664400b2d0 tx=0x7f664400ba60).ready entity=mon.0 client_cookie=6354fb8a334a0206 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f6653fff700 1 --2- 172.21.15.80:0/3389106445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66540734e0 0x7f6654071e20 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7f664400b2d0 tx=0x7f664400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f66537fe700 1 -- 172.21.15.80:0/3389106445 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6644007590 con 0x7f66540734e0 2019-11-28T11:28:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f6653fff700 1 --2- 172.21.15.80:0/3389106445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66540734e0 0x7f6654071e20 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7f664400b2d0 tx=0x7f664400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f66537fe700 1 -- 172.21.15.80:0/3389106445 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6644009b40 con 0x7f66540734e0 2019-11-28T11:28:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f6653fff700 1 --2- 172.21.15.80:0/3389106445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66540734e0 0x7f6654071e20 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7f664400b2d0 tx=0x7f664400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f66537fe700 1 -- 172.21.15.80:0/3389106445 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6644009d30 con 0x7f66540734e0 2019-11-28T11:28:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f665a934700 1 -- 172.21.15.80:0/3389106445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66540734e0 msgr2=0x7f6654071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.798+0000 7f665a934700 1 --2- 172.21.15.80:0/3389106445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66540734e0 0x7f6654071e20 secure :-1 s=READY pgs=574 cs=0 l=1 rx=0x7f664400b2d0 tx=0x7f664400ba60).stop 2019-11-28T11:28:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.799+0000 7f665a934700 1 -- 172.21.15.80:0/3389106445 shutdown_connections 2019-11-28T11:28:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.799+0000 7f665a934700 1 --2- 172.21.15.80:0/3389106445 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66540734e0 0x7f6654071e20 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.799+0000 7f665a934700 1 --2- 172.21.15.80:0/3389106445 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f665406c0a0 0x7f6654072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.799+0000 7f665a934700 1 -- 172.21.15.80:0/3389106445 shutdown_connections 2019-11-28T11:28:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.799+0000 7f665a934700 1 -- 172.21.15.80:0/3389106445 wait complete. 2019-11-28T11:28:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.799+0000 7f665a934700 1 -- 172.21.15.80:0/3389106445 >> 172.21.15.80:0/3389106445 conn(0x7f6654061cf0 msgr2=0x7f6654064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:45.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.801+0000 7f665a934700 1 Processor -- start 2019-11-28T11:28:45.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.801+0000 7f665a934700 1 -- start start 2019-11-28T11:28:45.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.802+0000 7f665a934700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f665413e7b0 0x7f665412abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:45.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.802+0000 7f665a934700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6654139e00 con 0x7f665413e320 2019-11-28T11:28:45.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.802+0000 7f665a934700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665413b4e0 con 0x7f665415fdf0 2019-11-28T11:28:45.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.802+0000 7f665a934700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6654108820 con 0x7f665413e7b0 2019-11-28T11:28:45.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f6653fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f665413e320 0x7f665412a3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33062/0 (socket says 172.21.15.80:33062) 2019-11-28T11:28:45.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f6653fff700 1 -- 172.21.15.80:0/2443811086 learned_addr learned my addr 172.21.15.80:0/2443811086 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:45.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66596d2700 1 --2- 172.21.15.80:0/2443811086 >> v2:172.21.15.174:3300/0 conn(0x7f665413e7b0 0x7f665412abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:45.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66517fa700 1 -- 172.21.15.80:0/2443811086 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647758566 0 0) 0x7f6644009b10 con 0x7f665413e320 2019-11-28T11:28:45.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66517fa700 1 -- 172.21.15.80:0/2443811086 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6638002e80 con 0x7f665413e320 2019-11-28T11:28:45.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66517fa700 1 -- 172.21.15.80:0/2443811086 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009364016 0 0) 0x7f663c000f30 con 0x7f665415fdf0 2019-11-28T11:28:45.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66517fa700 1 -- 172.21.15.80:0/2443811086 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66380030b0 con 0x7f665415fdf0 2019-11-28T11:28:45.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66517fa700 1 -- 172.21.15.80:0/2443811086 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1298361959 0 0) 0x7f664400a140 con 0x7f665413e320 2019-11-28T11:28:45.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66517fa700 1 -- 172.21.15.80:0/2443811086 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f66380033c0 con 0x7f665413e320 2019-11-28T11:28:45.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66517fa700 1 -- 172.21.15.80:0/2443811086 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f6644000d40 con 0x7f665413e320 2019-11-28T11:28:45.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66596d2700 1 -- 172.21.15.80:0/2443811086 >> v1:172.21.15.174:6789/0 conn(0x7f665415fdf0 legacy=0x7f665412b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66596d2700 1 -- 172.21.15.80:0/2443811086 >> v1:172.21.15.80:6789/0 conn(0x7f665413e320 legacy=0x7f665412a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:45.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66596d2700 1 -- 172.21.15.80:0/2443811086 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665410a8c0 con 0x7f665413e7b0 2019-11-28T11:28:45.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66596d2700 1 --2- 172.21.15.80:0/2443811086 >> v2:172.21.15.174:3300/0 conn(0x7f665413e7b0 0x7f665412abc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f664c0103a0 tx=0x7f664c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66596d2700 1 --2- 172.21.15.80:0/2443811086 >> v2:172.21.15.174:3300/0 conn(0x7f665413e7b0 0x7f665412abc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f664c0103a0 tx=0x7f664c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66596d2700 1 --2- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665413e7b0 0x7f665412abc0 secure :-1 s=READY pgs=338 cs=0 l=1 rx=0x7f664c0103a0 tx=0x7f664c010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:45.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66596d2700 1 --2- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665413e7b0 0x7f665412abc0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f664c0103a0 tx=0x7f664c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66517fa700 1 -- 172.21.15.80:0/2443811086 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f664c001570 con 0x7f665413e7b0 2019-11-28T11:28:45.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66596d2700 1 --2- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665413e7b0 0x7f665412abc0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f664c0103a0 tx=0x7f664c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66596d2700 1 --2- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665413e7b0 0x7f665412abc0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f664c0103a0 tx=0x7f664c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66517fa700 1 -- 172.21.15.80:0/2443811086 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664c000940 con 0x7f665413e7b0 2019-11-28T11:28:45.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f665a934700 1 -- 172.21.15.80:0/2443811086 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665410a8c0 con 0x7f665413e7b0 2019-11-28T11:28:45.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.803+0000 7f66517fa700 1 -- 172.21.15.80:0/2443811086 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f664c001b50 con 0x7f665413e7b0 2019-11-28T11:28:45.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.804+0000 7f665a934700 1 -- 172.21.15.80:0/2443811086 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665410a8c0 con 0x7f665413e7b0 2019-11-28T11:28:45.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.804+0000 7f66596d2700 1 --2- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665413e7b0 0x7f665412abc0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f664c0103a0 tx=0x7f664c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.804+0000 7f66517fa700 1 -- 172.21.15.80:0/2443811086 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f664c001190 con 0x7f665413e7b0 2019-11-28T11:28:45.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.804+0000 7f66596d2700 1 --2- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665413e7b0 0x7f665412abc0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f664c0103a0 tx=0x7f664c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.804+0000 7f66517fa700 1 --2- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66380187a0 0x7f663801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:45.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.804+0000 7f66517fa700 1 -- 172.21.15.80:0/2443811086 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f664c031a80 con 0x7f665413e7b0 2019-11-28T11:28:45.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.804+0000 7f6658ed1700 1 --2- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66380187a0 0x7f663801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:45.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.805+0000 7f6658ed1700 1 --2- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66380187a0 0x7f663801abf0 crc :-1 s=READY pgs=243 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:45.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.812+0000 7f665a934700 1 -- 172.21.15.80:0/2443811086 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6654109180 con 0x7f665413e7b0 2019-11-28T11:28:45.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.815+0000 7f66596d2700 1 --2- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665413e7b0 0x7f665412abc0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f664c0103a0 tx=0x7f664c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:45.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.816+0000 7f66517fa700 1 -- 172.21.15.80:0/2443811086 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f664c023c10 con 0x7f665413e7b0 2019-11-28T11:28:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:45.986+0000 7f665a934700 1 -- 172.21.15.80:0/2443811086 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6654109500 con 0x7f665413e7b0 2019-11-28T11:28:46.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.781+0000 7f66596d2700 1 --2- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665413e7b0 0x7f665412abc0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f664c0103a0 tx=0x7f664c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:46.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.781+0000 7f66517fa700 1 -- 172.21.15.80:0/2443811086 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f664c023c10 con 0x7f665413e7b0 2019-11-28T11:28:46.829 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:28:46.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.803+0000 7f665a934700 1 -- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66380187a0 msgr2=0x7f663801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:46.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.803+0000 7f665a934700 1 --2- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66380187a0 0x7f663801abf0 crc :-1 s=READY pgs=243 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:46.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.803+0000 7f665a934700 1 -- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665413e7b0 msgr2=0x7f665412abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:46.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.803+0000 7f665a934700 1 --2- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665413e7b0 0x7f665412abc0 secure :-1 s=READY pgs=338 cs=0 l=1 rx=0x7f664c0103a0 tx=0x7f664c010740).stop 2019-11-28T11:28:46.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.803+0000 7f665a934700 1 -- 172.21.15.80:0/2443811086 shutdown_connections 2019-11-28T11:28:46.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.803+0000 7f665a934700 1 --2- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f665413e7b0 0x7f665412abc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:46.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.803+0000 7f665a934700 1 --2- 172.21.15.80:0/2443811086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66380187a0 0x7f663801abf0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:46.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.804+0000 7f665a934700 1 -- 172.21.15.80:0/2443811086 shutdown_connections 2019-11-28T11:28:46.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.804+0000 7f665a934700 1 -- 172.21.15.80:0/2443811086 wait complete. 2019-11-28T11:28:46.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.804+0000 7f665a934700 1 -- 172.21.15.80:0/2443811086 >> 172.21.15.80:0/2443811086 conn(0x7f6654127dc0 msgr2=0x7f6654141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:46.842 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:28:46.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.933+0000 7f90791b8700 1 Processor -- start 2019-11-28T11:28:46.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.933+0000 7f90791b8700 1 -- start start 2019-11-28T11:28:46.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f90791b8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f907406c490 0x7f907406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:46.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f90791b8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f907406ce60 0x7f9074164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:46.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f90791b8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f907406db00 con 0x7f907406c0a0 2019-11-28T11:28:46.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f90791b8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907406fd60 con 0x7f907406ce60 2019-11-28T11:28:46.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f90791b8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9074070030 con 0x7f907406c490 2019-11-28T11:28:46.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f907359e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f907406c0a0 0x7f9074072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33066/0 (socket says 172.21.15.80:33066) 2019-11-28T11:28:46.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f907359e700 1 -- 172.21.15.80:0/568503791 learned_addr learned my addr 172.21.15.80:0/568503791 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:46.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f90789b7700 1 --2- 172.21.15.80:0/568503791 >> v2:172.21.15.174:3300/0 conn(0x7f907406ce60 0x7f9074164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:46.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f9072d9d700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f907406c490 0x7f907406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:46.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f907259c700 1 -- 172.21.15.80:0/568503791 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874432207 0 0) 0x7f905c001150 con 0x7f907406c0a0 2019-11-28T11:28:46.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f907259c700 1 -- 172.21.15.80:0/568503791 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9060002e80 con 0x7f907406c0a0 2019-11-28T11:28:46.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f907259c700 1 -- 172.21.15.80:0/568503791 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3697737691 0 0) 0x7f905c001130 con 0x7f907406c0a0 2019-11-28T11:28:46.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f907259c700 1 -- 172.21.15.80:0/568503791 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f907406c490 msgr2=0x7f907406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:46.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f907259c700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f907406c490 0x7f907406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:46.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f907259c700 1 -- 172.21.15.80:0/568503791 >> v2:172.21.15.174:3300/0 conn(0x7f907406ce60 msgr2=0x7f9074164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:46.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f907259c700 1 --2- 172.21.15.80:0/568503791 >> v2:172.21.15.174:3300/0 conn(0x7f907406ce60 0x7f9074164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:46.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f907259c700 1 -- 172.21.15.80:0/568503791 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90740706c0 con 0x7f907406c0a0 2019-11-28T11:28:46.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.934+0000 7f907259c700 1 -- 172.21.15.80:0/568503791 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f905c001660 con 0x7f907406c0a0 2019-11-28T11:28:46.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f907259c700 1 -- 172.21.15.80:0/568503791 >> v1:172.21.15.80:6789/0 conn(0x7f907406c0a0 legacy=0x7f9074072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:46.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f907259c700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9060047a80 0x7f9060049ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:46.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f907259c700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906004a660 0x7f906004cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:46.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f907259c700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f906004d390 0x7f906004f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:46.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f907259c700 1 -- 172.21.15.80:0/568503791 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906004ffe0 con 0x7f906004a660 2019-11-28T11:28:46.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f907259c700 1 -- 172.21.15.80:0/568503791 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90600501d0 con 0x7f9060047a80 2019-11-28T11:28:46.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f907259c700 1 -- 172.21.15.80:0/568503791 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9060050400 con 0x7f906004d390 2019-11-28T11:28:46.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f90789b7700 1 --2- 172.21.15.80:0/568503791 >> v2:172.21.15.174:3300/0 conn(0x7f907406ce60 0x7f9074164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:46.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f9072d9d700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906004a660 0x7f906004cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:46.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f907359e700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9060047a80 0x7f9060049ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:46.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f90789b7700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f906004d390 0x7f906004f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:46.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f9072d9d700 1 -- 172.21.15.80:0/568503791 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f906004d390 msgr2=0x7f906004f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:46.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f9072d9d700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f906004d390 0x7f906004f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:46.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f9072d9d700 1 -- 172.21.15.80:0/568503791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9060047a80 msgr2=0x7f9060049ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:46.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f9072d9d700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9060047a80 0x7f9060049ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:46.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f9072d9d700 1 -- 172.21.15.80:0/568503791 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90600506b0 con 0x7f906004a660 2019-11-28T11:28:46.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f90789b7700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f906004d390 0x7f906004f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:46.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f9072d9d700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906004a660 0x7f906004cb30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f906400f630 tx=0x7f9064002b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:46.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f9072d9d700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906004a660 0x7f906004cb30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f906400f630 tx=0x7f9064002b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:46.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f9072d9d700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906004a660 0x7f906004cb30 secure :-1 s=READY pgs=577 cs=0 l=1 rx=0x7f906400f630 tx=0x7f9064002b70).ready entity=mon.0 client_cookie=8815beb3f6e1932a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:46.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f9072d9d700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906004a660 0x7f906004cb30 secure :-1 s=THROTTLE_DONE pgs=577 cs=0 l=1 rx=0x7f906400f630 tx=0x7f9064002b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:46.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f907259c700 1 -- 172.21.15.80:0/568503791 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9064000960 con 0x7f906004a660 2019-11-28T11:28:46.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f9072d9d700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906004a660 0x7f906004cb30 secure :-1 s=THROTTLE_DONE pgs=577 cs=0 l=1 rx=0x7f906400f630 tx=0x7f9064002b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:46.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f9072d9d700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906004a660 0x7f906004cb30 secure :-1 s=THROTTLE_DONE pgs=577 cs=0 l=1 rx=0x7f906400f630 tx=0x7f9064002b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:46.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f907259c700 1 -- 172.21.15.80:0/568503791 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9064000e80 con 0x7f906004a660 2019-11-28T11:28:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f907259c700 1 -- 172.21.15.80:0/568503791 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9064001550 con 0x7f906004a660 2019-11-28T11:28:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f90791b8700 1 -- 172.21.15.80:0/568503791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906004a660 msgr2=0x7f906004cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f90791b8700 1 --2- 172.21.15.80:0/568503791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f906004a660 0x7f906004cb30 secure :-1 s=READY pgs=577 cs=0 l=1 rx=0x7f906400f630 tx=0x7f9064002b70).stop 2019-11-28T11:28:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.935+0000 7f90789b7700 1 -- 172.21.15.80:0/568503791 reap_dead start 2019-11-28T11:28:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.936+0000 7f90791b8700 1 -- 172.21.15.80:0/568503791 shutdown_connections 2019-11-28T11:28:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.936+0000 7f90791b8700 1 -- 172.21.15.80:0/568503791 shutdown_connections 2019-11-28T11:28:46.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.936+0000 7f90791b8700 1 -- 172.21.15.80:0/568503791 wait complete. 2019-11-28T11:28:46.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.936+0000 7f90791b8700 1 -- 172.21.15.80:0/568503791 >> 172.21.15.80:0/568503791 conn(0x7f9074061cf0 msgr2=0x7f9074064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:46.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.938+0000 7f90791b8700 1 Processor -- start 2019-11-28T11:28:46.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.939+0000 7f90791b8700 1 -- start start 2019-11-28T11:28:46.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.939+0000 7f90791b8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f907410ced0 0x7f907410d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:46.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.939+0000 7f90791b8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f907410d8a0 0x7f9074164c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:46.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.939+0000 7f90791b8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f907410fa50 con 0x7f907413fb20 2019-11-28T11:28:46.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.939+0000 7f90791b8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90741073b0 con 0x7f907410ced0 2019-11-28T11:28:46.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.939+0000 7f90791b8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9074106980 con 0x7f907410d8a0 2019-11-28T11:28:46.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f9072d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f907410ced0 0x7f907410d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:46.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f9072d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f907410ced0 0x7f907410d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33764/0 (socket says 172.21.15.80:33764) 2019-11-28T11:28:46.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f9072d9d700 1 -- 172.21.15.80:0/1409698863 learned_addr learned my addr 172.21.15.80:0/1409698863 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:46.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f90789b7700 1 --2- 172.21.15.80:0/1409698863 >> v2:172.21.15.174:3300/0 conn(0x7f907410d8a0 0x7f9074164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:46.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f9072d9d700 1 -- 172.21.15.80:0/1409698863 >> v2:172.21.15.174:3300/0 conn(0x7f907410d8a0 msgr2=0x7f9074164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:46.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f9072d9d700 1 --2- 172.21.15.80:0/1409698863 >> v2:172.21.15.174:3300/0 conn(0x7f907410d8a0 0x7f9074164c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f9072d9d700 1 -- 172.21.15.80:0/1409698863 >> v1:172.21.15.174:6789/0 conn(0x7f907413fb20 legacy=0x7f907410df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f906bfff700 1 -- 172.21.15.80:0/1409698863 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037502295 0 0) 0x7f905c001900 con 0x7f907413fb20 2019-11-28T11:28:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f9072d9d700 1 -- 172.21.15.80:0/1409698863 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907413a950 con 0x7f907410ced0 2019-11-28T11:28:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f9072d9d700 1 --2- 172.21.15.80:0/1409698863 >> v2:172.21.15.80:3300/0 conn(0x7f907410ced0 0x7f907410d360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9064010440 tx=0x7f9064010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f9072d9d700 1 --2- 172.21.15.80:0/1409698863 >> v2:172.21.15.80:3300/0 conn(0x7f907410ced0 0x7f907410d360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9064010440 tx=0x7f9064010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f9072d9d700 1 --2- 172.21.15.80:0/1409698863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907410ced0 0x7f907410d360 secure :-1 s=READY pgs=578 cs=0 l=1 rx=0x7f9064010440 tx=0x7f9064010240).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f9072d9d700 1 --2- 172.21.15.80:0/1409698863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907410ced0 0x7f907410d360 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7f9064010440 tx=0x7f9064010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:46.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f906bfff700 1 -- 172.21.15.80:0/1409698863 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9064009240 con 0x7f907410ced0 2019-11-28T11:28:46.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f9072d9d700 1 --2- 172.21.15.80:0/1409698863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907410ced0 0x7f907410d360 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7f9064010440 tx=0x7f9064010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:46.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f9072d9d700 1 --2- 172.21.15.80:0/1409698863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907410ced0 0x7f907410d360 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7f9064010440 tx=0x7f9064010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:46.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f906bfff700 1 -- 172.21.15.80:0/1409698863 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9064000c70 con 0x7f907410ced0 2019-11-28T11:28:46.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f90791b8700 1 -- 172.21.15.80:0/1409698863 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907413acd0 con 0x7f907410ced0 2019-11-28T11:28:46.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f906bfff700 1 -- 172.21.15.80:0/1409698863 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9064001300 con 0x7f907410ced0 2019-11-28T11:28:46.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.940+0000 7f90791b8700 1 -- 172.21.15.80:0/1409698863 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907413a950 con 0x7f907410ced0 2019-11-28T11:28:46.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.941+0000 7f9072d9d700 1 --2- 172.21.15.80:0/1409698863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907410ced0 0x7f907410d360 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7f9064010440 tx=0x7f9064010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:46.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.941+0000 7f906bfff700 1 -- 172.21.15.80:0/1409698863 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9064002960 con 0x7f907410ced0 2019-11-28T11:28:46.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.941+0000 7f9072d9d700 1 --2- 172.21.15.80:0/1409698863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907410ced0 0x7f907410d360 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7f9064010440 tx=0x7f9064010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:46.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.941+0000 7f906bfff700 1 --2- 172.21.15.80:0/1409698863 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9058018730 0x7f905801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:46.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.941+0000 7f906bfff700 1 -- 172.21.15.80:0/1409698863 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f9064031ae0 con 0x7f907410ced0 2019-11-28T11:28:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.941+0000 7f907359e700 1 --2- 172.21.15.80:0/1409698863 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9058018730 0x7f905801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.941+0000 7f907359e700 1 --2- 172.21.15.80:0/1409698863 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9058018730 0x7f905801abc0 crc :-1 s=READY pgs=244 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:46.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.948+0000 7f90791b8700 1 -- 172.21.15.80:0/1409698863 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907413acd0 con 0x7f907410ced0 2019-11-28T11:28:46.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.951+0000 7f9072d9d700 1 --2- 172.21.15.80:0/1409698863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907410ced0 0x7f907410d360 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7f9064010440 tx=0x7f9064010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:46.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:46.952+0000 7f906bfff700 1 -- 172.21.15.80:0/1409698863 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9064009240 con 0x7f907410ced0 2019-11-28T11:28:47.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.124+0000 7f90791b8700 1 -- 172.21.15.80:0/1409698863 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f907413a950 con 0x7f907410ced0 2019-11-28T11:28:47.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.124+0000 7f9072d9d700 1 --2- 172.21.15.80:0/1409698863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907410ced0 0x7f907410d360 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7f9064010440 tx=0x7f9064010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.124+0000 7f906bfff700 1 -- 172.21.15.80:0/1409698863 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+1425 (secure 0 0 0) 0x7f9064002960 con 0x7f907410ced0 2019-11-28T11:28:47.154 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2019-11-28T11:28:47.154 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:47.154 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":24,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:27.955433+0000","modified":"2019-11-28T11:28:46.777905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":49,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2019-11-28T11:28:47.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.127+0000 7f90791b8700 1 -- 172.21.15.80:0/1409698863 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9058018730 msgr2=0x7f905801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:47.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.127+0000 7f90791b8700 1 --2- 172.21.15.80:0/1409698863 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9058018730 0x7f905801abc0 crc :-1 s=READY pgs=244 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:47.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.127+0000 7f90791b8700 1 -- 172.21.15.80:0/1409698863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907410ced0 msgr2=0x7f907410d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:47.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.127+0000 7f90791b8700 1 --2- 172.21.15.80:0/1409698863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907410ced0 0x7f907410d360 secure :-1 s=READY pgs=578 cs=0 l=1 rx=0x7f9064010440 tx=0x7f9064010240).stop 2019-11-28T11:28:47.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.127+0000 7f90791b8700 1 -- 172.21.15.80:0/1409698863 shutdown_connections 2019-11-28T11:28:47.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.127+0000 7f90791b8700 1 --2- 172.21.15.80:0/1409698863 >> v2:172.21.15.174:3300/0 conn(0x7f907410d8a0 0x7f9074164c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:47.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.127+0000 7f90791b8700 1 --2- 172.21.15.80:0/1409698863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f907410ced0 0x7f907410d360 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:47.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.127+0000 7f90791b8700 1 --2- 172.21.15.80:0/1409698863 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9058018730 0x7f905801abc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:47.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.127+0000 7f90791b8700 1 -- 172.21.15.80:0/1409698863 shutdown_connections 2019-11-28T11:28:47.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.127+0000 7f90791b8700 1 -- 172.21.15.80:0/1409698863 wait complete. 2019-11-28T11:28:47.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.127+0000 7f90791b8700 1 -- 172.21.15.80:0/1409698863 >> 172.21.15.80:0/1409698863 conn(0x7f9074142090 msgr2=0x7f907410ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:47.165 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:28:47.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.261+0000 7fc859240700 1 Processor -- start 2019-11-28T11:28:47.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.261+0000 7fc859240700 1 -- start start 2019-11-28T11:28:47.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.261+0000 7fc859240700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc85406c0a0 0x7fc854072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:47.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc859240700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc8540734e0 0x7fc854071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:47.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc859240700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85406db00 con 0x7fc854072360 2019-11-28T11:28:47.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc859240700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85406f330 con 0x7fc8540734e0 2019-11-28T11:28:47.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc859240700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8540706c0 con 0x7fc85406c0a0 2019-11-28T11:28:47.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc858a3f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc854072360 0x7fc85406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33088/0 (socket says 172.21.15.80:33088) 2019-11-28T11:28:47.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc858a3f700 1 -- 172.21.15.80:0/3963390007 learned_addr learned my addr 172.21.15.80:0/3963390007 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:47.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85359e700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc85406c0a0 0x7fc854072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:47.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc852d9d700 1 --2- 172.21.15.80:0/3963390007 >> v2:172.21.15.174:3300/0 conn(0x7fc8540734e0 0x7fc854071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85259c700 1 -- 172.21.15.80:0/3963390007 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858913840 0 0) 0x7fc844001150 con 0x7fc854072360 2019-11-28T11:28:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85259c700 1 -- 172.21.15.80:0/3963390007 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc834002e80 con 0x7fc854072360 2019-11-28T11:28:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85259c700 1 -- 172.21.15.80:0/3963390007 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3231475595 0 0) 0x7fc844001130 con 0x7fc854072360 2019-11-28T11:28:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85259c700 1 -- 172.21.15.80:0/3963390007 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc85406c0a0 msgr2=0x7fc854072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:47.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85259c700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc85406c0a0 0x7fc854072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:47.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85259c700 1 -- 172.21.15.80:0/3963390007 >> v2:172.21.15.174:3300/0 conn(0x7fc8540734e0 msgr2=0x7fc854071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:47.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85259c700 1 --2- 172.21.15.80:0/3963390007 >> v2:172.21.15.174:3300/0 conn(0x7fc8540734e0 0x7fc854071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:47.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85259c700 1 -- 172.21.15.80:0/3963390007 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc854070a40 con 0x7fc854072360 2019-11-28T11:28:47.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85259c700 1 -- 172.21.15.80:0/3963390007 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc844001660 con 0x7fc854072360 2019-11-28T11:28:47.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85259c700 1 -- 172.21.15.80:0/3963390007 >> v1:172.21.15.80:6789/0 conn(0x7fc854072360 legacy=0x7fc85406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:47.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85259c700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8340479e0 0x7fc834049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:47.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85259c700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc83404a5f0 0x7fc83404caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:47.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85259c700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc83404d300 0x7fc83404f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:47.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85259c700 1 -- 172.21.15.80:0/3963390007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83404ff50 con 0x7fc83404a5f0 2019-11-28T11:28:47.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85259c700 1 -- 172.21.15.80:0/3963390007 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc834050140 con 0x7fc8340479e0 2019-11-28T11:28:47.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc85259c700 1 -- 172.21.15.80:0/3963390007 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc834050370 con 0x7fc83404d300 2019-11-28T11:28:47.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.262+0000 7fc852d9d700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc83404a5f0 0x7fc83404caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:47.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc85359e700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8340479e0 0x7fc834049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:47.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc858a3f700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc83404d300 0x7fc83404f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:47.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc852d9d700 1 -- 172.21.15.80:0/3963390007 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc83404d300 msgr2=0x7fc83404f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:47.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc852d9d700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc83404d300 0x7fc83404f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:47.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc852d9d700 1 -- 172.21.15.80:0/3963390007 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8340479e0 msgr2=0x7fc834049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:47.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc852d9d700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8340479e0 0x7fc834049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:47.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc852d9d700 1 -- 172.21.15.80:0/3963390007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc834050620 con 0x7fc83404a5f0 2019-11-28T11:28:47.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc85359e700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8340479e0 0x7fc834049e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:47.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc852d9d700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc83404a5f0 0x7fc83404caa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc84c00b6e0 tx=0x7fc84c00b530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc852d9d700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc83404a5f0 0x7fc83404caa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc84c00b6e0 tx=0x7fc84c00b530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc852d9d700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc83404a5f0 0x7fc83404caa0 secure :-1 s=READY pgs=580 cs=0 l=1 rx=0x7fc84c00b6e0 tx=0x7fc84c00b530).ready entity=mon.0 client_cookie=394dd1e862e964c9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:47.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc852d9d700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc83404a5f0 0x7fc83404caa0 secure :-1 s=THROTTLE_DONE pgs=580 cs=0 l=1 rx=0x7fc84c00b6e0 tx=0x7fc84c00b530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc85259c700 1 -- 172.21.15.80:0/3963390007 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc84c000960 con 0x7fc83404a5f0 2019-11-28T11:28:47.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc852d9d700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc83404a5f0 0x7fc83404caa0 secure :-1 s=THROTTLE_DONE pgs=580 cs=0 l=1 rx=0x7fc84c00b6e0 tx=0x7fc84c00b530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc852d9d700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc83404a5f0 0x7fc83404caa0 secure :-1 s=THROTTLE_DONE pgs=580 cs=0 l=1 rx=0x7fc84c00b6e0 tx=0x7fc84c00b530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc85259c700 1 -- 172.21.15.80:0/3963390007 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c009980 con 0x7fc83404a5f0 2019-11-28T11:28:47.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc85259c700 1 -- 172.21.15.80:0/3963390007 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc84c00a050 con 0x7fc83404a5f0 2019-11-28T11:28:47.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc859240700 1 -- 172.21.15.80:0/3963390007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc83404a5f0 msgr2=0x7fc83404caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:47.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc859240700 1 --2- 172.21.15.80:0/3963390007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc83404a5f0 0x7fc83404caa0 secure :-1 s=READY pgs=580 cs=0 l=1 rx=0x7fc84c00b6e0 tx=0x7fc84c00b530).stop 2019-11-28T11:28:47.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.263+0000 7fc858a3f700 1 -- 172.21.15.80:0/3963390007 reap_dead start 2019-11-28T11:28:47.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.264+0000 7fc859240700 1 -- 172.21.15.80:0/3963390007 shutdown_connections 2019-11-28T11:28:47.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.264+0000 7fc859240700 1 -- 172.21.15.80:0/3963390007 shutdown_connections 2019-11-28T11:28:47.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.264+0000 7fc859240700 1 -- 172.21.15.80:0/3963390007 wait complete. 2019-11-28T11:28:47.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.264+0000 7fc859240700 1 -- 172.21.15.80:0/3963390007 >> 172.21.15.80:0/3963390007 conn(0x7fc854061cf0 msgr2=0x7fc854064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:47.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.266+0000 7fc859240700 1 Processor -- start 2019-11-28T11:28:47.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.266+0000 7fc859240700 1 -- start start 2019-11-28T11:28:47.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.267+0000 7fc859240700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc854166d80 0x7fc854169180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:47.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.267+0000 7fc859240700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc854107940 con 0x7fc85410f520 2019-11-28T11:28:47.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.267+0000 7fc859240700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc854106a80 con 0x7fc8541061f0 2019-11-28T11:28:47.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.267+0000 7fc859240700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85410c300 con 0x7fc854166d80 2019-11-28T11:28:47.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.267+0000 7fc852d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc85410f520 0x7fc85413ab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33100/0 (socket says 172.21.15.80:33100) 2019-11-28T11:28:47.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.267+0000 7fc852d9d700 1 -- 172.21.15.80:0/2579962612 learned_addr learned my addr 172.21.15.80:0/2579962612 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:47.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.267+0000 7fc858a3f700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc854166d80 0x7fc854169180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:47.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.267+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132399338 0 0) 0x7fc84c00b2b0 con 0x7fc85410f520 2019-11-28T11:28:47.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.267+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc82c002e80 con 0x7fc85410f520 2019-11-28T11:28:47.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1392129661 0 0) 0x7fc84c000940 con 0x7fc85410f520 2019-11-28T11:28:47.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc82c0032e0 con 0x7fc85410f520 2019-11-28T11:28:47.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721462372 0 0) 0x7fc83c009eb0 con 0x7fc8541061f0 2019-11-28T11:28:47.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc82c005790 con 0x7fc8541061f0 2019-11-28T11:28:47.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc84c009ba0 con 0x7fc85410f520 2019-11-28T11:28:47.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc854166d80 msgr2=0x7fc854169180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:47.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc854166d80 0x7fc854169180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:47.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 >> v1:172.21.15.174:6789/0 conn(0x7fc8541061f0 legacy=0x7fc85413a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:47.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 >> v1:172.21.15.80:6789/0 conn(0x7fc85410f520 legacy=0x7fc85413ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:47.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc82c0032e0 0x7fc82c0036d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:47.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82c003c10 0x7fc82c0040d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:47.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc82c004720 0x7fc82c004be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:47.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0052f0 con 0x7fc82c003c10 2019-11-28T11:28:47.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c00beb0 con 0x7fc82c0032e0 2019-11-28T11:28:47.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c00c070 con 0x7fc82c004720 2019-11-28T11:28:47.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc852d9d700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82c003c10 0x7fc82c0040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:47.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc85359e700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc82c0032e0 0x7fc82c0036d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:47.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc858a3f700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc82c004720 0x7fc82c004be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:47.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc852d9d700 1 -- 172.21.15.80:0/2579962612 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc82c004720 msgr2=0x7fc82c004be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:47.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc852d9d700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc82c004720 0x7fc82c004be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:47.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc852d9d700 1 -- 172.21.15.80:0/2579962612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc82c0032e0 msgr2=0x7fc82c0036d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:47.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc852d9d700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc82c0032e0 0x7fc82c0036d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:47.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc852d9d700 1 -- 172.21.15.80:0/2579962612 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c00c2e0 con 0x7fc82c003c10 2019-11-28T11:28:47.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc859240700 1 -- 172.21.15.80:0/2579962612 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85410cfe0 con 0x7fc82c003c10 2019-11-28T11:28:47.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc852d9d700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82c003c10 0x7fc82c0040d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc84c010440 tx=0x7fc84c010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc859240700 1 -- 172.21.15.80:0/2579962612 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85410cc60 con 0x7fc82c003c10 2019-11-28T11:28:47.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc852d9d700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82c003c10 0x7fc82c0040d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc84c010440 tx=0x7fc84c010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc852d9d700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82c003c10 0x7fc82c0040d0 secure :-1 s=READY pgs=582 cs=0 l=1 rx=0x7fc84c010440 tx=0x7fc84c010340).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:47.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc852d9d700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82c003c10 0x7fc82c0040d0 secure :-1 s=THROTTLE_DONE pgs=582 cs=0 l=1 rx=0x7fc84c010440 tx=0x7fc84c010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc84c000940 con 0x7fc82c003c10 2019-11-28T11:28:47.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc852d9d700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82c003c10 0x7fc82c0040d0 secure :-1 s=THROTTLE_DONE pgs=582 cs=0 l=1 rx=0x7fc84c010440 tx=0x7fc84c010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc852d9d700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82c003c10 0x7fc82c0040d0 secure :-1 s=THROTTLE_DONE pgs=582 cs=0 l=1 rx=0x7fc84c010440 tx=0x7fc84c010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c009f80 con 0x7fc82c003c10 2019-11-28T11:28:47.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.268+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc84c00a650 con 0x7fc82c003c10 2019-11-28T11:28:47.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.269+0000 7fc852d9d700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82c003c10 0x7fc82c0040d0 secure :-1 s=THROTTLE_DONE pgs=582 cs=0 l=1 rx=0x7fc84c010440 tx=0x7fc84c010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.269+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc84c00a870 con 0x7fc82c003c10 2019-11-28T11:28:47.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.269+0000 7fc852d9d700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82c003c10 0x7fc82c0040d0 secure :-1 s=THROTTLE_DONE pgs=582 cs=0 l=1 rx=0x7fc84c010440 tx=0x7fc84c010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.269+0000 7fc84bfff700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc82c020c10 0x7fc82c023040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:47.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.269+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fc84c031c30 con 0x7fc82c003c10 2019-11-28T11:28:47.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.269+0000 7fc85359e700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc82c020c10 0x7fc82c023040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:47.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.270+0000 7fc85359e700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc82c020c10 0x7fc82c023040 crc :-1 s=READY pgs=245 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:47.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.276+0000 7fc859240700 1 -- 172.21.15.80:0/2579962612 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc830002e60 con 0x7fc82c003c10 2019-11-28T11:28:47.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.279+0000 7fc852d9d700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82c003c10 0x7fc82c0040d0 secure :-1 s=THROTTLE_DONE pgs=582 cs=0 l=1 rx=0x7fc84c010440 tx=0x7fc84c010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.279+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc84c009f80 con 0x7fc82c003c10 2019-11-28T11:28:47.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.454+0000 7fc859240700 1 -- 172.21.15.80:0/2579962612 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc830001d30 con 0x7fc82c003c10 2019-11-28T11:28:47.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.782+0000 7fc852d9d700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82c003c10 0x7fc82c0040d0 secure :-1 s=THROTTLE_DONE pgs=582 cs=0 l=1 rx=0x7fc84c010440 tx=0x7fc84c010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.782+0000 7fc84bfff700 1 -- 172.21.15.80:0/2579962612 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc84c009b80 con 0x7fc82c003c10 2019-11-28T11:28:47.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.820+0000 7fc859240700 1 -- 172.21.15.80:0/2579962612 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc82c020c10 msgr2=0x7fc82c023040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:47.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.820+0000 7fc859240700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc82c020c10 0x7fc82c023040 crc :-1 s=READY pgs=245 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:47.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.820+0000 7fc859240700 1 -- 172.21.15.80:0/2579962612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82c003c10 msgr2=0x7fc82c0040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:47.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.820+0000 7fc859240700 1 --2- 172.21.15.80:0/2579962612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82c003c10 0x7fc82c0040d0 secure :-1 s=READY pgs=582 cs=0 l=1 rx=0x7fc84c010440 tx=0x7fc84c010340).stop 2019-11-28T11:28:47.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.820+0000 7fc858a3f700 1 -- 172.21.15.80:0/2579962612 reap_dead start 2019-11-28T11:28:47.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.820+0000 7fc858a3f700 1 -- 172.21.15.80:0/2579962612 reap_dead start 2019-11-28T11:28:47.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.820+0000 7fc859240700 1 -- 172.21.15.80:0/2579962612 shutdown_connections 2019-11-28T11:28:47.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.820+0000 7fc859240700 1 -- 172.21.15.80:0/2579962612 shutdown_connections 2019-11-28T11:28:47.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.820+0000 7fc859240700 1 -- 172.21.15.80:0/2579962612 wait complete. 2019-11-28T11:28:47.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.820+0000 7fc859240700 1 -- 172.21.15.80:0/2579962612 >> 172.21.15.80:0/2579962612 conn(0x7fc854142090 msgr2=0x7fc85410ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:47.859 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:28:47.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.954+0000 7f1ac74cf700 1 Processor -- start 2019-11-28T11:28:47.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.954+0000 7f1ac74cf700 1 -- start start 2019-11-28T11:28:47.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.955+0000 7f1ac74cf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1ac015f100 0x7f1ac006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:47.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.955+0000 7f1ac74cf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac006c2f0 0x7f1ac006c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:47.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.955+0000 7f1ac74cf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac006db60 con 0x7f1ac015ed10 2019-11-28T11:28:47.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.955+0000 7f1ac74cf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac006fe00 con 0x7f1ac015f100 2019-11-28T11:28:47.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.955+0000 7f1ac74cf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac00700d0 con 0x7f1ac006c2f0 2019-11-28T11:28:47.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.955+0000 7f1ac5a6c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1ac015ed10 0x7f1ac0073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33112/0 (socket says 172.21.15.80:33112) 2019-11-28T11:28:47.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.955+0000 7f1ac5a6c700 1 -- 172.21.15.80:0/1134630114 learned_addr learned my addr 172.21.15.80:0/1134630114 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:47.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.955+0000 7f1ac626d700 1 --2- 172.21.15.80:0/1134630114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac006c2f0 0x7f1ac006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:47.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.955+0000 7f1ac526b700 1 --2- 172.21.15.80:0/1134630114 >> v2:172.21.15.174:3300/0 conn(0x7f1ac015f100 0x7f1ac006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:47.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.955+0000 7f1ac4a6a700 1 -- 172.21.15.80:0/1134630114 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925505381 0 0) 0x7f1ab00014d0 con 0x7f1ac015ed10 2019-11-28T11:28:47.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac4a6a700 1 -- 172.21.15.80:0/1134630114 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa8002e80 con 0x7f1ac015ed10 2019-11-28T11:28:47.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac4a6a700 1 -- 172.21.15.80:0/1134630114 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 624771862 0 0) 0x7f1ab00014b0 con 0x7f1ac015ed10 2019-11-28T11:28:47.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac626d700 1 -- 172.21.15.80:0/1134630114 >> v2:172.21.15.174:3300/0 conn(0x7f1ac015f100 msgr2=0x7f1ac006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:47.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac626d700 1 --2- 172.21.15.80:0/1134630114 >> v2:172.21.15.174:3300/0 conn(0x7f1ac015f100 0x7f1ac006bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:47.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac626d700 1 -- 172.21.15.80:0/1134630114 >> v1:172.21.15.80:6789/0 conn(0x7f1ac015ed10 legacy=0x7f1ac0073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:47.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac626d700 1 -- 172.21.15.80:0/1134630114 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac0070760 con 0x7f1ac006c2f0 2019-11-28T11:28:47.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac526b700 1 --2- 172.21.15.80:0/1134630114 >> v2:172.21.15.174:3300/0 conn(0x7f1ac015f100 0x7f1ac006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:47.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac626d700 1 --2- 172.21.15.80:0/1134630114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac006c2f0 0x7f1ac006c740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1ab800af80 tx=0x7f1ab800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac626d700 1 --2- 172.21.15.80:0/1134630114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac006c2f0 0x7f1ac006c740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1ab800af80 tx=0x7f1ab800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac626d700 1 --2- 172.21.15.80:0/1134630114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac006c2f0 0x7f1ac006c740 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f1ab800af80 tx=0x7f1ab800b790).ready entity=mon.2 client_cookie=64c2f609e443aad8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:47.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac626d700 1 --2- 172.21.15.80:0/1134630114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac006c2f0 0x7f1ac006c740 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f1ab800af80 tx=0x7f1ab800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac4a6a700 1 -- 172.21.15.80:0/1134630114 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab8000bc0 con 0x7f1ac006c2f0 2019-11-28T11:28:47.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac626d700 1 --2- 172.21.15.80:0/1134630114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac006c2f0 0x7f1ac006c740 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f1ab800af80 tx=0x7f1ab800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac626d700 1 --2- 172.21.15.80:0/1134630114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac006c2f0 0x7f1ac006c740 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f1ab800af80 tx=0x7f1ab800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:47.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac4a6a700 1 -- 172.21.15.80:0/1134630114 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab80097f0 con 0x7f1ac006c2f0 2019-11-28T11:28:47.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac4a6a700 1 -- 172.21.15.80:0/1134630114 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab8009ec0 con 0x7f1ac006c2f0 2019-11-28T11:28:47.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac74cf700 1 -- 172.21.15.80:0/1134630114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac006c2f0 msgr2=0x7f1ac006c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:47.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.956+0000 7f1ac74cf700 1 --2- 172.21.15.80:0/1134630114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac006c2f0 0x7f1ac006c740 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f1ab800af80 tx=0x7f1ab800b790).stop 2019-11-28T11:28:47.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.957+0000 7f1ac74cf700 1 -- 172.21.15.80:0/1134630114 shutdown_connections 2019-11-28T11:28:47.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.957+0000 7f1ac74cf700 1 --2- 172.21.15.80:0/1134630114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac006c2f0 0x7f1ac006c740 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:47.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.957+0000 7f1ac74cf700 1 --2- 172.21.15.80:0/1134630114 >> v2:172.21.15.174:3300/0 conn(0x7f1ac015f100 0x7f1ac006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:47.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.957+0000 7f1ac74cf700 1 -- 172.21.15.80:0/1134630114 shutdown_connections 2019-11-28T11:28:47.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.957+0000 7f1ac74cf700 1 -- 172.21.15.80:0/1134630114 wait complete. 2019-11-28T11:28:47.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.957+0000 7f1ac74cf700 1 -- 172.21.15.80:0/1134630114 >> 172.21.15.80:0/1134630114 conn(0x7f1ac0061d20 msgr2=0x7f1ac00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:47.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.960+0000 7f1ac74cf700 1 Processor -- start 2019-11-28T11:28:47.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.960+0000 7f1ac74cf700 1 -- start start 2019-11-28T11:28:47.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.960+0000 7f1ac74cf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac0148320 0x7f1ac010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:47.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.960+0000 7f1ac74cf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1ac010e3d0 0x7f1ac0168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:47.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.960+0000 7f1ac74cf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac0148e00 con 0x7f1ac010f290 2019-11-28T11:28:47.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.960+0000 7f1ac74cf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac0139ff0 con 0x7f1ac010e3d0 2019-11-28T11:28:47.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.960+0000 7f1ac74cf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac013aa20 con 0x7f1ac0148320 2019-11-28T11:28:47.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1ac526b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1ac010f290 0x7f1ac010dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33122/0 (socket says 172.21.15.80:33122) 2019-11-28T11:28:48.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1ac526b700 1 -- 172.21.15.80:0/3327523201 learned_addr learned my addr 172.21.15.80:0/3327523201 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:48.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739192110 0 0) 0x7f1ab400dd90 con 0x7f1ac010f290 2019-11-28T11:28:48.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1ac5a6c700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac0148320 0x7f1ac010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:48.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1ac626d700 1 --2- 172.21.15.80:0/3327523201 >> v2:172.21.15.174:3300/0 conn(0x7f1ac010e3d0 0x7f1ac0168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:48.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa0002e80 con 0x7f1ac010f290 2019-11-28T11:28:48.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3548955023 0 0) 0x7f1ab40010a0 con 0x7f1ac010f290 2019-11-28T11:28:48.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1aa00032e0 con 0x7f1ac010f290 2019-11-28T11:28:48.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f1ab4001670 con 0x7f1ac010f290 2019-11-28T11:28:48.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac0148320 msgr2=0x7f1ac010ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:48.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1abe7fc700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac0148320 0x7f1ac010ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:48.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 >> v2:172.21.15.174:3300/0 conn(0x7f1ac010e3d0 msgr2=0x7f1ac0168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:48.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1abe7fc700 1 --2- 172.21.15.80:0/3327523201 >> v2:172.21.15.174:3300/0 conn(0x7f1ac010e3d0 0x7f1ac0168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:48.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 >> v1:172.21.15.80:6789/0 conn(0x7f1ac010f290 legacy=0x7f1ac010dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:48.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1abe7fc700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aa0003350 0x7f1aa0003780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:48.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1abe7fc700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aa0003cc0 0x7f1aa0004180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:48.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1abe7fc700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aa0004940 0x7f1aa0004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:48.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa000bbf0 con 0x7f1aa0003350 2019-11-28T11:28:48.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa000bde0 con 0x7f1aa0003cc0 2019-11-28T11:28:48.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa000c010 con 0x7f1aa0004940 2019-11-28T11:28:48.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1ac626d700 1 --2- 172.21.15.80:0/3327523201 >> v2:172.21.15.174:3300/0 conn(0x7f1ac010e3d0 0x7f1ac0168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:48.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1ac5a6c700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aa0003350 0x7f1aa0003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:48.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1ac526b700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aa0003cc0 0x7f1aa0004180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1ac626d700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aa0004940 0x7f1aa0004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1ac5a6c700 1 -- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aa0004940 msgr2=0x7f1aa0004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1ac5a6c700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aa0004940 0x7f1aa0004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1ac5a6c700 1 -- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aa0003cc0 msgr2=0x7f1aa0004180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1ac5a6c700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aa0003cc0 0x7f1aa0004180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1ac5a6c700 1 -- 172.21.15.80:0/3327523201 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa000c2c0 con 0x7f1aa0003350 2019-11-28T11:28:48.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.961+0000 7f1ac74cf700 1 -- 172.21.15.80:0/3327523201 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac010c810 con 0x7f1aa0003350 2019-11-28T11:28:48.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1ac5a6c700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aa0003350 0x7f1aa0003780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1ab0010700 tx=0x7f1ab0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1ac526b700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aa0003cc0 0x7f1aa0004180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:48.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1ac626d700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aa0004940 0x7f1aa0004dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:28:48.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1ac5a6c700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aa0003350 0x7f1aa0003780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1ab0010700 tx=0x7f1ab0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1ac5a6c700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aa0003350 0x7f1aa0003780 secure :-1 s=READY pgs=585 cs=0 l=1 rx=0x7f1ab0010700 tx=0x7f1ab0010aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:48.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1ac5a6c700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aa0003350 0x7f1aa0003780 secure :-1 s=THROTTLE_DONE pgs=585 cs=0 l=1 rx=0x7f1ab0010700 tx=0x7f1ab0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1ac5a6c700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aa0003350 0x7f1aa0003780 secure :-1 s=THROTTLE_DONE pgs=585 cs=0 l=1 rx=0x7f1ab0010700 tx=0x7f1ab0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1ac74cf700 1 -- 172.21.15.80:0/3327523201 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac010c490 con 0x7f1aa0003350 2019-11-28T11:28:48.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1ac5a6c700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aa0003350 0x7f1aa0003780 secure :-1 s=THROTTLE_DONE pgs=585 cs=0 l=1 rx=0x7f1ab0010700 tx=0x7f1ab0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab0001650 con 0x7f1aa0003350 2019-11-28T11:28:48.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab0001270 con 0x7f1aa0003350 2019-11-28T11:28:48.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab0001d70 con 0x7f1aa0003350 2019-11-28T11:28:48.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1ac5a6c700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aa0003350 0x7f1aa0003780 secure :-1 s=THROTTLE_DONE pgs=585 cs=0 l=1 rx=0x7f1ab0010700 tx=0x7f1ab0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1ab0001460 con 0x7f1aa0003350 2019-11-28T11:28:48.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1ac5a6c700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aa0003350 0x7f1aa0003780 secure :-1 s=THROTTLE_DONE pgs=585 cs=0 l=1 rx=0x7f1ab0010700 tx=0x7f1ab0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1abe7fc700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1aa0020ab0 0x7f1aa0022f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:48.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.962+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f1ab0031f40 con 0x7f1aa0003350 2019-11-28T11:28:48.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.963+0000 7f1ac526b700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1aa0020ab0 0x7f1aa0022f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:48.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.963+0000 7f1ac526b700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1aa0020ab0 0x7f1aa0022f20 crc :-1 s=READY pgs=246 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:48.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.969+0000 7f1ac74cf700 1 -- 172.21.15.80:0/3327523201 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9c002e60 con 0x7f1aa0003350 2019-11-28T11:28:48.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.973+0000 7f1ac5a6c700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aa0003350 0x7f1aa0003780 secure :-1 s=THROTTLE_DONE pgs=585 cs=0 l=1 rx=0x7f1ab0010700 tx=0x7f1ab0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:47.973+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1ab0002030 con 0x7f1aa0003350 2019-11-28T11:28:48.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.142+0000 7f1ac74cf700 1 -- 172.21.15.80:0/3327523201 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a9c001d60 con 0x7f1aa0003350 2019-11-28T11:28:48.570 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:28:48.574 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:28:48.578 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:28:48.582 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:28:48.586 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:28:48.590 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:28:48.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.788+0000 7f1ac5a6c700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aa0003350 0x7f1aa0003780 secure :-1 s=THROTTLE_DONE pgs=585 cs=0 l=1 rx=0x7f1ab0010700 tx=0x7f1ab0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.788+0000 7f1abe7fc700 1 -- 172.21.15.80:0/3327523201 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) v1 ==== 185+0+0 (secure 0 0 0) 0x7f1ab0001270 con 0x7f1aa0003350 2019-11-28T11:28:48.835 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:28:48.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.809+0000 7f1ac74cf700 1 -- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1aa0020ab0 msgr2=0x7f1aa0022f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:48.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.809+0000 7f1ac74cf700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1aa0020ab0 0x7f1aa0022f20 crc :-1 s=READY pgs=246 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:48.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.809+0000 7f1ac74cf700 1 -- 172.21.15.80:0/3327523201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aa0003350 msgr2=0x7f1aa0003780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:48.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.809+0000 7f1ac74cf700 1 --2- 172.21.15.80:0/3327523201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aa0003350 0x7f1aa0003780 secure :-1 s=READY pgs=585 cs=0 l=1 rx=0x7f1ab0010700 tx=0x7f1ab0010aa0).stop 2019-11-28T11:28:48.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.809+0000 7f1ac626d700 1 -- 172.21.15.80:0/3327523201 reap_dead start 2019-11-28T11:28:48.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.809+0000 7f1ac626d700 1 -- 172.21.15.80:0/3327523201 reap_dead start 2019-11-28T11:28:48.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.809+0000 7f1ac74cf700 1 -- 172.21.15.80:0/3327523201 shutdown_connections 2019-11-28T11:28:48.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.809+0000 7f1ac74cf700 1 -- 172.21.15.80:0/3327523201 shutdown_connections 2019-11-28T11:28:48.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.809+0000 7f1ac74cf700 1 -- 172.21.15.80:0/3327523201 wait complete. 2019-11-28T11:28:48.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.809+0000 7f1ac74cf700 1 -- 172.21.15.80:0/3327523201 >> 172.21.15.80:0/3327523201 conn(0x7f1ac015e2d0 msgr2=0x7f1ac0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:48.848 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:28:48.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.942+0000 7f27e0053700 1 Processor -- start 2019-11-28T11:28:48.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.942+0000 7f27e0053700 1 -- start start 2019-11-28T11:28:48.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27e0053700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27d815ed10 0x7f27d815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:48.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27e0053700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27d80734b0 0x7f27d80726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:48.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27e0053700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d806db60 con 0x7f27d8073020 2019-11-28T11:28:48.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27e0053700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d806f3d0 con 0x7f27d80734b0 2019-11-28T11:28:48.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27e0053700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d806fe00 con 0x7f27d815ed10 2019-11-28T11:28:48.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27dedf1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27d80734b0 0x7f27d80726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:48.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27dedf1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27d80734b0 0x7f27d80726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33816/0 (socket says 172.21.15.80:33816) 2019-11-28T11:28:48.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27dedf1700 1 -- 172.21.15.80:0/97387124 learned_addr learned my addr 172.21.15.80:0/97387124 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:48.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27de5f0700 1 --2- 172.21.15.80:0/97387124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27d815ed10 0x7f27d815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:48.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27dedf1700 1 -- 172.21.15.80:0/97387124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27d815ed10 msgr2=0x7f27d815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:48.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27dedf1700 1 --2- 172.21.15.80:0/97387124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27d815ed10 0x7f27d815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:48.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27dedf1700 1 -- 172.21.15.80:0/97387124 >> v1:172.21.15.174:6789/0 conn(0x7f27d8073020 legacy=0x7f27d8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:48.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27dedf1700 1 -- 172.21.15.80:0/97387124 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d8070760 con 0x7f27d80734b0 2019-11-28T11:28:48.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27dedf1700 1 --2- 172.21.15.80:0/97387124 >> v2:172.21.15.80:3300/0 conn(0x7f27d80734b0 0x7f27d80726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f27d000f730 tx=0x7f27d0007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27dedf1700 1 --2- 172.21.15.80:0/97387124 >> v2:172.21.15.80:3300/0 conn(0x7f27d80734b0 0x7f27d80726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f27d000f730 tx=0x7f27d0007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27dedf1700 1 --2- 172.21.15.80:0/97387124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d80734b0 0x7f27d80726a0 secure :-1 s=READY pgs=586 cs=0 l=1 rx=0x7f27d000f730 tx=0x7f27d0007d50).ready entity=mon.0 client_cookie=354913b8cc38186f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:48.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27dedf1700 1 --2- 172.21.15.80:0/97387124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d80734b0 0x7f27d80726a0 secure :-1 s=THROTTLE_DONE pgs=586 cs=0 l=1 rx=0x7f27d000f730 tx=0x7f27d0007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27dedf1700 1 --2- 172.21.15.80:0/97387124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d80734b0 0x7f27d80726a0 secure :-1 s=THROTTLE_DONE pgs=586 cs=0 l=1 rx=0x7f27d000f730 tx=0x7f27d0007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27dd5ee700 1 -- 172.21.15.80:0/97387124 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27d0000a70 con 0x7f27d80734b0 2019-11-28T11:28:48.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27dedf1700 1 --2- 172.21.15.80:0/97387124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d80734b0 0x7f27d80726a0 secure :-1 s=THROTTLE_DONE pgs=586 cs=0 l=1 rx=0x7f27d000f730 tx=0x7f27d0007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27dd5ee700 1 -- 172.21.15.80:0/97387124 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d00010e0 con 0x7f27d80734b0 2019-11-28T11:28:48.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27dd5ee700 1 -- 172.21.15.80:0/97387124 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27d00017b0 con 0x7f27d80734b0 2019-11-28T11:28:48.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27e0053700 1 -- 172.21.15.80:0/97387124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d80734b0 msgr2=0x7f27d80726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:48.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.944+0000 7f27e0053700 1 --2- 172.21.15.80:0/97387124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d80734b0 0x7f27d80726a0 secure :-1 s=READY pgs=586 cs=0 l=1 rx=0x7f27d000f730 tx=0x7f27d0007d50).stop 2019-11-28T11:28:48.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.945+0000 7f27e0053700 1 -- 172.21.15.80:0/97387124 shutdown_connections 2019-11-28T11:28:48.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.945+0000 7f27e0053700 1 --2- 172.21.15.80:0/97387124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d80734b0 0x7f27d80726a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:48.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.945+0000 7f27e0053700 1 --2- 172.21.15.80:0/97387124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27d815ed10 0x7f27d815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:48.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.945+0000 7f27e0053700 1 -- 172.21.15.80:0/97387124 shutdown_connections 2019-11-28T11:28:48.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.945+0000 7f27e0053700 1 -- 172.21.15.80:0/97387124 wait complete. 2019-11-28T11:28:48.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.945+0000 7f27e0053700 1 -- 172.21.15.80:0/97387124 >> 172.21.15.80:0/97387124 conn(0x7f27d8061d20 msgr2=0x7f27d80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:48.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.948+0000 7f27e0053700 1 Processor -- start 2019-11-28T11:28:48.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.948+0000 7f27e0053700 1 -- start start 2019-11-28T11:28:48.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27e0053700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27d81079b0 0x7f27d8107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:48.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27e0053700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d8148e00 con 0x7f27d8108380 2019-11-28T11:28:48.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27e0053700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d8108b10 con 0x7f27d8148320 2019-11-28T11:28:48.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27e0053700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d813aa20 con 0x7f27d81079b0 2019-11-28T11:28:48.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27dddef700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27d81079b0 0x7f27d8107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:48.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27dedf1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f27d8108380 0x7f27d8168d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33142/0 (socket says 172.21.15.80:33142) 2019-11-28T11:28:48.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27dedf1700 1 -- 172.21.15.80:0/3021981412 learned_addr learned my addr 172.21.15.80:0/3021981412 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:48.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27dddef700 1 -- 172.21.15.80:0/3021981412 >> v1:172.21.15.174:6789/0 conn(0x7f27d8148320 legacy=0x7f27d810ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:48.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27dddef700 1 -- 172.21.15.80:0/3021981412 >> v1:172.21.15.80:6789/0 conn(0x7f27d8108380 legacy=0x7f27d8168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:48.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27d6ffd700 1 -- 172.21.15.80:0/3021981412 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96956691 0 0) 0x7f27d0000940 con 0x7f27d8108380 2019-11-28T11:28:48.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27dddef700 1 -- 172.21.15.80:0/3021981412 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d810c490 con 0x7f27d81079b0 2019-11-28T11:28:48.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27dddef700 1 --2- 172.21.15.80:0/3021981412 >> v2:172.21.15.80:3300/0 conn(0x7f27d81079b0 0x7f27d8107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27c80103a0 tx=0x7f27c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27dddef700 1 --2- 172.21.15.80:0/3021981412 >> v2:172.21.15.80:3300/0 conn(0x7f27d81079b0 0x7f27d8107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27c80103a0 tx=0x7f27c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27dddef700 1 --2- 172.21.15.80:0/3021981412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d81079b0 0x7f27d8107e40 secure :-1 s=READY pgs=588 cs=0 l=1 rx=0x7f27c80103a0 tx=0x7f27c8010740).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:48.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27dddef700 1 --2- 172.21.15.80:0/3021981412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d81079b0 0x7f27d8107e40 secure :-1 s=THROTTLE_DONE pgs=588 cs=0 l=1 rx=0x7f27c80103a0 tx=0x7f27c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27d6ffd700 1 -- 172.21.15.80:0/3021981412 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c8009790 con 0x7f27d81079b0 2019-11-28T11:28:48.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27dddef700 1 --2- 172.21.15.80:0/3021981412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d81079b0 0x7f27d8107e40 secure :-1 s=THROTTLE_DONE pgs=588 cs=0 l=1 rx=0x7f27c80103a0 tx=0x7f27c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27d6ffd700 1 -- 172.21.15.80:0/3021981412 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c800a6b0 con 0x7f27d81079b0 2019-11-28T11:28:48.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27dddef700 1 --2- 172.21.15.80:0/3021981412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d81079b0 0x7f27d8107e40 secure :-1 s=THROTTLE_DONE pgs=588 cs=0 l=1 rx=0x7f27c80103a0 tx=0x7f27c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27e0053700 1 -- 172.21.15.80:0/3021981412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d810c810 con 0x7f27d81079b0 2019-11-28T11:28:48.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27d6ffd700 1 -- 172.21.15.80:0/3021981412 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c8009b70 con 0x7f27d81079b0 2019-11-28T11:28:48.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.949+0000 7f27e0053700 1 -- 172.21.15.80:0/3021981412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d8108820 con 0x7f27d81079b0 2019-11-28T11:28:48.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.950+0000 7f27dddef700 1 --2- 172.21.15.80:0/3021981412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d81079b0 0x7f27d8107e40 secure :-1 s=THROTTLE_DONE pgs=588 cs=0 l=1 rx=0x7f27c80103a0 tx=0x7f27c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.950+0000 7f27d6ffd700 1 -- 172.21.15.80:0/3021981412 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f27c8009790 con 0x7f27d81079b0 2019-11-28T11:28:48.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.950+0000 7f27dddef700 1 --2- 172.21.15.80:0/3021981412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d81079b0 0x7f27d8107e40 secure :-1 s=THROTTLE_DONE pgs=588 cs=0 l=1 rx=0x7f27c80103a0 tx=0x7f27c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.950+0000 7f27d6ffd700 1 --2- 172.21.15.80:0/3021981412 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27bc018730 0x7f27bc01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:48.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.950+0000 7f27d6ffd700 1 -- 172.21.15.80:0/3021981412 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5668+0+0 (secure 0 0 0) 0x7f27c8031d10 con 0x7f27d81079b0 2019-11-28T11:28:48.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.950+0000 7f27de5f0700 1 --2- 172.21.15.80:0/3021981412 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27bc018730 0x7f27bc01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:48.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.951+0000 7f27de5f0700 1 --2- 172.21.15.80:0/3021981412 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27bc018730 0x7f27bc01abe0 crc :-1 s=READY pgs=247 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:48.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.958+0000 7f27e0053700 1 -- 172.21.15.80:0/3021981412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d810c490 con 0x7f27d81079b0 2019-11-28T11:28:48.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.961+0000 7f27dddef700 1 --2- 172.21.15.80:0/3021981412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d81079b0 0x7f27d8107e40 secure :-1 s=THROTTLE_DONE pgs=588 cs=0 l=1 rx=0x7f27c80103a0 tx=0x7f27c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:48.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:48.961+0000 7f27d6ffd700 1 -- 172.21.15.80:0/3021981412 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f27c8009580 con 0x7f27d81079b0 2019-11-28T11:28:49.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.131+0000 7f27e0053700 1 -- 172.21.15.80:0/3021981412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f27d810c810 con 0x7f27d81079b0 2019-11-28T11:28:49.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.792+0000 7f27dddef700 1 --2- 172.21.15.80:0/3021981412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d81079b0 0x7f27d8107e40 secure :-1 s=THROTTLE_DONE pgs=588 cs=0 l=1 rx=0x7f27c80103a0 tx=0x7f27c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:49.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.792+0000 7f27d6ffd700 1 -- 172.21.15.80:0/3021981412 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) v1 ==== 173+0+0 (secure 0 0 0) 0x7f27c800a640 con 0x7f27d81079b0 2019-11-28T11:28:49.824 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:28:49.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.798+0000 7f27e0053700 1 -- 172.21.15.80:0/3021981412 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27bc018730 msgr2=0x7f27bc01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:49.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.798+0000 7f27e0053700 1 --2- 172.21.15.80:0/3021981412 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27bc018730 0x7f27bc01abe0 crc :-1 s=READY pgs=247 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:49.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.798+0000 7f27e0053700 1 -- 172.21.15.80:0/3021981412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d81079b0 msgr2=0x7f27d8107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:49.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.798+0000 7f27e0053700 1 --2- 172.21.15.80:0/3021981412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d81079b0 0x7f27d8107e40 secure :-1 s=READY pgs=588 cs=0 l=1 rx=0x7f27c80103a0 tx=0x7f27c8010740).stop 2019-11-28T11:28:49.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.798+0000 7f27e0053700 1 -- 172.21.15.80:0/3021981412 shutdown_connections 2019-11-28T11:28:49.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.798+0000 7f27e0053700 1 --2- 172.21.15.80:0/3021981412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d81079b0 0x7f27d8107e40 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:49.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.798+0000 7f27e0053700 1 --2- 172.21.15.80:0/3021981412 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27bc018730 0x7f27bc01abe0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:49.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.798+0000 7f27e0053700 1 -- 172.21.15.80:0/3021981412 shutdown_connections 2019-11-28T11:28:49.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.798+0000 7f27e0053700 1 -- 172.21.15.80:0/3021981412 wait complete. 2019-11-28T11:28:49.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.798+0000 7f27e0053700 1 -- 172.21.15.80:0/3021981412 >> 172.21.15.80:0/3021981412 conn(0x7f27d815e2d0 msgr2=0x7f27d8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:49.837 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:28:49.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.933+0000 7fc9180ad700 1 Processor -- start 2019-11-28T11:28:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.933+0000 7fc9180ad700 1 -- start start 2019-11-28T11:28:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc9180ad700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc91006c0a0 0x7fc910072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc9180ad700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9100734e0 0x7fc910071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc9180ad700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91006db00 con 0x7fc910072360 2019-11-28T11:28:49.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc9180ad700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91006fd60 con 0x7fc91006c0a0 2019-11-28T11:28:49.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc9180ad700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc910070030 con 0x7fc9100734e0 2019-11-28T11:28:49.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc91664a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc91006c0a0 0x7fc910072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:49.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc91664a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc91006c0a0 0x7fc910072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33830/0 (socket says 172.21.15.80:33830) 2019-11-28T11:28:49.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc91664a700 1 -- 172.21.15.80:0/11190386 learned_addr learned my addr 172.21.15.80:0/11190386 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:49.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc915e49700 1 --2- 172.21.15.80:0/11190386 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9100734e0 0x7fc910071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:49.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc91664a700 1 -- 172.21.15.80:0/11190386 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9100734e0 msgr2=0x7fc910071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:49.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc91664a700 1 --2- 172.21.15.80:0/11190386 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9100734e0 0x7fc910071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:49.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc91664a700 1 -- 172.21.15.80:0/11190386 >> v1:172.21.15.174:6789/0 conn(0x7fc910072360 legacy=0x7fc91006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:49.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc91664a700 1 -- 172.21.15.80:0/11190386 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9100706c0 con 0x7fc91006c0a0 2019-11-28T11:28:49.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc91664a700 1 --2- 172.21.15.80:0/11190386 >> v2:172.21.15.80:3300/0 conn(0x7fc91006c0a0 0x7fc910072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc90000f740 tx=0x7fc90000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:49.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc91664a700 1 --2- 172.21.15.80:0/11190386 >> v2:172.21.15.80:3300/0 conn(0x7fc91006c0a0 0x7fc910072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc90000f740 tx=0x7fc90000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:49.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc91664a700 1 --2- 172.21.15.80:0/11190386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc91006c0a0 0x7fc910072fa0 secure :-1 s=READY pgs=589 cs=0 l=1 rx=0x7fc90000f740 tx=0x7fc90000f570).ready entity=mon.0 client_cookie=83a607aa83ecc95e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:49.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc91664a700 1 --2- 172.21.15.80:0/11190386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc91006c0a0 0x7fc910072fa0 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7fc90000f740 tx=0x7fc90000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:49.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.935+0000 7fc91664a700 1 --2- 172.21.15.80:0/11190386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc91006c0a0 0x7fc910072fa0 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7fc90000f740 tx=0x7fc90000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:49.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.934+0000 7fc915648700 1 -- 172.21.15.80:0/11190386 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc900000960 con 0x7fc91006c0a0 2019-11-28T11:28:49.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.935+0000 7fc91664a700 1 --2- 172.21.15.80:0/11190386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc91006c0a0 0x7fc910072fa0 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7fc90000f740 tx=0x7fc90000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:49.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.935+0000 7fc915648700 1 -- 172.21.15.80:0/11190386 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc900000c90 con 0x7fc91006c0a0 2019-11-28T11:28:49.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.935+0000 7fc915648700 1 -- 172.21.15.80:0/11190386 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9000013a0 con 0x7fc91006c0a0 2019-11-28T11:28:49.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.935+0000 7fc9180ad700 1 -- 172.21.15.80:0/11190386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc91006c0a0 msgr2=0x7fc910072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:49.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.935+0000 7fc9180ad700 1 --2- 172.21.15.80:0/11190386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc91006c0a0 0x7fc910072fa0 secure :-1 s=READY pgs=589 cs=0 l=1 rx=0x7fc90000f740 tx=0x7fc90000f570).stop 2019-11-28T11:28:49.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.935+0000 7fc9180ad700 1 -- 172.21.15.80:0/11190386 shutdown_connections 2019-11-28T11:28:49.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.935+0000 7fc9180ad700 1 --2- 172.21.15.80:0/11190386 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9100734e0 0x7fc910071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:49.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.935+0000 7fc9180ad700 1 --2- 172.21.15.80:0/11190386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc91006c0a0 0x7fc910072fa0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:49.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.935+0000 7fc9180ad700 1 -- 172.21.15.80:0/11190386 shutdown_connections 2019-11-28T11:28:49.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.935+0000 7fc9180ad700 1 -- 172.21.15.80:0/11190386 wait complete. 2019-11-28T11:28:49.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.935+0000 7fc9180ad700 1 -- 172.21.15.80:0/11190386 >> 172.21.15.80:0/11190386 conn(0x7fc910061cf0 msgr2=0x7fc910064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:49.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.938+0000 7fc9180ad700 1 Processor -- start 2019-11-28T11:28:49.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.938+0000 7fc9180ad700 1 -- start start 2019-11-28T11:28:49.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc9180ad700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc91013eb40 0x7fc91010afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:49.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc9180ad700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91013f1e0 con 0x7fc91010b500 2019-11-28T11:28:49.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc9180ad700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc910131a30 con 0x7fc9101631f0 2019-11-28T11:28:49.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc9180ad700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9101234c0 con 0x7fc91013eb40 2019-11-28T11:28:49.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc915e49700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc91010b500 0x7fc9101629f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33154/0 (socket says 172.21.15.80:33154) 2019-11-28T11:28:49.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc915e49700 1 -- 172.21.15.80:0/3142652197 learned_addr learned my addr 172.21.15.80:0/3142652197 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:49.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc91664a700 1 --2- 172.21.15.80:0/3142652197 >> v2:172.21.15.174:3300/0 conn(0x7fc91013eb40 0x7fc91010afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:49.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc90effd700 1 -- 172.21.15.80:0/3142652197 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271614107 0 0) 0x7fc904000fb0 con 0x7fc91010b500 2019-11-28T11:28:49.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc90effd700 1 -- 172.21.15.80:0/3142652197 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8f0002e80 con 0x7fc91010b500 2019-11-28T11:28:49.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc90effd700 1 -- 172.21.15.80:0/3142652197 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2745527351 0 0) 0x7fc9040010a0 con 0x7fc91010b500 2019-11-28T11:28:49.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc90effd700 1 -- 172.21.15.80:0/3142652197 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc8f00032e0 con 0x7fc91010b500 2019-11-28T11:28:49.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc90effd700 1 -- 172.21.15.80:0/3142652197 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc904001650 con 0x7fc91010b500 2019-11-28T11:28:49.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc91664a700 1 -- 172.21.15.80:0/3142652197 >> v1:172.21.15.174:6789/0 conn(0x7fc9101631f0 legacy=0x7fc910105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:49.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc91664a700 1 -- 172.21.15.80:0/3142652197 >> v1:172.21.15.80:6789/0 conn(0x7fc91010b500 legacy=0x7fc9101629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:49.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc91664a700 1 -- 172.21.15.80:0/3142652197 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc910108700 con 0x7fc91013eb40 2019-11-28T11:28:49.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc91664a700 1 --2- 172.21.15.80:0/3142652197 >> v2:172.21.15.174:3300/0 conn(0x7fc91013eb40 0x7fc91010afc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc900010380 tx=0x7fc900010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:49.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc91664a700 1 --2- 172.21.15.80:0/3142652197 >> v2:172.21.15.174:3300/0 conn(0x7fc91013eb40 0x7fc91010afc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc900010380 tx=0x7fc900010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:49.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.939+0000 7fc91664a700 1 --2- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc91013eb40 0x7fc91010afc0 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7fc900010380 tx=0x7fc900010720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:49.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.940+0000 7fc91664a700 1 --2- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc91013eb40 0x7fc91010afc0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7fc900010380 tx=0x7fc900010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:49.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.940+0000 7fc90effd700 1 -- 172.21.15.80:0/3142652197 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9000029a0 con 0x7fc91013eb40 2019-11-28T11:28:49.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.940+0000 7fc91664a700 1 --2- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc91013eb40 0x7fc91010afc0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7fc900010380 tx=0x7fc900010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:49.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.940+0000 7fc91664a700 1 --2- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc91013eb40 0x7fc91010afc0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7fc900010380 tx=0x7fc900010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:49.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.940+0000 7fc90effd700 1 -- 172.21.15.80:0/3142652197 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc900000b30 con 0x7fc91013eb40 2019-11-28T11:28:49.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.940+0000 7fc9180ad700 1 -- 172.21.15.80:0/3142652197 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc910108a80 con 0x7fc91013eb40 2019-11-28T11:28:49.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.940+0000 7fc90effd700 1 -- 172.21.15.80:0/3142652197 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc900000d20 con 0x7fc91013eb40 2019-11-28T11:28:49.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.940+0000 7fc9180ad700 1 -- 172.21.15.80:0/3142652197 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc910108700 con 0x7fc91013eb40 2019-11-28T11:28:49.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.940+0000 7fc91664a700 1 --2- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc91013eb40 0x7fc91010afc0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7fc900010380 tx=0x7fc900010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:49.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.940+0000 7fc90effd700 1 -- 172.21.15.80:0/3142652197 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc900000d20 con 0x7fc91013eb40 2019-11-28T11:28:49.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.940+0000 7fc91664a700 1 --2- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc91013eb40 0x7fc91010afc0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7fc900010380 tx=0x7fc900010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:49.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.940+0000 7fc90effd700 1 --2- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc8f0018770 0x7fc8f001ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:49.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.940+0000 7fc90effd700 1 -- 172.21.15.80:0/3142652197 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5286+0+0 (secure 0 0 0) 0x7fc900031a50 con 0x7fc91013eb40 2019-11-28T11:28:49.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.941+0000 7fc915e49700 1 --2- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc8f0018770 0x7fc8f001ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:49.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.941+0000 7fc915e49700 1 --2- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc8f0018770 0x7fc8f001ac00 crc :-1 s=READY pgs=248 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:49.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.948+0000 7fc9180ad700 1 -- 172.21.15.80:0/3142652197 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc910108a80 con 0x7fc91013eb40 2019-11-28T11:28:49.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.952+0000 7fc91664a700 1 --2- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc91013eb40 0x7fc91010afc0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7fc900010380 tx=0x7fc900010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:49.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:49.952+0000 7fc90effd700 1 -- 172.21.15.80:0/3142652197 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc900007230 con 0x7fc91013eb40 2019-11-28T11:28:50.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.138+0000 7fc9180ad700 1 -- 172.21.15.80:0/3142652197 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fc910108700 con 0x7fc91013eb40 2019-11-28T11:28:50.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.807+0000 7fc91664a700 1 --2- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc91013eb40 0x7fc91010afc0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7fc900010380 tx=0x7fc900010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:50.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.807+0000 7fc90effd700 1 -- 172.21.15.80:0/3142652197 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v53) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc900000d00 con 0x7fc91013eb40 2019-11-28T11:28:50.881 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:28:50.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.855+0000 7fc9180ad700 1 -- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc8f0018770 msgr2=0x7fc8f001ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:50.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.855+0000 7fc9180ad700 1 --2- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc8f0018770 0x7fc8f001ac00 crc :-1 s=READY pgs=248 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:50.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.855+0000 7fc9180ad700 1 -- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc91013eb40 msgr2=0x7fc91010afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:50.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.855+0000 7fc9180ad700 1 --2- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc91013eb40 0x7fc91010afc0 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7fc900010380 tx=0x7fc900010720).stop 2019-11-28T11:28:50.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.855+0000 7fc9180ad700 1 -- 172.21.15.80:0/3142652197 shutdown_connections 2019-11-28T11:28:50.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.855+0000 7fc9180ad700 1 --2- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc8f0018770 0x7fc8f001ac00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:50.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.855+0000 7fc9180ad700 1 --2- 172.21.15.80:0/3142652197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc91013eb40 0x7fc91010afc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:50.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.856+0000 7fc9180ad700 1 -- 172.21.15.80:0/3142652197 shutdown_connections 2019-11-28T11:28:50.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.856+0000 7fc9180ad700 1 -- 172.21.15.80:0/3142652197 wait complete. 2019-11-28T11:28:50.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.856+0000 7fc9180ad700 1 -- 172.21.15.80:0/3142652197 >> 172.21.15.80:0/3142652197 conn(0x7fc91011bfc0 msgr2=0x7fc910141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:50.895 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:28:50.896 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:28:51.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.989+0000 7f78f98c9700 1 Processor -- start 2019-11-28T11:28:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.989+0000 7f78f98c9700 1 -- start start 2019-11-28T11:28:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f98c9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78f406c0a0 0x7f78f4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f98c9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78f4072620 0x7f78f4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f98c9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f406db00 con 0x7f78f40734e0 2019-11-28T11:28:51.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f98c9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f406f330 con 0x7f78f4072620 2019-11-28T11:28:51.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f98c9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40706c0 con 0x7f78f406c0a0 2019-11-28T11:28:51.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78f4072620 0x7f78f4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:51.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78f4072620 0x7f78f4164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33846/0 (socket says 172.21.15.80:33846) 2019-11-28T11:28:51.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f3fff700 1 -- 172.21.15.80:0/683814475 learned_addr learned my addr 172.21.15.80:0/683814475 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:51.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f37fe700 1 --2- 172.21.15.80:0/683814475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78f406c0a0 0x7f78f4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:51.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f3fff700 1 -- 172.21.15.80:0/683814475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78f406c0a0 msgr2=0x7f78f4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:51.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f3fff700 1 --2- 172.21.15.80:0/683814475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78f406c0a0 0x7f78f4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:51.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f3fff700 1 -- 172.21.15.80:0/683814475 >> v1:172.21.15.80:6789/0 conn(0x7f78f40734e0 legacy=0x7f78f4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f3fff700 1 -- 172.21.15.80:0/683814475 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f4070a40 con 0x7f78f4072620 2019-11-28T11:28:51.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f37fe700 1 --2- 172.21.15.80:0/683814475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78f406c0a0 0x7f78f4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f3fff700 1 --2- 172.21.15.80:0/683814475 >> v2:172.21.15.80:3300/0 conn(0x7f78f4072620 0x7f78f4164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f78ec00f730 tx=0x7f78ec00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f3fff700 1 --2- 172.21.15.80:0/683814475 >> v2:172.21.15.80:3300/0 conn(0x7f78f4072620 0x7f78f4164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f78ec00f730 tx=0x7f78ec00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f3fff700 1 --2- 172.21.15.80:0/683814475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f4072620 0x7f78f4164d70 secure :-1 s=READY pgs=592 cs=0 l=1 rx=0x7f78ec00f730 tx=0x7f78ec00fad0).ready entity=mon.0 client_cookie=cbb613af8eb7e0ad server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f3fff700 1 --2- 172.21.15.80:0/683814475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f4072620 0x7f78f4164d70 secure :-1 s=THROTTLE_DONE pgs=592 cs=0 l=1 rx=0x7f78ec00f730 tx=0x7f78ec00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f3fff700 1 --2- 172.21.15.80:0/683814475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f4072620 0x7f78f4164d70 secure :-1 s=THROTTLE_DONE pgs=592 cs=0 l=1 rx=0x7f78ec00f730 tx=0x7f78ec00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f27fc700 1 -- 172.21.15.80:0/683814475 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ec000b90 con 0x7f78f4072620 2019-11-28T11:28:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f3fff700 1 --2- 172.21.15.80:0/683814475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f4072620 0x7f78f4164d70 secure :-1 s=THROTTLE_DONE pgs=592 cs=0 l=1 rx=0x7f78ec00f730 tx=0x7f78ec00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f27fc700 1 -- 172.21.15.80:0/683814475 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec0010e0 con 0x7f78f4072620 2019-11-28T11:28:51.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f27fc700 1 -- 172.21.15.80:0/683814475 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ec001830 con 0x7f78f4072620 2019-11-28T11:28:51.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f98c9700 1 -- 172.21.15.80:0/683814475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f4072620 msgr2=0x7f78f4164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f98c9700 1 --2- 172.21.15.80:0/683814475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f4072620 0x7f78f4164d70 secure :-1 s=READY pgs=592 cs=0 l=1 rx=0x7f78ec00f730 tx=0x7f78ec00fad0).stop 2019-11-28T11:28:51.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f98c9700 1 -- 172.21.15.80:0/683814475 shutdown_connections 2019-11-28T11:28:51.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f98c9700 1 --2- 172.21.15.80:0/683814475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f4072620 0x7f78f4164d70 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f98c9700 1 --2- 172.21.15.80:0/683814475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78f406c0a0 0x7f78f4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:51.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f98c9700 1 -- 172.21.15.80:0/683814475 shutdown_connections 2019-11-28T11:28:51.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f98c9700 1 -- 172.21.15.80:0/683814475 wait complete. 2019-11-28T11:28:51.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.991+0000 7f78f98c9700 1 -- 172.21.15.80:0/683814475 >> 172.21.15.80:0/683814475 conn(0x7f78f4061cf0 msgr2=0x7f78f4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:51.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.994+0000 7f78f98c9700 1 Processor -- start 2019-11-28T11:28:51.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.994+0000 7f78f98c9700 1 -- start start 2019-11-28T11:28:51.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f98c9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78f41299b0 0x7f78f411b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:51.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f98c9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f78f411c4b0 0x7f78f411b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:51.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f98c9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78f411bea0 0x7f78f413e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:51.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f98c9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f4142320 con 0x7f78f411bea0 2019-11-28T11:28:51.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f98c9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f4142d50 con 0x7f78f411c4b0 2019-11-28T11:28:51.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f98c9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f4119ba0 con 0x7f78f41299b0 2019-11-28T11:28:51.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78f411bea0 0x7f78f413e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:51.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78f411bea0 0x7f78f413e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33854/0 (socket says 172.21.15.80:33854) 2019-11-28T11:28:51.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f3fff700 1 -- 172.21.15.80:0/794402868 learned_addr learned my addr 172.21.15.80:0/794402868 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:51.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f37fe700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78f41299b0 0x7f78f411b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:51.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f2ffd700 1 --2- 172.21.15.80:0/794402868 >> v2:172.21.15.174:3300/0 conn(0x7f78f411c4b0 0x7f78f411b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:51.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f3fff700 1 -- 172.21.15.80:0/794402868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78f41299b0 msgr2=0x7f78f411b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f3fff700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78f41299b0 0x7f78f411b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f3fff700 1 -- 172.21.15.80:0/794402868 >> v2:172.21.15.174:3300/0 conn(0x7f78f411c4b0 msgr2=0x7f78f411b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f3fff700 1 --2- 172.21.15.80:0/794402868 >> v2:172.21.15.174:3300/0 conn(0x7f78f411c4b0 0x7f78f411b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f3fff700 1 -- 172.21.15.80:0/794402868 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f4119f20 con 0x7f78f411bea0 2019-11-28T11:28:51.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f3fff700 1 --2- 172.21.15.80:0/794402868 >> v2:172.21.15.80:3300/0 conn(0x7f78f411bea0 0x7f78f413e300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78ec010450 tx=0x7f78ec010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f3fff700 1 --2- 172.21.15.80:0/794402868 >> v2:172.21.15.80:3300/0 conn(0x7f78f411bea0 0x7f78f413e300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78ec010450 tx=0x7f78ec010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f3fff700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f411bea0 0x7f78f413e300 secure :-1 s=READY pgs=593 cs=0 l=1 rx=0x7f78ec010450 tx=0x7f78ec010300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:51.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f3fff700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f411bea0 0x7f78f413e300 secure :-1 s=THROTTLE_DONE pgs=593 cs=0 l=1 rx=0x7f78ec010450 tx=0x7f78ec010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f3fff700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f411bea0 0x7f78f413e300 secure :-1 s=THROTTLE_DONE pgs=593 cs=0 l=1 rx=0x7f78ec010450 tx=0x7f78ec010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78ebfff700 1 -- 172.21.15.80:0/794402868 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ec0012b0 con 0x7f78f411bea0 2019-11-28T11:28:51.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f3fff700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f411bea0 0x7f78f413e300 secure :-1 s=THROTTLE_DONE pgs=593 cs=0 l=1 rx=0x7f78ec010450 tx=0x7f78ec010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78ebfff700 1 -- 172.21.15.80:0/794402868 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec008180 con 0x7f78f411bea0 2019-11-28T11:28:51.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f98c9700 1 -- 172.21.15.80:0/794402868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f4119f20 con 0x7f78f411bea0 2019-11-28T11:28:51.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78ebfff700 1 -- 172.21.15.80:0/794402868 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ec001890 con 0x7f78f411bea0 2019-11-28T11:28:51.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.995+0000 7f78f98c9700 1 -- 172.21.15.80:0/794402868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f4119f20 con 0x7f78f411bea0 2019-11-28T11:28:51.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.996+0000 7f78f3fff700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f411bea0 0x7f78f413e300 secure :-1 s=THROTTLE_DONE pgs=593 cs=0 l=1 rx=0x7f78ec010450 tx=0x7f78ec010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.996+0000 7f78ebfff700 1 -- 172.21.15.80:0/794402868 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f78ec0010c0 con 0x7f78f411bea0 2019-11-28T11:28:51.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.996+0000 7f78f3fff700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f411bea0 0x7f78f413e300 secure :-1 s=THROTTLE_DONE pgs=593 cs=0 l=1 rx=0x7f78ec010450 tx=0x7f78ec010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.996+0000 7f78ebfff700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78cc018730 0x7f78cc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:51.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.996+0000 7f78ebfff700 1 -- 172.21.15.80:0/794402868 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f78ec031a50 con 0x7f78f411bea0 2019-11-28T11:28:51.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.996+0000 7f78f37fe700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78cc018730 0x7f78cc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:51.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:50.997+0000 7f78f37fe700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78cc018730 0x7f78cc01abc0 crc :-1 s=READY pgs=249 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:51.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.004+0000 7f78f98c9700 1 -- 172.21.15.80:0/794402868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f4119f20 con 0x7f78f411bea0 2019-11-28T11:28:51.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.008+0000 7f78f3fff700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f411bea0 0x7f78f413e300 secure :-1 s=THROTTLE_DONE pgs=593 cs=0 l=1 rx=0x7f78ec010450 tx=0x7f78ec010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.008+0000 7f78ebfff700 1 -- 172.21.15.80:0/794402868 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f78ec000eb0 con 0x7f78f411bea0 2019-11-28T11:28:51.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.178+0000 7f78f98c9700 1 -- 172.21.15.80:0/794402868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f78f4119f20 con 0x7f78f411bea0 2019-11-28T11:28:51.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.178+0000 7f78f3fff700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f411bea0 0x7f78f413e300 secure :-1 s=THROTTLE_DONE pgs=593 cs=0 l=1 rx=0x7f78ec010450 tx=0x7f78ec010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.178+0000 7f78ebfff700 1 -- 172.21.15.80:0/794402868 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+4797 (secure 0 0 0) 0x7f78ec0010c0 con 0x7f78f411bea0 2019-11-28T11:28:51.207 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:51.207 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:28:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:28:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:28:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:28:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:28:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:28:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:28:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:28:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:28:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:28:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:28:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:51.214 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:51.214 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:51.214 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:28:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:28:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:51.216 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:51.216 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:51.216 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.217 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:28:51.217 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:28:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:28:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:28:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:28:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:28:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:28:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:28:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.226 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:28:51.226 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:28:51.226 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.226 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:51.227 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:51.227 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:51.227 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:28:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:28:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.230 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:28:51.230 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:28:51.230 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:28:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:28:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:28:51.233 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:28:51.233 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:28:51.242 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.243 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:28:51.243 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:28:51.243 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.244 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:28:51.244 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:28:51.245 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:28:51.252 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:28:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:28:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:28:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:28:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:28:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:28:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:28:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:28:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:28:51.257 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:28:51.257 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:28:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:28:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:28:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:28:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:28:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:28:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:28:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:28:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:28:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:28:51.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:51.262 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:28:51.262 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:28:51.262 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:28:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:28:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:28:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:28:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:28:51.263 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:28:51.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.181+0000 7f78f98c9700 1 -- 172.21.15.80:0/794402868 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78cc018730 msgr2=0x7f78cc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.181+0000 7f78f98c9700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78cc018730 0x7f78cc01abc0 crc :-1 s=READY pgs=249 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.181+0000 7f78f98c9700 1 -- 172.21.15.80:0/794402868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f411bea0 msgr2=0x7f78f413e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.181+0000 7f78f98c9700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f411bea0 0x7f78f413e300 secure :-1 s=READY pgs=593 cs=0 l=1 rx=0x7f78ec010450 tx=0x7f78ec010300).stop 2019-11-28T11:28:51.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.181+0000 7f78f98c9700 1 -- 172.21.15.80:0/794402868 shutdown_connections 2019-11-28T11:28:51.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.181+0000 7f78f98c9700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78cc018730 0x7f78cc01abc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.181+0000 7f78f98c9700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78f411bea0 0x7f78f413e300 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.181+0000 7f78f98c9700 1 --2- 172.21.15.80:0/794402868 >> v2:172.21.15.174:3300/0 conn(0x7f78f411c4b0 0x7f78f411b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.181+0000 7f78f98c9700 1 --2- 172.21.15.80:0/794402868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78f41299b0 0x7f78f411b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.181+0000 7f78f98c9700 1 -- 172.21.15.80:0/794402868 shutdown_connections 2019-11-28T11:28:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.181+0000 7f78f98c9700 1 -- 172.21.15.80:0/794402868 wait complete. 2019-11-28T11:28:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.181+0000 7f78f98c9700 1 -- 172.21.15.80:0/794402868 >> 172.21.15.80:0/794402868 conn(0x7f78f413b860 msgr2=0x7f78f41050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:51.274 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:28:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.366+0000 7fc181e68700 1 Processor -- start 2019-11-28T11:28:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.366+0000 7fc181e68700 1 -- start start 2019-11-28T11:28:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.367+0000 7fc181e68700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c06c0a0 0x7fc17c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:51.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.367+0000 7fc181e68700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc17c072620 0x7fc17c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:51.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.367+0000 7fc181e68700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c06db00 con 0x7fc17c0734e0 2019-11-28T11:28:51.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.367+0000 7fc181e68700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17c06f330 con 0x7fc17c072620 2019-11-28T11:28:51.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.367+0000 7fc181e68700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0706c0 con 0x7fc17c06c0a0 2019-11-28T11:28:51.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc180c06700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc17c072620 0x7fc17c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:51.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c06c0a0 0x7fc17c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:51.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c06c0a0 0x7fc17c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:36118/0 (socket says 172.21.15.80:36118) 2019-11-28T11:28:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc180c06700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc17c072620 0x7fc17c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:48748/0 (socket says 172.21.15.80:48748) 2019-11-28T11:28:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17bfff700 1 -- 172.21.15.80:0/3752377508 learned_addr learned my addr 172.21.15.80:0/3752377508 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc173fff700 1 --1- 172.21.15.80:0/3752377508 >> v1:172.21.15.174:6789/0 conn(0x7fc17c0734e0 0x7fc17c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:48718/0 (socket says 172.21.15.80:48718) 2019-11-28T11:28:51.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17bfff700 1 -- 172.21.15.80:0/3752377508 >> v2:172.21.15.174:3300/0 conn(0x7fc17c072620 msgr2=0x7fc17c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:51.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17bfff700 1 --2- 172.21.15.80:0/3752377508 >> v2:172.21.15.174:3300/0 conn(0x7fc17c072620 0x7fc17c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:51.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17bfff700 1 -- 172.21.15.80:0/3752377508 >> v1:172.21.15.174:6789/0 conn(0x7fc17c0734e0 legacy=0x7fc17c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17b7fe700 1 -- 172.21.15.80:0/3752377508 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463643797 0 0) 0x7fc164001080 con 0x7fc17c0734e0 2019-11-28T11:28:51.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17bfff700 1 -- 172.21.15.80:0/3752377508 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c070a40 con 0x7fc17c06c0a0 2019-11-28T11:28:51.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc180c06700 1 --2- 172.21.15.80:0/3752377508 >> v2:172.21.15.174:3300/0 conn(0x7fc17c072620 0x7fc17c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:51.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17bfff700 1 --2- 172.21.15.80:0/3752377508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c06c0a0 0x7fc17c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc16c00f740 tx=0x7fc16c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17bfff700 1 --2- 172.21.15.80:0/3752377508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c06c0a0 0x7fc17c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc16c00f740 tx=0x7fc16c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17bfff700 1 --2- 172.21.15.80:0/3752377508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c06c0a0 0x7fc17c072fa0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fc16c00f740 tx=0x7fc16c00fae0).ready entity=mon.2 client_cookie=44ffd9adde5a0206 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17bfff700 1 --2- 172.21.15.80:0/3752377508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c06c0a0 0x7fc17c072fa0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fc16c00f740 tx=0x7fc16c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17b7fe700 1 -- 172.21.15.80:0/3752377508 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16c000960 con 0x7fc17c06c0a0 2019-11-28T11:28:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17bfff700 1 --2- 172.21.15.80:0/3752377508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c06c0a0 0x7fc17c072fa0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fc16c00f740 tx=0x7fc16c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17b7fe700 1 -- 172.21.15.80:0/3752377508 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c000c90 con 0x7fc17c06c0a0 2019-11-28T11:28:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17bfff700 1 --2- 172.21.15.80:0/3752377508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c06c0a0 0x7fc17c072fa0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fc16c00f740 tx=0x7fc16c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc17b7fe700 1 -- 172.21.15.80:0/3752377508 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16c007210 con 0x7fc17c06c0a0 2019-11-28T11:28:51.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc181e68700 1 -- 172.21.15.80:0/3752377508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c06c0a0 msgr2=0x7fc17c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.368+0000 7fc181e68700 1 --2- 172.21.15.80:0/3752377508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c06c0a0 0x7fc17c072fa0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fc16c00f740 tx=0x7fc16c00fae0).stop 2019-11-28T11:28:51.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.369+0000 7fc181e68700 1 -- 172.21.15.80:0/3752377508 shutdown_connections 2019-11-28T11:28:51.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.369+0000 7fc181e68700 1 --2- 172.21.15.80:0/3752377508 >> v2:172.21.15.174:3300/0 conn(0x7fc17c072620 0x7fc17c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:51.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.369+0000 7fc181e68700 1 --2- 172.21.15.80:0/3752377508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c06c0a0 0x7fc17c072fa0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.369+0000 7fc181e68700 1 -- 172.21.15.80:0/3752377508 shutdown_connections 2019-11-28T11:28:51.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.369+0000 7fc181e68700 1 -- 172.21.15.80:0/3752377508 wait complete. 2019-11-28T11:28:51.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.369+0000 7fc181e68700 1 -- 172.21.15.80:0/3752377508 >> 172.21.15.80:0/3752377508 conn(0x7fc17c061cf0 msgr2=0x7fc17c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:51.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.371+0000 7fc181e68700 1 Processor -- start 2019-11-28T11:28:51.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.372+0000 7fc181e68700 1 -- start start 2019-11-28T11:28:51.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.372+0000 7fc181e68700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c104820 0x7fc17c10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:51.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.372+0000 7fc181e68700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc17c10c890 0x7fc17c10b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:51.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.372+0000 7fc181e68700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c13bcd0 con 0x7fc17c10b710 2019-11-28T11:28:51.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.372+0000 7fc181e68700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17c108700 con 0x7fc17c10c890 2019-11-28T11:28:51.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.372+0000 7fc181e68700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1081f0 con 0x7fc17c104820 2019-11-28T11:28:51.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.372+0000 7fc173fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc17c10c890 0x7fc17c10b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:51.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.372+0000 7fc173fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc17c10c890 0x7fc17c10b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33866/0 (socket says 172.21.15.80:33866) 2019-11-28T11:28:51.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc173fff700 1 -- 172.21.15.80:0/754328033 learned_addr learned my addr 172.21.15.80:0/754328033 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:51.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc17bfff700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c104820 0x7fc17c10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:51.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc17bfff700 1 -- 172.21.15.80:0/754328033 >> v2:172.21.15.80:3300/0 conn(0x7fc17c10c890 msgr2=0x7fc17c10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc17bfff700 1 --2- 172.21.15.80:0/754328033 >> v2:172.21.15.80:3300/0 conn(0x7fc17c10c890 0x7fc17c10b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc17bfff700 1 -- 172.21.15.80:0/754328033 >> v1:172.21.15.80:6789/0 conn(0x7fc17c10b710 legacy=0x7fc17c104c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc17bfff700 1 -- 172.21.15.80:0/754328033 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c109a90 con 0x7fc17c104820 2019-11-28T11:28:51.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc1797fa700 1 -- 172.21.15.80:0/754328033 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360354792 0 0) 0x7fc174009b40 con 0x7fc17c10b710 2019-11-28T11:28:51.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc173fff700 1 --2- 172.21.15.80:0/754328033 >> v2:172.21.15.80:3300/0 conn(0x7fc17c10c890 0x7fc17c10b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc17bfff700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c104820 0x7fc17c10c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc16c0565c0 tx=0x7fc16c056960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc17bfff700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c104820 0x7fc17c10c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc16c0565c0 tx=0x7fc16c056960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc17bfff700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c104820 0x7fc17c10c350 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7fc16c0565c0 tx=0x7fc16c056960).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:51.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc17bfff700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c104820 0x7fc17c10c350 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fc16c0565c0 tx=0x7fc16c056960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc1797fa700 1 -- 172.21.15.80:0/754328033 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16c0540c0 con 0x7fc17c104820 2019-11-28T11:28:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc17bfff700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c104820 0x7fc17c10c350 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fc16c0565c0 tx=0x7fc16c056960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc17bfff700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c104820 0x7fc17c10c350 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fc16c0565c0 tx=0x7fc16c056960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc1797fa700 1 -- 172.21.15.80:0/754328033 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c007cd0 con 0x7fc17c104820 2019-11-28T11:28:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc1797fa700 1 -- 172.21.15.80:0/754328033 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16c0546a0 con 0x7fc17c104820 2019-11-28T11:28:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc181e68700 1 -- 172.21.15.80:0/754328033 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17c109e10 con 0x7fc17c104820 2019-11-28T11:28:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.373+0000 7fc181e68700 1 -- 172.21.15.80:0/754328033 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c109a90 con 0x7fc17c104820 2019-11-28T11:28:51.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.374+0000 7fc17bfff700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c104820 0x7fc17c10c350 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fc16c0565c0 tx=0x7fc16c056960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.374+0000 7fc1797fa700 1 -- 172.21.15.80:0/754328033 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc16c053ed0 con 0x7fc17c104820 2019-11-28T11:28:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.374+0000 7fc17bfff700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c104820 0x7fc17c10c350 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fc16c0565c0 tx=0x7fc16c056960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.374+0000 7fc1797fa700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc160018730 0x7fc16001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.374+0000 7fc1797fa700 1 -- 172.21.15.80:0/754328033 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fc16c077c40 con 0x7fc17c104820 2019-11-28T11:28:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.374+0000 7fc173fff700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc160018730 0x7fc16001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.374+0000 7fc173fff700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc160018730 0x7fc16001abc0 crc :-1 s=READY pgs=250 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:51.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.381+0000 7fc181e68700 1 -- 172.21.15.80:0/754328033 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17c109e10 con 0x7fc17c104820 2019-11-28T11:28:51.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.385+0000 7fc17bfff700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c104820 0x7fc17c10c350 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fc16c0565c0 tx=0x7fc16c056960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.385+0000 7fc1797fa700 1 -- 172.21.15.80:0/754328033 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc16c008140 con 0x7fc17c104820 2019-11-28T11:28:51.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.561+0000 7fc181e68700 1 -- 172.21.15.80:0/754328033 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc17c109a90 con 0x7fc17c104820 2019-11-28T11:28:51.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.562+0000 7fc17bfff700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c104820 0x7fc17c10c350 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fc16c0565c0 tx=0x7fc16c056960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.562+0000 7fc1797fa700 1 -- 172.21.15.80:0/754328033 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+12000 (secure 0 0 0) 0x7fc16c053ed0 con 0x7fc17c104820 2019-11-28T11:28:51.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.564+0000 7fc181e68700 1 -- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc160018730 msgr2=0x7fc16001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.564+0000 7fc181e68700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc160018730 0x7fc16001abc0 crc :-1 s=READY pgs=250 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.564+0000 7fc181e68700 1 -- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c104820 msgr2=0x7fc17c10c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.564+0000 7fc181e68700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c104820 0x7fc17c10c350 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7fc16c0565c0 tx=0x7fc16c056960).stop 2019-11-28T11:28:51.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.564+0000 7fc181e68700 1 -- 172.21.15.80:0/754328033 shutdown_connections 2019-11-28T11:28:51.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.564+0000 7fc181e68700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc160018730 0x7fc16001abc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.564+0000 7fc181e68700 1 --2- 172.21.15.80:0/754328033 >> v2:172.21.15.80:3300/0 conn(0x7fc17c10c890 0x7fc17c10b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.564+0000 7fc181e68700 1 --2- 172.21.15.80:0/754328033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc17c104820 0x7fc17c10c350 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.564+0000 7fc181e68700 1 -- 172.21.15.80:0/754328033 shutdown_connections 2019-11-28T11:28:51.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.564+0000 7fc181e68700 1 -- 172.21.15.80:0/754328033 wait complete. 2019-11-28T11:28:51.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.564+0000 7fc181e68700 1 -- 172.21.15.80:0/754328033 >> 172.21.15.80:0/754328033 conn(0x7fc17c13d620 msgr2=0x7fc17c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:51.600 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:51.600 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":53,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:28:50.796600+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:28:51.608 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:28:51.609 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:28:51.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.705+0000 7f9d2a3a0700 1 Processor -- start 2019-11-28T11:28:51.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.705+0000 7f9d2a3a0700 1 -- start start 2019-11-28T11:28:51.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.706+0000 7f9d2a3a0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d2415ed10 0x7f9d2415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:51.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.706+0000 7f9d2a3a0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9d24073020 0x7f9d24071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:51.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.706+0000 7f9d2a3a0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2406db60 con 0x7f9d240734b0 2019-11-28T11:28:51.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.706+0000 7f9d2a3a0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2406f3d0 con 0x7f9d24073020 2019-11-28T11:28:51.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.706+0000 7f9d2a3a0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2406fe00 con 0x7f9d2415ed10 2019-11-28T11:28:51.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.707+0000 7f9d23fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9d24073020 0x7f9d24071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:51.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.707+0000 7f9d2893d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d2415ed10 0x7f9d2415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:51.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.707+0000 7f9d2913e700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f9d240734b0 0x7f9d240723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:48732/0 (socket says 172.21.15.80:48732) 2019-11-28T11:28:51.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.707+0000 7f9d2913e700 1 -- 172.21.15.80:0/3332447678 learned_addr learned my addr 172.21.15.80:0/3332447678 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:51.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.707+0000 7f9d23fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9d24073020 0x7f9d24071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:48758/0 (socket says 172.21.15.80:48758) 2019-11-28T11:28:51.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.707+0000 7f9d2893d700 1 -- 172.21.15.80:0/3332447678 >> v2:172.21.15.174:3300/0 conn(0x7f9d24073020 msgr2=0x7f9d24071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:51.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.707+0000 7f9d2893d700 1 --2- 172.21.15.80:0/3332447678 >> v2:172.21.15.174:3300/0 conn(0x7f9d24073020 0x7f9d24071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:51.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.707+0000 7f9d2893d700 1 -- 172.21.15.80:0/3332447678 >> v1:172.21.15.174:6789/0 conn(0x7f9d240734b0 legacy=0x7f9d240723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.707+0000 7f9d237fe700 1 -- 172.21.15.80:0/3332447678 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608813442 0 0) 0x7f9d1c001100 con 0x7f9d240734b0 2019-11-28T11:28:51.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.707+0000 7f9d2893d700 1 -- 172.21.15.80:0/3332447678 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d24070760 con 0x7f9d2415ed10 2019-11-28T11:28:51.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.707+0000 7f9d23fff700 1 --2- 172.21.15.80:0/3332447678 >> v2:172.21.15.174:3300/0 conn(0x7f9d24073020 0x7f9d24071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:51.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.707+0000 7f9d2893d700 1 --2- 172.21.15.80:0/3332447678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d2415ed10 0x7f9d2415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9d0c00af50 tx=0x7f9d0c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.707+0000 7f9d2893d700 1 --2- 172.21.15.80:0/3332447678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d2415ed10 0x7f9d2415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9d0c00af50 tx=0x7f9d0c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.707+0000 7f9d2893d700 1 --2- 172.21.15.80:0/3332447678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d2415ed10 0x7f9d2415f100 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f9d0c00af50 tx=0x7f9d0c00b760).ready entity=mon.2 client_cookie=612bf71196250b7a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.708+0000 7f9d2893d700 1 --2- 172.21.15.80:0/3332447678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d2415ed10 0x7f9d2415f100 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f9d0c00af50 tx=0x7f9d0c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.708+0000 7f9d237fe700 1 -- 172.21.15.80:0/3332447678 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d0c007210 con 0x7f9d2415ed10 2019-11-28T11:28:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.708+0000 7f9d2893d700 1 --2- 172.21.15.80:0/3332447678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d2415ed10 0x7f9d2415f100 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f9d0c00af50 tx=0x7f9d0c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.708+0000 7f9d2893d700 1 --2- 172.21.15.80:0/3332447678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d2415ed10 0x7f9d2415f100 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f9d0c00af50 tx=0x7f9d0c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.708+0000 7f9d237fe700 1 -- 172.21.15.80:0/3332447678 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c0099b0 con 0x7f9d2415ed10 2019-11-28T11:28:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.708+0000 7f9d237fe700 1 -- 172.21.15.80:0/3332447678 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d0c00a080 con 0x7f9d2415ed10 2019-11-28T11:28:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.708+0000 7f9d2a3a0700 1 -- 172.21.15.80:0/3332447678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d2415ed10 msgr2=0x7f9d2415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.708+0000 7f9d2a3a0700 1 --2- 172.21.15.80:0/3332447678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d2415ed10 0x7f9d2415f100 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f9d0c00af50 tx=0x7f9d0c00b760).stop 2019-11-28T11:28:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.708+0000 7f9d2a3a0700 1 -- 172.21.15.80:0/3332447678 shutdown_connections 2019-11-28T11:28:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.708+0000 7f9d2a3a0700 1 --2- 172.21.15.80:0/3332447678 >> v2:172.21.15.174:3300/0 conn(0x7f9d24073020 0x7f9d24071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.708+0000 7f9d2a3a0700 1 --2- 172.21.15.80:0/3332447678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d2415ed10 0x7f9d2415f100 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.708+0000 7f9d2a3a0700 1 -- 172.21.15.80:0/3332447678 shutdown_connections 2019-11-28T11:28:51.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.708+0000 7f9d2a3a0700 1 -- 172.21.15.80:0/3332447678 wait complete. 2019-11-28T11:28:51.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.708+0000 7f9d2a3a0700 1 -- 172.21.15.80:0/3332447678 >> 172.21.15.80:0/3332447678 conn(0x7f9d24061d20 msgr2=0x7f9d240641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:51.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.711+0000 7f9d2a3a0700 1 Processor -- start 2019-11-28T11:28:51.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.711+0000 7f9d2a3a0700 1 -- start start 2019-11-28T11:28:51.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.712+0000 7f9d2a3a0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9d2410ed60 0x7f9d2410f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:51.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.712+0000 7f9d2a3a0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d2410f730 0x7f9d24167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:51.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.712+0000 7f9d2a3a0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2410c250 con 0x7f9d2410e970 2019-11-28T11:28:51.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.712+0000 7f9d2a3a0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2410e430 con 0x7f9d2410f730 2019-11-28T11:28:51.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.712+0000 7f9d2a3a0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d24105860 con 0x7f9d2410ed60 2019-11-28T11:28:51.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.712+0000 7f9d2913e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d2410f730 0x7f9d24167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:51.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.712+0000 7f9d2913e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d2410f730 0x7f9d24167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33880/0 (socket says 172.21.15.80:33880) 2019-11-28T11:28:51.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.712+0000 7f9d2913e700 1 -- 172.21.15.80:0/1980129610 learned_addr learned my addr 172.21.15.80:0/1980129610 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:51.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.712+0000 7f9d23fff700 1 --2- 172.21.15.80:0/1980129610 >> v2:172.21.15.174:3300/0 conn(0x7f9d2410ed60 0x7f9d2410f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:51.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.712+0000 7f9d2913e700 1 -- 172.21.15.80:0/1980129610 >> v2:172.21.15.174:3300/0 conn(0x7f9d2410ed60 msgr2=0x7f9d2410f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.712+0000 7f9d2913e700 1 --2- 172.21.15.80:0/1980129610 >> v2:172.21.15.174:3300/0 conn(0x7f9d2410ed60 0x7f9d2410f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.712+0000 7f9d2913e700 1 -- 172.21.15.80:0/1980129610 >> v1:172.21.15.174:6789/0 conn(0x7f9d2410e970 legacy=0x7f9d241087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.712+0000 7f9d2913e700 1 -- 172.21.15.80:0/1980129610 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d24105ef0 con 0x7f9d2410f730 2019-11-28T11:28:51.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.712+0000 7f9d2913e700 1 --2- 172.21.15.80:0/1980129610 >> v2:172.21.15.80:3300/0 conn(0x7f9d2410f730 0x7f9d24167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9d1c010450 tx=0x7f9d1c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.712+0000 7f9d2913e700 1 --2- 172.21.15.80:0/1980129610 >> v2:172.21.15.80:3300/0 conn(0x7f9d2410f730 0x7f9d24167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9d1c010450 tx=0x7f9d1c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.712+0000 7f9d2913e700 1 --2- 172.21.15.80:0/1980129610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d2410f730 0x7f9d24167d70 secure :-1 s=READY pgs=595 cs=0 l=1 rx=0x7f9d1c010450 tx=0x7f9d1c010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:51.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.713+0000 7f9d2913e700 1 --2- 172.21.15.80:0/1980129610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d2410f730 0x7f9d24167d70 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f9d1c010450 tx=0x7f9d1c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.713+0000 7f9d217fa700 1 -- 172.21.15.80:0/1980129610 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d1c000ef0 con 0x7f9d2410f730 2019-11-28T11:28:51.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.713+0000 7f9d2913e700 1 --2- 172.21.15.80:0/1980129610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d2410f730 0x7f9d24167d70 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f9d1c010450 tx=0x7f9d1c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.713+0000 7f9d2913e700 1 --2- 172.21.15.80:0/1980129610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d2410f730 0x7f9d24167d70 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f9d1c010450 tx=0x7f9d1c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.713+0000 7f9d217fa700 1 -- 172.21.15.80:0/1980129610 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c0041c0 con 0x7f9d2410f730 2019-11-28T11:28:51.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.713+0000 7f9d2a3a0700 1 -- 172.21.15.80:0/1980129610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d24106270 con 0x7f9d2410f730 2019-11-28T11:28:51.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.713+0000 7f9d217fa700 1 -- 172.21.15.80:0/1980129610 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d1c004810 con 0x7f9d2410f730 2019-11-28T11:28:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.713+0000 7f9d2a3a0700 1 -- 172.21.15.80:0/1980129610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d24105ef0 con 0x7f9d2410f730 2019-11-28T11:28:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.713+0000 7f9d2913e700 1 --2- 172.21.15.80:0/1980129610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d2410f730 0x7f9d24167d70 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f9d1c010450 tx=0x7f9d1c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.713+0000 7f9d217fa700 1 -- 172.21.15.80:0/1980129610 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9d1c0043b0 con 0x7f9d2410f730 2019-11-28T11:28:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.713+0000 7f9d2913e700 1 --2- 172.21.15.80:0/1980129610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d2410f730 0x7f9d24167d70 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f9d1c010450 tx=0x7f9d1c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.713+0000 7f9d217fa700 1 --2- 172.21.15.80:0/1980129610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d08018730 0x7f9d0801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.713+0000 7f9d217fa700 1 -- 172.21.15.80:0/1980129610 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f9d1c031cd0 con 0x7f9d2410f730 2019-11-28T11:28:51.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.714+0000 7f9d2893d700 1 --2- 172.21.15.80:0/1980129610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d08018730 0x7f9d0801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:51.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.714+0000 7f9d2893d700 1 --2- 172.21.15.80:0/1980129610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d08018730 0x7f9d0801abc0 crc :-1 s=READY pgs=251 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:51.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.720+0000 7f9d2a3a0700 1 -- 172.21.15.80:0/1980129610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d24106270 con 0x7f9d2410f730 2019-11-28T11:28:51.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.724+0000 7f9d2913e700 1 --2- 172.21.15.80:0/1980129610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d2410f730 0x7f9d24167d70 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f9d1c010450 tx=0x7f9d1c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.724+0000 7f9d217fa700 1 -- 172.21.15.80:0/1980129610 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9d1c001310 con 0x7f9d2410f730 2019-11-28T11:28:51.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.892+0000 7f9d2a3a0700 1 -- 172.21.15.80:0/1980129610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f9d2410fea0 con 0x7f9d2410f730 2019-11-28T11:28:51.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.893+0000 7f9d2913e700 1 --2- 172.21.15.80:0/1980129610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d2410f730 0x7f9d24167d70 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f9d1c010450 tx=0x7f9d1c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:51.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.893+0000 7f9d217fa700 1 -- 172.21.15.80:0/1980129610 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9d1c0041c0 con 0x7f9d2410f730 2019-11-28T11:28:51.921 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:28:51.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.895+0000 7f9d2a3a0700 1 -- 172.21.15.80:0/1980129610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d08018730 msgr2=0x7f9d0801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.895+0000 7f9d2a3a0700 1 --2- 172.21.15.80:0/1980129610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d08018730 0x7f9d0801abc0 crc :-1 s=READY pgs=251 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.895+0000 7f9d2a3a0700 1 -- 172.21.15.80:0/1980129610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d2410f730 msgr2=0x7f9d24167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:51.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.895+0000 7f9d2a3a0700 1 --2- 172.21.15.80:0/1980129610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d2410f730 0x7f9d24167d70 secure :-1 s=READY pgs=595 cs=0 l=1 rx=0x7f9d1c010450 tx=0x7f9d1c010280).stop 2019-11-28T11:28:51.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.895+0000 7f9d2a3a0700 1 -- 172.21.15.80:0/1980129610 shutdown_connections 2019-11-28T11:28:51.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.895+0000 7f9d2a3a0700 1 --2- 172.21.15.80:0/1980129610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d2410f730 0x7f9d24167d70 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.895+0000 7f9d2a3a0700 1 --2- 172.21.15.80:0/1980129610 >> v2:172.21.15.174:3300/0 conn(0x7f9d2410ed60 0x7f9d2410f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.895+0000 7f9d2a3a0700 1 --2- 172.21.15.80:0/1980129610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d08018730 0x7f9d0801abc0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:51.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.895+0000 7f9d2a3a0700 1 -- 172.21.15.80:0/1980129610 shutdown_connections 2019-11-28T11:28:51.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.896+0000 7f9d2a3a0700 1 -- 172.21.15.80:0/1980129610 wait complete. 2019-11-28T11:28:51.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:51.896+0000 7f9d2a3a0700 1 -- 172.21.15.80:0/1980129610 >> 172.21.15.80:0/1980129610 conn(0x7f9d2415e2d0 msgr2=0x7f9d24147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:51.933 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:28:52.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.024+0000 7f6dffaf5700 1 Processor -- start 2019-11-28T11:28:52.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.024+0000 7f6dffaf5700 1 -- start start 2019-11-28T11:28:52.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dffaf5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df806c0a0 0x7f6df8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:52.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dffaf5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6df80734e0 0x7f6df8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:52.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dffaf5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6df8072360 0x7f6df80727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:52.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dffaf5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df806f330 con 0x7f6df80734e0 2019-11-28T11:28:52.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dffaf5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df80706c0 con 0x7f6df8072360 2019-11-28T11:28:52.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dffaf5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df8070a40 con 0x7f6df806c0a0 2019-11-28T11:28:52.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dfd891700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6df80734e0 0x7f6df8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:52.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dfd891700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6df80734e0 0x7f6df8071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33888/0 (socket says 172.21.15.80:33888) 2019-11-28T11:28:52.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dfd891700 1 -- 172.21.15.80:0/471957396 learned_addr learned my addr 172.21.15.80:0/471957396 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:52.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dfe893700 1 --2- 172.21.15.80:0/471957396 >> v2:172.21.15.174:3300/0 conn(0x7f6df8072360 0x7f6df80727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:52.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dfe092700 1 --2- 172.21.15.80:0/471957396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df806c0a0 0x7f6df8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:52.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dfd891700 1 -- 172.21.15.80:0/471957396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df806c0a0 msgr2=0x7f6df8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:52.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dfd891700 1 --2- 172.21.15.80:0/471957396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df806c0a0 0x7f6df8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:52.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dfd891700 1 -- 172.21.15.80:0/471957396 >> v2:172.21.15.174:3300/0 conn(0x7f6df8072360 msgr2=0x7f6df80727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:52.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dfd891700 1 --2- 172.21.15.80:0/471957396 >> v2:172.21.15.174:3300/0 conn(0x7f6df8072360 0x7f6df80727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:52.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dfd891700 1 -- 172.21.15.80:0/471957396 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df806db00 con 0x7f6df80734e0 2019-11-28T11:28:52.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dfe092700 1 --2- 172.21.15.80:0/471957396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df806c0a0 0x7f6df8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:52.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.025+0000 7f6dfd891700 1 --2- 172.21.15.80:0/471957396 >> v2:172.21.15.80:3300/0 conn(0x7f6df80734e0 0x7f6df8071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6de800f740 tx=0x7f6de800f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.026+0000 7f6dfd891700 1 --2- 172.21.15.80:0/471957396 >> v2:172.21.15.80:3300/0 conn(0x7f6df80734e0 0x7f6df8071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6de800f740 tx=0x7f6de800f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.026+0000 7f6dfd891700 1 --2- 172.21.15.80:0/471957396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6df80734e0 0x7f6df8071e20 secure :-1 s=READY pgs=596 cs=0 l=1 rx=0x7f6de800f740 tx=0x7f6de800f5f0).ready entity=mon.0 client_cookie=3f85fe7f6df793d0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:52.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.026+0000 7f6dfd891700 1 --2- 172.21.15.80:0/471957396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6df80734e0 0x7f6df8071e20 secure :-1 s=THROTTLE_DONE pgs=596 cs=0 l=1 rx=0x7f6de800f740 tx=0x7f6de800f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.026+0000 7f6dfd891700 1 --2- 172.21.15.80:0/471957396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6df80734e0 0x7f6df8071e20 secure :-1 s=THROTTLE_DONE pgs=596 cs=0 l=1 rx=0x7f6de800f740 tx=0x7f6de800f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.026+0000 7f6dfd090700 1 -- 172.21.15.80:0/471957396 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6de8000960 con 0x7f6df80734e0 2019-11-28T11:28:52.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.026+0000 7f6dfd891700 1 --2- 172.21.15.80:0/471957396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6df80734e0 0x7f6df8071e20 secure :-1 s=THROTTLE_DONE pgs=596 cs=0 l=1 rx=0x7f6de800f740 tx=0x7f6de800f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.026+0000 7f6dfd090700 1 -- 172.21.15.80:0/471957396 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de8000c90 con 0x7f6df80734e0 2019-11-28T11:28:52.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.026+0000 7f6dfd090700 1 -- 172.21.15.80:0/471957396 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6de80013a0 con 0x7f6df80734e0 2019-11-28T11:28:52.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.026+0000 7f6dffaf5700 1 -- 172.21.15.80:0/471957396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6df80734e0 msgr2=0x7f6df8071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:52.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.026+0000 7f6dffaf5700 1 --2- 172.21.15.80:0/471957396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6df80734e0 0x7f6df8071e20 secure :-1 s=READY pgs=596 cs=0 l=1 rx=0x7f6de800f740 tx=0x7f6de800f5f0).stop 2019-11-28T11:28:52.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.027+0000 7f6dffaf5700 1 -- 172.21.15.80:0/471957396 shutdown_connections 2019-11-28T11:28:52.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.027+0000 7f6dffaf5700 1 --2- 172.21.15.80:0/471957396 >> v2:172.21.15.174:3300/0 conn(0x7f6df8072360 0x7f6df80727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:52.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.027+0000 7f6dffaf5700 1 --2- 172.21.15.80:0/471957396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6df80734e0 0x7f6df8071e20 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:52.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.027+0000 7f6dffaf5700 1 --2- 172.21.15.80:0/471957396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df806c0a0 0x7f6df8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:52.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.027+0000 7f6dffaf5700 1 -- 172.21.15.80:0/471957396 shutdown_connections 2019-11-28T11:28:52.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.027+0000 7f6dffaf5700 1 -- 172.21.15.80:0/471957396 wait complete. 2019-11-28T11:28:52.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.027+0000 7f6dffaf5700 1 -- 172.21.15.80:0/471957396 >> 172.21.15.80:0/471957396 conn(0x7f6df8061cf0 msgr2=0x7f6df8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.029+0000 7f6dffaf5700 1 Processor -- start 2019-11-28T11:28:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.029+0000 7f6dffaf5700 1 -- start start 2019-11-28T11:28:52.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.030+0000 7f6dffaf5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df813a780 0x7f6df812d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:52.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.030+0000 7f6dffaf5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6df812d9c0 0x7f6df812c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:52.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.030+0000 7f6dffaf5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df8139a60 con 0x7f6df812c840 2019-11-28T11:28:52.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.030+0000 7f6dffaf5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df8129830 con 0x7f6df812d9c0 2019-11-28T11:28:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.030+0000 7f6dffaf5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df812a260 con 0x7f6df813a780 2019-11-28T11:28:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.030+0000 7f6dfe092700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df813a780 0x7f6df812d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.030+0000 7f6dfe092700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df813a780 0x7f6df812d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:36150/0 (socket says 172.21.15.80:36150) 2019-11-28T11:28:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.030+0000 7f6dfd891700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6df812d9c0 0x7f6df812c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.030+0000 7f6dfe092700 1 -- 172.21.15.80:0/1049866700 learned_addr learned my addr 172.21.15.80:0/1049866700 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.030+0000 7f6dfd891700 1 -- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df813a780 msgr2=0x7f6df812d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.030+0000 7f6dfd891700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df813a780 0x7f6df812d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:52.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.030+0000 7f6dfd891700 1 -- 172.21.15.80:0/1049866700 >> v1:172.21.15.174:6789/0 conn(0x7f6df812c840 legacy=0x7f6df81281b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:52.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.030+0000 7f6dfd891700 1 -- 172.21.15.80:0/1049866700 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df812abc0 con 0x7f6df812d9c0 2019-11-28T11:28:52.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.030+0000 7f6df6ffd700 1 -- 172.21.15.80:0/1049866700 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413564641 0 0) 0x7f6df0001080 con 0x7f6df812c840 2019-11-28T11:28:52.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.031+0000 7f6dfd891700 1 --2- 172.21.15.80:0/1049866700 >> v2:172.21.15.174:3300/0 conn(0x7f6df812d9c0 0x7f6df812c300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6de80543f0 tx=0x7f6de800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.031+0000 7f6dfd891700 1 --2- 172.21.15.80:0/1049866700 >> v2:172.21.15.174:3300/0 conn(0x7f6df812d9c0 0x7f6df812c300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6de80543f0 tx=0x7f6de800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.031+0000 7f6dfd891700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6df812d9c0 0x7f6df812c300 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f6de80543f0 tx=0x7f6de800f4b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:52.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.031+0000 7f6dfd891700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6df812d9c0 0x7f6df812c300 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f6de80543f0 tx=0x7f6de800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.031+0000 7f6df6ffd700 1 -- 172.21.15.80:0/1049866700 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6de8007c20 con 0x7f6df812d9c0 2019-11-28T11:28:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.031+0000 7f6dfd891700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6df812d9c0 0x7f6df812c300 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f6de80543f0 tx=0x7f6de800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.031+0000 7f6dfd891700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6df812d9c0 0x7f6df812c300 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f6de80543f0 tx=0x7f6de800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.031+0000 7f6df6ffd700 1 -- 172.21.15.80:0/1049866700 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de8005390 con 0x7f6df812d9c0 2019-11-28T11:28:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.031+0000 7f6dffaf5700 1 -- 172.21.15.80:0/1049866700 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df812af40 con 0x7f6df812d9c0 2019-11-28T11:28:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.031+0000 7f6df6ffd700 1 -- 172.21.15.80:0/1049866700 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6de8005580 con 0x7f6df812d9c0 2019-11-28T11:28:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.031+0000 7f6dffaf5700 1 -- 172.21.15.80:0/1049866700 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df812abc0 con 0x7f6df812d9c0 2019-11-28T11:28:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.031+0000 7f6dfd891700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6df812d9c0 0x7f6df812c300 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f6de80543f0 tx=0x7f6de800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.032+0000 7f6df6ffd700 1 -- 172.21.15.80:0/1049866700 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6de8007c20 con 0x7f6df812d9c0 2019-11-28T11:28:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.032+0000 7f6dfd891700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6df812d9c0 0x7f6df812c300 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f6de80543f0 tx=0x7f6de800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.032+0000 7f6df6ffd700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ddc018730 0x7f6ddc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.032+0000 7f6df6ffd700 1 -- 172.21.15.80:0/1049866700 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f6de8075a70 con 0x7f6df812d9c0 2019-11-28T11:28:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.032+0000 7f6dfe092700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ddc018730 0x7f6ddc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.032+0000 7f6dfe092700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ddc018730 0x7f6ddc01abc0 crc :-1 s=READY pgs=252 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.039+0000 7f6dffaf5700 1 -- 172.21.15.80:0/1049866700 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df812af40 con 0x7f6df812d9c0 2019-11-28T11:28:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.043+0000 7f6dfd891700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6df812d9c0 0x7f6df812c300 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f6de80543f0 tx=0x7f6de800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.043+0000 7f6df6ffd700 1 -- 172.21.15.80:0/1049866700 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6de8005180 con 0x7f6df812d9c0 2019-11-28T11:28:52.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.206+0000 7f6dffaf5700 1 -- 172.21.15.80:0/1049866700 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6df812abc0 con 0x7f6df812d9c0 2019-11-28T11:28:52.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.207+0000 7f6dfd891700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6df812d9c0 0x7f6df812c300 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f6de80543f0 tx=0x7f6de800f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.207+0000 7f6df6ffd700 1 -- 172.21.15.80:0/1049866700 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) v1 ==== 84+0+64 (secure 0 0 0) 0x7f6de8007c20 con 0x7f6df812d9c0 2019-11-28T11:28:52.235 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:52.236 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:28:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:28:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:28:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:28:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:28:52.237 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:28:52.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.209+0000 7f6dffaf5700 1 -- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ddc018730 msgr2=0x7f6ddc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:52.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.209+0000 7f6dffaf5700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ddc018730 0x7f6ddc01abc0 crc :-1 s=READY pgs=252 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:52.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.209+0000 7f6dffaf5700 1 -- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6df812d9c0 msgr2=0x7f6df812c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:52.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.209+0000 7f6dffaf5700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6df812d9c0 0x7f6df812c300 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f6de80543f0 tx=0x7f6de800f4b0).stop 2019-11-28T11:28:52.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.210+0000 7f6dffaf5700 1 -- 172.21.15.80:0/1049866700 shutdown_connections 2019-11-28T11:28:52.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.210+0000 7f6dffaf5700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ddc018730 0x7f6ddc01abc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:52.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.210+0000 7f6dffaf5700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6df812d9c0 0x7f6df812c300 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:52.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.210+0000 7f6dffaf5700 1 --2- 172.21.15.80:0/1049866700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6df813a780 0x7f6df812d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:52.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.210+0000 7f6dffaf5700 1 -- 172.21.15.80:0/1049866700 shutdown_connections 2019-11-28T11:28:52.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.210+0000 7f6dffaf5700 1 -- 172.21.15.80:0/1049866700 wait complete. 2019-11-28T11:28:52.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.210+0000 7f6dffaf5700 1 -- 172.21.15.80:0/1049866700 >> 172.21.15.80:0/1049866700 conn(0x7f6df8127dc0 msgr2=0x7f6df8141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:52.247 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:28:52.247 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:28:52.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.343+0000 7f364d670700 1 Processor -- start 2019-11-28T11:28:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.343+0000 7f364d670700 1 -- start start 2019-11-28T11:28:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.344+0000 7f364d670700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f364815f100 0x7f364806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.344+0000 7f364d670700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f364806c2f0 0x7f364806c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.344+0000 7f364d670700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364806db60 con 0x7f364815ed10 2019-11-28T11:28:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.344+0000 7f364d670700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364806fe00 con 0x7f364815f100 2019-11-28T11:28:52.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.344+0000 7f364d670700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36480700d0 con 0x7f364806c2f0 2019-11-28T11:28:52.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.344+0000 7f36477fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f364815ed10 0x7f3648073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33214/0 (socket says 172.21.15.80:33214) 2019-11-28T11:28:52.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.344+0000 7f36477fe700 1 -- 172.21.15.80:0/2318988307 learned_addr learned my addr 172.21.15.80:0/2318988307 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:52.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.344+0000 7f3647fff700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f364806c2f0 0x7f364806c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:52.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.344+0000 7f3646ffd700 1 --2- 172.21.15.80:0/2318988307 >> v2:172.21.15.174:3300/0 conn(0x7f364815f100 0x7f364806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.344+0000 7f36467fc700 1 -- 172.21.15.80:0/2318988307 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132181157 0 0) 0x7f3638001150 con 0x7f364815ed10 2019-11-28T11:28:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36467fc700 1 -- 172.21.15.80:0/2318988307 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3628002e80 con 0x7f364815ed10 2019-11-28T11:28:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36467fc700 1 -- 172.21.15.80:0/2318988307 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 66643055 0 0) 0x7f3638001130 con 0x7f364815ed10 2019-11-28T11:28:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36467fc700 1 -- 172.21.15.80:0/2318988307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f364806c2f0 msgr2=0x7f364806c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36467fc700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f364806c2f0 0x7f364806c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:52.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36467fc700 1 -- 172.21.15.80:0/2318988307 >> v2:172.21.15.174:3300/0 conn(0x7f364815f100 msgr2=0x7f364806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:52.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36467fc700 1 --2- 172.21.15.80:0/2318988307 >> v2:172.21.15.174:3300/0 conn(0x7f364815f100 0x7f364806bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:52.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36467fc700 1 -- 172.21.15.80:0/2318988307 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3648070760 con 0x7f364815ed10 2019-11-28T11:28:52.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36467fc700 1 -- 172.21.15.80:0/2318988307 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f36380016c0 con 0x7f364815ed10 2019-11-28T11:28:52.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f3647fff700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f364806c2f0 0x7f364806c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:52.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36467fc700 1 -- 172.21.15.80:0/2318988307 >> v1:172.21.15.80:6789/0 conn(0x7f364815ed10 legacy=0x7f3648073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:52.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36467fc700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280479e0 0x7f3628049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:52.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36467fc700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362804a5c0 0x7f362804ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:52.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36467fc700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f362804d260 0x7f362804f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:52.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36467fc700 1 -- 172.21.15.80:0/2318988307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362804ff40 con 0x7f36280479e0 2019-11-28T11:28:52.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36467fc700 1 -- 172.21.15.80:0/2318988307 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3628050100 con 0x7f362804d260 2019-11-28T11:28:52.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36467fc700 1 -- 172.21.15.80:0/2318988307 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3628050330 con 0x7f362804a5c0 2019-11-28T11:28:52.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36477fe700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280479e0 0x7f3628049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:52.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f3646ffd700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362804a5c0 0x7f362804ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:52.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f3647fff700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f362804d260 0x7f362804f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:52.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36477fe700 1 -- 172.21.15.80:0/2318988307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362804a5c0 msgr2=0x7f362804ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36477fe700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362804a5c0 0x7f362804ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36477fe700 1 -- 172.21.15.80:0/2318988307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f362804d260 msgr2=0x7f362804f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36477fe700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f362804d260 0x7f362804f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:52.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36477fe700 1 -- 172.21.15.80:0/2318988307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36280505e0 con 0x7f36280479e0 2019-11-28T11:28:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36477fe700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280479e0 0x7f3628049e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f363800f830 tx=0x7f3638001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36477fe700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280479e0 0x7f3628049e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f363800f830 tx=0x7f3638001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36477fe700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280479e0 0x7f3628049e40 secure :-1 s=READY pgs=598 cs=0 l=1 rx=0x7f363800f830 tx=0x7f3638001810).ready entity=mon.0 client_cookie=29b267f5d8c55b88 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.345+0000 7f36477fe700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280479e0 0x7f3628049e40 secure :-1 s=THROTTLE_DONE pgs=598 cs=0 l=1 rx=0x7f363800f830 tx=0x7f3638001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.346+0000 7f36477fe700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280479e0 0x7f3628049e40 secure :-1 s=THROTTLE_DONE pgs=598 cs=0 l=1 rx=0x7f363800f830 tx=0x7f3638001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.346+0000 7f36467fc700 1 -- 172.21.15.80:0/2318988307 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3638001890 con 0x7f36280479e0 2019-11-28T11:28:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.346+0000 7f36477fe700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280479e0 0x7f3628049e40 secure :-1 s=THROTTLE_DONE pgs=598 cs=0 l=1 rx=0x7f363800f830 tx=0x7f3638001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.346+0000 7f36467fc700 1 -- 172.21.15.80:0/2318988307 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3638004240 con 0x7f36280479e0 2019-11-28T11:28:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.346+0000 7f36467fc700 1 -- 172.21.15.80:0/2318988307 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3638004910 con 0x7f36280479e0 2019-11-28T11:28:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.346+0000 7f364d670700 1 -- 172.21.15.80:0/2318988307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280479e0 msgr2=0x7f3628049e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:52.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.346+0000 7f364d670700 1 --2- 172.21.15.80:0/2318988307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280479e0 0x7f3628049e40 secure :-1 s=READY pgs=598 cs=0 l=1 rx=0x7f363800f830 tx=0x7f3638001810).stop 2019-11-28T11:28:52.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.346+0000 7f3647fff700 1 -- 172.21.15.80:0/2318988307 reap_dead start 2019-11-28T11:28:52.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.346+0000 7f364d670700 1 -- 172.21.15.80:0/2318988307 shutdown_connections 2019-11-28T11:28:52.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.346+0000 7f364d670700 1 -- 172.21.15.80:0/2318988307 shutdown_connections 2019-11-28T11:28:52.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.346+0000 7f364d670700 1 -- 172.21.15.80:0/2318988307 wait complete. 2019-11-28T11:28:52.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.346+0000 7f364d670700 1 -- 172.21.15.80:0/2318988307 >> 172.21.15.80:0/2318988307 conn(0x7f3648061d20 msgr2=0x7f36480641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:52.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.349+0000 7f364d670700 1 Processor -- start 2019-11-28T11:28:52.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.349+0000 7f364d670700 1 -- start start 2019-11-28T11:28:52.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f364d670700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3648108630 0x7f3648151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:52.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f364d670700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3648150ae0 0x7f3648167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:52.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f364d670700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3648133a20 con 0x7f3648151740 2019-11-28T11:28:52.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f364d670700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3648130f50 con 0x7f3648150ae0 2019-11-28T11:28:52.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f364d670700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3648131980 con 0x7f3648108630 2019-11-28T11:28:52.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f3646ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3648151740 0x7f36481502e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33226/0 (socket says 172.21.15.80:33226) 2019-11-28T11:28:52.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f3646ffd700 1 -- 172.21.15.80:0/1214597609 learned_addr learned my addr 172.21.15.80:0/1214597609 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:52.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f36477fe700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3648108630 0x7f3648151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:52.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f3647fff700 1 --2- 172.21.15.80:0/1214597609 >> v2:172.21.15.174:3300/0 conn(0x7f3648150ae0 0x7f3648167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:52.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f363ffff700 1 -- 172.21.15.80:0/1214597609 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567636260 0 0) 0x7f3630001360 con 0x7f3648151740 2019-11-28T11:28:52.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f363ffff700 1 -- 172.21.15.80:0/1214597609 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3620002e80 con 0x7f3648151740 2019-11-28T11:28:52.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f363ffff700 1 -- 172.21.15.80:0/1214597609 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 501090687 0 0) 0x7f3630001580 con 0x7f3648151740 2019-11-28T11:28:52.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f36477fe700 1 -- 172.21.15.80:0/1214597609 >> v2:172.21.15.174:3300/0 conn(0x7f3648150ae0 msgr2=0x7f3648167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:52.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f36477fe700 1 --2- 172.21.15.80:0/1214597609 >> v2:172.21.15.174:3300/0 conn(0x7f3648150ae0 0x7f3648167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:52.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f36477fe700 1 -- 172.21.15.80:0/1214597609 >> v1:172.21.15.80:6789/0 conn(0x7f3648151740 legacy=0x7f36481502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:52.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f36477fe700 1 -- 172.21.15.80:0/1214597609 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36481322e0 con 0x7f3648108630 2019-11-28T11:28:52.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f36477fe700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3648108630 0x7f3648151200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3638010370 tx=0x7f36380101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f36477fe700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3648108630 0x7f3648151200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3638010370 tx=0x7f36380101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f36477fe700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3648108630 0x7f3648151200 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f3638010370 tx=0x7f36380101a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:52.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f36477fe700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3648108630 0x7f3648151200 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f3638010370 tx=0x7f36380101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.350+0000 7f363ffff700 1 -- 172.21.15.80:0/1214597609 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3638001bc0 con 0x7f3648108630 2019-11-28T11:28:52.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.351+0000 7f36477fe700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3648108630 0x7f3648151200 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f3638010370 tx=0x7f36380101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.351+0000 7f36477fe700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3648108630 0x7f3648151200 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f3638010370 tx=0x7f36380101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.351+0000 7f363ffff700 1 -- 172.21.15.80:0/1214597609 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3638001830 con 0x7f3648108630 2019-11-28T11:28:52.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.351+0000 7f364d670700 1 -- 172.21.15.80:0/1214597609 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3648132660 con 0x7f3648108630 2019-11-28T11:28:52.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.351+0000 7f363ffff700 1 -- 172.21.15.80:0/1214597609 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3638004810 con 0x7f3648108630 2019-11-28T11:28:52.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.351+0000 7f364d670700 1 -- 172.21.15.80:0/1214597609 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36481322e0 con 0x7f3648108630 2019-11-28T11:28:52.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.351+0000 7f36477fe700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3648108630 0x7f3648151200 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f3638010370 tx=0x7f36380101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.351+0000 7f363ffff700 1 -- 172.21.15.80:0/1214597609 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3638001a20 con 0x7f3648108630 2019-11-28T11:28:52.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.351+0000 7f36477fe700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3648108630 0x7f3648151200 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f3638010370 tx=0x7f36380101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.351+0000 7f363ffff700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3620018780 0x7f362001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:52.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.351+0000 7f363ffff700 1 -- 172.21.15.80:0/1214597609 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f36380319e0 con 0x7f3648108630 2019-11-28T11:28:52.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.352+0000 7f3646ffd700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3620018780 0x7f362001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:52.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.352+0000 7f3646ffd700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3620018780 0x7f362001abf0 crc :-1 s=READY pgs=253 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:52.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.358+0000 7f364d670700 1 -- 172.21.15.80:0/1214597609 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3648132660 con 0x7f3648108630 2019-11-28T11:28:52.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.363+0000 7f36477fe700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3648108630 0x7f3648151200 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f3638010370 tx=0x7f36380101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.363+0000 7f363ffff700 1 -- 172.21.15.80:0/1214597609 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f36380013e0 con 0x7f3648108630 2019-11-28T11:28:52.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.533+0000 7f364d670700 1 -- 172.21.15.80:0/1214597609 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f36481322e0 con 0x7f3648108630 2019-11-28T11:28:52.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.814+0000 7f36477fe700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3648108630 0x7f3648151200 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f3638010370 tx=0x7f36380101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:52.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.814+0000 7f363ffff700 1 -- 172.21.15.80:0/1214597609 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v54) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3638001a20 con 0x7f3648108630 2019-11-28T11:28:52.875 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:28:52.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.849+0000 7f364d670700 1 -- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3620018780 msgr2=0x7f362001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:52.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.849+0000 7f364d670700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3620018780 0x7f362001abf0 crc :-1 s=READY pgs=253 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:52.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.849+0000 7f364d670700 1 -- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3648108630 msgr2=0x7f3648151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:52.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.849+0000 7f364d670700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3648108630 0x7f3648151200 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f3638010370 tx=0x7f36380101a0).stop 2019-11-28T11:28:52.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.849+0000 7f364d670700 1 -- 172.21.15.80:0/1214597609 shutdown_connections 2019-11-28T11:28:52.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.849+0000 7f364d670700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3620018780 0x7f362001abf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:52.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.849+0000 7f364d670700 1 --2- 172.21.15.80:0/1214597609 >> v2:172.21.15.174:3300/0 conn(0x7f3648150ae0 0x7f3648167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:52.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.849+0000 7f364d670700 1 --2- 172.21.15.80:0/1214597609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3648108630 0x7f3648151200 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:52.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.849+0000 7f364d670700 1 -- 172.21.15.80:0/1214597609 shutdown_connections 2019-11-28T11:28:52.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.849+0000 7f364d670700 1 -- 172.21.15.80:0/1214597609 wait complete. 2019-11-28T11:28:52.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.849+0000 7f364d670700 1 -- 172.21.15.80:0/1214597609 >> 172.21.15.80:0/1214597609 conn(0x7f364814dbb0 msgr2=0x7f3648142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:52.887 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:28:53.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.981+0000 7f347386d700 1 Processor -- start 2019-11-28T11:28:53.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.981+0000 7f347386d700 1 -- start start 2019-11-28T11:28:53.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.982+0000 7f347386d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f346c15f100 0x7f346c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:53.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.982+0000 7f347386d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346c06c2f0 0x7f346c06c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:53.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.982+0000 7f347386d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c06db60 con 0x7f346c15ed10 2019-11-28T11:28:53.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.982+0000 7f347386d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c06fe00 con 0x7f346c15f100 2019-11-28T11:28:53.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.982+0000 7f347386d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0700d0 con 0x7f346c06c2f0 2019-11-28T11:28:53.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.982+0000 7f3471609700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f346c15f100 0x7f346c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:53.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.982+0000 7f3471609700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f346c15f100 0x7f346c06bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33920/0 (socket says 172.21.15.80:33920) 2019-11-28T11:28:53.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.982+0000 7f3471609700 1 -- 172.21.15.80:0/3453237341 learned_addr learned my addr 172.21.15.80:0/3453237341 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:53.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.982+0000 7f347260b700 1 --2- 172.21.15.80:0/3453237341 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346c06c2f0 0x7f346c06c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:53.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.983+0000 7f3471609700 1 -- 172.21.15.80:0/3453237341 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346c06c2f0 msgr2=0x7f346c06c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:53.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.983+0000 7f3471609700 1 --2- 172.21.15.80:0/3453237341 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346c06c2f0 0x7f346c06c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:53.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.983+0000 7f3471609700 1 -- 172.21.15.80:0/3453237341 >> v1:172.21.15.80:6789/0 conn(0x7f346c15ed10 legacy=0x7f346c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:53.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.983+0000 7f3471609700 1 -- 172.21.15.80:0/3453237341 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c070760 con 0x7f346c15f100 2019-11-28T11:28:53.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.983+0000 7f3470e08700 1 -- 172.21.15.80:0/3453237341 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014150156 0 0) 0x7f345c001100 con 0x7f346c15ed10 2019-11-28T11:28:53.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.983+0000 7f3471609700 1 --2- 172.21.15.80:0/3453237341 >> v2:172.21.15.80:3300/0 conn(0x7f346c15f100 0x7f346c06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f345400f6c0 tx=0x7f345400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:53.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.983+0000 7f3471609700 1 --2- 172.21.15.80:0/3453237341 >> v2:172.21.15.80:3300/0 conn(0x7f346c15f100 0x7f346c06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f345400f6c0 tx=0x7f345400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:53.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.983+0000 7f3471609700 1 --2- 172.21.15.80:0/3453237341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c15f100 0x7f346c06bdb0 secure :-1 s=READY pgs=601 cs=0 l=1 rx=0x7f345400f6c0 tx=0x7f345400fa60).ready entity=mon.0 client_cookie=1315038ec4e58990 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:53.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.983+0000 7f3471609700 1 --2- 172.21.15.80:0/3453237341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c15f100 0x7f346c06bdb0 secure :-1 s=THROTTLE_DONE pgs=601 cs=0 l=1 rx=0x7f345400f6c0 tx=0x7f345400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:53.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.983+0000 7f3471609700 1 --2- 172.21.15.80:0/3453237341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c15f100 0x7f346c06bdb0 secure :-1 s=THROTTLE_DONE pgs=601 cs=0 l=1 rx=0x7f345400f6c0 tx=0x7f345400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:53.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.983+0000 7f3470e08700 1 -- 172.21.15.80:0/3453237341 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3454000960 con 0x7f346c15f100 2019-11-28T11:28:53.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.983+0000 7f3471609700 1 --2- 172.21.15.80:0/3453237341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c15f100 0x7f346c06bdb0 secure :-1 s=THROTTLE_DONE pgs=601 cs=0 l=1 rx=0x7f345400f6c0 tx=0x7f345400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:53.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.983+0000 7f3470e08700 1 -- 172.21.15.80:0/3453237341 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3454000c90 con 0x7f346c15f100 2019-11-28T11:28:53.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.983+0000 7f3470e08700 1 -- 172.21.15.80:0/3453237341 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3454001320 con 0x7f346c15f100 2019-11-28T11:28:53.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.983+0000 7f347386d700 1 -- 172.21.15.80:0/3453237341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c15f100 msgr2=0x7f346c06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:53.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.983+0000 7f347386d700 1 --2- 172.21.15.80:0/3453237341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c15f100 0x7f346c06bdb0 secure :-1 s=READY pgs=601 cs=0 l=1 rx=0x7f345400f6c0 tx=0x7f345400fa60).stop 2019-11-28T11:28:53.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.984+0000 7f347386d700 1 -- 172.21.15.80:0/3453237341 shutdown_connections 2019-11-28T11:28:53.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.984+0000 7f347386d700 1 --2- 172.21.15.80:0/3453237341 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346c06c2f0 0x7f346c06c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:53.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.984+0000 7f347386d700 1 --2- 172.21.15.80:0/3453237341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c15f100 0x7f346c06bdb0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:53.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.984+0000 7f347386d700 1 -- 172.21.15.80:0/3453237341 shutdown_connections 2019-11-28T11:28:53.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.984+0000 7f347386d700 1 -- 172.21.15.80:0/3453237341 wait complete. 2019-11-28T11:28:53.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.984+0000 7f347386d700 1 -- 172.21.15.80:0/3453237341 >> 172.21.15.80:0/3453237341 conn(0x7f346c061d20 msgr2=0x7f346c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:53.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.986+0000 7f347386d700 1 Processor -- start 2019-11-28T11:28:53.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.986+0000 7f347386d700 1 -- start start 2019-11-28T11:28:53.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.987+0000 7f347386d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f346c10ed60 0x7f346c10f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:53.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.987+0000 7f347386d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346c10f730 0x7f346c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:53.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.987+0000 7f347386d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c10c250 con 0x7f346c10e970 2019-11-28T11:28:53.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.987+0000 7f347386d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c10e430 con 0x7f346c10ed60 2019-11-28T11:28:53.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.987+0000 7f347386d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c105860 con 0x7f346c10f730 2019-11-28T11:28:53.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.987+0000 7f3471609700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f346c10ed60 0x7f346c10f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:53.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.987+0000 7f3471609700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f346c10ed60 0x7f346c10f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33924/0 (socket says 172.21.15.80:33924) 2019-11-28T11:28:53.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.987+0000 7f3471609700 1 -- 172.21.15.80:0/752835364 learned_addr learned my addr 172.21.15.80:0/752835364 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:53.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.987+0000 7f347260b700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346c10f730 0x7f346c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:53.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.988+0000 7f3471609700 1 -- 172.21.15.80:0/752835364 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346c10f730 msgr2=0x7f346c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:53.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.988+0000 7f3471609700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346c10f730 0x7f346c167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:53.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.988+0000 7f3471609700 1 -- 172.21.15.80:0/752835364 >> v1:172.21.15.174:6789/0 conn(0x7f346c10e970 legacy=0x7f346c1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:53.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.988+0000 7f3471609700 1 -- 172.21.15.80:0/752835364 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c105ef0 con 0x7f346c10ed60 2019-11-28T11:28:53.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.988+0000 7f3471609700 1 --2- 172.21.15.80:0/752835364 >> v2:172.21.15.80:3300/0 conn(0x7f346c10ed60 0x7f346c10f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f34540102c0 tx=0x7f3454012900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:53.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.988+0000 7f3471609700 1 --2- 172.21.15.80:0/752835364 >> v2:172.21.15.80:3300/0 conn(0x7f346c10ed60 0x7f346c10f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f34540102c0 tx=0x7f3454012900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:53.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.988+0000 7f3471609700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c10ed60 0x7f346c10f1f0 secure :-1 s=READY pgs=602 cs=0 l=1 rx=0x7f34540102c0 tx=0x7f3454012900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:53.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.988+0000 7f3471609700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c10ed60 0x7f346c10f1f0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7f34540102c0 tx=0x7f3454012900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:53.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.988+0000 7f3471609700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c10ed60 0x7f346c10f1f0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7f34540102c0 tx=0x7f3454012900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:53.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.988+0000 7f346a7fc700 1 -- 172.21.15.80:0/752835364 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3454007980 con 0x7f346c10ed60 2019-11-28T11:28:53.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.988+0000 7f3471609700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c10ed60 0x7f346c10f1f0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7f34540102c0 tx=0x7f3454012900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:53.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.988+0000 7f346a7fc700 1 -- 172.21.15.80:0/752835364 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3454000e40 con 0x7f346c10ed60 2019-11-28T11:28:53.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.988+0000 7f347386d700 1 -- 172.21.15.80:0/752835364 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c106270 con 0x7f346c10ed60 2019-11-28T11:28:53.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.988+0000 7f346a7fc700 1 -- 172.21.15.80:0/752835364 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3454001510 con 0x7f346c10ed60 2019-11-28T11:28:53.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.988+0000 7f347386d700 1 -- 172.21.15.80:0/752835364 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c105ef0 con 0x7f346c10ed60 2019-11-28T11:28:53.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.988+0000 7f3471609700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c10ed60 0x7f346c10f1f0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7f34540102c0 tx=0x7f3454012900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:53.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.989+0000 7f346a7fc700 1 -- 172.21.15.80:0/752835364 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3454007960 con 0x7f346c10ed60 2019-11-28T11:28:53.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.989+0000 7f3471609700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c10ed60 0x7f346c10f1f0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7f34540102c0 tx=0x7f3454012900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:53.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.989+0000 7f346a7fc700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3450018730 0x7f345001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:53.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.989+0000 7f346a7fc700 1 -- 172.21.15.80:0/752835364 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f3454033f40 con 0x7f346c10ed60 2019-11-28T11:28:53.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.989+0000 7f3471e0a700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3450018730 0x7f345001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:53.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.989+0000 7f3471e0a700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3450018730 0x7f345001abc0 crc :-1 s=READY pgs=254 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:53.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:52.996+0000 7f347386d700 1 -- 172.21.15.80:0/752835364 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346c106270 con 0x7f346c10ed60 2019-11-28T11:28:53.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.000+0000 7f3471609700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c10ed60 0x7f346c10f1f0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7f34540102c0 tx=0x7f3454012900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:53.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.000+0000 7f346a7fc700 1 -- 172.21.15.80:0/752835364 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3454007580 con 0x7f346c10ed60 2019-11-28T11:28:53.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.168+0000 7f347386d700 1 -- 172.21.15.80:0/752835364 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f346c105ef0 con 0x7f346c10ed60 2019-11-28T11:28:53.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.815+0000 7f3471609700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c10ed60 0x7f346c10f1f0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7f34540102c0 tx=0x7f3454012900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:53.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.815+0000 7f346a7fc700 1 -- 172.21.15.80:0/752835364 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v55) v1 ==== 125+0+0 (secure 0 0 0) 0x7f34540078c0 con 0x7f346c10ed60 2019-11-28T11:28:53.861 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:28:53.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.835+0000 7f347386d700 1 -- 172.21.15.80:0/752835364 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3450018730 msgr2=0x7f345001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:53.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.836+0000 7f347386d700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3450018730 0x7f345001abc0 crc :-1 s=READY pgs=254 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:53.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.836+0000 7f347386d700 1 -- 172.21.15.80:0/752835364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c10ed60 msgr2=0x7f346c10f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:53.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.836+0000 7f347386d700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c10ed60 0x7f346c10f1f0 secure :-1 s=READY pgs=602 cs=0 l=1 rx=0x7f34540102c0 tx=0x7f3454012900).stop 2019-11-28T11:28:53.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.836+0000 7f347386d700 1 -- 172.21.15.80:0/752835364 shutdown_connections 2019-11-28T11:28:53.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.836+0000 7f347386d700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346c10f730 0x7f346c167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:53.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.836+0000 7f347386d700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f346c10ed60 0x7f346c10f1f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:53.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.836+0000 7f347386d700 1 --2- 172.21.15.80:0/752835364 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3450018730 0x7f345001abc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:53.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.836+0000 7f347386d700 1 -- 172.21.15.80:0/752835364 shutdown_connections 2019-11-28T11:28:53.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.836+0000 7f347386d700 1 -- 172.21.15.80:0/752835364 wait complete. 2019-11-28T11:28:53.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.836+0000 7f347386d700 1 -- 172.21.15.80:0/752835364 >> 172.21.15.80:0/752835364 conn(0x7f346c15e2d0 msgr2=0x7f346c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:53.876 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:28:54.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.976+0000 7f64a8c6c700 1 Processor -- start 2019-11-28T11:28:54.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.976+0000 7f64a8c6c700 1 -- start start 2019-11-28T11:28:54.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.977+0000 7f64a8c6c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f64a415f100 0x7f64a406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:54.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.977+0000 7f64a8c6c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64a406c2f0 0x7f64a406c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:54.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.977+0000 7f64a8c6c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a406db60 con 0x7f64a415ed10 2019-11-28T11:28:54.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.977+0000 7f64a8c6c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a406fe00 con 0x7f64a415f100 2019-11-28T11:28:54.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.977+0000 7f64a8c6c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a40700d0 con 0x7f64a406c2f0 2019-11-28T11:28:54.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.977+0000 7f64a259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f64a415f100 0x7f64a406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.977+0000 7f64a2d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f64a415ed10 0x7f64a4073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33246/0 (socket says 172.21.15.80:33246) 2019-11-28T11:28:54.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.977+0000 7f64a259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f64a415f100 0x7f64a406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33934/0 (socket says 172.21.15.80:33934) 2019-11-28T11:28:54.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.977+0000 7f64a2d9d700 1 -- 172.21.15.80:0/1009303609 learned_addr learned my addr 172.21.15.80:0/1009303609 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:54.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.977+0000 7f64a359e700 1 --2- 172.21.15.80:0/1009303609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64a406c2f0 0x7f64a406c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.977+0000 7f64a1d9b700 1 -- 172.21.15.80:0/1009303609 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397730250 0 0) 0x7f648c0014d0 con 0x7f64a415ed10 2019-11-28T11:28:54.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.978+0000 7f64a1d9b700 1 -- 172.21.15.80:0/1009303609 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6484002e80 con 0x7f64a415ed10 2019-11-28T11:28:54.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.978+0000 7f64a259c700 1 -- 172.21.15.80:0/1009303609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64a406c2f0 msgr2=0x7f64a406c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:54.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.978+0000 7f64a259c700 1 --2- 172.21.15.80:0/1009303609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64a406c2f0 0x7f64a406c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:54.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.978+0000 7f64a259c700 1 -- 172.21.15.80:0/1009303609 >> v1:172.21.15.80:6789/0 conn(0x7f64a415ed10 legacy=0x7f64a4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.978+0000 7f64a259c700 1 -- 172.21.15.80:0/1009303609 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a4070760 con 0x7f64a415f100 2019-11-28T11:28:54.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.978+0000 7f64a259c700 1 --2- 172.21.15.80:0/1009303609 >> v2:172.21.15.80:3300/0 conn(0x7f64a415f100 0x7f64a406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f649400af50 tx=0x7f649400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.978+0000 7f64a259c700 1 --2- 172.21.15.80:0/1009303609 >> v2:172.21.15.80:3300/0 conn(0x7f64a415f100 0x7f64a406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f649400af50 tx=0x7f649400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.978+0000 7f64a259c700 1 --2- 172.21.15.80:0/1009303609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a415f100 0x7f64a406bdb0 secure :-1 s=READY pgs=604 cs=0 l=1 rx=0x7f649400af50 tx=0x7f649400b250).ready entity=mon.0 client_cookie=b5ed6c559513d904 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:54.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.978+0000 7f64a259c700 1 --2- 172.21.15.80:0/1009303609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a415f100 0x7f64a406bdb0 secure :-1 s=THROTTLE_DONE pgs=604 cs=0 l=1 rx=0x7f649400af50 tx=0x7f649400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.978+0000 7f64a1d9b700 1 -- 172.21.15.80:0/1009303609 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6494007210 con 0x7f64a415f100 2019-11-28T11:28:54.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.978+0000 7f64a259c700 1 --2- 172.21.15.80:0/1009303609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a415f100 0x7f64a406bdb0 secure :-1 s=THROTTLE_DONE pgs=604 cs=0 l=1 rx=0x7f649400af50 tx=0x7f649400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.978+0000 7f64a259c700 1 --2- 172.21.15.80:0/1009303609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a415f100 0x7f64a406bdb0 secure :-1 s=THROTTLE_DONE pgs=604 cs=0 l=1 rx=0x7f649400af50 tx=0x7f649400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.978+0000 7f64a1d9b700 1 -- 172.21.15.80:0/1009303609 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64940099b0 con 0x7f64a415f100 2019-11-28T11:28:54.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.978+0000 7f64a1d9b700 1 -- 172.21.15.80:0/1009303609 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f649400a080 con 0x7f64a415f100 2019-11-28T11:28:54.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.978+0000 7f64a8c6c700 1 -- 172.21.15.80:0/1009303609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a415f100 msgr2=0x7f64a406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.978+0000 7f64a8c6c700 1 --2- 172.21.15.80:0/1009303609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a415f100 0x7f64a406bdb0 secure :-1 s=READY pgs=604 cs=0 l=1 rx=0x7f649400af50 tx=0x7f649400b250).stop 2019-11-28T11:28:54.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.979+0000 7f64a8c6c700 1 -- 172.21.15.80:0/1009303609 shutdown_connections 2019-11-28T11:28:54.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.979+0000 7f64a8c6c700 1 --2- 172.21.15.80:0/1009303609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64a406c2f0 0x7f64a406c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:54.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.979+0000 7f64a8c6c700 1 --2- 172.21.15.80:0/1009303609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a415f100 0x7f64a406bdb0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:54.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.979+0000 7f64a8c6c700 1 -- 172.21.15.80:0/1009303609 shutdown_connections 2019-11-28T11:28:54.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.979+0000 7f64a8c6c700 1 -- 172.21.15.80:0/1009303609 wait complete. 2019-11-28T11:28:54.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.979+0000 7f64a8c6c700 1 -- 172.21.15.80:0/1009303609 >> 172.21.15.80:0/1009303609 conn(0x7f64a4061d20 msgr2=0x7f64a40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:54.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.981+0000 7f64a8c6c700 1 Processor -- start 2019-11-28T11:28:54.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.981+0000 7f64a8c6c700 1 -- start start 2019-11-28T11:28:54.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.982+0000 7f64a8c6c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64a410e970 0x7f64a41087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:54.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.982+0000 7f64a8c6c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f64a4108cf0 0x7f64a4107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:54.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.982+0000 7f64a8c6c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a410c250 con 0x7f64a4107b70 2019-11-28T11:28:54.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.982+0000 7f64a8c6c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a410da00 con 0x7f64a4108cf0 2019-11-28T11:28:54.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.982+0000 7f64a8c6c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a410e430 con 0x7f64a410e970 2019-11-28T11:28:54.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.982+0000 7f64a259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f64a4108cf0 0x7f64a4107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.982+0000 7f64a259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f64a4108cf0 0x7f64a4107630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33938/0 (socket says 172.21.15.80:33938) 2019-11-28T11:28:54.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.982+0000 7f64a259c700 1 -- 172.21.15.80:0/3968948463 learned_addr learned my addr 172.21.15.80:0/3968948463 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:54.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.982+0000 7f64a2d9d700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64a410e970 0x7f64a41087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.982+0000 7f64a259c700 1 -- 172.21.15.80:0/3968948463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64a410e970 msgr2=0x7f64a41087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.982+0000 7f64a259c700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64a410e970 0x7f64a41087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:54.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.982+0000 7f64a259c700 1 -- 172.21.15.80:0/3968948463 >> v1:172.21.15.174:6789/0 conn(0x7f64a4107b70 legacy=0x7f64a410ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.982+0000 7f64a259c700 1 -- 172.21.15.80:0/3968948463 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a4105ef0 con 0x7f64a4108cf0 2019-11-28T11:28:54.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.982+0000 7f64a2d9d700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64a410e970 0x7f64a41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:28:54.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.982+0000 7f64a259c700 1 --2- 172.21.15.80:0/3968948463 >> v2:172.21.15.80:3300/0 conn(0x7f64a4108cf0 0x7f64a4107630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6494010410 tx=0x7f64940107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.983+0000 7f64a259c700 1 --2- 172.21.15.80:0/3968948463 >> v2:172.21.15.80:3300/0 conn(0x7f64a4108cf0 0x7f64a4107630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6494010410 tx=0x7f64940107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.983+0000 7f64a259c700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a4108cf0 0x7f64a4107630 secure :-1 s=READY pgs=605 cs=0 l=1 rx=0x7f6494010410 tx=0x7f64940107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:54.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.983+0000 7f64a259c700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a4108cf0 0x7f64a4107630 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7f6494010410 tx=0x7f64940107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.983+0000 7f64a259c700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a4108cf0 0x7f64a4107630 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7f6494010410 tx=0x7f64940107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.983+0000 7f649b7fe700 1 -- 172.21.15.80:0/3968948463 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6494000940 con 0x7f64a4108cf0 2019-11-28T11:28:54.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.983+0000 7f64a259c700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a4108cf0 0x7f64a4107630 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7f6494010410 tx=0x7f64940107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.983+0000 7f649b7fe700 1 -- 172.21.15.80:0/3968948463 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6494009980 con 0x7f64a4108cf0 2019-11-28T11:28:54.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.983+0000 7f64a8c6c700 1 -- 172.21.15.80:0/3968948463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a4106270 con 0x7f64a4108cf0 2019-11-28T11:28:54.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.983+0000 7f649b7fe700 1 -- 172.21.15.80:0/3968948463 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f649400a050 con 0x7f64a4108cf0 2019-11-28T11:28:54.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.983+0000 7f64a8c6c700 1 -- 172.21.15.80:0/3968948463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a4105ef0 con 0x7f64a4108cf0 2019-11-28T11:28:54.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.983+0000 7f64a259c700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a4108cf0 0x7f64a4107630 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7f6494010410 tx=0x7f64940107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.983+0000 7f649b7fe700 1 -- 172.21.15.80:0/3968948463 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6494009b70 con 0x7f64a4108cf0 2019-11-28T11:28:54.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.983+0000 7f64a259c700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a4108cf0 0x7f64a4107630 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7f6494010410 tx=0x7f64940107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.984+0000 7f649b7fe700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f647c018730 0x7f647c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:54.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.984+0000 7f649b7fe700 1 -- 172.21.15.80:0/3968948463 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5904+0+0 (secure 0 0 0) 0x7f6494031ae0 con 0x7f64a4108cf0 2019-11-28T11:28:54.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.984+0000 7f64a2d9d700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f647c018730 0x7f647c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.984+0000 7f64a2d9d700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f647c018730 0x7f647c01abc0 crc :-1 s=READY pgs=255 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:54.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.991+0000 7f64a8c6c700 1 -- 172.21.15.80:0/3968948463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a4106270 con 0x7f64a4108cf0 2019-11-28T11:28:54.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.995+0000 7f64a259c700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a4108cf0 0x7f64a4107630 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7f6494010410 tx=0x7f64940107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:53.995+0000 7f649b7fe700 1 -- 172.21.15.80:0/3968948463 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6494009580 con 0x7f64a4108cf0 2019-11-28T11:28:54.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.161+0000 7f64a8c6c700 1 -- 172.21.15.80:0/3968948463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f64a4105ef0 con 0x7f64a4108cf0 2019-11-28T11:28:54.190 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:28:54.161+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:28:54.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.165+0000 7f64a259c700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a4108cf0 0x7f64a4107630 secure :-1 s=THROTTLE_DONE pgs=605 cs=0 l=1 rx=0x7f6494010410 tx=0x7f64940107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.165+0000 7f649b7fe700 1 -- 172.21.15.80:0/3968948463 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 8 and data pool 9 v26) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6494009c90 con 0x7f64a4108cf0 2019-11-28T11:28:54.197 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 8 and data pool 9 2019-11-28T11:28:54.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.171+0000 7f64a8c6c700 1 -- 172.21.15.80:0/3968948463 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f647c018730 msgr2=0x7f647c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.171+0000 7f64a8c6c700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f647c018730 0x7f647c01abc0 crc :-1 s=READY pgs=255 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:54.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.171+0000 7f64a8c6c700 1 -- 172.21.15.80:0/3968948463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a4108cf0 msgr2=0x7f64a4107630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.171+0000 7f64a8c6c700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a4108cf0 0x7f64a4107630 secure :-1 s=READY pgs=605 cs=0 l=1 rx=0x7f6494010410 tx=0x7f64940107b0).stop 2019-11-28T11:28:54.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.171+0000 7f64a8c6c700 1 -- 172.21.15.80:0/3968948463 shutdown_connections 2019-11-28T11:28:54.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.171+0000 7f64a8c6c700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f647c018730 0x7f647c01abc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:54.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.171+0000 7f64a8c6c700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64a4108cf0 0x7f64a4107630 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:54.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.171+0000 7f64a8c6c700 1 --2- 172.21.15.80:0/3968948463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64a410e970 0x7f64a41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:54.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.171+0000 7f64a8c6c700 1 -- 172.21.15.80:0/3968948463 shutdown_connections 2019-11-28T11:28:54.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.171+0000 7f64a8c6c700 1 -- 172.21.15.80:0/3968948463 wait complete. 2019-11-28T11:28:54.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.171+0000 7f64a8c6c700 1 -- 172.21.15.80:0/3968948463 >> 172.21.15.80:0/3968948463 conn(0x7f64a415e2d0 msgr2=0x7f64a4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:54.209 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:28:54.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.299+0000 7f675bec0700 1 Processor -- start 2019-11-28T11:28:54.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.299+0000 7f675bec0700 1 -- start start 2019-11-28T11:28:54.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.300+0000 7f675bec0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f675406c490 0x7f675406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:54.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.300+0000 7f675bec0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f675406ce60 0x7f6754164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:54.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.300+0000 7f675bec0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675406db00 con 0x7f675406c0a0 2019-11-28T11:28:54.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.300+0000 7f675bec0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675406fd60 con 0x7f675406c490 2019-11-28T11:28:54.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.300+0000 7f675bec0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6754070030 con 0x7f675406ce60 2019-11-28T11:28:54.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.300+0000 7f675a45d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f675406c0a0 0x7f6754072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33260/0 (socket says 172.21.15.80:33260) 2019-11-28T11:28:54.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.300+0000 7f675a45d700 1 -- 172.21.15.80:0/3468652687 learned_addr learned my addr 172.21.15.80:0/3468652687 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:54.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.300+0000 7f6759c5c700 1 --2- 172.21.15.80:0/3468652687 >> v2:172.21.15.174:3300/0 conn(0x7f675406c490 0x7f675406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.300+0000 7f675ac5e700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f675406ce60 0x7f6754164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.300+0000 7f675945b700 1 -- 172.21.15.80:0/3468652687 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520424726 0 0) 0x7f6750001150 con 0x7f675406c0a0 2019-11-28T11:28:54.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.300+0000 7f675945b700 1 -- 172.21.15.80:0/3468652687 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6740002e80 con 0x7f675406c0a0 2019-11-28T11:28:54.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 -- 172.21.15.80:0/3468652687 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3797687595 0 0) 0x7f6750001130 con 0x7f675406c0a0 2019-11-28T11:28:54.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 -- 172.21.15.80:0/3468652687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f675406ce60 msgr2=0x7f6754164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:54.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f675406ce60 0x7f6754164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:54.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 -- 172.21.15.80:0/3468652687 >> v2:172.21.15.174:3300/0 conn(0x7f675406c490 msgr2=0x7f675406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:54.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 --2- 172.21.15.80:0/3468652687 >> v2:172.21.15.174:3300/0 conn(0x7f675406c490 0x7f675406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:54.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 -- 172.21.15.80:0/3468652687 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67540706c0 con 0x7f675406c0a0 2019-11-28T11:28:54.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 -- 172.21.15.80:0/3468652687 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f6750001660 con 0x7f675406c0a0 2019-11-28T11:28:54.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 -- 172.21.15.80:0/3468652687 >> v1:172.21.15.80:6789/0 conn(0x7f675406c0a0 legacy=0x7f6754072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67400479e0 0x7f6740049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:54.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f674004a5c0 0x7f674004ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:54.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674004d290 0x7f674004f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:54.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 -- 172.21.15.80:0/3468652687 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674004ff50 con 0x7f674004d290 2019-11-28T11:28:54.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 -- 172.21.15.80:0/3468652687 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6740050140 con 0x7f674004a5c0 2019-11-28T11:28:54.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 -- 172.21.15.80:0/3468652687 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6740050370 con 0x7f67400479e0 2019-11-28T11:28:54.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675ac5e700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674004d290 0x7f674004f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f6759c5c700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f674004a5c0 0x7f674004ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675a45d700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67400479e0 0x7f6740049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675ac5e700 1 -- 172.21.15.80:0/3468652687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67400479e0 msgr2=0x7f6740049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:54.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675ac5e700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67400479e0 0x7f6740049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:54.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675ac5e700 1 -- 172.21.15.80:0/3468652687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f674004a5c0 msgr2=0x7f674004ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:54.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675ac5e700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f674004a5c0 0x7f674004ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:54.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675ac5e700 1 -- 172.21.15.80:0/3468652687 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6740050620 con 0x7f674004d290 2019-11-28T11:28:54.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675a45d700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67400479e0 0x7f6740049e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:54.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675ac5e700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674004d290 0x7f674004f740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f674c00b310 tx=0x7f674c00b690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675ac5e700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674004d290 0x7f674004f740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f674c00b310 tx=0x7f674c00b690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675ac5e700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674004d290 0x7f674004f740 secure :-1 s=READY pgs=607 cs=0 l=1 rx=0x7f674c00b310 tx=0x7f674c00b690).ready entity=mon.0 client_cookie=6768765ad8c437f9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:54.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675ac5e700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674004d290 0x7f674004f740 secure :-1 s=THROTTLE_DONE pgs=607 cs=0 l=1 rx=0x7f674c00b310 tx=0x7f674c00b690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 -- 172.21.15.80:0/3468652687 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674c000ed0 con 0x7f674004d290 2019-11-28T11:28:54.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675ac5e700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674004d290 0x7f674004f740 secure :-1 s=THROTTLE_DONE pgs=607 cs=0 l=1 rx=0x7f674c00b310 tx=0x7f674c00b690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675ac5e700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674004d290 0x7f674004f740 secure :-1 s=THROTTLE_DONE pgs=607 cs=0 l=1 rx=0x7f674c00b310 tx=0x7f674c00b690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 -- 172.21.15.80:0/3468652687 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c00f220 con 0x7f674004d290 2019-11-28T11:28:54.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675945b700 1 -- 172.21.15.80:0/3468652687 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674c000e30 con 0x7f674004d290 2019-11-28T11:28:54.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675bec0700 1 -- 172.21.15.80:0/3468652687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674004d290 msgr2=0x7f674004f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675bec0700 1 --2- 172.21.15.80:0/3468652687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674004d290 0x7f674004f740 secure :-1 s=READY pgs=607 cs=0 l=1 rx=0x7f674c00b310 tx=0x7f674c00b690).stop 2019-11-28T11:28:54.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.301+0000 7f675ac5e700 1 -- 172.21.15.80:0/3468652687 reap_dead start 2019-11-28T11:28:54.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.302+0000 7f675bec0700 1 -- 172.21.15.80:0/3468652687 shutdown_connections 2019-11-28T11:28:54.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.302+0000 7f675bec0700 1 -- 172.21.15.80:0/3468652687 shutdown_connections 2019-11-28T11:28:54.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.302+0000 7f675bec0700 1 -- 172.21.15.80:0/3468652687 wait complete. 2019-11-28T11:28:54.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.302+0000 7f675bec0700 1 -- 172.21.15.80:0/3468652687 >> 172.21.15.80:0/3468652687 conn(0x7f6754061cf0 msgr2=0x7f6754064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:54.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.305+0000 7f675bec0700 1 Processor -- start 2019-11-28T11:28:54.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.305+0000 7f675bec0700 1 -- start start 2019-11-28T11:28:54.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.305+0000 7f675bec0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f675410f520 0x7f675413ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:54.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f675bec0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6754165d70 0x7f6754168170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f675bec0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6754107940 con 0x7f67541061f0 2019-11-28T11:28:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f675bec0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675410c300 con 0x7f675410f520 2019-11-28T11:28:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f675bec0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675410c5d0 con 0x7f6754165d70 2019-11-28T11:28:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f675a45d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f67541061f0 0x7f675413a350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33272/0 (socket says 172.21.15.80:33272) 2019-11-28T11:28:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f675a45d700 1 -- 172.21.15.80:0/2262626547 learned_addr learned my addr 172.21.15.80:0/2262626547 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:54.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f6759c5c700 1 --2- 172.21.15.80:0/2262626547 >> v2:172.21.15.174:3300/0 conn(0x7f675410f520 0x7f675413ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f675ac5e700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6754165d70 0x7f6754168170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623452899 0 0) 0x7f6750001c20 con 0x7f67541061f0 2019-11-28T11:28:54.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f673c002e80 con 0x7f67541061f0 2019-11-28T11:28:54.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2429232534 0 0) 0x7f67500016a0 con 0x7f67541061f0 2019-11-28T11:28:54.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f673c0032e0 con 0x7f67541061f0 2019-11-28T11:28:54.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f6750000ea0 con 0x7f67541061f0 2019-11-28T11:28:54.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6754165d70 msgr2=0x7f6754168170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f674affd700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6754165d70 0x7f6754168170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 >> v2:172.21.15.174:3300/0 conn(0x7f675410f520 msgr2=0x7f675413ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f674affd700 1 --2- 172.21.15.80:0/2262626547 >> v2:172.21.15.174:3300/0 conn(0x7f675410f520 0x7f675413ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 >> v1:172.21.15.80:6789/0 conn(0x7f67541061f0 legacy=0x7f675413a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f674affd700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673c0033a0 0x7f673c0037f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f674affd700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f673c003d30 0x7f673c004190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f674affd700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c0048c0 0x7f673c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c00bbf0 con 0x7f673c0048c0 2019-11-28T11:28:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c00bdf0 con 0x7f673c003d30 2019-11-28T11:28:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c00c020 con 0x7f673c0033a0 2019-11-28T11:28:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f6759c5c700 1 --2- 172.21.15.80:0/2262626547 >> v2:172.21.15.174:3300/0 conn(0x7f675410f520 0x7f675413ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f675ac5e700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c0048c0 0x7f673c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f675a45d700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673c0033a0 0x7f673c0037f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f6759c5c700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f673c003d30 0x7f673c004190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f675ac5e700 1 -- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673c0033a0 msgr2=0x7f673c0037f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f675ac5e700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673c0033a0 0x7f673c0037f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f675ac5e700 1 -- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f673c003d30 msgr2=0x7f673c004190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.306+0000 7f675ac5e700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f673c003d30 0x7f673c004190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.307+0000 7f675ac5e700 1 -- 172.21.15.80:0/2262626547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673c00c2d0 con 0x7f673c0048c0 2019-11-28T11:28:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.307+0000 7f6759c5c700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f673c003d30 0x7f673c004190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.307+0000 7f675bec0700 1 -- 172.21.15.80:0/2262626547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675410cfe0 con 0x7f673c0048c0 2019-11-28T11:28:54.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.307+0000 7f675ac5e700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c0048c0 0x7f673c004d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f674c010700 tx=0x7f674c010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.307+0000 7f675ac5e700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c0048c0 0x7f673c004d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f674c010700 tx=0x7f674c010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.307+0000 7f675bec0700 1 -- 172.21.15.80:0/2262626547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675410cc60 con 0x7f673c0048c0 2019-11-28T11:28:54.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.307+0000 7f675ac5e700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c0048c0 0x7f673c004d80 secure :-1 s=READY pgs=609 cs=0 l=1 rx=0x7f674c010700 tx=0x7f674c010580).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:54.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.307+0000 7f675ac5e700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c0048c0 0x7f673c004d80 secure :-1 s=THROTTLE_DONE pgs=609 cs=0 l=1 rx=0x7f674c010700 tx=0x7f674c010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.307+0000 7f675ac5e700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c0048c0 0x7f673c004d80 secure :-1 s=THROTTLE_DONE pgs=609 cs=0 l=1 rx=0x7f674c010700 tx=0x7f674c010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.307+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674c009930 con 0x7f673c0048c0 2019-11-28T11:28:54.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.307+0000 7f675ac5e700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c0048c0 0x7f673c004d80 secure :-1 s=THROTTLE_DONE pgs=609 cs=0 l=1 rx=0x7f674c010700 tx=0x7f674c010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.307+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c009f80 con 0x7f673c0048c0 2019-11-28T11:28:54.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.307+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674c00a650 con 0x7f673c0048c0 2019-11-28T11:28:54.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.307+0000 7f675ac5e700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c0048c0 0x7f673c004d80 secure :-1 s=THROTTLE_DONE pgs=609 cs=0 l=1 rx=0x7f674c010700 tx=0x7f674c010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.308+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f674c00a170 con 0x7f673c0048c0 2019-11-28T11:28:54.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.308+0000 7f675ac5e700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c0048c0 0x7f673c004d80 secure :-1 s=THROTTLE_DONE pgs=609 cs=0 l=1 rx=0x7f674c010700 tx=0x7f674c010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.308+0000 7f674affd700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f673c020a80 0x7f673c022ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:54.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.308+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f674c031ec0 con 0x7f673c0048c0 2019-11-28T11:28:54.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.308+0000 7f675a45d700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f673c020a80 0x7f673c022ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.308+0000 7f675a45d700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f673c020a80 0x7f673c022ed0 crc :-1 s=READY pgs=256 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:54.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.314+0000 7f675bec0700 1 -- 172.21.15.80:0/2262626547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675410cfe0 con 0x7f673c0048c0 2019-11-28T11:28:54.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.318+0000 7f675ac5e700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c0048c0 0x7f673c004d80 secure :-1 s=THROTTLE_DONE pgs=609 cs=0 l=1 rx=0x7f674c010700 tx=0x7f674c010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.318+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f674c009b80 con 0x7f673c0048c0 2019-11-28T11:28:54.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.494+0000 7f675bec0700 1 -- 172.21.15.80:0/2262626547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f675410cc60 con 0x7f673c0048c0 2019-11-28T11:28:54.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.495+0000 7f675ac5e700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c0048c0 0x7f673c004d80 secure :-1 s=THROTTLE_DONE pgs=609 cs=0 l=1 rx=0x7f674c010700 tx=0x7f674c010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.495+0000 7f674affd700 1 -- 172.21.15.80:0/2262626547 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+14870 (secure 0 0 0) 0x7f674c021460 con 0x7f673c0048c0 2019-11-28T11:28:54.524 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:54.525 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":56,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:28:54.162833+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:28:52.545871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2019-11-28T11:28:53.180206+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:28:54.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.497+0000 7f675bec0700 1 -- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f673c020a80 msgr2=0x7f673c022ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.497+0000 7f675bec0700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f673c020a80 0x7f673c022ed0 crc :-1 s=READY pgs=256 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:54.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.497+0000 7f675bec0700 1 -- 172.21.15.80:0/2262626547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c0048c0 msgr2=0x7f673c004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.497+0000 7f675bec0700 1 --2- 172.21.15.80:0/2262626547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c0048c0 0x7f673c004d80 secure :-1 s=READY pgs=609 cs=0 l=1 rx=0x7f674c010700 tx=0x7f674c010580).stop 2019-11-28T11:28:54.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.497+0000 7f675ac5e700 1 -- 172.21.15.80:0/2262626547 reap_dead start 2019-11-28T11:28:54.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.497+0000 7f675ac5e700 1 -- 172.21.15.80:0/2262626547 reap_dead start 2019-11-28T11:28:54.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.497+0000 7f675bec0700 1 -- 172.21.15.80:0/2262626547 shutdown_connections 2019-11-28T11:28:54.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.497+0000 7f675bec0700 1 -- 172.21.15.80:0/2262626547 shutdown_connections 2019-11-28T11:28:54.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.497+0000 7f675bec0700 1 -- 172.21.15.80:0/2262626547 wait complete. 2019-11-28T11:28:54.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.497+0000 7f675bec0700 1 -- 172.21.15.80:0/2262626547 >> 172.21.15.80:0/2262626547 conn(0x7f6754142090 msgr2=0x7f675410ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:54.540 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:28:54.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.630+0000 7f9cc37f4700 1 Processor -- start 2019-11-28T11:28:54.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.630+0000 7f9cc37f4700 1 -- start start 2019-11-28T11:28:54.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc37f4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cbc06c0a0 0x7f9cbc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:54.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc37f4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cbc0734e0 0x7f9cbc071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:54.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc37f4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cbc06db00 con 0x7f9cbc072360 2019-11-28T11:28:54.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc37f4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cbc06fd60 con 0x7f9cbc06c0a0 2019-11-28T11:28:54.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc37f4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc070030 con 0x7f9cbc0734e0 2019-11-28T11:28:54.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc2592700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9cbc072360 0x7f9cbc06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33288/0 (socket says 172.21.15.80:33288) 2019-11-28T11:28:54.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc2592700 1 -- 172.21.15.80:0/875052954 learned_addr learned my addr 172.21.15.80:0/875052954 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:54.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc1d91700 1 --2- 172.21.15.80:0/875052954 >> v2:172.21.15.174:3300/0 conn(0x7f9cbc06c0a0 0x7f9cbc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc1590700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cbc0734e0 0x7f9cbc071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc0d8f700 1 -- 172.21.15.80:0/875052954 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979969904 0 0) 0x7f9cb40014d0 con 0x7f9cbc072360 2019-11-28T11:28:54.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc0d8f700 1 -- 172.21.15.80:0/875052954 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ca8002e80 con 0x7f9cbc072360 2019-11-28T11:28:54.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc0d8f700 1 -- 172.21.15.80:0/875052954 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 802036499 0 0) 0x7f9cb40014b0 con 0x7f9cbc072360 2019-11-28T11:28:54.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc0d8f700 1 -- 172.21.15.80:0/875052954 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cbc0734e0 msgr2=0x7f9cbc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:54.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc0d8f700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cbc0734e0 0x7f9cbc071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:54.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc0d8f700 1 -- 172.21.15.80:0/875052954 >> v2:172.21.15.174:3300/0 conn(0x7f9cbc06c0a0 msgr2=0x7f9cbc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:54.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc0d8f700 1 --2- 172.21.15.80:0/875052954 >> v2:172.21.15.174:3300/0 conn(0x7f9cbc06c0a0 0x7f9cbc072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:54.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc0d8f700 1 -- 172.21.15.80:0/875052954 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc0706c0 con 0x7f9cbc072360 2019-11-28T11:28:54.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.631+0000 7f9cc0d8f700 1 -- 172.21.15.80:0/875052954 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f9cb40019e0 con 0x7f9cbc072360 2019-11-28T11:28:54.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc0d8f700 1 -- 172.21.15.80:0/875052954 >> v1:172.21.15.80:6789/0 conn(0x7f9cbc072360 legacy=0x7f9cbc06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc0d8f700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ca80479e0 0x7f9ca8049e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:54.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc0d8f700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ca804a5a0 0x7f9ca804ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:54.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc0d8f700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca804d270 0x7f9ca804f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:54.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc0d8f700 1 -- 172.21.15.80:0/875052954 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca804ff50 con 0x7f9ca804d270 2019-11-28T11:28:54.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc0d8f700 1 -- 172.21.15.80:0/875052954 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca8050140 con 0x7f9ca804a5a0 2019-11-28T11:28:54.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc0d8f700 1 -- 172.21.15.80:0/875052954 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca8050370 con 0x7f9ca80479e0 2019-11-28T11:28:54.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc2592700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca804d270 0x7f9ca804f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc1d91700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ca80479e0 0x7f9ca8049e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc1590700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ca804a5a0 0x7f9ca804ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc2592700 1 -- 172.21.15.80:0/875052954 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ca80479e0 msgr2=0x7f9ca8049e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:54.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc2592700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ca80479e0 0x7f9ca8049e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:54.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc2592700 1 -- 172.21.15.80:0/875052954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ca804a5a0 msgr2=0x7f9ca804ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:54.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc2592700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ca804a5a0 0x7f9ca804ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:54.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc2592700 1 -- 172.21.15.80:0/875052954 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca8050620 con 0x7f9ca804d270 2019-11-28T11:28:54.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc1590700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ca804a5a0 0x7f9ca804ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:54.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc2592700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca804d270 0x7f9ca804f740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9cb400fc90 tx=0x7f9cb4001ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc2592700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca804d270 0x7f9ca804f740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9cb400fc90 tx=0x7f9cb4001ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc2592700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca804d270 0x7f9ca804f740 secure :-1 s=READY pgs=611 cs=0 l=1 rx=0x7f9cb400fc90 tx=0x7f9cb4001ad0).ready entity=mon.0 client_cookie=7c31c30edd34d6f9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:54.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc2592700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca804d270 0x7f9ca804f740 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7f9cb400fc90 tx=0x7f9cb4001ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc0d8f700 1 -- 172.21.15.80:0/875052954 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cb4001c00 con 0x7f9ca804d270 2019-11-28T11:28:54.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc2592700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca804d270 0x7f9ca804f740 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7f9cb400fc90 tx=0x7f9cb4001ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc2592700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca804d270 0x7f9ca804f740 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7f9cb400fc90 tx=0x7f9cb4001ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc0d8f700 1 -- 172.21.15.80:0/875052954 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb40014b0 con 0x7f9ca804d270 2019-11-28T11:28:54.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc0d8f700 1 -- 172.21.15.80:0/875052954 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cb4001c00 con 0x7f9ca804d270 2019-11-28T11:28:54.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc37f4700 1 -- 172.21.15.80:0/875052954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca804d270 msgr2=0x7f9ca804f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc37f4700 1 --2- 172.21.15.80:0/875052954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ca804d270 0x7f9ca804f740 secure :-1 s=READY pgs=611 cs=0 l=1 rx=0x7f9cb400fc90 tx=0x7f9cb4001ad0).stop 2019-11-28T11:28:54.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.632+0000 7f9cc2592700 1 -- 172.21.15.80:0/875052954 reap_dead start 2019-11-28T11:28:54.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.633+0000 7f9cc37f4700 1 -- 172.21.15.80:0/875052954 shutdown_connections 2019-11-28T11:28:54.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.633+0000 7f9cc37f4700 1 -- 172.21.15.80:0/875052954 shutdown_connections 2019-11-28T11:28:54.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.633+0000 7f9cc37f4700 1 -- 172.21.15.80:0/875052954 wait complete. 2019-11-28T11:28:54.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.633+0000 7f9cc37f4700 1 -- 172.21.15.80:0/875052954 >> 172.21.15.80:0/875052954 conn(0x7f9cbc061cf0 msgr2=0x7f9cbc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:54.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.635+0000 7f9cc37f4700 1 Processor -- start 2019-11-28T11:28:54.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.636+0000 7f9cc37f4700 1 -- start start 2019-11-28T11:28:54.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.636+0000 7f9cc37f4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cbc1061f0 0x7f9cbc10f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:54.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.636+0000 7f9cc37f4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cbc165d70 0x7f9cbc168170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:54.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.636+0000 7f9cc37f4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cbc107940 con 0x7f9cbc13a350 2019-11-28T11:28:54.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.636+0000 7f9cc37f4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cbc13bf00 con 0x7f9cbc165d70 2019-11-28T11:28:54.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.636+0000 7f9cc37f4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc10c300 con 0x7f9cbc1061f0 2019-11-28T11:28:54.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.636+0000 7f9cc1590700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9cbc13a350 0x7f9cbc13a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33302/0 (socket says 172.21.15.80:33302) 2019-11-28T11:28:54.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.636+0000 7f9cc1590700 1 -- 172.21.15.80:0/3101906320 learned_addr learned my addr 172.21.15.80:0/3101906320 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:54.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cc2592700 1 --2- 172.21.15.80:0/3101906320 >> v2:172.21.15.174:3300/0 conn(0x7f9cbc165d70 0x7f9cbc168170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cc1d91700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cbc1061f0 0x7f9cbc10f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cba7fc700 1 -- 172.21.15.80:0/3101906320 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88142646 0 0) 0x7f9cac009690 con 0x7f9cbc13a350 2019-11-28T11:28:54.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cba7fc700 1 -- 172.21.15.80:0/3101906320 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ca0002e80 con 0x7f9cbc13a350 2019-11-28T11:28:54.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cc2592700 1 -- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cbc1061f0 msgr2=0x7f9cbc10f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cc2592700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cbc1061f0 0x7f9cbc10f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:54.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cc2592700 1 -- 172.21.15.80:0/3101906320 >> v1:172.21.15.80:6789/0 conn(0x7f9cbc13a350 legacy=0x7f9cbc13a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cba7fc700 1 -- 172.21.15.80:0/3101906320 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 789522111 0 0) 0x7f9cac000dc0 con 0x7f9cbc13a350 2019-11-28T11:28:54.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cc2592700 1 -- 172.21.15.80:0/3101906320 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc10cc60 con 0x7f9cbc165d70 2019-11-28T11:28:54.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cc1d91700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cbc1061f0 0x7f9cbc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:54.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cc2592700 1 --2- 172.21.15.80:0/3101906320 >> v2:172.21.15.174:3300/0 conn(0x7f9cbc165d70 0x7f9cbc168170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9cb4010700 tx=0x7f9cb4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cc2592700 1 --2- 172.21.15.80:0/3101906320 >> v2:172.21.15.174:3300/0 conn(0x7f9cbc165d70 0x7f9cbc168170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9cb4010700 tx=0x7f9cb4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cc2592700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cbc165d70 0x7f9cbc168170 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7f9cb4010700 tx=0x7f9cb4010aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:54.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cc2592700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cbc165d70 0x7f9cbc168170 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f9cb4010700 tx=0x7f9cb4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cba7fc700 1 -- 172.21.15.80:0/3101906320 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cb4001bb0 con 0x7f9cbc165d70 2019-11-28T11:28:54.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cc2592700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cbc165d70 0x7f9cbc168170 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f9cb4010700 tx=0x7f9cb4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cc2592700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cbc165d70 0x7f9cbc168170 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f9cb4010700 tx=0x7f9cb4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cba7fc700 1 -- 172.21.15.80:0/3101906320 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb40047d0 con 0x7f9cbc165d70 2019-11-28T11:28:54.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cc37f4700 1 -- 172.21.15.80:0/3101906320 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cbc10cfe0 con 0x7f9cbc165d70 2019-11-28T11:28:54.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.637+0000 7f9cba7fc700 1 -- 172.21.15.80:0/3101906320 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cb4004e20 con 0x7f9cbc165d70 2019-11-28T11:28:54.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.638+0000 7f9cc37f4700 1 -- 172.21.15.80:0/3101906320 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cbc10cc60 con 0x7f9cbc165d70 2019-11-28T11:28:54.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.638+0000 7f9cc2592700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cbc165d70 0x7f9cbc168170 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f9cb4010700 tx=0x7f9cb4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.638+0000 7f9cba7fc700 1 -- 172.21.15.80:0/3101906320 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9cb40049c0 con 0x7f9cbc165d70 2019-11-28T11:28:54.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.638+0000 7f9cc2592700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cbc165d70 0x7f9cbc168170 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f9cb4010700 tx=0x7f9cb4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.638+0000 7f9cba7fc700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ca0018780 0x7f9ca001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:54.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.638+0000 7f9cba7fc700 1 -- 172.21.15.80:0/3101906320 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9cb4031d30 con 0x7f9cbc165d70 2019-11-28T11:28:54.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.639+0000 7f9cc1d91700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ca0018780 0x7f9ca001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.639+0000 7f9cc1d91700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ca0018780 0x7f9ca001abf0 crc :-1 s=READY pgs=257 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:54.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.645+0000 7f9cc37f4700 1 -- 172.21.15.80:0/3101906320 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cbc10cfe0 con 0x7f9cbc165d70 2019-11-28T11:28:54.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.649+0000 7f9cc2592700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cbc165d70 0x7f9cbc168170 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f9cb4010700 tx=0x7f9cb4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.649+0000 7f9cba7fc700 1 -- 172.21.15.80:0/3101906320 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9cb40045c0 con 0x7f9cbc165d70 2019-11-28T11:28:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.828+0000 7f9cc37f4700 1 -- 172.21.15.80:0/3101906320 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cbc10cc60 con 0x7f9cbc165d70 2019-11-28T11:28:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.829+0000 7f9cc2592700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cbc165d70 0x7f9cbc168170 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f9cb4010700 tx=0x7f9cb4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.829+0000 7f9cba7fc700 1 -- 172.21.15.80:0/3101906320 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+14870 (secure 0 0 0) 0x7f9cb40049c0 con 0x7f9cbc165d70 2019-11-28T11:28:54.858 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:54.858 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":56,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:28:54.162833+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:28:52.545871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2019-11-28T11:28:53.180206+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:28:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.831+0000 7f9cc37f4700 1 -- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ca0018780 msgr2=0x7f9ca001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.831+0000 7f9cc37f4700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ca0018780 0x7f9ca001abf0 crc :-1 s=READY pgs=257 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.831+0000 7f9cc37f4700 1 -- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cbc165d70 msgr2=0x7f9cbc168170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.831+0000 7f9cc37f4700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cbc165d70 0x7f9cbc168170 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7f9cb4010700 tx=0x7f9cb4010aa0).stop 2019-11-28T11:28:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.831+0000 7f9cc37f4700 1 -- 172.21.15.80:0/3101906320 shutdown_connections 2019-11-28T11:28:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.831+0000 7f9cc37f4700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ca0018780 0x7f9ca001abf0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:54.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.831+0000 7f9cc37f4700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cbc165d70 0x7f9cbc168170 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:54.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.831+0000 7f9cc37f4700 1 --2- 172.21.15.80:0/3101906320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cbc1061f0 0x7f9cbc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:54.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.831+0000 7f9cc37f4700 1 -- 172.21.15.80:0/3101906320 shutdown_connections 2019-11-28T11:28:54.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.831+0000 7f9cc37f4700 1 -- 172.21.15.80:0/3101906320 wait complete. 2019-11-28T11:28:54.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.831+0000 7f9cc37f4700 1 -- 172.21.15.80:0/3101906320 >> 172.21.15.80:0/3101906320 conn(0x7f9cbc142090 msgr2=0x7f9cbc10ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:54.870 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:28:54.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.964+0000 7f94b1c0e700 1 Processor -- start 2019-11-28T11:28:54.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.964+0000 7f94b1c0e700 1 -- start start 2019-11-28T11:28:54.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.965+0000 7f94b1c0e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f94ac15ed10 0x7f94ac15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:54.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.965+0000 7f94b1c0e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f94ac0734b0 0x7f94ac0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:54.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.965+0000 7f94b1c0e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac06db60 con 0x7f94ac073020 2019-11-28T11:28:54.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.965+0000 7f94b1c0e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac06fe00 con 0x7f94ac0734b0 2019-11-28T11:28:54.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.965+0000 7f94b1c0e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac0700d0 con 0x7f94ac15ed10 2019-11-28T11:28:54.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.965+0000 7f94b09ac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f94ac0734b0 0x7f94ac0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.965+0000 7f94b09ac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f94ac0734b0 0x7f94ac0726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33994/0 (socket says 172.21.15.80:33994) 2019-11-28T11:28:54.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.965+0000 7f94b09ac700 1 -- 172.21.15.80:0/2661309023 learned_addr learned my addr 172.21.15.80:0/2661309023 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:54.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.965+0000 7f94a3fff700 1 --1- 172.21.15.80:0/2661309023 >> v1:172.21.15.80:6789/0 conn(0x7f94ac073020 0x7f94ac071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33306/0 (socket says 172.21.15.80:33306) 2019-11-28T11:28:54.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.965+0000 7f94abfff700 1 --2- 172.21.15.80:0/2661309023 >> v2:172.21.15.174:3300/0 conn(0x7f94ac15ed10 0x7f94ac15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:54.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.966+0000 7f94b09ac700 1 -- 172.21.15.80:0/2661309023 >> v2:172.21.15.174:3300/0 conn(0x7f94ac15ed10 msgr2=0x7f94ac15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:54.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.966+0000 7f94b09ac700 1 --2- 172.21.15.80:0/2661309023 >> v2:172.21.15.174:3300/0 conn(0x7f94ac15ed10 0x7f94ac15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:55.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.966+0000 7f94b09ac700 1 -- 172.21.15.80:0/2661309023 >> v1:172.21.15.80:6789/0 conn(0x7f94ac073020 legacy=0x7f94ac071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:55.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.966+0000 7f94b09ac700 1 -- 172.21.15.80:0/2661309023 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac070760 con 0x7f94ac0734b0 2019-11-28T11:28:55.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.966+0000 7f94ab7fe700 1 -- 172.21.15.80:0/2661309023 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418885176 0 0) 0x7f9494001100 con 0x7f94ac073020 2019-11-28T11:28:55.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.966+0000 7f94b09ac700 1 --2- 172.21.15.80:0/2661309023 >> v2:172.21.15.80:3300/0 conn(0x7f94ac0734b0 0x7f94ac0726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f94a400fa30 tx=0x7f94a400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:55.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.966+0000 7f94b09ac700 1 --2- 172.21.15.80:0/2661309023 >> v2:172.21.15.80:3300/0 conn(0x7f94ac0734b0 0x7f94ac0726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f94a400fa30 tx=0x7f94a400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:55.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.966+0000 7f94b09ac700 1 --2- 172.21.15.80:0/2661309023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94ac0734b0 0x7f94ac0726a0 secure :-1 s=READY pgs=614 cs=0 l=1 rx=0x7f94a400fa30 tx=0x7f94a400fdd0).ready entity=mon.0 client_cookie=df995b471c0d6f04 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:55.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.966+0000 7f94b09ac700 1 --2- 172.21.15.80:0/2661309023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94ac0734b0 0x7f94ac0726a0 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f94a400fa30 tx=0x7f94a400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:55.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.966+0000 7f94ab7fe700 1 -- 172.21.15.80:0/2661309023 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94a4000df0 con 0x7f94ac0734b0 2019-11-28T11:28:55.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.966+0000 7f94b09ac700 1 --2- 172.21.15.80:0/2661309023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94ac0734b0 0x7f94ac0726a0 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f94a400fa30 tx=0x7f94a400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:55.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.966+0000 7f94b09ac700 1 --2- 172.21.15.80:0/2661309023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94ac0734b0 0x7f94ac0726a0 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f94a400fa30 tx=0x7f94a400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:55.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.966+0000 7f94ab7fe700 1 -- 172.21.15.80:0/2661309023 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a4001460 con 0x7f94ac0734b0 2019-11-28T11:28:55.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.966+0000 7f94ab7fe700 1 -- 172.21.15.80:0/2661309023 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94a4001b50 con 0x7f94ac0734b0 2019-11-28T11:28:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.966+0000 7f94b1c0e700 1 -- 172.21.15.80:0/2661309023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94ac0734b0 msgr2=0x7f94ac0726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.966+0000 7f94b1c0e700 1 --2- 172.21.15.80:0/2661309023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94ac0734b0 0x7f94ac0726a0 secure :-1 s=READY pgs=614 cs=0 l=1 rx=0x7f94a400fa30 tx=0x7f94a400fdd0).stop 2019-11-28T11:28:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.967+0000 7f94b1c0e700 1 -- 172.21.15.80:0/2661309023 shutdown_connections 2019-11-28T11:28:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.967+0000 7f94b1c0e700 1 --2- 172.21.15.80:0/2661309023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94ac0734b0 0x7f94ac0726a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.967+0000 7f94b1c0e700 1 --2- 172.21.15.80:0/2661309023 >> v2:172.21.15.174:3300/0 conn(0x7f94ac15ed10 0x7f94ac15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.967+0000 7f94b1c0e700 1 -- 172.21.15.80:0/2661309023 shutdown_connections 2019-11-28T11:28:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.967+0000 7f94b1c0e700 1 -- 172.21.15.80:0/2661309023 wait complete. 2019-11-28T11:28:55.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.967+0000 7f94b1c0e700 1 -- 172.21.15.80:0/2661309023 >> 172.21.15.80:0/2661309023 conn(0x7f94ac061d20 msgr2=0x7f94ac0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:55.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.969+0000 7f94b1c0e700 1 Processor -- start 2019-11-28T11:28:55.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.969+0000 7f94b1c0e700 1 -- start start 2019-11-28T11:28:55.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.970+0000 7f94b1c0e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94ac10f9f0 0x7f94ac168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.970+0000 7f94b1c0e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac10c250 con 0x7f94ac10e970 2019-11-28T11:28:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.970+0000 7f94b1c0e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac10fe60 con 0x7f94ac10ed60 2019-11-28T11:28:55.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.970+0000 7f94b1c0e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac10e430 con 0x7f94ac10f9f0 2019-11-28T11:28:55.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.970+0000 7f94abfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f94ac10e970 0x7f94ac1087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33312/0 (socket says 172.21.15.80:33312) 2019-11-28T11:28:55.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.970+0000 7f94abfff700 1 -- 172.21.15.80:0/714932382 learned_addr learned my addr 172.21.15.80:0/714932382 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:55.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.970+0000 7f94b09ac700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94ac10f9f0 0x7f94ac168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:55.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.970+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163055223 0 0) 0x7f949c009580 con 0x7f94ac10e970 2019-11-28T11:28:55.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.970+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9490002e80 con 0x7f94ac10e970 2019-11-28T11:28:55.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.970+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140226816 0 0) 0x7f9494000ea0 con 0x7f94ac10ed60 2019-11-28T11:28:55.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.970+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94900030b0 con 0x7f94ac10ed60 2019-11-28T11:28:55.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1360984125 0 0) 0x7f949c000940 con 0x7f94ac10e970 2019-11-28T11:28:55.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f94900033c0 con 0x7f94ac10e970 2019-11-28T11:28:55.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f949c009da0 con 0x7f94ac10e970 2019-11-28T11:28:55.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94ac10f9f0 msgr2=0x7f94ac168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:55.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a97fa700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94ac10f9f0 0x7f94ac168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:55.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 >> v1:172.21.15.174:6789/0 conn(0x7f94ac10ed60 legacy=0x7f94ac10f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:55.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 >> v1:172.21.15.80:6789/0 conn(0x7f94ac10e970 legacy=0x7f94ac1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:55.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a97fa700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9490005d40 0x7f9490006130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:55.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a97fa700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94900046f0 0x7f9490004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:55.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a97fa700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9490005200 0x7f94900032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:55.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9490003a90 con 0x7f9490005200 2019-11-28T11:28:55.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9490003cc0 con 0x7f94900046f0 2019-11-28T11:28:55.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9490003ef0 con 0x7f9490005d40 2019-11-28T11:28:55.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94b09ac700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94ac10f9f0 0x7f94ac168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:55.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94b09ac700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9490005200 0x7f94900032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:55.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94abfff700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9490005d40 0x7f9490006130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:55.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a3fff700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94900046f0 0x7f9490004bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:55.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94b09ac700 1 -- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9490005d40 msgr2=0x7f9490006130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:55.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94b09ac700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9490005d40 0x7f9490006130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:55.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94b09ac700 1 -- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94900046f0 msgr2=0x7f9490004bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:55.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94b09ac700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94900046f0 0x7f9490004bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:55.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94b09ac700 1 -- 172.21.15.80:0/714932382 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94900041a0 con 0x7f9490005200 2019-11-28T11:28:55.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94b1c0e700 1 -- 172.21.15.80:0/714932382 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ac106270 con 0x7f9490005200 2019-11-28T11:28:55.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94b09ac700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9490005200 0x7f94900032e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f94a4010720 tx=0x7f94a40105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:55.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94b1c0e700 1 -- 172.21.15.80:0/714932382 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ac105ef0 con 0x7f9490005200 2019-11-28T11:28:55.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94b09ac700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9490005200 0x7f94900032e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f94a4010720 tx=0x7f94a40105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:55.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94b09ac700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9490005200 0x7f94900032e0 secure :-1 s=READY pgs=616 cs=0 l=1 rx=0x7f94a4010720 tx=0x7f94a40105d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:55.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94b09ac700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9490005200 0x7f94900032e0 secure :-1 s=THROTTLE_DONE pgs=616 cs=0 l=1 rx=0x7f94a4010720 tx=0x7f94a40105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:55.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94a4001630 con 0x7f9490005200 2019-11-28T11:28:55.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94b09ac700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9490005200 0x7f94900032e0 secure :-1 s=THROTTLE_DONE pgs=616 cs=0 l=1 rx=0x7f94a4010720 tx=0x7f94a40105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:55.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a4000e00 con 0x7f9490005200 2019-11-28T11:28:55.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94b09ac700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9490005200 0x7f94900032e0 secure :-1 s=THROTTLE_DONE pgs=616 cs=0 l=1 rx=0x7f94a4010720 tx=0x7f94a40105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:55.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.971+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94a4000ff0 con 0x7f9490005200 2019-11-28T11:28:55.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.972+0000 7f94b09ac700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9490005200 0x7f94900032e0 secure :-1 s=THROTTLE_DONE pgs=616 cs=0 l=1 rx=0x7f94a4010720 tx=0x7f94a40105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:55.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.972+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f94a4001440 con 0x7f9490005200 2019-11-28T11:28:55.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.972+0000 7f94b09ac700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9490005200 0x7f94900032e0 secure :-1 s=THROTTLE_DONE pgs=616 cs=0 l=1 rx=0x7f94a4010720 tx=0x7f94a40105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:55.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.972+0000 7f94a97fa700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9490020ba0 0x7f9490022fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:55.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.972+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f94a4031f40 con 0x7f9490005200 2019-11-28T11:28:55.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.972+0000 7f94abfff700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9490020ba0 0x7f9490022fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:55.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.972+0000 7f94abfff700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9490020ba0 0x7f9490022fd0 crc :-1 s=READY pgs=258 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:55.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.979+0000 7f94b1c0e700 1 -- 172.21.15.80:0/714932382 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9484002e60 con 0x7f9490005200 2019-11-28T11:28:55.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.983+0000 7f94b09ac700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9490005200 0x7f94900032e0 secure :-1 s=THROTTLE_DONE pgs=616 cs=0 l=1 rx=0x7f94a4010720 tx=0x7f94a40105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:55.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:54.983+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f94a4001230 con 0x7f9490005200 2019-11-28T11:28:55.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:55.156+0000 7f94b1c0e700 1 -- 172.21.15.80:0/714932382 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f9484001d40 con 0x7f9490005200 2019-11-28T11:28:55.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:55.829+0000 7f94b09ac700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9490005200 0x7f94900032e0 secure :-1 s=THROTTLE_DONE pgs=616 cs=0 l=1 rx=0x7f94a4010720 tx=0x7f94a40105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:55.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:55.829+0000 7f94a97fa700 1 -- 172.21.15.80:0/714932382 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7f94a4000e00 con 0x7f9490005200 2019-11-28T11:28:55.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:55.873+0000 7f94b1c0e700 1 -- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9490020ba0 msgr2=0x7f9490022fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:55.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:55.873+0000 7f94b1c0e700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9490020ba0 0x7f9490022fd0 crc :-1 s=READY pgs=258 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:55.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:55.873+0000 7f94b1c0e700 1 -- 172.21.15.80:0/714932382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9490005200 msgr2=0x7f94900032e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:55.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:55.873+0000 7f94b1c0e700 1 --2- 172.21.15.80:0/714932382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9490005200 0x7f94900032e0 secure :-1 s=READY pgs=616 cs=0 l=1 rx=0x7f94a4010720 tx=0x7f94a40105d0).stop 2019-11-28T11:28:55.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:55.874+0000 7f94b09ac700 1 -- 172.21.15.80:0/714932382 reap_dead start 2019-11-28T11:28:55.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:55.874+0000 7f94b09ac700 1 -- 172.21.15.80:0/714932382 reap_dead start 2019-11-28T11:28:55.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:55.874+0000 7f94b1c0e700 1 -- 172.21.15.80:0/714932382 shutdown_connections 2019-11-28T11:28:55.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:55.874+0000 7f94b1c0e700 1 -- 172.21.15.80:0/714932382 shutdown_connections 2019-11-28T11:28:55.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:55.874+0000 7f94b1c0e700 1 -- 172.21.15.80:0/714932382 wait complete. 2019-11-28T11:28:55.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:55.874+0000 7f94b1c0e700 1 -- 172.21.15.80:0/714932382 >> 172.21.15.80:0/714932382 conn(0x7f94ac15e2d0 msgr2=0x7f94ac147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:55.913 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:28:56.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.003+0000 7f6639e7c700 1 Processor -- start 2019-11-28T11:28:56.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.003+0000 7f6639e7c700 1 -- start start 2019-11-28T11:28:56.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.004+0000 7f6639e7c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f663406c490 0x7f663406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:56.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.004+0000 7f6639e7c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663406db00 con 0x7f663406c0a0 2019-11-28T11:28:56.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.004+0000 7f6639e7c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663406e000 con 0x7f663406ce60 2019-11-28T11:28:56.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.004+0000 7f6639e7c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663406fd60 con 0x7f663406c490 2019-11-28T11:28:56.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.004+0000 7f6633fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f663406c0a0 0x7f6634072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33326/0 (socket says 172.21.15.80:33326) 2019-11-28T11:28:56.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.004+0000 7f6633fff700 1 -- 172.21.15.80:0/1882706583 learned_addr learned my addr 172.21.15.80:0/1882706583 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:56.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.004+0000 7f662bfff700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f663406c490 0x7f663406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:56.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.004+0000 7f66337fe700 1 -- 172.21.15.80:0/1882706583 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889206956 0 0) 0x7f6624001150 con 0x7f663406c0a0 2019-11-28T11:28:56.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.004+0000 7f66337fe700 1 -- 172.21.15.80:0/1882706583 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6620002e80 con 0x7f663406c0a0 2019-11-28T11:28:56.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f66337fe700 1 -- 172.21.15.80:0/1882706583 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2768275574 0 0) 0x7f6624001130 con 0x7f663406c0a0 2019-11-28T11:28:56.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f66337fe700 1 -- 172.21.15.80:0/1882706583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f663406c490 msgr2=0x7f663406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:56.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f66337fe700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f663406c490 0x7f663406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:56.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f66337fe700 1 -- 172.21.15.80:0/1882706583 >> v1:172.21.15.174:6789/0 conn(0x7f663406ce60 legacy=0x7f6634164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f66337fe700 1 -- 172.21.15.80:0/1882706583 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66340706c0 con 0x7f663406c0a0 2019-11-28T11:28:56.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f66337fe700 1 -- 172.21.15.80:0/1882706583 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f6624001660 con 0x7f663406c0a0 2019-11-28T11:28:56.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f66337fe700 1 -- 172.21.15.80:0/1882706583 >> v1:172.21.15.80:6789/0 conn(0x7f663406c0a0 legacy=0x7f6634072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f66337fe700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6620003ab0 0x7f6620005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:56.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f66337fe700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6620006670 0x7f6620008b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:56.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f66337fe700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6620009300 0x7f662000b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:56.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f66337fe700 1 -- 172.21.15.80:0/1882706583 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662000bfe0 con 0x7f6620009300 2019-11-28T11:28:56.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f66337fe700 1 -- 172.21.15.80:0/1882706583 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66200501e0 con 0x7f6620006670 2019-11-28T11:28:56.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f66337fe700 1 -- 172.21.15.80:0/1882706583 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6620050410 con 0x7f6620003ab0 2019-11-28T11:28:56.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f6638c1a700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6620009300 0x7f662000b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:56.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f6633fff700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6620003ab0 0x7f6620005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:56.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f662bfff700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6620006670 0x7f6620008b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:56.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f6638c1a700 1 -- 172.21.15.80:0/1882706583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6620003ab0 msgr2=0x7f6620005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:56.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f6638c1a700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6620003ab0 0x7f6620005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:56.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f6638c1a700 1 -- 172.21.15.80:0/1882706583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6620006670 msgr2=0x7f6620008b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:56.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f6638c1a700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6620006670 0x7f6620008b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:56.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f6638c1a700 1 -- 172.21.15.80:0/1882706583 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66200506c0 con 0x7f6620009300 2019-11-28T11:28:56.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f6638c1a700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6620009300 0x7f662000b7d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f662c00b300 tx=0x7f662c00b680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f6638c1a700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6620009300 0x7f662000b7d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f662c00b300 tx=0x7f662c00b680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f6638c1a700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6620009300 0x7f662000b7d0 secure :-1 s=READY pgs=618 cs=0 l=1 rx=0x7f662c00b300 tx=0x7f662c00b680).ready entity=mon.0 client_cookie=db10fc2c03f6d9ea server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:56.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f6638c1a700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6620009300 0x7f662000b7d0 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f662c00b300 tx=0x7f662c00b680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f6638c1a700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6620009300 0x7f662000b7d0 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f662c00b300 tx=0x7f662c00b680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f66337fe700 1 -- 172.21.15.80:0/1882706583 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f662c009f30 con 0x7f6620009300 2019-11-28T11:28:56.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f6638c1a700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6620009300 0x7f662000b7d0 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f662c00b300 tx=0x7f662c00b680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f66337fe700 1 -- 172.21.15.80:0/1882706583 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c009b50 con 0x7f6620009300 2019-11-28T11:28:56.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f66337fe700 1 -- 172.21.15.80:0/1882706583 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f662c00a510 con 0x7f6620009300 2019-11-28T11:28:56.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f6639e7c700 1 -- 172.21.15.80:0/1882706583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6620009300 msgr2=0x7f662000b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f6639e7c700 1 --2- 172.21.15.80:0/1882706583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6620009300 0x7f662000b7d0 secure :-1 s=READY pgs=618 cs=0 l=1 rx=0x7f662c00b300 tx=0x7f662c00b680).stop 2019-11-28T11:28:56.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.005+0000 7f6638c1a700 1 -- 172.21.15.80:0/1882706583 reap_dead start 2019-11-28T11:28:56.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.006+0000 7f6639e7c700 1 -- 172.21.15.80:0/1882706583 shutdown_connections 2019-11-28T11:28:56.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.006+0000 7f6639e7c700 1 -- 172.21.15.80:0/1882706583 shutdown_connections 2019-11-28T11:28:56.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.006+0000 7f6639e7c700 1 -- 172.21.15.80:0/1882706583 wait complete. 2019-11-28T11:28:56.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.006+0000 7f6639e7c700 1 -- 172.21.15.80:0/1882706583 >> 172.21.15.80:0/1882706583 conn(0x7f6634061cf0 msgr2=0x7f6634064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:56.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.008+0000 7f6639e7c700 1 Processor -- start 2019-11-28T11:28:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.009+0000 7f6639e7c700 1 -- start start 2019-11-28T11:28:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.009+0000 7f6639e7c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6634169ee0 0x7f663416c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.009+0000 7f6639e7c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6634140820 con 0x7f6634077040 2019-11-28T11:28:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.009+0000 7f6639e7c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6634140cd0 con 0x7f6634156340 2019-11-28T11:28:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.009+0000 7f6639e7c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6634137110 con 0x7f6634169ee0 2019-11-28T11:28:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.009+0000 7f6633fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6634077040 0x7f66341574c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33338/0 (socket says 172.21.15.80:33338) 2019-11-28T11:28:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.009+0000 7f6633fff700 1 -- 172.21.15.80:0/2103694530 learned_addr learned my addr 172.21.15.80:0/2103694530 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f6638c1a700 1 --2- 172.21.15.80:0/2103694530 >> v2:172.21.15.174:3300/0 conn(0x7f6634169ee0 0x7f663416c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f66317fa700 1 -- 172.21.15.80:0/2103694530 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916077138 0 0) 0x7f6624001940 con 0x7f6634077040 2019-11-28T11:28:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f66317fa700 1 -- 172.21.15.80:0/2103694530 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6618002e80 con 0x7f6634077040 2019-11-28T11:28:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f66317fa700 1 -- 172.21.15.80:0/2103694530 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1907112231 0 0) 0x7f6624000940 con 0x7f6634077040 2019-11-28T11:28:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f66317fa700 1 -- 172.21.15.80:0/2103694530 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f66180032e0 con 0x7f6634077040 2019-11-28T11:28:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f66317fa700 1 -- 172.21.15.80:0/2103694530 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f66240010a0 con 0x7f6634077040 2019-11-28T11:28:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f6638c1a700 1 -- 172.21.15.80:0/2103694530 >> v1:172.21.15.174:6789/0 conn(0x7f6634156340 legacy=0x7f66341567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f6638c1a700 1 -- 172.21.15.80:0/2103694530 >> v1:172.21.15.80:6789/0 conn(0x7f6634077040 legacy=0x7f66341574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f6638c1a700 1 -- 172.21.15.80:0/2103694530 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6634137a70 con 0x7f6634169ee0 2019-11-28T11:28:56.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f6638c1a700 1 --2- 172.21.15.80:0/2103694530 >> v2:172.21.15.174:3300/0 conn(0x7f6634169ee0 0x7f663416c2e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f662c0106e0 tx=0x7f662c010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f6638c1a700 1 --2- 172.21.15.80:0/2103694530 >> v2:172.21.15.174:3300/0 conn(0x7f6634169ee0 0x7f663416c2e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f662c0106e0 tx=0x7f662c010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f6638c1a700 1 --2- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6634169ee0 0x7f663416c2e0 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7f662c0106e0 tx=0x7f662c010a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:56.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f6638c1a700 1 --2- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6634169ee0 0x7f663416c2e0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f662c0106e0 tx=0x7f662c010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f66317fa700 1 -- 172.21.15.80:0/2103694530 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f662c00b3e0 con 0x7f6634169ee0 2019-11-28T11:28:56.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f6639e7c700 1 -- 172.21.15.80:0/2103694530 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6634137df0 con 0x7f6634169ee0 2019-11-28T11:28:56.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f6638c1a700 1 --2- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6634169ee0 0x7f663416c2e0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f662c0106e0 tx=0x7f662c010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f66317fa700 1 -- 172.21.15.80:0/2103694530 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c00b2a0 con 0x7f6634169ee0 2019-11-28T11:28:56.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f6638c1a700 1 --2- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6634169ee0 0x7f663416c2e0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f662c0106e0 tx=0x7f662c010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f6639e7c700 1 -- 172.21.15.80:0/2103694530 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6634137a70 con 0x7f6634169ee0 2019-11-28T11:28:56.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.010+0000 7f66317fa700 1 -- 172.21.15.80:0/2103694530 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f662c009cf0 con 0x7f6634169ee0 2019-11-28T11:28:56.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.011+0000 7f6638c1a700 1 --2- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6634169ee0 0x7f663416c2e0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f662c0106e0 tx=0x7f662c010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.011+0000 7f66317fa700 1 -- 172.21.15.80:0/2103694530 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f662c009910 con 0x7f6634169ee0 2019-11-28T11:28:56.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.011+0000 7f6638c1a700 1 --2- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6634169ee0 0x7f663416c2e0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f662c0106e0 tx=0x7f662c010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.011+0000 7f66317fa700 1 --2- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6618018770 0x7f661801ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:56.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.011+0000 7f66317fa700 1 -- 172.21.15.80:0/2103694530 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f662c031df0 con 0x7f6634169ee0 2019-11-28T11:28:56.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.011+0000 7f6633fff700 1 --2- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6618018770 0x7f661801ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:56.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.012+0000 7f6633fff700 1 --2- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6618018770 0x7f661801ac00 crc :-1 s=READY pgs=259 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:56.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.018+0000 7f6639e7c700 1 -- 172.21.15.80:0/2103694530 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6634137df0 con 0x7f6634169ee0 2019-11-28T11:28:56.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.022+0000 7f6638c1a700 1 --2- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6634169ee0 0x7f663416c2e0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f662c0106e0 tx=0x7f662c010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.022+0000 7f66317fa700 1 -- 172.21.15.80:0/2103694530 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f662c00b490 con 0x7f6634169ee0 2019-11-28T11:28:56.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.194+0000 7f6639e7c700 1 -- 172.21.15.80:0/2103694530 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6634137a70 con 0x7f6634169ee0 2019-11-28T11:28:56.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.195+0000 7f6638c1a700 1 --2- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6634169ee0 0x7f663416c2e0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f662c0106e0 tx=0x7f662c010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.195+0000 7f66317fa700 1 -- 172.21.15.80:0/2103694530 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+1422 (secure 0 0 0) 0x7f662c00a2d0 con 0x7f6634169ee0 2019-11-28T11:28:56.232 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:56.232 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:54.163001+0000","modified":"2019-11-28T11:28:55.825884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2019-11-28T11:28:56.232 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 27 2019-11-28T11:28:56.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.197+0000 7f6639e7c700 1 -- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6618018770 msgr2=0x7f661801ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.197+0000 7f6639e7c700 1 --2- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6618018770 0x7f661801ac00 crc :-1 s=READY pgs=259 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:56.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.197+0000 7f6639e7c700 1 -- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6634169ee0 msgr2=0x7f663416c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.197+0000 7f6639e7c700 1 --2- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6634169ee0 0x7f663416c2e0 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7f662c0106e0 tx=0x7f662c010a80).stop 2019-11-28T11:28:56.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.197+0000 7f6639e7c700 1 -- 172.21.15.80:0/2103694530 shutdown_connections 2019-11-28T11:28:56.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.197+0000 7f6639e7c700 1 --2- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6634169ee0 0x7f663416c2e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:56.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.197+0000 7f6639e7c700 1 --2- 172.21.15.80:0/2103694530 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6618018770 0x7f661801ac00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:56.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.197+0000 7f6639e7c700 1 -- 172.21.15.80:0/2103694530 shutdown_connections 2019-11-28T11:28:56.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.197+0000 7f6639e7c700 1 -- 172.21.15.80:0/2103694530 wait complete. 2019-11-28T11:28:56.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.197+0000 7f6639e7c700 1 -- 172.21.15.80:0/2103694530 >> 172.21.15.80:0/2103694530 conn(0x7f663413fa50 msgr2=0x7f663407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:56.236 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:28:56.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.326+0000 7f49eaf23700 1 Processor -- start 2019-11-28T11:28:56.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.326+0000 7f49eaf23700 1 -- start start 2019-11-28T11:28:56.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.327+0000 7f49eaf23700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49e406c0a0 0x7f49e4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:56.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.327+0000 7f49eaf23700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f49e40734e0 0x7f49e4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:56.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.327+0000 7f49eaf23700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e406db00 con 0x7f49e4072360 2019-11-28T11:28:56.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.327+0000 7f49eaf23700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e406f330 con 0x7f49e40734e0 2019-11-28T11:28:56.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.327+0000 7f49eaf23700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40706c0 con 0x7f49e406c0a0 2019-11-28T11:28:56.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.327+0000 7f49e8cbf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f49e40734e0 0x7f49e4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:56.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.327+0000 7f49e8cbf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f49e40734e0 0x7f49e4071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34034/0 (socket says 172.21.15.80:34034) 2019-11-28T11:28:56.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.327+0000 7f49e8cbf700 1 -- 172.21.15.80:0/2293293584 learned_addr learned my addr 172.21.15.80:0/2293293584 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:56.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.327+0000 7f49e9cc1700 1 --1- 172.21.15.80:0/2293293584 >> v1:172.21.15.80:6789/0 conn(0x7f49e4072360 0x7f49e406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33348/0 (socket says 172.21.15.80:33348) 2019-11-28T11:28:56.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.327+0000 7f49e94c0700 1 --2- 172.21.15.80:0/2293293584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49e406c0a0 0x7f49e4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:56.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.327+0000 7f49e8cbf700 1 -- 172.21.15.80:0/2293293584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49e406c0a0 msgr2=0x7f49e4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:56.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.327+0000 7f49e8cbf700 1 --2- 172.21.15.80:0/2293293584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49e406c0a0 0x7f49e4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:56.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.327+0000 7f49e8cbf700 1 -- 172.21.15.80:0/2293293584 >> v1:172.21.15.80:6789/0 conn(0x7f49e4072360 legacy=0x7f49e406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.327+0000 7f49e3fff700 1 -- 172.21.15.80:0/2293293584 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707352358 0 0) 0x7f49dc0009b0 con 0x7f49e4072360 2019-11-28T11:28:56.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.327+0000 7f49e8cbf700 1 -- 172.21.15.80:0/2293293584 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4070a40 con 0x7f49e40734e0 2019-11-28T11:28:56.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.327+0000 7f49e94c0700 1 --2- 172.21.15.80:0/2293293584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49e406c0a0 0x7f49e4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:28:56.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.328+0000 7f49e8cbf700 1 --2- 172.21.15.80:0/2293293584 >> v2:172.21.15.80:3300/0 conn(0x7f49e40734e0 0x7f49e4071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f49d400f740 tx=0x7f49d400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.328+0000 7f49e8cbf700 1 --2- 172.21.15.80:0/2293293584 >> v2:172.21.15.80:3300/0 conn(0x7f49e40734e0 0x7f49e4071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f49d400f740 tx=0x7f49d400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.328+0000 7f49e8cbf700 1 --2- 172.21.15.80:0/2293293584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e40734e0 0x7f49e4071e20 secure :-1 s=READY pgs=621 cs=0 l=1 rx=0x7f49d400f740 tx=0x7f49d400fae0).ready entity=mon.0 client_cookie=72576fafcb6f1668 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:56.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.328+0000 7f49e8cbf700 1 --2- 172.21.15.80:0/2293293584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e40734e0 0x7f49e4071e20 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f49d400f740 tx=0x7f49d400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.328+0000 7f49e3fff700 1 -- 172.21.15.80:0/2293293584 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49d4000960 con 0x7f49e40734e0 2019-11-28T11:28:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.328+0000 7f49e8cbf700 1 --2- 172.21.15.80:0/2293293584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e40734e0 0x7f49e4071e20 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f49d400f740 tx=0x7f49d400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.328+0000 7f49e3fff700 1 -- 172.21.15.80:0/2293293584 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d4000c90 con 0x7f49e40734e0 2019-11-28T11:28:56.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.328+0000 7f49e8cbf700 1 --2- 172.21.15.80:0/2293293584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e40734e0 0x7f49e4071e20 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f49d400f740 tx=0x7f49d400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.328+0000 7f49e3fff700 1 -- 172.21.15.80:0/2293293584 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49d4007210 con 0x7f49e40734e0 2019-11-28T11:28:56.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.328+0000 7f49eaf23700 1 -- 172.21.15.80:0/2293293584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e40734e0 msgr2=0x7f49e4071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.328+0000 7f49eaf23700 1 --2- 172.21.15.80:0/2293293584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e40734e0 0x7f49e4071e20 secure :-1 s=READY pgs=621 cs=0 l=1 rx=0x7f49d400f740 tx=0x7f49d400fae0).stop 2019-11-28T11:28:56.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.328+0000 7f49eaf23700 1 -- 172.21.15.80:0/2293293584 shutdown_connections 2019-11-28T11:28:56.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.328+0000 7f49eaf23700 1 --2- 172.21.15.80:0/2293293584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e40734e0 0x7f49e4071e20 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:56.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.328+0000 7f49eaf23700 1 --2- 172.21.15.80:0/2293293584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49e406c0a0 0x7f49e4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:56.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.329+0000 7f49eaf23700 1 -- 172.21.15.80:0/2293293584 shutdown_connections 2019-11-28T11:28:56.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.329+0000 7f49eaf23700 1 -- 172.21.15.80:0/2293293584 wait complete. 2019-11-28T11:28:56.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.329+0000 7f49eaf23700 1 -- 172.21.15.80:0/2293293584 >> 172.21.15.80:0/2293293584 conn(0x7f49e4061cf0 msgr2=0x7f49e4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:56.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.331+0000 7f49eaf23700 1 Processor -- start 2019-11-28T11:28:56.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.331+0000 7f49eaf23700 1 -- start start 2019-11-28T11:28:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.332+0000 7f49eaf23700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f49e413a780 0x7f49e412d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.332+0000 7f49eaf23700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49e412d9c0 0x7f49e412c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.332+0000 7f49eaf23700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f49e412c840 0x7f49e412ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.332+0000 7f49eaf23700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e412a260 con 0x7f49e412c840 2019-11-28T11:28:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.332+0000 7f49eaf23700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e412a530 con 0x7f49e413a780 2019-11-28T11:28:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.332+0000 7f49eaf23700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e4129830 con 0x7f49e412d9c0 2019-11-28T11:28:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.332+0000 7f49e9cc1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f49e412c840 0x7f49e412ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.332+0000 7f49e9cc1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f49e412c840 0x7f49e412ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34040/0 (socket says 172.21.15.80:34040) 2019-11-28T11:28:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.332+0000 7f49e9cc1700 1 -- 172.21.15.80:0/1964758244 learned_addr learned my addr 172.21.15.80:0/1964758244 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.332+0000 7f49e8cbf700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49e412d9c0 0x7f49e412c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.332+0000 7f49e94c0700 1 --2- 172.21.15.80:0/1964758244 >> v2:172.21.15.174:3300/0 conn(0x7f49e413a780 0x7f49e412d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:56.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e9cc1700 1 -- 172.21.15.80:0/1964758244 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49e412d9c0 msgr2=0x7f49e412c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e9cc1700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49e412d9c0 0x7f49e412c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:56.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e9cc1700 1 -- 172.21.15.80:0/1964758244 >> v2:172.21.15.174:3300/0 conn(0x7f49e413a780 msgr2=0x7f49e412d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e9cc1700 1 --2- 172.21.15.80:0/1964758244 >> v2:172.21.15.174:3300/0 conn(0x7f49e413a780 0x7f49e412d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:56.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e9cc1700 1 -- 172.21.15.80:0/1964758244 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e412abc0 con 0x7f49e412c840 2019-11-28T11:28:56.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e9cc1700 1 --2- 172.21.15.80:0/1964758244 >> v2:172.21.15.80:3300/0 conn(0x7f49e412c840 0x7f49e412ccc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49dc0125f0 tx=0x7f49dc0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e9cc1700 1 --2- 172.21.15.80:0/1964758244 >> v2:172.21.15.80:3300/0 conn(0x7f49e412c840 0x7f49e412ccc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49dc0125f0 tx=0x7f49dc0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e9cc1700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e412c840 0x7f49e412ccc0 secure :-1 s=READY pgs=622 cs=0 l=1 rx=0x7f49dc0125f0 tx=0x7f49dc0102e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:56.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e9cc1700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e412c840 0x7f49e412ccc0 secure :-1 s=THROTTLE_DONE pgs=622 cs=0 l=1 rx=0x7f49dc0125f0 tx=0x7f49dc0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e9cc1700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e412c840 0x7f49e412ccc0 secure :-1 s=THROTTLE_DONE pgs=622 cs=0 l=1 rx=0x7f49dc0125f0 tx=0x7f49dc0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e1ffb700 1 -- 172.21.15.80:0/1964758244 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49dc000940 con 0x7f49e412c840 2019-11-28T11:28:56.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e9cc1700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e412c840 0x7f49e412ccc0 secure :-1 s=THROTTLE_DONE pgs=622 cs=0 l=1 rx=0x7f49dc0125f0 tx=0x7f49dc0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e1ffb700 1 -- 172.21.15.80:0/1964758244 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc0010e0 con 0x7f49e412c840 2019-11-28T11:28:56.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e1ffb700 1 -- 172.21.15.80:0/1964758244 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49dc001770 con 0x7f49e412c840 2019-11-28T11:28:56.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49eaf23700 1 -- 172.21.15.80:0/1964758244 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e412af40 con 0x7f49e412c840 2019-11-28T11:28:56.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49eaf23700 1 -- 172.21.15.80:0/1964758244 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e412abc0 con 0x7f49e412c840 2019-11-28T11:28:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e9cc1700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e412c840 0x7f49e412ccc0 secure :-1 s=THROTTLE_DONE pgs=622 cs=0 l=1 rx=0x7f49dc0125f0 tx=0x7f49dc0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e1ffb700 1 -- 172.21.15.80:0/1964758244 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f49dc0012d0 con 0x7f49e412c840 2019-11-28T11:28:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.333+0000 7f49e9cc1700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e412c840 0x7f49e412ccc0 secure :-1 s=THROTTLE_DONE pgs=622 cs=0 l=1 rx=0x7f49dc0125f0 tx=0x7f49dc0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.334+0000 7f49e1ffb700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49c8018730 0x7f49c801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.334+0000 7f49e1ffb700 1 -- 172.21.15.80:0/1964758244 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f49dc033c90 con 0x7f49e412c840 2019-11-28T11:28:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.334+0000 7f49e94c0700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49c8018730 0x7f49c801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:56.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.334+0000 7f49e94c0700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49c8018730 0x7f49c801abc0 crc :-1 s=READY pgs=260 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:56.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.341+0000 7f49eaf23700 1 -- 172.21.15.80:0/1964758244 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e412af40 con 0x7f49e412c840 2019-11-28T11:28:56.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.344+0000 7f49e9cc1700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e412c840 0x7f49e412ccc0 secure :-1 s=THROTTLE_DONE pgs=622 cs=0 l=1 rx=0x7f49dc0125f0 tx=0x7f49dc0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.344+0000 7f49e1ffb700 1 -- 172.21.15.80:0/1964758244 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f49dc02ef80 con 0x7f49e412c840 2019-11-28T11:28:56.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.520+0000 7f49eaf23700 1 -- 172.21.15.80:0/1964758244 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49e412abc0 con 0x7f49e412c840 2019-11-28T11:28:56.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.521+0000 7f49e9cc1700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e412c840 0x7f49e412ccc0 secure :-1 s=THROTTLE_DONE pgs=622 cs=0 l=1 rx=0x7f49dc0125f0 tx=0x7f49dc0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.521+0000 7f49e1ffb700 1 -- 172.21.15.80:0/1964758244 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+14857 (secure 0 0 0) 0x7f49dc02ff00 con 0x7f49e412c840 2019-11-28T11:28:56.551 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:56.551 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":57,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:28:55.164436+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:28:52.545871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2019-11-28T11:28:53.180206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:28:56.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.523+0000 7f49eaf23700 1 -- 172.21.15.80:0/1964758244 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49c8018730 msgr2=0x7f49c801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.523+0000 7f49eaf23700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49c8018730 0x7f49c801abc0 crc :-1 s=READY pgs=260 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:56.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.523+0000 7f49eaf23700 1 -- 172.21.15.80:0/1964758244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e412c840 msgr2=0x7f49e412ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.523+0000 7f49eaf23700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e412c840 0x7f49e412ccc0 secure :-1 s=READY pgs=622 cs=0 l=1 rx=0x7f49dc0125f0 tx=0x7f49dc0102e0).stop 2019-11-28T11:28:56.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.523+0000 7f49eaf23700 1 -- 172.21.15.80:0/1964758244 shutdown_connections 2019-11-28T11:28:56.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.523+0000 7f49eaf23700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49c8018730 0x7f49c801abc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:56.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.523+0000 7f49eaf23700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e412c840 0x7f49e412ccc0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:56.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.523+0000 7f49eaf23700 1 --2- 172.21.15.80:0/1964758244 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49e412d9c0 0x7f49e412c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:56.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.523+0000 7f49eaf23700 1 --2- 172.21.15.80:0/1964758244 >> v2:172.21.15.174:3300/0 conn(0x7f49e413a780 0x7f49e412d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:56.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.523+0000 7f49eaf23700 1 -- 172.21.15.80:0/1964758244 shutdown_connections 2019-11-28T11:28:56.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.523+0000 7f49eaf23700 1 -- 172.21.15.80:0/1964758244 wait complete. 2019-11-28T11:28:56.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.523+0000 7f49eaf23700 1 -- 172.21.15.80:0/1964758244 >> 172.21.15.80:0/1964758244 conn(0x7f49e4127dc0 msgr2=0x7f49e4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:56.564 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:28:56.564 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:28:56.565 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:28:56.565 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:28:56.565 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:28:56.566 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:28:56.571 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:28:56.571 DEBUG:teuthology.parallel:result is None 2019-11-28T11:28:56.572 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:28:56.573 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:28:56.573 DEBUG:teuthology.parallel:result is None 2019-11-28T11:28:56.573 DEBUG:teuthology.parallel:result is None 2019-11-28T11:28:56.574 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:28:56.660 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:28:56.661 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:28:56.662 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:28:56.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.681+0000 7f13798d9700 1 Processor -- start 2019-11-28T11:28:56.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.681+0000 7f13798d9700 1 -- start start 2019-11-28T11:28:56.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.682+0000 7f13798d9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f137415ed10 0x7f137415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:56.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.682+0000 7f13798d9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13740734b0 0x7f13740726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:56.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.682+0000 7f13798d9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137406db60 con 0x7f1374073020 2019-11-28T11:28:56.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.682+0000 7f13798d9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137406fe00 con 0x7f137415ed10 2019-11-28T11:28:56.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.682+0000 7f13798d9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13740700d0 con 0x7f13740734b0 2019-11-28T11:28:56.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.682+0000 7f13737fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f137415ed10 0x7f137415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:56.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.682+0000 7f13737fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f137415ed10 0x7f137415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34068/0 (socket says 172.21.15.80:34068) 2019-11-28T11:28:56.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.682+0000 7f13737fe700 1 -- 172.21.15.80:0/161166727 learned_addr learned my addr 172.21.15.80:0/161166727 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:56.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.682+0000 7f1373fff700 1 --2- 172.21.15.80:0/161166727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13740734b0 0x7f13740726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:56.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.683+0000 7f13737fe700 1 -- 172.21.15.80:0/161166727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13740734b0 msgr2=0x7f13740726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:56.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.683+0000 7f13737fe700 1 --2- 172.21.15.80:0/161166727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13740734b0 0x7f13740726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:56.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.683+0000 7f13737fe700 1 -- 172.21.15.80:0/161166727 >> v1:172.21.15.174:6789/0 conn(0x7f1374073020 legacy=0x7f1374071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:56.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.683+0000 7f13737fe700 1 -- 172.21.15.80:0/161166727 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1374070760 con 0x7f137415ed10 2019-11-28T11:28:56.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.683+0000 7f13737fe700 1 --2- 172.21.15.80:0/161166727 >> v2:172.21.15.80:3300/0 conn(0x7f137415ed10 0x7f137415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f136400f6c0 tx=0x7f136400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.683+0000 7f13737fe700 1 --2- 172.21.15.80:0/161166727 >> v2:172.21.15.80:3300/0 conn(0x7f137415ed10 0x7f137415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f136400f6c0 tx=0x7f136400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.683+0000 7f13737fe700 1 --2- 172.21.15.80:0/161166727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f137415ed10 0x7f137415f100 secure :-1 s=READY pgs=629 cs=0 l=1 rx=0x7f136400f6c0 tx=0x7f136400fa60).ready entity=mon.0 client_cookie=6399570941de7202 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:56.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.683+0000 7f13737fe700 1 --2- 172.21.15.80:0/161166727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f137415ed10 0x7f137415f100 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f136400f6c0 tx=0x7f136400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.683+0000 7f13737fe700 1 --2- 172.21.15.80:0/161166727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f137415ed10 0x7f137415f100 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f136400f6c0 tx=0x7f136400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.683+0000 7f13727fc700 1 -- 172.21.15.80:0/161166727 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1364000960 con 0x7f137415ed10 2019-11-28T11:28:56.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.683+0000 7f13737fe700 1 --2- 172.21.15.80:0/161166727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f137415ed10 0x7f137415f100 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f136400f6c0 tx=0x7f136400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.683+0000 7f13727fc700 1 -- 172.21.15.80:0/161166727 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1364000c90 con 0x7f137415ed10 2019-11-28T11:28:56.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.683+0000 7f13727fc700 1 -- 172.21.15.80:0/161166727 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13640013a0 con 0x7f137415ed10 2019-11-28T11:28:56.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.683+0000 7f13798d9700 1 -- 172.21.15.80:0/161166727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f137415ed10 msgr2=0x7f137415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.683+0000 7f13798d9700 1 --2- 172.21.15.80:0/161166727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f137415ed10 0x7f137415f100 secure :-1 s=READY pgs=629 cs=0 l=1 rx=0x7f136400f6c0 tx=0x7f136400fa60).stop 2019-11-28T11:28:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.684+0000 7f13798d9700 1 -- 172.21.15.80:0/161166727 shutdown_connections 2019-11-28T11:28:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.684+0000 7f13798d9700 1 --2- 172.21.15.80:0/161166727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13740734b0 0x7f13740726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.684+0000 7f13798d9700 1 --2- 172.21.15.80:0/161166727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f137415ed10 0x7f137415f100 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.684+0000 7f13798d9700 1 -- 172.21.15.80:0/161166727 shutdown_connections 2019-11-28T11:28:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.684+0000 7f13798d9700 1 -- 172.21.15.80:0/161166727 wait complete. 2019-11-28T11:28:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.684+0000 7f13798d9700 1 -- 172.21.15.80:0/161166727 >> 172.21.15.80:0/161166727 conn(0x7f1374061d40 msgr2=0x7f13740641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:56.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.686+0000 7f13798d9700 1 Processor -- start 2019-11-28T11:28:56.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.686+0000 7f13798d9700 1 -- start start 2019-11-28T11:28:56.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.687+0000 7f13798d9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f137410c3c0 0x7f137410c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:56.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.687+0000 7f13798d9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137414dd80 con 0x7f137410cd90 2019-11-28T11:28:56.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.687+0000 7f13798d9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137410f4c0 con 0x7f137414d8d0 2019-11-28T11:28:56.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.687+0000 7f13798d9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13741029b0 con 0x7f137410c3c0 2019-11-28T11:28:56.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.687+0000 7f1373fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f137410cd90 0x7f137412be80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33390/0 (socket says 172.21.15.80:33390) 2019-11-28T11:28:56.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.687+0000 7f1373fff700 1 -- 172.21.15.80:0/366668494 learned_addr learned my addr 172.21.15.80:0/366668494 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:56.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.687+0000 7f1372ffd700 1 --2- 172.21.15.80:0/366668494 >> v2:172.21.15.174:3300/0 conn(0x7f137410c3c0 0x7f137410c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:56.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.687+0000 7f136bfff700 1 -- 172.21.15.80:0/366668494 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800945692 0 0) 0x7f136c005c50 con 0x7f137410cd90 2019-11-28T11:28:56.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.687+0000 7f136bfff700 1 -- 172.21.15.80:0/366668494 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f134c002e80 con 0x7f137410cd90 2019-11-28T11:28:56.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.688+0000 7f1372ffd700 1 -- 172.21.15.80:0/366668494 >> v1:172.21.15.174:6789/0 conn(0x7f137414d8d0 legacy=0x7f137410d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.688+0000 7f136bfff700 1 -- 172.21.15.80:0/366668494 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 276946921 0 0) 0x7f136c001200 con 0x7f137410cd90 2019-11-28T11:28:56.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.688+0000 7f1372ffd700 1 -- 172.21.15.80:0/366668494 >> v1:172.21.15.80:6789/0 conn(0x7f137410cd90 legacy=0x7f137412be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.688+0000 7f1372ffd700 1 -- 172.21.15.80:0/366668494 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1374103310 con 0x7f137410c3c0 2019-11-28T11:28:56.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.688+0000 7f1372ffd700 1 --2- 172.21.15.80:0/366668494 >> v2:172.21.15.174:3300/0 conn(0x7f137410c3c0 0x7f137410c850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f135c0103a0 tx=0x7f135c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.688+0000 7f1372ffd700 1 --2- 172.21.15.80:0/366668494 >> v2:172.21.15.174:3300/0 conn(0x7f137410c3c0 0x7f137410c850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f135c0103a0 tx=0x7f135c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.688+0000 7f1372ffd700 1 --2- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f137410c3c0 0x7f137410c850 secure :-1 s=READY pgs=366 cs=0 l=1 rx=0x7f135c0103a0 tx=0x7f135c010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:56.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.688+0000 7f1372ffd700 1 --2- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f137410c3c0 0x7f137410c850 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f135c0103a0 tx=0x7f135c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.688+0000 7f1372ffd700 1 --2- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f137410c3c0 0x7f137410c850 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f135c0103a0 tx=0x7f135c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.688+0000 7f136bfff700 1 -- 172.21.15.80:0/366668494 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f135c0099d0 con 0x7f137410c3c0 2019-11-28T11:28:56.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.688+0000 7f1372ffd700 1 --2- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f137410c3c0 0x7f137410c850 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f135c0103a0 tx=0x7f135c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.688+0000 7f136bfff700 1 -- 172.21.15.80:0/366668494 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c009bd0 con 0x7f137410c3c0 2019-11-28T11:28:56.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.688+0000 7f136bfff700 1 -- 172.21.15.80:0/366668494 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f135c00a2a0 con 0x7f137410c3c0 2019-11-28T11:28:56.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.688+0000 7f13798d9700 1 -- 172.21.15.80:0/366668494 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1374103690 con 0x7f137410c3c0 2019-11-28T11:28:56.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.688+0000 7f13798d9700 1 -- 172.21.15.80:0/366668494 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1374103310 con 0x7f137410c3c0 2019-11-28T11:28:56.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.688+0000 7f1372ffd700 1 --2- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f137410c3c0 0x7f137410c850 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f135c0103a0 tx=0x7f135c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.689+0000 7f136bfff700 1 -- 172.21.15.80:0/366668494 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f135c009880 con 0x7f137410c3c0 2019-11-28T11:28:56.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.689+0000 7f1372ffd700 1 --2- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f137410c3c0 0x7f137410c850 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f135c0103a0 tx=0x7f135c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.689+0000 7f136bfff700 1 --2- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f134c018780 0x7f134c01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:56.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.689+0000 7f136bfff700 1 -- 172.21.15.80:0/366668494 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f135c031a80 con 0x7f137410c3c0 2019-11-28T11:28:56.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.689+0000 7f13737fe700 1 --2- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f134c018780 0x7f134c01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:56.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.689+0000 7f13737fe700 1 --2- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f134c018780 0x7f134c01abf0 crc :-1 s=READY pgs=261 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:56.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.696+0000 7f13798d9700 1 -- 172.21.15.80:0/366668494 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1374103690 con 0x7f137410c3c0 2019-11-28T11:28:56.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.700+0000 7f1372ffd700 1 --2- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f137410c3c0 0x7f137410c850 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f135c0103a0 tx=0x7f135c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.700+0000 7f136bfff700 1 -- 172.21.15.80:0/366668494 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f135c0095d0 con 0x7f137410c3c0 2019-11-28T11:28:56.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.872+0000 7f13798d9700 1 -- 172.21.15.80:0/366668494 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1374103310 con 0x7f137410c3c0 2019-11-28T11:28:56.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.875+0000 7f1372ffd700 1 --2- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f137410c3c0 0x7f137410c850 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f135c0103a0 tx=0x7f135c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:56.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.875+0000 7f136bfff700 1 -- 172.21.15.80:0/366668494 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7f135c009a40 con 0x7f137410c3c0 2019-11-28T11:28:56.908 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:28:56.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.881+0000 7f13798d9700 1 -- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f134c018780 msgr2=0x7f134c01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.881+0000 7f13798d9700 1 --2- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f134c018780 0x7f134c01abf0 crc :-1 s=READY pgs=261 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:56.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.881+0000 7f13798d9700 1 -- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f137410c3c0 msgr2=0x7f137410c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:56.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.881+0000 7f13798d9700 1 --2- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f137410c3c0 0x7f137410c850 secure :-1 s=READY pgs=366 cs=0 l=1 rx=0x7f135c0103a0 tx=0x7f135c010740).stop 2019-11-28T11:28:56.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.881+0000 7f13798d9700 1 -- 172.21.15.80:0/366668494 shutdown_connections 2019-11-28T11:28:56.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.881+0000 7f13798d9700 1 --2- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f137410c3c0 0x7f137410c850 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:56.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.881+0000 7f13798d9700 1 --2- 172.21.15.80:0/366668494 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f134c018780 0x7f134c01abf0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:56.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.881+0000 7f13798d9700 1 -- 172.21.15.80:0/366668494 shutdown_connections 2019-11-28T11:28:56.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.881+0000 7f13798d9700 1 -- 172.21.15.80:0/366668494 wait complete. 2019-11-28T11:28:56.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:56.881+0000 7f13798d9700 1 -- 172.21.15.80:0/366668494 >> 172.21.15.80:0/366668494 conn(0x7f137414eee0 msgr2=0x7f1374149850 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:56.920 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:28:57.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.024+0000 7fed0c4b3700 1 Processor -- start 2019-11-28T11:28:57.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.024+0000 7fed0c4b3700 1 -- start start 2019-11-28T11:28:57.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.025+0000 7fed0c4b3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed0415f100 0x7fed0406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:57.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.025+0000 7fed0c4b3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0406db60 con 0x7fed0406c2f0 2019-11-28T11:28:57.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.025+0000 7fed0c4b3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0406e060 con 0x7fed0415ed10 2019-11-28T11:28:57.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.025+0000 7fed0c4b3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0406fe00 con 0x7fed0415f100 2019-11-28T11:28:57.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.025+0000 7fed0a24f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed0415f100 0x7fed0406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:57.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed0a24f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed0415f100 0x7fed0406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34086/0 (socket says 172.21.15.80:34086) 2019-11-28T11:28:57.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed0a24f700 1 -- 172.21.15.80:0/2274712667 learned_addr learned my addr 172.21.15.80:0/2274712667 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:57.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed0a24f700 1 -- 172.21.15.80:0/2274712667 >> v1:172.21.15.174:6789/0 conn(0x7fed0415ed10 legacy=0x7fed04073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed0a24f700 1 -- 172.21.15.80:0/2274712667 >> v1:172.21.15.80:6789/0 conn(0x7fed0406c2f0 legacy=0x7fed0406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed0a24f700 1 -- 172.21.15.80:0/2274712667 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed04070760 con 0x7fed0415f100 2019-11-28T11:28:57.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed09a4e700 1 -- 172.21.15.80:0/2274712667 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081832532 0 0) 0x7fecfc000a40 con 0x7fed0406c2f0 2019-11-28T11:28:57.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed0a24f700 1 --2- 172.21.15.80:0/2274712667 >> v2:172.21.15.80:3300/0 conn(0x7fed0415f100 0x7fed0406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fed0000fac0 tx=0x7fed0000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed0a24f700 1 --2- 172.21.15.80:0/2274712667 >> v2:172.21.15.80:3300/0 conn(0x7fed0415f100 0x7fed0406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fed0000fac0 tx=0x7fed0000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed0a24f700 1 --2- 172.21.15.80:0/2274712667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed0415f100 0x7fed0406bdb0 secure :-1 s=READY pgs=632 cs=0 l=1 rx=0x7fed0000fac0 tx=0x7fed0000fe60).ready entity=mon.0 client_cookie=c7021097951b7a8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:57.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed0a24f700 1 --2- 172.21.15.80:0/2274712667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed0415f100 0x7fed0406bdb0 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7fed0000fac0 tx=0x7fed0000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed09a4e700 1 -- 172.21.15.80:0/2274712667 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed00000ce0 con 0x7fed0415f100 2019-11-28T11:28:57.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed0a24f700 1 --2- 172.21.15.80:0/2274712667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed0415f100 0x7fed0406bdb0 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7fed0000fac0 tx=0x7fed0000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed09a4e700 1 -- 172.21.15.80:0/2274712667 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed00001010 con 0x7fed0415f100 2019-11-28T11:28:57.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed0a24f700 1 --2- 172.21.15.80:0/2274712667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed0415f100 0x7fed0406bdb0 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7fed0000fac0 tx=0x7fed0000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed09a4e700 1 -- 172.21.15.80:0/2274712667 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed00007590 con 0x7fed0415f100 2019-11-28T11:28:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed0c4b3700 1 -- 172.21.15.80:0/2274712667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed0415f100 msgr2=0x7fed0406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.026+0000 7fed0c4b3700 1 --2- 172.21.15.80:0/2274712667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed0415f100 0x7fed0406bdb0 secure :-1 s=READY pgs=632 cs=0 l=1 rx=0x7fed0000fac0 tx=0x7fed0000fe60).stop 2019-11-28T11:28:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.027+0000 7fed0c4b3700 1 -- 172.21.15.80:0/2274712667 shutdown_connections 2019-11-28T11:28:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.027+0000 7fed0c4b3700 1 --2- 172.21.15.80:0/2274712667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed0415f100 0x7fed0406bdb0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.027+0000 7fed0c4b3700 1 -- 172.21.15.80:0/2274712667 shutdown_connections 2019-11-28T11:28:57.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.027+0000 7fed0c4b3700 1 -- 172.21.15.80:0/2274712667 wait complete. 2019-11-28T11:28:57.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.027+0000 7fed0c4b3700 1 -- 172.21.15.80:0/2274712667 >> 172.21.15.80:0/2274712667 conn(0x7fed04061d40 msgr2=0x7fed040641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:57.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.029+0000 7fed0c4b3700 1 Processor -- start 2019-11-28T11:28:57.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.029+0000 7fed0c4b3700 1 -- start start 2019-11-28T11:28:57.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.030+0000 7fed0c4b3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fed04152750 0x7fed04135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:57.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.030+0000 7fed0c4b3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed04109d70 con 0x7fed04130dc0 2019-11-28T11:28:57.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.030+0000 7fed0c4b3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed041308e0 con 0x7fed04165d60 2019-11-28T11:28:57.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.030+0000 7fed0c4b3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed04132570 con 0x7fed04152750 2019-11-28T11:28:57.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.030+0000 7fed0a24f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fed04130dc0 0x7fed04131250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33408/0 (socket says 172.21.15.80:33408) 2019-11-28T11:28:57.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.030+0000 7fed0a24f700 1 -- 172.21.15.80:0/725849015 learned_addr learned my addr 172.21.15.80:0/725849015 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:57.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.030+0000 7fed0aa50700 1 --2- 172.21.15.80:0/725849015 >> v2:172.21.15.174:3300/0 conn(0x7fed04152750 0x7fed04135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:57.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fecfb7fe700 1 -- 172.21.15.80:0/725849015 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216612285 0 0) 0x7fed00007c80 con 0x7fed04130dc0 2019-11-28T11:28:57.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fecfb7fe700 1 -- 172.21.15.80:0/725849015 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecec002e80 con 0x7fed04130dc0 2019-11-28T11:28:57.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fecfb7fe700 1 -- 172.21.15.80:0/725849015 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376107835 0 0) 0x7fecfc000e20 con 0x7fed04165d60 2019-11-28T11:28:57.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fed0aa50700 1 -- 172.21.15.80:0/725849015 >> v1:172.21.15.174:6789/0 conn(0x7fed04165d60 legacy=0x7fed04168160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fed0aa50700 1 -- 172.21.15.80:0/725849015 >> v1:172.21.15.80:6789/0 conn(0x7fed04130dc0 legacy=0x7fed04131250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fed0aa50700 1 -- 172.21.15.80:0/725849015 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed04132ed0 con 0x7fed04152750 2019-11-28T11:28:57.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fed0aa50700 1 --2- 172.21.15.80:0/725849015 >> v2:172.21.15.174:3300/0 conn(0x7fed04152750 0x7fed04135790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fecf40103a0 tx=0x7fecf4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fed0aa50700 1 --2- 172.21.15.80:0/725849015 >> v2:172.21.15.174:3300/0 conn(0x7fed04152750 0x7fed04135790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fecf40103a0 tx=0x7fecf4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fed0aa50700 1 --2- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04152750 0x7fed04135790 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7fecf40103a0 tx=0x7fecf4010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:57.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fed0aa50700 1 --2- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04152750 0x7fed04135790 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7fecf40103a0 tx=0x7fecf4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fecfb7fe700 1 -- 172.21.15.80:0/725849015 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecf4000960 con 0x7fed04152750 2019-11-28T11:28:57.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fed0aa50700 1 --2- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04152750 0x7fed04135790 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7fecf40103a0 tx=0x7fecf4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fed0aa50700 1 --2- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04152750 0x7fed04135790 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7fecf40103a0 tx=0x7fecf4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fecfb7fe700 1 -- 172.21.15.80:0/725849015 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf400eef0 con 0x7fed04152750 2019-11-28T11:28:57.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fecfb7fe700 1 -- 172.21.15.80:0/725849015 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecf400f640 con 0x7fed04152750 2019-11-28T11:28:57.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fed0c4b3700 1 -- 172.21.15.80:0/725849015 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed04133250 con 0x7fed04152750 2019-11-28T11:28:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.031+0000 7fed0c4b3700 1 -- 172.21.15.80:0/725849015 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed04132ed0 con 0x7fed04152750 2019-11-28T11:28:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.032+0000 7fed0aa50700 1 --2- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04152750 0x7fed04135790 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7fecf40103a0 tx=0x7fecf4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.032+0000 7fecfb7fe700 1 -- 172.21.15.80:0/725849015 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fecf400f0e0 con 0x7fed04152750 2019-11-28T11:28:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.032+0000 7fed0aa50700 1 --2- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04152750 0x7fed04135790 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7fecf40103a0 tx=0x7fecf4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.032+0000 7fecfb7fe700 1 --2- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fecec018780 0x7fecec01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.032+0000 7fecfb7fe700 1 -- 172.21.15.80:0/725849015 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fecf4031ac0 con 0x7fed04152750 2019-11-28T11:28:57.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.032+0000 7fed0a24f700 1 --2- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fecec018780 0x7fecec01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:57.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.032+0000 7fed0a24f700 1 --2- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fecec018780 0x7fecec01abf0 crc :-1 s=READY pgs=262 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:57.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.040+0000 7fed0c4b3700 1 -- 172.21.15.80:0/725849015 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed04133250 con 0x7fed04152750 2019-11-28T11:28:57.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.044+0000 7fed0aa50700 1 --2- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04152750 0x7fed04135790 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7fecf40103a0 tx=0x7fecf4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.044+0000 7fecfb7fe700 1 -- 172.21.15.80:0/725849015 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fecf400f2f0 con 0x7fed04152750 2019-11-28T11:28:57.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.214+0000 7fed0c4b3700 1 -- 172.21.15.80:0/725849015 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fed04132ed0 con 0x7fed04152750 2019-11-28T11:28:57.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.220+0000 7fed0aa50700 1 --2- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04152750 0x7fed04135790 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7fecf40103a0 tx=0x7fecf4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.220+0000 7fecfb7fe700 1 -- 172.21.15.80:0/725849015 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v21) v1 ==== 184+0+0 (secure 0 0 0) 0x7fecf400f220 con 0x7fed04152750 2019-11-28T11:28:57.250 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:28:57.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.223+0000 7fed0c4b3700 1 -- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fecec018780 msgr2=0x7fecec01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.223+0000 7fed0c4b3700 1 --2- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fecec018780 0x7fecec01abf0 crc :-1 s=READY pgs=262 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:57.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.223+0000 7fed0c4b3700 1 -- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04152750 msgr2=0x7fed04135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.223+0000 7fed0c4b3700 1 --2- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04152750 0x7fed04135790 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7fecf40103a0 tx=0x7fecf4010740).stop 2019-11-28T11:28:57.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.223+0000 7fed0c4b3700 1 -- 172.21.15.80:0/725849015 shutdown_connections 2019-11-28T11:28:57.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.223+0000 7fed0c4b3700 1 --2- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fecec018780 0x7fecec01abf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:57.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.223+0000 7fed0c4b3700 1 --2- 172.21.15.80:0/725849015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04152750 0x7fed04135790 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:57.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.223+0000 7fed0c4b3700 1 -- 172.21.15.80:0/725849015 shutdown_connections 2019-11-28T11:28:57.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.223+0000 7fed0c4b3700 1 -- 172.21.15.80:0/725849015 wait complete. 2019-11-28T11:28:57.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.223+0000 7fed0c4b3700 1 -- 172.21.15.80:0/725849015 >> 172.21.15.80:0/725849015 conn(0x7fed041476e0 msgr2=0x7fed0412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:57.262 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:28:57.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.363+0000 7fad905b5700 1 Processor -- start 2019-11-28T11:28:57.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.363+0000 7fad905b5700 1 -- start start 2019-11-28T11:28:57.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.364+0000 7fad905b5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fad8815ed10 0x7fad8815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:57.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.364+0000 7fad905b5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad880734b0 0x7fad880726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:57.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.364+0000 7fad905b5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8806db60 con 0x7fad88073020 2019-11-28T11:28:57.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.364+0000 7fad905b5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8806fe00 con 0x7fad8815ed10 2019-11-28T11:28:57.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.364+0000 7fad905b5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad880700d0 con 0x7fad880734b0 2019-11-28T11:28:57.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.364+0000 7fad8e351700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fad88073020 0x7fad88071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33416/0 (socket says 172.21.15.80:33416) 2019-11-28T11:28:57.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.364+0000 7fad8e351700 1 -- 172.21.15.80:0/813883264 learned_addr learned my addr 172.21.15.80:0/813883264 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:57.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.364+0000 7fad8eb52700 1 --2- 172.21.15.80:0/813883264 >> v2:172.21.15.174:3300/0 conn(0x7fad8815ed10 0x7fad8815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.364+0000 7fad8f353700 1 --2- 172.21.15.80:0/813883264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad880734b0 0x7fad880726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad8db50700 1 -- 172.21.15.80:0/813883264 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426401689 0 0) 0x7fad700013f0 con 0x7fad88073020 2019-11-28T11:28:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad8db50700 1 -- 172.21.15.80:0/813883264 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad74002e80 con 0x7fad88073020 2019-11-28T11:28:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad8f353700 1 -- 172.21.15.80:0/813883264 >> v2:172.21.15.174:3300/0 conn(0x7fad8815ed10 msgr2=0x7fad8815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad8f353700 1 --2- 172.21.15.80:0/813883264 >> v2:172.21.15.174:3300/0 conn(0x7fad8815ed10 0x7fad8815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad8f353700 1 -- 172.21.15.80:0/813883264 >> v1:172.21.15.80:6789/0 conn(0x7fad88073020 legacy=0x7fad88071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad8f353700 1 -- 172.21.15.80:0/813883264 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad88070760 con 0x7fad880734b0 2019-11-28T11:28:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad8eb52700 1 --2- 172.21.15.80:0/813883264 >> v2:172.21.15.174:3300/0 conn(0x7fad8815ed10 0x7fad8815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:28:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad8f353700 1 --2- 172.21.15.80:0/813883264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad880734b0 0x7fad880726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fad8000af80 tx=0x7fad8000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad8f353700 1 --2- 172.21.15.80:0/813883264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad880734b0 0x7fad880726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fad8000af80 tx=0x7fad8000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad8f353700 1 --2- 172.21.15.80:0/813883264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad880734b0 0x7fad880726a0 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7fad8000af80 tx=0x7fad8000b790).ready entity=mon.2 client_cookie=20f07664121809fe server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:57.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad8f353700 1 --2- 172.21.15.80:0/813883264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad880734b0 0x7fad880726a0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fad8000af80 tx=0x7fad8000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad8db50700 1 -- 172.21.15.80:0/813883264 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad80000bc0 con 0x7fad880734b0 2019-11-28T11:28:57.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad8f353700 1 --2- 172.21.15.80:0/813883264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad880734b0 0x7fad880726a0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fad8000af80 tx=0x7fad8000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad8f353700 1 --2- 172.21.15.80:0/813883264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad880734b0 0x7fad880726a0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fad8000af80 tx=0x7fad8000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad8db50700 1 -- 172.21.15.80:0/813883264 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad800097f0 con 0x7fad880734b0 2019-11-28T11:28:57.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad8db50700 1 -- 172.21.15.80:0/813883264 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad80009ec0 con 0x7fad880734b0 2019-11-28T11:28:57.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad905b5700 1 -- 172.21.15.80:0/813883264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad880734b0 msgr2=0x7fad880726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.365+0000 7fad905b5700 1 --2- 172.21.15.80:0/813883264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad880734b0 0x7fad880726a0 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7fad8000af80 tx=0x7fad8000b790).stop 2019-11-28T11:28:57.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.366+0000 7fad905b5700 1 -- 172.21.15.80:0/813883264 shutdown_connections 2019-11-28T11:28:57.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.366+0000 7fad905b5700 1 --2- 172.21.15.80:0/813883264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad880734b0 0x7fad880726a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:57.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.366+0000 7fad905b5700 1 --2- 172.21.15.80:0/813883264 >> v2:172.21.15.174:3300/0 conn(0x7fad8815ed10 0x7fad8815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:57.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.366+0000 7fad905b5700 1 -- 172.21.15.80:0/813883264 shutdown_connections 2019-11-28T11:28:57.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.366+0000 7fad905b5700 1 -- 172.21.15.80:0/813883264 wait complete. 2019-11-28T11:28:57.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.366+0000 7fad905b5700 1 -- 172.21.15.80:0/813883264 >> 172.21.15.80:0/813883264 conn(0x7fad88061d40 msgr2=0x7fad880641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.369+0000 7fad905b5700 1 Processor -- start 2019-11-28T11:28:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.369+0000 7fad905b5700 1 -- start start 2019-11-28T11:28:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.369+0000 7fad905b5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad88152750 0x7fad88135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:57.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.369+0000 7fad905b5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fad88165d60 0x7fad88168160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:57.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.369+0000 7fad905b5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad88109d70 con 0x7fad88130dc0 2019-11-28T11:28:57.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.369+0000 7fad905b5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad88132570 con 0x7fad88152750 2019-11-28T11:28:57.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.369+0000 7fad905b5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad88132840 con 0x7fad88165d60 2019-11-28T11:28:57.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.369+0000 7fad8eb52700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad88152750 0x7fad88135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:57.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad8eb52700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad88152750 0x7fad88135790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34102/0 (socket says 172.21.15.80:34102) 2019-11-28T11:28:57.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad8eb52700 1 -- 172.21.15.80:0/1266554626 learned_addr learned my addr 172.21.15.80:0/1266554626 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:57.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad8f353700 1 --2- 172.21.15.80:0/1266554626 >> v2:172.21.15.174:3300/0 conn(0x7fad88165d60 0x7fad88168160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:57.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad8eb52700 1 -- 172.21.15.80:0/1266554626 >> v2:172.21.15.174:3300/0 conn(0x7fad88165d60 msgr2=0x7fad88168160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad8eb52700 1 --2- 172.21.15.80:0/1266554626 >> v2:172.21.15.174:3300/0 conn(0x7fad88165d60 0x7fad88168160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:57.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad8eb52700 1 -- 172.21.15.80:0/1266554626 >> v1:172.21.15.80:6789/0 conn(0x7fad88130dc0 legacy=0x7fad88131250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad8eb52700 1 -- 172.21.15.80:0/1266554626 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad88132ed0 con 0x7fad88152750 2019-11-28T11:28:57.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad8eb52700 1 --2- 172.21.15.80:0/1266554626 >> v2:172.21.15.80:3300/0 conn(0x7fad88152750 0x7fad88135790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad78010390 tx=0x7fad78010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad8eb52700 1 --2- 172.21.15.80:0/1266554626 >> v2:172.21.15.80:3300/0 conn(0x7fad88152750 0x7fad88135790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad78010390 tx=0x7fad78010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad8eb52700 1 --2- 172.21.15.80:0/1266554626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad88152750 0x7fad88135790 secure :-1 s=READY pgs=636 cs=0 l=1 rx=0x7fad78010390 tx=0x7fad78010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:57.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad8eb52700 1 --2- 172.21.15.80:0/1266554626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad88152750 0x7fad88135790 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7fad78010390 tx=0x7fad78010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad877fe700 1 -- 172.21.15.80:0/1266554626 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad78000960 con 0x7fad88152750 2019-11-28T11:28:57.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad8eb52700 1 --2- 172.21.15.80:0/1266554626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad88152750 0x7fad88135790 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7fad78010390 tx=0x7fad78010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad8eb52700 1 --2- 172.21.15.80:0/1266554626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad88152750 0x7fad88135790 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7fad78010390 tx=0x7fad78010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad877fe700 1 -- 172.21.15.80:0/1266554626 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad78009770 con 0x7fad88152750 2019-11-28T11:28:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad905b5700 1 -- 172.21.15.80:0/1266554626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad88133250 con 0x7fad88152750 2019-11-28T11:28:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad877fe700 1 -- 172.21.15.80:0/1266554626 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad78009ec0 con 0x7fad88152750 2019-11-28T11:28:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.370+0000 7fad905b5700 1 -- 172.21.15.80:0/1266554626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad88132ed0 con 0x7fad88152750 2019-11-28T11:28:57.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.371+0000 7fad8eb52700 1 --2- 172.21.15.80:0/1266554626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad88152750 0x7fad88135790 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7fad78010390 tx=0x7fad78010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.371+0000 7fad877fe700 1 -- 172.21.15.80:0/1266554626 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fad78009960 con 0x7fad88152750 2019-11-28T11:28:57.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.371+0000 7fad8eb52700 1 --2- 172.21.15.80:0/1266554626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad88152750 0x7fad88135790 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7fad78010390 tx=0x7fad78010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.371+0000 7fad877fe700 1 --2- 172.21.15.80:0/1266554626 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fad6c018730 0x7fad6c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:57.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.371+0000 7fad877fe700 1 -- 172.21.15.80:0/1266554626 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fad78031a70 con 0x7fad88152750 2019-11-28T11:28:57.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.371+0000 7fad8e351700 1 --2- 172.21.15.80:0/1266554626 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fad6c018730 0x7fad6c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:57.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.371+0000 7fad8e351700 1 --2- 172.21.15.80:0/1266554626 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fad6c018730 0x7fad6c01abc0 crc :-1 s=READY pgs=263 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:57.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.379+0000 7fad905b5700 1 -- 172.21.15.80:0/1266554626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad88133250 con 0x7fad88152750 2019-11-28T11:28:57.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.382+0000 7fad8eb52700 1 --2- 172.21.15.80:0/1266554626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad88152750 0x7fad88135790 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7fad78010390 tx=0x7fad78010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.382+0000 7fad877fe700 1 -- 172.21.15.80:0/1266554626 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fad78017540 con 0x7fad88152750 2019-11-28T11:28:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.552+0000 7fad905b5700 1 -- 172.21.15.80:0/1266554626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fad88132ed0 con 0x7fad88152750 2019-11-28T11:28:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.557+0000 7fad8eb52700 1 --2- 172.21.15.80:0/1266554626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad88152750 0x7fad88135790 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7fad78010390 tx=0x7fad78010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.557+0000 7fad877fe700 1 -- 172.21.15.80:0/1266554626 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7fad780179b0 con 0x7fad88152750 2019-11-28T11:28:57.588 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:28:57.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.561+0000 7fad905b5700 1 -- 172.21.15.80:0/1266554626 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fad6c018730 msgr2=0x7fad6c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.561+0000 7fad905b5700 1 --2- 172.21.15.80:0/1266554626 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fad6c018730 0x7fad6c01abc0 crc :-1 s=READY pgs=263 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:57.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.561+0000 7fad905b5700 1 -- 172.21.15.80:0/1266554626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad88152750 msgr2=0x7fad88135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.561+0000 7fad905b5700 1 --2- 172.21.15.80:0/1266554626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad88152750 0x7fad88135790 secure :-1 s=READY pgs=636 cs=0 l=1 rx=0x7fad78010390 tx=0x7fad78010730).stop 2019-11-28T11:28:57.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.561+0000 7fad905b5700 1 -- 172.21.15.80:0/1266554626 shutdown_connections 2019-11-28T11:28:57.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.561+0000 7fad905b5700 1 --2- 172.21.15.80:0/1266554626 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fad6c018730 0x7fad6c01abc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:57.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.561+0000 7fad905b5700 1 --2- 172.21.15.80:0/1266554626 >> v2:172.21.15.174:3300/0 conn(0x7fad88165d60 0x7fad88168160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:57.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.561+0000 7fad905b5700 1 --2- 172.21.15.80:0/1266554626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad88152750 0x7fad88135790 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:57.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.561+0000 7fad905b5700 1 -- 172.21.15.80:0/1266554626 shutdown_connections 2019-11-28T11:28:57.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.561+0000 7fad905b5700 1 -- 172.21.15.80:0/1266554626 wait complete. 2019-11-28T11:28:57.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.561+0000 7fad905b5700 1 -- 172.21.15.80:0/1266554626 >> 172.21.15.80:0/1266554626 conn(0x7fad881476e0 msgr2=0x7fad8812fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:57.600 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:28:57.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.703+0000 7fbb1bef3700 1 Processor -- start 2019-11-28T11:28:57.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.703+0000 7fbb1bef3700 1 -- start start 2019-11-28T11:28:57.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1bef3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb1415ed10 0x7fbb1415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:57.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1bef3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbb14073020 0x7fbb14071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:57.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1bef3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb140734b0 0x7fbb140723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:57.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1bef3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1406fe00 con 0x7fbb1415ed10 2019-11-28T11:28:57.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1bef3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb140700d0 con 0x7fbb14073020 2019-11-28T11:28:57.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1bef3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1406f3d0 con 0x7fbb140734b0 2019-11-28T11:28:57.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1a490700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb1415ed10 0x7fbb1415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:57.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1a490700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb1415ed10 0x7fbb1415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34110/0 (socket says 172.21.15.80:34110) 2019-11-28T11:28:57.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1a490700 1 -- 172.21.15.80:0/547138624 learned_addr learned my addr 172.21.15.80:0/547138624 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:57.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1ac91700 1 --2- 172.21.15.80:0/547138624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb140734b0 0x7fbb140723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:57.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb19c8f700 1 --2- 172.21.15.80:0/547138624 >> v2:172.21.15.174:3300/0 conn(0x7fbb14073020 0x7fbb14071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:57.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1a490700 1 -- 172.21.15.80:0/547138624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb140734b0 msgr2=0x7fbb140723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:57.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1a490700 1 --2- 172.21.15.80:0/547138624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb140734b0 0x7fbb140723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1a490700 1 -- 172.21.15.80:0/547138624 >> v2:172.21.15.174:3300/0 conn(0x7fbb14073020 msgr2=0x7fbb14071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1a490700 1 --2- 172.21.15.80:0/547138624 >> v2:172.21.15.174:3300/0 conn(0x7fbb14073020 0x7fbb14071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1a490700 1 -- 172.21.15.80:0/547138624 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb14070760 con 0x7fbb1415ed10 2019-11-28T11:28:57.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1a490700 1 --2- 172.21.15.80:0/547138624 >> v2:172.21.15.80:3300/0 conn(0x7fbb1415ed10 0x7fbb1415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbb0400f6c0 tx=0x7fbb0400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1a490700 1 --2- 172.21.15.80:0/547138624 >> v2:172.21.15.80:3300/0 conn(0x7fbb1415ed10 0x7fbb1415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbb0400f6c0 tx=0x7fbb0400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1a490700 1 --2- 172.21.15.80:0/547138624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb1415ed10 0x7fbb1415f100 secure :-1 s=READY pgs=637 cs=0 l=1 rx=0x7fbb0400f6c0 tx=0x7fbb0400f570).ready entity=mon.0 client_cookie=619c4f5c33ccb0f6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.704+0000 7fbb1a490700 1 --2- 172.21.15.80:0/547138624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb1415ed10 0x7fbb1415f100 secure :-1 s=THROTTLE_DONE pgs=637 cs=0 l=1 rx=0x7fbb0400f6c0 tx=0x7fbb0400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.705+0000 7fbb1a490700 1 --2- 172.21.15.80:0/547138624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb1415ed10 0x7fbb1415f100 secure :-1 s=THROTTLE_DONE pgs=637 cs=0 l=1 rx=0x7fbb0400f6c0 tx=0x7fbb0400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.705+0000 7fbb1948e700 1 -- 172.21.15.80:0/547138624 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb04000960 con 0x7fbb1415ed10 2019-11-28T11:28:57.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.705+0000 7fbb1a490700 1 --2- 172.21.15.80:0/547138624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb1415ed10 0x7fbb1415f100 secure :-1 s=THROTTLE_DONE pgs=637 cs=0 l=1 rx=0x7fbb0400f6c0 tx=0x7fbb0400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.705+0000 7fbb1948e700 1 -- 172.21.15.80:0/547138624 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb04000c90 con 0x7fbb1415ed10 2019-11-28T11:28:57.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.705+0000 7fbb1948e700 1 -- 172.21.15.80:0/547138624 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb040013a0 con 0x7fbb1415ed10 2019-11-28T11:28:57.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.705+0000 7fbb1bef3700 1 -- 172.21.15.80:0/547138624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb1415ed10 msgr2=0x7fbb1415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.705+0000 7fbb1bef3700 1 --2- 172.21.15.80:0/547138624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb1415ed10 0x7fbb1415f100 secure :-1 s=READY pgs=637 cs=0 l=1 rx=0x7fbb0400f6c0 tx=0x7fbb0400f570).stop 2019-11-28T11:28:57.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.705+0000 7fbb1bef3700 1 -- 172.21.15.80:0/547138624 shutdown_connections 2019-11-28T11:28:57.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.705+0000 7fbb1bef3700 1 --2- 172.21.15.80:0/547138624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb140734b0 0x7fbb140723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.705+0000 7fbb1bef3700 1 --2- 172.21.15.80:0/547138624 >> v2:172.21.15.174:3300/0 conn(0x7fbb14073020 0x7fbb14071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:28:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.705+0000 7fbb1bef3700 1 --2- 172.21.15.80:0/547138624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb1415ed10 0x7fbb1415f100 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.705+0000 7fbb1bef3700 1 -- 172.21.15.80:0/547138624 shutdown_connections 2019-11-28T11:28:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.705+0000 7fbb1bef3700 1 -- 172.21.15.80:0/547138624 wait complete. 2019-11-28T11:28:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.705+0000 7fbb1bef3700 1 -- 172.21.15.80:0/547138624 >> 172.21.15.80:0/547138624 conn(0x7fbb14061d40 msgr2=0x7fbb140641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:57.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.708+0000 7fbb1bef3700 1 Processor -- start 2019-11-28T11:28:57.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.708+0000 7fbb1bef3700 1 -- start start 2019-11-28T11:28:57.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb1bef3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb14114f60 0x7fbb14106b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:57.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb1bef3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb14130b20 con 0x7fbb141070d0 2019-11-28T11:28:57.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb1bef3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb14130620 con 0x7fbb1412e9a0 2019-11-28T11:28:57.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb1bef3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1410a4b0 con 0x7fbb14114f60 2019-11-28T11:28:57.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb19c8f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbb141070d0 0x7fbb1412e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33434/0 (socket says 172.21.15.80:33434) 2019-11-28T11:28:57.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb19c8f700 1 -- 172.21.15.80:0/1570313635 learned_addr learned my addr 172.21.15.80:0/1570313635 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:57.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb1a490700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb14114f60 0x7fbb14106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:57.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb12ffd700 1 -- 172.21.15.80:0/1570313635 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727597293 0 0) 0x7fbb0c001430 con 0x7fbb141070d0 2019-11-28T11:28:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb12ffd700 1 -- 172.21.15.80:0/1570313635 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf8002e80 con 0x7fbb141070d0 2019-11-28T11:28:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb12ffd700 1 -- 172.21.15.80:0/1570313635 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261506294 0 0) 0x7fbafc0095b0 con 0x7fbb1412e9a0 2019-11-28T11:28:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb12ffd700 1 -- 172.21.15.80:0/1570313635 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf80030b0 con 0x7fbb1412e9a0 2019-11-28T11:28:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb1a490700 1 -- 172.21.15.80:0/1570313635 >> v1:172.21.15.174:6789/0 conn(0x7fbb1412e9a0 legacy=0x7fbb14105a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb1a490700 1 -- 172.21.15.80:0/1570313635 >> v1:172.21.15.80:6789/0 conn(0x7fbb141070d0 legacy=0x7fbb1412e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb1a490700 1 -- 172.21.15.80:0/1570313635 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb14104390 con 0x7fbb14114f60 2019-11-28T11:28:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb1a490700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb14114f60 0x7fbb14106b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb040543c0 tx=0x7fbb04054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb1a490700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb14114f60 0x7fbb14106b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb040543c0 tx=0x7fbb04054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb1a490700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb14114f60 0x7fbb14106b90 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7fbb040543c0 tx=0x7fbb04054760).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb1a490700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb14114f60 0x7fbb14106b90 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fbb040543c0 tx=0x7fbb04054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb12ffd700 1 -- 172.21.15.80:0/1570313635 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb04007e10 con 0x7fbb14114f60 2019-11-28T11:28:57.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb1a490700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb14114f60 0x7fbb14106b90 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fbb040543c0 tx=0x7fbb04054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb1a490700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb14114f60 0x7fbb14106b90 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fbb040543c0 tx=0x7fbb04054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb12ffd700 1 -- 172.21.15.80:0/1570313635 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb04005370 con 0x7fbb14114f60 2019-11-28T11:28:57.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb1bef3700 1 -- 172.21.15.80:0/1570313635 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb14104710 con 0x7fbb14114f60 2019-11-28T11:28:57.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.709+0000 7fbb12ffd700 1 -- 172.21.15.80:0/1570313635 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb04005ac0 con 0x7fbb14114f60 2019-11-28T11:28:57.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.710+0000 7fbb1bef3700 1 -- 172.21.15.80:0/1570313635 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb14104390 con 0x7fbb14114f60 2019-11-28T11:28:57.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.710+0000 7fbb1a490700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb14114f60 0x7fbb14106b90 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fbb040543c0 tx=0x7fbb04054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.710+0000 7fbb12ffd700 1 -- 172.21.15.80:0/1570313635 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbb04007df0 con 0x7fbb14114f60 2019-11-28T11:28:57.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.710+0000 7fbb1a490700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb14114f60 0x7fbb14106b90 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fbb040543c0 tx=0x7fbb04054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.710+0000 7fbb12ffd700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbaf8018750 0x7fbaf801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:57.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.710+0000 7fbb12ffd700 1 -- 172.21.15.80:0/1570313635 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fbb04075a70 con 0x7fbb14114f60 2019-11-28T11:28:57.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.710+0000 7fbb19c8f700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbaf8018750 0x7fbaf801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:57.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.711+0000 7fbb19c8f700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbaf8018750 0x7fbaf801abe0 crc :-1 s=READY pgs=264 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:57.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.718+0000 7fbb1bef3700 1 -- 172.21.15.80:0/1570313635 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb14104710 con 0x7fbb14114f60 2019-11-28T11:28:57.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.722+0000 7fbb1a490700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb14114f60 0x7fbb14106b90 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fbb040543c0 tx=0x7fbb04054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.722+0000 7fbb12ffd700 1 -- 172.21.15.80:0/1570313635 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbb04007580 con 0x7fbb14114f60 2019-11-28T11:28:57.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.895+0000 7fbb1bef3700 1 -- 172.21.15.80:0/1570313635 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fbb14104390 con 0x7fbb14114f60 2019-11-28T11:28:57.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.898+0000 7fbb1a490700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb14114f60 0x7fbb14106b90 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fbb040543c0 tx=0x7fbb04054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:57.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.899+0000 7fbb12ffd700 1 -- 172.21.15.80:0/1570313635 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v23) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbb0405b430 con 0x7fbb14114f60 2019-11-28T11:28:57.931 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:28:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.904+0000 7fbb1bef3700 1 -- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbaf8018750 msgr2=0x7fbaf801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.904+0000 7fbb1bef3700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbaf8018750 0x7fbaf801abe0 crc :-1 s=READY pgs=264 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:57.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.904+0000 7fbb1bef3700 1 -- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb14114f60 msgr2=0x7fbb14106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:57.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.904+0000 7fbb1bef3700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb14114f60 0x7fbb14106b90 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7fbb040543c0 tx=0x7fbb04054760).stop 2019-11-28T11:28:57.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.904+0000 7fbb1bef3700 1 -- 172.21.15.80:0/1570313635 shutdown_connections 2019-11-28T11:28:57.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.904+0000 7fbb1bef3700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbaf8018750 0x7fbaf801abe0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:57.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.904+0000 7fbb1bef3700 1 --2- 172.21.15.80:0/1570313635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb14114f60 0x7fbb14106b90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:57.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.904+0000 7fbb1bef3700 1 -- 172.21.15.80:0/1570313635 shutdown_connections 2019-11-28T11:28:57.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.904+0000 7fbb1bef3700 1 -- 172.21.15.80:0/1570313635 wait complete. 2019-11-28T11:28:57.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:57.904+0000 7fbb1bef3700 1 -- 172.21.15.80:0/1570313635 >> 172.21.15.80:0/1570313635 conn(0x7fbb141476e0 msgr2=0x7fbb1412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:57.943 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:28:58.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.035+0000 7f68c5cec700 1 Processor -- start 2019-11-28T11:28:58.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.036+0000 7f68c5cec700 1 -- start start 2019-11-28T11:28:58.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.036+0000 7f68c5cec700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f68c006c0a0 0x7f68c0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:58.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.036+0000 7f68c5cec700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c006db00 con 0x7f68c0072620 2019-11-28T11:28:58.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.036+0000 7f68c5cec700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c006e000 con 0x7f68c00734e0 2019-11-28T11:28:58.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.036+0000 7f68c5cec700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c006fd60 con 0x7f68c006c0a0 2019-11-28T11:28:58.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68c4a8a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f68c0072620 0x7f68c0164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33444/0 (socket says 172.21.15.80:33444) 2019-11-28T11:28:58.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68c4a8a700 1 -- 172.21.15.80:0/1828609194 learned_addr learned my addr 172.21.15.80:0/1828609194 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:58.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68bffff700 1 --2- 172.21.15.80:0/1828609194 >> v2:172.21.15.174:3300/0 conn(0x7f68c006c0a0 0x7f68c0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:58.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68bf7fe700 1 -- 172.21.15.80:0/1828609194 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523102359 0 0) 0x7f68b80014d0 con 0x7f68c0072620 2019-11-28T11:28:58.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68bf7fe700 1 -- 172.21.15.80:0/1828609194 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a0002e80 con 0x7f68c0072620 2019-11-28T11:28:58.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68bffff700 1 -- 172.21.15.80:0/1828609194 >> v1:172.21.15.174:6789/0 conn(0x7f68c00734e0 legacy=0x7f68c0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:58.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68bf7fe700 1 -- 172.21.15.80:0/1828609194 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246608061 0 0) 0x7f68a8001080 con 0x7f68c00734e0 2019-11-28T11:28:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68bffff700 1 -- 172.21.15.80:0/1828609194 >> v1:172.21.15.80:6789/0 conn(0x7f68c0072620 legacy=0x7f68c0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68bffff700 1 -- 172.21.15.80:0/1828609194 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00706c0 con 0x7f68c006c0a0 2019-11-28T11:28:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68bffff700 1 --2- 172.21.15.80:0/1828609194 >> v2:172.21.15.174:3300/0 conn(0x7f68c006c0a0 0x7f68c0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f68b000af50 tx=0x7f68b000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68bffff700 1 --2- 172.21.15.80:0/1828609194 >> v2:172.21.15.174:3300/0 conn(0x7f68c006c0a0 0x7f68c0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f68b000af50 tx=0x7f68b000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:58.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68bffff700 1 --2- 172.21.15.80:0/1828609194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c006c0a0 0x7f68c0072fa0 secure :-1 s=READY pgs=372 cs=0 l=1 rx=0x7f68b000af50 tx=0x7f68b000b760).ready entity=mon.1 client_cookie=4df7e3b6632f8cd4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:58.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68bffff700 1 --2- 172.21.15.80:0/1828609194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c006c0a0 0x7f68c0072fa0 secure :-1 s=THROTTLE_DONE pgs=372 cs=0 l=1 rx=0x7f68b000af50 tx=0x7f68b000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:58.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68bf7fe700 1 -- 172.21.15.80:0/1828609194 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68b0000960 con 0x7f68c006c0a0 2019-11-28T11:28:58.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68bffff700 1 --2- 172.21.15.80:0/1828609194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c006c0a0 0x7f68c0072fa0 secure :-1 s=THROTTLE_DONE pgs=372 cs=0 l=1 rx=0x7f68b000af50 tx=0x7f68b000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:58.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68bffff700 1 --2- 172.21.15.80:0/1828609194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c006c0a0 0x7f68c0072fa0 secure :-1 s=THROTTLE_DONE pgs=372 cs=0 l=1 rx=0x7f68b000af50 tx=0x7f68b000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:58.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68bf7fe700 1 -- 172.21.15.80:0/1828609194 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b0009860 con 0x7f68c006c0a0 2019-11-28T11:28:58.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.037+0000 7f68bf7fe700 1 -- 172.21.15.80:0/1828609194 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68b0009f30 con 0x7f68c006c0a0 2019-11-28T11:28:58.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.038+0000 7f68c5cec700 1 -- 172.21.15.80:0/1828609194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c006c0a0 msgr2=0x7f68c0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:58.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.038+0000 7f68c5cec700 1 --2- 172.21.15.80:0/1828609194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c006c0a0 0x7f68c0072fa0 secure :-1 s=READY pgs=372 cs=0 l=1 rx=0x7f68b000af50 tx=0x7f68b000b760).stop 2019-11-28T11:28:58.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.038+0000 7f68c5cec700 1 -- 172.21.15.80:0/1828609194 shutdown_connections 2019-11-28T11:28:58.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.038+0000 7f68c5cec700 1 --2- 172.21.15.80:0/1828609194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c006c0a0 0x7f68c0072fa0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:58.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.038+0000 7f68c5cec700 1 -- 172.21.15.80:0/1828609194 shutdown_connections 2019-11-28T11:28:58.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.038+0000 7f68c5cec700 1 -- 172.21.15.80:0/1828609194 wait complete. 2019-11-28T11:28:58.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.038+0000 7f68c5cec700 1 -- 172.21.15.80:0/1828609194 >> 172.21.15.80:0/1828609194 conn(0x7f68c0061cf0 msgr2=0x7f68c0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:58.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.041+0000 7f68c5cec700 1 Processor -- start 2019-11-28T11:28:58.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.041+0000 7f68c5cec700 1 -- start start 2019-11-28T11:28:58.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.041+0000 7f68c5cec700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68c0164a10 0x7f68c0164ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:58.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.041+0000 7f68c5cec700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f68c01653e0 0x7f68c01205d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:58.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.041+0000 7f68c5cec700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c0116b90 con 0x7f68c01167a0 2019-11-28T11:28:58.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.041+0000 7f68c5cec700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c01563f0 con 0x7f68c0164a10 2019-11-28T11:28:58.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.041+0000 7f68c5cec700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c01566c0 con 0x7f68c01653e0 2019-11-28T11:28:58.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.041+0000 7f68b7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68c0164a10 0x7f68c0164ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:58.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68b7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68c0164a10 0x7f68c0164ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34132/0 (socket says 172.21.15.80:34132) 2019-11-28T11:28:58.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68b7fff700 1 -- 172.21.15.80:0/4105844354 learned_addr learned my addr 172.21.15.80:0/4105844354 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:28:58.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68c4a8a700 1 --2- 172.21.15.80:0/4105844354 >> v2:172.21.15.174:3300/0 conn(0x7f68c01653e0 0x7f68c01205d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:58.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68b7fff700 1 -- 172.21.15.80:0/4105844354 >> v2:172.21.15.174:3300/0 conn(0x7f68c01653e0 msgr2=0x7f68c01205d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:58.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68b7fff700 1 --2- 172.21.15.80:0/4105844354 >> v2:172.21.15.174:3300/0 conn(0x7f68c01653e0 0x7f68c01205d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:58.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68b7fff700 1 -- 172.21.15.80:0/4105844354 >> v1:172.21.15.174:6789/0 conn(0x7f68c01167a0 legacy=0x7f68c0121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68b7fff700 1 -- 172.21.15.80:0/4105844354 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c0156d50 con 0x7f68c0164a10 2019-11-28T11:28:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68b7fff700 1 --2- 172.21.15.80:0/4105844354 >> v2:172.21.15.80:3300/0 conn(0x7f68c0164a10 0x7f68c0164ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68a8010450 tx=0x7f68a800b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68b7fff700 1 --2- 172.21.15.80:0/4105844354 >> v2:172.21.15.80:3300/0 conn(0x7f68c0164a10 0x7f68c0164ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68a8010450 tx=0x7f68a800b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68b7fff700 1 --2- 172.21.15.80:0/4105844354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c0164a10 0x7f68c0164ea0 secure :-1 s=READY pgs=640 cs=0 l=1 rx=0x7f68a8010450 tx=0x7f68a800b390).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68b7fff700 1 --2- 172.21.15.80:0/4105844354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c0164a10 0x7f68c0164ea0 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7f68a8010450 tx=0x7f68a800b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68b7fff700 1 --2- 172.21.15.80:0/4105844354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c0164a10 0x7f68c0164ea0 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7f68a8010450 tx=0x7f68a800b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68b7fff700 1 --2- 172.21.15.80:0/4105844354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c0164a10 0x7f68c0164ea0 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7f68a8010450 tx=0x7f68a800b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68bd7fa700 1 -- 172.21.15.80:0/4105844354 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68a8000b50 con 0x7f68c0164a10 2019-11-28T11:28:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68bd7fa700 1 -- 172.21.15.80:0/4105844354 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a8009a30 con 0x7f68c0164a10 2019-11-28T11:28:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68c5cec700 1 -- 172.21.15.80:0/4105844354 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c01570d0 con 0x7f68c0164a10 2019-11-28T11:28:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68bd7fa700 1 -- 172.21.15.80:0/4105844354 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68a800a100 con 0x7f68c0164a10 2019-11-28T11:28:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68c5cec700 1 -- 172.21.15.80:0/4105844354 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c0156d50 con 0x7f68c0164a10 2019-11-28T11:28:58.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.042+0000 7f68b7fff700 1 --2- 172.21.15.80:0/4105844354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c0164a10 0x7f68c0164ea0 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7f68a8010450 tx=0x7f68a800b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:58.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.043+0000 7f68bd7fa700 1 -- 172.21.15.80:0/4105844354 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f68a8009630 con 0x7f68c0164a10 2019-11-28T11:28:58.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.043+0000 7f68b7fff700 1 --2- 172.21.15.80:0/4105844354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c0164a10 0x7f68c0164ea0 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7f68a8010450 tx=0x7f68a800b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:58.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.043+0000 7f68bd7fa700 1 --2- 172.21.15.80:0/4105844354 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6898018730 0x7f689801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.043+0000 7f68bd7fa700 1 -- 172.21.15.80:0/4105844354 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f68a8031b00 con 0x7f68c0164a10 2019-11-28T11:28:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.043+0000 7f68bffff700 1 --2- 172.21.15.80:0/4105844354 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6898018730 0x7f689801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.043+0000 7f68bffff700 1 --2- 172.21.15.80:0/4105844354 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6898018730 0x7f689801abc0 crc :-1 s=READY pgs=265 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:58.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.051+0000 7f68c5cec700 1 -- 172.21.15.80:0/4105844354 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c01570d0 con 0x7f68c0164a10 2019-11-28T11:28:58.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.054+0000 7f68b7fff700 1 --2- 172.21.15.80:0/4105844354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c0164a10 0x7f68c0164ea0 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7f68a8010450 tx=0x7f68a800b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:58.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.054+0000 7f68bd7fa700 1 -- 172.21.15.80:0/4105844354 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f68a8026340 con 0x7f68c0164a10 2019-11-28T11:28:58.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.228+0000 7f68c5cec700 1 -- 172.21.15.80:0/4105844354 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68c0156d50 con 0x7f68c0164a10 2019-11-28T11:28:58.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.228+0000 7f68b7fff700 1 --2- 172.21.15.80:0/4105844354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c0164a10 0x7f68c0164ea0 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7f68a8010450 tx=0x7f68a800b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:58.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.228+0000 7f68bd7fa700 1 -- 172.21.15.80:0/4105844354 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+1422 (secure 0 0 0) 0x7f68a8026340 con 0x7f68c0164a10 2019-11-28T11:28:58.259 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 27 2019-11-28T11:28:58.259 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:58.259 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:54.163001+0000","modified":"2019-11-28T11:28:55.825884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2019-11-28T11:28:58.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.231+0000 7f68c5cec700 1 -- 172.21.15.80:0/4105844354 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6898018730 msgr2=0x7f689801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:58.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.231+0000 7f68c5cec700 1 --2- 172.21.15.80:0/4105844354 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6898018730 0x7f689801abc0 crc :-1 s=READY pgs=265 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:58.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.231+0000 7f68c5cec700 1 -- 172.21.15.80:0/4105844354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c0164a10 msgr2=0x7f68c0164ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:58.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.231+0000 7f68c5cec700 1 --2- 172.21.15.80:0/4105844354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c0164a10 0x7f68c0164ea0 secure :-1 s=READY pgs=640 cs=0 l=1 rx=0x7f68a8010450 tx=0x7f68a800b390).stop 2019-11-28T11:28:58.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.231+0000 7f68c5cec700 1 -- 172.21.15.80:0/4105844354 shutdown_connections 2019-11-28T11:28:58.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.231+0000 7f68c5cec700 1 --2- 172.21.15.80:0/4105844354 >> v2:172.21.15.174:3300/0 conn(0x7f68c01653e0 0x7f68c01205d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:58.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.231+0000 7f68c5cec700 1 --2- 172.21.15.80:0/4105844354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c0164a10 0x7f68c0164ea0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:58.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.231+0000 7f68c5cec700 1 --2- 172.21.15.80:0/4105844354 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6898018730 0x7f689801abc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:58.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.231+0000 7f68c5cec700 1 -- 172.21.15.80:0/4105844354 shutdown_connections 2019-11-28T11:28:58.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.231+0000 7f68c5cec700 1 -- 172.21.15.80:0/4105844354 wait complete. 2019-11-28T11:28:58.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:58.231+0000 7f68c5cec700 1 -- 172.21.15.80:0/4105844354 >> 172.21.15.80:0/4105844354 conn(0x7f68c01426c0 msgr2=0x7f68c0110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:58.572 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 8, u'failed': [], u'epoch': 27, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [9], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:28:54.163001+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:28:55.825884+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:28:58.572 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:28:59.572 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:28:59.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.671+0000 7f7e77d19700 1 Processor -- start 2019-11-28T11:28:59.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.671+0000 7f7e77d19700 1 -- start start 2019-11-28T11:28:59.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.672+0000 7f7e77d19700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e7006c0a0 0x7f7e70072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:28:59.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.672+0000 7f7e77d19700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7006db00 con 0x7f7e700734e0 2019-11-28T11:28:59.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.672+0000 7f7e77d19700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7006e000 con 0x7f7e70072620 2019-11-28T11:28:59.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.672+0000 7f7e77d19700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7006fd60 con 0x7f7e7006c0a0 2019-11-28T11:28:59.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.672+0000 7f7e762b6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e7006c0a0 0x7f7e70072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.672+0000 7f7e75ab5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7e700734e0 0x7f7e70071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33458/0 (socket says 172.21.15.80:33458) 2019-11-28T11:28:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.672+0000 7f7e75ab5700 1 -- 172.21.15.80:0/1479614513 learned_addr learned my addr 172.21.15.80:0/1479614513 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.672+0000 7f7e762b6700 1 -- 172.21.15.80:0/1479614513 >> v1:172.21.15.174:6789/0 conn(0x7f7e70072620 legacy=0x7f7e70164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:28:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.673+0000 7f7e762b6700 1 -- 172.21.15.80:0/1479614513 >> v1:172.21.15.80:6789/0 conn(0x7f7e700734e0 legacy=0x7f7e70071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.673+0000 7f7e762b6700 1 -- 172.21.15.80:0/1479614513 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e700706c0 con 0x7f7e7006c0a0 2019-11-28T11:28:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.673+0000 7f7e752b4700 1 -- 172.21.15.80:0/1479614513 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317723946 0 0) 0x7f7e60001070 con 0x7f7e700734e0 2019-11-28T11:28:59.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.673+0000 7f7e762b6700 1 --2- 172.21.15.80:0/1479614513 >> v2:172.21.15.80:3300/0 conn(0x7f7e7006c0a0 0x7f7e70072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7e5800b2d0 tx=0x7f7e5800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.673+0000 7f7e762b6700 1 --2- 172.21.15.80:0/1479614513 >> v2:172.21.15.80:3300/0 conn(0x7f7e7006c0a0 0x7f7e70072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7e5800b2d0 tx=0x7f7e5800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.673+0000 7f7e762b6700 1 --2- 172.21.15.80:0/1479614513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e7006c0a0 0x7f7e70072fa0 secure :-1 s=READY pgs=642 cs=0 l=1 rx=0x7f7e5800b2d0 tx=0x7f7e5800bae0).ready entity=mon.0 client_cookie=9e344b71fdbb92c6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.673+0000 7f7e762b6700 1 --2- 172.21.15.80:0/1479614513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e7006c0a0 0x7f7e70072fa0 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7f7e5800b2d0 tx=0x7f7e5800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.673+0000 7f7e752b4700 1 -- 172.21.15.80:0/1479614513 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e58000ce0 con 0x7f7e7006c0a0 2019-11-28T11:28:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.673+0000 7f7e762b6700 1 --2- 172.21.15.80:0/1479614513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e7006c0a0 0x7f7e70072fa0 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7f7e5800b2d0 tx=0x7f7e5800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:59.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.673+0000 7f7e762b6700 1 --2- 172.21.15.80:0/1479614513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e7006c0a0 0x7f7e70072fa0 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7f7e5800b2d0 tx=0x7f7e5800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.673+0000 7f7e752b4700 1 -- 172.21.15.80:0/1479614513 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e58009be0 con 0x7f7e7006c0a0 2019-11-28T11:28:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.673+0000 7f7e752b4700 1 -- 172.21.15.80:0/1479614513 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e58000ce0 con 0x7f7e7006c0a0 2019-11-28T11:28:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.673+0000 7f7e77d19700 1 -- 172.21.15.80:0/1479614513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e7006c0a0 msgr2=0x7f7e70072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.673+0000 7f7e77d19700 1 --2- 172.21.15.80:0/1479614513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e7006c0a0 0x7f7e70072fa0 secure :-1 s=READY pgs=642 cs=0 l=1 rx=0x7f7e5800b2d0 tx=0x7f7e5800bae0).stop 2019-11-28T11:28:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.674+0000 7f7e77d19700 1 -- 172.21.15.80:0/1479614513 shutdown_connections 2019-11-28T11:28:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.674+0000 7f7e77d19700 1 --2- 172.21.15.80:0/1479614513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e7006c0a0 0x7f7e70072fa0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:59.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.674+0000 7f7e77d19700 1 -- 172.21.15.80:0/1479614513 shutdown_connections 2019-11-28T11:28:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.674+0000 7f7e77d19700 1 -- 172.21.15.80:0/1479614513 wait complete. 2019-11-28T11:28:59.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.674+0000 7f7e77d19700 1 -- 172.21.15.80:0/1479614513 >> 172.21.15.80:0/1479614513 conn(0x7f7e70061cf0 msgr2=0x7f7e70064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:28:59.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.676+0000 7f7e77d19700 1 Processor -- start 2019-11-28T11:28:59.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.676+0000 7f7e77d19700 1 -- start start 2019-11-28T11:28:59.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.677+0000 7f7e77d19700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7e70130140 0x7f7e7015fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:59.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.677+0000 7f7e77d19700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e70160340 0x7f7e7015ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:59.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.677+0000 7f7e77d19700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7015da00 con 0x7f7e7015f3a0 2019-11-28T11:28:59.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.677+0000 7f7e77d19700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e70141e10 con 0x7f7e70130140 2019-11-28T11:28:59.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.677+0000 7f7e77d19700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7015d730 con 0x7f7e70160340 2019-11-28T11:28:59.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.677+0000 7f7e76ab7700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7e7015f3a0 0x7f7e7013e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33460/0 (socket says 172.21.15.80:33460) 2019-11-28T11:28:59.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.677+0000 7f7e76ab7700 1 -- 172.21.15.80:0/2762051057 learned_addr learned my addr 172.21.15.80:0/2762051057 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:28:59.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.677+0000 7f7e75ab5700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e70160340 0x7f7e7015ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:59.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.677+0000 7f7e762b6700 1 --2- 172.21.15.80:0/2762051057 >> v2:172.21.15.174:3300/0 conn(0x7f7e70130140 0x7f7e7015fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:59.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.677+0000 7f7e6effd700 1 -- 172.21.15.80:0/2762051057 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099856805 0 0) 0x7f7e680009b0 con 0x7f7e7015f3a0 2019-11-28T11:28:59.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.677+0000 7f7e6effd700 1 -- 172.21.15.80:0/2762051057 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e54002e80 con 0x7f7e7015f3a0 2019-11-28T11:28:59.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.677+0000 7f7e762b6700 1 -- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e70160340 msgr2=0x7f7e7015ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:59.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.677+0000 7f7e762b6700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e70160340 0x7f7e7015ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:59.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.677+0000 7f7e762b6700 1 -- 172.21.15.80:0/2762051057 >> v1:172.21.15.80:6789/0 conn(0x7f7e7015f3a0 legacy=0x7f7e7013e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:59.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.678+0000 7f7e762b6700 1 -- 172.21.15.80:0/2762051057 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e701424a0 con 0x7f7e70130140 2019-11-28T11:28:59.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.678+0000 7f7e762b6700 1 --2- 172.21.15.80:0/2762051057 >> v2:172.21.15.174:3300/0 conn(0x7f7e70130140 0x7f7e7015fe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e58010700 tx=0x7f7e58010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:59.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.678+0000 7f7e762b6700 1 --2- 172.21.15.80:0/2762051057 >> v2:172.21.15.174:3300/0 conn(0x7f7e70130140 0x7f7e7015fe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e58010700 tx=0x7f7e58010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:59.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.678+0000 7f7e762b6700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e70130140 0x7f7e7015fe00 secure :-1 s=READY pgs=375 cs=0 l=1 rx=0x7f7e58010700 tx=0x7f7e58010aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:59.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.678+0000 7f7e762b6700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e70130140 0x7f7e7015fe00 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f7e58010700 tx=0x7f7e58010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:59.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.678+0000 7f7e6effd700 1 -- 172.21.15.80:0/2762051057 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e58000cc0 con 0x7f7e70130140 2019-11-28T11:28:59.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.678+0000 7f7e762b6700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e70130140 0x7f7e7015fe00 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f7e58010700 tx=0x7f7e58010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:59.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.678+0000 7f7e6effd700 1 -- 172.21.15.80:0/2762051057 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e58009af0 con 0x7f7e70130140 2019-11-28T11:28:59.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.678+0000 7f7e77d19700 1 -- 172.21.15.80:0/2762051057 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e70142820 con 0x7f7e70130140 2019-11-28T11:28:59.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.678+0000 7f7e762b6700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e70130140 0x7f7e7015fe00 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f7e58010700 tx=0x7f7e58010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:59.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.678+0000 7f7e6effd700 1 -- 172.21.15.80:0/2762051057 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e58009ce0 con 0x7f7e70130140 2019-11-28T11:28:59.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.678+0000 7f7e77d19700 1 -- 172.21.15.80:0/2762051057 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e70141620 con 0x7f7e70130140 2019-11-28T11:28:59.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.678+0000 7f7e762b6700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e70130140 0x7f7e7015fe00 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f7e58010700 tx=0x7f7e58010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:59.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.678+0000 7f7e6effd700 1 -- 172.21.15.80:0/2762051057 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7e58009ce0 con 0x7f7e70130140 2019-11-28T11:28:59.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.678+0000 7f7e762b6700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e70130140 0x7f7e7015fe00 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f7e58010700 tx=0x7f7e58010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:59.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.679+0000 7f7e6effd700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7e54018770 0x7f7e5401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:28:59.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.679+0000 7f7e6effd700 1 -- 172.21.15.80:0/2762051057 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7e58031db0 con 0x7f7e70130140 2019-11-28T11:28:59.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.679+0000 7f7e75ab5700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7e54018770 0x7f7e5401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:28:59.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.679+0000 7f7e75ab5700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7e54018770 0x7f7e5401abe0 crc :-1 s=READY pgs=266 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:28:59.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.686+0000 7f7e77d19700 1 -- 172.21.15.80:0/2762051057 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e701424a0 con 0x7f7e70130140 2019-11-28T11:28:59.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.690+0000 7f7e762b6700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e70130140 0x7f7e7015fe00 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f7e58010700 tx=0x7f7e58010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:59.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.690+0000 7f7e6effd700 1 -- 172.21.15.80:0/2762051057 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7e580261a0 con 0x7f7e70130140 2019-11-28T11:28:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.862+0000 7f7e77d19700 1 -- 172.21.15.80:0/2762051057 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e70142820 con 0x7f7e70130140 2019-11-28T11:28:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.862+0000 7f7e762b6700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e70130140 0x7f7e7015fe00 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f7e58010700 tx=0x7f7e58010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:28:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.862+0000 7f7e6effd700 1 -- 172.21.15.80:0/2762051057 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+1422 (secure 0 0 0) 0x7f7e580261a0 con 0x7f7e70130140 2019-11-28T11:28:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 27 2019-11-28T11:28:59.900 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:28:59.900 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:54.163001+0000","modified":"2019-11-28T11:28:55.825884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2019-11-28T11:28:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.865+0000 7f7e77d19700 1 -- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7e54018770 msgr2=0x7f7e5401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.865+0000 7f7e77d19700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7e54018770 0x7f7e5401abe0 crc :-1 s=READY pgs=266 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.865+0000 7f7e77d19700 1 -- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e70130140 msgr2=0x7f7e7015fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:28:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.865+0000 7f7e77d19700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e70130140 0x7f7e7015fe00 secure :-1 s=READY pgs=375 cs=0 l=1 rx=0x7f7e58010700 tx=0x7f7e58010aa0).stop 2019-11-28T11:28:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.865+0000 7f7e77d19700 1 -- 172.21.15.80:0/2762051057 shutdown_connections 2019-11-28T11:28:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.865+0000 7f7e77d19700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7e54018770 0x7f7e5401abe0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.865+0000 7f7e77d19700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e70160340 0x7f7e7015ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.865+0000 7f7e77d19700 1 --2- 172.21.15.80:0/2762051057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e70130140 0x7f7e7015fe00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:28:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.865+0000 7f7e77d19700 1 -- 172.21.15.80:0/2762051057 shutdown_connections 2019-11-28T11:28:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.865+0000 7f7e77d19700 1 -- 172.21.15.80:0/2762051057 wait complete. 2019-11-28T11:28:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:28:59.865+0000 7f7e77d19700 1 -- 172.21.15.80:0/2762051057 >> 172.21.15.80:0/2762051057 conn(0x7f7e70159ae0 msgr2=0x7f7e7013d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:00.209 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 8, u'failed': [], u'epoch': 27, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [9], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:28:54.163001+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:28:55.825884+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:29:00.334 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:29:01.334 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:01.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.424+0000 7fdecb458700 1 Processor -- start 2019-11-28T11:29:01.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.424+0000 7fdecb458700 1 -- start start 2019-11-28T11:29:01.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdecb458700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdec406c490 0x7fdec406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:01.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdecb458700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdec406ce60 0x7fdec4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:01.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdecb458700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec406db00 con 0x7fdec406c0a0 2019-11-28T11:29:01.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdecb458700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec406fd60 con 0x7fdec406ce60 2019-11-28T11:29:01.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdecb458700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec4070030 con 0x7fdec406c490 2019-11-28T11:29:01.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdeca1f6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdec406ce60 0x7fdec4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:01.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdeca1f6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdec406ce60 0x7fdec4164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34158/0 (socket says 172.21.15.80:34158) 2019-11-28T11:29:01.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdeca1f6700 1 -- 172.21.15.80:0/3477186390 learned_addr learned my addr 172.21.15.80:0/3477186390 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:01.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdec91f4700 1 --2- 172.21.15.80:0/3477186390 >> v2:172.21.15.174:3300/0 conn(0x7fdec406c490 0x7fdec406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:01.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdeca1f6700 1 -- 172.21.15.80:0/3477186390 >> v2:172.21.15.174:3300/0 conn(0x7fdec406c490 msgr2=0x7fdec406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:01.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/3477186390 >> v2:172.21.15.174:3300/0 conn(0x7fdec406c490 0x7fdec406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:01.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdeca1f6700 1 -- 172.21.15.80:0/3477186390 >> v1:172.21.15.174:6789/0 conn(0x7fdec406c0a0 legacy=0x7fdec4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:01.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdeca1f6700 1 -- 172.21.15.80:0/3477186390 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec40706c0 con 0x7fdec406ce60 2019-11-28T11:29:01.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/3477186390 >> v2:172.21.15.80:3300/0 conn(0x7fdec406ce60 0x7fdec4164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdebc00f730 tx=0x7fdebc007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:01.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/3477186390 >> v2:172.21.15.80:3300/0 conn(0x7fdec406ce60 0x7fdec4164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdebc00f730 tx=0x7fdebc007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:01.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/3477186390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdec406ce60 0x7fdec4164d70 secure :-1 s=READY pgs=644 cs=0 l=1 rx=0x7fdebc00f730 tx=0x7fdebc007d50).ready entity=mon.0 client_cookie=2a2c5fc0e5d7333 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:01.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/3477186390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdec406ce60 0x7fdec4164d70 secure :-1 s=THROTTLE_DONE pgs=644 cs=0 l=1 rx=0x7fdebc00f730 tx=0x7fdebc007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:01.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/3477186390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdec406ce60 0x7fdec4164d70 secure :-1 s=THROTTLE_DONE pgs=644 cs=0 l=1 rx=0x7fdebc00f730 tx=0x7fdebc007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:01.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdec89f3700 1 -- 172.21.15.80:0/3477186390 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdebc000a70 con 0x7fdec406ce60 2019-11-28T11:29:01.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/3477186390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdec406ce60 0x7fdec4164d70 secure :-1 s=THROTTLE_DONE pgs=644 cs=0 l=1 rx=0x7fdebc00f730 tx=0x7fdebc007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:01.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdec89f3700 1 -- 172.21.15.80:0/3477186390 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc0010e0 con 0x7fdec406ce60 2019-11-28T11:29:01.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.425+0000 7fdec89f3700 1 -- 172.21.15.80:0/3477186390 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdebc0017b0 con 0x7fdec406ce60 2019-11-28T11:29:01.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.426+0000 7fdecb458700 1 -- 172.21.15.80:0/3477186390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdec406ce60 msgr2=0x7fdec4164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:01.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.426+0000 7fdecb458700 1 --2- 172.21.15.80:0/3477186390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdec406ce60 0x7fdec4164d70 secure :-1 s=READY pgs=644 cs=0 l=1 rx=0x7fdebc00f730 tx=0x7fdebc007d50).stop 2019-11-28T11:29:01.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.426+0000 7fdecb458700 1 -- 172.21.15.80:0/3477186390 shutdown_connections 2019-11-28T11:29:01.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.426+0000 7fdecb458700 1 --2- 172.21.15.80:0/3477186390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdec406ce60 0x7fdec4164d70 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:01.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.426+0000 7fdecb458700 1 --2- 172.21.15.80:0/3477186390 >> v2:172.21.15.174:3300/0 conn(0x7fdec406c490 0x7fdec406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:01.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.426+0000 7fdecb458700 1 -- 172.21.15.80:0/3477186390 shutdown_connections 2019-11-28T11:29:01.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.426+0000 7fdecb458700 1 -- 172.21.15.80:0/3477186390 wait complete. 2019-11-28T11:29:01.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.426+0000 7fdecb458700 1 -- 172.21.15.80:0/3477186390 >> 172.21.15.80:0/3477186390 conn(0x7fdec4061cf0 msgr2=0x7fdec4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:01.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.429+0000 7fdecb458700 1 Processor -- start 2019-11-28T11:29:01.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.429+0000 7fdecb458700 1 -- start start 2019-11-28T11:29:01.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdecb458700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdec4167c30 0x7fdec416a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:01.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdecb458700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec413f1e0 con 0x7fdec4109e40 2019-11-28T11:29:01.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdecb458700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec4131a30 con 0x7fdec413eb40 2019-11-28T11:29:01.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdecb458700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec41234c0 con 0x7fdec4167c30 2019-11-28T11:29:01.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdec91f4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdec4109e40 0x7fdec410a2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33480/0 (socket says 172.21.15.80:33480) 2019-11-28T11:29:01.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdec91f4700 1 -- 172.21.15.80:0/459678821 learned_addr learned my addr 172.21.15.80:0/459678821 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:01.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/459678821 >> v2:172.21.15.174:3300/0 conn(0x7fdec4167c30 0x7fdec416a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:01.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdec27fc700 1 -- 172.21.15.80:0/459678821 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924562098 0 0) 0x7fdeb40010b0 con 0x7fdec4109e40 2019-11-28T11:29:01.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdec27fc700 1 -- 172.21.15.80:0/459678821 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdea8002e80 con 0x7fdec4109e40 2019-11-28T11:29:01.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdeca1f6700 1 -- 172.21.15.80:0/459678821 >> v1:172.21.15.174:6789/0 conn(0x7fdec413eb40 legacy=0x7fdec410afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:01.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdec27fc700 1 -- 172.21.15.80:0/459678821 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185993489 0 0) 0x7fdeac001370 con 0x7fdec413eb40 2019-11-28T11:29:01.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdeca1f6700 1 -- 172.21.15.80:0/459678821 >> v1:172.21.15.80:6789/0 conn(0x7fdec4109e40 legacy=0x7fdec410a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:01.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdeca1f6700 1 -- 172.21.15.80:0/459678821 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4108700 con 0x7fdec4167c30 2019-11-28T11:29:01.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/459678821 >> v2:172.21.15.174:3300/0 conn(0x7fdec4167c30 0x7fdec416a030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdebc0103c0 tx=0x7fdebc010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:01.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/459678821 >> v2:172.21.15.174:3300/0 conn(0x7fdec4167c30 0x7fdec416a030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdebc0103c0 tx=0x7fdebc010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:01.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec4167c30 0x7fdec416a030 secure :-1 s=READY pgs=378 cs=0 l=1 rx=0x7fdebc0103c0 tx=0x7fdebc010760).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:01.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec4167c30 0x7fdec416a030 secure :-1 s=THROTTLE_DONE pgs=378 cs=0 l=1 rx=0x7fdebc0103c0 tx=0x7fdebc010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:01.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.430+0000 7fdec27fc700 1 -- 172.21.15.80:0/459678821 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdebc0014a0 con 0x7fdec4167c30 2019-11-28T11:29:01.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.431+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec4167c30 0x7fdec416a030 secure :-1 s=THROTTLE_DONE pgs=378 cs=0 l=1 rx=0x7fdebc0103c0 tx=0x7fdebc010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:01.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.431+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec4167c30 0x7fdec416a030 secure :-1 s=THROTTLE_DONE pgs=378 cs=0 l=1 rx=0x7fdebc0103c0 tx=0x7fdebc010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:01.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.431+0000 7fdec27fc700 1 -- 172.21.15.80:0/459678821 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc0010c0 con 0x7fdec4167c30 2019-11-28T11:29:01.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.431+0000 7fdec27fc700 1 -- 172.21.15.80:0/459678821 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdebc001a80 con 0x7fdec4167c30 2019-11-28T11:29:01.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.431+0000 7fdecb458700 1 -- 172.21.15.80:0/459678821 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec4108a80 con 0x7fdec4167c30 2019-11-28T11:29:01.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.431+0000 7fdecb458700 1 -- 172.21.15.80:0/459678821 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec4108700 con 0x7fdec4167c30 2019-11-28T11:29:01.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.431+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec4167c30 0x7fdec416a030 secure :-1 s=THROTTLE_DONE pgs=378 cs=0 l=1 rx=0x7fdebc0103c0 tx=0x7fdebc010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:01.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.431+0000 7fdec27fc700 1 -- 172.21.15.80:0/459678821 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fdebc0012b0 con 0x7fdec4167c30 2019-11-28T11:29:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.431+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec4167c30 0x7fdec416a030 secure :-1 s=THROTTLE_DONE pgs=378 cs=0 l=1 rx=0x7fdebc0103c0 tx=0x7fdebc010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.431+0000 7fdec27fc700 1 --2- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdea8018780 0x7fdea801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.431+0000 7fdec27fc700 1 -- 172.21.15.80:0/459678821 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fdebc031ac0 con 0x7fdec4167c30 2019-11-28T11:29:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.432+0000 7fdec99f5700 1 --2- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdea8018780 0x7fdea801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.432+0000 7fdec99f5700 1 --2- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdea8018780 0x7fdea801abf0 crc :-1 s=READY pgs=270 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:01.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.439+0000 7fdecb458700 1 -- 172.21.15.80:0/459678821 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec4108a80 con 0x7fdec4167c30 2019-11-28T11:29:01.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.443+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec4167c30 0x7fdec416a030 secure :-1 s=THROTTLE_DONE pgs=378 cs=0 l=1 rx=0x7fdebc0103c0 tx=0x7fdebc010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:01.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.443+0000 7fdec27fc700 1 -- 172.21.15.80:0/459678821 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fdebc000eb0 con 0x7fdec4167c30 2019-11-28T11:29:01.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.613+0000 7fdecb458700 1 -- 172.21.15.80:0/459678821 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdec4108700 con 0x7fdec4167c30 2019-11-28T11:29:01.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.615+0000 7fdeca1f6700 1 --2- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec4167c30 0x7fdec416a030 secure :-1 s=THROTTLE_DONE pgs=378 cs=0 l=1 rx=0x7fdebc0103c0 tx=0x7fdebc010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:01.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.615+0000 7fdec27fc700 1 -- 172.21.15.80:0/459678821 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+2445 (secure 0 0 0) 0x7fdebc0012b0 con 0x7fdec4167c30 2019-11-28T11:29:01.644 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 29 2019-11-28T11:29:01.644 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:01.644 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5895,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/169206692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":169206692},{"type":"v1","addr":"172.21.15.80:6834","nonce":169206692}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":28},{"gid":5898,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/2970516164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":2970516164},{"type":"v1","addr":"172.21.15.80:6835","nonce":2970516164}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:54.163001+0000","modified":"2019-11-28T11:29:00.910039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5725},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5725":{"gid":5725,"name":"c","rank":0,"incarnation":29,"state":"up:creating","state_seq":2,"addr":"172.21.15.174:6835/2800771965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2800771965},{"type":"v1","addr":"172.21.15.174:6835","nonce":2800771965}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2019-11-28T11:29:01.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.616+0000 7fdecb458700 1 -- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdea8018780 msgr2=0x7fdea801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:01.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.616+0000 7fdecb458700 1 --2- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdea8018780 0x7fdea801abf0 crc :-1 s=READY pgs=270 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:01.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.616+0000 7fdecb458700 1 -- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec4167c30 msgr2=0x7fdec416a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:01.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.616+0000 7fdecb458700 1 --2- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec4167c30 0x7fdec416a030 secure :-1 s=READY pgs=378 cs=0 l=1 rx=0x7fdebc0103c0 tx=0x7fdebc010760).stop 2019-11-28T11:29:01.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.616+0000 7fdecb458700 1 -- 172.21.15.80:0/459678821 shutdown_connections 2019-11-28T11:29:01.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.616+0000 7fdecb458700 1 --2- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec4167c30 0x7fdec416a030 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:01.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.616+0000 7fdecb458700 1 --2- 172.21.15.80:0/459678821 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdea8018780 0x7fdea801abf0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:01.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.616+0000 7fdecb458700 1 -- 172.21.15.80:0/459678821 shutdown_connections 2019-11-28T11:29:01.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.616+0000 7fdecb458700 1 -- 172.21.15.80:0/459678821 wait complete. 2019-11-28T11:29:01.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:01.616+0000 7fdecb458700 1 -- 172.21.15.80:0/459678821 >> 172.21.15.80:0/459678821 conn(0x7fdec411bfc0 msgr2=0x7fdec4141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:01.958 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5725}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 8, u'failed': [], u'epoch': 29, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [9], u'info': {u'gid_5725': {u'export_targets': [], u'name': u'c', u'incarnation': 29, u'state_seq': 2, u'state': u'up:creating', u'gid': 5725, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2800771965, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2800771965, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2800771965'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:28:54.163001+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:29:00.910039+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:29:01.959 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5725:up:creating 2019-11-28T11:29:02.960 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:03.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.064+0000 7f1442f54700 1 Processor -- start 2019-11-28T11:29:03.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.065+0000 7f1442f54700 1 -- start start 2019-11-28T11:29:03.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.066+0000 7f1442f54700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f143c06c0a0 0x7f143c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.066+0000 7f1442f54700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143c06db00 con 0x7f143c072620 2019-11-28T11:29:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.066+0000 7f1442f54700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143c06e000 con 0x7f143c0734e0 2019-11-28T11:29:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.066+0000 7f1442f54700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143c06fd60 con 0x7f143c06c0a0 2019-11-28T11:29:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.066+0000 7f14414f1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f143c06c0a0 0x7f143c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.066+0000 7f14414f1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f143c06c0a0 0x7f143c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34174/0 (socket says 172.21.15.80:34174) 2019-11-28T11:29:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.066+0000 7f14414f1700 1 -- 172.21.15.80:0/1873570005 learned_addr learned my addr 172.21.15.80:0/1873570005 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.066+0000 7f1441cf2700 1 --1- 172.21.15.80:0/1873570005 >> v1:172.21.15.80:6789/0 conn(0x7f143c072620 0x7f143c164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33492/0 (socket says 172.21.15.80:33492) 2019-11-28T11:29:03.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.066+0000 7f14414f1700 1 -- 172.21.15.80:0/1873570005 >> v1:172.21.15.174:6789/0 conn(0x7f143c0734e0 legacy=0x7f143c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:03.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.066+0000 7f14414f1700 1 -- 172.21.15.80:0/1873570005 >> v1:172.21.15.80:6789/0 conn(0x7f143c072620 legacy=0x7f143c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:03.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.066+0000 7f14414f1700 1 -- 172.21.15.80:0/1873570005 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c0706c0 con 0x7f143c06c0a0 2019-11-28T11:29:03.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.066+0000 7f143bfff700 1 -- 172.21.15.80:0/1873570005 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554585631 0 0) 0x7f1434000d30 con 0x7f143c072620 2019-11-28T11:29:03.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.066+0000 7f14414f1700 1 --2- 172.21.15.80:0/1873570005 >> v2:172.21.15.80:3300/0 conn(0x7f143c06c0a0 0x7f143c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f142c00f740 tx=0x7f142c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.066+0000 7f14414f1700 1 --2- 172.21.15.80:0/1873570005 >> v2:172.21.15.80:3300/0 conn(0x7f143c06c0a0 0x7f143c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f142c00f740 tx=0x7f142c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.066+0000 7f14414f1700 1 --2- 172.21.15.80:0/1873570005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c06c0a0 0x7f143c072fa0 secure :-1 s=READY pgs=647 cs=0 l=1 rx=0x7f142c00f740 tx=0x7f142c00fae0).ready entity=mon.0 client_cookie=8464660da540bbbf server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:03.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.067+0000 7f14414f1700 1 --2- 172.21.15.80:0/1873570005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c06c0a0 0x7f143c072fa0 secure :-1 s=THROTTLE_DONE pgs=647 cs=0 l=1 rx=0x7f142c00f740 tx=0x7f142c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.067+0000 7f143bfff700 1 -- 172.21.15.80:0/1873570005 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f142c000960 con 0x7f143c06c0a0 2019-11-28T11:29:03.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.067+0000 7f14414f1700 1 --2- 172.21.15.80:0/1873570005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c06c0a0 0x7f143c072fa0 secure :-1 s=THROTTLE_DONE pgs=647 cs=0 l=1 rx=0x7f142c00f740 tx=0x7f142c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.067+0000 7f14414f1700 1 --2- 172.21.15.80:0/1873570005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c06c0a0 0x7f143c072fa0 secure :-1 s=THROTTLE_DONE pgs=647 cs=0 l=1 rx=0x7f142c00f740 tx=0x7f142c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.067+0000 7f143bfff700 1 -- 172.21.15.80:0/1873570005 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c000c90 con 0x7f143c06c0a0 2019-11-28T11:29:03.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.067+0000 7f143bfff700 1 -- 172.21.15.80:0/1873570005 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f142c0013e0 con 0x7f143c06c0a0 2019-11-28T11:29:03.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.067+0000 7f1442f54700 1 -- 172.21.15.80:0/1873570005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c06c0a0 msgr2=0x7f143c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:03.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.067+0000 7f1442f54700 1 --2- 172.21.15.80:0/1873570005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c06c0a0 0x7f143c072fa0 secure :-1 s=READY pgs=647 cs=0 l=1 rx=0x7f142c00f740 tx=0x7f142c00fae0).stop 2019-11-28T11:29:03.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.067+0000 7f1442f54700 1 -- 172.21.15.80:0/1873570005 shutdown_connections 2019-11-28T11:29:03.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.067+0000 7f1442f54700 1 --2- 172.21.15.80:0/1873570005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c06c0a0 0x7f143c072fa0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:03.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.068+0000 7f1442f54700 1 -- 172.21.15.80:0/1873570005 shutdown_connections 2019-11-28T11:29:03.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.068+0000 7f1442f54700 1 -- 172.21.15.80:0/1873570005 wait complete. 2019-11-28T11:29:03.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.068+0000 7f1442f54700 1 -- 172.21.15.80:0/1873570005 >> 172.21.15.80:0/1873570005 conn(0x7f143c061cf0 msgr2=0x7f143c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:03.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.070+0000 7f1442f54700 1 Processor -- start 2019-11-28T11:29:03.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.070+0000 7f1442f54700 1 -- start start 2019-11-28T11:29:03.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.071+0000 7f1442f54700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f143c12cea0 0x7f143c111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:03.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.071+0000 7f1442f54700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f143c1230e0 0x7f143c123570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:03.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.071+0000 7f1442f54700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f143c123ab0 0x7f143c12d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:03.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.071+0000 7f1442f54700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143c121040 con 0x7f143c12cea0 2019-11-28T11:29:03.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.071+0000 7f1442f54700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143c121310 con 0x7f143c1230e0 2019-11-28T11:29:03.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.071+0000 7f1442f54700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143c120610 con 0x7f143c123ab0 2019-11-28T11:29:03.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.071+0000 7f14414f1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f143c12cea0 0x7f143c111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:03.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.071+0000 7f14414f1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f143c12cea0 0x7f143c111db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34180/0 (socket says 172.21.15.80:34180) 2019-11-28T11:29:03.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.071+0000 7f14414f1700 1 -- 172.21.15.80:0/4233369893 learned_addr learned my addr 172.21.15.80:0/4233369893 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:03.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.071+0000 7f1441cf2700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f143c123ab0 0x7f143c12d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:03.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.071+0000 7f1440cf0700 1 --2- 172.21.15.80:0/4233369893 >> v2:172.21.15.174:3300/0 conn(0x7f143c1230e0 0x7f143c123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:03.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f14414f1700 1 -- 172.21.15.80:0/4233369893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f143c123ab0 msgr2=0x7f143c12d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:03.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f14414f1700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f143c123ab0 0x7f143c12d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:03.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f14414f1700 1 -- 172.21.15.80:0/4233369893 >> v2:172.21.15.174:3300/0 conn(0x7f143c1230e0 msgr2=0x7f143c123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:03.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f14414f1700 1 --2- 172.21.15.80:0/4233369893 >> v2:172.21.15.174:3300/0 conn(0x7f143c1230e0 0x7f143c123570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:03.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f14414f1700 1 -- 172.21.15.80:0/4233369893 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c1219a0 con 0x7f143c12cea0 2019-11-28T11:29:03.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f1440cf0700 1 --2- 172.21.15.80:0/4233369893 >> v2:172.21.15.174:3300/0 conn(0x7f143c1230e0 0x7f143c123570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:29:03.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f1441cf2700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f143c123ab0 0x7f143c12d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:29:03.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f14414f1700 1 --2- 172.21.15.80:0/4233369893 >> v2:172.21.15.80:3300/0 conn(0x7f143c12cea0 0x7f143c111db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f142c010440 tx=0x7f142c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f14414f1700 1 --2- 172.21.15.80:0/4233369893 >> v2:172.21.15.80:3300/0 conn(0x7f143c12cea0 0x7f143c111db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f142c010440 tx=0x7f142c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f14414f1700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c12cea0 0x7f143c111db0 secure :-1 s=READY pgs=648 cs=0 l=1 rx=0x7f142c010440 tx=0x7f142c0107e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:03.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f14414f1700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c12cea0 0x7f143c111db0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f142c010440 tx=0x7f142c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f14414f1700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c12cea0 0x7f143c111db0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f142c010440 tx=0x7f142c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f1439ffb700 1 -- 172.21.15.80:0/4233369893 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f142c005370 con 0x7f143c12cea0 2019-11-28T11:29:03.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f14414f1700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c12cea0 0x7f143c111db0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f142c010440 tx=0x7f142c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f1439ffb700 1 -- 172.21.15.80:0/4233369893 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c007e00 con 0x7f143c12cea0 2019-11-28T11:29:03.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f1442f54700 1 -- 172.21.15.80:0/4233369893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143c121d20 con 0x7f143c12cea0 2019-11-28T11:29:03.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f1439ffb700 1 -- 172.21.15.80:0/4233369893 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f142c005950 con 0x7f143c12cea0 2019-11-28T11:29:03.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.072+0000 7f1442f54700 1 -- 172.21.15.80:0/4233369893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143c1122f0 con 0x7f143c12cea0 2019-11-28T11:29:03.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.073+0000 7f14414f1700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c12cea0 0x7f143c111db0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f142c010440 tx=0x7f142c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.073+0000 7f1439ffb700 1 -- 172.21.15.80:0/4233369893 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f142c005180 con 0x7f143c12cea0 2019-11-28T11:29:03.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.073+0000 7f14414f1700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c12cea0 0x7f143c111db0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f142c010440 tx=0x7f142c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.073+0000 7f1439ffb700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f141c018730 0x7f141c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:03.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.073+0000 7f1439ffb700 1 -- 172.21.15.80:0/4233369893 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f142c0319c0 con 0x7f143c12cea0 2019-11-28T11:29:03.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.073+0000 7f1440cf0700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f141c018730 0x7f141c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:03.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.074+0000 7f1440cf0700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f141c018730 0x7f141c01abc0 crc :-1 s=READY pgs=274 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:03.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.080+0000 7f1442f54700 1 -- 172.21.15.80:0/4233369893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143c1219a0 con 0x7f143c12cea0 2019-11-28T11:29:03.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.083+0000 7f14414f1700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c12cea0 0x7f143c111db0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f142c010440 tx=0x7f142c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.083+0000 7f1439ffb700 1 -- 172.21.15.80:0/4233369893 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f142c0072a0 con 0x7f143c12cea0 2019-11-28T11:29:03.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.258+0000 7f1442f54700 1 -- 172.21.15.80:0/4233369893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f143c121d20 con 0x7f143c12cea0 2019-11-28T11:29:03.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.258+0000 7f14414f1700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c12cea0 0x7f143c111db0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f142c010440 tx=0x7f142c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.258+0000 7f1439ffb700 1 -- 172.21.15.80:0/4233369893 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2443 (secure 0 0 0) 0x7f142c005180 con 0x7f143c12cea0 2019-11-28T11:29:03.289 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 30 2019-11-28T11:29:03.289 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:03.290 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5895,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/169206692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":169206692},{"type":"v1","addr":"172.21.15.80:6834","nonce":169206692}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":28},{"gid":5898,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/2970516164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":2970516164},{"type":"v1","addr":"172.21.15.80:6835","nonce":2970516164}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:54.163001+0000","modified":"2019-11-28T11:29:01.914204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5725},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5725":{"gid":5725,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2800771965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2800771965},{"type":"v1","addr":"172.21.15.174:6835","nonce":2800771965}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2019-11-28T11:29:03.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.261+0000 7f1442f54700 1 -- 172.21.15.80:0/4233369893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f141c018730 msgr2=0x7f141c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:03.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.261+0000 7f1442f54700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f141c018730 0x7f141c01abc0 crc :-1 s=READY pgs=274 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:03.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.261+0000 7f1442f54700 1 -- 172.21.15.80:0/4233369893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c12cea0 msgr2=0x7f143c111db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:03.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.261+0000 7f1442f54700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c12cea0 0x7f143c111db0 secure :-1 s=READY pgs=648 cs=0 l=1 rx=0x7f142c010440 tx=0x7f142c0107e0).stop 2019-11-28T11:29:03.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.261+0000 7f1442f54700 1 -- 172.21.15.80:0/4233369893 shutdown_connections 2019-11-28T11:29:03.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.261+0000 7f1442f54700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f141c018730 0x7f141c01abc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:03.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.261+0000 7f1442f54700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f143c123ab0 0x7f143c12d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:03.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.261+0000 7f1442f54700 1 --2- 172.21.15.80:0/4233369893 >> v2:172.21.15.174:3300/0 conn(0x7f143c1230e0 0x7f143c123570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:03.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.261+0000 7f1442f54700 1 --2- 172.21.15.80:0/4233369893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f143c12cea0 0x7f143c111db0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:03.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.261+0000 7f1442f54700 1 -- 172.21.15.80:0/4233369893 shutdown_connections 2019-11-28T11:29:03.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.261+0000 7f1442f54700 1 -- 172.21.15.80:0/4233369893 wait complete. 2019-11-28T11:29:03.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.261+0000 7f1442f54700 1 -- 172.21.15.80:0/4233369893 >> 172.21.15.80:0/4233369893 conn(0x7f143c1426c0 msgr2=0x7f143c110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:03.605 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5725}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 8, u'failed': [], u'epoch': 30, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [9], u'info': {u'gid_5725': {u'export_targets': [], u'name': u'c', u'incarnation': 29, u'state_seq': 3, u'state': u'up:active', u'gid': 5725, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2800771965, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2800771965, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2800771965'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:28:54.163001+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:29:01.914204+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:29:03.605 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:29:03.606 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:29:03.741 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:29:03.741 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:29:03.741 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:29:03.742 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5725, 2019-11-28T11:29:03.742 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:29:03.742 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:29:03.742 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 2.7977686780000002, 2019-11-28T11:29:03.742 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 30, 2019-11-28T11:29:03.742 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 57, 2019-11-28T11:29:03.743 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 57, 2019-11-28T11:29:03.743 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 7.0791341599999997 2019-11-28T11:29:03.743 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:29:03.748 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5725, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.7977686780000002, "mdsmap_epoch": 30, "osdmap_epoch": 57, "osdmap_epoch_barrier": 57, "uptime": 7.0791341599999997 } 2019-11-28T11:29:03.749 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:29:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28ef73a700 1 Processor -- start 2019-11-28T11:29:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28ef73a700 1 -- start start 2019-11-28T11:29:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28ef73a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28e806c0a0 0x7f28e8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28ef73a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e80734e0 0x7f28e8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28ef73a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e806db00 con 0x7f28e8072360 2019-11-28T11:29:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28ef73a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e806fd60 con 0x7f28e806c0a0 2019-11-28T11:29:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28ef73a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e8070030 con 0x7f28e80734e0 2019-11-28T11:29:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28edcd7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28e806c0a0 0x7f28e8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28edcd7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28e806c0a0 0x7f28e8072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34188/0 (socket says 172.21.15.80:34188) 2019-11-28T11:29:03.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28edcd7700 1 -- 172.21.15.80:0/515625164 learned_addr learned my addr 172.21.15.80:0/515625164 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:03.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28ed4d6700 1 --2- 172.21.15.80:0/515625164 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e80734e0 0x7f28e8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:03.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28edcd7700 1 -- 172.21.15.80:0/515625164 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e80734e0 msgr2=0x7f28e8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28edcd7700 1 --2- 172.21.15.80:0/515625164 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e80734e0 0x7f28e8071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28edcd7700 1 -- 172.21.15.80:0/515625164 >> v1:172.21.15.80:6789/0 conn(0x7f28e8072360 legacy=0x7f28e806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28edcd7700 1 -- 172.21.15.80:0/515625164 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e80706c0 con 0x7f28e806c0a0 2019-11-28T11:29:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28eccd5700 1 -- 172.21.15.80:0/515625164 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659280831 0 0) 0x7f28e0000dc0 con 0x7f28e8072360 2019-11-28T11:29:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28ed4d6700 1 --2- 172.21.15.80:0/515625164 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e80734e0 0x7f28e8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:29:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.848+0000 7f28edcd7700 1 --2- 172.21.15.80:0/515625164 >> v2:172.21.15.80:3300/0 conn(0x7f28e806c0a0 0x7f28e8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f28d800f740 tx=0x7f28d800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.850+0000 7f28edcd7700 1 --2- 172.21.15.80:0/515625164 >> v2:172.21.15.80:3300/0 conn(0x7f28e806c0a0 0x7f28e8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f28d800f740 tx=0x7f28d800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.850+0000 7f28edcd7700 1 --2- 172.21.15.80:0/515625164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e806c0a0 0x7f28e8072fa0 secure :-1 s=READY pgs=650 cs=0 l=1 rx=0x7f28d800f740 tx=0x7f28d800fae0).ready entity=mon.0 client_cookie=6ef81b22099bf7e6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:03.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.850+0000 7f28edcd7700 1 --2- 172.21.15.80:0/515625164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e806c0a0 0x7f28e8072fa0 secure :-1 s=THROTTLE_DONE pgs=650 cs=0 l=1 rx=0x7f28d800f740 tx=0x7f28d800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.850+0000 7f28eccd5700 1 -- 172.21.15.80:0/515625164 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d8000960 con 0x7f28e806c0a0 2019-11-28T11:29:03.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.850+0000 7f28edcd7700 1 --2- 172.21.15.80:0/515625164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e806c0a0 0x7f28e8072fa0 secure :-1 s=THROTTLE_DONE pgs=650 cs=0 l=1 rx=0x7f28d800f740 tx=0x7f28d800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.850+0000 7f28edcd7700 1 --2- 172.21.15.80:0/515625164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e806c0a0 0x7f28e8072fa0 secure :-1 s=THROTTLE_DONE pgs=650 cs=0 l=1 rx=0x7f28d800f740 tx=0x7f28d800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.850+0000 7f28eccd5700 1 -- 172.21.15.80:0/515625164 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d8000c90 con 0x7f28e806c0a0 2019-11-28T11:29:03.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.850+0000 7f28eccd5700 1 -- 172.21.15.80:0/515625164 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d8000960 con 0x7f28e806c0a0 2019-11-28T11:29:03.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.850+0000 7f28ef73a700 1 -- 172.21.15.80:0/515625164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e806c0a0 msgr2=0x7f28e8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:03.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.850+0000 7f28ef73a700 1 --2- 172.21.15.80:0/515625164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e806c0a0 0x7f28e8072fa0 secure :-1 s=READY pgs=650 cs=0 l=1 rx=0x7f28d800f740 tx=0x7f28d800fae0).stop 2019-11-28T11:29:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.850+0000 7f28ef73a700 1 -- 172.21.15.80:0/515625164 shutdown_connections 2019-11-28T11:29:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.850+0000 7f28ef73a700 1 --2- 172.21.15.80:0/515625164 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e80734e0 0x7f28e8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.850+0000 7f28ef73a700 1 --2- 172.21.15.80:0/515625164 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e806c0a0 0x7f28e8072fa0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.851+0000 7f28ef73a700 1 -- 172.21.15.80:0/515625164 shutdown_connections 2019-11-28T11:29:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.851+0000 7f28ef73a700 1 -- 172.21.15.80:0/515625164 wait complete. 2019-11-28T11:29:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.851+0000 7f28ef73a700 1 -- 172.21.15.80:0/515625164 >> 172.21.15.80:0/515625164 conn(0x7f28e8061cf0 msgr2=0x7f28e8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.853+0000 7f28ef73a700 1 Processor -- start 2019-11-28T11:29:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.853+0000 7f28ef73a700 1 -- start start 2019-11-28T11:29:03.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ef73a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e8103000 0x7f28e8103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:03.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ef73a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28e81039d0 0x7f28e8167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:03.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ef73a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e81312c0 con 0x7f28e813dc00 2019-11-28T11:29:03.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ef73a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e8105830 con 0x7f28e81039d0 2019-11-28T11:29:03.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ef73a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e8105b00 con 0x7f28e8103000 2019-11-28T11:29:03.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ee4d8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28e81039d0 0x7f28e8167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:03.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ee4d8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28e81039d0 0x7f28e8167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34196/0 (socket says 172.21.15.80:34196) 2019-11-28T11:29:03.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ee4d8700 1 -- 172.21.15.80:0/3050460855 learned_addr learned my addr 172.21.15.80:0/3050460855 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:03.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ed4d6700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e8103000 0x7f28e8103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:03.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ee4d8700 1 -- 172.21.15.80:0/3050460855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e8103000 msgr2=0x7f28e8103490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:03.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ee4d8700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e8103000 0x7f28e8103490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ee4d8700 1 -- 172.21.15.80:0/3050460855 >> v1:172.21.15.174:6789/0 conn(0x7f28e813dc00 legacy=0x7f28e8109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ee4d8700 1 -- 172.21.15.80:0/3050460855 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e8106190 con 0x7f28e81039d0 2019-11-28T11:29:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ee4d8700 1 --2- 172.21.15.80:0/3050460855 >> v2:172.21.15.80:3300/0 conn(0x7f28e81039d0 0x7f28e8167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28e0010790 tx=0x7f28e0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ee4d8700 1 --2- 172.21.15.80:0/3050460855 >> v2:172.21.15.80:3300/0 conn(0x7f28e81039d0 0x7f28e8167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28e0010790 tx=0x7f28e0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ee4d8700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e81039d0 0x7f28e8167a10 secure :-1 s=READY pgs=651 cs=0 l=1 rx=0x7f28e0010790 tx=0x7f28e0010610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ee4d8700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e81039d0 0x7f28e8167a10 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7f28e0010790 tx=0x7f28e0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28de7fc700 1 -- 172.21.15.80:0/3050460855 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28e0005af0 con 0x7f28e81039d0 2019-11-28T11:29:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ee4d8700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e81039d0 0x7f28e8167a10 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7f28e0010790 tx=0x7f28e0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ee4d8700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e81039d0 0x7f28e8167a10 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7f28e0010790 tx=0x7f28e0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28de7fc700 1 -- 172.21.15.80:0/3050460855 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e0000cc0 con 0x7f28e81039d0 2019-11-28T11:29:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28ef73a700 1 -- 172.21.15.80:0/3050460855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e8106510 con 0x7f28e81039d0 2019-11-28T11:29:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.854+0000 7f28de7fc700 1 -- 172.21.15.80:0/3050460855 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28e00060d0 con 0x7f28e81039d0 2019-11-28T11:29:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.855+0000 7f28ef73a700 1 -- 172.21.15.80:0/3050460855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e8106190 con 0x7f28e81039d0 2019-11-28T11:29:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.855+0000 7f28ee4d8700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e81039d0 0x7f28e8167a10 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7f28e0010790 tx=0x7f28e0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.855+0000 7f28de7fc700 1 -- 172.21.15.80:0/3050460855 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f28e0005850 con 0x7f28e81039d0 2019-11-28T11:29:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.855+0000 7f28ee4d8700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e81039d0 0x7f28e8167a10 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7f28e0010790 tx=0x7f28e0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.855+0000 7f28de7fc700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28d0018730 0x7f28d001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.855+0000 7f28de7fc700 1 -- 172.21.15.80:0/3050460855 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f28e0031ed0 con 0x7f28e81039d0 2019-11-28T11:29:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.856+0000 7f28edcd7700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28d0018730 0x7f28d001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.856+0000 7f28edcd7700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28d0018730 0x7f28d001abc0 crc :-1 s=READY pgs=275 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.863+0000 7f28ef73a700 1 -- 172.21.15.80:0/3050460855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e8106510 con 0x7f28e81039d0 2019-11-28T11:29:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.867+0000 7f28ee4d8700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e81039d0 0x7f28e8167a10 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7f28e0010790 tx=0x7f28e0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:03.867+0000 7f28de7fc700 1 -- 172.21.15.80:0/3050460855 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f28e0000cc0 con 0x7f28e81039d0 2019-11-28T11:29:04.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.044+0000 7f28ef73a700 1 -- 172.21.15.80:0/3050460855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28e8106190 con 0x7f28e81039d0 2019-11-28T11:29:04.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.045+0000 7f28ee4d8700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e81039d0 0x7f28e8167a10 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7f28e0010790 tx=0x7f28e0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.045+0000 7f28de7fc700 1 -- 172.21.15.80:0/3050460855 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+14857 (secure 0 0 0) 0x7f28e0000cc0 con 0x7f28e81039d0 2019-11-28T11:29:04.082 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:04.083 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":57,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:28:55.164436+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:28:52.545871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2019-11-28T11:28:53.180206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:29:04.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.047+0000 7f28ef73a700 1 -- 172.21.15.80:0/3050460855 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28d0018730 msgr2=0x7f28d001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.047+0000 7f28ef73a700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28d0018730 0x7f28d001abc0 crc :-1 s=READY pgs=275 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.047+0000 7f28ef73a700 1 -- 172.21.15.80:0/3050460855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e81039d0 msgr2=0x7f28e8167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.047+0000 7f28ef73a700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e81039d0 0x7f28e8167a10 secure :-1 s=READY pgs=651 cs=0 l=1 rx=0x7f28e0010790 tx=0x7f28e0010610).stop 2019-11-28T11:29:04.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.047+0000 7f28ef73a700 1 -- 172.21.15.80:0/3050460855 shutdown_connections 2019-11-28T11:29:04.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.047+0000 7f28ef73a700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e81039d0 0x7f28e8167a10 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.047+0000 7f28ef73a700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e8103000 0x7f28e8103490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.047+0000 7f28ef73a700 1 --2- 172.21.15.80:0/3050460855 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28d0018730 0x7f28d001abc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.047+0000 7f28ef73a700 1 -- 172.21.15.80:0/3050460855 shutdown_connections 2019-11-28T11:29:04.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.047+0000 7f28ef73a700 1 -- 172.21.15.80:0/3050460855 wait complete. 2019-11-28T11:29:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.047+0000 7f28ef73a700 1 -- 172.21.15.80:0/3050460855 >> 172.21.15.80:0/3050460855 conn(0x7f28e811bfc0 msgr2=0x7f28e8141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:04.103 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:28:52.545871+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 8, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'56', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:28:53.180206+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 9, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'57', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:29:04.103 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:29:04.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.202+0000 7f2bc6950700 1 Processor -- start 2019-11-28T11:29:04.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.202+0000 7f2bc6950700 1 -- start start 2019-11-28T11:29:04.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.203+0000 7f2bc6950700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2bc015f100 0x7f2bc006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:04.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.203+0000 7f2bc6950700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c2f0 0x7f2bc006c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:04.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.203+0000 7f2bc6950700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc006db60 con 0x7f2bc015ed10 2019-11-28T11:29:04.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.203+0000 7f2bc6950700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc006fe00 con 0x7f2bc015f100 2019-11-28T11:29:04.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.203+0000 7f2bc6950700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc00700d0 con 0x7f2bc006c2f0 2019-11-28T11:29:04.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.203+0000 7f2bc56ee700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c2f0 0x7f2bc006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:04.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.203+0000 7f2bbffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2bc015f100 0x7f2bc006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:04.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.203+0000 7f2bc56ee700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c2f0 0x7f2bc006c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:36464/0 (socket says 172.21.15.80:36464) 2019-11-28T11:29:04.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.203+0000 7f2bc56ee700 1 -- 172.21.15.80:0/2789725054 learned_addr learned my addr 172.21.15.80:0/2789725054 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:04.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.203+0000 7f2bbffff700 1 -- 172.21.15.80:0/2789725054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c2f0 msgr2=0x7f2bc006c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:04.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.203+0000 7f2bbffff700 1 --2- 172.21.15.80:0/2789725054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c2f0 0x7f2bc006c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:04.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.203+0000 7f2bbffff700 1 -- 172.21.15.80:0/2789725054 >> v1:172.21.15.174:6789/0 conn(0x7f2bc015ed10 legacy=0x7f2bc0073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.203+0000 7f2bbffff700 1 -- 172.21.15.80:0/2789725054 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc0070760 con 0x7f2bc015f100 2019-11-28T11:29:04.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.203+0000 7f2bc56ee700 1 --2- 172.21.15.80:0/2789725054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c2f0 0x7f2bc006c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:04.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.204+0000 7f2bbffff700 1 --2- 172.21.15.80:0/2789725054 >> v2:172.21.15.174:3300/0 conn(0x7f2bc015f100 0x7f2bc006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2bb000af50 tx=0x7f2bb000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.204+0000 7f2bbffff700 1 --2- 172.21.15.80:0/2789725054 >> v2:172.21.15.174:3300/0 conn(0x7f2bc015f100 0x7f2bc006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2bb000af50 tx=0x7f2bb000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.204+0000 7f2bbffff700 1 --2- 172.21.15.80:0/2789725054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bc015f100 0x7f2bc006bdb0 secure :-1 s=READY pgs=382 cs=0 l=1 rx=0x7f2bb000af50 tx=0x7f2bb000b760).ready entity=mon.1 client_cookie=8c540f5914295636 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:04.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.204+0000 7f2bbffff700 1 --2- 172.21.15.80:0/2789725054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bc015f100 0x7f2bc006bdb0 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7f2bb000af50 tx=0x7f2bb000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.204+0000 7f2bbffff700 1 --2- 172.21.15.80:0/2789725054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bc015f100 0x7f2bc006bdb0 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7f2bb000af50 tx=0x7f2bb000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.204+0000 7f2bbf7fe700 1 -- 172.21.15.80:0/2789725054 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bb0007210 con 0x7f2bc015f100 2019-11-28T11:29:04.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.204+0000 7f2bbffff700 1 --2- 172.21.15.80:0/2789725054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bc015f100 0x7f2bc006bdb0 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7f2bb000af50 tx=0x7f2bb000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.204+0000 7f2bbf7fe700 1 -- 172.21.15.80:0/2789725054 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb00099b0 con 0x7f2bc015f100 2019-11-28T11:29:04.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.204+0000 7f2bbf7fe700 1 -- 172.21.15.80:0/2789725054 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bb000a080 con 0x7f2bc015f100 2019-11-28T11:29:04.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.204+0000 7f2bc6950700 1 -- 172.21.15.80:0/2789725054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bc015f100 msgr2=0x7f2bc006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.204+0000 7f2bc6950700 1 --2- 172.21.15.80:0/2789725054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bc015f100 0x7f2bc006bdb0 secure :-1 s=READY pgs=382 cs=0 l=1 rx=0x7f2bb000af50 tx=0x7f2bb000b760).stop 2019-11-28T11:29:04.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.204+0000 7f2bc6950700 1 -- 172.21.15.80:0/2789725054 shutdown_connections 2019-11-28T11:29:04.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.204+0000 7f2bc6950700 1 --2- 172.21.15.80:0/2789725054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c2f0 0x7f2bc006c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:04.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.204+0000 7f2bc6950700 1 --2- 172.21.15.80:0/2789725054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bc015f100 0x7f2bc006bdb0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.204+0000 7f2bc6950700 1 -- 172.21.15.80:0/2789725054 shutdown_connections 2019-11-28T11:29:04.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.205+0000 7f2bc6950700 1 -- 172.21.15.80:0/2789725054 wait complete. 2019-11-28T11:29:04.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.205+0000 7f2bc6950700 1 -- 172.21.15.80:0/2789725054 >> 172.21.15.80:0/2789725054 conn(0x7f2bc0061d20 msgr2=0x7f2bc00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:04.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.207+0000 7f2bc6950700 1 Processor -- start 2019-11-28T11:29:04.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.207+0000 7f2bc6950700 1 -- start start 2019-11-28T11:29:04.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bc6950700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc015f800 0x7f2bc0156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:04.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bc6950700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2bc01566b0 0x7f2bc0155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:04.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bc6950700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc015cb50 con 0x7f2bc01555a0 2019-11-28T11:29:04.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bc6950700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc01023d0 con 0x7f2bc01566b0 2019-11-28T11:29:04.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bc6950700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc01026a0 con 0x7f2bc015f800 2019-11-28T11:29:04.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bbffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2bc01566b0 0x7f2bc0155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:04.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bbffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2bc01566b0 0x7f2bc0155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34206/0 (socket says 172.21.15.80:34206) 2019-11-28T11:29:04.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bbffff700 1 -- 172.21.15.80:0/1518642985 learned_addr learned my addr 172.21.15.80:0/1518642985 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:04.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bc4eed700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc015f800 0x7f2bc0156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:04.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bbffff700 1 -- 172.21.15.80:0/1518642985 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc015f800 msgr2=0x7f2bc0156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc015f800 0x7f2bc0156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bbffff700 1 -- 172.21.15.80:0/1518642985 >> v1:172.21.15.174:6789/0 conn(0x7f2bc01555a0 legacy=0x7f2bc0110bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bbffff700 1 -- 172.21.15.80:0/1518642985 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc0103760 con 0x7f2bc01566b0 2019-11-28T11:29:04.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bbd7fa700 1 -- 172.21.15.80:0/1518642985 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224947581 0 0) 0x7f2bb8007b60 con 0x7f2bc01555a0 2019-11-28T11:29:04.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1518642985 >> v2:172.21.15.80:3300/0 conn(0x7f2bc01566b0 0x7f2bc0155060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2bb00103f0 tx=0x7f2bb0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1518642985 >> v2:172.21.15.80:3300/0 conn(0x7f2bc01566b0 0x7f2bc0155060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2bb00103f0 tx=0x7f2bb0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.208+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01566b0 0x7f2bc0155060 secure :-1 s=READY pgs=652 cs=0 l=1 rx=0x7f2bb00103f0 tx=0x7f2bb0010790).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:04.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.209+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01566b0 0x7f2bc0155060 secure :-1 s=THROTTLE_DONE pgs=652 cs=0 l=1 rx=0x7f2bb00103f0 tx=0x7f2bb0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.209+0000 7f2bbd7fa700 1 -- 172.21.15.80:0/1518642985 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bb0000940 con 0x7f2bc01566b0 2019-11-28T11:29:04.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.209+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01566b0 0x7f2bc0155060 secure :-1 s=THROTTLE_DONE pgs=652 cs=0 l=1 rx=0x7f2bb00103f0 tx=0x7f2bb0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.209+0000 7f2bc6950700 1 -- 172.21.15.80:0/1518642985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc0103ae0 con 0x7f2bc01566b0 2019-11-28T11:29:04.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.209+0000 7f2bbd7fa700 1 -- 172.21.15.80:0/1518642985 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb0000940 con 0x7f2bc01566b0 2019-11-28T11:29:04.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.209+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01566b0 0x7f2bc0155060 secure :-1 s=THROTTLE_DONE pgs=652 cs=0 l=1 rx=0x7f2bb00103f0 tx=0x7f2bb0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.209+0000 7f2bbd7fa700 1 -- 172.21.15.80:0/1518642985 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bb0009b70 con 0x7f2bc01566b0 2019-11-28T11:29:04.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.209+0000 7f2bc6950700 1 -- 172.21.15.80:0/1518642985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc0104bc0 con 0x7f2bc01566b0 2019-11-28T11:29:04.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.209+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01566b0 0x7f2bc0155060 secure :-1 s=THROTTLE_DONE pgs=652 cs=0 l=1 rx=0x7f2bb00103f0 tx=0x7f2bb0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.209+0000 7f2bbd7fa700 1 -- 172.21.15.80:0/1518642985 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2bb0009790 con 0x7f2bc01566b0 2019-11-28T11:29:04.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.209+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01566b0 0x7f2bc0155060 secure :-1 s=THROTTLE_DONE pgs=652 cs=0 l=1 rx=0x7f2bb00103f0 tx=0x7f2bb0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.209+0000 7f2bbd7fa700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ba4018730 0x7f2ba401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:04.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.209+0000 7f2bbd7fa700 1 -- 172.21.15.80:0/1518642985 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2bb0031b10 con 0x7f2bc01566b0 2019-11-28T11:29:04.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.210+0000 7f2bc4eed700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ba4018730 0x7f2ba401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:04.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.210+0000 7f2bc4eed700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ba4018730 0x7f2ba401abc0 crc :-1 s=READY pgs=276 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:04.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.217+0000 7f2bc6950700 1 -- 172.21.15.80:0/1518642985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc0103760 con 0x7f2bc01566b0 2019-11-28T11:29:04.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.221+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01566b0 0x7f2bc0155060 secure :-1 s=THROTTLE_DONE pgs=652 cs=0 l=1 rx=0x7f2bb00103f0 tx=0x7f2bb0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.221+0000 7f2bbd7fa700 1 -- 172.21.15.80:0/1518642985 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2bb0009580 con 0x7f2bc01566b0 2019-11-28T11:29:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.386+0000 7f2bc6950700 1 -- 172.21.15.80:0/1518642985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f2bc0103ae0 con 0x7f2bc01566b0 2019-11-28T11:29:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.387+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01566b0 0x7f2bc0155060 secure :-1 s=THROTTLE_DONE pgs=652 cs=0 l=1 rx=0x7f2bb00103f0 tx=0x7f2bb0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.387+0000 7f2bbd7fa700 1 -- 172.21.15.80:0/1518642985 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2bb0009790 con 0x7f2bc01566b0 2019-11-28T11:29:04.416 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:29:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.389+0000 7f2bc6950700 1 -- 172.21.15.80:0/1518642985 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ba4018730 msgr2=0x7f2ba401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.389+0000 7f2bc6950700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ba4018730 0x7f2ba401abc0 crc :-1 s=READY pgs=276 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.389+0000 7f2bc6950700 1 -- 172.21.15.80:0/1518642985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01566b0 msgr2=0x7f2bc0155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.389+0000 7f2bc6950700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01566b0 0x7f2bc0155060 secure :-1 s=READY pgs=652 cs=0 l=1 rx=0x7f2bb00103f0 tx=0x7f2bb0010790).stop 2019-11-28T11:29:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.390+0000 7f2bc6950700 1 -- 172.21.15.80:0/1518642985 shutdown_connections 2019-11-28T11:29:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.390+0000 7f2bc6950700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ba4018730 0x7f2ba401abc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.390+0000 7f2bc6950700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bc01566b0 0x7f2bc0155060 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.390+0000 7f2bc6950700 1 --2- 172.21.15.80:0/1518642985 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc015f800 0x7f2bc0156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.390+0000 7f2bc6950700 1 -- 172.21.15.80:0/1518642985 shutdown_connections 2019-11-28T11:29:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.390+0000 7f2bc6950700 1 -- 172.21.15.80:0/1518642985 wait complete. 2019-11-28T11:29:04.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.390+0000 7f2bc6950700 1 -- 172.21.15.80:0/1518642985 >> 172.21.15.80:0/1518642985 conn(0x7f2bc007c4f0 msgr2=0x7f2bc015ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:04.428 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:29:04.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.525+0000 7f78b6ff3700 1 Processor -- start 2019-11-28T11:29:04.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.525+0000 7f78b6ff3700 1 -- start start 2019-11-28T11:29:04.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.526+0000 7f78b6ff3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78b015ed10 0x7f78b015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:04.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.526+0000 7f78b6ff3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78b0073020 0x7f78b0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:04.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.526+0000 7f78b6ff3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b006db60 con 0x7f78b00734b0 2019-11-28T11:29:04.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.526+0000 7f78b6ff3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b006f3d0 con 0x7f78b0073020 2019-11-28T11:29:04.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.526+0000 7f78b6ff3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b006fe00 con 0x7f78b015ed10 2019-11-28T11:29:04.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.526+0000 7f78b4d8f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78b0073020 0x7f78b0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:04.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.526+0000 7f78b4d8f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78b0073020 0x7f78b0071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34214/0 (socket says 172.21.15.80:34214) 2019-11-28T11:29:04.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.526+0000 7f78b4d8f700 1 -- 172.21.15.80:0/1282108373 learned_addr learned my addr 172.21.15.80:0/1282108373 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:04.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.526+0000 7f78b5590700 1 --2- 172.21.15.80:0/1282108373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78b015ed10 0x7f78b015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:04.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.527+0000 7f78b4d8f700 1 -- 172.21.15.80:0/1282108373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78b015ed10 msgr2=0x7f78b015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:04.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.527+0000 7f78b4d8f700 1 --2- 172.21.15.80:0/1282108373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78b015ed10 0x7f78b015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:04.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.527+0000 7f78b4d8f700 1 -- 172.21.15.80:0/1282108373 >> v1:172.21.15.174:6789/0 conn(0x7f78b00734b0 legacy=0x7f78b00723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.527+0000 7f78b4d8f700 1 -- 172.21.15.80:0/1282108373 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b0070760 con 0x7f78b0073020 2019-11-28T11:29:04.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.527+0000 7f78b4d8f700 1 --2- 172.21.15.80:0/1282108373 >> v2:172.21.15.80:3300/0 conn(0x7f78b0073020 0x7f78b0071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f78a000f6c0 tx=0x7f78a000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.527+0000 7f78b4d8f700 1 --2- 172.21.15.80:0/1282108373 >> v2:172.21.15.80:3300/0 conn(0x7f78b0073020 0x7f78b0071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f78a000f6c0 tx=0x7f78a000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.527+0000 7f78b4d8f700 1 --2- 172.21.15.80:0/1282108373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b0073020 0x7f78b0071ea0 secure :-1 s=READY pgs=653 cs=0 l=1 rx=0x7f78a000f6c0 tx=0x7f78a000fa60).ready entity=mon.0 client_cookie=d255969d98d38a44 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:04.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.527+0000 7f78b4d8f700 1 --2- 172.21.15.80:0/1282108373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b0073020 0x7f78b0071ea0 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7f78a000f6c0 tx=0x7f78a000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.527+0000 7f78affff700 1 -- 172.21.15.80:0/1282108373 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78a0000960 con 0x7f78b0073020 2019-11-28T11:29:04.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.527+0000 7f78b4d8f700 1 --2- 172.21.15.80:0/1282108373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b0073020 0x7f78b0071ea0 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7f78a000f6c0 tx=0x7f78a000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.527+0000 7f78b4d8f700 1 --2- 172.21.15.80:0/1282108373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b0073020 0x7f78b0071ea0 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7f78a000f6c0 tx=0x7f78a000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.527+0000 7f78affff700 1 -- 172.21.15.80:0/1282108373 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a0000c90 con 0x7f78b0073020 2019-11-28T11:29:04.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.527+0000 7f78affff700 1 -- 172.21.15.80:0/1282108373 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78a00013a0 con 0x7f78b0073020 2019-11-28T11:29:04.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.527+0000 7f78b6ff3700 1 -- 172.21.15.80:0/1282108373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b0073020 msgr2=0x7f78b0071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.527+0000 7f78b6ff3700 1 --2- 172.21.15.80:0/1282108373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b0073020 0x7f78b0071ea0 secure :-1 s=READY pgs=653 cs=0 l=1 rx=0x7f78a000f6c0 tx=0x7f78a000fa60).stop 2019-11-28T11:29:04.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.528+0000 7f78b6ff3700 1 -- 172.21.15.80:0/1282108373 shutdown_connections 2019-11-28T11:29:04.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.528+0000 7f78b6ff3700 1 --2- 172.21.15.80:0/1282108373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b0073020 0x7f78b0071ea0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.528+0000 7f78b6ff3700 1 --2- 172.21.15.80:0/1282108373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78b015ed10 0x7f78b015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:04.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.528+0000 7f78b6ff3700 1 -- 172.21.15.80:0/1282108373 shutdown_connections 2019-11-28T11:29:04.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.528+0000 7f78b6ff3700 1 -- 172.21.15.80:0/1282108373 wait complete. 2019-11-28T11:29:04.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.528+0000 7f78b6ff3700 1 -- 172.21.15.80:0/1282108373 >> 172.21.15.80:0/1282108373 conn(0x7f78b0061d20 msgr2=0x7f78b00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:04.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.530+0000 7f78b6ff3700 1 Processor -- start 2019-11-28T11:29:04.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.530+0000 7f78b6ff3700 1 -- start start 2019-11-28T11:29:04.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.531+0000 7f78b6ff3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78b0148320 0x7f78b010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:04.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.531+0000 7f78b6ff3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78b010e3d0 0x7f78b0168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:04.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.531+0000 7f78b6ff3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b0148e00 con 0x7f78b010f290 2019-11-28T11:29:04.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.531+0000 7f78b6ff3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b0139ff0 con 0x7f78b010e3d0 2019-11-28T11:29:04.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.531+0000 7f78b6ff3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b013aa20 con 0x7f78b0148320 2019-11-28T11:29:04.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.531+0000 7f78b5d91700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78b010e3d0 0x7f78b0168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:04.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.531+0000 7f78b5590700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78b0148320 0x7f78b010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:04.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.531+0000 7f78b5d91700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78b010e3d0 0x7f78b0168d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34220/0 (socket says 172.21.15.80:34220) 2019-11-28T11:29:04.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.531+0000 7f78b5d91700 1 -- 172.21.15.80:0/1580511262 learned_addr learned my addr 172.21.15.80:0/1580511262 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:04.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78b5d91700 1 -- 172.21.15.80:0/1580511262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78b0148320 msgr2=0x7f78b010ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78b5d91700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78b0148320 0x7f78b010ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78b5d91700 1 -- 172.21.15.80:0/1580511262 >> v1:172.21.15.174:6789/0 conn(0x7f78b010f290 legacy=0x7f78b010dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78b5d91700 1 -- 172.21.15.80:0/1580511262 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b010c490 con 0x7f78b010e3d0 2019-11-28T11:29:04.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78adffb700 1 -- 172.21.15.80:0/1580511262 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370984666 0 0) 0x7f78a00075d0 con 0x7f78b010f290 2019-11-28T11:29:04.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78b5d91700 1 --2- 172.21.15.80:0/1580511262 >> v2:172.21.15.80:3300/0 conn(0x7f78b010e3d0 0x7f78b0168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78a80103a0 tx=0x7f78a8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78b5d91700 1 --2- 172.21.15.80:0/1580511262 >> v2:172.21.15.80:3300/0 conn(0x7f78b010e3d0 0x7f78b0168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78a80103a0 tx=0x7f78a8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78b5d91700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b010e3d0 0x7f78b0168d80 secure :-1 s=READY pgs=654 cs=0 l=1 rx=0x7f78a80103a0 tx=0x7f78a8010740).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:04.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78b5d91700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b010e3d0 0x7f78b0168d80 secure :-1 s=THROTTLE_DONE pgs=654 cs=0 l=1 rx=0x7f78a80103a0 tx=0x7f78a8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78adffb700 1 -- 172.21.15.80:0/1580511262 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78a8000960 con 0x7f78b010e3d0 2019-11-28T11:29:04.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78b5d91700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b010e3d0 0x7f78b0168d80 secure :-1 s=THROTTLE_DONE pgs=654 cs=0 l=1 rx=0x7f78a80103a0 tx=0x7f78a8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78b5d91700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b010e3d0 0x7f78b0168d80 secure :-1 s=THROTTLE_DONE pgs=654 cs=0 l=1 rx=0x7f78a80103a0 tx=0x7f78a8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78adffb700 1 -- 172.21.15.80:0/1580511262 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a8001090 con 0x7f78b010e3d0 2019-11-28T11:29:04.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78adffb700 1 -- 172.21.15.80:0/1580511262 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78a8001760 con 0x7f78b010e3d0 2019-11-28T11:29:04.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78b6ff3700 1 -- 172.21.15.80:0/1580511262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b010c810 con 0x7f78b010e3d0 2019-11-28T11:29:04.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78b6ff3700 1 -- 172.21.15.80:0/1580511262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b010c490 con 0x7f78b010e3d0 2019-11-28T11:29:04.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.532+0000 7f78b5d91700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b010e3d0 0x7f78b0168d80 secure :-1 s=THROTTLE_DONE pgs=654 cs=0 l=1 rx=0x7f78a80103a0 tx=0x7f78a8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.533+0000 7f78adffb700 1 -- 172.21.15.80:0/1580511262 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f78a8000940 con 0x7f78b010e3d0 2019-11-28T11:29:04.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.533+0000 7f78b5d91700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b010e3d0 0x7f78b0168d80 secure :-1 s=THROTTLE_DONE pgs=654 cs=0 l=1 rx=0x7f78a80103a0 tx=0x7f78a8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.533+0000 7f78adffb700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7894018730 0x7f789401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:04.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.533+0000 7f78adffb700 1 -- 172.21.15.80:0/1580511262 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f78a8031a90 con 0x7f78b010e3d0 2019-11-28T11:29:04.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.533+0000 7f78b5590700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7894018730 0x7f789401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:04.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.533+0000 7f78b5590700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7894018730 0x7f789401abc0 crc :-1 s=READY pgs=277 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:04.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.540+0000 7f78b6ff3700 1 -- 172.21.15.80:0/1580511262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b010c810 con 0x7f78b010e3d0 2019-11-28T11:29:04.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.544+0000 7f78b5d91700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b010e3d0 0x7f78b0168d80 secure :-1 s=THROTTLE_DONE pgs=654 cs=0 l=1 rx=0x7f78a80103a0 tx=0x7f78a8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.544+0000 7f78adffb700 1 -- 172.21.15.80:0/1580511262 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f78a8007590 con 0x7f78b010e3d0 2019-11-28T11:29:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.710+0000 7f78b6ff3700 1 -- 172.21.15.80:0/1580511262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f78b010c490 con 0x7f78b010e3d0 2019-11-28T11:29:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.710+0000 7f78b5d91700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b010e3d0 0x7f78b0168d80 secure :-1 s=THROTTLE_DONE pgs=654 cs=0 l=1 rx=0x7f78a80103a0 tx=0x7f78a8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.710+0000 7f78adffb700 1 -- 172.21.15.80:0/1580511262 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v57) v1 ==== 104+0+10 (secure 0 0 0) 0x7f78a8000940 con 0x7f78b010e3d0 2019-11-28T11:29:04.740 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:29:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.713+0000 7f78b6ff3700 1 -- 172.21.15.80:0/1580511262 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7894018730 msgr2=0x7f789401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.713+0000 7f78b6ff3700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7894018730 0x7f789401abc0 crc :-1 s=READY pgs=277 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.713+0000 7f78b6ff3700 1 -- 172.21.15.80:0/1580511262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b010e3d0 msgr2=0x7f78b0168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.713+0000 7f78b6ff3700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b010e3d0 0x7f78b0168d80 secure :-1 s=READY pgs=654 cs=0 l=1 rx=0x7f78a80103a0 tx=0x7f78a8010740).stop 2019-11-28T11:29:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.713+0000 7f78b6ff3700 1 -- 172.21.15.80:0/1580511262 shutdown_connections 2019-11-28T11:29:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.713+0000 7f78b6ff3700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b010e3d0 0x7f78b0168d80 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.713+0000 7f78b6ff3700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7894018730 0x7f789401abc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.713+0000 7f78b6ff3700 1 --2- 172.21.15.80:0/1580511262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78b0148320 0x7f78b010ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.713+0000 7f78b6ff3700 1 -- 172.21.15.80:0/1580511262 shutdown_connections 2019-11-28T11:29:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.713+0000 7f78b6ff3700 1 -- 172.21.15.80:0/1580511262 wait complete. 2019-11-28T11:29:04.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.713+0000 7f78b6ff3700 1 -- 172.21.15.80:0/1580511262 >> 172.21.15.80:0/1580511262 conn(0x7f78b015e2d0 msgr2=0x7f78b0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:04.752 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:29:04.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.846+0000 7ff8fb7c3700 1 Processor -- start 2019-11-28T11:29:04.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.847+0000 7ff8fb7c3700 1 -- start start 2019-11-28T11:29:04.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8fb7c3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8f415f100 0x7ff8f406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:04.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8fb7c3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f406db60 con 0x7ff8f415ed10 2019-11-28T11:29:04.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8fb7c3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f406e060 con 0x7ff8f406c2f0 2019-11-28T11:29:04.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8fb7c3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f406fe00 con 0x7ff8f415f100 2019-11-28T11:29:04.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f955f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8f415f100 0x7ff8f406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:04.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f955f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8f415f100 0x7ff8f406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34230/0 (socket says 172.21.15.80:34230) 2019-11-28T11:29:04.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f9d60700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff8f415ed10 0x7ff8f4073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33542/0 (socket says 172.21.15.80:33542) 2019-11-28T11:29:04.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f955f700 1 -- 172.21.15.80:0/4115053306 learned_addr learned my addr 172.21.15.80:0/4115053306 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:04.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f955f700 1 -- 172.21.15.80:0/4115053306 >> v1:172.21.15.174:6789/0 conn(0x7ff8f406c2f0 legacy=0x7ff8f406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f955f700 1 -- 172.21.15.80:0/4115053306 >> v1:172.21.15.80:6789/0 conn(0x7ff8f415ed10 legacy=0x7ff8f4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f8d5e700 1 -- 172.21.15.80:0/4115053306 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596879906 0 0) 0x7ff8e4001100 con 0x7ff8f415ed10 2019-11-28T11:29:04.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f955f700 1 -- 172.21.15.80:0/4115053306 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f4070760 con 0x7ff8f415f100 2019-11-28T11:29:04.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f955f700 1 --2- 172.21.15.80:0/4115053306 >> v2:172.21.15.80:3300/0 conn(0x7ff8f415f100 0x7ff8f406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff8dc00f740 tx=0x7ff8dc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f955f700 1 --2- 172.21.15.80:0/4115053306 >> v2:172.21.15.80:3300/0 conn(0x7ff8f415f100 0x7ff8f406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff8dc00f740 tx=0x7ff8dc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f955f700 1 --2- 172.21.15.80:0/4115053306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f415f100 0x7ff8f406bdb0 secure :-1 s=READY pgs=656 cs=0 l=1 rx=0x7ff8dc00f740 tx=0x7ff8dc00fae0).ready entity=mon.0 client_cookie=7958510ec503e00d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:04.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f955f700 1 --2- 172.21.15.80:0/4115053306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f415f100 0x7ff8f406bdb0 secure :-1 s=THROTTLE_DONE pgs=656 cs=0 l=1 rx=0x7ff8dc00f740 tx=0x7ff8dc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f8d5e700 1 -- 172.21.15.80:0/4115053306 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8dc000960 con 0x7ff8f415f100 2019-11-28T11:29:04.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f955f700 1 --2- 172.21.15.80:0/4115053306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f415f100 0x7ff8f406bdb0 secure :-1 s=THROTTLE_DONE pgs=656 cs=0 l=1 rx=0x7ff8dc00f740 tx=0x7ff8dc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f955f700 1 --2- 172.21.15.80:0/4115053306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f415f100 0x7ff8f406bdb0 secure :-1 s=THROTTLE_DONE pgs=656 cs=0 l=1 rx=0x7ff8dc00f740 tx=0x7ff8dc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f8d5e700 1 -- 172.21.15.80:0/4115053306 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc000c90 con 0x7ff8f415f100 2019-11-28T11:29:04.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.848+0000 7ff8f8d5e700 1 -- 172.21.15.80:0/4115053306 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8dc001360 con 0x7ff8f415f100 2019-11-28T11:29:04.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.849+0000 7ff8fb7c3700 1 -- 172.21.15.80:0/4115053306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f415f100 msgr2=0x7ff8f406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.849+0000 7ff8fb7c3700 1 --2- 172.21.15.80:0/4115053306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f415f100 0x7ff8f406bdb0 secure :-1 s=READY pgs=656 cs=0 l=1 rx=0x7ff8dc00f740 tx=0x7ff8dc00fae0).stop 2019-11-28T11:29:04.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.849+0000 7ff8fb7c3700 1 -- 172.21.15.80:0/4115053306 shutdown_connections 2019-11-28T11:29:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.849+0000 7ff8fb7c3700 1 --2- 172.21.15.80:0/4115053306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f415f100 0x7ff8f406bdb0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.849+0000 7ff8fb7c3700 1 -- 172.21.15.80:0/4115053306 shutdown_connections 2019-11-28T11:29:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.849+0000 7ff8fb7c3700 1 -- 172.21.15.80:0/4115053306 wait complete. 2019-11-28T11:29:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.849+0000 7ff8fb7c3700 1 -- 172.21.15.80:0/4115053306 >> 172.21.15.80:0/4115053306 conn(0x7ff8f4061d20 msgr2=0x7ff8f40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.852+0000 7ff8fb7c3700 1 Processor -- start 2019-11-28T11:29:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.852+0000 7ff8fb7c3700 1 -- start start 2019-11-28T11:29:04.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fb7c3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8f410ed60 0x7ff8f410f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:04.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fb7c3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8f410f730 0x7ff8f4167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:04.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fb7c3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f410c250 con 0x7ff8f410e970 2019-11-28T11:29:04.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fb7c3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f410e430 con 0x7ff8f410f730 2019-11-28T11:29:04.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fb7c3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f4105860 con 0x7ff8f410ed60 2019-11-28T11:29:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fa561700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8f410f730 0x7ff8f4167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8f9d60700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff8f410e970 0x7ff8f41087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33548/0 (socket says 172.21.15.80:33548) 2019-11-28T11:29:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8f9d60700 1 -- 172.21.15.80:0/1708939205 learned_addr learned my addr 172.21.15.80:0/1708939205 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8f955f700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8f410ed60 0x7ff8f410f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fa561700 1 -- 172.21.15.80:0/1708939205 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8f410ed60 msgr2=0x7ff8f410f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fa561700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8f410ed60 0x7ff8f410f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fa561700 1 -- 172.21.15.80:0/1708939205 >> v1:172.21.15.80:6789/0 conn(0x7ff8f410e970 legacy=0x7ff8f41087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fa561700 1 -- 172.21.15.80:0/1708939205 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f4105ef0 con 0x7ff8f410f730 2019-11-28T11:29:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8f27fc700 1 -- 172.21.15.80:0/1708939205 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458776535 0 0) 0x7ff8e4001150 con 0x7ff8f410e970 2019-11-28T11:29:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fa561700 1 --2- 172.21.15.80:0/1708939205 >> v2:172.21.15.80:3300/0 conn(0x7ff8f410f730 0x7ff8f4167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8ec010730 tx=0x7ff8ec00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fa561700 1 --2- 172.21.15.80:0/1708939205 >> v2:172.21.15.80:3300/0 conn(0x7ff8f410f730 0x7ff8f4167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8ec010730 tx=0x7ff8ec00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fa561700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f410f730 0x7ff8f4167d70 secure :-1 s=READY pgs=658 cs=0 l=1 rx=0x7ff8ec010730 tx=0x7ff8ec00b670).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fa561700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f410f730 0x7ff8f4167d70 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7ff8ec010730 tx=0x7ff8ec00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8f27fc700 1 -- 172.21.15.80:0/1708939205 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8ec000dd0 con 0x7ff8f410f730 2019-11-28T11:29:04.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fa561700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f410f730 0x7ff8f4167d70 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7ff8ec010730 tx=0x7ff8ec00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fa561700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f410f730 0x7ff8f4167d70 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7ff8ec010730 tx=0x7ff8ec00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8f27fc700 1 -- 172.21.15.80:0/1708939205 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec00f160 con 0x7ff8f410f730 2019-11-28T11:29:04.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8f27fc700 1 -- 172.21.15.80:0/1708939205 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8ec00f870 con 0x7ff8f410f730 2019-11-28T11:29:04.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fb7c3700 1 -- 172.21.15.80:0/1708939205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f4106270 con 0x7ff8f410f730 2019-11-28T11:29:04.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.853+0000 7ff8fb7c3700 1 -- 172.21.15.80:0/1708939205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f4105ef0 con 0x7ff8f410f730 2019-11-28T11:29:04.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.854+0000 7ff8fa561700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f410f730 0x7ff8f4167d70 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7ff8ec010730 tx=0x7ff8ec00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.854+0000 7ff8f27fc700 1 -- 172.21.15.80:0/1708939205 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff8ec009910 con 0x7ff8f410f730 2019-11-28T11:29:04.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.854+0000 7ff8fa561700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f410f730 0x7ff8f4167d70 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7ff8ec010730 tx=0x7ff8ec00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.854+0000 7ff8f27fc700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8d8018730 0x7ff8d801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:04.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.854+0000 7ff8f27fc700 1 -- 172.21.15.80:0/1708939205 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff8ec031db0 con 0x7ff8f410f730 2019-11-28T11:29:04.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.854+0000 7ff8f9d60700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8d8018730 0x7ff8d801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:04.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.855+0000 7ff8f9d60700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8d8018730 0x7ff8d801abc0 crc :-1 s=READY pgs=278 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:04.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.862+0000 7ff8fb7c3700 1 -- 172.21.15.80:0/1708939205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f4106270 con 0x7ff8f410f730 2019-11-28T11:29:04.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.865+0000 7ff8fa561700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f410f730 0x7ff8f4167d70 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7ff8ec010730 tx=0x7ff8ec00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:04.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:04.865+0000 7ff8f27fc700 1 -- 172.21.15.80:0/1708939205 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff8ec000cc0 con 0x7ff8f410f730 2019-11-28T11:29:05.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.032+0000 7ff8fb7c3700 1 -- 172.21.15.80:0/1708939205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7ff8f4105ef0 con 0x7ff8f410f730 2019-11-28T11:29:05.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.033+0000 7ff8fa561700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f410f730 0x7ff8f4167d70 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7ff8ec010730 tx=0x7ff8ec00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:05.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.033+0000 7ff8f27fc700 1 -- 172.21.15.80:0/1708939205 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v57) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff8ec000ed0 con 0x7ff8f410f730 2019-11-28T11:29:05.062 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:29:05.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.035+0000 7ff8fb7c3700 1 -- 172.21.15.80:0/1708939205 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8d8018730 msgr2=0x7ff8d801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:05.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.035+0000 7ff8fb7c3700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8d8018730 0x7ff8d801abc0 crc :-1 s=READY pgs=278 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:05.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.035+0000 7ff8fb7c3700 1 -- 172.21.15.80:0/1708939205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f410f730 msgr2=0x7ff8f4167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:05.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.035+0000 7ff8fb7c3700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f410f730 0x7ff8f4167d70 secure :-1 s=READY pgs=658 cs=0 l=1 rx=0x7ff8ec010730 tx=0x7ff8ec00b670).stop 2019-11-28T11:29:05.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.035+0000 7ff8fb7c3700 1 -- 172.21.15.80:0/1708939205 shutdown_connections 2019-11-28T11:29:05.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.035+0000 7ff8fb7c3700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8d8018730 0x7ff8d801abc0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:05.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.035+0000 7ff8fb7c3700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f410f730 0x7ff8f4167d70 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:05.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.035+0000 7ff8fb7c3700 1 --2- 172.21.15.80:0/1708939205 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8f410ed60 0x7ff8f410f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:05.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.035+0000 7ff8fb7c3700 1 -- 172.21.15.80:0/1708939205 shutdown_connections 2019-11-28T11:29:05.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.035+0000 7ff8fb7c3700 1 -- 172.21.15.80:0/1708939205 wait complete. 2019-11-28T11:29:05.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.035+0000 7ff8fb7c3700 1 -- 172.21.15.80:0/1708939205 >> 172.21.15.80:0/1708939205 conn(0x7ff8f415e2d0 msgr2=0x7ff8f4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:05.073 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:29:05.074 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:05.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.164+0000 7faac5840700 1 Processor -- start 2019-11-28T11:29:05.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.165+0000 7faac5840700 1 -- start start 2019-11-28T11:29:05.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.165+0000 7faac5840700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faac006c0a0 0x7faac0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:05.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.165+0000 7faac5840700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac00734e0 0x7faac0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:05.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.165+0000 7faac5840700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac006db00 con 0x7faac0072360 2019-11-28T11:29:05.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.165+0000 7faac5840700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac006fd60 con 0x7faac006c0a0 2019-11-28T11:29:05.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.165+0000 7faac5840700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac0070030 con 0x7faac00734e0 2019-11-28T11:29:05.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.166+0000 7faabf7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faac006c0a0 0x7faac0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:05.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.166+0000 7faabeffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac00734e0 0x7faac0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:05.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.166+0000 7faabf7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faac006c0a0 0x7faac0072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:49126/0 (socket says 172.21.15.80:49126) 2019-11-28T11:29:05.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.166+0000 7faabeffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac00734e0 0x7faac0071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:36504/0 (socket says 172.21.15.80:36504) 2019-11-28T11:29:05.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.166+0000 7faabf7fe700 1 -- 172.21.15.80:0/2815583166 learned_addr learned my addr 172.21.15.80:0/2815583166 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:05.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.166+0000 7faabf7fe700 1 -- 172.21.15.80:0/2815583166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac00734e0 msgr2=0x7faac0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:05.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.166+0000 7faabf7fe700 1 --2- 172.21.15.80:0/2815583166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac00734e0 0x7faac0071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:05.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.166+0000 7faabf7fe700 1 -- 172.21.15.80:0/2815583166 >> v1:172.21.15.174:6789/0 conn(0x7faac0072360 legacy=0x7faac006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:05.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.166+0000 7faabf7fe700 1 -- 172.21.15.80:0/2815583166 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac00706c0 con 0x7faac006c0a0 2019-11-28T11:29:05.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.166+0000 7faabeffd700 1 --2- 172.21.15.80:0/2815583166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac00734e0 0x7faac0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:05.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.166+0000 7faabf7fe700 1 --2- 172.21.15.80:0/2815583166 >> v2:172.21.15.174:3300/0 conn(0x7faac006c0a0 0x7faac0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faaa800f740 tx=0x7faaa800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:05.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.166+0000 7faabf7fe700 1 --2- 172.21.15.80:0/2815583166 >> v2:172.21.15.174:3300/0 conn(0x7faac006c0a0 0x7faac0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faaa800f740 tx=0x7faaa800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:05.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.166+0000 7faabf7fe700 1 --2- 172.21.15.80:0/2815583166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faac006c0a0 0x7faac0072fa0 secure :-1 s=READY pgs=388 cs=0 l=1 rx=0x7faaa800f740 tx=0x7faaa800fae0).ready entity=mon.1 client_cookie=4619e8fe85b8e392 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:05.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.167+0000 7faabf7fe700 1 --2- 172.21.15.80:0/2815583166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faac006c0a0 0x7faac0072fa0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7faaa800f740 tx=0x7faaa800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:05.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.167+0000 7faabe7fc700 1 -- 172.21.15.80:0/2815583166 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaa8000960 con 0x7faac006c0a0 2019-11-28T11:29:05.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.167+0000 7faabf7fe700 1 --2- 172.21.15.80:0/2815583166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faac006c0a0 0x7faac0072fa0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7faaa800f740 tx=0x7faaa800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:05.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.167+0000 7faabf7fe700 1 --2- 172.21.15.80:0/2815583166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faac006c0a0 0x7faac0072fa0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7faaa800f740 tx=0x7faaa800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:05.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.167+0000 7faabe7fc700 1 -- 172.21.15.80:0/2815583166 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa8000c90 con 0x7faac006c0a0 2019-11-28T11:29:05.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.167+0000 7faabe7fc700 1 -- 172.21.15.80:0/2815583166 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaa80013a0 con 0x7faac006c0a0 2019-11-28T11:29:05.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.167+0000 7faac5840700 1 -- 172.21.15.80:0/2815583166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faac006c0a0 msgr2=0x7faac0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:05.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.167+0000 7faac5840700 1 --2- 172.21.15.80:0/2815583166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faac006c0a0 0x7faac0072fa0 secure :-1 s=READY pgs=388 cs=0 l=1 rx=0x7faaa800f740 tx=0x7faaa800fae0).stop 2019-11-28T11:29:05.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.167+0000 7faac5840700 1 -- 172.21.15.80:0/2815583166 shutdown_connections 2019-11-28T11:29:05.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.167+0000 7faac5840700 1 --2- 172.21.15.80:0/2815583166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac00734e0 0x7faac0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:05.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.167+0000 7faac5840700 1 --2- 172.21.15.80:0/2815583166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faac006c0a0 0x7faac0072fa0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:05.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.167+0000 7faac5840700 1 -- 172.21.15.80:0/2815583166 shutdown_connections 2019-11-28T11:29:05.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.167+0000 7faac5840700 1 -- 172.21.15.80:0/2815583166 wait complete. 2019-11-28T11:29:05.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.167+0000 7faac5840700 1 -- 172.21.15.80:0/2815583166 >> 172.21.15.80:0/2815583166 conn(0x7faac0061cf0 msgr2=0x7faac0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:05.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.170+0000 7faac5840700 1 Processor -- start 2019-11-28T11:29:05.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.170+0000 7faac5840700 1 -- start start 2019-11-28T11:29:05.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.171+0000 7faac5840700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faac013eb40 0x7faac010afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:05.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.171+0000 7faac5840700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faac010b500 0x7faac01629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:05.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.171+0000 7faac5840700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac013f1e0 con 0x7faac0162f30 2019-11-28T11:29:05.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.171+0000 7faac5840700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac01234c0 con 0x7faac013eb40 2019-11-28T11:29:05.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.171+0000 7faac5840700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac013e0d0 con 0x7faac010b500 2019-11-28T11:29:05.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.171+0000 7faabf7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faac013eb40 0x7faac010afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:05.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.171+0000 7faabffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faac0162f30 0x7faac0109e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33564/0 (socket says 172.21.15.80:33564) 2019-11-28T11:29:05.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.171+0000 7faabffff700 1 -- 172.21.15.80:0/134261761 learned_addr learned my addr 172.21.15.80:0/134261761 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:05.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.171+0000 7faabeffd700 1 --2- 172.21.15.80:0/134261761 >> v2:172.21.15.174:3300/0 conn(0x7faac010b500 0x7faac01629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:05.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.171+0000 7faabf7fe700 1 -- 172.21.15.80:0/134261761 >> v2:172.21.15.174:3300/0 conn(0x7faac010b500 msgr2=0x7faac01629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:05.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.171+0000 7faabf7fe700 1 --2- 172.21.15.80:0/134261761 >> v2:172.21.15.174:3300/0 conn(0x7faac010b500 0x7faac01629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:05.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.171+0000 7faabf7fe700 1 -- 172.21.15.80:0/134261761 >> v1:172.21.15.80:6789/0 conn(0x7faac0162f30 legacy=0x7faac0109e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:05.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.171+0000 7faabf7fe700 1 -- 172.21.15.80:0/134261761 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac0108700 con 0x7faac013eb40 2019-11-28T11:29:05.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.171+0000 7faab7fff700 1 -- 172.21.15.80:0/134261761 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210437672 0 0) 0x7faab8001290 con 0x7faac0162f30 2019-11-28T11:29:05.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.172+0000 7faabf7fe700 1 --2- 172.21.15.80:0/134261761 >> v2:172.21.15.80:3300/0 conn(0x7faac013eb40 0x7faac010afc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faaa8010390 tx=0x7faaa8010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:05.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.172+0000 7faabf7fe700 1 --2- 172.21.15.80:0/134261761 >> v2:172.21.15.80:3300/0 conn(0x7faac013eb40 0x7faac010afc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faaa8010390 tx=0x7faaa8010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:05.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.172+0000 7faabf7fe700 1 --2- 172.21.15.80:0/134261761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faac013eb40 0x7faac010afc0 secure :-1 s=READY pgs=660 cs=0 l=1 rx=0x7faaa8010390 tx=0x7faaa8010210).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:05.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.172+0000 7faabf7fe700 1 --2- 172.21.15.80:0/134261761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faac013eb40 0x7faac010afc0 secure :-1 s=THROTTLE_DONE pgs=660 cs=0 l=1 rx=0x7faaa8010390 tx=0x7faaa8010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:05.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.172+0000 7faab7fff700 1 -- 172.21.15.80:0/134261761 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaa8005560 con 0x7faac013eb40 2019-11-28T11:29:05.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.172+0000 7faabf7fe700 1 --2- 172.21.15.80:0/134261761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faac013eb40 0x7faac010afc0 secure :-1 s=THROTTLE_DONE pgs=660 cs=0 l=1 rx=0x7faaa8010390 tx=0x7faaa8010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:05.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.172+0000 7faab7fff700 1 -- 172.21.15.80:0/134261761 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa8005180 con 0x7faac013eb40 2019-11-28T11:29:05.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.172+0000 7faabf7fe700 1 --2- 172.21.15.80:0/134261761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faac013eb40 0x7faac010afc0 secure :-1 s=THROTTLE_DONE pgs=660 cs=0 l=1 rx=0x7faaa8010390 tx=0x7faaa8010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:05.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.172+0000 7faac5840700 1 -- 172.21.15.80:0/134261761 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac0108a80 con 0x7faac013eb40 2019-11-28T11:29:05.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.172+0000 7faab7fff700 1 -- 172.21.15.80:0/134261761 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaa8005850 con 0x7faac013eb40 2019-11-28T11:29:05.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.172+0000 7faac5840700 1 -- 172.21.15.80:0/134261761 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac0108700 con 0x7faac013eb40 2019-11-28T11:29:05.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.172+0000 7faabf7fe700 1 --2- 172.21.15.80:0/134261761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faac013eb40 0x7faac010afc0 secure :-1 s=THROTTLE_DONE pgs=660 cs=0 l=1 rx=0x7faaa8010390 tx=0x7faaa8010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:05.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.172+0000 7faab7fff700 1 -- 172.21.15.80:0/134261761 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7faaa8005370 con 0x7faac013eb40 2019-11-28T11:29:05.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.172+0000 7faabf7fe700 1 --2- 172.21.15.80:0/134261761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faac013eb40 0x7faac010afc0 secure :-1 s=THROTTLE_DONE pgs=660 cs=0 l=1 rx=0x7faaa8010390 tx=0x7faaa8010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:05.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.172+0000 7faab7fff700 1 --2- 172.21.15.80:0/134261761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaa4018730 0x7faaa401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:05.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.172+0000 7faab7fff700 1 -- 172.21.15.80:0/134261761 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7faaa8031c50 con 0x7faac013eb40 2019-11-28T11:29:05.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.173+0000 7faabeffd700 1 --2- 172.21.15.80:0/134261761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaa4018730 0x7faaa401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:05.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.173+0000 7faabeffd700 1 --2- 172.21.15.80:0/134261761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaa4018730 0x7faaa401abc0 crc :-1 s=READY pgs=279 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:05.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.180+0000 7faac5840700 1 -- 172.21.15.80:0/134261761 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac0108a80 con 0x7faac013eb40 2019-11-28T11:29:05.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.183+0000 7faabf7fe700 1 --2- 172.21.15.80:0/134261761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faac013eb40 0x7faac010afc0 secure :-1 s=THROTTLE_DONE pgs=660 cs=0 l=1 rx=0x7faaa8010390 tx=0x7faaa8010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:05.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.183+0000 7faab7fff700 1 -- 172.21.15.80:0/134261761 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7faaa8007f90 con 0x7faac013eb40 2019-11-28T11:29:05.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.355+0000 7faac5840700 1 -- 172.21.15.80:0/134261761 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faac0108700 con 0x7faac013eb40 2019-11-28T11:29:05.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.355+0000 7faabf7fe700 1 --2- 172.21.15.80:0/134261761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faac013eb40 0x7faac010afc0 secure :-1 s=THROTTLE_DONE pgs=660 cs=0 l=1 rx=0x7faaa8010390 tx=0x7faaa8010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:05.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.355+0000 7faab7fff700 1 -- 172.21.15.80:0/134261761 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2443 (secure 0 0 0) 0x7faaa8005180 con 0x7faac013eb40 2019-11-28T11:29:05.386 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 30 2019-11-28T11:29:05.386 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:05.386 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5895,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/169206692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":169206692},{"type":"v1","addr":"172.21.15.80:6834","nonce":169206692}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":28},{"gid":5898,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/2970516164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":2970516164},{"type":"v1","addr":"172.21.15.80:6835","nonce":2970516164}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:54.163001+0000","modified":"2019-11-28T11:29:01.914204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5725},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5725":{"gid":5725,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2800771965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2800771965},{"type":"v1","addr":"172.21.15.174:6835","nonce":2800771965}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2019-11-28T11:29:05.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.358+0000 7faac5840700 1 -- 172.21.15.80:0/134261761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaa4018730 msgr2=0x7faaa401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:05.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.358+0000 7faac5840700 1 --2- 172.21.15.80:0/134261761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaa4018730 0x7faaa401abc0 crc :-1 s=READY pgs=279 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:05.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.358+0000 7faac5840700 1 -- 172.21.15.80:0/134261761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faac013eb40 msgr2=0x7faac010afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:05.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.358+0000 7faac5840700 1 --2- 172.21.15.80:0/134261761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faac013eb40 0x7faac010afc0 secure :-1 s=READY pgs=660 cs=0 l=1 rx=0x7faaa8010390 tx=0x7faaa8010210).stop 2019-11-28T11:29:05.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.358+0000 7faac5840700 1 -- 172.21.15.80:0/134261761 shutdown_connections 2019-11-28T11:29:05.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.358+0000 7faac5840700 1 --2- 172.21.15.80:0/134261761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaa4018730 0x7faaa401abc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:05.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.358+0000 7faac5840700 1 --2- 172.21.15.80:0/134261761 >> v2:172.21.15.174:3300/0 conn(0x7faac010b500 0x7faac01629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:05.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.358+0000 7faac5840700 1 --2- 172.21.15.80:0/134261761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faac013eb40 0x7faac010afc0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.358+0000 7faac5840700 1 -- 172.21.15.80:0/134261761 shutdown_connections 2019-11-28T11:29:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.358+0000 7faac5840700 1 -- 172.21.15.80:0/134261761 wait complete. 2019-11-28T11:29:05.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:05.358+0000 7faac5840700 1 -- 172.21.15.80:0/134261761 >> 172.21.15.80:0/134261761 conn(0x7faac011bfc0 msgr2=0x7faac0141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:05.699 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5725}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 8, u'failed': [], u'epoch': 30, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [9], u'info': {u'gid_5725': {u'export_targets': [], u'name': u'c', u'incarnation': 29, u'state_seq': 3, u'state': u'up:active', u'gid': 5725, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2800771965, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2800771965, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2800771965'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:28:54.163001+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:29:01.914204+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:29:05.700 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:29:05.700 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:29:05.826 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:29:05.827 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:29:05.827 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:29:05.827 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5725, 2019-11-28T11:29:05.827 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:29:05.827 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:29:05.827 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 4.8836611230000004, 2019-11-28T11:29:05.828 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 30, 2019-11-28T11:29:05.828 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 57, 2019-11-28T11:29:05.828 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 57, 2019-11-28T11:29:05.828 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 9.1650254550000003 2019-11-28T11:29:05.828 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:29:05.832 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5725, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.8836611230000004, "mdsmap_epoch": 30, "osdmap_epoch": 57, "osdmap_epoch_barrier": 57, "uptime": 9.1650254550000003 } 2019-11-28T11:29:05.832 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:29:05.832 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:29:05.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:29:05.833 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:29:05.901 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:29:05.902 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:29:06.022 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:29:06.023 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:29:06.023 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:29:06.023 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:29:06.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:29:06.023 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:29:06.092 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:29:06.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.183+0000 7fc4c15e5700 1 Processor -- start 2019-11-28T11:29:06.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.183+0000 7fc4c15e5700 1 -- start start 2019-11-28T11:29:06.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.184+0000 7fc4c15e5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc06c0a0 0x7fc4bc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:06.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.184+0000 7fc4c15e5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc06db00 con 0x7fc4bc0734e0 2019-11-28T11:29:06.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.184+0000 7fc4c15e5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc06e000 con 0x7fc4bc072620 2019-11-28T11:29:06.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.184+0000 7fc4c15e5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc06f330 con 0x7fc4bc06c0a0 2019-11-28T11:29:06.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4baffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc4bc0734e0 0x7fc4bc071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33574/0 (socket says 172.21.15.80:33574) 2019-11-28T11:29:06.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4baffd700 1 -- 172.21.15.80:0/4288042852 learned_addr learned my addr 172.21.15.80:0/4288042852 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:06.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4bb7fe700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc06c0a0 0x7fc4bc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4ba7fc700 1 -- 172.21.15.80:0/4288042852 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244839834 0 0) 0x7fc4a40013f0 con 0x7fc4bc0734e0 2019-11-28T11:29:06.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4ba7fc700 1 -- 172.21.15.80:0/4288042852 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4a8002e80 con 0x7fc4bc0734e0 2019-11-28T11:29:06.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4ba7fc700 1 -- 172.21.15.80:0/4288042852 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2555438814 0 0) 0x7fc4a40013d0 con 0x7fc4bc0734e0 2019-11-28T11:29:06.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4ba7fc700 1 -- 172.21.15.80:0/4288042852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc06c0a0 msgr2=0x7fc4bc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:06.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4ba7fc700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc06c0a0 0x7fc4bc072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:06.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4ba7fc700 1 -- 172.21.15.80:0/4288042852 >> v1:172.21.15.174:6789/0 conn(0x7fc4bc072620 legacy=0x7fc4bc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4ba7fc700 1 -- 172.21.15.80:0/4288042852 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc0706c0 con 0x7fc4bc0734e0 2019-11-28T11:29:06.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4ba7fc700 1 -- 172.21.15.80:0/4288042852 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc4a4001900 con 0x7fc4bc0734e0 2019-11-28T11:29:06.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4ba7fc700 1 -- 172.21.15.80:0/4288042852 >> v1:172.21.15.80:6789/0 conn(0x7fc4bc0734e0 legacy=0x7fc4bc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4ba7fc700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003ab0 0x7fc4a8005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:06.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4ba7fc700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4a8006690 0x7fc4a8008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:06.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4ba7fc700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4a8009380 0x7fc4a800b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:06.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4ba7fc700 1 -- 172.21.15.80:0/4288042852 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a800bfd0 con 0x7fc4a8003ab0 2019-11-28T11:29:06.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4ba7fc700 1 -- 172.21.15.80:0/4288042852 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a80501d0 con 0x7fc4a8006690 2019-11-28T11:29:06.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4ba7fc700 1 -- 172.21.15.80:0/4288042852 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a8050400 con 0x7fc4a8009380 2019-11-28T11:29:06.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4bb7fe700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003ab0 0x7fc4a8005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4baffd700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4a8006690 0x7fc4a8008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4bbfff700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4a8009380 0x7fc4a800b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4bb7fe700 1 -- 172.21.15.80:0/4288042852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4a8009380 msgr2=0x7fc4a800b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:06.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4bb7fe700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4a8009380 0x7fc4a800b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:06.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4bb7fe700 1 -- 172.21.15.80:0/4288042852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4a8006690 msgr2=0x7fc4a8008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:06.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4bb7fe700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4a8006690 0x7fc4a8008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:06.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4bb7fe700 1 -- 172.21.15.80:0/4288042852 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a80506b0 con 0x7fc4a8003ab0 2019-11-28T11:29:06.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.185+0000 7fc4baffd700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4a8006690 0x7fc4a8008b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:29:06.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.186+0000 7fc4bb7fe700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003ab0 0x7fc4a8005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc4b400b030 tx=0x7fc4b400b7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.186+0000 7fc4bb7fe700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003ab0 0x7fc4a8005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc4b400b030 tx=0x7fc4b400b7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.186+0000 7fc4bb7fe700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003ab0 0x7fc4a8005f10 secure :-1 s=READY pgs=662 cs=0 l=1 rx=0x7fc4b400b030 tx=0x7fc4b400b7c0).ready entity=mon.0 client_cookie=4be324be2b772d5c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:06.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.186+0000 7fc4bb7fe700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003ab0 0x7fc4a8005f10 secure :-1 s=THROTTLE_DONE pgs=662 cs=0 l=1 rx=0x7fc4b400b030 tx=0x7fc4b400b7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.186+0000 7fc4ba7fc700 1 -- 172.21.15.80:0/4288042852 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4b4005560 con 0x7fc4a8003ab0 2019-11-28T11:29:06.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.186+0000 7fc4bb7fe700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003ab0 0x7fc4a8005f10 secure :-1 s=THROTTLE_DONE pgs=662 cs=0 l=1 rx=0x7fc4b400b030 tx=0x7fc4b400b7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.186+0000 7fc4bb7fe700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003ab0 0x7fc4a8005f10 secure :-1 s=THROTTLE_DONE pgs=662 cs=0 l=1 rx=0x7fc4b400b030 tx=0x7fc4b400b7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.186+0000 7fc4ba7fc700 1 -- 172.21.15.80:0/4288042852 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b4005180 con 0x7fc4a8003ab0 2019-11-28T11:29:06.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.186+0000 7fc4ba7fc700 1 -- 172.21.15.80:0/4288042852 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4b4005560 con 0x7fc4a8003ab0 2019-11-28T11:29:06.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.186+0000 7fc4c15e5700 1 -- 172.21.15.80:0/4288042852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003ab0 msgr2=0x7fc4a8005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.186+0000 7fc4c15e5700 1 --2- 172.21.15.80:0/4288042852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4a8003ab0 0x7fc4a8005f10 secure :-1 s=READY pgs=662 cs=0 l=1 rx=0x7fc4b400b030 tx=0x7fc4b400b7c0).stop 2019-11-28T11:29:06.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.186+0000 7fc4bbfff700 1 -- 172.21.15.80:0/4288042852 reap_dead start 2019-11-28T11:29:06.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.186+0000 7fc4c15e5700 1 -- 172.21.15.80:0/4288042852 shutdown_connections 2019-11-28T11:29:06.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.186+0000 7fc4c15e5700 1 -- 172.21.15.80:0/4288042852 shutdown_connections 2019-11-28T11:29:06.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.186+0000 7fc4c15e5700 1 -- 172.21.15.80:0/4288042852 wait complete. 2019-11-28T11:29:06.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.186+0000 7fc4c15e5700 1 -- 172.21.15.80:0/4288042852 >> 172.21.15.80:0/4288042852 conn(0x7fc4bc061cf0 msgr2=0x7fc4bc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:06.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.189+0000 7fc4c15e5700 1 Processor -- start 2019-11-28T11:29:06.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.189+0000 7fc4c15e5700 1 -- start start 2019-11-28T11:29:06.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.190+0000 7fc4c15e5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc150f50 0x7fc4bc07b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:06.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.190+0000 7fc4c15e5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc0754d0 con 0x7fc4bc07bba0 2019-11-28T11:29:06.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.190+0000 7fc4c15e5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc12eb20 con 0x7fc4bc074d00 2019-11-28T11:29:06.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.190+0000 7fc4c15e5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc078980 con 0x7fc4bc150f50 2019-11-28T11:29:06.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.190+0000 7fc4bbfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc4bc07bba0 0x7fc4bc167c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33584/0 (socket says 172.21.15.80:33584) 2019-11-28T11:29:06.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.190+0000 7fc4bbfff700 1 -- 172.21.15.80:0/3708117144 learned_addr learned my addr 172.21.15.80:0/3708117144 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:06.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.190+0000 7fc4baffd700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc150f50 0x7fc4bc07b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.190+0000 7fc4b3fff700 1 -- 172.21.15.80:0/3708117144 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3459306436 0 0) 0x7fc4ac0010b0 con 0x7fc4bc07bba0 2019-11-28T11:29:06.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.190+0000 7fc4b3fff700 1 -- 172.21.15.80:0/3708117144 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4a0002e80 con 0x7fc4bc07bba0 2019-11-28T11:29:06.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.190+0000 7fc4b3fff700 1 -- 172.21.15.80:0/3708117144 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324945042 0 0) 0x7fc4b40053e0 con 0x7fc4bc074d00 2019-11-28T11:29:06.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.190+0000 7fc4b3fff700 1 -- 172.21.15.80:0/3708117144 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4a0004170 con 0x7fc4bc074d00 2019-11-28T11:29:06.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.190+0000 7fc4baffd700 1 -- 172.21.15.80:0/3708117144 >> v1:172.21.15.174:6789/0 conn(0x7fc4bc074d00 legacy=0x7fc4bc07aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.190+0000 7fc4baffd700 1 -- 172.21.15.80:0/3708117144 >> v1:172.21.15.80:6789/0 conn(0x7fc4bc07bba0 legacy=0x7fc4bc167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.190+0000 7fc4baffd700 1 -- 172.21.15.80:0/3708117144 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc0792e0 con 0x7fc4bc150f50 2019-11-28T11:29:06.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.190+0000 7fc4baffd700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc150f50 0x7fc4bc07b220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc4a40106b0 tx=0x7fc4a4010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.190+0000 7fc4baffd700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc150f50 0x7fc4bc07b220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc4a40106b0 tx=0x7fc4a4010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.191+0000 7fc4baffd700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc150f50 0x7fc4bc07b220 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7fc4a40106b0 tx=0x7fc4a4010a50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:06.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.191+0000 7fc4baffd700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc150f50 0x7fc4bc07b220 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fc4a40106b0 tx=0x7fc4a4010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.191+0000 7fc4b3fff700 1 -- 172.21.15.80:0/3708117144 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4a4001db0 con 0x7fc4bc150f50 2019-11-28T11:29:06.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.191+0000 7fc4baffd700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc150f50 0x7fc4bc07b220 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fc4a40106b0 tx=0x7fc4a4010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.191+0000 7fc4b3fff700 1 -- 172.21.15.80:0/3708117144 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a4004360 con 0x7fc4bc150f50 2019-11-28T11:29:06.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.191+0000 7fc4baffd700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc150f50 0x7fc4bc07b220 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fc4a40106b0 tx=0x7fc4a4010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.191+0000 7fc4b3fff700 1 -- 172.21.15.80:0/3708117144 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4a4004a70 con 0x7fc4bc150f50 2019-11-28T11:29:06.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.191+0000 7fc4c15e5700 1 -- 172.21.15.80:0/3708117144 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc079660 con 0x7fc4bc150f50 2019-11-28T11:29:06.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.191+0000 7fc4c15e5700 1 -- 172.21.15.80:0/3708117144 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc0792e0 con 0x7fc4bc150f50 2019-11-28T11:29:06.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.191+0000 7fc4baffd700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc150f50 0x7fc4bc07b220 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fc4a40106b0 tx=0x7fc4a4010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.191+0000 7fc4b3fff700 1 -- 172.21.15.80:0/3708117144 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc4a4004550 con 0x7fc4bc150f50 2019-11-28T11:29:06.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.191+0000 7fc4baffd700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc150f50 0x7fc4bc07b220 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fc4a40106b0 tx=0x7fc4a4010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.191+0000 7fc4b3fff700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4a0018750 0x7fc4a001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:06.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.191+0000 7fc4b3fff700 1 -- 172.21.15.80:0/3708117144 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc4a4031dc0 con 0x7fc4bc150f50 2019-11-28T11:29:06.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.192+0000 7fc4bb7fe700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4a0018750 0x7fc4a001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.192+0000 7fc4bb7fe700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4a0018750 0x7fc4a001abe0 crc :-1 s=READY pgs=280 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:06.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.199+0000 7fc4c15e5700 1 -- 172.21.15.80:0/3708117144 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4bc079660 con 0x7fc4bc150f50 2019-11-28T11:29:06.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.202+0000 7fc4baffd700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc150f50 0x7fc4bc07b220 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fc4a40106b0 tx=0x7fc4a4010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.202+0000 7fc4b3fff700 1 -- 172.21.15.80:0/3708117144 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc4a4000cc0 con 0x7fc4bc150f50 2019-11-28T11:29:06.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.379+0000 7fc4c15e5700 1 -- 172.21.15.80:0/3708117144 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4bc0792e0 con 0x7fc4bc150f50 2019-11-28T11:29:06.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.380+0000 7fc4baffd700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc150f50 0x7fc4bc07b220 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fc4a40106b0 tx=0x7fc4a4010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.381+0000 7fc4b3fff700 1 -- 172.21.15.80:0/3708117144 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+14857 (secure 0 0 0) 0x7fc4a401fbe0 con 0x7fc4bc150f50 2019-11-28T11:29:06.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.385+0000 7fc4c15e5700 1 -- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4a0018750 msgr2=0x7fc4a001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.385+0000 7fc4c15e5700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4a0018750 0x7fc4a001abe0 crc :-1 s=READY pgs=280 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:06.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.385+0000 7fc4c15e5700 1 -- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc150f50 msgr2=0x7fc4bc07b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.385+0000 7fc4c15e5700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc150f50 0x7fc4bc07b220 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7fc4a40106b0 tx=0x7fc4a4010a50).stop 2019-11-28T11:29:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.385+0000 7fc4c15e5700 1 -- 172.21.15.80:0/3708117144 shutdown_connections 2019-11-28T11:29:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.385+0000 7fc4c15e5700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc150f50 0x7fc4bc07b220 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.385+0000 7fc4c15e5700 1 --2- 172.21.15.80:0/3708117144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4a0018750 0x7fc4a001abe0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.385+0000 7fc4c15e5700 1 -- 172.21.15.80:0/3708117144 shutdown_connections 2019-11-28T11:29:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.385+0000 7fc4c15e5700 1 -- 172.21.15.80:0/3708117144 wait complete. 2019-11-28T11:29:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.385+0000 7fc4c15e5700 1 -- 172.21.15.80:0/3708117144 >> 172.21.15.80:0/3708117144 conn(0x7fc4bc13fa50 msgr2=0x7fc4bc07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:06.417 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:06.417 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":57,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:28:55.164436+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:28:52.545871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2019-11-28T11:28:53.180206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:29:06.426 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:28:52.545871+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 8, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'56', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:28:53.180206+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 9, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'57', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:29:06.426 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:29:06.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.519+0000 7f4dcd533700 1 Processor -- start 2019-11-28T11:29:06.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.519+0000 7f4dcd533700 1 -- start start 2019-11-28T11:29:06.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.520+0000 7f4dcd533700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4dc815ed10 0x7f4dc815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:06.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.520+0000 7f4dcd533700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4dc8073020 0x7f4dc8071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:06.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.520+0000 7f4dcd533700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc806db60 con 0x7f4dc80734b0 2019-11-28T11:29:06.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.520+0000 7f4dcd533700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc806f3d0 con 0x7f4dc8073020 2019-11-28T11:29:06.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.520+0000 7f4dcd533700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc806fe00 con 0x7f4dc815ed10 2019-11-28T11:29:06.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.520+0000 7f4dc7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4dc80734b0 0x7f4dc80723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33592/0 (socket says 172.21.15.80:33592) 2019-11-28T11:29:06.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.520+0000 7f4dc7fff700 1 -- 172.21.15.80:0/761448273 learned_addr learned my addr 172.21.15.80:0/761448273 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:06.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.520+0000 7f4dc77fe700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4dc815ed10 0x7f4dc815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.520+0000 7f4dc6ffd700 1 --2- 172.21.15.80:0/761448273 >> v2:172.21.15.174:3300/0 conn(0x7f4dc8073020 0x7f4dc8071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.520+0000 7f4dc67fc700 1 -- 172.21.15.80:0/761448273 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140072330 0 0) 0x7f4dc00014d0 con 0x7f4dc80734b0 2019-11-28T11:29:06.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 -- 172.21.15.80:0/761448273 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4db0002e80 con 0x7f4dc80734b0 2019-11-28T11:29:06.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 -- 172.21.15.80:0/761448273 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3578966397 0 0) 0x7f4dc00014b0 con 0x7f4dc80734b0 2019-11-28T11:29:06.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 -- 172.21.15.80:0/761448273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4dc815ed10 msgr2=0x7f4dc815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:06.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4dc815ed10 0x7f4dc815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:06.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 -- 172.21.15.80:0/761448273 >> v2:172.21.15.174:3300/0 conn(0x7f4dc8073020 msgr2=0x7f4dc8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:06.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 --2- 172.21.15.80:0/761448273 >> v2:172.21.15.174:3300/0 conn(0x7f4dc8073020 0x7f4dc8071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:06.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 -- 172.21.15.80:0/761448273 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc8070760 con 0x7f4dc80734b0 2019-11-28T11:29:06.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 -- 172.21.15.80:0/761448273 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f4dc0001a40 con 0x7f4dc80734b0 2019-11-28T11:29:06.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 -- 172.21.15.80:0/761448273 >> v1:172.21.15.80:6789/0 conn(0x7f4dc80734b0 legacy=0x7f4dc80723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db00479e0 0x7f4db0049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:06.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4db004a5c0 0x7f4db004ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:06.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4db004d260 0x7f4db004f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:06.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 -- 172.21.15.80:0/761448273 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db004ff40 con 0x7f4db00479e0 2019-11-28T11:29:06.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 -- 172.21.15.80:0/761448273 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db0050130 con 0x7f4db004d260 2019-11-28T11:29:06.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 -- 172.21.15.80:0/761448273 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db0050360 con 0x7f4db004a5c0 2019-11-28T11:29:06.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc77fe700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db00479e0 0x7f4db0049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc6ffd700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4db004a5c0 0x7f4db004ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc7fff700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4db004d260 0x7f4db004f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc77fe700 1 -- 172.21.15.80:0/761448273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4db004a5c0 msgr2=0x7f4db004ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc77fe700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4db004a5c0 0x7f4db004ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc77fe700 1 -- 172.21.15.80:0/761448273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4db004d260 msgr2=0x7f4db004f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc77fe700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4db004d260 0x7f4db004f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc77fe700 1 -- 172.21.15.80:0/761448273 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db0050610 con 0x7f4db00479e0 2019-11-28T11:29:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc7fff700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4db004d260 0x7f4db004f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:29:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc77fe700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db00479e0 0x7f4db0049e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4dbc002c70 tx=0x7f4dbc00f940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc77fe700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db00479e0 0x7f4db0049e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4dbc002c70 tx=0x7f4dbc00f940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc77fe700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db00479e0 0x7f4db0049e40 secure :-1 s=READY pgs=665 cs=0 l=1 rx=0x7f4dbc002c70 tx=0x7f4dbc00f940).ready entity=mon.0 client_cookie=116ba2d21d6eda39 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc77fe700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db00479e0 0x7f4db0049e40 secure :-1 s=THROTTLE_DONE pgs=665 cs=0 l=1 rx=0x7f4dbc002c70 tx=0x7f4dbc00f940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 -- 172.21.15.80:0/761448273 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dbc000960 con 0x7f4db00479e0 2019-11-28T11:29:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc77fe700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db00479e0 0x7f4db0049e40 secure :-1 s=THROTTLE_DONE pgs=665 cs=0 l=1 rx=0x7f4dbc002c70 tx=0x7f4dbc00f940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc77fe700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db00479e0 0x7f4db0049e40 secure :-1 s=THROTTLE_DONE pgs=665 cs=0 l=1 rx=0x7f4dbc002c70 tx=0x7f4dbc00f940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 -- 172.21.15.80:0/761448273 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc000e80 con 0x7f4db00479e0 2019-11-28T11:29:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.521+0000 7f4dc67fc700 1 -- 172.21.15.80:0/761448273 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dbc000960 con 0x7f4db00479e0 2019-11-28T11:29:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.522+0000 7f4dcd533700 1 -- 172.21.15.80:0/761448273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db00479e0 msgr2=0x7f4db0049e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.522+0000 7f4dcd533700 1 --2- 172.21.15.80:0/761448273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4db00479e0 0x7f4db0049e40 secure :-1 s=READY pgs=665 cs=0 l=1 rx=0x7f4dbc002c70 tx=0x7f4dbc00f940).stop 2019-11-28T11:29:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.522+0000 7f4dc7fff700 1 -- 172.21.15.80:0/761448273 reap_dead start 2019-11-28T11:29:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.522+0000 7f4dcd533700 1 -- 172.21.15.80:0/761448273 shutdown_connections 2019-11-28T11:29:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.522+0000 7f4dcd533700 1 -- 172.21.15.80:0/761448273 shutdown_connections 2019-11-28T11:29:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.522+0000 7f4dcd533700 1 -- 172.21.15.80:0/761448273 wait complete. 2019-11-28T11:29:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.522+0000 7f4dcd533700 1 -- 172.21.15.80:0/761448273 >> 172.21.15.80:0/761448273 conn(0x7f4dc8061d20 msgr2=0x7f4dc80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.525+0000 7f4dcd533700 1 Processor -- start 2019-11-28T11:29:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.525+0000 7f4dcd533700 1 -- start start 2019-11-28T11:29:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dcd533700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4dc81502e0 0x7f4dc8150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dcd533700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4dc8150cb0 0x7f4dc8167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dcd533700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc8133a20 con 0x7f4dc8108630 2019-11-28T11:29:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dcd533700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc8131980 con 0x7f4dc81502e0 2019-11-28T11:29:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dcd533700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc8131c50 con 0x7f4dc8150cb0 2019-11-28T11:29:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dc6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4dc81502e0 0x7f4dc8150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dc6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4dc81502e0 0x7f4dc8150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34288/0 (socket says 172.21.15.80:34288) 2019-11-28T11:29:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dc6ffd700 1 -- 172.21.15.80:0/260671633 learned_addr learned my addr 172.21.15.80:0/260671633 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dc7fff700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4dc8150cb0 0x7f4dc8167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dc6ffd700 1 -- 172.21.15.80:0/260671633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4dc8150cb0 msgr2=0x7f4dc8167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dc6ffd700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4dc8150cb0 0x7f4dc8167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dc6ffd700 1 -- 172.21.15.80:0/260671633 >> v1:172.21.15.174:6789/0 conn(0x7f4dc8108630 legacy=0x7f4dc8151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dc6ffd700 1 -- 172.21.15.80:0/260671633 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc81322e0 con 0x7f4dc81502e0 2019-11-28T11:29:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4daffff700 1 -- 172.21.15.80:0/260671633 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276344422 0 0) 0x7f4dbc002540 con 0x7f4dc8108630 2019-11-28T11:29:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dc6ffd700 1 --2- 172.21.15.80:0/260671633 >> v2:172.21.15.80:3300/0 conn(0x7f4dc81502e0 0x7f4dc8150770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4db8010450 tx=0x7f4db8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dc6ffd700 1 --2- 172.21.15.80:0/260671633 >> v2:172.21.15.80:3300/0 conn(0x7f4dc81502e0 0x7f4dc8150770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4db8010450 tx=0x7f4db8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dc6ffd700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc81502e0 0x7f4dc8150770 secure :-1 s=READY pgs=666 cs=0 l=1 rx=0x7f4db8010450 tx=0x7f4db8010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dc6ffd700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc81502e0 0x7f4dc8150770 secure :-1 s=THROTTLE_DONE pgs=666 cs=0 l=1 rx=0x7f4db8010450 tx=0x7f4db8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4daffff700 1 -- 172.21.15.80:0/260671633 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4db8000940 con 0x7f4dc81502e0 2019-11-28T11:29:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dc6ffd700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc81502e0 0x7f4dc8150770 secure :-1 s=THROTTLE_DONE pgs=666 cs=0 l=1 rx=0x7f4db8010450 tx=0x7f4db8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dc6ffd700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc81502e0 0x7f4dc8150770 secure :-1 s=THROTTLE_DONE pgs=666 cs=0 l=1 rx=0x7f4db8010450 tx=0x7f4db8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4daffff700 1 -- 172.21.15.80:0/260671633 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db8005580 con 0x7f4dc81502e0 2019-11-28T11:29:06.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dcd533700 1 -- 172.21.15.80:0/260671633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc8132660 con 0x7f4dc81502e0 2019-11-28T11:29:06.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4daffff700 1 -- 172.21.15.80:0/260671633 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4db8005bd0 con 0x7f4dc81502e0 2019-11-28T11:29:06.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.526+0000 7f4dcd533700 1 -- 172.21.15.80:0/260671633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc81322e0 con 0x7f4dc81502e0 2019-11-28T11:29:06.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.527+0000 7f4dc6ffd700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc81502e0 0x7f4dc8150770 secure :-1 s=THROTTLE_DONE pgs=666 cs=0 l=1 rx=0x7f4db8010450 tx=0x7f4db8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.527+0000 7f4daffff700 1 -- 172.21.15.80:0/260671633 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4db8005180 con 0x7f4dc81502e0 2019-11-28T11:29:06.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.527+0000 7f4dc6ffd700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc81502e0 0x7f4dc8150770 secure :-1 s=THROTTLE_DONE pgs=666 cs=0 l=1 rx=0x7f4db8010450 tx=0x7f4db8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.527+0000 7f4daffff700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4da8018730 0x7f4da801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:06.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.527+0000 7f4daffff700 1 -- 172.21.15.80:0/260671633 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4db8031b30 con 0x7f4dc81502e0 2019-11-28T11:29:06.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.527+0000 7f4dc77fe700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4da8018730 0x7f4da801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.527+0000 7f4dc77fe700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4da8018730 0x7f4da801abc0 crc :-1 s=READY pgs=281 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:06.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.535+0000 7f4dcd533700 1 -- 172.21.15.80:0/260671633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc8132660 con 0x7f4dc81502e0 2019-11-28T11:29:06.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.538+0000 7f4dc6ffd700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc81502e0 0x7f4dc8150770 secure :-1 s=THROTTLE_DONE pgs=666 cs=0 l=1 rx=0x7f4db8010450 tx=0x7f4db8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.538+0000 7f4daffff700 1 -- 172.21.15.80:0/260671633 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4db80060a0 con 0x7f4dc81502e0 2019-11-28T11:29:06.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.706+0000 7f4dcd533700 1 -- 172.21.15.80:0/260671633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f4dc81322e0 con 0x7f4dc81502e0 2019-11-28T11:29:06.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.706+0000 7f4dc6ffd700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc81502e0 0x7f4dc8150770 secure :-1 s=THROTTLE_DONE pgs=666 cs=0 l=1 rx=0x7f4db8010450 tx=0x7f4db8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.706+0000 7f4daffff700 1 -- 172.21.15.80:0/260671633 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4db8005180 con 0x7f4dc81502e0 2019-11-28T11:29:06.737 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:29:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.709+0000 7f4dcd533700 1 -- 172.21.15.80:0/260671633 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4da8018730 msgr2=0x7f4da801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.709+0000 7f4dcd533700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4da8018730 0x7f4da801abc0 crc :-1 s=READY pgs=281 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.709+0000 7f4dcd533700 1 -- 172.21.15.80:0/260671633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc81502e0 msgr2=0x7f4dc8150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.709+0000 7f4dcd533700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc81502e0 0x7f4dc8150770 secure :-1 s=READY pgs=666 cs=0 l=1 rx=0x7f4db8010450 tx=0x7f4db8010280).stop 2019-11-28T11:29:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.709+0000 7f4dcd533700 1 -- 172.21.15.80:0/260671633 shutdown_connections 2019-11-28T11:29:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.709+0000 7f4dcd533700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4dc8150cb0 0x7f4dc8167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:06.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.709+0000 7f4dcd533700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc81502e0 0x7f4dc8150770 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:06.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.709+0000 7f4dcd533700 1 --2- 172.21.15.80:0/260671633 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4da8018730 0x7f4da801abc0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:06.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.709+0000 7f4dcd533700 1 -- 172.21.15.80:0/260671633 shutdown_connections 2019-11-28T11:29:06.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.709+0000 7f4dcd533700 1 -- 172.21.15.80:0/260671633 wait complete. 2019-11-28T11:29:06.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.709+0000 7f4dcd533700 1 -- 172.21.15.80:0/260671633 >> 172.21.15.80:0/260671633 conn(0x7f4dc814dbb0 msgr2=0x7f4dc8142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:06.749 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:29:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.851+0000 7ffb94d69700 1 Processor -- start 2019-11-28T11:29:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.851+0000 7ffb94d69700 1 -- start start 2019-11-28T11:29:06.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.852+0000 7ffb94d69700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffb9015f100 0x7ffb9006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:06.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.852+0000 7ffb94d69700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb9006c2f0 0x7ffb9006c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:06.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.852+0000 7ffb94d69700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9006db60 con 0x7ffb9015ed10 2019-11-28T11:29:06.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.852+0000 7ffb94d69700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9006fe00 con 0x7ffb9015f100 2019-11-28T11:29:06.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.852+0000 7ffb94d69700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900700d0 con 0x7ffb9006c2f0 2019-11-28T11:29:06.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb9006c2f0 0x7ffb9006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8e59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffb9015f100 0x7ffb9006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8e59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffb9015f100 0x7ffb9006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:49184/0 (socket says 172.21.15.80:49184) 2019-11-28T11:29:06.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb9006c2f0 0x7ffb9006c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:36556/0 (socket says 172.21.15.80:36556) 2019-11-28T11:29:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8e59c700 1 -- 172.21.15.80:0/3346233672 learned_addr learned my addr 172.21.15.80:0/3346233672 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8f59e700 1 -- 172.21.15.80:0/3346233672 >> v2:172.21.15.174:3300/0 conn(0x7ffb9015f100 msgr2=0x7ffb9006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3346233672 >> v2:172.21.15.174:3300/0 conn(0x7ffb9015f100 0x7ffb9006bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:06.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8f59e700 1 -- 172.21.15.80:0/3346233672 >> v1:172.21.15.174:6789/0 conn(0x7ffb9015ed10 legacy=0x7ffb90073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8f59e700 1 -- 172.21.15.80:0/3346233672 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb90070760 con 0x7ffb9006c2f0 2019-11-28T11:29:06.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8e59c700 1 --2- 172.21.15.80:0/3346233672 >> v2:172.21.15.174:3300/0 conn(0x7ffb9015f100 0x7ffb9006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:06.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3346233672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb9006c2f0 0x7ffb9006c740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffb8800b300 tx=0x7ffb8800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3346233672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb9006c2f0 0x7ffb9006c740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffb8800b300 tx=0x7ffb8800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3346233672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb9006c2f0 0x7ffb9006c740 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7ffb8800b300 tx=0x7ffb8800bb10).ready entity=mon.2 client_cookie=c266526f8dc63aa0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3346233672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb9006c2f0 0x7ffb9006c740 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7ffb8800b300 tx=0x7ffb8800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3346233672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb9006c2f0 0x7ffb9006c740 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7ffb8800b300 tx=0x7ffb8800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8dd9b700 1 -- 172.21.15.80:0/3346233672 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb88000f40 con 0x7ffb9006c2f0 2019-11-28T11:29:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3346233672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb9006c2f0 0x7ffb9006c740 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7ffb8800b300 tx=0x7ffb8800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8dd9b700 1 -- 172.21.15.80:0/3346233672 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb88009b70 con 0x7ffb9006c2f0 2019-11-28T11:29:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb8dd9b700 1 -- 172.21.15.80:0/3346233672 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb8800a240 con 0x7ffb9006c2f0 2019-11-28T11:29:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb94d69700 1 -- 172.21.15.80:0/3346233672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb9006c2f0 msgr2=0x7ffb9006c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.853+0000 7ffb94d69700 1 --2- 172.21.15.80:0/3346233672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb9006c2f0 0x7ffb9006c740 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7ffb8800b300 tx=0x7ffb8800bb10).stop 2019-11-28T11:29:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.854+0000 7ffb94d69700 1 -- 172.21.15.80:0/3346233672 shutdown_connections 2019-11-28T11:29:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.854+0000 7ffb94d69700 1 --2- 172.21.15.80:0/3346233672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb9006c2f0 0x7ffb9006c740 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.854+0000 7ffb94d69700 1 --2- 172.21.15.80:0/3346233672 >> v2:172.21.15.174:3300/0 conn(0x7ffb9015f100 0x7ffb9006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:06.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.854+0000 7ffb94d69700 1 -- 172.21.15.80:0/3346233672 shutdown_connections 2019-11-28T11:29:06.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.854+0000 7ffb94d69700 1 -- 172.21.15.80:0/3346233672 wait complete. 2019-11-28T11:29:06.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.854+0000 7ffb94d69700 1 -- 172.21.15.80:0/3346233672 >> 172.21.15.80:0/3346233672 conn(0x7ffb90061d20 msgr2=0x7ffb900641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.857+0000 7ffb94d69700 1 Processor -- start 2019-11-28T11:29:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.857+0000 7ffb94d69700 1 -- start start 2019-11-28T11:29:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.857+0000 7ffb94d69700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb901079b0 0x7ffb90107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.857+0000 7ffb94d69700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffb90108380 0x7ffb90168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.857+0000 7ffb94d69700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb901087d0 con 0x7ffb90148320 2019-11-28T11:29:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.857+0000 7ffb94d69700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9013aa20 con 0x7ffb90108380 2019-11-28T11:29:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.857+0000 7ffb94d69700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9013acf0 con 0x7ffb901079b0 2019-11-28T11:29:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb8ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ffb90148320 0x7ffb9010ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33616/0 (socket says 172.21.15.80:33616) 2019-11-28T11:29:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb8ed9d700 1 -- 172.21.15.80:0/3874415424 learned_addr learned my addr 172.21.15.80:0/3874415424 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3874415424 >> v2:172.21.15.80:3300/0 conn(0x7ffb90108380 0x7ffb90168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb8e59c700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb901079b0 0x7ffb90107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb877fe700 1 -- 172.21.15.80:0/3874415424 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869665869 0 0) 0x7ffb80001150 con 0x7ffb90148320 2019-11-28T11:29:06.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb877fe700 1 -- 172.21.15.80:0/3874415424 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb74002e80 con 0x7ffb90148320 2019-11-28T11:29:06.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb8f59e700 1 -- 172.21.15.80:0/3874415424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb901079b0 msgr2=0x7ffb90107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb901079b0 0x7ffb90107e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb8f59e700 1 -- 172.21.15.80:0/3874415424 >> v1:172.21.15.80:6789/0 conn(0x7ffb90148320 legacy=0x7ffb9010ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb8f59e700 1 -- 172.21.15.80:0/3874415424 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9010c490 con 0x7ffb90108380 2019-11-28T11:29:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3874415424 >> v2:172.21.15.80:3300/0 conn(0x7ffb90108380 0x7ffb90168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb88010710 tx=0x7ffb880105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3874415424 >> v2:172.21.15.80:3300/0 conn(0x7ffb90108380 0x7ffb90168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb88010710 tx=0x7ffb880105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb90108380 0x7ffb90168d80 secure :-1 s=READY pgs=668 cs=0 l=1 rx=0x7ffb88010710 tx=0x7ffb880105c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:06.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb90108380 0x7ffb90168d80 secure :-1 s=THROTTLE_DONE pgs=668 cs=0 l=1 rx=0x7ffb88010710 tx=0x7ffb880105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb877fe700 1 -- 172.21.15.80:0/3874415424 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb88009d10 con 0x7ffb90108380 2019-11-28T11:29:06.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb90108380 0x7ffb90168d80 secure :-1 s=THROTTLE_DONE pgs=668 cs=0 l=1 rx=0x7ffb88010710 tx=0x7ffb880105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb94d69700 1 -- 172.21.15.80:0/3874415424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9010c810 con 0x7ffb90108380 2019-11-28T11:29:06.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb877fe700 1 -- 172.21.15.80:0/3874415424 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb88002f60 con 0x7ffb90108380 2019-11-28T11:29:06.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb90108380 0x7ffb90168d80 secure :-1 s=THROTTLE_DONE pgs=668 cs=0 l=1 rx=0x7ffb88010710 tx=0x7ffb880105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb877fe700 1 -- 172.21.15.80:0/3874415424 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb88009ed0 con 0x7ffb90108380 2019-11-28T11:29:06.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.858+0000 7ffb94d69700 1 -- 172.21.15.80:0/3874415424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9010c490 con 0x7ffb90108380 2019-11-28T11:29:06.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.859+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb90108380 0x7ffb90168d80 secure :-1 s=THROTTLE_DONE pgs=668 cs=0 l=1 rx=0x7ffb88010710 tx=0x7ffb880105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.859+0000 7ffb877fe700 1 -- 172.21.15.80:0/3874415424 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ffb88009dd0 con 0x7ffb90108380 2019-11-28T11:29:06.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.859+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb90108380 0x7ffb90168d80 secure :-1 s=THROTTLE_DONE pgs=668 cs=0 l=1 rx=0x7ffb88010710 tx=0x7ffb880105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.859+0000 7ffb877fe700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffb74018770 0x7ffb7401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:06.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.859+0000 7ffb877fe700 1 -- 172.21.15.80:0/3874415424 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ffb88031d90 con 0x7ffb90108380 2019-11-28T11:29:06.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.860+0000 7ffb8ed9d700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffb74018770 0x7ffb7401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:06.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.860+0000 7ffb8ed9d700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffb74018770 0x7ffb7401abe0 crc :-1 s=READY pgs=282 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:06.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.866+0000 7ffb94d69700 1 -- 172.21.15.80:0/3874415424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb9010c810 con 0x7ffb90108380 2019-11-28T11:29:06.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.870+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb90108380 0x7ffb90168d80 secure :-1 s=THROTTLE_DONE pgs=668 cs=0 l=1 rx=0x7ffb88010710 tx=0x7ffb880105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:06.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:06.870+0000 7ffb877fe700 1 -- 172.21.15.80:0/3874415424 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ffb88009aa0 con 0x7ffb90108380 2019-11-28T11:29:07.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.039+0000 7ffb94d69700 1 -- 172.21.15.80:0/3874415424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7ffb9010c490 con 0x7ffb90108380 2019-11-28T11:29:07.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.039+0000 7ffb8f59e700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb90108380 0x7ffb90168d80 secure :-1 s=THROTTLE_DONE pgs=668 cs=0 l=1 rx=0x7ffb88010710 tx=0x7ffb880105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.039+0000 7ffb877fe700 1 -- 172.21.15.80:0/3874415424 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v57) v1 ==== 104+0+10 (secure 0 0 0) 0x7ffb88009cb0 con 0x7ffb90108380 2019-11-28T11:29:07.069 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:29:07.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.042+0000 7ffb94d69700 1 -- 172.21.15.80:0/3874415424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffb74018770 msgr2=0x7ffb7401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:07.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.042+0000 7ffb94d69700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffb74018770 0x7ffb7401abe0 crc :-1 s=READY pgs=282 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:07.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.042+0000 7ffb94d69700 1 -- 172.21.15.80:0/3874415424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb90108380 msgr2=0x7ffb90168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:07.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.042+0000 7ffb94d69700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb90108380 0x7ffb90168d80 secure :-1 s=READY pgs=668 cs=0 l=1 rx=0x7ffb88010710 tx=0x7ffb880105c0).stop 2019-11-28T11:29:07.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.042+0000 7ffb94d69700 1 -- 172.21.15.80:0/3874415424 shutdown_connections 2019-11-28T11:29:07.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.042+0000 7ffb94d69700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffb74018770 0x7ffb7401abe0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:07.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.042+0000 7ffb94d69700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb90108380 0x7ffb90168d80 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:07.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.042+0000 7ffb94d69700 1 --2- 172.21.15.80:0/3874415424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb901079b0 0x7ffb90107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:07.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.042+0000 7ffb94d69700 1 -- 172.21.15.80:0/3874415424 shutdown_connections 2019-11-28T11:29:07.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.042+0000 7ffb94d69700 1 -- 172.21.15.80:0/3874415424 wait complete. 2019-11-28T11:29:07.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.042+0000 7ffb94d69700 1 -- 172.21.15.80:0/3874415424 >> 172.21.15.80:0/3874415424 conn(0x7ffb9015e2d0 msgr2=0x7ffb90147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:07.081 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:29:07.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.174+0000 7f832256a700 1 Processor -- start 2019-11-28T11:29:07.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.174+0000 7f832256a700 1 -- start start 2019-11-28T11:29:07.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.175+0000 7f832256a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f831c15ed10 0x7f831c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.175+0000 7f832256a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f831c0734b0 0x7f831c0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.175+0000 7f832256a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831c06db60 con 0x7f831c073020 2019-11-28T11:29:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.175+0000 7f832256a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c06fe00 con 0x7f831c0734b0 2019-11-28T11:29:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.175+0000 7f832256a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c0700d0 con 0x7f831c15ed10 2019-11-28T11:29:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f8321308700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f831c0734b0 0x7f831c0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f8321308700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f831c0734b0 0x7f831c0726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34308/0 (socket says 172.21.15.80:34308) 2019-11-28T11:29:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f8321308700 1 -- 172.21.15.80:0/2782445363 learned_addr learned my addr 172.21.15.80:0/2782445363 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f8320b07700 1 --2- 172.21.15.80:0/2782445363 >> v2:172.21.15.174:3300/0 conn(0x7f831c15ed10 0x7f831c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:07.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f8321308700 1 -- 172.21.15.80:0/2782445363 >> v2:172.21.15.174:3300/0 conn(0x7f831c15ed10 msgr2=0x7f831c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:07.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f8321308700 1 --2- 172.21.15.80:0/2782445363 >> v2:172.21.15.174:3300/0 conn(0x7f831c15ed10 0x7f831c15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:07.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f8321308700 1 -- 172.21.15.80:0/2782445363 >> v1:172.21.15.80:6789/0 conn(0x7f831c073020 legacy=0x7f831c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:07.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f831b7fe700 1 -- 172.21.15.80:0/2782445363 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537489658 0 0) 0x7f830c001100 con 0x7f831c073020 2019-11-28T11:29:07.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f8321308700 1 -- 172.21.15.80:0/2782445363 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c070760 con 0x7f831c0734b0 2019-11-28T11:29:07.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f8320b07700 1 --2- 172.21.15.80:0/2782445363 >> v2:172.21.15.174:3300/0 conn(0x7f831c15ed10 0x7f831c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:29:07.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f8321308700 1 --2- 172.21.15.80:0/2782445363 >> v2:172.21.15.80:3300/0 conn(0x7f831c0734b0 0x7f831c0726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f831400fab0 tx=0x7f831400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f8321308700 1 --2- 172.21.15.80:0/2782445363 >> v2:172.21.15.80:3300/0 conn(0x7f831c0734b0 0x7f831c0726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f831400fab0 tx=0x7f831400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f8321308700 1 --2- 172.21.15.80:0/2782445363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c0734b0 0x7f831c0726a0 secure :-1 s=READY pgs=670 cs=0 l=1 rx=0x7f831400fab0 tx=0x7f831400fe50).ready entity=mon.0 client_cookie=a958ebaef451687c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:07.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f8321308700 1 --2- 172.21.15.80:0/2782445363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c0734b0 0x7f831c0726a0 secure :-1 s=THROTTLE_DONE pgs=670 cs=0 l=1 rx=0x7f831400fab0 tx=0x7f831400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f831b7fe700 1 -- 172.21.15.80:0/2782445363 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8314000f10 con 0x7f831c0734b0 2019-11-28T11:29:07.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f8321308700 1 --2- 172.21.15.80:0/2782445363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c0734b0 0x7f831c0726a0 secure :-1 s=THROTTLE_DONE pgs=670 cs=0 l=1 rx=0x7f831400fab0 tx=0x7f831400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f8321308700 1 --2- 172.21.15.80:0/2782445363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c0734b0 0x7f831c0726a0 secure :-1 s=THROTTLE_DONE pgs=670 cs=0 l=1 rx=0x7f831400fab0 tx=0x7f831400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f831b7fe700 1 -- 172.21.15.80:0/2782445363 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8314001460 con 0x7f831c0734b0 2019-11-28T11:29:07.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f831b7fe700 1 -- 172.21.15.80:0/2782445363 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8314001bb0 con 0x7f831c0734b0 2019-11-28T11:29:07.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f832256a700 1 -- 172.21.15.80:0/2782445363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c0734b0 msgr2=0x7f831c0726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:07.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.176+0000 7f832256a700 1 --2- 172.21.15.80:0/2782445363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c0734b0 0x7f831c0726a0 secure :-1 s=READY pgs=670 cs=0 l=1 rx=0x7f831400fab0 tx=0x7f831400fe50).stop 2019-11-28T11:29:07.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.177+0000 7f832256a700 1 -- 172.21.15.80:0/2782445363 shutdown_connections 2019-11-28T11:29:07.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.177+0000 7f832256a700 1 --2- 172.21.15.80:0/2782445363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c0734b0 0x7f831c0726a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:07.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.177+0000 7f832256a700 1 --2- 172.21.15.80:0/2782445363 >> v2:172.21.15.174:3300/0 conn(0x7f831c15ed10 0x7f831c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:07.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.177+0000 7f832256a700 1 -- 172.21.15.80:0/2782445363 shutdown_connections 2019-11-28T11:29:07.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.177+0000 7f832256a700 1 -- 172.21.15.80:0/2782445363 wait complete. 2019-11-28T11:29:07.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.177+0000 7f832256a700 1 -- 172.21.15.80:0/2782445363 >> 172.21.15.80:0/2782445363 conn(0x7f831c061d20 msgr2=0x7f831c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:07.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.179+0000 7f832256a700 1 Processor -- start 2019-11-28T11:29:07.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.179+0000 7f832256a700 1 -- start start 2019-11-28T11:29:07.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.180+0000 7f832256a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f831c1079b0 0x7f831c107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:07.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.180+0000 7f832256a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831c148e00 con 0x7f831c148320 2019-11-28T11:29:07.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.180+0000 7f832256a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831c108b10 con 0x7f831c108380 2019-11-28T11:29:07.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.180+0000 7f832256a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c13aa20 con 0x7f831c1079b0 2019-11-28T11:29:07.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f831bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f831c1079b0 0x7f831c107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:07.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f8320b07700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f831c148320 0x7f831c10ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33628/0 (socket says 172.21.15.80:33628) 2019-11-28T11:29:07.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f8320b07700 1 -- 172.21.15.80:0/3673171854 learned_addr learned my addr 172.21.15.80:0/3673171854 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:07.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f831bfff700 1 -- 172.21.15.80:0/3673171854 >> v1:172.21.15.174:6789/0 conn(0x7f831c108380 legacy=0x7f831c168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:07.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f831bfff700 1 -- 172.21.15.80:0/3673171854 >> v1:172.21.15.80:6789/0 conn(0x7f831c148320 legacy=0x7f831c10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:07.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f831bfff700 1 -- 172.21.15.80:0/3673171854 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c10c490 con 0x7f831c1079b0 2019-11-28T11:29:07.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f83197fa700 1 -- 172.21.15.80:0/3673171854 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742531940 0 0) 0x7f8304009c90 con 0x7f831c148320 2019-11-28T11:29:07.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f831bfff700 1 --2- 172.21.15.80:0/3673171854 >> v2:172.21.15.80:3300/0 conn(0x7f831c1079b0 0x7f831c107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f830c010350 tx=0x7f830c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f831bfff700 1 --2- 172.21.15.80:0/3673171854 >> v2:172.21.15.80:3300/0 conn(0x7f831c1079b0 0x7f831c107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f830c010350 tx=0x7f830c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f831bfff700 1 --2- 172.21.15.80:0/3673171854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c1079b0 0x7f831c107e40 secure :-1 s=READY pgs=672 cs=0 l=1 rx=0x7f830c010350 tx=0x7f830c0106f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:07.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f831bfff700 1 --2- 172.21.15.80:0/3673171854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c1079b0 0x7f831c107e40 secure :-1 s=THROTTLE_DONE pgs=672 cs=0 l=1 rx=0x7f830c010350 tx=0x7f830c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f83197fa700 1 -- 172.21.15.80:0/3673171854 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f830c000ce0 con 0x7f831c1079b0 2019-11-28T11:29:07.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f831bfff700 1 --2- 172.21.15.80:0/3673171854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c1079b0 0x7f831c107e40 secure :-1 s=THROTTLE_DONE pgs=672 cs=0 l=1 rx=0x7f830c010350 tx=0x7f830c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f83197fa700 1 -- 172.21.15.80:0/3673171854 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c00dd80 con 0x7f831c1079b0 2019-11-28T11:29:07.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f831bfff700 1 --2- 172.21.15.80:0/3673171854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c1079b0 0x7f831c107e40 secure :-1 s=THROTTLE_DONE pgs=672 cs=0 l=1 rx=0x7f830c010350 tx=0x7f830c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f832256a700 1 -- 172.21.15.80:0/3673171854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831c10c810 con 0x7f831c1079b0 2019-11-28T11:29:07.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f83197fa700 1 -- 172.21.15.80:0/3673171854 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f830c00df70 con 0x7f831c1079b0 2019-11-28T11:29:07.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f832256a700 1 -- 172.21.15.80:0/3673171854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c108820 con 0x7f831c1079b0 2019-11-28T11:29:07.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.181+0000 7f831bfff700 1 --2- 172.21.15.80:0/3673171854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c1079b0 0x7f831c107e40 secure :-1 s=THROTTLE_DONE pgs=672 cs=0 l=1 rx=0x7f830c010350 tx=0x7f830c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.182+0000 7f83197fa700 1 -- 172.21.15.80:0/3673171854 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f830c00df70 con 0x7f831c1079b0 2019-11-28T11:29:07.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.182+0000 7f831bfff700 1 --2- 172.21.15.80:0/3673171854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c1079b0 0x7f831c107e40 secure :-1 s=THROTTLE_DONE pgs=672 cs=0 l=1 rx=0x7f830c010350 tx=0x7f830c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.182+0000 7f83197fa700 1 --2- 172.21.15.80:0/3673171854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8300018730 0x7f830001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:07.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.182+0000 7f83197fa700 1 -- 172.21.15.80:0/3673171854 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f830c031a20 con 0x7f831c1079b0 2019-11-28T11:29:07.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.182+0000 7f8320b07700 1 --2- 172.21.15.80:0/3673171854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8300018730 0x7f830001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:07.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.182+0000 7f8320b07700 1 --2- 172.21.15.80:0/3673171854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8300018730 0x7f830001abc0 crc :-1 s=READY pgs=283 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:07.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.190+0000 7f832256a700 1 -- 172.21.15.80:0/3673171854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831c10c490 con 0x7f831c1079b0 2019-11-28T11:29:07.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.193+0000 7f831bfff700 1 --2- 172.21.15.80:0/3673171854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c1079b0 0x7f831c107e40 secure :-1 s=THROTTLE_DONE pgs=672 cs=0 l=1 rx=0x7f830c010350 tx=0x7f830c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.193+0000 7f83197fa700 1 -- 172.21.15.80:0/3673171854 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f830c00d980 con 0x7f831c1079b0 2019-11-28T11:29:07.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.359+0000 7f832256a700 1 -- 172.21.15.80:0/3673171854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f831c10c810 con 0x7f831c1079b0 2019-11-28T11:29:07.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.359+0000 7f831bfff700 1 --2- 172.21.15.80:0/3673171854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c1079b0 0x7f831c107e40 secure :-1 s=THROTTLE_DONE pgs=672 cs=0 l=1 rx=0x7f830c010350 tx=0x7f830c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.359+0000 7f83197fa700 1 -- 172.21.15.80:0/3673171854 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v57) v1 ==== 100+0+10 (secure 0 0 0) 0x7f830c00df50 con 0x7f831c1079b0 2019-11-28T11:29:07.390 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:29:07.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.362+0000 7f832256a700 1 -- 172.21.15.80:0/3673171854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8300018730 msgr2=0x7f830001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:07.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.362+0000 7f832256a700 1 --2- 172.21.15.80:0/3673171854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8300018730 0x7f830001abc0 crc :-1 s=READY pgs=283 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:07.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.362+0000 7f832256a700 1 -- 172.21.15.80:0/3673171854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c1079b0 msgr2=0x7f831c107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:07.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.362+0000 7f832256a700 1 --2- 172.21.15.80:0/3673171854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c1079b0 0x7f831c107e40 secure :-1 s=READY pgs=672 cs=0 l=1 rx=0x7f830c010350 tx=0x7f830c0106f0).stop 2019-11-28T11:29:07.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.362+0000 7f832256a700 1 -- 172.21.15.80:0/3673171854 shutdown_connections 2019-11-28T11:29:07.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.362+0000 7f832256a700 1 --2- 172.21.15.80:0/3673171854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8300018730 0x7f830001abc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:07.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.362+0000 7f832256a700 1 --2- 172.21.15.80:0/3673171854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f831c1079b0 0x7f831c107e40 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:07.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.362+0000 7f832256a700 1 -- 172.21.15.80:0/3673171854 shutdown_connections 2019-11-28T11:29:07.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.362+0000 7f832256a700 1 -- 172.21.15.80:0/3673171854 wait complete. 2019-11-28T11:29:07.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.362+0000 7f832256a700 1 -- 172.21.15.80:0/3673171854 >> 172.21.15.80:0/3673171854 conn(0x7f831c15e2d0 msgr2=0x7f831c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:07.402 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:29:07.403 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:07.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.503+0000 7f70f1e01700 1 Processor -- start 2019-11-28T11:29:07.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.503+0000 7f70f1e01700 1 -- start start 2019-11-28T11:29:07.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.504+0000 7f70f1e01700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70ec06c0a0 0x7f70ec072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:07.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.504+0000 7f70f1e01700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f70ec072620 0x7f70ec164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:07.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.504+0000 7f70f1e01700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec06db00 con 0x7f70ec0734e0 2019-11-28T11:29:07.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.504+0000 7f70f1e01700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ec06f330 con 0x7f70ec072620 2019-11-28T11:29:07.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.504+0000 7f70f1e01700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec0706c0 con 0x7f70ec06c0a0 2019-11-28T11:29:07.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.504+0000 7f70e3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f70ec0734e0 0x7f70ec071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33636/0 (socket says 172.21.15.80:33636) 2019-11-28T11:29:07.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.504+0000 7f70e3fff700 1 -- 172.21.15.80:0/765526438 learned_addr learned my addr 172.21.15.80:0/765526438 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:07.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.504+0000 7f70ebfff700 1 --2- 172.21.15.80:0/765526438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70ec06c0a0 0x7f70ec072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:07.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.504+0000 7f70f0b9f700 1 --2- 172.21.15.80:0/765526438 >> v2:172.21.15.174:3300/0 conn(0x7f70ec072620 0x7f70ec164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:07.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70eb7fe700 1 -- 172.21.15.80:0/765526438 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648624236 0 0) 0x7f70d4001150 con 0x7f70ec0734e0 2019-11-28T11:29:07.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70eb7fe700 1 -- 172.21.15.80:0/765526438 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70d8002e80 con 0x7f70ec0734e0 2019-11-28T11:29:07.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70f0b9f700 1 -- 172.21.15.80:0/765526438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70ec06c0a0 msgr2=0x7f70ec072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:07.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70f0b9f700 1 --2- 172.21.15.80:0/765526438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70ec06c0a0 0x7f70ec072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:07.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70f0b9f700 1 -- 172.21.15.80:0/765526438 >> v1:172.21.15.80:6789/0 conn(0x7f70ec0734e0 legacy=0x7f70ec071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:07.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70eb7fe700 1 -- 172.21.15.80:0/765526438 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 256584930 0 0) 0x7f70d4001130 con 0x7f70ec0734e0 2019-11-28T11:29:07.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70f0b9f700 1 -- 172.21.15.80:0/765526438 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec070a40 con 0x7f70ec072620 2019-11-28T11:29:07.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70ebfff700 1 --2- 172.21.15.80:0/765526438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70ec06c0a0 0x7f70ec072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:07.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70f0b9f700 1 --2- 172.21.15.80:0/765526438 >> v2:172.21.15.174:3300/0 conn(0x7f70ec072620 0x7f70ec164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f70e400b300 tx=0x7f70e400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70f0b9f700 1 --2- 172.21.15.80:0/765526438 >> v2:172.21.15.174:3300/0 conn(0x7f70ec072620 0x7f70ec164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f70e400b300 tx=0x7f70e400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70f0b9f700 1 --2- 172.21.15.80:0/765526438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70ec072620 0x7f70ec164d70 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7f70e400b300 tx=0x7f70e400bb10).ready entity=mon.1 client_cookie=2e926119de011296 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:07.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70f0b9f700 1 --2- 172.21.15.80:0/765526438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70ec072620 0x7f70ec164d70 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7f70e400b300 tx=0x7f70e400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70eb7fe700 1 -- 172.21.15.80:0/765526438 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70e4000f40 con 0x7f70ec072620 2019-11-28T11:29:07.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70f0b9f700 1 --2- 172.21.15.80:0/765526438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70ec072620 0x7f70ec164d70 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7f70e400b300 tx=0x7f70e400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70f0b9f700 1 --2- 172.21.15.80:0/765526438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70ec072620 0x7f70ec164d70 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7f70e400b300 tx=0x7f70e400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70eb7fe700 1 -- 172.21.15.80:0/765526438 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e4009b70 con 0x7f70ec072620 2019-11-28T11:29:07.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70eb7fe700 1 -- 172.21.15.80:0/765526438 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70e400a240 con 0x7f70ec072620 2019-11-28T11:29:07.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70f1e01700 1 -- 172.21.15.80:0/765526438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70ec072620 msgr2=0x7f70ec164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:07.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.505+0000 7f70f1e01700 1 --2- 172.21.15.80:0/765526438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70ec072620 0x7f70ec164d70 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7f70e400b300 tx=0x7f70e400bb10).stop 2019-11-28T11:29:07.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.506+0000 7f70f1e01700 1 -- 172.21.15.80:0/765526438 shutdown_connections 2019-11-28T11:29:07.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.506+0000 7f70f1e01700 1 --2- 172.21.15.80:0/765526438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70ec072620 0x7f70ec164d70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:07.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.506+0000 7f70f1e01700 1 --2- 172.21.15.80:0/765526438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70ec06c0a0 0x7f70ec072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:07.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.506+0000 7f70f1e01700 1 -- 172.21.15.80:0/765526438 shutdown_connections 2019-11-28T11:29:07.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.506+0000 7f70f1e01700 1 -- 172.21.15.80:0/765526438 wait complete. 2019-11-28T11:29:07.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.506+0000 7f70f1e01700 1 -- 172.21.15.80:0/765526438 >> 172.21.15.80:0/765526438 conn(0x7f70ec061cf0 msgr2=0x7f70ec064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:07.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.508+0000 7f70f1e01700 1 Processor -- start 2019-11-28T11:29:07.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.509+0000 7f70f1e01700 1 -- start start 2019-11-28T11:29:07.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.509+0000 7f70f1e01700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f70ec104820 0x7f70ec10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:07.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.509+0000 7f70f1e01700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f70ec10c890 0x7f70ec10b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:07.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.509+0000 7f70f1e01700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec13bcd0 con 0x7f70ec10b710 2019-11-28T11:29:07.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.509+0000 7f70f1e01700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ec109130 con 0x7f70ec10c890 2019-11-28T11:29:07.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.509+0000 7f70f1e01700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ec109400 con 0x7f70ec104820 2019-11-28T11:29:07.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.509+0000 7f70e3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f70ec10c890 0x7f70ec10b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:07.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.509+0000 7f70f0b9f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f70ec10b710 0x7f70ec104c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33646/0 (socket says 172.21.15.80:33646) 2019-11-28T11:29:07.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.509+0000 7f70f0b9f700 1 -- 172.21.15.80:0/3164754746 learned_addr learned my addr 172.21.15.80:0/3164754746 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:07.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.509+0000 7f70ebfff700 1 --2- 172.21.15.80:0/3164754746 >> v2:172.21.15.174:3300/0 conn(0x7f70ec104820 0x7f70ec10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:07.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70e3fff700 1 -- 172.21.15.80:0/3164754746 >> v2:172.21.15.174:3300/0 conn(0x7f70ec104820 msgr2=0x7f70ec10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:07.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70e3fff700 1 --2- 172.21.15.80:0/3164754746 >> v2:172.21.15.174:3300/0 conn(0x7f70ec104820 0x7f70ec10c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:07.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70e3fff700 1 -- 172.21.15.80:0/3164754746 >> v1:172.21.15.80:6789/0 conn(0x7f70ec10b710 legacy=0x7f70ec104c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:07.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70e97fa700 1 -- 172.21.15.80:0/3164754746 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063975421 0 0) 0x7f70e4009930 con 0x7f70ec10b710 2019-11-28T11:29:07.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70e3fff700 1 -- 172.21.15.80:0/3164754746 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec109a90 con 0x7f70ec10c890 2019-11-28T11:29:07.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70e3fff700 1 --2- 172.21.15.80:0/3164754746 >> v2:172.21.15.80:3300/0 conn(0x7f70ec10c890 0x7f70ec10b1d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f70d40103a0 tx=0x7f70d400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70e3fff700 1 --2- 172.21.15.80:0/3164754746 >> v2:172.21.15.80:3300/0 conn(0x7f70ec10c890 0x7f70ec10b1d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f70d40103a0 tx=0x7f70d400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70e3fff700 1 --2- 172.21.15.80:0/3164754746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ec10c890 0x7f70ec10b1d0 secure :-1 s=READY pgs=675 cs=0 l=1 rx=0x7f70d40103a0 tx=0x7f70d400b2e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:07.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70e3fff700 1 --2- 172.21.15.80:0/3164754746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ec10c890 0x7f70ec10b1d0 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7f70d40103a0 tx=0x7f70d400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70e97fa700 1 -- 172.21.15.80:0/3164754746 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70d4000d80 con 0x7f70ec10c890 2019-11-28T11:29:07.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70e3fff700 1 --2- 172.21.15.80:0/3164754746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ec10c890 0x7f70ec10b1d0 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7f70d40103a0 tx=0x7f70d400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70e97fa700 1 -- 172.21.15.80:0/3164754746 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d4001380 con 0x7f70ec10c890 2019-11-28T11:29:07.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70e3fff700 1 --2- 172.21.15.80:0/3164754746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ec10c890 0x7f70ec10b1d0 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7f70d40103a0 tx=0x7f70d400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70f1e01700 1 -- 172.21.15.80:0/3164754746 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ec109e10 con 0x7f70ec10c890 2019-11-28T11:29:07.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70e97fa700 1 -- 172.21.15.80:0/3164754746 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70d4001570 con 0x7f70ec10c890 2019-11-28T11:29:07.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70f1e01700 1 -- 172.21.15.80:0/3164754746 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ec109a90 con 0x7f70ec10c890 2019-11-28T11:29:07.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.510+0000 7f70e3fff700 1 --2- 172.21.15.80:0/3164754746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ec10c890 0x7f70ec10b1d0 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7f70d40103a0 tx=0x7f70d400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.511+0000 7f70e97fa700 1 -- 172.21.15.80:0/3164754746 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f70d4000d60 con 0x7f70ec10c890 2019-11-28T11:29:07.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.511+0000 7f70e3fff700 1 --2- 172.21.15.80:0/3164754746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ec10c890 0x7f70ec10b1d0 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7f70d40103a0 tx=0x7f70d400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.511+0000 7f70e97fa700 1 --2- 172.21.15.80:0/3164754746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70d0018730 0x7f70d001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:07.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.511+0000 7f70e97fa700 1 -- 172.21.15.80:0/3164754746 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f70d40319e0 con 0x7f70ec10c890 2019-11-28T11:29:07.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.511+0000 7f70ebfff700 1 --2- 172.21.15.80:0/3164754746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70d0018730 0x7f70d001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:07.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.511+0000 7f70ebfff700 1 --2- 172.21.15.80:0/3164754746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70d0018730 0x7f70d001abc0 crc :-1 s=READY pgs=284 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:07.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.518+0000 7f70f1e01700 1 -- 172.21.15.80:0/3164754746 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ec109e10 con 0x7f70ec10c890 2019-11-28T11:29:07.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.522+0000 7f70e3fff700 1 --2- 172.21.15.80:0/3164754746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ec10c890 0x7f70ec10b1d0 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7f70d40103a0 tx=0x7f70d400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.522+0000 7f70e97fa700 1 -- 172.21.15.80:0/3164754746 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f70d4001570 con 0x7f70ec10c890 2019-11-28T11:29:07.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.694+0000 7f70f1e01700 1 -- 172.21.15.80:0/3164754746 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70ec109a90 con 0x7f70ec10c890 2019-11-28T11:29:07.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.695+0000 7f70e3fff700 1 --2- 172.21.15.80:0/3164754746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ec10c890 0x7f70ec10b1d0 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7f70d40103a0 tx=0x7f70d400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.695+0000 7f70e97fa700 1 -- 172.21.15.80:0/3164754746 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2443 (secure 0 0 0) 0x7f70d4000d60 con 0x7f70ec10c890 2019-11-28T11:29:07.725 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 30 2019-11-28T11:29:07.725 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:07.726 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5895,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/169206692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":169206692},{"type":"v1","addr":"172.21.15.80:6834","nonce":169206692}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":28},{"gid":5898,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/2970516164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":2970516164},{"type":"v1","addr":"172.21.15.80:6835","nonce":2970516164}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:54.163001+0000","modified":"2019-11-28T11:29:01.914204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5725},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5725":{"gid":5725,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2800771965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2800771965},{"type":"v1","addr":"172.21.15.174:6835","nonce":2800771965}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2019-11-28T11:29:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.697+0000 7f70f1e01700 1 -- 172.21.15.80:0/3164754746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70d0018730 msgr2=0x7f70d001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.697+0000 7f70f1e01700 1 --2- 172.21.15.80:0/3164754746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70d0018730 0x7f70d001abc0 crc :-1 s=READY pgs=284 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:07.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.697+0000 7f70f1e01700 1 -- 172.21.15.80:0/3164754746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ec10c890 msgr2=0x7f70ec10b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.697+0000 7f70f1e01700 1 --2- 172.21.15.80:0/3164754746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ec10c890 0x7f70ec10b1d0 secure :-1 s=READY pgs=675 cs=0 l=1 rx=0x7f70d40103a0 tx=0x7f70d400b2e0).stop 2019-11-28T11:29:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.697+0000 7f70f1e01700 1 -- 172.21.15.80:0/3164754746 shutdown_connections 2019-11-28T11:29:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.697+0000 7f70f1e01700 1 --2- 172.21.15.80:0/3164754746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70d0018730 0x7f70d001abc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.697+0000 7f70f1e01700 1 --2- 172.21.15.80:0/3164754746 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70ec10c890 0x7f70ec10b1d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.697+0000 7f70f1e01700 1 --2- 172.21.15.80:0/3164754746 >> v2:172.21.15.174:3300/0 conn(0x7f70ec104820 0x7f70ec10c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:07.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.697+0000 7f70f1e01700 1 -- 172.21.15.80:0/3164754746 shutdown_connections 2019-11-28T11:29:07.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.697+0000 7f70f1e01700 1 -- 172.21.15.80:0/3164754746 wait complete. 2019-11-28T11:29:07.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:07.697+0000 7f70f1e01700 1 -- 172.21.15.80:0/3164754746 >> 172.21.15.80:0/3164754746 conn(0x7f70ec13d620 msgr2=0x7f70ec13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:08.040 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5725}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 8, u'failed': [], u'epoch': 30, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [9], u'info': {u'gid_5725': {u'export_targets': [], u'name': u'c', u'incarnation': 29, u'state_seq': 3, u'state': u'up:active', u'gid': 5725, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2800771965, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2800771965, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2800771965'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:28:54.163001+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:29:01.914204+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:29:08.040 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:29:08.041 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:29:08.167 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:29:08.168 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:29:08.168 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:29:08.168 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5725, 2019-11-28T11:29:08.168 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:29:08.169 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:29:08.169 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 7.2244212660000002, 2019-11-28T11:29:08.169 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 30, 2019-11-28T11:29:08.169 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 57, 2019-11-28T11:29:08.170 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 57, 2019-11-28T11:29:08.170 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 11.50578543 2019-11-28T11:29:08.170 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:29:08.173 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5725, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.2244212660000002, "mdsmap_epoch": 30, "osdmap_epoch": 57, "osdmap_epoch_barrier": 57, "uptime": 11.50578543 } 2019-11-28T11:29:08.174 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:29:08.174 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:29:08.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:29:08.175 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:29:08.246 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:29:08.246 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:29:08.373 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:29:08.374 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:29:08.374 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:29:08.374 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:29:08.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:29:08.375 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:29:08.446 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:29:08.567 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:29:08.568 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:29:08.568 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:29:08.573 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:29:08.574 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:29:08.694 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:29:08.695 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:29:08.695 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:29:08.701 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:29:08.701 INFO:tasks.cephfs.mount:Creating file a 2019-11-28T11:29:08.701 INFO:teuthology.orchestra.run.smithi076:> sudo touch /home/ubuntu/cephtest/mnt.0/a 2019-11-28T11:29:08.767 INFO:tasks.cephfs.mount:Creating file b 2019-11-28T11:29:08.767 INFO:teuthology.orchestra.run.smithi076:> sudo touch /home/ubuntu/cephtest/mnt.0/b 2019-11-28T11:29:08.834 INFO:tasks.cephfs.mount:Creating file c 2019-11-28T11:29:08.835 INFO:teuthology.orchestra.run.smithi076:> sudo touch /home/ubuntu/cephtest/mnt.0/c 2019-11-28T11:29:08.895 INFO:tasks.cephfs.mount:Checking file a 2019-11-28T11:29:08.895 INFO:teuthology.orchestra.run.smithi076:> sudo ls /home/ubuntu/cephtest/mnt.0/a 2019-11-28T11:29:08.953 INFO:teuthology.orchestra.run.smithi076.stdout:/home/ubuntu/cephtest/mnt.0/a 2019-11-28T11:29:08.953 INFO:tasks.cephfs.mount:Checking file b 2019-11-28T11:29:08.954 INFO:teuthology.orchestra.run.smithi076:> sudo ls /home/ubuntu/cephtest/mnt.0/b 2019-11-28T11:29:09.009 INFO:teuthology.orchestra.run.smithi076.stdout:/home/ubuntu/cephtest/mnt.0/b 2019-11-28T11:29:09.010 INFO:tasks.cephfs.mount:Checking file c 2019-11-28T11:29:09.010 INFO:teuthology.orchestra.run.smithi076:> sudo ls /home/ubuntu/cephtest/mnt.0/c 2019-11-28T11:29:09.062 INFO:teuthology.orchestra.run.smithi076.stdout:/home/ubuntu/cephtest/mnt.0/c 2019-11-28T11:29:09.063 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:29:09.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:29:09.063 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T11:29:11.691 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:29:11.695 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:29:11.737 INFO:tasks.cephfs.mount:Checking file a 2019-11-28T11:29:11.737 INFO:teuthology.orchestra.run.smithi016:> sudo ls /home/ubuntu/cephtest/mnt.1/a 2019-11-28T11:29:11.804 INFO:teuthology.orchestra.run.smithi016.stdout:/home/ubuntu/cephtest/mnt.1/a 2019-11-28T11:29:11.805 INFO:tasks.cephfs.mount:Checking file b 2019-11-28T11:29:11.806 INFO:teuthology.orchestra.run.smithi016:> sudo ls /home/ubuntu/cephtest/mnt.1/b 2019-11-28T11:29:11.866 INFO:teuthology.orchestra.run.smithi016.stdout:/home/ubuntu/cephtest/mnt.1/b 2019-11-28T11:29:11.867 INFO:tasks.cephfs.mount:Checking file c 2019-11-28T11:29:11.867 INFO:teuthology.orchestra.run.smithi016:> sudo ls /home/ubuntu/cephtest/mnt.1/c 2019-11-28T11:29:11.925 INFO:teuthology.orchestra.run.smithi016.stdout:/home/ubuntu/cephtest/mnt.1/c 2019-11-28T11:29:11.926 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:29:12.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.016+0000 7ff46a524700 1 Processor -- start 2019-11-28T11:29:12.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.016+0000 7ff46a524700 1 -- start start 2019-11-28T11:29:12.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff46a524700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff46406c490 0x7ff46406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:12.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff46a524700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46406db00 con 0x7ff46406c0a0 2019-11-28T11:29:12.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff46a524700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46406e000 con 0x7ff46406ce60 2019-11-28T11:29:12.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff46a524700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46406fd60 con 0x7ff46406c490 2019-11-28T11:29:12.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff468ac1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff46406c0a0 0x7ff464072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33650/0 (socket says 172.21.15.80:33650) 2019-11-28T11:29:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff468ac1700 1 -- 172.21.15.80:0/2697891396 learned_addr learned my addr 172.21.15.80:0/2697891396 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff463fff700 1 --2- 172.21.15.80:0/2697891396 >> v2:172.21.15.174:3300/0 conn(0x7ff46406c490 0x7ff46406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff4637fe700 1 -- 172.21.15.80:0/2697891396 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574390492 0 0) 0x7ff45c0014d0 con 0x7ff46406c0a0 2019-11-28T11:29:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff4637fe700 1 -- 172.21.15.80:0/2697891396 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff450002e80 con 0x7ff46406c0a0 2019-11-28T11:29:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff4637fe700 1 -- 172.21.15.80:0/2697891396 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 70104063 0 0) 0x7ff45c0014b0 con 0x7ff46406c0a0 2019-11-28T11:29:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff4637fe700 1 -- 172.21.15.80:0/2697891396 >> v2:172.21.15.174:3300/0 conn(0x7ff46406c490 msgr2=0x7ff46406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff4637fe700 1 --2- 172.21.15.80:0/2697891396 >> v2:172.21.15.174:3300/0 conn(0x7ff46406c490 0x7ff46406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff4637fe700 1 -- 172.21.15.80:0/2697891396 >> v1:172.21.15.174:6789/0 conn(0x7ff46406ce60 legacy=0x7ff464164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff4637fe700 1 -- 172.21.15.80:0/2697891396 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4640706c0 con 0x7ff46406c0a0 2019-11-28T11:29:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff4637fe700 1 -- 172.21.15.80:0/2697891396 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff45c0019e0 con 0x7ff46406c0a0 2019-11-28T11:29:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff4637fe700 1 -- 172.21.15.80:0/2697891396 >> v1:172.21.15.80:6789/0 conn(0x7ff46406c0a0 legacy=0x7ff464072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.017+0000 7ff4637fe700 1 --2- 172.21.15.80:0/2697891396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff450003ab0 0x7ff450005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff4637fe700 1 --2- 172.21.15.80:0/2697891396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff450006690 0x7ff450008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff4637fe700 1 --2- 172.21.15.80:0/2697891396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff450009380 0x7ff45000b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff4637fe700 1 -- 172.21.15.80:0/2697891396 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45000c000 con 0x7ff450006690 2019-11-28T11:29:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff4637fe700 1 -- 172.21.15.80:0/2697891396 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff450050200 con 0x7ff450003ab0 2019-11-28T11:29:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff4637fe700 1 -- 172.21.15.80:0/2697891396 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff450050430 con 0x7ff450009380 2019-11-28T11:29:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff463fff700 1 --2- 172.21.15.80:0/2697891396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff450006690 0x7ff450008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff468ac1700 1 --2- 172.21.15.80:0/2697891396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff450003ab0 0x7ff450005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff4692c2700 1 --2- 172.21.15.80:0/2697891396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff450009380 0x7ff45000b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:12.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff463fff700 1 -- 172.21.15.80:0/2697891396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff450009380 msgr2=0x7ff45000b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:12.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff463fff700 1 --2- 172.21.15.80:0/2697891396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff450009380 0x7ff45000b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:12.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff463fff700 1 -- 172.21.15.80:0/2697891396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff450003ab0 msgr2=0x7ff450005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:12.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff463fff700 1 --2- 172.21.15.80:0/2697891396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff450003ab0 0x7ff450005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:12.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff463fff700 1 -- 172.21.15.80:0/2697891396 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4500506e0 con 0x7ff450006690 2019-11-28T11:29:12.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff4692c2700 1 -- 172.21.15.80:0/2697891396 reap_dead start 2019-11-28T11:29:12.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff463fff700 1 --2- 172.21.15.80:0/2697891396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff450006690 0x7ff450008b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff45400b230 tx=0x7ff45400b530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff463fff700 1 --2- 172.21.15.80:0/2697891396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff450006690 0x7ff450008b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff45400b230 tx=0x7ff45400b530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff463fff700 1 --2- 172.21.15.80:0/2697891396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff450006690 0x7ff450008b20 secure :-1 s=READY pgs=678 cs=0 l=1 rx=0x7ff45400b230 tx=0x7ff45400b530).ready entity=mon.0 client_cookie=3e69ffafc87bbc32 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:12.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff463fff700 1 --2- 172.21.15.80:0/2697891396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff450006690 0x7ff450008b20 secure :-1 s=THROTTLE_DONE pgs=678 cs=0 l=1 rx=0x7ff45400b230 tx=0x7ff45400b530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff4637fe700 1 -- 172.21.15.80:0/2697891396 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff454000960 con 0x7ff450006690 2019-11-28T11:29:12.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff463fff700 1 --2- 172.21.15.80:0/2697891396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff450006690 0x7ff450008b20 secure :-1 s=THROTTLE_DONE pgs=678 cs=0 l=1 rx=0x7ff45400b230 tx=0x7ff45400b530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff463fff700 1 --2- 172.21.15.80:0/2697891396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff450006690 0x7ff450008b20 secure :-1 s=THROTTLE_DONE pgs=678 cs=0 l=1 rx=0x7ff45400b230 tx=0x7ff45400b530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff4637fe700 1 -- 172.21.15.80:0/2697891396 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff454009580 con 0x7ff450006690 2019-11-28T11:29:12.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff4637fe700 1 -- 172.21.15.80:0/2697891396 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff454009c50 con 0x7ff450006690 2019-11-28T11:29:12.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff46a524700 1 -- 172.21.15.80:0/2697891396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff450006690 msgr2=0x7ff450008b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.018+0000 7ff46a524700 1 --2- 172.21.15.80:0/2697891396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff450006690 0x7ff450008b20 secure :-1 s=READY pgs=678 cs=0 l=1 rx=0x7ff45400b230 tx=0x7ff45400b530).stop 2019-11-28T11:29:12.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.019+0000 7ff46a524700 1 -- 172.21.15.80:0/2697891396 shutdown_connections 2019-11-28T11:29:12.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.019+0000 7ff46a524700 1 --2- 172.21.15.80:0/2697891396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff450006690 0x7ff450008b20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.019+0000 7ff46a524700 1 -- 172.21.15.80:0/2697891396 shutdown_connections 2019-11-28T11:29:12.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.019+0000 7ff46a524700 1 -- 172.21.15.80:0/2697891396 wait complete. 2019-11-28T11:29:12.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.019+0000 7ff46a524700 1 -- 172.21.15.80:0/2697891396 >> 172.21.15.80:0/2697891396 conn(0x7ff464061cf0 msgr2=0x7ff464064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:12.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.021+0000 7ff46a524700 1 Processor -- start 2019-11-28T11:29:12.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.021+0000 7ff46a524700 1 -- start start 2019-11-28T11:29:12.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.022+0000 7ff46a524700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff464074d00 0x7ff4640750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:12.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.022+0000 7ff46a524700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff464152bd0 0x7ff464140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:12.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.022+0000 7ff46a524700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff464079230 con 0x7ff464153040 2019-11-28T11:29:12.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.022+0000 7ff46a524700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46407ab30 con 0x7ff464074d00 2019-11-28T11:29:12.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.022+0000 7ff46a524700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46407ae00 con 0x7ff464152bd0 2019-11-28T11:29:12.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff468ac1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff464074d00 0x7ff4640750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:12.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff468ac1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff464074d00 0x7ff4640750f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34350/0 (socket says 172.21.15.80:34350) 2019-11-28T11:29:12.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff468ac1700 1 -- 172.21.15.80:0/3075417406 learned_addr learned my addr 172.21.15.80:0/3075417406 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:12.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff463fff700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff464152bd0 0x7ff464140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:12.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff468ac1700 1 -- 172.21.15.80:0/3075417406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff464152bd0 msgr2=0x7ff464140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff468ac1700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff464152bd0 0x7ff464140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff468ac1700 1 -- 172.21.15.80:0/3075417406 >> v1:172.21.15.174:6789/0 conn(0x7ff464153040 legacy=0x7ff464140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff468ac1700 1 -- 172.21.15.80:0/3075417406 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46407b490 con 0x7ff464074d00 2019-11-28T11:29:12.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff468ac1700 1 --2- 172.21.15.80:0/3075417406 >> v2:172.21.15.80:3300/0 conn(0x7ff464074d00 0x7ff4640750f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff45c0107c0 tx=0x7ff45c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff468ac1700 1 --2- 172.21.15.80:0/3075417406 >> v2:172.21.15.80:3300/0 conn(0x7ff464074d00 0x7ff4640750f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff45c0107c0 tx=0x7ff45c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff468ac1700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff464074d00 0x7ff4640750f0 secure :-1 s=READY pgs=679 cs=0 l=1 rx=0x7ff45c0107c0 tx=0x7ff45c0105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:12.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff468ac1700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff464074d00 0x7ff4640750f0 secure :-1 s=THROTTLE_DONE pgs=679 cs=0 l=1 rx=0x7ff45c0107c0 tx=0x7ff45c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff468ac1700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff464074d00 0x7ff4640750f0 secure :-1 s=THROTTLE_DONE pgs=679 cs=0 l=1 rx=0x7ff45c0107c0 tx=0x7ff45c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff468ac1700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff464074d00 0x7ff4640750f0 secure :-1 s=THROTTLE_DONE pgs=679 cs=0 l=1 rx=0x7ff45c0107c0 tx=0x7ff45c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff4617fa700 1 -- 172.21.15.80:0/3075417406 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff45c0047b0 con 0x7ff464074d00 2019-11-28T11:29:12.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff4617fa700 1 -- 172.21.15.80:0/3075417406 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c001fc0 con 0x7ff464074d00 2019-11-28T11:29:12.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff4617fa700 1 -- 172.21.15.80:0/3075417406 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff45c004d90 con 0x7ff464074d00 2019-11-28T11:29:12.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff46a524700 1 -- 172.21.15.80:0/3075417406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46407b810 con 0x7ff464074d00 2019-11-28T11:29:12.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff46a524700 1 -- 172.21.15.80:0/3075417406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46407b490 con 0x7ff464074d00 2019-11-28T11:29:12.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.023+0000 7ff468ac1700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff464074d00 0x7ff4640750f0 secure :-1 s=THROTTLE_DONE pgs=679 cs=0 l=1 rx=0x7ff45c0107c0 tx=0x7ff45c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.024+0000 7ff4617fa700 1 -- 172.21.15.80:0/3075417406 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff45c0045c0 con 0x7ff464074d00 2019-11-28T11:29:12.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.024+0000 7ff468ac1700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff464074d00 0x7ff4640750f0 secure :-1 s=THROTTLE_DONE pgs=679 cs=0 l=1 rx=0x7ff45c0107c0 tx=0x7ff45c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.024+0000 7ff4617fa700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff448018730 0x7ff44801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:12.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.024+0000 7ff4617fa700 1 -- 172.21.15.80:0/3075417406 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff45c031e30 con 0x7ff464074d00 2019-11-28T11:29:12.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.024+0000 7ff463fff700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff448018730 0x7ff44801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:12.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.024+0000 7ff463fff700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff448018730 0x7ff44801abc0 crc :-1 s=READY pgs=285 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:12.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.031+0000 7ff46a524700 1 -- 172.21.15.80:0/3075417406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46407b810 con 0x7ff464074d00 2019-11-28T11:29:12.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.034+0000 7ff468ac1700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff464074d00 0x7ff4640750f0 secure :-1 s=THROTTLE_DONE pgs=679 cs=0 l=1 rx=0x7ff45c0107c0 tx=0x7ff45c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.034+0000 7ff4617fa700 1 -- 172.21.15.80:0/3075417406 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff45c0013e0 con 0x7ff464074d00 2019-11-28T11:29:12.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.211+0000 7ff46a524700 1 -- 172.21.15.80:0/3075417406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff46407b490 con 0x7ff464074d00 2019-11-28T11:29:12.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.212+0000 7ff468ac1700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff464074d00 0x7ff4640750f0 secure :-1 s=THROTTLE_DONE pgs=679 cs=0 l=1 rx=0x7ff45c0107c0 tx=0x7ff45c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.212+0000 7ff4617fa700 1 -- 172.21.15.80:0/3075417406 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+14857 (secure 0 0 0) 0x7ff45c0045c0 con 0x7ff464074d00 2019-11-28T11:29:12.242 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:12.242 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":57,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:28:55.164436+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:28:52.545871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2019-11-28T11:28:53.180206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:29:12.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.214+0000 7ff46a524700 1 -- 172.21.15.80:0/3075417406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff448018730 msgr2=0x7ff44801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.214+0000 7ff46a524700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff448018730 0x7ff44801abc0 crc :-1 s=READY pgs=285 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.214+0000 7ff46a524700 1 -- 172.21.15.80:0/3075417406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff464074d00 msgr2=0x7ff4640750f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.214+0000 7ff46a524700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff464074d00 0x7ff4640750f0 secure :-1 s=READY pgs=679 cs=0 l=1 rx=0x7ff45c0107c0 tx=0x7ff45c0105f0).stop 2019-11-28T11:29:12.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.214+0000 7ff46a524700 1 -- 172.21.15.80:0/3075417406 shutdown_connections 2019-11-28T11:29:12.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.214+0000 7ff46a524700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff448018730 0x7ff44801abc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.214+0000 7ff46a524700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff464152bd0 0x7ff464140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.214+0000 7ff46a524700 1 --2- 172.21.15.80:0/3075417406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff464074d00 0x7ff4640750f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.214+0000 7ff46a524700 1 -- 172.21.15.80:0/3075417406 shutdown_connections 2019-11-28T11:29:12.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.214+0000 7ff46a524700 1 -- 172.21.15.80:0/3075417406 wait complete. 2019-11-28T11:29:12.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.214+0000 7ff46a524700 1 -- 172.21.15.80:0/3075417406 >> 172.21.15.80:0/3075417406 conn(0x7ff46413fa50 msgr2=0x7ff46407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:12.255 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:28:52.545871+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 8, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'56', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:28:53.180206+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 9, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'57', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:29:12.256 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:29:12.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.349+0000 7facbec19700 1 Processor -- start 2019-11-28T11:29:12.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.349+0000 7facbec19700 1 -- start start 2019-11-28T11:29:12.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.350+0000 7facbec19700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7facb815f100 0x7facb806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:12.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.350+0000 7facbec19700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb806db60 con 0x7facb806c2f0 2019-11-28T11:29:12.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.350+0000 7facbec19700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb806e060 con 0x7facb815ed10 2019-11-28T11:29:12.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.350+0000 7facbec19700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb806fe00 con 0x7facb815f100 2019-11-28T11:29:12.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.350+0000 7facbc9b5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7facb815f100 0x7facb806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:12.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facbd9b7700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7facb806c2f0 0x7facb806c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33672/0 (socket says 172.21.15.80:33672) 2019-11-28T11:29:12.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facbd9b7700 1 -- 172.21.15.80:0/1597736065 learned_addr learned my addr 172.21.15.80:0/1597736065 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:12.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facbc9b5700 1 -- 172.21.15.80:0/1597736065 >> v1:172.21.15.174:6789/0 conn(0x7facb815ed10 legacy=0x7facb8073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:12.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facbc9b5700 1 -- 172.21.15.80:0/1597736065 >> v1:172.21.15.80:6789/0 conn(0x7facb806c2f0 legacy=0x7facb806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facb7fff700 1 -- 172.21.15.80:0/1597736065 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330805847 0 0) 0x7facb0001150 con 0x7facb806c2f0 2019-11-28T11:29:12.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facbc9b5700 1 -- 172.21.15.80:0/1597736065 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb8070760 con 0x7facb815f100 2019-11-28T11:29:12.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facbc9b5700 1 --2- 172.21.15.80:0/1597736065 >> v2:172.21.15.80:3300/0 conn(0x7facb815f100 0x7facb806bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faca800af50 tx=0x7faca800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facbc9b5700 1 --2- 172.21.15.80:0/1597736065 >> v2:172.21.15.80:3300/0 conn(0x7facb815f100 0x7facb806bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faca800af50 tx=0x7faca800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facbc9b5700 1 --2- 172.21.15.80:0/1597736065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb815f100 0x7facb806bdb0 secure :-1 s=READY pgs=681 cs=0 l=1 rx=0x7faca800af50 tx=0x7faca800b760).ready entity=mon.0 client_cookie=eb82d3d7863c4681 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:12.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facbc9b5700 1 --2- 172.21.15.80:0/1597736065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb815f100 0x7facb806bdb0 secure :-1 s=THROTTLE_DONE pgs=681 cs=0 l=1 rx=0x7faca800af50 tx=0x7faca800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facb7fff700 1 -- 172.21.15.80:0/1597736065 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faca8000960 con 0x7facb815f100 2019-11-28T11:29:12.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facbc9b5700 1 --2- 172.21.15.80:0/1597736065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb815f100 0x7facb806bdb0 secure :-1 s=THROTTLE_DONE pgs=681 cs=0 l=1 rx=0x7faca800af50 tx=0x7faca800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facbc9b5700 1 --2- 172.21.15.80:0/1597736065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb815f100 0x7facb806bdb0 secure :-1 s=THROTTLE_DONE pgs=681 cs=0 l=1 rx=0x7faca800af50 tx=0x7faca800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facb7fff700 1 -- 172.21.15.80:0/1597736065 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca8009860 con 0x7facb815f100 2019-11-28T11:29:12.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facb7fff700 1 -- 172.21.15.80:0/1597736065 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faca8009f30 con 0x7facb815f100 2019-11-28T11:29:12.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facbec19700 1 -- 172.21.15.80:0/1597736065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb815f100 msgr2=0x7facb806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.351+0000 7facbec19700 1 --2- 172.21.15.80:0/1597736065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb815f100 0x7facb806bdb0 secure :-1 s=READY pgs=681 cs=0 l=1 rx=0x7faca800af50 tx=0x7faca800b760).stop 2019-11-28T11:29:12.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.352+0000 7facbec19700 1 -- 172.21.15.80:0/1597736065 shutdown_connections 2019-11-28T11:29:12.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.352+0000 7facbec19700 1 --2- 172.21.15.80:0/1597736065 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb815f100 0x7facb806bdb0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.352+0000 7facbec19700 1 -- 172.21.15.80:0/1597736065 shutdown_connections 2019-11-28T11:29:12.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.352+0000 7facbec19700 1 -- 172.21.15.80:0/1597736065 wait complete. 2019-11-28T11:29:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.352+0000 7facbec19700 1 -- 172.21.15.80:0/1597736065 >> 172.21.15.80:0/1597736065 conn(0x7facb8061d20 msgr2=0x7facb80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:12.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.354+0000 7facbec19700 1 Processor -- start 2019-11-28T11:29:12.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.354+0000 7facbec19700 1 -- start start 2019-11-28T11:29:12.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.355+0000 7facbec19700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7facb8148320 0x7facb810ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:12.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.355+0000 7facbec19700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7facb810f290 0x7facb810dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:12.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.355+0000 7facbec19700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb8148e00 con 0x7facb810e110 2019-11-28T11:29:12.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.355+0000 7facbec19700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb813aa20 con 0x7facb810f290 2019-11-28T11:29:12.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.355+0000 7facbec19700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb813acf0 con 0x7facb8148320 2019-11-28T11:29:12.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.355+0000 7facbc9b5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7facb810f290 0x7facb810dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:12.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.355+0000 7facbc9b5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7facb810f290 0x7facb810dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34360/0 (socket says 172.21.15.80:34360) 2019-11-28T11:29:12.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbc9b5700 1 -- 172.21.15.80:0/3480848375 learned_addr learned my addr 172.21.15.80:0/3480848375 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:12.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbd9b7700 1 --1- 172.21.15.80:0/3480848375 >> v1:172.21.15.80:6789/0 conn(0x7facb810e110 0x7facb81079b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33678/0 (socket says 172.21.15.80:33678) 2019-11-28T11:29:12.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbd1b6700 1 --2- 172.21.15.80:0/3480848375 >> v2:172.21.15.174:3300/0 conn(0x7facb8148320 0x7facb810ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:12.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbc9b5700 1 -- 172.21.15.80:0/3480848375 >> v2:172.21.15.174:3300/0 conn(0x7facb8148320 msgr2=0x7facb810ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbc9b5700 1 --2- 172.21.15.80:0/3480848375 >> v2:172.21.15.174:3300/0 conn(0x7facb8148320 0x7facb810ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbc9b5700 1 -- 172.21.15.80:0/3480848375 >> v1:172.21.15.80:6789/0 conn(0x7facb810e110 legacy=0x7facb81079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facb5ffb700 1 -- 172.21.15.80:0/3480848375 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50658576 0 0) 0x7facb0000f40 con 0x7facb810e110 2019-11-28T11:29:12.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbc9b5700 1 -- 172.21.15.80:0/3480848375 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb810c490 con 0x7facb810f290 2019-11-28T11:29:12.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbd1b6700 1 --2- 172.21.15.80:0/3480848375 >> v2:172.21.15.174:3300/0 conn(0x7facb8148320 0x7facb810ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:29:12.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbc9b5700 1 --2- 172.21.15.80:0/3480848375 >> v2:172.21.15.80:3300/0 conn(0x7facb810f290 0x7facb810dbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faca80104a0 tx=0x7faca8010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbc9b5700 1 --2- 172.21.15.80:0/3480848375 >> v2:172.21.15.80:3300/0 conn(0x7facb810f290 0x7facb810dbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faca80104a0 tx=0x7faca8010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbc9b5700 1 --2- 172.21.15.80:0/3480848375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb810f290 0x7facb810dbd0 secure :-1 s=READY pgs=683 cs=0 l=1 rx=0x7faca80104a0 tx=0x7faca8010840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:12.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbc9b5700 1 --2- 172.21.15.80:0/3480848375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb810f290 0x7facb810dbd0 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7faca80104a0 tx=0x7faca8010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facb5ffb700 1 -- 172.21.15.80:0/3480848375 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faca8000940 con 0x7facb810f290 2019-11-28T11:29:12.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbc9b5700 1 --2- 172.21.15.80:0/3480848375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb810f290 0x7facb810dbd0 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7faca80104a0 tx=0x7faca8010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbc9b5700 1 --2- 172.21.15.80:0/3480848375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb810f290 0x7facb810dbd0 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7faca80104a0 tx=0x7faca8010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facb5ffb700 1 -- 172.21.15.80:0/3480848375 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca8009980 con 0x7facb810f290 2019-11-28T11:29:12.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facb5ffb700 1 -- 172.21.15.80:0/3480848375 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faca800a050 con 0x7facb810f290 2019-11-28T11:29:12.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbec19700 1 -- 172.21.15.80:0/3480848375 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb810c810 con 0x7facb810f290 2019-11-28T11:29:12.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbec19700 1 -- 172.21.15.80:0/3480848375 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb810c490 con 0x7facb810f290 2019-11-28T11:29:12.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.356+0000 7facbc9b5700 1 --2- 172.21.15.80:0/3480848375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb810f290 0x7facb810dbd0 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7faca80104a0 tx=0x7faca8010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.357+0000 7facb5ffb700 1 -- 172.21.15.80:0/3480848375 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7faca8009b70 con 0x7facb810f290 2019-11-28T11:29:12.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.357+0000 7facbc9b5700 1 --2- 172.21.15.80:0/3480848375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb810f290 0x7facb810dbd0 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7faca80104a0 tx=0x7faca8010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.357+0000 7facb5ffb700 1 --2- 172.21.15.80:0/3480848375 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fac9c018730 0x7fac9c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:12.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.357+0000 7facb5ffb700 1 -- 172.21.15.80:0/3480848375 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7faca8031b20 con 0x7facb810f290 2019-11-28T11:29:12.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.357+0000 7facbd1b6700 1 --2- 172.21.15.80:0/3480848375 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fac9c018730 0x7fac9c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:12.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.357+0000 7facbd1b6700 1 --2- 172.21.15.80:0/3480848375 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fac9c018730 0x7fac9c01abc0 crc :-1 s=READY pgs=286 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:12.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.364+0000 7facbec19700 1 -- 172.21.15.80:0/3480848375 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb810c810 con 0x7facb810f290 2019-11-28T11:29:12.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.368+0000 7facbc9b5700 1 --2- 172.21.15.80:0/3480848375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb810f290 0x7facb810dbd0 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7faca80104a0 tx=0x7faca8010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.368+0000 7facb5ffb700 1 -- 172.21.15.80:0/3480848375 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7faca802afd0 con 0x7facb810f290 2019-11-28T11:29:12.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.533+0000 7facbec19700 1 -- 172.21.15.80:0/3480848375 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7facb810c490 con 0x7facb810f290 2019-11-28T11:29:12.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.534+0000 7facbc9b5700 1 --2- 172.21.15.80:0/3480848375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb810f290 0x7facb810dbd0 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7faca80104a0 tx=0x7faca8010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.534+0000 7facb5ffb700 1 -- 172.21.15.80:0/3480848375 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7faca802afd0 con 0x7facb810f290 2019-11-28T11:29:12.564 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:29:12.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.536+0000 7facbec19700 1 -- 172.21.15.80:0/3480848375 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fac9c018730 msgr2=0x7fac9c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.536+0000 7facbec19700 1 --2- 172.21.15.80:0/3480848375 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fac9c018730 0x7fac9c01abc0 crc :-1 s=READY pgs=286 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.536+0000 7facbec19700 1 -- 172.21.15.80:0/3480848375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb810f290 msgr2=0x7facb810dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.536+0000 7facbec19700 1 --2- 172.21.15.80:0/3480848375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb810f290 0x7facb810dbd0 secure :-1 s=READY pgs=683 cs=0 l=1 rx=0x7faca80104a0 tx=0x7faca8010840).stop 2019-11-28T11:29:12.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.536+0000 7facbec19700 1 -- 172.21.15.80:0/3480848375 shutdown_connections 2019-11-28T11:29:12.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.536+0000 7facbec19700 1 --2- 172.21.15.80:0/3480848375 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fac9c018730 0x7fac9c01abc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.536+0000 7facbec19700 1 --2- 172.21.15.80:0/3480848375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7facb810f290 0x7facb810dbd0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.536+0000 7facbec19700 1 --2- 172.21.15.80:0/3480848375 >> v2:172.21.15.174:3300/0 conn(0x7facb8148320 0x7facb810ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.536+0000 7facbec19700 1 -- 172.21.15.80:0/3480848375 shutdown_connections 2019-11-28T11:29:12.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.536+0000 7facbec19700 1 -- 172.21.15.80:0/3480848375 wait complete. 2019-11-28T11:29:12.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.536+0000 7facbec19700 1 -- 172.21.15.80:0/3480848375 >> 172.21.15.80:0/3480848375 conn(0x7facb815e2d0 msgr2=0x7facb8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:12.584 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:29:12.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.693+0000 7fdbca21d700 1 Processor -- start 2019-11-28T11:29:12.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.693+0000 7fdbca21d700 1 -- start start 2019-11-28T11:29:12.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.694+0000 7fdbca21d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdbc415ed10 0x7fdbc415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:12.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.694+0000 7fdbca21d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc4073020 0x7fdbc4071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:12.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.694+0000 7fdbca21d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc406db60 con 0x7fdbc40734b0 2019-11-28T11:29:12.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.694+0000 7fdbca21d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc406fe00 con 0x7fdbc415ed10 2019-11-28T11:29:12.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.694+0000 7fdbca21d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40700d0 con 0x7fdbc4073020 2019-11-28T11:29:12.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.694+0000 7fdbc3fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdbc415ed10 0x7fdbc415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:12.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.694+0000 7fdbbbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc4073020 0x7fdbc4071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:12.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.694+0000 7fdbc8fbb700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fdbc40734b0 0x7fdbc40723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:49230/0 (socket says 172.21.15.80:49230) 2019-11-28T11:29:12.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.694+0000 7fdbc8fbb700 1 -- 172.21.15.80:0/2066609519 learned_addr learned my addr 172.21.15.80:0/2066609519 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:12.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.695+0000 7fdbbbfff700 1 -- 172.21.15.80:0/2066609519 >> v2:172.21.15.174:3300/0 conn(0x7fdbc415ed10 msgr2=0x7fdbc415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:12.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.695+0000 7fdbbbfff700 1 --2- 172.21.15.80:0/2066609519 >> v2:172.21.15.174:3300/0 conn(0x7fdbc415ed10 0x7fdbc415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:12.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.695+0000 7fdbbbfff700 1 -- 172.21.15.80:0/2066609519 >> v1:172.21.15.174:6789/0 conn(0x7fdbc40734b0 legacy=0x7fdbc40723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.695+0000 7fdbbbfff700 1 -- 172.21.15.80:0/2066609519 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc4070760 con 0x7fdbc4073020 2019-11-28T11:29:12.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.695+0000 7fdbc3fff700 1 --2- 172.21.15.80:0/2066609519 >> v2:172.21.15.174:3300/0 conn(0x7fdbc415ed10 0x7fdbc415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:12.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.695+0000 7fdbbbfff700 1 --2- 172.21.15.80:0/2066609519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc4073020 0x7fdbc4071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdbac00af50 tx=0x7fdbac00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.695+0000 7fdbbbfff700 1 --2- 172.21.15.80:0/2066609519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc4073020 0x7fdbc4071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdbac00af50 tx=0x7fdbac00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.695+0000 7fdbbbfff700 1 --2- 172.21.15.80:0/2066609519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc4073020 0x7fdbc4071ea0 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fdbac00af50 tx=0x7fdbac00b760).ready entity=mon.2 client_cookie=b4f06026ceb28710 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:12.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.695+0000 7fdbbbfff700 1 --2- 172.21.15.80:0/2066609519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc4073020 0x7fdbc4071ea0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fdbac00af50 tx=0x7fdbac00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.695+0000 7fdbbbfff700 1 --2- 172.21.15.80:0/2066609519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc4073020 0x7fdbc4071ea0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fdbac00af50 tx=0x7fdbac00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.695+0000 7fdbc37fe700 1 -- 172.21.15.80:0/2066609519 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbac007210 con 0x7fdbc4073020 2019-11-28T11:29:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.695+0000 7fdbbbfff700 1 --2- 172.21.15.80:0/2066609519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc4073020 0x7fdbc4071ea0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fdbac00af50 tx=0x7fdbac00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.695+0000 7fdbc37fe700 1 -- 172.21.15.80:0/2066609519 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbac0099b0 con 0x7fdbc4073020 2019-11-28T11:29:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.695+0000 7fdbc37fe700 1 -- 172.21.15.80:0/2066609519 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbac00a080 con 0x7fdbc4073020 2019-11-28T11:29:12.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.695+0000 7fdbca21d700 1 -- 172.21.15.80:0/2066609519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc4073020 msgr2=0x7fdbc4071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.695+0000 7fdbca21d700 1 --2- 172.21.15.80:0/2066609519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc4073020 0x7fdbc4071ea0 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fdbac00af50 tx=0x7fdbac00b760).stop 2019-11-28T11:29:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.696+0000 7fdbca21d700 1 -- 172.21.15.80:0/2066609519 shutdown_connections 2019-11-28T11:29:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.696+0000 7fdbca21d700 1 --2- 172.21.15.80:0/2066609519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc4073020 0x7fdbc4071ea0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.696+0000 7fdbca21d700 1 --2- 172.21.15.80:0/2066609519 >> v2:172.21.15.174:3300/0 conn(0x7fdbc415ed10 0x7fdbc415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:12.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.696+0000 7fdbca21d700 1 -- 172.21.15.80:0/2066609519 shutdown_connections 2019-11-28T11:29:12.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.696+0000 7fdbca21d700 1 -- 172.21.15.80:0/2066609519 wait complete. 2019-11-28T11:29:12.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.696+0000 7fdbca21d700 1 -- 172.21.15.80:0/2066609519 >> 172.21.15.80:0/2066609519 conn(0x7fdbc4061d20 msgr2=0x7fdbc40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:12.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.698+0000 7fdbca21d700 1 Processor -- start 2019-11-28T11:29:12.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.698+0000 7fdbca21d700 1 -- start start 2019-11-28T11:29:12.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.699+0000 7fdbca21d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc415f800 0x7fdbc4156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:12.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.699+0000 7fdbca21d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdbc4155860 0x7fdbc412d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:12.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.699+0000 7fdbca21d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc415cb50 con 0x7fdbc41566b0 2019-11-28T11:29:12.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.699+0000 7fdbca21d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc41023d0 con 0x7fdbc4155860 2019-11-28T11:29:12.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.699+0000 7fdbca21d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc41026a0 con 0x7fdbc415f800 2019-11-28T11:29:12.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.699+0000 7fdbc8fbb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdbc4155860 0x7fdbc412d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:12.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.699+0000 7fdbc8fbb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdbc4155860 0x7fdbc412d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34376/0 (socket says 172.21.15.80:34376) 2019-11-28T11:29:12.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.699+0000 7fdbc8fbb700 1 -- 172.21.15.80:0/2455989216 learned_addr learned my addr 172.21.15.80:0/2455989216 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:12.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.699+0000 7fdbc3fff700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc415f800 0x7fdbc4156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:12.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.699+0000 7fdbc8fbb700 1 -- 172.21.15.80:0/2455989216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc415f800 msgr2=0x7fdbc4156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.700+0000 7fdbc8fbb700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc415f800 0x7fdbc4156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.700+0000 7fdbc8fbb700 1 -- 172.21.15.80:0/2455989216 >> v1:172.21.15.80:6789/0 conn(0x7fdbc41566b0 legacy=0x7fdbc4155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.700+0000 7fdbc8fbb700 1 -- 172.21.15.80:0/2455989216 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc4103760 con 0x7fdbc4155860 2019-11-28T11:29:12.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.700+0000 7fdbc17fa700 1 -- 172.21.15.80:0/2455989216 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89847039 0 0) 0x7fdbac00b2e0 con 0x7fdbc41566b0 2019-11-28T11:29:12.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.700+0000 7fdbc8fbb700 1 --2- 172.21.15.80:0/2455989216 >> v2:172.21.15.80:3300/0 conn(0x7fdbc4155860 0x7fdbc412d3e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdbbc0107c0 tx=0x7fdbbc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.700+0000 7fdbc8fbb700 1 --2- 172.21.15.80:0/2455989216 >> v2:172.21.15.80:3300/0 conn(0x7fdbc4155860 0x7fdbc412d3e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdbbc0107c0 tx=0x7fdbbc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.700+0000 7fdbc8fbb700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbc4155860 0x7fdbc412d3e0 secure :-1 s=READY pgs=685 cs=0 l=1 rx=0x7fdbbc0107c0 tx=0x7fdbbc0105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:12.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.700+0000 7fdbc8fbb700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbc4155860 0x7fdbc412d3e0 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7fdbbc0107c0 tx=0x7fdbbc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.700+0000 7fdbc17fa700 1 -- 172.21.15.80:0/2455989216 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbbc000f40 con 0x7fdbc4155860 2019-11-28T11:29:12.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.700+0000 7fdbc8fbb700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbc4155860 0x7fdbc412d3e0 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7fdbbc0107c0 tx=0x7fdbbc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.700+0000 7fdbc8fbb700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbc4155860 0x7fdbc412d3e0 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7fdbbc0107c0 tx=0x7fdbbc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.700+0000 7fdbc17fa700 1 -- 172.21.15.80:0/2455989216 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc004540 con 0x7fdbc4155860 2019-11-28T11:29:12.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.700+0000 7fdbc17fa700 1 -- 172.21.15.80:0/2455989216 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbbc004bd0 con 0x7fdbc4155860 2019-11-28T11:29:12.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.700+0000 7fdbca21d700 1 -- 172.21.15.80:0/2455989216 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc4103ae0 con 0x7fdbc4155860 2019-11-28T11:29:12.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.700+0000 7fdbca21d700 1 -- 172.21.15.80:0/2455989216 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc4104bc0 con 0x7fdbc4155860 2019-11-28T11:29:12.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.700+0000 7fdbc8fbb700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbc4155860 0x7fdbc412d3e0 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7fdbbc0107c0 tx=0x7fdbbc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.701+0000 7fdbc17fa700 1 -- 172.21.15.80:0/2455989216 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fdbbc004730 con 0x7fdbc4155860 2019-11-28T11:29:12.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.701+0000 7fdbc8fbb700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbc4155860 0x7fdbc412d3e0 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7fdbbc0107c0 tx=0x7fdbbc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.701+0000 7fdbc17fa700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdba8018730 0x7fdba801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:12.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.701+0000 7fdbc17fa700 1 -- 172.21.15.80:0/2455989216 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fdbbc031e20 con 0x7fdbc4155860 2019-11-28T11:29:12.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.701+0000 7fdbc3fff700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdba8018730 0x7fdba801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:12.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.701+0000 7fdbc3fff700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdba8018730 0x7fdba801abc0 crc :-1 s=READY pgs=287 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:12.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.708+0000 7fdbca21d700 1 -- 172.21.15.80:0/2455989216 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc4103760 con 0x7fdbc4155860 2019-11-28T11:29:12.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.712+0000 7fdbc8fbb700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbc4155860 0x7fdbc412d3e0 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7fdbbc0107c0 tx=0x7fdbbc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.712+0000 7fdbc17fa700 1 -- 172.21.15.80:0/2455989216 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fdbbc026cb0 con 0x7fdbc4155860 2019-11-28T11:29:12.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.877+0000 7fdbca21d700 1 -- 172.21.15.80:0/2455989216 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fdbc4103ae0 con 0x7fdbc4155860 2019-11-28T11:29:12.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.878+0000 7fdbc8fbb700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbc4155860 0x7fdbc412d3e0 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7fdbbc0107c0 tx=0x7fdbbc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:12.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.878+0000 7fdbc17fa700 1 -- 172.21.15.80:0/2455989216 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v57) v1 ==== 104+0+10 (secure 0 0 0) 0x7fdbbc026cb0 con 0x7fdbc4155860 2019-11-28T11:29:12.909 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:29:12.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.880+0000 7fdbca21d700 1 -- 172.21.15.80:0/2455989216 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdba8018730 msgr2=0x7fdba801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.880+0000 7fdbca21d700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdba8018730 0x7fdba801abc0 crc :-1 s=READY pgs=287 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.880+0000 7fdbca21d700 1 -- 172.21.15.80:0/2455989216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbc4155860 msgr2=0x7fdbc412d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.880+0000 7fdbca21d700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbc4155860 0x7fdbc412d3e0 secure :-1 s=READY pgs=685 cs=0 l=1 rx=0x7fdbbc0107c0 tx=0x7fdbbc0105f0).stop 2019-11-28T11:29:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.880+0000 7fdbca21d700 1 -- 172.21.15.80:0/2455989216 shutdown_connections 2019-11-28T11:29:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.880+0000 7fdbca21d700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdba8018730 0x7fdba801abc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.880+0000 7fdbca21d700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbc4155860 0x7fdbc412d3e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.880+0000 7fdbca21d700 1 --2- 172.21.15.80:0/2455989216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbc415f800 0x7fdbc4156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.880+0000 7fdbca21d700 1 -- 172.21.15.80:0/2455989216 shutdown_connections 2019-11-28T11:29:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.880+0000 7fdbca21d700 1 -- 172.21.15.80:0/2455989216 wait complete. 2019-11-28T11:29:12.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:12.880+0000 7fdbca21d700 1 -- 172.21.15.80:0/2455989216 >> 172.21.15.80:0/2455989216 conn(0x7fdbc407c4f0 msgr2=0x7fdbc415ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:12.923 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:29:13.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.018+0000 7fa24d17e700 1 Processor -- start 2019-11-28T11:29:13.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.018+0000 7fa24d17e700 1 -- start start 2019-11-28T11:29:13.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.019+0000 7fa24d17e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa24815ed10 0x7fa24815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:13.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.019+0000 7fa24d17e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa2480734b0 0x7fa2480726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:13.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.019+0000 7fa24d17e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24806db60 con 0x7fa248073020 2019-11-28T11:29:13.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.019+0000 7fa24d17e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24806fe00 con 0x7fa24815ed10 2019-11-28T11:29:13.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.019+0000 7fa24d17e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2480700d0 con 0x7fa2480734b0 2019-11-28T11:29:13.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa24815ed10 0x7fa24815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:13.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa246d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa248073020 0x7fa248071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33700/0 (socket says 172.21.15.80:33700) 2019-11-28T11:29:13.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa246d9d700 1 -- 172.21.15.80:0/1481911802 learned_addr learned my addr 172.21.15.80:0/1481911802 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:13.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24c97d700 1 --2- 172.21.15.80:0/1481911802 >> v2:172.21.15.174:3300/0 conn(0x7fa2480734b0 0x7fa2480726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:13.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24759e700 1 -- 172.21.15.80:0/1481911802 >> v2:172.21.15.174:3300/0 conn(0x7fa2480734b0 msgr2=0x7fa2480726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:13.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24759e700 1 --2- 172.21.15.80:0/1481911802 >> v2:172.21.15.174:3300/0 conn(0x7fa2480734b0 0x7fa2480726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:13.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24759e700 1 -- 172.21.15.80:0/1481911802 >> v1:172.21.15.80:6789/0 conn(0x7fa248073020 legacy=0x7fa248071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:13.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24759e700 1 -- 172.21.15.80:0/1481911802 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa248070760 con 0x7fa24815ed10 2019-11-28T11:29:13.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24659c700 1 -- 172.21.15.80:0/1481911802 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013822718 0 0) 0x7fa2300013b0 con 0x7fa248073020 2019-11-28T11:29:13.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24759e700 1 --2- 172.21.15.80:0/1481911802 >> v2:172.21.15.80:3300/0 conn(0x7fa24815ed10 0x7fa24815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa23800af50 tx=0x7fa23800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24759e700 1 --2- 172.21.15.80:0/1481911802 >> v2:172.21.15.80:3300/0 conn(0x7fa24815ed10 0x7fa24815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa23800af50 tx=0x7fa23800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24759e700 1 --2- 172.21.15.80:0/1481911802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24815ed10 0x7fa24815f100 secure :-1 s=READY pgs=687 cs=0 l=1 rx=0x7fa23800af50 tx=0x7fa23800b6e0).ready entity=mon.0 client_cookie=bd8485c398c4c63f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:13.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24759e700 1 --2- 172.21.15.80:0/1481911802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24815ed10 0x7fa24815f100 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7fa23800af50 tx=0x7fa23800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24659c700 1 -- 172.21.15.80:0/1481911802 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa238007210 con 0x7fa24815ed10 2019-11-28T11:29:13.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24759e700 1 --2- 172.21.15.80:0/1481911802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24815ed10 0x7fa24815f100 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7fa23800af50 tx=0x7fa23800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24759e700 1 --2- 172.21.15.80:0/1481911802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24815ed10 0x7fa24815f100 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7fa23800af50 tx=0x7fa23800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24659c700 1 -- 172.21.15.80:0/1481911802 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2380099b0 con 0x7fa24815ed10 2019-11-28T11:29:13.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24659c700 1 -- 172.21.15.80:0/1481911802 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa238009ba0 con 0x7fa24815ed10 2019-11-28T11:29:13.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24d17e700 1 -- 172.21.15.80:0/1481911802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24815ed10 msgr2=0x7fa24815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:13.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.020+0000 7fa24d17e700 1 --2- 172.21.15.80:0/1481911802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24815ed10 0x7fa24815f100 secure :-1 s=READY pgs=687 cs=0 l=1 rx=0x7fa23800af50 tx=0x7fa23800b6e0).stop 2019-11-28T11:29:13.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.021+0000 7fa24d17e700 1 -- 172.21.15.80:0/1481911802 shutdown_connections 2019-11-28T11:29:13.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.021+0000 7fa24d17e700 1 --2- 172.21.15.80:0/1481911802 >> v2:172.21.15.174:3300/0 conn(0x7fa2480734b0 0x7fa2480726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:13.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.021+0000 7fa24d17e700 1 --2- 172.21.15.80:0/1481911802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24815ed10 0x7fa24815f100 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:13.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.021+0000 7fa24d17e700 1 -- 172.21.15.80:0/1481911802 shutdown_connections 2019-11-28T11:29:13.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.021+0000 7fa24d17e700 1 -- 172.21.15.80:0/1481911802 wait complete. 2019-11-28T11:29:13.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.021+0000 7fa24d17e700 1 -- 172.21.15.80:0/1481911802 >> 172.21.15.80:0/1481911802 conn(0x7fa248061d20 msgr2=0x7fa2480641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:13.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.023+0000 7fa24d17e700 1 Processor -- start 2019-11-28T11:29:13.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.023+0000 7fa24d17e700 1 -- start start 2019-11-28T11:29:13.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.024+0000 7fa24d17e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa24810cbb0 0x7fa24810d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:13.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.024+0000 7fa24d17e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa24810d580 0x7fa24816ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:13.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.024+0000 7fa24d17e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2481057a0 con 0x7fa248153db0 2019-11-28T11:29:13.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.024+0000 7fa24d17e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa248106280 con 0x7fa24810cbb0 2019-11-28T11:29:13.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.024+0000 7fa24d17e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa248106550 con 0x7fa24810d580 2019-11-28T11:29:13.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.024+0000 7fa246d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa24810cbb0 0x7fa24810d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:13.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.024+0000 7fa24759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa248153db0 0x7fa24810dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33704/0 (socket says 172.21.15.80:33704) 2019-11-28T11:29:13.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.024+0000 7fa24759e700 1 -- 172.21.15.80:0/78077731 learned_addr learned my addr 172.21.15.80:0/78077731 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:13.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa246d9d700 1 -- 172.21.15.80:0/78077731 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa24810d580 msgr2=0x7fa24816ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:13.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa246d9d700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa24810d580 0x7fa24816ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:13.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa246d9d700 1 -- 172.21.15.80:0/78077731 >> v1:172.21.15.80:6789/0 conn(0x7fa248153db0 legacy=0x7fa24810dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:13.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa23ffff700 1 -- 172.21.15.80:0/78077731 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122769711 0 0) 0x7fa2380099a0 con 0x7fa248153db0 2019-11-28T11:29:13.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa246d9d700 1 -- 172.21.15.80:0/78077731 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa248106be0 con 0x7fa24810cbb0 2019-11-28T11:29:13.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa246d9d700 1 --2- 172.21.15.80:0/78077731 >> v2:172.21.15.80:3300/0 conn(0x7fa24810cbb0 0x7fa24810d040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa230010720 tx=0x7fa230010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa246d9d700 1 --2- 172.21.15.80:0/78077731 >> v2:172.21.15.80:3300/0 conn(0x7fa24810cbb0 0x7fa24810d040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa230010720 tx=0x7fa230010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa246d9d700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24810cbb0 0x7fa24810d040 secure :-1 s=READY pgs=689 cs=0 l=1 rx=0x7fa230010720 tx=0x7fa230010550).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:13.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa246d9d700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24810cbb0 0x7fa24810d040 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7fa230010720 tx=0x7fa230010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa23ffff700 1 -- 172.21.15.80:0/78077731 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa230001150 con 0x7fa24810cbb0 2019-11-28T11:29:13.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa246d9d700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24810cbb0 0x7fa24810d040 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7fa230010720 tx=0x7fa230010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa23ffff700 1 -- 172.21.15.80:0/78077731 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2300015d0 con 0x7fa24810cbb0 2019-11-28T11:29:13.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa246d9d700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24810cbb0 0x7fa24810d040 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7fa230010720 tx=0x7fa230010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa23ffff700 1 -- 172.21.15.80:0/78077731 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa230004550 con 0x7fa24810cbb0 2019-11-28T11:29:13.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa24d17e700 1 -- 172.21.15.80:0/78077731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa248106f60 con 0x7fa24810cbb0 2019-11-28T11:29:13.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa24d17e700 1 -- 172.21.15.80:0/78077731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa248106be0 con 0x7fa24810cbb0 2019-11-28T11:29:13.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.025+0000 7fa246d9d700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24810cbb0 0x7fa24810d040 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7fa230010720 tx=0x7fa230010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.026+0000 7fa23ffff700 1 -- 172.21.15.80:0/78077731 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa230004360 con 0x7fa24810cbb0 2019-11-28T11:29:13.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.026+0000 7fa246d9d700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24810cbb0 0x7fa24810d040 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7fa230010720 tx=0x7fa230010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.026+0000 7fa23ffff700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa220018730 0x7fa22001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:13.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.026+0000 7fa23ffff700 1 -- 172.21.15.80:0/78077731 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa230031dd0 con 0x7fa24810cbb0 2019-11-28T11:29:13.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.026+0000 7fa24759e700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa220018730 0x7fa22001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:13.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.026+0000 7fa24759e700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa220018730 0x7fa22001abc0 crc :-1 s=READY pgs=288 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:13.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.034+0000 7fa24d17e700 1 -- 172.21.15.80:0/78077731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa248106f60 con 0x7fa24810cbb0 2019-11-28T11:29:13.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.037+0000 7fa246d9d700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24810cbb0 0x7fa24810d040 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7fa230010720 tx=0x7fa230010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.037+0000 7fa23ffff700 1 -- 172.21.15.80:0/78077731 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa230000cc0 con 0x7fa24810cbb0 2019-11-28T11:29:13.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.204+0000 7fa24d17e700 1 -- 172.21.15.80:0/78077731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fa248106be0 con 0x7fa24810cbb0 2019-11-28T11:29:13.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.204+0000 7fa246d9d700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24810cbb0 0x7fa24810d040 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7fa230010720 tx=0x7fa230010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.204+0000 7fa23ffff700 1 -- 172.21.15.80:0/78077731 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v57) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa230004360 con 0x7fa24810cbb0 2019-11-28T11:29:13.235 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:29:13.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.206+0000 7fa24d17e700 1 -- 172.21.15.80:0/78077731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa220018730 msgr2=0x7fa22001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:13.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.206+0000 7fa24d17e700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa220018730 0x7fa22001abc0 crc :-1 s=READY pgs=288 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:13.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.206+0000 7fa24d17e700 1 -- 172.21.15.80:0/78077731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24810cbb0 msgr2=0x7fa24810d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:13.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.206+0000 7fa24d17e700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24810cbb0 0x7fa24810d040 secure :-1 s=READY pgs=689 cs=0 l=1 rx=0x7fa230010720 tx=0x7fa230010550).stop 2019-11-28T11:29:13.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.206+0000 7fa24d17e700 1 -- 172.21.15.80:0/78077731 shutdown_connections 2019-11-28T11:29:13.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.206+0000 7fa24d17e700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa220018730 0x7fa22001abc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:13.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.206+0000 7fa24d17e700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa24810d580 0x7fa24816ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:13.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.206+0000 7fa24d17e700 1 --2- 172.21.15.80:0/78077731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa24810cbb0 0x7fa24810d040 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:13.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.207+0000 7fa24d17e700 1 -- 172.21.15.80:0/78077731 shutdown_connections 2019-11-28T11:29:13.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.207+0000 7fa24d17e700 1 -- 172.21.15.80:0/78077731 wait complete. 2019-11-28T11:29:13.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.207+0000 7fa24d17e700 1 -- 172.21.15.80:0/78077731 >> 172.21.15.80:0/78077731 conn(0x7fa24815e2d0 msgr2=0x7fa248147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:13.246 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:29:13.246 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:13.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.335+0000 7fb0d3ab4700 1 Processor -- start 2019-11-28T11:29:13.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.335+0000 7fb0d3ab4700 1 -- start start 2019-11-28T11:29:13.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.336+0000 7fb0d3ab4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb0cc06d120 0x7fb0cc165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:13.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.336+0000 7fb0d3ab4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0cc06d5a0 con 0x7fb0cc06c0a0 2019-11-28T11:29:13.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.336+0000 7fb0d3ab4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0cc06db00 con 0x7fb0cc06c490 2019-11-28T11:29:13.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.336+0000 7fb0d3ab4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0cc06fd60 con 0x7fb0cc06d120 2019-11-28T11:29:13.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.336+0000 7fb0d2051700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb0cc06c0a0 0x7fb0cc072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33710/0 (socket says 172.21.15.80:33710) 2019-11-28T11:29:13.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.336+0000 7fb0d2051700 1 -- 172.21.15.80:0/2678829630 learned_addr learned my addr 172.21.15.80:0/2678829630 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:13.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d2852700 1 --2- 172.21.15.80:0/2678829630 >> v2:172.21.15.174:3300/0 conn(0x7fb0cc06d120 0x7fb0cc165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:13.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d104f700 1 -- 172.21.15.80:0/2678829630 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038151447 0 0) 0x7fb0bc001150 con 0x7fb0cc06c0a0 2019-11-28T11:29:13.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d104f700 1 -- 172.21.15.80:0/2678829630 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0b8002e80 con 0x7fb0cc06c0a0 2019-11-28T11:29:13.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d104f700 1 -- 172.21.15.80:0/2678829630 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 326144976 0 0) 0x7fb0bc001130 con 0x7fb0cc06c0a0 2019-11-28T11:29:13.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d104f700 1 -- 172.21.15.80:0/2678829630 >> v2:172.21.15.174:3300/0 conn(0x7fb0cc06d120 msgr2=0x7fb0cc165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:13.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d104f700 1 --2- 172.21.15.80:0/2678829630 >> v2:172.21.15.174:3300/0 conn(0x7fb0cc06d120 0x7fb0cc165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:13.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d104f700 1 -- 172.21.15.80:0/2678829630 >> v1:172.21.15.174:6789/0 conn(0x7fb0cc06c490 legacy=0x7fb0cc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:13.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d104f700 1 -- 172.21.15.80:0/2678829630 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc0706c0 con 0x7fb0cc06c0a0 2019-11-28T11:29:13.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d104f700 1 -- 172.21.15.80:0/2678829630 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fb0bc001660 con 0x7fb0cc06c0a0 2019-11-28T11:29:13.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d104f700 1 -- 172.21.15.80:0/2678829630 >> v1:172.21.15.80:6789/0 conn(0x7fb0cc06c0a0 legacy=0x7fb0cc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:13.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d104f700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0b8003ab0 0x7fb0b8005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:13.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d104f700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0b8006690 0x7fb0b8008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:13.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d104f700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0b8009380 0x7fb0b800b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:13.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d104f700 1 -- 172.21.15.80:0/2678829630 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b800c000 con 0x7fb0b8003ab0 2019-11-28T11:29:13.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d2051700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0b8003ab0 0x7fb0b8005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:13.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d104f700 1 -- 172.21.15.80:0/2678829630 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b8050200 con 0x7fb0b8009380 2019-11-28T11:29:13.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d104f700 1 -- 172.21.15.80:0/2678829630 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b8050430 con 0x7fb0b8006690 2019-11-28T11:29:13.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d2852700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0b8009380 0x7fb0b800b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:13.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d1850700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0b8006690 0x7fb0b8008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:13.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d2051700 1 -- 172.21.15.80:0/2678829630 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0b8006690 msgr2=0x7fb0b8008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:13.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d2051700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0b8006690 0x7fb0b8008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:13.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d2051700 1 -- 172.21.15.80:0/2678829630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0b8009380 msgr2=0x7fb0b800b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:13.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d2051700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0b8009380 0x7fb0b800b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:13.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d2051700 1 -- 172.21.15.80:0/2678829630 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b80506e0 con 0x7fb0b8003ab0 2019-11-28T11:29:13.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d2852700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0b8009380 0x7fb0b800b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:29:13.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d2852700 1 -- 172.21.15.80:0/2678829630 reap_dead start 2019-11-28T11:29:13.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d2051700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0b8003ab0 0x7fb0b8005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb0bc00f910 tx=0x7fb0bc001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d2051700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0b8003ab0 0x7fb0b8005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb0bc00f910 tx=0x7fb0bc001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.337+0000 7fb0d2051700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0b8003ab0 0x7fb0b8005f10 secure :-1 s=READY pgs=691 cs=0 l=1 rx=0x7fb0bc00f910 tx=0x7fb0bc001dd0).ready entity=mon.0 client_cookie=bb55e28699c15d60 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:13.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.338+0000 7fb0d2051700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0b8003ab0 0x7fb0b8005f10 secure :-1 s=THROTTLE_DONE pgs=691 cs=0 l=1 rx=0x7fb0bc00f910 tx=0x7fb0bc001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.338+0000 7fb0d104f700 1 -- 172.21.15.80:0/2678829630 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0bc001130 con 0x7fb0b8003ab0 2019-11-28T11:29:13.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.338+0000 7fb0d2051700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0b8003ab0 0x7fb0b8005f10 secure :-1 s=THROTTLE_DONE pgs=691 cs=0 l=1 rx=0x7fb0bc00f910 tx=0x7fb0bc001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.338+0000 7fb0d2051700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0b8003ab0 0x7fb0b8005f10 secure :-1 s=THROTTLE_DONE pgs=691 cs=0 l=1 rx=0x7fb0bc00f910 tx=0x7fb0bc001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.338+0000 7fb0d104f700 1 -- 172.21.15.80:0/2678829630 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc004240 con 0x7fb0b8003ab0 2019-11-28T11:29:13.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.338+0000 7fb0d104f700 1 -- 172.21.15.80:0/2678829630 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0bc004990 con 0x7fb0b8003ab0 2019-11-28T11:29:13.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.338+0000 7fb0d3ab4700 1 -- 172.21.15.80:0/2678829630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0b8003ab0 msgr2=0x7fb0b8005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:13.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.338+0000 7fb0d3ab4700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0b8003ab0 0x7fb0b8005f10 secure :-1 s=READY pgs=691 cs=0 l=1 rx=0x7fb0bc00f910 tx=0x7fb0bc001dd0).stop 2019-11-28T11:29:13.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.338+0000 7fb0d3ab4700 1 -- 172.21.15.80:0/2678829630 shutdown_connections 2019-11-28T11:29:13.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.338+0000 7fb0d3ab4700 1 --2- 172.21.15.80:0/2678829630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0b8003ab0 0x7fb0b8005f10 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:13.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.338+0000 7fb0d3ab4700 1 -- 172.21.15.80:0/2678829630 shutdown_connections 2019-11-28T11:29:13.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.338+0000 7fb0d3ab4700 1 -- 172.21.15.80:0/2678829630 wait complete. 2019-11-28T11:29:13.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.338+0000 7fb0d3ab4700 1 -- 172.21.15.80:0/2678829630 >> 172.21.15.80:0/2678829630 conn(0x7fb0cc061cf0 msgr2=0x7fb0cc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:13.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.341+0000 7fb0d3ab4700 1 Processor -- start 2019-11-28T11:29:13.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.341+0000 7fb0d3ab4700 1 -- start start 2019-11-28T11:29:13.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.342+0000 7fb0d3ab4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0cc074d00 0x7fb0cc0750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:13.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.342+0000 7fb0d3ab4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb0cc152bd0 0x7fb0cc140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:13.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.342+0000 7fb0d3ab4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0cc079230 con 0x7fb0cc153040 2019-11-28T11:29:13.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.342+0000 7fb0d3ab4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0cc079e30 con 0x7fb0cc152bd0 2019-11-28T11:29:13.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.342+0000 7fb0d3ab4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc07a100 con 0x7fb0cc074d00 2019-11-28T11:29:13.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.342+0000 7fb0d1850700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb0cc152bd0 0x7fb0cc140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:13.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.342+0000 7fb0d2051700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0cc074d00 0x7fb0cc0750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:13.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.342+0000 7fb0d2852700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fb0cc153040 0x7fb0cc140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:49270/0 (socket says 172.21.15.80:49270) 2019-11-28T11:29:13.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.342+0000 7fb0d2852700 1 -- 172.21.15.80:0/891067604 learned_addr learned my addr 172.21.15.80:0/891067604 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:13.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.342+0000 7fb0d2051700 1 -- 172.21.15.80:0/891067604 >> v2:172.21.15.174:3300/0 conn(0x7fb0cc152bd0 msgr2=0x7fb0cc140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:13.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.342+0000 7fb0d2051700 1 --2- 172.21.15.80:0/891067604 >> v2:172.21.15.174:3300/0 conn(0x7fb0cc152bd0 0x7fb0cc140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:13.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.342+0000 7fb0d2051700 1 -- 172.21.15.80:0/891067604 >> v1:172.21.15.174:6789/0 conn(0x7fb0cc153040 legacy=0x7fb0cc140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:13.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.342+0000 7fb0caffd700 1 -- 172.21.15.80:0/891067604 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520350035 0 0) 0x7fb0c4005550 con 0x7fb0cc153040 2019-11-28T11:29:13.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.342+0000 7fb0d2051700 1 -- 172.21.15.80:0/891067604 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc07b490 con 0x7fb0cc074d00 2019-11-28T11:29:13.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.342+0000 7fb0d1850700 1 --2- 172.21.15.80:0/891067604 >> v2:172.21.15.174:3300/0 conn(0x7fb0cc152bd0 0x7fb0cc140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:13.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.342+0000 7fb0d2051700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0cc074d00 0x7fb0cc0750f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb0bc010370 tx=0x7fb0bc010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.343+0000 7fb0d2051700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0cc074d00 0x7fb0cc0750f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb0bc010370 tx=0x7fb0bc010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.343+0000 7fb0d2051700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0cc074d00 0x7fb0cc0750f0 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7fb0bc010370 tx=0x7fb0bc010710).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:13.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.343+0000 7fb0d2051700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0cc074d00 0x7fb0cc0750f0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fb0bc010370 tx=0x7fb0bc010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.343+0000 7fb0caffd700 1 -- 172.21.15.80:0/891067604 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0bc004240 con 0x7fb0cc074d00 2019-11-28T11:29:13.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.343+0000 7fb0d2051700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0cc074d00 0x7fb0cc0750f0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fb0bc010370 tx=0x7fb0bc010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.343+0000 7fb0d3ab4700 1 -- 172.21.15.80:0/891067604 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0cc07b810 con 0x7fb0cc074d00 2019-11-28T11:29:13.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.343+0000 7fb0caffd700 1 -- 172.21.15.80:0/891067604 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc0014e0 con 0x7fb0cc074d00 2019-11-28T11:29:13.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.343+0000 7fb0d2051700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0cc074d00 0x7fb0cc0750f0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fb0bc010370 tx=0x7fb0bc010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.343+0000 7fb0caffd700 1 -- 172.21.15.80:0/891067604 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0bc004620 con 0x7fb0cc074d00 2019-11-28T11:29:13.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.343+0000 7fb0d3ab4700 1 -- 172.21.15.80:0/891067604 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0cc07b490 con 0x7fb0cc074d00 2019-11-28T11:29:13.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.343+0000 7fb0d2051700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0cc074d00 0x7fb0cc0750f0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fb0bc010370 tx=0x7fb0bc010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.344+0000 7fb0caffd700 1 -- 172.21.15.80:0/891067604 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb0bc004240 con 0x7fb0cc074d00 2019-11-28T11:29:13.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.344+0000 7fb0d2051700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0cc074d00 0x7fb0cc0750f0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fb0bc010370 tx=0x7fb0bc010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.344+0000 7fb0caffd700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0b0018730 0x7fb0b001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:13.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.344+0000 7fb0caffd700 1 -- 172.21.15.80:0/891067604 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb0bc031a30 con 0x7fb0cc074d00 2019-11-28T11:29:13.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.344+0000 7fb0d1850700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0b0018730 0x7fb0b001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:13.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.344+0000 7fb0d1850700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0b0018730 0x7fb0b001abc0 crc :-1 s=READY pgs=289 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:13.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.350+0000 7fb0d3ab4700 1 -- 172.21.15.80:0/891067604 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0cc07b810 con 0x7fb0cc074d00 2019-11-28T11:29:13.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.355+0000 7fb0d2051700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0cc074d00 0x7fb0cc0750f0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fb0bc010370 tx=0x7fb0bc010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.355+0000 7fb0caffd700 1 -- 172.21.15.80:0/891067604 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb0bc001c60 con 0x7fb0cc074d00 2019-11-28T11:29:13.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.525+0000 7fb0d3ab4700 1 -- 172.21.15.80:0/891067604 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0cc07b490 con 0x7fb0cc074d00 2019-11-28T11:29:13.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.526+0000 7fb0d2051700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0cc074d00 0x7fb0cc0750f0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fb0bc010370 tx=0x7fb0bc010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:13.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.526+0000 7fb0caffd700 1 -- 172.21.15.80:0/891067604 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2443 (secure 0 0 0) 0x7fb0bc004240 con 0x7fb0cc074d00 2019-11-28T11:29:13.560 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 30 2019-11-28T11:29:13.560 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:13.560 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5895,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/169206692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":169206692},{"type":"v1","addr":"172.21.15.80:6834","nonce":169206692}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":28},{"gid":5898,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/2970516164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":2970516164},{"type":"v1","addr":"172.21.15.80:6835","nonce":2970516164}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:54.163001+0000","modified":"2019-11-28T11:29:01.914204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5725},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5725":{"gid":5725,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2800771965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2800771965},{"type":"v1","addr":"172.21.15.174:6835","nonce":2800771965}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2019-11-28T11:29:13.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.528+0000 7fb0d3ab4700 1 -- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0b0018730 msgr2=0x7fb0b001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:13.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.528+0000 7fb0d3ab4700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0b0018730 0x7fb0b001abc0 crc :-1 s=READY pgs=289 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:13.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.528+0000 7fb0d3ab4700 1 -- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0cc074d00 msgr2=0x7fb0cc0750f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:13.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.528+0000 7fb0d3ab4700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0cc074d00 0x7fb0cc0750f0 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7fb0bc010370 tx=0x7fb0bc010710).stop 2019-11-28T11:29:13.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.528+0000 7fb0d3ab4700 1 -- 172.21.15.80:0/891067604 shutdown_connections 2019-11-28T11:29:13.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.528+0000 7fb0d3ab4700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0b0018730 0x7fb0b001abc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:13.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.528+0000 7fb0d3ab4700 1 --2- 172.21.15.80:0/891067604 >> v2:172.21.15.174:3300/0 conn(0x7fb0cc152bd0 0x7fb0cc140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:13.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.528+0000 7fb0d3ab4700 1 --2- 172.21.15.80:0/891067604 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0cc074d00 0x7fb0cc0750f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:13.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.528+0000 7fb0d3ab4700 1 -- 172.21.15.80:0/891067604 shutdown_connections 2019-11-28T11:29:13.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.528+0000 7fb0d3ab4700 1 -- 172.21.15.80:0/891067604 wait complete. 2019-11-28T11:29:13.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:13.528+0000 7fb0d3ab4700 1 -- 172.21.15.80:0/891067604 >> 172.21.15.80:0/891067604 conn(0x7fb0cc13fa50 msgr2=0x7fb0cc07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:13.877 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5725}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 8, u'failed': [], u'epoch': 30, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [9], u'info': {u'gid_5725': {u'export_targets': [], u'name': u'c', u'incarnation': 29, u'state_seq': 3, u'state': u'up:active', u'gid': 5725, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2800771965, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2800771965, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2800771965'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:28:54.163001+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:29:01.914204+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:29:13.877 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:29:13.878 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:29:14.014 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:29:14.015 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:29:14.015 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:29:14.015 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5725, 2019-11-28T11:29:14.015 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:29:14.015 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:29:14.015 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 13.071515432, 2019-11-28T11:29:14.016 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 30, 2019-11-28T11:29:14.016 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 57, 2019-11-28T11:29:14.016 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 57, 2019-11-28T11:29:14.016 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 17.352879143999999 2019-11-28T11:29:14.016 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:29:14.024 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5725, "want_state": "up:active", "state": "up:active", "rank_uptime": 13.071515432, "mdsmap_epoch": 30, "osdmap_epoch": 57, "osdmap_epoch_barrier": 57, "uptime": 17.352879143999999 } 2019-11-28T11:29:14.024 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:29:14.024 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:29:14.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:29:14.025 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:29:14.095 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:29:14.095 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:29:14.216 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:29:14.217 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:29:14.217 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:29:14.217 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:29:14.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:29:14.217 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:29:14.299 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:14.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.389+0000 7fd24d1e0700 1 Processor -- start 2019-11-28T11:29:14.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.389+0000 7fd24d1e0700 1 -- start start 2019-11-28T11:29:14.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.390+0000 7fd24d1e0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd24806c0a0 0x7fd248072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:14.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.390+0000 7fd24d1e0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd248072620 0x7fd248164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:14.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.390+0000 7fd24d1e0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24806db00 con 0x7fd2480734e0 2019-11-28T11:29:14.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.390+0000 7fd24d1e0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24806f330 con 0x7fd248072620 2019-11-28T11:29:14.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.390+0000 7fd24d1e0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2480706c0 con 0x7fd24806c0a0 2019-11-28T11:29:14.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.390+0000 7fd24c9df700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd248072620 0x7fd248164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:14.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24c9df700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd248072620 0x7fd248164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34416/0 (socket says 172.21.15.80:34416) 2019-11-28T11:29:14.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.390+0000 7fd246d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd2480734e0 0x7fd248071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33734/0 (socket says 172.21.15.80:33734) 2019-11-28T11:29:14.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24c9df700 1 -- 172.21.15.80:0/3300528030 learned_addr learned my addr 172.21.15.80:0/3300528030 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:14.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24759e700 1 --2- 172.21.15.80:0/3300528030 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd24806c0a0 0x7fd248072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:14.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24c9df700 1 -- 172.21.15.80:0/3300528030 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd24806c0a0 msgr2=0x7fd248072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:14.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24c9df700 1 --2- 172.21.15.80:0/3300528030 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd24806c0a0 0x7fd248072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:14.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24c9df700 1 -- 172.21.15.80:0/3300528030 >> v1:172.21.15.80:6789/0 conn(0x7fd2480734e0 legacy=0x7fd248071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:14.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24659c700 1 -- 172.21.15.80:0/3300528030 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676717787 0 0) 0x7fd238001070 con 0x7fd2480734e0 2019-11-28T11:29:14.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24c9df700 1 -- 172.21.15.80:0/3300528030 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd248070a40 con 0x7fd248072620 2019-11-28T11:29:14.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24c9df700 1 --2- 172.21.15.80:0/3300528030 >> v2:172.21.15.80:3300/0 conn(0x7fd248072620 0x7fd248164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd24000f6b0 tx=0x7fd24000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:14.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24c9df700 1 --2- 172.21.15.80:0/3300528030 >> v2:172.21.15.80:3300/0 conn(0x7fd248072620 0x7fd248164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd24000f6b0 tx=0x7fd24000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:14.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24c9df700 1 --2- 172.21.15.80:0/3300528030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd248072620 0x7fd248164d70 secure :-1 s=READY pgs=694 cs=0 l=1 rx=0x7fd24000f6b0 tx=0x7fd24000fa50).ready entity=mon.0 client_cookie=dddf63faf2bfcba1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:14.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24c9df700 1 --2- 172.21.15.80:0/3300528030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd248072620 0x7fd248164d70 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7fd24000f6b0 tx=0x7fd24000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:14.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24659c700 1 -- 172.21.15.80:0/3300528030 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd240000a70 con 0x7fd248072620 2019-11-28T11:29:14.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24c9df700 1 --2- 172.21.15.80:0/3300528030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd248072620 0x7fd248164d70 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7fd24000f6b0 tx=0x7fd24000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:14.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24659c700 1 -- 172.21.15.80:0/3300528030 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2400010e0 con 0x7fd248072620 2019-11-28T11:29:14.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24c9df700 1 --2- 172.21.15.80:0/3300528030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd248072620 0x7fd248164d70 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7fd24000f6b0 tx=0x7fd24000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:14.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24659c700 1 -- 172.21.15.80:0/3300528030 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2400012d0 con 0x7fd248072620 2019-11-28T11:29:14.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24d1e0700 1 -- 172.21.15.80:0/3300528030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd248072620 msgr2=0x7fd248164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:14.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.391+0000 7fd24d1e0700 1 --2- 172.21.15.80:0/3300528030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd248072620 0x7fd248164d70 secure :-1 s=READY pgs=694 cs=0 l=1 rx=0x7fd24000f6b0 tx=0x7fd24000fa50).stop 2019-11-28T11:29:14.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.392+0000 7fd24d1e0700 1 -- 172.21.15.80:0/3300528030 shutdown_connections 2019-11-28T11:29:14.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.392+0000 7fd24d1e0700 1 --2- 172.21.15.80:0/3300528030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd248072620 0x7fd248164d70 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:14.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.392+0000 7fd24d1e0700 1 --2- 172.21.15.80:0/3300528030 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd24806c0a0 0x7fd248072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:14.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.392+0000 7fd24d1e0700 1 -- 172.21.15.80:0/3300528030 shutdown_connections 2019-11-28T11:29:14.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.392+0000 7fd24d1e0700 1 -- 172.21.15.80:0/3300528030 wait complete. 2019-11-28T11:29:14.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.392+0000 7fd24d1e0700 1 -- 172.21.15.80:0/3300528030 >> 172.21.15.80:0/3300528030 conn(0x7fd248061cf0 msgr2=0x7fd248064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:14.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.394+0000 7fd24d1e0700 1 Processor -- start 2019-11-28T11:29:14.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.394+0000 7fd24d1e0700 1 -- start start 2019-11-28T11:29:14.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.395+0000 7fd24d1e0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd248104820 0x7fd24810c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:14.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.395+0000 7fd24d1e0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd24810c890 0x7fd24810b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:14.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.395+0000 7fd24d1e0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd24810b710 0x7fd24810bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:14.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.395+0000 7fd24d1e0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd248108700 con 0x7fd24810b710 2019-11-28T11:29:14.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.395+0000 7fd24d1e0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2481081f0 con 0x7fd24810c890 2019-11-28T11:29:14.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.395+0000 7fd24d1e0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd248109130 con 0x7fd248104820 2019-11-28T11:29:14.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.395+0000 7fd24c9df700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd24810b710 0x7fd24810bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:14.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.395+0000 7fd24c9df700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd24810b710 0x7fd24810bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34422/0 (socket says 172.21.15.80:34422) 2019-11-28T11:29:14.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.395+0000 7fd24c9df700 1 -- 172.21.15.80:0/451464950 learned_addr learned my addr 172.21.15.80:0/451464950 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:14.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd246d9d700 1 --2- 172.21.15.80:0/451464950 >> v2:172.21.15.174:3300/0 conn(0x7fd24810c890 0x7fd24810b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:14.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd24759e700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd248104820 0x7fd24810c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:14.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd24c9df700 1 -- 172.21.15.80:0/451464950 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd248104820 msgr2=0x7fd24810c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:14.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd24c9df700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd248104820 0x7fd24810c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:14.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd24c9df700 1 -- 172.21.15.80:0/451464950 >> v2:172.21.15.174:3300/0 conn(0x7fd24810c890 msgr2=0x7fd24810b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:14.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd24c9df700 1 --2- 172.21.15.80:0/451464950 >> v2:172.21.15.174:3300/0 conn(0x7fd24810c890 0x7fd24810b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:14.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd24c9df700 1 -- 172.21.15.80:0/451464950 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd248109a90 con 0x7fd24810b710 2019-11-28T11:29:14.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd246d9d700 1 --2- 172.21.15.80:0/451464950 >> v2:172.21.15.174:3300/0 conn(0x7fd24810c890 0x7fd24810b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:29:14.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd24c9df700 1 --2- 172.21.15.80:0/451464950 >> v2:172.21.15.80:3300/0 conn(0x7fd24810b710 0x7fd24810bb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd240054460 tx=0x7fd24000f5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:14.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd24c9df700 1 --2- 172.21.15.80:0/451464950 >> v2:172.21.15.80:3300/0 conn(0x7fd24810b710 0x7fd24810bb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd240054460 tx=0x7fd24000f5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:14.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd24c9df700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd24810b710 0x7fd24810bb70 secure :-1 s=READY pgs=695 cs=0 l=1 rx=0x7fd240054460 tx=0x7fd24000f5e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:14.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd24c9df700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd24810b710 0x7fd24810bb70 secure :-1 s=THROTTLE_DONE pgs=695 cs=0 l=1 rx=0x7fd240054460 tx=0x7fd24000f5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:14.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd23ffff700 1 -- 172.21.15.80:0/451464950 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2400081d0 con 0x7fd24810b710 2019-11-28T11:29:14.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd24c9df700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd24810b710 0x7fd24810bb70 secure :-1 s=THROTTLE_DONE pgs=695 cs=0 l=1 rx=0x7fd240054460 tx=0x7fd24000f5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:14.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd24c9df700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd24810b710 0x7fd24810bb70 secure :-1 s=THROTTLE_DONE pgs=695 cs=0 l=1 rx=0x7fd240054460 tx=0x7fd24000f5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:14.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd23ffff700 1 -- 172.21.15.80:0/451464950 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd240000c80 con 0x7fd24810b710 2019-11-28T11:29:14.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd23ffff700 1 -- 172.21.15.80:0/451464950 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2400014a0 con 0x7fd24810b710 2019-11-28T11:29:14.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd24d1e0700 1 -- 172.21.15.80:0/451464950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd248109e10 con 0x7fd24810b710 2019-11-28T11:29:14.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.396+0000 7fd24d1e0700 1 -- 172.21.15.80:0/451464950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd248109a90 con 0x7fd24810b710 2019-11-28T11:29:14.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.397+0000 7fd24c9df700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd24810b710 0x7fd24810bb70 secure :-1 s=THROTTLE_DONE pgs=695 cs=0 l=1 rx=0x7fd240054460 tx=0x7fd24000f5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:14.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.397+0000 7fd23ffff700 1 -- 172.21.15.80:0/451464950 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd2400010c0 con 0x7fd24810b710 2019-11-28T11:29:14.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.397+0000 7fd24c9df700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd24810b710 0x7fd24810bb70 secure :-1 s=THROTTLE_DONE pgs=695 cs=0 l=1 rx=0x7fd240054460 tx=0x7fd24000f5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:14.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.397+0000 7fd23ffff700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd220018730 0x7fd22001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:14.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.397+0000 7fd23ffff700 1 -- 172.21.15.80:0/451464950 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd240075a40 con 0x7fd24810b710 2019-11-28T11:29:14.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.397+0000 7fd24759e700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd220018730 0x7fd22001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:14.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.398+0000 7fd24759e700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd220018730 0x7fd22001abc0 crc :-1 s=READY pgs=290 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:14.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.405+0000 7fd24d1e0700 1 -- 172.21.15.80:0/451464950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd248109e10 con 0x7fd24810b710 2019-11-28T11:29:14.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.408+0000 7fd24c9df700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd24810b710 0x7fd24810bb70 secure :-1 s=THROTTLE_DONE pgs=695 cs=0 l=1 rx=0x7fd240054460 tx=0x7fd24000f5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:14.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.408+0000 7fd23ffff700 1 -- 172.21.15.80:0/451464950 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd24005b160 con 0x7fd24810b710 2019-11-28T11:29:14.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.582+0000 7fd24d1e0700 1 -- 172.21.15.80:0/451464950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd248109a90 con 0x7fd24810b710 2019-11-28T11:29:14.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.582+0000 7fd24c9df700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd24810b710 0x7fd24810bb70 secure :-1 s=THROTTLE_DONE pgs=695 cs=0 l=1 rx=0x7fd240054460 tx=0x7fd24000f5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:14.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.582+0000 7fd23ffff700 1 -- 172.21.15.80:0/451464950 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2443 (secure 0 0 0) 0x7fd2400018b0 con 0x7fd24810b710 2019-11-28T11:29:14.613 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 30 2019-11-28T11:29:14.613 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:14.613 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5895,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/169206692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":169206692},{"type":"v1","addr":"172.21.15.80:6834","nonce":169206692}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":28},{"gid":5898,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/2970516164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":2970516164},{"type":"v1","addr":"172.21.15.80:6835","nonce":2970516164}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:54.163001+0000","modified":"2019-11-28T11:29:01.914204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5725},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5725":{"gid":5725,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2800771965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2800771965},{"type":"v1","addr":"172.21.15.174:6835","nonce":2800771965}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2019-11-28T11:29:14.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.585+0000 7fd24d1e0700 1 -- 172.21.15.80:0/451464950 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd220018730 msgr2=0x7fd22001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:14.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.585+0000 7fd24d1e0700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd220018730 0x7fd22001abc0 crc :-1 s=READY pgs=290 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:14.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.585+0000 7fd24d1e0700 1 -- 172.21.15.80:0/451464950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd24810b710 msgr2=0x7fd24810bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:14.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.585+0000 7fd24d1e0700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd24810b710 0x7fd24810bb70 secure :-1 s=READY pgs=695 cs=0 l=1 rx=0x7fd240054460 tx=0x7fd24000f5e0).stop 2019-11-28T11:29:14.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.585+0000 7fd24d1e0700 1 -- 172.21.15.80:0/451464950 shutdown_connections 2019-11-28T11:29:14.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.585+0000 7fd24d1e0700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd220018730 0x7fd22001abc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:14.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.585+0000 7fd24d1e0700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd24810b710 0x7fd24810bb70 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:14.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.585+0000 7fd24d1e0700 1 --2- 172.21.15.80:0/451464950 >> v2:172.21.15.174:3300/0 conn(0x7fd24810c890 0x7fd24810b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:14.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.585+0000 7fd24d1e0700 1 --2- 172.21.15.80:0/451464950 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd248104820 0x7fd24810c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:14.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.585+0000 7fd24d1e0700 1 -- 172.21.15.80:0/451464950 shutdown_connections 2019-11-28T11:29:14.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.585+0000 7fd24d1e0700 1 -- 172.21.15.80:0/451464950 wait complete. 2019-11-28T11:29:14.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:14.585+0000 7fd24d1e0700 1 -- 172.21.15.80:0/451464950 >> 172.21.15.80:0/451464950 conn(0x7fd24813d620 msgr2=0x7fd24813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:14.625 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session ls 2019-11-28T11:29:14.750 INFO:teuthology.orchestra.run.smithi174.stdout:[ 2019-11-28T11:29:14.750 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:29:14.750 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 6081, 2019-11-28T11:29:14.750 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:29:14.750 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:29:14.750 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:29:14.751 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 6081 2019-11-28T11:29:14.751 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:14.751 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:29:14.751 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:29:14.751 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.76:0", 2019-11-28T11:29:14.751 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 2799695493 2019-11-28T11:29:14.751 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:29:14.752 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:14.752 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:29:14.752 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:29:14.752 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 1, 2019-11-28T11:29:14.752 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 0, 2019-11-28T11:29:14.752 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 0.56499807800000001, 2019-11-28T11:29:14.752 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:29:14.753 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 0, 2019-11-28T11:29:14.753 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:29:14.753 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:29:14.753 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:29:14.753 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:29:14.753 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:14.753 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:29:14.754 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:29:14.754 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:29:14.754 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:14.754 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:29:14.754 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:29:14.754 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:29:14.754 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:14.755 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:29:14.755 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:29:14.755 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:29:14.755 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:14.755 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:29:14.755 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0.99870004389165434, 2019-11-28T11:29:14.755 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:29:14.756 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:14.756 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.6081 v1:172.21.15.76:0/2799695493", 2019-11-28T11:29:14.756 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [], 2019-11-28T11:29:14.756 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T11:29:14.756 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:29:14.756 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:29:14.756 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:29:14.757 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "0", 2019-11-28T11:29:14.757 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi076", 2019-11-28T11:29:14.757 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:29:14.757 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:29:14.757 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:29:14.757 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:14.757 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:29:14.757 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 6039, 2019-11-28T11:29:14.758 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:29:14.758 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:29:14.758 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:29:14.758 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 6039 2019-11-28T11:29:14.758 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:14.758 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:29:14.758 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:29:14.759 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.16:0", 2019-11-28T11:29:14.759 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 1888035988 2019-11-28T11:29:14.759 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:29:14.759 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:14.759 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:29:14.759 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:29:14.759 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 4, 2019-11-28T11:29:14.760 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 4, 2019-11-28T11:29:14.760 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 6.4079780059999996, 2019-11-28T11:29:14.760 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:29:14.760 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 0, 2019-11-28T11:29:14.760 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:29:14.760 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:29:14.760 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:29:14.761 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:29:14.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:14.761 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:29:14.761 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:29:14.761 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:29:14.761 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:14.761 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:29:14.761 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:29:14.762 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:29:14.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:14.762 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:29:14.762 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:29:14.762 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:29:14.762 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:14.762 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:29:14.763 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 5.9378952324297201, 2019-11-28T11:29:14.763 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:29:14.763 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:14.763 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.6039 v1:172.21.15.16:0/1888035988", 2019-11-28T11:29:14.763 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [], 2019-11-28T11:29:14.763 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T11:29:14.763 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:29:14.764 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:29:14.764 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:29:14.764 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "1", 2019-11-28T11:29:14.764 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi016", 2019-11-28T11:29:14.771 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:29:14.771 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:29:14.771 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:29:14.771 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:29:14.772 INFO:teuthology.orchestra.run.smithi174.stdout:] 2019-11-28T11:29:14.773 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 6081, "entity": { "name": { "type": "client", "num": 6081 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 2799695493 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 0.56499807800000001, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.99870004389165434, "halflife": 300 }, "inst": "client.6081 v1:172.21.15.76:0/2799695493", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } }, { "id": 6039, "entity": { "name": { "type": "client", "num": 6039 }, "addr": { "type": "v1", "addr": "172.21.15.16:0", "nonce": 1888035988 } }, "state": "open", "num_leases": 0, "num_caps": 4, "request_load_avg": 4, "uptime": 6.4079780059999996, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 5.9378952324297201, "halflife": 300 }, "inst": "client.6039 v1:172.21.15.16:0/1888035988", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "1", "hostname": "smithi016", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:29:14.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:29:14.773 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:29:14.773 INFO:teuthology.orchestra.run.smithi076:> import glob 2019-11-28T11:29:14.774 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:29:14.774 INFO:teuthology.orchestra.run.smithi076:> import json 2019-11-28T11:29:14.774 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:29:14.774 INFO:teuthology.orchestra.run.smithi076:> def get_id_to_dir(): 2019-11-28T11:29:14.774 INFO:teuthology.orchestra.run.smithi076:> result = {} 2019-11-28T11:29:14.774 INFO:teuthology.orchestra.run.smithi076:> for dir in glob.glob("/sys/kernel/debug/ceph/*"): 2019-11-28T11:29:14.774 INFO:teuthology.orchestra.run.smithi076:> mds_sessions_lines = open(os.path.join(dir, "mds_sessions")).readlines() 2019-11-28T11:29:14.775 INFO:teuthology.orchestra.run.smithi076:> client_id = mds_sessions_lines[1].split()[1].strip('"'"'"'"'"') 2019-11-28T11:29:14.775 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:29:14.775 INFO:teuthology.orchestra.run.smithi076:> result[client_id] = dir 2019-11-28T11:29:14.775 INFO:teuthology.orchestra.run.smithi076:> return result 2019-11-28T11:29:14.775 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:29:14.775 INFO:teuthology.orchestra.run.smithi076:> print(json.dumps(get_id_to_dir())) 2019-11-28T11:29:14.775 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:29:14.855 INFO:teuthology.orchestra.run.smithi076.stdout:{"0": "/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client6081"} 2019-11-28T11:29:14.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:29:14.856 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:29:14.856 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:29:14.856 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:29:14.857 INFO:teuthology.orchestra.run.smithi076:> print(open(os.path.join("/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client6081", "mds_sessions")).read()) 2019-11-28T11:29:14.857 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:29:14.929 INFO:teuthology.orchestra.run.smithi076.stdout:global_id 6081 2019-11-28T11:29:14.929 INFO:teuthology.orchestra.run.smithi076.stdout:name "0" 2019-11-28T11:29:14.930 INFO:teuthology.orchestra.run.smithi076.stdout:mds.0 open 2019-11-28T11:29:14.930 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:29:14.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:29:14.931 INFO:teuthology.orchestra.run.smithi016:> sudo python -c ' 2019-11-28T11:29:14.931 INFO:teuthology.orchestra.run.smithi016:> import glob 2019-11-28T11:29:14.931 INFO:teuthology.orchestra.run.smithi016:> import os 2019-11-28T11:29:14.931 INFO:teuthology.orchestra.run.smithi016:> import json 2019-11-28T11:29:14.931 INFO:teuthology.orchestra.run.smithi016:> 2019-11-28T11:29:14.931 INFO:teuthology.orchestra.run.smithi016:> def get_id_to_dir(): 2019-11-28T11:29:14.931 INFO:teuthology.orchestra.run.smithi016:> result = {} 2019-11-28T11:29:14.931 INFO:teuthology.orchestra.run.smithi016:> for dir in glob.glob("/sys/kernel/debug/ceph/*"): 2019-11-28T11:29:14.932 INFO:teuthology.orchestra.run.smithi016:> mds_sessions_lines = open(os.path.join(dir, "mds_sessions")).readlines() 2019-11-28T11:29:14.932 INFO:teuthology.orchestra.run.smithi016:> client_id = mds_sessions_lines[1].split()[1].strip('"'"'"'"'"') 2019-11-28T11:29:14.932 INFO:teuthology.orchestra.run.smithi016:> 2019-11-28T11:29:14.932 INFO:teuthology.orchestra.run.smithi016:> result[client_id] = dir 2019-11-28T11:29:14.932 INFO:teuthology.orchestra.run.smithi016:> return result 2019-11-28T11:29:14.932 INFO:teuthology.orchestra.run.smithi016:> 2019-11-28T11:29:14.932 INFO:teuthology.orchestra.run.smithi016:> print(json.dumps(get_id_to_dir())) 2019-11-28T11:29:14.933 INFO:teuthology.orchestra.run.smithi016:> ' 2019-11-28T11:29:15.054 INFO:teuthology.orchestra.run.smithi016.stdout:{"1": "/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client6039"} 2019-11-28T11:29:15.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:29:15.055 INFO:teuthology.orchestra.run.smithi016:> sudo python -c ' 2019-11-28T11:29:15.055 INFO:teuthology.orchestra.run.smithi016:> import os 2019-11-28T11:29:15.055 INFO:teuthology.orchestra.run.smithi016:> 2019-11-28T11:29:15.055 INFO:teuthology.orchestra.run.smithi016:> print(open(os.path.join("/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client6039", "mds_sessions")).read()) 2019-11-28T11:29:15.056 INFO:teuthology.orchestra.run.smithi016:> ' 2019-11-28T11:29:15.125 INFO:teuthology.orchestra.run.smithi016.stdout:global_id 6039 2019-11-28T11:29:15.126 INFO:teuthology.orchestra.run.smithi016.stdout:name "1" 2019-11-28T11:29:15.126 INFO:teuthology.orchestra.run.smithi016.stdout:mds.0 open 2019-11-28T11:29:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: 2019-11-28T11:29:15.126 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic' 2019-11-28T11:29:15.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.216+0000 7fe2f4742700 1 Processor -- start 2019-11-28T11:29:15.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.216+0000 7fe2f4742700 1 -- start start 2019-11-28T11:29:15.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.217+0000 7fe2f4742700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec06c490 0x7fe2ec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:15.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.217+0000 7fe2f4742700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec06db00 con 0x7fe2ec06c0a0 2019-11-28T11:29:15.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.217+0000 7fe2f4742700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec06e000 con 0x7fe2ec06ce60 2019-11-28T11:29:15.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.217+0000 7fe2f4742700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec06fd60 con 0x7fe2ec06c490 2019-11-28T11:29:15.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.217+0000 7fe2f2cdf700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe2ec06c0a0 0x7fe2ec072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33744/0 (socket says 172.21.15.80:33744) 2019-11-28T11:29:15.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.217+0000 7fe2f2cdf700 1 -- 172.21.15.80:0/4144910162 learned_addr learned my addr 172.21.15.80:0/4144910162 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:15.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.217+0000 7fe2f24de700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec06c490 0x7fe2ec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:15.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 -- 172.21.15.80:0/4144910162 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291810599 0 0) 0x7fe2dc001150 con 0x7fe2ec06c0a0 2019-11-28T11:29:15.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 -- 172.21.15.80:0/4144910162 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d8002e80 con 0x7fe2ec06c0a0 2019-11-28T11:29:15.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 -- 172.21.15.80:0/4144910162 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812878918 0 0) 0x7fe2e4000d30 con 0x7fe2ec06ce60 2019-11-28T11:29:15.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 -- 172.21.15.80:0/4144910162 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d80030b0 con 0x7fe2ec06ce60 2019-11-28T11:29:15.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 -- 172.21.15.80:0/4144910162 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4000973416 0 0) 0x7fe2dc001130 con 0x7fe2ec06c0a0 2019-11-28T11:29:15.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 -- 172.21.15.80:0/4144910162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec06c490 msgr2=0x7fe2ec06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:15.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec06c490 0x7fe2ec06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:15.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 -- 172.21.15.80:0/4144910162 >> v1:172.21.15.174:6789/0 conn(0x7fe2ec06ce60 legacy=0x7fe2ec164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:15.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 -- 172.21.15.80:0/4144910162 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec0706c0 con 0x7fe2ec06c0a0 2019-11-28T11:29:15.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 -- 172.21.15.80:0/4144910162 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fe2dc001660 con 0x7fe2ec06c0a0 2019-11-28T11:29:15.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 -- 172.21.15.80:0/4144910162 >> v1:172.21.15.80:6789/0 conn(0x7fe2ec06c0a0 legacy=0x7fe2ec072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:15.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2d8003b80 0x7fe2d8005fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:15.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2d80066b0 0x7fe2d8008b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:15.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f2cdf700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2d8003b80 0x7fe2d8005fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:15.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2d804d3a0 0x7fe2d804f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:15.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 -- 172.21.15.80:0/4144910162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d804fff0 con 0x7fe2d8003b80 2019-11-28T11:29:15.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 -- 172.21.15.80:0/4144910162 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80501e0 con 0x7fe2d80066b0 2019-11-28T11:29:15.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 -- 172.21.15.80:0/4144910162 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8050410 con 0x7fe2d804d3a0 2019-11-28T11:29:15.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f24de700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2d80066b0 0x7fe2d8008b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:15.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f34e0700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2d804d3a0 0x7fe2d804f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:15.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f2cdf700 1 -- 172.21.15.80:0/4144910162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2d804d3a0 msgr2=0x7fe2d804f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:15.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f2cdf700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2d804d3a0 0x7fe2d804f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:15.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f2cdf700 1 -- 172.21.15.80:0/4144910162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2d80066b0 msgr2=0x7fe2d8008b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:15.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f2cdf700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2d80066b0 0x7fe2d8008b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:15.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f2cdf700 1 -- 172.21.15.80:0/4144910162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d80506c0 con 0x7fe2d8003b80 2019-11-28T11:29:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f24de700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2d80066b0 0x7fe2d8008b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:29:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f2cdf700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2d8003b80 0x7fe2d8005fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe2dc00f890 tx=0x7fe2dc00fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f2cdf700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2d8003b80 0x7fe2d8005fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe2dc00f890 tx=0x7fe2dc00fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f2cdf700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2d8003b80 0x7fe2d8005fc0 secure :-1 s=READY pgs=697 cs=0 l=1 rx=0x7fe2dc00f890 tx=0x7fe2dc00fc30).ready entity=mon.0 client_cookie=d077030228f44ae6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f2cdf700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2d8003b80 0x7fe2d8005fc0 secure :-1 s=THROTTLE_DONE pgs=697 cs=0 l=1 rx=0x7fe2dc00f890 tx=0x7fe2dc00fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f1cdd700 1 -- 172.21.15.80:0/4144910162 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2dc000c90 con 0x7fe2d8003b80 2019-11-28T11:29:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f2cdf700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2d8003b80 0x7fe2d8005fc0 secure :-1 s=THROTTLE_DONE pgs=697 cs=0 l=1 rx=0x7fe2dc00f890 tx=0x7fe2dc00fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.218+0000 7fe2f2cdf700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2d8003b80 0x7fe2d8005fc0 secure :-1 s=THROTTLE_DONE pgs=697 cs=0 l=1 rx=0x7fe2dc00f890 tx=0x7fe2dc00fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.219+0000 7fe2f1cdd700 1 -- 172.21.15.80:0/4144910162 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc004240 con 0x7fe2d8003b80 2019-11-28T11:29:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.219+0000 7fe2f1cdd700 1 -- 172.21.15.80:0/4144910162 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2dc004850 con 0x7fe2d8003b80 2019-11-28T11:29:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.219+0000 7fe2f4742700 1 -- 172.21.15.80:0/4144910162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2d8003b80 msgr2=0x7fe2d8005fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.219+0000 7fe2f4742700 1 --2- 172.21.15.80:0/4144910162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2d8003b80 0x7fe2d8005fc0 secure :-1 s=READY pgs=697 cs=0 l=1 rx=0x7fe2dc00f890 tx=0x7fe2dc00fc30).stop 2019-11-28T11:29:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.219+0000 7fe2f34e0700 1 -- 172.21.15.80:0/4144910162 reap_dead start 2019-11-28T11:29:15.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.219+0000 7fe2f4742700 1 -- 172.21.15.80:0/4144910162 shutdown_connections 2019-11-28T11:29:15.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.219+0000 7fe2f4742700 1 -- 172.21.15.80:0/4144910162 shutdown_connections 2019-11-28T11:29:15.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.219+0000 7fe2f4742700 1 -- 172.21.15.80:0/4144910162 wait complete. 2019-11-28T11:29:15.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.219+0000 7fe2f4742700 1 -- 172.21.15.80:0/4144910162 >> 172.21.15.80:0/4144910162 conn(0x7fe2ec061cf0 msgr2=0x7fe2ec064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:15.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.222+0000 7fe2f4742700 1 Processor -- start 2019-11-28T11:29:15.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.222+0000 7fe2f4742700 1 -- start start 2019-11-28T11:29:15.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2f4742700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe2ec0750f0 0x7fe2ec151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:15.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2f4742700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec079230 con 0x7fe2ec074d00 2019-11-28T11:29:15.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2f4742700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec079890 con 0x7fe2ec151f90 2019-11-28T11:29:15.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2f4742700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ec07ab30 con 0x7fe2ec0750f0 2019-11-28T11:29:15.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2f2cdf700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe2ec074d00 0x7fe2ec152bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33756/0 (socket says 172.21.15.80:33756) 2019-11-28T11:29:15.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2f2cdf700 1 -- 172.21.15.80:0/2492501392 learned_addr learned my addr 172.21.15.80:0/2492501392 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:15.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2f24de700 1 --2- 172.21.15.80:0/2492501392 >> v2:172.21.15.174:3300/0 conn(0x7fe2ec0750f0 0x7fe2ec151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:15.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2eb7fe700 1 -- 172.21.15.80:0/2492501392 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551140755 0 0) 0x7fe2dc0012d0 con 0x7fe2ec074d00 2019-11-28T11:29:15.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2eb7fe700 1 -- 172.21.15.80:0/2492501392 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d0002e80 con 0x7fe2ec074d00 2019-11-28T11:29:15.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2eb7fe700 1 -- 172.21.15.80:0/2492501392 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 943418598 0 0) 0x7fe2dc0014d0 con 0x7fe2ec074d00 2019-11-28T11:29:15.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2f24de700 1 -- 172.21.15.80:0/2492501392 >> v1:172.21.15.174:6789/0 conn(0x7fe2ec151f90 legacy=0x7fe2ec168d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:15.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2f24de700 1 -- 172.21.15.80:0/2492501392 >> v1:172.21.15.80:6789/0 conn(0x7fe2ec074d00 legacy=0x7fe2ec152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:15.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2f24de700 1 -- 172.21.15.80:0/2492501392 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec07b490 con 0x7fe2ec0750f0 2019-11-28T11:29:15.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2f24de700 1 --2- 172.21.15.80:0/2492501392 >> v2:172.21.15.174:3300/0 conn(0x7fe2ec0750f0 0x7fe2ec151a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe2d40103a0 tx=0x7fe2d4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2f24de700 1 --2- 172.21.15.80:0/2492501392 >> v2:172.21.15.174:3300/0 conn(0x7fe2ec0750f0 0x7fe2ec151a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe2d40103a0 tx=0x7fe2d4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2f24de700 1 --2- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2ec0750f0 0x7fe2ec151a50 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7fe2d40103a0 tx=0x7fe2d4010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2f24de700 1 --2- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2ec0750f0 0x7fe2ec151a50 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7fe2d40103a0 tx=0x7fe2d4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2eb7fe700 1 -- 172.21.15.80:0/2492501392 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2d4000b30 con 0x7fe2ec0750f0 2019-11-28T11:29:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.223+0000 7fe2f24de700 1 --2- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2ec0750f0 0x7fe2ec151a50 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7fe2d40103a0 tx=0x7fe2d4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.224+0000 7fe2eb7fe700 1 -- 172.21.15.80:0/2492501392 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d4009790 con 0x7fe2ec0750f0 2019-11-28T11:29:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.224+0000 7fe2f24de700 1 --2- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2ec0750f0 0x7fe2ec151a50 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7fe2d40103a0 tx=0x7fe2d4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.224+0000 7fe2f4742700 1 -- 172.21.15.80:0/2492501392 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ec07b810 con 0x7fe2ec0750f0 2019-11-28T11:29:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.224+0000 7fe2eb7fe700 1 -- 172.21.15.80:0/2492501392 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2d4000d20 con 0x7fe2ec0750f0 2019-11-28T11:29:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.224+0000 7fe2f4742700 1 -- 172.21.15.80:0/2492501392 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ec07b490 con 0x7fe2ec0750f0 2019-11-28T11:29:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.224+0000 7fe2f24de700 1 --2- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2ec0750f0 0x7fe2ec151a50 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7fe2d40103a0 tx=0x7fe2d4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.224+0000 7fe2eb7fe700 1 -- 172.21.15.80:0/2492501392 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe2d4000940 con 0x7fe2ec0750f0 2019-11-28T11:29:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.224+0000 7fe2f24de700 1 --2- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2ec0750f0 0x7fe2ec151a50 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7fe2d40103a0 tx=0x7fe2d4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.224+0000 7fe2eb7fe700 1 --2- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2d0018780 0x7fe2d001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:15.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.224+0000 7fe2eb7fe700 1 -- 172.21.15.80:0/2492501392 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe2d4031a80 con 0x7fe2ec0750f0 2019-11-28T11:29:15.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.225+0000 7fe2f2cdf700 1 --2- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2d0018780 0x7fe2d001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:15.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.225+0000 7fe2f2cdf700 1 --2- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2d0018780 0x7fe2d001abf0 crc :-1 s=READY pgs=291 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:15.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.231+0000 7fe2f4742700 1 -- 172.21.15.80:0/2492501392 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ec07b810 con 0x7fe2ec0750f0 2019-11-28T11:29:15.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.235+0000 7fe2f24de700 1 --2- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2ec0750f0 0x7fe2ec151a50 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7fe2d40103a0 tx=0x7fe2d4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:15.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.235+0000 7fe2eb7fe700 1 -- 172.21.15.80:0/2492501392 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe2d4009580 con 0x7fe2ec0750f0 2019-11-28T11:29:15.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.408+0000 7fe2f4742700 1 -- 172.21.15.80:0/2492501392 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic"]} v 0) v1 -- 0x7fe2ec07b490 con 0x7fe2ec0750f0 2019-11-28T11:29:15.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.571+0000 7fe2f24de700 1 --2- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2ec0750f0 0x7fe2ec151a50 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7fe2d40103a0 tx=0x7fe2d4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:15.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.571+0000 7fe2eb7fe700 1 -- 172.21.15.80:0/2492501392 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic"]}]=0 v153) v1 ==== 142+0+0 (secure 0 0 0) 0x7fe2d4000940 con 0x7fe2ec0750f0 2019-11-28T11:29:15.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.574+0000 7fe2f4742700 1 -- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2d0018780 msgr2=0x7fe2d001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:15.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.574+0000 7fe2f4742700 1 --2- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2d0018780 0x7fe2d001abf0 crc :-1 s=READY pgs=291 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:15.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.574+0000 7fe2f4742700 1 -- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2ec0750f0 msgr2=0x7fe2ec151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:15.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.574+0000 7fe2f4742700 1 --2- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2ec0750f0 0x7fe2ec151a50 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7fe2d40103a0 tx=0x7fe2d4010740).stop 2019-11-28T11:29:15.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.574+0000 7fe2f4742700 1 -- 172.21.15.80:0/2492501392 shutdown_connections 2019-11-28T11:29:15.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.574+0000 7fe2f4742700 1 --2- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2d0018780 0x7fe2d001abf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:15.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.574+0000 7fe2f4742700 1 --2- 172.21.15.80:0/2492501392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2ec0750f0 0x7fe2ec151a50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:15.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.574+0000 7fe2f4742700 1 -- 172.21.15.80:0/2492501392 shutdown_connections 2019-11-28T11:29:15.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.574+0000 7fe2f4742700 1 -- 172.21.15.80:0/2492501392 wait complete. 2019-11-28T11:29:15.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:15.574+0000 7fe2f4742700 1 -- 172.21.15.80:0/2492501392 >> 172.21.15.80:0/2492501392 conn(0x7fe2ec13fa50 msgr2=0x7fe2ec07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:15.613 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:29:15.614 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:29:15.679 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:29:15.742 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:29:15.799 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:29:15.856 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:29:15.916 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:29:15.979 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:29:15.980 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:29:15.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:29:15.980 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T11:29:16.050 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:29:16.054 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:29:16.091 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:29:16.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:29:16.091 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:29:16.218 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:29:16.222 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:29:16.264 INFO:tasks.cephfs_test_runner:test_basic (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2019-11-28T11:29:16.264 INFO:tasks.cephfs_test_runner:Starting test: test_config_session_timeout (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T11:29:16.264 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout' 2019-11-28T11:29:16.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.357+0000 7f35f046c700 1 Processor -- start 2019-11-28T11:29:16.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.357+0000 7f35f046c700 1 -- start start 2019-11-28T11:29:16.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.358+0000 7f35f046c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35e806c0a0 0x7f35e8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:16.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.358+0000 7f35f046c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f35e8072620 0x7f35e8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:16.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.358+0000 7f35f046c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e806db00 con 0x7f35e80734e0 2019-11-28T11:29:16.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.358+0000 7f35f046c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e806f330 con 0x7f35e8072620 2019-11-28T11:29:16.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.358+0000 7f35f046c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80706c0 con 0x7f35e806c0a0 2019-11-28T11:29:16.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.358+0000 7f35eea09700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35e806c0a0 0x7f35e8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:16.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.358+0000 7f35ef20a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f35e8072620 0x7f35e8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:16.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.358+0000 7f35ef20a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f35e8072620 0x7f35e8164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:49336/0 (socket says 172.21.15.80:49336) 2019-11-28T11:29:16.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.358+0000 7f35eea09700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35e806c0a0 0x7f35e8072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:36708/0 (socket says 172.21.15.80:36708) 2019-11-28T11:29:16.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.358+0000 7f35ef20a700 1 -- 172.21.15.80:0/2276243756 learned_addr learned my addr 172.21.15.80:0/2276243756 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:16.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.358+0000 7f35ee208700 1 --1- 172.21.15.80:0/2276243756 >> v1:172.21.15.174:6789/0 conn(0x7f35e80734e0 0x7f35e8071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:49312/0 (socket says 172.21.15.80:49312) 2019-11-28T11:29:16.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.358+0000 7f35ef20a700 1 -- 172.21.15.80:0/2276243756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35e806c0a0 msgr2=0x7f35e8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:16.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.358+0000 7f35ef20a700 1 --2- 172.21.15.80:0/2276243756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35e806c0a0 0x7f35e8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:16.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.358+0000 7f35ef20a700 1 -- 172.21.15.80:0/2276243756 >> v1:172.21.15.174:6789/0 conn(0x7f35e80734e0 legacy=0x7f35e8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:16.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.358+0000 7f35eda07700 1 -- 172.21.15.80:0/2276243756 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792985934 0 0) 0x7f35dc001070 con 0x7f35e80734e0 2019-11-28T11:29:16.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.359+0000 7f35ef20a700 1 -- 172.21.15.80:0/2276243756 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e8070a40 con 0x7f35e8072620 2019-11-28T11:29:16.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.359+0000 7f35eea09700 1 --2- 172.21.15.80:0/2276243756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35e806c0a0 0x7f35e8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:16.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.359+0000 7f35ef20a700 1 --2- 172.21.15.80:0/2276243756 >> v2:172.21.15.174:3300/0 conn(0x7f35e8072620 0x7f35e8164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f35d800fae0 tx=0x7f35d800fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:16.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.359+0000 7f35ef20a700 1 --2- 172.21.15.80:0/2276243756 >> v2:172.21.15.174:3300/0 conn(0x7f35e8072620 0x7f35e8164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f35d800fae0 tx=0x7f35d800fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:16.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.359+0000 7f35ef20a700 1 --2- 172.21.15.80:0/2276243756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35e8072620 0x7f35e8164d70 secure :-1 s=READY pgs=406 cs=0 l=1 rx=0x7f35d800fae0 tx=0x7f35d800fe80).ready entity=mon.1 client_cookie=ea8876a9a02ecc34 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:16.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.359+0000 7f35ef20a700 1 --2- 172.21.15.80:0/2276243756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35e8072620 0x7f35e8164d70 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f35d800fae0 tx=0x7f35d800fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:16.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.359+0000 7f35eda07700 1 -- 172.21.15.80:0/2276243756 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35d8000df0 con 0x7f35e8072620 2019-11-28T11:29:16.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.359+0000 7f35ef20a700 1 --2- 172.21.15.80:0/2276243756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35e8072620 0x7f35e8164d70 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f35d800fae0 tx=0x7f35d800fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:16.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.359+0000 7f35ef20a700 1 --2- 172.21.15.80:0/2276243756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35e8072620 0x7f35e8164d70 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f35d800fae0 tx=0x7f35d800fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:16.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.359+0000 7f35eda07700 1 -- 172.21.15.80:0/2276243756 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d80011f0 con 0x7f35e8072620 2019-11-28T11:29:16.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.359+0000 7f35eda07700 1 -- 172.21.15.80:0/2276243756 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35d8001880 con 0x7f35e8072620 2019-11-28T11:29:16.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.359+0000 7f35f046c700 1 -- 172.21.15.80:0/2276243756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35e8072620 msgr2=0x7f35e8164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:16.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.359+0000 7f35f046c700 1 --2- 172.21.15.80:0/2276243756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35e8072620 0x7f35e8164d70 secure :-1 s=READY pgs=406 cs=0 l=1 rx=0x7f35d800fae0 tx=0x7f35d800fe80).stop 2019-11-28T11:29:16.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.360+0000 7f35f046c700 1 -- 172.21.15.80:0/2276243756 shutdown_connections 2019-11-28T11:29:16.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.360+0000 7f35f046c700 1 --2- 172.21.15.80:0/2276243756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35e8072620 0x7f35e8164d70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:16.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.360+0000 7f35f046c700 1 --2- 172.21.15.80:0/2276243756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35e806c0a0 0x7f35e8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:16.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.360+0000 7f35f046c700 1 -- 172.21.15.80:0/2276243756 shutdown_connections 2019-11-28T11:29:16.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.360+0000 7f35f046c700 1 -- 172.21.15.80:0/2276243756 wait complete. 2019-11-28T11:29:16.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.360+0000 7f35f046c700 1 -- 172.21.15.80:0/2276243756 >> 172.21.15.80:0/2276243756 conn(0x7f35e8061cf0 msgr2=0x7f35e8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:16.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.362+0000 7f35f046c700 1 Processor -- start 2019-11-28T11:29:16.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.362+0000 7f35f046c700 1 -- start start 2019-11-28T11:29:16.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.363+0000 7f35f046c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35e813e8e0 0x7f35e814fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:16.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.363+0000 7f35f046c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f35e81500d0 0x7f35e8105fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:16.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.363+0000 7f35f046c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35e81064e0 0x7f35e810e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:16.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.363+0000 7f35f046c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e810d240 con 0x7f35e81064e0 2019-11-28T11:29:16.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.363+0000 7f35f046c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e810d510 con 0x7f35e81500d0 2019-11-28T11:29:16.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.363+0000 7f35f046c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e81048d0 con 0x7f35e813e8e0 2019-11-28T11:29:16.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.363+0000 7f35ef20a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35e81064e0 0x7f35e810e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:16.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.363+0000 7f35ef20a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35e81064e0 0x7f35e810e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34458/0 (socket says 172.21.15.80:34458) 2019-11-28T11:29:16.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.363+0000 7f35ef20a700 1 -- 172.21.15.80:0/500680258 learned_addr learned my addr 172.21.15.80:0/500680258 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:16.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.363+0000 7f35ee208700 1 --2- 172.21.15.80:0/500680258 >> v2:172.21.15.174:3300/0 conn(0x7f35e81500d0 0x7f35e8105fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:16.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.363+0000 7f35eea09700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35e813e8e0 0x7f35e814fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35ef20a700 1 -- 172.21.15.80:0/500680258 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35e813e8e0 msgr2=0x7f35e814fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35ef20a700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35e813e8e0 0x7f35e814fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35ef20a700 1 -- 172.21.15.80:0/500680258 >> v2:172.21.15.174:3300/0 conn(0x7f35e81500d0 msgr2=0x7f35e8105fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35ef20a700 1 --2- 172.21.15.80:0/500680258 >> v2:172.21.15.174:3300/0 conn(0x7f35e81500d0 0x7f35e8105fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35ef20a700 1 -- 172.21.15.80:0/500680258 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e8104c50 con 0x7f35e81064e0 2019-11-28T11:29:16.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35ee208700 1 --2- 172.21.15.80:0/500680258 >> v2:172.21.15.174:3300/0 conn(0x7f35e81500d0 0x7f35e8105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:16.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35ef20a700 1 --2- 172.21.15.80:0/500680258 >> v2:172.21.15.80:3300/0 conn(0x7f35e81064e0 0x7f35e810e250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f35d8010770 tx=0x7f35d8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:16.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35ef20a700 1 --2- 172.21.15.80:0/500680258 >> v2:172.21.15.80:3300/0 conn(0x7f35e81064e0 0x7f35e810e250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f35d8010770 tx=0x7f35d8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:16.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35ef20a700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35e81064e0 0x7f35e810e250 secure :-1 s=READY pgs=699 cs=0 l=1 rx=0x7f35d8010770 tx=0x7f35d8010b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:16.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35ef20a700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35e81064e0 0x7f35e810e250 secure :-1 s=THROTTLE_DONE pgs=699 cs=0 l=1 rx=0x7f35d8010770 tx=0x7f35d8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:16.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35e77fe700 1 -- 172.21.15.80:0/500680258 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35d8000fe0 con 0x7f35e81064e0 2019-11-28T11:29:16.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35ef20a700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35e81064e0 0x7f35e810e250 secure :-1 s=THROTTLE_DONE pgs=699 cs=0 l=1 rx=0x7f35d8010770 tx=0x7f35d8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:16.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35e77fe700 1 -- 172.21.15.80:0/500680258 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d8008530 con 0x7f35e81064e0 2019-11-28T11:29:16.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35ef20a700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35e81064e0 0x7f35e810e250 secure :-1 s=THROTTLE_DONE pgs=699 cs=0 l=1 rx=0x7f35d8010770 tx=0x7f35d8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:16.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35f046c700 1 -- 172.21.15.80:0/500680258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e8104c50 con 0x7f35e81064e0 2019-11-28T11:29:16.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35e77fe700 1 -- 172.21.15.80:0/500680258 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35d80011d0 con 0x7f35e81064e0 2019-11-28T11:29:16.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35f046c700 1 -- 172.21.15.80:0/500680258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e8104c50 con 0x7f35e81064e0 2019-11-28T11:29:16.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.364+0000 7f35ef20a700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35e81064e0 0x7f35e810e250 secure :-1 s=THROTTLE_DONE pgs=699 cs=0 l=1 rx=0x7f35d8010770 tx=0x7f35d8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:16.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.365+0000 7f35e77fe700 1 -- 172.21.15.80:0/500680258 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f35d8000df0 con 0x7f35e81064e0 2019-11-28T11:29:16.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.365+0000 7f35ef20a700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35e81064e0 0x7f35e810e250 secure :-1 s=THROTTLE_DONE pgs=699 cs=0 l=1 rx=0x7f35d8010770 tx=0x7f35d8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:16.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.365+0000 7f35e77fe700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f35c8018730 0x7f35c801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:16.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.365+0000 7f35e77fe700 1 -- 172.21.15.80:0/500680258 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f35d8031da0 con 0x7f35e81064e0 2019-11-28T11:29:16.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.365+0000 7f35eea09700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f35c8018730 0x7f35c801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:16.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.365+0000 7f35eea09700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f35c8018730 0x7f35c801abc0 crc :-1 s=READY pgs=292 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:16.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.372+0000 7f35f046c700 1 -- 172.21.15.80:0/500680258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e8104c50 con 0x7f35e81064e0 2019-11-28T11:29:16.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.376+0000 7f35ef20a700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35e81064e0 0x7f35e810e250 secure :-1 s=THROTTLE_DONE pgs=699 cs=0 l=1 rx=0x7f35d8010770 tx=0x7f35d8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:16.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.376+0000 7f35e77fe700 1 -- 172.21.15.80:0/500680258 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f35d80076d0 con 0x7f35e81064e0 2019-11-28T11:29:16.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.548+0000 7f35f046c700 1 -- 172.21.15.80:0/500680258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout"]} v 0) v1 -- 0x7f35e8104c50 con 0x7f35e81064e0 2019-11-28T11:29:16.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.578+0000 7f35ef20a700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35e81064e0 0x7f35e810e250 secure :-1 s=THROTTLE_DONE pgs=699 cs=0 l=1 rx=0x7f35d8010770 tx=0x7f35d8010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:16.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.578+0000 7f35e77fe700 1 -- 172.21.15.80:0/500680258 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout"]}]=0 v154) v1 ==== 162+0+0 (secure 0 0 0) 0x7f35d8000f10 con 0x7f35e81064e0 2019-11-28T11:29:16.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.582+0000 7f35f046c700 1 -- 172.21.15.80:0/500680258 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f35c8018730 msgr2=0x7f35c801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.582+0000 7f35f046c700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f35c8018730 0x7f35c801abc0 crc :-1 s=READY pgs=292 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.582+0000 7f35f046c700 1 -- 172.21.15.80:0/500680258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35e81064e0 msgr2=0x7f35e810e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.582+0000 7f35f046c700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35e81064e0 0x7f35e810e250 secure :-1 s=READY pgs=699 cs=0 l=1 rx=0x7f35d8010770 tx=0x7f35d8010b10).stop 2019-11-28T11:29:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.582+0000 7f35f046c700 1 -- 172.21.15.80:0/500680258 shutdown_connections 2019-11-28T11:29:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.582+0000 7f35f046c700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f35c8018730 0x7f35c801abc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:16.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.582+0000 7f35f046c700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35e81064e0 0x7f35e810e250 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:16.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.582+0000 7f35f046c700 1 --2- 172.21.15.80:0/500680258 >> v2:172.21.15.174:3300/0 conn(0x7f35e81500d0 0x7f35e8105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:16.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.582+0000 7f35f046c700 1 --2- 172.21.15.80:0/500680258 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35e813e8e0 0x7f35e814fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:16.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.582+0000 7f35f046c700 1 -- 172.21.15.80:0/500680258 shutdown_connections 2019-11-28T11:29:16.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.582+0000 7f35f046c700 1 -- 172.21.15.80:0/500680258 wait complete. 2019-11-28T11:29:16.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:16.582+0000 7f35f046c700 1 -- 172.21.15.80:0/500680258 >> 172.21.15.80:0/500680258 conn(0x7f35e813d620 msgr2=0x7f35e813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:16.621 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:29:16.621 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:29:16.696 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:29:16.757 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:29:16.822 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:29:16.878 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:29:16.939 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:29:16.997 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:29:16.998 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:29:16.998 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:29:16.999 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:29:16.999 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:29:16.999 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:29:17.000 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:29:17.004 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:29:17.004 DEBUG:teuthology.parallel:result is None 2019-11-28T11:29:17.006 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:29:17.007 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:29:17.007 DEBUG:teuthology.parallel:result is None 2019-11-28T11:29:17.007 DEBUG:teuthology.parallel:result is None 2019-11-28T11:29:17.008 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:29:17.008 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:29:17.009 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:29:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.193+0000 7f2944086700 1 Processor -- start 2019-11-28T11:29:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.193+0000 7f2944086700 1 -- start start 2019-11-28T11:29:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f2944086700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f293c06c0a0 0x7f293c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f2944086700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f293c0734e0 0x7f293c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f2944086700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293c06db00 con 0x7f293c072360 2019-11-28T11:29:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f2944086700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293c06f330 con 0x7f293c0734e0 2019-11-28T11:29:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f2944086700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293c0706c0 con 0x7f293c06c0a0 2019-11-28T11:29:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f2942623700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f293c06c0a0 0x7f293c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f2942623700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f293c06c0a0 0x7f293c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:36728/0 (socket says 172.21.15.80:36728) 2019-11-28T11:29:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f2942623700 1 -- 172.21.15.80:0/1952657205 learned_addr learned my addr 172.21.15.80:0/1952657205 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f2941e22700 1 --2- 172.21.15.80:0/1952657205 >> v2:172.21.15.174:3300/0 conn(0x7f293c0734e0 0x7f293c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f2941e22700 1 -- 172.21.15.80:0/1952657205 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f293c06c0a0 msgr2=0x7f293c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f2941e22700 1 --2- 172.21.15.80:0/1952657205 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f293c06c0a0 0x7f293c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f2941e22700 1 -- 172.21.15.80:0/1952657205 >> v1:172.21.15.174:6789/0 conn(0x7f293c072360 legacy=0x7f293c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f2941e22700 1 -- 172.21.15.80:0/1952657205 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c070a40 con 0x7f293c0734e0 2019-11-28T11:29:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f2942623700 1 --2- 172.21.15.80:0/1952657205 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f293c06c0a0 0x7f293c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f2941e22700 1 --2- 172.21.15.80:0/1952657205 >> v2:172.21.15.174:3300/0 conn(0x7f293c0734e0 0x7f293c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f292c00af50 tx=0x7f292c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f2941e22700 1 --2- 172.21.15.80:0/1952657205 >> v2:172.21.15.174:3300/0 conn(0x7f293c0734e0 0x7f293c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f292c00af50 tx=0x7f292c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f2941e22700 1 --2- 172.21.15.80:0/1952657205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c0734e0 0x7f293c071e20 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7f292c00af50 tx=0x7f292c00b760).ready entity=mon.1 client_cookie=eb5ee3f29816bf2a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f2941e22700 1 --2- 172.21.15.80:0/1952657205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c0734e0 0x7f293c071e20 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7f292c00af50 tx=0x7f292c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f2941e22700 1 --2- 172.21.15.80:0/1952657205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c0734e0 0x7f293c071e20 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7f292c00af50 tx=0x7f292c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f2941621700 1 -- 172.21.15.80:0/1952657205 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f292c007210 con 0x7f293c0734e0 2019-11-28T11:29:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f2941e22700 1 --2- 172.21.15.80:0/1952657205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c0734e0 0x7f293c071e20 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7f292c00af50 tx=0x7f292c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f2941621700 1 -- 172.21.15.80:0/1952657205 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c0099b0 con 0x7f293c0734e0 2019-11-28T11:29:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f2941621700 1 -- 172.21.15.80:0/1952657205 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f292c00a080 con 0x7f293c0734e0 2019-11-28T11:29:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f2944086700 1 -- 172.21.15.80:0/1952657205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c0734e0 msgr2=0x7f293c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f2944086700 1 --2- 172.21.15.80:0/1952657205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c0734e0 0x7f293c071e20 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7f292c00af50 tx=0x7f292c00b760).stop 2019-11-28T11:29:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.196+0000 7f2944086700 1 -- 172.21.15.80:0/1952657205 shutdown_connections 2019-11-28T11:29:17.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.196+0000 7f2944086700 1 --2- 172.21.15.80:0/1952657205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c0734e0 0x7f293c071e20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.196+0000 7f2944086700 1 --2- 172.21.15.80:0/1952657205 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f293c06c0a0 0x7f293c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.196+0000 7f2944086700 1 -- 172.21.15.80:0/1952657205 shutdown_connections 2019-11-28T11:29:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.196+0000 7f2944086700 1 -- 172.21.15.80:0/1952657205 wait complete. 2019-11-28T11:29:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.196+0000 7f2944086700 1 -- 172.21.15.80:0/1952657205 >> 172.21.15.80:0/1952657205 conn(0x7f293c061cf0 msgr2=0x7f293c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.199+0000 7f2944086700 1 Processor -- start 2019-11-28T11:29:17.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.199+0000 7f2944086700 1 -- start start 2019-11-28T11:29:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.193+0000 7f9aeb04d700 1 Processor -- start 2019-11-28T11:29:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.193+0000 7f9aeb04d700 1 -- start start 2019-11-28T11:29:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f9aeb04d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9ae406c0a0 0x7f9ae4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f9aeb04d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae4072620 0x7f9ae4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:17.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f9aeb04d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae406db00 con 0x7f9ae40734e0 2019-11-28T11:29:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f9aeb04d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae406fd60 con 0x7f9ae406c0a0 2019-11-28T11:29:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f9aeb04d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae4070030 con 0x7f9ae4072620 2019-11-28T11:29:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f9ae95ea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9ae406c0a0 0x7f9ae4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f9ae95ea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9ae406c0a0 0x7f9ae4072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34462/0 (socket says 172.21.15.80:34462) 2019-11-28T11:29:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f9ae95ea700 1 -- 172.21.15.80:0/3130153980 learned_addr learned my addr 172.21.15.80:0/3130153980 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/3130153980 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae4072620 0x7f9ae4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f9ae9deb700 1 -- 172.21.15.80:0/3130153980 >> v2:172.21.15.80:3300/0 conn(0x7f9ae406c0a0 msgr2=0x7f9ae4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/3130153980 >> v2:172.21.15.80:3300/0 conn(0x7f9ae406c0a0 0x7f9ae4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f9ae9deb700 1 -- 172.21.15.80:0/3130153980 >> v1:172.21.15.80:6789/0 conn(0x7f9ae40734e0 legacy=0x7f9ae4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f9ad7fff700 1 -- 172.21.15.80:0/3130153980 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297858113 0 0) 0x7f9ae0001480 con 0x7f9ae40734e0 2019-11-28T11:29:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f9ae9deb700 1 -- 172.21.15.80:0/3130153980 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae40706c0 con 0x7f9ae4072620 2019-11-28T11:29:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/3130153980 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae4072620 0x7f9ae4164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9ad800af80 tx=0x7f9ad800b280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/3130153980 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae4072620 0x7f9ae4164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9ad800af80 tx=0x7f9ad800b280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/3130153980 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae4072620 0x7f9ae4164d70 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f9ad800af80 tx=0x7f9ad800b280).ready entity=mon.2 client_cookie=fe549a2dcf5df250 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/3130153980 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae4072620 0x7f9ae4164d70 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f9ad800af80 tx=0x7f9ad800b280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f9ad7fff700 1 -- 172.21.15.80:0/3130153980 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ad8007240 con 0x7f9ae4072620 2019-11-28T11:29:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/3130153980 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae4072620 0x7f9ae4164d70 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f9ad800af80 tx=0x7f9ad800b280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/3130153980 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae4072620 0x7f9ae4164d70 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f9ad800af80 tx=0x7f9ad800b280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f9ad7fff700 1 -- 172.21.15.80:0/3130153980 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad8000b10 con 0x7f9ae4072620 2019-11-28T11:29:17.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f9ad7fff700 1 -- 172.21.15.80:0/3130153980 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ad80097f0 con 0x7f9ae4072620 2019-11-28T11:29:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f9aeb04d700 1 -- 172.21.15.80:0/3130153980 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae4072620 msgr2=0x7f9ae4164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f9aeb04d700 1 --2- 172.21.15.80:0/3130153980 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae4072620 0x7f9ae4164d70 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f9ad800af80 tx=0x7f9ad800b280).stop 2019-11-28T11:29:17.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.196+0000 7f9aeb04d700 1 -- 172.21.15.80:0/3130153980 shutdown_connections 2019-11-28T11:29:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.196+0000 7f9aeb04d700 1 --2- 172.21.15.80:0/3130153980 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae4072620 0x7f9ae4164d70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.196+0000 7f9aeb04d700 1 --2- 172.21.15.80:0/3130153980 >> v2:172.21.15.80:3300/0 conn(0x7f9ae406c0a0 0x7f9ae4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.196+0000 7f9aeb04d700 1 -- 172.21.15.80:0/3130153980 shutdown_connections 2019-11-28T11:29:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.196+0000 7f9aeb04d700 1 -- 172.21.15.80:0/3130153980 wait complete. 2019-11-28T11:29:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.196+0000 7f9aeb04d700 1 -- 172.21.15.80:0/3130153980 >> 172.21.15.80:0/3130153980 conn(0x7f9ae4061cf0 msgr2=0x7f9ae4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.199+0000 7f9aeb04d700 1 Processor -- start 2019-11-28T11:29:17.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.199+0000 7f9aeb04d700 1 -- start start 2019-11-28T11:29:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.193+0000 7f1d58a1c700 1 Processor -- start 2019-11-28T11:29:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.193+0000 7f1d58a1c700 1 -- start start 2019-11-28T11:29:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f1d58a1c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d5406c0a0 0x7f1d54072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f1d58a1c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5406db00 con 0x7f1d540734e0 2019-11-28T11:29:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f1d58a1c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5406e000 con 0x7f1d54072620 2019-11-28T11:29:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f1d58a1c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5406f330 con 0x7f1d5406c0a0 2019-11-28T11:29:17.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f1d5259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1d540734e0 0x7f1d54071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33792/0 (socket says 172.21.15.80:33792) 2019-11-28T11:29:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f1d5259c700 1 -- 172.21.15.80:0/659356752 learned_addr learned my addr 172.21.15.80:0/659356752 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.194+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/659356752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d5406c0a0 0x7f1d54072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f1d51d9b700 1 -- 172.21.15.80:0/659356752 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615224646 0 0) 0x7f1d48001150 con 0x7f1d540734e0 2019-11-28T11:29:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f1d51d9b700 1 -- 172.21.15.80:0/659356752 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d3c002e80 con 0x7f1d540734e0 2019-11-28T11:29:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f1d52d9d700 1 -- 172.21.15.80:0/659356752 >> v1:172.21.15.174:6789/0 conn(0x7f1d54072620 legacy=0x7f1d54164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f1d52d9d700 1 -- 172.21.15.80:0/659356752 >> v1:172.21.15.80:6789/0 conn(0x7f1d540734e0 legacy=0x7f1d54071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f1d52d9d700 1 -- 172.21.15.80:0/659356752 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d540706c0 con 0x7f1d5406c0a0 2019-11-28T11:29:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/659356752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d5406c0a0 0x7f1d54072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1d4400af50 tx=0x7f1d4400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/659356752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d5406c0a0 0x7f1d54072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1d4400af50 tx=0x7f1d4400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/659356752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d5406c0a0 0x7f1d54072fa0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f1d4400af50 tx=0x7f1d4400b760).ready entity=mon.2 client_cookie=1d26b7813d18af7d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/659356752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d5406c0a0 0x7f1d54072fa0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f1d4400af50 tx=0x7f1d4400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/659356752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d5406c0a0 0x7f1d54072fa0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f1d4400af50 tx=0x7f1d4400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f1d51d9b700 1 -- 172.21.15.80:0/659356752 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d44000960 con 0x7f1d5406c0a0 2019-11-28T11:29:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/659356752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d5406c0a0 0x7f1d54072fa0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f1d4400af50 tx=0x7f1d4400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f1d51d9b700 1 -- 172.21.15.80:0/659356752 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d44009860 con 0x7f1d5406c0a0 2019-11-28T11:29:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f1d51d9b700 1 -- 172.21.15.80:0/659356752 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d44009f30 con 0x7f1d5406c0a0 2019-11-28T11:29:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f1d58a1c700 1 -- 172.21.15.80:0/659356752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d5406c0a0 msgr2=0x7f1d54072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.195+0000 7f1d58a1c700 1 --2- 172.21.15.80:0/659356752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d5406c0a0 0x7f1d54072fa0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f1d4400af50 tx=0x7f1d4400b760).stop 2019-11-28T11:29:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.196+0000 7f1d58a1c700 1 -- 172.21.15.80:0/659356752 shutdown_connections 2019-11-28T11:29:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.196+0000 7f1d58a1c700 1 --2- 172.21.15.80:0/659356752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d5406c0a0 0x7f1d54072fa0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.197+0000 7f1d58a1c700 1 -- 172.21.15.80:0/659356752 shutdown_connections 2019-11-28T11:29:17.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.197+0000 7f1d58a1c700 1 -- 172.21.15.80:0/659356752 wait complete. 2019-11-28T11:29:17.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.197+0000 7f1d58a1c700 1 -- 172.21.15.80:0/659356752 >> 172.21.15.80:0/659356752 conn(0x7f1d54061cf0 msgr2=0x7f1d54064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:17.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.199+0000 7f1d58a1c700 1 Processor -- start 2019-11-28T11:29:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.199+0000 7f1d58a1c700 1 -- start start 2019-11-28T11:29:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d58a1c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1d5412cea0 0x7f1d54111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d58a1c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d541230e0 0x7f1d54123570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d58a1c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1d54123ab0 0x7f1d5412d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d58a1c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d54121040 con 0x7f1d54123ab0 2019-11-28T11:29:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d58a1c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d54121310 con 0x7f1d5412cea0 2019-11-28T11:29:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d58a1c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d54120610 con 0x7f1d541230e0 2019-11-28T11:29:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d5359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1d54123ab0 0x7f1d5412d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d52d9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1d5412cea0 0x7f1d54111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d5359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1d54123ab0 0x7f1d5412d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34482/0 (socket says 172.21.15.80:34482) 2019-11-28T11:29:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d5359e700 1 -- 172.21.15.80:0/3130936911 learned_addr learned my addr 172.21.15.80:0/3130936911 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d5259c700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d541230e0 0x7f1d54123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d52d9d700 1 -- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d541230e0 msgr2=0x7f1d54123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d541230e0 0x7f1d54123570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d52d9d700 1 -- 172.21.15.80:0/3130936911 >> v2:172.21.15.80:3300/0 conn(0x7f1d54123ab0 msgr2=0x7f1d5412d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/3130936911 >> v2:172.21.15.80:3300/0 conn(0x7f1d54123ab0 0x7f1d5412d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d52d9d700 1 -- 172.21.15.80:0/3130936911 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d541219a0 con 0x7f1d5412cea0 2019-11-28T11:29:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/3130936911 >> v2:172.21.15.174:3300/0 conn(0x7f1d5412cea0 0x7f1d54111db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d44010380 tx=0x7f1d44010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/3130936911 >> v2:172.21.15.174:3300/0 conn(0x7f1d5412cea0 0x7f1d54111db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d44010380 tx=0x7f1d44010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5412cea0 0x7f1d54111db0 secure :-1 s=READY pgs=411 cs=0 l=1 rx=0x7f1d44010380 tx=0x7f1d44010200).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5412cea0 0x7f1d54111db0 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f1d44010380 tx=0x7f1d44010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5412cea0 0x7f1d54111db0 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f1d44010380 tx=0x7f1d44010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5412cea0 0x7f1d54111db0 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f1d44010380 tx=0x7f1d44010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f1d437fe700 1 -- 172.21.15.80:0/3130936911 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d44000940 con 0x7f1d5412cea0 2019-11-28T11:29:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f1d437fe700 1 -- 172.21.15.80:0/3130936911 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d44009770 con 0x7f1d5412cea0 2019-11-28T11:29:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f1d437fe700 1 -- 172.21.15.80:0/3130936911 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d44009ec0 con 0x7f1d5412cea0 2019-11-28T11:29:17.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f1d58a1c700 1 -- 172.21.15.80:0/3130936911 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d54121d20 con 0x7f1d5412cea0 2019-11-28T11:29:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f1d58a1c700 1 -- 172.21.15.80:0/3130936911 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d541122f0 con 0x7f1d5412cea0 2019-11-28T11:29:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5412cea0 0x7f1d54111db0 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f1d44010380 tx=0x7f1d44010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f1d437fe700 1 -- 172.21.15.80:0/3130936911 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1d44009960 con 0x7f1d5412cea0 2019-11-28T11:29:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f1d437fe700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d38018730 0x7f1d3801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:17.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5412cea0 0x7f1d54111db0 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f1d44010380 tx=0x7f1d44010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f1d437fe700 1 -- 172.21.15.80:0/3130936911 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1d44009940 con 0x7f1d5412cea0 2019-11-28T11:29:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f1d5259c700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d38018730 0x7f1d3801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.203+0000 7f1d5259c700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d38018730 0x7f1d3801abc0 crc :-1 s=READY pgs=293 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.208+0000 7f1d58a1c700 1 -- 172.21.15.80:0/3130936911 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d541219a0 con 0x7f1d5412cea0 2019-11-28T11:29:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.218+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5412cea0 0x7f1d54111db0 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f1d44010380 tx=0x7f1d44010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.218+0000 7f1d437fe700 1 -- 172.21.15.80:0/3130936911 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1d4400a160 con 0x7f1d5412cea0 2019-11-28T11:29:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f2944086700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f293c167e60 0x7f293c16a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f2944086700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293c106a10 con 0x7f293c109870 2019-11-28T11:29:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f2944086700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293c140bc0 con 0x7f293c1401d0 2019-11-28T11:29:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f2944086700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293c13bc40 con 0x7f293c167e60 2019-11-28T11:29:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f2942e24700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f293c167e60 0x7f293c16a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f2941e22700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f293c109870 0x7f293c139b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33804/0 (socket says 172.21.15.80:33804) 2019-11-28T11:29:17.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f2941e22700 1 -- 172.21.15.80:0/400287125 learned_addr learned my addr 172.21.15.80:0/400287125 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f2942e24700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f293c167e60 0x7f293c16a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:49370/0 (socket says 172.21.15.80:49370) 2019-11-28T11:29:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f2942e24700 1 -- 172.21.15.80:0/400287125 >> v1:172.21.15.174:6789/0 conn(0x7f293c1401d0 legacy=0x7f293c139300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f2942e24700 1 -- 172.21.15.80:0/400287125 >> v1:172.21.15.80:6789/0 conn(0x7f293c109870 legacy=0x7f293c139b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f2942e24700 1 -- 172.21.15.80:0/400287125 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c106fb0 con 0x7f293c167e60 2019-11-28T11:29:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f2942e24700 1 --2- 172.21.15.80:0/400287125 >> v2:172.21.15.174:3300/0 conn(0x7f293c167e60 0x7f293c16a260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2934010730 tx=0x7f2934010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f2942e24700 1 --2- 172.21.15.80:0/400287125 >> v2:172.21.15.174:3300/0 conn(0x7f293c167e60 0x7f293c16a260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2934010730 tx=0x7f2934010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f2942e24700 1 --2- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c167e60 0x7f293c16a260 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7f2934010730 tx=0x7f2934010ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f2942e24700 1 --2- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c167e60 0x7f293c16a260 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f2934010730 tx=0x7f2934010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f2942e24700 1 --2- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c167e60 0x7f293c16a260 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f2934010730 tx=0x7f2934010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f2942e24700 1 --2- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c167e60 0x7f293c16a260 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f2934010730 tx=0x7f2934010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f2932ffd700 1 -- 172.21.15.80:0/400287125 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2934000ce0 con 0x7f293c167e60 2019-11-28T11:29:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f2932ffd700 1 -- 172.21.15.80:0/400287125 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2934009d10 con 0x7f293c167e60 2019-11-28T11:29:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f2932ffd700 1 -- 172.21.15.80:0/400287125 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f293400a460 con 0x7f293c167e60 2019-11-28T11:29:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f2944086700 1 -- 172.21.15.80:0/400287125 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f293c107330 con 0x7f293c167e60 2019-11-28T11:29:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f2944086700 1 -- 172.21.15.80:0/400287125 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293c109d00 con 0x7f293c167e60 2019-11-28T11:29:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f2942e24700 1 --2- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c167e60 0x7f293c16a260 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f2934010730 tx=0x7f2934010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f2932ffd700 1 -- 172.21.15.80:0/400287125 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2934009b20 con 0x7f293c167e60 2019-11-28T11:29:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f2942e24700 1 --2- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c167e60 0x7f293c16a260 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f2934010730 tx=0x7f2934010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.203+0000 7f2932ffd700 1 --2- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2924018730 0x7f292401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.203+0000 7f2932ffd700 1 -- 172.21.15.80:0/400287125 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2934031de0 con 0x7f293c167e60 2019-11-28T11:29:17.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.203+0000 7f2942623700 1 --2- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2924018730 0x7f292401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.203+0000 7f2942623700 1 --2- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2924018730 0x7f292401abc0 crc :-1 s=READY pgs=295 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.208+0000 7f2944086700 1 -- 172.21.15.80:0/400287125 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293c106fb0 con 0x7f293c167e60 2019-11-28T11:29:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.215+0000 7f2942e24700 1 --2- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c167e60 0x7f293c16a260 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f2934010730 tx=0x7f2934010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.215+0000 7f2932ffd700 1 -- 172.21.15.80:0/400287125 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2934009910 con 0x7f293c167e60 2019-11-28T11:29:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f9aeb04d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae413e9e0 0x7f9ae4108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:17.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f9aeb04d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9ae4109430 0x7f9ae41098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f9aeb04d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae41066e0 con 0x7f9ae413e5f0 2019-11-28T11:29:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f9aeb04d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae410e060 con 0x7f9ae4109430 2019-11-28T11:29:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f9aeb04d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae410e330 con 0x7f9ae413e9e0 2019-11-28T11:29:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f9ae95ea700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9ae413e5f0 0x7f9ae410a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33806/0 (socket says 172.21.15.80:33806) 2019-11-28T11:29:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f9ae95ea700 1 -- 172.21.15.80:0/1868172753 learned_addr learned my addr 172.21.15.80:0/1868172753 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f9ae8de9700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae413e9e0 0x7f9ae4108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.200+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/1868172753 >> v2:172.21.15.174:3300/0 conn(0x7f9ae4109430 0x7f9ae41098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ad5ffb700 1 -- 172.21.15.80:0/1868172753 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240557303 0 0) 0x7f9adc0010b0 con 0x7f9ae413e5f0 2019-11-28T11:29:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ad5ffb700 1 -- 172.21.15.80:0/1868172753 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ac4002e80 con 0x7f9ae413e5f0 2019-11-28T11:29:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ae9deb700 1 -- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae413e9e0 msgr2=0x7f9ae4108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae413e9e0 0x7f9ae4108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ae9deb700 1 -- 172.21.15.80:0/1868172753 >> v1:172.21.15.80:6789/0 conn(0x7f9ae413e5f0 legacy=0x7f9ae410a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ad5ffb700 1 -- 172.21.15.80:0/1868172753 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1400409373 0 0) 0x7f9adc000940 con 0x7f9ae413e5f0 2019-11-28T11:29:17.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ae9deb700 1 -- 172.21.15.80:0/1868172753 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae410e9c0 con 0x7f9ae4109430 2019-11-28T11:29:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ae8de9700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae413e9e0 0x7f9ae4108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/1868172753 >> v2:172.21.15.174:3300/0 conn(0x7f9ae4109430 0x7f9ae41098a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9ad80543f0 tx=0x7f9ad8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/1868172753 >> v2:172.21.15.174:3300/0 conn(0x7f9ae4109430 0x7f9ae41098a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9ad80543f0 tx=0x7f9ad8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae4109430 0x7f9ae41098a0 secure :-1 s=READY pgs=413 cs=0 l=1 rx=0x7f9ad80543f0 tx=0x7f9ad8054790).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae4109430 0x7f9ae41098a0 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7f9ad80543f0 tx=0x7f9ad8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae4109430 0x7f9ae41098a0 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7f9ad80543f0 tx=0x7f9ad8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ad5ffb700 1 -- 172.21.15.80:0/1868172753 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ad800b050 con 0x7f9ae4109430 2019-11-28T11:29:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae4109430 0x7f9ae41098a0 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7f9ad80543f0 tx=0x7f9ad8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ad5ffb700 1 -- 172.21.15.80:0/1868172753 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad80099b0 con 0x7f9ae4109430 2019-11-28T11:29:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.201+0000 7f9ad5ffb700 1 -- 172.21.15.80:0/1868172753 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ad800a080 con 0x7f9ae4109430 2019-11-28T11:29:17.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f9aeb04d700 1 -- 172.21.15.80:0/1868172753 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae410ed40 con 0x7f9ae4109430 2019-11-28T11:29:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f9aeb04d700 1 -- 172.21.15.80:0/1868172753 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae410e9c0 con 0x7f9ae4109430 2019-11-28T11:29:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae4109430 0x7f9ae41098a0 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7f9ad80543f0 tx=0x7f9ad8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f9ad5ffb700 1 -- 172.21.15.80:0/1868172753 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9ad8009ba0 con 0x7f9ae4109430 2019-11-28T11:29:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae4109430 0x7f9ae41098a0 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7f9ad80543f0 tx=0x7f9ad8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f9ad5ffb700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ac4018780 0x7f9ac401ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f9ad5ffb700 1 -- 172.21.15.80:0/1868172753 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9ad8075cb0 con 0x7f9ae4109430 2019-11-28T11:29:17.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.202+0000 7f9ae95ea700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ac4018780 0x7f9ac401ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.203+0000 7f9ae95ea700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ac4018780 0x7f9ac401ac10 crc :-1 s=READY pgs=294 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.208+0000 7f9aeb04d700 1 -- 172.21.15.80:0/1868172753 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae410ed40 con 0x7f9ae4109430 2019-11-28T11:29:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.212+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae4109430 0x7f9ae41098a0 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7f9ad80543f0 tx=0x7f9ad8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.212+0000 7f9ad5ffb700 1 -- 172.21.15.80:0/1868172753 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9ad80095b0 con 0x7f9ae4109430 2019-11-28T11:29:17.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.400+0000 7f2944086700 1 -- 172.21.15.80:0/400287125 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f293c107330 con 0x7f293c167e60 2019-11-28T11:29:17.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.401+0000 7f9aeb04d700 1 -- 172.21.15.80:0/1868172753 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f9ae410e9c0 con 0x7f9ae4109430 2019-11-28T11:29:17.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.410+0000 7f1d58a1c700 1 -- 172.21.15.80:0/3130936911 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f1d54121d20 con 0x7f1d5412cea0 2019-11-28T11:29:17.608 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:29:17.577+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:29:17.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.582+0000 7f2942e24700 1 --2- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c167e60 0x7f293c16a260 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f2934010730 tx=0x7f2934010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.582+0000 7f2932ffd700 1 -- 172.21.15.80:0/400287125 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5895 v31) v1 ==== 95+0+0 (secure 0 0 0) 0x7f2934000cc0 con 0x7f293c167e60 2019-11-28T11:29:17.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.582+0000 7f9ae9deb700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae4109430 0x7f9ae41098a0 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7f9ad80543f0 tx=0x7f9ad8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.582+0000 7f9ad5ffb700 1 -- 172.21.15.80:0/1868172753 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 5898 v31) v1 ==== 95+0+0 (secure 0 0 0) 0x7f9ad80099b0 con 0x7f9ae4109430 2019-11-28T11:29:17.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.582+0000 7f1d52d9d700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5412cea0 0x7f1d54111db0 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f1d44010380 tx=0x7f1d44010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.582+0000 7f1d437fe700 1 -- 172.21.15.80:0/3130936911 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 5725 v31) v1 ==== 95+0+0 (secure 0 0 0) 0x7f1d44009940 con 0x7f1d5412cea0 2019-11-28T11:29:17.644 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 5895 2019-11-28T11:29:17.644 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 5898 2019-11-28T11:29:17.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.617+0000 7f2944086700 1 -- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2924018730 msgr2=0x7f292401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.617+0000 7f2944086700 1 --2- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2924018730 0x7f292401abc0 crc :-1 s=READY pgs=295 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.617+0000 7f2944086700 1 -- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c167e60 msgr2=0x7f293c16a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.617+0000 7f2944086700 1 --2- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c167e60 0x7f293c16a260 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7f2934010730 tx=0x7f2934010ad0).stop 2019-11-28T11:29:17.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.617+0000 7f2944086700 1 -- 172.21.15.80:0/400287125 shutdown_connections 2019-11-28T11:29:17.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.617+0000 7f2944086700 1 --2- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f293c167e60 0x7f293c16a260 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.617+0000 7f2944086700 1 --2- 172.21.15.80:0/400287125 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2924018730 0x7f292401abc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.617+0000 7f2944086700 1 -- 172.21.15.80:0/400287125 shutdown_connections 2019-11-28T11:29:17.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.617+0000 7f2944086700 1 -- 172.21.15.80:0/400287125 wait complete. 2019-11-28T11:29:17.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.618+0000 7f2944086700 1 -- 172.21.15.80:0/400287125 >> 172.21.15.80:0/400287125 conn(0x7f293c1416d0 msgr2=0x7f293c111c20 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:17.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.617+0000 7f9aeb04d700 1 -- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ac4018780 msgr2=0x7f9ac401ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.617+0000 7f9aeb04d700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ac4018780 0x7f9ac401ac10 crc :-1 s=READY pgs=294 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.617+0000 7f9aeb04d700 1 -- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae4109430 msgr2=0x7f9ae41098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.617+0000 7f9aeb04d700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae4109430 0x7f9ae41098a0 secure :-1 s=READY pgs=413 cs=0 l=1 rx=0x7f9ad80543f0 tx=0x7f9ad8054790).stop 2019-11-28T11:29:17.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.618+0000 7f9aeb04d700 1 -- 172.21.15.80:0/1868172753 shutdown_connections 2019-11-28T11:29:17.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.618+0000 7f9aeb04d700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ac4018780 0x7f9ac401ac10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.618+0000 7f9aeb04d700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae4109430 0x7f9ae41098a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.618+0000 7f9aeb04d700 1 --2- 172.21.15.80:0/1868172753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ae413e9e0 0x7f9ae4108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.618+0000 7f9aeb04d700 1 -- 172.21.15.80:0/1868172753 shutdown_connections 2019-11-28T11:29:17.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.618+0000 7f9aeb04d700 1 -- 172.21.15.80:0/1868172753 wait complete. 2019-11-28T11:29:17.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.618+0000 7f9aeb04d700 1 -- 172.21.15.80:0/1868172753 >> 172.21.15.80:0/1868172753 conn(0x7f9ae413d620 msgr2=0x7f9ae413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:17.652 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 5725 2019-11-28T11:29:17.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.626+0000 7f1d58a1c700 1 -- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d38018730 msgr2=0x7f1d3801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.626+0000 7f1d58a1c700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d38018730 0x7f1d3801abc0 crc :-1 s=READY pgs=293 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.626+0000 7f1d58a1c700 1 -- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5412cea0 msgr2=0x7f1d54111db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.626+0000 7f1d58a1c700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5412cea0 0x7f1d54111db0 secure :-1 s=READY pgs=411 cs=0 l=1 rx=0x7f1d44010380 tx=0x7f1d44010200).stop 2019-11-28T11:29:17.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.626+0000 7f1d58a1c700 1 -- 172.21.15.80:0/3130936911 shutdown_connections 2019-11-28T11:29:17.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.626+0000 7f1d58a1c700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d38018730 0x7f1d3801abc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.626+0000 7f1d58a1c700 1 --2- 172.21.15.80:0/3130936911 >> v2:172.21.15.80:3300/0 conn(0x7f1d54123ab0 0x7f1d5412d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.626+0000 7f1d58a1c700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d541230e0 0x7f1d54123570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.626+0000 7f1d58a1c700 1 --2- 172.21.15.80:0/3130936911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d5412cea0 0x7f1d54111db0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.626+0000 7f1d58a1c700 1 -- 172.21.15.80:0/3130936911 shutdown_connections 2019-11-28T11:29:17.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.626+0000 7f1d58a1c700 1 -- 172.21.15.80:0/3130936911 wait complete. 2019-11-28T11:29:17.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.626+0000 7f1d58a1c700 1 -- 172.21.15.80:0/3130936911 >> 172.21.15.80:0/3130936911 conn(0x7f1d541426c0 msgr2=0x7f1d54110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:17.659 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:29:17.660 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:29:17.666 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:29:17.666 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:29:17.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.821+0000 7fb323392700 1 Processor -- start 2019-11-28T11:29:17.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.821+0000 7fb323392700 1 -- start start 2019-11-28T11:29:17.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.822+0000 7fb323392700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb31c06c0a0 0x7fb31c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:17.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.822+0000 7fb323392700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c06db00 con 0x7fb31c0734e0 2019-11-28T11:29:17.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.822+0000 7fb323392700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c06e000 con 0x7fb31c072620 2019-11-28T11:29:17.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.822+0000 7fb323392700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31c06fd60 con 0x7fb31c06c0a0 2019-11-28T11:29:17.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.822+0000 7fb32112e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb31c0734e0 0x7fb31c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33824/0 (socket says 172.21.15.80:33824) 2019-11-28T11:29:17.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.822+0000 7fb32112e700 1 -- 172.21.15.80:0/3128380889 learned_addr learned my addr 172.21.15.80:0/3128380889 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:17.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.822+0000 7fb32192f700 1 --2- 172.21.15.80:0/3128380889 >> v2:172.21.15.174:3300/0 conn(0x7fb31c06c0a0 0x7fb31c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.822+0000 7fb32092d700 1 -- 172.21.15.80:0/3128380889 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210719787 0 0) 0x7fb318001150 con 0x7fb31c0734e0 2019-11-28T11:29:17.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.822+0000 7fb32092d700 1 -- 172.21.15.80:0/3128380889 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb308002e80 con 0x7fb31c0734e0 2019-11-28T11:29:17.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.822+0000 7fb32192f700 1 -- 172.21.15.80:0/3128380889 >> v1:172.21.15.174:6789/0 conn(0x7fb31c072620 legacy=0x7fb31c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.822+0000 7fb32092d700 1 -- 172.21.15.80:0/3128380889 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445672671 0 0) 0x7fb314000d30 con 0x7fb31c072620 2019-11-28T11:29:17.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.822+0000 7fb32192f700 1 -- 172.21.15.80:0/3128380889 >> v1:172.21.15.80:6789/0 conn(0x7fb31c0734e0 legacy=0x7fb31c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.822+0000 7fb32192f700 1 -- 172.21.15.80:0/3128380889 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c0706c0 con 0x7fb31c06c0a0 2019-11-28T11:29:17.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.822+0000 7fb32192f700 1 --2- 172.21.15.80:0/3128380889 >> v2:172.21.15.174:3300/0 conn(0x7fb31c06c0a0 0x7fb31c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb30c00af50 tx=0x7fb30c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.822+0000 7fb32192f700 1 --2- 172.21.15.80:0/3128380889 >> v2:172.21.15.174:3300/0 conn(0x7fb31c06c0a0 0x7fb31c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb30c00af50 tx=0x7fb30c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.822+0000 7fb32192f700 1 --2- 172.21.15.80:0/3128380889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c06c0a0 0x7fb31c072fa0 secure :-1 s=READY pgs=415 cs=0 l=1 rx=0x7fb30c00af50 tx=0x7fb30c00b760).ready entity=mon.1 client_cookie=bccb0da67ab0f479 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:17.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.823+0000 7fb32192f700 1 --2- 172.21.15.80:0/3128380889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c06c0a0 0x7fb31c072fa0 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7fb30c00af50 tx=0x7fb30c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.823+0000 7fb32092d700 1 -- 172.21.15.80:0/3128380889 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb30c007210 con 0x7fb31c06c0a0 2019-11-28T11:29:17.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.823+0000 7fb32192f700 1 --2- 172.21.15.80:0/3128380889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c06c0a0 0x7fb31c072fa0 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7fb30c00af50 tx=0x7fb30c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.823+0000 7fb32192f700 1 --2- 172.21.15.80:0/3128380889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c06c0a0 0x7fb31c072fa0 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7fb30c00af50 tx=0x7fb30c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.823+0000 7fb32092d700 1 -- 172.21.15.80:0/3128380889 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c0099b0 con 0x7fb31c06c0a0 2019-11-28T11:29:17.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.823+0000 7fb32092d700 1 -- 172.21.15.80:0/3128380889 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb30c00a080 con 0x7fb31c06c0a0 2019-11-28T11:29:17.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.823+0000 7fb323392700 1 -- 172.21.15.80:0/3128380889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c06c0a0 msgr2=0x7fb31c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.823+0000 7fb323392700 1 --2- 172.21.15.80:0/3128380889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c06c0a0 0x7fb31c072fa0 secure :-1 s=READY pgs=415 cs=0 l=1 rx=0x7fb30c00af50 tx=0x7fb30c00b760).stop 2019-11-28T11:29:17.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.823+0000 7fb323392700 1 -- 172.21.15.80:0/3128380889 shutdown_connections 2019-11-28T11:29:17.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.823+0000 7fb323392700 1 --2- 172.21.15.80:0/3128380889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c06c0a0 0x7fb31c072fa0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:17.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.824+0000 7fb323392700 1 -- 172.21.15.80:0/3128380889 shutdown_connections 2019-11-28T11:29:17.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.824+0000 7fb323392700 1 -- 172.21.15.80:0/3128380889 wait complete. 2019-11-28T11:29:17.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.824+0000 7fb323392700 1 -- 172.21.15.80:0/3128380889 >> 172.21.15.80:0/3128380889 conn(0x7fb31c061cf0 msgr2=0x7fb31c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:17.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.826+0000 7fb323392700 1 Processor -- start 2019-11-28T11:29:17.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.826+0000 7fb323392700 1 -- start start 2019-11-28T11:29:17.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb323392700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb31c111db0 0x7fb31c1238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:17.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb323392700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c124260 con 0x7fb31c12cea0 2019-11-28T11:29:17.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb323392700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c12e5d0 con 0x7fb31c165a00 2019-11-28T11:29:17.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb323392700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31c121040 con 0x7fb31c111db0 2019-11-28T11:29:17.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb32192f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb31c12cea0 0x7fb31c1230e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33826/0 (socket says 172.21.15.80:33826) 2019-11-28T11:29:17.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb32192f700 1 -- 172.21.15.80:0/676056875 learned_addr learned my addr 172.21.15.80:0/676056875 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:17.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb32112e700 1 --2- 172.21.15.80:0/676056875 >> v2:172.21.15.174:3300/0 conn(0x7fb31c111db0 0x7fb31c1238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb3127fc700 1 -- 172.21.15.80:0/676056875 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008780011 0 0) 0x7fb30c00b400 con 0x7fb31c12cea0 2019-11-28T11:29:17.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb3127fc700 1 -- 172.21.15.80:0/676056875 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb304002e80 con 0x7fb31c12cea0 2019-11-28T11:29:17.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb3127fc700 1 -- 172.21.15.80:0/676056875 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466134656 0 0) 0x7fb3140015c0 con 0x7fb31c165a00 2019-11-28T11:29:17.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb32112e700 1 -- 172.21.15.80:0/676056875 >> v1:172.21.15.174:6789/0 conn(0x7fb31c165a00 legacy=0x7fb31c167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb32112e700 1 -- 172.21.15.80:0/676056875 >> v1:172.21.15.80:6789/0 conn(0x7fb31c12cea0 legacy=0x7fb31c1230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:17.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb32112e700 1 -- 172.21.15.80:0/676056875 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c1219a0 con 0x7fb31c111db0 2019-11-28T11:29:17.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb32112e700 1 --2- 172.21.15.80:0/676056875 >> v2:172.21.15.174:3300/0 conn(0x7fb31c111db0 0x7fb31c1238e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb318010370 tx=0x7fb318010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb32112e700 1 --2- 172.21.15.80:0/676056875 >> v2:172.21.15.174:3300/0 conn(0x7fb31c111db0 0x7fb31c1238e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb318010370 tx=0x7fb318010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb32112e700 1 --2- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c111db0 0x7fb31c1238e0 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7fb318010370 tx=0x7fb318010710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:17.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.827+0000 7fb32112e700 1 --2- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c111db0 0x7fb31c1238e0 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7fb318010370 tx=0x7fb318010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.828+0000 7fb3127fc700 1 -- 172.21.15.80:0/676056875 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb318000c90 con 0x7fb31c111db0 2019-11-28T11:29:17.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.828+0000 7fb32112e700 1 --2- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c111db0 0x7fb31c1238e0 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7fb318010370 tx=0x7fb318010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.828+0000 7fb32112e700 1 --2- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c111db0 0x7fb31c1238e0 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7fb318010370 tx=0x7fb318010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.828+0000 7fb3127fc700 1 -- 172.21.15.80:0/676056875 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb318004240 con 0x7fb31c111db0 2019-11-28T11:29:17.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.828+0000 7fb3127fc700 1 -- 172.21.15.80:0/676056875 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb318004890 con 0x7fb31c111db0 2019-11-28T11:29:17.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.828+0000 7fb323392700 1 -- 172.21.15.80:0/676056875 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31c121d20 con 0x7fb31c111db0 2019-11-28T11:29:17.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.828+0000 7fb323392700 1 -- 172.21.15.80:0/676056875 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31c1219a0 con 0x7fb31c111db0 2019-11-28T11:29:17.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.828+0000 7fb32112e700 1 --2- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c111db0 0x7fb31c1238e0 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7fb318010370 tx=0x7fb318010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.828+0000 7fb3127fc700 1 -- 172.21.15.80:0/676056875 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb318000c90 con 0x7fb31c111db0 2019-11-28T11:29:17.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.828+0000 7fb32112e700 1 --2- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c111db0 0x7fb31c1238e0 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7fb318010370 tx=0x7fb318010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.828+0000 7fb3127fc700 1 --2- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb304018780 0x7fb30401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:17.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.828+0000 7fb3127fc700 1 -- 172.21.15.80:0/676056875 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fb318031a90 con 0x7fb31c111db0 2019-11-28T11:29:17.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.829+0000 7fb32192f700 1 --2- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb304018780 0x7fb30401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:17.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.829+0000 7fb32192f700 1 --2- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb304018780 0x7fb30401abf0 crc :-1 s=READY pgs=296 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:17.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.836+0000 7fb323392700 1 -- 172.21.15.80:0/676056875 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31c121d20 con 0x7fb31c111db0 2019-11-28T11:29:17.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.840+0000 7fb32112e700 1 --2- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c111db0 0x7fb31c1238e0 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7fb318010370 tx=0x7fb318010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:17.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:17.840+0000 7fb3127fc700 1 -- 172.21.15.80:0/676056875 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb318001210 con 0x7fb31c111db0 2019-11-28T11:29:18.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.014+0000 7fb323392700 1 -- 172.21.15.80:0/676056875 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb31c1219a0 con 0x7fb31c111db0 2019-11-28T11:29:18.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.016+0000 7fb32112e700 1 --2- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c111db0 0x7fb31c1238e0 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7fb318010370 tx=0x7fb318010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.016+0000 7fb3127fc700 1 -- 172.21.15.80:0/676056875 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v60) v1 ==== 81+0+31763 (secure 0 0 0) 0x7fb318000c90 con 0x7fb31c111db0 2019-11-28T11:29:18.047 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:18.047 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:29:18.048 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 60, 2019-11-28T11:29:18.048 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:29:18.048 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:29:18.049 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:29:17.414302+0000", 2019-11-28T11:29:18.049 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:29:18.049 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:29:18.049 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:29:18.049 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:29:18.049 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:29:18.050 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:29:18.050 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:29:18.050 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:29:18.050 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:29:18.050 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:29:18.050 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:29:18.051 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:29:18.051 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:29:18.051 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:29:18.051 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:29:18.051 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 9, 2019-11-28T11:29:18.051 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:29:18.052 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:29:18.052 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:29:18.052 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:29:18.052 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:29:18.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.052 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:29:18.053 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:29:18.053 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:29:18.053 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:29:18.053 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:29:18.053 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:29:18.053 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:29:18.054 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:29:18.054 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:29:18.054 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:29:18.054 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:29:18.054 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:29:18.054 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:29:18.054 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:29:18.055 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:29:18.055 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:29:18.055 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:29:18.055 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:29:18.057 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:29:18.057 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:29:18.057 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:29:18.057 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:29:18.057 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:29:18.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.058 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:29:18.058 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:29:18.058 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:29:18.058 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:29:18.058 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:29:18.058 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:29:18.058 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:29:18.059 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:29:18.059 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:29:18.059 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:29:18.059 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:29:18.059 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:29:18.059 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:29:18.060 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:29:18.060 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:29:18.060 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:29:18.060 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:29:18.060 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:29:18.060 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:29:18.061 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:29:18.061 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:29:18.061 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:29:18.061 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:29:18.061 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:29:18.061 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:29:18.061 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:29:18.062 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:29:18.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.062 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:29:18.062 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:29:18.062 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:29:18.062 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:29:18.063 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:29:18.063 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:29:18.063 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:29:18.063 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:29:18.063 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:29:18.063 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:29:18.063 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:29:18.064 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:29:18.064 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:29:18.064 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:29:18.064 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.065 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 8, 2019-11-28T11:29:18.065 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:29:18.065 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:28:52.545871+0000", 2019-11-28T11:29:18.065 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:29:18.065 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:29:18.066 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:29:18.066 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:29:18.066 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:29:18.066 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:29:18.066 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:29:18.066 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:29:18.067 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:29:18.067 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:29:18.067 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:29:18.067 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:29:18.067 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:29:18.067 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:29:18.068 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:29:18.068 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:29:18.068 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:29:18.068 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:29:18.068 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:29:18.068 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:29:18.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.069 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "56", 2019-11-28T11:29:18.073 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:29:18.073 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:29:18.073 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:29:18.073 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:29:18.073 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:29:18.073 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:29:18.074 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:29:18.074 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:29:18.074 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:29:18.074 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:29:18.074 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:29:18.074 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:29:18.074 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:29:18.075 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:29:18.075 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:29:18.075 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:29:18.075 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:29:18.075 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:29:18.075 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:29:18.075 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:29:18.076 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:29:18.076 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:29:18.076 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:29:18.077 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:29:18.088 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:29:18.089 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:29:18.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.093 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:29:18.093 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:29:18.094 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:29:18.094 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:29:18.094 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:29:18.095 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:29:18.095 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:29:18.095 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:29:18.095 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:29:18.095 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:29:18.095 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:29:18.096 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:29:18.096 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:29:18.096 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:29:18.096 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:29:18.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.096 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:29:18.097 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:29:18.097 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:29:18.097 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.097 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.105 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 9, 2019-11-28T11:29:18.105 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:29:18.105 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:28:53.180206+0000", 2019-11-28T11:29:18.105 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:29:18.105 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:29:18.105 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:29:18.106 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:29:18.106 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:29:18.106 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:29:18.106 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:29:18.106 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:29:18.106 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:29:18.107 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:29:18.107 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:29:18.107 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:29:18.107 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:29:18.107 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:29:18.108 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:29:18.108 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:29:18.108 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:29:18.108 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:29:18.110 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:29:18.110 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:29:18.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.111 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "57", 2019-11-28T11:29:18.111 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:29:18.111 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:29:18.111 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:29:18.111 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:29:18.111 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:29:18.111 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:29:18.112 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:29:18.112 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:29:18.112 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:29:18.112 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:29:18.112 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:29:18.112 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:29:18.113 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:29:18.113 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:29:18.113 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:29:18.113 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:29:18.113 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:29:18.113 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:29:18.113 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:29:18.114 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:29:18.114 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:29:18.114 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:29:18.114 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:29:18.114 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:29:18.114 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:29:18.115 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:29:18.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.115 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:29:18.115 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:29:18.115 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:29:18.115 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:29:18.115 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:29:18.127 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:29:18.128 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:29:18.128 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:29:18.128 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:29:18.128 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:29:18.128 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:29:18.128 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:29:18.129 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:29:18.129 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:29:18.129 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:29:18.129 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.129 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.129 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.130 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:29:18.130 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:29:18.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.131 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:29:18.131 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:29:18.131 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:29:18.131 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:29:18.132 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:29:18.132 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:29:18.132 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:29:18.132 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:29:18.132 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:29:18.132 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 55, 2019-11-28T11:29:18.133 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:29:18.133 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:29:18.133 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:29:18.133 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.133 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.133 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:29:18.134 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:29:18.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.134 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.134 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:29:18.134 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:29:18.134 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.135 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.135 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:29:18.135 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.135 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.135 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:29:18.136 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:29:18.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.136 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.136 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:29:18.136 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:29:18.136 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.137 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.137 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:29:18.137 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.137 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.137 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:29:18.138 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:29:18.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.138 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.139 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:29:18.139 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:29:18.139 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.139 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.139 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:29:18.140 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.140 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.140 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:29:18.140 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:29:18.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.141 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.141 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:29:18.141 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:29:18.141 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.141 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.141 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:29:18.142 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:29:18.142 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:29:18.142 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:29:18.142 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:29:18.142 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:29:18.142 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:29:18.142 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.143 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:29:18.143 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:29:18.143 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:29:18.143 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:29:18.143 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:29:18.144 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:29:18.144 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:29:18.144 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:29:18.144 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:29:18.144 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 55, 2019-11-28T11:29:18.144 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:29:18.144 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:29:18.145 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:29:18.145 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.145 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.145 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:29:18.145 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:29:18.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.146 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.146 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:29:18.146 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:29:18.146 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.146 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.147 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:29:18.147 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.147 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.147 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:29:18.147 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:29:18.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.148 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.148 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:29:18.148 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:29:18.148 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.149 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.149 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:29:18.149 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.150 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.150 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:29:18.150 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:29:18.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.151 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.151 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:29:18.151 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:29:18.151 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.151 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.152 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:29:18.152 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.152 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.152 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:29:18.152 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:29:18.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.153 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.153 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:29:18.153 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:29:18.153 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.153 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.154 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:29:18.154 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:29:18.154 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:29:18.154 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:29:18.154 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:29:18.154 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:29:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:29:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:29:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:29:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:29:18.155 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:29:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:29:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:29:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:29:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:29:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:29:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 33, 2019-11-28T11:29:18.156 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:29:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:29:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:29:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:29:18.157 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:29:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:29:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:29:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.158 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:29:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:29:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:29:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.160 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:29:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:29:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:29:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:29:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:29:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.162 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:29:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:29:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.163 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:29:18.164 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.164 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.164 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:29:18.164 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:29:18.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.165 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.165 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:29:18.166 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:29:18.166 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.166 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.166 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:29:18.167 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:29:18.167 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:29:18.167 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:29:18.167 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:29:18.167 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:29:18.167 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:29:18.168 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.168 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:29:18.168 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:29:18.168 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:29:18.169 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:29:18.169 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:29:18.169 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:29:18.169 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:29:18.169 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:29:18.170 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:29:18.170 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 55, 2019-11-28T11:29:18.170 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:29:18.170 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:29:18.170 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:29:18.170 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.171 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.171 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:29:18.171 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:29:18.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.171 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.172 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:29:18.172 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:29:18.172 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.172 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.172 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:29:18.172 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.173 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.173 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:29:18.173 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:29:18.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.174 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.174 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:29:18.174 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:29:18.174 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.175 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.175 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:29:18.175 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.175 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.175 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:29:18.176 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:29:18.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.176 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.176 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:29:18.176 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:29:18.176 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.177 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.177 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:29:18.177 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.177 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.177 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:29:18.178 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:29:18.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.178 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.178 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:29:18.178 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:29:18.178 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.179 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.179 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:29:18.179 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:29:18.179 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:29:18.179 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:29:18.179 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:29:18.179 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:29:18.180 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:29:18.180 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.181 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:29:18.181 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:29:18.182 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:29:18.183 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:29:18.183 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:29:18.183 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:29:18.183 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:29:18.183 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:29:18.183 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:29:18.183 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 54, 2019-11-28T11:29:18.184 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:29:18.184 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:29:18.184 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:29:18.184 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.184 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.184 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:29:18.185 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:29:18.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.185 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.185 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:29:18.185 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:29:18.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.186 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.186 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:29:18.186 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.186 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.186 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:29:18.187 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:29:18.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.187 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.187 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:29:18.187 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:29:18.187 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.187 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.188 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:29:18.188 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.188 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.188 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:29:18.189 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:29:18.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.189 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.189 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:29:18.189 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:29:18.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.190 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.190 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:29:18.190 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.191 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.191 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:29:18.191 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:29:18.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.192 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.192 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:29:18.192 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:29:18.192 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.192 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.192 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:29:18.193 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:29:18.193 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:29:18.193 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:29:18.193 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:29:18.193 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:29:18.193 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:29:18.193 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.194 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:29:18.194 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:29:18.194 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:29:18.194 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:29:18.194 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:29:18.195 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:29:18.195 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:29:18.195 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:29:18.195 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:29:18.195 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 55, 2019-11-28T11:29:18.195 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:29:18.195 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:29:18.196 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:29:18.196 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.196 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.196 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:29:18.196 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:29:18.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.197 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.197 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:29:18.197 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:29:18.197 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.198 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.198 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:29:18.198 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.198 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.198 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:29:18.199 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:29:18.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.199 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.199 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:29:18.199 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:29:18.199 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.199 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.200 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:29:18.200 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.200 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.200 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:29:18.200 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:29:18.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.201 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.201 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:29:18.202 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:29:18.202 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.202 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.202 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:29:18.202 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.203 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.203 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:29:18.203 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:29:18.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.203 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.203 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:29:18.203 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:29:18.204 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.204 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.204 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:29:18.204 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:29:18.204 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:29:18.204 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:29:18.205 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:29:18.205 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:29:18.205 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:29:18.205 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.205 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:29:18.206 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:29:18.206 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:29:18.206 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:29:18.206 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:29:18.206 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:29:18.206 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:29:18.206 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:29:18.207 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:29:18.207 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 54, 2019-11-28T11:29:18.207 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:29:18.207 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:29:18.207 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:29:18.207 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.208 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.208 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:29:18.208 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:29:18.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.208 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.208 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:29:18.209 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:29:18.209 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.209 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.209 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:29:18.209 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.209 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.210 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:29:18.210 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:29:18.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.210 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.210 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:29:18.210 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:29:18.211 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.211 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.211 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:29:18.211 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.212 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.212 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:29:18.212 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:29:18.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.213 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.213 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:29:18.213 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:29:18.213 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.213 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.214 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:29:18.214 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.214 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.214 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:29:18.214 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:29:18.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.215 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.215 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:29:18.215 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:29:18.215 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.215 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.216 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:29:18.216 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:29:18.216 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:29:18.216 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:29:18.216 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:29:18.216 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:29:18.216 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:29:18.217 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.217 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:29:18.217 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:29:18.217 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:29:18.217 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:29:18.218 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:29:18.218 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:29:18.218 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:29:18.218 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:29:18.218 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:29:18.218 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 55, 2019-11-28T11:29:18.218 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:29:18.219 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:29:18.219 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:29:18.219 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.219 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.219 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:29:18.219 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:29:18.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.220 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.220 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:29:18.220 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:29:18.220 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.220 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.221 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:29:18.221 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.221 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.221 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:29:18.221 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:29:18.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.222 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.222 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:29:18.223 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:29:18.223 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.223 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.223 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:29:18.224 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.224 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.224 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:29:18.224 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:29:18.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.225 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.225 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:29:18.225 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:29:18.225 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.225 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.226 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:29:18.226 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:29:18.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.226 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:29:18.226 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:29:18.226 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:29:18.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.227 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:29:18.227 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:29:18.227 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:29:18.227 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.227 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.228 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:29:18.228 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:29:18.228 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:29:18.228 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:29:18.228 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:29:18.229 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:29:18.229 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:29:18.229 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:18.229 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.229 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:29:18.229 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:29:18.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.230 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:29:18.230 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:29:18.230 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:29:18.230 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:29:18.230 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:29:18.230 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:29:18.230 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:29:18.231 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:29:18.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.231 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:29:18.231 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:29:18.232 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:29:18.232 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:29:18.232 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:29:18.232 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:29:18.232 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:29:18.232 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:29:18.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.233 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:29:18.233 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:29:18.233 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:29:18.233 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:29:18.233 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:29:18.234 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:29:18.234 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:29:18.234 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:29:18.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.234 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:29:18.234 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:29:18.235 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:29:18.235 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:29:18.235 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:29:18.235 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:29:18.235 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:29:18.235 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:29:18.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.236 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:29:18.236 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:29:18.236 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:29:18.236 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:29:18.237 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:29:18.237 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:29:18.237 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:29:18.237 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:29:18.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.238 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:29:18.238 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:29:18.238 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:29:18.238 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:29:18.238 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:29:18.238 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:29:18.238 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:29:18.239 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:29:18.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.239 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:29:18.239 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:29:18.239 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:29:18.239 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:29:18.240 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:29:18.240 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:29:18.240 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:29:18.240 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:29:18.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:18.240 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:29:18.241 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:29:18.241 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:29:18.241 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:29:18.241 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:29:18.241 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:29:18.241 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:29:18.242 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:29:18.242 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.242 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:29:18.243 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:29:18.243 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:29:18.243 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:29:18.243 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:29:18.243 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:29:18.243 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/2800771965": "2019-11-29T11:29:17.414283+0000", 2019-11-28T11:29:18.243 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/2800771965": "2019-11-29T11:29:17.414283+0000" 2019-11-28T11:29:18.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.244 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:29:18.244 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:29:18.244 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:29:18.244 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:29:18.244 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:29:18.244 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:29:18.245 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:29:18.245 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:29:18.245 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:29:18.245 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:29:18.245 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:29:18.245 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:29:18.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.246 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:29:18.246 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:29:18.246 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:29:18.246 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:29:18.246 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:29:18.246 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:29:18.246 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:29:18.247 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:18.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:18.247 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:29:18.247 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:29:18.247 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:29:18.247 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:29:18.247 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:29:18.247 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:29:18.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.020+0000 7fb323392700 1 -- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb304018780 msgr2=0x7fb30401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:18.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.020+0000 7fb323392700 1 --2- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb304018780 0x7fb30401abf0 crc :-1 s=READY pgs=296 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:18.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.020+0000 7fb323392700 1 -- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c111db0 msgr2=0x7fb31c1238e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:18.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.020+0000 7fb323392700 1 --2- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c111db0 0x7fb31c1238e0 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7fb318010370 tx=0x7fb318010710).stop 2019-11-28T11:29:18.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.020+0000 7fb323392700 1 -- 172.21.15.80:0/676056875 shutdown_connections 2019-11-28T11:29:18.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.020+0000 7fb323392700 1 --2- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb304018780 0x7fb30401abf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:18.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.020+0000 7fb323392700 1 --2- 172.21.15.80:0/676056875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c111db0 0x7fb31c1238e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:18.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.020+0000 7fb323392700 1 -- 172.21.15.80:0/676056875 shutdown_connections 2019-11-28T11:29:18.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.020+0000 7fb323392700 1 -- 172.21.15.80:0/676056875 wait complete. 2019-11-28T11:29:18.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.020+0000 7fb323392700 1 -- 172.21.15.80:0/676056875 >> 172.21.15.80:0/676056875 conn(0x7fb31c1426c0 msgr2=0x7fb31c110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:18.252 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:18.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.343+0000 7fba750db700 1 Processor -- start 2019-11-28T11:29:18.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.343+0000 7fba750db700 1 -- start start 2019-11-28T11:29:18.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.344+0000 7fba750db700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fba7006c0a0 0x7fba70072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:18.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.344+0000 7fba750db700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7006db00 con 0x7fba70072620 2019-11-28T11:29:18.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.344+0000 7fba750db700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7006e000 con 0x7fba700734e0 2019-11-28T11:29:18.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.344+0000 7fba750db700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7006fd60 con 0x7fba7006c0a0 2019-11-28T11:29:18.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.344+0000 7fba748da700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fba70072620 0x7fba70164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33836/0 (socket says 172.21.15.80:33836) 2019-11-28T11:29:18.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.344+0000 7fba748da700 1 -- 172.21.15.80:0/2826669125 learned_addr learned my addr 172.21.15.80:0/2826669125 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:18.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6f59e700 1 --2- 172.21.15.80:0/2826669125 >> v2:172.21.15.174:3300/0 conn(0x7fba7006c0a0 0x7fba70072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:18.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6e59c700 1 -- 172.21.15.80:0/2826669125 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208809736 0 0) 0x7fba68001150 con 0x7fba70072620 2019-11-28T11:29:18.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6e59c700 1 -- 172.21.15.80:0/2826669125 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba50002e80 con 0x7fba70072620 2019-11-28T11:29:18.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6e59c700 1 -- 172.21.15.80:0/2826669125 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966221368 0 0) 0x7fba60001030 con 0x7fba700734e0 2019-11-28T11:29:18.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6e59c700 1 -- 172.21.15.80:0/2826669125 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba50004170 con 0x7fba700734e0 2019-11-28T11:29:18.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6f59e700 1 -- 172.21.15.80:0/2826669125 >> v1:172.21.15.174:6789/0 conn(0x7fba700734e0 legacy=0x7fba70071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:18.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6f59e700 1 -- 172.21.15.80:0/2826669125 >> v1:172.21.15.80:6789/0 conn(0x7fba70072620 legacy=0x7fba70164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:18.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6f59e700 1 -- 172.21.15.80:0/2826669125 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba700706c0 con 0x7fba7006c0a0 2019-11-28T11:29:18.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6f59e700 1 --2- 172.21.15.80:0/2826669125 >> v2:172.21.15.174:3300/0 conn(0x7fba7006c0a0 0x7fba70072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fba5800b2d0 tx=0x7fba5800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6f59e700 1 --2- 172.21.15.80:0/2826669125 >> v2:172.21.15.174:3300/0 conn(0x7fba7006c0a0 0x7fba70072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fba5800b2d0 tx=0x7fba5800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6f59e700 1 --2- 172.21.15.80:0/2826669125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7006c0a0 0x7fba70072fa0 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7fba5800b2d0 tx=0x7fba5800bae0).ready entity=mon.1 client_cookie=d4efa50e2ebf8c9a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:18.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6f59e700 1 --2- 172.21.15.80:0/2826669125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7006c0a0 0x7fba70072fa0 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7fba5800b2d0 tx=0x7fba5800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6e59c700 1 -- 172.21.15.80:0/2826669125 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba58000ce0 con 0x7fba7006c0a0 2019-11-28T11:29:18.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6f59e700 1 --2- 172.21.15.80:0/2826669125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7006c0a0 0x7fba70072fa0 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7fba5800b2d0 tx=0x7fba5800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6f59e700 1 --2- 172.21.15.80:0/2826669125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7006c0a0 0x7fba70072fa0 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7fba5800b2d0 tx=0x7fba5800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6e59c700 1 -- 172.21.15.80:0/2826669125 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba58009be0 con 0x7fba7006c0a0 2019-11-28T11:29:18.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba6e59c700 1 -- 172.21.15.80:0/2826669125 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba5800a2b0 con 0x7fba7006c0a0 2019-11-28T11:29:18.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba750db700 1 -- 172.21.15.80:0/2826669125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7006c0a0 msgr2=0x7fba70072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:18.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.345+0000 7fba750db700 1 --2- 172.21.15.80:0/2826669125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7006c0a0 0x7fba70072fa0 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7fba5800b2d0 tx=0x7fba5800bae0).stop 2019-11-28T11:29:18.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.346+0000 7fba750db700 1 -- 172.21.15.80:0/2826669125 shutdown_connections 2019-11-28T11:29:18.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.346+0000 7fba750db700 1 --2- 172.21.15.80:0/2826669125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7006c0a0 0x7fba70072fa0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:18.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.346+0000 7fba750db700 1 -- 172.21.15.80:0/2826669125 shutdown_connections 2019-11-28T11:29:18.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.346+0000 7fba750db700 1 -- 172.21.15.80:0/2826669125 wait complete. 2019-11-28T11:29:18.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.346+0000 7fba750db700 1 -- 172.21.15.80:0/2826669125 >> 172.21.15.80:0/2826669125 conn(0x7fba70061cf0 msgr2=0x7fba70064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:18.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.348+0000 7fba750db700 1 Processor -- start 2019-11-28T11:29:18.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.349+0000 7fba750db700 1 -- start start 2019-11-28T11:29:18.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.349+0000 7fba750db700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba7010e4f0 0x7fba7013b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:18.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.349+0000 7fba750db700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fba7012d820 0x7fba7012dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:18.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.349+0000 7fba750db700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7010b5d0 con 0x7fba7013a720 2019-11-28T11:29:18.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.349+0000 7fba750db700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7010dfd0 con 0x7fba7012d820 2019-11-28T11:29:18.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.349+0000 7fba750db700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7010c8c0 con 0x7fba7010e4f0 2019-11-28T11:29:18.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba748da700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fba7012d820 0x7fba7012dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:18.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba6f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba7010e4f0 0x7fba7013b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:18.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba748da700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fba7012d820 0x7fba7012dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:49414/0 (socket says 172.21.15.80:49414) 2019-11-28T11:29:18.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba6f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba7010e4f0 0x7fba7013b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:36784/0 (socket says 172.21.15.80:36784) 2019-11-28T11:29:18.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba6ed9d700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fba7013a720 0x7fba7013abb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:49384/0 (socket says 172.21.15.80:49384) 2019-11-28T11:29:18.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba748da700 1 -- 172.21.15.80:0/812445535 learned_addr learned my addr 172.21.15.80:0/812445535 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:18.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba748da700 1 -- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba7010e4f0 msgr2=0x7fba7013b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:18.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba748da700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba7010e4f0 0x7fba7013b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:18.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba748da700 1 -- 172.21.15.80:0/812445535 >> v1:172.21.15.174:6789/0 conn(0x7fba7013a720 legacy=0x7fba7013abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:18.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba67fff700 1 -- 172.21.15.80:0/812445535 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985800131 0 0) 0x7fba60000e20 con 0x7fba7013a720 2019-11-28T11:29:18.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba748da700 1 -- 172.21.15.80:0/812445535 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7010dc50 con 0x7fba7012d820 2019-11-28T11:29:18.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba6f59e700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba7010e4f0 0x7fba7013b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:18.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba748da700 1 --2- 172.21.15.80:0/812445535 >> v2:172.21.15.174:3300/0 conn(0x7fba7012d820 0x7fba7012dc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fba68010430 tx=0x7fba680107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba748da700 1 --2- 172.21.15.80:0/812445535 >> v2:172.21.15.174:3300/0 conn(0x7fba7012d820 0x7fba7012dc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fba68010430 tx=0x7fba680107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba748da700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7012d820 0x7fba7012dc90 secure :-1 s=READY pgs=421 cs=0 l=1 rx=0x7fba68010430 tx=0x7fba680107d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:18.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba748da700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7012d820 0x7fba7012dc90 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7fba68010430 tx=0x7fba680107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba67fff700 1 -- 172.21.15.80:0/812445535 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba68000ef0 con 0x7fba7012d820 2019-11-28T11:29:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba748da700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7012d820 0x7fba7012dc90 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7fba68010430 tx=0x7fba680107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba748da700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7012d820 0x7fba7012dc90 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7fba68010430 tx=0x7fba680107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba67fff700 1 -- 172.21.15.80:0/812445535 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba68004240 con 0x7fba7012d820 2019-11-28T11:29:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba67fff700 1 -- 172.21.15.80:0/812445535 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba68004890 con 0x7fba7012d820 2019-11-28T11:29:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba750db700 1 -- 172.21.15.80:0/812445535 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7010dc50 con 0x7fba7012d820 2019-11-28T11:29:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.350+0000 7fba750db700 1 -- 172.21.15.80:0/812445535 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7010dc50 con 0x7fba7012d820 2019-11-28T11:29:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.351+0000 7fba748da700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7012d820 0x7fba7012dc90 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7fba68010430 tx=0x7fba680107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.351+0000 7fba67fff700 1 -- 172.21.15.80:0/812445535 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fba68004430 con 0x7fba7012d820 2019-11-28T11:29:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.351+0000 7fba748da700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7012d820 0x7fba7012dc90 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7fba68010430 tx=0x7fba680107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.351+0000 7fba67fff700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba48018730 0x7fba4801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.351+0000 7fba67fff700 1 -- 172.21.15.80:0/812445535 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fba68031b10 con 0x7fba7012d820 2019-11-28T11:29:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.351+0000 7fba6f59e700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba48018730 0x7fba4801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.351+0000 7fba6f59e700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba48018730 0x7fba4801abc0 crc :-1 s=READY pgs=297 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:18.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.359+0000 7fba750db700 1 -- 172.21.15.80:0/812445535 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7010dc50 con 0x7fba7012d820 2019-11-28T11:29:18.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.362+0000 7fba748da700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7012d820 0x7fba7012dc90 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7fba68010430 tx=0x7fba680107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.362+0000 7fba67fff700 1 -- 172.21.15.80:0/812445535 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fba68000b30 con 0x7fba7012d820 2019-11-28T11:29:18.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.533+0000 7fba750db700 1 -- 172.21.15.80:0/812445535 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba7010dc50 con 0x7fba7012d820 2019-11-28T11:29:18.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.534+0000 7fba748da700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7012d820 0x7fba7012dc90 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7fba68010430 tx=0x7fba680107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.534+0000 7fba67fff700 1 -- 172.21.15.80:0/812445535 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+1425 (secure 0 0 0) 0x7fba68004dd0 con 0x7fba7012d820 2019-11-28T11:29:18.565 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 31 2019-11-28T11:29:18.565 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:18.565 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:54.163001+0000","modified":"2019-11-28T11:29:17.577775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2019-11-28T11:29:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.536+0000 7fba750db700 1 -- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba48018730 msgr2=0x7fba4801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.536+0000 7fba750db700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba48018730 0x7fba4801abc0 crc :-1 s=READY pgs=297 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.536+0000 7fba750db700 1 -- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7012d820 msgr2=0x7fba7012dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.536+0000 7fba750db700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7012d820 0x7fba7012dc90 secure :-1 s=READY pgs=421 cs=0 l=1 rx=0x7fba68010430 tx=0x7fba680107d0).stop 2019-11-28T11:29:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.536+0000 7fba750db700 1 -- 172.21.15.80:0/812445535 shutdown_connections 2019-11-28T11:29:18.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.536+0000 7fba750db700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba7012d820 0x7fba7012dc90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.536+0000 7fba750db700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba48018730 0x7fba4801abc0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.536+0000 7fba750db700 1 --2- 172.21.15.80:0/812445535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba7010e4f0 0x7fba7013b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.536+0000 7fba750db700 1 -- 172.21.15.80:0/812445535 shutdown_connections 2019-11-28T11:29:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.536+0000 7fba750db700 1 -- 172.21.15.80:0/812445535 wait complete. 2019-11-28T11:29:18.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.536+0000 7fba750db700 1 -- 172.21.15.80:0/812445535 >> 172.21.15.80:0/812445535 conn(0x7fba7015dfe0 msgr2=0x7fba7007b880 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:18.577 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:29:18.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.670+0000 7fc81c3d7700 1 Processor -- start 2019-11-28T11:29:18.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.670+0000 7fc81c3d7700 1 -- start start 2019-11-28T11:29:18.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.671+0000 7fc81c3d7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc81406c490 0x7fc81406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:18.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.671+0000 7fc81c3d7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81406db00 con 0x7fc81406c0a0 2019-11-28T11:29:18.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.671+0000 7fc81c3d7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81406e000 con 0x7fc81406ce60 2019-11-28T11:29:18.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.671+0000 7fc81c3d7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81406fd60 con 0x7fc81406c490 2019-11-28T11:29:18.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.671+0000 7fc81a173700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc81406c490 0x7fc81406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:18.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.671+0000 7fc81a173700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc81406c490 0x7fc81406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34536/0 (socket says 172.21.15.80:34536) 2019-11-28T11:29:18.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.671+0000 7fc81a173700 1 -- 172.21.15.80:0/29314861 learned_addr learned my addr 172.21.15.80:0/29314861 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:18.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.671+0000 7fc81a974700 1 --1- 172.21.15.80:0/29314861 >> v1:172.21.15.80:6789/0 conn(0x7fc81406c0a0 0x7fc814072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33848/0 (socket says 172.21.15.80:33848) 2019-11-28T11:29:18.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.672+0000 7fc819972700 1 -- 172.21.15.80:0/29314861 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981211068 0 0) 0x7fc80c0009b0 con 0x7fc81406ce60 2019-11-28T11:29:18.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.672+0000 7fc81a173700 1 -- 172.21.15.80:0/29314861 >> v1:172.21.15.174:6789/0 conn(0x7fc81406ce60 legacy=0x7fc814164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:18.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.672+0000 7fc81a173700 1 -- 172.21.15.80:0/29314861 >> v1:172.21.15.80:6789/0 conn(0x7fc81406c0a0 legacy=0x7fc814072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:18.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.672+0000 7fc81a173700 1 -- 172.21.15.80:0/29314861 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8140706c0 con 0x7fc81406c490 2019-11-28T11:29:18.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.672+0000 7fc81a173700 1 --2- 172.21.15.80:0/29314861 >> v2:172.21.15.80:3300/0 conn(0x7fc81406c490 0x7fc81406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc7fc00fac0 tx=0x7fc7fc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.672+0000 7fc81a173700 1 --2- 172.21.15.80:0/29314861 >> v2:172.21.15.80:3300/0 conn(0x7fc81406c490 0x7fc81406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc7fc00fac0 tx=0x7fc7fc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.672+0000 7fc81a173700 1 --2- 172.21.15.80:0/29314861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc81406c490 0x7fc81406c920 secure :-1 s=READY pgs=708 cs=0 l=1 rx=0x7fc7fc00fac0 tx=0x7fc7fc00fe60).ready entity=mon.0 client_cookie=3da35803e7423fae server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:18.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.672+0000 7fc81a173700 1 --2- 172.21.15.80:0/29314861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc81406c490 0x7fc81406c920 secure :-1 s=THROTTLE_DONE pgs=708 cs=0 l=1 rx=0x7fc7fc00fac0 tx=0x7fc7fc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.672+0000 7fc819972700 1 -- 172.21.15.80:0/29314861 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7fc000ce0 con 0x7fc81406c490 2019-11-28T11:29:18.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.672+0000 7fc81a173700 1 --2- 172.21.15.80:0/29314861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc81406c490 0x7fc81406c920 secure :-1 s=THROTTLE_DONE pgs=708 cs=0 l=1 rx=0x7fc7fc00fac0 tx=0x7fc7fc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.672+0000 7fc819972700 1 -- 172.21.15.80:0/29314861 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7fc001010 con 0x7fc81406c490 2019-11-28T11:29:18.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.672+0000 7fc81a173700 1 --2- 172.21.15.80:0/29314861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc81406c490 0x7fc81406c920 secure :-1 s=THROTTLE_DONE pgs=708 cs=0 l=1 rx=0x7fc7fc00fac0 tx=0x7fc7fc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.672+0000 7fc819972700 1 -- 172.21.15.80:0/29314861 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7fc007590 con 0x7fc81406c490 2019-11-28T11:29:18.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.672+0000 7fc81c3d7700 1 -- 172.21.15.80:0/29314861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc81406c490 msgr2=0x7fc81406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:18.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.672+0000 7fc81c3d7700 1 --2- 172.21.15.80:0/29314861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc81406c490 0x7fc81406c920 secure :-1 s=READY pgs=708 cs=0 l=1 rx=0x7fc7fc00fac0 tx=0x7fc7fc00fe60).stop 2019-11-28T11:29:18.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.673+0000 7fc81c3d7700 1 -- 172.21.15.80:0/29314861 shutdown_connections 2019-11-28T11:29:18.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.673+0000 7fc81c3d7700 1 --2- 172.21.15.80:0/29314861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc81406c490 0x7fc81406c920 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:18.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.673+0000 7fc81c3d7700 1 -- 172.21.15.80:0/29314861 shutdown_connections 2019-11-28T11:29:18.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.673+0000 7fc81c3d7700 1 -- 172.21.15.80:0/29314861 wait complete. 2019-11-28T11:29:18.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.673+0000 7fc81c3d7700 1 -- 172.21.15.80:0/29314861 >> 172.21.15.80:0/29314861 conn(0x7fc814061cf0 msgr2=0x7fc814064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:18.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.675+0000 7fc81c3d7700 1 Processor -- start 2019-11-28T11:29:18.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.675+0000 7fc81c3d7700 1 -- start start 2019-11-28T11:29:18.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.676+0000 7fc81c3d7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc81413f580 0x7fc814114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:18.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.676+0000 7fc81c3d7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81413fc20 con 0x7fc814114670 2019-11-28T11:29:18.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.676+0000 7fc81c3d7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc814122460 con 0x7fc81411edb0 2019-11-28T11:29:18.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.676+0000 7fc81c3d7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc814122c80 con 0x7fc81413f580 2019-11-28T11:29:18.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.676+0000 7fc81a173700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc814114670 0x7fc81411e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33856/0 (socket says 172.21.15.80:33856) 2019-11-28T11:29:18.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.676+0000 7fc81a173700 1 -- 172.21.15.80:0/1030356157 learned_addr learned my addr 172.21.15.80:0/1030356157 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:18.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.676+0000 7fc81a974700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc81413f580 0x7fc814114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:18.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.676+0000 7fc8137fe700 1 -- 172.21.15.80:0/1030356157 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099599246 0 0) 0x7fc7fc007dc0 con 0x7fc814114670 2019-11-28T11:29:18.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.676+0000 7fc8137fe700 1 -- 172.21.15.80:0/1030356157 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f8002e80 con 0x7fc814114670 2019-11-28T11:29:18.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.676+0000 7fc8137fe700 1 -- 172.21.15.80:0/1030356157 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099985391 0 0) 0x7fc80c001240 con 0x7fc81411edb0 2019-11-28T11:29:18.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc8137fe700 1 -- 172.21.15.80:0/1030356157 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f80030b0 con 0x7fc81411edb0 2019-11-28T11:29:18.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc8137fe700 1 -- 172.21.15.80:0/1030356157 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3094903488 0 0) 0x7fc7fc008530 con 0x7fc814114670 2019-11-28T11:29:18.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc81a974700 1 -- 172.21.15.80:0/1030356157 >> v1:172.21.15.174:6789/0 conn(0x7fc81411edb0 legacy=0x7fc814168a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:18.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc81a974700 1 -- 172.21.15.80:0/1030356157 >> v1:172.21.15.80:6789/0 conn(0x7fc814114670 legacy=0x7fc81411e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:18.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc81a974700 1 -- 172.21.15.80:0/1030356157 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc814124010 con 0x7fc81413f580 2019-11-28T11:29:18.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc81a974700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc81413f580 0x7fc814114130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc804010370 tx=0x7fc804010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc81a974700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc81413f580 0x7fc814114130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc804010370 tx=0x7fc804010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc81a974700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc81413f580 0x7fc814114130 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7fc804010370 tx=0x7fc804010710).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:18.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc81a974700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc81413f580 0x7fc814114130 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fc804010370 tx=0x7fc804010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc8137fe700 1 -- 172.21.15.80:0/1030356157 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc804004240 con 0x7fc81413f580 2019-11-28T11:29:18.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc81a974700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc81413f580 0x7fc814114130 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fc804010370 tx=0x7fc804010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc81a974700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc81413f580 0x7fc814114130 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fc804010370 tx=0x7fc804010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc8137fe700 1 -- 172.21.15.80:0/1030356157 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc804000c90 con 0x7fc81413f580 2019-11-28T11:29:18.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc81c3d7700 1 -- 172.21.15.80:0/1030356157 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc814124010 con 0x7fc81413f580 2019-11-28T11:29:18.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc8137fe700 1 -- 172.21.15.80:0/1030356157 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc804004820 con 0x7fc81413f580 2019-11-28T11:29:18.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc81c3d7700 1 -- 172.21.15.80:0/1030356157 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc814124010 con 0x7fc81413f580 2019-11-28T11:29:18.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.677+0000 7fc81a974700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc81413f580 0x7fc814114130 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fc804010370 tx=0x7fc804010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.678+0000 7fc8137fe700 1 -- 172.21.15.80:0/1030356157 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc804004240 con 0x7fc81413f580 2019-11-28T11:29:18.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.678+0000 7fc81a974700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc81413f580 0x7fc814114130 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fc804010370 tx=0x7fc804010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.678+0000 7fc8137fe700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7f8018750 0x7fc7f801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:18.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.678+0000 7fc8137fe700 1 -- 172.21.15.80:0/1030356157 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fc804031a80 con 0x7fc81413f580 2019-11-28T11:29:18.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.678+0000 7fc81a173700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7f8018750 0x7fc7f801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:18.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.678+0000 7fc81a173700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7f8018750 0x7fc7f801abe0 crc :-1 s=READY pgs=298 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:18.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.685+0000 7fc81c3d7700 1 -- 172.21.15.80:0/1030356157 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc814124010 con 0x7fc81413f580 2019-11-28T11:29:18.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.689+0000 7fc81a974700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc81413f580 0x7fc814114130 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fc804010370 tx=0x7fc804010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:18.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.689+0000 7fc8137fe700 1 -- 172.21.15.80:0/1030356157 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc804001220 con 0x7fc81413f580 2019-11-28T11:29:18.728 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:29:18.733 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:29:18.737 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:29:18.741 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:29:18.745 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:29:18.749 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:29:18.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:18.859+0000 7fc81c3d7700 1 -- 172.21.15.80:0/1030356157 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc814124010 con 0x7fc81413f580 2019-11-28T11:29:19.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.587+0000 7fc81a974700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc81413f580 0x7fc814114130 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fc804010370 tx=0x7fc804010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:19.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.587+0000 7fc8137fe700 1 -- 172.21.15.80:0/1030356157 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc80401f8a0 con 0x7fc81413f580 2019-11-28T11:29:19.661 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:29:19.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.627+0000 7fc81c3d7700 1 -- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7f8018750 msgr2=0x7fc7f801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:19.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.627+0000 7fc81c3d7700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7f8018750 0x7fc7f801abe0 crc :-1 s=READY pgs=298 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:19.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.627+0000 7fc81c3d7700 1 -- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc81413f580 msgr2=0x7fc814114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:19.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.627+0000 7fc81c3d7700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc81413f580 0x7fc814114130 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7fc804010370 tx=0x7fc804010710).stop 2019-11-28T11:29:19.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.627+0000 7fc81c3d7700 1 -- 172.21.15.80:0/1030356157 shutdown_connections 2019-11-28T11:29:19.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.627+0000 7fc81c3d7700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7f8018750 0x7fc7f801abe0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:19.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.627+0000 7fc81c3d7700 1 --2- 172.21.15.80:0/1030356157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc81413f580 0x7fc814114130 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:19.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.627+0000 7fc81c3d7700 1 -- 172.21.15.80:0/1030356157 shutdown_connections 2019-11-28T11:29:19.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.627+0000 7fc81c3d7700 1 -- 172.21.15.80:0/1030356157 wait complete. 2019-11-28T11:29:19.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.627+0000 7fc81c3d7700 1 -- 172.21.15.80:0/1030356157 >> 172.21.15.80:0/1030356157 conn(0x7fc8141426c0 msgr2=0x7fc814110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:19.673 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:19.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.765+0000 7f0694ccf700 1 Processor -- start 2019-11-28T11:29:19.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.765+0000 7f0694ccf700 1 -- start start 2019-11-28T11:29:19.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.766+0000 7f0694ccf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f069006c0a0 0x7f0690072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:19.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.766+0000 7f0694ccf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069006db00 con 0x7f06900734e0 2019-11-28T11:29:19.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.766+0000 7f0694ccf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069006e000 con 0x7f0690072620 2019-11-28T11:29:19.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.766+0000 7f0694ccf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069006fd60 con 0x7f069006c0a0 2019-11-28T11:29:19.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.766+0000 7f068ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f069006c0a0 0x7f0690072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:19.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.766+0000 7f068ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f069006c0a0 0x7f0690072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34546/0 (socket says 172.21.15.80:34546) 2019-11-28T11:29:19.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.766+0000 7f068ed9d700 1 -- 172.21.15.80:0/3956938941 learned_addr learned my addr 172.21.15.80:0/3956938941 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:19.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.766+0000 7f068e59c700 1 --1- 172.21.15.80:0/3956938941 >> v1:172.21.15.80:6789/0 conn(0x7f06900734e0 0x7f0690071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33866/0 (socket says 172.21.15.80:33866) 2019-11-28T11:29:19.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.766+0000 7f068ed9d700 1 -- 172.21.15.80:0/3956938941 >> v1:172.21.15.174:6789/0 conn(0x7f0690072620 legacy=0x7f0690164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:19.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.766+0000 7f068ed9d700 1 -- 172.21.15.80:0/3956938941 >> v1:172.21.15.80:6789/0 conn(0x7f06900734e0 legacy=0x7f0690071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:19.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.766+0000 7f068ed9d700 1 -- 172.21.15.80:0/3956938941 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06900706c0 con 0x7f069006c0a0 2019-11-28T11:29:19.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.766+0000 7f068dd9b700 1 -- 172.21.15.80:0/3956938941 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220739047 0 0) 0x7f0680001070 con 0x7f06900734e0 2019-11-28T11:29:19.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.767+0000 7f068ed9d700 1 --2- 172.21.15.80:0/3956938941 >> v2:172.21.15.80:3300/0 conn(0x7f069006c0a0 0x7f0690072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f068800f740 tx=0x7f068800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:19.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.767+0000 7f068ed9d700 1 --2- 172.21.15.80:0/3956938941 >> v2:172.21.15.80:3300/0 conn(0x7f069006c0a0 0x7f0690072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f068800f740 tx=0x7f068800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:19.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.767+0000 7f068ed9d700 1 --2- 172.21.15.80:0/3956938941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069006c0a0 0x7f0690072fa0 secure :-1 s=READY pgs=711 cs=0 l=1 rx=0x7f068800f740 tx=0x7f068800fae0).ready entity=mon.0 client_cookie=7225bfe3d01ce13d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:19.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.767+0000 7f068ed9d700 1 --2- 172.21.15.80:0/3956938941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069006c0a0 0x7f0690072fa0 secure :-1 s=THROTTLE_DONE pgs=711 cs=0 l=1 rx=0x7f068800f740 tx=0x7f068800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:19.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.767+0000 7f068dd9b700 1 -- 172.21.15.80:0/3956938941 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0688000960 con 0x7f069006c0a0 2019-11-28T11:29:19.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.767+0000 7f068ed9d700 1 --2- 172.21.15.80:0/3956938941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069006c0a0 0x7f0690072fa0 secure :-1 s=THROTTLE_DONE pgs=711 cs=0 l=1 rx=0x7f068800f740 tx=0x7f068800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:19.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.767+0000 7f068ed9d700 1 --2- 172.21.15.80:0/3956938941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069006c0a0 0x7f0690072fa0 secure :-1 s=THROTTLE_DONE pgs=711 cs=0 l=1 rx=0x7f068800f740 tx=0x7f068800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:19.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.767+0000 7f068dd9b700 1 -- 172.21.15.80:0/3956938941 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0688000c90 con 0x7f069006c0a0 2019-11-28T11:29:19.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.767+0000 7f068dd9b700 1 -- 172.21.15.80:0/3956938941 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06880013e0 con 0x7f069006c0a0 2019-11-28T11:29:19.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.767+0000 7f0694ccf700 1 -- 172.21.15.80:0/3956938941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069006c0a0 msgr2=0x7f0690072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:19.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.767+0000 7f0694ccf700 1 --2- 172.21.15.80:0/3956938941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069006c0a0 0x7f0690072fa0 secure :-1 s=READY pgs=711 cs=0 l=1 rx=0x7f068800f740 tx=0x7f068800fae0).stop 2019-11-28T11:29:19.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.768+0000 7f0694ccf700 1 -- 172.21.15.80:0/3956938941 shutdown_connections 2019-11-28T11:29:19.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.768+0000 7f0694ccf700 1 --2- 172.21.15.80:0/3956938941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f069006c0a0 0x7f0690072fa0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:19.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.768+0000 7f0694ccf700 1 -- 172.21.15.80:0/3956938941 shutdown_connections 2019-11-28T11:29:19.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.768+0000 7f0694ccf700 1 -- 172.21.15.80:0/3956938941 wait complete. 2019-11-28T11:29:19.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.768+0000 7f0694ccf700 1 -- 172.21.15.80:0/3956938941 >> 172.21.15.80:0/3956938941 conn(0x7f0690061cf0 msgr2=0x7f0690064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:19.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.770+0000 7f0694ccf700 1 Processor -- start 2019-11-28T11:29:19.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.770+0000 7f0694ccf700 1 -- start start 2019-11-28T11:29:19.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f0694ccf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0690111db0 0x7f06901238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:19.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f0694ccf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0690124260 con 0x7f069012cea0 2019-11-28T11:29:19.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f0694ccf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069012e5d0 con 0x7f0690165a00 2019-11-28T11:29:19.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f0694ccf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0690121040 con 0x7f0690111db0 2019-11-28T11:29:19.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f068ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f069012cea0 0x7f06901230e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33868/0 (socket says 172.21.15.80:33868) 2019-11-28T11:29:19.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f068ed9d700 1 -- 172.21.15.80:0/4051757564 learned_addr learned my addr 172.21.15.80:0/4051757564 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:19.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148675780 0 0) 0x7f06880075d0 con 0x7f069012cea0 2019-11-28T11:29:19.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0668002e80 con 0x7f069012cea0 2019-11-28T11:29:19.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f068e59c700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0690111db0 0x7f06901238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:19.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1104031358 0 0) 0x7f0688007da0 con 0x7f069012cea0 2019-11-28T11:29:19.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f06680032e0 con 0x7f069012cea0 2019-11-28T11:29:19.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f0688000940 con 0x7f069012cea0 2019-11-28T11:29:19.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0690111db0 msgr2=0x7f06901238e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:19.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f06877fe700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0690111db0 0x7f06901238e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:19.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 >> v1:172.21.15.174:6789/0 conn(0x7f0690165a00 legacy=0x7f0690167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:19.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 >> v1:172.21.15.80:6789/0 conn(0x7f069012cea0 legacy=0x7f06901230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:19.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f06877fe700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0668003330 0x7f0668003740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:19.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f06877fe700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0668003c80 0x7f0668004100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:19.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f06877fe700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0668004910 0x7f0668004da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:19.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.771+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066800bb90 con 0x7f0668003330 2019-11-28T11:29:19.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066800bdc0 con 0x7f0668003c80 2019-11-28T11:29:19.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066800bff0 con 0x7f0668004910 2019-11-28T11:29:19.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068ed9d700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0668003330 0x7f0668003740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:19.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068f59e700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0668004910 0x7f0668004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:19.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068e59c700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0668003c80 0x7f0668004100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:19.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068ed9d700 1 -- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0668004910 msgr2=0x7f0668004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:19.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068ed9d700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0668004910 0x7f0668004da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:19.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068ed9d700 1 -- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0668003c80 msgr2=0x7f0668004100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:19.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068ed9d700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0668003c80 0x7f0668004100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:19.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068ed9d700 1 -- 172.21.15.80:0/4051757564 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066800c2a0 con 0x7f0668003330 2019-11-28T11:29:19.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f0694ccf700 1 -- 172.21.15.80:0/4051757564 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0690121d20 con 0x7f0668003330 2019-11-28T11:29:19.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068e59c700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0668003c80 0x7f0668004100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:29:19.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068ed9d700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0668003330 0x7f0668003740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0688010440 tx=0x7f06880107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:19.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068f59e700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0668004910 0x7f0668004da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:29:19.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f0694ccf700 1 -- 172.21.15.80:0/4051757564 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06901219a0 con 0x7f0668003330 2019-11-28T11:29:19.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068ed9d700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0668003330 0x7f0668003740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0688010440 tx=0x7f06880107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:19.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068ed9d700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0668003330 0x7f0668003740 secure :-1 s=READY pgs=713 cs=0 l=1 rx=0x7f0688010440 tx=0x7f06880107e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:19.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068ed9d700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0668003330 0x7f0668003740 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7f0688010440 tx=0x7f06880107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:19.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0688005370 con 0x7f0668003330 2019-11-28T11:29:19.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068ed9d700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0668003330 0x7f0668003740 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7f0688010440 tx=0x7f06880107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:19.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068ed9d700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0668003330 0x7f0668003740 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7f0688010440 tx=0x7f06880107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:19.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0688007da0 con 0x7f0668003330 2019-11-28T11:29:19.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0688005180 con 0x7f0668003330 2019-11-28T11:29:19.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.772+0000 7f068ed9d700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0668003330 0x7f0668003740 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7f0688010440 tx=0x7f06880107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:19.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.773+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0688005180 con 0x7f0668003330 2019-11-28T11:29:19.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.773+0000 7f068ed9d700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0668003330 0x7f0668003740 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7f0688010440 tx=0x7f06880107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:19.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.773+0000 7f06877fe700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0668020ba0 0x7f0668022fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:19.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.773+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f0688031c80 con 0x7f0668003330 2019-11-28T11:29:19.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.773+0000 7f068e59c700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0668020ba0 0x7f0668022fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:19.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.773+0000 7f068e59c700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0668020ba0 0x7f0668022fd0 crc :-1 s=READY pgs=299 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:19.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.780+0000 7f0694ccf700 1 -- 172.21.15.80:0/4051757564 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0690121d20 con 0x7f0668003330 2019-11-28T11:29:19.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.784+0000 7f068ed9d700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0668003330 0x7f0668003740 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7f0688010440 tx=0x7f06880107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:19.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.784+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f06880080f0 con 0x7f0668003330 2019-11-28T11:29:19.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.957+0000 7f0694ccf700 1 -- 172.21.15.80:0/4051757564 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06901219a0 con 0x7f0668003330 2019-11-28T11:29:19.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.958+0000 7f068ed9d700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0668003330 0x7f0668003740 secure :-1 s=THROTTLE_DONE pgs=713 cs=0 l=1 rx=0x7f0688010440 tx=0x7f06880107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:19.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.958+0000 7f06877fe700 1 -- 172.21.15.80:0/4051757564 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+1425 (secure 0 0 0) 0x7f0688005b00 con 0x7f0668003330 2019-11-28T11:29:19.989 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 32 2019-11-28T11:29:19.989 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:19.989 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":32,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:28:54.163001+0000","modified":"2019-11-28T11:29:19.583680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2019-11-28T11:29:19.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.960+0000 7f0694ccf700 1 -- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0668020ba0 msgr2=0x7f0668022fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:19.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.960+0000 7f0694ccf700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0668020ba0 0x7f0668022fd0 crc :-1 s=READY pgs=299 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:19.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.960+0000 7f0694ccf700 1 -- 172.21.15.80:0/4051757564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0668003330 msgr2=0x7f0668003740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:19.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.960+0000 7f0694ccf700 1 --2- 172.21.15.80:0/4051757564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0668003330 0x7f0668003740 secure :-1 s=READY pgs=713 cs=0 l=1 rx=0x7f0688010440 tx=0x7f06880107e0).stop 2019-11-28T11:29:19.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.960+0000 7f068f59e700 1 -- 172.21.15.80:0/4051757564 reap_dead start 2019-11-28T11:29:19.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.960+0000 7f068f59e700 1 -- 172.21.15.80:0/4051757564 reap_dead start 2019-11-28T11:29:19.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.960+0000 7f0694ccf700 1 -- 172.21.15.80:0/4051757564 shutdown_connections 2019-11-28T11:29:19.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.960+0000 7f0694ccf700 1 -- 172.21.15.80:0/4051757564 shutdown_connections 2019-11-28T11:29:19.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.960+0000 7f0694ccf700 1 -- 172.21.15.80:0/4051757564 wait complete. 2019-11-28T11:29:19.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:19.960+0000 7f0694ccf700 1 -- 172.21.15.80:0/4051757564 >> 172.21.15.80:0/4051757564 conn(0x7f06901426c0 msgr2=0x7f0690110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:20.001 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:29:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.094+0000 7fd0693d8700 1 Processor -- start 2019-11-28T11:29:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.094+0000 7fd0693d8700 1 -- start start 2019-11-28T11:29:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.095+0000 7fd0693d8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd06406c0a0 0x7fd064072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.095+0000 7fd0693d8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06406db00 con 0x7fd064072620 2019-11-28T11:29:20.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.095+0000 7fd0693d8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06406e000 con 0x7fd0640734e0 2019-11-28T11:29:20.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.095+0000 7fd0693d8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06406fd60 con 0x7fd06406c0a0 2019-11-28T11:29:20.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.095+0000 7fd063fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd064072620 0x7fd064164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33886/0 (socket says 172.21.15.80:33886) 2019-11-28T11:29:20.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.095+0000 7fd063fff700 1 -- 172.21.15.80:0/234837341 learned_addr learned my addr 172.21.15.80:0/234837341 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:20.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.095+0000 7fd0627fc700 1 -- 172.21.15.80:0/234837341 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373318503 0 0) 0x7fd05c001150 con 0x7fd064072620 2019-11-28T11:29:20.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.095+0000 7fd0637fe700 1 --2- 172.21.15.80:0/234837341 >> v2:172.21.15.174:3300/0 conn(0x7fd06406c0a0 0x7fd064072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:20.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.095+0000 7fd0627fc700 1 -- 172.21.15.80:0/234837341 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd050002e80 con 0x7fd064072620 2019-11-28T11:29:20.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0627fc700 1 -- 172.21.15.80:0/234837341 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2895147594 0 0) 0x7fd05c001130 con 0x7fd064072620 2019-11-28T11:29:20.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0627fc700 1 -- 172.21.15.80:0/234837341 >> v2:172.21.15.174:3300/0 conn(0x7fd06406c0a0 msgr2=0x7fd064072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:20.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0627fc700 1 --2- 172.21.15.80:0/234837341 >> v2:172.21.15.174:3300/0 conn(0x7fd06406c0a0 0x7fd064072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:20.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0627fc700 1 -- 172.21.15.80:0/234837341 >> v1:172.21.15.174:6789/0 conn(0x7fd0640734e0 legacy=0x7fd064071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:20.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0627fc700 1 -- 172.21.15.80:0/234837341 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0640706c0 con 0x7fd064072620 2019-11-28T11:29:20.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0627fc700 1 -- 172.21.15.80:0/234837341 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd05c001660 con 0x7fd064072620 2019-11-28T11:29:20.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0627fc700 1 -- 172.21.15.80:0/234837341 >> v1:172.21.15.80:6789/0 conn(0x7fd064072620 legacy=0x7fd064164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0627fc700 1 --2- 172.21.15.80:0/234837341 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd050003ab0 0x7fd050005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0627fc700 1 --2- 172.21.15.80:0/234837341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd050006670 0x7fd050008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0627fc700 1 --2- 172.21.15.80:0/234837341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0500093a0 0x7fd05000b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0627fc700 1 -- 172.21.15.80:0/234837341 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05000c020 con 0x7fd0500093a0 2019-11-28T11:29:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0627fc700 1 -- 172.21.15.80:0/234837341 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd050050220 con 0x7fd050006670 2019-11-28T11:29:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0627fc700 1 -- 172.21.15.80:0/234837341 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd050050450 con 0x7fd050003ab0 2019-11-28T11:29:20.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd063fff700 1 --2- 172.21.15.80:0/234837341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0500093a0 0x7fd05000b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd062ffd700 1 --2- 172.21.15.80:0/234837341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd050006670 0x7fd050008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0637fe700 1 --2- 172.21.15.80:0/234837341 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd050003ab0 0x7fd050005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd063fff700 1 -- 172.21.15.80:0/234837341 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd050003ab0 msgr2=0x7fd050005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd063fff700 1 --2- 172.21.15.80:0/234837341 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd050003ab0 0x7fd050005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd063fff700 1 -- 172.21.15.80:0/234837341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd050006670 msgr2=0x7fd050008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd063fff700 1 --2- 172.21.15.80:0/234837341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd050006670 0x7fd050008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:20.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd063fff700 1 -- 172.21.15.80:0/234837341 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd050050700 con 0x7fd0500093a0 2019-11-28T11:29:20.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd063fff700 1 --2- 172.21.15.80:0/234837341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0500093a0 0x7fd05000b870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd05c00f910 tx=0x7fd05c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd063fff700 1 -- 172.21.15.80:0/234837341 reap_dead start 2019-11-28T11:29:20.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd063fff700 1 --2- 172.21.15.80:0/234837341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0500093a0 0x7fd05000b870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd05c00f910 tx=0x7fd05c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd063fff700 1 --2- 172.21.15.80:0/234837341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0500093a0 0x7fd05000b870 secure :-1 s=READY pgs=715 cs=0 l=1 rx=0x7fd05c00f910 tx=0x7fd05c00f790).ready entity=mon.0 client_cookie=d991cf4b013cbc57 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:20.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd063fff700 1 --2- 172.21.15.80:0/234837341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0500093a0 0x7fd05000b870 secure :-1 s=THROTTLE_DONE pgs=715 cs=0 l=1 rx=0x7fd05c00f910 tx=0x7fd05c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0627fc700 1 -- 172.21.15.80:0/234837341 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd05c0014f0 con 0x7fd0500093a0 2019-11-28T11:29:20.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd063fff700 1 --2- 172.21.15.80:0/234837341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0500093a0 0x7fd05000b870 secure :-1 s=THROTTLE_DONE pgs=715 cs=0 l=1 rx=0x7fd05c00f910 tx=0x7fd05c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd063fff700 1 --2- 172.21.15.80:0/234837341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0500093a0 0x7fd05000b870 secure :-1 s=THROTTLE_DONE pgs=715 cs=0 l=1 rx=0x7fd05c00f910 tx=0x7fd05c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0627fc700 1 -- 172.21.15.80:0/234837341 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c004240 con 0x7fd0500093a0 2019-11-28T11:29:20.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0627fc700 1 -- 172.21.15.80:0/234837341 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd05c004910 con 0x7fd0500093a0 2019-11-28T11:29:20.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0693d8700 1 -- 172.21.15.80:0/234837341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0500093a0 msgr2=0x7fd05000b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:20.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.096+0000 7fd0693d8700 1 --2- 172.21.15.80:0/234837341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0500093a0 0x7fd05000b870 secure :-1 s=READY pgs=715 cs=0 l=1 rx=0x7fd05c00f910 tx=0x7fd05c00f790).stop 2019-11-28T11:29:20.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.097+0000 7fd0693d8700 1 -- 172.21.15.80:0/234837341 shutdown_connections 2019-11-28T11:29:20.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.097+0000 7fd0693d8700 1 --2- 172.21.15.80:0/234837341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0500093a0 0x7fd05000b870 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:20.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.097+0000 7fd0693d8700 1 -- 172.21.15.80:0/234837341 shutdown_connections 2019-11-28T11:29:20.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.097+0000 7fd0693d8700 1 -- 172.21.15.80:0/234837341 wait complete. 2019-11-28T11:29:20.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.097+0000 7fd0693d8700 1 -- 172.21.15.80:0/234837341 >> 172.21.15.80:0/234837341 conn(0x7fd064061cf0 msgr2=0x7fd064064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:20.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.099+0000 7fd0693d8700 1 Processor -- start 2019-11-28T11:29:20.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.100+0000 7fd0693d8700 1 -- start start 2019-11-28T11:29:20.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0693d8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd064074d00 0x7fd0640750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:20.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0693d8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd064152bd0 0x7fd064140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:20.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0693d8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd064079230 con 0x7fd064153040 2019-11-28T11:29:20.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0693d8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06407ab30 con 0x7fd064074d00 2019-11-28T11:29:20.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0693d8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06407ae00 con 0x7fd064152bd0 2019-11-28T11:29:20.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0637fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd064074d00 0x7fd0640750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:20.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0637fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd064074d00 0x7fd0640750f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34578/0 (socket says 172.21.15.80:34578) 2019-11-28T11:29:20.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0637fe700 1 -- 172.21.15.80:0/4196450557 learned_addr learned my addr 172.21.15.80:0/4196450557 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:20.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd062ffd700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd064152bd0 0x7fd064140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:20.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0637fe700 1 -- 172.21.15.80:0/4196450557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd064152bd0 msgr2=0x7fd064140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:20.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0637fe700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd064152bd0 0x7fd064140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:20.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0637fe700 1 -- 172.21.15.80:0/4196450557 >> v1:172.21.15.174:6789/0 conn(0x7fd064153040 legacy=0x7fd064140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:20.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0637fe700 1 -- 172.21.15.80:0/4196450557 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06407b490 con 0x7fd064074d00 2019-11-28T11:29:20.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0637fe700 1 --2- 172.21.15.80:0/4196450557 >> v2:172.21.15.80:3300/0 conn(0x7fd064074d00 0x7fd0640750f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd04c010450 tx=0x7fd04c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0637fe700 1 --2- 172.21.15.80:0/4196450557 >> v2:172.21.15.80:3300/0 conn(0x7fd064074d00 0x7fd0640750f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd04c010450 tx=0x7fd04c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0637fe700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd064074d00 0x7fd0640750f0 secure :-1 s=READY pgs=716 cs=0 l=1 rx=0x7fd04c010450 tx=0x7fd04c010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:20.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0637fe700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd064074d00 0x7fd0640750f0 secure :-1 s=THROTTLE_DONE pgs=716 cs=0 l=1 rx=0x7fd04c010450 tx=0x7fd04c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0637fe700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd064074d00 0x7fd0640750f0 secure :-1 s=THROTTLE_DONE pgs=716 cs=0 l=1 rx=0x7fd04c010450 tx=0x7fd04c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd05bfff700 1 -- 172.21.15.80:0/4196450557 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd04c000940 con 0x7fd064074d00 2019-11-28T11:29:20.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0637fe700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd064074d00 0x7fd0640750f0 secure :-1 s=THROTTLE_DONE pgs=716 cs=0 l=1 rx=0x7fd04c010450 tx=0x7fd04c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd05bfff700 1 -- 172.21.15.80:0/4196450557 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c005580 con 0x7fd064074d00 2019-11-28T11:29:20.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0693d8700 1 -- 172.21.15.80:0/4196450557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06407b810 con 0x7fd064074d00 2019-11-28T11:29:20.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd05bfff700 1 -- 172.21.15.80:0/4196450557 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd04c005bd0 con 0x7fd064074d00 2019-11-28T11:29:20.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.101+0000 7fd0693d8700 1 -- 172.21.15.80:0/4196450557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06407b490 con 0x7fd064074d00 2019-11-28T11:29:20.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.102+0000 7fd0637fe700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd064074d00 0x7fd0640750f0 secure :-1 s=THROTTLE_DONE pgs=716 cs=0 l=1 rx=0x7fd04c010450 tx=0x7fd04c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.102+0000 7fd05bfff700 1 -- 172.21.15.80:0/4196450557 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd04c005180 con 0x7fd064074d00 2019-11-28T11:29:20.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.102+0000 7fd0637fe700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd064074d00 0x7fd0640750f0 secure :-1 s=THROTTLE_DONE pgs=716 cs=0 l=1 rx=0x7fd04c010450 tx=0x7fd04c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.102+0000 7fd05bfff700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd048018730 0x7fd04801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:20.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.102+0000 7fd05bfff700 1 -- 172.21.15.80:0/4196450557 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fd04c031b40 con 0x7fd064074d00 2019-11-28T11:29:20.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.102+0000 7fd062ffd700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd048018730 0x7fd04801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:20.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.102+0000 7fd062ffd700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd048018730 0x7fd04801abc0 crc :-1 s=READY pgs=300 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:20.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.109+0000 7fd0693d8700 1 -- 172.21.15.80:0/4196450557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06407b810 con 0x7fd064074d00 2019-11-28T11:29:20.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.113+0000 7fd0637fe700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd064074d00 0x7fd0640750f0 secure :-1 s=THROTTLE_DONE pgs=716 cs=0 l=1 rx=0x7fd04c010450 tx=0x7fd04c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.113+0000 7fd05bfff700 1 -- 172.21.15.80:0/4196450557 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd04c0060a0 con 0x7fd064074d00 2019-11-28T11:29:20.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.287+0000 7fd0693d8700 1 -- 172.21.15.80:0/4196450557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd06407b490 con 0x7fd064074d00 2019-11-28T11:29:20.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.590+0000 7fd0637fe700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd064074d00 0x7fd0640750f0 secure :-1 s=THROTTLE_DONE pgs=716 cs=0 l=1 rx=0x7fd04c010450 tx=0x7fd04c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.590+0000 7fd05bfff700 1 -- 172.21.15.80:0/4196450557 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd04c005180 con 0x7fd064074d00 2019-11-28T11:29:20.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.603+0000 7fd0693d8700 1 -- 172.21.15.80:0/4196450557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd048018730 msgr2=0x7fd04801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:20.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.604+0000 7fd0693d8700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd048018730 0x7fd04801abc0 crc :-1 s=READY pgs=300 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:20.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.604+0000 7fd0693d8700 1 -- 172.21.15.80:0/4196450557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd064074d00 msgr2=0x7fd0640750f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:20.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.604+0000 7fd0693d8700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd064074d00 0x7fd0640750f0 secure :-1 s=READY pgs=716 cs=0 l=1 rx=0x7fd04c010450 tx=0x7fd04c010280).stop 2019-11-28T11:29:20.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.604+0000 7fd0693d8700 1 -- 172.21.15.80:0/4196450557 shutdown_connections 2019-11-28T11:29:20.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.604+0000 7fd0693d8700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd048018730 0x7fd04801abc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:20.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.604+0000 7fd0693d8700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd064152bd0 0x7fd064140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:20.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.604+0000 7fd0693d8700 1 --2- 172.21.15.80:0/4196450557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd064074d00 0x7fd0640750f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:20.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.604+0000 7fd0693d8700 1 -- 172.21.15.80:0/4196450557 shutdown_connections 2019-11-28T11:29:20.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.604+0000 7fd0693d8700 1 -- 172.21.15.80:0/4196450557 wait complete. 2019-11-28T11:29:20.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.604+0000 7fd0693d8700 1 -- 172.21.15.80:0/4196450557 >> 172.21.15.80:0/4196450557 conn(0x7fd06413fa50 msgr2=0x7fd06407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:20.644 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:29:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.736+0000 7f31e5ddc700 1 Processor -- start 2019-11-28T11:29:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.736+0000 7f31e5ddc700 1 -- start start 2019-11-28T11:29:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.737+0000 7f31e5ddc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f31e015f100 0x7f31e006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.737+0000 7f31e5ddc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e006db60 con 0x7f31e015ed10 2019-11-28T11:29:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.737+0000 7f31e5ddc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e006e060 con 0x7f31e006c2f0 2019-11-28T11:29:20.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.737+0000 7f31e5ddc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e006fe00 con 0x7f31e015f100 2019-11-28T11:29:20.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.737+0000 7f31d7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f31e015f100 0x7f31e006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:20.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.737+0000 7f31dffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f31e015ed10 0x7f31e0073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33902/0 (socket says 172.21.15.80:33902) 2019-11-28T11:29:20.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.737+0000 7f31dffff700 1 -- 172.21.15.80:0/3662407544 learned_addr learned my addr 172.21.15.80:0/3662407544 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:20.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.738+0000 7f31d7fff700 1 -- 172.21.15.80:0/3662407544 >> v1:172.21.15.174:6789/0 conn(0x7f31e006c2f0 legacy=0x7f31e006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:20.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.738+0000 7f31d7fff700 1 -- 172.21.15.80:0/3662407544 >> v1:172.21.15.80:6789/0 conn(0x7f31e015ed10 legacy=0x7f31e0073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:20.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.738+0000 7f31df7fe700 1 -- 172.21.15.80:0/3662407544 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018838058 0 0) 0x7f31d8001400 con 0x7f31e006c2f0 2019-11-28T11:29:20.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.738+0000 7f31d7fff700 1 -- 172.21.15.80:0/3662407544 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e0070760 con 0x7f31e015f100 2019-11-28T11:29:20.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.738+0000 7f31d7fff700 1 --2- 172.21.15.80:0/3662407544 >> v2:172.21.15.80:3300/0 conn(0x7f31e015f100 0x7f31e006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f31c800af50 tx=0x7f31c800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.738+0000 7f31d7fff700 1 --2- 172.21.15.80:0/3662407544 >> v2:172.21.15.80:3300/0 conn(0x7f31e015f100 0x7f31e006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f31c800af50 tx=0x7f31c800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.738+0000 7f31d7fff700 1 --2- 172.21.15.80:0/3662407544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e015f100 0x7f31e006bdb0 secure :-1 s=READY pgs=718 cs=0 l=1 rx=0x7f31c800af50 tx=0x7f31c800b760).ready entity=mon.0 client_cookie=aaba4283a9e340d3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:20.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.738+0000 7f31d7fff700 1 --2- 172.21.15.80:0/3662407544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e015f100 0x7f31e006bdb0 secure :-1 s=THROTTLE_DONE pgs=718 cs=0 l=1 rx=0x7f31c800af50 tx=0x7f31c800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.738+0000 7f31df7fe700 1 -- 172.21.15.80:0/3662407544 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31c8000960 con 0x7f31e015f100 2019-11-28T11:29:20.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.738+0000 7f31d7fff700 1 --2- 172.21.15.80:0/3662407544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e015f100 0x7f31e006bdb0 secure :-1 s=THROTTLE_DONE pgs=718 cs=0 l=1 rx=0x7f31c800af50 tx=0x7f31c800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.738+0000 7f31d7fff700 1 --2- 172.21.15.80:0/3662407544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e015f100 0x7f31e006bdb0 secure :-1 s=THROTTLE_DONE pgs=718 cs=0 l=1 rx=0x7f31c800af50 tx=0x7f31c800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.738+0000 7f31df7fe700 1 -- 172.21.15.80:0/3662407544 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c8009860 con 0x7f31e015f100 2019-11-28T11:29:20.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.738+0000 7f31df7fe700 1 -- 172.21.15.80:0/3662407544 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31c8000960 con 0x7f31e015f100 2019-11-28T11:29:20.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.738+0000 7f31e5ddc700 1 -- 172.21.15.80:0/3662407544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e015f100 msgr2=0x7f31e006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:20.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.738+0000 7f31e5ddc700 1 --2- 172.21.15.80:0/3662407544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e015f100 0x7f31e006bdb0 secure :-1 s=READY pgs=718 cs=0 l=1 rx=0x7f31c800af50 tx=0x7f31c800b760).stop 2019-11-28T11:29:20.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.739+0000 7f31e5ddc700 1 -- 172.21.15.80:0/3662407544 shutdown_connections 2019-11-28T11:29:20.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.739+0000 7f31e5ddc700 1 --2- 172.21.15.80:0/3662407544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e015f100 0x7f31e006bdb0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:20.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.739+0000 7f31e5ddc700 1 -- 172.21.15.80:0/3662407544 shutdown_connections 2019-11-28T11:29:20.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.739+0000 7f31e5ddc700 1 -- 172.21.15.80:0/3662407544 wait complete. 2019-11-28T11:29:20.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.739+0000 7f31e5ddc700 1 -- 172.21.15.80:0/3662407544 >> 172.21.15.80:0/3662407544 conn(0x7f31e0061d20 msgr2=0x7f31e00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:20.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.741+0000 7f31e5ddc700 1 Processor -- start 2019-11-28T11:29:20.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.741+0000 7f31e5ddc700 1 -- start start 2019-11-28T11:29:20.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.742+0000 7f31e5ddc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f31e010f9f0 0x7f31e0168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:20.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.742+0000 7f31e5ddc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e010c250 con 0x7f31e010e970 2019-11-28T11:29:20.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.742+0000 7f31e5ddc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e010fe70 con 0x7f31e010ed60 2019-11-28T11:29:20.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.742+0000 7f31e5ddc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e010e430 con 0x7f31e010f9f0 2019-11-28T11:29:20.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.742+0000 7f31dffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f31e010e970 0x7f31e01087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33908/0 (socket says 172.21.15.80:33908) 2019-11-28T11:29:20.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.742+0000 7f31dffff700 1 -- 172.21.15.80:0/2205088545 learned_addr learned my addr 172.21.15.80:0/2205088545 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:20.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.742+0000 7f31e4b7a700 1 --2- 172.21.15.80:0/2205088545 >> v2:172.21.15.80:3300/0 conn(0x7f31e010f9f0 0x7f31e0168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:20.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.742+0000 7f31dd7fa700 1 -- 172.21.15.80:0/2205088545 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078276096 0 0) 0x7f31d0001150 con 0x7f31e010e970 2019-11-28T11:29:20.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.742+0000 7f31dd7fa700 1 -- 172.21.15.80:0/2205088545 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c4002e80 con 0x7f31e010e970 2019-11-28T11:29:20.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.743+0000 7f31e4b7a700 1 -- 172.21.15.80:0/2205088545 >> v1:172.21.15.174:6789/0 conn(0x7f31e010ed60 legacy=0x7f31e010f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:20.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.743+0000 7f31dd7fa700 1 -- 172.21.15.80:0/2205088545 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559098523 0 0) 0x7f31c800b460 con 0x7f31e010ed60 2019-11-28T11:29:20.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.743+0000 7f31e4b7a700 1 -- 172.21.15.80:0/2205088545 >> v1:172.21.15.80:6789/0 conn(0x7f31e010e970 legacy=0x7f31e01087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:20.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.743+0000 7f31e4b7a700 1 -- 172.21.15.80:0/2205088545 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e0105ef0 con 0x7f31e010f9f0 2019-11-28T11:29:20.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.743+0000 7f31e4b7a700 1 --2- 172.21.15.80:0/2205088545 >> v2:172.21.15.80:3300/0 conn(0x7f31e010f9f0 0x7f31e0168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f31d8010750 tx=0x7f31d8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.743+0000 7f31e4b7a700 1 --2- 172.21.15.80:0/2205088545 >> v2:172.21.15.80:3300/0 conn(0x7f31e010f9f0 0x7f31e0168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f31d8010750 tx=0x7f31d8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.743+0000 7f31e4b7a700 1 --2- 172.21.15.80:0/2205088545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e010f9f0 0x7f31e0168d80 secure :-1 s=READY pgs=720 cs=0 l=1 rx=0x7f31d8010750 tx=0x7f31d8010af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:20.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.743+0000 7f31e4b7a700 1 --2- 172.21.15.80:0/2205088545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e010f9f0 0x7f31e0168d80 secure :-1 s=THROTTLE_DONE pgs=720 cs=0 l=1 rx=0x7f31d8010750 tx=0x7f31d8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.743+0000 7f31dd7fa700 1 -- 172.21.15.80:0/2205088545 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31d800f560 con 0x7f31e010f9f0 2019-11-28T11:29:20.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.743+0000 7f31e4b7a700 1 --2- 172.21.15.80:0/2205088545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e010f9f0 0x7f31e0168d80 secure :-1 s=THROTTLE_DONE pgs=720 cs=0 l=1 rx=0x7f31d8010750 tx=0x7f31d8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.743+0000 7f31e4b7a700 1 --2- 172.21.15.80:0/2205088545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e010f9f0 0x7f31e0168d80 secure :-1 s=THROTTLE_DONE pgs=720 cs=0 l=1 rx=0x7f31d8010750 tx=0x7f31d8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.743+0000 7f31dd7fa700 1 -- 172.21.15.80:0/2205088545 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d800f0e0 con 0x7f31e010f9f0 2019-11-28T11:29:20.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.743+0000 7f31e5ddc700 1 -- 172.21.15.80:0/2205088545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e0106270 con 0x7f31e010f9f0 2019-11-28T11:29:20.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.743+0000 7f31dd7fa700 1 -- 172.21.15.80:0/2205088545 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31d8009930 con 0x7f31e010f9f0 2019-11-28T11:29:20.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.743+0000 7f31e5ddc700 1 -- 172.21.15.80:0/2205088545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e0105ef0 con 0x7f31e010f9f0 2019-11-28T11:29:20.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.743+0000 7f31e4b7a700 1 --2- 172.21.15.80:0/2205088545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e010f9f0 0x7f31e0168d80 secure :-1 s=THROTTLE_DONE pgs=720 cs=0 l=1 rx=0x7f31d8010750 tx=0x7f31d8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.744+0000 7f31dd7fa700 1 -- 172.21.15.80:0/2205088545 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f31d800f2d0 con 0x7f31e010f9f0 2019-11-28T11:29:20.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.744+0000 7f31e4b7a700 1 --2- 172.21.15.80:0/2205088545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e010f9f0 0x7f31e0168d80 secure :-1 s=THROTTLE_DONE pgs=720 cs=0 l=1 rx=0x7f31d8010750 tx=0x7f31d8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.744+0000 7f31dd7fa700 1 --2- 172.21.15.80:0/2205088545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f31c4018780 0x7f31c401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:20.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.744+0000 7f31dd7fa700 1 -- 172.21.15.80:0/2205088545 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f31d8031e30 con 0x7f31e010f9f0 2019-11-28T11:29:20.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.744+0000 7f31dffff700 1 --2- 172.21.15.80:0/2205088545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f31c4018780 0x7f31c401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:20.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.744+0000 7f31dffff700 1 --2- 172.21.15.80:0/2205088545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f31c4018780 0x7f31c401abf0 crc :-1 s=READY pgs=301 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:20.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.752+0000 7f31e5ddc700 1 -- 172.21.15.80:0/2205088545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e0106270 con 0x7f31e010f9f0 2019-11-28T11:29:20.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.755+0000 7f31e4b7a700 1 --2- 172.21.15.80:0/2205088545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e010f9f0 0x7f31e0168d80 secure :-1 s=THROTTLE_DONE pgs=720 cs=0 l=1 rx=0x7f31d8010750 tx=0x7f31d8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:20.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.755+0000 7f31dd7fa700 1 -- 172.21.15.80:0/2205088545 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f31d8026cc0 con 0x7f31e010f9f0 2019-11-28T11:29:20.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:20.923+0000 7f31e5ddc700 1 -- 172.21.15.80:0/2205088545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f31e0105ef0 con 0x7f31e010f9f0 2019-11-28T11:29:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.595+0000 7f31e4b7a700 1 --2- 172.21.15.80:0/2205088545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e010f9f0 0x7f31e0168d80 secure :-1 s=THROTTLE_DONE pgs=720 cs=0 l=1 rx=0x7f31d8010750 tx=0x7f31d8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.595+0000 7f31dd7fa700 1 -- 172.21.15.80:0/2205088545 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v61) v1 ==== 185+0+0 (secure 0 0 0) 0x7f31d800f2d0 con 0x7f31e010f9f0 2019-11-28T11:29:21.668 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:29:21.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.640+0000 7f31e5ddc700 1 -- 172.21.15.80:0/2205088545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f31c4018780 msgr2=0x7f31c401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:21.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.640+0000 7f31e5ddc700 1 --2- 172.21.15.80:0/2205088545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f31c4018780 0x7f31c401abf0 crc :-1 s=READY pgs=301 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:21.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.640+0000 7f31e5ddc700 1 -- 172.21.15.80:0/2205088545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e010f9f0 msgr2=0x7f31e0168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:21.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.640+0000 7f31e5ddc700 1 --2- 172.21.15.80:0/2205088545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e010f9f0 0x7f31e0168d80 secure :-1 s=READY pgs=720 cs=0 l=1 rx=0x7f31d8010750 tx=0x7f31d8010af0).stop 2019-11-28T11:29:21.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.640+0000 7f31e5ddc700 1 -- 172.21.15.80:0/2205088545 shutdown_connections 2019-11-28T11:29:21.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.640+0000 7f31e5ddc700 1 --2- 172.21.15.80:0/2205088545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e010f9f0 0x7f31e0168d80 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:21.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.640+0000 7f31e5ddc700 1 --2- 172.21.15.80:0/2205088545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f31c4018780 0x7f31c401abf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:21.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.640+0000 7f31e5ddc700 1 -- 172.21.15.80:0/2205088545 shutdown_connections 2019-11-28T11:29:21.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.640+0000 7f31e5ddc700 1 -- 172.21.15.80:0/2205088545 wait complete. 2019-11-28T11:29:21.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.640+0000 7f31e5ddc700 1 -- 172.21.15.80:0/2205088545 >> 172.21.15.80:0/2205088545 conn(0x7f31e015e2d0 msgr2=0x7f31e0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:21.680 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:29:21.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.774+0000 7f7b4ef40700 1 Processor -- start 2019-11-28T11:29:21.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.774+0000 7f7b4ef40700 1 -- start start 2019-11-28T11:29:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.775+0000 7f7b4ef40700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7b4815ed10 0x7f7b4815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.775+0000 7f7b4ef40700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4806db60 con 0x7f7b480734b0 2019-11-28T11:29:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.775+0000 7f7b4ef40700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4806e060 con 0x7f7b48073020 2019-11-28T11:29:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.775+0000 7f7b4ef40700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4806fe00 con 0x7f7b4815ed10 2019-11-28T11:29:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.775+0000 7f7b4dcde700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7b480734b0 0x7f7b480726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33918/0 (socket says 172.21.15.80:33918) 2019-11-28T11:29:21.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.775+0000 7f7b4dcde700 1 -- 172.21.15.80:0/2193054867 learned_addr learned my addr 172.21.15.80:0/2193054867 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:21.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.775+0000 7f7b4d4dd700 1 --2- 172.21.15.80:0/2193054867 >> v2:172.21.15.174:3300/0 conn(0x7f7b4815ed10 0x7f7b4815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:21.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.775+0000 7f7b47fff700 1 -- 172.21.15.80:0/2193054867 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261407595 0 0) 0x7f7b38001150 con 0x7f7b480734b0 2019-11-28T11:29:21.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.775+0000 7f7b47fff700 1 -- 172.21.15.80:0/2193054867 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b34002e80 con 0x7f7b480734b0 2019-11-28T11:29:21.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b47fff700 1 -- 172.21.15.80:0/2193054867 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3981446054 0 0) 0x7f7b38001130 con 0x7f7b480734b0 2019-11-28T11:29:21.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b47fff700 1 -- 172.21.15.80:0/2193054867 >> v2:172.21.15.174:3300/0 conn(0x7f7b4815ed10 msgr2=0x7f7b4815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:21.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b47fff700 1 --2- 172.21.15.80:0/2193054867 >> v2:172.21.15.174:3300/0 conn(0x7f7b4815ed10 0x7f7b4815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:21.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b47fff700 1 -- 172.21.15.80:0/2193054867 >> v1:172.21.15.174:6789/0 conn(0x7f7b48073020 legacy=0x7f7b48071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:21.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b47fff700 1 -- 172.21.15.80:0/2193054867 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b48070760 con 0x7f7b480734b0 2019-11-28T11:29:21.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b47fff700 1 -- 172.21.15.80:0/2193054867 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f7b38001660 con 0x7f7b480734b0 2019-11-28T11:29:21.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4d4dd700 1 --2- 172.21.15.80:0/2193054867 >> v2:172.21.15.174:3300/0 conn(0x7f7b4815ed10 0x7f7b4815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:21.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b47fff700 1 -- 172.21.15.80:0/2193054867 >> v1:172.21.15.80:6789/0 conn(0x7f7b480734b0 legacy=0x7f7b480726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:21.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b47fff700 1 --2- 172.21.15.80:0/2193054867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b34003a80 0x7f7b34005ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:21.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b47fff700 1 --2- 172.21.15.80:0/2193054867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b34006690 0x7f7b34008b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:21.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b47fff700 1 --2- 172.21.15.80:0/2193054867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b340093a0 0x7f7b3400b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:21.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b47fff700 1 -- 172.21.15.80:0/2193054867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b34050030 con 0x7f7b340093a0 2019-11-28T11:29:21.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b47fff700 1 -- 172.21.15.80:0/2193054867 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b34050220 con 0x7f7b34003a80 2019-11-28T11:29:21.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b47fff700 1 -- 172.21.15.80:0/2193054867 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b34050450 con 0x7f7b34006690 2019-11-28T11:29:21.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4dcde700 1 --2- 172.21.15.80:0/2193054867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b340093a0 0x7f7b3400b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:21.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4d4dd700 1 --2- 172.21.15.80:0/2193054867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b34003a80 0x7f7b34005ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:21.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4ccdc700 1 --2- 172.21.15.80:0/2193054867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b34006690 0x7f7b34008b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:21.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4dcde700 1 -- 172.21.15.80:0/2193054867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b34006690 msgr2=0x7f7b34008b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:21.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4dcde700 1 --2- 172.21.15.80:0/2193054867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b34006690 0x7f7b34008b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:21.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4dcde700 1 -- 172.21.15.80:0/2193054867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b34003a80 msgr2=0x7f7b34005ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:21.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4dcde700 1 --2- 172.21.15.80:0/2193054867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b34003a80 0x7f7b34005ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:21.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4dcde700 1 -- 172.21.15.80:0/2193054867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b34050700 con 0x7f7b340093a0 2019-11-28T11:29:21.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4dcde700 1 --2- 172.21.15.80:0/2193054867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b340093a0 0x7f7b3400b870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7b3800f860 tx=0x7f7b3800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:21.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4dcde700 1 -- 172.21.15.80:0/2193054867 reap_dead start 2019-11-28T11:29:21.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4dcde700 1 --2- 172.21.15.80:0/2193054867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b340093a0 0x7f7b3400b870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7b3800f860 tx=0x7f7b3800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:21.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4dcde700 1 --2- 172.21.15.80:0/2193054867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b340093a0 0x7f7b3400b870 secure :-1 s=READY pgs=722 cs=0 l=1 rx=0x7f7b3800f860 tx=0x7f7b3800f790).ready entity=mon.0 client_cookie=5d2d68b42bb607da server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:21.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4dcde700 1 --2- 172.21.15.80:0/2193054867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b340093a0 0x7f7b3400b870 secure :-1 s=THROTTLE_DONE pgs=722 cs=0 l=1 rx=0x7f7b3800f860 tx=0x7f7b3800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:21.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b47fff700 1 -- 172.21.15.80:0/2193054867 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b38001640 con 0x7f7b340093a0 2019-11-28T11:29:21.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4dcde700 1 --2- 172.21.15.80:0/2193054867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b340093a0 0x7f7b3400b870 secure :-1 s=THROTTLE_DONE pgs=722 cs=0 l=1 rx=0x7f7b3800f860 tx=0x7f7b3800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:21.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4dcde700 1 --2- 172.21.15.80:0/2193054867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b340093a0 0x7f7b3400b870 secure :-1 s=THROTTLE_DONE pgs=722 cs=0 l=1 rx=0x7f7b3800f860 tx=0x7f7b3800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:21.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b47fff700 1 -- 172.21.15.80:0/2193054867 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b38004430 con 0x7f7b340093a0 2019-11-28T11:29:21.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b47fff700 1 -- 172.21.15.80:0/2193054867 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b38004b80 con 0x7f7b340093a0 2019-11-28T11:29:21.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4ef40700 1 -- 172.21.15.80:0/2193054867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b340093a0 msgr2=0x7f7b3400b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:21.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.776+0000 7f7b4ef40700 1 --2- 172.21.15.80:0/2193054867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b340093a0 0x7f7b3400b870 secure :-1 s=READY pgs=722 cs=0 l=1 rx=0x7f7b3800f860 tx=0x7f7b3800f790).stop 2019-11-28T11:29:21.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.777+0000 7f7b4ef40700 1 -- 172.21.15.80:0/2193054867 shutdown_connections 2019-11-28T11:29:21.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.777+0000 7f7b4ef40700 1 --2- 172.21.15.80:0/2193054867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b340093a0 0x7f7b3400b870 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:21.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.777+0000 7f7b4ef40700 1 -- 172.21.15.80:0/2193054867 shutdown_connections 2019-11-28T11:29:21.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.777+0000 7f7b4ef40700 1 -- 172.21.15.80:0/2193054867 wait complete. 2019-11-28T11:29:21.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.777+0000 7f7b4ef40700 1 -- 172.21.15.80:0/2193054867 >> 172.21.15.80:0/2193054867 conn(0x7f7b48061d20 msgr2=0x7f7b480641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:21.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.780+0000 7f7b4ef40700 1 Processor -- start 2019-11-28T11:29:21.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.780+0000 7f7b4ef40700 1 -- start start 2019-11-28T11:29:21.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ef40700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7b481502e0 0x7f7b48150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:21.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ef40700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b48133a20 con 0x7f7b48150cb0 2019-11-28T11:29:21.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ef40700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b48109fc0 con 0x7f7b48108630 2019-11-28T11:29:21.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ef40700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b48131980 con 0x7f7b481502e0 2019-11-28T11:29:21.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ccdc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7b481502e0 0x7f7b48150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:21.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ccdc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7b481502e0 0x7f7b48150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34614/0 (socket says 172.21.15.80:34614) 2019-11-28T11:29:21.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ccdc700 1 -- 172.21.15.80:0/175413955 learned_addr learned my addr 172.21.15.80:0/175413955 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:21.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ccdc700 1 -- 172.21.15.80:0/175413955 >> v1:172.21.15.174:6789/0 conn(0x7f7b48108630 legacy=0x7f7b48151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:21.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ccdc700 1 -- 172.21.15.80:0/175413955 >> v1:172.21.15.80:6789/0 conn(0x7f7b48150cb0 legacy=0x7f7b48167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:21.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ccdc700 1 -- 172.21.15.80:0/175413955 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b481322e0 con 0x7f7b481502e0 2019-11-28T11:29:21.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b45ffb700 1 -- 172.21.15.80:0/175413955 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067496290 0 0) 0x7f7b30001010 con 0x7f7b48108630 2019-11-28T11:29:21.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ccdc700 1 --2- 172.21.15.80:0/175413955 >> v2:172.21.15.80:3300/0 conn(0x7f7b481502e0 0x7f7b48150770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b40010440 tx=0x7f7b400107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:21.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ccdc700 1 --2- 172.21.15.80:0/175413955 >> v2:172.21.15.80:3300/0 conn(0x7f7b481502e0 0x7f7b48150770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b40010440 tx=0x7f7b400107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:21.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ccdc700 1 --2- 172.21.15.80:0/175413955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b481502e0 0x7f7b48150770 secure :-1 s=READY pgs=724 cs=0 l=1 rx=0x7f7b40010440 tx=0x7f7b400107e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:21.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ccdc700 1 --2- 172.21.15.80:0/175413955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b481502e0 0x7f7b48150770 secure :-1 s=THROTTLE_DONE pgs=724 cs=0 l=1 rx=0x7f7b40010440 tx=0x7f7b400107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:21.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b45ffb700 1 -- 172.21.15.80:0/175413955 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b400059c0 con 0x7f7b481502e0 2019-11-28T11:29:21.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ccdc700 1 --2- 172.21.15.80:0/175413955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b481502e0 0x7f7b48150770 secure :-1 s=THROTTLE_DONE pgs=724 cs=0 l=1 rx=0x7f7b40010440 tx=0x7f7b400107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:21.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ccdc700 1 --2- 172.21.15.80:0/175413955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b481502e0 0x7f7b48150770 secure :-1 s=THROTTLE_DONE pgs=724 cs=0 l=1 rx=0x7f7b40010440 tx=0x7f7b400107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:21.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b45ffb700 1 -- 172.21.15.80:0/175413955 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b40000940 con 0x7f7b481502e0 2019-11-28T11:29:21.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ef40700 1 -- 172.21.15.80:0/175413955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b48132660 con 0x7f7b481502e0 2019-11-28T11:29:21.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b45ffb700 1 -- 172.21.15.80:0/175413955 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b40005fa0 con 0x7f7b481502e0 2019-11-28T11:29:21.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.781+0000 7f7b4ef40700 1 -- 172.21.15.80:0/175413955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b481322e0 con 0x7f7b481502e0 2019-11-28T11:29:21.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.782+0000 7f7b4ccdc700 1 --2- 172.21.15.80:0/175413955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b481502e0 0x7f7b48150770 secure :-1 s=THROTTLE_DONE pgs=724 cs=0 l=1 rx=0x7f7b40010440 tx=0x7f7b400107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:21.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.782+0000 7f7b45ffb700 1 -- 172.21.15.80:0/175413955 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7b40005fa0 con 0x7f7b481502e0 2019-11-28T11:29:21.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.782+0000 7f7b4ccdc700 1 --2- 172.21.15.80:0/175413955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b481502e0 0x7f7b48150770 secure :-1 s=THROTTLE_DONE pgs=724 cs=0 l=1 rx=0x7f7b40010440 tx=0x7f7b400107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:21.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.782+0000 7f7b45ffb700 1 --2- 172.21.15.80:0/175413955 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b2c018730 0x7f7b2c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:21.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.782+0000 7f7b45ffb700 1 -- 172.21.15.80:0/175413955 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5668+0+0 (secure 0 0 0) 0x7f7b40031b90 con 0x7f7b481502e0 2019-11-28T11:29:21.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.782+0000 7f7b4d4dd700 1 --2- 172.21.15.80:0/175413955 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b2c018730 0x7f7b2c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:21.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.783+0000 7f7b4d4dd700 1 --2- 172.21.15.80:0/175413955 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b2c018730 0x7f7b2c01abc0 crc :-1 s=READY pgs=302 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:21.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.790+0000 7f7b4ef40700 1 -- 172.21.15.80:0/175413955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b48132660 con 0x7f7b481502e0 2019-11-28T11:29:21.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.793+0000 7f7b4ccdc700 1 --2- 172.21.15.80:0/175413955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b481502e0 0x7f7b48150770 secure :-1 s=THROTTLE_DONE pgs=724 cs=0 l=1 rx=0x7f7b40010440 tx=0x7f7b400107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:21.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.793+0000 7f7b45ffb700 1 -- 172.21.15.80:0/175413955 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7b40005c50 con 0x7f7b481502e0 2019-11-28T11:29:21.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:21.961+0000 7f7b4ef40700 1 -- 172.21.15.80:0/175413955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7b481322e0 con 0x7f7b481502e0 2019-11-28T11:29:22.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.601+0000 7f7b4ccdc700 1 --2- 172.21.15.80:0/175413955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b481502e0 0x7f7b48150770 secure :-1 s=THROTTLE_DONE pgs=724 cs=0 l=1 rx=0x7f7b40010440 tx=0x7f7b400107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:22.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.601+0000 7f7b45ffb700 1 -- 172.21.15.80:0/175413955 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v62) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7b40000940 con 0x7f7b481502e0 2019-11-28T11:29:22.656 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:29:22.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.628+0000 7f7b4ef40700 1 -- 172.21.15.80:0/175413955 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b2c018730 msgr2=0x7f7b2c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:22.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.628+0000 7f7b4ef40700 1 --2- 172.21.15.80:0/175413955 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b2c018730 0x7f7b2c01abc0 crc :-1 s=READY pgs=302 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:22.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.628+0000 7f7b4ef40700 1 -- 172.21.15.80:0/175413955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b481502e0 msgr2=0x7f7b48150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:22.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.628+0000 7f7b4ef40700 1 --2- 172.21.15.80:0/175413955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b481502e0 0x7f7b48150770 secure :-1 s=READY pgs=724 cs=0 l=1 rx=0x7f7b40010440 tx=0x7f7b400107e0).stop 2019-11-28T11:29:22.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.629+0000 7f7b4ef40700 1 -- 172.21.15.80:0/175413955 shutdown_connections 2019-11-28T11:29:22.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.629+0000 7f7b4ef40700 1 --2- 172.21.15.80:0/175413955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b481502e0 0x7f7b48150770 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:22.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.629+0000 7f7b4ef40700 1 --2- 172.21.15.80:0/175413955 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b2c018730 0x7f7b2c01abc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:22.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.629+0000 7f7b4ef40700 1 -- 172.21.15.80:0/175413955 shutdown_connections 2019-11-28T11:29:22.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.629+0000 7f7b4ef40700 1 -- 172.21.15.80:0/175413955 wait complete. 2019-11-28T11:29:22.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.629+0000 7f7b4ef40700 1 -- 172.21.15.80:0/175413955 >> 172.21.15.80:0/175413955 conn(0x7f7b4814dbb0 msgr2=0x7f7b48142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:22.670 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:29:22.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.766+0000 7f9faed85700 1 Processor -- start 2019-11-28T11:29:22.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.767+0000 7f9faed85700 1 -- start start 2019-11-28T11:29:22.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.767+0000 7f9faed85700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9fa806c490 0x7f9fa806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:22.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.767+0000 7f9faed85700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fa806ce60 0x7f9fa8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:22.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.767+0000 7f9faed85700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa806db00 con 0x7f9fa806c0a0 2019-11-28T11:29:22.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.767+0000 7f9faed85700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa806fd60 con 0x7f9fa806c490 2019-11-28T11:29:22.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.767+0000 7f9faed85700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8070030 con 0x7f9fa806ce60 2019-11-28T11:29:22.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9facb21700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9fa806c490 0x7f9fa806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:22.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9fad322700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9fa806c0a0 0x7f9fa8072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33936/0 (socket says 172.21.15.80:33936) 2019-11-28T11:29:22.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9facb21700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9fa806c490 0x7f9fa806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34624/0 (socket says 172.21.15.80:34624) 2019-11-28T11:29:22.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9fad322700 1 -- 172.21.15.80:0/812413337 learned_addr learned my addr 172.21.15.80:0/812413337 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:22.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9fadb23700 1 --2- 172.21.15.80:0/812413337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fa806ce60 0x7f9fa8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:22.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9fa7fff700 1 -- 172.21.15.80:0/812413337 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400808031 0 0) 0x7f9f900014d0 con 0x7f9fa806c0a0 2019-11-28T11:29:22.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9fa7fff700 1 -- 172.21.15.80:0/812413337 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f94002e80 con 0x7f9fa806c0a0 2019-11-28T11:29:22.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9facb21700 1 -- 172.21.15.80:0/812413337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fa806ce60 msgr2=0x7f9fa8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:22.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9facb21700 1 --2- 172.21.15.80:0/812413337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fa806ce60 0x7f9fa8164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:22.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9facb21700 1 -- 172.21.15.80:0/812413337 >> v1:172.21.15.80:6789/0 conn(0x7f9fa806c0a0 legacy=0x7f9fa8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:22.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9facb21700 1 -- 172.21.15.80:0/812413337 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa80706c0 con 0x7f9fa806c490 2019-11-28T11:29:22.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9facb21700 1 --2- 172.21.15.80:0/812413337 >> v2:172.21.15.80:3300/0 conn(0x7f9fa806c490 0x7f9fa806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9f9800af50 tx=0x7f9f9800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:22.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9facb21700 1 --2- 172.21.15.80:0/812413337 >> v2:172.21.15.80:3300/0 conn(0x7f9fa806c490 0x7f9fa806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9f9800af50 tx=0x7f9f9800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:22.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9facb21700 1 --2- 172.21.15.80:0/812413337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa806c490 0x7f9fa806c920 secure :-1 s=READY pgs=726 cs=0 l=1 rx=0x7f9f9800af50 tx=0x7f9f9800b250).ready entity=mon.0 client_cookie=8957c0ee9b1a28dd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:22.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9facb21700 1 --2- 172.21.15.80:0/812413337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa806c490 0x7f9fa806c920 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7f9f9800af50 tx=0x7f9f9800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:22.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9fa7fff700 1 -- 172.21.15.80:0/812413337 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f98007210 con 0x7f9fa806c490 2019-11-28T11:29:22.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9facb21700 1 --2- 172.21.15.80:0/812413337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa806c490 0x7f9fa806c920 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7f9f9800af50 tx=0x7f9f9800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:22.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9facb21700 1 --2- 172.21.15.80:0/812413337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa806c490 0x7f9fa806c920 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7f9f9800af50 tx=0x7f9f9800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:22.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9fa7fff700 1 -- 172.21.15.80:0/812413337 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f980099b0 con 0x7f9fa806c490 2019-11-28T11:29:22.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9fa7fff700 1 -- 172.21.15.80:0/812413337 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f9800a080 con 0x7f9fa806c490 2019-11-28T11:29:22.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9faed85700 1 -- 172.21.15.80:0/812413337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa806c490 msgr2=0x7f9fa806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:22.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.768+0000 7f9faed85700 1 --2- 172.21.15.80:0/812413337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa806c490 0x7f9fa806c920 secure :-1 s=READY pgs=726 cs=0 l=1 rx=0x7f9f9800af50 tx=0x7f9f9800b250).stop 2019-11-28T11:29:22.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.769+0000 7f9faed85700 1 -- 172.21.15.80:0/812413337 shutdown_connections 2019-11-28T11:29:22.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.769+0000 7f9faed85700 1 --2- 172.21.15.80:0/812413337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fa806ce60 0x7f9fa8164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:22.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.769+0000 7f9faed85700 1 --2- 172.21.15.80:0/812413337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa806c490 0x7f9fa806c920 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:22.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.769+0000 7f9faed85700 1 -- 172.21.15.80:0/812413337 shutdown_connections 2019-11-28T11:29:22.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.769+0000 7f9faed85700 1 -- 172.21.15.80:0/812413337 wait complete. 2019-11-28T11:29:22.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.769+0000 7f9faed85700 1 -- 172.21.15.80:0/812413337 >> 172.21.15.80:0/812413337 conn(0x7f9fa8061cf0 msgr2=0x7f9fa8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:22.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.772+0000 7f9faed85700 1 Processor -- start 2019-11-28T11:29:22.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.772+0000 7f9faed85700 1 -- start start 2019-11-28T11:29:22.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9faed85700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9fa81281b0 0x7f9fa8128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:22.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9faed85700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9fa8128b80 0x7f9fa8167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:22.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9faed85700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa8139a60 con 0x7f9fa813a780 2019-11-28T11:29:22.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9faed85700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa812a260 con 0x7f9fa8128b80 2019-11-28T11:29:22.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9faed85700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa812a530 con 0x7f9fa81281b0 2019-11-28T11:29:22.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fadb23700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9fa8128b80 0x7f9fa8167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:22.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fad322700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9fa813a780 0x7f9fa812d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33942/0 (socket says 172.21.15.80:33942) 2019-11-28T11:29:22.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fad322700 1 -- 172.21.15.80:0/3609818227 learned_addr learned my addr 172.21.15.80:0/3609818227 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:22.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9facb21700 1 --2- 172.21.15.80:0/3609818227 >> v2:172.21.15.174:3300/0 conn(0x7f9fa81281b0 0x7f9fa8128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:22.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fadb23700 1 -- 172.21.15.80:0/3609818227 >> v2:172.21.15.174:3300/0 conn(0x7f9fa81281b0 msgr2=0x7f9fa8128640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:22.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fadb23700 1 --2- 172.21.15.80:0/3609818227 >> v2:172.21.15.174:3300/0 conn(0x7f9fa81281b0 0x7f9fa8128640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:22.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fa5ffb700 1 -- 172.21.15.80:0/3609818227 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781391829 0 0) 0x7f9f900014f0 con 0x7f9fa813a780 2019-11-28T11:29:22.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fadb23700 1 -- 172.21.15.80:0/3609818227 >> v1:172.21.15.80:6789/0 conn(0x7f9fa813a780 legacy=0x7f9fa812d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:22.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fadb23700 1 -- 172.21.15.80:0/3609818227 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa812abc0 con 0x7f9fa8128b80 2019-11-28T11:29:22.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fadb23700 1 --2- 172.21.15.80:0/3609818227 >> v2:172.21.15.80:3300/0 conn(0x7f9fa8128b80 0x7f9fa8167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9fa000ea40 tx=0x7f9fa0010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:22.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fadb23700 1 --2- 172.21.15.80:0/3609818227 >> v2:172.21.15.80:3300/0 conn(0x7f9fa8128b80 0x7f9fa8167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9fa000ea40 tx=0x7f9fa0010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:22.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fadb23700 1 --2- 172.21.15.80:0/3609818227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa8128b80 0x7f9fa8167d70 secure :-1 s=READY pgs=728 cs=0 l=1 rx=0x7f9fa000ea40 tx=0x7f9fa0010240).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:22.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fadb23700 1 --2- 172.21.15.80:0/3609818227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa8128b80 0x7f9fa8167d70 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f9fa000ea40 tx=0x7f9fa0010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:22.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fa5ffb700 1 -- 172.21.15.80:0/3609818227 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fa000ee80 con 0x7f9fa8128b80 2019-11-28T11:29:22.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fadb23700 1 --2- 172.21.15.80:0/3609818227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa8128b80 0x7f9fa8167d70 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f9fa000ea40 tx=0x7f9fa0010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:22.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fadb23700 1 --2- 172.21.15.80:0/3609818227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa8128b80 0x7f9fa8167d70 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f9fa000ea40 tx=0x7f9fa0010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:22.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fa5ffb700 1 -- 172.21.15.80:0/3609818227 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa000f080 con 0x7f9fa8128b80 2019-11-28T11:29:22.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9faed85700 1 -- 172.21.15.80:0/3609818227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa812af40 con 0x7f9fa8128b80 2019-11-28T11:29:22.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9fa5ffb700 1 -- 172.21.15.80:0/3609818227 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fa000f750 con 0x7f9fa8128b80 2019-11-28T11:29:22.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.773+0000 7f9faed85700 1 -- 172.21.15.80:0/3609818227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa812abc0 con 0x7f9fa8128b80 2019-11-28T11:29:22.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.774+0000 7f9fadb23700 1 --2- 172.21.15.80:0/3609818227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa8128b80 0x7f9fa8167d70 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f9fa000ea40 tx=0x7f9fa0010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:22.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.774+0000 7f9fa5ffb700 1 -- 172.21.15.80:0/3609818227 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9fa000ebe0 con 0x7f9fa8128b80 2019-11-28T11:29:22.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.774+0000 7f9fadb23700 1 --2- 172.21.15.80:0/3609818227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa8128b80 0x7f9fa8167d70 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f9fa000ea40 tx=0x7f9fa0010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:22.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.774+0000 7f9fa5ffb700 1 --2- 172.21.15.80:0/3609818227 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f8c018730 0x7f9f8c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:22.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.774+0000 7f9fa5ffb700 1 -- 172.21.15.80:0/3609818227 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5286+0+0 (secure 0 0 0) 0x7f9fa0031a50 con 0x7f9fa8128b80 2019-11-28T11:29:22.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.774+0000 7f9fad322700 1 --2- 172.21.15.80:0/3609818227 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f8c018730 0x7f9f8c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:22.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.774+0000 7f9fad322700 1 --2- 172.21.15.80:0/3609818227 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f8c018730 0x7f9f8c01abc0 crc :-1 s=READY pgs=303 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:22.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.782+0000 7f9faed85700 1 -- 172.21.15.80:0/3609818227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa812af40 con 0x7f9fa8128b80 2019-11-28T11:29:22.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.785+0000 7f9fadb23700 1 --2- 172.21.15.80:0/3609818227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa8128b80 0x7f9fa8167d70 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f9fa000ea40 tx=0x7f9fa0010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:22.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.785+0000 7f9fa5ffb700 1 -- 172.21.15.80:0/3609818227 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9fa0000a70 con 0x7f9fa8128b80 2019-11-28T11:29:23.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:22.974+0000 7f9faed85700 1 -- 172.21.15.80:0/3609818227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f9fa812abc0 con 0x7f9fa8128b80 2019-11-28T11:29:23.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.602+0000 7f9fadb23700 1 --2- 172.21.15.80:0/3609818227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa8128b80 0x7f9fa8167d70 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f9fa000ea40 tx=0x7f9fa0010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:23.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.602+0000 7f9fa5ffb700 1 -- 172.21.15.80:0/3609818227 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v63) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9fa0000a70 con 0x7f9fa8128b80 2019-11-28T11:29:23.669 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:29:23.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.640+0000 7f9faed85700 1 -- 172.21.15.80:0/3609818227 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f8c018730 msgr2=0x7f9f8c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:23.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.640+0000 7f9faed85700 1 --2- 172.21.15.80:0/3609818227 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f8c018730 0x7f9f8c01abc0 crc :-1 s=READY pgs=303 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:23.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.640+0000 7f9faed85700 1 -- 172.21.15.80:0/3609818227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa8128b80 msgr2=0x7f9fa8167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:23.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.641+0000 7f9faed85700 1 --2- 172.21.15.80:0/3609818227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa8128b80 0x7f9fa8167d70 secure :-1 s=READY pgs=728 cs=0 l=1 rx=0x7f9fa000ea40 tx=0x7f9fa0010240).stop 2019-11-28T11:29:23.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.641+0000 7f9faed85700 1 -- 172.21.15.80:0/3609818227 shutdown_connections 2019-11-28T11:29:23.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.641+0000 7f9faed85700 1 --2- 172.21.15.80:0/3609818227 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f8c018730 0x7f9f8c01abc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:23.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.641+0000 7f9faed85700 1 --2- 172.21.15.80:0/3609818227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa8128b80 0x7f9fa8167d70 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:23.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.641+0000 7f9faed85700 1 --2- 172.21.15.80:0/3609818227 >> v2:172.21.15.174:3300/0 conn(0x7f9fa81281b0 0x7f9fa8128640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:23.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.641+0000 7f9faed85700 1 -- 172.21.15.80:0/3609818227 shutdown_connections 2019-11-28T11:29:23.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.641+0000 7f9faed85700 1 -- 172.21.15.80:0/3609818227 wait complete. 2019-11-28T11:29:23.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.641+0000 7f9faed85700 1 -- 172.21.15.80:0/3609818227 >> 172.21.15.80:0/3609818227 conn(0x7f9fa8127dc0 msgr2=0x7f9fa8141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:23.681 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:29:23.682 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:29:23.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.771+0000 7f370df5c700 1 Processor -- start 2019-11-28T11:29:23.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.771+0000 7f370df5c700 1 -- start start 2019-11-28T11:29:23.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.772+0000 7f370df5c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f370806c0a0 0x7f3708072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:23.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.772+0000 7f370df5c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37080734e0 0x7f3708071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:23.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.772+0000 7f370df5c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370806db00 con 0x7f3708072360 2019-11-28T11:29:23.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.772+0000 7f370df5c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370806fd60 con 0x7f370806c0a0 2019-11-28T11:29:23.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.772+0000 7f370df5c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3708070030 con 0x7f37080734e0 2019-11-28T11:29:23.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.772+0000 7f3707fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f370806c0a0 0x7f3708072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:23.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.772+0000 7f370ccfa700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3708072360 0x7f370806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33952/0 (socket says 172.21.15.80:33952) 2019-11-28T11:29:23.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.772+0000 7f370ccfa700 1 -- 172.21.15.80:0/1785086682 learned_addr learned my addr 172.21.15.80:0/1785086682 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:23.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.772+0000 7f36fffff700 1 --2- 172.21.15.80:0/1785086682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37080734e0 0x7f3708071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:23.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.772+0000 7f3707fff700 1 -- 172.21.15.80:0/1785086682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37080734e0 msgr2=0x7f3708071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:23.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.772+0000 7f3707fff700 1 --2- 172.21.15.80:0/1785086682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37080734e0 0x7f3708071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:23.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.772+0000 7f3707fff700 1 -- 172.21.15.80:0/1785086682 >> v1:172.21.15.80:6789/0 conn(0x7f3708072360 legacy=0x7f370806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:23.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.772+0000 7f3707fff700 1 -- 172.21.15.80:0/1785086682 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37080706c0 con 0x7f370806c0a0 2019-11-28T11:29:23.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.772+0000 7f37077fe700 1 -- 172.21.15.80:0/1785086682 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760798526 0 0) 0x7f37000014d0 con 0x7f3708072360 2019-11-28T11:29:23.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.772+0000 7f36fffff700 1 --2- 172.21.15.80:0/1785086682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37080734e0 0x7f3708071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:29:23.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.772+0000 7f3707fff700 1 --2- 172.21.15.80:0/1785086682 >> v2:172.21.15.80:3300/0 conn(0x7f370806c0a0 0x7f3708072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f36f800af50 tx=0x7f36f800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:23.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.773+0000 7f3707fff700 1 --2- 172.21.15.80:0/1785086682 >> v2:172.21.15.80:3300/0 conn(0x7f370806c0a0 0x7f3708072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f36f800af50 tx=0x7f36f800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:23.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.773+0000 7f3707fff700 1 --2- 172.21.15.80:0/1785086682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370806c0a0 0x7f3708072fa0 secure :-1 s=READY pgs=730 cs=0 l=1 rx=0x7f36f800af50 tx=0x7f36f800b760).ready entity=mon.0 client_cookie=a31aaeb5cd236af server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:23.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.773+0000 7f3707fff700 1 --2- 172.21.15.80:0/1785086682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370806c0a0 0x7f3708072fa0 secure :-1 s=THROTTLE_DONE pgs=730 cs=0 l=1 rx=0x7f36f800af50 tx=0x7f36f800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:23.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.773+0000 7f37077fe700 1 -- 172.21.15.80:0/1785086682 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36f8007210 con 0x7f370806c0a0 2019-11-28T11:29:23.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.773+0000 7f3707fff700 1 --2- 172.21.15.80:0/1785086682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370806c0a0 0x7f3708072fa0 secure :-1 s=THROTTLE_DONE pgs=730 cs=0 l=1 rx=0x7f36f800af50 tx=0x7f36f800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:23.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.773+0000 7f3707fff700 1 --2- 172.21.15.80:0/1785086682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370806c0a0 0x7f3708072fa0 secure :-1 s=THROTTLE_DONE pgs=730 cs=0 l=1 rx=0x7f36f800af50 tx=0x7f36f800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:23.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.773+0000 7f37077fe700 1 -- 172.21.15.80:0/1785086682 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f80099b0 con 0x7f370806c0a0 2019-11-28T11:29:23.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.773+0000 7f37077fe700 1 -- 172.21.15.80:0/1785086682 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36f800a080 con 0x7f370806c0a0 2019-11-28T11:29:23.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.773+0000 7f370df5c700 1 -- 172.21.15.80:0/1785086682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370806c0a0 msgr2=0x7f3708072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:23.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.773+0000 7f370df5c700 1 --2- 172.21.15.80:0/1785086682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370806c0a0 0x7f3708072fa0 secure :-1 s=READY pgs=730 cs=0 l=1 rx=0x7f36f800af50 tx=0x7f36f800b760).stop 2019-11-28T11:29:23.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.773+0000 7f370df5c700 1 -- 172.21.15.80:0/1785086682 shutdown_connections 2019-11-28T11:29:23.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.773+0000 7f370df5c700 1 --2- 172.21.15.80:0/1785086682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37080734e0 0x7f3708071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:23.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.773+0000 7f370df5c700 1 --2- 172.21.15.80:0/1785086682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f370806c0a0 0x7f3708072fa0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:23.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.773+0000 7f370df5c700 1 -- 172.21.15.80:0/1785086682 shutdown_connections 2019-11-28T11:29:23.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.773+0000 7f370df5c700 1 -- 172.21.15.80:0/1785086682 wait complete. 2019-11-28T11:29:23.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.773+0000 7f370df5c700 1 -- 172.21.15.80:0/1785086682 >> 172.21.15.80:0/1785086682 conn(0x7f3708061cf0 msgr2=0x7f3708064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:23.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.776+0000 7f370df5c700 1 Processor -- start 2019-11-28T11:29:23.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.776+0000 7f370df5c700 1 -- start start 2019-11-28T11:29:23.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f370df5c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3708143180 0x7f370815a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:23.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f370df5c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f370815ae20 0x7f3708159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:23.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f370df5c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370813dd80 con 0x7f3708159d90 2019-11-28T11:29:23.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f370df5c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370815c2e0 con 0x7f3708143180 2019-11-28T11:29:23.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f370df5c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370815c5b0 con 0x7f370815ae20 2019-11-28T11:29:23.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f3707fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3708143180 0x7f370815a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:23.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f3707fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3708143180 0x7f370815a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34640/0 (socket says 172.21.15.80:34640) 2019-11-28T11:29:23.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f3707fff700 1 -- 172.21.15.80:0/497908804 learned_addr learned my addr 172.21.15.80:0/497908804 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:23.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f36fffff700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f370815ae20 0x7f3708159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:23.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f3707fff700 1 -- 172.21.15.80:0/497908804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f370815ae20 msgr2=0x7f3708159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:23.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f3707fff700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f370815ae20 0x7f3708159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:23.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f3707fff700 1 -- 172.21.15.80:0/497908804 >> v1:172.21.15.80:6789/0 conn(0x7f3708159d90 legacy=0x7f3708113fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:23.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f3707fff700 1 -- 172.21.15.80:0/497908804 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370815cc40 con 0x7f3708143180 2019-11-28T11:29:23.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f3707fff700 1 --2- 172.21.15.80:0/497908804 >> v2:172.21.15.80:3300/0 conn(0x7f3708143180 0x7f370815a8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f36f8010420 tx=0x7f36f80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:23.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f3707fff700 1 --2- 172.21.15.80:0/497908804 >> v2:172.21.15.80:3300/0 conn(0x7f3708143180 0x7f370815a8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f36f8010420 tx=0x7f36f80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:23.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f3707fff700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708143180 0x7f370815a8e0 secure :-1 s=READY pgs=732 cs=0 l=1 rx=0x7f36f8010420 tx=0x7f36f80102a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:23.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f3707fff700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708143180 0x7f370815a8e0 secure :-1 s=THROTTLE_DONE pgs=732 cs=0 l=1 rx=0x7f36f8010420 tx=0x7f36f80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:23.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f3707fff700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708143180 0x7f370815a8e0 secure :-1 s=THROTTLE_DONE pgs=732 cs=0 l=1 rx=0x7f36f8010420 tx=0x7f36f80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:23.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f3707fff700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708143180 0x7f370815a8e0 secure :-1 s=THROTTLE_DONE pgs=732 cs=0 l=1 rx=0x7f36f8010420 tx=0x7f36f80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:23.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f37057fa700 1 -- 172.21.15.80:0/497908804 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36f800b250 con 0x7f3708143180 2019-11-28T11:29:23.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f37057fa700 1 -- 172.21.15.80:0/497908804 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f8009770 con 0x7f3708143180 2019-11-28T11:29:23.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f37057fa700 1 -- 172.21.15.80:0/497908804 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36f8000940 con 0x7f3708143180 2019-11-28T11:29:23.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f370df5c700 1 -- 172.21.15.80:0/497908804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370815cfc0 con 0x7f3708143180 2019-11-28T11:29:23.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.777+0000 7f370df5c700 1 -- 172.21.15.80:0/497908804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370815cc40 con 0x7f3708143180 2019-11-28T11:29:23.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.778+0000 7f3707fff700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708143180 0x7f370815a8e0 secure :-1 s=THROTTLE_DONE pgs=732 cs=0 l=1 rx=0x7f36f8010420 tx=0x7f36f80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:23.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.778+0000 7f37057fa700 1 -- 172.21.15.80:0/497908804 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f36f8009960 con 0x7f3708143180 2019-11-28T11:29:23.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.778+0000 7f3707fff700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708143180 0x7f370815a8e0 secure :-1 s=THROTTLE_DONE pgs=732 cs=0 l=1 rx=0x7f36f8010420 tx=0x7f36f80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:23.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.778+0000 7f37057fa700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36ec018730 0x7f36ec01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:23.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.778+0000 7f37057fa700 1 -- 172.21.15.80:0/497908804 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f36f8031ac0 con 0x7f3708143180 2019-11-28T11:29:23.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.778+0000 7f36fffff700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36ec018730 0x7f36ec01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:23.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.779+0000 7f36fffff700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36ec018730 0x7f36ec01abc0 crc :-1 s=READY pgs=304 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:23.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.786+0000 7f370df5c700 1 -- 172.21.15.80:0/497908804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370815cfc0 con 0x7f3708143180 2019-11-28T11:29:23.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.789+0000 7f3707fff700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708143180 0x7f370815a8e0 secure :-1 s=THROTTLE_DONE pgs=732 cs=0 l=1 rx=0x7f36f8010420 tx=0x7f36f80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:23.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.789+0000 7f37057fa700 1 -- 172.21.15.80:0/497908804 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f36f800b5d0 con 0x7f3708143180 2019-11-28T11:29:23.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.960+0000 7f370df5c700 1 -- 172.21.15.80:0/497908804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f370815cc40 con 0x7f3708143180 2019-11-28T11:29:23.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.960+0000 7f3707fff700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708143180 0x7f370815a8e0 secure :-1 s=THROTTLE_DONE pgs=732 cs=0 l=1 rx=0x7f36f8010420 tx=0x7f36f80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:23.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.960+0000 7f37057fa700 1 -- 172.21.15.80:0/497908804 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+4797 (secure 0 0 0) 0x7f36f8009960 con 0x7f3708143180 2019-11-28T11:29:23.991 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:23.991 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:29:23.992 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:29:23.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:23.992 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:29:23.992 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:29:23.992 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:23.992 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:29:23.993 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:29:23.993 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:29:23.993 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:29:23.993 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:23.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:23.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:23.994 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:29:23.994 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:29:23.994 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:23.994 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:29:23.994 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:29:23.994 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:29:23.994 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:29:23.995 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:23.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:23.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:23.995 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:29:23.995 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:29:23.995 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:23.995 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:29:23.996 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:29:23.996 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:29:23.996 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:29:23.996 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:23.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:23.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:23.997 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:29:23.997 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:29:23.997 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:23.997 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:29:23.997 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:29:23.998 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:29:23.998 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:23.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:23.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:23.998 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:29:23.998 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:29:23.998 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:23.999 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:29:23.999 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:29:23.999 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:29:23.999 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:23.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:23.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:23.999 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:29:24.000 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:29:24.000 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:24.000 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:29:24.000 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:29:24.000 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:29:24.000 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:24.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:24.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:24.001 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:29:24.001 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:29:24.001 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:24.001 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:29:24.001 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:29:24.001 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:29:24.002 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:24.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:24.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:24.002 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:29:24.002 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:29:24.002 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:24.002 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:29:24.002 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:29:24.003 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:29:24.003 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:24.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:24.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:24.003 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:29:24.003 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:29:24.003 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:24.004 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:29:24.004 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:29:24.004 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:29:24.004 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:24.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:24.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:24.004 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:29:24.005 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:29:24.005 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:24.005 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:29:24.005 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:29:24.005 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:29:24.005 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:24.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:24.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:24.006 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:29:24.006 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:29:24.006 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:24.006 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:29:24.006 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:29:24.006 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:29:24.007 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:24.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:24.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:24.009 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:29:24.009 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:29:24.009 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:24.009 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:29:24.009 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:29:24.010 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:29:24.010 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:24.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:24.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:24.010 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:29:24.010 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:29:24.010 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:24.011 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:29:24.011 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:29:24.011 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:29:24.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:24.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:24.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:24.011 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:29:24.012 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:29:24.012 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:24.012 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:29:24.012 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:29:24.012 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:29:24.012 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:24.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:24.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:24.013 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:29:24.013 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:29:24.013 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:24.013 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:29:24.013 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:29:24.013 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:29:24.014 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:24.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:24.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:24.014 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:29:24.014 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:29:24.014 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:24.014 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:29:24.015 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:29:24.015 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:29:24.015 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:29:24.015 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:24.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:24.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:24.015 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:29:24.015 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:29:24.016 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:24.016 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:29:24.016 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:29:24.016 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:29:24.016 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:24.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:29:24.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:24.017 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:29:24.017 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:29:24.017 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:29:24.017 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:29:24.017 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:29:24.017 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:29:24.017 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:24.018 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:24.018 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:29:24.018 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:29:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.962+0000 7f370df5c700 1 -- 172.21.15.80:0/497908804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36ec018730 msgr2=0x7f36ec01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.962+0000 7f370df5c700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36ec018730 0x7f36ec01abc0 crc :-1 s=READY pgs=304 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.962+0000 7f370df5c700 1 -- 172.21.15.80:0/497908804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708143180 msgr2=0x7f370815a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.962+0000 7f370df5c700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708143180 0x7f370815a8e0 secure :-1 s=READY pgs=732 cs=0 l=1 rx=0x7f36f8010420 tx=0x7f36f80102a0).stop 2019-11-28T11:29:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.962+0000 7f370df5c700 1 -- 172.21.15.80:0/497908804 shutdown_connections 2019-11-28T11:29:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.962+0000 7f370df5c700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36ec018730 0x7f36ec01abc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.962+0000 7f370df5c700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f370815ae20 0x7f3708159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.962+0000 7f370df5c700 1 --2- 172.21.15.80:0/497908804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3708143180 0x7f370815a8e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.963+0000 7f370df5c700 1 -- 172.21.15.80:0/497908804 shutdown_connections 2019-11-28T11:29:24.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.963+0000 7f370df5c700 1 -- 172.21.15.80:0/497908804 wait complete. 2019-11-28T11:29:24.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:23.963+0000 7f370df5c700 1 -- 172.21.15.80:0/497908804 >> 172.21.15.80:0/497908804 conn(0x7f370813d620 msgr2=0x7f3708140470 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:24.022 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:29:24.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.112+0000 7fb9a3242700 1 Processor -- start 2019-11-28T11:29:24.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.112+0000 7fb9a3242700 1 -- start start 2019-11-28T11:29:24.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.113+0000 7fb9a3242700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb99c06c0a0 0x7fb99c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:24.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.113+0000 7fb9a3242700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb99c0734e0 0x7fb99c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:24.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.113+0000 7fb9a3242700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb99c072360 0x7fb99c0727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:24.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.113+0000 7fb9a3242700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99c06f330 con 0x7fb99c0734e0 2019-11-28T11:29:24.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.113+0000 7fb9a3242700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99c0706c0 con 0x7fb99c072360 2019-11-28T11:29:24.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.113+0000 7fb9a3242700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c070a40 con 0x7fb99c06c0a0 2019-11-28T11:29:24.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.113+0000 7fb9a0fde700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb99c0734e0 0x7fb99c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:24.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.113+0000 7fb9a0fde700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb99c0734e0 0x7fb99c071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34652/0 (socket says 172.21.15.80:34652) 2019-11-28T11:29:24.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.113+0000 7fb9a0fde700 1 -- 172.21.15.80:0/512869515 learned_addr learned my addr 172.21.15.80:0/512869515 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:24.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.113+0000 7fb9a17df700 1 --2- 172.21.15.80:0/512869515 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb99c06c0a0 0x7fb99c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:24.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.113+0000 7fb9a1fe0700 1 --2- 172.21.15.80:0/512869515 >> v2:172.21.15.174:3300/0 conn(0x7fb99c072360 0x7fb99c0727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:24.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.113+0000 7fb9a0fde700 1 -- 172.21.15.80:0/512869515 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb99c06c0a0 msgr2=0x7fb99c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:24.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.113+0000 7fb9a0fde700 1 --2- 172.21.15.80:0/512869515 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb99c06c0a0 0x7fb99c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:24.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.114+0000 7fb9a0fde700 1 -- 172.21.15.80:0/512869515 >> v2:172.21.15.174:3300/0 conn(0x7fb99c072360 msgr2=0x7fb99c0727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:24.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.114+0000 7fb9a0fde700 1 --2- 172.21.15.80:0/512869515 >> v2:172.21.15.174:3300/0 conn(0x7fb99c072360 0x7fb99c0727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:24.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.114+0000 7fb9a0fde700 1 -- 172.21.15.80:0/512869515 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99c06db00 con 0x7fb99c0734e0 2019-11-28T11:29:24.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.114+0000 7fb9a1fe0700 1 --2- 172.21.15.80:0/512869515 >> v2:172.21.15.174:3300/0 conn(0x7fb99c072360 0x7fb99c0727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:29:24.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.114+0000 7fb9a0fde700 1 --2- 172.21.15.80:0/512869515 >> v2:172.21.15.80:3300/0 conn(0x7fb99c0734e0 0x7fb99c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb98400f6c0 tx=0x7fb98400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.114+0000 7fb9a0fde700 1 --2- 172.21.15.80:0/512869515 >> v2:172.21.15.80:3300/0 conn(0x7fb99c0734e0 0x7fb99c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb98400f6c0 tx=0x7fb98400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.114+0000 7fb9a0fde700 1 --2- 172.21.15.80:0/512869515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c0734e0 0x7fb99c071e20 secure :-1 s=READY pgs=733 cs=0 l=1 rx=0x7fb98400f6c0 tx=0x7fb98400fa60).ready entity=mon.0 client_cookie=4d3a4d25a855d327 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:24.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.114+0000 7fb9a0fde700 1 --2- 172.21.15.80:0/512869515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c0734e0 0x7fb99c071e20 secure :-1 s=THROTTLE_DONE pgs=733 cs=0 l=1 rx=0x7fb98400f6c0 tx=0x7fb98400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.114+0000 7fb9a0fde700 1 --2- 172.21.15.80:0/512869515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c0734e0 0x7fb99c071e20 secure :-1 s=THROTTLE_DONE pgs=733 cs=0 l=1 rx=0x7fb98400f6c0 tx=0x7fb98400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.114+0000 7fb99bfff700 1 -- 172.21.15.80:0/512869515 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb984000960 con 0x7fb99c0734e0 2019-11-28T11:29:24.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.114+0000 7fb9a0fde700 1 --2- 172.21.15.80:0/512869515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c0734e0 0x7fb99c071e20 secure :-1 s=THROTTLE_DONE pgs=733 cs=0 l=1 rx=0x7fb98400f6c0 tx=0x7fb98400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.114+0000 7fb99bfff700 1 -- 172.21.15.80:0/512869515 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb984000c90 con 0x7fb99c0734e0 2019-11-28T11:29:24.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.114+0000 7fb99bfff700 1 -- 172.21.15.80:0/512869515 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb984001440 con 0x7fb99c0734e0 2019-11-28T11:29:24.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.114+0000 7fb9a3242700 1 -- 172.21.15.80:0/512869515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c0734e0 msgr2=0x7fb99c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.114+0000 7fb9a3242700 1 --2- 172.21.15.80:0/512869515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c0734e0 0x7fb99c071e20 secure :-1 s=READY pgs=733 cs=0 l=1 rx=0x7fb98400f6c0 tx=0x7fb98400fa60).stop 2019-11-28T11:29:24.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.115+0000 7fb9a3242700 1 -- 172.21.15.80:0/512869515 shutdown_connections 2019-11-28T11:29:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.115+0000 7fb9a3242700 1 --2- 172.21.15.80:0/512869515 >> v2:172.21.15.174:3300/0 conn(0x7fb99c072360 0x7fb99c0727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.115+0000 7fb9a3242700 1 --2- 172.21.15.80:0/512869515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c0734e0 0x7fb99c071e20 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.115+0000 7fb9a3242700 1 --2- 172.21.15.80:0/512869515 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb99c06c0a0 0x7fb99c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.115+0000 7fb9a3242700 1 -- 172.21.15.80:0/512869515 shutdown_connections 2019-11-28T11:29:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.115+0000 7fb9a3242700 1 -- 172.21.15.80:0/512869515 wait complete. 2019-11-28T11:29:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.115+0000 7fb9a3242700 1 -- 172.21.15.80:0/512869515 >> 172.21.15.80:0/512869515 conn(0x7fb99c061cf0 msgr2=0x7fb99c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:24.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.117+0000 7fb9a3242700 1 Processor -- start 2019-11-28T11:29:24.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.117+0000 7fb9a3242700 1 -- start start 2019-11-28T11:29:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.118+0000 7fb9a3242700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb99c13a780 0x7fb99c12d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.118+0000 7fb9a3242700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99c139a60 con 0x7fb99c12cb00 2019-11-28T11:29:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.118+0000 7fb9a3242700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99c13b060 con 0x7fb99c12d9c0 2019-11-28T11:29:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.118+0000 7fb9a3242700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99c12a260 con 0x7fb99c13a780 2019-11-28T11:29:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.118+0000 7fb9a17df700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb99c13a780 0x7fb99c12d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:24.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.118+0000 7fb9a1fe0700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb99c12cb00 0x7fb99c167d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33974/0 (socket says 172.21.15.80:33974) 2019-11-28T11:29:24.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.118+0000 7fb9a1fe0700 1 -- 172.21.15.80:0/470335295 learned_addr learned my addr 172.21.15.80:0/470335295 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:24.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.119+0000 7fb9a17df700 1 -- 172.21.15.80:0/470335295 >> v1:172.21.15.174:6789/0 conn(0x7fb99c12d9c0 legacy=0x7fb99c12c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.119+0000 7fb9a17df700 1 -- 172.21.15.80:0/470335295 >> v1:172.21.15.80:6789/0 conn(0x7fb99c12cb00 legacy=0x7fb99c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.119+0000 7fb9a17df700 1 -- 172.21.15.80:0/470335295 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99c12abc0 con 0x7fb99c13a780 2019-11-28T11:29:24.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.119+0000 7fb9a17df700 1 --2- 172.21.15.80:0/470335295 >> v2:172.21.15.80:3300/0 conn(0x7fb99c13a780 0x7fb99c12d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb98c0125b0 tx=0x7fb98c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.119+0000 7fb9a17df700 1 --2- 172.21.15.80:0/470335295 >> v2:172.21.15.80:3300/0 conn(0x7fb99c13a780 0x7fb99c12d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb98c0125b0 tx=0x7fb98c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.119+0000 7fb9a17df700 1 --2- 172.21.15.80:0/470335295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c13a780 0x7fb99c12d480 secure :-1 s=READY pgs=735 cs=0 l=1 rx=0x7fb98c0125b0 tx=0x7fb98c012950).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:24.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.119+0000 7fb9a17df700 1 --2- 172.21.15.80:0/470335295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c13a780 0x7fb99c12d480 secure :-1 s=THROTTLE_DONE pgs=735 cs=0 l=1 rx=0x7fb98c0125b0 tx=0x7fb98c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.119+0000 7fb999ffb700 1 -- 172.21.15.80:0/470335295 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb98c000940 con 0x7fb99c13a780 2019-11-28T11:29:24.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.119+0000 7fb9a17df700 1 --2- 172.21.15.80:0/470335295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c13a780 0x7fb99c12d480 secure :-1 s=THROTTLE_DONE pgs=735 cs=0 l=1 rx=0x7fb98c0125b0 tx=0x7fb98c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.119+0000 7fb9a17df700 1 --2- 172.21.15.80:0/470335295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c13a780 0x7fb99c12d480 secure :-1 s=THROTTLE_DONE pgs=735 cs=0 l=1 rx=0x7fb98c0125b0 tx=0x7fb98c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.119+0000 7fb999ffb700 1 -- 172.21.15.80:0/470335295 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c005770 con 0x7fb99c13a780 2019-11-28T11:29:24.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.119+0000 7fb9a3242700 1 -- 172.21.15.80:0/470335295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99c12af40 con 0x7fb99c13a780 2019-11-28T11:29:24.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.119+0000 7fb999ffb700 1 -- 172.21.15.80:0/470335295 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb98c005e00 con 0x7fb99c13a780 2019-11-28T11:29:24.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.119+0000 7fb9a3242700 1 -- 172.21.15.80:0/470335295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99c12abc0 con 0x7fb99c13a780 2019-11-28T11:29:24.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.119+0000 7fb9a17df700 1 --2- 172.21.15.80:0/470335295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c13a780 0x7fb99c12d480 secure :-1 s=THROTTLE_DONE pgs=735 cs=0 l=1 rx=0x7fb98c0125b0 tx=0x7fb98c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.120+0000 7fb999ffb700 1 -- 172.21.15.80:0/470335295 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb98c005390 con 0x7fb99c13a780 2019-11-28T11:29:24.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.120+0000 7fb9a17df700 1 --2- 172.21.15.80:0/470335295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c13a780 0x7fb99c12d480 secure :-1 s=THROTTLE_DONE pgs=735 cs=0 l=1 rx=0x7fb98c0125b0 tx=0x7fb98c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.120+0000 7fb999ffb700 1 --2- 172.21.15.80:0/470335295 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb980018730 0x7fb98001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:24.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.120+0000 7fb999ffb700 1 -- 172.21.15.80:0/470335295 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fb98c033ec0 con 0x7fb99c13a780 2019-11-28T11:29:24.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.120+0000 7fb9a0fde700 1 --2- 172.21.15.80:0/470335295 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb980018730 0x7fb98001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:24.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.120+0000 7fb9a0fde700 1 --2- 172.21.15.80:0/470335295 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb980018730 0x7fb98001abc0 crc :-1 s=READY pgs=305 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:24.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.127+0000 7fb9a3242700 1 -- 172.21.15.80:0/470335295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb99c12af40 con 0x7fb99c13a780 2019-11-28T11:29:24.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.131+0000 7fb9a17df700 1 --2- 172.21.15.80:0/470335295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c13a780 0x7fb99c12d480 secure :-1 s=THROTTLE_DONE pgs=735 cs=0 l=1 rx=0x7fb98c0125b0 tx=0x7fb98c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.131+0000 7fb999ffb700 1 -- 172.21.15.80:0/470335295 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb98c005180 con 0x7fb99c13a780 2019-11-28T11:29:24.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.306+0000 7fb9a3242700 1 -- 172.21.15.80:0/470335295 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb99c12abc0 con 0x7fb99c13a780 2019-11-28T11:29:24.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.307+0000 7fb9a17df700 1 --2- 172.21.15.80:0/470335295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c13a780 0x7fb99c12d480 secure :-1 s=THROTTLE_DONE pgs=735 cs=0 l=1 rx=0x7fb98c0125b0 tx=0x7fb98c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.307+0000 7fb999ffb700 1 -- 172.21.15.80:0/470335295 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+12000 (secure 0 0 0) 0x7fb98c005390 con 0x7fb99c13a780 2019-11-28T11:29:24.338 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:24.338 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":63,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:29:23.601283+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:29:24.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.309+0000 7fb9a3242700 1 -- 172.21.15.80:0/470335295 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb980018730 msgr2=0x7fb98001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.309+0000 7fb9a3242700 1 --2- 172.21.15.80:0/470335295 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb980018730 0x7fb98001abc0 crc :-1 s=READY pgs=305 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.309+0000 7fb9a3242700 1 -- 172.21.15.80:0/470335295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c13a780 msgr2=0x7fb99c12d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.309+0000 7fb9a3242700 1 --2- 172.21.15.80:0/470335295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c13a780 0x7fb99c12d480 secure :-1 s=READY pgs=735 cs=0 l=1 rx=0x7fb98c0125b0 tx=0x7fb98c012950).stop 2019-11-28T11:29:24.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.309+0000 7fb9a3242700 1 -- 172.21.15.80:0/470335295 shutdown_connections 2019-11-28T11:29:24.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.309+0000 7fb9a3242700 1 --2- 172.21.15.80:0/470335295 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb980018730 0x7fb98001abc0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.309+0000 7fb9a3242700 1 --2- 172.21.15.80:0/470335295 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb99c13a780 0x7fb99c12d480 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.309+0000 7fb9a3242700 1 -- 172.21.15.80:0/470335295 shutdown_connections 2019-11-28T11:29:24.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.309+0000 7fb9a3242700 1 -- 172.21.15.80:0/470335295 wait complete. 2019-11-28T11:29:24.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.309+0000 7fb9a3242700 1 -- 172.21.15.80:0/470335295 >> 172.21.15.80:0/470335295 conn(0x7fb99c127dc0 msgr2=0x7fb99c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:24.351 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:29:24.351 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:29:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.444+0000 7f9b381b2700 1 Processor -- start 2019-11-28T11:29:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.444+0000 7f9b381b2700 1 -- start start 2019-11-28T11:29:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.445+0000 7f9b381b2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b301639f0 0x7f9b30165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.445+0000 7f9b381b2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3006db60 con 0x7f9b3015f100 2019-11-28T11:29:24.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.445+0000 7f9b381b2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3006e060 con 0x7f9b3015ed10 2019-11-28T11:29:24.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.445+0000 7f9b381b2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3006fe00 con 0x7f9b301639f0 2019-11-28T11:29:24.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.445+0000 7f9b36f50700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b301639f0 0x7f9b30165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:24.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.445+0000 7f9b35f4e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9b3015f100 0x7f9b3006bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33982/0 (socket says 172.21.15.80:33982) 2019-11-28T11:29:24.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.445+0000 7f9b35f4e700 1 -- 172.21.15.80:0/2458175796 learned_addr learned my addr 172.21.15.80:0/2458175796 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:24.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.445+0000 7f9b36f50700 1 -- 172.21.15.80:0/2458175796 >> v1:172.21.15.174:6789/0 conn(0x7f9b3015ed10 legacy=0x7f9b30073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:24.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.446+0000 7f9b36f50700 1 -- 172.21.15.80:0/2458175796 >> v1:172.21.15.80:6789/0 conn(0x7f9b3015f100 legacy=0x7f9b3006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.445+0000 7f9b3574d700 1 -- 172.21.15.80:0/2458175796 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663104532 0 0) 0x7f9b20001150 con 0x7f9b3015f100 2019-11-28T11:29:24.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.446+0000 7f9b36f50700 1 -- 172.21.15.80:0/2458175796 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b30070760 con 0x7f9b301639f0 2019-11-28T11:29:24.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.446+0000 7f9b36f50700 1 --2- 172.21.15.80:0/2458175796 >> v2:172.21.15.80:3300/0 conn(0x7f9b301639f0 0x7f9b30165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9b2800b2d0 tx=0x7f9b2800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.446+0000 7f9b36f50700 1 --2- 172.21.15.80:0/2458175796 >> v2:172.21.15.80:3300/0 conn(0x7f9b301639f0 0x7f9b30165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9b2800b2d0 tx=0x7f9b2800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.446+0000 7f9b36f50700 1 --2- 172.21.15.80:0/2458175796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b301639f0 0x7f9b30165df0 secure :-1 s=READY pgs=737 cs=0 l=1 rx=0x7f9b2800b2d0 tx=0x7f9b2800bae0).ready entity=mon.0 client_cookie=1c147ed01ad1b83a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:24.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.446+0000 7f9b36f50700 1 --2- 172.21.15.80:0/2458175796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b301639f0 0x7f9b30165df0 secure :-1 s=THROTTLE_DONE pgs=737 cs=0 l=1 rx=0x7f9b2800b2d0 tx=0x7f9b2800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.446+0000 7f9b3574d700 1 -- 172.21.15.80:0/2458175796 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b28009f20 con 0x7f9b301639f0 2019-11-28T11:29:24.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.446+0000 7f9b36f50700 1 --2- 172.21.15.80:0/2458175796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b301639f0 0x7f9b30165df0 secure :-1 s=THROTTLE_DONE pgs=737 cs=0 l=1 rx=0x7f9b2800b2d0 tx=0x7f9b2800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.446+0000 7f9b36f50700 1 --2- 172.21.15.80:0/2458175796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b301639f0 0x7f9b30165df0 secure :-1 s=THROTTLE_DONE pgs=737 cs=0 l=1 rx=0x7f9b2800b2d0 tx=0x7f9b2800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.446+0000 7f9b3574d700 1 -- 172.21.15.80:0/2458175796 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b28000df0 con 0x7f9b301639f0 2019-11-28T11:29:24.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.446+0000 7f9b3574d700 1 -- 172.21.15.80:0/2458175796 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b2800a500 con 0x7f9b301639f0 2019-11-28T11:29:24.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.446+0000 7f9b381b2700 1 -- 172.21.15.80:0/2458175796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b301639f0 msgr2=0x7f9b30165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.446+0000 7f9b381b2700 1 --2- 172.21.15.80:0/2458175796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b301639f0 0x7f9b30165df0 secure :-1 s=READY pgs=737 cs=0 l=1 rx=0x7f9b2800b2d0 tx=0x7f9b2800bae0).stop 2019-11-28T11:29:24.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.447+0000 7f9b381b2700 1 -- 172.21.15.80:0/2458175796 shutdown_connections 2019-11-28T11:29:24.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.447+0000 7f9b381b2700 1 --2- 172.21.15.80:0/2458175796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b301639f0 0x7f9b30165df0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.447+0000 7f9b381b2700 1 -- 172.21.15.80:0/2458175796 shutdown_connections 2019-11-28T11:29:24.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.447+0000 7f9b381b2700 1 -- 172.21.15.80:0/2458175796 wait complete. 2019-11-28T11:29:24.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.447+0000 7f9b381b2700 1 -- 172.21.15.80:0/2458175796 >> 172.21.15.80:0/2458175796 conn(0x7f9b30061d20 msgr2=0x7f9b300641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:24.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.449+0000 7f9b381b2700 1 Processor -- start 2019-11-28T11:29:24.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.449+0000 7f9b381b2700 1 -- start start 2019-11-28T11:29:24.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.450+0000 7f9b381b2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b3010e970 0x7f9b301087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:24.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.450+0000 7f9b381b2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9b30107e30 0x7f9b30167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:24.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.450+0000 7f9b381b2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3010c250 con 0x7f9b30108cf0 2019-11-28T11:29:24.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.450+0000 7f9b381b2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3010da00 con 0x7f9b30107e30 2019-11-28T11:29:24.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.450+0000 7f9b381b2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3010e430 con 0x7f9b3010e970 2019-11-28T11:29:24.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.450+0000 7f9b36f50700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9b30107e30 0x7f9b30167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:24.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.450+0000 7f9b3674f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b3010e970 0x7f9b301087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:24.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.450+0000 7f9b36f50700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9b30107e30 0x7f9b30167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:49558/0 (socket says 172.21.15.80:49558) 2019-11-28T11:29:24.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.450+0000 7f9b36f50700 1 -- 172.21.15.80:0/31208182 learned_addr learned my addr 172.21.15.80:0/31208182 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:24.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.450+0000 7f9b3674f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b3010e970 0x7f9b301087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:36930/0 (socket says 172.21.15.80:36930) 2019-11-28T11:29:24.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.450+0000 7f9b35f4e700 1 --1- 172.21.15.80:0/31208182 >> v1:172.21.15.174:6789/0 conn(0x7f9b30108cf0 0x7f9b30107630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:49528/0 (socket says 172.21.15.80:49528) 2019-11-28T11:29:24.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b3674f700 1 -- 172.21.15.80:0/31208182 >> v2:172.21.15.174:3300/0 conn(0x7f9b30107e30 msgr2=0x7f9b30167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b3674f700 1 --2- 172.21.15.80:0/31208182 >> v2:172.21.15.174:3300/0 conn(0x7f9b30107e30 0x7f9b30167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b3674f700 1 -- 172.21.15.80:0/31208182 >> v1:172.21.15.174:6789/0 conn(0x7f9b30108cf0 legacy=0x7f9b30107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b3674f700 1 -- 172.21.15.80:0/31208182 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b30105ef0 con 0x7f9b3010e970 2019-11-28T11:29:24.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b36f50700 1 --2- 172.21.15.80:0/31208182 >> v2:172.21.15.174:3300/0 conn(0x7f9b30107e30 0x7f9b30167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:24.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b3674f700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b3010e970 0x7f9b301087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b2c0103a0 tx=0x7f9b2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b3674f700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b3010e970 0x7f9b301087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b2c0103a0 tx=0x7f9b2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b3674f700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b3010e970 0x7f9b301087b0 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f9b2c0103a0 tx=0x7f9b2c010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:24.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b3674f700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b3010e970 0x7f9b301087b0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f9b2c0103a0 tx=0x7f9b2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b26ffd700 1 -- 172.21.15.80:0/31208182 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b2c009b70 con 0x7f9b3010e970 2019-11-28T11:29:24.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b3674f700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b3010e970 0x7f9b301087b0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f9b2c0103a0 tx=0x7f9b2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b3674f700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b3010e970 0x7f9b301087b0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f9b2c0103a0 tx=0x7f9b2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b26ffd700 1 -- 172.21.15.80:0/31208182 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c009790 con 0x7f9b3010e970 2019-11-28T11:29:24.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b381b2700 1 -- 172.21.15.80:0/31208182 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b30106270 con 0x7f9b3010e970 2019-11-28T11:29:24.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b26ffd700 1 -- 172.21.15.80:0/31208182 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b2c00a150 con 0x7f9b3010e970 2019-11-28T11:29:24.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b381b2700 1 -- 172.21.15.80:0/31208182 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b30105ef0 con 0x7f9b3010e970 2019-11-28T11:29:24.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.451+0000 7f9b3674f700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b3010e970 0x7f9b301087b0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f9b2c0103a0 tx=0x7f9b2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.452+0000 7f9b26ffd700 1 -- 172.21.15.80:0/31208182 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9b2c009a20 con 0x7f9b3010e970 2019-11-28T11:29:24.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.452+0000 7f9b3674f700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b3010e970 0x7f9b301087b0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f9b2c0103a0 tx=0x7f9b2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.452+0000 7f9b26ffd700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b18018730 0x7f9b1801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:24.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.452+0000 7f9b26ffd700 1 -- 172.21.15.80:0/31208182 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f9b2c031a60 con 0x7f9b3010e970 2019-11-28T11:29:24.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.452+0000 7f9b35f4e700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b18018730 0x7f9b1801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:24.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.452+0000 7f9b35f4e700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b18018730 0x7f9b1801abc0 crc :-1 s=READY pgs=306 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:24.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.460+0000 7f9b381b2700 1 -- 172.21.15.80:0/31208182 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b30106270 con 0x7f9b3010e970 2019-11-28T11:29:24.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.463+0000 7f9b3674f700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b3010e970 0x7f9b301087b0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f9b2c0103a0 tx=0x7f9b2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.463+0000 7f9b26ffd700 1 -- 172.21.15.80:0/31208182 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9b2c009580 con 0x7f9b3010e970 2019-11-28T11:29:24.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.633+0000 7f9b381b2700 1 -- 172.21.15.80:0/31208182 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f9b30105ef0 con 0x7f9b3010e970 2019-11-28T11:29:24.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.634+0000 7f9b3674f700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b3010e970 0x7f9b301087b0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f9b2c0103a0 tx=0x7f9b2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.634+0000 7f9b26ffd700 1 -- 172.21.15.80:0/31208182 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v63) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9b2c009980 con 0x7f9b3010e970 2019-11-28T11:29:24.665 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:29:24.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.636+0000 7f9b381b2700 1 -- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b18018730 msgr2=0x7f9b1801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.636+0000 7f9b381b2700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b18018730 0x7f9b1801abc0 crc :-1 s=READY pgs=306 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.636+0000 7f9b381b2700 1 -- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b3010e970 msgr2=0x7f9b301087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.636+0000 7f9b381b2700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b3010e970 0x7f9b301087b0 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f9b2c0103a0 tx=0x7f9b2c010740).stop 2019-11-28T11:29:24.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.636+0000 7f9b381b2700 1 -- 172.21.15.80:0/31208182 shutdown_connections 2019-11-28T11:29:24.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.636+0000 7f9b381b2700 1 --2- 172.21.15.80:0/31208182 >> v2:172.21.15.174:3300/0 conn(0x7f9b30107e30 0x7f9b30167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.636+0000 7f9b381b2700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b18018730 0x7f9b1801abc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.636+0000 7f9b381b2700 1 --2- 172.21.15.80:0/31208182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b3010e970 0x7f9b301087b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.636+0000 7f9b381b2700 1 -- 172.21.15.80:0/31208182 shutdown_connections 2019-11-28T11:29:24.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.636+0000 7f9b381b2700 1 -- 172.21.15.80:0/31208182 wait complete. 2019-11-28T11:29:24.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.636+0000 7f9b381b2700 1 -- 172.21.15.80:0/31208182 >> 172.21.15.80:0/31208182 conn(0x7f9b3015e2d0 msgr2=0x7f9b30147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:24.677 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:29:24.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.765+0000 7f20a7e1b700 1 Processor -- start 2019-11-28T11:29:24.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.765+0000 7f20a7e1b700 1 -- start start 2019-11-28T11:29:24.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.766+0000 7f20a7e1b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20a006c0a0 0x7f20a0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:24.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.766+0000 7f20a7e1b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f20a00734e0 0x7f20a0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:24.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.766+0000 7f20a7e1b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a006db00 con 0x7f20a0072360 2019-11-28T11:29:24.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.766+0000 7f20a7e1b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a006fd60 con 0x7f20a006c0a0 2019-11-28T11:29:24.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.766+0000 7f20a7e1b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a0070030 con 0x7f20a00734e0 2019-11-28T11:29:24.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.766+0000 7f20a63b8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20a006c0a0 0x7f20a0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:24.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a63b8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20a006c0a0 0x7f20a0072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34676/0 (socket says 172.21.15.80:34676) 2019-11-28T11:29:24.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a63b8700 1 -- 172.21.15.80:0/1316018702 learned_addr learned my addr 172.21.15.80:0/1316018702 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:24.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a5bb7700 1 --2- 172.21.15.80:0/1316018702 >> v2:172.21.15.174:3300/0 conn(0x7f20a00734e0 0x7f20a0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:24.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a63b8700 1 -- 172.21.15.80:0/1316018702 >> v2:172.21.15.174:3300/0 conn(0x7f20a00734e0 msgr2=0x7f20a0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:24.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a63b8700 1 --2- 172.21.15.80:0/1316018702 >> v2:172.21.15.174:3300/0 conn(0x7f20a00734e0 0x7f20a0071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:24.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a63b8700 1 -- 172.21.15.80:0/1316018702 >> v1:172.21.15.174:6789/0 conn(0x7f20a0072360 legacy=0x7f20a006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:24.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a63b8700 1 -- 172.21.15.80:0/1316018702 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a00706c0 con 0x7f20a006c0a0 2019-11-28T11:29:24.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a63b8700 1 --2- 172.21.15.80:0/1316018702 >> v2:172.21.15.80:3300/0 conn(0x7f20a006c0a0 0x7f20a0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f209000f6c0 tx=0x7f209000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a63b8700 1 --2- 172.21.15.80:0/1316018702 >> v2:172.21.15.80:3300/0 conn(0x7f20a006c0a0 0x7f20a0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f209000f6c0 tx=0x7f209000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a63b8700 1 --2- 172.21.15.80:0/1316018702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a006c0a0 0x7f20a0072fa0 secure :-1 s=READY pgs=738 cs=0 l=1 rx=0x7f209000f6c0 tx=0x7f209000fa60).ready entity=mon.0 client_cookie=c10928ed7c9ab3a6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:24.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a63b8700 1 --2- 172.21.15.80:0/1316018702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a006c0a0 0x7f20a0072fa0 secure :-1 s=THROTTLE_DONE pgs=738 cs=0 l=1 rx=0x7f209000f6c0 tx=0x7f209000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a63b8700 1 --2- 172.21.15.80:0/1316018702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a006c0a0 0x7f20a0072fa0 secure :-1 s=THROTTLE_DONE pgs=738 cs=0 l=1 rx=0x7f209000f6c0 tx=0x7f209000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a53b6700 1 -- 172.21.15.80:0/1316018702 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2090000960 con 0x7f20a006c0a0 2019-11-28T11:29:24.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a63b8700 1 --2- 172.21.15.80:0/1316018702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a006c0a0 0x7f20a0072fa0 secure :-1 s=THROTTLE_DONE pgs=738 cs=0 l=1 rx=0x7f209000f6c0 tx=0x7f209000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a53b6700 1 -- 172.21.15.80:0/1316018702 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2090000c90 con 0x7f20a006c0a0 2019-11-28T11:29:24.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a53b6700 1 -- 172.21.15.80:0/1316018702 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20900013a0 con 0x7f20a006c0a0 2019-11-28T11:29:24.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a7e1b700 1 -- 172.21.15.80:0/1316018702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a006c0a0 msgr2=0x7f20a0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.767+0000 7f20a7e1b700 1 --2- 172.21.15.80:0/1316018702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a006c0a0 0x7f20a0072fa0 secure :-1 s=READY pgs=738 cs=0 l=1 rx=0x7f209000f6c0 tx=0x7f209000fa60).stop 2019-11-28T11:29:24.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.768+0000 7f20a7e1b700 1 -- 172.21.15.80:0/1316018702 shutdown_connections 2019-11-28T11:29:24.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.768+0000 7f20a7e1b700 1 --2- 172.21.15.80:0/1316018702 >> v2:172.21.15.174:3300/0 conn(0x7f20a00734e0 0x7f20a0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:24.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.768+0000 7f20a7e1b700 1 --2- 172.21.15.80:0/1316018702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a006c0a0 0x7f20a0072fa0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.768+0000 7f20a7e1b700 1 -- 172.21.15.80:0/1316018702 shutdown_connections 2019-11-28T11:29:24.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.768+0000 7f20a7e1b700 1 -- 172.21.15.80:0/1316018702 wait complete. 2019-11-28T11:29:24.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.768+0000 7f20a7e1b700 1 -- 172.21.15.80:0/1316018702 >> 172.21.15.80:0/1316018702 conn(0x7f20a0061cf0 msgr2=0x7f20a0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:24.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.770+0000 7f20a7e1b700 1 Processor -- start 2019-11-28T11:29:24.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.770+0000 7f20a7e1b700 1 -- start start 2019-11-28T11:29:24.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.771+0000 7f20a7e1b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20a010d6c0 0x7f20a010c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:24.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.771+0000 7f20a7e1b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a01066e0 con 0x7f20a013e300 2019-11-28T11:29:24.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.771+0000 7f20a7e1b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a010d280 con 0x7f20a010db50 2019-11-28T11:29:24.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.771+0000 7f20a7e1b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a010a4a0 con 0x7f20a010d6c0 2019-11-28T11:29:24.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.771+0000 7f20a63b8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f20a013e300 0x7f20a013e6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33998/0 (socket says 172.21.15.80:33998) 2019-11-28T11:29:24.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.771+0000 7f20a5bb7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20a010d6c0 0x7f20a010c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:24.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.771+0000 7f20a63b8700 1 -- 172.21.15.80:0/3681906978 learned_addr learned my addr 172.21.15.80:0/3681906978 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:24.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f209effd700 1 -- 172.21.15.80:0/3681906978 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402029103 0 0) 0x7f20900075d0 con 0x7f20a013e300 2019-11-28T11:29:24.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f209effd700 1 -- 172.21.15.80:0/3681906978 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2084002e80 con 0x7f20a013e300 2019-11-28T11:29:24.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f20a5bb7700 1 -- 172.21.15.80:0/3681906978 >> v1:172.21.15.174:6789/0 conn(0x7f20a010db50 legacy=0x7f20a010ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f20a5bb7700 1 -- 172.21.15.80:0/3681906978 >> v1:172.21.15.80:6789/0 conn(0x7f20a013e300 legacy=0x7f20a013e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f20a5bb7700 1 -- 172.21.15.80:0/3681906978 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a010ae00 con 0x7f20a010d6c0 2019-11-28T11:29:24.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f20a5bb7700 1 --2- 172.21.15.80:0/3681906978 >> v2:172.21.15.80:3300/0 conn(0x7f20a010d6c0 0x7f20a010c540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2088010720 tx=0x7f2088010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f20a5bb7700 1 --2- 172.21.15.80:0/3681906978 >> v2:172.21.15.80:3300/0 conn(0x7f20a010d6c0 0x7f20a010c540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2088010720 tx=0x7f2088010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f20a5bb7700 1 --2- 172.21.15.80:0/3681906978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a010d6c0 0x7f20a010c540 secure :-1 s=READY pgs=740 cs=0 l=1 rx=0x7f2088010720 tx=0x7f2088010ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:24.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f20a5bb7700 1 --2- 172.21.15.80:0/3681906978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a010d6c0 0x7f20a010c540 secure :-1 s=THROTTLE_DONE pgs=740 cs=0 l=1 rx=0x7f2088010720 tx=0x7f2088010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f20a5bb7700 1 --2- 172.21.15.80:0/3681906978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a010d6c0 0x7f20a010c540 secure :-1 s=THROTTLE_DONE pgs=740 cs=0 l=1 rx=0x7f2088010720 tx=0x7f2088010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f209effd700 1 -- 172.21.15.80:0/3681906978 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2088000cc0 con 0x7f20a010d6c0 2019-11-28T11:29:24.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f20a5bb7700 1 --2- 172.21.15.80:0/3681906978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a010d6c0 0x7f20a010c540 secure :-1 s=THROTTLE_DONE pgs=740 cs=0 l=1 rx=0x7f2088010720 tx=0x7f2088010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f209effd700 1 -- 172.21.15.80:0/3681906978 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2088009d50 con 0x7f20a010d6c0 2019-11-28T11:29:24.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f20a7e1b700 1 -- 172.21.15.80:0/3681906978 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a010b180 con 0x7f20a010d6c0 2019-11-28T11:29:24.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f209effd700 1 -- 172.21.15.80:0/3681906978 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f208800a420 con 0x7f20a010d6c0 2019-11-28T11:29:24.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f20a7e1b700 1 -- 172.21.15.80:0/3681906978 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a010ae00 con 0x7f20a010d6c0 2019-11-28T11:29:24.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.772+0000 7f20a5bb7700 1 --2- 172.21.15.80:0/3681906978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a010d6c0 0x7f20a010c540 secure :-1 s=THROTTLE_DONE pgs=740 cs=0 l=1 rx=0x7f2088010720 tx=0x7f2088010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.773+0000 7f209effd700 1 -- 172.21.15.80:0/3681906978 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2088009950 con 0x7f20a010d6c0 2019-11-28T11:29:24.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.773+0000 7f20a5bb7700 1 --2- 172.21.15.80:0/3681906978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a010d6c0 0x7f20a010c540 secure :-1 s=THROTTLE_DONE pgs=740 cs=0 l=1 rx=0x7f2088010720 tx=0x7f2088010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.773+0000 7f209effd700 1 --2- 172.21.15.80:0/3681906978 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2084018770 0x7f208401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:24.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.773+0000 7f209effd700 1 -- 172.21.15.80:0/3681906978 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f2088031e10 con 0x7f20a010d6c0 2019-11-28T11:29:24.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.773+0000 7f20a63b8700 1 --2- 172.21.15.80:0/3681906978 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2084018770 0x7f208401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:24.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.773+0000 7f20a63b8700 1 --2- 172.21.15.80:0/3681906978 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2084018770 0x7f208401abe0 crc :-1 s=READY pgs=307 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:24.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.781+0000 7f20a7e1b700 1 -- 172.21.15.80:0/3681906978 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a010b180 con 0x7f20a010d6c0 2019-11-28T11:29:24.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.784+0000 7f20a5bb7700 1 --2- 172.21.15.80:0/3681906978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a010d6c0 0x7f20a010c540 secure :-1 s=THROTTLE_DONE pgs=740 cs=0 l=1 rx=0x7f2088010720 tx=0x7f2088010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.784+0000 7f209effd700 1 -- 172.21.15.80:0/3681906978 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2088000cc0 con 0x7f20a010d6c0 2019-11-28T11:29:24.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.949+0000 7f20a7e1b700 1 -- 172.21.15.80:0/3681906978 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f20a010ae00 con 0x7f20a010d6c0 2019-11-28T11:29:24.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.950+0000 7f20a5bb7700 1 --2- 172.21.15.80:0/3681906978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a010d6c0 0x7f20a010c540 secure :-1 s=THROTTLE_DONE pgs=740 cs=0 l=1 rx=0x7f2088010720 tx=0x7f2088010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:24.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.950+0000 7f209effd700 1 -- 172.21.15.80:0/3681906978 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v63) v1 ==== 84+0+64 (secure 0 0 0) 0x7f2088009950 con 0x7f20a010d6c0 2019-11-28T11:29:24.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.952+0000 7f20a7e1b700 1 -- 172.21.15.80:0/3681906978 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2084018770 msgr2=0x7f208401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.952+0000 7f20a7e1b700 1 --2- 172.21.15.80:0/3681906978 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2084018770 0x7f208401abe0 crc :-1 s=READY pgs=307 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.952+0000 7f20a7e1b700 1 -- 172.21.15.80:0/3681906978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a010d6c0 msgr2=0x7f20a010c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:24.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.952+0000 7f20a7e1b700 1 --2- 172.21.15.80:0/3681906978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a010d6c0 0x7f20a010c540 secure :-1 s=READY pgs=740 cs=0 l=1 rx=0x7f2088010720 tx=0x7f2088010ac0).stop 2019-11-28T11:29:24.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.952+0000 7f20a7e1b700 1 -- 172.21.15.80:0/3681906978 shutdown_connections 2019-11-28T11:29:24.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.952+0000 7f20a7e1b700 1 --2- 172.21.15.80:0/3681906978 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2084018770 0x7f208401abe0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.952+0000 7f20a7e1b700 1 --2- 172.21.15.80:0/3681906978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a010d6c0 0x7f20a010c540 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:24.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.953+0000 7f20a7e1b700 1 -- 172.21.15.80:0/3681906978 shutdown_connections 2019-11-28T11:29:24.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.953+0000 7f20a7e1b700 1 -- 172.21.15.80:0/3681906978 wait complete. 2019-11-28T11:29:24.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:24.953+0000 7f20a7e1b700 1 -- 172.21.15.80:0/3681906978 >> 172.21.15.80:0/3681906978 conn(0x7f20a013d620 msgr2=0x7f20a013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:24.992 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:24.992 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:29:24.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:29:24.993 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:29:24.993 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:29:24.993 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:29:24.993 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:29:24.994 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:29:24.994 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:29:25.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.088+0000 7f7edd3ce700 1 Processor -- start 2019-11-28T11:29:25.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.088+0000 7f7edd3ce700 1 -- start start 2019-11-28T11:29:25.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.089+0000 7f7edd3ce700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ed815ed10 0x7f7ed815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:25.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.089+0000 7f7edd3ce700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ed8073020 0x7f7ed8071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:25.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.089+0000 7f7edd3ce700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed806db60 con 0x7f7ed80734b0 2019-11-28T11:29:25.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.089+0000 7f7edd3ce700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed806f3d0 con 0x7f7ed8073020 2019-11-28T11:29:25.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.089+0000 7f7edd3ce700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed806fe00 con 0x7f7ed815ed10 2019-11-28T11:29:25.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.089+0000 7f7ed6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ed8073020 0x7f7ed8071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:25.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.089+0000 7f7ed7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7ed80734b0 0x7f7ed80723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34006/0 (socket says 172.21.15.80:34006) 2019-11-28T11:29:25.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.089+0000 7f7ed6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ed8073020 0x7f7ed8071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34694/0 (socket says 172.21.15.80:34694) 2019-11-28T11:29:25.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.089+0000 7f7ed7fff700 1 -- 172.21.15.80:0/2312819908 learned_addr learned my addr 172.21.15.80:0/2312819908 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.089+0000 7f7ed77fe700 1 --2- 172.21.15.80:0/2312819908 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ed815ed10 0x7f7ed815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.089+0000 7f7ed6ffd700 1 -- 172.21.15.80:0/2312819908 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ed815ed10 msgr2=0x7f7ed815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.089+0000 7f7ed6ffd700 1 --2- 172.21.15.80:0/2312819908 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ed815ed10 0x7f7ed815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.089+0000 7f7ed6ffd700 1 -- 172.21.15.80:0/2312819908 >> v1:172.21.15.80:6789/0 conn(0x7f7ed80734b0 legacy=0x7f7ed80723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.089+0000 7f7ed67fc700 1 -- 172.21.15.80:0/2312819908 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027043847 0 0) 0x7f7ed0001150 con 0x7f7ed80734b0 2019-11-28T11:29:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.089+0000 7f7ed6ffd700 1 -- 172.21.15.80:0/2312819908 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed8070760 con 0x7f7ed8073020 2019-11-28T11:29:25.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7ed6ffd700 1 --2- 172.21.15.80:0/2312819908 >> v2:172.21.15.80:3300/0 conn(0x7f7ed8073020 0x7f7ed8071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ec800b2d0 tx=0x7f7ec800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7ed6ffd700 1 --2- 172.21.15.80:0/2312819908 >> v2:172.21.15.80:3300/0 conn(0x7f7ed8073020 0x7f7ed8071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ec800b2d0 tx=0x7f7ec800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7ed6ffd700 1 --2- 172.21.15.80:0/2312819908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ed8073020 0x7f7ed8071ea0 secure :-1 s=READY pgs=742 cs=0 l=1 rx=0x7f7ec800b2d0 tx=0x7f7ec800ba60).ready entity=mon.0 client_cookie=ae37f9c101003ea server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:25.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7ed6ffd700 1 --2- 172.21.15.80:0/2312819908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ed8073020 0x7f7ed8071ea0 secure :-1 s=THROTTLE_DONE pgs=742 cs=0 l=1 rx=0x7f7ec800b2d0 tx=0x7f7ec800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7ed67fc700 1 -- 172.21.15.80:0/2312819908 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ec8007590 con 0x7f7ed8073020 2019-11-28T11:29:25.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7ed6ffd700 1 --2- 172.21.15.80:0/2312819908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ed8073020 0x7f7ed8071ea0 secure :-1 s=THROTTLE_DONE pgs=742 cs=0 l=1 rx=0x7f7ec800b2d0 tx=0x7f7ec800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7ed6ffd700 1 --2- 172.21.15.80:0/2312819908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ed8073020 0x7f7ed8071ea0 secure :-1 s=THROTTLE_DONE pgs=742 cs=0 l=1 rx=0x7f7ec800b2d0 tx=0x7f7ec800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7ed67fc700 1 -- 172.21.15.80:0/2312819908 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec8009b40 con 0x7f7ed8073020 2019-11-28T11:29:25.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7ed67fc700 1 -- 172.21.15.80:0/2312819908 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ec8009d30 con 0x7f7ed8073020 2019-11-28T11:29:25.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7edd3ce700 1 -- 172.21.15.80:0/2312819908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ed8073020 msgr2=0x7f7ed8071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:25.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7edd3ce700 1 --2- 172.21.15.80:0/2312819908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ed8073020 0x7f7ed8071ea0 secure :-1 s=READY pgs=742 cs=0 l=1 rx=0x7f7ec800b2d0 tx=0x7f7ec800ba60).stop 2019-11-28T11:29:25.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7edd3ce700 1 -- 172.21.15.80:0/2312819908 shutdown_connections 2019-11-28T11:29:25.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7edd3ce700 1 --2- 172.21.15.80:0/2312819908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ed8073020 0x7f7ed8071ea0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:25.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7edd3ce700 1 --2- 172.21.15.80:0/2312819908 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ed815ed10 0x7f7ed815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:25.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7edd3ce700 1 -- 172.21.15.80:0/2312819908 shutdown_connections 2019-11-28T11:29:25.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7edd3ce700 1 -- 172.21.15.80:0/2312819908 wait complete. 2019-11-28T11:29:25.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.090+0000 7f7edd3ce700 1 -- 172.21.15.80:0/2312819908 >> 172.21.15.80:0/2312819908 conn(0x7f7ed8061d20 msgr2=0x7f7ed80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:25.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.093+0000 7f7edd3ce700 1 Processor -- start 2019-11-28T11:29:25.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.093+0000 7f7edd3ce700 1 -- start start 2019-11-28T11:29:25.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.094+0000 7f7edd3ce700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7ed8169da0 0x7f7ed816c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:25.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.094+0000 7f7edd3ce700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed81057a0 con 0x7f7ed810cbb0 2019-11-28T11:29:25.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.094+0000 7f7edd3ce700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed8105c00 con 0x7f7ed8153db0 2019-11-28T11:29:25.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.094+0000 7f7edd3ce700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed8106280 con 0x7f7ed8169da0 2019-11-28T11:29:25.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.094+0000 7f7ed6ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7ed810cbb0 0x7f7ed810d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34012/0 (socket says 172.21.15.80:34012) 2019-11-28T11:29:25.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.094+0000 7f7ed6ffd700 1 -- 172.21.15.80:0/2483753319 learned_addr learned my addr 172.21.15.80:0/2483753319 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:25.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.094+0000 7f7ed7fff700 1 --2- 172.21.15.80:0/2483753319 >> v2:172.21.15.174:3300/0 conn(0x7f7ed8169da0 0x7f7ed816c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:25.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.094+0000 7f7ecffff700 1 -- 172.21.15.80:0/2483753319 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038300601 0 0) 0x7f7ec800b1d0 con 0x7f7ed810cbb0 2019-11-28T11:29:25.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.094+0000 7f7ecffff700 1 -- 172.21.15.80:0/2483753319 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ebc002e80 con 0x7f7ed810cbb0 2019-11-28T11:29:25.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.094+0000 7f7ecffff700 1 -- 172.21.15.80:0/2483753319 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4171458755 0 0) 0x7f7ec800b340 con 0x7f7ed810cbb0 2019-11-28T11:29:25.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.094+0000 7f7ed7fff700 1 -- 172.21.15.80:0/2483753319 >> v1:172.21.15.174:6789/0 conn(0x7f7ed8153db0 legacy=0x7f7ed810dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:25.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.094+0000 7f7ed7fff700 1 -- 172.21.15.80:0/2483753319 >> v1:172.21.15.80:6789/0 conn(0x7f7ed810cbb0 legacy=0x7f7ed810d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:25.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.094+0000 7f7ed7fff700 1 -- 172.21.15.80:0/2483753319 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed8106be0 con 0x7f7ed8169da0 2019-11-28T11:29:25.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.095+0000 7f7ed7fff700 1 --2- 172.21.15.80:0/2483753319 >> v2:172.21.15.174:3300/0 conn(0x7f7ed8169da0 0x7f7ed816c1a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ed00103a0 tx=0x7f7ed0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.095+0000 7f7ed7fff700 1 --2- 172.21.15.80:0/2483753319 >> v2:172.21.15.174:3300/0 conn(0x7f7ed8169da0 0x7f7ed816c1a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ed00103a0 tx=0x7f7ed0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.095+0000 7f7ed7fff700 1 --2- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed8169da0 0x7f7ed816c1a0 secure :-1 s=READY pgs=438 cs=0 l=1 rx=0x7f7ed00103a0 tx=0x7f7ed0010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:25.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.095+0000 7f7ed7fff700 1 --2- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed8169da0 0x7f7ed816c1a0 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f7ed00103a0 tx=0x7f7ed0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.095+0000 7f7ecffff700 1 -- 172.21.15.80:0/2483753319 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed0001570 con 0x7f7ed8169da0 2019-11-28T11:29:25.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.095+0000 7f7ed7fff700 1 --2- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed8169da0 0x7f7ed816c1a0 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f7ed00103a0 tx=0x7f7ed0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.095+0000 7f7ed7fff700 1 --2- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed8169da0 0x7f7ed816c1a0 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f7ed00103a0 tx=0x7f7ed0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.095+0000 7f7ecffff700 1 -- 172.21.15.80:0/2483753319 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed0000940 con 0x7f7ed8169da0 2019-11-28T11:29:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.095+0000 7f7ecffff700 1 -- 172.21.15.80:0/2483753319 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed0001b50 con 0x7f7ed8169da0 2019-11-28T11:29:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.095+0000 7f7edd3ce700 1 -- 172.21.15.80:0/2483753319 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed8106f60 con 0x7f7ed8169da0 2019-11-28T11:29:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.095+0000 7f7edd3ce700 1 -- 172.21.15.80:0/2483753319 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed8106be0 con 0x7f7ed8169da0 2019-11-28T11:29:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.095+0000 7f7ed7fff700 1 --2- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed8169da0 0x7f7ed816c1a0 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f7ed00103a0 tx=0x7f7ed0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.096+0000 7f7ecffff700 1 -- 172.21.15.80:0/2483753319 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7ed0001190 con 0x7f7ed8169da0 2019-11-28T11:29:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.096+0000 7f7ed7fff700 1 --2- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed8169da0 0x7f7ed816c1a0 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f7ed00103a0 tx=0x7f7ed0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.096+0000 7f7ecffff700 1 --2- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ebc018780 0x7f7ebc01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.096+0000 7f7ecffff700 1 -- 172.21.15.80:0/2483753319 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f7ed0031a50 con 0x7f7ed8169da0 2019-11-28T11:29:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.096+0000 7f7ed77fe700 1 --2- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ebc018780 0x7f7ebc01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:25.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.096+0000 7f7ed77fe700 1 --2- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ebc018780 0x7f7ebc01abf0 crc :-1 s=READY pgs=308 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:25.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.103+0000 7f7edd3ce700 1 -- 172.21.15.80:0/2483753319 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed8106f60 con 0x7f7ed8169da0 2019-11-28T11:29:25.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.107+0000 7f7ed7fff700 1 --2- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed8169da0 0x7f7ed816c1a0 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f7ed00103a0 tx=0x7f7ed0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.107+0000 7f7ecffff700 1 -- 172.21.15.80:0/2483753319 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7ed0018200 con 0x7f7ed8169da0 2019-11-28T11:29:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.278+0000 7f7edd3ce700 1 -- 172.21.15.80:0/2483753319 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f7ed8106be0 con 0x7f7ed8169da0 2019-11-28T11:29:25.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.613+0000 7f7ed7fff700 1 --2- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed8169da0 0x7f7ed816c1a0 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f7ed00103a0 tx=0x7f7ed0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.613+0000 7f7ecffff700 1 -- 172.21.15.80:0/2483753319 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v64) v1 ==== 133+0+0 (secure 0 0 0) 0x7f7ed0018200 con 0x7f7ed8169da0 2019-11-28T11:29:25.673 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:29:25.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.644+0000 7f7edd3ce700 1 -- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ebc018780 msgr2=0x7f7ebc01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:25.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.645+0000 7f7edd3ce700 1 --2- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ebc018780 0x7f7ebc01abf0 crc :-1 s=READY pgs=308 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:25.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.645+0000 7f7edd3ce700 1 -- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed8169da0 msgr2=0x7f7ed816c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:25.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.645+0000 7f7edd3ce700 1 --2- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed8169da0 0x7f7ed816c1a0 secure :-1 s=READY pgs=438 cs=0 l=1 rx=0x7f7ed00103a0 tx=0x7f7ed0010740).stop 2019-11-28T11:29:25.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.645+0000 7f7edd3ce700 1 -- 172.21.15.80:0/2483753319 shutdown_connections 2019-11-28T11:29:25.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.645+0000 7f7edd3ce700 1 --2- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed8169da0 0x7f7ed816c1a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:25.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.645+0000 7f7edd3ce700 1 --2- 172.21.15.80:0/2483753319 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ebc018780 0x7f7ebc01abf0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:25.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.645+0000 7f7edd3ce700 1 -- 172.21.15.80:0/2483753319 shutdown_connections 2019-11-28T11:29:25.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.645+0000 7f7edd3ce700 1 -- 172.21.15.80:0/2483753319 wait complete. 2019-11-28T11:29:25.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.645+0000 7f7edd3ce700 1 -- 172.21.15.80:0/2483753319 >> 172.21.15.80:0/2483753319 conn(0x7f7ed815e2d0 msgr2=0x7f7ed8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:25.685 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:29:25.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.778+0000 7fd37c910700 1 Processor -- start 2019-11-28T11:29:25.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.778+0000 7fd37c910700 1 -- start start 2019-11-28T11:29:25.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.779+0000 7fd37c910700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd37815ed10 0x7fd37815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:25.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.779+0000 7fd37c910700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd378073020 0x7fd378071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.779+0000 7fd37c910700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37806db60 con 0x7fd3780734b0 2019-11-28T11:29:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.779+0000 7fd37c910700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37806fe00 con 0x7fd37815ed10 2019-11-28T11:29:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.779+0000 7fd37c910700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3780700d0 con 0x7fd378073020 2019-11-28T11:29:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd376d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd37815ed10 0x7fd37815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd376d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd37815ed10 0x7fd37815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34704/0 (socket says 172.21.15.80:34704) 2019-11-28T11:29:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd376d9d700 1 -- 172.21.15.80:0/4045823614 learned_addr learned my addr 172.21.15.80:0/4045823614 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:25.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd37659c700 1 --2- 172.21.15.80:0/4045823614 >> v2:172.21.15.174:3300/0 conn(0x7fd378073020 0x7fd378071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:25.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd376d9d700 1 -- 172.21.15.80:0/4045823614 >> v2:172.21.15.174:3300/0 conn(0x7fd378073020 msgr2=0x7fd378071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:25.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd376d9d700 1 --2- 172.21.15.80:0/4045823614 >> v2:172.21.15.174:3300/0 conn(0x7fd378073020 0x7fd378071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:25.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd376d9d700 1 -- 172.21.15.80:0/4045823614 >> v1:172.21.15.174:6789/0 conn(0x7fd3780734b0 legacy=0x7fd3780723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:25.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd376d9d700 1 -- 172.21.15.80:0/4045823614 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd378070760 con 0x7fd37815ed10 2019-11-28T11:29:25.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd376d9d700 1 --2- 172.21.15.80:0/4045823614 >> v2:172.21.15.80:3300/0 conn(0x7fd37815ed10 0x7fd37815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd36800f740 tx=0x7fd36800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd376d9d700 1 --2- 172.21.15.80:0/4045823614 >> v2:172.21.15.80:3300/0 conn(0x7fd37815ed10 0x7fd37815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd36800f740 tx=0x7fd36800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd376d9d700 1 --2- 172.21.15.80:0/4045823614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd37815ed10 0x7fd37815f100 secure :-1 s=READY pgs=744 cs=0 l=1 rx=0x7fd36800f740 tx=0x7fd36800f570).ready entity=mon.0 client_cookie=ccafdbb2a8453b8b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:25.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd376d9d700 1 --2- 172.21.15.80:0/4045823614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd37815ed10 0x7fd37815f100 secure :-1 s=THROTTLE_DONE pgs=744 cs=0 l=1 rx=0x7fd36800f740 tx=0x7fd36800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd376d9d700 1 --2- 172.21.15.80:0/4045823614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd37815ed10 0x7fd37815f100 secure :-1 s=THROTTLE_DONE pgs=744 cs=0 l=1 rx=0x7fd36800f740 tx=0x7fd36800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd375d9b700 1 -- 172.21.15.80:0/4045823614 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd368000960 con 0x7fd37815ed10 2019-11-28T11:29:25.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd376d9d700 1 --2- 172.21.15.80:0/4045823614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd37815ed10 0x7fd37815f100 secure :-1 s=THROTTLE_DONE pgs=744 cs=0 l=1 rx=0x7fd36800f740 tx=0x7fd36800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd375d9b700 1 -- 172.21.15.80:0/4045823614 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd368000c90 con 0x7fd37815ed10 2019-11-28T11:29:25.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd375d9b700 1 -- 172.21.15.80:0/4045823614 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3680013a0 con 0x7fd37815ed10 2019-11-28T11:29:25.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd37c910700 1 -- 172.21.15.80:0/4045823614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd37815ed10 msgr2=0x7fd37815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:25.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.780+0000 7fd37c910700 1 --2- 172.21.15.80:0/4045823614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd37815ed10 0x7fd37815f100 secure :-1 s=READY pgs=744 cs=0 l=1 rx=0x7fd36800f740 tx=0x7fd36800f570).stop 2019-11-28T11:29:25.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.781+0000 7fd37c910700 1 -- 172.21.15.80:0/4045823614 shutdown_connections 2019-11-28T11:29:25.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.781+0000 7fd37c910700 1 --2- 172.21.15.80:0/4045823614 >> v2:172.21.15.174:3300/0 conn(0x7fd378073020 0x7fd378071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:25.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.781+0000 7fd37c910700 1 --2- 172.21.15.80:0/4045823614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd37815ed10 0x7fd37815f100 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:25.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.781+0000 7fd37c910700 1 -- 172.21.15.80:0/4045823614 shutdown_connections 2019-11-28T11:29:25.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.781+0000 7fd37c910700 1 -- 172.21.15.80:0/4045823614 wait complete. 2019-11-28T11:29:25.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.781+0000 7fd37c910700 1 -- 172.21.15.80:0/4045823614 >> 172.21.15.80:0/4045823614 conn(0x7fd378061d20 msgr2=0x7fd3780641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:25.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.784+0000 7fd37c910700 1 Processor -- start 2019-11-28T11:29:25.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.784+0000 7fd37c910700 1 -- start start 2019-11-28T11:29:25.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.784+0000 7fd37c910700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd3781079b0 0x7fd378107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:25.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37c910700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd378148e00 con 0x7fd378108380 2019-11-28T11:29:25.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37c910700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd378108b10 con 0x7fd378148320 2019-11-28T11:29:25.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37c910700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37813aa20 con 0x7fd3781079b0 2019-11-28T11:29:25.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd378108380 0x7fd378168d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34030/0 (socket says 172.21.15.80:34030) 2019-11-28T11:29:25.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37759e700 1 -- 172.21.15.80:0/3772333209 learned_addr learned my addr 172.21.15.80:0/3772333209 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:25.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37659c700 1 --2- 172.21.15.80:0/3772333209 >> v2:172.21.15.174:3300/0 conn(0x7fd3781079b0 0x7fd378107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:25.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd36f7fe700 1 -- 172.21.15.80:0/3772333209 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740086797 0 0) 0x7fd3700009b0 con 0x7fd378108380 2019-11-28T11:29:25.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd36f7fe700 1 -- 172.21.15.80:0/3772333209 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd350002e80 con 0x7fd378108380 2019-11-28T11:29:25.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37659c700 1 -- 172.21.15.80:0/3772333209 >> v1:172.21.15.174:6789/0 conn(0x7fd378148320 legacy=0x7fd37810ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:25.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37659c700 1 -- 172.21.15.80:0/3772333209 >> v1:172.21.15.80:6789/0 conn(0x7fd378108380 legacy=0x7fd378168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:25.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37659c700 1 -- 172.21.15.80:0/3772333209 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37810c490 con 0x7fd3781079b0 2019-11-28T11:29:25.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37659c700 1 --2- 172.21.15.80:0/3772333209 >> v2:172.21.15.174:3300/0 conn(0x7fd3781079b0 0x7fd378107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd360010720 tx=0x7fd360010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37659c700 1 --2- 172.21.15.80:0/3772333209 >> v2:172.21.15.174:3300/0 conn(0x7fd3781079b0 0x7fd378107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd360010720 tx=0x7fd360010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37659c700 1 --2- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3781079b0 0x7fd378107e40 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7fd360010720 tx=0x7fd360010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:25.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37659c700 1 --2- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3781079b0 0x7fd378107e40 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7fd360010720 tx=0x7fd360010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd36f7fe700 1 -- 172.21.15.80:0/3772333209 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd360000cc0 con 0x7fd3781079b0 2019-11-28T11:29:25.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37659c700 1 --2- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3781079b0 0x7fd378107e40 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7fd360010720 tx=0x7fd360010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37659c700 1 --2- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3781079b0 0x7fd378107e40 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7fd360010720 tx=0x7fd360010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd36f7fe700 1 -- 172.21.15.80:0/3772333209 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd360009fc0 con 0x7fd3781079b0 2019-11-28T11:29:25.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd36f7fe700 1 -- 172.21.15.80:0/3772333209 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36000a1b0 con 0x7fd3781079b0 2019-11-28T11:29:25.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37c910700 1 -- 172.21.15.80:0/3772333209 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37810c810 con 0x7fd3781079b0 2019-11-28T11:29:25.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.785+0000 7fd37c910700 1 -- 172.21.15.80:0/3772333209 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd378108820 con 0x7fd3781079b0 2019-11-28T11:29:25.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.786+0000 7fd37659c700 1 --2- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3781079b0 0x7fd378107e40 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7fd360010720 tx=0x7fd360010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.786+0000 7fd37659c700 1 --2- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3781079b0 0x7fd378107e40 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7fd360010720 tx=0x7fd360010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.786+0000 7fd36f7fe700 1 -- 172.21.15.80:0/3772333209 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd360009c40 con 0x7fd3781079b0 2019-11-28T11:29:25.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.786+0000 7fd36f7fe700 1 --2- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd350018770 0x7fd35001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:25.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.786+0000 7fd36f7fe700 1 -- 172.21.15.80:0/3772333209 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd360031e30 con 0x7fd3781079b0 2019-11-28T11:29:25.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.787+0000 7fd376d9d700 1 --2- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd350018770 0x7fd35001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:25.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.787+0000 7fd376d9d700 1 --2- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd350018770 0x7fd35001abe0 crc :-1 s=READY pgs=309 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:25.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.794+0000 7fd37c910700 1 -- 172.21.15.80:0/3772333209 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37810c490 con 0x7fd3781079b0 2019-11-28T11:29:25.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.798+0000 7fd37659c700 1 --2- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3781079b0 0x7fd378107e40 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7fd360010720 tx=0x7fd360010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:25.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.798+0000 7fd36f7fe700 1 -- 172.21.15.80:0/3772333209 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd3600099e0 con 0x7fd3781079b0 2019-11-28T11:29:25.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:25.967+0000 7fd37c910700 1 -- 172.21.15.80:0/3772333209 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7fd37810c810 con 0x7fd3781079b0 2019-11-28T11:29:26.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.617+0000 7fd37659c700 1 --2- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3781079b0 0x7fd378107e40 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7fd360010720 tx=0x7fd360010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:26.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.617+0000 7fd36f7fe700 1 -- 172.21.15.80:0/3772333209 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v65) v1 ==== 125+0+0 (secure 0 0 0) 0x7fd360009bf0 con 0x7fd3781079b0 2019-11-28T11:29:26.662 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:29:26.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.634+0000 7fd37c910700 1 -- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd350018770 msgr2=0x7fd35001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:26.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.634+0000 7fd37c910700 1 --2- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd350018770 0x7fd35001abe0 crc :-1 s=READY pgs=309 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:26.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.634+0000 7fd37c910700 1 -- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3781079b0 msgr2=0x7fd378107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:26.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.634+0000 7fd37c910700 1 --2- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3781079b0 0x7fd378107e40 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7fd360010720 tx=0x7fd360010ac0).stop 2019-11-28T11:29:26.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.634+0000 7fd37c910700 1 -- 172.21.15.80:0/3772333209 shutdown_connections 2019-11-28T11:29:26.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.634+0000 7fd37c910700 1 --2- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3781079b0 0x7fd378107e40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:26.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.634+0000 7fd37c910700 1 --2- 172.21.15.80:0/3772333209 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd350018770 0x7fd35001abe0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:26.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.634+0000 7fd37c910700 1 -- 172.21.15.80:0/3772333209 shutdown_connections 2019-11-28T11:29:26.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.634+0000 7fd37c910700 1 -- 172.21.15.80:0/3772333209 wait complete. 2019-11-28T11:29:26.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.634+0000 7fd37c910700 1 -- 172.21.15.80:0/3772333209 >> 172.21.15.80:0/3772333209 conn(0x7fd37815e2d0 msgr2=0x7fd378147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:26.675 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:29:26.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.767+0000 7eff677e4700 1 Processor -- start 2019-11-28T11:29:26.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.767+0000 7eff677e4700 1 -- start start 2019-11-28T11:29:26.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.768+0000 7eff677e4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff6015f100 0x7eff6006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:26.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.768+0000 7eff677e4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6006db60 con 0x7eff6015ed10 2019-11-28T11:29:26.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.768+0000 7eff677e4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6006e060 con 0x7eff6006c2f0 2019-11-28T11:29:26.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.768+0000 7eff677e4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6006fe00 con 0x7eff6015f100 2019-11-28T11:29:26.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.768+0000 7eff65580700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff6015f100 0x7eff6006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:26.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.768+0000 7eff65580700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff6015f100 0x7eff6006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34722/0 (socket says 172.21.15.80:34722) 2019-11-28T11:29:26.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff65580700 1 -- 172.21.15.80:0/757670354 learned_addr learned my addr 172.21.15.80:0/757670354 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:26.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff65d81700 1 --1- 172.21.15.80:0/757670354 >> v1:172.21.15.80:6789/0 conn(0x7eff6015ed10 0x7eff60073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34034/0 (socket says 172.21.15.80:34034) 2019-11-28T11:29:26.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff65580700 1 -- 172.21.15.80:0/757670354 >> v1:172.21.15.174:6789/0 conn(0x7eff6006c2f0 legacy=0x7eff6006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:26.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff65580700 1 -- 172.21.15.80:0/757670354 >> v1:172.21.15.80:6789/0 conn(0x7eff6015ed10 legacy=0x7eff60073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:26.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff64d7f700 1 -- 172.21.15.80:0/757670354 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156379237 0 0) 0x7eff48001480 con 0x7eff6015ed10 2019-11-28T11:29:26.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff65580700 1 -- 172.21.15.80:0/757670354 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff60070760 con 0x7eff6015f100 2019-11-28T11:29:26.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff65580700 1 --2- 172.21.15.80:0/757670354 >> v2:172.21.15.80:3300/0 conn(0x7eff6015f100 0x7eff6006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7eff50008400 tx=0x7eff5000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:26.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff65580700 1 --2- 172.21.15.80:0/757670354 >> v2:172.21.15.80:3300/0 conn(0x7eff6015f100 0x7eff6006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7eff50008400 tx=0x7eff5000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:26.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff65580700 1 --2- 172.21.15.80:0/757670354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff6015f100 0x7eff6006bdb0 secure :-1 s=READY pgs=747 cs=0 l=1 rx=0x7eff50008400 tx=0x7eff5000fad0).ready entity=mon.0 client_cookie=169f1f497702009a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:26.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff65580700 1 --2- 172.21.15.80:0/757670354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff6015f100 0x7eff6006bdb0 secure :-1 s=THROTTLE_DONE pgs=747 cs=0 l=1 rx=0x7eff50008400 tx=0x7eff5000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:26.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff64d7f700 1 -- 172.21.15.80:0/757670354 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff50000960 con 0x7eff6015f100 2019-11-28T11:29:26.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff65580700 1 --2- 172.21.15.80:0/757670354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff6015f100 0x7eff6006bdb0 secure :-1 s=THROTTLE_DONE pgs=747 cs=0 l=1 rx=0x7eff50008400 tx=0x7eff5000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:26.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff65580700 1 --2- 172.21.15.80:0/757670354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff6015f100 0x7eff6006bdb0 secure :-1 s=THROTTLE_DONE pgs=747 cs=0 l=1 rx=0x7eff50008400 tx=0x7eff5000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:26.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff64d7f700 1 -- 172.21.15.80:0/757670354 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff50000c90 con 0x7eff6015f100 2019-11-28T11:29:26.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff64d7f700 1 -- 172.21.15.80:0/757670354 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff50001360 con 0x7eff6015f100 2019-11-28T11:29:26.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff677e4700 1 -- 172.21.15.80:0/757670354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff6015f100 msgr2=0x7eff6006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:26.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.769+0000 7eff677e4700 1 --2- 172.21.15.80:0/757670354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff6015f100 0x7eff6006bdb0 secure :-1 s=READY pgs=747 cs=0 l=1 rx=0x7eff50008400 tx=0x7eff5000fad0).stop 2019-11-28T11:29:26.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.770+0000 7eff677e4700 1 -- 172.21.15.80:0/757670354 shutdown_connections 2019-11-28T11:29:26.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.770+0000 7eff677e4700 1 --2- 172.21.15.80:0/757670354 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff6015f100 0x7eff6006bdb0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:26.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.770+0000 7eff677e4700 1 -- 172.21.15.80:0/757670354 shutdown_connections 2019-11-28T11:29:26.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.770+0000 7eff677e4700 1 -- 172.21.15.80:0/757670354 wait complete. 2019-11-28T11:29:26.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.770+0000 7eff677e4700 1 -- 172.21.15.80:0/757670354 >> 172.21.15.80:0/757670354 conn(0x7eff60061d20 msgr2=0x7eff600641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:26.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.772+0000 7eff677e4700 1 Processor -- start 2019-11-28T11:29:26.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.772+0000 7eff677e4700 1 -- start start 2019-11-28T11:29:26.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.773+0000 7eff677e4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7eff60153db0 0x7eff6010dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:26.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.773+0000 7eff677e4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff60148830 0x7eff6016ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:26.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.773+0000 7eff677e4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff601057a0 con 0x7eff6010e270 2019-11-28T11:29:26.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.773+0000 7eff677e4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff60106280 con 0x7eff60153db0 2019-11-28T11:29:26.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.773+0000 7eff677e4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff60106550 con 0x7eff60148830 2019-11-28T11:29:26.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.773+0000 7eff65d81700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7eff60153db0 0x7eff6010dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:26.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff65580700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7eff6010e270 0x7eff60148030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:49586/0 (socket says 172.21.15.80:49586) 2019-11-28T11:29:26.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.773+0000 7eff66582700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff60148830 0x7eff6016ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:26.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff65580700 1 -- 172.21.15.80:0/946147452 learned_addr learned my addr 172.21.15.80:0/946147452 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:26.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff5e7fc700 1 -- 172.21.15.80:0/946147452 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551798273 0 0) 0x7eff500078e0 con 0x7eff6010e270 2019-11-28T11:29:26.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff5e7fc700 1 -- 172.21.15.80:0/946147452 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff44002e80 con 0x7eff6010e270 2019-11-28T11:29:26.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff65d81700 1 -- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff60148830 msgr2=0x7eff6016ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:26.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff65d81700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff60148830 0x7eff6016ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:26.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff65d81700 1 -- 172.21.15.80:0/946147452 >> v1:172.21.15.174:6789/0 conn(0x7eff6010e270 legacy=0x7eff60148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:26.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff65d81700 1 -- 172.21.15.80:0/946147452 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff60106be0 con 0x7eff60153db0 2019-11-28T11:29:26.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff66582700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff60148830 0x7eff6016ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:26.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff65d81700 1 --2- 172.21.15.80:0/946147452 >> v2:172.21.15.174:3300/0 conn(0x7eff60153db0 0x7eff6010dd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff480106f0 tx=0x7eff48010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff65d81700 1 --2- 172.21.15.80:0/946147452 >> v2:172.21.15.174:3300/0 conn(0x7eff60153db0 0x7eff6010dd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff480106f0 tx=0x7eff48010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff65d81700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff60153db0 0x7eff6010dd30 secure :-1 s=READY pgs=444 cs=0 l=1 rx=0x7eff480106f0 tx=0x7eff48010a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff65d81700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff60153db0 0x7eff6010dd30 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7eff480106f0 tx=0x7eff48010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff5e7fc700 1 -- 172.21.15.80:0/946147452 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff480045c0 con 0x7eff60153db0 2019-11-28T11:29:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff65d81700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff60153db0 0x7eff6010dd30 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7eff480106f0 tx=0x7eff48010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff5e7fc700 1 -- 172.21.15.80:0/946147452 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff48001010 con 0x7eff60153db0 2019-11-28T11:29:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff65d81700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff60153db0 0x7eff6010dd30 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7eff480106f0 tx=0x7eff48010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:26.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff677e4700 1 -- 172.21.15.80:0/946147452 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff60106f60 con 0x7eff60153db0 2019-11-28T11:29:26.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff5e7fc700 1 -- 172.21.15.80:0/946147452 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff480047b0 con 0x7eff60153db0 2019-11-28T11:29:26.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.774+0000 7eff677e4700 1 -- 172.21.15.80:0/946147452 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff60106be0 con 0x7eff60153db0 2019-11-28T11:29:26.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.775+0000 7eff65d81700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff60153db0 0x7eff6010dd30 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7eff480106f0 tx=0x7eff48010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:26.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.775+0000 7eff5e7fc700 1 -- 172.21.15.80:0/946147452 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7eff480045c0 con 0x7eff60153db0 2019-11-28T11:29:26.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.775+0000 7eff65d81700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff60153db0 0x7eff6010dd30 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7eff480106f0 tx=0x7eff48010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:26.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.775+0000 7eff5e7fc700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff44018770 0x7eff4401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:26.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.775+0000 7eff5e7fc700 1 -- 172.21.15.80:0/946147452 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5904+0+0 (secure 0 0 0) 0x7eff48031ff0 con 0x7eff60153db0 2019-11-28T11:29:26.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.775+0000 7eff65580700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff44018770 0x7eff4401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:26.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.775+0000 7eff65580700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff44018770 0x7eff4401abe0 crc :-1 s=READY pgs=310 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:26.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.782+0000 7eff677e4700 1 -- 172.21.15.80:0/946147452 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff60106f60 con 0x7eff60153db0 2019-11-28T11:29:26.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.786+0000 7eff65d81700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff60153db0 0x7eff6010dd30 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7eff480106f0 tx=0x7eff48010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:26.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.786+0000 7eff5e7fc700 1 -- 172.21.15.80:0/946147452 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7eff480015a0 con 0x7eff60153db0 2019-11-28T11:29:26.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.951+0000 7eff677e4700 1 -- 172.21.15.80:0/946147452 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7eff60106be0 con 0x7eff60153db0 2019-11-28T11:29:26.983 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:29:26.953+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:29:26.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.956+0000 7eff65d81700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff60153db0 0x7eff6010dd30 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7eff480106f0 tx=0x7eff48010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:26.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.956+0000 7eff5e7fc700 1 -- 172.21.15.80:0/946147452 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 10 and data pool 11 v34) v1 ==== 174+0+0 (secure 0 0 0) 0x7eff480045c0 con 0x7eff60153db0 2019-11-28T11:29:26.989 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 10 and data pool 11 2019-11-28T11:29:26.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.961+0000 7eff677e4700 1 -- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff44018770 msgr2=0x7eff4401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:26.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.961+0000 7eff677e4700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff44018770 0x7eff4401abe0 crc :-1 s=READY pgs=310 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:26.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.961+0000 7eff677e4700 1 -- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff60153db0 msgr2=0x7eff6010dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:26.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.961+0000 7eff677e4700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff60153db0 0x7eff6010dd30 secure :-1 s=READY pgs=444 cs=0 l=1 rx=0x7eff480106f0 tx=0x7eff48010a90).stop 2019-11-28T11:29:26.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.961+0000 7eff677e4700 1 -- 172.21.15.80:0/946147452 shutdown_connections 2019-11-28T11:29:26.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.961+0000 7eff677e4700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff60148830 0x7eff6016ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:26.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.961+0000 7eff677e4700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff44018770 0x7eff4401abe0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:26.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.961+0000 7eff677e4700 1 --2- 172.21.15.80:0/946147452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff60153db0 0x7eff6010dd30 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:26.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.961+0000 7eff677e4700 1 -- 172.21.15.80:0/946147452 shutdown_connections 2019-11-28T11:29:26.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.961+0000 7eff677e4700 1 -- 172.21.15.80:0/946147452 wait complete. 2019-11-28T11:29:26.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:26.961+0000 7eff677e4700 1 -- 172.21.15.80:0/946147452 >> 172.21.15.80:0/946147452 conn(0x7eff6015e2d0 msgr2=0x7eff60147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:27.002 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:29:27.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.089+0000 7fa914611700 1 Processor -- start 2019-11-28T11:29:27.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.089+0000 7fa914611700 1 -- start start 2019-11-28T11:29:27.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.090+0000 7fa914611700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa90c06d120 0x7fa90c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:27.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.090+0000 7fa914611700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90c06d5a0 con 0x7fa90c06c490 2019-11-28T11:29:27.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.090+0000 7fa914611700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90c06db00 con 0x7fa90c06c0a0 2019-11-28T11:29:27.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.090+0000 7fa914611700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa90c06fd60 con 0x7fa90c06d120 2019-11-28T11:29:27.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.090+0000 7fa9133af700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa90c06d120 0x7fa90c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:27.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa9133af700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa90c06d120 0x7fa90c165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34734/0 (socket says 172.21.15.80:34734) 2019-11-28T11:29:27.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa9123ad700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa90c06c490 0x7fa90c06c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34052/0 (socket says 172.21.15.80:34052) 2019-11-28T11:29:27.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa9133af700 1 -- 172.21.15.80:0/4045129763 learned_addr learned my addr 172.21.15.80:0/4045129763 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:27.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa9133af700 1 -- 172.21.15.80:0/4045129763 >> v1:172.21.15.174:6789/0 conn(0x7fa90c06c0a0 legacy=0x7fa90c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa9133af700 1 -- 172.21.15.80:0/4045129763 >> v1:172.21.15.80:6789/0 conn(0x7fa90c06c490 legacy=0x7fa90c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa9133af700 1 -- 172.21.15.80:0/4045129763 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c0706c0 con 0x7fa90c06d120 2019-11-28T11:29:27.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa911bac700 1 -- 172.21.15.80:0/4045129763 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260880992 0 0) 0x7fa900001100 con 0x7fa90c06c490 2019-11-28T11:29:27.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa9133af700 1 --2- 172.21.15.80:0/4045129763 >> v2:172.21.15.80:3300/0 conn(0x7fa90c06d120 0x7fa90c165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa90400f730 tx=0x7fa90400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa9133af700 1 --2- 172.21.15.80:0/4045129763 >> v2:172.21.15.80:3300/0 conn(0x7fa90c06d120 0x7fa90c165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa90400f730 tx=0x7fa90400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa9133af700 1 --2- 172.21.15.80:0/4045129763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c06d120 0x7fa90c165d80 secure :-1 s=READY pgs=749 cs=0 l=1 rx=0x7fa90400f730 tx=0x7fa90400fad0).ready entity=mon.0 client_cookie=7cdc984779b2637d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:27.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa9133af700 1 --2- 172.21.15.80:0/4045129763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c06d120 0x7fa90c165d80 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7fa90400f730 tx=0x7fa90400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa911bac700 1 -- 172.21.15.80:0/4045129763 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9040010e0 con 0x7fa90c06d120 2019-11-28T11:29:27.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa9133af700 1 --2- 172.21.15.80:0/4045129763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c06d120 0x7fa90c165d80 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7fa90400f730 tx=0x7fa90400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa911bac700 1 -- 172.21.15.80:0/4045129763 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa904000a00 con 0x7fa90c06d120 2019-11-28T11:29:27.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa9133af700 1 --2- 172.21.15.80:0/4045129763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c06d120 0x7fa90c165d80 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7fa90400f730 tx=0x7fa90400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa911bac700 1 -- 172.21.15.80:0/4045129763 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa904000bf0 con 0x7fa90c06d120 2019-11-28T11:29:27.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa914611700 1 -- 172.21.15.80:0/4045129763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c06d120 msgr2=0x7fa90c165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.091+0000 7fa914611700 1 --2- 172.21.15.80:0/4045129763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c06d120 0x7fa90c165d80 secure :-1 s=READY pgs=749 cs=0 l=1 rx=0x7fa90400f730 tx=0x7fa90400fad0).stop 2019-11-28T11:29:27.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.092+0000 7fa914611700 1 -- 172.21.15.80:0/4045129763 shutdown_connections 2019-11-28T11:29:27.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.092+0000 7fa914611700 1 --2- 172.21.15.80:0/4045129763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c06d120 0x7fa90c165d80 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:27.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.092+0000 7fa914611700 1 -- 172.21.15.80:0/4045129763 shutdown_connections 2019-11-28T11:29:27.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.092+0000 7fa914611700 1 -- 172.21.15.80:0/4045129763 wait complete. 2019-11-28T11:29:27.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.092+0000 7fa914611700 1 -- 172.21.15.80:0/4045129763 >> 172.21.15.80:0/4045129763 conn(0x7fa90c061cf0 msgr2=0x7fa90c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:27.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.094+0000 7fa914611700 1 Processor -- start 2019-11-28T11:29:27.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.094+0000 7fa914611700 1 -- start start 2019-11-28T11:29:27.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.095+0000 7fa914611700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa90c167a20 0x7fa90c169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:27.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.095+0000 7fa914611700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90c13fc50 con 0x7fa90c1145b0 2019-11-28T11:29:27.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.095+0000 7fa914611700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90c122ef0 con 0x7fa90c13f580 2019-11-28T11:29:27.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.095+0000 7fa914611700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa90c112550 con 0x7fa90c167a20 2019-11-28T11:29:27.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.095+0000 7fa9123ad700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa90c1145b0 0x7fa90c114a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34056/0 (socket says 172.21.15.80:34056) 2019-11-28T11:29:27.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.095+0000 7fa9123ad700 1 -- 172.21.15.80:0/1198840405 learned_addr learned my addr 172.21.15.80:0/1198840405 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:27.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.095+0000 7fa9133af700 1 --2- 172.21.15.80:0/1198840405 >> v2:172.21.15.80:3300/0 conn(0x7fa90c167a20 0x7fa90c169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:27.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.096+0000 7fa9133af700 1 -- 172.21.15.80:0/1198840405 >> v1:172.21.15.174:6789/0 conn(0x7fa90c13f580 legacy=0x7fa90c115730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.096+0000 7fa9133af700 1 -- 172.21.15.80:0/1198840405 >> v1:172.21.15.80:6789/0 conn(0x7fa90c1145b0 legacy=0x7fa90c114a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.096+0000 7fa90b7fe700 1 -- 172.21.15.80:0/1198840405 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024490868 0 0) 0x7fa900001150 con 0x7fa90c1145b0 2019-11-28T11:29:27.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.096+0000 7fa9133af700 1 -- 172.21.15.80:0/1198840405 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c112eb0 con 0x7fa90c167a20 2019-11-28T11:29:27.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.096+0000 7fa9133af700 1 --2- 172.21.15.80:0/1198840405 >> v2:172.21.15.80:3300/0 conn(0x7fa90c167a20 0x7fa90c169e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa904010390 tx=0x7fa904010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.096+0000 7fa9133af700 1 --2- 172.21.15.80:0/1198840405 >> v2:172.21.15.80:3300/0 conn(0x7fa90c167a20 0x7fa90c169e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa904010390 tx=0x7fa904010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.096+0000 7fa9133af700 1 --2- 172.21.15.80:0/1198840405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c167a20 0x7fa90c169e20 secure :-1 s=READY pgs=751 cs=0 l=1 rx=0x7fa904010390 tx=0x7fa904010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:27.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.096+0000 7fa9133af700 1 --2- 172.21.15.80:0/1198840405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c167a20 0x7fa90c169e20 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fa904010390 tx=0x7fa904010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.096+0000 7fa90b7fe700 1 -- 172.21.15.80:0/1198840405 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9040014a0 con 0x7fa90c167a20 2019-11-28T11:29:27.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.096+0000 7fa9133af700 1 --2- 172.21.15.80:0/1198840405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c167a20 0x7fa90c169e20 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fa904010390 tx=0x7fa904010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.096+0000 7fa90b7fe700 1 -- 172.21.15.80:0/1198840405 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9040010c0 con 0x7fa90c167a20 2019-11-28T11:29:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.096+0000 7fa9133af700 1 --2- 172.21.15.80:0/1198840405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c167a20 0x7fa90c169e20 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fa904010390 tx=0x7fa904010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.096+0000 7fa914611700 1 -- 172.21.15.80:0/1198840405 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90c113230 con 0x7fa90c167a20 2019-11-28T11:29:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.096+0000 7fa90b7fe700 1 -- 172.21.15.80:0/1198840405 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa904001a80 con 0x7fa90c167a20 2019-11-28T11:29:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.096+0000 7fa914611700 1 -- 172.21.15.80:0/1198840405 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90c112eb0 con 0x7fa90c167a20 2019-11-28T11:29:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.096+0000 7fa9133af700 1 --2- 172.21.15.80:0/1198840405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c167a20 0x7fa90c169e20 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fa904010390 tx=0x7fa904010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.097+0000 7fa90b7fe700 1 -- 172.21.15.80:0/1198840405 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa9040012b0 con 0x7fa90c167a20 2019-11-28T11:29:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.097+0000 7fa9133af700 1 --2- 172.21.15.80:0/1198840405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c167a20 0x7fa90c169e20 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fa904010390 tx=0x7fa904010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.097+0000 7fa90b7fe700 1 --2- 172.21.15.80:0/1198840405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8ec018730 0x7fa8ec01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.097+0000 7fa90b7fe700 1 -- 172.21.15.80:0/1198840405 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa904031a80 con 0x7fa90c167a20 2019-11-28T11:29:27.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.097+0000 7fa912bae700 1 --2- 172.21.15.80:0/1198840405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8ec018730 0x7fa8ec01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.097+0000 7fa912bae700 1 --2- 172.21.15.80:0/1198840405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8ec018730 0x7fa8ec01abc0 crc :-1 s=READY pgs=311 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:27.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.105+0000 7fa914611700 1 -- 172.21.15.80:0/1198840405 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90c113230 con 0x7fa90c167a20 2019-11-28T11:29:27.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.108+0000 7fa9133af700 1 --2- 172.21.15.80:0/1198840405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c167a20 0x7fa90c169e20 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fa904010390 tx=0x7fa904010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.108+0000 7fa90b7fe700 1 -- 172.21.15.80:0/1198840405 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa904000eb0 con 0x7fa90c167a20 2019-11-28T11:29:27.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.287+0000 7fa914611700 1 -- 172.21.15.80:0/1198840405 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa90c112eb0 con 0x7fa90c167a20 2019-11-28T11:29:27.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.287+0000 7fa9133af700 1 --2- 172.21.15.80:0/1198840405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c167a20 0x7fa90c169e20 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fa904010390 tx=0x7fa904010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.287+0000 7fa90b7fe700 1 -- 172.21.15.80:0/1198840405 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+14873 (secure 0 0 0) 0x7fa9040012b0 con 0x7fa90c167a20 2019-11-28T11:29:27.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.290+0000 7fa914611700 1 -- 172.21.15.80:0/1198840405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8ec018730 msgr2=0x7fa8ec01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.290+0000 7fa914611700 1 --2- 172.21.15.80:0/1198840405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8ec018730 0x7fa8ec01abc0 crc :-1 s=READY pgs=311 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:27.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.290+0000 7fa914611700 1 -- 172.21.15.80:0/1198840405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c167a20 msgr2=0x7fa90c169e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.290+0000 7fa914611700 1 --2- 172.21.15.80:0/1198840405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c167a20 0x7fa90c169e20 secure :-1 s=READY pgs=751 cs=0 l=1 rx=0x7fa904010390 tx=0x7fa904010730).stop 2019-11-28T11:29:27.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.290+0000 7fa914611700 1 -- 172.21.15.80:0/1198840405 shutdown_connections 2019-11-28T11:29:27.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.290+0000 7fa914611700 1 --2- 172.21.15.80:0/1198840405 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa90c167a20 0x7fa90c169e20 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:27.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.290+0000 7fa914611700 1 --2- 172.21.15.80:0/1198840405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8ec018730 0x7fa8ec01abc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:27.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.290+0000 7fa914611700 1 -- 172.21.15.80:0/1198840405 shutdown_connections 2019-11-28T11:29:27.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.290+0000 7fa914611700 1 -- 172.21.15.80:0/1198840405 wait complete. 2019-11-28T11:29:27.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.290+0000 7fa914611700 1 -- 172.21.15.80:0/1198840405 >> 172.21.15.80:0/1198840405 conn(0x7fa90c1426c0 msgr2=0x7fa90c110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:27.323 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:27.323 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":66,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:29:26.954008+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:29:25.290976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2019-11-28T11:29:25.980441+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:29:27.331 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:29:27.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.420+0000 7f3def7ad700 1 Processor -- start 2019-11-28T11:29:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.420+0000 7f3def7ad700 1 -- start start 2019-11-28T11:29:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.421+0000 7f3def7ad700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3de806c490 0x7f3de806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.421+0000 7f3def7ad700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de806ce60 0x7f3de8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.421+0000 7f3def7ad700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de806db00 con 0x7f3de806c0a0 2019-11-28T11:29:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.421+0000 7f3def7ad700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de806fd60 con 0x7f3de806c490 2019-11-28T11:29:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.421+0000 7f3def7ad700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de8070030 con 0x7f3de806ce60 2019-11-28T11:29:27.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3ded549700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3de806c490 0x7f3de806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:27.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3ded549700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3de806c490 0x7f3de806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34750/0 (socket says 172.21.15.80:34750) 2019-11-28T11:29:27.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3ded549700 1 -- 172.21.15.80:0/2396707933 learned_addr learned my addr 172.21.15.80:0/2396707933 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:27.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3dedd4a700 1 --1- 172.21.15.80:0/2396707933 >> v1:172.21.15.80:6789/0 conn(0x7f3de806c0a0 0x7f3de8072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34062/0 (socket says 172.21.15.80:34062) 2019-11-28T11:29:27.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3dee54b700 1 --2- 172.21.15.80:0/2396707933 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de806ce60 0x7f3de8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:27.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3ded549700 1 -- 172.21.15.80:0/2396707933 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de806ce60 msgr2=0x7f3de8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3ded549700 1 --2- 172.21.15.80:0/2396707933 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de806ce60 0x7f3de8164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3ded549700 1 -- 172.21.15.80:0/2396707933 >> v1:172.21.15.80:6789/0 conn(0x7f3de806c0a0 legacy=0x7f3de8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3ded549700 1 -- 172.21.15.80:0/2396707933 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de80706c0 con 0x7f3de806c490 2019-11-28T11:29:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3decd48700 1 -- 172.21.15.80:0/2396707933 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238628133 0 0) 0x7f3dd8001100 con 0x7f3de806c0a0 2019-11-28T11:29:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3ded549700 1 --2- 172.21.15.80:0/2396707933 >> v2:172.21.15.80:3300/0 conn(0x7f3de806c490 0x7f3de806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3dd000fa40 tx=0x7f3dd000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3ded549700 1 --2- 172.21.15.80:0/2396707933 >> v2:172.21.15.80:3300/0 conn(0x7f3de806c490 0x7f3de806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3dd000fa40 tx=0x7f3dd000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3ded549700 1 --2- 172.21.15.80:0/2396707933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de806c490 0x7f3de806c920 secure :-1 s=READY pgs=753 cs=0 l=1 rx=0x7f3dd000fa40 tx=0x7f3dd000fde0).ready entity=mon.0 client_cookie=99ada973c9ebc0b6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:27.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3ded549700 1 --2- 172.21.15.80:0/2396707933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de806c490 0x7f3de806c920 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f3dd000fa40 tx=0x7f3dd000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3decd48700 1 -- 172.21.15.80:0/2396707933 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dd0000ce0 con 0x7f3de806c490 2019-11-28T11:29:27.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3ded549700 1 --2- 172.21.15.80:0/2396707933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de806c490 0x7f3de806c920 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f3dd000fa40 tx=0x7f3dd000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3ded549700 1 --2- 172.21.15.80:0/2396707933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de806c490 0x7f3de806c920 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f3dd000fa40 tx=0x7f3dd000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3decd48700 1 -- 172.21.15.80:0/2396707933 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd0001010 con 0x7f3de806c490 2019-11-28T11:29:27.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3decd48700 1 -- 172.21.15.80:0/2396707933 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dd0001720 con 0x7f3de806c490 2019-11-28T11:29:27.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3def7ad700 1 -- 172.21.15.80:0/2396707933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de806c490 msgr2=0x7f3de806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.422+0000 7f3def7ad700 1 --2- 172.21.15.80:0/2396707933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de806c490 0x7f3de806c920 secure :-1 s=READY pgs=753 cs=0 l=1 rx=0x7f3dd000fa40 tx=0x7f3dd000fde0).stop 2019-11-28T11:29:27.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.423+0000 7f3def7ad700 1 -- 172.21.15.80:0/2396707933 shutdown_connections 2019-11-28T11:29:27.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.423+0000 7f3def7ad700 1 --2- 172.21.15.80:0/2396707933 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de806ce60 0x7f3de8164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:27.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.423+0000 7f3def7ad700 1 --2- 172.21.15.80:0/2396707933 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de806c490 0x7f3de806c920 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:27.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.423+0000 7f3def7ad700 1 -- 172.21.15.80:0/2396707933 shutdown_connections 2019-11-28T11:29:27.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.423+0000 7f3def7ad700 1 -- 172.21.15.80:0/2396707933 wait complete. 2019-11-28T11:29:27.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.423+0000 7f3def7ad700 1 -- 172.21.15.80:0/2396707933 >> 172.21.15.80:0/2396707933 conn(0x7f3de8061cf0 msgr2=0x7f3de8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:27.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.425+0000 7f3def7ad700 1 Processor -- start 2019-11-28T11:29:27.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.426+0000 7f3def7ad700 1 -- start start 2019-11-28T11:29:27.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.426+0000 7f3def7ad700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3de815fdf0 0x7f3de812b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:27.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.426+0000 7f3def7ad700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3de812b8a0 0x7f3de813e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:27.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.426+0000 7f3def7ad700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de8139e00 con 0x7f3de813e860 2019-11-28T11:29:27.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.426+0000 7f3def7ad700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de8108820 con 0x7f3de812b8a0 2019-11-28T11:29:27.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.426+0000 7f3def7ad700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de8108af0 con 0x7f3de815fdf0 2019-11-28T11:29:27.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3ded549700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3de812b8a0 0x7f3de813e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:27.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3dee54b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3de813e860 0x7f3de812a3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34070/0 (socket says 172.21.15.80:34070) 2019-11-28T11:29:27.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3dee54b700 1 -- 172.21.15.80:0/3457875093 learned_addr learned my addr 172.21.15.80:0/3457875093 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:27.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3dedd4a700 1 --2- 172.21.15.80:0/3457875093 >> v2:172.21.15.174:3300/0 conn(0x7f3de815fdf0 0x7f3de812b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:27.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3ded549700 1 -- 172.21.15.80:0/3457875093 >> v2:172.21.15.174:3300/0 conn(0x7f3de815fdf0 msgr2=0x7f3de812b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3ded549700 1 --2- 172.21.15.80:0/3457875093 >> v2:172.21.15.174:3300/0 conn(0x7f3de815fdf0 0x7f3de812b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:27.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3ded549700 1 -- 172.21.15.80:0/3457875093 >> v1:172.21.15.80:6789/0 conn(0x7f3de813e860 legacy=0x7f3de812a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3de67fc700 1 -- 172.21.15.80:0/3457875093 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379718875 0 0) 0x7f3de0002180 con 0x7f3de813e860 2019-11-28T11:29:27.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3ded549700 1 -- 172.21.15.80:0/3457875093 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de810a8c0 con 0x7f3de812b8a0 2019-11-28T11:29:27.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3ded549700 1 --2- 172.21.15.80:0/3457875093 >> v2:172.21.15.80:3300/0 conn(0x7f3de812b8a0 0x7f3de813e320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3dd0010720 tx=0x7f3dd0010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3ded549700 1 --2- 172.21.15.80:0/3457875093 >> v2:172.21.15.80:3300/0 conn(0x7f3de812b8a0 0x7f3de813e320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3dd0010720 tx=0x7f3dd0010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3ded549700 1 --2- 172.21.15.80:0/3457875093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de812b8a0 0x7f3de813e320 secure :-1 s=READY pgs=755 cs=0 l=1 rx=0x7f3dd0010720 tx=0x7f3dd0010550).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:27.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3ded549700 1 --2- 172.21.15.80:0/3457875093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de812b8a0 0x7f3de813e320 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7f3dd0010720 tx=0x7f3dd0010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3de67fc700 1 -- 172.21.15.80:0/3457875093 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dd0007c60 con 0x7f3de812b8a0 2019-11-28T11:29:27.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3ded549700 1 --2- 172.21.15.80:0/3457875093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de812b8a0 0x7f3de813e320 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7f3dd0010720 tx=0x7f3dd0010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3ded549700 1 --2- 172.21.15.80:0/3457875093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de812b8a0 0x7f3de813e320 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7f3dd0010720 tx=0x7f3dd0010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3de67fc700 1 -- 172.21.15.80:0/3457875093 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd00013d0 con 0x7f3de812b8a0 2019-11-28T11:29:27.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3def7ad700 1 -- 172.21.15.80:0/3457875093 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de810a8c0 con 0x7f3de812b8a0 2019-11-28T11:29:27.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3de67fc700 1 -- 172.21.15.80:0/3457875093 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dd0001a20 con 0x7f3de812b8a0 2019-11-28T11:29:27.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.427+0000 7f3def7ad700 1 -- 172.21.15.80:0/3457875093 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de810a8c0 con 0x7f3de812b8a0 2019-11-28T11:29:27.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.428+0000 7f3ded549700 1 --2- 172.21.15.80:0/3457875093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de812b8a0 0x7f3de813e320 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7f3dd0010720 tx=0x7f3dd0010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.428+0000 7f3de67fc700 1 -- 172.21.15.80:0/3457875093 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3dd0007b90 con 0x7f3de812b8a0 2019-11-28T11:29:27.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.428+0000 7f3ded549700 1 --2- 172.21.15.80:0/3457875093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de812b8a0 0x7f3de813e320 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7f3dd0010720 tx=0x7f3dd0010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.428+0000 7f3de67fc700 1 --2- 172.21.15.80:0/3457875093 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3dcc018730 0x7f3dcc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:27.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.428+0000 7f3de67fc700 1 -- 172.21.15.80:0/3457875093 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3dd0031d40 con 0x7f3de812b8a0 2019-11-28T11:29:27.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.428+0000 7f3dedd4a700 1 --2- 172.21.15.80:0/3457875093 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3dcc018730 0x7f3dcc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:27.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.428+0000 7f3dedd4a700 1 --2- 172.21.15.80:0/3457875093 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3dcc018730 0x7f3dcc01abc0 crc :-1 s=READY pgs=312 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:27.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.436+0000 7f3def7ad700 1 -- 172.21.15.80:0/3457875093 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de8109180 con 0x7f3de812b8a0 2019-11-28T11:29:27.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.439+0000 7f3ded549700 1 --2- 172.21.15.80:0/3457875093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de812b8a0 0x7f3de813e320 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7f3dd0010720 tx=0x7f3dd0010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.439+0000 7f3de67fc700 1 -- 172.21.15.80:0/3457875093 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3dd0000fd0 con 0x7f3de812b8a0 2019-11-28T11:29:27.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.614+0000 7f3def7ad700 1 -- 172.21.15.80:0/3457875093 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3de8109500 con 0x7f3de812b8a0 2019-11-28T11:29:27.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.615+0000 7f3ded549700 1 --2- 172.21.15.80:0/3457875093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de812b8a0 0x7f3de813e320 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7f3dd0010720 tx=0x7f3dd0010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.615+0000 7f3de67fc700 1 -- 172.21.15.80:0/3457875093 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+14873 (secure 0 0 0) 0x7f3dd0007b90 con 0x7f3de812b8a0 2019-11-28T11:29:27.647 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:27.647 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":66,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:29:26.954008+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:29:25.290976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2019-11-28T11:29:25.980441+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:29:27.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.617+0000 7f3def7ad700 1 -- 172.21.15.80:0/3457875093 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3dcc018730 msgr2=0x7f3dcc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.617+0000 7f3def7ad700 1 --2- 172.21.15.80:0/3457875093 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3dcc018730 0x7f3dcc01abc0 crc :-1 s=READY pgs=312 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:27.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.617+0000 7f3def7ad700 1 -- 172.21.15.80:0/3457875093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de812b8a0 msgr2=0x7f3de813e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.617+0000 7f3def7ad700 1 --2- 172.21.15.80:0/3457875093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de812b8a0 0x7f3de813e320 secure :-1 s=READY pgs=755 cs=0 l=1 rx=0x7f3dd0010720 tx=0x7f3dd0010550).stop 2019-11-28T11:29:27.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.617+0000 7f3def7ad700 1 -- 172.21.15.80:0/3457875093 shutdown_connections 2019-11-28T11:29:27.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.617+0000 7f3def7ad700 1 --2- 172.21.15.80:0/3457875093 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3dcc018730 0x7f3dcc01abc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:27.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.617+0000 7f3def7ad700 1 --2- 172.21.15.80:0/3457875093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3de812b8a0 0x7f3de813e320 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:27.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.617+0000 7f3def7ad700 1 --2- 172.21.15.80:0/3457875093 >> v2:172.21.15.174:3300/0 conn(0x7f3de815fdf0 0x7f3de812b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:27.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.617+0000 7f3def7ad700 1 -- 172.21.15.80:0/3457875093 shutdown_connections 2019-11-28T11:29:27.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.617+0000 7f3def7ad700 1 -- 172.21.15.80:0/3457875093 wait complete. 2019-11-28T11:29:27.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.617+0000 7f3def7ad700 1 -- 172.21.15.80:0/3457875093 >> 172.21.15.80:0/3457875093 conn(0x7f3de8127dc0 msgr2=0x7f3de8141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:27.658 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:29:27.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.750+0000 7f4d3ed87700 1 Processor -- start 2019-11-28T11:29:27.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.750+0000 7f4d3ed87700 1 -- start start 2019-11-28T11:29:27.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.751+0000 7f4d3ed87700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d381639f0 0x7f4d38165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:27.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.751+0000 7f4d3ed87700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3806db60 con 0x7f4d3815ed10 2019-11-28T11:29:27.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.751+0000 7f4d3ed87700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3806e060 con 0x7f4d3815f100 2019-11-28T11:29:27.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.751+0000 7f4d3ed87700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3806fe00 con 0x7f4d381639f0 2019-11-28T11:29:27.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.751+0000 7f4d3d324700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4d3815ed10 0x7f4d38073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34076/0 (socket says 172.21.15.80:34076) 2019-11-28T11:29:27.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.751+0000 7f4d3d324700 1 -- 172.21.15.80:0/1001292499 learned_addr learned my addr 172.21.15.80:0/1001292499 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:27.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.751+0000 7f4d3db25700 1 --2- 172.21.15.80:0/1001292499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d381639f0 0x7f4d38165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:27.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d37fff700 1 -- 172.21.15.80:0/1001292499 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066976942 0 0) 0x7f4d200014d0 con 0x7f4d3815ed10 2019-11-28T11:29:27.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d37fff700 1 -- 172.21.15.80:0/1001292499 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d24002e80 con 0x7f4d3815ed10 2019-11-28T11:29:27.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d37fff700 1 -- 172.21.15.80:0/1001292499 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769588459 0 0) 0x7f4d28001080 con 0x7f4d3815f100 2019-11-28T11:29:27.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d37fff700 1 -- 172.21.15.80:0/1001292499 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d24004170 con 0x7f4d3815f100 2019-11-28T11:29:27.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d3db25700 1 -- 172.21.15.80:0/1001292499 >> v1:172.21.15.174:6789/0 conn(0x7f4d3815f100 legacy=0x7f4d3806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d3db25700 1 -- 172.21.15.80:0/1001292499 >> v1:172.21.15.80:6789/0 conn(0x7f4d3815ed10 legacy=0x7f4d38073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d3db25700 1 -- 172.21.15.80:0/1001292499 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d38070760 con 0x7f4d381639f0 2019-11-28T11:29:27.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d3db25700 1 --2- 172.21.15.80:0/1001292499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d381639f0 0x7f4d38165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4d3000af80 tx=0x7f4d3000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d3db25700 1 --2- 172.21.15.80:0/1001292499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d381639f0 0x7f4d38165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4d3000af80 tx=0x7f4d3000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d3db25700 1 --2- 172.21.15.80:0/1001292499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d381639f0 0x7f4d38165df0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f4d3000af80 tx=0x7f4d3000b790).ready entity=mon.2 client_cookie=dacf5c2c5c1edb4c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:27.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d3db25700 1 --2- 172.21.15.80:0/1001292499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d381639f0 0x7f4d38165df0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f4d3000af80 tx=0x7f4d3000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d37fff700 1 -- 172.21.15.80:0/1001292499 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d30007240 con 0x7f4d381639f0 2019-11-28T11:29:27.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d3db25700 1 --2- 172.21.15.80:0/1001292499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d381639f0 0x7f4d38165df0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f4d3000af80 tx=0x7f4d3000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d3db25700 1 --2- 172.21.15.80:0/1001292499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d381639f0 0x7f4d38165df0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f4d3000af80 tx=0x7f4d3000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d37fff700 1 -- 172.21.15.80:0/1001292499 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d30000bb0 con 0x7f4d381639f0 2019-11-28T11:29:27.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d37fff700 1 -- 172.21.15.80:0/1001292499 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d30007240 con 0x7f4d381639f0 2019-11-28T11:29:27.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d3ed87700 1 -- 172.21.15.80:0/1001292499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d381639f0 msgr2=0x7f4d38165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.752+0000 7f4d3ed87700 1 --2- 172.21.15.80:0/1001292499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d381639f0 0x7f4d38165df0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f4d3000af80 tx=0x7f4d3000b790).stop 2019-11-28T11:29:27.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.753+0000 7f4d3ed87700 1 -- 172.21.15.80:0/1001292499 shutdown_connections 2019-11-28T11:29:27.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.753+0000 7f4d3ed87700 1 --2- 172.21.15.80:0/1001292499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d381639f0 0x7f4d38165df0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:27.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.753+0000 7f4d3ed87700 1 -- 172.21.15.80:0/1001292499 shutdown_connections 2019-11-28T11:29:27.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.753+0000 7f4d3ed87700 1 -- 172.21.15.80:0/1001292499 wait complete. 2019-11-28T11:29:27.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.753+0000 7f4d3ed87700 1 -- 172.21.15.80:0/1001292499 >> 172.21.15.80:0/1001292499 conn(0x7f4d38061d20 msgr2=0x7f4d380641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:27.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.755+0000 7f4d3ed87700 1 Processor -- start 2019-11-28T11:29:27.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.755+0000 7f4d3ed87700 1 -- start start 2019-11-28T11:29:27.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.756+0000 7f4d3ed87700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4d38073290 0x7f4d38075520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:27.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.756+0000 7f4d3ed87700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d38148840 0x7f4d3812db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:27.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.756+0000 7f4d3ed87700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d381321a0 con 0x7f4d38075a60 2019-11-28T11:29:27.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.756+0000 7f4d3ed87700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3807a4f0 con 0x7f4d38073290 2019-11-28T11:29:27.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.756+0000 7f4d3ed87700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3807a7c0 con 0x7f4d38148840 2019-11-28T11:29:27.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.756+0000 7f4d3d324700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4d38073290 0x7f4d38075520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:27.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d3d324700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4d38073290 0x7f4d38075520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34766/0 (socket says 172.21.15.80:34766) 2019-11-28T11:29:27.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d3d324700 1 -- 172.21.15.80:0/3259702122 learned_addr learned my addr 172.21.15.80:0/3259702122 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:27.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d3db25700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d38148840 0x7f4d3812db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:27.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d3d324700 1 -- 172.21.15.80:0/3259702122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d38148840 msgr2=0x7f4d3812db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d3d324700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d38148840 0x7f4d3812db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:27.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d3d324700 1 -- 172.21.15.80:0/3259702122 >> v1:172.21.15.80:6789/0 conn(0x7f4d38075a60 legacy=0x7f4d38148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:27.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d3d324700 1 -- 172.21.15.80:0/3259702122 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3807ae50 con 0x7f4d38073290 2019-11-28T11:29:27.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d35ffb700 1 -- 172.21.15.80:0/3259702122 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496145650 0 0) 0x7f4d28001240 con 0x7f4d38075a60 2019-11-28T11:29:27.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d3db25700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d38148840 0x7f4d3812db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:27.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d3d324700 1 --2- 172.21.15.80:0/3259702122 >> v2:172.21.15.80:3300/0 conn(0x7f4d38073290 0x7f4d38075520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d20010760 tx=0x7f4d20010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d3d324700 1 --2- 172.21.15.80:0/3259702122 >> v2:172.21.15.80:3300/0 conn(0x7f4d38073290 0x7f4d38075520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d20010760 tx=0x7f4d20010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d3d324700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d38073290 0x7f4d38075520 secure :-1 s=READY pgs=758 cs=0 l=1 rx=0x7f4d20010760 tx=0x7f4d20010b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:27.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d3d324700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d38073290 0x7f4d38075520 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7f4d20010760 tx=0x7f4d20010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d35ffb700 1 -- 172.21.15.80:0/3259702122 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d20001010 con 0x7f4d38073290 2019-11-28T11:29:27.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d3d324700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d38073290 0x7f4d38075520 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7f4d20010760 tx=0x7f4d20010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d3d324700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d38073290 0x7f4d38075520 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7f4d20010760 tx=0x7f4d20010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d35ffb700 1 -- 172.21.15.80:0/3259702122 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d20001440 con 0x7f4d38073290 2019-11-28T11:29:27.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d3ed87700 1 -- 172.21.15.80:0/3259702122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3807b1d0 con 0x7f4d38073290 2019-11-28T11:29:27.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d35ffb700 1 -- 172.21.15.80:0/3259702122 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d20001a90 con 0x7f4d38073290 2019-11-28T11:29:27.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.757+0000 7f4d3ed87700 1 -- 172.21.15.80:0/3259702122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3807ae50 con 0x7f4d38073290 2019-11-28T11:29:27.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.758+0000 7f4d3d324700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d38073290 0x7f4d38075520 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7f4d20010760 tx=0x7f4d20010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.758+0000 7f4d35ffb700 1 -- 172.21.15.80:0/3259702122 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4d20001010 con 0x7f4d38073290 2019-11-28T11:29:27.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.758+0000 7f4d3d324700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d38073290 0x7f4d38075520 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7f4d20010760 tx=0x7f4d20010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.758+0000 7f4d35ffb700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d1c018730 0x7f4d1c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:27.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.758+0000 7f4d35ffb700 1 -- 172.21.15.80:0/3259702122 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4d20031e40 con 0x7f4d38073290 2019-11-28T11:29:27.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.758+0000 7f4d3cb23700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d1c018730 0x7f4d1c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:27.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.758+0000 7f4d3cb23700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d1c018730 0x7f4d1c01abc0 crc :-1 s=READY pgs=313 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.765+0000 7f4d3ed87700 1 -- 172.21.15.80:0/3259702122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3807b1d0 con 0x7f4d38073290 2019-11-28T11:29:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.769+0000 7f4d3d324700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d38073290 0x7f4d38075520 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7f4d20010760 tx=0x7f4d20010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.769+0000 7f4d35ffb700 1 -- 172.21.15.80:0/3259702122 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4d2002e400 con 0x7f4d38073290 2019-11-28T11:29:27.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:27.944+0000 7f4d3ed87700 1 -- 172.21.15.80:0/3259702122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f4d3807ae50 con 0x7f4d38073290 2019-11-28T11:29:28.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.634+0000 7f4d3d324700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d38073290 0x7f4d38075520 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7f4d20010760 tx=0x7f4d20010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:28.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.634+0000 7f4d35ffb700 1 -- 172.21.15.80:0/3259702122 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v35) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4d2002e400 con 0x7f4d38073290 2019-11-28T11:29:28.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.660+0000 7f4d3ed87700 1 -- 172.21.15.80:0/3259702122 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d1c018730 msgr2=0x7f4d1c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:28.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.660+0000 7f4d3ed87700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d1c018730 0x7f4d1c01abc0 crc :-1 s=READY pgs=313 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:28.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.660+0000 7f4d3ed87700 1 -- 172.21.15.80:0/3259702122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d38073290 msgr2=0x7f4d38075520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:28.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.660+0000 7f4d3ed87700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d38073290 0x7f4d38075520 secure :-1 s=READY pgs=758 cs=0 l=1 rx=0x7f4d20010760 tx=0x7f4d20010b00).stop 2019-11-28T11:29:28.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.661+0000 7f4d3ed87700 1 -- 172.21.15.80:0/3259702122 shutdown_connections 2019-11-28T11:29:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.661+0000 7f4d3ed87700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d1c018730 0x7f4d1c01abc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.661+0000 7f4d3ed87700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d38148840 0x7f4d3812db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.661+0000 7f4d3ed87700 1 --2- 172.21.15.80:0/3259702122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d38073290 0x7f4d38075520 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.661+0000 7f4d3ed87700 1 -- 172.21.15.80:0/3259702122 shutdown_connections 2019-11-28T11:29:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.661+0000 7f4d3ed87700 1 -- 172.21.15.80:0/3259702122 wait complete. 2019-11-28T11:29:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.661+0000 7f4d3ed87700 1 -- 172.21.15.80:0/3259702122 >> 172.21.15.80:0/3259702122 conn(0x7f4d38147670 msgr2=0x7f4d381641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:28.701 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:28.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.790+0000 7f6caa1e0700 1 Processor -- start 2019-11-28T11:29:28.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.790+0000 7f6caa1e0700 1 -- start start 2019-11-28T11:29:28.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6caa1e0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ca406c0a0 0x7f6ca4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:28.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6caa1e0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6ca4072620 0x7f6ca4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:28.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6caa1e0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca406db00 con 0x7f6ca40734e0 2019-11-28T11:29:28.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6caa1e0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca406fd60 con 0x7f6ca406c0a0 2019-11-28T11:29:28.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6caa1e0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca4070030 con 0x7f6ca4072620 2019-11-28T11:29:28.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ca406c0a0 0x7f6ca4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:28.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6c9bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6ca40734e0 0x7f6ca4071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34090/0 (socket says 172.21.15.80:34090) 2019-11-28T11:29:28.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6c9bfff700 1 -- 172.21.15.80:0/1822032509 learned_addr learned my addr 172.21.15.80:0/1822032509 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:28.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca8f7e700 1 --2- 172.21.15.80:0/1822032509 >> v2:172.21.15.174:3300/0 conn(0x7f6ca4072620 0x7f6ca4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:28.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca3fff700 1 -- 172.21.15.80:0/1822032509 >> v2:172.21.15.174:3300/0 conn(0x7f6ca4072620 msgr2=0x7f6ca4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:28.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1822032509 >> v2:172.21.15.174:3300/0 conn(0x7f6ca4072620 0x7f6ca4164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:28.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca3fff700 1 -- 172.21.15.80:0/1822032509 >> v1:172.21.15.80:6789/0 conn(0x7f6ca40734e0 legacy=0x7f6ca4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:28.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca37fe700 1 -- 172.21.15.80:0/1822032509 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466022046 0 0) 0x7f6c8c001150 con 0x7f6ca40734e0 2019-11-28T11:29:28.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca3fff700 1 -- 172.21.15.80:0/1822032509 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca40706c0 con 0x7f6ca406c0a0 2019-11-28T11:29:28.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca8f7e700 1 --2- 172.21.15.80:0/1822032509 >> v2:172.21.15.174:3300/0 conn(0x7f6ca4072620 0x7f6ca4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:29:28.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1822032509 >> v2:172.21.15.80:3300/0 conn(0x7f6ca406c0a0 0x7f6ca4072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6c9400af50 tx=0x7f6c9400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:28.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1822032509 >> v2:172.21.15.80:3300/0 conn(0x7f6ca406c0a0 0x7f6ca4072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6c9400af50 tx=0x7f6c9400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:28.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1822032509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca406c0a0 0x7f6ca4072fa0 secure :-1 s=READY pgs=760 cs=0 l=1 rx=0x7f6c9400af50 tx=0x7f6c9400b760).ready entity=mon.0 client_cookie=34220ea4ff576378 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:28.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1822032509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca406c0a0 0x7f6ca4072fa0 secure :-1 s=THROTTLE_DONE pgs=760 cs=0 l=1 rx=0x7f6c9400af50 tx=0x7f6c9400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:28.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca37fe700 1 -- 172.21.15.80:0/1822032509 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c94007210 con 0x7f6ca406c0a0 2019-11-28T11:29:28.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1822032509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca406c0a0 0x7f6ca4072fa0 secure :-1 s=THROTTLE_DONE pgs=760 cs=0 l=1 rx=0x7f6c9400af50 tx=0x7f6c9400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:28.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1822032509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca406c0a0 0x7f6ca4072fa0 secure :-1 s=THROTTLE_DONE pgs=760 cs=0 l=1 rx=0x7f6c9400af50 tx=0x7f6c9400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:28.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca37fe700 1 -- 172.21.15.80:0/1822032509 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c940099b0 con 0x7f6ca406c0a0 2019-11-28T11:29:28.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6ca37fe700 1 -- 172.21.15.80:0/1822032509 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c94009ba0 con 0x7f6ca406c0a0 2019-11-28T11:29:28.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6caa1e0700 1 -- 172.21.15.80:0/1822032509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca406c0a0 msgr2=0x7f6ca4072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:28.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.791+0000 7f6caa1e0700 1 --2- 172.21.15.80:0/1822032509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca406c0a0 0x7f6ca4072fa0 secure :-1 s=READY pgs=760 cs=0 l=1 rx=0x7f6c9400af50 tx=0x7f6c9400b760).stop 2019-11-28T11:29:28.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.792+0000 7f6caa1e0700 1 -- 172.21.15.80:0/1822032509 shutdown_connections 2019-11-28T11:29:28.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.792+0000 7f6caa1e0700 1 --2- 172.21.15.80:0/1822032509 >> v2:172.21.15.174:3300/0 conn(0x7f6ca4072620 0x7f6ca4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:28.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.792+0000 7f6caa1e0700 1 --2- 172.21.15.80:0/1822032509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca406c0a0 0x7f6ca4072fa0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:28.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.792+0000 7f6caa1e0700 1 -- 172.21.15.80:0/1822032509 shutdown_connections 2019-11-28T11:29:28.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.792+0000 7f6caa1e0700 1 -- 172.21.15.80:0/1822032509 wait complete. 2019-11-28T11:29:28.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.792+0000 7f6caa1e0700 1 -- 172.21.15.80:0/1822032509 >> 172.21.15.80:0/1822032509 conn(0x7f6ca4061cf0 msgr2=0x7f6ca4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.794+0000 7f6caa1e0700 1 Processor -- start 2019-11-28T11:29:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.795+0000 7f6caa1e0700 1 -- start start 2019-11-28T11:29:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.795+0000 7f6caa1e0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6ca413e5f0 0x7f6ca413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.795+0000 7f6caa1e0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ca410a070 0x7f6ca410bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.795+0000 7f6caa1e0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca41066e0 con 0x7f6ca410a4e0 2019-11-28T11:29:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.795+0000 7f6caa1e0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca410e060 con 0x7f6ca413e5f0 2019-11-28T11:29:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.795+0000 7f6caa1e0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca410e330 con 0x7f6ca410a070 2019-11-28T11:29:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.795+0000 7f6ca8f7e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6ca410a4e0 0x7f6ca410c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34098/0 (socket says 172.21.15.80:34098) 2019-11-28T11:29:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.795+0000 7f6ca8f7e700 1 -- 172.21.15.80:0/1457475574 learned_addr learned my addr 172.21.15.80:0/1457475574 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1457475574 >> v2:172.21.15.174:3300/0 conn(0x7f6ca413e5f0 0x7f6ca413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6c9bfff700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ca410a070 0x7f6ca410bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6ca17fa700 1 -- 172.21.15.80:0/1457475574 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567958505 0 0) 0x7f6c9c009e90 con 0x7f6ca410a4e0 2019-11-28T11:29:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6ca17fa700 1 -- 172.21.15.80:0/1457475574 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c88002e80 con 0x7f6ca410a4e0 2019-11-28T11:29:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6ca3fff700 1 -- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ca410a070 msgr2=0x7f6ca410bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ca410a070 0x7f6ca410bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6ca3fff700 1 -- 172.21.15.80:0/1457475574 >> v1:172.21.15.80:6789/0 conn(0x7f6ca410a4e0 legacy=0x7f6ca410c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6ca3fff700 1 -- 172.21.15.80:0/1457475574 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca410e9c0 con 0x7f6ca413e5f0 2019-11-28T11:29:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1457475574 >> v2:172.21.15.174:3300/0 conn(0x7f6ca413e5f0 0x7f6ca413e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6c94010330 tx=0x7f6c940106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:28.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1457475574 >> v2:172.21.15.174:3300/0 conn(0x7f6ca413e5f0 0x7f6ca413e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6c94010330 tx=0x7f6c940106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:28.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca413e5f0 0x7f6ca413e9e0 secure :-1 s=READY pgs=448 cs=0 l=1 rx=0x7f6c94010330 tx=0x7f6c940106d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:28.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca413e5f0 0x7f6ca413e9e0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7f6c94010330 tx=0x7f6c940106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:28.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6ca17fa700 1 -- 172.21.15.80:0/1457475574 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c94000940 con 0x7f6ca413e5f0 2019-11-28T11:29:28.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca413e5f0 0x7f6ca413e9e0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7f6c94010330 tx=0x7f6c940106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:28.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca413e5f0 0x7f6ca413e9e0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7f6c94010330 tx=0x7f6c940106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:28.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6ca17fa700 1 -- 172.21.15.80:0/1457475574 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c94009770 con 0x7f6ca413e5f0 2019-11-28T11:29:28.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6caa1e0700 1 -- 172.21.15.80:0/1457475574 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca410ed40 con 0x7f6ca413e5f0 2019-11-28T11:29:28.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6ca17fa700 1 -- 172.21.15.80:0/1457475574 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c94009ec0 con 0x7f6ca413e5f0 2019-11-28T11:29:28.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.796+0000 7f6caa1e0700 1 -- 172.21.15.80:0/1457475574 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca410e9c0 con 0x7f6ca413e5f0 2019-11-28T11:29:28.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.797+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca413e5f0 0x7f6ca413e9e0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7f6c94010330 tx=0x7f6c940106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:28.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.797+0000 7f6ca17fa700 1 -- 172.21.15.80:0/1457475574 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6c94009960 con 0x7f6ca413e5f0 2019-11-28T11:29:28.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.797+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca413e5f0 0x7f6ca413e9e0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7f6c94010330 tx=0x7f6c940106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:28.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.797+0000 7f6ca17fa700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c88018770 0x7f6c8801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:28.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.797+0000 7f6ca17fa700 1 -- 172.21.15.80:0/1457475574 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6c94031a40 con 0x7f6ca413e5f0 2019-11-28T11:29:28.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.797+0000 7f6c9bfff700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c88018770 0x7f6c8801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:28.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.797+0000 7f6c9bfff700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c88018770 0x7f6c8801abe0 crc :-1 s=READY pgs=314 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:28.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.806+0000 7f6caa1e0700 1 -- 172.21.15.80:0/1457475574 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca410ed40 con 0x7f6ca413e5f0 2019-11-28T11:29:28.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.809+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca413e5f0 0x7f6ca413e9e0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7f6c94010330 tx=0x7f6c940106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:28.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.809+0000 7f6ca17fa700 1 -- 172.21.15.80:0/1457475574 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6c9400b3d0 con 0x7f6ca413e5f0 2019-11-28T11:29:29.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.982+0000 7f6caa1e0700 1 -- 172.21.15.80:0/1457475574 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ca410e9c0 con 0x7f6ca413e5f0 2019-11-28T11:29:29.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.982+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca413e5f0 0x7f6ca413e9e0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7f6c94010330 tx=0x7f6c940106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.982+0000 7f6ca17fa700 1 -- 172.21.15.80:0/1457475574 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+1424 (secure 0 0 0) 0x7f6c940179d0 con 0x7f6ca413e5f0 2019-11-28T11:29:29.015 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 35 2019-11-28T11:29:29.016 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:29.016 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:29:26.954212+0000","modified":"2019-11-28T11:29:28.628047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2019-11-28T11:29:29.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.985+0000 7f6caa1e0700 1 -- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c88018770 msgr2=0x7f6c8801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.985+0000 7f6caa1e0700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c88018770 0x7f6c8801abe0 crc :-1 s=READY pgs=314 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.985+0000 7f6caa1e0700 1 -- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca413e5f0 msgr2=0x7f6ca413e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.985+0000 7f6caa1e0700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca413e5f0 0x7f6ca413e9e0 secure :-1 s=READY pgs=448 cs=0 l=1 rx=0x7f6c94010330 tx=0x7f6c940106d0).stop 2019-11-28T11:29:29.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.985+0000 7f6caa1e0700 1 -- 172.21.15.80:0/1457475574 shutdown_connections 2019-11-28T11:29:29.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.985+0000 7f6caa1e0700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c88018770 0x7f6c8801abe0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.985+0000 7f6caa1e0700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ca410a070 0x7f6ca410bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.985+0000 7f6caa1e0700 1 --2- 172.21.15.80:0/1457475574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca413e5f0 0x7f6ca413e9e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.985+0000 7f6caa1e0700 1 -- 172.21.15.80:0/1457475574 shutdown_connections 2019-11-28T11:29:29.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.985+0000 7f6caa1e0700 1 -- 172.21.15.80:0/1457475574 wait complete. 2019-11-28T11:29:29.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:28.985+0000 7f6caa1e0700 1 -- 172.21.15.80:0/1457475574 >> 172.21.15.80:0/1457475574 conn(0x7f6ca413d620 msgr2=0x7f6ca413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:29.027 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:29:29.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.119+0000 7ff4259fb700 1 Processor -- start 2019-11-28T11:29:29.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.119+0000 7ff4259fb700 1 -- start start 2019-11-28T11:29:29.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.120+0000 7ff4259fb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff42006c0a0 0x7ff420072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:29.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.120+0000 7ff4259fb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff4200734e0 0x7ff420071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:29.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.120+0000 7ff4259fb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42006db00 con 0x7ff420072360 2019-11-28T11:29:29.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.120+0000 7ff4259fb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42006f330 con 0x7ff4200734e0 2019-11-28T11:29:29.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.120+0000 7ff4259fb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4200706c0 con 0x7ff42006c0a0 2019-11-28T11:29:29.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.120+0000 7ff41ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff420072360 0x7ff42006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34104/0 (socket says 172.21.15.80:34104) 2019-11-28T11:29:29.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.120+0000 7ff41ffff700 1 -- 172.21.15.80:0/3734300505 learned_addr learned my addr 172.21.15.80:0/3734300505 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:29.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41f7fe700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff42006c0a0 0x7ff420072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41effd700 1 --2- 172.21.15.80:0/3734300505 >> v2:172.21.15.174:3300/0 conn(0x7ff4200734e0 0x7ff420071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41e7fc700 1 -- 172.21.15.80:0/3734300505 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708133092 0 0) 0x7ff4180014d0 con 0x7ff420072360 2019-11-28T11:29:29.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41e7fc700 1 -- 172.21.15.80:0/3734300505 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff400002e80 con 0x7ff420072360 2019-11-28T11:29:29.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41e7fc700 1 -- 172.21.15.80:0/3734300505 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 66362946 0 0) 0x7ff4180014b0 con 0x7ff420072360 2019-11-28T11:29:29.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41e7fc700 1 -- 172.21.15.80:0/3734300505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff42006c0a0 msgr2=0x7ff420072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:29.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41e7fc700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff42006c0a0 0x7ff420072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:29.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41e7fc700 1 -- 172.21.15.80:0/3734300505 >> v2:172.21.15.174:3300/0 conn(0x7ff4200734e0 msgr2=0x7ff420071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:29.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41e7fc700 1 --2- 172.21.15.80:0/3734300505 >> v2:172.21.15.174:3300/0 conn(0x7ff4200734e0 0x7ff420071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:29.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41e7fc700 1 -- 172.21.15.80:0/3734300505 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff420070a40 con 0x7ff420072360 2019-11-28T11:29:29.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41e7fc700 1 -- 172.21.15.80:0/3734300505 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff4180019e0 con 0x7ff420072360 2019-11-28T11:29:29.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41e7fc700 1 -- 172.21.15.80:0/3734300505 >> v1:172.21.15.80:6789/0 conn(0x7ff420072360 legacy=0x7ff42006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41e7fc700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4000479e0 0x7ff400049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:29.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41e7fc700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff40004a5c0 0x7ff40004ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:29.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41e7fc700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff40004d270 0x7ff40004f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:29.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41e7fc700 1 -- 172.21.15.80:0/3734300505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40004ff50 con 0x7ff40004d270 2019-11-28T11:29:29.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41e7fc700 1 -- 172.21.15.80:0/3734300505 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff400050140 con 0x7ff40004a5c0 2019-11-28T11:29:29.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41e7fc700 1 -- 172.21.15.80:0/3734300505 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff400050370 con 0x7ff4000479e0 2019-11-28T11:29:29.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41ffff700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff40004d270 0x7ff40004f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41f7fe700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4000479e0 0x7ff400049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.121+0000 7ff41effd700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff40004a5c0 0x7ff40004ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff41ffff700 1 -- 172.21.15.80:0/3734300505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4000479e0 msgr2=0x7ff400049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:29.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff41ffff700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4000479e0 0x7ff400049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:29.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff41ffff700 1 -- 172.21.15.80:0/3734300505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff40004a5c0 msgr2=0x7ff40004ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:29.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff41ffff700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff40004a5c0 0x7ff40004ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:29.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff41ffff700 1 -- 172.21.15.80:0/3734300505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff400050620 con 0x7ff40004d270 2019-11-28T11:29:29.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff41ffff700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff40004d270 0x7ff40004f740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff41800fc10 tx=0x7ff41800fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff41ffff700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff40004d270 0x7ff40004f740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff41800fc10 tx=0x7ff41800fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff41ffff700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff40004d270 0x7ff40004f740 secure :-1 s=READY pgs=763 cs=0 l=1 rx=0x7ff41800fc10 tx=0x7ff41800fb10).ready entity=mon.0 client_cookie=ab64b12e11cb922 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:29.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff41ffff700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff40004d270 0x7ff40004f740 secure :-1 s=THROTTLE_DONE pgs=763 cs=0 l=1 rx=0x7ff41800fc10 tx=0x7ff41800fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff41e7fc700 1 -- 172.21.15.80:0/3734300505 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4180014b0 con 0x7ff40004d270 2019-11-28T11:29:29.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff41ffff700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff40004d270 0x7ff40004f740 secure :-1 s=THROTTLE_DONE pgs=763 cs=0 l=1 rx=0x7ff41800fc10 tx=0x7ff41800fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff41ffff700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff40004d270 0x7ff40004f740 secure :-1 s=THROTTLE_DONE pgs=763 cs=0 l=1 rx=0x7ff41800fc10 tx=0x7ff41800fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff41e7fc700 1 -- 172.21.15.80:0/3734300505 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4180045c0 con 0x7ff40004d270 2019-11-28T11:29:29.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff41e7fc700 1 -- 172.21.15.80:0/3734300505 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff418004cd0 con 0x7ff40004d270 2019-11-28T11:29:29.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff4259fb700 1 -- 172.21.15.80:0/3734300505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff40004d270 msgr2=0x7ff40004f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff4259fb700 1 --2- 172.21.15.80:0/3734300505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff40004d270 0x7ff40004f740 secure :-1 s=READY pgs=763 cs=0 l=1 rx=0x7ff41800fc10 tx=0x7ff41800fb10).stop 2019-11-28T11:29:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff41ffff700 1 -- 172.21.15.80:0/3734300505 reap_dead start 2019-11-28T11:29:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff4259fb700 1 -- 172.21.15.80:0/3734300505 shutdown_connections 2019-11-28T11:29:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff4259fb700 1 -- 172.21.15.80:0/3734300505 shutdown_connections 2019-11-28T11:29:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff4259fb700 1 -- 172.21.15.80:0/3734300505 wait complete. 2019-11-28T11:29:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.122+0000 7ff4259fb700 1 -- 172.21.15.80:0/3734300505 >> 172.21.15.80:0/3734300505 conn(0x7ff420061cf0 msgr2=0x7ff420064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.125+0000 7ff4259fb700 1 Processor -- start 2019-11-28T11:29:29.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.125+0000 7ff4259fb700 1 -- start start 2019-11-28T11:29:29.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff4259fb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff420107940 0x7ff42010f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:29.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff4259fb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff42010f7a0 0x7ff4201629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:29.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff4259fb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff420107110 con 0x7ff42013fb20 2019-11-28T11:29:29.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff4259fb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42013b5e0 con 0x7ff42010f7a0 2019-11-28T11:29:29.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff4259fb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42013b8b0 con 0x7ff420107940 2019-11-28T11:29:29.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff41ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff42010f7a0 0x7ff4201629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff41ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff42010f7a0 0x7ff4201629f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34800/0 (socket says 172.21.15.80:34800) 2019-11-28T11:29:29.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff41ffff700 1 -- 172.21.15.80:0/4122138793 learned_addr learned my addr 172.21.15.80:0/4122138793 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:29.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff41effd700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff420107940 0x7ff42010f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff41ffff700 1 -- 172.21.15.80:0/4122138793 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff420107940 msgr2=0x7ff42010f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff41ffff700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff420107940 0x7ff42010f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff41ffff700 1 -- 172.21.15.80:0/4122138793 >> v1:172.21.15.174:6789/0 conn(0x7ff42013fb20 legacy=0x7ff4201080b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff417fff700 1 -- 172.21.15.80:0/4122138793 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 784822997 0 0) 0x7ff410000c90 con 0x7ff42013fb20 2019-11-28T11:29:29.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff41ffff700 1 -- 172.21.15.80:0/4122138793 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42013bf40 con 0x7ff42010f7a0 2019-11-28T11:29:29.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff41ffff700 1 --2- 172.21.15.80:0/4122138793 >> v2:172.21.15.80:3300/0 conn(0x7ff42010f7a0 0x7ff4201629f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff418010740 tx=0x7ff418010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff41ffff700 1 --2- 172.21.15.80:0/4122138793 >> v2:172.21.15.80:3300/0 conn(0x7ff42010f7a0 0x7ff4201629f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff418010740 tx=0x7ff418010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.126+0000 7ff41ffff700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42010f7a0 0x7ff4201629f0 secure :-1 s=READY pgs=764 cs=0 l=1 rx=0x7ff418010740 tx=0x7ff418010ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:29.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.127+0000 7ff41ffff700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42010f7a0 0x7ff4201629f0 secure :-1 s=THROTTLE_DONE pgs=764 cs=0 l=1 rx=0x7ff418010740 tx=0x7ff418010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.127+0000 7ff417fff700 1 -- 172.21.15.80:0/4122138793 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff41800f900 con 0x7ff42010f7a0 2019-11-28T11:29:29.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.127+0000 7ff41ffff700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42010f7a0 0x7ff4201629f0 secure :-1 s=THROTTLE_DONE pgs=764 cs=0 l=1 rx=0x7ff418010740 tx=0x7ff418010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.127+0000 7ff41ffff700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42010f7a0 0x7ff4201629f0 secure :-1 s=THROTTLE_DONE pgs=764 cs=0 l=1 rx=0x7ff418010740 tx=0x7ff418010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.127+0000 7ff417fff700 1 -- 172.21.15.80:0/4122138793 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff418001270 con 0x7ff42010f7a0 2019-11-28T11:29:29.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.127+0000 7ff4259fb700 1 -- 172.21.15.80:0/4122138793 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42010dea0 con 0x7ff42010f7a0 2019-11-28T11:29:29.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.127+0000 7ff417fff700 1 -- 172.21.15.80:0/4122138793 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff41800f900 con 0x7ff42010f7a0 2019-11-28T11:29:29.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.127+0000 7ff4259fb700 1 -- 172.21.15.80:0/4122138793 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42013bf40 con 0x7ff42010f7a0 2019-11-28T11:29:29.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.127+0000 7ff41ffff700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42010f7a0 0x7ff4201629f0 secure :-1 s=THROTTLE_DONE pgs=764 cs=0 l=1 rx=0x7ff418010740 tx=0x7ff418010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.127+0000 7ff417fff700 1 -- 172.21.15.80:0/4122138793 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff4180045c0 con 0x7ff42010f7a0 2019-11-28T11:29:29.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.127+0000 7ff41ffff700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42010f7a0 0x7ff4201629f0 secure :-1 s=THROTTLE_DONE pgs=764 cs=0 l=1 rx=0x7ff418010740 tx=0x7ff418010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.127+0000 7ff417fff700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff3f8018730 0x7ff3f801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:29.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.127+0000 7ff417fff700 1 -- 172.21.15.80:0/4122138793 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff418031ef0 con 0x7ff42010f7a0 2019-11-28T11:29:29.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.128+0000 7ff41f7fe700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff3f8018730 0x7ff3f801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.128+0000 7ff41f7fe700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff3f8018730 0x7ff3f801abc0 crc :-1 s=READY pgs=315 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:29.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.135+0000 7ff4259fb700 1 -- 172.21.15.80:0/4122138793 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42010dea0 con 0x7ff42010f7a0 2019-11-28T11:29:29.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.138+0000 7ff41ffff700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42010f7a0 0x7ff4201629f0 secure :-1 s=THROTTLE_DONE pgs=764 cs=0 l=1 rx=0x7ff418010740 tx=0x7ff418010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.138+0000 7ff417fff700 1 -- 172.21.15.80:0/4122138793 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff418000cc0 con 0x7ff42010f7a0 2019-11-28T11:29:29.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.314+0000 7ff4259fb700 1 -- 172.21.15.80:0/4122138793 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff42013bf40 con 0x7ff42010f7a0 2019-11-28T11:29:29.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.315+0000 7ff41ffff700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42010f7a0 0x7ff4201629f0 secure :-1 s=THROTTLE_DONE pgs=764 cs=0 l=1 rx=0x7ff418010740 tx=0x7ff418010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.315+0000 7ff417fff700 1 -- 172.21.15.80:0/4122138793 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+14860 (secure 0 0 0) 0x7ff4180045c0 con 0x7ff42010f7a0 2019-11-28T11:29:29.346 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:29.346 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":67,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:29:27.955377+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:29:25.290976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2019-11-28T11:29:25.980441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:29:29.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.317+0000 7ff4259fb700 1 -- 172.21.15.80:0/4122138793 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff3f8018730 msgr2=0x7ff3f801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.317+0000 7ff4259fb700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff3f8018730 0x7ff3f801abc0 crc :-1 s=READY pgs=315 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.317+0000 7ff4259fb700 1 -- 172.21.15.80:0/4122138793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42010f7a0 msgr2=0x7ff4201629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.317+0000 7ff4259fb700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42010f7a0 0x7ff4201629f0 secure :-1 s=READY pgs=764 cs=0 l=1 rx=0x7ff418010740 tx=0x7ff418010ae0).stop 2019-11-28T11:29:29.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.317+0000 7ff4259fb700 1 -- 172.21.15.80:0/4122138793 shutdown_connections 2019-11-28T11:29:29.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.317+0000 7ff4259fb700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff42010f7a0 0x7ff4201629f0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.317+0000 7ff4259fb700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff420107940 0x7ff42010f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.317+0000 7ff4259fb700 1 --2- 172.21.15.80:0/4122138793 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff3f8018730 0x7ff3f801abc0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.317+0000 7ff4259fb700 1 -- 172.21.15.80:0/4122138793 shutdown_connections 2019-11-28T11:29:29.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.317+0000 7ff4259fb700 1 -- 172.21.15.80:0/4122138793 wait complete. 2019-11-28T11:29:29.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.317+0000 7ff4259fb700 1 -- 172.21.15.80:0/4122138793 >> 172.21.15.80:0/4122138793 conn(0x7ff420142090 msgr2=0x7ff42010ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:29.358 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:29:29.358 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:29:29.359 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:29:29.359 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:29:29.359 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:29:29.359 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:29:29.363 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:29:29.364 DEBUG:teuthology.parallel:result is None 2019-11-28T11:29:29.365 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:29:29.365 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:29:29.365 DEBUG:teuthology.parallel:result is None 2019-11-28T11:29:29.366 DEBUG:teuthology.parallel:result is None 2019-11-28T11:29:29.366 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:29:29.449 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:29:29.454 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:29:29.454 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:29:29.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.472+0000 7fc08a0f2700 1 Processor -- start 2019-11-28T11:29:29.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.472+0000 7fc08a0f2700 1 -- start start 2019-11-28T11:29:29.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.473+0000 7fc08a0f2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc08415ed10 0x7fc08415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:29.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.473+0000 7fc08a0f2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08406db60 con 0x7fc084073020 2019-11-28T11:29:29.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.473+0000 7fc08a0f2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08406e060 con 0x7fc0840734b0 2019-11-28T11:29:29.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.473+0000 7fc08a0f2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08406f3d0 con 0x7fc08415ed10 2019-11-28T11:29:29.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc07bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc084073020 0x7fc084071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34150/0 (socket says 172.21.15.80:34150) 2019-11-28T11:29:29.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc07bfff700 1 -- 172.21.15.80:0/3993869599 learned_addr learned my addr 172.21.15.80:0/3993869599 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:29.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc083fff700 1 --2- 172.21.15.80:0/3993869599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc08415ed10 0x7fc08415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc0837fe700 1 -- 172.21.15.80:0/3993869599 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869228477 0 0) 0x7fc07c001400 con 0x7fc0840734b0 2019-11-28T11:29:29.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc0837fe700 1 -- 172.21.15.80:0/3993869599 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc064002e80 con 0x7fc0840734b0 2019-11-28T11:29:29.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc0837fe700 1 -- 172.21.15.80:0/3993869599 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3881900667 0 0) 0x7fc06c001070 con 0x7fc084073020 2019-11-28T11:29:29.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc0837fe700 1 -- 172.21.15.80:0/3993869599 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc064004170 con 0x7fc084073020 2019-11-28T11:29:29.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc083fff700 1 -- 172.21.15.80:0/3993869599 >> v1:172.21.15.174:6789/0 conn(0x7fc0840734b0 legacy=0x7fc0840726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc083fff700 1 -- 172.21.15.80:0/3993869599 >> v1:172.21.15.80:6789/0 conn(0x7fc084073020 legacy=0x7fc084071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc083fff700 1 -- 172.21.15.80:0/3993869599 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc084070760 con 0x7fc08415ed10 2019-11-28T11:29:29.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc083fff700 1 --2- 172.21.15.80:0/3993869599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc08415ed10 0x7fc08415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc07400af50 tx=0x7fc07400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc083fff700 1 --2- 172.21.15.80:0/3993869599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc08415ed10 0x7fc08415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc07400af50 tx=0x7fc07400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc083fff700 1 --2- 172.21.15.80:0/3993869599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc08415ed10 0x7fc08415f100 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7fc07400af50 tx=0x7fc07400b760).ready entity=mon.2 client_cookie=5b23ba50a0acb280 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:29.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc083fff700 1 --2- 172.21.15.80:0/3993869599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc08415ed10 0x7fc08415f100 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fc07400af50 tx=0x7fc07400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc0837fe700 1 -- 172.21.15.80:0/3993869599 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc074000960 con 0x7fc08415ed10 2019-11-28T11:29:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc083fff700 1 --2- 172.21.15.80:0/3993869599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc08415ed10 0x7fc08415f100 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fc07400af50 tx=0x7fc07400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc083fff700 1 --2- 172.21.15.80:0/3993869599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc08415ed10 0x7fc08415f100 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fc07400af50 tx=0x7fc07400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc0837fe700 1 -- 172.21.15.80:0/3993869599 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc074009860 con 0x7fc08415ed10 2019-11-28T11:29:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc0837fe700 1 -- 172.21.15.80:0/3993869599 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc074000960 con 0x7fc08415ed10 2019-11-28T11:29:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc08a0f2700 1 -- 172.21.15.80:0/3993869599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc08415ed10 msgr2=0x7fc08415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.474+0000 7fc08a0f2700 1 --2- 172.21.15.80:0/3993869599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc08415ed10 0x7fc08415f100 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7fc07400af50 tx=0x7fc07400b760).stop 2019-11-28T11:29:29.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.475+0000 7fc08a0f2700 1 -- 172.21.15.80:0/3993869599 shutdown_connections 2019-11-28T11:29:29.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.475+0000 7fc08a0f2700 1 --2- 172.21.15.80:0/3993869599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc08415ed10 0x7fc08415f100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.475+0000 7fc08a0f2700 1 -- 172.21.15.80:0/3993869599 shutdown_connections 2019-11-28T11:29:29.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.475+0000 7fc08a0f2700 1 -- 172.21.15.80:0/3993869599 wait complete. 2019-11-28T11:29:29.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.475+0000 7fc08a0f2700 1 -- 172.21.15.80:0/3993869599 >> 172.21.15.80:0/3993869599 conn(0x7fc084061d40 msgr2=0x7fc0840641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.478+0000 7fc08a0f2700 1 Processor -- start 2019-11-28T11:29:29.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.478+0000 7fc08a0f2700 1 -- start start 2019-11-28T11:29:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.478+0000 7fc08a0f2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc084127e50 0x7fc0841282e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.478+0000 7fc08a0f2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc084112d80 0x7fc084113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.478+0000 7fc08a0f2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc084148aa0 con 0x7fc0841486b0 2019-11-28T11:29:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.478+0000 7fc08a0f2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc084156b70 con 0x7fc084127e50 2019-11-28T11:29:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.478+0000 7fc08a0f2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc084156e40 con 0x7fc084112d80 2019-11-28T11:29:29.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc083fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc0841486b0 0x7fc084113f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34152/0 (socket says 172.21.15.80:34152) 2019-11-28T11:29:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc083fff700 1 -- 172.21.15.80:0/1912392585 learned_addr learned my addr 172.21.15.80:0/1912392585 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc07bfff700 1 --2- 172.21.15.80:0/1912392585 >> v2:172.21.15.174:3300/0 conn(0x7fc084127e50 0x7fc0841282e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc088e90700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc084112d80 0x7fc084113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc0817fa700 1 -- 172.21.15.80:0/1912392585 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337967872 0 0) 0x7fc07400b3d0 con 0x7fc0841486b0 2019-11-28T11:29:29.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc0817fa700 1 -- 172.21.15.80:0/1912392585 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc05c002e80 con 0x7fc0841486b0 2019-11-28T11:29:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc07bfff700 1 -- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc084112d80 msgr2=0x7fc084113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc07bfff700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc084112d80 0x7fc084113220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc07bfff700 1 -- 172.21.15.80:0/1912392585 >> v1:172.21.15.80:6789/0 conn(0x7fc0841486b0 legacy=0x7fc084113f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc07bfff700 1 -- 172.21.15.80:0/1912392585 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0841574d0 con 0x7fc084127e50 2019-11-28T11:29:29.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc088e90700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc084112d80 0x7fc084113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:29.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc07bfff700 1 --2- 172.21.15.80:0/1912392585 >> v2:172.21.15.174:3300/0 conn(0x7fc084127e50 0x7fc0841282e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc06c010330 tx=0x7fc06c0106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc07bfff700 1 --2- 172.21.15.80:0/1912392585 >> v2:172.21.15.174:3300/0 conn(0x7fc084127e50 0x7fc0841282e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc06c010330 tx=0x7fc06c0106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc07bfff700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc084127e50 0x7fc0841282e0 secure :-1 s=READY pgs=457 cs=0 l=1 rx=0x7fc06c010330 tx=0x7fc06c0106d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:29.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc07bfff700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc084127e50 0x7fc0841282e0 secure :-1 s=THROTTLE_DONE pgs=457 cs=0 l=1 rx=0x7fc06c010330 tx=0x7fc06c0106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc0817fa700 1 -- 172.21.15.80:0/1912392585 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc06c0041d0 con 0x7fc084127e50 2019-11-28T11:29:29.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc07bfff700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc084127e50 0x7fc0841282e0 secure :-1 s=THROTTLE_DONE pgs=457 cs=0 l=1 rx=0x7fc06c010330 tx=0x7fc06c0106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc07bfff700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc084127e50 0x7fc0841282e0 secure :-1 s=THROTTLE_DONE pgs=457 cs=0 l=1 rx=0x7fc06c010330 tx=0x7fc06c0106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc0817fa700 1 -- 172.21.15.80:0/1912392585 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c000960 con 0x7fc084127e50 2019-11-28T11:29:29.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc08a0f2700 1 -- 172.21.15.80:0/1912392585 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc084157850 con 0x7fc084127e50 2019-11-28T11:29:29.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc0817fa700 1 -- 172.21.15.80:0/1912392585 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc06c0047b0 con 0x7fc084127e50 2019-11-28T11:29:29.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.479+0000 7fc08a0f2700 1 -- 172.21.15.80:0/1912392585 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0841574d0 con 0x7fc084127e50 2019-11-28T11:29:29.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.480+0000 7fc07bfff700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc084127e50 0x7fc0841282e0 secure :-1 s=THROTTLE_DONE pgs=457 cs=0 l=1 rx=0x7fc06c010330 tx=0x7fc06c0106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.480+0000 7fc0817fa700 1 -- 172.21.15.80:0/1912392585 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc06c003fe0 con 0x7fc084127e50 2019-11-28T11:29:29.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.480+0000 7fc07bfff700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc084127e50 0x7fc0841282e0 secure :-1 s=THROTTLE_DONE pgs=457 cs=0 l=1 rx=0x7fc06c010330 tx=0x7fc06c0106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.480+0000 7fc0817fa700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc05c018770 0x7fc05c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:29.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.480+0000 7fc0817fa700 1 -- 172.21.15.80:0/1912392585 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc06c031a00 con 0x7fc084127e50 2019-11-28T11:29:29.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.480+0000 7fc083fff700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc05c018770 0x7fc05c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.480+0000 7fc083fff700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc05c018770 0x7fc05c01abe0 crc :-1 s=READY pgs=316 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:29.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.488+0000 7fc08a0f2700 1 -- 172.21.15.80:0/1912392585 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc084157850 con 0x7fc084127e50 2019-11-28T11:29:29.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.492+0000 7fc07bfff700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc084127e50 0x7fc0841282e0 secure :-1 s=THROTTLE_DONE pgs=457 cs=0 l=1 rx=0x7fc06c010330 tx=0x7fc06c0106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.492+0000 7fc0817fa700 1 -- 172.21.15.80:0/1912392585 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc06c020fb0 con 0x7fc084127e50 2019-11-28T11:29:29.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.663+0000 7fc08a0f2700 1 -- 172.21.15.80:0/1912392585 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc0841574d0 con 0x7fc084127e50 2019-11-28T11:29:29.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.667+0000 7fc07bfff700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc084127e50 0x7fc0841282e0 secure :-1 s=THROTTLE_DONE pgs=457 cs=0 l=1 rx=0x7fc06c010330 tx=0x7fc06c0106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.667+0000 7fc0817fa700 1 -- 172.21.15.80:0/1912392585 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v24) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc06c020fb0 con 0x7fc084127e50 2019-11-28T11:29:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:29:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.673+0000 7fc08a0f2700 1 -- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc05c018770 msgr2=0x7fc05c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.673+0000 7fc08a0f2700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc05c018770 0x7fc05c01abe0 crc :-1 s=READY pgs=316 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.673+0000 7fc08a0f2700 1 -- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc084127e50 msgr2=0x7fc0841282e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.673+0000 7fc08a0f2700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc084127e50 0x7fc0841282e0 secure :-1 s=READY pgs=457 cs=0 l=1 rx=0x7fc06c010330 tx=0x7fc06c0106d0).stop 2019-11-28T11:29:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.673+0000 7fc08a0f2700 1 -- 172.21.15.80:0/1912392585 shutdown_connections 2019-11-28T11:29:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.673+0000 7fc08a0f2700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc05c018770 0x7fc05c01abe0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.673+0000 7fc08a0f2700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc084112d80 0x7fc084113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.673+0000 7fc08a0f2700 1 --2- 172.21.15.80:0/1912392585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc084127e50 0x7fc0841282e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.673+0000 7fc08a0f2700 1 -- 172.21.15.80:0/1912392585 shutdown_connections 2019-11-28T11:29:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.673+0000 7fc08a0f2700 1 -- 172.21.15.80:0/1912392585 wait complete. 2019-11-28T11:29:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.673+0000 7fc08a0f2700 1 -- 172.21.15.80:0/1912392585 >> 172.21.15.80:0/1912392585 conn(0x7fc084166610 msgr2=0x7fc0841473d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:29.713 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:29:29.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.814+0000 7f37cee4a700 1 Processor -- start 2019-11-28T11:29:29.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.815+0000 7f37cee4a700 1 -- start start 2019-11-28T11:29:29.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cee4a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f37c815ed10 0x7f37c815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:29.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cee4a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c80734b0 0x7f37c80726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:29.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cee4a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c806db60 con 0x7f37c8073020 2019-11-28T11:29:29.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cee4a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c806fe00 con 0x7f37c815ed10 2019-11-28T11:29:29.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cee4a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c80700d0 con 0x7f37c80734b0 2019-11-28T11:29:29.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cd3e7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f37c815ed10 0x7f37c815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cd3e7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f37c815ed10 0x7f37c815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34844/0 (socket says 172.21.15.80:34844) 2019-11-28T11:29:29.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cd3e7700 1 -- 172.21.15.80:0/102418144 learned_addr learned my addr 172.21.15.80:0/102418144 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:29.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cdbe8700 1 --2- 172.21.15.80:0/102418144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c80734b0 0x7f37c80726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cd3e7700 1 -- 172.21.15.80:0/102418144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c80734b0 msgr2=0x7f37c80726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:29.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/102418144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c80734b0 0x7f37c80726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:29.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cd3e7700 1 -- 172.21.15.80:0/102418144 >> v1:172.21.15.174:6789/0 conn(0x7f37c8073020 legacy=0x7f37c8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cd3e7700 1 -- 172.21.15.80:0/102418144 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c8070760 con 0x7f37c815ed10 2019-11-28T11:29:29.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/102418144 >> v2:172.21.15.80:3300/0 conn(0x7f37c815ed10 0x7f37c815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f37b800f6c0 tx=0x7f37b800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/102418144 >> v2:172.21.15.80:3300/0 conn(0x7f37c815ed10 0x7f37c815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f37b800f6c0 tx=0x7f37b800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/102418144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c815ed10 0x7f37c815f100 secure :-1 s=READY pgs=774 cs=0 l=1 rx=0x7f37b800f6c0 tx=0x7f37b800fa60).ready entity=mon.0 client_cookie=99aa14dbf3d904c2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:29.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/102418144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c815ed10 0x7f37c815f100 secure :-1 s=THROTTLE_DONE pgs=774 cs=0 l=1 rx=0x7f37b800f6c0 tx=0x7f37b800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37bffff700 1 -- 172.21.15.80:0/102418144 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b8000960 con 0x7f37c815ed10 2019-11-28T11:29:29.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/102418144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c815ed10 0x7f37c815f100 secure :-1 s=THROTTLE_DONE pgs=774 cs=0 l=1 rx=0x7f37b800f6c0 tx=0x7f37b800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/102418144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c815ed10 0x7f37c815f100 secure :-1 s=THROTTLE_DONE pgs=774 cs=0 l=1 rx=0x7f37b800f6c0 tx=0x7f37b800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.816+0000 7f37bffff700 1 -- 172.21.15.80:0/102418144 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b8000c90 con 0x7f37c815ed10 2019-11-28T11:29:29.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.817+0000 7f37bffff700 1 -- 172.21.15.80:0/102418144 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b80013a0 con 0x7f37c815ed10 2019-11-28T11:29:29.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.817+0000 7f37cee4a700 1 -- 172.21.15.80:0/102418144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c815ed10 msgr2=0x7f37c815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.817+0000 7f37cee4a700 1 --2- 172.21.15.80:0/102418144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c815ed10 0x7f37c815f100 secure :-1 s=READY pgs=774 cs=0 l=1 rx=0x7f37b800f6c0 tx=0x7f37b800fa60).stop 2019-11-28T11:29:29.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.817+0000 7f37cee4a700 1 -- 172.21.15.80:0/102418144 shutdown_connections 2019-11-28T11:29:29.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.817+0000 7f37cee4a700 1 --2- 172.21.15.80:0/102418144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c80734b0 0x7f37c80726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:29.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.817+0000 7f37cee4a700 1 --2- 172.21.15.80:0/102418144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c815ed10 0x7f37c815f100 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.817+0000 7f37cee4a700 1 -- 172.21.15.80:0/102418144 shutdown_connections 2019-11-28T11:29:29.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.817+0000 7f37cee4a700 1 -- 172.21.15.80:0/102418144 wait complete. 2019-11-28T11:29:29.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.817+0000 7f37cee4a700 1 -- 172.21.15.80:0/102418144 >> 172.21.15.80:0/102418144 conn(0x7f37c8061d40 msgr2=0x7f37c80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:29.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.820+0000 7f37cee4a700 1 Processor -- start 2019-11-28T11:29:29.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.820+0000 7f37cee4a700 1 -- start start 2019-11-28T11:29:29.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37cee4a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f37c8114f60 0x7f37c8106b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:29.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37cee4a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c81070d0 0x7f37c812e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:29.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37cee4a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c8130b20 con 0x7f37c812e6e0 2019-11-28T11:29:29.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37cee4a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c8148b60 con 0x7f37c8114f60 2019-11-28T11:29:29.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37cee4a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c8148e30 con 0x7f37c81070d0 2019-11-28T11:29:29.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37cd3e7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f37c8114f60 0x7f37c8106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37cd3e7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f37c8114f60 0x7f37c8106b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34850/0 (socket says 172.21.15.80:34850) 2019-11-28T11:29:29.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37cd3e7700 1 -- 172.21.15.80:0/2377252587 learned_addr learned my addr 172.21.15.80:0/2377252587 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:29.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37ccbe6700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c81070d0 0x7f37c812e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37cd3e7700 1 -- 172.21.15.80:0/2377252587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c81070d0 msgr2=0x7f37c812e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c81070d0 0x7f37c812e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:29.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37cd3e7700 1 -- 172.21.15.80:0/2377252587 >> v1:172.21.15.174:6789/0 conn(0x7f37c812e6e0 legacy=0x7f37c8152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:29.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37cd3e7700 1 -- 172.21.15.80:0/2377252587 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c8104390 con 0x7f37c8114f60 2019-11-28T11:29:29.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/2377252587 >> v2:172.21.15.80:3300/0 conn(0x7f37c8114f60 0x7f37c8106b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f37b8010440 tx=0x7f37b80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/2377252587 >> v2:172.21.15.80:3300/0 conn(0x7f37c8114f60 0x7f37c8106b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f37b8010440 tx=0x7f37b80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c8114f60 0x7f37c8106b90 secure :-1 s=READY pgs=775 cs=0 l=1 rx=0x7f37b8010440 tx=0x7f37b80102f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:29.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c8114f60 0x7f37c8106b90 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7f37b8010440 tx=0x7f37b80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.821+0000 7f37bdffb700 1 -- 172.21.15.80:0/2377252587 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b8000940 con 0x7f37c8114f60 2019-11-28T11:29:29.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.822+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c8114f60 0x7f37c8106b90 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7f37b8010440 tx=0x7f37b80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.822+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c8114f60 0x7f37c8106b90 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7f37b8010440 tx=0x7f37b80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.822+0000 7f37bdffb700 1 -- 172.21.15.80:0/2377252587 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b8000f50 con 0x7f37c8114f60 2019-11-28T11:29:29.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.822+0000 7f37cee4a700 1 -- 172.21.15.80:0/2377252587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c8104710 con 0x7f37c8114f60 2019-11-28T11:29:29.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.822+0000 7f37bdffb700 1 -- 172.21.15.80:0/2377252587 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b80015a0 con 0x7f37c8114f60 2019-11-28T11:29:29.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.822+0000 7f37cee4a700 1 -- 172.21.15.80:0/2377252587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c8104390 con 0x7f37c8114f60 2019-11-28T11:29:29.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.822+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c8114f60 0x7f37c8106b90 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7f37b8010440 tx=0x7f37b80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.822+0000 7f37bdffb700 1 -- 172.21.15.80:0/2377252587 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f37b8001140 con 0x7f37c8114f60 2019-11-28T11:29:29.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.822+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c8114f60 0x7f37c8106b90 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7f37b8010440 tx=0x7f37b80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.822+0000 7f37bdffb700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f37a8018730 0x7f37a801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:29.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.822+0000 7f37bdffb700 1 -- 172.21.15.80:0/2377252587 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f37b8031a90 con 0x7f37c8114f60 2019-11-28T11:29:29.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.822+0000 7f37ccbe6700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f37a8018730 0x7f37a801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:29.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.823+0000 7f37ccbe6700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f37a8018730 0x7f37a801abc0 crc :-1 s=READY pgs=317 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:29.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.830+0000 7f37cee4a700 1 -- 172.21.15.80:0/2377252587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c8104710 con 0x7f37c8114f60 2019-11-28T11:29:29.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.833+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c8114f60 0x7f37c8106b90 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7f37b8010440 tx=0x7f37b80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:29.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:29.833+0000 7f37bdffb700 1 -- 172.21.15.80:0/2377252587 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f37b8000b30 con 0x7f37c8114f60 2019-11-28T11:29:30.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.004+0000 7f37cee4a700 1 -- 172.21.15.80:0/2377252587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f37c8104390 con 0x7f37c8114f60 2019-11-28T11:29:30.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.007+0000 7f37cd3e7700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c8114f60 0x7f37c8106b90 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7f37b8010440 tx=0x7f37b80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.007+0000 7f37bdffb700 1 -- 172.21.15.80:0/2377252587 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v25) v1 ==== 184+0+0 (secure 0 0 0) 0x7f37b8017430 con 0x7f37c8114f60 2019-11-28T11:29:30.041 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:29:30.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.013+0000 7f37cee4a700 1 -- 172.21.15.80:0/2377252587 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f37a8018730 msgr2=0x7f37a801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.013+0000 7f37cee4a700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f37a8018730 0x7f37a801abc0 crc :-1 s=READY pgs=317 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.013+0000 7f37cee4a700 1 -- 172.21.15.80:0/2377252587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c8114f60 msgr2=0x7f37c8106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.013+0000 7f37cee4a700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c8114f60 0x7f37c8106b90 secure :-1 s=READY pgs=775 cs=0 l=1 rx=0x7f37b8010440 tx=0x7f37b80102f0).stop 2019-11-28T11:29:30.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.013+0000 7f37cee4a700 1 -- 172.21.15.80:0/2377252587 shutdown_connections 2019-11-28T11:29:30.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.013+0000 7f37cee4a700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f37a8018730 0x7f37a801abc0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.013+0000 7f37cee4a700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c81070d0 0x7f37c812e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.013+0000 7f37cee4a700 1 --2- 172.21.15.80:0/2377252587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37c8114f60 0x7f37c8106b90 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.013+0000 7f37cee4a700 1 -- 172.21.15.80:0/2377252587 shutdown_connections 2019-11-28T11:29:30.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.013+0000 7f37cee4a700 1 -- 172.21.15.80:0/2377252587 wait complete. 2019-11-28T11:29:30.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.013+0000 7f37cee4a700 1 -- 172.21.15.80:0/2377252587 >> 172.21.15.80:0/2377252587 conn(0x7f37c81476e0 msgr2=0x7f37c812fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:30.053 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:29:30.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.174+0000 7f9fa2217700 1 Processor -- start 2019-11-28T11:29:30.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.174+0000 7f9fa2217700 1 -- start start 2019-11-28T11:29:30.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.175+0000 7f9fa2217700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9f9c15f100 0x7f9f9c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:30.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.175+0000 7f9fa2217700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9f9c06c2f0 0x7f9f9c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:30.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.175+0000 7f9fa2217700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c06db60 con 0x7f9f9c15ed10 2019-11-28T11:29:30.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.175+0000 7f9fa2217700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9c06fe00 con 0x7f9f9c06c2f0 2019-11-28T11:29:30.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.175+0000 7f9fa2217700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9c0700d0 con 0x7f9f9c15f100 2019-11-28T11:29:30.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.175+0000 7f9fa0fb5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9f9c06c2f0 0x7f9f9c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:30.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9fa0fb5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9f9c06c2f0 0x7f9f9c06c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34862/0 (socket says 172.21.15.80:34862) 2019-11-28T11:29:30.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9fa0fb5700 1 -- 172.21.15.80:0/3233070681 learned_addr learned my addr 172.21.15.80:0/3233070681 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:30.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9f93fff700 1 --2- 172.21.15.80:0/3233070681 >> v2:172.21.15.174:3300/0 conn(0x7f9f9c15f100 0x7f9f9c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:30.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9fa0fb5700 1 -- 172.21.15.80:0/3233070681 >> v2:172.21.15.174:3300/0 conn(0x7f9f9c15f100 msgr2=0x7f9f9c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:30.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9fa0fb5700 1 --2- 172.21.15.80:0/3233070681 >> v2:172.21.15.174:3300/0 conn(0x7f9f9c15f100 0x7f9f9c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:30.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9fa0fb5700 1 -- 172.21.15.80:0/3233070681 >> v1:172.21.15.174:6789/0 conn(0x7f9f9c15ed10 legacy=0x7f9f9c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:30.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9fa0fb5700 1 -- 172.21.15.80:0/3233070681 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c070760 con 0x7f9f9c06c2f0 2019-11-28T11:29:30.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9fa0fb5700 1 --2- 172.21.15.80:0/3233070681 >> v2:172.21.15.80:3300/0 conn(0x7f9f9c06c2f0 0x7f9f9c06c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9f9400fab0 tx=0x7f9f940080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9fa0fb5700 1 --2- 172.21.15.80:0/3233070681 >> v2:172.21.15.80:3300/0 conn(0x7f9f9c06c2f0 0x7f9f9c06c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9f9400fab0 tx=0x7f9f940080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9fa0fb5700 1 --2- 172.21.15.80:0/3233070681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f9c06c2f0 0x7f9f9c06c770 secure :-1 s=READY pgs=776 cs=0 l=1 rx=0x7f9f9400fab0 tx=0x7f9f940080d0).ready entity=mon.0 client_cookie=93ecaf1760060692 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:30.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9fa0fb5700 1 --2- 172.21.15.80:0/3233070681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f9c06c2f0 0x7f9f9c06c770 secure :-1 s=THROTTLE_DONE pgs=776 cs=0 l=1 rx=0x7f9f9400fab0 tx=0x7f9f940080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9fa0fb5700 1 --2- 172.21.15.80:0/3233070681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f9c06c2f0 0x7f9f9c06c770 secure :-1 s=THROTTLE_DONE pgs=776 cs=0 l=1 rx=0x7f9f9400fab0 tx=0x7f9f940080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9f9b7fe700 1 -- 172.21.15.80:0/3233070681 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f94000df0 con 0x7f9f9c06c2f0 2019-11-28T11:29:30.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9fa0fb5700 1 --2- 172.21.15.80:0/3233070681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f9c06c2f0 0x7f9f9c06c770 secure :-1 s=THROTTLE_DONE pgs=776 cs=0 l=1 rx=0x7f9f9400fab0 tx=0x7f9f940080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9f9b7fe700 1 -- 172.21.15.80:0/3233070681 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f94001460 con 0x7f9f9c06c2f0 2019-11-28T11:29:30.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9f9b7fe700 1 -- 172.21.15.80:0/3233070681 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f94001b30 con 0x7f9f9c06c2f0 2019-11-28T11:29:30.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9fa2217700 1 -- 172.21.15.80:0/3233070681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f9c06c2f0 msgr2=0x7f9f9c06c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.176+0000 7f9fa2217700 1 --2- 172.21.15.80:0/3233070681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f9c06c2f0 0x7f9f9c06c770 secure :-1 s=READY pgs=776 cs=0 l=1 rx=0x7f9f9400fab0 tx=0x7f9f940080d0).stop 2019-11-28T11:29:30.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.177+0000 7f9fa2217700 1 -- 172.21.15.80:0/3233070681 shutdown_connections 2019-11-28T11:29:30.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.177+0000 7f9fa2217700 1 --2- 172.21.15.80:0/3233070681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f9c06c2f0 0x7f9f9c06c770 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.177+0000 7f9fa2217700 1 --2- 172.21.15.80:0/3233070681 >> v2:172.21.15.174:3300/0 conn(0x7f9f9c15f100 0x7f9f9c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:30.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.177+0000 7f9fa2217700 1 -- 172.21.15.80:0/3233070681 shutdown_connections 2019-11-28T11:29:30.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.177+0000 7f9fa2217700 1 -- 172.21.15.80:0/3233070681 wait complete. 2019-11-28T11:29:30.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.177+0000 7f9fa2217700 1 -- 172.21.15.80:0/3233070681 >> 172.21.15.80:0/3233070681 conn(0x7f9f9c061d40 msgr2=0x7f9f9c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:30.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.179+0000 7f9fa2217700 1 Processor -- start 2019-11-28T11:29:30.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.179+0000 7f9fa2217700 1 -- start start 2019-11-28T11:29:30.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.180+0000 7f9fa2217700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f9c152750 0x7f9f9c135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:30.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.180+0000 7f9fa2217700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9f9c130dc0 0x7f9f9c131250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:30.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.180+0000 7f9fa2217700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c109d70 con 0x7f9f9c131790 2019-11-28T11:29:30.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.180+0000 7f9fa2217700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9c131c10 con 0x7f9f9c130dc0 2019-11-28T11:29:30.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.180+0000 7f9fa2217700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c10a460 con 0x7f9f9c152750 2019-11-28T11:29:30.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.180+0000 7f9f93fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9f9c130dc0 0x7f9f9c131250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:30.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.180+0000 7f9f9bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f9c152750 0x7f9f9c135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:30.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.180+0000 7f9fa0fb5700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f9f9c131790 0x7f9f9c134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:49728/0 (socket says 172.21.15.80:49728) 2019-11-28T11:29:30.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.180+0000 7f9f9bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f9c152750 0x7f9f9c135790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:37124/0 (socket says 172.21.15.80:37124) 2019-11-28T11:29:30.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.180+0000 7f9f93fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9f9c130dc0 0x7f9f9c131250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:49752/0 (socket says 172.21.15.80:49752) 2019-11-28T11:29:30.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.180+0000 7f9f9bfff700 1 -- 172.21.15.80:0/611306876 learned_addr learned my addr 172.21.15.80:0/611306876 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:30.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9f9bfff700 1 -- 172.21.15.80:0/611306876 >> v2:172.21.15.174:3300/0 conn(0x7f9f9c130dc0 msgr2=0x7f9f9c131250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9f9bfff700 1 --2- 172.21.15.80:0/611306876 >> v2:172.21.15.174:3300/0 conn(0x7f9f9c130dc0 0x7f9f9c131250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9f9bfff700 1 -- 172.21.15.80:0/611306876 >> v1:172.21.15.174:6789/0 conn(0x7f9f9c131790 legacy=0x7f9f9c134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9f9bfff700 1 -- 172.21.15.80:0/611306876 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c132ed0 con 0x7f9f9c152750 2019-11-28T11:29:30.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9f93fff700 1 --2- 172.21.15.80:0/611306876 >> v2:172.21.15.174:3300/0 conn(0x7f9f9c130dc0 0x7f9f9c131250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:30.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9f997fa700 1 -- 172.21.15.80:0/611306876 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250654782 0 0) 0x7f9f94007e10 con 0x7f9f9c131790 2019-11-28T11:29:30.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9f9bfff700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f9c152750 0x7f9f9c135790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f8c012600 tx=0x7f9f8c0129a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9f9bfff700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f9c152750 0x7f9f9c135790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f8c012600 tx=0x7f9f8c0129a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9f9bfff700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f9c152750 0x7f9f9c135790 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f9f8c012600 tx=0x7f9f8c0129a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:30.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9f9bfff700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f9c152750 0x7f9f9c135790 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f9f8c012600 tx=0x7f9f8c0129a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9f997fa700 1 -- 172.21.15.80:0/611306876 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f8c007210 con 0x7f9f9c152750 2019-11-28T11:29:30.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9f9bfff700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f9c152750 0x7f9f9c135790 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f9f8c012600 tx=0x7f9f8c0129a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9f9bfff700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f9c152750 0x7f9f9c135790 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f9f8c012600 tx=0x7f9f8c0129a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9f997fa700 1 -- 172.21.15.80:0/611306876 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c0053c0 con 0x7f9f9c152750 2019-11-28T11:29:30.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9f997fa700 1 -- 172.21.15.80:0/611306876 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f8c005a50 con 0x7f9f9c152750 2019-11-28T11:29:30.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9fa2217700 1 -- 172.21.15.80:0/611306876 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c133250 con 0x7f9f9c152750 2019-11-28T11:29:30.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.181+0000 7f9fa2217700 1 -- 172.21.15.80:0/611306876 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c132ed0 con 0x7f9f9c152750 2019-11-28T11:29:30.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.182+0000 7f9f9bfff700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f9c152750 0x7f9f9c135790 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f9f8c012600 tx=0x7f9f8c0129a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.182+0000 7f9f997fa700 1 -- 172.21.15.80:0/611306876 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9f8c0055b0 con 0x7f9f9c152750 2019-11-28T11:29:30.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.182+0000 7f9f9bfff700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f9c152750 0x7f9f9c135790 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f9f8c012600 tx=0x7f9f8c0129a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.182+0000 7f9f997fa700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f80018730 0x7f9f8001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:30.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.182+0000 7f9f997fa700 1 -- 172.21.15.80:0/611306876 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9f8c033cd0 con 0x7f9f9c152750 2019-11-28T11:29:30.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.182+0000 7f9f93fff700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f80018730 0x7f9f8001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:30.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.182+0000 7f9f93fff700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f80018730 0x7f9f8001abc0 crc :-1 s=READY pgs=318 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:30.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.189+0000 7f9fa2217700 1 -- 172.21.15.80:0/611306876 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9c133250 con 0x7f9f9c152750 2019-11-28T11:29:30.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.193+0000 7f9f9bfff700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f9c152750 0x7f9f9c135790 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f9f8c012600 tx=0x7f9f8c0129a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.193+0000 7f9f997fa700 1 -- 172.21.15.80:0/611306876 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9f8c0075b0 con 0x7f9f9c152750 2019-11-28T11:29:30.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.362+0000 7f9fa2217700 1 -- 172.21.15.80:0/611306876 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9f9c132ed0 con 0x7f9f9c152750 2019-11-28T11:29:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.365+0000 7f9f9bfff700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f9c152750 0x7f9f9c135790 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f9f8c012600 tx=0x7f9f8c0129a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.365+0000 7f9f997fa700 1 -- 172.21.15.80:0/611306876 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v26) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9f8c019670 con 0x7f9f9c152750 2019-11-28T11:29:30.398 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:29:30.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.371+0000 7f9fa2217700 1 -- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f80018730 msgr2=0x7f9f8001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.371+0000 7f9fa2217700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f80018730 0x7f9f8001abc0 crc :-1 s=READY pgs=318 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.371+0000 7f9fa2217700 1 -- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f9c152750 msgr2=0x7f9f9c135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.371+0000 7f9fa2217700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f9c152750 0x7f9f9c135790 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f9f8c012600 tx=0x7f9f8c0129a0).stop 2019-11-28T11:29:30.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.371+0000 7f9fa2217700 1 -- 172.21.15.80:0/611306876 shutdown_connections 2019-11-28T11:29:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.371+0000 7f9fa2217700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f80018730 0x7f9f8001abc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.371+0000 7f9fa2217700 1 --2- 172.21.15.80:0/611306876 >> v2:172.21.15.174:3300/0 conn(0x7f9f9c130dc0 0x7f9f9c131250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.371+0000 7f9fa2217700 1 --2- 172.21.15.80:0/611306876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f9c152750 0x7f9f9c135790 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.371+0000 7f9fa2217700 1 -- 172.21.15.80:0/611306876 shutdown_connections 2019-11-28T11:29:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.371+0000 7f9fa2217700 1 -- 172.21.15.80:0/611306876 wait complete. 2019-11-28T11:29:30.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.371+0000 7f9fa2217700 1 -- 172.21.15.80:0/611306876 >> 172.21.15.80:0/611306876 conn(0x7f9f9c1476e0 msgr2=0x7f9f9c12fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:30.413 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:29:30.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.523+0000 7f69996c2700 1 Processor -- start 2019-11-28T11:29:30.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.523+0000 7f69996c2700 1 -- start start 2019-11-28T11:29:30.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.524+0000 7f69996c2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f699415f100 0x7f699406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:30.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.524+0000 7f69996c2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f699406c2f0 0x7f699406c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:30.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.524+0000 7f69996c2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699406db60 con 0x7f699415ed10 2019-11-28T11:29:30.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.524+0000 7f69996c2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699406fe00 con 0x7f699415f100 2019-11-28T11:29:30.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.524+0000 7f69996c2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69940700d0 con 0x7f699406c2f0 2019-11-28T11:29:30.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.524+0000 7f6992ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f699415f100 0x7f699406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:30.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.524+0000 7f6992ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f699415f100 0x7f699406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34876/0 (socket says 172.21.15.80:34876) 2019-11-28T11:29:30.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.524+0000 7f6992ffd700 1 -- 172.21.15.80:0/2331655687 learned_addr learned my addr 172.21.15.80:0/2331655687 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:30.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.524+0000 7f69937fe700 1 --1- 172.21.15.80:0/2331655687 >> v1:172.21.15.80:6789/0 conn(0x7f699415ed10 0x7f6994073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34188/0 (socket says 172.21.15.80:34188) 2019-11-28T11:29:30.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f6993fff700 1 --2- 172.21.15.80:0/2331655687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f699406c2f0 0x7f699406c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:30.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f6992ffd700 1 -- 172.21.15.80:0/2331655687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f699406c2f0 msgr2=0x7f699406c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:30.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2331655687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f699406c2f0 0x7f699406c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:30.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f6992ffd700 1 -- 172.21.15.80:0/2331655687 >> v1:172.21.15.80:6789/0 conn(0x7f699415ed10 legacy=0x7f6994073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f6992ffd700 1 -- 172.21.15.80:0/2331655687 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6994070760 con 0x7f699415f100 2019-11-28T11:29:30.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f69927fc700 1 -- 172.21.15.80:0/2331655687 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 883563540 0 0) 0x7f6984001480 con 0x7f699415ed10 2019-11-28T11:29:30.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f6993fff700 1 --2- 172.21.15.80:0/2331655687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f699406c2f0 0x7f699406c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:29:30.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2331655687 >> v2:172.21.15.80:3300/0 conn(0x7f699415f100 0x7f699406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f697c00f740 tx=0x7f697c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2331655687 >> v2:172.21.15.80:3300/0 conn(0x7f699415f100 0x7f699406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f697c00f740 tx=0x7f697c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2331655687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415f100 0x7f699406bdb0 secure :-1 s=READY pgs=778 cs=0 l=1 rx=0x7f697c00f740 tx=0x7f697c00fae0).ready entity=mon.0 client_cookie=2ecb64081afbb59c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:30.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2331655687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415f100 0x7f699406bdb0 secure :-1 s=THROTTLE_DONE pgs=778 cs=0 l=1 rx=0x7f697c00f740 tx=0x7f697c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f69927fc700 1 -- 172.21.15.80:0/2331655687 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f697c000960 con 0x7f699415f100 2019-11-28T11:29:30.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2331655687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415f100 0x7f699406bdb0 secure :-1 s=THROTTLE_DONE pgs=778 cs=0 l=1 rx=0x7f697c00f740 tx=0x7f697c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2331655687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415f100 0x7f699406bdb0 secure :-1 s=THROTTLE_DONE pgs=778 cs=0 l=1 rx=0x7f697c00f740 tx=0x7f697c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f69927fc700 1 -- 172.21.15.80:0/2331655687 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c000c90 con 0x7f699415f100 2019-11-28T11:29:30.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f69927fc700 1 -- 172.21.15.80:0/2331655687 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f697c0013a0 con 0x7f699415f100 2019-11-28T11:29:30.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f69996c2700 1 -- 172.21.15.80:0/2331655687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415f100 msgr2=0x7f699406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.525+0000 7f69996c2700 1 --2- 172.21.15.80:0/2331655687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415f100 0x7f699406bdb0 secure :-1 s=READY pgs=778 cs=0 l=1 rx=0x7f697c00f740 tx=0x7f697c00fae0).stop 2019-11-28T11:29:30.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.526+0000 7f69996c2700 1 -- 172.21.15.80:0/2331655687 shutdown_connections 2019-11-28T11:29:30.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.526+0000 7f69996c2700 1 --2- 172.21.15.80:0/2331655687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f699406c2f0 0x7f699406c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:30.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.526+0000 7f69996c2700 1 --2- 172.21.15.80:0/2331655687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415f100 0x7f699406bdb0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.526+0000 7f69996c2700 1 -- 172.21.15.80:0/2331655687 shutdown_connections 2019-11-28T11:29:30.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.526+0000 7f69996c2700 1 -- 172.21.15.80:0/2331655687 wait complete. 2019-11-28T11:29:30.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.526+0000 7f69996c2700 1 -- 172.21.15.80:0/2331655687 >> 172.21.15.80:0/2331655687 conn(0x7f6994061d40 msgr2=0x7f69940641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:30.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.528+0000 7f69996c2700 1 Processor -- start 2019-11-28T11:29:30.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.528+0000 7f69996c2700 1 -- start start 2019-11-28T11:29:30.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.529+0000 7f69996c2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6994152a40 0x7f699415a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:30.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.529+0000 7f69996c2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f699415ab70 0x7f69941480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:30.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.529+0000 7f69996c2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6994153290 con 0x7f69941485f0 2019-11-28T11:29:30.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.529+0000 7f69996c2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699410a4a0 con 0x7f699415ab70 2019-11-28T11:29:30.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.529+0000 7f69996c2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6994113ca0 con 0x7f6994152a40 2019-11-28T11:29:30.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.529+0000 7f6992ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f699415ab70 0x7f69941480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:30.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.529+0000 7f6992ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f699415ab70 0x7f69941480b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34882/0 (socket says 172.21.15.80:34882) 2019-11-28T11:29:30.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.529+0000 7f6992ffd700 1 -- 172.21.15.80:0/2769044261 learned_addr learned my addr 172.21.15.80:0/2769044261 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:30.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.529+0000 7f69937fe700 1 --2- 172.21.15.80:0/2769044261 >> v2:172.21.15.174:3300/0 conn(0x7f6994152a40 0x7f699415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:30.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.529+0000 7f6992ffd700 1 -- 172.21.15.80:0/2769044261 >> v2:172.21.15.174:3300/0 conn(0x7f6994152a40 msgr2=0x7f699415a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.529+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2769044261 >> v2:172.21.15.174:3300/0 conn(0x7f6994152a40 0x7f699415a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.529+0000 7f6992ffd700 1 -- 172.21.15.80:0/2769044261 >> v1:172.21.15.174:6789/0 conn(0x7f69941485f0 legacy=0x7f69941594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.529+0000 7f6992ffd700 1 -- 172.21.15.80:0/2769044261 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6994114330 con 0x7f699415ab70 2019-11-28T11:29:30.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.530+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2769044261 >> v2:172.21.15.80:3300/0 conn(0x7f699415ab70 0x7f69941480b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f697c010460 tx=0x7f697c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.530+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2769044261 >> v2:172.21.15.80:3300/0 conn(0x7f699415ab70 0x7f69941480b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f697c010460 tx=0x7f697c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.530+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2769044261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415ab70 0x7f69941480b0 secure :-1 s=READY pgs=779 cs=0 l=1 rx=0x7f697c010460 tx=0x7f697c010310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:30.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.530+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2769044261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415ab70 0x7f69941480b0 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7f697c010460 tx=0x7f697c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.530+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2769044261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415ab70 0x7f69941480b0 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7f697c010460 tx=0x7f697c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.530+0000 7f698bfff700 1 -- 172.21.15.80:0/2769044261 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f697c000940 con 0x7f699415ab70 2019-11-28T11:29:30.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.530+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2769044261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415ab70 0x7f69941480b0 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7f697c010460 tx=0x7f697c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.530+0000 7f698bfff700 1 -- 172.21.15.80:0/2769044261 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c000f50 con 0x7f699415ab70 2019-11-28T11:29:30.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.530+0000 7f69996c2700 1 -- 172.21.15.80:0/2769044261 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69941146b0 con 0x7f699415ab70 2019-11-28T11:29:30.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.530+0000 7f698bfff700 1 -- 172.21.15.80:0/2769044261 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f697c001620 con 0x7f699415ab70 2019-11-28T11:29:30.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.530+0000 7f69996c2700 1 -- 172.21.15.80:0/2769044261 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6994115790 con 0x7f699415ab70 2019-11-28T11:29:30.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.530+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2769044261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415ab70 0x7f69941480b0 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7f697c010460 tx=0x7f697c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.530+0000 7f698bfff700 1 -- 172.21.15.80:0/2769044261 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f697c001140 con 0x7f699415ab70 2019-11-28T11:29:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.530+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2769044261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415ab70 0x7f69941480b0 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7f697c010460 tx=0x7f697c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.530+0000 7f698bfff700 1 --2- 172.21.15.80:0/2769044261 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f696c018730 0x7f696c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.531+0000 7f698bfff700 1 -- 172.21.15.80:0/2769044261 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f697c031ad0 con 0x7f699415ab70 2019-11-28T11:29:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.531+0000 7f69937fe700 1 --2- 172.21.15.80:0/2769044261 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f696c018730 0x7f696c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.531+0000 7f69937fe700 1 --2- 172.21.15.80:0/2769044261 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f696c018730 0x7f696c01abc0 crc :-1 s=READY pgs=319 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.539+0000 7f69996c2700 1 -- 172.21.15.80:0/2769044261 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6994114330 con 0x7f699415ab70 2019-11-28T11:29:30.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.542+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2769044261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415ab70 0x7f69941480b0 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7f697c010460 tx=0x7f697c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.542+0000 7f698bfff700 1 -- 172.21.15.80:0/2769044261 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f697c000b50 con 0x7f699415ab70 2019-11-28T11:29:30.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.713+0000 7f69996c2700 1 -- 172.21.15.80:0/2769044261 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f69941146b0 con 0x7f699415ab70 2019-11-28T11:29:30.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.716+0000 7f6992ffd700 1 --2- 172.21.15.80:0/2769044261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415ab70 0x7f69941480b0 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7f697c010460 tx=0x7f697c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.716+0000 7f698bfff700 1 -- 172.21.15.80:0/2769044261 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v27) v1 ==== 184+0+0 (secure 0 0 0) 0x7f697c017450 con 0x7f699415ab70 2019-11-28T11:29:30.746 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:29:30.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.718+0000 7f69996c2700 1 -- 172.21.15.80:0/2769044261 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f696c018730 msgr2=0x7f696c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.718+0000 7f69996c2700 1 --2- 172.21.15.80:0/2769044261 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f696c018730 0x7f696c01abc0 crc :-1 s=READY pgs=319 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.718+0000 7f69996c2700 1 -- 172.21.15.80:0/2769044261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415ab70 msgr2=0x7f69941480b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.718+0000 7f69996c2700 1 --2- 172.21.15.80:0/2769044261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415ab70 0x7f69941480b0 secure :-1 s=READY pgs=779 cs=0 l=1 rx=0x7f697c010460 tx=0x7f697c010310).stop 2019-11-28T11:29:30.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.719+0000 7f69996c2700 1 -- 172.21.15.80:0/2769044261 shutdown_connections 2019-11-28T11:29:30.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.719+0000 7f69996c2700 1 --2- 172.21.15.80:0/2769044261 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f696c018730 0x7f696c01abc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.719+0000 7f69996c2700 1 --2- 172.21.15.80:0/2769044261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f699415ab70 0x7f69941480b0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.719+0000 7f69996c2700 1 --2- 172.21.15.80:0/2769044261 >> v2:172.21.15.174:3300/0 conn(0x7f6994152a40 0x7f699415a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.719+0000 7f69996c2700 1 -- 172.21.15.80:0/2769044261 shutdown_connections 2019-11-28T11:29:30.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.719+0000 7f69996c2700 1 -- 172.21.15.80:0/2769044261 wait complete. 2019-11-28T11:29:30.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.719+0000 7f69996c2700 1 -- 172.21.15.80:0/2769044261 >> 172.21.15.80:0/2769044261 conn(0x7f69941476e0 msgr2=0x7f699412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:30.758 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:30.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.845+0000 7f3bfd0dc700 1 Processor -- start 2019-11-28T11:29:30.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.845+0000 7f3bfd0dc700 1 -- start start 2019-11-28T11:29:30.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.846+0000 7f3bfd0dc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bf806c0a0 0x7f3bf8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:30.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.846+0000 7f3bfd0dc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3bf8072620 0x7f3bf8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:30.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.846+0000 7f3bfd0dc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf806db00 con 0x7f3bf80734e0 2019-11-28T11:29:30.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.846+0000 7f3bfd0dc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf806fd60 con 0x7f3bf806c0a0 2019-11-28T11:29:30.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.846+0000 7f3bfd0dc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf8070030 con 0x7f3bf8072620 2019-11-28T11:29:30.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.846+0000 7f3bf759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bf806c0a0 0x7f3bf8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:30.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.846+0000 7f3bf6d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3bf80734e0 0x7f3bf8071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34206/0 (socket says 172.21.15.80:34206) 2019-11-28T11:29:30.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bf6d9d700 1 -- 172.21.15.80:0/3623623914 learned_addr learned my addr 172.21.15.80:0/3623623914 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:30.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bf759e700 1 --2- 172.21.15.80:0/3623623914 >> v2:172.21.15.80:3300/0 conn(0x7f3bf806c0a0 0x7f3bf8072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34886/0 (socket says 172.21.15.80:34886) 2019-11-28T11:29:30.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bfc8db700 1 --2- 172.21.15.80:0/3623623914 >> v2:172.21.15.174:3300/0 conn(0x7f3bf8072620 0x7f3bf8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:30.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bf759e700 1 -- 172.21.15.80:0/3623623914 >> v2:172.21.15.174:3300/0 conn(0x7f3bf8072620 msgr2=0x7f3bf8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:30.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bf759e700 1 --2- 172.21.15.80:0/3623623914 >> v2:172.21.15.174:3300/0 conn(0x7f3bf8072620 0x7f3bf8164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:30.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bf759e700 1 -- 172.21.15.80:0/3623623914 >> v1:172.21.15.80:6789/0 conn(0x7f3bf80734e0 legacy=0x7f3bf8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bf759e700 1 -- 172.21.15.80:0/3623623914 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf80706c0 con 0x7f3bf806c0a0 2019-11-28T11:29:30.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bf659c700 1 -- 172.21.15.80:0/3623623914 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756154069 0 0) 0x7f3be00013f0 con 0x7f3bf80734e0 2019-11-28T11:29:30.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bf759e700 1 --2- 172.21.15.80:0/3623623914 >> v2:172.21.15.80:3300/0 conn(0x7f3bf806c0a0 0x7f3bf8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3be800af50 tx=0x7f3be800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bf759e700 1 --2- 172.21.15.80:0/3623623914 >> v2:172.21.15.80:3300/0 conn(0x7f3bf806c0a0 0x7f3bf8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3be800af50 tx=0x7f3be800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bf759e700 1 --2- 172.21.15.80:0/3623623914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf806c0a0 0x7f3bf8072fa0 secure :-1 s=READY pgs=781 cs=0 l=1 rx=0x7f3be800af50 tx=0x7f3be800b6e0).ready entity=mon.0 client_cookie=281d8f1cb8c7a02f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:30.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bf759e700 1 --2- 172.21.15.80:0/3623623914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf806c0a0 0x7f3bf8072fa0 secure :-1 s=THROTTLE_DONE pgs=781 cs=0 l=1 rx=0x7f3be800af50 tx=0x7f3be800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bf659c700 1 -- 172.21.15.80:0/3623623914 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3be8007210 con 0x7f3bf806c0a0 2019-11-28T11:29:30.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bf759e700 1 --2- 172.21.15.80:0/3623623914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf806c0a0 0x7f3bf8072fa0 secure :-1 s=THROTTLE_DONE pgs=781 cs=0 l=1 rx=0x7f3be800af50 tx=0x7f3be800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bf759e700 1 --2- 172.21.15.80:0/3623623914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf806c0a0 0x7f3bf8072fa0 secure :-1 s=THROTTLE_DONE pgs=781 cs=0 l=1 rx=0x7f3be800af50 tx=0x7f3be800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bf659c700 1 -- 172.21.15.80:0/3623623914 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be80099b0 con 0x7f3bf806c0a0 2019-11-28T11:29:30.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bf659c700 1 -- 172.21.15.80:0/3623623914 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3be800a080 con 0x7f3bf806c0a0 2019-11-28T11:29:30.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bfd0dc700 1 -- 172.21.15.80:0/3623623914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf806c0a0 msgr2=0x7f3bf8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.847+0000 7f3bfd0dc700 1 --2- 172.21.15.80:0/3623623914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf806c0a0 0x7f3bf8072fa0 secure :-1 s=READY pgs=781 cs=0 l=1 rx=0x7f3be800af50 tx=0x7f3be800b6e0).stop 2019-11-28T11:29:30.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.848+0000 7f3bfd0dc700 1 -- 172.21.15.80:0/3623623914 shutdown_connections 2019-11-28T11:29:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.848+0000 7f3bfd0dc700 1 --2- 172.21.15.80:0/3623623914 >> v2:172.21.15.174:3300/0 conn(0x7f3bf8072620 0x7f3bf8164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.848+0000 7f3bfd0dc700 1 --2- 172.21.15.80:0/3623623914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bf806c0a0 0x7f3bf8072fa0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.848+0000 7f3bfd0dc700 1 -- 172.21.15.80:0/3623623914 shutdown_connections 2019-11-28T11:29:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.848+0000 7f3bfd0dc700 1 -- 172.21.15.80:0/3623623914 wait complete. 2019-11-28T11:29:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.848+0000 7f3bfd0dc700 1 -- 172.21.15.80:0/3623623914 >> 172.21.15.80:0/3623623914 conn(0x7f3bf8061cf0 msgr2=0x7f3bf8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:30.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.850+0000 7f3bfd0dc700 1 Processor -- start 2019-11-28T11:29:30.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.850+0000 7f3bfd0dc700 1 -- start start 2019-11-28T11:29:30.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.851+0000 7f3bfd0dc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bf8104820 0x7f3bf810c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:30.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.851+0000 7f3bfd0dc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3bf810c890 0x7f3bf810b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:30.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.851+0000 7f3bfd0dc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf813bcd0 con 0x7f3bf810b710 2019-11-28T11:29:30.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.851+0000 7f3bfd0dc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf8108700 con 0x7f3bf810c890 2019-11-28T11:29:30.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.851+0000 7f3bfd0dc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf81081f0 con 0x7f3bf8104820 2019-11-28T11:29:30.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.851+0000 7f3bfc8db700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3bf810b710 0x7f3bf8104c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34210/0 (socket says 172.21.15.80:34210) 2019-11-28T11:29:30.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.851+0000 7f3bfc8db700 1 -- 172.21.15.80:0/2210138815 learned_addr learned my addr 172.21.15.80:0/2210138815 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:30.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.851+0000 7f3bf759e700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bf8104820 0x7f3bf810c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:30.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.851+0000 7f3bf6d9d700 1 --2- 172.21.15.80:0/2210138815 >> v2:172.21.15.174:3300/0 conn(0x7f3bf810c890 0x7f3bf810b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:30.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3beffff700 1 -- 172.21.15.80:0/2210138815 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694632652 0 0) 0x7f3bf00057c0 con 0x7f3bf810b710 2019-11-28T11:29:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3beffff700 1 -- 172.21.15.80:0/2210138815 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bd0002e80 con 0x7f3bf810b710 2019-11-28T11:29:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3bf6d9d700 1 -- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bf8104820 msgr2=0x7f3bf810c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3bf6d9d700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bf8104820 0x7f3bf810c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3bf6d9d700 1 -- 172.21.15.80:0/2210138815 >> v1:172.21.15.80:6789/0 conn(0x7f3bf810b710 legacy=0x7f3bf8104c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3bf6d9d700 1 -- 172.21.15.80:0/2210138815 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf8109a90 con 0x7f3bf810c890 2019-11-28T11:29:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3bf759e700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bf8104820 0x7f3bf810c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3bf6d9d700 1 --2- 172.21.15.80:0/2210138815 >> v2:172.21.15.174:3300/0 conn(0x7f3bf810c890 0x7f3bf810b1d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3be00106b0 tx=0x7f3be0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3bf6d9d700 1 --2- 172.21.15.80:0/2210138815 >> v2:172.21.15.174:3300/0 conn(0x7f3bf810c890 0x7f3bf810b1d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3be00106b0 tx=0x7f3be0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3bf6d9d700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf810c890 0x7f3bf810b1d0 secure :-1 s=READY pgs=463 cs=0 l=1 rx=0x7f3be00106b0 tx=0x7f3be0010a50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3bf6d9d700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf810c890 0x7f3bf810b1d0 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f3be00106b0 tx=0x7f3be0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3beffff700 1 -- 172.21.15.80:0/2210138815 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3be00010d0 con 0x7f3bf810c890 2019-11-28T11:29:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3bf6d9d700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf810c890 0x7f3bf810b1d0 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f3be00106b0 tx=0x7f3be0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3bf6d9d700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf810c890 0x7f3bf810b1d0 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f3be00106b0 tx=0x7f3be0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3beffff700 1 -- 172.21.15.80:0/2210138815 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be0004550 con 0x7f3bf810c890 2019-11-28T11:29:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3bfd0dc700 1 -- 172.21.15.80:0/2210138815 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf8109e10 con 0x7f3bf810c890 2019-11-28T11:29:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3beffff700 1 -- 172.21.15.80:0/2210138815 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3be0004c20 con 0x7f3bf810c890 2019-11-28T11:29:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.852+0000 7f3bfd0dc700 1 -- 172.21.15.80:0/2210138815 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf8109a90 con 0x7f3bf810c890 2019-11-28T11:29:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.853+0000 7f3bf6d9d700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf810c890 0x7f3bf810b1d0 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f3be00106b0 tx=0x7f3be0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.853+0000 7f3beffff700 1 -- 172.21.15.80:0/2210138815 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3be0001090 con 0x7f3bf810c890 2019-11-28T11:29:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.853+0000 7f3bf6d9d700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf810c890 0x7f3bf810b1d0 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f3be00106b0 tx=0x7f3be0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.853+0000 7f3beffff700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3bd0018770 0x7f3bd001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.853+0000 7f3beffff700 1 -- 172.21.15.80:0/2210138815 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3be0031d30 con 0x7f3bf810c890 2019-11-28T11:29:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.853+0000 7f3bf759e700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3bd0018770 0x7f3bd001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.853+0000 7f3bf759e700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3bd0018770 0x7f3bd001abe0 crc :-1 s=READY pgs=320 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.861+0000 7f3bfd0dc700 1 -- 172.21.15.80:0/2210138815 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf8109e10 con 0x7f3bf810c890 2019-11-28T11:29:30.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.864+0000 7f3bf6d9d700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf810c890 0x7f3bf810b1d0 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f3be00106b0 tx=0x7f3be0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:30.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:30.864+0000 7f3beffff700 1 -- 172.21.15.80:0/2210138815 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3be0026570 con 0x7f3bf810c890 2019-11-28T11:29:31.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:31.040+0000 7f3bfd0dc700 1 -- 172.21.15.80:0/2210138815 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bf8109a90 con 0x7f3bf810c890 2019-11-28T11:29:31.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:31.040+0000 7f3bf6d9d700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf810c890 0x7f3bf810b1d0 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f3be00106b0 tx=0x7f3be0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:31.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:31.040+0000 7f3beffff700 1 -- 172.21.15.80:0/2210138815 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+1424 (secure 0 0 0) 0x7f3be0026570 con 0x7f3bf810c890 2019-11-28T11:29:31.072 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 35 2019-11-28T11:29:31.072 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:31.073 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:29:26.954212+0000","modified":"2019-11-28T11:29:28.628047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2019-11-28T11:29:31.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:31.043+0000 7f3bfd0dc700 1 -- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3bd0018770 msgr2=0x7f3bd001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:31.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:31.043+0000 7f3bfd0dc700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3bd0018770 0x7f3bd001abe0 crc :-1 s=READY pgs=320 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:31.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:31.043+0000 7f3bfd0dc700 1 -- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf810c890 msgr2=0x7f3bf810b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:31.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:31.043+0000 7f3bfd0dc700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf810c890 0x7f3bf810b1d0 secure :-1 s=READY pgs=463 cs=0 l=1 rx=0x7f3be00106b0 tx=0x7f3be0010a50).stop 2019-11-28T11:29:31.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:31.043+0000 7f3bfd0dc700 1 -- 172.21.15.80:0/2210138815 shutdown_connections 2019-11-28T11:29:31.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:31.043+0000 7f3bfd0dc700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3bd0018770 0x7f3bd001abe0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:31.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:31.043+0000 7f3bfd0dc700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf810c890 0x7f3bf810b1d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:31.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:31.043+0000 7f3bfd0dc700 1 --2- 172.21.15.80:0/2210138815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bf8104820 0x7f3bf810c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:31.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:31.043+0000 7f3bfd0dc700 1 -- 172.21.15.80:0/2210138815 shutdown_connections 2019-11-28T11:29:31.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:31.043+0000 7f3bfd0dc700 1 -- 172.21.15.80:0/2210138815 wait complete. 2019-11-28T11:29:31.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:31.043+0000 7f3bfd0dc700 1 -- 172.21.15.80:0/2210138815 >> 172.21.15.80:0/2210138815 conn(0x7f3bf813d620 msgr2=0x7f3bf813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:31.386 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 10, u'failed': [], u'epoch': 35, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [11], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:29:26.954212+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:29:28.628047+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:29:31.387 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:29:32.387 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:32.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.486+0000 7fb45b86a700 1 Processor -- start 2019-11-28T11:29:32.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.486+0000 7fb45b86a700 1 -- start start 2019-11-28T11:29:32.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.487+0000 7fb45b86a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb45406c490 0x7fb45406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:32.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.487+0000 7fb45b86a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45406db00 con 0x7fb45406ce60 2019-11-28T11:29:32.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.487+0000 7fb45b86a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45406e000 con 0x7fb45406c0a0 2019-11-28T11:29:32.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.487+0000 7fb45b86a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45406fd60 con 0x7fb45406c490 2019-11-28T11:29:32.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.487+0000 7fb459606700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb45406c490 0x7fb45406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:32.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.487+0000 7fb459606700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb45406c490 0x7fb45406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34902/0 (socket says 172.21.15.80:34902) 2019-11-28T11:29:32.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.487+0000 7fb459606700 1 -- 172.21.15.80:0/3012954313 learned_addr learned my addr 172.21.15.80:0/3012954313 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:32.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.487+0000 7fb45a608700 1 --1- 172.21.15.80:0/3012954313 >> v1:172.21.15.80:6789/0 conn(0x7fb45406ce60 0x7fb454164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34216/0 (socket says 172.21.15.80:34216) 2019-11-28T11:29:32.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.487+0000 7fb459606700 1 -- 172.21.15.80:0/3012954313 >> v1:172.21.15.174:6789/0 conn(0x7fb45406c0a0 legacy=0x7fb454072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:32.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.487+0000 7fb459606700 1 -- 172.21.15.80:0/3012954313 >> v1:172.21.15.80:6789/0 conn(0x7fb45406ce60 legacy=0x7fb454164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:32.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.487+0000 7fb459606700 1 -- 172.21.15.80:0/3012954313 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540706c0 con 0x7fb45406c490 2019-11-28T11:29:32.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.487+0000 7fb458e05700 1 -- 172.21.15.80:0/3012954313 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560928574 0 0) 0x7fb44c0009b0 con 0x7fb45406ce60 2019-11-28T11:29:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.487+0000 7fb459606700 1 --2- 172.21.15.80:0/3012954313 >> v2:172.21.15.80:3300/0 conn(0x7fb45406c490 0x7fb45406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb44800f740 tx=0x7fb44800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.487+0000 7fb459606700 1 --2- 172.21.15.80:0/3012954313 >> v2:172.21.15.80:3300/0 conn(0x7fb45406c490 0x7fb45406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb44800f740 tx=0x7fb44800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.488+0000 7fb459606700 1 --2- 172.21.15.80:0/3012954313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb45406c490 0x7fb45406c920 secure :-1 s=READY pgs=784 cs=0 l=1 rx=0x7fb44800f740 tx=0x7fb44800fae0).ready entity=mon.0 client_cookie=7fa27d970b3e9f76 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.488+0000 7fb459606700 1 --2- 172.21.15.80:0/3012954313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb45406c490 0x7fb45406c920 secure :-1 s=THROTTLE_DONE pgs=784 cs=0 l=1 rx=0x7fb44800f740 tx=0x7fb44800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.488+0000 7fb458e05700 1 -- 172.21.15.80:0/3012954313 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb448000960 con 0x7fb45406c490 2019-11-28T11:29:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.488+0000 7fb459606700 1 --2- 172.21.15.80:0/3012954313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb45406c490 0x7fb45406c920 secure :-1 s=THROTTLE_DONE pgs=784 cs=0 l=1 rx=0x7fb44800f740 tx=0x7fb44800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:32.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.488+0000 7fb459606700 1 --2- 172.21.15.80:0/3012954313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb45406c490 0x7fb45406c920 secure :-1 s=THROTTLE_DONE pgs=784 cs=0 l=1 rx=0x7fb44800f740 tx=0x7fb44800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:32.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.488+0000 7fb458e05700 1 -- 172.21.15.80:0/3012954313 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb448000c90 con 0x7fb45406c490 2019-11-28T11:29:32.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.488+0000 7fb458e05700 1 -- 172.21.15.80:0/3012954313 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4480013e0 con 0x7fb45406c490 2019-11-28T11:29:32.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.488+0000 7fb45b86a700 1 -- 172.21.15.80:0/3012954313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb45406c490 msgr2=0x7fb45406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:32.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.488+0000 7fb45b86a700 1 --2- 172.21.15.80:0/3012954313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb45406c490 0x7fb45406c920 secure :-1 s=READY pgs=784 cs=0 l=1 rx=0x7fb44800f740 tx=0x7fb44800fae0).stop 2019-11-28T11:29:32.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.488+0000 7fb45b86a700 1 -- 172.21.15.80:0/3012954313 shutdown_connections 2019-11-28T11:29:32.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.488+0000 7fb45b86a700 1 --2- 172.21.15.80:0/3012954313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb45406c490 0x7fb45406c920 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:32.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.488+0000 7fb45b86a700 1 -- 172.21.15.80:0/3012954313 shutdown_connections 2019-11-28T11:29:32.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.488+0000 7fb45b86a700 1 -- 172.21.15.80:0/3012954313 wait complete. 2019-11-28T11:29:32.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.489+0000 7fb45b86a700 1 -- 172.21.15.80:0/3012954313 >> 172.21.15.80:0/3012954313 conn(0x7fb454061cf0 msgr2=0x7fb454064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:32.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.491+0000 7fb45b86a700 1 Processor -- start 2019-11-28T11:29:32.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.491+0000 7fb45b86a700 1 -- start start 2019-11-28T11:29:32.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.492+0000 7fb45b86a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb45412cea0 0x7fb454111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:32.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.492+0000 7fb45b86a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb454124260 con 0x7fb4541230e0 2019-11-28T11:29:32.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.492+0000 7fb45b86a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45412e5d0 con 0x7fb454165a00 2019-11-28T11:29:32.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.492+0000 7fb45b86a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb454120610 con 0x7fb45412cea0 2019-11-28T11:29:32.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.492+0000 7fb459606700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb4541230e0 0x7fb454123570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34222/0 (socket says 172.21.15.80:34222) 2019-11-28T11:29:32.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.492+0000 7fb459606700 1 -- 172.21.15.80:0/4031313796 learned_addr learned my addr 172.21.15.80:0/4031313796 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:32.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.492+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311559947 0 0) 0x7fb448007da0 con 0x7fb4541230e0 2019-11-28T11:29:32.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.492+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb434002e80 con 0x7fb4541230e0 2019-11-28T11:29:32.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.492+0000 7fb459e07700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb45412cea0 0x7fb454111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:32.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.492+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 861345759 0 0) 0x7fb4480081b0 con 0x7fb4541230e0 2019-11-28T11:29:32.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.492+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb4340032e0 con 0x7fb4541230e0 2019-11-28T11:29:32.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fb448000940 con 0x7fb4541230e0 2019-11-28T11:29:32.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb45412cea0 msgr2=0x7fb454111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:32.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb4527fc700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb45412cea0 0x7fb454111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:32.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 >> v1:172.21.15.174:6789/0 conn(0x7fb454165a00 legacy=0x7fb454167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:32.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 >> v1:172.21.15.80:6789/0 conn(0x7fb4541230e0 legacy=0x7fb454123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:32.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb4527fc700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb434003330 0x7fb434003740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:32.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb4527fc700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb434003c80 0x7fb434004140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:32.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb4527fc700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4340049a0 0x7fb434004e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:32.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43400bbf0 con 0x7fb434003330 2019-11-28T11:29:32.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43400bde0 con 0x7fb434003c80 2019-11-28T11:29:32.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43400c010 con 0x7fb4340049a0 2019-11-28T11:29:32.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb459e07700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb434003330 0x7fb434003740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:32.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb459606700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb434003c80 0x7fb434004140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:32.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb45a608700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4340049a0 0x7fb434004e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:32.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb459e07700 1 -- 172.21.15.80:0/4031313796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4340049a0 msgr2=0x7fb434004e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:32.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb459e07700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4340049a0 0x7fb434004e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:32.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb459e07700 1 -- 172.21.15.80:0/4031313796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb434003c80 msgr2=0x7fb434004140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:32.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb459e07700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb434003c80 0x7fb434004140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:32.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb459e07700 1 -- 172.21.15.80:0/4031313796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43400c2c0 con 0x7fb434003330 2019-11-28T11:29:32.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb45b86a700 1 -- 172.21.15.80:0/4031313796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb454121d20 con 0x7fb434003330 2019-11-28T11:29:32.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb459e07700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb434003330 0x7fb434003740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb4440106b0 tx=0x7fb44400db50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:32.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb459e07700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb434003330 0x7fb434003740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb4440106b0 tx=0x7fb44400db50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:32.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb459e07700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb434003330 0x7fb434003740 secure :-1 s=READY pgs=786 cs=0 l=1 rx=0x7fb4440106b0 tx=0x7fb44400db50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:32.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb459e07700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb434003330 0x7fb434003740 secure :-1 s=THROTTLE_DONE pgs=786 cs=0 l=1 rx=0x7fb4440106b0 tx=0x7fb44400db50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:32.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb444009200 con 0x7fb434003330 2019-11-28T11:29:32.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb45b86a700 1 -- 172.21.15.80:0/4031313796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4541219a0 con 0x7fb434003330 2019-11-28T11:29:32.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb459e07700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb434003330 0x7fb434003740 secure :-1 s=THROTTLE_DONE pgs=786 cs=0 l=1 rx=0x7fb4440106b0 tx=0x7fb44400db50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:32.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb459e07700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb434003330 0x7fb434003740 secure :-1 s=THROTTLE_DONE pgs=786 cs=0 l=1 rx=0x7fb4440106b0 tx=0x7fb44400db50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:32.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb444008d80 con 0x7fb434003330 2019-11-28T11:29:32.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.493+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb444009520 con 0x7fb434003330 2019-11-28T11:29:32.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.494+0000 7fb459e07700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb434003330 0x7fb434003740 secure :-1 s=THROTTLE_DONE pgs=786 cs=0 l=1 rx=0x7fb4440106b0 tx=0x7fb44400db50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:32.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.494+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb444009180 con 0x7fb434003330 2019-11-28T11:29:32.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.494+0000 7fb459e07700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb434003330 0x7fb434003740 secure :-1 s=THROTTLE_DONE pgs=786 cs=0 l=1 rx=0x7fb4440106b0 tx=0x7fb44400db50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:32.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.494+0000 7fb4527fc700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb434022da0 0x7fb4340251d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:32.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.495+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb444031d30 con 0x7fb434003330 2019-11-28T11:29:32.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.495+0000 7fb459606700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb434022da0 0x7fb4340251d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:32.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.495+0000 7fb459606700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb434022da0 0x7fb4340251d0 crc :-1 s=READY pgs=321 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:32.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.501+0000 7fb45b86a700 1 -- 172.21.15.80:0/4031313796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb454121d20 con 0x7fb434003330 2019-11-28T11:29:32.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.504+0000 7fb459e07700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb434003330 0x7fb434003740 secure :-1 s=THROTTLE_DONE pgs=786 cs=0 l=1 rx=0x7fb4440106b0 tx=0x7fb44400db50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:32.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.504+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb444008f50 con 0x7fb434003330 2019-11-28T11:29:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.678+0000 7fb45b86a700 1 -- 172.21.15.80:0/4031313796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4541219a0 con 0x7fb434003330 2019-11-28T11:29:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.678+0000 7fb459e07700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb434003330 0x7fb434003740 secure :-1 s=THROTTLE_DONE pgs=786 cs=0 l=1 rx=0x7fb4440106b0 tx=0x7fb44400db50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.678+0000 7fb4527fc700 1 -- 172.21.15.80:0/4031313796 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+1424 (secure 0 0 0) 0x7fb444009160 con 0x7fb434003330 2019-11-28T11:29:32.710 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 35 2019-11-28T11:29:32.710 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:32.710 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:29:26.954212+0000","modified":"2019-11-28T11:29:28.628047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2019-11-28T11:29:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.681+0000 7fb45b86a700 1 -- 172.21.15.80:0/4031313796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb434022da0 msgr2=0x7fb4340251d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.681+0000 7fb45b86a700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb434022da0 0x7fb4340251d0 crc :-1 s=READY pgs=321 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.681+0000 7fb45b86a700 1 -- 172.21.15.80:0/4031313796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb434003330 msgr2=0x7fb434003740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.681+0000 7fb45b86a700 1 --2- 172.21.15.80:0/4031313796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb434003330 0x7fb434003740 secure :-1 s=READY pgs=786 cs=0 l=1 rx=0x7fb4440106b0 tx=0x7fb44400db50).stop 2019-11-28T11:29:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.681+0000 7fb45a608700 1 -- 172.21.15.80:0/4031313796 reap_dead start 2019-11-28T11:29:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.681+0000 7fb45a608700 1 -- 172.21.15.80:0/4031313796 reap_dead start 2019-11-28T11:29:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.681+0000 7fb45b86a700 1 -- 172.21.15.80:0/4031313796 shutdown_connections 2019-11-28T11:29:32.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.681+0000 7fb45b86a700 1 -- 172.21.15.80:0/4031313796 shutdown_connections 2019-11-28T11:29:32.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.681+0000 7fb45b86a700 1 -- 172.21.15.80:0/4031313796 wait complete. 2019-11-28T11:29:32.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:32.681+0000 7fb45b86a700 1 -- 172.21.15.80:0/4031313796 >> 172.21.15.80:0/4031313796 conn(0x7fb4541426c0 msgr2=0x7fb454110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:33.030 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 10, u'failed': [], u'epoch': 35, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [11], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:29:26.954212+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:29:28.628047+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:29:33.031 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:29:34.032 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:34.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.120+0000 7f989e91e700 1 Processor -- start 2019-11-28T11:29:34.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.120+0000 7f989e91e700 1 -- start start 2019-11-28T11:29:34.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.121+0000 7f989e91e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f989806c0a0 0x7f9898072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:34.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.121+0000 7f989e91e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989806db00 con 0x7f9898072620 2019-11-28T11:29:34.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.121+0000 7f989e91e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989806e000 con 0x7f98980734e0 2019-11-28T11:29:34.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.121+0000 7f989e91e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989806fd60 con 0x7f989806c0a0 2019-11-28T11:29:34.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.121+0000 7f989d6bc700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9898072620 0x7f9898164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34238/0 (socket says 172.21.15.80:34238) 2019-11-28T11:29:34.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.121+0000 7f989d6bc700 1 -- 172.21.15.80:0/3862359217 learned_addr learned my addr 172.21.15.80:0/3862359217 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:34.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.121+0000 7f989cebb700 1 --2- 172.21.15.80:0/3862359217 >> v2:172.21.15.174:3300/0 conn(0x7f989806c0a0 0x7f9898072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:34.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f98977fe700 1 -- 172.21.15.80:0/3862359217 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567774175 0 0) 0x7f98900014d0 con 0x7f9898072620 2019-11-28T11:29:34.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f98977fe700 1 -- 172.21.15.80:0/3862359217 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9884002e80 con 0x7f9898072620 2019-11-28T11:29:34.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f98977fe700 1 -- 172.21.15.80:0/3862359217 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3929017831 0 0) 0x7f9888001080 con 0x7f98980734e0 2019-11-28T11:29:34.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f98977fe700 1 -- 172.21.15.80:0/3862359217 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98840030b0 con 0x7f98980734e0 2019-11-28T11:29:34.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f98977fe700 1 -- 172.21.15.80:0/3862359217 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 324841913 0 0) 0x7f98900014b0 con 0x7f9898072620 2019-11-28T11:29:34.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f989cebb700 1 -- 172.21.15.80:0/3862359217 >> v1:172.21.15.174:6789/0 conn(0x7f98980734e0 legacy=0x7f9898071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:34.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f989cebb700 1 -- 172.21.15.80:0/3862359217 >> v1:172.21.15.80:6789/0 conn(0x7f9898072620 legacy=0x7f9898164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:34.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f989cebb700 1 -- 172.21.15.80:0/3862359217 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98980706c0 con 0x7f989806c0a0 2019-11-28T11:29:34.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f989cebb700 1 --2- 172.21.15.80:0/3862359217 >> v2:172.21.15.174:3300/0 conn(0x7f989806c0a0 0x7f9898072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f988000af50 tx=0x7f988000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:34.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f989cebb700 1 --2- 172.21.15.80:0/3862359217 >> v2:172.21.15.174:3300/0 conn(0x7f989806c0a0 0x7f9898072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f988000af50 tx=0x7f988000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:34.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f989cebb700 1 --2- 172.21.15.80:0/3862359217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f989806c0a0 0x7f9898072fa0 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7f988000af50 tx=0x7f988000b760).ready entity=mon.1 client_cookie=b3564def80d6dae0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:34.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f989cebb700 1 --2- 172.21.15.80:0/3862359217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f989806c0a0 0x7f9898072fa0 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7f988000af50 tx=0x7f988000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:34.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f98977fe700 1 -- 172.21.15.80:0/3862359217 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9880000960 con 0x7f989806c0a0 2019-11-28T11:29:34.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f989cebb700 1 --2- 172.21.15.80:0/3862359217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f989806c0a0 0x7f9898072fa0 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7f988000af50 tx=0x7f988000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:34.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f989cebb700 1 --2- 172.21.15.80:0/3862359217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f989806c0a0 0x7f9898072fa0 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7f988000af50 tx=0x7f988000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:34.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f98977fe700 1 -- 172.21.15.80:0/3862359217 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9880009860 con 0x7f989806c0a0 2019-11-28T11:29:34.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f98977fe700 1 -- 172.21.15.80:0/3862359217 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9880009f30 con 0x7f989806c0a0 2019-11-28T11:29:34.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f989e91e700 1 -- 172.21.15.80:0/3862359217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f989806c0a0 msgr2=0x7f9898072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:34.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.122+0000 7f989e91e700 1 --2- 172.21.15.80:0/3862359217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f989806c0a0 0x7f9898072fa0 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7f988000af50 tx=0x7f988000b760).stop 2019-11-28T11:29:34.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.123+0000 7f989e91e700 1 -- 172.21.15.80:0/3862359217 shutdown_connections 2019-11-28T11:29:34.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.123+0000 7f989e91e700 1 --2- 172.21.15.80:0/3862359217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f989806c0a0 0x7f9898072fa0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:34.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.123+0000 7f989e91e700 1 -- 172.21.15.80:0/3862359217 shutdown_connections 2019-11-28T11:29:34.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.123+0000 7f989e91e700 1 -- 172.21.15.80:0/3862359217 wait complete. 2019-11-28T11:29:34.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.123+0000 7f989e91e700 1 -- 172.21.15.80:0/3862359217 >> 172.21.15.80:0/3862359217 conn(0x7f9898061cf0 msgr2=0x7f9898064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:34.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.125+0000 7f989e91e700 1 Processor -- start 2019-11-28T11:29:34.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.125+0000 7f989e91e700 1 -- start start 2019-11-28T11:29:34.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.126+0000 7f989e91e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f989812cea0 0x7f9898111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:34.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.126+0000 7f989e91e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98981230e0 0x7f9898123570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:34.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.126+0000 7f989e91e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9898124260 con 0x7f9898123ab0 2019-11-28T11:29:34.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.126+0000 7f989e91e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9898120610 con 0x7f98981230e0 2019-11-28T11:29:34.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.126+0000 7f989e91e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9898121040 con 0x7f989812cea0 2019-11-28T11:29:34.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f9897fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98981230e0 0x7f9898123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:34.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f9897fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98981230e0 0x7f9898123570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34926/0 (socket says 172.21.15.80:34926) 2019-11-28T11:29:34.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f9897fff700 1 -- 172.21.15.80:0/1227974044 learned_addr learned my addr 172.21.15.80:0/1227974044 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:34.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f989cebb700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f989812cea0 0x7f9898111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:34.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f9897fff700 1 -- 172.21.15.80:0/1227974044 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f989812cea0 msgr2=0x7f9898111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:34.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f9897fff700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f989812cea0 0x7f9898111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:34.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f98957fa700 1 -- 172.21.15.80:0/1227974044 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000557572 0 0) 0x7f9890001480 con 0x7f9898123ab0 2019-11-28T11:29:34.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f9897fff700 1 -- 172.21.15.80:0/1227974044 >> v1:172.21.15.174:6789/0 conn(0x7f9898123ab0 legacy=0x7f989812d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:34.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f9897fff700 1 -- 172.21.15.80:0/1227974044 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98981219a0 con 0x7f98981230e0 2019-11-28T11:29:34.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f9897fff700 1 --2- 172.21.15.80:0/1227974044 >> v2:172.21.15.80:3300/0 conn(0x7f98981230e0 0x7f9898123570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9888010410 tx=0x7f9888010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f9897fff700 1 --2- 172.21.15.80:0/1227974044 >> v2:172.21.15.80:3300/0 conn(0x7f98981230e0 0x7f9898123570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9888010410 tx=0x7f9888010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f9897fff700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98981230e0 0x7f9898123570 secure :-1 s=READY pgs=788 cs=0 l=1 rx=0x7f9888010410 tx=0x7f9888010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f9897fff700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98981230e0 0x7f9898123570 secure :-1 s=THROTTLE_DONE pgs=788 cs=0 l=1 rx=0x7f9888010410 tx=0x7f9888010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f98957fa700 1 -- 172.21.15.80:0/1227974044 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9888005770 con 0x7f98981230e0 2019-11-28T11:29:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f9897fff700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98981230e0 0x7f9898123570 secure :-1 s=THROTTLE_DONE pgs=788 cs=0 l=1 rx=0x7f9888010410 tx=0x7f9888010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f9897fff700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98981230e0 0x7f9898123570 secure :-1 s=THROTTLE_DONE pgs=788 cs=0 l=1 rx=0x7f9888010410 tx=0x7f9888010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:34.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f98957fa700 1 -- 172.21.15.80:0/1227974044 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9888005390 con 0x7f98981230e0 2019-11-28T11:29:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f989e91e700 1 -- 172.21.15.80:0/1227974044 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9898121d20 con 0x7f98981230e0 2019-11-28T11:29:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f98957fa700 1 -- 172.21.15.80:0/1227974044 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9888005d50 con 0x7f98981230e0 2019-11-28T11:29:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.127+0000 7f989e91e700 1 -- 172.21.15.80:0/1227974044 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98981122f0 con 0x7f98981230e0 2019-11-28T11:29:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.128+0000 7f9897fff700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98981230e0 0x7f9898123570 secure :-1 s=THROTTLE_DONE pgs=788 cs=0 l=1 rx=0x7f9888010410 tx=0x7f9888010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.128+0000 7f98957fa700 1 -- 172.21.15.80:0/1227974044 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9888005580 con 0x7f98981230e0 2019-11-28T11:29:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.128+0000 7f9897fff700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98981230e0 0x7f9898123570 secure :-1 s=THROTTLE_DONE pgs=788 cs=0 l=1 rx=0x7f9888010410 tx=0x7f9888010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:34.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.128+0000 7f98957fa700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f987c018730 0x7f987c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:34.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.128+0000 7f98957fa700 1 -- 172.21.15.80:0/1227974044 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9888031a50 con 0x7f98981230e0 2019-11-28T11:29:34.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.128+0000 7f989cebb700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f987c018730 0x7f987c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:34.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.128+0000 7f989cebb700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f987c018730 0x7f987c01abc0 crc :-1 s=READY pgs=325 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:34.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.136+0000 7f989e91e700 1 -- 172.21.15.80:0/1227974044 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98981219a0 con 0x7f98981230e0 2019-11-28T11:29:34.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.139+0000 7f9897fff700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98981230e0 0x7f9898123570 secure :-1 s=THROTTLE_DONE pgs=788 cs=0 l=1 rx=0x7f9888010410 tx=0x7f9888010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:34.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.139+0000 7f98957fa700 1 -- 172.21.15.80:0/1227974044 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f98880075a0 con 0x7f98981230e0 2019-11-28T11:29:34.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.312+0000 7f989e91e700 1 -- 172.21.15.80:0/1227974044 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9898121d20 con 0x7f98981230e0 2019-11-28T11:29:34.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.313+0000 7f9897fff700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98981230e0 0x7f9898123570 secure :-1 s=THROTTLE_DONE pgs=788 cs=0 l=1 rx=0x7f9888010410 tx=0x7f9888010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:34.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.313+0000 7f98957fa700 1 -- 172.21.15.80:0/1227974044 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+2447 (secure 0 0 0) 0x7f9888005580 con 0x7f98981230e0 2019-11-28T11:29:34.345 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 37 2019-11-28T11:29:34.345 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:34.345 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6312,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1488684602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1488684602},{"type":"v1","addr":"172.21.15.80:6834","nonce":1488684602}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36},{"gid":6315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1002302731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1002302731},{"type":"v1","addr":"172.21.15.80:6835","nonce":1002302731}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:29:26.954212+0000","modified":"2019-11-28T11:29:33.646658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5186":{"gid":5186,"name":"c","rank":0,"incarnation":37,"state":"up:creating","state_seq":2,"addr":"172.21.15.174:6835/698358691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":698358691},{"type":"v1","addr":"172.21.15.174:6835","nonce":698358691}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2019-11-28T11:29:34.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.315+0000 7f989e91e700 1 -- 172.21.15.80:0/1227974044 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f987c018730 msgr2=0x7f987c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:34.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.315+0000 7f989e91e700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f987c018730 0x7f987c01abc0 crc :-1 s=READY pgs=325 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:34.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.315+0000 7f989e91e700 1 -- 172.21.15.80:0/1227974044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98981230e0 msgr2=0x7f9898123570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:34.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.315+0000 7f989e91e700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98981230e0 0x7f9898123570 secure :-1 s=READY pgs=788 cs=0 l=1 rx=0x7f9888010410 tx=0x7f9888010290).stop 2019-11-28T11:29:34.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.315+0000 7f989e91e700 1 -- 172.21.15.80:0/1227974044 shutdown_connections 2019-11-28T11:29:34.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.315+0000 7f989e91e700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f987c018730 0x7f987c01abc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:34.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.315+0000 7f989e91e700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98981230e0 0x7f9898123570 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:34.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.315+0000 7f989e91e700 1 --2- 172.21.15.80:0/1227974044 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f989812cea0 0x7f9898111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:34.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.315+0000 7f989e91e700 1 -- 172.21.15.80:0/1227974044 shutdown_connections 2019-11-28T11:29:34.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.315+0000 7f989e91e700 1 -- 172.21.15.80:0/1227974044 wait complete. 2019-11-28T11:29:34.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:34.315+0000 7f989e91e700 1 -- 172.21.15.80:0/1227974044 >> 172.21.15.80:0/1227974044 conn(0x7f98981426c0 msgr2=0x7f9898110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:34.660 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5186}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 10, u'failed': [], u'epoch': 37, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [11], u'info': {u'gid_5186': {u'export_targets': [], u'name': u'c', u'incarnation': 37, u'state_seq': 2, u'state': u'up:creating', u'gid': 5186, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 698358691, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 698358691, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/698358691'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:29:26.954212+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:29:33.646658+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:29:34.660 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5186:up:creating 2019-11-28T11:29:35.661 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:35.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.758+0000 7f16d26df700 1 Processor -- start 2019-11-28T11:29:35.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.758+0000 7f16d26df700 1 -- start start 2019-11-28T11:29:35.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.759+0000 7f16d26df700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f16cc06c0a0 0x7f16cc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:35.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.759+0000 7f16d26df700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16cc0734e0 0x7f16cc071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:35.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.759+0000 7f16d26df700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16cc06db00 con 0x7f16cc072360 2019-11-28T11:29:35.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.759+0000 7f16d26df700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16cc06fd60 con 0x7f16cc0734e0 2019-11-28T11:29:35.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.759+0000 7f16d26df700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16cc070030 con 0x7f16cc06c0a0 2019-11-28T11:29:35.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.759+0000 7f16cbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16cc0734e0 0x7f16cc071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:35.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.759+0000 7f16cbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16cc0734e0 0x7f16cc071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34938/0 (socket says 172.21.15.80:34938) 2019-11-28T11:29:35.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.759+0000 7f16d147d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f16cc072360 0x7f16cc06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34254/0 (socket says 172.21.15.80:34254) 2019-11-28T11:29:35.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.759+0000 7f16cbfff700 1 -- 172.21.15.80:0/2362144930 learned_addr learned my addr 172.21.15.80:0/2362144930 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:35.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.759+0000 7f16d0c7c700 1 --2- 172.21.15.80:0/2362144930 >> v2:172.21.15.174:3300/0 conn(0x7f16cc06c0a0 0x7f16cc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:35.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.759+0000 7f16cbfff700 1 -- 172.21.15.80:0/2362144930 >> v2:172.21.15.174:3300/0 conn(0x7f16cc06c0a0 msgr2=0x7f16cc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:35.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.759+0000 7f16cbfff700 1 --2- 172.21.15.80:0/2362144930 >> v2:172.21.15.174:3300/0 conn(0x7f16cc06c0a0 0x7f16cc072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:35.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.759+0000 7f16cbfff700 1 -- 172.21.15.80:0/2362144930 >> v1:172.21.15.80:6789/0 conn(0x7f16cc072360 legacy=0x7f16cc06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:35.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.759+0000 7f16cbfff700 1 -- 172.21.15.80:0/2362144930 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc0706c0 con 0x7f16cc0734e0 2019-11-28T11:29:35.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.759+0000 7f16cb7fe700 1 -- 172.21.15.80:0/2362144930 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951050140 0 0) 0x7f16b40009b0 con 0x7f16cc072360 2019-11-28T11:29:35.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.760+0000 7f16cbfff700 1 --2- 172.21.15.80:0/2362144930 >> v2:172.21.15.80:3300/0 conn(0x7f16cc0734e0 0x7f16cc071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f16bc00f6c0 tx=0x7f16bc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:35.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.760+0000 7f16cbfff700 1 --2- 172.21.15.80:0/2362144930 >> v2:172.21.15.80:3300/0 conn(0x7f16cc0734e0 0x7f16cc071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f16bc00f6c0 tx=0x7f16bc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:35.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.760+0000 7f16cbfff700 1 --2- 172.21.15.80:0/2362144930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0734e0 0x7f16cc071e20 secure :-1 s=READY pgs=790 cs=0 l=1 rx=0x7f16bc00f6c0 tx=0x7f16bc00fa60).ready entity=mon.0 client_cookie=f5b37700dbc9b774 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:35.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.760+0000 7f16cbfff700 1 --2- 172.21.15.80:0/2362144930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0734e0 0x7f16cc071e20 secure :-1 s=THROTTLE_DONE pgs=790 cs=0 l=1 rx=0x7f16bc00f6c0 tx=0x7f16bc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:35.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.760+0000 7f16cb7fe700 1 -- 172.21.15.80:0/2362144930 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16bc000960 con 0x7f16cc0734e0 2019-11-28T11:29:35.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.760+0000 7f16cbfff700 1 --2- 172.21.15.80:0/2362144930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0734e0 0x7f16cc071e20 secure :-1 s=THROTTLE_DONE pgs=790 cs=0 l=1 rx=0x7f16bc00f6c0 tx=0x7f16bc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:35.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.760+0000 7f16cbfff700 1 --2- 172.21.15.80:0/2362144930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0734e0 0x7f16cc071e20 secure :-1 s=THROTTLE_DONE pgs=790 cs=0 l=1 rx=0x7f16bc00f6c0 tx=0x7f16bc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:35.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.760+0000 7f16cb7fe700 1 -- 172.21.15.80:0/2362144930 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc000c90 con 0x7f16cc0734e0 2019-11-28T11:29:35.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.760+0000 7f16cb7fe700 1 -- 172.21.15.80:0/2362144930 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16bc000960 con 0x7f16cc0734e0 2019-11-28T11:29:35.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.760+0000 7f16d26df700 1 -- 172.21.15.80:0/2362144930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0734e0 msgr2=0x7f16cc071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:35.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.760+0000 7f16d26df700 1 --2- 172.21.15.80:0/2362144930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0734e0 0x7f16cc071e20 secure :-1 s=READY pgs=790 cs=0 l=1 rx=0x7f16bc00f6c0 tx=0x7f16bc00fa60).stop 2019-11-28T11:29:35.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.760+0000 7f16d26df700 1 -- 172.21.15.80:0/2362144930 shutdown_connections 2019-11-28T11:29:35.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.760+0000 7f16d26df700 1 --2- 172.21.15.80:0/2362144930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0734e0 0x7f16cc071e20 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:35.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.760+0000 7f16d26df700 1 --2- 172.21.15.80:0/2362144930 >> v2:172.21.15.174:3300/0 conn(0x7f16cc06c0a0 0x7f16cc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:35.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.760+0000 7f16d26df700 1 -- 172.21.15.80:0/2362144930 shutdown_connections 2019-11-28T11:29:35.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.761+0000 7f16d26df700 1 -- 172.21.15.80:0/2362144930 wait complete. 2019-11-28T11:29:35.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.761+0000 7f16d26df700 1 -- 172.21.15.80:0/2362144930 >> 172.21.15.80:0/2362144930 conn(0x7f16cc061cf0 msgr2=0x7f16cc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:35.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.763+0000 7f16d26df700 1 Processor -- start 2019-11-28T11:29:35.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.763+0000 7f16d26df700 1 -- start start 2019-11-28T11:29:35.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.764+0000 7f16d26df700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16cc13a780 0x7f16cc12d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:35.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.764+0000 7f16d26df700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f16cc12cb00 0x7f16cc167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:35.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.764+0000 7f16d26df700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16cc139a60 con 0x7f16cc12d9c0 2019-11-28T11:29:35.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.764+0000 7f16d26df700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16cc129830 con 0x7f16cc12cb00 2019-11-28T11:29:35.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.764+0000 7f16d26df700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc12a260 con 0x7f16cc13a780 2019-11-28T11:29:35.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.764+0000 7f16cbfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f16cc12d9c0 0x7f16cc12c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34258/0 (socket says 172.21.15.80:34258) 2019-11-28T11:29:35.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.764+0000 7f16cbfff700 1 -- 172.21.15.80:0/3467707107 learned_addr learned my addr 172.21.15.80:0/3467707107 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:35.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.764+0000 7f16d147d700 1 --2- 172.21.15.80:0/3467707107 >> v2:172.21.15.174:3300/0 conn(0x7f16cc12cb00 0x7f16cc167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:35.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.764+0000 7f16d0c7c700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16cc13a780 0x7f16cc12d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:35.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.764+0000 7f16c97fa700 1 -- 172.21.15.80:0/3467707107 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749464501 0 0) 0x7f16bc0078e0 con 0x7f16cc12d9c0 2019-11-28T11:29:35.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.764+0000 7f16c97fa700 1 -- 172.21.15.80:0/3467707107 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16b0002e80 con 0x7f16cc12d9c0 2019-11-28T11:29:35.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.764+0000 7f16d147d700 1 -- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16cc13a780 msgr2=0x7f16cc12d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:35.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16c97fa700 1 -- 172.21.15.80:0/3467707107 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2373176262 0 0) 0x7f16bc007580 con 0x7f16cc12d9c0 2019-11-28T11:29:35.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16d147d700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16cc13a780 0x7f16cc12d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:35.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16d147d700 1 -- 172.21.15.80:0/3467707107 >> v1:172.21.15.80:6789/0 conn(0x7f16cc12d9c0 legacy=0x7f16cc12c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:35.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16d147d700 1 -- 172.21.15.80:0/3467707107 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc12abc0 con 0x7f16cc12cb00 2019-11-28T11:29:35.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16d0c7c700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16cc13a780 0x7f16cc12d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:35.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16d147d700 1 --2- 172.21.15.80:0/3467707107 >> v2:172.21.15.174:3300/0 conn(0x7f16cc12cb00 0x7f16cc167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f16b4010380 tx=0x7f16b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:35.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16d147d700 1 --2- 172.21.15.80:0/3467707107 >> v2:172.21.15.174:3300/0 conn(0x7f16cc12cb00 0x7f16cc167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f16b4010380 tx=0x7f16b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:35.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16d147d700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16cc12cb00 0x7f16cc167d70 secure :-1 s=READY pgs=469 cs=0 l=1 rx=0x7f16b4010380 tx=0x7f16b4010720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:35.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16d147d700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16cc12cb00 0x7f16cc167d70 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7f16b4010380 tx=0x7f16b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:35.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16c97fa700 1 -- 172.21.15.80:0/3467707107 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16b4000940 con 0x7f16cc12cb00 2019-11-28T11:29:35.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16d147d700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16cc12cb00 0x7f16cc167d70 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7f16b4010380 tx=0x7f16b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:35.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16c97fa700 1 -- 172.21.15.80:0/3467707107 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b4001380 con 0x7f16cc12cb00 2019-11-28T11:29:35.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16d147d700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16cc12cb00 0x7f16cc167d70 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7f16b4010380 tx=0x7f16b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:35.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16c97fa700 1 -- 172.21.15.80:0/3467707107 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16b4001570 con 0x7f16cc12cb00 2019-11-28T11:29:35.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16d26df700 1 -- 172.21.15.80:0/3467707107 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16cc12af40 con 0x7f16cc12cb00 2019-11-28T11:29:35.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16d26df700 1 -- 172.21.15.80:0/3467707107 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16cc12abc0 con 0x7f16cc12cb00 2019-11-28T11:29:35.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.765+0000 7f16d147d700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16cc12cb00 0x7f16cc167d70 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7f16b4010380 tx=0x7f16b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:35.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.766+0000 7f16c97fa700 1 -- 172.21.15.80:0/3467707107 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f16b4000ef0 con 0x7f16cc12cb00 2019-11-28T11:29:35.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.766+0000 7f16d147d700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16cc12cb00 0x7f16cc167d70 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7f16b4010380 tx=0x7f16b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:35.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.766+0000 7f16c97fa700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16b0018780 0x7f16b001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:35.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.766+0000 7f16c97fa700 1 -- 172.21.15.80:0/3467707107 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f16b40319d0 con 0x7f16cc12cb00 2019-11-28T11:29:35.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.766+0000 7f16d0c7c700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16b0018780 0x7f16b001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:35.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.766+0000 7f16d0c7c700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16b0018780 0x7f16b001abf0 crc :-1 s=READY pgs=328 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:35.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.773+0000 7f16d26df700 1 -- 172.21.15.80:0/3467707107 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16cc12af40 con 0x7f16cc12cb00 2019-11-28T11:29:35.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.777+0000 7f16d147d700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16cc12cb00 0x7f16cc167d70 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7f16b4010380 tx=0x7f16b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:35.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.777+0000 7f16c97fa700 1 -- 172.21.15.80:0/3467707107 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f16b4001570 con 0x7f16cc12cb00 2019-11-28T11:29:35.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.949+0000 7f16d26df700 1 -- 172.21.15.80:0/3467707107 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16cc12abc0 con 0x7f16cc12cb00 2019-11-28T11:29:35.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.950+0000 7f16d147d700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16cc12cb00 0x7f16cc167d70 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7f16b4010380 tx=0x7f16b4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:35.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.950+0000 7f16c97fa700 1 -- 172.21.15.80:0/3467707107 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2445 (secure 0 0 0) 0x7f16b4001570 con 0x7f16cc12cb00 2019-11-28T11:29:35.982 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 38 2019-11-28T11:29:35.982 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:35.982 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6312,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1488684602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1488684602},{"type":"v1","addr":"172.21.15.80:6834","nonce":1488684602}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36},{"gid":6315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1002302731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1002302731},{"type":"v1","addr":"172.21.15.80:6835","nonce":1002302731}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:29:26.954212+0000","modified":"2019-11-28T11:29:34.648365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5186":{"gid":5186,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/698358691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":698358691},{"type":"v1","addr":"172.21.15.174:6835","nonce":698358691}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2019-11-28T11:29:35.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.952+0000 7f16d26df700 1 -- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16b0018780 msgr2=0x7f16b001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:35.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.952+0000 7f16d26df700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16b0018780 0x7f16b001abf0 crc :-1 s=READY pgs=328 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:35.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.952+0000 7f16d26df700 1 -- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16cc12cb00 msgr2=0x7f16cc167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:35.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.952+0000 7f16d26df700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16cc12cb00 0x7f16cc167d70 secure :-1 s=READY pgs=469 cs=0 l=1 rx=0x7f16b4010380 tx=0x7f16b4010720).stop 2019-11-28T11:29:35.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.952+0000 7f16d26df700 1 -- 172.21.15.80:0/3467707107 shutdown_connections 2019-11-28T11:29:35.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.952+0000 7f16d26df700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16b0018780 0x7f16b001abf0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:35.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.952+0000 7f16d26df700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16cc12cb00 0x7f16cc167d70 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:35.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.952+0000 7f16d26df700 1 --2- 172.21.15.80:0/3467707107 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16cc13a780 0x7f16cc12d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:35.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.952+0000 7f16d26df700 1 -- 172.21.15.80:0/3467707107 shutdown_connections 2019-11-28T11:29:35.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.952+0000 7f16d26df700 1 -- 172.21.15.80:0/3467707107 wait complete. 2019-11-28T11:29:35.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:35.952+0000 7f16d26df700 1 -- 172.21.15.80:0/3467707107 >> 172.21.15.80:0/3467707107 conn(0x7f16cc127dc0 msgr2=0x7f16cc141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:36.299 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5186}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 10, u'failed': [], u'epoch': 38, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [11], u'info': {u'gid_5186': {u'export_targets': [], u'name': u'c', u'incarnation': 37, u'state_seq': 3, u'state': u'up:active', u'gid': 5186, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 698358691, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 698358691, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/698358691'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:29:26.954212+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:29:34.648365+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:29:36.299 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:29:36.300 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:29:36.425 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:29:36.426 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:29:36.426 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:29:36.426 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5186, 2019-11-28T11:29:36.426 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:29:36.426 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:29:36.426 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 2.7468348960000002, 2019-11-28T11:29:36.426 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 38, 2019-11-28T11:29:36.427 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 67, 2019-11-28T11:29:36.427 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 67, 2019-11-28T11:29:36.427 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 6.97508734 2019-11-28T11:29:36.427 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:29:36.431 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5186, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.7468348960000002, "mdsmap_epoch": 38, "osdmap_epoch": 67, "osdmap_epoch_barrier": 67, "uptime": 6.97508734 } 2019-11-28T11:29:36.432 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:29:36.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.523+0000 7fd4c0baa700 1 Processor -- start 2019-11-28T11:29:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.523+0000 7fd4c0baa700 1 -- start start 2019-11-28T11:29:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4c0baa700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd4bc06c490 0x7fd4bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4c0baa700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc06db00 con 0x7fd4bc06c0a0 2019-11-28T11:29:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4c0baa700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc06e000 con 0x7fd4bc06ce60 2019-11-28T11:29:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4c0baa700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc06fd60 con 0x7fd4bc06c490 2019-11-28T11:29:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4bad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd4bc06c0a0 0x7fd4bc072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34266/0 (socket says 172.21.15.80:34266) 2019-11-28T11:29:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4bad9d700 1 -- 172.21.15.80:0/1684816419 learned_addr learned my addr 172.21.15.80:0/1684816419 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4ba59c700 1 --2- 172.21.15.80:0/1684816419 >> v2:172.21.15.174:3300/0 conn(0x7fd4bc06c490 0x7fd4bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4b9d9b700 1 -- 172.21.15.80:0/1684816419 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583076903 0 0) 0x7fd4ac001150 con 0x7fd4bc06c0a0 2019-11-28T11:29:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4b9d9b700 1 -- 172.21.15.80:0/1684816419 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4a8002e80 con 0x7fd4bc06c0a0 2019-11-28T11:29:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4b9d9b700 1 -- 172.21.15.80:0/1684816419 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169349164 0 0) 0x7fd4b4000d30 con 0x7fd4bc06ce60 2019-11-28T11:29:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4b9d9b700 1 -- 172.21.15.80:0/1684816419 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4a8002f30 con 0x7fd4bc06ce60 2019-11-28T11:29:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4ba59c700 1 -- 172.21.15.80:0/1684816419 >> v1:172.21.15.174:6789/0 conn(0x7fd4bc06ce60 legacy=0x7fd4bc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4b9d9b700 1 -- 172.21.15.80:0/1684816419 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1213401701 0 0) 0x7fd4ac001130 con 0x7fd4bc06c0a0 2019-11-28T11:29:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4ba59c700 1 -- 172.21.15.80:0/1684816419 >> v1:172.21.15.80:6789/0 conn(0x7fd4bc06c0a0 legacy=0x7fd4bc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4ba59c700 1 -- 172.21.15.80:0/1684816419 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc0706c0 con 0x7fd4bc06c490 2019-11-28T11:29:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4ba59c700 1 --2- 172.21.15.80:0/1684816419 >> v2:172.21.15.174:3300/0 conn(0x7fd4bc06c490 0x7fd4bc06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd4a400af50 tx=0x7fd4a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4ba59c700 1 --2- 172.21.15.80:0/1684816419 >> v2:172.21.15.174:3300/0 conn(0x7fd4bc06c490 0x7fd4bc06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd4a400af50 tx=0x7fd4a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.525+0000 7fd4ba59c700 1 --2- 172.21.15.80:0/1684816419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4bc06c490 0x7fd4bc06c920 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7fd4a400af50 tx=0x7fd4a400b760).ready entity=mon.1 client_cookie=24b34f5ddd727278 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.526+0000 7fd4ba59c700 1 --2- 172.21.15.80:0/1684816419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4bc06c490 0x7fd4bc06c920 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7fd4a400af50 tx=0x7fd4a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.526+0000 7fd4b9d9b700 1 -- 172.21.15.80:0/1684816419 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4a4000960 con 0x7fd4bc06c490 2019-11-28T11:29:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.526+0000 7fd4ba59c700 1 --2- 172.21.15.80:0/1684816419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4bc06c490 0x7fd4bc06c920 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7fd4a400af50 tx=0x7fd4a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.526+0000 7fd4ba59c700 1 --2- 172.21.15.80:0/1684816419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4bc06c490 0x7fd4bc06c920 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7fd4a400af50 tx=0x7fd4a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.526+0000 7fd4b9d9b700 1 -- 172.21.15.80:0/1684816419 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a4009860 con 0x7fd4bc06c490 2019-11-28T11:29:36.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.526+0000 7fd4b9d9b700 1 -- 172.21.15.80:0/1684816419 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4a4009f30 con 0x7fd4bc06c490 2019-11-28T11:29:36.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.526+0000 7fd4c0baa700 1 -- 172.21.15.80:0/1684816419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4bc06c490 msgr2=0x7fd4bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:36.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.526+0000 7fd4c0baa700 1 --2- 172.21.15.80:0/1684816419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4bc06c490 0x7fd4bc06c920 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7fd4a400af50 tx=0x7fd4a400b760).stop 2019-11-28T11:29:36.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.526+0000 7fd4c0baa700 1 -- 172.21.15.80:0/1684816419 shutdown_connections 2019-11-28T11:29:36.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.526+0000 7fd4c0baa700 1 --2- 172.21.15.80:0/1684816419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4bc06c490 0x7fd4bc06c920 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:36.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.527+0000 7fd4c0baa700 1 -- 172.21.15.80:0/1684816419 shutdown_connections 2019-11-28T11:29:36.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.527+0000 7fd4c0baa700 1 -- 172.21.15.80:0/1684816419 wait complete. 2019-11-28T11:29:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.527+0000 7fd4c0baa700 1 -- 172.21.15.80:0/1684816419 >> 172.21.15.80:0/1684816419 conn(0x7fd4bc061cf0 msgr2=0x7fd4bc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.529+0000 7fd4c0baa700 1 Processor -- start 2019-11-28T11:29:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.529+0000 7fd4c0baa700 1 -- start start 2019-11-28T11:29:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4c0baa700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd4bc12cea0 0x7fd4bc111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4c0baa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd4bc165a00 0x7fd4bc167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:36.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4c0baa700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc124260 con 0x7fd4bc1230e0 2019-11-28T11:29:36.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4c0baa700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc121040 con 0x7fd4bc165a00 2019-11-28T11:29:36.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4c0baa700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc121310 con 0x7fd4bc12cea0 2019-11-28T11:29:36.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4bb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd4bc165a00 0x7fd4bc167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:36.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4bb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd4bc165a00 0x7fd4bc167e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34960/0 (socket says 172.21.15.80:34960) 2019-11-28T11:29:36.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4ba59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd4bc1230e0 0x7fd4bc123570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34274/0 (socket says 172.21.15.80:34274) 2019-11-28T11:29:36.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4bb59e700 1 -- 172.21.15.80:0/3402355356 learned_addr learned my addr 172.21.15.80:0/3402355356 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:36.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4bad9d700 1 --2- 172.21.15.80:0/3402355356 >> v2:172.21.15.174:3300/0 conn(0x7fd4bc12cea0 0x7fd4bc111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:36.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4bb59e700 1 -- 172.21.15.80:0/3402355356 >> v2:172.21.15.174:3300/0 conn(0x7fd4bc12cea0 msgr2=0x7fd4bc111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:36.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4bb59e700 1 --2- 172.21.15.80:0/3402355356 >> v2:172.21.15.174:3300/0 conn(0x7fd4bc12cea0 0x7fd4bc111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:36.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4bb59e700 1 -- 172.21.15.80:0/3402355356 >> v1:172.21.15.80:6789/0 conn(0x7fd4bc1230e0 legacy=0x7fd4bc123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:36.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4bb59e700 1 -- 172.21.15.80:0/3402355356 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc1219a0 con 0x7fd4bc165a00 2019-11-28T11:29:36.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4b37fe700 1 -- 172.21.15.80:0/3402355356 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348385930 0 0) 0x7fd4a400abb0 con 0x7fd4bc1230e0 2019-11-28T11:29:36.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4bb59e700 1 --2- 172.21.15.80:0/3402355356 >> v2:172.21.15.80:3300/0 conn(0x7fd4bc165a00 0x7fd4bc167e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4b4010790 tx=0x7fd4b4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4bb59e700 1 --2- 172.21.15.80:0/3402355356 >> v2:172.21.15.80:3300/0 conn(0x7fd4bc165a00 0x7fd4bc167e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4b4010790 tx=0x7fd4b4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.530+0000 7fd4bb59e700 1 --2- 172.21.15.80:0/3402355356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4bc165a00 0x7fd4bc167e00 secure :-1 s=READY pgs=794 cs=0 l=1 rx=0x7fd4b4010790 tx=0x7fd4b4010610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:36.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.531+0000 7fd4bb59e700 1 --2- 172.21.15.80:0/3402355356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4bc165a00 0x7fd4bc167e00 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7fd4b4010790 tx=0x7fd4b4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.531+0000 7fd4b37fe700 1 -- 172.21.15.80:0/3402355356 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4b4007950 con 0x7fd4bc165a00 2019-11-28T11:29:36.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.531+0000 7fd4bb59e700 1 --2- 172.21.15.80:0/3402355356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4bc165a00 0x7fd4bc167e00 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7fd4b4010790 tx=0x7fd4b4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.531+0000 7fd4bb59e700 1 --2- 172.21.15.80:0/3402355356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4bc165a00 0x7fd4bc167e00 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7fd4b4010790 tx=0x7fd4b4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.531+0000 7fd4b37fe700 1 -- 172.21.15.80:0/3402355356 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b4005af0 con 0x7fd4bc165a00 2019-11-28T11:29:36.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.531+0000 7fd4b37fe700 1 -- 172.21.15.80:0/3402355356 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4b4007950 con 0x7fd4bc165a00 2019-11-28T11:29:36.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.531+0000 7fd4c0baa700 1 -- 172.21.15.80:0/3402355356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4bc121d20 con 0x7fd4bc165a00 2019-11-28T11:29:36.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.531+0000 7fd4c0baa700 1 -- 172.21.15.80:0/3402355356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc1122f0 con 0x7fd4bc165a00 2019-11-28T11:29:36.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.531+0000 7fd4bb59e700 1 --2- 172.21.15.80:0/3402355356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4bc165a00 0x7fd4bc167e00 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7fd4b4010790 tx=0x7fd4b4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.531+0000 7fd4b37fe700 1 -- 172.21.15.80:0/3402355356 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd4b4005710 con 0x7fd4bc165a00 2019-11-28T11:29:36.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.531+0000 7fd4bb59e700 1 --2- 172.21.15.80:0/3402355356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4bc165a00 0x7fd4bc167e00 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7fd4b4010790 tx=0x7fd4b4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.531+0000 7fd4b37fe700 1 --2- 172.21.15.80:0/3402355356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4a0018730 0x7fd4a001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:36.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.531+0000 7fd4b37fe700 1 -- 172.21.15.80:0/3402355356 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd4b4031f80 con 0x7fd4bc165a00 2019-11-28T11:29:36.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.531+0000 7fd4bad9d700 1 --2- 172.21.15.80:0/3402355356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4a0018730 0x7fd4a001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:36.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.532+0000 7fd4bad9d700 1 --2- 172.21.15.80:0/3402355356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4a0018730 0x7fd4a001abc0 crc :-1 s=READY pgs=329 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:36.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.539+0000 7fd4c0baa700 1 -- 172.21.15.80:0/3402355356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc1219a0 con 0x7fd4bc165a00 2019-11-28T11:29:36.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.542+0000 7fd4bb59e700 1 --2- 172.21.15.80:0/3402355356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4bc165a00 0x7fd4bc167e00 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7fd4b4010790 tx=0x7fd4b4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.542+0000 7fd4b37fe700 1 -- 172.21.15.80:0/3402355356 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd4b4000cc0 con 0x7fd4bc165a00 2019-11-28T11:29:36.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.720+0000 7fd4c0baa700 1 -- 172.21.15.80:0/3402355356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4bc121d20 con 0x7fd4bc165a00 2019-11-28T11:29:36.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.720+0000 7fd4bb59e700 1 --2- 172.21.15.80:0/3402355356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4bc165a00 0x7fd4bc167e00 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7fd4b4010790 tx=0x7fd4b4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.720+0000 7fd4b37fe700 1 -- 172.21.15.80:0/3402355356 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+14860 (secure 0 0 0) 0x7fd4b4005710 con 0x7fd4bc165a00 2019-11-28T11:29:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:36.753 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":67,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:29:27.955377+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:29:25.290976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2019-11-28T11:29:25.980441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:29:36.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.723+0000 7fd4c0baa700 1 -- 172.21.15.80:0/3402355356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4a0018730 msgr2=0x7fd4a001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:36.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.723+0000 7fd4c0baa700 1 --2- 172.21.15.80:0/3402355356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4a0018730 0x7fd4a001abc0 crc :-1 s=READY pgs=329 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:36.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.723+0000 7fd4c0baa700 1 -- 172.21.15.80:0/3402355356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4bc165a00 msgr2=0x7fd4bc167e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:36.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.723+0000 7fd4c0baa700 1 --2- 172.21.15.80:0/3402355356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4bc165a00 0x7fd4bc167e00 secure :-1 s=READY pgs=794 cs=0 l=1 rx=0x7fd4b4010790 tx=0x7fd4b4010610).stop 2019-11-28T11:29:36.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.723+0000 7fd4c0baa700 1 -- 172.21.15.80:0/3402355356 shutdown_connections 2019-11-28T11:29:36.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.723+0000 7fd4c0baa700 1 --2- 172.21.15.80:0/3402355356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4a0018730 0x7fd4a001abc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:36.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.723+0000 7fd4c0baa700 1 --2- 172.21.15.80:0/3402355356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4bc165a00 0x7fd4bc167e00 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:36.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.723+0000 7fd4c0baa700 1 --2- 172.21.15.80:0/3402355356 >> v2:172.21.15.174:3300/0 conn(0x7fd4bc12cea0 0x7fd4bc111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:36.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.723+0000 7fd4c0baa700 1 -- 172.21.15.80:0/3402355356 shutdown_connections 2019-11-28T11:29:36.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.723+0000 7fd4c0baa700 1 -- 172.21.15.80:0/3402355356 wait complete. 2019-11-28T11:29:36.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.723+0000 7fd4c0baa700 1 -- 172.21.15.80:0/3402355356 >> 172.21.15.80:0/3402355356 conn(0x7fd4bc1426c0 msgr2=0x7fd4bc110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:36.779 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:29:25.290976+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 10, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'66', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:29:25.980441+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 11, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'67', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:29:36.780 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:29:36.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.877+0000 7fd9f7231700 1 Processor -- start 2019-11-28T11:29:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.878+0000 7fd9f7231700 1 -- start start 2019-11-28T11:29:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f7231700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd9f015ed10 0x7fd9f015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f7231700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f006db60 con 0x7fd9f0073020 2019-11-28T11:29:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f7231700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f006e060 con 0x7fd9f00734b0 2019-11-28T11:29:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f7231700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f006fe00 con 0x7fd9f015ed10 2019-11-28T11:29:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f57ce700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd9f015ed10 0x7fd9f015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f57ce700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd9f015ed10 0x7fd9f015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34964/0 (socket says 172.21.15.80:34964) 2019-11-28T11:29:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f4fcd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd9f0073020 0x7fd9f0071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34284/0 (socket says 172.21.15.80:34284) 2019-11-28T11:29:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f57ce700 1 -- 172.21.15.80:0/1137999599 learned_addr learned my addr 172.21.15.80:0/1137999599 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f57ce700 1 -- 172.21.15.80:0/1137999599 >> v1:172.21.15.174:6789/0 conn(0x7fd9f00734b0 legacy=0x7fd9f00726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f57ce700 1 -- 172.21.15.80:0/1137999599 >> v1:172.21.15.80:6789/0 conn(0x7fd9f0073020 legacy=0x7fd9f0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f57ce700 1 -- 172.21.15.80:0/1137999599 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f0070760 con 0x7fd9f015ed10 2019-11-28T11:29:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9effff700 1 -- 172.21.15.80:0/1137999599 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056378641 0 0) 0x7fd9e0001070 con 0x7fd9f0073020 2019-11-28T11:29:36.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f57ce700 1 --2- 172.21.15.80:0/1137999599 >> v2:172.21.15.80:3300/0 conn(0x7fd9f015ed10 0x7fd9f015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd9d800fac0 tx=0x7fd9d800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f57ce700 1 --2- 172.21.15.80:0/1137999599 >> v2:172.21.15.80:3300/0 conn(0x7fd9f015ed10 0x7fd9f015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd9d800fac0 tx=0x7fd9d800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f57ce700 1 --2- 172.21.15.80:0/1137999599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9f015ed10 0x7fd9f015f100 secure :-1 s=READY pgs=796 cs=0 l=1 rx=0x7fd9d800fac0 tx=0x7fd9d800fe60).ready entity=mon.0 client_cookie=cb6375f4301f55a5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:36.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f57ce700 1 --2- 172.21.15.80:0/1137999599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9f015ed10 0x7fd9f015f100 secure :-1 s=THROTTLE_DONE pgs=796 cs=0 l=1 rx=0x7fd9d800fac0 tx=0x7fd9d800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9effff700 1 -- 172.21.15.80:0/1137999599 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d8000ce0 con 0x7fd9f015ed10 2019-11-28T11:29:36.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f57ce700 1 --2- 172.21.15.80:0/1137999599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9f015ed10 0x7fd9f015f100 secure :-1 s=THROTTLE_DONE pgs=796 cs=0 l=1 rx=0x7fd9d800fac0 tx=0x7fd9d800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f57ce700 1 --2- 172.21.15.80:0/1137999599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9f015ed10 0x7fd9f015f100 secure :-1 s=THROTTLE_DONE pgs=796 cs=0 l=1 rx=0x7fd9d800fac0 tx=0x7fd9d800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9effff700 1 -- 172.21.15.80:0/1137999599 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d8000ce0 con 0x7fd9f015ed10 2019-11-28T11:29:36.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9effff700 1 -- 172.21.15.80:0/1137999599 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d80013f0 con 0x7fd9f015ed10 2019-11-28T11:29:36.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f7231700 1 -- 172.21.15.80:0/1137999599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9f015ed10 msgr2=0x7fd9f015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:36.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.879+0000 7fd9f7231700 1 --2- 172.21.15.80:0/1137999599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9f015ed10 0x7fd9f015f100 secure :-1 s=READY pgs=796 cs=0 l=1 rx=0x7fd9d800fac0 tx=0x7fd9d800fe60).stop 2019-11-28T11:29:36.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.880+0000 7fd9f7231700 1 -- 172.21.15.80:0/1137999599 shutdown_connections 2019-11-28T11:29:36.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.880+0000 7fd9f7231700 1 --2- 172.21.15.80:0/1137999599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9f015ed10 0x7fd9f015f100 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:36.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.880+0000 7fd9f7231700 1 -- 172.21.15.80:0/1137999599 shutdown_connections 2019-11-28T11:29:36.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.880+0000 7fd9f7231700 1 -- 172.21.15.80:0/1137999599 wait complete. 2019-11-28T11:29:36.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.880+0000 7fd9f7231700 1 -- 172.21.15.80:0/1137999599 >> 172.21.15.80:0/1137999599 conn(0x7fd9f0061d20 msgr2=0x7fd9f00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:36.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.883+0000 7fd9f7231700 1 Processor -- start 2019-11-28T11:29:36.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.883+0000 7fd9f7231700 1 -- start start 2019-11-28T11:29:36.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9f7231700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9f010ed60 0x7fd9f010f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:36.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9f7231700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f010c250 con 0x7fd9f010f730 2019-11-28T11:29:36.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9f7231700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f010c6d0 con 0x7fd9f010e970 2019-11-28T11:29:36.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9f7231700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f010e430 con 0x7fd9f010ed60 2019-11-28T11:29:36.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9f5fcf700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd9f010f730 0x7fd9f0167d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34290/0 (socket says 172.21.15.80:34290) 2019-11-28T11:29:36.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9f5fcf700 1 -- 172.21.15.80:0/319981451 learned_addr learned my addr 172.21.15.80:0/319981451 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:36.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9f4fcd700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9f010ed60 0x7fd9f010f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:36.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9edffb700 1 -- 172.21.15.80:0/319981451 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782385262 0 0) 0x7fd9e8000b90 con 0x7fd9f010f730 2019-11-28T11:29:36.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9edffb700 1 -- 172.21.15.80:0/319981451 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9d4002e80 con 0x7fd9f010f730 2019-11-28T11:29:36.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9edffb700 1 -- 172.21.15.80:0/319981451 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787754515 0 0) 0x7fd9d8007c80 con 0x7fd9f010e970 2019-11-28T11:29:36.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9edffb700 1 -- 172.21.15.80:0/319981451 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9d40030b0 con 0x7fd9f010e970 2019-11-28T11:29:36.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9edffb700 1 -- 172.21.15.80:0/319981451 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1540468672 0 0) 0x7fd9e80012b0 con 0x7fd9f010f730 2019-11-28T11:29:36.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9edffb700 1 -- 172.21.15.80:0/319981451 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd9d40033c0 con 0x7fd9f010f730 2019-11-28T11:29:36.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9edffb700 1 -- 172.21.15.80:0/319981451 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd9e8001860 con 0x7fd9f010f730 2019-11-28T11:29:36.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9f4fcd700 1 -- 172.21.15.80:0/319981451 >> v1:172.21.15.174:6789/0 conn(0x7fd9f010e970 legacy=0x7fd9f01087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:36.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9f4fcd700 1 -- 172.21.15.80:0/319981451 >> v1:172.21.15.80:6789/0 conn(0x7fd9f010f730 legacy=0x7fd9f0167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:36.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.884+0000 7fd9f4fcd700 1 -- 172.21.15.80:0/319981451 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f0105ef0 con 0x7fd9f010ed60 2019-11-28T11:29:36.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.885+0000 7fd9f4fcd700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9f010ed60 0x7fd9f010f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd9e0010330 tx=0x7fd9e00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.885+0000 7fd9f4fcd700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9f010ed60 0x7fd9f010f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd9e0010330 tx=0x7fd9e00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.885+0000 7fd9f4fcd700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9f010ed60 0x7fd9f010f1f0 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fd9e0010330 tx=0x7fd9e00106d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:36.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.885+0000 7fd9f4fcd700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9f010ed60 0x7fd9f010f1f0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fd9e0010330 tx=0x7fd9e00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.885+0000 7fd9edffb700 1 -- 172.21.15.80:0/319981451 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9e00041d0 con 0x7fd9f010ed60 2019-11-28T11:29:36.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.885+0000 7fd9f4fcd700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9f010ed60 0x7fd9f010f1f0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fd9e0010330 tx=0x7fd9e00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.885+0000 7fd9f4fcd700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9f010ed60 0x7fd9f010f1f0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fd9e0010330 tx=0x7fd9e00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.885+0000 7fd9edffb700 1 -- 172.21.15.80:0/319981451 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e0000d50 con 0x7fd9f010ed60 2019-11-28T11:29:36.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.885+0000 7fd9f7231700 1 -- 172.21.15.80:0/319981451 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f0106270 con 0x7fd9f010ed60 2019-11-28T11:29:36.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.885+0000 7fd9edffb700 1 -- 172.21.15.80:0/319981451 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9e00047b0 con 0x7fd9f010ed60 2019-11-28T11:29:36.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.885+0000 7fd9f7231700 1 -- 172.21.15.80:0/319981451 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f0105ef0 con 0x7fd9f010ed60 2019-11-28T11:29:36.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.885+0000 7fd9f4fcd700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9f010ed60 0x7fd9f010f1f0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fd9e0010330 tx=0x7fd9e00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.886+0000 7fd9edffb700 1 -- 172.21.15.80:0/319981451 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd9e0003fe0 con 0x7fd9f010ed60 2019-11-28T11:29:36.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.886+0000 7fd9f4fcd700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9f010ed60 0x7fd9f010f1f0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fd9e0010330 tx=0x7fd9e00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.886+0000 7fd9edffb700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd9d40187a0 0x7fd9d401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:36.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.886+0000 7fd9edffb700 1 -- 172.21.15.80:0/319981451 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd9e0031a40 con 0x7fd9f010ed60 2019-11-28T11:29:36.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.886+0000 7fd9f57ce700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd9d40187a0 0x7fd9d401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:36.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.886+0000 7fd9f57ce700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd9d40187a0 0x7fd9d401abf0 crc :-1 s=READY pgs=330 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:36.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.893+0000 7fd9f7231700 1 -- 172.21.15.80:0/319981451 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f0106270 con 0x7fd9f010ed60 2019-11-28T11:29:36.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.897+0000 7fd9f4fcd700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9f010ed60 0x7fd9f010f1f0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fd9e0010330 tx=0x7fd9e00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:36.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:36.897+0000 7fd9edffb700 1 -- 172.21.15.80:0/319981451 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd9e002dfa0 con 0x7fd9f010ed60 2019-11-28T11:29:37.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.063+0000 7fd9f7231700 1 -- 172.21.15.80:0/319981451 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fd9f0105ef0 con 0x7fd9f010ed60 2019-11-28T11:29:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.063+0000 7fd9f4fcd700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9f010ed60 0x7fd9f010f1f0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fd9e0010330 tx=0x7fd9e00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.064+0000 7fd9edffb700 1 -- 172.21.15.80:0/319981451 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v67) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd9e002dfa0 con 0x7fd9f010ed60 2019-11-28T11:29:37.095 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:29:37.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.065+0000 7fd9f7231700 1 -- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd9d40187a0 msgr2=0x7fd9d401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.065+0000 7fd9f7231700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd9d40187a0 0x7fd9d401abf0 crc :-1 s=READY pgs=330 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:37.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.065+0000 7fd9f7231700 1 -- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9f010ed60 msgr2=0x7fd9f010f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.065+0000 7fd9f7231700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9f010ed60 0x7fd9f010f1f0 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fd9e0010330 tx=0x7fd9e00106d0).stop 2019-11-28T11:29:37.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.066+0000 7fd9f7231700 1 -- 172.21.15.80:0/319981451 shutdown_connections 2019-11-28T11:29:37.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.066+0000 7fd9f7231700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9f010ed60 0x7fd9f010f1f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:37.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.066+0000 7fd9f7231700 1 --2- 172.21.15.80:0/319981451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd9d40187a0 0x7fd9d401abf0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:37.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.066+0000 7fd9f7231700 1 -- 172.21.15.80:0/319981451 shutdown_connections 2019-11-28T11:29:37.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.066+0000 7fd9f7231700 1 -- 172.21.15.80:0/319981451 wait complete. 2019-11-28T11:29:37.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.066+0000 7fd9f7231700 1 -- 172.21.15.80:0/319981451 >> 172.21.15.80:0/319981451 conn(0x7fd9f015e2d0 msgr2=0x7fd9f0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:37.107 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:29:37.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.200+0000 7fba74e6a700 1 Processor -- start 2019-11-28T11:29:37.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.200+0000 7fba74e6a700 1 -- start start 2019-11-28T11:29:37.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.201+0000 7fba74e6a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba7015ed10 0x7fba7015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:37.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.201+0000 7fba74e6a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba70073020 0x7fba70071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:37.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.201+0000 7fba74e6a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fba700734b0 0x7fba700723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.201+0000 7fba74e6a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7006fe00 con 0x7fba7015ed10 2019-11-28T11:29:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.201+0000 7fba74e6a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba700700d0 con 0x7fba700734b0 2019-11-28T11:29:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.201+0000 7fba74e6a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7006f3d0 con 0x7fba70073020 2019-11-28T11:29:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.201+0000 7fba6ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba7015ed10 0x7fba7015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.201+0000 7fba6ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba7015ed10 0x7fba7015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34978/0 (socket says 172.21.15.80:34978) 2019-11-28T11:29:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.201+0000 7fba6ed9d700 1 -- 172.21.15.80:0/1096517391 learned_addr learned my addr 172.21.15.80:0/1096517391 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.201+0000 7fba6e59c700 1 --2- 172.21.15.80:0/1096517391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba70073020 0x7fba70071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.201+0000 7fba6f59e700 1 --2- 172.21.15.80:0/1096517391 >> v2:172.21.15.174:3300/0 conn(0x7fba700734b0 0x7fba700723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.202+0000 7fba6ed9d700 1 -- 172.21.15.80:0/1096517391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba70073020 msgr2=0x7fba70071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.202+0000 7fba6ed9d700 1 --2- 172.21.15.80:0/1096517391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba70073020 0x7fba70071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.202+0000 7fba6ed9d700 1 -- 172.21.15.80:0/1096517391 >> v2:172.21.15.174:3300/0 conn(0x7fba700734b0 msgr2=0x7fba700723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.202+0000 7fba6ed9d700 1 --2- 172.21.15.80:0/1096517391 >> v2:172.21.15.174:3300/0 conn(0x7fba700734b0 0x7fba700723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.202+0000 7fba6ed9d700 1 -- 172.21.15.80:0/1096517391 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba70070760 con 0x7fba7015ed10 2019-11-28T11:29:37.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.202+0000 7fba6ed9d700 1 --2- 172.21.15.80:0/1096517391 >> v2:172.21.15.80:3300/0 conn(0x7fba7015ed10 0x7fba7015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fba5800fa40 tx=0x7fba5800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.202+0000 7fba6ed9d700 1 --2- 172.21.15.80:0/1096517391 >> v2:172.21.15.80:3300/0 conn(0x7fba7015ed10 0x7fba7015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fba5800fa40 tx=0x7fba5800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.202+0000 7fba6ed9d700 1 --2- 172.21.15.80:0/1096517391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015ed10 0x7fba7015f100 secure :-1 s=READY pgs=798 cs=0 l=1 rx=0x7fba5800fa40 tx=0x7fba5800f8f0).ready entity=mon.0 client_cookie=dde981ee23000e8f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:37.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.202+0000 7fba6ed9d700 1 --2- 172.21.15.80:0/1096517391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015ed10 0x7fba7015f100 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7fba5800fa40 tx=0x7fba5800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.202+0000 7fba6ed9d700 1 --2- 172.21.15.80:0/1096517391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015ed10 0x7fba7015f100 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7fba5800fa40 tx=0x7fba5800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.202+0000 7fba6dd9b700 1 -- 172.21.15.80:0/1096517391 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba58000ce0 con 0x7fba7015ed10 2019-11-28T11:29:37.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.202+0000 7fba6ed9d700 1 --2- 172.21.15.80:0/1096517391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015ed10 0x7fba7015f100 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7fba5800fa40 tx=0x7fba5800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.202+0000 7fba6dd9b700 1 -- 172.21.15.80:0/1096517391 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba58001010 con 0x7fba7015ed10 2019-11-28T11:29:37.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.202+0000 7fba6dd9b700 1 -- 172.21.15.80:0/1096517391 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba58001720 con 0x7fba7015ed10 2019-11-28T11:29:37.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.202+0000 7fba74e6a700 1 -- 172.21.15.80:0/1096517391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015ed10 msgr2=0x7fba7015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.202+0000 7fba74e6a700 1 --2- 172.21.15.80:0/1096517391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015ed10 0x7fba7015f100 secure :-1 s=READY pgs=798 cs=0 l=1 rx=0x7fba5800fa40 tx=0x7fba5800f8f0).stop 2019-11-28T11:29:37.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.203+0000 7fba74e6a700 1 -- 172.21.15.80:0/1096517391 shutdown_connections 2019-11-28T11:29:37.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.203+0000 7fba74e6a700 1 --2- 172.21.15.80:0/1096517391 >> v2:172.21.15.174:3300/0 conn(0x7fba700734b0 0x7fba700723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:37.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.203+0000 7fba74e6a700 1 --2- 172.21.15.80:0/1096517391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba70073020 0x7fba70071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:37.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.203+0000 7fba74e6a700 1 --2- 172.21.15.80:0/1096517391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015ed10 0x7fba7015f100 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:37.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.203+0000 7fba74e6a700 1 -- 172.21.15.80:0/1096517391 shutdown_connections 2019-11-28T11:29:37.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.203+0000 7fba74e6a700 1 -- 172.21.15.80:0/1096517391 wait complete. 2019-11-28T11:29:37.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.203+0000 7fba74e6a700 1 -- 172.21.15.80:0/1096517391 >> 172.21.15.80:0/1096517391 conn(0x7fba70061d20 msgr2=0x7fba700641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:37.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.205+0000 7fba74e6a700 1 Processor -- start 2019-11-28T11:29:37.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.205+0000 7fba74e6a700 1 -- start start 2019-11-28T11:29:37.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.206+0000 7fba74e6a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fba701079b0 0x7fba70107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:37.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.206+0000 7fba74e6a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba70108380 0x7fba70168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:37.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.206+0000 7fba74e6a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba70148e00 con 0x7fba70148320 2019-11-28T11:29:37.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.206+0000 7fba74e6a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7013aa20 con 0x7fba70108380 2019-11-28T11:29:37.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.206+0000 7fba74e6a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7013acf0 con 0x7fba701079b0 2019-11-28T11:29:37.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.206+0000 7fba6f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba70108380 0x7fba70168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:37.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.206+0000 7fba6f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba70108380 0x7fba70168d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34986/0 (socket says 172.21.15.80:34986) 2019-11-28T11:29:37.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.206+0000 7fba6f59e700 1 -- 172.21.15.80:0/1494955797 learned_addr learned my addr 172.21.15.80:0/1494955797 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:37.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.206+0000 7fba6e59c700 1 --2- 172.21.15.80:0/1494955797 >> v2:172.21.15.174:3300/0 conn(0x7fba701079b0 0x7fba70107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:37.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.206+0000 7fba6f59e700 1 -- 172.21.15.80:0/1494955797 >> v2:172.21.15.174:3300/0 conn(0x7fba701079b0 msgr2=0x7fba70107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.206+0000 7fba6f59e700 1 --2- 172.21.15.80:0/1494955797 >> v2:172.21.15.174:3300/0 conn(0x7fba701079b0 0x7fba70107e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:37.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.206+0000 7fba6f59e700 1 -- 172.21.15.80:0/1494955797 >> v1:172.21.15.174:6789/0 conn(0x7fba70148320 legacy=0x7fba7010ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.206+0000 7fba6f59e700 1 -- 172.21.15.80:0/1494955797 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7010c490 con 0x7fba70108380 2019-11-28T11:29:37.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.207+0000 7fba6f59e700 1 --2- 172.21.15.80:0/1494955797 >> v2:172.21.15.80:3300/0 conn(0x7fba70108380 0x7fba70168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fba68010450 tx=0x7fba68010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.207+0000 7fba6f59e700 1 --2- 172.21.15.80:0/1494955797 >> v2:172.21.15.80:3300/0 conn(0x7fba70108380 0x7fba70168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fba68010450 tx=0x7fba68010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.207+0000 7fba6f59e700 1 --2- 172.21.15.80:0/1494955797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba70108380 0x7fba70168d80 secure :-1 s=READY pgs=799 cs=0 l=1 rx=0x7fba68010450 tx=0x7fba68010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:37.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.207+0000 7fba6f59e700 1 --2- 172.21.15.80:0/1494955797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba70108380 0x7fba70168d80 secure :-1 s=THROTTLE_DONE pgs=799 cs=0 l=1 rx=0x7fba68010450 tx=0x7fba68010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.207+0000 7fba6f59e700 1 --2- 172.21.15.80:0/1494955797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba70108380 0x7fba70168d80 secure :-1 s=THROTTLE_DONE pgs=799 cs=0 l=1 rx=0x7fba68010450 tx=0x7fba68010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.207+0000 7fba6f59e700 1 --2- 172.21.15.80:0/1494955797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba70108380 0x7fba70168d80 secure :-1 s=THROTTLE_DONE pgs=799 cs=0 l=1 rx=0x7fba68010450 tx=0x7fba68010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.207+0000 7fba677fe700 1 -- 172.21.15.80:0/1494955797 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba6800f090 con 0x7fba70108380 2019-11-28T11:29:37.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.207+0000 7fba677fe700 1 -- 172.21.15.80:0/1494955797 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba68000a70 con 0x7fba70108380 2019-11-28T11:29:37.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.207+0000 7fba74e6a700 1 -- 172.21.15.80:0/1494955797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7010c810 con 0x7fba70108380 2019-11-28T11:29:37.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.207+0000 7fba677fe700 1 -- 172.21.15.80:0/1494955797 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba6800f670 con 0x7fba70108380 2019-11-28T11:29:37.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.207+0000 7fba74e6a700 1 -- 172.21.15.80:0/1494955797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba70108820 con 0x7fba70108380 2019-11-28T11:29:37.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.207+0000 7fba6f59e700 1 --2- 172.21.15.80:0/1494955797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba70108380 0x7fba70168d80 secure :-1 s=THROTTLE_DONE pgs=799 cs=0 l=1 rx=0x7fba68010450 tx=0x7fba68010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.207+0000 7fba677fe700 1 -- 172.21.15.80:0/1494955797 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fba6800ed50 con 0x7fba70108380 2019-11-28T11:29:37.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.207+0000 7fba6f59e700 1 --2- 172.21.15.80:0/1494955797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba70108380 0x7fba70168d80 secure :-1 s=THROTTLE_DONE pgs=799 cs=0 l=1 rx=0x7fba68010450 tx=0x7fba68010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.208+0000 7fba677fe700 1 --2- 172.21.15.80:0/1494955797 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba48018730 0x7fba4801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:37.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.208+0000 7fba677fe700 1 -- 172.21.15.80:0/1494955797 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fba68031ad0 con 0x7fba70108380 2019-11-28T11:29:37.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.208+0000 7fba6ed9d700 1 --2- 172.21.15.80:0/1494955797 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba48018730 0x7fba4801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:37.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.208+0000 7fba6ed9d700 1 --2- 172.21.15.80:0/1494955797 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba48018730 0x7fba4801abc0 crc :-1 s=READY pgs=331 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:37.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.215+0000 7fba74e6a700 1 -- 172.21.15.80:0/1494955797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7010c490 con 0x7fba70108380 2019-11-28T11:29:37.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.219+0000 7fba6f59e700 1 --2- 172.21.15.80:0/1494955797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba70108380 0x7fba70168d80 secure :-1 s=THROTTLE_DONE pgs=799 cs=0 l=1 rx=0x7fba68010450 tx=0x7fba68010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.219+0000 7fba677fe700 1 -- 172.21.15.80:0/1494955797 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fba6800ea80 con 0x7fba70108380 2019-11-28T11:29:37.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.385+0000 7fba74e6a700 1 -- 172.21.15.80:0/1494955797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fba7010c810 con 0x7fba70108380 2019-11-28T11:29:37.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.385+0000 7fba6f59e700 1 --2- 172.21.15.80:0/1494955797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba70108380 0x7fba70168d80 secure :-1 s=THROTTLE_DONE pgs=799 cs=0 l=1 rx=0x7fba68010450 tx=0x7fba68010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.385+0000 7fba677fe700 1 -- 172.21.15.80:0/1494955797 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v67) v1 ==== 104+0+10 (secure 0 0 0) 0x7fba6800ec90 con 0x7fba70108380 2019-11-28T11:29:37.418 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:29:37.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.388+0000 7fba74e6a700 1 -- 172.21.15.80:0/1494955797 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba48018730 msgr2=0x7fba4801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.388+0000 7fba74e6a700 1 --2- 172.21.15.80:0/1494955797 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba48018730 0x7fba4801abc0 crc :-1 s=READY pgs=331 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:37.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.388+0000 7fba74e6a700 1 -- 172.21.15.80:0/1494955797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba70108380 msgr2=0x7fba70168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.388+0000 7fba74e6a700 1 --2- 172.21.15.80:0/1494955797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba70108380 0x7fba70168d80 secure :-1 s=READY pgs=799 cs=0 l=1 rx=0x7fba68010450 tx=0x7fba68010280).stop 2019-11-28T11:29:37.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.388+0000 7fba74e6a700 1 -- 172.21.15.80:0/1494955797 shutdown_connections 2019-11-28T11:29:37.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.388+0000 7fba74e6a700 1 --2- 172.21.15.80:0/1494955797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba70108380 0x7fba70168d80 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:37.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.388+0000 7fba74e6a700 1 --2- 172.21.15.80:0/1494955797 >> v2:172.21.15.174:3300/0 conn(0x7fba701079b0 0x7fba70107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:37.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.388+0000 7fba74e6a700 1 --2- 172.21.15.80:0/1494955797 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba48018730 0x7fba4801abc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:37.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.388+0000 7fba74e6a700 1 -- 172.21.15.80:0/1494955797 shutdown_connections 2019-11-28T11:29:37.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.388+0000 7fba74e6a700 1 -- 172.21.15.80:0/1494955797 wait complete. 2019-11-28T11:29:37.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.388+0000 7fba74e6a700 1 -- 172.21.15.80:0/1494955797 >> 172.21.15.80:0/1494955797 conn(0x7fba7015e2d0 msgr2=0x7fba70147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:37.430 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:29:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.522+0000 7fd181ff0700 1 Processor -- start 2019-11-28T11:29:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.522+0000 7fd181ff0700 1 -- start start 2019-11-28T11:29:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.523+0000 7fd181ff0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c15ed10 0x7fd17c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.523+0000 7fd181ff0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd17c073020 0x7fd17c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.523+0000 7fd181ff0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17c06db60 con 0x7fd17c0734b0 2019-11-28T11:29:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.523+0000 7fd181ff0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17c06f3d0 con 0x7fd17c073020 2019-11-28T11:29:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.523+0000 7fd181ff0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c06fe00 con 0x7fd17c15ed10 2019-11-28T11:29:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd173fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd17c073020 0x7fd17c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd17bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c15ed10 0x7fd17c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd173fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd17c073020 0x7fd17c071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:49878/0 (socket says 172.21.15.80:49878) 2019-11-28T11:29:37.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd17bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c15ed10 0x7fd17c15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:37252/0 (socket says 172.21.15.80:37252) 2019-11-28T11:29:37.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd173fff700 1 -- 172.21.15.80:0/1795239649 learned_addr learned my addr 172.21.15.80:0/1795239649 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:37.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd173fff700 1 -- 172.21.15.80:0/1795239649 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c15ed10 msgr2=0x7fd17c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:37.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd173fff700 1 --2- 172.21.15.80:0/1795239649 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c15ed10 0x7fd17c15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd173fff700 1 -- 172.21.15.80:0/1795239649 >> v1:172.21.15.174:6789/0 conn(0x7fd17c0734b0 legacy=0x7fd17c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd173fff700 1 -- 172.21.15.80:0/1795239649 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c070760 con 0x7fd17c073020 2019-11-28T11:29:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd17b7fe700 1 -- 172.21.15.80:0/1795239649 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529728390 0 0) 0x7fd174000d30 con 0x7fd17c0734b0 2019-11-28T11:29:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd173fff700 1 --2- 172.21.15.80:0/1795239649 >> v2:172.21.15.174:3300/0 conn(0x7fd17c073020 0x7fd17c071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd16400f740 tx=0x7fd16400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd173fff700 1 --2- 172.21.15.80:0/1795239649 >> v2:172.21.15.174:3300/0 conn(0x7fd17c073020 0x7fd17c071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd16400f740 tx=0x7fd16400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd173fff700 1 --2- 172.21.15.80:0/1795239649 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd17c073020 0x7fd17c071ea0 secure :-1 s=READY pgs=476 cs=0 l=1 rx=0x7fd16400f740 tx=0x7fd16400f570).ready entity=mon.1 client_cookie=8f4ba1bd1fa2949 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd173fff700 1 --2- 172.21.15.80:0/1795239649 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd17c073020 0x7fd17c071ea0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7fd16400f740 tx=0x7fd16400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd17b7fe700 1 -- 172.21.15.80:0/1795239649 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd164000960 con 0x7fd17c073020 2019-11-28T11:29:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd173fff700 1 --2- 172.21.15.80:0/1795239649 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd17c073020 0x7fd17c071ea0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7fd16400f740 tx=0x7fd16400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd173fff700 1 --2- 172.21.15.80:0/1795239649 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd17c073020 0x7fd17c071ea0 secure :-1 s=THROTTLE_DONE pgs=476 cs=0 l=1 rx=0x7fd16400f740 tx=0x7fd16400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd17b7fe700 1 -- 172.21.15.80:0/1795239649 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd164000c90 con 0x7fd17c073020 2019-11-28T11:29:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd17b7fe700 1 -- 172.21.15.80:0/1795239649 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1640013a0 con 0x7fd17c073020 2019-11-28T11:29:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd181ff0700 1 -- 172.21.15.80:0/1795239649 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd17c073020 msgr2=0x7fd17c071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.524+0000 7fd181ff0700 1 --2- 172.21.15.80:0/1795239649 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd17c073020 0x7fd17c071ea0 secure :-1 s=READY pgs=476 cs=0 l=1 rx=0x7fd16400f740 tx=0x7fd16400f570).stop 2019-11-28T11:29:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.525+0000 7fd181ff0700 1 -- 172.21.15.80:0/1795239649 shutdown_connections 2019-11-28T11:29:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.525+0000 7fd181ff0700 1 --2- 172.21.15.80:0/1795239649 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd17c073020 0x7fd17c071ea0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.525+0000 7fd181ff0700 1 --2- 172.21.15.80:0/1795239649 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c15ed10 0x7fd17c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.525+0000 7fd181ff0700 1 -- 172.21.15.80:0/1795239649 shutdown_connections 2019-11-28T11:29:37.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.525+0000 7fd181ff0700 1 -- 172.21.15.80:0/1795239649 wait complete. 2019-11-28T11:29:37.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.525+0000 7fd181ff0700 1 -- 172.21.15.80:0/1795239649 >> 172.21.15.80:0/1795239649 conn(0x7fd17c061d20 msgr2=0x7fd17c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:37.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.527+0000 7fd181ff0700 1 Processor -- start 2019-11-28T11:29:37.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.528+0000 7fd181ff0700 1 -- start start 2019-11-28T11:29:37.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.528+0000 7fd181ff0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c10e970 0x7fd17c1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:37.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.528+0000 7fd181ff0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17c10c250 con 0x7fd17c108cf0 2019-11-28T11:29:37.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.528+0000 7fd181ff0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17c10c6d0 con 0x7fd17c107e30 2019-11-28T11:29:37.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.528+0000 7fd181ff0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c10da00 con 0x7fd17c10e970 2019-11-28T11:29:37.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.528+0000 7fd173fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd17c108cf0 0x7fd17c107630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34316/0 (socket says 172.21.15.80:34316) 2019-11-28T11:29:37.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.528+0000 7fd173fff700 1 -- 172.21.15.80:0/3911574583 learned_addr learned my addr 172.21.15.80:0/3911574583 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:37.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.528+0000 7fd17bfff700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c10e970 0x7fd17c1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:37.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd1797fa700 1 -- 172.21.15.80:0/3911574583 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039837986 0 0) 0x7fd1640079a0 con 0x7fd17c108cf0 2019-11-28T11:29:37.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd1797fa700 1 -- 172.21.15.80:0/3911574583 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd160002e80 con 0x7fd17c108cf0 2019-11-28T11:29:37.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd1797fa700 1 -- 172.21.15.80:0/3911574583 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059658211 0 0) 0x7fd1740011a0 con 0x7fd17c107e30 2019-11-28T11:29:37.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd1797fa700 1 -- 172.21.15.80:0/3911574583 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd160004220 con 0x7fd17c107e30 2019-11-28T11:29:37.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd17bfff700 1 -- 172.21.15.80:0/3911574583 >> v1:172.21.15.174:6789/0 conn(0x7fd17c107e30 legacy=0x7fd17c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd17bfff700 1 -- 172.21.15.80:0/3911574583 >> v1:172.21.15.80:6789/0 conn(0x7fd17c108cf0 legacy=0x7fd17c107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd17bfff700 1 -- 172.21.15.80:0/3911574583 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c105ef0 con 0x7fd17c10e970 2019-11-28T11:29:37.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd17bfff700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c10e970 0x7fd17c1087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd16c010390 tx=0x7fd16c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd17bfff700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c10e970 0x7fd17c1087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd16c010390 tx=0x7fd16c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd17bfff700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c10e970 0x7fd17c1087b0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fd16c010390 tx=0x7fd16c010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:37.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd17bfff700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c10e970 0x7fd17c1087b0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd16c010390 tx=0x7fd16c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd1797fa700 1 -- 172.21.15.80:0/3911574583 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd16c009640 con 0x7fd17c10e970 2019-11-28T11:29:37.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd17bfff700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c10e970 0x7fd17c1087b0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd16c010390 tx=0x7fd16c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd17bfff700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c10e970 0x7fd17c1087b0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd16c010390 tx=0x7fd16c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd1797fa700 1 -- 172.21.15.80:0/3911574583 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16c000940 con 0x7fd17c10e970 2019-11-28T11:29:37.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd181ff0700 1 -- 172.21.15.80:0/3911574583 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17c106270 con 0x7fd17c10e970 2019-11-28T11:29:37.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd1797fa700 1 -- 172.21.15.80:0/3911574583 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd16c00a0e0 con 0x7fd17c10e970 2019-11-28T11:29:37.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.529+0000 7fd181ff0700 1 -- 172.21.15.80:0/3911574583 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17c105ef0 con 0x7fd17c10e970 2019-11-28T11:29:37.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.530+0000 7fd17bfff700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c10e970 0x7fd17c1087b0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd16c010390 tx=0x7fd16c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.530+0000 7fd1797fa700 1 -- 172.21.15.80:0/3911574583 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd16c009a70 con 0x7fd17c10e970 2019-11-28T11:29:37.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.530+0000 7fd17bfff700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c10e970 0x7fd17c1087b0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd16c010390 tx=0x7fd16c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.530+0000 7fd1797fa700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd160018750 0x7fd16001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:37.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.530+0000 7fd1797fa700 1 -- 172.21.15.80:0/3911574583 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd16c031aa0 con 0x7fd17c10e970 2019-11-28T11:29:37.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.530+0000 7fd173fff700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd160018750 0x7fd16001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:37.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.530+0000 7fd173fff700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd160018750 0x7fd16001abe0 crc :-1 s=READY pgs=332 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:37.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.537+0000 7fd181ff0700 1 -- 172.21.15.80:0/3911574583 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17c106270 con 0x7fd17c10e970 2019-11-28T11:29:37.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.541+0000 7fd17bfff700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c10e970 0x7fd17c1087b0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd16c010390 tx=0x7fd16c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.541+0000 7fd1797fa700 1 -- 172.21.15.80:0/3911574583 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd16c009860 con 0x7fd17c10e970 2019-11-28T11:29:37.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.711+0000 7fd181ff0700 1 -- 172.21.15.80:0/3911574583 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fd17c105ef0 con 0x7fd17c10e970 2019-11-28T11:29:37.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.711+0000 7fd17bfff700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c10e970 0x7fd17c1087b0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd16c010390 tx=0x7fd16c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.711+0000 7fd1797fa700 1 -- 172.21.15.80:0/3911574583 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v67) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd16c009a70 con 0x7fd17c10e970 2019-11-28T11:29:37.743 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:29:37.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.714+0000 7fd181ff0700 1 -- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd160018750 msgr2=0x7fd16001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.714+0000 7fd181ff0700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd160018750 0x7fd16001abe0 crc :-1 s=READY pgs=332 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:37.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.714+0000 7fd181ff0700 1 -- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c10e970 msgr2=0x7fd17c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.714+0000 7fd181ff0700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c10e970 0x7fd17c1087b0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fd16c010390 tx=0x7fd16c010730).stop 2019-11-28T11:29:37.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.714+0000 7fd181ff0700 1 -- 172.21.15.80:0/3911574583 shutdown_connections 2019-11-28T11:29:37.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.714+0000 7fd181ff0700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd160018750 0x7fd16001abe0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:37.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.714+0000 7fd181ff0700 1 --2- 172.21.15.80:0/3911574583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd17c10e970 0x7fd17c1087b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:37.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.714+0000 7fd181ff0700 1 -- 172.21.15.80:0/3911574583 shutdown_connections 2019-11-28T11:29:37.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.714+0000 7fd181ff0700 1 -- 172.21.15.80:0/3911574583 wait complete. 2019-11-28T11:29:37.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.714+0000 7fd181ff0700 1 -- 172.21.15.80:0/3911574583 >> 172.21.15.80:0/3911574583 conn(0x7fd17c15e2d0 msgr2=0x7fd17c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:37.755 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:29:37.756 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:37.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.844+0000 7fb095967700 1 Processor -- start 2019-11-28T11:29:37.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.844+0000 7fb095967700 1 -- start start 2019-11-28T11:29:37.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb095967700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb09006c0a0 0x7fb090072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:37.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb095967700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb0900734e0 0x7fb090071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:37.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb095967700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09006db00 con 0x7fb090072360 2019-11-28T11:29:37.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb095967700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09006f330 con 0x7fb0900734e0 2019-11-28T11:29:37.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb095967700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0900706c0 con 0x7fb09006c0a0 2019-11-28T11:29:37.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb08effd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb0900734e0 0x7fb090071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:37.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb08effd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb0900734e0 0x7fb090071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35010/0 (socket says 172.21.15.80:35010) 2019-11-28T11:29:37.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb08effd700 1 -- 172.21.15.80:0/3301502637 learned_addr learned my addr 172.21.15.80:0/3301502637 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:37.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb08f7fe700 1 --2- 172.21.15.80:0/3301502637 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb09006c0a0 0x7fb090072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:37.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb08effd700 1 -- 172.21.15.80:0/3301502637 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb09006c0a0 msgr2=0x7fb090072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:37.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb08effd700 1 --2- 172.21.15.80:0/3301502637 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb09006c0a0 0x7fb090072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:37.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb08effd700 1 -- 172.21.15.80:0/3301502637 >> v1:172.21.15.80:6789/0 conn(0x7fb090072360 legacy=0x7fb09006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb08effd700 1 -- 172.21.15.80:0/3301502637 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb090070a40 con 0x7fb0900734e0 2019-11-28T11:29:37.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb08e7fc700 1 -- 172.21.15.80:0/3301502637 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687891723 0 0) 0x7fb088000dc0 con 0x7fb090072360 2019-11-28T11:29:37.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb08effd700 1 --2- 172.21.15.80:0/3301502637 >> v2:172.21.15.80:3300/0 conn(0x7fb0900734e0 0x7fb090071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb08000f6c0 tx=0x7fb08000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb08effd700 1 --2- 172.21.15.80:0/3301502637 >> v2:172.21.15.80:3300/0 conn(0x7fb0900734e0 0x7fb090071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb08000f6c0 tx=0x7fb08000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.845+0000 7fb08effd700 1 --2- 172.21.15.80:0/3301502637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0900734e0 0x7fb090071e20 secure :-1 s=READY pgs=802 cs=0 l=1 rx=0x7fb08000f6c0 tx=0x7fb08000fa60).ready entity=mon.0 client_cookie=7eb097577c7f4ffd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:37.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.846+0000 7fb08effd700 1 --2- 172.21.15.80:0/3301502637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0900734e0 0x7fb090071e20 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7fb08000f6c0 tx=0x7fb08000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.846+0000 7fb08e7fc700 1 -- 172.21.15.80:0/3301502637 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb080000960 con 0x7fb0900734e0 2019-11-28T11:29:37.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.846+0000 7fb08effd700 1 --2- 172.21.15.80:0/3301502637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0900734e0 0x7fb090071e20 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7fb08000f6c0 tx=0x7fb08000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.846+0000 7fb08effd700 1 --2- 172.21.15.80:0/3301502637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0900734e0 0x7fb090071e20 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7fb08000f6c0 tx=0x7fb08000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.846+0000 7fb08e7fc700 1 -- 172.21.15.80:0/3301502637 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb080000c90 con 0x7fb0900734e0 2019-11-28T11:29:37.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.846+0000 7fb08e7fc700 1 -- 172.21.15.80:0/3301502637 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb080000960 con 0x7fb0900734e0 2019-11-28T11:29:37.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.846+0000 7fb095967700 1 -- 172.21.15.80:0/3301502637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0900734e0 msgr2=0x7fb090071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.846+0000 7fb095967700 1 --2- 172.21.15.80:0/3301502637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0900734e0 0x7fb090071e20 secure :-1 s=READY pgs=802 cs=0 l=1 rx=0x7fb08000f6c0 tx=0x7fb08000fa60).stop 2019-11-28T11:29:37.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.846+0000 7fb095967700 1 -- 172.21.15.80:0/3301502637 shutdown_connections 2019-11-28T11:29:37.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.846+0000 7fb095967700 1 --2- 172.21.15.80:0/3301502637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0900734e0 0x7fb090071e20 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:37.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.846+0000 7fb095967700 1 --2- 172.21.15.80:0/3301502637 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb09006c0a0 0x7fb090072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:37.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.846+0000 7fb095967700 1 -- 172.21.15.80:0/3301502637 shutdown_connections 2019-11-28T11:29:37.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.846+0000 7fb095967700 1 -- 172.21.15.80:0/3301502637 wait complete. 2019-11-28T11:29:37.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.846+0000 7fb095967700 1 -- 172.21.15.80:0/3301502637 >> 172.21.15.80:0/3301502637 conn(0x7fb090061cf0 msgr2=0x7fb090064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:37.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.849+0000 7fb095967700 1 Processor -- start 2019-11-28T11:29:37.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.849+0000 7fb095967700 1 -- start start 2019-11-28T11:29:37.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb095967700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb09015fdf0 0x7fb09012b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:37.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb095967700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb09012a3c0 0x7fb09012a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:37.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb095967700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09013eb20 con 0x7fb09012b8a0 2019-11-28T11:29:37.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb095967700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb090108820 con 0x7fb09012a3c0 2019-11-28T11:29:37.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb095967700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb090108af0 con 0x7fb09015fdf0 2019-11-28T11:29:37.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb08ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb09012a3c0 0x7fb09012a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:37.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb08ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb09012a3c0 0x7fb09012a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35016/0 (socket says 172.21.15.80:35016) 2019-11-28T11:29:37.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb08ffff700 1 -- 172.21.15.80:0/3202587174 learned_addr learned my addr 172.21.15.80:0/3202587174 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:37.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb08f7fe700 1 --2- 172.21.15.80:0/3202587174 >> v2:172.21.15.174:3300/0 conn(0x7fb09015fdf0 0x7fb09012b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:37.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb08ffff700 1 -- 172.21.15.80:0/3202587174 >> v2:172.21.15.174:3300/0 conn(0x7fb09015fdf0 msgr2=0x7fb09012b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb08ffff700 1 --2- 172.21.15.80:0/3202587174 >> v2:172.21.15.174:3300/0 conn(0x7fb09015fdf0 0x7fb09012b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:37.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb08ffff700 1 -- 172.21.15.80:0/3202587174 >> v1:172.21.15.174:6789/0 conn(0x7fb09012b8a0 legacy=0x7fb09013e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:37.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb08ffff700 1 -- 172.21.15.80:0/3202587174 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09010a8c0 con 0x7fb09012a3c0 2019-11-28T11:29:37.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb08f7fe700 1 --2- 172.21.15.80:0/3202587174 >> v2:172.21.15.174:3300/0 conn(0x7fb09015fdf0 0x7fb09012b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:29:37.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb08ffff700 1 --2- 172.21.15.80:0/3202587174 >> v2:172.21.15.80:3300/0 conn(0x7fb09012a3c0 0x7fb09012a820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb088010790 tx=0x7fb088010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb08ffff700 1 --2- 172.21.15.80:0/3202587174 >> v2:172.21.15.80:3300/0 conn(0x7fb09012a3c0 0x7fb09012a820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb088010790 tx=0x7fb088010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb08ffff700 1 --2- 172.21.15.80:0/3202587174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb09012a3c0 0x7fb09012a820 secure :-1 s=READY pgs=803 cs=0 l=1 rx=0x7fb088010790 tx=0x7fb088010b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:37.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb08ffff700 1 --2- 172.21.15.80:0/3202587174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb09012a3c0 0x7fb09012a820 secure :-1 s=THROTTLE_DONE pgs=803 cs=0 l=1 rx=0x7fb088010790 tx=0x7fb088010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb08ffff700 1 --2- 172.21.15.80:0/3202587174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb09012a3c0 0x7fb09012a820 secure :-1 s=THROTTLE_DONE pgs=803 cs=0 l=1 rx=0x7fb088010790 tx=0x7fb088010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb087fff700 1 -- 172.21.15.80:0/3202587174 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb088005af0 con 0x7fb09012a3c0 2019-11-28T11:29:37.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb08ffff700 1 --2- 172.21.15.80:0/3202587174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb09012a3c0 0x7fb09012a820 secure :-1 s=THROTTLE_DONE pgs=803 cs=0 l=1 rx=0x7fb088010790 tx=0x7fb088010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb087fff700 1 -- 172.21.15.80:0/3202587174 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb088000cc0 con 0x7fb09012a3c0 2019-11-28T11:29:37.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb095967700 1 -- 172.21.15.80:0/3202587174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09010a8c0 con 0x7fb09012a3c0 2019-11-28T11:29:37.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb087fff700 1 -- 172.21.15.80:0/3202587174 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0880060d0 con 0x7fb09012a3c0 2019-11-28T11:29:37.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.850+0000 7fb095967700 1 -- 172.21.15.80:0/3202587174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09010a8c0 con 0x7fb09012a3c0 2019-11-28T11:29:37.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.851+0000 7fb08ffff700 1 --2- 172.21.15.80:0/3202587174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb09012a3c0 0x7fb09012a820 secure :-1 s=THROTTLE_DONE pgs=803 cs=0 l=1 rx=0x7fb088010790 tx=0x7fb088010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.851+0000 7fb087fff700 1 -- 172.21.15.80:0/3202587174 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb0880057b0 con 0x7fb09012a3c0 2019-11-28T11:29:37.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.851+0000 7fb08ffff700 1 --2- 172.21.15.80:0/3202587174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb09012a3c0 0x7fb09012a820 secure :-1 s=THROTTLE_DONE pgs=803 cs=0 l=1 rx=0x7fb088010790 tx=0x7fb088010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.851+0000 7fb087fff700 1 --2- 172.21.15.80:0/3202587174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb068018730 0x7fb06801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:37.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.851+0000 7fb087fff700 1 -- 172.21.15.80:0/3202587174 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb088031df0 con 0x7fb09012a3c0 2019-11-28T11:29:37.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.851+0000 7fb08f7fe700 1 --2- 172.21.15.80:0/3202587174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb068018730 0x7fb06801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:37.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.852+0000 7fb08f7fe700 1 --2- 172.21.15.80:0/3202587174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb068018730 0x7fb06801abc0 crc :-1 s=READY pgs=333 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:37.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.859+0000 7fb095967700 1 -- 172.21.15.80:0/3202587174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb090109180 con 0x7fb09012a3c0 2019-11-28T11:29:37.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.862+0000 7fb08ffff700 1 --2- 172.21.15.80:0/3202587174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb09012a3c0 0x7fb09012a820 secure :-1 s=THROTTLE_DONE pgs=803 cs=0 l=1 rx=0x7fb088010790 tx=0x7fb088010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:37.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:37.863+0000 7fb087fff700 1 -- 172.21.15.80:0/3202587174 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb088007920 con 0x7fb09012a3c0 2019-11-28T11:29:38.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.035+0000 7fb095967700 1 -- 172.21.15.80:0/3202587174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb090109500 con 0x7fb09012a3c0 2019-11-28T11:29:38.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.035+0000 7fb08ffff700 1 --2- 172.21.15.80:0/3202587174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb09012a3c0 0x7fb09012a820 secure :-1 s=THROTTLE_DONE pgs=803 cs=0 l=1 rx=0x7fb088010790 tx=0x7fb088010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:38.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.035+0000 7fb087fff700 1 -- 172.21.15.80:0/3202587174 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2445 (secure 0 0 0) 0x7fb088005710 con 0x7fb09012a3c0 2019-11-28T11:29:38.067 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 38 2019-11-28T11:29:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:38.068 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6312,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1488684602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1488684602},{"type":"v1","addr":"172.21.15.80:6834","nonce":1488684602}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36},{"gid":6315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1002302731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1002302731},{"type":"v1","addr":"172.21.15.80:6835","nonce":1002302731}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:29:26.954212+0000","modified":"2019-11-28T11:29:34.648365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5186":{"gid":5186,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/698358691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":698358691},{"type":"v1","addr":"172.21.15.174:6835","nonce":698358691}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2019-11-28T11:29:38.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.038+0000 7fb095967700 1 -- 172.21.15.80:0/3202587174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb068018730 msgr2=0x7fb06801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:38.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.038+0000 7fb095967700 1 --2- 172.21.15.80:0/3202587174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb068018730 0x7fb06801abc0 crc :-1 s=READY pgs=333 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:38.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.038+0000 7fb095967700 1 -- 172.21.15.80:0/3202587174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb09012a3c0 msgr2=0x7fb09012a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:38.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.038+0000 7fb095967700 1 --2- 172.21.15.80:0/3202587174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb09012a3c0 0x7fb09012a820 secure :-1 s=READY pgs=803 cs=0 l=1 rx=0x7fb088010790 tx=0x7fb088010b30).stop 2019-11-28T11:29:38.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.038+0000 7fb095967700 1 -- 172.21.15.80:0/3202587174 shutdown_connections 2019-11-28T11:29:38.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.038+0000 7fb095967700 1 --2- 172.21.15.80:0/3202587174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb09012a3c0 0x7fb09012a820 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:38.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.038+0000 7fb095967700 1 --2- 172.21.15.80:0/3202587174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb068018730 0x7fb06801abc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:38.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.038+0000 7fb095967700 1 --2- 172.21.15.80:0/3202587174 >> v2:172.21.15.174:3300/0 conn(0x7fb09015fdf0 0x7fb09012b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:38.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.038+0000 7fb095967700 1 -- 172.21.15.80:0/3202587174 shutdown_connections 2019-11-28T11:29:38.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.038+0000 7fb095967700 1 -- 172.21.15.80:0/3202587174 wait complete. 2019-11-28T11:29:38.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.038+0000 7fb095967700 1 -- 172.21.15.80:0/3202587174 >> 172.21.15.80:0/3202587174 conn(0x7fb090127dc0 msgr2=0x7fb090141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:38.386 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5186}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 10, u'failed': [], u'epoch': 38, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [11], u'info': {u'gid_5186': {u'export_targets': [], u'name': u'c', u'incarnation': 37, u'state_seq': 3, u'state': u'up:active', u'gid': 5186, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 698358691, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 698358691, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/698358691'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:29:26.954212+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:29:34.648365+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:29:38.387 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:29:38.387 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:29:38.514 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:29:38.514 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:29:38.515 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:29:38.515 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5186, 2019-11-28T11:29:38.515 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:29:38.515 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:29:38.515 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 4.8341701879999999, 2019-11-28T11:29:38.515 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 38, 2019-11-28T11:29:38.515 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 67, 2019-11-28T11:29:38.516 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 67, 2019-11-28T11:29:38.516 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 9.0624211559999992 2019-11-28T11:29:38.516 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:29:38.519 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5186, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.8341701879999999, "mdsmap_epoch": 38, "osdmap_epoch": 67, "osdmap_epoch_barrier": 67, "uptime": 9.0624211559999992 } 2019-11-28T11:29:38.519 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:29:38.519 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:29:38.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:29:38.519 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:29:38.593 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:29:38.593 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:29:38.733 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:29:38.733 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:29:38.733 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:29:38.734 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:29:38.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:29:38.734 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:29:38.808 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:29:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.899+0000 7f5ca201a700 1 Processor -- start 2019-11-28T11:29:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.899+0000 7f5ca201a700 1 -- start start 2019-11-28T11:29:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5ca201a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c06d120 0x7f5c9c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5ca201a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9c06d580 con 0x7f5c9c06c0a0 2019-11-28T11:29:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5ca201a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9c06db00 con 0x7f5c9c06c490 2019-11-28T11:29:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5ca201a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c06fd60 con 0x7f5c9c06d120 2019-11-28T11:29:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5c9c06c0a0 0x7f5c9c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34336/0 (socket says 172.21.15.80:34336) 2019-11-28T11:29:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9bfff700 1 -- 172.21.15.80:0/1657596363 learned_addr learned my addr 172.21.15.80:0/1657596363 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5ca0db8700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c06d120 0x7f5c9c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9b7fe700 1 -- 172.21.15.80:0/1657596363 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639146491 0 0) 0x7f5c8c001150 con 0x7f5c9c06c0a0 2019-11-28T11:29:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9b7fe700 1 -- 172.21.15.80:0/1657596363 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c88002e80 con 0x7f5c9c06c0a0 2019-11-28T11:29:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9b7fe700 1 -- 172.21.15.80:0/1657596363 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2088676552 0 0) 0x7f5c8c001130 con 0x7f5c9c06c0a0 2019-11-28T11:29:38.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9b7fe700 1 -- 172.21.15.80:0/1657596363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c06d120 msgr2=0x7f5c9c165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:38.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9b7fe700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c06d120 0x7f5c9c165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:38.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9b7fe700 1 -- 172.21.15.80:0/1657596363 >> v1:172.21.15.174:6789/0 conn(0x7f5c9c06c490 legacy=0x7f5c9c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:38.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9b7fe700 1 -- 172.21.15.80:0/1657596363 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c0706c0 con 0x7f5c9c06c0a0 2019-11-28T11:29:38.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9b7fe700 1 -- 172.21.15.80:0/1657596363 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f5c8c001660 con 0x7f5c9c06c0a0 2019-11-28T11:29:38.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9b7fe700 1 -- 172.21.15.80:0/1657596363 >> v1:172.21.15.80:6789/0 conn(0x7f5c9c06c0a0 legacy=0x7f5c9c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:38.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9b7fe700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c88003ab0 0x7f5c88005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:38.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9b7fe700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c88006640 0x7f5c88008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:38.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9b7fe700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c88009310 0x7f5c8800b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:38.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9b7fe700 1 -- 172.21.15.80:0/1657596363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8800bff0 con 0x7f5c88006640 2019-11-28T11:29:38.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9b7fe700 1 -- 172.21.15.80:0/1657596363 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c880501f0 con 0x7f5c88009310 2019-11-28T11:29:38.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c9b7fe700 1 -- 172.21.15.80:0/1657596363 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c88050420 con 0x7f5c88003ab0 2019-11-28T11:29:38.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.900+0000 7f5c93fff700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c88006640 0x7f5c88008b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:38.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5c9bfff700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c88003ab0 0x7f5c88005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:38.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5ca0db8700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c88009310 0x7f5c8800b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:38.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5c93fff700 1 -- 172.21.15.80:0/1657596363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c88003ab0 msgr2=0x7f5c88005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:38.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5c93fff700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c88003ab0 0x7f5c88005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:38.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5c93fff700 1 -- 172.21.15.80:0/1657596363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c88009310 msgr2=0x7f5c8800b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:38.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5c93fff700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c88009310 0x7f5c8800b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:38.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5c93fff700 1 -- 172.21.15.80:0/1657596363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c880506d0 con 0x7f5c88006640 2019-11-28T11:29:38.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5c93fff700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c88006640 0x7f5c88008b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5c8400af70 tx=0x7f5c8400b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:38.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5c93fff700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c88006640 0x7f5c88008b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5c8400af70 tx=0x7f5c8400b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:38.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5c93fff700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c88006640 0x7f5c88008b10 secure :-1 s=READY pgs=805 cs=0 l=1 rx=0x7f5c8400af70 tx=0x7f5c8400b270).ready entity=mon.0 client_cookie=4829b1e232176f3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:38.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5c93fff700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c88006640 0x7f5c88008b10 secure :-1 s=THROTTLE_DONE pgs=805 cs=0 l=1 rx=0x7f5c8400af70 tx=0x7f5c8400b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:38.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5c9b7fe700 1 -- 172.21.15.80:0/1657596363 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c84009af0 con 0x7f5c88006640 2019-11-28T11:29:38.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5c93fff700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c88006640 0x7f5c88008b10 secure :-1 s=THROTTLE_DONE pgs=805 cs=0 l=1 rx=0x7f5c8400af70 tx=0x7f5c8400b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:38.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5c93fff700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c88006640 0x7f5c88008b10 secure :-1 s=THROTTLE_DONE pgs=805 cs=0 l=1 rx=0x7f5c8400af70 tx=0x7f5c8400b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:38.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5c9b7fe700 1 -- 172.21.15.80:0/1657596363 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c84009670 con 0x7f5c88006640 2019-11-28T11:29:38.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5c9b7fe700 1 -- 172.21.15.80:0/1657596363 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c84009860 con 0x7f5c88006640 2019-11-28T11:29:38.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5ca201a700 1 -- 172.21.15.80:0/1657596363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c88006640 msgr2=0x7f5c88008b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:38.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5ca201a700 1 --2- 172.21.15.80:0/1657596363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5c88006640 0x7f5c88008b10 secure :-1 s=READY pgs=805 cs=0 l=1 rx=0x7f5c8400af70 tx=0x7f5c8400b270).stop 2019-11-28T11:29:38.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.901+0000 7f5ca0db8700 1 -- 172.21.15.80:0/1657596363 reap_dead start 2019-11-28T11:29:38.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.902+0000 7f5ca201a700 1 -- 172.21.15.80:0/1657596363 shutdown_connections 2019-11-28T11:29:38.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.902+0000 7f5ca201a700 1 -- 172.21.15.80:0/1657596363 shutdown_connections 2019-11-28T11:29:38.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.902+0000 7f5ca201a700 1 -- 172.21.15.80:0/1657596363 wait complete. 2019-11-28T11:29:38.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.902+0000 7f5ca201a700 1 -- 172.21.15.80:0/1657596363 >> 172.21.15.80:0/1657596363 conn(0x7f5c9c061cf0 msgr2=0x7f5c9c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:38.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.904+0000 7f5ca201a700 1 Processor -- start 2019-11-28T11:29:38.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.904+0000 7f5ca201a700 1 -- start start 2019-11-28T11:29:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.905+0000 7f5ca201a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5c9c074d00 0x7f5c9c07aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.905+0000 7f5ca201a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c150f50 0x7f5c9c07af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.905+0000 7f5ca201a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9c0754d0 con 0x7f5c9c07bba0 2019-11-28T11:29:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.905+0000 7f5ca201a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9c078980 con 0x7f5c9c074d00 2019-11-28T11:29:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.905+0000 7f5ca201a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c078c50 con 0x7f5c9c150f50 2019-11-28T11:29:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.905+0000 7f5c9bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5c9c074d00 0x7f5c9c07aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.905+0000 7f5c93fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c150f50 0x7f5c9c07af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.905+0000 7f5c9bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5c9c074d00 0x7f5c9c07aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:49918/0 (socket says 172.21.15.80:49918) 2019-11-28T11:29:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.905+0000 7f5c9bfff700 1 -- 172.21.15.80:0/3720079189 learned_addr learned my addr 172.21.15.80:0/3720079189 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.905+0000 7f5c93fff700 1 -- 172.21.15.80:0/3720079189 >> v2:172.21.15.174:3300/0 conn(0x7f5c9c074d00 msgr2=0x7f5c9c07aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.905+0000 7f5c93fff700 1 --2- 172.21.15.80:0/3720079189 >> v2:172.21.15.174:3300/0 conn(0x7f5c9c074d00 0x7f5c9c07aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.905+0000 7f5c93fff700 1 -- 172.21.15.80:0/3720079189 >> v1:172.21.15.174:6789/0 conn(0x7f5c9c07bba0 legacy=0x7f5c9c076d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.905+0000 7f5c93fff700 1 -- 172.21.15.80:0/3720079189 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c0792e0 con 0x7f5c9c150f50 2019-11-28T11:29:38.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.906+0000 7f5c93fff700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c150f50 0x7f5c9c07af60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c84010390 tx=0x7f5c840101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:38.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.906+0000 7f5c93fff700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c150f50 0x7f5c9c07af60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c84010390 tx=0x7f5c840101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:38.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.906+0000 7f5c93fff700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c150f50 0x7f5c9c07af60 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f5c84010390 tx=0x7f5c840101c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:38.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.906+0000 7f5c93fff700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c150f50 0x7f5c9c07af60 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f5c84010390 tx=0x7f5c840101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:38.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.906+0000 7f5c93fff700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c150f50 0x7f5c9c07af60 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f5c84010390 tx=0x7f5c840101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:38.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.906+0000 7f5c997fa700 1 -- 172.21.15.80:0/3720079189 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c84000d80 con 0x7f5c9c150f50 2019-11-28T11:29:38.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.906+0000 7f5c93fff700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c150f50 0x7f5c9c07af60 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f5c84010390 tx=0x7f5c840101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:38.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.906+0000 7f5c997fa700 1 -- 172.21.15.80:0/3720079189 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c84001270 con 0x7f5c9c150f50 2019-11-28T11:29:38.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.906+0000 7f5c997fa700 1 -- 172.21.15.80:0/3720079189 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c84001940 con 0x7f5c9c150f50 2019-11-28T11:29:38.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.906+0000 7f5ca201a700 1 -- 172.21.15.80:0/3720079189 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9c079660 con 0x7f5c9c150f50 2019-11-28T11:29:38.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.906+0000 7f5ca201a700 1 -- 172.21.15.80:0/3720079189 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9c0792e0 con 0x7f5c9c150f50 2019-11-28T11:29:38.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.906+0000 7f5c93fff700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c150f50 0x7f5c9c07af60 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f5c84010390 tx=0x7f5c840101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:38.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.906+0000 7f5c997fa700 1 -- 172.21.15.80:0/3720079189 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5c84000ae0 con 0x7f5c9c150f50 2019-11-28T11:29:38.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.906+0000 7f5c93fff700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c150f50 0x7f5c9c07af60 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f5c84010390 tx=0x7f5c840101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:38.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.907+0000 7f5c997fa700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c80018730 0x7f5c8001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:38.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.907+0000 7f5c997fa700 1 -- 172.21.15.80:0/3720079189 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5c840319e0 con 0x7f5c9c150f50 2019-11-28T11:29:38.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.907+0000 7f5c9bfff700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c80018730 0x7f5c8001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:38.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.907+0000 7f5c9bfff700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c80018730 0x7f5c8001abc0 crc :-1 s=READY pgs=334 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:38.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.914+0000 7f5ca201a700 1 -- 172.21.15.80:0/3720079189 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c9c079660 con 0x7f5c9c150f50 2019-11-28T11:29:38.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.918+0000 7f5c93fff700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c150f50 0x7f5c9c07af60 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f5c84010390 tx=0x7f5c840101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:38.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:38.918+0000 7f5c997fa700 1 -- 172.21.15.80:0/3720079189 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5c84001e10 con 0x7f5c9c150f50 2019-11-28T11:29:39.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.093+0000 7f5ca201a700 1 -- 172.21.15.80:0/3720079189 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c9c0792e0 con 0x7f5c9c150f50 2019-11-28T11:29:39.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.095+0000 7f5c93fff700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c150f50 0x7f5c9c07af60 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f5c84010390 tx=0x7f5c840101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.095+0000 7f5c997fa700 1 -- 172.21.15.80:0/3720079189 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+14860 (secure 0 0 0) 0x7f5c84000ae0 con 0x7f5c9c150f50 2019-11-28T11:29:39.127 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:39.128 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":67,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:29:27.955377+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:29:25.290976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2019-11-28T11:29:25.980441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:29:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.098+0000 7f5ca201a700 1 -- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c80018730 msgr2=0x7f5c8001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.098+0000 7f5ca201a700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c80018730 0x7f5c8001abc0 crc :-1 s=READY pgs=334 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.098+0000 7f5ca201a700 1 -- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c150f50 msgr2=0x7f5c9c07af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.098+0000 7f5ca201a700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c150f50 0x7f5c9c07af60 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f5c84010390 tx=0x7f5c840101c0).stop 2019-11-28T11:29:39.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.098+0000 7f5ca201a700 1 -- 172.21.15.80:0/3720079189 shutdown_connections 2019-11-28T11:29:39.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.098+0000 7f5ca201a700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c80018730 0x7f5c8001abc0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.098+0000 7f5ca201a700 1 --2- 172.21.15.80:0/3720079189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c9c150f50 0x7f5c9c07af60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.098+0000 7f5ca201a700 1 --2- 172.21.15.80:0/3720079189 >> v2:172.21.15.174:3300/0 conn(0x7f5c9c074d00 0x7f5c9c07aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.098+0000 7f5ca201a700 1 -- 172.21.15.80:0/3720079189 shutdown_connections 2019-11-28T11:29:39.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.098+0000 7f5ca201a700 1 -- 172.21.15.80:0/3720079189 wait complete. 2019-11-28T11:29:39.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.098+0000 7f5ca201a700 1 -- 172.21.15.80:0/3720079189 >> 172.21.15.80:0/3720079189 conn(0x7f5c9c13fa50 msgr2=0x7f5c9c07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:39.140 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:29:25.290976+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 10, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'66', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:29:25.980441+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 11, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'67', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:29:39.141 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:29:39.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.233+0000 7fcc8bf2b700 1 Processor -- start 2019-11-28T11:29:39.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.233+0000 7fcc8bf2b700 1 -- start start 2019-11-28T11:29:39.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.234+0000 7fcc8bf2b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcc841639f0 0x7fcc84165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:39.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.234+0000 7fcc8bf2b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8406db60 con 0x7fcc8415f100 2019-11-28T11:29:39.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.234+0000 7fcc8bf2b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8406e060 con 0x7fcc8415ed10 2019-11-28T11:29:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.234+0000 7fcc8bf2b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8406fe00 con 0x7fcc841639f0 2019-11-28T11:29:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.234+0000 7fcc89cc7700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcc8415f100 0x7fcc8406bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34360/0 (socket says 172.21.15.80:34360) 2019-11-28T11:29:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.234+0000 7fcc89cc7700 1 -- 172.21.15.80:0/1129921337 learned_addr learned my addr 172.21.15.80:0/1129921337 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.234+0000 7fcc8acc9700 1 --2- 172.21.15.80:0/1129921337 >> v2:172.21.15.174:3300/0 conn(0x7fcc841639f0 0x7fcc84165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.234+0000 7fcc894c6700 1 -- 172.21.15.80:0/1129921337 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144848852 0 0) 0x7fcc78001150 con 0x7fcc8415f100 2019-11-28T11:29:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.234+0000 7fcc894c6700 1 -- 172.21.15.80:0/1129921337 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc6c002e80 con 0x7fcc8415f100 2019-11-28T11:29:39.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.234+0000 7fcc894c6700 1 -- 172.21.15.80:0/1129921337 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734235782 0 0) 0x7fcc7c001080 con 0x7fcc8415ed10 2019-11-28T11:29:39.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.234+0000 7fcc894c6700 1 -- 172.21.15.80:0/1129921337 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc6c0030b0 con 0x7fcc8415ed10 2019-11-28T11:29:39.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.235+0000 7fcc8acc9700 1 -- 172.21.15.80:0/1129921337 >> v1:172.21.15.174:6789/0 conn(0x7fcc8415ed10 legacy=0x7fcc84073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.235+0000 7fcc8acc9700 1 -- 172.21.15.80:0/1129921337 >> v1:172.21.15.80:6789/0 conn(0x7fcc8415f100 legacy=0x7fcc8406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.235+0000 7fcc8acc9700 1 -- 172.21.15.80:0/1129921337 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc84070760 con 0x7fcc841639f0 2019-11-28T11:29:39.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.235+0000 7fcc8acc9700 1 --2- 172.21.15.80:0/1129921337 >> v2:172.21.15.174:3300/0 conn(0x7fcc841639f0 0x7fcc84165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcc7400b300 tx=0x7fcc7400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.235+0000 7fcc8acc9700 1 --2- 172.21.15.80:0/1129921337 >> v2:172.21.15.174:3300/0 conn(0x7fcc841639f0 0x7fcc84165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcc7400b300 tx=0x7fcc7400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.235+0000 7fcc8acc9700 1 --2- 172.21.15.80:0/1129921337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc841639f0 0x7fcc84165df0 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7fcc7400b300 tx=0x7fcc7400bb10).ready entity=mon.1 client_cookie=971accc0648817af server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:39.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.235+0000 7fcc8acc9700 1 --2- 172.21.15.80:0/1129921337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc841639f0 0x7fcc84165df0 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7fcc7400b300 tx=0x7fcc7400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.235+0000 7fcc894c6700 1 -- 172.21.15.80:0/1129921337 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc740075c0 con 0x7fcc841639f0 2019-11-28T11:29:39.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.235+0000 7fcc8acc9700 1 --2- 172.21.15.80:0/1129921337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc841639f0 0x7fcc84165df0 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7fcc7400b300 tx=0x7fcc7400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.235+0000 7fcc8acc9700 1 --2- 172.21.15.80:0/1129921337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc841639f0 0x7fcc84165df0 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7fcc7400b300 tx=0x7fcc7400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.235+0000 7fcc894c6700 1 -- 172.21.15.80:0/1129921337 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc74000f30 con 0x7fcc841639f0 2019-11-28T11:29:39.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.235+0000 7fcc894c6700 1 -- 172.21.15.80:0/1129921337 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc74009f50 con 0x7fcc841639f0 2019-11-28T11:29:39.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.235+0000 7fcc8bf2b700 1 -- 172.21.15.80:0/1129921337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc841639f0 msgr2=0x7fcc84165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.235+0000 7fcc8bf2b700 1 --2- 172.21.15.80:0/1129921337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc841639f0 0x7fcc84165df0 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7fcc7400b300 tx=0x7fcc7400bb10).stop 2019-11-28T11:29:39.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.236+0000 7fcc8bf2b700 1 -- 172.21.15.80:0/1129921337 shutdown_connections 2019-11-28T11:29:39.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.236+0000 7fcc8bf2b700 1 --2- 172.21.15.80:0/1129921337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc841639f0 0x7fcc84165df0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.236+0000 7fcc8bf2b700 1 -- 172.21.15.80:0/1129921337 shutdown_connections 2019-11-28T11:29:39.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.236+0000 7fcc8bf2b700 1 -- 172.21.15.80:0/1129921337 wait complete. 2019-11-28T11:29:39.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.236+0000 7fcc8bf2b700 1 -- 172.21.15.80:0/1129921337 >> 172.21.15.80:0/1129921337 conn(0x7fcc84061d20 msgr2=0x7fcc840641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:39.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.238+0000 7fcc8bf2b700 1 Processor -- start 2019-11-28T11:29:39.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.238+0000 7fcc8bf2b700 1 -- start start 2019-11-28T11:29:39.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.239+0000 7fcc8bf2b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc84073290 0x7fcc84075520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:39.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.239+0000 7fcc8bf2b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcc84075a60 0x7fcc84148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:39.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.239+0000 7fcc8bf2b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc841321a0 con 0x7fcc84148580 2019-11-28T11:29:39.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.239+0000 7fcc8bf2b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc841334a0 con 0x7fcc84075a60 2019-11-28T11:29:39.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.239+0000 7fcc8bf2b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8407ae50 con 0x7fcc84073290 2019-11-28T11:29:39.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.239+0000 7fcc89cc7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcc84075a60 0x7fcc84148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:39.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.239+0000 7fcc89cc7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcc84075a60 0x7fcc84148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35048/0 (socket says 172.21.15.80:35048) 2019-11-28T11:29:39.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.239+0000 7fcc89cc7700 1 -- 172.21.15.80:0/2450322211 learned_addr learned my addr 172.21.15.80:0/2450322211 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:39.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.239+0000 7fcc8a4c8700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc84073290 0x7fcc84075520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:39.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.239+0000 7fcc89cc7700 1 -- 172.21.15.80:0/2450322211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc84073290 msgr2=0x7fcc84075520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.239+0000 7fcc89cc7700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc84073290 0x7fcc84075520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.239+0000 7fcc89cc7700 1 -- 172.21.15.80:0/2450322211 >> v1:172.21.15.80:6789/0 conn(0x7fcc84148580 legacy=0x7fcc840743a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.239+0000 7fcc89cc7700 1 -- 172.21.15.80:0/2450322211 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8407b1d0 con 0x7fcc84075a60 2019-11-28T11:29:39.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.239+0000 7fcc82ffd700 1 -- 172.21.15.80:0/2450322211 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781305503 0 0) 0x7fcc74009cd0 con 0x7fcc84148580 2019-11-28T11:29:39.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.239+0000 7fcc89cc7700 1 --2- 172.21.15.80:0/2450322211 >> v2:172.21.15.80:3300/0 conn(0x7fcc84075a60 0x7fcc84148040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc780103e0 tx=0x7fcc78010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.240+0000 7fcc89cc7700 1 --2- 172.21.15.80:0/2450322211 >> v2:172.21.15.80:3300/0 conn(0x7fcc84075a60 0x7fcc84148040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc780103e0 tx=0x7fcc78010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.240+0000 7fcc89cc7700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc84075a60 0x7fcc84148040 secure :-1 s=READY pgs=808 cs=0 l=1 rx=0x7fcc780103e0 tx=0x7fcc78010260).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:39.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.240+0000 7fcc89cc7700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc84075a60 0x7fcc84148040 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7fcc780103e0 tx=0x7fcc78010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.240+0000 7fcc82ffd700 1 -- 172.21.15.80:0/2450322211 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc78000c90 con 0x7fcc84075a60 2019-11-28T11:29:39.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.240+0000 7fcc89cc7700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc84075a60 0x7fcc84148040 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7fcc780103e0 tx=0x7fcc78010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.240+0000 7fcc8bf2b700 1 -- 172.21.15.80:0/2450322211 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8407b1d0 con 0x7fcc84075a60 2019-11-28T11:29:39.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.240+0000 7fcc82ffd700 1 -- 172.21.15.80:0/2450322211 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc78000c90 con 0x7fcc84075a60 2019-11-28T11:29:39.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.240+0000 7fcc89cc7700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc84075a60 0x7fcc84148040 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7fcc780103e0 tx=0x7fcc78010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.240+0000 7fcc82ffd700 1 -- 172.21.15.80:0/2450322211 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc78000e80 con 0x7fcc84075a60 2019-11-28T11:29:39.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.240+0000 7fcc8bf2b700 1 -- 172.21.15.80:0/2450322211 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8407b1d0 con 0x7fcc84075a60 2019-11-28T11:29:39.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.240+0000 7fcc89cc7700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc84075a60 0x7fcc84148040 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7fcc780103e0 tx=0x7fcc78010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.240+0000 7fcc82ffd700 1 -- 172.21.15.80:0/2450322211 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcc78000e80 con 0x7fcc84075a60 2019-11-28T11:29:39.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.240+0000 7fcc89cc7700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc84075a60 0x7fcc84148040 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7fcc780103e0 tx=0x7fcc78010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.241+0000 7fcc82ffd700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcc64018730 0x7fcc6401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:39.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.241+0000 7fcc82ffd700 1 -- 172.21.15.80:0/2450322211 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fcc78031aa0 con 0x7fcc84075a60 2019-11-28T11:29:39.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.241+0000 7fcc8a4c8700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcc64018730 0x7fcc6401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:39.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.241+0000 7fcc8a4c8700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcc64018730 0x7fcc6401abc0 crc :-1 s=READY pgs=335 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:39.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.248+0000 7fcc8bf2b700 1 -- 172.21.15.80:0/2450322211 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8407b1d0 con 0x7fcc84075a60 2019-11-28T11:29:39.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.252+0000 7fcc89cc7700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc84075a60 0x7fcc84148040 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7fcc780103e0 tx=0x7fcc78010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.252+0000 7fcc82ffd700 1 -- 172.21.15.80:0/2450322211 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcc7802af50 con 0x7fcc84075a60 2019-11-28T11:29:39.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.419+0000 7fcc8bf2b700 1 -- 172.21.15.80:0/2450322211 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fcc8407b1d0 con 0x7fcc84075a60 2019-11-28T11:29:39.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.420+0000 7fcc89cc7700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc84075a60 0x7fcc84148040 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7fcc780103e0 tx=0x7fcc78010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.420+0000 7fcc82ffd700 1 -- 172.21.15.80:0/2450322211 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v67) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcc7802af50 con 0x7fcc84075a60 2019-11-28T11:29:39.452 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:29:39.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.422+0000 7fcc8bf2b700 1 -- 172.21.15.80:0/2450322211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcc64018730 msgr2=0x7fcc6401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.422+0000 7fcc8bf2b700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcc64018730 0x7fcc6401abc0 crc :-1 s=READY pgs=335 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.422+0000 7fcc8bf2b700 1 -- 172.21.15.80:0/2450322211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc84075a60 msgr2=0x7fcc84148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.422+0000 7fcc8bf2b700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc84075a60 0x7fcc84148040 secure :-1 s=READY pgs=808 cs=0 l=1 rx=0x7fcc780103e0 tx=0x7fcc78010260).stop 2019-11-28T11:29:39.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.422+0000 7fcc8bf2b700 1 -- 172.21.15.80:0/2450322211 shutdown_connections 2019-11-28T11:29:39.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.422+0000 7fcc8bf2b700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcc64018730 0x7fcc6401abc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.422+0000 7fcc8bf2b700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc84075a60 0x7fcc84148040 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.422+0000 7fcc8bf2b700 1 --2- 172.21.15.80:0/2450322211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc84073290 0x7fcc84075520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.422+0000 7fcc8bf2b700 1 -- 172.21.15.80:0/2450322211 shutdown_connections 2019-11-28T11:29:39.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.422+0000 7fcc8bf2b700 1 -- 172.21.15.80:0/2450322211 wait complete. 2019-11-28T11:29:39.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.422+0000 7fcc8bf2b700 1 -- 172.21.15.80:0/2450322211 >> 172.21.15.80:0/2450322211 conn(0x7fcc84147670 msgr2=0x7fcc841641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:39.464 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:29:39.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.557+0000 7f01ec230700 1 Processor -- start 2019-11-28T11:29:39.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.557+0000 7f01ec230700 1 -- start start 2019-11-28T11:29:39.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01ec230700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01e415ed10 0x7f01e415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:39.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01ec230700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01e40734b0 0x7f01e40726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:39.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01ec230700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e406db60 con 0x7f01e4073020 2019-11-28T11:29:39.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01ec230700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e406f3d0 con 0x7f01e40734b0 2019-11-28T11:29:39.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01ec230700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e406fe00 con 0x7f01e415ed10 2019-11-28T11:29:39.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01eafce700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01e40734b0 0x7f01e40726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:39.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01e9fcc700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f01e4073020 0x7f01e4071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34374/0 (socket says 172.21.15.80:34374) 2019-11-28T11:29:39.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01e9fcc700 1 -- 172.21.15.80:0/3208836576 learned_addr learned my addr 172.21.15.80:0/3208836576 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:39.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01ea7cd700 1 --2- 172.21.15.80:0/3208836576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01e415ed10 0x7f01e415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:39.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01eafce700 1 -- 172.21.15.80:0/3208836576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01e415ed10 msgr2=0x7f01e415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:39.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01eafce700 1 --2- 172.21.15.80:0/3208836576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01e415ed10 0x7f01e415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:39.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01eafce700 1 -- 172.21.15.80:0/3208836576 >> v1:172.21.15.80:6789/0 conn(0x7f01e4073020 legacy=0x7f01e4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01e97cb700 1 -- 172.21.15.80:0/3208836576 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588331270 0 0) 0x7f01cc0013f0 con 0x7f01e4073020 2019-11-28T11:29:39.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01eafce700 1 -- 172.21.15.80:0/3208836576 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e4070760 con 0x7f01e40734b0 2019-11-28T11:29:39.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01ea7cd700 1 --2- 172.21.15.80:0/3208836576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01e415ed10 0x7f01e415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:29:39.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01eafce700 1 --2- 172.21.15.80:0/3208836576 >> v2:172.21.15.80:3300/0 conn(0x7f01e40734b0 0x7f01e40726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f01dc00af50 tx=0x7f01dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01eafce700 1 --2- 172.21.15.80:0/3208836576 >> v2:172.21.15.80:3300/0 conn(0x7f01e40734b0 0x7f01e40726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f01dc00af50 tx=0x7f01dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01eafce700 1 --2- 172.21.15.80:0/3208836576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e40734b0 0x7f01e40726a0 secure :-1 s=READY pgs=810 cs=0 l=1 rx=0x7f01dc00af50 tx=0x7f01dc00b760).ready entity=mon.0 client_cookie=afefacb000a8bc88 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:39.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01eafce700 1 --2- 172.21.15.80:0/3208836576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e40734b0 0x7f01e40726a0 secure :-1 s=THROTTLE_DONE pgs=810 cs=0 l=1 rx=0x7f01dc00af50 tx=0x7f01dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01e97cb700 1 -- 172.21.15.80:0/3208836576 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01dc009ba0 con 0x7f01e40734b0 2019-11-28T11:29:39.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01eafce700 1 --2- 172.21.15.80:0/3208836576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e40734b0 0x7f01e40726a0 secure :-1 s=THROTTLE_DONE pgs=810 cs=0 l=1 rx=0x7f01dc00af50 tx=0x7f01dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01eafce700 1 --2- 172.21.15.80:0/3208836576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e40734b0 0x7f01e40726a0 secure :-1 s=THROTTLE_DONE pgs=810 cs=0 l=1 rx=0x7f01dc00af50 tx=0x7f01dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.558+0000 7f01e97cb700 1 -- 172.21.15.80:0/3208836576 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc0097c0 con 0x7f01e40734b0 2019-11-28T11:29:39.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.559+0000 7f01e97cb700 1 -- 172.21.15.80:0/3208836576 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01dc000bc0 con 0x7f01e40734b0 2019-11-28T11:29:39.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.559+0000 7f01ec230700 1 -- 172.21.15.80:0/3208836576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e40734b0 msgr2=0x7f01e40726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.559+0000 7f01ec230700 1 --2- 172.21.15.80:0/3208836576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e40734b0 0x7f01e40726a0 secure :-1 s=READY pgs=810 cs=0 l=1 rx=0x7f01dc00af50 tx=0x7f01dc00b760).stop 2019-11-28T11:29:39.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.559+0000 7f01ec230700 1 -- 172.21.15.80:0/3208836576 shutdown_connections 2019-11-28T11:29:39.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.559+0000 7f01ec230700 1 --2- 172.21.15.80:0/3208836576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e40734b0 0x7f01e40726a0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.559+0000 7f01ec230700 1 --2- 172.21.15.80:0/3208836576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01e415ed10 0x7f01e415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:39.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.559+0000 7f01ec230700 1 -- 172.21.15.80:0/3208836576 shutdown_connections 2019-11-28T11:29:39.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.559+0000 7f01ec230700 1 -- 172.21.15.80:0/3208836576 wait complete. 2019-11-28T11:29:39.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.559+0000 7f01ec230700 1 -- 172.21.15.80:0/3208836576 >> 172.21.15.80:0/3208836576 conn(0x7f01e4061d20 msgr2=0x7f01e40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:39.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.562+0000 7f01ec230700 1 Processor -- start 2019-11-28T11:29:39.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.562+0000 7f01ec230700 1 -- start start 2019-11-28T11:29:39.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01ec230700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01e410ed60 0x7f01e410f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:39.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01ec230700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01e410f730 0x7f01e4167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:39.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01ec230700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e410c250 con 0x7f01e410e970 2019-11-28T11:29:39.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01ec230700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e410e430 con 0x7f01e410ed60 2019-11-28T11:29:39.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01ec230700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e4105860 con 0x7f01e410f730 2019-11-28T11:29:39.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01e9fcc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01e410ed60 0x7f01e410f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:39.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01e9fcc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01e410ed60 0x7f01e410f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35062/0 (socket says 172.21.15.80:35062) 2019-11-28T11:29:39.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01e9fcc700 1 -- 172.21.15.80:0/1267981667 learned_addr learned my addr 172.21.15.80:0/1267981667 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:39.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01eafce700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01e410f730 0x7f01e4167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:39.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01e9fcc700 1 -- 172.21.15.80:0/1267981667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01e410f730 msgr2=0x7f01e4167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01e9fcc700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01e410f730 0x7f01e4167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01e9fcc700 1 -- 172.21.15.80:0/1267981667 >> v1:172.21.15.174:6789/0 conn(0x7f01e410e970 legacy=0x7f01e41087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01e9fcc700 1 -- 172.21.15.80:0/1267981667 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e4105ef0 con 0x7f01e410ed60 2019-11-28T11:29:39.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01e9fcc700 1 --2- 172.21.15.80:0/1267981667 >> v2:172.21.15.80:3300/0 conn(0x7f01e410ed60 0x7f01e410f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f01cc0107c0 tx=0x7f01cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01e9fcc700 1 --2- 172.21.15.80:0/1267981667 >> v2:172.21.15.80:3300/0 conn(0x7f01e410ed60 0x7f01e410f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f01cc0107c0 tx=0x7f01cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01e9fcc700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e410ed60 0x7f01e410f1f0 secure :-1 s=READY pgs=811 cs=0 l=1 rx=0x7f01cc0107c0 tx=0x7f01cc0105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:39.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01e9fcc700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e410ed60 0x7f01e410f1f0 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f01cc0107c0 tx=0x7f01cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01e2ffd700 1 -- 172.21.15.80:0/1267981667 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01cc0010d0 con 0x7f01e410ed60 2019-11-28T11:29:39.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01e9fcc700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e410ed60 0x7f01e410f1f0 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f01cc0107c0 tx=0x7f01cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01e9fcc700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e410ed60 0x7f01e410f1f0 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f01cc0107c0 tx=0x7f01cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01e2ffd700 1 -- 172.21.15.80:0/1267981667 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc004360 con 0x7f01e410ed60 2019-11-28T11:29:39.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01ec230700 1 -- 172.21.15.80:0/1267981667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e4106270 con 0x7f01e410ed60 2019-11-28T11:29:39.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01e2ffd700 1 -- 172.21.15.80:0/1267981667 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01cc0049f0 con 0x7f01e410ed60 2019-11-28T11:29:39.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.563+0000 7f01ec230700 1 -- 172.21.15.80:0/1267981667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e4105ef0 con 0x7f01e410ed60 2019-11-28T11:29:39.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.564+0000 7f01e9fcc700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e410ed60 0x7f01e410f1f0 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f01cc0107c0 tx=0x7f01cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.564+0000 7f01e2ffd700 1 -- 172.21.15.80:0/1267981667 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f01cc0010d0 con 0x7f01e410ed60 2019-11-28T11:29:39.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.564+0000 7f01e9fcc700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e410ed60 0x7f01e410f1f0 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f01cc0107c0 tx=0x7f01cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.564+0000 7f01e2ffd700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01c8018730 0x7f01c801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:39.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.564+0000 7f01e2ffd700 1 -- 172.21.15.80:0/1267981667 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f01cc031e10 con 0x7f01e410ed60 2019-11-28T11:29:39.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.564+0000 7f01ea7cd700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01c8018730 0x7f01c801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:39.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.565+0000 7f01ea7cd700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01c8018730 0x7f01c801abc0 crc :-1 s=READY pgs=336 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:39.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.572+0000 7f01ec230700 1 -- 172.21.15.80:0/1267981667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e4106270 con 0x7f01e410ed60 2019-11-28T11:29:39.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.575+0000 7f01e9fcc700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e410ed60 0x7f01e410f1f0 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f01cc0107c0 tx=0x7f01cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.576+0000 7f01e2ffd700 1 -- 172.21.15.80:0/1267981667 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f01cc000cc0 con 0x7f01e410ed60 2019-11-28T11:29:39.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.742+0000 7f01ec230700 1 -- 172.21.15.80:0/1267981667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f01e4105ef0 con 0x7f01e410ed60 2019-11-28T11:29:39.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.742+0000 7f01e9fcc700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e410ed60 0x7f01e410f1f0 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f01cc0107c0 tx=0x7f01cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.742+0000 7f01e2ffd700 1 -- 172.21.15.80:0/1267981667 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v67) v1 ==== 104+0+10 (secure 0 0 0) 0x7f01cc0010b0 con 0x7f01e410ed60 2019-11-28T11:29:39.774 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:29:39.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.745+0000 7f01ec230700 1 -- 172.21.15.80:0/1267981667 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01c8018730 msgr2=0x7f01c801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.745+0000 7f01ec230700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01c8018730 0x7f01c801abc0 crc :-1 s=READY pgs=336 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.745+0000 7f01ec230700 1 -- 172.21.15.80:0/1267981667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e410ed60 msgr2=0x7f01e410f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.745+0000 7f01ec230700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e410ed60 0x7f01e410f1f0 secure :-1 s=READY pgs=811 cs=0 l=1 rx=0x7f01cc0107c0 tx=0x7f01cc0105f0).stop 2019-11-28T11:29:39.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.745+0000 7f01ec230700 1 -- 172.21.15.80:0/1267981667 shutdown_connections 2019-11-28T11:29:39.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.745+0000 7f01ec230700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01e410f730 0x7f01e4167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.745+0000 7f01ec230700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e410ed60 0x7f01e410f1f0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.745+0000 7f01ec230700 1 --2- 172.21.15.80:0/1267981667 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01c8018730 0x7f01c801abc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.745+0000 7f01ec230700 1 -- 172.21.15.80:0/1267981667 shutdown_connections 2019-11-28T11:29:39.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.745+0000 7f01ec230700 1 -- 172.21.15.80:0/1267981667 wait complete. 2019-11-28T11:29:39.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.745+0000 7f01ec230700 1 -- 172.21.15.80:0/1267981667 >> 172.21.15.80:0/1267981667 conn(0x7f01e415e2d0 msgr2=0x7f01e4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:39.786 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:29:39.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.877+0000 7f5882abe700 1 Processor -- start 2019-11-28T11:29:39.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.877+0000 7f5882abe700 1 -- start start 2019-11-28T11:29:39.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.878+0000 7f5882abe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c15ed10 0x7f587c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:39.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.878+0000 7f5882abe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f587c0734b0 0x7f587c0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:39.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.878+0000 7f5882abe700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c06db60 con 0x7f587c073020 2019-11-28T11:29:39.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.878+0000 7f5882abe700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c06f3d0 con 0x7f587c0734b0 2019-11-28T11:29:39.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.878+0000 7f5882abe700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c06fe00 con 0x7f587c15ed10 2019-11-28T11:29:39.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.878+0000 7f588105b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c15ed10 0x7f587c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:39.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.878+0000 7f588105b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c15ed10 0x7f587c15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:37328/0 (socket says 172.21.15.80:37328) 2019-11-28T11:29:39.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.878+0000 7f588105b700 1 -- 172.21.15.80:0/2883893661 learned_addr learned my addr 172.21.15.80:0/2883893661 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:39.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.878+0000 7f588185c700 1 --2- 172.21.15.80:0/2883893661 >> v2:172.21.15.174:3300/0 conn(0x7f587c0734b0 0x7f587c0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:39.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.879+0000 7f588105b700 1 -- 172.21.15.80:0/2883893661 >> v2:172.21.15.174:3300/0 conn(0x7f587c0734b0 msgr2=0x7f587c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:39.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.879+0000 7f588105b700 1 --2- 172.21.15.80:0/2883893661 >> v2:172.21.15.174:3300/0 conn(0x7f587c0734b0 0x7f587c0726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:39.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.879+0000 7f588105b700 1 -- 172.21.15.80:0/2883893661 >> v1:172.21.15.174:6789/0 conn(0x7f587c073020 legacy=0x7f587c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.879+0000 7f588105b700 1 -- 172.21.15.80:0/2883893661 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c070760 con 0x7f587c15ed10 2019-11-28T11:29:39.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.879+0000 7f588185c700 1 --2- 172.21.15.80:0/2883893661 >> v2:172.21.15.174:3300/0 conn(0x7f587c0734b0 0x7f587c0726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:39.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.879+0000 7f588105b700 1 --2- 172.21.15.80:0/2883893661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c15ed10 0x7f587c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f587000f740 tx=0x7f587000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.879+0000 7f588105b700 1 --2- 172.21.15.80:0/2883893661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c15ed10 0x7f587c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f587000f740 tx=0x7f587000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.879+0000 7f588105b700 1 --2- 172.21.15.80:0/2883893661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c15ed10 0x7f587c15f100 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f587000f740 tx=0x7f587000fae0).ready entity=mon.2 client_cookie=7d7bf337334b7d81 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:39.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.879+0000 7f588105b700 1 --2- 172.21.15.80:0/2883893661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c15ed10 0x7f587c15f100 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f587000f740 tx=0x7f587000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.879+0000 7f588105b700 1 --2- 172.21.15.80:0/2883893661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c15ed10 0x7f587c15f100 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f587000f740 tx=0x7f587000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.879+0000 7f586ffff700 1 -- 172.21.15.80:0/2883893661 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5870000960 con 0x7f587c15ed10 2019-11-28T11:29:39.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.879+0000 7f588105b700 1 --2- 172.21.15.80:0/2883893661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c15ed10 0x7f587c15f100 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f587000f740 tx=0x7f587000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.879+0000 7f586ffff700 1 -- 172.21.15.80:0/2883893661 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5870000c90 con 0x7f587c15ed10 2019-11-28T11:29:39.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.879+0000 7f586ffff700 1 -- 172.21.15.80:0/2883893661 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58700013a0 con 0x7f587c15ed10 2019-11-28T11:29:39.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.879+0000 7f5882abe700 1 -- 172.21.15.80:0/2883893661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c15ed10 msgr2=0x7f587c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.879+0000 7f5882abe700 1 --2- 172.21.15.80:0/2883893661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c15ed10 0x7f587c15f100 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f587000f740 tx=0x7f587000fae0).stop 2019-11-28T11:29:39.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.880+0000 7f5882abe700 1 -- 172.21.15.80:0/2883893661 shutdown_connections 2019-11-28T11:29:39.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.880+0000 7f5882abe700 1 --2- 172.21.15.80:0/2883893661 >> v2:172.21.15.174:3300/0 conn(0x7f587c0734b0 0x7f587c0726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:39.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.880+0000 7f5882abe700 1 --2- 172.21.15.80:0/2883893661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c15ed10 0x7f587c15f100 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:39.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.880+0000 7f5882abe700 1 -- 172.21.15.80:0/2883893661 shutdown_connections 2019-11-28T11:29:39.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.880+0000 7f5882abe700 1 -- 172.21.15.80:0/2883893661 wait complete. 2019-11-28T11:29:39.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.880+0000 7f5882abe700 1 -- 172.21.15.80:0/2883893661 >> 172.21.15.80:0/2883893661 conn(0x7f587c061d20 msgr2=0x7f587c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:39.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.882+0000 7f5882abe700 1 Processor -- start 2019-11-28T11:29:39.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.882+0000 7f5882abe700 1 -- start start 2019-11-28T11:29:39.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.883+0000 7f5882abe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c12bde0 0x7f587c12c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:39.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.883+0000 7f5882abe700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c104420 con 0x7f587c15faf0 2019-11-28T11:29:39.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.883+0000 7f5882abe700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c104a80 con 0x7f587c12c7b0 2019-11-28T11:29:39.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.883+0000 7f5882abe700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c111980 con 0x7f587c12bde0 2019-11-28T11:29:39.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f588105b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f587c15faf0 0x7f587c1573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34390/0 (socket says 172.21.15.80:34390) 2019-11-28T11:29:39.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f588105b700 1 -- 172.21.15.80:0/3354453422 learned_addr learned my addr 172.21.15.80:0/3354453422 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:39.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f588085a700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c12bde0 0x7f587c12c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:39.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f586dffb700 1 -- 172.21.15.80:0/3354453422 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880342991 0 0) 0x7f5870007da0 con 0x7f587c15faf0 2019-11-28T11:29:39.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f586dffb700 1 -- 172.21.15.80:0/3354453422 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f585c002e80 con 0x7f587c15faf0 2019-11-28T11:29:39.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f586dffb700 1 -- 172.21.15.80:0/3354453422 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871778274 0 0) 0x7f5874009930 con 0x7f587c12c7b0 2019-11-28T11:29:39.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f586dffb700 1 -- 172.21.15.80:0/3354453422 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f585c0030b0 con 0x7f587c12c7b0 2019-11-28T11:29:39.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f588085a700 1 -- 172.21.15.80:0/3354453422 >> v1:172.21.15.174:6789/0 conn(0x7f587c12c7b0 legacy=0x7f587c156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f588085a700 1 -- 172.21.15.80:0/3354453422 >> v1:172.21.15.80:6789/0 conn(0x7f587c15faf0 legacy=0x7f587c1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:39.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f588085a700 1 -- 172.21.15.80:0/3354453422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c1122e0 con 0x7f587c12bde0 2019-11-28T11:29:39.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f588085a700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c12bde0 0x7f587c12c270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58780103a0 tx=0x7f5878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f588085a700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c12bde0 0x7f587c12c270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58780103a0 tx=0x7f5878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f588085a700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c12bde0 0x7f587c12c270 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f58780103a0 tx=0x7f5878010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:39.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f588085a700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c12bde0 0x7f587c12c270 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f58780103a0 tx=0x7f5878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f586dffb700 1 -- 172.21.15.80:0/3354453422 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58780099d0 con 0x7f587c12bde0 2019-11-28T11:29:39.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f588085a700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c12bde0 0x7f587c12c270 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f58780103a0 tx=0x7f5878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f588085a700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c12bde0 0x7f587c12c270 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f58780103a0 tx=0x7f5878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f586dffb700 1 -- 172.21.15.80:0/3354453422 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5878009bd0 con 0x7f587c12bde0 2019-11-28T11:29:39.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f5882abe700 1 -- 172.21.15.80:0/3354453422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c112660 con 0x7f587c12bde0 2019-11-28T11:29:39.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f586dffb700 1 -- 172.21.15.80:0/3354453422 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f587800a2a0 con 0x7f587c12bde0 2019-11-28T11:29:39.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.884+0000 7f5882abe700 1 -- 172.21.15.80:0/3354453422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c1122e0 con 0x7f587c12bde0 2019-11-28T11:29:39.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.885+0000 7f588085a700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c12bde0 0x7f587c12c270 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f58780103a0 tx=0x7f5878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.885+0000 7f586dffb700 1 -- 172.21.15.80:0/3354453422 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5878009880 con 0x7f587c12bde0 2019-11-28T11:29:39.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.885+0000 7f588085a700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c12bde0 0x7f587c12c270 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f58780103a0 tx=0x7f5878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.885+0000 7f586dffb700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f585c018750 0x7f585c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:39.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.885+0000 7f586dffb700 1 -- 172.21.15.80:0/3354453422 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5878031a80 con 0x7f587c12bde0 2019-11-28T11:29:39.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.885+0000 7f588105b700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f585c018750 0x7f585c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:39.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.885+0000 7f588105b700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f585c018750 0x7f585c01abe0 crc :-1 s=READY pgs=337 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:39.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.892+0000 7f5882abe700 1 -- 172.21.15.80:0/3354453422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c112660 con 0x7f587c12bde0 2019-11-28T11:29:39.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.896+0000 7f588085a700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c12bde0 0x7f587c12c270 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f58780103a0 tx=0x7f5878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:39.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:39.896+0000 7f586dffb700 1 -- 172.21.15.80:0/3354453422 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f58780095d0 con 0x7f587c12bde0 2019-11-28T11:29:40.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.062+0000 7f5882abe700 1 -- 172.21.15.80:0/3354453422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f587c1122e0 con 0x7f587c12bde0 2019-11-28T11:29:40.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.064+0000 7f588085a700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c12bde0 0x7f587c12c270 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f58780103a0 tx=0x7f5878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:40.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.064+0000 7f586dffb700 1 -- 172.21.15.80:0/3354453422 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v67) v1 ==== 100+0+10 (secure 0 0 0) 0x7f58780097e0 con 0x7f587c12bde0 2019-11-28T11:29:40.095 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:29:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.065+0000 7f5882abe700 1 -- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f585c018750 msgr2=0x7f585c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.065+0000 7f5882abe700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f585c018750 0x7f585c01abe0 crc :-1 s=READY pgs=337 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.065+0000 7f5882abe700 1 -- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c12bde0 msgr2=0x7f587c12c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.065+0000 7f5882abe700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c12bde0 0x7f587c12c270 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f58780103a0 tx=0x7f5878010740).stop 2019-11-28T11:29:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.065+0000 7f5882abe700 1 -- 172.21.15.80:0/3354453422 shutdown_connections 2019-11-28T11:29:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.065+0000 7f5882abe700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f585c018750 0x7f585c01abe0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.065+0000 7f5882abe700 1 --2- 172.21.15.80:0/3354453422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f587c12bde0 0x7f587c12c270 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:40.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.065+0000 7f5882abe700 1 -- 172.21.15.80:0/3354453422 shutdown_connections 2019-11-28T11:29:40.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.065+0000 7f5882abe700 1 -- 172.21.15.80:0/3354453422 wait complete. 2019-11-28T11:29:40.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.065+0000 7f5882abe700 1 -- 172.21.15.80:0/3354453422 >> 172.21.15.80:0/3354453422 conn(0x7f587c07c4f0 msgr2=0x7f587c15ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:40.109 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:29:40.109 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:40.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.204+0000 7ff2dba17700 1 Processor -- start 2019-11-28T11:29:40.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.204+0000 7ff2dba17700 1 -- start start 2019-11-28T11:29:40.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.205+0000 7ff2dba17700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2d406c0a0 0x7ff2d4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:40.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.205+0000 7ff2dba17700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff2d4072620 0x7ff2d4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:40.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.205+0000 7ff2dba17700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d406db00 con 0x7ff2d40734e0 2019-11-28T11:29:40.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.205+0000 7ff2dba17700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d406f330 con 0x7ff2d4072620 2019-11-28T11:29:40.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.205+0000 7ff2dba17700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40706c0 con 0x7ff2d406c0a0 2019-11-28T11:29:40.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.205+0000 7ff2da7b5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff2d4072620 0x7ff2d4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:40.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.205+0000 7ff2da7b5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff2d4072620 0x7ff2d4164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35084/0 (socket says 172.21.15.80:35084) 2019-11-28T11:29:40.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.205+0000 7ff2da7b5700 1 -- 172.21.15.80:0/80205772 learned_addr learned my addr 172.21.15.80:0/80205772 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:40.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.205+0000 7ff2d97b3700 1 --1- 172.21.15.80:0/80205772 >> v1:172.21.15.80:6789/0 conn(0x7ff2d40734e0 0x7ff2d4071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34402/0 (socket says 172.21.15.80:34402) 2019-11-28T11:29:40.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.205+0000 7ff2d9fb4700 1 --2- 172.21.15.80:0/80205772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2d406c0a0 0x7ff2d4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:40.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.206+0000 7ff2da7b5700 1 -- 172.21.15.80:0/80205772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2d406c0a0 msgr2=0x7ff2d4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:40.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.206+0000 7ff2da7b5700 1 --2- 172.21.15.80:0/80205772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2d406c0a0 0x7ff2d4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:40.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.206+0000 7ff2da7b5700 1 -- 172.21.15.80:0/80205772 >> v1:172.21.15.80:6789/0 conn(0x7ff2d40734e0 legacy=0x7ff2d4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:40.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.206+0000 7ff2d8fb2700 1 -- 172.21.15.80:0/80205772 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621316330 0 0) 0x7ff2c4001070 con 0x7ff2d40734e0 2019-11-28T11:29:40.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.206+0000 7ff2da7b5700 1 -- 172.21.15.80:0/80205772 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d4070a40 con 0x7ff2d4072620 2019-11-28T11:29:40.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.206+0000 7ff2da7b5700 1 --2- 172.21.15.80:0/80205772 >> v2:172.21.15.80:3300/0 conn(0x7ff2d4072620 0x7ff2d4164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff2cc00f6b0 tx=0x7ff2cc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:40.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.206+0000 7ff2da7b5700 1 --2- 172.21.15.80:0/80205772 >> v2:172.21.15.80:3300/0 conn(0x7ff2d4072620 0x7ff2d4164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff2cc00f6b0 tx=0x7ff2cc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:40.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.206+0000 7ff2da7b5700 1 --2- 172.21.15.80:0/80205772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d4072620 0x7ff2d4164d70 secure :-1 s=READY pgs=814 cs=0 l=1 rx=0x7ff2cc00f6b0 tx=0x7ff2cc00fa50).ready entity=mon.0 client_cookie=a766bb9375b16c0a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:40.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.206+0000 7ff2da7b5700 1 --2- 172.21.15.80:0/80205772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d4072620 0x7ff2d4164d70 secure :-1 s=THROTTLE_DONE pgs=814 cs=0 l=1 rx=0x7ff2cc00f6b0 tx=0x7ff2cc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:40.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.206+0000 7ff2d8fb2700 1 -- 172.21.15.80:0/80205772 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2cc000a70 con 0x7ff2d4072620 2019-11-28T11:29:40.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.206+0000 7ff2da7b5700 1 --2- 172.21.15.80:0/80205772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d4072620 0x7ff2d4164d70 secure :-1 s=THROTTLE_DONE pgs=814 cs=0 l=1 rx=0x7ff2cc00f6b0 tx=0x7ff2cc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:40.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.206+0000 7ff2da7b5700 1 --2- 172.21.15.80:0/80205772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d4072620 0x7ff2d4164d70 secure :-1 s=THROTTLE_DONE pgs=814 cs=0 l=1 rx=0x7ff2cc00f6b0 tx=0x7ff2cc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:40.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.206+0000 7ff2d8fb2700 1 -- 172.21.15.80:0/80205772 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc0010e0 con 0x7ff2d4072620 2019-11-28T11:29:40.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.206+0000 7ff2d8fb2700 1 -- 172.21.15.80:0/80205772 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2cc0012d0 con 0x7ff2d4072620 2019-11-28T11:29:40.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.206+0000 7ff2dba17700 1 -- 172.21.15.80:0/80205772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d4072620 msgr2=0x7ff2d4164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:40.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.206+0000 7ff2dba17700 1 --2- 172.21.15.80:0/80205772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d4072620 0x7ff2d4164d70 secure :-1 s=READY pgs=814 cs=0 l=1 rx=0x7ff2cc00f6b0 tx=0x7ff2cc00fa50).stop 2019-11-28T11:29:40.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.207+0000 7ff2dba17700 1 -- 172.21.15.80:0/80205772 shutdown_connections 2019-11-28T11:29:40.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.207+0000 7ff2dba17700 1 --2- 172.21.15.80:0/80205772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d4072620 0x7ff2d4164d70 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:40.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.207+0000 7ff2dba17700 1 --2- 172.21.15.80:0/80205772 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2d406c0a0 0x7ff2d4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.207+0000 7ff2dba17700 1 -- 172.21.15.80:0/80205772 shutdown_connections 2019-11-28T11:29:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.207+0000 7ff2dba17700 1 -- 172.21.15.80:0/80205772 wait complete. 2019-11-28T11:29:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.207+0000 7ff2dba17700 1 -- 172.21.15.80:0/80205772 >> 172.21.15.80:0/80205772 conn(0x7ff2d4061cf0 msgr2=0x7ff2d4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:40.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.209+0000 7ff2dba17700 1 Processor -- start 2019-11-28T11:29:40.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.209+0000 7ff2dba17700 1 -- start start 2019-11-28T11:29:40.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.210+0000 7ff2dba17700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff2d413e9e0 0x7ff2d4108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:40.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.210+0000 7ff2dba17700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2d4109430 0x7ff2d41098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:40.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.210+0000 7ff2dba17700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d41066e0 con 0x7ff2d413e5f0 2019-11-28T11:29:40.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.210+0000 7ff2dba17700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d410e060 con 0x7ff2d413e9e0 2019-11-28T11:29:40.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.210+0000 7ff2dba17700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d410e330 con 0x7ff2d4109430 2019-11-28T11:29:40.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.210+0000 7ff2d9fb4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff2d413e5f0 0x7ff2d410a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34404/0 (socket says 172.21.15.80:34404) 2019-11-28T11:29:40.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.210+0000 7ff2d9fb4700 1 -- 172.21.15.80:0/3469231637 learned_addr learned my addr 172.21.15.80:0/3469231637 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:40.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.210+0000 7ff2d97b3700 1 --2- 172.21.15.80:0/3469231637 >> v2:172.21.15.80:3300/0 conn(0x7ff2d413e9e0 0x7ff2d4108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:40.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.210+0000 7ff2da7b5700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2d4109430 0x7ff2d41098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:40.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2d27fc700 1 -- 172.21.15.80:0/3469231637 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011595022 0 0) 0x7ff2bc009900 con 0x7ff2d413e5f0 2019-11-28T11:29:40.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2d27fc700 1 -- 172.21.15.80:0/3469231637 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2b8002e80 con 0x7ff2d413e5f0 2019-11-28T11:29:40.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2d97b3700 1 -- 172.21.15.80:0/3469231637 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2d4109430 msgr2=0x7ff2d41098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:40.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2d97b3700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2d4109430 0x7ff2d41098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:40.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2d97b3700 1 -- 172.21.15.80:0/3469231637 >> v1:172.21.15.80:6789/0 conn(0x7ff2d413e5f0 legacy=0x7ff2d410a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:40.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2d97b3700 1 -- 172.21.15.80:0/3469231637 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d410e9c0 con 0x7ff2d413e9e0 2019-11-28T11:29:40.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2d97b3700 1 --2- 172.21.15.80:0/3469231637 >> v2:172.21.15.80:3300/0 conn(0x7ff2d413e9e0 0x7ff2d4108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff2c40103a0 tx=0x7ff2c40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:40.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2d97b3700 1 --2- 172.21.15.80:0/3469231637 >> v2:172.21.15.80:3300/0 conn(0x7ff2d413e9e0 0x7ff2d4108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff2c40103a0 tx=0x7ff2c40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:40.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2d97b3700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d413e9e0 0x7ff2d4108ef0 secure :-1 s=READY pgs=816 cs=0 l=1 rx=0x7ff2c40103a0 tx=0x7ff2c40101d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:40.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2d97b3700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d413e9e0 0x7ff2d4108ef0 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7ff2c40103a0 tx=0x7ff2c40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:40.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2d27fc700 1 -- 172.21.15.80:0/3469231637 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2c4001230 con 0x7ff2d413e9e0 2019-11-28T11:29:40.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2d97b3700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d413e9e0 0x7ff2d4108ef0 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7ff2c40103a0 tx=0x7ff2c40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:40.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2d97b3700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d413e9e0 0x7ff2d4108ef0 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7ff2c40103a0 tx=0x7ff2c40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:40.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2d27fc700 1 -- 172.21.15.80:0/3469231637 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c4003fe0 con 0x7ff2d413e9e0 2019-11-28T11:29:40.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2dba17700 1 -- 172.21.15.80:0/3469231637 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d410ed40 con 0x7ff2d413e9e0 2019-11-28T11:29:40.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2d27fc700 1 -- 172.21.15.80:0/3469231637 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2c4004730 con 0x7ff2d413e9e0 2019-11-28T11:29:40.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2dba17700 1 -- 172.21.15.80:0/3469231637 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d410e9c0 con 0x7ff2d413e9e0 2019-11-28T11:29:40.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.211+0000 7ff2d97b3700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d413e9e0 0x7ff2d4108ef0 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7ff2c40103a0 tx=0x7ff2c40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:40.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.212+0000 7ff2d27fc700 1 -- 172.21.15.80:0/3469231637 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff2c4000dd0 con 0x7ff2d413e9e0 2019-11-28T11:29:40.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.212+0000 7ff2d97b3700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d413e9e0 0x7ff2d4108ef0 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7ff2c40103a0 tx=0x7ff2c40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:40.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.212+0000 7ff2d27fc700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2b8018770 0x7ff2b801ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:40.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.212+0000 7ff2d27fc700 1 -- 172.21.15.80:0/3469231637 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff2c4031c20 con 0x7ff2d413e9e0 2019-11-28T11:29:40.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.212+0000 7ff2d9fb4700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2b8018770 0x7ff2b801ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:40.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.212+0000 7ff2d9fb4700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2b8018770 0x7ff2b801ac00 crc :-1 s=READY pgs=338 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:40.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.219+0000 7ff2dba17700 1 -- 172.21.15.80:0/3469231637 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d410ed40 con 0x7ff2d413e9e0 2019-11-28T11:29:40.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.223+0000 7ff2d97b3700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d413e9e0 0x7ff2d4108ef0 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7ff2c40103a0 tx=0x7ff2c40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:40.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.223+0000 7ff2d27fc700 1 -- 172.21.15.80:0/3469231637 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff2c4000940 con 0x7ff2d413e9e0 2019-11-28T11:29:40.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.397+0000 7ff2dba17700 1 -- 172.21.15.80:0/3469231637 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2d410e9c0 con 0x7ff2d413e9e0 2019-11-28T11:29:40.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.397+0000 7ff2d97b3700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d413e9e0 0x7ff2d4108ef0 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7ff2c40103a0 tx=0x7ff2c40101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:40.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.397+0000 7ff2d27fc700 1 -- 172.21.15.80:0/3469231637 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2445 (secure 0 0 0) 0x7ff2c4000ce0 con 0x7ff2d413e9e0 2019-11-28T11:29:40.429 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 38 2019-11-28T11:29:40.430 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:40.430 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6312,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1488684602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1488684602},{"type":"v1","addr":"172.21.15.80:6834","nonce":1488684602}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36},{"gid":6315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1002302731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1002302731},{"type":"v1","addr":"172.21.15.80:6835","nonce":1002302731}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:29:26.954212+0000","modified":"2019-11-28T11:29:34.648365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5186":{"gid":5186,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/698358691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":698358691},{"type":"v1","addr":"172.21.15.174:6835","nonce":698358691}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2019-11-28T11:29:40.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.400+0000 7ff2dba17700 1 -- 172.21.15.80:0/3469231637 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2b8018770 msgr2=0x7ff2b801ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:40.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.400+0000 7ff2dba17700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2b8018770 0x7ff2b801ac00 crc :-1 s=READY pgs=338 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:40.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.400+0000 7ff2dba17700 1 -- 172.21.15.80:0/3469231637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d413e9e0 msgr2=0x7ff2d4108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:40.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.400+0000 7ff2dba17700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d413e9e0 0x7ff2d4108ef0 secure :-1 s=READY pgs=816 cs=0 l=1 rx=0x7ff2c40103a0 tx=0x7ff2c40101d0).stop 2019-11-28T11:29:40.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.400+0000 7ff2dba17700 1 -- 172.21.15.80:0/3469231637 shutdown_connections 2019-11-28T11:29:40.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.400+0000 7ff2dba17700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2b8018770 0x7ff2b801ac00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:40.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.400+0000 7ff2dba17700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2d4109430 0x7ff2d41098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:40.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.400+0000 7ff2dba17700 1 --2- 172.21.15.80:0/3469231637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d413e9e0 0x7ff2d4108ef0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:40.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.400+0000 7ff2dba17700 1 -- 172.21.15.80:0/3469231637 shutdown_connections 2019-11-28T11:29:40.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.400+0000 7ff2dba17700 1 -- 172.21.15.80:0/3469231637 wait complete. 2019-11-28T11:29:40.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:40.400+0000 7ff2dba17700 1 -- 172.21.15.80:0/3469231637 >> 172.21.15.80:0/3469231637 conn(0x7ff2d413d620 msgr2=0x7ff2d413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:40.748 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5186}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 10, u'failed': [], u'epoch': 38, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [11], u'info': {u'gid_5186': {u'export_targets': [], u'name': u'c', u'incarnation': 37, u'state_seq': 3, u'state': u'up:active', u'gid': 5186, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 698358691, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 698358691, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/698358691'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:29:26.954212+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:29:34.648365+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:29:40.748 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:29:40.749 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:29:40.878 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:29:40.878 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:29:40.878 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:29:40.878 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5186, 2019-11-28T11:29:40.879 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:29:40.879 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:29:40.879 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 7.199608875, 2019-11-28T11:29:40.879 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 38, 2019-11-28T11:29:40.879 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 67, 2019-11-28T11:29:40.879 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 67, 2019-11-28T11:29:40.879 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 11.427860308 2019-11-28T11:29:40.880 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:29:40.886 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5186, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.199608875, "mdsmap_epoch": 38, "osdmap_epoch": 67, "osdmap_epoch_barrier": 67, "uptime": 11.427860308 } 2019-11-28T11:29:40.886 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:29:40.886 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:29:40.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:29:40.887 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:29:40.966 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:29:40.966 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:29:41.104 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:29:41.105 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:29:41.105 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:29:41.105 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:29:41.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:29:41.105 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:29:41.174 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:29:41.308 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:29:41.308 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:29:41.309 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:29:41.309 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:29:41.309 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:29:41.431 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:29:41.432 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:29:41.432 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:29:41.439 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:29:41.440 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:41.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.532+0000 7f2afd9d3700 1 Processor -- start 2019-11-28T11:29:41.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.532+0000 7f2afd9d3700 1 -- start start 2019-11-28T11:29:41.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2afd9d3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2af806c0a0 0x7f2af8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:41.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2afd9d3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af8072620 0x7f2af8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:41.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2afd9d3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af806db00 con 0x7f2af80734e0 2019-11-28T11:29:41.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2afd9d3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af806fd60 con 0x7f2af806c0a0 2019-11-28T11:29:41.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2afd9d3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8070030 con 0x7f2af8072620 2019-11-28T11:29:41.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2af77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2af806c0a0 0x7f2af8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:41.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2af77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2af806c0a0 0x7f2af8072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35096/0 (socket says 172.21.15.80:35096) 2019-11-28T11:29:41.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2af77fe700 1 -- 172.21.15.80:0/3283985032 learned_addr learned my addr 172.21.15.80:0/3283985032 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:41.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2af6ffd700 1 --1- 172.21.15.80:0/3283985032 >> v1:172.21.15.80:6789/0 conn(0x7f2af80734e0 0x7f2af8071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34412/0 (socket says 172.21.15.80:34412) 2019-11-28T11:29:41.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2af7fff700 1 --2- 172.21.15.80:0/3283985032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af8072620 0x7f2af8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:41.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2af77fe700 1 -- 172.21.15.80:0/3283985032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af8072620 msgr2=0x7f2af8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:41.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2af77fe700 1 --2- 172.21.15.80:0/3283985032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af8072620 0x7f2af8164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:41.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2af77fe700 1 -- 172.21.15.80:0/3283985032 >> v1:172.21.15.80:6789/0 conn(0x7f2af80734e0 legacy=0x7f2af8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:41.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2af67fc700 1 -- 172.21.15.80:0/3283985032 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237058118 0 0) 0x7f2ae8001100 con 0x7f2af80734e0 2019-11-28T11:29:41.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2af77fe700 1 -- 172.21.15.80:0/3283985032 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af80706c0 con 0x7f2af806c0a0 2019-11-28T11:29:41.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2af77fe700 1 --2- 172.21.15.80:0/3283985032 >> v2:172.21.15.80:3300/0 conn(0x7f2af806c0a0 0x7f2af8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2ae000fa40 tx=0x7f2ae000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:41.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2af77fe700 1 --2- 172.21.15.80:0/3283985032 >> v2:172.21.15.80:3300/0 conn(0x7f2af806c0a0 0x7f2af8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2ae000fa40 tx=0x7f2ae000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:41.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2af77fe700 1 --2- 172.21.15.80:0/3283985032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2af806c0a0 0x7f2af8072fa0 secure :-1 s=READY pgs=818 cs=0 l=1 rx=0x7f2ae000fa40 tx=0x7f2ae000fde0).ready entity=mon.0 client_cookie=ffaaa653ba74e8ab server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:41.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2af77fe700 1 --2- 172.21.15.80:0/3283985032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2af806c0a0 0x7f2af8072fa0 secure :-1 s=THROTTLE_DONE pgs=818 cs=0 l=1 rx=0x7f2ae000fa40 tx=0x7f2ae000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:41.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2af67fc700 1 -- 172.21.15.80:0/3283985032 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae0000ce0 con 0x7f2af806c0a0 2019-11-28T11:29:41.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.533+0000 7f2af77fe700 1 --2- 172.21.15.80:0/3283985032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2af806c0a0 0x7f2af8072fa0 secure :-1 s=THROTTLE_DONE pgs=818 cs=0 l=1 rx=0x7f2ae000fa40 tx=0x7f2ae000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:41.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.534+0000 7f2af77fe700 1 --2- 172.21.15.80:0/3283985032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2af806c0a0 0x7f2af8072fa0 secure :-1 s=THROTTLE_DONE pgs=818 cs=0 l=1 rx=0x7f2ae000fa40 tx=0x7f2ae000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:41.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.534+0000 7f2af67fc700 1 -- 172.21.15.80:0/3283985032 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae0001010 con 0x7f2af806c0a0 2019-11-28T11:29:41.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.534+0000 7f2af67fc700 1 -- 172.21.15.80:0/3283985032 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae0001300 con 0x7f2af806c0a0 2019-11-28T11:29:41.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.534+0000 7f2afd9d3700 1 -- 172.21.15.80:0/3283985032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2af806c0a0 msgr2=0x7f2af8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:41.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.534+0000 7f2afd9d3700 1 --2- 172.21.15.80:0/3283985032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2af806c0a0 0x7f2af8072fa0 secure :-1 s=READY pgs=818 cs=0 l=1 rx=0x7f2ae000fa40 tx=0x7f2ae000fde0).stop 2019-11-28T11:29:41.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.534+0000 7f2afd9d3700 1 -- 172.21.15.80:0/3283985032 shutdown_connections 2019-11-28T11:29:41.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.534+0000 7f2afd9d3700 1 --2- 172.21.15.80:0/3283985032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af8072620 0x7f2af8164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:41.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.534+0000 7f2afd9d3700 1 --2- 172.21.15.80:0/3283985032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2af806c0a0 0x7f2af8072fa0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:41.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.534+0000 7f2afd9d3700 1 -- 172.21.15.80:0/3283985032 shutdown_connections 2019-11-28T11:29:41.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.534+0000 7f2afd9d3700 1 -- 172.21.15.80:0/3283985032 wait complete. 2019-11-28T11:29:41.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.534+0000 7f2afd9d3700 1 -- 172.21.15.80:0/3283985032 >> 172.21.15.80:0/3283985032 conn(0x7f2af8061cf0 msgr2=0x7f2af8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:41.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.537+0000 7f2afd9d3700 1 Processor -- start 2019-11-28T11:29:41.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.537+0000 7f2afd9d3700 1 -- start start 2019-11-28T11:29:41.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2afd9d3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af813e5f0 0x7f2af813e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:41.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2afd9d3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af81066e0 con 0x7f2af810a070 2019-11-28T11:29:41.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2afd9d3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af810ce40 con 0x7f2af810a4e0 2019-11-28T11:29:41.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2afd9d3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af810d630 con 0x7f2af813e5f0 2019-11-28T11:29:41.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2af6ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2af810a070 0x7f2af810bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34418/0 (socket says 172.21.15.80:34418) 2019-11-28T11:29:41.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2af6ffd700 1 -- 172.21.15.80:0/1405301652 learned_addr learned my addr 172.21.15.80:0/1405301652 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:41.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2af77fe700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af813e5f0 0x7f2af813e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:41.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2aeffff700 1 -- 172.21.15.80:0/1405301652 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658056748 0 0) 0x7f2ae8001150 con 0x7f2af810a070 2019-11-28T11:29:41.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2aeffff700 1 -- 172.21.15.80:0/1405301652 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2adc002e80 con 0x7f2af810a070 2019-11-28T11:29:41.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2aeffff700 1 -- 172.21.15.80:0/1405301652 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805567934 0 0) 0x7f2af0001080 con 0x7f2af810a4e0 2019-11-28T11:29:41.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2aeffff700 1 -- 172.21.15.80:0/1405301652 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2adc0030b0 con 0x7f2af810a4e0 2019-11-28T11:29:41.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2af77fe700 1 -- 172.21.15.80:0/1405301652 >> v1:172.21.15.174:6789/0 conn(0x7f2af810a4e0 legacy=0x7f2af810c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:41.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2af77fe700 1 -- 172.21.15.80:0/1405301652 >> v1:172.21.15.80:6789/0 conn(0x7f2af810a070 legacy=0x7f2af810bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:41.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2aeffff700 1 -- 172.21.15.80:0/1405301652 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2493290904 0 0) 0x7f2ae8001300 con 0x7f2af810a070 2019-11-28T11:29:41.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2af77fe700 1 -- 172.21.15.80:0/1405301652 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af810e9c0 con 0x7f2af813e5f0 2019-11-28T11:29:41.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2af77fe700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af813e5f0 0x7f2af813e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ae0010720 tx=0x7f2ae0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:41.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2af77fe700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af813e5f0 0x7f2af813e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ae0010720 tx=0x7f2ae0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:41.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.538+0000 7f2af77fe700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af813e5f0 0x7f2af813e9e0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f2ae0010720 tx=0x7f2ae0010ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:41.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.539+0000 7f2af77fe700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af813e5f0 0x7f2af813e9e0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f2ae0010720 tx=0x7f2ae0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:41.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.539+0000 7f2aeffff700 1 -- 172.21.15.80:0/1405301652 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae0007d60 con 0x7f2af813e5f0 2019-11-28T11:29:41.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.539+0000 7f2af77fe700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af813e5f0 0x7f2af813e9e0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f2ae0010720 tx=0x7f2ae0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:41.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.539+0000 7f2af77fe700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af813e5f0 0x7f2af813e9e0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f2ae0010720 tx=0x7f2ae0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:41.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.539+0000 7f2aeffff700 1 -- 172.21.15.80:0/1405301652 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae00011c0 con 0x7f2af813e5f0 2019-11-28T11:29:41.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.539+0000 7f2afd9d3700 1 -- 172.21.15.80:0/1405301652 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af810ed40 con 0x7f2af813e5f0 2019-11-28T11:29:41.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.539+0000 7f2aeffff700 1 -- 172.21.15.80:0/1405301652 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae0007d60 con 0x7f2af813e5f0 2019-11-28T11:29:41.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.539+0000 7f2afd9d3700 1 -- 172.21.15.80:0/1405301652 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af810e9c0 con 0x7f2af813e5f0 2019-11-28T11:29:41.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.539+0000 7f2af77fe700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af813e5f0 0x7f2af813e9e0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f2ae0010720 tx=0x7f2ae0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:41.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.539+0000 7f2aeffff700 1 -- 172.21.15.80:0/1405301652 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2ae0007d60 con 0x7f2af813e5f0 2019-11-28T11:29:41.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.539+0000 7f2af77fe700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af813e5f0 0x7f2af813e9e0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f2ae0010720 tx=0x7f2ae0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:41.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.539+0000 7f2aeffff700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2adc018750 0x7f2adc01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:41.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.539+0000 7f2aeffff700 1 -- 172.21.15.80:0/1405301652 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2ae0031e00 con 0x7f2af813e5f0 2019-11-28T11:29:41.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.540+0000 7f2af6ffd700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2adc018750 0x7f2adc01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:41.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.540+0000 7f2af6ffd700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2adc018750 0x7f2adc01abe0 crc :-1 s=READY pgs=339 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:41.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.547+0000 7f2afd9d3700 1 -- 172.21.15.80:0/1405301652 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af810ed40 con 0x7f2af813e5f0 2019-11-28T11:29:41.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.551+0000 7f2af77fe700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af813e5f0 0x7f2af813e9e0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f2ae0010720 tx=0x7f2ae0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:41.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.551+0000 7f2aeffff700 1 -- 172.21.15.80:0/1405301652 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2ae0000cc0 con 0x7f2af813e5f0 2019-11-28T11:29:41.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.724+0000 7f2afd9d3700 1 -- 172.21.15.80:0/1405301652 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2af810e9c0 con 0x7f2af813e5f0 2019-11-28T11:29:41.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.725+0000 7f2af77fe700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af813e5f0 0x7f2af813e9e0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f2ae0010720 tx=0x7f2ae0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:41.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.725+0000 7f2aeffff700 1 -- 172.21.15.80:0/1405301652 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2445 (secure 0 0 0) 0x7f2ae0007d60 con 0x7f2af813e5f0 2019-11-28T11:29:41.758 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 38 2019-11-28T11:29:41.758 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:41.758 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6312,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1488684602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1488684602},{"type":"v1","addr":"172.21.15.80:6834","nonce":1488684602}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36},{"gid":6315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1002302731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1002302731},{"type":"v1","addr":"172.21.15.80:6835","nonce":1002302731}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:29:26.954212+0000","modified":"2019-11-28T11:29:34.648365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5186":{"gid":5186,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/698358691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":698358691},{"type":"v1","addr":"172.21.15.174:6835","nonce":698358691}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2019-11-28T11:29:41.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.729+0000 7f2afd9d3700 1 -- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2adc018750 msgr2=0x7f2adc01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:41.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.729+0000 7f2afd9d3700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2adc018750 0x7f2adc01abe0 crc :-1 s=READY pgs=339 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:41.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.729+0000 7f2afd9d3700 1 -- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af813e5f0 msgr2=0x7f2af813e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:41.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.729+0000 7f2afd9d3700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af813e5f0 0x7f2af813e9e0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f2ae0010720 tx=0x7f2ae0010ac0).stop 2019-11-28T11:29:41.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.730+0000 7f2afd9d3700 1 -- 172.21.15.80:0/1405301652 shutdown_connections 2019-11-28T11:29:41.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.730+0000 7f2afd9d3700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2adc018750 0x7f2adc01abe0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:41.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.730+0000 7f2afd9d3700 1 --2- 172.21.15.80:0/1405301652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2af813e5f0 0x7f2af813e9e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:41.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.730+0000 7f2afd9d3700 1 -- 172.21.15.80:0/1405301652 shutdown_connections 2019-11-28T11:29:41.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.730+0000 7f2afd9d3700 1 -- 172.21.15.80:0/1405301652 wait complete. 2019-11-28T11:29:41.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.730+0000 7f2afd9d3700 1 -- 172.21.15.80:0/1405301652 >> 172.21.15.80:0/1405301652 conn(0x7f2af813d620 msgr2=0x7f2af813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:41.770 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config set mds_defer_session_stale false 2019-11-28T11:29:41.894 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:29:41.894 INFO:teuthology.orchestra.run.smithi174.stdout: "success": "mds_defer_session_stale = 'false' (not observed, change may require restart) " 2019-11-28T11:29:41.895 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:29:41.900 INFO:tasks.cephfs.filesystem:_json_asok output: { "success": "mds_defer_session_stale = 'false' (not observed, change may require restart) " } 2019-11-28T11:29:41.900 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:42.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.988+0000 7f33730f2700 1 Processor -- start 2019-11-28T11:29:42.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.989+0000 7f33730f2700 1 -- start start 2019-11-28T11:29:42.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f33730f2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f336c06c0a0 0x7f336c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:42.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f33730f2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f336c0734e0 0x7f336c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:42.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f33730f2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f336c072360 0x7f336c0727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:42.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f33730f2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336c06f330 con 0x7f336c0734e0 2019-11-28T11:29:42.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f33730f2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336c0706c0 con 0x7f336c072360 2019-11-28T11:29:42.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f33730f2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336c070a40 con 0x7f336c06c0a0 2019-11-28T11:29:42.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f3370e8e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f336c0734e0 0x7f336c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:42.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f3370e8e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f336c0734e0 0x7f336c071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35112/0 (socket says 172.21.15.80:35112) 2019-11-28T11:29:42.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f3370e8e700 1 -- 172.21.15.80:0/872796391 learned_addr learned my addr 172.21.15.80:0/872796391 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:42.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f3371e90700 1 --2- 172.21.15.80:0/872796391 >> v2:172.21.15.174:3300/0 conn(0x7f336c072360 0x7f336c0727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:42.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f337168f700 1 --2- 172.21.15.80:0/872796391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f336c06c0a0 0x7f336c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:42.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f3370e8e700 1 -- 172.21.15.80:0/872796391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f336c06c0a0 msgr2=0x7f336c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:42.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f3370e8e700 1 --2- 172.21.15.80:0/872796391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f336c06c0a0 0x7f336c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:42.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f3370e8e700 1 -- 172.21.15.80:0/872796391 >> v2:172.21.15.174:3300/0 conn(0x7f336c072360 msgr2=0x7f336c0727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:42.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f3370e8e700 1 --2- 172.21.15.80:0/872796391 >> v2:172.21.15.174:3300/0 conn(0x7f336c072360 0x7f336c0727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:42.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f3370e8e700 1 -- 172.21.15.80:0/872796391 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c06db00 con 0x7f336c0734e0 2019-11-28T11:29:42.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f3370e8e700 1 --2- 172.21.15.80:0/872796391 >> v2:172.21.15.80:3300/0 conn(0x7f336c0734e0 0x7f336c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f335c00f6c0 tx=0x7f335c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f3370e8e700 1 --2- 172.21.15.80:0/872796391 >> v2:172.21.15.80:3300/0 conn(0x7f336c0734e0 0x7f336c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f335c00f6c0 tx=0x7f335c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f3370e8e700 1 --2- 172.21.15.80:0/872796391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c0734e0 0x7f336c071e20 secure :-1 s=READY pgs=820 cs=0 l=1 rx=0x7f335c00f6c0 tx=0x7f335c00f570).ready entity=mon.0 client_cookie=b6c3d81f8c376044 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:42.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f3370e8e700 1 --2- 172.21.15.80:0/872796391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c0734e0 0x7f336c071e20 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f335c00f6c0 tx=0x7f335c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f3370e8e700 1 --2- 172.21.15.80:0/872796391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c0734e0 0x7f336c071e20 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f335c00f6c0 tx=0x7f335c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f336bfff700 1 -- 172.21.15.80:0/872796391 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f335c000960 con 0x7f336c0734e0 2019-11-28T11:29:42.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.990+0000 7f3370e8e700 1 --2- 172.21.15.80:0/872796391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c0734e0 0x7f336c071e20 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f335c00f6c0 tx=0x7f335c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.991+0000 7f336bfff700 1 -- 172.21.15.80:0/872796391 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c000c90 con 0x7f336c0734e0 2019-11-28T11:29:42.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.991+0000 7f336bfff700 1 -- 172.21.15.80:0/872796391 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f335c0013a0 con 0x7f336c0734e0 2019-11-28T11:29:42.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.991+0000 7f33730f2700 1 -- 172.21.15.80:0/872796391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c0734e0 msgr2=0x7f336c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:42.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.991+0000 7f33730f2700 1 --2- 172.21.15.80:0/872796391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c0734e0 0x7f336c071e20 secure :-1 s=READY pgs=820 cs=0 l=1 rx=0x7f335c00f6c0 tx=0x7f335c00f570).stop 2019-11-28T11:29:42.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.991+0000 7f33730f2700 1 -- 172.21.15.80:0/872796391 shutdown_connections 2019-11-28T11:29:42.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.991+0000 7f33730f2700 1 --2- 172.21.15.80:0/872796391 >> v2:172.21.15.174:3300/0 conn(0x7f336c072360 0x7f336c0727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:42.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.991+0000 7f33730f2700 1 --2- 172.21.15.80:0/872796391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c0734e0 0x7f336c071e20 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:42.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.991+0000 7f33730f2700 1 --2- 172.21.15.80:0/872796391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f336c06c0a0 0x7f336c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:42.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.991+0000 7f33730f2700 1 -- 172.21.15.80:0/872796391 shutdown_connections 2019-11-28T11:29:42.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.991+0000 7f33730f2700 1 -- 172.21.15.80:0/872796391 wait complete. 2019-11-28T11:29:42.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.991+0000 7f33730f2700 1 -- 172.21.15.80:0/872796391 >> 172.21.15.80:0/872796391 conn(0x7f336c061cf0 msgr2=0x7f336c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:42.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.994+0000 7f33730f2700 1 Processor -- start 2019-11-28T11:29:42.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.994+0000 7f33730f2700 1 -- start start 2019-11-28T11:29:42.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.995+0000 7f33730f2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f336c13e320 0x7f336c13e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:42.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.995+0000 7f33730f2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336c139e00 con 0x7f336c15fdf0 2019-11-28T11:29:42.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.995+0000 7f33730f2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336c13b4e0 con 0x7f336c12a3c0 2019-11-28T11:29:42.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.995+0000 7f33730f2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336c108820 con 0x7f336c13e320 2019-11-28T11:29:42.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.995+0000 7f337168f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f336c15fdf0 0x7f336c12b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34430/0 (socket says 172.21.15.80:34430) 2019-11-28T11:29:42.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.995+0000 7f337168f700 1 -- 172.21.15.80:0/1124453027 learned_addr learned my addr 172.21.15.80:0/1124453027 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:42.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.995+0000 7f3370e8e700 1 --2- 172.21.15.80:0/1124453027 >> v2:172.21.15.174:3300/0 conn(0x7f336c13e320 0x7f336c13e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:42.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.995+0000 7f3369ffb700 1 -- 172.21.15.80:0/1124453027 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488192004 0 0) 0x7f3354001330 con 0x7f336c15fdf0 2019-11-28T11:29:42.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.995+0000 7f3369ffb700 1 -- 172.21.15.80:0/1124453027 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3350002e80 con 0x7f336c15fdf0 2019-11-28T11:29:42.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.995+0000 7f3370e8e700 1 -- 172.21.15.80:0/1124453027 >> v1:172.21.15.174:6789/0 conn(0x7f336c12a3c0 legacy=0x7f336c12a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:42.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.995+0000 7f3369ffb700 1 -- 172.21.15.80:0/1124453027 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710852632 0 0) 0x7f3364001080 con 0x7f336c12a3c0 2019-11-28T11:29:42.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.995+0000 7f3370e8e700 1 -- 172.21.15.80:0/1124453027 >> v1:172.21.15.80:6789/0 conn(0x7f336c15fdf0 legacy=0x7f336c12b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:42.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.995+0000 7f3370e8e700 1 -- 172.21.15.80:0/1124453027 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c10a8c0 con 0x7f336c13e320 2019-11-28T11:29:42.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.995+0000 7f3370e8e700 1 --2- 172.21.15.80:0/1124453027 >> v2:172.21.15.174:3300/0 conn(0x7f336c13e320 0x7f336c13e7b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f335c0543c0 tx=0x7f335c054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.996+0000 7f3370e8e700 1 --2- 172.21.15.80:0/1124453027 >> v2:172.21.15.174:3300/0 conn(0x7f336c13e320 0x7f336c13e7b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f335c0543c0 tx=0x7f335c054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.996+0000 7f3370e8e700 1 --2- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f336c13e320 0x7f336c13e7b0 secure :-1 s=READY pgs=489 cs=0 l=1 rx=0x7f335c0543c0 tx=0x7f335c054760).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:42.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.996+0000 7f3370e8e700 1 --2- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f336c13e320 0x7f336c13e7b0 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7f335c0543c0 tx=0x7f335c054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.996+0000 7f3369ffb700 1 -- 172.21.15.80:0/1124453027 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f335c007cd0 con 0x7f336c13e320 2019-11-28T11:29:42.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.996+0000 7f3370e8e700 1 --2- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f336c13e320 0x7f336c13e7b0 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7f335c0543c0 tx=0x7f335c054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.996+0000 7f3369ffb700 1 -- 172.21.15.80:0/1124453027 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c007cd0 con 0x7f336c13e320 2019-11-28T11:29:42.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.996+0000 7f3370e8e700 1 --2- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f336c13e320 0x7f336c13e7b0 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7f335c0543c0 tx=0x7f335c054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.996+0000 7f33730f2700 1 -- 172.21.15.80:0/1124453027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c10a8c0 con 0x7f336c13e320 2019-11-28T11:29:42.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.996+0000 7f3369ffb700 1 -- 172.21.15.80:0/1124453027 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f335c005770 con 0x7f336c13e320 2019-11-28T11:29:42.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.996+0000 7f33730f2700 1 -- 172.21.15.80:0/1124453027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c10a8c0 con 0x7f336c13e320 2019-11-28T11:29:42.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.996+0000 7f3370e8e700 1 --2- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f336c13e320 0x7f336c13e7b0 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7f335c0543c0 tx=0x7f335c054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.996+0000 7f3369ffb700 1 -- 172.21.15.80:0/1124453027 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f335c005390 con 0x7f336c13e320 2019-11-28T11:29:42.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.996+0000 7f3370e8e700 1 --2- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f336c13e320 0x7f336c13e7b0 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7f335c0543c0 tx=0x7f335c054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.996+0000 7f3369ffb700 1 --2- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3350018780 0x7f335001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:42.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.997+0000 7f3369ffb700 1 -- 172.21.15.80:0/1124453027 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f335c075ad0 con 0x7f336c13e320 2019-11-28T11:29:42.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.997+0000 7f337168f700 1 --2- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3350018780 0x7f335001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:42.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:41.997+0000 7f337168f700 1 --2- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3350018780 0x7f335001abf0 crc :-1 s=READY pgs=340 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:42.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.004+0000 7f33730f2700 1 -- 172.21.15.80:0/1124453027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336c109180 con 0x7f336c13e320 2019-11-28T11:29:42.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.008+0000 7f3370e8e700 1 --2- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f336c13e320 0x7f336c13e7b0 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7f335c0543c0 tx=0x7f335c054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.008+0000 7f3369ffb700 1 -- 172.21.15.80:0/1124453027 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f335c005180 con 0x7f336c13e320 2019-11-28T11:29:42.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.178+0000 7f33730f2700 1 -- 172.21.15.80:0/1124453027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f336c109500 con 0x7f336c13e320 2019-11-28T11:29:42.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.179+0000 7f3370e8e700 1 --2- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f336c13e320 0x7f336c13e7b0 secure :-1 s=THROTTLE_DONE pgs=489 cs=0 l=1 rx=0x7f335c0543c0 tx=0x7f335c054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.179+0000 7f3369ffb700 1 -- 172.21.15.80:0/1124453027 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2445 (secure 0 0 0) 0x7f335c007da0 con 0x7f336c13e320 2019-11-28T11:29:42.210 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 38 2019-11-28T11:29:42.211 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:42.211 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6312,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1488684602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1488684602},{"type":"v1","addr":"172.21.15.80:6834","nonce":1488684602}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36},{"gid":6315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1002302731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1002302731},{"type":"v1","addr":"172.21.15.80:6835","nonce":1002302731}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:29:26.954212+0000","modified":"2019-11-28T11:29:34.648365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5186":{"gid":5186,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/698358691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":698358691},{"type":"v1","addr":"172.21.15.174:6835","nonce":698358691}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2019-11-28T11:29:42.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.181+0000 7f33730f2700 1 -- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3350018780 msgr2=0x7f335001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:42.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.181+0000 7f33730f2700 1 --2- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3350018780 0x7f335001abf0 crc :-1 s=READY pgs=340 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:42.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.181+0000 7f33730f2700 1 -- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f336c13e320 msgr2=0x7f336c13e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:42.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.181+0000 7f33730f2700 1 --2- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f336c13e320 0x7f336c13e7b0 secure :-1 s=READY pgs=489 cs=0 l=1 rx=0x7f335c0543c0 tx=0x7f335c054760).stop 2019-11-28T11:29:42.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.181+0000 7f33730f2700 1 -- 172.21.15.80:0/1124453027 shutdown_connections 2019-11-28T11:29:42.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.181+0000 7f33730f2700 1 --2- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3350018780 0x7f335001abf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:42.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.181+0000 7f33730f2700 1 --2- 172.21.15.80:0/1124453027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f336c13e320 0x7f336c13e7b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:42.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.181+0000 7f33730f2700 1 -- 172.21.15.80:0/1124453027 shutdown_connections 2019-11-28T11:29:42.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.181+0000 7f33730f2700 1 -- 172.21.15.80:0/1124453027 wait complete. 2019-11-28T11:29:42.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.181+0000 7f33730f2700 1 -- 172.21.15.80:0/1124453027 >> 172.21.15.80:0/1124453027 conn(0x7f336c127dc0 msgr2=0x7f336c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:42.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:29:42.222 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:29:42.222 INFO:teuthology.orchestra.run.smithi076:> import glob 2019-11-28T11:29:42.222 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:29:42.222 INFO:teuthology.orchestra.run.smithi076:> import json 2019-11-28T11:29:42.222 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:29:42.223 INFO:teuthology.orchestra.run.smithi076:> def get_id_to_dir(): 2019-11-28T11:29:42.223 INFO:teuthology.orchestra.run.smithi076:> result = {} 2019-11-28T11:29:42.223 INFO:teuthology.orchestra.run.smithi076:> for dir in glob.glob("/sys/kernel/debug/ceph/*"): 2019-11-28T11:29:42.223 INFO:teuthology.orchestra.run.smithi076:> mds_sessions_lines = open(os.path.join(dir, "mds_sessions")).readlines() 2019-11-28T11:29:42.223 INFO:teuthology.orchestra.run.smithi076:> client_id = mds_sessions_lines[1].split()[1].strip('"'"'"'"'"') 2019-11-28T11:29:42.223 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:29:42.224 INFO:teuthology.orchestra.run.smithi076:> result[client_id] = dir 2019-11-28T11:29:42.224 INFO:teuthology.orchestra.run.smithi076:> return result 2019-11-28T11:29:42.224 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:29:42.224 INFO:teuthology.orchestra.run.smithi076:> print(json.dumps(get_id_to_dir())) 2019-11-28T11:29:42.224 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:29:42.348 INFO:teuthology.orchestra.run.smithi076.stdout:{"0": "/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client5240"} 2019-11-28T11:29:42.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:29:42.349 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:29:42.349 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:29:42.349 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:29:42.349 INFO:teuthology.orchestra.run.smithi076:> print(open(os.path.join("/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client5240", "mds_sessions")).read()) 2019-11-28T11:29:42.349 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:29:42.431 INFO:teuthology.orchestra.run.smithi076.stdout:global_id 5240 2019-11-28T11:29:42.431 INFO:teuthology.orchestra.run.smithi076.stdout:name "0" 2019-11-28T11:29:42.431 INFO:teuthology.orchestra.run.smithi076.stdout:mds.0 open 2019-11-28T11:29:42.432 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:29:42.432 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:42.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.521+0000 7f3e1a3ba700 1 Processor -- start 2019-11-28T11:29:42.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.521+0000 7f3e1a3ba700 1 -- start start 2019-11-28T11:29:42.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.522+0000 7f3e1a3ba700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e1406c0a0 0x7f3e14072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:42.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.522+0000 7f3e1a3ba700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3e140734e0 0x7f3e14071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:42.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.522+0000 7f3e1a3ba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e14072360 0x7f3e140727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:42.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.522+0000 7f3e1a3ba700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1406f330 con 0x7f3e14072360 2019-11-28T11:29:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.522+0000 7f3e1a3ba700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e140706c0 con 0x7f3e140734e0 2019-11-28T11:29:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.522+0000 7f3e1a3ba700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e14070a40 con 0x7f3e1406c0a0 2019-11-28T11:29:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.522+0000 7f3e19158700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e14072360 0x7f3e140727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.522+0000 7f3e19158700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e14072360 0x7f3e140727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35122/0 (socket says 172.21.15.80:35122) 2019-11-28T11:29:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.522+0000 7f3e19158700 1 -- 172.21.15.80:0/1389038733 learned_addr learned my addr 172.21.15.80:0/1389038733 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:29:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.522+0000 7f3e13fff700 1 --2- 172.21.15.80:0/1389038733 >> v2:172.21.15.174:3300/0 conn(0x7f3e140734e0 0x7f3e14071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:42.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.522+0000 7f3e18957700 1 --2- 172.21.15.80:0/1389038733 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e1406c0a0 0x7f3e14072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.522+0000 7f3e19158700 1 -- 172.21.15.80:0/1389038733 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e1406c0a0 msgr2=0x7f3e14072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.522+0000 7f3e19158700 1 --2- 172.21.15.80:0/1389038733 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e1406c0a0 0x7f3e14072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.522+0000 7f3e19158700 1 -- 172.21.15.80:0/1389038733 >> v2:172.21.15.174:3300/0 conn(0x7f3e140734e0 msgr2=0x7f3e14071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.522+0000 7f3e19158700 1 --2- 172.21.15.80:0/1389038733 >> v2:172.21.15.174:3300/0 conn(0x7f3e140734e0 0x7f3e14071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e19158700 1 -- 172.21.15.80:0/1389038733 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1406db00 con 0x7f3e14072360 2019-11-28T11:29:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e13fff700 1 --2- 172.21.15.80:0/1389038733 >> v2:172.21.15.174:3300/0 conn(0x7f3e140734e0 0x7f3e14071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e19158700 1 --2- 172.21.15.80:0/1389038733 >> v2:172.21.15.80:3300/0 conn(0x7f3e14072360 0x7f3e140727e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3e0c00fa30 tx=0x7f3e0c00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e19158700 1 --2- 172.21.15.80:0/1389038733 >> v2:172.21.15.80:3300/0 conn(0x7f3e14072360 0x7f3e140727e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3e0c00fa30 tx=0x7f3e0c00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e19158700 1 --2- 172.21.15.80:0/1389038733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e14072360 0x7f3e140727e0 secure :-1 s=READY pgs=822 cs=0 l=1 rx=0x7f3e0c00fa30 tx=0x7f3e0c00fdd0).ready entity=mon.0 client_cookie=24c806857d28dc1e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e19158700 1 --2- 172.21.15.80:0/1389038733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e14072360 0x7f3e140727e0 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7f3e0c00fa30 tx=0x7f3e0c00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e19158700 1 --2- 172.21.15.80:0/1389038733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e14072360 0x7f3e140727e0 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7f3e0c00fa30 tx=0x7f3e0c00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e137fe700 1 -- 172.21.15.80:0/1389038733 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0c001460 con 0x7f3e14072360 2019-11-28T11:29:42.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e19158700 1 --2- 172.21.15.80:0/1389038733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e14072360 0x7f3e140727e0 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7f3e0c00fa30 tx=0x7f3e0c00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e137fe700 1 -- 172.21.15.80:0/1389038733 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c000f10 con 0x7f3e14072360 2019-11-28T11:29:42.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e137fe700 1 -- 172.21.15.80:0/1389038733 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0c001a40 con 0x7f3e14072360 2019-11-28T11:29:42.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e1a3ba700 1 -- 172.21.15.80:0/1389038733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e14072360 msgr2=0x7f3e140727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:42.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e1a3ba700 1 --2- 172.21.15.80:0/1389038733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e14072360 0x7f3e140727e0 secure :-1 s=READY pgs=822 cs=0 l=1 rx=0x7f3e0c00fa30 tx=0x7f3e0c00fdd0).stop 2019-11-28T11:29:42.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e1a3ba700 1 -- 172.21.15.80:0/1389038733 shutdown_connections 2019-11-28T11:29:42.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e1a3ba700 1 --2- 172.21.15.80:0/1389038733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e14072360 0x7f3e140727e0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:42.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e1a3ba700 1 --2- 172.21.15.80:0/1389038733 >> v2:172.21.15.174:3300/0 conn(0x7f3e140734e0 0x7f3e14071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:42.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.523+0000 7f3e1a3ba700 1 --2- 172.21.15.80:0/1389038733 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e1406c0a0 0x7f3e14072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:42.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.524+0000 7f3e1a3ba700 1 -- 172.21.15.80:0/1389038733 shutdown_connections 2019-11-28T11:29:42.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.524+0000 7f3e1a3ba700 1 -- 172.21.15.80:0/1389038733 wait complete. 2019-11-28T11:29:42.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.524+0000 7f3e1a3ba700 1 -- 172.21.15.80:0/1389038733 >> 172.21.15.80:0/1389038733 conn(0x7f3e14061cf0 msgr2=0x7f3e14064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:42.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.526+0000 7f3e1a3ba700 1 Processor -- start 2019-11-28T11:29:42.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.526+0000 7f3e1a3ba700 1 -- start start 2019-11-28T11:29:42.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.527+0000 7f3e1a3ba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e1413e9e0 0x7f3e14108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:42.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.527+0000 7f3e1a3ba700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e14109430 0x7f3e141098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:42.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.527+0000 7f3e1a3ba700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e141066e0 con 0x7f3e1413e5f0 2019-11-28T11:29:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.527+0000 7f3e1a3ba700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1410e060 con 0x7f3e1413e9e0 2019-11-28T11:29:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.527+0000 7f3e1a3ba700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1410e330 con 0x7f3e14109430 2019-11-28T11:29:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.527+0000 7f3e13fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e1413e9e0 0x7f3e14108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.527+0000 7f3e18957700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f3e1413e5f0 0x7f3e1410a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:49988/0 (socket says 172.21.15.80:49988) 2019-11-28T11:29:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.527+0000 7f3e13fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e1413e9e0 0x7f3e14108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35130/0 (socket says 172.21.15.80:35130) 2019-11-28T11:29:42.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.527+0000 7f3e18957700 1 -- 172.21.15.80:0/1455219796 learned_addr learned my addr 172.21.15.80:0/1455219796 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:42.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.527+0000 7f3e19158700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e14109430 0x7f3e141098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:42.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.527+0000 7f3e13fff700 1 -- 172.21.15.80:0/1455219796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e14109430 msgr2=0x7f3e141098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:42.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.527+0000 7f3e13fff700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e14109430 0x7f3e141098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.527+0000 7f3e13fff700 1 -- 172.21.15.80:0/1455219796 >> v1:172.21.15.174:6789/0 conn(0x7f3e1413e5f0 legacy=0x7f3e1410a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.527+0000 7f3e117fa700 1 -- 172.21.15.80:0/1455219796 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553719980 0 0) 0x7f3dfc009790 con 0x7f3e1413e5f0 2019-11-28T11:29:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.527+0000 7f3e13fff700 1 -- 172.21.15.80:0/1455219796 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1410e9c0 con 0x7f3e1413e9e0 2019-11-28T11:29:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.528+0000 7f3e13fff700 1 --2- 172.21.15.80:0/1455219796 >> v2:172.21.15.80:3300/0 conn(0x7f3e1413e9e0 0x7f3e14108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e04010390 tx=0x7f3e04005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.528+0000 7f3e13fff700 1 --2- 172.21.15.80:0/1455219796 >> v2:172.21.15.80:3300/0 conn(0x7f3e1413e9e0 0x7f3e14108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e04010390 tx=0x7f3e04005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.528+0000 7f3e13fff700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e1413e9e0 0x7f3e14108ef0 secure :-1 s=READY pgs=823 cs=0 l=1 rx=0x7f3e04010390 tx=0x7f3e04005ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.528+0000 7f3e13fff700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e1413e9e0 0x7f3e14108ef0 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f3e04010390 tx=0x7f3e04005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.528+0000 7f3e117fa700 1 -- 172.21.15.80:0/1455219796 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e04000940 con 0x7f3e1413e9e0 2019-11-28T11:29:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.528+0000 7f3e13fff700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e1413e9e0 0x7f3e14108ef0 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f3e04010390 tx=0x7f3e04005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.528+0000 7f3e13fff700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e1413e9e0 0x7f3e14108ef0 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f3e04010390 tx=0x7f3e04005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.528+0000 7f3e117fa700 1 -- 172.21.15.80:0/1455219796 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e04008710 con 0x7f3e1413e9e0 2019-11-28T11:29:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.528+0000 7f3e1a3ba700 1 -- 172.21.15.80:0/1455219796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1410ed40 con 0x7f3e1413e9e0 2019-11-28T11:29:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.528+0000 7f3e117fa700 1 -- 172.21.15.80:0/1455219796 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e04000940 con 0x7f3e1413e9e0 2019-11-28T11:29:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.528+0000 7f3e1a3ba700 1 -- 172.21.15.80:0/1455219796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1410e9c0 con 0x7f3e1413e9e0 2019-11-28T11:29:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.528+0000 7f3e13fff700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e1413e9e0 0x7f3e14108ef0 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f3e04010390 tx=0x7f3e04005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.528+0000 7f3e117fa700 1 -- 172.21.15.80:0/1455219796 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3e04008900 con 0x7f3e1413e9e0 2019-11-28T11:29:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.528+0000 7f3e13fff700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e1413e9e0 0x7f3e14108ef0 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f3e04010390 tx=0x7f3e04005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.528+0000 7f3e117fa700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3df8018730 0x7f3df801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:42.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.528+0000 7f3e117fa700 1 -- 172.21.15.80:0/1455219796 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3e04031a20 con 0x7f3e1413e9e0 2019-11-28T11:29:42.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.529+0000 7f3e18957700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3df8018730 0x7f3df801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:42.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.529+0000 7f3e18957700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3df8018730 0x7f3df801abc0 crc :-1 s=READY pgs=341 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:42.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.536+0000 7f3e1a3ba700 1 -- 172.21.15.80:0/1455219796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1410ed40 con 0x7f3e1413e9e0 2019-11-28T11:29:42.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.540+0000 7f3e13fff700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e1413e9e0 0x7f3e14108ef0 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f3e04010390 tx=0x7f3e04005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.540+0000 7f3e117fa700 1 -- 172.21.15.80:0/1455219796 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3e04005180 con 0x7f3e1413e9e0 2019-11-28T11:29:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.715+0000 7f3e1a3ba700 1 -- 172.21.15.80:0/1455219796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e1410e9c0 con 0x7f3e1413e9e0 2019-11-28T11:29:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.715+0000 7f3e13fff700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e1413e9e0 0x7f3e14108ef0 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f3e04010390 tx=0x7f3e04005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.715+0000 7f3e117fa700 1 -- 172.21.15.80:0/1455219796 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2445 (secure 0 0 0) 0x7f3e04009110 con 0x7f3e1413e9e0 2019-11-28T11:29:42.748 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 38 2019-11-28T11:29:42.748 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:42.748 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6312,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1488684602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1488684602},{"type":"v1","addr":"172.21.15.80:6834","nonce":1488684602}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36},{"gid":6315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1002302731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1002302731},{"type":"v1","addr":"172.21.15.80:6835","nonce":1002302731}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:29:26.954212+0000","modified":"2019-11-28T11:29:34.648365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5186":{"gid":5186,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/698358691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":698358691},{"type":"v1","addr":"172.21.15.174:6835","nonce":698358691}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2019-11-28T11:29:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.717+0000 7f3e1a3ba700 1 -- 172.21.15.80:0/1455219796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3df8018730 msgr2=0x7f3df801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.717+0000 7f3e1a3ba700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3df8018730 0x7f3df801abc0 crc :-1 s=READY pgs=341 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.717+0000 7f3e1a3ba700 1 -- 172.21.15.80:0/1455219796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e1413e9e0 msgr2=0x7f3e14108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.717+0000 7f3e1a3ba700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e1413e9e0 0x7f3e14108ef0 secure :-1 s=READY pgs=823 cs=0 l=1 rx=0x7f3e04010390 tx=0x7f3e04005ee0).stop 2019-11-28T11:29:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.718+0000 7f3e1a3ba700 1 -- 172.21.15.80:0/1455219796 shutdown_connections 2019-11-28T11:29:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.718+0000 7f3e1a3ba700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e14109430 0x7f3e141098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.718+0000 7f3e1a3ba700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e1413e9e0 0x7f3e14108ef0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.718+0000 7f3e1a3ba700 1 --2- 172.21.15.80:0/1455219796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3df8018730 0x7f3df801abc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.718+0000 7f3e1a3ba700 1 -- 172.21.15.80:0/1455219796 shutdown_connections 2019-11-28T11:29:42.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.718+0000 7f3e1a3ba700 1 -- 172.21.15.80:0/1455219796 wait complete. 2019-11-28T11:29:42.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:42.718+0000 7f3e1a3ba700 1 -- 172.21.15.80:0/1455219796 >> 172.21.15.80:0/1455219796 conn(0x7f3e1413d620 msgr2=0x7f3e1413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:42.758 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session config 5240 timeout 120 2019-11-28T11:29:42.890 INFO:tasks.cephfs.filesystem:_json_asok output: 2019-11-28T11:29:42.943 INFO:teuthology.orchestra.console:Performing hard reset of smithi076 2019-11-28T11:29:42.943 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power reset 2019-11-28T11:29:42.987 INFO:teuthology.orchestra.console:Hard reset for smithi076 completed 2019-11-28T11:29:43.089 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:29:43.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.177+0000 7f685a54d700 1 Processor -- start 2019-11-28T11:29:43.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.177+0000 7f685a54d700 1 -- start start 2019-11-28T11:29:43.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.178+0000 7f685a54d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f685406c0a0 0x7f6854072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:43.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.178+0000 7f685a54d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685406db00 con 0x7f6854072620 2019-11-28T11:29:43.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.178+0000 7f685a54d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685406e000 con 0x7f68540734e0 2019-11-28T11:29:43.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.178+0000 7f685a54d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685406fd60 con 0x7f685406c0a0 2019-11-28T11:29:43.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.178+0000 7f68592eb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6854072620 0x7f6854164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34456/0 (socket says 172.21.15.80:34456) 2019-11-28T11:29:43.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.178+0000 7f68592eb700 1 -- 172.21.15.80:0/473636320 learned_addr learned my addr 172.21.15.80:0/473636320 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:43.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.178+0000 7f6858aea700 1 --2- 172.21.15.80:0/473636320 >> v2:172.21.15.174:3300/0 conn(0x7f685406c0a0 0x7f6854072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:43.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.178+0000 7f68537fe700 1 -- 172.21.15.80:0/473636320 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167659672 0 0) 0x7f684c001150 con 0x7f6854072620 2019-11-28T11:29:43.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.178+0000 7f68537fe700 1 -- 172.21.15.80:0/473636320 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6840002e80 con 0x7f6854072620 2019-11-28T11:29:43.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68537fe700 1 -- 172.21.15.80:0/473636320 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1728978689 0 0) 0x7f684c001130 con 0x7f6854072620 2019-11-28T11:29:43.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68537fe700 1 -- 172.21.15.80:0/473636320 >> v2:172.21.15.174:3300/0 conn(0x7f685406c0a0 msgr2=0x7f6854072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:43.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68537fe700 1 --2- 172.21.15.80:0/473636320 >> v2:172.21.15.174:3300/0 conn(0x7f685406c0a0 0x7f6854072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:43.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68537fe700 1 -- 172.21.15.80:0/473636320 >> v1:172.21.15.174:6789/0 conn(0x7f68540734e0 legacy=0x7f6854071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:43.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68537fe700 1 -- 172.21.15.80:0/473636320 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68540706c0 con 0x7f6854072620 2019-11-28T11:29:43.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68537fe700 1 -- 172.21.15.80:0/473636320 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f684c0016c0 con 0x7f6854072620 2019-11-28T11:29:43.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68537fe700 1 -- 172.21.15.80:0/473636320 >> v1:172.21.15.80:6789/0 conn(0x7f6854072620 legacy=0x7f6854164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:43.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68537fe700 1 --2- 172.21.15.80:0/473636320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840003b20 0x7f6840005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:43.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68537fe700 1 --2- 172.21.15.80:0/473636320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6840006730 0x7f6840008be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:43.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68537fe700 1 --2- 172.21.15.80:0/473636320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6840009440 0x7f684000b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:29:43.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68537fe700 1 -- 172.21.15.80:0/473636320 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684000c0c0 con 0x7f6840003b20 2019-11-28T11:29:43.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68537fe700 1 -- 172.21.15.80:0/473636320 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68400502c0 con 0x7f6840009440 2019-11-28T11:29:43.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68537fe700 1 -- 172.21.15.80:0/473636320 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68400504f0 con 0x7f6840006730 2019-11-28T11:29:43.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f6858aea700 1 --2- 172.21.15.80:0/473636320 >> v2:172.21.15.174:3300/0 conn(0x7f685406c0a0 0x7f6854072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:29:43.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68592eb700 1 --2- 172.21.15.80:0/473636320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6840009440 0x7f684000b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:43.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f6853fff700 1 --2- 172.21.15.80:0/473636320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6840006730 0x7f6840008be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:43.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f6858aea700 1 --2- 172.21.15.80:0/473636320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840003b20 0x7f6840005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:43.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f6858aea700 1 -- 172.21.15.80:0/473636320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6840006730 msgr2=0x7f6840008be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:43.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f6858aea700 1 --2- 172.21.15.80:0/473636320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6840006730 0x7f6840008be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:43.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f6858aea700 1 -- 172.21.15.80:0/473636320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6840009440 msgr2=0x7f684000b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:29:43.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f6858aea700 1 --2- 172.21.15.80:0/473636320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6840009440 0x7f684000b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:29:43.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68592eb700 1 -- 172.21.15.80:0/473636320 reap_dead start 2019-11-28T11:29:43.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f6858aea700 1 -- 172.21.15.80:0/473636320 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68400507a0 con 0x7f6840003b20 2019-11-28T11:29:43.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f6858aea700 1 --2- 172.21.15.80:0/473636320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840003b20 0x7f6840005f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f683c00d4e0 tx=0x7f683c00ad70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:43.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f6858aea700 1 --2- 172.21.15.80:0/473636320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840003b20 0x7f6840005f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f683c00d4e0 tx=0x7f683c00ad70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:43.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f6858aea700 1 --2- 172.21.15.80:0/473636320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840003b20 0x7f6840005f80 secure :-1 s=READY pgs=825 cs=0 l=1 rx=0x7f683c00d4e0 tx=0x7f683c00ad70).ready entity=mon.0 client_cookie=7d3bf559e1e58e5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:43.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f6858aea700 1 --2- 172.21.15.80:0/473636320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840003b20 0x7f6840005f80 secure :-1 s=THROTTLE_DONE pgs=825 cs=0 l=1 rx=0x7f683c00d4e0 tx=0x7f683c00ad70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:43.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f6858aea700 1 --2- 172.21.15.80:0/473636320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840003b20 0x7f6840005f80 secure :-1 s=THROTTLE_DONE pgs=825 cs=0 l=1 rx=0x7f683c00d4e0 tx=0x7f683c00ad70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:43.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68537fe700 1 -- 172.21.15.80:0/473636320 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f683c00aa00 con 0x7f6840003b20 2019-11-28T11:29:43.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f6858aea700 1 --2- 172.21.15.80:0/473636320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840003b20 0x7f6840005f80 secure :-1 s=THROTTLE_DONE pgs=825 cs=0 l=1 rx=0x7f683c00d4e0 tx=0x7f683c00ad70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:43.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68537fe700 1 -- 172.21.15.80:0/473636320 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c009770 con 0x7f6840003b20 2019-11-28T11:29:43.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.179+0000 7f68537fe700 1 -- 172.21.15.80:0/473636320 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f683c009ec0 con 0x7f6840003b20 2019-11-28T11:29:43.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.180+0000 7f685a54d700 1 -- 172.21.15.80:0/473636320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840003b20 msgr2=0x7f6840005f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:43.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.180+0000 7f685a54d700 1 --2- 172.21.15.80:0/473636320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840003b20 0x7f6840005f80 secure :-1 s=READY pgs=825 cs=0 l=1 rx=0x7f683c00d4e0 tx=0x7f683c00ad70).stop 2019-11-28T11:29:43.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.180+0000 7f685a54d700 1 -- 172.21.15.80:0/473636320 shutdown_connections 2019-11-28T11:29:43.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.180+0000 7f685a54d700 1 --2- 172.21.15.80:0/473636320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6840003b20 0x7f6840005f80 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:43.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.180+0000 7f685a54d700 1 -- 172.21.15.80:0/473636320 shutdown_connections 2019-11-28T11:29:43.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.180+0000 7f685a54d700 1 -- 172.21.15.80:0/473636320 wait complete. 2019-11-28T11:29:43.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.180+0000 7f685a54d700 1 -- 172.21.15.80:0/473636320 >> 172.21.15.80:0/473636320 conn(0x7f6854061cf0 msgr2=0x7f6854064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:43.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.183+0000 7f685a54d700 1 Processor -- start 2019-11-28T11:29:43.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.183+0000 7f685a54d700 1 -- start start 2019-11-28T11:29:43.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f685a54d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6854074d00 0x7f685407aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:43.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f685a54d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6854150f50 0x7f685407af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:43.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f685a54d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68540754d0 con 0x7f685407bba0 2019-11-28T11:29:43.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f685a54d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6854078980 con 0x7f6854074d00 2019-11-28T11:29:43.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f685a54d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6854078c50 con 0x7f6854150f50 2019-11-28T11:29:43.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f6858aea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6854074d00 0x7f685407aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:43.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f68592eb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f685407bba0 0x7f6854076d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34468/0 (socket says 172.21.15.80:34468) 2019-11-28T11:29:43.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f6858aea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6854074d00 0x7f685407aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35148/0 (socket says 172.21.15.80:35148) 2019-11-28T11:29:43.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f68592eb700 1 -- 172.21.15.80:0/808360010 learned_addr learned my addr 172.21.15.80:0/808360010 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:29:43.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f6853fff700 1 --2- 172.21.15.80:0/808360010 >> v2:172.21.15.174:3300/0 conn(0x7f6854150f50 0x7f685407af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:43.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f6858aea700 1 -- 172.21.15.80:0/808360010 >> v2:172.21.15.174:3300/0 conn(0x7f6854150f50 msgr2=0x7f685407af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:43.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f6858aea700 1 --2- 172.21.15.80:0/808360010 >> v2:172.21.15.174:3300/0 conn(0x7f6854150f50 0x7f685407af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:43.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f6858aea700 1 -- 172.21.15.80:0/808360010 >> v1:172.21.15.80:6789/0 conn(0x7f685407bba0 legacy=0x7f6854076d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:43.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f68517fa700 1 -- 172.21.15.80:0/808360010 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581323008 0 0) 0x7f684c000940 con 0x7f685407bba0 2019-11-28T11:29:43.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f6858aea700 1 -- 172.21.15.80:0/808360010 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68540792e0 con 0x7f6854074d00 2019-11-28T11:29:43.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f6858aea700 1 --2- 172.21.15.80:0/808360010 >> v2:172.21.15.80:3300/0 conn(0x7f6854074d00 0x7f685407aa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f683c010390 tx=0x7f683c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:43.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f6858aea700 1 --2- 172.21.15.80:0/808360010 >> v2:172.21.15.80:3300/0 conn(0x7f6854074d00 0x7f685407aa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f683c010390 tx=0x7f683c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:43.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f6858aea700 1 --2- 172.21.15.80:0/808360010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6854074d00 0x7f685407aa20 secure :-1 s=READY pgs=827 cs=0 l=1 rx=0x7f683c010390 tx=0x7f683c010190).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:43.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f6858aea700 1 --2- 172.21.15.80:0/808360010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6854074d00 0x7f685407aa20 secure :-1 s=THROTTLE_DONE pgs=827 cs=0 l=1 rx=0x7f683c010390 tx=0x7f683c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:43.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f68517fa700 1 -- 172.21.15.80:0/808360010 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f683c000940 con 0x7f6854074d00 2019-11-28T11:29:43.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f6858aea700 1 --2- 172.21.15.80:0/808360010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6854074d00 0x7f685407aa20 secure :-1 s=THROTTLE_DONE pgs=827 cs=0 l=1 rx=0x7f683c010390 tx=0x7f683c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:43.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f6858aea700 1 --2- 172.21.15.80:0/808360010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6854074d00 0x7f685407aa20 secure :-1 s=THROTTLE_DONE pgs=827 cs=0 l=1 rx=0x7f683c010390 tx=0x7f683c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:43.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f68517fa700 1 -- 172.21.15.80:0/808360010 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c000e80 con 0x7f6854074d00 2019-11-28T11:29:43.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f685a54d700 1 -- 172.21.15.80:0/808360010 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6854079660 con 0x7f6854074d00 2019-11-28T11:29:43.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f68517fa700 1 -- 172.21.15.80:0/808360010 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f683c0015d0 con 0x7f6854074d00 2019-11-28T11:29:43.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.184+0000 7f685a54d700 1 -- 172.21.15.80:0/808360010 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68540792e0 con 0x7f6854074d00 2019-11-28T11:29:43.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.185+0000 7f6858aea700 1 --2- 172.21.15.80:0/808360010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6854074d00 0x7f685407aa20 secure :-1 s=THROTTLE_DONE pgs=827 cs=0 l=1 rx=0x7f683c010390 tx=0x7f683c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:43.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.185+0000 7f68517fa700 1 -- 172.21.15.80:0/808360010 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f683c001070 con 0x7f6854074d00 2019-11-28T11:29:43.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.185+0000 7f6858aea700 1 --2- 172.21.15.80:0/808360010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6854074d00 0x7f685407aa20 secure :-1 s=THROTTLE_DONE pgs=827 cs=0 l=1 rx=0x7f683c010390 tx=0x7f683c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:43.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.185+0000 7f68517fa700 1 --2- 172.21.15.80:0/808360010 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6838018730 0x7f683801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:29:43.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.185+0000 7f68517fa700 1 -- 172.21.15.80:0/808360010 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f683c031a10 con 0x7f6854074d00 2019-11-28T11:29:43.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.185+0000 7f6853fff700 1 --2- 172.21.15.80:0/808360010 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6838018730 0x7f683801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:29:43.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.185+0000 7f6853fff700 1 --2- 172.21.15.80:0/808360010 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6838018730 0x7f683801abc0 crc :-1 s=READY pgs=342 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:29:43.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.192+0000 7f685a54d700 1 -- 172.21.15.80:0/808360010 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6854079660 con 0x7f6854074d00 2019-11-28T11:29:43.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.196+0000 7f6858aea700 1 --2- 172.21.15.80:0/808360010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6854074d00 0x7f685407aa20 secure :-1 s=THROTTLE_DONE pgs=827 cs=0 l=1 rx=0x7f683c010390 tx=0x7f683c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:43.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.196+0000 7f68517fa700 1 -- 172.21.15.80:0/808360010 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f683c030710 con 0x7f6854074d00 2019-11-28T11:29:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.370+0000 7f685a54d700 1 -- 172.21.15.80:0/808360010 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68540792e0 con 0x7f6854074d00 2019-11-28T11:29:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.370+0000 7f6858aea700 1 --2- 172.21.15.80:0/808360010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6854074d00 0x7f685407aa20 secure :-1 s=THROTTLE_DONE pgs=827 cs=0 l=1 rx=0x7f683c010390 tx=0x7f683c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:29:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.370+0000 7f68517fa700 1 -- 172.21.15.80:0/808360010 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2445 (secure 0 0 0) 0x7f683c030710 con 0x7f6854074d00 2019-11-28T11:29:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:29:43.403 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6312,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1488684602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1488684602},{"type":"v1","addr":"172.21.15.80:6834","nonce":1488684602}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36},{"gid":6315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1002302731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1002302731},{"type":"v1","addr":"172.21.15.80:6835","nonce":1002302731}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:29:26.954212+0000","modified":"2019-11-28T11:29:34.648365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5186":{"gid":5186,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/698358691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":698358691},{"type":"v1","addr":"172.21.15.174:6835","nonce":698358691}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2019-11-28T11:29:43.403 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 38 2019-11-28T11:29:43.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.372+0000 7f685a54d700 1 -- 172.21.15.80:0/808360010 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6838018730 msgr2=0x7f683801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:43.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.372+0000 7f685a54d700 1 --2- 172.21.15.80:0/808360010 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6838018730 0x7f683801abc0 crc :-1 s=READY pgs=342 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:43.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.372+0000 7f685a54d700 1 -- 172.21.15.80:0/808360010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6854074d00 msgr2=0x7f685407aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:29:43.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.372+0000 7f685a54d700 1 --2- 172.21.15.80:0/808360010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6854074d00 0x7f685407aa20 secure :-1 s=READY pgs=827 cs=0 l=1 rx=0x7f683c010390 tx=0x7f683c010190).stop 2019-11-28T11:29:43.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.373+0000 7f685a54d700 1 -- 172.21.15.80:0/808360010 shutdown_connections 2019-11-28T11:29:43.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.373+0000 7f685a54d700 1 --2- 172.21.15.80:0/808360010 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6838018730 0x7f683801abc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:43.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.373+0000 7f685a54d700 1 --2- 172.21.15.80:0/808360010 >> v2:172.21.15.174:3300/0 conn(0x7f6854150f50 0x7f685407af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:43.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.373+0000 7f685a54d700 1 --2- 172.21.15.80:0/808360010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6854074d00 0x7f685407aa20 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:29:43.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.373+0000 7f685a54d700 1 -- 172.21.15.80:0/808360010 shutdown_connections 2019-11-28T11:29:43.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.373+0000 7f685a54d700 1 -- 172.21.15.80:0/808360010 wait complete. 2019-11-28T11:29:43.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:29:43.373+0000 7f685a54d700 1 -- 172.21.15.80:0/808360010 >> 172.21.15.80:0/808360010 conn(0x7f685413fa50 msgr2=0x7f685407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:29:43.415 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session ls 2019-11-28T11:29:43.540 INFO:teuthology.orchestra.run.smithi174.stdout:[ 2019-11-28T11:29:43.541 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:29:43.541 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 6169, 2019-11-28T11:29:43.541 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:29:43.541 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:29:43.541 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:29:43.542 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 6169 2019-11-28T11:29:43.542 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:43.542 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:29:43.542 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:29:43.542 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.16:0", 2019-11-28T11:29:43.542 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 4246646419 2019-11-28T11:29:43.542 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:29:43.543 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:43.543 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:29:43.543 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:29:43.543 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 1, 2019-11-28T11:29:43.543 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 0, 2019-11-28T11:29:43.543 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 2.4599923449999999, 2019-11-28T11:29:43.543 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:29:43.544 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 0, 2019-11-28T11:29:43.544 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:29:43.544 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:29:43.544 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:29:43.544 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:29:43.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:43.545 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:29:43.545 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:29:43.545 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:29:43.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:43.545 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:29:43.545 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:29:43.546 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:29:43.546 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:43.546 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:29:43.546 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:29:43.546 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:29:43.546 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:43.546 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:29:43.547 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0.99433692776210114, 2019-11-28T11:29:43.547 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:29:43.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:43.547 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.6169 v1:172.21.15.16:0/4246646419", 2019-11-28T11:29:43.547 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [], 2019-11-28T11:29:43.547 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T11:29:43.547 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:29:43.548 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:29:43.548 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:29:43.548 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "1", 2019-11-28T11:29:43.548 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi016", 2019-11-28T11:29:43.548 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:29:43.548 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:29:43.548 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:29:43.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:43.549 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:29:43.549 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5240, 2019-11-28T11:29:43.549 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:29:43.549 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:29:43.549 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:29:43.549 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 5240 2019-11-28T11:29:43.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:43.550 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:29:43.550 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:29:43.550 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.76:0", 2019-11-28T11:29:43.550 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 596202409 2019-11-28T11:29:43.550 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:29:43.550 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:43.551 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:29:43.551 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:29:43.551 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 1, 2019-11-28T11:29:43.551 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 1, 2019-11-28T11:29:43.552 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 4.8419848759999997, 2019-11-28T11:29:43.552 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:29:43.553 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 1, 2019-11-28T11:29:43.553 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:29:43.553 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:29:43.553 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:29:43.554 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:29:43.554 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:43.554 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:29:43.554 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:29:43.554 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:29:43.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:43.555 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:29:43.555 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:29:43.555 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:29:43.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:43.556 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:29:43.556 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:29:43.556 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:29:43.556 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:43.556 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:29:43.556 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0.9888795548256395, 2019-11-28T11:29:43.557 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:29:43.557 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:29:43.557 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.5240 v1:172.21.15.76:0/596202409", 2019-11-28T11:29:43.557 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [ 2019-11-28T11:29:43.557 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:29:43.557 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 2, 2019-11-28T11:29:43.557 INFO:teuthology.orchestra.run.smithi174.stdout: "created_ino": "0x0" 2019-11-28T11:29:43.558 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:29:43.558 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2019-11-28T11:29:43.558 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T11:29:43.558 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:29:43.558 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:29:43.558 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:29:43.558 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "0", 2019-11-28T11:29:43.558 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi076", 2019-11-28T11:29:43.559 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:29:43.559 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/", 2019-11-28T11:29:43.559 INFO:teuthology.orchestra.run.smithi174.stdout: "timeout": "120" 2019-11-28T11:29:43.559 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:29:43.559 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:29:43.559 INFO:teuthology.orchestra.run.smithi174.stdout:] 2019-11-28T11:29:43.561 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 6169, "entity": { "name": { "type": "client", "num": 6169 }, "addr": { "type": "v1", "addr": "172.21.15.16:0", "nonce": 4246646419 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 2.4599923449999999, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.99433692776210114, "halflife": 300 }, "inst": "client.6169 v1:172.21.15.16:0/4246646419", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "1", "hostname": "smithi016", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } }, { "id": 5240, "entity": { "name": { "type": "client", "num": 5240 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 596202409 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 1, "uptime": 4.8419848759999997, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.9888795548256395, "halflife": 300 }, "inst": "client.5240 v1:172.21.15.76:0/596202409", "completed_requests": [ { "tid": 2, "created_ino": "0x0" } ], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/", "timeout": "120" } } ] 2019-11-28T11:29:48.847 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:29:48.852 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:29:48.857 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:31:13.562 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:31:13.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.658+0000 7f27f4ea0700 1 Processor -- start 2019-11-28T11:31:13.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.658+0000 7f27f4ea0700 1 -- start start 2019-11-28T11:31:13.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.659+0000 7f27f4ea0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f27f006c0a0 0x7f27f0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:31:13.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.659+0000 7f27f4ea0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27f0072620 0x7f27f0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:31:13.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.659+0000 7f27f4ea0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f006db00 con 0x7f27f00734e0 2019-11-28T11:31:13.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.659+0000 7f27f4ea0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f006fd60 con 0x7f27f0072620 2019-11-28T11:31:13.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.659+0000 7f27f4ea0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f0070030 con 0x7f27f006c0a0 2019-11-28T11:31:13.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.659+0000 7f27ef59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27f0072620 0x7f27f0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:31:13.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.659+0000 7f27ef59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27f0072620 0x7f27f0164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35158/0 (socket says 172.21.15.80:35158) 2019-11-28T11:31:13.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.659+0000 7f27ef59e700 1 -- 172.21.15.80:0/3650901772 learned_addr learned my addr 172.21.15.80:0/3650901772 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:31:13.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.659+0000 7f27eed9d700 1 --2- 172.21.15.80:0/3650901772 >> v2:172.21.15.174:3300/0 conn(0x7f27f006c0a0 0x7f27f0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:31:13.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.659+0000 7f27ef59e700 1 -- 172.21.15.80:0/3650901772 >> v2:172.21.15.174:3300/0 conn(0x7f27f006c0a0 msgr2=0x7f27f0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:31:13.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.659+0000 7f27ef59e700 1 --2- 172.21.15.80:0/3650901772 >> v2:172.21.15.174:3300/0 conn(0x7f27f006c0a0 0x7f27f0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:31:13.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.659+0000 7f27ef59e700 1 -- 172.21.15.80:0/3650901772 >> v1:172.21.15.80:6789/0 conn(0x7f27f00734e0 legacy=0x7f27f0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:31:13.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.659+0000 7f27edd9b700 1 -- 172.21.15.80:0/3650901772 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3154479982 0 0) 0x7f27d8001030 con 0x7f27f00734e0 2019-11-28T11:31:13.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.659+0000 7f27ef59e700 1 -- 172.21.15.80:0/3650901772 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00706c0 con 0x7f27f0072620 2019-11-28T11:31:13.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.660+0000 7f27eed9d700 1 --2- 172.21.15.80:0/3650901772 >> v2:172.21.15.174:3300/0 conn(0x7f27f006c0a0 0x7f27f0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:31:13.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.660+0000 7f27ef59e700 1 --2- 172.21.15.80:0/3650901772 >> v2:172.21.15.80:3300/0 conn(0x7f27f0072620 0x7f27f0164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f27e800fab0 tx=0x7f27e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:31:13.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.660+0000 7f27ef59e700 1 --2- 172.21.15.80:0/3650901772 >> v2:172.21.15.80:3300/0 conn(0x7f27f0072620 0x7f27f0164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f27e800fab0 tx=0x7f27e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:31:13.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.660+0000 7f27ef59e700 1 --2- 172.21.15.80:0/3650901772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27f0072620 0x7f27f0164d70 secure :-1 s=READY pgs=829 cs=0 l=1 rx=0x7f27e800fab0 tx=0x7f27e800fe50).ready entity=mon.0 client_cookie=83a157771c677ff6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:31:13.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.660+0000 7f27ef59e700 1 --2- 172.21.15.80:0/3650901772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27f0072620 0x7f27f0164d70 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f27e800fab0 tx=0x7f27e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:31:13.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.660+0000 7f27edd9b700 1 -- 172.21.15.80:0/3650901772 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27e8000f10 con 0x7f27f0072620 2019-11-28T11:31:13.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.660+0000 7f27ef59e700 1 --2- 172.21.15.80:0/3650901772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27f0072620 0x7f27f0164d70 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f27e800fab0 tx=0x7f27e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:31:13.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.660+0000 7f27ef59e700 1 --2- 172.21.15.80:0/3650901772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27f0072620 0x7f27f0164d70 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f27e800fab0 tx=0x7f27e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:31:13.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.660+0000 7f27edd9b700 1 -- 172.21.15.80:0/3650901772 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e8001460 con 0x7f27f0072620 2019-11-28T11:31:13.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.660+0000 7f27edd9b700 1 -- 172.21.15.80:0/3650901772 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27e8001bb0 con 0x7f27f0072620 2019-11-28T11:31:13.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.660+0000 7f27f4ea0700 1 -- 172.21.15.80:0/3650901772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27f0072620 msgr2=0x7f27f0164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:31:13.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.660+0000 7f27f4ea0700 1 --2- 172.21.15.80:0/3650901772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27f0072620 0x7f27f0164d70 secure :-1 s=READY pgs=829 cs=0 l=1 rx=0x7f27e800fab0 tx=0x7f27e800fe50).stop 2019-11-28T11:31:13.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.661+0000 7f27f4ea0700 1 -- 172.21.15.80:0/3650901772 shutdown_connections 2019-11-28T11:31:13.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.661+0000 7f27f4ea0700 1 --2- 172.21.15.80:0/3650901772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27f0072620 0x7f27f0164d70 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:31:13.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.661+0000 7f27f4ea0700 1 --2- 172.21.15.80:0/3650901772 >> v2:172.21.15.174:3300/0 conn(0x7f27f006c0a0 0x7f27f0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:31:13.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.661+0000 7f27f4ea0700 1 -- 172.21.15.80:0/3650901772 shutdown_connections 2019-11-28T11:31:13.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.661+0000 7f27f4ea0700 1 -- 172.21.15.80:0/3650901772 wait complete. 2019-11-28T11:31:13.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.661+0000 7f27f4ea0700 1 -- 172.21.15.80:0/3650901772 >> 172.21.15.80:0/3650901772 conn(0x7f27f0061cf0 msgr2=0x7f27f0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:31:13.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.663+0000 7f27f4ea0700 1 Processor -- start 2019-11-28T11:31:13.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.663+0000 7f27f4ea0700 1 -- start start 2019-11-28T11:31:13.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.664+0000 7f27f4ea0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f015d7c0 0x7f27f012e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:31:13.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.664+0000 7f27f4ea0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f27f0159970 0x7f27f0158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:31:13.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.664+0000 7f27f4ea0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f0112260 con 0x7f27f0159e00 2019-11-28T11:31:13.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.664+0000 7f27f4ea0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f01405c0 con 0x7f27f0159970 2019-11-28T11:31:13.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.664+0000 7f27f4ea0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f0140ff0 con 0x7f27f015d7c0 2019-11-28T11:31:13.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.664+0000 7f27ee59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f27f0159970 0x7f27f0158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:31:13.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.664+0000 7f27eed9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f015d7c0 0x7f27f012e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:31:13.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.664+0000 7f27ee59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f27f0159970 0x7f27f0158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:50050/0 (socket says 172.21.15.80:50050) 2019-11-28T11:31:13.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.664+0000 7f27ee59c700 1 -- 172.21.15.80:0/4014710820 learned_addr learned my addr 172.21.15.80:0/4014710820 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:31:13.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27eed9d700 1 -- 172.21.15.80:0/4014710820 >> v2:172.21.15.174:3300/0 conn(0x7f27f0159970 msgr2=0x7f27f0158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:31:13.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27eed9d700 1 --2- 172.21.15.80:0/4014710820 >> v2:172.21.15.174:3300/0 conn(0x7f27f0159970 0x7f27f0158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:31:13.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27eed9d700 1 -- 172.21.15.80:0/4014710820 >> v1:172.21.15.174:6789/0 conn(0x7f27f0159e00 legacy=0x7f27f0158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:31:13.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27eed9d700 1 -- 172.21.15.80:0/4014710820 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f0141950 con 0x7f27f015d7c0 2019-11-28T11:31:13.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27e77fe700 1 -- 172.21.15.80:0/4014710820 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578475433 0 0) 0x7f27e8000ed0 con 0x7f27f0159e00 2019-11-28T11:31:13.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27ee59c700 1 --2- 172.21.15.80:0/4014710820 >> v2:172.21.15.174:3300/0 conn(0x7f27f0159970 0x7f27f0158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:31:13.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27eed9d700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f015d7c0 0x7f27f012e690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27e0010380 tx=0x7f27e0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:31:13.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27eed9d700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f015d7c0 0x7f27f012e690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27e0010380 tx=0x7f27e0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:31:13.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27eed9d700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f015d7c0 0x7f27f012e690 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f27e0010380 tx=0x7f27e0010720).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:31:13.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27eed9d700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f015d7c0 0x7f27f012e690 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f27e0010380 tx=0x7f27e0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:31:13.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27e77fe700 1 -- 172.21.15.80:0/4014710820 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27e0000940 con 0x7f27f015d7c0 2019-11-28T11:31:13.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27eed9d700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f015d7c0 0x7f27f012e690 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f27e0010380 tx=0x7f27e0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:31:13.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27f4ea0700 1 -- 172.21.15.80:0/4014710820 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f0141cd0 con 0x7f27f015d7c0 2019-11-28T11:31:13.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27e77fe700 1 -- 172.21.15.80:0/4014710820 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e0000940 con 0x7f27f015d7c0 2019-11-28T11:31:13.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27eed9d700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f015d7c0 0x7f27f012e690 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f27e0010380 tx=0x7f27e0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:31:13.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27e77fe700 1 -- 172.21.15.80:0/4014710820 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27e0001320 con 0x7f27f015d7c0 2019-11-28T11:31:13.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.665+0000 7f27f4ea0700 1 -- 172.21.15.80:0/4014710820 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f0141950 con 0x7f27f015d7c0 2019-11-28T11:31:13.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.666+0000 7f27eed9d700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f015d7c0 0x7f27f012e690 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f27e0010380 tx=0x7f27e0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:31:13.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.666+0000 7f27eed9d700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f015d7c0 0x7f27f012e690 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f27e0010380 tx=0x7f27e0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:31:13.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.666+0000 7f27e77fe700 1 -- 172.21.15.80:0/4014710820 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f27e0000fe0 con 0x7f27f015d7c0 2019-11-28T11:31:13.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.666+0000 7f27e77fe700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27d4018730 0x7f27d401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:31:13.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.666+0000 7f27e77fe700 1 -- 172.21.15.80:0/4014710820 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f27e00319b0 con 0x7f27f015d7c0 2019-11-28T11:31:13.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.666+0000 7f27ee59c700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27d4018730 0x7f27d401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:31:13.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.666+0000 7f27ee59c700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27d4018730 0x7f27d401abc0 crc :-1 s=READY pgs=343 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:31:13.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.673+0000 7f27f4ea0700 1 -- 172.21.15.80:0/4014710820 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f0141cd0 con 0x7f27f015d7c0 2019-11-28T11:31:13.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.678+0000 7f27eed9d700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f015d7c0 0x7f27f012e690 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f27e0010380 tx=0x7f27e0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:31:13.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.678+0000 7f27e77fe700 1 -- 172.21.15.80:0/4014710820 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f27e0000c90 con 0x7f27f015d7c0 2019-11-28T11:31:13.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.849+0000 7f27f4ea0700 1 -- 172.21.15.80:0/4014710820 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27f0141950 con 0x7f27f015d7c0 2019-11-28T11:31:13.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.849+0000 7f27eed9d700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f015d7c0 0x7f27f012e690 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f27e0010380 tx=0x7f27e0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:31:13.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.849+0000 7f27e77fe700 1 -- 172.21.15.80:0/4014710820 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2445 (secure 0 0 0) 0x7f27e0000f40 con 0x7f27f015d7c0 2019-11-28T11:31:13.887 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 38 2019-11-28T11:31:13.887 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:31:13.887 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6312,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1488684602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1488684602},{"type":"v1","addr":"172.21.15.80:6834","nonce":1488684602}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36},{"gid":6315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1002302731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1002302731},{"type":"v1","addr":"172.21.15.80:6835","nonce":1002302731}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:29:26.954212+0000","modified":"2019-11-28T11:29:34.648365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5186":{"gid":5186,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/698358691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":698358691},{"type":"v1","addr":"172.21.15.174:6835","nonce":698358691}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2019-11-28T11:31:13.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.851+0000 7f27f4ea0700 1 -- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27d4018730 msgr2=0x7f27d401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:31:13.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.851+0000 7f27f4ea0700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27d4018730 0x7f27d401abc0 crc :-1 s=READY pgs=343 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:31:13.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.851+0000 7f27f4ea0700 1 -- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f015d7c0 msgr2=0x7f27f012e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:31:13.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.852+0000 7f27f4ea0700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f015d7c0 0x7f27f012e690 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f27e0010380 tx=0x7f27e0010720).stop 2019-11-28T11:31:13.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.852+0000 7f27f4ea0700 1 -- 172.21.15.80:0/4014710820 shutdown_connections 2019-11-28T11:31:13.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.852+0000 7f27f4ea0700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27d4018730 0x7f27d401abc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:31:13.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.852+0000 7f27f4ea0700 1 --2- 172.21.15.80:0/4014710820 >> v2:172.21.15.174:3300/0 conn(0x7f27f0159970 0x7f27f0158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:31:13.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.852+0000 7f27f4ea0700 1 --2- 172.21.15.80:0/4014710820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f015d7c0 0x7f27f012e690 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:31:13.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.852+0000 7f27f4ea0700 1 -- 172.21.15.80:0/4014710820 shutdown_connections 2019-11-28T11:31:13.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.852+0000 7f27f4ea0700 1 -- 172.21.15.80:0/4014710820 wait complete. 2019-11-28T11:31:13.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:31:13.852+0000 7f27f4ea0700 1 -- 172.21.15.80:0/4014710820 >> 172.21.15.80:0/4014710820 conn(0x7f27f013b860 msgr2=0x7f27f01050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:31:13.899 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session ls 2019-11-28T11:31:14.049 INFO:teuthology.orchestra.run.smithi174.stdout:[ 2019-11-28T11:31:14.049 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:31:14.049 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 6169, 2019-11-28T11:31:14.050 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:31:14.050 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:31:14.050 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:31:14.050 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 6169 2019-11-28T11:31:14.050 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:31:14.050 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:31:14.050 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:31:14.051 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.16:0", 2019-11-28T11:31:14.051 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 4246646419 2019-11-28T11:31:14.051 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:31:14.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:31:14.051 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:31:14.051 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:31:14.051 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 1, 2019-11-28T11:31:14.052 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 0, 2019-11-28T11:31:14.052 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 92.969747408000003, 2019-11-28T11:31:14.052 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:31:14.052 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 0, 2019-11-28T11:31:14.053 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:31:14.053 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:31:14.053 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:31:14.053 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:31:14.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:31:14.053 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:31:14.054 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:31:14.054 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:31:14.054 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:31:14.054 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:31:14.054 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:31:14.054 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:31:14.054 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:31:14.055 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:31:14.055 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:31:14.055 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:31:14.055 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:31:14.055 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:31:14.055 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0.80670187183670727, 2019-11-28T11:31:14.055 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:31:14.056 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:31:14.056 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.6169 v1:172.21.15.16:0/4246646419", 2019-11-28T11:31:14.056 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [], 2019-11-28T11:31:14.056 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T11:31:14.056 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:31:14.056 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:31:14.056 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:31:14.057 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "1", 2019-11-28T11:31:14.057 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi016", 2019-11-28T11:31:14.057 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:31:14.057 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:31:14.057 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:31:14.057 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:31:14.057 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:31:14.058 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5240, 2019-11-28T11:31:14.058 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:31:14.058 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:31:14.058 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:31:14.058 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 5240 2019-11-28T11:31:14.058 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:31:14.058 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:31:14.059 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:31:14.059 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.76:0", 2019-11-28T11:31:14.059 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 596202409 2019-11-28T11:31:14.059 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:31:14.059 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:31:14.059 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:31:14.059 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:31:14.060 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 1, 2019-11-28T11:31:14.060 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 0, 2019-11-28T11:31:14.060 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 95.350739942000004, 2019-11-28T11:31:14.060 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:31:14.062 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 1, 2019-11-28T11:31:14.062 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:31:14.062 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:31:14.063 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:31:14.063 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:31:14.063 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:31:14.063 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:31:14.063 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:31:14.063 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:31:14.063 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:31:14.064 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:31:14.064 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:31:14.064 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:31:14.064 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:31:14.064 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:31:14.064 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:31:14.064 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:31:14.065 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:31:14.065 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:31:14.065 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0.80227617900187631, 2019-11-28T11:31:14.065 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:31:14.065 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:31:14.065 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.5240 v1:172.21.15.76:0/596202409", 2019-11-28T11:31:14.065 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [ 2019-11-28T11:31:14.066 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:31:14.066 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 2, 2019-11-28T11:31:14.066 INFO:teuthology.orchestra.run.smithi174.stdout: "created_ino": "0x0" 2019-11-28T11:31:14.066 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:31:14.066 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2019-11-28T11:31:14.066 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T11:31:14.066 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:31:14.066 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:31:14.067 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:31:14.067 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "0", 2019-11-28T11:31:14.067 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi076", 2019-11-28T11:31:14.067 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:31:14.067 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/", 2019-11-28T11:31:14.067 INFO:teuthology.orchestra.run.smithi174.stdout: "timeout": "120" 2019-11-28T11:31:14.067 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:31:14.068 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:31:14.068 INFO:teuthology.orchestra.run.smithi174.stdout:] 2019-11-28T11:31:14.069 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 6169, "entity": { "name": { "type": "client", "num": 6169 }, "addr": { "type": "v1", "addr": "172.21.15.16:0", "nonce": 4246646419 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 92.969747408000003, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.80670187183670727, "halflife": 300 }, "inst": "client.6169 v1:172.21.15.16:0/4246646419", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "1", "hostname": "smithi016", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } }, { "id": 5240, "entity": { "name": { "type": "client", "num": 5240 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 596202409 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 95.350739942000004, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.80227617900187631, "halflife": 300 }, "inst": "client.5240 v1:172.21.15.76:0/596202409", "completed_requests": [ { "tid": 2, "created_ino": "0x0" } ], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/", "timeout": "120" } } ] 2019-11-28T11:32:14.070 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:32:14.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.159+0000 7fa601ab4700 1 Processor -- start 2019-11-28T11:32:14.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.159+0000 7fa601ab4700 1 -- start start 2019-11-28T11:32:14.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa601ab4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5fc06c0a0 0x7fa5fc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa601ab4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa5fc072620 0x7fa5fc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa601ab4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5fc06db00 con 0x7fa5fc0734e0 2019-11-28T11:32:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa601ab4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5fc06f330 con 0x7fa5fc072620 2019-11-28T11:32:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa601ab4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc0706c0 con 0x7fa5fc06c0a0 2019-11-28T11:32:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa600852700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa5fc072620 0x7fa5fc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa5f3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa5fc0734e0 0x7fa5fc071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34486/0 (socket says 172.21.15.80:34486) 2019-11-28T11:32:14.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa600852700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa5fc072620 0x7fa5fc164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35174/0 (socket says 172.21.15.80:35174) 2019-11-28T11:32:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa5f3fff700 1 -- 172.21.15.80:0/647040984 learned_addr learned my addr 172.21.15.80:0/647040984 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa5fbfff700 1 --2- 172.21.15.80:0/647040984 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5fc06c0a0 0x7fa5fc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa600852700 1 -- 172.21.15.80:0/647040984 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5fc06c0a0 msgr2=0x7fa5fc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa600852700 1 --2- 172.21.15.80:0/647040984 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5fc06c0a0 0x7fa5fc072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa600852700 1 -- 172.21.15.80:0/647040984 >> v1:172.21.15.80:6789/0 conn(0x7fa5fc0734e0 legacy=0x7fa5fc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa600852700 1 -- 172.21.15.80:0/647040984 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc070a40 con 0x7fa5fc072620 2019-11-28T11:32:14.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa5fb7fe700 1 -- 172.21.15.80:0/647040984 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996518062 0 0) 0x7fa5e4001150 con 0x7fa5fc0734e0 2019-11-28T11:32:14.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa600852700 1 --2- 172.21.15.80:0/647040984 >> v2:172.21.15.80:3300/0 conn(0x7fa5fc072620 0x7fa5fc164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa5f400b2d0 tx=0x7fa5f400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:14.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa600852700 1 --2- 172.21.15.80:0/647040984 >> v2:172.21.15.80:3300/0 conn(0x7fa5fc072620 0x7fa5fc164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa5f400b2d0 tx=0x7fa5f400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:14.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa600852700 1 --2- 172.21.15.80:0/647040984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5fc072620 0x7fa5fc164d70 secure :-1 s=READY pgs=831 cs=0 l=1 rx=0x7fa5f400b2d0 tx=0x7fa5f400ba60).ready entity=mon.0 client_cookie=f1d9d286dfb5ba3d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:14.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa600852700 1 --2- 172.21.15.80:0/647040984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5fc072620 0x7fa5fc164d70 secure :-1 s=THROTTLE_DONE pgs=831 cs=0 l=1 rx=0x7fa5f400b2d0 tx=0x7fa5f400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:14.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa5fb7fe700 1 -- 172.21.15.80:0/647040984 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f4009f20 con 0x7fa5fc072620 2019-11-28T11:32:14.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa600852700 1 --2- 172.21.15.80:0/647040984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5fc072620 0x7fa5fc164d70 secure :-1 s=THROTTLE_DONE pgs=831 cs=0 l=1 rx=0x7fa5f400b2d0 tx=0x7fa5f400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:14.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.161+0000 7fa600852700 1 --2- 172.21.15.80:0/647040984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5fc072620 0x7fa5fc164d70 secure :-1 s=THROTTLE_DONE pgs=831 cs=0 l=1 rx=0x7fa5f400b2d0 tx=0x7fa5f400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:14.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.160+0000 7fa5fb7fe700 1 -- 172.21.15.80:0/647040984 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f4000f10 con 0x7fa5fc072620 2019-11-28T11:32:14.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.161+0000 7fa5fb7fe700 1 -- 172.21.15.80:0/647040984 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f4009f20 con 0x7fa5fc072620 2019-11-28T11:32:14.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.161+0000 7fa601ab4700 1 -- 172.21.15.80:0/647040984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5fc072620 msgr2=0x7fa5fc164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:14.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.161+0000 7fa601ab4700 1 --2- 172.21.15.80:0/647040984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5fc072620 0x7fa5fc164d70 secure :-1 s=READY pgs=831 cs=0 l=1 rx=0x7fa5f400b2d0 tx=0x7fa5f400ba60).stop 2019-11-28T11:32:14.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.161+0000 7fa601ab4700 1 -- 172.21.15.80:0/647040984 shutdown_connections 2019-11-28T11:32:14.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.161+0000 7fa601ab4700 1 --2- 172.21.15.80:0/647040984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5fc072620 0x7fa5fc164d70 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:14.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.161+0000 7fa601ab4700 1 --2- 172.21.15.80:0/647040984 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5fc06c0a0 0x7fa5fc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:14.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.161+0000 7fa601ab4700 1 -- 172.21.15.80:0/647040984 shutdown_connections 2019-11-28T11:32:14.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.161+0000 7fa601ab4700 1 -- 172.21.15.80:0/647040984 wait complete. 2019-11-28T11:32:14.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.161+0000 7fa601ab4700 1 -- 172.21.15.80:0/647040984 >> 172.21.15.80:0/647040984 conn(0x7fa5fc061cf0 msgr2=0x7fa5fc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:14.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.164+0000 7fa601ab4700 1 Processor -- start 2019-11-28T11:32:14.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.164+0000 7fa601ab4700 1 -- start start 2019-11-28T11:32:14.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa601ab4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5fc13e9e0 0x7fa5fc108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:14.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa601ab4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5fc1066e0 con 0x7fa5fc109430 2019-11-28T11:32:14.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa601ab4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5fc10ce40 con 0x7fa5fc13e5f0 2019-11-28T11:32:14.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa601ab4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc10e060 con 0x7fa5fc13e9e0 2019-11-28T11:32:14.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa600852700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa5fc109430 0x7fa5fc168ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34496/0 (socket says 172.21.15.80:34496) 2019-11-28T11:32:14.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa600852700 1 -- 172.21.15.80:0/3602405316 learned_addr learned my addr 172.21.15.80:0/3602405316 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:14.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f3fff700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5fc13e9e0 0x7fa5fc108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:14.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884496782 0 0) 0x7fa5f4000cc0 con 0x7fa5fc109430 2019-11-28T11:32:14.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5e0002e80 con 0x7fa5fc109430 2019-11-28T11:32:14.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774361347 0 0) 0x7fa5ec000f30 con 0x7fa5fc13e5f0 2019-11-28T11:32:14.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5e00030b0 con 0x7fa5fc13e5f0 2019-11-28T11:32:14.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3150237099 0 0) 0x7fa5f4000ee0 con 0x7fa5fc109430 2019-11-28T11:32:14.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa5e00033c0 con 0x7fa5fc109430 2019-11-28T11:32:14.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fa5f400a000 con 0x7fa5fc109430 2019-11-28T11:32:14.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5fc13e9e0 msgr2=0x7fa5fc108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:14.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5fc13e9e0 0x7fa5fc108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:14.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 >> v1:172.21.15.174:6789/0 conn(0x7fa5fc13e5f0 legacy=0x7fa5fc10a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:14.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 >> v1:172.21.15.80:6789/0 conn(0x7fa5fc109430 legacy=0x7fa5fc168ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:14.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5e0005d40 0x7fa5e0006130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:14.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5e00046f0 0x7fa5e0004b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:14.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5e0005080 0x7fa5e00032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:14.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e0003960 con 0x7fa5e0005080 2019-11-28T11:32:14.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e0003b90 con 0x7fa5e0005d40 2019-11-28T11:32:14.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e0003dc0 con 0x7fa5e00046f0 2019-11-28T11:32:14.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa600852700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5e0005080 0x7fa5e00032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:14.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5f3fff700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5e00046f0 0x7fa5e0004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:14.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.165+0000 7fa5fbfff700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5e0005d40 0x7fa5e0006130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:14.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa600852700 1 -- 172.21.15.80:0/3602405316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5e00046f0 msgr2=0x7fa5e0004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:14.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa600852700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5e00046f0 0x7fa5e0004b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:14.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa600852700 1 -- 172.21.15.80:0/3602405316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5e0005d40 msgr2=0x7fa5e0006130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:14.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa600852700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5e0005d40 0x7fa5e0006130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:14.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa600852700 1 -- 172.21.15.80:0/3602405316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e0004070 con 0x7fa5e0005080 2019-11-28T11:32:14.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa601ab4700 1 -- 172.21.15.80:0/3602405316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5fc10ed40 con 0x7fa5e0005080 2019-11-28T11:32:14.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa600852700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5e0005080 0x7fa5e00032e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa5f40107b0 tx=0x7fa5f4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:14.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa601ab4700 1 -- 172.21.15.80:0/3602405316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5fc10e9c0 con 0x7fa5e0005080 2019-11-28T11:32:14.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa600852700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5e0005080 0x7fa5e00032e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa5f40107b0 tx=0x7fa5f4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:14.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa600852700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5e0005080 0x7fa5e00032e0 secure :-1 s=READY pgs=833 cs=0 l=1 rx=0x7fa5f40107b0 tx=0x7fa5f4010660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:14.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa600852700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5e0005080 0x7fa5e00032e0 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fa5f40107b0 tx=0x7fa5f4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:14.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f4000ee0 con 0x7fa5e0005080 2019-11-28T11:32:14.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa600852700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5e0005080 0x7fa5e00032e0 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fa5f40107b0 tx=0x7fa5f4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:14.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f4000ee0 con 0x7fa5e0005080 2019-11-28T11:32:14.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa600852700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5e0005080 0x7fa5e00032e0 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fa5f40107b0 tx=0x7fa5f4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:14.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f4005cb0 con 0x7fa5e0005080 2019-11-28T11:32:14.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.166+0000 7fa600852700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5e0005080 0x7fa5e00032e0 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fa5f40107b0 tx=0x7fa5f4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:14.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.167+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa5f40058d0 con 0x7fa5e0005080 2019-11-28T11:32:14.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.167+0000 7fa600852700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5e0005080 0x7fa5e00032e0 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fa5f40107b0 tx=0x7fa5f4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:14.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.167+0000 7fa5f97fa700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa5e0020b90 0x7fa5e0022fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:14.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.167+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fa5f4031db0 con 0x7fa5e0005080 2019-11-28T11:32:14.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.167+0000 7fa5fbfff700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa5e0020b90 0x7fa5e0022fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:14.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.167+0000 7fa5fbfff700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa5e0020b90 0x7fa5e0022fc0 crc :-1 s=READY pgs=344 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:14.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.174+0000 7fa601ab4700 1 -- 172.21.15.80:0/3602405316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d4002e60 con 0x7fa5e0005080 2019-11-28T11:32:14.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.177+0000 7fa600852700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5e0005080 0x7fa5e00032e0 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fa5f40107b0 tx=0x7fa5f4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:14.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.177+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa5f40056c0 con 0x7fa5e0005080 2019-11-28T11:32:14.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.349+0000 7fa601ab4700 1 -- 172.21.15.80:0/3602405316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5d4001d10 con 0x7fa5e0005080 2019-11-28T11:32:14.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.350+0000 7fa600852700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5e0005080 0x7fa5e00032e0 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fa5f40107b0 tx=0x7fa5f4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:14.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.350+0000 7fa5f97fa700 1 -- 172.21.15.80:0/3602405316 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2445 (secure 0 0 0) 0x7fa5f40058d0 con 0x7fa5e0005080 2019-11-28T11:32:14.392 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 38 2019-11-28T11:32:14.392 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:32:14.392 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6312,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1488684602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1488684602},{"type":"v1","addr":"172.21.15.80:6834","nonce":1488684602}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36},{"gid":6315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/1002302731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1002302731},{"type":"v1","addr":"172.21.15.80:6835","nonce":1002302731}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:29:26.954212+0000","modified":"2019-11-28T11:29:34.648365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5186":{"gid":5186,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/698358691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":698358691},{"type":"v1","addr":"172.21.15.174:6835","nonce":698358691}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2019-11-28T11:32:14.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.352+0000 7fa601ab4700 1 -- 172.21.15.80:0/3602405316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa5e0020b90 msgr2=0x7fa5e0022fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:14.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.352+0000 7fa601ab4700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa5e0020b90 0x7fa5e0022fc0 crc :-1 s=READY pgs=344 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:14.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.352+0000 7fa601ab4700 1 -- 172.21.15.80:0/3602405316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5e0005080 msgr2=0x7fa5e00032e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:14.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.352+0000 7fa601ab4700 1 --2- 172.21.15.80:0/3602405316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5e0005080 0x7fa5e00032e0 secure :-1 s=READY pgs=833 cs=0 l=1 rx=0x7fa5f40107b0 tx=0x7fa5f4010660).stop 2019-11-28T11:32:14.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.352+0000 7fa600852700 1 -- 172.21.15.80:0/3602405316 reap_dead start 2019-11-28T11:32:14.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.352+0000 7fa600852700 1 -- 172.21.15.80:0/3602405316 reap_dead start 2019-11-28T11:32:14.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.352+0000 7fa601ab4700 1 -- 172.21.15.80:0/3602405316 shutdown_connections 2019-11-28T11:32:14.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.352+0000 7fa601ab4700 1 -- 172.21.15.80:0/3602405316 shutdown_connections 2019-11-28T11:32:14.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.352+0000 7fa601ab4700 1 -- 172.21.15.80:0/3602405316 wait complete. 2019-11-28T11:32:14.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:14.352+0000 7fa601ab4700 1 -- 172.21.15.80:0/3602405316 >> 172.21.15.80:0/3602405316 conn(0x7fa5fc13d620 msgr2=0x7fa5fc13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:14.404 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session ls 2019-11-28T11:32:14.543 INFO:teuthology.orchestra.run.smithi174.stdout:[ 2019-11-28T11:32:14.543 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:32:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 6169, 2019-11-28T11:32:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:32:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:32:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:32:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 6169 2019-11-28T11:32:14.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:32:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:32:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:32:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.16:0", 2019-11-28T11:32:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 4246646419 2019-11-28T11:32:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:32:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:32:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:32:14.545 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:32:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 1, 2019-11-28T11:32:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 0, 2019-11-28T11:32:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 153.46461645700001, 2019-11-28T11:32:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:32:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 0, 2019-11-28T11:32:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:32:14.546 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:32:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:32:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:32:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:32:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:32:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:32:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:32:14.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:32:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:32:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:32:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:32:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:32:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:32:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:32:14.548 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:32:14.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:32:14.549 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:32:14.549 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0.70147225367147592, 2019-11-28T11:32:14.549 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:32:14.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:32:14.549 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.6169 v1:172.21.15.16:0/4246646419", 2019-11-28T11:32:14.549 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [], 2019-11-28T11:32:14.550 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T11:32:14.550 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:32:14.550 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:32:14.550 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:32:14.550 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "1", 2019-11-28T11:32:14.550 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi016", 2019-11-28T11:32:14.550 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:32:14.551 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:32:14.551 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:32:14.551 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:32:14.551 INFO:teuthology.orchestra.run.smithi174.stdout:] 2019-11-28T11:32:14.552 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 6169, "entity": { "name": { "type": "client", "num": 6169 }, "addr": { "type": "v1", "addr": "172.21.15.16:0", "nonce": 4246646419 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 153.46461645700001, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.70147225367147592, "halflife": 300 }, "inst": "client.6169 v1:172.21.15.16:0/4246646419", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "1", "hostname": "smithi016", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:32:35.641 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2019-11-28T11:32:35.660 DEBUG:tasks.ceph:Missed logrotate, host unreachable 2019-11-28T11:32:44.553 INFO:teuthology.misc:Re-opening connections... 2019-11-28T11:32:44.553 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:32:44.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:32:44.554 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:32:44.665 INFO:teuthology.orchestra.run.smithi076:> true 2019-11-28T11:32:45.017 DEBUG:teuthology.misc:waited 0.463842153549 2019-11-28T11:32:46.018 INFO:teuthology.orchestra.run:Running command with timeout 10 2019-11-28T11:32:46.018 INFO:teuthology.orchestra.run.smithi076:> uptime 2019-11-28T11:32:46.140 INFO:teuthology.orchestra.run.smithi076.stdout: 11:32:46 up 1 min, 0 users, load average: 0.35, 0.14, 0.05 2019-11-28T11:32:46.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:32:46.141 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:32:46.233 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout' 2019-11-28T11:32:46.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.311+0000 7fee234f4700 1 Processor -- start 2019-11-28T11:32:46.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.311+0000 7fee234f4700 1 -- start start 2019-11-28T11:32:46.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.312+0000 7fee234f4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fee1c06c0a0 0x7fee1c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:46.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.312+0000 7fee234f4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1c06db00 con 0x7fee1c0734e0 2019-11-28T11:32:46.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.312+0000 7fee234f4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1c06e000 con 0x7fee1c072620 2019-11-28T11:32:46.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.312+0000 7fee234f4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1c06fd60 con 0x7fee1c06c0a0 2019-11-28T11:32:46.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.312+0000 7fee21290700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fee1c0734e0 0x7fee1c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34510/0 (socket says 172.21.15.80:34510) 2019-11-28T11:32:46.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.312+0000 7fee21290700 1 -- 172.21.15.80:0/301672286 learned_addr learned my addr 172.21.15.80:0/301672286 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:46.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.312+0000 7fee21a91700 1 --2- 172.21.15.80:0/301672286 >> v2:172.21.15.174:3300/0 conn(0x7fee1c06c0a0 0x7fee1c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:46.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.312+0000 7fee20a8f700 1 -- 172.21.15.80:0/301672286 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788129956 0 0) 0x7fee10001070 con 0x7fee1c0734e0 2019-11-28T11:32:46.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee20a8f700 1 -- 172.21.15.80:0/301672286 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee04002e80 con 0x7fee1c0734e0 2019-11-28T11:32:46.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee20a8f700 1 -- 172.21.15.80:0/301672286 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3109062301 0 0) 0x7fee10001050 con 0x7fee1c0734e0 2019-11-28T11:32:46.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee20a8f700 1 -- 172.21.15.80:0/301672286 >> v2:172.21.15.174:3300/0 conn(0x7fee1c06c0a0 msgr2=0x7fee1c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:46.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee20a8f700 1 --2- 172.21.15.80:0/301672286 >> v2:172.21.15.174:3300/0 conn(0x7fee1c06c0a0 0x7fee1c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:46.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee20a8f700 1 -- 172.21.15.80:0/301672286 >> v1:172.21.15.174:6789/0 conn(0x7fee1c072620 legacy=0x7fee1c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:46.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee20a8f700 1 -- 172.21.15.80:0/301672286 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c0706c0 con 0x7fee1c0734e0 2019-11-28T11:32:46.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee20a8f700 1 -- 172.21.15.80:0/301672286 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fee10001580 con 0x7fee1c0734e0 2019-11-28T11:32:46.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee20a8f700 1 -- 172.21.15.80:0/301672286 >> v1:172.21.15.80:6789/0 conn(0x7fee1c0734e0 legacy=0x7fee1c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:46.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee20a8f700 1 --2- 172.21.15.80:0/301672286 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee04003ab0 0x7fee04005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:46.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee20a8f700 1 --2- 172.21.15.80:0/301672286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee04006670 0x7fee04008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:46.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee20a8f700 1 --2- 172.21.15.80:0/301672286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee04009380 0x7fee0400b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:46.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee20a8f700 1 -- 172.21.15.80:0/301672286 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0400c000 con 0x7fee04009380 2019-11-28T11:32:46.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee20a8f700 1 -- 172.21.15.80:0/301672286 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee04050200 con 0x7fee04006670 2019-11-28T11:32:46.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee20a8f700 1 -- 172.21.15.80:0/301672286 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee04050430 con 0x7fee04003ab0 2019-11-28T11:32:46.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee22292700 1 --2- 172.21.15.80:0/301672286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee04009380 0x7fee0400b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:46.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee21a91700 1 --2- 172.21.15.80:0/301672286 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee04003ab0 0x7fee04005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:46.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee21290700 1 --2- 172.21.15.80:0/301672286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee04006670 0x7fee04008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:46.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee22292700 1 -- 172.21.15.80:0/301672286 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee04003ab0 msgr2=0x7fee04005ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:46.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee22292700 1 --2- 172.21.15.80:0/301672286 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee04003ab0 0x7fee04005ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:46.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee22292700 1 -- 172.21.15.80:0/301672286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee04006670 msgr2=0x7fee04008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:46.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee22292700 1 --2- 172.21.15.80:0/301672286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee04006670 0x7fee04008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:46.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee22292700 1 -- 172.21.15.80:0/301672286 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee040506e0 con 0x7fee04009380 2019-11-28T11:32:46.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee22292700 1 --2- 172.21.15.80:0/301672286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee04009380 0x7fee0400b850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fee1400b2d0 tx=0x7fee1400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:46.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee22292700 1 -- 172.21.15.80:0/301672286 reap_dead start 2019-11-28T11:32:46.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee22292700 1 --2- 172.21.15.80:0/301672286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee04009380 0x7fee0400b850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fee1400b2d0 tx=0x7fee1400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:46.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee22292700 1 --2- 172.21.15.80:0/301672286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee04009380 0x7fee0400b850 secure :-1 s=READY pgs=835 cs=0 l=1 rx=0x7fee1400b2d0 tx=0x7fee1400b5d0).ready entity=mon.0 client_cookie=b5e29d480a001692 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:46.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.313+0000 7fee22292700 1 --2- 172.21.15.80:0/301672286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee04009380 0x7fee0400b850 secure :-1 s=THROTTLE_DONE pgs=835 cs=0 l=1 rx=0x7fee1400b2d0 tx=0x7fee1400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:46.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.314+0000 7fee20a8f700 1 -- 172.21.15.80:0/301672286 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee14009ef0 con 0x7fee04009380 2019-11-28T11:32:46.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.314+0000 7fee22292700 1 --2- 172.21.15.80:0/301672286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee04009380 0x7fee0400b850 secure :-1 s=THROTTLE_DONE pgs=835 cs=0 l=1 rx=0x7fee1400b2d0 tx=0x7fee1400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:46.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.314+0000 7fee22292700 1 --2- 172.21.15.80:0/301672286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee04009380 0x7fee0400b850 secure :-1 s=THROTTLE_DONE pgs=835 cs=0 l=1 rx=0x7fee1400b2d0 tx=0x7fee1400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:46.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.314+0000 7fee20a8f700 1 -- 172.21.15.80:0/301672286 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee14000d30 con 0x7fee04009380 2019-11-28T11:32:46.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.314+0000 7fee20a8f700 1 -- 172.21.15.80:0/301672286 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee14009c50 con 0x7fee04009380 2019-11-28T11:32:46.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.314+0000 7fee234f4700 1 -- 172.21.15.80:0/301672286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee04009380 msgr2=0x7fee0400b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:46.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.314+0000 7fee234f4700 1 --2- 172.21.15.80:0/301672286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee04009380 0x7fee0400b850 secure :-1 s=READY pgs=835 cs=0 l=1 rx=0x7fee1400b2d0 tx=0x7fee1400b5d0).stop 2019-11-28T11:32:46.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.314+0000 7fee234f4700 1 -- 172.21.15.80:0/301672286 shutdown_connections 2019-11-28T11:32:46.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.314+0000 7fee234f4700 1 --2- 172.21.15.80:0/301672286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee04009380 0x7fee0400b850 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:46.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.314+0000 7fee234f4700 1 -- 172.21.15.80:0/301672286 shutdown_connections 2019-11-28T11:32:46.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.314+0000 7fee234f4700 1 -- 172.21.15.80:0/301672286 wait complete. 2019-11-28T11:32:46.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.314+0000 7fee234f4700 1 -- 172.21.15.80:0/301672286 >> 172.21.15.80:0/301672286 conn(0x7fee1c061cf0 msgr2=0x7fee1c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:46.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.317+0000 7fee234f4700 1 Processor -- start 2019-11-28T11:32:46.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.317+0000 7fee234f4700 1 -- start start 2019-11-28T11:32:46.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee234f4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fee1c0750f0 0x7fee1c151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:46.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee234f4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee1c151f90 0x7fee1c1523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:46.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee234f4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1c079230 con 0x7fee1c074d00 2019-11-28T11:32:46.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee234f4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1c07ab30 con 0x7fee1c0750f0 2019-11-28T11:32:46.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee234f4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c07ae00 con 0x7fee1c151f90 2019-11-28T11:32:46.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee22292700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee1c151f90 0x7fee1c1523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:46.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee21290700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fee1c0750f0 0x7fee1c151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:46.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee22292700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee1c151f90 0x7fee1c1523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:37466/0 (socket says 172.21.15.80:37466) 2019-11-28T11:32:46.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee22292700 1 -- 172.21.15.80:0/176771416 learned_addr learned my addr 172.21.15.80:0/176771416 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:46.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee22292700 1 -- 172.21.15.80:0/176771416 >> v2:172.21.15.174:3300/0 conn(0x7fee1c0750f0 msgr2=0x7fee1c151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:46.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee22292700 1 --2- 172.21.15.80:0/176771416 >> v2:172.21.15.174:3300/0 conn(0x7fee1c0750f0 0x7fee1c151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:46.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee22292700 1 -- 172.21.15.80:0/176771416 >> v1:172.21.15.174:6789/0 conn(0x7fee1c074d00 legacy=0x7fee1c152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:46.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee22292700 1 -- 172.21.15.80:0/176771416 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c07b490 con 0x7fee1c151f90 2019-11-28T11:32:46.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee22292700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee1c151f90 0x7fee1c1523e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee140107d0 tx=0x7fee14010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:46.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee22292700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee1c151f90 0x7fee1c1523e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee140107d0 tx=0x7fee14010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:46.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee22292700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee1c151f90 0x7fee1c1523e0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fee140107d0 tx=0x7fee14010600).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:46.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee22292700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee1c151f90 0x7fee1c1523e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fee140107d0 tx=0x7fee14010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:46.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee1a7fc700 1 -- 172.21.15.80:0/176771416 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee14000d00 con 0x7fee1c151f90 2019-11-28T11:32:46.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.318+0000 7fee22292700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee1c151f90 0x7fee1c1523e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fee140107d0 tx=0x7fee14010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:46.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.319+0000 7fee22292700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee1c151f90 0x7fee1c1523e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fee140107d0 tx=0x7fee14010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:46.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.319+0000 7fee1a7fc700 1 -- 172.21.15.80:0/176771416 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee14009900 con 0x7fee1c151f90 2019-11-28T11:32:46.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.319+0000 7fee1a7fc700 1 -- 172.21.15.80:0/176771416 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee1400a390 con 0x7fee1c151f90 2019-11-28T11:32:46.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.319+0000 7fee234f4700 1 -- 172.21.15.80:0/176771416 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1c07b810 con 0x7fee1c151f90 2019-11-28T11:32:46.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.319+0000 7fee234f4700 1 -- 172.21.15.80:0/176771416 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1c07b490 con 0x7fee1c151f90 2019-11-28T11:32:46.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.319+0000 7fee22292700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee1c151f90 0x7fee1c1523e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fee140107d0 tx=0x7fee14010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:46.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.319+0000 7fee1a7fc700 1 -- 172.21.15.80:0/176771416 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fee14009d20 con 0x7fee1c151f90 2019-11-28T11:32:46.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.319+0000 7fee22292700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee1c151f90 0x7fee1c1523e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fee140107d0 tx=0x7fee14010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:46.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.319+0000 7fee1a7fc700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fedfc018730 0x7fedfc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:46.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.319+0000 7fee1a7fc700 1 -- 172.21.15.80:0/176771416 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fee14031dd0 con 0x7fee1c151f90 2019-11-28T11:32:46.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.319+0000 7fee21a91700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fedfc018730 0x7fedfc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:46.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.320+0000 7fee21a91700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fedfc018730 0x7fedfc01abc0 crc :-1 s=READY pgs=345 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:46.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.327+0000 7fee234f4700 1 -- 172.21.15.80:0/176771416 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1c07b810 con 0x7fee1c151f90 2019-11-28T11:32:46.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.330+0000 7fee22292700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee1c151f90 0x7fee1c1523e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fee140107d0 tx=0x7fee14010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:46.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.331+0000 7fee1a7fc700 1 -- 172.21.15.80:0/176771416 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fee14024fe0 con 0x7fee1c151f90 2019-11-28T11:32:46.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:46.502+0000 7fee234f4700 1 -- 172.21.15.80:0/176771416 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout"]} v 0) v1 -- 0x7fee1c07b490 con 0x7fee1c151f90 2019-11-28T11:32:47.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.179+0000 7fee22292700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee1c151f90 0x7fee1c1523e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fee140107d0 tx=0x7fee14010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:47.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.179+0000 7fee1a7fc700 1 -- 172.21.15.80:0/176771416 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout"]}]=0 v203) v1 ==== 159+0+0 (secure 0 0 0) 0x7fee14024fe0 con 0x7fee1c151f90 2019-11-28T11:32:47.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.219+0000 7fee234f4700 1 -- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fedfc018730 msgr2=0x7fedfc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:47.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.219+0000 7fee234f4700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fedfc018730 0x7fedfc01abc0 crc :-1 s=READY pgs=345 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:47.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.219+0000 7fee234f4700 1 -- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee1c151f90 msgr2=0x7fee1c1523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:47.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.219+0000 7fee234f4700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee1c151f90 0x7fee1c1523e0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fee140107d0 tx=0x7fee14010600).stop 2019-11-28T11:32:47.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.219+0000 7fee234f4700 1 -- 172.21.15.80:0/176771416 shutdown_connections 2019-11-28T11:32:47.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.219+0000 7fee234f4700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee1c151f90 0x7fee1c1523e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:47.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.219+0000 7fee234f4700 1 --2- 172.21.15.80:0/176771416 >> v2:172.21.15.174:3300/0 conn(0x7fee1c0750f0 0x7fee1c151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:47.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.219+0000 7fee234f4700 1 --2- 172.21.15.80:0/176771416 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fedfc018730 0x7fedfc01abc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:47.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.220+0000 7fee234f4700 1 -- 172.21.15.80:0/176771416 shutdown_connections 2019-11-28T11:32:47.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.220+0000 7fee234f4700 1 -- 172.21.15.80:0/176771416 wait complete. 2019-11-28T11:32:47.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.220+0000 7fee234f4700 1 -- 172.21.15.80:0/176771416 >> 172.21.15.80:0/176771416 conn(0x7fee1c13fa50 msgr2=0x7fee1c07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:47.273 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:32:47.274 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:32:47.355 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:32:47.432 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:32:47.556 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:32:47.617 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:32:47.709 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:32:47.768 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:32:47.768 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:32:47.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:32:47.769 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:32:47.856 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:32:47.861 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:32:47.904 INFO:tasks.cephfs_test_runner:test_config_session_timeout (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2019-11-28T11:32:47.904 INFO:tasks.cephfs_test_runner:Starting test: test_create_fsync (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T11:32:47.904 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync' 2019-11-28T11:32:48.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.980+0000 7efc98587700 1 Processor -- start 2019-11-28T11:32:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.980+0000 7efc98587700 1 -- start start 2019-11-28T11:32:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc98587700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efc9006c490 0x7efc9006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc98587700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc9006ce60 0x7efc90164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc98587700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9006db00 con 0x7efc9006c0a0 2019-11-28T11:32:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc98587700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9006fd60 con 0x7efc9006ce60 2019-11-28T11:32:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc98587700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc90070030 con 0x7efc9006c490 2019-11-28T11:32:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc97325700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc9006ce60 0x7efc90164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc96b24700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efc9006c0a0 0x7efc90072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34526/0 (socket says 172.21.15.80:34526) 2019-11-28T11:32:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc96b24700 1 -- 172.21.15.80:0/1654256076 learned_addr learned my addr 172.21.15.80:0/1654256076 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc96323700 1 --2- 172.21.15.80:0/1654256076 >> v2:172.21.15.174:3300/0 conn(0x7efc9006c490 0x7efc9006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc95b22700 1 -- 172.21.15.80:0/1654256076 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084787580 0 0) 0x7efc80001150 con 0x7efc9006c0a0 2019-11-28T11:32:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc95b22700 1 -- 172.21.15.80:0/1654256076 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc7c002e80 con 0x7efc9006c0a0 2019-11-28T11:32:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc97325700 1 -- 172.21.15.80:0/1654256076 >> v2:172.21.15.174:3300/0 conn(0x7efc9006c490 msgr2=0x7efc9006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc97325700 1 --2- 172.21.15.80:0/1654256076 >> v2:172.21.15.174:3300/0 conn(0x7efc9006c490 0x7efc9006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc97325700 1 -- 172.21.15.80:0/1654256076 >> v1:172.21.15.80:6789/0 conn(0x7efc9006c0a0 legacy=0x7efc90072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc97325700 1 -- 172.21.15.80:0/1654256076 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc900706c0 con 0x7efc9006ce60 2019-11-28T11:32:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc97325700 1 --2- 172.21.15.80:0/1654256076 >> v2:172.21.15.80:3300/0 conn(0x7efc9006ce60 0x7efc90164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efc8800b2d0 tx=0x7efc8800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc97325700 1 --2- 172.21.15.80:0/1654256076 >> v2:172.21.15.80:3300/0 conn(0x7efc9006ce60 0x7efc90164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efc8800b2d0 tx=0x7efc8800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc97325700 1 --2- 172.21.15.80:0/1654256076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9006ce60 0x7efc90164d70 secure :-1 s=READY pgs=837 cs=0 l=1 rx=0x7efc8800b2d0 tx=0x7efc8800b5d0).ready entity=mon.0 client_cookie=c0b93dc9802d4eec server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc97325700 1 --2- 172.21.15.80:0/1654256076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9006ce60 0x7efc90164d70 secure :-1 s=THROTTLE_DONE pgs=837 cs=0 l=1 rx=0x7efc8800b2d0 tx=0x7efc8800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc95b22700 1 -- 172.21.15.80:0/1654256076 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc88009f20 con 0x7efc9006ce60 2019-11-28T11:32:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc97325700 1 --2- 172.21.15.80:0/1654256076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9006ce60 0x7efc90164d70 secure :-1 s=THROTTLE_DONE pgs=837 cs=0 l=1 rx=0x7efc8800b2d0 tx=0x7efc8800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc97325700 1 --2- 172.21.15.80:0/1654256076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9006ce60 0x7efc90164d70 secure :-1 s=THROTTLE_DONE pgs=837 cs=0 l=1 rx=0x7efc8800b2d0 tx=0x7efc8800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.981+0000 7efc95b22700 1 -- 172.21.15.80:0/1654256076 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc88009b40 con 0x7efc9006ce60 2019-11-28T11:32:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.982+0000 7efc95b22700 1 -- 172.21.15.80:0/1654256076 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc8800a500 con 0x7efc9006ce60 2019-11-28T11:32:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.982+0000 7efc98587700 1 -- 172.21.15.80:0/1654256076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9006ce60 msgr2=0x7efc90164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.982+0000 7efc98587700 1 --2- 172.21.15.80:0/1654256076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9006ce60 0x7efc90164d70 secure :-1 s=READY pgs=837 cs=0 l=1 rx=0x7efc8800b2d0 tx=0x7efc8800b5d0).stop 2019-11-28T11:32:48.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.982+0000 7efc98587700 1 -- 172.21.15.80:0/1654256076 shutdown_connections 2019-11-28T11:32:48.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.982+0000 7efc98587700 1 --2- 172.21.15.80:0/1654256076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9006ce60 0x7efc90164d70 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:48.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.982+0000 7efc98587700 1 --2- 172.21.15.80:0/1654256076 >> v2:172.21.15.174:3300/0 conn(0x7efc9006c490 0x7efc9006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:48.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.982+0000 7efc98587700 1 -- 172.21.15.80:0/1654256076 shutdown_connections 2019-11-28T11:32:48.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.982+0000 7efc98587700 1 -- 172.21.15.80:0/1654256076 wait complete. 2019-11-28T11:32:48.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.982+0000 7efc98587700 1 -- 172.21.15.80:0/1654256076 >> 172.21.15.80:0/1654256076 conn(0x7efc90061cf0 msgr2=0x7efc90064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:48.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.985+0000 7efc98587700 1 Processor -- start 2019-11-28T11:32:48.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.985+0000 7efc98587700 1 -- start start 2019-11-28T11:32:48.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc98587700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efc90167c30 0x7efc9016a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:48.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc98587700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9013f1e0 con 0x7efc9013eb40 2019-11-28T11:32:48.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc98587700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc90131a30 con 0x7efc90109e40 2019-11-28T11:32:48.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc98587700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc901234c0 con 0x7efc90167c30 2019-11-28T11:32:48.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc96b24700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efc9013eb40 0x7efc9010afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34532/0 (socket says 172.21.15.80:34532) 2019-11-28T11:32:48.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc96b24700 1 -- 172.21.15.80:0/69267968 learned_addr learned my addr 172.21.15.80:0/69267968 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:48.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124996017 0 0) 0x7efc80001150 con 0x7efc9013eb40 2019-11-28T11:32:48.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc74002e80 con 0x7efc9013eb40 2019-11-28T11:32:48.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc97325700 1 --2- 172.21.15.80:0/69267968 >> v2:172.21.15.174:3300/0 conn(0x7efc90167c30 0x7efc9016a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2746537363 0 0) 0x7efc80001350 con 0x7efc9013eb40 2019-11-28T11:32:48.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efc740032e0 con 0x7efc9013eb40 2019-11-28T11:32:48.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7efc80001860 con 0x7efc9013eb40 2019-11-28T11:32:48.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 >> v2:172.21.15.174:3300/0 conn(0x7efc90167c30 msgr2=0x7efc9016a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc8f7fe700 1 --2- 172.21.15.80:0/69267968 >> v2:172.21.15.174:3300/0 conn(0x7efc90167c30 0x7efc9016a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:48.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 >> v1:172.21.15.174:6789/0 conn(0x7efc90109e40 legacy=0x7efc9010a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 >> v1:172.21.15.80:6789/0 conn(0x7efc9013eb40 legacy=0x7efc9010afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc8f7fe700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc74003330 0x7efc74003760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:48.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc8f7fe700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc74003ca0 0x7efc74004160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:48.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc8f7fe700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc740049c0 0x7efc74004e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7400bc20 con 0x7efc74003330 2019-11-28T11:32:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7400be50 con 0x7efc740049c0 2019-11-28T11:32:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7400c080 con 0x7efc74003ca0 2019-11-28T11:32:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc96b24700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc74003330 0x7efc74003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc97325700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc740049c0 0x7efc74004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.986+0000 7efc96323700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc74003ca0 0x7efc74004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc96b24700 1 -- 172.21.15.80:0/69267968 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc74003ca0 msgr2=0x7efc74004160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc96b24700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc74003ca0 0x7efc74004160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc96b24700 1 -- 172.21.15.80:0/69267968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc740049c0 msgr2=0x7efc74004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc96b24700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc740049c0 0x7efc74004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc96b24700 1 -- 172.21.15.80:0/69267968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7400c330 con 0x7efc74003330 2019-11-28T11:32:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc97325700 1 -- 172.21.15.80:0/69267968 reap_dead start 2019-11-28T11:32:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc98587700 1 -- 172.21.15.80:0/69267968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc90108a80 con 0x7efc74003330 2019-11-28T11:32:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc96b24700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc74003330 0x7efc74003760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc800103e0 tx=0x7efc80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc98587700 1 -- 172.21.15.80:0/69267968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc90108700 con 0x7efc74003330 2019-11-28T11:32:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc96b24700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc74003330 0x7efc74003760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc800103e0 tx=0x7efc80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc96b24700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc74003330 0x7efc74003760 secure :-1 s=READY pgs=839 cs=0 l=1 rx=0x7efc800103e0 tx=0x7efc80010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc96b24700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc74003330 0x7efc74003760 secure :-1 s=THROTTLE_DONE pgs=839 cs=0 l=1 rx=0x7efc800103e0 tx=0x7efc80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc80000940 con 0x7efc74003330 2019-11-28T11:32:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc96b24700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc74003330 0x7efc74003760 secure :-1 s=THROTTLE_DONE pgs=839 cs=0 l=1 rx=0x7efc800103e0 tx=0x7efc80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc80000940 con 0x7efc74003330 2019-11-28T11:32:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc96b24700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc74003330 0x7efc74003760 secure :-1 s=THROTTLE_DONE pgs=839 cs=0 l=1 rx=0x7efc800103e0 tx=0x7efc80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc80001a80 con 0x7efc74003330 2019-11-28T11:32:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc96b24700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc74003330 0x7efc74003760 secure :-1 s=THROTTLE_DONE pgs=839 cs=0 l=1 rx=0x7efc800103e0 tx=0x7efc80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efc80004240 con 0x7efc74003330 2019-11-28T11:32:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.987+0000 7efc96b24700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc74003330 0x7efc74003760 secure :-1 s=THROTTLE_DONE pgs=839 cs=0 l=1 rx=0x7efc800103e0 tx=0x7efc80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.988+0000 7efc8f7fe700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc7401b4d0 0x7efc7401d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.988+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6063+0+0 (secure 0 0 0) 0x7efc80031c00 con 0x7efc74003330 2019-11-28T11:32:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.988+0000 7efc96323700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc7401b4d0 0x7efc7401d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.988+0000 7efc96323700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc7401b4d0 0x7efc7401d900 crc :-1 s=READY pgs=346 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.995+0000 7efc98587700 1 -- 172.21.15.80:0/69267968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc68002e60 con 0x7efc74003330 2019-11-28T11:32:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.998+0000 7efc96b24700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc74003330 0x7efc74003760 secure :-1 s=THROTTLE_DONE pgs=839 cs=0 l=1 rx=0x7efc800103e0 tx=0x7efc80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:47.998+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efc80000e10 con 0x7efc74003330 2019-11-28T11:32:48.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.170+0000 7efc98587700 1 -- 172.21.15.80:0/69267968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync"]} v 0) v1 -- 0x7efc68001d60 con 0x7efc74003330 2019-11-28T11:32:48.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.180+0000 7efc96b24700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc74003330 0x7efc74003760 secure :-1 s=THROTTLE_DONE pgs=839 cs=0 l=1 rx=0x7efc800103e0 tx=0x7efc80010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.180+0000 7efc8f7fe700 1 -- 172.21.15.80:0/69267968 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync"]}]=0 v204) v1 ==== 152+0+0 (secure 0 0 0) 0x7efc8001f7c0 con 0x7efc74003330 2019-11-28T11:32:48.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.188+0000 7efc98587700 1 -- 172.21.15.80:0/69267968 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc7401b4d0 msgr2=0x7efc7401d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.188+0000 7efc98587700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc7401b4d0 0x7efc7401d900 crc :-1 s=READY pgs=346 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:48.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.188+0000 7efc98587700 1 -- 172.21.15.80:0/69267968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc74003330 msgr2=0x7efc74003760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.188+0000 7efc98587700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc74003330 0x7efc74003760 secure :-1 s=READY pgs=839 cs=0 l=1 rx=0x7efc800103e0 tx=0x7efc80010290).stop 2019-11-28T11:32:48.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.188+0000 7efc98587700 1 -- 172.21.15.80:0/69267968 shutdown_connections 2019-11-28T11:32:48.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.188+0000 7efc98587700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc7401b4d0 0x7efc7401d900 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:48.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.188+0000 7efc98587700 1 --2- 172.21.15.80:0/69267968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc74003330 0x7efc74003760 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:48.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.188+0000 7efc98587700 1 -- 172.21.15.80:0/69267968 shutdown_connections 2019-11-28T11:32:48.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.188+0000 7efc98587700 1 -- 172.21.15.80:0/69267968 wait complete. 2019-11-28T11:32:48.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.188+0000 7efc98587700 1 -- 172.21.15.80:0/69267968 >> 172.21.15.80:0/69267968 conn(0x7efc9011bfc0 msgr2=0x7efc90141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:48.241 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:32:48.242 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:32:48.308 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:32:48.369 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:32:48.430 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:32:48.486 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:32:48.548 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:32:48.604 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:32:48.605 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:32:48.605 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:32:48.606 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:32:48.606 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:32:48.607 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:32:48.607 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:32:48.611 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:32:48.612 DEBUG:teuthology.parallel:result is None 2019-11-28T11:32:48.613 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:32:48.614 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:32:48.614 DEBUG:teuthology.parallel:result is None 2019-11-28T11:32:48.614 DEBUG:teuthology.parallel:result is None 2019-11-28T11:32:48.614 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:32:48.615 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:32:48.615 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:32:48.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.773+0000 7fda3635b700 1 Processor -- start 2019-11-28T11:32:48.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.773+0000 7fda3635b700 1 -- start start 2019-11-28T11:32:48.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda3635b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda3006c0a0 0x7fda30072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:48.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda3635b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fda300734e0 0x7fda30071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:48.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda3635b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda3006db00 con 0x7fda30072360 2019-11-28T11:32:48.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda3635b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3006f330 con 0x7fda300734e0 2019-11-28T11:32:48.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda3635b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda300706c0 con 0x7fda3006c0a0 2019-11-28T11:32:48.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda2ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fda300734e0 0x7fda30071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda2ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fda300734e0 0x7fda30071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35230/0 (socket says 172.21.15.80:35230) 2019-11-28T11:32:48.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda2ffff700 1 -- 172.21.15.80:0/3251572535 learned_addr learned my addr 172.21.15.80:0/3251572535 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:48.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda348f8700 1 --2- 172.21.15.80:0/3251572535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda3006c0a0 0x7fda30072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda2ffff700 1 -- 172.21.15.80:0/3251572535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda3006c0a0 msgr2=0x7fda30072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:48.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3251572535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda3006c0a0 0x7fda30072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:48.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda2ffff700 1 -- 172.21.15.80:0/3251572535 >> v1:172.21.15.80:6789/0 conn(0x7fda30072360 legacy=0x7fda3006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda2ffff700 1 -- 172.21.15.80:0/3251572535 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda30070a40 con 0x7fda300734e0 2019-11-28T11:32:48.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3251572535 >> v2:172.21.15.80:3300/0 conn(0x7fda300734e0 0x7fda30071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fda1800f740 tx=0x7fda1800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3251572535 >> v2:172.21.15.80:3300/0 conn(0x7fda300734e0 0x7fda30071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fda1800f740 tx=0x7fda1800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3251572535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda300734e0 0x7fda30071e20 secure :-1 s=READY pgs=841 cs=0 l=1 rx=0x7fda1800f740 tx=0x7fda1800fae0).ready entity=mon.0 client_cookie=54e1692461f76fb7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:48.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3251572535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda300734e0 0x7fda30071e20 secure :-1 s=THROTTLE_DONE pgs=841 cs=0 l=1 rx=0x7fda1800f740 tx=0x7fda1800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3251572535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda300734e0 0x7fda30071e20 secure :-1 s=THROTTLE_DONE pgs=841 cs=0 l=1 rx=0x7fda1800f740 tx=0x7fda1800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.774+0000 7fda2f7fe700 1 -- 172.21.15.80:0/3251572535 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda18000960 con 0x7fda300734e0 2019-11-28T11:32:48.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3251572535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda300734e0 0x7fda30071e20 secure :-1 s=THROTTLE_DONE pgs=841 cs=0 l=1 rx=0x7fda1800f740 tx=0x7fda1800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7fda2f7fe700 1 -- 172.21.15.80:0/3251572535 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda18000c90 con 0x7fda300734e0 2019-11-28T11:32:48.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7fda2f7fe700 1 -- 172.21.15.80:0/3251572535 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda180013a0 con 0x7fda300734e0 2019-11-28T11:32:48.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7fda3635b700 1 -- 172.21.15.80:0/3251572535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda300734e0 msgr2=0x7fda30071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7fda3635b700 1 --2- 172.21.15.80:0/3251572535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda300734e0 0x7fda30071e20 secure :-1 s=READY pgs=841 cs=0 l=1 rx=0x7fda1800f740 tx=0x7fda1800fae0).stop 2019-11-28T11:32:48.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7fda3635b700 1 -- 172.21.15.80:0/3251572535 shutdown_connections 2019-11-28T11:32:48.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7fda3635b700 1 --2- 172.21.15.80:0/3251572535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda300734e0 0x7fda30071e20 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:48.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7fda3635b700 1 --2- 172.21.15.80:0/3251572535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda3006c0a0 0x7fda30072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:48.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7fda3635b700 1 -- 172.21.15.80:0/3251572535 shutdown_connections 2019-11-28T11:32:48.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7fda3635b700 1 -- 172.21.15.80:0/3251572535 wait complete. 2019-11-28T11:32:48.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7fda3635b700 1 -- 172.21.15.80:0/3251572535 >> 172.21.15.80:0/3251572535 conn(0x7fda30061cf0 msgr2=0x7fda30064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:48.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.778+0000 7fda3635b700 1 Processor -- start 2019-11-28T11:32:48.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.779+0000 7fda3635b700 1 -- start start 2019-11-28T11:32:48.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda3635b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fda301281b0 0x7fda30128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:48.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda3635b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda30128b80 0x7fda30167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:48.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda3635b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda30139a60 con 0x7fda3013a780 2019-11-28T11:32:48.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda3635b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3012a260 con 0x7fda301281b0 2019-11-28T11:32:48.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda3635b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3012a530 con 0x7fda30128b80 2019-11-28T11:32:48.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda2ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fda301281b0 0x7fda30128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda348f8700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fda3013a780 0x7fda3012d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:50106/0 (socket says 172.21.15.80:50106) 2019-11-28T11:32:48.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda2ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fda301281b0 0x7fda30128640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:50134/0 (socket says 172.21.15.80:50134) 2019-11-28T11:32:48.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda348f8700 1 -- 172.21.15.80:0/3987435400 learned_addr learned my addr 172.21.15.80:0/3987435400 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:48.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda350f9700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda30128b80 0x7fda30167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda2ffff700 1 -- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda30128b80 msgr2=0x7fda30167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda30128b80 0x7fda30167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:48.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda2ffff700 1 -- 172.21.15.80:0/3987435400 >> v1:172.21.15.174:6789/0 conn(0x7fda3013a780 legacy=0x7fda3012d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda2ffff700 1 -- 172.21.15.80:0/3987435400 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3012abc0 con 0x7fda301281b0 2019-11-28T11:32:48.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3987435400 >> v2:172.21.15.174:3300/0 conn(0x7fda301281b0 0x7fda30128640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fda180103a0 tx=0x7fda180101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3987435400 >> v2:172.21.15.174:3300/0 conn(0x7fda301281b0 0x7fda30128640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fda180103a0 tx=0x7fda180101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda301281b0 0x7fda30128640 secure :-1 s=READY pgs=500 cs=0 l=1 rx=0x7fda180103a0 tx=0x7fda180101d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:48.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda301281b0 0x7fda30128640 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7fda180103a0 tx=0x7fda180101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7fda2d7fa700 1 -- 172.21.15.80:0/3987435400 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda18000940 con 0x7fda301281b0 2019-11-28T11:32:48.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda301281b0 0x7fda30128640 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7fda180103a0 tx=0x7fda180101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda301281b0 0x7fda30128640 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7fda180103a0 tx=0x7fda180101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7fda2d7fa700 1 -- 172.21.15.80:0/3987435400 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda18000f50 con 0x7fda301281b0 2019-11-28T11:32:48.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7fda2d7fa700 1 -- 172.21.15.80:0/3987435400 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda180016a0 con 0x7fda301281b0 2019-11-28T11:32:48.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7fda3635b700 1 -- 172.21.15.80:0/3987435400 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3012af40 con 0x7fda301281b0 2019-11-28T11:32:48.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7fda3635b700 1 -- 172.21.15.80:0/3987435400 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3012abc0 con 0x7fda301281b0 2019-11-28T11:32:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda301281b0 0x7fda30128640 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7fda180103a0 tx=0x7fda180101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.782+0000 7fda2d7fa700 1 -- 172.21.15.80:0/3987435400 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fda18001140 con 0x7fda301281b0 2019-11-28T11:32:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.782+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda301281b0 0x7fda30128640 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7fda180103a0 tx=0x7fda180101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.782+0000 7fda2d7fa700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda14018730 0x7fda1401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.782+0000 7fda2d7fa700 1 -- 172.21.15.80:0/3987435400 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fda18031c30 con 0x7fda301281b0 2019-11-28T11:32:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.783+0000 7fda348f8700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda14018730 0x7fda1401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.783+0000 7fda348f8700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda14018730 0x7fda1401abc0 crc :-1 s=READY pgs=347 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.788+0000 7fda3635b700 1 -- 172.21.15.80:0/3987435400 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda3012af40 con 0x7fda301281b0 2019-11-28T11:32:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.792+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda301281b0 0x7fda30128640 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7fda180103a0 tx=0x7fda180101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.792+0000 7fda2d7fa700 1 -- 172.21.15.80:0/3987435400 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fda18000b50 con 0x7fda301281b0 2019-11-28T11:32:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.773+0000 7f1433571700 1 Processor -- start 2019-11-28T11:32:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.773+0000 7f1433571700 1 -- start start 2019-11-28T11:32:48.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f1433571700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c06c0a0 0x7f142c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:48.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f1433571700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f142c072620 0x7f142c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:48.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f1433571700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142c06db00 con 0x7f142c0734e0 2019-11-28T11:32:48.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f1433571700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142c06f330 con 0x7f142c072620 2019-11-28T11:32:48.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f1433571700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0706c0 con 0x7f142c06c0a0 2019-11-28T11:32:48.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f143230f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f142c072620 0x7f142c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f143230f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f142c072620 0x7f142c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35240/0 (socket says 172.21.15.80:35240) 2019-11-28T11:32:48.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f1431b0e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c06c0a0 0x7f142c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f143230f700 1 -- 172.21.15.80:0/1247889297 learned_addr learned my addr 172.21.15.80:0/1247889297 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:48.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f143230f700 1 -- 172.21.15.80:0/1247889297 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c06c0a0 msgr2=0x7f142c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:48.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f143230f700 1 --2- 172.21.15.80:0/1247889297 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c06c0a0 0x7f142c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:48.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f143230f700 1 -- 172.21.15.80:0/1247889297 >> v1:172.21.15.174:6789/0 conn(0x7f142c0734e0 legacy=0x7f142c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f143230f700 1 -- 172.21.15.80:0/1247889297 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c070a40 con 0x7f142c072620 2019-11-28T11:32:48.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f143230f700 1 --2- 172.21.15.80:0/1247889297 >> v2:172.21.15.80:3300/0 conn(0x7f142c072620 0x7f142c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f142400f6b0 tx=0x7f142400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f143230f700 1 --2- 172.21.15.80:0/1247889297 >> v2:172.21.15.80:3300/0 conn(0x7f142c072620 0x7f142c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f142400f6b0 tx=0x7f142400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f143230f700 1 --2- 172.21.15.80:0/1247889297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f142c072620 0x7f142c164d70 secure :-1 s=READY pgs=842 cs=0 l=1 rx=0x7f142400f6b0 tx=0x7f142400fa50).ready entity=mon.0 client_cookie=79e674562a27a9ca server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f143230f700 1 --2- 172.21.15.80:0/1247889297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f142c072620 0x7f142c164d70 secure :-1 s=THROTTLE_DONE pgs=842 cs=0 l=1 rx=0x7f142400f6b0 tx=0x7f142400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f143230f700 1 --2- 172.21.15.80:0/1247889297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f142c072620 0x7f142c164d70 secure :-1 s=THROTTLE_DONE pgs=842 cs=0 l=1 rx=0x7f142400f6b0 tx=0x7f142400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f1430b0c700 1 -- 172.21.15.80:0/1247889297 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1424000a70 con 0x7f142c072620 2019-11-28T11:32:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f143230f700 1 --2- 172.21.15.80:0/1247889297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f142c072620 0x7f142c164d70 secure :-1 s=THROTTLE_DONE pgs=842 cs=0 l=1 rx=0x7f142400f6b0 tx=0x7f142400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f1430b0c700 1 -- 172.21.15.80:0/1247889297 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14240010e0 con 0x7f142c072620 2019-11-28T11:32:48.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f1430b0c700 1 -- 172.21.15.80:0/1247889297 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14240017b0 con 0x7f142c072620 2019-11-28T11:32:48.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f1433571700 1 -- 172.21.15.80:0/1247889297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f142c072620 msgr2=0x7f142c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f1433571700 1 --2- 172.21.15.80:0/1247889297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f142c072620 0x7f142c164d70 secure :-1 s=READY pgs=842 cs=0 l=1 rx=0x7f142400f6b0 tx=0x7f142400fa50).stop 2019-11-28T11:32:48.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.777+0000 7f1433571700 1 -- 172.21.15.80:0/1247889297 shutdown_connections 2019-11-28T11:32:48.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.777+0000 7f1433571700 1 --2- 172.21.15.80:0/1247889297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f142c072620 0x7f142c164d70 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:48.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.777+0000 7f1433571700 1 --2- 172.21.15.80:0/1247889297 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c06c0a0 0x7f142c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:48.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.777+0000 7f1433571700 1 -- 172.21.15.80:0/1247889297 shutdown_connections 2019-11-28T11:32:48.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.777+0000 7f1433571700 1 -- 172.21.15.80:0/1247889297 wait complete. 2019-11-28T11:32:48.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.777+0000 7f1433571700 1 -- 172.21.15.80:0/1247889297 >> 172.21.15.80:0/1247889297 conn(0x7f142c061cf0 msgr2=0x7f142c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:48.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.779+0000 7f1433571700 1 Processor -- start 2019-11-28T11:32:48.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.779+0000 7f1433571700 1 -- start start 2019-11-28T11:32:48.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7f1433571700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c104820 0x7f142c10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:48.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7f1433571700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142c13bcd0 con 0x7f142c10b9d0 2019-11-28T11:32:48.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7f1433571700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142c105ea0 con 0x7f142c10c890 2019-11-28T11:32:48.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7f1433571700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c108700 con 0x7f142c104820 2019-11-28T11:32:48.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7f143230f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f142c10b9d0 0x7f142c167a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34578/0 (socket says 172.21.15.80:34578) 2019-11-28T11:32:48.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7f1431b0e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c104820 0x7f142c10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7f143230f700 1 -- 172.21.15.80:0/3795388072 learned_addr learned my addr 172.21.15.80:0/3795388072 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:48.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f14227fc700 1 -- 172.21.15.80:0/3795388072 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537505570 0 0) 0x7f1424000940 con 0x7f142c10b9d0 2019-11-28T11:32:48.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f14227fc700 1 -- 172.21.15.80:0/3795388072 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1414002e80 con 0x7f142c10b9d0 2019-11-28T11:32:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f14227fc700 1 -- 172.21.15.80:0/3795388072 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563027582 0 0) 0x7f141c000fb0 con 0x7f142c10c890 2019-11-28T11:32:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f14227fc700 1 -- 172.21.15.80:0/3795388072 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1414004220 con 0x7f142c10c890 2019-11-28T11:32:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f1431b0e700 1 -- 172.21.15.80:0/3795388072 >> v1:172.21.15.174:6789/0 conn(0x7f142c10c890 legacy=0x7f142c10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f1431b0e700 1 -- 172.21.15.80:0/3795388072 >> v1:172.21.15.80:6789/0 conn(0x7f142c10b9d0 legacy=0x7f142c167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f1431b0e700 1 -- 172.21.15.80:0/3795388072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c109a90 con 0x7f142c104820 2019-11-28T11:32:48.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f1431b0e700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c104820 0x7f142c10c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1428010710 tx=0x7f1428010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f1431b0e700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c104820 0x7f142c10c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1428010710 tx=0x7f1428010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f1431b0e700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c104820 0x7f142c10c350 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f1428010710 tx=0x7f1428010ab0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:48.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f1431b0e700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c104820 0x7f142c10c350 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f1428010710 tx=0x7f1428010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f14227fc700 1 -- 172.21.15.80:0/3795388072 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14280099c0 con 0x7f142c104820 2019-11-28T11:32:48.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f1431b0e700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c104820 0x7f142c10c350 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f1428010710 tx=0x7f1428010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f1431b0e700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c104820 0x7f142c10c350 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f1428010710 tx=0x7f1428010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f14227fc700 1 -- 172.21.15.80:0/3795388072 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1428000cc0 con 0x7f142c104820 2019-11-28T11:32:48.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f14227fc700 1 -- 172.21.15.80:0/3795388072 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f142800a460 con 0x7f142c104820 2019-11-28T11:32:48.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f1433571700 1 -- 172.21.15.80:0/3795388072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142c109e10 con 0x7f142c104820 2019-11-28T11:32:48.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.782+0000 7f1433571700 1 -- 172.21.15.80:0/3795388072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142c109a90 con 0x7f142c104820 2019-11-28T11:32:48.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.782+0000 7f1431b0e700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c104820 0x7f142c10c350 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f1428010710 tx=0x7f1428010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.782+0000 7f14227fc700 1 -- 172.21.15.80:0/3795388072 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1428009a60 con 0x7f142c104820 2019-11-28T11:32:48.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.782+0000 7f1431b0e700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c104820 0x7f142c10c350 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f1428010710 tx=0x7f1428010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.783+0000 7f14227fc700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1414018760 0x7f141401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:48.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.783+0000 7f14227fc700 1 -- 172.21.15.80:0/3795388072 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f1428031e30 con 0x7f142c104820 2019-11-28T11:32:48.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.783+0000 7f143130d700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1414018760 0x7f141401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.783+0000 7f143130d700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1414018760 0x7f141401abf0 crc :-1 s=READY pgs=348 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:48.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.788+0000 7f1433571700 1 -- 172.21.15.80:0/3795388072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142c109e10 con 0x7f142c104820 2019-11-28T11:32:48.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.792+0000 7f1431b0e700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c104820 0x7f142c10c350 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f1428010710 tx=0x7f1428010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.792+0000 7f14227fc700 1 -- 172.21.15.80:0/3795388072 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f142802e290 con 0x7f142c104820 2019-11-28T11:32:48.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.773+0000 7f530c4a1700 1 Processor -- start 2019-11-28T11:32:48.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.773+0000 7f530c4a1700 1 -- start start 2019-11-28T11:32:48.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f530c4a1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f530406c0a0 0x7f5304072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:48.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f530c4a1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53040734e0 0x7f5304071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:48.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f530c4a1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530406db00 con 0x7f5304072360 2019-11-28T11:32:48.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f530c4a1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530406fd60 con 0x7f53040734e0 2019-11-28T11:32:48.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f530c4a1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5304070030 con 0x7f530406c0a0 2019-11-28T11:32:48.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f530a23d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53040734e0 0x7f5304071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f530aa3e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f530406c0a0 0x7f5304072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f530a23d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53040734e0 0x7f5304071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35242/0 (socket says 172.21.15.80:35242) 2019-11-28T11:32:48.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f530a23d700 1 -- 172.21.15.80:0/711771114 learned_addr learned my addr 172.21.15.80:0/711771114 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:48.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f530a23d700 1 -- 172.21.15.80:0/711771114 >> v2:172.21.15.174:3300/0 conn(0x7f530406c0a0 msgr2=0x7f5304072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:48.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f530a23d700 1 --2- 172.21.15.80:0/711771114 >> v2:172.21.15.174:3300/0 conn(0x7f530406c0a0 0x7f5304072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:48.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f530a23d700 1 -- 172.21.15.80:0/711771114 >> v1:172.21.15.174:6789/0 conn(0x7f5304072360 legacy=0x7f530406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.775+0000 7f530a23d700 1 -- 172.21.15.80:0/711771114 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53040706c0 con 0x7f53040734e0 2019-11-28T11:32:48.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f530a23d700 1 --2- 172.21.15.80:0/711771114 >> v2:172.21.15.80:3300/0 conn(0x7f53040734e0 0x7f5304071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f52f800f740 tx=0x7f52f800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f530a23d700 1 --2- 172.21.15.80:0/711771114 >> v2:172.21.15.80:3300/0 conn(0x7f53040734e0 0x7f5304071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f52f800f740 tx=0x7f52f800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f530a23d700 1 --2- 172.21.15.80:0/711771114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53040734e0 0x7f5304071e20 secure :-1 s=READY pgs=843 cs=0 l=1 rx=0x7f52f800f740 tx=0x7f52f800f570).ready entity=mon.0 client_cookie=77cf44c0321a2449 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:48.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f530a23d700 1 --2- 172.21.15.80:0/711771114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53040734e0 0x7f5304071e20 secure :-1 s=THROTTLE_DONE pgs=843 cs=0 l=1 rx=0x7f52f800f740 tx=0x7f52f800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f530a23d700 1 --2- 172.21.15.80:0/711771114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53040734e0 0x7f5304071e20 secure :-1 s=THROTTLE_DONE pgs=843 cs=0 l=1 rx=0x7f52f800f740 tx=0x7f52f800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f530a23d700 1 --2- 172.21.15.80:0/711771114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53040734e0 0x7f5304071e20 secure :-1 s=THROTTLE_DONE pgs=843 cs=0 l=1 rx=0x7f52f800f740 tx=0x7f52f800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f5309a3c700 1 -- 172.21.15.80:0/711771114 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52f8000960 con 0x7f53040734e0 2019-11-28T11:32:48.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f5309a3c700 1 -- 172.21.15.80:0/711771114 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f8000c90 con 0x7f53040734e0 2019-11-28T11:32:48.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f5309a3c700 1 -- 172.21.15.80:0/711771114 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52f80013a0 con 0x7f53040734e0 2019-11-28T11:32:48.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f530c4a1700 1 -- 172.21.15.80:0/711771114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53040734e0 msgr2=0x7f5304071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.776+0000 7f530c4a1700 1 --2- 172.21.15.80:0/711771114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53040734e0 0x7f5304071e20 secure :-1 s=READY pgs=843 cs=0 l=1 rx=0x7f52f800f740 tx=0x7f52f800f570).stop 2019-11-28T11:32:48.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.777+0000 7f530c4a1700 1 -- 172.21.15.80:0/711771114 shutdown_connections 2019-11-28T11:32:48.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.777+0000 7f530c4a1700 1 --2- 172.21.15.80:0/711771114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53040734e0 0x7f5304071e20 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:48.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.777+0000 7f530c4a1700 1 --2- 172.21.15.80:0/711771114 >> v2:172.21.15.174:3300/0 conn(0x7f530406c0a0 0x7f5304072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:48.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.777+0000 7f530c4a1700 1 -- 172.21.15.80:0/711771114 shutdown_connections 2019-11-28T11:32:48.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.777+0000 7f530c4a1700 1 -- 172.21.15.80:0/711771114 wait complete. 2019-11-28T11:32:48.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.777+0000 7f530c4a1700 1 -- 172.21.15.80:0/711771114 >> 172.21.15.80:0/711771114 conn(0x7f5304061cf0 msgr2=0x7f5304064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:48.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.779+0000 7f530c4a1700 1 Processor -- start 2019-11-28T11:32:48.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.779+0000 7f530c4a1700 1 -- start start 2019-11-28T11:32:48.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7f530c4a1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530413e900 0x7f5304121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:48.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7f530c4a1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f53041211a0 0x7f530413a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:48.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7f530c4a1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5304139df0 con 0x7f5304121c90 2019-11-28T11:32:48.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7f530c4a1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530413b850 con 0x7f53041211a0 2019-11-28T11:32:48.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7f530c4a1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5304128fb0 con 0x7f530413e900 2019-11-28T11:32:48.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7f530a23d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5304121c90 0x7f53041209a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34570/0 (socket says 172.21.15.80:34570) 2019-11-28T11:32:48.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7f530a23d700 1 -- 172.21.15.80:0/2362701326 learned_addr learned my addr 172.21.15.80:0/2362701326 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:48.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7f530aa3e700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530413e900 0x7f5304121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.780+0000 7f530b23f700 1 --2- 172.21.15.80:0/2362701326 >> v2:172.21.15.174:3300/0 conn(0x7f53041211a0 0x7f530413a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f53037fe700 1 -- 172.21.15.80:0/2362701326 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289936310 0 0) 0x7f52f8007580 con 0x7f5304121c90 2019-11-28T11:32:48.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f530aa3e700 1 -- 172.21.15.80:0/2362701326 >> v2:172.21.15.174:3300/0 conn(0x7f53041211a0 msgr2=0x7f530413a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f530aa3e700 1 --2- 172.21.15.80:0/2362701326 >> v2:172.21.15.174:3300/0 conn(0x7f53041211a0 0x7f530413a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:48.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f530aa3e700 1 -- 172.21.15.80:0/2362701326 >> v1:172.21.15.80:6789/0 conn(0x7f5304121c90 legacy=0x7f53041209a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:48.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f530aa3e700 1 -- 172.21.15.80:0/2362701326 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5304129330 con 0x7f530413e900 2019-11-28T11:32:48.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f530aa3e700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530413e900 0x7f5304121750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52f4010710 tx=0x7f52f400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f530aa3e700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530413e900 0x7f5304121750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52f4010710 tx=0x7f52f400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f530aa3e700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530413e900 0x7f5304121750 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7f52f4010710 tx=0x7f52f400b6e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:48.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f530aa3e700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530413e900 0x7f5304121750 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f52f4010710 tx=0x7f52f400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f53037fe700 1 -- 172.21.15.80:0/2362701326 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52f40099c0 con 0x7f530413e900 2019-11-28T11:32:48.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f530aa3e700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530413e900 0x7f5304121750 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f52f4010710 tx=0x7f52f400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f530aa3e700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530413e900 0x7f5304121750 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f52f4010710 tx=0x7f52f400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f53037fe700 1 -- 172.21.15.80:0/2362701326 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f4000cc0 con 0x7f530413e900 2019-11-28T11:32:48.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f530c4a1700 1 -- 172.21.15.80:0/2362701326 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53041281b0 con 0x7f530413e900 2019-11-28T11:32:48.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f53037fe700 1 -- 172.21.15.80:0/2362701326 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52f400a460 con 0x7f530413e900 2019-11-28T11:32:48.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.781+0000 7f530c4a1700 1 -- 172.21.15.80:0/2362701326 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5304129330 con 0x7f530413e900 2019-11-28T11:32:48.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.782+0000 7f530aa3e700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530413e900 0x7f5304121750 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f52f4010710 tx=0x7f52f400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.782+0000 7f530aa3e700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530413e900 0x7f5304121750 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f52f4010710 tx=0x7f52f400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.782+0000 7f53037fe700 1 -- 172.21.15.80:0/2362701326 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f52f4009df0 con 0x7f530413e900 2019-11-28T11:32:48.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.783+0000 7f53037fe700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f52e4018730 0x7f52e401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:48.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.783+0000 7f53037fe700 1 -- 172.21.15.80:0/2362701326 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f52f4032000 con 0x7f530413e900 2019-11-28T11:32:48.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.783+0000 7f530a23d700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f52e4018730 0x7f52e401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:48.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.783+0000 7f530a23d700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f52e4018730 0x7f52e401abc0 crc :-1 s=READY pgs=349 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:48.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.788+0000 7f530c4a1700 1 -- 172.21.15.80:0/2362701326 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e0002e60 con 0x7f530413e900 2019-11-28T11:32:48.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.795+0000 7f530aa3e700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530413e900 0x7f5304121750 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f52f4010710 tx=0x7f52f400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:48.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.795+0000 7f53037fe700 1 -- 172.21.15.80:0/2362701326 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f52f4009be0 con 0x7f530413e900 2019-11-28T11:32:49.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.980+0000 7f530c4a1700 1 -- 172.21.15.80:0/2362701326 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f52e0001d10 con 0x7f530413e900 2019-11-28T11:32:49.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.980+0000 7fda3635b700 1 -- 172.21.15.80:0/3987435400 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7fda3012abc0 con 0x7fda301281b0 2019-11-28T11:32:49.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:48.982+0000 7f1433571700 1 -- 172.21.15.80:0/3795388072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f142c109a90 con 0x7f142c104820 2019-11-28T11:32:49.223 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:32:49.181+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:32:49.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.188+0000 7fda2ffff700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda301281b0 0x7fda30128640 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7fda180103a0 tx=0x7fda180101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.188+0000 7fda2d7fa700 1 -- 172.21.15.80:0/3987435400 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6312 v39) v1 ==== 95+0+0 (secure 0 0 0) 0x7fda180174c0 con 0x7fda301281b0 2019-11-28T11:32:49.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.188+0000 7f530aa3e700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530413e900 0x7f5304121750 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f52f4010710 tx=0x7f52f400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.188+0000 7f53037fe700 1 -- 172.21.15.80:0/2362701326 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 5186 v39) v1 ==== 95+0+0 (secure 0 0 0) 0x7f52f4009df0 con 0x7f530413e900 2019-11-28T11:32:49.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.188+0000 7f1431b0e700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c104820 0x7f142c10c350 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f1428010710 tx=0x7f1428010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.188+0000 7f14227fc700 1 -- 172.21.15.80:0/3795388072 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6315 v39) v1 ==== 95+0+0 (secure 0 0 0) 0x7f142802e290 con 0x7f142c104820 2019-11-28T11:32:49.235 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 5186 2019-11-28T11:32:49.236 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 6312 2019-11-28T11:32:49.238 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 6315 2019-11-28T11:32:49.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.196+0000 7f530c4a1700 1 -- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f52e4018730 msgr2=0x7f52e401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.196+0000 7f530c4a1700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f52e4018730 0x7f52e401abc0 crc :-1 s=READY pgs=349 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.196+0000 7f530c4a1700 1 -- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530413e900 msgr2=0x7f5304121750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.196+0000 7f530c4a1700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530413e900 0x7f5304121750 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7f52f4010710 tx=0x7f52f400b6e0).stop 2019-11-28T11:32:49.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.196+0000 7f530c4a1700 1 -- 172.21.15.80:0/2362701326 shutdown_connections 2019-11-28T11:32:49.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.196+0000 7f530c4a1700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f52e4018730 0x7f52e401abc0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.196+0000 7f530c4a1700 1 --2- 172.21.15.80:0/2362701326 >> v2:172.21.15.174:3300/0 conn(0x7f53041211a0 0x7f530413a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.196+0000 7f530c4a1700 1 --2- 172.21.15.80:0/2362701326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530413e900 0x7f5304121750 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.196+0000 7f530c4a1700 1 -- 172.21.15.80:0/2362701326 shutdown_connections 2019-11-28T11:32:49.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.196+0000 7f530c4a1700 1 -- 172.21.15.80:0/2362701326 wait complete. 2019-11-28T11:32:49.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.196+0000 7f530c4a1700 1 -- 172.21.15.80:0/2362701326 >> 172.21.15.80:0/2362701326 conn(0x7f5304127dc0 msgr2=0x7f5304141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:49.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.197+0000 7fda3635b700 1 -- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda14018730 msgr2=0x7fda1401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.197+0000 7fda3635b700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda14018730 0x7fda1401abc0 crc :-1 s=READY pgs=347 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.197+0000 7fda3635b700 1 -- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda301281b0 msgr2=0x7fda30128640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.197+0000 7fda3635b700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda301281b0 0x7fda30128640 secure :-1 s=READY pgs=500 cs=0 l=1 rx=0x7fda180103a0 tx=0x7fda180101d0).stop 2019-11-28T11:32:49.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.197+0000 7fda3635b700 1 -- 172.21.15.80:0/3987435400 shutdown_connections 2019-11-28T11:32:49.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.197+0000 7fda3635b700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda30128b80 0x7fda30167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.197+0000 7fda3635b700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda301281b0 0x7fda30128640 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.197+0000 7fda3635b700 1 --2- 172.21.15.80:0/3987435400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda14018730 0x7fda1401abc0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.197+0000 7fda3635b700 1 -- 172.21.15.80:0/3987435400 shutdown_connections 2019-11-28T11:32:49.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.197+0000 7fda3635b700 1 -- 172.21.15.80:0/3987435400 wait complete. 2019-11-28T11:32:49.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.197+0000 7fda3635b700 1 -- 172.21.15.80:0/3987435400 >> 172.21.15.80:0/3987435400 conn(0x7fda30127dc0 msgr2=0x7fda30141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:49.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.198+0000 7f1433571700 1 -- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1414018760 msgr2=0x7f141401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.198+0000 7f1433571700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1414018760 0x7f141401abf0 crc :-1 s=READY pgs=348 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.198+0000 7f1433571700 1 -- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c104820 msgr2=0x7f142c10c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.198+0000 7f1433571700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c104820 0x7f142c10c350 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f1428010710 tx=0x7f1428010ab0).stop 2019-11-28T11:32:49.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.198+0000 7f1433571700 1 -- 172.21.15.80:0/3795388072 shutdown_connections 2019-11-28T11:32:49.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.198+0000 7f1433571700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1414018760 0x7f141401abf0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.198+0000 7f1433571700 1 --2- 172.21.15.80:0/3795388072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f142c104820 0x7f142c10c350 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.198+0000 7f1433571700 1 -- 172.21.15.80:0/3795388072 shutdown_connections 2019-11-28T11:32:49.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.198+0000 7f1433571700 1 -- 172.21.15.80:0/3795388072 wait complete. 2019-11-28T11:32:49.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.198+0000 7f1433571700 1 -- 172.21.15.80:0/3795388072 >> 172.21.15.80:0/3795388072 conn(0x7f142c13d620 msgr2=0x7f142c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:49.250 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:32:49.250 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:32:49.252 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:32:49.252 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:32:49.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.393+0000 7f79eff79700 1 Processor -- start 2019-11-28T11:32:49.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.393+0000 7f79eff79700 1 -- start start 2019-11-28T11:32:49.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.394+0000 7f79eff79700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79e806c0a0 0x7f79e8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:49.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.394+0000 7f79eff79700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f79e80734e0 0x7f79e8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:49.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.394+0000 7f79eff79700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f79e8072360 0x7f79e80727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:49.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.394+0000 7f79eff79700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e806f330 con 0x7f79e80734e0 2019-11-28T11:32:49.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.394+0000 7f79eff79700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e80706c0 con 0x7f79e8072360 2019-11-28T11:32:49.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.394+0000 7f79eff79700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e8070a40 con 0x7f79e806c0a0 2019-11-28T11:32:49.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.394+0000 7f79edd15700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f79e80734e0 0x7f79e8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:49.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.394+0000 7f79edd15700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f79e80734e0 0x7f79e8071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35274/0 (socket says 172.21.15.80:35274) 2019-11-28T11:32:49.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.394+0000 7f79edd15700 1 -- 172.21.15.80:0/1343861926 learned_addr learned my addr 172.21.15.80:0/1343861926 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:49.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79eed17700 1 --2- 172.21.15.80:0/1343861926 >> v2:172.21.15.174:3300/0 conn(0x7f79e8072360 0x7f79e80727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:49.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79ee516700 1 --2- 172.21.15.80:0/1343861926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79e806c0a0 0x7f79e8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:49.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79edd15700 1 -- 172.21.15.80:0/1343861926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79e806c0a0 msgr2=0x7f79e8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:49.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79edd15700 1 --2- 172.21.15.80:0/1343861926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79e806c0a0 0x7f79e8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:49.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79edd15700 1 -- 172.21.15.80:0/1343861926 >> v2:172.21.15.174:3300/0 conn(0x7f79e8072360 msgr2=0x7f79e80727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:49.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79edd15700 1 --2- 172.21.15.80:0/1343861926 >> v2:172.21.15.174:3300/0 conn(0x7f79e8072360 0x7f79e80727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:49.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79edd15700 1 -- 172.21.15.80:0/1343861926 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e806db00 con 0x7f79e80734e0 2019-11-28T11:32:49.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79edd15700 1 --2- 172.21.15.80:0/1343861926 >> v2:172.21.15.80:3300/0 conn(0x7f79e80734e0 0x7f79e8071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f79dc00f740 tx=0x7f79dc00f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79edd15700 1 --2- 172.21.15.80:0/1343861926 >> v2:172.21.15.80:3300/0 conn(0x7f79e80734e0 0x7f79e8071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f79dc00f740 tx=0x7f79dc00f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79edd15700 1 --2- 172.21.15.80:0/1343861926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79e80734e0 0x7f79e8071e20 secure :-1 s=READY pgs=846 cs=0 l=1 rx=0x7f79dc00f740 tx=0x7f79dc00f5f0).ready entity=mon.0 client_cookie=d262f302f2f83029 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:49.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79edd15700 1 --2- 172.21.15.80:0/1343861926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79e80734e0 0x7f79e8071e20 secure :-1 s=THROTTLE_DONE pgs=846 cs=0 l=1 rx=0x7f79dc00f740 tx=0x7f79dc00f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79edd15700 1 --2- 172.21.15.80:0/1343861926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79e80734e0 0x7f79e8071e20 secure :-1 s=THROTTLE_DONE pgs=846 cs=0 l=1 rx=0x7f79dc00f740 tx=0x7f79dc00f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79ed514700 1 -- 172.21.15.80:0/1343861926 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79dc000960 con 0x7f79e80734e0 2019-11-28T11:32:49.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79edd15700 1 --2- 172.21.15.80:0/1343861926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79e80734e0 0x7f79e8071e20 secure :-1 s=THROTTLE_DONE pgs=846 cs=0 l=1 rx=0x7f79dc00f740 tx=0x7f79dc00f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79ed514700 1 -- 172.21.15.80:0/1343861926 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc000c90 con 0x7f79e80734e0 2019-11-28T11:32:49.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79ed514700 1 -- 172.21.15.80:0/1343861926 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79dc0013a0 con 0x7f79e80734e0 2019-11-28T11:32:49.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79eff79700 1 -- 172.21.15.80:0/1343861926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79e80734e0 msgr2=0x7f79e8071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.395+0000 7f79eff79700 1 --2- 172.21.15.80:0/1343861926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79e80734e0 0x7f79e8071e20 secure :-1 s=READY pgs=846 cs=0 l=1 rx=0x7f79dc00f740 tx=0x7f79dc00f5f0).stop 2019-11-28T11:32:49.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.396+0000 7f79eff79700 1 -- 172.21.15.80:0/1343861926 shutdown_connections 2019-11-28T11:32:49.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.396+0000 7f79eff79700 1 --2- 172.21.15.80:0/1343861926 >> v2:172.21.15.174:3300/0 conn(0x7f79e8072360 0x7f79e80727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:49.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.396+0000 7f79eff79700 1 --2- 172.21.15.80:0/1343861926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79e80734e0 0x7f79e8071e20 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.396+0000 7f79eff79700 1 --2- 172.21.15.80:0/1343861926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79e806c0a0 0x7f79e8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:49.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.396+0000 7f79eff79700 1 -- 172.21.15.80:0/1343861926 shutdown_connections 2019-11-28T11:32:49.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.396+0000 7f79eff79700 1 -- 172.21.15.80:0/1343861926 wait complete. 2019-11-28T11:32:49.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.396+0000 7f79eff79700 1 -- 172.21.15.80:0/1343861926 >> 172.21.15.80:0/1343861926 conn(0x7f79e8061cf0 msgr2=0x7f79e8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:49.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.398+0000 7f79eff79700 1 Processor -- start 2019-11-28T11:32:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.398+0000 7f79eff79700 1 -- start start 2019-11-28T11:32:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.399+0000 7f79eff79700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79e815fdf0 0x7f79e812b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.399+0000 7f79eff79700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e813eb20 con 0x7f79e812b8a0 2019-11-28T11:32:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.399+0000 7f79eff79700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e8139e00 con 0x7f79e812a3c0 2019-11-28T11:32:49.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.399+0000 7f79eff79700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e8107df0 con 0x7f79e815fdf0 2019-11-28T11:32:49.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.399+0000 7f79edd15700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f79e812b8a0 0x7f79e813e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34592/0 (socket says 172.21.15.80:34592) 2019-11-28T11:32:49.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.399+0000 7f79edd15700 1 -- 172.21.15.80:0/626272051 learned_addr learned my addr 172.21.15.80:0/626272051 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:49.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79ee516700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79e815fdf0 0x7f79e812b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:49.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.399+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306538322 0 0) 0x7f79dc007580 con 0x7f79e812b8a0 2019-11-28T11:32:49.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c8002e80 con 0x7f79e812b8a0 2019-11-28T11:32:49.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2239955083 0 0) 0x7f79dc007a60 con 0x7f79e812b8a0 2019-11-28T11:32:49.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f79c80032e0 con 0x7f79e812b8a0 2019-11-28T11:32:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f79dc007fe0 con 0x7f79e812b8a0 2019-11-28T11:32:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79e815fdf0 msgr2=0x7f79e812b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79e6ffd700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79e815fdf0 0x7f79e812b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 >> v1:172.21.15.174:6789/0 conn(0x7f79e812a3c0 legacy=0x7f79e812a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 >> v1:172.21.15.80:6789/0 conn(0x7f79e812b8a0 legacy=0x7f79e813e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79e6ffd700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79c8003380 0x7f79c80037b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:49.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79e6ffd700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79c8003cf0 0x7f79c8004190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:49.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79e6ffd700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c8004950 0x7f79c8004dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:49.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c800bbf0 con 0x7f79c8003cf0 2019-11-28T11:32:49.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c800bde0 con 0x7f79c8003380 2019-11-28T11:32:49.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c800c010 con 0x7f79c8004950 2019-11-28T11:32:49.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79edd15700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79c8003cf0 0x7f79c8004190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:49.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79ee516700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79c8003380 0x7f79c80037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:49.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79eed17700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c8004950 0x7f79c8004dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:49.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79edd15700 1 -- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c8004950 msgr2=0x7f79c8004dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79edd15700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c8004950 0x7f79c8004dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79edd15700 1 -- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79c8003380 msgr2=0x7f79c80037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79edd15700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79c8003380 0x7f79c80037b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79edd15700 1 -- 172.21.15.80:0/626272051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c800c2c0 con 0x7f79c8003cf0 2019-11-28T11:32:49.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79eff79700 1 -- 172.21.15.80:0/626272051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e810a8c0 con 0x7f79c8003cf0 2019-11-28T11:32:49.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79edd15700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79c8003cf0 0x7f79c8004190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79dc010450 tx=0x7f79dc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79eed17700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c8004950 0x7f79c8004dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:32:49.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79eff79700 1 -- 172.21.15.80:0/626272051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e8109180 con 0x7f79c8003cf0 2019-11-28T11:32:49.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79edd15700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79c8003cf0 0x7f79c8004190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79dc010450 tx=0x7f79dc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.400+0000 7f79edd15700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79c8003cf0 0x7f79c8004190 secure :-1 s=READY pgs=848 cs=0 l=1 rx=0x7f79dc010450 tx=0x7f79dc010300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:49.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.401+0000 7f79edd15700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79c8003cf0 0x7f79c8004190 secure :-1 s=THROTTLE_DONE pgs=848 cs=0 l=1 rx=0x7f79dc010450 tx=0x7f79dc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.401+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79dc007a60 con 0x7f79c8003cf0 2019-11-28T11:32:49.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.401+0000 7f79edd15700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79c8003cf0 0x7f79c8004190 secure :-1 s=THROTTLE_DONE pgs=848 cs=0 l=1 rx=0x7f79dc010450 tx=0x7f79dc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.401+0000 7f79edd15700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79c8003cf0 0x7f79c8004190 secure :-1 s=THROTTLE_DONE pgs=848 cs=0 l=1 rx=0x7f79dc010450 tx=0x7f79dc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.401+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc005370 con 0x7f79c8003cf0 2019-11-28T11:32:49.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.401+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79dc0059c0 con 0x7f79c8003cf0 2019-11-28T11:32:49.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.401+0000 7f79edd15700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79c8003cf0 0x7f79c8004190 secure :-1 s=THROTTLE_DONE pgs=848 cs=0 l=1 rx=0x7f79dc010450 tx=0x7f79dc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.401+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f79dc005560 con 0x7f79c8003cf0 2019-11-28T11:32:49.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.401+0000 7f79edd15700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79c8003cf0 0x7f79c8004190 secure :-1 s=THROTTLE_DONE pgs=848 cs=0 l=1 rx=0x7f79dc010450 tx=0x7f79dc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.401+0000 7f79e6ffd700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f79c8020c20 0x7f79c8023050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:49.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.401+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f79dc031c70 con 0x7f79c8003cf0 2019-11-28T11:32:49.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.401+0000 7f79ee516700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f79c8020c20 0x7f79c8023050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:49.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.402+0000 7f79ee516700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f79c8020c20 0x7f79c8023050 crc :-1 s=READY pgs=350 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:49.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.408+0000 7f79eff79700 1 -- 172.21.15.80:0/626272051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e8109500 con 0x7f79c8003cf0 2019-11-28T11:32:49.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.412+0000 7f79edd15700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79c8003cf0 0x7f79c8004190 secure :-1 s=THROTTLE_DONE pgs=848 cs=0 l=1 rx=0x7f79dc010450 tx=0x7f79dc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.412+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f79dc0081c0 con 0x7f79c8003cf0 2019-11-28T11:32:49.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.586+0000 7f79eff79700 1 -- 172.21.15.80:0/626272051 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f79e8109180 con 0x7f79c8003cf0 2019-11-28T11:32:49.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.587+0000 7f79edd15700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79c8003cf0 0x7f79c8004190 secure :-1 s=THROTTLE_DONE pgs=848 cs=0 l=1 rx=0x7f79dc010450 tx=0x7f79dc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.587+0000 7f79e6ffd700 1 -- 172.21.15.80:0/626272051 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v71) v1 ==== 81+0+31835 (secure 0 0 0) 0x7f79dc005350 con 0x7f79c8003cf0 2019-11-28T11:32:49.632 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:32:49.632 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:32:49.633 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 71, 2019-11-28T11:32:49.633 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:32:49.633 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:32:49.634 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:32:48.986510+0000", 2019-11-28T11:32:49.634 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:32:49.634 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:32:49.634 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:32:49.635 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:32:49.635 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:32:49.635 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:32:49.635 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:32:49.635 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:32:49.636 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:32:49.636 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:32:49.636 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:32:49.636 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:32:49.637 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:32:49.637 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:32:49.637 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:32:49.637 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 11, 2019-11-28T11:32:49.638 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:32:49.638 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:32:49.638 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:32:49.638 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:32:49.639 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:32:49.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.639 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:32:49.639 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:32:49.640 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:32:49.640 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:32:49.640 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:32:49.640 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:32:49.640 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:32:49.641 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:32:49.642 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:32:49.642 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:32:49.642 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:32:49.642 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:32:49.643 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:32:49.643 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:32:49.643 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:32:49.643 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:32:49.644 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:32:49.644 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:32:49.644 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:32:49.644 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:32:49.644 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:32:49.645 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:32:49.645 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:32:49.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.646 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:32:49.646 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:32:49.646 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:32:49.647 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:32:49.647 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:32:49.647 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:32:49.647 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:32:49.648 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:32:49.650 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:32:49.650 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:32:49.651 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:32:49.651 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:32:49.652 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:32:49.652 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:32:49.653 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:32:49.653 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:32:49.653 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:32:49.654 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:32:49.654 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:32:49.654 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:32:49.654 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:32:49.655 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:32:49.655 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:32:49.655 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:32:49.655 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:32:49.656 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:32:49.656 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:32:49.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.658 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:32:49.658 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:32:49.658 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:32:49.658 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:32:49.659 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:32:49.659 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:32:49.659 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:32:49.659 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:32:49.660 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:32:49.660 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:32:49.660 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:32:49.660 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:32:49.661 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:32:49.661 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:32:49.661 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.662 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 10, 2019-11-28T11:32:49.663 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:32:49.663 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:29:25.290976+0000", 2019-11-28T11:32:49.663 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:32:49.663 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:32:49.664 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:32:49.664 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:32:49.664 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:32:49.664 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:32:49.665 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:32:49.665 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:32:49.665 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:32:49.666 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:32:49.666 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:32:49.666 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:32:49.666 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:32:49.667 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:32:49.667 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:32:49.667 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:32:49.667 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:32:49.668 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:32:49.668 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:32:49.668 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:32:49.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.669 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "66", 2019-11-28T11:32:49.669 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:32:49.669 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:32:49.670 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:32:49.670 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:32:49.670 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:32:49.670 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:32:49.671 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:32:49.672 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:32:49.672 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:32:49.672 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:32:49.673 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:32:49.673 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:32:49.673 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:32:49.674 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:32:49.674 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:32:49.674 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:32:49.674 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:32:49.674 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:32:49.675 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:32:49.675 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:32:49.675 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:32:49.675 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:32:49.676 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:32:49.676 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:32:49.676 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:32:49.676 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:32:49.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.677 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:32:49.677 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:32:49.677 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:32:49.678 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:32:49.678 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:32:49.678 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:32:49.678 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:32:49.679 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:32:49.679 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:32:49.679 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:32:49.680 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:32:49.680 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:32:49.680 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:32:49.680 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:32:49.680 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:32:49.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.681 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:32:49.681 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:32:49.682 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:32:49.682 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.684 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 11, 2019-11-28T11:32:49.684 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:32:49.684 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:29:25.980441+0000", 2019-11-28T11:32:49.685 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:32:49.685 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:32:49.685 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:32:49.685 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:32:49.686 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:32:49.686 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:32:49.686 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:32:49.686 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:32:49.687 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:32:49.687 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:32:49.687 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:32:49.687 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:32:49.687 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:32:49.688 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:32:49.688 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:32:49.688 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:32:49.688 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:32:49.689 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:32:49.689 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:32:49.689 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:32:49.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.690 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "67", 2019-11-28T11:32:49.690 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:32:49.690 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:32:49.690 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:32:49.690 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:32:49.691 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:32:49.691 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:32:49.691 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:32:49.691 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:32:49.692 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:32:49.692 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:32:49.692 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:32:49.692 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:32:49.693 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:32:49.693 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:32:49.693 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:32:49.694 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:32:49.694 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:32:49.694 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:32:49.694 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:32:49.695 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:32:49.695 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:32:49.695 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:32:49.695 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:32:49.696 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:32:49.696 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:32:49.696 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:32:49.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.696 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:32:49.697 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:32:49.697 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:32:49.697 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:32:49.697 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:32:49.698 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:32:49.698 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:32:49.698 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:32:49.698 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:32:49.699 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:32:49.699 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:32:49.700 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:32:49.700 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:32:49.700 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:32:49.700 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:32:49.700 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.700 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.701 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.701 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:32:49.701 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:32:49.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.701 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:32:49.701 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:32:49.701 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:32:49.702 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:32:49.702 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:32:49.702 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:32:49.702 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:32:49.702 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:32:49.702 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:32:49.702 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 65, 2019-11-28T11:32:49.702 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:32:49.703 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:32:49.703 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:32:49.703 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.703 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.703 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:32:49.703 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:32:49.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.704 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.704 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:32:49.704 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:32:49.704 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.704 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.705 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:32:49.705 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.705 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.705 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:32:49.705 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:32:49.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.706 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.708 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:32:49.708 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:32:49.708 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.708 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.709 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:32:49.709 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.709 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.709 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:32:49.709 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:32:49.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.710 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.710 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:32:49.710 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:32:49.710 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.710 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.711 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:32:49.711 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.711 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.711 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:32:49.711 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:32:49.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.712 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.712 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:32:49.712 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:32:49.713 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.713 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.713 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:32:49.713 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:32:49.713 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:32:49.713 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:32:49.714 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:32:49.714 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:32:49.714 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:32:49.714 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.714 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:32:49.715 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:32:49.715 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:32:49.715 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:32:49.715 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:32:49.715 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:32:49.715 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:32:49.715 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:32:49.716 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:32:49.716 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 65, 2019-11-28T11:32:49.716 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:32:49.716 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:32:49.716 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:32:49.716 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.717 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.717 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:32:49.717 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:32:49.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.717 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.718 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:32:49.718 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:32:49.718 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.718 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.718 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:32:49.718 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.719 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.719 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:32:49.719 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:32:49.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.719 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.720 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:32:49.720 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:32:49.720 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.720 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.720 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:32:49.721 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.721 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.721 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:32:49.721 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:32:49.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.723 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.723 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:32:49.723 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:32:49.724 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.724 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.724 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:32:49.724 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.724 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.725 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:32:49.725 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:32:49.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.725 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.725 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:32:49.726 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:32:49.726 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.726 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.726 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:32:49.727 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:32:49.727 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:32:49.727 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:32:49.727 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:32:49.727 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:32:49.728 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:32:49.728 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.728 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:32:49.728 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:32:49.729 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:32:49.729 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:32:49.729 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:32:49.729 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:32:49.729 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:32:49.729 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:32:49.730 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:32:49.730 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 65, 2019-11-28T11:32:49.730 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:32:49.730 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:32:49.730 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:32:49.730 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.731 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.731 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:32:49.731 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:32:49.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.731 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.731 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:32:49.732 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:32:49.732 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.732 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.732 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:32:49.732 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.732 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.733 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:32:49.733 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:32:49.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.733 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.733 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:32:49.734 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:32:49.734 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.734 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.734 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:32:49.734 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.734 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.735 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:32:49.735 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:32:49.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.735 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.735 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:32:49.735 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:32:49.736 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.736 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.736 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:32:49.736 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.736 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.737 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:32:49.737 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:32:49.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.737 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.737 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:32:49.737 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:32:49.738 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.738 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.738 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:32:49.738 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:32:49.738 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:32:49.739 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:32:49.739 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:32:49.739 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:32:49.739 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:32:49.739 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.739 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:32:49.740 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:32:49.740 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:32:49.740 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:32:49.740 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:32:49.740 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:32:49.740 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:32:49.740 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:32:49.741 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:32:49.741 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 55, 2019-11-28T11:32:49.741 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:32:49.741 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:32:49.741 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:32:49.741 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.742 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.744 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:32:49.744 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:32:49.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.745 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.745 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:32:49.745 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:32:49.745 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.745 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.746 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:32:49.746 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.746 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.746 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:32:49.746 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:32:49.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.747 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.747 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:32:49.747 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:32:49.747 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.747 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.748 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:32:49.748 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.748 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.748 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:32:49.748 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:32:49.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.749 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.749 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:32:49.749 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:32:49.749 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.749 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.750 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:32:49.750 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.750 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.750 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:32:49.750 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:32:49.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.751 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.751 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:32:49.751 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:32:49.751 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.751 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.752 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:32:49.752 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:32:49.752 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:32:49.752 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:32:49.752 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:32:49.752 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:32:49.753 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:32:49.753 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.753 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:32:49.753 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:32:49.753 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:32:49.754 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:32:49.754 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:32:49.754 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:32:49.754 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:32:49.754 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:32:49.754 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:32:49.755 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 64, 2019-11-28T11:32:49.755 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:32:49.755 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:32:49.755 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:32:49.755 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.755 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.756 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:32:49.756 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:32:49.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.756 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.756 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:32:49.756 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:32:49.757 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.757 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.757 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:32:49.757 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.758 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.758 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:32:49.758 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:32:49.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.758 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.758 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:32:49.759 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:32:49.759 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.759 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.759 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:32:49.759 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.759 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.760 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:32:49.760 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:32:49.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.760 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.760 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:32:49.761 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:32:49.761 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.761 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.761 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:32:49.761 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.761 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.762 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:32:49.762 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:32:49.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.762 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.762 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:32:49.763 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:32:49.763 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.763 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.763 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:32:49.763 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:32:49.763 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:32:49.764 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:32:49.764 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:32:49.764 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:32:49.764 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:32:49.764 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.765 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:32:49.765 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:32:49.765 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:32:49.765 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:32:49.765 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:32:49.766 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:32:49.766 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:32:49.766 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:32:49.766 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:32:49.766 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 65, 2019-11-28T11:32:49.766 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:32:49.766 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:32:49.767 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:32:49.767 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.767 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.767 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:32:49.767 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:32:49.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.768 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.768 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:32:49.768 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:32:49.768 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.768 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.769 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:32:49.769 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.769 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.769 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:32:49.769 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:32:49.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.770 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.770 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:32:49.770 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:32:49.770 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.770 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.770 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:32:49.771 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.771 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.771 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:32:49.771 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:32:49.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.772 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.772 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:32:49.772 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:32:49.772 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.772 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.772 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:32:49.773 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.773 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.773 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:32:49.773 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:32:49.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.774 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.774 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:32:49.774 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:32:49.774 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.774 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.775 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:32:49.775 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:32:49.775 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:32:49.775 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:32:49.775 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:32:49.775 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:32:49.776 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:32:49.776 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.776 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:32:49.776 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:32:49.777 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:32:49.777 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:32:49.777 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:32:49.777 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:32:49.777 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:32:49.777 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:32:49.777 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:32:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 65, 2019-11-28T11:32:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:32:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:32:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:32:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:32:49.779 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:32:49.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.779 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.779 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:32:49.779 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:32:49.779 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.780 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.780 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:32:49.780 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.780 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.780 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:32:49.781 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:32:49.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.781 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.781 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:32:49.781 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:32:49.781 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:32:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:32:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:32:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:32:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:32:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:32:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:32:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:32:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:32:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:32:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:32:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:32:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:32:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:32:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:32:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:32:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:32:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:32:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:32:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:32:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:32:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:32:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:32:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:32:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:32:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:32:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 65, 2019-11-28T11:32:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:32:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:32:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:32:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:32:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:32:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:32:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:32:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.792 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:32:49.792 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.792 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.792 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:32:49.792 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:32:49.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.793 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.793 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:32:49.793 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:32:49.793 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.793 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.794 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:32:49.794 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.794 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.794 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:32:49.794 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:32:49.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.795 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.795 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:32:49.795 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:32:49.795 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.796 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.796 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:32:49.796 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:32:49.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.796 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:32:49.796 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:32:49.797 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:32:49.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.797 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:32:49.797 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:32:49.797 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:32:49.797 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.798 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.798 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:32:49.798 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:32:49.798 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:32:49.798 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:32:49.798 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:32:49.799 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:32:49.799 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:32:49.799 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:49.799 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.799 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:32:49.799 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:32:49.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.799 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:32:49.800 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:32:49.800 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:32:49.800 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:32:49.800 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:32:49.800 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:32:49.800 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:32:49.800 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:32:49.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.801 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:32:49.801 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:32:49.801 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:32:49.801 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:32:49.801 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:32:49.802 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:32:49.802 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:32:49.802 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:32:49.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.802 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:32:49.802 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:32:49.803 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:32:49.803 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:32:49.803 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:32:49.803 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:32:49.803 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:32:49.803 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:32:49.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.804 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:32:49.804 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:32:49.804 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:32:49.804 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:32:49.804 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:32:49.804 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:32:49.804 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:32:49.805 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:32:49.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.805 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:32:49.805 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:32:49.806 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:32:49.806 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:32:49.806 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:32:49.806 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:32:49.806 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:32:49.806 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:32:49.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.807 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:32:49.807 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:32:49.807 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:32:49.807 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:32:49.807 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:32:49.807 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:32:49.808 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:32:49.808 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:32:49.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.808 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:32:49.808 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:32:49.808 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:32:49.809 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:32:49.809 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:32:49.809 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:32:49.809 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:32:49.809 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:32:49.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:49.810 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:32:49.810 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:32:49.810 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:32:49.810 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:32:49.810 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:32:49.810 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:32:49.810 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:32:49.811 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:32:49.811 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.811 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:32:49.811 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:32:49.811 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:32:49.811 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:32:49.811 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:32:49.811 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:32:49.812 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/698358691": "2019-11-29T11:32:48.980865+0000", 2019-11-28T11:32:49.812 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/698358691": "2019-11-29T11:32:48.980865+0000", 2019-11-28T11:32:49.812 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.76:0/596202409": "2019-11-28T12:31:39.417125+0000" 2019-11-28T11:32:49.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.812 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:32:49.812 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:32:49.813 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:32:49.813 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:32:49.813 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:32:49.813 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:32:49.813 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:32:49.813 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:32:49.813 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:32:49.814 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:32:49.814 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:32:49.814 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:32:49.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.814 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:32:49.814 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:32:49.814 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:32:49.815 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:32:49.815 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:32:49.815 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:32:49.815 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:32:49.815 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:49.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:49.815 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:32:49.816 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:32:49.816 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:32:49.816 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:32:49.816 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:32:49.816 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:32:49.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.592+0000 7f79eff79700 1 -- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f79c8020c20 msgr2=0x7f79c8023050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.592+0000 7f79eff79700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f79c8020c20 0x7f79c8023050 crc :-1 s=READY pgs=350 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.592+0000 7f79eff79700 1 -- 172.21.15.80:0/626272051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79c8003cf0 msgr2=0x7f79c8004190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.592+0000 7f79eff79700 1 --2- 172.21.15.80:0/626272051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79c8003cf0 0x7f79c8004190 secure :-1 s=READY pgs=848 cs=0 l=1 rx=0x7f79dc010450 tx=0x7f79dc010300).stop 2019-11-28T11:32:49.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.592+0000 7f79eed17700 1 -- 172.21.15.80:0/626272051 reap_dead start 2019-11-28T11:32:49.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.592+0000 7f79eed17700 1 -- 172.21.15.80:0/626272051 reap_dead start 2019-11-28T11:32:49.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.592+0000 7f79eff79700 1 -- 172.21.15.80:0/626272051 shutdown_connections 2019-11-28T11:32:49.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.592+0000 7f79eff79700 1 -- 172.21.15.80:0/626272051 shutdown_connections 2019-11-28T11:32:49.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.592+0000 7f79eff79700 1 -- 172.21.15.80:0/626272051 wait complete. 2019-11-28T11:32:49.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.592+0000 7f79eff79700 1 -- 172.21.15.80:0/626272051 >> 172.21.15.80:0/626272051 conn(0x7f79e8127dc0 msgr2=0x7f79e8141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:49.821 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:32:49.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.899+0000 7fce38cd6700 1 Processor -- start 2019-11-28T11:32:49.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.899+0000 7fce38cd6700 1 -- start start 2019-11-28T11:32:49.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.900+0000 7fce38cd6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fce3406c0a0 0x7fce34072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:49.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.900+0000 7fce38cd6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3406db00 con 0x7fce340734e0 2019-11-28T11:32:49.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.900+0000 7fce38cd6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3406e000 con 0x7fce34072620 2019-11-28T11:32:49.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.900+0000 7fce38cd6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3406fd60 con 0x7fce3406c0a0 2019-11-28T11:32:49.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.900+0000 7fce3259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fce340734e0 0x7fce34071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34610/0 (socket says 172.21.15.80:34610) 2019-11-28T11:32:49.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.900+0000 7fce3259c700 1 -- 172.21.15.80:0/2393473547 learned_addr learned my addr 172.21.15.80:0/2393473547 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:49.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.900+0000 7fce32d9d700 1 --2- 172.21.15.80:0/2393473547 >> v2:172.21.15.174:3300/0 conn(0x7fce3406c0a0 0x7fce34072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:49.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.900+0000 7fce31d9b700 1 -- 172.21.15.80:0/2393473547 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632963625 0 0) 0x7fce1c001070 con 0x7fce340734e0 2019-11-28T11:32:49.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.900+0000 7fce31d9b700 1 -- 172.21.15.80:0/2393473547 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce20002e80 con 0x7fce340734e0 2019-11-28T11:32:49.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce31d9b700 1 -- 172.21.15.80:0/2393473547 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1142355929 0 0) 0x7fce1c001050 con 0x7fce340734e0 2019-11-28T11:32:49.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce31d9b700 1 -- 172.21.15.80:0/2393473547 >> v2:172.21.15.174:3300/0 conn(0x7fce3406c0a0 msgr2=0x7fce34072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:49.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce31d9b700 1 --2- 172.21.15.80:0/2393473547 >> v2:172.21.15.174:3300/0 conn(0x7fce3406c0a0 0x7fce34072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:49.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce31d9b700 1 -- 172.21.15.80:0/2393473547 >> v1:172.21.15.174:6789/0 conn(0x7fce34072620 legacy=0x7fce34164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce31d9b700 1 -- 172.21.15.80:0/2393473547 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce340706c0 con 0x7fce340734e0 2019-11-28T11:32:49.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce31d9b700 1 -- 172.21.15.80:0/2393473547 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fce1c0015e0 con 0x7fce340734e0 2019-11-28T11:32:49.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce31d9b700 1 -- 172.21.15.80:0/2393473547 >> v1:172.21.15.80:6789/0 conn(0x7fce340734e0 legacy=0x7fce34071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce31d9b700 1 --2- 172.21.15.80:0/2393473547 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce20003ab0 0x7fce20005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:49.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce31d9b700 1 --2- 172.21.15.80:0/2393473547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce20006690 0x7fce20008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:49.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce31d9b700 1 --2- 172.21.15.80:0/2393473547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce20009380 0x7fce2000b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:49.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce31d9b700 1 -- 172.21.15.80:0/2393473547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2000c000 con 0x7fce20006690 2019-11-28T11:32:49.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce31d9b700 1 -- 172.21.15.80:0/2393473547 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce20050200 con 0x7fce20009380 2019-11-28T11:32:49.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce31d9b700 1 -- 172.21.15.80:0/2393473547 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce20050430 con 0x7fce20003ab0 2019-11-28T11:32:49.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce3259c700 1 --2- 172.21.15.80:0/2393473547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce20006690 0x7fce20008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:49.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce3359e700 1 --2- 172.21.15.80:0/2393473547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce20009380 0x7fce2000b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:49.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce32d9d700 1 --2- 172.21.15.80:0/2393473547 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce20003ab0 0x7fce20005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:49.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce3259c700 1 -- 172.21.15.80:0/2393473547 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce20003ab0 msgr2=0x7fce20005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:49.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce3259c700 1 --2- 172.21.15.80:0/2393473547 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce20003ab0 0x7fce20005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:49.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce3259c700 1 -- 172.21.15.80:0/2393473547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce20009380 msgr2=0x7fce2000b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:49.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce3259c700 1 --2- 172.21.15.80:0/2393473547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce20009380 0x7fce2000b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:49.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce3359e700 1 -- 172.21.15.80:0/2393473547 reap_dead start 2019-11-28T11:32:49.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce3259c700 1 -- 172.21.15.80:0/2393473547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce200506e0 con 0x7fce20006690 2019-11-28T11:32:49.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce3259c700 1 --2- 172.21.15.80:0/2393473547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce20006690 0x7fce20008b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fce1c00f8a0 tx=0x7fce1c00f3e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce3259c700 1 --2- 172.21.15.80:0/2393473547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce20006690 0x7fce20008b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fce1c00f8a0 tx=0x7fce1c00f3e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce3259c700 1 --2- 172.21.15.80:0/2393473547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce20006690 0x7fce20008b20 secure :-1 s=READY pgs=850 cs=0 l=1 rx=0x7fce1c00f8a0 tx=0x7fce1c00f3e0).ready entity=mon.0 client_cookie=a870d28f6c5f05f3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:49.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce3259c700 1 --2- 172.21.15.80:0/2393473547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce20006690 0x7fce20008b20 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7fce1c00f8a0 tx=0x7fce1c00f3e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce31d9b700 1 -- 172.21.15.80:0/2393473547 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce1c001050 con 0x7fce20006690 2019-11-28T11:32:49.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce3259c700 1 --2- 172.21.15.80:0/2393473547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce20006690 0x7fce20008b20 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7fce1c00f8a0 tx=0x7fce1c00f3e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce31d9b700 1 -- 172.21.15.80:0/2393473547 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c0040a0 con 0x7fce20006690 2019-11-28T11:32:49.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce3259c700 1 --2- 172.21.15.80:0/2393473547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce20006690 0x7fce20008b20 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7fce1c00f8a0 tx=0x7fce1c00f3e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce31d9b700 1 -- 172.21.15.80:0/2393473547 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce1c001050 con 0x7fce20006690 2019-11-28T11:32:49.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce38cd6700 1 -- 172.21.15.80:0/2393473547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce20006690 msgr2=0x7fce20008b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.901+0000 7fce38cd6700 1 --2- 172.21.15.80:0/2393473547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce20006690 0x7fce20008b20 secure :-1 s=READY pgs=850 cs=0 l=1 rx=0x7fce1c00f8a0 tx=0x7fce1c00f3e0).stop 2019-11-28T11:32:49.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.902+0000 7fce38cd6700 1 -- 172.21.15.80:0/2393473547 shutdown_connections 2019-11-28T11:32:49.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.902+0000 7fce38cd6700 1 --2- 172.21.15.80:0/2393473547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce20006690 0x7fce20008b20 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.902+0000 7fce38cd6700 1 -- 172.21.15.80:0/2393473547 shutdown_connections 2019-11-28T11:32:49.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.902+0000 7fce38cd6700 1 -- 172.21.15.80:0/2393473547 wait complete. 2019-11-28T11:32:49.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.902+0000 7fce38cd6700 1 -- 172.21.15.80:0/2393473547 >> 172.21.15.80:0/2393473547 conn(0x7fce34061cf0 msgr2=0x7fce34064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:49.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.905+0000 7fce38cd6700 1 Processor -- start 2019-11-28T11:32:49.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.905+0000 7fce38cd6700 1 -- start start 2019-11-28T11:32:49.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.905+0000 7fce38cd6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce34074d00 0x7fce3407aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:49.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.905+0000 7fce38cd6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fce34150f50 0x7fce3407af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:49.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce38cd6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce340754d0 con 0x7fce3407bba0 2019-11-28T11:32:49.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce38cd6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce34077f50 con 0x7fce34150f50 2019-11-28T11:32:49.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce38cd6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce34078980 con 0x7fce34074d00 2019-11-28T11:32:49.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce3259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fce34150f50 0x7fce3407af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:49.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce3259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fce34150f50 0x7fce3407af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35304/0 (socket says 172.21.15.80:35304) 2019-11-28T11:32:49.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce3259c700 1 -- 172.21.15.80:0/4285420545 learned_addr learned my addr 172.21.15.80:0/4285420545 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:49.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce32d9d700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce34074d00 0x7fce3407aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:49.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce3259c700 1 -- 172.21.15.80:0/4285420545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce34074d00 msgr2=0x7fce3407aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce3259c700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce34074d00 0x7fce3407aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:49.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce3259c700 1 -- 172.21.15.80:0/4285420545 >> v1:172.21.15.174:6789/0 conn(0x7fce3407bba0 legacy=0x7fce34076d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce3259c700 1 -- 172.21.15.80:0/4285420545 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce340792e0 con 0x7fce34150f50 2019-11-28T11:32:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce3259c700 1 --2- 172.21.15.80:0/4285420545 >> v2:172.21.15.80:3300/0 conn(0x7fce34150f50 0x7fce3407af60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fce1c010430 tx=0x7fce1c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce3259c700 1 --2- 172.21.15.80:0/4285420545 >> v2:172.21.15.80:3300/0 conn(0x7fce34150f50 0x7fce3407af60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fce1c010430 tx=0x7fce1c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce3259c700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce34150f50 0x7fce3407af60 secure :-1 s=READY pgs=851 cs=0 l=1 rx=0x7fce1c010430 tx=0x7fce1c010260).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce3259c700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce34150f50 0x7fce3407af60 secure :-1 s=THROTTLE_DONE pgs=851 cs=0 l=1 rx=0x7fce1c010430 tx=0x7fce1c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce2b7fe700 1 -- 172.21.15.80:0/4285420545 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce1c000940 con 0x7fce34150f50 2019-11-28T11:32:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce3259c700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce34150f50 0x7fce3407af60 secure :-1 s=THROTTLE_DONE pgs=851 cs=0 l=1 rx=0x7fce1c010430 tx=0x7fce1c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce3259c700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce34150f50 0x7fce3407af60 secure :-1 s=THROTTLE_DONE pgs=851 cs=0 l=1 rx=0x7fce1c010430 tx=0x7fce1c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce2b7fe700 1 -- 172.21.15.80:0/4285420545 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c0041d0 con 0x7fce34150f50 2019-11-28T11:32:49.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce38cd6700 1 -- 172.21.15.80:0/4285420545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce34079660 con 0x7fce34150f50 2019-11-28T11:32:49.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce2b7fe700 1 -- 172.21.15.80:0/4285420545 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce1c0013f0 con 0x7fce34150f50 2019-11-28T11:32:49.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.906+0000 7fce38cd6700 1 -- 172.21.15.80:0/4285420545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce340792e0 con 0x7fce34150f50 2019-11-28T11:32:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.907+0000 7fce3259c700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce34150f50 0x7fce3407af60 secure :-1 s=THROTTLE_DONE pgs=851 cs=0 l=1 rx=0x7fce1c010430 tx=0x7fce1c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.907+0000 7fce2b7fe700 1 -- 172.21.15.80:0/4285420545 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fce1c0043c0 con 0x7fce34150f50 2019-11-28T11:32:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.907+0000 7fce3259c700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce34150f50 0x7fce3407af60 secure :-1 s=THROTTLE_DONE pgs=851 cs=0 l=1 rx=0x7fce1c010430 tx=0x7fce1c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.907+0000 7fce2b7fe700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fce18018730 0x7fce1801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.907+0000 7fce2b7fe700 1 -- 172.21.15.80:0/4285420545 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fce1c031b40 con 0x7fce34150f50 2019-11-28T11:32:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.907+0000 7fce32d9d700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fce18018730 0x7fce1801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:49.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.907+0000 7fce32d9d700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fce18018730 0x7fce1801abc0 crc :-1 s=READY pgs=351 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:49.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.914+0000 7fce38cd6700 1 -- 172.21.15.80:0/4285420545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce34079660 con 0x7fce34150f50 2019-11-28T11:32:49.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.917+0000 7fce3259c700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce34150f50 0x7fce3407af60 secure :-1 s=THROTTLE_DONE pgs=851 cs=0 l=1 rx=0x7fce1c010430 tx=0x7fce1c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:49.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:49.917+0000 7fce2b7fe700 1 -- 172.21.15.80:0/4285420545 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fce1c000ea0 con 0x7fce34150f50 2019-11-28T11:32:50.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.091+0000 7fce38cd6700 1 -- 172.21.15.80:0/4285420545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce340792e0 con 0x7fce34150f50 2019-11-28T11:32:50.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.091+0000 7fce3259c700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce34150f50 0x7fce3407af60 secure :-1 s=THROTTLE_DONE pgs=851 cs=0 l=1 rx=0x7fce1c010430 tx=0x7fce1c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:50.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.091+0000 7fce2b7fe700 1 -- 172.21.15.80:0/4285420545 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+1427 (secure 0 0 0) 0x7fce1c01ff80 con 0x7fce34150f50 2019-11-28T11:32:50.135 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 39 2019-11-28T11:32:50.135 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:32:50.136 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:29:26.954212+0000","modified":"2019-11-28T11:32:49.181214+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2019-11-28T11:32:50.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.094+0000 7fce38cd6700 1 -- 172.21.15.80:0/4285420545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fce18018730 msgr2=0x7fce1801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:50.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.094+0000 7fce38cd6700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fce18018730 0x7fce1801abc0 crc :-1 s=READY pgs=351 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:50.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.094+0000 7fce38cd6700 1 -- 172.21.15.80:0/4285420545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce34150f50 msgr2=0x7fce3407af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:50.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.094+0000 7fce38cd6700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce34150f50 0x7fce3407af60 secure :-1 s=READY pgs=851 cs=0 l=1 rx=0x7fce1c010430 tx=0x7fce1c010260).stop 2019-11-28T11:32:50.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.094+0000 7fce38cd6700 1 -- 172.21.15.80:0/4285420545 shutdown_connections 2019-11-28T11:32:50.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.094+0000 7fce38cd6700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fce18018730 0x7fce1801abc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:50.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.094+0000 7fce38cd6700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce34150f50 0x7fce3407af60 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:50.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.094+0000 7fce38cd6700 1 --2- 172.21.15.80:0/4285420545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce34074d00 0x7fce3407aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:50.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.094+0000 7fce38cd6700 1 -- 172.21.15.80:0/4285420545 shutdown_connections 2019-11-28T11:32:50.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.094+0000 7fce38cd6700 1 -- 172.21.15.80:0/4285420545 wait complete. 2019-11-28T11:32:50.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.094+0000 7fce38cd6700 1 -- 172.21.15.80:0/4285420545 >> 172.21.15.80:0/4285420545 conn(0x7fce3413fa50 msgr2=0x7fce3407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:50.147 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:32:50.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.228+0000 7f6cb1e77700 1 Processor -- start 2019-11-28T11:32:50.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.228+0000 7f6cb1e77700 1 -- start start 2019-11-28T11:32:50.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.229+0000 7f6cb1e77700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6cac06c0a0 0x7f6cac072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:50.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.229+0000 7f6cb1e77700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cac072620 0x7f6cac164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:50.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.229+0000 7f6cb1e77700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cac06db00 con 0x7f6cac0734e0 2019-11-28T11:32:50.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.229+0000 7f6cb1e77700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cac06fd60 con 0x7f6cac06c0a0 2019-11-28T11:32:50.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.229+0000 7f6cb1e77700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac070030 con 0x7f6cac072620 2019-11-28T11:32:50.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.229+0000 7f6cabfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6cac06c0a0 0x7f6cac072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:50.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.229+0000 7f6cabfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6cac06c0a0 0x7f6cac072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35310/0 (socket says 172.21.15.80:35310) 2019-11-28T11:32:50.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.229+0000 7f6cabfff700 1 -- 172.21.15.80:0/3682551639 learned_addr learned my addr 172.21.15.80:0/3682551639 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:50.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.229+0000 7f6cb0c15700 1 --2- 172.21.15.80:0/3682551639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cac072620 0x7f6cac164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:50.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.230+0000 7f6cabfff700 1 -- 172.21.15.80:0/3682551639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cac072620 msgr2=0x7f6cac164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:50.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.230+0000 7f6cabfff700 1 --2- 172.21.15.80:0/3682551639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cac072620 0x7f6cac164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:50.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.230+0000 7f6cabfff700 1 -- 172.21.15.80:0/3682551639 >> v1:172.21.15.174:6789/0 conn(0x7f6cac0734e0 legacy=0x7f6cac071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:50.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.230+0000 7f6cabfff700 1 -- 172.21.15.80:0/3682551639 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac0706c0 con 0x7f6cac06c0a0 2019-11-28T11:32:50.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.230+0000 7f6cab7fe700 1 -- 172.21.15.80:0/3682551639 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660358316 0 0) 0x7f6c94001080 con 0x7f6cac0734e0 2019-11-28T11:32:50.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.230+0000 7f6cabfff700 1 --2- 172.21.15.80:0/3682551639 >> v2:172.21.15.80:3300/0 conn(0x7f6cac06c0a0 0x7f6cac072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6c9c00f6c0 tx=0x7f6c9c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:50.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.230+0000 7f6cabfff700 1 --2- 172.21.15.80:0/3682551639 >> v2:172.21.15.80:3300/0 conn(0x7f6cac06c0a0 0x7f6cac072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6c9c00f6c0 tx=0x7f6c9c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:50.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.230+0000 7f6cabfff700 1 --2- 172.21.15.80:0/3682551639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cac06c0a0 0x7f6cac072fa0 secure :-1 s=READY pgs=852 cs=0 l=1 rx=0x7f6c9c00f6c0 tx=0x7f6c9c00fa60).ready entity=mon.0 client_cookie=a8ea65af45ccac0a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:50.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.230+0000 7f6cabfff700 1 --2- 172.21.15.80:0/3682551639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cac06c0a0 0x7f6cac072fa0 secure :-1 s=THROTTLE_DONE pgs=852 cs=0 l=1 rx=0x7f6c9c00f6c0 tx=0x7f6c9c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:50.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.230+0000 7f6cab7fe700 1 -- 172.21.15.80:0/3682551639 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c9c000960 con 0x7f6cac06c0a0 2019-11-28T11:32:50.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.230+0000 7f6cabfff700 1 --2- 172.21.15.80:0/3682551639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cac06c0a0 0x7f6cac072fa0 secure :-1 s=THROTTLE_DONE pgs=852 cs=0 l=1 rx=0x7f6c9c00f6c0 tx=0x7f6c9c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:50.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.230+0000 7f6cabfff700 1 --2- 172.21.15.80:0/3682551639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cac06c0a0 0x7f6cac072fa0 secure :-1 s=THROTTLE_DONE pgs=852 cs=0 l=1 rx=0x7f6c9c00f6c0 tx=0x7f6c9c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:50.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.230+0000 7f6cab7fe700 1 -- 172.21.15.80:0/3682551639 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c000c90 con 0x7f6cac06c0a0 2019-11-28T11:32:50.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.230+0000 7f6cab7fe700 1 -- 172.21.15.80:0/3682551639 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c9c000960 con 0x7f6cac06c0a0 2019-11-28T11:32:50.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.230+0000 7f6cb1e77700 1 -- 172.21.15.80:0/3682551639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cac06c0a0 msgr2=0x7f6cac072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:50.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.230+0000 7f6cb1e77700 1 --2- 172.21.15.80:0/3682551639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cac06c0a0 0x7f6cac072fa0 secure :-1 s=READY pgs=852 cs=0 l=1 rx=0x7f6c9c00f6c0 tx=0x7f6c9c00fa60).stop 2019-11-28T11:32:50.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.231+0000 7f6cb1e77700 1 -- 172.21.15.80:0/3682551639 shutdown_connections 2019-11-28T11:32:50.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.231+0000 7f6cb1e77700 1 --2- 172.21.15.80:0/3682551639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cac072620 0x7f6cac164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:50.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.231+0000 7f6cb1e77700 1 --2- 172.21.15.80:0/3682551639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cac06c0a0 0x7f6cac072fa0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:50.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.231+0000 7f6cb1e77700 1 -- 172.21.15.80:0/3682551639 shutdown_connections 2019-11-28T11:32:50.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.231+0000 7f6cb1e77700 1 -- 172.21.15.80:0/3682551639 wait complete. 2019-11-28T11:32:50.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.231+0000 7f6cb1e77700 1 -- 172.21.15.80:0/3682551639 >> 172.21.15.80:0/3682551639 conn(0x7f6cac061cf0 msgr2=0x7f6cac064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:50.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.233+0000 7f6cb1e77700 1 Processor -- start 2019-11-28T11:32:50.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.233+0000 7f6cb1e77700 1 -- start start 2019-11-28T11:32:50.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.234+0000 7f6cb1e77700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6cac13e9e0 0x7f6cac108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:50.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.234+0000 7f6cb1e77700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cac1066e0 con 0x7f6cac109430 2019-11-28T11:32:50.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.234+0000 7f6cb1e77700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cac10ce40 con 0x7f6cac13e5f0 2019-11-28T11:32:50.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.234+0000 7f6cb1e77700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cac10e060 con 0x7f6cac13e9e0 2019-11-28T11:32:50.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.234+0000 7f6cb0c15700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6cac109430 0x7f6cac168ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34636/0 (socket says 172.21.15.80:34636) 2019-11-28T11:32:50.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.234+0000 7f6cb0c15700 1 -- 172.21.15.80:0/3119633661 learned_addr learned my addr 172.21.15.80:0/3119633661 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:50.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.234+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/3119633661 >> v2:172.21.15.174:3300/0 conn(0x7f6cac13e9e0 0x7f6cac108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:50.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.234+0000 7f6ca97fa700 1 -- 172.21.15.80:0/3119633661 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362548456 0 0) 0x7f6ca4009930 con 0x7f6cac109430 2019-11-28T11:32:50.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.234+0000 7f6ca97fa700 1 -- 172.21.15.80:0/3119633661 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c84002e80 con 0x7f6cac109430 2019-11-28T11:32:50.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.235+0000 7f6ca97fa700 1 -- 172.21.15.80:0/3119633661 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3258152911 0 0) 0x7f6ca400a970 con 0x7f6cac109430 2019-11-28T11:32:50.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.235+0000 7f6ca3fff700 1 -- 172.21.15.80:0/3119633661 >> v1:172.21.15.174:6789/0 conn(0x7f6cac13e5f0 legacy=0x7f6cac10a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:50.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.235+0000 7f6ca3fff700 1 -- 172.21.15.80:0/3119633661 >> v1:172.21.15.80:6789/0 conn(0x7f6cac109430 legacy=0x7f6cac168ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:50.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.235+0000 7f6ca3fff700 1 -- 172.21.15.80:0/3119633661 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac10e9c0 con 0x7f6cac13e9e0 2019-11-28T11:32:50.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.235+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/3119633661 >> v2:172.21.15.174:3300/0 conn(0x7f6cac13e9e0 0x7f6cac108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6c940103a0 tx=0x7f6c94010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:50.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.235+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/3119633661 >> v2:172.21.15.174:3300/0 conn(0x7f6cac13e9e0 0x7f6cac108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6c940103a0 tx=0x7f6c94010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.235+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cac13e9e0 0x7f6cac108ef0 secure :-1 s=READY pgs=507 cs=0 l=1 rx=0x7f6c940103a0 tx=0x7f6c94010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.235+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cac13e9e0 0x7f6cac108ef0 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7f6c940103a0 tx=0x7f6c94010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.235+0000 7f6ca97fa700 1 -- 172.21.15.80:0/3119633661 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c94009960 con 0x7f6cac13e9e0 2019-11-28T11:32:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.235+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cac13e9e0 0x7f6cac108ef0 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7f6c940103a0 tx=0x7f6c94010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.235+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cac13e9e0 0x7f6cac108ef0 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7f6c940103a0 tx=0x7f6c94010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.235+0000 7f6ca97fa700 1 -- 172.21.15.80:0/3119633661 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c94000a70 con 0x7f6cac13e9e0 2019-11-28T11:32:50.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.235+0000 7f6cb1e77700 1 -- 172.21.15.80:0/3119633661 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cac10ed40 con 0x7f6cac13e9e0 2019-11-28T11:32:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.235+0000 7f6ca97fa700 1 -- 172.21.15.80:0/3119633661 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c94009f40 con 0x7f6cac13e9e0 2019-11-28T11:32:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.235+0000 7f6cb1e77700 1 -- 172.21.15.80:0/3119633661 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cac10e9c0 con 0x7f6cac13e9e0 2019-11-28T11:32:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.235+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cac13e9e0 0x7f6cac108ef0 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7f6c940103a0 tx=0x7f6c94010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.236+0000 7f6ca97fa700 1 -- 172.21.15.80:0/3119633661 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6c9400a3d0 con 0x7f6cac13e9e0 2019-11-28T11:32:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.236+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cac13e9e0 0x7f6cac108ef0 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7f6c940103a0 tx=0x7f6c94010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:50.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.236+0000 7f6ca97fa700 1 --2- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c84018780 0x7f6c8401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.236+0000 7f6ca97fa700 1 -- 172.21.15.80:0/3119633661 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f6c94031a60 con 0x7f6cac13e9e0 2019-11-28T11:32:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.236+0000 7f6cabfff700 1 --2- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c84018780 0x7f6c8401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:50.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.236+0000 7f6cabfff700 1 --2- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c84018780 0x7f6c8401abf0 crc :-1 s=READY pgs=352 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.243+0000 7f6cb1e77700 1 -- 172.21.15.80:0/3119633661 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cac10ed40 con 0x7f6cac13e9e0 2019-11-28T11:32:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.247+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cac13e9e0 0x7f6cac108ef0 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7f6c940103a0 tx=0x7f6c94010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:50.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.247+0000 7f6ca97fa700 1 -- 172.21.15.80:0/3119633661 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6c94026160 con 0x7f6cac13e9e0 2019-11-28T11:32:50.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:50.412+0000 7f6cb1e77700 1 -- 172.21.15.80:0/3119633661 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6cac10e9c0 con 0x7f6cac13e9e0 2019-11-28T11:32:51.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.191+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cac13e9e0 0x7f6cac108ef0 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7f6c940103a0 tx=0x7f6c94010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.191+0000 7f6ca97fa700 1 -- 172.21.15.80:0/3119633661 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6c9400a3d0 con 0x7f6cac13e9e0 2019-11-28T11:32:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:32:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.229+0000 7f6cb1e77700 1 -- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c84018780 msgr2=0x7f6c8401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.229+0000 7f6cb1e77700 1 --2- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c84018780 0x7f6c8401abf0 crc :-1 s=READY pgs=352 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.229+0000 7f6cb1e77700 1 -- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cac13e9e0 msgr2=0x7f6cac108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.229+0000 7f6cb1e77700 1 --2- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cac13e9e0 0x7f6cac108ef0 secure :-1 s=READY pgs=507 cs=0 l=1 rx=0x7f6c940103a0 tx=0x7f6c94010740).stop 2019-11-28T11:32:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.229+0000 7f6cb1e77700 1 -- 172.21.15.80:0/3119633661 shutdown_connections 2019-11-28T11:32:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.229+0000 7f6cb1e77700 1 --2- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cac13e9e0 0x7f6cac108ef0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.229+0000 7f6cb1e77700 1 --2- 172.21.15.80:0/3119633661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c84018780 0x7f6c8401abf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.229+0000 7f6cb1e77700 1 -- 172.21.15.80:0/3119633661 shutdown_connections 2019-11-28T11:32:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.229+0000 7f6cb1e77700 1 -- 172.21.15.80:0/3119633661 wait complete. 2019-11-28T11:32:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.229+0000 7f6cb1e77700 1 -- 172.21.15.80:0/3119633661 >> 172.21.15.80:0/3119633661 conn(0x7f6cac13d620 msgr2=0x7f6cac13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:51.283 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:32:51.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.358+0000 7fd74660e700 1 Processor -- start 2019-11-28T11:32:51.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.358+0000 7fd74660e700 1 -- start start 2019-11-28T11:32:51.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.359+0000 7fd74660e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd74006c0a0 0x7fd740072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:51.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.359+0000 7fd74660e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd7400734e0 0x7fd740071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.359+0000 7fd74660e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd740072360 0x7fd7400727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.359+0000 7fd74660e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74006f330 con 0x7fd740072360 2019-11-28T11:32:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.359+0000 7fd74660e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7400706c0 con 0x7fd7400734e0 2019-11-28T11:32:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.359+0000 7fd74660e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd740070a40 con 0x7fd74006c0a0 2019-11-28T11:32:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.359+0000 7fd7453ac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd740072360 0x7fd7400727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.359+0000 7fd7453ac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd740072360 0x7fd7400727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35324/0 (socket says 172.21.15.80:35324) 2019-11-28T11:32:51.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.359+0000 7fd7453ac700 1 -- 172.21.15.80:0/1927023709 learned_addr learned my addr 172.21.15.80:0/1927023709 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:51.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd744bab700 1 --2- 172.21.15.80:0/1927023709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd74006c0a0 0x7fd740072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:51.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd73ffff700 1 --2- 172.21.15.80:0/1927023709 >> v2:172.21.15.174:3300/0 conn(0x7fd7400734e0 0x7fd740071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:51.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd7453ac700 1 -- 172.21.15.80:0/1927023709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd74006c0a0 msgr2=0x7fd740072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:51.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd7453ac700 1 --2- 172.21.15.80:0/1927023709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd74006c0a0 0x7fd740072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:51.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd7453ac700 1 -- 172.21.15.80:0/1927023709 >> v2:172.21.15.174:3300/0 conn(0x7fd7400734e0 msgr2=0x7fd740071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:51.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd7453ac700 1 --2- 172.21.15.80:0/1927023709 >> v2:172.21.15.174:3300/0 conn(0x7fd7400734e0 0x7fd740071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:51.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd7453ac700 1 -- 172.21.15.80:0/1927023709 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74006db00 con 0x7fd740072360 2019-11-28T11:32:51.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd7453ac700 1 --2- 172.21.15.80:0/1927023709 >> v2:172.21.15.80:3300/0 conn(0x7fd740072360 0x7fd7400727e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd73800f6b0 tx=0x7fd738007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd7453ac700 1 --2- 172.21.15.80:0/1927023709 >> v2:172.21.15.80:3300/0 conn(0x7fd740072360 0x7fd7400727e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd73800f6b0 tx=0x7fd738007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd7453ac700 1 --2- 172.21.15.80:0/1927023709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd740072360 0x7fd7400727e0 secure :-1 s=READY pgs=854 cs=0 l=1 rx=0x7fd73800f6b0 tx=0x7fd738007d50).ready entity=mon.0 client_cookie=2b0044bf91428d43 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:51.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd7453ac700 1 --2- 172.21.15.80:0/1927023709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd740072360 0x7fd7400727e0 secure :-1 s=THROTTLE_DONE pgs=854 cs=0 l=1 rx=0x7fd73800f6b0 tx=0x7fd738007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd7453ac700 1 --2- 172.21.15.80:0/1927023709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd740072360 0x7fd7400727e0 secure :-1 s=THROTTLE_DONE pgs=854 cs=0 l=1 rx=0x7fd73800f6b0 tx=0x7fd738007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd73f7fe700 1 -- 172.21.15.80:0/1927023709 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd738000ba0 con 0x7fd740072360 2019-11-28T11:32:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd7453ac700 1 --2- 172.21.15.80:0/1927023709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd740072360 0x7fd7400727e0 secure :-1 s=THROTTLE_DONE pgs=854 cs=0 l=1 rx=0x7fd73800f6b0 tx=0x7fd738007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd73f7fe700 1 -- 172.21.15.80:0/1927023709 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7380010e0 con 0x7fd740072360 2019-11-28T11:32:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd73f7fe700 1 -- 172.21.15.80:0/1927023709 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7380017b0 con 0x7fd740072360 2019-11-28T11:32:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd74660e700 1 -- 172.21.15.80:0/1927023709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd740072360 msgr2=0x7fd7400727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.360+0000 7fd74660e700 1 --2- 172.21.15.80:0/1927023709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd740072360 0x7fd7400727e0 secure :-1 s=READY pgs=854 cs=0 l=1 rx=0x7fd73800f6b0 tx=0x7fd738007d50).stop 2019-11-28T11:32:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.361+0000 7fd74660e700 1 -- 172.21.15.80:0/1927023709 shutdown_connections 2019-11-28T11:32:51.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.361+0000 7fd74660e700 1 --2- 172.21.15.80:0/1927023709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd740072360 0x7fd7400727e0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:51.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.361+0000 7fd74660e700 1 --2- 172.21.15.80:0/1927023709 >> v2:172.21.15.174:3300/0 conn(0x7fd7400734e0 0x7fd740071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:51.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.361+0000 7fd74660e700 1 --2- 172.21.15.80:0/1927023709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd74006c0a0 0x7fd740072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:51.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.361+0000 7fd74660e700 1 -- 172.21.15.80:0/1927023709 shutdown_connections 2019-11-28T11:32:51.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.361+0000 7fd74660e700 1 -- 172.21.15.80:0/1927023709 wait complete. 2019-11-28T11:32:51.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.361+0000 7fd74660e700 1 -- 172.21.15.80:0/1927023709 >> 172.21.15.80:0/1927023709 conn(0x7fd740061cf0 msgr2=0x7fd740064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:51.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.363+0000 7fd74660e700 1 Processor -- start 2019-11-28T11:32:51.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.363+0000 7fd74660e700 1 -- start start 2019-11-28T11:32:51.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.364+0000 7fd74660e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd740104820 0x7fd74010c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:51.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.364+0000 7fd74660e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd74010c890 0x7fd74010b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:51.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.364+0000 7fd74660e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74013bcd0 con 0x7fd74010b710 2019-11-28T11:32:51.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.364+0000 7fd74660e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd740109130 con 0x7fd74010c890 2019-11-28T11:32:51.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.364+0000 7fd74660e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd740109400 con 0x7fd740104820 2019-11-28T11:32:51.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.364+0000 7fd73ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd74010c890 0x7fd74010b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:51.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.364+0000 7fd7453ac700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd74010b710 0x7fd740104c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34644/0 (socket says 172.21.15.80:34644) 2019-11-28T11:32:51.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.364+0000 7fd7453ac700 1 -- 172.21.15.80:0/2683489091 learned_addr learned my addr 172.21.15.80:0/2683489091 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:51.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.364+0000 7fd73ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd74010c890 0x7fd74010b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35330/0 (socket says 172.21.15.80:35330) 2019-11-28T11:32:51.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.364+0000 7fd744bab700 1 --2- 172.21.15.80:0/2683489091 >> v2:172.21.15.174:3300/0 conn(0x7fd740104820 0x7fd74010c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:51.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73ffff700 1 -- 172.21.15.80:0/2683489091 >> v2:172.21.15.174:3300/0 conn(0x7fd740104820 msgr2=0x7fd74010c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:51.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73ffff700 1 --2- 172.21.15.80:0/2683489091 >> v2:172.21.15.174:3300/0 conn(0x7fd740104820 0x7fd74010c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:51.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73ffff700 1 -- 172.21.15.80:0/2683489091 >> v1:172.21.15.80:6789/0 conn(0x7fd74010b710 legacy=0x7fd740104c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:51.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73ffff700 1 -- 172.21.15.80:0/2683489091 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd740109a90 con 0x7fd74010c890 2019-11-28T11:32:51.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73d7fa700 1 -- 172.21.15.80:0/2683489091 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268704560 0 0) 0x7fd738007ea0 con 0x7fd74010b710 2019-11-28T11:32:51.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73ffff700 1 --2- 172.21.15.80:0/2683489091 >> v2:172.21.15.80:3300/0 conn(0x7fd74010c890 0x7fd74010b1d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd7300106a0 tx=0x7fd730010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73ffff700 1 --2- 172.21.15.80:0/2683489091 >> v2:172.21.15.80:3300/0 conn(0x7fd74010c890 0x7fd74010b1d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd7300106a0 tx=0x7fd730010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73ffff700 1 --2- 172.21.15.80:0/2683489091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74010c890 0x7fd74010b1d0 secure :-1 s=READY pgs=856 cs=0 l=1 rx=0x7fd7300106a0 tx=0x7fd730010a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:51.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73ffff700 1 --2- 172.21.15.80:0/2683489091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74010c890 0x7fd74010b1d0 secure :-1 s=THROTTLE_DONE pgs=856 cs=0 l=1 rx=0x7fd7300106a0 tx=0x7fd730010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73d7fa700 1 -- 172.21.15.80:0/2683489091 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd730000cc0 con 0x7fd74010c890 2019-11-28T11:32:51.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73ffff700 1 --2- 172.21.15.80:0/2683489091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74010c890 0x7fd74010b1d0 secure :-1 s=THROTTLE_DONE pgs=856 cs=0 l=1 rx=0x7fd7300106a0 tx=0x7fd730010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73ffff700 1 --2- 172.21.15.80:0/2683489091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74010c890 0x7fd74010b1d0 secure :-1 s=THROTTLE_DONE pgs=856 cs=0 l=1 rx=0x7fd7300106a0 tx=0x7fd730010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73d7fa700 1 -- 172.21.15.80:0/2683489091 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd730009fc0 con 0x7fd74010c890 2019-11-28T11:32:51.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd74660e700 1 -- 172.21.15.80:0/2683489091 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd740109e10 con 0x7fd74010c890 2019-11-28T11:32:51.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73d7fa700 1 -- 172.21.15.80:0/2683489091 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd73000a1b0 con 0x7fd74010c890 2019-11-28T11:32:51.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd74660e700 1 -- 172.21.15.80:0/2683489091 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd740109a90 con 0x7fd74010c890 2019-11-28T11:32:51.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73ffff700 1 --2- 172.21.15.80:0/2683489091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74010c890 0x7fd74010b1d0 secure :-1 s=THROTTLE_DONE pgs=856 cs=0 l=1 rx=0x7fd7300106a0 tx=0x7fd730010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73d7fa700 1 -- 172.21.15.80:0/2683489091 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd730009a30 con 0x7fd74010c890 2019-11-28T11:32:51.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.365+0000 7fd73ffff700 1 --2- 172.21.15.80:0/2683489091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74010c890 0x7fd74010b1d0 secure :-1 s=THROTTLE_DONE pgs=856 cs=0 l=1 rx=0x7fd7300106a0 tx=0x7fd730010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.366+0000 7fd73d7fa700 1 --2- 172.21.15.80:0/2683489091 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd724018730 0x7fd72401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:51.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.366+0000 7fd73d7fa700 1 -- 172.21.15.80:0/2683489091 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fd730031dd0 con 0x7fd74010c890 2019-11-28T11:32:51.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.366+0000 7fd744bab700 1 --2- 172.21.15.80:0/2683489091 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd724018730 0x7fd72401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:51.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.366+0000 7fd744bab700 1 --2- 172.21.15.80:0/2683489091 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd724018730 0x7fd72401abc0 crc :-1 s=READY pgs=353 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:51.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.373+0000 7fd74660e700 1 -- 172.21.15.80:0/2683489091 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd740109e10 con 0x7fd74010c890 2019-11-28T11:32:51.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.377+0000 7fd73ffff700 1 --2- 172.21.15.80:0/2683489091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74010c890 0x7fd74010b1d0 secure :-1 s=THROTTLE_DONE pgs=856 cs=0 l=1 rx=0x7fd7300106a0 tx=0x7fd730010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.377+0000 7fd73d7fa700 1 -- 172.21.15.80:0/2683489091 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd730017770 con 0x7fd74010c890 2019-11-28T11:32:51.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.549+0000 7fd74660e700 1 -- 172.21.15.80:0/2683489091 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd740109a90 con 0x7fd74010c890 2019-11-28T11:32:51.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.550+0000 7fd73ffff700 1 --2- 172.21.15.80:0/2683489091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74010c890 0x7fd74010b1d0 secure :-1 s=THROTTLE_DONE pgs=856 cs=0 l=1 rx=0x7fd7300106a0 tx=0x7fd730010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.550+0000 7fd73d7fa700 1 -- 172.21.15.80:0/2683489091 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+1427 (secure 0 0 0) 0x7fd730009a30 con 0x7fd74010c890 2019-11-28T11:32:51.594 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 40 2019-11-28T11:32:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:32:51.595 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":40,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:29:26.954212+0000","modified":"2019-11-28T11:32:51.189930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2019-11-28T11:32:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.552+0000 7fd74660e700 1 -- 172.21.15.80:0/2683489091 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd724018730 msgr2=0x7fd72401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.552+0000 7fd74660e700 1 --2- 172.21.15.80:0/2683489091 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd724018730 0x7fd72401abc0 crc :-1 s=READY pgs=353 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.552+0000 7fd74660e700 1 -- 172.21.15.80:0/2683489091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74010c890 msgr2=0x7fd74010b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:51.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.552+0000 7fd74660e700 1 --2- 172.21.15.80:0/2683489091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74010c890 0x7fd74010b1d0 secure :-1 s=READY pgs=856 cs=0 l=1 rx=0x7fd7300106a0 tx=0x7fd730010a40).stop 2019-11-28T11:32:51.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.552+0000 7fd74660e700 1 -- 172.21.15.80:0/2683489091 shutdown_connections 2019-11-28T11:32:51.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.552+0000 7fd74660e700 1 --2- 172.21.15.80:0/2683489091 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd724018730 0x7fd72401abc0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:51.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.553+0000 7fd74660e700 1 --2- 172.21.15.80:0/2683489091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74010c890 0x7fd74010b1d0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:51.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.553+0000 7fd74660e700 1 --2- 172.21.15.80:0/2683489091 >> v2:172.21.15.174:3300/0 conn(0x7fd740104820 0x7fd74010c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:51.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.553+0000 7fd74660e700 1 -- 172.21.15.80:0/2683489091 shutdown_connections 2019-11-28T11:32:51.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.553+0000 7fd74660e700 1 -- 172.21.15.80:0/2683489091 wait complete. 2019-11-28T11:32:51.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.553+0000 7fd74660e700 1 -- 172.21.15.80:0/2683489091 >> 172.21.15.80:0/2683489091 conn(0x7fd74013d620 msgr2=0x7fd74013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:51.606 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:32:51.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.686+0000 7fe714b7a700 1 Processor -- start 2019-11-28T11:32:51.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.686+0000 7fe714b7a700 1 -- start start 2019-11-28T11:32:51.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe714b7a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe71006c490 0x7fe71006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:51.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe714b7a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe71006ce60 0x7fe710164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:51.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe714b7a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71006db00 con 0x7fe71006c0a0 2019-11-28T11:32:51.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe714b7a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71006fd60 con 0x7fe71006c490 2019-11-28T11:32:51.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe714b7a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe710070030 con 0x7fe71006ce60 2019-11-28T11:32:51.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe70e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe71006c490 0x7fe71006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:51.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe70e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe71006c490 0x7fe71006c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35338/0 (socket says 172.21.15.80:35338) 2019-11-28T11:32:51.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe70e59c700 1 -- 172.21.15.80:0/1181171432 learned_addr learned my addr 172.21.15.80:0/1181171432 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:51.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe70ed9d700 1 --1- 172.21.15.80:0/1181171432 >> v1:172.21.15.80:6789/0 conn(0x7fe71006c0a0 0x7fe710072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34650/0 (socket says 172.21.15.80:34650) 2019-11-28T11:32:51.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe70f59e700 1 --2- 172.21.15.80:0/1181171432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe71006ce60 0x7fe710164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:51.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe70e59c700 1 -- 172.21.15.80:0/1181171432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe71006ce60 msgr2=0x7fe710164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:51.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe70e59c700 1 --2- 172.21.15.80:0/1181171432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe71006ce60 0x7fe710164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:51.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe70e59c700 1 -- 172.21.15.80:0/1181171432 >> v1:172.21.15.80:6789/0 conn(0x7fe71006c0a0 legacy=0x7fe710072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:51.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe70dd9b700 1 -- 172.21.15.80:0/1181171432 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895568360 0 0) 0x7fe700001100 con 0x7fe71006c0a0 2019-11-28T11:32:51.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe70e59c700 1 -- 172.21.15.80:0/1181171432 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7100706c0 con 0x7fe71006c490 2019-11-28T11:32:51.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe70e59c700 1 --2- 172.21.15.80:0/1181171432 >> v2:172.21.15.80:3300/0 conn(0x7fe71006c490 0x7fe71006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe70400f6c0 tx=0x7fe70400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.687+0000 7fe70e59c700 1 --2- 172.21.15.80:0/1181171432 >> v2:172.21.15.80:3300/0 conn(0x7fe71006c490 0x7fe71006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe70400f6c0 tx=0x7fe70400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.688+0000 7fe70e59c700 1 --2- 172.21.15.80:0/1181171432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe71006c490 0x7fe71006c920 secure :-1 s=READY pgs=858 cs=0 l=1 rx=0x7fe70400f6c0 tx=0x7fe70400fa60).ready entity=mon.0 client_cookie=a35330e7c8154e23 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:51.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.688+0000 7fe70e59c700 1 --2- 172.21.15.80:0/1181171432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe71006c490 0x7fe71006c920 secure :-1 s=THROTTLE_DONE pgs=858 cs=0 l=1 rx=0x7fe70400f6c0 tx=0x7fe70400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.688+0000 7fe70dd9b700 1 -- 172.21.15.80:0/1181171432 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe704000960 con 0x7fe71006c490 2019-11-28T11:32:51.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.688+0000 7fe70e59c700 1 --2- 172.21.15.80:0/1181171432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe71006c490 0x7fe71006c920 secure :-1 s=THROTTLE_DONE pgs=858 cs=0 l=1 rx=0x7fe70400f6c0 tx=0x7fe70400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.688+0000 7fe70e59c700 1 --2- 172.21.15.80:0/1181171432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe71006c490 0x7fe71006c920 secure :-1 s=THROTTLE_DONE pgs=858 cs=0 l=1 rx=0x7fe70400f6c0 tx=0x7fe70400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.688+0000 7fe70dd9b700 1 -- 172.21.15.80:0/1181171432 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe704000c90 con 0x7fe71006c490 2019-11-28T11:32:51.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.688+0000 7fe70dd9b700 1 -- 172.21.15.80:0/1181171432 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe704000960 con 0x7fe71006c490 2019-11-28T11:32:51.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.688+0000 7fe714b7a700 1 -- 172.21.15.80:0/1181171432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe71006c490 msgr2=0x7fe71006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:51.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.688+0000 7fe714b7a700 1 --2- 172.21.15.80:0/1181171432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe71006c490 0x7fe71006c920 secure :-1 s=READY pgs=858 cs=0 l=1 rx=0x7fe70400f6c0 tx=0x7fe70400fa60).stop 2019-11-28T11:32:51.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.688+0000 7fe714b7a700 1 -- 172.21.15.80:0/1181171432 shutdown_connections 2019-11-28T11:32:51.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.688+0000 7fe714b7a700 1 --2- 172.21.15.80:0/1181171432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe71006ce60 0x7fe710164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:51.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.688+0000 7fe714b7a700 1 --2- 172.21.15.80:0/1181171432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe71006c490 0x7fe71006c920 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:51.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.689+0000 7fe714b7a700 1 -- 172.21.15.80:0/1181171432 shutdown_connections 2019-11-28T11:32:51.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.689+0000 7fe714b7a700 1 -- 172.21.15.80:0/1181171432 wait complete. 2019-11-28T11:32:51.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.689+0000 7fe714b7a700 1 -- 172.21.15.80:0/1181171432 >> 172.21.15.80:0/1181171432 conn(0x7fe710061cf0 msgr2=0x7fe710064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:51.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.691+0000 7fe714b7a700 1 Processor -- start 2019-11-28T11:32:51.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.691+0000 7fe714b7a700 1 -- start start 2019-11-28T11:32:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe714b7a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710128e40 0x7fe710168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe714b7a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe710139a60 con 0x7fe71013a780 2019-11-28T11:32:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe714b7a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71013b060 con 0x7fe7101281b0 2019-11-28T11:32:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe714b7a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71012a260 con 0x7fe710128e40 2019-11-28T11:32:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe70ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe71013a780 0x7fe71012d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34656/0 (socket says 172.21.15.80:34656) 2019-11-28T11:32:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe70ed9d700 1 -- 172.21.15.80:0/332197533 learned_addr learned my addr 172.21.15.80:0/332197533 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe70f59e700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710128e40 0x7fe710168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe6ff7fe700 1 -- 172.21.15.80:0/332197533 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217223675 0 0) 0x7fe700001170 con 0x7fe71013a780 2019-11-28T11:32:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe6ff7fe700 1 -- 172.21.15.80:0/332197533 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f4002e80 con 0x7fe71013a780 2019-11-28T11:32:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe6ff7fe700 1 -- 172.21.15.80:0/332197533 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799533542 0 0) 0x7fe704007900 con 0x7fe7101281b0 2019-11-28T11:32:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe6ff7fe700 1 -- 172.21.15.80:0/332197533 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f40030b0 con 0x7fe7101281b0 2019-11-28T11:32:51.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe70f59e700 1 -- 172.21.15.80:0/332197533 >> v1:172.21.15.174:6789/0 conn(0x7fe7101281b0 legacy=0x7fe710128640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:51.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe70f59e700 1 -- 172.21.15.80:0/332197533 >> v1:172.21.15.80:6789/0 conn(0x7fe71013a780 legacy=0x7fe71012d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe70f59e700 1 -- 172.21.15.80:0/332197533 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71012abc0 con 0x7fe710128e40 2019-11-28T11:32:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe70f59e700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710128e40 0x7fe710168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe708010710 tx=0x7fe708010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe70f59e700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710128e40 0x7fe710168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe708010710 tx=0x7fe708010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.692+0000 7fe70f59e700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710128e40 0x7fe710168d80 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7fe708010710 tx=0x7fe708010ab0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.693+0000 7fe70f59e700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710128e40 0x7fe710168d80 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fe708010710 tx=0x7fe708010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.693+0000 7fe6ff7fe700 1 -- 172.21.15.80:0/332197533 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe708000e90 con 0x7fe710128e40 2019-11-28T11:32:51.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.693+0000 7fe70f59e700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710128e40 0x7fe710168d80 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fe708010710 tx=0x7fe708010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.693+0000 7fe714b7a700 1 -- 172.21.15.80:0/332197533 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71012af40 con 0x7fe710128e40 2019-11-28T11:32:51.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.693+0000 7fe6ff7fe700 1 -- 172.21.15.80:0/332197533 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe708000e70 con 0x7fe710128e40 2019-11-28T11:32:51.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.693+0000 7fe70f59e700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710128e40 0x7fe710168d80 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fe708010710 tx=0x7fe708010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.693+0000 7fe6ff7fe700 1 -- 172.21.15.80:0/332197533 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe70800f590 con 0x7fe710128e40 2019-11-28T11:32:51.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.693+0000 7fe714b7a700 1 -- 172.21.15.80:0/332197533 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71012abc0 con 0x7fe710128e40 2019-11-28T11:32:51.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.693+0000 7fe70f59e700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710128e40 0x7fe710168d80 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fe708010710 tx=0x7fe708010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.693+0000 7fe6ff7fe700 1 -- 172.21.15.80:0/332197533 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe70800f110 con 0x7fe710128e40 2019-11-28T11:32:51.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.693+0000 7fe70f59e700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710128e40 0x7fe710168d80 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fe708010710 tx=0x7fe708010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.694+0000 7fe6ff7fe700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe6f4018750 0x7fe6f401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:51.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.694+0000 7fe6ff7fe700 1 -- 172.21.15.80:0/332197533 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fe708031dd0 con 0x7fe710128e40 2019-11-28T11:32:51.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.694+0000 7fe70ed9d700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe6f4018750 0x7fe6f401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:51.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.694+0000 7fe70ed9d700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe6f4018750 0x7fe6f401abe0 crc :-1 s=READY pgs=354 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:51.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.701+0000 7fe714b7a700 1 -- 172.21.15.80:0/332197533 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71012af40 con 0x7fe710128e40 2019-11-28T11:32:51.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.705+0000 7fe70f59e700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710128e40 0x7fe710168d80 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fe708010710 tx=0x7fe708010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:51.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.705+0000 7fe6ff7fe700 1 -- 172.21.15.80:0/332197533 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe70800eeb0 con 0x7fe710128e40 2019-11-28T11:32:51.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:51.881+0000 7fe714b7a700 1 -- 172.21.15.80:0/332197533 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe71012abc0 con 0x7fe710128e40 2019-11-28T11:32:52.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.596+0000 7fe70f59e700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710128e40 0x7fe710168d80 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fe708010710 tx=0x7fe708010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:52.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.596+0000 7fe6ff7fe700 1 -- 172.21.15.80:0/332197533 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe70800f0c0 con 0x7fe710128e40 2019-11-28T11:32:52.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.649+0000 7fe714b7a700 1 -- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe6f4018750 msgr2=0x7fe6f401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:52.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.649+0000 7fe714b7a700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe6f4018750 0x7fe6f401abe0 crc :-1 s=READY pgs=354 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:52.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.649+0000 7fe714b7a700 1 -- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710128e40 msgr2=0x7fe710168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:52.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.649+0000 7fe714b7a700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710128e40 0x7fe710168d80 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7fe708010710 tx=0x7fe708010ab0).stop 2019-11-28T11:32:52.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.649+0000 7fe714b7a700 1 -- 172.21.15.80:0/332197533 shutdown_connections 2019-11-28T11:32:52.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.649+0000 7fe714b7a700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710128e40 0x7fe710168d80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:52.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.649+0000 7fe714b7a700 1 --2- 172.21.15.80:0/332197533 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe6f4018750 0x7fe6f401abe0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:52.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.649+0000 7fe714b7a700 1 -- 172.21.15.80:0/332197533 shutdown_connections 2019-11-28T11:32:52.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.649+0000 7fe714b7a700 1 -- 172.21.15.80:0/332197533 wait complete. 2019-11-28T11:32:52.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.649+0000 7fe714b7a700 1 -- 172.21.15.80:0/332197533 >> 172.21.15.80:0/332197533 conn(0x7fe710127dc0 msgr2=0x7fe710141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:52.702 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:32:52.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.781+0000 7f9a5f22e700 1 Processor -- start 2019-11-28T11:32:52.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.782+0000 7f9a5f22e700 1 -- start start 2019-11-28T11:32:52.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5f22e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a581639f0 0x7f9a58165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:52.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5f22e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5806db60 con 0x7f9a5815f100 2019-11-28T11:32:52.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5f22e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5806e060 con 0x7f9a5815ed10 2019-11-28T11:32:52.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5f22e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5806fe00 con 0x7f9a581639f0 2019-11-28T11:32:52.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5dfcc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a581639f0 0x7f9a58165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:52.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5dfcc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a581639f0 0x7f9a58165df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35352/0 (socket says 172.21.15.80:35352) 2019-11-28T11:32:52.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5cfca700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9a5815f100 0x7f9a5806bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34664/0 (socket says 172.21.15.80:34664) 2019-11-28T11:32:52.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5dfcc700 1 -- 172.21.15.80:0/2390714495 learned_addr learned my addr 172.21.15.80:0/2390714495 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:52.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5dfcc700 1 -- 172.21.15.80:0/2390714495 >> v1:172.21.15.174:6789/0 conn(0x7f9a5815ed10 legacy=0x7f9a58073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:52.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5dfcc700 1 -- 172.21.15.80:0/2390714495 >> v1:172.21.15.80:6789/0 conn(0x7f9a5815f100 legacy=0x7f9a5806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:52.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5dfcc700 1 -- 172.21.15.80:0/2390714495 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a58070760 con 0x7f9a581639f0 2019-11-28T11:32:52.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2390714495 >> v2:172.21.15.80:3300/0 conn(0x7f9a581639f0 0x7f9a58165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9a4800f730 tx=0x7f9a4800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:52.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2390714495 >> v2:172.21.15.80:3300/0 conn(0x7f9a581639f0 0x7f9a58165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9a4800f730 tx=0x7f9a4800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:52.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2390714495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a581639f0 0x7f9a58165df0 secure :-1 s=READY pgs=861 cs=0 l=1 rx=0x7f9a4800f730 tx=0x7f9a4800fad0).ready entity=mon.0 client_cookie=3fac7e14ac61f5af server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:52.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2390714495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a581639f0 0x7f9a58165df0 secure :-1 s=THROTTLE_DONE pgs=861 cs=0 l=1 rx=0x7f9a4800f730 tx=0x7f9a4800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:52.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a57fff700 1 -- 172.21.15.80:0/2390714495 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a480010e0 con 0x7f9a581639f0 2019-11-28T11:32:52.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2390714495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a581639f0 0x7f9a58165df0 secure :-1 s=THROTTLE_DONE pgs=861 cs=0 l=1 rx=0x7f9a4800f730 tx=0x7f9a4800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:52.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2390714495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a581639f0 0x7f9a58165df0 secure :-1 s=THROTTLE_DONE pgs=861 cs=0 l=1 rx=0x7f9a4800f730 tx=0x7f9a4800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:52.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a57fff700 1 -- 172.21.15.80:0/2390714495 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a48000a70 con 0x7f9a581639f0 2019-11-28T11:32:52.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a57fff700 1 -- 172.21.15.80:0/2390714495 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a480016c0 con 0x7f9a581639f0 2019-11-28T11:32:52.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5f22e700 1 -- 172.21.15.80:0/2390714495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a581639f0 msgr2=0x7f9a58165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:52.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.783+0000 7f9a5f22e700 1 --2- 172.21.15.80:0/2390714495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a581639f0 0x7f9a58165df0 secure :-1 s=READY pgs=861 cs=0 l=1 rx=0x7f9a4800f730 tx=0x7f9a4800fad0).stop 2019-11-28T11:32:52.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.784+0000 7f9a5f22e700 1 -- 172.21.15.80:0/2390714495 shutdown_connections 2019-11-28T11:32:52.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.784+0000 7f9a5f22e700 1 --2- 172.21.15.80:0/2390714495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a581639f0 0x7f9a58165df0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.784+0000 7f9a5f22e700 1 -- 172.21.15.80:0/2390714495 shutdown_connections 2019-11-28T11:32:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.784+0000 7f9a5f22e700 1 -- 172.21.15.80:0/2390714495 wait complete. 2019-11-28T11:32:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.784+0000 7f9a5f22e700 1 -- 172.21.15.80:0/2390714495 >> 172.21.15.80:0/2390714495 conn(0x7f9a58061d20 msgr2=0x7f9a580641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.787+0000 7f9a5f22e700 1 Processor -- start 2019-11-28T11:32:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.787+0000 7f9a5f22e700 1 -- start start 2019-11-28T11:32:52.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5f22e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9a581320b0 0x7f9a58132570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:52.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5f22e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5807c080 con 0x7f9a5812aa90 2019-11-28T11:32:52.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5f22e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a58078560 con 0x7f9a5812ae80 2019-11-28T11:32:52.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5f22e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5807a2c0 con 0x7f9a581320b0 2019-11-28T11:32:52.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5d7cb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9a5812aa90 0x7f9a580741e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34670/0 (socket says 172.21.15.80:34670) 2019-11-28T11:32:52.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5d7cb700 1 -- 172.21.15.80:0/2156063260 learned_addr learned my addr 172.21.15.80:0/2156063260 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:52.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2156063260 >> v2:172.21.15.174:3300/0 conn(0x7f9a581320b0 0x7f9a58132570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:52.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a55ffb700 1 -- 172.21.15.80:0/2156063260 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668628476 0 0) 0x7f9a500014d0 con 0x7f9a5812aa90 2019-11-28T11:32:52.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a55ffb700 1 -- 172.21.15.80:0/2156063260 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a38002e80 con 0x7f9a5812aa90 2019-11-28T11:32:52.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a55ffb700 1 -- 172.21.15.80:0/2156063260 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590712643 0 0) 0x7f9a4c001100 con 0x7f9a5812ae80 2019-11-28T11:32:52.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5dfcc700 1 -- 172.21.15.80:0/2156063260 >> v1:172.21.15.174:6789/0 conn(0x7f9a5812ae80 legacy=0x7f9a5812d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:52.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5dfcc700 1 -- 172.21.15.80:0/2156063260 >> v1:172.21.15.80:6789/0 conn(0x7f9a5812aa90 legacy=0x7f9a580741e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:52.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5dfcc700 1 -- 172.21.15.80:0/2156063260 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5807ac20 con 0x7f9a581320b0 2019-11-28T11:32:52.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2156063260 >> v2:172.21.15.174:3300/0 conn(0x7f9a581320b0 0x7f9a58132570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a480009c0 tx=0x7f9a48010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:52.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2156063260 >> v2:172.21.15.174:3300/0 conn(0x7f9a581320b0 0x7f9a58132570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a480009c0 tx=0x7f9a48010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:52.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a581320b0 0x7f9a58132570 secure :-1 s=READY pgs=511 cs=0 l=1 rx=0x7f9a480009c0 tx=0x7f9a48010770).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:52.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a581320b0 0x7f9a58132570 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f9a480009c0 tx=0x7f9a48010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a55ffb700 1 -- 172.21.15.80:0/2156063260 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a48007ae0 con 0x7f9a581320b0 2019-11-28T11:32:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a581320b0 0x7f9a58132570 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f9a480009c0 tx=0x7f9a48010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a581320b0 0x7f9a58132570 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f9a480009c0 tx=0x7f9a48010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a55ffb700 1 -- 172.21.15.80:0/2156063260 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a480012b0 con 0x7f9a581320b0 2019-11-28T11:32:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a5f22e700 1 -- 172.21.15.80:0/2156063260 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5807afa0 con 0x7f9a581320b0 2019-11-28T11:32:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.788+0000 7f9a55ffb700 1 -- 172.21.15.80:0/2156063260 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a480014a0 con 0x7f9a581320b0 2019-11-28T11:32:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.789+0000 7f9a5f22e700 1 -- 172.21.15.80:0/2156063260 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5807ac20 con 0x7f9a581320b0 2019-11-28T11:32:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.789+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a581320b0 0x7f9a58132570 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f9a480009c0 tx=0x7f9a48010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.789+0000 7f9a55ffb700 1 -- 172.21.15.80:0/2156063260 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9a48000eb0 con 0x7f9a581320b0 2019-11-28T11:32:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.789+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a581320b0 0x7f9a58132570 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f9a480009c0 tx=0x7f9a48010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.789+0000 7f9a55ffb700 1 --2- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a38018780 0x7f9a3801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.789+0000 7f9a55ffb700 1 -- 172.21.15.80:0/2156063260 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f9a48031a40 con 0x7f9a581320b0 2019-11-28T11:32:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.789+0000 7f9a5d7cb700 1 --2- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a38018780 0x7f9a3801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:52.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.790+0000 7f9a5d7cb700 1 --2- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a38018780 0x7f9a3801abf0 crc :-1 s=READY pgs=355 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:52.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.797+0000 7f9a5f22e700 1 -- 172.21.15.80:0/2156063260 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5807afa0 con 0x7f9a581320b0 2019-11-28T11:32:52.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.800+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a581320b0 0x7f9a58132570 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f9a480009c0 tx=0x7f9a48010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:52.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.800+0000 7f9a55ffb700 1 -- 172.21.15.80:0/2156063260 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9a480173e0 con 0x7f9a581320b0 2019-11-28T11:32:53.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:52.970+0000 7f9a5f22e700 1 -- 172.21.15.80:0/2156063260 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9a5807ac20 con 0x7f9a581320b0 2019-11-28T11:32:53.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.600+0000 7f9a5dfcc700 1 --2- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a581320b0 0x7f9a58132570 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f9a480009c0 tx=0x7f9a48010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:53.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.601+0000 7f9a55ffb700 1 -- 172.21.15.80:0/2156063260 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v72) v1 ==== 185+0+0 (secure 0 0 0) 0x7f9a480173e0 con 0x7f9a581320b0 2019-11-28T11:32:53.678 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:32:53.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.637+0000 7f9a5f22e700 1 -- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a38018780 msgr2=0x7f9a3801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:53.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.637+0000 7f9a5f22e700 1 --2- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a38018780 0x7f9a3801abf0 crc :-1 s=READY pgs=355 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:53.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.637+0000 7f9a5f22e700 1 -- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a581320b0 msgr2=0x7f9a58132570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:53.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.637+0000 7f9a5f22e700 1 --2- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a581320b0 0x7f9a58132570 secure :-1 s=READY pgs=511 cs=0 l=1 rx=0x7f9a480009c0 tx=0x7f9a48010770).stop 2019-11-28T11:32:53.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.637+0000 7f9a5f22e700 1 -- 172.21.15.80:0/2156063260 shutdown_connections 2019-11-28T11:32:53.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.637+0000 7f9a5f22e700 1 --2- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a581320b0 0x7f9a58132570 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:53.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.637+0000 7f9a5f22e700 1 --2- 172.21.15.80:0/2156063260 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a38018780 0x7f9a3801abf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:53.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.637+0000 7f9a5f22e700 1 -- 172.21.15.80:0/2156063260 shutdown_connections 2019-11-28T11:32:53.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.637+0000 7f9a5f22e700 1 -- 172.21.15.80:0/2156063260 wait complete. 2019-11-28T11:32:53.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.637+0000 7f9a5f22e700 1 -- 172.21.15.80:0/2156063260 >> 172.21.15.80:0/2156063260 conn(0x7f9a58147670 msgr2=0x7f9a581641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:53.691 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:32:53.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.770+0000 7fc01e42a700 1 Processor -- start 2019-11-28T11:32:53.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.770+0000 7fc01e42a700 1 -- start start 2019-11-28T11:32:53.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.771+0000 7fc01e42a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc01815ed10 0x7fc01815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:53.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.771+0000 7fc01e42a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01806db60 con 0x7fc018073020 2019-11-28T11:32:53.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.771+0000 7fc01e42a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01806e060 con 0x7fc0180734b0 2019-11-28T11:32:53.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.771+0000 7fc01e42a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01806fe00 con 0x7fc01815ed10 2019-11-28T11:32:53.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.771+0000 7fc017fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc018073020 0x7fc018071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34678/0 (socket says 172.21.15.80:34678) 2019-11-28T11:32:53.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.771+0000 7fc017fff700 1 -- 172.21.15.80:0/1283536390 learned_addr learned my addr 172.21.15.80:0/1283536390 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:53.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/1283536390 >> v2:172.21.15.174:3300/0 conn(0x7fc01815ed10 0x7fc01815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:53.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc0177fe700 1 -- 172.21.15.80:0/1283536390 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196215380 0 0) 0x7fc0080014d0 con 0x7fc018073020 2019-11-28T11:32:53.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc0177fe700 1 -- 172.21.15.80:0/1283536390 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc004002e80 con 0x7fc018073020 2019-11-28T11:32:53.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc0177fe700 1 -- 172.21.15.80:0/1283536390 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659201332 0 0) 0x7fc0100009b0 con 0x7fc0180734b0 2019-11-28T11:32:53.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc0177fe700 1 -- 172.21.15.80:0/1283536390 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0040030b0 con 0x7fc0180734b0 2019-11-28T11:32:53.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc0177fe700 1 -- 172.21.15.80:0/1283536390 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 22756081 0 0) 0x7fc0080014b0 con 0x7fc018073020 2019-11-28T11:32:53.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc01c9c7700 1 -- 172.21.15.80:0/1283536390 >> v1:172.21.15.174:6789/0 conn(0x7fc0180734b0 legacy=0x7fc0180726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:53.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc01c9c7700 1 -- 172.21.15.80:0/1283536390 >> v1:172.21.15.80:6789/0 conn(0x7fc018073020 legacy=0x7fc018071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:53.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc01c9c7700 1 -- 172.21.15.80:0/1283536390 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc018070760 con 0x7fc01815ed10 2019-11-28T11:32:53.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/1283536390 >> v2:172.21.15.174:3300/0 conn(0x7fc01815ed10 0x7fc01815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc00000af50 tx=0x7fc00000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:53.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/1283536390 >> v2:172.21.15.174:3300/0 conn(0x7fc01815ed10 0x7fc01815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc00000af50 tx=0x7fc00000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:53.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/1283536390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01815ed10 0x7fc01815f100 secure :-1 s=READY pgs=513 cs=0 l=1 rx=0x7fc00000af50 tx=0x7fc00000b760).ready entity=mon.1 client_cookie=f0e9437900f8353a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:53.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/1283536390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01815ed10 0x7fc01815f100 secure :-1 s=THROTTLE_DONE pgs=513 cs=0 l=1 rx=0x7fc00000af50 tx=0x7fc00000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:53.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc0177fe700 1 -- 172.21.15.80:0/1283536390 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc000000960 con 0x7fc01815ed10 2019-11-28T11:32:53.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/1283536390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01815ed10 0x7fc01815f100 secure :-1 s=THROTTLE_DONE pgs=513 cs=0 l=1 rx=0x7fc00000af50 tx=0x7fc00000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:53.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/1283536390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01815ed10 0x7fc01815f100 secure :-1 s=THROTTLE_DONE pgs=513 cs=0 l=1 rx=0x7fc00000af50 tx=0x7fc00000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:53.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc0177fe700 1 -- 172.21.15.80:0/1283536390 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc000009860 con 0x7fc01815ed10 2019-11-28T11:32:53.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc0177fe700 1 -- 172.21.15.80:0/1283536390 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc000000960 con 0x7fc01815ed10 2019-11-28T11:32:53.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc01e42a700 1 -- 172.21.15.80:0/1283536390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01815ed10 msgr2=0x7fc01815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:53.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.772+0000 7fc01e42a700 1 --2- 172.21.15.80:0/1283536390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01815ed10 0x7fc01815f100 secure :-1 s=READY pgs=513 cs=0 l=1 rx=0x7fc00000af50 tx=0x7fc00000b760).stop 2019-11-28T11:32:53.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.773+0000 7fc01e42a700 1 -- 172.21.15.80:0/1283536390 shutdown_connections 2019-11-28T11:32:53.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.773+0000 7fc01e42a700 1 --2- 172.21.15.80:0/1283536390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01815ed10 0x7fc01815f100 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:53.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.773+0000 7fc01e42a700 1 -- 172.21.15.80:0/1283536390 shutdown_connections 2019-11-28T11:32:53.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.773+0000 7fc01e42a700 1 -- 172.21.15.80:0/1283536390 wait complete. 2019-11-28T11:32:53.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.773+0000 7fc01e42a700 1 -- 172.21.15.80:0/1283536390 >> 172.21.15.80:0/1283536390 conn(0x7fc018061d20 msgr2=0x7fc0180641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:53.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.775+0000 7fc01e42a700 1 Processor -- start 2019-11-28T11:32:53.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.776+0000 7fc01e42a700 1 -- start start 2019-11-28T11:32:53.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.776+0000 7fc01e42a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc018148320 0x7fc01810ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:53.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01e42a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc018148e00 con 0x7fc01810e3d0 2019-11-28T11:32:53.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01e42a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc018108b10 con 0x7fc01810f290 2019-11-28T11:32:53.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01e42a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01813aa20 con 0x7fc018148320 2019-11-28T11:32:53.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01d1c8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc01810e3d0 0x7fc018168d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34686/0 (socket says 172.21.15.80:34686) 2019-11-28T11:32:53.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01d1c8700 1 -- 172.21.15.80:0/3053045731 learned_addr learned my addr 172.21.15.80:0/3053045731 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:53.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/3053045731 >> v2:172.21.15.174:3300/0 conn(0x7fc018148320 0x7fc01810ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:53.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc0157fa700 1 -- 172.21.15.80:0/3053045731 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554703951 0 0) 0x7fc0100010b0 con 0x7fc01810e3d0 2019-11-28T11:32:53.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc0157fa700 1 -- 172.21.15.80:0/3053045731 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbffc002e80 con 0x7fc01810e3d0 2019-11-28T11:32:53.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc0157fa700 1 -- 172.21.15.80:0/3053045731 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788725085 0 0) 0x7fc0080012c0 con 0x7fc01810f290 2019-11-28T11:32:53.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01c9c7700 1 -- 172.21.15.80:0/3053045731 >> v1:172.21.15.174:6789/0 conn(0x7fc01810f290 legacy=0x7fc01810dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:53.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01c9c7700 1 -- 172.21.15.80:0/3053045731 >> v1:172.21.15.80:6789/0 conn(0x7fc01810e3d0 legacy=0x7fc018168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:53.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01c9c7700 1 -- 172.21.15.80:0/3053045731 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01810c490 con 0x7fc018148320 2019-11-28T11:32:53.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/3053045731 >> v2:172.21.15.174:3300/0 conn(0x7fc018148320 0x7fc01810ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc0000103c0 tx=0x7fc000010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:53.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/3053045731 >> v2:172.21.15.174:3300/0 conn(0x7fc018148320 0x7fc01810ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc0000103c0 tx=0x7fc000010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:53.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc018148320 0x7fc01810ed50 secure :-1 s=READY pgs=515 cs=0 l=1 rx=0x7fc0000103c0 tx=0x7fc000010760).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:53.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc018148320 0x7fc01810ed50 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7fc0000103c0 tx=0x7fc000010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:53.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc0157fa700 1 -- 172.21.15.80:0/3053045731 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc000000940 con 0x7fc018148320 2019-11-28T11:32:53.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc018148320 0x7fc01810ed50 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7fc0000103c0 tx=0x7fc000010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:53.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc018148320 0x7fc01810ed50 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7fc0000103c0 tx=0x7fc000010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:53.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc0157fa700 1 -- 172.21.15.80:0/3053045731 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc000009980 con 0x7fc018148320 2019-11-28T11:32:53.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc0157fa700 1 -- 172.21.15.80:0/3053045731 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc00000a0d0 con 0x7fc018148320 2019-11-28T11:32:53.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01e42a700 1 -- 172.21.15.80:0/3053045731 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01810c810 con 0x7fc018148320 2019-11-28T11:32:53.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.777+0000 7fc01e42a700 1 -- 172.21.15.80:0/3053045731 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01810c490 con 0x7fc018148320 2019-11-28T11:32:53.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.778+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc018148320 0x7fc01810ed50 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7fc0000103c0 tx=0x7fc000010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:53.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.778+0000 7fc0157fa700 1 -- 172.21.15.80:0/3053045731 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc000009b70 con 0x7fc018148320 2019-11-28T11:32:53.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.778+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc018148320 0x7fc01810ed50 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7fc0000103c0 tx=0x7fc000010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:53.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.778+0000 7fc0157fa700 1 --2- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbffc018780 0x7fbffc01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:53.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.778+0000 7fc0157fa700 1 -- 172.21.15.80:0/3053045731 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5711+0+0 (secure 0 0 0) 0x7fc000031a90 con 0x7fc018148320 2019-11-28T11:32:53.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.778+0000 7fc017fff700 1 --2- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbffc018780 0x7fbffc01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:53.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.779+0000 7fc017fff700 1 --2- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbffc018780 0x7fbffc01abf0 crc :-1 s=READY pgs=356 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:53.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.786+0000 7fc01e42a700 1 -- 172.21.15.80:0/3053045731 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01810c810 con 0x7fc018148320 2019-11-28T11:32:53.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.789+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc018148320 0x7fc01810ed50 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7fc0000103c0 tx=0x7fc000010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:53.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.789+0000 7fc0157fa700 1 -- 172.21.15.80:0/3053045731 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc000009d80 con 0x7fc018148320 2019-11-28T11:32:54.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:53.957+0000 7fc01e42a700 1 -- 172.21.15.80:0/3053045731 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc01810c490 con 0x7fc018148320 2019-11-28T11:32:54.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.607+0000 7fc01c9c7700 1 --2- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc018148320 0x7fc01810ed50 secure :-1 s=THROTTLE_DONE pgs=515 cs=0 l=1 rx=0x7fc0000103c0 tx=0x7fc000010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:54.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.607+0000 7fc0157fa700 1 -- 172.21.15.80:0/3053045731 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v73) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc000009b70 con 0x7fc018148320 2019-11-28T11:32:54.665 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:32:54.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.624+0000 7fc01e42a700 1 -- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbffc018780 msgr2=0x7fbffc01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:54.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.624+0000 7fc01e42a700 1 --2- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbffc018780 0x7fbffc01abf0 crc :-1 s=READY pgs=356 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:54.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.624+0000 7fc01e42a700 1 -- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc018148320 msgr2=0x7fc01810ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:54.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.624+0000 7fc01e42a700 1 --2- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc018148320 0x7fc01810ed50 secure :-1 s=READY pgs=515 cs=0 l=1 rx=0x7fc0000103c0 tx=0x7fc000010760).stop 2019-11-28T11:32:54.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.624+0000 7fc01e42a700 1 -- 172.21.15.80:0/3053045731 shutdown_connections 2019-11-28T11:32:54.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.624+0000 7fc01e42a700 1 --2- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbffc018780 0x7fbffc01abf0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:54.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.624+0000 7fc01e42a700 1 --2- 172.21.15.80:0/3053045731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc018148320 0x7fc01810ed50 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:54.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.624+0000 7fc01e42a700 1 -- 172.21.15.80:0/3053045731 shutdown_connections 2019-11-28T11:32:54.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.624+0000 7fc01e42a700 1 -- 172.21.15.80:0/3053045731 wait complete. 2019-11-28T11:32:54.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.624+0000 7fc01e42a700 1 -- 172.21.15.80:0/3053045731 >> 172.21.15.80:0/3053045731 conn(0x7fc01815e2d0 msgr2=0x7fc018147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:54.678 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:32:54.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.759+0000 7fae991b9700 1 Processor -- start 2019-11-28T11:32:54.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.759+0000 7fae991b9700 1 -- start start 2019-11-28T11:32:54.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.760+0000 7fae991b9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae9406c490 0x7fae9406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:54.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.760+0000 7fae991b9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9406db00 con 0x7fae9406ce60 2019-11-28T11:32:54.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.760+0000 7fae991b9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9406e000 con 0x7fae9406c0a0 2019-11-28T11:32:54.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.760+0000 7fae991b9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9406fd60 con 0x7fae9406c490 2019-11-28T11:32:54.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.760+0000 7fae989b8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fae9406ce60 0x7fae94164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34692/0 (socket says 172.21.15.80:34692) 2019-11-28T11:32:54.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.760+0000 7fae989b8700 1 -- 172.21.15.80:0/43749489 learned_addr learned my addr 172.21.15.80:0/43749489 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:54.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.760+0000 7fae92d9d700 1 --2- 172.21.15.80:0/43749489 >> v2:172.21.15.174:3300/0 conn(0x7fae9406c490 0x7fae9406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:54.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.760+0000 7fae9259c700 1 -- 172.21.15.80:0/43749489 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941924149 0 0) 0x7fae8c0014d0 con 0x7fae9406ce60 2019-11-28T11:32:54.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.760+0000 7fae9259c700 1 -- 172.21.15.80:0/43749489 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae74002e80 con 0x7fae9406ce60 2019-11-28T11:32:54.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.760+0000 7fae92d9d700 1 -- 172.21.15.80:0/43749489 >> v1:172.21.15.174:6789/0 conn(0x7fae9406c0a0 legacy=0x7fae94072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:54.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.760+0000 7fae9259c700 1 -- 172.21.15.80:0/43749489 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2857113557 0 0) 0x7fae8c0014b0 con 0x7fae9406ce60 2019-11-28T11:32:54.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.760+0000 7fae92d9d700 1 -- 172.21.15.80:0/43749489 >> v1:172.21.15.80:6789/0 conn(0x7fae9406ce60 legacy=0x7fae94164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:54.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.760+0000 7fae92d9d700 1 -- 172.21.15.80:0/43749489 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae940706c0 con 0x7fae9406c490 2019-11-28T11:32:54.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.760+0000 7fae92d9d700 1 --2- 172.21.15.80:0/43749489 >> v2:172.21.15.174:3300/0 conn(0x7fae9406c490 0x7fae9406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae7c00af50 tx=0x7fae7c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:54.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.760+0000 7fae92d9d700 1 --2- 172.21.15.80:0/43749489 >> v2:172.21.15.174:3300/0 conn(0x7fae9406c490 0x7fae9406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae7c00af50 tx=0x7fae7c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:54.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.760+0000 7fae92d9d700 1 --2- 172.21.15.80:0/43749489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae9406c490 0x7fae9406c920 secure :-1 s=READY pgs=517 cs=0 l=1 rx=0x7fae7c00af50 tx=0x7fae7c00b760).ready entity=mon.1 client_cookie=f29deab970c6911f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:54.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.761+0000 7fae92d9d700 1 --2- 172.21.15.80:0/43749489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae9406c490 0x7fae9406c920 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7fae7c00af50 tx=0x7fae7c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:54.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.761+0000 7fae9259c700 1 -- 172.21.15.80:0/43749489 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae7c000960 con 0x7fae9406c490 2019-11-28T11:32:54.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.761+0000 7fae92d9d700 1 --2- 172.21.15.80:0/43749489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae9406c490 0x7fae9406c920 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7fae7c00af50 tx=0x7fae7c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:54.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.761+0000 7fae92d9d700 1 --2- 172.21.15.80:0/43749489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae9406c490 0x7fae9406c920 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7fae7c00af50 tx=0x7fae7c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:54.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.761+0000 7fae9259c700 1 -- 172.21.15.80:0/43749489 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c009860 con 0x7fae9406c490 2019-11-28T11:32:54.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.761+0000 7fae9259c700 1 -- 172.21.15.80:0/43749489 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae7c000960 con 0x7fae9406c490 2019-11-28T11:32:54.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.761+0000 7fae991b9700 1 -- 172.21.15.80:0/43749489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae9406c490 msgr2=0x7fae9406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:54.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.761+0000 7fae991b9700 1 --2- 172.21.15.80:0/43749489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae9406c490 0x7fae9406c920 secure :-1 s=READY pgs=517 cs=0 l=1 rx=0x7fae7c00af50 tx=0x7fae7c00b760).stop 2019-11-28T11:32:54.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.761+0000 7fae991b9700 1 -- 172.21.15.80:0/43749489 shutdown_connections 2019-11-28T11:32:54.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.761+0000 7fae991b9700 1 --2- 172.21.15.80:0/43749489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae9406c490 0x7fae9406c920 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:54.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.761+0000 7fae991b9700 1 -- 172.21.15.80:0/43749489 shutdown_connections 2019-11-28T11:32:54.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.761+0000 7fae991b9700 1 -- 172.21.15.80:0/43749489 wait complete. 2019-11-28T11:32:54.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.761+0000 7fae991b9700 1 -- 172.21.15.80:0/43749489 >> 172.21.15.80:0/43749489 conn(0x7fae94061cf0 msgr2=0x7fae94064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:54.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.764+0000 7fae991b9700 1 Processor -- start 2019-11-28T11:32:54.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.764+0000 7fae991b9700 1 -- start start 2019-11-28T11:32:54.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae991b9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae941145b0 0x7fae94114a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:54.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae991b9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9413fc50 con 0x7fae9413f580 2019-11-28T11:32:54.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae991b9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae94122ef0 con 0x7fae94114f80 2019-11-28T11:32:54.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae991b9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae94112550 con 0x7fae941145b0 2019-11-28T11:32:54.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae9359e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fae9413f580 0x7fae94115730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34696/0 (socket says 172.21.15.80:34696) 2019-11-28T11:32:54.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae9359e700 1 -- 172.21.15.80:0/4147360366 learned_addr learned my addr 172.21.15.80:0/4147360366 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:54.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae92d9d700 1 --2- 172.21.15.80:0/4147360366 >> v2:172.21.15.174:3300/0 conn(0x7fae941145b0 0x7fae94114a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:54.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae8bfff700 1 -- 172.21.15.80:0/4147360366 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091996431 0 0) 0x7fae84000b40 con 0x7fae9413f580 2019-11-28T11:32:54.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae8bfff700 1 -- 172.21.15.80:0/4147360366 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae6c002e80 con 0x7fae9413f580 2019-11-28T11:32:54.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae8bfff700 1 -- 172.21.15.80:0/4147360366 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097765109 0 0) 0x7fae8c000d30 con 0x7fae94114f80 2019-11-28T11:32:54.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae8bfff700 1 -- 172.21.15.80:0/4147360366 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae6c0030b0 con 0x7fae94114f80 2019-11-28T11:32:54.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae92d9d700 1 -- 172.21.15.80:0/4147360366 >> v1:172.21.15.174:6789/0 conn(0x7fae94114f80 legacy=0x7fae94168a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:54.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae92d9d700 1 -- 172.21.15.80:0/4147360366 >> v1:172.21.15.80:6789/0 conn(0x7fae9413f580 legacy=0x7fae94115730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:54.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae8bfff700 1 -- 172.21.15.80:0/4147360366 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3524350588 0 0) 0x7fae84001200 con 0x7fae9413f580 2019-11-28T11:32:54.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae92d9d700 1 -- 172.21.15.80:0/4147360366 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae94115400 con 0x7fae941145b0 2019-11-28T11:32:54.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae92d9d700 1 --2- 172.21.15.80:0/4147360366 >> v2:172.21.15.174:3300/0 conn(0x7fae941145b0 0x7fae94114a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae7c0103d0 tx=0x7fae7c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:54.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae92d9d700 1 --2- 172.21.15.80:0/4147360366 >> v2:172.21.15.174:3300/0 conn(0x7fae941145b0 0x7fae94114a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae7c0103d0 tx=0x7fae7c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:54.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.765+0000 7fae92d9d700 1 --2- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae941145b0 0x7fae94114a40 secure :-1 s=READY pgs=519 cs=0 l=1 rx=0x7fae7c0103d0 tx=0x7fae7c010770).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:54.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.766+0000 7fae92d9d700 1 --2- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae941145b0 0x7fae94114a40 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7fae7c0103d0 tx=0x7fae7c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:54.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.766+0000 7fae8bfff700 1 -- 172.21.15.80:0/4147360366 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae7c000940 con 0x7fae941145b0 2019-11-28T11:32:54.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.766+0000 7fae92d9d700 1 --2- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae941145b0 0x7fae94114a40 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7fae7c0103d0 tx=0x7fae7c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:54.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.766+0000 7fae8bfff700 1 -- 172.21.15.80:0/4147360366 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c000940 con 0x7fae941145b0 2019-11-28T11:32:54.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.766+0000 7fae991b9700 1 -- 172.21.15.80:0/4147360366 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae94115400 con 0x7fae941145b0 2019-11-28T11:32:54.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.766+0000 7fae92d9d700 1 --2- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae941145b0 0x7fae94114a40 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7fae7c0103d0 tx=0x7fae7c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:54.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.766+0000 7fae8bfff700 1 -- 172.21.15.80:0/4147360366 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae7c009b70 con 0x7fae941145b0 2019-11-28T11:32:54.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.766+0000 7fae991b9700 1 -- 172.21.15.80:0/4147360366 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae94115400 con 0x7fae941145b0 2019-11-28T11:32:54.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.766+0000 7fae92d9d700 1 --2- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae941145b0 0x7fae94114a40 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7fae7c0103d0 tx=0x7fae7c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:54.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.766+0000 7fae8bfff700 1 -- 172.21.15.80:0/4147360366 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fae7c00a290 con 0x7fae941145b0 2019-11-28T11:32:54.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.766+0000 7fae92d9d700 1 --2- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae941145b0 0x7fae94114a40 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7fae7c0103d0 tx=0x7fae7c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:54.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.766+0000 7fae8bfff700 1 --2- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae6c018750 0x7fae6c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:54.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.766+0000 7fae8bfff700 1 -- 172.21.15.80:0/4147360366 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5329+0+0 (secure 0 0 0) 0x7fae7c031ae0 con 0x7fae941145b0 2019-11-28T11:32:54.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.767+0000 7fae9359e700 1 --2- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae6c018750 0x7fae6c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:54.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.767+0000 7fae9359e700 1 --2- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae6c018750 0x7fae6c01abe0 crc :-1 s=READY pgs=357 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:54.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.774+0000 7fae991b9700 1 -- 172.21.15.80:0/4147360366 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae94112eb0 con 0x7fae941145b0 2019-11-28T11:32:54.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.778+0000 7fae92d9d700 1 --2- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae941145b0 0x7fae94114a40 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7fae7c0103d0 tx=0x7fae7c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:54.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.778+0000 7fae8bfff700 1 -- 172.21.15.80:0/4147360366 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fae7c016570 con 0x7fae941145b0 2019-11-28T11:32:55.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:54.965+0000 7fae991b9700 1 -- 172.21.15.80:0/4147360366 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fae94113230 con 0x7fae941145b0 2019-11-28T11:32:55.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.608+0000 7fae92d9d700 1 --2- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae941145b0 0x7fae94114a40 secure :-1 s=THROTTLE_DONE pgs=519 cs=0 l=1 rx=0x7fae7c0103d0 tx=0x7fae7c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:55.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.608+0000 7fae8bfff700 1 -- 172.21.15.80:0/4147360366 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v74) v1 ==== 97+0+0 (secure 0 0 0) 0x7fae7c016570 con 0x7fae941145b0 2019-11-28T11:32:55.674 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:32:55.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.632+0000 7fae991b9700 1 -- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae6c018750 msgr2=0x7fae6c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:55.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.632+0000 7fae991b9700 1 --2- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae6c018750 0x7fae6c01abe0 crc :-1 s=READY pgs=357 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:55.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.632+0000 7fae991b9700 1 -- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae941145b0 msgr2=0x7fae94114a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:55.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.632+0000 7fae991b9700 1 --2- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae941145b0 0x7fae94114a40 secure :-1 s=READY pgs=519 cs=0 l=1 rx=0x7fae7c0103d0 tx=0x7fae7c010770).stop 2019-11-28T11:32:55.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.632+0000 7fae991b9700 1 -- 172.21.15.80:0/4147360366 shutdown_connections 2019-11-28T11:32:55.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.632+0000 7fae991b9700 1 --2- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae6c018750 0x7fae6c01abe0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:55.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.632+0000 7fae991b9700 1 --2- 172.21.15.80:0/4147360366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae941145b0 0x7fae94114a40 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:55.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.632+0000 7fae991b9700 1 -- 172.21.15.80:0/4147360366 shutdown_connections 2019-11-28T11:32:55.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.632+0000 7fae991b9700 1 -- 172.21.15.80:0/4147360366 wait complete. 2019-11-28T11:32:55.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.632+0000 7fae991b9700 1 -- 172.21.15.80:0/4147360366 >> 172.21.15.80:0/4147360366 conn(0x7fae941426c0 msgr2=0x7fae94110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:55.687 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:32:55.688 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:32:55.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.768+0000 7f9dd9c55700 1 Processor -- start 2019-11-28T11:32:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.768+0000 7f9dd9c55700 1 -- start start 2019-11-28T11:32:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.769+0000 7f9dd9c55700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9dd406c0a0 0x7f9dd4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.769+0000 7f9dd9c55700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9dd40734e0 0x7f9dd4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.769+0000 7f9dd9c55700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dd4072360 0x7f9dd4072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.769+0000 7f9dd9c55700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd406fd60 con 0x7f9dd40734e0 2019-11-28T11:32:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.769+0000 7f9dd9c55700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd4070030 con 0x7f9dd406c0a0 2019-11-28T11:32:55.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.769+0000 7f9dd9c55700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd406f330 con 0x7f9dd4072360 2019-11-28T11:32:55.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.769+0000 7f9dcbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9dd40734e0 0x7f9dd4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:55.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dcbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9dd40734e0 0x7f9dd4071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35388/0 (socket says 172.21.15.80:35388) 2019-11-28T11:32:55.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dcbfff700 1 -- 172.21.15.80:0/3476263129 learned_addr learned my addr 172.21.15.80:0/3476263129 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dd3fff700 1 --2- 172.21.15.80:0/3476263129 >> v2:172.21.15.174:3300/0 conn(0x7f9dd406c0a0 0x7f9dd4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dd89f3700 1 --2- 172.21.15.80:0/3476263129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dd4072360 0x7f9dd4072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dcbfff700 1 -- 172.21.15.80:0/3476263129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dd4072360 msgr2=0x7f9dd4072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dcbfff700 1 --2- 172.21.15.80:0/3476263129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dd4072360 0x7f9dd4072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dcbfff700 1 -- 172.21.15.80:0/3476263129 >> v2:172.21.15.174:3300/0 conn(0x7f9dd406c0a0 msgr2=0x7f9dd4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dcbfff700 1 --2- 172.21.15.80:0/3476263129 >> v2:172.21.15.174:3300/0 conn(0x7f9dd406c0a0 0x7f9dd4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:55.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dcbfff700 1 -- 172.21.15.80:0/3476263129 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd40706c0 con 0x7f9dd40734e0 2019-11-28T11:32:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dd3fff700 1 --2- 172.21.15.80:0/3476263129 >> v2:172.21.15.174:3300/0 conn(0x7f9dd406c0a0 0x7f9dd4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:32:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dcbfff700 1 --2- 172.21.15.80:0/3476263129 >> v2:172.21.15.80:3300/0 conn(0x7f9dd40734e0 0x7f9dd4071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9dbc00f740 tx=0x7f9dbc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dcbfff700 1 --2- 172.21.15.80:0/3476263129 >> v2:172.21.15.80:3300/0 conn(0x7f9dd40734e0 0x7f9dd4071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9dbc00f740 tx=0x7f9dbc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dcbfff700 1 --2- 172.21.15.80:0/3476263129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40734e0 0x7f9dd4071e20 secure :-1 s=READY pgs=867 cs=0 l=1 rx=0x7f9dbc00f740 tx=0x7f9dbc00f570).ready entity=mon.0 client_cookie=e434a103e59f11ba server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dcbfff700 1 --2- 172.21.15.80:0/3476263129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40734e0 0x7f9dd4071e20 secure :-1 s=THROTTLE_DONE pgs=867 cs=0 l=1 rx=0x7f9dbc00f740 tx=0x7f9dbc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dd37fe700 1 -- 172.21.15.80:0/3476263129 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dbc000960 con 0x7f9dd40734e0 2019-11-28T11:32:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dcbfff700 1 --2- 172.21.15.80:0/3476263129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40734e0 0x7f9dd4071e20 secure :-1 s=THROTTLE_DONE pgs=867 cs=0 l=1 rx=0x7f9dbc00f740 tx=0x7f9dbc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dcbfff700 1 --2- 172.21.15.80:0/3476263129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40734e0 0x7f9dd4071e20 secure :-1 s=THROTTLE_DONE pgs=867 cs=0 l=1 rx=0x7f9dbc00f740 tx=0x7f9dbc00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dd37fe700 1 -- 172.21.15.80:0/3476263129 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc000c90 con 0x7f9dd40734e0 2019-11-28T11:32:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dd37fe700 1 -- 172.21.15.80:0/3476263129 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dbc0013a0 con 0x7f9dd40734e0 2019-11-28T11:32:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dd9c55700 1 -- 172.21.15.80:0/3476263129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40734e0 msgr2=0x7f9dd4071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.770+0000 7f9dd9c55700 1 --2- 172.21.15.80:0/3476263129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40734e0 0x7f9dd4071e20 secure :-1 s=READY pgs=867 cs=0 l=1 rx=0x7f9dbc00f740 tx=0x7f9dbc00f570).stop 2019-11-28T11:32:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.771+0000 7f9dd9c55700 1 -- 172.21.15.80:0/3476263129 shutdown_connections 2019-11-28T11:32:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.771+0000 7f9dd9c55700 1 --2- 172.21.15.80:0/3476263129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dd4072360 0x7f9dd4072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.771+0000 7f9dd9c55700 1 --2- 172.21.15.80:0/3476263129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd40734e0 0x7f9dd4071e20 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.771+0000 7f9dd9c55700 1 --2- 172.21.15.80:0/3476263129 >> v2:172.21.15.174:3300/0 conn(0x7f9dd406c0a0 0x7f9dd4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.771+0000 7f9dd9c55700 1 -- 172.21.15.80:0/3476263129 shutdown_connections 2019-11-28T11:32:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.771+0000 7f9dd9c55700 1 -- 172.21.15.80:0/3476263129 wait complete. 2019-11-28T11:32:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.771+0000 7f9dd9c55700 1 -- 172.21.15.80:0/3476263129 >> 172.21.15.80:0/3476263129 conn(0x7f9dd4061cf0 msgr2=0x7f9dd4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.774+0000 7f9dd9c55700 1 Processor -- start 2019-11-28T11:32:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.774+0000 7f9dd9c55700 1 -- start start 2019-11-28T11:32:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.775+0000 7f9dd9c55700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9dd415fdf0 0x7f9dd412b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.775+0000 7f9dd9c55700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dd412b8a0 0x7f9dd413e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.775+0000 7f9dd9c55700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9dd413e860 0x7f9dd412a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.775+0000 7f9dd9c55700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd4108820 con 0x7f9dd413e860 2019-11-28T11:32:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.775+0000 7f9dd9c55700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd4108af0 con 0x7f9dd415fdf0 2019-11-28T11:32:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.775+0000 7f9dd9c55700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd4107df0 con 0x7f9dd412b8a0 2019-11-28T11:32:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.775+0000 7f9dd89f3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9dd413e860 0x7f9dd412a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:55.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.775+0000 7f9dd89f3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9dd413e860 0x7f9dd412a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35396/0 (socket says 172.21.15.80:35396) 2019-11-28T11:32:55.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.775+0000 7f9dd89f3700 1 -- 172.21.15.80:0/143250334 learned_addr learned my addr 172.21.15.80:0/143250334 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:55.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.775+0000 7f9dd3fff700 1 --2- 172.21.15.80:0/143250334 >> v2:172.21.15.174:3300/0 conn(0x7f9dd415fdf0 0x7f9dd412b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:55.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.775+0000 7f9dcbfff700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dd412b8a0 0x7f9dd413e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:55.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.775+0000 7f9dd89f3700 1 -- 172.21.15.80:0/143250334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dd412b8a0 msgr2=0x7f9dd413e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:55.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.775+0000 7f9dd89f3700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dd412b8a0 0x7f9dd413e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:55.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.775+0000 7f9dd89f3700 1 -- 172.21.15.80:0/143250334 >> v2:172.21.15.174:3300/0 conn(0x7f9dd415fdf0 msgr2=0x7f9dd412b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:55.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.775+0000 7f9dd89f3700 1 --2- 172.21.15.80:0/143250334 >> v2:172.21.15.174:3300/0 conn(0x7f9dd415fdf0 0x7f9dd412b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:55.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.776+0000 7f9dd89f3700 1 -- 172.21.15.80:0/143250334 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd410a8c0 con 0x7f9dd413e860 2019-11-28T11:32:55.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.776+0000 7f9dd89f3700 1 --2- 172.21.15.80:0/143250334 >> v2:172.21.15.80:3300/0 conn(0x7f9dd413e860 0x7f9dd412a3c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9dcc010760 tx=0x7f9dcc0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.776+0000 7f9dd89f3700 1 --2- 172.21.15.80:0/143250334 >> v2:172.21.15.80:3300/0 conn(0x7f9dd413e860 0x7f9dd412a3c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9dcc010760 tx=0x7f9dcc0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.776+0000 7f9dd89f3700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd413e860 0x7f9dd412a3c0 secure :-1 s=READY pgs=868 cs=0 l=1 rx=0x7f9dcc010760 tx=0x7f9dcc0105e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.776+0000 7f9dd89f3700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd413e860 0x7f9dd412a3c0 secure :-1 s=THROTTLE_DONE pgs=868 cs=0 l=1 rx=0x7f9dcc010760 tx=0x7f9dcc0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.776+0000 7f9dd17fa700 1 -- 172.21.15.80:0/143250334 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dcc00aa30 con 0x7f9dd413e860 2019-11-28T11:32:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.776+0000 7f9dd89f3700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd413e860 0x7f9dd412a3c0 secure :-1 s=THROTTLE_DONE pgs=868 cs=0 l=1 rx=0x7f9dcc010760 tx=0x7f9dcc0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.776+0000 7f9dd89f3700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd413e860 0x7f9dd412a3c0 secure :-1 s=THROTTLE_DONE pgs=868 cs=0 l=1 rx=0x7f9dcc010760 tx=0x7f9dcc0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.776+0000 7f9dd17fa700 1 -- 172.21.15.80:0/143250334 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc0013e0 con 0x7f9dd413e860 2019-11-28T11:32:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.776+0000 7f9dd9c55700 1 -- 172.21.15.80:0/143250334 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd410a8c0 con 0x7f9dd413e860 2019-11-28T11:32:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.776+0000 7f9dd17fa700 1 -- 172.21.15.80:0/143250334 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dcc0019f0 con 0x7f9dd413e860 2019-11-28T11:32:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.776+0000 7f9dd9c55700 1 -- 172.21.15.80:0/143250334 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd410a8c0 con 0x7f9dd413e860 2019-11-28T11:32:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.776+0000 7f9dd89f3700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd413e860 0x7f9dd412a3c0 secure :-1 s=THROTTLE_DONE pgs=868 cs=0 l=1 rx=0x7f9dcc010760 tx=0x7f9dcc0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.776+0000 7f9dd17fa700 1 -- 172.21.15.80:0/143250334 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9dcc00aa30 con 0x7f9dd413e860 2019-11-28T11:32:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.776+0000 7f9dd89f3700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd413e860 0x7f9dd412a3c0 secure :-1 s=THROTTLE_DONE pgs=868 cs=0 l=1 rx=0x7f9dcc010760 tx=0x7f9dcc0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.777+0000 7f9dd17fa700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9db8018730 0x7f9db801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.777+0000 7f9dd17fa700 1 -- 172.21.15.80:0/143250334 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f9dcc031fb0 con 0x7f9dd413e860 2019-11-28T11:32:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.777+0000 7f9dd3fff700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9db8018730 0x7f9db801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.777+0000 7f9dd3fff700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9db8018730 0x7f9db801abe0 crc :-1 s=READY pgs=358 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.784+0000 7f9dd9c55700 1 -- 172.21.15.80:0/143250334 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd4109180 con 0x7f9dd413e860 2019-11-28T11:32:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.787+0000 7f9dd89f3700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd413e860 0x7f9dd412a3c0 secure :-1 s=THROTTLE_DONE pgs=868 cs=0 l=1 rx=0x7f9dcc010760 tx=0x7f9dcc0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.787+0000 7f9dd17fa700 1 -- 172.21.15.80:0/143250334 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9dcc000ee0 con 0x7f9dd413e860 2019-11-28T11:32:56.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.963+0000 7f9dd9c55700 1 -- 172.21.15.80:0/143250334 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9dd4109500 con 0x7f9dd413e860 2019-11-28T11:32:56.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.963+0000 7f9dd89f3700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd413e860 0x7f9dd412a3c0 secure :-1 s=THROTTLE_DONE pgs=868 cs=0 l=1 rx=0x7f9dcc010760 tx=0x7f9dcc0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.963+0000 7f9dd17fa700 1 -- 172.21.15.80:0/143250334 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v27) v1 ==== 80+0+4797 (secure 0 0 0) 0x7f9dcc00aa30 con 0x7f9dd413e860 2019-11-28T11:32:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:32:56.008 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:32:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:32:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:32:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:32:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:32:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:32:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:32:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:32:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:32:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:32:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:32:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:32:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:32:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:32:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:32:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:32:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:32:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:32:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:32:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:32:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:32:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:32:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:32:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:32:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:32:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:32:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:32:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:32:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:32:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:32:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:32:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:32:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:32:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:32:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:32:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:32:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:32:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:32:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:32:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:32:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:32:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:32:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:32:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:32:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:32:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:32:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:32:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:32:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:32:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:32:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:32:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:32:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:32:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:32:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:32:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:32:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:32:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:32:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:32:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:32:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:32:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:32:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:32:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:32:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:32:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:32:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:32:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:32:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:32:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:32:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:32:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:32:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:32:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:32:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:32:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:32:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:32:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:32:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:32:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:32:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:32:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:32:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:32:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:32:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:32:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:32:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:32:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:32:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:32:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:32:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:32:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:32:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:32:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:32:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:32:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:32:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:32:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:32:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.033 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:32:56.033 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:32:56.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.965+0000 7f9dd9c55700 1 -- 172.21.15.80:0/143250334 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9db8018730 msgr2=0x7f9db801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.965+0000 7f9dd9c55700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9db8018730 0x7f9db801abe0 crc :-1 s=READY pgs=358 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:56.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.965+0000 7f9dd9c55700 1 -- 172.21.15.80:0/143250334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd413e860 msgr2=0x7f9dd412a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.965+0000 7f9dd9c55700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd413e860 0x7f9dd412a3c0 secure :-1 s=READY pgs=868 cs=0 l=1 rx=0x7f9dcc010760 tx=0x7f9dcc0105e0).stop 2019-11-28T11:32:56.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.965+0000 7f9dd9c55700 1 -- 172.21.15.80:0/143250334 shutdown_connections 2019-11-28T11:32:56.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.965+0000 7f9dd9c55700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9db8018730 0x7f9db801abe0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:56.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.965+0000 7f9dd9c55700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9dd413e860 0x7f9dd412a3c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:56.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.965+0000 7f9dd9c55700 1 --2- 172.21.15.80:0/143250334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9dd412b8a0 0x7f9dd413e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:56.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.965+0000 7f9dd9c55700 1 --2- 172.21.15.80:0/143250334 >> v2:172.21.15.174:3300/0 conn(0x7f9dd415fdf0 0x7f9dd412b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:56.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.966+0000 7f9dd9c55700 1 -- 172.21.15.80:0/143250334 shutdown_connections 2019-11-28T11:32:56.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.966+0000 7f9dd9c55700 1 -- 172.21.15.80:0/143250334 wait complete. 2019-11-28T11:32:56.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:55.966+0000 7f9dd9c55700 1 -- 172.21.15.80:0/143250334 >> 172.21.15.80:0/143250334 conn(0x7f9dd4127dc0 msgr2=0x7f9dd4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:56.038 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:32:56.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.113+0000 7f0dc1792700 1 Processor -- start 2019-11-28T11:32:56.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.113+0000 7f0dc1792700 1 -- start start 2019-11-28T11:32:56.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dc1792700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dbc06d120 0x7f0dbc165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:56.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dc1792700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dbc06d580 con 0x7f0dbc06c0a0 2019-11-28T11:32:56.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dc1792700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dbc06db00 con 0x7f0dbc06c490 2019-11-28T11:32:56.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dc1792700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc06fd60 con 0x7f0dbc06d120 2019-11-28T11:32:56.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dbb7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0dbc06c0a0 0x7f0dbc072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34716/0 (socket says 172.21.15.80:34716) 2019-11-28T11:32:56.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dbb7fe700 1 -- 172.21.15.80:0/364727213 learned_addr learned my addr 172.21.15.80:0/364727213 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:56.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/364727213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dbc06d120 0x7f0dbc165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:56.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dba7fc700 1 -- 172.21.15.80:0/364727213 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051282697 0 0) 0x7f0dac001150 con 0x7f0dbc06c0a0 2019-11-28T11:32:56.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dba7fc700 1 -- 172.21.15.80:0/364727213 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d9c002e80 con 0x7f0dbc06c0a0 2019-11-28T11:32:56.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dba7fc700 1 -- 172.21.15.80:0/364727213 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082016643 0 0) 0x7f0da4001400 con 0x7f0dbc06c490 2019-11-28T11:32:56.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dba7fc700 1 -- 172.21.15.80:0/364727213 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d9c0030b0 con 0x7f0dbc06c490 2019-11-28T11:32:56.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dba7fc700 1 -- 172.21.15.80:0/364727213 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2047624474 0 0) 0x7f0dac001130 con 0x7f0dbc06c0a0 2019-11-28T11:32:56.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dbbfff700 1 -- 172.21.15.80:0/364727213 >> v1:172.21.15.174:6789/0 conn(0x7f0dbc06c490 legacy=0x7f0dbc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dbbfff700 1 -- 172.21.15.80:0/364727213 >> v1:172.21.15.80:6789/0 conn(0x7f0dbc06c0a0 legacy=0x7f0dbc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dbbfff700 1 -- 172.21.15.80:0/364727213 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc0706c0 con 0x7f0dbc06d120 2019-11-28T11:32:56.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/364727213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dbc06d120 0x7f0dbc165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0db400af80 tx=0x7f0db400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/364727213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dbc06d120 0x7f0dbc165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0db400af80 tx=0x7f0db400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.114+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/364727213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dbc06d120 0x7f0dbc165d80 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f0db400af80 tx=0x7f0db400b790).ready entity=mon.2 client_cookie=5c8c49ef0a64119d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:56.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.115+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/364727213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dbc06d120 0x7f0dbc165d80 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0db400af80 tx=0x7f0db400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.115+0000 7f0dba7fc700 1 -- 172.21.15.80:0/364727213 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0db4007240 con 0x7f0dbc06d120 2019-11-28T11:32:56.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.115+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/364727213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dbc06d120 0x7f0dbc165d80 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0db400af80 tx=0x7f0db400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.115+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/364727213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dbc06d120 0x7f0dbc165d80 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0db400af80 tx=0x7f0db400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.115+0000 7f0dba7fc700 1 -- 172.21.15.80:0/364727213 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db4000bb0 con 0x7f0dbc06d120 2019-11-28T11:32:56.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.115+0000 7f0dba7fc700 1 -- 172.21.15.80:0/364727213 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0db4009e60 con 0x7f0dbc06d120 2019-11-28T11:32:56.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.115+0000 7f0dc1792700 1 -- 172.21.15.80:0/364727213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dbc06d120 msgr2=0x7f0dbc165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.115+0000 7f0dc1792700 1 --2- 172.21.15.80:0/364727213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dbc06d120 0x7f0dbc165d80 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f0db400af80 tx=0x7f0db400b790).stop 2019-11-28T11:32:56.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.115+0000 7f0dc1792700 1 -- 172.21.15.80:0/364727213 shutdown_connections 2019-11-28T11:32:56.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.115+0000 7f0dc1792700 1 --2- 172.21.15.80:0/364727213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dbc06d120 0x7f0dbc165d80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:56.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.115+0000 7f0dc1792700 1 -- 172.21.15.80:0/364727213 shutdown_connections 2019-11-28T11:32:56.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.115+0000 7f0dc1792700 1 -- 172.21.15.80:0/364727213 wait complete. 2019-11-28T11:32:56.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.115+0000 7f0dc1792700 1 -- 172.21.15.80:0/364727213 >> 172.21.15.80:0/364727213 conn(0x7f0dbc061cf0 msgr2=0x7f0dbc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:56.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.118+0000 7f0dc1792700 1 Processor -- start 2019-11-28T11:32:56.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.118+0000 7f0dc1792700 1 -- start start 2019-11-28T11:32:56.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0dc1792700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0dbc167a20 0x7f0dbc169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:56.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0dc1792700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dbc13fc50 con 0x7f0dbc1145b0 2019-11-28T11:32:56.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0dc1792700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dbc122ef0 con 0x7f0dbc13f580 2019-11-28T11:32:56.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0dc1792700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dbc112550 con 0x7f0dbc167a20 2019-11-28T11:32:56.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0dbaffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0dbc1145b0 0x7f0dbc114a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34724/0 (socket says 172.21.15.80:34724) 2019-11-28T11:32:56.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0dbaffd700 1 -- 172.21.15.80:0/1036045738 learned_addr learned my addr 172.21.15.80:0/1036045738 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:56.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/1036045738 >> v2:172.21.15.174:3300/0 conn(0x7f0dbc167a20 0x7f0dbc169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:56.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0db3fff700 1 -- 172.21.15.80:0/1036045738 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021698841 0 0) 0x7f0da40015c0 con 0x7f0dbc1145b0 2019-11-28T11:32:56.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0db3fff700 1 -- 172.21.15.80:0/1036045738 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d94002e80 con 0x7f0dbc1145b0 2019-11-28T11:32:56.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0db3fff700 1 -- 172.21.15.80:0/1036045738 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294848342 0 0) 0x7f0dac001100 con 0x7f0dbc13f580 2019-11-28T11:32:56.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0db3fff700 1 -- 172.21.15.80:0/1036045738 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d940030b0 con 0x7f0dbc13f580 2019-11-28T11:32:56.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0dbbfff700 1 -- 172.21.15.80:0/1036045738 >> v1:172.21.15.174:6789/0 conn(0x7f0dbc13f580 legacy=0x7f0dbc115730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0dbbfff700 1 -- 172.21.15.80:0/1036045738 >> v1:172.21.15.80:6789/0 conn(0x7f0dbc1145b0 legacy=0x7f0dbc114a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0dbbfff700 1 -- 172.21.15.80:0/1036045738 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc112eb0 con 0x7f0dbc167a20 2019-11-28T11:32:56.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/1036045738 >> v2:172.21.15.174:3300/0 conn(0x7f0dbc167a20 0x7f0dbc169e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0db40103b0 tx=0x7f0db4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/1036045738 >> v2:172.21.15.174:3300/0 conn(0x7f0dbc167a20 0x7f0dbc169e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0db40103b0 tx=0x7f0db4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.119+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0dbc167a20 0x7f0dbc169e20 secure :-1 s=READY pgs=522 cs=0 l=1 rx=0x7f0db40103b0 tx=0x7f0db4010750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:56.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.120+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0dbc167a20 0x7f0dbc169e20 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f0db40103b0 tx=0x7f0db4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.120+0000 7f0db3fff700 1 -- 172.21.15.80:0/1036045738 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0db400ae90 con 0x7f0dbc167a20 2019-11-28T11:32:56.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.120+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0dbc167a20 0x7f0dbc169e20 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f0db40103b0 tx=0x7f0db4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.120+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0dbc167a20 0x7f0dbc169e20 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f0db40103b0 tx=0x7f0db4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.120+0000 7f0db3fff700 1 -- 172.21.15.80:0/1036045738 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db40099b0 con 0x7f0dbc167a20 2019-11-28T11:32:56.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.120+0000 7f0db3fff700 1 -- 172.21.15.80:0/1036045738 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0db400ae90 con 0x7f0dbc167a20 2019-11-28T11:32:56.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.120+0000 7f0dc1792700 1 -- 172.21.15.80:0/1036045738 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dbc113230 con 0x7f0dbc167a20 2019-11-28T11:32:56.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.120+0000 7f0dc1792700 1 -- 172.21.15.80:0/1036045738 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dbc112eb0 con 0x7f0dbc167a20 2019-11-28T11:32:56.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.120+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0dbc167a20 0x7f0dbc169e20 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f0db40103b0 tx=0x7f0db4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.120+0000 7f0db3fff700 1 -- 172.21.15.80:0/1036045738 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0db4009ba0 con 0x7f0dbc167a20 2019-11-28T11:32:56.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.120+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0dbc167a20 0x7f0dbc169e20 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f0db40103b0 tx=0x7f0db4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.120+0000 7f0db3fff700 1 --2- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d94018750 0x7f0d9401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:56.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.120+0000 7f0db3fff700 1 -- 172.21.15.80:0/1036045738 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f0db4031ac0 con 0x7f0dbc167a20 2019-11-28T11:32:56.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.121+0000 7f0dbb7fe700 1 --2- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d94018750 0x7f0d9401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:56.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.121+0000 7f0dbb7fe700 1 --2- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d94018750 0x7f0d9401abe0 crc :-1 s=READY pgs=359 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:56.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.128+0000 7f0dc1792700 1 -- 172.21.15.80:0/1036045738 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dbc113230 con 0x7f0dbc167a20 2019-11-28T11:32:56.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.132+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0dbc167a20 0x7f0dbc169e20 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f0db40103b0 tx=0x7f0db4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.132+0000 7f0db3fff700 1 -- 172.21.15.80:0/1036045738 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0db40095b0 con 0x7f0dbc167a20 2019-11-28T11:32:56.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.307+0000 7f0dc1792700 1 -- 172.21.15.80:0/1036045738 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dbc112eb0 con 0x7f0dbc167a20 2019-11-28T11:32:56.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.308+0000 7f0dbbfff700 1 --2- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0dbc167a20 0x7f0dbc169e20 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f0db40103b0 tx=0x7f0db4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.308+0000 7f0db3fff700 1 -- 172.21.15.80:0/1036045738 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+12001 (secure 0 0 0) 0x7f0db4009ba0 con 0x7f0dbc167a20 2019-11-28T11:32:56.354 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:32:56.354 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":74,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:32:55.604668+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:32:56.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.312+0000 7f0dc1792700 1 -- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d94018750 msgr2=0x7f0d9401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.312+0000 7f0dc1792700 1 --2- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d94018750 0x7f0d9401abe0 crc :-1 s=READY pgs=359 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:56.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.312+0000 7f0dc1792700 1 -- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0dbc167a20 msgr2=0x7f0dbc169e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.312+0000 7f0dc1792700 1 --2- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0dbc167a20 0x7f0dbc169e20 secure :-1 s=READY pgs=522 cs=0 l=1 rx=0x7f0db40103b0 tx=0x7f0db4010750).stop 2019-11-28T11:32:56.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.312+0000 7f0dc1792700 1 -- 172.21.15.80:0/1036045738 shutdown_connections 2019-11-28T11:32:56.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.312+0000 7f0dc1792700 1 --2- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0dbc167a20 0x7f0dbc169e20 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:56.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.312+0000 7f0dc1792700 1 --2- 172.21.15.80:0/1036045738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d94018750 0x7f0d9401abe0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:56.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.312+0000 7f0dc1792700 1 -- 172.21.15.80:0/1036045738 shutdown_connections 2019-11-28T11:32:56.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.312+0000 7f0dc1792700 1 -- 172.21.15.80:0/1036045738 wait complete. 2019-11-28T11:32:56.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.312+0000 7f0dc1792700 1 -- 172.21.15.80:0/1036045738 >> 172.21.15.80:0/1036045738 conn(0x7f0dbc1426c0 msgr2=0x7f0dbc110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:56.366 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:32:56.367 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:32:56.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.446+0000 7fde897ee700 1 Processor -- start 2019-11-28T11:32:56.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.446+0000 7fde897ee700 1 -- start start 2019-11-28T11:32:56.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.447+0000 7fde897ee700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fde8415f100 0x7fde8406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:56.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.447+0000 7fde897ee700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde8406c2f0 0x7fde8406c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:56.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.447+0000 7fde897ee700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8406db60 con 0x7fde8415ed10 2019-11-28T11:32:56.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.447+0000 7fde897ee700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8406fe00 con 0x7fde8415f100 2019-11-28T11:32:56.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.447+0000 7fde897ee700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde840700d0 con 0x7fde8406c2f0 2019-11-28T11:32:56.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.447+0000 7fde82ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fde8415f100 0x7fde8406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:56.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde82ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fde8415f100 0x7fde8406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35418/0 (socket says 172.21.15.80:35418) 2019-11-28T11:32:56.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde82ffd700 1 -- 172.21.15.80:0/963552208 learned_addr learned my addr 172.21.15.80:0/963552208 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:56.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde83fff700 1 --2- 172.21.15.80:0/963552208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde8406c2f0 0x7fde8406c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:56.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde82ffd700 1 -- 172.21.15.80:0/963552208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde8406c2f0 msgr2=0x7fde8406c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:56.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde82ffd700 1 --2- 172.21.15.80:0/963552208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde8406c2f0 0x7fde8406c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:56.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde82ffd700 1 -- 172.21.15.80:0/963552208 >> v1:172.21.15.174:6789/0 conn(0x7fde8415ed10 legacy=0x7fde84073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:56.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde82ffd700 1 -- 172.21.15.80:0/963552208 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde84070760 con 0x7fde8415f100 2019-11-28T11:32:56.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde83fff700 1 --2- 172.21.15.80:0/963552208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde8406c2f0 0x7fde8406c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:32:56.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde82ffd700 1 --2- 172.21.15.80:0/963552208 >> v2:172.21.15.80:3300/0 conn(0x7fde8415f100 0x7fde8406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fde6c00fac0 tx=0x7fde6c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde82ffd700 1 --2- 172.21.15.80:0/963552208 >> v2:172.21.15.80:3300/0 conn(0x7fde8415f100 0x7fde8406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fde6c00fac0 tx=0x7fde6c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde82ffd700 1 --2- 172.21.15.80:0/963552208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde8415f100 0x7fde8406bdb0 secure :-1 s=READY pgs=871 cs=0 l=1 rx=0x7fde6c00fac0 tx=0x7fde6c00fe60).ready entity=mon.0 client_cookie=c0b6f102523906be server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:56.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde82ffd700 1 --2- 172.21.15.80:0/963552208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde8415f100 0x7fde8406bdb0 secure :-1 s=THROTTLE_DONE pgs=871 cs=0 l=1 rx=0x7fde6c00fac0 tx=0x7fde6c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde827fc700 1 -- 172.21.15.80:0/963552208 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde6c000ce0 con 0x7fde8415f100 2019-11-28T11:32:56.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde82ffd700 1 --2- 172.21.15.80:0/963552208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde8415f100 0x7fde8406bdb0 secure :-1 s=THROTTLE_DONE pgs=871 cs=0 l=1 rx=0x7fde6c00fac0 tx=0x7fde6c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde82ffd700 1 --2- 172.21.15.80:0/963552208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde8415f100 0x7fde8406bdb0 secure :-1 s=THROTTLE_DONE pgs=871 cs=0 l=1 rx=0x7fde6c00fac0 tx=0x7fde6c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde827fc700 1 -- 172.21.15.80:0/963552208 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c001010 con 0x7fde8415f100 2019-11-28T11:32:56.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde827fc700 1 -- 172.21.15.80:0/963552208 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde6c001720 con 0x7fde8415f100 2019-11-28T11:32:56.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde897ee700 1 -- 172.21.15.80:0/963552208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde8415f100 msgr2=0x7fde8406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.448+0000 7fde897ee700 1 --2- 172.21.15.80:0/963552208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde8415f100 0x7fde8406bdb0 secure :-1 s=READY pgs=871 cs=0 l=1 rx=0x7fde6c00fac0 tx=0x7fde6c00fe60).stop 2019-11-28T11:32:56.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.449+0000 7fde897ee700 1 -- 172.21.15.80:0/963552208 shutdown_connections 2019-11-28T11:32:56.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.449+0000 7fde897ee700 1 --2- 172.21.15.80:0/963552208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde8406c2f0 0x7fde8406c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:56.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.449+0000 7fde897ee700 1 --2- 172.21.15.80:0/963552208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde8415f100 0x7fde8406bdb0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:56.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.449+0000 7fde897ee700 1 -- 172.21.15.80:0/963552208 shutdown_connections 2019-11-28T11:32:56.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.449+0000 7fde897ee700 1 -- 172.21.15.80:0/963552208 wait complete. 2019-11-28T11:32:56.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.449+0000 7fde897ee700 1 -- 172.21.15.80:0/963552208 >> 172.21.15.80:0/963552208 conn(0x7fde84061d20 msgr2=0x7fde840641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:56.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.451+0000 7fde897ee700 1 Processor -- start 2019-11-28T11:32:56.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.451+0000 7fde897ee700 1 -- start start 2019-11-28T11:32:56.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.452+0000 7fde897ee700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde841079b0 0x7fde84107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:56.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.452+0000 7fde897ee700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde841087d0 con 0x7fde84148320 2019-11-28T11:32:56.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.452+0000 7fde897ee700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde84148e00 con 0x7fde84108380 2019-11-28T11:32:56.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.452+0000 7fde897ee700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8413aa20 con 0x7fde841079b0 2019-11-28T11:32:56.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.452+0000 7fde837fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fde84148320 0x7fde8410ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34736/0 (socket says 172.21.15.80:34736) 2019-11-28T11:32:56.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.452+0000 7fde837fe700 1 -- 172.21.15.80:0/1765167897 learned_addr learned my addr 172.21.15.80:0/1765167897 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:56.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde82ffd700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde841079b0 0x7fde84107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:56.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde7bfff700 1 -- 172.21.15.80:0/1765167897 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866223576 0 0) 0x7fde74001150 con 0x7fde84148320 2019-11-28T11:32:56.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde7bfff700 1 -- 172.21.15.80:0/1765167897 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde5c002e80 con 0x7fde84148320 2019-11-28T11:32:56.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde7bfff700 1 -- 172.21.15.80:0/1765167897 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438222764 0 0) 0x7fde7c001080 con 0x7fde84108380 2019-11-28T11:32:56.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde7bfff700 1 -- 172.21.15.80:0/1765167897 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde5c0030b0 con 0x7fde84108380 2019-11-28T11:32:56.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde82ffd700 1 -- 172.21.15.80:0/1765167897 >> v1:172.21.15.174:6789/0 conn(0x7fde84108380 legacy=0x7fde84168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde82ffd700 1 -- 172.21.15.80:0/1765167897 >> v1:172.21.15.80:6789/0 conn(0x7fde84148320 legacy=0x7fde8410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde82ffd700 1 -- 172.21.15.80:0/1765167897 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8410c490 con 0x7fde841079b0 2019-11-28T11:32:56.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde82ffd700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde841079b0 0x7fde84107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde6c010720 tx=0x7fde6c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde82ffd700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde841079b0 0x7fde84107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde6c010720 tx=0x7fde6c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde82ffd700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde841079b0 0x7fde84107e40 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7fde6c010720 tx=0x7fde6c010ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:56.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde82ffd700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde841079b0 0x7fde84107e40 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fde6c010720 tx=0x7fde6c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde7bfff700 1 -- 172.21.15.80:0/1765167897 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde6c000cc0 con 0x7fde841079b0 2019-11-28T11:32:56.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde82ffd700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde841079b0 0x7fde84107e40 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fde6c010720 tx=0x7fde6c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde7bfff700 1 -- 172.21.15.80:0/1765167897 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c0012d0 con 0x7fde841079b0 2019-11-28T11:32:56.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde82ffd700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde841079b0 0x7fde84107e40 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fde6c010720 tx=0x7fde6c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde897ee700 1 -- 172.21.15.80:0/1765167897 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8410c810 con 0x7fde841079b0 2019-11-28T11:32:56.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde7bfff700 1 -- 172.21.15.80:0/1765167897 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde6c0014c0 con 0x7fde841079b0 2019-11-28T11:32:56.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.453+0000 7fde897ee700 1 -- 172.21.15.80:0/1765167897 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8410c490 con 0x7fde841079b0 2019-11-28T11:32:56.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.454+0000 7fde82ffd700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde841079b0 0x7fde84107e40 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fde6c010720 tx=0x7fde6c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.454+0000 7fde7bfff700 1 -- 172.21.15.80:0/1765167897 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fde6c000cc0 con 0x7fde841079b0 2019-11-28T11:32:56.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.454+0000 7fde82ffd700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde841079b0 0x7fde84107e40 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fde6c010720 tx=0x7fde6c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.454+0000 7fde7bfff700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fde5c018750 0x7fde5c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:56.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.454+0000 7fde7bfff700 1 -- 172.21.15.80:0/1765167897 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fde6c031e50 con 0x7fde841079b0 2019-11-28T11:32:56.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.454+0000 7fde837fe700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fde5c018750 0x7fde5c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:56.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.454+0000 7fde837fe700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fde5c018750 0x7fde5c01abe0 crc :-1 s=READY pgs=360 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:56.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.462+0000 7fde897ee700 1 -- 172.21.15.80:0/1765167897 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8410c810 con 0x7fde841079b0 2019-11-28T11:32:56.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.466+0000 7fde82ffd700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde841079b0 0x7fde84107e40 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fde6c010720 tx=0x7fde6c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.466+0000 7fde7bfff700 1 -- 172.21.15.80:0/1765167897 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fde6c000ed0 con 0x7fde841079b0 2019-11-28T11:32:56.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.633+0000 7fde897ee700 1 -- 172.21.15.80:0/1765167897 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fde8410c490 con 0x7fde841079b0 2019-11-28T11:32:56.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.633+0000 7fde82ffd700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde841079b0 0x7fde84107e40 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fde6c010720 tx=0x7fde6c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.633+0000 7fde7bfff700 1 -- 172.21.15.80:0/1765167897 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v74) v1 ==== 92+0+10 (secure 0 0 0) 0x7fde6c000cc0 con 0x7fde841079b0 2019-11-28T11:32:56.678 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:32:56.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.636+0000 7fde897ee700 1 -- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fde5c018750 msgr2=0x7fde5c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.636+0000 7fde897ee700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fde5c018750 0x7fde5c01abe0 crc :-1 s=READY pgs=360 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:56.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.636+0000 7fde897ee700 1 -- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde841079b0 msgr2=0x7fde84107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.636+0000 7fde897ee700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde841079b0 0x7fde84107e40 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7fde6c010720 tx=0x7fde6c010ac0).stop 2019-11-28T11:32:56.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.636+0000 7fde897ee700 1 -- 172.21.15.80:0/1765167897 shutdown_connections 2019-11-28T11:32:56.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.636+0000 7fde897ee700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fde5c018750 0x7fde5c01abe0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:56.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.636+0000 7fde897ee700 1 --2- 172.21.15.80:0/1765167897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde841079b0 0x7fde84107e40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:56.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.636+0000 7fde897ee700 1 -- 172.21.15.80:0/1765167897 shutdown_connections 2019-11-28T11:32:56.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.636+0000 7fde897ee700 1 -- 172.21.15.80:0/1765167897 wait complete. 2019-11-28T11:32:56.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.636+0000 7fde897ee700 1 -- 172.21.15.80:0/1765167897 >> 172.21.15.80:0/1765167897 conn(0x7fde8415e2d0 msgr2=0x7fde84147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:56.690 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:32:56.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.767+0000 7f5622f0c700 1 Processor -- start 2019-11-28T11:32:56.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.767+0000 7f5622f0c700 1 -- start start 2019-11-28T11:32:56.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.768+0000 7f5622f0c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f561c06d120 0x7f561c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:56.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.768+0000 7f5622f0c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561c06d580 con 0x7f561c06c490 2019-11-28T11:32:56.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.768+0000 7f5622f0c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561c06db00 con 0x7f561c06c0a0 2019-11-28T11:32:56.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.768+0000 7f5622f0c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561c06fd60 con 0x7f561c06d120 2019-11-28T11:32:56.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.768+0000 7f5620ca8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f561c06c490 0x7f561c06c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34748/0 (socket says 172.21.15.80:34748) 2019-11-28T11:32:56.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.768+0000 7f5620ca8700 1 -- 172.21.15.80:0/1947801399 learned_addr learned my addr 172.21.15.80:0/1947801399 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:56.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.768+0000 7f5621caa700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f561c06d120 0x7f561c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:56.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.768+0000 7f561bfff700 1 -- 172.21.15.80:0/1947801399 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648742700 0 0) 0x7f5604001150 con 0x7f561c06c490 2019-11-28T11:32:56.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.768+0000 7f561bfff700 1 -- 172.21.15.80:0/1947801399 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5608002e80 con 0x7f561c06c490 2019-11-28T11:32:56.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 -- 172.21.15.80:0/1947801399 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992216340 0 0) 0x7f560c001080 con 0x7f561c06c0a0 2019-11-28T11:32:56.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 -- 172.21.15.80:0/1947801399 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56080030b0 con 0x7f561c06c0a0 2019-11-28T11:32:56.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 -- 172.21.15.80:0/1947801399 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 157644330 0 0) 0x7f5604001130 con 0x7f561c06c490 2019-11-28T11:32:56.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 -- 172.21.15.80:0/1947801399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f561c06d120 msgr2=0x7f561c165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:56.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f561c06d120 0x7f561c165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:56.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 -- 172.21.15.80:0/1947801399 >> v1:172.21.15.174:6789/0 conn(0x7f561c06c0a0 legacy=0x7f561c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 -- 172.21.15.80:0/1947801399 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561c0706c0 con 0x7f561c06c490 2019-11-28T11:32:56.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 -- 172.21.15.80:0/1947801399 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f56040016c0 con 0x7f561c06c490 2019-11-28T11:32:56.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 -- 172.21.15.80:0/1947801399 >> v1:172.21.15.80:6789/0 conn(0x7f561c06c490 legacy=0x7f561c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5608003b30 0x7f5608005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:56.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5608006680 0x7f5608008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:56.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f560804d320 0x7f560804f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:56.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 -- 172.21.15.80:0/1947801399 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560804ffd0 con 0x7f5608006680 2019-11-28T11:32:56.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 -- 172.21.15.80:0/1947801399 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5608050200 con 0x7f560804d320 2019-11-28T11:32:56.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5620ca8700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5608006680 0x7f5608008b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:56.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 -- 172.21.15.80:0/1947801399 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5608050430 con 0x7f5608003b30 2019-11-28T11:32:56.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f56214a9700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5608003b30 0x7f5608005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:56.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5621caa700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f560804d320 0x7f560804f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:56.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5620ca8700 1 -- 172.21.15.80:0/1947801399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5608003b30 msgr2=0x7f5608005f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:56.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5620ca8700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5608003b30 0x7f5608005f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:56.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5620ca8700 1 -- 172.21.15.80:0/1947801399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f560804d320 msgr2=0x7f560804f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:56.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5620ca8700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f560804d320 0x7f560804f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:56.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5620ca8700 1 -- 172.21.15.80:0/1947801399 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56080506e0 con 0x7f5608006680 2019-11-28T11:32:56.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5621caa700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f560804d320 0x7f560804f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:32:56.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5620ca8700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5608006680 0x7f5608008b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f560400f890 tx=0x7f560400fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5620ca8700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5608006680 0x7f5608008b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f560400f890 tx=0x7f560400fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5620ca8700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5608006680 0x7f5608008b10 secure :-1 s=READY pgs=874 cs=0 l=1 rx=0x7f560400f890 tx=0x7f560400fc30).ready entity=mon.0 client_cookie=a6b44b9df2d26ddc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:56.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5620ca8700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5608006680 0x7f5608008b10 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7f560400f890 tx=0x7f560400fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5620ca8700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5608006680 0x7f5608008b10 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7f560400f890 tx=0x7f560400fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 -- 172.21.15.80:0/1947801399 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5604004430 con 0x7f5608006680 2019-11-28T11:32:56.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5620ca8700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5608006680 0x7f5608008b10 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7f560400f890 tx=0x7f560400fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 -- 172.21.15.80:0/1947801399 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5604001130 con 0x7f5608006680 2019-11-28T11:32:56.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f561bfff700 1 -- 172.21.15.80:0/1947801399 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5604004a10 con 0x7f5608006680 2019-11-28T11:32:56.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5622f0c700 1 -- 172.21.15.80:0/1947801399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5608006680 msgr2=0x7f5608008b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5622f0c700 1 --2- 172.21.15.80:0/1947801399 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5608006680 0x7f5608008b10 secure :-1 s=READY pgs=874 cs=0 l=1 rx=0x7f560400f890 tx=0x7f560400fc30).stop 2019-11-28T11:32:56.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.769+0000 7f5621caa700 1 -- 172.21.15.80:0/1947801399 reap_dead start 2019-11-28T11:32:56.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.770+0000 7f5622f0c700 1 -- 172.21.15.80:0/1947801399 shutdown_connections 2019-11-28T11:32:56.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.770+0000 7f5622f0c700 1 -- 172.21.15.80:0/1947801399 shutdown_connections 2019-11-28T11:32:56.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.770+0000 7f5622f0c700 1 -- 172.21.15.80:0/1947801399 wait complete. 2019-11-28T11:32:56.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.770+0000 7f5622f0c700 1 -- 172.21.15.80:0/1947801399 >> 172.21.15.80:0/1947801399 conn(0x7f561c061cf0 msgr2=0x7f561c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:56.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.773+0000 7f5622f0c700 1 Processor -- start 2019-11-28T11:32:56.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.773+0000 7f5622f0c700 1 -- start start 2019-11-28T11:32:56.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5622f0c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f561c150f50 0x7f561c07b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:56.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5622f0c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561c0754d0 con 0x7f561c074d00 2019-11-28T11:32:56.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5622f0c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561c12eb20 con 0x7f561c07bba0 2019-11-28T11:32:56.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5622f0c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561c078980 con 0x7f561c150f50 2019-11-28T11:32:56.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f56214a9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f561c074d00 0x7f561c07aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34756/0 (socket says 172.21.15.80:34756) 2019-11-28T11:32:56.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5620ca8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f561c150f50 0x7f561c07b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:56.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f56214a9700 1 -- 172.21.15.80:0/230378292 learned_addr learned my addr 172.21.15.80:0/230378292 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:56.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5620ca8700 1 -- 172.21.15.80:0/230378292 >> v1:172.21.15.174:6789/0 conn(0x7f561c07bba0 legacy=0x7f561c167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5620ca8700 1 -- 172.21.15.80:0/230378292 >> v1:172.21.15.80:6789/0 conn(0x7f561c074d00 legacy=0x7f561c07aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5620ca8700 1 -- 172.21.15.80:0/230378292 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561c0792e0 con 0x7f561c150f50 2019-11-28T11:32:56.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5619ffb700 1 -- 172.21.15.80:0/230378292 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801205599 0 0) 0x7f560c007970 con 0x7f561c074d00 2019-11-28T11:32:56.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5620ca8700 1 --2- 172.21.15.80:0/230378292 >> v2:172.21.15.80:3300/0 conn(0x7f561c150f50 0x7f561c07b220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5604010360 tx=0x7f5604010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5620ca8700 1 --2- 172.21.15.80:0/230378292 >> v2:172.21.15.80:3300/0 conn(0x7f561c150f50 0x7f561c07b220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5604010360 tx=0x7f5604010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5620ca8700 1 --2- 172.21.15.80:0/230378292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f561c150f50 0x7f561c07b220 secure :-1 s=READY pgs=876 cs=0 l=1 rx=0x7f5604010360 tx=0x7f5604010700).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:56.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5620ca8700 1 --2- 172.21.15.80:0/230378292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f561c150f50 0x7f561c07b220 secure :-1 s=THROTTLE_DONE pgs=876 cs=0 l=1 rx=0x7f5604010360 tx=0x7f5604010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5619ffb700 1 -- 172.21.15.80:0/230378292 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5604000f20 con 0x7f561c150f50 2019-11-28T11:32:56.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5620ca8700 1 --2- 172.21.15.80:0/230378292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f561c150f50 0x7f561c07b220 secure :-1 s=THROTTLE_DONE pgs=876 cs=0 l=1 rx=0x7f5604010360 tx=0x7f5604010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5620ca8700 1 --2- 172.21.15.80:0/230378292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f561c150f50 0x7f561c07b220 secure :-1 s=THROTTLE_DONE pgs=876 cs=0 l=1 rx=0x7f5604010360 tx=0x7f5604010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5619ffb700 1 -- 172.21.15.80:0/230378292 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56040011a0 con 0x7f561c150f50 2019-11-28T11:32:56.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5622f0c700 1 -- 172.21.15.80:0/230378292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561c079660 con 0x7f561c150f50 2019-11-28T11:32:56.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5619ffb700 1 -- 172.21.15.80:0/230378292 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5604004810 con 0x7f561c150f50 2019-11-28T11:32:56.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.774+0000 7f5622f0c700 1 -- 172.21.15.80:0/230378292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561c0792e0 con 0x7f561c150f50 2019-11-28T11:32:56.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.775+0000 7f5620ca8700 1 --2- 172.21.15.80:0/230378292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f561c150f50 0x7f561c07b220 secure :-1 s=THROTTLE_DONE pgs=876 cs=0 l=1 rx=0x7f5604010360 tx=0x7f5604010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.775+0000 7f5619ffb700 1 -- 172.21.15.80:0/230378292 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5604004240 con 0x7f561c150f50 2019-11-28T11:32:56.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.775+0000 7f5620ca8700 1 --2- 172.21.15.80:0/230378292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f561c150f50 0x7f561c07b220 secure :-1 s=THROTTLE_DONE pgs=876 cs=0 l=1 rx=0x7f5604010360 tx=0x7f5604010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.775+0000 7f5619ffb700 1 --2- 172.21.15.80:0/230378292 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5600018730 0x7f560001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:56.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.775+0000 7f5619ffb700 1 -- 172.21.15.80:0/230378292 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f5604031aa0 con 0x7f561c150f50 2019-11-28T11:32:56.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.775+0000 7f56214a9700 1 --2- 172.21.15.80:0/230378292 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5600018730 0x7f560001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:56.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.776+0000 7f56214a9700 1 --2- 172.21.15.80:0/230378292 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5600018730 0x7f560001abc0 crc :-1 s=READY pgs=361 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:56.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.782+0000 7f5622f0c700 1 -- 172.21.15.80:0/230378292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561c079660 con 0x7f561c150f50 2019-11-28T11:32:56.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.786+0000 7f5620ca8700 1 --2- 172.21.15.80:0/230378292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f561c150f50 0x7f561c07b220 secure :-1 s=THROTTLE_DONE pgs=876 cs=0 l=1 rx=0x7f5604010360 tx=0x7f5604010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.786+0000 7f5619ffb700 1 -- 172.21.15.80:0/230378292 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5604000c90 con 0x7f561c150f50 2019-11-28T11:32:56.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.950+0000 7f5622f0c700 1 -- 172.21.15.80:0/230378292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f561c0792e0 con 0x7f561c150f50 2019-11-28T11:32:56.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.950+0000 7f5620ca8700 1 --2- 172.21.15.80:0/230378292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f561c150f50 0x7f561c07b220 secure :-1 s=THROTTLE_DONE pgs=876 cs=0 l=1 rx=0x7f5604010360 tx=0x7f5604010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:56.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.950+0000 7f5619ffb700 1 -- 172.21.15.80:0/230378292 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) v1 ==== 84+0+64 (secure 0 0 0) 0x7f560401f880 con 0x7f561c150f50 2019-11-28T11:32:56.995 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:32:56.996 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:32:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:32:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:32:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:32:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:32:56.998 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:32:56.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.953+0000 7f5622f0c700 1 -- 172.21.15.80:0/230378292 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5600018730 msgr2=0x7f560001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.953+0000 7f5622f0c700 1 --2- 172.21.15.80:0/230378292 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5600018730 0x7f560001abc0 crc :-1 s=READY pgs=361 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:56.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.953+0000 7f5622f0c700 1 -- 172.21.15.80:0/230378292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f561c150f50 msgr2=0x7f561c07b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:56.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.953+0000 7f5622f0c700 1 --2- 172.21.15.80:0/230378292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f561c150f50 0x7f561c07b220 secure :-1 s=READY pgs=876 cs=0 l=1 rx=0x7f5604010360 tx=0x7f5604010700).stop 2019-11-28T11:32:56.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.953+0000 7f5622f0c700 1 -- 172.21.15.80:0/230378292 shutdown_connections 2019-11-28T11:32:57.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.953+0000 7f5622f0c700 1 --2- 172.21.15.80:0/230378292 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5600018730 0x7f560001abc0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:57.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.953+0000 7f5622f0c700 1 --2- 172.21.15.80:0/230378292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f561c150f50 0x7f561c07b220 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:57.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.953+0000 7f5622f0c700 1 -- 172.21.15.80:0/230378292 shutdown_connections 2019-11-28T11:32:57.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.953+0000 7f5622f0c700 1 -- 172.21.15.80:0/230378292 wait complete. 2019-11-28T11:32:57.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:56.953+0000 7f5622f0c700 1 -- 172.21.15.80:0/230378292 >> 172.21.15.80:0/230378292 conn(0x7f561c13fa50 msgr2=0x7f561c07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:57.009 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:32:57.009 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:32:57.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.088+0000 7f5ad8fa6700 1 Processor -- start 2019-11-28T11:32:57.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.088+0000 7f5ad8fa6700 1 -- start start 2019-11-28T11:32:57.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.089+0000 7f5ad8fa6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5ad415ed10 0x7f5ad415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:57.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.089+0000 7f5ad8fa6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5ad40734b0 0x7f5ad40726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:57.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.089+0000 7f5ad8fa6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad406db60 con 0x7f5ad4073020 2019-11-28T11:32:57.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.089+0000 7f5ad8fa6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad406fe00 con 0x7f5ad415ed10 2019-11-28T11:32:57.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.089+0000 7f5ad8fa6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad40700d0 con 0x7f5ad40734b0 2019-11-28T11:32:57.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.089+0000 7f5ad2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5ad415ed10 0x7f5ad415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:57.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5ad415ed10 0x7f5ad415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35448/0 (socket says 172.21.15.80:35448) 2019-11-28T11:32:57.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad2d9d700 1 -- 172.21.15.80:0/4294023789 learned_addr learned my addr 172.21.15.80:0/4294023789 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:57.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad359e700 1 --2- 172.21.15.80:0/4294023789 >> v2:172.21.15.174:3300/0 conn(0x7f5ad40734b0 0x7f5ad40726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:57.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad2d9d700 1 -- 172.21.15.80:0/4294023789 >> v2:172.21.15.174:3300/0 conn(0x7f5ad40734b0 msgr2=0x7f5ad40726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:57.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad2d9d700 1 --2- 172.21.15.80:0/4294023789 >> v2:172.21.15.174:3300/0 conn(0x7f5ad40734b0 0x7f5ad40726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:57.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad2d9d700 1 -- 172.21.15.80:0/4294023789 >> v1:172.21.15.174:6789/0 conn(0x7f5ad4073020 legacy=0x7f5ad4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:57.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad2d9d700 1 -- 172.21.15.80:0/4294023789 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad4070760 con 0x7f5ad415ed10 2019-11-28T11:32:57.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad359e700 1 --2- 172.21.15.80:0/4294023789 >> v2:172.21.15.174:3300/0 conn(0x7f5ad40734b0 0x7f5ad40726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:32:57.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad2d9d700 1 --2- 172.21.15.80:0/4294023789 >> v2:172.21.15.80:3300/0 conn(0x7f5ad415ed10 0x7f5ad415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5acc00fac0 tx=0x7f5acc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad2d9d700 1 --2- 172.21.15.80:0/4294023789 >> v2:172.21.15.80:3300/0 conn(0x7f5ad415ed10 0x7f5ad415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5acc00fac0 tx=0x7f5acc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad2d9d700 1 --2- 172.21.15.80:0/4294023789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad415ed10 0x7f5ad415f100 secure :-1 s=READY pgs=877 cs=0 l=1 rx=0x7f5acc00fac0 tx=0x7f5acc00fe60).ready entity=mon.0 client_cookie=9697544f77e5737e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:57.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad2d9d700 1 --2- 172.21.15.80:0/4294023789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad415ed10 0x7f5ad415f100 secure :-1 s=THROTTLE_DONE pgs=877 cs=0 l=1 rx=0x7f5acc00fac0 tx=0x7f5acc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad2d9d700 1 --2- 172.21.15.80:0/4294023789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad415ed10 0x7f5ad415f100 secure :-1 s=THROTTLE_DONE pgs=877 cs=0 l=1 rx=0x7f5acc00fac0 tx=0x7f5acc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad2d9d700 1 --2- 172.21.15.80:0/4294023789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad415ed10 0x7f5ad415f100 secure :-1 s=THROTTLE_DONE pgs=877 cs=0 l=1 rx=0x7f5acc00fac0 tx=0x7f5acc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad1d9b700 1 -- 172.21.15.80:0/4294023789 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5acc000ce0 con 0x7f5ad415ed10 2019-11-28T11:32:57.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad1d9b700 1 -- 172.21.15.80:0/4294023789 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc001010 con 0x7f5ad415ed10 2019-11-28T11:32:57.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad1d9b700 1 -- 172.21.15.80:0/4294023789 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5acc001720 con 0x7f5ad415ed10 2019-11-28T11:32:57.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad8fa6700 1 -- 172.21.15.80:0/4294023789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad415ed10 msgr2=0x7f5ad415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:57.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.090+0000 7f5ad8fa6700 1 --2- 172.21.15.80:0/4294023789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad415ed10 0x7f5ad415f100 secure :-1 s=READY pgs=877 cs=0 l=1 rx=0x7f5acc00fac0 tx=0x7f5acc00fe60).stop 2019-11-28T11:32:57.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.091+0000 7f5ad8fa6700 1 -- 172.21.15.80:0/4294023789 shutdown_connections 2019-11-28T11:32:57.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.091+0000 7f5ad8fa6700 1 --2- 172.21.15.80:0/4294023789 >> v2:172.21.15.174:3300/0 conn(0x7f5ad40734b0 0x7f5ad40726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:57.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.091+0000 7f5ad8fa6700 1 --2- 172.21.15.80:0/4294023789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad415ed10 0x7f5ad415f100 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:57.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.091+0000 7f5ad8fa6700 1 -- 172.21.15.80:0/4294023789 shutdown_connections 2019-11-28T11:32:57.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.091+0000 7f5ad8fa6700 1 -- 172.21.15.80:0/4294023789 wait complete. 2019-11-28T11:32:57.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.091+0000 7f5ad8fa6700 1 -- 172.21.15.80:0/4294023789 >> 172.21.15.80:0/4294023789 conn(0x7f5ad4061d20 msgr2=0x7f5ad40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:57.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.093+0000 7f5ad8fa6700 1 Processor -- start 2019-11-28T11:32:57.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.094+0000 7f5ad8fa6700 1 -- start start 2019-11-28T11:32:57.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.094+0000 7f5ad8fa6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ad415faf0 0x7f5ad41573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:57.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.094+0000 7f5ad8fa6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5ad41578e0 0x7f5ad4148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:57.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.094+0000 7f5ad8fa6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5ad4148580 0x7f5ad4148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:57.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.094+0000 7f5ad8fa6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad4110f50 con 0x7f5ad41578e0 2019-11-28T11:32:57.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.094+0000 7f5ad8fa6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad415cb20 con 0x7f5ad4148580 2019-11-28T11:32:57.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.094+0000 7f5ad8fa6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad41122e0 con 0x7f5ad415faf0 2019-11-28T11:32:57.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.094+0000 7f5ad259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5ad41578e0 0x7f5ad4148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:57.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.094+0000 7f5ad259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5ad41578e0 0x7f5ad4148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35456/0 (socket says 172.21.15.80:35456) 2019-11-28T11:32:57.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.094+0000 7f5ad259c700 1 -- 172.21.15.80:0/3292561682 learned_addr learned my addr 172.21.15.80:0/3292561682 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:57.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad359e700 1 --2- 172.21.15.80:0/3292561682 >> v2:172.21.15.174:3300/0 conn(0x7f5ad4148580 0x7f5ad4148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:57.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad2d9d700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ad415faf0 0x7f5ad41573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:57.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad259c700 1 -- 172.21.15.80:0/3292561682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ad415faf0 msgr2=0x7f5ad41573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:57.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad259c700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ad415faf0 0x7f5ad41573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:57.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad259c700 1 -- 172.21.15.80:0/3292561682 >> v2:172.21.15.174:3300/0 conn(0x7f5ad4148580 msgr2=0x7f5ad4148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:57.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad259c700 1 --2- 172.21.15.80:0/3292561682 >> v2:172.21.15.174:3300/0 conn(0x7f5ad4148580 0x7f5ad4148a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:57.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad259c700 1 -- 172.21.15.80:0/3292561682 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad4112660 con 0x7f5ad41578e0 2019-11-28T11:32:57.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad2d9d700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ad415faf0 0x7f5ad41573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:32:57.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad359e700 1 --2- 172.21.15.80:0/3292561682 >> v2:172.21.15.174:3300/0 conn(0x7f5ad4148580 0x7f5ad4148a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:32:57.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad259c700 1 --2- 172.21.15.80:0/3292561682 >> v2:172.21.15.80:3300/0 conn(0x7f5ad41578e0 0x7f5ad4148040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5abc010410 tx=0x7f5abc0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad259c700 1 --2- 172.21.15.80:0/3292561682 >> v2:172.21.15.80:3300/0 conn(0x7f5ad41578e0 0x7f5ad4148040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5abc010410 tx=0x7f5abc0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad259c700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad41578e0 0x7f5ad4148040 secure :-1 s=READY pgs=878 cs=0 l=1 rx=0x7f5abc010410 tx=0x7f5abc0107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:57.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad259c700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad41578e0 0x7f5ad4148040 secure :-1 s=THROTTLE_DONE pgs=878 cs=0 l=1 rx=0x7f5abc010410 tx=0x7f5abc0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad259c700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad41578e0 0x7f5ad4148040 secure :-1 s=THROTTLE_DONE pgs=878 cs=0 l=1 rx=0x7f5abc010410 tx=0x7f5abc0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5acb7fe700 1 -- 172.21.15.80:0/3292561682 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5abc000960 con 0x7f5ad41578e0 2019-11-28T11:32:57.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad259c700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad41578e0 0x7f5ad4148040 secure :-1 s=THROTTLE_DONE pgs=878 cs=0 l=1 rx=0x7f5abc010410 tx=0x7f5abc0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5acb7fe700 1 -- 172.21.15.80:0/3292561682 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc0010a0 con 0x7f5ad41578e0 2019-11-28T11:32:57.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5acb7fe700 1 -- 172.21.15.80:0/3292561682 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5abc001770 con 0x7f5ad41578e0 2019-11-28T11:32:57.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad8fa6700 1 -- 172.21.15.80:0/3292561682 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad4112660 con 0x7f5ad41578e0 2019-11-28T11:32:57.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad8fa6700 1 -- 172.21.15.80:0/3292561682 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad4112660 con 0x7f5ad41578e0 2019-11-28T11:32:57.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.095+0000 7f5ad259c700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad41578e0 0x7f5ad4148040 secure :-1 s=THROTTLE_DONE pgs=878 cs=0 l=1 rx=0x7f5abc010410 tx=0x7f5abc0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.096+0000 7f5acb7fe700 1 -- 172.21.15.80:0/3292561682 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5abc001290 con 0x7f5ad41578e0 2019-11-28T11:32:57.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.096+0000 7f5ad259c700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad41578e0 0x7f5ad4148040 secure :-1 s=THROTTLE_DONE pgs=878 cs=0 l=1 rx=0x7f5abc010410 tx=0x7f5abc0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.096+0000 7f5acb7fe700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5ab8018730 0x7f5ab801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:57.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.096+0000 7f5acb7fe700 1 -- 172.21.15.80:0/3292561682 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f5abc031a70 con 0x7f5ad41578e0 2019-11-28T11:32:57.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.096+0000 7f5ad2d9d700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5ab8018730 0x7f5ab801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:57.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.096+0000 7f5ad2d9d700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5ab8018730 0x7f5ab801abc0 crc :-1 s=READY pgs=362 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:57.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.103+0000 7f5ad8fa6700 1 -- 172.21.15.80:0/3292561682 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad4112660 con 0x7f5ad41578e0 2019-11-28T11:32:57.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.107+0000 7f5ad259c700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad41578e0 0x7f5ad4148040 secure :-1 s=THROTTLE_DONE pgs=878 cs=0 l=1 rx=0x7f5abc010410 tx=0x7f5abc0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.107+0000 7f5acb7fe700 1 -- 172.21.15.80:0/3292561682 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5abc0075b0 con 0x7f5ad41578e0 2019-11-28T11:32:57.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.275+0000 7f5ad8fa6700 1 -- 172.21.15.80:0/3292561682 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f5ad41122e0 con 0x7f5ad41578e0 2019-11-28T11:32:57.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.616+0000 7f5ad259c700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad41578e0 0x7f5ad4148040 secure :-1 s=THROTTLE_DONE pgs=878 cs=0 l=1 rx=0x7f5abc010410 tx=0x7f5abc0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.616+0000 7f5acb7fe700 1 -- 172.21.15.80:0/3292561682 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v75) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5abc017480 con 0x7f5ad41578e0 2019-11-28T11:32:57.682 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:32:57.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.641+0000 7f5ad8fa6700 1 -- 172.21.15.80:0/3292561682 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5ab8018730 msgr2=0x7f5ab801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:57.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.641+0000 7f5ad8fa6700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5ab8018730 0x7f5ab801abc0 crc :-1 s=READY pgs=362 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:57.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.641+0000 7f5ad8fa6700 1 -- 172.21.15.80:0/3292561682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad41578e0 msgr2=0x7f5ad4148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:57.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.641+0000 7f5ad8fa6700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad41578e0 0x7f5ad4148040 secure :-1 s=READY pgs=878 cs=0 l=1 rx=0x7f5abc010410 tx=0x7f5abc0107b0).stop 2019-11-28T11:32:57.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.641+0000 7f5ad8fa6700 1 -- 172.21.15.80:0/3292561682 shutdown_connections 2019-11-28T11:32:57.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.641+0000 7f5ad8fa6700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5ab8018730 0x7f5ab801abc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:57.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.641+0000 7f5ad8fa6700 1 --2- 172.21.15.80:0/3292561682 >> v2:172.21.15.174:3300/0 conn(0x7f5ad4148580 0x7f5ad4148a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:57.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.641+0000 7f5ad8fa6700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ad41578e0 0x7f5ad4148040 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:57.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.641+0000 7f5ad8fa6700 1 --2- 172.21.15.80:0/3292561682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ad415faf0 0x7f5ad41573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:57.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.641+0000 7f5ad8fa6700 1 -- 172.21.15.80:0/3292561682 shutdown_connections 2019-11-28T11:32:57.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.641+0000 7f5ad8fa6700 1 -- 172.21.15.80:0/3292561682 wait complete. 2019-11-28T11:32:57.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.641+0000 7f5ad8fa6700 1 -- 172.21.15.80:0/3292561682 >> 172.21.15.80:0/3292561682 conn(0x7f5ad407c4f0 msgr2=0x7f5ad415ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:57.694 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:32:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.774+0000 7f0208a8f700 1 Processor -- start 2019-11-28T11:32:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.774+0000 7f0208a8f700 1 -- start start 2019-11-28T11:32:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.775+0000 7f0208a8f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f020415ed10 0x7f020415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.775+0000 7f0208a8f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0204073020 0x7f0204071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:57.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.775+0000 7f0208a8f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020406db60 con 0x7f02040734b0 2019-11-28T11:32:57.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.775+0000 7f0208a8f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020406fe00 con 0x7f020415ed10 2019-11-28T11:32:57.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.775+0000 7f0208a8f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02040700d0 con 0x7f0204073020 2019-11-28T11:32:57.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0202d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f020415ed10 0x7f020415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:57.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f020359e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f02040734b0 0x7f02040723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34780/0 (socket says 172.21.15.80:34780) 2019-11-28T11:32:57.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f020359e700 1 -- 172.21.15.80:0/4120978163 learned_addr learned my addr 172.21.15.80:0/4120978163 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:57.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f020259c700 1 --2- 172.21.15.80:0/4120978163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0204073020 0x7f0204071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:57.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0202d9d700 1 -- 172.21.15.80:0/4120978163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0204073020 msgr2=0x7f0204071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:57.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0202d9d700 1 --2- 172.21.15.80:0/4120978163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0204073020 0x7f0204071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:57.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0202d9d700 1 -- 172.21.15.80:0/4120978163 >> v1:172.21.15.80:6789/0 conn(0x7f02040734b0 legacy=0x7f02040723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:57.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0201d9b700 1 -- 172.21.15.80:0/4120978163 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639322377 0 0) 0x7f01fc001150 con 0x7f02040734b0 2019-11-28T11:32:57.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0202d9d700 1 -- 172.21.15.80:0/4120978163 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0204070760 con 0x7f020415ed10 2019-11-28T11:32:57.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0202d9d700 1 --2- 172.21.15.80:0/4120978163 >> v2:172.21.15.80:3300/0 conn(0x7f020415ed10 0x7f020415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f01f400b2d0 tx=0x7f01f400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0202d9d700 1 --2- 172.21.15.80:0/4120978163 >> v2:172.21.15.80:3300/0 conn(0x7f020415ed10 0x7f020415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f01f400b2d0 tx=0x7f01f400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0202d9d700 1 --2- 172.21.15.80:0/4120978163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f020415ed10 0x7f020415f100 secure :-1 s=READY pgs=880 cs=0 l=1 rx=0x7f01f400b2d0 tx=0x7f01f400b5d0).ready entity=mon.0 client_cookie=4cab71b1e4c055f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:57.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0202d9d700 1 --2- 172.21.15.80:0/4120978163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f020415ed10 0x7f020415f100 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f01f400b2d0 tx=0x7f01f400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0201d9b700 1 -- 172.21.15.80:0/4120978163 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01f4007590 con 0x7f020415ed10 2019-11-28T11:32:57.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0202d9d700 1 --2- 172.21.15.80:0/4120978163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f020415ed10 0x7f020415f100 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f01f400b2d0 tx=0x7f01f400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0202d9d700 1 --2- 172.21.15.80:0/4120978163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f020415ed10 0x7f020415f100 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f01f400b2d0 tx=0x7f01f400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0201d9b700 1 -- 172.21.15.80:0/4120978163 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f4000cc0 con 0x7f020415ed10 2019-11-28T11:32:57.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0201d9b700 1 -- 172.21.15.80:0/4120978163 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01f4009f20 con 0x7f020415ed10 2019-11-28T11:32:57.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0208a8f700 1 -- 172.21.15.80:0/4120978163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f020415ed10 msgr2=0x7f020415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:57.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.776+0000 7f0208a8f700 1 --2- 172.21.15.80:0/4120978163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f020415ed10 0x7f020415f100 secure :-1 s=READY pgs=880 cs=0 l=1 rx=0x7f01f400b2d0 tx=0x7f01f400b5d0).stop 2019-11-28T11:32:57.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.777+0000 7f0208a8f700 1 -- 172.21.15.80:0/4120978163 shutdown_connections 2019-11-28T11:32:57.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.777+0000 7f0208a8f700 1 --2- 172.21.15.80:0/4120978163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0204073020 0x7f0204071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:57.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.777+0000 7f0208a8f700 1 --2- 172.21.15.80:0/4120978163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f020415ed10 0x7f020415f100 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:57.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.777+0000 7f0208a8f700 1 -- 172.21.15.80:0/4120978163 shutdown_connections 2019-11-28T11:32:57.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.777+0000 7f0208a8f700 1 -- 172.21.15.80:0/4120978163 wait complete. 2019-11-28T11:32:57.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.777+0000 7f0208a8f700 1 -- 172.21.15.80:0/4120978163 >> 172.21.15.80:0/4120978163 conn(0x7f0204061d20 msgr2=0x7f02040641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:57.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.779+0000 7f0208a8f700 1 Processor -- start 2019-11-28T11:32:57.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.780+0000 7f0208a8f700 1 -- start start 2019-11-28T11:32:57.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.780+0000 7f0208a8f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f020410e970 0x7f02041087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:57.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.780+0000 7f0208a8f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0204107e30 0x7f0204167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:57.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.780+0000 7f0208a8f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020410c250 con 0x7f0204108cf0 2019-11-28T11:32:57.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.780+0000 7f0208a8f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020410da00 con 0x7f0204107e30 2019-11-28T11:32:57.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.780+0000 7f0208a8f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020410e430 con 0x7f020410e970 2019-11-28T11:32:57.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.780+0000 7f020259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0204108cf0 0x7f0204107630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34786/0 (socket says 172.21.15.80:34786) 2019-11-28T11:32:57.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.780+0000 7f020259c700 1 -- 172.21.15.80:0/3366113151 learned_addr learned my addr 172.21.15.80:0/3366113151 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:57.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f0202d9d700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f020410e970 0x7f02041087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:57.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f020359e700 1 --2- 172.21.15.80:0/3366113151 >> v2:172.21.15.174:3300/0 conn(0x7f0204107e30 0x7f0204167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:57.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f01fb7fe700 1 -- 172.21.15.80:0/3366113151 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751786245 0 0) 0x7f01ec0057b0 con 0x7f0204108cf0 2019-11-28T11:32:57.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f01fb7fe700 1 -- 172.21.15.80:0/3366113151 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01e8002e80 con 0x7f0204108cf0 2019-11-28T11:32:57.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f01fb7fe700 1 -- 172.21.15.80:0/3366113151 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3478914720 0 0) 0x7f01ec0059b0 con 0x7f0204108cf0 2019-11-28T11:32:57.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f01fb7fe700 1 -- 172.21.15.80:0/3366113151 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f01e80032e0 con 0x7f0204108cf0 2019-11-28T11:32:57.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f01fb7fe700 1 -- 172.21.15.80:0/3366113151 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f01ec005f40 con 0x7f0204108cf0 2019-11-28T11:32:57.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f0202d9d700 1 -- 172.21.15.80:0/3366113151 >> v2:172.21.15.174:3300/0 conn(0x7f0204107e30 msgr2=0x7f0204167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:57.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f0202d9d700 1 --2- 172.21.15.80:0/3366113151 >> v2:172.21.15.174:3300/0 conn(0x7f0204107e30 0x7f0204167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:57.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f0202d9d700 1 -- 172.21.15.80:0/3366113151 >> v1:172.21.15.80:6789/0 conn(0x7f0204108cf0 legacy=0x7f0204107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:57.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f0202d9d700 1 -- 172.21.15.80:0/3366113151 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0204105ef0 con 0x7f020410e970 2019-11-28T11:32:57.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f0202d9d700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f020410e970 0x7f02041087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f01f4010710 tx=0x7f01f4010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f0202d9d700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f020410e970 0x7f02041087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f01f4010710 tx=0x7f01f4010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f0202d9d700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f020410e970 0x7f02041087b0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f01f4010710 tx=0x7f01f4010590).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:57.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f0202d9d700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f020410e970 0x7f02041087b0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f01f4010710 tx=0x7f01f4010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f01fb7fe700 1 -- 172.21.15.80:0/3366113151 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01f4000cc0 con 0x7f020410e970 2019-11-28T11:32:57.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f0202d9d700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f020410e970 0x7f02041087b0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f01f4010710 tx=0x7f01f4010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f0202d9d700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f020410e970 0x7f02041087b0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f01f4010710 tx=0x7f01f4010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f01fb7fe700 1 -- 172.21.15.80:0/3366113151 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f400ad00 con 0x7f020410e970 2019-11-28T11:32:57.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f0208a8f700 1 -- 172.21.15.80:0/3366113151 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0204106270 con 0x7f020410e970 2019-11-28T11:32:57.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f01fb7fe700 1 -- 172.21.15.80:0/3366113151 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01f4000cc0 con 0x7f020410e970 2019-11-28T11:32:57.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.781+0000 7f0208a8f700 1 -- 172.21.15.80:0/3366113151 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0204105ef0 con 0x7f020410e970 2019-11-28T11:32:57.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.782+0000 7f0202d9d700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f020410e970 0x7f02041087b0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f01f4010710 tx=0x7f01f4010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.782+0000 7f01fb7fe700 1 -- 172.21.15.80:0/3366113151 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f01f4009b10 con 0x7f020410e970 2019-11-28T11:32:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.782+0000 7f0202d9d700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f020410e970 0x7f02041087b0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f01f4010710 tx=0x7f01f4010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.782+0000 7f01fb7fe700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01e8018770 0x7f01e801ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.782+0000 7f01fb7fe700 1 -- 172.21.15.80:0/3366113151 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f01f4031d70 con 0x7f020410e970 2019-11-28T11:32:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.782+0000 7f020259c700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01e8018770 0x7f01e801ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.783+0000 7f020259c700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01e8018770 0x7f01e801ac00 crc :-1 s=READY pgs=363 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:57.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.790+0000 7f0208a8f700 1 -- 172.21.15.80:0/3366113151 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0204106270 con 0x7f020410e970 2019-11-28T11:32:57.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.794+0000 7f0202d9d700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f020410e970 0x7f02041087b0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f01f4010710 tx=0x7f01f4010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:57.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.794+0000 7f01fb7fe700 1 -- 172.21.15.80:0/3366113151 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f01f400abe0 con 0x7f020410e970 2019-11-28T11:32:58.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:57.961+0000 7f0208a8f700 1 -- 172.21.15.80:0/3366113151 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f0204105ef0 con 0x7f020410e970 2019-11-28T11:32:58.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.621+0000 7f0202d9d700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f020410e970 0x7f02041087b0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f01f4010710 tx=0x7f01f4010590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:58.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.621+0000 7f01fb7fe700 1 -- 172.21.15.80:0/3366113151 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v76) v1 ==== 125+0+0 (secure 0 0 0) 0x7f01f400abe0 con 0x7f020410e970 2019-11-28T11:32:58.771 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:32:58.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.628+0000 7f0208a8f700 1 -- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01e8018770 msgr2=0x7f01e801ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:58.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.628+0000 7f0208a8f700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01e8018770 0x7f01e801ac00 crc :-1 s=READY pgs=363 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:58.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.628+0000 7f0208a8f700 1 -- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f020410e970 msgr2=0x7f02041087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:58.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.628+0000 7f0208a8f700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f020410e970 0x7f02041087b0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f01f4010710 tx=0x7f01f4010590).stop 2019-11-28T11:32:58.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.628+0000 7f0208a8f700 1 -- 172.21.15.80:0/3366113151 shutdown_connections 2019-11-28T11:32:58.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.628+0000 7f0208a8f700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01e8018770 0x7f01e801ac00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:58.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.628+0000 7f0208a8f700 1 --2- 172.21.15.80:0/3366113151 >> v2:172.21.15.174:3300/0 conn(0x7f0204107e30 0x7f0204167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:58.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.628+0000 7f0208a8f700 1 --2- 172.21.15.80:0/3366113151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f020410e970 0x7f02041087b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:58.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.628+0000 7f0208a8f700 1 -- 172.21.15.80:0/3366113151 shutdown_connections 2019-11-28T11:32:58.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.628+0000 7f0208a8f700 1 -- 172.21.15.80:0/3366113151 wait complete. 2019-11-28T11:32:58.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.628+0000 7f0208a8f700 1 -- 172.21.15.80:0/3366113151 >> 172.21.15.80:0/3366113151 conn(0x7f020415e2d0 msgr2=0x7f0204147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:58.773 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:32:58.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.857+0000 7fac91f2b700 1 Processor -- start 2019-11-28T11:32:58.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.857+0000 7fac91f2b700 1 -- start start 2019-11-28T11:32:58.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.858+0000 7fac91f2b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac8c15ed10 0x7fac8c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:58.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.858+0000 7fac91f2b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fac8c073020 0x7fac8c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:58.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.858+0000 7fac91f2b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8c06db60 con 0x7fac8c0734b0 2019-11-28T11:32:58.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.858+0000 7fac91f2b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c06f3d0 con 0x7fac8c073020 2019-11-28T11:32:58.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.858+0000 7fac91f2b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c06fe00 con 0x7fac8c15ed10 2019-11-28T11:32:58.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.859+0000 7fac83fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fac8c073020 0x7fac8c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:58.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.859+0000 7fac8bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac8c15ed10 0x7fac8c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:58.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.859+0000 7fac90cc9700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fac8c0734b0 0x7fac8c0723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:50338/0 (socket says 172.21.15.80:50338) 2019-11-28T11:32:58.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.859+0000 7fac83fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fac8c073020 0x7fac8c071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:50362/0 (socket says 172.21.15.80:50362) 2019-11-28T11:32:58.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.859+0000 7fac8bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac8c15ed10 0x7fac8c15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:37736/0 (socket says 172.21.15.80:37736) 2019-11-28T11:32:58.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.859+0000 7fac90cc9700 1 -- 172.21.15.80:0/1192393932 learned_addr learned my addr 172.21.15.80:0/1192393932 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:58.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.859+0000 7fac8bfff700 1 -- 172.21.15.80:0/1192393932 >> v2:172.21.15.174:3300/0 conn(0x7fac8c073020 msgr2=0x7fac8c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:58.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.859+0000 7fac8bfff700 1 --2- 172.21.15.80:0/1192393932 >> v2:172.21.15.174:3300/0 conn(0x7fac8c073020 0x7fac8c071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:58.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.859+0000 7fac8bfff700 1 -- 172.21.15.80:0/1192393932 >> v1:172.21.15.174:6789/0 conn(0x7fac8c0734b0 legacy=0x7fac8c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:58.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.859+0000 7fac8b7fe700 1 -- 172.21.15.80:0/1192393932 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804153709 0 0) 0x7fac84001480 con 0x7fac8c0734b0 2019-11-28T11:32:58.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.859+0000 7fac8bfff700 1 -- 172.21.15.80:0/1192393932 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c070760 con 0x7fac8c15ed10 2019-11-28T11:32:58.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.859+0000 7fac83fff700 1 --2- 172.21.15.80:0/1192393932 >> v2:172.21.15.174:3300/0 conn(0x7fac8c073020 0x7fac8c071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:32:58.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.859+0000 7fac8bfff700 1 --2- 172.21.15.80:0/1192393932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac8c15ed10 0x7fac8c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fac7c00af50 tx=0x7fac7c00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:58.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.859+0000 7fac8bfff700 1 --2- 172.21.15.80:0/1192393932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac8c15ed10 0x7fac8c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fac7c00af50 tx=0x7fac7c00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:58.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.859+0000 7fac8bfff700 1 --2- 172.21.15.80:0/1192393932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac8c15ed10 0x7fac8c15f100 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fac7c00af50 tx=0x7fac7c00b250).ready entity=mon.2 client_cookie=64c4352187e92fca server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:58.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.859+0000 7fac8bfff700 1 --2- 172.21.15.80:0/1192393932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac8c15ed10 0x7fac8c15f100 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fac7c00af50 tx=0x7fac7c00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:58.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.860+0000 7fac8b7fe700 1 -- 172.21.15.80:0/1192393932 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac7c007210 con 0x7fac8c15ed10 2019-11-28T11:32:58.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.860+0000 7fac8bfff700 1 --2- 172.21.15.80:0/1192393932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac8c15ed10 0x7fac8c15f100 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fac7c00af50 tx=0x7fac7c00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:58.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.860+0000 7fac8b7fe700 1 -- 172.21.15.80:0/1192393932 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c0099b0 con 0x7fac8c15ed10 2019-11-28T11:32:58.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.860+0000 7fac8bfff700 1 --2- 172.21.15.80:0/1192393932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac8c15ed10 0x7fac8c15f100 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fac7c00af50 tx=0x7fac7c00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:58.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.860+0000 7fac8b7fe700 1 -- 172.21.15.80:0/1192393932 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac7c009ba0 con 0x7fac8c15ed10 2019-11-28T11:32:58.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.860+0000 7fac91f2b700 1 -- 172.21.15.80:0/1192393932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac8c15ed10 msgr2=0x7fac8c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:58.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.860+0000 7fac91f2b700 1 --2- 172.21.15.80:0/1192393932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac8c15ed10 0x7fac8c15f100 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fac7c00af50 tx=0x7fac7c00b250).stop 2019-11-28T11:32:58.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.860+0000 7fac91f2b700 1 -- 172.21.15.80:0/1192393932 shutdown_connections 2019-11-28T11:32:58.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.860+0000 7fac91f2b700 1 --2- 172.21.15.80:0/1192393932 >> v2:172.21.15.174:3300/0 conn(0x7fac8c073020 0x7fac8c071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:58.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.860+0000 7fac91f2b700 1 --2- 172.21.15.80:0/1192393932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac8c15ed10 0x7fac8c15f100 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:58.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.860+0000 7fac91f2b700 1 -- 172.21.15.80:0/1192393932 shutdown_connections 2019-11-28T11:32:58.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.860+0000 7fac91f2b700 1 -- 172.21.15.80:0/1192393932 wait complete. 2019-11-28T11:32:58.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.860+0000 7fac91f2b700 1 -- 172.21.15.80:0/1192393932 >> 172.21.15.80:0/1192393932 conn(0x7fac8c061d20 msgr2=0x7fac8c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:58.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.863+0000 7fac91f2b700 1 Processor -- start 2019-11-28T11:32:58.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.863+0000 7fac91f2b700 1 -- start start 2019-11-28T11:32:58.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac91f2b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fac8c10f9f0 0x7fac8c168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:58.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac91f2b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8c10c250 con 0x7fac8c10ed60 2019-11-28T11:32:58.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac91f2b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8c10fe70 con 0x7fac8c10e970 2019-11-28T11:32:58.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac91f2b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c10e430 con 0x7fac8c10f9f0 2019-11-28T11:32:58.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac90cc9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fac8c10f9f0 0x7fac8c168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:58.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac90cc9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fac8c10f9f0 0x7fac8c168d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35484/0 (socket says 172.21.15.80:35484) 2019-11-28T11:32:58.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac90cc9700 1 -- 172.21.15.80:0/1288345532 learned_addr learned my addr 172.21.15.80:0/1288345532 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:58.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac897fa700 1 -- 172.21.15.80:0/1288345532 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295314339 0 0) 0x7fac7c00ae10 con 0x7fac8c10e970 2019-11-28T11:32:58.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac90cc9700 1 -- 172.21.15.80:0/1288345532 >> v1:172.21.15.174:6789/0 conn(0x7fac8c10e970 legacy=0x7fac8c1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:58.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac90cc9700 1 -- 172.21.15.80:0/1288345532 >> v1:172.21.15.80:6789/0 conn(0x7fac8c10ed60 legacy=0x7fac8c10f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:58.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac90cc9700 1 -- 172.21.15.80:0/1288345532 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c105ef0 con 0x7fac8c10f9f0 2019-11-28T11:32:58.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac90cc9700 1 --2- 172.21.15.80:0/1288345532 >> v2:172.21.15.80:3300/0 conn(0x7fac8c10f9f0 0x7fac8c168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac840107c0 tx=0x7fac84010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:58.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac90cc9700 1 --2- 172.21.15.80:0/1288345532 >> v2:172.21.15.80:3300/0 conn(0x7fac8c10f9f0 0x7fac8c168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac840107c0 tx=0x7fac84010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac90cc9700 1 --2- 172.21.15.80:0/1288345532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac8c10f9f0 0x7fac8c168d80 secure :-1 s=READY pgs=883 cs=0 l=1 rx=0x7fac840107c0 tx=0x7fac84010b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac90cc9700 1 --2- 172.21.15.80:0/1288345532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac8c10f9f0 0x7fac8c168d80 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7fac840107c0 tx=0x7fac84010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac897fa700 1 -- 172.21.15.80:0/1288345532 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac84001270 con 0x7fac8c10f9f0 2019-11-28T11:32:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac90cc9700 1 --2- 172.21.15.80:0/1288345532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac8c10f9f0 0x7fac8c168d80 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7fac840107c0 tx=0x7fac84010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac91f2b700 1 -- 172.21.15.80:0/1288345532 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8c106270 con 0x7fac8c10f9f0 2019-11-28T11:32:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac897fa700 1 -- 172.21.15.80:0/1288345532 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac84001270 con 0x7fac8c10f9f0 2019-11-28T11:32:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac90cc9700 1 --2- 172.21.15.80:0/1288345532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac8c10f9f0 0x7fac8c168d80 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7fac840107c0 tx=0x7fac84010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:58.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac897fa700 1 -- 172.21.15.80:0/1288345532 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac84004730 con 0x7fac8c10f9f0 2019-11-28T11:32:58.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.864+0000 7fac91f2b700 1 -- 172.21.15.80:0/1288345532 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8c105ef0 con 0x7fac8c10f9f0 2019-11-28T11:32:58.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.865+0000 7fac90cc9700 1 --2- 172.21.15.80:0/1288345532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac8c10f9f0 0x7fac8c168d80 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7fac840107c0 tx=0x7fac84010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:58.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.865+0000 7fac897fa700 1 -- 172.21.15.80:0/1288345532 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fac84004540 con 0x7fac8c10f9f0 2019-11-28T11:32:58.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.865+0000 7fac90cc9700 1 --2- 172.21.15.80:0/1288345532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac8c10f9f0 0x7fac8c168d80 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7fac840107c0 tx=0x7fac84010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:58.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.865+0000 7fac897fa700 1 --2- 172.21.15.80:0/1288345532 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fac70018730 0x7fac7001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:58.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.865+0000 7fac897fa700 1 -- 172.21.15.80:0/1288345532 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5904+0+0 (secure 0 0 0) 0x7fac84031ef0 con 0x7fac8c10f9f0 2019-11-28T11:32:58.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.865+0000 7fac8bfff700 1 --2- 172.21.15.80:0/1288345532 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fac70018730 0x7fac7001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:58.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.866+0000 7fac8bfff700 1 --2- 172.21.15.80:0/1288345532 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fac70018730 0x7fac7001abc0 crc :-1 s=READY pgs=364 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:58.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.872+0000 7fac91f2b700 1 -- 172.21.15.80:0/1288345532 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8c106270 con 0x7fac8c10f9f0 2019-11-28T11:32:58.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.876+0000 7fac90cc9700 1 --2- 172.21.15.80:0/1288345532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac8c10f9f0 0x7fac8c168d80 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7fac840107c0 tx=0x7fac84010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:58.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:58.876+0000 7fac897fa700 1 -- 172.21.15.80:0/1288345532 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fac84000f90 con 0x7fac8c10f9f0 2019-11-28T11:32:59.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.042+0000 7fac91f2b700 1 -- 172.21.15.80:0/1288345532 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7fac8c105ef0 con 0x7fac8c10f9f0 2019-11-28T11:32:59.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.046+0000 7fac90cc9700 1 --2- 172.21.15.80:0/1288345532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac8c10f9f0 0x7fac8c168d80 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7fac840107c0 tx=0x7fac84010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.046+0000 7fac897fa700 1 -- 172.21.15.80:0/1288345532 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 12 and data pool 13 v42) v1 ==== 174+0+0 (secure 0 0 0) 0x7fac8401fd10 con 0x7fac8c10f9f0 2019-11-28T11:32:59.091 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:32:59.043+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:32:59.093 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 12 and data pool 13 2019-11-28T11:32:59.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.052+0000 7fac91f2b700 1 -- 172.21.15.80:0/1288345532 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fac70018730 msgr2=0x7fac7001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.052+0000 7fac91f2b700 1 --2- 172.21.15.80:0/1288345532 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fac70018730 0x7fac7001abc0 crc :-1 s=READY pgs=364 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.052+0000 7fac91f2b700 1 -- 172.21.15.80:0/1288345532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac8c10f9f0 msgr2=0x7fac8c168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.052+0000 7fac91f2b700 1 --2- 172.21.15.80:0/1288345532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac8c10f9f0 0x7fac8c168d80 secure :-1 s=READY pgs=883 cs=0 l=1 rx=0x7fac840107c0 tx=0x7fac84010b60).stop 2019-11-28T11:32:59.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.052+0000 7fac91f2b700 1 -- 172.21.15.80:0/1288345532 shutdown_connections 2019-11-28T11:32:59.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.052+0000 7fac91f2b700 1 --2- 172.21.15.80:0/1288345532 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac8c10f9f0 0x7fac8c168d80 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.052+0000 7fac91f2b700 1 --2- 172.21.15.80:0/1288345532 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fac70018730 0x7fac7001abc0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.052+0000 7fac91f2b700 1 -- 172.21.15.80:0/1288345532 shutdown_connections 2019-11-28T11:32:59.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.052+0000 7fac91f2b700 1 -- 172.21.15.80:0/1288345532 wait complete. 2019-11-28T11:32:59.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.052+0000 7fac91f2b700 1 -- 172.21.15.80:0/1288345532 >> 172.21.15.80:0/1288345532 conn(0x7fac8c15e2d0 msgr2=0x7fac8c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:59.105 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:32:59.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.181+0000 7fae37e72700 1 Processor -- start 2019-11-28T11:32:59.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.181+0000 7fae37e72700 1 -- start start 2019-11-28T11:32:59.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.182+0000 7fae37e72700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fae3006c0a0 0x7fae30072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:59.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.182+0000 7fae37e72700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae300734e0 0x7fae30071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:59.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.182+0000 7fae37e72700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3006db00 con 0x7fae30072360 2019-11-28T11:32:59.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.182+0000 7fae37e72700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3006fd60 con 0x7fae3006c0a0 2019-11-28T11:32:59.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.182+0000 7fae37e72700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae30070030 con 0x7fae300734e0 2019-11-28T11:32:59.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3640f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fae3006c0a0 0x7fae30072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3640f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fae3006c0a0 0x7fae30072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35488/0 (socket says 172.21.15.80:35488) 2019-11-28T11:32:59.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae36c10700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fae30072360 0x7fae3006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34806/0 (socket says 172.21.15.80:34806) 2019-11-28T11:32:59.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3640f700 1 -- 172.21.15.80:0/248391045 learned_addr learned my addr 172.21.15.80:0/248391045 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:59.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae35c0e700 1 --2- 172.21.15.80:0/248391045 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae300734e0 0x7fae30071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3640f700 1 -- 172.21.15.80:0/248391045 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae300734e0 msgr2=0x7fae30071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:59.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3640f700 1 --2- 172.21.15.80:0/248391045 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae300734e0 0x7fae30071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:59.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3640f700 1 -- 172.21.15.80:0/248391045 >> v1:172.21.15.80:6789/0 conn(0x7fae30072360 legacy=0x7fae3006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3540d700 1 -- 172.21.15.80:0/248391045 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543706909 0 0) 0x7fae280009b0 con 0x7fae30072360 2019-11-28T11:32:59.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3640f700 1 -- 172.21.15.80:0/248391045 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae300706c0 con 0x7fae3006c0a0 2019-11-28T11:32:59.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae35c0e700 1 --2- 172.21.15.80:0/248391045 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae300734e0 0x7fae30071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:32:59.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3640f700 1 --2- 172.21.15.80:0/248391045 >> v2:172.21.15.80:3300/0 conn(0x7fae3006c0a0 0x7fae30072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae2000f740 tx=0x7fae2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3640f700 1 --2- 172.21.15.80:0/248391045 >> v2:172.21.15.80:3300/0 conn(0x7fae3006c0a0 0x7fae30072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae2000f740 tx=0x7fae2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3640f700 1 --2- 172.21.15.80:0/248391045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae3006c0a0 0x7fae30072fa0 secure :-1 s=READY pgs=885 cs=0 l=1 rx=0x7fae2000f740 tx=0x7fae2000fae0).ready entity=mon.0 client_cookie=7b9c4540b29e0ed4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:59.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3640f700 1 --2- 172.21.15.80:0/248391045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae3006c0a0 0x7fae30072fa0 secure :-1 s=THROTTLE_DONE pgs=885 cs=0 l=1 rx=0x7fae2000f740 tx=0x7fae2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3540d700 1 -- 172.21.15.80:0/248391045 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae20000960 con 0x7fae3006c0a0 2019-11-28T11:32:59.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3640f700 1 --2- 172.21.15.80:0/248391045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae3006c0a0 0x7fae30072fa0 secure :-1 s=THROTTLE_DONE pgs=885 cs=0 l=1 rx=0x7fae2000f740 tx=0x7fae2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3540d700 1 -- 172.21.15.80:0/248391045 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae20000c90 con 0x7fae3006c0a0 2019-11-28T11:32:59.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3640f700 1 --2- 172.21.15.80:0/248391045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae3006c0a0 0x7fae30072fa0 secure :-1 s=THROTTLE_DONE pgs=885 cs=0 l=1 rx=0x7fae2000f740 tx=0x7fae2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae3540d700 1 -- 172.21.15.80:0/248391045 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae20007210 con 0x7fae3006c0a0 2019-11-28T11:32:59.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae37e72700 1 -- 172.21.15.80:0/248391045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae3006c0a0 msgr2=0x7fae30072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.183+0000 7fae37e72700 1 --2- 172.21.15.80:0/248391045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae3006c0a0 0x7fae30072fa0 secure :-1 s=READY pgs=885 cs=0 l=1 rx=0x7fae2000f740 tx=0x7fae2000fae0).stop 2019-11-28T11:32:59.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.184+0000 7fae37e72700 1 -- 172.21.15.80:0/248391045 shutdown_connections 2019-11-28T11:32:59.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.184+0000 7fae37e72700 1 --2- 172.21.15.80:0/248391045 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae300734e0 0x7fae30071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:59.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.184+0000 7fae37e72700 1 --2- 172.21.15.80:0/248391045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae3006c0a0 0x7fae30072fa0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.184+0000 7fae37e72700 1 -- 172.21.15.80:0/248391045 shutdown_connections 2019-11-28T11:32:59.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.184+0000 7fae37e72700 1 -- 172.21.15.80:0/248391045 wait complete. 2019-11-28T11:32:59.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.184+0000 7fae37e72700 1 -- 172.21.15.80:0/248391045 >> 172.21.15.80:0/248391045 conn(0x7fae30061cf0 msgr2=0x7fae30064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:59.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.187+0000 7fae37e72700 1 Processor -- start 2019-11-28T11:32:59.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.187+0000 7fae37e72700 1 -- start start 2019-11-28T11:32:59.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.187+0000 7fae37e72700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae3013eb40 0x7fae3010afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:59.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.187+0000 7fae37e72700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae301631f0 0x7fae30105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:59.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.187+0000 7fae37e72700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3013f1e0 con 0x7fae3010b500 2019-11-28T11:32:59.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.187+0000 7fae37e72700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae301234c0 con 0x7fae301631f0 2019-11-28T11:32:59.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.187+0000 7fae37e72700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3013d6a0 con 0x7fae3013eb40 2019-11-28T11:32:59.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae35c0e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fae3010b500 0x7fae301629f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34810/0 (socket says 172.21.15.80:34810) 2019-11-28T11:32:59.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae35c0e700 1 -- 172.21.15.80:0/2311498475 learned_addr learned my addr 172.21.15.80:0/2311498475 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:59.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437345214 0 0) 0x7fae18001220 con 0x7fae3010b500 2019-11-28T11:32:59.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae14002e80 con 0x7fae3010b500 2019-11-28T11:32:59.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae3640f700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae3013eb40 0x7fae3010afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae36c10700 1 --2- 172.21.15.80:0/2311498475 >> v2:172.21.15.174:3300/0 conn(0x7fae301631f0 0x7fae30105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2558582351 0 0) 0x7fae18000cc0 con 0x7fae3010b500 2019-11-28T11:32:59.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fae140032e0 con 0x7fae3010b500 2019-11-28T11:32:59.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fae18001650 con 0x7fae3010b500 2019-11-28T11:32:59.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae3013eb40 msgr2=0x7fae3010afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae2effd700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae3013eb40 0x7fae3010afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 >> v2:172.21.15.174:3300/0 conn(0x7fae301631f0 msgr2=0x7fae30105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae2effd700 1 --2- 172.21.15.80:0/2311498475 >> v2:172.21.15.174:3300/0 conn(0x7fae301631f0 0x7fae30105210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 >> v1:172.21.15.80:6789/0 conn(0x7fae3010b500 legacy=0x7fae301629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae2effd700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae14003950 0x7fae14005d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:59.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae2effd700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae14006290 0x7fae14008690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:59.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae2effd700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae14008df0 0x7fae1400b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:59.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1400bad0 con 0x7fae14006290 2019-11-28T11:32:59.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1400bd00 con 0x7fae14008df0 2019-11-28T11:32:59.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1400bf30 con 0x7fae14003950 2019-11-28T11:32:59.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae35c0e700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae14006290 0x7fae14008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae3640f700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae14003950 0x7fae14005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae36c10700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae14008df0 0x7fae1400b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae35c0e700 1 -- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae14003950 msgr2=0x7fae14005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.188+0000 7fae35c0e700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae14003950 0x7fae14005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae35c0e700 1 -- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae14008df0 msgr2=0x7fae1400b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae35c0e700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae14008df0 0x7fae1400b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae35c0e700 1 -- 172.21.15.80:0/2311498475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1400c1e0 con 0x7fae14006290 2019-11-28T11:32:59.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae36c10700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae14008df0 0x7fae1400b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:32:59.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae37e72700 1 -- 172.21.15.80:0/2311498475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae30108a80 con 0x7fae14006290 2019-11-28T11:32:59.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae35c0e700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae14006290 0x7fae14008690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae180107e0 tx=0x7fae18010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae37e72700 1 -- 172.21.15.80:0/2311498475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae30108700 con 0x7fae14006290 2019-11-28T11:32:59.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae35c0e700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae14006290 0x7fae14008690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae180107e0 tx=0x7fae18010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae35c0e700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae14006290 0x7fae14008690 secure :-1 s=READY pgs=887 cs=0 l=1 rx=0x7fae180107e0 tx=0x7fae18010610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae35c0e700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae14006290 0x7fae14008690 secure :-1 s=THROTTLE_DONE pgs=887 cs=0 l=1 rx=0x7fae180107e0 tx=0x7fae18010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae18001010 con 0x7fae14006290 2019-11-28T11:32:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae35c0e700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae14006290 0x7fae14008690 secure :-1 s=THROTTLE_DONE pgs=887 cs=0 l=1 rx=0x7fae180107e0 tx=0x7fae18010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae35c0e700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae14006290 0x7fae14008690 secure :-1 s=THROTTLE_DONE pgs=887 cs=0 l=1 rx=0x7fae180107e0 tx=0x7fae18010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae18001620 con 0x7fae14006290 2019-11-28T11:32:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae18001c70 con 0x7fae14006290 2019-11-28T11:32:59.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae35c0e700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae14006290 0x7fae14008690 secure :-1 s=THROTTLE_DONE pgs=887 cs=0 l=1 rx=0x7fae180107e0 tx=0x7fae18010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fae18001e90 con 0x7fae14006290 2019-11-28T11:32:59.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae35c0e700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae14006290 0x7fae14008690 secure :-1 s=THROTTLE_DONE pgs=887 cs=0 l=1 rx=0x7fae180107e0 tx=0x7fae18010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae2effd700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae14020b10 0x7fae14022f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:59.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.189+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fae18031fd0 con 0x7fae14006290 2019-11-28T11:32:59.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.190+0000 7fae3640f700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae14020b10 0x7fae14022f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.190+0000 7fae3640f700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae14020b10 0x7fae14022f40 crc :-1 s=READY pgs=365 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:59.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.197+0000 7fae37e72700 1 -- 172.21.15.80:0/2311498475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae30108a80 con 0x7fae14006290 2019-11-28T11:32:59.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.200+0000 7fae35c0e700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae14006290 0x7fae14008690 secure :-1 s=THROTTLE_DONE pgs=887 cs=0 l=1 rx=0x7fae180107e0 tx=0x7fae18010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.200+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fae18001620 con 0x7fae14006290 2019-11-28T11:32:59.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.376+0000 7fae37e72700 1 -- 172.21.15.80:0/2311498475 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae30108700 con 0x7fae14006290 2019-11-28T11:32:59.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.377+0000 7fae35c0e700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae14006290 0x7fae14008690 secure :-1 s=THROTTLE_DONE pgs=887 cs=0 l=1 rx=0x7fae180107e0 tx=0x7fae18010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.377+0000 7fae2effd700 1 -- 172.21.15.80:0/2311498475 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+14873 (secure 0 0 0) 0x7fae18001200 con 0x7fae14006290 2019-11-28T11:32:59.421 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:32:59.422 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":77,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:32:59.044170+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:32:57.287502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2019-11-28T11:32:57.974341+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:32:59.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.379+0000 7fae37e72700 1 -- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae14020b10 msgr2=0x7fae14022f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.379+0000 7fae37e72700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae14020b10 0x7fae14022f40 crc :-1 s=READY pgs=365 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.379+0000 7fae37e72700 1 -- 172.21.15.80:0/2311498475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae14006290 msgr2=0x7fae14008690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.379+0000 7fae37e72700 1 --2- 172.21.15.80:0/2311498475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae14006290 0x7fae14008690 secure :-1 s=READY pgs=887 cs=0 l=1 rx=0x7fae180107e0 tx=0x7fae18010610).stop 2019-11-28T11:32:59.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.379+0000 7fae36c10700 1 -- 172.21.15.80:0/2311498475 reap_dead start 2019-11-28T11:32:59.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.379+0000 7fae36c10700 1 -- 172.21.15.80:0/2311498475 reap_dead start 2019-11-28T11:32:59.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.379+0000 7fae37e72700 1 -- 172.21.15.80:0/2311498475 shutdown_connections 2019-11-28T11:32:59.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.379+0000 7fae37e72700 1 -- 172.21.15.80:0/2311498475 shutdown_connections 2019-11-28T11:32:59.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.379+0000 7fae37e72700 1 -- 172.21.15.80:0/2311498475 wait complete. 2019-11-28T11:32:59.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.379+0000 7fae37e72700 1 -- 172.21.15.80:0/2311498475 >> 172.21.15.80:0/2311498475 conn(0x7fae3011bfc0 msgr2=0x7fae30141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:59.434 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:32:59.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.509+0000 7f8e05be2700 1 Processor -- start 2019-11-28T11:32:59.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.509+0000 7f8e05be2700 1 -- start start 2019-11-28T11:32:59.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.510+0000 7f8e05be2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8e0006c0a0 0x7f8e00072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:59.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.510+0000 7f8e05be2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e000734e0 0x7f8e00071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:59.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.510+0000 7f8e05be2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e00072360 0x7f8e00072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:59.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.510+0000 7f8e05be2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0006fd60 con 0x7f8e000734e0 2019-11-28T11:32:59.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.510+0000 7f8e05be2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e00070030 con 0x7f8e0006c0a0 2019-11-28T11:32:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.510+0000 7f8e05be2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0006f330 con 0x7f8e00072360 2019-11-28T11:32:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8df7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e000734e0 0x7f8e00071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8df7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e000734e0 0x7f8e00071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35508/0 (socket says 172.21.15.80:35508) 2019-11-28T11:32:59.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8df7fff700 1 -- 172.21.15.80:0/537654179 learned_addr learned my addr 172.21.15.80:0/537654179 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:59.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8dfffff700 1 --2- 172.21.15.80:0/537654179 >> v2:172.21.15.174:3300/0 conn(0x7f8e0006c0a0 0x7f8e00072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8e04980700 1 --2- 172.21.15.80:0/537654179 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e00072360 0x7f8e00072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8df7fff700 1 -- 172.21.15.80:0/537654179 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e00072360 msgr2=0x7f8e00072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8df7fff700 1 --2- 172.21.15.80:0/537654179 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e00072360 0x7f8e00072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8df7fff700 1 -- 172.21.15.80:0/537654179 >> v2:172.21.15.174:3300/0 conn(0x7f8e0006c0a0 msgr2=0x7f8e00072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:32:59.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8df7fff700 1 --2- 172.21.15.80:0/537654179 >> v2:172.21.15.174:3300/0 conn(0x7f8e0006c0a0 0x7f8e00072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:59.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8df7fff700 1 -- 172.21.15.80:0/537654179 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e000706c0 con 0x7f8e000734e0 2019-11-28T11:32:59.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8df7fff700 1 --2- 172.21.15.80:0/537654179 >> v2:172.21.15.80:3300/0 conn(0x7f8e000734e0 0x7f8e00071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8de800f6c0 tx=0x7f8de800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8df7fff700 1 --2- 172.21.15.80:0/537654179 >> v2:172.21.15.80:3300/0 conn(0x7f8e000734e0 0x7f8e00071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8de800f6c0 tx=0x7f8de800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8df7fff700 1 --2- 172.21.15.80:0/537654179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e000734e0 0x7f8e00071e20 secure :-1 s=READY pgs=888 cs=0 l=1 rx=0x7f8de800f6c0 tx=0x7f8de800f570).ready entity=mon.0 client_cookie=142e9deb30497eee server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:59.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8df7fff700 1 --2- 172.21.15.80:0/537654179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e000734e0 0x7f8e00071e20 secure :-1 s=THROTTLE_DONE pgs=888 cs=0 l=1 rx=0x7f8de800f6c0 tx=0x7f8de800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8df7fff700 1 --2- 172.21.15.80:0/537654179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e000734e0 0x7f8e00071e20 secure :-1 s=THROTTLE_DONE pgs=888 cs=0 l=1 rx=0x7f8de800f6c0 tx=0x7f8de800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8dff7fe700 1 -- 172.21.15.80:0/537654179 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8de8000960 con 0x7f8e000734e0 2019-11-28T11:32:59.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8df7fff700 1 --2- 172.21.15.80:0/537654179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e000734e0 0x7f8e00071e20 secure :-1 s=THROTTLE_DONE pgs=888 cs=0 l=1 rx=0x7f8de800f6c0 tx=0x7f8de800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8dff7fe700 1 -- 172.21.15.80:0/537654179 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de8000c90 con 0x7f8e000734e0 2019-11-28T11:32:59.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8dff7fe700 1 -- 172.21.15.80:0/537654179 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8de80013a0 con 0x7f8e000734e0 2019-11-28T11:32:59.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8e05be2700 1 -- 172.21.15.80:0/537654179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e000734e0 msgr2=0x7f8e00071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.511+0000 7f8e05be2700 1 --2- 172.21.15.80:0/537654179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e000734e0 0x7f8e00071e20 secure :-1 s=READY pgs=888 cs=0 l=1 rx=0x7f8de800f6c0 tx=0x7f8de800f570).stop 2019-11-28T11:32:59.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.512+0000 7f8e05be2700 1 -- 172.21.15.80:0/537654179 shutdown_connections 2019-11-28T11:32:59.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.512+0000 7f8e05be2700 1 --2- 172.21.15.80:0/537654179 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e00072360 0x7f8e00072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.512+0000 7f8e05be2700 1 --2- 172.21.15.80:0/537654179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e000734e0 0x7f8e00071e20 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.512+0000 7f8e05be2700 1 --2- 172.21.15.80:0/537654179 >> v2:172.21.15.174:3300/0 conn(0x7f8e0006c0a0 0x7f8e00072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.512+0000 7f8e05be2700 1 -- 172.21.15.80:0/537654179 shutdown_connections 2019-11-28T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.512+0000 7f8e05be2700 1 -- 172.21.15.80:0/537654179 wait complete. 2019-11-28T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.512+0000 7f8e05be2700 1 -- 172.21.15.80:0/537654179 >> 172.21.15.80:0/537654179 conn(0x7f8e00061cf0 msgr2=0x7f8e00064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:59.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.514+0000 7f8e05be2700 1 Processor -- start 2019-11-28T11:32:59.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.515+0000 7f8e05be2700 1 -- start start 2019-11-28T11:32:59.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.515+0000 7f8e05be2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e0013a780 0x7f8e0012d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:59.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.515+0000 7f8e05be2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8e0012d9c0 0x7f8e0012c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:59.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.515+0000 7f8e05be2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e0012c840 0x7f8e0012cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:59.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.515+0000 7f8e05be2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0012a260 con 0x7f8e0013a780 2019-11-28T11:32:59.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.515+0000 7f8e05be2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0012a530 con 0x7f8e0012d9c0 2019-11-28T11:32:59.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.515+0000 7f8e05be2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e00129830 con 0x7f8e0012c840 2019-11-28T11:32:59.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.515+0000 7f8dfffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e0013a780 0x7f8e0012d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.515+0000 7f8dfffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e0013a780 0x7f8e0012d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35514/0 (socket says 172.21.15.80:35514) 2019-11-28T11:32:59.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.515+0000 7f8dfffff700 1 -- 172.21.15.80:0/2794446501 learned_addr learned my addr 172.21.15.80:0/2794446501 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8df7fff700 1 --2- 172.21.15.80:0/2794446501 >> v2:172.21.15.174:3300/0 conn(0x7f8e0012d9c0 0x7f8e0012c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8e04980700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e0012c840 0x7f8e0012cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8dfffff700 1 -- 172.21.15.80:0/2794446501 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e0012c840 msgr2=0x7f8e0012cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8dfffff700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e0012c840 0x7f8e0012cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8dfffff700 1 -- 172.21.15.80:0/2794446501 >> v2:172.21.15.174:3300/0 conn(0x7f8e0012d9c0 msgr2=0x7f8e0012c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8dfffff700 1 --2- 172.21.15.80:0/2794446501 >> v2:172.21.15.174:3300/0 conn(0x7f8e0012d9c0 0x7f8e0012c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8dfffff700 1 -- 172.21.15.80:0/2794446501 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0012abc0 con 0x7f8e0013a780 2019-11-28T11:32:59.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8e04980700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e0012c840 0x7f8e0012cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:32:59.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8dfffff700 1 --2- 172.21.15.80:0/2794446501 >> v2:172.21.15.80:3300/0 conn(0x7f8e0013a780 0x7f8e0012d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8df0010450 tx=0x7f8df0010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8dfffff700 1 --2- 172.21.15.80:0/2794446501 >> v2:172.21.15.80:3300/0 conn(0x7f8e0013a780 0x7f8e0012d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8df0010450 tx=0x7f8df0010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8dfffff700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0013a780 0x7f8e0012d480 secure :-1 s=READY pgs=889 cs=0 l=1 rx=0x7f8df0010450 tx=0x7f8df0010300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:59.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8dfffff700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0013a780 0x7f8e0012d480 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f8df0010450 tx=0x7f8df0010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8dfffff700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0013a780 0x7f8e0012d480 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f8df0010450 tx=0x7f8df0010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8dfffff700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0013a780 0x7f8e0012d480 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f8df0010450 tx=0x7f8df0010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8dfd7fa700 1 -- 172.21.15.80:0/2794446501 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8df0000960 con 0x7f8e0013a780 2019-11-28T11:32:59.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8dfd7fa700 1 -- 172.21.15.80:0/2794446501 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df0000e80 con 0x7f8e0013a780 2019-11-28T11:32:59.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8e05be2700 1 -- 172.21.15.80:0/2794446501 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0012af40 con 0x7f8e0013a780 2019-11-28T11:32:59.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8dfd7fa700 1 -- 172.21.15.80:0/2794446501 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8df0001550 con 0x7f8e0013a780 2019-11-28T11:32:59.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8e05be2700 1 -- 172.21.15.80:0/2794446501 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0012abc0 con 0x7f8e0013a780 2019-11-28T11:32:59.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.516+0000 7f8dfffff700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0013a780 0x7f8e0012d480 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f8df0010450 tx=0x7f8df0010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.517+0000 7f8dfd7fa700 1 -- 172.21.15.80:0/2794446501 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8df0001070 con 0x7f8e0013a780 2019-11-28T11:32:59.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.517+0000 7f8dfffff700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0013a780 0x7f8e0012d480 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f8df0010450 tx=0x7f8df0010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.517+0000 7f8dfd7fa700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8de4018730 0x7f8de401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:59.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.517+0000 7f8dfd7fa700 1 -- 172.21.15.80:0/2794446501 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8df0031a20 con 0x7f8e0013a780 2019-11-28T11:32:59.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.517+0000 7f8df7fff700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8de4018730 0x7f8de401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.517+0000 7f8df7fff700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8de4018730 0x7f8de401abc0 crc :-1 s=READY pgs=366 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:59.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.525+0000 7f8e05be2700 1 -- 172.21.15.80:0/2794446501 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0012af40 con 0x7f8e0013a780 2019-11-28T11:32:59.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.528+0000 7f8dfffff700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0013a780 0x7f8e0012d480 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f8df0010450 tx=0x7f8df0010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.528+0000 7f8dfd7fa700 1 -- 172.21.15.80:0/2794446501 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8df00092e0 con 0x7f8e0013a780 2019-11-28T11:32:59.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.706+0000 7f8e05be2700 1 -- 172.21.15.80:0/2794446501 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e0012abc0 con 0x7f8e0013a780 2019-11-28T11:32:59.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.707+0000 7f8dfffff700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0013a780 0x7f8e0012d480 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f8df0010450 tx=0x7f8df0010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.707+0000 7f8dfd7fa700 1 -- 172.21.15.80:0/2794446501 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+14873 (secure 0 0 0) 0x7f8df0001070 con 0x7f8e0013a780 2019-11-28T11:32:59.751 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:32:59.751 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":77,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:32:59.044170+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:32:57.287502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2019-11-28T11:32:57.974341+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:32:59.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.709+0000 7f8e05be2700 1 -- 172.21.15.80:0/2794446501 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8de4018730 msgr2=0x7f8de401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.709+0000 7f8e05be2700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8de4018730 0x7f8de401abc0 crc :-1 s=READY pgs=366 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.709+0000 7f8e05be2700 1 -- 172.21.15.80:0/2794446501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0013a780 msgr2=0x7f8e0012d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.709+0000 7f8e05be2700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0013a780 0x7f8e0012d480 secure :-1 s=READY pgs=889 cs=0 l=1 rx=0x7f8df0010450 tx=0x7f8df0010300).stop 2019-11-28T11:32:59.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.709+0000 7f8e05be2700 1 -- 172.21.15.80:0/2794446501 shutdown_connections 2019-11-28T11:32:59.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.709+0000 7f8e05be2700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8de4018730 0x7f8de401abc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.709+0000 7f8e05be2700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e0012c840 0x7f8e0012cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.709+0000 7f8e05be2700 1 --2- 172.21.15.80:0/2794446501 >> v2:172.21.15.174:3300/0 conn(0x7f8e0012d9c0 0x7f8e0012c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.709+0000 7f8e05be2700 1 --2- 172.21.15.80:0/2794446501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0013a780 0x7f8e0012d480 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.709+0000 7f8e05be2700 1 -- 172.21.15.80:0/2794446501 shutdown_connections 2019-11-28T11:32:59.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.709+0000 7f8e05be2700 1 -- 172.21.15.80:0/2794446501 wait complete. 2019-11-28T11:32:59.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.709+0000 7f8e05be2700 1 -- 172.21.15.80:0/2794446501 >> 172.21.15.80:0/2794446501 conn(0x7f8e00127dc0 msgr2=0x7f8e00141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:59.763 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:32:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.843+0000 7efedfad8700 1 Processor -- start 2019-11-28T11:32:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.843+0000 7efedfad8700 1 -- start start 2019-11-28T11:32:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.844+0000 7efedfad8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efed815f100 0x7efed806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:32:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.844+0000 7efedfad8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed806db60 con 0x7efed815ed10 2019-11-28T11:32:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.844+0000 7efedfad8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed806e060 con 0x7efed806c2f0 2019-11-28T11:32:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.844+0000 7efedfad8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed806fe00 con 0x7efed815f100 2019-11-28T11:32:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.844+0000 7efedd874700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efed815f100 0x7efed806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.844+0000 7efede075700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efed815ed10 0x7efed8073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34838/0 (socket says 172.21.15.80:34838) 2019-11-28T11:32:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.844+0000 7efede075700 1 -- 172.21.15.80:0/3734320053 learned_addr learned my addr 172.21.15.80:0/3734320053 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:32:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.845+0000 7efedd874700 1 -- 172.21.15.80:0/3734320053 >> v1:172.21.15.174:6789/0 conn(0x7efed806c2f0 legacy=0x7efed806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.845+0000 7efedd874700 1 -- 172.21.15.80:0/3734320053 >> v1:172.21.15.80:6789/0 conn(0x7efed815ed10 legacy=0x7efed8073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.845+0000 7efedd073700 1 -- 172.21.15.80:0/3734320053 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803469693 0 0) 0x7efec8001150 con 0x7efed815ed10 2019-11-28T11:32:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.845+0000 7efedd874700 1 -- 172.21.15.80:0/3734320053 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed8070760 con 0x7efed815f100 2019-11-28T11:32:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.845+0000 7efedd874700 1 --2- 172.21.15.80:0/3734320053 >> v2:172.21.15.80:3300/0 conn(0x7efed815f100 0x7efed806bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efec000b2d0 tx=0x7efec000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.845+0000 7efedd874700 1 --2- 172.21.15.80:0/3734320053 >> v2:172.21.15.80:3300/0 conn(0x7efed815f100 0x7efed806bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efec000b2d0 tx=0x7efec000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.845+0000 7efedd874700 1 --2- 172.21.15.80:0/3734320053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed815f100 0x7efed806bdb0 secure :-1 s=READY pgs=891 cs=0 l=1 rx=0x7efec000b2d0 tx=0x7efec000bae0).ready entity=mon.0 client_cookie=2108602ed5a43e1f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.845+0000 7efedd874700 1 --2- 172.21.15.80:0/3734320053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed815f100 0x7efed806bdb0 secure :-1 s=THROTTLE_DONE pgs=891 cs=0 l=1 rx=0x7efec000b2d0 tx=0x7efec000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.845+0000 7efedd073700 1 -- 172.21.15.80:0/3734320053 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec0000ce0 con 0x7efed815f100 2019-11-28T11:32:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.845+0000 7efedd874700 1 --2- 172.21.15.80:0/3734320053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed815f100 0x7efed806bdb0 secure :-1 s=THROTTLE_DONE pgs=891 cs=0 l=1 rx=0x7efec000b2d0 tx=0x7efec000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.845+0000 7efedd874700 1 --2- 172.21.15.80:0/3734320053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed815f100 0x7efed806bdb0 secure :-1 s=THROTTLE_DONE pgs=891 cs=0 l=1 rx=0x7efec000b2d0 tx=0x7efec000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.845+0000 7efedd073700 1 -- 172.21.15.80:0/3734320053 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec0009be0 con 0x7efed815f100 2019-11-28T11:32:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.845+0000 7efedd073700 1 -- 172.21.15.80:0/3734320053 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec000a2b0 con 0x7efed815f100 2019-11-28T11:32:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.845+0000 7efedfad8700 1 -- 172.21.15.80:0/3734320053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed815f100 msgr2=0x7efed806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.845+0000 7efedfad8700 1 --2- 172.21.15.80:0/3734320053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed815f100 0x7efed806bdb0 secure :-1 s=READY pgs=891 cs=0 l=1 rx=0x7efec000b2d0 tx=0x7efec000bae0).stop 2019-11-28T11:32:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.846+0000 7efedfad8700 1 -- 172.21.15.80:0/3734320053 shutdown_connections 2019-11-28T11:32:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.846+0000 7efedfad8700 1 --2- 172.21.15.80:0/3734320053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed815f100 0x7efed806bdb0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.846+0000 7efedfad8700 1 -- 172.21.15.80:0/3734320053 shutdown_connections 2019-11-28T11:32:59.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.846+0000 7efedfad8700 1 -- 172.21.15.80:0/3734320053 wait complete. 2019-11-28T11:32:59.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.846+0000 7efedfad8700 1 -- 172.21.15.80:0/3734320053 >> 172.21.15.80:0/3734320053 conn(0x7efed8061d20 msgr2=0x7efed80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:32:59.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.848+0000 7efedfad8700 1 Processor -- start 2019-11-28T11:32:59.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.848+0000 7efedfad8700 1 -- start start 2019-11-28T11:32:59.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.849+0000 7efedfad8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efed8148320 0x7efed810ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:59.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.849+0000 7efedfad8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efed810e3d0 0x7efed8168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:59.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.849+0000 7efedfad8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed8148e00 con 0x7efed810f290 2019-11-28T11:32:59.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.849+0000 7efedfad8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed813aa20 con 0x7efed8148320 2019-11-28T11:32:59.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.849+0000 7efedfad8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed813acf0 con 0x7efed810e3d0 2019-11-28T11:32:59.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.849+0000 7efede075700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efed8148320 0x7efed810ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.849+0000 7efede075700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efed8148320 0x7efed810ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35528/0 (socket says 172.21.15.80:35528) 2019-11-28T11:32:59.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.849+0000 7efede075700 1 -- 172.21.15.80:0/1557783680 learned_addr learned my addr 172.21.15.80:0/1557783680 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:32:59.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.849+0000 7efede876700 1 --2- 172.21.15.80:0/1557783680 >> v2:172.21.15.174:3300/0 conn(0x7efed810e3d0 0x7efed8168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.849+0000 7efede075700 1 -- 172.21.15.80:0/1557783680 >> v2:172.21.15.174:3300/0 conn(0x7efed810e3d0 msgr2=0x7efed8168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.849+0000 7efede075700 1 --2- 172.21.15.80:0/1557783680 >> v2:172.21.15.174:3300/0 conn(0x7efed810e3d0 0x7efed8168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:32:59.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.850+0000 7efede075700 1 -- 172.21.15.80:0/1557783680 >> v1:172.21.15.174:6789/0 conn(0x7efed810f290 legacy=0x7efed810dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:32:59.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.850+0000 7efede075700 1 -- 172.21.15.80:0/1557783680 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed810c490 con 0x7efed8148320 2019-11-28T11:32:59.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.850+0000 7efede876700 1 --2- 172.21.15.80:0/1557783680 >> v2:172.21.15.174:3300/0 conn(0x7efed810e3d0 0x7efed8168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:32:59.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.850+0000 7efede075700 1 --2- 172.21.15.80:0/1557783680 >> v2:172.21.15.80:3300/0 conn(0x7efed8148320 0x7efed810ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efec8010430 tx=0x7efec80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.850+0000 7efede075700 1 --2- 172.21.15.80:0/1557783680 >> v2:172.21.15.80:3300/0 conn(0x7efed8148320 0x7efed810ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efec8010430 tx=0x7efec80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.850+0000 7efede075700 1 --2- 172.21.15.80:0/1557783680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed8148320 0x7efed810ed50 secure :-1 s=READY pgs=892 cs=0 l=1 rx=0x7efec8010430 tx=0x7efec80107d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:59.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.850+0000 7efede075700 1 --2- 172.21.15.80:0/1557783680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed8148320 0x7efed810ed50 secure :-1 s=THROTTLE_DONE pgs=892 cs=0 l=1 rx=0x7efec8010430 tx=0x7efec80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.850+0000 7efede075700 1 --2- 172.21.15.80:0/1557783680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed8148320 0x7efed810ed50 secure :-1 s=THROTTLE_DONE pgs=892 cs=0 l=1 rx=0x7efec8010430 tx=0x7efec80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.850+0000 7efed6ffd700 1 -- 172.21.15.80:0/1557783680 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec8000ed0 con 0x7efed8148320 2019-11-28T11:32:59.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.850+0000 7efede075700 1 --2- 172.21.15.80:0/1557783680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed8148320 0x7efed810ed50 secure :-1 s=THROTTLE_DONE pgs=892 cs=0 l=1 rx=0x7efec8010430 tx=0x7efec80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.850+0000 7efed6ffd700 1 -- 172.21.15.80:0/1557783680 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec8004430 con 0x7efed8148320 2019-11-28T11:32:59.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.850+0000 7efedfad8700 1 -- 172.21.15.80:0/1557783680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed810c810 con 0x7efed8148320 2019-11-28T11:32:59.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.850+0000 7efed6ffd700 1 -- 172.21.15.80:0/1557783680 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec8004ac0 con 0x7efed8148320 2019-11-28T11:32:59.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.850+0000 7efedfad8700 1 -- 172.21.15.80:0/1557783680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed810c490 con 0x7efed8148320 2019-11-28T11:32:59.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.850+0000 7efede075700 1 --2- 172.21.15.80:0/1557783680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed8148320 0x7efed810ed50 secure :-1 s=THROTTLE_DONE pgs=892 cs=0 l=1 rx=0x7efec8010430 tx=0x7efec80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.850+0000 7efed6ffd700 1 -- 172.21.15.80:0/1557783680 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efec8004620 con 0x7efed8148320 2019-11-28T11:32:59.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.851+0000 7efede075700 1 --2- 172.21.15.80:0/1557783680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed8148320 0x7efed810ed50 secure :-1 s=THROTTLE_DONE pgs=892 cs=0 l=1 rx=0x7efec8010430 tx=0x7efec80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.851+0000 7efed6ffd700 1 --2- 172.21.15.80:0/1557783680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efebc018730 0x7efebc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:32:59.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.851+0000 7efed6ffd700 1 -- 172.21.15.80:0/1557783680 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6020+0+0 (secure 0 0 0) 0x7efec8031b00 con 0x7efed8148320 2019-11-28T11:32:59.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.851+0000 7efedd874700 1 --2- 172.21.15.80:0/1557783680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efebc018730 0x7efebc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:32:59.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.851+0000 7efedd874700 1 --2- 172.21.15.80:0/1557783680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efebc018730 0x7efebc01abc0 crc :-1 s=READY pgs=367 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:32:59.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.858+0000 7efedfad8700 1 -- 172.21.15.80:0/1557783680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed810c810 con 0x7efed8148320 2019-11-28T11:32:59.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.862+0000 7efede075700 1 --2- 172.21.15.80:0/1557783680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed8148320 0x7efed810ed50 secure :-1 s=THROTTLE_DONE pgs=892 cs=0 l=1 rx=0x7efec8010430 tx=0x7efec80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:32:59.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:32:59.862+0000 7efed6ffd700 1 -- 172.21.15.80:0/1557783680 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efec80279c0 con 0x7efed8148320 2019-11-28T11:33:00.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.034+0000 7efedfad8700 1 -- 172.21.15.80:0/1557783680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7efed810c490 con 0x7efed8148320 2019-11-28T11:33:00.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.627+0000 7efede075700 1 --2- 172.21.15.80:0/1557783680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed8148320 0x7efed810ed50 secure :-1 s=THROTTLE_DONE pgs=892 cs=0 l=1 rx=0x7efec8010430 tx=0x7efec80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:00.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.627+0000 7efed6ffd700 1 -- 172.21.15.80:0/1557783680 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v43) v1 ==== 118+0+0 (secure 0 0 0) 0x7efec80279c0 con 0x7efed8148320 2019-11-28T11:33:00.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.651+0000 7efedfad8700 1 -- 172.21.15.80:0/1557783680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efebc018730 msgr2=0x7efebc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.651+0000 7efedfad8700 1 --2- 172.21.15.80:0/1557783680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efebc018730 0x7efebc01abc0 crc :-1 s=READY pgs=367 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.651+0000 7efedfad8700 1 -- 172.21.15.80:0/1557783680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed8148320 msgr2=0x7efed810ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.651+0000 7efedfad8700 1 --2- 172.21.15.80:0/1557783680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed8148320 0x7efed810ed50 secure :-1 s=READY pgs=892 cs=0 l=1 rx=0x7efec8010430 tx=0x7efec80107d0).stop 2019-11-28T11:33:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.652+0000 7efedfad8700 1 -- 172.21.15.80:0/1557783680 shutdown_connections 2019-11-28T11:33:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.652+0000 7efedfad8700 1 --2- 172.21.15.80:0/1557783680 >> v2:172.21.15.174:3300/0 conn(0x7efed810e3d0 0x7efed8168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.652+0000 7efedfad8700 1 --2- 172.21.15.80:0/1557783680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efebc018730 0x7efebc01abc0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:00.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.652+0000 7efedfad8700 1 --2- 172.21.15.80:0/1557783680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efed8148320 0x7efed810ed50 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.652+0000 7efedfad8700 1 -- 172.21.15.80:0/1557783680 shutdown_connections 2019-11-28T11:33:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.652+0000 7efedfad8700 1 -- 172.21.15.80:0/1557783680 wait complete. 2019-11-28T11:33:00.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.652+0000 7efedfad8700 1 -- 172.21.15.80:0/1557783680 >> 172.21.15.80:0/1557783680 conn(0x7efed815e2d0 msgr2=0x7efed8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:00.704 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:33:00.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.780+0000 7f4a1e718700 1 Processor -- start 2019-11-28T11:33:00.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.780+0000 7f4a1e718700 1 -- start start 2019-11-28T11:33:00.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.781+0000 7f4a1e718700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4a1806c0a0 0x7f4a18072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:00.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.781+0000 7f4a1e718700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a180734e0 0x7f4a18071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:00.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.781+0000 7f4a1e718700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1806db00 con 0x7f4a18072360 2019-11-28T11:33:00.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.781+0000 7f4a1e718700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1806fd60 con 0x7f4a1806c0a0 2019-11-28T11:33:00.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.781+0000 7f4a1e718700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a18070030 con 0x7f4a180734e0 2019-11-28T11:33:00.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.781+0000 7f4a1ccb5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4a1806c0a0 0x7f4a18072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:00.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.781+0000 7f4a17fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a180734e0 0x7f4a18071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:00.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.781+0000 7f4a1d4b6700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f4a18072360 0x7f4a1806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:50396/0 (socket says 172.21.15.80:50396) 2019-11-28T11:33:00.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.781+0000 7f4a1d4b6700 1 -- 172.21.15.80:0/2555470934 learned_addr learned my addr 172.21.15.80:0/2555470934 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:00.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a1ccb5700 1 -- 172.21.15.80:0/2555470934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a180734e0 msgr2=0x7f4a18071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:00.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/2555470934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a180734e0 0x7f4a18071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:00.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a1ccb5700 1 -- 172.21.15.80:0/2555470934 >> v1:172.21.15.174:6789/0 conn(0x7f4a18072360 legacy=0x7f4a1806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:00.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a1ccb5700 1 -- 172.21.15.80:0/2555470934 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a180706c0 con 0x7f4a1806c0a0 2019-11-28T11:33:00.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a177fe700 1 -- 172.21.15.80:0/2555470934 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169424690 0 0) 0x7f4a00001100 con 0x7f4a18072360 2019-11-28T11:33:00.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a17fff700 1 --2- 172.21.15.80:0/2555470934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a180734e0 0x7f4a18071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:33:00.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/2555470934 >> v2:172.21.15.174:3300/0 conn(0x7f4a1806c0a0 0x7f4a18072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4a1000b2d0 tx=0x7f4a1000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:00.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/2555470934 >> v2:172.21.15.174:3300/0 conn(0x7f4a1806c0a0 0x7f4a18072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4a1000b2d0 tx=0x7f4a1000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:00.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/2555470934 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a1806c0a0 0x7f4a18072fa0 secure :-1 s=READY pgs=533 cs=0 l=1 rx=0x7f4a1000b2d0 tx=0x7f4a1000bae0).ready entity=mon.1 client_cookie=1d056c952a224323 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:00.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/2555470934 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a1806c0a0 0x7f4a18072fa0 secure :-1 s=THROTTLE_DONE pgs=533 cs=0 l=1 rx=0x7f4a1000b2d0 tx=0x7f4a1000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:00.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a177fe700 1 -- 172.21.15.80:0/2555470934 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a10007590 con 0x7f4a1806c0a0 2019-11-28T11:33:00.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/2555470934 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a1806c0a0 0x7f4a18072fa0 secure :-1 s=THROTTLE_DONE pgs=533 cs=0 l=1 rx=0x7f4a1000b2d0 tx=0x7f4a1000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:00.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/2555470934 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a1806c0a0 0x7f4a18072fa0 secure :-1 s=THROTTLE_DONE pgs=533 cs=0 l=1 rx=0x7f4a1000b2d0 tx=0x7f4a1000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:00.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a177fe700 1 -- 172.21.15.80:0/2555470934 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10009d30 con 0x7f4a1806c0a0 2019-11-28T11:33:00.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a177fe700 1 -- 172.21.15.80:0/2555470934 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a1000a400 con 0x7f4a1806c0a0 2019-11-28T11:33:00.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a1e718700 1 -- 172.21.15.80:0/2555470934 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a1806c0a0 msgr2=0x7f4a18072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:00.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.782+0000 7f4a1e718700 1 --2- 172.21.15.80:0/2555470934 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a1806c0a0 0x7f4a18072fa0 secure :-1 s=READY pgs=533 cs=0 l=1 rx=0x7f4a1000b2d0 tx=0x7f4a1000bae0).stop 2019-11-28T11:33:00.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.783+0000 7f4a1e718700 1 -- 172.21.15.80:0/2555470934 shutdown_connections 2019-11-28T11:33:00.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.783+0000 7f4a1e718700 1 --2- 172.21.15.80:0/2555470934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a180734e0 0x7f4a18071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:00.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.783+0000 7f4a1e718700 1 --2- 172.21.15.80:0/2555470934 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a1806c0a0 0x7f4a18072fa0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:00.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.783+0000 7f4a1e718700 1 -- 172.21.15.80:0/2555470934 shutdown_connections 2019-11-28T11:33:00.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.783+0000 7f4a1e718700 1 -- 172.21.15.80:0/2555470934 wait complete. 2019-11-28T11:33:00.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.783+0000 7f4a1e718700 1 -- 172.21.15.80:0/2555470934 >> 172.21.15.80:0/2555470934 conn(0x7f4a18061cf0 msgr2=0x7f4a18064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:00.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.785+0000 7f4a1e718700 1 Processor -- start 2019-11-28T11:33:00.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.785+0000 7f4a1e718700 1 -- start start 2019-11-28T11:33:00.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.786+0000 7f4a1e718700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4a18164ff0 0x7f4a181653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:00.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.786+0000 7f4a1e718700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a18133cb0 0x7f4a18132ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:00.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.786+0000 7f4a1e718700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a18131680 con 0x7f4a18133820 2019-11-28T11:33:00.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.786+0000 7f4a1e718700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1810dd90 con 0x7f4a18164ff0 2019-11-28T11:33:00.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.786+0000 7f4a1e718700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1810e060 con 0x7f4a18133cb0 2019-11-28T11:33:00.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.786+0000 7f4a17fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4a18133820 0x7f4a181326a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34858/0 (socket says 172.21.15.80:34858) 2019-11-28T11:33:00.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.786+0000 7f4a17fff700 1 -- 172.21.15.80:0/3149506930 learned_addr learned my addr 172.21.15.80:0/3149506930 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:00.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.786+0000 7f4a1d4b6700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a18133cb0 0x7f4a18132ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:00.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.786+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/3149506930 >> v2:172.21.15.174:3300/0 conn(0x7f4a18164ff0 0x7f4a181653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:00.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.786+0000 7f4a157fa700 1 -- 172.21.15.80:0/3149506930 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 860918746 0 0) 0x7f4a0800dd90 con 0x7f4a18133820 2019-11-28T11:33:00.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.786+0000 7f4a157fa700 1 -- 172.21.15.80:0/3149506930 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49fc002e80 con 0x7f4a18133820 2019-11-28T11:33:00.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a1ccb5700 1 -- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a18133cb0 msgr2=0x7f4a18132ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:00.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a18133cb0 0x7f4a18132ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:00.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a1ccb5700 1 -- 172.21.15.80:0/3149506930 >> v1:172.21.15.80:6789/0 conn(0x7f4a18133820 legacy=0x7f4a181326a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:00.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a1ccb5700 1 -- 172.21.15.80:0/3149506930 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1810e6f0 con 0x7f4a18164ff0 2019-11-28T11:33:00.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a1d4b6700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a18133cb0 0x7f4a18132ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:33:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/3149506930 >> v2:172.21.15.174:3300/0 conn(0x7f4a18164ff0 0x7f4a181653e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a10010720 tx=0x7f4a10010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/3149506930 >> v2:172.21.15.174:3300/0 conn(0x7f4a18164ff0 0x7f4a181653e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a10010720 tx=0x7f4a10010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a18164ff0 0x7f4a181653e0 secure :-1 s=READY pgs=534 cs=0 l=1 rx=0x7f4a10010720 tx=0x7f4a10010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a18164ff0 0x7f4a181653e0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7f4a10010720 tx=0x7f4a10010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a157fa700 1 -- 172.21.15.80:0/3149506930 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a10000cc0 con 0x7f4a18164ff0 2019-11-28T11:33:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a18164ff0 0x7f4a181653e0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7f4a10010720 tx=0x7f4a10010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:00.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a157fa700 1 -- 172.21.15.80:0/3149506930 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10000cc0 con 0x7f4a18164ff0 2019-11-28T11:33:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a1e718700 1 -- 172.21.15.80:0/3149506930 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1810ea70 con 0x7f4a18164ff0 2019-11-28T11:33:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a18164ff0 0x7f4a181653e0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7f4a10010720 tx=0x7f4a10010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a157fa700 1 -- 172.21.15.80:0/3149506930 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a1000b5d0 con 0x7f4a18164ff0 2019-11-28T11:33:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a1e718700 1 -- 172.21.15.80:0/3149506930 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1810e6f0 con 0x7f4a18164ff0 2019-11-28T11:33:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.787+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a18164ff0 0x7f4a181653e0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7f4a10010720 tx=0x7f4a10010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.788+0000 7f4a157fa700 1 -- 172.21.15.80:0/3149506930 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4a10009b10 con 0x7f4a18164ff0 2019-11-28T11:33:00.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.788+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a18164ff0 0x7f4a181653e0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7f4a10010720 tx=0x7f4a10010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:00.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.788+0000 7f4a157fa700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49fc018770 0x7f49fc01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:00.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.788+0000 7f4a157fa700 1 -- 172.21.15.80:0/3149506930 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4a10031e30 con 0x7f4a18164ff0 2019-11-28T11:33:00.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.788+0000 7f4a17fff700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49fc018770 0x7f49fc01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:00.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.788+0000 7f4a17fff700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49fc018770 0x7f49fc01abe0 crc :-1 s=READY pgs=368 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:00.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.795+0000 7f4a1e718700 1 -- 172.21.15.80:0/3149506930 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1810ea70 con 0x7f4a18164ff0 2019-11-28T11:33:00.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.799+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a18164ff0 0x7f4a181653e0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7f4a10010720 tx=0x7f4a10010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:00.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.799+0000 7f4a157fa700 1 -- 172.21.15.80:0/3149506930 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4a10009900 con 0x7f4a18164ff0 2019-11-28T11:33:01.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.970+0000 7f4a1e718700 1 -- 172.21.15.80:0/3149506930 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a1810e6f0 con 0x7f4a18164ff0 2019-11-28T11:33:01.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.970+0000 7f4a1ccb5700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a18164ff0 0x7f4a181653e0 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7f4a10010720 tx=0x7f4a10010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.970+0000 7f4a157fa700 1 -- 172.21.15.80:0/3149506930 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+1424 (secure 0 0 0) 0x7f4a10017f20 con 0x7f4a18164ff0 2019-11-28T11:33:01.014 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 43 2019-11-28T11:33:01.015 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:33:01.015 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":43,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:33:00.620986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:33:01.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.972+0000 7f4a1e718700 1 -- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49fc018770 msgr2=0x7f49fc01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.972+0000 7f4a1e718700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49fc018770 0x7f49fc01abe0 crc :-1 s=READY pgs=368 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.972+0000 7f4a1e718700 1 -- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a18164ff0 msgr2=0x7f4a181653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.972+0000 7f4a1e718700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a18164ff0 0x7f4a181653e0 secure :-1 s=READY pgs=534 cs=0 l=1 rx=0x7f4a10010720 tx=0x7f4a10010ac0).stop 2019-11-28T11:33:01.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.973+0000 7f4a1e718700 1 -- 172.21.15.80:0/3149506930 shutdown_connections 2019-11-28T11:33:01.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.973+0000 7f4a1e718700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49fc018770 0x7f49fc01abe0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.973+0000 7f4a1e718700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a18133cb0 0x7f4a18132ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.973+0000 7f4a1e718700 1 --2- 172.21.15.80:0/3149506930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a18164ff0 0x7f4a181653e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.973+0000 7f4a1e718700 1 -- 172.21.15.80:0/3149506930 shutdown_connections 2019-11-28T11:33:01.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.973+0000 7f4a1e718700 1 -- 172.21.15.80:0/3149506930 wait complete. 2019-11-28T11:33:01.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:00.973+0000 7f4a1e718700 1 -- 172.21.15.80:0/3149506930 >> 172.21.15.80:0/3149506930 conn(0x7f4a1811bfc0 msgr2=0x7f4a18141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:01.026 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:33:01.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.102+0000 7fb36a7a7700 1 Processor -- start 2019-11-28T11:33:01.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.102+0000 7fb36a7a7700 1 -- start start 2019-11-28T11:33:01.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb36a7a7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb36406c0a0 0x7fb364072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb36a7a7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36406db00 con 0x7fb364072620 2019-11-28T11:33:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb36a7a7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36406e000 con 0x7fb3640734e0 2019-11-28T11:33:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb36a7a7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36406fd60 con 0x7fb36406c0a0 2019-11-28T11:33:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb369545700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb364072620 0x7fb364164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34868/0 (socket says 172.21.15.80:34868) 2019-11-28T11:33:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb369545700 1 -- 172.21.15.80:0/3896911748 learned_addr learned my addr 172.21.15.80:0/3896911748 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb368d44700 1 --2- 172.21.15.80:0/3896911748 >> v2:172.21.15.174:3300/0 conn(0x7fb36406c0a0 0x7fb364072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb3637fe700 1 -- 172.21.15.80:0/3896911748 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541076150 0 0) 0x7fb35c0014d0 con 0x7fb364072620 2019-11-28T11:33:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb3637fe700 1 -- 172.21.15.80:0/3896911748 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb350002e80 con 0x7fb364072620 2019-11-28T11:33:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb3637fe700 1 -- 172.21.15.80:0/3896911748 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541661637 0 0) 0x7fb354001080 con 0x7fb3640734e0 2019-11-28T11:33:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb3637fe700 1 -- 172.21.15.80:0/3896911748 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb350004170 con 0x7fb3640734e0 2019-11-28T11:33:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb368d44700 1 -- 172.21.15.80:0/3896911748 >> v1:172.21.15.174:6789/0 conn(0x7fb3640734e0 legacy=0x7fb364071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb368d44700 1 -- 172.21.15.80:0/3896911748 >> v1:172.21.15.80:6789/0 conn(0x7fb364072620 legacy=0x7fb364164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb368d44700 1 -- 172.21.15.80:0/3896911748 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3640706c0 con 0x7fb36406c0a0 2019-11-28T11:33:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb368d44700 1 --2- 172.21.15.80:0/3896911748 >> v2:172.21.15.174:3300/0 conn(0x7fb36406c0a0 0x7fb364072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb34c00af50 tx=0x7fb34c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb368d44700 1 --2- 172.21.15.80:0/3896911748 >> v2:172.21.15.174:3300/0 conn(0x7fb36406c0a0 0x7fb364072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb34c00af50 tx=0x7fb34c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.103+0000 7fb368d44700 1 --2- 172.21.15.80:0/3896911748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb36406c0a0 0x7fb364072fa0 secure :-1 s=READY pgs=536 cs=0 l=1 rx=0x7fb34c00af50 tx=0x7fb34c00b760).ready entity=mon.1 client_cookie=cb80751e8f13d78c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.104+0000 7fb368d44700 1 --2- 172.21.15.80:0/3896911748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb36406c0a0 0x7fb364072fa0 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7fb34c00af50 tx=0x7fb34c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.104+0000 7fb3637fe700 1 -- 172.21.15.80:0/3896911748 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb34c000960 con 0x7fb36406c0a0 2019-11-28T11:33:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.104+0000 7fb368d44700 1 --2- 172.21.15.80:0/3896911748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb36406c0a0 0x7fb364072fa0 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7fb34c00af50 tx=0x7fb34c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.104+0000 7fb368d44700 1 --2- 172.21.15.80:0/3896911748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb36406c0a0 0x7fb364072fa0 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7fb34c00af50 tx=0x7fb34c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.104+0000 7fb3637fe700 1 -- 172.21.15.80:0/3896911748 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c009860 con 0x7fb36406c0a0 2019-11-28T11:33:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.104+0000 7fb3637fe700 1 -- 172.21.15.80:0/3896911748 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb34c009f30 con 0x7fb36406c0a0 2019-11-28T11:33:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.104+0000 7fb36a7a7700 1 -- 172.21.15.80:0/3896911748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb36406c0a0 msgr2=0x7fb364072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.104+0000 7fb36a7a7700 1 --2- 172.21.15.80:0/3896911748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb36406c0a0 0x7fb364072fa0 secure :-1 s=READY pgs=536 cs=0 l=1 rx=0x7fb34c00af50 tx=0x7fb34c00b760).stop 2019-11-28T11:33:01.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.104+0000 7fb36a7a7700 1 -- 172.21.15.80:0/3896911748 shutdown_connections 2019-11-28T11:33:01.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.104+0000 7fb36a7a7700 1 --2- 172.21.15.80:0/3896911748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb36406c0a0 0x7fb364072fa0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.104+0000 7fb36a7a7700 1 -- 172.21.15.80:0/3896911748 shutdown_connections 2019-11-28T11:33:01.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.104+0000 7fb36a7a7700 1 -- 172.21.15.80:0/3896911748 wait complete. 2019-11-28T11:33:01.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.104+0000 7fb36a7a7700 1 -- 172.21.15.80:0/3896911748 >> 172.21.15.80:0/3896911748 conn(0x7fb364061cf0 msgr2=0x7fb364064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:01.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.107+0000 7fb36a7a7700 1 Processor -- start 2019-11-28T11:33:01.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.107+0000 7fb36a7a7700 1 -- start start 2019-11-28T11:33:01.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb36a7a7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3641346b0 0x7fb364135040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:01.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb36a7a7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb364135580 0x7fb364135a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:01.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb36a7a7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36413f410 con 0x7fb3641342c0 2019-11-28T11:33:01.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb36a7a7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb364141670 con 0x7fb364135580 2019-11-28T11:33:01.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb36a7a7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb364141940 con 0x7fb3641346b0 2019-11-28T11:33:01.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb368d44700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb3641342c0 0x7fb3641361c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34870/0 (socket says 172.21.15.80:34870) 2019-11-28T11:33:01.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb368d44700 1 -- 172.21.15.80:0/622595046 learned_addr learned my addr 172.21.15.80:0/622595046 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:01.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb363fff700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3641346b0 0x7fb364135040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:01.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb369545700 1 --2- 172.21.15.80:0/622595046 >> v2:172.21.15.174:3300/0 conn(0x7fb364135580 0x7fb364135a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:01.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb3617fa700 1 -- 172.21.15.80:0/622595046 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490094045 0 0) 0x7fb34c00b3d0 con 0x7fb3641342c0 2019-11-28T11:33:01.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb3617fa700 1 -- 172.21.15.80:0/622595046 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb348002e80 con 0x7fb3641342c0 2019-11-28T11:33:01.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb363fff700 1 -- 172.21.15.80:0/622595046 >> v2:172.21.15.174:3300/0 conn(0x7fb364135580 msgr2=0x7fb364135a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb363fff700 1 --2- 172.21.15.80:0/622595046 >> v2:172.21.15.174:3300/0 conn(0x7fb364135580 0x7fb364135a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb3617fa700 1 -- 172.21.15.80:0/622595046 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1957672760 0 0) 0x7fb34c000940 con 0x7fb3641342c0 2019-11-28T11:33:01.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb363fff700 1 -- 172.21.15.80:0/622595046 >> v1:172.21.15.80:6789/0 conn(0x7fb3641342c0 legacy=0x7fb3641361c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb363fff700 1 -- 172.21.15.80:0/622595046 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb364141fd0 con 0x7fb3641346b0 2019-11-28T11:33:01.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb363fff700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3641346b0 0x7fb364135040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb3540103a0 tx=0x7fb35400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb363fff700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3641346b0 0x7fb364135040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb3540103a0 tx=0x7fb35400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.108+0000 7fb363fff700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3641346b0 0x7fb364135040 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7fb3540103a0 tx=0x7fb35400b2e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:01.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.109+0000 7fb363fff700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3641346b0 0x7fb364135040 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fb3540103a0 tx=0x7fb35400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.109+0000 7fb3617fa700 1 -- 172.21.15.80:0/622595046 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb354009960 con 0x7fb3641346b0 2019-11-28T11:33:01.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.109+0000 7fb363fff700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3641346b0 0x7fb364135040 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fb3540103a0 tx=0x7fb35400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.109+0000 7fb3617fa700 1 -- 172.21.15.80:0/622595046 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb354000aa0 con 0x7fb3641346b0 2019-11-28T11:33:01.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.109+0000 7fb363fff700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3641346b0 0x7fb364135040 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fb3540103a0 tx=0x7fb35400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.109+0000 7fb36a7a7700 1 -- 172.21.15.80:0/622595046 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb364142350 con 0x7fb3641346b0 2019-11-28T11:33:01.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.109+0000 7fb3617fa700 1 -- 172.21.15.80:0/622595046 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb354009b40 con 0x7fb3641346b0 2019-11-28T11:33:01.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.109+0000 7fb36a7a7700 1 -- 172.21.15.80:0/622595046 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb364141fd0 con 0x7fb3641346b0 2019-11-28T11:33:01.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.109+0000 7fb363fff700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3641346b0 0x7fb364135040 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fb3540103a0 tx=0x7fb35400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.109+0000 7fb3617fa700 1 -- 172.21.15.80:0/622595046 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb354009600 con 0x7fb3641346b0 2019-11-28T11:33:01.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.109+0000 7fb363fff700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3641346b0 0x7fb364135040 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fb3540103a0 tx=0x7fb35400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.109+0000 7fb3617fa700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb348018780 0x7fb34801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:01.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.109+0000 7fb3617fa700 1 -- 172.21.15.80:0/622595046 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb354031a00 con 0x7fb3641346b0 2019-11-28T11:33:01.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.110+0000 7fb368d44700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb348018780 0x7fb34801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:01.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.110+0000 7fb368d44700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb348018780 0x7fb34801abf0 crc :-1 s=READY pgs=369 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:01.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.117+0000 7fb36a7a7700 1 -- 172.21.15.80:0/622595046 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb364142350 con 0x7fb3641346b0 2019-11-28T11:33:01.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.121+0000 7fb363fff700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3641346b0 0x7fb364135040 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fb3540103a0 tx=0x7fb35400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.121+0000 7fb3617fa700 1 -- 172.21.15.80:0/622595046 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb354026710 con 0x7fb3641346b0 2019-11-28T11:33:01.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.296+0000 7fb36a7a7700 1 -- 172.21.15.80:0/622595046 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb364141fd0 con 0x7fb3641346b0 2019-11-28T11:33:01.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.298+0000 7fb363fff700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3641346b0 0x7fb364135040 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7fb3540103a0 tx=0x7fb35400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.298+0000 7fb3617fa700 1 -- 172.21.15.80:0/622595046 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+14860 (secure 0 0 0) 0x7fb354026710 con 0x7fb3641346b0 2019-11-28T11:33:01.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.301+0000 7fb36a7a7700 1 -- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb348018780 msgr2=0x7fb34801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.301+0000 7fb36a7a7700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb348018780 0x7fb34801abf0 crc :-1 s=READY pgs=369 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.301+0000 7fb36a7a7700 1 -- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3641346b0 msgr2=0x7fb364135040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.301+0000 7fb36a7a7700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3641346b0 0x7fb364135040 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7fb3540103a0 tx=0x7fb35400b2e0).stop 2019-11-28T11:33:01.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.302+0000 7fb36a7a7700 1 -- 172.21.15.80:0/622595046 shutdown_connections 2019-11-28T11:33:01.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.302+0000 7fb36a7a7700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb348018780 0x7fb34801abf0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.302+0000 7fb36a7a7700 1 --2- 172.21.15.80:0/622595046 >> v2:172.21.15.174:3300/0 conn(0x7fb364135580 0x7fb364135a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.302+0000 7fb36a7a7700 1 --2- 172.21.15.80:0/622595046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3641346b0 0x7fb364135040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.302+0000 7fb36a7a7700 1 -- 172.21.15.80:0/622595046 shutdown_connections 2019-11-28T11:33:01.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.302+0000 7fb36a7a7700 1 -- 172.21.15.80:0/622595046 wait complete. 2019-11-28T11:33:01.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.302+0000 7fb36a7a7700 1 -- 172.21.15.80:0/622595046 >> 172.21.15.80:0/622595046 conn(0x7fb364159ae0 msgr2=0x7fb36413d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:33:01.349 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":78,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:33:00.045712+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:32:57.287502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2019-11-28T11:32:57.974341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:33:01.357 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:33:01.357 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:33:01.358 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:33:01.358 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:33:01.358 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:33:01.358 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:33:01.370 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:33:01.370 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:33:01.370 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:33:01.371 DEBUG:teuthology.parallel:result is None 2019-11-28T11:33:01.371 DEBUG:teuthology.parallel:result is None 2019-11-28T11:33:01.371 DEBUG:teuthology.parallel:result is None 2019-11-28T11:33:01.371 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:33:01.451 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:33:01.452 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:33:01.457 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:33:01.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.464+0000 7f35c5193700 1 Processor -- start 2019-11-28T11:33:01.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.465+0000 7f35c5193700 1 -- start start 2019-11-28T11:33:01.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c5193700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f35c015f100 0x7f35c006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:01.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c5193700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35c006c2f0 0x7f35c006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:01.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c5193700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c006db60 con 0x7f35c015ed10 2019-11-28T11:33:01.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c5193700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c006fe00 con 0x7f35c006c2f0 2019-11-28T11:33:01.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c5193700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c00700d0 con 0x7f35c015f100 2019-11-28T11:33:01.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c4992700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35c006c2f0 0x7f35c006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:01.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c4992700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35c006c2f0 0x7f35c006c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35590/0 (socket says 172.21.15.80:35590) 2019-11-28T11:33:01.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c4992700 1 -- 172.21.15.80:0/1311677426 learned_addr learned my addr 172.21.15.80:0/1311677426 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:01.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35bed9d700 1 --2- 172.21.15.80:0/1311677426 >> v2:172.21.15.174:3300/0 conn(0x7f35c015f100 0x7f35c006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:01.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c4992700 1 -- 172.21.15.80:0/1311677426 >> v2:172.21.15.174:3300/0 conn(0x7f35c015f100 msgr2=0x7f35c006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:01.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c4992700 1 --2- 172.21.15.80:0/1311677426 >> v2:172.21.15.174:3300/0 conn(0x7f35c015f100 0x7f35c006bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:01.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c4992700 1 -- 172.21.15.80:0/1311677426 >> v1:172.21.15.174:6789/0 conn(0x7f35c015ed10 legacy=0x7f35c0073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c4992700 1 -- 172.21.15.80:0/1311677426 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c0070760 con 0x7f35c006c2f0 2019-11-28T11:33:01.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c4992700 1 --2- 172.21.15.80:0/1311677426 >> v2:172.21.15.80:3300/0 conn(0x7f35c006c2f0 0x7f35c006c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f35b800f6b0 tx=0x7f35b800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c4992700 1 --2- 172.21.15.80:0/1311677426 >> v2:172.21.15.80:3300/0 conn(0x7f35c006c2f0 0x7f35c006c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f35b800f6b0 tx=0x7f35b800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c4992700 1 --2- 172.21.15.80:0/1311677426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c006c2f0 0x7f35c006c770 secure :-1 s=READY pgs=902 cs=0 l=1 rx=0x7f35b800f6b0 tx=0x7f35b800fa50).ready entity=mon.0 client_cookie=9b047199156ccd6d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:01.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c4992700 1 --2- 172.21.15.80:0/1311677426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c006c2f0 0x7f35c006c770 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7f35b800f6b0 tx=0x7f35b800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c4992700 1 --2- 172.21.15.80:0/1311677426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c006c2f0 0x7f35c006c770 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7f35b800f6b0 tx=0x7f35b800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35be59c700 1 -- 172.21.15.80:0/1311677426 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b8000a70 con 0x7f35c006c2f0 2019-11-28T11:33:01.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c4992700 1 --2- 172.21.15.80:0/1311677426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c006c2f0 0x7f35c006c770 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7f35b800f6b0 tx=0x7f35b800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35be59c700 1 -- 172.21.15.80:0/1311677426 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b80010e0 con 0x7f35c006c2f0 2019-11-28T11:33:01.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35be59c700 1 -- 172.21.15.80:0/1311677426 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b80017b0 con 0x7f35c006c2f0 2019-11-28T11:33:01.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c5193700 1 -- 172.21.15.80:0/1311677426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c006c2f0 msgr2=0x7f35c006c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.466+0000 7f35c5193700 1 --2- 172.21.15.80:0/1311677426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c006c2f0 0x7f35c006c770 secure :-1 s=READY pgs=902 cs=0 l=1 rx=0x7f35b800f6b0 tx=0x7f35b800fa50).stop 2019-11-28T11:33:01.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.467+0000 7f35c5193700 1 -- 172.21.15.80:0/1311677426 shutdown_connections 2019-11-28T11:33:01.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.467+0000 7f35c5193700 1 --2- 172.21.15.80:0/1311677426 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c006c2f0 0x7f35c006c770 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.467+0000 7f35c5193700 1 --2- 172.21.15.80:0/1311677426 >> v2:172.21.15.174:3300/0 conn(0x7f35c015f100 0x7f35c006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:01.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.467+0000 7f35c5193700 1 -- 172.21.15.80:0/1311677426 shutdown_connections 2019-11-28T11:33:01.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.467+0000 7f35c5193700 1 -- 172.21.15.80:0/1311677426 wait complete. 2019-11-28T11:33:01.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.467+0000 7f35c5193700 1 -- 172.21.15.80:0/1311677426 >> 172.21.15.80:0/1311677426 conn(0x7f35c0061d40 msgr2=0x7f35c00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:01.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.469+0000 7f35c5193700 1 Processor -- start 2019-11-28T11:33:01.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.470+0000 7f35c5193700 1 -- start start 2019-11-28T11:33:01.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.470+0000 7f35c5193700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f35c0152750 0x7f35c0135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:01.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.470+0000 7f35c5193700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35c0130dc0 0x7f35c0131250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:01.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.470+0000 7f35c5193700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c0109d70 con 0x7f35c0131790 2019-11-28T11:33:01.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.470+0000 7f35c5193700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c0131c10 con 0x7f35c0130dc0 2019-11-28T11:33:01.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.470+0000 7f35c5193700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c0132570 con 0x7f35c0152750 2019-11-28T11:33:01.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35bed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35c0130dc0 0x7f35c0131250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:01.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35c4992700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f35c0131790 0x7f35c0134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34912/0 (socket says 172.21.15.80:34912) 2019-11-28T11:33:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35bed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35c0130dc0 0x7f35c0131250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35594/0 (socket says 172.21.15.80:35594) 2019-11-28T11:33:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35c4992700 1 -- 172.21.15.80:0/1668644857 learned_addr learned my addr 172.21.15.80:0/1668644857 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35bf59e700 1 --2- 172.21.15.80:0/1668644857 >> v2:172.21.15.174:3300/0 conn(0x7f35c0152750 0x7f35c0135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35bed9d700 1 -- 172.21.15.80:0/1668644857 >> v2:172.21.15.174:3300/0 conn(0x7f35c0152750 msgr2=0x7f35c0135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35bed9d700 1 --2- 172.21.15.80:0/1668644857 >> v2:172.21.15.174:3300/0 conn(0x7f35c0152750 0x7f35c0135790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35bed9d700 1 -- 172.21.15.80:0/1668644857 >> v1:172.21.15.80:6789/0 conn(0x7f35c0131790 legacy=0x7f35c0134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35bed9d700 1 -- 172.21.15.80:0/1668644857 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c0132ed0 con 0x7f35c0130dc0 2019-11-28T11:33:01.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35b7fff700 1 -- 172.21.15.80:0/1668644857 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611017489 0 0) 0x7f35b80079e0 con 0x7f35c0131790 2019-11-28T11:33:01.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35bed9d700 1 --2- 172.21.15.80:0/1668644857 >> v2:172.21.15.80:3300/0 conn(0x7f35c0130dc0 0x7f35c0131250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f35b00103d0 tx=0x7f35b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35bed9d700 1 --2- 172.21.15.80:0/1668644857 >> v2:172.21.15.80:3300/0 conn(0x7f35c0130dc0 0x7f35c0131250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f35b00103d0 tx=0x7f35b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35bed9d700 1 --2- 172.21.15.80:0/1668644857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c0130dc0 0x7f35c0131250 secure :-1 s=READY pgs=904 cs=0 l=1 rx=0x7f35b00103d0 tx=0x7f35b0010200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:01.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35bed9d700 1 --2- 172.21.15.80:0/1668644857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c0130dc0 0x7f35c0131250 secure :-1 s=THROTTLE_DONE pgs=904 cs=0 l=1 rx=0x7f35b00103d0 tx=0x7f35b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35b7fff700 1 -- 172.21.15.80:0/1668644857 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b000a730 con 0x7f35c0130dc0 2019-11-28T11:33:01.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35bed9d700 1 --2- 172.21.15.80:0/1668644857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c0130dc0 0x7f35c0131250 secure :-1 s=THROTTLE_DONE pgs=904 cs=0 l=1 rx=0x7f35b00103d0 tx=0x7f35b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35bed9d700 1 --2- 172.21.15.80:0/1668644857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c0130dc0 0x7f35c0131250 secure :-1 s=THROTTLE_DONE pgs=904 cs=0 l=1 rx=0x7f35b00103d0 tx=0x7f35b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35b7fff700 1 -- 172.21.15.80:0/1668644857 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b0009770 con 0x7f35c0130dc0 2019-11-28T11:33:01.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35b7fff700 1 -- 172.21.15.80:0/1668644857 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b0009e00 con 0x7f35c0130dc0 2019-11-28T11:33:01.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35c5193700 1 -- 172.21.15.80:0/1668644857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c0133250 con 0x7f35c0130dc0 2019-11-28T11:33:01.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.471+0000 7f35c5193700 1 -- 172.21.15.80:0/1668644857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c0132ed0 con 0x7f35c0130dc0 2019-11-28T11:33:01.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.472+0000 7f35bed9d700 1 --2- 172.21.15.80:0/1668644857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c0130dc0 0x7f35c0131250 secure :-1 s=THROTTLE_DONE pgs=904 cs=0 l=1 rx=0x7f35b00103d0 tx=0x7f35b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.472+0000 7f35b7fff700 1 -- 172.21.15.80:0/1668644857 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f35b000a7d0 con 0x7f35c0130dc0 2019-11-28T11:33:01.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.472+0000 7f35bed9d700 1 --2- 172.21.15.80:0/1668644857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c0130dc0 0x7f35c0131250 secure :-1 s=THROTTLE_DONE pgs=904 cs=0 l=1 rx=0x7f35b00103d0 tx=0x7f35b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.472+0000 7f35b7fff700 1 --2- 172.21.15.80:0/1668644857 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3598018730 0x7f359801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:01.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.472+0000 7f35b7fff700 1 -- 172.21.15.80:0/1668644857 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f35b0031a50 con 0x7f35c0130dc0 2019-11-28T11:33:01.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.473+0000 7f35bf59e700 1 --2- 172.21.15.80:0/1668644857 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3598018730 0x7f359801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:01.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.473+0000 7f35bf59e700 1 --2- 172.21.15.80:0/1668644857 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3598018730 0x7f359801abc0 crc :-1 s=READY pgs=370 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.480+0000 7f35c5193700 1 -- 172.21.15.80:0/1668644857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c0133250 con 0x7f35c0130dc0 2019-11-28T11:33:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.483+0000 7f35bed9d700 1 --2- 172.21.15.80:0/1668644857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c0130dc0 0x7f35c0131250 secure :-1 s=THROTTLE_DONE pgs=904 cs=0 l=1 rx=0x7f35b00103d0 tx=0x7f35b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.483+0000 7f35b7fff700 1 -- 172.21.15.80:0/1668644857 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f35b0000940 con 0x7f35c0130dc0 2019-11-28T11:33:01.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.654+0000 7f35c5193700 1 -- 172.21.15.80:0/1668644857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f35c0132ed0 con 0x7f35c0130dc0 2019-11-28T11:33:01.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.657+0000 7f35bed9d700 1 --2- 172.21.15.80:0/1668644857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c0130dc0 0x7f35c0131250 secure :-1 s=THROTTLE_DONE pgs=904 cs=0 l=1 rx=0x7f35b00103d0 tx=0x7f35b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.657+0000 7f35b7fff700 1 -- 172.21.15.80:0/1668644857 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v28) v1 ==== 184+0+0 (secure 0 0 0) 0x7f35b0009580 con 0x7f35c0130dc0 2019-11-28T11:33:01.701 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:33:01.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.659+0000 7f35c5193700 1 -- 172.21.15.80:0/1668644857 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3598018730 msgr2=0x7f359801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.659+0000 7f35c5193700 1 --2- 172.21.15.80:0/1668644857 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3598018730 0x7f359801abc0 crc :-1 s=READY pgs=370 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.659+0000 7f35c5193700 1 -- 172.21.15.80:0/1668644857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c0130dc0 msgr2=0x7f35c0131250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.659+0000 7f35c5193700 1 --2- 172.21.15.80:0/1668644857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c0130dc0 0x7f35c0131250 secure :-1 s=READY pgs=904 cs=0 l=1 rx=0x7f35b00103d0 tx=0x7f35b0010200).stop 2019-11-28T11:33:01.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.659+0000 7f35c5193700 1 -- 172.21.15.80:0/1668644857 shutdown_connections 2019-11-28T11:33:01.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.659+0000 7f35c5193700 1 --2- 172.21.15.80:0/1668644857 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3598018730 0x7f359801abc0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.659+0000 7f35c5193700 1 --2- 172.21.15.80:0/1668644857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35c0130dc0 0x7f35c0131250 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.659+0000 7f35c5193700 1 --2- 172.21.15.80:0/1668644857 >> v2:172.21.15.174:3300/0 conn(0x7f35c0152750 0x7f35c0135790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.659+0000 7f35c5193700 1 -- 172.21.15.80:0/1668644857 shutdown_connections 2019-11-28T11:33:01.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.659+0000 7f35c5193700 1 -- 172.21.15.80:0/1668644857 wait complete. 2019-11-28T11:33:01.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.659+0000 7f35c5193700 1 -- 172.21.15.80:0/1668644857 >> 172.21.15.80:0/1668644857 conn(0x7f35c01476e0 msgr2=0x7f35c012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:01.713 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:33:01.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.800+0000 7fa0b8c52700 1 Processor -- start 2019-11-28T11:33:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.800+0000 7fa0b8c52700 1 -- start start 2019-11-28T11:33:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.801+0000 7fa0b8c52700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0b415f100 0x7fa0b406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.801+0000 7fa0b8c52700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b406db60 con 0x7fa0b406c2f0 2019-11-28T11:33:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.801+0000 7fa0b8c52700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b406e060 con 0x7fa0b415ed10 2019-11-28T11:33:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.801+0000 7fa0b8c52700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b406fe00 con 0x7fa0b415f100 2019-11-28T11:33:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.801+0000 7fa0b359e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa0b406c2f0 0x7fa0b406c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34918/0 (socket says 172.21.15.80:34918) 2019-11-28T11:33:01.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.801+0000 7fa0b359e700 1 -- 172.21.15.80:0/61574868 learned_addr learned my addr 172.21.15.80:0/61574868 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:01.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.801+0000 7fa0b259c700 1 --2- 172.21.15.80:0/61574868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0b415f100 0x7fa0b406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:01.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.801+0000 7fa0b1d9b700 1 -- 172.21.15.80:0/61574868 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427217431 0 0) 0x7fa0ac001150 con 0x7fa0b406c2f0 2019-11-28T11:33:01.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.801+0000 7fa0b1d9b700 1 -- 172.21.15.80:0/61574868 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0a0002e80 con 0x7fa0b406c2f0 2019-11-28T11:33:01.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.801+0000 7fa0b1d9b700 1 -- 172.21.15.80:0/61574868 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854528933 0 0) 0x7fa0a4001400 con 0x7fa0b415ed10 2019-11-28T11:33:01.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.801+0000 7fa0b1d9b700 1 -- 172.21.15.80:0/61574868 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0a0004170 con 0x7fa0b415ed10 2019-11-28T11:33:01.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.801+0000 7fa0b259c700 1 -- 172.21.15.80:0/61574868 >> v1:172.21.15.174:6789/0 conn(0x7fa0b415ed10 legacy=0x7fa0b4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.801+0000 7fa0b259c700 1 -- 172.21.15.80:0/61574868 >> v1:172.21.15.80:6789/0 conn(0x7fa0b406c2f0 legacy=0x7fa0b406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.802+0000 7fa0b259c700 1 -- 172.21.15.80:0/61574868 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b4070760 con 0x7fa0b415f100 2019-11-28T11:33:01.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.802+0000 7fa0b259c700 1 --2- 172.21.15.80:0/61574868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0b415f100 0x7fa0b406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa09c00af50 tx=0x7fa09c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.802+0000 7fa0b259c700 1 --2- 172.21.15.80:0/61574868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0b415f100 0x7fa0b406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa09c00af50 tx=0x7fa09c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.802+0000 7fa0b259c700 1 --2- 172.21.15.80:0/61574868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0b415f100 0x7fa0b406bdb0 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7fa09c00af50 tx=0x7fa09c00b760).ready entity=mon.2 client_cookie=11134b86cf3a3d31 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:01.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.802+0000 7fa0b259c700 1 --2- 172.21.15.80:0/61574868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0b415f100 0x7fa0b406bdb0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fa09c00af50 tx=0x7fa09c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.802+0000 7fa0b1d9b700 1 -- 172.21.15.80:0/61574868 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa09c000960 con 0x7fa0b415f100 2019-11-28T11:33:01.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.802+0000 7fa0b259c700 1 --2- 172.21.15.80:0/61574868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0b415f100 0x7fa0b406bdb0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fa09c00af50 tx=0x7fa09c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.802+0000 7fa0b259c700 1 --2- 172.21.15.80:0/61574868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0b415f100 0x7fa0b406bdb0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fa09c00af50 tx=0x7fa09c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.802+0000 7fa0b1d9b700 1 -- 172.21.15.80:0/61574868 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c009860 con 0x7fa0b415f100 2019-11-28T11:33:01.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.802+0000 7fa0b1d9b700 1 -- 172.21.15.80:0/61574868 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa09c009f30 con 0x7fa0b415f100 2019-11-28T11:33:01.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.802+0000 7fa0b8c52700 1 -- 172.21.15.80:0/61574868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0b415f100 msgr2=0x7fa0b406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.802+0000 7fa0b8c52700 1 --2- 172.21.15.80:0/61574868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0b415f100 0x7fa0b406bdb0 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7fa09c00af50 tx=0x7fa09c00b760).stop 2019-11-28T11:33:01.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.803+0000 7fa0b8c52700 1 -- 172.21.15.80:0/61574868 shutdown_connections 2019-11-28T11:33:01.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.803+0000 7fa0b8c52700 1 --2- 172.21.15.80:0/61574868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0b415f100 0x7fa0b406bdb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.803+0000 7fa0b8c52700 1 -- 172.21.15.80:0/61574868 shutdown_connections 2019-11-28T11:33:01.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.803+0000 7fa0b8c52700 1 -- 172.21.15.80:0/61574868 wait complete. 2019-11-28T11:33:01.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.803+0000 7fa0b8c52700 1 -- 172.21.15.80:0/61574868 >> 172.21.15.80:0/61574868 conn(0x7fa0b4061d40 msgr2=0x7fa0b40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:01.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.805+0000 7fa0b8c52700 1 Processor -- start 2019-11-28T11:33:01.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.805+0000 7fa0b8c52700 1 -- start start 2019-11-28T11:33:01.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.806+0000 7fa0b8c52700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa0b4128480 0x7fa0b4115b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:01.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.806+0000 7fa0b8c52700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa0b4102e90 0x7fa0b4101e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:01.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.806+0000 7fa0b8c52700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b4148b90 con 0x7fa0b4102a00 2019-11-28T11:33:01.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.806+0000 7fa0b8c52700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b4113ab0 con 0x7fa0b4128480 2019-11-28T11:33:01.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.806+0000 7fa0b8c52700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b4113d80 con 0x7fa0b4102e90 2019-11-28T11:33:01.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.806+0000 7fa0b2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa0b4128480 0x7fa0b4115b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:01.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.806+0000 7fa0b2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa0b4128480 0x7fa0b4115b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35608/0 (socket says 172.21.15.80:35608) 2019-11-28T11:33:01.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.806+0000 7fa0b2d9d700 1 -- 172.21.15.80:0/373251440 learned_addr learned my addr 172.21.15.80:0/373251440 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:01.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.806+0000 7fa0b359e700 1 --2- 172.21.15.80:0/373251440 >> v2:172.21.15.174:3300/0 conn(0x7fa0b4102e90 0x7fa0b4101e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:01.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.806+0000 7fa0b2d9d700 1 -- 172.21.15.80:0/373251440 >> v2:172.21.15.174:3300/0 conn(0x7fa0b4102e90 msgr2=0x7fa0b4101e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.806+0000 7fa0b2d9d700 1 --2- 172.21.15.80:0/373251440 >> v2:172.21.15.174:3300/0 conn(0x7fa0b4102e90 0x7fa0b4101e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:01.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.806+0000 7fa0b2d9d700 1 -- 172.21.15.80:0/373251440 >> v1:172.21.15.174:6789/0 conn(0x7fa0b4102a00 legacy=0x7fa0b41480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:01.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.806+0000 7fa0b2d9d700 1 -- 172.21.15.80:0/373251440 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b4114410 con 0x7fa0b4128480 2019-11-28T11:33:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.806+0000 7fa0b2d9d700 1 --2- 172.21.15.80:0/373251440 >> v2:172.21.15.80:3300/0 conn(0x7fa0b4128480 0x7fa0b4115b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa0a4010790 tx=0x7fa0a4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.806+0000 7fa0b2d9d700 1 --2- 172.21.15.80:0/373251440 >> v2:172.21.15.80:3300/0 conn(0x7fa0b4128480 0x7fa0b4115b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa0a4010790 tx=0x7fa0a4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.806+0000 7fa0b2d9d700 1 --2- 172.21.15.80:0/373251440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4128480 0x7fa0b4115b10 secure :-1 s=READY pgs=906 cs=0 l=1 rx=0x7fa0a4010790 tx=0x7fa0a4010610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.807+0000 7fa0b2d9d700 1 --2- 172.21.15.80:0/373251440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4128480 0x7fa0b4115b10 secure :-1 s=THROTTLE_DONE pgs=906 cs=0 l=1 rx=0x7fa0a4010790 tx=0x7fa0a4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.807+0000 7fa0b2d9d700 1 --2- 172.21.15.80:0/373251440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4128480 0x7fa0b4115b10 secure :-1 s=THROTTLE_DONE pgs=906 cs=0 l=1 rx=0x7fa0a4010790 tx=0x7fa0a4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.807+0000 7fa0ab7fe700 1 -- 172.21.15.80:0/373251440 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0a4005af0 con 0x7fa0b4128480 2019-11-28T11:33:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.807+0000 7fa0b2d9d700 1 --2- 172.21.15.80:0/373251440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4128480 0x7fa0b4115b10 secure :-1 s=THROTTLE_DONE pgs=906 cs=0 l=1 rx=0x7fa0a4010790 tx=0x7fa0a4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.807+0000 7fa0ab7fe700 1 -- 172.21.15.80:0/373251440 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a4005710 con 0x7fa0b4128480 2019-11-28T11:33:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.807+0000 7fa0ab7fe700 1 -- 172.21.15.80:0/373251440 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0a40060d0 con 0x7fa0b4128480 2019-11-28T11:33:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.807+0000 7fa0b8c52700 1 -- 172.21.15.80:0/373251440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b4114790 con 0x7fa0b4128480 2019-11-28T11:33:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.807+0000 7fa0b8c52700 1 -- 172.21.15.80:0/373251440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b4114410 con 0x7fa0b4128480 2019-11-28T11:33:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.807+0000 7fa0b2d9d700 1 --2- 172.21.15.80:0/373251440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4128480 0x7fa0b4115b10 secure :-1 s=THROTTLE_DONE pgs=906 cs=0 l=1 rx=0x7fa0a4010790 tx=0x7fa0a4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.807+0000 7fa0ab7fe700 1 -- 172.21.15.80:0/373251440 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa0a4005900 con 0x7fa0b4128480 2019-11-28T11:33:01.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.807+0000 7fa0b2d9d700 1 --2- 172.21.15.80:0/373251440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4128480 0x7fa0b4115b10 secure :-1 s=THROTTLE_DONE pgs=906 cs=0 l=1 rx=0x7fa0a4010790 tx=0x7fa0a4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.807+0000 7fa0ab7fe700 1 --2- 172.21.15.80:0/373251440 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa098018730 0x7fa09801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:01.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.808+0000 7fa0ab7fe700 1 -- 172.21.15.80:0/373251440 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa0a4031de0 con 0x7fa0b4128480 2019-11-28T11:33:01.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.808+0000 7fa0b259c700 1 --2- 172.21.15.80:0/373251440 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa098018730 0x7fa09801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:01.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.808+0000 7fa0b259c700 1 --2- 172.21.15.80:0/373251440 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa098018730 0x7fa09801abc0 crc :-1 s=READY pgs=371 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:01.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.815+0000 7fa0b8c52700 1 -- 172.21.15.80:0/373251440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b4114790 con 0x7fa0b4128480 2019-11-28T11:33:01.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.819+0000 7fa0b2d9d700 1 --2- 172.21.15.80:0/373251440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4128480 0x7fa0b4115b10 secure :-1 s=THROTTLE_DONE pgs=906 cs=0 l=1 rx=0x7fa0a4010790 tx=0x7fa0a4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:01.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.819+0000 7fa0ab7fe700 1 -- 172.21.15.80:0/373251440 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa0a4007920 con 0x7fa0b4128480 2019-11-28T11:33:02.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.989+0000 7fa0b8c52700 1 -- 172.21.15.80:0/373251440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa0b4114410 con 0x7fa0b4128480 2019-11-28T11:33:02.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.992+0000 7fa0b2d9d700 1 --2- 172.21.15.80:0/373251440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4128480 0x7fa0b4115b10 secure :-1 s=THROTTLE_DONE pgs=906 cs=0 l=1 rx=0x7fa0a4010790 tx=0x7fa0a4010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.992+0000 7fa0ab7fe700 1 -- 172.21.15.80:0/373251440 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v29) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa0a4005c10 con 0x7fa0b4128480 2019-11-28T11:33:02.040 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:33:02.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.998+0000 7fa0b8c52700 1 -- 172.21.15.80:0/373251440 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa098018730 msgr2=0x7fa09801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.998+0000 7fa0b8c52700 1 --2- 172.21.15.80:0/373251440 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa098018730 0x7fa09801abc0 crc :-1 s=READY pgs=371 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:02.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.998+0000 7fa0b8c52700 1 -- 172.21.15.80:0/373251440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4128480 msgr2=0x7fa0b4115b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.998+0000 7fa0b8c52700 1 --2- 172.21.15.80:0/373251440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4128480 0x7fa0b4115b10 secure :-1 s=READY pgs=906 cs=0 l=1 rx=0x7fa0a4010790 tx=0x7fa0a4010610).stop 2019-11-28T11:33:02.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.998+0000 7fa0b8c52700 1 -- 172.21.15.80:0/373251440 shutdown_connections 2019-11-28T11:33:02.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.998+0000 7fa0b8c52700 1 --2- 172.21.15.80:0/373251440 >> v2:172.21.15.174:3300/0 conn(0x7fa0b4102e90 0x7fa0b4101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:02.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.998+0000 7fa0b8c52700 1 --2- 172.21.15.80:0/373251440 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa098018730 0x7fa09801abc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:02.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.998+0000 7fa0b8c52700 1 --2- 172.21.15.80:0/373251440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa0b4128480 0x7fa0b4115b10 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:02.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.998+0000 7fa0b8c52700 1 -- 172.21.15.80:0/373251440 shutdown_connections 2019-11-28T11:33:02.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.998+0000 7fa0b8c52700 1 -- 172.21.15.80:0/373251440 wait complete. 2019-11-28T11:33:02.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:01.998+0000 7fa0b8c52700 1 -- 172.21.15.80:0/373251440 >> 172.21.15.80:0/373251440 conn(0x7fa0b4166610 msgr2=0x7fa0b41473d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:02.052 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:33:02.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.140+0000 7f673595d700 1 Processor -- start 2019-11-28T11:33:02.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.141+0000 7f673595d700 1 -- start start 2019-11-28T11:33:02.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.141+0000 7f673595d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f67301639f0 0x7f6730165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:02.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f673595d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673006db60 con 0x7f673015f100 2019-11-28T11:33:02.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f673595d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673006e060 con 0x7f673015ed10 2019-11-28T11:33:02.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f673595d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673006fe00 con 0x7f67301639f0 2019-11-28T11:33:02.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672effd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f673015f100 0x7f673006bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34932/0 (socket says 172.21.15.80:34932) 2019-11-28T11:33:02.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672effd700 1 -- 172.21.15.80:0/2883375452 learned_addr learned my addr 172.21.15.80:0/2883375452 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:02.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672ffff700 1 --2- 172.21.15.80:0/2883375452 >> v2:172.21.15.174:3300/0 conn(0x7f67301639f0 0x7f6730165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:02.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 -- 172.21.15.80:0/2883375452 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108198170 0 0) 0x7f6718001150 con 0x7f673015f100 2019-11-28T11:33:02.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 -- 172.21.15.80:0/2883375452 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6710002e80 con 0x7f673015f100 2019-11-28T11:33:02.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 -- 172.21.15.80:0/2883375452 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866451590 0 0) 0x7f6720001080 con 0x7f673015ed10 2019-11-28T11:33:02.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 -- 172.21.15.80:0/2883375452 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67100030b0 con 0x7f673015ed10 2019-11-28T11:33:02.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 -- 172.21.15.80:0/2883375452 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2080920104 0 0) 0x7f6718001130 con 0x7f673015f100 2019-11-28T11:33:02.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 -- 172.21.15.80:0/2883375452 >> v2:172.21.15.174:3300/0 conn(0x7f67301639f0 msgr2=0x7f6730165df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:02.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 --2- 172.21.15.80:0/2883375452 >> v2:172.21.15.174:3300/0 conn(0x7f67301639f0 0x7f6730165df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:02.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 -- 172.21.15.80:0/2883375452 >> v1:172.21.15.174:6789/0 conn(0x7f673015ed10 legacy=0x7f6730073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 -- 172.21.15.80:0/2883375452 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6730070760 con 0x7f673015f100 2019-11-28T11:33:02.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 -- 172.21.15.80:0/2883375452 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f6718001660 con 0x7f673015f100 2019-11-28T11:33:02.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 -- 172.21.15.80:0/2883375452 >> v1:172.21.15.80:6789/0 conn(0x7f673015f100 legacy=0x7f673006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 --2- 172.21.15.80:0/2883375452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6710003b80 0x7f6710005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:02.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 --2- 172.21.15.80:0/2883375452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67100066d0 0x7f6710008b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:02.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 --2- 172.21.15.80:0/2883375452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f671004d3a0 0x7f671004f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:02.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672f7fe700 1 --2- 172.21.15.80:0/2883375452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6710003b80 0x7f6710005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:02.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 -- 172.21.15.80:0/2883375452 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671004fff0 con 0x7f6710003b80 2019-11-28T11:33:02.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 -- 172.21.15.80:0/2883375452 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6710050220 con 0x7f671004d3a0 2019-11-28T11:33:02.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672e7fc700 1 -- 172.21.15.80:0/2883375452 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6710050450 con 0x7f67100066d0 2019-11-28T11:33:02.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672effd700 1 --2- 172.21.15.80:0/2883375452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67100066d0 0x7f6710008b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:02.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.142+0000 7f672ffff700 1 --2- 172.21.15.80:0/2883375452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f671004d3a0 0x7f671004f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:02.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f672f7fe700 1 -- 172.21.15.80:0/2883375452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67100066d0 msgr2=0x7f6710008b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:02.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f672f7fe700 1 --2- 172.21.15.80:0/2883375452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67100066d0 0x7f6710008b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:02.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f672f7fe700 1 -- 172.21.15.80:0/2883375452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f671004d3a0 msgr2=0x7f671004f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:02.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f672f7fe700 1 --2- 172.21.15.80:0/2883375452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f671004d3a0 0x7f671004f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:02.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f672f7fe700 1 -- 172.21.15.80:0/2883375452 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6710050700 con 0x7f6710003b80 2019-11-28T11:33:02.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f672ffff700 1 -- 172.21.15.80:0/2883375452 reap_dead start 2019-11-28T11:33:02.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f672f7fe700 1 --2- 172.21.15.80:0/2883375452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6710003b80 0x7f6710005fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f672000af70 tx=0x7f672000b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f672f7fe700 1 --2- 172.21.15.80:0/2883375452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6710003b80 0x7f6710005fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f672000af70 tx=0x7f672000b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f672f7fe700 1 --2- 172.21.15.80:0/2883375452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6710003b80 0x7f6710005fe0 secure :-1 s=READY pgs=908 cs=0 l=1 rx=0x7f672000af70 tx=0x7f672000b2f0).ready entity=mon.0 client_cookie=cbbb2cc1ac0555e6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:02.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f672f7fe700 1 --2- 172.21.15.80:0/2883375452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6710003b80 0x7f6710005fe0 secure :-1 s=THROTTLE_DONE pgs=908 cs=0 l=1 rx=0x7f672000af70 tx=0x7f672000b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f672e7fc700 1 -- 172.21.15.80:0/2883375452 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6720009c80 con 0x7f6710003b80 2019-11-28T11:33:02.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f672f7fe700 1 --2- 172.21.15.80:0/2883375452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6710003b80 0x7f6710005fe0 secure :-1 s=THROTTLE_DONE pgs=908 cs=0 l=1 rx=0x7f672000af70 tx=0x7f672000b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f672f7fe700 1 --2- 172.21.15.80:0/2883375452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6710003b80 0x7f6710005fe0 secure :-1 s=THROTTLE_DONE pgs=908 cs=0 l=1 rx=0x7f672000af70 tx=0x7f672000b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f672e7fc700 1 -- 172.21.15.80:0/2883375452 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67200098a0 con 0x7f6710003b80 2019-11-28T11:33:02.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f672e7fc700 1 -- 172.21.15.80:0/2883375452 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f672000a3b0 con 0x7f6710003b80 2019-11-28T11:33:02.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f673595d700 1 -- 172.21.15.80:0/2883375452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6710003b80 msgr2=0x7f6710005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f673595d700 1 --2- 172.21.15.80:0/2883375452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6710003b80 0x7f6710005fe0 secure :-1 s=READY pgs=908 cs=0 l=1 rx=0x7f672000af70 tx=0x7f672000b2f0).stop 2019-11-28T11:33:02.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f673595d700 1 -- 172.21.15.80:0/2883375452 shutdown_connections 2019-11-28T11:33:02.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.143+0000 7f673595d700 1 --2- 172.21.15.80:0/2883375452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6710003b80 0x7f6710005fe0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:02.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.144+0000 7f673595d700 1 -- 172.21.15.80:0/2883375452 shutdown_connections 2019-11-28T11:33:02.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.144+0000 7f673595d700 1 -- 172.21.15.80:0/2883375452 wait complete. 2019-11-28T11:33:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.144+0000 7f673595d700 1 -- 172.21.15.80:0/2883375452 >> 172.21.15.80:0/2883375452 conn(0x7f6730061d40 msgr2=0x7f67300641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.146+0000 7f673595d700 1 Processor -- start 2019-11-28T11:33:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.146+0000 7f673595d700 1 -- start start 2019-11-28T11:33:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.147+0000 7f673595d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673012e3d0 0x7f673012e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.147+0000 7f673595d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673013bdf0 con 0x7f6730137480 2019-11-28T11:33:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.147+0000 7f673595d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67301083e0 con 0x7f673010c510 2019-11-28T11:33:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.147+0000 7f673595d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673013b9a0 con 0x7f673012e3d0 2019-11-28T11:33:02.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.147+0000 7f672effd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6730137480 0x7f673010bd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34942/0 (socket says 172.21.15.80:34942) 2019-11-28T11:33:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.147+0000 7f672effd700 1 -- 172.21.15.80:0/4046025905 learned_addr learned my addr 172.21.15.80:0/4046025905 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.147+0000 7f672f7fe700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673012e3d0 0x7f673012e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.147+0000 7f6727fff700 1 -- 172.21.15.80:0/4046025905 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011163039 0 0) 0x7f6718001110 con 0x7f6730137480 2019-11-28T11:33:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.147+0000 7f6727fff700 1 -- 172.21.15.80:0/4046025905 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6708002e80 con 0x7f6730137480 2019-11-28T11:33:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.147+0000 7f6727fff700 1 -- 172.21.15.80:0/4046025905 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502888181 0 0) 0x7f6728001400 con 0x7f673010c510 2019-11-28T11:33:02.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.147+0000 7f6727fff700 1 -- 172.21.15.80:0/4046025905 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67080030b0 con 0x7f673010c510 2019-11-28T11:33:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.148+0000 7f672f7fe700 1 -- 172.21.15.80:0/4046025905 >> v1:172.21.15.174:6789/0 conn(0x7f673010c510 legacy=0x7f6730152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.148+0000 7f672f7fe700 1 -- 172.21.15.80:0/4046025905 >> v1:172.21.15.80:6789/0 conn(0x7f6730137480 legacy=0x7f673010bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.148+0000 7f672f7fe700 1 -- 172.21.15.80:0/4046025905 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673010a640 con 0x7f673012e3d0 2019-11-28T11:33:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.148+0000 7f672f7fe700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673012e3d0 0x7f673012e7c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.148+0000 7f672f7fe700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673012e3d0 0x7f673012e7c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.148+0000 7f672f7fe700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673012e3d0 0x7f673012e7c0 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:02.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.148+0000 7f672f7fe700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673012e3d0 0x7f673012e7c0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.148+0000 7f6727fff700 1 -- 172.21.15.80:0/4046025905 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f672000ac40 con 0x7f673012e3d0 2019-11-28T11:33:02.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.148+0000 7f672f7fe700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673012e3d0 0x7f673012e7c0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.148+0000 7f672f7fe700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673012e3d0 0x7f673012e7c0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.148+0000 7f6727fff700 1 -- 172.21.15.80:0/4046025905 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6720009790 con 0x7f673012e3d0 2019-11-28T11:33:02.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.148+0000 7f6727fff700 1 -- 172.21.15.80:0/4046025905 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6720009e60 con 0x7f673012e3d0 2019-11-28T11:33:02.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.148+0000 7f673595d700 1 -- 172.21.15.80:0/4046025905 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673010a9c0 con 0x7f673012e3d0 2019-11-28T11:33:02.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.148+0000 7f673595d700 1 -- 172.21.15.80:0/4046025905 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673010a640 con 0x7f673012e3d0 2019-11-28T11:33:02.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.148+0000 7f672f7fe700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673012e3d0 0x7f673012e7c0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.148+0000 7f6727fff700 1 -- 172.21.15.80:0/4046025905 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6720009980 con 0x7f673012e3d0 2019-11-28T11:33:02.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.149+0000 7f672f7fe700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673012e3d0 0x7f673012e7c0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.149+0000 7f6727fff700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6708018750 0x7f670801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:02.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.149+0000 7f6727fff700 1 -- 172.21.15.80:0/4046025905 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6720031a70 con 0x7f673012e3d0 2019-11-28T11:33:02.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.149+0000 7f672effd700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6708018750 0x7f670801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:02.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.149+0000 7f672effd700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6708018750 0x7f670801abe0 crc :-1 s=READY pgs=372 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:02.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.156+0000 7f673595d700 1 -- 172.21.15.80:0/4046025905 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673010a9c0 con 0x7f673012e3d0 2019-11-28T11:33:02.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.160+0000 7f672f7fe700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673012e3d0 0x7f673012e7c0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.160+0000 7f6727fff700 1 -- 172.21.15.80:0/4046025905 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f672000ae50 con 0x7f673012e3d0 2019-11-28T11:33:02.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.329+0000 7f673595d700 1 -- 172.21.15.80:0/4046025905 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f673010a640 con 0x7f673012e3d0 2019-11-28T11:33:02.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.333+0000 7f672f7fe700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673012e3d0 0x7f673012e7c0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.333+0000 7f6727fff700 1 -- 172.21.15.80:0/4046025905 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v30) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6720009ab0 con 0x7f673012e3d0 2019-11-28T11:33:02.381 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:33:02.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.339+0000 7f673595d700 1 -- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6708018750 msgr2=0x7f670801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.339+0000 7f673595d700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6708018750 0x7f670801abe0 crc :-1 s=READY pgs=372 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:02.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.339+0000 7f673595d700 1 -- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673012e3d0 msgr2=0x7f673012e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.339+0000 7f673595d700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673012e3d0 0x7f673012e7c0 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).stop 2019-11-28T11:33:02.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.339+0000 7f673595d700 1 -- 172.21.15.80:0/4046025905 shutdown_connections 2019-11-28T11:33:02.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.339+0000 7f673595d700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6708018750 0x7f670801abe0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:02.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.339+0000 7f673595d700 1 --2- 172.21.15.80:0/4046025905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673012e3d0 0x7f673012e7c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:02.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.339+0000 7f673595d700 1 -- 172.21.15.80:0/4046025905 shutdown_connections 2019-11-28T11:33:02.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.339+0000 7f673595d700 1 -- 172.21.15.80:0/4046025905 wait complete. 2019-11-28T11:33:02.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.339+0000 7f673595d700 1 -- 172.21.15.80:0/4046025905 >> 172.21.15.80:0/4046025905 conn(0x7f673007c450 msgr2=0x7f6730118c60 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:02.393 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:33:02.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.481+0000 7faa46690700 1 Processor -- start 2019-11-28T11:33:02.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.481+0000 7faa46690700 1 -- start start 2019-11-28T11:33:02.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.482+0000 7faa46690700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4015ed10 0x7faa4015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:02.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.482+0000 7faa46690700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4006db60 con 0x7faa40073020 2019-11-28T11:33:02.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.482+0000 7faa46690700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4006e060 con 0x7faa400734b0 2019-11-28T11:33:02.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.482+0000 7faa46690700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4006f3d0 con 0x7faa4015ed10 2019-11-28T11:33:02.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.482+0000 7faa3ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faa40073020 0x7faa40071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34950/0 (socket says 172.21.15.80:34950) 2019-11-28T11:33:02.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.482+0000 7faa3ffff700 1 -- 172.21.15.80:0/268611448 learned_addr learned my addr 172.21.15.80:0/268611448 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:02.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.482+0000 7faa44c2d700 1 --2- 172.21.15.80:0/268611448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4015ed10 0x7faa4015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:02.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.482+0000 7faa3f7fe700 1 -- 172.21.15.80:0/268611448 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273168829 0 0) 0x7faa300014d0 con 0x7faa40073020 2019-11-28T11:33:02.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa3f7fe700 1 -- 172.21.15.80:0/268611448 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa2c002e80 con 0x7faa40073020 2019-11-28T11:33:02.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa3f7fe700 1 -- 172.21.15.80:0/268611448 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398822360 0 0) 0x7faa380009b0 con 0x7faa400734b0 2019-11-28T11:33:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa3f7fe700 1 -- 172.21.15.80:0/268611448 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa2c004170 con 0x7faa400734b0 2019-11-28T11:33:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa44c2d700 1 -- 172.21.15.80:0/268611448 >> v1:172.21.15.174:6789/0 conn(0x7faa400734b0 legacy=0x7faa400726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa44c2d700 1 -- 172.21.15.80:0/268611448 >> v1:172.21.15.80:6789/0 conn(0x7faa40073020 legacy=0x7faa40071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa44c2d700 1 -- 172.21.15.80:0/268611448 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa40070760 con 0x7faa4015ed10 2019-11-28T11:33:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa44c2d700 1 --2- 172.21.15.80:0/268611448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4015ed10 0x7faa4015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faa2800af50 tx=0x7faa2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa44c2d700 1 --2- 172.21.15.80:0/268611448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4015ed10 0x7faa4015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faa2800af50 tx=0x7faa2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa44c2d700 1 --2- 172.21.15.80:0/268611448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4015ed10 0x7faa4015f100 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7faa2800af50 tx=0x7faa2800b760).ready entity=mon.2 client_cookie=4f99158b5847f512 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa44c2d700 1 --2- 172.21.15.80:0/268611448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4015ed10 0x7faa4015f100 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7faa2800af50 tx=0x7faa2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa3f7fe700 1 -- 172.21.15.80:0/268611448 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa28000960 con 0x7faa4015ed10 2019-11-28T11:33:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa44c2d700 1 --2- 172.21.15.80:0/268611448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4015ed10 0x7faa4015f100 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7faa2800af50 tx=0x7faa2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa44c2d700 1 --2- 172.21.15.80:0/268611448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4015ed10 0x7faa4015f100 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7faa2800af50 tx=0x7faa2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa3f7fe700 1 -- 172.21.15.80:0/268611448 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa28009860 con 0x7faa4015ed10 2019-11-28T11:33:02.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa3f7fe700 1 -- 172.21.15.80:0/268611448 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa28009f30 con 0x7faa4015ed10 2019-11-28T11:33:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa46690700 1 -- 172.21.15.80:0/268611448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4015ed10 msgr2=0x7faa4015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.483+0000 7faa46690700 1 --2- 172.21.15.80:0/268611448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4015ed10 0x7faa4015f100 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7faa2800af50 tx=0x7faa2800b760).stop 2019-11-28T11:33:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.484+0000 7faa46690700 1 -- 172.21.15.80:0/268611448 shutdown_connections 2019-11-28T11:33:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.484+0000 7faa46690700 1 --2- 172.21.15.80:0/268611448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4015ed10 0x7faa4015f100 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.484+0000 7faa46690700 1 -- 172.21.15.80:0/268611448 shutdown_connections 2019-11-28T11:33:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.484+0000 7faa46690700 1 -- 172.21.15.80:0/268611448 wait complete. 2019-11-28T11:33:02.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.484+0000 7faa46690700 1 -- 172.21.15.80:0/268611448 >> 172.21.15.80:0/268611448 conn(0x7faa40061d40 msgr2=0x7faa400641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:02.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.486+0000 7faa46690700 1 Processor -- start 2019-11-28T11:33:02.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.486+0000 7faa46690700 1 -- start start 2019-11-28T11:33:02.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.487+0000 7faa46690700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faa40114f60 0x7faa40106b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:02.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.487+0000 7faa46690700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4012e9a0 0x7faa40105a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:02.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.487+0000 7faa46690700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa40130b20 con 0x7faa401070d0 2019-11-28T11:33:02.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.487+0000 7faa46690700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa40148b60 con 0x7faa40114f60 2019-11-28T11:33:02.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.487+0000 7faa46690700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa40148e30 con 0x7faa4012e9a0 2019-11-28T11:33:02.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.487+0000 7faa44c2d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faa40114f60 0x7faa40106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:02.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.487+0000 7faa44c2d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faa40114f60 0x7faa40106b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35640/0 (socket says 172.21.15.80:35640) 2019-11-28T11:33:02.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.487+0000 7faa44c2d700 1 -- 172.21.15.80:0/48765215 learned_addr learned my addr 172.21.15.80:0/48765215 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:02.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.487+0000 7faa4542e700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4012e9a0 0x7faa40105a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:02.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa44c2d700 1 -- 172.21.15.80:0/48765215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4012e9a0 msgr2=0x7faa40105a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa44c2d700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4012e9a0 0x7faa40105a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:02.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa44c2d700 1 -- 172.21.15.80:0/48765215 >> v1:172.21.15.174:6789/0 conn(0x7faa401070d0 legacy=0x7faa4012e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa44c2d700 1 -- 172.21.15.80:0/48765215 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa40104390 con 0x7faa40114f60 2019-11-28T11:33:02.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa3d7fa700 1 -- 172.21.15.80:0/48765215 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145446561 0 0) 0x7faa300012c0 con 0x7faa401070d0 2019-11-28T11:33:02.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa44c2d700 1 --2- 172.21.15.80:0/48765215 >> v2:172.21.15.80:3300/0 conn(0x7faa40114f60 0x7faa40106b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faa280104a0 tx=0x7faa280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa44c2d700 1 --2- 172.21.15.80:0/48765215 >> v2:172.21.15.80:3300/0 conn(0x7faa40114f60 0x7faa40106b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faa280104a0 tx=0x7faa280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa44c2d700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa40114f60 0x7faa40106b90 secure :-1 s=READY pgs=911 cs=0 l=1 rx=0x7faa280104a0 tx=0x7faa280102d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:02.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa44c2d700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa40114f60 0x7faa40106b90 secure :-1 s=THROTTLE_DONE pgs=911 cs=0 l=1 rx=0x7faa280104a0 tx=0x7faa280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa3d7fa700 1 -- 172.21.15.80:0/48765215 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa28000940 con 0x7faa40114f60 2019-11-28T11:33:02.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa44c2d700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa40114f60 0x7faa40106b90 secure :-1 s=THROTTLE_DONE pgs=911 cs=0 l=1 rx=0x7faa280104a0 tx=0x7faa280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa46690700 1 -- 172.21.15.80:0/48765215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa40104710 con 0x7faa40114f60 2019-11-28T11:33:02.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa3d7fa700 1 -- 172.21.15.80:0/48765215 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa28000940 con 0x7faa40114f60 2019-11-28T11:33:02.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa44c2d700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa40114f60 0x7faa40106b90 secure :-1 s=THROTTLE_DONE pgs=911 cs=0 l=1 rx=0x7faa280104a0 tx=0x7faa280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa3d7fa700 1 -- 172.21.15.80:0/48765215 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa28009b70 con 0x7faa40114f60 2019-11-28T11:33:02.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa46690700 1 -- 172.21.15.80:0/48765215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa40104390 con 0x7faa40114f60 2019-11-28T11:33:02.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa44c2d700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa40114f60 0x7faa40106b90 secure :-1 s=THROTTLE_DONE pgs=911 cs=0 l=1 rx=0x7faa280104a0 tx=0x7faa280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa3d7fa700 1 -- 172.21.15.80:0/48765215 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7faa2800a2d0 con 0x7faa40114f60 2019-11-28T11:33:02.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.488+0000 7faa44c2d700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa40114f60 0x7faa40106b90 secure :-1 s=THROTTLE_DONE pgs=911 cs=0 l=1 rx=0x7faa280104a0 tx=0x7faa280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.489+0000 7faa3d7fa700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa24018730 0x7faa2401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:02.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.489+0000 7faa3d7fa700 1 -- 172.21.15.80:0/48765215 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7faa28031ac0 con 0x7faa40114f60 2019-11-28T11:33:02.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.489+0000 7faa3ffff700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa24018730 0x7faa2401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:02.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.489+0000 7faa3ffff700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa24018730 0x7faa2401abc0 crc :-1 s=READY pgs=373 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:02.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.497+0000 7faa46690700 1 -- 172.21.15.80:0/48765215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa40104710 con 0x7faa40114f60 2019-11-28T11:33:02.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.500+0000 7faa44c2d700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa40114f60 0x7faa40106b90 secure :-1 s=THROTTLE_DONE pgs=911 cs=0 l=1 rx=0x7faa280104a0 tx=0x7faa280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.500+0000 7faa3d7fa700 1 -- 172.21.15.80:0/48765215 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7faa2800a0c0 con 0x7faa40114f60 2019-11-28T11:33:02.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.672+0000 7faa46690700 1 -- 172.21.15.80:0/48765215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7faa40104390 con 0x7faa40114f60 2019-11-28T11:33:02.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.674+0000 7faa44c2d700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa40114f60 0x7faa40106b90 secure :-1 s=THROTTLE_DONE pgs=911 cs=0 l=1 rx=0x7faa280104a0 tx=0x7faa280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.674+0000 7faa3d7fa700 1 -- 172.21.15.80:0/48765215 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v31) v1 ==== 184+0+0 (secure 0 0 0) 0x7faa28009580 con 0x7faa40114f60 2019-11-28T11:33:02.719 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:33:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.677+0000 7faa46690700 1 -- 172.21.15.80:0/48765215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa24018730 msgr2=0x7faa2401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.677+0000 7faa46690700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa24018730 0x7faa2401abc0 crc :-1 s=READY pgs=373 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.677+0000 7faa46690700 1 -- 172.21.15.80:0/48765215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa40114f60 msgr2=0x7faa40106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.677+0000 7faa46690700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa40114f60 0x7faa40106b90 secure :-1 s=READY pgs=911 cs=0 l=1 rx=0x7faa280104a0 tx=0x7faa280102d0).stop 2019-11-28T11:33:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.677+0000 7faa46690700 1 -- 172.21.15.80:0/48765215 shutdown_connections 2019-11-28T11:33:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.677+0000 7faa46690700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4012e9a0 0x7faa40105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:02.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.677+0000 7faa46690700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa24018730 0x7faa2401abc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.677+0000 7faa46690700 1 --2- 172.21.15.80:0/48765215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa40114f60 0x7faa40106b90 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.677+0000 7faa46690700 1 -- 172.21.15.80:0/48765215 shutdown_connections 2019-11-28T11:33:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.677+0000 7faa46690700 1 -- 172.21.15.80:0/48765215 wait complete. 2019-11-28T11:33:02.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.677+0000 7faa46690700 1 -- 172.21.15.80:0/48765215 >> 172.21.15.80:0/48765215 conn(0x7faa401476e0 msgr2=0x7faa4012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:02.731 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:33:02.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.806+0000 7f106375b700 1 Processor -- start 2019-11-28T11:33:02.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.807+0000 7f106375b700 1 -- start start 2019-11-28T11:33:02.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f106375b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f105c06c490 0x7f105c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:02.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f106375b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f105c06ce60 0x7f105c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:02.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f106375b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105c06db00 con 0x7f105c06c0a0 2019-11-28T11:33:02.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f106375b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105c06fd60 con 0x7f105c06c490 2019-11-28T11:33:02.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f106375b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105c070030 con 0x7f105c06ce60 2019-11-28T11:33:02.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f10614f7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f105c06c490 0x7f105c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:02.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f1061cf8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f105c06c0a0 0x7f105c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34964/0 (socket says 172.21.15.80:34964) 2019-11-28T11:33:02.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f1061cf8700 1 -- 172.21.15.80:0/1707737195 learned_addr learned my addr 172.21.15.80:0/1707737195 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f10624f9700 1 --2- 172.21.15.80:0/1707737195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f105c06ce60 0x7f105c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f10614f7700 1 -- 172.21.15.80:0/1707737195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f105c06ce60 msgr2=0x7f105c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f10614f7700 1 --2- 172.21.15.80:0/1707737195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f105c06ce60 0x7f105c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f10614f7700 1 -- 172.21.15.80:0/1707737195 >> v1:172.21.15.80:6789/0 conn(0x7f105c06c0a0 legacy=0x7f105c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f10614f7700 1 -- 172.21.15.80:0/1707737195 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c0706c0 con 0x7f105c06c490 2019-11-28T11:33:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f1060cf6700 1 -- 172.21.15.80:0/1707737195 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221458269 0 0) 0x7f104c001150 con 0x7f105c06c0a0 2019-11-28T11:33:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f10614f7700 1 --2- 172.21.15.80:0/1707737195 >> v2:172.21.15.80:3300/0 conn(0x7f105c06c490 0x7f105c06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f104400af50 tx=0x7f104400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f10614f7700 1 --2- 172.21.15.80:0/1707737195 >> v2:172.21.15.80:3300/0 conn(0x7f105c06c490 0x7f105c06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f104400af50 tx=0x7f104400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f10614f7700 1 --2- 172.21.15.80:0/1707737195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f105c06c490 0x7f105c06c920 secure :-1 s=READY pgs=913 cs=0 l=1 rx=0x7f104400af50 tx=0x7f104400b6e0).ready entity=mon.0 client_cookie=e5d2bbd8450d9250 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f10614f7700 1 --2- 172.21.15.80:0/1707737195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f105c06c490 0x7f105c06c920 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f104400af50 tx=0x7f104400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f1060cf6700 1 -- 172.21.15.80:0/1707737195 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1044007210 con 0x7f105c06c490 2019-11-28T11:33:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f10614f7700 1 --2- 172.21.15.80:0/1707737195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f105c06c490 0x7f105c06c920 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f104400af50 tx=0x7f104400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f10614f7700 1 --2- 172.21.15.80:0/1707737195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f105c06c490 0x7f105c06c920 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f104400af50 tx=0x7f104400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f1060cf6700 1 -- 172.21.15.80:0/1707737195 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10440099b0 con 0x7f105c06c490 2019-11-28T11:33:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.808+0000 7f1060cf6700 1 -- 172.21.15.80:0/1707737195 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1044009ba0 con 0x7f105c06c490 2019-11-28T11:33:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.809+0000 7f106375b700 1 -- 172.21.15.80:0/1707737195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f105c06c490 msgr2=0x7f105c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.809+0000 7f106375b700 1 --2- 172.21.15.80:0/1707737195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f105c06c490 0x7f105c06c920 secure :-1 s=READY pgs=913 cs=0 l=1 rx=0x7f104400af50 tx=0x7f104400b6e0).stop 2019-11-28T11:33:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.809+0000 7f106375b700 1 -- 172.21.15.80:0/1707737195 shutdown_connections 2019-11-28T11:33:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.809+0000 7f106375b700 1 --2- 172.21.15.80:0/1707737195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f105c06ce60 0x7f105c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.809+0000 7f106375b700 1 --2- 172.21.15.80:0/1707737195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f105c06c490 0x7f105c06c920 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.809+0000 7f106375b700 1 -- 172.21.15.80:0/1707737195 shutdown_connections 2019-11-28T11:33:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.809+0000 7f106375b700 1 -- 172.21.15.80:0/1707737195 wait complete. 2019-11-28T11:33:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.809+0000 7f106375b700 1 -- 172.21.15.80:0/1707737195 >> 172.21.15.80:0/1707737195 conn(0x7f105c061cf0 msgr2=0x7f105c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:02.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.812+0000 7f106375b700 1 Processor -- start 2019-11-28T11:33:02.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.812+0000 7f106375b700 1 -- start start 2019-11-28T11:33:02.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f106375b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f105c1281b0 0x7f105c128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:02.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f106375b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105c139a60 con 0x7f105c128b80 2019-11-28T11:33:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f106375b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105c13b060 con 0x7f105c13a780 2019-11-28T11:33:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f106375b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105c12a260 con 0x7f105c1281b0 2019-11-28T11:33:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f10624f9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f105c128b80 0x7f105c167d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34974/0 (socket says 172.21.15.80:34974) 2019-11-28T11:33:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f10624f9700 1 -- 172.21.15.80:0/3595726598 learned_addr learned my addr 172.21.15.80:0/3595726598 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:02.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f10614f7700 1 --2- 172.21.15.80:0/3595726598 >> v2:172.21.15.174:3300/0 conn(0x7f105c1281b0 0x7f105c128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f105a7fc700 1 -- 172.21.15.80:0/3595726598 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170330594 0 0) 0x7f10540014d0 con 0x7f105c128b80 2019-11-28T11:33:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f105a7fc700 1 -- 172.21.15.80:0/3595726598 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1040002e80 con 0x7f105c128b80 2019-11-28T11:33:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f10614f7700 1 -- 172.21.15.80:0/3595726598 >> v1:172.21.15.174:6789/0 conn(0x7f105c13a780 legacy=0x7f105c12d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f10614f7700 1 -- 172.21.15.80:0/3595726598 >> v1:172.21.15.80:6789/0 conn(0x7f105c128b80 legacy=0x7f105c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f10614f7700 1 -- 172.21.15.80:0/3595726598 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c12abc0 con 0x7f105c1281b0 2019-11-28T11:33:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f10614f7700 1 --2- 172.21.15.80:0/3595726598 >> v2:172.21.15.174:3300/0 conn(0x7f105c1281b0 0x7f105c128640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1044054390 tx=0x7f1044054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f10614f7700 1 --2- 172.21.15.80:0/3595726598 >> v2:172.21.15.174:3300/0 conn(0x7f105c1281b0 0x7f105c128640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1044054390 tx=0x7f1044054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f10614f7700 1 --2- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c1281b0 0x7f105c128640 secure :-1 s=READY pgs=551 cs=0 l=1 rx=0x7f1044054390 tx=0x7f1044054730).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f10614f7700 1 --2- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c1281b0 0x7f105c128640 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f1044054390 tx=0x7f1044054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f105a7fc700 1 -- 172.21.15.80:0/3595726598 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1044009960 con 0x7f105c1281b0 2019-11-28T11:33:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f10614f7700 1 --2- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c1281b0 0x7f105c128640 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f1044054390 tx=0x7f1044054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f10614f7700 1 --2- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c1281b0 0x7f105c128640 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f1044054390 tx=0x7f1044054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f105a7fc700 1 -- 172.21.15.80:0/3595726598 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1044009580 con 0x7f105c1281b0 2019-11-28T11:33:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f106375b700 1 -- 172.21.15.80:0/3595726598 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105c12af40 con 0x7f105c1281b0 2019-11-28T11:33:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.813+0000 7f105a7fc700 1 -- 172.21.15.80:0/3595726598 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1044009f40 con 0x7f105c1281b0 2019-11-28T11:33:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.814+0000 7f106375b700 1 -- 172.21.15.80:0/3595726598 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105c12abc0 con 0x7f105c1281b0 2019-11-28T11:33:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.814+0000 7f10614f7700 1 --2- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c1281b0 0x7f105c128640 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f1044054390 tx=0x7f1044054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.814+0000 7f105a7fc700 1 -- 172.21.15.80:0/3595726598 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1044009770 con 0x7f105c1281b0 2019-11-28T11:33:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.814+0000 7f10614f7700 1 --2- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c1281b0 0x7f105c128640 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f1044054390 tx=0x7f1044054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.814+0000 7f105a7fc700 1 --2- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1040018770 0x7f104001ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.814+0000 7f105a7fc700 1 -- 172.21.15.80:0/3595726598 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1044075d50 con 0x7f105c1281b0 2019-11-28T11:33:02.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.814+0000 7f1061cf8700 1 --2- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1040018770 0x7f104001ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:02.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.815+0000 7f1061cf8700 1 --2- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1040018770 0x7f104001ac00 crc :-1 s=READY pgs=374 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.822+0000 7f106375b700 1 -- 172.21.15.80:0/3595726598 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105c12af40 con 0x7f105c1281b0 2019-11-28T11:33:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.826+0000 7f10614f7700 1 --2- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c1281b0 0x7f105c128640 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f1044054390 tx=0x7f1044054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.826+0000 7f105a7fc700 1 -- 172.21.15.80:0/3595726598 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1044000940 con 0x7f105c1281b0 2019-11-28T11:33:03.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.998+0000 7f106375b700 1 -- 172.21.15.80:0/3595726598 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f105c12abc0 con 0x7f105c1281b0 2019-11-28T11:33:03.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.998+0000 7f10614f7700 1 --2- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c1281b0 0x7f105c128640 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f1044054390 tx=0x7f1044054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:03.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:02.998+0000 7f105a7fc700 1 -- 172.21.15.80:0/3595726598 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+1424 (secure 0 0 0) 0x7f104405b9d0 con 0x7f105c1281b0 2019-11-28T11:33:03.043 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 43 2019-11-28T11:33:03.043 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:33:03.043 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":43,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:33:00.620986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:33:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:03.001+0000 7f106375b700 1 -- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1040018770 msgr2=0x7f104001ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:03.001+0000 7f106375b700 1 --2- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1040018770 0x7f104001ac00 crc :-1 s=READY pgs=374 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:03.001+0000 7f106375b700 1 -- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c1281b0 msgr2=0x7f105c128640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:03.001+0000 7f106375b700 1 --2- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c1281b0 0x7f105c128640 secure :-1 s=READY pgs=551 cs=0 l=1 rx=0x7f1044054390 tx=0x7f1044054730).stop 2019-11-28T11:33:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:03.001+0000 7f106375b700 1 -- 172.21.15.80:0/3595726598 shutdown_connections 2019-11-28T11:33:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:03.001+0000 7f106375b700 1 --2- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c1281b0 0x7f105c128640 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:03.001+0000 7f106375b700 1 --2- 172.21.15.80:0/3595726598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1040018770 0x7f104001ac00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:03.001+0000 7f106375b700 1 -- 172.21.15.80:0/3595726598 shutdown_connections 2019-11-28T11:33:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:03.001+0000 7f106375b700 1 -- 172.21.15.80:0/3595726598 wait complete. 2019-11-28T11:33:03.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:03.001+0000 7f106375b700 1 -- 172.21.15.80:0/3595726598 >> 172.21.15.80:0/3595726598 conn(0x7f105c127dc0 msgr2=0x7f105c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:03.358 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 12, u'failed': [], u'epoch': 43, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [13], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:32:59.044350+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:33:00.620986+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:33:03.358 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:33:04.359 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:33:04.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.436+0000 7fa457a29700 1 Processor -- start 2019-11-28T11:33:04.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.436+0000 7fa457a29700 1 -- start start 2019-11-28T11:33:04.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.437+0000 7fa457a29700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa45006c0a0 0x7fa450072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:04.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.437+0000 7fa457a29700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa4500734e0 0x7fa450071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:04.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.437+0000 7fa457a29700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa450072360 0x7fa4500727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:04.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.437+0000 7fa457a29700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45006f330 con 0x7fa450072360 2019-11-28T11:33:04.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.437+0000 7fa457a29700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4500706c0 con 0x7fa4500734e0 2019-11-28T11:33:04.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.437+0000 7fa457a29700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa450070a40 con 0x7fa45006c0a0 2019-11-28T11:33:04.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.437+0000 7fa4567c7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa450072360 0x7fa4500727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:04.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.437+0000 7fa4567c7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa450072360 0x7fa4500727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35664/0 (socket says 172.21.15.80:35664) 2019-11-28T11:33:04.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.437+0000 7fa4567c7700 1 -- 172.21.15.80:0/3547538447 learned_addr learned my addr 172.21.15.80:0/3547538447 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:04.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.437+0000 7fa4557c5700 1 --2- 172.21.15.80:0/3547538447 >> v2:172.21.15.174:3300/0 conn(0x7fa4500734e0 0x7fa450071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:04.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.437+0000 7fa455fc6700 1 --2- 172.21.15.80:0/3547538447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa45006c0a0 0x7fa450072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:04.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.438+0000 7fa4567c7700 1 -- 172.21.15.80:0/3547538447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa45006c0a0 msgr2=0x7fa450072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:04.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.438+0000 7fa4567c7700 1 --2- 172.21.15.80:0/3547538447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa45006c0a0 0x7fa450072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:04.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.438+0000 7fa4567c7700 1 -- 172.21.15.80:0/3547538447 >> v2:172.21.15.174:3300/0 conn(0x7fa4500734e0 msgr2=0x7fa450071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:04.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.438+0000 7fa4567c7700 1 --2- 172.21.15.80:0/3547538447 >> v2:172.21.15.174:3300/0 conn(0x7fa4500734e0 0x7fa450071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:04.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.438+0000 7fa4567c7700 1 -- 172.21.15.80:0/3547538447 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45006db00 con 0x7fa450072360 2019-11-28T11:33:04.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.438+0000 7fa4567c7700 1 --2- 172.21.15.80:0/3547538447 >> v2:172.21.15.80:3300/0 conn(0x7fa450072360 0x7fa4500727e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa44800fa30 tx=0x7fa4480080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:04.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.438+0000 7fa4567c7700 1 --2- 172.21.15.80:0/3547538447 >> v2:172.21.15.80:3300/0 conn(0x7fa450072360 0x7fa4500727e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa44800fa30 tx=0x7fa4480080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:04.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.438+0000 7fa4567c7700 1 --2- 172.21.15.80:0/3547538447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa450072360 0x7fa4500727e0 secure :-1 s=READY pgs=915 cs=0 l=1 rx=0x7fa44800fa30 tx=0x7fa4480080d0).ready entity=mon.0 client_cookie=31777b5cf0aaf5ec server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:04.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.438+0000 7fa4567c7700 1 --2- 172.21.15.80:0/3547538447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa450072360 0x7fa4500727e0 secure :-1 s=THROTTLE_DONE pgs=915 cs=0 l=1 rx=0x7fa44800fa30 tx=0x7fa4480080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:04.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.438+0000 7fa4567c7700 1 --2- 172.21.15.80:0/3547538447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa450072360 0x7fa4500727e0 secure :-1 s=THROTTLE_DONE pgs=915 cs=0 l=1 rx=0x7fa44800fa30 tx=0x7fa4480080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:04.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.438+0000 7fa454fc4700 1 -- 172.21.15.80:0/3547538447 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa448000df0 con 0x7fa450072360 2019-11-28T11:33:04.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.438+0000 7fa4567c7700 1 --2- 172.21.15.80:0/3547538447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa450072360 0x7fa4500727e0 secure :-1 s=THROTTLE_DONE pgs=915 cs=0 l=1 rx=0x7fa44800fa30 tx=0x7fa4480080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:04.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.438+0000 7fa454fc4700 1 -- 172.21.15.80:0/3547538447 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa448001460 con 0x7fa450072360 2019-11-28T11:33:04.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.438+0000 7fa454fc4700 1 -- 172.21.15.80:0/3547538447 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa448001bb0 con 0x7fa450072360 2019-11-28T11:33:04.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.438+0000 7fa457a29700 1 -- 172.21.15.80:0/3547538447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa450072360 msgr2=0x7fa4500727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:04.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.438+0000 7fa457a29700 1 --2- 172.21.15.80:0/3547538447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa450072360 0x7fa4500727e0 secure :-1 s=READY pgs=915 cs=0 l=1 rx=0x7fa44800fa30 tx=0x7fa4480080d0).stop 2019-11-28T11:33:04.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.439+0000 7fa457a29700 1 -- 172.21.15.80:0/3547538447 shutdown_connections 2019-11-28T11:33:04.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.439+0000 7fa457a29700 1 --2- 172.21.15.80:0/3547538447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa450072360 0x7fa4500727e0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:04.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.439+0000 7fa457a29700 1 --2- 172.21.15.80:0/3547538447 >> v2:172.21.15.174:3300/0 conn(0x7fa4500734e0 0x7fa450071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:04.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.439+0000 7fa457a29700 1 --2- 172.21.15.80:0/3547538447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa45006c0a0 0x7fa450072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:04.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.439+0000 7fa457a29700 1 -- 172.21.15.80:0/3547538447 shutdown_connections 2019-11-28T11:33:04.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.439+0000 7fa457a29700 1 -- 172.21.15.80:0/3547538447 wait complete. 2019-11-28T11:33:04.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.439+0000 7fa457a29700 1 -- 172.21.15.80:0/3547538447 >> 172.21.15.80:0/3547538447 conn(0x7fa450061cf0 msgr2=0x7fa450064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:04.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.441+0000 7fa457a29700 1 Processor -- start 2019-11-28T11:33:04.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.441+0000 7fa457a29700 1 -- start start 2019-11-28T11:33:04.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.442+0000 7fa457a29700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4501096f0 0x7fa450169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:04.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.442+0000 7fa457a29700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4501066e0 con 0x7fa45013e5f0 2019-11-28T11:33:04.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.442+0000 7fa457a29700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45010ce40 con 0x7fa45013e9e0 2019-11-28T11:33:04.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.442+0000 7fa457a29700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45010e060 con 0x7fa4501096f0 2019-11-28T11:33:04.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.442+0000 7fa455fc6700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa45013e5f0 0x7fa45010a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34984/0 (socket says 172.21.15.80:34984) 2019-11-28T11:33:04.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.442+0000 7fa455fc6700 1 -- 172.21.15.80:0/2624829577 learned_addr learned my addr 172.21.15.80:0/2624829577 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:04.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.442+0000 7fa4567c7700 1 --2- 172.21.15.80:0/2624829577 >> v2:172.21.15.80:3300/0 conn(0x7fa4501096f0 0x7fa450169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:04.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.442+0000 7fa4567c7700 1 -- 172.21.15.80:0/2624829577 >> v1:172.21.15.174:6789/0 conn(0x7fa45013e9e0 legacy=0x7fa450108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:04.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.442+0000 7fa4567c7700 1 -- 172.21.15.80:0/2624829577 >> v1:172.21.15.80:6789/0 conn(0x7fa45013e5f0 legacy=0x7fa45010a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:04.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.442+0000 7fa44e7fc700 1 -- 172.21.15.80:0/2624829577 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676613601 0 0) 0x7fa440000fb0 con 0x7fa45013e5f0 2019-11-28T11:33:04.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.442+0000 7fa4567c7700 1 -- 172.21.15.80:0/2624829577 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45010e9c0 con 0x7fa4501096f0 2019-11-28T11:33:04.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.443+0000 7fa4567c7700 1 --2- 172.21.15.80:0/2624829577 >> v2:172.21.15.80:3300/0 conn(0x7fa4501096f0 0x7fa450169ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa448054700 tx=0x7fa448054aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:04.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.443+0000 7fa4567c7700 1 --2- 172.21.15.80:0/2624829577 >> v2:172.21.15.80:3300/0 conn(0x7fa4501096f0 0x7fa450169ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa448054700 tx=0x7fa448054aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:04.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.443+0000 7fa4567c7700 1 --2- 172.21.15.80:0/2624829577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4501096f0 0x7fa450169ed0 secure :-1 s=READY pgs=917 cs=0 l=1 rx=0x7fa448054700 tx=0x7fa448054aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:04.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.443+0000 7fa4567c7700 1 --2- 172.21.15.80:0/2624829577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4501096f0 0x7fa450169ed0 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7fa448054700 tx=0x7fa448054aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:04.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.443+0000 7fa44e7fc700 1 -- 172.21.15.80:0/2624829577 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa448001820 con 0x7fa4501096f0 2019-11-28T11:33:04.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.443+0000 7fa4567c7700 1 --2- 172.21.15.80:0/2624829577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4501096f0 0x7fa450169ed0 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7fa448054700 tx=0x7fa448054aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:04.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.443+0000 7fa4567c7700 1 --2- 172.21.15.80:0/2624829577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4501096f0 0x7fa450169ed0 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7fa448054700 tx=0x7fa448054aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:04.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.443+0000 7fa44e7fc700 1 -- 172.21.15.80:0/2624829577 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa448001440 con 0x7fa4501096f0 2019-11-28T11:33:04.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.443+0000 7fa44e7fc700 1 -- 172.21.15.80:0/2624829577 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa448001e00 con 0x7fa4501096f0 2019-11-28T11:33:04.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.443+0000 7fa457a29700 1 -- 172.21.15.80:0/2624829577 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45010ed40 con 0x7fa4501096f0 2019-11-28T11:33:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.443+0000 7fa457a29700 1 -- 172.21.15.80:0/2624829577 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45010e9c0 con 0x7fa4501096f0 2019-11-28T11:33:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.443+0000 7fa4567c7700 1 --2- 172.21.15.80:0/2624829577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4501096f0 0x7fa450169ed0 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7fa448054700 tx=0x7fa448054aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.444+0000 7fa44e7fc700 1 -- 172.21.15.80:0/2624829577 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa448001630 con 0x7fa4501096f0 2019-11-28T11:33:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.444+0000 7fa4567c7700 1 --2- 172.21.15.80:0/2624829577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4501096f0 0x7fa450169ed0 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7fa448054700 tx=0x7fa448054aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.444+0000 7fa44e7fc700 1 --2- 172.21.15.80:0/2624829577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa430018730 0x7fa43001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.444+0000 7fa44e7fc700 1 -- 172.21.15.80:0/2624829577 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa448075e20 con 0x7fa4501096f0 2019-11-28T11:33:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.444+0000 7fa455fc6700 1 --2- 172.21.15.80:0/2624829577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa430018730 0x7fa43001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.444+0000 7fa455fc6700 1 --2- 172.21.15.80:0/2624829577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa430018730 0x7fa43001abc0 crc :-1 s=READY pgs=375 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.451+0000 7fa457a29700 1 -- 172.21.15.80:0/2624829577 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45010ed40 con 0x7fa4501096f0 2019-11-28T11:33:04.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.455+0000 7fa4567c7700 1 --2- 172.21.15.80:0/2624829577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4501096f0 0x7fa450169ed0 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7fa448054700 tx=0x7fa448054aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:04.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.455+0000 7fa44e7fc700 1 -- 172.21.15.80:0/2624829577 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa448001230 con 0x7fa4501096f0 2019-11-28T11:33:04.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.630+0000 7fa457a29700 1 -- 172.21.15.80:0/2624829577 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa45010e9c0 con 0x7fa4501096f0 2019-11-28T11:33:04.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.630+0000 7fa4567c7700 1 --2- 172.21.15.80:0/2624829577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4501096f0 0x7fa450169ed0 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7fa448054700 tx=0x7fa448054aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:04.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.630+0000 7fa44e7fc700 1 -- 172.21.15.80:0/2624829577 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+1424 (secure 0 0 0) 0x7fa448001630 con 0x7fa4501096f0 2019-11-28T11:33:04.675 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 43 2019-11-28T11:33:04.675 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:33:04.676 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":43,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:33:00.620986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:33:04.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.633+0000 7fa457a29700 1 -- 172.21.15.80:0/2624829577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa430018730 msgr2=0x7fa43001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:04.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.633+0000 7fa457a29700 1 --2- 172.21.15.80:0/2624829577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa430018730 0x7fa43001abc0 crc :-1 s=READY pgs=375 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:04.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.633+0000 7fa457a29700 1 -- 172.21.15.80:0/2624829577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4501096f0 msgr2=0x7fa450169ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:04.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.633+0000 7fa457a29700 1 --2- 172.21.15.80:0/2624829577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4501096f0 0x7fa450169ed0 secure :-1 s=READY pgs=917 cs=0 l=1 rx=0x7fa448054700 tx=0x7fa448054aa0).stop 2019-11-28T11:33:04.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.633+0000 7fa457a29700 1 -- 172.21.15.80:0/2624829577 shutdown_connections 2019-11-28T11:33:04.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.633+0000 7fa457a29700 1 --2- 172.21.15.80:0/2624829577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4501096f0 0x7fa450169ed0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:04.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.633+0000 7fa457a29700 1 --2- 172.21.15.80:0/2624829577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa430018730 0x7fa43001abc0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:04.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.633+0000 7fa457a29700 1 -- 172.21.15.80:0/2624829577 shutdown_connections 2019-11-28T11:33:04.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.633+0000 7fa457a29700 1 -- 172.21.15.80:0/2624829577 wait complete. 2019-11-28T11:33:04.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:04.633+0000 7fa457a29700 1 -- 172.21.15.80:0/2624829577 >> 172.21.15.80:0/2624829577 conn(0x7fa45013d620 msgr2=0x7fa45013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:04.990 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 12, u'failed': [], u'epoch': 43, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [13], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:32:59.044350+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:33:00.620986+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:33:04.990 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:33:05.662 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:33:05.666 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:33:05.671 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:33:05.675 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:33:05.679 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:33:05.684 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:33:05.991 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:33:06.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.067+0000 7fc08f7d1700 1 Processor -- start 2019-11-28T11:33:06.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.067+0000 7fc08f7d1700 1 -- start start 2019-11-28T11:33:06.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.068+0000 7fc08f7d1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc08806c490 0x7fc08806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:06.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.068+0000 7fc08f7d1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc08806ce60 0x7fc088164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:06.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.068+0000 7fc08f7d1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08806db00 con 0x7fc08806c0a0 2019-11-28T11:33:06.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.068+0000 7fc08f7d1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08806fd60 con 0x7fc08806ce60 2019-11-28T11:33:06.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.068+0000 7fc08f7d1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc088070030 con 0x7fc08806c490 2019-11-28T11:33:06.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.068+0000 7fc08e56f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc08806ce60 0x7fc088164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:06.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.068+0000 7fc08e56f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc08806ce60 0x7fc088164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35682/0 (socket says 172.21.15.80:35682) 2019-11-28T11:33:06.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.068+0000 7fc08e56f700 1 -- 172.21.15.80:0/807739191 learned_addr learned my addr 172.21.15.80:0/807739191 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:06.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.068+0000 7fc08d56d700 1 --2- 172.21.15.80:0/807739191 >> v2:172.21.15.174:3300/0 conn(0x7fc08806c490 0x7fc08806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:06.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.069+0000 7fc08e56f700 1 -- 172.21.15.80:0/807739191 >> v2:172.21.15.174:3300/0 conn(0x7fc08806c490 msgr2=0x7fc08806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:06.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.069+0000 7fc08e56f700 1 --2- 172.21.15.80:0/807739191 >> v2:172.21.15.174:3300/0 conn(0x7fc08806c490 0x7fc08806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:06.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.069+0000 7fc08e56f700 1 -- 172.21.15.80:0/807739191 >> v1:172.21.15.174:6789/0 conn(0x7fc08806c0a0 legacy=0x7fc088072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:06.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.069+0000 7fc08e56f700 1 -- 172.21.15.80:0/807739191 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0880706c0 con 0x7fc08806ce60 2019-11-28T11:33:06.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.069+0000 7fc08e56f700 1 --2- 172.21.15.80:0/807739191 >> v2:172.21.15.80:3300/0 conn(0x7fc08806ce60 0x7fc088164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc08000f6b0 tx=0x7fc08000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:06.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.069+0000 7fc08e56f700 1 --2- 172.21.15.80:0/807739191 >> v2:172.21.15.80:3300/0 conn(0x7fc08806ce60 0x7fc088164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc08000f6b0 tx=0x7fc08000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:06.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.069+0000 7fc08e56f700 1 --2- 172.21.15.80:0/807739191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08806ce60 0x7fc088164d70 secure :-1 s=READY pgs=918 cs=0 l=1 rx=0x7fc08000f6b0 tx=0x7fc08000fa50).ready entity=mon.0 client_cookie=40359ce27ec847c9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:06.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.069+0000 7fc08e56f700 1 --2- 172.21.15.80:0/807739191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08806ce60 0x7fc088164d70 secure :-1 s=THROTTLE_DONE pgs=918 cs=0 l=1 rx=0x7fc08000f6b0 tx=0x7fc08000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:06.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.069+0000 7fc08e56f700 1 --2- 172.21.15.80:0/807739191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08806ce60 0x7fc088164d70 secure :-1 s=THROTTLE_DONE pgs=918 cs=0 l=1 rx=0x7fc08000f6b0 tx=0x7fc08000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:06.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.069+0000 7fc08cd6c700 1 -- 172.21.15.80:0/807739191 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc080000a70 con 0x7fc08806ce60 2019-11-28T11:33:06.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.069+0000 7fc08e56f700 1 --2- 172.21.15.80:0/807739191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08806ce60 0x7fc088164d70 secure :-1 s=THROTTLE_DONE pgs=918 cs=0 l=1 rx=0x7fc08000f6b0 tx=0x7fc08000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:06.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.069+0000 7fc08cd6c700 1 -- 172.21.15.80:0/807739191 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0800010e0 con 0x7fc08806ce60 2019-11-28T11:33:06.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.069+0000 7fc08cd6c700 1 -- 172.21.15.80:0/807739191 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0800017b0 con 0x7fc08806ce60 2019-11-28T11:33:06.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.069+0000 7fc08f7d1700 1 -- 172.21.15.80:0/807739191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08806ce60 msgr2=0x7fc088164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:06.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.069+0000 7fc08f7d1700 1 --2- 172.21.15.80:0/807739191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08806ce60 0x7fc088164d70 secure :-1 s=READY pgs=918 cs=0 l=1 rx=0x7fc08000f6b0 tx=0x7fc08000fa50).stop 2019-11-28T11:33:06.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.070+0000 7fc08f7d1700 1 -- 172.21.15.80:0/807739191 shutdown_connections 2019-11-28T11:33:06.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.070+0000 7fc08f7d1700 1 --2- 172.21.15.80:0/807739191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08806ce60 0x7fc088164d70 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:06.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.070+0000 7fc08f7d1700 1 --2- 172.21.15.80:0/807739191 >> v2:172.21.15.174:3300/0 conn(0x7fc08806c490 0x7fc08806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:06.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.070+0000 7fc08f7d1700 1 -- 172.21.15.80:0/807739191 shutdown_connections 2019-11-28T11:33:06.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.070+0000 7fc08f7d1700 1 -- 172.21.15.80:0/807739191 wait complete. 2019-11-28T11:33:06.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.070+0000 7fc08f7d1700 1 -- 172.21.15.80:0/807739191 >> 172.21.15.80:0/807739191 conn(0x7fc088061cf0 msgr2=0x7fc088064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:06.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.072+0000 7fc08f7d1700 1 Processor -- start 2019-11-28T11:33:06.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.072+0000 7fc08f7d1700 1 -- start start 2019-11-28T11:33:06.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.073+0000 7fc08f7d1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc08813dc00 0x7fc088109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:06.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.073+0000 7fc08f7d1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc08810a3a0 0x7fc088108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:06.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.073+0000 7fc08f7d1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0881312c0 con 0x7fc088109220 2019-11-28T11:33:06.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.073+0000 7fc08f7d1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc088105830 con 0x7fc08813dc00 2019-11-28T11:33:06.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.073+0000 7fc08f7d1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc088105b00 con 0x7fc08810a3a0 2019-11-28T11:33:06.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.073+0000 7fc08dd6e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc08813dc00 0x7fc088109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:06.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.073+0000 7fc08e56f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc088109220 0x7fc088103000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35006/0 (socket says 172.21.15.80:35006) 2019-11-28T11:33:06.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.073+0000 7fc08e56f700 1 -- 172.21.15.80:0/2333532987 learned_addr learned my addr 172.21.15.80:0/2333532987 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:06.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.073+0000 7fc08d56d700 1 --2- 172.21.15.80:0/2333532987 >> v2:172.21.15.174:3300/0 conn(0x7fc08810a3a0 0x7fc088108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:06.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.073+0000 7fc08dd6e700 1 -- 172.21.15.80:0/2333532987 >> v2:172.21.15.174:3300/0 conn(0x7fc08810a3a0 msgr2=0x7fc088108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:06.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.073+0000 7fc08dd6e700 1 --2- 172.21.15.80:0/2333532987 >> v2:172.21.15.174:3300/0 conn(0x7fc08810a3a0 0x7fc088108ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:06.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.073+0000 7fc08dd6e700 1 -- 172.21.15.80:0/2333532987 >> v1:172.21.15.80:6789/0 conn(0x7fc088109220 legacy=0x7fc088103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:06.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.073+0000 7fc08dd6e700 1 -- 172.21.15.80:0/2333532987 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc088106190 con 0x7fc08813dc00 2019-11-28T11:33:06.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.073+0000 7fc0867fc700 1 -- 172.21.15.80:0/2333532987 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126908074 0 0) 0x7fc080000940 con 0x7fc088109220 2019-11-28T11:33:06.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.074+0000 7fc08dd6e700 1 --2- 172.21.15.80:0/2333532987 >> v2:172.21.15.80:3300/0 conn(0x7fc08813dc00 0x7fc088109e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc0700106a0 tx=0x7fc070010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:06.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.074+0000 7fc08dd6e700 1 --2- 172.21.15.80:0/2333532987 >> v2:172.21.15.80:3300/0 conn(0x7fc08813dc00 0x7fc088109e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc0700106a0 tx=0x7fc070010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:06.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.074+0000 7fc08dd6e700 1 --2- 172.21.15.80:0/2333532987 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08813dc00 0x7fc088109e60 secure :-1 s=READY pgs=920 cs=0 l=1 rx=0x7fc0700106a0 tx=0x7fc070010a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:06.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.074+0000 7fc08dd6e700 1 --2- 172.21.15.80:0/2333532987 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08813dc00 0x7fc088109e60 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7fc0700106a0 tx=0x7fc070010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:06.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.074+0000 7fc0867fc700 1 -- 172.21.15.80:0/2333532987 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc070009b10 con 0x7fc08813dc00 2019-11-28T11:33:06.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.074+0000 7fc08dd6e700 1 --2- 172.21.15.80:0/2333532987 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08813dc00 0x7fc088109e60 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7fc0700106a0 tx=0x7fc070010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:06.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.074+0000 7fc08dd6e700 1 --2- 172.21.15.80:0/2333532987 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08813dc00 0x7fc088109e60 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7fc0700106a0 tx=0x7fc070010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:06.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.074+0000 7fc0867fc700 1 -- 172.21.15.80:0/2333532987 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07000aa30 con 0x7fc08813dc00 2019-11-28T11:33:06.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.074+0000 7fc0867fc700 1 -- 172.21.15.80:0/2333532987 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc07000a190 con 0x7fc08813dc00 2019-11-28T11:33:06.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.074+0000 7fc08f7d1700 1 -- 172.21.15.80:0/2333532987 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc088106510 con 0x7fc08813dc00 2019-11-28T11:33:06.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.074+0000 7fc08f7d1700 1 -- 172.21.15.80:0/2333532987 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc088106190 con 0x7fc08813dc00 2019-11-28T11:33:06.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.074+0000 7fc08dd6e700 1 --2- 172.21.15.80:0/2333532987 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08813dc00 0x7fc088109e60 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7fc0700106a0 tx=0x7fc070010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:06.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.074+0000 7fc0867fc700 1 -- 172.21.15.80:0/2333532987 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc070009b10 con 0x7fc08813dc00 2019-11-28T11:33:06.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.074+0000 7fc08dd6e700 1 --2- 172.21.15.80:0/2333532987 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08813dc00 0x7fc088109e60 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7fc0700106a0 tx=0x7fc070010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:06.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.074+0000 7fc0867fc700 1 --2- 172.21.15.80:0/2333532987 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc06c018730 0x7fc06c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:06.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.074+0000 7fc0867fc700 1 -- 172.21.15.80:0/2333532987 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc070031d90 con 0x7fc08813dc00 2019-11-28T11:33:06.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.075+0000 7fc08d56d700 1 --2- 172.21.15.80:0/2333532987 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc06c018730 0x7fc06c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:06.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.075+0000 7fc08d56d700 1 --2- 172.21.15.80:0/2333532987 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc06c018730 0x7fc06c01abc0 crc :-1 s=READY pgs=379 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:06.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.083+0000 7fc08f7d1700 1 -- 172.21.15.80:0/2333532987 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc088106510 con 0x7fc08813dc00 2019-11-28T11:33:06.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.086+0000 7fc08dd6e700 1 --2- 172.21.15.80:0/2333532987 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08813dc00 0x7fc088109e60 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7fc0700106a0 tx=0x7fc070010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:06.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.086+0000 7fc0867fc700 1 -- 172.21.15.80:0/2333532987 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc070009900 con 0x7fc08813dc00 2019-11-28T11:33:06.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.259+0000 7fc08f7d1700 1 -- 172.21.15.80:0/2333532987 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc088106190 con 0x7fc08813dc00 2019-11-28T11:33:06.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.259+0000 7fc08dd6e700 1 --2- 172.21.15.80:0/2333532987 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08813dc00 0x7fc088109e60 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7fc0700106a0 tx=0x7fc070010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:06.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.259+0000 7fc0867fc700 1 -- 172.21.15.80:0/2333532987 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+2450 (secure 0 0 0) 0x7fc070009b10 con 0x7fc08813dc00 2019-11-28T11:33:06.314 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 45 2019-11-28T11:33:06.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.262+0000 7fc08f7d1700 1 -- 172.21.15.80:0/2333532987 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc06c018730 msgr2=0x7fc06c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:06.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.262+0000 7fc08f7d1700 1 --2- 172.21.15.80:0/2333532987 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc06c018730 0x7fc06c01abc0 crc :-1 s=READY pgs=379 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:06.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.262+0000 7fc08f7d1700 1 -- 172.21.15.80:0/2333532987 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08813dc00 msgr2=0x7fc088109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:06.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.262+0000 7fc08f7d1700 1 --2- 172.21.15.80:0/2333532987 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08813dc00 0x7fc088109e60 secure :-1 s=READY pgs=920 cs=0 l=1 rx=0x7fc0700106a0 tx=0x7fc070010a40).stop 2019-11-28T11:33:06.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.262+0000 7fc08f7d1700 1 -- 172.21.15.80:0/2333532987 shutdown_connections 2019-11-28T11:33:06.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.262+0000 7fc08f7d1700 1 --2- 172.21.15.80:0/2333532987 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc06c018730 0x7fc06c01abc0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:06.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.262+0000 7fc08f7d1700 1 --2- 172.21.15.80:0/2333532987 >> v2:172.21.15.174:3300/0 conn(0x7fc08810a3a0 0x7fc088108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:06.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.262+0000 7fc08f7d1700 1 --2- 172.21.15.80:0/2333532987 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc08813dc00 0x7fc088109e60 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:06.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.262+0000 7fc08f7d1700 1 -- 172.21.15.80:0/2333532987 shutdown_connections 2019-11-28T11:33:06.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.262+0000 7fc08f7d1700 1 -- 172.21.15.80:0/2333532987 wait complete. 2019-11-28T11:33:06.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:06.262+0000 7fc08f7d1700 1 -- 172.21.15.80:0/2333532987 >> 172.21.15.80:0/2333532987 conn(0x7fc08811bfc0 msgr2=0x7fc088141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:06.316 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:33:06.316 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/3314051014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3314051014},{"type":"v1","addr":"172.21.15.80:6833","nonce":3314051014}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":44},{"gid":6693,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/2096906665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2096906665},{"type":"v1","addr":"172.21.15.80:6835","nonce":2096906665}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:33:05.641620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5390":{"gid":5390,"name":"c","rank":0,"incarnation":45,"state":"up:creating","state_seq":2,"addr":"172.21.15.174:6835/3402343468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3402343468},{"type":"v1","addr":"172.21.15.174:6835","nonce":3402343468}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:33:06.626 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5390}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 12, u'failed': [], u'epoch': 45, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [13], u'info': {u'gid_5390': {u'export_targets': [], u'name': u'c', u'incarnation': 45, u'state_seq': 2, u'state': u'up:creating', u'gid': 5390, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3402343468, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 3402343468, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/3402343468'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:32:59.044350+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:33:05.641620+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:33:06.627 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5390:up:creating 2019-11-28T11:33:07.627 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:33:07.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.704+0000 7fa9e6588700 1 Processor -- start 2019-11-28T11:33:07.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.704+0000 7fa9e6588700 1 -- start start 2019-11-28T11:33:07.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.705+0000 7fa9e6588700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9e006c0a0 0x7fa9e0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:07.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.705+0000 7fa9e6588700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e0072620 0x7fa9e0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:07.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.705+0000 7fa9e6588700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e006db00 con 0x7fa9e00734e0 2019-11-28T11:33:07.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.705+0000 7fa9e6588700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e006fd60 con 0x7fa9e006c0a0 2019-11-28T11:33:07.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.705+0000 7fa9e6588700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e0070030 con 0x7fa9e0072620 2019-11-28T11:33:07.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9dffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa9e00734e0 0x7fa9e0071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35010/0 (socket says 172.21.15.80:35010) 2019-11-28T11:33:07.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9dffff700 1 -- 172.21.15.80:0/1112324083 learned_addr learned my addr 172.21.15.80:0/1112324083 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:07.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/1112324083 >> v2:172.21.15.174:3300/0 conn(0x7fa9e006c0a0 0x7fa9e0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:07.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9e5326700 1 --2- 172.21.15.80:0/1112324083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e0072620 0x7fa9e0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:07.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9df7fe700 1 -- 172.21.15.80:0/1112324083 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547520357 0 0) 0x7fa9d0001150 con 0x7fa9e00734e0 2019-11-28T11:33:07.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9df7fe700 1 -- 172.21.15.80:0/1112324083 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9cc002e80 con 0x7fa9e00734e0 2019-11-28T11:33:07.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9df7fe700 1 -- 172.21.15.80:0/1112324083 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3726108287 0 0) 0x7fa9d0001130 con 0x7fa9e00734e0 2019-11-28T11:33:07.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9e4b25700 1 -- 172.21.15.80:0/1112324083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e0072620 msgr2=0x7fa9e0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:07.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/1112324083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e0072620 0x7fa9e0164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:07.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9e4b25700 1 -- 172.21.15.80:0/1112324083 >> v1:172.21.15.80:6789/0 conn(0x7fa9e00734e0 legacy=0x7fa9e0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:07.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9e4b25700 1 -- 172.21.15.80:0/1112324083 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e00706c0 con 0x7fa9e006c0a0 2019-11-28T11:33:07.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9e5326700 1 --2- 172.21.15.80:0/1112324083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e0072620 0x7fa9e0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:33:07.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/1112324083 >> v2:172.21.15.174:3300/0 conn(0x7fa9e006c0a0 0x7fa9e0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa9c800af50 tx=0x7fa9c800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:07.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/1112324083 >> v2:172.21.15.174:3300/0 conn(0x7fa9e006c0a0 0x7fa9e0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa9c800af50 tx=0x7fa9c800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:07.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/1112324083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e006c0a0 0x7fa9e0072fa0 secure :-1 s=READY pgs=554 cs=0 l=1 rx=0x7fa9c800af50 tx=0x7fa9c800b760).ready entity=mon.1 client_cookie=a65b05ab2a38dc42 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:07.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/1112324083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e006c0a0 0x7fa9e0072fa0 secure :-1 s=THROTTLE_DONE pgs=554 cs=0 l=1 rx=0x7fa9c800af50 tx=0x7fa9c800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:07.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9df7fe700 1 -- 172.21.15.80:0/1112324083 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c8007210 con 0x7fa9e006c0a0 2019-11-28T11:33:07.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.706+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/1112324083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e006c0a0 0x7fa9e0072fa0 secure :-1 s=THROTTLE_DONE pgs=554 cs=0 l=1 rx=0x7fa9c800af50 tx=0x7fa9c800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:07.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.707+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/1112324083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e006c0a0 0x7fa9e0072fa0 secure :-1 s=THROTTLE_DONE pgs=554 cs=0 l=1 rx=0x7fa9c800af50 tx=0x7fa9c800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:07.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.707+0000 7fa9df7fe700 1 -- 172.21.15.80:0/1112324083 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c80099b0 con 0x7fa9e006c0a0 2019-11-28T11:33:07.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.707+0000 7fa9df7fe700 1 -- 172.21.15.80:0/1112324083 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c800a080 con 0x7fa9e006c0a0 2019-11-28T11:33:07.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.707+0000 7fa9e6588700 1 -- 172.21.15.80:0/1112324083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e006c0a0 msgr2=0x7fa9e0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:07.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.707+0000 7fa9e6588700 1 --2- 172.21.15.80:0/1112324083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e006c0a0 0x7fa9e0072fa0 secure :-1 s=READY pgs=554 cs=0 l=1 rx=0x7fa9c800af50 tx=0x7fa9c800b760).stop 2019-11-28T11:33:07.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.707+0000 7fa9e6588700 1 -- 172.21.15.80:0/1112324083 shutdown_connections 2019-11-28T11:33:07.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.707+0000 7fa9e6588700 1 --2- 172.21.15.80:0/1112324083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e0072620 0x7fa9e0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:07.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.707+0000 7fa9e6588700 1 --2- 172.21.15.80:0/1112324083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e006c0a0 0x7fa9e0072fa0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:07.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.707+0000 7fa9e6588700 1 -- 172.21.15.80:0/1112324083 shutdown_connections 2019-11-28T11:33:07.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.707+0000 7fa9e6588700 1 -- 172.21.15.80:0/1112324083 wait complete. 2019-11-28T11:33:07.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.707+0000 7fa9e6588700 1 -- 172.21.15.80:0/1112324083 >> 172.21.15.80:0/1112324083 conn(0x7fa9e0061cf0 msgr2=0x7fa9e0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:07.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.710+0000 7fa9e6588700 1 Processor -- start 2019-11-28T11:33:07.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.710+0000 7fa9e6588700 1 -- start start 2019-11-28T11:33:07.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e6588700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9e0104820 0x7fa9e010c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:07.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e6588700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e010b9d0 0x7fa9e0167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:07.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e6588700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e013bcd0 con 0x7fa9e010c890 2019-11-28T11:33:07.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e6588700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e0109130 con 0x7fa9e0104820 2019-11-28T11:33:07.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e6588700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e0109400 con 0x7fa9e010b9d0 2019-11-28T11:33:07.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e5326700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e010b9d0 0x7fa9e0167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:07.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e4b25700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9e0104820 0x7fa9e010c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:07.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9dffff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa9e010c890 0x7fa9e010b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:50562/0 (socket says 172.21.15.80:50562) 2019-11-28T11:33:07.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e5326700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e010b9d0 0x7fa9e0167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:37964/0 (socket says 172.21.15.80:37964) 2019-11-28T11:33:07.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e4b25700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9e0104820 0x7fa9e010c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:50586/0 (socket says 172.21.15.80:50586) 2019-11-28T11:33:07.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9dffff700 1 -- 172.21.15.80:0/783626584 learned_addr learned my addr 172.21.15.80:0/783626584 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:07.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e4b25700 1 -- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e010b9d0 msgr2=0x7fa9e0167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:07.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e010b9d0 0x7fa9e0167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:07.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9dd7fa700 1 -- 172.21.15.80:0/783626584 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662803304 0 0) 0x7fa9d0000f40 con 0x7fa9e010c890 2019-11-28T11:33:07.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e4b25700 1 -- 172.21.15.80:0/783626584 >> v1:172.21.15.174:6789/0 conn(0x7fa9e010c890 legacy=0x7fa9e010b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:07.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e4b25700 1 -- 172.21.15.80:0/783626584 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e0109a90 con 0x7fa9e0104820 2019-11-28T11:33:07.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/783626584 >> v2:172.21.15.174:3300/0 conn(0x7fa9e0104820 0x7fa9e010c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa9c80103b0 tx=0x7fa9c80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:07.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/783626584 >> v2:172.21.15.174:3300/0 conn(0x7fa9e0104820 0x7fa9e010c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa9c80103b0 tx=0x7fa9c80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:07.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e0104820 0x7fa9e010c350 secure :-1 s=READY pgs=556 cs=0 l=1 rx=0x7fa9c80103b0 tx=0x7fa9c80101b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:07.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e0104820 0x7fa9e010c350 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7fa9c80103b0 tx=0x7fa9c80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:07.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9dd7fa700 1 -- 172.21.15.80:0/783626584 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c8000940 con 0x7fa9e0104820 2019-11-28T11:33:07.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e0104820 0x7fa9e010c350 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7fa9c80103b0 tx=0x7fa9c80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:07.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9dd7fa700 1 -- 172.21.15.80:0/783626584 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c8009770 con 0x7fa9e0104820 2019-11-28T11:33:07.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e0104820 0x7fa9e010c350 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7fa9c80103b0 tx=0x7fa9c80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:07.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9e6588700 1 -- 172.21.15.80:0/783626584 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e0109e10 con 0x7fa9e0104820 2019-11-28T11:33:07.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.711+0000 7fa9dd7fa700 1 -- 172.21.15.80:0/783626584 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c8000940 con 0x7fa9e0104820 2019-11-28T11:33:07.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.712+0000 7fa9e6588700 1 -- 172.21.15.80:0/783626584 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e0109a90 con 0x7fa9e0104820 2019-11-28T11:33:07.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.712+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e0104820 0x7fa9e010c350 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7fa9c80103b0 tx=0x7fa9c80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:07.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.712+0000 7fa9dd7fa700 1 -- 172.21.15.80:0/783626584 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa9c8009960 con 0x7fa9e0104820 2019-11-28T11:33:07.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.712+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e0104820 0x7fa9e010c350 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7fa9c80103b0 tx=0x7fa9c80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:07.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.712+0000 7fa9dd7fa700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa9c4018730 0x7fa9c401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:07.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.712+0000 7fa9dd7fa700 1 -- 172.21.15.80:0/783626584 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa9c8031a40 con 0x7fa9e0104820 2019-11-28T11:33:07.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.712+0000 7fa9dffff700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa9c4018730 0x7fa9c401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:07.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.713+0000 7fa9dffff700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa9c4018730 0x7fa9c401abc0 crc :-1 s=READY pgs=380 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:07.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.720+0000 7fa9e6588700 1 -- 172.21.15.80:0/783626584 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e0109e10 con 0x7fa9e0104820 2019-11-28T11:33:07.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.723+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e0104820 0x7fa9e010c350 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7fa9c80103b0 tx=0x7fa9c80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:07.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.723+0000 7fa9dd7fa700 1 -- 172.21.15.80:0/783626584 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa9c8000940 con 0x7fa9e0104820 2019-11-28T11:33:07.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.895+0000 7fa9e6588700 1 -- 172.21.15.80:0/783626584 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9e0109a90 con 0x7fa9e0104820 2019-11-28T11:33:07.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.897+0000 7fa9e4b25700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e0104820 0x7fa9e010c350 secure :-1 s=THROTTLE_DONE pgs=556 cs=0 l=1 rx=0x7fa9c80103b0 tx=0x7fa9c80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:07.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.897+0000 7fa9dd7fa700 1 -- 172.21.15.80:0/783626584 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+2448 (secure 0 0 0) 0x7fa9c8009960 con 0x7fa9e0104820 2019-11-28T11:33:07.941 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 46 2019-11-28T11:33:07.941 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:33:07.942 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/3314051014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3314051014},{"type":"v1","addr":"172.21.15.80:6833","nonce":3314051014}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":44},{"gid":6693,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/2096906665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2096906665},{"type":"v1","addr":"172.21.15.80:6835","nonce":2096906665}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:33:06.645749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5390":{"gid":5390,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/3402343468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3402343468},{"type":"v1","addr":"172.21.15.174:6835","nonce":3402343468}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:33:07.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.898+0000 7fa9e6588700 1 -- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa9c4018730 msgr2=0x7fa9c401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:07.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.898+0000 7fa9e6588700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa9c4018730 0x7fa9c401abc0 crc :-1 s=READY pgs=380 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:07.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.898+0000 7fa9e6588700 1 -- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e0104820 msgr2=0x7fa9e010c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:07.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.898+0000 7fa9e6588700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e0104820 0x7fa9e010c350 secure :-1 s=READY pgs=556 cs=0 l=1 rx=0x7fa9c80103b0 tx=0x7fa9c80101b0).stop 2019-11-28T11:33:07.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.898+0000 7fa9e6588700 1 -- 172.21.15.80:0/783626584 shutdown_connections 2019-11-28T11:33:07.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.898+0000 7fa9e6588700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e010b9d0 0x7fa9e0167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:07.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.898+0000 7fa9e6588700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa9c4018730 0x7fa9c401abc0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:07.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.898+0000 7fa9e6588700 1 --2- 172.21.15.80:0/783626584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e0104820 0x7fa9e010c350 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:07.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.898+0000 7fa9e6588700 1 -- 172.21.15.80:0/783626584 shutdown_connections 2019-11-28T11:33:07.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.898+0000 7fa9e6588700 1 -- 172.21.15.80:0/783626584 wait complete. 2019-11-28T11:33:07.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:07.898+0000 7fa9e6588700 1 -- 172.21.15.80:0/783626584 >> 172.21.15.80:0/783626584 conn(0x7fa9e013d620 msgr2=0x7fa9e013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:08.256 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5390}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 12, u'failed': [], u'epoch': 46, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [13], u'info': {u'gid_5390': {u'export_targets': [], u'name': u'c', u'incarnation': 45, u'state_seq': 3, u'state': u'up:active', u'gid': 5390, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3402343468, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 3402343468, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/3402343468'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:32:59.044350+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:33:06.645749+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:33:08.256 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:33:08.257 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:33:08.395 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:33:08.395 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:33:08.396 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:33:08.396 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5390, 2019-11-28T11:33:08.396 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:33:08.396 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:33:08.396 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 2.705932319, 2019-11-28T11:33:08.397 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 46, 2019-11-28T11:33:08.397 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 78, 2019-11-28T11:33:08.398 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 78, 2019-11-28T11:33:08.398 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 6.9432801499999997 2019-11-28T11:33:08.398 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:33:08.401 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5390, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.705932319, "mdsmap_epoch": 46, "osdmap_epoch": 78, "osdmap_epoch_barrier": 78, "uptime": 6.9432801499999997 } 2019-11-28T11:33:08.402 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:33:08.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.480+0000 7fed43aba700 1 Processor -- start 2019-11-28T11:33:08.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.480+0000 7fed43aba700 1 -- start start 2019-11-28T11:33:08.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.481+0000 7fed43aba700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed3c06c0a0 0x7fed3c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:08.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.481+0000 7fed43aba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed3c0734e0 0x7fed3c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:08.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.481+0000 7fed43aba700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3c06db00 con 0x7fed3c072360 2019-11-28T11:33:08.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.481+0000 7fed43aba700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed3c06f330 con 0x7fed3c0734e0 2019-11-28T11:33:08.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.481+0000 7fed43aba700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c0706c0 con 0x7fed3c06c0a0 2019-11-28T11:33:08.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.481+0000 7fed41856700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed3c0734e0 0x7fed3c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:08.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.481+0000 7fed41856700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed3c0734e0 0x7fed3c071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35712/0 (socket says 172.21.15.80:35712) 2019-11-28T11:33:08.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.481+0000 7fed41856700 1 -- 172.21.15.80:0/1301579098 learned_addr learned my addr 172.21.15.80:0/1301579098 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:08.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.481+0000 7fed42057700 1 --2- 172.21.15.80:0/1301579098 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed3c06c0a0 0x7fed3c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:08.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.481+0000 7fed41856700 1 -- 172.21.15.80:0/1301579098 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed3c06c0a0 msgr2=0x7fed3c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:08.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.481+0000 7fed41856700 1 --2- 172.21.15.80:0/1301579098 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed3c06c0a0 0x7fed3c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:08.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.481+0000 7fed41856700 1 -- 172.21.15.80:0/1301579098 >> v1:172.21.15.174:6789/0 conn(0x7fed3c072360 legacy=0x7fed3c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:08.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.481+0000 7fed41856700 1 -- 172.21.15.80:0/1301579098 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c070a40 con 0x7fed3c0734e0 2019-11-28T11:33:08.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.481+0000 7fed42057700 1 --2- 172.21.15.80:0/1301579098 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed3c06c0a0 0x7fed3c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:33:08.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.482+0000 7fed41856700 1 --2- 172.21.15.80:0/1301579098 >> v2:172.21.15.80:3300/0 conn(0x7fed3c0734e0 0x7fed3c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fed2c00f740 tx=0x7fed2c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.482+0000 7fed41856700 1 --2- 172.21.15.80:0/1301579098 >> v2:172.21.15.80:3300/0 conn(0x7fed3c0734e0 0x7fed3c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fed2c00f740 tx=0x7fed2c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.482+0000 7fed41856700 1 --2- 172.21.15.80:0/1301579098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c0734e0 0x7fed3c071e20 secure :-1 s=READY pgs=922 cs=0 l=1 rx=0x7fed2c00f740 tx=0x7fed2c00fae0).ready entity=mon.0 client_cookie=4430e4073ad2cb91 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:08.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.482+0000 7fed41856700 1 --2- 172.21.15.80:0/1301579098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c0734e0 0x7fed3c071e20 secure :-1 s=THROTTLE_DONE pgs=922 cs=0 l=1 rx=0x7fed2c00f740 tx=0x7fed2c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.482+0000 7fed41856700 1 --2- 172.21.15.80:0/1301579098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c0734e0 0x7fed3c071e20 secure :-1 s=THROTTLE_DONE pgs=922 cs=0 l=1 rx=0x7fed2c00f740 tx=0x7fed2c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.482+0000 7fed41856700 1 --2- 172.21.15.80:0/1301579098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c0734e0 0x7fed3c071e20 secure :-1 s=THROTTLE_DONE pgs=922 cs=0 l=1 rx=0x7fed2c00f740 tx=0x7fed2c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.482+0000 7fed41055700 1 -- 172.21.15.80:0/1301579098 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed2c000960 con 0x7fed3c0734e0 2019-11-28T11:33:08.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.482+0000 7fed41055700 1 -- 172.21.15.80:0/1301579098 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2c000c90 con 0x7fed3c0734e0 2019-11-28T11:33:08.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.482+0000 7fed41055700 1 -- 172.21.15.80:0/1301579098 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed2c0013a0 con 0x7fed3c0734e0 2019-11-28T11:33:08.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.482+0000 7fed43aba700 1 -- 172.21.15.80:0/1301579098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c0734e0 msgr2=0x7fed3c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:08.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.482+0000 7fed43aba700 1 --2- 172.21.15.80:0/1301579098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c0734e0 0x7fed3c071e20 secure :-1 s=READY pgs=922 cs=0 l=1 rx=0x7fed2c00f740 tx=0x7fed2c00fae0).stop 2019-11-28T11:33:08.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.483+0000 7fed43aba700 1 -- 172.21.15.80:0/1301579098 shutdown_connections 2019-11-28T11:33:08.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.483+0000 7fed43aba700 1 --2- 172.21.15.80:0/1301579098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c0734e0 0x7fed3c071e20 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:08.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.483+0000 7fed43aba700 1 --2- 172.21.15.80:0/1301579098 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed3c06c0a0 0x7fed3c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:08.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.483+0000 7fed43aba700 1 -- 172.21.15.80:0/1301579098 shutdown_connections 2019-11-28T11:33:08.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.483+0000 7fed43aba700 1 -- 172.21.15.80:0/1301579098 wait complete. 2019-11-28T11:33:08.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.483+0000 7fed43aba700 1 -- 172.21.15.80:0/1301579098 >> 172.21.15.80:0/1301579098 conn(0x7fed3c061cf0 msgr2=0x7fed3c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:08.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.485+0000 7fed43aba700 1 Processor -- start 2019-11-28T11:33:08.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.485+0000 7fed43aba700 1 -- start start 2019-11-28T11:33:08.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.486+0000 7fed43aba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed3c13e900 0x7fed3c15c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:08.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.486+0000 7fed43aba700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3c13bb70 con 0x7fed3c15c720 2019-11-28T11:33:08.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.486+0000 7fed43aba700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3c13eed0 con 0x7fed3c0768c0 2019-11-28T11:33:08.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.486+0000 7fed43aba700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed3c158fc0 con 0x7fed3c13e900 2019-11-28T11:33:08.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.486+0000 7fed42057700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed3c13e900 0x7fed3c15c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:08.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.486+0000 7fed41856700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fed3c15c720 0x7fed3c0760c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35032/0 (socket says 172.21.15.80:35032) 2019-11-28T11:33:08.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.486+0000 7fed41856700 1 -- 172.21.15.80:0/1679580972 learned_addr learned my addr 172.21.15.80:0/1679580972 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:08.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.486+0000 7fed42057700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed3c13e900 0x7fed3c15c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35714/0 (socket says 172.21.15.80:35714) 2019-11-28T11:33:08.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.486+0000 7fed42057700 1 -- 172.21.15.80:0/1679580972 >> v1:172.21.15.174:6789/0 conn(0x7fed3c0768c0 legacy=0x7fed3c15b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:08.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.486+0000 7fed42057700 1 -- 172.21.15.80:0/1679580972 >> v1:172.21.15.80:6789/0 conn(0x7fed3c15c720 legacy=0x7fed3c0760c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:08.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.486+0000 7fed42057700 1 -- 172.21.15.80:0/1679580972 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c159920 con 0x7fed3c13e900 2019-11-28T11:33:08.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.486+0000 7fed3affd700 1 -- 172.21.15.80:0/1679580972 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192465975 0 0) 0x7fed2c007da0 con 0x7fed3c15c720 2019-11-28T11:33:08.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.486+0000 7fed42057700 1 --2- 172.21.15.80:0/1679580972 >> v2:172.21.15.80:3300/0 conn(0x7fed3c13e900 0x7fed3c15c1e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fed24010710 tx=0x7fed24010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.486+0000 7fed42057700 1 --2- 172.21.15.80:0/1679580972 >> v2:172.21.15.80:3300/0 conn(0x7fed3c13e900 0x7fed3c15c1e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fed24010710 tx=0x7fed24010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.486+0000 7fed42057700 1 --2- 172.21.15.80:0/1679580972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c13e900 0x7fed3c15c1e0 secure :-1 s=READY pgs=924 cs=0 l=1 rx=0x7fed24010710 tx=0x7fed24010ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:08.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.487+0000 7fed42057700 1 --2- 172.21.15.80:0/1679580972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c13e900 0x7fed3c15c1e0 secure :-1 s=THROTTLE_DONE pgs=924 cs=0 l=1 rx=0x7fed24010710 tx=0x7fed24010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.487+0000 7fed3affd700 1 -- 172.21.15.80:0/1679580972 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed24009b20 con 0x7fed3c13e900 2019-11-28T11:33:08.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.487+0000 7fed42057700 1 --2- 172.21.15.80:0/1679580972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c13e900 0x7fed3c15c1e0 secure :-1 s=THROTTLE_DONE pgs=924 cs=0 l=1 rx=0x7fed24010710 tx=0x7fed24010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.487+0000 7fed3affd700 1 -- 172.21.15.80:0/1679580972 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed24009b20 con 0x7fed3c13e900 2019-11-28T11:33:08.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.487+0000 7fed42057700 1 --2- 172.21.15.80:0/1679580972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c13e900 0x7fed3c15c1e0 secure :-1 s=THROTTLE_DONE pgs=924 cs=0 l=1 rx=0x7fed24010710 tx=0x7fed24010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.487+0000 7fed43aba700 1 -- 172.21.15.80:0/1679580972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3c159ca0 con 0x7fed3c13e900 2019-11-28T11:33:08.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.487+0000 7fed3affd700 1 -- 172.21.15.80:0/1679580972 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed24001320 con 0x7fed3c13e900 2019-11-28T11:33:08.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.487+0000 7fed43aba700 1 -- 172.21.15.80:0/1679580972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3c159920 con 0x7fed3c13e900 2019-11-28T11:33:08.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.487+0000 7fed42057700 1 --2- 172.21.15.80:0/1679580972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c13e900 0x7fed3c15c1e0 secure :-1 s=THROTTLE_DONE pgs=924 cs=0 l=1 rx=0x7fed24010710 tx=0x7fed24010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.487+0000 7fed3affd700 1 -- 172.21.15.80:0/1679580972 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fed24000f40 con 0x7fed3c13e900 2019-11-28T11:33:08.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.487+0000 7fed42057700 1 --2- 172.21.15.80:0/1679580972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c13e900 0x7fed3c15c1e0 secure :-1 s=THROTTLE_DONE pgs=924 cs=0 l=1 rx=0x7fed24010710 tx=0x7fed24010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.487+0000 7fed3affd700 1 --2- 172.21.15.80:0/1679580972 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed20018730 0x7fed2001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:08.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.487+0000 7fed3affd700 1 -- 172.21.15.80:0/1679580972 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fed24031df0 con 0x7fed3c13e900 2019-11-28T11:33:08.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.488+0000 7fed41856700 1 --2- 172.21.15.80:0/1679580972 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed20018730 0x7fed2001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:08.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.488+0000 7fed41856700 1 --2- 172.21.15.80:0/1679580972 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed20018730 0x7fed2001abc0 crc :-1 s=READY pgs=381 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:08.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.495+0000 7fed43aba700 1 -- 172.21.15.80:0/1679580972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3c159ca0 con 0x7fed3c13e900 2019-11-28T11:33:08.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.499+0000 7fed42057700 1 --2- 172.21.15.80:0/1679580972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c13e900 0x7fed3c15c1e0 secure :-1 s=THROTTLE_DONE pgs=924 cs=0 l=1 rx=0x7fed24010710 tx=0x7fed24010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.499+0000 7fed3affd700 1 -- 172.21.15.80:0/1679580972 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fed240304c0 con 0x7fed3c13e900 2019-11-28T11:33:08.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.674+0000 7fed43aba700 1 -- 172.21.15.80:0/1679580972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed3c159920 con 0x7fed3c13e900 2019-11-28T11:33:08.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.674+0000 7fed42057700 1 --2- 172.21.15.80:0/1679580972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c13e900 0x7fed3c15c1e0 secure :-1 s=THROTTLE_DONE pgs=924 cs=0 l=1 rx=0x7fed24010710 tx=0x7fed24010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.674+0000 7fed3affd700 1 -- 172.21.15.80:0/1679580972 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+14860 (secure 0 0 0) 0x7fed240304c0 con 0x7fed3c13e900 2019-11-28T11:33:08.720 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:33:08.720 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":78,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:33:00.045712+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:32:57.287502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2019-11-28T11:32:57.974341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:33:08.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.677+0000 7fed43aba700 1 -- 172.21.15.80:0/1679580972 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed20018730 msgr2=0x7fed2001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:08.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.677+0000 7fed43aba700 1 --2- 172.21.15.80:0/1679580972 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed20018730 0x7fed2001abc0 crc :-1 s=READY pgs=381 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:08.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.677+0000 7fed43aba700 1 -- 172.21.15.80:0/1679580972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c13e900 msgr2=0x7fed3c15c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:08.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.677+0000 7fed43aba700 1 --2- 172.21.15.80:0/1679580972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c13e900 0x7fed3c15c1e0 secure :-1 s=READY pgs=924 cs=0 l=1 rx=0x7fed24010710 tx=0x7fed24010ab0).stop 2019-11-28T11:33:08.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.677+0000 7fed43aba700 1 -- 172.21.15.80:0/1679580972 shutdown_connections 2019-11-28T11:33:08.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.677+0000 7fed43aba700 1 --2- 172.21.15.80:0/1679580972 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed20018730 0x7fed2001abc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:08.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.677+0000 7fed43aba700 1 --2- 172.21.15.80:0/1679580972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed3c13e900 0x7fed3c15c1e0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:08.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.677+0000 7fed43aba700 1 -- 172.21.15.80:0/1679580972 shutdown_connections 2019-11-28T11:33:08.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.677+0000 7fed43aba700 1 -- 172.21.15.80:0/1679580972 wait complete. 2019-11-28T11:33:08.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.677+0000 7fed43aba700 1 -- 172.21.15.80:0/1679580972 >> 172.21.15.80:0/1679580972 conn(0x7fed3c13d930 msgr2=0x7fed3c07b940 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:08.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:32:57.287502+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 12, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'77', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:32:57.974341+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 13, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'78', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:33:08.733 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:33:08.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.812+0000 7f7337f8a700 1 Processor -- start 2019-11-28T11:33:08.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.812+0000 7f7337f8a700 1 -- start start 2019-11-28T11:33:08.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.813+0000 7f7337f8a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f733015ed10 0x7f733015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:08.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.813+0000 7f7337f8a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7330073020 0x7f7330071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:08.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.813+0000 7f7337f8a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f733006db60 con 0x7f73300734b0 2019-11-28T11:33:08.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.813+0000 7f7337f8a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733006fe00 con 0x7f733015ed10 2019-11-28T11:33:08.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.813+0000 7f7337f8a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73300700d0 con 0x7f7330073020 2019-11-28T11:33:08.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7336527700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f733015ed10 0x7f733015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:08.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7336527700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f733015ed10 0x7f733015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35722/0 (socket says 172.21.15.80:35722) 2019-11-28T11:33:08.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7336527700 1 -- 172.21.15.80:0/1530876541 learned_addr learned my addr 172.21.15.80:0/1530876541 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:08.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7335d26700 1 --2- 172.21.15.80:0/1530876541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7330073020 0x7f7330071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:08.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7336527700 1 -- 172.21.15.80:0/1530876541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7330073020 msgr2=0x7f7330071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:08.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7336527700 1 --2- 172.21.15.80:0/1530876541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7330073020 0x7f7330071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:08.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7336527700 1 -- 172.21.15.80:0/1530876541 >> v1:172.21.15.174:6789/0 conn(0x7f73300734b0 legacy=0x7f73300723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:08.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7336527700 1 -- 172.21.15.80:0/1530876541 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7330070760 con 0x7f733015ed10 2019-11-28T11:33:08.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7336527700 1 --2- 172.21.15.80:0/1530876541 >> v2:172.21.15.80:3300/0 conn(0x7f733015ed10 0x7f733015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f731800fa40 tx=0x7f731800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7336527700 1 --2- 172.21.15.80:0/1530876541 >> v2:172.21.15.80:3300/0 conn(0x7f733015ed10 0x7f733015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f731800fa40 tx=0x7f731800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7336527700 1 --2- 172.21.15.80:0/1530876541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733015ed10 0x7f733015f100 secure :-1 s=READY pgs=925 cs=0 l=1 rx=0x7f731800fa40 tx=0x7f731800fde0).ready entity=mon.0 client_cookie=56e55bb27c3a38d4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:08.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7336527700 1 --2- 172.21.15.80:0/1530876541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733015ed10 0x7f733015f100 secure :-1 s=THROTTLE_DONE pgs=925 cs=0 l=1 rx=0x7f731800fa40 tx=0x7f731800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7335525700 1 -- 172.21.15.80:0/1530876541 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7318000ce0 con 0x7f733015ed10 2019-11-28T11:33:08.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7336527700 1 --2- 172.21.15.80:0/1530876541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733015ed10 0x7f733015f100 secure :-1 s=THROTTLE_DONE pgs=925 cs=0 l=1 rx=0x7f731800fa40 tx=0x7f731800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7336527700 1 --2- 172.21.15.80:0/1530876541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733015ed10 0x7f733015f100 secure :-1 s=THROTTLE_DONE pgs=925 cs=0 l=1 rx=0x7f731800fa40 tx=0x7f731800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7335525700 1 -- 172.21.15.80:0/1530876541 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7318001010 con 0x7f733015ed10 2019-11-28T11:33:08.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7335525700 1 -- 172.21.15.80:0/1530876541 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7318001720 con 0x7f733015ed10 2019-11-28T11:33:08.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7337f8a700 1 -- 172.21.15.80:0/1530876541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733015ed10 msgr2=0x7f733015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:08.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.814+0000 7f7337f8a700 1 --2- 172.21.15.80:0/1530876541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733015ed10 0x7f733015f100 secure :-1 s=READY pgs=925 cs=0 l=1 rx=0x7f731800fa40 tx=0x7f731800fde0).stop 2019-11-28T11:33:08.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.815+0000 7f7337f8a700 1 -- 172.21.15.80:0/1530876541 shutdown_connections 2019-11-28T11:33:08.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.815+0000 7f7337f8a700 1 --2- 172.21.15.80:0/1530876541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7330073020 0x7f7330071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:08.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.815+0000 7f7337f8a700 1 --2- 172.21.15.80:0/1530876541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733015ed10 0x7f733015f100 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:08.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.815+0000 7f7337f8a700 1 -- 172.21.15.80:0/1530876541 shutdown_connections 2019-11-28T11:33:08.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.815+0000 7f7337f8a700 1 -- 172.21.15.80:0/1530876541 wait complete. 2019-11-28T11:33:08.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.815+0000 7f7337f8a700 1 -- 172.21.15.80:0/1530876541 >> 172.21.15.80:0/1530876541 conn(0x7f7330061d20 msgr2=0x7f73300641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:08.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.818+0000 7f7337f8a700 1 Processor -- start 2019-11-28T11:33:08.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.818+0000 7f7337f8a700 1 -- start start 2019-11-28T11:33:08.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.818+0000 7f7337f8a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f733010e970 0x7f73301087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:08.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.818+0000 7f7337f8a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7330108cf0 0x7f7330107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:08.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.818+0000 7f7337f8a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f733010c250 con 0x7f7330107b70 2019-11-28T11:33:08.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.818+0000 7f7337f8a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733010e430 con 0x7f733010e970 2019-11-28T11:33:08.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.818+0000 7f7337f8a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7330105860 con 0x7f7330108cf0 2019-11-28T11:33:08.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.818+0000 7f7336527700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f733010e970 0x7f73301087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f7336d28700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7330107b70 0x7f733010ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35048/0 (socket says 172.21.15.80:35048) 2019-11-28T11:33:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f7336d28700 1 -- 172.21.15.80:0/4122531864 learned_addr learned my addr 172.21.15.80:0/4122531864 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f7335d26700 1 --2- 172.21.15.80:0/4122531864 >> v2:172.21.15.174:3300/0 conn(0x7f7330108cf0 0x7f7330107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f7336527700 1 -- 172.21.15.80:0/4122531864 >> v2:172.21.15.174:3300/0 conn(0x7f7330108cf0 msgr2=0x7f7330107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:08.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f7336527700 1 --2- 172.21.15.80:0/4122531864 >> v2:172.21.15.174:3300/0 conn(0x7f7330108cf0 0x7f7330107630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f7336527700 1 -- 172.21.15.80:0/4122531864 >> v1:172.21.15.80:6789/0 conn(0x7f7330107b70 legacy=0x7f733010ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f7336527700 1 -- 172.21.15.80:0/4122531864 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7330105ef0 con 0x7f733010e970 2019-11-28T11:33:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f732effd700 1 -- 172.21.15.80:0/4122531864 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941034715 0 0) 0x7f7328001100 con 0x7f7330107b70 2019-11-28T11:33:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f7336527700 1 --2- 172.21.15.80:0/4122531864 >> v2:172.21.15.80:3300/0 conn(0x7f733010e970 0x7f73301087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7318010690 tx=0x7f7318010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f7336527700 1 --2- 172.21.15.80:0/4122531864 >> v2:172.21.15.80:3300/0 conn(0x7f733010e970 0x7f73301087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7318010690 tx=0x7f7318010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f7336527700 1 --2- 172.21.15.80:0/4122531864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733010e970 0x7f73301087b0 secure :-1 s=READY pgs=927 cs=0 l=1 rx=0x7f7318010690 tx=0x7f7318010a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f7336527700 1 --2- 172.21.15.80:0/4122531864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733010e970 0x7f73301087b0 secure :-1 s=THROTTLE_DONE pgs=927 cs=0 l=1 rx=0x7f7318010690 tx=0x7f7318010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f732effd700 1 -- 172.21.15.80:0/4122531864 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73180012d0 con 0x7f733010e970 2019-11-28T11:33:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f7336527700 1 --2- 172.21.15.80:0/4122531864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733010e970 0x7f73301087b0 secure :-1 s=THROTTLE_DONE pgs=927 cs=0 l=1 rx=0x7f7318010690 tx=0x7f7318010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f7336527700 1 --2- 172.21.15.80:0/4122531864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733010e970 0x7f73301087b0 secure :-1 s=THROTTLE_DONE pgs=927 cs=0 l=1 rx=0x7f7318010690 tx=0x7f7318010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f732effd700 1 -- 172.21.15.80:0/4122531864 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7318000cc0 con 0x7f733010e970 2019-11-28T11:33:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f7337f8a700 1 -- 172.21.15.80:0/4122531864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7330106270 con 0x7f733010e970 2019-11-28T11:33:08.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f732effd700 1 -- 172.21.15.80:0/4122531864 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73180018b0 con 0x7f733010e970 2019-11-28T11:33:08.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f7337f8a700 1 -- 172.21.15.80:0/4122531864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7330105ef0 con 0x7f733010e970 2019-11-28T11:33:08.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.819+0000 7f7336527700 1 --2- 172.21.15.80:0/4122531864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733010e970 0x7f73301087b0 secure :-1 s=THROTTLE_DONE pgs=927 cs=0 l=1 rx=0x7f7318010690 tx=0x7f7318010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.820+0000 7f732effd700 1 -- 172.21.15.80:0/4122531864 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f73180010e0 con 0x7f733010e970 2019-11-28T11:33:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.820+0000 7f7336527700 1 --2- 172.21.15.80:0/4122531864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733010e970 0x7f73301087b0 secure :-1 s=THROTTLE_DONE pgs=927 cs=0 l=1 rx=0x7f7318010690 tx=0x7f7318010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.820+0000 7f732effd700 1 --2- 172.21.15.80:0/4122531864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7314018730 0x7f731401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.820+0000 7f732effd700 1 -- 172.21.15.80:0/4122531864 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7318031d10 con 0x7f733010e970 2019-11-28T11:33:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.820+0000 7f7335d26700 1 --2- 172.21.15.80:0/4122531864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7314018730 0x7f731401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:08.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.820+0000 7f7335d26700 1 --2- 172.21.15.80:0/4122531864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7314018730 0x7f731401abc0 crc :-1 s=READY pgs=382 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.828+0000 7f7337f8a700 1 -- 172.21.15.80:0/4122531864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7330106270 con 0x7f733010e970 2019-11-28T11:33:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.831+0000 7f7336527700 1 --2- 172.21.15.80:0/4122531864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733010e970 0x7f73301087b0 secure :-1 s=THROTTLE_DONE pgs=927 cs=0 l=1 rx=0x7f7318010690 tx=0x7f7318010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:08.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.831+0000 7f732effd700 1 -- 172.21.15.80:0/4122531864 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7318029250 con 0x7f733010e970 2019-11-28T11:33:09.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.997+0000 7f7337f8a700 1 -- 172.21.15.80:0/4122531864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f7330105ef0 con 0x7f733010e970 2019-11-28T11:33:09.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.997+0000 7f7336527700 1 --2- 172.21.15.80:0/4122531864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733010e970 0x7f73301087b0 secure :-1 s=THROTTLE_DONE pgs=927 cs=0 l=1 rx=0x7f7318010690 tx=0x7f7318010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:08.997+0000 7f732effd700 1 -- 172.21.15.80:0/4122531864 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v78) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7318029250 con 0x7f733010e970 2019-11-28T11:33:09.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.000+0000 7f7337f8a700 1 -- 172.21.15.80:0/4122531864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7314018730 msgr2=0x7f731401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.000+0000 7f7337f8a700 1 --2- 172.21.15.80:0/4122531864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7314018730 0x7f731401abc0 crc :-1 s=READY pgs=382 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.000+0000 7f7337f8a700 1 -- 172.21.15.80:0/4122531864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733010e970 msgr2=0x7f73301087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.000+0000 7f7337f8a700 1 --2- 172.21.15.80:0/4122531864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733010e970 0x7f73301087b0 secure :-1 s=READY pgs=927 cs=0 l=1 rx=0x7f7318010690 tx=0x7f7318010a30).stop 2019-11-28T11:33:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.000+0000 7f7337f8a700 1 -- 172.21.15.80:0/4122531864 shutdown_connections 2019-11-28T11:33:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.000+0000 7f7337f8a700 1 --2- 172.21.15.80:0/4122531864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7314018730 0x7f731401abc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.000+0000 7f7337f8a700 1 --2- 172.21.15.80:0/4122531864 >> v2:172.21.15.174:3300/0 conn(0x7f7330108cf0 0x7f7330107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.000+0000 7f7337f8a700 1 --2- 172.21.15.80:0/4122531864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f733010e970 0x7f73301087b0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.000+0000 7f7337f8a700 1 -- 172.21.15.80:0/4122531864 shutdown_connections 2019-11-28T11:33:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.000+0000 7f7337f8a700 1 -- 172.21.15.80:0/4122531864 wait complete. 2019-11-28T11:33:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.000+0000 7f7337f8a700 1 -- 172.21.15.80:0/4122531864 >> 172.21.15.80:0/4122531864 conn(0x7f733015e2d0 msgr2=0x7f7330147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:09.048 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:33:09.068 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:33:09.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.155+0000 7ff374733700 1 Processor -- start 2019-11-28T11:33:09.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.155+0000 7ff374733700 1 -- start start 2019-11-28T11:33:09.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.156+0000 7ff374733700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff36c15ed10 0x7ff36c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:09.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.156+0000 7ff374733700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff36c073020 0x7ff36c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:09.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.156+0000 7ff374733700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36c06db60 con 0x7ff36c0734b0 2019-11-28T11:33:09.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.156+0000 7ff374733700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff36c06fe00 con 0x7ff36c15ed10 2019-11-28T11:33:09.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.156+0000 7ff374733700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff36c0700d0 con 0x7ff36c073020 2019-11-28T11:33:09.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff372cd0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff36c15ed10 0x7ff36c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:09.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff372cd0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff36c15ed10 0x7ff36c15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35736/0 (socket says 172.21.15.80:35736) 2019-11-28T11:33:09.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff372cd0700 1 -- 172.21.15.80:0/1471203578 learned_addr learned my addr 172.21.15.80:0/1471203578 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:09.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff3724cf700 1 --2- 172.21.15.80:0/1471203578 >> v2:172.21.15.174:3300/0 conn(0x7ff36c073020 0x7ff36c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:09.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff372cd0700 1 -- 172.21.15.80:0/1471203578 >> v2:172.21.15.174:3300/0 conn(0x7ff36c073020 msgr2=0x7ff36c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:09.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff372cd0700 1 --2- 172.21.15.80:0/1471203578 >> v2:172.21.15.174:3300/0 conn(0x7ff36c073020 0x7ff36c071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:09.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff372cd0700 1 -- 172.21.15.80:0/1471203578 >> v1:172.21.15.174:6789/0 conn(0x7ff36c0734b0 legacy=0x7ff36c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:09.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff372cd0700 1 -- 172.21.15.80:0/1471203578 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c070760 con 0x7ff36c15ed10 2019-11-28T11:33:09.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff3724cf700 1 --2- 172.21.15.80:0/1471203578 >> v2:172.21.15.174:3300/0 conn(0x7ff36c073020 0x7ff36c071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:33:09.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff372cd0700 1 --2- 172.21.15.80:0/1471203578 >> v2:172.21.15.80:3300/0 conn(0x7ff36c15ed10 0x7ff36c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff35400fac0 tx=0x7ff35400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff372cd0700 1 --2- 172.21.15.80:0/1471203578 >> v2:172.21.15.80:3300/0 conn(0x7ff36c15ed10 0x7ff36c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff35400fac0 tx=0x7ff35400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff372cd0700 1 --2- 172.21.15.80:0/1471203578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c15ed10 0x7ff36c15f100 secure :-1 s=READY pgs=928 cs=0 l=1 rx=0x7ff35400fac0 tx=0x7ff35400fe60).ready entity=mon.0 client_cookie=98764aa59a66ac45 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:09.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff372cd0700 1 --2- 172.21.15.80:0/1471203578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c15ed10 0x7ff36c15f100 secure :-1 s=THROTTLE_DONE pgs=928 cs=0 l=1 rx=0x7ff35400fac0 tx=0x7ff35400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff372cd0700 1 --2- 172.21.15.80:0/1471203578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c15ed10 0x7ff36c15f100 secure :-1 s=THROTTLE_DONE pgs=928 cs=0 l=1 rx=0x7ff35400fac0 tx=0x7ff35400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff372cd0700 1 --2- 172.21.15.80:0/1471203578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c15ed10 0x7ff36c15f100 secure :-1 s=THROTTLE_DONE pgs=928 cs=0 l=1 rx=0x7ff35400fac0 tx=0x7ff35400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff371cce700 1 -- 172.21.15.80:0/1471203578 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff354000ce0 con 0x7ff36c15ed10 2019-11-28T11:33:09.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff371cce700 1 -- 172.21.15.80:0/1471203578 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff354001010 con 0x7ff36c15ed10 2019-11-28T11:33:09.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff371cce700 1 -- 172.21.15.80:0/1471203578 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff354001720 con 0x7ff36c15ed10 2019-11-28T11:33:09.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff374733700 1 -- 172.21.15.80:0/1471203578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c15ed10 msgr2=0x7ff36c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.157+0000 7ff374733700 1 --2- 172.21.15.80:0/1471203578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c15ed10 0x7ff36c15f100 secure :-1 s=READY pgs=928 cs=0 l=1 rx=0x7ff35400fac0 tx=0x7ff35400fe60).stop 2019-11-28T11:33:09.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.158+0000 7ff374733700 1 -- 172.21.15.80:0/1471203578 shutdown_connections 2019-11-28T11:33:09.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.158+0000 7ff374733700 1 --2- 172.21.15.80:0/1471203578 >> v2:172.21.15.174:3300/0 conn(0x7ff36c073020 0x7ff36c071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:09.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.158+0000 7ff374733700 1 --2- 172.21.15.80:0/1471203578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c15ed10 0x7ff36c15f100 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.158+0000 7ff374733700 1 -- 172.21.15.80:0/1471203578 shutdown_connections 2019-11-28T11:33:09.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.158+0000 7ff374733700 1 -- 172.21.15.80:0/1471203578 wait complete. 2019-11-28T11:33:09.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.158+0000 7ff374733700 1 -- 172.21.15.80:0/1471203578 >> 172.21.15.80:0/1471203578 conn(0x7ff36c061d20 msgr2=0x7ff36c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:09.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.161+0000 7ff374733700 1 Processor -- start 2019-11-28T11:33:09.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.161+0000 7ff374733700 1 -- start start 2019-11-28T11:33:09.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.161+0000 7ff374733700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff36c153db0 0x7ff36c10dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:09.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.161+0000 7ff374733700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff36c148830 0x7ff36c16ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:09.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.161+0000 7ff374733700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36c1057a0 con 0x7ff36c10e270 2019-11-28T11:33:09.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.161+0000 7ff374733700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff36c106280 con 0x7ff36c153db0 2019-11-28T11:33:09.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.161+0000 7ff374733700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c106550 con 0x7ff36c148830 2019-11-28T11:33:09.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff372cd0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff36c153db0 0x7ff36c10dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:09.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff372cd0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff36c153db0 0x7ff36c10dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35742/0 (socket says 172.21.15.80:35742) 2019-11-28T11:33:09.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff3724cf700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff36c10e270 0x7ff36c148030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35060/0 (socket says 172.21.15.80:35060) 2019-11-28T11:33:09.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff372cd0700 1 -- 172.21.15.80:0/2237171541 learned_addr learned my addr 172.21.15.80:0/2237171541 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:09.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff3734d1700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff36c148830 0x7ff36c16ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:09.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff372cd0700 1 -- 172.21.15.80:0/2237171541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff36c148830 msgr2=0x7ff36c16ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff372cd0700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff36c148830 0x7ff36c16ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff372cd0700 1 -- 172.21.15.80:0/2237171541 >> v1:172.21.15.80:6789/0 conn(0x7ff36c10e270 legacy=0x7ff36c148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff36b7fe700 1 -- 172.21.15.80:0/2237171541 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358699102 0 0) 0x7ff35c007480 con 0x7ff36c10e270 2019-11-28T11:33:09.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff372cd0700 1 -- 172.21.15.80:0/2237171541 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c106be0 con 0x7ff36c153db0 2019-11-28T11:33:09.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff3734d1700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff36c148830 0x7ff36c16ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:33:09.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff372cd0700 1 --2- 172.21.15.80:0/2237171541 >> v2:172.21.15.80:3300/0 conn(0x7ff36c153db0 0x7ff36c10dd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff3540107e0 tx=0x7ff354010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff372cd0700 1 --2- 172.21.15.80:0/2237171541 >> v2:172.21.15.80:3300/0 conn(0x7ff36c153db0 0x7ff36c10dd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff3540107e0 tx=0x7ff354010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff372cd0700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c153db0 0x7ff36c10dd30 secure :-1 s=READY pgs=930 cs=0 l=1 rx=0x7ff3540107e0 tx=0x7ff354010b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff372cd0700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c153db0 0x7ff36c10dd30 secure :-1 s=THROTTLE_DONE pgs=930 cs=0 l=1 rx=0x7ff3540107e0 tx=0x7ff354010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff36b7fe700 1 -- 172.21.15.80:0/2237171541 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff354000cc0 con 0x7ff36c153db0 2019-11-28T11:33:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff372cd0700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c153db0 0x7ff36c10dd30 secure :-1 s=THROTTLE_DONE pgs=930 cs=0 l=1 rx=0x7ff3540107e0 tx=0x7ff354010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff372cd0700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c153db0 0x7ff36c10dd30 secure :-1 s=THROTTLE_DONE pgs=930 cs=0 l=1 rx=0x7ff3540107e0 tx=0x7ff354010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff36b7fe700 1 -- 172.21.15.80:0/2237171541 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3540012d0 con 0x7ff36c153db0 2019-11-28T11:33:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff374733700 1 -- 172.21.15.80:0/2237171541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36c106f60 con 0x7ff36c153db0 2019-11-28T11:33:09.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff36b7fe700 1 -- 172.21.15.80:0/2237171541 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff354000cc0 con 0x7ff36c153db0 2019-11-28T11:33:09.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff374733700 1 -- 172.21.15.80:0/2237171541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36c106be0 con 0x7ff36c153db0 2019-11-28T11:33:09.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.162+0000 7ff372cd0700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c153db0 0x7ff36c10dd30 secure :-1 s=THROTTLE_DONE pgs=930 cs=0 l=1 rx=0x7ff3540107e0 tx=0x7ff354010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.163+0000 7ff36b7fe700 1 -- 172.21.15.80:0/2237171541 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff354000ed0 con 0x7ff36c153db0 2019-11-28T11:33:09.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.163+0000 7ff372cd0700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c153db0 0x7ff36c10dd30 secure :-1 s=THROTTLE_DONE pgs=930 cs=0 l=1 rx=0x7ff3540107e0 tx=0x7ff354010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.163+0000 7ff36b7fe700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff350018730 0x7ff35001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:09.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.163+0000 7ff36b7fe700 1 -- 172.21.15.80:0/2237171541 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff354031e60 con 0x7ff36c153db0 2019-11-28T11:33:09.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.163+0000 7ff3724cf700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff350018730 0x7ff35001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:09.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.163+0000 7ff3724cf700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff350018730 0x7ff35001abc0 crc :-1 s=READY pgs=383 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:09.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.171+0000 7ff374733700 1 -- 172.21.15.80:0/2237171541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36c106f60 con 0x7ff36c153db0 2019-11-28T11:33:09.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.174+0000 7ff372cd0700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c153db0 0x7ff36c10dd30 secure :-1 s=THROTTLE_DONE pgs=930 cs=0 l=1 rx=0x7ff3540107e0 tx=0x7ff354010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.174+0000 7ff36b7fe700 1 -- 172.21.15.80:0/2237171541 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff35402e000 con 0x7ff36c153db0 2019-11-28T11:33:09.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.341+0000 7ff374733700 1 -- 172.21.15.80:0/2237171541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7ff36c106be0 con 0x7ff36c153db0 2019-11-28T11:33:09.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.341+0000 7ff372cd0700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c153db0 0x7ff36c10dd30 secure :-1 s=THROTTLE_DONE pgs=930 cs=0 l=1 rx=0x7ff3540107e0 tx=0x7ff354010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.341+0000 7ff36b7fe700 1 -- 172.21.15.80:0/2237171541 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v78) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff35402e000 con 0x7ff36c153db0 2019-11-28T11:33:09.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.343+0000 7ff374733700 1 -- 172.21.15.80:0/2237171541 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff350018730 msgr2=0x7ff35001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.343+0000 7ff374733700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff350018730 0x7ff35001abc0 crc :-1 s=READY pgs=383 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.343+0000 7ff374733700 1 -- 172.21.15.80:0/2237171541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c153db0 msgr2=0x7ff36c10dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.343+0000 7ff374733700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c153db0 0x7ff36c10dd30 secure :-1 s=READY pgs=930 cs=0 l=1 rx=0x7ff3540107e0 tx=0x7ff354010b80).stop 2019-11-28T11:33:09.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.343+0000 7ff374733700 1 -- 172.21.15.80:0/2237171541 shutdown_connections 2019-11-28T11:33:09.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.343+0000 7ff374733700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff350018730 0x7ff35001abc0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.343+0000 7ff374733700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff36c148830 0x7ff36c16ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.343+0000 7ff374733700 1 --2- 172.21.15.80:0/2237171541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff36c153db0 0x7ff36c10dd30 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.343+0000 7ff374733700 1 -- 172.21.15.80:0/2237171541 shutdown_connections 2019-11-28T11:33:09.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.344+0000 7ff374733700 1 -- 172.21.15.80:0/2237171541 wait complete. 2019-11-28T11:33:09.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.344+0000 7ff374733700 1 -- 172.21.15.80:0/2237171541 >> 172.21.15.80:0/2237171541 conn(0x7ff36c15e2d0 msgr2=0x7ff36c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:09.395 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:33:09.402 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:33:09.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.485+0000 7f58c91a8700 1 Processor -- start 2019-11-28T11:33:09.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.485+0000 7f58c91a8700 1 -- start start 2019-11-28T11:33:09.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.486+0000 7f58c91a8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58c415f100 0x7f58c406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:09.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.486+0000 7f58c91a8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c406c2f0 0x7f58c406c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:09.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.486+0000 7f58c91a8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c406db60 con 0x7f58c415ed10 2019-11-28T11:33:09.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.486+0000 7f58c91a8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c406fe00 con 0x7f58c415f100 2019-11-28T11:33:09.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.486+0000 7f58c91a8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40700d0 con 0x7f58c406c2f0 2019-11-28T11:33:09.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.486+0000 7f58c2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58c415f100 0x7f58c406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.486+0000 7f58c359e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f58c415ed10 0x7f58c4073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35066/0 (socket says 172.21.15.80:35066) 2019-11-28T11:33:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.486+0000 7f58c359e700 1 -- 172.21.15.80:0/2557787285 learned_addr learned my addr 172.21.15.80:0/2557787285 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.486+0000 7f58c89a7700 1 --2- 172.21.15.80:0/2557787285 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c406c2f0 0x7f58c406c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.487+0000 7f58c2d9d700 1 -- 172.21.15.80:0/2557787285 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c406c2f0 msgr2=0x7f58c406c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.487+0000 7f58c2d9d700 1 --2- 172.21.15.80:0/2557787285 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c406c2f0 0x7f58c406c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:09.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.487+0000 7f58c2d9d700 1 -- 172.21.15.80:0/2557787285 >> v1:172.21.15.80:6789/0 conn(0x7f58c415ed10 legacy=0x7f58c4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.487+0000 7f58c259c700 1 -- 172.21.15.80:0/2557787285 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237259519 0 0) 0x7f58ac0014d0 con 0x7f58c415ed10 2019-11-28T11:33:09.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.487+0000 7f58c2d9d700 1 -- 172.21.15.80:0/2557787285 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c4070760 con 0x7f58c415f100 2019-11-28T11:33:09.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.487+0000 7f58c2d9d700 1 --2- 172.21.15.80:0/2557787285 >> v2:172.21.15.80:3300/0 conn(0x7f58c415f100 0x7f58c406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f58b400af50 tx=0x7f58b400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.487+0000 7f58c2d9d700 1 --2- 172.21.15.80:0/2557787285 >> v2:172.21.15.80:3300/0 conn(0x7f58c415f100 0x7f58c406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f58b400af50 tx=0x7f58b400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.487+0000 7f58c2d9d700 1 --2- 172.21.15.80:0/2557787285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c415f100 0x7f58c406bdb0 secure :-1 s=READY pgs=932 cs=0 l=1 rx=0x7f58b400af50 tx=0x7f58b400b6e0).ready entity=mon.0 client_cookie=1da7f67485ab3b3f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:09.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.487+0000 7f58c2d9d700 1 --2- 172.21.15.80:0/2557787285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c415f100 0x7f58c406bdb0 secure :-1 s=THROTTLE_DONE pgs=932 cs=0 l=1 rx=0x7f58b400af50 tx=0x7f58b400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.487+0000 7f58c259c700 1 -- 172.21.15.80:0/2557787285 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b4007210 con 0x7f58c415f100 2019-11-28T11:33:09.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.487+0000 7f58c2d9d700 1 --2- 172.21.15.80:0/2557787285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c415f100 0x7f58c406bdb0 secure :-1 s=THROTTLE_DONE pgs=932 cs=0 l=1 rx=0x7f58b400af50 tx=0x7f58b400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.487+0000 7f58c2d9d700 1 --2- 172.21.15.80:0/2557787285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c415f100 0x7f58c406bdb0 secure :-1 s=THROTTLE_DONE pgs=932 cs=0 l=1 rx=0x7f58b400af50 tx=0x7f58b400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.487+0000 7f58c259c700 1 -- 172.21.15.80:0/2557787285 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b40099b0 con 0x7f58c415f100 2019-11-28T11:33:09.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.487+0000 7f58c259c700 1 -- 172.21.15.80:0/2557787285 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b400a080 con 0x7f58c415f100 2019-11-28T11:33:09.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.487+0000 7f58c91a8700 1 -- 172.21.15.80:0/2557787285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c415f100 msgr2=0x7f58c406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.487+0000 7f58c91a8700 1 --2- 172.21.15.80:0/2557787285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c415f100 0x7f58c406bdb0 secure :-1 s=READY pgs=932 cs=0 l=1 rx=0x7f58b400af50 tx=0x7f58b400b6e0).stop 2019-11-28T11:33:09.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.488+0000 7f58c91a8700 1 -- 172.21.15.80:0/2557787285 shutdown_connections 2019-11-28T11:33:09.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.488+0000 7f58c91a8700 1 --2- 172.21.15.80:0/2557787285 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c406c2f0 0x7f58c406c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:09.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.488+0000 7f58c91a8700 1 --2- 172.21.15.80:0/2557787285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c415f100 0x7f58c406bdb0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.488+0000 7f58c91a8700 1 -- 172.21.15.80:0/2557787285 shutdown_connections 2019-11-28T11:33:09.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.488+0000 7f58c91a8700 1 -- 172.21.15.80:0/2557787285 wait complete. 2019-11-28T11:33:09.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.488+0000 7f58c91a8700 1 -- 172.21.15.80:0/2557787285 >> 172.21.15.80:0/2557787285 conn(0x7f58c4061d20 msgr2=0x7f58c40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:09.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.490+0000 7f58c91a8700 1 Processor -- start 2019-11-28T11:33:09.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.490+0000 7f58c91a8700 1 -- start start 2019-11-28T11:33:09.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.491+0000 7f58c91a8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c4148320 0x7f58c410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:09.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.491+0000 7f58c91a8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58c410e3d0 0x7f58c4168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:09.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.491+0000 7f58c91a8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c4148e00 con 0x7f58c410f290 2019-11-28T11:33:09.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.491+0000 7f58c91a8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c4139ff0 con 0x7f58c410e3d0 2019-11-28T11:33:09.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.491+0000 7f58c91a8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c413aa20 con 0x7f58c4148320 2019-11-28T11:33:09.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.491+0000 7f58c89a7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58c410e3d0 0x7f58c4168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:09.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.491+0000 7f58c89a7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58c410e3d0 0x7f58c4168d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35758/0 (socket says 172.21.15.80:35758) 2019-11-28T11:33:09.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.491+0000 7f58c89a7700 1 -- 172.21.15.80:0/85864127 learned_addr learned my addr 172.21.15.80:0/85864127 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:09.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.491+0000 7f58c359e700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c4148320 0x7f58c410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:09.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.491+0000 7f58c89a7700 1 -- 172.21.15.80:0/85864127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c4148320 msgr2=0x7f58c410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.491+0000 7f58c89a7700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c4148320 0x7f58c410ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.491+0000 7f58c89a7700 1 -- 172.21.15.80:0/85864127 >> v1:172.21.15.174:6789/0 conn(0x7f58c410f290 legacy=0x7f58c410dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.491+0000 7f58c89a7700 1 -- 172.21.15.80:0/85864127 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c410c490 con 0x7f58c410e3d0 2019-11-28T11:33:09.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.492+0000 7f58c89a7700 1 --2- 172.21.15.80:0/85864127 >> v2:172.21.15.80:3300/0 conn(0x7f58c410e3d0 0x7f58c4168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58bc010440 tx=0x7f58bc006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.492+0000 7f58c89a7700 1 --2- 172.21.15.80:0/85864127 >> v2:172.21.15.80:3300/0 conn(0x7f58c410e3d0 0x7f58c4168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58bc010440 tx=0x7f58bc006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.492+0000 7f58c89a7700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c410e3d0 0x7f58c4168d80 secure :-1 s=READY pgs=933 cs=0 l=1 rx=0x7f58bc010440 tx=0x7f58bc006f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:09.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.492+0000 7f58c89a7700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c410e3d0 0x7f58c4168d80 secure :-1 s=THROTTLE_DONE pgs=933 cs=0 l=1 rx=0x7f58bc010440 tx=0x7f58bc006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.492+0000 7f58bbfff700 1 -- 172.21.15.80:0/85864127 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58bc000a70 con 0x7f58c410e3d0 2019-11-28T11:33:09.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.492+0000 7f58c89a7700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c410e3d0 0x7f58c4168d80 secure :-1 s=THROTTLE_DONE pgs=933 cs=0 l=1 rx=0x7f58bc010440 tx=0x7f58bc006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.492+0000 7f58c89a7700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c410e3d0 0x7f58c4168d80 secure :-1 s=THROTTLE_DONE pgs=933 cs=0 l=1 rx=0x7f58bc010440 tx=0x7f58bc006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.492+0000 7f58bbfff700 1 -- 172.21.15.80:0/85864127 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc00ecb0 con 0x7f58c410e3d0 2019-11-28T11:33:09.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.492+0000 7f58c91a8700 1 -- 172.21.15.80:0/85864127 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c410c810 con 0x7f58c410e3d0 2019-11-28T11:33:09.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.492+0000 7f58bbfff700 1 -- 172.21.15.80:0/85864127 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58bc00f380 con 0x7f58c410e3d0 2019-11-28T11:33:09.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.492+0000 7f58c91a8700 1 -- 172.21.15.80:0/85864127 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c410c490 con 0x7f58c410e3d0 2019-11-28T11:33:09.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.492+0000 7f58c89a7700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c410e3d0 0x7f58c4168d80 secure :-1 s=THROTTLE_DONE pgs=933 cs=0 l=1 rx=0x7f58bc010440 tx=0x7f58bc006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.492+0000 7f58bbfff700 1 -- 172.21.15.80:0/85864127 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f58bc00eea0 con 0x7f58c410e3d0 2019-11-28T11:33:09.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.492+0000 7f58c89a7700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c410e3d0 0x7f58c4168d80 secure :-1 s=THROTTLE_DONE pgs=933 cs=0 l=1 rx=0x7f58bc010440 tx=0x7f58bc006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.492+0000 7f58bbfff700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f589c018730 0x7f589c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:09.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.492+0000 7f58bbfff700 1 -- 172.21.15.80:0/85864127 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f58bc031a60 con 0x7f58c410e3d0 2019-11-28T11:33:09.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.493+0000 7f58c359e700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f589c018730 0x7f589c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:09.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.493+0000 7f58c359e700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f589c018730 0x7f589c01abc0 crc :-1 s=READY pgs=384 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:09.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.501+0000 7f58c91a8700 1 -- 172.21.15.80:0/85864127 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c410c810 con 0x7f58c410e3d0 2019-11-28T11:33:09.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.504+0000 7f58c89a7700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c410e3d0 0x7f58c4168d80 secure :-1 s=THROTTLE_DONE pgs=933 cs=0 l=1 rx=0x7f58bc010440 tx=0x7f58bc006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.504+0000 7f58bbfff700 1 -- 172.21.15.80:0/85864127 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f58bc02cfe0 con 0x7f58c410e3d0 2019-11-28T11:33:09.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.670+0000 7f58c91a8700 1 -- 172.21.15.80:0/85864127 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f58c410c490 con 0x7f58c410e3d0 2019-11-28T11:33:09.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.671+0000 7f58c89a7700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c410e3d0 0x7f58c4168d80 secure :-1 s=THROTTLE_DONE pgs=933 cs=0 l=1 rx=0x7f58bc010440 tx=0x7f58bc006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.671+0000 7f58bbfff700 1 -- 172.21.15.80:0/85864127 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v78) v1 ==== 100+0+10 (secure 0 0 0) 0x7f58bc02cfe0 con 0x7f58c410e3d0 2019-11-28T11:33:09.716 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:33:09.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.673+0000 7f58c91a8700 1 -- 172.21.15.80:0/85864127 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f589c018730 msgr2=0x7f589c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.673+0000 7f58c91a8700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f589c018730 0x7f589c01abc0 crc :-1 s=READY pgs=384 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.673+0000 7f58c91a8700 1 -- 172.21.15.80:0/85864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c410e3d0 msgr2=0x7f58c4168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.673+0000 7f58c91a8700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c410e3d0 0x7f58c4168d80 secure :-1 s=READY pgs=933 cs=0 l=1 rx=0x7f58bc010440 tx=0x7f58bc006f90).stop 2019-11-28T11:33:09.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.674+0000 7f58c91a8700 1 -- 172.21.15.80:0/85864127 shutdown_connections 2019-11-28T11:33:09.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.674+0000 7f58c91a8700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58c410e3d0 0x7f58c4168d80 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.674+0000 7f58c91a8700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f589c018730 0x7f589c01abc0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.674+0000 7f58c91a8700 1 --2- 172.21.15.80:0/85864127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58c4148320 0x7f58c410ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.674+0000 7f58c91a8700 1 -- 172.21.15.80:0/85864127 shutdown_connections 2019-11-28T11:33:09.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.674+0000 7f58c91a8700 1 -- 172.21.15.80:0/85864127 wait complete. 2019-11-28T11:33:09.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.674+0000 7f58c91a8700 1 -- 172.21.15.80:0/85864127 >> 172.21.15.80:0/85864127 conn(0x7f58c415e2d0 msgr2=0x7f58c4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:09.728 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:33:09.729 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:33:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.803+0000 7f2707d49700 1 Processor -- start 2019-11-28T11:33:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.803+0000 7f2707d49700 1 -- start start 2019-11-28T11:33:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.804+0000 7f2707d49700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f270006c0a0 0x7f2700072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.804+0000 7f2707d49700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270006db00 con 0x7f2700072620 2019-11-28T11:33:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.804+0000 7f2707d49700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270006e000 con 0x7f27000734e0 2019-11-28T11:33:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.804+0000 7f2707d49700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f270006fd60 con 0x7f270006c0a0 2019-11-28T11:33:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.804+0000 7f27062e6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f270006c0a0 0x7f2700072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:09.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.804+0000 7f2706ae7700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2700072620 0x7f2700164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35082/0 (socket says 172.21.15.80:35082) 2019-11-28T11:33:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.804+0000 7f2706ae7700 1 -- 172.21.15.80:0/3812205497 learned_addr learned my addr 172.21.15.80:0/3812205497 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.804+0000 7f27062e6700 1 -- 172.21.15.80:0/3812205497 >> v1:172.21.15.174:6789/0 conn(0x7f27000734e0 legacy=0x7f2700071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.804+0000 7f27062e6700 1 -- 172.21.15.80:0/3812205497 >> v1:172.21.15.80:6789/0 conn(0x7f2700072620 legacy=0x7f2700164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.804+0000 7f27062e6700 1 -- 172.21.15.80:0/3812205497 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27000706c0 con 0x7f270006c0a0 2019-11-28T11:33:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.804+0000 7f27052e4700 1 -- 172.21.15.80:0/3812205497 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436955938 0 0) 0x7f26f8001150 con 0x7f2700072620 2019-11-28T11:33:09.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.805+0000 7f27062e6700 1 --2- 172.21.15.80:0/3812205497 >> v2:172.21.15.80:3300/0 conn(0x7f270006c0a0 0x7f2700072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f26f000af50 tx=0x7f26f000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.805+0000 7f27062e6700 1 --2- 172.21.15.80:0/3812205497 >> v2:172.21.15.80:3300/0 conn(0x7f270006c0a0 0x7f2700072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f26f000af50 tx=0x7f26f000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.805+0000 7f27062e6700 1 --2- 172.21.15.80:0/3812205497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f270006c0a0 0x7f2700072fa0 secure :-1 s=READY pgs=935 cs=0 l=1 rx=0x7f26f000af50 tx=0x7f26f000b760).ready entity=mon.0 client_cookie=1815b69c12b8f773 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.805+0000 7f27062e6700 1 --2- 172.21.15.80:0/3812205497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f270006c0a0 0x7f2700072fa0 secure :-1 s=THROTTLE_DONE pgs=935 cs=0 l=1 rx=0x7f26f000af50 tx=0x7f26f000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.805+0000 7f27052e4700 1 -- 172.21.15.80:0/3812205497 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f0007210 con 0x7f270006c0a0 2019-11-28T11:33:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.805+0000 7f27062e6700 1 --2- 172.21.15.80:0/3812205497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f270006c0a0 0x7f2700072fa0 secure :-1 s=THROTTLE_DONE pgs=935 cs=0 l=1 rx=0x7f26f000af50 tx=0x7f26f000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.805+0000 7f27062e6700 1 --2- 172.21.15.80:0/3812205497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f270006c0a0 0x7f2700072fa0 secure :-1 s=THROTTLE_DONE pgs=935 cs=0 l=1 rx=0x7f26f000af50 tx=0x7f26f000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.805+0000 7f27052e4700 1 -- 172.21.15.80:0/3812205497 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f00099b0 con 0x7f270006c0a0 2019-11-28T11:33:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.805+0000 7f27052e4700 1 -- 172.21.15.80:0/3812205497 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f000a080 con 0x7f270006c0a0 2019-11-28T11:33:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.805+0000 7f2707d49700 1 -- 172.21.15.80:0/3812205497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f270006c0a0 msgr2=0x7f2700072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.805+0000 7f2707d49700 1 --2- 172.21.15.80:0/3812205497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f270006c0a0 0x7f2700072fa0 secure :-1 s=READY pgs=935 cs=0 l=1 rx=0x7f26f000af50 tx=0x7f26f000b760).stop 2019-11-28T11:33:09.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.806+0000 7f2707d49700 1 -- 172.21.15.80:0/3812205497 shutdown_connections 2019-11-28T11:33:09.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.806+0000 7f2707d49700 1 --2- 172.21.15.80:0/3812205497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f270006c0a0 0x7f2700072fa0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.806+0000 7f2707d49700 1 -- 172.21.15.80:0/3812205497 shutdown_connections 2019-11-28T11:33:09.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.806+0000 7f2707d49700 1 -- 172.21.15.80:0/3812205497 wait complete. 2019-11-28T11:33:09.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.806+0000 7f2707d49700 1 -- 172.21.15.80:0/3812205497 >> 172.21.15.80:0/3812205497 conn(0x7f2700061cf0 msgr2=0x7f2700064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:09.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.808+0000 7f2707d49700 1 Processor -- start 2019-11-28T11:33:09.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.808+0000 7f2707d49700 1 -- start start 2019-11-28T11:33:09.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.809+0000 7f2707d49700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f27001346b0 0x7f2700135040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:09.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.809+0000 7f2707d49700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2700135580 0x7f27001359c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:09.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.809+0000 7f2707d49700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270013f410 con 0x7f27001342c0 2019-11-28T11:33:09.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.809+0000 7f2707d49700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2700141670 con 0x7f2700135580 2019-11-28T11:33:09.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.809+0000 7f2707d49700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2700141940 con 0x7f27001346b0 2019-11-28T11:33:09.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.809+0000 7f2706ae7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2700135580 0x7f27001359c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:09.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.809+0000 7f2706ae7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2700135580 0x7f27001359c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35774/0 (socket says 172.21.15.80:35774) 2019-11-28T11:33:09.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.809+0000 7f2706ae7700 1 -- 172.21.15.80:0/3221830939 learned_addr learned my addr 172.21.15.80:0/3221830939 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:09.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.809+0000 7f2705ae5700 1 --2- 172.21.15.80:0/3221830939 >> v2:172.21.15.174:3300/0 conn(0x7f27001346b0 0x7f2700135040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:09.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.809+0000 7f2706ae7700 1 -- 172.21.15.80:0/3221830939 >> v2:172.21.15.174:3300/0 conn(0x7f27001346b0 msgr2=0x7f2700135040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.809+0000 7f2706ae7700 1 --2- 172.21.15.80:0/3221830939 >> v2:172.21.15.174:3300/0 conn(0x7f27001346b0 0x7f2700135040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:09.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.809+0000 7f2706ae7700 1 -- 172.21.15.80:0/3221830939 >> v1:172.21.15.174:6789/0 conn(0x7f27001342c0 legacy=0x7f27001361c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:09.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.809+0000 7f2706ae7700 1 -- 172.21.15.80:0/3221830939 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2700141fd0 con 0x7f2700135580 2019-11-28T11:33:09.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.809+0000 7f2706ae7700 1 --2- 172.21.15.80:0/3221830939 >> v2:172.21.15.80:3300/0 conn(0x7f2700135580 0x7f27001359c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26f8010390 tx=0x7f26f8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.809+0000 7f2706ae7700 1 --2- 172.21.15.80:0/3221830939 >> v2:172.21.15.80:3300/0 conn(0x7f2700135580 0x7f27001359c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26f8010390 tx=0x7f26f8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.809+0000 7f2706ae7700 1 --2- 172.21.15.80:0/3221830939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2700135580 0x7f27001359c0 secure :-1 s=READY pgs=936 cs=0 l=1 rx=0x7f26f8010390 tx=0x7f26f8010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:09.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.810+0000 7f2706ae7700 1 --2- 172.21.15.80:0/3221830939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2700135580 0x7f27001359c0 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f26f8010390 tx=0x7f26f8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.810+0000 7f26f6ffd700 1 -- 172.21.15.80:0/3221830939 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f8000960 con 0x7f2700135580 2019-11-28T11:33:09.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.810+0000 7f2706ae7700 1 --2- 172.21.15.80:0/3221830939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2700135580 0x7f27001359c0 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f26f8010390 tx=0x7f26f8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.810+0000 7f26f6ffd700 1 -- 172.21.15.80:0/3221830939 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f80010e0 con 0x7f2700135580 2019-11-28T11:33:09.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.810+0000 7f2706ae7700 1 --2- 172.21.15.80:0/3221830939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2700135580 0x7f27001359c0 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f26f8010390 tx=0x7f26f8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.810+0000 7f2707d49700 1 -- 172.21.15.80:0/3221830939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2700142350 con 0x7f2700135580 2019-11-28T11:33:09.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.810+0000 7f26f6ffd700 1 -- 172.21.15.80:0/3221830939 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f8000960 con 0x7f2700135580 2019-11-28T11:33:09.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.810+0000 7f2707d49700 1 -- 172.21.15.80:0/3221830939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2700141fd0 con 0x7f2700135580 2019-11-28T11:33:09.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.810+0000 7f2706ae7700 1 --2- 172.21.15.80:0/3221830939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2700135580 0x7f27001359c0 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f26f8010390 tx=0x7f26f8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.810+0000 7f26f6ffd700 1 -- 172.21.15.80:0/3221830939 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f26f8000960 con 0x7f2700135580 2019-11-28T11:33:09.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.810+0000 7f2706ae7700 1 --2- 172.21.15.80:0/3221830939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2700135580 0x7f27001359c0 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f26f8010390 tx=0x7f26f8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.810+0000 7f26f6ffd700 1 --2- 172.21.15.80:0/3221830939 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f26e8018730 0x7f26e801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:09.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.810+0000 7f26f6ffd700 1 -- 172.21.15.80:0/3221830939 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f26f8031d30 con 0x7f2700135580 2019-11-28T11:33:09.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.810+0000 7f27062e6700 1 --2- 172.21.15.80:0/3221830939 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f26e8018730 0x7f26e801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:09.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.811+0000 7f27062e6700 1 --2- 172.21.15.80:0/3221830939 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f26e8018730 0x7f26e801abc0 crc :-1 s=READY pgs=385 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:09.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.818+0000 7f2707d49700 1 -- 172.21.15.80:0/3221830939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2700142350 con 0x7f2700135580 2019-11-28T11:33:09.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.822+0000 7f2706ae7700 1 --2- 172.21.15.80:0/3221830939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2700135580 0x7f27001359c0 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f26f8010390 tx=0x7f26f8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:09.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.822+0000 7f26f6ffd700 1 -- 172.21.15.80:0/3221830939 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f26f80075b0 con 0x7f2700135580 2019-11-28T11:33:10.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.994+0000 7f2707d49700 1 -- 172.21.15.80:0/3221830939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2700141fd0 con 0x7f2700135580 2019-11-28T11:33:10.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.995+0000 7f2706ae7700 1 --2- 172.21.15.80:0/3221830939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2700135580 0x7f27001359c0 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f26f8010390 tx=0x7f26f8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:10.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.995+0000 7f26f6ffd700 1 -- 172.21.15.80:0/3221830939 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+2448 (secure 0 0 0) 0x7f26f8000940 con 0x7f2700135580 2019-11-28T11:33:10.041 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 46 2019-11-28T11:33:10.041 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:33:10.041 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/3314051014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3314051014},{"type":"v1","addr":"172.21.15.80:6833","nonce":3314051014}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":44},{"gid":6693,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/2096906665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2096906665},{"type":"v1","addr":"172.21.15.80:6835","nonce":2096906665}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:33:06.645749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5390":{"gid":5390,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/3402343468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3402343468},{"type":"v1","addr":"172.21.15.174:6835","nonce":3402343468}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:33:10.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.997+0000 7f2707d49700 1 -- 172.21.15.80:0/3221830939 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f26e8018730 msgr2=0x7f26e801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:10.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.997+0000 7f2707d49700 1 --2- 172.21.15.80:0/3221830939 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f26e8018730 0x7f26e801abc0 crc :-1 s=READY pgs=385 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:10.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.997+0000 7f2707d49700 1 -- 172.21.15.80:0/3221830939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2700135580 msgr2=0x7f27001359c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:10.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.997+0000 7f2707d49700 1 --2- 172.21.15.80:0/3221830939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2700135580 0x7f27001359c0 secure :-1 s=READY pgs=936 cs=0 l=1 rx=0x7f26f8010390 tx=0x7f26f8010730).stop 2019-11-28T11:33:10.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.997+0000 7f2707d49700 1 -- 172.21.15.80:0/3221830939 shutdown_connections 2019-11-28T11:33:10.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.997+0000 7f2707d49700 1 --2- 172.21.15.80:0/3221830939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2700135580 0x7f27001359c0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:10.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.997+0000 7f2707d49700 1 --2- 172.21.15.80:0/3221830939 >> v2:172.21.15.174:3300/0 conn(0x7f27001346b0 0x7f2700135040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:10.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.997+0000 7f2707d49700 1 --2- 172.21.15.80:0/3221830939 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f26e8018730 0x7f26e801abc0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:10.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.997+0000 7f2707d49700 1 -- 172.21.15.80:0/3221830939 shutdown_connections 2019-11-28T11:33:10.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.997+0000 7f2707d49700 1 -- 172.21.15.80:0/3221830939 wait complete. 2019-11-28T11:33:10.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:09.997+0000 7f2707d49700 1 -- 172.21.15.80:0/3221830939 >> 172.21.15.80:0/3221830939 conn(0x7f2700159ae0 msgr2=0x7f270013d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:10.368 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5390}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 12, u'failed': [], u'epoch': 46, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [13], u'info': {u'gid_5390': {u'export_targets': [], u'name': u'c', u'incarnation': 45, u'state_seq': 3, u'state': u'up:active', u'gid': 5390, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3402343468, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 3402343468, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/3402343468'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:32:59.044350+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:33:06.645749+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:33:10.368 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:33:10.369 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:33:10.504 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:33:10.504 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:33:10.505 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:33:10.505 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5390, 2019-11-28T11:33:10.505 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:33:10.505 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:33:10.505 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 4.8153242059999997, 2019-11-28T11:33:10.505 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 46, 2019-11-28T11:33:10.506 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 78, 2019-11-28T11:33:10.506 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 78, 2019-11-28T11:33:10.506 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 9.0526689779999998 2019-11-28T11:33:10.506 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:33:10.512 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5390, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.8153242059999997, "mdsmap_epoch": 46, "osdmap_epoch": 78, "osdmap_epoch_barrier": 78, "uptime": 9.0526689779999998 } 2019-11-28T11:33:10.512 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:33:10.512 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:33:10.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:33:10.513 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:33:10.583 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:33:10.584 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:33:10.908 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:33:10.909 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:33:10.975 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:33:10.975 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:33:11.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:33:11.010 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:33:11.085 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:33:11.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.161+0000 7ff33b634700 1 Processor -- start 2019-11-28T11:33:11.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.162+0000 7ff33b634700 1 -- start start 2019-11-28T11:33:11.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff33b634700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff33406c490 0x7ff33406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:11.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff33b634700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff33406ce60 0x7ff334164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:11.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff33b634700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33406db00 con 0x7ff33406c0a0 2019-11-28T11:33:11.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff33b634700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33406fd60 con 0x7ff33406ce60 2019-11-28T11:33:11.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff33b634700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff334070030 con 0x7ff33406c490 2019-11-28T11:33:11.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff33a3d2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff33406ce60 0x7ff334164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff339bd1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff33406c0a0 0x7ff334072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35094/0 (socket says 172.21.15.80:35094) 2019-11-28T11:33:11.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff339bd1700 1 -- 172.21.15.80:0/681641815 learned_addr learned my addr 172.21.15.80:0/681641815 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:11.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff3393d0700 1 --2- 172.21.15.80:0/681641815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff33406c490 0x7ff33406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff33a3d2700 1 -- 172.21.15.80:0/681641815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff33406c490 msgr2=0x7ff33406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:11.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/681641815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff33406c490 0x7ff33406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:11.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff33a3d2700 1 -- 172.21.15.80:0/681641815 >> v1:172.21.15.80:6789/0 conn(0x7ff33406c0a0 legacy=0x7ff334072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff338bcf700 1 -- 172.21.15.80:0/681641815 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499953198 0 0) 0x7ff31c0014d0 con 0x7ff33406c0a0 2019-11-28T11:33:11.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff33a3d2700 1 -- 172.21.15.80:0/681641815 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3340706c0 con 0x7ff33406ce60 2019-11-28T11:33:11.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/681641815 >> v2:172.21.15.80:3300/0 conn(0x7ff33406ce60 0x7ff334164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff32c00af50 tx=0x7ff32c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/681641815 >> v2:172.21.15.80:3300/0 conn(0x7ff33406ce60 0x7ff334164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff32c00af50 tx=0x7ff32c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/681641815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33406ce60 0x7ff334164d70 secure :-1 s=READY pgs=938 cs=0 l=1 rx=0x7ff32c00af50 tx=0x7ff32c00b6e0).ready entity=mon.0 client_cookie=cdf4f9c364a2a0c3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:11.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/681641815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33406ce60 0x7ff334164d70 secure :-1 s=THROTTLE_DONE pgs=938 cs=0 l=1 rx=0x7ff32c00af50 tx=0x7ff32c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff338bcf700 1 -- 172.21.15.80:0/681641815 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff32c009ba0 con 0x7ff33406ce60 2019-11-28T11:33:11.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/681641815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33406ce60 0x7ff334164d70 secure :-1 s=THROTTLE_DONE pgs=938 cs=0 l=1 rx=0x7ff32c00af50 tx=0x7ff32c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/681641815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33406ce60 0x7ff334164d70 secure :-1 s=THROTTLE_DONE pgs=938 cs=0 l=1 rx=0x7ff32c00af50 tx=0x7ff32c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff338bcf700 1 -- 172.21.15.80:0/681641815 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c0097c0 con 0x7ff33406ce60 2019-11-28T11:33:11.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.163+0000 7ff338bcf700 1 -- 172.21.15.80:0/681641815 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff32c00a180 con 0x7ff33406ce60 2019-11-28T11:33:11.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.164+0000 7ff33b634700 1 -- 172.21.15.80:0/681641815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33406ce60 msgr2=0x7ff334164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.164+0000 7ff33b634700 1 --2- 172.21.15.80:0/681641815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33406ce60 0x7ff334164d70 secure :-1 s=READY pgs=938 cs=0 l=1 rx=0x7ff32c00af50 tx=0x7ff32c00b6e0).stop 2019-11-28T11:33:11.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.164+0000 7ff33b634700 1 -- 172.21.15.80:0/681641815 shutdown_connections 2019-11-28T11:33:11.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.164+0000 7ff33b634700 1 --2- 172.21.15.80:0/681641815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff33406ce60 0x7ff334164d70 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:11.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.164+0000 7ff33b634700 1 --2- 172.21.15.80:0/681641815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff33406c490 0x7ff33406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:11.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.164+0000 7ff33b634700 1 -- 172.21.15.80:0/681641815 shutdown_connections 2019-11-28T11:33:11.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.164+0000 7ff33b634700 1 -- 172.21.15.80:0/681641815 wait complete. 2019-11-28T11:33:11.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.164+0000 7ff33b634700 1 -- 172.21.15.80:0/681641815 >> 172.21.15.80:0/681641815 conn(0x7ff334061cf0 msgr2=0x7ff334064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:11.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.167+0000 7ff33b634700 1 Processor -- start 2019-11-28T11:33:11.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.167+0000 7ff33b634700 1 -- start start 2019-11-28T11:33:11.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33b634700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff3341653e0 0x7ff3341396e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:11.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33b634700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff334139c20 0x7ff33413a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:11.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33b634700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33413b3f0 con 0x7ff334164ff0 2019-11-28T11:33:11.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33b634700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff334155a60 con 0x7ff334139c20 2019-11-28T11:33:11.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33b634700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff334155d30 con 0x7ff3341653e0 2019-11-28T11:33:11.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33a3d2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff334139c20 0x7ff33413a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33a3d2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff334139c20 0x7ff33413a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35788/0 (socket says 172.21.15.80:35788) 2019-11-28T11:33:11.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33a3d2700 1 -- 172.21.15.80:0/3630661204 learned_addr learned my addr 172.21.15.80:0/3630661204 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:11.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff3393d0700 1 --2- 172.21.15.80:0/3630661204 >> v2:172.21.15.174:3300/0 conn(0x7ff3341653e0 0x7ff3341396e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33a3d2700 1 -- 172.21.15.80:0/3630661204 >> v2:172.21.15.174:3300/0 conn(0x7ff3341653e0 msgr2=0x7ff3341396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/3630661204 >> v2:172.21.15.174:3300/0 conn(0x7ff3341653e0 0x7ff3341396e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:11.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33a3d2700 1 -- 172.21.15.80:0/3630661204 >> v1:172.21.15.80:6789/0 conn(0x7ff334164ff0 legacy=0x7ff334113ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff3327fc700 1 -- 172.21.15.80:0/3630661204 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165511483 0 0) 0x7ff31c001480 con 0x7ff334164ff0 2019-11-28T11:33:11.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33a3d2700 1 -- 172.21.15.80:0/3630661204 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3341563c0 con 0x7ff334139c20 2019-11-28T11:33:11.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/3630661204 >> v2:172.21.15.80:3300/0 conn(0x7ff334139c20 0x7ff33413a0c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff32c0103a0 tx=0x7ff32c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/3630661204 >> v2:172.21.15.80:3300/0 conn(0x7ff334139c20 0x7ff33413a0c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff32c0103a0 tx=0x7ff32c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/3630661204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff334139c20 0x7ff33413a0c0 secure :-1 s=READY pgs=940 cs=0 l=1 rx=0x7ff32c0103a0 tx=0x7ff32c010740).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:11.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/3630661204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff334139c20 0x7ff33413a0c0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7ff32c0103a0 tx=0x7ff32c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff3327fc700 1 -- 172.21.15.80:0/3630661204 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff32c00ad00 con 0x7ff334139c20 2019-11-28T11:33:11.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/3630661204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff334139c20 0x7ff33413a0c0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7ff32c0103a0 tx=0x7ff32c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/3630661204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff334139c20 0x7ff33413a0c0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7ff32c0103a0 tx=0x7ff32c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff3327fc700 1 -- 172.21.15.80:0/3630661204 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c009770 con 0x7ff334139c20 2019-11-28T11:33:11.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff3327fc700 1 -- 172.21.15.80:0/3630661204 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff32c009e40 con 0x7ff334139c20 2019-11-28T11:33:11.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33b634700 1 -- 172.21.15.80:0/3630661204 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff334156740 con 0x7ff334139c20 2019-11-28T11:33:11.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.168+0000 7ff33b634700 1 -- 172.21.15.80:0/3630661204 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff334157820 con 0x7ff334139c20 2019-11-28T11:33:11.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.169+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/3630661204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff334139c20 0x7ff33413a0c0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7ff32c0103a0 tx=0x7ff32c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.169+0000 7ff3327fc700 1 -- 172.21.15.80:0/3630661204 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff32c00ac20 con 0x7ff334139c20 2019-11-28T11:33:11.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.169+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/3630661204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff334139c20 0x7ff33413a0c0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7ff32c0103a0 tx=0x7ff32c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.169+0000 7ff3327fc700 1 --2- 172.21.15.80:0/3630661204 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff318018730 0x7ff31801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:11.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.169+0000 7ff3327fc700 1 -- 172.21.15.80:0/3630661204 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff32c031b50 con 0x7ff334139c20 2019-11-28T11:33:11.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.169+0000 7ff339bd1700 1 --2- 172.21.15.80:0/3630661204 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff318018730 0x7ff31801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.169+0000 7ff339bd1700 1 --2- 172.21.15.80:0/3630661204 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff318018730 0x7ff31801abc0 crc :-1 s=READY pgs=386 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:11.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.177+0000 7ff33b634700 1 -- 172.21.15.80:0/3630661204 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3341563c0 con 0x7ff334139c20 2019-11-28T11:33:11.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.180+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/3630661204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff334139c20 0x7ff33413a0c0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7ff32c0103a0 tx=0x7ff32c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.180+0000 7ff3327fc700 1 -- 172.21.15.80:0/3630661204 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff32c000b20 con 0x7ff334139c20 2019-11-28T11:33:11.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.356+0000 7ff33b634700 1 -- 172.21.15.80:0/3630661204 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff334156740 con 0x7ff334139c20 2019-11-28T11:33:11.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.357+0000 7ff33a3d2700 1 --2- 172.21.15.80:0/3630661204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff334139c20 0x7ff33413a0c0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7ff32c0103a0 tx=0x7ff32c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.357+0000 7ff3327fc700 1 -- 172.21.15.80:0/3630661204 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+14860 (secure 0 0 0) 0x7ff32c00aba0 con 0x7ff334139c20 2019-11-28T11:33:11.401 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:33:11.402 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":78,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:33:00.045712+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:32:57.287502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2019-11-28T11:32:57.974341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:33:11.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.359+0000 7ff33b634700 1 -- 172.21.15.80:0/3630661204 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff318018730 msgr2=0x7ff31801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.359+0000 7ff33b634700 1 --2- 172.21.15.80:0/3630661204 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff318018730 0x7ff31801abc0 crc :-1 s=READY pgs=386 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:11.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.359+0000 7ff33b634700 1 -- 172.21.15.80:0/3630661204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff334139c20 msgr2=0x7ff33413a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.359+0000 7ff33b634700 1 --2- 172.21.15.80:0/3630661204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff334139c20 0x7ff33413a0c0 secure :-1 s=READY pgs=940 cs=0 l=1 rx=0x7ff32c0103a0 tx=0x7ff32c010740).stop 2019-11-28T11:33:11.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.359+0000 7ff33b634700 1 -- 172.21.15.80:0/3630661204 shutdown_connections 2019-11-28T11:33:11.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.359+0000 7ff33b634700 1 --2- 172.21.15.80:0/3630661204 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff318018730 0x7ff31801abc0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:11.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.359+0000 7ff33b634700 1 --2- 172.21.15.80:0/3630661204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff334139c20 0x7ff33413a0c0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:11.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.359+0000 7ff33b634700 1 --2- 172.21.15.80:0/3630661204 >> v2:172.21.15.174:3300/0 conn(0x7ff3341653e0 0x7ff3341396e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:11.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.359+0000 7ff33b634700 1 -- 172.21.15.80:0/3630661204 shutdown_connections 2019-11-28T11:33:11.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.359+0000 7ff33b634700 1 -- 172.21.15.80:0/3630661204 wait complete. 2019-11-28T11:33:11.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.359+0000 7ff33b634700 1 -- 172.21.15.80:0/3630661204 >> 172.21.15.80:0/3630661204 conn(0x7ff33411beb0 msgr2=0x7ff33413ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:11.417 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:32:57.287502+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 12, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'77', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:32:57.974341+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 13, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'78', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:33:11.417 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:33:11.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.497+0000 7f28e6340700 1 Processor -- start 2019-11-28T11:33:11.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.497+0000 7f28e6340700 1 -- start start 2019-11-28T11:33:11.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.498+0000 7f28e6340700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28e015ed10 0x7f28e015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:11.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.498+0000 7f28e6340700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e0073020 0x7f28e0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:11.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.498+0000 7f28e6340700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e006db60 con 0x7f28e00734b0 2019-11-28T11:33:11.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.498+0000 7f28e6340700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e006fe00 con 0x7f28e015ed10 2019-11-28T11:33:11.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.498+0000 7f28e6340700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e00700d0 con 0x7f28e0073020 2019-11-28T11:33:11.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.498+0000 7f28e48dd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28e015ed10 0x7f28e015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.498+0000 7f28e48dd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28e015ed10 0x7f28e015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35792/0 (socket says 172.21.15.80:35792) 2019-11-28T11:33:11.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.498+0000 7f28e48dd700 1 -- 172.21.15.80:0/1944462373 learned_addr learned my addr 172.21.15.80:0/1944462373 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:11.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.498+0000 7f28e50de700 1 --1- 172.21.15.80:0/1944462373 >> v1:172.21.15.80:6789/0 conn(0x7f28e00734b0 0x7f28e00723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35112/0 (socket says 172.21.15.80:35112) 2019-11-28T11:33:11.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.498+0000 7f28dffff700 1 --2- 172.21.15.80:0/1944462373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e0073020 0x7f28e0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.498+0000 7f28e48dd700 1 -- 172.21.15.80:0/1944462373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e0073020 msgr2=0x7f28e0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:11.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.498+0000 7f28e48dd700 1 --2- 172.21.15.80:0/1944462373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e0073020 0x7f28e0071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:11.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.498+0000 7f28e48dd700 1 -- 172.21.15.80:0/1944462373 >> v1:172.21.15.80:6789/0 conn(0x7f28e00734b0 legacy=0x7f28e00723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.498+0000 7f28e48dd700 1 -- 172.21.15.80:0/1944462373 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e0070760 con 0x7f28e015ed10 2019-11-28T11:33:11.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.498+0000 7f28df7fe700 1 -- 172.21.15.80:0/1944462373 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602142508 0 0) 0x7f28c8001100 con 0x7f28e00734b0 2019-11-28T11:33:11.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.498+0000 7f28e48dd700 1 --2- 172.21.15.80:0/1944462373 >> v2:172.21.15.80:3300/0 conn(0x7f28e015ed10 0x7f28e015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f28d800fa40 tx=0x7f28d800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.499+0000 7f28e48dd700 1 --2- 172.21.15.80:0/1944462373 >> v2:172.21.15.80:3300/0 conn(0x7f28e015ed10 0x7f28e015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f28d800fa40 tx=0x7f28d800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.499+0000 7f28e48dd700 1 --2- 172.21.15.80:0/1944462373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e015ed10 0x7f28e015f100 secure :-1 s=READY pgs=942 cs=0 l=1 rx=0x7f28d800fa40 tx=0x7f28d800fde0).ready entity=mon.0 client_cookie=f51108610e39dc8d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:11.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.499+0000 7f28e48dd700 1 --2- 172.21.15.80:0/1944462373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e015ed10 0x7f28e015f100 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7f28d800fa40 tx=0x7f28d800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.499+0000 7f28df7fe700 1 -- 172.21.15.80:0/1944462373 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d8000ce0 con 0x7f28e015ed10 2019-11-28T11:33:11.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.499+0000 7f28e48dd700 1 --2- 172.21.15.80:0/1944462373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e015ed10 0x7f28e015f100 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7f28d800fa40 tx=0x7f28d800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.499+0000 7f28e48dd700 1 --2- 172.21.15.80:0/1944462373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e015ed10 0x7f28e015f100 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7f28d800fa40 tx=0x7f28d800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.499+0000 7f28df7fe700 1 -- 172.21.15.80:0/1944462373 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d8001010 con 0x7f28e015ed10 2019-11-28T11:33:11.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.499+0000 7f28df7fe700 1 -- 172.21.15.80:0/1944462373 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d8001720 con 0x7f28e015ed10 2019-11-28T11:33:11.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.499+0000 7f28e6340700 1 -- 172.21.15.80:0/1944462373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e015ed10 msgr2=0x7f28e015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.499+0000 7f28e6340700 1 --2- 172.21.15.80:0/1944462373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e015ed10 0x7f28e015f100 secure :-1 s=READY pgs=942 cs=0 l=1 rx=0x7f28d800fa40 tx=0x7f28d800fde0).stop 2019-11-28T11:33:11.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.499+0000 7f28e6340700 1 -- 172.21.15.80:0/1944462373 shutdown_connections 2019-11-28T11:33:11.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.499+0000 7f28e6340700 1 --2- 172.21.15.80:0/1944462373 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e0073020 0x7f28e0071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:11.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.499+0000 7f28e6340700 1 --2- 172.21.15.80:0/1944462373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e015ed10 0x7f28e015f100 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:11.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.499+0000 7f28e6340700 1 -- 172.21.15.80:0/1944462373 shutdown_connections 2019-11-28T11:33:11.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.499+0000 7f28e6340700 1 -- 172.21.15.80:0/1944462373 wait complete. 2019-11-28T11:33:11.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.499+0000 7f28e6340700 1 -- 172.21.15.80:0/1944462373 >> 172.21.15.80:0/1944462373 conn(0x7f28e0061d20 msgr2=0x7f28e00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:11.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.502+0000 7f28e6340700 1 Processor -- start 2019-11-28T11:33:11.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.502+0000 7f28e6340700 1 -- start start 2019-11-28T11:33:11.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28e6340700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28e010ed60 0x7f28e010f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:11.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28e6340700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010f730 0x7f28e0167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:11.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28e6340700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e010c250 con 0x7f28e010e970 2019-11-28T11:33:11.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28e6340700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e010e430 con 0x7f28e010ed60 2019-11-28T11:33:11.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28e6340700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e0105860 con 0x7f28e010f730 2019-11-28T11:33:11.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28dffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28e010ed60 0x7f28e010f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28dffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28e010ed60 0x7f28e010f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35800/0 (socket says 172.21.15.80:35800) 2019-11-28T11:33:11.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28dffff700 1 -- 172.21.15.80:0/3842163626 learned_addr learned my addr 172.21.15.80:0/3842163626 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:11.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28e50de700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010f730 0x7f28e0167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28dffff700 1 -- 172.21.15.80:0/3842163626 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010f730 msgr2=0x7f28e0167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28dffff700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010f730 0x7f28e0167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:11.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28dffff700 1 -- 172.21.15.80:0/3842163626 >> v1:172.21.15.174:6789/0 conn(0x7f28e010e970 legacy=0x7f28e01087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28dffff700 1 -- 172.21.15.80:0/3842163626 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e0105ef0 con 0x7f28e010ed60 2019-11-28T11:33:11.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28e50de700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010f730 0x7f28e0167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:33:11.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28dffff700 1 --2- 172.21.15.80:0/3842163626 >> v2:172.21.15.80:3300/0 conn(0x7f28e010ed60 0x7f28e010f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28d0010400 tx=0x7f28d00107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28dffff700 1 --2- 172.21.15.80:0/3842163626 >> v2:172.21.15.80:3300/0 conn(0x7f28e010ed60 0x7f28e010f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28d0010400 tx=0x7f28d00107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28dffff700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e010ed60 0x7f28e010f1f0 secure :-1 s=READY pgs=943 cs=0 l=1 rx=0x7f28d0010400 tx=0x7f28d00107a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:11.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28dffff700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e010ed60 0x7f28e010f1f0 secure :-1 s=THROTTLE_DONE pgs=943 cs=0 l=1 rx=0x7f28d0010400 tx=0x7f28d00107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28dd7fa700 1 -- 172.21.15.80:0/3842163626 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d0000940 con 0x7f28e010ed60 2019-11-28T11:33:11.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.503+0000 7f28dffff700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e010ed60 0x7f28e010f1f0 secure :-1 s=THROTTLE_DONE pgs=943 cs=0 l=1 rx=0x7f28d0010400 tx=0x7f28d00107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.504+0000 7f28dffff700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e010ed60 0x7f28e010f1f0 secure :-1 s=THROTTLE_DONE pgs=943 cs=0 l=1 rx=0x7f28d0010400 tx=0x7f28d00107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.504+0000 7f28dd7fa700 1 -- 172.21.15.80:0/3842163626 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d0000ea0 con 0x7f28e010ed60 2019-11-28T11:33:11.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.504+0000 7f28e6340700 1 -- 172.21.15.80:0/3842163626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e0106270 con 0x7f28e010ed60 2019-11-28T11:33:11.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.504+0000 7f28dd7fa700 1 -- 172.21.15.80:0/3842163626 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d0001470 con 0x7f28e010ed60 2019-11-28T11:33:11.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.504+0000 7f28e6340700 1 -- 172.21.15.80:0/3842163626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e0105ef0 con 0x7f28e010ed60 2019-11-28T11:33:11.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.504+0000 7f28dffff700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e010ed60 0x7f28e010f1f0 secure :-1 s=THROTTLE_DONE pgs=943 cs=0 l=1 rx=0x7f28d0010400 tx=0x7f28d00107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.504+0000 7f28dd7fa700 1 -- 172.21.15.80:0/3842163626 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f28d0001090 con 0x7f28e010ed60 2019-11-28T11:33:11.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.504+0000 7f28dffff700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e010ed60 0x7f28e010f1f0 secure :-1 s=THROTTLE_DONE pgs=943 cs=0 l=1 rx=0x7f28d0010400 tx=0x7f28d00107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.504+0000 7f28dd7fa700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28c4018730 0x7f28c401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:11.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.504+0000 7f28dd7fa700 1 -- 172.21.15.80:0/3842163626 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f28d0031ac0 con 0x7f28e010ed60 2019-11-28T11:33:11.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.504+0000 7f28e48dd700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28c4018730 0x7f28c401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.505+0000 7f28e48dd700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28c4018730 0x7f28c401abc0 crc :-1 s=READY pgs=387 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:11.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.512+0000 7f28e6340700 1 -- 172.21.15.80:0/3842163626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e0106270 con 0x7f28e010ed60 2019-11-28T11:33:11.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.515+0000 7f28dffff700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e010ed60 0x7f28e010f1f0 secure :-1 s=THROTTLE_DONE pgs=943 cs=0 l=1 rx=0x7f28d0010400 tx=0x7f28d00107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.516+0000 7f28dd7fa700 1 -- 172.21.15.80:0/3842163626 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f28d0000c90 con 0x7f28e010ed60 2019-11-28T11:33:11.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.686+0000 7f28e6340700 1 -- 172.21.15.80:0/3842163626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f28e0105ef0 con 0x7f28e010ed60 2019-11-28T11:33:11.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.686+0000 7f28dffff700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e010ed60 0x7f28e010f1f0 secure :-1 s=THROTTLE_DONE pgs=943 cs=0 l=1 rx=0x7f28d0010400 tx=0x7f28d00107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.686+0000 7f28dd7fa700 1 -- 172.21.15.80:0/3842163626 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v78) v1 ==== 92+0+10 (secure 0 0 0) 0x7f28d0001090 con 0x7f28e010ed60 2019-11-28T11:33:11.731 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:33:11.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.689+0000 7f28e6340700 1 -- 172.21.15.80:0/3842163626 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28c4018730 msgr2=0x7f28c401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.689+0000 7f28e6340700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28c4018730 0x7f28c401abc0 crc :-1 s=READY pgs=387 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:11.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.689+0000 7f28e6340700 1 -- 172.21.15.80:0/3842163626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e010ed60 msgr2=0x7f28e010f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.689+0000 7f28e6340700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e010ed60 0x7f28e010f1f0 secure :-1 s=READY pgs=943 cs=0 l=1 rx=0x7f28d0010400 tx=0x7f28d00107a0).stop 2019-11-28T11:33:11.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.689+0000 7f28e6340700 1 -- 172.21.15.80:0/3842163626 shutdown_connections 2019-11-28T11:33:11.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.689+0000 7f28e6340700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010f730 0x7f28e0167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:11.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.689+0000 7f28e6340700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e010ed60 0x7f28e010f1f0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:11.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.689+0000 7f28e6340700 1 --2- 172.21.15.80:0/3842163626 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28c4018730 0x7f28c401abc0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:11.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.689+0000 7f28e6340700 1 -- 172.21.15.80:0/3842163626 shutdown_connections 2019-11-28T11:33:11.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.689+0000 7f28e6340700 1 -- 172.21.15.80:0/3842163626 wait complete. 2019-11-28T11:33:11.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.689+0000 7f28e6340700 1 -- 172.21.15.80:0/3842163626 >> 172.21.15.80:0/3842163626 conn(0x7f28e015e2d0 msgr2=0x7f28e0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:11.743 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:33:11.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.822+0000 7fcd7c0e4700 1 Processor -- start 2019-11-28T11:33:11.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.823+0000 7fcd7c0e4700 1 -- start start 2019-11-28T11:33:11.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7c0e4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcd741639f0 0x7fcd74165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7c0e4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7406db60 con 0x7fcd7415ed10 2019-11-28T11:33:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7c0e4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7406e060 con 0x7fcd7415f100 2019-11-28T11:33:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7c0e4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7406fe00 con 0x7fcd741639f0 2019-11-28T11:33:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7a681700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcd7415ed10 0x7fcd74073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35122/0 (socket says 172.21.15.80:35122) 2019-11-28T11:33:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7a681700 1 -- 172.21.15.80:0/2863310963 learned_addr learned my addr 172.21.15.80:0/2863310963 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:11.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/2863310963 >> v2:172.21.15.174:3300/0 conn(0x7fcd741639f0 0x7fcd74165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7967f700 1 -- 172.21.15.80:0/2863310963 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816077111 0 0) 0x7fcd68001150 con 0x7fcd7415ed10 2019-11-28T11:33:11.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7967f700 1 -- 172.21.15.80:0/2863310963 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd60002e80 con 0x7fcd7415ed10 2019-11-28T11:33:11.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7967f700 1 -- 172.21.15.80:0/2863310963 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2821422092 0 0) 0x7fcd68001130 con 0x7fcd7415ed10 2019-11-28T11:33:11.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7967f700 1 -- 172.21.15.80:0/2863310963 >> v2:172.21.15.174:3300/0 conn(0x7fcd741639f0 msgr2=0x7fcd74165df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:11.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7967f700 1 --2- 172.21.15.80:0/2863310963 >> v2:172.21.15.174:3300/0 conn(0x7fcd741639f0 0x7fcd74165df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:11.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7967f700 1 -- 172.21.15.80:0/2863310963 >> v1:172.21.15.174:6789/0 conn(0x7fcd7415f100 legacy=0x7fcd7406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7967f700 1 -- 172.21.15.80:0/2863310963 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd74070760 con 0x7fcd7415ed10 2019-11-28T11:33:11.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7967f700 1 -- 172.21.15.80:0/2863310963 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fcd68001660 con 0x7fcd7415ed10 2019-11-28T11:33:11.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7967f700 1 -- 172.21.15.80:0/2863310963 >> v1:172.21.15.80:6789/0 conn(0x7fcd7415ed10 legacy=0x7fcd74073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7967f700 1 --2- 172.21.15.80:0/2863310963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd60003ab0 0x7fcd60005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:11.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7967f700 1 --2- 172.21.15.80:0/2863310963 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd60006690 0x7fcd60008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:11.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7967f700 1 --2- 172.21.15.80:0/2863310963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd60009380 0x7fcd6000b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:11.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7967f700 1 -- 172.21.15.80:0/2863310963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6000c000 con 0x7fcd60009380 2019-11-28T11:33:11.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7967f700 1 -- 172.21.15.80:0/2863310963 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd60050200 con 0x7fcd60003ab0 2019-11-28T11:33:11.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7967f700 1 -- 172.21.15.80:0/2863310963 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd60050430 con 0x7fcd60006690 2019-11-28T11:33:11.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.824+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/2863310963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd60009380 0x7fcd6000b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7a681700 1 --2- 172.21.15.80:0/2863310963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd60003ab0 0x7fcd60005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd79e80700 1 --2- 172.21.15.80:0/2863310963 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd60006690 0x7fcd60008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7ae82700 1 -- 172.21.15.80:0/2863310963 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd60006690 msgr2=0x7fcd60008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:11.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/2863310963 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd60006690 0x7fcd60008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:11.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7ae82700 1 -- 172.21.15.80:0/2863310963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd60003ab0 msgr2=0x7fcd60005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:11.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/2863310963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd60003ab0 0x7fcd60005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:11.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7ae82700 1 -- 172.21.15.80:0/2863310963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd600506e0 con 0x7fcd60009380 2019-11-28T11:33:11.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/2863310963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd60009380 0x7fcd6000b850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcd6c00eba0 tx=0x7fcd6c00ead0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7ae82700 1 -- 172.21.15.80:0/2863310963 reap_dead start 2019-11-28T11:33:11.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/2863310963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd60009380 0x7fcd6000b850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcd6c00eba0 tx=0x7fcd6c00ead0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/2863310963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd60009380 0x7fcd6000b850 secure :-1 s=READY pgs=945 cs=0 l=1 rx=0x7fcd6c00eba0 tx=0x7fcd6c00ead0).ready entity=mon.0 client_cookie=566408f2a9804e75 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:11.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/2863310963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd60009380 0x7fcd6000b850 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7fcd6c00eba0 tx=0x7fcd6c00ead0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7967f700 1 -- 172.21.15.80:0/2863310963 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd6c00f120 con 0x7fcd60009380 2019-11-28T11:33:11.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/2863310963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd60009380 0x7fcd6000b850 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7fcd6c00eba0 tx=0x7fcd6c00ead0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/2863310963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd60009380 0x7fcd6000b850 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7fcd6c00eba0 tx=0x7fcd6c00ead0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7967f700 1 -- 172.21.15.80:0/2863310963 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c00ed40 con 0x7fcd60009380 2019-11-28T11:33:11.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7967f700 1 -- 172.21.15.80:0/2863310963 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd6c00ef30 con 0x7fcd60009380 2019-11-28T11:33:11.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7c0e4700 1 -- 172.21.15.80:0/2863310963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd60009380 msgr2=0x7fcd6000b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.825+0000 7fcd7c0e4700 1 --2- 172.21.15.80:0/2863310963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd60009380 0x7fcd6000b850 secure :-1 s=READY pgs=945 cs=0 l=1 rx=0x7fcd6c00eba0 tx=0x7fcd6c00ead0).stop 2019-11-28T11:33:11.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.826+0000 7fcd7c0e4700 1 -- 172.21.15.80:0/2863310963 shutdown_connections 2019-11-28T11:33:11.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.826+0000 7fcd7c0e4700 1 --2- 172.21.15.80:0/2863310963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd60009380 0x7fcd6000b850 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:11.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.826+0000 7fcd7c0e4700 1 -- 172.21.15.80:0/2863310963 shutdown_connections 2019-11-28T11:33:11.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.826+0000 7fcd7c0e4700 1 -- 172.21.15.80:0/2863310963 wait complete. 2019-11-28T11:33:11.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.826+0000 7fcd7c0e4700 1 -- 172.21.15.80:0/2863310963 >> 172.21.15.80:0/2863310963 conn(0x7fcd74061d20 msgr2=0x7fcd740641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:11.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.828+0000 7fcd7c0e4700 1 Processor -- start 2019-11-28T11:33:11.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.828+0000 7fcd7c0e4700 1 -- start start 2019-11-28T11:33:11.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.829+0000 7fcd7c0e4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcd741502e0 0x7fcd74150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:11.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.829+0000 7fcd7c0e4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd74150cb0 0x7fcd74167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:11.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.829+0000 7fcd7c0e4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd74133a20 con 0x7fcd74108630 2019-11-28T11:33:11.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.829+0000 7fcd7c0e4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd74131980 con 0x7fcd741502e0 2019-11-28T11:33:11.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.829+0000 7fcd7c0e4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd74131c50 con 0x7fcd74150cb0 2019-11-28T11:33:11.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.829+0000 7fcd7a681700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fcd74108630 0x7fcd74151200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:50678/0 (socket says 172.21.15.80:50678) 2019-11-28T11:33:11.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.829+0000 7fcd7a681700 1 -- 172.21.15.80:0/447866156 learned_addr learned my addr 172.21.15.80:0/447866156 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:11.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.829+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd74150cb0 0x7fcd74167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.829+0000 7fcd79e80700 1 --2- 172.21.15.80:0/447866156 >> v2:172.21.15.174:3300/0 conn(0x7fcd741502e0 0x7fcd74150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd66ffd700 1 -- 172.21.15.80:0/447866156 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602067199 0 0) 0x7fcd68001850 con 0x7fcd74108630 2019-11-28T11:33:11.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd66ffd700 1 -- 172.21.15.80:0/447866156 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd5c002e80 con 0x7fcd74108630 2019-11-28T11:33:11.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd7ae82700 1 -- 172.21.15.80:0/447866156 >> v2:172.21.15.174:3300/0 conn(0x7fcd741502e0 msgr2=0x7fcd74150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/447866156 >> v2:172.21.15.174:3300/0 conn(0x7fcd741502e0 0x7fcd74150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:11.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd7ae82700 1 -- 172.21.15.80:0/447866156 >> v1:172.21.15.174:6789/0 conn(0x7fcd74108630 legacy=0x7fcd74151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:11.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd7ae82700 1 -- 172.21.15.80:0/447866156 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd741322e0 con 0x7fcd74150cb0 2019-11-28T11:33:11.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd74150cb0 0x7fcd74167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd6c010710 tx=0x7fcd6c010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd74150cb0 0x7fcd74167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd6c010710 tx=0x7fcd6c010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd74150cb0 0x7fcd74167d70 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7fcd6c010710 tx=0x7fcd6c010540).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:11.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd74150cb0 0x7fcd74167d70 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fcd6c010710 tx=0x7fcd6c010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd66ffd700 1 -- 172.21.15.80:0/447866156 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd6c00e830 con 0x7fcd74150cb0 2019-11-28T11:33:11.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd74150cb0 0x7fcd74167d70 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fcd6c010710 tx=0x7fcd6c010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd7c0e4700 1 -- 172.21.15.80:0/447866156 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd74132660 con 0x7fcd74150cb0 2019-11-28T11:33:11.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd66ffd700 1 -- 172.21.15.80:0/447866156 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c00e830 con 0x7fcd74150cb0 2019-11-28T11:33:11.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd74150cb0 0x7fcd74167d70 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fcd6c010710 tx=0x7fcd6c010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd66ffd700 1 -- 172.21.15.80:0/447866156 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd6c00f190 con 0x7fcd74150cb0 2019-11-28T11:33:11.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd7c0e4700 1 -- 172.21.15.80:0/447866156 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd741322e0 con 0x7fcd74150cb0 2019-11-28T11:33:11.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.830+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd74150cb0 0x7fcd74167d70 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fcd6c010710 tx=0x7fcd6c010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.831+0000 7fcd66ffd700 1 -- 172.21.15.80:0/447866156 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcd6c00f870 con 0x7fcd74150cb0 2019-11-28T11:33:11.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.831+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd74150cb0 0x7fcd74167d70 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fcd6c010710 tx=0x7fcd6c010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.831+0000 7fcd66ffd700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd5c018770 0x7fcd5c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:11.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.831+0000 7fcd66ffd700 1 -- 172.21.15.80:0/447866156 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fcd6c031d90 con 0x7fcd74150cb0 2019-11-28T11:33:11.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.831+0000 7fcd7a681700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd5c018770 0x7fcd5c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:11.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.831+0000 7fcd7a681700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd5c018770 0x7fcd5c01abe0 crc :-1 s=READY pgs=388 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:11.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.838+0000 7fcd7c0e4700 1 -- 172.21.15.80:0/447866156 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd74132660 con 0x7fcd74150cb0 2019-11-28T11:33:11.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.842+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd74150cb0 0x7fcd74167d70 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fcd6c010710 tx=0x7fcd6c010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:11.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:11.842+0000 7fcd66ffd700 1 -- 172.21.15.80:0/447866156 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcd6c00f660 con 0x7fcd74150cb0 2019-11-28T11:33:12.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.009+0000 7fcd7c0e4700 1 -- 172.21.15.80:0/447866156 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fcd741322e0 con 0x7fcd74150cb0 2019-11-28T11:33:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.009+0000 7fcd7ae82700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd74150cb0 0x7fcd74167d70 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fcd6c010710 tx=0x7fcd6c010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.009+0000 7fcd66ffd700 1 -- 172.21.15.80:0/447866156 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v78) v1 ==== 104+0+10 (secure 0 0 0) 0x7fcd6c00f870 con 0x7fcd74150cb0 2019-11-28T11:33:12.053 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:33:12.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.012+0000 7fcd7c0e4700 1 -- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd5c018770 msgr2=0x7fcd5c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:12.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.012+0000 7fcd7c0e4700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd5c018770 0x7fcd5c01abe0 crc :-1 s=READY pgs=388 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:12.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.012+0000 7fcd7c0e4700 1 -- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd74150cb0 msgr2=0x7fcd74167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:12.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.012+0000 7fcd7c0e4700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd74150cb0 0x7fcd74167d70 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7fcd6c010710 tx=0x7fcd6c010540).stop 2019-11-28T11:33:12.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.012+0000 7fcd7c0e4700 1 -- 172.21.15.80:0/447866156 shutdown_connections 2019-11-28T11:33:12.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.012+0000 7fcd7c0e4700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd74150cb0 0x7fcd74167d70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:12.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.012+0000 7fcd7c0e4700 1 --2- 172.21.15.80:0/447866156 >> v2:172.21.15.174:3300/0 conn(0x7fcd741502e0 0x7fcd74150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:12.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.012+0000 7fcd7c0e4700 1 --2- 172.21.15.80:0/447866156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd5c018770 0x7fcd5c01abe0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:12.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.012+0000 7fcd7c0e4700 1 -- 172.21.15.80:0/447866156 shutdown_connections 2019-11-28T11:33:12.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.012+0000 7fcd7c0e4700 1 -- 172.21.15.80:0/447866156 wait complete. 2019-11-28T11:33:12.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.012+0000 7fcd7c0e4700 1 -- 172.21.15.80:0/447866156 >> 172.21.15.80:0/447866156 conn(0x7fcd7414dbb0 msgr2=0x7fcd74142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:12.065 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:33:12.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.148+0000 7fc8301a5700 1 Processor -- start 2019-11-28T11:33:12.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.148+0000 7fc8301a5700 1 -- start start 2019-11-28T11:33:12.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.149+0000 7fc8301a5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc8281639f0 0x7fc828165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:12.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.149+0000 7fc8301a5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82806db60 con 0x7fc82815f100 2019-11-28T11:33:12.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.149+0000 7fc8301a5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82806e060 con 0x7fc82815ed10 2019-11-28T11:33:12.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.149+0000 7fc8301a5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82806fe00 con 0x7fc8281639f0 2019-11-28T11:33:12.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82df41700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc82815f100 0x7fc82806bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35142/0 (socket says 172.21.15.80:35142) 2019-11-28T11:33:12.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82df41700 1 -- 172.21.15.80:0/4039622928 learned_addr learned my addr 172.21.15.80:0/4039622928 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:12.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82ef43700 1 --2- 172.21.15.80:0/4039622928 >> v2:172.21.15.174:3300/0 conn(0x7fc8281639f0 0x7fc828165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:12.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82d740700 1 -- 172.21.15.80:0/4039622928 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754681304 0 0) 0x7fc8240014d0 con 0x7fc82815f100 2019-11-28T11:33:12.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82d740700 1 -- 172.21.15.80:0/4039622928 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc814002e80 con 0x7fc82815f100 2019-11-28T11:33:12.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82d740700 1 -- 172.21.15.80:0/4039622928 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3116141496 0 0) 0x7fc8240014b0 con 0x7fc82815f100 2019-11-28T11:33:12.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82d740700 1 -- 172.21.15.80:0/4039622928 >> v2:172.21.15.174:3300/0 conn(0x7fc8281639f0 msgr2=0x7fc828165df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:12.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82d740700 1 --2- 172.21.15.80:0/4039622928 >> v2:172.21.15.174:3300/0 conn(0x7fc8281639f0 0x7fc828165df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:12.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82d740700 1 -- 172.21.15.80:0/4039622928 >> v1:172.21.15.174:6789/0 conn(0x7fc82815ed10 legacy=0x7fc828073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:12.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82d740700 1 -- 172.21.15.80:0/4039622928 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828070760 con 0x7fc82815f100 2019-11-28T11:33:12.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82d740700 1 -- 172.21.15.80:0/4039622928 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc8240019e0 con 0x7fc82815f100 2019-11-28T11:33:12.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82d740700 1 -- 172.21.15.80:0/4039622928 >> v1:172.21.15.80:6789/0 conn(0x7fc82815f100 legacy=0x7fc82806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:12.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82d740700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc814003ab0 0x7fc814005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:12.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82d740700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc814006690 0x7fc814008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82d740700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc814009380 0x7fc81400b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82d740700 1 -- 172.21.15.80:0/4039622928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81400c000 con 0x7fc814006690 2019-11-28T11:33:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82d740700 1 -- 172.21.15.80:0/4039622928 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc814050200 con 0x7fc814009380 2019-11-28T11:33:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82df41700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc814006690 0x7fc814008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82d740700 1 -- 172.21.15.80:0/4039622928 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc814050430 con 0x7fc814003ab0 2019-11-28T11:33:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82e742700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc814003ab0 0x7fc814005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:12.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.150+0000 7fc82ef43700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc814009380 0x7fc81400b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc82df41700 1 -- 172.21.15.80:0/4039622928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc814003ab0 msgr2=0x7fc814005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc82df41700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc814003ab0 0x7fc814005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc82df41700 1 -- 172.21.15.80:0/4039622928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc814009380 msgr2=0x7fc81400b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc82df41700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc814009380 0x7fc81400b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc82ef43700 1 -- 172.21.15.80:0/4039622928 reap_dead start 2019-11-28T11:33:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc82df41700 1 -- 172.21.15.80:0/4039622928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8140506e0 con 0x7fc814006690 2019-11-28T11:33:12.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc82e742700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc814003ab0 0x7fc814005f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:33:12.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc82df41700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc814006690 0x7fc814008b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc82400fc90 tx=0x7fc82400fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc82df41700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc814006690 0x7fc814008b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc82400fc90 tx=0x7fc82400fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc82df41700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc814006690 0x7fc814008b20 secure :-1 s=READY pgs=947 cs=0 l=1 rx=0x7fc82400fc90 tx=0x7fc82400fb10).ready entity=mon.0 client_cookie=854ef1cf6e9168c4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:12.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc82df41700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc814006690 0x7fc814008b20 secure :-1 s=THROTTLE_DONE pgs=947 cs=0 l=1 rx=0x7fc82400fc90 tx=0x7fc82400fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc82d740700 1 -- 172.21.15.80:0/4039622928 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8240014b0 con 0x7fc814006690 2019-11-28T11:33:12.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc82df41700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc814006690 0x7fc814008b20 secure :-1 s=THROTTLE_DONE pgs=947 cs=0 l=1 rx=0x7fc82400fc90 tx=0x7fc82400fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc82df41700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc814006690 0x7fc814008b20 secure :-1 s=THROTTLE_DONE pgs=947 cs=0 l=1 rx=0x7fc82400fc90 tx=0x7fc82400fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc82d740700 1 -- 172.21.15.80:0/4039622928 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8240045c0 con 0x7fc814006690 2019-11-28T11:33:12.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc82d740700 1 -- 172.21.15.80:0/4039622928 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8240014b0 con 0x7fc814006690 2019-11-28T11:33:12.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc8301a5700 1 -- 172.21.15.80:0/4039622928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc814006690 msgr2=0x7fc814008b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:12.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.151+0000 7fc8301a5700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc814006690 0x7fc814008b20 secure :-1 s=READY pgs=947 cs=0 l=1 rx=0x7fc82400fc90 tx=0x7fc82400fb10).stop 2019-11-28T11:33:12.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.152+0000 7fc8301a5700 1 -- 172.21.15.80:0/4039622928 shutdown_connections 2019-11-28T11:33:12.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.152+0000 7fc8301a5700 1 --2- 172.21.15.80:0/4039622928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc814006690 0x7fc814008b20 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:12.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.152+0000 7fc8301a5700 1 -- 172.21.15.80:0/4039622928 shutdown_connections 2019-11-28T11:33:12.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.152+0000 7fc8301a5700 1 -- 172.21.15.80:0/4039622928 wait complete. 2019-11-28T11:33:12.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.152+0000 7fc8301a5700 1 -- 172.21.15.80:0/4039622928 >> 172.21.15.80:0/4039622928 conn(0x7fc828061d20 msgr2=0x7fc8280641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:12.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.154+0000 7fc8301a5700 1 Processor -- start 2019-11-28T11:33:12.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.154+0000 7fc8301a5700 1 -- start start 2019-11-28T11:33:12.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.155+0000 7fc8301a5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc82812c2a0 0x7fc82812c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:12.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.155+0000 7fc8301a5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82810a310 con 0x7fc8281510e0 2019-11-28T11:33:12.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.155+0000 7fc8301a5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc828109e50 con 0x7fc828108630 2019-11-28T11:33:12.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.155+0000 7fc8301a5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82812ee80 con 0x7fc82812c2a0 2019-11-28T11:33:12.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.155+0000 7fc82df41700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc82812c2a0 0x7fc82812c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:12.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.155+0000 7fc82df41700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc82812c2a0 0x7fc82812c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35840/0 (socket says 172.21.15.80:35840) 2019-11-28T11:33:12.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.155+0000 7fc82ef43700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc8281510e0 0x7fc828151560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35158/0 (socket says 172.21.15.80:35158) 2019-11-28T11:33:12.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.155+0000 7fc82df41700 1 -- 172.21.15.80:0/3273305348 learned_addr learned my addr 172.21.15.80:0/3273305348 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:12.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.155+0000 7fc82df41700 1 -- 172.21.15.80:0/3273305348 >> v1:172.21.15.174:6789/0 conn(0x7fc828108630 legacy=0x7fc828152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:12.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.155+0000 7fc82df41700 1 -- 172.21.15.80:0/3273305348 >> v1:172.21.15.80:6789/0 conn(0x7fc8281510e0 legacy=0x7fc828151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:12.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.155+0000 7fc82df41700 1 -- 172.21.15.80:0/3273305348 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828133350 con 0x7fc82812c2a0 2019-11-28T11:33:12.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.155+0000 7fc81effd700 1 -- 172.21.15.80:0/3273305348 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457031168 0 0) 0x7fc8200020f0 con 0x7fc8281510e0 2019-11-28T11:33:12.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.155+0000 7fc82df41700 1 --2- 172.21.15.80:0/3273305348 >> v2:172.21.15.80:3300/0 conn(0x7fc82812c2a0 0x7fc82812c730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc8240107c0 tx=0x7fc824010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.155+0000 7fc82df41700 1 --2- 172.21.15.80:0/3273305348 >> v2:172.21.15.80:3300/0 conn(0x7fc82812c2a0 0x7fc82812c730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc8240107c0 tx=0x7fc824010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.155+0000 7fc82df41700 1 --2- 172.21.15.80:0/3273305348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82812c2a0 0x7fc82812c730 secure :-1 s=READY pgs=949 cs=0 l=1 rx=0x7fc8240107c0 tx=0x7fc824010b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:12.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.156+0000 7fc82df41700 1 --2- 172.21.15.80:0/3273305348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82812c2a0 0x7fc82812c730 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fc8240107c0 tx=0x7fc824010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.156+0000 7fc81effd700 1 -- 172.21.15.80:0/3273305348 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc824000cc0 con 0x7fc82812c2a0 2019-11-28T11:33:12.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.156+0000 7fc82df41700 1 --2- 172.21.15.80:0/3273305348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82812c2a0 0x7fc82812c730 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fc8240107c0 tx=0x7fc824010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.156+0000 7fc82df41700 1 --2- 172.21.15.80:0/3273305348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82812c2a0 0x7fc82812c730 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fc8240107c0 tx=0x7fc824010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.156+0000 7fc81effd700 1 -- 172.21.15.80:0/3273305348 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8240045c0 con 0x7fc82812c2a0 2019-11-28T11:33:12.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.156+0000 7fc8301a5700 1 -- 172.21.15.80:0/3273305348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8281336d0 con 0x7fc82812c2a0 2019-11-28T11:33:12.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.156+0000 7fc81effd700 1 -- 172.21.15.80:0/3273305348 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc824004c90 con 0x7fc82812c2a0 2019-11-28T11:33:12.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.156+0000 7fc8301a5700 1 -- 172.21.15.80:0/3273305348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc828133350 con 0x7fc82812c2a0 2019-11-28T11:33:12.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.156+0000 7fc82df41700 1 --2- 172.21.15.80:0/3273305348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82812c2a0 0x7fc82812c730 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fc8240107c0 tx=0x7fc824010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.156+0000 7fc81effd700 1 -- 172.21.15.80:0/3273305348 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc824001010 con 0x7fc82812c2a0 2019-11-28T11:33:12.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.156+0000 7fc82df41700 1 --2- 172.21.15.80:0/3273305348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82812c2a0 0x7fc82812c730 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fc8240107c0 tx=0x7fc824010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.156+0000 7fc81effd700 1 --2- 172.21.15.80:0/3273305348 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc810018730 0x7fc81001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:12.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.156+0000 7fc81effd700 1 -- 172.21.15.80:0/3273305348 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc824031f00 con 0x7fc82812c2a0 2019-11-28T11:33:12.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.157+0000 7fc82e742700 1 --2- 172.21.15.80:0/3273305348 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc810018730 0x7fc81001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:12.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.157+0000 7fc82e742700 1 --2- 172.21.15.80:0/3273305348 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc810018730 0x7fc81001abc0 crc :-1 s=READY pgs=389 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:12.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.164+0000 7fc8301a5700 1 -- 172.21.15.80:0/3273305348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8281336d0 con 0x7fc82812c2a0 2019-11-28T11:33:12.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.167+0000 7fc82df41700 1 --2- 172.21.15.80:0/3273305348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82812c2a0 0x7fc82812c730 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fc8240107c0 tx=0x7fc824010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.167+0000 7fc81effd700 1 -- 172.21.15.80:0/3273305348 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc824027f30 con 0x7fc82812c2a0 2019-11-28T11:33:12.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.336+0000 7fc8301a5700 1 -- 172.21.15.80:0/3273305348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fc828133350 con 0x7fc82812c2a0 2019-11-28T11:33:12.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.337+0000 7fc82df41700 1 --2- 172.21.15.80:0/3273305348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82812c2a0 0x7fc82812c730 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fc8240107c0 tx=0x7fc824010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.337+0000 7fc81effd700 1 -- 172.21.15.80:0/3273305348 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v78) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc824027f30 con 0x7fc82812c2a0 2019-11-28T11:33:12.385 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:33:12.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.339+0000 7fc8301a5700 1 -- 172.21.15.80:0/3273305348 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc810018730 msgr2=0x7fc81001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:12.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.339+0000 7fc8301a5700 1 --2- 172.21.15.80:0/3273305348 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc810018730 0x7fc81001abc0 crc :-1 s=READY pgs=389 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:12.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.339+0000 7fc8301a5700 1 -- 172.21.15.80:0/3273305348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82812c2a0 msgr2=0x7fc82812c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:12.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.339+0000 7fc8301a5700 1 --2- 172.21.15.80:0/3273305348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82812c2a0 0x7fc82812c730 secure :-1 s=READY pgs=949 cs=0 l=1 rx=0x7fc8240107c0 tx=0x7fc824010b60).stop 2019-11-28T11:33:12.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.339+0000 7fc8301a5700 1 -- 172.21.15.80:0/3273305348 shutdown_connections 2019-11-28T11:33:12.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.339+0000 7fc8301a5700 1 --2- 172.21.15.80:0/3273305348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc82812c2a0 0x7fc82812c730 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.339+0000 7fc8301a5700 1 --2- 172.21.15.80:0/3273305348 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc810018730 0x7fc81001abc0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.339+0000 7fc8301a5700 1 -- 172.21.15.80:0/3273305348 shutdown_connections 2019-11-28T11:33:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.339+0000 7fc8301a5700 1 -- 172.21.15.80:0/3273305348 wait complete. 2019-11-28T11:33:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.339+0000 7fc8301a5700 1 -- 172.21.15.80:0/3273305348 >> 172.21.15.80:0/3273305348 conn(0x7fc82814dbb0 msgr2=0x7fc828142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:12.394 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:33:12.394 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:33:12.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.468+0000 7eff4fd68700 1 Processor -- start 2019-11-28T11:33:12.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.468+0000 7eff4fd68700 1 -- start start 2019-11-28T11:33:12.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4fd68700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff4806c0a0 0x7eff48072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:12.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4fd68700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7eff480734e0 0x7eff48071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:12.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4fd68700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff48072360 0x7eff480727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:12.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4fd68700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4806f330 con 0x7eff48072360 2019-11-28T11:33:12.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4fd68700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff480706c0 con 0x7eff480734e0 2019-11-28T11:33:12.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4fd68700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff48070a40 con 0x7eff4806c0a0 2019-11-28T11:33:12.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4eb06700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff48072360 0x7eff480727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:12.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4eb06700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff48072360 0x7eff480727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35848/0 (socket says 172.21.15.80:35848) 2019-11-28T11:33:12.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4eb06700 1 -- 172.21.15.80:0/29195269 learned_addr learned my addr 172.21.15.80:0/29195269 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:12.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4db04700 1 --2- 172.21.15.80:0/29195269 >> v2:172.21.15.174:3300/0 conn(0x7eff480734e0 0x7eff48071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:12.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4e305700 1 --2- 172.21.15.80:0/29195269 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff4806c0a0 0x7eff48072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:12.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4eb06700 1 -- 172.21.15.80:0/29195269 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff4806c0a0 msgr2=0x7eff48072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:12.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4eb06700 1 --2- 172.21.15.80:0/29195269 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff4806c0a0 0x7eff48072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:12.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4eb06700 1 -- 172.21.15.80:0/29195269 >> v2:172.21.15.174:3300/0 conn(0x7eff480734e0 msgr2=0x7eff48071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:12.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4eb06700 1 --2- 172.21.15.80:0/29195269 >> v2:172.21.15.174:3300/0 conn(0x7eff480734e0 0x7eff48071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:12.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4eb06700 1 -- 172.21.15.80:0/29195269 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4806db00 con 0x7eff48072360 2019-11-28T11:33:12.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.469+0000 7eff4eb06700 1 --2- 172.21.15.80:0/29195269 >> v2:172.21.15.80:3300/0 conn(0x7eff48072360 0x7eff480727e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7eff4000f6b0 tx=0x7eff40007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.470+0000 7eff4eb06700 1 --2- 172.21.15.80:0/29195269 >> v2:172.21.15.80:3300/0 conn(0x7eff48072360 0x7eff480727e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7eff4000f6b0 tx=0x7eff40007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.470+0000 7eff4eb06700 1 --2- 172.21.15.80:0/29195269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff48072360 0x7eff480727e0 secure :-1 s=READY pgs=950 cs=0 l=1 rx=0x7eff4000f6b0 tx=0x7eff40007d50).ready entity=mon.0 client_cookie=89b7c8665aaeb9f0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:12.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.470+0000 7eff4eb06700 1 --2- 172.21.15.80:0/29195269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff48072360 0x7eff480727e0 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7eff4000f6b0 tx=0x7eff40007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.470+0000 7eff4eb06700 1 --2- 172.21.15.80:0/29195269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff48072360 0x7eff480727e0 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7eff4000f6b0 tx=0x7eff40007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.470+0000 7eff4d303700 1 -- 172.21.15.80:0/29195269 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff40000a70 con 0x7eff48072360 2019-11-28T11:33:12.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.470+0000 7eff4eb06700 1 --2- 172.21.15.80:0/29195269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff48072360 0x7eff480727e0 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7eff4000f6b0 tx=0x7eff40007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.470+0000 7eff4d303700 1 -- 172.21.15.80:0/29195269 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff400010e0 con 0x7eff48072360 2019-11-28T11:33:12.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.470+0000 7eff4d303700 1 -- 172.21.15.80:0/29195269 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff40001830 con 0x7eff48072360 2019-11-28T11:33:12.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.470+0000 7eff4fd68700 1 -- 172.21.15.80:0/29195269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff48072360 msgr2=0x7eff480727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:12.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.470+0000 7eff4fd68700 1 --2- 172.21.15.80:0/29195269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff48072360 0x7eff480727e0 secure :-1 s=READY pgs=950 cs=0 l=1 rx=0x7eff4000f6b0 tx=0x7eff40007d50).stop 2019-11-28T11:33:12.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.471+0000 7eff4fd68700 1 -- 172.21.15.80:0/29195269 shutdown_connections 2019-11-28T11:33:12.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.471+0000 7eff4fd68700 1 --2- 172.21.15.80:0/29195269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff48072360 0x7eff480727e0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:12.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.471+0000 7eff4fd68700 1 --2- 172.21.15.80:0/29195269 >> v2:172.21.15.174:3300/0 conn(0x7eff480734e0 0x7eff48071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:12.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.471+0000 7eff4fd68700 1 --2- 172.21.15.80:0/29195269 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff4806c0a0 0x7eff48072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:12.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.471+0000 7eff4fd68700 1 -- 172.21.15.80:0/29195269 shutdown_connections 2019-11-28T11:33:12.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.471+0000 7eff4fd68700 1 -- 172.21.15.80:0/29195269 wait complete. 2019-11-28T11:33:12.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.471+0000 7eff4fd68700 1 -- 172.21.15.80:0/29195269 >> 172.21.15.80:0/29195269 conn(0x7eff48061cf0 msgr2=0x7eff48064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:12.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.473+0000 7eff4fd68700 1 Processor -- start 2019-11-28T11:33:12.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.473+0000 7eff4fd68700 1 -- start start 2019-11-28T11:33:12.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.474+0000 7eff4fd68700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff48166a10 0x7eff48168e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:12.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.474+0000 7eff4fd68700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4813bcd0 con 0x7eff48104820 2019-11-28T11:33:12.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.474+0000 7eff4fd68700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff48105ea0 con 0x7eff48104c10 2019-11-28T11:33:12.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.474+0000 7eff4fd68700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff48109130 con 0x7eff48166a10 2019-11-28T11:33:12.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.474+0000 7eff4e305700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7eff48104820 0x7eff4810c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35168/0 (socket says 172.21.15.80:35168) 2019-11-28T11:33:12.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.474+0000 7eff4e305700 1 -- 172.21.15.80:0/130655394 learned_addr learned my addr 172.21.15.80:0/130655394 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:12.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.474+0000 7eff4eb06700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff48166a10 0x7eff48168e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:12.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.474+0000 7eff46ffd700 1 -- 172.21.15.80:0/130655394 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012958360 0 0) 0x7eff30001330 con 0x7eff48104820 2019-11-28T11:33:12.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.474+0000 7eff46ffd700 1 -- 172.21.15.80:0/130655394 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff2c002e80 con 0x7eff48104820 2019-11-28T11:33:12.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.474+0000 7eff46ffd700 1 -- 172.21.15.80:0/130655394 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913317267 0 0) 0x7eff38000f30 con 0x7eff48104c10 2019-11-28T11:33:12.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.474+0000 7eff46ffd700 1 -- 172.21.15.80:0/130655394 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff2c0030b0 con 0x7eff48104c10 2019-11-28T11:33:12.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.474+0000 7eff4eb06700 1 -- 172.21.15.80:0/130655394 >> v1:172.21.15.174:6789/0 conn(0x7eff48104c10 legacy=0x7eff481050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:12.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff4eb06700 1 -- 172.21.15.80:0/130655394 >> v1:172.21.15.80:6789/0 conn(0x7eff48104820 legacy=0x7eff4810c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:12.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff46ffd700 1 -- 172.21.15.80:0/130655394 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1651080647 0 0) 0x7eff300014c0 con 0x7eff48104820 2019-11-28T11:33:12.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff4eb06700 1 -- 172.21.15.80:0/130655394 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff48109a90 con 0x7eff48166a10 2019-11-28T11:33:12.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff4eb06700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff48166a10 0x7eff48168e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff400543b0 tx=0x7eff40054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff4eb06700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff48166a10 0x7eff48168e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff400543b0 tx=0x7eff40054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff4eb06700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff48166a10 0x7eff48168e10 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7eff400543b0 tx=0x7eff40054750).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:12.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff4eb06700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff48166a10 0x7eff48168e10 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7eff400543b0 tx=0x7eff40054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff46ffd700 1 -- 172.21.15.80:0/130655394 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff40008180 con 0x7eff48166a10 2019-11-28T11:33:12.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff4eb06700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff48166a10 0x7eff48168e10 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7eff400543b0 tx=0x7eff40054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff46ffd700 1 -- 172.21.15.80:0/130655394 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff400010c0 con 0x7eff48166a10 2019-11-28T11:33:12.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff4eb06700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff48166a10 0x7eff48168e10 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7eff400543b0 tx=0x7eff40054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff4fd68700 1 -- 172.21.15.80:0/130655394 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff48109e10 con 0x7eff48166a10 2019-11-28T11:33:12.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff46ffd700 1 -- 172.21.15.80:0/130655394 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff40000ba0 con 0x7eff48166a10 2019-11-28T11:33:12.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff4fd68700 1 -- 172.21.15.80:0/130655394 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff48109a90 con 0x7eff48166a10 2019-11-28T11:33:12.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff4eb06700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff48166a10 0x7eff48168e10 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7eff400543b0 tx=0x7eff40054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff46ffd700 1 -- 172.21.15.80:0/130655394 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7eff400012b0 con 0x7eff48166a10 2019-11-28T11:33:12.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.475+0000 7eff4eb06700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff48166a10 0x7eff48168e10 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7eff400543b0 tx=0x7eff40054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.476+0000 7eff46ffd700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff2c018750 0x7eff2c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:12.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.476+0000 7eff46ffd700 1 -- 172.21.15.80:0/130655394 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7eff40075aa0 con 0x7eff48166a10 2019-11-28T11:33:12.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.476+0000 7eff4e305700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff2c018750 0x7eff2c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:12.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.476+0000 7eff4e305700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff2c018750 0x7eff2c01abe0 crc :-1 s=READY pgs=390 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:12.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.483+0000 7eff4fd68700 1 -- 172.21.15.80:0/130655394 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff48109e10 con 0x7eff48166a10 2019-11-28T11:33:12.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.487+0000 7eff4eb06700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff48166a10 0x7eff48168e10 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7eff400543b0 tx=0x7eff40054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.487+0000 7eff46ffd700 1 -- 172.21.15.80:0/130655394 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7eff40000eb0 con 0x7eff48166a10 2019-11-28T11:33:12.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.658+0000 7eff4fd68700 1 -- 172.21.15.80:0/130655394 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff48109a90 con 0x7eff48166a10 2019-11-28T11:33:12.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.658+0000 7eff4eb06700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff48166a10 0x7eff48168e10 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7eff400543b0 tx=0x7eff40054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:12.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.659+0000 7eff46ffd700 1 -- 172.21.15.80:0/130655394 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+2448 (secure 0 0 0) 0x7eff400012b0 con 0x7eff48166a10 2019-11-28T11:33:12.704 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 46 2019-11-28T11:33:12.704 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:33:12.705 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/3314051014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3314051014},{"type":"v1","addr":"172.21.15.80:6833","nonce":3314051014}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":44},{"gid":6693,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/2096906665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2096906665},{"type":"v1","addr":"172.21.15.80:6835","nonce":2096906665}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:33:06.645749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5390":{"gid":5390,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/3402343468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3402343468},{"type":"v1","addr":"172.21.15.174:6835","nonce":3402343468}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:33:12.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.661+0000 7eff4fd68700 1 -- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff2c018750 msgr2=0x7eff2c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:12.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.661+0000 7eff4fd68700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff2c018750 0x7eff2c01abe0 crc :-1 s=READY pgs=390 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:12.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.661+0000 7eff4fd68700 1 -- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff48166a10 msgr2=0x7eff48168e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:12.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.661+0000 7eff4fd68700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff48166a10 0x7eff48168e10 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7eff400543b0 tx=0x7eff40054750).stop 2019-11-28T11:33:12.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.661+0000 7eff4fd68700 1 -- 172.21.15.80:0/130655394 shutdown_connections 2019-11-28T11:33:12.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.661+0000 7eff4fd68700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff48166a10 0x7eff48168e10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:12.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.661+0000 7eff4fd68700 1 --2- 172.21.15.80:0/130655394 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff2c018750 0x7eff2c01abe0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:12.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.661+0000 7eff4fd68700 1 -- 172.21.15.80:0/130655394 shutdown_connections 2019-11-28T11:33:12.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.661+0000 7eff4fd68700 1 -- 172.21.15.80:0/130655394 wait complete. 2019-11-28T11:33:12.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:12.661+0000 7eff4fd68700 1 -- 172.21.15.80:0/130655394 >> 172.21.15.80:0/130655394 conn(0x7eff4813d620 msgr2=0x7eff4813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:13.018 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5390}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 12, u'failed': [], u'epoch': 46, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [13], u'info': {u'gid_5390': {u'export_targets': [], u'name': u'c', u'incarnation': 45, u'state_seq': 3, u'state': u'up:active', u'gid': 5390, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3402343468, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 3402343468, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/3402343468'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:32:59.044350+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:33:06.645749+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:33:13.018 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:33:13.019 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:33:13.144 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:33:13.145 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:33:13.145 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:33:13.145 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5390, 2019-11-28T11:33:13.145 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:33:13.145 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:33:13.145 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 7.455513185, 2019-11-28T11:33:13.146 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 46, 2019-11-28T11:33:13.146 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 78, 2019-11-28T11:33:13.146 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 78, 2019-11-28T11:33:13.146 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 11.692859434000001 2019-11-28T11:33:13.146 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:33:13.150 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5390, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.455513185, "mdsmap_epoch": 46, "osdmap_epoch": 78, "osdmap_epoch_barrier": 78, "uptime": 11.692859434000001 } 2019-11-28T11:33:13.151 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:33:13.151 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:33:13.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:33:13.151 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:33:13.223 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:33:13.223 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:33:13.346 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:33:13.346 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:33:13.346 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:33:13.346 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:33:13.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:33:13.347 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:33:13.429 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:33:13.553 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:33:13.554 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:33:13.554 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:33:13.560 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:33:13.560 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:33:13.682 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:33:13.683 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:33:13.683 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:33:13.688 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:33:13.689 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:33:13.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:33:13.689 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:33:13.764 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:33:13.777 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:33:13.815 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits daemon-helper kill python -c ' 2019-11-28T11:33:13.815 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:33:13.815 INFO:teuthology.orchestra.run.smithi076:> import time 2019-11-28T11:33:13.815 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:33:13.815 INFO:teuthology.orchestra.run.smithi076:> path = "/home/ubuntu/cephtest/mnt.0/subdir" 2019-11-28T11:33:13.815 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:33:13.815 INFO:teuthology.orchestra.run.smithi076:> print("Starting creation...") 2019-11-28T11:33:13.816 INFO:teuthology.orchestra.run.smithi076:> start = time.time() 2019-11-28T11:33:13.816 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:33:13.816 INFO:teuthology.orchestra.run.smithi076:> os.mkdir(path) 2019-11-28T11:33:13.816 INFO:teuthology.orchestra.run.smithi076:> dfd = os.open(path, os.O_DIRECTORY) 2019-11-28T11:33:13.816 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:33:13.816 INFO:teuthology.orchestra.run.smithi076:> fd = open(os.path.join(path, "childfile"), "w") 2019-11-28T11:33:13.816 INFO:teuthology.orchestra.run.smithi076:> print("Finished creation in {0}s".format(time.time() - start)) 2019-11-28T11:33:13.817 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:33:13.817 INFO:teuthology.orchestra.run.smithi076:> print("Starting fsync...") 2019-11-28T11:33:13.817 INFO:teuthology.orchestra.run.smithi076:> start = time.time() 2019-11-28T11:33:13.817 INFO:teuthology.orchestra.run.smithi076:> if False: 2019-11-28T11:33:13.817 INFO:teuthology.orchestra.run.smithi076:> os.fsync(dfd) 2019-11-28T11:33:13.817 INFO:teuthology.orchestra.run.smithi076:> else: 2019-11-28T11:33:13.817 INFO:teuthology.orchestra.run.smithi076:> os.fsync(fd) 2019-11-28T11:33:13.817 INFO:teuthology.orchestra.run.smithi076:> print("Finished fsync in {0}s".format(time.time() - start)) 2019-11-28T11:33:13.818 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:33:16.456 INFO:teuthology.orchestra.run.smithi076.stdout:Starting creation... 2019-11-28T11:33:16.456 INFO:teuthology.orchestra.run.smithi076.stdout:Finished creation in 0.0046329498291s 2019-11-28T11:33:16.456 INFO:teuthology.orchestra.run.smithi076.stdout:Starting fsync... 2019-11-28T11:33:16.456 INFO:teuthology.orchestra.run.smithi076.stdout:Finished fsync in 2.53730082512s 2019-11-28T11:33:16.514 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:33:16.514 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:33:16.514 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:33:16.515 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:33:16.515 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:33:16.515 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:33:16.519 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:33:16.520 DEBUG:teuthology.parallel:result is None 2019-11-28T11:33:16.521 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:33:16.521 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:33:16.522 DEBUG:teuthology.parallel:result is None 2019-11-28T11:33:16.522 DEBUG:teuthology.parallel:result is None 2019-11-28T11:33:16.522 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:33:16.523 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:33:16.523 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:33:16.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.683+0000 7efc8350b700 1 Processor -- start 2019-11-28T11:33:16.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.684+0000 7efc8350b700 1 -- start start 2019-11-28T11:33:16.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.684+0000 7efc8350b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc7c06c490 0x7efc7c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:16.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.684+0000 7efc8350b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc7c06ce60 0x7efc7c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:16.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc8350b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7c06db00 con 0x7efc7c06c0a0 2019-11-28T11:33:16.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc8350b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7c06fd60 con 0x7efc7c06ce60 2019-11-28T11:33:16.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc8350b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c070030 con 0x7efc7c06c490 2019-11-28T11:33:16.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc822a9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc7c06ce60 0x7efc7c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:16.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc822a9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc7c06ce60 0x7efc7c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35864/0 (socket says 172.21.15.80:35864) 2019-11-28T11:33:16.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc822a9700 1 -- 172.21.15.80:0/1832880338 learned_addr learned my addr 172.21.15.80:0/1832880338 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:16.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc812a7700 1 --2- 172.21.15.80:0/1832880338 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc7c06c490 0x7efc7c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:16.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc822a9700 1 -- 172.21.15.80:0/1832880338 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc7c06c490 msgr2=0x7efc7c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:33:16.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc822a9700 1 --2- 172.21.15.80:0/1832880338 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc7c06c490 0x7efc7c06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:16.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc822a9700 1 -- 172.21.15.80:0/1832880338 >> v1:172.21.15.174:6789/0 conn(0x7efc7c06c0a0 legacy=0x7efc7c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:16.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc80aa6700 1 -- 172.21.15.80:0/1832880338 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549167188 0 0) 0x7efc74001400 con 0x7efc7c06c0a0 2019-11-28T11:33:16.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc822a9700 1 -- 172.21.15.80:0/1832880338 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c0706c0 con 0x7efc7c06ce60 2019-11-28T11:33:16.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc822a9700 1 --2- 172.21.15.80:0/1832880338 >> v2:172.21.15.80:3300/0 conn(0x7efc7c06ce60 0x7efc7c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efc7800f6b0 tx=0x7efc7800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc822a9700 1 --2- 172.21.15.80:0/1832880338 >> v2:172.21.15.80:3300/0 conn(0x7efc7c06ce60 0x7efc7c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efc7800f6b0 tx=0x7efc7800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc822a9700 1 --2- 172.21.15.80:0/1832880338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c06ce60 0x7efc7c164d70 secure :-1 s=READY pgs=952 cs=0 l=1 rx=0x7efc7800f6b0 tx=0x7efc7800fa50).ready entity=mon.0 client_cookie=5a818d50f4c4afd9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:16.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc822a9700 1 --2- 172.21.15.80:0/1832880338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c06ce60 0x7efc7c164d70 secure :-1 s=THROTTLE_DONE pgs=952 cs=0 l=1 rx=0x7efc7800f6b0 tx=0x7efc7800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc80aa6700 1 -- 172.21.15.80:0/1832880338 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc780010e0 con 0x7efc7c06ce60 2019-11-28T11:33:16.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc822a9700 1 --2- 172.21.15.80:0/1832880338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c06ce60 0x7efc7c164d70 secure :-1 s=THROTTLE_DONE pgs=952 cs=0 l=1 rx=0x7efc7800f6b0 tx=0x7efc7800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc80aa6700 1 -- 172.21.15.80:0/1832880338 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc78000a70 con 0x7efc7c06ce60 2019-11-28T11:33:16.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc822a9700 1 --2- 172.21.15.80:0/1832880338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c06ce60 0x7efc7c164d70 secure :-1 s=THROTTLE_DONE pgs=952 cs=0 l=1 rx=0x7efc7800f6b0 tx=0x7efc7800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc80aa6700 1 -- 172.21.15.80:0/1832880338 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc780012d0 con 0x7efc7c06ce60 2019-11-28T11:33:16.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc8350b700 1 -- 172.21.15.80:0/1832880338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c06ce60 msgr2=0x7efc7c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:16.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.685+0000 7efc8350b700 1 --2- 172.21.15.80:0/1832880338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c06ce60 0x7efc7c164d70 secure :-1 s=READY pgs=952 cs=0 l=1 rx=0x7efc7800f6b0 tx=0x7efc7800fa50).stop 2019-11-28T11:33:16.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.686+0000 7efc8350b700 1 -- 172.21.15.80:0/1832880338 shutdown_connections 2019-11-28T11:33:16.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.686+0000 7efc8350b700 1 --2- 172.21.15.80:0/1832880338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c06ce60 0x7efc7c164d70 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:16.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.686+0000 7efc8350b700 1 --2- 172.21.15.80:0/1832880338 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc7c06c490 0x7efc7c06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:33:16.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.686+0000 7efc8350b700 1 -- 172.21.15.80:0/1832880338 shutdown_connections 2019-11-28T11:33:16.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.686+0000 7efc8350b700 1 -- 172.21.15.80:0/1832880338 wait complete. 2019-11-28T11:33:16.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.686+0000 7efc8350b700 1 -- 172.21.15.80:0/1832880338 >> 172.21.15.80:0/1832880338 conn(0x7efc7c061cf0 msgr2=0x7efc7c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:16.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.689+0000 7efc8350b700 1 Processor -- start 2019-11-28T11:33:16.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.689+0000 7efc8350b700 1 -- start start 2019-11-28T11:33:16.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.689+0000 7efc8350b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc7c13a780 0x7efc7c12d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:16.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc8350b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc7c12cb00 0x7efc7c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:16.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc8350b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7c139a60 con 0x7efc7c12d9c0 2019-11-28T11:33:16.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc8350b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7c129830 con 0x7efc7c12cb00 2019-11-28T11:33:16.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc8350b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c12a260 con 0x7efc7c13a780 2019-11-28T11:33:16.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc822a9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc7c12cb00 0x7efc7c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:16.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc822a9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc7c12cb00 0x7efc7c167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35870/0 (socket says 172.21.15.80:35870) 2019-11-28T11:33:16.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc81aa8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc7c13a780 0x7efc7c12d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:16.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc822a9700 1 -- 172.21.15.80:0/1682291836 learned_addr learned my addr 172.21.15.80:0/1682291836 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:16.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc822a9700 1 -- 172.21.15.80:0/1682291836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc7c13a780 msgr2=0x7efc7c12d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:16.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc822a9700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc7c13a780 0x7efc7c12d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:16.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc822a9700 1 -- 172.21.15.80:0/1682291836 >> v1:172.21.15.174:6789/0 conn(0x7efc7c12d9c0 legacy=0x7efc7c12c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:16.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc822a9700 1 -- 172.21.15.80:0/1682291836 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c12abc0 con 0x7efc7c12cb00 2019-11-28T11:33:16.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc81aa8700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc7c13a780 0x7efc7c12d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:33:16.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc822a9700 1 --2- 172.21.15.80:0/1682291836 >> v2:172.21.15.80:3300/0 conn(0x7efc7c12cb00 0x7efc7c167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc78054460 tx=0x7efc78054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc822a9700 1 --2- 172.21.15.80:0/1682291836 >> v2:172.21.15.80:3300/0 conn(0x7efc7c12cb00 0x7efc7c167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc78054460 tx=0x7efc78054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc822a9700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c12cb00 0x7efc7c167d70 secure :-1 s=READY pgs=953 cs=0 l=1 rx=0x7efc78054460 tx=0x7efc78054800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:16.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc822a9700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c12cb00 0x7efc7c167d70 secure :-1 s=THROTTLE_DONE pgs=953 cs=0 l=1 rx=0x7efc78054460 tx=0x7efc78054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc822a9700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c12cb00 0x7efc7c167d70 secure :-1 s=THROTTLE_DONE pgs=953 cs=0 l=1 rx=0x7efc78054460 tx=0x7efc78054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7efc822a9700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c12cb00 0x7efc7c167d70 secure :-1 s=THROTTLE_DONE pgs=953 cs=0 l=1 rx=0x7efc78054460 tx=0x7efc78054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.691+0000 7efc6e7fc700 1 -- 172.21.15.80:0/1682291836 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc78001590 con 0x7efc7c12cb00 2019-11-28T11:33:16.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.691+0000 7efc6e7fc700 1 -- 172.21.15.80:0/1682291836 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc780011b0 con 0x7efc7c12cb00 2019-11-28T11:33:16.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.691+0000 7efc8350b700 1 -- 172.21.15.80:0/1682291836 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7c12af40 con 0x7efc7c12cb00 2019-11-28T11:33:16.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.691+0000 7efc6e7fc700 1 -- 172.21.15.80:0/1682291836 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc78001cf0 con 0x7efc7c12cb00 2019-11-28T11:33:16.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.691+0000 7efc8350b700 1 -- 172.21.15.80:0/1682291836 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7c12abc0 con 0x7efc7c12cb00 2019-11-28T11:33:16.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7efc822a9700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c12cb00 0x7efc7c167d70 secure :-1 s=THROTTLE_DONE pgs=953 cs=0 l=1 rx=0x7efc78054460 tx=0x7efc78054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7efc6e7fc700 1 -- 172.21.15.80:0/1682291836 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efc780010c0 con 0x7efc7c12cb00 2019-11-28T11:33:16.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7efc822a9700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c12cb00 0x7efc7c167d70 secure :-1 s=THROTTLE_DONE pgs=953 cs=0 l=1 rx=0x7efc78054460 tx=0x7efc78054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7efc6e7fc700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc64018730 0x7efc6401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:16.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7efc6e7fc700 1 -- 172.21.15.80:0/1682291836 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7efc78075b00 con 0x7efc7c12cb00 2019-11-28T11:33:16.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7efc81aa8700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc64018730 0x7efc6401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:16.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7efc81aa8700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc64018730 0x7efc6401abc0 crc :-1 s=READY pgs=391 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:16.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7f2522da4700 1 Processor -- start 2019-11-28T11:33:16.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.690+0000 7f2522da4700 1 -- start start 2019-11-28T11:33:16.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.691+0000 7f2522da4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f251c06d120 0x7f251c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:16.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.691+0000 7f2522da4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c06d5a0 con 0x7f251c06c0a0 2019-11-28T11:33:16.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.691+0000 7f2522da4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c06db00 con 0x7f251c06c490 2019-11-28T11:33:16.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.691+0000 7f2522da4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251c06fd60 con 0x7f251c06d120 2019-11-28T11:33:16.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.691+0000 7f2521341700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f251c06c0a0 0x7f251c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35190/0 (socket says 172.21.15.80:35190) 2019-11-28T11:33:16.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.691+0000 7f2521341700 1 -- 172.21.15.80:0/3611263486 learned_addr learned my addr 172.21.15.80:0/3611263486 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:16.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.691+0000 7f2521b42700 1 --2- 172.21.15.80:0/3611263486 >> v2:172.21.15.174:3300/0 conn(0x7f251c06d120 0x7f251c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:16.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.691+0000 7f2513fff700 1 -- 172.21.15.80:0/3611263486 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949307871 0 0) 0x7f2518001150 con 0x7f251c06c0a0 2019-11-28T11:33:16.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.691+0000 7f2513fff700 1 -- 172.21.15.80:0/3611263486 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2508002e80 con 0x7f251c06c0a0 2019-11-28T11:33:16.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f2521b42700 1 -- 172.21.15.80:0/3611263486 >> v1:172.21.15.174:6789/0 conn(0x7f251c06c490 legacy=0x7f251c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:16.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f2521b42700 1 -- 172.21.15.80:0/3611263486 >> v1:172.21.15.80:6789/0 conn(0x7f251c06c0a0 legacy=0x7f251c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:16.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f2521b42700 1 -- 172.21.15.80:0/3611263486 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c0706c0 con 0x7f251c06d120 2019-11-28T11:33:16.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f2521b42700 1 --2- 172.21.15.80:0/3611263486 >> v2:172.21.15.174:3300/0 conn(0x7f251c06d120 0x7f251c165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f251400b300 tx=0x7f251400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f2521b42700 1 --2- 172.21.15.80:0/3611263486 >> v2:172.21.15.174:3300/0 conn(0x7f251c06d120 0x7f251c165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f251400b300 tx=0x7f251400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f2521b42700 1 --2- 172.21.15.80:0/3611263486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f251c06d120 0x7f251c165d80 secure :-1 s=READY pgs=573 cs=0 l=1 rx=0x7f251400b300 tx=0x7f251400bb10).ready entity=mon.1 client_cookie=df5e5103d4bbecc4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:16.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f2521b42700 1 --2- 172.21.15.80:0/3611263486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f251c06d120 0x7f251c165d80 secure :-1 s=THROTTLE_DONE pgs=573 cs=0 l=1 rx=0x7f251400b300 tx=0x7f251400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f2513fff700 1 -- 172.21.15.80:0/3611263486 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25140075c0 con 0x7f251c06d120 2019-11-28T11:33:16.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f2521b42700 1 --2- 172.21.15.80:0/3611263486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f251c06d120 0x7f251c165d80 secure :-1 s=THROTTLE_DONE pgs=573 cs=0 l=1 rx=0x7f251400b300 tx=0x7f251400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f2521b42700 1 --2- 172.21.15.80:0/3611263486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f251c06d120 0x7f251c165d80 secure :-1 s=THROTTLE_DONE pgs=573 cs=0 l=1 rx=0x7f251400b300 tx=0x7f251400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f2513fff700 1 -- 172.21.15.80:0/3611263486 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2514000f30 con 0x7f251c06d120 2019-11-28T11:33:16.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f2513fff700 1 -- 172.21.15.80:0/3611263486 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f251400a1e0 con 0x7f251c06d120 2019-11-28T11:33:16.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f2522da4700 1 -- 172.21.15.80:0/3611263486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f251c06d120 msgr2=0x7f251c165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:16.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f2522da4700 1 --2- 172.21.15.80:0/3611263486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f251c06d120 0x7f251c165d80 secure :-1 s=READY pgs=573 cs=0 l=1 rx=0x7f251400b300 tx=0x7f251400bb10).stop 2019-11-28T11:33:16.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f2522da4700 1 -- 172.21.15.80:0/3611263486 shutdown_connections 2019-11-28T11:33:16.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f2522da4700 1 --2- 172.21.15.80:0/3611263486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f251c06d120 0x7f251c165d80 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:16.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f2522da4700 1 -- 172.21.15.80:0/3611263486 shutdown_connections 2019-11-28T11:33:16.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f2522da4700 1 -- 172.21.15.80:0/3611263486 wait complete. 2019-11-28T11:33:16.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f2522da4700 1 -- 172.21.15.80:0/3611263486 >> 172.21.15.80:0/3611263486 conn(0x7f251c061cf0 msgr2=0x7f251c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:16.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.696+0000 7f2522da4700 1 Processor -- start 2019-11-28T11:33:16.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.696+0000 7f2522da4700 1 -- start start 2019-11-28T11:33:16.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2522da4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f251c12cea0 0x7f251c111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:16.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.691+0000 7f3f2f678700 1 Processor -- start 2019-11-28T11:33:16.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.691+0000 7f3f2f678700 1 -- start start 2019-11-28T11:33:16.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f3f2f678700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2806c0a0 0x7f3f28072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:33:16.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f3f2f678700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2806db00 con 0x7f3f280734e0 2019-11-28T11:33:16.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f3f2f678700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2806e000 con 0x7f3f28072620 2019-11-28T11:33:16.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f3f2f678700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2806f330 con 0x7f3f2806c0a0 2019-11-28T11:33:16.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f3f2d414700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3f280734e0 0x7f3f28071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35196/0 (socket says 172.21.15.80:35196) 2019-11-28T11:33:16.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f3f2d414700 1 -- 172.21.15.80:0/482219634 learned_addr learned my addr 172.21.15.80:0/482219634 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:33:16.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f3f2dc15700 1 --2- 172.21.15.80:0/482219634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2806c0a0 0x7f3f28072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:16.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f3f2cc13700 1 -- 172.21.15.80:0/482219634 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521399282 0 0) 0x7f3f1c001170 con 0x7f3f280734e0 2019-11-28T11:33:16.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.692+0000 7f3f2cc13700 1 -- 172.21.15.80:0/482219634 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f10002e80 con 0x7f3f280734e0 2019-11-28T11:33:16.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f3f2dc15700 1 -- 172.21.15.80:0/482219634 >> v1:172.21.15.174:6789/0 conn(0x7f3f28072620 legacy=0x7f3f28164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:16.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f3f2dc15700 1 -- 172.21.15.80:0/482219634 >> v1:172.21.15.80:6789/0 conn(0x7f3f280734e0 legacy=0x7f3f28071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:16.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f3f2dc15700 1 -- 172.21.15.80:0/482219634 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f280706c0 con 0x7f3f2806c0a0 2019-11-28T11:33:16.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f3f2dc15700 1 --2- 172.21.15.80:0/482219634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2806c0a0 0x7f3f28072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3f1800af50 tx=0x7f3f1800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f3f2dc15700 1 --2- 172.21.15.80:0/482219634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2806c0a0 0x7f3f28072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3f1800af50 tx=0x7f3f1800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f3f2dc15700 1 --2- 172.21.15.80:0/482219634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2806c0a0 0x7f3f28072fa0 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f3f1800af50 tx=0x7f3f1800b760).ready entity=mon.2 client_cookie=54ca2f2078909e77 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:16.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f3f2dc15700 1 --2- 172.21.15.80:0/482219634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2806c0a0 0x7f3f28072fa0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f3f1800af50 tx=0x7f3f1800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f3f2cc13700 1 -- 172.21.15.80:0/482219634 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f18000960 con 0x7f3f2806c0a0 2019-11-28T11:33:16.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f3f2dc15700 1 --2- 172.21.15.80:0/482219634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2806c0a0 0x7f3f28072fa0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f3f1800af50 tx=0x7f3f1800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f3f2dc15700 1 --2- 172.21.15.80:0/482219634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2806c0a0 0x7f3f28072fa0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f3f1800af50 tx=0x7f3f1800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f3f2cc13700 1 -- 172.21.15.80:0/482219634 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f18009860 con 0x7f3f2806c0a0 2019-11-28T11:33:16.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f3f2cc13700 1 -- 172.21.15.80:0/482219634 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f18009f30 con 0x7f3f2806c0a0 2019-11-28T11:33:16.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f3f2f678700 1 -- 172.21.15.80:0/482219634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2806c0a0 msgr2=0x7f3f28072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:16.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.693+0000 7f3f2f678700 1 --2- 172.21.15.80:0/482219634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2806c0a0 0x7f3f28072fa0 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f3f1800af50 tx=0x7f3f1800b760).stop 2019-11-28T11:33:16.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.694+0000 7f3f2f678700 1 -- 172.21.15.80:0/482219634 shutdown_connections 2019-11-28T11:33:16.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.694+0000 7f3f2f678700 1 --2- 172.21.15.80:0/482219634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2806c0a0 0x7f3f28072fa0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:16.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.694+0000 7f3f2f678700 1 -- 172.21.15.80:0/482219634 shutdown_connections 2019-11-28T11:33:16.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.694+0000 7f3f2f678700 1 -- 172.21.15.80:0/482219634 wait complete. 2019-11-28T11:33:16.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.694+0000 7f3f2f678700 1 -- 172.21.15.80:0/482219634 >> 172.21.15.80:0/482219634 conn(0x7f3f28061cf0 msgr2=0x7f3f28064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:16.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.696+0000 7f3f2f678700 1 Processor -- start 2019-11-28T11:33:16.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.696+0000 7f3f2f678700 1 -- start start 2019-11-28T11:33:16.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2522da4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f251c1230e0 0x7f251c123570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:16.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2522da4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f251c123ab0 0x7f251c12d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:16.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2522da4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251c121040 con 0x7f251c1230e0 2019-11-28T11:33:16.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2522da4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251c121310 con 0x7f251c12cea0 2019-11-28T11:33:16.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2522da4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c120610 con 0x7f251c123ab0 2019-11-28T11:33:16.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2520b40700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f251c1230e0 0x7f251c123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:16.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2521341700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f251c12cea0 0x7f251c111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:16.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2521b42700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f251c123ab0 0x7f251c12d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:16.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2521341700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f251c12cea0 0x7f251c111db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:50772/0 (socket says 172.21.15.80:50772) 2019-11-28T11:33:16.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2520b40700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f251c1230e0 0x7f251c123570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35890/0 (socket says 172.21.15.80:35890) 2019-11-28T11:33:16.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2521341700 1 -- 172.21.15.80:0/3298769032 learned_addr learned my addr 172.21.15.80:0/3298769032 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:16.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2521b42700 1 -- 172.21.15.80:0/3298769032 >> v2:172.21.15.174:3300/0 conn(0x7f251c12cea0 msgr2=0x7f251c111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:16.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2521b42700 1 --2- 172.21.15.80:0/3298769032 >> v2:172.21.15.174:3300/0 conn(0x7f251c12cea0 0x7f251c111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:16.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2521b42700 1 -- 172.21.15.80:0/3298769032 >> v2:172.21.15.80:3300/0 conn(0x7f251c1230e0 msgr2=0x7f251c123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:16.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2521b42700 1 --2- 172.21.15.80:0/3298769032 >> v2:172.21.15.80:3300/0 conn(0x7f251c1230e0 0x7f251c123570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:16.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2521b42700 1 -- 172.21.15.80:0/3298769032 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c1219a0 con 0x7f251c123ab0 2019-11-28T11:33:16.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2520b40700 1 --2- 172.21.15.80:0/3298769032 >> v2:172.21.15.80:3300/0 conn(0x7f251c1230e0 0x7f251c123570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:33:16.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2521b42700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f251c123ab0 0x7f251c12d290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2514010700 tx=0x7f2514010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2521b42700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f251c123ab0 0x7f251c12d290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2514010700 tx=0x7f2514010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f2521b42700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f251c123ab0 0x7f251c12d290 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7f2514010700 tx=0x7f2514010580).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:16.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f2521b42700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f251c123ab0 0x7f251c12d290 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f2514010700 tx=0x7f2514010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f2521b42700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f251c123ab0 0x7f251c12d290 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f2514010700 tx=0x7f2514010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f2521b42700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f251c123ab0 0x7f251c12d290 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f2514010700 tx=0x7f2514010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f2511ffb700 1 -- 172.21.15.80:0/3298769032 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f251400afd0 con 0x7f251c123ab0 2019-11-28T11:33:16.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f2511ffb700 1 -- 172.21.15.80:0/3298769032 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2514009b20 con 0x7f251c123ab0 2019-11-28T11:33:16.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f2511ffb700 1 -- 172.21.15.80:0/3298769032 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f251400a1f0 con 0x7f251c123ab0 2019-11-28T11:33:16.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f2522da4700 1 -- 172.21.15.80:0/3298769032 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251c121d20 con 0x7f251c123ab0 2019-11-28T11:33:16.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f2522da4700 1 -- 172.21.15.80:0/3298769032 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c1122f0 con 0x7f251c123ab0 2019-11-28T11:33:16.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f2521b42700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f251c123ab0 0x7f251c12d290 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f2514010700 tx=0x7f2514010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f2521b42700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f251c123ab0 0x7f251c12d290 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f2514010700 tx=0x7f2514010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.699+0000 7f2511ffb700 1 -- 172.21.15.80:0/3298769032 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2514009d10 con 0x7f251c123ab0 2019-11-28T11:33:16.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.699+0000 7f2511ffb700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f24fc018730 0x7f24fc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:16.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.699+0000 7f2511ffb700 1 -- 172.21.15.80:0/3298769032 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2514031f20 con 0x7f251c123ab0 2019-11-28T11:33:16.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.700+0000 7f2521341700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f24fc018730 0x7f24fc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:16.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.700+0000 7f2521341700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f24fc018730 0x7f24fc01abc0 crc :-1 s=READY pgs=393 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:16.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.705+0000 7f2522da4700 1 -- 172.21.15.80:0/3298769032 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c1219a0 con 0x7f251c123ab0 2019-11-28T11:33:16.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.709+0000 7f2521b42700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f251c123ab0 0x7f251c12d290 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f2514010700 tx=0x7f2514010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.709+0000 7f2511ffb700 1 -- 172.21.15.80:0/3298769032 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2514031c70 con 0x7f251c123ab0 2019-11-28T11:33:16.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f3f2f678700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3f28112fb0 0x7f3f28113440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:16.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f3f2f678700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f28113980 0x7f3f28168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:16.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f3f2f678700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f28113db0 con 0x7f3f2813f580 2019-11-28T11:33:16.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f3f2f678700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f281236b0 con 0x7f3f28112fb0 2019-11-28T11:33:16.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f3f2f678700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f28123980 con 0x7f3f28113980 2019-11-28T11:33:16.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f3f2d414700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3f28112fb0 0x7f3f28113440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:16.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f3f2d414700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3f28112fb0 0x7f3f28113440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35894/0 (socket says 172.21.15.80:35894) 2019-11-28T11:33:16.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f2d414700 1 -- 172.21.15.80:0/2971492608 learned_addr learned my addr 172.21.15.80:0/2971492608 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:33:16.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.697+0000 7f3f2dc15700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f3f2813f580 0x7f3f28114130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:50752/0 (socket says 172.21.15.80:50752) 2019-11-28T11:33:16.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f2e416700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f28113980 0x7f3f28168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:16.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f2d414700 1 -- 172.21.15.80:0/2971492608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f28113980 msgr2=0x7f3f28168a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:16.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f267fc700 1 -- 172.21.15.80:0/2971492608 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949070996 0 0) 0x7f3f18000940 con 0x7f3f2813f580 2019-11-28T11:33:16.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f2d414700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f28113980 0x7f3f28168a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:16.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f2d414700 1 -- 172.21.15.80:0/2971492608 >> v1:172.21.15.174:6789/0 conn(0x7f3f2813f580 legacy=0x7f3f28114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:16.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f2d414700 1 -- 172.21.15.80:0/2971492608 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f28124010 con 0x7f3f28112fb0 2019-11-28T11:33:16.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f2d414700 1 --2- 172.21.15.80:0/2971492608 >> v2:172.21.15.80:3300/0 conn(0x7f3f28112fb0 0x7f3f28113440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3f1c010430 tx=0x7f3f1c0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f2d414700 1 --2- 172.21.15.80:0/2971492608 >> v2:172.21.15.80:3300/0 conn(0x7f3f28112fb0 0x7f3f28113440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3f1c010430 tx=0x7f3f1c0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f2d414700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f28112fb0 0x7f3f28113440 secure :-1 s=READY pgs=956 cs=0 l=1 rx=0x7f3f1c010430 tx=0x7f3f1c0107d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:16.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f2d414700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f28112fb0 0x7f3f28113440 secure :-1 s=THROTTLE_DONE pgs=956 cs=0 l=1 rx=0x7f3f1c010430 tx=0x7f3f1c0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f267fc700 1 -- 172.21.15.80:0/2971492608 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f1c000c90 con 0x7f3f28112fb0 2019-11-28T11:33:16.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f2d414700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f28112fb0 0x7f3f28113440 secure :-1 s=THROTTLE_DONE pgs=956 cs=0 l=1 rx=0x7f3f1c010430 tx=0x7f3f1c0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f2f678700 1 -- 172.21.15.80:0/2971492608 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f28124010 con 0x7f3f28112fb0 2019-11-28T11:33:16.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f2d414700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f28112fb0 0x7f3f28113440 secure :-1 s=THROTTLE_DONE pgs=956 cs=0 l=1 rx=0x7f3f1c010430 tx=0x7f3f1c0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f267fc700 1 -- 172.21.15.80:0/2971492608 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1c000c90 con 0x7f3f28112fb0 2019-11-28T11:33:16.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f267fc700 1 -- 172.21.15.80:0/2971492608 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f1c008a30 con 0x7f3f28112fb0 2019-11-28T11:33:16.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.698+0000 7f3f2f678700 1 -- 172.21.15.80:0/2971492608 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f28124010 con 0x7f3f28112fb0 2019-11-28T11:33:16.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.699+0000 7f3f2d414700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f28112fb0 0x7f3f28113440 secure :-1 s=THROTTLE_DONE pgs=956 cs=0 l=1 rx=0x7f3f1c010430 tx=0x7f3f1c0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.699+0000 7f3f267fc700 1 -- 172.21.15.80:0/2971492608 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3f1c004240 con 0x7f3f28112fb0 2019-11-28T11:33:16.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.699+0000 7f3f267fc700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f08020f40 0x7f3f080233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:33:16.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.699+0000 7f3f2d414700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f28112fb0 0x7f3f28113440 secure :-1 s=THROTTLE_DONE pgs=956 cs=0 l=1 rx=0x7f3f1c010430 tx=0x7f3f1c0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.699+0000 7f3f267fc700 1 -- 172.21.15.80:0/2971492608 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3f1c031d70 con 0x7f3f28112fb0 2019-11-28T11:33:16.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.699+0000 7f3f2dc15700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f08020f40 0x7f3f080233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:33:16.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.700+0000 7f3f2dc15700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f08020f40 0x7f3f080233f0 crc :-1 s=READY pgs=392 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:33:16.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.706+0000 7f3f2f678700 1 -- 172.21.15.80:0/2971492608 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f28124010 con 0x7f3f28112fb0 2019-11-28T11:33:16.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.709+0000 7f3f2d414700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f28112fb0 0x7f3f28113440 secure :-1 s=THROTTLE_DONE pgs=956 cs=0 l=1 rx=0x7f3f1c010430 tx=0x7f3f1c0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.709+0000 7f3f267fc700 1 -- 172.21.15.80:0/2971492608 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3f1c0012e0 con 0x7f3f28112fb0 2019-11-28T11:33:16.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.699+0000 7efc8350b700 1 -- 172.21.15.80:0/1682291836 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7c12af40 con 0x7efc7c12cb00 2019-11-28T11:33:16.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.703+0000 7efc822a9700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c12cb00 0x7efc7c167d70 secure :-1 s=THROTTLE_DONE pgs=953 cs=0 l=1 rx=0x7efc78054460 tx=0x7efc78054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:16.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.703+0000 7efc6e7fc700 1 -- 172.21.15.80:0/1682291836 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efc78000eb0 con 0x7efc7c12cb00 2019-11-28T11:33:16.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.897+0000 7f3f2f678700 1 -- 172.21.15.80:0/2971492608 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f3f28124010 con 0x7f3f28112fb0 2019-11-28T11:33:17.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:16.996+0000 7efc8350b700 1 -- 172.21.15.80:0/1682291836 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7efc7c12abc0 con 0x7efc7c12cb00 2019-11-28T11:33:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.002+0000 7f2522da4700 1 -- 172.21.15.80:0/3298769032 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f251c121d20 con 0x7f251c123ab0 2019-11-28T11:33:17.638 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:33:17.593+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:33:17.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.595+0000 7f3f2d414700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f28112fb0 0x7f3f28113440 secure :-1 s=THROTTLE_DONE pgs=956 cs=0 l=1 rx=0x7f3f1c010430 tx=0x7f3f1c0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:17.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.595+0000 7f3f267fc700 1 -- 172.21.15.80:0/2971492608 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6687 v47) v1 ==== 95+0+0 (secure 0 0 0) 0x7f3f1c004240 con 0x7f3f28112fb0 2019-11-28T11:33:17.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.595+0000 7efc822a9700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c12cb00 0x7efc7c167d70 secure :-1 s=THROTTLE_DONE pgs=953 cs=0 l=1 rx=0x7efc78054460 tx=0x7efc78054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:17.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.595+0000 7efc6e7fc700 1 -- 172.21.15.80:0/1682291836 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 5390 v47) v1 ==== 95+0+0 (secure 0 0 0) 0x7efc780010c0 con 0x7efc7c12cb00 2019-11-28T11:33:17.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.595+0000 7f2521b42700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f251c123ab0 0x7f251c12d290 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f2514010700 tx=0x7f2514010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:33:17.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.595+0000 7f2511ffb700 1 -- 172.21.15.80:0/3298769032 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6693 v47) v1 ==== 95+0+0 (secure 0 0 0) 0x7f251400b1e0 con 0x7f251c123ab0 2019-11-28T11:33:17.655 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 5390 2019-11-28T11:33:17.657 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 6687 2019-11-28T11:33:17.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.613+0000 7efc8350b700 1 -- 172.21.15.80:0/1682291836 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc64018730 msgr2=0x7efc6401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:17.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.613+0000 7efc8350b700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc64018730 0x7efc6401abc0 crc :-1 s=READY pgs=391 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:17.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.613+0000 7efc8350b700 1 -- 172.21.15.80:0/1682291836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c12cb00 msgr2=0x7efc7c167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:17.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.613+0000 7efc8350b700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c12cb00 0x7efc7c167d70 secure :-1 s=READY pgs=953 cs=0 l=1 rx=0x7efc78054460 tx=0x7efc78054800).stop 2019-11-28T11:33:17.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.613+0000 7efc8350b700 1 -- 172.21.15.80:0/1682291836 shutdown_connections 2019-11-28T11:33:17.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.613+0000 7efc8350b700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc7c12cb00 0x7efc7c167d70 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:17.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.613+0000 7efc8350b700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc64018730 0x7efc6401abc0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:17.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.613+0000 7efc8350b700 1 --2- 172.21.15.80:0/1682291836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc7c13a780 0x7efc7c12d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:17.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.613+0000 7efc8350b700 1 -- 172.21.15.80:0/1682291836 shutdown_connections 2019-11-28T11:33:17.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.613+0000 7efc8350b700 1 -- 172.21.15.80:0/1682291836 wait complete. 2019-11-28T11:33:17.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.613+0000 7efc8350b700 1 -- 172.21.15.80:0/1682291836 >> 172.21.15.80:0/1682291836 conn(0x7efc7c127dc0 msgr2=0x7efc7c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:17.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.615+0000 7f3f2f678700 1 -- 172.21.15.80:0/2971492608 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f08020f40 msgr2=0x7f3f080233f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:17.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.615+0000 7f3f2f678700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f08020f40 0x7f3f080233f0 crc :-1 s=READY pgs=392 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:17.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.615+0000 7f3f2f678700 1 -- 172.21.15.80:0/2971492608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f28112fb0 msgr2=0x7f3f28113440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:17.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.615+0000 7f3f2f678700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f28112fb0 0x7f3f28113440 secure :-1 s=READY pgs=956 cs=0 l=1 rx=0x7f3f1c010430 tx=0x7f3f1c0107d0).stop 2019-11-28T11:33:17.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.615+0000 7f3f2f678700 1 -- 172.21.15.80:0/2971492608 shutdown_connections 2019-11-28T11:33:17.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.615+0000 7f3f2f678700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f28113980 0x7f3f28168a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:17.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.615+0000 7f3f2f678700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f28112fb0 0x7f3f28113440 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:17.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.615+0000 7f3f2f678700 1 --2- 172.21.15.80:0/2971492608 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f08020f40 0x7f3f080233f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:17.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.615+0000 7f3f2f678700 1 -- 172.21.15.80:0/2971492608 shutdown_connections 2019-11-28T11:33:17.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.615+0000 7f3f2f678700 1 -- 172.21.15.80:0/2971492608 wait complete. 2019-11-28T11:33:17.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.615+0000 7f3f2f678700 1 -- 172.21.15.80:0/2971492608 >> 172.21.15.80:0/2971492608 conn(0x7f3f281426c0 msgr2=0x7f3f28110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:17.663 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 6693 2019-11-28T11:33:17.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.619+0000 7f2522da4700 1 -- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f24fc018730 msgr2=0x7f24fc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:17.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.619+0000 7f2522da4700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f24fc018730 0x7f24fc01abc0 crc :-1 s=READY pgs=393 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:17.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.619+0000 7f2522da4700 1 -- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f251c123ab0 msgr2=0x7f251c12d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:33:17.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.619+0000 7f2522da4700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f251c123ab0 0x7f251c12d290 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7f2514010700 tx=0x7f2514010580).stop 2019-11-28T11:33:17.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.619+0000 7f2522da4700 1 -- 172.21.15.80:0/3298769032 shutdown_connections 2019-11-28T11:33:17.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.619+0000 7f2522da4700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f24fc018730 0x7f24fc01abc0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:17.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.619+0000 7f2522da4700 1 --2- 172.21.15.80:0/3298769032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f251c123ab0 0x7f251c12d290 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:17.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.619+0000 7f2522da4700 1 --2- 172.21.15.80:0/3298769032 >> v2:172.21.15.80:3300/0 conn(0x7f251c1230e0 0x7f251c123570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:17.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.619+0000 7f2522da4700 1 --2- 172.21.15.80:0/3298769032 >> v2:172.21.15.174:3300/0 conn(0x7f251c12cea0 0x7f251c111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:33:17.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.620+0000 7f2522da4700 1 -- 172.21.15.80:0/3298769032 shutdown_connections 2019-11-28T11:33:17.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.620+0000 7f2522da4700 1 -- 172.21.15.80:0/3298769032 wait complete. 2019-11-28T11:33:17.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:33:17.620+0000 7f2522da4700 1 -- 172.21.15.80:0/3298769032 >> 172.21.15.80:0/3298769032 conn(0x7f251c1426c0 msgr2=0x7f251c110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:33:17.669 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:33:17.671 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:33:17.674 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:33:17.724 INFO:teuthology.orchestra.console:Performing hard reset of smithi076 2019-11-28T11:33:17.725 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power reset 2019-11-28T11:33:17.772 INFO:teuthology.orchestra.console:Hard reset for smithi076 completed 2019-11-28T11:33:35.921 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:33:35.931 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:33:35.948 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:33:47.873 INFO:teuthology.misc:Re-opening connections... 2019-11-28T11:33:47.873 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:33:47.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:33:47.876 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:33:47.971 DEBUG:tasks.ceph:Missed logrotate, EOFError 2019-11-28T11:33:50.940 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:33:50.941 DEBUG:teuthology.misc:waited 3.06727600098 2019-11-28T11:33:51.942 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:33:51.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:33:51.942 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:33:54.008 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:33:54.009 DEBUG:teuthology.misc:waited 6.13530802727 2019-11-28T11:33:55.010 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:33:55.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:33:55.011 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:33:57.080 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:33:57.081 DEBUG:teuthology.misc:waited 9.20718288422 2019-11-28T11:33:58.081 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:33:58.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:33:58.083 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:00.152 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:00.153 DEBUG:teuthology.misc:waited 12.2791500092 2019-11-28T11:34:01.154 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:34:01.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:01.154 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:03.228 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:03.229 DEBUG:teuthology.misc:waited 15.355257988 2019-11-28T11:34:04.229 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:34:04.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:04.230 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:06.296 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:06.297 DEBUG:teuthology.misc:waited 18.4232308865 2019-11-28T11:34:07.298 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:34:07.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:07.298 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:09.368 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:09.369 DEBUG:teuthology.misc:waited 21.4951319695 2019-11-28T11:34:10.370 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:34:10.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:10.371 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:12.442 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:12.442 DEBUG:teuthology.misc:waited 24.5685360432 2019-11-28T11:34:13.443 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:34:13.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:13.444 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:15.512 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:15.513 DEBUG:teuthology.misc:waited 27.639302969 2019-11-28T11:34:16.514 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:34:16.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:16.515 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:17.973 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:34:17.977 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:34:17.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:17.982 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:18.584 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:18.585 DEBUG:tasks.ceph:Missed logrotate, node 'smithi076' is offline 2019-11-28T11:34:18.585 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:18.586 DEBUG:teuthology.misc:waited 30.7121658325 2019-11-28T11:34:19.587 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:34:19.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:19.588 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:21.657 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:21.658 DEBUG:teuthology.misc:waited 33.7843568325 2019-11-28T11:34:22.659 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:34:22.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:22.659 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:24.728 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:24.729 DEBUG:teuthology.misc:waited 36.8551700115 2019-11-28T11:34:25.730 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:34:25.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:25.730 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:27.800 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:27.801 DEBUG:teuthology.misc:waited 39.9271540642 2019-11-28T11:34:28.801 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:34:28.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:28.802 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:30.873 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:30.874 DEBUG:teuthology.misc:waited 43.0000629425 2019-11-28T11:34:31.885 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:34:31.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:31.886 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:33.944 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:33.945 DEBUG:teuthology.misc:waited 46.0713880062 2019-11-28T11:34:34.946 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:34:34.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:34.947 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:37.017 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:37.017 DEBUG:teuthology.misc:waited 49.1433570385 2019-11-28T11:34:38.017 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:34:38.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:38.018 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:40.088 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:40.089 DEBUG:teuthology.misc:waited 52.2152659893 2019-11-28T11:34:41.089 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:34:41.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:41.090 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:43.160 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:43.161 DEBUG:teuthology.misc:waited 55.2872040272 2019-11-28T11:34:44.162 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:34:44.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:44.163 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:46.236 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:34:46.237 DEBUG:teuthology.misc:waited 58.3633019924 2019-11-28T11:34:47.237 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:34:47.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:47.238 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:34:48.586 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:34:48.591 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:34:48.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:34:48.598 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:35:47.239 DEBUG:teuthology.orchestra.remote:timed out 2019-11-28T11:35:47.239 DEBUG:teuthology.misc:waited 119.365865946 2019-11-28T11:35:48.240 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:35:48.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:35:48.241 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:35:48.486 INFO:teuthology.orchestra.run.smithi076:> true 2019-11-28T11:35:48.600 DEBUG:teuthology.orchestra.remote:timed out 2019-11-28T11:35:48.600 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:35:48.783 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:35:48.789 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:35:48.799 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:35:48.990 DEBUG:teuthology.misc:waited 121.116127014 2019-11-28T11:35:49.991 INFO:teuthology.orchestra.run:Running command with timeout 10 2019-11-28T11:35:49.991 INFO:teuthology.orchestra.run.smithi076:> uptime 2019-11-28T11:35:50.060 INFO:teuthology.orchestra.run.smithi076.stdout: 11:35:50 up 0 min, 0 users, load average: 0.47, 0.14, 0.05 2019-11-28T11:35:50.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:35:50.061 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:35:50.182 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:35:50.183 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:35:50.183 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:35:50.183 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:35:50.184 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:35:50.184 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:35:50.189 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:35:50.189 DEBUG:teuthology.parallel:result is None 2019-11-28T11:35:50.190 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:35:50.190 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:35:50.190 DEBUG:teuthology.parallel:result is None 2019-11-28T11:35:50.190 DEBUG:teuthology.parallel:result is None 2019-11-28T11:35:50.191 INFO:tasks.cephfs.test_client_recovery:Waiting for reconnect... 2019-11-28T11:35:50.191 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:35:50.277 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:35:50.296 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:35:50.297 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:35:50.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.273+0000 7fc3f3a6b700 1 Processor -- start 2019-11-28T11:35:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.273+0000 7fc3f3a6b700 1 -- start start 2019-11-28T11:35:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.274+0000 7fc3f3a6b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3ec06c0a0 0x7fc3ec072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.274+0000 7fc3f3a6b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3ec072620 0x7fc3ec164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.274+0000 7fc3f3a6b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec06db00 con 0x7fc3ec0734e0 2019-11-28T11:35:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.274+0000 7fc3f3a6b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ec06fd60 con 0x7fc3ec06c0a0 2019-11-28T11:35:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.274+0000 7fc3f3a6b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec070030 con 0x7fc3ec072620 2019-11-28T11:35:50.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.274+0000 7fc3f2008700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3ec06c0a0 0x7fc3ec072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:50.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.274+0000 7fc3f1807700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc3ec0734e0 0x7fc3ec071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35244/0 (socket says 172.21.15.80:35244) 2019-11-28T11:35:50.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.274+0000 7fc3f1807700 1 -- 172.21.15.80:0/339549623 learned_addr learned my addr 172.21.15.80:0/339549623 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:35:50.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.274+0000 7fc3f2809700 1 --2- 172.21.15.80:0/339549623 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3ec072620 0x7fc3ec164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:50.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.275+0000 7fc3f2008700 1 -- 172.21.15.80:0/339549623 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3ec072620 msgr2=0x7fc3ec164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:35:50.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.275+0000 7fc3f2008700 1 --2- 172.21.15.80:0/339549623 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3ec072620 0x7fc3ec164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:50.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.275+0000 7fc3f2008700 1 -- 172.21.15.80:0/339549623 >> v1:172.21.15.80:6789/0 conn(0x7fc3ec0734e0 legacy=0x7fc3ec071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:50.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.275+0000 7fc3f2008700 1 -- 172.21.15.80:0/339549623 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec0706c0 con 0x7fc3ec06c0a0 2019-11-28T11:35:50.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.275+0000 7fc3f1006700 1 -- 172.21.15.80:0/339549623 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140166796 0 0) 0x7fc3dc001070 con 0x7fc3ec0734e0 2019-11-28T11:35:50.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.275+0000 7fc3f2008700 1 --2- 172.21.15.80:0/339549623 >> v2:172.21.15.80:3300/0 conn(0x7fc3ec06c0a0 0x7fc3ec072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc3e000af50 tx=0x7fc3e000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:50.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.275+0000 7fc3f2008700 1 --2- 172.21.15.80:0/339549623 >> v2:172.21.15.80:3300/0 conn(0x7fc3ec06c0a0 0x7fc3ec072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc3e000af50 tx=0x7fc3e000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:50.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.275+0000 7fc3f2008700 1 --2- 172.21.15.80:0/339549623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec06c0a0 0x7fc3ec072fa0 secure :-1 s=READY pgs=963 cs=0 l=1 rx=0x7fc3e000af50 tx=0x7fc3e000b6e0).ready entity=mon.0 client_cookie=51d0c7a17c82b3b4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:50.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.275+0000 7fc3f2008700 1 --2- 172.21.15.80:0/339549623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec06c0a0 0x7fc3ec072fa0 secure :-1 s=THROTTLE_DONE pgs=963 cs=0 l=1 rx=0x7fc3e000af50 tx=0x7fc3e000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:50.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.275+0000 7fc3f1006700 1 -- 172.21.15.80:0/339549623 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e0007210 con 0x7fc3ec06c0a0 2019-11-28T11:35:50.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.275+0000 7fc3f2008700 1 --2- 172.21.15.80:0/339549623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec06c0a0 0x7fc3ec072fa0 secure :-1 s=THROTTLE_DONE pgs=963 cs=0 l=1 rx=0x7fc3e000af50 tx=0x7fc3e000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:50.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.275+0000 7fc3f2008700 1 --2- 172.21.15.80:0/339549623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec06c0a0 0x7fc3ec072fa0 secure :-1 s=THROTTLE_DONE pgs=963 cs=0 l=1 rx=0x7fc3e000af50 tx=0x7fc3e000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:50.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.275+0000 7fc3f1006700 1 -- 172.21.15.80:0/339549623 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e00099b0 con 0x7fc3ec06c0a0 2019-11-28T11:35:50.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.275+0000 7fc3f1006700 1 -- 172.21.15.80:0/339549623 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e0009ba0 con 0x7fc3ec06c0a0 2019-11-28T11:35:50.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.275+0000 7fc3f3a6b700 1 -- 172.21.15.80:0/339549623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec06c0a0 msgr2=0x7fc3ec072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:50.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.275+0000 7fc3f3a6b700 1 --2- 172.21.15.80:0/339549623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec06c0a0 0x7fc3ec072fa0 secure :-1 s=READY pgs=963 cs=0 l=1 rx=0x7fc3e000af50 tx=0x7fc3e000b6e0).stop 2019-11-28T11:35:50.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.276+0000 7fc3f3a6b700 1 -- 172.21.15.80:0/339549623 shutdown_connections 2019-11-28T11:35:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.276+0000 7fc3f3a6b700 1 --2- 172.21.15.80:0/339549623 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3ec072620 0x7fc3ec164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.276+0000 7fc3f3a6b700 1 --2- 172.21.15.80:0/339549623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3ec06c0a0 0x7fc3ec072fa0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.276+0000 7fc3f3a6b700 1 -- 172.21.15.80:0/339549623 shutdown_connections 2019-11-28T11:35:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.276+0000 7fc3f3a6b700 1 -- 172.21.15.80:0/339549623 wait complete. 2019-11-28T11:35:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.276+0000 7fc3f3a6b700 1 -- 172.21.15.80:0/339549623 >> 172.21.15.80:0/339549623 conn(0x7fc3ec061cf0 msgr2=0x7fc3ec064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:50.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.278+0000 7fc3f3a6b700 1 Processor -- start 2019-11-28T11:35:50.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.278+0000 7fc3f3a6b700 1 -- start start 2019-11-28T11:35:50.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.279+0000 7fc3f3a6b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc3ec13e5f0 0x7fc3ec13e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:50.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.279+0000 7fc3f3a6b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec1066e0 con 0x7fc3ec10a4e0 2019-11-28T11:35:50.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.279+0000 7fc3f3a6b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec10ce40 con 0x7fc3ec10a070 2019-11-28T11:35:50.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.279+0000 7fc3f3a6b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ec10e060 con 0x7fc3ec13e5f0 2019-11-28T11:35:50.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.279+0000 7fc3f2809700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc3ec10a4e0 0x7fc3ec10c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35250/0 (socket says 172.21.15.80:35250) 2019-11-28T11:35:50.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.279+0000 7fc3f2809700 1 -- 172.21.15.80:0/3719578789 learned_addr learned my addr 172.21.15.80:0/3719578789 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:35:50.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.279+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197772564 0 0) 0x7fc3e4001490 con 0x7fc3ec10a4e0 2019-11-28T11:35:50.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.279+0000 7fc3f2008700 1 --2- 172.21.15.80:0/3719578789 >> v2:172.21.15.174:3300/0 conn(0x7fc3ec13e5f0 0x7fc3ec13e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:50.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.279+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3cc002e80 con 0x7fc3ec10a4e0 2019-11-28T11:35:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1374439403 0 0) 0x7fc3e4001600 con 0x7fc3ec10a4e0 2019-11-28T11:35:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc3cc0032e0 con 0x7fc3ec10a4e0 2019-11-28T11:35:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc3e4001bd0 con 0x7fc3ec10a4e0 2019-11-28T11:35:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 >> v2:172.21.15.174:3300/0 conn(0x7fc3ec13e5f0 msgr2=0x7fc3ec13e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3eaffd700 1 --2- 172.21.15.80:0/3719578789 >> v2:172.21.15.174:3300/0 conn(0x7fc3ec13e5f0 0x7fc3ec13e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 >> v1:172.21.15.174:6789/0 conn(0x7fc3ec10a070 legacy=0x7fc3ec10bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:50.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 >> v1:172.21.15.80:6789/0 conn(0x7fc3ec10a4e0 legacy=0x7fc3ec10c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:50.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3eaffd700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3cc003a00 0x7fc3cc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:50.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3eaffd700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3cc004370 0x7fc3cc004830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:50.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3eaffd700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3cc004df0 0x7fc3cc00b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:50.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc00bc10 con 0x7fc3cc004370 2019-11-28T11:35:50.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc00be40 con 0x7fc3cc004df0 2019-11-28T11:35:50.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc00c070 con 0x7fc3cc003a00 2019-11-28T11:35:50.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f1807700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3cc004370 0x7fc3cc004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:50.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f2008700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3cc003a00 0x7fc3cc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:50.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f2809700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3cc004df0 0x7fc3cc00b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:50.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f1807700 1 -- 172.21.15.80:0/3719578789 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3cc003a00 msgr2=0x7fc3cc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:50.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f1807700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3cc003a00 0x7fc3cc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:50.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f1807700 1 -- 172.21.15.80:0/3719578789 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3cc004df0 msgr2=0x7fc3cc00b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:50.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f1807700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3cc004df0 0x7fc3cc00b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f1807700 1 -- 172.21.15.80:0/3719578789 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc00c320 con 0x7fc3cc004370 2019-11-28T11:35:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f2008700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3cc003a00 0x7fc3cc003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:35:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f2809700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3cc004df0 0x7fc3cc00b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:35:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f3a6b700 1 -- 172.21.15.80:0/3719578789 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ec10ed40 con 0x7fc3cc004370 2019-11-28T11:35:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f2809700 1 -- 172.21.15.80:0/3719578789 reap_dead start 2019-11-28T11:35:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f1807700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3cc004370 0x7fc3cc004830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc3dc0103a0 tx=0x7fc3dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f3a6b700 1 -- 172.21.15.80:0/3719578789 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ec10e9c0 con 0x7fc3cc004370 2019-11-28T11:35:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f1807700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3cc004370 0x7fc3cc004830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc3dc0103a0 tx=0x7fc3dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f1807700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3cc004370 0x7fc3cc004830 secure :-1 s=READY pgs=965 cs=0 l=1 rx=0x7fc3dc0103a0 tx=0x7fc3dc010740).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f1807700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3cc004370 0x7fc3cc004830 secure :-1 s=THROTTLE_DONE pgs=965 cs=0 l=1 rx=0x7fc3dc0103a0 tx=0x7fc3dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:50.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3f1807700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3cc004370 0x7fc3cc004830 secure :-1 s=THROTTLE_DONE pgs=965 cs=0 l=1 rx=0x7fc3dc0103a0 tx=0x7fc3dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:50.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.280+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3dc000e50 con 0x7fc3cc004370 2019-11-28T11:35:50.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.281+0000 7fc3f1807700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3cc004370 0x7fc3cc004830 secure :-1 s=THROTTLE_DONE pgs=965 cs=0 l=1 rx=0x7fc3dc0103a0 tx=0x7fc3dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:50.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.281+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc003fe0 con 0x7fc3cc004370 2019-11-28T11:35:50.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.281+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3dc004630 con 0x7fc3cc004370 2019-11-28T11:35:50.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.281+0000 7fc3f1807700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3cc004370 0x7fc3cc004830 secure :-1 s=THROTTLE_DONE pgs=965 cs=0 l=1 rx=0x7fc3dc0103a0 tx=0x7fc3dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:50.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.281+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc3dc0041d0 con 0x7fc3cc004370 2019-11-28T11:35:50.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.281+0000 7fc3f1807700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3cc004370 0x7fc3cc004830 secure :-1 s=THROTTLE_DONE pgs=965 cs=0 l=1 rx=0x7fc3dc0103a0 tx=0x7fc3dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:50.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.281+0000 7fc3eaffd700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3cc01b4e0 0x7fc3cc01d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:50.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.281+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fc3dc031b50 con 0x7fc3cc004370 2019-11-28T11:35:50.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.281+0000 7fc3f2008700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3cc01b4e0 0x7fc3cc01d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:50.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.282+0000 7fc3f2008700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3cc01b4e0 0x7fc3cc01d910 crc :-1 s=READY pgs=394 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:50.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.288+0000 7fc3f3a6b700 1 -- 172.21.15.80:0/3719578789 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ec10ed40 con 0x7fc3cc004370 2019-11-28T11:35:50.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.292+0000 7fc3f1807700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3cc004370 0x7fc3cc004830 secure :-1 s=THROTTLE_DONE pgs=965 cs=0 l=1 rx=0x7fc3dc0103a0 tx=0x7fc3dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:50.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.292+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc3dc000940 con 0x7fc3cc004370 2019-11-28T11:35:50.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.463+0000 7fc3f3a6b700 1 -- 172.21.15.80:0/3719578789 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3ec10e9c0 con 0x7fc3cc004370 2019-11-28T11:35:50.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.464+0000 7fc3f1807700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3cc004370 0x7fc3cc004830 secure :-1 s=THROTTLE_DONE pgs=965 cs=0 l=1 rx=0x7fc3dc0103a0 tx=0x7fc3dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:50.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.464+0000 7fc3eaffd700 1 -- 172.21.15.80:0/3719578789 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+1427 (secure 0 0 0) 0x7fc3dc01fd20 con 0x7fc3cc004370 2019-11-28T11:35:50.520 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 47 2019-11-28T11:35:50.520 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:35:50.521 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:33:17.594269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:35:50.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.466+0000 7fc3f3a6b700 1 -- 172.21.15.80:0/3719578789 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3cc01b4e0 msgr2=0x7fc3cc01d910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:50.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.466+0000 7fc3f3a6b700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3cc01b4e0 0x7fc3cc01d910 crc :-1 s=READY pgs=394 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:50.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.466+0000 7fc3f3a6b700 1 -- 172.21.15.80:0/3719578789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3cc004370 msgr2=0x7fc3cc004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:50.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.466+0000 7fc3f3a6b700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3cc004370 0x7fc3cc004830 secure :-1 s=READY pgs=965 cs=0 l=1 rx=0x7fc3dc0103a0 tx=0x7fc3dc010740).stop 2019-11-28T11:35:50.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.466+0000 7fc3f3a6b700 1 -- 172.21.15.80:0/3719578789 shutdown_connections 2019-11-28T11:35:50.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.466+0000 7fc3f3a6b700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3cc01b4e0 0x7fc3cc01d910 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:50.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.466+0000 7fc3f3a6b700 1 --2- 172.21.15.80:0/3719578789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3cc004370 0x7fc3cc004830 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:50.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.466+0000 7fc3f3a6b700 1 -- 172.21.15.80:0/3719578789 shutdown_connections 2019-11-28T11:35:50.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.466+0000 7fc3f3a6b700 1 -- 172.21.15.80:0/3719578789 wait complete. 2019-11-28T11:35:50.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:50.466+0000 7fc3f3a6b700 1 -- 172.21.15.80:0/3719578789 >> 172.21.15.80:0/3719578789 conn(0x7fc3ec13d620 msgr2=0x7fc3ec13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:50.532 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T11:35:51.533 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:35:51.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.600+0000 7f5a8654d700 1 Processor -- start 2019-11-28T11:35:51.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.600+0000 7f5a8654d700 1 -- start start 2019-11-28T11:35:51.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.601+0000 7f5a8654d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a8006c0a0 0x7f5a80072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:51.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.601+0000 7f5a8654d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5a80072620 0x7f5a80164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:51.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.601+0000 7f5a8654d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8006db00 con 0x7f5a800734e0 2019-11-28T11:35:51.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.601+0000 7f5a8654d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8006fd60 con 0x7f5a8006c0a0 2019-11-28T11:35:51.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.601+0000 7f5a8654d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a80070030 con 0x7f5a80072620 2019-11-28T11:35:51.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.601+0000 7f5a84aea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a8006c0a0 0x7f5a80072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:51.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.601+0000 7f5a84aea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a8006c0a0 0x7f5a80072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35944/0 (socket says 172.21.15.80:35944) 2019-11-28T11:35:51.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.601+0000 7f5a84aea700 1 -- 172.21.15.80:0/645399802 learned_addr learned my addr 172.21.15.80:0/645399802 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:35:51.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.601+0000 7f5a852eb700 1 --2- 172.21.15.80:0/645399802 >> v2:172.21.15.174:3300/0 conn(0x7f5a80072620 0x7f5a80164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:51.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.601+0000 7f5a84aea700 1 -- 172.21.15.80:0/645399802 >> v2:172.21.15.174:3300/0 conn(0x7f5a80072620 msgr2=0x7f5a80164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:35:51.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.601+0000 7f5a84aea700 1 --2- 172.21.15.80:0/645399802 >> v2:172.21.15.174:3300/0 conn(0x7f5a80072620 0x7f5a80164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:51.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.601+0000 7f5a84aea700 1 -- 172.21.15.80:0/645399802 >> v1:172.21.15.174:6789/0 conn(0x7f5a800734e0 legacy=0x7f5a80071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:51.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.601+0000 7f5a84aea700 1 -- 172.21.15.80:0/645399802 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a800706c0 con 0x7f5a8006c0a0 2019-11-28T11:35:51.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.601+0000 7f5a84aea700 1 --2- 172.21.15.80:0/645399802 >> v2:172.21.15.80:3300/0 conn(0x7f5a8006c0a0 0x7f5a80072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a6800f740 tx=0x7f5a6800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:51.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.602+0000 7f5a84aea700 1 --2- 172.21.15.80:0/645399802 >> v2:172.21.15.80:3300/0 conn(0x7f5a8006c0a0 0x7f5a80072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a6800f740 tx=0x7f5a6800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:51.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.602+0000 7f5a84aea700 1 --2- 172.21.15.80:0/645399802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8006c0a0 0x7f5a80072fa0 secure :-1 s=READY pgs=966 cs=0 l=1 rx=0x7f5a6800f740 tx=0x7f5a6800f570).ready entity=mon.0 client_cookie=10fae4b1cb8d8486 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:51.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.602+0000 7f5a84aea700 1 --2- 172.21.15.80:0/645399802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8006c0a0 0x7f5a80072fa0 secure :-1 s=THROTTLE_DONE pgs=966 cs=0 l=1 rx=0x7f5a6800f740 tx=0x7f5a6800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:51.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.602+0000 7f5a84aea700 1 --2- 172.21.15.80:0/645399802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8006c0a0 0x7f5a80072fa0 secure :-1 s=THROTTLE_DONE pgs=966 cs=0 l=1 rx=0x7f5a6800f740 tx=0x7f5a6800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:51.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.602+0000 7f5a7f7fe700 1 -- 172.21.15.80:0/645399802 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a68000960 con 0x7f5a8006c0a0 2019-11-28T11:35:51.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.602+0000 7f5a84aea700 1 --2- 172.21.15.80:0/645399802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8006c0a0 0x7f5a80072fa0 secure :-1 s=THROTTLE_DONE pgs=966 cs=0 l=1 rx=0x7f5a6800f740 tx=0x7f5a6800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:51.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.602+0000 7f5a7f7fe700 1 -- 172.21.15.80:0/645399802 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a68000c90 con 0x7f5a8006c0a0 2019-11-28T11:35:51.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.602+0000 7f5a7f7fe700 1 -- 172.21.15.80:0/645399802 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a680013a0 con 0x7f5a8006c0a0 2019-11-28T11:35:51.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.602+0000 7f5a8654d700 1 -- 172.21.15.80:0/645399802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8006c0a0 msgr2=0x7f5a80072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:51.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.602+0000 7f5a8654d700 1 --2- 172.21.15.80:0/645399802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8006c0a0 0x7f5a80072fa0 secure :-1 s=READY pgs=966 cs=0 l=1 rx=0x7f5a6800f740 tx=0x7f5a6800f570).stop 2019-11-28T11:35:51.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.602+0000 7f5a8654d700 1 -- 172.21.15.80:0/645399802 shutdown_connections 2019-11-28T11:35:51.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.602+0000 7f5a8654d700 1 --2- 172.21.15.80:0/645399802 >> v2:172.21.15.174:3300/0 conn(0x7f5a80072620 0x7f5a80164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:51.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.602+0000 7f5a8654d700 1 --2- 172.21.15.80:0/645399802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a8006c0a0 0x7f5a80072fa0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:51.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.602+0000 7f5a8654d700 1 -- 172.21.15.80:0/645399802 shutdown_connections 2019-11-28T11:35:51.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.602+0000 7f5a8654d700 1 -- 172.21.15.80:0/645399802 wait complete. 2019-11-28T11:35:51.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.602+0000 7f5a8654d700 1 -- 172.21.15.80:0/645399802 >> 172.21.15.80:0/645399802 conn(0x7f5a80061cf0 msgr2=0x7f5a80064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:51.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.605+0000 7f5a8654d700 1 Processor -- start 2019-11-28T11:35:51.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.605+0000 7f5a8654d700 1 -- start start 2019-11-28T11:35:51.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.606+0000 7f5a8654d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5a801096f0 0x7f5a80169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:51.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.606+0000 7f5a8654d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a801066e0 con 0x7f5a8013e5f0 2019-11-28T11:35:51.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.606+0000 7f5a8654d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8010ce40 con 0x7f5a8013e9e0 2019-11-28T11:35:51.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.606+0000 7f5a8654d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8010e060 con 0x7f5a801096f0 2019-11-28T11:35:51.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.606+0000 7f5a84aea700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5a8013e5f0 0x7f5a8010a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35266/0 (socket says 172.21.15.80:35266) 2019-11-28T11:35:51.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.606+0000 7f5a84aea700 1 -- 172.21.15.80:0/1720539674 learned_addr learned my addr 172.21.15.80:0/1720539674 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:35:51.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.606+0000 7f5a852eb700 1 --2- 172.21.15.80:0/1720539674 >> v2:172.21.15.174:3300/0 conn(0x7f5a801096f0 0x7f5a80169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:51.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.606+0000 7f5a7d7fa700 1 -- 172.21.15.80:0/1720539674 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392343392 0 0) 0x7f5a680079a0 con 0x7f5a8013e5f0 2019-11-28T11:35:51.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.606+0000 7f5a7d7fa700 1 -- 172.21.15.80:0/1720539674 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a64002e80 con 0x7f5a8013e5f0 2019-11-28T11:35:51.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.606+0000 7f5a852eb700 1 -- 172.21.15.80:0/1720539674 >> v1:172.21.15.174:6789/0 conn(0x7f5a8013e9e0 legacy=0x7f5a80108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:51.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.606+0000 7f5a7d7fa700 1 -- 172.21.15.80:0/1720539674 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1316019917 0 0) 0x7f5a68007d50 con 0x7f5a8013e5f0 2019-11-28T11:35:51.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.606+0000 7f5a852eb700 1 -- 172.21.15.80:0/1720539674 >> v1:172.21.15.80:6789/0 conn(0x7f5a8013e5f0 legacy=0x7f5a8010a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:51.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.607+0000 7f5a852eb700 1 -- 172.21.15.80:0/1720539674 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8010e9c0 con 0x7f5a801096f0 2019-11-28T11:35:51.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.607+0000 7f5a852eb700 1 --2- 172.21.15.80:0/1720539674 >> v2:172.21.15.174:3300/0 conn(0x7f5a801096f0 0x7f5a80169ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a78010710 tx=0x7f5a78010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:51.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.607+0000 7f5a852eb700 1 --2- 172.21.15.80:0/1720539674 >> v2:172.21.15.174:3300/0 conn(0x7f5a801096f0 0x7f5a80169ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a78010710 tx=0x7f5a78010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:51.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.607+0000 7f5a852eb700 1 --2- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a801096f0 0x7f5a80169ed0 secure :-1 s=READY pgs=584 cs=0 l=1 rx=0x7f5a78010710 tx=0x7f5a78010ab0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:51.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.607+0000 7f5a852eb700 1 --2- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a801096f0 0x7f5a80169ed0 secure :-1 s=THROTTLE_DONE pgs=584 cs=0 l=1 rx=0x7f5a78010710 tx=0x7f5a78010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:51.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.607+0000 7f5a7d7fa700 1 -- 172.21.15.80:0/1720539674 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a78009d10 con 0x7f5a801096f0 2019-11-28T11:35:51.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.607+0000 7f5a852eb700 1 --2- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a801096f0 0x7f5a80169ed0 secure :-1 s=THROTTLE_DONE pgs=584 cs=0 l=1 rx=0x7f5a78010710 tx=0x7f5a78010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:51.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.607+0000 7f5a852eb700 1 --2- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a801096f0 0x7f5a80169ed0 secure :-1 s=THROTTLE_DONE pgs=584 cs=0 l=1 rx=0x7f5a78010710 tx=0x7f5a78010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:51.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.607+0000 7f5a7d7fa700 1 -- 172.21.15.80:0/1720539674 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a78009930 con 0x7f5a801096f0 2019-11-28T11:35:51.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.607+0000 7f5a7d7fa700 1 -- 172.21.15.80:0/1720539674 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a78009b20 con 0x7f5a801096f0 2019-11-28T11:35:51.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.607+0000 7f5a8654d700 1 -- 172.21.15.80:0/1720539674 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8010ed40 con 0x7f5a801096f0 2019-11-28T11:35:51.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.607+0000 7f5a8654d700 1 -- 172.21.15.80:0/1720539674 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8010e9c0 con 0x7f5a801096f0 2019-11-28T11:35:51.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.607+0000 7f5a852eb700 1 --2- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a801096f0 0x7f5a80169ed0 secure :-1 s=THROTTLE_DONE pgs=584 cs=0 l=1 rx=0x7f5a78010710 tx=0x7f5a78010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:51.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.607+0000 7f5a7d7fa700 1 -- 172.21.15.80:0/1720539674 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5a7800ee00 con 0x7f5a801096f0 2019-11-28T11:35:51.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.607+0000 7f5a852eb700 1 --2- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a801096f0 0x7f5a80169ed0 secure :-1 s=THROTTLE_DONE pgs=584 cs=0 l=1 rx=0x7f5a78010710 tx=0x7f5a78010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:51.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.608+0000 7f5a7d7fa700 1 --2- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a64018780 0x7f5a6401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:51.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.608+0000 7f5a7d7fa700 1 -- 172.21.15.80:0/1720539674 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f5a78031dc0 con 0x7f5a801096f0 2019-11-28T11:35:51.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.608+0000 7f5a84aea700 1 --2- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a64018780 0x7f5a6401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:51.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.608+0000 7f5a84aea700 1 --2- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a64018780 0x7f5a6401abf0 crc :-1 s=READY pgs=395 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:51.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.615+0000 7f5a8654d700 1 -- 172.21.15.80:0/1720539674 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8010ed40 con 0x7f5a801096f0 2019-11-28T11:35:51.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.619+0000 7f5a852eb700 1 --2- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a801096f0 0x7f5a80169ed0 secure :-1 s=THROTTLE_DONE pgs=584 cs=0 l=1 rx=0x7f5a78010710 tx=0x7f5a78010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:51.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.619+0000 7f5a7d7fa700 1 -- 172.21.15.80:0/1720539674 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5a78009b20 con 0x7f5a801096f0 2019-11-28T11:35:51.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.795+0000 7f5a8654d700 1 -- 172.21.15.80:0/1720539674 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a8010e9c0 con 0x7f5a801096f0 2019-11-28T11:35:51.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.797+0000 7f5a852eb700 1 --2- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a801096f0 0x7f5a80169ed0 secure :-1 s=THROTTLE_DONE pgs=584 cs=0 l=1 rx=0x7f5a78010710 tx=0x7f5a78010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:51.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.797+0000 7f5a7d7fa700 1 -- 172.21.15.80:0/1720539674 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+1427 (secure 0 0 0) 0x7f5a78009b20 con 0x7f5a801096f0 2019-11-28T11:35:51.856 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 47 2019-11-28T11:35:51.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.798+0000 7f5a8654d700 1 -- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a64018780 msgr2=0x7f5a6401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:51.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.798+0000 7f5a8654d700 1 --2- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a64018780 0x7f5a6401abf0 crc :-1 s=READY pgs=395 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:51.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.798+0000 7f5a8654d700 1 -- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a801096f0 msgr2=0x7f5a80169ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:51.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.798+0000 7f5a8654d700 1 --2- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a801096f0 0x7f5a80169ed0 secure :-1 s=READY pgs=584 cs=0 l=1 rx=0x7f5a78010710 tx=0x7f5a78010ab0).stop 2019-11-28T11:35:51.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.798+0000 7f5a8654d700 1 -- 172.21.15.80:0/1720539674 shutdown_connections 2019-11-28T11:35:51.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.798+0000 7f5a8654d700 1 --2- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a801096f0 0x7f5a80169ed0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:51.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.798+0000 7f5a8654d700 1 --2- 172.21.15.80:0/1720539674 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a64018780 0x7f5a6401abf0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:51.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.798+0000 7f5a8654d700 1 -- 172.21.15.80:0/1720539674 shutdown_connections 2019-11-28T11:35:51.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.798+0000 7f5a8654d700 1 -- 172.21.15.80:0/1720539674 wait complete. 2019-11-28T11:35:51.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:51.798+0000 7f5a8654d700 1 -- 172.21.15.80:0/1720539674 >> 172.21.15.80:0/1720539674 conn(0x7f5a8013d620 msgr2=0x7f5a8013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:51.858 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:35:51.858 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:33:17.594269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:35:51.864 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T11:35:52.865 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:35:52.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.929+0000 7f65a68f7700 1 Processor -- start 2019-11-28T11:35:52.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.929+0000 7f65a68f7700 1 -- start start 2019-11-28T11:35:52.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.930+0000 7f65a68f7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a006c490 0x7f65a006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:52.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.930+0000 7f65a68f7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f65a006ce60 0x7f65a0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:52.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.930+0000 7f65a68f7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a006db00 con 0x7f65a006c0a0 2019-11-28T11:35:52.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.930+0000 7f65a68f7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a006fd60 con 0x7f65a006ce60 2019-11-28T11:35:52.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.930+0000 7f65a68f7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a0070030 con 0x7f65a006c490 2019-11-28T11:35:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.930+0000 7f65a4e94700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f65a006c0a0 0x7f65a0072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35274/0 (socket says 172.21.15.80:35274) 2019-11-28T11:35:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.930+0000 7f65a4e94700 1 -- 172.21.15.80:0/2859102421 learned_addr learned my addr 172.21.15.80:0/2859102421 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:35:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.930+0000 7f65a5695700 1 --2- 172.21.15.80:0/2859102421 >> v2:172.21.15.174:3300/0 conn(0x7f65a006ce60 0x7f65a0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.930+0000 7f659ffff700 1 --2- 172.21.15.80:0/2859102421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a006c490 0x7f65a006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f659f7fe700 1 -- 172.21.15.80:0/2859102421 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616857842 0 0) 0x7f6588001150 con 0x7f65a006c0a0 2019-11-28T11:35:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f659f7fe700 1 -- 172.21.15.80:0/2859102421 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f658c002e80 con 0x7f65a006c0a0 2019-11-28T11:35:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f659ffff700 1 -- 172.21.15.80:0/2859102421 >> v2:172.21.15.174:3300/0 conn(0x7f65a006ce60 msgr2=0x7f65a0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:35:52.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f659ffff700 1 --2- 172.21.15.80:0/2859102421 >> v2:172.21.15.174:3300/0 conn(0x7f65a006ce60 0x7f65a0164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:52.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f659ffff700 1 -- 172.21.15.80:0/2859102421 >> v1:172.21.15.80:6789/0 conn(0x7f65a006c0a0 legacy=0x7f65a0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:52.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f659ffff700 1 -- 172.21.15.80:0/2859102421 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a00706c0 con 0x7f65a006c490 2019-11-28T11:35:52.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f65a5695700 1 --2- 172.21.15.80:0/2859102421 >> v2:172.21.15.174:3300/0 conn(0x7f65a006ce60 0x7f65a0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:35:52.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f659ffff700 1 --2- 172.21.15.80:0/2859102421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a006c490 0x7f65a006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f659000af50 tx=0x7f659000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:52.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f659ffff700 1 --2- 172.21.15.80:0/2859102421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a006c490 0x7f65a006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f659000af50 tx=0x7f659000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:52.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f659ffff700 1 --2- 172.21.15.80:0/2859102421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a006c490 0x7f65a006c920 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f659000af50 tx=0x7f659000b760).ready entity=mon.2 client_cookie=9f869a10fdc1ab17 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:52.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f659ffff700 1 --2- 172.21.15.80:0/2859102421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a006c490 0x7f65a006c920 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f659000af50 tx=0x7f659000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:52.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f659f7fe700 1 -- 172.21.15.80:0/2859102421 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6590007210 con 0x7f65a006c490 2019-11-28T11:35:52.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f659ffff700 1 --2- 172.21.15.80:0/2859102421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a006c490 0x7f65a006c920 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f659000af50 tx=0x7f659000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:52.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f659ffff700 1 --2- 172.21.15.80:0/2859102421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a006c490 0x7f65a006c920 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f659000af50 tx=0x7f659000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:52.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f659f7fe700 1 -- 172.21.15.80:0/2859102421 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65900099b0 con 0x7f65a006c490 2019-11-28T11:35:52.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f659f7fe700 1 -- 172.21.15.80:0/2859102421 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f659000a080 con 0x7f65a006c490 2019-11-28T11:35:52.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f65a68f7700 1 -- 172.21.15.80:0/2859102421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a006c490 msgr2=0x7f65a006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:52.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.931+0000 7f65a68f7700 1 --2- 172.21.15.80:0/2859102421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a006c490 0x7f65a006c920 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f659000af50 tx=0x7f659000b760).stop 2019-11-28T11:35:52.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.932+0000 7f65a68f7700 1 -- 172.21.15.80:0/2859102421 shutdown_connections 2019-11-28T11:35:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.932+0000 7f65a68f7700 1 --2- 172.21.15.80:0/2859102421 >> v2:172.21.15.174:3300/0 conn(0x7f65a006ce60 0x7f65a0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.932+0000 7f65a68f7700 1 --2- 172.21.15.80:0/2859102421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a006c490 0x7f65a006c920 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.932+0000 7f65a68f7700 1 -- 172.21.15.80:0/2859102421 shutdown_connections 2019-11-28T11:35:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.932+0000 7f65a68f7700 1 -- 172.21.15.80:0/2859102421 wait complete. 2019-11-28T11:35:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.932+0000 7f65a68f7700 1 -- 172.21.15.80:0/2859102421 >> 172.21.15.80:0/2859102421 conn(0x7f65a0061cf0 msgr2=0x7f65a0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:53.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.934+0000 7f65a68f7700 1 Processor -- start 2019-11-28T11:35:53.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.934+0000 7f65a68f7700 1 -- start start 2019-11-28T11:35:53.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.935+0000 7f65a68f7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a013eb40 0x7f65a010afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:53.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.935+0000 7f65a68f7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a013f1e0 con 0x7f65a010b500 2019-11-28T11:35:53.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.935+0000 7f65a68f7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a0131a30 con 0x7f65a01631f0 2019-11-28T11:35:53.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.935+0000 7f65a68f7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a01234c0 con 0x7f65a013eb40 2019-11-28T11:35:53.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f659ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f65a010b500 0x7f65a01629f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35280/0 (socket says 172.21.15.80:35280) 2019-11-28T11:35:53.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f659ffff700 1 -- 172.21.15.80:0/2117168158 learned_addr learned my addr 172.21.15.80:0/2117168158 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:35:53.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f65a4e94700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a013eb40 0x7f65a010afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:53.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f659d7fa700 1 -- 172.21.15.80:0/2117168158 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120819791 0 0) 0x7f659000abb0 con 0x7f65a010b500 2019-11-28T11:35:53.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f659d7fa700 1 -- 172.21.15.80:0/2117168158 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6584002e80 con 0x7f65a010b500 2019-11-28T11:35:53.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f659d7fa700 1 -- 172.21.15.80:0/2117168158 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068410711 0 0) 0x7f6598009b40 con 0x7f65a01631f0 2019-11-28T11:35:53.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f659d7fa700 1 -- 172.21.15.80:0/2117168158 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65840030b0 con 0x7f65a01631f0 2019-11-28T11:35:53.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f65a4e94700 1 -- 172.21.15.80:0/2117168158 >> v1:172.21.15.174:6789/0 conn(0x7f65a01631f0 legacy=0x7f65a0105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:53.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f65a4e94700 1 -- 172.21.15.80:0/2117168158 >> v1:172.21.15.80:6789/0 conn(0x7f65a010b500 legacy=0x7f65a01629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:53.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f65a4e94700 1 -- 172.21.15.80:0/2117168158 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a0108700 con 0x7f65a013eb40 2019-11-28T11:35:53.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f65a4e94700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a013eb40 0x7f65a010afc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6588010380 tx=0x7f6588010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:53.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f65a4e94700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a013eb40 0x7f65a010afc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6588010380 tx=0x7f6588010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:53.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f65a4e94700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a013eb40 0x7f65a010afc0 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f6588010380 tx=0x7f6588010720).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:53.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f65a4e94700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a013eb40 0x7f65a010afc0 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f6588010380 tx=0x7f6588010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:53.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f659d7fa700 1 -- 172.21.15.80:0/2117168158 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f658800f130 con 0x7f65a013eb40 2019-11-28T11:35:53.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f65a4e94700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a013eb40 0x7f65a010afc0 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f6588010380 tx=0x7f6588010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:53.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f65a4e94700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a013eb40 0x7f65a010afc0 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f6588010380 tx=0x7f6588010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:53.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f659d7fa700 1 -- 172.21.15.80:0/2117168158 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658800ed50 con 0x7f65a013eb40 2019-11-28T11:35:53.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f65a68f7700 1 -- 172.21.15.80:0/2117168158 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a0108a80 con 0x7f65a013eb40 2019-11-28T11:35:53.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f659d7fa700 1 -- 172.21.15.80:0/2117168158 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f658800f7b0 con 0x7f65a013eb40 2019-11-28T11:35:53.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.936+0000 7f65a68f7700 1 -- 172.21.15.80:0/2117168158 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a0108700 con 0x7f65a013eb40 2019-11-28T11:35:53.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.937+0000 7f65a4e94700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a013eb40 0x7f65a010afc0 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f6588010380 tx=0x7f6588010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:53.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.937+0000 7f659d7fa700 1 -- 172.21.15.80:0/2117168158 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f658800efe0 con 0x7f65a013eb40 2019-11-28T11:35:53.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.937+0000 7f65a4e94700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a013eb40 0x7f65a010afc0 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f6588010380 tx=0x7f6588010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:53.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.937+0000 7f659d7fa700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6584018750 0x7f658401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:53.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.937+0000 7f659d7fa700 1 -- 172.21.15.80:0/2117168158 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f6588031a50 con 0x7f65a013eb40 2019-11-28T11:35:53.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.937+0000 7f659ffff700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6584018750 0x7f658401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:53.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.937+0000 7f659ffff700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6584018750 0x7f658401abe0 crc :-1 s=READY pgs=396 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:53.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.945+0000 7f65a68f7700 1 -- 172.21.15.80:0/2117168158 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a0108a80 con 0x7f65a013eb40 2019-11-28T11:35:53.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.948+0000 7f65a4e94700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a013eb40 0x7f65a010afc0 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f6588010380 tx=0x7f6588010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:53.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:52.948+0000 7f659d7fa700 1 -- 172.21.15.80:0/2117168158 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f658800eb40 con 0x7f65a013eb40 2019-11-28T11:35:53.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:53.119+0000 7f65a68f7700 1 -- 172.21.15.80:0/2117168158 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65a0108700 con 0x7f65a013eb40 2019-11-28T11:35:53.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:53.119+0000 7f65a4e94700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a013eb40 0x7f65a010afc0 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f6588010380 tx=0x7f6588010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:53.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:53.119+0000 7f659d7fa700 1 -- 172.21.15.80:0/2117168158 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+1427 (secure 0 0 0) 0x7f6588017a00 con 0x7f65a013eb40 2019-11-28T11:35:53.176 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 47 2019-11-28T11:35:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:35:53.176 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:33:17.594269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:35:53.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:53.121+0000 7f65a68f7700 1 -- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6584018750 msgr2=0x7f658401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:53.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:53.121+0000 7f65a68f7700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6584018750 0x7f658401abe0 crc :-1 s=READY pgs=396 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:53.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:53.121+0000 7f65a68f7700 1 -- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a013eb40 msgr2=0x7f65a010afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:53.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:53.121+0000 7f65a68f7700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a013eb40 0x7f65a010afc0 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f6588010380 tx=0x7f6588010720).stop 2019-11-28T11:35:53.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:53.122+0000 7f65a68f7700 1 -- 172.21.15.80:0/2117168158 shutdown_connections 2019-11-28T11:35:53.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:53.122+0000 7f65a68f7700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6584018750 0x7f658401abe0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:53.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:53.122+0000 7f65a68f7700 1 --2- 172.21.15.80:0/2117168158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a013eb40 0x7f65a010afc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:53.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:53.122+0000 7f65a68f7700 1 -- 172.21.15.80:0/2117168158 shutdown_connections 2019-11-28T11:35:53.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:53.122+0000 7f65a68f7700 1 -- 172.21.15.80:0/2117168158 wait complete. 2019-11-28T11:35:53.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:53.122+0000 7f65a68f7700 1 -- 172.21.15.80:0/2117168158 >> 172.21.15.80:0/2117168158 conn(0x7f65a011bfc0 msgr2=0x7f65a0141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:53.187 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T11:35:54.189 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:35:54.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.259+0000 7fa3e481e700 1 Processor -- start 2019-11-28T11:35:54.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.259+0000 7fa3e481e700 1 -- start start 2019-11-28T11:35:54.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.260+0000 7fa3e481e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa3e006c0a0 0x7fa3e0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:54.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.260+0000 7fa3e481e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa3e0072620 0x7fa3e0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:54.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.260+0000 7fa3e481e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e006db00 con 0x7fa3e00734e0 2019-11-28T11:35:54.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.260+0000 7fa3e481e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e006fd60 con 0x7fa3e006c0a0 2019-11-28T11:35:54.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.260+0000 7fa3e481e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e0070030 con 0x7fa3e0072620 2019-11-28T11:35:54.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.260+0000 7fa3ded9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa3e006c0a0 0x7fa3e0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:54.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.260+0000 7fa3ded9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa3e006c0a0 0x7fa3e0072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35970/0 (socket says 172.21.15.80:35970) 2019-11-28T11:35:54.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.260+0000 7fa3ded9d700 1 -- 172.21.15.80:0/2638443656 learned_addr learned my addr 172.21.15.80:0/2638443656 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:35:54.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.260+0000 7fa3de59c700 1 --1- 172.21.15.80:0/2638443656 >> v1:172.21.15.80:6789/0 conn(0x7fa3e00734e0 0x7fa3e0071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35290/0 (socket says 172.21.15.80:35290) 2019-11-28T11:35:54.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.260+0000 7fa3df59e700 1 --2- 172.21.15.80:0/2638443656 >> v2:172.21.15.174:3300/0 conn(0x7fa3e0072620 0x7fa3e0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:54.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.260+0000 7fa3ded9d700 1 -- 172.21.15.80:0/2638443656 >> v2:172.21.15.174:3300/0 conn(0x7fa3e0072620 msgr2=0x7fa3e0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:35:54.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.260+0000 7fa3ded9d700 1 --2- 172.21.15.80:0/2638443656 >> v2:172.21.15.174:3300/0 conn(0x7fa3e0072620 0x7fa3e0164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:54.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.260+0000 7fa3ded9d700 1 -- 172.21.15.80:0/2638443656 >> v1:172.21.15.80:6789/0 conn(0x7fa3e00734e0 legacy=0x7fa3e0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:54.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.260+0000 7fa3ded9d700 1 -- 172.21.15.80:0/2638443656 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e00706c0 con 0x7fa3e006c0a0 2019-11-28T11:35:54.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.260+0000 7fa3ddd9b700 1 -- 172.21.15.80:0/2638443656 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233163362 0 0) 0x7fa3d4001070 con 0x7fa3e00734e0 2019-11-28T11:35:54.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.261+0000 7fa3ded9d700 1 --2- 172.21.15.80:0/2638443656 >> v2:172.21.15.80:3300/0 conn(0x7fa3e006c0a0 0x7fa3e0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa3d000fa40 tx=0x7fa3d000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:54.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.261+0000 7fa3ded9d700 1 --2- 172.21.15.80:0/2638443656 >> v2:172.21.15.80:3300/0 conn(0x7fa3e006c0a0 0x7fa3e0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa3d000fa40 tx=0x7fa3d000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:54.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.261+0000 7fa3ded9d700 1 --2- 172.21.15.80:0/2638443656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e006c0a0 0x7fa3e0072fa0 secure :-1 s=READY pgs=971 cs=0 l=1 rx=0x7fa3d000fa40 tx=0x7fa3d000fde0).ready entity=mon.0 client_cookie=713c894435bf360d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:54.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.261+0000 7fa3ded9d700 1 --2- 172.21.15.80:0/2638443656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e006c0a0 0x7fa3e0072fa0 secure :-1 s=THROTTLE_DONE pgs=971 cs=0 l=1 rx=0x7fa3d000fa40 tx=0x7fa3d000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:54.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.261+0000 7fa3ddd9b700 1 -- 172.21.15.80:0/2638443656 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3d0000ce0 con 0x7fa3e006c0a0 2019-11-28T11:35:54.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.261+0000 7fa3ded9d700 1 --2- 172.21.15.80:0/2638443656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e006c0a0 0x7fa3e0072fa0 secure :-1 s=THROTTLE_DONE pgs=971 cs=0 l=1 rx=0x7fa3d000fa40 tx=0x7fa3d000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:54.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.261+0000 7fa3ded9d700 1 --2- 172.21.15.80:0/2638443656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e006c0a0 0x7fa3e0072fa0 secure :-1 s=THROTTLE_DONE pgs=971 cs=0 l=1 rx=0x7fa3d000fa40 tx=0x7fa3d000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:54.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.261+0000 7fa3ddd9b700 1 -- 172.21.15.80:0/2638443656 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d0001010 con 0x7fa3e006c0a0 2019-11-28T11:35:54.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.261+0000 7fa3ddd9b700 1 -- 172.21.15.80:0/2638443656 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3d0001720 con 0x7fa3e006c0a0 2019-11-28T11:35:54.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.261+0000 7fa3e481e700 1 -- 172.21.15.80:0/2638443656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e006c0a0 msgr2=0x7fa3e0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:54.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.261+0000 7fa3e481e700 1 --2- 172.21.15.80:0/2638443656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e006c0a0 0x7fa3e0072fa0 secure :-1 s=READY pgs=971 cs=0 l=1 rx=0x7fa3d000fa40 tx=0x7fa3d000fde0).stop 2019-11-28T11:35:54.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.262+0000 7fa3e481e700 1 -- 172.21.15.80:0/2638443656 shutdown_connections 2019-11-28T11:35:54.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.262+0000 7fa3e481e700 1 --2- 172.21.15.80:0/2638443656 >> v2:172.21.15.174:3300/0 conn(0x7fa3e0072620 0x7fa3e0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:54.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.262+0000 7fa3e481e700 1 --2- 172.21.15.80:0/2638443656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e006c0a0 0x7fa3e0072fa0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:54.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.262+0000 7fa3e481e700 1 -- 172.21.15.80:0/2638443656 shutdown_connections 2019-11-28T11:35:54.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.262+0000 7fa3e481e700 1 -- 172.21.15.80:0/2638443656 wait complete. 2019-11-28T11:35:54.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.262+0000 7fa3e481e700 1 -- 172.21.15.80:0/2638443656 >> 172.21.15.80:0/2638443656 conn(0x7fa3e0061cf0 msgr2=0x7fa3e0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:54.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.264+0000 7fa3e481e700 1 Processor -- start 2019-11-28T11:35:54.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.264+0000 7fa3e481e700 1 -- start start 2019-11-28T11:35:54.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.265+0000 7fa3e481e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa3e0104820 0x7fa3e010c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:54.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.265+0000 7fa3e481e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa3e010b9d0 0x7fa3e0167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:54.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.265+0000 7fa3e481e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e013bcd0 con 0x7fa3e010c890 2019-11-28T11:35:54.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.265+0000 7fa3e481e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e0109130 con 0x7fa3e010b9d0 2019-11-28T11:35:54.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.265+0000 7fa3e481e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e0109400 con 0x7fa3e0104820 2019-11-28T11:35:54.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.265+0000 7fa3df59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa3e010b9d0 0x7fa3e0167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:54.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.265+0000 7fa3df59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa3e010b9d0 0x7fa3e0167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35980/0 (socket says 172.21.15.80:35980) 2019-11-28T11:35:54.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.265+0000 7fa3df59e700 1 -- 172.21.15.80:0/2639833341 learned_addr learned my addr 172.21.15.80:0/2639833341 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:35:54.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.265+0000 7fa3ded9d700 1 --2- 172.21.15.80:0/2639833341 >> v2:172.21.15.174:3300/0 conn(0x7fa3e0104820 0x7fa3e010c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:54.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.265+0000 7fa3df59e700 1 -- 172.21.15.80:0/2639833341 >> v2:172.21.15.174:3300/0 conn(0x7fa3e0104820 msgr2=0x7fa3e010c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:54.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.265+0000 7fa3df59e700 1 --2- 172.21.15.80:0/2639833341 >> v2:172.21.15.174:3300/0 conn(0x7fa3e0104820 0x7fa3e010c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:54.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.265+0000 7fa3df59e700 1 -- 172.21.15.80:0/2639833341 >> v1:172.21.15.174:6789/0 conn(0x7fa3e010c890 legacy=0x7fa3e010b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:54.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.265+0000 7fa3df59e700 1 -- 172.21.15.80:0/2639833341 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e0109a90 con 0x7fa3e010b9d0 2019-11-28T11:35:54.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.265+0000 7fa3df59e700 1 --2- 172.21.15.80:0/2639833341 >> v2:172.21.15.80:3300/0 conn(0x7fa3e010b9d0 0x7fa3e0167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa3d8010440 tx=0x7fa3d8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:54.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.265+0000 7fa3df59e700 1 --2- 172.21.15.80:0/2639833341 >> v2:172.21.15.80:3300/0 conn(0x7fa3e010b9d0 0x7fa3e0167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa3d8010440 tx=0x7fa3d8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:54.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.265+0000 7fa3df59e700 1 --2- 172.21.15.80:0/2639833341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e010b9d0 0x7fa3e0167a10 secure :-1 s=READY pgs=972 cs=0 l=1 rx=0x7fa3d8010440 tx=0x7fa3d8006f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:54.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.266+0000 7fa3df59e700 1 --2- 172.21.15.80:0/2639833341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e010b9d0 0x7fa3e0167a10 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7fa3d8010440 tx=0x7fa3d8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:54.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.266+0000 7fa3df59e700 1 --2- 172.21.15.80:0/2639833341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e010b9d0 0x7fa3e0167a10 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7fa3d8010440 tx=0x7fa3d8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:54.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.266+0000 7fa3df59e700 1 --2- 172.21.15.80:0/2639833341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e010b9d0 0x7fa3e0167a10 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7fa3d8010440 tx=0x7fa3d8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:54.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.266+0000 7fa3cf7fe700 1 -- 172.21.15.80:0/2639833341 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3d8000a70 con 0x7fa3e010b9d0 2019-11-28T11:35:54.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.266+0000 7fa3cf7fe700 1 -- 172.21.15.80:0/2639833341 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d800ecb0 con 0x7fa3e010b9d0 2019-11-28T11:35:54.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.266+0000 7fa3cf7fe700 1 -- 172.21.15.80:0/2639833341 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3d800f380 con 0x7fa3e010b9d0 2019-11-28T11:35:54.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.266+0000 7fa3e481e700 1 -- 172.21.15.80:0/2639833341 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e0109e10 con 0x7fa3e010b9d0 2019-11-28T11:35:54.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.266+0000 7fa3e481e700 1 -- 172.21.15.80:0/2639833341 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e0109a90 con 0x7fa3e010b9d0 2019-11-28T11:35:54.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.266+0000 7fa3df59e700 1 --2- 172.21.15.80:0/2639833341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e010b9d0 0x7fa3e0167a10 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7fa3d8010440 tx=0x7fa3d8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:54.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.266+0000 7fa3cf7fe700 1 -- 172.21.15.80:0/2639833341 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa3d8000a70 con 0x7fa3e010b9d0 2019-11-28T11:35:54.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.266+0000 7fa3df59e700 1 --2- 172.21.15.80:0/2639833341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e010b9d0 0x7fa3e0167a10 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7fa3d8010440 tx=0x7fa3d8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:54.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.266+0000 7fa3cf7fe700 1 --2- 172.21.15.80:0/2639833341 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa3c4018730 0x7fa3c401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:54.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.266+0000 7fa3cf7fe700 1 -- 172.21.15.80:0/2639833341 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fa3d8031a70 con 0x7fa3e010b9d0 2019-11-28T11:35:54.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.266+0000 7fa3ded9d700 1 --2- 172.21.15.80:0/2639833341 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa3c4018730 0x7fa3c401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:54.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.267+0000 7fa3ded9d700 1 --2- 172.21.15.80:0/2639833341 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa3c4018730 0x7fa3c401abc0 crc :-1 s=READY pgs=397 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:54.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.274+0000 7fa3e481e700 1 -- 172.21.15.80:0/2639833341 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e0109e10 con 0x7fa3e010b9d0 2019-11-28T11:35:54.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.278+0000 7fa3df59e700 1 --2- 172.21.15.80:0/2639833341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e010b9d0 0x7fa3e0167a10 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7fa3d8010440 tx=0x7fa3d8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:54.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.278+0000 7fa3cf7fe700 1 -- 172.21.15.80:0/2639833341 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa3d802af20 con 0x7fa3e010b9d0 2019-11-28T11:35:54.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.451+0000 7fa3e481e700 1 -- 172.21.15.80:0/2639833341 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3e0109a90 con 0x7fa3e010b9d0 2019-11-28T11:35:54.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.451+0000 7fa3df59e700 1 --2- 172.21.15.80:0/2639833341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e010b9d0 0x7fa3e0167a10 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7fa3d8010440 tx=0x7fa3d8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:54.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.451+0000 7fa3cf7fe700 1 -- 172.21.15.80:0/2639833341 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+1427 (secure 0 0 0) 0x7fa3d800ea80 con 0x7fa3e010b9d0 2019-11-28T11:35:54.507 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 47 2019-11-28T11:35:54.508 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:35:54.508 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:33:17.594269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:35:54.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.453+0000 7fa3e481e700 1 -- 172.21.15.80:0/2639833341 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa3c4018730 msgr2=0x7fa3c401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:54.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.453+0000 7fa3e481e700 1 --2- 172.21.15.80:0/2639833341 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa3c4018730 0x7fa3c401abc0 crc :-1 s=READY pgs=397 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:54.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.453+0000 7fa3e481e700 1 -- 172.21.15.80:0/2639833341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e010b9d0 msgr2=0x7fa3e0167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:54.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.453+0000 7fa3e481e700 1 --2- 172.21.15.80:0/2639833341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e010b9d0 0x7fa3e0167a10 secure :-1 s=READY pgs=972 cs=0 l=1 rx=0x7fa3d8010440 tx=0x7fa3d8006f90).stop 2019-11-28T11:35:54.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.454+0000 7fa3e481e700 1 -- 172.21.15.80:0/2639833341 shutdown_connections 2019-11-28T11:35:54.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.454+0000 7fa3e481e700 1 --2- 172.21.15.80:0/2639833341 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3e010b9d0 0x7fa3e0167a10 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:54.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.454+0000 7fa3e481e700 1 --2- 172.21.15.80:0/2639833341 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa3c4018730 0x7fa3c401abc0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:54.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.454+0000 7fa3e481e700 1 --2- 172.21.15.80:0/2639833341 >> v2:172.21.15.174:3300/0 conn(0x7fa3e0104820 0x7fa3e010c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:54.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.454+0000 7fa3e481e700 1 -- 172.21.15.80:0/2639833341 shutdown_connections 2019-11-28T11:35:54.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.454+0000 7fa3e481e700 1 -- 172.21.15.80:0/2639833341 wait complete. 2019-11-28T11:35:54.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:54.454+0000 7fa3e481e700 1 -- 172.21.15.80:0/2639833341 >> 172.21.15.80:0/2639833341 conn(0x7fa3e013d620 msgr2=0x7fa3e013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:54.519 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T11:35:55.520 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:35:55.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.585+0000 7fecf72b5700 1 Processor -- start 2019-11-28T11:35:55.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.585+0000 7fecf72b5700 1 -- start start 2019-11-28T11:35:55.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.586+0000 7fecf72b5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fecf006c490 0x7fecf006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:55.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.586+0000 7fecf72b5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fecf006ce60 0x7fecf0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:55.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.586+0000 7fecf72b5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf006db00 con 0x7fecf006c0a0 2019-11-28T11:35:55.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.586+0000 7fecf72b5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf006fd60 con 0x7fecf006c490 2019-11-28T11:35:55.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.586+0000 7fecf72b5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf0070030 con 0x7fecf006ce60 2019-11-28T11:35:55.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf5051700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fecf006c490 0x7fecf006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:55.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf5051700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fecf006c490 0x7fecf006c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35992/0 (socket says 172.21.15.80:35992) 2019-11-28T11:35:55.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf5051700 1 -- 172.21.15.80:0/2785260907 learned_addr learned my addr 172.21.15.80:0/2785260907 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:35:55.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf6053700 1 --2- 172.21.15.80:0/2785260907 >> v2:172.21.15.174:3300/0 conn(0x7fecf006ce60 0x7fecf0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:55.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf5051700 1 -- 172.21.15.80:0/2785260907 >> v2:172.21.15.174:3300/0 conn(0x7fecf006ce60 msgr2=0x7fecf0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:35:55.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf5051700 1 --2- 172.21.15.80:0/2785260907 >> v2:172.21.15.174:3300/0 conn(0x7fecf006ce60 0x7fecf0164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:55.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf5051700 1 -- 172.21.15.80:0/2785260907 >> v1:172.21.15.174:6789/0 conn(0x7fecf006c0a0 legacy=0x7fecf0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:55.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf5051700 1 -- 172.21.15.80:0/2785260907 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf00706c0 con 0x7fecf006c490 2019-11-28T11:35:55.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf5051700 1 --2- 172.21.15.80:0/2785260907 >> v2:172.21.15.80:3300/0 conn(0x7fecf006c490 0x7fecf006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fecd800f740 tx=0x7fecd800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf5051700 1 --2- 172.21.15.80:0/2785260907 >> v2:172.21.15.80:3300/0 conn(0x7fecf006c490 0x7fecf006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fecd800f740 tx=0x7fecd800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf5051700 1 --2- 172.21.15.80:0/2785260907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf006c490 0x7fecf006c920 secure :-1 s=READY pgs=973 cs=0 l=1 rx=0x7fecd800f740 tx=0x7fecd800f570).ready entity=mon.0 client_cookie=fb480be800eefcf3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:55.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf5051700 1 --2- 172.21.15.80:0/2785260907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf006c490 0x7fecf006c920 secure :-1 s=THROTTLE_DONE pgs=973 cs=0 l=1 rx=0x7fecd800f740 tx=0x7fecd800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf5051700 1 --2- 172.21.15.80:0/2785260907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf006c490 0x7fecf006c920 secure :-1 s=THROTTLE_DONE pgs=973 cs=0 l=1 rx=0x7fecd800f740 tx=0x7fecd800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf4850700 1 -- 172.21.15.80:0/2785260907 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecd8000960 con 0x7fecf006c490 2019-11-28T11:35:55.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf5051700 1 --2- 172.21.15.80:0/2785260907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf006c490 0x7fecf006c920 secure :-1 s=THROTTLE_DONE pgs=973 cs=0 l=1 rx=0x7fecd800f740 tx=0x7fecd800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf4850700 1 -- 172.21.15.80:0/2785260907 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd8000c90 con 0x7fecf006c490 2019-11-28T11:35:55.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf4850700 1 -- 172.21.15.80:0/2785260907 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecd80013a0 con 0x7fecf006c490 2019-11-28T11:35:55.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf72b5700 1 -- 172.21.15.80:0/2785260907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf006c490 msgr2=0x7fecf006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:55.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.587+0000 7fecf72b5700 1 --2- 172.21.15.80:0/2785260907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf006c490 0x7fecf006c920 secure :-1 s=READY pgs=973 cs=0 l=1 rx=0x7fecd800f740 tx=0x7fecd800f570).stop 2019-11-28T11:35:55.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.588+0000 7fecf72b5700 1 -- 172.21.15.80:0/2785260907 shutdown_connections 2019-11-28T11:35:55.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.588+0000 7fecf72b5700 1 --2- 172.21.15.80:0/2785260907 >> v2:172.21.15.174:3300/0 conn(0x7fecf006ce60 0x7fecf0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:55.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.588+0000 7fecf72b5700 1 --2- 172.21.15.80:0/2785260907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf006c490 0x7fecf006c920 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:55.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.588+0000 7fecf72b5700 1 -- 172.21.15.80:0/2785260907 shutdown_connections 2019-11-28T11:35:55.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.588+0000 7fecf72b5700 1 -- 172.21.15.80:0/2785260907 wait complete. 2019-11-28T11:35:55.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.588+0000 7fecf72b5700 1 -- 172.21.15.80:0/2785260907 >> 172.21.15.80:0/2785260907 conn(0x7fecf0061cf0 msgr2=0x7fecf0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:55.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.591+0000 7fecf72b5700 1 Processor -- start 2019-11-28T11:35:55.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.591+0000 7fecf72b5700 1 -- start start 2019-11-28T11:35:55.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.591+0000 7fecf72b5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fecf015fdf0 0x7fecf012b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:55.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.591+0000 7fecf72b5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fecf012b8a0 0x7fecf013e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:55.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.591+0000 7fecf72b5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf0139e00 con 0x7fecf013e860 2019-11-28T11:35:55.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.591+0000 7fecf72b5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf0108820 con 0x7fecf012b8a0 2019-11-28T11:35:55.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.591+0000 7fecf72b5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf0108af0 con 0x7fecf015fdf0 2019-11-28T11:35:55.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf5051700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fecf012b8a0 0x7fecf013e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:55.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf5051700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fecf012b8a0 0x7fecf013e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35996/0 (socket says 172.21.15.80:35996) 2019-11-28T11:35:55.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf5051700 1 -- 172.21.15.80:0/4086648969 learned_addr learned my addr 172.21.15.80:0/4086648969 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:35:55.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf5852700 1 --2- 172.21.15.80:0/4086648969 >> v2:172.21.15.174:3300/0 conn(0x7fecf015fdf0 0x7fecf012b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:55.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf5051700 1 -- 172.21.15.80:0/4086648969 >> v2:172.21.15.174:3300/0 conn(0x7fecf015fdf0 msgr2=0x7fecf012b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:55.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf5051700 1 --2- 172.21.15.80:0/4086648969 >> v2:172.21.15.174:3300/0 conn(0x7fecf015fdf0 0x7fecf012b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:55.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf5051700 1 -- 172.21.15.80:0/4086648969 >> v1:172.21.15.80:6789/0 conn(0x7fecf013e860 legacy=0x7fecf012a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:55.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf5051700 1 -- 172.21.15.80:0/4086648969 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf010a8c0 con 0x7fecf012b8a0 2019-11-28T11:35:55.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecee7fc700 1 -- 172.21.15.80:0/4086648969 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130137169 0 0) 0x7fece8001400 con 0x7fecf013e860 2019-11-28T11:35:55.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf5051700 1 --2- 172.21.15.80:0/4086648969 >> v2:172.21.15.80:3300/0 conn(0x7fecf012b8a0 0x7fecf013e320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fecd8007bb0 tx=0x7fecd8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf5051700 1 --2- 172.21.15.80:0/4086648969 >> v2:172.21.15.80:3300/0 conn(0x7fecf012b8a0 0x7fecf013e320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fecd8007bb0 tx=0x7fecd8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf5051700 1 --2- 172.21.15.80:0/4086648969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf012b8a0 0x7fecf013e320 secure :-1 s=READY pgs=975 cs=0 l=1 rx=0x7fecd8007bb0 tx=0x7fecd8010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:55.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf5051700 1 --2- 172.21.15.80:0/4086648969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf012b8a0 0x7fecf013e320 secure :-1 s=THROTTLE_DONE pgs=975 cs=0 l=1 rx=0x7fecd8007bb0 tx=0x7fecd8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecee7fc700 1 -- 172.21.15.80:0/4086648969 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecd8007dd0 con 0x7fecf012b8a0 2019-11-28T11:35:55.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf5051700 1 --2- 172.21.15.80:0/4086648969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf012b8a0 0x7fecf013e320 secure :-1 s=THROTTLE_DONE pgs=975 cs=0 l=1 rx=0x7fecd8007bb0 tx=0x7fecd8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf5051700 1 --2- 172.21.15.80:0/4086648969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf012b8a0 0x7fecf013e320 secure :-1 s=THROTTLE_DONE pgs=975 cs=0 l=1 rx=0x7fecd8007bb0 tx=0x7fecd8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecee7fc700 1 -- 172.21.15.80:0/4086648969 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd8005580 con 0x7fecf012b8a0 2019-11-28T11:35:55.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf72b5700 1 -- 172.21.15.80:0/4086648969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf010a8c0 con 0x7fecf012b8a0 2019-11-28T11:35:55.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecee7fc700 1 -- 172.21.15.80:0/4086648969 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecd8005c90 con 0x7fecf012b8a0 2019-11-28T11:35:55.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf72b5700 1 -- 172.21.15.80:0/4086648969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf010a8c0 con 0x7fecf012b8a0 2019-11-28T11:35:55.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.592+0000 7fecf5051700 1 --2- 172.21.15.80:0/4086648969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf012b8a0 0x7fecf013e320 secure :-1 s=THROTTLE_DONE pgs=975 cs=0 l=1 rx=0x7fecd8007bb0 tx=0x7fecd8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.593+0000 7fecee7fc700 1 -- 172.21.15.80:0/4086648969 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fecd8005770 con 0x7fecf012b8a0 2019-11-28T11:35:55.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.593+0000 7fecf5051700 1 --2- 172.21.15.80:0/4086648969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf012b8a0 0x7fecf013e320 secure :-1 s=THROTTLE_DONE pgs=975 cs=0 l=1 rx=0x7fecd8007bb0 tx=0x7fecd8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.593+0000 7fecee7fc700 1 --2- 172.21.15.80:0/4086648969 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fecd4018730 0x7fecd401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:55.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.593+0000 7fecee7fc700 1 -- 172.21.15.80:0/4086648969 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fecd8031d40 con 0x7fecf012b8a0 2019-11-28T11:35:55.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.593+0000 7fecf5852700 1 --2- 172.21.15.80:0/4086648969 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fecd4018730 0x7fecd401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:55.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.593+0000 7fecf5852700 1 --2- 172.21.15.80:0/4086648969 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fecd4018730 0x7fecd401abe0 crc :-1 s=READY pgs=401 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:55.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.601+0000 7fecf72b5700 1 -- 172.21.15.80:0/4086648969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf0109180 con 0x7fecf012b8a0 2019-11-28T11:35:55.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.604+0000 7fecf5051700 1 --2- 172.21.15.80:0/4086648969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf012b8a0 0x7fecf013e320 secure :-1 s=THROTTLE_DONE pgs=975 cs=0 l=1 rx=0x7fecd8007bb0 tx=0x7fecd8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.604+0000 7fecee7fc700 1 -- 172.21.15.80:0/4086648969 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fecd8005180 con 0x7fecf012b8a0 2019-11-28T11:35:55.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.776+0000 7fecf72b5700 1 -- 172.21.15.80:0/4086648969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecf0109500 con 0x7fecf012b8a0 2019-11-28T11:35:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.777+0000 7fecf5051700 1 --2- 172.21.15.80:0/4086648969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf012b8a0 0x7fecf013e320 secure :-1 s=THROTTLE_DONE pgs=975 cs=0 l=1 rx=0x7fecd8007bb0 tx=0x7fecd8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.777+0000 7fecee7fc700 1 -- 172.21.15.80:0/4086648969 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fecd8007580 con 0x7fecf012b8a0 2019-11-28T11:35:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:35:55.833 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:35:55.834 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:35:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.779+0000 7fecf72b5700 1 -- 172.21.15.80:0/4086648969 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fecd4018730 msgr2=0x7fecd401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.779+0000 7fecf72b5700 1 --2- 172.21.15.80:0/4086648969 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fecd4018730 0x7fecd401abe0 crc :-1 s=READY pgs=401 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.779+0000 7fecf72b5700 1 -- 172.21.15.80:0/4086648969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf012b8a0 msgr2=0x7fecf013e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.779+0000 7fecf72b5700 1 --2- 172.21.15.80:0/4086648969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf012b8a0 0x7fecf013e320 secure :-1 s=READY pgs=975 cs=0 l=1 rx=0x7fecd8007bb0 tx=0x7fecd8010730).stop 2019-11-28T11:35:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.779+0000 7fecf72b5700 1 -- 172.21.15.80:0/4086648969 shutdown_connections 2019-11-28T11:35:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.779+0000 7fecf72b5700 1 --2- 172.21.15.80:0/4086648969 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fecd4018730 0x7fecd401abe0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.779+0000 7fecf72b5700 1 --2- 172.21.15.80:0/4086648969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf012b8a0 0x7fecf013e320 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.779+0000 7fecf72b5700 1 --2- 172.21.15.80:0/4086648969 >> v2:172.21.15.174:3300/0 conn(0x7fecf015fdf0 0x7fecf012b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.779+0000 7fecf72b5700 1 -- 172.21.15.80:0/4086648969 shutdown_connections 2019-11-28T11:35:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.779+0000 7fecf72b5700 1 -- 172.21.15.80:0/4086648969 wait complete. 2019-11-28T11:35:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.779+0000 7fecf72b5700 1 -- 172.21.15.80:0/4086648969 >> 172.21.15.80:0/4086648969 conn(0x7fecf0127dc0 msgr2=0x7fecf0141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:55.845 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to up:reconnect 2019-11-28T11:35:55.845 INFO:tasks.cephfs.filesystem:reached state 'up:reconnect' in 5.65414404869s 2019-11-28T11:35:55.845 INFO:tasks.cephfs.test_client_recovery:Waiting for active... 2019-11-28T11:35:55.845 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:35:55.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.908+0000 7fa26790c700 1 Processor -- start 2019-11-28T11:35:55.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.908+0000 7fa26790c700 1 -- start start 2019-11-28T11:35:55.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.909+0000 7fa26790c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa26006c490 0x7fa26006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:55.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.909+0000 7fa26790c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26006db00 con 0x7fa26006c0a0 2019-11-28T11:35:55.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.909+0000 7fa26790c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26006e000 con 0x7fa26006ce60 2019-11-28T11:35:55.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.909+0000 7fa26790c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26006fd60 con 0x7fa26006c490 2019-11-28T11:35:55.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.909+0000 7fa265ea9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa26006c0a0 0x7fa260072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35318/0 (socket says 172.21.15.80:35318) 2019-11-28T11:35:55.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.909+0000 7fa265ea9700 1 -- 172.21.15.80:0/18591535 learned_addr learned my addr 172.21.15.80:0/18591535 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:35:55.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.909+0000 7fa264ea7700 1 -- 172.21.15.80:0/18591535 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70852349 0 0) 0x7fa254001150 con 0x7fa26006c0a0 2019-11-28T11:35:55.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.909+0000 7fa2656a8700 1 --2- 172.21.15.80:0/18591535 >> v2:172.21.15.174:3300/0 conn(0x7fa26006c490 0x7fa26006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:55.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.909+0000 7fa264ea7700 1 -- 172.21.15.80:0/18591535 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa248002e80 con 0x7fa26006c0a0 2019-11-28T11:35:55.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa264ea7700 1 -- 172.21.15.80:0/18591535 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2128208822 0 0) 0x7fa254001130 con 0x7fa26006c0a0 2019-11-28T11:35:55.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa264ea7700 1 -- 172.21.15.80:0/18591535 >> v2:172.21.15.174:3300/0 conn(0x7fa26006c490 msgr2=0x7fa26006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:35:55.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa264ea7700 1 --2- 172.21.15.80:0/18591535 >> v2:172.21.15.174:3300/0 conn(0x7fa26006c490 0x7fa26006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:55.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa264ea7700 1 -- 172.21.15.80:0/18591535 >> v1:172.21.15.174:6789/0 conn(0x7fa26006ce60 legacy=0x7fa260164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:55.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa264ea7700 1 -- 172.21.15.80:0/18591535 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2600706c0 con 0x7fa26006c0a0 2019-11-28T11:35:55.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa264ea7700 1 -- 172.21.15.80:0/18591535 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fa254001660 con 0x7fa26006c0a0 2019-11-28T11:35:55.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa264ea7700 1 -- 172.21.15.80:0/18591535 >> v1:172.21.15.80:6789/0 conn(0x7fa26006c0a0 legacy=0x7fa260072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:55.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa264ea7700 1 --2- 172.21.15.80:0/18591535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa248003ab0 0x7fa248005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:55.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa264ea7700 1 --2- 172.21.15.80:0/18591535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa248006670 0x7fa248008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:55.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa264ea7700 1 --2- 172.21.15.80:0/18591535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa248009380 0x7fa24800b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:55.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa264ea7700 1 -- 172.21.15.80:0/18591535 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24800c000 con 0x7fa248003ab0 2019-11-28T11:35:55.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa265ea9700 1 --2- 172.21.15.80:0/18591535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa248003ab0 0x7fa248005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:55.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa264ea7700 1 -- 172.21.15.80:0/18591535 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa248050200 con 0x7fa248009380 2019-11-28T11:35:55.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa264ea7700 1 -- 172.21.15.80:0/18591535 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa248050430 con 0x7fa248006670 2019-11-28T11:35:55.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa2656a8700 1 --2- 172.21.15.80:0/18591535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa248006670 0x7fa248008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:55.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa2666aa700 1 --2- 172.21.15.80:0/18591535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa248009380 0x7fa24800b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:55.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa265ea9700 1 -- 172.21.15.80:0/18591535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa248006670 msgr2=0x7fa248008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:35:55.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa265ea9700 1 --2- 172.21.15.80:0/18591535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa248006670 0x7fa248008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:55.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa265ea9700 1 -- 172.21.15.80:0/18591535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa248009380 msgr2=0x7fa24800b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:35:55.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa265ea9700 1 --2- 172.21.15.80:0/18591535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa248009380 0x7fa24800b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:55.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa2666aa700 1 -- 172.21.15.80:0/18591535 reap_dead start 2019-11-28T11:35:55.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa265ea9700 1 -- 172.21.15.80:0/18591535 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2480506e0 con 0x7fa248003ab0 2019-11-28T11:35:55.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa265ea9700 1 --2- 172.21.15.80:0/18591535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa248003ab0 0x7fa248005ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa25400f8e0 tx=0x7fa25400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa265ea9700 1 --2- 172.21.15.80:0/18591535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa248003ab0 0x7fa248005ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa25400f8e0 tx=0x7fa25400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa265ea9700 1 --2- 172.21.15.80:0/18591535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa248003ab0 0x7fa248005ef0 secure :-1 s=READY pgs=977 cs=0 l=1 rx=0x7fa25400f8e0 tx=0x7fa25400f790).ready entity=mon.0 client_cookie=bc5169e598bc1cd8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa265ea9700 1 --2- 172.21.15.80:0/18591535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa248003ab0 0x7fa248005ef0 secure :-1 s=THROTTLE_DONE pgs=977 cs=0 l=1 rx=0x7fa25400f8e0 tx=0x7fa25400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa264ea7700 1 -- 172.21.15.80:0/18591535 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa254001130 con 0x7fa248003ab0 2019-11-28T11:35:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa265ea9700 1 --2- 172.21.15.80:0/18591535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa248003ab0 0x7fa248005ef0 secure :-1 s=THROTTLE_DONE pgs=977 cs=0 l=1 rx=0x7fa25400f8e0 tx=0x7fa25400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa265ea9700 1 --2- 172.21.15.80:0/18591535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa248003ab0 0x7fa248005ef0 secure :-1 s=THROTTLE_DONE pgs=977 cs=0 l=1 rx=0x7fa25400f8e0 tx=0x7fa25400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa264ea7700 1 -- 172.21.15.80:0/18591535 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa254004240 con 0x7fa248003ab0 2019-11-28T11:35:55.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa264ea7700 1 -- 172.21.15.80:0/18591535 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa254001130 con 0x7fa248003ab0 2019-11-28T11:35:55.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa26790c700 1 -- 172.21.15.80:0/18591535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa248003ab0 msgr2=0x7fa248005ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:55.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.910+0000 7fa26790c700 1 --2- 172.21.15.80:0/18591535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa248003ab0 0x7fa248005ef0 secure :-1 s=READY pgs=977 cs=0 l=1 rx=0x7fa25400f8e0 tx=0x7fa25400f790).stop 2019-11-28T11:35:55.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.911+0000 7fa26790c700 1 -- 172.21.15.80:0/18591535 shutdown_connections 2019-11-28T11:35:55.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.911+0000 7fa26790c700 1 --2- 172.21.15.80:0/18591535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa248003ab0 0x7fa248005ef0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:55.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.911+0000 7fa26790c700 1 -- 172.21.15.80:0/18591535 shutdown_connections 2019-11-28T11:35:55.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.911+0000 7fa26790c700 1 -- 172.21.15.80:0/18591535 wait complete. 2019-11-28T11:35:55.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.911+0000 7fa26790c700 1 -- 172.21.15.80:0/18591535 >> 172.21.15.80:0/18591535 conn(0x7fa260061cf0 msgr2=0x7fa260064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:55.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.914+0000 7fa26790c700 1 Processor -- start 2019-11-28T11:35:55.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.914+0000 7fa26790c700 1 -- start start 2019-11-28T11:35:55.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.914+0000 7fa26790c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa2600750f0 0x7fa260151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:55.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.914+0000 7fa26790c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa260151f90 0x7fa2601523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:55.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.914+0000 7fa26790c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa260079230 con 0x7fa260074d00 2019-11-28T11:35:55.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.914+0000 7fa26790c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26007ab30 con 0x7fa2600750f0 2019-11-28T11:35:55.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.914+0000 7fa26790c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26007ae00 con 0x7fa260151f90 2019-11-28T11:35:55.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa265ea9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa260074d00 0x7fa260152bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35330/0 (socket says 172.21.15.80:35330) 2019-11-28T11:35:55.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa265ea9700 1 -- 172.21.15.80:0/606802848 learned_addr learned my addr 172.21.15.80:0/606802848 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:35:55.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa2666aa700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa260151f90 0x7fa2601523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:55.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa2656a8700 1 --2- 172.21.15.80:0/606802848 >> v2:172.21.15.174:3300/0 conn(0x7fa2600750f0 0x7fa260151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:55.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa25e7fc700 1 -- 172.21.15.80:0/606802848 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602345748 0 0) 0x7fa254001070 con 0x7fa260074d00 2019-11-28T11:35:55.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa25e7fc700 1 -- 172.21.15.80:0/606802848 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa240002e80 con 0x7fa260074d00 2019-11-28T11:35:55.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa25e7fc700 1 -- 172.21.15.80:0/606802848 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 687455062 0 0) 0x7fa254001140 con 0x7fa260074d00 2019-11-28T11:35:55.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa25e7fc700 1 -- 172.21.15.80:0/606802848 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa2400032e0 con 0x7fa260074d00 2019-11-28T11:35:55.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa25e7fc700 1 -- 172.21.15.80:0/606802848 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fa2540016f0 con 0x7fa260074d00 2019-11-28T11:35:55.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa2666aa700 1 -- 172.21.15.80:0/606802848 >> v2:172.21.15.174:3300/0 conn(0x7fa2600750f0 msgr2=0x7fa260151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:55.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa2666aa700 1 --2- 172.21.15.80:0/606802848 >> v2:172.21.15.174:3300/0 conn(0x7fa2600750f0 0x7fa260151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:55.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa2666aa700 1 -- 172.21.15.80:0/606802848 >> v1:172.21.15.80:6789/0 conn(0x7fa260074d00 legacy=0x7fa260152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:55.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa2666aa700 1 -- 172.21.15.80:0/606802848 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26007b490 con 0x7fa260151f90 2019-11-28T11:35:55.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa2656a8700 1 --2- 172.21.15.80:0/606802848 >> v2:172.21.15.174:3300/0 conn(0x7fa2600750f0 0x7fa260151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:35:55.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa2666aa700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa260151f90 0x7fa2601523e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa258010730 tx=0x7fa258010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa2666aa700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa260151f90 0x7fa2601523e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa258010730 tx=0x7fa258010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa2666aa700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa260151f90 0x7fa2601523e0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7fa258010730 tx=0x7fa258010ad0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:55.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa2666aa700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa260151f90 0x7fa2601523e0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa258010730 tx=0x7fa258010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa25e7fc700 1 -- 172.21.15.80:0/606802848 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2580011f0 con 0x7fa260151f90 2019-11-28T11:35:55.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa2666aa700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa260151f90 0x7fa2601523e0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa258010730 tx=0x7fa258010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa25e7fc700 1 -- 172.21.15.80:0/606802848 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa258005a60 con 0x7fa260151f90 2019-11-28T11:35:55.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa2666aa700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa260151f90 0x7fa2601523e0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa258010730 tx=0x7fa258010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.915+0000 7fa25e7fc700 1 -- 172.21.15.80:0/606802848 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2580015d0 con 0x7fa260151f90 2019-11-28T11:35:55.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.916+0000 7fa26790c700 1 -- 172.21.15.80:0/606802848 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26007b810 con 0x7fa260151f90 2019-11-28T11:35:55.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.916+0000 7fa26790c700 1 -- 172.21.15.80:0/606802848 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26007b490 con 0x7fa260151f90 2019-11-28T11:35:55.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.916+0000 7fa2666aa700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa260151f90 0x7fa2601523e0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa258010730 tx=0x7fa258010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.917+0000 7fa25e7fc700 1 -- 172.21.15.80:0/606802848 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa258001610 con 0x7fa260151f90 2019-11-28T11:35:55.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.917+0000 7fa2666aa700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa260151f90 0x7fa2601523e0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa258010730 tx=0x7fa258010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.917+0000 7fa25e7fc700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa240018770 0x7fa24001ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:55.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.917+0000 7fa25e7fc700 1 -- 172.21.15.80:0/606802848 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fa258031d90 con 0x7fa260151f90 2019-11-28T11:35:55.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.917+0000 7fa265ea9700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa240018770 0x7fa24001ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:55.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.917+0000 7fa265ea9700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa240018770 0x7fa24001ac00 crc :-1 s=READY pgs=402 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:55.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.923+0000 7fa26790c700 1 -- 172.21.15.80:0/606802848 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26007b810 con 0x7fa260151f90 2019-11-28T11:35:55.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.927+0000 7fa2666aa700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa260151f90 0x7fa2601523e0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa258010730 tx=0x7fa258010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:55.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:55.927+0000 7fa25e7fc700 1 -- 172.21.15.80:0/606802848 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa258001400 con 0x7fa260151f90 2019-11-28T11:35:56.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:56.099+0000 7fa26790c700 1 -- 172.21.15.80:0/606802848 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa26007b490 con 0x7fa260151f90 2019-11-28T11:35:56.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:56.099+0000 7fa2666aa700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa260151f90 0x7fa2601523e0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa258010730 tx=0x7fa258010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:56.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:56.099+0000 7fa25e7fc700 1 -- 172.21.15.80:0/606802848 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fa258002020 con 0x7fa260151f90 2019-11-28T11:35:56.156 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:35:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:35:56.157 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:35:56.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:56.102+0000 7fa26790c700 1 -- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa240018770 msgr2=0x7fa24001ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:56.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:56.102+0000 7fa26790c700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa240018770 0x7fa24001ac00 crc :-1 s=READY pgs=402 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:56.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:56.102+0000 7fa26790c700 1 -- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa260151f90 msgr2=0x7fa2601523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:56.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:56.102+0000 7fa26790c700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa260151f90 0x7fa2601523e0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7fa258010730 tx=0x7fa258010ad0).stop 2019-11-28T11:35:56.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:56.102+0000 7fa26790c700 1 -- 172.21.15.80:0/606802848 shutdown_connections 2019-11-28T11:35:56.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:56.102+0000 7fa26790c700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa240018770 0x7fa24001ac00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:56.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:56.102+0000 7fa26790c700 1 --2- 172.21.15.80:0/606802848 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa260151f90 0x7fa2601523e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:56.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:56.102+0000 7fa26790c700 1 --2- 172.21.15.80:0/606802848 >> v2:172.21.15.174:3300/0 conn(0x7fa2600750f0 0x7fa260151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:56.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:56.102+0000 7fa26790c700 1 -- 172.21.15.80:0/606802848 shutdown_connections 2019-11-28T11:35:56.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:56.102+0000 7fa26790c700 1 -- 172.21.15.80:0/606802848 wait complete. 2019-11-28T11:35:56.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:56.102+0000 7fa26790c700 1 -- 172.21.15.80:0/606802848 >> 172.21.15.80:0/606802848 conn(0x7fa26013fa50 msgr2=0x7fa26007c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:56.168 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:35:57.169 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:35:57.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.232+0000 7f573185a700 1 Processor -- start 2019-11-28T11:35:57.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.232+0000 7f573185a700 1 -- start start 2019-11-28T11:35:57.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.233+0000 7f573185a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f572c06c0a0 0x7f572c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:57.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.233+0000 7f573185a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f572c0734e0 0x7f572c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:57.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.233+0000 7f573185a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f572c072360 0x7f572c072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:57.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.233+0000 7f573185a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572c06fd60 con 0x7f572c072360 2019-11-28T11:35:57.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.233+0000 7f573185a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572c070030 con 0x7f572c06c0a0 2019-11-28T11:35:57.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.233+0000 7f573185a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c06f330 con 0x7f572c0734e0 2019-11-28T11:35:57.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.233+0000 7f572bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f572c072360 0x7f572c072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:57.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.233+0000 7f572bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f572c072360 0x7f572c072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36024/0 (socket says 172.21.15.80:36024) 2019-11-28T11:35:57.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.233+0000 7f572bfff700 1 -- 172.21.15.80:0/278173345 learned_addr learned my addr 172.21.15.80:0/278173345 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:35:57.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.233+0000 7f572affd700 1 --2- 172.21.15.80:0/278173345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f572c0734e0 0x7f572c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:57.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.233+0000 7f572b7fe700 1 --2- 172.21.15.80:0/278173345 >> v2:172.21.15.174:3300/0 conn(0x7f572c06c0a0 0x7f572c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:57.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.234+0000 7f572bfff700 1 -- 172.21.15.80:0/278173345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f572c0734e0 msgr2=0x7f572c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:35:57.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.234+0000 7f572bfff700 1 --2- 172.21.15.80:0/278173345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f572c0734e0 0x7f572c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:57.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.234+0000 7f572bfff700 1 -- 172.21.15.80:0/278173345 >> v2:172.21.15.174:3300/0 conn(0x7f572c06c0a0 msgr2=0x7f572c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:35:57.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.234+0000 7f572bfff700 1 --2- 172.21.15.80:0/278173345 >> v2:172.21.15.174:3300/0 conn(0x7f572c06c0a0 0x7f572c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:57.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.234+0000 7f572bfff700 1 -- 172.21.15.80:0/278173345 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c0706c0 con 0x7f572c072360 2019-11-28T11:35:57.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.234+0000 7f572bfff700 1 --2- 172.21.15.80:0/278173345 >> v2:172.21.15.80:3300/0 conn(0x7f572c072360 0x7f572c072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f572400f6b0 tx=0x7f5724007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:57.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.234+0000 7f572bfff700 1 --2- 172.21.15.80:0/278173345 >> v2:172.21.15.80:3300/0 conn(0x7f572c072360 0x7f572c072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f572400f6b0 tx=0x7f5724007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:57.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.234+0000 7f572bfff700 1 --2- 172.21.15.80:0/278173345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f572c072360 0x7f572c072800 secure :-1 s=READY pgs=979 cs=0 l=1 rx=0x7f572400f6b0 tx=0x7f5724007d50).ready entity=mon.0 client_cookie=2223a4b79b9829dc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:57.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.234+0000 7f572bfff700 1 --2- 172.21.15.80:0/278173345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f572c072360 0x7f572c072800 secure :-1 s=THROTTLE_DONE pgs=979 cs=0 l=1 rx=0x7f572400f6b0 tx=0x7f5724007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:57.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.234+0000 7f572bfff700 1 --2- 172.21.15.80:0/278173345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f572c072360 0x7f572c072800 secure :-1 s=THROTTLE_DONE pgs=979 cs=0 l=1 rx=0x7f572400f6b0 tx=0x7f5724007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:57.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.234+0000 7f572a7fc700 1 -- 172.21.15.80:0/278173345 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5724000a70 con 0x7f572c072360 2019-11-28T11:35:57.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.234+0000 7f572bfff700 1 --2- 172.21.15.80:0/278173345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f572c072360 0x7f572c072800 secure :-1 s=THROTTLE_DONE pgs=979 cs=0 l=1 rx=0x7f572400f6b0 tx=0x7f5724007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:57.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.234+0000 7f572a7fc700 1 -- 172.21.15.80:0/278173345 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57240010e0 con 0x7f572c072360 2019-11-28T11:35:57.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.234+0000 7f572a7fc700 1 -- 172.21.15.80:0/278173345 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5724001830 con 0x7f572c072360 2019-11-28T11:35:57.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.234+0000 7f573185a700 1 -- 172.21.15.80:0/278173345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f572c072360 msgr2=0x7f572c072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:57.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.234+0000 7f573185a700 1 --2- 172.21.15.80:0/278173345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f572c072360 0x7f572c072800 secure :-1 s=READY pgs=979 cs=0 l=1 rx=0x7f572400f6b0 tx=0x7f5724007d50).stop 2019-11-28T11:35:57.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.235+0000 7f573185a700 1 -- 172.21.15.80:0/278173345 shutdown_connections 2019-11-28T11:35:57.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.235+0000 7f573185a700 1 --2- 172.21.15.80:0/278173345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f572c072360 0x7f572c072800 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:57.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.235+0000 7f573185a700 1 --2- 172.21.15.80:0/278173345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f572c0734e0 0x7f572c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:57.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.235+0000 7f573185a700 1 --2- 172.21.15.80:0/278173345 >> v2:172.21.15.174:3300/0 conn(0x7f572c06c0a0 0x7f572c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:57.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.235+0000 7f573185a700 1 -- 172.21.15.80:0/278173345 shutdown_connections 2019-11-28T11:35:57.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.235+0000 7f573185a700 1 -- 172.21.15.80:0/278173345 wait complete. 2019-11-28T11:35:57.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.235+0000 7f573185a700 1 -- 172.21.15.80:0/278173345 >> 172.21.15.80:0/278173345 conn(0x7f572c061cf0 msgr2=0x7f572c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:57.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.237+0000 7f573185a700 1 Processor -- start 2019-11-28T11:35:57.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.237+0000 7f573185a700 1 -- start start 2019-11-28T11:35:57.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.238+0000 7f573185a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f572c13dc00 0x7f572c109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:57.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.238+0000 7f573185a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f572c1094e0 0x7f572c167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:57.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.238+0000 7f573185a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572c1312c0 con 0x7f572c10a3a0 2019-11-28T11:35:57.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.238+0000 7f573185a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572c104e00 con 0x7f572c1094e0 2019-11-28T11:35:57.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.238+0000 7f573185a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c105830 con 0x7f572c13dc00 2019-11-28T11:35:57.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.238+0000 7f572affd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f572c10a3a0 0x7f572c108ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35344/0 (socket says 172.21.15.80:35344) 2019-11-28T11:35:57.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.238+0000 7f572affd700 1 -- 172.21.15.80:0/995540127 learned_addr learned my addr 172.21.15.80:0/995540127 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:35:57.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.238+0000 7f572b7fe700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f572c13dc00 0x7f572c109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:57.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.238+0000 7f572bfff700 1 --2- 172.21.15.80:0/995540127 >> v2:172.21.15.174:3300/0 conn(0x7f572c1094e0 0x7f572c167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:57.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f5723fff700 1 -- 172.21.15.80:0/995540127 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469326334 0 0) 0x7f5714009930 con 0x7f572c10a3a0 2019-11-28T11:35:57.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f5723fff700 1 -- 172.21.15.80:0/995540127 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5704002e80 con 0x7f572c10a3a0 2019-11-28T11:35:57.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f572bfff700 1 -- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f572c13dc00 msgr2=0x7f572c109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:57.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f572bfff700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f572c13dc00 0x7f572c109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:57.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f572bfff700 1 -- 172.21.15.80:0/995540127 >> v1:172.21.15.80:6789/0 conn(0x7f572c10a3a0 legacy=0x7f572c108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:57.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f5723fff700 1 -- 172.21.15.80:0/995540127 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 498551647 0 0) 0x7f5714000cc0 con 0x7f572c10a3a0 2019-11-28T11:35:57.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f572bfff700 1 -- 172.21.15.80:0/995540127 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c106190 con 0x7f572c1094e0 2019-11-28T11:35:57.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f572b7fe700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f572c13dc00 0x7f572c109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:35:57.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f572bfff700 1 --2- 172.21.15.80:0/995540127 >> v2:172.21.15.174:3300/0 conn(0x7f572c1094e0 0x7f572c167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57240543b0 tx=0x7f5724054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:57.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f572bfff700 1 --2- 172.21.15.80:0/995540127 >> v2:172.21.15.174:3300/0 conn(0x7f572c1094e0 0x7f572c167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57240543b0 tx=0x7f5724054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:57.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f572bfff700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572c1094e0 0x7f572c167a10 secure :-1 s=READY pgs=589 cs=0 l=1 rx=0x7f57240543b0 tx=0x7f5724054750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:57.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f572bfff700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572c1094e0 0x7f572c167a10 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f57240543b0 tx=0x7f5724054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:57.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f5723fff700 1 -- 172.21.15.80:0/995540127 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57240010a0 con 0x7f572c1094e0 2019-11-28T11:35:57.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f572bfff700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572c1094e0 0x7f572c167a10 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f57240543b0 tx=0x7f5724054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:57.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f572bfff700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572c1094e0 0x7f572c167a10 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f57240543b0 tx=0x7f5724054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:57.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f5723fff700 1 -- 172.21.15.80:0/995540127 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5724008180 con 0x7f572c1094e0 2019-11-28T11:35:57.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f573185a700 1 -- 172.21.15.80:0/995540127 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572c106510 con 0x7f572c1094e0 2019-11-28T11:35:57.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f5723fff700 1 -- 172.21.15.80:0/995540127 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5724000eb0 con 0x7f572c1094e0 2019-11-28T11:35:57.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.239+0000 7f573185a700 1 -- 172.21.15.80:0/995540127 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572c106190 con 0x7f572c1094e0 2019-11-28T11:35:57.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.240+0000 7f572bfff700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572c1094e0 0x7f572c167a10 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f57240543b0 tx=0x7f5724054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:57.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.240+0000 7f5723fff700 1 -- 172.21.15.80:0/995540127 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5724000f50 con 0x7f572c1094e0 2019-11-28T11:35:57.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.240+0000 7f572bfff700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572c1094e0 0x7f572c167a10 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f57240543b0 tx=0x7f5724054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:57.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.240+0000 7f5723fff700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5704018780 0x7f570401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:57.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.240+0000 7f5723fff700 1 -- 172.21.15.80:0/995540127 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f5724075a10 con 0x7f572c1094e0 2019-11-28T11:35:57.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.240+0000 7f572b7fe700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5704018780 0x7f570401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:57.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.240+0000 7f572b7fe700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5704018780 0x7f570401abf0 crc :-1 s=READY pgs=403 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:57.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.247+0000 7f573185a700 1 -- 172.21.15.80:0/995540127 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572c106510 con 0x7f572c1094e0 2019-11-28T11:35:57.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.251+0000 7f572bfff700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572c1094e0 0x7f572c167a10 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f57240543b0 tx=0x7f5724054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:57.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.251+0000 7f5723fff700 1 -- 172.21.15.80:0/995540127 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f572406b8d0 con 0x7f572c1094e0 2019-11-28T11:35:57.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.424+0000 7f573185a700 1 -- 172.21.15.80:0/995540127 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f572c106190 con 0x7f572c1094e0 2019-11-28T11:35:57.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.424+0000 7f572bfff700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572c1094e0 0x7f572c167a10 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f57240543b0 tx=0x7f5724054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:57.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.425+0000 7f5723fff700 1 -- 172.21.15.80:0/995540127 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f572406b8d0 con 0x7f572c1094e0 2019-11-28T11:35:57.482 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:35:57.483 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:35:57.483 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:35:57.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.427+0000 7f573185a700 1 -- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5704018780 msgr2=0x7f570401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:57.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.427+0000 7f573185a700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5704018780 0x7f570401abf0 crc :-1 s=READY pgs=403 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:57.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.427+0000 7f573185a700 1 -- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572c1094e0 msgr2=0x7f572c167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:57.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.427+0000 7f573185a700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572c1094e0 0x7f572c167a10 secure :-1 s=READY pgs=589 cs=0 l=1 rx=0x7f57240543b0 tx=0x7f5724054750).stop 2019-11-28T11:35:57.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.427+0000 7f573185a700 1 -- 172.21.15.80:0/995540127 shutdown_connections 2019-11-28T11:35:57.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.427+0000 7f573185a700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5704018780 0x7f570401abf0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:57.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.427+0000 7f573185a700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f572c1094e0 0x7f572c167a10 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:57.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.427+0000 7f573185a700 1 --2- 172.21.15.80:0/995540127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f572c13dc00 0x7f572c109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:57.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.427+0000 7f573185a700 1 -- 172.21.15.80:0/995540127 shutdown_connections 2019-11-28T11:35:57.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.427+0000 7f573185a700 1 -- 172.21.15.80:0/995540127 wait complete. 2019-11-28T11:35:57.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:57.427+0000 7f573185a700 1 -- 172.21.15.80:0/995540127 >> 172.21.15.80:0/995540127 conn(0x7f572c11bfc0 msgr2=0x7f572c141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:57.494 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:35:58.494 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:35:58.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.558+0000 7fd1e3446700 1 Processor -- start 2019-11-28T11:35:58.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.558+0000 7fd1e3446700 1 -- start start 2019-11-28T11:35:58.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.559+0000 7fd1e3446700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd1dc06d120 0x7fd1dc165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:58.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.559+0000 7fd1e3446700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc06d5a0 con 0x7fd1dc06c490 2019-11-28T11:35:58.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.559+0000 7fd1e3446700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc06db00 con 0x7fd1dc06c0a0 2019-11-28T11:35:58.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.559+0000 7fd1e3446700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1dc06fd60 con 0x7fd1dc06d120 2019-11-28T11:35:58.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.559+0000 7fd1e11e2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd1dc06c490 0x7fd1dc06c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35354/0 (socket says 172.21.15.80:35354) 2019-11-28T11:35:58.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.559+0000 7fd1e11e2700 1 -- 172.21.15.80:0/80965794 learned_addr learned my addr 172.21.15.80:0/80965794 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:35:58.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e21e4700 1 --2- 172.21.15.80:0/80965794 >> v2:172.21.15.174:3300/0 conn(0x7fd1dc06d120 0x7fd1dc165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:58.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 -- 172.21.15.80:0/80965794 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540624078 0 0) 0x7fd1cc001150 con 0x7fd1dc06c490 2019-11-28T11:35:58.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 -- 172.21.15.80:0/80965794 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c8002e80 con 0x7fd1dc06c490 2019-11-28T11:35:58.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 -- 172.21.15.80:0/80965794 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620675954 0 0) 0x7fd1c4001400 con 0x7fd1dc06c0a0 2019-11-28T11:35:58.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 -- 172.21.15.80:0/80965794 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c80030b0 con 0x7fd1dc06c0a0 2019-11-28T11:35:58.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 -- 172.21.15.80:0/80965794 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2069824589 0 0) 0x7fd1cc001130 con 0x7fd1dc06c490 2019-11-28T11:35:58.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 -- 172.21.15.80:0/80965794 >> v2:172.21.15.174:3300/0 conn(0x7fd1dc06d120 msgr2=0x7fd1dc165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:35:58.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 --2- 172.21.15.80:0/80965794 >> v2:172.21.15.174:3300/0 conn(0x7fd1dc06d120 0x7fd1dc165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:58.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 -- 172.21.15.80:0/80965794 >> v1:172.21.15.174:6789/0 conn(0x7fd1dc06c0a0 legacy=0x7fd1dc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:58.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 -- 172.21.15.80:0/80965794 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc0706c0 con 0x7fd1dc06c490 2019-11-28T11:35:58.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 -- 172.21.15.80:0/80965794 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd1cc001660 con 0x7fd1dc06c490 2019-11-28T11:35:58.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 -- 172.21.15.80:0/80965794 >> v1:172.21.15.80:6789/0 conn(0x7fd1dc06c490 legacy=0x7fd1dc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:58.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c8003b30 0x7fd1c8005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:58.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1c80066c0 0x7fd1c8008b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:58.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c804d3a0 0x7fd1c804f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:58.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 -- 172.21.15.80:0/80965794 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c804fff0 con 0x7fd1c8003b30 2019-11-28T11:35:58.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 -- 172.21.15.80:0/80965794 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c8050220 con 0x7fd1c80066c0 2019-11-28T11:35:58.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e09e1700 1 -- 172.21.15.80:0/80965794 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c8050450 con 0x7fd1c804d3a0 2019-11-28T11:35:58.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e19e3700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c8003b30 0x7fd1c8005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:58.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e11e2700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1c80066c0 0x7fd1c8008b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:58.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e21e4700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c804d3a0 0x7fd1c804f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:58.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e19e3700 1 -- 172.21.15.80:0/80965794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c804d3a0 msgr2=0x7fd1c804f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:35:58.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e19e3700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c804d3a0 0x7fd1c804f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:58.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e19e3700 1 -- 172.21.15.80:0/80965794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1c80066c0 msgr2=0x7fd1c8008b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:35:58.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e19e3700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1c80066c0 0x7fd1c8008b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:58.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e21e4700 1 -- 172.21.15.80:0/80965794 reap_dead start 2019-11-28T11:35:58.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e19e3700 1 -- 172.21.15.80:0/80965794 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c8050700 con 0x7fd1c8003b30 2019-11-28T11:35:58.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e11e2700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1c80066c0 0x7fd1c8008b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:35:58.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.560+0000 7fd1e19e3700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c8003b30 0x7fd1c8005f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd1c400b2f0 tx=0x7fd1c400ba80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:58.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.561+0000 7fd1e19e3700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c8003b30 0x7fd1c8005f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd1c400b2f0 tx=0x7fd1c400ba80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:58.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.561+0000 7fd1e19e3700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c8003b30 0x7fd1c8005f90 secure :-1 s=READY pgs=982 cs=0 l=1 rx=0x7fd1c400b2f0 tx=0x7fd1c400ba80).ready entity=mon.0 client_cookie=d2a1bedb276ea4d9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:58.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.561+0000 7fd1e19e3700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c8003b30 0x7fd1c8005f90 secure :-1 s=THROTTLE_DONE pgs=982 cs=0 l=1 rx=0x7fd1c400b2f0 tx=0x7fd1c400ba80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:58.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.561+0000 7fd1e09e1700 1 -- 172.21.15.80:0/80965794 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1c400a090 con 0x7fd1c8003b30 2019-11-28T11:35:58.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.561+0000 7fd1e19e3700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c8003b30 0x7fd1c8005f90 secure :-1 s=THROTTLE_DONE pgs=982 cs=0 l=1 rx=0x7fd1c400b2f0 tx=0x7fd1c400ba80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:58.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.561+0000 7fd1e09e1700 1 -- 172.21.15.80:0/80965794 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c4009cb0 con 0x7fd1c8003b30 2019-11-28T11:35:58.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.561+0000 7fd1e19e3700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c8003b30 0x7fd1c8005f90 secure :-1 s=THROTTLE_DONE pgs=982 cs=0 l=1 rx=0x7fd1c400b2f0 tx=0x7fd1c400ba80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:58.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.561+0000 7fd1e09e1700 1 -- 172.21.15.80:0/80965794 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1c400a320 con 0x7fd1c8003b30 2019-11-28T11:35:58.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.561+0000 7fd1e3446700 1 -- 172.21.15.80:0/80965794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c8003b30 msgr2=0x7fd1c8005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:58.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.561+0000 7fd1e3446700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c8003b30 0x7fd1c8005f90 secure :-1 s=READY pgs=982 cs=0 l=1 rx=0x7fd1c400b2f0 tx=0x7fd1c400ba80).stop 2019-11-28T11:35:58.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.561+0000 7fd1e3446700 1 -- 172.21.15.80:0/80965794 shutdown_connections 2019-11-28T11:35:58.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.561+0000 7fd1e3446700 1 --2- 172.21.15.80:0/80965794 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1c8003b30 0x7fd1c8005f90 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:58.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.562+0000 7fd1e3446700 1 -- 172.21.15.80:0/80965794 shutdown_connections 2019-11-28T11:35:58.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.562+0000 7fd1e3446700 1 -- 172.21.15.80:0/80965794 wait complete. 2019-11-28T11:35:58.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.562+0000 7fd1e3446700 1 -- 172.21.15.80:0/80965794 >> 172.21.15.80:0/80965794 conn(0x7fd1dc061cf0 msgr2=0x7fd1dc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:58.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.564+0000 7fd1e3446700 1 Processor -- start 2019-11-28T11:35:58.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.564+0000 7fd1e3446700 1 -- start start 2019-11-28T11:35:58.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e3446700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd1dc074d00 0x7fd1dc07aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:58.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e3446700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd1dc150f50 0x7fd1dc07af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:58.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e3446700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc0754d0 con 0x7fd1dc07bba0 2019-11-28T11:35:58.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e3446700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1dc078980 con 0x7fd1dc150f50 2019-11-28T11:35:58.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e3446700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1dc078c50 con 0x7fd1dc074d00 2019-11-28T11:35:58.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e11e2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd1dc150f50 0x7fd1dc07af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:58.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e11e2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd1dc150f50 0x7fd1dc07af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36046/0 (socket says 172.21.15.80:36046) 2019-11-28T11:35:58.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e11e2700 1 -- 172.21.15.80:0/2376279503 learned_addr learned my addr 172.21.15.80:0/2376279503 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:35:58.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e19e3700 1 --2- 172.21.15.80:0/2376279503 >> v2:172.21.15.174:3300/0 conn(0x7fd1dc074d00 0x7fd1dc07aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:58.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e11e2700 1 -- 172.21.15.80:0/2376279503 >> v2:172.21.15.174:3300/0 conn(0x7fd1dc074d00 msgr2=0x7fd1dc07aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:58.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e11e2700 1 --2- 172.21.15.80:0/2376279503 >> v2:172.21.15.174:3300/0 conn(0x7fd1dc074d00 0x7fd1dc07aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:58.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e11e2700 1 -- 172.21.15.80:0/2376279503 >> v1:172.21.15.174:6789/0 conn(0x7fd1dc07bba0 legacy=0x7fd1dc076d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:58.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e11e2700 1 -- 172.21.15.80:0/2376279503 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc0792e0 con 0x7fd1dc150f50 2019-11-28T11:35:58.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e19e3700 1 --2- 172.21.15.80:0/2376279503 >> v2:172.21.15.174:3300/0 conn(0x7fd1dc074d00 0x7fd1dc07aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:35:58.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e11e2700 1 --2- 172.21.15.80:0/2376279503 >> v2:172.21.15.80:3300/0 conn(0x7fd1dc150f50 0x7fd1dc07af60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd1cc010430 tx=0x7fd1cc0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:58.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e11e2700 1 --2- 172.21.15.80:0/2376279503 >> v2:172.21.15.80:3300/0 conn(0x7fd1dc150f50 0x7fd1dc07af60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd1cc010430 tx=0x7fd1cc0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:58.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.565+0000 7fd1e11e2700 1 --2- 172.21.15.80:0/2376279503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1dc150f50 0x7fd1dc07af60 secure :-1 s=READY pgs=983 cs=0 l=1 rx=0x7fd1cc010430 tx=0x7fd1cc0107d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:58.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.566+0000 7fd1e11e2700 1 --2- 172.21.15.80:0/2376279503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1dc150f50 0x7fd1dc07af60 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7fd1cc010430 tx=0x7fd1cc0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:58.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.566+0000 7fd1e11e2700 1 --2- 172.21.15.80:0/2376279503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1dc150f50 0x7fd1dc07af60 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7fd1cc010430 tx=0x7fd1cc0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:58.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.566+0000 7fd1da7fc700 1 -- 172.21.15.80:0/2376279503 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1cc000ef0 con 0x7fd1dc150f50 2019-11-28T11:35:58.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.566+0000 7fd1e11e2700 1 --2- 172.21.15.80:0/2376279503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1dc150f50 0x7fd1dc07af60 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7fd1cc010430 tx=0x7fd1cc0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:58.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.566+0000 7fd1da7fc700 1 -- 172.21.15.80:0/2376279503 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc004430 con 0x7fd1dc150f50 2019-11-28T11:35:58.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.566+0000 7fd1e3446700 1 -- 172.21.15.80:0/2376279503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc079660 con 0x7fd1dc150f50 2019-11-28T11:35:58.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.566+0000 7fd1da7fc700 1 -- 172.21.15.80:0/2376279503 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1cc004a80 con 0x7fd1dc150f50 2019-11-28T11:35:58.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.566+0000 7fd1e3446700 1 -- 172.21.15.80:0/2376279503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1dc0792e0 con 0x7fd1dc150f50 2019-11-28T11:35:58.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.566+0000 7fd1e11e2700 1 --2- 172.21.15.80:0/2376279503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1dc150f50 0x7fd1dc07af60 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7fd1cc010430 tx=0x7fd1cc0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:58.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.566+0000 7fd1da7fc700 1 -- 172.21.15.80:0/2376279503 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd1cc004620 con 0x7fd1dc150f50 2019-11-28T11:35:58.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.566+0000 7fd1e11e2700 1 --2- 172.21.15.80:0/2376279503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1dc150f50 0x7fd1dc07af60 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7fd1cc010430 tx=0x7fd1cc0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:58.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.566+0000 7fd1da7fc700 1 --2- 172.21.15.80:0/2376279503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1c0018730 0x7fd1c001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:58.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.566+0000 7fd1da7fc700 1 -- 172.21.15.80:0/2376279503 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fd1cc031d40 con 0x7fd1dc150f50 2019-11-28T11:35:58.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.567+0000 7fd1e19e3700 1 --2- 172.21.15.80:0/2376279503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1c0018730 0x7fd1c001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:58.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.567+0000 7fd1e19e3700 1 --2- 172.21.15.80:0/2376279503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1c0018730 0x7fd1c001abe0 crc :-1 s=READY pgs=404 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:58.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.574+0000 7fd1e3446700 1 -- 172.21.15.80:0/2376279503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1dc079660 con 0x7fd1dc150f50 2019-11-28T11:35:58.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.577+0000 7fd1e11e2700 1 --2- 172.21.15.80:0/2376279503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1dc150f50 0x7fd1dc07af60 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7fd1cc010430 tx=0x7fd1cc0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:58.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.577+0000 7fd1da7fc700 1 -- 172.21.15.80:0/2376279503 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd1cc0012e0 con 0x7fd1dc150f50 2019-11-28T11:35:58.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.752+0000 7fd1e3446700 1 -- 172.21.15.80:0/2376279503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1dc0792e0 con 0x7fd1dc150f50 2019-11-28T11:35:58.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.752+0000 7fd1e11e2700 1 --2- 172.21.15.80:0/2376279503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1dc150f50 0x7fd1dc07af60 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7fd1cc010430 tx=0x7fd1cc0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:58.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.752+0000 7fd1da7fc700 1 -- 172.21.15.80:0/2376279503 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fd1cc004430 con 0x7fd1dc150f50 2019-11-28T11:35:58.809 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:35:58.812 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:35:58.812 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:35:58.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.754+0000 7fd1e3446700 1 -- 172.21.15.80:0/2376279503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1c0018730 msgr2=0x7fd1c001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:58.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.754+0000 7fd1e3446700 1 --2- 172.21.15.80:0/2376279503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1c0018730 0x7fd1c001abe0 crc :-1 s=READY pgs=404 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:58.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.754+0000 7fd1e3446700 1 -- 172.21.15.80:0/2376279503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1dc150f50 msgr2=0x7fd1dc07af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:58.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.754+0000 7fd1e3446700 1 --2- 172.21.15.80:0/2376279503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1dc150f50 0x7fd1dc07af60 secure :-1 s=READY pgs=983 cs=0 l=1 rx=0x7fd1cc010430 tx=0x7fd1cc0107d0).stop 2019-11-28T11:35:58.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.755+0000 7fd1e3446700 1 -- 172.21.15.80:0/2376279503 shutdown_connections 2019-11-28T11:35:58.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.755+0000 7fd1e3446700 1 --2- 172.21.15.80:0/2376279503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1c0018730 0x7fd1c001abe0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:58.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.755+0000 7fd1e3446700 1 --2- 172.21.15.80:0/2376279503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1dc150f50 0x7fd1dc07af60 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:58.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.755+0000 7fd1e3446700 1 --2- 172.21.15.80:0/2376279503 >> v2:172.21.15.174:3300/0 conn(0x7fd1dc074d00 0x7fd1dc07aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:58.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.755+0000 7fd1e3446700 1 -- 172.21.15.80:0/2376279503 shutdown_connections 2019-11-28T11:35:58.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.755+0000 7fd1e3446700 1 -- 172.21.15.80:0/2376279503 wait complete. 2019-11-28T11:35:58.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:58.755+0000 7fd1e3446700 1 -- 172.21.15.80:0/2376279503 >> 172.21.15.80:0/2376279503 conn(0x7fd1dc13fa50 msgr2=0x7fd1dc07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:58.821 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:35:59.821 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:35:59.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.888+0000 7f8f9cf15700 1 Processor -- start 2019-11-28T11:35:59.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.888+0000 7f8f9cf15700 1 -- start start 2019-11-28T11:35:59.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.889+0000 7f8f9cf15700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f9806c490 0x7f8f9806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:59.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.889+0000 7f8f9cf15700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8f9806ce60 0x7f8f98164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:35:59.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.889+0000 7f8f9cf15700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9806db00 con 0x7f8f9806c0a0 2019-11-28T11:35:59.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.889+0000 7f8f9cf15700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9806fd60 con 0x7f8f9806ce60 2019-11-28T11:35:59.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.889+0000 7f8f9cf15700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f98070030 con 0x7f8f9806c490 2019-11-28T11:35:59.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f96d9d700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f8f9806c0a0 0x7f8f98072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:50914/0 (socket says 172.21.15.80:50914) 2019-11-28T11:35:59.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f96d9d700 1 -- 172.21.15.80:0/3191916201 learned_addr learned my addr 172.21.15.80:0/3191916201 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:35:59.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f9759e700 1 --2- 172.21.15.80:0/3191916201 >> v2:172.21.15.174:3300/0 conn(0x7f8f9806ce60 0x7f8f98164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:59.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f9659c700 1 --2- 172.21.15.80:0/3191916201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f9806c490 0x7f8f9806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:59.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f9759e700 1 -- 172.21.15.80:0/3191916201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f9806c490 msgr2=0x7f8f9806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:35:59.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f9759e700 1 --2- 172.21.15.80:0/3191916201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f9806c490 0x7f8f9806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:59.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f9759e700 1 -- 172.21.15.80:0/3191916201 >> v1:172.21.15.174:6789/0 conn(0x7f8f9806c0a0 legacy=0x7f8f98072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:59.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f9759e700 1 -- 172.21.15.80:0/3191916201 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f980706c0 con 0x7f8f9806ce60 2019-11-28T11:35:59.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f95d9b700 1 -- 172.21.15.80:0/3191916201 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253588677 0 0) 0x7f8f80001480 con 0x7f8f9806c0a0 2019-11-28T11:35:59.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f9659c700 1 --2- 172.21.15.80:0/3191916201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f9806c490 0x7f8f9806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:35:59.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f9759e700 1 --2- 172.21.15.80:0/3191916201 >> v2:172.21.15.174:3300/0 conn(0x7f8f9806ce60 0x7f8f98164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8f8800af80 tx=0x7f8f8800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:59.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f9759e700 1 --2- 172.21.15.80:0/3191916201 >> v2:172.21.15.174:3300/0 conn(0x7f8f9806ce60 0x7f8f98164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8f8800af80 tx=0x7f8f8800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:59.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f9759e700 1 --2- 172.21.15.80:0/3191916201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f9806ce60 0x7f8f98164d70 secure :-1 s=READY pgs=593 cs=0 l=1 rx=0x7f8f8800af80 tx=0x7f8f8800b790).ready entity=mon.1 client_cookie=2f7efee2b72448fd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:59.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f9759e700 1 --2- 172.21.15.80:0/3191916201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f9806ce60 0x7f8f98164d70 secure :-1 s=THROTTLE_DONE pgs=593 cs=0 l=1 rx=0x7f8f8800af80 tx=0x7f8f8800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:59.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f95d9b700 1 -- 172.21.15.80:0/3191916201 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f88000bc0 con 0x7f8f9806ce60 2019-11-28T11:35:59.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f9759e700 1 --2- 172.21.15.80:0/3191916201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f9806ce60 0x7f8f98164d70 secure :-1 s=THROTTLE_DONE pgs=593 cs=0 l=1 rx=0x7f8f8800af80 tx=0x7f8f8800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:59.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f9759e700 1 --2- 172.21.15.80:0/3191916201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f9806ce60 0x7f8f98164d70 secure :-1 s=THROTTLE_DONE pgs=593 cs=0 l=1 rx=0x7f8f8800af80 tx=0x7f8f8800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:59.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f95d9b700 1 -- 172.21.15.80:0/3191916201 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f880097f0 con 0x7f8f9806ce60 2019-11-28T11:35:59.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f95d9b700 1 -- 172.21.15.80:0/3191916201 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f88009ec0 con 0x7f8f9806ce60 2019-11-28T11:35:59.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f9cf15700 1 -- 172.21.15.80:0/3191916201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f9806ce60 msgr2=0x7f8f98164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:59.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.890+0000 7f8f9cf15700 1 --2- 172.21.15.80:0/3191916201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f9806ce60 0x7f8f98164d70 secure :-1 s=READY pgs=593 cs=0 l=1 rx=0x7f8f8800af80 tx=0x7f8f8800b790).stop 2019-11-28T11:35:59.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.891+0000 7f8f9cf15700 1 -- 172.21.15.80:0/3191916201 shutdown_connections 2019-11-28T11:35:59.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.891+0000 7f8f9cf15700 1 --2- 172.21.15.80:0/3191916201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f9806ce60 0x7f8f98164d70 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:59.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.891+0000 7f8f9cf15700 1 --2- 172.21.15.80:0/3191916201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f9806c490 0x7f8f9806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:35:59.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.891+0000 7f8f9cf15700 1 -- 172.21.15.80:0/3191916201 shutdown_connections 2019-11-28T11:35:59.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.891+0000 7f8f9cf15700 1 -- 172.21.15.80:0/3191916201 wait complete. 2019-11-28T11:35:59.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.891+0000 7f8f9cf15700 1 -- 172.21.15.80:0/3191916201 >> 172.21.15.80:0/3191916201 conn(0x7f8f98061cf0 msgr2=0x7f8f98064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:35:59.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.894+0000 7f8f9cf15700 1 Processor -- start 2019-11-28T11:35:59.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.894+0000 7f8f9cf15700 1 -- start start 2019-11-28T11:35:59.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.894+0000 7f8f9cf15700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8f9813a780 0x7f8f9812d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:59.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.894+0000 7f8f9cf15700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8f9812cb00 0x7f8f98167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:59.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.894+0000 7f8f9cf15700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f98139a60 con 0x7f8f9812d9c0 2019-11-28T11:35:59.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.894+0000 7f8f9cf15700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9812a260 con 0x7f8f9813a780 2019-11-28T11:35:59.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.894+0000 7f8f9cf15700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9812a530 con 0x7f8f9812cb00 2019-11-28T11:35:59.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.894+0000 7f8f96d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8f9813a780 0x7f8f9812d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:59.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f9659c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8f9812d9c0 0x7f8f9812c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35378/0 (socket says 172.21.15.80:35378) 2019-11-28T11:35:59.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f96d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8f9813a780 0x7f8f9812d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36060/0 (socket says 172.21.15.80:36060) 2019-11-28T11:35:59.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f9659c700 1 -- 172.21.15.80:0/4075230183 learned_addr learned my addr 172.21.15.80:0/4075230183 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:35:59.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f9759e700 1 --2- 172.21.15.80:0/4075230183 >> v2:172.21.15.174:3300/0 conn(0x7f8f9812cb00 0x7f8f98167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:59.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f96d9d700 1 -- 172.21.15.80:0/4075230183 >> v2:172.21.15.174:3300/0 conn(0x7f8f9812cb00 msgr2=0x7f8f98167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:59.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f96d9d700 1 --2- 172.21.15.80:0/4075230183 >> v2:172.21.15.174:3300/0 conn(0x7f8f9812cb00 0x7f8f98167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:35:59.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f96d9d700 1 -- 172.21.15.80:0/4075230183 >> v1:172.21.15.80:6789/0 conn(0x7f8f9812d9c0 legacy=0x7f8f9812c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:35:59.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f8f7fe700 1 -- 172.21.15.80:0/4075230183 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493248253 0 0) 0x7f8f9000dd90 con 0x7f8f9812d9c0 2019-11-28T11:35:59.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f96d9d700 1 -- 172.21.15.80:0/4075230183 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9812abc0 con 0x7f8f9813a780 2019-11-28T11:35:59.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f9759e700 1 --2- 172.21.15.80:0/4075230183 >> v2:172.21.15.174:3300/0 conn(0x7f8f9812cb00 0x7f8f98167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:35:59.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f96d9d700 1 --2- 172.21.15.80:0/4075230183 >> v2:172.21.15.80:3300/0 conn(0x7f8f9813a780 0x7f8f9812d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8f80010710 tx=0x7f8f80010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:59.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f96d9d700 1 --2- 172.21.15.80:0/4075230183 >> v2:172.21.15.80:3300/0 conn(0x7f8f9813a780 0x7f8f9812d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8f80010710 tx=0x7f8f80010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:59.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f96d9d700 1 --2- 172.21.15.80:0/4075230183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f9813a780 0x7f8f9812d480 secure :-1 s=READY pgs=985 cs=0 l=1 rx=0x7f8f80010710 tx=0x7f8f80010ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:59.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f96d9d700 1 --2- 172.21.15.80:0/4075230183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f9813a780 0x7f8f9812d480 secure :-1 s=THROTTLE_DONE pgs=985 cs=0 l=1 rx=0x7f8f80010710 tx=0x7f8f80010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:59.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f8f7fe700 1 -- 172.21.15.80:0/4075230183 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f80001480 con 0x7f8f9813a780 2019-11-28T11:35:59.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f96d9d700 1 --2- 172.21.15.80:0/4075230183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f9813a780 0x7f8f9812d480 secure :-1 s=THROTTLE_DONE pgs=985 cs=0 l=1 rx=0x7f8f80010710 tx=0x7f8f80010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:59.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f8f7fe700 1 -- 172.21.15.80:0/4075230183 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f80004730 con 0x7f8f9813a780 2019-11-28T11:35:59.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f9cf15700 1 -- 172.21.15.80:0/4075230183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9812af40 con 0x7f8f9813a780 2019-11-28T11:35:59.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f96d9d700 1 --2- 172.21.15.80:0/4075230183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f9813a780 0x7f8f9812d480 secure :-1 s=THROTTLE_DONE pgs=985 cs=0 l=1 rx=0x7f8f80010710 tx=0x7f8f80010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:59.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f8f7fe700 1 -- 172.21.15.80:0/4075230183 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f80004920 con 0x7f8f9813a780 2019-11-28T11:35:59.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.895+0000 7f8f9cf15700 1 -- 172.21.15.80:0/4075230183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9812abc0 con 0x7f8f9813a780 2019-11-28T11:35:59.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.896+0000 7f8f96d9d700 1 --2- 172.21.15.80:0/4075230183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f9813a780 0x7f8f9812d480 secure :-1 s=THROTTLE_DONE pgs=985 cs=0 l=1 rx=0x7f8f80010710 tx=0x7f8f80010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:59.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.896+0000 7f8f8f7fe700 1 -- 172.21.15.80:0/4075230183 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8f80001480 con 0x7f8f9813a780 2019-11-28T11:35:59.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.896+0000 7f8f96d9d700 1 --2- 172.21.15.80:0/4075230183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f9813a780 0x7f8f9812d480 secure :-1 s=THROTTLE_DONE pgs=985 cs=0 l=1 rx=0x7f8f80010710 tx=0x7f8f80010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:59.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.896+0000 7f8f8f7fe700 1 --2- 172.21.15.80:0/4075230183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f70018730 0x7f8f7001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:35:59.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.896+0000 7f8f8f7fe700 1 -- 172.21.15.80:0/4075230183 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8f80031d20 con 0x7f8f9813a780 2019-11-28T11:35:59.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.896+0000 7f8f9659c700 1 --2- 172.21.15.80:0/4075230183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f70018730 0x7f8f7001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:35:59.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.897+0000 7f8f9659c700 1 --2- 172.21.15.80:0/4075230183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f70018730 0x7f8f7001abc0 crc :-1 s=READY pgs=405 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:35:59.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.904+0000 7f8f9cf15700 1 -- 172.21.15.80:0/4075230183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9812af40 con 0x7f8f9813a780 2019-11-28T11:35:59.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.907+0000 7f8f96d9d700 1 --2- 172.21.15.80:0/4075230183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f9813a780 0x7f8f9812d480 secure :-1 s=THROTTLE_DONE pgs=985 cs=0 l=1 rx=0x7f8f80010710 tx=0x7f8f80010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:35:59.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:35:59.907+0000 7f8f8f7fe700 1 -- 172.21.15.80:0/4075230183 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8f80001250 con 0x7f8f9813a780 2019-11-28T11:36:00.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:00.080+0000 7f8f9cf15700 1 -- 172.21.15.80:0/4075230183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f9812abc0 con 0x7f8f9813a780 2019-11-28T11:36:00.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:00.081+0000 7f8f96d9d700 1 --2- 172.21.15.80:0/4075230183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f9813a780 0x7f8f9812d480 secure :-1 s=THROTTLE_DONE pgs=985 cs=0 l=1 rx=0x7f8f80010710 tx=0x7f8f80010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:00.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:00.081+0000 7f8f8f7fe700 1 -- 172.21.15.80:0/4075230183 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f8f80001460 con 0x7f8f9813a780 2019-11-28T11:36:00.139 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:00.140 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:00.140 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:00.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:00.083+0000 7f8f9cf15700 1 -- 172.21.15.80:0/4075230183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f70018730 msgr2=0x7f8f7001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:00.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:00.083+0000 7f8f9cf15700 1 --2- 172.21.15.80:0/4075230183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f70018730 0x7f8f7001abc0 crc :-1 s=READY pgs=405 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:00.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:00.083+0000 7f8f9cf15700 1 -- 172.21.15.80:0/4075230183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f9813a780 msgr2=0x7f8f9812d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:00.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:00.083+0000 7f8f9cf15700 1 --2- 172.21.15.80:0/4075230183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f9813a780 0x7f8f9812d480 secure :-1 s=READY pgs=985 cs=0 l=1 rx=0x7f8f80010710 tx=0x7f8f80010ab0).stop 2019-11-28T11:36:00.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:00.083+0000 7f8f9cf15700 1 -- 172.21.15.80:0/4075230183 shutdown_connections 2019-11-28T11:36:00.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:00.083+0000 7f8f9cf15700 1 --2- 172.21.15.80:0/4075230183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f70018730 0x7f8f7001abc0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:00.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:00.083+0000 7f8f9cf15700 1 --2- 172.21.15.80:0/4075230183 >> v2:172.21.15.174:3300/0 conn(0x7f8f9812cb00 0x7f8f98167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:00.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:00.083+0000 7f8f9cf15700 1 --2- 172.21.15.80:0/4075230183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f9813a780 0x7f8f9812d480 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:00.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:00.083+0000 7f8f9cf15700 1 -- 172.21.15.80:0/4075230183 shutdown_connections 2019-11-28T11:36:00.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:00.083+0000 7f8f9cf15700 1 -- 172.21.15.80:0/4075230183 wait complete. 2019-11-28T11:36:00.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:00.083+0000 7f8f9cf15700 1 -- 172.21.15.80:0/4075230183 >> 172.21.15.80:0/4075230183 conn(0x7f8f98127dc0 msgr2=0x7f8f98141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:00.150 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:01.151 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:01.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.218+0000 7fc3aa825700 1 Processor -- start 2019-11-28T11:36:01.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.218+0000 7fc3aa825700 1 -- start start 2019-11-28T11:36:01.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3aa825700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3a406c0a0 0x7fc3a4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:01.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3aa825700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc3a40734e0 0x7fc3a4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:01.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3aa825700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a406db00 con 0x7fc3a4072360 2019-11-28T11:36:01.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3aa825700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a406fd60 con 0x7fc3a406c0a0 2019-11-28T11:36:01.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3aa825700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a4070030 con 0x7fc3a40734e0 2019-11-28T11:36:01.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a8dc2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3a406c0a0 0x7fc3a4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:01.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a8dc2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3a406c0a0 0x7fc3a4072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36068/0 (socket says 172.21.15.80:36068) 2019-11-28T11:36:01.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a8dc2700 1 -- 172.21.15.80:0/3957834509 learned_addr learned my addr 172.21.15.80:0/3957834509 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:01.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a3fff700 1 --2- 172.21.15.80:0/3957834509 >> v2:172.21.15.174:3300/0 conn(0x7fc3a40734e0 0x7fc3a4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:01.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a8dc2700 1 -- 172.21.15.80:0/3957834509 >> v2:172.21.15.174:3300/0 conn(0x7fc3a40734e0 msgr2=0x7fc3a4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:01.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a8dc2700 1 --2- 172.21.15.80:0/3957834509 >> v2:172.21.15.174:3300/0 conn(0x7fc3a40734e0 0x7fc3a4071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:01.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a8dc2700 1 -- 172.21.15.80:0/3957834509 >> v1:172.21.15.80:6789/0 conn(0x7fc3a4072360 legacy=0x7fc3a406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:01.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a8dc2700 1 -- 172.21.15.80:0/3957834509 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a40706c0 con 0x7fc3a406c0a0 2019-11-28T11:36:01.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a37fe700 1 -- 172.21.15.80:0/3957834509 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096749482 0 0) 0x7fc39c000a40 con 0x7fc3a4072360 2019-11-28T11:36:01.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a8dc2700 1 --2- 172.21.15.80:0/3957834509 >> v2:172.21.15.80:3300/0 conn(0x7fc3a406c0a0 0x7fc3a4072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc38c00f6c0 tx=0x7fc38c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:01.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a8dc2700 1 --2- 172.21.15.80:0/3957834509 >> v2:172.21.15.80:3300/0 conn(0x7fc3a406c0a0 0x7fc3a4072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc38c00f6c0 tx=0x7fc38c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:01.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a8dc2700 1 --2- 172.21.15.80:0/3957834509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3a406c0a0 0x7fc3a4072fa0 secure :-1 s=READY pgs=987 cs=0 l=1 rx=0x7fc38c00f6c0 tx=0x7fc38c00fa60).ready entity=mon.0 client_cookie=ba3e6a1b46598aae server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:01.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a8dc2700 1 --2- 172.21.15.80:0/3957834509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3a406c0a0 0x7fc3a4072fa0 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7fc38c00f6c0 tx=0x7fc38c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:01.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a37fe700 1 -- 172.21.15.80:0/3957834509 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc38c000960 con 0x7fc3a406c0a0 2019-11-28T11:36:01.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a8dc2700 1 --2- 172.21.15.80:0/3957834509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3a406c0a0 0x7fc3a4072fa0 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7fc38c00f6c0 tx=0x7fc38c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:01.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a37fe700 1 -- 172.21.15.80:0/3957834509 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c000c90 con 0x7fc3a406c0a0 2019-11-28T11:36:01.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a8dc2700 1 --2- 172.21.15.80:0/3957834509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3a406c0a0 0x7fc3a4072fa0 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7fc38c00f6c0 tx=0x7fc38c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:01.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.219+0000 7fc3a37fe700 1 -- 172.21.15.80:0/3957834509 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc38c007210 con 0x7fc3a406c0a0 2019-11-28T11:36:01.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.220+0000 7fc3aa825700 1 -- 172.21.15.80:0/3957834509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3a406c0a0 msgr2=0x7fc3a4072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:01.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.220+0000 7fc3aa825700 1 --2- 172.21.15.80:0/3957834509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3a406c0a0 0x7fc3a4072fa0 secure :-1 s=READY pgs=987 cs=0 l=1 rx=0x7fc38c00f6c0 tx=0x7fc38c00fa60).stop 2019-11-28T11:36:01.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.220+0000 7fc3aa825700 1 -- 172.21.15.80:0/3957834509 shutdown_connections 2019-11-28T11:36:01.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.220+0000 7fc3aa825700 1 --2- 172.21.15.80:0/3957834509 >> v2:172.21.15.174:3300/0 conn(0x7fc3a40734e0 0x7fc3a4071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:01.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.220+0000 7fc3aa825700 1 --2- 172.21.15.80:0/3957834509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3a406c0a0 0x7fc3a4072fa0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:01.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.220+0000 7fc3aa825700 1 -- 172.21.15.80:0/3957834509 shutdown_connections 2019-11-28T11:36:01.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.220+0000 7fc3aa825700 1 -- 172.21.15.80:0/3957834509 wait complete. 2019-11-28T11:36:01.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.220+0000 7fc3aa825700 1 -- 172.21.15.80:0/3957834509 >> 172.21.15.80:0/3957834509 conn(0x7fc3a4061cf0 msgr2=0x7fc3a4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:01.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.223+0000 7fc3aa825700 1 Processor -- start 2019-11-28T11:36:01.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.223+0000 7fc3aa825700 1 -- start start 2019-11-28T11:36:01.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3aa825700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc3a412dc20 0x7fc3a412e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:01.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3aa825700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a4076690 con 0x7fc3a4075a00 2019-11-28T11:36:01.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3aa825700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a41141d0 con 0x7fc3a410adf0 2019-11-28T11:36:01.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3aa825700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a4073960 con 0x7fc3a412dc20 2019-11-28T11:36:01.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3a3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc3a4075a00 0x7fc3a4075e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35390/0 (socket says 172.21.15.80:35390) 2019-11-28T11:36:01.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3a3fff700 1 -- 172.21.15.80:0/216359354 learned_addr learned my addr 172.21.15.80:0/216359354 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:01.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3a95c3700 1 --2- 172.21.15.80:0/216359354 >> v2:172.21.15.174:3300/0 conn(0x7fc3a412dc20 0x7fc3a412e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:01.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3a17fa700 1 -- 172.21.15.80:0/216359354 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966452567 0 0) 0x7fc394001430 con 0x7fc3a4075a00 2019-11-28T11:36:01.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3a17fa700 1 -- 172.21.15.80:0/216359354 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc388002e80 con 0x7fc3a4075a00 2019-11-28T11:36:01.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3a17fa700 1 -- 172.21.15.80:0/216359354 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224355879 0 0) 0x7fc38c007d20 con 0x7fc3a410adf0 2019-11-28T11:36:01.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3a17fa700 1 -- 172.21.15.80:0/216359354 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3880030b0 con 0x7fc3a410adf0 2019-11-28T11:36:01.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3a17fa700 1 -- 172.21.15.80:0/216359354 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 275997347 0 0) 0x7fc394000cc0 con 0x7fc3a4075a00 2019-11-28T11:36:01.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3a17fa700 1 -- 172.21.15.80:0/216359354 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc3880033c0 con 0x7fc3a4075a00 2019-11-28T11:36:01.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3a17fa700 1 -- 172.21.15.80:0/216359354 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc3940018c0 con 0x7fc3a4075a00 2019-11-28T11:36:01.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3a95c3700 1 -- 172.21.15.80:0/216359354 >> v1:172.21.15.174:6789/0 conn(0x7fc3a410adf0 legacy=0x7fc3a41592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:01.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3a95c3700 1 -- 172.21.15.80:0/216359354 >> v1:172.21.15.80:6789/0 conn(0x7fc3a4075a00 legacy=0x7fc3a4075e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:01.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3a95c3700 1 -- 172.21.15.80:0/216359354 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a40742c0 con 0x7fc3a412dc20 2019-11-28T11:36:01.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3a95c3700 1 --2- 172.21.15.80:0/216359354 >> v2:172.21.15.174:3300/0 conn(0x7fc3a412dc20 0x7fc3a412e0c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc39c0125b0 tx=0x7fc39c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:01.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3a95c3700 1 --2- 172.21.15.80:0/216359354 >> v2:172.21.15.174:3300/0 conn(0x7fc3a412dc20 0x7fc3a412e0c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc39c0125b0 tx=0x7fc39c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:01.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.224+0000 7fc3a95c3700 1 --2- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3a412dc20 0x7fc3a412e0c0 secure :-1 s=READY pgs=595 cs=0 l=1 rx=0x7fc39c0125b0 tx=0x7fc39c012950).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:01.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.225+0000 7fc3a95c3700 1 --2- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3a412dc20 0x7fc3a412e0c0 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7fc39c0125b0 tx=0x7fc39c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:01.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.225+0000 7fc3a17fa700 1 -- 172.21.15.80:0/216359354 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc39c000940 con 0x7fc3a412dc20 2019-11-28T11:36:01.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.225+0000 7fc3a95c3700 1 --2- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3a412dc20 0x7fc3a412e0c0 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7fc39c0125b0 tx=0x7fc39c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:01.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.225+0000 7fc3a17fa700 1 -- 172.21.15.80:0/216359354 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c00bb90 con 0x7fc3a412dc20 2019-11-28T11:36:01.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.225+0000 7fc3a95c3700 1 --2- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3a412dc20 0x7fc3a412e0c0 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7fc39c0125b0 tx=0x7fc39c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:01.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.225+0000 7fc3a17fa700 1 -- 172.21.15.80:0/216359354 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc39c000940 con 0x7fc3a412dc20 2019-11-28T11:36:01.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.225+0000 7fc3aa825700 1 -- 172.21.15.80:0/216359354 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a4074640 con 0x7fc3a412dc20 2019-11-28T11:36:01.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.225+0000 7fc3aa825700 1 -- 172.21.15.80:0/216359354 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a40742c0 con 0x7fc3a412dc20 2019-11-28T11:36:01.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.225+0000 7fc3a95c3700 1 --2- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3a412dc20 0x7fc3a412e0c0 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7fc39c0125b0 tx=0x7fc39c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:01.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.225+0000 7fc3a17fa700 1 -- 172.21.15.80:0/216359354 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc39c00b830 con 0x7fc3a412dc20 2019-11-28T11:36:01.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.225+0000 7fc3a95c3700 1 --2- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3a412dc20 0x7fc3a412e0c0 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7fc39c0125b0 tx=0x7fc39c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:01.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.226+0000 7fc3a17fa700 1 --2- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3880187a0 0x7fc38801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:01.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.226+0000 7fc3a17fa700 1 -- 172.21.15.80:0/216359354 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fc39c033cf0 con 0x7fc3a412dc20 2019-11-28T11:36:01.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.226+0000 7fc3a8dc2700 1 --2- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3880187a0 0x7fc38801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:01.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.226+0000 7fc3a8dc2700 1 --2- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3880187a0 0x7fc38801abf0 crc :-1 s=READY pgs=406 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:01.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.233+0000 7fc3aa825700 1 -- 172.21.15.80:0/216359354 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a4074640 con 0x7fc3a412dc20 2019-11-28T11:36:01.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.236+0000 7fc3a95c3700 1 --2- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3a412dc20 0x7fc3a412e0c0 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7fc39c0125b0 tx=0x7fc39c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:01.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.236+0000 7fc3a17fa700 1 -- 172.21.15.80:0/216359354 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc39c026f00 con 0x7fc3a412dc20 2019-11-28T11:36:01.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.410+0000 7fc3aa825700 1 -- 172.21.15.80:0/216359354 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3a40742c0 con 0x7fc3a412dc20 2019-11-28T11:36:01.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.410+0000 7fc3a95c3700 1 --2- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3a412dc20 0x7fc3a412e0c0 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7fc39c0125b0 tx=0x7fc39c012950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:01.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.410+0000 7fc3a17fa700 1 -- 172.21.15.80:0/216359354 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fc39c026f00 con 0x7fc3a412dc20 2019-11-28T11:36:01.467 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:01.468 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:01.468 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:01.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.412+0000 7fc3aa825700 1 -- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3880187a0 msgr2=0x7fc38801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:01.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.412+0000 7fc3aa825700 1 --2- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3880187a0 0x7fc38801abf0 crc :-1 s=READY pgs=406 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:01.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.412+0000 7fc3aa825700 1 -- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3a412dc20 msgr2=0x7fc3a412e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.412+0000 7fc3aa825700 1 --2- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3a412dc20 0x7fc3a412e0c0 secure :-1 s=READY pgs=595 cs=0 l=1 rx=0x7fc39c0125b0 tx=0x7fc39c012950).stop 2019-11-28T11:36:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.413+0000 7fc3aa825700 1 -- 172.21.15.80:0/216359354 shutdown_connections 2019-11-28T11:36:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.413+0000 7fc3aa825700 1 --2- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3a412dc20 0x7fc3a412e0c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.413+0000 7fc3aa825700 1 --2- 172.21.15.80:0/216359354 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc3880187a0 0x7fc38801abf0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.413+0000 7fc3aa825700 1 -- 172.21.15.80:0/216359354 shutdown_connections 2019-11-28T11:36:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.413+0000 7fc3aa825700 1 -- 172.21.15.80:0/216359354 wait complete. 2019-11-28T11:36:01.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:01.413+0000 7fc3aa825700 1 -- 172.21.15.80:0/216359354 >> 172.21.15.80:0/216359354 conn(0x7fc3a413d930 msgr2=0x7fc3a4111550 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:01.479 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:02.480 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:02.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.549+0000 7fb90bc87700 1 Processor -- start 2019-11-28T11:36:02.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.549+0000 7fb90bc87700 1 -- start start 2019-11-28T11:36:02.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.550+0000 7fb90bc87700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb90406c0a0 0x7fb904072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:02.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.550+0000 7fb90bc87700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90406db00 con 0x7fb904072620 2019-11-28T11:36:02.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.550+0000 7fb90bc87700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90406e000 con 0x7fb9040734e0 2019-11-28T11:36:02.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.550+0000 7fb90bc87700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90406fd60 con 0x7fb90406c0a0 2019-11-28T11:36:02.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.550+0000 7fb90a224700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb90406c0a0 0x7fb904072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:02.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.550+0000 7fb90a224700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb90406c0a0 0x7fb904072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36080/0 (socket says 172.21.15.80:36080) 2019-11-28T11:36:02.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.550+0000 7fb90a224700 1 -- 172.21.15.80:0/1990140751 learned_addr learned my addr 172.21.15.80:0/1990140751 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:02.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.551+0000 7fb90a224700 1 -- 172.21.15.80:0/1990140751 >> v1:172.21.15.174:6789/0 conn(0x7fb9040734e0 legacy=0x7fb904071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:02.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.551+0000 7fb90a224700 1 -- 172.21.15.80:0/1990140751 >> v1:172.21.15.80:6789/0 conn(0x7fb904072620 legacy=0x7fb904164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:02.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.551+0000 7fb90a224700 1 -- 172.21.15.80:0/1990140751 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9040706c0 con 0x7fb90406c0a0 2019-11-28T11:36:02.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.551+0000 7fb909222700 1 -- 172.21.15.80:0/1990140751 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367791338 0 0) 0x7fb8fc000dc0 con 0x7fb904072620 2019-11-28T11:36:02.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.551+0000 7fb90a224700 1 --2- 172.21.15.80:0/1990140751 >> v2:172.21.15.80:3300/0 conn(0x7fb90406c0a0 0x7fb904072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb8f400f740 tx=0x7fb8f400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:02.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.551+0000 7fb90a224700 1 --2- 172.21.15.80:0/1990140751 >> v2:172.21.15.80:3300/0 conn(0x7fb90406c0a0 0x7fb904072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb8f400f740 tx=0x7fb8f400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:02.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.551+0000 7fb90a224700 1 --2- 172.21.15.80:0/1990140751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb90406c0a0 0x7fb904072fa0 secure :-1 s=READY pgs=990 cs=0 l=1 rx=0x7fb8f400f740 tx=0x7fb8f400fae0).ready entity=mon.0 client_cookie=808e3215ecbdca1f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:02.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.551+0000 7fb90a224700 1 --2- 172.21.15.80:0/1990140751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb90406c0a0 0x7fb904072fa0 secure :-1 s=THROTTLE_DONE pgs=990 cs=0 l=1 rx=0x7fb8f400f740 tx=0x7fb8f400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:02.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.551+0000 7fb909222700 1 -- 172.21.15.80:0/1990140751 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8f4000960 con 0x7fb90406c0a0 2019-11-28T11:36:02.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.551+0000 7fb90a224700 1 --2- 172.21.15.80:0/1990140751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb90406c0a0 0x7fb904072fa0 secure :-1 s=THROTTLE_DONE pgs=990 cs=0 l=1 rx=0x7fb8f400f740 tx=0x7fb8f400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:02.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.551+0000 7fb90a224700 1 --2- 172.21.15.80:0/1990140751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb90406c0a0 0x7fb904072fa0 secure :-1 s=THROTTLE_DONE pgs=990 cs=0 l=1 rx=0x7fb8f400f740 tx=0x7fb8f400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:02.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.551+0000 7fb909222700 1 -- 172.21.15.80:0/1990140751 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f4000c90 con 0x7fb90406c0a0 2019-11-28T11:36:02.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.551+0000 7fb909222700 1 -- 172.21.15.80:0/1990140751 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8f40013e0 con 0x7fb90406c0a0 2019-11-28T11:36:02.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.551+0000 7fb90bc87700 1 -- 172.21.15.80:0/1990140751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb90406c0a0 msgr2=0x7fb904072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:02.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.551+0000 7fb90bc87700 1 --2- 172.21.15.80:0/1990140751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb90406c0a0 0x7fb904072fa0 secure :-1 s=READY pgs=990 cs=0 l=1 rx=0x7fb8f400f740 tx=0x7fb8f400fae0).stop 2019-11-28T11:36:02.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.552+0000 7fb90bc87700 1 -- 172.21.15.80:0/1990140751 shutdown_connections 2019-11-28T11:36:02.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.552+0000 7fb90bc87700 1 --2- 172.21.15.80:0/1990140751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb90406c0a0 0x7fb904072fa0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:02.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.552+0000 7fb90bc87700 1 -- 172.21.15.80:0/1990140751 shutdown_connections 2019-11-28T11:36:02.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.552+0000 7fb90bc87700 1 -- 172.21.15.80:0/1990140751 wait complete. 2019-11-28T11:36:02.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.552+0000 7fb90bc87700 1 -- 172.21.15.80:0/1990140751 >> 172.21.15.80:0/1990140751 conn(0x7fb904061cf0 msgr2=0x7fb904064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:02.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.554+0000 7fb90bc87700 1 Processor -- start 2019-11-28T11:36:02.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.554+0000 7fb90bc87700 1 -- start start 2019-11-28T11:36:02.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.555+0000 7fb90bc87700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb90412cea0 0x7fb904111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:02.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.555+0000 7fb90bc87700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb9041230e0 0x7fb904123570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:02.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.555+0000 7fb90bc87700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb904124260 con 0x7fb904123ab0 2019-11-28T11:36:02.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.555+0000 7fb90bc87700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb904120610 con 0x7fb9041230e0 2019-11-28T11:36:02.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.555+0000 7fb90bc87700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb904121040 con 0x7fb90412cea0 2019-11-28T11:36:02.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.555+0000 7fb90aa25700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb904123ab0 0x7fb90412d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35402/0 (socket says 172.21.15.80:35402) 2019-11-28T11:36:02.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.555+0000 7fb90aa25700 1 -- 172.21.15.80:0/3901477806 learned_addr learned my addr 172.21.15.80:0/3901477806 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:02.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.555+0000 7fb90a224700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb90412cea0 0x7fb904111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:02.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.555+0000 7fb909a23700 1 --2- 172.21.15.80:0/3901477806 >> v2:172.21.15.174:3300/0 conn(0x7fb9041230e0 0x7fb904123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:02.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.555+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875781676 0 0) 0x7fb8fc0015c0 con 0x7fb904123ab0 2019-11-28T11:36:02.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.555+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8e8002e80 con 0x7fb904123ab0 2019-11-28T11:36:02.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.555+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4162341411 0 0) 0x7fb8fc0017c0 con 0x7fb904123ab0 2019-11-28T11:36:02.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb8e80032e0 con 0x7fb904123ab0 2019-11-28T11:36:02.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fb8fc001cd0 con 0x7fb904123ab0 2019-11-28T11:36:02.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb90412cea0 msgr2=0x7fb904111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:02.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb902ffd700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb90412cea0 0x7fb904111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:02.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 >> v2:172.21.15.174:3300/0 conn(0x7fb9041230e0 msgr2=0x7fb904123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:02.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb902ffd700 1 --2- 172.21.15.80:0/3901477806 >> v2:172.21.15.174:3300/0 conn(0x7fb9041230e0 0x7fb904123570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:02.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 >> v1:172.21.15.80:6789/0 conn(0x7fb904123ab0 legacy=0x7fb90412d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:02.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb902ffd700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e80033a0 0x7fb8e80037f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:02.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb902ffd700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8e8003d30 0x7fb8e80041b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:02.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb902ffd700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8e80049c0 0x7fb8e8004e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:02.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e800bc40 con 0x7fb8e80033a0 2019-11-28T11:36:02.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e800be70 con 0x7fb8e8003d30 2019-11-28T11:36:02.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e800c0a0 con 0x7fb8e80049c0 2019-11-28T11:36:02.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb909a23700 1 --2- 172.21.15.80:0/3901477806 >> v2:172.21.15.174:3300/0 conn(0x7fb9041230e0 0x7fb904123570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:02.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90a224700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb90412cea0 0x7fb904111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:02.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90a224700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e80033a0 0x7fb8e80037f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:02.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb909a23700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8e8003d30 0x7fb8e80041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:02.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90aa25700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8e80049c0 0x7fb8e8004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:02.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90a224700 1 -- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8e80049c0 msgr2=0x7fb8e8004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:02.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90a224700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8e80049c0 0x7fb8e8004e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:02.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90a224700 1 -- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8e8003d30 msgr2=0x7fb8e80041b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:02.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90a224700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8e8003d30 0x7fb8e80041b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:02.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90a224700 1 -- 172.21.15.80:0/3901477806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e800c350 con 0x7fb8e80033a0 2019-11-28T11:36:02.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90aa25700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8e80049c0 0x7fb8e8004e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:36:02.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90bc87700 1 -- 172.21.15.80:0/3901477806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb904121d20 con 0x7fb8e80033a0 2019-11-28T11:36:02.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90a224700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e80033a0 0x7fb8e80037f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb8f40125b0 tx=0x7fb8f40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:02.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90bc87700 1 -- 172.21.15.80:0/3901477806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9041219a0 con 0x7fb8e80033a0 2019-11-28T11:36:02.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90a224700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e80033a0 0x7fb8e80037f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb8f40125b0 tx=0x7fb8f40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:02.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90a224700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e80033a0 0x7fb8e80037f0 secure :-1 s=READY pgs=992 cs=0 l=1 rx=0x7fb8f40125b0 tx=0x7fb8f40102d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:02.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90a224700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e80033a0 0x7fb8e80037f0 secure :-1 s=THROTTLE_DONE pgs=992 cs=0 l=1 rx=0x7fb8f40125b0 tx=0x7fb8f40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:02.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8f4000940 con 0x7fb8e80033a0 2019-11-28T11:36:02.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90a224700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e80033a0 0x7fb8e80037f0 secure :-1 s=THROTTLE_DONE pgs=992 cs=0 l=1 rx=0x7fb8f40125b0 tx=0x7fb8f40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:02.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb90a224700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e80033a0 0x7fb8e80037f0 secure :-1 s=THROTTLE_DONE pgs=992 cs=0 l=1 rx=0x7fb8f40125b0 tx=0x7fb8f40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:02.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f4000d60 con 0x7fb8e80033a0 2019-11-28T11:36:02.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.556+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8f4001430 con 0x7fb8e80033a0 2019-11-28T11:36:02.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.557+0000 7fb90a224700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e80033a0 0x7fb8e80037f0 secure :-1 s=THROTTLE_DONE pgs=992 cs=0 l=1 rx=0x7fb8f40125b0 tx=0x7fb8f40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:02.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.557+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb8f4000f50 con 0x7fb8e80033a0 2019-11-28T11:36:02.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.557+0000 7fb90a224700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e80033a0 0x7fb8e80037f0 secure :-1 s=THROTTLE_DONE pgs=992 cs=0 l=1 rx=0x7fb8f40125b0 tx=0x7fb8f40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:02.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.557+0000 7fb902ffd700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8e8020b30 0x7fb8e8022f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:02.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.557+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fb8f4033da0 con 0x7fb8e80033a0 2019-11-28T11:36:02.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.557+0000 7fb909a23700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8e8020b30 0x7fb8e8022f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:02.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.557+0000 7fb909a23700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8e8020b30 0x7fb8e8022f60 crc :-1 s=READY pgs=407 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:02.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.564+0000 7fb90bc87700 1 -- 172.21.15.80:0/3901477806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb904121d20 con 0x7fb8e80033a0 2019-11-28T11:36:02.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.568+0000 7fb90a224700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e80033a0 0x7fb8e80037f0 secure :-1 s=THROTTLE_DONE pgs=992 cs=0 l=1 rx=0x7fb8f40125b0 tx=0x7fb8f40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:02.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.568+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb8f4000b50 con 0x7fb8e80033a0 2019-11-28T11:36:02.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.742+0000 7fb90bc87700 1 -- 172.21.15.80:0/3901477806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9041219a0 con 0x7fb8e80033a0 2019-11-28T11:36:02.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.742+0000 7fb90a224700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e80033a0 0x7fb8e80037f0 secure :-1 s=THROTTLE_DONE pgs=992 cs=0 l=1 rx=0x7fb8f40125b0 tx=0x7fb8f40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:02.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.742+0000 7fb902ffd700 1 -- 172.21.15.80:0/3901477806 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fb8f4000d60 con 0x7fb8e80033a0 2019-11-28T11:36:02.800 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:02.800 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:02.800 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:02.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.745+0000 7fb90bc87700 1 -- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8e8020b30 msgr2=0x7fb8e8022f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:02.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.745+0000 7fb90bc87700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8e8020b30 0x7fb8e8022f60 crc :-1 s=READY pgs=407 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:02.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.745+0000 7fb90bc87700 1 -- 172.21.15.80:0/3901477806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e80033a0 msgr2=0x7fb8e80037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:02.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.745+0000 7fb90bc87700 1 --2- 172.21.15.80:0/3901477806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8e80033a0 0x7fb8e80037f0 secure :-1 s=READY pgs=992 cs=0 l=1 rx=0x7fb8f40125b0 tx=0x7fb8f40102d0).stop 2019-11-28T11:36:02.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.745+0000 7fb90aa25700 1 -- 172.21.15.80:0/3901477806 reap_dead start 2019-11-28T11:36:02.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.745+0000 7fb90aa25700 1 -- 172.21.15.80:0/3901477806 reap_dead start 2019-11-28T11:36:02.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.745+0000 7fb90bc87700 1 -- 172.21.15.80:0/3901477806 shutdown_connections 2019-11-28T11:36:02.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.745+0000 7fb90bc87700 1 -- 172.21.15.80:0/3901477806 shutdown_connections 2019-11-28T11:36:02.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.745+0000 7fb90bc87700 1 -- 172.21.15.80:0/3901477806 wait complete. 2019-11-28T11:36:02.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:02.745+0000 7fb90bc87700 1 -- 172.21.15.80:0/3901477806 >> 172.21.15.80:0/3901477806 conn(0x7fb9041426c0 msgr2=0x7fb904110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:02.819 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:03.820 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:03.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.884+0000 7fab30655700 1 Processor -- start 2019-11-28T11:36:03.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.884+0000 7fab30655700 1 -- start start 2019-11-28T11:36:03.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.885+0000 7fab30655700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab2806c0a0 0x7fab28072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:03.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.885+0000 7fab30655700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2806db00 con 0x7fab280734e0 2019-11-28T11:36:03.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.885+0000 7fab30655700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2806e000 con 0x7fab28072620 2019-11-28T11:36:03.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.885+0000 7fab30655700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2806f330 con 0x7fab2806c0a0 2019-11-28T11:36:03.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2e3f1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fab280734e0 0x7fab28071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35420/0 (socket says 172.21.15.80:35420) 2019-11-28T11:36:03.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2e3f1700 1 -- 172.21.15.80:0/1147783504 learned_addr learned my addr 172.21.15.80:0/1147783504 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:03.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2ebf2700 1 --2- 172.21.15.80:0/1147783504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab2806c0a0 0x7fab28072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:03.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2dbf0700 1 -- 172.21.15.80:0/1147783504 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469729634 0 0) 0x7fab18001070 con 0x7fab280734e0 2019-11-28T11:36:03.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2dbf0700 1 -- 172.21.15.80:0/1147783504 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab14002e80 con 0x7fab280734e0 2019-11-28T11:36:03.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2dbf0700 1 -- 172.21.15.80:0/1147783504 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937239893 0 0) 0x7fab20000d30 con 0x7fab28072620 2019-11-28T11:36:03.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2dbf0700 1 -- 172.21.15.80:0/1147783504 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab14004170 con 0x7fab28072620 2019-11-28T11:36:03.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2ebf2700 1 -- 172.21.15.80:0/1147783504 >> v1:172.21.15.174:6789/0 conn(0x7fab28072620 legacy=0x7fab28164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:03.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2ebf2700 1 -- 172.21.15.80:0/1147783504 >> v1:172.21.15.80:6789/0 conn(0x7fab280734e0 legacy=0x7fab28071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:03.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2ebf2700 1 -- 172.21.15.80:0/1147783504 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab280706c0 con 0x7fab2806c0a0 2019-11-28T11:36:03.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2ebf2700 1 --2- 172.21.15.80:0/1147783504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab2806c0a0 0x7fab28072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fab1000af50 tx=0x7fab1000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:03.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2ebf2700 1 --2- 172.21.15.80:0/1147783504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab2806c0a0 0x7fab28072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fab1000af50 tx=0x7fab1000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:03.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2ebf2700 1 --2- 172.21.15.80:0/1147783504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab2806c0a0 0x7fab28072fa0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7fab1000af50 tx=0x7fab1000b760).ready entity=mon.2 client_cookie=72972f2cfcd967cb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:03.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2ebf2700 1 --2- 172.21.15.80:0/1147783504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab2806c0a0 0x7fab28072fa0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fab1000af50 tx=0x7fab1000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:03.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2dbf0700 1 -- 172.21.15.80:0/1147783504 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab10000960 con 0x7fab2806c0a0 2019-11-28T11:36:03.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2ebf2700 1 --2- 172.21.15.80:0/1147783504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab2806c0a0 0x7fab28072fa0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fab1000af50 tx=0x7fab1000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:03.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2ebf2700 1 --2- 172.21.15.80:0/1147783504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab2806c0a0 0x7fab28072fa0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fab1000af50 tx=0x7fab1000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:03.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2dbf0700 1 -- 172.21.15.80:0/1147783504 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab10009860 con 0x7fab2806c0a0 2019-11-28T11:36:03.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab2dbf0700 1 -- 172.21.15.80:0/1147783504 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab10009f30 con 0x7fab2806c0a0 2019-11-28T11:36:03.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab30655700 1 -- 172.21.15.80:0/1147783504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab2806c0a0 msgr2=0x7fab28072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:03.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.886+0000 7fab30655700 1 --2- 172.21.15.80:0/1147783504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab2806c0a0 0x7fab28072fa0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7fab1000af50 tx=0x7fab1000b760).stop 2019-11-28T11:36:03.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.887+0000 7fab30655700 1 -- 172.21.15.80:0/1147783504 shutdown_connections 2019-11-28T11:36:03.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.887+0000 7fab30655700 1 --2- 172.21.15.80:0/1147783504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab2806c0a0 0x7fab28072fa0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:03.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.887+0000 7fab30655700 1 -- 172.21.15.80:0/1147783504 shutdown_connections 2019-11-28T11:36:03.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.887+0000 7fab30655700 1 -- 172.21.15.80:0/1147783504 wait complete. 2019-11-28T11:36:03.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.887+0000 7fab30655700 1 -- 172.21.15.80:0/1147783504 >> 172.21.15.80:0/1147783504 conn(0x7fab28061cf0 msgr2=0x7fab28064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:03.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.890+0000 7fab30655700 1 Processor -- start 2019-11-28T11:36:03.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.890+0000 7fab30655700 1 -- start start 2019-11-28T11:36:03.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab30655700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab28135840 0x7fab281ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:03.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab30655700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2813f410 con 0x7fab281346b0 2019-11-28T11:36:03.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab30655700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2812ed00 con 0x7fab281342c0 2019-11-28T11:36:03.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab30655700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab28141670 con 0x7fab28135840 2019-11-28T11:36:03.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab2e3f1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fab281346b0 0x7fab28135040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35424/0 (socket says 172.21.15.80:35424) 2019-11-28T11:36:03.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab2e3f1700 1 -- 172.21.15.80:0/1656976265 learned_addr learned my addr 172.21.15.80:0/1656976265 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:03.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab2f3f3700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab28135840 0x7fab281ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:03.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab277fe700 1 -- 172.21.15.80:0/1656976265 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160418398 0 0) 0x7fab18001280 con 0x7fab281346b0 2019-11-28T11:36:03.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab277fe700 1 -- 172.21.15.80:0/1656976265 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab0c002e80 con 0x7fab281346b0 2019-11-28T11:36:03.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab277fe700 1 -- 172.21.15.80:0/1656976265 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569921150 0 0) 0x7fab10000940 con 0x7fab281342c0 2019-11-28T11:36:03.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab277fe700 1 -- 172.21.15.80:0/1656976265 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab0c0030b0 con 0x7fab281342c0 2019-11-28T11:36:03.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab277fe700 1 -- 172.21.15.80:0/1656976265 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3109896913 0 0) 0x7fab18001480 con 0x7fab281346b0 2019-11-28T11:36:03.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab2f3f3700 1 -- 172.21.15.80:0/1656976265 >> v1:172.21.15.174:6789/0 conn(0x7fab281342c0 legacy=0x7fab281361c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:03.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab2f3f3700 1 -- 172.21.15.80:0/1656976265 >> v1:172.21.15.80:6789/0 conn(0x7fab281346b0 legacy=0x7fab28135040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:03.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab2f3f3700 1 -- 172.21.15.80:0/1656976265 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab28141fd0 con 0x7fab28135840 2019-11-28T11:36:03.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab2f3f3700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab28135840 0x7fab281ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab20010710 tx=0x7fab20010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:03.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab2f3f3700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab28135840 0x7fab281ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab20010710 tx=0x7fab20010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:03.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab2f3f3700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab28135840 0x7fab281ad5b0 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7fab20010710 tx=0x7fab20010ab0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:03.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab2f3f3700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab28135840 0x7fab281ad5b0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7fab20010710 tx=0x7fab20010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:03.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab277fe700 1 -- 172.21.15.80:0/1656976265 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab2000f350 con 0x7fab28135840 2019-11-28T11:36:03.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab2f3f3700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab28135840 0x7fab281ad5b0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7fab20010710 tx=0x7fab20010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:03.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab277fe700 1 -- 172.21.15.80:0/1656976265 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab20000cc0 con 0x7fab28135840 2019-11-28T11:36:03.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab30655700 1 -- 172.21.15.80:0/1656976265 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab28142350 con 0x7fab28135840 2019-11-28T11:36:03.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab2f3f3700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab28135840 0x7fab281ad5b0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7fab20010710 tx=0x7fab20010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:03.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab277fe700 1 -- 172.21.15.80:0/1656976265 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab2000f5b0 con 0x7fab28135840 2019-11-28T11:36:03.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.891+0000 7fab30655700 1 -- 172.21.15.80:0/1656976265 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab28141fd0 con 0x7fab28135840 2019-11-28T11:36:03.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.892+0000 7fab2f3f3700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab28135840 0x7fab281ad5b0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7fab20010710 tx=0x7fab20010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:03.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.892+0000 7fab277fe700 1 -- 172.21.15.80:0/1656976265 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fab2000f500 con 0x7fab28135840 2019-11-28T11:36:03.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.892+0000 7fab2f3f3700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab28135840 0x7fab281ad5b0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7fab20010710 tx=0x7fab20010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:03.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.892+0000 7fab277fe700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab0c018750 0x7fab0c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:03.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.892+0000 7fab277fe700 1 -- 172.21.15.80:0/1656976265 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fab20031e30 con 0x7fab28135840 2019-11-28T11:36:03.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.892+0000 7fab2ebf2700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab0c018750 0x7fab0c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:03.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.893+0000 7fab2ebf2700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab0c018750 0x7fab0c01abe0 crc :-1 s=READY pgs=408 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:03.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.900+0000 7fab30655700 1 -- 172.21.15.80:0/1656976265 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab28142350 con 0x7fab28135840 2019-11-28T11:36:03.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.904+0000 7fab2f3f3700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab28135840 0x7fab281ad5b0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7fab20010710 tx=0x7fab20010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:03.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:03.904+0000 7fab277fe700 1 -- 172.21.15.80:0/1656976265 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fab2000f2f0 con 0x7fab28135840 2019-11-28T11:36:04.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:04.074+0000 7fab30655700 1 -- 172.21.15.80:0/1656976265 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab28141fd0 con 0x7fab28135840 2019-11-28T11:36:04.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:04.076+0000 7fab2f3f3700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab28135840 0x7fab281ad5b0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7fab20010710 tx=0x7fab20010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:04.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:04.076+0000 7fab277fe700 1 -- 172.21.15.80:0/1656976265 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fab2000f500 con 0x7fab28135840 2019-11-28T11:36:04.134 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:04.134 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:04.134 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:04.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:04.077+0000 7fab30655700 1 -- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab0c018750 msgr2=0x7fab0c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:04.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:04.077+0000 7fab30655700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab0c018750 0x7fab0c01abe0 crc :-1 s=READY pgs=408 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:04.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:04.077+0000 7fab30655700 1 -- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab28135840 msgr2=0x7fab281ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:04.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:04.077+0000 7fab30655700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab28135840 0x7fab281ad5b0 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7fab20010710 tx=0x7fab20010ab0).stop 2019-11-28T11:36:04.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:04.077+0000 7fab30655700 1 -- 172.21.15.80:0/1656976265 shutdown_connections 2019-11-28T11:36:04.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:04.077+0000 7fab30655700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab28135840 0x7fab281ad5b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:04.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:04.077+0000 7fab30655700 1 --2- 172.21.15.80:0/1656976265 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab0c018750 0x7fab0c01abe0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:04.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:04.077+0000 7fab30655700 1 -- 172.21.15.80:0/1656976265 shutdown_connections 2019-11-28T11:36:04.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:04.077+0000 7fab30655700 1 -- 172.21.15.80:0/1656976265 wait complete. 2019-11-28T11:36:04.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:04.077+0000 7fab30655700 1 -- 172.21.15.80:0/1656976265 >> 172.21.15.80:0/1656976265 conn(0x7fab28159ae0 msgr2=0x7fab2813d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:04.145 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:05.146 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:05.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.212+0000 7f61cb3ba700 1 Processor -- start 2019-11-28T11:36:05.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.212+0000 7f61cb3ba700 1 -- start start 2019-11-28T11:36:05.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.213+0000 7f61cb3ba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f61c406d120 0x7f61c4165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:05.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.213+0000 7f61cb3ba700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c406d5a0 con 0x7f61c406c0a0 2019-11-28T11:36:05.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.213+0000 7f61cb3ba700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c406db00 con 0x7f61c406c490 2019-11-28T11:36:05.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.213+0000 7f61cb3ba700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c406fd60 con 0x7f61c406d120 2019-11-28T11:36:05.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.213+0000 7f61ca158700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f61c406d120 0x7f61c4165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:05.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.213+0000 7f61ca158700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f61c406d120 0x7f61c4165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36116/0 (socket says 172.21.15.80:36116) 2019-11-28T11:36:05.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.213+0000 7f61ca158700 1 -- 172.21.15.80:0/1269838430 learned_addr learned my addr 172.21.15.80:0/1269838430 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:05.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.213+0000 7f61ca158700 1 -- 172.21.15.80:0/1269838430 >> v1:172.21.15.174:6789/0 conn(0x7f61c406c490 legacy=0x7f61c406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:05.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.213+0000 7f61ca158700 1 -- 172.21.15.80:0/1269838430 >> v1:172.21.15.80:6789/0 conn(0x7f61c406c0a0 legacy=0x7f61c4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:05.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.213+0000 7f61ca158700 1 -- 172.21.15.80:0/1269838430 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c40706c0 con 0x7f61c406d120 2019-11-28T11:36:05.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.213+0000 7f61ca158700 1 --2- 172.21.15.80:0/1269838430 >> v2:172.21.15.80:3300/0 conn(0x7f61c406d120 0x7f61c4165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f61bc00f730 tx=0x7f61bc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:05.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.213+0000 7f61ca158700 1 --2- 172.21.15.80:0/1269838430 >> v2:172.21.15.80:3300/0 conn(0x7f61c406d120 0x7f61c4165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f61bc00f730 tx=0x7f61bc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:05.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.213+0000 7f61ca158700 1 --2- 172.21.15.80:0/1269838430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c406d120 0x7f61c4165d80 secure :-1 s=READY pgs=996 cs=0 l=1 rx=0x7f61bc00f730 tx=0x7f61bc00fad0).ready entity=mon.0 client_cookie=4faf1b302388c435 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:05.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.213+0000 7f61ca158700 1 --2- 172.21.15.80:0/1269838430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c406d120 0x7f61c4165d80 secure :-1 s=THROTTLE_DONE pgs=996 cs=0 l=1 rx=0x7f61bc00f730 tx=0x7f61bc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:05.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.213+0000 7f61ca158700 1 --2- 172.21.15.80:0/1269838430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c406d120 0x7f61c4165d80 secure :-1 s=THROTTLE_DONE pgs=996 cs=0 l=1 rx=0x7f61bc00f730 tx=0x7f61bc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:05.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.213+0000 7f61c8955700 1 -- 172.21.15.80:0/1269838430 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61bc0010e0 con 0x7f61c406d120 2019-11-28T11:36:05.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.214+0000 7f61ca158700 1 --2- 172.21.15.80:0/1269838430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c406d120 0x7f61c4165d80 secure :-1 s=THROTTLE_DONE pgs=996 cs=0 l=1 rx=0x7f61bc00f730 tx=0x7f61bc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:05.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.214+0000 7f61c8955700 1 -- 172.21.15.80:0/1269838430 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc000a70 con 0x7f61c406d120 2019-11-28T11:36:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.214+0000 7f61c8955700 1 -- 172.21.15.80:0/1269838430 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61bc0016c0 con 0x7f61c406d120 2019-11-28T11:36:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.214+0000 7f61cb3ba700 1 -- 172.21.15.80:0/1269838430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c406d120 msgr2=0x7f61c4165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.214+0000 7f61cb3ba700 1 --2- 172.21.15.80:0/1269838430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c406d120 0x7f61c4165d80 secure :-1 s=READY pgs=996 cs=0 l=1 rx=0x7f61bc00f730 tx=0x7f61bc00fad0).stop 2019-11-28T11:36:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.214+0000 7f61cb3ba700 1 -- 172.21.15.80:0/1269838430 shutdown_connections 2019-11-28T11:36:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.214+0000 7f61cb3ba700 1 --2- 172.21.15.80:0/1269838430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c406d120 0x7f61c4165d80 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.214+0000 7f61cb3ba700 1 -- 172.21.15.80:0/1269838430 shutdown_connections 2019-11-28T11:36:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.214+0000 7f61cb3ba700 1 -- 172.21.15.80:0/1269838430 wait complete. 2019-11-28T11:36:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.214+0000 7f61cb3ba700 1 -- 172.21.15.80:0/1269838430 >> 172.21.15.80:0/1269838430 conn(0x7f61c4061cf0 msgr2=0x7f61c4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:05.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.217+0000 7f61cb3ba700 1 Processor -- start 2019-11-28T11:36:05.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.217+0000 7f61cb3ba700 1 -- start start 2019-11-28T11:36:05.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61cb3ba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f61c4111db0 0x7f61c41238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:05.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61cb3ba700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f61c4165a00 0x7f61c4167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:05.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61cb3ba700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c4124260 con 0x7f61c412cea0 2019-11-28T11:36:05.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61cb3ba700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c4121040 con 0x7f61c4111db0 2019-11-28T11:36:05.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61cb3ba700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c4121310 con 0x7f61c4165a00 2019-11-28T11:36:05.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61c9156700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f61c4111db0 0x7f61c41238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:05.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61c9156700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f61c4111db0 0x7f61c41238e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36122/0 (socket says 172.21.15.80:36122) 2019-11-28T11:36:05.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61c9156700 1 -- 172.21.15.80:0/3677790189 learned_addr learned my addr 172.21.15.80:0/3677790189 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:05.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61ca158700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f61c4165a00 0x7f61c4167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:05.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61c9156700 1 -- 172.21.15.80:0/3677790189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f61c4165a00 msgr2=0x7f61c4167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:05.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61c9156700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f61c4165a00 0x7f61c4167e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:05.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61c9156700 1 -- 172.21.15.80:0/3677790189 >> v1:172.21.15.174:6789/0 conn(0x7f61c412cea0 legacy=0x7f61c41230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:05.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61c9156700 1 -- 172.21.15.80:0/3677790189 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c41219a0 con 0x7f61c4111db0 2019-11-28T11:36:05.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61c9156700 1 --2- 172.21.15.80:0/3677790189 >> v2:172.21.15.80:3300/0 conn(0x7f61c4111db0 0x7f61c41238e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f61b4010410 tx=0x7f61b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:05.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61c9156700 1 --2- 172.21.15.80:0/3677790189 >> v2:172.21.15.80:3300/0 conn(0x7f61c4111db0 0x7f61c41238e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f61b4010410 tx=0x7f61b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:05.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61c9156700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c4111db0 0x7f61c41238e0 secure :-1 s=READY pgs=997 cs=0 l=1 rx=0x7f61b4010410 tx=0x7f61b4010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:05.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61c9156700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c4111db0 0x7f61c41238e0 secure :-1 s=THROTTLE_DONE pgs=997 cs=0 l=1 rx=0x7f61b4010410 tx=0x7f61b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:05.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61c27fc700 1 -- 172.21.15.80:0/3677790189 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61b4000960 con 0x7f61c4111db0 2019-11-28T11:36:05.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61c9156700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c4111db0 0x7f61c41238e0 secure :-1 s=THROTTLE_DONE pgs=997 cs=0 l=1 rx=0x7f61b4010410 tx=0x7f61b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:05.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61c9156700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c4111db0 0x7f61c41238e0 secure :-1 s=THROTTLE_DONE pgs=997 cs=0 l=1 rx=0x7f61b4010410 tx=0x7f61b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:05.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61c27fc700 1 -- 172.21.15.80:0/3677790189 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b40010a0 con 0x7f61c4111db0 2019-11-28T11:36:05.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61cb3ba700 1 -- 172.21.15.80:0/3677790189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c4121d20 con 0x7f61c4111db0 2019-11-28T11:36:05.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61c27fc700 1 -- 172.21.15.80:0/3677790189 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61b40017f0 con 0x7f61c4111db0 2019-11-28T11:36:05.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.218+0000 7f61cb3ba700 1 -- 172.21.15.80:0/3677790189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c41219a0 con 0x7f61c4111db0 2019-11-28T11:36:05.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.219+0000 7f61c9156700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c4111db0 0x7f61c41238e0 secure :-1 s=THROTTLE_DONE pgs=997 cs=0 l=1 rx=0x7f61b4010410 tx=0x7f61b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:05.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.219+0000 7f61c27fc700 1 -- 172.21.15.80:0/3677790189 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f61b4000eb0 con 0x7f61c4111db0 2019-11-28T11:36:05.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.219+0000 7f61c9156700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c4111db0 0x7f61c41238e0 secure :-1 s=THROTTLE_DONE pgs=997 cs=0 l=1 rx=0x7f61b4010410 tx=0x7f61b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:05.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.220+0000 7f61c27fc700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f61a8018730 0x7f61a801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:05.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.220+0000 7f61c27fc700 1 -- 172.21.15.80:0/3677790189 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f61b4031ac0 con 0x7f61c4111db0 2019-11-28T11:36:05.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.220+0000 7f61c9957700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f61a8018730 0x7f61a801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:05.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.220+0000 7f61c9957700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f61a8018730 0x7f61a801abc0 crc :-1 s=READY pgs=409 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:05.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.227+0000 7f61cb3ba700 1 -- 172.21.15.80:0/3677790189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c4121d20 con 0x7f61c4111db0 2019-11-28T11:36:05.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.230+0000 7f61c9156700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c4111db0 0x7f61c41238e0 secure :-1 s=THROTTLE_DONE pgs=997 cs=0 l=1 rx=0x7f61b4010410 tx=0x7f61b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:05.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.230+0000 7f61c27fc700 1 -- 172.21.15.80:0/3677790189 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f61b40075b0 con 0x7f61c4111db0 2019-11-28T11:36:05.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.402+0000 7f61cb3ba700 1 -- 172.21.15.80:0/3677790189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61c41219a0 con 0x7f61c4111db0 2019-11-28T11:36:05.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.403+0000 7f61c9156700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c4111db0 0x7f61c41238e0 secure :-1 s=THROTTLE_DONE pgs=997 cs=0 l=1 rx=0x7f61b4010410 tx=0x7f61b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:05.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.403+0000 7f61c27fc700 1 -- 172.21.15.80:0/3677790189 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f61b40018c0 con 0x7f61c4111db0 2019-11-28T11:36:05.459 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:05.460 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:05.460 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:05.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.405+0000 7f61cb3ba700 1 -- 172.21.15.80:0/3677790189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f61a8018730 msgr2=0x7f61a801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:05.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.405+0000 7f61cb3ba700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f61a8018730 0x7f61a801abc0 crc :-1 s=READY pgs=409 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:05.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.405+0000 7f61cb3ba700 1 -- 172.21.15.80:0/3677790189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c4111db0 msgr2=0x7f61c41238e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:05.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.405+0000 7f61cb3ba700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c4111db0 0x7f61c41238e0 secure :-1 s=READY pgs=997 cs=0 l=1 rx=0x7f61b4010410 tx=0x7f61b4010270).stop 2019-11-28T11:36:05.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.405+0000 7f61cb3ba700 1 -- 172.21.15.80:0/3677790189 shutdown_connections 2019-11-28T11:36:05.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.405+0000 7f61cb3ba700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f61c4165a00 0x7f61c4167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:05.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.405+0000 7f61cb3ba700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61c4111db0 0x7f61c41238e0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:05.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.405+0000 7f61cb3ba700 1 --2- 172.21.15.80:0/3677790189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f61a8018730 0x7f61a801abc0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:05.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.405+0000 7f61cb3ba700 1 -- 172.21.15.80:0/3677790189 shutdown_connections 2019-11-28T11:36:05.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.405+0000 7f61cb3ba700 1 -- 172.21.15.80:0/3677790189 wait complete. 2019-11-28T11:36:05.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:05.405+0000 7f61cb3ba700 1 -- 172.21.15.80:0/3677790189 >> 172.21.15.80:0/3677790189 conn(0x7f61c41426c0 msgr2=0x7f61c4110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:05.471 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:06.472 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:06.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.534+0000 7f5f8a32e700 1 Processor -- start 2019-11-28T11:36:06.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.534+0000 7f5f8a32e700 1 -- start start 2019-11-28T11:36:06.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.535+0000 7f5f8a32e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f8406c490 0x7f5f8406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:06.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.535+0000 7f5f8a32e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8406db00 con 0x7f5f8406ce60 2019-11-28T11:36:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.535+0000 7f5f8a32e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8406e000 con 0x7f5f8406c0a0 2019-11-28T11:36:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.535+0000 7f5f8a32e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8406fd60 con 0x7f5f8406c490 2019-11-28T11:36:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.535+0000 7f5f890cc700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5f8406ce60 0x7f5f84164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35444/0 (socket says 172.21.15.80:35444) 2019-11-28T11:36:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.535+0000 7f5f890cc700 1 -- 172.21.15.80:0/2381387085 learned_addr learned my addr 172.21.15.80:0/2381387085 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.535+0000 7f5f83fff700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f8406c490 0x7f5f8406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 -- 172.21.15.80:0/2381387085 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232187229 0 0) 0x7f5f7c001150 con 0x7f5f8406ce60 2019-11-28T11:36:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 -- 172.21.15.80:0/2381387085 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f70002e80 con 0x7f5f8406ce60 2019-11-28T11:36:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 -- 172.21.15.80:0/2381387085 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596680654 0 0) 0x7f5f6c001080 con 0x7f5f8406c0a0 2019-11-28T11:36:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 -- 172.21.15.80:0/2381387085 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f700030b0 con 0x7f5f8406c0a0 2019-11-28T11:36:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 -- 172.21.15.80:0/2381387085 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1041365000 0 0) 0x7f5f7c001130 con 0x7f5f8406ce60 2019-11-28T11:36:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 -- 172.21.15.80:0/2381387085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f8406c490 msgr2=0x7f5f8406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f8406c490 0x7f5f8406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 -- 172.21.15.80:0/2381387085 >> v1:172.21.15.174:6789/0 conn(0x7f5f8406c0a0 legacy=0x7f5f84072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 -- 172.21.15.80:0/2381387085 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f840706c0 con 0x7f5f8406ce60 2019-11-28T11:36:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 -- 172.21.15.80:0/2381387085 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f5f7c001660 con 0x7f5f8406ce60 2019-11-28T11:36:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 -- 172.21.15.80:0/2381387085 >> v1:172.21.15.80:6789/0 conn(0x7f5f8406ce60 legacy=0x7f5f84164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f70003b80 0x7f5f70005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f700066d0 0x7f5f70008b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f7004d3a0 0x7f5f7004f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 -- 172.21.15.80:0/2381387085 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7004fff0 con 0x7f5f70003b80 2019-11-28T11:36:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 -- 172.21.15.80:0/2381387085 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f700501e0 con 0x7f5f700066d0 2019-11-28T11:36:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 -- 172.21.15.80:0/2381387085 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f70050410 con 0x7f5f7004d3a0 2019-11-28T11:36:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f888cb700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f70003b80 0x7f5f70005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f83fff700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f700066d0 0x7f5f70008b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f890cc700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f7004d3a0 0x7f5f7004f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f888cb700 1 -- 172.21.15.80:0/2381387085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f7004d3a0 msgr2=0x7f5f7004f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f888cb700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f7004d3a0 0x7f5f7004f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f888cb700 1 -- 172.21.15.80:0/2381387085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f700066d0 msgr2=0x7f5f70008b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f888cb700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f700066d0 0x7f5f70008b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f888cb700 1 -- 172.21.15.80:0/2381387085 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f700506c0 con 0x7f5f70003b80 2019-11-28T11:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f890cc700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f7004d3a0 0x7f5f7004f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f888cb700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f70003b80 0x7f5f70005fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5f6c00af70 tx=0x7f5f6c00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f888cb700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f70003b80 0x7f5f70005fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5f6c00af70 tx=0x7f5f6c00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f888cb700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f70003b80 0x7f5f70005fe0 secure :-1 s=READY pgs=999 cs=0 l=1 rx=0x7f5f6c00af70 tx=0x7f5f6c00b2f0).ready entity=mon.0 client_cookie=70c46e271d278830 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:06.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f888cb700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f70003b80 0x7f5f70005fe0 secure :-1 s=THROTTLE_DONE pgs=999 cs=0 l=1 rx=0x7f5f6c00af70 tx=0x7f5f6c00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:06.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f837fe700 1 -- 172.21.15.80:0/2381387085 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f6c009cb0 con 0x7f5f70003b80 2019-11-28T11:36:06.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.536+0000 7f5f888cb700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f70003b80 0x7f5f70005fe0 secure :-1 s=THROTTLE_DONE pgs=999 cs=0 l=1 rx=0x7f5f6c00af70 tx=0x7f5f6c00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:06.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.537+0000 7f5f837fe700 1 -- 172.21.15.80:0/2381387085 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c0098d0 con 0x7f5f70003b80 2019-11-28T11:36:06.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.537+0000 7f5f888cb700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f70003b80 0x7f5f70005fe0 secure :-1 s=THROTTLE_DONE pgs=999 cs=0 l=1 rx=0x7f5f6c00af70 tx=0x7f5f6c00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:06.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.537+0000 7f5f837fe700 1 -- 172.21.15.80:0/2381387085 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f6c009f40 con 0x7f5f70003b80 2019-11-28T11:36:06.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.537+0000 7f5f8a32e700 1 -- 172.21.15.80:0/2381387085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f70003b80 msgr2=0x7f5f70005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.537+0000 7f5f8a32e700 1 --2- 172.21.15.80:0/2381387085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f70003b80 0x7f5f70005fe0 secure :-1 s=READY pgs=999 cs=0 l=1 rx=0x7f5f6c00af70 tx=0x7f5f6c00b2f0).stop 2019-11-28T11:36:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.537+0000 7f5f890cc700 1 -- 172.21.15.80:0/2381387085 reap_dead start 2019-11-28T11:36:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.537+0000 7f5f8a32e700 1 -- 172.21.15.80:0/2381387085 shutdown_connections 2019-11-28T11:36:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.537+0000 7f5f8a32e700 1 -- 172.21.15.80:0/2381387085 shutdown_connections 2019-11-28T11:36:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.537+0000 7f5f8a32e700 1 -- 172.21.15.80:0/2381387085 wait complete. 2019-11-28T11:36:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.537+0000 7f5f8a32e700 1 -- 172.21.15.80:0/2381387085 >> 172.21.15.80:0/2381387085 conn(0x7f5f84061cf0 msgr2=0x7f5f84064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.540+0000 7f5f8a32e700 1 Processor -- start 2019-11-28T11:36:06.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.540+0000 7f5f8a32e700 1 -- start start 2019-11-28T11:36:06.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f8a32e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5f84074d00 0x7f5f840750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:06.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f8a32e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f84152bd0 0x7f5f84140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:06.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f8a32e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f84079230 con 0x7f5f84153040 2019-11-28T11:36:06.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f8a32e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8407ab30 con 0x7f5f84152bd0 2019-11-28T11:36:06.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f8a32e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8407ae00 con 0x7f5f84074d00 2019-11-28T11:36:06.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f83fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f84152bd0 0x7f5f84140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:06.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f83fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f84152bd0 0x7f5f84140440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36140/0 (socket says 172.21.15.80:36140) 2019-11-28T11:36:06.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f83fff700 1 -- 172.21.15.80:0/116053169 learned_addr learned my addr 172.21.15.80:0/116053169 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:06.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f888cb700 1 --2- 172.21.15.80:0/116053169 >> v2:172.21.15.174:3300/0 conn(0x7f5f84074d00 0x7f5f840750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:06.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f83fff700 1 -- 172.21.15.80:0/116053169 >> v2:172.21.15.174:3300/0 conn(0x7f5f84074d00 msgr2=0x7f5f840750f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:06.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f83fff700 1 --2- 172.21.15.80:0/116053169 >> v2:172.21.15.174:3300/0 conn(0x7f5f84074d00 0x7f5f840750f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:06.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f83fff700 1 -- 172.21.15.80:0/116053169 >> v1:172.21.15.174:6789/0 conn(0x7f5f84153040 legacy=0x7f5f84140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:06.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f83fff700 1 -- 172.21.15.80:0/116053169 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8407b490 con 0x7f5f84152bd0 2019-11-28T11:36:06.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f888cb700 1 --2- 172.21.15.80:0/116053169 >> v2:172.21.15.174:3300/0 conn(0x7f5f84074d00 0x7f5f840750f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:36:06.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f83fff700 1 --2- 172.21.15.80:0/116053169 >> v2:172.21.15.80:3300/0 conn(0x7f5f84152bd0 0x7f5f84140440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5f74010780 tx=0x7f5f74010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:06.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f83fff700 1 --2- 172.21.15.80:0/116053169 >> v2:172.21.15.80:3300/0 conn(0x7f5f84152bd0 0x7f5f84140440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5f74010780 tx=0x7f5f74010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:06.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f83fff700 1 --2- 172.21.15.80:0/116053169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f84152bd0 0x7f5f84140440 secure :-1 s=READY pgs=1000 cs=0 l=1 rx=0x7f5f74010780 tx=0x7f5f74010b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:06.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f83fff700 1 --2- 172.21.15.80:0/116053169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f84152bd0 0x7f5f84140440 secure :-1 s=THROTTLE_DONE pgs=1000 cs=0 l=1 rx=0x7f5f74010780 tx=0x7f5f74010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:06.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f817fa700 1 -- 172.21.15.80:0/116053169 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f7400aad0 con 0x7f5f84152bd0 2019-11-28T11:36:06.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f83fff700 1 --2- 172.21.15.80:0/116053169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f84152bd0 0x7f5f84140440 secure :-1 s=THROTTLE_DONE pgs=1000 cs=0 l=1 rx=0x7f5f74010780 tx=0x7f5f74010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:06.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f83fff700 1 --2- 172.21.15.80:0/116053169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f84152bd0 0x7f5f84140440 secure :-1 s=THROTTLE_DONE pgs=1000 cs=0 l=1 rx=0x7f5f74010780 tx=0x7f5f74010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:06.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f817fa700 1 -- 172.21.15.80:0/116053169 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f74009ce0 con 0x7f5f84152bd0 2019-11-28T11:36:06.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f8a32e700 1 -- 172.21.15.80:0/116053169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8407b810 con 0x7f5f84152bd0 2019-11-28T11:36:06.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f817fa700 1 -- 172.21.15.80:0/116053169 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f7400a370 con 0x7f5f84152bd0 2019-11-28T11:36:06.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.541+0000 7f5f8a32e700 1 -- 172.21.15.80:0/116053169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8407b490 con 0x7f5f84152bd0 2019-11-28T11:36:06.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.542+0000 7f5f83fff700 1 --2- 172.21.15.80:0/116053169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f84152bd0 0x7f5f84140440 secure :-1 s=THROTTLE_DONE pgs=1000 cs=0 l=1 rx=0x7f5f74010780 tx=0x7f5f74010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:06.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.542+0000 7f5f817fa700 1 -- 172.21.15.80:0/116053169 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5f74009900 con 0x7f5f84152bd0 2019-11-28T11:36:06.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.542+0000 7f5f83fff700 1 --2- 172.21.15.80:0/116053169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f84152bd0 0x7f5f84140440 secure :-1 s=THROTTLE_DONE pgs=1000 cs=0 l=1 rx=0x7f5f74010780 tx=0x7f5f74010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:06.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.542+0000 7f5f817fa700 1 --2- 172.21.15.80:0/116053169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f68018730 0x7f5f6801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:06.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.542+0000 7f5f817fa700 1 -- 172.21.15.80:0/116053169 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f5f74031e90 con 0x7f5f84152bd0 2019-11-28T11:36:06.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.542+0000 7f5f888cb700 1 --2- 172.21.15.80:0/116053169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f68018730 0x7f5f6801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:06.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.542+0000 7f5f888cb700 1 --2- 172.21.15.80:0/116053169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f68018730 0x7f5f6801abc0 crc :-1 s=READY pgs=410 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:06.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.549+0000 7f5f8a32e700 1 -- 172.21.15.80:0/116053169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8407b810 con 0x7f5f84152bd0 2019-11-28T11:36:06.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.553+0000 7f5f83fff700 1 --2- 172.21.15.80:0/116053169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f84152bd0 0x7f5f84140440 secure :-1 s=THROTTLE_DONE pgs=1000 cs=0 l=1 rx=0x7f5f74010780 tx=0x7f5f74010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:06.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.553+0000 7f5f817fa700 1 -- 172.21.15.80:0/116053169 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5f74000cc0 con 0x7f5f84152bd0 2019-11-28T11:36:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.728+0000 7f5f8a32e700 1 -- 172.21.15.80:0/116053169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f8407b490 con 0x7f5f84152bd0 2019-11-28T11:36:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.728+0000 7f5f83fff700 1 --2- 172.21.15.80:0/116053169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f84152bd0 0x7f5f84140440 secure :-1 s=THROTTLE_DONE pgs=1000 cs=0 l=1 rx=0x7f5f74010780 tx=0x7f5f74010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:06.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.728+0000 7f5f817fa700 1 -- 172.21.15.80:0/116053169 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f5f74009900 con 0x7f5f84152bd0 2019-11-28T11:36:06.786 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:06.786 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:06.786 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:06.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.731+0000 7f5f8a32e700 1 -- 172.21.15.80:0/116053169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f68018730 msgr2=0x7f5f6801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:06.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.731+0000 7f5f8a32e700 1 --2- 172.21.15.80:0/116053169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f68018730 0x7f5f6801abc0 crc :-1 s=READY pgs=410 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:06.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.731+0000 7f5f8a32e700 1 -- 172.21.15.80:0/116053169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f84152bd0 msgr2=0x7f5f84140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:06.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.731+0000 7f5f8a32e700 1 --2- 172.21.15.80:0/116053169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f84152bd0 0x7f5f84140440 secure :-1 s=READY pgs=1000 cs=0 l=1 rx=0x7f5f74010780 tx=0x7f5f74010b20).stop 2019-11-28T11:36:06.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.731+0000 7f5f8a32e700 1 -- 172.21.15.80:0/116053169 shutdown_connections 2019-11-28T11:36:06.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.731+0000 7f5f8a32e700 1 --2- 172.21.15.80:0/116053169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f68018730 0x7f5f6801abc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:06.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.731+0000 7f5f8a32e700 1 --2- 172.21.15.80:0/116053169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f84152bd0 0x7f5f84140440 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:06.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.731+0000 7f5f8a32e700 1 --2- 172.21.15.80:0/116053169 >> v2:172.21.15.174:3300/0 conn(0x7f5f84074d00 0x7f5f840750f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:06.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.731+0000 7f5f8a32e700 1 -- 172.21.15.80:0/116053169 shutdown_connections 2019-11-28T11:36:06.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.731+0000 7f5f8a32e700 1 -- 172.21.15.80:0/116053169 wait complete. 2019-11-28T11:36:06.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:06.731+0000 7f5f8a32e700 1 -- 172.21.15.80:0/116053169 >> 172.21.15.80:0/116053169 conn(0x7f5f8413fa50 msgr2=0x7f5f8407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:06.798 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:07.800 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:07.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.866+0000 7f8fb964c700 1 Processor -- start 2019-11-28T11:36:07.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.866+0000 7f8fb964c700 1 -- start start 2019-11-28T11:36:07.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.867+0000 7f8fb964c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb406c490 0x7f8fb406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:07.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.867+0000 7f8fb964c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8fb406ce60 0x7f8fb4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:07.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.867+0000 7f8fb964c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb406db00 con 0x7f8fb406c0a0 2019-11-28T11:36:07.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.867+0000 7f8fb964c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb406fd60 con 0x7f8fb406ce60 2019-11-28T11:36:07.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.867+0000 7f8fb964c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4070030 con 0x7f8fb406c490 2019-11-28T11:36:07.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.867+0000 7f8fb3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8fb406ce60 0x7f8fb4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:07.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.867+0000 7f8fb37fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8fb406c0a0 0x7f8fb4072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35462/0 (socket says 172.21.15.80:35462) 2019-11-28T11:36:07.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.867+0000 7f8fb37fe700 1 -- 172.21.15.80:0/1870379432 learned_addr learned my addr 172.21.15.80:0/1870379432 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:07.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb2ffd700 1 --2- 172.21.15.80:0/1870379432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb406c490 0x7f8fb406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:07.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb3fff700 1 -- 172.21.15.80:0/1870379432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb406c490 msgr2=0x7f8fb406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:07.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/1870379432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb406c490 0x7f8fb406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:07.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb3fff700 1 -- 172.21.15.80:0/1870379432 >> v1:172.21.15.80:6789/0 conn(0x7f8fb406c0a0 legacy=0x7f8fb4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:07.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb3fff700 1 -- 172.21.15.80:0/1870379432 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40706c0 con 0x7f8fb406ce60 2019-11-28T11:36:07.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb27fc700 1 -- 172.21.15.80:0/1870379432 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433450378 0 0) 0x7f8f9c001150 con 0x7f8fb406c0a0 2019-11-28T11:36:07.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/1870379432 >> v2:172.21.15.80:3300/0 conn(0x7f8fb406ce60 0x7f8fb4164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8fac00b2d0 tx=0x7f8fac00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:07.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/1870379432 >> v2:172.21.15.80:3300/0 conn(0x7f8fb406ce60 0x7f8fb4164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8fac00b2d0 tx=0x7f8fac00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:07.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/1870379432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb406ce60 0x7f8fb4164d70 secure :-1 s=READY pgs=1002 cs=0 l=1 rx=0x7f8fac00b2d0 tx=0x7f8fac00ba60).ready entity=mon.0 client_cookie=bcc243d978e2b82e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:07.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/1870379432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb406ce60 0x7f8fb4164d70 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7f8fac00b2d0 tx=0x7f8fac00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:07.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb27fc700 1 -- 172.21.15.80:0/1870379432 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fac009f20 con 0x7f8fb406ce60 2019-11-28T11:36:07.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/1870379432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb406ce60 0x7f8fb4164d70 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7f8fac00b2d0 tx=0x7f8fac00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:07.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/1870379432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb406ce60 0x7f8fb4164d70 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7f8fac00b2d0 tx=0x7f8fac00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:07.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb27fc700 1 -- 172.21.15.80:0/1870379432 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac009b40 con 0x7f8fb406ce60 2019-11-28T11:36:07.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb27fc700 1 -- 172.21.15.80:0/1870379432 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fac00a500 con 0x7f8fb406ce60 2019-11-28T11:36:07.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb964c700 1 -- 172.21.15.80:0/1870379432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb406ce60 msgr2=0x7f8fb4164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:07.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.868+0000 7f8fb964c700 1 --2- 172.21.15.80:0/1870379432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb406ce60 0x7f8fb4164d70 secure :-1 s=READY pgs=1002 cs=0 l=1 rx=0x7f8fac00b2d0 tx=0x7f8fac00ba60).stop 2019-11-28T11:36:07.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.869+0000 7f8fb964c700 1 -- 172.21.15.80:0/1870379432 shutdown_connections 2019-11-28T11:36:07.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.869+0000 7f8fb964c700 1 --2- 172.21.15.80:0/1870379432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fb406ce60 0x7f8fb4164d70 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:07.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.869+0000 7f8fb964c700 1 --2- 172.21.15.80:0/1870379432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb406c490 0x7f8fb406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:07.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.869+0000 7f8fb964c700 1 -- 172.21.15.80:0/1870379432 shutdown_connections 2019-11-28T11:36:07.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.869+0000 7f8fb964c700 1 -- 172.21.15.80:0/1870379432 wait complete. 2019-11-28T11:36:07.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.869+0000 7f8fb964c700 1 -- 172.21.15.80:0/1870379432 >> 172.21.15.80:0/1870379432 conn(0x7f8fb4061cf0 msgr2=0x7f8fb4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:07.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.871+0000 7f8fb964c700 1 Processor -- start 2019-11-28T11:36:07.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.871+0000 7f8fb964c700 1 -- start start 2019-11-28T11:36:07.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.872+0000 7f8fb964c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb41284f0 0x7f8fb4128980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:07.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.872+0000 7f8fb964c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8fb412e240 0x7f8fb412e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:07.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.872+0000 7f8fb964c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb4101e80 con 0x7f8fb4142160 2019-11-28T11:36:07.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.872+0000 7f8fb964c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb4107520 con 0x7f8fb412e240 2019-11-28T11:36:07.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.872+0000 7f8fb964c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb41077f0 con 0x7f8fb41284f0 2019-11-28T11:36:07.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.872+0000 7f8fb37fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8fb4142160 0x7f8fb410de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35468/0 (socket says 172.21.15.80:35468) 2019-11-28T11:36:07.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.872+0000 7f8fb37fe700 1 -- 172.21.15.80:0/2311781769 learned_addr learned my addr 172.21.15.80:0/2311781769 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:07.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.872+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/2311781769 >> v2:172.21.15.174:3300/0 conn(0x7f8fb412e240 0x7f8fb412e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:07.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fb2ffd700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb41284f0 0x7f8fb4128980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:07.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fabfff700 1 -- 172.21.15.80:0/2311781769 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068650439 0 0) 0x7f8f9c001150 con 0x7f8fb4142160 2019-11-28T11:36:07.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fabfff700 1 -- 172.21.15.80:0/2311781769 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f98002e80 con 0x7f8fb4142160 2019-11-28T11:36:07.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fabfff700 1 -- 172.21.15.80:0/2311781769 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2445778686 0 0) 0x7f8f9c001300 con 0x7f8fb4142160 2019-11-28T11:36:07.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fabfff700 1 -- 172.21.15.80:0/2311781769 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8f980032e0 con 0x7f8fb4142160 2019-11-28T11:36:07.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fabfff700 1 -- 172.21.15.80:0/2311781769 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f8f9c0018b0 con 0x7f8fb4142160 2019-11-28T11:36:07.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fb3fff700 1 -- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb41284f0 msgr2=0x7f8fb4128980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:07.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb41284f0 0x7f8fb4128980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:07.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fb3fff700 1 -- 172.21.15.80:0/2311781769 >> v1:172.21.15.80:6789/0 conn(0x7f8fb4142160 legacy=0x7f8fb410de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:07.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fb3fff700 1 -- 172.21.15.80:0/2311781769 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb4107e80 con 0x7f8fb412e240 2019-11-28T11:36:07.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fb2ffd700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb41284f0 0x7f8fb4128980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:07.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/2311781769 >> v2:172.21.15.174:3300/0 conn(0x7f8fb412e240 0x7f8fb412e6b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8fac0106f0 tx=0x7f8fac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:07.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/2311781769 >> v2:172.21.15.174:3300/0 conn(0x7f8fb412e240 0x7f8fb412e6b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8fac0106f0 tx=0x7f8fac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:07.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fb412e240 0x7f8fb412e6b0 secure :-1 s=READY pgs=603 cs=0 l=1 rx=0x7f8fac0106f0 tx=0x7f8fac010a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:07.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fb412e240 0x7f8fb412e6b0 secure :-1 s=THROTTLE_DONE pgs=603 cs=0 l=1 rx=0x7f8fac0106f0 tx=0x7f8fac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:07.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fabfff700 1 -- 172.21.15.80:0/2311781769 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fac009d80 con 0x7f8fb412e240 2019-11-28T11:36:07.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fb412e240 0x7f8fb412e6b0 secure :-1 s=THROTTLE_DONE pgs=603 cs=0 l=1 rx=0x7f8fac0106f0 tx=0x7f8fac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:07.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fb964c700 1 -- 172.21.15.80:0/2311781769 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb4108200 con 0x7f8fb412e240 2019-11-28T11:36:07.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fabfff700 1 -- 172.21.15.80:0/2311781769 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac009900 con 0x7f8fb412e240 2019-11-28T11:36:07.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fb412e240 0x7f8fb412e6b0 secure :-1 s=THROTTLE_DONE pgs=603 cs=0 l=1 rx=0x7f8fac0106f0 tx=0x7f8fac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:07.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fabfff700 1 -- 172.21.15.80:0/2311781769 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fac009af0 con 0x7f8fb412e240 2019-11-28T11:36:07.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.873+0000 7f8fb964c700 1 -- 172.21.15.80:0/2311781769 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb4107e80 con 0x7f8fb412e240 2019-11-28T11:36:07.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.874+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fb412e240 0x7f8fb412e6b0 secure :-1 s=THROTTLE_DONE pgs=603 cs=0 l=1 rx=0x7f8fac0106f0 tx=0x7f8fac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:07.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.874+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fb412e240 0x7f8fb412e6b0 secure :-1 s=THROTTLE_DONE pgs=603 cs=0 l=1 rx=0x7f8fac0106f0 tx=0x7f8fac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:07.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.874+0000 7f8fabfff700 1 -- 172.21.15.80:0/2311781769 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8fac009af0 con 0x7f8fb412e240 2019-11-28T11:36:07.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.874+0000 7f8fabfff700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f98018770 0x7f8f9801ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:07.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.874+0000 7f8fabfff700 1 -- 172.21.15.80:0/2311781769 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8fac031d70 con 0x7f8fb412e240 2019-11-28T11:36:07.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.874+0000 7f8fb37fe700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f98018770 0x7f8f9801ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:07.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.875+0000 7f8fb37fe700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f98018770 0x7f8f9801ac00 crc :-1 s=READY pgs=411 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:07.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.882+0000 7f8fb964c700 1 -- 172.21.15.80:0/2311781769 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb4108200 con 0x7f8fb412e240 2019-11-28T11:36:07.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.885+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fb412e240 0x7f8fb412e6b0 secure :-1 s=THROTTLE_DONE pgs=603 cs=0 l=1 rx=0x7f8fac0106f0 tx=0x7f8fac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:07.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:07.885+0000 7f8fabfff700 1 -- 172.21.15.80:0/2311781769 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8fac024f80 con 0x7f8fb412e240 2019-11-28T11:36:08.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:08.058+0000 7f8fb964c700 1 -- 172.21.15.80:0/2311781769 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fb4107e80 con 0x7f8fb412e240 2019-11-28T11:36:08.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:08.059+0000 7f8fb3fff700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fb412e240 0x7f8fb412e6b0 secure :-1 s=THROTTLE_DONE pgs=603 cs=0 l=1 rx=0x7f8fac0106f0 tx=0x7f8fac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:08.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:08.059+0000 7f8fabfff700 1 -- 172.21.15.80:0/2311781769 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f8fac024f80 con 0x7f8fb412e240 2019-11-28T11:36:08.116 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:08.116 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:08.117 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:08.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:08.061+0000 7f8fb964c700 1 -- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f98018770 msgr2=0x7f8f9801ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:08.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:08.061+0000 7f8fb964c700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f98018770 0x7f8f9801ac00 crc :-1 s=READY pgs=411 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:08.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:08.061+0000 7f8fb964c700 1 -- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fb412e240 msgr2=0x7f8fb412e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:08.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:08.061+0000 7f8fb964c700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fb412e240 0x7f8fb412e6b0 secure :-1 s=READY pgs=603 cs=0 l=1 rx=0x7f8fac0106f0 tx=0x7f8fac010a90).stop 2019-11-28T11:36:08.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:08.061+0000 7f8fb964c700 1 -- 172.21.15.80:0/2311781769 shutdown_connections 2019-11-28T11:36:08.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:08.061+0000 7f8fb964c700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8f98018770 0x7f8f9801ac00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:08.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:08.061+0000 7f8fb964c700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fb412e240 0x7f8fb412e6b0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:08.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:08.061+0000 7f8fb964c700 1 --2- 172.21.15.80:0/2311781769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb41284f0 0x7f8fb4128980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:08.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:08.061+0000 7f8fb964c700 1 -- 172.21.15.80:0/2311781769 shutdown_connections 2019-11-28T11:36:08.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:08.061+0000 7f8fb964c700 1 -- 172.21.15.80:0/2311781769 wait complete. 2019-11-28T11:36:08.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:08.061+0000 7f8fb964c700 1 -- 172.21.15.80:0/2311781769 >> 172.21.15.80:0/2311781769 conn(0x7f8fb415e210 msgr2=0x7f8fb410b140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:08.128 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:09.129 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:09.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.199+0000 7feb34fc1700 1 Processor -- start 2019-11-28T11:36:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.199+0000 7feb34fc1700 1 -- start start 2019-11-28T11:36:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.200+0000 7feb34fc1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb3006d120 0x7feb30165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.200+0000 7feb34fc1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3006d5a0 con 0x7feb3006c490 2019-11-28T11:36:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.200+0000 7feb34fc1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3006db00 con 0x7feb3006c0a0 2019-11-28T11:36:09.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.200+0000 7feb34fc1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3006fd60 con 0x7feb3006d120 2019-11-28T11:36:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.200+0000 7feb2f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb3006d120 0x7feb30165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.200+0000 7feb2e59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7feb3006c490 0x7feb3006c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35480/0 (socket says 172.21.15.80:35480) 2019-11-28T11:36:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.201+0000 7feb2e59c700 1 -- 172.21.15.80:0/1087850560 learned_addr learned my addr 172.21.15.80:0/1087850560 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:09.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.201+0000 7feb2f59e700 1 -- 172.21.15.80:0/1087850560 >> v1:172.21.15.174:6789/0 conn(0x7feb3006c0a0 legacy=0x7feb30072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:09.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.201+0000 7feb2f59e700 1 -- 172.21.15.80:0/1087850560 >> v1:172.21.15.80:6789/0 conn(0x7feb3006c490 legacy=0x7feb3006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:09.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.201+0000 7feb2dd9b700 1 -- 172.21.15.80:0/1087850560 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042172276 0 0) 0x7feb20001150 con 0x7feb3006c490 2019-11-28T11:36:09.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.201+0000 7feb2f59e700 1 -- 172.21.15.80:0/1087850560 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb300706c0 con 0x7feb3006d120 2019-11-28T11:36:09.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.201+0000 7feb2f59e700 1 --2- 172.21.15.80:0/1087850560 >> v2:172.21.15.80:3300/0 conn(0x7feb3006d120 0x7feb30165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feb2800af50 tx=0x7feb2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:09.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.201+0000 7feb2f59e700 1 --2- 172.21.15.80:0/1087850560 >> v2:172.21.15.80:3300/0 conn(0x7feb3006d120 0x7feb30165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feb2800af50 tx=0x7feb2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:09.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.201+0000 7feb2f59e700 1 --2- 172.21.15.80:0/1087850560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3006d120 0x7feb30165d80 secure :-1 s=READY pgs=1005 cs=0 l=1 rx=0x7feb2800af50 tx=0x7feb2800b760).ready entity=mon.0 client_cookie=242162f307499b9a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:09.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.201+0000 7feb2f59e700 1 --2- 172.21.15.80:0/1087850560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3006d120 0x7feb30165d80 secure :-1 s=THROTTLE_DONE pgs=1005 cs=0 l=1 rx=0x7feb2800af50 tx=0x7feb2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:09.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.201+0000 7feb2dd9b700 1 -- 172.21.15.80:0/1087850560 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb28009ba0 con 0x7feb3006d120 2019-11-28T11:36:09.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.201+0000 7feb2f59e700 1 --2- 172.21.15.80:0/1087850560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3006d120 0x7feb30165d80 secure :-1 s=THROTTLE_DONE pgs=1005 cs=0 l=1 rx=0x7feb2800af50 tx=0x7feb2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:09.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.201+0000 7feb2dd9b700 1 -- 172.21.15.80:0/1087850560 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb28000a70 con 0x7feb3006d120 2019-11-28T11:36:09.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.201+0000 7feb2f59e700 1 --2- 172.21.15.80:0/1087850560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3006d120 0x7feb30165d80 secure :-1 s=THROTTLE_DONE pgs=1005 cs=0 l=1 rx=0x7feb2800af50 tx=0x7feb2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:09.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.201+0000 7feb2dd9b700 1 -- 172.21.15.80:0/1087850560 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb28009ba0 con 0x7feb3006d120 2019-11-28T11:36:09.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.201+0000 7feb34fc1700 1 -- 172.21.15.80:0/1087850560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3006d120 msgr2=0x7feb30165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:09.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.201+0000 7feb34fc1700 1 --2- 172.21.15.80:0/1087850560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3006d120 0x7feb30165d80 secure :-1 s=READY pgs=1005 cs=0 l=1 rx=0x7feb2800af50 tx=0x7feb2800b760).stop 2019-11-28T11:36:09.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.202+0000 7feb34fc1700 1 -- 172.21.15.80:0/1087850560 shutdown_connections 2019-11-28T11:36:09.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.202+0000 7feb34fc1700 1 --2- 172.21.15.80:0/1087850560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3006d120 0x7feb30165d80 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:09.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.202+0000 7feb34fc1700 1 -- 172.21.15.80:0/1087850560 shutdown_connections 2019-11-28T11:36:09.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.202+0000 7feb34fc1700 1 -- 172.21.15.80:0/1087850560 wait complete. 2019-11-28T11:36:09.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.202+0000 7feb34fc1700 1 -- 172.21.15.80:0/1087850560 >> 172.21.15.80:0/1087850560 conn(0x7feb30061cf0 msgr2=0x7feb30064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:09.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.204+0000 7feb34fc1700 1 Processor -- start 2019-11-28T11:36:09.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.204+0000 7feb34fc1700 1 -- start start 2019-11-28T11:36:09.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.205+0000 7feb34fc1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb3012cea0 0x7feb30111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:09.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.205+0000 7feb34fc1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7feb301230e0 0x7feb30123570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:09.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.205+0000 7feb34fc1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb30124260 con 0x7feb30123ab0 2019-11-28T11:36:09.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.205+0000 7feb34fc1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb30121040 con 0x7feb3012cea0 2019-11-28T11:36:09.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.205+0000 7feb34fc1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb30121310 con 0x7feb301230e0 2019-11-28T11:36:09.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.205+0000 7feb2ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb3012cea0 0x7feb30111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:09.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.205+0000 7feb2f59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7feb30123ab0 0x7feb3012d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35486/0 (socket says 172.21.15.80:35486) 2019-11-28T11:36:09.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.205+0000 7feb2f59e700 1 -- 172.21.15.80:0/3338837771 learned_addr learned my addr 172.21.15.80:0/3338837771 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:09.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.205+0000 7feb2e59c700 1 --2- 172.21.15.80:0/3338837771 >> v2:172.21.15.174:3300/0 conn(0x7feb301230e0 0x7feb30123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:09.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb2ed9d700 1 -- 172.21.15.80:0/3338837771 >> v2:172.21.15.174:3300/0 conn(0x7feb301230e0 msgr2=0x7feb30123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:09.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb2ed9d700 1 --2- 172.21.15.80:0/3338837771 >> v2:172.21.15.174:3300/0 conn(0x7feb301230e0 0x7feb30123570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:09.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb2ed9d700 1 -- 172.21.15.80:0/3338837771 >> v1:172.21.15.80:6789/0 conn(0x7feb30123ab0 legacy=0x7feb3012d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:09.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb277fe700 1 -- 172.21.15.80:0/3338837771 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535826547 0 0) 0x7feb280009d0 con 0x7feb30123ab0 2019-11-28T11:36:09.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb2ed9d700 1 -- 172.21.15.80:0/3338837771 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb301219a0 con 0x7feb3012cea0 2019-11-28T11:36:09.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb2ed9d700 1 --2- 172.21.15.80:0/3338837771 >> v2:172.21.15.80:3300/0 conn(0x7feb3012cea0 0x7feb30111db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb18010720 tx=0x7feb1800b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:09.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb2ed9d700 1 --2- 172.21.15.80:0/3338837771 >> v2:172.21.15.80:3300/0 conn(0x7feb3012cea0 0x7feb30111db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb18010720 tx=0x7feb1800b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:09.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb2ed9d700 1 --2- 172.21.15.80:0/3338837771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3012cea0 0x7feb30111db0 secure :-1 s=READY pgs=1007 cs=0 l=1 rx=0x7feb18010720 tx=0x7feb1800b660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:09.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb2ed9d700 1 --2- 172.21.15.80:0/3338837771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3012cea0 0x7feb30111db0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7feb18010720 tx=0x7feb1800b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:09.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb277fe700 1 -- 172.21.15.80:0/3338837771 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb18009b10 con 0x7feb3012cea0 2019-11-28T11:36:09.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb2ed9d700 1 --2- 172.21.15.80:0/3338837771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3012cea0 0x7feb30111db0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7feb18010720 tx=0x7feb1800b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:09.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb2ed9d700 1 --2- 172.21.15.80:0/3338837771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3012cea0 0x7feb30111db0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7feb18010720 tx=0x7feb1800b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:09.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb277fe700 1 -- 172.21.15.80:0/3338837771 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1800aa30 con 0x7feb3012cea0 2019-11-28T11:36:09.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb34fc1700 1 -- 172.21.15.80:0/3338837771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb30121d20 con 0x7feb3012cea0 2019-11-28T11:36:09.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb277fe700 1 -- 172.21.15.80:0/3338837771 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb1800a190 con 0x7feb3012cea0 2019-11-28T11:36:09.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb34fc1700 1 -- 172.21.15.80:0/3338837771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb301122f0 con 0x7feb3012cea0 2019-11-28T11:36:09.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.206+0000 7feb2ed9d700 1 --2- 172.21.15.80:0/3338837771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3012cea0 0x7feb30111db0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7feb18010720 tx=0x7feb1800b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:09.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.207+0000 7feb277fe700 1 -- 172.21.15.80:0/3338837771 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7feb18009b10 con 0x7feb3012cea0 2019-11-28T11:36:09.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.207+0000 7feb2ed9d700 1 --2- 172.21.15.80:0/3338837771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3012cea0 0x7feb30111db0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7feb18010720 tx=0x7feb1800b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:09.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.207+0000 7feb277fe700 1 --2- 172.21.15.80:0/3338837771 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb08018730 0x7feb0801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:09.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.207+0000 7feb277fe700 1 -- 172.21.15.80:0/3338837771 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7feb18031da0 con 0x7feb3012cea0 2019-11-28T11:36:09.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.207+0000 7feb2e59c700 1 --2- 172.21.15.80:0/3338837771 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb08018730 0x7feb0801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:09.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.207+0000 7feb2e59c700 1 --2- 172.21.15.80:0/3338837771 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb08018730 0x7feb0801abc0 crc :-1 s=READY pgs=412 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:09.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.215+0000 7feb34fc1700 1 -- 172.21.15.80:0/3338837771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb301219a0 con 0x7feb3012cea0 2019-11-28T11:36:09.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.218+0000 7feb2ed9d700 1 --2- 172.21.15.80:0/3338837771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3012cea0 0x7feb30111db0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7feb18010720 tx=0x7feb1800b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:09.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.218+0000 7feb277fe700 1 -- 172.21.15.80:0/3338837771 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7feb18009900 con 0x7feb3012cea0 2019-11-28T11:36:09.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.389+0000 7feb34fc1700 1 -- 172.21.15.80:0/3338837771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb30121d20 con 0x7feb3012cea0 2019-11-28T11:36:09.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.390+0000 7feb2ed9d700 1 --2- 172.21.15.80:0/3338837771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3012cea0 0x7feb30111db0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7feb18010720 tx=0x7feb1800b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:09.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.390+0000 7feb277fe700 1 -- 172.21.15.80:0/3338837771 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7feb18009b10 con 0x7feb3012cea0 2019-11-28T11:36:09.447 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:09.447 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:09.448 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:09.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.392+0000 7feb34fc1700 1 -- 172.21.15.80:0/3338837771 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb08018730 msgr2=0x7feb0801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:09.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.392+0000 7feb34fc1700 1 --2- 172.21.15.80:0/3338837771 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb08018730 0x7feb0801abc0 crc :-1 s=READY pgs=412 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:09.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.392+0000 7feb34fc1700 1 -- 172.21.15.80:0/3338837771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3012cea0 msgr2=0x7feb30111db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:09.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.392+0000 7feb34fc1700 1 --2- 172.21.15.80:0/3338837771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3012cea0 0x7feb30111db0 secure :-1 s=READY pgs=1007 cs=0 l=1 rx=0x7feb18010720 tx=0x7feb1800b660).stop 2019-11-28T11:36:09.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.392+0000 7feb34fc1700 1 -- 172.21.15.80:0/3338837771 shutdown_connections 2019-11-28T11:36:09.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.392+0000 7feb34fc1700 1 --2- 172.21.15.80:0/3338837771 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb08018730 0x7feb0801abc0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:09.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.392+0000 7feb34fc1700 1 --2- 172.21.15.80:0/3338837771 >> v2:172.21.15.174:3300/0 conn(0x7feb301230e0 0x7feb30123570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:09.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.392+0000 7feb34fc1700 1 --2- 172.21.15.80:0/3338837771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3012cea0 0x7feb30111db0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:09.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.392+0000 7feb34fc1700 1 -- 172.21.15.80:0/3338837771 shutdown_connections 2019-11-28T11:36:09.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.392+0000 7feb34fc1700 1 -- 172.21.15.80:0/3338837771 wait complete. 2019-11-28T11:36:09.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:09.392+0000 7feb34fc1700 1 -- 172.21.15.80:0/3338837771 >> 172.21.15.80:0/3338837771 conn(0x7feb301426c0 msgr2=0x7feb30110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:09.459 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:10.460 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:10.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.529+0000 7efc9c13e700 1 Processor -- start 2019-11-28T11:36:10.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.529+0000 7efc9c13e700 1 -- start start 2019-11-28T11:36:10.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.530+0000 7efc9c13e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc9406c0a0 0x7efc94072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:10.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9c13e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc94072620 0x7efc94164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:10.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9c13e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9406db00 con 0x7efc940734e0 2019-11-28T11:36:10.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9c13e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9406fd60 con 0x7efc9406c0a0 2019-11-28T11:36:10.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9c13e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc94070030 con 0x7efc94072620 2019-11-28T11:36:10.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9a6db700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc9406c0a0 0x7efc94072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:10.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc99eda700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efc940734e0 0x7efc94071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35494/0 (socket says 172.21.15.80:35494) 2019-11-28T11:36:10.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc99eda700 1 -- 172.21.15.80:0/831548721 learned_addr learned my addr 172.21.15.80:0/831548721 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9aedc700 1 --2- 172.21.15.80:0/831548721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc94072620 0x7efc94164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9a6db700 1 -- 172.21.15.80:0/831548721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc94072620 msgr2=0x7efc94164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9a6db700 1 --2- 172.21.15.80:0/831548721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc94072620 0x7efc94164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9a6db700 1 -- 172.21.15.80:0/831548721 >> v1:172.21.15.80:6789/0 conn(0x7efc940734e0 legacy=0x7efc94071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc996d9700 1 -- 172.21.15.80:0/831548721 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861152884 0 0) 0x7efc840013f0 con 0x7efc940734e0 2019-11-28T11:36:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9a6db700 1 -- 172.21.15.80:0/831548721 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc940706c0 con 0x7efc9406c0a0 2019-11-28T11:36:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9aedc700 1 --2- 172.21.15.80:0/831548721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc94072620 0x7efc94164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9a6db700 1 --2- 172.21.15.80:0/831548721 >> v2:172.21.15.80:3300/0 conn(0x7efc9406c0a0 0x7efc94072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efc7c00af50 tx=0x7efc7c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9a6db700 1 --2- 172.21.15.80:0/831548721 >> v2:172.21.15.80:3300/0 conn(0x7efc9406c0a0 0x7efc94072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efc7c00af50 tx=0x7efc7c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9a6db700 1 --2- 172.21.15.80:0/831548721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9406c0a0 0x7efc94072fa0 secure :-1 s=READY pgs=1009 cs=0 l=1 rx=0x7efc7c00af50 tx=0x7efc7c00b760).ready entity=mon.0 client_cookie=6f6bc315d9fc60e5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9a6db700 1 --2- 172.21.15.80:0/831548721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9406c0a0 0x7efc94072fa0 secure :-1 s=THROTTLE_DONE pgs=1009 cs=0 l=1 rx=0x7efc7c00af50 tx=0x7efc7c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc996d9700 1 -- 172.21.15.80:0/831548721 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc7c007210 con 0x7efc9406c0a0 2019-11-28T11:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9a6db700 1 --2- 172.21.15.80:0/831548721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9406c0a0 0x7efc94072fa0 secure :-1 s=THROTTLE_DONE pgs=1009 cs=0 l=1 rx=0x7efc7c00af50 tx=0x7efc7c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9a6db700 1 --2- 172.21.15.80:0/831548721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9406c0a0 0x7efc94072fa0 secure :-1 s=THROTTLE_DONE pgs=1009 cs=0 l=1 rx=0x7efc7c00af50 tx=0x7efc7c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc996d9700 1 -- 172.21.15.80:0/831548721 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c0099b0 con 0x7efc9406c0a0 2019-11-28T11:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc996d9700 1 -- 172.21.15.80:0/831548721 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc7c009ba0 con 0x7efc9406c0a0 2019-11-28T11:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9c13e700 1 -- 172.21.15.80:0/831548721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9406c0a0 msgr2=0x7efc94072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.531+0000 7efc9c13e700 1 --2- 172.21.15.80:0/831548721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9406c0a0 0x7efc94072fa0 secure :-1 s=READY pgs=1009 cs=0 l=1 rx=0x7efc7c00af50 tx=0x7efc7c00b760).stop 2019-11-28T11:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.532+0000 7efc9c13e700 1 -- 172.21.15.80:0/831548721 shutdown_connections 2019-11-28T11:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.532+0000 7efc9c13e700 1 --2- 172.21.15.80:0/831548721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc94072620 0x7efc94164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:10.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.532+0000 7efc9c13e700 1 --2- 172.21.15.80:0/831548721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9406c0a0 0x7efc94072fa0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:10.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.532+0000 7efc9c13e700 1 -- 172.21.15.80:0/831548721 shutdown_connections 2019-11-28T11:36:10.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.532+0000 7efc9c13e700 1 -- 172.21.15.80:0/831548721 wait complete. 2019-11-28T11:36:10.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.532+0000 7efc9c13e700 1 -- 172.21.15.80:0/831548721 >> 172.21.15.80:0/831548721 conn(0x7efc94061cf0 msgr2=0x7efc94064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.535+0000 7efc9c13e700 1 Processor -- start 2019-11-28T11:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.535+0000 7efc9c13e700 1 -- start start 2019-11-28T11:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc9c13e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc94104c10 0x7efc941050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc9c13e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc941055e0 0x7efc94167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:10.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc9c13e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9413bcd0 con 0x7efc94104820 2019-11-28T11:36:10.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc9c13e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc94109130 con 0x7efc94104c10 2019-11-28T11:36:10.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc9c13e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc94109400 con 0x7efc941055e0 2019-11-28T11:36:10.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc99eda700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc94104c10 0x7efc941050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:10.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc99eda700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc94104c10 0x7efc941050a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36180/0 (socket says 172.21.15.80:36180) 2019-11-28T11:36:10.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc99eda700 1 -- 172.21.15.80:0/1542840003 learned_addr learned my addr 172.21.15.80:0/1542840003 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:10.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc9aedc700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc941055e0 0x7efc94167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:10.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc99eda700 1 -- 172.21.15.80:0/1542840003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc941055e0 msgr2=0x7efc94167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:10.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc99eda700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc941055e0 0x7efc94167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:10.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc99eda700 1 -- 172.21.15.80:0/1542840003 >> v1:172.21.15.174:6789/0 conn(0x7efc94104820 legacy=0x7efc9410c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:10.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc99eda700 1 -- 172.21.15.80:0/1542840003 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94109a90 con 0x7efc94104c10 2019-11-28T11:36:10.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc99eda700 1 --2- 172.21.15.80:0/1542840003 >> v2:172.21.15.80:3300/0 conn(0x7efc94104c10 0x7efc941050a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc840107c0 tx=0x7efc840105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:10.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc99eda700 1 --2- 172.21.15.80:0/1542840003 >> v2:172.21.15.80:3300/0 conn(0x7efc94104c10 0x7efc941050a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc840107c0 tx=0x7efc840105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:10.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc99eda700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc94104c10 0x7efc941050a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rx=0x7efc840107c0 tx=0x7efc840105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:10.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc99eda700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc94104c10 0x7efc941050a0 secure :-1 s=THROTTLE_DONE pgs=1010 cs=0 l=1 rx=0x7efc840107c0 tx=0x7efc840105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:10.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc99eda700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc94104c10 0x7efc941050a0 secure :-1 s=THROTTLE_DONE pgs=1010 cs=0 l=1 rx=0x7efc840107c0 tx=0x7efc840105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:10.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc92ffd700 1 -- 172.21.15.80:0/1542840003 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc840010d0 con 0x7efc94104c10 2019-11-28T11:36:10.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc99eda700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc94104c10 0x7efc941050a0 secure :-1 s=THROTTLE_DONE pgs=1010 cs=0 l=1 rx=0x7efc840107c0 tx=0x7efc840105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:10.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc92ffd700 1 -- 172.21.15.80:0/1542840003 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc84004360 con 0x7efc94104c10 2019-11-28T11:36:10.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc9c13e700 1 -- 172.21.15.80:0/1542840003 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc94109e10 con 0x7efc94104c10 2019-11-28T11:36:10.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc92ffd700 1 -- 172.21.15.80:0/1542840003 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc840049f0 con 0x7efc94104c10 2019-11-28T11:36:10.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.536+0000 7efc9c13e700 1 -- 172.21.15.80:0/1542840003 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc94105a60 con 0x7efc94104c10 2019-11-28T11:36:10.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.537+0000 7efc99eda700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc94104c10 0x7efc941050a0 secure :-1 s=THROTTLE_DONE pgs=1010 cs=0 l=1 rx=0x7efc840107c0 tx=0x7efc840105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:10.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.537+0000 7efc92ffd700 1 -- 172.21.15.80:0/1542840003 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efc840010b0 con 0x7efc94104c10 2019-11-28T11:36:10.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.537+0000 7efc99eda700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc94104c10 0x7efc941050a0 secure :-1 s=THROTTLE_DONE pgs=1010 cs=0 l=1 rx=0x7efc840107c0 tx=0x7efc840105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:10.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.537+0000 7efc92ffd700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc78018730 0x7efc7801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:10.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.537+0000 7efc92ffd700 1 -- 172.21.15.80:0/1542840003 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7efc84031df0 con 0x7efc94104c10 2019-11-28T11:36:10.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.538+0000 7efc9a6db700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc78018730 0x7efc7801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:10.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.538+0000 7efc9a6db700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc78018730 0x7efc7801abc0 crc :-1 s=READY pgs=413 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:10.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.545+0000 7efc9c13e700 1 -- 172.21.15.80:0/1542840003 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc94109a90 con 0x7efc94104c10 2019-11-28T11:36:10.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.548+0000 7efc99eda700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc94104c10 0x7efc941050a0 secure :-1 s=THROTTLE_DONE pgs=1010 cs=0 l=1 rx=0x7efc840107c0 tx=0x7efc840105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:10.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.548+0000 7efc92ffd700 1 -- 172.21.15.80:0/1542840003 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efc84000cc0 con 0x7efc94104c10 2019-11-28T11:36:10.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.721+0000 7efc9c13e700 1 -- 172.21.15.80:0/1542840003 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc94109e10 con 0x7efc94104c10 2019-11-28T11:36:10.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.722+0000 7efc99eda700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc94104c10 0x7efc941050a0 secure :-1 s=THROTTLE_DONE pgs=1010 cs=0 l=1 rx=0x7efc840107c0 tx=0x7efc840105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:10.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.722+0000 7efc92ffd700 1 -- 172.21.15.80:0/1542840003 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7efc840010b0 con 0x7efc94104c10 2019-11-28T11:36:10.780 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:10.780 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:10.781 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:10.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.725+0000 7efc9c13e700 1 -- 172.21.15.80:0/1542840003 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc78018730 msgr2=0x7efc7801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:10.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.725+0000 7efc9c13e700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc78018730 0x7efc7801abc0 crc :-1 s=READY pgs=413 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:10.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.725+0000 7efc9c13e700 1 -- 172.21.15.80:0/1542840003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc94104c10 msgr2=0x7efc941050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:10.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.725+0000 7efc9c13e700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc94104c10 0x7efc941050a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rx=0x7efc840107c0 tx=0x7efc840105f0).stop 2019-11-28T11:36:10.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.725+0000 7efc9c13e700 1 -- 172.21.15.80:0/1542840003 shutdown_connections 2019-11-28T11:36:10.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.725+0000 7efc9c13e700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc941055e0 0x7efc94167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:10.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.725+0000 7efc9c13e700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc94104c10 0x7efc941050a0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:10.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.725+0000 7efc9c13e700 1 --2- 172.21.15.80:0/1542840003 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc78018730 0x7efc7801abc0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:10.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.725+0000 7efc9c13e700 1 -- 172.21.15.80:0/1542840003 shutdown_connections 2019-11-28T11:36:10.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.725+0000 7efc9c13e700 1 -- 172.21.15.80:0/1542840003 wait complete. 2019-11-28T11:36:10.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:10.725+0000 7efc9c13e700 1 -- 172.21.15.80:0/1542840003 >> 172.21.15.80:0/1542840003 conn(0x7efc9413d620 msgr2=0x7efc9413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:10.792 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:11.793 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:11.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.855+0000 7fa05c745700 1 Processor -- start 2019-11-28T11:36:11.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.855+0000 7fa05c745700 1 -- start start 2019-11-28T11:36:11.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.856+0000 7fa05c745700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa05406c490 0x7fa05406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:11.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.856+0000 7fa05c745700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa05406ce60 0x7fa054164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:11.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.856+0000 7fa05c745700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05406db00 con 0x7fa05406c0a0 2019-11-28T11:36:11.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.856+0000 7fa05c745700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05406fd60 con 0x7fa05406ce60 2019-11-28T11:36:11.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.856+0000 7fa05c745700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa054070030 con 0x7fa05406c490 2019-11-28T11:36:11.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.856+0000 7fa05b4e3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa05406ce60 0x7fa054164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:11.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.856+0000 7fa05ace2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa05406c0a0 0x7fa054072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35504/0 (socket says 172.21.15.80:35504) 2019-11-28T11:36:11.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.856+0000 7fa05ace2700 1 -- 172.21.15.80:0/1789728728 learned_addr learned my addr 172.21.15.80:0/1789728728 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:11.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa05a4e1700 1 --2- 172.21.15.80:0/1789728728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa05406c490 0x7fa05406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:11.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa05b4e3700 1 -- 172.21.15.80:0/1789728728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa05406c490 msgr2=0x7fa05406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:11.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa05b4e3700 1 --2- 172.21.15.80:0/1789728728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa05406c490 0x7fa05406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:11.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa05b4e3700 1 -- 172.21.15.80:0/1789728728 >> v1:172.21.15.80:6789/0 conn(0x7fa05406c0a0 legacy=0x7fa054072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:11.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa05b4e3700 1 -- 172.21.15.80:0/1789728728 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0540706c0 con 0x7fa05406ce60 2019-11-28T11:36:11.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa059ce0700 1 -- 172.21.15.80:0/1789728728 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389097388 0 0) 0x7fa03c001150 con 0x7fa05406c0a0 2019-11-28T11:36:11.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa05a4e1700 1 --2- 172.21.15.80:0/1789728728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa05406c490 0x7fa05406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:36:11.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa05b4e3700 1 --2- 172.21.15.80:0/1789728728 >> v2:172.21.15.80:3300/0 conn(0x7fa05406ce60 0x7fa054164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa04c00af50 tx=0x7fa04c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:11.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa05b4e3700 1 --2- 172.21.15.80:0/1789728728 >> v2:172.21.15.80:3300/0 conn(0x7fa05406ce60 0x7fa054164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa04c00af50 tx=0x7fa04c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:11.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa05b4e3700 1 --2- 172.21.15.80:0/1789728728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05406ce60 0x7fa054164d70 secure :-1 s=READY pgs=1012 cs=0 l=1 rx=0x7fa04c00af50 tx=0x7fa04c00b760).ready entity=mon.0 client_cookie=3ae6953505020009 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:11.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa05b4e3700 1 --2- 172.21.15.80:0/1789728728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05406ce60 0x7fa054164d70 secure :-1 s=THROTTLE_DONE pgs=1012 cs=0 l=1 rx=0x7fa04c00af50 tx=0x7fa04c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:11.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa059ce0700 1 -- 172.21.15.80:0/1789728728 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa04c009ba0 con 0x7fa05406ce60 2019-11-28T11:36:11.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa05b4e3700 1 --2- 172.21.15.80:0/1789728728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05406ce60 0x7fa054164d70 secure :-1 s=THROTTLE_DONE pgs=1012 cs=0 l=1 rx=0x7fa04c00af50 tx=0x7fa04c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:11.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa059ce0700 1 -- 172.21.15.80:0/1789728728 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04c0097c0 con 0x7fa05406ce60 2019-11-28T11:36:11.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa05b4e3700 1 --2- 172.21.15.80:0/1789728728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05406ce60 0x7fa054164d70 secure :-1 s=THROTTLE_DONE pgs=1012 cs=0 l=1 rx=0x7fa04c00af50 tx=0x7fa04c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:11.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa059ce0700 1 -- 172.21.15.80:0/1789728728 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa04c000bc0 con 0x7fa05406ce60 2019-11-28T11:36:11.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa05c745700 1 -- 172.21.15.80:0/1789728728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05406ce60 msgr2=0x7fa054164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:11.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.857+0000 7fa05c745700 1 --2- 172.21.15.80:0/1789728728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05406ce60 0x7fa054164d70 secure :-1 s=READY pgs=1012 cs=0 l=1 rx=0x7fa04c00af50 tx=0x7fa04c00b760).stop 2019-11-28T11:36:11.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.858+0000 7fa05c745700 1 -- 172.21.15.80:0/1789728728 shutdown_connections 2019-11-28T11:36:11.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.858+0000 7fa05c745700 1 --2- 172.21.15.80:0/1789728728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa05406ce60 0x7fa054164d70 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:11.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.858+0000 7fa05c745700 1 --2- 172.21.15.80:0/1789728728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa05406c490 0x7fa05406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:11.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.858+0000 7fa05c745700 1 -- 172.21.15.80:0/1789728728 shutdown_connections 2019-11-28T11:36:11.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.858+0000 7fa05c745700 1 -- 172.21.15.80:0/1789728728 wait complete. 2019-11-28T11:36:11.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.858+0000 7fa05c745700 1 -- 172.21.15.80:0/1789728728 >> 172.21.15.80:0/1789728728 conn(0x7fa054061cf0 msgr2=0x7fa054064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:11.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.860+0000 7fa05c745700 1 Processor -- start 2019-11-28T11:36:11.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.860+0000 7fa05c745700 1 -- start start 2019-11-28T11:36:11.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.861+0000 7fa05c745700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa05415fdf0 0x7fa05412b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:11.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.861+0000 7fa05c745700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa05412a3c0 0x7fa05412a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:11.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.861+0000 7fa05c745700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05413eb20 con 0x7fa05412b8a0 2019-11-28T11:36:11.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.861+0000 7fa05c745700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa054108820 con 0x7fa05415fdf0 2019-11-28T11:36:11.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.861+0000 7fa05c745700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa054108af0 con 0x7fa05412a3c0 2019-11-28T11:36:11.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.861+0000 7fa05a4e1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa05412b8a0 0x7fa05413e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35512/0 (socket says 172.21.15.80:35512) 2019-11-28T11:36:11.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.861+0000 7fa05a4e1700 1 -- 172.21.15.80:0/1301576457 learned_addr learned my addr 172.21.15.80:0/1301576457 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:11.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.861+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369294516 0 0) 0x7fa04400a010 con 0x7fa05412b8a0 2019-11-28T11:36:11.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa038002e80 con 0x7fa05412b8a0 2019-11-28T11:36:11.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05b4e3700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa05412a3c0 0x7fa05412a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:11.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05ace2700 1 --2- 172.21.15.80:0/1301576457 >> v2:172.21.15.174:3300/0 conn(0x7fa05415fdf0 0x7fa05412b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:11.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3880854132 0 0) 0x7fa0440010d0 con 0x7fa05412b8a0 2019-11-28T11:36:11.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa0380032e0 con 0x7fa05412b8a0 2019-11-28T11:36:11.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fa0440016a0 con 0x7fa05412b8a0 2019-11-28T11:36:11.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa05412a3c0 msgr2=0x7fa05412a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:11.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa0537fe700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa05412a3c0 0x7fa05412a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:11.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 >> v2:172.21.15.174:3300/0 conn(0x7fa05415fdf0 msgr2=0x7fa05412b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:11.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa0537fe700 1 --2- 172.21.15.80:0/1301576457 >> v2:172.21.15.174:3300/0 conn(0x7fa05415fdf0 0x7fa05412b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:11.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 >> v1:172.21.15.80:6789/0 conn(0x7fa05412b8a0 legacy=0x7fa05413e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:11.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa0537fe700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa038003310 0x7fa038003740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:11.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa0537fe700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa038003c80 0x7fa0380040d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:11.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa0537fe700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa038004800 0x7fa038004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:11.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03800bb60 con 0x7fa038003310 2019-11-28T11:36:11.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03800bd50 con 0x7fa038004800 2019-11-28T11:36:11.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03800bf80 con 0x7fa038003c80 2019-11-28T11:36:11.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05ace2700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa038003310 0x7fa038003740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:11.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05a4e1700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa038003c80 0x7fa0380040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:11.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05b4e3700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa038004800 0x7fa038004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:11.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05ace2700 1 -- 172.21.15.80:0/1301576457 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa038003c80 msgr2=0x7fa0380040d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:11.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05ace2700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa038003c80 0x7fa0380040d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:11.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05ace2700 1 -- 172.21.15.80:0/1301576457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa038004800 msgr2=0x7fa038004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:11.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05ace2700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa038004800 0x7fa038004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:11.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05ace2700 1 -- 172.21.15.80:0/1301576457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03800c230 con 0x7fa038003310 2019-11-28T11:36:11.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05c745700 1 -- 172.21.15.80:0/1301576457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05410a8c0 con 0x7fa038003310 2019-11-28T11:36:11.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05ace2700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa038003310 0x7fa038003740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa03c010600 tx=0x7fa03c0104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:11.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05c745700 1 -- 172.21.15.80:0/1301576457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa054109180 con 0x7fa038003310 2019-11-28T11:36:11.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05ace2700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa038003310 0x7fa038003740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa03c010600 tx=0x7fa03c0104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:11.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05ace2700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa038003310 0x7fa038003740 secure :-1 s=READY pgs=1014 cs=0 l=1 rx=0x7fa03c010600 tx=0x7fa03c0104b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:11.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05ace2700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa038003310 0x7fa038003740 secure :-1 s=THROTTLE_DONE pgs=1014 cs=0 l=1 rx=0x7fa03c010600 tx=0x7fa03c0104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:11.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa03c000ef0 con 0x7fa038003310 2019-11-28T11:36:11.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.862+0000 7fa05ace2700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa038003310 0x7fa038003740 secure :-1 s=THROTTLE_DONE pgs=1014 cs=0 l=1 rx=0x7fa03c010600 tx=0x7fa03c0104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:11.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.863+0000 7fa05ace2700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa038003310 0x7fa038003740 secure :-1 s=THROTTLE_DONE pgs=1014 cs=0 l=1 rx=0x7fa03c010600 tx=0x7fa03c0104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:11.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.863+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c004430 con 0x7fa038003310 2019-11-28T11:36:11.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.863+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa03c000ef0 con 0x7fa038003310 2019-11-28T11:36:11.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.863+0000 7fa05ace2700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa038003310 0x7fa038003740 secure :-1 s=THROTTLE_DONE pgs=1014 cs=0 l=1 rx=0x7fa03c010600 tx=0x7fa03c0104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:11.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.863+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa03c004620 con 0x7fa038003310 2019-11-28T11:36:11.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.863+0000 7fa05ace2700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa038003310 0x7fa038003740 secure :-1 s=THROTTLE_DONE pgs=1014 cs=0 l=1 rx=0x7fa03c010600 tx=0x7fa03c0104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:11.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.863+0000 7fa0537fe700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa038020ad0 0x7fa038022f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:11.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.863+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fa03c031e50 con 0x7fa038003310 2019-11-28T11:36:11.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.863+0000 7fa05a4e1700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa038020ad0 0x7fa038022f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:11.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.864+0000 7fa05a4e1700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa038020ad0 0x7fa038022f00 crc :-1 s=READY pgs=414 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:11.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.871+0000 7fa05c745700 1 -- 172.21.15.80:0/1301576457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02c002e60 con 0x7fa038003310 2019-11-28T11:36:11.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.874+0000 7fa05ace2700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa038003310 0x7fa038003740 secure :-1 s=THROTTLE_DONE pgs=1014 cs=0 l=1 rx=0x7fa03c010600 tx=0x7fa03c0104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:11.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:11.874+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa03c001710 con 0x7fa038003310 2019-11-28T11:36:12.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:12.045+0000 7fa05c745700 1 -- 172.21.15.80:0/1301576457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa02c001d10 con 0x7fa038003310 2019-11-28T11:36:12.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:12.045+0000 7fa05ace2700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa038003310 0x7fa038003740 secure :-1 s=THROTTLE_DONE pgs=1014 cs=0 l=1 rx=0x7fa03c010600 tx=0x7fa03c0104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:12.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:12.045+0000 7fa0537fe700 1 -- 172.21.15.80:0/1301576457 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fa03c004e20 con 0x7fa038003310 2019-11-28T11:36:12.103 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:12.104 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:12.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:12.048+0000 7fa05c745700 1 -- 172.21.15.80:0/1301576457 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa038020ad0 msgr2=0x7fa038022f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:12.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:12.048+0000 7fa05c745700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa038020ad0 0x7fa038022f00 crc :-1 s=READY pgs=414 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:12.048+0000 7fa05c745700 1 -- 172.21.15.80:0/1301576457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa038003310 msgr2=0x7fa038003740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:12.048+0000 7fa05c745700 1 --2- 172.21.15.80:0/1301576457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa038003310 0x7fa038003740 secure :-1 s=READY pgs=1014 cs=0 l=1 rx=0x7fa03c010600 tx=0x7fa03c0104b0).stop 2019-11-28T11:36:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:12.048+0000 7fa05b4e3700 1 -- 172.21.15.80:0/1301576457 reap_dead start 2019-11-28T11:36:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:12.048+0000 7fa05b4e3700 1 -- 172.21.15.80:0/1301576457 reap_dead start 2019-11-28T11:36:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:12.048+0000 7fa05c745700 1 -- 172.21.15.80:0/1301576457 shutdown_connections 2019-11-28T11:36:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:12.048+0000 7fa05c745700 1 -- 172.21.15.80:0/1301576457 shutdown_connections 2019-11-28T11:36:12.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:12.048+0000 7fa05c745700 1 -- 172.21.15.80:0/1301576457 wait complete. 2019-11-28T11:36:12.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:12.048+0000 7fa05c745700 1 -- 172.21.15.80:0/1301576457 >> 172.21.15.80:0/1301576457 conn(0x7fa054127dc0 msgr2=0x7fa054141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:12.117 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:13.118 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:13.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.194+0000 7f9a7abe8700 1 Processor -- start 2019-11-28T11:36:13.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.194+0000 7f9a7abe8700 1 -- start start 2019-11-28T11:36:13.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.195+0000 7f9a7abe8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a7406c0a0 0x7f9a74072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:13.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.195+0000 7f9a7abe8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a740734e0 0x7f9a74071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:13.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.195+0000 7f9a7abe8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7406db00 con 0x7f9a74072360 2019-11-28T11:36:13.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.195+0000 7f9a7abe8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7406f330 con 0x7f9a740734e0 2019-11-28T11:36:13.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.195+0000 7f9a7abe8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a740706c0 con 0x7f9a7406c0a0 2019-11-28T11:36:13.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a78984700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a740734e0 0x7f9a74071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:13.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a78984700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a740734e0 0x7f9a74071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36212/0 (socket says 172.21.15.80:36212) 2019-11-28T11:36:13.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a78984700 1 -- 172.21.15.80:0/3391974033 learned_addr learned my addr 172.21.15.80:0/3391974033 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:13.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a79185700 1 --2- 172.21.15.80:0/3391974033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a7406c0a0 0x7f9a74072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:13.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a78984700 1 -- 172.21.15.80:0/3391974033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a7406c0a0 msgr2=0x7f9a74072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:13.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a78984700 1 --2- 172.21.15.80:0/3391974033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a7406c0a0 0x7f9a74072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:13.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a78984700 1 -- 172.21.15.80:0/3391974033 >> v1:172.21.15.174:6789/0 conn(0x7f9a74072360 legacy=0x7f9a7406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:13.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a78984700 1 -- 172.21.15.80:0/3391974033 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a74070a40 con 0x7f9a740734e0 2019-11-28T11:36:13.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a78984700 1 --2- 172.21.15.80:0/3391974033 >> v2:172.21.15.80:3300/0 conn(0x7f9a740734e0 0x7f9a74071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9a6400f6c0 tx=0x7f9a6400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:13.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a78984700 1 --2- 172.21.15.80:0/3391974033 >> v2:172.21.15.80:3300/0 conn(0x7f9a740734e0 0x7f9a74071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9a6400f6c0 tx=0x7f9a6400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:13.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a78984700 1 --2- 172.21.15.80:0/3391974033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a740734e0 0x7f9a74071e20 secure :-1 s=READY pgs=1015 cs=0 l=1 rx=0x7f9a6400f6c0 tx=0x7f9a6400fa60).ready entity=mon.0 client_cookie=764f62a8d270c174 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:13.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a78984700 1 --2- 172.21.15.80:0/3391974033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a740734e0 0x7f9a74071e20 secure :-1 s=THROTTLE_DONE pgs=1015 cs=0 l=1 rx=0x7f9a6400f6c0 tx=0x7f9a6400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:13.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a78984700 1 --2- 172.21.15.80:0/3391974033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a740734e0 0x7f9a74071e20 secure :-1 s=THROTTLE_DONE pgs=1015 cs=0 l=1 rx=0x7f9a6400f6c0 tx=0x7f9a6400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:13.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a78984700 1 --2- 172.21.15.80:0/3391974033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a740734e0 0x7f9a74071e20 secure :-1 s=THROTTLE_DONE pgs=1015 cs=0 l=1 rx=0x7f9a6400f6c0 tx=0x7f9a6400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:13.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a6bfff700 1 -- 172.21.15.80:0/3391974033 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a64000960 con 0x7f9a740734e0 2019-11-28T11:36:13.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a6bfff700 1 -- 172.21.15.80:0/3391974033 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a64000c90 con 0x7f9a740734e0 2019-11-28T11:36:13.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a6bfff700 1 -- 172.21.15.80:0/3391974033 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a640013a0 con 0x7f9a740734e0 2019-11-28T11:36:13.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a7abe8700 1 -- 172.21.15.80:0/3391974033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a740734e0 msgr2=0x7f9a74071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:13.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.196+0000 7f9a7abe8700 1 --2- 172.21.15.80:0/3391974033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a740734e0 0x7f9a74071e20 secure :-1 s=READY pgs=1015 cs=0 l=1 rx=0x7f9a6400f6c0 tx=0x7f9a6400fa60).stop 2019-11-28T11:36:13.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.197+0000 7f9a7abe8700 1 -- 172.21.15.80:0/3391974033 shutdown_connections 2019-11-28T11:36:13.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.197+0000 7f9a7abe8700 1 --2- 172.21.15.80:0/3391974033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a740734e0 0x7f9a74071e20 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:13.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.197+0000 7f9a7abe8700 1 --2- 172.21.15.80:0/3391974033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a7406c0a0 0x7f9a74072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:13.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.197+0000 7f9a7abe8700 1 -- 172.21.15.80:0/3391974033 shutdown_connections 2019-11-28T11:36:13.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.197+0000 7f9a7abe8700 1 -- 172.21.15.80:0/3391974033 wait complete. 2019-11-28T11:36:13.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.197+0000 7f9a7abe8700 1 -- 172.21.15.80:0/3391974033 >> 172.21.15.80:0/3391974033 conn(0x7f9a74061cf0 msgr2=0x7f9a74064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:13.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.200+0000 7f9a7abe8700 1 Processor -- start 2019-11-28T11:36:13.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.200+0000 7f9a7abe8700 1 -- start start 2019-11-28T11:36:13.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.201+0000 7f9a7abe8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9a741098d0 0x7f9a74109d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:13.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.201+0000 7f9a7abe8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a74139e00 con 0x7f9a7410a2a0 2019-11-28T11:36:13.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.201+0000 7f9a7abe8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7413a4d0 con 0x7f9a7412a6b0 2019-11-28T11:36:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.201+0000 7f9a7abe8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a74107b00 con 0x7f9a741098d0 2019-11-28T11:36:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.201+0000 7f9a79986700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9a7410a2a0 0x7f9a74168ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35534/0 (socket says 172.21.15.80:35534) 2019-11-28T11:36:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.201+0000 7f9a79986700 1 -- 172.21.15.80:0/1177936304 learned_addr learned my addr 172.21.15.80:0/1177936304 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.201+0000 7f9a78984700 1 --2- 172.21.15.80:0/1177936304 >> v2:172.21.15.174:3300/0 conn(0x7f9a741098d0 0x7f9a74109d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.201+0000 7f9a69ffb700 1 -- 172.21.15.80:0/1177936304 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220231029 0 0) 0x7f9a6c000f10 con 0x7f9a7410a2a0 2019-11-28T11:36:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.201+0000 7f9a69ffb700 1 -- 172.21.15.80:0/1177936304 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a54002e80 con 0x7f9a7410a2a0 2019-11-28T11:36:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.201+0000 7f9a69ffb700 1 -- 172.21.15.80:0/1177936304 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3996978544 0 0) 0x7f9a6c001630 con 0x7f9a7410a2a0 2019-11-28T11:36:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a69ffb700 1 -- 172.21.15.80:0/1177936304 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9a540032e0 con 0x7f9a7410a2a0 2019-11-28T11:36:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a69ffb700 1 -- 172.21.15.80:0/1177936304 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f9a6c001be0 con 0x7f9a7410a2a0 2019-11-28T11:36:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a78984700 1 -- 172.21.15.80:0/1177936304 >> v1:172.21.15.174:6789/0 conn(0x7f9a7412a6b0 legacy=0x7f9a7412b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a78984700 1 -- 172.21.15.80:0/1177936304 >> v1:172.21.15.80:6789/0 conn(0x7f9a7410a2a0 legacy=0x7f9a74168ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a78984700 1 -- 172.21.15.80:0/1177936304 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a74108190 con 0x7f9a741098d0 2019-11-28T11:36:13.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a78984700 1 --2- 172.21.15.80:0/1177936304 >> v2:172.21.15.174:3300/0 conn(0x7f9a741098d0 0x7f9a74109d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a640103a0 tx=0x7f9a64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:13.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a78984700 1 --2- 172.21.15.80:0/1177936304 >> v2:172.21.15.174:3300/0 conn(0x7f9a741098d0 0x7f9a74109d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a640103a0 tx=0x7f9a64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:13.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a78984700 1 --2- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a741098d0 0x7f9a74109d60 secure :-1 s=READY pgs=608 cs=0 l=1 rx=0x7f9a640103a0 tx=0x7f9a64010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:13.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a78984700 1 --2- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a741098d0 0x7f9a74109d60 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f9a640103a0 tx=0x7f9a64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:13.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a69ffb700 1 -- 172.21.15.80:0/1177936304 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a64000940 con 0x7f9a741098d0 2019-11-28T11:36:13.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a78984700 1 --2- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a741098d0 0x7f9a74109d60 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f9a640103a0 tx=0x7f9a64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:13.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a7abe8700 1 -- 172.21.15.80:0/1177936304 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a74108510 con 0x7f9a741098d0 2019-11-28T11:36:13.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a69ffb700 1 -- 172.21.15.80:0/1177936304 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a64000940 con 0x7f9a741098d0 2019-11-28T11:36:13.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a78984700 1 --2- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a741098d0 0x7f9a74109d60 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f9a640103a0 tx=0x7f9a64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:13.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a69ffb700 1 -- 172.21.15.80:0/1177936304 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a64001140 con 0x7f9a741098d0 2019-11-28T11:36:13.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a7abe8700 1 -- 172.21.15.80:0/1177936304 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7410a710 con 0x7f9a741098d0 2019-11-28T11:36:13.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.202+0000 7f9a78984700 1 --2- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a741098d0 0x7f9a74109d60 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f9a640103a0 tx=0x7f9a64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:13.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.203+0000 7f9a69ffb700 1 -- 172.21.15.80:0/1177936304 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9a64000d60 con 0x7f9a741098d0 2019-11-28T11:36:13.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.203+0000 7f9a78984700 1 --2- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a741098d0 0x7f9a74109d60 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f9a640103a0 tx=0x7f9a64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:13.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.203+0000 7f9a69ffb700 1 --2- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a54018770 0x7f9a5401ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:13.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.203+0000 7f9a69ffb700 1 -- 172.21.15.80:0/1177936304 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f9a64031af0 con 0x7f9a741098d0 2019-11-28T11:36:13.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.203+0000 7f9a79185700 1 --2- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a54018770 0x7f9a5401ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:13.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.203+0000 7f9a79185700 1 --2- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a54018770 0x7f9a5401ac00 crc :-1 s=READY pgs=415 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:13.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.210+0000 7f9a7abe8700 1 -- 172.21.15.80:0/1177936304 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a74108190 con 0x7f9a741098d0 2019-11-28T11:36:13.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.214+0000 7f9a78984700 1 --2- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a741098d0 0x7f9a74109d60 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f9a640103a0 tx=0x7f9a64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:13.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.214+0000 7f9a69ffb700 1 -- 172.21.15.80:0/1177936304 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9a64000b10 con 0x7f9a741098d0 2019-11-28T11:36:13.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.385+0000 7f9a7abe8700 1 -- 172.21.15.80:0/1177936304 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a74108510 con 0x7f9a741098d0 2019-11-28T11:36:13.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.386+0000 7f9a78984700 1 --2- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a741098d0 0x7f9a74109d60 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f9a640103a0 tx=0x7f9a64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:13.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.386+0000 7f9a69ffb700 1 -- 172.21.15.80:0/1177936304 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f9a64001730 con 0x7f9a741098d0 2019-11-28T11:36:13.444 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:13.444 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:13.444 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:13.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.388+0000 7f9a7abe8700 1 -- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a54018770 msgr2=0x7f9a5401ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:13.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.388+0000 7f9a7abe8700 1 --2- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a54018770 0x7f9a5401ac00 crc :-1 s=READY pgs=415 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:13.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.388+0000 7f9a7abe8700 1 -- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a741098d0 msgr2=0x7f9a74109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:13.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.388+0000 7f9a7abe8700 1 --2- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a741098d0 0x7f9a74109d60 secure :-1 s=READY pgs=608 cs=0 l=1 rx=0x7f9a640103a0 tx=0x7f9a64010740).stop 2019-11-28T11:36:13.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.388+0000 7f9a7abe8700 1 -- 172.21.15.80:0/1177936304 shutdown_connections 2019-11-28T11:36:13.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.388+0000 7f9a7abe8700 1 --2- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a741098d0 0x7f9a74109d60 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:13.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.388+0000 7f9a7abe8700 1 --2- 172.21.15.80:0/1177936304 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a54018770 0x7f9a5401ac00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:13.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.388+0000 7f9a7abe8700 1 -- 172.21.15.80:0/1177936304 shutdown_connections 2019-11-28T11:36:13.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.388+0000 7f9a7abe8700 1 -- 172.21.15.80:0/1177936304 wait complete. 2019-11-28T11:36:13.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:13.388+0000 7f9a7abe8700 1 -- 172.21.15.80:0/1177936304 >> 172.21.15.80:0/1177936304 conn(0x7f9a74127dc0 msgr2=0x7f9a74141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:13.455 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:14.456 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:14.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.521+0000 7f6bcad27700 1 Processor -- start 2019-11-28T11:36:14.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.521+0000 7f6bcad27700 1 -- start start 2019-11-28T11:36:14.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.522+0000 7f6bcad27700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6bc406c490 0x7f6bc406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:14.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.522+0000 7f6bcad27700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc406db00 con 0x7f6bc406c0a0 2019-11-28T11:36:14.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.522+0000 7f6bcad27700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc406e000 con 0x7f6bc406ce60 2019-11-28T11:36:14.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.522+0000 7f6bcad27700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc406fd60 con 0x7f6bc406c490 2019-11-28T11:36:14.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.522+0000 7f6bc8ac3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6bc406c490 0x7f6bc406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:14.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.522+0000 7f6bc8ac3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6bc406c490 0x7f6bc406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36226/0 (socket says 172.21.15.80:36226) 2019-11-28T11:36:14.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.522+0000 7f6bc8ac3700 1 -- 172.21.15.80:0/1276531259 learned_addr learned my addr 172.21.15.80:0/1276531259 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:14.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.522+0000 7f6bc92c4700 1 --1- 172.21.15.80:0/1276531259 >> v1:172.21.15.80:6789/0 conn(0x7f6bc406c0a0 0x7f6bc4072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35538/0 (socket says 172.21.15.80:35538) 2019-11-28T11:36:14.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.522+0000 7f6bc8ac3700 1 -- 172.21.15.80:0/1276531259 >> v1:172.21.15.174:6789/0 conn(0x7f6bc406ce60 legacy=0x7f6bc4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:14.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.522+0000 7f6bc8ac3700 1 -- 172.21.15.80:0/1276531259 >> v1:172.21.15.80:6789/0 conn(0x7f6bc406c0a0 legacy=0x7f6bc4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:14.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.522+0000 7f6bc8ac3700 1 -- 172.21.15.80:0/1276531259 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc40706c0 con 0x7f6bc406c490 2019-11-28T11:36:14.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.522+0000 7f6bc3fff700 1 -- 172.21.15.80:0/1276531259 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260389049 0 0) 0x7f6bb4001480 con 0x7f6bc406c0a0 2019-11-28T11:36:14.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.522+0000 7f6bc8ac3700 1 --2- 172.21.15.80:0/1276531259 >> v2:172.21.15.80:3300/0 conn(0x7f6bc406c490 0x7f6bc406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6bb800f740 tx=0x7f6bb800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:14.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.522+0000 7f6bc8ac3700 1 --2- 172.21.15.80:0/1276531259 >> v2:172.21.15.80:3300/0 conn(0x7f6bc406c490 0x7f6bc406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6bb800f740 tx=0x7f6bb800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:14.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.522+0000 7f6bc8ac3700 1 --2- 172.21.15.80:0/1276531259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bc406c490 0x7f6bc406c920 secure :-1 s=READY pgs=1018 cs=0 l=1 rx=0x7f6bb800f740 tx=0x7f6bb800fae0).ready entity=mon.0 client_cookie=1dbf06b159a523f9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:14.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.523+0000 7f6bc8ac3700 1 --2- 172.21.15.80:0/1276531259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bc406c490 0x7f6bc406c920 secure :-1 s=THROTTLE_DONE pgs=1018 cs=0 l=1 rx=0x7f6bb800f740 tx=0x7f6bb800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:14.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.523+0000 7f6bc3fff700 1 -- 172.21.15.80:0/1276531259 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bb8000960 con 0x7f6bc406c490 2019-11-28T11:36:14.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.523+0000 7f6bc8ac3700 1 --2- 172.21.15.80:0/1276531259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bc406c490 0x7f6bc406c920 secure :-1 s=THROTTLE_DONE pgs=1018 cs=0 l=1 rx=0x7f6bb800f740 tx=0x7f6bb800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:14.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.523+0000 7f6bc8ac3700 1 --2- 172.21.15.80:0/1276531259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bc406c490 0x7f6bc406c920 secure :-1 s=THROTTLE_DONE pgs=1018 cs=0 l=1 rx=0x7f6bb800f740 tx=0x7f6bb800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:14.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.523+0000 7f6bc3fff700 1 -- 172.21.15.80:0/1276531259 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb8000c90 con 0x7f6bc406c490 2019-11-28T11:36:14.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.523+0000 7f6bc3fff700 1 -- 172.21.15.80:0/1276531259 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bb8001360 con 0x7f6bc406c490 2019-11-28T11:36:14.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.523+0000 7f6bcad27700 1 -- 172.21.15.80:0/1276531259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bc406c490 msgr2=0x7f6bc406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:14.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.523+0000 7f6bcad27700 1 --2- 172.21.15.80:0/1276531259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bc406c490 0x7f6bc406c920 secure :-1 s=READY pgs=1018 cs=0 l=1 rx=0x7f6bb800f740 tx=0x7f6bb800fae0).stop 2019-11-28T11:36:14.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.523+0000 7f6bcad27700 1 -- 172.21.15.80:0/1276531259 shutdown_connections 2019-11-28T11:36:14.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.523+0000 7f6bcad27700 1 --2- 172.21.15.80:0/1276531259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bc406c490 0x7f6bc406c920 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:14.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.523+0000 7f6bcad27700 1 -- 172.21.15.80:0/1276531259 shutdown_connections 2019-11-28T11:36:14.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.523+0000 7f6bcad27700 1 -- 172.21.15.80:0/1276531259 wait complete. 2019-11-28T11:36:14.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.523+0000 7f6bcad27700 1 -- 172.21.15.80:0/1276531259 >> 172.21.15.80:0/1276531259 conn(0x7f6bc4061cf0 msgr2=0x7f6bc4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:14.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.526+0000 7f6bcad27700 1 Processor -- start 2019-11-28T11:36:14.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.526+0000 7f6bcad27700 1 -- start start 2019-11-28T11:36:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bcad27700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bc4166a10 0x7f6bc4168e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bcad27700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc4124260 con 0x7f6bc4111db0 2019-11-28T11:36:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bcad27700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc412e5d0 con 0x7f6bc412cea0 2019-11-28T11:36:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bcad27700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc4121040 con 0x7f6bc4166a10 2019-11-28T11:36:14.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc8ac3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6bc4111db0 0x7f6bc41238e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35546/0 (socket says 172.21.15.80:35546) 2019-11-28T11:36:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc8ac3700 1 -- 172.21.15.80:0/281545537 learned_addr learned my addr 172.21.15.80:0/281545537 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc9ac5700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bc4166a10 0x7f6bc4168e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820530504 0 0) 0x7f6bb8007a40 con 0x7f6bc4111db0 2019-11-28T11:36:14.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ba4002e80 con 0x7f6bc4111db0 2019-11-28T11:36:14.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 312457994 0 0) 0x7f6bb80081b0 con 0x7f6bc4111db0 2019-11-28T11:36:14.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6ba40032e0 con 0x7f6bc4111db0 2019-11-28T11:36:14.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f6bb8000940 con 0x7f6bc4111db0 2019-11-28T11:36:14.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bc4166a10 msgr2=0x7f6bc4168e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:14.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc1ffb700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bc4166a10 0x7f6bc4168e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:14.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 >> v1:172.21.15.174:6789/0 conn(0x7f6bc412cea0 legacy=0x7f6bc41230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:14.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 >> v1:172.21.15.80:6789/0 conn(0x7f6bc4111db0 legacy=0x7f6bc41238e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:14.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc1ffb700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ba4003330 0x7f6ba4003740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:14.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc1ffb700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ba4003c80 0x7f6ba40040d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc1ffb700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba4004880 0x7f6ba4004d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba400bb90 con 0x7f6ba4004880 2019-11-28T11:36:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba400dfd0 con 0x7f6ba4003330 2019-11-28T11:36:14.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.527+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba400e1c0 con 0x7f6ba4003c80 2019-11-28T11:36:14.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc9ac5700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba4004880 0x7f6ba4004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:14.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc92c4700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ba4003330 0x7f6ba4003740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:14.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc8ac3700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ba4003c80 0x7f6ba40040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:14.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc9ac5700 1 -- 172.21.15.80:0/281545537 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ba4003c80 msgr2=0x7f6ba40040d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:14.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc9ac5700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ba4003c80 0x7f6ba40040d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:14.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc9ac5700 1 -- 172.21.15.80:0/281545537 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ba4003330 msgr2=0x7f6ba4003740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:14.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc9ac5700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ba4003330 0x7f6ba4003740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:14.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc9ac5700 1 -- 172.21.15.80:0/281545537 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba400bdc0 con 0x7f6ba4004880 2019-11-28T11:36:14.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bcad27700 1 -- 172.21.15.80:0/281545537 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc4121d20 con 0x7f6ba4004880 2019-11-28T11:36:14.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc9ac5700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba4004880 0x7f6ba4004d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6bbc0103a0 tx=0x7f6bbc010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:14.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bcad27700 1 -- 172.21.15.80:0/281545537 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc41219a0 con 0x7f6ba4004880 2019-11-28T11:36:14.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc9ac5700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba4004880 0x7f6ba4004d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6bbc0103a0 tx=0x7f6bbc010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:14.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc9ac5700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba4004880 0x7f6ba4004d40 secure :-1 s=READY pgs=1020 cs=0 l=1 rx=0x7f6bbc0103a0 tx=0x7f6bbc010250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc9ac5700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba4004880 0x7f6ba4004d40 secure :-1 s=THROTTLE_DONE pgs=1020 cs=0 l=1 rx=0x7f6bbc0103a0 tx=0x7f6bbc010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bbc000b60 con 0x7f6ba4004880 2019-11-28T11:36:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc9ac5700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba4004880 0x7f6ba4004d40 secure :-1 s=THROTTLE_DONE pgs=1020 cs=0 l=1 rx=0x7f6bbc0103a0 tx=0x7f6bbc010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:14.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc9ac5700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba4004880 0x7f6ba4004d40 secure :-1 s=THROTTLE_DONE pgs=1020 cs=0 l=1 rx=0x7f6bbc0103a0 tx=0x7f6bbc010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc00ef30 con 0x7f6ba4004880 2019-11-28T11:36:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bbc00eca0 con 0x7f6ba4004880 2019-11-28T11:36:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.528+0000 7f6bc9ac5700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba4004880 0x7f6ba4004d40 secure :-1 s=THROTTLE_DONE pgs=1020 cs=0 l=1 rx=0x7f6bbc0103a0 tx=0x7f6bbc010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.529+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6bbc00f120 con 0x7f6ba4004880 2019-11-28T11:36:14.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.529+0000 7f6bc9ac5700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba4004880 0x7f6ba4004d40 secure :-1 s=THROTTLE_DONE pgs=1020 cs=0 l=1 rx=0x7f6bbc0103a0 tx=0x7f6bbc010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:14.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.529+0000 7f6bc1ffb700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ba4024f90 0x7f6ba40273c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:14.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.529+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f6bbc031c00 con 0x7f6ba4004880 2019-11-28T11:36:14.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.529+0000 7f6bc92c4700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ba4024f90 0x7f6ba40273c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:14.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.529+0000 7f6bc92c4700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ba4024f90 0x7f6ba40273c0 crc :-1 s=READY pgs=416 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:14.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.536+0000 7f6bcad27700 1 -- 172.21.15.80:0/281545537 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b9c002e60 con 0x7f6ba4004880 2019-11-28T11:36:14.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.540+0000 7f6bc9ac5700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba4004880 0x7f6ba4004d40 secure :-1 s=THROTTLE_DONE pgs=1020 cs=0 l=1 rx=0x7f6bbc0103a0 tx=0x7f6bbc010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:14.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.540+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6bbc00ea90 con 0x7f6ba4004880 2019-11-28T11:36:14.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.713+0000 7f6bcad27700 1 -- 172.21.15.80:0/281545537 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b9c001d10 con 0x7f6ba4004880 2019-11-28T11:36:14.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.713+0000 7f6bc9ac5700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba4004880 0x7f6ba4004d40 secure :-1 s=THROTTLE_DONE pgs=1020 cs=0 l=1 rx=0x7f6bbc0103a0 tx=0x7f6bbc010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:14.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.713+0000 7f6bc1ffb700 1 -- 172.21.15.80:0/281545537 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f6bbc00ef10 con 0x7f6ba4004880 2019-11-28T11:36:14.771 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:14.772 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:14.772 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:14.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.716+0000 7f6bcad27700 1 -- 172.21.15.80:0/281545537 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ba4024f90 msgr2=0x7f6ba40273c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:14.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.716+0000 7f6bcad27700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ba4024f90 0x7f6ba40273c0 crc :-1 s=READY pgs=416 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:14.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.716+0000 7f6bcad27700 1 -- 172.21.15.80:0/281545537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba4004880 msgr2=0x7f6ba4004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:14.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.716+0000 7f6bcad27700 1 --2- 172.21.15.80:0/281545537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ba4004880 0x7f6ba4004d40 secure :-1 s=READY pgs=1020 cs=0 l=1 rx=0x7f6bbc0103a0 tx=0x7f6bbc010250).stop 2019-11-28T11:36:14.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.716+0000 7f6bc9ac5700 1 -- 172.21.15.80:0/281545537 reap_dead start 2019-11-28T11:36:14.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.716+0000 7f6bc9ac5700 1 -- 172.21.15.80:0/281545537 reap_dead start 2019-11-28T11:36:14.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.716+0000 7f6bcad27700 1 -- 172.21.15.80:0/281545537 shutdown_connections 2019-11-28T11:36:14.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.716+0000 7f6bcad27700 1 -- 172.21.15.80:0/281545537 shutdown_connections 2019-11-28T11:36:14.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.716+0000 7f6bcad27700 1 -- 172.21.15.80:0/281545537 wait complete. 2019-11-28T11:36:14.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:14.716+0000 7f6bcad27700 1 -- 172.21.15.80:0/281545537 >> 172.21.15.80:0/281545537 conn(0x7f6bc41426c0 msgr2=0x7f6bc4110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:14.786 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:15.788 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:15.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.860+0000 7f966c086700 1 Processor -- start 2019-11-28T11:36:15.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.860+0000 7f966c086700 1 -- start start 2019-11-28T11:36:15.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.861+0000 7f966c086700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f966406c0a0 0x7f9664072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:15.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.861+0000 7f966c086700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664072620 0x7f9664164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:15.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.861+0000 7f966c086700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966406db00 con 0x7f96640734e0 2019-11-28T11:36:15.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.861+0000 7f966c086700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966406fd60 con 0x7f966406c0a0 2019-11-28T11:36:15.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.861+0000 7f966c086700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9664070030 con 0x7f9664072620 2019-11-28T11:36:15.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.861+0000 7f9669e22700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f96640734e0 0x7f9664071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35562/0 (socket says 172.21.15.80:35562) 2019-11-28T11:36:15.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.861+0000 7f9669e22700 1 -- 172.21.15.80:0/2811286483 learned_addr learned my addr 172.21.15.80:0/2811286483 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:15.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.861+0000 7f966ae24700 1 --2- 172.21.15.80:0/2811286483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664072620 0x7f9664164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:15.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.861+0000 7f966a623700 1 --2- 172.21.15.80:0/2811286483 >> v2:172.21.15.174:3300/0 conn(0x7f966406c0a0 0x7f9664072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:15.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f9669621700 1 -- 172.21.15.80:0/2811286483 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819576282 0 0) 0x7f964c0013f0 con 0x7f96640734e0 2019-11-28T11:36:15.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f9669621700 1 -- 172.21.15.80:0/2811286483 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9650002e80 con 0x7f96640734e0 2019-11-28T11:36:15.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f966a623700 1 -- 172.21.15.80:0/2811286483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664072620 msgr2=0x7f9664164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:15.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f966a623700 1 --2- 172.21.15.80:0/2811286483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664072620 0x7f9664164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f966a623700 1 -- 172.21.15.80:0/2811286483 >> v1:172.21.15.80:6789/0 conn(0x7f96640734e0 legacy=0x7f9664071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f9669621700 1 -- 172.21.15.80:0/2811286483 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 606108868 0 0) 0x7f964c0013d0 con 0x7f96640734e0 2019-11-28T11:36:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f966a623700 1 -- 172.21.15.80:0/2811286483 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96640706c0 con 0x7f966406c0a0 2019-11-28T11:36:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f966ae24700 1 --2- 172.21.15.80:0/2811286483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664072620 0x7f9664164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f966a623700 1 --2- 172.21.15.80:0/2811286483 >> v2:172.21.15.174:3300/0 conn(0x7f966406c0a0 0x7f9664072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f965400af50 tx=0x7f965400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f966a623700 1 --2- 172.21.15.80:0/2811286483 >> v2:172.21.15.174:3300/0 conn(0x7f966406c0a0 0x7f9664072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f965400af50 tx=0x7f965400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f966a623700 1 --2- 172.21.15.80:0/2811286483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f966406c0a0 0x7f9664072fa0 secure :-1 s=READY pgs=611 cs=0 l=1 rx=0x7f965400af50 tx=0x7f965400b760).ready entity=mon.1 client_cookie=eb525b45aa86b61b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f966a623700 1 --2- 172.21.15.80:0/2811286483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f966406c0a0 0x7f9664072fa0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7f965400af50 tx=0x7f965400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f9669621700 1 -- 172.21.15.80:0/2811286483 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9654007210 con 0x7f966406c0a0 2019-11-28T11:36:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f966a623700 1 --2- 172.21.15.80:0/2811286483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f966406c0a0 0x7f9664072fa0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7f965400af50 tx=0x7f965400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f966a623700 1 --2- 172.21.15.80:0/2811286483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f966406c0a0 0x7f9664072fa0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7f965400af50 tx=0x7f965400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f9669621700 1 -- 172.21.15.80:0/2811286483 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96540099b0 con 0x7f966406c0a0 2019-11-28T11:36:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f9669621700 1 -- 172.21.15.80:0/2811286483 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f965400a080 con 0x7f966406c0a0 2019-11-28T11:36:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f966c086700 1 -- 172.21.15.80:0/2811286483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f966406c0a0 msgr2=0x7f9664072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:15.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.862+0000 7f966c086700 1 --2- 172.21.15.80:0/2811286483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f966406c0a0 0x7f9664072fa0 secure :-1 s=READY pgs=611 cs=0 l=1 rx=0x7f965400af50 tx=0x7f965400b760).stop 2019-11-28T11:36:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.863+0000 7f966c086700 1 -- 172.21.15.80:0/2811286483 shutdown_connections 2019-11-28T11:36:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.863+0000 7f966c086700 1 --2- 172.21.15.80:0/2811286483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664072620 0x7f9664164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.863+0000 7f966c086700 1 --2- 172.21.15.80:0/2811286483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f966406c0a0 0x7f9664072fa0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.863+0000 7f966c086700 1 -- 172.21.15.80:0/2811286483 shutdown_connections 2019-11-28T11:36:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.863+0000 7f966c086700 1 -- 172.21.15.80:0/2811286483 wait complete. 2019-11-28T11:36:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.863+0000 7f966c086700 1 -- 172.21.15.80:0/2811286483 >> 172.21.15.80:0/2811286483 conn(0x7f9664061cf0 msgr2=0x7f9664064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:15.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.866+0000 7f966c086700 1 Processor -- start 2019-11-28T11:36:15.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.866+0000 7f966c086700 1 -- start start 2019-11-28T11:36:15.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.866+0000 7f966c086700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9664104c10 0x7f96641050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:15.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.866+0000 7f966c086700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966413bcd0 con 0x7f9664104820 2019-11-28T11:36:15.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.866+0000 7f966c086700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9664105ea0 con 0x7f96641055e0 2019-11-28T11:36:15.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.866+0000 7f966c086700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9664109130 con 0x7f9664104c10 2019-11-28T11:36:15.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.866+0000 7f966a623700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9664104820 0x7f966410c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35564/0 (socket says 172.21.15.80:35564) 2019-11-28T11:36:15.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.866+0000 7f966a623700 1 -- 172.21.15.80:0/1080057225 learned_addr learned my addr 172.21.15.80:0/1080057225 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:15.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f9669e22700 1 --2- 172.21.15.80:0/1080057225 >> v2:172.21.15.80:3300/0 conn(0x7f9664104c10 0x7f96641050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:15.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f9662ffd700 1 -- 172.21.15.80:0/1080057225 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948424001 0 0) 0x7f965400abb0 con 0x7f9664104820 2019-11-28T11:36:15.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f9662ffd700 1 -- 172.21.15.80:0/1080057225 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9648002e80 con 0x7f9664104820 2019-11-28T11:36:15.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f9662ffd700 1 -- 172.21.15.80:0/1080057225 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137718132 0 0) 0x7f965c0097c0 con 0x7f96641055e0 2019-11-28T11:36:15.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f9669e22700 1 -- 172.21.15.80:0/1080057225 >> v1:172.21.15.174:6789/0 conn(0x7f96641055e0 legacy=0x7f9664167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:15.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f9669e22700 1 -- 172.21.15.80:0/1080057225 >> v1:172.21.15.80:6789/0 conn(0x7f9664104820 legacy=0x7f966410c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:15.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f9669e22700 1 -- 172.21.15.80:0/1080057225 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9664109a90 con 0x7f9664104c10 2019-11-28T11:36:15.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f9669e22700 1 --2- 172.21.15.80:0/1080057225 >> v2:172.21.15.80:3300/0 conn(0x7f9664104c10 0x7f96641050a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f964c010700 tx=0x7f964c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:15.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f9669e22700 1 --2- 172.21.15.80:0/1080057225 >> v2:172.21.15.80:3300/0 conn(0x7f9664104c10 0x7f96641050a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f964c010700 tx=0x7f964c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:15.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f9669e22700 1 --2- 172.21.15.80:0/1080057225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9664104c10 0x7f96641050a0 secure :-1 s=READY pgs=1023 cs=0 l=1 rx=0x7f964c010700 tx=0x7f964c010aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:15.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f9669e22700 1 --2- 172.21.15.80:0/1080057225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9664104c10 0x7f96641050a0 secure :-1 s=THROTTLE_DONE pgs=1023 cs=0 l=1 rx=0x7f964c010700 tx=0x7f964c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:15.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f9662ffd700 1 -- 172.21.15.80:0/1080057225 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f964c000cc0 con 0x7f9664104c10 2019-11-28T11:36:15.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f9669e22700 1 --2- 172.21.15.80:0/1080057225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9664104c10 0x7f96641050a0 secure :-1 s=THROTTLE_DONE pgs=1023 cs=0 l=1 rx=0x7f964c010700 tx=0x7f964c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:15.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f9669e22700 1 --2- 172.21.15.80:0/1080057225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9664104c10 0x7f96641050a0 secure :-1 s=THROTTLE_DONE pgs=1023 cs=0 l=1 rx=0x7f964c010700 tx=0x7f964c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:15.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f9662ffd700 1 -- 172.21.15.80:0/1080057225 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c004550 con 0x7f9664104c10 2019-11-28T11:36:15.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f966c086700 1 -- 172.21.15.80:0/1080057225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9664109e10 con 0x7f9664104c10 2019-11-28T11:36:15.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f9662ffd700 1 -- 172.21.15.80:0/1080057225 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f964c004c20 con 0x7f9664104c10 2019-11-28T11:36:15.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.867+0000 7f966c086700 1 -- 172.21.15.80:0/1080057225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9664109a90 con 0x7f9664104c10 2019-11-28T11:36:15.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.868+0000 7f9669e22700 1 --2- 172.21.15.80:0/1080057225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9664104c10 0x7f96641050a0 secure :-1 s=THROTTLE_DONE pgs=1023 cs=0 l=1 rx=0x7f964c010700 tx=0x7f964c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:15.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.868+0000 7f9662ffd700 1 -- 172.21.15.80:0/1080057225 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f964c0010d0 con 0x7f9664104c10 2019-11-28T11:36:15.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.868+0000 7f9669e22700 1 --2- 172.21.15.80:0/1080057225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9664104c10 0x7f96641050a0 secure :-1 s=THROTTLE_DONE pgs=1023 cs=0 l=1 rx=0x7f964c010700 tx=0x7f964c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:15.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.868+0000 7f9662ffd700 1 --2- 172.21.15.80:0/1080057225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9648018780 0x7f964801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:15.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.868+0000 7f9662ffd700 1 -- 172.21.15.80:0/1080057225 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f964c031e30 con 0x7f9664104c10 2019-11-28T11:36:15.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.868+0000 7f966a623700 1 --2- 172.21.15.80:0/1080057225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9648018780 0x7f964801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:15.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.868+0000 7f966a623700 1 --2- 172.21.15.80:0/1080057225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9648018780 0x7f964801abf0 crc :-1 s=READY pgs=417 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:15.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.875+0000 7f966c086700 1 -- 172.21.15.80:0/1080057225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9664109e10 con 0x7f9664104c10 2019-11-28T11:36:15.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.879+0000 7f9669e22700 1 --2- 172.21.15.80:0/1080057225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9664104c10 0x7f96641050a0 secure :-1 s=THROTTLE_DONE pgs=1023 cs=0 l=1 rx=0x7f964c010700 tx=0x7f964c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:15.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:15.879+0000 7f9662ffd700 1 -- 172.21.15.80:0/1080057225 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f964c02cf30 con 0x7f9664104c10 2019-11-28T11:36:16.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:16.051+0000 7f966c086700 1 -- 172.21.15.80:0/1080057225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9664109a90 con 0x7f9664104c10 2019-11-28T11:36:16.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:16.052+0000 7f9669e22700 1 --2- 172.21.15.80:0/1080057225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9664104c10 0x7f96641050a0 secure :-1 s=THROTTLE_DONE pgs=1023 cs=0 l=1 rx=0x7f964c010700 tx=0x7f964c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:16.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:16.052+0000 7f9662ffd700 1 -- 172.21.15.80:0/1080057225 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f964c02cf30 con 0x7f9664104c10 2019-11-28T11:36:16.111 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:16.111 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:16.111 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:16.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:16.054+0000 7f966c086700 1 -- 172.21.15.80:0/1080057225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9648018780 msgr2=0x7f964801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:16.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:16.054+0000 7f966c086700 1 --2- 172.21.15.80:0/1080057225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9648018780 0x7f964801abf0 crc :-1 s=READY pgs=417 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:16.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:16.054+0000 7f966c086700 1 -- 172.21.15.80:0/1080057225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9664104c10 msgr2=0x7f96641050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:16.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:16.054+0000 7f966c086700 1 --2- 172.21.15.80:0/1080057225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9664104c10 0x7f96641050a0 secure :-1 s=READY pgs=1023 cs=0 l=1 rx=0x7f964c010700 tx=0x7f964c010aa0).stop 2019-11-28T11:36:16.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:16.054+0000 7f966c086700 1 -- 172.21.15.80:0/1080057225 shutdown_connections 2019-11-28T11:36:16.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:16.054+0000 7f966c086700 1 --2- 172.21.15.80:0/1080057225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9648018780 0x7f964801abf0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:16.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:16.054+0000 7f966c086700 1 --2- 172.21.15.80:0/1080057225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9664104c10 0x7f96641050a0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:16.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:16.054+0000 7f966c086700 1 -- 172.21.15.80:0/1080057225 shutdown_connections 2019-11-28T11:36:16.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:16.054+0000 7f966c086700 1 -- 172.21.15.80:0/1080057225 wait complete. 2019-11-28T11:36:16.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:16.054+0000 7f966c086700 1 -- 172.21.15.80:0/1080057225 >> 172.21.15.80:0/1080057225 conn(0x7f966413d620 msgr2=0x7f966413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:16.121 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:17.123 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:17.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.186+0000 7fb1552ee700 1 Processor -- start 2019-11-28T11:36:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.187+0000 7fb1552ee700 1 -- start start 2019-11-28T11:36:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.187+0000 7fb1552ee700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb15006c0a0 0x7fb150072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.187+0000 7fb1552ee700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1500734e0 0x7fb150071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.187+0000 7fb1552ee700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb150072360 0x7fb150072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:17.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.187+0000 7fb1552ee700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb15006fd60 con 0x7fb15006c0a0 2019-11-28T11:36:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.187+0000 7fb1552ee700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb150070030 con 0x7fb150072360 2019-11-28T11:36:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.187+0000 7fb1552ee700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15006f330 con 0x7fb1500734e0 2019-11-28T11:36:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb15006c0a0 0x7fb150072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:17.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb15006c0a0 0x7fb150072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36256/0 (socket says 172.21.15.80:36256) 2019-11-28T11:36:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14f7fe700 1 -- 172.21.15.80:0/2268452029 learned_addr learned my addr 172.21.15.80:0/2268452029 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:17.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14effd700 1 --2- 172.21.15.80:0/2268452029 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1500734e0 0x7fb150071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:17.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14ffff700 1 --2- 172.21.15.80:0/2268452029 >> v2:172.21.15.174:3300/0 conn(0x7fb150072360 0x7fb150072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:17.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14f7fe700 1 -- 172.21.15.80:0/2268452029 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1500734e0 msgr2=0x7fb150071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/2268452029 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1500734e0 0x7fb150071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14f7fe700 1 -- 172.21.15.80:0/2268452029 >> v2:172.21.15.174:3300/0 conn(0x7fb150072360 msgr2=0x7fb150072800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:17.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/2268452029 >> v2:172.21.15.174:3300/0 conn(0x7fb150072360 0x7fb150072800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14f7fe700 1 -- 172.21.15.80:0/2268452029 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1500706c0 con 0x7fb15006c0a0 2019-11-28T11:36:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/2268452029 >> v2:172.21.15.80:3300/0 conn(0x7fb15006c0a0 0x7fb150072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb13800f6c0 tx=0x7fb13800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:17.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/2268452029 >> v2:172.21.15.80:3300/0 conn(0x7fb15006c0a0 0x7fb150072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb13800f6c0 tx=0x7fb13800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/2268452029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb15006c0a0 0x7fb150072fa0 secure :-1 s=READY pgs=1024 cs=0 l=1 rx=0x7fb13800f6c0 tx=0x7fb13800f570).ready entity=mon.0 client_cookie=5b15bd0df4083413 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/2268452029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb15006c0a0 0x7fb150072fa0 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7fb13800f6c0 tx=0x7fb13800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/2268452029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb15006c0a0 0x7fb150072fa0 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7fb13800f6c0 tx=0x7fb13800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14e7fc700 1 -- 172.21.15.80:0/2268452029 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb138000960 con 0x7fb15006c0a0 2019-11-28T11:36:17.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/2268452029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb15006c0a0 0x7fb150072fa0 secure :-1 s=THROTTLE_DONE pgs=1024 cs=0 l=1 rx=0x7fb13800f6c0 tx=0x7fb13800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14e7fc700 1 -- 172.21.15.80:0/2268452029 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb138000c90 con 0x7fb15006c0a0 2019-11-28T11:36:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb14e7fc700 1 -- 172.21.15.80:0/2268452029 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1380013a0 con 0x7fb15006c0a0 2019-11-28T11:36:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb1552ee700 1 -- 172.21.15.80:0/2268452029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb15006c0a0 msgr2=0x7fb150072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:17.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.188+0000 7fb1552ee700 1 --2- 172.21.15.80:0/2268452029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb15006c0a0 0x7fb150072fa0 secure :-1 s=READY pgs=1024 cs=0 l=1 rx=0x7fb13800f6c0 tx=0x7fb13800f570).stop 2019-11-28T11:36:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.189+0000 7fb1552ee700 1 -- 172.21.15.80:0/2268452029 shutdown_connections 2019-11-28T11:36:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.189+0000 7fb1552ee700 1 --2- 172.21.15.80:0/2268452029 >> v2:172.21.15.174:3300/0 conn(0x7fb150072360 0x7fb150072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:17.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.189+0000 7fb1552ee700 1 --2- 172.21.15.80:0/2268452029 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1500734e0 0x7fb150071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:17.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.189+0000 7fb1552ee700 1 --2- 172.21.15.80:0/2268452029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb15006c0a0 0x7fb150072fa0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.189+0000 7fb1552ee700 1 -- 172.21.15.80:0/2268452029 shutdown_connections 2019-11-28T11:36:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.189+0000 7fb1552ee700 1 -- 172.21.15.80:0/2268452029 wait complete. 2019-11-28T11:36:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.189+0000 7fb1552ee700 1 -- 172.21.15.80:0/2268452029 >> 172.21.15.80:0/2268452029 conn(0x7fb150061cf0 msgr2=0x7fb150064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:17.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.191+0000 7fb1552ee700 1 Processor -- start 2019-11-28T11:36:17.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.192+0000 7fb1552ee700 1 -- start start 2019-11-28T11:36:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.192+0000 7fb1552ee700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb150164ff0 0x7fb1501653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:17.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.192+0000 7fb1552ee700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb150133820 0x7fb1501326a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.192+0000 7fb1552ee700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb150133cb0 0x7fb150132be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.192+0000 7fb1552ee700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb15010dd90 con 0x7fb150164ff0 2019-11-28T11:36:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb1552ee700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb15010e060 con 0x7fb150133820 2019-11-28T11:36:17.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb1552ee700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15010d360 con 0x7fb150133cb0 2019-11-28T11:36:17.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb150164ff0 0x7fb1501653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:17.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb150164ff0 0x7fb1501653e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36262/0 (socket says 172.21.15.80:36262) 2019-11-28T11:36:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14f7fe700 1 -- 172.21.15.80:0/1600543653 learned_addr learned my addr 172.21.15.80:0/1600543653 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:17.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14effd700 1 --2- 172.21.15.80:0/1600543653 >> v2:172.21.15.174:3300/0 conn(0x7fb150133820 0x7fb1501326a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:17.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14ffff700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb150133cb0 0x7fb150132be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14f7fe700 1 -- 172.21.15.80:0/1600543653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb150133cb0 msgr2=0x7fb150132be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb150133cb0 0x7fb150132be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14f7fe700 1 -- 172.21.15.80:0/1600543653 >> v2:172.21.15.174:3300/0 conn(0x7fb150133820 msgr2=0x7fb1501326a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:17.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/1600543653 >> v2:172.21.15.174:3300/0 conn(0x7fb150133820 0x7fb1501326a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:17.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14f7fe700 1 -- 172.21.15.80:0/1600543653 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15010e6f0 con 0x7fb150164ff0 2019-11-28T11:36:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14ffff700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb150133cb0 0x7fb150132be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:36:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/1600543653 >> v2:172.21.15.80:3300/0 conn(0x7fb150164ff0 0x7fb1501653e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb138010440 tx=0x7fb1380102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:17.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/1600543653 >> v2:172.21.15.80:3300/0 conn(0x7fb150164ff0 0x7fb1501653e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb138010440 tx=0x7fb1380102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:17.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb150164ff0 0x7fb1501653e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rx=0x7fb138010440 tx=0x7fb1380102f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:17.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb150164ff0 0x7fb1501653e0 secure :-1 s=THROTTLE_DONE pgs=1025 cs=0 l=1 rx=0x7fb138010440 tx=0x7fb1380102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb147fff700 1 -- 172.21.15.80:0/1600543653 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb138007a60 con 0x7fb150164ff0 2019-11-28T11:36:17.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb150164ff0 0x7fb1501653e0 secure :-1 s=THROTTLE_DONE pgs=1025 cs=0 l=1 rx=0x7fb138010440 tx=0x7fb1380102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb147fff700 1 -- 172.21.15.80:0/1600543653 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb138005370 con 0x7fb150164ff0 2019-11-28T11:36:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb150164ff0 0x7fb1501653e0 secure :-1 s=THROTTLE_DONE pgs=1025 cs=0 l=1 rx=0x7fb138010440 tx=0x7fb1380102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:17.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb1552ee700 1 -- 172.21.15.80:0/1600543653 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15010ea70 con 0x7fb150164ff0 2019-11-28T11:36:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb147fff700 1 -- 172.21.15.80:0/1600543653 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb138005a80 con 0x7fb150164ff0 2019-11-28T11:36:17.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.193+0000 7fb1552ee700 1 -- 172.21.15.80:0/1600543653 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15010e6f0 con 0x7fb150164ff0 2019-11-28T11:36:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.194+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb150164ff0 0x7fb1501653e0 secure :-1 s=THROTTLE_DONE pgs=1025 cs=0 l=1 rx=0x7fb138010440 tx=0x7fb1380102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.194+0000 7fb147fff700 1 -- 172.21.15.80:0/1600543653 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb138007a60 con 0x7fb150164ff0 2019-11-28T11:36:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.194+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb150164ff0 0x7fb1501653e0 secure :-1 s=THROTTLE_DONE pgs=1025 cs=0 l=1 rx=0x7fb138010440 tx=0x7fb1380102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:17.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.194+0000 7fb147fff700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb134018730 0x7fb13401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.194+0000 7fb147fff700 1 -- 172.21.15.80:0/1600543653 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fb138031a00 con 0x7fb150164ff0 2019-11-28T11:36:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.194+0000 7fb14effd700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb134018730 0x7fb13401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:17.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.194+0000 7fb14effd700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb134018730 0x7fb13401abc0 crc :-1 s=READY pgs=418 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.201+0000 7fb1552ee700 1 -- 172.21.15.80:0/1600543653 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb15010ea70 con 0x7fb150164ff0 2019-11-28T11:36:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.204+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb150164ff0 0x7fb1501653e0 secure :-1 s=THROTTLE_DONE pgs=1025 cs=0 l=1 rx=0x7fb138010440 tx=0x7fb1380102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:17.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.204+0000 7fb147fff700 1 -- 172.21.15.80:0/1600543653 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb138007230 con 0x7fb150164ff0 2019-11-28T11:36:17.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.374+0000 7fb1552ee700 1 -- 172.21.15.80:0/1600543653 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb15010e6f0 con 0x7fb150164ff0 2019-11-28T11:36:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.375+0000 7fb14f7fe700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb150164ff0 0x7fb1501653e0 secure :-1 s=THROTTLE_DONE pgs=1025 cs=0 l=1 rx=0x7fb138010440 tx=0x7fb1380102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:17.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.375+0000 7fb147fff700 1 -- 172.21.15.80:0/1600543653 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fb138007a60 con 0x7fb150164ff0 2019-11-28T11:36:17.434 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:17.434 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:17.434 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.377+0000 7fb1552ee700 1 -- 172.21.15.80:0/1600543653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb134018730 msgr2=0x7fb13401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.377+0000 7fb1552ee700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb134018730 0x7fb13401abc0 crc :-1 s=READY pgs=418 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.377+0000 7fb1552ee700 1 -- 172.21.15.80:0/1600543653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb150164ff0 msgr2=0x7fb1501653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.377+0000 7fb1552ee700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb150164ff0 0x7fb1501653e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rx=0x7fb138010440 tx=0x7fb1380102f0).stop 2019-11-28T11:36:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.377+0000 7fb1552ee700 1 -- 172.21.15.80:0/1600543653 shutdown_connections 2019-11-28T11:36:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.377+0000 7fb1552ee700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb134018730 0x7fb13401abc0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:17.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.377+0000 7fb1552ee700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb150133cb0 0x7fb150132be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.377+0000 7fb1552ee700 1 --2- 172.21.15.80:0/1600543653 >> v2:172.21.15.174:3300/0 conn(0x7fb150133820 0x7fb1501326a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.377+0000 7fb1552ee700 1 --2- 172.21.15.80:0/1600543653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb150164ff0 0x7fb1501653e0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.378+0000 7fb1552ee700 1 -- 172.21.15.80:0/1600543653 shutdown_connections 2019-11-28T11:36:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.378+0000 7fb1552ee700 1 -- 172.21.15.80:0/1600543653 wait complete. 2019-11-28T11:36:17.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:17.378+0000 7fb1552ee700 1 -- 172.21.15.80:0/1600543653 >> 172.21.15.80:0/1600543653 conn(0x7fb15011bfc0 msgr2=0x7fb150141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:17.445 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:18.447 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.522+0000 7f8a22baf700 1 Processor -- start 2019-11-28T11:36:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.522+0000 7f8a22baf700 1 -- start start 2019-11-28T11:36:18.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.523+0000 7f8a22baf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a1c06c0a0 0x7f8a1c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.523+0000 7f8a22baf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8a1c072620 0x7f8a1c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.523+0000 7f8a22baf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a1c06db00 con 0x7f8a1c0734e0 2019-11-28T11:36:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.523+0000 7f8a22baf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1c06fd60 con 0x7f8a1c06c0a0 2019-11-28T11:36:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.523+0000 7f8a22baf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1c070030 con 0x7f8a1c072620 2019-11-28T11:36:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.523+0000 7f8a2114c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a1c06c0a0 0x7f8a1c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.523+0000 7f8a2114c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a1c06c0a0 0x7f8a1c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36270/0 (socket says 172.21.15.80:36270) 2019-11-28T11:36:18.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a2114c700 1 -- 172.21.15.80:0/2743051770 learned_addr learned my addr 172.21.15.80:0/2743051770 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a2194d700 1 --2- 172.21.15.80:0/2743051770 >> v2:172.21.15.174:3300/0 conn(0x7f8a1c072620 0x7f8a1c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a2114c700 1 -- 172.21.15.80:0/2743051770 >> v2:172.21.15.174:3300/0 conn(0x7f8a1c072620 msgr2=0x7f8a1c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a2114c700 1 --2- 172.21.15.80:0/2743051770 >> v2:172.21.15.174:3300/0 conn(0x7f8a1c072620 0x7f8a1c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a2114c700 1 -- 172.21.15.80:0/2743051770 >> v1:172.21.15.174:6789/0 conn(0x7f8a1c0734e0 legacy=0x7f8a1c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a13fff700 1 -- 172.21.15.80:0/2743051770 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318082431 0 0) 0x7f8a18001080 con 0x7f8a1c0734e0 2019-11-28T11:36:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a2114c700 1 -- 172.21.15.80:0/2743051770 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c0706c0 con 0x7f8a1c06c0a0 2019-11-28T11:36:18.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a2114c700 1 --2- 172.21.15.80:0/2743051770 >> v2:172.21.15.80:3300/0 conn(0x7f8a1c06c0a0 0x7f8a1c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8a0c00f6c0 tx=0x7f8a0c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:18.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a2114c700 1 --2- 172.21.15.80:0/2743051770 >> v2:172.21.15.80:3300/0 conn(0x7f8a1c06c0a0 0x7f8a1c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8a0c00f6c0 tx=0x7f8a0c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:18.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a2114c700 1 --2- 172.21.15.80:0/2743051770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c06c0a0 0x7f8a1c072fa0 secure :-1 s=READY pgs=1026 cs=0 l=1 rx=0x7f8a0c00f6c0 tx=0x7f8a0c00fa60).ready entity=mon.0 client_cookie=e27c800dad87a6db server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:18.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a2114c700 1 --2- 172.21.15.80:0/2743051770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c06c0a0 0x7f8a1c072fa0 secure :-1 s=THROTTLE_DONE pgs=1026 cs=0 l=1 rx=0x7f8a0c00f6c0 tx=0x7f8a0c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:18.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a13fff700 1 -- 172.21.15.80:0/2743051770 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a0c000960 con 0x7f8a1c06c0a0 2019-11-28T11:36:18.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a2114c700 1 --2- 172.21.15.80:0/2743051770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c06c0a0 0x7f8a1c072fa0 secure :-1 s=THROTTLE_DONE pgs=1026 cs=0 l=1 rx=0x7f8a0c00f6c0 tx=0x7f8a0c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:18.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a2114c700 1 --2- 172.21.15.80:0/2743051770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c06c0a0 0x7f8a1c072fa0 secure :-1 s=THROTTLE_DONE pgs=1026 cs=0 l=1 rx=0x7f8a0c00f6c0 tx=0x7f8a0c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:18.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a13fff700 1 -- 172.21.15.80:0/2743051770 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c000c90 con 0x7f8a1c06c0a0 2019-11-28T11:36:18.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a13fff700 1 -- 172.21.15.80:0/2743051770 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a0c000960 con 0x7f8a1c06c0a0 2019-11-28T11:36:18.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a22baf700 1 -- 172.21.15.80:0/2743051770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c06c0a0 msgr2=0x7f8a1c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:18.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.524+0000 7f8a22baf700 1 --2- 172.21.15.80:0/2743051770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c06c0a0 0x7f8a1c072fa0 secure :-1 s=READY pgs=1026 cs=0 l=1 rx=0x7f8a0c00f6c0 tx=0x7f8a0c00fa60).stop 2019-11-28T11:36:18.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.525+0000 7f8a22baf700 1 -- 172.21.15.80:0/2743051770 shutdown_connections 2019-11-28T11:36:18.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.525+0000 7f8a22baf700 1 --2- 172.21.15.80:0/2743051770 >> v2:172.21.15.174:3300/0 conn(0x7f8a1c072620 0x7f8a1c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:18.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.525+0000 7f8a22baf700 1 --2- 172.21.15.80:0/2743051770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c06c0a0 0x7f8a1c072fa0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:18.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.525+0000 7f8a22baf700 1 -- 172.21.15.80:0/2743051770 shutdown_connections 2019-11-28T11:36:18.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.525+0000 7f8a22baf700 1 -- 172.21.15.80:0/2743051770 wait complete. 2019-11-28T11:36:18.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.525+0000 7f8a22baf700 1 -- 172.21.15.80:0/2743051770 >> 172.21.15.80:0/2743051770 conn(0x7f8a1c061cf0 msgr2=0x7f8a1c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:18.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.527+0000 7f8a22baf700 1 Processor -- start 2019-11-28T11:36:18.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.527+0000 7f8a22baf700 1 -- start start 2019-11-28T11:36:18.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.528+0000 7f8a22baf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a1c104820 0x7f8a1c10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:18.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.528+0000 7f8a22baf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a1c10c890 0x7f8a1c10b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:18.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.528+0000 7f8a22baf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8a1c10b710 0x7f8a1c10bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:18.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.528+0000 7f8a22baf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1c109130 con 0x7f8a1c104820 2019-11-28T11:36:18.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.528+0000 7f8a22baf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1c109400 con 0x7f8a1c10b710 2019-11-28T11:36:18.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.528+0000 7f8a22baf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c108700 con 0x7f8a1c10c890 2019-11-28T11:36:18.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a2114c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a1c104820 0x7f8a1c10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:18.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a2114c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a1c104820 0x7f8a1c10c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36276/0 (socket says 172.21.15.80:36276) 2019-11-28T11:36:18.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a2114c700 1 -- 172.21.15.80:0/813511956 learned_addr learned my addr 172.21.15.80:0/813511956 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:18.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a2094b700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a1c10c890 0x7f8a1c10b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:18.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a2194d700 1 --2- 172.21.15.80:0/813511956 >> v2:172.21.15.174:3300/0 conn(0x7f8a1c10b710 0x7f8a1c10bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:18.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a2114c700 1 -- 172.21.15.80:0/813511956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a1c10c890 msgr2=0x7f8a1c10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:18.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a2114c700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a1c10c890 0x7f8a1c10b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:18.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a2114c700 1 -- 172.21.15.80:0/813511956 >> v2:172.21.15.174:3300/0 conn(0x7f8a1c10b710 msgr2=0x7f8a1c10bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:18.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a2114c700 1 --2- 172.21.15.80:0/813511956 >> v2:172.21.15.174:3300/0 conn(0x7f8a1c10b710 0x7f8a1c10bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:18.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a2114c700 1 -- 172.21.15.80:0/813511956 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c109a90 con 0x7f8a1c104820 2019-11-28T11:36:18.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a2114c700 1 --2- 172.21.15.80:0/813511956 >> v2:172.21.15.80:3300/0 conn(0x7f8a1c104820 0x7f8a1c10c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a0c054440 tx=0x7f8a0c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:18.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a2114c700 1 --2- 172.21.15.80:0/813511956 >> v2:172.21.15.80:3300/0 conn(0x7f8a1c104820 0x7f8a1c10c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a0c054440 tx=0x7f8a0c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:18.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a2114c700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c104820 0x7f8a1c10c350 secure :-1 s=READY pgs=1027 cs=0 l=1 rx=0x7f8a0c054440 tx=0x7f8a0c054370).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:18.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a2114c700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c104820 0x7f8a1c10c350 secure :-1 s=THROTTLE_DONE pgs=1027 cs=0 l=1 rx=0x7f8a0c054440 tx=0x7f8a0c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:18.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a2114c700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c104820 0x7f8a1c10c350 secure :-1 s=THROTTLE_DONE pgs=1027 cs=0 l=1 rx=0x7f8a0c054440 tx=0x7f8a0c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:18.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a2114c700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c104820 0x7f8a1c10c350 secure :-1 s=THROTTLE_DONE pgs=1027 cs=0 l=1 rx=0x7f8a0c054440 tx=0x7f8a0c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:18.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a11ffb700 1 -- 172.21.15.80:0/813511956 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a0c008160 con 0x7f8a1c104820 2019-11-28T11:36:18.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a11ffb700 1 -- 172.21.15.80:0/813511956 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c005370 con 0x7f8a1c104820 2019-11-28T11:36:18.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a22baf700 1 -- 172.21.15.80:0/813511956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1c109e10 con 0x7f8a1c104820 2019-11-28T11:36:18.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a11ffb700 1 -- 172.21.15.80:0/813511956 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a0c005a00 con 0x7f8a1c104820 2019-11-28T11:36:18.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.529+0000 7f8a22baf700 1 -- 172.21.15.80:0/813511956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1c109a90 con 0x7f8a1c104820 2019-11-28T11:36:18.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.530+0000 7f8a2114c700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c104820 0x7f8a1c10c350 secure :-1 s=THROTTLE_DONE pgs=1027 cs=0 l=1 rx=0x7f8a0c054440 tx=0x7f8a0c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:18.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.530+0000 7f8a11ffb700 1 -- 172.21.15.80:0/813511956 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8a0c005560 con 0x7f8a1c104820 2019-11-28T11:36:18.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.530+0000 7f8a2114c700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c104820 0x7f8a1c10c350 secure :-1 s=THROTTLE_DONE pgs=1027 cs=0 l=1 rx=0x7f8a0c054440 tx=0x7f8a0c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:18.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.530+0000 7f8a11ffb700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89fc018730 0x7f89fc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:18.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.530+0000 7f8a11ffb700 1 -- 172.21.15.80:0/813511956 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8a0c075a40 con 0x7f8a1c104820 2019-11-28T11:36:18.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.530+0000 7f8a2094b700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89fc018730 0x7f89fc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:18.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.530+0000 7f8a2094b700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89fc018730 0x7f89fc01abc0 crc :-1 s=READY pgs=419 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:18.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.538+0000 7f8a22baf700 1 -- 172.21.15.80:0/813511956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a1c109e10 con 0x7f8a1c104820 2019-11-28T11:36:18.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.541+0000 7f8a2114c700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c104820 0x7f8a1c10c350 secure :-1 s=THROTTLE_DONE pgs=1027 cs=0 l=1 rx=0x7f8a0c054440 tx=0x7f8a0c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:18.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.541+0000 7f8a11ffb700 1 -- 172.21.15.80:0/813511956 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8a0c007330 con 0x7f8a1c104820 2019-11-28T11:36:18.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.716+0000 7f8a22baf700 1 -- 172.21.15.80:0/813511956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a1c109a90 con 0x7f8a1c104820 2019-11-28T11:36:18.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.716+0000 7f8a2114c700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c104820 0x7f8a1c10c350 secure :-1 s=THROTTLE_DONE pgs=1027 cs=0 l=1 rx=0x7f8a0c054440 tx=0x7f8a0c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:18.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.716+0000 7f8a11ffb700 1 -- 172.21.15.80:0/813511956 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f8a0c005540 con 0x7f8a1c104820 2019-11-28T11:36:18.777 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:18.777 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:18.777 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:18.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.719+0000 7f8a22baf700 1 -- 172.21.15.80:0/813511956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89fc018730 msgr2=0x7f89fc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:18.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.719+0000 7f8a22baf700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89fc018730 0x7f89fc01abc0 crc :-1 s=READY pgs=419 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:18.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.719+0000 7f8a22baf700 1 -- 172.21.15.80:0/813511956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c104820 msgr2=0x7f8a1c10c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:18.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.719+0000 7f8a22baf700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c104820 0x7f8a1c10c350 secure :-1 s=READY pgs=1027 cs=0 l=1 rx=0x7f8a0c054440 tx=0x7f8a0c054370).stop 2019-11-28T11:36:18.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.719+0000 7f8a22baf700 1 -- 172.21.15.80:0/813511956 shutdown_connections 2019-11-28T11:36:18.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.719+0000 7f8a22baf700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89fc018730 0x7f89fc01abc0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:18.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.719+0000 7f8a22baf700 1 --2- 172.21.15.80:0/813511956 >> v2:172.21.15.174:3300/0 conn(0x7f8a1c10b710 0x7f8a1c10bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:18.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.719+0000 7f8a22baf700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a1c10c890 0x7f8a1c10b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:18.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.719+0000 7f8a22baf700 1 --2- 172.21.15.80:0/813511956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a1c104820 0x7f8a1c10c350 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:18.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.719+0000 7f8a22baf700 1 -- 172.21.15.80:0/813511956 shutdown_connections 2019-11-28T11:36:18.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.719+0000 7f8a22baf700 1 -- 172.21.15.80:0/813511956 wait complete. 2019-11-28T11:36:18.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:18.719+0000 7f8a22baf700 1 -- 172.21.15.80:0/813511956 >> 172.21.15.80:0/813511956 conn(0x7f8a1c13d620 msgr2=0x7f8a1c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:18.802 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:19.166 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:36:19.172 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:36:19.178 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:36:19.189 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:36:19.193 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:36:19.204 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:36:19.803 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:19.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.865+0000 7f07ff1f0700 1 Processor -- start 2019-11-28T11:36:19.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.865+0000 7f07ff1f0700 1 -- start start 2019-11-28T11:36:19.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.866+0000 7f07ff1f0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f07f806c0a0 0x7f07f8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:19.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.866+0000 7f07ff1f0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07f80734e0 0x7f07f8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:19.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.866+0000 7f07ff1f0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f806db00 con 0x7f07f8072360 2019-11-28T11:36:19.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.866+0000 7f07ff1f0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f806fd60 con 0x7f07f806c0a0 2019-11-28T11:36:19.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.866+0000 7f07ff1f0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f8070030 con 0x7f07f80734e0 2019-11-28T11:36:19.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.866+0000 7f07fdf8e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f07f8072360 0x7f07f806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35602/0 (socket says 172.21.15.80:35602) 2019-11-28T11:36:19.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.866+0000 7f07fdf8e700 1 -- 172.21.15.80:0/3577521242 learned_addr learned my addr 172.21.15.80:0/3577521242 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:19.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07fd78d700 1 --2- 172.21.15.80:0/3577521242 >> v2:172.21.15.174:3300/0 conn(0x7f07f806c0a0 0x7f07f8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:19.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07fcf8c700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07f80734e0 0x7f07f8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:19.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07f7fff700 1 -- 172.21.15.80:0/3577521242 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903702708 0 0) 0x7f07f0001150 con 0x7f07f8072360 2019-11-28T11:36:19.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07f7fff700 1 -- 172.21.15.80:0/3577521242 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e4002e80 con 0x7f07f8072360 2019-11-28T11:36:19.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07f7fff700 1 -- 172.21.15.80:0/3577521242 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 436260159 0 0) 0x7f07f0001130 con 0x7f07f8072360 2019-11-28T11:36:19.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07f7fff700 1 -- 172.21.15.80:0/3577521242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07f80734e0 msgr2=0x7f07f8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:19.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07f7fff700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07f80734e0 0x7f07f8071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:19.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07f7fff700 1 -- 172.21.15.80:0/3577521242 >> v2:172.21.15.174:3300/0 conn(0x7f07f806c0a0 msgr2=0x7f07f8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:19.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07f7fff700 1 --2- 172.21.15.80:0/3577521242 >> v2:172.21.15.174:3300/0 conn(0x7f07f806c0a0 0x7f07f8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:19.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07f7fff700 1 -- 172.21.15.80:0/3577521242 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f80706c0 con 0x7f07f8072360 2019-11-28T11:36:19.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07f7fff700 1 -- 172.21.15.80:0/3577521242 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f07f0001660 con 0x7f07f8072360 2019-11-28T11:36:19.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07fd78d700 1 --2- 172.21.15.80:0/3577521242 >> v2:172.21.15.174:3300/0 conn(0x7f07f806c0a0 0x7f07f8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:36:19.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07f7fff700 1 -- 172.21.15.80:0/3577521242 >> v1:172.21.15.80:6789/0 conn(0x7f07f8072360 legacy=0x7f07f806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:19.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07f7fff700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e40479a0 0x7f07e4049dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:19.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07f7fff700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e404a5c0 0x7f07e404ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:19.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07f7fff700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07e404d2f0 0x7f07e404f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:19.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07f7fff700 1 -- 172.21.15.80:0/3577521242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e404ff40 con 0x7f07e404a5c0 2019-11-28T11:36:19.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07f7fff700 1 -- 172.21.15.80:0/3577521242 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e4050130 con 0x7f07e40479a0 2019-11-28T11:36:19.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07f7fff700 1 -- 172.21.15.80:0/3577521242 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e4050360 con 0x7f07e404d2f0 2019-11-28T11:36:19.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07fcf8c700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e404a5c0 0x7f07e404ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:19.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07fd78d700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e40479a0 0x7f07e4049dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:19.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07fdf8e700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07e404d2f0 0x7f07e404f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:19.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07fcf8c700 1 -- 172.21.15.80:0/3577521242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07e404d2f0 msgr2=0x7f07e404f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:19.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07fcf8c700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07e404d2f0 0x7f07e404f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:19.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07fcf8c700 1 -- 172.21.15.80:0/3577521242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e40479a0 msgr2=0x7f07e4049dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:19.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07fcf8c700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e40479a0 0x7f07e4049dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:19.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07fcf8c700 1 -- 172.21.15.80:0/3577521242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e4050610 con 0x7f07e404a5c0 2019-11-28T11:36:19.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07fcf8c700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e404a5c0 0x7f07e404ca90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f07e800b370 tx=0x7f07e800b240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:19.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07fcf8c700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e404a5c0 0x7f07e404ca90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f07e800b370 tx=0x7f07e800b240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:19.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.867+0000 7f07fcf8c700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e404a5c0 0x7f07e404ca90 secure :-1 s=READY pgs=1029 cs=0 l=1 rx=0x7f07e800b370 tx=0x7f07e800b240).ready entity=mon.0 client_cookie=4f22a6149b01d732 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:19.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.868+0000 7f07fcf8c700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e404a5c0 0x7f07e404ca90 secure :-1 s=THROTTLE_DONE pgs=1029 cs=0 l=1 rx=0x7f07e800b370 tx=0x7f07e800b240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:19.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.868+0000 7f07fcf8c700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e404a5c0 0x7f07e404ca90 secure :-1 s=THROTTLE_DONE pgs=1029 cs=0 l=1 rx=0x7f07e800b370 tx=0x7f07e800b240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:19.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.868+0000 7f07f7fff700 1 -- 172.21.15.80:0/3577521242 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07e8008ac0 con 0x7f07e404a5c0 2019-11-28T11:36:19.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.868+0000 7f07fcf8c700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e404a5c0 0x7f07e404ca90 secure :-1 s=THROTTLE_DONE pgs=1029 cs=0 l=1 rx=0x7f07e800b370 tx=0x7f07e800b240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:19.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.868+0000 7f07f7fff700 1 -- 172.21.15.80:0/3577521242 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e80086e0 con 0x7f07e404a5c0 2019-11-28T11:36:19.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.868+0000 7f07f7fff700 1 -- 172.21.15.80:0/3577521242 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07e80090a0 con 0x7f07e404a5c0 2019-11-28T11:36:19.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.868+0000 7f07ff1f0700 1 -- 172.21.15.80:0/3577521242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e404a5c0 msgr2=0x7f07e404ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:19.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.868+0000 7f07ff1f0700 1 --2- 172.21.15.80:0/3577521242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07e404a5c0 0x7f07e404ca90 secure :-1 s=READY pgs=1029 cs=0 l=1 rx=0x7f07e800b370 tx=0x7f07e800b240).stop 2019-11-28T11:36:19.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.868+0000 7f07fdf8e700 1 -- 172.21.15.80:0/3577521242 reap_dead start 2019-11-28T11:36:19.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.868+0000 7f07ff1f0700 1 -- 172.21.15.80:0/3577521242 shutdown_connections 2019-11-28T11:36:19.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.868+0000 7f07ff1f0700 1 -- 172.21.15.80:0/3577521242 shutdown_connections 2019-11-28T11:36:19.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.868+0000 7f07ff1f0700 1 -- 172.21.15.80:0/3577521242 wait complete. 2019-11-28T11:36:19.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.868+0000 7f07ff1f0700 1 -- 172.21.15.80:0/3577521242 >> 172.21.15.80:0/3577521242 conn(0x7f07f8061cf0 msgr2=0x7f07f8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:19.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.871+0000 7f07ff1f0700 1 Processor -- start 2019-11-28T11:36:19.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.871+0000 7f07ff1f0700 1 -- start start 2019-11-28T11:36:19.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.872+0000 7f07ff1f0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07f81061f0 0x7f07f810f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:19.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.872+0000 7f07ff1f0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f07f813a350 0x7f07f813a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:19.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.872+0000 7f07ff1f0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f8107940 con 0x7f07f813ad20 2019-11-28T11:36:19.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.872+0000 7f07ff1f0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f813b1a0 con 0x7f07f81061f0 2019-11-28T11:36:19.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.872+0000 7f07ff1f0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f810c300 con 0x7f07f813a350 2019-11-28T11:36:19.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.872+0000 7f07fd78d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07f81061f0 0x7f07f810f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:19.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.872+0000 7f07fd78d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07f81061f0 0x7f07f810f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36296/0 (socket says 172.21.15.80:36296) 2019-11-28T11:36:19.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.872+0000 7f07fd78d700 1 -- 172.21.15.80:0/1355707039 learned_addr learned my addr 172.21.15.80:0/1355707039 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:19.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.872+0000 7f07fcf8c700 1 --2- 172.21.15.80:0/1355707039 >> v2:172.21.15.174:3300/0 conn(0x7f07f813a350 0x7f07f813a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:19.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.872+0000 7f07fd78d700 1 -- 172.21.15.80:0/1355707039 >> v2:172.21.15.174:3300/0 conn(0x7f07f813a350 msgr2=0x7f07f813a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:19.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.872+0000 7f07fd78d700 1 --2- 172.21.15.80:0/1355707039 >> v2:172.21.15.174:3300/0 conn(0x7f07f813a350 0x7f07f813a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:19.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.872+0000 7f07fd78d700 1 -- 172.21.15.80:0/1355707039 >> v1:172.21.15.174:6789/0 conn(0x7f07f813ad20 legacy=0x7f07f810e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:19.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.872+0000 7f07fd78d700 1 -- 172.21.15.80:0/1355707039 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f810cc60 con 0x7f07f81061f0 2019-11-28T11:36:19.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.872+0000 7f07fd78d700 1 --2- 172.21.15.80:0/1355707039 >> v2:172.21.15.80:3300/0 conn(0x7f07f81061f0 0x7f07f810f520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f07e00107a0 tx=0x7f07e0010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:19.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.872+0000 7f07fd78d700 1 --2- 172.21.15.80:0/1355707039 >> v2:172.21.15.80:3300/0 conn(0x7f07f81061f0 0x7f07f810f520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f07e00107a0 tx=0x7f07e0010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:19.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.872+0000 7f07fd78d700 1 --2- 172.21.15.80:0/1355707039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f81061f0 0x7f07f810f520 secure :-1 s=READY pgs=1030 cs=0 l=1 rx=0x7f07e00107a0 tx=0x7f07e0010620).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:19.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.873+0000 7f07fd78d700 1 --2- 172.21.15.80:0/1355707039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f81061f0 0x7f07f810f520 secure :-1 s=THROTTLE_DONE pgs=1030 cs=0 l=1 rx=0x7f07e00107a0 tx=0x7f07e0010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:19.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.873+0000 7f07fd78d700 1 --2- 172.21.15.80:0/1355707039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f81061f0 0x7f07f810f520 secure :-1 s=THROTTLE_DONE pgs=1030 cs=0 l=1 rx=0x7f07e00107a0 tx=0x7f07e0010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:19.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.873+0000 7f07fd78d700 1 --2- 172.21.15.80:0/1355707039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f81061f0 0x7f07f810f520 secure :-1 s=THROTTLE_DONE pgs=1030 cs=0 l=1 rx=0x7f07e00107a0 tx=0x7f07e0010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:19.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.873+0000 7f07f5ffb700 1 -- 172.21.15.80:0/1355707039 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07e0000ce0 con 0x7f07f81061f0 2019-11-28T11:36:19.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.873+0000 7f07f5ffb700 1 -- 172.21.15.80:0/1355707039 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e000f3e0 con 0x7f07f81061f0 2019-11-28T11:36:19.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.873+0000 7f07ff1f0700 1 -- 172.21.15.80:0/1355707039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f810cfe0 con 0x7f07f81061f0 2019-11-28T11:36:19.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.873+0000 7f07f5ffb700 1 -- 172.21.15.80:0/1355707039 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07e000fa30 con 0x7f07f81061f0 2019-11-28T11:36:19.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.873+0000 7f07ff1f0700 1 -- 172.21.15.80:0/1355707039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f810cc60 con 0x7f07f81061f0 2019-11-28T11:36:19.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.873+0000 7f07fd78d700 1 --2- 172.21.15.80:0/1355707039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f81061f0 0x7f07f810f520 secure :-1 s=THROTTLE_DONE pgs=1030 cs=0 l=1 rx=0x7f07e00107a0 tx=0x7f07e0010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:19.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.873+0000 7f07f5ffb700 1 -- 172.21.15.80:0/1355707039 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f07e000efc0 con 0x7f07f81061f0 2019-11-28T11:36:19.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.873+0000 7f07fd78d700 1 --2- 172.21.15.80:0/1355707039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f81061f0 0x7f07f810f520 secure :-1 s=THROTTLE_DONE pgs=1030 cs=0 l=1 rx=0x7f07e00107a0 tx=0x7f07e0010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:19.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.873+0000 7f07f5ffb700 1 --2- 172.21.15.80:0/1355707039 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07dc018730 0x7f07dc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:19.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.873+0000 7f07f5ffb700 1 -- 172.21.15.80:0/1355707039 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f07e0031ef0 con 0x7f07f81061f0 2019-11-28T11:36:19.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.874+0000 7f07fcf8c700 1 --2- 172.21.15.80:0/1355707039 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07dc018730 0x7f07dc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:19.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.874+0000 7f07fcf8c700 1 --2- 172.21.15.80:0/1355707039 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07dc018730 0x7f07dc01abc0 crc :-1 s=READY pgs=420 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:19.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.880+0000 7f07ff1f0700 1 -- 172.21.15.80:0/1355707039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f810cfe0 con 0x7f07f81061f0 2019-11-28T11:36:19.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.884+0000 7f07fd78d700 1 --2- 172.21.15.80:0/1355707039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f81061f0 0x7f07f810f520 secure :-1 s=THROTTLE_DONE pgs=1030 cs=0 l=1 rx=0x7f07e00107a0 tx=0x7f07e0010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:19.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:19.884+0000 7f07f5ffb700 1 -- 172.21.15.80:0/1355707039 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f07e000fcf0 con 0x7f07f81061f0 2019-11-28T11:36:20.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:20.056+0000 7f07ff1f0700 1 -- 172.21.15.80:0/1355707039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07f810cc60 con 0x7f07f81061f0 2019-11-28T11:36:20.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:20.057+0000 7f07fd78d700 1 --2- 172.21.15.80:0/1355707039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f81061f0 0x7f07f810f520 secure :-1 s=THROTTLE_DONE pgs=1030 cs=0 l=1 rx=0x7f07e00107a0 tx=0x7f07e0010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:20.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:20.057+0000 7f07f5ffb700 1 -- 172.21.15.80:0/1355707039 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f07e000f3e0 con 0x7f07f81061f0 2019-11-28T11:36:20.120 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:20.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:20.059+0000 7f07ff1f0700 1 -- 172.21.15.80:0/1355707039 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07dc018730 msgr2=0x7f07dc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:20.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:20.059+0000 7f07ff1f0700 1 --2- 172.21.15.80:0/1355707039 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07dc018730 0x7f07dc01abc0 crc :-1 s=READY pgs=420 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:20.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:20.059+0000 7f07ff1f0700 1 -- 172.21.15.80:0/1355707039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f81061f0 msgr2=0x7f07f810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:20.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:20.059+0000 7f07ff1f0700 1 --2- 172.21.15.80:0/1355707039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f81061f0 0x7f07f810f520 secure :-1 s=READY pgs=1030 cs=0 l=1 rx=0x7f07e00107a0 tx=0x7f07e0010620).stop 2019-11-28T11:36:20.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:20.059+0000 7f07ff1f0700 1 -- 172.21.15.80:0/1355707039 shutdown_connections 2019-11-28T11:36:20.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:20.059+0000 7f07ff1f0700 1 --2- 172.21.15.80:0/1355707039 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f07dc018730 0x7f07dc01abc0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:20.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:20.059+0000 7f07ff1f0700 1 --2- 172.21.15.80:0/1355707039 >> v2:172.21.15.174:3300/0 conn(0x7f07f813a350 0x7f07f813a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:20.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:20.059+0000 7f07ff1f0700 1 --2- 172.21.15.80:0/1355707039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f81061f0 0x7f07f810f520 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:20.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:20.059+0000 7f07ff1f0700 1 -- 172.21.15.80:0/1355707039 shutdown_connections 2019-11-28T11:36:20.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:20.059+0000 7f07ff1f0700 1 -- 172.21.15.80:0/1355707039 wait complete. 2019-11-28T11:36:20.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:20.059+0000 7f07ff1f0700 1 -- 172.21.15.80:0/1355707039 >> 172.21.15.80:0/1355707039 conn(0x7f07f8142090 msgr2=0x7f07f810ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:20.126 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:20.126 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:20.128 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:21.128 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:21.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.208+0000 7f17de6ed700 1 Processor -- start 2019-11-28T11:36:21.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.208+0000 7f17de6ed700 1 -- start start 2019-11-28T11:36:21.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.209+0000 7f17de6ed700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d806c490 0x7f17d806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:21.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.209+0000 7f17de6ed700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f17d806ce60 0x7f17d8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:21.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.209+0000 7f17de6ed700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d806db00 con 0x7f17d806c0a0 2019-11-28T11:36:21.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.209+0000 7f17de6ed700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d806fd60 con 0x7f17d806ce60 2019-11-28T11:36:21.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.209+0000 7f17de6ed700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d8070030 con 0x7f17d806c490 2019-11-28T11:36:21.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17d7fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d806c490 0x7f17d806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:21.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17dd48b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f17d806ce60 0x7f17d8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:21.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17dd48b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f17d806ce60 0x7f17d8164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:51194/0 (socket says 172.21.15.80:51194) 2019-11-28T11:36:21.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17d7fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d806c490 0x7f17d806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:38566/0 (socket says 172.21.15.80:38566) 2019-11-28T11:36:21.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17dcc8a700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f17d806c0a0 0x7f17d8072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:51164/0 (socket says 172.21.15.80:51164) 2019-11-28T11:36:21.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17dd48b700 1 -- 172.21.15.80:0/1334229429 learned_addr learned my addr 172.21.15.80:0/1334229429 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:21.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17dd48b700 1 -- 172.21.15.80:0/1334229429 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d806c490 msgr2=0x7f17d806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:21.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17dd48b700 1 --2- 172.21.15.80:0/1334229429 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d806c490 0x7f17d806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:21.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17dd48b700 1 -- 172.21.15.80:0/1334229429 >> v1:172.21.15.174:6789/0 conn(0x7f17d806c0a0 legacy=0x7f17d8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:21.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17dd48b700 1 -- 172.21.15.80:0/1334229429 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d80706c0 con 0x7f17d806ce60 2019-11-28T11:36:21.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17d77fe700 1 -- 172.21.15.80:0/1334229429 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045404495 0 0) 0x7f17c0001080 con 0x7f17d806c0a0 2019-11-28T11:36:21.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17d7fff700 1 --2- 172.21.15.80:0/1334229429 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d806c490 0x7f17d806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:21.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17dd48b700 1 --2- 172.21.15.80:0/1334229429 >> v2:172.21.15.174:3300/0 conn(0x7f17d806ce60 0x7f17d8164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f17d000f760 tx=0x7f17d000fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:21.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17dd48b700 1 --2- 172.21.15.80:0/1334229429 >> v2:172.21.15.174:3300/0 conn(0x7f17d806ce60 0x7f17d8164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f17d000f760 tx=0x7f17d000fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:21.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17dd48b700 1 --2- 172.21.15.80:0/1334229429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d806ce60 0x7f17d8164d70 secure :-1 s=READY pgs=616 cs=0 l=1 rx=0x7f17d000f760 tx=0x7f17d000fb00).ready entity=mon.1 client_cookie=de47e05c0899a4bc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:21.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17dd48b700 1 --2- 172.21.15.80:0/1334229429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d806ce60 0x7f17d8164d70 secure :-1 s=THROTTLE_DONE pgs=616 cs=0 l=1 rx=0x7f17d000f760 tx=0x7f17d000fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:21.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17d77fe700 1 -- 172.21.15.80:0/1334229429 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17d0000a70 con 0x7f17d806ce60 2019-11-28T11:36:21.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17dd48b700 1 --2- 172.21.15.80:0/1334229429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d806ce60 0x7f17d8164d70 secure :-1 s=THROTTLE_DONE pgs=616 cs=0 l=1 rx=0x7f17d000f760 tx=0x7f17d000fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:21.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17dd48b700 1 --2- 172.21.15.80:0/1334229429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d806ce60 0x7f17d8164d70 secure :-1 s=THROTTLE_DONE pgs=616 cs=0 l=1 rx=0x7f17d000f760 tx=0x7f17d000fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:21.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.210+0000 7f17d77fe700 1 -- 172.21.15.80:0/1334229429 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d0000e70 con 0x7f17d806ce60 2019-11-28T11:36:21.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.211+0000 7f17d77fe700 1 -- 172.21.15.80:0/1334229429 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17d0001500 con 0x7f17d806ce60 2019-11-28T11:36:21.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.211+0000 7f17de6ed700 1 -- 172.21.15.80:0/1334229429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d806ce60 msgr2=0x7f17d8164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:21.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.211+0000 7f17de6ed700 1 --2- 172.21.15.80:0/1334229429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d806ce60 0x7f17d8164d70 secure :-1 s=READY pgs=616 cs=0 l=1 rx=0x7f17d000f760 tx=0x7f17d000fb00).stop 2019-11-28T11:36:21.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.211+0000 7f17de6ed700 1 -- 172.21.15.80:0/1334229429 shutdown_connections 2019-11-28T11:36:21.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.211+0000 7f17de6ed700 1 --2- 172.21.15.80:0/1334229429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d806ce60 0x7f17d8164d70 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:21.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.211+0000 7f17de6ed700 1 --2- 172.21.15.80:0/1334229429 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17d806c490 0x7f17d806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:21.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.211+0000 7f17de6ed700 1 -- 172.21.15.80:0/1334229429 shutdown_connections 2019-11-28T11:36:21.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.211+0000 7f17de6ed700 1 -- 172.21.15.80:0/1334229429 wait complete. 2019-11-28T11:36:21.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.211+0000 7f17de6ed700 1 -- 172.21.15.80:0/1334229429 >> 172.21.15.80:0/1334229429 conn(0x7f17d8061cf0 msgr2=0x7f17d8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:21.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.214+0000 7f17de6ed700 1 Processor -- start 2019-11-28T11:36:21.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.214+0000 7f17de6ed700 1 -- start start 2019-11-28T11:36:21.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17de6ed700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f17d813a780 0x7f17d812d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:21.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17de6ed700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17d812cb00 0x7f17d8167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:21.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17de6ed700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d8139a60 con 0x7f17d812d9c0 2019-11-28T11:36:21.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17de6ed700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d812a260 con 0x7f17d812cb00 2019-11-28T11:36:21.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17de6ed700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d812a530 con 0x7f17d813a780 2019-11-28T11:36:21.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17dd48b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17d812cb00 0x7f17d8167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:21.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17dcc8a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f17d813a780 0x7f17d812d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:21.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17d7fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f17d812d9c0 0x7f17d812c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:51172/0 (socket says 172.21.15.80:51172) 2019-11-28T11:36:21.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17d7fff700 1 -- 172.21.15.80:0/1725747071 learned_addr learned my addr 172.21.15.80:0/1725747071 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:21.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17d57fa700 1 -- 172.21.15.80:0/1725747071 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338457416 0 0) 0x7f17c800df00 con 0x7f17d812d9c0 2019-11-28T11:36:21.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17d57fa700 1 -- 172.21.15.80:0/1725747071 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17bc002e80 con 0x7f17d812d9c0 2019-11-28T11:36:21.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17dcc8a700 1 -- 172.21.15.80:0/1725747071 >> v2:172.21.15.80:3300/0 conn(0x7f17d812cb00 msgr2=0x7f17d8167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:21.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17dcc8a700 1 --2- 172.21.15.80:0/1725747071 >> v2:172.21.15.80:3300/0 conn(0x7f17d812cb00 0x7f17d8167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:21.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17dcc8a700 1 -- 172.21.15.80:0/1725747071 >> v1:172.21.15.174:6789/0 conn(0x7f17d812d9c0 legacy=0x7f17d812c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:21.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17dcc8a700 1 -- 172.21.15.80:0/1725747071 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d812abc0 con 0x7f17d813a780 2019-11-28T11:36:21.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17dd48b700 1 --2- 172.21.15.80:0/1725747071 >> v2:172.21.15.80:3300/0 conn(0x7f17d812cb00 0x7f17d8167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:21.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.215+0000 7f17dcc8a700 1 --2- 172.21.15.80:0/1725747071 >> v2:172.21.15.174:3300/0 conn(0x7f17d813a780 0x7f17d812d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f17c0010370 tx=0x7f17c0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:21.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.216+0000 7f17dcc8a700 1 --2- 172.21.15.80:0/1725747071 >> v2:172.21.15.174:3300/0 conn(0x7f17d813a780 0x7f17d812d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f17c0010370 tx=0x7f17c0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:21.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.216+0000 7f17dcc8a700 1 --2- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d813a780 0x7f17d812d480 secure :-1 s=READY pgs=618 cs=0 l=1 rx=0x7f17c0010370 tx=0x7f17c0010710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:21.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.216+0000 7f17dcc8a700 1 --2- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d813a780 0x7f17d812d480 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f17c0010370 tx=0x7f17c0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:21.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.216+0000 7f17d57fa700 1 -- 172.21.15.80:0/1725747071 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17c0000e50 con 0x7f17d813a780 2019-11-28T11:36:21.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.216+0000 7f17dcc8a700 1 --2- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d813a780 0x7f17d812d480 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f17c0010370 tx=0x7f17c0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:21.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.216+0000 7f17dcc8a700 1 --2- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d813a780 0x7f17d812d480 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f17c0010370 tx=0x7f17c0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:21.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.216+0000 7f17d57fa700 1 -- 172.21.15.80:0/1725747071 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c00043b0 con 0x7f17d813a780 2019-11-28T11:36:21.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.216+0000 7f17d57fa700 1 -- 172.21.15.80:0/1725747071 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17c0000e50 con 0x7f17d813a780 2019-11-28T11:36:21.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.216+0000 7f17de6ed700 1 -- 172.21.15.80:0/1725747071 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d812af40 con 0x7f17d813a780 2019-11-28T11:36:21.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.216+0000 7f17de6ed700 1 -- 172.21.15.80:0/1725747071 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d812abc0 con 0x7f17d813a780 2019-11-28T11:36:21.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.216+0000 7f17dcc8a700 1 --2- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d813a780 0x7f17d812d480 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f17c0010370 tx=0x7f17c0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:21.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.217+0000 7f17d57fa700 1 -- 172.21.15.80:0/1725747071 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f17c00045a0 con 0x7f17d813a780 2019-11-28T11:36:21.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.217+0000 7f17dcc8a700 1 --2- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d813a780 0x7f17d812d480 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f17c0010370 tx=0x7f17c0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:21.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.217+0000 7f17d57fa700 1 --2- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17bc018770 0x7f17bc01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:21.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.217+0000 7f17d57fa700 1 -- 172.21.15.80:0/1725747071 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f17c0031a10 con 0x7f17d813a780 2019-11-28T11:36:21.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.217+0000 7f17d7fff700 1 --2- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17bc018770 0x7f17bc01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:21.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.217+0000 7f17d7fff700 1 --2- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17bc018770 0x7f17bc01abe0 crc :-1 s=READY pgs=421 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:21.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.224+0000 7f17de6ed700 1 -- 172.21.15.80:0/1725747071 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d812af40 con 0x7f17d813a780 2019-11-28T11:36:21.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.227+0000 7f17dcc8a700 1 --2- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d813a780 0x7f17d812d480 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f17c0010370 tx=0x7f17c0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:21.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.227+0000 7f17d57fa700 1 -- 172.21.15.80:0/1725747071 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f17c0001220 con 0x7f17d813a780 2019-11-28T11:36:21.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.400+0000 7f17de6ed700 1 -- 172.21.15.80:0/1725747071 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17d812abc0 con 0x7f17d813a780 2019-11-28T11:36:21.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.401+0000 7f17dcc8a700 1 --2- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d813a780 0x7f17d812d480 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f17c0010370 tx=0x7f17c0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:21.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.401+0000 7f17d57fa700 1 -- 172.21.15.80:0/1725747071 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f17c00045a0 con 0x7f17d813a780 2019-11-28T11:36:21.472 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:21.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.403+0000 7f17de6ed700 1 -- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17bc018770 msgr2=0x7f17bc01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:21.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.403+0000 7f17de6ed700 1 --2- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17bc018770 0x7f17bc01abe0 crc :-1 s=READY pgs=421 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:21.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.403+0000 7f17de6ed700 1 -- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d813a780 msgr2=0x7f17d812d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:21.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.403+0000 7f17de6ed700 1 --2- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d813a780 0x7f17d812d480 secure :-1 s=READY pgs=618 cs=0 l=1 rx=0x7f17c0010370 tx=0x7f17c0010710).stop 2019-11-28T11:36:21.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.403+0000 7f17de6ed700 1 -- 172.21.15.80:0/1725747071 shutdown_connections 2019-11-28T11:36:21.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.403+0000 7f17de6ed700 1 --2- 172.21.15.80:0/1725747071 >> v2:172.21.15.80:3300/0 conn(0x7f17d812cb00 0x7f17d8167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:21.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.403+0000 7f17de6ed700 1 --2- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17bc018770 0x7f17bc01abe0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:21.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.403+0000 7f17de6ed700 1 --2- 172.21.15.80:0/1725747071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17d813a780 0x7f17d812d480 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:21.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.403+0000 7f17de6ed700 1 -- 172.21.15.80:0/1725747071 shutdown_connections 2019-11-28T11:36:21.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.403+0000 7f17de6ed700 1 -- 172.21.15.80:0/1725747071 wait complete. 2019-11-28T11:36:21.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:21.403+0000 7f17de6ed700 1 -- 172.21.15.80:0/1725747071 >> 172.21.15.80:0/1725747071 conn(0x7f17d8127dc0 msgr2=0x7f17d8141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:21.475 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:21.475 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:21.476 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:22.481 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:22.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.555+0000 7efd3663d700 1 Processor -- start 2019-11-28T11:36:22.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.555+0000 7efd3663d700 1 -- start start 2019-11-28T11:36:22.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.556+0000 7efd3663d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efd3006c0a0 0x7efd30072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:22.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.556+0000 7efd3663d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3006db00 con 0x7efd30072620 2019-11-28T11:36:22.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.556+0000 7efd3663d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3006e000 con 0x7efd300734e0 2019-11-28T11:36:22.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.556+0000 7efd3663d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd3006fd60 con 0x7efd3006c0a0 2019-11-28T11:36:22.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.556+0000 7efd34bda700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efd3006c0a0 0x7efd30072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:22.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.556+0000 7efd34bda700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efd3006c0a0 0x7efd30072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36318/0 (socket says 172.21.15.80:36318) 2019-11-28T11:36:22.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.556+0000 7efd353db700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efd30072620 0x7efd30164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35636/0 (socket says 172.21.15.80:35636) 2019-11-28T11:36:22.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.556+0000 7efd34bda700 1 -- 172.21.15.80:0/3231306478 learned_addr learned my addr 172.21.15.80:0/3231306478 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:22.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.557+0000 7efd34bda700 1 -- 172.21.15.80:0/3231306478 >> v1:172.21.15.174:6789/0 conn(0x7efd300734e0 legacy=0x7efd30071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:22.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.557+0000 7efd34bda700 1 -- 172.21.15.80:0/3231306478 >> v1:172.21.15.80:6789/0 conn(0x7efd30072620 legacy=0x7efd30164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:22.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.557+0000 7efd34bda700 1 -- 172.21.15.80:0/3231306478 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300706c0 con 0x7efd3006c0a0 2019-11-28T11:36:22.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.557+0000 7efd2f7fe700 1 -- 172.21.15.80:0/3231306478 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277012393 0 0) 0x7efd28000d30 con 0x7efd30072620 2019-11-28T11:36:22.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.557+0000 7efd34bda700 1 --2- 172.21.15.80:0/3231306478 >> v2:172.21.15.80:3300/0 conn(0x7efd3006c0a0 0x7efd30072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efd2000f740 tx=0x7efd2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:22.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.557+0000 7efd34bda700 1 --2- 172.21.15.80:0/3231306478 >> v2:172.21.15.80:3300/0 conn(0x7efd3006c0a0 0x7efd30072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efd2000f740 tx=0x7efd2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:22.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.557+0000 7efd34bda700 1 --2- 172.21.15.80:0/3231306478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd3006c0a0 0x7efd30072fa0 secure :-1 s=READY pgs=1032 cs=0 l=1 rx=0x7efd2000f740 tx=0x7efd2000fae0).ready entity=mon.0 client_cookie=ad59a8e07d587166 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:22.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.557+0000 7efd34bda700 1 --2- 172.21.15.80:0/3231306478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd3006c0a0 0x7efd30072fa0 secure :-1 s=THROTTLE_DONE pgs=1032 cs=0 l=1 rx=0x7efd2000f740 tx=0x7efd2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:22.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.557+0000 7efd2f7fe700 1 -- 172.21.15.80:0/3231306478 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd20000960 con 0x7efd3006c0a0 2019-11-28T11:36:22.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.557+0000 7efd34bda700 1 --2- 172.21.15.80:0/3231306478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd3006c0a0 0x7efd30072fa0 secure :-1 s=THROTTLE_DONE pgs=1032 cs=0 l=1 rx=0x7efd2000f740 tx=0x7efd2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:22.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.557+0000 7efd2f7fe700 1 -- 172.21.15.80:0/3231306478 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd20000c90 con 0x7efd3006c0a0 2019-11-28T11:36:22.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.557+0000 7efd34bda700 1 --2- 172.21.15.80:0/3231306478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd3006c0a0 0x7efd30072fa0 secure :-1 s=THROTTLE_DONE pgs=1032 cs=0 l=1 rx=0x7efd2000f740 tx=0x7efd2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:22.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.557+0000 7efd2f7fe700 1 -- 172.21.15.80:0/3231306478 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd20007210 con 0x7efd3006c0a0 2019-11-28T11:36:22.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.557+0000 7efd3663d700 1 -- 172.21.15.80:0/3231306478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd3006c0a0 msgr2=0x7efd30072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:22.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.557+0000 7efd3663d700 1 --2- 172.21.15.80:0/3231306478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd3006c0a0 0x7efd30072fa0 secure :-1 s=READY pgs=1032 cs=0 l=1 rx=0x7efd2000f740 tx=0x7efd2000fae0).stop 2019-11-28T11:36:22.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.558+0000 7efd3663d700 1 -- 172.21.15.80:0/3231306478 shutdown_connections 2019-11-28T11:36:22.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.558+0000 7efd3663d700 1 --2- 172.21.15.80:0/3231306478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd3006c0a0 0x7efd30072fa0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:22.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.558+0000 7efd3663d700 1 -- 172.21.15.80:0/3231306478 shutdown_connections 2019-11-28T11:36:22.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.558+0000 7efd3663d700 1 -- 172.21.15.80:0/3231306478 wait complete. 2019-11-28T11:36:22.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.558+0000 7efd3663d700 1 -- 172.21.15.80:0/3231306478 >> 172.21.15.80:0/3231306478 conn(0x7efd30061cf0 msgr2=0x7efd30064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:22.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.560+0000 7efd3663d700 1 Processor -- start 2019-11-28T11:36:22.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.560+0000 7efd3663d700 1 -- start start 2019-11-28T11:36:22.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.561+0000 7efd3663d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efd30166a10 0x7efd30168e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:22.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.561+0000 7efd3663d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd30124260 con 0x7efd3012cea0 2019-11-28T11:36:22.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.561+0000 7efd3663d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3012e5d0 con 0x7efd30111db0 2019-11-28T11:36:22.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.561+0000 7efd3663d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd30121040 con 0x7efd30166a10 2019-11-28T11:36:22.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.561+0000 7efd34bda700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efd3012cea0 0x7efd301230e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35638/0 (socket says 172.21.15.80:35638) 2019-11-28T11:36:22.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.561+0000 7efd34bda700 1 -- 172.21.15.80:0/3836985700 learned_addr learned my addr 172.21.15.80:0/3836985700 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:22.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.561+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036356493 0 0) 0x7efd200075d0 con 0x7efd3012cea0 2019-11-28T11:36:22.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.561+0000 7efd353db700 1 --2- 172.21.15.80:0/3836985700 >> v2:172.21.15.174:3300/0 conn(0x7efd30166a10 0x7efd30168e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:22.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.561+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd14002e80 con 0x7efd3012cea0 2019-11-28T11:36:22.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2014892003 0 0) 0x7efd200079e0 con 0x7efd3012cea0 2019-11-28T11:36:22.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efd140032e0 con 0x7efd3012cea0 2019-11-28T11:36:22.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7efd20000940 con 0x7efd3012cea0 2019-11-28T11:36:22.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 >> v2:172.21.15.174:3300/0 conn(0x7efd30166a10 msgr2=0x7efd30168e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:22.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2d7fa700 1 --2- 172.21.15.80:0/3836985700 >> v2:172.21.15.174:3300/0 conn(0x7efd30166a10 0x7efd30168e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:22.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 >> v1:172.21.15.174:6789/0 conn(0x7efd30111db0 legacy=0x7efd301238e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:22.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 >> v1:172.21.15.80:6789/0 conn(0x7efd3012cea0 legacy=0x7efd301230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:22.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2d7fa700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd140036d0 0x7efd14003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:22.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2d7fa700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd14004020 0x7efd140044e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:22.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2d7fa700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd14004bf0 0x7efd1400b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:22.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd14005320 con 0x7efd14004bf0 2019-11-28T11:36:22.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1400dfe0 con 0x7efd14004020 2019-11-28T11:36:22.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1400e210 con 0x7efd140036d0 2019-11-28T11:36:22.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd353db700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd14004bf0 0x7efd1400b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:22.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd34bda700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd140036d0 0x7efd14003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:22.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2ffff700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd14004020 0x7efd140044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:22.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd353db700 1 -- 172.21.15.80:0/3836985700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd140036d0 msgr2=0x7efd14003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:22.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd353db700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd140036d0 0x7efd14003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:22.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd353db700 1 -- 172.21.15.80:0/3836985700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd14004020 msgr2=0x7efd140044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:22.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd353db700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd14004020 0x7efd140044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd353db700 1 -- 172.21.15.80:0/3836985700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1400e4c0 con 0x7efd14004bf0 2019-11-28T11:36:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd34bda700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd140036d0 0x7efd14003ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:36:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd3663d700 1 -- 172.21.15.80:0/3836985700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd30121d20 con 0x7efd14004bf0 2019-11-28T11:36:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd353db700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd14004bf0 0x7efd1400b890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efd28010950 tx=0x7efd28010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd3663d700 1 -- 172.21.15.80:0/3836985700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd301219a0 con 0x7efd14004bf0 2019-11-28T11:36:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd353db700 1 -- 172.21.15.80:0/3836985700 reap_dead start 2019-11-28T11:36:22.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd353db700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd14004bf0 0x7efd1400b890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efd28010950 tx=0x7efd28010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:22.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd353db700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd14004bf0 0x7efd1400b890 secure :-1 s=READY pgs=1034 cs=0 l=1 rx=0x7efd28010950 tx=0x7efd28010880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:22.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd353db700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd14004bf0 0x7efd1400b890 secure :-1 s=THROTTLE_DONE pgs=1034 cs=0 l=1 rx=0x7efd28010950 tx=0x7efd28010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:22.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd28000cc0 con 0x7efd14004bf0 2019-11-28T11:36:22.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd353db700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd14004bf0 0x7efd1400b890 secure :-1 s=THROTTLE_DONE pgs=1034 cs=0 l=1 rx=0x7efd28010950 tx=0x7efd28010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:22.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd28009af0 con 0x7efd14004bf0 2019-11-28T11:36:22.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd353db700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd14004bf0 0x7efd1400b890 secure :-1 s=THROTTLE_DONE pgs=1034 cs=0 l=1 rx=0x7efd28010950 tx=0x7efd28010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:22.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.562+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd28009ce0 con 0x7efd14004bf0 2019-11-28T11:36:22.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.563+0000 7efd353db700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd14004bf0 0x7efd1400b890 secure :-1 s=THROTTLE_DONE pgs=1034 cs=0 l=1 rx=0x7efd28010950 tx=0x7efd28010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:22.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.563+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efd28000cc0 con 0x7efd14004bf0 2019-11-28T11:36:22.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.563+0000 7efd353db700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd14004bf0 0x7efd1400b890 secure :-1 s=THROTTLE_DONE pgs=1034 cs=0 l=1 rx=0x7efd28010950 tx=0x7efd28010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:22.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.563+0000 7efd2d7fa700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efd1401d6e0 0x7efd1401fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:22.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.563+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7efd28031ea0 con 0x7efd14004bf0 2019-11-28T11:36:22.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.563+0000 7efd34bda700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efd1401d6e0 0x7efd1401fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:22.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.563+0000 7efd34bda700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efd1401d6e0 0x7efd1401fb10 crc :-1 s=READY pgs=422 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:22.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.570+0000 7efd3663d700 1 -- 172.21.15.80:0/3836985700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd08002e60 con 0x7efd14004bf0 2019-11-28T11:36:22.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.574+0000 7efd353db700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd14004bf0 0x7efd1400b890 secure :-1 s=THROTTLE_DONE pgs=1034 cs=0 l=1 rx=0x7efd28010950 tx=0x7efd28010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:22.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.574+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efd2800a940 con 0x7efd14004bf0 2019-11-28T11:36:22.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.747+0000 7efd3663d700 1 -- 172.21.15.80:0/3836985700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd08001d10 con 0x7efd14004bf0 2019-11-28T11:36:22.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.747+0000 7efd353db700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd14004bf0 0x7efd1400b890 secure :-1 s=THROTTLE_DONE pgs=1034 cs=0 l=1 rx=0x7efd28010950 tx=0x7efd28010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:22.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.747+0000 7efd2d7fa700 1 -- 172.21.15.80:0/3836985700 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7efd28000cc0 con 0x7efd14004bf0 2019-11-28T11:36:22.806 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:22.806 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:22.806 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:22.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.749+0000 7efd3663d700 1 -- 172.21.15.80:0/3836985700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efd1401d6e0 msgr2=0x7efd1401fb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:22.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.749+0000 7efd3663d700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efd1401d6e0 0x7efd1401fb10 crc :-1 s=READY pgs=422 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:22.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.749+0000 7efd3663d700 1 -- 172.21.15.80:0/3836985700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd14004bf0 msgr2=0x7efd1400b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:22.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.749+0000 7efd3663d700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd14004bf0 0x7efd1400b890 secure :-1 s=READY pgs=1034 cs=0 l=1 rx=0x7efd28010950 tx=0x7efd28010880).stop 2019-11-28T11:36:22.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.750+0000 7efd3663d700 1 -- 172.21.15.80:0/3836985700 shutdown_connections 2019-11-28T11:36:22.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.750+0000 7efd3663d700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efd1401d6e0 0x7efd1401fb10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:22.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.750+0000 7efd3663d700 1 --2- 172.21.15.80:0/3836985700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd14004bf0 0x7efd1400b890 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:22.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.750+0000 7efd3663d700 1 -- 172.21.15.80:0/3836985700 shutdown_connections 2019-11-28T11:36:22.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.750+0000 7efd3663d700 1 -- 172.21.15.80:0/3836985700 wait complete. 2019-11-28T11:36:22.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:22.750+0000 7efd3663d700 1 -- 172.21.15.80:0/3836985700 >> 172.21.15.80:0/3836985700 conn(0x7efd301426c0 msgr2=0x7efd30110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:22.817 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:23.819 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:23.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.880+0000 7f69431eb700 1 Processor -- start 2019-11-28T11:36:23.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.880+0000 7f69431eb700 1 -- start start 2019-11-28T11:36:23.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.881+0000 7f69431eb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f693c06c0a0 0x7f693c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:23.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.881+0000 7f69431eb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f693c0734e0 0x7f693c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:23.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.881+0000 7f69431eb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693c06db00 con 0x7f693c072360 2019-11-28T11:36:23.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.881+0000 7f69431eb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c06fd60 con 0x7f693c0734e0 2019-11-28T11:36:23.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.881+0000 7f69431eb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c070030 con 0x7f693c06c0a0 2019-11-28T11:36:23.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.881+0000 7f6940f87700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f693c0734e0 0x7f693c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:23.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.881+0000 7f6941f89700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f693c072360 0x7f693c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35654/0 (socket says 172.21.15.80:35654) 2019-11-28T11:36:23.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.881+0000 7f6941f89700 1 -- 172.21.15.80:0/3574117864 learned_addr learned my addr 172.21.15.80:0/3574117864 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:23.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.881+0000 7f6941788700 1 --2- 172.21.15.80:0/3574117864 >> v2:172.21.15.174:3300/0 conn(0x7f693c06c0a0 0x7f693c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:23.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.882+0000 7f6940f87700 1 -- 172.21.15.80:0/3574117864 >> v2:172.21.15.174:3300/0 conn(0x7f693c06c0a0 msgr2=0x7f693c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:23.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.882+0000 7f6940f87700 1 --2- 172.21.15.80:0/3574117864 >> v2:172.21.15.174:3300/0 conn(0x7f693c06c0a0 0x7f693c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:23.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.882+0000 7f6940f87700 1 -- 172.21.15.80:0/3574117864 >> v1:172.21.15.80:6789/0 conn(0x7f693c072360 legacy=0x7f693c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:23.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.882+0000 7f6940f87700 1 -- 172.21.15.80:0/3574117864 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c0706c0 con 0x7f693c0734e0 2019-11-28T11:36:23.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.882+0000 7f693bfff700 1 -- 172.21.15.80:0/3574117864 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870167618 0 0) 0x7f6934001150 con 0x7f693c072360 2019-11-28T11:36:23.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.882+0000 7f6940f87700 1 --2- 172.21.15.80:0/3574117864 >> v2:172.21.15.80:3300/0 conn(0x7f693c0734e0 0x7f693c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f693000af50 tx=0x7f693000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:23.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.882+0000 7f6940f87700 1 --2- 172.21.15.80:0/3574117864 >> v2:172.21.15.80:3300/0 conn(0x7f693c0734e0 0x7f693c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f693000af50 tx=0x7f693000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:23.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.882+0000 7f6940f87700 1 --2- 172.21.15.80:0/3574117864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c0734e0 0x7f693c071e20 secure :-1 s=READY pgs=1036 cs=0 l=1 rx=0x7f693000af50 tx=0x7f693000b6e0).ready entity=mon.0 client_cookie=c8cd5d4c221e3a6e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:23.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.882+0000 7f6940f87700 1 --2- 172.21.15.80:0/3574117864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c0734e0 0x7f693c071e20 secure :-1 s=THROTTLE_DONE pgs=1036 cs=0 l=1 rx=0x7f693000af50 tx=0x7f693000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:23.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.882+0000 7f693bfff700 1 -- 172.21.15.80:0/3574117864 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6930007210 con 0x7f693c0734e0 2019-11-28T11:36:23.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.882+0000 7f6940f87700 1 --2- 172.21.15.80:0/3574117864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c0734e0 0x7f693c071e20 secure :-1 s=THROTTLE_DONE pgs=1036 cs=0 l=1 rx=0x7f693000af50 tx=0x7f693000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:23.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.882+0000 7f6940f87700 1 --2- 172.21.15.80:0/3574117864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c0734e0 0x7f693c071e20 secure :-1 s=THROTTLE_DONE pgs=1036 cs=0 l=1 rx=0x7f693000af50 tx=0x7f693000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:23.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.882+0000 7f693bfff700 1 -- 172.21.15.80:0/3574117864 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69300099b0 con 0x7f693c0734e0 2019-11-28T11:36:23.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.882+0000 7f693bfff700 1 -- 172.21.15.80:0/3574117864 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f693000a080 con 0x7f693c0734e0 2019-11-28T11:36:23.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.882+0000 7f69431eb700 1 -- 172.21.15.80:0/3574117864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c0734e0 msgr2=0x7f693c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:23.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.882+0000 7f69431eb700 1 --2- 172.21.15.80:0/3574117864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c0734e0 0x7f693c071e20 secure :-1 s=READY pgs=1036 cs=0 l=1 rx=0x7f693000af50 tx=0x7f693000b6e0).stop 2019-11-28T11:36:23.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.883+0000 7f69431eb700 1 -- 172.21.15.80:0/3574117864 shutdown_connections 2019-11-28T11:36:23.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.883+0000 7f69431eb700 1 --2- 172.21.15.80:0/3574117864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c0734e0 0x7f693c071e20 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:23.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.883+0000 7f69431eb700 1 --2- 172.21.15.80:0/3574117864 >> v2:172.21.15.174:3300/0 conn(0x7f693c06c0a0 0x7f693c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:23.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.883+0000 7f69431eb700 1 -- 172.21.15.80:0/3574117864 shutdown_connections 2019-11-28T11:36:23.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.883+0000 7f69431eb700 1 -- 172.21.15.80:0/3574117864 wait complete. 2019-11-28T11:36:23.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.883+0000 7f69431eb700 1 -- 172.21.15.80:0/3574117864 >> 172.21.15.80:0/3574117864 conn(0x7f693c061cf0 msgr2=0x7f693c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:23.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.885+0000 7f69431eb700 1 Processor -- start 2019-11-28T11:36:23.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.885+0000 7f69431eb700 1 -- start start 2019-11-28T11:36:23.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.886+0000 7f69431eb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f693c15fdf0 0x7f693c12b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:23.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.886+0000 7f69431eb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f693c12b8a0 0x7f693c13e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:23.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.886+0000 7f69431eb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693c139e00 con 0x7f693c13e860 2019-11-28T11:36:23.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.886+0000 7f69431eb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c108820 con 0x7f693c12b8a0 2019-11-28T11:36:23.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.886+0000 7f69431eb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c108af0 con 0x7f693c15fdf0 2019-11-28T11:36:23.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.886+0000 7f6940f87700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f693c12b8a0 0x7f693c13e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:23.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.886+0000 7f6940f87700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f693c12b8a0 0x7f693c13e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36344/0 (socket says 172.21.15.80:36344) 2019-11-28T11:36:23.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.886+0000 7f6940f87700 1 -- 172.21.15.80:0/4131603897 learned_addr learned my addr 172.21.15.80:0/4131603897 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:23.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.886+0000 7f6941788700 1 --2- 172.21.15.80:0/4131603897 >> v2:172.21.15.174:3300/0 conn(0x7f693c15fdf0 0x7f693c12b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:23.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f6940f87700 1 -- 172.21.15.80:0/4131603897 >> v2:172.21.15.174:3300/0 conn(0x7f693c15fdf0 msgr2=0x7f693c12b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:23.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f6940f87700 1 --2- 172.21.15.80:0/4131603897 >> v2:172.21.15.174:3300/0 conn(0x7f693c15fdf0 0x7f693c12b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:23.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f6940f87700 1 -- 172.21.15.80:0/4131603897 >> v1:172.21.15.80:6789/0 conn(0x7f693c13e860 legacy=0x7f693c12a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:23.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f6940f87700 1 -- 172.21.15.80:0/4131603897 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c10a8c0 con 0x7f693c12b8a0 2019-11-28T11:36:23.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f6939ffb700 1 -- 172.21.15.80:0/4131603897 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762705619 0 0) 0x7f6934000f40 con 0x7f693c13e860 2019-11-28T11:36:23.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f6940f87700 1 --2- 172.21.15.80:0/4131603897 >> v2:172.21.15.80:3300/0 conn(0x7f693c12b8a0 0x7f693c13e320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f69300103d0 tx=0x7f6930010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:23.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f6940f87700 1 --2- 172.21.15.80:0/4131603897 >> v2:172.21.15.80:3300/0 conn(0x7f693c12b8a0 0x7f693c13e320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f69300103d0 tx=0x7f6930010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:23.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f6940f87700 1 --2- 172.21.15.80:0/4131603897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c12b8a0 0x7f693c13e320 secure :-1 s=READY pgs=1038 cs=0 l=1 rx=0x7f69300103d0 tx=0x7f6930010770).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:23.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f6940f87700 1 --2- 172.21.15.80:0/4131603897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c12b8a0 0x7f693c13e320 secure :-1 s=THROTTLE_DONE pgs=1038 cs=0 l=1 rx=0x7f69300103d0 tx=0x7f6930010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:23.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f6939ffb700 1 -- 172.21.15.80:0/4131603897 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6930000940 con 0x7f693c12b8a0 2019-11-28T11:36:23.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f6940f87700 1 --2- 172.21.15.80:0/4131603897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c12b8a0 0x7f693c13e320 secure :-1 s=THROTTLE_DONE pgs=1038 cs=0 l=1 rx=0x7f69300103d0 tx=0x7f6930010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:23.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f6940f87700 1 --2- 172.21.15.80:0/4131603897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c12b8a0 0x7f693c13e320 secure :-1 s=THROTTLE_DONE pgs=1038 cs=0 l=1 rx=0x7f69300103d0 tx=0x7f6930010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:23.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f6939ffb700 1 -- 172.21.15.80:0/4131603897 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6930009980 con 0x7f693c12b8a0 2019-11-28T11:36:23.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f69431eb700 1 -- 172.21.15.80:0/4131603897 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693c10a8c0 con 0x7f693c12b8a0 2019-11-28T11:36:23.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f6939ffb700 1 -- 172.21.15.80:0/4131603897 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f693000a090 con 0x7f693c12b8a0 2019-11-28T11:36:23.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f69431eb700 1 -- 172.21.15.80:0/4131603897 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693c10a8c0 con 0x7f693c12b8a0 2019-11-28T11:36:23.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.887+0000 7f6940f87700 1 --2- 172.21.15.80:0/4131603897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c12b8a0 0x7f693c13e320 secure :-1 s=THROTTLE_DONE pgs=1038 cs=0 l=1 rx=0x7f69300103d0 tx=0x7f6930010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:23.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.888+0000 7f6939ffb700 1 -- 172.21.15.80:0/4131603897 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6930009580 con 0x7f693c12b8a0 2019-11-28T11:36:23.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.888+0000 7f6940f87700 1 --2- 172.21.15.80:0/4131603897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c12b8a0 0x7f693c13e320 secure :-1 s=THROTTLE_DONE pgs=1038 cs=0 l=1 rx=0x7f69300103d0 tx=0x7f6930010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:23.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.888+0000 7f6939ffb700 1 --2- 172.21.15.80:0/4131603897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f691c018730 0x7f691c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:23.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.888+0000 7f6939ffb700 1 -- 172.21.15.80:0/4131603897 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f6930031ab0 con 0x7f693c12b8a0 2019-11-28T11:36:23.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.888+0000 7f6941788700 1 --2- 172.21.15.80:0/4131603897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f691c018730 0x7f691c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:23.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.888+0000 7f6941788700 1 --2- 172.21.15.80:0/4131603897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f691c018730 0x7f691c01abc0 crc :-1 s=READY pgs=423 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:23.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.896+0000 7f69431eb700 1 -- 172.21.15.80:0/4131603897 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693c109180 con 0x7f693c12b8a0 2019-11-28T11:36:23.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.899+0000 7f6940f87700 1 --2- 172.21.15.80:0/4131603897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c12b8a0 0x7f693c13e320 secure :-1 s=THROTTLE_DONE pgs=1038 cs=0 l=1 rx=0x7f69300103d0 tx=0x7f6930010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:23.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:23.899+0000 7f6939ffb700 1 -- 172.21.15.80:0/4131603897 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f69300175d0 con 0x7f693c12b8a0 2019-11-28T11:36:24.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:24.073+0000 7f69431eb700 1 -- 172.21.15.80:0/4131603897 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f693c109500 con 0x7f693c12b8a0 2019-11-28T11:36:24.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:24.073+0000 7f6940f87700 1 --2- 172.21.15.80:0/4131603897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c12b8a0 0x7f693c13e320 secure :-1 s=THROTTLE_DONE pgs=1038 cs=0 l=1 rx=0x7f69300103d0 tx=0x7f6930010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:24.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:24.073+0000 7f6939ffb700 1 -- 172.21.15.80:0/4131603897 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f6930009580 con 0x7f693c12b8a0 2019-11-28T11:36:24.132 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:24.133 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:24.133 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:24.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:24.076+0000 7f69431eb700 1 -- 172.21.15.80:0/4131603897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f691c018730 msgr2=0x7f691c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:24.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:24.076+0000 7f69431eb700 1 --2- 172.21.15.80:0/4131603897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f691c018730 0x7f691c01abc0 crc :-1 s=READY pgs=423 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:24.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:24.076+0000 7f69431eb700 1 -- 172.21.15.80:0/4131603897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c12b8a0 msgr2=0x7f693c13e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:24.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:24.076+0000 7f69431eb700 1 --2- 172.21.15.80:0/4131603897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c12b8a0 0x7f693c13e320 secure :-1 s=READY pgs=1038 cs=0 l=1 rx=0x7f69300103d0 tx=0x7f6930010770).stop 2019-11-28T11:36:24.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:24.076+0000 7f69431eb700 1 -- 172.21.15.80:0/4131603897 shutdown_connections 2019-11-28T11:36:24.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:24.076+0000 7f69431eb700 1 --2- 172.21.15.80:0/4131603897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f691c018730 0x7f691c01abc0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:24.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:24.076+0000 7f69431eb700 1 --2- 172.21.15.80:0/4131603897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c12b8a0 0x7f693c13e320 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:24.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:24.076+0000 7f69431eb700 1 --2- 172.21.15.80:0/4131603897 >> v2:172.21.15.174:3300/0 conn(0x7f693c15fdf0 0x7f693c12b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:24.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:24.076+0000 7f69431eb700 1 -- 172.21.15.80:0/4131603897 shutdown_connections 2019-11-28T11:36:24.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:24.076+0000 7f69431eb700 1 -- 172.21.15.80:0/4131603897 wait complete. 2019-11-28T11:36:24.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:24.076+0000 7f69431eb700 1 -- 172.21.15.80:0/4131603897 >> 172.21.15.80:0/4131603897 conn(0x7f693c127dc0 msgr2=0x7f693c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:24.144 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:25.158 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:25.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.239+0000 7f920ee3a700 1 Processor -- start 2019-11-28T11:36:25.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.240+0000 7f920ee3a700 1 -- start start 2019-11-28T11:36:25.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.240+0000 7f920ee3a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f920806c0a0 0x7f9208072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:25.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.240+0000 7f920ee3a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92080734e0 0x7f9208071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:25.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.240+0000 7f920ee3a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9208072360 0x7f9208072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:25.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.240+0000 7f920ee3a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f920806fd60 con 0x7f9208072360 2019-11-28T11:36:25.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920ee3a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9208070030 con 0x7f920806c0a0 2019-11-28T11:36:25.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920ee3a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920806f330 con 0x7f92080734e0 2019-11-28T11:36:25.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920dbd8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9208072360 0x7f9208072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:25.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920dbd8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9208072360 0x7f9208072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36352/0 (socket says 172.21.15.80:36352) 2019-11-28T11:36:25.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920dbd8700 1 -- 172.21.15.80:0/1478529709 learned_addr learned my addr 172.21.15.80:0/1478529709 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:25.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920d3d7700 1 --2- 172.21.15.80:0/1478529709 >> v2:172.21.15.174:3300/0 conn(0x7f920806c0a0 0x7f9208072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:25.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920cbd6700 1 --2- 172.21.15.80:0/1478529709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92080734e0 0x7f9208071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:25.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920dbd8700 1 -- 172.21.15.80:0/1478529709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92080734e0 msgr2=0x7f9208071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:25.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920dbd8700 1 --2- 172.21.15.80:0/1478529709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92080734e0 0x7f9208071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:25.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920dbd8700 1 -- 172.21.15.80:0/1478529709 >> v2:172.21.15.174:3300/0 conn(0x7f920806c0a0 msgr2=0x7f9208072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:25.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920dbd8700 1 --2- 172.21.15.80:0/1478529709 >> v2:172.21.15.174:3300/0 conn(0x7f920806c0a0 0x7f9208072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:25.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920dbd8700 1 -- 172.21.15.80:0/1478529709 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92080706c0 con 0x7f9208072360 2019-11-28T11:36:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920dbd8700 1 --2- 172.21.15.80:0/1478529709 >> v2:172.21.15.80:3300/0 conn(0x7f9208072360 0x7f9208072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f920000f6b0 tx=0x7f9200007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920dbd8700 1 --2- 172.21.15.80:0/1478529709 >> v2:172.21.15.80:3300/0 conn(0x7f9208072360 0x7f9208072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f920000f6b0 tx=0x7f9200007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920dbd8700 1 --2- 172.21.15.80:0/1478529709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208072360 0x7f9208072800 secure :-1 s=READY pgs=1039 cs=0 l=1 rx=0x7f920000f6b0 tx=0x7f9200007d50).ready entity=mon.0 client_cookie=5ee7cc1a0c73f71c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920dbd8700 1 --2- 172.21.15.80:0/1478529709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208072360 0x7f9208072800 secure :-1 s=THROTTLE_DONE pgs=1039 cs=0 l=1 rx=0x7f920000f6b0 tx=0x7f9200007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f9207fff700 1 -- 172.21.15.80:0/1478529709 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9200000a70 con 0x7f9208072360 2019-11-28T11:36:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920dbd8700 1 --2- 172.21.15.80:0/1478529709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208072360 0x7f9208072800 secure :-1 s=THROTTLE_DONE pgs=1039 cs=0 l=1 rx=0x7f920000f6b0 tx=0x7f9200007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920dbd8700 1 --2- 172.21.15.80:0/1478529709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208072360 0x7f9208072800 secure :-1 s=THROTTLE_DONE pgs=1039 cs=0 l=1 rx=0x7f920000f6b0 tx=0x7f9200007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f9207fff700 1 -- 172.21.15.80:0/1478529709 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92000010e0 con 0x7f9208072360 2019-11-28T11:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f9207fff700 1 -- 172.21.15.80:0/1478529709 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92000012d0 con 0x7f9208072360 2019-11-28T11:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920ee3a700 1 -- 172.21.15.80:0/1478529709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208072360 msgr2=0x7f9208072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.241+0000 7f920ee3a700 1 --2- 172.21.15.80:0/1478529709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208072360 0x7f9208072800 secure :-1 s=READY pgs=1039 cs=0 l=1 rx=0x7f920000f6b0 tx=0x7f9200007d50).stop 2019-11-28T11:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.242+0000 7f920ee3a700 1 -- 172.21.15.80:0/1478529709 shutdown_connections 2019-11-28T11:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.242+0000 7f920ee3a700 1 --2- 172.21.15.80:0/1478529709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9208072360 0x7f9208072800 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.242+0000 7f920ee3a700 1 --2- 172.21.15.80:0/1478529709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92080734e0 0x7f9208071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.242+0000 7f920ee3a700 1 --2- 172.21.15.80:0/1478529709 >> v2:172.21.15.174:3300/0 conn(0x7f920806c0a0 0x7f9208072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.242+0000 7f920ee3a700 1 -- 172.21.15.80:0/1478529709 shutdown_connections 2019-11-28T11:36:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.242+0000 7f920ee3a700 1 -- 172.21.15.80:0/1478529709 wait complete. 2019-11-28T11:36:25.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.242+0000 7f920ee3a700 1 -- 172.21.15.80:0/1478529709 >> 172.21.15.80:0/1478529709 conn(0x7f9208061cf0 msgr2=0x7f9208064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:25.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.245+0000 7f920ee3a700 1 Processor -- start 2019-11-28T11:36:25.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.245+0000 7f920ee3a700 1 -- start start 2019-11-28T11:36:25.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920ee3a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f920813dc00 0x7f9208109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:25.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920ee3a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92081094e0 0x7f9208167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:25.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920ee3a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92081312c0 con 0x7f920810a3a0 2019-11-28T11:36:25.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920ee3a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9208105830 con 0x7f920813dc00 2019-11-28T11:36:25.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920ee3a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9208105b00 con 0x7f92081094e0 2019-11-28T11:36:25.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920dbd8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92081094e0 0x7f9208167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:25.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920d3d7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f920813dc00 0x7f9208109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:25.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920dbd8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92081094e0 0x7f9208167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:38620/0 (socket says 172.21.15.80:38620) 2019-11-28T11:36:25.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920cbd6700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f920810a3a0 0x7f9208108ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:51218/0 (socket says 172.21.15.80:51218) 2019-11-28T11:36:25.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920dbd8700 1 -- 172.21.15.80:0/2933134335 learned_addr learned my addr 172.21.15.80:0/2933134335 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:25.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920dbd8700 1 -- 172.21.15.80:0/2933134335 >> v2:172.21.15.174:3300/0 conn(0x7f920813dc00 msgr2=0x7f9208109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:25.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920dbd8700 1 --2- 172.21.15.80:0/2933134335 >> v2:172.21.15.174:3300/0 conn(0x7f920813dc00 0x7f9208109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:25.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920dbd8700 1 -- 172.21.15.80:0/2933134335 >> v1:172.21.15.174:6789/0 conn(0x7f920810a3a0 legacy=0x7f9208108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:25.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920dbd8700 1 -- 172.21.15.80:0/2933134335 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9208106190 con 0x7f92081094e0 2019-11-28T11:36:25.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920d3d7700 1 --2- 172.21.15.80:0/2933134335 >> v2:172.21.15.174:3300/0 conn(0x7f920813dc00 0x7f9208109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:25.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f9205ffb700 1 -- 172.21.15.80:0/2933134335 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456726487 0 0) 0x7f91f8009790 con 0x7f920810a3a0 2019-11-28T11:36:25.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920dbd8700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92081094e0 0x7f9208167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9200054450 tx=0x7f92000547f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920dbd8700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92081094e0 0x7f9208167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9200054450 tx=0x7f92000547f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.246+0000 7f920dbd8700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92081094e0 0x7f9208167a10 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f9200054450 tx=0x7f92000547f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.247+0000 7f920dbd8700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92081094e0 0x7f9208167a10 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9200054450 tx=0x7f92000547f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.247+0000 7f9205ffb700 1 -- 172.21.15.80:0/2933134335 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92000012b0 con 0x7f92081094e0 2019-11-28T11:36:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.247+0000 7f920dbd8700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92081094e0 0x7f9208167a10 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9200054450 tx=0x7f92000547f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.247+0000 7f920dbd8700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92081094e0 0x7f9208167a10 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9200054450 tx=0x7f92000547f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.247+0000 7f9205ffb700 1 -- 172.21.15.80:0/2933134335 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92000081f0 con 0x7f92081094e0 2019-11-28T11:36:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.247+0000 7f920ee3a700 1 -- 172.21.15.80:0/2933134335 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9208106510 con 0x7f92081094e0 2019-11-28T11:36:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.247+0000 7f9205ffb700 1 -- 172.21.15.80:0/2933134335 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9200001890 con 0x7f92081094e0 2019-11-28T11:36:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.247+0000 7f920ee3a700 1 -- 172.21.15.80:0/2933134335 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9208106190 con 0x7f92081094e0 2019-11-28T11:36:25.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.247+0000 7f920dbd8700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92081094e0 0x7f9208167a10 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9200054450 tx=0x7f92000547f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:25.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.247+0000 7f9205ffb700 1 -- 172.21.15.80:0/2933134335 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f92000010c0 con 0x7f92081094e0 2019-11-28T11:36:25.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.247+0000 7f920dbd8700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92081094e0 0x7f9208167a10 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9200054450 tx=0x7f92000547f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:25.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.247+0000 7f9205ffb700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91ec018730 0x7f91ec01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:25.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.247+0000 7f9205ffb700 1 -- 172.21.15.80:0/2933134335 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f9200075b00 con 0x7f92081094e0 2019-11-28T11:36:25.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.248+0000 7f920d3d7700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91ec018730 0x7f91ec01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:25.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.248+0000 7f920d3d7700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91ec018730 0x7f91ec01abc0 crc :-1 s=READY pgs=424 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:25.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.255+0000 7f920ee3a700 1 -- 172.21.15.80:0/2933134335 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9208106510 con 0x7f92081094e0 2019-11-28T11:36:25.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.258+0000 7f920dbd8700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92081094e0 0x7f9208167a10 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9200054450 tx=0x7f92000547f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:25.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.258+0000 7f9205ffb700 1 -- 172.21.15.80:0/2933134335 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f92000081f0 con 0x7f92081094e0 2019-11-28T11:36:25.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.430+0000 7f920ee3a700 1 -- 172.21.15.80:0/2933134335 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9208106190 con 0x7f92081094e0 2019-11-28T11:36:25.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.431+0000 7f920dbd8700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92081094e0 0x7f9208167a10 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f9200054450 tx=0x7f92000547f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:25.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.431+0000 7f9205ffb700 1 -- 172.21.15.80:0/2933134335 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f92000018c0 con 0x7f92081094e0 2019-11-28T11:36:25.490 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:25.490 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:25.490 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:25.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.433+0000 7f920ee3a700 1 -- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91ec018730 msgr2=0x7f91ec01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:25.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.433+0000 7f920ee3a700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91ec018730 0x7f91ec01abc0 crc :-1 s=READY pgs=424 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:25.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.433+0000 7f920ee3a700 1 -- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92081094e0 msgr2=0x7f9208167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:25.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.433+0000 7f920ee3a700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92081094e0 0x7f9208167a10 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f9200054450 tx=0x7f92000547f0).stop 2019-11-28T11:36:25.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.433+0000 7f920ee3a700 1 -- 172.21.15.80:0/2933134335 shutdown_connections 2019-11-28T11:36:25.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.433+0000 7f920ee3a700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f92081094e0 0x7f9208167a10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:25.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.433+0000 7f920ee3a700 1 --2- 172.21.15.80:0/2933134335 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91ec018730 0x7f91ec01abc0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:25.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.433+0000 7f920ee3a700 1 --2- 172.21.15.80:0/2933134335 >> v2:172.21.15.174:3300/0 conn(0x7f920813dc00 0x7f9208109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:25.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.433+0000 7f920ee3a700 1 -- 172.21.15.80:0/2933134335 shutdown_connections 2019-11-28T11:36:25.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.433+0000 7f920ee3a700 1 -- 172.21.15.80:0/2933134335 wait complete. 2019-11-28T11:36:25.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:25.433+0000 7f920ee3a700 1 -- 172.21.15.80:0/2933134335 >> 172.21.15.80:0/2933134335 conn(0x7f920811bfc0 msgr2=0x7f9208141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:25.501 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:26.503 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:26.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.566+0000 7f3daf608700 1 Processor -- start 2019-11-28T11:36:26.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.566+0000 7f3daf608700 1 -- start start 2019-11-28T11:36:26.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.567+0000 7f3daf608700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da806c490 0x7f3da806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:26.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.567+0000 7f3daf608700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3da806ce60 0x7f3da8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:26.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.567+0000 7f3daf608700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da806db00 con 0x7f3da806c0a0 2019-11-28T11:36:26.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.567+0000 7f3daf608700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da806fd60 con 0x7f3da806ce60 2019-11-28T11:36:26.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.567+0000 7f3daf608700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da8070030 con 0x7f3da806c490 2019-11-28T11:36:26.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.567+0000 7f3dae3a6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3da806ce60 0x7f3da8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:26.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.567+0000 7f3dae3a6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3da806ce60 0x7f3da8164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36366/0 (socket says 172.21.15.80:36366) 2019-11-28T11:36:26.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.567+0000 7f3dae3a6700 1 -- 172.21.15.80:0/4231939359 learned_addr learned my addr 172.21.15.80:0/4231939359 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:26.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.567+0000 7f3dad3a4700 1 --2- 172.21.15.80:0/4231939359 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da806c490 0x7f3da806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:26.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.568+0000 7f3dae3a6700 1 -- 172.21.15.80:0/4231939359 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da806c490 msgr2=0x7f3da806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:26.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.568+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/4231939359 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da806c490 0x7f3da806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:26.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.568+0000 7f3dae3a6700 1 -- 172.21.15.80:0/4231939359 >> v1:172.21.15.174:6789/0 conn(0x7f3da806c0a0 legacy=0x7f3da8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:26.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.568+0000 7f3dae3a6700 1 -- 172.21.15.80:0/4231939359 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da80706c0 con 0x7f3da806ce60 2019-11-28T11:36:26.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.568+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/4231939359 >> v2:172.21.15.80:3300/0 conn(0x7f3da806ce60 0x7f3da8164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3da000f6b0 tx=0x7f3da000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:26.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.568+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/4231939359 >> v2:172.21.15.80:3300/0 conn(0x7f3da806ce60 0x7f3da8164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3da000f6b0 tx=0x7f3da000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:26.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.568+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/4231939359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da806ce60 0x7f3da8164d70 secure :-1 s=READY pgs=1040 cs=0 l=1 rx=0x7f3da000f6b0 tx=0x7f3da000fa50).ready entity=mon.0 client_cookie=546080d245d2517f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:26.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.568+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/4231939359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da806ce60 0x7f3da8164d70 secure :-1 s=THROTTLE_DONE pgs=1040 cs=0 l=1 rx=0x7f3da000f6b0 tx=0x7f3da000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:26.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.568+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/4231939359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da806ce60 0x7f3da8164d70 secure :-1 s=THROTTLE_DONE pgs=1040 cs=0 l=1 rx=0x7f3da000f6b0 tx=0x7f3da000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:26.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.568+0000 7f3dacba3700 1 -- 172.21.15.80:0/4231939359 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3da0000a70 con 0x7f3da806ce60 2019-11-28T11:36:26.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.568+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/4231939359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da806ce60 0x7f3da8164d70 secure :-1 s=THROTTLE_DONE pgs=1040 cs=0 l=1 rx=0x7f3da000f6b0 tx=0x7f3da000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:26.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.568+0000 7f3dacba3700 1 -- 172.21.15.80:0/4231939359 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da00010e0 con 0x7f3da806ce60 2019-11-28T11:36:26.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.568+0000 7f3dacba3700 1 -- 172.21.15.80:0/4231939359 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3da00017b0 con 0x7f3da806ce60 2019-11-28T11:36:26.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.568+0000 7f3daf608700 1 -- 172.21.15.80:0/4231939359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da806ce60 msgr2=0x7f3da8164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:26.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.568+0000 7f3daf608700 1 --2- 172.21.15.80:0/4231939359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da806ce60 0x7f3da8164d70 secure :-1 s=READY pgs=1040 cs=0 l=1 rx=0x7f3da000f6b0 tx=0x7f3da000fa50).stop 2019-11-28T11:36:26.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.569+0000 7f3daf608700 1 -- 172.21.15.80:0/4231939359 shutdown_connections 2019-11-28T11:36:26.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.569+0000 7f3daf608700 1 --2- 172.21.15.80:0/4231939359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3da806ce60 0x7f3da8164d70 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:26.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.569+0000 7f3daf608700 1 --2- 172.21.15.80:0/4231939359 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da806c490 0x7f3da806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:26.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.569+0000 7f3daf608700 1 -- 172.21.15.80:0/4231939359 shutdown_connections 2019-11-28T11:36:26.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.569+0000 7f3daf608700 1 -- 172.21.15.80:0/4231939359 wait complete. 2019-11-28T11:36:26.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.569+0000 7f3daf608700 1 -- 172.21.15.80:0/4231939359 >> 172.21.15.80:0/4231939359 conn(0x7f3da8061cf0 msgr2=0x7f3da8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:26.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.571+0000 7f3daf608700 1 Processor -- start 2019-11-28T11:36:26.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.571+0000 7f3daf608700 1 -- start start 2019-11-28T11:36:26.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.572+0000 7f3daf608700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3da813a780 0x7f3da812d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:26.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.572+0000 7f3daf608700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da812cb00 0x7f3da8167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:26.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.572+0000 7f3daf608700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da8139a60 con 0x7f3da812d9c0 2019-11-28T11:36:26.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.572+0000 7f3daf608700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da812a260 con 0x7f3da813a780 2019-11-28T11:36:26.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.572+0000 7f3daf608700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da812a530 con 0x7f3da812cb00 2019-11-28T11:36:26.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.572+0000 7f3dad3a4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3da812d9c0 0x7f3da812c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35688/0 (socket says 172.21.15.80:35688) 2019-11-28T11:36:26.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.572+0000 7f3dad3a4700 1 -- 172.21.15.80:0/3340150636 learned_addr learned my addr 172.21.15.80:0/3340150636 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:26.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.572+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da812cb00 0x7f3da8167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:26.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.572+0000 7f3dadba5700 1 --2- 172.21.15.80:0/3340150636 >> v2:172.21.15.174:3300/0 conn(0x7f3da813a780 0x7f3da812d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:26.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.572+0000 7f3da67fc700 1 -- 172.21.15.80:0/3340150636 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846636824 0 0) 0x7f3d9c009610 con 0x7f3da812d9c0 2019-11-28T11:36:26.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.572+0000 7f3da67fc700 1 -- 172.21.15.80:0/3340150636 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d88002e80 con 0x7f3da812d9c0 2019-11-28T11:36:26.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.573+0000 7f3dae3a6700 1 -- 172.21.15.80:0/3340150636 >> v2:172.21.15.174:3300/0 conn(0x7f3da813a780 msgr2=0x7f3da812d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:26.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.573+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/3340150636 >> v2:172.21.15.174:3300/0 conn(0x7f3da813a780 0x7f3da812d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:26.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.573+0000 7f3dae3a6700 1 -- 172.21.15.80:0/3340150636 >> v1:172.21.15.80:6789/0 conn(0x7f3da812d9c0 legacy=0x7f3da812c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:26.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.573+0000 7f3dae3a6700 1 -- 172.21.15.80:0/3340150636 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da812abc0 con 0x7f3da812cb00 2019-11-28T11:36:26.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.573+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da812cb00 0x7f3da8167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3da00103c0 tx=0x7f3da00101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:26.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.573+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da812cb00 0x7f3da8167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3da00103c0 tx=0x7f3da00101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:26.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.573+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da812cb00 0x7f3da8167d70 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f3da00103c0 tx=0x7f3da00101f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:26.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.573+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da812cb00 0x7f3da8167d70 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f3da00103c0 tx=0x7f3da00101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:26.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.573+0000 7f3da67fc700 1 -- 172.21.15.80:0/3340150636 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3da00014a0 con 0x7f3da812cb00 2019-11-28T11:36:26.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.573+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da812cb00 0x7f3da8167d70 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f3da00103c0 tx=0x7f3da00101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:26.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.573+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da812cb00 0x7f3da8167d70 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f3da00103c0 tx=0x7f3da00101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:26.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.573+0000 7f3da67fc700 1 -- 172.21.15.80:0/3340150636 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da00010c0 con 0x7f3da812cb00 2019-11-28T11:36:26.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.573+0000 7f3daf608700 1 -- 172.21.15.80:0/3340150636 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da812af40 con 0x7f3da812cb00 2019-11-28T11:36:26.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.573+0000 7f3da67fc700 1 -- 172.21.15.80:0/3340150636 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3da0001a80 con 0x7f3da812cb00 2019-11-28T11:36:26.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.573+0000 7f3daf608700 1 -- 172.21.15.80:0/3340150636 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da812abc0 con 0x7f3da812cb00 2019-11-28T11:36:26.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.573+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da812cb00 0x7f3da8167d70 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f3da00103c0 tx=0x7f3da00101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:26.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.574+0000 7f3da67fc700 1 -- 172.21.15.80:0/3340150636 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3da00012b0 con 0x7f3da812cb00 2019-11-28T11:36:26.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.574+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da812cb00 0x7f3da8167d70 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f3da00103c0 tx=0x7f3da00101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:26.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.574+0000 7f3da67fc700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d88018770 0x7f3d8801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:26.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.574+0000 7f3da67fc700 1 -- 172.21.15.80:0/3340150636 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f3da0031c10 con 0x7f3da812cb00 2019-11-28T11:36:26.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.574+0000 7f3dadba5700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d88018770 0x7f3d8801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:26.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.574+0000 7f3dadba5700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d88018770 0x7f3d8801abe0 crc :-1 s=READY pgs=425 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:26.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.582+0000 7f3daf608700 1 -- 172.21.15.80:0/3340150636 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da812af40 con 0x7f3da812cb00 2019-11-28T11:36:26.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.585+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da812cb00 0x7f3da8167d70 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f3da00103c0 tx=0x7f3da00101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:26.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.585+0000 7f3da67fc700 1 -- 172.21.15.80:0/3340150636 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3da0000eb0 con 0x7f3da812cb00 2019-11-28T11:36:26.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.762+0000 7f3daf608700 1 -- 172.21.15.80:0/3340150636 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3da812abc0 con 0x7f3da812cb00 2019-11-28T11:36:26.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.763+0000 7f3dae3a6700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da812cb00 0x7f3da8167d70 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f3da00103c0 tx=0x7f3da00101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:26.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.763+0000 7f3da67fc700 1 -- 172.21.15.80:0/3340150636 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f3da0000eb0 con 0x7f3da812cb00 2019-11-28T11:36:26.822 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:26.822 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:26.822 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:26.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.765+0000 7f3daf608700 1 -- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d88018770 msgr2=0x7f3d8801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:26.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.765+0000 7f3daf608700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d88018770 0x7f3d8801abe0 crc :-1 s=READY pgs=425 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:26.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.765+0000 7f3daf608700 1 -- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da812cb00 msgr2=0x7f3da8167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:26.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.765+0000 7f3daf608700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da812cb00 0x7f3da8167d70 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f3da00103c0 tx=0x7f3da00101f0).stop 2019-11-28T11:36:26.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.766+0000 7f3daf608700 1 -- 172.21.15.80:0/3340150636 shutdown_connections 2019-11-28T11:36:26.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.766+0000 7f3daf608700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d88018770 0x7f3d8801abe0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:26.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.766+0000 7f3daf608700 1 --2- 172.21.15.80:0/3340150636 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3da812cb00 0x7f3da8167d70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.766+0000 7f3daf608700 1 --2- 172.21.15.80:0/3340150636 >> v2:172.21.15.174:3300/0 conn(0x7f3da813a780 0x7f3da812d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.766+0000 7f3daf608700 1 -- 172.21.15.80:0/3340150636 shutdown_connections 2019-11-28T11:36:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.766+0000 7f3daf608700 1 -- 172.21.15.80:0/3340150636 wait complete. 2019-11-28T11:36:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:26.766+0000 7f3daf608700 1 -- 172.21.15.80:0/3340150636 >> 172.21.15.80:0/3340150636 conn(0x7f3da8127dc0 msgr2=0x7f3da8141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:26.843 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:27.844 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:27.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.909+0000 7f8de1c9e700 1 Processor -- start 2019-11-28T11:36:27.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.909+0000 7f8de1c9e700 1 -- start start 2019-11-28T11:36:27.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8de1c9e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ddc06c490 0x7f8ddc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:27.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8de1c9e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8ddc06ce60 0x7f8ddc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:27.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8de1c9e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ddc06db00 con 0x7f8ddc06c0a0 2019-11-28T11:36:27.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8de1c9e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ddc06fd60 con 0x7f8ddc06c490 2019-11-28T11:36:27.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8de1c9e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ddc070030 con 0x7f8ddc06ce60 2019-11-28T11:36:27.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8dd3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ddc06c490 0x7f8ddc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:27.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8dd3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ddc06c490 0x7f8ddc06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36380/0 (socket says 172.21.15.80:36380) 2019-11-28T11:36:27.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8dd3fff700 1 -- 172.21.15.80:0/3633452457 learned_addr learned my addr 172.21.15.80:0/3633452457 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:27.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8de0a3c700 1 --2- 172.21.15.80:0/3633452457 >> v2:172.21.15.174:3300/0 conn(0x7f8ddc06ce60 0x7f8ddc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:27.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8dd3fff700 1 -- 172.21.15.80:0/3633452457 >> v2:172.21.15.174:3300/0 conn(0x7f8ddc06ce60 msgr2=0x7f8ddc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:27.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8dd3fff700 1 --2- 172.21.15.80:0/3633452457 >> v2:172.21.15.174:3300/0 conn(0x7f8ddc06ce60 0x7f8ddc164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:27.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8dd3fff700 1 -- 172.21.15.80:0/3633452457 >> v1:172.21.15.174:6789/0 conn(0x7f8ddc06c0a0 legacy=0x7f8ddc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:27.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8dd3fff700 1 -- 172.21.15.80:0/3633452457 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc0706c0 con 0x7f8ddc06c490 2019-11-28T11:36:27.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8de0a3c700 1 --2- 172.21.15.80:0/3633452457 >> v2:172.21.15.174:3300/0 conn(0x7f8ddc06ce60 0x7f8ddc164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:36:27.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8dd3fff700 1 --2- 172.21.15.80:0/3633452457 >> v2:172.21.15.80:3300/0 conn(0x7f8ddc06c490 0x7f8ddc06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8dc400f740 tx=0x7f8dc400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:27.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8dd3fff700 1 --2- 172.21.15.80:0/3633452457 >> v2:172.21.15.80:3300/0 conn(0x7f8ddc06c490 0x7f8ddc06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8dc400f740 tx=0x7f8dc400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:27.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8dd3fff700 1 --2- 172.21.15.80:0/3633452457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc06c490 0x7f8ddc06c920 secure :-1 s=READY pgs=1042 cs=0 l=1 rx=0x7f8dc400f740 tx=0x7f8dc400f570).ready entity=mon.0 client_cookie=b6b48ca5342c20f1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8dd3fff700 1 --2- 172.21.15.80:0/3633452457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc06c490 0x7f8ddc06c920 secure :-1 s=THROTTLE_DONE pgs=1042 cs=0 l=1 rx=0x7f8dc400f740 tx=0x7f8dc400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8dd3fff700 1 --2- 172.21.15.80:0/3633452457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc06c490 0x7f8ddc06c920 secure :-1 s=THROTTLE_DONE pgs=1042 cs=0 l=1 rx=0x7f8dc400f740 tx=0x7f8dc400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8ddb7fe700 1 -- 172.21.15.80:0/3633452457 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dc4000960 con 0x7f8ddc06c490 2019-11-28T11:36:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8dd3fff700 1 --2- 172.21.15.80:0/3633452457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc06c490 0x7f8ddc06c920 secure :-1 s=THROTTLE_DONE pgs=1042 cs=0 l=1 rx=0x7f8dc400f740 tx=0x7f8dc400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8ddb7fe700 1 -- 172.21.15.80:0/3633452457 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc4000c90 con 0x7f8ddc06c490 2019-11-28T11:36:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8ddb7fe700 1 -- 172.21.15.80:0/3633452457 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dc40013a0 con 0x7f8ddc06c490 2019-11-28T11:36:27.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8de1c9e700 1 -- 172.21.15.80:0/3633452457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc06c490 msgr2=0x7f8ddc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:27.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.910+0000 7f8de1c9e700 1 --2- 172.21.15.80:0/3633452457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc06c490 0x7f8ddc06c920 secure :-1 s=READY pgs=1042 cs=0 l=1 rx=0x7f8dc400f740 tx=0x7f8dc400f570).stop 2019-11-28T11:36:27.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.911+0000 7f8de1c9e700 1 -- 172.21.15.80:0/3633452457 shutdown_connections 2019-11-28T11:36:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.911+0000 7f8de1c9e700 1 --2- 172.21.15.80:0/3633452457 >> v2:172.21.15.174:3300/0 conn(0x7f8ddc06ce60 0x7f8ddc164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.911+0000 7f8de1c9e700 1 --2- 172.21.15.80:0/3633452457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc06c490 0x7f8ddc06c920 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.911+0000 7f8de1c9e700 1 -- 172.21.15.80:0/3633452457 shutdown_connections 2019-11-28T11:36:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.911+0000 7f8de1c9e700 1 -- 172.21.15.80:0/3633452457 wait complete. 2019-11-28T11:36:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.911+0000 7f8de1c9e700 1 -- 172.21.15.80:0/3633452457 >> 172.21.15.80:0/3633452457 conn(0x7f8ddc061cf0 msgr2=0x7f8ddc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:27.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.914+0000 7f8de1c9e700 1 Processor -- start 2019-11-28T11:36:27.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.914+0000 7f8de1c9e700 1 -- start start 2019-11-28T11:36:27.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.914+0000 7f8de1c9e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8ddc13e320 0x7f8ddc13e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:27.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.914+0000 7f8de1c9e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ddc12a3c0 0x7f8ddc12a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:27.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.914+0000 7f8de1c9e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ddc139e00 con 0x7f8ddc15fdf0 2019-11-28T11:36:27.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.914+0000 7f8de1c9e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ddc108820 con 0x7f8ddc12a3c0 2019-11-28T11:36:27.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.914+0000 7f8de1c9e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ddc108af0 con 0x7f8ddc13e320 2019-11-28T11:36:27.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.914+0000 7f8de0a3c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ddc12a3c0 0x7f8ddc12a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:27.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8de0a3c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ddc12a3c0 0x7f8ddc12a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36388/0 (socket says 172.21.15.80:36388) 2019-11-28T11:36:27.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8de0a3c700 1 -- 172.21.15.80:0/300994685 learned_addr learned my addr 172.21.15.80:0/300994685 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:27.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8dd3fff700 1 --2- 172.21.15.80:0/300994685 >> v2:172.21.15.174:3300/0 conn(0x7f8ddc13e320 0x7f8ddc13e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:27.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8de0a3c700 1 -- 172.21.15.80:0/300994685 >> v2:172.21.15.174:3300/0 conn(0x7f8ddc13e320 msgr2=0x7f8ddc13e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:27.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8de0a3c700 1 --2- 172.21.15.80:0/300994685 >> v2:172.21.15.174:3300/0 conn(0x7f8ddc13e320 0x7f8ddc13e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:27.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8de0a3c700 1 -- 172.21.15.80:0/300994685 >> v1:172.21.15.80:6789/0 conn(0x7f8ddc15fdf0 legacy=0x7f8ddc12b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:27.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8de0a3c700 1 -- 172.21.15.80:0/300994685 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc10a8c0 con 0x7f8ddc12a3c0 2019-11-28T11:36:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8dd97fa700 1 -- 172.21.15.80:0/300994685 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314183083 0 0) 0x7f8dcc0010c0 con 0x7f8ddc15fdf0 2019-11-28T11:36:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8de0a3c700 1 --2- 172.21.15.80:0/300994685 >> v2:172.21.15.80:3300/0 conn(0x7f8ddc12a3c0 0x7f8ddc12a820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8dd4010800 tx=0x7f8dd4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8de0a3c700 1 --2- 172.21.15.80:0/300994685 >> v2:172.21.15.80:3300/0 conn(0x7f8ddc12a3c0 0x7f8ddc12a820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8dd4010800 tx=0x7f8dd4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8de0a3c700 1 --2- 172.21.15.80:0/300994685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc12a3c0 0x7f8ddc12a820 secure :-1 s=READY pgs=1044 cs=0 l=1 rx=0x7f8dd4010800 tx=0x7f8dd4010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8de0a3c700 1 --2- 172.21.15.80:0/300994685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc12a3c0 0x7f8ddc12a820 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f8dd4010800 tx=0x7f8dd4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8de0a3c700 1 --2- 172.21.15.80:0/300994685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc12a3c0 0x7f8ddc12a820 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f8dd4010800 tx=0x7f8dd4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:27.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8dd97fa700 1 -- 172.21.15.80:0/300994685 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dd4008800 con 0x7f8ddc12a3c0 2019-11-28T11:36:27.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8de0a3c700 1 --2- 172.21.15.80:0/300994685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc12a3c0 0x7f8ddc12a820 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f8dd4010800 tx=0x7f8dd4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:27.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8dd97fa700 1 -- 172.21.15.80:0/300994685 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd4009e00 con 0x7f8ddc12a3c0 2019-11-28T11:36:27.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8de1c9e700 1 -- 172.21.15.80:0/300994685 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ddc10a8c0 con 0x7f8ddc12a3c0 2019-11-28T11:36:27.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8dd97fa700 1 -- 172.21.15.80:0/300994685 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dd400a530 con 0x7f8ddc12a3c0 2019-11-28T11:36:27.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8de1c9e700 1 -- 172.21.15.80:0/300994685 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ddc10a8c0 con 0x7f8ddc12a3c0 2019-11-28T11:36:27.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.915+0000 7f8de0a3c700 1 --2- 172.21.15.80:0/300994685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc12a3c0 0x7f8ddc12a820 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f8dd4010800 tx=0x7f8dd4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:27.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.916+0000 7f8dd97fa700 1 -- 172.21.15.80:0/300994685 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8dd4000df0 con 0x7f8ddc12a3c0 2019-11-28T11:36:27.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.916+0000 7f8de0a3c700 1 --2- 172.21.15.80:0/300994685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc12a3c0 0x7f8ddc12a820 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f8dd4010800 tx=0x7f8dd4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:27.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.916+0000 7f8dd97fa700 1 --2- 172.21.15.80:0/300994685 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8dc0018730 0x7f8dc001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:27.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.916+0000 7f8dd97fa700 1 -- 172.21.15.80:0/300994685 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8dd4031ea0 con 0x7f8ddc12a3c0 2019-11-28T11:36:27.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.916+0000 7f8ddbfff700 1 --2- 172.21.15.80:0/300994685 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8dc0018730 0x7f8dc001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:27.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.916+0000 7f8ddbfff700 1 --2- 172.21.15.80:0/300994685 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8dc0018730 0x7f8dc001abc0 crc :-1 s=READY pgs=426 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:27.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.924+0000 7f8de1c9e700 1 -- 172.21.15.80:0/300994685 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ddc109180 con 0x7f8ddc12a3c0 2019-11-28T11:36:27.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.927+0000 7f8de0a3c700 1 --2- 172.21.15.80:0/300994685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc12a3c0 0x7f8ddc12a820 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f8dd4010800 tx=0x7f8dd4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:27.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:27.927+0000 7f8dd97fa700 1 -- 172.21.15.80:0/300994685 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8dd4009960 con 0x7f8ddc12a3c0 2019-11-28T11:36:28.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:28.100+0000 7f8de1c9e700 1 -- 172.21.15.80:0/300994685 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ddc109500 con 0x7f8ddc12a3c0 2019-11-28T11:36:28.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:28.100+0000 7f8de0a3c700 1 --2- 172.21.15.80:0/300994685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc12a3c0 0x7f8ddc12a820 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f8dd4010800 tx=0x7f8dd4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:28.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:28.100+0000 7f8dd97fa700 1 -- 172.21.15.80:0/300994685 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f8dd4009de0 con 0x7f8ddc12a3c0 2019-11-28T11:36:28.227 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:28.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:28.103+0000 7f8de1c9e700 1 -- 172.21.15.80:0/300994685 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8dc0018730 msgr2=0x7f8dc001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:28.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:28.103+0000 7f8de1c9e700 1 --2- 172.21.15.80:0/300994685 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8dc0018730 0x7f8dc001abc0 crc :-1 s=READY pgs=426 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:28.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:28.103+0000 7f8de1c9e700 1 -- 172.21.15.80:0/300994685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc12a3c0 msgr2=0x7f8ddc12a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:28.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:28.103+0000 7f8de1c9e700 1 --2- 172.21.15.80:0/300994685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc12a3c0 0x7f8ddc12a820 secure :-1 s=READY pgs=1044 cs=0 l=1 rx=0x7f8dd4010800 tx=0x7f8dd4010600).stop 2019-11-28T11:36:28.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:28.103+0000 7f8de1c9e700 1 -- 172.21.15.80:0/300994685 shutdown_connections 2019-11-28T11:36:28.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:28.103+0000 7f8de1c9e700 1 --2- 172.21.15.80:0/300994685 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8dc0018730 0x7f8dc001abc0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:28.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:28.103+0000 7f8de1c9e700 1 --2- 172.21.15.80:0/300994685 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ddc12a3c0 0x7f8ddc12a820 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:28.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:28.103+0000 7f8de1c9e700 1 --2- 172.21.15.80:0/300994685 >> v2:172.21.15.174:3300/0 conn(0x7f8ddc13e320 0x7f8ddc13e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:28.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:28.103+0000 7f8de1c9e700 1 -- 172.21.15.80:0/300994685 shutdown_connections 2019-11-28T11:36:28.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:28.103+0000 7f8de1c9e700 1 -- 172.21.15.80:0/300994685 wait complete. 2019-11-28T11:36:28.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:28.103+0000 7f8de1c9e700 1 -- 172.21.15.80:0/300994685 >> 172.21.15.80:0/300994685 conn(0x7f8ddc127dc0 msgr2=0x7f8ddc141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:28.229 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:28.229 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:28.230 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:29.233 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:29.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.301+0000 7fcf756af700 1 Processor -- start 2019-11-28T11:36:29.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.301+0000 7fcf756af700 1 -- start start 2019-11-28T11:36:29.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.302+0000 7fcf756af700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf7006d120 0x7fcf70165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:29.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.302+0000 7fcf756af700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7006d5a0 con 0x7fcf7006c490 2019-11-28T11:36:29.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.302+0000 7fcf756af700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7006db00 con 0x7fcf7006c0a0 2019-11-28T11:36:29.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.302+0000 7fcf756af700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf7006fd60 con 0x7fcf7006d120 2019-11-28T11:36:29.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.302+0000 7fcf6ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf7006d120 0x7fcf70165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:29.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.302+0000 7fcf6effd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcf7006c490 0x7fcf7006c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35712/0 (socket says 172.21.15.80:35712) 2019-11-28T11:36:29.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.302+0000 7fcf6effd700 1 -- 172.21.15.80:0/2964298218 learned_addr learned my addr 172.21.15.80:0/2964298218 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:29.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.302+0000 7fcf6ffff700 1 -- 172.21.15.80:0/2964298218 >> v1:172.21.15.174:6789/0 conn(0x7fcf7006c0a0 legacy=0x7fcf70072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:29.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.302+0000 7fcf6ffff700 1 -- 172.21.15.80:0/2964298218 >> v1:172.21.15.80:6789/0 conn(0x7fcf7006c490 legacy=0x7fcf7006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:29.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.302+0000 7fcf6ffff700 1 -- 172.21.15.80:0/2964298218 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf700706c0 con 0x7fcf7006d120 2019-11-28T11:36:29.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.302+0000 7fcf6e7fc700 1 -- 172.21.15.80:0/2964298218 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167555618 0 0) 0x7fcf600014d0 con 0x7fcf7006c490 2019-11-28T11:36:29.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.302+0000 7fcf6ffff700 1 --2- 172.21.15.80:0/2964298218 >> v2:172.21.15.80:3300/0 conn(0x7fcf7006d120 0x7fcf70165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcf6800af50 tx=0x7fcf6800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:29.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.302+0000 7fcf6ffff700 1 --2- 172.21.15.80:0/2964298218 >> v2:172.21.15.80:3300/0 conn(0x7fcf7006d120 0x7fcf70165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcf6800af50 tx=0x7fcf6800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:29.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.302+0000 7fcf6ffff700 1 --2- 172.21.15.80:0/2964298218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7006d120 0x7fcf70165d80 secure :-1 s=READY pgs=1046 cs=0 l=1 rx=0x7fcf6800af50 tx=0x7fcf6800b760).ready entity=mon.0 client_cookie=f16d43c133452291 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:29.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.303+0000 7fcf6ffff700 1 --2- 172.21.15.80:0/2964298218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7006d120 0x7fcf70165d80 secure :-1 s=THROTTLE_DONE pgs=1046 cs=0 l=1 rx=0x7fcf6800af50 tx=0x7fcf6800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:29.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.303+0000 7fcf6e7fc700 1 -- 172.21.15.80:0/2964298218 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf68009ba0 con 0x7fcf7006d120 2019-11-28T11:36:29.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.303+0000 7fcf6ffff700 1 --2- 172.21.15.80:0/2964298218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7006d120 0x7fcf70165d80 secure :-1 s=THROTTLE_DONE pgs=1046 cs=0 l=1 rx=0x7fcf6800af50 tx=0x7fcf6800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:29.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.303+0000 7fcf6ffff700 1 --2- 172.21.15.80:0/2964298218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7006d120 0x7fcf70165d80 secure :-1 s=THROTTLE_DONE pgs=1046 cs=0 l=1 rx=0x7fcf6800af50 tx=0x7fcf6800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:29.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.303+0000 7fcf6e7fc700 1 -- 172.21.15.80:0/2964298218 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf68000a70 con 0x7fcf7006d120 2019-11-28T11:36:29.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.303+0000 7fcf6e7fc700 1 -- 172.21.15.80:0/2964298218 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf6800a180 con 0x7fcf7006d120 2019-11-28T11:36:29.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.303+0000 7fcf756af700 1 -- 172.21.15.80:0/2964298218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7006d120 msgr2=0x7fcf70165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:29.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.303+0000 7fcf756af700 1 --2- 172.21.15.80:0/2964298218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7006d120 0x7fcf70165d80 secure :-1 s=READY pgs=1046 cs=0 l=1 rx=0x7fcf6800af50 tx=0x7fcf6800b760).stop 2019-11-28T11:36:29.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.303+0000 7fcf756af700 1 -- 172.21.15.80:0/2964298218 shutdown_connections 2019-11-28T11:36:29.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.303+0000 7fcf756af700 1 --2- 172.21.15.80:0/2964298218 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7006d120 0x7fcf70165d80 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:29.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.303+0000 7fcf756af700 1 -- 172.21.15.80:0/2964298218 shutdown_connections 2019-11-28T11:36:29.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.303+0000 7fcf756af700 1 -- 172.21.15.80:0/2964298218 wait complete. 2019-11-28T11:36:29.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.303+0000 7fcf756af700 1 -- 172.21.15.80:0/2964298218 >> 172.21.15.80:0/2964298218 conn(0x7fcf70061cf0 msgr2=0x7fcf70064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:29.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.306+0000 7fcf756af700 1 Processor -- start 2019-11-28T11:36:29.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.306+0000 7fcf756af700 1 -- start start 2019-11-28T11:36:29.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf756af700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf7012cea0 0x7fcf70111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:29.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf756af700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf70165a00 0x7fcf70167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:29.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf756af700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf70124260 con 0x7fcf701230e0 2019-11-28T11:36:29.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf756af700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf70121040 con 0x7fcf7012cea0 2019-11-28T11:36:29.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf756af700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf70121310 con 0x7fcf70165a00 2019-11-28T11:36:29.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf6f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf7012cea0 0x7fcf70111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:29.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf6f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf7012cea0 0x7fcf70111db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36398/0 (socket says 172.21.15.80:36398) 2019-11-28T11:36:29.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf6f7fe700 1 -- 172.21.15.80:0/3174340741 learned_addr learned my addr 172.21.15.80:0/3174340741 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:29.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf6ffff700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf70165a00 0x7fcf70167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:29.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf6f7fe700 1 -- 172.21.15.80:0/3174340741 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf70165a00 msgr2=0x7fcf70167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:29.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf6f7fe700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf70165a00 0x7fcf70167e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:29.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf6f7fe700 1 -- 172.21.15.80:0/3174340741 >> v1:172.21.15.80:6789/0 conn(0x7fcf701230e0 legacy=0x7fcf70123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:29.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf6f7fe700 1 -- 172.21.15.80:0/3174340741 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf701219a0 con 0x7fcf7012cea0 2019-11-28T11:36:29.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf6f7fe700 1 --2- 172.21.15.80:0/3174340741 >> v2:172.21.15.80:3300/0 conn(0x7fcf7012cea0 0x7fcf70111db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcf64010410 tx=0x7fcf64010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:29.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf6f7fe700 1 --2- 172.21.15.80:0/3174340741 >> v2:172.21.15.80:3300/0 conn(0x7fcf7012cea0 0x7fcf70111db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcf64010410 tx=0x7fcf64010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:29.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf6f7fe700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7012cea0 0x7fcf70111db0 secure :-1 s=READY pgs=1048 cs=0 l=1 rx=0x7fcf64010410 tx=0x7fcf64010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:29.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf6f7fe700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7012cea0 0x7fcf70111db0 secure :-1 s=THROTTLE_DONE pgs=1048 cs=0 l=1 rx=0x7fcf64010410 tx=0x7fcf64010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:29.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf6f7fe700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7012cea0 0x7fcf70111db0 secure :-1 s=THROTTLE_DONE pgs=1048 cs=0 l=1 rx=0x7fcf64010410 tx=0x7fcf64010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:29.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf57fff700 1 -- 172.21.15.80:0/3174340741 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf640057c0 con 0x7fcf7012cea0 2019-11-28T11:36:29.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf6f7fe700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7012cea0 0x7fcf70111db0 secure :-1 s=THROTTLE_DONE pgs=1048 cs=0 l=1 rx=0x7fcf64010410 tx=0x7fcf64010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:29.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf57fff700 1 -- 172.21.15.80:0/3174340741 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf640053e0 con 0x7fcf7012cea0 2019-11-28T11:36:29.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.307+0000 7fcf756af700 1 -- 172.21.15.80:0/3174340741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf70121d20 con 0x7fcf7012cea0 2019-11-28T11:36:29.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.308+0000 7fcf57fff700 1 -- 172.21.15.80:0/3174340741 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf64005e40 con 0x7fcf7012cea0 2019-11-28T11:36:29.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.308+0000 7fcf756af700 1 -- 172.21.15.80:0/3174340741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf701122f0 con 0x7fcf7012cea0 2019-11-28T11:36:29.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.308+0000 7fcf6f7fe700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7012cea0 0x7fcf70111db0 secure :-1 s=THROTTLE_DONE pgs=1048 cs=0 l=1 rx=0x7fcf64010410 tx=0x7fcf64010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:29.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.308+0000 7fcf57fff700 1 -- 172.21.15.80:0/3174340741 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcf64005670 con 0x7fcf7012cea0 2019-11-28T11:36:29.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.308+0000 7fcf6f7fe700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7012cea0 0x7fcf70111db0 secure :-1 s=THROTTLE_DONE pgs=1048 cs=0 l=1 rx=0x7fcf64010410 tx=0x7fcf64010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:29.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.308+0000 7fcf57fff700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf50018730 0x7fcf5001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:29.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.308+0000 7fcf57fff700 1 -- 172.21.15.80:0/3174340741 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fcf64031ad0 con 0x7fcf7012cea0 2019-11-28T11:36:29.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.308+0000 7fcf6effd700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf50018730 0x7fcf5001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:29.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.309+0000 7fcf6effd700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf50018730 0x7fcf5001abc0 crc :-1 s=READY pgs=427 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:29.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.316+0000 7fcf756af700 1 -- 172.21.15.80:0/3174340741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf701219a0 con 0x7fcf7012cea0 2019-11-28T11:36:29.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.320+0000 7fcf6f7fe700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7012cea0 0x7fcf70111db0 secure :-1 s=THROTTLE_DONE pgs=1048 cs=0 l=1 rx=0x7fcf64010410 tx=0x7fcf64010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:29.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.320+0000 7fcf57fff700 1 -- 172.21.15.80:0/3174340741 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcf64007600 con 0x7fcf7012cea0 2019-11-28T11:36:29.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.491+0000 7fcf756af700 1 -- 172.21.15.80:0/3174340741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf70121d20 con 0x7fcf7012cea0 2019-11-28T11:36:29.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.491+0000 7fcf6f7fe700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7012cea0 0x7fcf70111db0 secure :-1 s=THROTTLE_DONE pgs=1048 cs=0 l=1 rx=0x7fcf64010410 tx=0x7fcf64010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:29.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.491+0000 7fcf57fff700 1 -- 172.21.15.80:0/3174340741 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fcf640055d0 con 0x7fcf7012cea0 2019-11-28T11:36:29.552 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:29.553 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:29.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.494+0000 7fcf756af700 1 -- 172.21.15.80:0/3174340741 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf50018730 msgr2=0x7fcf5001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:29.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.494+0000 7fcf756af700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf50018730 0x7fcf5001abc0 crc :-1 s=READY pgs=427 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:29.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.494+0000 7fcf756af700 1 -- 172.21.15.80:0/3174340741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7012cea0 msgr2=0x7fcf70111db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:29.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.494+0000 7fcf756af700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7012cea0 0x7fcf70111db0 secure :-1 s=READY pgs=1048 cs=0 l=1 rx=0x7fcf64010410 tx=0x7fcf64010290).stop 2019-11-28T11:36:29.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.494+0000 7fcf756af700 1 -- 172.21.15.80:0/3174340741 shutdown_connections 2019-11-28T11:36:29.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.494+0000 7fcf756af700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf50018730 0x7fcf5001abc0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:29.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.494+0000 7fcf756af700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf70165a00 0x7fcf70167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:29.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.494+0000 7fcf756af700 1 --2- 172.21.15.80:0/3174340741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7012cea0 0x7fcf70111db0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:29.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.494+0000 7fcf756af700 1 -- 172.21.15.80:0/3174340741 shutdown_connections 2019-11-28T11:36:29.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.494+0000 7fcf756af700 1 -- 172.21.15.80:0/3174340741 wait complete. 2019-11-28T11:36:29.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:29.494+0000 7fcf756af700 1 -- 172.21.15.80:0/3174340741 >> 172.21.15.80:0/3174340741 conn(0x7fcf701426c0 msgr2=0x7fcf70110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:29.563 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:30.567 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:30.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.631+0000 7f8055ad3700 1 Processor -- start 2019-11-28T11:36:30.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.631+0000 7f8055ad3700 1 -- start start 2019-11-28T11:36:30.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.632+0000 7f8055ad3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f805006c0a0 0x7f8050072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:30.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.632+0000 7f8055ad3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8050072620 0x7f8050164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:30.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.632+0000 7f8055ad3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805006db00 con 0x7f80500734e0 2019-11-28T11:36:30.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.632+0000 7f8055ad3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f805006fd60 con 0x7f805006c0a0 2019-11-28T11:36:30.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.632+0000 7f8055ad3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8050070030 con 0x7f8050072620 2019-11-28T11:36:30.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.632+0000 7f804ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f805006c0a0 0x7f8050072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:30.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.632+0000 7f804ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f805006c0a0 0x7f8050072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36406/0 (socket says 172.21.15.80:36406) 2019-11-28T11:36:30.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.632+0000 7f804ffff700 1 -- 172.21.15.80:0/3047785722 learned_addr learned my addr 172.21.15.80:0/3047785722 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:30.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.632+0000 7f8054871700 1 --2- 172.21.15.80:0/3047785722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8050072620 0x7f8050164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:30.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.632+0000 7f804ffff700 1 -- 172.21.15.80:0/3047785722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8050072620 msgr2=0x7f8050164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:30.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.632+0000 7f804ffff700 1 --2- 172.21.15.80:0/3047785722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8050072620 0x7f8050164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:30.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.632+0000 7f804ffff700 1 -- 172.21.15.80:0/3047785722 >> v1:172.21.15.174:6789/0 conn(0x7f80500734e0 legacy=0x7f8050071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:30.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.632+0000 7f804ffff700 1 -- 172.21.15.80:0/3047785722 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80500706c0 con 0x7f805006c0a0 2019-11-28T11:36:30.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.633+0000 7f804ffff700 1 --2- 172.21.15.80:0/3047785722 >> v2:172.21.15.80:3300/0 conn(0x7f805006c0a0 0x7f8050072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f804000f740 tx=0x7f804000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:30.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.633+0000 7f804ffff700 1 --2- 172.21.15.80:0/3047785722 >> v2:172.21.15.80:3300/0 conn(0x7f805006c0a0 0x7f8050072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f804000f740 tx=0x7f804000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:30.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.633+0000 7f804ffff700 1 --2- 172.21.15.80:0/3047785722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f805006c0a0 0x7f8050072fa0 secure :-1 s=READY pgs=1049 cs=0 l=1 rx=0x7f804000f740 tx=0x7f804000f570).ready entity=mon.0 client_cookie=cc575730c2e0679c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:30.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.633+0000 7f804ffff700 1 --2- 172.21.15.80:0/3047785722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f805006c0a0 0x7f8050072fa0 secure :-1 s=THROTTLE_DONE pgs=1049 cs=0 l=1 rx=0x7f804000f740 tx=0x7f804000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:30.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.633+0000 7f804f7fe700 1 -- 172.21.15.80:0/3047785722 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8040000960 con 0x7f805006c0a0 2019-11-28T11:36:30.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.633+0000 7f804ffff700 1 --2- 172.21.15.80:0/3047785722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f805006c0a0 0x7f8050072fa0 secure :-1 s=THROTTLE_DONE pgs=1049 cs=0 l=1 rx=0x7f804000f740 tx=0x7f804000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:30.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.633+0000 7f804ffff700 1 --2- 172.21.15.80:0/3047785722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f805006c0a0 0x7f8050072fa0 secure :-1 s=THROTTLE_DONE pgs=1049 cs=0 l=1 rx=0x7f804000f740 tx=0x7f804000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:30.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.633+0000 7f804f7fe700 1 -- 172.21.15.80:0/3047785722 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8040000c90 con 0x7f805006c0a0 2019-11-28T11:36:30.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.633+0000 7f804f7fe700 1 -- 172.21.15.80:0/3047785722 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80400013a0 con 0x7f805006c0a0 2019-11-28T11:36:30.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.633+0000 7f8055ad3700 1 -- 172.21.15.80:0/3047785722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f805006c0a0 msgr2=0x7f8050072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:30.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.633+0000 7f8055ad3700 1 --2- 172.21.15.80:0/3047785722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f805006c0a0 0x7f8050072fa0 secure :-1 s=READY pgs=1049 cs=0 l=1 rx=0x7f804000f740 tx=0x7f804000f570).stop 2019-11-28T11:36:30.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.633+0000 7f8055ad3700 1 -- 172.21.15.80:0/3047785722 shutdown_connections 2019-11-28T11:36:30.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.633+0000 7f8055ad3700 1 --2- 172.21.15.80:0/3047785722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8050072620 0x7f8050164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:30.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.633+0000 7f8055ad3700 1 --2- 172.21.15.80:0/3047785722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f805006c0a0 0x7f8050072fa0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:30.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.633+0000 7f8055ad3700 1 -- 172.21.15.80:0/3047785722 shutdown_connections 2019-11-28T11:36:30.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.633+0000 7f8055ad3700 1 -- 172.21.15.80:0/3047785722 wait complete. 2019-11-28T11:36:30.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.634+0000 7f8055ad3700 1 -- 172.21.15.80:0/3047785722 >> 172.21.15.80:0/3047785722 conn(0x7f8050061cf0 msgr2=0x7f8050064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:30.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.636+0000 7f8055ad3700 1 Processor -- start 2019-11-28T11:36:30.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.636+0000 7f8055ad3700 1 -- start start 2019-11-28T11:36:30.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f8055ad3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8050104820 0x7f805010c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:30.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f8055ad3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f805010b9d0 0x7f8050167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:30.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f8055ad3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805013bcd0 con 0x7f805010c890 2019-11-28T11:36:30.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f8055ad3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8050109130 con 0x7f8050104820 2019-11-28T11:36:30.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f8055ad3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8050109400 con 0x7f805010b9d0 2019-11-28T11:36:30.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f8047fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f805010c890 0x7f805010b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35730/0 (socket says 172.21.15.80:35730) 2019-11-28T11:36:30.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f8047fff700 1 -- 172.21.15.80:0/4026010988 learned_addr learned my addr 172.21.15.80:0/4026010988 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:30.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f804ffff700 1 --2- 172.21.15.80:0/4026010988 >> v2:172.21.15.174:3300/0 conn(0x7f8050104820 0x7f805010c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:30.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f8054871700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f805010b9d0 0x7f8050167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:30.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f804d7fa700 1 -- 172.21.15.80:0/4026010988 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009194341 0 0) 0x7f80380009b0 con 0x7f805010c890 2019-11-28T11:36:30.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f804d7fa700 1 -- 172.21.15.80:0/4026010988 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8028002e80 con 0x7f805010c890 2019-11-28T11:36:30.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f804ffff700 1 -- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f805010b9d0 msgr2=0x7f8050167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:30.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f804ffff700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f805010b9d0 0x7f8050167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:30.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f804ffff700 1 -- 172.21.15.80:0/4026010988 >> v1:172.21.15.80:6789/0 conn(0x7f805010c890 legacy=0x7f805010b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:30.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f804ffff700 1 -- 172.21.15.80:0/4026010988 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8050109a90 con 0x7f8050104820 2019-11-28T11:36:30.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f8054871700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f805010b9d0 0x7f8050167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:30.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f804ffff700 1 --2- 172.21.15.80:0/4026010988 >> v2:172.21.15.174:3300/0 conn(0x7f8050104820 0x7f805010c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8040010380 tx=0x7f8040010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:30.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f804ffff700 1 --2- 172.21.15.80:0/4026010988 >> v2:172.21.15.174:3300/0 conn(0x7f8050104820 0x7f805010c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8040010380 tx=0x7f8040010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:30.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.637+0000 7f804ffff700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8050104820 0x7f805010c350 secure :-1 s=READY pgs=626 cs=0 l=1 rx=0x7f8040010380 tx=0x7f8040010720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:30.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.638+0000 7f804ffff700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8050104820 0x7f805010c350 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7f8040010380 tx=0x7f8040010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:30.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.638+0000 7f804d7fa700 1 -- 172.21.15.80:0/4026010988 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80400029a0 con 0x7f8050104820 2019-11-28T11:36:30.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.638+0000 7f804ffff700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8050104820 0x7f805010c350 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7f8040010380 tx=0x7f8040010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:30.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.638+0000 7f804ffff700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8050104820 0x7f805010c350 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7f8040010380 tx=0x7f8040010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:30.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.638+0000 7f804d7fa700 1 -- 172.21.15.80:0/4026010988 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8040000b30 con 0x7f8050104820 2019-11-28T11:36:30.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.638+0000 7f8055ad3700 1 -- 172.21.15.80:0/4026010988 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8050109e10 con 0x7f8050104820 2019-11-28T11:36:30.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.638+0000 7f804d7fa700 1 -- 172.21.15.80:0/4026010988 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8040001240 con 0x7f8050104820 2019-11-28T11:36:30.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.638+0000 7f8055ad3700 1 -- 172.21.15.80:0/4026010988 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8050109a90 con 0x7f8050104820 2019-11-28T11:36:30.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.638+0000 7f804ffff700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8050104820 0x7f805010c350 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7f8040010380 tx=0x7f8040010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:30.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.638+0000 7f804d7fa700 1 -- 172.21.15.80:0/4026010988 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8040000d20 con 0x7f8050104820 2019-11-28T11:36:30.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.638+0000 7f804ffff700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8050104820 0x7f805010c350 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7f8040010380 tx=0x7f8040010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:30.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.638+0000 7f804d7fa700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8028018770 0x7f802801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:30.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.638+0000 7f804d7fa700 1 -- 172.21.15.80:0/4026010988 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8040031a60 con 0x7f8050104820 2019-11-28T11:36:30.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.639+0000 7f8047fff700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8028018770 0x7f802801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:30.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.639+0000 7f8047fff700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8028018770 0x7f802801abe0 crc :-1 s=READY pgs=428 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:30.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.646+0000 7f8055ad3700 1 -- 172.21.15.80:0/4026010988 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8050109e10 con 0x7f8050104820 2019-11-28T11:36:30.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.650+0000 7f804ffff700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8050104820 0x7f805010c350 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7f8040010380 tx=0x7f8040010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:30.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.650+0000 7f804d7fa700 1 -- 172.21.15.80:0/4026010988 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8040007230 con 0x7f8050104820 2019-11-28T11:36:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.823+0000 7f8055ad3700 1 -- 172.21.15.80:0/4026010988 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8050109a90 con 0x7f8050104820 2019-11-28T11:36:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.823+0000 7f804ffff700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8050104820 0x7f805010c350 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7f8040010380 tx=0x7f8040010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.823+0000 7f804d7fa700 1 -- 172.21.15.80:0/4026010988 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f8040001730 con 0x7f8050104820 2019-11-28T11:36:30.889 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:30.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.826+0000 7f8055ad3700 1 -- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8028018770 msgr2=0x7f802801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:30.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.826+0000 7f8055ad3700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8028018770 0x7f802801abe0 crc :-1 s=READY pgs=428 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:30.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.826+0000 7f8055ad3700 1 -- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8050104820 msgr2=0x7f805010c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:30.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.826+0000 7f8055ad3700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8050104820 0x7f805010c350 secure :-1 s=READY pgs=626 cs=0 l=1 rx=0x7f8040010380 tx=0x7f8040010720).stop 2019-11-28T11:36:30.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.826+0000 7f8055ad3700 1 -- 172.21.15.80:0/4026010988 shutdown_connections 2019-11-28T11:36:30.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.826+0000 7f8055ad3700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8028018770 0x7f802801abe0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:30.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.826+0000 7f8055ad3700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f805010b9d0 0x7f8050167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:30.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.826+0000 7f8055ad3700 1 --2- 172.21.15.80:0/4026010988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8050104820 0x7f805010c350 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:30.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.826+0000 7f8055ad3700 1 -- 172.21.15.80:0/4026010988 shutdown_connections 2019-11-28T11:36:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.826+0000 7f8055ad3700 1 -- 172.21.15.80:0/4026010988 wait complete. 2019-11-28T11:36:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:30.826+0000 7f8055ad3700 1 -- 172.21.15.80:0/4026010988 >> 172.21.15.80:0/4026010988 conn(0x7f805013d620 msgr2=0x7f805013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:30.892 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:30.892 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:30.902 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:31.903 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:32.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.979+0000 7f90298ef700 1 Processor -- start 2019-11-28T11:36:32.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.979+0000 7f90298ef700 1 -- start start 2019-11-28T11:36:32.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f90298ef700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902406c0a0 0x7f9024072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:32.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f90298ef700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90240734e0 0x7f9024071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:32.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f90298ef700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902406db00 con 0x7f9024072360 2019-11-28T11:36:32.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f90298ef700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902406f330 con 0x7f90240734e0 2019-11-28T11:36:32.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f90298ef700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90240706c0 con 0x7f902406c0a0 2019-11-28T11:36:32.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f9022ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90240734e0 0x7f9024071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:32.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f9022ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90240734e0 0x7f9024071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36422/0 (socket says 172.21.15.80:36422) 2019-11-28T11:36:32.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f9022ffd700 1 -- 172.21.15.80:0/2113677299 learned_addr learned my addr 172.21.15.80:0/2113677299 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:32.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f90237fe700 1 --2- 172.21.15.80:0/2113677299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902406c0a0 0x7f9024072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:32.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f9022ffd700 1 -- 172.21.15.80:0/2113677299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902406c0a0 msgr2=0x7f9024072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:32.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2113677299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902406c0a0 0x7f9024072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:32.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f9022ffd700 1 -- 172.21.15.80:0/2113677299 >> v1:172.21.15.174:6789/0 conn(0x7f9024072360 legacy=0x7f902406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:32.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f9022ffd700 1 -- 172.21.15.80:0/2113677299 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9024070a40 con 0x7f90240734e0 2019-11-28T11:36:32.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2113677299 >> v2:172.21.15.80:3300/0 conn(0x7f90240734e0 0x7f9024071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f900c00fa40 tx=0x7f900c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:32.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2113677299 >> v2:172.21.15.80:3300/0 conn(0x7f90240734e0 0x7f9024071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f900c00fa40 tx=0x7f900c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:32.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2113677299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90240734e0 0x7f9024071e20 secure :-1 s=READY pgs=1051 cs=0 l=1 rx=0x7f900c00fa40 tx=0x7f900c00fde0).ready entity=mon.0 client_cookie=e02ad7a1b8bdb142 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:32.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2113677299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90240734e0 0x7f9024071e20 secure :-1 s=THROTTLE_DONE pgs=1051 cs=0 l=1 rx=0x7f900c00fa40 tx=0x7f900c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:32.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2113677299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90240734e0 0x7f9024071e20 secure :-1 s=THROTTLE_DONE pgs=1051 cs=0 l=1 rx=0x7f900c00fa40 tx=0x7f900c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:32.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f90227fc700 1 -- 172.21.15.80:0/2113677299 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f900c000ce0 con 0x7f90240734e0 2019-11-28T11:36:32.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.980+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2113677299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90240734e0 0x7f9024071e20 secure :-1 s=THROTTLE_DONE pgs=1051 cs=0 l=1 rx=0x7f900c00fa40 tx=0x7f900c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:32.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.981+0000 7f90227fc700 1 -- 172.21.15.80:0/2113677299 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c001010 con 0x7f90240734e0 2019-11-28T11:36:32.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.981+0000 7f90227fc700 1 -- 172.21.15.80:0/2113677299 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f900c001720 con 0x7f90240734e0 2019-11-28T11:36:32.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.981+0000 7f90298ef700 1 -- 172.21.15.80:0/2113677299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90240734e0 msgr2=0x7f9024071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:32.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.981+0000 7f90298ef700 1 --2- 172.21.15.80:0/2113677299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90240734e0 0x7f9024071e20 secure :-1 s=READY pgs=1051 cs=0 l=1 rx=0x7f900c00fa40 tx=0x7f900c00fde0).stop 2019-11-28T11:36:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.981+0000 7f90298ef700 1 -- 172.21.15.80:0/2113677299 shutdown_connections 2019-11-28T11:36:32.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.981+0000 7f90298ef700 1 --2- 172.21.15.80:0/2113677299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90240734e0 0x7f9024071e20 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:32.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.981+0000 7f90298ef700 1 --2- 172.21.15.80:0/2113677299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902406c0a0 0x7f9024072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:32.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.981+0000 7f90298ef700 1 -- 172.21.15.80:0/2113677299 shutdown_connections 2019-11-28T11:36:32.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.981+0000 7f90298ef700 1 -- 172.21.15.80:0/2113677299 wait complete. 2019-11-28T11:36:32.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.981+0000 7f90298ef700 1 -- 172.21.15.80:0/2113677299 >> 172.21.15.80:0/2113677299 conn(0x7f9024061cf0 msgr2=0x7f9024064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:32.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.984+0000 7f90298ef700 1 Processor -- start 2019-11-28T11:36:32.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.984+0000 7f90298ef700 1 -- start start 2019-11-28T11:36:32.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.985+0000 7f90298ef700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90241281b0 0x7f9024128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.985+0000 7f90298ef700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9024139a60 con 0x7f902413a780 2019-11-28T11:36:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.985+0000 7f90298ef700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902413b060 con 0x7f9024128b80 2019-11-28T11:36:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.985+0000 7f90298ef700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902412a260 con 0x7f90241281b0 2019-11-28T11:36:32.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.985+0000 7f90237fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f902413a780 0x7f902412d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35744/0 (socket says 172.21.15.80:35744) 2019-11-28T11:36:32.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.985+0000 7f90237fe700 1 -- 172.21.15.80:0/2610403898 learned_addr learned my addr 172.21.15.80:0/2610403898 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:32.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.985+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90241281b0 0x7f9024128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:32.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.985+0000 7f901bfff700 1 -- 172.21.15.80:0/2610403898 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350692611 0 0) 0x7f901c0057b0 con 0x7f902413a780 2019-11-28T11:36:32.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.985+0000 7f901bfff700 1 -- 172.21.15.80:0/2610403898 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ffc002e80 con 0x7f902413a780 2019-11-28T11:36:32.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.985+0000 7f901bfff700 1 -- 172.21.15.80:0/2610403898 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002336317 0 0) 0x7f90140009b0 con 0x7f9024128b80 2019-11-28T11:36:32.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.985+0000 7f901bfff700 1 -- 172.21.15.80:0/2610403898 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ffc0030b0 con 0x7f9024128b80 2019-11-28T11:36:32.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.985+0000 7f901bfff700 1 -- 172.21.15.80:0/2610403898 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2614434370 0 0) 0x7f901c000dc0 con 0x7f902413a780 2019-11-28T11:36:32.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.985+0000 7f901bfff700 1 -- 172.21.15.80:0/2610403898 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8ffc004680 con 0x7f902413a780 2019-11-28T11:36:32.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.985+0000 7f901bfff700 1 -- 172.21.15.80:0/2610403898 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f901c001310 con 0x7f902413a780 2019-11-28T11:36:32.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.986+0000 7f9022ffd700 1 -- 172.21.15.80:0/2610403898 >> v1:172.21.15.174:6789/0 conn(0x7f9024128b80 legacy=0x7f9024167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:32.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.986+0000 7f9022ffd700 1 -- 172.21.15.80:0/2610403898 >> v1:172.21.15.80:6789/0 conn(0x7f902413a780 legacy=0x7f902412d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:32.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.986+0000 7f9022ffd700 1 -- 172.21.15.80:0/2610403898 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902412abc0 con 0x7f90241281b0 2019-11-28T11:36:32.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.986+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90241281b0 0x7f9024128640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:32.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.986+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90241281b0 0x7f9024128640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:32.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.986+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90241281b0 0x7f9024128640 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:32.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.986+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90241281b0 0x7f9024128640 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:32.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.986+0000 7f901bfff700 1 -- 172.21.15.80:0/2610403898 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f900c000cc0 con 0x7f90241281b0 2019-11-28T11:36:32.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.986+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90241281b0 0x7f9024128640 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.986+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90241281b0 0x7f9024128640 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.986+0000 7f901bfff700 1 -- 172.21.15.80:0/2610403898 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c0012d0 con 0x7f90241281b0 2019-11-28T11:36:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.986+0000 7f901bfff700 1 -- 172.21.15.80:0/2610403898 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f900c000cc0 con 0x7f90241281b0 2019-11-28T11:36:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.986+0000 7f90298ef700 1 -- 172.21.15.80:0/2610403898 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902412af40 con 0x7f90241281b0 2019-11-28T11:36:32.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.986+0000 7f90298ef700 1 -- 172.21.15.80:0/2610403898 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902412abc0 con 0x7f90241281b0 2019-11-28T11:36:32.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.986+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90241281b0 0x7f9024128640 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:32.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.987+0000 7f901bfff700 1 -- 172.21.15.80:0/2610403898 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f900c000ed0 con 0x7f90241281b0 2019-11-28T11:36:32.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.987+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90241281b0 0x7f9024128640 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:32.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.987+0000 7f901bfff700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ffc018780 0x7f8ffc01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:32.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.987+0000 7f901bfff700 1 -- 172.21.15.80:0/2610403898 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f900c031e20 con 0x7f90241281b0 2019-11-28T11:36:32.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.987+0000 7f90237fe700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ffc018780 0x7f8ffc01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:32.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.987+0000 7f90237fe700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ffc018780 0x7f8ffc01abf0 crc :-1 s=READY pgs=429 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:32.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.994+0000 7f90298ef700 1 -- 172.21.15.80:0/2610403898 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902412af40 con 0x7f90241281b0 2019-11-28T11:36:32.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.998+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90241281b0 0x7f9024128640 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:32.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:31.998+0000 7f901bfff700 1 -- 172.21.15.80:0/2610403898 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f900c009f60 con 0x7f90241281b0 2019-11-28T11:36:32.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:32.169+0000 7f90298ef700 1 -- 172.21.15.80:0/2610403898 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f902412abc0 con 0x7f90241281b0 2019-11-28T11:36:32.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:32.170+0000 7f9022ffd700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90241281b0 0x7f9024128640 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:32.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:32.170+0000 7f901bfff700 1 -- 172.21.15.80:0/2610403898 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f900c009f60 con 0x7f90241281b0 2019-11-28T11:36:32.229 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:32.230 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:32.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:32.172+0000 7f90298ef700 1 -- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ffc018780 msgr2=0x7f8ffc01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:32.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:32.172+0000 7f90298ef700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ffc018780 0x7f8ffc01abf0 crc :-1 s=READY pgs=429 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:32.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:32.172+0000 7f90298ef700 1 -- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90241281b0 msgr2=0x7f9024128640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:32.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:32.172+0000 7f90298ef700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90241281b0 0x7f9024128640 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).stop 2019-11-28T11:36:32.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:32.172+0000 7f90298ef700 1 -- 172.21.15.80:0/2610403898 shutdown_connections 2019-11-28T11:36:32.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:32.172+0000 7f90298ef700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ffc018780 0x7f8ffc01abf0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:32.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:32.172+0000 7f90298ef700 1 --2- 172.21.15.80:0/2610403898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90241281b0 0x7f9024128640 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:32.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:32.172+0000 7f90298ef700 1 -- 172.21.15.80:0/2610403898 shutdown_connections 2019-11-28T11:36:32.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:32.172+0000 7f90298ef700 1 -- 172.21.15.80:0/2610403898 wait complete. 2019-11-28T11:36:32.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:32.172+0000 7f90298ef700 1 -- 172.21.15.80:0/2610403898 >> 172.21.15.80:0/2610403898 conn(0x7f9024127dc0 msgr2=0x7f9024141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:32.241 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:33.242 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:33.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.303+0000 7f8123b29700 1 Processor -- start 2019-11-28T11:36:33.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.304+0000 7f8123b29700 1 -- start start 2019-11-28T11:36:33.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f8123b29700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c06c0a0 0x7f811c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:33.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f8123b29700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f811c072620 0x7f811c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:33.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f8123b29700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811c06db00 con 0x7f811c0734e0 2019-11-28T11:36:33.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f8123b29700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811c06f330 con 0x7f811c072620 2019-11-28T11:36:33.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f8123b29700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811c0706c0 con 0x7f811c06c0a0 2019-11-28T11:36:33.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f81220c6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c06c0a0 0x7f811c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:33.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f81228c7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f811c072620 0x7f811c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:33.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f81220c6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c06c0a0 0x7f811c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:38694/0 (socket says 172.21.15.80:38694) 2019-11-28T11:36:33.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f81228c7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f811c072620 0x7f811c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:51324/0 (socket says 172.21.15.80:51324) 2019-11-28T11:36:33.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f81220c6700 1 -- 172.21.15.80:0/2688038226 learned_addr learned my addr 172.21.15.80:0/2688038226 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:33.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f81220c6700 1 -- 172.21.15.80:0/2688038226 >> v2:172.21.15.174:3300/0 conn(0x7f811c072620 msgr2=0x7f811c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:33.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f81220c6700 1 --2- 172.21.15.80:0/2688038226 >> v2:172.21.15.174:3300/0 conn(0x7f811c072620 0x7f811c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:33.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f81220c6700 1 -- 172.21.15.80:0/2688038226 >> v1:172.21.15.174:6789/0 conn(0x7f811c0734e0 legacy=0x7f811c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:33.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f81210c4700 1 -- 172.21.15.80:0/2688038226 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204504799 0 0) 0x7f810c001080 con 0x7f811c0734e0 2019-11-28T11:36:33.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f81220c6700 1 -- 172.21.15.80:0/2688038226 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c070a40 con 0x7f811c06c0a0 2019-11-28T11:36:33.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f81228c7700 1 --2- 172.21.15.80:0/2688038226 >> v2:172.21.15.174:3300/0 conn(0x7f811c072620 0x7f811c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:33.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.305+0000 7f81220c6700 1 --2- 172.21.15.80:0/2688038226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c06c0a0 0x7f811c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f810400f740 tx=0x7f810400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:33.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.306+0000 7f81220c6700 1 --2- 172.21.15.80:0/2688038226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c06c0a0 0x7f811c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f810400f740 tx=0x7f810400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:33.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.306+0000 7f81220c6700 1 --2- 172.21.15.80:0/2688038226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c06c0a0 0x7f811c072fa0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f810400f740 tx=0x7f810400fae0).ready entity=mon.2 client_cookie=8cd81f8f4ea1e9ff server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:33.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.306+0000 7f81220c6700 1 --2- 172.21.15.80:0/2688038226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c06c0a0 0x7f811c072fa0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f810400f740 tx=0x7f810400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:33.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.306+0000 7f81210c4700 1 -- 172.21.15.80:0/2688038226 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8104000960 con 0x7f811c06c0a0 2019-11-28T11:36:33.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.306+0000 7f81220c6700 1 --2- 172.21.15.80:0/2688038226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c06c0a0 0x7f811c072fa0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f810400f740 tx=0x7f810400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:33.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.306+0000 7f81220c6700 1 --2- 172.21.15.80:0/2688038226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c06c0a0 0x7f811c072fa0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f810400f740 tx=0x7f810400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:33.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.306+0000 7f81210c4700 1 -- 172.21.15.80:0/2688038226 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8104000c90 con 0x7f811c06c0a0 2019-11-28T11:36:33.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.306+0000 7f81210c4700 1 -- 172.21.15.80:0/2688038226 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81040013a0 con 0x7f811c06c0a0 2019-11-28T11:36:33.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.306+0000 7f8123b29700 1 -- 172.21.15.80:0/2688038226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c06c0a0 msgr2=0x7f811c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:33.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.306+0000 7f8123b29700 1 --2- 172.21.15.80:0/2688038226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c06c0a0 0x7f811c072fa0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f810400f740 tx=0x7f810400fae0).stop 2019-11-28T11:36:33.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.307+0000 7f8123b29700 1 -- 172.21.15.80:0/2688038226 shutdown_connections 2019-11-28T11:36:33.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.307+0000 7f8123b29700 1 --2- 172.21.15.80:0/2688038226 >> v2:172.21.15.174:3300/0 conn(0x7f811c072620 0x7f811c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:33.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.307+0000 7f8123b29700 1 --2- 172.21.15.80:0/2688038226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c06c0a0 0x7f811c072fa0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:33.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.307+0000 7f8123b29700 1 -- 172.21.15.80:0/2688038226 shutdown_connections 2019-11-28T11:36:33.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.307+0000 7f8123b29700 1 -- 172.21.15.80:0/2688038226 wait complete. 2019-11-28T11:36:33.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.307+0000 7f8123b29700 1 -- 172.21.15.80:0/2688038226 >> 172.21.15.80:0/2688038226 conn(0x7f811c061cf0 msgr2=0x7f811c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:33.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.309+0000 7f8123b29700 1 Processor -- start 2019-11-28T11:36:33.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.309+0000 7f8123b29700 1 -- start start 2019-11-28T11:36:33.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f8123b29700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c104c10 0x7f811c1050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:33.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f8123b29700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f811c1055e0 0x7f811c167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:33.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f8123b29700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811c105a30 con 0x7f811c104820 2019-11-28T11:36:33.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f8123b29700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811c109130 con 0x7f811c1055e0 2019-11-28T11:36:33.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f8123b29700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811c109400 con 0x7f811c104c10 2019-11-28T11:36:33.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f81220c6700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f811c104820 0x7f811c10c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35756/0 (socket says 172.21.15.80:35756) 2019-11-28T11:36:33.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f81228c7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f811c1055e0 0x7f811c167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:33.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f81220c6700 1 -- 172.21.15.80:0/1063467643 learned_addr learned my addr 172.21.15.80:0/1063467643 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:33.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f81218c5700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c104c10 0x7f811c1050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:33.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f81228c7700 1 -- 172.21.15.80:0/1063467643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c104c10 msgr2=0x7f811c1050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:33.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f81228c7700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c104c10 0x7f811c1050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:33.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f81228c7700 1 -- 172.21.15.80:0/1063467643 >> v1:172.21.15.80:6789/0 conn(0x7f811c104820 legacy=0x7f811c10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:33.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f811affd700 1 -- 172.21.15.80:0/1063467643 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657484141 0 0) 0x7f81040075d0 con 0x7f811c104820 2019-11-28T11:36:33.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f81228c7700 1 -- 172.21.15.80:0/1063467643 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c109a90 con 0x7f811c1055e0 2019-11-28T11:36:33.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f81218c5700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c104c10 0x7f811c1050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:36:33.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f81228c7700 1 --2- 172.21.15.80:0/1063467643 >> v2:172.21.15.80:3300/0 conn(0x7f811c1055e0 0x7f811c167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8114010700 tx=0x7f8114010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:33.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.310+0000 7f81228c7700 1 --2- 172.21.15.80:0/1063467643 >> v2:172.21.15.80:3300/0 conn(0x7f811c1055e0 0x7f811c167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8114010700 tx=0x7f8114010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:33.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.311+0000 7f81228c7700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c1055e0 0x7f811c167a10 secure :-1 s=READY pgs=1054 cs=0 l=1 rx=0x7f8114010700 tx=0x7f8114010aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:33.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.311+0000 7f81228c7700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c1055e0 0x7f811c167a10 secure :-1 s=THROTTLE_DONE pgs=1054 cs=0 l=1 rx=0x7f8114010700 tx=0x7f8114010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:33.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.311+0000 7f811affd700 1 -- 172.21.15.80:0/1063467643 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f811400af10 con 0x7f811c1055e0 2019-11-28T11:36:33.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.311+0000 7f81228c7700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c1055e0 0x7f811c167a10 secure :-1 s=THROTTLE_DONE pgs=1054 cs=0 l=1 rx=0x7f8114010700 tx=0x7f8114010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.311+0000 7f81228c7700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c1055e0 0x7f811c167a10 secure :-1 s=THROTTLE_DONE pgs=1054 cs=0 l=1 rx=0x7f8114010700 tx=0x7f8114010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.311+0000 7f811affd700 1 -- 172.21.15.80:0/1063467643 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8114009b20 con 0x7f811c1055e0 2019-11-28T11:36:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.311+0000 7f811affd700 1 -- 172.21.15.80:0/1063467643 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f811400a230 con 0x7f811c1055e0 2019-11-28T11:36:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.311+0000 7f8123b29700 1 -- 172.21.15.80:0/1063467643 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811c109e10 con 0x7f811c1055e0 2019-11-28T11:36:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.311+0000 7f8123b29700 1 -- 172.21.15.80:0/1063467643 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811c109a90 con 0x7f811c1055e0 2019-11-28T11:36:33.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.312+0000 7f81228c7700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c1055e0 0x7f811c167a10 secure :-1 s=THROTTLE_DONE pgs=1054 cs=0 l=1 rx=0x7f8114010700 tx=0x7f8114010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:33.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.312+0000 7f811affd700 1 -- 172.21.15.80:0/1063467643 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8114009930 con 0x7f811c1055e0 2019-11-28T11:36:33.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.312+0000 7f81228c7700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c1055e0 0x7f811c167a10 secure :-1 s=THROTTLE_DONE pgs=1054 cs=0 l=1 rx=0x7f8114010700 tx=0x7f8114010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:33.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.312+0000 7f811affd700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8100018730 0x7f810001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:33.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.312+0000 7f811affd700 1 -- 172.21.15.80:0/1063467643 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8114031d80 con 0x7f811c1055e0 2019-11-28T11:36:33.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.312+0000 7f81220c6700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8100018730 0x7f810001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:33.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.312+0000 7f81220c6700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8100018730 0x7f810001abc0 crc :-1 s=READY pgs=430 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:33.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.319+0000 7f8123b29700 1 -- 172.21.15.80:0/1063467643 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811c109e10 con 0x7f811c1055e0 2019-11-28T11:36:33.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.322+0000 7f81228c7700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c1055e0 0x7f811c167a10 secure :-1 s=THROTTLE_DONE pgs=1054 cs=0 l=1 rx=0x7f8114010700 tx=0x7f8114010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:33.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.322+0000 7f811affd700 1 -- 172.21.15.80:0/1063467643 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8114000df0 con 0x7f811c1055e0 2019-11-28T11:36:33.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.493+0000 7f8123b29700 1 -- 172.21.15.80:0/1063467643 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f811c109a90 con 0x7f811c1055e0 2019-11-28T11:36:33.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.494+0000 7f81228c7700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c1055e0 0x7f811c167a10 secure :-1 s=THROTTLE_DONE pgs=1054 cs=0 l=1 rx=0x7f8114010700 tx=0x7f8114010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:33.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.494+0000 7f811affd700 1 -- 172.21.15.80:0/1063467643 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f8114009930 con 0x7f811c1055e0 2019-11-28T11:36:33.554 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:33.555 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:33.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.496+0000 7f8123b29700 1 -- 172.21.15.80:0/1063467643 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8100018730 msgr2=0x7f810001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:33.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.496+0000 7f8123b29700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8100018730 0x7f810001abc0 crc :-1 s=READY pgs=430 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:33.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.496+0000 7f8123b29700 1 -- 172.21.15.80:0/1063467643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c1055e0 msgr2=0x7f811c167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:33.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.496+0000 7f8123b29700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c1055e0 0x7f811c167a10 secure :-1 s=READY pgs=1054 cs=0 l=1 rx=0x7f8114010700 tx=0x7f8114010aa0).stop 2019-11-28T11:36:33.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.496+0000 7f8123b29700 1 -- 172.21.15.80:0/1063467643 shutdown_connections 2019-11-28T11:36:33.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.496+0000 7f8123b29700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8100018730 0x7f810001abc0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:33.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.496+0000 7f8123b29700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f811c1055e0 0x7f811c167a10 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:33.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.496+0000 7f8123b29700 1 --2- 172.21.15.80:0/1063467643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f811c104c10 0x7f811c1050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:33.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.497+0000 7f8123b29700 1 -- 172.21.15.80:0/1063467643 shutdown_connections 2019-11-28T11:36:33.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.497+0000 7f8123b29700 1 -- 172.21.15.80:0/1063467643 wait complete. 2019-11-28T11:36:33.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:33.497+0000 7f8123b29700 1 -- 172.21.15.80:0/1063467643 >> 172.21.15.80:0/1063467643 conn(0x7f811c13d620 msgr2=0x7f811c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:33.566 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:34.567 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:34.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.633+0000 7f7fd60a1700 1 Processor -- start 2019-11-28T11:36:34.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.633+0000 7f7fd60a1700 1 -- start start 2019-11-28T11:36:34.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.634+0000 7f7fd60a1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7fd006c0a0 0x7f7fd0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:34.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.634+0000 7f7fd60a1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fd00734e0 0x7f7fd0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:34.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.634+0000 7f7fd60a1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7fd0072360 0x7f7fd0072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:34.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.634+0000 7f7fd60a1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd006fd60 con 0x7f7fd0072360 2019-11-28T11:36:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.634+0000 7f7fd60a1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd0070030 con 0x7f7fd006c0a0 2019-11-28T11:36:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.634+0000 7f7fd60a1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd006f330 con 0x7f7fd00734e0 2019-11-28T11:36:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.634+0000 7f7fd4e3f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7fd0072360 0x7f7fd0072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.634+0000 7f7fd4e3f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7fd0072360 0x7f7fd0072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36452/0 (socket says 172.21.15.80:36452) 2019-11-28T11:36:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.634+0000 7f7fd4e3f700 1 -- 172.21.15.80:0/2568264635 learned_addr learned my addr 172.21.15.80:0/2568264635 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fc7fff700 1 --2- 172.21.15.80:0/2568264635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fd00734e0 0x7f7fd0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fcffff700 1 --2- 172.21.15.80:0/2568264635 >> v2:172.21.15.174:3300/0 conn(0x7f7fd006c0a0 0x7f7fd0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fd4e3f700 1 -- 172.21.15.80:0/2568264635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fd00734e0 msgr2=0x7f7fd0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/2568264635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fd00734e0 0x7f7fd0071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fd4e3f700 1 -- 172.21.15.80:0/2568264635 >> v2:172.21.15.174:3300/0 conn(0x7f7fd006c0a0 msgr2=0x7f7fd0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/2568264635 >> v2:172.21.15.174:3300/0 conn(0x7f7fd006c0a0 0x7f7fd0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fd4e3f700 1 -- 172.21.15.80:0/2568264635 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd00706c0 con 0x7f7fd0072360 2019-11-28T11:36:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/2568264635 >> v2:172.21.15.80:3300/0 conn(0x7f7fd0072360 0x7f7fd0072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7fc800fa30 tx=0x7f7fc80080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/2568264635 >> v2:172.21.15.80:3300/0 conn(0x7f7fd0072360 0x7f7fd0072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7fc800fa30 tx=0x7f7fc80080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/2568264635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0072360 0x7f7fd0072800 secure :-1 s=READY pgs=1055 cs=0 l=1 rx=0x7f7fc800fa30 tx=0x7f7fc80080d0).ready entity=mon.0 client_cookie=6550869b7e2a2b9e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/2568264635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0072360 0x7f7fd0072800 secure :-1 s=THROTTLE_DONE pgs=1055 cs=0 l=1 rx=0x7f7fc800fa30 tx=0x7f7fc80080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/2568264635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0072360 0x7f7fd0072800 secure :-1 s=THROTTLE_DONE pgs=1055 cs=0 l=1 rx=0x7f7fc800fa30 tx=0x7f7fc80080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fcf7fe700 1 -- 172.21.15.80:0/2568264635 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fc8000df0 con 0x7f7fd0072360 2019-11-28T11:36:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/2568264635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0072360 0x7f7fd0072800 secure :-1 s=THROTTLE_DONE pgs=1055 cs=0 l=1 rx=0x7f7fc800fa30 tx=0x7f7fc80080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fcf7fe700 1 -- 172.21.15.80:0/2568264635 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc8001460 con 0x7f7fd0072360 2019-11-28T11:36:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fcf7fe700 1 -- 172.21.15.80:0/2568264635 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fc8001bb0 con 0x7f7fd0072360 2019-11-28T11:36:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fd60a1700 1 -- 172.21.15.80:0/2568264635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0072360 msgr2=0x7f7fd0072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.635+0000 7f7fd60a1700 1 --2- 172.21.15.80:0/2568264635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0072360 0x7f7fd0072800 secure :-1 s=READY pgs=1055 cs=0 l=1 rx=0x7f7fc800fa30 tx=0x7f7fc80080d0).stop 2019-11-28T11:36:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.636+0000 7f7fd60a1700 1 -- 172.21.15.80:0/2568264635 shutdown_connections 2019-11-28T11:36:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.636+0000 7f7fd60a1700 1 --2- 172.21.15.80:0/2568264635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0072360 0x7f7fd0072800 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.636+0000 7f7fd60a1700 1 --2- 172.21.15.80:0/2568264635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fd00734e0 0x7f7fd0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.636+0000 7f7fd60a1700 1 --2- 172.21.15.80:0/2568264635 >> v2:172.21.15.174:3300/0 conn(0x7f7fd006c0a0 0x7f7fd0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.636+0000 7f7fd60a1700 1 -- 172.21.15.80:0/2568264635 shutdown_connections 2019-11-28T11:36:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.636+0000 7f7fd60a1700 1 -- 172.21.15.80:0/2568264635 wait complete. 2019-11-28T11:36:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.636+0000 7f7fd60a1700 1 -- 172.21.15.80:0/2568264635 >> 172.21.15.80:0/2568264635 conn(0x7f7fd0061cf0 msgr2=0x7f7fd0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.638+0000 7f7fd60a1700 1 Processor -- start 2019-11-28T11:36:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.638+0000 7f7fd60a1700 1 -- start start 2019-11-28T11:36:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.639+0000 7f7fd60a1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fd013dc00 0x7f7fd0109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.639+0000 7f7fd60a1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7fd010a3a0 0x7f7fd0108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.639+0000 7f7fd60a1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7fd0109220 0x7f7fd0109680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.639+0000 7f7fd60a1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd0104e00 con 0x7f7fd0109220 2019-11-28T11:36:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.639+0000 7f7fd60a1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd0105830 con 0x7f7fd010a3a0 2019-11-28T11:36:34.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.639+0000 7f7fd60a1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd0106190 con 0x7f7fd013dc00 2019-11-28T11:36:34.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.639+0000 7f7fd4e3f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7fd0109220 0x7f7fd0109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:34.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.639+0000 7f7fd4e3f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7fd0109220 0x7f7fd0109680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36458/0 (socket says 172.21.15.80:36458) 2019-11-28T11:36:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.639+0000 7f7fd4e3f700 1 -- 172.21.15.80:0/977601546 learned_addr learned my addr 172.21.15.80:0/977601546 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fc7fff700 1 --2- 172.21.15.80:0/977601546 >> v2:172.21.15.174:3300/0 conn(0x7f7fd010a3a0 0x7f7fd0108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fcffff700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fd013dc00 0x7f7fd0109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fd4e3f700 1 -- 172.21.15.80:0/977601546 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fd013dc00 msgr2=0x7f7fd0109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fd013dc00 0x7f7fd0109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fd4e3f700 1 -- 172.21.15.80:0/977601546 >> v2:172.21.15.174:3300/0 conn(0x7f7fd010a3a0 msgr2=0x7f7fd0108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/977601546 >> v2:172.21.15.174:3300/0 conn(0x7f7fd010a3a0 0x7f7fd0108ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fd4e3f700 1 -- 172.21.15.80:0/977601546 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd0106510 con 0x7f7fd0109220 2019-11-28T11:36:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/977601546 >> v2:172.21.15.80:3300/0 conn(0x7f7fd0109220 0x7f7fd0109680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7fc80547c0 tx=0x7f7fc80546c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/977601546 >> v2:172.21.15.80:3300/0 conn(0x7f7fd0109220 0x7f7fd0109680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7fc80547c0 tx=0x7f7fc80546c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0109220 0x7f7fd0109680 secure :-1 s=READY pgs=1056 cs=0 l=1 rx=0x7f7fc80547c0 tx=0x7f7fc80546c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0109220 0x7f7fd0109680 secure :-1 s=THROTTLE_DONE pgs=1056 cs=0 l=1 rx=0x7f7fc80547c0 tx=0x7f7fc80546c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:34.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fcd7fa700 1 -- 172.21.15.80:0/977601546 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fc8001910 con 0x7f7fd0109220 2019-11-28T11:36:34.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fd60a1700 1 -- 172.21.15.80:0/977601546 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd0106510 con 0x7f7fd0109220 2019-11-28T11:36:34.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0109220 0x7f7fd0109680 secure :-1 s=THROTTLE_DONE pgs=1056 cs=0 l=1 rx=0x7f7fc80547c0 tx=0x7f7fc80546c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:34.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fd60a1700 1 -- 172.21.15.80:0/977601546 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd0106510 con 0x7f7fd0109220 2019-11-28T11:36:34.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0109220 0x7f7fd0109680 secure :-1 s=THROTTLE_DONE pgs=1056 cs=0 l=1 rx=0x7f7fc80547c0 tx=0x7f7fc80546c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:34.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fcd7fa700 1 -- 172.21.15.80:0/977601546 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc8001230 con 0x7f7fd0109220 2019-11-28T11:36:34.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fcd7fa700 1 -- 172.21.15.80:0/977601546 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fc8001b20 con 0x7f7fd0109220 2019-11-28T11:36:34.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.640+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0109220 0x7f7fd0109680 secure :-1 s=THROTTLE_DONE pgs=1056 cs=0 l=1 rx=0x7f7fc80547c0 tx=0x7f7fc80546c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:34.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.641+0000 7f7fcd7fa700 1 -- 172.21.15.80:0/977601546 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7fc8001420 con 0x7f7fd0109220 2019-11-28T11:36:34.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.641+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0109220 0x7f7fd0109680 secure :-1 s=THROTTLE_DONE pgs=1056 cs=0 l=1 rx=0x7f7fc80547c0 tx=0x7f7fc80546c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:34.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.641+0000 7f7fcd7fa700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7fb4018730 0x7f7fb401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:34.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.641+0000 7f7fcd7fa700 1 -- 172.21.15.80:0/977601546 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f7fc8075da0 con 0x7f7fd0109220 2019-11-28T11:36:34.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.641+0000 7f7fcffff700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7fb4018730 0x7f7fb401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:34.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.641+0000 7f7fcffff700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7fb4018730 0x7f7fb401abc0 crc :-1 s=READY pgs=431 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:34.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.648+0000 7f7fd60a1700 1 -- 172.21.15.80:0/977601546 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd0106510 con 0x7f7fd0109220 2019-11-28T11:36:34.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.652+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0109220 0x7f7fd0109680 secure :-1 s=THROTTLE_DONE pgs=1056 cs=0 l=1 rx=0x7f7fc80547c0 tx=0x7f7fc80546c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:34.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.652+0000 7f7fcd7fa700 1 -- 172.21.15.80:0/977601546 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7fc805b7b0 con 0x7f7fd0109220 2019-11-28T11:36:34.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.824+0000 7f7fd60a1700 1 -- 172.21.15.80:0/977601546 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fd0106510 con 0x7f7fd0109220 2019-11-28T11:36:34.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.825+0000 7f7fd4e3f700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0109220 0x7f7fd0109680 secure :-1 s=THROTTLE_DONE pgs=1056 cs=0 l=1 rx=0x7f7fc80547c0 tx=0x7f7fc80546c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:34.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.825+0000 7f7fcd7fa700 1 -- 172.21.15.80:0/977601546 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f7fc805b7b0 con 0x7f7fd0109220 2019-11-28T11:36:34.885 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:34.886 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:34.886 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:34.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.827+0000 7f7fd60a1700 1 -- 172.21.15.80:0/977601546 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7fb4018730 msgr2=0x7f7fb401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:34.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.827+0000 7f7fd60a1700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7fb4018730 0x7f7fb401abc0 crc :-1 s=READY pgs=431 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:34.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.827+0000 7f7fd60a1700 1 -- 172.21.15.80:0/977601546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0109220 msgr2=0x7f7fd0109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:34.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.827+0000 7f7fd60a1700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0109220 0x7f7fd0109680 secure :-1 s=READY pgs=1056 cs=0 l=1 rx=0x7f7fc80547c0 tx=0x7f7fc80546c0).stop 2019-11-28T11:36:34.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.827+0000 7f7fd60a1700 1 -- 172.21.15.80:0/977601546 shutdown_connections 2019-11-28T11:36:34.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.827+0000 7f7fd60a1700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7fb4018730 0x7f7fb401abc0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:34.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.827+0000 7f7fd60a1700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fd0109220 0x7f7fd0109680 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:34.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.827+0000 7f7fd60a1700 1 --2- 172.21.15.80:0/977601546 >> v2:172.21.15.174:3300/0 conn(0x7f7fd010a3a0 0x7f7fd0108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:34.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.827+0000 7f7fd60a1700 1 --2- 172.21.15.80:0/977601546 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fd013dc00 0x7f7fd0109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:34.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.828+0000 7f7fd60a1700 1 -- 172.21.15.80:0/977601546 shutdown_connections 2019-11-28T11:36:34.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.828+0000 7f7fd60a1700 1 -- 172.21.15.80:0/977601546 wait complete. 2019-11-28T11:36:34.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:34.828+0000 7f7fd60a1700 1 -- 172.21.15.80:0/977601546 >> 172.21.15.80:0/977601546 conn(0x7f7fd011bfc0 msgr2=0x7f7fd0141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:34.897 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:35.898 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:36.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.974+0000 7f89f0c6d700 1 Processor -- start 2019-11-28T11:36:36.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.974+0000 7f89f0c6d700 1 -- start start 2019-11-28T11:36:36.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89f0c6d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89ec06c490 0x7f89ec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:36.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89f0c6d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f89ec06ce60 0x7f89ec164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:36.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89f0c6d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ec06db00 con 0x7f89ec06c0a0 2019-11-28T11:36:36.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89f0c6d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ec06fd60 con 0x7f89ec06ce60 2019-11-28T11:36:36.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89f0c6d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec070030 con 0x7f89ec06c490 2019-11-28T11:36:36.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89eb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f89ec06ce60 0x7f89ec164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:36.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89eb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f89ec06ce60 0x7f89ec164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36466/0 (socket says 172.21.15.80:36466) 2019-11-28T11:36:36.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89eb59e700 1 -- 172.21.15.80:0/2162463866 learned_addr learned my addr 172.21.15.80:0/2162463866 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:36.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89ea59c700 1 --2- 172.21.15.80:0/2162463866 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89ec06c490 0x7f89ec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:36.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89eb59e700 1 -- 172.21.15.80:0/2162463866 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89ec06c490 msgr2=0x7f89ec06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:36.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89eb59e700 1 --2- 172.21.15.80:0/2162463866 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89ec06c490 0x7f89ec06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:36.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89eb59e700 1 -- 172.21.15.80:0/2162463866 >> v1:172.21.15.174:6789/0 conn(0x7f89ec06c0a0 legacy=0x7f89ec072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:36.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89eb59e700 1 -- 172.21.15.80:0/2162463866 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec0706c0 con 0x7f89ec06ce60 2019-11-28T11:36:36.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89eb59e700 1 --2- 172.21.15.80:0/2162463866 >> v2:172.21.15.80:3300/0 conn(0x7f89ec06ce60 0x7f89ec164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f89e400f730 tx=0x7f89e4007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:36.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89eb59e700 1 --2- 172.21.15.80:0/2162463866 >> v2:172.21.15.80:3300/0 conn(0x7f89ec06ce60 0x7f89ec164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f89e400f730 tx=0x7f89e4007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:36.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89eb59e700 1 --2- 172.21.15.80:0/2162463866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec06ce60 0x7f89ec164d70 secure :-1 s=READY pgs=1057 cs=0 l=1 rx=0x7f89e400f730 tx=0x7f89e4007d50).ready entity=mon.0 client_cookie=29246f62098805d4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:36.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89eb59e700 1 --2- 172.21.15.80:0/2162463866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec06ce60 0x7f89ec164d70 secure :-1 s=THROTTLE_DONE pgs=1057 cs=0 l=1 rx=0x7f89e400f730 tx=0x7f89e4007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:36.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89e9d9b700 1 -- 172.21.15.80:0/2162463866 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e4000a70 con 0x7f89ec06ce60 2019-11-28T11:36:36.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89eb59e700 1 --2- 172.21.15.80:0/2162463866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec06ce60 0x7f89ec164d70 secure :-1 s=THROTTLE_DONE pgs=1057 cs=0 l=1 rx=0x7f89e400f730 tx=0x7f89e4007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:36.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89eb59e700 1 --2- 172.21.15.80:0/2162463866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec06ce60 0x7f89ec164d70 secure :-1 s=THROTTLE_DONE pgs=1057 cs=0 l=1 rx=0x7f89e400f730 tx=0x7f89e4007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:36.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89e9d9b700 1 -- 172.21.15.80:0/2162463866 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e40010e0 con 0x7f89ec06ce60 2019-11-28T11:36:36.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89e9d9b700 1 -- 172.21.15.80:0/2162463866 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e40017b0 con 0x7f89ec06ce60 2019-11-28T11:36:36.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89f0c6d700 1 -- 172.21.15.80:0/2162463866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec06ce60 msgr2=0x7f89ec164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:36.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.976+0000 7f89f0c6d700 1 --2- 172.21.15.80:0/2162463866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec06ce60 0x7f89ec164d70 secure :-1 s=READY pgs=1057 cs=0 l=1 rx=0x7f89e400f730 tx=0x7f89e4007d50).stop 2019-11-28T11:36:36.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.977+0000 7f89f0c6d700 1 -- 172.21.15.80:0/2162463866 shutdown_connections 2019-11-28T11:36:36.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.977+0000 7f89f0c6d700 1 --2- 172.21.15.80:0/2162463866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec06ce60 0x7f89ec164d70 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:36.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.977+0000 7f89f0c6d700 1 --2- 172.21.15.80:0/2162463866 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89ec06c490 0x7f89ec06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:36.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.977+0000 7f89f0c6d700 1 -- 172.21.15.80:0/2162463866 shutdown_connections 2019-11-28T11:36:36.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.977+0000 7f89f0c6d700 1 -- 172.21.15.80:0/2162463866 wait complete. 2019-11-28T11:36:36.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.977+0000 7f89f0c6d700 1 -- 172.21.15.80:0/2162463866 >> 172.21.15.80:0/2162463866 conn(0x7f89ec061cf0 msgr2=0x7f89ec064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:36.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.980+0000 7f89f0c6d700 1 Processor -- start 2019-11-28T11:36:36.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.980+0000 7f89f0c6d700 1 -- start start 2019-11-28T11:36:36.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89f0c6d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f89ec159980 0x7f89ec10c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:36.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89f0c6d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89ec10cba0 0x7f89ec1af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:36.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89f0c6d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ec13b920 con 0x7f89ec159590 2019-11-28T11:36:36.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89f0c6d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ec141450 con 0x7f89ec159980 2019-11-28T11:36:36.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89f0c6d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec10a890 con 0x7f89ec10cba0 2019-11-28T11:36:36.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89ea59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f89ec159980 0x7f89ec10c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:36.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89ea59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f89ec159980 0x7f89ec10c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36470/0 (socket says 172.21.15.80:36470) 2019-11-28T11:36:36.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89ea59c700 1 -- 172.21.15.80:0/2012688673 learned_addr learned my addr 172.21.15.80:0/2012688673 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:36.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89eb59e700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89ec10cba0 0x7f89ec1af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:36.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89ea59c700 1 -- 172.21.15.80:0/2012688673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89ec10cba0 msgr2=0x7f89ec1af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:36.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89ea59c700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89ec10cba0 0x7f89ec1af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:36.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89ea59c700 1 -- 172.21.15.80:0/2012688673 >> v1:172.21.15.174:6789/0 conn(0x7f89ec159590 legacy=0x7f89ec15fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:36.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89ea59c700 1 -- 172.21.15.80:0/2012688673 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec10af20 con 0x7f89ec159980 2019-11-28T11:36:36.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89e37fe700 1 -- 172.21.15.80:0/2012688673 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553533967 0 0) 0x7f89dc000ff0 con 0x7f89ec159590 2019-11-28T11:36:36.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89ea59c700 1 --2- 172.21.15.80:0/2012688673 >> v2:172.21.15.80:3300/0 conn(0x7f89ec159980 0x7f89ec10c660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f89d4010780 tx=0x7f89d4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:36.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89ea59c700 1 --2- 172.21.15.80:0/2012688673 >> v2:172.21.15.80:3300/0 conn(0x7f89ec159980 0x7f89ec10c660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f89d4010780 tx=0x7f89d4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:36.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89ea59c700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec159980 0x7f89ec10c660 secure :-1 s=READY pgs=1058 cs=0 l=1 rx=0x7f89d4010780 tx=0x7f89d4010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:36.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89ea59c700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec159980 0x7f89ec10c660 secure :-1 s=THROTTLE_DONE pgs=1058 cs=0 l=1 rx=0x7f89d4010780 tx=0x7f89d4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:36.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89ea59c700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec159980 0x7f89ec10c660 secure :-1 s=THROTTLE_DONE pgs=1058 cs=0 l=1 rx=0x7f89d4010780 tx=0x7f89d4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:36.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89e37fe700 1 -- 172.21.15.80:0/2012688673 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89d4000cc0 con 0x7f89ec159980 2019-11-28T11:36:36.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89ea59c700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec159980 0x7f89ec10c660 secure :-1 s=THROTTLE_DONE pgs=1058 cs=0 l=1 rx=0x7f89d4010780 tx=0x7f89d4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:36.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89e37fe700 1 -- 172.21.15.80:0/2012688673 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d4001410 con 0x7f89ec159980 2019-11-28T11:36:36.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89f0c6d700 1 -- 172.21.15.80:0/2012688673 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ec10b2a0 con 0x7f89ec159980 2019-11-28T11:36:36.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.981+0000 7f89e37fe700 1 -- 172.21.15.80:0/2012688673 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89d4001a20 con 0x7f89ec159980 2019-11-28T11:36:36.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.982+0000 7f89f0c6d700 1 -- 172.21.15.80:0/2012688673 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ec10a300 con 0x7f89ec159980 2019-11-28T11:36:36.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.982+0000 7f89ea59c700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec159980 0x7f89ec10c660 secure :-1 s=THROTTLE_DONE pgs=1058 cs=0 l=1 rx=0x7f89d4010780 tx=0x7f89d4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:36.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.982+0000 7f89e37fe700 1 -- 172.21.15.80:0/2012688673 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f89d4001010 con 0x7f89ec159980 2019-11-28T11:36:36.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.982+0000 7f89ea59c700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec159980 0x7f89ec10c660 secure :-1 s=THROTTLE_DONE pgs=1058 cs=0 l=1 rx=0x7f89d4010780 tx=0x7f89d4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:36.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.982+0000 7f89e37fe700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89d0018730 0x7f89d001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:36.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.982+0000 7f89e37fe700 1 -- 172.21.15.80:0/2012688673 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f89d4031e50 con 0x7f89ec159980 2019-11-28T11:36:36.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.982+0000 7f89ead9d700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89d0018730 0x7f89d001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:36.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.983+0000 7f89ead9d700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89d0018730 0x7f89d001abc0 crc :-1 s=READY pgs=432 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:36.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.989+0000 7f89f0c6d700 1 -- 172.21.15.80:0/2012688673 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ec10af20 con 0x7f89ec159980 2019-11-28T11:36:36.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.993+0000 7f89ea59c700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec159980 0x7f89ec10c660 secure :-1 s=THROTTLE_DONE pgs=1058 cs=0 l=1 rx=0x7f89d4010780 tx=0x7f89d4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:36.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:35.993+0000 7f89e37fe700 1 -- 172.21.15.80:0/2012688673 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f89d4000cc0 con 0x7f89ec159980 2019-11-28T11:36:36.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:36.166+0000 7f89f0c6d700 1 -- 172.21.15.80:0/2012688673 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89ec10b2a0 con 0x7f89ec159980 2019-11-28T11:36:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:36.167+0000 7f89ea59c700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec159980 0x7f89ec10c660 secure :-1 s=THROTTLE_DONE pgs=1058 cs=0 l=1 rx=0x7f89d4010780 tx=0x7f89d4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:36.167+0000 7f89e37fe700 1 -- 172.21.15.80:0/2012688673 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f89d4001010 con 0x7f89ec159980 2019-11-28T11:36:36.227 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:36.227 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:36.228 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:36.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:36.169+0000 7f89f0c6d700 1 -- 172.21.15.80:0/2012688673 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89d0018730 msgr2=0x7f89d001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:36.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:36.169+0000 7f89f0c6d700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89d0018730 0x7f89d001abc0 crc :-1 s=READY pgs=432 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:36.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:36.169+0000 7f89f0c6d700 1 -- 172.21.15.80:0/2012688673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec159980 msgr2=0x7f89ec10c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:36.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:36.169+0000 7f89f0c6d700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec159980 0x7f89ec10c660 secure :-1 s=READY pgs=1058 cs=0 l=1 rx=0x7f89d4010780 tx=0x7f89d4010600).stop 2019-11-28T11:36:36.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:36.169+0000 7f89f0c6d700 1 -- 172.21.15.80:0/2012688673 shutdown_connections 2019-11-28T11:36:36.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:36.169+0000 7f89f0c6d700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89ec10cba0 0x7f89ec1af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:36.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:36.169+0000 7f89f0c6d700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89ec159980 0x7f89ec10c660 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:36.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:36.169+0000 7f89f0c6d700 1 --2- 172.21.15.80:0/2012688673 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89d0018730 0x7f89d001abc0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:36.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:36.169+0000 7f89f0c6d700 1 -- 172.21.15.80:0/2012688673 shutdown_connections 2019-11-28T11:36:36.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:36.169+0000 7f89f0c6d700 1 -- 172.21.15.80:0/2012688673 wait complete. 2019-11-28T11:36:36.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:36.169+0000 7f89f0c6d700 1 -- 172.21.15.80:0/2012688673 >> 172.21.15.80:0/2012688673 conn(0x7f89ec141950 msgr2=0x7f89ec14fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:36.238 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:37.240 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:37.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.305+0000 7fe641571700 1 Processor -- start 2019-11-28T11:36:37.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.305+0000 7fe641571700 1 -- start start 2019-11-28T11:36:37.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.306+0000 7fe641571700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe63c06c490 0x7fe63c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:37.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.306+0000 7fe641571700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe63c06ce60 0x7fe63c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:37.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.306+0000 7fe641571700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63c06db00 con 0x7fe63c06c0a0 2019-11-28T11:36:37.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.306+0000 7fe641571700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63c06fd60 con 0x7fe63c06ce60 2019-11-28T11:36:37.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.306+0000 7fe641571700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63c070030 con 0x7fe63c06c490 2019-11-28T11:36:37.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.306+0000 7fe63bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe63c06ce60 0x7fe63c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:37.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.306+0000 7fe63b7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe63c06c0a0 0x7fe63c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35792/0 (socket says 172.21.15.80:35792) 2019-11-28T11:36:37.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.306+0000 7fe63b7fe700 1 -- 172.21.15.80:0/1217322690 learned_addr learned my addr 172.21.15.80:0/1217322690 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:37.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe63bfff700 1 -- 172.21.15.80:0/1217322690 >> v2:172.21.15.174:3300/0 conn(0x7fe63c06c490 msgr2=0x7fe63c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:37.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe63affd700 1 --2- 172.21.15.80:0/1217322690 >> v2:172.21.15.174:3300/0 conn(0x7fe63c06c490 0x7fe63c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:37.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe63bfff700 1 --2- 172.21.15.80:0/1217322690 >> v2:172.21.15.174:3300/0 conn(0x7fe63c06c490 0x7fe63c06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:37.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe63bfff700 1 -- 172.21.15.80:0/1217322690 >> v1:172.21.15.80:6789/0 conn(0x7fe63c06c0a0 legacy=0x7fe63c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:37.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe63a7fc700 1 -- 172.21.15.80:0/1217322690 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257442414 0 0) 0x7fe62c001150 con 0x7fe63c06c0a0 2019-11-28T11:36:37.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe63bfff700 1 -- 172.21.15.80:0/1217322690 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c0706c0 con 0x7fe63c06ce60 2019-11-28T11:36:37.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe63bfff700 1 --2- 172.21.15.80:0/1217322690 >> v2:172.21.15.80:3300/0 conn(0x7fe63c06ce60 0x7fe63c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe63400af50 tx=0x7fe63400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:37.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe63bfff700 1 --2- 172.21.15.80:0/1217322690 >> v2:172.21.15.80:3300/0 conn(0x7fe63c06ce60 0x7fe63c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe63400af50 tx=0x7fe63400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:37.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe63bfff700 1 --2- 172.21.15.80:0/1217322690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c06ce60 0x7fe63c164d70 secure :-1 s=READY pgs=1060 cs=0 l=1 rx=0x7fe63400af50 tx=0x7fe63400b6e0).ready entity=mon.0 client_cookie=1d3efe423051e660 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:37.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe63bfff700 1 --2- 172.21.15.80:0/1217322690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c06ce60 0x7fe63c164d70 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7fe63400af50 tx=0x7fe63400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:37.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe63a7fc700 1 -- 172.21.15.80:0/1217322690 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe634009ba0 con 0x7fe63c06ce60 2019-11-28T11:36:37.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe63bfff700 1 --2- 172.21.15.80:0/1217322690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c06ce60 0x7fe63c164d70 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7fe63400af50 tx=0x7fe63400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:37.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe63bfff700 1 --2- 172.21.15.80:0/1217322690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c06ce60 0x7fe63c164d70 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7fe63400af50 tx=0x7fe63400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:37.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe63a7fc700 1 -- 172.21.15.80:0/1217322690 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6340097c0 con 0x7fe63c06ce60 2019-11-28T11:36:37.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe63a7fc700 1 -- 172.21.15.80:0/1217322690 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63400a180 con 0x7fe63c06ce60 2019-11-28T11:36:37.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe641571700 1 -- 172.21.15.80:0/1217322690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c06ce60 msgr2=0x7fe63c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:37.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.307+0000 7fe641571700 1 --2- 172.21.15.80:0/1217322690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c06ce60 0x7fe63c164d70 secure :-1 s=READY pgs=1060 cs=0 l=1 rx=0x7fe63400af50 tx=0x7fe63400b6e0).stop 2019-11-28T11:36:37.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.308+0000 7fe641571700 1 -- 172.21.15.80:0/1217322690 shutdown_connections 2019-11-28T11:36:37.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.308+0000 7fe641571700 1 --2- 172.21.15.80:0/1217322690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c06ce60 0x7fe63c164d70 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:37.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.308+0000 7fe641571700 1 --2- 172.21.15.80:0/1217322690 >> v2:172.21.15.174:3300/0 conn(0x7fe63c06c490 0x7fe63c06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:37.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.308+0000 7fe641571700 1 -- 172.21.15.80:0/1217322690 shutdown_connections 2019-11-28T11:36:37.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.308+0000 7fe641571700 1 -- 172.21.15.80:0/1217322690 wait complete. 2019-11-28T11:36:37.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.308+0000 7fe641571700 1 -- 172.21.15.80:0/1217322690 >> 172.21.15.80:0/1217322690 conn(0x7fe63c061cf0 msgr2=0x7fe63c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.310+0000 7fe641571700 1 Processor -- start 2019-11-28T11:36:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.310+0000 7fe641571700 1 -- start start 2019-11-28T11:36:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.311+0000 7fe641571700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe63c164ff0 0x7fe63c1653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.311+0000 7fe641571700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe63c133cb0 0x7fe63c132ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.311+0000 7fe641571700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63c131680 con 0x7fe63c133820 2019-11-28T11:36:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.311+0000 7fe641571700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63c10dd90 con 0x7fe63c164ff0 2019-11-28T11:36:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.311+0000 7fe641571700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63c10e060 con 0x7fe63c133cb0 2019-11-28T11:36:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.311+0000 7fe63b7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe63c164ff0 0x7fe63c1653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.311+0000 7fe63b7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe63c164ff0 0x7fe63c1653e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36482/0 (socket says 172.21.15.80:36482) 2019-11-28T11:36:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.311+0000 7fe63b7fe700 1 -- 172.21.15.80:0/174195315 learned_addr learned my addr 172.21.15.80:0/174195315 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.311+0000 7fe63b7fe700 1 -- 172.21.15.80:0/174195315 >> v2:172.21.15.174:3300/0 conn(0x7fe63c133cb0 msgr2=0x7fe63c132ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.311+0000 7fe63bfff700 1 --2- 172.21.15.80:0/174195315 >> v2:172.21.15.174:3300/0 conn(0x7fe63c133cb0 0x7fe63c132ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.311+0000 7fe63b7fe700 1 --2- 172.21.15.80:0/174195315 >> v2:172.21.15.174:3300/0 conn(0x7fe63c133cb0 0x7fe63c132ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.311+0000 7fe63b7fe700 1 -- 172.21.15.80:0/174195315 >> v1:172.21.15.174:6789/0 conn(0x7fe63c133820 legacy=0x7fe63c1326a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.311+0000 7fe63b7fe700 1 -- 172.21.15.80:0/174195315 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c10e6f0 con 0x7fe63c164ff0 2019-11-28T11:36:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.311+0000 7fe63b7fe700 1 --2- 172.21.15.80:0/174195315 >> v2:172.21.15.80:3300/0 conn(0x7fe63c164ff0 0x7fe63c1653e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe62c010430 tx=0x7fe62c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.311+0000 7fe63b7fe700 1 --2- 172.21.15.80:0/174195315 >> v2:172.21.15.80:3300/0 conn(0x7fe63c164ff0 0x7fe63c1653e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe62c010430 tx=0x7fe62c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.311+0000 7fe63b7fe700 1 --2- 172.21.15.80:0/174195315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c164ff0 0x7fe63c1653e0 secure :-1 s=READY pgs=1061 cs=0 l=1 rx=0x7fe62c010430 tx=0x7fe62c010260).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.312+0000 7fe63b7fe700 1 --2- 172.21.15.80:0/174195315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c164ff0 0x7fe63c1653e0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7fe62c010430 tx=0x7fe62c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.312+0000 7fe63b7fe700 1 --2- 172.21.15.80:0/174195315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c164ff0 0x7fe63c1653e0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7fe62c010430 tx=0x7fe62c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.312+0000 7fe633fff700 1 -- 172.21.15.80:0/174195315 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe62c000ed0 con 0x7fe63c164ff0 2019-11-28T11:36:37.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.312+0000 7fe63b7fe700 1 --2- 172.21.15.80:0/174195315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c164ff0 0x7fe63c1653e0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7fe62c010430 tx=0x7fe62c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:37.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.312+0000 7fe633fff700 1 -- 172.21.15.80:0/174195315 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c004430 con 0x7fe63c164ff0 2019-11-28T11:36:37.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.312+0000 7fe633fff700 1 -- 172.21.15.80:0/174195315 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe62c004a80 con 0x7fe63c164ff0 2019-11-28T11:36:37.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.312+0000 7fe641571700 1 -- 172.21.15.80:0/174195315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63c10ea70 con 0x7fe63c164ff0 2019-11-28T11:36:37.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.312+0000 7fe641571700 1 -- 172.21.15.80:0/174195315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63c10e6f0 con 0x7fe63c164ff0 2019-11-28T11:36:37.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.312+0000 7fe63b7fe700 1 --2- 172.21.15.80:0/174195315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c164ff0 0x7fe63c1653e0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7fe62c010430 tx=0x7fe62c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:37.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.312+0000 7fe633fff700 1 -- 172.21.15.80:0/174195315 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe62c004620 con 0x7fe63c164ff0 2019-11-28T11:36:37.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.312+0000 7fe63b7fe700 1 --2- 172.21.15.80:0/174195315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c164ff0 0x7fe63c1653e0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7fe62c010430 tx=0x7fe62c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:37.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.312+0000 7fe633fff700 1 --2- 172.21.15.80:0/174195315 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe614018730 0x7fe61401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:37.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.312+0000 7fe633fff700 1 -- 172.21.15.80:0/174195315 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fe62c031b00 con 0x7fe63c164ff0 2019-11-28T11:36:37.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.313+0000 7fe63affd700 1 --2- 172.21.15.80:0/174195315 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe614018730 0x7fe61401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:37.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.313+0000 7fe63affd700 1 --2- 172.21.15.80:0/174195315 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe614018730 0x7fe61401abc0 crc :-1 s=READY pgs=433 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:37.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.321+0000 7fe641571700 1 -- 172.21.15.80:0/174195315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63c10ea70 con 0x7fe63c164ff0 2019-11-28T11:36:37.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.324+0000 7fe63b7fe700 1 --2- 172.21.15.80:0/174195315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c164ff0 0x7fe63c1653e0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7fe62c010430 tx=0x7fe62c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:37.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.324+0000 7fe633fff700 1 -- 172.21.15.80:0/174195315 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe62c0012b0 con 0x7fe63c164ff0 2019-11-28T11:36:37.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.495+0000 7fe641571700 1 -- 172.21.15.80:0/174195315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe63c10e6f0 con 0x7fe63c164ff0 2019-11-28T11:36:37.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.496+0000 7fe63b7fe700 1 --2- 172.21.15.80:0/174195315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c164ff0 0x7fe63c1653e0 secure :-1 s=THROTTLE_DONE pgs=1061 cs=0 l=1 rx=0x7fe62c010430 tx=0x7fe62c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:37.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.496+0000 7fe633fff700 1 -- 172.21.15.80:0/174195315 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fe62c004620 con 0x7fe63c164ff0 2019-11-28T11:36:37.555 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:37.555 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:37.556 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.498+0000 7fe641571700 1 -- 172.21.15.80:0/174195315 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe614018730 msgr2=0x7fe61401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.498+0000 7fe641571700 1 --2- 172.21.15.80:0/174195315 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe614018730 0x7fe61401abc0 crc :-1 s=READY pgs=433 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.498+0000 7fe641571700 1 -- 172.21.15.80:0/174195315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c164ff0 msgr2=0x7fe63c1653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.498+0000 7fe641571700 1 --2- 172.21.15.80:0/174195315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c164ff0 0x7fe63c1653e0 secure :-1 s=READY pgs=1061 cs=0 l=1 rx=0x7fe62c010430 tx=0x7fe62c010260).stop 2019-11-28T11:36:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.498+0000 7fe641571700 1 -- 172.21.15.80:0/174195315 shutdown_connections 2019-11-28T11:36:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.498+0000 7fe641571700 1 --2- 172.21.15.80:0/174195315 >> v2:172.21.15.174:3300/0 conn(0x7fe63c133cb0 0x7fe63c132ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.498+0000 7fe641571700 1 --2- 172.21.15.80:0/174195315 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe614018730 0x7fe61401abc0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:37.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.498+0000 7fe641571700 1 --2- 172.21.15.80:0/174195315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63c164ff0 0x7fe63c1653e0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:37.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.498+0000 7fe641571700 1 -- 172.21.15.80:0/174195315 shutdown_connections 2019-11-28T11:36:37.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.498+0000 7fe641571700 1 -- 172.21.15.80:0/174195315 wait complete. 2019-11-28T11:36:37.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:37.498+0000 7fe641571700 1 -- 172.21.15.80:0/174195315 >> 172.21.15.80:0/174195315 conn(0x7fe63c11bfc0 msgr2=0x7fe63c141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:37.566 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:38.567 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:38.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.627+0000 7fc13b1a1700 1 Processor -- start 2019-11-28T11:36:38.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.627+0000 7fc13b1a1700 1 -- start start 2019-11-28T11:36:38.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.628+0000 7fc13b1a1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc13406c490 0x7fc13406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:38.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.628+0000 7fc13b1a1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc13406ce60 0x7fc134164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:38.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.628+0000 7fc13b1a1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13406db00 con 0x7fc13406c0a0 2019-11-28T11:36:38.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.628+0000 7fc13b1a1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13406fd60 con 0x7fc13406c490 2019-11-28T11:36:38.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.628+0000 7fc13b1a1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc134070030 con 0x7fc13406ce60 2019-11-28T11:36:38.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.628+0000 7fc138f3d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc13406c490 0x7fc13406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:38.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.628+0000 7fc13973e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc13406c0a0 0x7fc134072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35806/0 (socket says 172.21.15.80:35806) 2019-11-28T11:36:38.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.628+0000 7fc13973e700 1 -- 172.21.15.80:0/893762243 learned_addr learned my addr 172.21.15.80:0/893762243 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:38.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc139f3f700 1 --2- 172.21.15.80:0/893762243 >> v2:172.21.15.174:3300/0 conn(0x7fc13406ce60 0x7fc134164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:38.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc138f3d700 1 -- 172.21.15.80:0/893762243 >> v2:172.21.15.174:3300/0 conn(0x7fc13406ce60 msgr2=0x7fc134164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:38.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc138f3d700 1 --2- 172.21.15.80:0/893762243 >> v2:172.21.15.174:3300/0 conn(0x7fc13406ce60 0x7fc134164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:38.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc138f3d700 1 -- 172.21.15.80:0/893762243 >> v1:172.21.15.80:6789/0 conn(0x7fc13406c0a0 legacy=0x7fc134072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:38.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc138f3d700 1 -- 172.21.15.80:0/893762243 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1340706c0 con 0x7fc13406c490 2019-11-28T11:36:38.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc133fff700 1 -- 172.21.15.80:0/893762243 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046264372 0 0) 0x7fc11c0014d0 con 0x7fc13406c0a0 2019-11-28T11:36:38.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc139f3f700 1 --2- 172.21.15.80:0/893762243 >> v2:172.21.15.174:3300/0 conn(0x7fc13406ce60 0x7fc134164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:36:38.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc138f3d700 1 --2- 172.21.15.80:0/893762243 >> v2:172.21.15.80:3300/0 conn(0x7fc13406c490 0x7fc13406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc12400af50 tx=0x7fc12400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:38.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc138f3d700 1 --2- 172.21.15.80:0/893762243 >> v2:172.21.15.80:3300/0 conn(0x7fc13406c490 0x7fc13406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc12400af50 tx=0x7fc12400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:38.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc138f3d700 1 --2- 172.21.15.80:0/893762243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13406c490 0x7fc13406c920 secure :-1 s=READY pgs=1063 cs=0 l=1 rx=0x7fc12400af50 tx=0x7fc12400b760).ready entity=mon.0 client_cookie=5682f5c705a13fdc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:38.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc138f3d700 1 --2- 172.21.15.80:0/893762243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13406c490 0x7fc13406c920 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7fc12400af50 tx=0x7fc12400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:38.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc133fff700 1 -- 172.21.15.80:0/893762243 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc124007210 con 0x7fc13406c490 2019-11-28T11:36:38.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc138f3d700 1 --2- 172.21.15.80:0/893762243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13406c490 0x7fc13406c920 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7fc12400af50 tx=0x7fc12400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:38.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc138f3d700 1 --2- 172.21.15.80:0/893762243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13406c490 0x7fc13406c920 secure :-1 s=THROTTLE_DONE pgs=1063 cs=0 l=1 rx=0x7fc12400af50 tx=0x7fc12400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:38.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc133fff700 1 -- 172.21.15.80:0/893762243 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1240099b0 con 0x7fc13406c490 2019-11-28T11:36:38.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc133fff700 1 -- 172.21.15.80:0/893762243 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc12400a080 con 0x7fc13406c490 2019-11-28T11:36:38.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc13b1a1700 1 -- 172.21.15.80:0/893762243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13406c490 msgr2=0x7fc13406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.629+0000 7fc13b1a1700 1 --2- 172.21.15.80:0/893762243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13406c490 0x7fc13406c920 secure :-1 s=READY pgs=1063 cs=0 l=1 rx=0x7fc12400af50 tx=0x7fc12400b760).stop 2019-11-28T11:36:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.630+0000 7fc13b1a1700 1 -- 172.21.15.80:0/893762243 shutdown_connections 2019-11-28T11:36:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.630+0000 7fc13b1a1700 1 --2- 172.21.15.80:0/893762243 >> v2:172.21.15.174:3300/0 conn(0x7fc13406ce60 0x7fc134164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.630+0000 7fc13b1a1700 1 --2- 172.21.15.80:0/893762243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13406c490 0x7fc13406c920 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.630+0000 7fc13b1a1700 1 -- 172.21.15.80:0/893762243 shutdown_connections 2019-11-28T11:36:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.630+0000 7fc13b1a1700 1 -- 172.21.15.80:0/893762243 wait complete. 2019-11-28T11:36:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.630+0000 7fc13b1a1700 1 -- 172.21.15.80:0/893762243 >> 172.21.15.80:0/893762243 conn(0x7fc134061cf0 msgr2=0x7fc134064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:38.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.632+0000 7fc13b1a1700 1 Processor -- start 2019-11-28T11:36:38.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.632+0000 7fc13b1a1700 1 -- start start 2019-11-28T11:36:38.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.633+0000 7fc13b1a1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc13412d840 0x7fc13412dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:38.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.633+0000 7fc13b1a1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc134135c60 con 0x7fc13410cfb0 2019-11-28T11:36:38.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.633+0000 7fc13b1a1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc134101f00 con 0x7fc134104d10 2019-11-28T11:36:38.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.633+0000 7fc13b1a1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc134141e60 con 0x7fc13412d840 2019-11-28T11:36:38.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.633+0000 7fc139f3f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc13412d840 0x7fc13412dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:38.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.633+0000 7fc138f3d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc13410cfb0 0x7fc13410d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35814/0 (socket says 172.21.15.80:35814) 2019-11-28T11:36:38.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.633+0000 7fc138f3d700 1 -- 172.21.15.80:0/3164768583 learned_addr learned my addr 172.21.15.80:0/3164768583 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:38.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.634+0000 7fc139f3f700 1 -- 172.21.15.80:0/3164768583 >> v1:172.21.15.174:6789/0 conn(0x7fc134104d10 legacy=0x7fc13410e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:38.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.634+0000 7fc139f3f700 1 -- 172.21.15.80:0/3164768583 >> v1:172.21.15.80:6789/0 conn(0x7fc13410cfb0 legacy=0x7fc13410d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:38.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.634+0000 7fc131ffb700 1 -- 172.21.15.80:0/3164768583 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531186088 0 0) 0x7fc12400abb0 con 0x7fc13410cfb0 2019-11-28T11:36:38.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.634+0000 7fc139f3f700 1 -- 172.21.15.80:0/3164768583 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1341424f0 con 0x7fc13412d840 2019-11-28T11:36:38.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.634+0000 7fc139f3f700 1 --2- 172.21.15.80:0/3164768583 >> v2:172.21.15.80:3300/0 conn(0x7fc13412d840 0x7fc13412dce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc12c0103b0 tx=0x7fc12c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.634+0000 7fc139f3f700 1 --2- 172.21.15.80:0/3164768583 >> v2:172.21.15.80:3300/0 conn(0x7fc13412d840 0x7fc13412dce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc12c0103b0 tx=0x7fc12c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.634+0000 7fc139f3f700 1 --2- 172.21.15.80:0/3164768583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13412d840 0x7fc13412dce0 secure :-1 s=READY pgs=1065 cs=0 l=1 rx=0x7fc12c0103b0 tx=0x7fc12c010750).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.634+0000 7fc139f3f700 1 --2- 172.21.15.80:0/3164768583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13412d840 0x7fc13412dce0 secure :-1 s=THROTTLE_DONE pgs=1065 cs=0 l=1 rx=0x7fc12c0103b0 tx=0x7fc12c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.634+0000 7fc131ffb700 1 -- 172.21.15.80:0/3164768583 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc12c00bf80 con 0x7fc13412d840 2019-11-28T11:36:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.634+0000 7fc139f3f700 1 --2- 172.21.15.80:0/3164768583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13412d840 0x7fc13412dce0 secure :-1 s=THROTTLE_DONE pgs=1065 cs=0 l=1 rx=0x7fc12c0103b0 tx=0x7fc12c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.634+0000 7fc139f3f700 1 --2- 172.21.15.80:0/3164768583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13412d840 0x7fc13412dce0 secure :-1 s=THROTTLE_DONE pgs=1065 cs=0 l=1 rx=0x7fc12c0103b0 tx=0x7fc12c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.634+0000 7fc131ffb700 1 -- 172.21.15.80:0/3164768583 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12c00bba0 con 0x7fc13412d840 2019-11-28T11:36:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.634+0000 7fc13b1a1700 1 -- 172.21.15.80:0/3164768583 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1341424f0 con 0x7fc13412d840 2019-11-28T11:36:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.634+0000 7fc131ffb700 1 -- 172.21.15.80:0/3164768583 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc12c00c560 con 0x7fc13412d840 2019-11-28T11:36:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.634+0000 7fc13b1a1700 1 -- 172.21.15.80:0/3164768583 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1341424f0 con 0x7fc13412d840 2019-11-28T11:36:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.634+0000 7fc139f3f700 1 --2- 172.21.15.80:0/3164768583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13412d840 0x7fc13412dce0 secure :-1 s=THROTTLE_DONE pgs=1065 cs=0 l=1 rx=0x7fc12c0103b0 tx=0x7fc12c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.635+0000 7fc131ffb700 1 -- 172.21.15.80:0/3164768583 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc12c00bd90 con 0x7fc13412d840 2019-11-28T11:36:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.635+0000 7fc139f3f700 1 --2- 172.21.15.80:0/3164768583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13412d840 0x7fc13412dce0 secure :-1 s=THROTTLE_DONE pgs=1065 cs=0 l=1 rx=0x7fc12c0103b0 tx=0x7fc12c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.635+0000 7fc131ffb700 1 --2- 172.21.15.80:0/3164768583 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc118018730 0x7fc11801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:38.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.635+0000 7fc131ffb700 1 -- 172.21.15.80:0/3164768583 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fc12c031aa0 con 0x7fc13412d840 2019-11-28T11:36:38.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.635+0000 7fc13973e700 1 --2- 172.21.15.80:0/3164768583 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc118018730 0x7fc11801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:38.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.635+0000 7fc13973e700 1 --2- 172.21.15.80:0/3164768583 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc118018730 0x7fc11801abc0 crc :-1 s=READY pgs=434 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:38.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.642+0000 7fc13b1a1700 1 -- 172.21.15.80:0/3164768583 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1341424f0 con 0x7fc13412d840 2019-11-28T11:36:38.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.646+0000 7fc139f3f700 1 --2- 172.21.15.80:0/3164768583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13412d840 0x7fc13412dce0 secure :-1 s=THROTTLE_DONE pgs=1065 cs=0 l=1 rx=0x7fc12c0103b0 tx=0x7fc12c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:38.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.646+0000 7fc131ffb700 1 -- 172.21.15.80:0/3164768583 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc12c00b990 con 0x7fc13412d840 2019-11-28T11:36:38.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.821+0000 7fc13b1a1700 1 -- 172.21.15.80:0/3164768583 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1341424f0 con 0x7fc13412d840 2019-11-28T11:36:38.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.821+0000 7fc139f3f700 1 --2- 172.21.15.80:0/3164768583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13412d840 0x7fc13412dce0 secure :-1 s=THROTTLE_DONE pgs=1065 cs=0 l=1 rx=0x7fc12c0103b0 tx=0x7fc12c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:38.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.821+0000 7fc131ffb700 1 -- 172.21.15.80:0/3164768583 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fc12c00bd90 con 0x7fc13412d840 2019-11-28T11:36:38.881 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:38.881 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:38.881 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.823+0000 7fc13b1a1700 1 -- 172.21.15.80:0/3164768583 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc118018730 msgr2=0x7fc11801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.823+0000 7fc13b1a1700 1 --2- 172.21.15.80:0/3164768583 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc118018730 0x7fc11801abc0 crc :-1 s=READY pgs=434 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:38.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.823+0000 7fc13b1a1700 1 -- 172.21.15.80:0/3164768583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13412d840 msgr2=0x7fc13412dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:38.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.823+0000 7fc13b1a1700 1 --2- 172.21.15.80:0/3164768583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13412d840 0x7fc13412dce0 secure :-1 s=READY pgs=1065 cs=0 l=1 rx=0x7fc12c0103b0 tx=0x7fc12c010750).stop 2019-11-28T11:36:38.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.824+0000 7fc13b1a1700 1 -- 172.21.15.80:0/3164768583 shutdown_connections 2019-11-28T11:36:38.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.824+0000 7fc13b1a1700 1 --2- 172.21.15.80:0/3164768583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc13412d840 0x7fc13412dce0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:38.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.824+0000 7fc13b1a1700 1 --2- 172.21.15.80:0/3164768583 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc118018730 0x7fc11801abc0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:38.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.824+0000 7fc13b1a1700 1 -- 172.21.15.80:0/3164768583 shutdown_connections 2019-11-28T11:36:38.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.824+0000 7fc13b1a1700 1 -- 172.21.15.80:0/3164768583 wait complete. 2019-11-28T11:36:38.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:38.824+0000 7fc13b1a1700 1 -- 172.21.15.80:0/3164768583 >> 172.21.15.80:0/3164768583 conn(0x7fc13415e210 msgr2=0x7fc13410b140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:38.903 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:39.904 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:40.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.966+0000 7f184be7d700 1 Processor -- start 2019-11-28T11:36:40.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.966+0000 7f184be7d700 1 -- start start 2019-11-28T11:36:40.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.967+0000 7f184be7d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184406c0a0 0x7f1844072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:40.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.967+0000 7f184be7d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1844072620 0x7f1844164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:40.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.967+0000 7f184be7d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f184406db00 con 0x7f18440734e0 2019-11-28T11:36:40.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.967+0000 7f184be7d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184406f330 con 0x7f1844072620 2019-11-28T11:36:40.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.967+0000 7f184be7d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18440706c0 con 0x7f184406c0a0 2019-11-28T11:36:40.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.968+0000 7f184a41a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184406c0a0 0x7f1844072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:40.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.968+0000 7f184ac1b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1844072620 0x7f1844164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:40.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.968+0000 7f184a41a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184406c0a0 0x7f1844072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:38764/0 (socket says 172.21.15.80:38764) 2019-11-28T11:36:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.968+0000 7f184a41a700 1 -- 172.21.15.80:0/2095256747 learned_addr learned my addr 172.21.15.80:0/2095256747 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.968+0000 7f184a41a700 1 -- 172.21.15.80:0/2095256747 >> v2:172.21.15.174:3300/0 conn(0x7f1844072620 msgr2=0x7f1844164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.968+0000 7f184a41a700 1 --2- 172.21.15.80:0/2095256747 >> v2:172.21.15.174:3300/0 conn(0x7f1844072620 0x7f1844164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.968+0000 7f184a41a700 1 -- 172.21.15.80:0/2095256747 >> v1:172.21.15.174:6789/0 conn(0x7f18440734e0 legacy=0x7f1844071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:40.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.968+0000 7f184a41a700 1 -- 172.21.15.80:0/2095256747 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1844070a40 con 0x7f184406c0a0 2019-11-28T11:36:40.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.968+0000 7f184ac1b700 1 --2- 172.21.15.80:0/2095256747 >> v2:172.21.15.174:3300/0 conn(0x7f1844072620 0x7f1844164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:40.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.968+0000 7f184a41a700 1 --2- 172.21.15.80:0/2095256747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184406c0a0 0x7f1844072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f183c00f740 tx=0x7f183c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:40.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.968+0000 7f184a41a700 1 --2- 172.21.15.80:0/2095256747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184406c0a0 0x7f1844072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f183c00f740 tx=0x7f183c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:40.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.968+0000 7f184a41a700 1 --2- 172.21.15.80:0/2095256747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184406c0a0 0x7f1844072fa0 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f183c00f740 tx=0x7f183c00fae0).ready entity=mon.2 client_cookie=1c479c1ed1975c9f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:40.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.968+0000 7f184a41a700 1 --2- 172.21.15.80:0/2095256747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184406c0a0 0x7f1844072fa0 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f183c00f740 tx=0x7f183c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:40.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.968+0000 7f184a41a700 1 --2- 172.21.15.80:0/2095256747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184406c0a0 0x7f1844072fa0 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f183c00f740 tx=0x7f183c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:40.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.969+0000 7f184a41a700 1 --2- 172.21.15.80:0/2095256747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184406c0a0 0x7f1844072fa0 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f183c00f740 tx=0x7f183c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:40.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.968+0000 7f1849418700 1 -- 172.21.15.80:0/2095256747 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f183c000960 con 0x7f184406c0a0 2019-11-28T11:36:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.969+0000 7f1849418700 1 -- 172.21.15.80:0/2095256747 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c000c90 con 0x7f184406c0a0 2019-11-28T11:36:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.969+0000 7f1849418700 1 -- 172.21.15.80:0/2095256747 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f183c0013a0 con 0x7f184406c0a0 2019-11-28T11:36:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.969+0000 7f184be7d700 1 -- 172.21.15.80:0/2095256747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184406c0a0 msgr2=0x7f1844072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:40.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.969+0000 7f184be7d700 1 --2- 172.21.15.80:0/2095256747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184406c0a0 0x7f1844072fa0 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f183c00f740 tx=0x7f183c00fae0).stop 2019-11-28T11:36:40.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.969+0000 7f184be7d700 1 -- 172.21.15.80:0/2095256747 shutdown_connections 2019-11-28T11:36:40.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.969+0000 7f184be7d700 1 --2- 172.21.15.80:0/2095256747 >> v2:172.21.15.174:3300/0 conn(0x7f1844072620 0x7f1844164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:40.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.969+0000 7f184be7d700 1 --2- 172.21.15.80:0/2095256747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184406c0a0 0x7f1844072fa0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:40.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.969+0000 7f184be7d700 1 -- 172.21.15.80:0/2095256747 shutdown_connections 2019-11-28T11:36:40.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.969+0000 7f184be7d700 1 -- 172.21.15.80:0/2095256747 wait complete. 2019-11-28T11:36:40.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.969+0000 7f184be7d700 1 -- 172.21.15.80:0/2095256747 >> 172.21.15.80:0/2095256747 conn(0x7f1844061cf0 msgr2=0x7f1844064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:40.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.972+0000 7f184be7d700 1 Processor -- start 2019-11-28T11:36:40.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.972+0000 7f184be7d700 1 -- start start 2019-11-28T11:36:40.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184be7d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f184415d7c0 0x7f184412e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:40.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184be7d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1844159e00 0x7f1844159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:40.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184be7d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1844112260 con 0x7f1844159970 2019-11-28T11:36:40.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184be7d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1844140ff0 con 0x7f184415d7c0 2019-11-28T11:36:40.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184be7d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18441412c0 con 0x7f1844159e00 2019-11-28T11:36:40.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184a41a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f184415d7c0 0x7f184412e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:40.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184a41a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f184415d7c0 0x7f184412e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36510/0 (socket says 172.21.15.80:36510) 2019-11-28T11:36:40.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184a41a700 1 -- 172.21.15.80:0/282257216 learned_addr learned my addr 172.21.15.80:0/282257216 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:40.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184ac1b700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1844159e00 0x7f1844159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:40.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184a41a700 1 -- 172.21.15.80:0/282257216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1844159e00 msgr2=0x7f1844159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:40.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184a41a700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1844159e00 0x7f1844159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:40.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184a41a700 1 -- 172.21.15.80:0/282257216 >> v1:172.21.15.174:6789/0 conn(0x7f1844159970 legacy=0x7f1844158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:40.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184a41a700 1 -- 172.21.15.80:0/282257216 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1844141950 con 0x7f184415d7c0 2019-11-28T11:36:40.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184a41a700 1 --2- 172.21.15.80:0/282257216 >> v2:172.21.15.80:3300/0 conn(0x7f184415d7c0 0x7f184412e690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f183c010440 tx=0x7f183c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:40.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184a41a700 1 --2- 172.21.15.80:0/282257216 >> v2:172.21.15.80:3300/0 conn(0x7f184415d7c0 0x7f184412e690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f183c010440 tx=0x7f183c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:40.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184a41a700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184415d7c0 0x7f184412e690 secure :-1 s=READY pgs=1066 cs=0 l=1 rx=0x7f183c010440 tx=0x7f183c0102f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:40.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184a41a700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184415d7c0 0x7f184412e690 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7f183c010440 tx=0x7f183c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:40.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184a41a700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184415d7c0 0x7f184412e690 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7f183c010440 tx=0x7f183c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:40.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f1842ffd700 1 -- 172.21.15.80:0/282257216 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f183c005560 con 0x7f184415d7c0 2019-11-28T11:36:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184a41a700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184415d7c0 0x7f184412e690 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7f183c010440 tx=0x7f183c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f1842ffd700 1 -- 172.21.15.80:0/282257216 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c005180 con 0x7f184415d7c0 2019-11-28T11:36:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f184be7d700 1 -- 172.21.15.80:0/282257216 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1844141cd0 con 0x7f184415d7c0 2019-11-28T11:36:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.973+0000 7f1842ffd700 1 -- 172.21.15.80:0/282257216 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f183c005b40 con 0x7f184415d7c0 2019-11-28T11:36:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.974+0000 7f184be7d700 1 -- 172.21.15.80:0/282257216 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1844141950 con 0x7f184415d7c0 2019-11-28T11:36:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.974+0000 7f184a41a700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184415d7c0 0x7f184412e690 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7f183c010440 tx=0x7f183c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.974+0000 7f1842ffd700 1 -- 172.21.15.80:0/282257216 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f183c005370 con 0x7f184415d7c0 2019-11-28T11:36:40.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.974+0000 7f184a41a700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184415d7c0 0x7f184412e690 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7f183c010440 tx=0x7f183c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:40.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.974+0000 7f1842ffd700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1824018730 0x7f182401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:40.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.974+0000 7f1842ffd700 1 -- 172.21.15.80:0/282257216 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f183c031ad0 con 0x7f184415d7c0 2019-11-28T11:36:40.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.974+0000 7f1849c19700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1824018730 0x7f182401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:40.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.975+0000 7f1849c19700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1824018730 0x7f182401abc0 crc :-1 s=READY pgs=435 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:40.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.982+0000 7f184be7d700 1 -- 172.21.15.80:0/282257216 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1844141cd0 con 0x7f184415d7c0 2019-11-28T11:36:40.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.985+0000 7f184a41a700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184415d7c0 0x7f184412e690 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7f183c010440 tx=0x7f183c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:40.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:39.985+0000 7f1842ffd700 1 -- 172.21.15.80:0/282257216 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f183c0072a0 con 0x7f184415d7c0 2019-11-28T11:36:40.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:40.156+0000 7f184be7d700 1 -- 172.21.15.80:0/282257216 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1844141950 con 0x7f184415d7c0 2019-11-28T11:36:40.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:40.156+0000 7f184a41a700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184415d7c0 0x7f184412e690 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7f183c010440 tx=0x7f183c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:40.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:40.156+0000 7f1842ffd700 1 -- 172.21.15.80:0/282257216 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f183c005370 con 0x7f184415d7c0 2019-11-28T11:36:40.216 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:40.216 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:40.217 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:40.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:40.159+0000 7f184be7d700 1 -- 172.21.15.80:0/282257216 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1824018730 msgr2=0x7f182401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:40.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:40.159+0000 7f184be7d700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1824018730 0x7f182401abc0 crc :-1 s=READY pgs=435 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:40.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:40.159+0000 7f184be7d700 1 -- 172.21.15.80:0/282257216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184415d7c0 msgr2=0x7f184412e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:40.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:40.159+0000 7f184be7d700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184415d7c0 0x7f184412e690 secure :-1 s=READY pgs=1066 cs=0 l=1 rx=0x7f183c010440 tx=0x7f183c0102f0).stop 2019-11-28T11:36:40.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:40.159+0000 7f184be7d700 1 -- 172.21.15.80:0/282257216 shutdown_connections 2019-11-28T11:36:40.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:40.159+0000 7f184be7d700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1844159e00 0x7f1844159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:40.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:40.159+0000 7f184be7d700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1824018730 0x7f182401abc0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:40.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:40.159+0000 7f184be7d700 1 --2- 172.21.15.80:0/282257216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184415d7c0 0x7f184412e690 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:40.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:40.159+0000 7f184be7d700 1 -- 172.21.15.80:0/282257216 shutdown_connections 2019-11-28T11:36:40.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:40.159+0000 7f184be7d700 1 -- 172.21.15.80:0/282257216 wait complete. 2019-11-28T11:36:40.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:40.159+0000 7f184be7d700 1 -- 172.21.15.80:0/282257216 >> 172.21.15.80:0/282257216 conn(0x7f184413b860 msgr2=0x7f18441050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:40.228 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:41.230 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:41.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.290+0000 7fc589030700 1 Processor -- start 2019-11-28T11:36:41.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.290+0000 7fc589030700 1 -- start start 2019-11-28T11:36:41.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.291+0000 7fc589030700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc58406d120 0x7fc584165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:41.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.291+0000 7fc589030700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58406d5a0 con 0x7fc58406c0a0 2019-11-28T11:36:41.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.291+0000 7fc589030700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58406db00 con 0x7fc58406c490 2019-11-28T11:36:41.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.291+0000 7fc589030700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58406fd60 con 0x7fc58406d120 2019-11-28T11:36:41.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.291+0000 7fc58359e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc58406c0a0 0x7fc584072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35834/0 (socket says 172.21.15.80:35834) 2019-11-28T11:36:41.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.291+0000 7fc58359e700 1 -- 172.21.15.80:0/843463440 learned_addr learned my addr 172.21.15.80:0/843463440 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:41.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.291+0000 7fc58882f700 1 --2- 172.21.15.80:0/843463440 >> v2:172.21.15.174:3300/0 conn(0x7fc58406d120 0x7fc584165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:41.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.291+0000 7fc58259c700 1 -- 172.21.15.80:0/843463440 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902584216 0 0) 0x7fc5740014d0 con 0x7fc58406c0a0 2019-11-28T11:36:41.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.291+0000 7fc58259c700 1 -- 172.21.15.80:0/843463440 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc56c002e80 con 0x7fc58406c0a0 2019-11-28T11:36:41.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.291+0000 7fc58259c700 1 -- 172.21.15.80:0/843463440 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2719556698 0 0) 0x7fc5740014b0 con 0x7fc58406c0a0 2019-11-28T11:36:41.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.291+0000 7fc58882f700 1 -- 172.21.15.80:0/843463440 >> v1:172.21.15.174:6789/0 conn(0x7fc58406c490 legacy=0x7fc58406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:41.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.291+0000 7fc58882f700 1 -- 172.21.15.80:0/843463440 >> v1:172.21.15.80:6789/0 conn(0x7fc58406c0a0 legacy=0x7fc584072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:41.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.291+0000 7fc58882f700 1 -- 172.21.15.80:0/843463440 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5840706c0 con 0x7fc58406d120 2019-11-28T11:36:41.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.291+0000 7fc58882f700 1 --2- 172.21.15.80:0/843463440 >> v2:172.21.15.174:3300/0 conn(0x7fc58406d120 0x7fc584165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc57c00af80 tx=0x7fc57c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:41.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.292+0000 7fc58882f700 1 --2- 172.21.15.80:0/843463440 >> v2:172.21.15.174:3300/0 conn(0x7fc58406d120 0x7fc584165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc57c00af80 tx=0x7fc57c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:41.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.292+0000 7fc58882f700 1 --2- 172.21.15.80:0/843463440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc58406d120 0x7fc584165d80 secure :-1 s=READY pgs=636 cs=0 l=1 rx=0x7fc57c00af80 tx=0x7fc57c00b790).ready entity=mon.1 client_cookie=1557d5aa1dba18af server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:41.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.292+0000 7fc58882f700 1 --2- 172.21.15.80:0/843463440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc58406d120 0x7fc584165d80 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7fc57c00af80 tx=0x7fc57c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:41.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.292+0000 7fc58259c700 1 -- 172.21.15.80:0/843463440 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc57c007240 con 0x7fc58406d120 2019-11-28T11:36:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.292+0000 7fc58882f700 1 --2- 172.21.15.80:0/843463440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc58406d120 0x7fc584165d80 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7fc57c00af80 tx=0x7fc57c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.292+0000 7fc58882f700 1 --2- 172.21.15.80:0/843463440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc58406d120 0x7fc584165d80 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7fc57c00af80 tx=0x7fc57c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.292+0000 7fc58259c700 1 -- 172.21.15.80:0/843463440 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c000bb0 con 0x7fc58406d120 2019-11-28T11:36:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.292+0000 7fc58259c700 1 -- 172.21.15.80:0/843463440 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc57c009e60 con 0x7fc58406d120 2019-11-28T11:36:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.292+0000 7fc589030700 1 -- 172.21.15.80:0/843463440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc58406d120 msgr2=0x7fc584165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.292+0000 7fc589030700 1 --2- 172.21.15.80:0/843463440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc58406d120 0x7fc584165d80 secure :-1 s=READY pgs=636 cs=0 l=1 rx=0x7fc57c00af80 tx=0x7fc57c00b790).stop 2019-11-28T11:36:41.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.292+0000 7fc589030700 1 -- 172.21.15.80:0/843463440 shutdown_connections 2019-11-28T11:36:41.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.292+0000 7fc589030700 1 --2- 172.21.15.80:0/843463440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc58406d120 0x7fc584165d80 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:41.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.292+0000 7fc589030700 1 -- 172.21.15.80:0/843463440 shutdown_connections 2019-11-28T11:36:41.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.292+0000 7fc589030700 1 -- 172.21.15.80:0/843463440 wait complete. 2019-11-28T11:36:41.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.292+0000 7fc589030700 1 -- 172.21.15.80:0/843463440 >> 172.21.15.80:0/843463440 conn(0x7fc584061cf0 msgr2=0x7fc584064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:41.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.295+0000 7fc589030700 1 Processor -- start 2019-11-28T11:36:41.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.295+0000 7fc589030700 1 -- start start 2019-11-28T11:36:41.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc589030700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc584111db0 0x7fc5841238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:41.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc589030700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc584165a00 0x7fc584167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:41.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc589030700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc584124260 con 0x7fc58412cea0 2019-11-28T11:36:41.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc589030700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc584121040 con 0x7fc584111db0 2019-11-28T11:36:41.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc589030700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc584121310 con 0x7fc584165a00 2019-11-28T11:36:41.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc58882f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc584165a00 0x7fc584167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:41.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc58359e700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc58412cea0 0x7fc5841230e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:51384/0 (socket says 172.21.15.80:51384) 2019-11-28T11:36:41.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc582d9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc584111db0 0x7fc5841238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:41.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc58359e700 1 -- 172.21.15.80:0/3881145360 learned_addr learned my addr 172.21.15.80:0/3881145360 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:41.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc56bfff700 1 -- 172.21.15.80:0/3881145360 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499908530 0 0) 0x7fc5740012c0 con 0x7fc58412cea0 2019-11-28T11:36:41.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc56bfff700 1 -- 172.21.15.80:0/3881145360 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc564002e80 con 0x7fc58412cea0 2019-11-28T11:36:41.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc58882f700 1 -- 172.21.15.80:0/3881145360 >> v2:172.21.15.174:3300/0 conn(0x7fc584111db0 msgr2=0x7fc5841238e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:41.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc58882f700 1 --2- 172.21.15.80:0/3881145360 >> v2:172.21.15.174:3300/0 conn(0x7fc584111db0 0x7fc5841238e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:41.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc58882f700 1 -- 172.21.15.80:0/3881145360 >> v1:172.21.15.174:6789/0 conn(0x7fc58412cea0 legacy=0x7fc5841230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:41.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc58882f700 1 -- 172.21.15.80:0/3881145360 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5841219a0 con 0x7fc584165a00 2019-11-28T11:36:41.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc582d9d700 1 --2- 172.21.15.80:0/3881145360 >> v2:172.21.15.174:3300/0 conn(0x7fc584111db0 0x7fc5841238e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.296+0000 7fc58882f700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc584165a00 0x7fc584167e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc57c012590 tx=0x7fc57c012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.297+0000 7fc58882f700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc584165a00 0x7fc584167e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc57c012590 tx=0x7fc57c012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.297+0000 7fc58882f700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc584165a00 0x7fc584167e00 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7fc57c012590 tx=0x7fc57c012930).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.297+0000 7fc58882f700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc584165a00 0x7fc584167e00 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc57c012590 tx=0x7fc57c012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.297+0000 7fc56bfff700 1 -- 172.21.15.80:0/3881145360 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc57c00afe0 con 0x7fc584165a00 2019-11-28T11:36:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.297+0000 7fc58882f700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc584165a00 0x7fc584167e00 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc57c012590 tx=0x7fc57c012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:41.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.297+0000 7fc56bfff700 1 -- 172.21.15.80:0/3881145360 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c0097c0 con 0x7fc584165a00 2019-11-28T11:36:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.297+0000 7fc589030700 1 -- 172.21.15.80:0/3881145360 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc584121d20 con 0x7fc584165a00 2019-11-28T11:36:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.297+0000 7fc58882f700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc584165a00 0x7fc584167e00 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc57c012590 tx=0x7fc57c012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.297+0000 7fc56bfff700 1 -- 172.21.15.80:0/3881145360 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc57c0099b0 con 0x7fc584165a00 2019-11-28T11:36:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.297+0000 7fc589030700 1 -- 172.21.15.80:0/3881145360 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5841219a0 con 0x7fc584165a00 2019-11-28T11:36:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.297+0000 7fc58882f700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc584165a00 0x7fc584167e00 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc57c012590 tx=0x7fc57c012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.298+0000 7fc56bfff700 1 -- 172.21.15.80:0/3881145360 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc57c009a50 con 0x7fc584165a00 2019-11-28T11:36:41.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.298+0000 7fc58882f700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc584165a00 0x7fc584167e00 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc57c012590 tx=0x7fc57c012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.298+0000 7fc56bfff700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc564018770 0x7fc56401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.298+0000 7fc56bfff700 1 -- 172.21.15.80:0/3881145360 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fc57c033bf0 con 0x7fc584165a00 2019-11-28T11:36:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.298+0000 7fc58359e700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc564018770 0x7fc56401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.298+0000 7fc58359e700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc564018770 0x7fc56401abe0 crc :-1 s=READY pgs=436 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.305+0000 7fc589030700 1 -- 172.21.15.80:0/3881145360 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc584121d20 con 0x7fc584165a00 2019-11-28T11:36:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.309+0000 7fc58882f700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc584165a00 0x7fc584167e00 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc57c012590 tx=0x7fc57c012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:41.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.309+0000 7fc56bfff700 1 -- 172.21.15.80:0/3881145360 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc57c0095b0 con 0x7fc584165a00 2019-11-28T11:36:41.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.480+0000 7fc589030700 1 -- 172.21.15.80:0/3881145360 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5841219a0 con 0x7fc584165a00 2019-11-28T11:36:41.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.481+0000 7fc58882f700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc584165a00 0x7fc584167e00 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc57c012590 tx=0x7fc57c012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:41.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.481+0000 7fc56bfff700 1 -- 172.21.15.80:0/3881145360 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fc57c015e30 con 0x7fc584165a00 2019-11-28T11:36:41.542 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:41.542 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:41.542 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:41.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.483+0000 7fc589030700 1 -- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc564018770 msgr2=0x7fc56401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:41.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.483+0000 7fc589030700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc564018770 0x7fc56401abe0 crc :-1 s=READY pgs=436 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.483+0000 7fc589030700 1 -- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc584165a00 msgr2=0x7fc584167e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.483+0000 7fc589030700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc584165a00 0x7fc584167e00 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7fc57c012590 tx=0x7fc57c012930).stop 2019-11-28T11:36:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.483+0000 7fc589030700 1 -- 172.21.15.80:0/3881145360 shutdown_connections 2019-11-28T11:36:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.483+0000 7fc589030700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc584165a00 0x7fc584167e00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:41.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.483+0000 7fc589030700 1 --2- 172.21.15.80:0/3881145360 >> v2:172.21.15.174:3300/0 conn(0x7fc584111db0 0x7fc5841238e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.483+0000 7fc589030700 1 --2- 172.21.15.80:0/3881145360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc564018770 0x7fc56401abe0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.483+0000 7fc589030700 1 -- 172.21.15.80:0/3881145360 shutdown_connections 2019-11-28T11:36:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.483+0000 7fc589030700 1 -- 172.21.15.80:0/3881145360 wait complete. 2019-11-28T11:36:41.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:41.483+0000 7fc589030700 1 -- 172.21.15.80:0/3881145360 >> 172.21.15.80:0/3881145360 conn(0x7fc5841426c0 msgr2=0x7fc584110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:41.562 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:42.563 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:42.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.634+0000 7fe6543a7700 1 Processor -- start 2019-11-28T11:36:42.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.634+0000 7fe6543a7700 1 -- start start 2019-11-28T11:36:42.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe6543a7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe64c06c0a0 0x7fe64c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:42.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe6543a7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe64c072620 0x7fe64c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:42.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe6543a7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64c06db00 con 0x7fe64c0734e0 2019-11-28T11:36:42.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe6543a7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64c06f330 con 0x7fe64c072620 2019-11-28T11:36:42.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe6543a7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c0706c0 con 0x7fe64c06c0a0 2019-11-28T11:36:42.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe653145700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe64c072620 0x7fe64c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:42.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe653145700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe64c072620 0x7fe64c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36534/0 (socket says 172.21.15.80:36534) 2019-11-28T11:36:42.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe653145700 1 -- 172.21.15.80:0/2534029418 learned_addr learned my addr 172.21.15.80:0/2534029418 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:42.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe652944700 1 --2- 172.21.15.80:0/2534029418 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe64c06c0a0 0x7fe64c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:42.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe653145700 1 -- 172.21.15.80:0/2534029418 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe64c06c0a0 msgr2=0x7fe64c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:42.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe653145700 1 --2- 172.21.15.80:0/2534029418 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe64c06c0a0 0x7fe64c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:42.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe653145700 1 -- 172.21.15.80:0/2534029418 >> v1:172.21.15.174:6789/0 conn(0x7fe64c0734e0 legacy=0x7fe64c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:42.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe653145700 1 -- 172.21.15.80:0/2534029418 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c070a40 con 0x7fe64c072620 2019-11-28T11:36:42.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe653145700 1 --2- 172.21.15.80:0/2534029418 >> v2:172.21.15.80:3300/0 conn(0x7fe64c072620 0x7fe64c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe64400f6b0 tx=0x7fe64400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:42.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe653145700 1 --2- 172.21.15.80:0/2534029418 >> v2:172.21.15.80:3300/0 conn(0x7fe64c072620 0x7fe64c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe64400f6b0 tx=0x7fe64400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:42.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe653145700 1 --2- 172.21.15.80:0/2534029418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe64c072620 0x7fe64c164d70 secure :-1 s=READY pgs=1068 cs=0 l=1 rx=0x7fe64400f6b0 tx=0x7fe64400fa50).ready entity=mon.0 client_cookie=a84b9cd7d720569c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:42.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe653145700 1 --2- 172.21.15.80:0/2534029418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe64c072620 0x7fe64c164d70 secure :-1 s=THROTTLE_DONE pgs=1068 cs=0 l=1 rx=0x7fe64400f6b0 tx=0x7fe64400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:42.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe651942700 1 -- 172.21.15.80:0/2534029418 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe644000a70 con 0x7fe64c072620 2019-11-28T11:36:42.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe653145700 1 --2- 172.21.15.80:0/2534029418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe64c072620 0x7fe64c164d70 secure :-1 s=THROTTLE_DONE pgs=1068 cs=0 l=1 rx=0x7fe64400f6b0 tx=0x7fe64400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:42.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.635+0000 7fe653145700 1 --2- 172.21.15.80:0/2534029418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe64c072620 0x7fe64c164d70 secure :-1 s=THROTTLE_DONE pgs=1068 cs=0 l=1 rx=0x7fe64400f6b0 tx=0x7fe64400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:42.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.636+0000 7fe651942700 1 -- 172.21.15.80:0/2534029418 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6440010e0 con 0x7fe64c072620 2019-11-28T11:36:42.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.636+0000 7fe651942700 1 -- 172.21.15.80:0/2534029418 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6440017b0 con 0x7fe64c072620 2019-11-28T11:36:42.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.636+0000 7fe6543a7700 1 -- 172.21.15.80:0/2534029418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe64c072620 msgr2=0x7fe64c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:42.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.636+0000 7fe6543a7700 1 --2- 172.21.15.80:0/2534029418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe64c072620 0x7fe64c164d70 secure :-1 s=READY pgs=1068 cs=0 l=1 rx=0x7fe64400f6b0 tx=0x7fe64400fa50).stop 2019-11-28T11:36:42.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.636+0000 7fe6543a7700 1 -- 172.21.15.80:0/2534029418 shutdown_connections 2019-11-28T11:36:42.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.636+0000 7fe6543a7700 1 --2- 172.21.15.80:0/2534029418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe64c072620 0x7fe64c164d70 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:42.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.636+0000 7fe6543a7700 1 --2- 172.21.15.80:0/2534029418 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe64c06c0a0 0x7fe64c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:42.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.636+0000 7fe6543a7700 1 -- 172.21.15.80:0/2534029418 shutdown_connections 2019-11-28T11:36:42.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.636+0000 7fe6543a7700 1 -- 172.21.15.80:0/2534029418 wait complete. 2019-11-28T11:36:42.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.636+0000 7fe6543a7700 1 -- 172.21.15.80:0/2534029418 >> 172.21.15.80:0/2534029418 conn(0x7fe64c061cf0 msgr2=0x7fe64c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:42.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.639+0000 7fe6543a7700 1 Processor -- start 2019-11-28T11:36:42.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.639+0000 7fe6543a7700 1 -- start start 2019-11-28T11:36:42.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6543a7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe64c1096f0 0x7fe64c169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:42.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6543a7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64c1066e0 con 0x7fe64c13e5f0 2019-11-28T11:36:42.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6543a7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64c10ce40 con 0x7fe64c13e9e0 2019-11-28T11:36:42.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6543a7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64c10e060 con 0x7fe64c1096f0 2019-11-28T11:36:42.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe652944700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe64c13e5f0 0x7fe64c10a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35854/0 (socket says 172.21.15.80:35854) 2019-11-28T11:36:42.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe652944700 1 -- 172.21.15.80:0/3329341137 learned_addr learned my addr 172.21.15.80:0/3329341137 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:42.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268658240 0 0) 0x7fe63c009580 con 0x7fe64c13e5f0 2019-11-28T11:36:42.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe653145700 1 --2- 172.21.15.80:0/3329341137 >> v2:172.21.15.174:3300/0 conn(0x7fe64c1096f0 0x7fe64c169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:42.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe634002e80 con 0x7fe64c13e5f0 2019-11-28T11:36:42.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3411145709 0 0) 0x7fe63c000940 con 0x7fe64c13e5f0 2019-11-28T11:36:42.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe6340032e0 con 0x7fe64c13e5f0 2019-11-28T11:36:42.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fe63c009dc0 con 0x7fe64c13e5f0 2019-11-28T11:36:42.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 >> v2:172.21.15.174:3300/0 conn(0x7fe64c1096f0 msgr2=0x7fe64c169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:42.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6437fe700 1 --2- 172.21.15.80:0/3329341137 >> v2:172.21.15.174:3300/0 conn(0x7fe64c1096f0 0x7fe64c169ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:42.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 >> v1:172.21.15.174:6789/0 conn(0x7fe64c13e9e0 legacy=0x7fe64c108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:42.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 >> v1:172.21.15.80:6789/0 conn(0x7fe64c13e5f0 legacy=0x7fe64c10a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:42.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6437fe700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe634003330 0x7fe634003720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:42.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6437fe700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe634003c60 0x7fe634004100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:42.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6437fe700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe634004910 0x7fe634004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:42.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63400bbf0 con 0x7fe634003c60 2019-11-28T11:36:42.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63400bde0 con 0x7fe634003330 2019-11-28T11:36:42.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63400c010 con 0x7fe634004910 2019-11-28T11:36:42.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe652944700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe634003330 0x7fe634003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:42.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.640+0000 7fe652143700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe634003c60 0x7fe634004100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:42.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe653145700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe634004910 0x7fe634004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:42.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe652944700 1 -- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe634004910 msgr2=0x7fe634004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:42.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe652944700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe634004910 0x7fe634004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:42.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe652944700 1 -- 172.21.15.80:0/3329341137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe634003c60 msgr2=0x7fe634004100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:42.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe652944700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe634003c60 0x7fe634004100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:42.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe652944700 1 -- 172.21.15.80:0/3329341137 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63400c2c0 con 0x7fe634003330 2019-11-28T11:36:42.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe653145700 1 -- 172.21.15.80:0/3329341137 reap_dead start 2019-11-28T11:36:42.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe652143700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe634003c60 0x7fe634004100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:42.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe6543a7700 1 -- 172.21.15.80:0/3329341137 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64c10ed40 con 0x7fe634003330 2019-11-28T11:36:42.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe652944700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe634003330 0x7fe634003720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe63c010440 tx=0x7fe63c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:42.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe6543a7700 1 -- 172.21.15.80:0/3329341137 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64c10e9c0 con 0x7fe634003330 2019-11-28T11:36:42.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe652944700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe634003330 0x7fe634003720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe63c010440 tx=0x7fe63c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:42.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe652944700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe634003330 0x7fe634003720 secure :-1 s=READY pgs=640 cs=0 l=1 rx=0x7fe63c010440 tx=0x7fe63c010270).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:42.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe652944700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe634003330 0x7fe634003720 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7fe63c010440 tx=0x7fe63c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:42.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63c000940 con 0x7fe634003330 2019-11-28T11:36:42.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe652944700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe634003330 0x7fe634003720 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7fe63c010440 tx=0x7fe63c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:42.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c000e80 con 0x7fe634003330 2019-11-28T11:36:42.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe652944700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe634003330 0x7fe634003720 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7fe63c010440 tx=0x7fe63c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:42.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63c001070 con 0x7fe634003330 2019-11-28T11:36:42.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.641+0000 7fe652944700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe634003330 0x7fe634003720 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7fe63c010440 tx=0x7fe63c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:42.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.642+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe63c001070 con 0x7fe634003330 2019-11-28T11:36:42.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.642+0000 7fe652944700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe634003330 0x7fe634003720 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7fe63c010440 tx=0x7fe63c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:42.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.642+0000 7fe6437fe700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe63401b470 0x7fe63401d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:42.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.642+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fe63c031970 con 0x7fe634003330 2019-11-28T11:36:42.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.642+0000 7fe652143700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe63401b470 0x7fe63401d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:42.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.642+0000 7fe652143700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe63401b470 0x7fe63401d8e0 crc :-1 s=READY pgs=437 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:42.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.649+0000 7fe6543a7700 1 -- 172.21.15.80:0/3329341137 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe628002e60 con 0x7fe634003330 2019-11-28T11:36:42.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.653+0000 7fe652944700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe634003330 0x7fe634003720 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7fe63c010440 tx=0x7fe63c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:42.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.653+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe63c02afb0 con 0x7fe634003330 2019-11-28T11:36:42.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.825+0000 7fe6543a7700 1 -- 172.21.15.80:0/3329341137 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe628001d10 con 0x7fe634003330 2019-11-28T11:36:42.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.826+0000 7fe652944700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe634003330 0x7fe634003720 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7fe63c010440 tx=0x7fe63c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:42.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.826+0000 7fe6437fe700 1 -- 172.21.15.80:0/3329341137 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fe63c02afb0 con 0x7fe634003330 2019-11-28T11:36:42.887 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:42.887 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:42.887 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:42.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.828+0000 7fe6543a7700 1 -- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe63401b470 msgr2=0x7fe63401d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:42.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.828+0000 7fe6543a7700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe63401b470 0x7fe63401d8e0 crc :-1 s=READY pgs=437 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:42.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.828+0000 7fe6543a7700 1 -- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe634003330 msgr2=0x7fe634003720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:42.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.828+0000 7fe6543a7700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe634003330 0x7fe634003720 secure :-1 s=READY pgs=640 cs=0 l=1 rx=0x7fe63c010440 tx=0x7fe63c010270).stop 2019-11-28T11:36:42.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.828+0000 7fe6543a7700 1 -- 172.21.15.80:0/3329341137 shutdown_connections 2019-11-28T11:36:42.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.828+0000 7fe6543a7700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe63401b470 0x7fe63401d8e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:42.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.828+0000 7fe6543a7700 1 --2- 172.21.15.80:0/3329341137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe634003330 0x7fe634003720 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:42.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.828+0000 7fe6543a7700 1 -- 172.21.15.80:0/3329341137 shutdown_connections 2019-11-28T11:36:42.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.828+0000 7fe6543a7700 1 -- 172.21.15.80:0/3329341137 wait complete. 2019-11-28T11:36:42.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:42.828+0000 7fe6543a7700 1 -- 172.21.15.80:0/3329341137 >> 172.21.15.80:0/3329341137 conn(0x7fe64c13d620 msgr2=0x7fe64c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:42.898 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:43.899 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:44.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.965+0000 7f9387c4d700 1 Processor -- start 2019-11-28T11:36:44.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.965+0000 7f9387c4d700 1 -- start start 2019-11-28T11:36:44.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.966+0000 7f9387c4d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f938006c490 0x7f938006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:44.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.966+0000 7f9387c4d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938006ce60 0x7f9380164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.966+0000 7f9387c4d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938006db00 con 0x7f938006c0a0 2019-11-28T11:36:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.966+0000 7f9387c4d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938006fd60 con 0x7f938006c490 2019-11-28T11:36:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.966+0000 7f9387c4d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9380070030 con 0x7f938006ce60 2019-11-28T11:36:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.966+0000 7f93869eb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938006ce60 0x7f9380164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.966+0000 7f93859e9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f938006c490 0x7f938006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.966+0000 7f93859e9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f938006c490 0x7f938006c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:51442/0 (socket says 172.21.15.80:51442) 2019-11-28T11:36:44.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.966+0000 7f93869eb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938006ce60 0x7f9380164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:38814/0 (socket says 172.21.15.80:38814) 2019-11-28T11:36:44.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.966+0000 7f93861ea700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f938006c0a0 0x7f9380072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:51412/0 (socket says 172.21.15.80:51412) 2019-11-28T11:36:44.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.966+0000 7f93859e9700 1 -- 172.21.15.80:0/2892557602 learned_addr learned my addr 172.21.15.80:0/2892557602 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:44.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.966+0000 7f93869eb700 1 -- 172.21.15.80:0/2892557602 >> v2:172.21.15.174:3300/0 conn(0x7f938006c490 msgr2=0x7f938006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:44.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.966+0000 7f93869eb700 1 --2- 172.21.15.80:0/2892557602 >> v2:172.21.15.174:3300/0 conn(0x7f938006c490 0x7f938006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:44.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.966+0000 7f93869eb700 1 -- 172.21.15.80:0/2892557602 >> v1:172.21.15.174:6789/0 conn(0x7f938006c0a0 legacy=0x7f9380072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:44.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.966+0000 7f93869eb700 1 -- 172.21.15.80:0/2892557602 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93800706c0 con 0x7f938006ce60 2019-11-28T11:36:44.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.966+0000 7f93859e9700 1 --2- 172.21.15.80:0/2892557602 >> v2:172.21.15.174:3300/0 conn(0x7f938006c490 0x7f938006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:44.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.967+0000 7f93869eb700 1 --2- 172.21.15.80:0/2892557602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938006ce60 0x7f9380164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f937800b300 tx=0x7f937800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:44.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.967+0000 7f93869eb700 1 --2- 172.21.15.80:0/2892557602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938006ce60 0x7f9380164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f937800b300 tx=0x7f937800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:44.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.967+0000 7f93869eb700 1 --2- 172.21.15.80:0/2892557602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938006ce60 0x7f9380164d70 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f937800b300 tx=0x7f937800bb10).ready entity=mon.2 client_cookie=52526b7ff8da01e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:44.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.967+0000 7f93869eb700 1 --2- 172.21.15.80:0/2892557602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938006ce60 0x7f9380164d70 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f937800b300 tx=0x7f937800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:44.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.967+0000 7f93869eb700 1 --2- 172.21.15.80:0/2892557602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938006ce60 0x7f9380164d70 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f937800b300 tx=0x7f937800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:44.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.967+0000 7f93851e8700 1 -- 172.21.15.80:0/2892557602 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9378000f40 con 0x7f938006ce60 2019-11-28T11:36:44.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.967+0000 7f93869eb700 1 --2- 172.21.15.80:0/2892557602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938006ce60 0x7f9380164d70 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f937800b300 tx=0x7f937800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:44.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.967+0000 7f93851e8700 1 -- 172.21.15.80:0/2892557602 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9378009b70 con 0x7f938006ce60 2019-11-28T11:36:44.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.967+0000 7f93851e8700 1 -- 172.21.15.80:0/2892557602 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f937800a240 con 0x7f938006ce60 2019-11-28T11:36:44.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.967+0000 7f9387c4d700 1 -- 172.21.15.80:0/2892557602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938006ce60 msgr2=0x7f9380164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:44.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.967+0000 7f9387c4d700 1 --2- 172.21.15.80:0/2892557602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938006ce60 0x7f9380164d70 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f937800b300 tx=0x7f937800bb10).stop 2019-11-28T11:36:44.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.968+0000 7f9387c4d700 1 -- 172.21.15.80:0/2892557602 shutdown_connections 2019-11-28T11:36:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.968+0000 7f9387c4d700 1 --2- 172.21.15.80:0/2892557602 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f938006ce60 0x7f9380164d70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.968+0000 7f9387c4d700 1 --2- 172.21.15.80:0/2892557602 >> v2:172.21.15.174:3300/0 conn(0x7f938006c490 0x7f938006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.968+0000 7f9387c4d700 1 -- 172.21.15.80:0/2892557602 shutdown_connections 2019-11-28T11:36:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.968+0000 7f9387c4d700 1 -- 172.21.15.80:0/2892557602 wait complete. 2019-11-28T11:36:44.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.968+0000 7f9387c4d700 1 -- 172.21.15.80:0/2892557602 >> 172.21.15.80:0/2892557602 conn(0x7f9380061cf0 msgr2=0x7f9380064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:44.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.970+0000 7f9387c4d700 1 Processor -- start 2019-11-28T11:36:44.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.970+0000 7f9387c4d700 1 -- start start 2019-11-28T11:36:44.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.971+0000 7f9387c4d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9380103000 0x7f9380103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:44.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.971+0000 7f9387c4d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93801039d0 0x7f9380167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:44.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.971+0000 7f9387c4d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93801312c0 con 0x7f938013dc00 2019-11-28T11:36:44.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.971+0000 7f9387c4d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9380105830 con 0x7f9380103000 2019-11-28T11:36:44.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.971+0000 7f9387c4d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9380105b00 con 0x7f93801039d0 2019-11-28T11:36:44.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.971+0000 7f93861ea700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f938013dc00 0x7f9380109e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35874/0 (socket says 172.21.15.80:35874) 2019-11-28T11:36:44.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.971+0000 7f93861ea700 1 -- 172.21.15.80:0/677943506 learned_addr learned my addr 172.21.15.80:0/677943506 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:44.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.971+0000 7f93869eb700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93801039d0 0x7f9380167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:44.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.971+0000 7f93859e9700 1 --2- 172.21.15.80:0/677943506 >> v2:172.21.15.174:3300/0 conn(0x7f9380103000 0x7f9380103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:44.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.971+0000 7f9376ffd700 1 -- 172.21.15.80:0/677943506 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087862464 0 0) 0x7f937c001100 con 0x7f938013dc00 2019-11-28T11:36:44.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.971+0000 7f9376ffd700 1 -- 172.21.15.80:0/677943506 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9368002e80 con 0x7f938013dc00 2019-11-28T11:36:44.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f93859e9700 1 -- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93801039d0 msgr2=0x7f9380167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:44.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f93859e9700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93801039d0 0x7f9380167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:44.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f93859e9700 1 -- 172.21.15.80:0/677943506 >> v1:172.21.15.80:6789/0 conn(0x7f938013dc00 legacy=0x7f9380109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:44.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f93859e9700 1 -- 172.21.15.80:0/677943506 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9380106190 con 0x7f9380103000 2019-11-28T11:36:44.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f93869eb700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93801039d0 0x7f9380167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:44.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f93859e9700 1 --2- 172.21.15.80:0/677943506 >> v2:172.21.15.174:3300/0 conn(0x7f9380103000 0x7f9380103490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9370010380 tx=0x7f9370010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:44.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f93859e9700 1 --2- 172.21.15.80:0/677943506 >> v2:172.21.15.174:3300/0 conn(0x7f9380103000 0x7f9380103490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9370010380 tx=0x7f9370010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:44.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f93859e9700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9380103000 0x7f9380103490 secure :-1 s=READY pgs=642 cs=0 l=1 rx=0x7f9370010380 tx=0x7f9370010720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:44.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f93859e9700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9380103000 0x7f9380103490 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7f9370010380 tx=0x7f9370010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:44.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f9376ffd700 1 -- 172.21.15.80:0/677943506 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9370001090 con 0x7f9380103000 2019-11-28T11:36:44.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f93859e9700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9380103000 0x7f9380103490 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7f9370010380 tx=0x7f9370010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:44.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f93859e9700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9380103000 0x7f9380103490 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7f9370010380 tx=0x7f9370010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:44.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f9376ffd700 1 -- 172.21.15.80:0/677943506 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9370000940 con 0x7f9380103000 2019-11-28T11:36:44.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f9387c4d700 1 -- 172.21.15.80:0/677943506 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9380106510 con 0x7f9380103000 2019-11-28T11:36:44.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f9376ffd700 1 -- 172.21.15.80:0/677943506 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9370001670 con 0x7f9380103000 2019-11-28T11:36:44.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f9387c4d700 1 -- 172.21.15.80:0/677943506 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9380106190 con 0x7f9380103000 2019-11-28T11:36:44.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.972+0000 7f93859e9700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9380103000 0x7f9380103490 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7f9370010380 tx=0x7f9370010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:44.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.973+0000 7f9376ffd700 1 -- 172.21.15.80:0/677943506 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9370000ea0 con 0x7f9380103000 2019-11-28T11:36:44.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.973+0000 7f93859e9700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9380103000 0x7f9380103490 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7f9370010380 tx=0x7f9370010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:44.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.973+0000 7f9376ffd700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9368018770 0x7f936801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:44.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.973+0000 7f9376ffd700 1 -- 172.21.15.80:0/677943506 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f93700319d0 con 0x7f9380103000 2019-11-28T11:36:44.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.973+0000 7f93861ea700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9368018770 0x7f936801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:44.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.973+0000 7f93861ea700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9368018770 0x7f936801abe0 crc :-1 s=READY pgs=438 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:44.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.980+0000 7f9387c4d700 1 -- 172.21.15.80:0/677943506 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9380106510 con 0x7f9380103000 2019-11-28T11:36:44.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.984+0000 7f93859e9700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9380103000 0x7f9380103490 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7f9370010380 tx=0x7f9370010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:44.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:43.984+0000 7f9376ffd700 1 -- 172.21.15.80:0/677943506 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9370000c90 con 0x7f9380103000 2019-11-28T11:36:44.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:44.157+0000 7f9387c4d700 1 -- 172.21.15.80:0/677943506 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9380106190 con 0x7f9380103000 2019-11-28T11:36:44.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:44.157+0000 7f93859e9700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9380103000 0x7f9380103490 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7f9370010380 tx=0x7f9370010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:44.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:44.157+0000 7f9376ffd700 1 -- 172.21.15.80:0/677943506 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f9370000ea0 con 0x7f9380103000 2019-11-28T11:36:44.218 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:44.218 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:44.218 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:44.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:44.160+0000 7f9387c4d700 1 -- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9368018770 msgr2=0x7f936801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:44.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:44.160+0000 7f9387c4d700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9368018770 0x7f936801abe0 crc :-1 s=READY pgs=438 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:44.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:44.160+0000 7f9387c4d700 1 -- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9380103000 msgr2=0x7f9380103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:44.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:44.160+0000 7f9387c4d700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9380103000 0x7f9380103490 secure :-1 s=READY pgs=642 cs=0 l=1 rx=0x7f9370010380 tx=0x7f9370010720).stop 2019-11-28T11:36:44.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:44.160+0000 7f9387c4d700 1 -- 172.21.15.80:0/677943506 shutdown_connections 2019-11-28T11:36:44.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:44.160+0000 7f9387c4d700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9368018770 0x7f936801abe0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:44.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:44.160+0000 7f9387c4d700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93801039d0 0x7f9380167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:44.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:44.160+0000 7f9387c4d700 1 --2- 172.21.15.80:0/677943506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9380103000 0x7f9380103490 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:44.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:44.160+0000 7f9387c4d700 1 -- 172.21.15.80:0/677943506 shutdown_connections 2019-11-28T11:36:44.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:44.160+0000 7f9387c4d700 1 -- 172.21.15.80:0/677943506 wait complete. 2019-11-28T11:36:44.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:44.160+0000 7f9387c4d700 1 -- 172.21.15.80:0/677943506 >> 172.21.15.80:0/677943506 conn(0x7f938011bfc0 msgr2=0x7f9380141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:44.230 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:45.231 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:45.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.295+0000 7fa915676700 1 Processor -- start 2019-11-28T11:36:45.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.295+0000 7fa915676700 1 -- start start 2019-11-28T11:36:45.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa915676700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa91006c0a0 0x7fa910072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:45.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa915676700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9100734e0 0x7fa910071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:45.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa915676700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa910072360 0x7fa910072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:45.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa915676700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91006fd60 con 0x7fa910072360 2019-11-28T11:36:45.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa915676700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa910070030 con 0x7fa91006c0a0 2019-11-28T11:36:45.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa915676700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91006f330 con 0x7fa9100734e0 2019-11-28T11:36:45.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa90ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa910072360 0x7fa910072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:45.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa90ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa910072360 0x7fa910072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36568/0 (socket says 172.21.15.80:36568) 2019-11-28T11:36:45.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa90ffff700 1 -- 172.21.15.80:0/4052780361 learned_addr learned my addr 172.21.15.80:0/4052780361 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:45.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa90effd700 1 --2- 172.21.15.80:0/4052780361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9100734e0 0x7fa910071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:45.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa90f7fe700 1 --2- 172.21.15.80:0/4052780361 >> v2:172.21.15.174:3300/0 conn(0x7fa91006c0a0 0x7fa910072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:45.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa90ffff700 1 -- 172.21.15.80:0/4052780361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9100734e0 msgr2=0x7fa910071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:45.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa90ffff700 1 --2- 172.21.15.80:0/4052780361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9100734e0 0x7fa910071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:45.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa90ffff700 1 -- 172.21.15.80:0/4052780361 >> v2:172.21.15.174:3300/0 conn(0x7fa91006c0a0 msgr2=0x7fa910072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:45.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa90ffff700 1 --2- 172.21.15.80:0/4052780361 >> v2:172.21.15.174:3300/0 conn(0x7fa91006c0a0 0x7fa910072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:45.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa90ffff700 1 -- 172.21.15.80:0/4052780361 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9100706c0 con 0x7fa910072360 2019-11-28T11:36:45.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa90effd700 1 --2- 172.21.15.80:0/4052780361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9100734e0 0x7fa910071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:36:45.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.296+0000 7fa90ffff700 1 --2- 172.21.15.80:0/4052780361 >> v2:172.21.15.80:3300/0 conn(0x7fa910072360 0x7fa910072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa90800fab0 tx=0x7fa90800f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:45.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa90ffff700 1 --2- 172.21.15.80:0/4052780361 >> v2:172.21.15.80:3300/0 conn(0x7fa910072360 0x7fa910072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa90800fab0 tx=0x7fa90800f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:45.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa90ffff700 1 --2- 172.21.15.80:0/4052780361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa910072360 0x7fa910072800 secure :-1 s=READY pgs=1071 cs=0 l=1 rx=0x7fa90800fab0 tx=0x7fa90800f930).ready entity=mon.0 client_cookie=3f16bd24df5d5fb5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:45.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa90ffff700 1 --2- 172.21.15.80:0/4052780361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa910072360 0x7fa910072800 secure :-1 s=THROTTLE_DONE pgs=1071 cs=0 l=1 rx=0x7fa90800fab0 tx=0x7fa90800f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:45.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa90ffff700 1 --2- 172.21.15.80:0/4052780361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa910072360 0x7fa910072800 secure :-1 s=THROTTLE_DONE pgs=1071 cs=0 l=1 rx=0x7fa90800fab0 tx=0x7fa90800f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:45.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa90e7fc700 1 -- 172.21.15.80:0/4052780361 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa908001460 con 0x7fa910072360 2019-11-28T11:36:45.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa90ffff700 1 --2- 172.21.15.80:0/4052780361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa910072360 0x7fa910072800 secure :-1 s=THROTTLE_DONE pgs=1071 cs=0 l=1 rx=0x7fa90800fab0 tx=0x7fa90800f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:45.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa90e7fc700 1 -- 172.21.15.80:0/4052780361 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa908000f10 con 0x7fa910072360 2019-11-28T11:36:45.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa90e7fc700 1 -- 172.21.15.80:0/4052780361 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa908001a40 con 0x7fa910072360 2019-11-28T11:36:45.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa915676700 1 -- 172.21.15.80:0/4052780361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa910072360 msgr2=0x7fa910072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:45.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa915676700 1 --2- 172.21.15.80:0/4052780361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa910072360 0x7fa910072800 secure :-1 s=READY pgs=1071 cs=0 l=1 rx=0x7fa90800fab0 tx=0x7fa90800f930).stop 2019-11-28T11:36:45.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa915676700 1 -- 172.21.15.80:0/4052780361 shutdown_connections 2019-11-28T11:36:45.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa915676700 1 --2- 172.21.15.80:0/4052780361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa910072360 0x7fa910072800 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:45.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa915676700 1 --2- 172.21.15.80:0/4052780361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9100734e0 0x7fa910071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:45.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa915676700 1 --2- 172.21.15.80:0/4052780361 >> v2:172.21.15.174:3300/0 conn(0x7fa91006c0a0 0x7fa910072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:45.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa915676700 1 -- 172.21.15.80:0/4052780361 shutdown_connections 2019-11-28T11:36:45.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa915676700 1 -- 172.21.15.80:0/4052780361 wait complete. 2019-11-28T11:36:45.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.297+0000 7fa915676700 1 -- 172.21.15.80:0/4052780361 >> 172.21.15.80:0/4052780361 conn(0x7fa910061cf0 msgr2=0x7fa910064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:45.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.300+0000 7fa915676700 1 Processor -- start 2019-11-28T11:36:45.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.300+0000 7fa915676700 1 -- start start 2019-11-28T11:36:45.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa915676700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa91013eb40 0x7fa91010afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:45.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa915676700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa91010b500 0x7fa9101629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:45.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa915676700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa91013f1e0 con 0x7fa910162f30 2019-11-28T11:36:45.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa915676700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9101234c0 con 0x7fa91013eb40 2019-11-28T11:36:45.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa915676700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91013e0d0 con 0x7fa91010b500 2019-11-28T11:36:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa90f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa91013eb40 0x7fa91010afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa90f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa91013eb40 0x7fa91010afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36574/0 (socket says 172.21.15.80:36574) 2019-11-28T11:36:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa90f7fe700 1 -- 172.21.15.80:0/2952912499 learned_addr learned my addr 172.21.15.80:0/2952912499 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa90effd700 1 --2- 172.21.15.80:0/2952912499 >> v2:172.21.15.174:3300/0 conn(0x7fa91010b500 0x7fa9101629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa90f7fe700 1 -- 172.21.15.80:0/2952912499 >> v2:172.21.15.174:3300/0 conn(0x7fa91010b500 msgr2=0x7fa9101629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:45.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa90f7fe700 1 --2- 172.21.15.80:0/2952912499 >> v2:172.21.15.174:3300/0 conn(0x7fa91010b500 0x7fa9101629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa90f7fe700 1 -- 172.21.15.80:0/2952912499 >> v1:172.21.15.174:6789/0 conn(0x7fa910162f30 legacy=0x7fa910109e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa90f7fe700 1 -- 172.21.15.80:0/2952912499 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa910108700 con 0x7fa91013eb40 2019-11-28T11:36:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa907fff700 1 -- 172.21.15.80:0/2952912499 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324134880 0 0) 0x7fa908000f10 con 0x7fa910162f30 2019-11-28T11:36:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa90f7fe700 1 --2- 172.21.15.80:0/2952912499 >> v2:172.21.15.80:3300/0 conn(0x7fa91013eb40 0x7fa91010afc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa8f80103d0 tx=0x7fa8f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa90f7fe700 1 --2- 172.21.15.80:0/2952912499 >> v2:172.21.15.80:3300/0 conn(0x7fa91013eb40 0x7fa91010afc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa8f80103d0 tx=0x7fa8f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.301+0000 7fa90f7fe700 1 --2- 172.21.15.80:0/2952912499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa91013eb40 0x7fa91010afc0 secure :-1 s=READY pgs=1072 cs=0 l=1 rx=0x7fa8f80103d0 tx=0x7fa8f8010770).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:45.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.302+0000 7fa90f7fe700 1 --2- 172.21.15.80:0/2952912499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa91013eb40 0x7fa91010afc0 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7fa8f80103d0 tx=0x7fa8f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.302+0000 7fa907fff700 1 -- 172.21.15.80:0/2952912499 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f8000940 con 0x7fa91013eb40 2019-11-28T11:36:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.302+0000 7fa90f7fe700 1 --2- 172.21.15.80:0/2952912499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa91013eb40 0x7fa91010afc0 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7fa8f80103d0 tx=0x7fa8f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.302+0000 7fa907fff700 1 -- 172.21.15.80:0/2952912499 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f8000e80 con 0x7fa91013eb40 2019-11-28T11:36:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.302+0000 7fa90f7fe700 1 --2- 172.21.15.80:0/2952912499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa91013eb40 0x7fa91010afc0 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7fa8f80103d0 tx=0x7fa8f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.302+0000 7fa907fff700 1 -- 172.21.15.80:0/2952912499 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f8001070 con 0x7fa91013eb40 2019-11-28T11:36:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.302+0000 7fa915676700 1 -- 172.21.15.80:0/2952912499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa910108a80 con 0x7fa91013eb40 2019-11-28T11:36:45.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.302+0000 7fa915676700 1 -- 172.21.15.80:0/2952912499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa910108700 con 0x7fa91013eb40 2019-11-28T11:36:45.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.302+0000 7fa90f7fe700 1 --2- 172.21.15.80:0/2952912499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa91013eb40 0x7fa91010afc0 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7fa8f80103d0 tx=0x7fa8f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:45.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.302+0000 7fa907fff700 1 -- 172.21.15.80:0/2952912499 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa8f8001070 con 0x7fa91013eb40 2019-11-28T11:36:45.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.302+0000 7fa90f7fe700 1 --2- 172.21.15.80:0/2952912499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa91013eb40 0x7fa91010afc0 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7fa8f80103d0 tx=0x7fa8f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:45.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.302+0000 7fa907fff700 1 --2- 172.21.15.80:0/2952912499 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8f4018730 0x7fa8f401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:45.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.302+0000 7fa907fff700 1 -- 172.21.15.80:0/2952912499 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fa8f8031b00 con 0x7fa91013eb40 2019-11-28T11:36:45.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.303+0000 7fa90effd700 1 --2- 172.21.15.80:0/2952912499 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8f4018730 0x7fa8f401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:45.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.303+0000 7fa90effd700 1 --2- 172.21.15.80:0/2952912499 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8f4018730 0x7fa8f401abc0 crc :-1 s=READY pgs=439 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:45.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.310+0000 7fa915676700 1 -- 172.21.15.80:0/2952912499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa910108a80 con 0x7fa91013eb40 2019-11-28T11:36:45.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.314+0000 7fa90f7fe700 1 --2- 172.21.15.80:0/2952912499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa91013eb40 0x7fa91010afc0 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7fa8f80103d0 tx=0x7fa8f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.314+0000 7fa907fff700 1 -- 172.21.15.80:0/2952912499 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa8f8009250 con 0x7fa91013eb40 2019-11-28T11:36:45.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.488+0000 7fa915676700 1 -- 172.21.15.80:0/2952912499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa910108700 con 0x7fa91013eb40 2019-11-28T11:36:45.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.488+0000 7fa90f7fe700 1 --2- 172.21.15.80:0/2952912499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa91013eb40 0x7fa91010afc0 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7fa8f80103d0 tx=0x7fa8f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:45.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.488+0000 7fa907fff700 1 -- 172.21.15.80:0/2952912499 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fa8f8001070 con 0x7fa91013eb40 2019-11-28T11:36:45.548 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 50 2019-11-28T11:36:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:45.549 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:35:55.635472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:45.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.490+0000 7fa915676700 1 -- 172.21.15.80:0/2952912499 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8f4018730 msgr2=0x7fa8f401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.490+0000 7fa915676700 1 --2- 172.21.15.80:0/2952912499 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8f4018730 0x7fa8f401abc0 crc :-1 s=READY pgs=439 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.490+0000 7fa915676700 1 -- 172.21.15.80:0/2952912499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa91013eb40 msgr2=0x7fa91010afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.490+0000 7fa915676700 1 --2- 172.21.15.80:0/2952912499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa91013eb40 0x7fa91010afc0 secure :-1 s=READY pgs=1072 cs=0 l=1 rx=0x7fa8f80103d0 tx=0x7fa8f8010770).stop 2019-11-28T11:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.490+0000 7fa915676700 1 -- 172.21.15.80:0/2952912499 shutdown_connections 2019-11-28T11:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.490+0000 7fa915676700 1 --2- 172.21.15.80:0/2952912499 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8f4018730 0x7fa8f401abc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.490+0000 7fa915676700 1 --2- 172.21.15.80:0/2952912499 >> v2:172.21.15.174:3300/0 conn(0x7fa91010b500 0x7fa9101629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.490+0000 7fa915676700 1 --2- 172.21.15.80:0/2952912499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa91013eb40 0x7fa91010afc0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.491+0000 7fa915676700 1 -- 172.21.15.80:0/2952912499 shutdown_connections 2019-11-28T11:36:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.491+0000 7fa915676700 1 -- 172.21.15.80:0/2952912499 wait complete. 2019-11-28T11:36:45.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:45.491+0000 7fa915676700 1 -- 172.21.15.80:0/2952912499 >> 172.21.15.80:0/2952912499 conn(0x7fa91011bfc0 msgr2=0x7fa910141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:45.560 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:36:46.563 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:46.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.622+0000 7ff98888a700 1 Processor -- start 2019-11-28T11:36:46.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.622+0000 7ff98888a700 1 -- start start 2019-11-28T11:36:46.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.623+0000 7ff98888a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff98406c0a0 0x7ff984072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:46.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff98888a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff9840734e0 0x7ff984071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:46.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff98888a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff98406db00 con 0x7ff984072360 2019-11-28T11:36:46.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff98888a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98406fd60 con 0x7ff98406c0a0 2019-11-28T11:36:46.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff98888a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff984070030 con 0x7ff9840734e0 2019-11-28T11:36:46.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff982d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff98406c0a0 0x7ff984072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:46.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff982d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff98406c0a0 0x7ff984072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36580/0 (socket says 172.21.15.80:36580) 2019-11-28T11:36:46.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff982d9d700 1 -- 172.21.15.80:0/2805173304 learned_addr learned my addr 172.21.15.80:0/2805173304 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:46.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff98259c700 1 --2- 172.21.15.80:0/2805173304 >> v2:172.21.15.174:3300/0 conn(0x7ff9840734e0 0x7ff984071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:46.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff982d9d700 1 -- 172.21.15.80:0/2805173304 >> v2:172.21.15.174:3300/0 conn(0x7ff9840734e0 msgr2=0x7ff984071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:46.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff982d9d700 1 --2- 172.21.15.80:0/2805173304 >> v2:172.21.15.174:3300/0 conn(0x7ff9840734e0 0x7ff984071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:46.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff982d9d700 1 -- 172.21.15.80:0/2805173304 >> v1:172.21.15.174:6789/0 conn(0x7ff984072360 legacy=0x7ff98406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:46.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff982d9d700 1 -- 172.21.15.80:0/2805173304 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9840706c0 con 0x7ff98406c0a0 2019-11-28T11:36:46.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff982d9d700 1 --2- 172.21.15.80:0/2805173304 >> v2:172.21.15.80:3300/0 conn(0x7ff98406c0a0 0x7ff984072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff96c00f6c0 tx=0x7ff96c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:46.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff982d9d700 1 --2- 172.21.15.80:0/2805173304 >> v2:172.21.15.80:3300/0 conn(0x7ff98406c0a0 0x7ff984072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff96c00f6c0 tx=0x7ff96c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:46.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff982d9d700 1 --2- 172.21.15.80:0/2805173304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff98406c0a0 0x7ff984072fa0 secure :-1 s=READY pgs=1073 cs=0 l=1 rx=0x7ff96c00f6c0 tx=0x7ff96c00fa60).ready entity=mon.0 client_cookie=13ecfc32878f1430 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:46.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff982d9d700 1 --2- 172.21.15.80:0/2805173304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff98406c0a0 0x7ff984072fa0 secure :-1 s=THROTTLE_DONE pgs=1073 cs=0 l=1 rx=0x7ff96c00f6c0 tx=0x7ff96c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:46.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff981d9b700 1 -- 172.21.15.80:0/2805173304 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff96c000960 con 0x7ff98406c0a0 2019-11-28T11:36:46.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff982d9d700 1 --2- 172.21.15.80:0/2805173304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff98406c0a0 0x7ff984072fa0 secure :-1 s=THROTTLE_DONE pgs=1073 cs=0 l=1 rx=0x7ff96c00f6c0 tx=0x7ff96c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:46.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff982d9d700 1 --2- 172.21.15.80:0/2805173304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff98406c0a0 0x7ff984072fa0 secure :-1 s=THROTTLE_DONE pgs=1073 cs=0 l=1 rx=0x7ff96c00f6c0 tx=0x7ff96c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:46.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff981d9b700 1 -- 172.21.15.80:0/2805173304 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c000c90 con 0x7ff98406c0a0 2019-11-28T11:36:46.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff981d9b700 1 -- 172.21.15.80:0/2805173304 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff96c000960 con 0x7ff98406c0a0 2019-11-28T11:36:46.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff98888a700 1 -- 172.21.15.80:0/2805173304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff98406c0a0 msgr2=0x7ff984072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:46.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.624+0000 7ff98888a700 1 --2- 172.21.15.80:0/2805173304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff98406c0a0 0x7ff984072fa0 secure :-1 s=READY pgs=1073 cs=0 l=1 rx=0x7ff96c00f6c0 tx=0x7ff96c00fa60).stop 2019-11-28T11:36:46.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.625+0000 7ff98888a700 1 -- 172.21.15.80:0/2805173304 shutdown_connections 2019-11-28T11:36:46.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.625+0000 7ff98888a700 1 --2- 172.21.15.80:0/2805173304 >> v2:172.21.15.174:3300/0 conn(0x7ff9840734e0 0x7ff984071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:46.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.625+0000 7ff98888a700 1 --2- 172.21.15.80:0/2805173304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff98406c0a0 0x7ff984072fa0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:46.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.625+0000 7ff98888a700 1 -- 172.21.15.80:0/2805173304 shutdown_connections 2019-11-28T11:36:46.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.625+0000 7ff98888a700 1 -- 172.21.15.80:0/2805173304 wait complete. 2019-11-28T11:36:46.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.625+0000 7ff98888a700 1 -- 172.21.15.80:0/2805173304 >> 172.21.15.80:0/2805173304 conn(0x7ff984061cf0 msgr2=0x7ff984064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:46.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.628+0000 7ff98888a700 1 Processor -- start 2019-11-28T11:36:46.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.628+0000 7ff98888a700 1 -- start start 2019-11-28T11:36:46.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff98888a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff98410ab00 0x7ff98410bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:46.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff98888a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff984159000 con 0x7ff98412e850 2019-11-28T11:36:46.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff98888a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff98412eca0 con 0x7ff98410c500 2019-11-28T11:36:46.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff98888a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98415a2f0 con 0x7ff98410ab00 2019-11-28T11:36:46.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff98359e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff98412e850 0x7ff98415cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35906/0 (socket says 172.21.15.80:35906) 2019-11-28T11:36:46.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff98359e700 1 -- 172.21.15.80:0/236591161 learned_addr learned my addr 172.21.15.80:0/236591161 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:46.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff982d9d700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff98410ab00 0x7ff98410bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:46.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589656542 0 0) 0x7ff97c0009b0 con 0x7ff98412e850 2019-11-28T11:36:46.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff95c002e80 con 0x7ff98412e850 2019-11-28T11:36:46.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 714713590 0 0) 0x7ff97c0012b0 con 0x7ff98412e850 2019-11-28T11:36:46.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff95c0032e0 con 0x7ff98412e850 2019-11-28T11:36:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff97c001860 con 0x7ff98412e850 2019-11-28T11:36:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff98410ab00 msgr2=0x7ff98410bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff97b7fe700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff98410ab00 0x7ff98410bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 >> v1:172.21.15.174:6789/0 conn(0x7ff98410c500 legacy=0x7ff98412e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 >> v1:172.21.15.80:6789/0 conn(0x7ff98412e850 legacy=0x7ff98415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff97b7fe700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95c003400 0x7ff95c003810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff97b7fe700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95c003d50 0x7ff95c004210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff97b7fe700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff95c0048c0 0x7ff95c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c00bbf0 con 0x7ff95c003d50 2019-11-28T11:36:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c00bdf0 con 0x7ff95c0048c0 2019-11-28T11:36:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.629+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c00c020 con 0x7ff95c003400 2019-11-28T11:36:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff98259c700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95c003d50 0x7ff95c004210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff982d9d700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95c003400 0x7ff95c003810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff98359e700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff95c0048c0 0x7ff95c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff98259c700 1 -- 172.21.15.80:0/236591161 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95c003400 msgr2=0x7ff95c003810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff98259c700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95c003400 0x7ff95c003810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff98259c700 1 -- 172.21.15.80:0/236591161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff95c0048c0 msgr2=0x7ff95c004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff98259c700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff95c0048c0 0x7ff95c004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff98259c700 1 -- 172.21.15.80:0/236591161 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c00c2d0 con 0x7ff95c003d50 2019-11-28T11:36:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff98888a700 1 -- 172.21.15.80:0/236591161 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98415ba00 con 0x7ff95c003d50 2019-11-28T11:36:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff98259c700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95c003d50 0x7ff95c004210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff9740106c0 tx=0x7ff97400b680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:46.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff98888a700 1 -- 172.21.15.80:0/236591161 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98415b680 con 0x7ff95c003d50 2019-11-28T11:36:46.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff98259c700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95c003d50 0x7ff95c004210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff9740106c0 tx=0x7ff97400b680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:46.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff98259c700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95c003d50 0x7ff95c004210 secure :-1 s=READY pgs=1075 cs=0 l=1 rx=0x7ff9740106c0 tx=0x7ff97400b680).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:46.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff98259c700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95c003d50 0x7ff95c004210 secure :-1 s=THROTTLE_DONE pgs=1075 cs=0 l=1 rx=0x7ff9740106c0 tx=0x7ff97400b680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:46.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff97400a000 con 0x7ff95c003d50 2019-11-28T11:36:46.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff98259c700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95c003d50 0x7ff95c004210 secure :-1 s=THROTTLE_DONE pgs=1075 cs=0 l=1 rx=0x7ff9740106c0 tx=0x7ff97400b680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:46.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff98259c700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95c003d50 0x7ff95c004210 secure :-1 s=THROTTLE_DONE pgs=1075 cs=0 l=1 rx=0x7ff9740106c0 tx=0x7ff97400b680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff974009c20 con 0x7ff95c003d50 2019-11-28T11:36:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff97400a780 con 0x7ff95c003d50 2019-11-28T11:36:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.630+0000 7ff98259c700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95c003d50 0x7ff95c004210 secure :-1 s=THROTTLE_DONE pgs=1075 cs=0 l=1 rx=0x7ff9740106c0 tx=0x7ff97400b680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.631+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff974009e10 con 0x7ff95c003d50 2019-11-28T11:36:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.631+0000 7ff98259c700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95c003d50 0x7ff95c004210 secure :-1 s=THROTTLE_DONE pgs=1075 cs=0 l=1 rx=0x7ff9740106c0 tx=0x7ff97400b680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.631+0000 7ff97b7fe700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff95c020bc0 0x7ff95c022ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.631+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6149+0+0 (secure 0 0 0) 0x7ff974031f10 con 0x7ff95c003d50 2019-11-28T11:36:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.631+0000 7ff982d9d700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff95c020bc0 0x7ff95c022ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.631+0000 7ff982d9d700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff95c020bc0 0x7ff95c022ff0 crc :-1 s=READY pgs=440 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.638+0000 7ff98888a700 1 -- 172.21.15.80:0/236591161 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98415ba00 con 0x7ff95c003d50 2019-11-28T11:36:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.641+0000 7ff98259c700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95c003d50 0x7ff95c004210 secure :-1 s=THROTTLE_DONE pgs=1075 cs=0 l=1 rx=0x7ff9740106c0 tx=0x7ff97400b680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.641+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff974009a10 con 0x7ff95c003d50 2019-11-28T11:36:46.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.816+0000 7ff98888a700 1 -- 172.21.15.80:0/236591161 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff98415b680 con 0x7ff95c003d50 2019-11-28T11:36:46.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.816+0000 7ff98259c700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95c003d50 0x7ff95c004210 secure :-1 s=THROTTLE_DONE pgs=1075 cs=0 l=1 rx=0x7ff9740106c0 tx=0x7ff97400b680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:46.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.816+0000 7ff97b7fe700 1 -- 172.21.15.80:0/236591161 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+2447 (secure 0 0 0) 0x7ff974009c20 con 0x7ff95c003d50 2019-11-28T11:36:46.877 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 51 2019-11-28T11:36:46.877 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:46.877 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:36:46.762759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:46.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.819+0000 7ff98888a700 1 -- 172.21.15.80:0/236591161 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff95c020bc0 msgr2=0x7ff95c022ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:46.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.819+0000 7ff98888a700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff95c020bc0 0x7ff95c022ff0 crc :-1 s=READY pgs=440 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:46.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.819+0000 7ff98888a700 1 -- 172.21.15.80:0/236591161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95c003d50 msgr2=0x7ff95c004210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:46.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.819+0000 7ff98888a700 1 --2- 172.21.15.80:0/236591161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95c003d50 0x7ff95c004210 secure :-1 s=READY pgs=1075 cs=0 l=1 rx=0x7ff9740106c0 tx=0x7ff97400b680).stop 2019-11-28T11:36:46.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.819+0000 7ff98359e700 1 -- 172.21.15.80:0/236591161 reap_dead start 2019-11-28T11:36:46.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.819+0000 7ff98359e700 1 -- 172.21.15.80:0/236591161 reap_dead start 2019-11-28T11:36:46.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.819+0000 7ff98888a700 1 -- 172.21.15.80:0/236591161 shutdown_connections 2019-11-28T11:36:46.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.819+0000 7ff98888a700 1 -- 172.21.15.80:0/236591161 shutdown_connections 2019-11-28T11:36:46.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.819+0000 7ff98888a700 1 -- 172.21.15.80:0/236591161 wait complete. 2019-11-28T11:36:46.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:46.819+0000 7ff98888a700 1 -- 172.21.15.80:0/236591161 >> 172.21.15.80:0/236591161 conn(0x7ff98413d930 msgr2=0x7ff984111550 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:46.905 INFO:tasks.cephfs.filesystem:mapped states [u'up:rejoin'] to None 2019-11-28T11:36:47.907 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.970+0000 7f6605b2c700 1 Processor -- start 2019-11-28T11:36:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.970+0000 7f6605b2c700 1 -- start start 2019-11-28T11:36:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.971+0000 7f6605b2c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f660006c490 0x7f660006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.971+0000 7f6605b2c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f660006ce60 0x7f6600164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.971+0000 7f6605b2c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660006db00 con 0x7f660006c0a0 2019-11-28T11:36:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.971+0000 7f6605b2c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660006fd60 con 0x7f660006c490 2019-11-28T11:36:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.971+0000 7f6605b2c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6600070030 con 0x7f660006ce60 2019-11-28T11:36:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.971+0000 7f65fffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f660006c0a0 0x7f6600072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35916/0 (socket says 172.21.15.80:35916) 2019-11-28T11:36:48.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.971+0000 7f65fffff700 1 -- 172.21.15.80:0/1988371214 learned_addr learned my addr 172.21.15.80:0/1988371214 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:48.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.971+0000 7f66048ca700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f660006ce60 0x7f6600164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.971+0000 7f65f7fff700 1 --2- 172.21.15.80:0/1988371214 >> v2:172.21.15.174:3300/0 conn(0x7f660006c490 0x7f660006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.971+0000 7f65ff7fe700 1 -- 172.21.15.80:0/1988371214 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909680031 0 0) 0x7f65f0001150 con 0x7f660006c0a0 2019-11-28T11:36:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.971+0000 7f65ff7fe700 1 -- 172.21.15.80:0/1988371214 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65ec002e80 con 0x7f660006c0a0 2019-11-28T11:36:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.971+0000 7f65ff7fe700 1 -- 172.21.15.80:0/1988371214 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3273411931 0 0) 0x7f65f0001130 con 0x7f660006c0a0 2019-11-28T11:36:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65ff7fe700 1 -- 172.21.15.80:0/1988371214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f660006ce60 msgr2=0x7f6600164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65ff7fe700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f660006ce60 0x7f6600164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65ff7fe700 1 -- 172.21.15.80:0/1988371214 >> v2:172.21.15.174:3300/0 conn(0x7f660006c490 msgr2=0x7f660006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65ff7fe700 1 --2- 172.21.15.80:0/1988371214 >> v2:172.21.15.174:3300/0 conn(0x7f660006c490 0x7f660006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65ff7fe700 1 -- 172.21.15.80:0/1988371214 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66000706c0 con 0x7f660006c0a0 2019-11-28T11:36:48.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65ff7fe700 1 -- 172.21.15.80:0/1988371214 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f65f0001660 con 0x7f660006c0a0 2019-11-28T11:36:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65ff7fe700 1 -- 172.21.15.80:0/1988371214 >> v1:172.21.15.80:6789/0 conn(0x7f660006c0a0 legacy=0x7f6600072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65ff7fe700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65ec047b30 0x7f65ec049f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65ff7fe700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec04a6f0 0x7f65ec04cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65ff7fe700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65ec04d3c0 0x7f65ec04f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:48.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65ff7fe700 1 -- 172.21.15.80:0/1988371214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec0500a0 con 0x7f65ec04a6f0 2019-11-28T11:36:48.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65ff7fe700 1 -- 172.21.15.80:0/1988371214 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec0502d0 con 0x7f65ec04d3c0 2019-11-28T11:36:48.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65ff7fe700 1 -- 172.21.15.80:0/1988371214 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec050500 con 0x7f65ec047b30 2019-11-28T11:36:48.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65f7fff700 1 --2- 172.21.15.80:0/1988371214 >> v2:172.21.15.174:3300/0 conn(0x7f660006c490 0x7f660006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:48.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f66048ca700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f660006ce60 0x7f6600164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65f7fff700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec04a6f0 0x7f65ec04cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65fffff700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65ec047b30 0x7f65ec049f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f66048ca700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65ec04d3c0 0x7f65ec04f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65f7fff700 1 -- 172.21.15.80:0/1988371214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65ec047b30 msgr2=0x7f65ec049f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65f7fff700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65ec047b30 0x7f65ec049f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65f7fff700 1 -- 172.21.15.80:0/1988371214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65ec04d3c0 msgr2=0x7f65ec04f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65f7fff700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65ec04d3c0 0x7f65ec04f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65f7fff700 1 -- 172.21.15.80:0/1988371214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec0507b0 con 0x7f65ec04a6f0 2019-11-28T11:36:48.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65f7fff700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec04a6f0 0x7f65ec04cbc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f65e800d4e0 tx=0x7f65e800d7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65f7fff700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec04a6f0 0x7f65ec04cbc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f65e800d4e0 tx=0x7f65e800d7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65f7fff700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec04a6f0 0x7f65ec04cbc0 secure :-1 s=READY pgs=1077 cs=0 l=1 rx=0x7f65e800d4e0 tx=0x7f65e800d7c0).ready entity=mon.0 client_cookie=530ec2148f95f338 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:48.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65f7fff700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec04a6f0 0x7f65ec04cbc0 secure :-1 s=THROTTLE_DONE pgs=1077 cs=0 l=1 rx=0x7f65e800d4e0 tx=0x7f65e800d7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65ff7fe700 1 -- 172.21.15.80:0/1988371214 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65e800ab60 con 0x7f65ec04a6f0 2019-11-28T11:36:48.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65f7fff700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec04a6f0 0x7f65ec04cbc0 secure :-1 s=THROTTLE_DONE pgs=1077 cs=0 l=1 rx=0x7f65e800d4e0 tx=0x7f65e800d7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65f7fff700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec04a6f0 0x7f65ec04cbc0 secure :-1 s=THROTTLE_DONE pgs=1077 cs=0 l=1 rx=0x7f65e800d4e0 tx=0x7f65e800d7c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65ff7fe700 1 -- 172.21.15.80:0/1988371214 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e8009770 con 0x7f65ec04a6f0 2019-11-28T11:36:48.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f65ff7fe700 1 -- 172.21.15.80:0/1988371214 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65e800ab60 con 0x7f65ec04a6f0 2019-11-28T11:36:48.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f6605b2c700 1 -- 172.21.15.80:0/1988371214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec04a6f0 msgr2=0x7f65ec04cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f6605b2c700 1 --2- 172.21.15.80:0/1988371214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65ec04a6f0 0x7f65ec04cbc0 secure :-1 s=READY pgs=1077 cs=0 l=1 rx=0x7f65e800d4e0 tx=0x7f65e800d7c0).stop 2019-11-28T11:36:48.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.972+0000 7f66048ca700 1 -- 172.21.15.80:0/1988371214 reap_dead start 2019-11-28T11:36:48.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.973+0000 7f6605b2c700 1 -- 172.21.15.80:0/1988371214 shutdown_connections 2019-11-28T11:36:48.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.973+0000 7f6605b2c700 1 -- 172.21.15.80:0/1988371214 shutdown_connections 2019-11-28T11:36:48.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.973+0000 7f6605b2c700 1 -- 172.21.15.80:0/1988371214 wait complete. 2019-11-28T11:36:48.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.973+0000 7f6605b2c700 1 -- 172.21.15.80:0/1988371214 >> 172.21.15.80:0/1988371214 conn(0x7f6600061cf0 msgr2=0x7f6600064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:48.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.976+0000 7f6605b2c700 1 Processor -- start 2019-11-28T11:36:48.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.976+0000 7f6605b2c700 1 -- start start 2019-11-28T11:36:48.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.976+0000 7f6605b2c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6600106c20 0x7f6600138530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:48.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.976+0000 7f6605b2c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6600138a70 0x7f66001375d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:48.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.976+0000 7f6605b2c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66001165a0 con 0x7f6600137b10 2019-11-28T11:36:48.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.976+0000 7f6605b2c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66001267c0 con 0x7f6600138a70 2019-11-28T11:36:48.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.976+0000 7f6605b2c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6600115570 con 0x7f6600106c20 2019-11-28T11:36:48.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65f7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6600138a70 0x7f66001375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f66048ca700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6600137b10 0x7f660013f560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35932/0 (socket says 172.21.15.80:35932) 2019-11-28T11:36:48.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65f7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6600138a70 0x7f66001375d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36612/0 (socket says 172.21.15.80:36612) 2019-11-28T11:36:48.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f66048ca700 1 -- 172.21.15.80:0/2762928239 learned_addr learned my addr 172.21.15.80:0/2762928239 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:48.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65fffff700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6600106c20 0x7f6600138530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65fd7fa700 1 -- 172.21.15.80:0/2762928239 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079700232 0 0) 0x7f65f8009d50 con 0x7f6600137b10 2019-11-28T11:36:48.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65fd7fa700 1 -- 172.21.15.80:0/2762928239 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65e4002e80 con 0x7f6600137b10 2019-11-28T11:36:48.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65f7fff700 1 -- 172.21.15.80:0/2762928239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6600106c20 msgr2=0x7f6600138530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65f7fff700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6600106c20 0x7f6600138530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65f7fff700 1 -- 172.21.15.80:0/2762928239 >> v1:172.21.15.80:6789/0 conn(0x7f6600137b10 legacy=0x7f660013f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65f7fff700 1 -- 172.21.15.80:0/2762928239 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66001158f0 con 0x7f6600138a70 2019-11-28T11:36:48.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65f7fff700 1 --2- 172.21.15.80:0/2762928239 >> v2:172.21.15.80:3300/0 conn(0x7f6600138a70 0x7f66001375d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f65e8010340 tx=0x7f65e80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65f7fff700 1 --2- 172.21.15.80:0/2762928239 >> v2:172.21.15.80:3300/0 conn(0x7f6600138a70 0x7f66001375d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f65e8010340 tx=0x7f65e80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65f7fff700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6600138a70 0x7f66001375d0 secure :-1 s=READY pgs=1079 cs=0 l=1 rx=0x7f65e8010340 tx=0x7f65e80101f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65f7fff700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6600138a70 0x7f66001375d0 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f65e8010340 tx=0x7f65e80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65fd7fa700 1 -- 172.21.15.80:0/2762928239 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65e8000940 con 0x7f6600138a70 2019-11-28T11:36:48.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65f7fff700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6600138a70 0x7f66001375d0 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f65e8010340 tx=0x7f65e80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65f7fff700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6600138a70 0x7f66001375d0 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f65e8010340 tx=0x7f65e80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65fd7fa700 1 -- 172.21.15.80:0/2762928239 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e800d4c0 con 0x7f6600138a70 2019-11-28T11:36:48.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f6605b2c700 1 -- 172.21.15.80:0/2762928239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6600125fa0 con 0x7f6600138a70 2019-11-28T11:36:48.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65fd7fa700 1 -- 172.21.15.80:0/2762928239 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65e8000940 con 0x7f6600138a70 2019-11-28T11:36:48.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f6605b2c700 1 -- 172.21.15.80:0/2762928239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66001147b0 con 0x7f6600138a70 2019-11-28T11:36:48.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.977+0000 7f65f7fff700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6600138a70 0x7f66001375d0 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f65e8010340 tx=0x7f65e80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.978+0000 7f65fd7fa700 1 -- 172.21.15.80:0/2762928239 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f65e8000c90 con 0x7f6600138a70 2019-11-28T11:36:48.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.978+0000 7f65f7fff700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6600138a70 0x7f66001375d0 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f65e8010340 tx=0x7f65e80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.978+0000 7f65fd7fa700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f65e4018770 0x7f65e401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:48.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.978+0000 7f65fd7fa700 1 -- 172.21.15.80:0/2762928239 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f65e8031c30 con 0x7f6600138a70 2019-11-28T11:36:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.978+0000 7f65fffff700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f65e4018770 0x7f65e401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.978+0000 7f65fffff700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f65e4018770 0x7f65e401abe0 crc :-1 s=READY pgs=441 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.985+0000 7f6605b2c700 1 -- 172.21.15.80:0/2762928239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66001158f0 con 0x7f6600138a70 2019-11-28T11:36:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.989+0000 7f65f7fff700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6600138a70 0x7f66001375d0 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f65e8010340 tx=0x7f65e80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:47.989+0000 7f65fd7fa700 1 -- 172.21.15.80:0/2762928239 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f65e800d170 con 0x7f6600138a70 2019-11-28T11:36:48.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.163+0000 7f6605b2c700 1 -- 172.21.15.80:0/2762928239 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6600125fa0 con 0x7f6600138a70 2019-11-28T11:36:48.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.163+0000 7f65f7fff700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6600138a70 0x7f66001375d0 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f65e8010340 tx=0x7f65e80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.163+0000 7f65fd7fa700 1 -- 172.21.15.80:0/2762928239 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+2447 (secure 0 0 0) 0x7f65e800d4c0 con 0x7f6600138a70 2019-11-28T11:36:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 52 2019-11-28T11:36:48.229 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:48.230 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:36:47.769088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":17,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.166+0000 7f6605b2c700 1 -- 172.21.15.80:0/2762928239 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f65e4018770 msgr2=0x7f65e401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.166+0000 7f6605b2c700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f65e4018770 0x7f65e401abe0 crc :-1 s=READY pgs=441 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.166+0000 7f6605b2c700 1 -- 172.21.15.80:0/2762928239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6600138a70 msgr2=0x7f66001375d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.166+0000 7f6605b2c700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6600138a70 0x7f66001375d0 secure :-1 s=READY pgs=1079 cs=0 l=1 rx=0x7f65e8010340 tx=0x7f65e80101f0).stop 2019-11-28T11:36:48.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.166+0000 7f6605b2c700 1 -- 172.21.15.80:0/2762928239 shutdown_connections 2019-11-28T11:36:48.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.166+0000 7f6605b2c700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f65e4018770 0x7f65e401abe0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.166+0000 7f6605b2c700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6600138a70 0x7f66001375d0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.166+0000 7f6605b2c700 1 --2- 172.21.15.80:0/2762928239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6600106c20 0x7f6600138530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.166+0000 7f6605b2c700 1 -- 172.21.15.80:0/2762928239 shutdown_connections 2019-11-28T11:36:48.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.166+0000 7f6605b2c700 1 -- 172.21.15.80:0/2762928239 wait complete. 2019-11-28T11:36:48.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.166+0000 7f6605b2c700 1 -- 172.21.15.80:0/2762928239 >> 172.21.15.80:0/2762928239 conn(0x7f6600141d10 msgr2=0x7f660013ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:48.238 INFO:tasks.cephfs.filesystem:mapped states [u'up:active'] to up:active 2019-11-28T11:36:48.238 INFO:tasks.cephfs.filesystem:reached state 'up:active' in 52.3928608894s 2019-11-28T11:36:48.238 INFO:tasks.cephfs.test_client_recovery:Reached active... 2019-11-28T11:36:48.239 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:36:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.305+0000 7fc1f9ce5700 1 Processor -- start 2019-11-28T11:36:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.305+0000 7fc1f9ce5700 1 -- start start 2019-11-28T11:36:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.306+0000 7fc1f9ce5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc1f406c490 0x7fc1f406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.306+0000 7fc1f9ce5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f406db00 con 0x7fc1f406c0a0 2019-11-28T11:36:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.306+0000 7fc1f9ce5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f406e000 con 0x7fc1f406ce60 2019-11-28T11:36:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.306+0000 7fc1f9ce5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f406fd60 con 0x7fc1f406c490 2019-11-28T11:36:48.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.306+0000 7fc1ebfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc1f406c490 0x7fc1f406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.306+0000 7fc1f3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc1f406c0a0 0x7fc1f4072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35936/0 (socket says 172.21.15.80:35936) 2019-11-28T11:36:48.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.306+0000 7fc1f3fff700 1 -- 172.21.15.80:0/4241270764 learned_addr learned my addr 172.21.15.80:0/4241270764 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:48.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.306+0000 7fc1f37fe700 1 -- 172.21.15.80:0/4241270764 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283473918 0 0) 0x7fc1e4001150 con 0x7fc1f406c0a0 2019-11-28T11:36:48.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.306+0000 7fc1f37fe700 1 -- 172.21.15.80:0/4241270764 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1e0002e80 con 0x7fc1f406c0a0 2019-11-28T11:36:48.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.306+0000 7fc1ebfff700 1 -- 172.21.15.80:0/4241270764 >> v1:172.21.15.174:6789/0 conn(0x7fc1f406ce60 legacy=0x7fc1f4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.306+0000 7fc1ebfff700 1 -- 172.21.15.80:0/4241270764 >> v1:172.21.15.80:6789/0 conn(0x7fc1f406c0a0 legacy=0x7fc1f4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.307+0000 7fc1ebfff700 1 -- 172.21.15.80:0/4241270764 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f40706c0 con 0x7fc1f406c490 2019-11-28T11:36:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.307+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/4241270764 >> v2:172.21.15.80:3300/0 conn(0x7fc1f406c490 0x7fc1f406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc1dc00af50 tx=0x7fc1dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.307+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/4241270764 >> v2:172.21.15.80:3300/0 conn(0x7fc1f406c490 0x7fc1f406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc1dc00af50 tx=0x7fc1dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.307+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/4241270764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f406c490 0x7fc1f406c920 secure :-1 s=READY pgs=1081 cs=0 l=1 rx=0x7fc1dc00af50 tx=0x7fc1dc00b760).ready entity=mon.0 client_cookie=b7ec57339af3593c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.307+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/4241270764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f406c490 0x7fc1f406c920 secure :-1 s=THROTTLE_DONE pgs=1081 cs=0 l=1 rx=0x7fc1dc00af50 tx=0x7fc1dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.307+0000 7fc1f37fe700 1 -- 172.21.15.80:0/4241270764 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1dc000960 con 0x7fc1f406c490 2019-11-28T11:36:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.307+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/4241270764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f406c490 0x7fc1f406c920 secure :-1 s=THROTTLE_DONE pgs=1081 cs=0 l=1 rx=0x7fc1dc00af50 tx=0x7fc1dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.307+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/4241270764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f406c490 0x7fc1f406c920 secure :-1 s=THROTTLE_DONE pgs=1081 cs=0 l=1 rx=0x7fc1dc00af50 tx=0x7fc1dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.307+0000 7fc1f37fe700 1 -- 172.21.15.80:0/4241270764 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc009860 con 0x7fc1f406c490 2019-11-28T11:36:48.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.307+0000 7fc1f37fe700 1 -- 172.21.15.80:0/4241270764 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1dc000960 con 0x7fc1f406c490 2019-11-28T11:36:48.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.307+0000 7fc1f9ce5700 1 -- 172.21.15.80:0/4241270764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f406c490 msgr2=0x7fc1f406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.307+0000 7fc1f9ce5700 1 --2- 172.21.15.80:0/4241270764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f406c490 0x7fc1f406c920 secure :-1 s=READY pgs=1081 cs=0 l=1 rx=0x7fc1dc00af50 tx=0x7fc1dc00b760).stop 2019-11-28T11:36:48.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.307+0000 7fc1f9ce5700 1 -- 172.21.15.80:0/4241270764 shutdown_connections 2019-11-28T11:36:48.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.307+0000 7fc1f9ce5700 1 --2- 172.21.15.80:0/4241270764 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f406c490 0x7fc1f406c920 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.308+0000 7fc1f9ce5700 1 -- 172.21.15.80:0/4241270764 shutdown_connections 2019-11-28T11:36:48.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.308+0000 7fc1f9ce5700 1 -- 172.21.15.80:0/4241270764 wait complete. 2019-11-28T11:36:48.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.308+0000 7fc1f9ce5700 1 -- 172.21.15.80:0/4241270764 >> 172.21.15.80:0/4241270764 conn(0x7fc1f4061cf0 msgr2=0x7fc1f4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:48.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.310+0000 7fc1f9ce5700 1 Processor -- start 2019-11-28T11:36:48.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.310+0000 7fc1f9ce5700 1 -- start start 2019-11-28T11:36:48.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1f9ce5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f413f580 0x7fc1f4114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:48.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1f9ce5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc1f4114670 0x7fc1f411e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:48.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1f9ce5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc1f411eaf0 0x7fc1f411ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:48.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1f9ce5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f4122c80 con 0x7fc1f4114670 2019-11-28T11:36:48.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1f9ce5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f4122140 con 0x7fc1f411eaf0 2019-11-28T11:36:48.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1f9ce5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f4121e60 con 0x7fc1f413f580 2019-11-28T11:36:48.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1ebfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc1f4114670 0x7fc1f411e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1ebfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc1f4114670 0x7fc1f411e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36628/0 (socket says 172.21.15.80:36628) 2019-11-28T11:36:48.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1ebfff700 1 -- 172.21.15.80:0/3896641082 learned_addr learned my addr 172.21.15.80:0/3896641082 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:48.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1f3fff700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f413f580 0x7fc1f4114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1f8a83700 1 --2- 172.21.15.80:0/3896641082 >> v2:172.21.15.174:3300/0 conn(0x7fc1f411eaf0 0x7fc1f411ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1ebfff700 1 -- 172.21.15.80:0/3896641082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f413f580 msgr2=0x7fc1f4114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f413f580 0x7fc1f4114130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1ebfff700 1 -- 172.21.15.80:0/3896641082 >> v2:172.21.15.174:3300/0 conn(0x7fc1f411eaf0 msgr2=0x7fc1f411ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/3896641082 >> v2:172.21.15.174:3300/0 conn(0x7fc1f411eaf0 0x7fc1f411ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1ebfff700 1 -- 172.21.15.80:0/3896641082 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f4124010 con 0x7fc1f4114670 2019-11-28T11:36:48.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/3896641082 >> v2:172.21.15.80:3300/0 conn(0x7fc1f4114670 0x7fc1f411e5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc1dc010420 tx=0x7fc1dc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/3896641082 >> v2:172.21.15.80:3300/0 conn(0x7fc1f4114670 0x7fc1f411e5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc1dc010420 tx=0x7fc1dc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f4114670 0x7fc1f411e5b0 secure :-1 s=READY pgs=1082 cs=0 l=1 rx=0x7fc1dc010420 tx=0x7fc1dc0102d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:48.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f4114670 0x7fc1f411e5b0 secure :-1 s=THROTTLE_DONE pgs=1082 cs=0 l=1 rx=0x7fc1dc010420 tx=0x7fc1dc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f4114670 0x7fc1f411e5b0 secure :-1 s=THROTTLE_DONE pgs=1082 cs=0 l=1 rx=0x7fc1dc010420 tx=0x7fc1dc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1f17fa700 1 -- 172.21.15.80:0/3896641082 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1dc000940 con 0x7fc1f4114670 2019-11-28T11:36:48.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f4114670 0x7fc1f411e5b0 secure :-1 s=THROTTLE_DONE pgs=1082 cs=0 l=1 rx=0x7fc1dc010420 tx=0x7fc1dc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1f17fa700 1 -- 172.21.15.80:0/3896641082 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc009980 con 0x7fc1f4114670 2019-11-28T11:36:48.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1f9ce5700 1 -- 172.21.15.80:0/3896641082 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f4124010 con 0x7fc1f4114670 2019-11-28T11:36:48.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.311+0000 7fc1f17fa700 1 -- 172.21.15.80:0/3896641082 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1dc00a0d0 con 0x7fc1f4114670 2019-11-28T11:36:48.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.312+0000 7fc1f9ce5700 1 -- 172.21.15.80:0/3896641082 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f4124010 con 0x7fc1f4114670 2019-11-28T11:36:48.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.312+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f4114670 0x7fc1f411e5b0 secure :-1 s=THROTTLE_DONE pgs=1082 cs=0 l=1 rx=0x7fc1dc010420 tx=0x7fc1dc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.312+0000 7fc1f17fa700 1 -- 172.21.15.80:0/3896641082 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc1dc009b70 con 0x7fc1f4114670 2019-11-28T11:36:48.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.312+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f4114670 0x7fc1f411e5b0 secure :-1 s=THROTTLE_DONE pgs=1082 cs=0 l=1 rx=0x7fc1dc010420 tx=0x7fc1dc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.312+0000 7fc1f17fa700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc1d8018730 0x7fc1d801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:48.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.312+0000 7fc1f17fa700 1 -- 172.21.15.80:0/3896641082 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fc1dc031a70 con 0x7fc1f4114670 2019-11-28T11:36:48.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.312+0000 7fc1f3fff700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc1d8018730 0x7fc1d801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.313+0000 7fc1f3fff700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc1d8018730 0x7fc1d801abc0 crc :-1 s=READY pgs=442 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:48.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.320+0000 7fc1f9ce5700 1 -- 172.21.15.80:0/3896641082 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f4124010 con 0x7fc1f4114670 2019-11-28T11:36:48.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.323+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f4114670 0x7fc1f411e5b0 secure :-1 s=THROTTLE_DONE pgs=1082 cs=0 l=1 rx=0x7fc1dc010420 tx=0x7fc1dc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.323+0000 7fc1f17fa700 1 -- 172.21.15.80:0/3896641082 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc1dc02cff0 con 0x7fc1f4114670 2019-11-28T11:36:48.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.501+0000 7fc1f9ce5700 1 -- 172.21.15.80:0/3896641082 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1f4124010 con 0x7fc1f4114670 2019-11-28T11:36:48.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.502+0000 7fc1ebfff700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f4114670 0x7fc1f411e5b0 secure :-1 s=THROTTLE_DONE pgs=1082 cs=0 l=1 rx=0x7fc1dc010420 tx=0x7fc1dc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.502+0000 7fc1f17fa700 1 -- 172.21.15.80:0/3896641082 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+15053 (secure 0 0 0) 0x7fc1dc02cff0 con 0x7fc1f4114670 2019-11-28T11:36:48.563 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:48.564 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":82,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:36:45.758316+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:32:57.287502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2019-11-28T11:32:57.974341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.76:0/3432629622":"2019-11-28T12:36:45.218542+0000","172.21.15.174:6835/3402343468":"2019-11-29T11:33:16.997740+0000","172.21.15.174:6834/3402343468":"2019-11-29T11:33:16.997740+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:36:48.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.504+0000 7fc1f9ce5700 1 -- 172.21.15.80:0/3896641082 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc1d8018730 msgr2=0x7fc1d801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.504+0000 7fc1f9ce5700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc1d8018730 0x7fc1d801abc0 crc :-1 s=READY pgs=442 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.504+0000 7fc1f9ce5700 1 -- 172.21.15.80:0/3896641082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f4114670 msgr2=0x7fc1f411e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.504+0000 7fc1f9ce5700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f4114670 0x7fc1f411e5b0 secure :-1 s=READY pgs=1082 cs=0 l=1 rx=0x7fc1dc010420 tx=0x7fc1dc0102d0).stop 2019-11-28T11:36:48.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.504+0000 7fc1f9ce5700 1 -- 172.21.15.80:0/3896641082 shutdown_connections 2019-11-28T11:36:48.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.504+0000 7fc1f9ce5700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc1d8018730 0x7fc1d801abc0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.504+0000 7fc1f9ce5700 1 --2- 172.21.15.80:0/3896641082 >> v2:172.21.15.174:3300/0 conn(0x7fc1f411eaf0 0x7fc1f411ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.504+0000 7fc1f9ce5700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1f4114670 0x7fc1f411e5b0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.504+0000 7fc1f9ce5700 1 --2- 172.21.15.80:0/3896641082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1f413f580 0x7fc1f4114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.504+0000 7fc1f9ce5700 1 -- 172.21.15.80:0/3896641082 shutdown_connections 2019-11-28T11:36:48.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.504+0000 7fc1f9ce5700 1 -- 172.21.15.80:0/3896641082 wait complete. 2019-11-28T11:36:48.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.504+0000 7fc1f9ce5700 1 -- 172.21.15.80:0/3896641082 >> 172.21.15.80:0/3896641082 conn(0x7fc1f41426c0 msgr2=0x7fc1f4110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:48.575 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:32:57.287502+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 12, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'77', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:32:57.974341+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 13, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'78', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:36:48.577 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:36:48.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.643+0000 7efcb24d0700 1 Processor -- start 2019-11-28T11:36:48.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.643+0000 7efcb24d0700 1 -- start start 2019-11-28T11:36:48.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcb24d0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efcac15ed10 0x7efcac15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:48.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcb24d0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcac073020 0x7efcac071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:48.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcb24d0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcac06db60 con 0x7efcac0734b0 2019-11-28T11:36:48.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcb24d0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcac06fe00 con 0x7efcac15ed10 2019-11-28T11:36:48.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcb24d0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcac0700d0 con 0x7efcac073020 2019-11-28T11:36:48.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcb0a6d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efcac15ed10 0x7efcac15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcb126e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efcac0734b0 0x7efcac0723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35950/0 (socket says 172.21.15.80:35950) 2019-11-28T11:36:48.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcb126e700 1 -- 172.21.15.80:0/38708505 learned_addr learned my addr 172.21.15.80:0/38708505 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:48.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcabfff700 1 --2- 172.21.15.80:0/38708505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcac073020 0x7efcac071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcb0a6d700 1 -- 172.21.15.80:0/38708505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcac073020 msgr2=0x7efcac071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:48.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcb0a6d700 1 --2- 172.21.15.80:0/38708505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcac073020 0x7efcac071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:48.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcb0a6d700 1 -- 172.21.15.80:0/38708505 >> v1:172.21.15.80:6789/0 conn(0x7efcac0734b0 legacy=0x7efcac0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcb0a6d700 1 -- 172.21.15.80:0/38708505 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac070760 con 0x7efcac15ed10 2019-11-28T11:36:48.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcab7fe700 1 -- 172.21.15.80:0/38708505 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004851635 0 0) 0x7efca4001150 con 0x7efcac0734b0 2019-11-28T11:36:48.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcb0a6d700 1 --2- 172.21.15.80:0/38708505 >> v2:172.21.15.80:3300/0 conn(0x7efcac15ed10 0x7efcac15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efc9c00af50 tx=0x7efc9c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcb0a6d700 1 --2- 172.21.15.80:0/38708505 >> v2:172.21.15.80:3300/0 conn(0x7efcac15ed10 0x7efcac15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efc9c00af50 tx=0x7efc9c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.644+0000 7efcb0a6d700 1 --2- 172.21.15.80:0/38708505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac15ed10 0x7efcac15f100 secure :-1 s=READY pgs=1084 cs=0 l=1 rx=0x7efc9c00af50 tx=0x7efc9c00b6e0).ready entity=mon.0 client_cookie=65719a7bf4e5cc25 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:48.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.645+0000 7efcb0a6d700 1 --2- 172.21.15.80:0/38708505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac15ed10 0x7efcac15f100 secure :-1 s=THROTTLE_DONE pgs=1084 cs=0 l=1 rx=0x7efc9c00af50 tx=0x7efc9c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.645+0000 7efcab7fe700 1 -- 172.21.15.80:0/38708505 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc9c007210 con 0x7efcac15ed10 2019-11-28T11:36:48.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.645+0000 7efcb0a6d700 1 --2- 172.21.15.80:0/38708505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac15ed10 0x7efcac15f100 secure :-1 s=THROTTLE_DONE pgs=1084 cs=0 l=1 rx=0x7efc9c00af50 tx=0x7efc9c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.645+0000 7efcb0a6d700 1 --2- 172.21.15.80:0/38708505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac15ed10 0x7efcac15f100 secure :-1 s=THROTTLE_DONE pgs=1084 cs=0 l=1 rx=0x7efc9c00af50 tx=0x7efc9c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.645+0000 7efcab7fe700 1 -- 172.21.15.80:0/38708505 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c0099b0 con 0x7efcac15ed10 2019-11-28T11:36:48.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.645+0000 7efcab7fe700 1 -- 172.21.15.80:0/38708505 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc9c00a080 con 0x7efcac15ed10 2019-11-28T11:36:48.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.645+0000 7efcb24d0700 1 -- 172.21.15.80:0/38708505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac15ed10 msgr2=0x7efcac15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.645+0000 7efcb24d0700 1 --2- 172.21.15.80:0/38708505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac15ed10 0x7efcac15f100 secure :-1 s=READY pgs=1084 cs=0 l=1 rx=0x7efc9c00af50 tx=0x7efc9c00b6e0).stop 2019-11-28T11:36:48.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.645+0000 7efcb24d0700 1 -- 172.21.15.80:0/38708505 shutdown_connections 2019-11-28T11:36:48.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.645+0000 7efcb24d0700 1 --2- 172.21.15.80:0/38708505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcac073020 0x7efcac071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:48.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.645+0000 7efcb24d0700 1 --2- 172.21.15.80:0/38708505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac15ed10 0x7efcac15f100 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.645+0000 7efcb24d0700 1 -- 172.21.15.80:0/38708505 shutdown_connections 2019-11-28T11:36:48.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.645+0000 7efcb24d0700 1 -- 172.21.15.80:0/38708505 wait complete. 2019-11-28T11:36:48.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.645+0000 7efcb24d0700 1 -- 172.21.15.80:0/38708505 >> 172.21.15.80:0/38708505 conn(0x7efcac061d20 msgr2=0x7efcac0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:48.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.648+0000 7efcb24d0700 1 Processor -- start 2019-11-28T11:36:48.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.648+0000 7efcb24d0700 1 -- start start 2019-11-28T11:36:48.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcb24d0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efcac148320 0x7efcac10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:48.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcb24d0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efcac10f290 0x7efcac10dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:48.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcb24d0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcac148e00 con 0x7efcac10e110 2019-11-28T11:36:48.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcb24d0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcac13aa20 con 0x7efcac10f290 2019-11-28T11:36:48.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcb24d0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcac13acf0 con 0x7efcac148320 2019-11-28T11:36:48.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcabfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efcac10f290 0x7efcac10dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcabfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efcac10f290 0x7efcac10dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36640/0 (socket says 172.21.15.80:36640) 2019-11-28T11:36:48.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcabfff700 1 -- 172.21.15.80:0/1367104709 learned_addr learned my addr 172.21.15.80:0/1367104709 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:48.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcb0a6d700 1 --2- 172.21.15.80:0/1367104709 >> v2:172.21.15.174:3300/0 conn(0x7efcac148320 0x7efcac10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcabfff700 1 -- 172.21.15.80:0/1367104709 >> v2:172.21.15.174:3300/0 conn(0x7efcac148320 msgr2=0x7efcac10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcabfff700 1 --2- 172.21.15.80:0/1367104709 >> v2:172.21.15.174:3300/0 conn(0x7efcac148320 0x7efcac10ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcabfff700 1 -- 172.21.15.80:0/1367104709 >> v1:172.21.15.174:6789/0 conn(0x7efcac10e110 legacy=0x7efcac1079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcabfff700 1 -- 172.21.15.80:0/1367104709 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac10c490 con 0x7efcac10f290 2019-11-28T11:36:48.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcabfff700 1 --2- 172.21.15.80:0/1367104709 >> v2:172.21.15.80:3300/0 conn(0x7efcac10f290 0x7efcac10dbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc940107d0 tx=0x7efc940105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcabfff700 1 --2- 172.21.15.80:0/1367104709 >> v2:172.21.15.80:3300/0 conn(0x7efcac10f290 0x7efcac10dbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc940107d0 tx=0x7efc940105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcabfff700 1 --2- 172.21.15.80:0/1367104709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac10f290 0x7efcac10dbd0 secure :-1 s=READY pgs=1085 cs=0 l=1 rx=0x7efc940107d0 tx=0x7efc940105d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:48.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcabfff700 1 --2- 172.21.15.80:0/1367104709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac10f290 0x7efcac10dbd0 secure :-1 s=THROTTLE_DONE pgs=1085 cs=0 l=1 rx=0x7efc940107d0 tx=0x7efc940105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcabfff700 1 --2- 172.21.15.80:0/1367104709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac10f290 0x7efcac10dbd0 secure :-1 s=THROTTLE_DONE pgs=1085 cs=0 l=1 rx=0x7efc940107d0 tx=0x7efc940105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efca97fa700 1 -- 172.21.15.80:0/1367104709 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc94005af0 con 0x7efcac10f290 2019-11-28T11:36:48.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcabfff700 1 --2- 172.21.15.80:0/1367104709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac10f290 0x7efcac10dbd0 secure :-1 s=THROTTLE_DONE pgs=1085 cs=0 l=1 rx=0x7efc940107d0 tx=0x7efc940105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efca97fa700 1 -- 172.21.15.80:0/1367104709 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc94005710 con 0x7efcac10f290 2019-11-28T11:36:48.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efca97fa700 1 -- 172.21.15.80:0/1367104709 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc940060d0 con 0x7efcac10f290 2019-11-28T11:36:48.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcb24d0700 1 -- 172.21.15.80:0/1367104709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcac10c810 con 0x7efcac10f290 2019-11-28T11:36:48.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.649+0000 7efcb24d0700 1 -- 172.21.15.80:0/1367104709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcac10c490 con 0x7efcac10f290 2019-11-28T11:36:48.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.650+0000 7efcabfff700 1 --2- 172.21.15.80:0/1367104709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac10f290 0x7efcac10dbd0 secure :-1 s=THROTTLE_DONE pgs=1085 cs=0 l=1 rx=0x7efc940107d0 tx=0x7efc940105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.650+0000 7efca97fa700 1 -- 172.21.15.80:0/1367104709 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efc94005900 con 0x7efcac10f290 2019-11-28T11:36:48.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.650+0000 7efcabfff700 1 --2- 172.21.15.80:0/1367104709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac10f290 0x7efcac10dbd0 secure :-1 s=THROTTLE_DONE pgs=1085 cs=0 l=1 rx=0x7efc940107d0 tx=0x7efc940105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.650+0000 7efca97fa700 1 --2- 172.21.15.80:0/1367104709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc90018730 0x7efc9001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:48.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.650+0000 7efca97fa700 1 -- 172.21.15.80:0/1367104709 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6149+0+0 (secure 0 0 0) 0x7efc94031dc0 con 0x7efcac10f290 2019-11-28T11:36:48.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.650+0000 7efcb0a6d700 1 --2- 172.21.15.80:0/1367104709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc90018730 0x7efc9001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:48.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.651+0000 7efcb0a6d700 1 --2- 172.21.15.80:0/1367104709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc90018730 0x7efc9001abc0 crc :-1 s=READY pgs=443 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:48.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.658+0000 7efcb24d0700 1 -- 172.21.15.80:0/1367104709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcac10c810 con 0x7efcac10f290 2019-11-28T11:36:48.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.662+0000 7efcabfff700 1 --2- 172.21.15.80:0/1367104709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac10f290 0x7efcac10dbd0 secure :-1 s=THROTTLE_DONE pgs=1085 cs=0 l=1 rx=0x7efc940107d0 tx=0x7efc940105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.662+0000 7efca97fa700 1 -- 172.21.15.80:0/1367104709 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efc94024fd0 con 0x7efcac10f290 2019-11-28T11:36:48.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.830+0000 7efcb24d0700 1 -- 172.21.15.80:0/1367104709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7efcac10c490 con 0x7efcac10f290 2019-11-28T11:36:48.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.830+0000 7efcabfff700 1 --2- 172.21.15.80:0/1367104709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac10f290 0x7efcac10dbd0 secure :-1 s=THROTTLE_DONE pgs=1085 cs=0 l=1 rx=0x7efc940107d0 tx=0x7efc940105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:48.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.830+0000 7efca97fa700 1 -- 172.21.15.80:0/1367104709 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v82) v1 ==== 92+0+10 (secure 0 0 0) 0x7efc94024fd0 con 0x7efcac10f290 2019-11-28T11:36:48.891 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:36:48.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.833+0000 7efcb24d0700 1 -- 172.21.15.80:0/1367104709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc90018730 msgr2=0x7efc9001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.833+0000 7efcb24d0700 1 --2- 172.21.15.80:0/1367104709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc90018730 0x7efc9001abc0 crc :-1 s=READY pgs=443 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.833+0000 7efcb24d0700 1 -- 172.21.15.80:0/1367104709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac10f290 msgr2=0x7efcac10dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:48.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.833+0000 7efcb24d0700 1 --2- 172.21.15.80:0/1367104709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac10f290 0x7efcac10dbd0 secure :-1 s=READY pgs=1085 cs=0 l=1 rx=0x7efc940107d0 tx=0x7efc940105d0).stop 2019-11-28T11:36:48.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.833+0000 7efcb24d0700 1 -- 172.21.15.80:0/1367104709 shutdown_connections 2019-11-28T11:36:48.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.833+0000 7efcb24d0700 1 --2- 172.21.15.80:0/1367104709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc90018730 0x7efc9001abc0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.833+0000 7efcb24d0700 1 --2- 172.21.15.80:0/1367104709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcac10f290 0x7efcac10dbd0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.833+0000 7efcb24d0700 1 --2- 172.21.15.80:0/1367104709 >> v2:172.21.15.174:3300/0 conn(0x7efcac148320 0x7efcac10ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:48.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.833+0000 7efcb24d0700 1 -- 172.21.15.80:0/1367104709 shutdown_connections 2019-11-28T11:36:48.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.833+0000 7efcb24d0700 1 -- 172.21.15.80:0/1367104709 wait complete. 2019-11-28T11:36:48.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.833+0000 7efcb24d0700 1 -- 172.21.15.80:0/1367104709 >> 172.21.15.80:0/1367104709 conn(0x7efcac15e2d0 msgr2=0x7efcac147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:48.902 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:36:49.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.968+0000 7f4e1faa5700 1 Processor -- start 2019-11-28T11:36:49.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.968+0000 7f4e1faa5700 1 -- start start 2019-11-28T11:36:49.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1faa5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e1815ed10 0x7f4e1815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:49.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1faa5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4e180734b0 0x7f4e180726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:49.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1faa5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1806db60 con 0x7f4e18073020 2019-11-28T11:36:49.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1faa5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1806f3d0 con 0x7f4e180734b0 2019-11-28T11:36:49.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1faa5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1806fe00 con 0x7f4e1815ed10 2019-11-28T11:36:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1e042700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e1815ed10 0x7f4e1815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1e843700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4e180734b0 0x7f4e180726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1e843700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4e180734b0 0x7f4e180726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:51532/0 (socket says 172.21.15.80:51532) 2019-11-28T11:36:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1e042700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e1815ed10 0x7f4e1815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:38906/0 (socket says 172.21.15.80:38906) 2019-11-28T11:36:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1e843700 1 -- 172.21.15.80:0/2915481167 learned_addr learned my addr 172.21.15.80:0/2915481167 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1e843700 1 -- 172.21.15.80:0/2915481167 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e1815ed10 msgr2=0x7f4e1815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1e843700 1 --2- 172.21.15.80:0/2915481167 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e1815ed10 0x7f4e1815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1e843700 1 -- 172.21.15.80:0/2915481167 >> v1:172.21.15.174:6789/0 conn(0x7f4e18073020 legacy=0x7f4e18071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1e843700 1 -- 172.21.15.80:0/2915481167 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e18070760 con 0x7f4e180734b0 2019-11-28T11:36:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1d040700 1 -- 172.21.15.80:0/2915481167 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804065038 0 0) 0x7f4e08001080 con 0x7f4e18073020 2019-11-28T11:36:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1e042700 1 --2- 172.21.15.80:0/2915481167 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e1815ed10 0x7f4e1815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.969+0000 7f4e1e843700 1 --2- 172.21.15.80:0/2915481167 >> v2:172.21.15.174:3300/0 conn(0x7f4e180734b0 0x7f4e180726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4e1000f760 tx=0x7f4e1000fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.970+0000 7f4e1e843700 1 --2- 172.21.15.80:0/2915481167 >> v2:172.21.15.174:3300/0 conn(0x7f4e180734b0 0x7f4e180726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4e1000f760 tx=0x7f4e1000fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.970+0000 7f4e1e843700 1 --2- 172.21.15.80:0/2915481167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e180734b0 0x7f4e180726a0 secure :-1 s=READY pgs=649 cs=0 l=1 rx=0x7f4e1000f760 tx=0x7f4e1000fb00).ready entity=mon.1 client_cookie=911fe96d47b695 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:49.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.970+0000 7f4e1e843700 1 --2- 172.21.15.80:0/2915481167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e180734b0 0x7f4e180726a0 secure :-1 s=THROTTLE_DONE pgs=649 cs=0 l=1 rx=0x7f4e1000f760 tx=0x7f4e1000fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.970+0000 7f4e1d040700 1 -- 172.21.15.80:0/2915481167 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e10000a70 con 0x7f4e180734b0 2019-11-28T11:36:49.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.970+0000 7f4e1e843700 1 --2- 172.21.15.80:0/2915481167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e180734b0 0x7f4e180726a0 secure :-1 s=THROTTLE_DONE pgs=649 cs=0 l=1 rx=0x7f4e1000f760 tx=0x7f4e1000fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.970+0000 7f4e1e843700 1 --2- 172.21.15.80:0/2915481167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e180734b0 0x7f4e180726a0 secure :-1 s=THROTTLE_DONE pgs=649 cs=0 l=1 rx=0x7f4e1000f760 tx=0x7f4e1000fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.970+0000 7f4e1d040700 1 -- 172.21.15.80:0/2915481167 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e10000e70 con 0x7f4e180734b0 2019-11-28T11:36:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.970+0000 7f4e1d040700 1 -- 172.21.15.80:0/2915481167 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e10001500 con 0x7f4e180734b0 2019-11-28T11:36:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.970+0000 7f4e1faa5700 1 -- 172.21.15.80:0/2915481167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e180734b0 msgr2=0x7f4e180726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.970+0000 7f4e1faa5700 1 --2- 172.21.15.80:0/2915481167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e180734b0 0x7f4e180726a0 secure :-1 s=READY pgs=649 cs=0 l=1 rx=0x7f4e1000f760 tx=0x7f4e1000fb00).stop 2019-11-28T11:36:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.971+0000 7f4e1faa5700 1 -- 172.21.15.80:0/2915481167 shutdown_connections 2019-11-28T11:36:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.971+0000 7f4e1faa5700 1 --2- 172.21.15.80:0/2915481167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e180734b0 0x7f4e180726a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:49.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.971+0000 7f4e1faa5700 1 --2- 172.21.15.80:0/2915481167 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e1815ed10 0x7f4e1815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:49.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.971+0000 7f4e1faa5700 1 -- 172.21.15.80:0/2915481167 shutdown_connections 2019-11-28T11:36:49.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.971+0000 7f4e1faa5700 1 -- 172.21.15.80:0/2915481167 wait complete. 2019-11-28T11:36:49.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.971+0000 7f4e1faa5700 1 -- 172.21.15.80:0/2915481167 >> 172.21.15.80:0/2915481167 conn(0x7f4e18061d20 msgr2=0x7f4e180641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:49.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.973+0000 7f4e1faa5700 1 Processor -- start 2019-11-28T11:36:49.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.973+0000 7f4e1faa5700 1 -- start start 2019-11-28T11:36:49.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e1faa5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e1810f9f0 0x7f4e18168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:49.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e1faa5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1810c250 con 0x7f4e1810e970 2019-11-28T11:36:49.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e1faa5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1810fe70 con 0x7f4e1810ed60 2019-11-28T11:36:49.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e1faa5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1810e430 con 0x7f4e1810f9f0 2019-11-28T11:36:49.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e1e843700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e1810f9f0 0x7f4e18168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:49.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e1e843700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e1810f9f0 0x7f4e18168d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36654/0 (socket says 172.21.15.80:36654) 2019-11-28T11:36:49.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e1e843700 1 -- 172.21.15.80:0/452059577 learned_addr learned my addr 172.21.15.80:0/452059577 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:49.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e1e042700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4e1810e970 0x7f4e181087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35968/0 (socket says 172.21.15.80:35968) 2019-11-28T11:36:49.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e1e843700 1 -- 172.21.15.80:0/452059577 >> v1:172.21.15.174:6789/0 conn(0x7f4e1810ed60 legacy=0x7f4e1810f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e1e843700 1 -- 172.21.15.80:0/452059577 >> v1:172.21.15.80:6789/0 conn(0x7f4e1810e970 legacy=0x7f4e181087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e1e843700 1 -- 172.21.15.80:0/452059577 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e18105ef0 con 0x7f4e1810f9f0 2019-11-28T11:36:49.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e16ffd700 1 -- 172.21.15.80:0/452059577 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028857718 0 0) 0x7f4e0000dcf0 con 0x7f4e1810e970 2019-11-28T11:36:49.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e1e843700 1 --2- 172.21.15.80:0/452059577 >> v2:172.21.15.80:3300/0 conn(0x7f4e1810f9f0 0x7f4e18168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4e10008120 tx=0x7f4e10012a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e1e843700 1 --2- 172.21.15.80:0/452059577 >> v2:172.21.15.80:3300/0 conn(0x7f4e1810f9f0 0x7f4e18168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4e10008120 tx=0x7f4e10012a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e1e843700 1 --2- 172.21.15.80:0/452059577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1810f9f0 0x7f4e18168d80 secure :-1 s=READY pgs=1087 cs=0 l=1 rx=0x7f4e10008120 tx=0x7f4e10012a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e1e843700 1 --2- 172.21.15.80:0/452059577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1810f9f0 0x7f4e18168d80 secure :-1 s=THROTTLE_DONE pgs=1087 cs=0 l=1 rx=0x7f4e10008120 tx=0x7f4e10012a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.974+0000 7f4e16ffd700 1 -- 172.21.15.80:0/452059577 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e10008250 con 0x7f4e1810f9f0 2019-11-28T11:36:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.975+0000 7f4e1faa5700 1 -- 172.21.15.80:0/452059577 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e18106270 con 0x7f4e1810f9f0 2019-11-28T11:36:49.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.975+0000 7f4e1e843700 1 --2- 172.21.15.80:0/452059577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1810f9f0 0x7f4e18168d80 secure :-1 s=THROTTLE_DONE pgs=1087 cs=0 l=1 rx=0x7f4e10008120 tx=0x7f4e10012a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.975+0000 7f4e1faa5700 1 -- 172.21.15.80:0/452059577 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e18105ef0 con 0x7f4e1810f9f0 2019-11-28T11:36:49.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.975+0000 7f4e1e843700 1 --2- 172.21.15.80:0/452059577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1810f9f0 0x7f4e18168d80 secure :-1 s=THROTTLE_DONE pgs=1087 cs=0 l=1 rx=0x7f4e10008120 tx=0x7f4e10012a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.975+0000 7f4e16ffd700 1 -- 172.21.15.80:0/452059577 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e100081b0 con 0x7f4e1810f9f0 2019-11-28T11:36:49.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.975+0000 7f4e16ffd700 1 -- 172.21.15.80:0/452059577 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e100075d0 con 0x7f4e1810f9f0 2019-11-28T11:36:49.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.975+0000 7f4e1e843700 1 --2- 172.21.15.80:0/452059577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1810f9f0 0x7f4e18168d80 secure :-1 s=THROTTLE_DONE pgs=1087 cs=0 l=1 rx=0x7f4e10008120 tx=0x7f4e10012a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.975+0000 7f4e16ffd700 1 -- 172.21.15.80:0/452059577 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4e100075d0 con 0x7f4e1810f9f0 2019-11-28T11:36:49.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.975+0000 7f4e1e843700 1 --2- 172.21.15.80:0/452059577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1810f9f0 0x7f4e18168d80 secure :-1 s=THROTTLE_DONE pgs=1087 cs=0 l=1 rx=0x7f4e10008120 tx=0x7f4e10012a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.975+0000 7f4e16ffd700 1 --2- 172.21.15.80:0/452059577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4dfc018730 0x7f4dfc01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:49.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.975+0000 7f4e16ffd700 1 -- 172.21.15.80:0/452059577 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f4e10033fe0 con 0x7f4e1810f9f0 2019-11-28T11:36:49.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.975+0000 7f4e1e042700 1 --2- 172.21.15.80:0/452059577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4dfc018730 0x7f4dfc01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:49.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.976+0000 7f4e1e042700 1 --2- 172.21.15.80:0/452059577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4dfc018730 0x7f4dfc01abe0 crc :-1 s=READY pgs=444 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:49.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.983+0000 7f4e1faa5700 1 -- 172.21.15.80:0/452059577 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e18106270 con 0x7f4e1810f9f0 2019-11-28T11:36:49.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.986+0000 7f4e1e843700 1 --2- 172.21.15.80:0/452059577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1810f9f0 0x7f4e18168d80 secure :-1 s=THROTTLE_DONE pgs=1087 cs=0 l=1 rx=0x7f4e10008120 tx=0x7f4e10012a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:48.986+0000 7f4e16ffd700 1 -- 172.21.15.80:0/452059577 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4e10019880 con 0x7f4e1810f9f0 2019-11-28T11:36:49.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.153+0000 7f4e1faa5700 1 -- 172.21.15.80:0/452059577 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f4e18105ef0 con 0x7f4e1810f9f0 2019-11-28T11:36:49.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.153+0000 7f4e1e843700 1 --2- 172.21.15.80:0/452059577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1810f9f0 0x7f4e18168d80 secure :-1 s=THROTTLE_DONE pgs=1087 cs=0 l=1 rx=0x7f4e10008120 tx=0x7f4e10012a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.153+0000 7f4e16ffd700 1 -- 172.21.15.80:0/452059577 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v82) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4e100075d0 con 0x7f4e1810f9f0 2019-11-28T11:36:49.217 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:36:49.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.156+0000 7f4e1faa5700 1 -- 172.21.15.80:0/452059577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4dfc018730 msgr2=0x7f4dfc01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.156+0000 7f4e1faa5700 1 --2- 172.21.15.80:0/452059577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4dfc018730 0x7f4dfc01abe0 crc :-1 s=READY pgs=444 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:49.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.156+0000 7f4e1faa5700 1 -- 172.21.15.80:0/452059577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1810f9f0 msgr2=0x7f4e18168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.156+0000 7f4e1faa5700 1 --2- 172.21.15.80:0/452059577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1810f9f0 0x7f4e18168d80 secure :-1 s=READY pgs=1087 cs=0 l=1 rx=0x7f4e10008120 tx=0x7f4e10012a70).stop 2019-11-28T11:36:49.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.156+0000 7f4e1faa5700 1 -- 172.21.15.80:0/452059577 shutdown_connections 2019-11-28T11:36:49.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.156+0000 7f4e1faa5700 1 --2- 172.21.15.80:0/452059577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1810f9f0 0x7f4e18168d80 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:49.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.156+0000 7f4e1faa5700 1 --2- 172.21.15.80:0/452059577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4dfc018730 0x7f4dfc01abe0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:49.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.156+0000 7f4e1faa5700 1 -- 172.21.15.80:0/452059577 shutdown_connections 2019-11-28T11:36:49.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.156+0000 7f4e1faa5700 1 -- 172.21.15.80:0/452059577 wait complete. 2019-11-28T11:36:49.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.156+0000 7f4e1faa5700 1 -- 172.21.15.80:0/452059577 >> 172.21.15.80:0/452059577 conn(0x7f4e1815e2d0 msgr2=0x7f4e18147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:49.226 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:36:49.316 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:36:49.324 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:36:49.335 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:36:49.341 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:36:49.363 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:36:49.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.290+0000 7f242b80f700 1 Processor -- start 2019-11-28T11:36:49.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.290+0000 7f242b80f700 1 -- start start 2019-11-28T11:36:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.291+0000 7f242b80f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f242415ed10 0x7f242415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.291+0000 7f242b80f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f24240734b0 0x7f24240726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.291+0000 7f242b80f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242406db60 con 0x7f2424073020 2019-11-28T11:36:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.291+0000 7f242b80f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242406f3d0 con 0x7f24240734b0 2019-11-28T11:36:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.291+0000 7f242b80f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242406fe00 con 0x7f242415ed10 2019-11-28T11:36:49.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.291+0000 7f242a5ad700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f24240734b0 0x7f24240726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:49.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.291+0000 7f242a5ad700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f24240734b0 0x7f24240726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36662/0 (socket says 172.21.15.80:36662) 2019-11-28T11:36:49.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.291+0000 7f242a5ad700 1 -- 172.21.15.80:0/3992794208 learned_addr learned my addr 172.21.15.80:0/3992794208 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:49.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.291+0000 7f2429dac700 1 --2- 172.21.15.80:0/3992794208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f242415ed10 0x7f242415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:49.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.291+0000 7f242a5ad700 1 -- 172.21.15.80:0/3992794208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f242415ed10 msgr2=0x7f242415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:49.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.291+0000 7f242a5ad700 1 --2- 172.21.15.80:0/3992794208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f242415ed10 0x7f242415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:49.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.291+0000 7f242a5ad700 1 -- 172.21.15.80:0/3992794208 >> v1:172.21.15.80:6789/0 conn(0x7f2424073020 legacy=0x7f2424071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.291+0000 7f242a5ad700 1 -- 172.21.15.80:0/3992794208 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2424070760 con 0x7f24240734b0 2019-11-28T11:36:49.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.291+0000 7f242a5ad700 1 --2- 172.21.15.80:0/3992794208 >> v2:172.21.15.80:3300/0 conn(0x7f24240734b0 0x7f24240726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f241c00fa30 tx=0x7f241c00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.292+0000 7f242a5ad700 1 --2- 172.21.15.80:0/3992794208 >> v2:172.21.15.80:3300/0 conn(0x7f24240734b0 0x7f24240726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f241c00fa30 tx=0x7f241c00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.292+0000 7f242a5ad700 1 --2- 172.21.15.80:0/3992794208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24240734b0 0x7f24240726a0 secure :-1 s=READY pgs=1089 cs=0 l=1 rx=0x7f241c00fa30 tx=0x7f241c00fdd0).ready entity=mon.0 client_cookie=2f1518b0e7bc69c2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:49.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.292+0000 7f242a5ad700 1 --2- 172.21.15.80:0/3992794208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24240734b0 0x7f24240726a0 secure :-1 s=THROTTLE_DONE pgs=1089 cs=0 l=1 rx=0x7f241c00fa30 tx=0x7f241c00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.292+0000 7f242a5ad700 1 --2- 172.21.15.80:0/3992794208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24240734b0 0x7f24240726a0 secure :-1 s=THROTTLE_DONE pgs=1089 cs=0 l=1 rx=0x7f241c00fa30 tx=0x7f241c00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.292+0000 7f2428daa700 1 -- 172.21.15.80:0/3992794208 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f241c000df0 con 0x7f24240734b0 2019-11-28T11:36:49.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.292+0000 7f242a5ad700 1 --2- 172.21.15.80:0/3992794208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24240734b0 0x7f24240726a0 secure :-1 s=THROTTLE_DONE pgs=1089 cs=0 l=1 rx=0x7f241c00fa30 tx=0x7f241c00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.292+0000 7f2428daa700 1 -- 172.21.15.80:0/3992794208 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c001460 con 0x7f24240734b0 2019-11-28T11:36:49.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.292+0000 7f2428daa700 1 -- 172.21.15.80:0/3992794208 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f241c001b30 con 0x7f24240734b0 2019-11-28T11:36:49.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.292+0000 7f242b80f700 1 -- 172.21.15.80:0/3992794208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24240734b0 msgr2=0x7f24240726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.292+0000 7f242b80f700 1 --2- 172.21.15.80:0/3992794208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24240734b0 0x7f24240726a0 secure :-1 s=READY pgs=1089 cs=0 l=1 rx=0x7f241c00fa30 tx=0x7f241c00fdd0).stop 2019-11-28T11:36:49.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.292+0000 7f242b80f700 1 -- 172.21.15.80:0/3992794208 shutdown_connections 2019-11-28T11:36:49.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.292+0000 7f242b80f700 1 --2- 172.21.15.80:0/3992794208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24240734b0 0x7f24240726a0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:49.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.293+0000 7f242b80f700 1 --2- 172.21.15.80:0/3992794208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f242415ed10 0x7f242415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:49.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.293+0000 7f242b80f700 1 -- 172.21.15.80:0/3992794208 shutdown_connections 2019-11-28T11:36:49.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.293+0000 7f242b80f700 1 -- 172.21.15.80:0/3992794208 wait complete. 2019-11-28T11:36:49.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.293+0000 7f242b80f700 1 -- 172.21.15.80:0/3992794208 >> 172.21.15.80:0/3992794208 conn(0x7f2424061d20 msgr2=0x7f24240641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:49.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.295+0000 7f242b80f700 1 Processor -- start 2019-11-28T11:36:49.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.295+0000 7f242b80f700 1 -- start start 2019-11-28T11:36:49.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.296+0000 7f242b80f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f242412bde0 0x7f242412c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:49.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.296+0000 7f242b80f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f242412c7b0 0x7f2424156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:49.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.296+0000 7f242b80f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2424104420 con 0x7f242415faf0 2019-11-28T11:36:49.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.296+0000 7f242b80f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2424111980 con 0x7f242412c7b0 2019-11-28T11:36:49.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.296+0000 7f242b80f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2424111c50 con 0x7f242412bde0 2019-11-28T11:36:49.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.296+0000 7f2429dac700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f242415faf0 0x7f24241573a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35980/0 (socket says 172.21.15.80:35980) 2019-11-28T11:36:49.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.296+0000 7f2429dac700 1 -- 172.21.15.80:0/2038949697 learned_addr learned my addr 172.21.15.80:0/2038949697 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:49.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.296+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998916738 0 0) 0x7f24140057b0 con 0x7f242415faf0 2019-11-28T11:36:49.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.296+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2404002e80 con 0x7f242415faf0 2019-11-28T11:36:49.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.296+0000 7f24295ab700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f242412bde0 0x7f242412c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:49.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.296+0000 7f242a5ad700 1 --2- 172.21.15.80:0/2038949697 >> v2:172.21.15.174:3300/0 conn(0x7f242412c7b0 0x7f2424156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:49.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3463592610 0 0) 0x7f2414000dc0 con 0x7f242415faf0 2019-11-28T11:36:49.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f24040032e0 con 0x7f242415faf0 2019-11-28T11:36:49.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f2414001350 con 0x7f242415faf0 2019-11-28T11:36:49.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f242412bde0 msgr2=0x7f242412c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24227fc700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f242412bde0 0x7f242412c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:49.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 >> v2:172.21.15.174:3300/0 conn(0x7f242412c7b0 msgr2=0x7f2424156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24227fc700 1 --2- 172.21.15.80:0/2038949697 >> v2:172.21.15.174:3300/0 conn(0x7f242412c7b0 0x7f2424156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:49.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 >> v1:172.21.15.80:6789/0 conn(0x7f242415faf0 legacy=0x7f24241573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24227fc700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24040033f0 0x7f2404003840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:49.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24227fc700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2404003d80 0x7f2404004220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:49.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24227fc700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24040049e0 0x7f2404004e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:49.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240400bc70 con 0x7f2404003d80 2019-11-28T11:36:49.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240400bea0 con 0x7f24040033f0 2019-11-28T11:36:49.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240400c0d0 con 0x7f24040049e0 2019-11-28T11:36:49.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f242a5ad700 1 --2- 172.21.15.80:0/2038949697 >> v2:172.21.15.174:3300/0 conn(0x7f242412c7b0 0x7f2424156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:49.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24295ab700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f242412bde0 0x7f242412c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:49.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24295ab700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2404003d80 0x7f2404004220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:49.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f2429dac700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24040033f0 0x7f2404003840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:49.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f242a5ad700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24040049e0 0x7f2404004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:49.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24295ab700 1 -- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24040049e0 msgr2=0x7f2404004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24295ab700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24040049e0 0x7f2404004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:49.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24295ab700 1 -- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24040033f0 msgr2=0x7f2404003840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24295ab700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24040033f0 0x7f2404003840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:49.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24295ab700 1 -- 172.21.15.80:0/2038949697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240400c380 con 0x7f2404003d80 2019-11-28T11:36:49.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f242b80f700 1 -- 172.21.15.80:0/2038949697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2424112660 con 0x7f2404003d80 2019-11-28T11:36:49.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24295ab700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2404003d80 0x7f2404004220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f24180103b0 tx=0x7f241800be50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24295ab700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2404003d80 0x7f2404004220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f24180103b0 tx=0x7f241800be50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.297+0000 7f24295ab700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2404003d80 0x7f2404004220 secure :-1 s=READY pgs=1091 cs=0 l=1 rx=0x7f24180103b0 tx=0x7f241800be50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:49.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.298+0000 7f242b80f700 1 -- 172.21.15.80:0/2038949697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24241122e0 con 0x7f2404003d80 2019-11-28T11:36:49.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.298+0000 7f24295ab700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2404003d80 0x7f2404004220 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7f24180103b0 tx=0x7f241800be50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.298+0000 7f24295ab700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2404003d80 0x7f2404004220 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7f24180103b0 tx=0x7f241800be50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.298+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f241800ad30 con 0x7f2404003d80 2019-11-28T11:36:49.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.298+0000 7f24295ab700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2404003d80 0x7f2404004220 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7f24180103b0 tx=0x7f241800be50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.298+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2418000b10 con 0x7f2404003d80 2019-11-28T11:36:49.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.298+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2418009d90 con 0x7f2404003d80 2019-11-28T11:36:49.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.298+0000 7f24295ab700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2404003d80 0x7f2404004220 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7f24180103b0 tx=0x7f241800be50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.298+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f241800a280 con 0x7f2404003d80 2019-11-28T11:36:49.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.298+0000 7f24295ab700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2404003d80 0x7f2404004220 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7f24180103b0 tx=0x7f241800be50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.298+0000 7f24227fc700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2404020b20 0x7f2404022f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:49.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.298+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f2418031b90 con 0x7f2404003d80 2019-11-28T11:36:49.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.298+0000 7f2429dac700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2404020b20 0x7f2404022f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:49.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.299+0000 7f2429dac700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2404020b20 0x7f2404022f50 crc :-1 s=READY pgs=445 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:49.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.306+0000 7f242b80f700 1 -- 172.21.15.80:0/2038949697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2400002e60 con 0x7f2404003d80 2019-11-28T11:36:49.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.309+0000 7f24295ab700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2404003d80 0x7f2404004220 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7f24180103b0 tx=0x7f241800be50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.309+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f241800a070 con 0x7f2404003d80 2019-11-28T11:36:49.404 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:36:49.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.479+0000 7f242b80f700 1 -- 172.21.15.80:0/2038949697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f2400001d30 con 0x7f2404003d80 2019-11-28T11:36:49.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.479+0000 7f24295ab700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2404003d80 0x7f2404004220 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7f24180103b0 tx=0x7f241800be50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.479+0000 7f24227fc700 1 -- 172.21.15.80:0/2038949697 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v82) v1 ==== 100+0+10 (secure 0 0 0) 0x7f241800a280 con 0x7f2404003d80 2019-11-28T11:36:49.539 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:36:49.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.481+0000 7f242b80f700 1 -- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2404020b20 msgr2=0x7f2404022f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.481+0000 7f242b80f700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2404020b20 0x7f2404022f50 crc :-1 s=READY pgs=445 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:49.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.481+0000 7f242b80f700 1 -- 172.21.15.80:0/2038949697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2404003d80 msgr2=0x7f2404004220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.481+0000 7f242b80f700 1 --2- 172.21.15.80:0/2038949697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2404003d80 0x7f2404004220 secure :-1 s=READY pgs=1091 cs=0 l=1 rx=0x7f24180103b0 tx=0x7f241800be50).stop 2019-11-28T11:36:49.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.481+0000 7f242a5ad700 1 -- 172.21.15.80:0/2038949697 reap_dead start 2019-11-28T11:36:49.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.482+0000 7f242b80f700 1 -- 172.21.15.80:0/2038949697 shutdown_connections 2019-11-28T11:36:49.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.482+0000 7f242b80f700 1 -- 172.21.15.80:0/2038949697 shutdown_connections 2019-11-28T11:36:49.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.482+0000 7f242b80f700 1 -- 172.21.15.80:0/2038949697 wait complete. 2019-11-28T11:36:49.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.482+0000 7f242b80f700 1 -- 172.21.15.80:0/2038949697 >> 172.21.15.80:0/2038949697 conn(0x7f242407c4f0 msgr2=0x7f242415ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:49.553 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:36:49.553 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:49.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.613+0000 7fbc56bf7700 1 Processor -- start 2019-11-28T11:36:49.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.614+0000 7fbc56bf7700 1 -- start start 2019-11-28T11:36:49.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc56bf7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbc5006c0a0 0x7fbc50072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:49.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc56bf7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5006db00 con 0x7fbc500734e0 2019-11-28T11:36:49.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc56bf7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5006e000 con 0x7fbc50072620 2019-11-28T11:36:49.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc56bf7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5006fd60 con 0x7fbc5006c0a0 2019-11-28T11:36:49.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc55194700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbc5006c0a0 0x7fbc50072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:49.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc54993700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbc500734e0 0x7fbc50071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35998/0 (socket says 172.21.15.80:35998) 2019-11-28T11:36:49.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc54993700 1 -- 172.21.15.80:0/533732230 learned_addr learned my addr 172.21.15.80:0/533732230 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:49.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc55194700 1 -- 172.21.15.80:0/533732230 >> v1:172.21.15.174:6789/0 conn(0x7fbc50072620 legacy=0x7fbc50164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc55194700 1 -- 172.21.15.80:0/533732230 >> v1:172.21.15.80:6789/0 conn(0x7fbc500734e0 legacy=0x7fbc50071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc55194700 1 -- 172.21.15.80:0/533732230 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc500706c0 con 0x7fbc5006c0a0 2019-11-28T11:36:49.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc4ffff700 1 -- 172.21.15.80:0/533732230 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579502069 0 0) 0x7fbc380013f0 con 0x7fbc500734e0 2019-11-28T11:36:49.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc55194700 1 --2- 172.21.15.80:0/533732230 >> v2:172.21.15.80:3300/0 conn(0x7fbc5006c0a0 0x7fbc50072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbc4000af50 tx=0x7fbc4000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc55194700 1 --2- 172.21.15.80:0/533732230 >> v2:172.21.15.80:3300/0 conn(0x7fbc5006c0a0 0x7fbc50072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbc4000af50 tx=0x7fbc4000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc55194700 1 --2- 172.21.15.80:0/533732230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc5006c0a0 0x7fbc50072fa0 secure :-1 s=READY pgs=1093 cs=0 l=1 rx=0x7fbc4000af50 tx=0x7fbc4000b760).ready entity=mon.0 client_cookie=87e51a5604b5f5cc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:49.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc55194700 1 --2- 172.21.15.80:0/533732230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc5006c0a0 0x7fbc50072fa0 secure :-1 s=THROTTLE_DONE pgs=1093 cs=0 l=1 rx=0x7fbc4000af50 tx=0x7fbc4000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc4ffff700 1 -- 172.21.15.80:0/533732230 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc40007210 con 0x7fbc5006c0a0 2019-11-28T11:36:49.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc55194700 1 --2- 172.21.15.80:0/533732230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc5006c0a0 0x7fbc50072fa0 secure :-1 s=THROTTLE_DONE pgs=1093 cs=0 l=1 rx=0x7fbc4000af50 tx=0x7fbc4000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc55194700 1 --2- 172.21.15.80:0/533732230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc5006c0a0 0x7fbc50072fa0 secure :-1 s=THROTTLE_DONE pgs=1093 cs=0 l=1 rx=0x7fbc4000af50 tx=0x7fbc4000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc4ffff700 1 -- 172.21.15.80:0/533732230 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc400099b0 con 0x7fbc5006c0a0 2019-11-28T11:36:49.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc4ffff700 1 -- 172.21.15.80:0/533732230 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc4000a080 con 0x7fbc5006c0a0 2019-11-28T11:36:49.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.615+0000 7fbc56bf7700 1 -- 172.21.15.80:0/533732230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc5006c0a0 msgr2=0x7fbc50072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.616+0000 7fbc56bf7700 1 --2- 172.21.15.80:0/533732230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc5006c0a0 0x7fbc50072fa0 secure :-1 s=READY pgs=1093 cs=0 l=1 rx=0x7fbc4000af50 tx=0x7fbc4000b760).stop 2019-11-28T11:36:49.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.616+0000 7fbc56bf7700 1 -- 172.21.15.80:0/533732230 shutdown_connections 2019-11-28T11:36:49.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.616+0000 7fbc56bf7700 1 --2- 172.21.15.80:0/533732230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc5006c0a0 0x7fbc50072fa0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:49.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.616+0000 7fbc56bf7700 1 -- 172.21.15.80:0/533732230 shutdown_connections 2019-11-28T11:36:49.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.616+0000 7fbc56bf7700 1 -- 172.21.15.80:0/533732230 wait complete. 2019-11-28T11:36:49.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.616+0000 7fbc56bf7700 1 -- 172.21.15.80:0/533732230 >> 172.21.15.80:0/533732230 conn(0x7fbc50061cf0 msgr2=0x7fbc50064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:49.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.619+0000 7fbc56bf7700 1 Processor -- start 2019-11-28T11:36:49.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.619+0000 7fbc56bf7700 1 -- start start 2019-11-28T11:36:49.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc56bf7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbc5015ce10 0x7fbc50140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:49.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc56bf7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5015d4a0 con 0x7fbc5015c9a0 2019-11-28T11:36:49.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc56bf7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5013f510 con 0x7fbc5012a8e0 2019-11-28T11:36:49.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc56bf7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc50163ae0 con 0x7fbc5015ce10 2019-11-28T11:36:49.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc54993700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbc5015c9a0 0x7fbc5013ff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36002/0 (socket says 172.21.15.80:36002) 2019-11-28T11:36:49.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc54993700 1 -- 172.21.15.80:0/1797437316 learned_addr learned my addr 172.21.15.80:0/1797437316 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:49.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc55995700 1 --2- 172.21.15.80:0/1797437316 >> v2:172.21.15.174:3300/0 conn(0x7fbc5015ce10 0x7fbc50140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:49.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc4dffb700 1 -- 172.21.15.80:0/1797437316 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813770109 0 0) 0x7fbc380014e0 con 0x7fbc5015c9a0 2019-11-28T11:36:49.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc4dffb700 1 -- 172.21.15.80:0/1797437316 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc34002e80 con 0x7fbc5015c9a0 2019-11-28T11:36:49.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc4dffb700 1 -- 172.21.15.80:0/1797437316 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3105433366 0 0) 0x7fbc380015b0 con 0x7fbc5015c9a0 2019-11-28T11:36:49.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc4dffb700 1 -- 172.21.15.80:0/1797437316 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbc340032e0 con 0x7fbc5015c9a0 2019-11-28T11:36:49.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc4dffb700 1 -- 172.21.15.80:0/1797437316 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fbc38001ac0 con 0x7fbc5015c9a0 2019-11-28T11:36:49.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc55995700 1 -- 172.21.15.80:0/1797437316 >> v1:172.21.15.174:6789/0 conn(0x7fbc5012a8e0 legacy=0x7fbc50140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc55995700 1 -- 172.21.15.80:0/1797437316 >> v1:172.21.15.80:6789/0 conn(0x7fbc5015c9a0 legacy=0x7fbc5013ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc55995700 1 -- 172.21.15.80:0/1797437316 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc50164440 con 0x7fbc5015ce10 2019-11-28T11:36:49.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc55995700 1 --2- 172.21.15.80:0/1797437316 >> v2:172.21.15.174:3300/0 conn(0x7fbc5015ce10 0x7fbc50140720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbc480103b0 tx=0x7fbc48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.620+0000 7fbc55995700 1 --2- 172.21.15.80:0/1797437316 >> v2:172.21.15.174:3300/0 conn(0x7fbc5015ce10 0x7fbc50140720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbc480103b0 tx=0x7fbc48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.621+0000 7fbc55995700 1 --2- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc5015ce10 0x7fbc50140720 secure :-1 s=READY pgs=653 cs=0 l=1 rx=0x7fbc480103b0 tx=0x7fbc48010750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:49.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.621+0000 7fbc55995700 1 --2- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc5015ce10 0x7fbc50140720 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7fbc480103b0 tx=0x7fbc48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.621+0000 7fbc4dffb700 1 -- 172.21.15.80:0/1797437316 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc48000960 con 0x7fbc5015ce10 2019-11-28T11:36:49.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.621+0000 7fbc55995700 1 --2- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc5015ce10 0x7fbc50140720 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7fbc480103b0 tx=0x7fbc48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.621+0000 7fbc4dffb700 1 -- 172.21.15.80:0/1797437316 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc48009990 con 0x7fbc5015ce10 2019-11-28T11:36:49.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.621+0000 7fbc55995700 1 --2- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc5015ce10 0x7fbc50140720 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7fbc480103b0 tx=0x7fbc48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.621+0000 7fbc56bf7700 1 -- 172.21.15.80:0/1797437316 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc501647c0 con 0x7fbc5015ce10 2019-11-28T11:36:49.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.621+0000 7fbc4dffb700 1 -- 172.21.15.80:0/1797437316 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc48009b80 con 0x7fbc5015ce10 2019-11-28T11:36:49.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.621+0000 7fbc56bf7700 1 -- 172.21.15.80:0/1797437316 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5012e2e0 con 0x7fbc5015ce10 2019-11-28T11:36:49.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.621+0000 7fbc55995700 1 --2- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc5015ce10 0x7fbc50140720 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7fbc480103b0 tx=0x7fbc48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.621+0000 7fbc4dffb700 1 -- 172.21.15.80:0/1797437316 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbc48009b80 con 0x7fbc5015ce10 2019-11-28T11:36:49.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.621+0000 7fbc55995700 1 --2- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc5015ce10 0x7fbc50140720 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7fbc480103b0 tx=0x7fbc48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.621+0000 7fbc4dffb700 1 --2- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc34018770 0x7fbc3401ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:49.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.622+0000 7fbc4dffb700 1 -- 172.21.15.80:0/1797437316 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fbc48031a80 con 0x7fbc5015ce10 2019-11-28T11:36:49.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.622+0000 7fbc55194700 1 --2- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc34018770 0x7fbc3401ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:49.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.622+0000 7fbc55194700 1 --2- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc34018770 0x7fbc3401ac00 crc :-1 s=READY pgs=446 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.629+0000 7fbc56bf7700 1 -- 172.21.15.80:0/1797437316 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc50163380 con 0x7fbc5015ce10 2019-11-28T11:36:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.633+0000 7fbc55995700 1 --2- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc5015ce10 0x7fbc50140720 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7fbc480103b0 tx=0x7fbc48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.633+0000 7fbc4dffb700 1 -- 172.21.15.80:0/1797437316 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbc48009590 con 0x7fbc5015ce10 2019-11-28T11:36:49.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.808+0000 7fbc56bf7700 1 -- 172.21.15.80:0/1797437316 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc50164440 con 0x7fbc5015ce10 2019-11-28T11:36:49.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.808+0000 7fbc55995700 1 --2- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc5015ce10 0x7fbc50140720 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7fbc480103b0 tx=0x7fbc48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:49.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.809+0000 7fbc4dffb700 1 -- 172.21.15.80:0/1797437316 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+2447 (secure 0 0 0) 0x7fbc48009b80 con 0x7fbc5015ce10 2019-11-28T11:36:49.870 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 52 2019-11-28T11:36:49.871 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:49.871 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/104419485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":104419485},{"type":"v1","addr":"172.21.15.80:6835","nonce":104419485}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48},{"gid":6870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2848936187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2848936187},{"type":"v1","addr":"172.21.15.80:6834","nonce":2848936187}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:36:47.769088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5474":{"gid":5474,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":17,"addr":"172.21.15.174:6835/3667048559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3667048559},{"type":"v1","addr":"172.21.15.174:6835","nonce":3667048559}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:49.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.811+0000 7fbc56bf7700 1 -- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc34018770 msgr2=0x7fbc3401ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.811+0000 7fbc56bf7700 1 --2- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc34018770 0x7fbc3401ac00 crc :-1 s=READY pgs=446 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:49.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.811+0000 7fbc56bf7700 1 -- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc5015ce10 msgr2=0x7fbc50140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:49.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.811+0000 7fbc56bf7700 1 --2- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc5015ce10 0x7fbc50140720 secure :-1 s=READY pgs=653 cs=0 l=1 rx=0x7fbc480103b0 tx=0x7fbc48010750).stop 2019-11-28T11:36:49.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.811+0000 7fbc56bf7700 1 -- 172.21.15.80:0/1797437316 shutdown_connections 2019-11-28T11:36:49.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.811+0000 7fbc56bf7700 1 --2- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc5015ce10 0x7fbc50140720 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:49.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.811+0000 7fbc56bf7700 1 --2- 172.21.15.80:0/1797437316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc34018770 0x7fbc3401ac00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:49.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.811+0000 7fbc56bf7700 1 -- 172.21.15.80:0/1797437316 shutdown_connections 2019-11-28T11:36:49.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.811+0000 7fbc56bf7700 1 -- 172.21.15.80:0/1797437316 wait complete. 2019-11-28T11:36:49.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:49.811+0000 7fbc56bf7700 1 -- 172.21.15.80:0/1797437316 >> 172.21.15.80:0/1797437316 conn(0x7fbc50159ae0 msgr2=0x7fbc5013d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:50.189 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5474}, u'last_failure_osd_epoch': 80, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 12, u'failed': [], u'epoch': 52, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [13], u'info': {u'gid_5474': {u'export_targets': [], u'name': u'c', u'incarnation': 49, u'state_seq': 17, u'state': u'up:active', u'gid': 5474, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3667048559, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 3667048559, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/3667048559'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:32:59.044350+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:36:47.769088+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:36:50.189 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:36:50.189 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:36:50.320 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:36:50.320 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:36:50.320 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:36:50.321 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 5474, 2019-11-28T11:36:50.321 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:36:50.321 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:36:50.321 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 55.629851395999999, 2019-11-28T11:36:50.321 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 52, 2019-11-28T11:36:50.322 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 82, 2019-11-28T11:36:50.322 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 82, 2019-11-28T11:36:50.322 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 60.046540675999999 2019-11-28T11:36:50.322 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:36:50.326 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 5474, "want_state": "up:active", "state": "up:active", "rank_uptime": 55.629851395999999, "mdsmap_epoch": 52, "osdmap_epoch": 82, "osdmap_epoch_barrier": 82, "uptime": 60.046540675999999 } 2019-11-28T11:36:50.326 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:36:50.326 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:36:50.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:36:50.327 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:36:50.404 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:36:50.404 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:36:50.486 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:36:50.486 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:36:50.520 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:36:50.520 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:36:50.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:36:50.537 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:36:50.615 INFO:teuthology.orchestra.run.smithi016:> cd /home/ubuntu/cephtest/mnt.1 && sudo ls subdir/childfile 2019-11-28T11:36:50.672 INFO:teuthology.orchestra.run.smithi016.stdout:subdir/childfile 2019-11-28T11:36:50.673 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync' 2019-11-28T11:36:50.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.733+0000 7ff42ce51700 1 Processor -- start 2019-11-28T11:36:50.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.733+0000 7ff42ce51700 1 -- start start 2019-11-28T11:36:50.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.734+0000 7ff42ce51700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff42806c490 0x7ff42806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:50.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.734+0000 7ff42ce51700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff42806ce60 0x7ff428164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:50.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.734+0000 7ff42ce51700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42806db00 con 0x7ff42806c0a0 2019-11-28T11:36:50.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.734+0000 7ff42ce51700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42806fd60 con 0x7ff42806ce60 2019-11-28T11:36:50.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.734+0000 7ff42ce51700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff428070030 con 0x7ff42806c490 2019-11-28T11:36:50.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.734+0000 7ff426d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff42806c0a0 0x7ff428072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36008/0 (socket says 172.21.15.80:36008) 2019-11-28T11:36:50.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.734+0000 7ff426d9d700 1 -- 172.21.15.80:0/335763201 learned_addr learned my addr 172.21.15.80:0/335763201 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:50.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff42759e700 1 --2- 172.21.15.80:0/335763201 >> v2:172.21.15.174:3300/0 conn(0x7ff42806ce60 0x7ff428164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:50.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff42659c700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff42806c490 0x7ff42806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:50.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff425d9b700 1 -- 172.21.15.80:0/335763201 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571160316 0 0) 0x7ff410001150 con 0x7ff42806c0a0 2019-11-28T11:36:50.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff425d9b700 1 -- 172.21.15.80:0/335763201 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff408002e80 con 0x7ff42806c0a0 2019-11-28T11:36:50.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff425d9b700 1 -- 172.21.15.80:0/335763201 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2591009829 0 0) 0x7ff410001130 con 0x7ff42806c0a0 2019-11-28T11:36:50.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff425d9b700 1 -- 172.21.15.80:0/335763201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff42806c490 msgr2=0x7ff42806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:50.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff425d9b700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff42806c490 0x7ff42806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:50.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff425d9b700 1 -- 172.21.15.80:0/335763201 >> v2:172.21.15.174:3300/0 conn(0x7ff42806ce60 msgr2=0x7ff428164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:50.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff425d9b700 1 --2- 172.21.15.80:0/335763201 >> v2:172.21.15.174:3300/0 conn(0x7ff42806ce60 0x7ff428164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:50.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff425d9b700 1 -- 172.21.15.80:0/335763201 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4280706c0 con 0x7ff42806c0a0 2019-11-28T11:36:50.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff425d9b700 1 -- 172.21.15.80:0/335763201 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff410001660 con 0x7ff42806c0a0 2019-11-28T11:36:50.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff425d9b700 1 -- 172.21.15.80:0/335763201 >> v1:172.21.15.80:6789/0 conn(0x7ff42806c0a0 legacy=0x7ff428072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:50.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff425d9b700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff408047a80 0x7ff408049ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:50.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff425d9b700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff40804a660 0x7ff40804cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:50.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff425d9b700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff40804d300 0x7ff40804f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:50.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff425d9b700 1 -- 172.21.15.80:0/335763201 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40804ffe0 con 0x7ff408047a80 2019-11-28T11:36:50.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff425d9b700 1 -- 172.21.15.80:0/335763201 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080501d0 con 0x7ff40804d300 2019-11-28T11:36:50.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff425d9b700 1 -- 172.21.15.80:0/335763201 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff408050400 con 0x7ff40804a660 2019-11-28T11:36:50.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff42659c700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff42806c490 0x7ff42806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:50.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff426d9d700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff408047a80 0x7ff408049ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:50.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff42759e700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff40804d300 0x7ff40804f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:50.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff42659c700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff40804a660 0x7ff40804cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:50.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.735+0000 7ff426d9d700 1 -- 172.21.15.80:0/335763201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff40804a660 msgr2=0x7ff40804cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:50.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff426d9d700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff40804a660 0x7ff40804cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:50.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff426d9d700 1 -- 172.21.15.80:0/335763201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff40804d300 msgr2=0x7ff40804f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:50.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff426d9d700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff40804d300 0x7ff40804f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:50.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff426d9d700 1 -- 172.21.15.80:0/335763201 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080506b0 con 0x7ff408047a80 2019-11-28T11:36:50.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff42759e700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff40804d300 0x7ff40804f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:36:50.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff426d9d700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff408047a80 0x7ff408049ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff41000f890 tx=0x7ff41000fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:50.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff426d9d700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff408047a80 0x7ff408049ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff41000f890 tx=0x7ff41000fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:50.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff426d9d700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff408047a80 0x7ff408049ee0 secure :-1 s=READY pgs=1096 cs=0 l=1 rx=0x7ff41000f890 tx=0x7ff41000fc30).ready entity=mon.0 client_cookie=f475b6fd66ae6aab server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:50.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff426d9d700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff408047a80 0x7ff408049ee0 secure :-1 s=THROTTLE_DONE pgs=1096 cs=0 l=1 rx=0x7ff41000f890 tx=0x7ff41000fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:50.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff425d9b700 1 -- 172.21.15.80:0/335763201 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff410001850 con 0x7ff408047a80 2019-11-28T11:36:50.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff426d9d700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff408047a80 0x7ff408049ee0 secure :-1 s=THROTTLE_DONE pgs=1096 cs=0 l=1 rx=0x7ff41000f890 tx=0x7ff41000fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:50.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff426d9d700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff408047a80 0x7ff408049ee0 secure :-1 s=THROTTLE_DONE pgs=1096 cs=0 l=1 rx=0x7ff41000f890 tx=0x7ff41000fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:50.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff425d9b700 1 -- 172.21.15.80:0/335763201 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff410004430 con 0x7ff408047a80 2019-11-28T11:36:50.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff425d9b700 1 -- 172.21.15.80:0/335763201 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff410004b80 con 0x7ff408047a80 2019-11-28T11:36:50.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff42ce51700 1 -- 172.21.15.80:0/335763201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff408047a80 msgr2=0x7ff408049ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:50.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff42ce51700 1 --2- 172.21.15.80:0/335763201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff408047a80 0x7ff408049ee0 secure :-1 s=READY pgs=1096 cs=0 l=1 rx=0x7ff41000f890 tx=0x7ff41000fc30).stop 2019-11-28T11:36:50.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.736+0000 7ff42759e700 1 -- 172.21.15.80:0/335763201 reap_dead start 2019-11-28T11:36:50.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.737+0000 7ff42ce51700 1 -- 172.21.15.80:0/335763201 shutdown_connections 2019-11-28T11:36:50.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.737+0000 7ff42ce51700 1 -- 172.21.15.80:0/335763201 shutdown_connections 2019-11-28T11:36:50.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.737+0000 7ff42ce51700 1 -- 172.21.15.80:0/335763201 wait complete. 2019-11-28T11:36:50.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.737+0000 7ff42ce51700 1 -- 172.21.15.80:0/335763201 >> 172.21.15.80:0/335763201 conn(0x7ff428061cf0 msgr2=0x7ff428064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:50.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.739+0000 7ff42ce51700 1 Processor -- start 2019-11-28T11:36:50.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.739+0000 7ff42ce51700 1 -- start start 2019-11-28T11:36:50.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff42ce51700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff428139620 0x7ff428139ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:50.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff42ce51700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff428166ea0 0x7ff4281692a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:50.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff42ce51700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff428137060 con 0x7ff428106930 2019-11-28T11:36:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff42ce51700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff428114e70 con 0x7ff428166ea0 2019-11-28T11:36:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff42ce51700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff428138890 con 0x7ff428139620 2019-11-28T11:36:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff426d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff428106930 0x7ff42813a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36020/0 (socket says 172.21.15.80:36020) 2019-11-28T11:36:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff426d9d700 1 -- 172.21.15.80:0/298948561 learned_addr learned my addr 172.21.15.80:0/298948561 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff42759e700 1 --2- 172.21.15.80:0/298948561 >> v2:172.21.15.80:3300/0 conn(0x7ff428166ea0 0x7ff4281692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff42659c700 1 --2- 172.21.15.80:0/298948561 >> v2:172.21.15.174:3300/0 conn(0x7ff428139620 0x7ff428139ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:50.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff41f7fe700 1 -- 172.21.15.80:0/298948561 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726217311 0 0) 0x7ff410000d80 con 0x7ff428106930 2019-11-28T11:36:50.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff41f7fe700 1 -- 172.21.15.80:0/298948561 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff400002e80 con 0x7ff428106930 2019-11-28T11:36:50.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff42759e700 1 -- 172.21.15.80:0/298948561 >> v2:172.21.15.174:3300/0 conn(0x7ff428139620 msgr2=0x7ff428139ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:50.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff42759e700 1 --2- 172.21.15.80:0/298948561 >> v2:172.21.15.174:3300/0 conn(0x7ff428139620 0x7ff428139ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:50.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff42759e700 1 -- 172.21.15.80:0/298948561 >> v1:172.21.15.80:6789/0 conn(0x7ff428106930 legacy=0x7ff42813a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:50.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff42759e700 1 -- 172.21.15.80:0/298948561 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff428115500 con 0x7ff428166ea0 2019-11-28T11:36:50.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff42759e700 1 --2- 172.21.15.80:0/298948561 >> v2:172.21.15.80:3300/0 conn(0x7ff428166ea0 0x7ff4281692a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff420010720 tx=0x7ff420010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:50.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff42759e700 1 --2- 172.21.15.80:0/298948561 >> v2:172.21.15.80:3300/0 conn(0x7ff428166ea0 0x7ff4281692a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff420010720 tx=0x7ff420010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:50.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.740+0000 7ff42759e700 1 --2- 172.21.15.80:0/298948561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff428166ea0 0x7ff4281692a0 secure :-1 s=READY pgs=1098 cs=0 l=1 rx=0x7ff420010720 tx=0x7ff420010550).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:50.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.741+0000 7ff42759e700 1 --2- 172.21.15.80:0/298948561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff428166ea0 0x7ff4281692a0 secure :-1 s=THROTTLE_DONE pgs=1098 cs=0 l=1 rx=0x7ff420010720 tx=0x7ff420010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:50.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.741+0000 7ff42759e700 1 --2- 172.21.15.80:0/298948561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff428166ea0 0x7ff4281692a0 secure :-1 s=THROTTLE_DONE pgs=1098 cs=0 l=1 rx=0x7ff420010720 tx=0x7ff420010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:50.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.741+0000 7ff41f7fe700 1 -- 172.21.15.80:0/298948561 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff420009b40 con 0x7ff428166ea0 2019-11-28T11:36:50.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.741+0000 7ff42759e700 1 --2- 172.21.15.80:0/298948561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff428166ea0 0x7ff4281692a0 secure :-1 s=THROTTLE_DONE pgs=1098 cs=0 l=1 rx=0x7ff420010720 tx=0x7ff420010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:50.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.741+0000 7ff41f7fe700 1 -- 172.21.15.80:0/298948561 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42000ac40 con 0x7ff428166ea0 2019-11-28T11:36:50.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.741+0000 7ff41f7fe700 1 -- 172.21.15.80:0/298948561 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff42000a120 con 0x7ff428166ea0 2019-11-28T11:36:50.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.741+0000 7ff42ce51700 1 -- 172.21.15.80:0/298948561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff428115880 con 0x7ff428166ea0 2019-11-28T11:36:50.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.741+0000 7ff42ce51700 1 -- 172.21.15.80:0/298948561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4281147b0 con 0x7ff428166ea0 2019-11-28T11:36:50.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.741+0000 7ff42759e700 1 --2- 172.21.15.80:0/298948561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff428166ea0 0x7ff4281692a0 secure :-1 s=THROTTLE_DONE pgs=1098 cs=0 l=1 rx=0x7ff420010720 tx=0x7ff420010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:50.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.741+0000 7ff41f7fe700 1 -- 172.21.15.80:0/298948561 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff420009930 con 0x7ff428166ea0 2019-11-28T11:36:50.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.741+0000 7ff42759e700 1 --2- 172.21.15.80:0/298948561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff428166ea0 0x7ff4281692a0 secure :-1 s=THROTTLE_DONE pgs=1098 cs=0 l=1 rx=0x7ff420010720 tx=0x7ff420010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:50.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.741+0000 7ff41f7fe700 1 --2- 172.21.15.80:0/298948561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff400018770 0x7ff40001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:50.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.741+0000 7ff41f7fe700 1 -- 172.21.15.80:0/298948561 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6149+0+0 (secure 0 0 0) 0x7ff420031d60 con 0x7ff428166ea0 2019-11-28T11:36:50.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.742+0000 7ff426d9d700 1 --2- 172.21.15.80:0/298948561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff400018770 0x7ff40001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:50.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.742+0000 7ff426d9d700 1 --2- 172.21.15.80:0/298948561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff400018770 0x7ff40001abe0 crc :-1 s=READY pgs=447 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:50.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.749+0000 7ff42ce51700 1 -- 172.21.15.80:0/298948561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff428115500 con 0x7ff428166ea0 2019-11-28T11:36:50.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.752+0000 7ff42759e700 1 --2- 172.21.15.80:0/298948561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff428166ea0 0x7ff4281692a0 secure :-1 s=THROTTLE_DONE pgs=1098 cs=0 l=1 rx=0x7ff420010720 tx=0x7ff420010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:50.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.752+0000 7ff41f7fe700 1 -- 172.21.15.80:0/298948561 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff420000f40 con 0x7ff428166ea0 2019-11-28T11:36:50.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:50.926+0000 7ff42ce51700 1 -- 172.21.15.80:0/298948561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync"]} v 0) v1 -- 0x7ff428115880 con 0x7ff428166ea0 2019-11-28T11:36:51.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:51.783+0000 7ff42759e700 1 --2- 172.21.15.80:0/298948561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff428166ea0 0x7ff4281692a0 secure :-1 s=THROTTLE_DONE pgs=1098 cs=0 l=1 rx=0x7ff420010720 tx=0x7ff420010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:51.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:51.783+0000 7ff41f7fe700 1 -- 172.21.15.80:0/298948561 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync"]}]=0 v294) v1 ==== 149+0+0 (secure 0 0 0) 0x7ff420009cd0 con 0x7ff428166ea0 2019-11-28T11:36:51.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:51.794+0000 7ff42ce51700 1 -- 172.21.15.80:0/298948561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff400018770 msgr2=0x7ff40001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:51.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:51.794+0000 7ff42ce51700 1 --2- 172.21.15.80:0/298948561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff400018770 0x7ff40001abe0 crc :-1 s=READY pgs=447 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:51.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:51.794+0000 7ff42ce51700 1 -- 172.21.15.80:0/298948561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff428166ea0 msgr2=0x7ff4281692a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:51.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:51.794+0000 7ff42ce51700 1 --2- 172.21.15.80:0/298948561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff428166ea0 0x7ff4281692a0 secure :-1 s=READY pgs=1098 cs=0 l=1 rx=0x7ff420010720 tx=0x7ff420010550).stop 2019-11-28T11:36:51.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:51.794+0000 7ff42ce51700 1 -- 172.21.15.80:0/298948561 shutdown_connections 2019-11-28T11:36:51.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:51.794+0000 7ff42ce51700 1 --2- 172.21.15.80:0/298948561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff400018770 0x7ff40001abe0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:51.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:51.794+0000 7ff42ce51700 1 --2- 172.21.15.80:0/298948561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff428166ea0 0x7ff4281692a0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:51.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:51.794+0000 7ff42ce51700 1 --2- 172.21.15.80:0/298948561 >> v2:172.21.15.174:3300/0 conn(0x7ff428139620 0x7ff428139ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:51.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:51.795+0000 7ff42ce51700 1 -- 172.21.15.80:0/298948561 shutdown_connections 2019-11-28T11:36:51.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:51.795+0000 7ff42ce51700 1 -- 172.21.15.80:0/298948561 wait complete. 2019-11-28T11:36:51.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:51.795+0000 7ff42ce51700 1 -- 172.21.15.80:0/298948561 >> 172.21.15.80:0/298948561 conn(0x7ff428141d10 msgr2=0x7ff42813ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:51.869 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:36:51.869 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:36:51.940 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:36:52.001 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:36:52.106 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:36:52.165 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:36:52.226 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:36:52.283 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:36:52.283 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:36:52.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:36:52.284 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:36:52.406 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:36:52.410 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:36:52.452 INFO:tasks.cephfs_test_runner:test_create_fsync (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2019-11-28T11:36:52.452 INFO:tasks.cephfs_test_runner:Starting test: test_dir_fsync (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T11:36:52.453 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync' 2019-11-28T11:36:52.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.513+0000 7fec7562f700 1 Processor -- start 2019-11-28T11:36:52.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.513+0000 7fec7562f700 1 -- start start 2019-11-28T11:36:52.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec7562f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fec7006c0a0 0x7fec70072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec7562f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec700734e0 0x7fec70071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec7562f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fec70072360 0x7fec70072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec7562f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7006fd60 con 0x7fec7006c0a0 2019-11-28T11:36:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec7562f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec70070030 con 0x7fec70072360 2019-11-28T11:36:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec7562f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7006f330 con 0x7fec700734e0 2019-11-28T11:36:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec6f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fec7006c0a0 0x7fec70072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec6f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fec7006c0a0 0x7fec70072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36712/0 (socket says 172.21.15.80:36712) 2019-11-28T11:36:52.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec6f7fe700 1 -- 172.21.15.80:0/913185244 learned_addr learned my addr 172.21.15.80:0/913185244 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:52.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec6ffff700 1 --2- 172.21.15.80:0/913185244 >> v2:172.21.15.174:3300/0 conn(0x7fec70072360 0x7fec70072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:52.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec6effd700 1 --2- 172.21.15.80:0/913185244 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec700734e0 0x7fec70071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:52.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec6f7fe700 1 -- 172.21.15.80:0/913185244 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec700734e0 msgr2=0x7fec70071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:52.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec6f7fe700 1 --2- 172.21.15.80:0/913185244 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec700734e0 0x7fec70071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:52.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec6f7fe700 1 -- 172.21.15.80:0/913185244 >> v2:172.21.15.174:3300/0 conn(0x7fec70072360 msgr2=0x7fec70072800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:52.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec6f7fe700 1 --2- 172.21.15.80:0/913185244 >> v2:172.21.15.174:3300/0 conn(0x7fec70072360 0x7fec70072800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:52.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec6f7fe700 1 -- 172.21.15.80:0/913185244 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec700706c0 con 0x7fec7006c0a0 2019-11-28T11:36:52.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec6ffff700 1 --2- 172.21.15.80:0/913185244 >> v2:172.21.15.174:3300/0 conn(0x7fec70072360 0x7fec70072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:36:52.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec6f7fe700 1 --2- 172.21.15.80:0/913185244 >> v2:172.21.15.80:3300/0 conn(0x7fec7006c0a0 0x7fec70072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fec6000fa40 tx=0x7fec6000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:52.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec6f7fe700 1 --2- 172.21.15.80:0/913185244 >> v2:172.21.15.80:3300/0 conn(0x7fec7006c0a0 0x7fec70072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fec6000fa40 tx=0x7fec6000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:52.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.514+0000 7fec6f7fe700 1 --2- 172.21.15.80:0/913185244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec7006c0a0 0x7fec70072fa0 secure :-1 s=READY pgs=1099 cs=0 l=1 rx=0x7fec6000fa40 tx=0x7fec6000fde0).ready entity=mon.0 client_cookie=2a406500aa4d2248 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:52.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.515+0000 7fec6f7fe700 1 --2- 172.21.15.80:0/913185244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec7006c0a0 0x7fec70072fa0 secure :-1 s=THROTTLE_DONE pgs=1099 cs=0 l=1 rx=0x7fec6000fa40 tx=0x7fec6000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:52.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.515+0000 7fec6f7fe700 1 --2- 172.21.15.80:0/913185244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec7006c0a0 0x7fec70072fa0 secure :-1 s=THROTTLE_DONE pgs=1099 cs=0 l=1 rx=0x7fec6000fa40 tx=0x7fec6000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:52.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.515+0000 7fec6e7fc700 1 -- 172.21.15.80:0/913185244 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec60000ce0 con 0x7fec7006c0a0 2019-11-28T11:36:52.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.515+0000 7fec6f7fe700 1 --2- 172.21.15.80:0/913185244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec7006c0a0 0x7fec70072fa0 secure :-1 s=THROTTLE_DONE pgs=1099 cs=0 l=1 rx=0x7fec6000fa40 tx=0x7fec6000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:52.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.515+0000 7fec6e7fc700 1 -- 172.21.15.80:0/913185244 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec60001010 con 0x7fec7006c0a0 2019-11-28T11:36:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.515+0000 7fec6e7fc700 1 -- 172.21.15.80:0/913185244 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec600017c0 con 0x7fec7006c0a0 2019-11-28T11:36:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.515+0000 7fec7562f700 1 -- 172.21.15.80:0/913185244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec7006c0a0 msgr2=0x7fec70072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.515+0000 7fec7562f700 1 --2- 172.21.15.80:0/913185244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec7006c0a0 0x7fec70072fa0 secure :-1 s=READY pgs=1099 cs=0 l=1 rx=0x7fec6000fa40 tx=0x7fec6000fde0).stop 2019-11-28T11:36:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.515+0000 7fec7562f700 1 -- 172.21.15.80:0/913185244 shutdown_connections 2019-11-28T11:36:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.515+0000 7fec7562f700 1 --2- 172.21.15.80:0/913185244 >> v2:172.21.15.174:3300/0 conn(0x7fec70072360 0x7fec70072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.515+0000 7fec7562f700 1 --2- 172.21.15.80:0/913185244 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec700734e0 0x7fec70071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:52.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.515+0000 7fec7562f700 1 --2- 172.21.15.80:0/913185244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec7006c0a0 0x7fec70072fa0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:52.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.515+0000 7fec7562f700 1 -- 172.21.15.80:0/913185244 shutdown_connections 2019-11-28T11:36:52.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.515+0000 7fec7562f700 1 -- 172.21.15.80:0/913185244 wait complete. 2019-11-28T11:36:52.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.515+0000 7fec7562f700 1 -- 172.21.15.80:0/913185244 >> 172.21.15.80:0/913185244 conn(0x7fec70061cf0 msgr2=0x7fec70064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:52.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.518+0000 7fec7562f700 1 Processor -- start 2019-11-28T11:36:52.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.518+0000 7fec7562f700 1 -- start start 2019-11-28T11:36:52.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec7562f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fec70109e40 0x7fec7010a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:52.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec7562f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec7010a810 0x7fec70105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:52.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec7562f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7013f1e0 con 0x7fec7013eb40 2019-11-28T11:36:52.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec7562f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec701234c0 con 0x7fec70109e40 2019-11-28T11:36:52.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec7562f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7013e0d0 con 0x7fec7010a810 2019-11-28T11:36:52.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec6ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec7010a810 0x7fec70105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:52.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec6effd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fec70109e40 0x7fec7010a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:52.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec6ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec7010a810 0x7fec70105210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:38980/0 (socket says 172.21.15.80:38980) 2019-11-28T11:36:52.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec6effd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fec70109e40 0x7fec7010a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:51604/0 (socket says 172.21.15.80:51604) 2019-11-28T11:36:52.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec6ffff700 1 -- 172.21.15.80:0/1062648471 learned_addr learned my addr 172.21.15.80:0/1062648471 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:52.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec6effd700 1 -- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec7010a810 msgr2=0x7fec70105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:52.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec6effd700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec7010a810 0x7fec70105210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:52.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec6effd700 1 -- 172.21.15.80:0/1062648471 >> v1:172.21.15.174:6789/0 conn(0x7fec7013eb40 legacy=0x7fec7010afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:52.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec6effd700 1 -- 172.21.15.80:0/1062648471 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec70108700 con 0x7fec70109e40 2019-11-28T11:36:52.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec57fff700 1 -- 172.21.15.80:0/1062648471 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113397734 0 0) 0x7fec60008190 con 0x7fec7013eb40 2019-11-28T11:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec6ffff700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec7010a810 0x7fec70105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec6effd700 1 --2- 172.21.15.80:0/1062648471 >> v2:172.21.15.174:3300/0 conn(0x7fec70109e40 0x7fec7010a2d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec640103a0 tx=0x7fec64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec6effd700 1 --2- 172.21.15.80:0/1062648471 >> v2:172.21.15.174:3300/0 conn(0x7fec70109e40 0x7fec7010a2d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec640103a0 tx=0x7fec64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:52.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.519+0000 7fec6effd700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec70109e40 0x7fec7010a2d0 secure :-1 s=READY pgs=655 cs=0 l=1 rx=0x7fec640103a0 tx=0x7fec64010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:52.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.520+0000 7fec6effd700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec70109e40 0x7fec7010a2d0 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7fec640103a0 tx=0x7fec64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:52.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.520+0000 7fec57fff700 1 -- 172.21.15.80:0/1062648471 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec64009620 con 0x7fec70109e40 2019-11-28T11:36:52.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.520+0000 7fec6effd700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec70109e40 0x7fec7010a2d0 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7fec640103a0 tx=0x7fec64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:52.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.520+0000 7fec57fff700 1 -- 172.21.15.80:0/1062648471 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec64000940 con 0x7fec70109e40 2019-11-28T11:36:52.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.520+0000 7fec6effd700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec70109e40 0x7fec7010a2d0 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7fec640103a0 tx=0x7fec64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:52.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.520+0000 7fec57fff700 1 -- 172.21.15.80:0/1062648471 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec64009e30 con 0x7fec70109e40 2019-11-28T11:36:52.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.520+0000 7fec7562f700 1 -- 172.21.15.80:0/1062648471 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec70108a80 con 0x7fec70109e40 2019-11-28T11:36:52.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.520+0000 7fec7562f700 1 -- 172.21.15.80:0/1062648471 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec70108700 con 0x7fec70109e40 2019-11-28T11:36:52.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.520+0000 7fec6effd700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec70109e40 0x7fec7010a2d0 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7fec640103a0 tx=0x7fec64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:52.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.520+0000 7fec57fff700 1 -- 172.21.15.80:0/1062648471 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fec64009a50 con 0x7fec70109e40 2019-11-28T11:36:52.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.520+0000 7fec6effd700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec70109e40 0x7fec7010a2d0 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7fec640103a0 tx=0x7fec64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:52.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.520+0000 7fec57fff700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fec50018730 0x7fec5001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:52.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.520+0000 7fec57fff700 1 -- 172.21.15.80:0/1062648471 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fec640319f0 con 0x7fec70109e40 2019-11-28T11:36:52.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.521+0000 7fec6f7fe700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fec50018730 0x7fec5001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:52.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.521+0000 7fec6f7fe700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fec50018730 0x7fec5001abc0 crc :-1 s=READY pgs=448 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:52.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.528+0000 7fec7562f700 1 -- 172.21.15.80:0/1062648471 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec70108a80 con 0x7fec70109e40 2019-11-28T11:36:52.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.532+0000 7fec6effd700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec70109e40 0x7fec7010a2d0 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7fec640103a0 tx=0x7fec64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:52.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.532+0000 7fec57fff700 1 -- 172.21.15.80:0/1062648471 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fec64009840 con 0x7fec70109e40 2019-11-28T11:36:52.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.704+0000 7fec7562f700 1 -- 172.21.15.80:0/1062648471 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync"]} v 0) v1 -- 0x7fec70108700 con 0x7fec70109e40 2019-11-28T11:36:52.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.789+0000 7fec6effd700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec70109e40 0x7fec7010a2d0 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7fec640103a0 tx=0x7fec64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:52.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.789+0000 7fec57fff700 1 -- 172.21.15.80:0/1062648471 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync"]}]=0 v295) v1 ==== 149+0+0 (secure 0 0 0) 0x7fec64009b60 con 0x7fec70109e40 2019-11-28T11:36:52.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.820+0000 7fec7562f700 1 -- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fec50018730 msgr2=0x7fec5001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.820+0000 7fec7562f700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fec50018730 0x7fec5001abc0 crc :-1 s=READY pgs=448 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.820+0000 7fec7562f700 1 -- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec70109e40 msgr2=0x7fec7010a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.820+0000 7fec7562f700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec70109e40 0x7fec7010a2d0 secure :-1 s=READY pgs=655 cs=0 l=1 rx=0x7fec640103a0 tx=0x7fec64010740).stop 2019-11-28T11:36:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.820+0000 7fec7562f700 1 -- 172.21.15.80:0/1062648471 shutdown_connections 2019-11-28T11:36:52.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.820+0000 7fec7562f700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec7010a810 0x7fec70105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:52.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.820+0000 7fec7562f700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec70109e40 0x7fec7010a2d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:52.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.820+0000 7fec7562f700 1 --2- 172.21.15.80:0/1062648471 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fec50018730 0x7fec5001abc0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:52.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.820+0000 7fec7562f700 1 -- 172.21.15.80:0/1062648471 shutdown_connections 2019-11-28T11:36:52.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.820+0000 7fec7562f700 1 -- 172.21.15.80:0/1062648471 wait complete. 2019-11-28T11:36:52.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:52.820+0000 7fec7562f700 1 -- 172.21.15.80:0/1062648471 >> 172.21.15.80:0/1062648471 conn(0x7fec7011bfc0 msgr2=0x7fec70141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:52.890 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:36:52.890 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:36:52.957 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:36:53.017 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:36:53.078 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:36:53.134 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:36:53.197 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:36:53.255 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:36:53.256 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:36:53.256 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:36:53.256 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:36:53.256 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:36:53.257 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:36:53.257 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:36:53.262 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:36:53.262 DEBUG:teuthology.parallel:result is None 2019-11-28T11:36:53.263 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:36:53.264 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:36:53.264 DEBUG:teuthology.parallel:result is None 2019-11-28T11:36:53.264 DEBUG:teuthology.parallel:result is None 2019-11-28T11:36:53.264 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:36:53.265 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:36:53.265 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:36:53.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.403+0000 7f4547eef700 1 Processor -- start 2019-11-28T11:36:53.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.403+0000 7f4547eef700 1 -- start start 2019-11-28T11:36:53.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.404+0000 7f4547eef700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f454006c490 0x7f454006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:53.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.404+0000 7f4547eef700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454006db00 con 0x7f454006ce60 2019-11-28T11:36:53.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.404+0000 7f4547eef700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454005daa0 con 0x7f454006c0a0 2019-11-28T11:36:53.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.404+0000 7f4547eef700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454006fd60 con 0x7f454006c490 2019-11-28T11:36:53.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.404+0000 7f4546c8d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f454006ce60 0x7f4540164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36044/0 (socket says 172.21.15.80:36044) 2019-11-28T11:36:53.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.404+0000 7f4546c8d700 1 -- 172.21.15.80:0/3586539053 learned_addr learned my addr 172.21.15.80:0/3586539053 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:53.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.404+0000 7f4545c8b700 1 --2- 172.21.15.80:0/3586539053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f454006c490 0x7f454006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:53.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.404+0000 7f454548a700 1 -- 172.21.15.80:0/3586539053 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076036698 0 0) 0x7f4538001150 con 0x7f454006ce60 2019-11-28T11:36:53.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.404+0000 7f454548a700 1 -- 172.21.15.80:0/3586539053 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4528002e80 con 0x7f454006ce60 2019-11-28T11:36:53.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.404+0000 7f454548a700 1 -- 172.21.15.80:0/3586539053 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119411243 0 0) 0x7f4530001370 con 0x7f454006c0a0 2019-11-28T11:36:53.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.404+0000 7f454548a700 1 -- 172.21.15.80:0/3586539053 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4528004170 con 0x7f454006c0a0 2019-11-28T11:36:53.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.405+0000 7f4545c8b700 1 -- 172.21.15.80:0/3586539053 >> v1:172.21.15.174:6789/0 conn(0x7f454006c0a0 legacy=0x7f4540072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.405+0000 7f4545c8b700 1 -- 172.21.15.80:0/3586539053 >> v1:172.21.15.80:6789/0 conn(0x7f454006ce60 legacy=0x7f4540164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.405+0000 7f4545c8b700 1 -- 172.21.15.80:0/3586539053 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45400706c0 con 0x7f454006c490 2019-11-28T11:36:53.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.405+0000 7f4545c8b700 1 --2- 172.21.15.80:0/3586539053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f454006c490 0x7f454006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f453400af50 tx=0x7f453400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.405+0000 7f4545c8b700 1 --2- 172.21.15.80:0/3586539053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f454006c490 0x7f454006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f453400af50 tx=0x7f453400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.405+0000 7f4545c8b700 1 --2- 172.21.15.80:0/3586539053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f454006c490 0x7f454006c920 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f453400af50 tx=0x7f453400b760).ready entity=mon.2 client_cookie=fcd2a8d8e150743 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:53.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.405+0000 7f4545c8b700 1 --2- 172.21.15.80:0/3586539053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f454006c490 0x7f454006c920 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f453400af50 tx=0x7f453400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.405+0000 7f454548a700 1 -- 172.21.15.80:0/3586539053 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4534000960 con 0x7f454006c490 2019-11-28T11:36:53.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.405+0000 7f4545c8b700 1 --2- 172.21.15.80:0/3586539053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f454006c490 0x7f454006c920 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f453400af50 tx=0x7f453400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.405+0000 7f454548a700 1 -- 172.21.15.80:0/3586539053 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4534009860 con 0x7f454006c490 2019-11-28T11:36:53.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.405+0000 7f4545c8b700 1 --2- 172.21.15.80:0/3586539053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f454006c490 0x7f454006c920 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f453400af50 tx=0x7f453400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.405+0000 7f454548a700 1 -- 172.21.15.80:0/3586539053 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4534007210 con 0x7f454006c490 2019-11-28T11:36:53.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.405+0000 7f4547eef700 1 -- 172.21.15.80:0/3586539053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f454006c490 msgr2=0x7f454006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.405+0000 7f4547eef700 1 --2- 172.21.15.80:0/3586539053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f454006c490 0x7f454006c920 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f453400af50 tx=0x7f453400b760).stop 2019-11-28T11:36:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.406+0000 7f4547eef700 1 -- 172.21.15.80:0/3586539053 shutdown_connections 2019-11-28T11:36:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.406+0000 7f4547eef700 1 --2- 172.21.15.80:0/3586539053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f454006c490 0x7f454006c920 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.406+0000 7f4547eef700 1 -- 172.21.15.80:0/3586539053 shutdown_connections 2019-11-28T11:36:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.406+0000 7f4547eef700 1 -- 172.21.15.80:0/3586539053 wait complete. 2019-11-28T11:36:53.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.406+0000 7f4547eef700 1 -- 172.21.15.80:0/3586539053 >> 172.21.15.80:0/3586539053 conn(0x7f4540061cf0 msgr2=0x7f4540064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:53.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.408+0000 7f4547eef700 1 Processor -- start 2019-11-28T11:36:53.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.408+0000 7f4547eef700 1 -- start start 2019-11-28T11:36:53.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.409+0000 7f4547eef700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f454012e800 0x7f45401ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:53.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.409+0000 7f4547eef700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4540106fc0 con 0x7f4540137500 2019-11-28T11:36:53.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.409+0000 7f4547eef700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4540103350 con 0x7f45401065d0 2019-11-28T11:36:53.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.409+0000 7f4547eef700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4540134680 con 0x7f454012e800 2019-11-28T11:36:53.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.409+0000 7f4545c8b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4540137500 0x7f4540137990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36048/0 (socket says 172.21.15.80:36048) 2019-11-28T11:36:53.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.409+0000 7f4545c8b700 1 -- 172.21.15.80:0/945576542 learned_addr learned my addr 172.21.15.80:0/945576542 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:53.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.409+0000 7f4546c8d700 1 --2- 172.21.15.80:0/945576542 >> v2:172.21.15.174:3300/0 conn(0x7f454012e800 0x7f45401ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:53.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.409+0000 7f453effd700 1 -- 172.21.15.80:0/945576542 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365586117 0 0) 0x7f453400b3d0 con 0x7f4540137500 2019-11-28T11:36:53.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.410+0000 7f453effd700 1 -- 172.21.15.80:0/945576542 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4520002e80 con 0x7f4540137500 2019-11-28T11:36:53.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.410+0000 7f4546c8d700 1 -- 172.21.15.80:0/945576542 >> v1:172.21.15.174:6789/0 conn(0x7f45401065d0 legacy=0x7f4540138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.410+0000 7f4546c8d700 1 -- 172.21.15.80:0/945576542 >> v1:172.21.15.80:6789/0 conn(0x7f4540137500 legacy=0x7f4540137990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.410+0000 7f4546c8d700 1 -- 172.21.15.80:0/945576542 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4540134fe0 con 0x7f454012e800 2019-11-28T11:36:53.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.410+0000 7f4546c8d700 1 --2- 172.21.15.80:0/945576542 >> v2:172.21.15.174:3300/0 conn(0x7f454012e800 0x7f45401ae5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4538010370 tx=0x7f4538010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.410+0000 7f4546c8d700 1 --2- 172.21.15.80:0/945576542 >> v2:172.21.15.174:3300/0 conn(0x7f454012e800 0x7f45401ae5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4538010370 tx=0x7f4538010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.410+0000 7f4546c8d700 1 --2- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454012e800 0x7f45401ae5b0 secure :-1 s=READY pgs=658 cs=0 l=1 rx=0x7f4538010370 tx=0x7f4538010710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:53.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.410+0000 7f4546c8d700 1 --2- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454012e800 0x7f45401ae5b0 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7f4538010370 tx=0x7f4538010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.410+0000 7f453effd700 1 -- 172.21.15.80:0/945576542 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4538000ef0 con 0x7f454012e800 2019-11-28T11:36:53.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.410+0000 7f4546c8d700 1 --2- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454012e800 0x7f45401ae5b0 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7f4538010370 tx=0x7f4538010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.410+0000 7f4546c8d700 1 --2- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454012e800 0x7f45401ae5b0 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7f4538010370 tx=0x7f4538010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.410+0000 7f453effd700 1 -- 172.21.15.80:0/945576542 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4538004240 con 0x7f454012e800 2019-11-28T11:36:53.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.410+0000 7f453effd700 1 -- 172.21.15.80:0/945576542 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4538004910 con 0x7f454012e800 2019-11-28T11:36:53.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.410+0000 7f4547eef700 1 -- 172.21.15.80:0/945576542 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4540135360 con 0x7f454012e800 2019-11-28T11:36:53.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.410+0000 7f4547eef700 1 -- 172.21.15.80:0/945576542 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4540136440 con 0x7f454012e800 2019-11-28T11:36:53.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.411+0000 7f4546c8d700 1 --2- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454012e800 0x7f45401ae5b0 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7f4538010370 tx=0x7f4538010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.411+0000 7f453effd700 1 -- 172.21.15.80:0/945576542 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4538000ac0 con 0x7f454012e800 2019-11-28T11:36:53.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.411+0000 7f4546c8d700 1 --2- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454012e800 0x7f45401ae5b0 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7f4538010370 tx=0x7f4538010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.411+0000 7f453effd700 1 --2- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4520018770 0x7f452001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:53.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.411+0000 7f453effd700 1 -- 172.21.15.80:0/945576542 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f4538031a40 con 0x7f454012e800 2019-11-28T11:36:53.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.411+0000 7f454648c700 1 --2- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4520018770 0x7f452001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:53.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.411+0000 7f454648c700 1 --2- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4520018770 0x7f452001abe0 crc :-1 s=READY pgs=449 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:53.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f4547eef700 1 -- 172.21.15.80:0/945576542 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4540134fe0 con 0x7f454012e800 2019-11-28T11:36:53.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.422+0000 7f4546c8d700 1 --2- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454012e800 0x7f45401ae5b0 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7f4538010370 tx=0x7f4538010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.422+0000 7f453effd700 1 -- 172.21.15.80:0/945576542 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4538001200 con 0x7f454012e800 2019-11-28T11:36:53.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.416+0000 7f7b6f003700 1 Processor -- start 2019-11-28T11:36:53.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.416+0000 7f7b6f003700 1 -- start start 2019-11-28T11:36:53.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f7b6f003700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b6806c0a0 0x7f7b68072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:53.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f7b6f003700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7b68072620 0x7f7b68164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:53.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f7b6f003700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6806db00 con 0x7f7b680734e0 2019-11-28T11:36:53.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f7b6f003700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b6806f330 con 0x7f7b68072620 2019-11-28T11:36:53.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f7b6f003700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b680706c0 con 0x7f7b6806c0a0 2019-11-28T11:36:53.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f7b6cd9f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7b680734e0 0x7f7b68071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36058/0 (socket says 172.21.15.80:36058) 2019-11-28T11:36:53.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f7b6cd9f700 1 -- 172.21.15.80:0/388115446 learned_addr learned my addr 172.21.15.80:0/388115446 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:53.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f7b6d5a0700 1 --2- 172.21.15.80:0/388115446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b6806c0a0 0x7f7b68072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:53.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f7b6dda1700 1 --2- 172.21.15.80:0/388115446 >> v2:172.21.15.174:3300/0 conn(0x7f7b68072620 0x7f7b68164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:53.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f7b6d5a0700 1 -- 172.21.15.80:0/388115446 >> v2:172.21.15.174:3300/0 conn(0x7f7b68072620 msgr2=0x7f7b68164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:53.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f7b6d5a0700 1 --2- 172.21.15.80:0/388115446 >> v2:172.21.15.174:3300/0 conn(0x7f7b68072620 0x7f7b68164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:53.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f7b6d5a0700 1 -- 172.21.15.80:0/388115446 >> v1:172.21.15.80:6789/0 conn(0x7f7b680734e0 legacy=0x7f7b68071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f7b6d5a0700 1 -- 172.21.15.80:0/388115446 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b68070a40 con 0x7f7b6806c0a0 2019-11-28T11:36:53.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f7b67fff700 1 -- 172.21.15.80:0/388115446 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388536047 0 0) 0x7f7b580014d0 con 0x7f7b680734e0 2019-11-28T11:36:53.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f7b6d5a0700 1 --2- 172.21.15.80:0/388115446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b6806c0a0 0x7f7b68072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7b6000af50 tx=0x7f7b6000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f7b6d5a0700 1 --2- 172.21.15.80:0/388115446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b6806c0a0 0x7f7b68072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7b6000af50 tx=0x7f7b6000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f7b6d5a0700 1 --2- 172.21.15.80:0/388115446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b6806c0a0 0x7f7b68072fa0 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f7b6000af50 tx=0x7f7b6000b6e0).ready entity=mon.2 client_cookie=34929076324b1efb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:53.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f7b6d5a0700 1 --2- 172.21.15.80:0/388115446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b6806c0a0 0x7f7b68072fa0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f7b6000af50 tx=0x7f7b6000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f7b67fff700 1 -- 172.21.15.80:0/388115446 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b60007210 con 0x7f7b6806c0a0 2019-11-28T11:36:53.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f7b6d5a0700 1 --2- 172.21.15.80:0/388115446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b6806c0a0 0x7f7b68072fa0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f7b6000af50 tx=0x7f7b6000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f7b67fff700 1 -- 172.21.15.80:0/388115446 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b600099b0 con 0x7f7b6806c0a0 2019-11-28T11:36:53.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f7b6d5a0700 1 --2- 172.21.15.80:0/388115446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b6806c0a0 0x7f7b68072fa0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f7b6000af50 tx=0x7f7b6000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f7b67fff700 1 -- 172.21.15.80:0/388115446 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b60007210 con 0x7f7b6806c0a0 2019-11-28T11:36:53.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f7b6f003700 1 -- 172.21.15.80:0/388115446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b6806c0a0 msgr2=0x7f7b68072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f7b6f003700 1 --2- 172.21.15.80:0/388115446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b6806c0a0 0x7f7b68072fa0 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f7b6000af50 tx=0x7f7b6000b6e0).stop 2019-11-28T11:36:53.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.420+0000 7f7b6f003700 1 -- 172.21.15.80:0/388115446 shutdown_connections 2019-11-28T11:36:53.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.420+0000 7f7b6f003700 1 --2- 172.21.15.80:0/388115446 >> v2:172.21.15.174:3300/0 conn(0x7f7b68072620 0x7f7b68164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:53.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.420+0000 7f7b6f003700 1 --2- 172.21.15.80:0/388115446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b6806c0a0 0x7f7b68072fa0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:53.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.420+0000 7f7b6f003700 1 -- 172.21.15.80:0/388115446 shutdown_connections 2019-11-28T11:36:53.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.420+0000 7f7b6f003700 1 -- 172.21.15.80:0/388115446 wait complete. 2019-11-28T11:36:53.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.420+0000 7f7b6f003700 1 -- 172.21.15.80:0/388115446 >> 172.21.15.80:0/388115446 conn(0x7f7b68061cf0 msgr2=0x7f7b68064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:53.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.423+0000 7f7b6f003700 1 Processor -- start 2019-11-28T11:36:53.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.423+0000 7f7b6f003700 1 -- start start 2019-11-28T11:36:53.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.424+0000 7f7b6f003700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7b68104c10 0x7f7b681050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:53.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.424+0000 7f7b6f003700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6813bcd0 con 0x7f7b681055e0 2019-11-28T11:36:53.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.424+0000 7f7b6f003700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b68105ea0 con 0x7f7b68104820 2019-11-28T11:36:53.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.424+0000 7f7b6f003700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b68109130 con 0x7f7b68104c10 2019-11-28T11:36:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.424+0000 7f7b6cd9f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7b68104c10 0x7f7b681050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.424+0000 7f7b6cd9f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7b68104c10 0x7f7b681050a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36752/0 (socket says 172.21.15.80:36752) 2019-11-28T11:36:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.424+0000 7f7b6d5a0700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f7b68104820 0x7f7b6810c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:51610/0 (socket says 172.21.15.80:51610) 2019-11-28T11:36:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.424+0000 7f7b6dda1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7b681055e0 0x7f7b68167a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36070/0 (socket says 172.21.15.80:36070) 2019-11-28T11:36:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.424+0000 7f7b6cd9f700 1 -- 172.21.15.80:0/1081624424 learned_addr learned my addr 172.21.15.80:0/1081624424 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.425+0000 7f7b65ffb700 1 -- 172.21.15.80:0/1081624424 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814916616 0 0) 0x7f7b60000940 con 0x7f7b68104820 2019-11-28T11:36:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.425+0000 7f7b6cd9f700 1 -- 172.21.15.80:0/1081624424 >> v1:172.21.15.174:6789/0 conn(0x7f7b68104820 legacy=0x7f7b6810c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.425+0000 7f7b6cd9f700 1 -- 172.21.15.80:0/1081624424 >> v1:172.21.15.80:6789/0 conn(0x7f7b681055e0 legacy=0x7f7b68167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.425+0000 7f7b6cd9f700 1 -- 172.21.15.80:0/1081624424 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b68109a90 con 0x7f7b68104c10 2019-11-28T11:36:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.425+0000 7f7b6cd9f700 1 --2- 172.21.15.80:0/1081624424 >> v2:172.21.15.80:3300/0 conn(0x7f7b68104c10 0x7f7b681050a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b580107b0 tx=0x7f7b58010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.425+0000 7f7b6cd9f700 1 --2- 172.21.15.80:0/1081624424 >> v2:172.21.15.80:3300/0 conn(0x7f7b68104c10 0x7f7b681050a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b580107b0 tx=0x7f7b58010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.425+0000 7f7b6cd9f700 1 --2- 172.21.15.80:0/1081624424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b68104c10 0x7f7b681050a0 secure :-1 s=READY pgs=1104 cs=0 l=1 rx=0x7f7b580107b0 tx=0x7f7b58010b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.425+0000 7f7b6cd9f700 1 --2- 172.21.15.80:0/1081624424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b68104c10 0x7f7b681050a0 secure :-1 s=THROTTLE_DONE pgs=1104 cs=0 l=1 rx=0x7f7b580107b0 tx=0x7f7b58010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.425+0000 7f7b65ffb700 1 -- 172.21.15.80:0/1081624424 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b58001250 con 0x7f7b68104c10 2019-11-28T11:36:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.425+0000 7f7b6cd9f700 1 --2- 172.21.15.80:0/1081624424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b68104c10 0x7f7b681050a0 secure :-1 s=THROTTLE_DONE pgs=1104 cs=0 l=1 rx=0x7f7b580107b0 tx=0x7f7b58010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.425+0000 7f7b65ffb700 1 -- 172.21.15.80:0/1081624424 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b58001250 con 0x7f7b68104c10 2019-11-28T11:36:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.425+0000 7f7b6cd9f700 1 --2- 172.21.15.80:0/1081624424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b68104c10 0x7f7b681050a0 secure :-1 s=THROTTLE_DONE pgs=1104 cs=0 l=1 rx=0x7f7b580107b0 tx=0x7f7b58010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.425+0000 7f7b6f003700 1 -- 172.21.15.80:0/1081624424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b68109e10 con 0x7f7b68104c10 2019-11-28T11:36:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.425+0000 7f7b65ffb700 1 -- 172.21.15.80:0/1081624424 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b580049a0 con 0x7f7b68104c10 2019-11-28T11:36:53.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.425+0000 7f7b6f003700 1 -- 172.21.15.80:0/1081624424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b68109a90 con 0x7f7b68104c10 2019-11-28T11:36:53.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.426+0000 7f7b6cd9f700 1 --2- 172.21.15.80:0/1081624424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b68104c10 0x7f7b681050a0 secure :-1 s=THROTTLE_DONE pgs=1104 cs=0 l=1 rx=0x7f7b580107b0 tx=0x7f7b58010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.426+0000 7f7b65ffb700 1 -- 172.21.15.80:0/1081624424 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7b580045c0 con 0x7f7b68104c10 2019-11-28T11:36:53.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.426+0000 7f7b6cd9f700 1 --2- 172.21.15.80:0/1081624424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b68104c10 0x7f7b681050a0 secure :-1 s=THROTTLE_DONE pgs=1104 cs=0 l=1 rx=0x7f7b580107b0 tx=0x7f7b58010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.426+0000 7f7b65ffb700 1 --2- 172.21.15.80:0/1081624424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b48018730 0x7f7b4801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:53.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.426+0000 7f7b65ffb700 1 -- 172.21.15.80:0/1081624424 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f7b58031ed0 con 0x7f7b68104c10 2019-11-28T11:36:53.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.426+0000 7f7b6d5a0700 1 --2- 172.21.15.80:0/1081624424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b48018730 0x7f7b4801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:53.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f7b6d5a0700 1 --2- 172.21.15.80:0/1081624424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b48018730 0x7f7b4801abc0 crc :-1 s=READY pgs=450 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:53.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.431+0000 7f7b6f003700 1 -- 172.21.15.80:0/1081624424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b68109e10 con 0x7f7b68104c10 2019-11-28T11:36:53.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.443+0000 7f7b6cd9f700 1 --2- 172.21.15.80:0/1081624424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b68104c10 0x7f7b681050a0 secure :-1 s=THROTTLE_DONE pgs=1104 cs=0 l=1 rx=0x7f7b580107b0 tx=0x7f7b58010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.443+0000 7f7b65ffb700 1 -- 172.21.15.80:0/1081624424 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7b58001660 con 0x7f7b68104c10 2019-11-28T11:36:53.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.416+0000 7f8aa2e87700 1 Processor -- start 2019-11-28T11:36:53.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.416+0000 7f8aa2e87700 1 -- start start 2019-11-28T11:36:53.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f8aa2e87700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8a9c06c490 0x7f8a9c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:53.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f8aa2e87700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a9c06ce60 0x7f8a9c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:53.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f8aa2e87700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9c06db00 con 0x7f8a9c06c0a0 2019-11-28T11:36:53.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f8aa2e87700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a9c06fd60 con 0x7f8a9c06ce60 2019-11-28T11:36:53.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f8aa2e87700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a9c070030 con 0x7f8a9c06c490 2019-11-28T11:36:53.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f8aa0c23700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8a9c06c490 0x7f8a9c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:53.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f8aa0c23700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8a9c06c490 0x7f8a9c06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:51630/0 (socket says 172.21.15.80:51630) 2019-11-28T11:36:53.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f8aa0c23700 1 -- 172.21.15.80:0/1362292991 learned_addr learned my addr 172.21.15.80:0/1362292991 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:53.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f8aa1c25700 1 --2- 172.21.15.80:0/1362292991 >> v2:172.21.15.80:3300/0 conn(0x7f8a9c06ce60 0x7f8a9c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:53.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.418+0000 7f8aa1424700 1 --1- 172.21.15.80:0/1362292991 >> v1:172.21.15.174:6789/0 conn(0x7f8a9c06c0a0 0x7f8a9c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:51598/0 (socket says 172.21.15.80:51598) 2019-11-28T11:36:53.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f8aa0c23700 1 -- 172.21.15.80:0/1362292991 >> v2:172.21.15.80:3300/0 conn(0x7f8a9c06ce60 msgr2=0x7f8a9c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:53.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1362292991 >> v2:172.21.15.80:3300/0 conn(0x7f8a9c06ce60 0x7f8a9c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:53.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f8aa0c23700 1 -- 172.21.15.80:0/1362292991 >> v1:172.21.15.174:6789/0 conn(0x7f8a9c06c0a0 legacy=0x7f8a9c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f8aa0c23700 1 -- 172.21.15.80:0/1362292991 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c0706c0 con 0x7f8a9c06c490 2019-11-28T11:36:53.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f8aa1c25700 1 --2- 172.21.15.80:0/1362292991 >> v2:172.21.15.80:3300/0 conn(0x7f8a9c06ce60 0x7f8a9c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:53.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1362292991 >> v2:172.21.15.174:3300/0 conn(0x7f8a9c06c490 0x7f8a9c06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8a8c00fac0 tx=0x7f8a8c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1362292991 >> v2:172.21.15.174:3300/0 conn(0x7f8a9c06c490 0x7f8a9c06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8a8c00fac0 tx=0x7f8a8c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.419+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1362292991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a9c06c490 0x7f8a9c06c920 secure :-1 s=READY pgs=660 cs=0 l=1 rx=0x7f8a8c00fac0 tx=0x7f8a8c00fe60).ready entity=mon.1 client_cookie=e8c17271457ea88c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:53.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.422+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1362292991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a9c06c490 0x7f8a9c06c920 secure :-1 s=THROTTLE_DONE pgs=660 cs=0 l=1 rx=0x7f8a8c00fac0 tx=0x7f8a8c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.422+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1362292991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a9c06c490 0x7f8a9c06c920 secure :-1 s=THROTTLE_DONE pgs=660 cs=0 l=1 rx=0x7f8a8c00fac0 tx=0x7f8a8c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.422+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1362292991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a9c06c490 0x7f8a9c06c920 secure :-1 s=THROTTLE_DONE pgs=660 cs=0 l=1 rx=0x7f8a8c00fac0 tx=0x7f8a8c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.422+0000 7f8a9bfff700 1 -- 172.21.15.80:0/1362292991 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a8c000ce0 con 0x7f8a9c06c490 2019-11-28T11:36:53.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.422+0000 7f8a9bfff700 1 -- 172.21.15.80:0/1362292991 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c001010 con 0x7f8a9c06c490 2019-11-28T11:36:53.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.422+0000 7f8a9bfff700 1 -- 172.21.15.80:0/1362292991 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a8c001720 con 0x7f8a9c06c490 2019-11-28T11:36:53.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.422+0000 7f8aa2e87700 1 -- 172.21.15.80:0/1362292991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a9c06c490 msgr2=0x7f8a9c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.422+0000 7f8aa2e87700 1 --2- 172.21.15.80:0/1362292991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a9c06c490 0x7f8a9c06c920 secure :-1 s=READY pgs=660 cs=0 l=1 rx=0x7f8a8c00fac0 tx=0x7f8a8c00fe60).stop 2019-11-28T11:36:53.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.423+0000 7f8aa2e87700 1 -- 172.21.15.80:0/1362292991 shutdown_connections 2019-11-28T11:36:53.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.423+0000 7f8aa2e87700 1 --2- 172.21.15.80:0/1362292991 >> v2:172.21.15.80:3300/0 conn(0x7f8a9c06ce60 0x7f8a9c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:53.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.423+0000 7f8aa2e87700 1 --2- 172.21.15.80:0/1362292991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a9c06c490 0x7f8a9c06c920 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:53.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.423+0000 7f8aa2e87700 1 -- 172.21.15.80:0/1362292991 shutdown_connections 2019-11-28T11:36:53.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.423+0000 7f8aa2e87700 1 -- 172.21.15.80:0/1362292991 wait complete. 2019-11-28T11:36:53.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.423+0000 7f8aa2e87700 1 -- 172.21.15.80:0/1362292991 >> 172.21.15.80:0/1362292991 conn(0x7f8a9c061cf0 msgr2=0x7f8a9c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:53.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.426+0000 7f8aa2e87700 1 Processor -- start 2019-11-28T11:36:53.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.426+0000 7f8aa2e87700 1 -- start start 2019-11-28T11:36:53.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa2e87700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a9c15ded0 0x7f8a9c15e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:53.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa2e87700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9c13fa40 con 0x7f8a9c102070 2019-11-28T11:36:53.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa2e87700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9c110d80 con 0x7f8a9c13ab40 2019-11-28T11:36:53.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa2e87700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a9c108190 con 0x7f8a9c15ded0 2019-11-28T11:36:53.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa0c23700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a9c15ded0 0x7f8a9c15e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:53.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa0c23700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a9c15ded0 0x7f8a9c15e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36760/0 (socket says 172.21.15.80:36760) 2019-11-28T11:36:53.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa0c23700 1 -- 172.21.15.80:0/1884158906 learned_addr learned my addr 172.21.15.80:0/1884158906 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:53.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa0c23700 1 -- 172.21.15.80:0/1884158906 >> v1:172.21.15.174:6789/0 conn(0x7f8a9c13ab40 legacy=0x7f8a9c1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa0c23700 1 -- 172.21.15.80:0/1884158906 >> v1:172.21.15.80:6789/0 conn(0x7f8a9c102070 legacy=0x7f8a9c102500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8a99ffb700 1 -- 172.21.15.80:0/1884158906 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149936041 0 0) 0x7f8a94001100 con 0x7f8a9c102070 2019-11-28T11:36:53.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa0c23700 1 -- 172.21.15.80:0/1884158906 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c108af0 con 0x7f8a9c15ded0 2019-11-28T11:36:53.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1884158906 >> v2:172.21.15.80:3300/0 conn(0x7f8a9c15ded0 0x7f8a9c15e360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a8c0107c0 tx=0x7f8a8c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1884158906 >> v2:172.21.15.80:3300/0 conn(0x7f8a9c15ded0 0x7f8a9c15e360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a8c0107c0 tx=0x7f8a8c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1884158906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a9c15ded0 0x7f8a9c15e360 secure :-1 s=READY pgs=1106 cs=0 l=1 rx=0x7f8a8c0107c0 tx=0x7f8a8c010b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:53.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1884158906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a9c15ded0 0x7f8a9c15e360 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7f8a8c0107c0 tx=0x7f8a8c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8a99ffb700 1 -- 172.21.15.80:0/1884158906 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a8c000cc0 con 0x7f8a9c15ded0 2019-11-28T11:36:53.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa2e87700 1 -- 172.21.15.80:0/1884158906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c108e70 con 0x7f8a9c15ded0 2019-11-28T11:36:53.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1884158906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a9c15ded0 0x7f8a9c15e360 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7f8a8c0107c0 tx=0x7f8a8c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1884158906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a9c15ded0 0x7f8a9c15e360 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7f8a8c0107c0 tx=0x7f8a8c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8a99ffb700 1 -- 172.21.15.80:0/1884158906 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c000cc0 con 0x7f8a9c15ded0 2019-11-28T11:36:53.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8a99ffb700 1 -- 172.21.15.80:0/1884158906 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a8c0014c0 con 0x7f8a9c15ded0 2019-11-28T11:36:53.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.427+0000 7f8aa2e87700 1 -- 172.21.15.80:0/1884158906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9c108af0 con 0x7f8a9c15ded0 2019-11-28T11:36:53.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.428+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1884158906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a9c15ded0 0x7f8a9c15e360 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7f8a8c0107c0 tx=0x7f8a8c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.428+0000 7f8a99ffb700 1 -- 172.21.15.80:0/1884158906 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8a8c0010e0 con 0x7f8a9c15ded0 2019-11-28T11:36:53.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.428+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1884158906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a9c15ded0 0x7f8a9c15e360 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7f8a8c0107c0 tx=0x7f8a8c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.428+0000 7f8a99ffb700 1 --2- 172.21.15.80:0/1884158906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a80018730 0x7f8a8001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:53.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.428+0000 7f8a99ffb700 1 -- 172.21.15.80:0/1884158906 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f8a8c032130 con 0x7f8a9c15ded0 2019-11-28T11:36:53.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.428+0000 7f8aa1424700 1 --2- 172.21.15.80:0/1884158906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a80018730 0x7f8a8001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:53.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.429+0000 7f8aa1424700 1 --2- 172.21.15.80:0/1884158906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a80018730 0x7f8a8001abe0 crc :-1 s=READY pgs=451 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:53.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.431+0000 7f8aa2e87700 1 -- 172.21.15.80:0/1884158906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9c108e70 con 0x7f8a9c15ded0 2019-11-28T11:36:53.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.437+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1884158906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a9c15ded0 0x7f8a9c15e360 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7f8a8c0107c0 tx=0x7f8a8c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.437+0000 7f8a99ffb700 1 -- 172.21.15.80:0/1884158906 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8a8c000ed0 con 0x7f8a9c15ded0 2019-11-28T11:36:53.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.615+0000 7f4547eef700 1 -- 172.21.15.80:0/945576542 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f4540135360 con 0x7f454012e800 2019-11-28T11:36:53.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.620+0000 7f8aa2e87700 1 -- 172.21.15.80:0/1884158906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f8a9c108af0 con 0x7f8a9c15ded0 2019-11-28T11:36:53.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.630+0000 7f7b6f003700 1 -- 172.21.15.80:0/1081624424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f7b68109a90 con 0x7f7b68104c10 2019-11-28T11:36:53.848 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:36:53.788+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:36:53.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.792+0000 7f8aa0c23700 1 --2- 172.21.15.80:0/1884158906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a9c15ded0 0x7f8a9c15e360 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7f8a8c0107c0 tx=0x7f8a8c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.792+0000 7f8a99ffb700 1 -- 172.21.15.80:0/1884158906 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6562 v53) v1 ==== 95+0+0 (secure 0 0 0) 0x7f8a8c000ed0 con 0x7f8a9c15ded0 2019-11-28T11:36:53.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.792+0000 7f7b6cd9f700 1 --2- 172.21.15.80:0/1081624424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b68104c10 0x7f7b681050a0 secure :-1 s=THROTTLE_DONE pgs=1104 cs=0 l=1 rx=0x7f7b580107b0 tx=0x7f7b58010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.792+0000 7f7b65ffb700 1 -- 172.21.15.80:0/1081624424 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6870 v53) v1 ==== 95+0+0 (secure 0 0 0) 0x7f7b580045c0 con 0x7f7b68104c10 2019-11-28T11:36:53.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.793+0000 7f4546c8d700 1 --2- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454012e800 0x7f45401ae5b0 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7f4538010370 tx=0x7f4538010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:53.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.793+0000 7f453effd700 1 -- 172.21.15.80:0/945576542 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 5474 v53) v1 ==== 95+0+0 (secure 0 0 0) 0x7f4538000ac0 con 0x7f454012e800 2019-11-28T11:36:53.854 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 6870 2019-11-28T11:36:53.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.796+0000 7f7b6f003700 1 -- 172.21.15.80:0/1081624424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b48018730 msgr2=0x7f7b4801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.796+0000 7f7b6f003700 1 --2- 172.21.15.80:0/1081624424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b48018730 0x7f7b4801abc0 crc :-1 s=READY pgs=450 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:53.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.796+0000 7f7b6f003700 1 -- 172.21.15.80:0/1081624424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b68104c10 msgr2=0x7f7b681050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.796+0000 7f7b6f003700 1 --2- 172.21.15.80:0/1081624424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b68104c10 0x7f7b681050a0 secure :-1 s=READY pgs=1104 cs=0 l=1 rx=0x7f7b580107b0 tx=0x7f7b58010b50).stop 2019-11-28T11:36:53.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.796+0000 7f7b6f003700 1 -- 172.21.15.80:0/1081624424 shutdown_connections 2019-11-28T11:36:53.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.796+0000 7f7b6f003700 1 --2- 172.21.15.80:0/1081624424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b68104c10 0x7f7b681050a0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:53.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.796+0000 7f7b6f003700 1 --2- 172.21.15.80:0/1081624424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b48018730 0x7f7b4801abc0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:53.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.796+0000 7f7b6f003700 1 -- 172.21.15.80:0/1081624424 shutdown_connections 2019-11-28T11:36:53.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.796+0000 7f7b6f003700 1 -- 172.21.15.80:0/1081624424 wait complete. 2019-11-28T11:36:53.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.796+0000 7f7b6f003700 1 -- 172.21.15.80:0/1081624424 >> 172.21.15.80:0/1081624424 conn(0x7f7b6813d620 msgr2=0x7f7b6813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:53.870 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:36:53.889 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 5474 2019-11-28T11:36:53.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.832+0000 7f4547eef700 1 -- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4520018770 msgr2=0x7f452001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.832+0000 7f4547eef700 1 --2- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4520018770 0x7f452001abe0 crc :-1 s=READY pgs=449 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:53.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.832+0000 7f4547eef700 1 -- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454012e800 msgr2=0x7f45401ae5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.832+0000 7f4547eef700 1 --2- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454012e800 0x7f45401ae5b0 secure :-1 s=READY pgs=658 cs=0 l=1 rx=0x7f4538010370 tx=0x7f4538010710).stop 2019-11-28T11:36:53.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.832+0000 7f4547eef700 1 -- 172.21.15.80:0/945576542 shutdown_connections 2019-11-28T11:36:53.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.832+0000 7f4547eef700 1 --2- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454012e800 0x7f45401ae5b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:53.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.832+0000 7f4547eef700 1 --2- 172.21.15.80:0/945576542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4520018770 0x7f452001abe0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:53.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.832+0000 7f4547eef700 1 -- 172.21.15.80:0/945576542 shutdown_connections 2019-11-28T11:36:53.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.832+0000 7f4547eef700 1 -- 172.21.15.80:0/945576542 wait complete. 2019-11-28T11:36:53.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.832+0000 7f4547eef700 1 -- 172.21.15.80:0/945576542 >> 172.21.15.80:0/945576542 conn(0x7f454013d930 msgr2=0x7f4540102360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:53.900 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 6562 2019-11-28T11:36:53.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.836+0000 7f8aa2e87700 1 -- 172.21.15.80:0/1884158906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a80018730 msgr2=0x7f8a8001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.836+0000 7f8aa2e87700 1 --2- 172.21.15.80:0/1884158906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a80018730 0x7f8a8001abe0 crc :-1 s=READY pgs=451 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:53.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.836+0000 7f8aa2e87700 1 -- 172.21.15.80:0/1884158906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a9c15ded0 msgr2=0x7f8a9c15e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:53.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.836+0000 7f8aa2e87700 1 --2- 172.21.15.80:0/1884158906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a9c15ded0 0x7f8a9c15e360 secure :-1 s=READY pgs=1106 cs=0 l=1 rx=0x7f8a8c0107c0 tx=0x7f8a8c010b60).stop 2019-11-28T11:36:53.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.837+0000 7f8aa2e87700 1 -- 172.21.15.80:0/1884158906 shutdown_connections 2019-11-28T11:36:53.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.837+0000 7f8aa2e87700 1 --2- 172.21.15.80:0/1884158906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a9c15ded0 0x7f8a9c15e360 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:53.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.837+0000 7f8aa2e87700 1 --2- 172.21.15.80:0/1884158906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a80018730 0x7f8a8001abe0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:53.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.837+0000 7f8aa2e87700 1 -- 172.21.15.80:0/1884158906 shutdown_connections 2019-11-28T11:36:53.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.837+0000 7f8aa2e87700 1 -- 172.21.15.80:0/1884158906 wait complete. 2019-11-28T11:36:53.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:53.837+0000 7f8aa2e87700 1 -- 172.21.15.80:0/1884158906 >> 172.21.15.80:0/1884158906 conn(0x7f8a9c11a910 msgr2=0x7f8a9c1413c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:53.906 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:36:53.909 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:36:53.910 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:36:54.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.021+0000 7f8d8d84f700 1 Processor -- start 2019-11-28T11:36:54.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.021+0000 7f8d8d84f700 1 -- start start 2019-11-28T11:36:54.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.022+0000 7f8d8d84f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d8806c0a0 0x7f8d88072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:54.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.022+0000 7f8d8d84f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8d88072620 0x7f8d88164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:54.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.022+0000 7f8d8d84f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8806db00 con 0x7f8d880734e0 2019-11-28T11:36:54.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.022+0000 7f8d8d84f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8806f330 con 0x7f8d88072620 2019-11-28T11:36:54.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.022+0000 7f8d8d84f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d880706c0 con 0x7f8d8806c0a0 2019-11-28T11:36:54.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.022+0000 7f8d86ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8d880734e0 0x7f8d88071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36086/0 (socket says 172.21.15.80:36086) 2019-11-28T11:36:54.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.022+0000 7f8d86ffd700 1 -- 172.21.15.80:0/298897449 learned_addr learned my addr 172.21.15.80:0/298897449 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:54.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d877fe700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d8806c0a0 0x7f8d88072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:54.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d87fff700 1 --2- 172.21.15.80:0/298897449 >> v2:172.21.15.174:3300/0 conn(0x7f8d88072620 0x7f8d88164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:54.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d867fc700 1 -- 172.21.15.80:0/298897449 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22200950 0 0) 0x7f8d700013f0 con 0x7f8d880734e0 2019-11-28T11:36:54.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d867fc700 1 -- 172.21.15.80:0/298897449 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d68002e80 con 0x7f8d880734e0 2019-11-28T11:36:54.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d867fc700 1 -- 172.21.15.80:0/298897449 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 747404203 0 0) 0x7f8d700013d0 con 0x7f8d880734e0 2019-11-28T11:36:54.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d867fc700 1 -- 172.21.15.80:0/298897449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d8806c0a0 msgr2=0x7f8d88072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:54.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d867fc700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d8806c0a0 0x7f8d88072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:54.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d867fc700 1 -- 172.21.15.80:0/298897449 >> v2:172.21.15.174:3300/0 conn(0x7f8d88072620 msgr2=0x7f8d88164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:54.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d867fc700 1 --2- 172.21.15.80:0/298897449 >> v2:172.21.15.174:3300/0 conn(0x7f8d88072620 0x7f8d88164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:54.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d867fc700 1 -- 172.21.15.80:0/298897449 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88070a40 con 0x7f8d880734e0 2019-11-28T11:36:54.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d867fc700 1 -- 172.21.15.80:0/298897449 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f8d70001900 con 0x7f8d880734e0 2019-11-28T11:36:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d867fc700 1 -- 172.21.15.80:0/298897449 >> v1:172.21.15.80:6789/0 conn(0x7f8d880734e0 legacy=0x7f8d88071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d867fc700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d680479e0 0x7f8d68049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d867fc700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d6804a5c0 0x7f8d6804ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d867fc700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d6804d2f0 0x7f8d6804f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d867fc700 1 -- 172.21.15.80:0/298897449 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6804ff40 con 0x7f8d6804a5c0 2019-11-28T11:36:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d867fc700 1 -- 172.21.15.80:0/298897449 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68050130 con 0x7f8d680479e0 2019-11-28T11:36:54.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d867fc700 1 -- 172.21.15.80:0/298897449 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68050360 con 0x7f8d6804d2f0 2019-11-28T11:36:54.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d86ffd700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d6804a5c0 0x7f8d6804ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:54.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d877fe700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d680479e0 0x7f8d68049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:54.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d87fff700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d6804d2f0 0x7f8d6804f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:54.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d86ffd700 1 -- 172.21.15.80:0/298897449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d6804d2f0 msgr2=0x7f8d6804f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:54.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d86ffd700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d6804d2f0 0x7f8d6804f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:54.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d86ffd700 1 -- 172.21.15.80:0/298897449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d680479e0 msgr2=0x7f8d68049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:54.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d86ffd700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d680479e0 0x7f8d68049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:54.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d86ffd700 1 -- 172.21.15.80:0/298897449 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d68050610 con 0x7f8d6804a5c0 2019-11-28T11:36:54.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d86ffd700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d6804a5c0 0x7f8d6804ca90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8d7000fc10 tx=0x7f8d7000fa90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.023+0000 7f8d86ffd700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d6804a5c0 0x7f8d6804ca90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8d7000fc10 tx=0x7f8d7000fa90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.024+0000 7f8d86ffd700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d6804a5c0 0x7f8d6804ca90 secure :-1 s=READY pgs=1108 cs=0 l=1 rx=0x7f8d7000fc10 tx=0x7f8d7000fa90).ready entity=mon.0 client_cookie=1d3166c637dfa87a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:54.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.024+0000 7f8d86ffd700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d6804a5c0 0x7f8d6804ca90 secure :-1 s=THROTTLE_DONE pgs=1108 cs=0 l=1 rx=0x7f8d7000fc10 tx=0x7f8d7000fa90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.024+0000 7f8d867fc700 1 -- 172.21.15.80:0/298897449 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d70001b20 con 0x7f8d6804a5c0 2019-11-28T11:36:54.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.024+0000 7f8d86ffd700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d6804a5c0 0x7f8d6804ca90 secure :-1 s=THROTTLE_DONE pgs=1108 cs=0 l=1 rx=0x7f8d7000fc10 tx=0x7f8d7000fa90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.024+0000 7f8d86ffd700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d6804a5c0 0x7f8d6804ca90 secure :-1 s=THROTTLE_DONE pgs=1108 cs=0 l=1 rx=0x7f8d7000fc10 tx=0x7f8d7000fa90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.024+0000 7f8d867fc700 1 -- 172.21.15.80:0/298897449 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d70004610 con 0x7f8d6804a5c0 2019-11-28T11:36:54.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.024+0000 7f8d867fc700 1 -- 172.21.15.80:0/298897449 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d70004d20 con 0x7f8d6804a5c0 2019-11-28T11:36:54.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.024+0000 7f8d8d84f700 1 -- 172.21.15.80:0/298897449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d6804a5c0 msgr2=0x7f8d6804ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.024+0000 7f8d8d84f700 1 --2- 172.21.15.80:0/298897449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d6804a5c0 0x7f8d6804ca90 secure :-1 s=READY pgs=1108 cs=0 l=1 rx=0x7f8d7000fc10 tx=0x7f8d7000fa90).stop 2019-11-28T11:36:54.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.024+0000 7f8d87fff700 1 -- 172.21.15.80:0/298897449 reap_dead start 2019-11-28T11:36:54.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.024+0000 7f8d8d84f700 1 -- 172.21.15.80:0/298897449 shutdown_connections 2019-11-28T11:36:54.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.024+0000 7f8d8d84f700 1 -- 172.21.15.80:0/298897449 shutdown_connections 2019-11-28T11:36:54.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.024+0000 7f8d8d84f700 1 -- 172.21.15.80:0/298897449 wait complete. 2019-11-28T11:36:54.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.024+0000 7f8d8d84f700 1 -- 172.21.15.80:0/298897449 >> 172.21.15.80:0/298897449 conn(0x7f8d88061cf0 msgr2=0x7f8d88064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:54.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.027+0000 7f8d8d84f700 1 Processor -- start 2019-11-28T11:36:54.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.027+0000 7f8d8d84f700 1 -- start start 2019-11-28T11:36:54.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d8d84f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8d88106c20 0x7f8d88138530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:54.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d8d84f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8d88137dd0 0x7f8d881629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:54.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d8d84f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d881165a0 con 0x7f8d88138a70 2019-11-28T11:36:54.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d8d84f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d88114ee0 con 0x7f8d88106c20 2019-11-28T11:36:54.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d8d84f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d881267c0 con 0x7f8d88137dd0 2019-11-28T11:36:54.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d877fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8d88106c20 0x7f8d88138530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:54.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d877fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8d88106c20 0x7f8d88138530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36780/0 (socket says 172.21.15.80:36780) 2019-11-28T11:36:54.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d877fe700 1 -- 172.21.15.80:0/4244869344 learned_addr learned my addr 172.21.15.80:0/4244869344 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:54.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d87fff700 1 --2- 172.21.15.80:0/4244869344 >> v2:172.21.15.174:3300/0 conn(0x7f8d88137dd0 0x7f8d881629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:54.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d877fe700 1 -- 172.21.15.80:0/4244869344 >> v2:172.21.15.174:3300/0 conn(0x7f8d88137dd0 msgr2=0x7f8d881629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d877fe700 1 --2- 172.21.15.80:0/4244869344 >> v2:172.21.15.174:3300/0 conn(0x7f8d88137dd0 0x7f8d881629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:54.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d877fe700 1 -- 172.21.15.80:0/4244869344 >> v1:172.21.15.80:6789/0 conn(0x7f8d88138a70 legacy=0x7f8d881375d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d877fe700 1 -- 172.21.15.80:0/4244869344 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88115570 con 0x7f8d88106c20 2019-11-28T11:36:54.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d877fe700 1 --2- 172.21.15.80:0/4244869344 >> v2:172.21.15.80:3300/0 conn(0x7f8d88106c20 0x7f8d88138530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d78010450 tx=0x7f8d78010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d877fe700 1 --2- 172.21.15.80:0/4244869344 >> v2:172.21.15.80:3300/0 conn(0x7f8d88106c20 0x7f8d88138530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d78010450 tx=0x7f8d78010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d877fe700 1 --2- 172.21.15.80:0/4244869344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d88106c20 0x7f8d88138530 secure :-1 s=READY pgs=1110 cs=0 l=1 rx=0x7f8d78010450 tx=0x7f8d78010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:54.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.028+0000 7f8d877fe700 1 --2- 172.21.15.80:0/4244869344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d88106c20 0x7f8d88138530 secure :-1 s=THROTTLE_DONE pgs=1110 cs=0 l=1 rx=0x7f8d78010450 tx=0x7f8d78010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.029+0000 7f8d7ffff700 1 -- 172.21.15.80:0/4244869344 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d78000940 con 0x7f8d88106c20 2019-11-28T11:36:54.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.029+0000 7f8d877fe700 1 --2- 172.21.15.80:0/4244869344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d88106c20 0x7f8d88138530 secure :-1 s=THROTTLE_DONE pgs=1110 cs=0 l=1 rx=0x7f8d78010450 tx=0x7f8d78010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.029+0000 7f8d877fe700 1 --2- 172.21.15.80:0/4244869344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d88106c20 0x7f8d88138530 secure :-1 s=THROTTLE_DONE pgs=1110 cs=0 l=1 rx=0x7f8d78010450 tx=0x7f8d78010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.029+0000 7f8d7ffff700 1 -- 172.21.15.80:0/4244869344 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d78009250 con 0x7f8d88106c20 2019-11-28T11:36:54.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.029+0000 7f8d7ffff700 1 -- 172.21.15.80:0/4244869344 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d78000940 con 0x7f8d88106c20 2019-11-28T11:36:54.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.029+0000 7f8d8d84f700 1 -- 172.21.15.80:0/4244869344 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d881158f0 con 0x7f8d88106c20 2019-11-28T11:36:54.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.029+0000 7f8d8d84f700 1 -- 172.21.15.80:0/4244869344 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d88125fa0 con 0x7f8d88106c20 2019-11-28T11:36:54.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.029+0000 7f8d877fe700 1 --2- 172.21.15.80:0/4244869344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d88106c20 0x7f8d88138530 secure :-1 s=THROTTLE_DONE pgs=1110 cs=0 l=1 rx=0x7f8d78010450 tx=0x7f8d78010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.029+0000 7f8d7ffff700 1 -- 172.21.15.80:0/4244869344 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8d78000ea0 con 0x7f8d88106c20 2019-11-28T11:36:54.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.029+0000 7f8d877fe700 1 --2- 172.21.15.80:0/4244869344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d88106c20 0x7f8d88138530 secure :-1 s=THROTTLE_DONE pgs=1110 cs=0 l=1 rx=0x7f8d78010450 tx=0x7f8d78010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.029+0000 7f8d7ffff700 1 --2- 172.21.15.80:0/4244869344 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8d60018730 0x7f8d6001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:54.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.029+0000 7f8d7ffff700 1 -- 172.21.15.80:0/4244869344 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f8d78031ad0 con 0x7f8d88106c20 2019-11-28T11:36:54.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.029+0000 7f8d86ffd700 1 --2- 172.21.15.80:0/4244869344 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8d60018730 0x7f8d6001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:54.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.030+0000 7f8d86ffd700 1 --2- 172.21.15.80:0/4244869344 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8d60018730 0x7f8d6001abc0 crc :-1 s=READY pgs=452 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:54.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.037+0000 7f8d8d84f700 1 -- 172.21.15.80:0/4244869344 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d881147b0 con 0x7f8d88106c20 2019-11-28T11:36:54.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.040+0000 7f8d877fe700 1 --2- 172.21.15.80:0/4244869344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d88106c20 0x7f8d88138530 secure :-1 s=THROTTLE_DONE pgs=1110 cs=0 l=1 rx=0x7f8d78010450 tx=0x7f8d78010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.040+0000 7f8d7ffff700 1 -- 172.21.15.80:0/4244869344 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8d78000c90 con 0x7f8d88106c20 2019-11-28T11:36:54.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.216+0000 7f8d8d84f700 1 -- 172.21.15.80:0/4244869344 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8d88115570 con 0x7f8d88106c20 2019-11-28T11:36:54.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.217+0000 7f8d877fe700 1 --2- 172.21.15.80:0/4244869344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d88106c20 0x7f8d88138530 secure :-1 s=THROTTLE_DONE pgs=1110 cs=0 l=1 rx=0x7f8d78010450 tx=0x7f8d78010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.217+0000 7f8d7ffff700 1 -- 172.21.15.80:0/4244869344 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v85) v1 ==== 81+0+31990 (secure 0 0 0) 0x7f8d78000ea0 con 0x7f8d88106c20 2019-11-28T11:36:54.279 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:54.280 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:36:54.280 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 85, 2019-11-28T11:36:54.280 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:36:54.280 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:36:54.281 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:36:53.631915+0000", 2019-11-28T11:36:54.282 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:36:54.282 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:36:54.282 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:36:54.282 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:36:54.282 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:36:54.283 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:36:54.283 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:36:54.283 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:36:54.283 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:36:54.283 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:36:54.283 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:36:54.284 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:36:54.284 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:36:54.284 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:36:54.284 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:36:54.284 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 13, 2019-11-28T11:36:54.285 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:36:54.285 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:36:54.285 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:36:54.285 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:36:54.285 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:36:54.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.285 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:36:54.286 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:36:54.286 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:36:54.286 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:36:54.286 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:36:54.286 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:36:54.286 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:36:54.286 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:36:54.287 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:36:54.287 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:36:54.287 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:36:54.287 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:36:54.287 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:36:54.287 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:36:54.287 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:36:54.287 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:36:54.288 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:36:54.288 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:36:54.288 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:36:54.288 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:36:54.288 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:36:54.289 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:36:54.289 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:36:54.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.289 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:36:54.289 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:36:54.290 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:36:54.290 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:36:54.290 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:36:54.291 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:36:54.291 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:36:54.291 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:36:54.292 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:36:54.292 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:36:54.292 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:36:54.292 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:36:54.293 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:36:54.293 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:36:54.293 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:36:54.293 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:36:54.293 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:36:54.294 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:36:54.294 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:36:54.294 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:36:54.295 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:36:54.295 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:36:54.295 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:36:54.295 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:36:54.296 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:36:54.296 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:36:54.296 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:36:54.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.297 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:36:54.297 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:36:54.298 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:36:54.298 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:36:54.298 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:36:54.298 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:36:54.298 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:36:54.299 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:36:54.299 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:36:54.299 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:36:54.299 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:36:54.300 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:36:54.300 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:36:54.300 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:36:54.300 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.301 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 12, 2019-11-28T11:36:54.301 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:36:54.301 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:32:57.287502+0000", 2019-11-28T11:36:54.302 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:36:54.302 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:36:54.303 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:36:54.303 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:36:54.303 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:36:54.303 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:36:54.303 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:36:54.304 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:36:54.304 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:36:54.304 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:36:54.304 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:36:54.305 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:36:54.305 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:36:54.305 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:36:54.305 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:36:54.305 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:36:54.306 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:36:54.306 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:36:54.306 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:36:54.306 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:36:54.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.307 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "77", 2019-11-28T11:36:54.307 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:36:54.307 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:36:54.307 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:36:54.307 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:36:54.308 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:36:54.308 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:36:54.308 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:36:54.308 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:36:54.308 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:36:54.309 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:36:54.309 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:36:54.309 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:36:54.309 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:36:54.310 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:36:54.310 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:36:54.310 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:36:54.310 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:36:54.310 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:36:54.311 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:36:54.311 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:36:54.311 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:36:54.312 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:36:54.312 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:36:54.312 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:36:54.312 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:36:54.313 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:36:54.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.314 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:36:54.314 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:36:54.314 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:36:54.314 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:36:54.314 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:36:54.315 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:36:54.315 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:36:54.315 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:36:54.315 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:36:54.315 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:36:54.316 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:36:54.316 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:36:54.316 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:36:54.316 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:36:54.316 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:36:54.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.317 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:36:54.317 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:36:54.317 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:36:54.318 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.318 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.318 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 13, 2019-11-28T11:36:54.318 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:36:54.319 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:32:57.974341+0000", 2019-11-28T11:36:54.319 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:36:54.319 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:36:54.319 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:36:54.320 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:36:54.320 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:36:54.320 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:36:54.321 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:36:54.321 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:36:54.321 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:36:54.321 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:36:54.321 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:36:54.321 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:36:54.322 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:36:54.322 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:36:54.322 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:36:54.324 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:36:54.324 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:36:54.324 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:36:54.324 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:36:54.324 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:36:54.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.325 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "78", 2019-11-28T11:36:54.325 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:36:54.325 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:36:54.325 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:36:54.325 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:36:54.325 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:36:54.325 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:36:54.326 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:36:54.326 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:36:54.326 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:36:54.326 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:36:54.326 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:36:54.326 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:36:54.326 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:36:54.327 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:36:54.327 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:36:54.327 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:36:54.327 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:36:54.327 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:36:54.327 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:36:54.327 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:36:54.328 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:36:54.328 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:36:54.328 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:36:54.328 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:36:54.328 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:36:54.328 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:36:54.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.329 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:36:54.329 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:36:54.329 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:36:54.329 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:36:54.330 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:36:54.330 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:36:54.330 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:36:54.330 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:36:54.331 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:36:54.331 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:36:54.331 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:36:54.331 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:36:54.331 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:36:54.332 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:36:54.332 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:36:54.332 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.332 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.332 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.333 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:36:54.333 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:36:54.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.333 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:36:54.333 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:36:54.334 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:36:54.335 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:36:54.335 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:36:54.335 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:36:54.335 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:36:54.335 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:36:54.336 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:36:54.336 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 76, 2019-11-28T11:36:54.336 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:36:54.336 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:36:54.337 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:36:54.337 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.337 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.338 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:36:54.338 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:36:54.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.339 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.339 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:36:54.339 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:36:54.339 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.339 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.340 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:36:54.340 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.340 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.341 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:36:54.341 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:36:54.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.342 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.342 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:36:54.342 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:36:54.342 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.342 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.342 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:36:54.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.343 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:36:54.343 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:36:54.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.344 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.344 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:36:54.344 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:36:54.344 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.345 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.345 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:36:54.345 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.345 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.345 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:36:54.346 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:36:54.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.346 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.346 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:36:54.346 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:36:54.346 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.347 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.347 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:36:54.347 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:36:54.347 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:36:54.347 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:36:54.347 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:36:54.348 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:36:54.348 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:36:54.348 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.348 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:36:54.348 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:36:54.349 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:36:54.349 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:36:54.349 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:36:54.349 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:36:54.349 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:36:54.349 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:36:54.350 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:36:54.350 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 75, 2019-11-28T11:36:54.350 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:36:54.350 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:36:54.350 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:36:54.350 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.351 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.351 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:36:54.351 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:36:54.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.351 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.351 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:36:54.352 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:36:54.352 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.352 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.352 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:36:54.353 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.353 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.353 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:36:54.353 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:36:54.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.354 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.354 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:36:54.354 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:36:54.354 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.356 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.357 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:36:54.357 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.358 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.358 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:36:54.358 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:36:54.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.359 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.359 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:36:54.359 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:36:54.359 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.359 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.359 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:36:54.360 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.360 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.360 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:36:54.360 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:36:54.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.361 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.361 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:36:54.361 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:36:54.361 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.361 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.361 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:36:54.362 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:36:54.362 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:36:54.362 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:36:54.362 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:36:54.362 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:36:54.362 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:36:54.362 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.363 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:36:54.363 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:36:54.363 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:36:54.363 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:36:54.363 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:36:54.363 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:36:54.364 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:36:54.364 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:36:54.364 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:36:54.364 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 65, 2019-11-28T11:36:54.364 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:36:54.364 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:36:54.364 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:36:54.365 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.365 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.365 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:36:54.365 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:36:54.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.366 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.366 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:36:54.366 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:36:54.366 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.366 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.366 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:36:54.366 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.367 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.367 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:36:54.367 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:36:54.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.367 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.368 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:36:54.368 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:36:54.368 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.368 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.368 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:36:54.368 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.369 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.369 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:36:54.369 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:36:54.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.369 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.370 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:36:54.370 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:36:54.370 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.370 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.370 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:36:54.370 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.371 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.371 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:36:54.371 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:36:54.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.371 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.371 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:36:54.372 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:36:54.372 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.372 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.372 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:36:54.372 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:36:54.373 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:36:54.373 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:36:54.373 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:36:54.373 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:36:54.373 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:36:54.373 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.374 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:36:54.374 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:36:54.374 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:36:54.374 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:36:54.374 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:36:54.374 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:36:54.375 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:36:54.375 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:36:54.375 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:36:54.375 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 55, 2019-11-28T11:36:54.375 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:36:54.375 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:36:54.375 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:36:54.376 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.376 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.376 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:36:54.376 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:36:54.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.376 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.377 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:36:54.377 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:36:54.377 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.377 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.377 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:36:54.377 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.378 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.378 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:36:54.378 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:36:54.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.378 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.379 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:36:54.379 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:36:54.379 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.379 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.379 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:36:54.379 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.380 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.380 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:36:54.380 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:36:54.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.381 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.381 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:36:54.381 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:36:54.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.381 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.382 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:36:54.382 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.382 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.382 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:36:54.382 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:36:54.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.383 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.383 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:36:54.383 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:36:54.383 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.383 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.384 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:36:54.384 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:36:54.384 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:36:54.384 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:36:54.384 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:36:54.384 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:36:54.384 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:36:54.385 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.385 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:36:54.385 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:36:54.385 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:36:54.385 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:36:54.385 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:36:54.386 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:36:54.386 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:36:54.386 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:36:54.386 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:36:54.386 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 76, 2019-11-28T11:36:54.386 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:36:54.386 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:36:54.387 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:36:54.387 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.387 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.387 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:36:54.387 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:36:54.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.388 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.388 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:36:54.388 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:36:54.388 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.388 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.389 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:36:54.389 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.389 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.389 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:36:54.389 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:36:54.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.390 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.390 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:36:54.390 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:36:54.390 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.390 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.391 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:36:54.391 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.391 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.391 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:36:54.391 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:36:54.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.392 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.392 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:36:54.392 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:36:54.392 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.392 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.392 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:36:54.393 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.393 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.393 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:36:54.393 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:36:54.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.394 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.394 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:36:54.394 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:36:54.394 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.394 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.394 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:36:54.395 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:36:54.395 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:36:54.395 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:36:54.395 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:36:54.395 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:36:54.395 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:36:54.395 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.396 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:36:54.396 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:36:54.396 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:36:54.396 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:36:54.396 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:36:54.397 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:36:54.397 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:36:54.397 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:36:54.397 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:36:54.397 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 76, 2019-11-28T11:36:54.397 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:36:54.397 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:36:54.398 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:36:54.398 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.398 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.398 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:36:54.398 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:36:54.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.399 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.399 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:36:54.399 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:36:54.399 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.399 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.400 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:36:54.400 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.400 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.400 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:36:54.400 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:36:54.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.401 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.401 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:36:54.401 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:36:54.401 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.401 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.402 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:36:54.402 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.402 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.402 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:36:54.402 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:36:54.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.403 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.403 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:36:54.403 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:36:54.403 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.403 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.404 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:36:54.404 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.404 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.404 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:36:54.404 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:36:54.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.405 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.405 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:36:54.405 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:36:54.405 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.405 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.406 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:36:54.406 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:36:54.406 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:36:54.406 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:36:54.406 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:36:54.406 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:36:54.407 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:36:54.407 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.407 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:36:54.407 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:36:54.407 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:36:54.407 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:36:54.408 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:36:54.408 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:36:54.408 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:36:54.408 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:36:54.408 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:36:54.408 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 76, 2019-11-28T11:36:54.408 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:36:54.409 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:36:54.409 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:36:54.409 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.409 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.409 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:36:54.409 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:36:54.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.410 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.410 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:36:54.410 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:36:54.410 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.410 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.411 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:36:54.411 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.411 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.412 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:36:54.412 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:36:54.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.412 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.413 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:36:54.413 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:36:54.413 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.413 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.413 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:36:54.413 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.414 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.414 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:36:54.414 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:36:54.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.414 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.415 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:36:54.415 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:36:54.415 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.415 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.415 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:36:54.415 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.416 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.416 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:36:54.416 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:36:54.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.416 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.417 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:36:54.417 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:36:54.417 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.417 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.417 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:36:54.417 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:36:54.419 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:36:54.419 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:36:54.419 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:36:54.419 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:36:54.419 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:36:54.420 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.420 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:36:54.420 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:36:54.420 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:36:54.421 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:36:54.421 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:36:54.421 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:36:54.421 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:36:54.421 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:36:54.421 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:36:54.422 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 76, 2019-11-28T11:36:54.422 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:36:54.422 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:36:54.422 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:36:54.422 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.422 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.422 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:36:54.423 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:36:54.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.423 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.423 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:36:54.423 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:36:54.423 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.424 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.424 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:36:54.424 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.424 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.424 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:36:54.425 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:36:54.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.425 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.425 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:36:54.425 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:36:54.425 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.426 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.426 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:36:54.426 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.426 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.426 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:36:54.426 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:36:54.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.427 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.427 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:36:54.427 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:36:54.427 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.427 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.428 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:36:54.428 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:36:54.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.428 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:36:54.428 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:36:54.428 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:36:54.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.429 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:36:54.429 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:36:54.429 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:36:54.429 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.429 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.430 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:36:54.430 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:36:54.430 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:36:54.430 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:36:54.430 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:36:54.430 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:36:54.430 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:36:54.431 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:36:54.431 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.431 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:36:54.431 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:36:54.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.431 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:36:54.431 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:36:54.432 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:36:54.432 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:36:54.432 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:36:54.432 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:36:54.432 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:36:54.433 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:36:54.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.433 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:36:54.433 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:36:54.433 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:36:54.433 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:36:54.434 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:36:54.434 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:36:54.434 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:36:54.434 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:36:54.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.434 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:36:54.435 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:36:54.435 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:36:54.435 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:36:54.435 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:36:54.435 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:36:54.435 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:36:54.436 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:36:54.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.436 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:36:54.436 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:36:54.436 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:36:54.437 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:36:54.437 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:36:54.437 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:36:54.437 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:36:54.437 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:36:54.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.438 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:36:54.438 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:36:54.438 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:36:54.438 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:36:54.438 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:36:54.438 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:36:54.438 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:36:54.439 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:36:54.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.439 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:36:54.439 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:36:54.439 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:36:54.439 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:36:54.439 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:36:54.440 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:36:54.440 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:36:54.440 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:36:54.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.441 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:36:54.441 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:36:54.441 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:36:54.441 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:36:54.442 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:36:54.442 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:36:54.442 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:36:54.442 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:36:54.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:36:54.442 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:36:54.442 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:36:54.443 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:36:54.443 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:36:54.443 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:36:54.443 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:36:54.443 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:36:54.443 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:36:54.443 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.444 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:36:54.444 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:36:54.444 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:36:54.444 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:36:54.444 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:36:54.444 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:36:54.444 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/3667048559": "2019-11-29T11:36:53.617641+0000", 2019-11-28T11:36:54.445 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.76:0/3432629622": "2019-11-28T12:36:45.218542+0000", 2019-11-28T11:36:54.445 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/3667048559": "2019-11-29T11:36:53.617641+0000", 2019-11-28T11:36:54.445 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/3402343468": "2019-11-29T11:33:16.997740+0000", 2019-11-28T11:36:54.445 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/3402343468": "2019-11-29T11:33:16.997740+0000" 2019-11-28T11:36:54.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.445 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:36:54.445 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:36:54.446 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:36:54.446 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:36:54.446 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:36:54.446 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:36:54.446 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:36:54.446 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:36:54.446 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:36:54.446 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:36:54.447 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:36:54.447 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:36:54.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.447 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:36:54.447 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:36:54.448 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:36:54.448 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:36:54.448 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:36:54.449 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:36:54.449 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:36:54.449 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:36:54.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:36:54.449 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:36:54.449 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:36:54.449 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:36:54.450 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:36:54.450 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:36:54.450 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:36:54.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.220+0000 7f8d8d84f700 1 -- 172.21.15.80:0/4244869344 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8d60018730 msgr2=0x7f8d6001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.221+0000 7f8d8d84f700 1 --2- 172.21.15.80:0/4244869344 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8d60018730 0x7f8d6001abc0 crc :-1 s=READY pgs=452 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:54.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.221+0000 7f8d8d84f700 1 -- 172.21.15.80:0/4244869344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d88106c20 msgr2=0x7f8d88138530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.221+0000 7f8d8d84f700 1 --2- 172.21.15.80:0/4244869344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d88106c20 0x7f8d88138530 secure :-1 s=READY pgs=1110 cs=0 l=1 rx=0x7f8d78010450 tx=0x7f8d78010280).stop 2019-11-28T11:36:54.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.221+0000 7f8d8d84f700 1 -- 172.21.15.80:0/4244869344 shutdown_connections 2019-11-28T11:36:54.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.221+0000 7f8d8d84f700 1 --2- 172.21.15.80:0/4244869344 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8d60018730 0x7f8d6001abc0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:54.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.221+0000 7f8d8d84f700 1 --2- 172.21.15.80:0/4244869344 >> v2:172.21.15.174:3300/0 conn(0x7f8d88137dd0 0x7f8d881629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:54.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.221+0000 7f8d8d84f700 1 --2- 172.21.15.80:0/4244869344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d88106c20 0x7f8d88138530 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:54.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.221+0000 7f8d8d84f700 1 -- 172.21.15.80:0/4244869344 shutdown_connections 2019-11-28T11:36:54.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.221+0000 7f8d8d84f700 1 -- 172.21.15.80:0/4244869344 wait complete. 2019-11-28T11:36:54.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.221+0000 7f8d8d84f700 1 -- 172.21.15.80:0/4244869344 >> 172.21.15.80:0/4244869344 conn(0x7f8d88141d10 msgr2=0x7f8d8813ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:54.454 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:54.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.513+0000 7fa77bc3b700 1 Processor -- start 2019-11-28T11:36:54.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.513+0000 7fa77bc3b700 1 -- start start 2019-11-28T11:36:54.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa77bc3b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa77406c0a0 0x7fa774072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:54.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa77bc3b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77406db00 con 0x7fa774072620 2019-11-28T11:36:54.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa77bc3b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77406e000 con 0x7fa7740734e0 2019-11-28T11:36:54.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa77bc3b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77406f330 con 0x7fa77406c0a0 2019-11-28T11:36:54.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa77a9d9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa774072620 0x7fa774164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36104/0 (socket says 172.21.15.80:36104) 2019-11-28T11:36:54.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa77a9d9700 1 -- 172.21.15.80:0/391639223 learned_addr learned my addr 172.21.15.80:0/391639223 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:54.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/391639223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa77406c0a0 0x7fa774072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:54.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa7791d6700 1 -- 172.21.15.80:0/391639223 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473972486 0 0) 0x7fa76c001150 con 0x7fa774072620 2019-11-28T11:36:54.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa7791d6700 1 -- 172.21.15.80:0/391639223 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa760002e80 con 0x7fa774072620 2019-11-28T11:36:54.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa7791d6700 1 -- 172.21.15.80:0/391639223 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341377977 0 0) 0x7fa764000ff0 con 0x7fa7740734e0 2019-11-28T11:36:54.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa7791d6700 1 -- 172.21.15.80:0/391639223 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7600030b0 con 0x7fa7740734e0 2019-11-28T11:36:54.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa77a1d8700 1 -- 172.21.15.80:0/391639223 >> v1:172.21.15.174:6789/0 conn(0x7fa7740734e0 legacy=0x7fa774071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa77a1d8700 1 -- 172.21.15.80:0/391639223 >> v1:172.21.15.80:6789/0 conn(0x7fa774072620 legacy=0x7fa774164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa77a1d8700 1 -- 172.21.15.80:0/391639223 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7740706c0 con 0x7fa77406c0a0 2019-11-28T11:36:54.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/391639223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa77406c0a0 0x7fa774072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa75c00b2d0 tx=0x7fa75c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/391639223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa77406c0a0 0x7fa774072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa75c00b2d0 tx=0x7fa75c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/391639223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa77406c0a0 0x7fa774072fa0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7fa75c00b2d0 tx=0x7fa75c00bae0).ready entity=mon.2 client_cookie=64a9b003ee209ca8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:54.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/391639223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa77406c0a0 0x7fa774072fa0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7fa75c00b2d0 tx=0x7fa75c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa7791d6700 1 -- 172.21.15.80:0/391639223 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa75c000ce0 con 0x7fa77406c0a0 2019-11-28T11:36:54.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.515+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/391639223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa77406c0a0 0x7fa774072fa0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7fa75c00b2d0 tx=0x7fa75c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.516+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/391639223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa77406c0a0 0x7fa774072fa0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7fa75c00b2d0 tx=0x7fa75c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.516+0000 7fa7791d6700 1 -- 172.21.15.80:0/391639223 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c007590 con 0x7fa77406c0a0 2019-11-28T11:36:54.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.516+0000 7fa7791d6700 1 -- 172.21.15.80:0/391639223 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa75c009f20 con 0x7fa77406c0a0 2019-11-28T11:36:54.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.516+0000 7fa77bc3b700 1 -- 172.21.15.80:0/391639223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa77406c0a0 msgr2=0x7fa774072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.516+0000 7fa77bc3b700 1 --2- 172.21.15.80:0/391639223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa77406c0a0 0x7fa774072fa0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7fa75c00b2d0 tx=0x7fa75c00bae0).stop 2019-11-28T11:36:54.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.516+0000 7fa77bc3b700 1 -- 172.21.15.80:0/391639223 shutdown_connections 2019-11-28T11:36:54.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.516+0000 7fa77bc3b700 1 --2- 172.21.15.80:0/391639223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa77406c0a0 0x7fa774072fa0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:54.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.516+0000 7fa77bc3b700 1 -- 172.21.15.80:0/391639223 shutdown_connections 2019-11-28T11:36:54.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.516+0000 7fa77bc3b700 1 -- 172.21.15.80:0/391639223 wait complete. 2019-11-28T11:36:54.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.516+0000 7fa77bc3b700 1 -- 172.21.15.80:0/391639223 >> 172.21.15.80:0/391639223 conn(0x7fa774061cf0 msgr2=0x7fa774064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:54.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.519+0000 7fa77bc3b700 1 Processor -- start 2019-11-28T11:36:54.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.519+0000 7fa77bc3b700 1 -- start start 2019-11-28T11:36:54.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77bc3b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa77413f390 0x7fa774160f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:54.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77bc3b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa774141010 con 0x7fa774140790 2019-11-28T11:36:54.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77bc3b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7741414c0 con 0x7fa774161490 2019-11-28T11:36:54.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77bc3b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7741254a0 con 0x7fa77413f390 2019-11-28T11:36:54.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77a1d8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa77413f390 0x7fa774160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:54.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77a1d8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa77413f390 0x7fa774160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36792/0 (socket says 172.21.15.80:36792) 2019-11-28T11:36:54.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77a1d8700 1 -- 172.21.15.80:0/3652124425 learned_addr learned my addr 172.21.15.80:0/3652124425 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:54.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77a1d8700 1 -- 172.21.15.80:0/3652124425 >> v1:172.21.15.174:6789/0 conn(0x7fa774161490 legacy=0x7fa77415fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77a1d8700 1 -- 172.21.15.80:0/3652124425 >> v1:172.21.15.80:6789/0 conn(0x7fa774140790 legacy=0x7fa7741605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa772ffd700 1 -- 172.21.15.80:0/3652124425 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598053081 0 0) 0x7fa764000de0 con 0x7fa774161490 2019-11-28T11:36:54.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77a1d8700 1 -- 172.21.15.80:0/3652124425 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77415ea10 con 0x7fa77413f390 2019-11-28T11:36:54.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/3652124425 >> v2:172.21.15.80:3300/0 conn(0x7fa77413f390 0x7fa774160f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa75c0107c0 tx=0x7fa75c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/3652124425 >> v2:172.21.15.80:3300/0 conn(0x7fa77413f390 0x7fa774160f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa75c0107c0 tx=0x7fa75c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/3652124425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77413f390 0x7fa774160f50 secure :-1 s=READY pgs=1113 cs=0 l=1 rx=0x7fa75c0107c0 tx=0x7fa75c010b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:54.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/3652124425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77413f390 0x7fa774160f50 secure :-1 s=THROTTLE_DONE pgs=1113 cs=0 l=1 rx=0x7fa75c0107c0 tx=0x7fa75c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa772ffd700 1 -- 172.21.15.80:0/3652124425 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa75c000cc0 con 0x7fa77413f390 2019-11-28T11:36:54.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/3652124425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77413f390 0x7fa774160f50 secure :-1 s=THROTTLE_DONE pgs=1113 cs=0 l=1 rx=0x7fa75c0107c0 tx=0x7fa75c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa772ffd700 1 -- 172.21.15.80:0/3652124425 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c000cc0 con 0x7fa77413f390 2019-11-28T11:36:54.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77bc3b700 1 -- 172.21.15.80:0/3652124425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77415ea10 con 0x7fa77413f390 2019-11-28T11:36:54.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/3652124425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77413f390 0x7fa774160f50 secure :-1 s=THROTTLE_DONE pgs=1113 cs=0 l=1 rx=0x7fa75c0107c0 tx=0x7fa75c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa772ffd700 1 -- 172.21.15.80:0/3652124425 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa75c009ef0 con 0x7fa77413f390 2019-11-28T11:36:54.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.520+0000 7fa77bc3b700 1 -- 172.21.15.80:0/3652124425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77415ea10 con 0x7fa77413f390 2019-11-28T11:36:54.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.521+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/3652124425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77413f390 0x7fa774160f50 secure :-1 s=THROTTLE_DONE pgs=1113 cs=0 l=1 rx=0x7fa75c0107c0 tx=0x7fa75c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.521+0000 7fa772ffd700 1 -- 172.21.15.80:0/3652124425 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa75c00a610 con 0x7fa77413f390 2019-11-28T11:36:54.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.521+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/3652124425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77413f390 0x7fa774160f50 secure :-1 s=THROTTLE_DONE pgs=1113 cs=0 l=1 rx=0x7fa75c0107c0 tx=0x7fa75c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.521+0000 7fa772ffd700 1 --2- 172.21.15.80:0/3652124425 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa758018730 0x7fa75801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:54.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.521+0000 7fa772ffd700 1 -- 172.21.15.80:0/3652124425 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fa75c032160 con 0x7fa77413f390 2019-11-28T11:36:54.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.521+0000 7fa7799d7700 1 --2- 172.21.15.80:0/3652124425 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa758018730 0x7fa75801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:54.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.522+0000 7fa7799d7700 1 --2- 172.21.15.80:0/3652124425 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa758018730 0x7fa75801abc0 crc :-1 s=READY pgs=453 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:54.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.529+0000 7fa77bc3b700 1 -- 172.21.15.80:0/3652124425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77415ea10 con 0x7fa77413f390 2019-11-28T11:36:54.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.532+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/3652124425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77413f390 0x7fa774160f50 secure :-1 s=THROTTLE_DONE pgs=1113 cs=0 l=1 rx=0x7fa75c0107c0 tx=0x7fa75c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.532+0000 7fa772ffd700 1 -- 172.21.15.80:0/3652124425 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa75c00a400 con 0x7fa77413f390 2019-11-28T11:36:54.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.704+0000 7fa77bc3b700 1 -- 172.21.15.80:0/3652124425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa77415ea10 con 0x7fa77413f390 2019-11-28T11:36:54.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.704+0000 7fa77a1d8700 1 --2- 172.21.15.80:0/3652124425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77413f390 0x7fa774160f50 secure :-1 s=THROTTLE_DONE pgs=1113 cs=0 l=1 rx=0x7fa75c0107c0 tx=0x7fa75c010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.704+0000 7fa772ffd700 1 -- 172.21.15.80:0/3652124425 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+1427 (secure 0 0 0) 0x7fa75c017ea0 con 0x7fa77413f390 2019-11-28T11:36:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 53 2019-11-28T11:36:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.707+0000 7fa77bc3b700 1 -- 172.21.15.80:0/3652124425 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa758018730 msgr2=0x7fa75801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.707+0000 7fa77bc3b700 1 --2- 172.21.15.80:0/3652124425 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa758018730 0x7fa75801abc0 crc :-1 s=READY pgs=453 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.707+0000 7fa77bc3b700 1 -- 172.21.15.80:0/3652124425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77413f390 msgr2=0x7fa774160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.707+0000 7fa77bc3b700 1 --2- 172.21.15.80:0/3652124425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77413f390 0x7fa774160f50 secure :-1 s=READY pgs=1113 cs=0 l=1 rx=0x7fa75c0107c0 tx=0x7fa75c010b60).stop 2019-11-28T11:36:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.707+0000 7fa77bc3b700 1 -- 172.21.15.80:0/3652124425 shutdown_connections 2019-11-28T11:36:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.707+0000 7fa77bc3b700 1 --2- 172.21.15.80:0/3652124425 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa758018730 0x7fa75801abc0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:54.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.707+0000 7fa77bc3b700 1 --2- 172.21.15.80:0/3652124425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa77413f390 0x7fa774160f50 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:54.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.707+0000 7fa77bc3b700 1 -- 172.21.15.80:0/3652124425 shutdown_connections 2019-11-28T11:36:54.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.707+0000 7fa77bc3b700 1 -- 172.21.15.80:0/3652124425 wait complete. 2019-11-28T11:36:54.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.707+0000 7fa77bc3b700 1 -- 172.21.15.80:0/3652124425 >> 172.21.15.80:0/3652124425 conn(0x7fa77407c6e0 msgr2=0x7fa77407b810 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:54.771 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:54.771 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:36:53.789475+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:54.777 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:36:54.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.842+0000 7fc554a86700 1 Processor -- start 2019-11-28T11:36:54.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.842+0000 7fc554a86700 1 -- start start 2019-11-28T11:36:54.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.843+0000 7fc554a86700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc55006c0a0 0x7fc550072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:54.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.843+0000 7fc554a86700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc5500734e0 0x7fc550071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:54.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.843+0000 7fc554a86700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55006db00 con 0x7fc550072360 2019-11-28T11:36:54.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.843+0000 7fc554a86700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc55006fd60 con 0x7fc5500734e0 2019-11-28T11:36:54.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.843+0000 7fc554a86700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc550070030 con 0x7fc55006c0a0 2019-11-28T11:36:54.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.843+0000 7fc54e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc5500734e0 0x7fc550071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:54.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.843+0000 7fc54e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc5500734e0 0x7fc550071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36804/0 (socket says 172.21.15.80:36804) 2019-11-28T11:36:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.843+0000 7fc54e59c700 1 -- 172.21.15.80:0/861777855 learned_addr learned my addr 172.21.15.80:0/861777855 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.843+0000 7fc54ed9d700 1 --2- 172.21.15.80:0/861777855 >> v2:172.21.15.174:3300/0 conn(0x7fc55006c0a0 0x7fc550072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.843+0000 7fc54e59c700 1 -- 172.21.15.80:0/861777855 >> v2:172.21.15.174:3300/0 conn(0x7fc55006c0a0 msgr2=0x7fc550072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.843+0000 7fc54e59c700 1 --2- 172.21.15.80:0/861777855 >> v2:172.21.15.174:3300/0 conn(0x7fc55006c0a0 0x7fc550072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.844+0000 7fc54e59c700 1 -- 172.21.15.80:0/861777855 >> v1:172.21.15.174:6789/0 conn(0x7fc550072360 legacy=0x7fc55006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.844+0000 7fc54e59c700 1 -- 172.21.15.80:0/861777855 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5500706c0 con 0x7fc5500734e0 2019-11-28T11:36:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.844+0000 7fc54e59c700 1 --2- 172.21.15.80:0/861777855 >> v2:172.21.15.80:3300/0 conn(0x7fc5500734e0 0x7fc550071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc53800f6c0 tx=0x7fc53800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.844+0000 7fc54e59c700 1 --2- 172.21.15.80:0/861777855 >> v2:172.21.15.80:3300/0 conn(0x7fc5500734e0 0x7fc550071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc53800f6c0 tx=0x7fc53800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.844+0000 7fc54e59c700 1 --2- 172.21.15.80:0/861777855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5500734e0 0x7fc550071e20 secure :-1 s=READY pgs=1114 cs=0 l=1 rx=0x7fc53800f6c0 tx=0x7fc53800fa60).ready entity=mon.0 client_cookie=87c03fb59e2ea1c1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.844+0000 7fc54e59c700 1 --2- 172.21.15.80:0/861777855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5500734e0 0x7fc550071e20 secure :-1 s=THROTTLE_DONE pgs=1114 cs=0 l=1 rx=0x7fc53800f6c0 tx=0x7fc53800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.844+0000 7fc54dd9b700 1 -- 172.21.15.80:0/861777855 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc538000960 con 0x7fc5500734e0 2019-11-28T11:36:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.844+0000 7fc54e59c700 1 --2- 172.21.15.80:0/861777855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5500734e0 0x7fc550071e20 secure :-1 s=THROTTLE_DONE pgs=1114 cs=0 l=1 rx=0x7fc53800f6c0 tx=0x7fc53800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.844+0000 7fc54e59c700 1 --2- 172.21.15.80:0/861777855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5500734e0 0x7fc550071e20 secure :-1 s=THROTTLE_DONE pgs=1114 cs=0 l=1 rx=0x7fc53800f6c0 tx=0x7fc53800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.844+0000 7fc54dd9b700 1 -- 172.21.15.80:0/861777855 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc538000c90 con 0x7fc5500734e0 2019-11-28T11:36:54.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.844+0000 7fc54dd9b700 1 -- 172.21.15.80:0/861777855 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5380013a0 con 0x7fc5500734e0 2019-11-28T11:36:54.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.844+0000 7fc554a86700 1 -- 172.21.15.80:0/861777855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5500734e0 msgr2=0x7fc550071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.844+0000 7fc554a86700 1 --2- 172.21.15.80:0/861777855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5500734e0 0x7fc550071e20 secure :-1 s=READY pgs=1114 cs=0 l=1 rx=0x7fc53800f6c0 tx=0x7fc53800fa60).stop 2019-11-28T11:36:54.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.845+0000 7fc554a86700 1 -- 172.21.15.80:0/861777855 shutdown_connections 2019-11-28T11:36:54.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.845+0000 7fc554a86700 1 --2- 172.21.15.80:0/861777855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5500734e0 0x7fc550071e20 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:54.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.845+0000 7fc554a86700 1 --2- 172.21.15.80:0/861777855 >> v2:172.21.15.174:3300/0 conn(0x7fc55006c0a0 0x7fc550072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:54.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.845+0000 7fc554a86700 1 -- 172.21.15.80:0/861777855 shutdown_connections 2019-11-28T11:36:54.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.845+0000 7fc554a86700 1 -- 172.21.15.80:0/861777855 wait complete. 2019-11-28T11:36:54.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.845+0000 7fc554a86700 1 -- 172.21.15.80:0/861777855 >> 172.21.15.80:0/861777855 conn(0x7fc550061cf0 msgr2=0x7fc550064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:54.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.847+0000 7fc554a86700 1 Processor -- start 2019-11-28T11:36:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.847+0000 7fc554a86700 1 -- start start 2019-11-28T11:36:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.848+0000 7fc554a86700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc5501281b0 0x7fc550128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.848+0000 7fc554a86700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc550128b80 0x7fc550167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.848+0000 7fc554a86700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc550139a60 con 0x7fc55013a780 2019-11-28T11:36:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.848+0000 7fc554a86700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc55012a260 con 0x7fc550128b80 2019-11-28T11:36:54.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.848+0000 7fc554a86700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55012a530 con 0x7fc5501281b0 2019-11-28T11:36:54.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.848+0000 7fc54ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc55013a780 0x7fc55012d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36122/0 (socket says 172.21.15.80:36122) 2019-11-28T11:36:54.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.848+0000 7fc54ed9d700 1 -- 172.21.15.80:0/2216663352 learned_addr learned my addr 172.21.15.80:0/2216663352 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:54.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.848+0000 7fc54f59e700 1 --2- 172.21.15.80:0/2216663352 >> v2:172.21.15.174:3300/0 conn(0x7fc550128b80 0x7fc550167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:54.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.848+0000 7fc54e59c700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc5501281b0 0x7fc550128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:54.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.848+0000 7fc5477fe700 1 -- 172.21.15.80:0/2216663352 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963455366 0 0) 0x7fc540009580 con 0x7fc55013a780 2019-11-28T11:36:54.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.848+0000 7fc5477fe700 1 -- 172.21.15.80:0/2216663352 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc534002e80 con 0x7fc55013a780 2019-11-28T11:36:54.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.848+0000 7fc54f59e700 1 -- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc5501281b0 msgr2=0x7fc550128640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.848+0000 7fc54f59e700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc5501281b0 0x7fc550128640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:54.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.848+0000 7fc54f59e700 1 -- 172.21.15.80:0/2216663352 >> v1:172.21.15.80:6789/0 conn(0x7fc55013a780 legacy=0x7fc55012d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:54.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.848+0000 7fc54f59e700 1 -- 172.21.15.80:0/2216663352 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55012abc0 con 0x7fc550128b80 2019-11-28T11:36:54.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.849+0000 7fc54f59e700 1 --2- 172.21.15.80:0/2216663352 >> v2:172.21.15.174:3300/0 conn(0x7fc550128b80 0x7fc550167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc548010730 tx=0x7fc54800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.849+0000 7fc54f59e700 1 --2- 172.21.15.80:0/2216663352 >> v2:172.21.15.174:3300/0 conn(0x7fc550128b80 0x7fc550167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc548010730 tx=0x7fc54800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.849+0000 7fc54f59e700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc550128b80 0x7fc550167d70 secure :-1 s=READY pgs=666 cs=0 l=1 rx=0x7fc548010730 tx=0x7fc54800b670).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:54.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.849+0000 7fc54f59e700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc550128b80 0x7fc550167d70 secure :-1 s=THROTTLE_DONE pgs=666 cs=0 l=1 rx=0x7fc548010730 tx=0x7fc54800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.849+0000 7fc5477fe700 1 -- 172.21.15.80:0/2216663352 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc548000ce0 con 0x7fc550128b80 2019-11-28T11:36:54.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.849+0000 7fc54f59e700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc550128b80 0x7fc550167d70 secure :-1 s=THROTTLE_DONE pgs=666 cs=0 l=1 rx=0x7fc548010730 tx=0x7fc54800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.849+0000 7fc5477fe700 1 -- 172.21.15.80:0/2216663352 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc548009ba0 con 0x7fc550128b80 2019-11-28T11:36:54.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.849+0000 7fc54f59e700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc550128b80 0x7fc550167d70 secure :-1 s=THROTTLE_DONE pgs=666 cs=0 l=1 rx=0x7fc548010730 tx=0x7fc54800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.849+0000 7fc554a86700 1 -- 172.21.15.80:0/2216663352 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55012af40 con 0x7fc550128b80 2019-11-28T11:36:54.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.849+0000 7fc5477fe700 1 -- 172.21.15.80:0/2216663352 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc548009910 con 0x7fc550128b80 2019-11-28T11:36:54.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.849+0000 7fc554a86700 1 -- 172.21.15.80:0/2216663352 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55012abc0 con 0x7fc550128b80 2019-11-28T11:36:54.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.849+0000 7fc54f59e700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc550128b80 0x7fc550167d70 secure :-1 s=THROTTLE_DONE pgs=666 cs=0 l=1 rx=0x7fc548010730 tx=0x7fc54800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.849+0000 7fc5477fe700 1 -- 172.21.15.80:0/2216663352 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc548009d90 con 0x7fc550128b80 2019-11-28T11:36:54.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.849+0000 7fc54f59e700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc550128b80 0x7fc550167d70 secure :-1 s=THROTTLE_DONE pgs=666 cs=0 l=1 rx=0x7fc548010730 tx=0x7fc54800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.850+0000 7fc5477fe700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc534018770 0x7fc53401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:54.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.850+0000 7fc5477fe700 1 -- 172.21.15.80:0/2216663352 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fc548031d70 con 0x7fc550128b80 2019-11-28T11:36:54.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.850+0000 7fc54ed9d700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc534018770 0x7fc53401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:54.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.850+0000 7fc54ed9d700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc534018770 0x7fc53401abe0 crc :-1 s=READY pgs=454 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:54.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.857+0000 7fc554a86700 1 -- 172.21.15.80:0/2216663352 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55012af40 con 0x7fc550128b80 2019-11-28T11:36:54.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.861+0000 7fc54f59e700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc550128b80 0x7fc550167d70 secure :-1 s=THROTTLE_DONE pgs=666 cs=0 l=1 rx=0x7fc548010730 tx=0x7fc54800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:54.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:54.861+0000 7fc5477fe700 1 -- 172.21.15.80:0/2216663352 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc54802e490 con 0x7fc550128b80 2019-11-28T11:36:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.027+0000 7fc554a86700 1 -- 172.21.15.80:0/2216663352 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc55012abc0 con 0x7fc550128b80 2019-11-28T11:36:55.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.803+0000 7fc54f59e700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc550128b80 0x7fc550167d70 secure :-1 s=THROTTLE_DONE pgs=666 cs=0 l=1 rx=0x7fc548010730 tx=0x7fc54800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:55.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.803+0000 7fc5477fe700 1 -- 172.21.15.80:0/2216663352 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc54802e490 con 0x7fc550128b80 2019-11-28T11:36:55.903 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:36:55.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.845+0000 7fc554a86700 1 -- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc534018770 msgr2=0x7fc53401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:55.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.845+0000 7fc554a86700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc534018770 0x7fc53401abe0 crc :-1 s=READY pgs=454 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:55.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.845+0000 7fc554a86700 1 -- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc550128b80 msgr2=0x7fc550167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:55.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.845+0000 7fc554a86700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc550128b80 0x7fc550167d70 secure :-1 s=READY pgs=666 cs=0 l=1 rx=0x7fc548010730 tx=0x7fc54800b670).stop 2019-11-28T11:36:55.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.845+0000 7fc554a86700 1 -- 172.21.15.80:0/2216663352 shutdown_connections 2019-11-28T11:36:55.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.845+0000 7fc554a86700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc534018770 0x7fc53401abe0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:55.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.845+0000 7fc554a86700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc550128b80 0x7fc550167d70 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:55.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.845+0000 7fc554a86700 1 --2- 172.21.15.80:0/2216663352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc5501281b0 0x7fc550128640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:55.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.845+0000 7fc554a86700 1 -- 172.21.15.80:0/2216663352 shutdown_connections 2019-11-28T11:36:55.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.845+0000 7fc554a86700 1 -- 172.21.15.80:0/2216663352 wait complete. 2019-11-28T11:36:55.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.845+0000 7fc554a86700 1 -- 172.21.15.80:0/2216663352 >> 172.21.15.80:0/2216663352 conn(0x7fc550127dc0 msgr2=0x7fc550141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:55.916 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:36:56.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.975+0000 7f4aecc7d700 1 Processor -- start 2019-11-28T11:36:56.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.975+0000 7f4aecc7d700 1 -- start start 2019-11-28T11:36:56.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.976+0000 7f4aecc7d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4ae806c0a0 0x7f4ae8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:56.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.976+0000 7f4aecc7d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4ae80734e0 0x7f4ae8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:56.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.976+0000 7f4aecc7d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae806db00 con 0x7f4ae8072360 2019-11-28T11:36:56.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.976+0000 7f4aecc7d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae806fd60 con 0x7f4ae80734e0 2019-11-28T11:36:56.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.976+0000 7f4aecc7d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae8070030 con 0x7f4ae806c0a0 2019-11-28T11:36:56.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.976+0000 7f4ae659c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4ae80734e0 0x7f4ae8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:56.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.976+0000 7f4ae659c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4ae80734e0 0x7f4ae8071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36818/0 (socket says 172.21.15.80:36818) 2019-11-28T11:36:56.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.976+0000 7f4ae659c700 1 -- 172.21.15.80:0/3995327786 learned_addr learned my addr 172.21.15.80:0/3995327786 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:56.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.976+0000 7f4ae759e700 1 --1- 172.21.15.80:0/3995327786 >> v1:172.21.15.80:6789/0 conn(0x7f4ae8072360 0x7f4ae806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36132/0 (socket says 172.21.15.80:36132) 2019-11-28T11:36:56.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4ae6d9d700 1 --2- 172.21.15.80:0/3995327786 >> v2:172.21.15.174:3300/0 conn(0x7f4ae806c0a0 0x7f4ae8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:56.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4ae659c700 1 -- 172.21.15.80:0/3995327786 >> v2:172.21.15.174:3300/0 conn(0x7f4ae806c0a0 msgr2=0x7f4ae8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:56.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4ae659c700 1 --2- 172.21.15.80:0/3995327786 >> v2:172.21.15.174:3300/0 conn(0x7f4ae806c0a0 0x7f4ae8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:56.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4ae659c700 1 -- 172.21.15.80:0/3995327786 >> v1:172.21.15.80:6789/0 conn(0x7f4ae8072360 legacy=0x7f4ae806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:56.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4ae5d9b700 1 -- 172.21.15.80:0/3995327786 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577896228 0 0) 0x7f4ae00009b0 con 0x7f4ae8072360 2019-11-28T11:36:56.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4ae659c700 1 -- 172.21.15.80:0/3995327786 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae80706c0 con 0x7f4ae80734e0 2019-11-28T11:36:56.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4ae659c700 1 --2- 172.21.15.80:0/3995327786 >> v2:172.21.15.80:3300/0 conn(0x7f4ae80734e0 0x7f4ae8071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4ad800f6c0 tx=0x7f4ad800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4ae659c700 1 --2- 172.21.15.80:0/3995327786 >> v2:172.21.15.80:3300/0 conn(0x7f4ae80734e0 0x7f4ae8071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4ad800f6c0 tx=0x7f4ad800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4ae659c700 1 --2- 172.21.15.80:0/3995327786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ae80734e0 0x7f4ae8071e20 secure :-1 s=READY pgs=1117 cs=0 l=1 rx=0x7f4ad800f6c0 tx=0x7f4ad800fa60).ready entity=mon.0 client_cookie=b32924a157a60026 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4ae659c700 1 --2- 172.21.15.80:0/3995327786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ae80734e0 0x7f4ae8071e20 secure :-1 s=THROTTLE_DONE pgs=1117 cs=0 l=1 rx=0x7f4ad800f6c0 tx=0x7f4ad800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4ae5d9b700 1 -- 172.21.15.80:0/3995327786 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ad8000960 con 0x7f4ae80734e0 2019-11-28T11:36:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4ae659c700 1 --2- 172.21.15.80:0/3995327786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ae80734e0 0x7f4ae8071e20 secure :-1 s=THROTTLE_DONE pgs=1117 cs=0 l=1 rx=0x7f4ad800f6c0 tx=0x7f4ad800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4ae659c700 1 --2- 172.21.15.80:0/3995327786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ae80734e0 0x7f4ae8071e20 secure :-1 s=THROTTLE_DONE pgs=1117 cs=0 l=1 rx=0x7f4ad800f6c0 tx=0x7f4ad800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4ae5d9b700 1 -- 172.21.15.80:0/3995327786 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad8000c90 con 0x7f4ae80734e0 2019-11-28T11:36:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4ae5d9b700 1 -- 172.21.15.80:0/3995327786 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ad8007210 con 0x7f4ae80734e0 2019-11-28T11:36:56.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4aecc7d700 1 -- 172.21.15.80:0/3995327786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ae80734e0 msgr2=0x7f4ae8071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:56.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.977+0000 7f4aecc7d700 1 --2- 172.21.15.80:0/3995327786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ae80734e0 0x7f4ae8071e20 secure :-1 s=READY pgs=1117 cs=0 l=1 rx=0x7f4ad800f6c0 tx=0x7f4ad800fa60).stop 2019-11-28T11:36:56.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.978+0000 7f4aecc7d700 1 -- 172.21.15.80:0/3995327786 shutdown_connections 2019-11-28T11:36:56.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.978+0000 7f4aecc7d700 1 --2- 172.21.15.80:0/3995327786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ae80734e0 0x7f4ae8071e20 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:56.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.978+0000 7f4aecc7d700 1 --2- 172.21.15.80:0/3995327786 >> v2:172.21.15.174:3300/0 conn(0x7f4ae806c0a0 0x7f4ae8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:56.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.978+0000 7f4aecc7d700 1 -- 172.21.15.80:0/3995327786 shutdown_connections 2019-11-28T11:36:56.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.978+0000 7f4aecc7d700 1 -- 172.21.15.80:0/3995327786 wait complete. 2019-11-28T11:36:56.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.978+0000 7f4aecc7d700 1 -- 172.21.15.80:0/3995327786 >> 172.21.15.80:0/3995327786 conn(0x7f4ae8061cf0 msgr2=0x7f4ae8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:56.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.980+0000 7f4aecc7d700 1 Processor -- start 2019-11-28T11:36:56.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.980+0000 7f4aecc7d700 1 -- start start 2019-11-28T11:36:56.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.981+0000 7f4aecc7d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ae815fdf0 0x7f4ae812b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:56.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.981+0000 7f4aecc7d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae813eb20 con 0x7f4ae812a3c0 2019-11-28T11:36:56.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.981+0000 7f4aecc7d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae8139e00 con 0x7f4ae812b8a0 2019-11-28T11:36:56.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.981+0000 7f4aecc7d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae8107df0 con 0x7f4ae815fdf0 2019-11-28T11:36:56.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.981+0000 7f4ae759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4ae812a3c0 0x7f4ae812a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36138/0 (socket says 172.21.15.80:36138) 2019-11-28T11:36:56.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.981+0000 7f4ae759e700 1 -- 172.21.15.80:0/3706688875 learned_addr learned my addr 172.21.15.80:0/3706688875 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:56.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4ae6d9d700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ae815fdf0 0x7f4ae812b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:56.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494213036 0 0) 0x7f4ae0000f80 con 0x7f4ae812a3c0 2019-11-28T11:36:56.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ac0002e80 con 0x7f4ae812a3c0 2019-11-28T11:36:56.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492705803 0 0) 0x7f4ad8007580 con 0x7f4ae812b8a0 2019-11-28T11:36:56.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ac00030b0 con 0x7f4ae812b8a0 2019-11-28T11:36:56.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1177862333 0 0) 0x7f4ae0000940 con 0x7f4ae812a3c0 2019-11-28T11:36:56.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4ac00033c0 con 0x7f4ae812a3c0 2019-11-28T11:36:56.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f4ae0001760 con 0x7f4ae812a3c0 2019-11-28T11:36:56.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ae815fdf0 msgr2=0x7f4ae812b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:56.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ae815fdf0 0x7f4ae812b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:56.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 >> v1:172.21.15.174:6789/0 conn(0x7f4ae812b8a0 legacy=0x7f4ae813e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:56.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 >> v1:172.21.15.80:6789/0 conn(0x7f4ae812a3c0 legacy=0x7f4ae812a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:56.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ac0005c70 0x7f4ac0006060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:56.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac00046f0 0x7f4ac0004b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:56.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac0005080 0x7f4ac0003480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:56.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac00039c0 con 0x7f4ac0005080 2019-11-28T11:36:56.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac0003bf0 con 0x7f4ac0005c70 2019-11-28T11:36:56.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac0003e20 con 0x7f4ac00046f0 2019-11-28T11:36:56.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4ae6d9d700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ae815fdf0 0x7f4ae812b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:56.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4ae759e700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac0005080 0x7f4ac0003480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:56.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4ae659c700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac00046f0 0x7f4ac0004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:56.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4ae6d9d700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ac0005c70 0x7f4ac0006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:56.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4ae759e700 1 -- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac00046f0 msgr2=0x7f4ac0004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:56.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4ae759e700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ac00046f0 0x7f4ac0004b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:56.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4ae759e700 1 -- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ac0005c70 msgr2=0x7f4ac0006060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:56.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4ae759e700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ac0005c70 0x7f4ac0006060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:56.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4ae759e700 1 -- 172.21.15.80:0/3706688875 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac00040d0 con 0x7f4ac0005080 2019-11-28T11:36:56.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4aecc7d700 1 -- 172.21.15.80:0/3706688875 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae810a8c0 con 0x7f4ac0005080 2019-11-28T11:36:56.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4ae759e700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac0005080 0x7f4ac0003480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4ae0010420 tx=0x7f4ae00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4ae6d9d700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ac0005c70 0x7f4ac0006060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:36:56.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4aecc7d700 1 -- 172.21.15.80:0/3706688875 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae8109180 con 0x7f4ac0005080 2019-11-28T11:36:56.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4ae759e700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac0005080 0x7f4ac0003480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4ae0010420 tx=0x7f4ae00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.982+0000 7f4ae759e700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac0005080 0x7f4ac0003480 secure :-1 s=READY pgs=1119 cs=0 l=1 rx=0x7f4ae0010420 tx=0x7f4ae00102a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:56.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.983+0000 7f4ae759e700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac0005080 0x7f4ac0003480 secure :-1 s=THROTTLE_DONE pgs=1119 cs=0 l=1 rx=0x7f4ae0010420 tx=0x7f4ae00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.983+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ae0001980 con 0x7f4ac0005080 2019-11-28T11:36:56.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.983+0000 7f4ae759e700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac0005080 0x7f4ac0003480 secure :-1 s=THROTTLE_DONE pgs=1119 cs=0 l=1 rx=0x7f4ae0010420 tx=0x7f4ae00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.983+0000 7f4ae759e700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac0005080 0x7f4ac0003480 secure :-1 s=THROTTLE_DONE pgs=1119 cs=0 l=1 rx=0x7f4ae0010420 tx=0x7f4ae00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.983+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae0004430 con 0x7f4ac0005080 2019-11-28T11:36:56.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.983+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ae0001980 con 0x7f4ac0005080 2019-11-28T11:36:56.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.983+0000 7f4ae759e700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac0005080 0x7f4ac0003480 secure :-1 s=THROTTLE_DONE pgs=1119 cs=0 l=1 rx=0x7f4ae0010420 tx=0x7f4ae00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.983+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4ae0001980 con 0x7f4ac0005080 2019-11-28T11:36:56.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.983+0000 7f4ae759e700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac0005080 0x7f4ac0003480 secure :-1 s=THROTTLE_DONE pgs=1119 cs=0 l=1 rx=0x7f4ae0010420 tx=0x7f4ae00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.983+0000 7f4adf7fe700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ac0024fa0 0x7f4ac00273d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:56.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.983+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f4ae0031c40 con 0x7f4ac0005080 2019-11-28T11:36:56.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.983+0000 7f4ae6d9d700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ac0024fa0 0x7f4ac00273d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:56.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.984+0000 7f4ae6d9d700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ac0024fa0 0x7f4ac00273d0 crc :-1 s=READY pgs=455 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:56.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.990+0000 7f4aecc7d700 1 -- 172.21.15.80:0/3706688875 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae8109500 con 0x7f4ac0005080 2019-11-28T11:36:56.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.994+0000 7f4ae759e700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac0005080 0x7f4ac0003480 secure :-1 s=THROTTLE_DONE pgs=1119 cs=0 l=1 rx=0x7f4ae0010420 tx=0x7f4ae00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:55.994+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4ae0000990 con 0x7f4ac0005080 2019-11-28T11:36:56.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.165+0000 7f4aecc7d700 1 -- 172.21.15.80:0/3706688875 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ae8109180 con 0x7f4ac0005080 2019-11-28T11:36:56.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.165+0000 7f4ae759e700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac0005080 0x7f4ac0003480 secure :-1 s=THROTTLE_DONE pgs=1119 cs=0 l=1 rx=0x7f4ae0010420 tx=0x7f4ae00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.166+0000 7f4adf7fe700 1 -- 172.21.15.80:0/3706688875 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+1427 (secure 0 0 0) 0x7f4ae001fe10 con 0x7f4ac0005080 2019-11-28T11:36:56.231 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 54 2019-11-28T11:36:56.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.168+0000 7f4aecc7d700 1 -- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ac0024fa0 msgr2=0x7f4ac00273d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:56.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.168+0000 7f4aecc7d700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ac0024fa0 0x7f4ac00273d0 crc :-1 s=READY pgs=455 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:56.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.168+0000 7f4aecc7d700 1 -- 172.21.15.80:0/3706688875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac0005080 msgr2=0x7f4ac0003480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:56.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.168+0000 7f4aecc7d700 1 --2- 172.21.15.80:0/3706688875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ac0005080 0x7f4ac0003480 secure :-1 s=READY pgs=1119 cs=0 l=1 rx=0x7f4ae0010420 tx=0x7f4ae00102a0).stop 2019-11-28T11:36:56.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.168+0000 7f4ae759e700 1 -- 172.21.15.80:0/3706688875 reap_dead start 2019-11-28T11:36:56.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.168+0000 7f4ae759e700 1 -- 172.21.15.80:0/3706688875 reap_dead start 2019-11-28T11:36:56.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.168+0000 7f4aecc7d700 1 -- 172.21.15.80:0/3706688875 shutdown_connections 2019-11-28T11:36:56.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.168+0000 7f4aecc7d700 1 -- 172.21.15.80:0/3706688875 shutdown_connections 2019-11-28T11:36:56.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.168+0000 7f4aecc7d700 1 -- 172.21.15.80:0/3706688875 wait complete. 2019-11-28T11:36:56.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.168+0000 7f4aecc7d700 1 -- 172.21.15.80:0/3706688875 >> 172.21.15.80:0/3706688875 conn(0x7f4ae8127dc0 msgr2=0x7f4ae8141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:56.237 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:36:56.238 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":54,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:32:59.044350+0000","modified":"2019-11-28T11:36:55.795838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2019-11-28T11:36:56.240 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:36:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.310+0000 7fc0fbaac700 1 Processor -- start 2019-11-28T11:36:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.310+0000 7fc0fbaac700 1 -- start start 2019-11-28T11:36:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fbaac700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f406c0a0 0x7fc0f4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fbaac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0f4072620 0x7fc0f4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fbaac700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f406db00 con 0x7fc0f40734e0 2019-11-28T11:36:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fbaac700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f406f330 con 0x7fc0f4072620 2019-11-28T11:36:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fbaac700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f40706c0 con 0x7fc0f406c0a0 2019-11-28T11:36:56.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fa84a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0f4072620 0x7fc0f4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:56.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0f9848700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc0f40734e0 0x7fc0f4071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36154/0 (socket says 172.21.15.80:36154) 2019-11-28T11:36:56.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fa84a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0f4072620 0x7fc0f4164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36836/0 (socket says 172.21.15.80:36836) 2019-11-28T11:36:56.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fa84a700 1 -- 172.21.15.80:0/4002794664 learned_addr learned my addr 172.21.15.80:0/4002794664 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:56.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fa049700 1 --2- 172.21.15.80:0/4002794664 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f406c0a0 0x7fc0f4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:56.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fa84a700 1 -- 172.21.15.80:0/4002794664 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f406c0a0 msgr2=0x7fc0f4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:56.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fa84a700 1 --2- 172.21.15.80:0/4002794664 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f406c0a0 0x7fc0f4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:56.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fa84a700 1 -- 172.21.15.80:0/4002794664 >> v1:172.21.15.80:6789/0 conn(0x7fc0f40734e0 legacy=0x7fc0f4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:56.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fa84a700 1 -- 172.21.15.80:0/4002794664 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f4070a40 con 0x7fc0f4072620 2019-11-28T11:36:56.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0f9047700 1 -- 172.21.15.80:0/4002794664 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125362986 0 0) 0x7fc0e4001070 con 0x7fc0f40734e0 2019-11-28T11:36:56.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fa84a700 1 --2- 172.21.15.80:0/4002794664 >> v2:172.21.15.80:3300/0 conn(0x7fc0f4072620 0x7fc0f4164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc0ec00f6b0 tx=0x7fc0ec00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fa84a700 1 --2- 172.21.15.80:0/4002794664 >> v2:172.21.15.80:3300/0 conn(0x7fc0f4072620 0x7fc0f4164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc0ec00f6b0 tx=0x7fc0ec00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fa84a700 1 --2- 172.21.15.80:0/4002794664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f4072620 0x7fc0f4164d70 secure :-1 s=READY pgs=1121 cs=0 l=1 rx=0x7fc0ec00f6b0 tx=0x7fc0ec00fa50).ready entity=mon.0 client_cookie=aa8f9910c8d86c69 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:56.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fa84a700 1 --2- 172.21.15.80:0/4002794664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f4072620 0x7fc0f4164d70 secure :-1 s=THROTTLE_DONE pgs=1121 cs=0 l=1 rx=0x7fc0ec00f6b0 tx=0x7fc0ec00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0f9047700 1 -- 172.21.15.80:0/4002794664 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0ec000a70 con 0x7fc0f4072620 2019-11-28T11:36:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fa84a700 1 --2- 172.21.15.80:0/4002794664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f4072620 0x7fc0f4164d70 secure :-1 s=THROTTLE_DONE pgs=1121 cs=0 l=1 rx=0x7fc0ec00f6b0 tx=0x7fc0ec00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0fa84a700 1 --2- 172.21.15.80:0/4002794664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f4072620 0x7fc0f4164d70 secure :-1 s=THROTTLE_DONE pgs=1121 cs=0 l=1 rx=0x7fc0ec00f6b0 tx=0x7fc0ec00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0f9047700 1 -- 172.21.15.80:0/4002794664 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ec0010e0 con 0x7fc0f4072620 2019-11-28T11:36:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.311+0000 7fc0f9047700 1 -- 172.21.15.80:0/4002794664 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0ec0012d0 con 0x7fc0f4072620 2019-11-28T11:36:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.312+0000 7fc0fbaac700 1 -- 172.21.15.80:0/4002794664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f4072620 msgr2=0x7fc0f4164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.312+0000 7fc0fbaac700 1 --2- 172.21.15.80:0/4002794664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f4072620 0x7fc0f4164d70 secure :-1 s=READY pgs=1121 cs=0 l=1 rx=0x7fc0ec00f6b0 tx=0x7fc0ec00fa50).stop 2019-11-28T11:36:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.312+0000 7fc0fbaac700 1 -- 172.21.15.80:0/4002794664 shutdown_connections 2019-11-28T11:36:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.312+0000 7fc0fbaac700 1 --2- 172.21.15.80:0/4002794664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f4072620 0x7fc0f4164d70 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.312+0000 7fc0fbaac700 1 --2- 172.21.15.80:0/4002794664 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f406c0a0 0x7fc0f4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.312+0000 7fc0fbaac700 1 -- 172.21.15.80:0/4002794664 shutdown_connections 2019-11-28T11:36:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.312+0000 7fc0fbaac700 1 -- 172.21.15.80:0/4002794664 wait complete. 2019-11-28T11:36:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.312+0000 7fc0fbaac700 1 -- 172.21.15.80:0/4002794664 >> 172.21.15.80:0/4002794664 conn(0x7fc0f4061cf0 msgr2=0x7fc0f4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.315+0000 7fc0fbaac700 1 Processor -- start 2019-11-28T11:36:56.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.315+0000 7fc0fbaac700 1 -- start start 2019-11-28T11:36:56.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fbaac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0f413e5f0 0x7fc0f413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:56.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fbaac700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc0f410a070 0x7fc0f410bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:56.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fbaac700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f410a4e0 0x7fc0f410c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:56.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fbaac700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f410e060 con 0x7fc0f413e5f0 2019-11-28T11:36:56.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fbaac700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f410e330 con 0x7fc0f410a070 2019-11-28T11:36:56.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fbaac700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f410d630 con 0x7fc0f410a4e0 2019-11-28T11:36:56.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fa049700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0f413e5f0 0x7fc0f413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:56.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fa049700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0f413e5f0 0x7fc0f413e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36840/0 (socket says 172.21.15.80:36840) 2019-11-28T11:36:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fa049700 1 -- 172.21.15.80:0/3709643136 learned_addr learned my addr 172.21.15.80:0/3709643136 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fa84a700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f410a4e0 0x7fc0f410c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0f9848700 1 --2- 172.21.15.80:0/3709643136 >> v2:172.21.15.174:3300/0 conn(0x7fc0f410a070 0x7fc0f410bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fa049700 1 -- 172.21.15.80:0/3709643136 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f410a4e0 msgr2=0x7fc0f410c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fa049700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f410a4e0 0x7fc0f410c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fa049700 1 -- 172.21.15.80:0/3709643136 >> v2:172.21.15.174:3300/0 conn(0x7fc0f410a070 msgr2=0x7fc0f410bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fa049700 1 --2- 172.21.15.80:0/3709643136 >> v2:172.21.15.174:3300/0 conn(0x7fc0f410a070 0x7fc0f410bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:56.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fa049700 1 -- 172.21.15.80:0/3709643136 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f410e9c0 con 0x7fc0f413e5f0 2019-11-28T11:36:56.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0f9848700 1 --2- 172.21.15.80:0/3709643136 >> v2:172.21.15.174:3300/0 conn(0x7fc0f410a070 0x7fc0f410bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:36:56.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fa049700 1 --2- 172.21.15.80:0/3709643136 >> v2:172.21.15.80:3300/0 conn(0x7fc0f413e5f0 0x7fc0f413e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc0dc010780 tx=0x7fc0dc010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fa049700 1 --2- 172.21.15.80:0/3709643136 >> v2:172.21.15.80:3300/0 conn(0x7fc0f413e5f0 0x7fc0f413e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc0dc010780 tx=0x7fc0dc010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fa049700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f413e5f0 0x7fc0f413e9e0 secure :-1 s=READY pgs=1122 cs=0 l=1 rx=0x7fc0dc010780 tx=0x7fc0dc010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:56.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fa049700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f413e5f0 0x7fc0f413e9e0 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7fc0dc010780 tx=0x7fc0dc010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fa049700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f413e5f0 0x7fc0f413e9e0 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7fc0dc010780 tx=0x7fc0dc010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fa049700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f413e5f0 0x7fc0f413e9e0 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7fc0dc010780 tx=0x7fc0dc010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0f2ffd700 1 -- 172.21.15.80:0/3709643136 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0dc000cc0 con 0x7fc0f413e5f0 2019-11-28T11:36:56.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0f2ffd700 1 -- 172.21.15.80:0/3709643136 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0dc001410 con 0x7fc0f413e5f0 2019-11-28T11:36:56.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fbaac700 1 -- 172.21.15.80:0/3709643136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f410ed40 con 0x7fc0f413e5f0 2019-11-28T11:36:56.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0f2ffd700 1 -- 172.21.15.80:0/3709643136 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0dc001a20 con 0x7fc0f413e5f0 2019-11-28T11:36:56.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.316+0000 7fc0fbaac700 1 -- 172.21.15.80:0/3709643136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f410e9c0 con 0x7fc0f413e5f0 2019-11-28T11:36:56.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.317+0000 7fc0fa049700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f413e5f0 0x7fc0f413e9e0 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7fc0dc010780 tx=0x7fc0dc010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.317+0000 7fc0f2ffd700 1 -- 172.21.15.80:0/3709643136 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc0dc001010 con 0x7fc0f413e5f0 2019-11-28T11:36:56.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.317+0000 7fc0fa049700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f413e5f0 0x7fc0f413e9e0 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7fc0dc010780 tx=0x7fc0dc010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.317+0000 7fc0f2ffd700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0d8018730 0x7fc0d801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:56.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.317+0000 7fc0f2ffd700 1 -- 172.21.15.80:0/3709643136 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fc0dc031d60 con 0x7fc0f413e5f0 2019-11-28T11:36:56.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.318+0000 7fc0f9848700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0d8018730 0x7fc0d801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:56.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.318+0000 7fc0f9848700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0d8018730 0x7fc0d801abc0 crc :-1 s=READY pgs=456 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:56.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.325+0000 7fc0fbaac700 1 -- 172.21.15.80:0/3709643136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f410ed40 con 0x7fc0f413e5f0 2019-11-28T11:36:56.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.328+0000 7fc0fa049700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f413e5f0 0x7fc0f413e9e0 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7fc0dc010780 tx=0x7fc0dc010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.328+0000 7fc0f2ffd700 1 -- 172.21.15.80:0/3709643136 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc0dc000cc0 con 0x7fc0f413e5f0 2019-11-28T11:36:56.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.502+0000 7fc0fbaac700 1 -- 172.21.15.80:0/3709643136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc0f410e9c0 con 0x7fc0f413e5f0 2019-11-28T11:36:56.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.810+0000 7fc0fa049700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f413e5f0 0x7fc0f413e9e0 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7fc0dc010780 tx=0x7fc0dc010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:56.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.810+0000 7fc0f2ffd700 1 -- 172.21.15.80:0/3709643136 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v55) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc0dc001010 con 0x7fc0f413e5f0 2019-11-28T11:36:56.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.819+0000 7fc0fbaac700 1 -- 172.21.15.80:0/3709643136 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0d8018730 msgr2=0x7fc0d801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:56.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.819+0000 7fc0fbaac700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0d8018730 0x7fc0d801abc0 crc :-1 s=READY pgs=456 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:56.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.819+0000 7fc0fbaac700 1 -- 172.21.15.80:0/3709643136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f413e5f0 msgr2=0x7fc0f413e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:56.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.819+0000 7fc0fbaac700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f413e5f0 0x7fc0f413e9e0 secure :-1 s=READY pgs=1122 cs=0 l=1 rx=0x7fc0dc010780 tx=0x7fc0dc010600).stop 2019-11-28T11:36:56.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.819+0000 7fc0fbaac700 1 -- 172.21.15.80:0/3709643136 shutdown_connections 2019-11-28T11:36:56.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.819+0000 7fc0fbaac700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0d8018730 0x7fc0d801abc0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:56.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.819+0000 7fc0fbaac700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f410a4e0 0x7fc0f410c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:56.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.819+0000 7fc0fbaac700 1 --2- 172.21.15.80:0/3709643136 >> v2:172.21.15.174:3300/0 conn(0x7fc0f410a070 0x7fc0f410bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:56.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.819+0000 7fc0fbaac700 1 --2- 172.21.15.80:0/3709643136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f413e5f0 0x7fc0f413e9e0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:56.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.819+0000 7fc0fbaac700 1 -- 172.21.15.80:0/3709643136 shutdown_connections 2019-11-28T11:36:56.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.819+0000 7fc0fbaac700 1 -- 172.21.15.80:0/3709643136 wait complete. 2019-11-28T11:36:56.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.819+0000 7fc0fbaac700 1 -- 172.21.15.80:0/3709643136 >> 172.21.15.80:0/3709643136 conn(0x7fc0f413d620 msgr2=0x7fc0f413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:56.890 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:36:57.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.953+0000 7f6a34923700 1 Processor -- start 2019-11-28T11:36:57.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.953+0000 7f6a34923700 1 -- start start 2019-11-28T11:36:57.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.954+0000 7f6a34923700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a3015f100 0x7f6a3006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:57.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.954+0000 7f6a34923700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6a3006c2f0 0x7f6a3006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:57.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.954+0000 7f6a34923700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3006db60 con 0x7f6a3015ed10 2019-11-28T11:36:57.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.954+0000 7f6a34923700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3006fe00 con 0x7f6a3015f100 2019-11-28T11:36:57.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.954+0000 7f6a34923700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a300700d0 con 0x7f6a3006c2f0 2019-11-28T11:36:57.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.954+0000 7f6a2e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a3015f100 0x7f6a3006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:57.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6a3015ed10 0x7f6a30073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36164/0 (socket says 172.21.15.80:36164) 2019-11-28T11:36:57.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2ed9d700 1 -- 172.21.15.80:0/3129347180 learned_addr learned my addr 172.21.15.80:0/3129347180 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:57.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2f59e700 1 --2- 172.21.15.80:0/3129347180 >> v2:172.21.15.174:3300/0 conn(0x7f6a3006c2f0 0x7f6a3006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:57.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2e59c700 1 -- 172.21.15.80:0/3129347180 >> v2:172.21.15.174:3300/0 conn(0x7f6a3006c2f0 msgr2=0x7f6a3006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:57.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/3129347180 >> v2:172.21.15.174:3300/0 conn(0x7f6a3006c2f0 0x7f6a3006c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:57.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2e59c700 1 -- 172.21.15.80:0/3129347180 >> v1:172.21.15.80:6789/0 conn(0x7f6a3015ed10 legacy=0x7f6a30073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:57.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2dd9b700 1 -- 172.21.15.80:0/3129347180 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274858126 0 0) 0x7f6a180014d0 con 0x7f6a3015ed10 2019-11-28T11:36:57.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2e59c700 1 -- 172.21.15.80:0/3129347180 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a30070760 con 0x7f6a3015f100 2019-11-28T11:36:57.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2f59e700 1 --2- 172.21.15.80:0/3129347180 >> v2:172.21.15.174:3300/0 conn(0x7f6a3006c2f0 0x7f6a3006c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:36:57.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/3129347180 >> v2:172.21.15.80:3300/0 conn(0x7f6a3015f100 0x7f6a3006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6a2000af50 tx=0x7f6a2000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:57.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/3129347180 >> v2:172.21.15.80:3300/0 conn(0x7f6a3015f100 0x7f6a3006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6a2000af50 tx=0x7f6a2000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:57.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/3129347180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3015f100 0x7f6a3006bdb0 secure :-1 s=READY pgs=1124 cs=0 l=1 rx=0x7f6a2000af50 tx=0x7f6a2000b760).ready entity=mon.0 client_cookie=67dfca3c8b2f1dc8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:57.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/3129347180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3015f100 0x7f6a3006bdb0 secure :-1 s=THROTTLE_DONE pgs=1124 cs=0 l=1 rx=0x7f6a2000af50 tx=0x7f6a2000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:57.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2dd9b700 1 -- 172.21.15.80:0/3129347180 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a20007210 con 0x7f6a3015f100 2019-11-28T11:36:57.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/3129347180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3015f100 0x7f6a3006bdb0 secure :-1 s=THROTTLE_DONE pgs=1124 cs=0 l=1 rx=0x7f6a2000af50 tx=0x7f6a2000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:57.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/3129347180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3015f100 0x7f6a3006bdb0 secure :-1 s=THROTTLE_DONE pgs=1124 cs=0 l=1 rx=0x7f6a2000af50 tx=0x7f6a2000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:57.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2dd9b700 1 -- 172.21.15.80:0/3129347180 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a200099b0 con 0x7f6a3015f100 2019-11-28T11:36:57.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a2dd9b700 1 -- 172.21.15.80:0/3129347180 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a2000a080 con 0x7f6a3015f100 2019-11-28T11:36:57.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a34923700 1 -- 172.21.15.80:0/3129347180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3015f100 msgr2=0x7f6a3006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:57.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.955+0000 7f6a34923700 1 --2- 172.21.15.80:0/3129347180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3015f100 0x7f6a3006bdb0 secure :-1 s=READY pgs=1124 cs=0 l=1 rx=0x7f6a2000af50 tx=0x7f6a2000b760).stop 2019-11-28T11:36:57.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.956+0000 7f6a34923700 1 -- 172.21.15.80:0/3129347180 shutdown_connections 2019-11-28T11:36:57.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.956+0000 7f6a34923700 1 --2- 172.21.15.80:0/3129347180 >> v2:172.21.15.174:3300/0 conn(0x7f6a3006c2f0 0x7f6a3006c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:57.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.956+0000 7f6a34923700 1 --2- 172.21.15.80:0/3129347180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3015f100 0x7f6a3006bdb0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:57.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.956+0000 7f6a34923700 1 -- 172.21.15.80:0/3129347180 shutdown_connections 2019-11-28T11:36:57.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.956+0000 7f6a34923700 1 -- 172.21.15.80:0/3129347180 wait complete. 2019-11-28T11:36:57.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.956+0000 7f6a34923700 1 -- 172.21.15.80:0/3129347180 >> 172.21.15.80:0/3129347180 conn(0x7f6a30061d20 msgr2=0x7f6a300641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:57.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.958+0000 7f6a34923700 1 Processor -- start 2019-11-28T11:36:57.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.958+0000 7f6a34923700 1 -- start start 2019-11-28T11:36:57.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.959+0000 7f6a34923700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a3010e970 0x7f6a301087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:57.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.959+0000 7f6a34923700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a30108cf0 0x7f6a30107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:57.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.959+0000 7f6a34923700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3010c250 con 0x7f6a30107b70 2019-11-28T11:36:57.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.959+0000 7f6a34923700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3010da00 con 0x7f6a30108cf0 2019-11-28T11:36:57.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.959+0000 7f6a34923700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3010e430 con 0x7f6a3010e970 2019-11-28T11:36:57.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.959+0000 7f6a2f59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6a30107b70 0x7f6a3010ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36174/0 (socket says 172.21.15.80:36174) 2019-11-28T11:36:57.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.959+0000 7f6a2f59e700 1 -- 172.21.15.80:0/245529297 learned_addr learned my addr 172.21.15.80:0/245529297 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:57.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.959+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/245529297 >> v2:172.21.15.80:3300/0 conn(0x7f6a30108cf0 0x7f6a30107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:57.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.959+0000 7f6a2ed9d700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a3010e970 0x7f6a301087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:57.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a277fe700 1 -- 172.21.15.80:0/245529297 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4068560831 0 0) 0x7f6a28009b10 con 0x7f6a30107b70 2019-11-28T11:36:57.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a277fe700 1 -- 172.21.15.80:0/245529297 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a08002e80 con 0x7f6a30107b70 2019-11-28T11:36:57.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a2e59c700 1 -- 172.21.15.80:0/245529297 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a3010e970 msgr2=0x7f6a301087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:57.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a3010e970 0x7f6a301087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:57.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a2e59c700 1 -- 172.21.15.80:0/245529297 >> v1:172.21.15.80:6789/0 conn(0x7f6a30107b70 legacy=0x7f6a3010ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:57.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a2e59c700 1 -- 172.21.15.80:0/245529297 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a30105ef0 con 0x7f6a30108cf0 2019-11-28T11:36:57.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/245529297 >> v2:172.21.15.80:3300/0 conn(0x7f6a30108cf0 0x7f6a30107630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6a20010370 tx=0x7f6a200101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:57.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/245529297 >> v2:172.21.15.80:3300/0 conn(0x7f6a30108cf0 0x7f6a30107630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6a20010370 tx=0x7f6a200101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:57.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a30108cf0 0x7f6a30107630 secure :-1 s=READY pgs=1126 cs=0 l=1 rx=0x7f6a20010370 tx=0x7f6a200101f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:57.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a30108cf0 0x7f6a30107630 secure :-1 s=THROTTLE_DONE pgs=1126 cs=0 l=1 rx=0x7f6a20010370 tx=0x7f6a200101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:57.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a277fe700 1 -- 172.21.15.80:0/245529297 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a20009960 con 0x7f6a30108cf0 2019-11-28T11:36:57.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a30108cf0 0x7f6a30107630 secure :-1 s=THROTTLE_DONE pgs=1126 cs=0 l=1 rx=0x7f6a20010370 tx=0x7f6a200101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:57.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a30108cf0 0x7f6a30107630 secure :-1 s=THROTTLE_DONE pgs=1126 cs=0 l=1 rx=0x7f6a20010370 tx=0x7f6a200101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:57.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a277fe700 1 -- 172.21.15.80:0/245529297 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a20009580 con 0x7f6a30108cf0 2019-11-28T11:36:57.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a34923700 1 -- 172.21.15.80:0/245529297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a30106270 con 0x7f6a30108cf0 2019-11-28T11:36:57.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a277fe700 1 -- 172.21.15.80:0/245529297 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a20009f40 con 0x7f6a30108cf0 2019-11-28T11:36:57.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a34923700 1 -- 172.21.15.80:0/245529297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a30105ef0 con 0x7f6a30108cf0 2019-11-28T11:36:57.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.960+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a30108cf0 0x7f6a30107630 secure :-1 s=THROTTLE_DONE pgs=1126 cs=0 l=1 rx=0x7f6a20010370 tx=0x7f6a200101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:57.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.961+0000 7f6a277fe700 1 -- 172.21.15.80:0/245529297 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6a20009770 con 0x7f6a30108cf0 2019-11-28T11:36:57.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.961+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a30108cf0 0x7f6a30107630 secure :-1 s=THROTTLE_DONE pgs=1126 cs=0 l=1 rx=0x7f6a20010370 tx=0x7f6a200101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:57.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.961+0000 7f6a277fe700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a08018770 0x7f6a0801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:57.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.961+0000 7f6a277fe700 1 -- 172.21.15.80:0/245529297 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f6a200319c0 con 0x7f6a30108cf0 2019-11-28T11:36:57.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.961+0000 7f6a2ed9d700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a08018770 0x7f6a0801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:57.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.961+0000 7f6a2ed9d700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a08018770 0x7f6a0801abe0 crc :-1 s=READY pgs=457 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:57.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.969+0000 7f6a34923700 1 -- 172.21.15.80:0/245529297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a30106270 con 0x7f6a30108cf0 2019-11-28T11:36:57.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.972+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a30108cf0 0x7f6a30107630 secure :-1 s=THROTTLE_DONE pgs=1126 cs=0 l=1 rx=0x7f6a20010370 tx=0x7f6a200101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:57.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:56.972+0000 7f6a277fe700 1 -- 172.21.15.80:0/245529297 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6a2002cf40 con 0x7f6a30108cf0 2019-11-28T11:36:57.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.141+0000 7f6a34923700 1 -- 172.21.15.80:0/245529297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6a30105ef0 con 0x7f6a30108cf0 2019-11-28T11:36:57.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.815+0000 7f6a2e59c700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a30108cf0 0x7f6a30107630 secure :-1 s=THROTTLE_DONE pgs=1126 cs=0 l=1 rx=0x7f6a20010370 tx=0x7f6a200101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:57.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.815+0000 7f6a277fe700 1 -- 172.21.15.80:0/245529297 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) v1 ==== 185+0+0 (secure 0 0 0) 0x7f6a2002cf40 con 0x7f6a30108cf0 2019-11-28T11:36:57.916 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:36:57.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.858+0000 7f6a34923700 1 -- 172.21.15.80:0/245529297 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a08018770 msgr2=0x7f6a0801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:57.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.858+0000 7f6a34923700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a08018770 0x7f6a0801abe0 crc :-1 s=READY pgs=457 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:57.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.858+0000 7f6a34923700 1 -- 172.21.15.80:0/245529297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a30108cf0 msgr2=0x7f6a30107630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:57.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.858+0000 7f6a34923700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a30108cf0 0x7f6a30107630 secure :-1 s=READY pgs=1126 cs=0 l=1 rx=0x7f6a20010370 tx=0x7f6a200101f0).stop 2019-11-28T11:36:57.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.858+0000 7f6a34923700 1 -- 172.21.15.80:0/245529297 shutdown_connections 2019-11-28T11:36:57.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.858+0000 7f6a34923700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a08018770 0x7f6a0801abe0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:57.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.858+0000 7f6a34923700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a30108cf0 0x7f6a30107630 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:57.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.858+0000 7f6a34923700 1 --2- 172.21.15.80:0/245529297 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a3010e970 0x7f6a301087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:57.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.859+0000 7f6a34923700 1 -- 172.21.15.80:0/245529297 shutdown_connections 2019-11-28T11:36:57.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.859+0000 7f6a34923700 1 -- 172.21.15.80:0/245529297 wait complete. 2019-11-28T11:36:57.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.859+0000 7f6a34923700 1 -- 172.21.15.80:0/245529297 >> 172.21.15.80:0/245529297 conn(0x7f6a3015e2d0 msgr2=0x7f6a30147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:57.929 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:36:58.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.994+0000 7f6768b7e700 1 Processor -- start 2019-11-28T11:36:58.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.994+0000 7f6768b7e700 1 -- start start 2019-11-28T11:36:58.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.995+0000 7f6768b7e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f676415ed10 0x7f676415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:58.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.995+0000 7f6768b7e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676406db60 con 0x7f6764073020 2019-11-28T11:36:58.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.995+0000 7f6768b7e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676406e060 con 0x7f67640734b0 2019-11-28T11:36:58.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.995+0000 7f6768b7e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676406fe00 con 0x7f676415ed10 2019-11-28T11:36:58.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.995+0000 7f676259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6764073020 0x7f6764071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36182/0 (socket says 172.21.15.80:36182) 2019-11-28T11:36:58.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.995+0000 7f676259c700 1 -- 172.21.15.80:0/2006165875 learned_addr learned my addr 172.21.15.80:0/2006165875 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:58.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.995+0000 7f6762d9d700 1 --2- 172.21.15.80:0/2006165875 >> v2:172.21.15.174:3300/0 conn(0x7f676415ed10 0x7f676415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:58.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.995+0000 7f6761d9b700 1 -- 172.21.15.80:0/2006165875 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637951904 0 0) 0x7f6754001070 con 0x7f6764073020 2019-11-28T11:36:58.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.995+0000 7f6761d9b700 1 -- 172.21.15.80:0/2006165875 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6744002e80 con 0x7f6764073020 2019-11-28T11:36:58.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.995+0000 7f6762d9d700 1 -- 172.21.15.80:0/2006165875 >> v1:172.21.15.174:6789/0 conn(0x7f67640734b0 legacy=0x7f67640726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:58.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.995+0000 7f6761d9b700 1 -- 172.21.15.80:0/2006165875 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1165448705 0 0) 0x7f6754001050 con 0x7f6764073020 2019-11-28T11:36:58.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.995+0000 7f6762d9d700 1 -- 172.21.15.80:0/2006165875 >> v1:172.21.15.80:6789/0 conn(0x7f6764073020 legacy=0x7f6764071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:58.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.995+0000 7f6762d9d700 1 -- 172.21.15.80:0/2006165875 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6764070760 con 0x7f676415ed10 2019-11-28T11:36:58.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.996+0000 7f6762d9d700 1 --2- 172.21.15.80:0/2006165875 >> v2:172.21.15.174:3300/0 conn(0x7f676415ed10 0x7f676415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f674c00b2d0 tx=0x7f674c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:58.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.996+0000 7f6762d9d700 1 --2- 172.21.15.80:0/2006165875 >> v2:172.21.15.174:3300/0 conn(0x7f676415ed10 0x7f676415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f674c00b2d0 tx=0x7f674c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:58.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.996+0000 7f6762d9d700 1 --2- 172.21.15.80:0/2006165875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f676415ed10 0x7f676415f100 secure :-1 s=READY pgs=669 cs=0 l=1 rx=0x7f674c00b2d0 tx=0x7f674c00bae0).ready entity=mon.1 client_cookie=ead5e41cd5928a67 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:58.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.996+0000 7f6762d9d700 1 --2- 172.21.15.80:0/2006165875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f676415ed10 0x7f676415f100 secure :-1 s=THROTTLE_DONE pgs=669 cs=0 l=1 rx=0x7f674c00b2d0 tx=0x7f674c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:58.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.996+0000 7f6761d9b700 1 -- 172.21.15.80:0/2006165875 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674c000ce0 con 0x7f676415ed10 2019-11-28T11:36:58.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.996+0000 7f6762d9d700 1 --2- 172.21.15.80:0/2006165875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f676415ed10 0x7f676415f100 secure :-1 s=THROTTLE_DONE pgs=669 cs=0 l=1 rx=0x7f674c00b2d0 tx=0x7f674c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:58.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.996+0000 7f6762d9d700 1 --2- 172.21.15.80:0/2006165875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f676415ed10 0x7f676415f100 secure :-1 s=THROTTLE_DONE pgs=669 cs=0 l=1 rx=0x7f674c00b2d0 tx=0x7f674c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:58.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.996+0000 7f6761d9b700 1 -- 172.21.15.80:0/2006165875 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c009be0 con 0x7f676415ed10 2019-11-28T11:36:58.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.996+0000 7f6761d9b700 1 -- 172.21.15.80:0/2006165875 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674c000ce0 con 0x7f676415ed10 2019-11-28T11:36:58.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.996+0000 7f6768b7e700 1 -- 172.21.15.80:0/2006165875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f676415ed10 msgr2=0x7f676415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:58.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.996+0000 7f6768b7e700 1 --2- 172.21.15.80:0/2006165875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f676415ed10 0x7f676415f100 secure :-1 s=READY pgs=669 cs=0 l=1 rx=0x7f674c00b2d0 tx=0x7f674c00bae0).stop 2019-11-28T11:36:58.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.997+0000 7f6768b7e700 1 -- 172.21.15.80:0/2006165875 shutdown_connections 2019-11-28T11:36:58.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.997+0000 7f6768b7e700 1 --2- 172.21.15.80:0/2006165875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f676415ed10 0x7f676415f100 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:58.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.997+0000 7f6768b7e700 1 -- 172.21.15.80:0/2006165875 shutdown_connections 2019-11-28T11:36:58.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.997+0000 7f6768b7e700 1 -- 172.21.15.80:0/2006165875 wait complete. 2019-11-28T11:36:58.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.997+0000 7f6768b7e700 1 -- 172.21.15.80:0/2006165875 >> 172.21.15.80:0/2006165875 conn(0x7f6764061d20 msgr2=0x7f67640641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:58.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.999+0000 7f6768b7e700 1 Processor -- start 2019-11-28T11:36:58.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:57.999+0000 7f6768b7e700 1 -- start start 2019-11-28T11:36:58.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f6768b7e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f676410e970 0x7f67641087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:58.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f6768b7e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6764107e30 0x7f6764167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:58.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f6768b7e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676410c250 con 0x7f6764108cf0 2019-11-28T11:36:58.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f6768b7e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676410da00 con 0x7f6764107e30 2019-11-28T11:36:58.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f6768b7e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676410e430 con 0x7f676410e970 2019-11-28T11:36:58.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f676359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6764107e30 0x7f6764167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:58.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f676359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6764107e30 0x7f6764167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36870/0 (socket says 172.21.15.80:36870) 2019-11-28T11:36:58.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f676359e700 1 -- 172.21.15.80:0/143491640 learned_addr learned my addr 172.21.15.80:0/143491640 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:58.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f6762d9d700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f676410e970 0x7f67641087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:58.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f676359e700 1 -- 172.21.15.80:0/143491640 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f676410e970 msgr2=0x7f67641087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:58.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f676359e700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f676410e970 0x7f67641087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:58.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f676359e700 1 -- 172.21.15.80:0/143491640 >> v1:172.21.15.80:6789/0 conn(0x7f6764108cf0 legacy=0x7f6764107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:58.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f676359e700 1 -- 172.21.15.80:0/143491640 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6764105ef0 con 0x7f6764107e30 2019-11-28T11:36:58.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f675b7fe700 1 -- 172.21.15.80:0/143491640 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615202493 0 0) 0x7f6754001280 con 0x7f6764108cf0 2019-11-28T11:36:58.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f676359e700 1 --2- 172.21.15.80:0/143491640 >> v2:172.21.15.80:3300/0 conn(0x7f6764107e30 0x7f6764167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f675c010420 tx=0x7f675c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:58.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f676359e700 1 --2- 172.21.15.80:0/143491640 >> v2:172.21.15.80:3300/0 conn(0x7f6764107e30 0x7f6764167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f675c010420 tx=0x7f675c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:58.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f676359e700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6764107e30 0x7f6764167d70 secure :-1 s=READY pgs=1129 cs=0 l=1 rx=0x7f675c010420 tx=0x7f675c010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:58.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f676359e700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6764107e30 0x7f6764167d70 secure :-1 s=THROTTLE_DONE pgs=1129 cs=0 l=1 rx=0x7f675c010420 tx=0x7f675c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:58.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f675b7fe700 1 -- 172.21.15.80:0/143491640 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f675c000960 con 0x7f6764107e30 2019-11-28T11:36:58.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f676359e700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6764107e30 0x7f6764167d70 secure :-1 s=THROTTLE_DONE pgs=1129 cs=0 l=1 rx=0x7f675c010420 tx=0x7f675c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:58.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f6768b7e700 1 -- 172.21.15.80:0/143491640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6764106270 con 0x7f6764107e30 2019-11-28T11:36:58.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f675b7fe700 1 -- 172.21.15.80:0/143491640 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c000960 con 0x7f6764107e30 2019-11-28T11:36:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f676359e700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6764107e30 0x7f6764167d70 secure :-1 s=THROTTLE_DONE pgs=1129 cs=0 l=1 rx=0x7f675c010420 tx=0x7f675c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.000+0000 7f675b7fe700 1 -- 172.21.15.80:0/143491640 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f675c001280 con 0x7f6764107e30 2019-11-28T11:36:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.001+0000 7f6768b7e700 1 -- 172.21.15.80:0/143491640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6764105ef0 con 0x7f6764107e30 2019-11-28T11:36:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.001+0000 7f676359e700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6764107e30 0x7f6764167d70 secure :-1 s=THROTTLE_DONE pgs=1129 cs=0 l=1 rx=0x7f675c010420 tx=0x7f675c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.001+0000 7f675b7fe700 1 -- 172.21.15.80:0/143491640 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f675c000ea0 con 0x7f6764107e30 2019-11-28T11:36:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.001+0000 7f676359e700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6764107e30 0x7f6764167d70 secure :-1 s=THROTTLE_DONE pgs=1129 cs=0 l=1 rx=0x7f675c010420 tx=0x7f675c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.001+0000 7f675b7fe700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f673c018730 0x7f673c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.001+0000 7f675b7fe700 1 -- 172.21.15.80:0/143491640 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5797+0+0 (secure 0 0 0) 0x7f675c031aa0 con 0x7f6764107e30 2019-11-28T11:36:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.001+0000 7f6762d9d700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f673c018730 0x7f673c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.002+0000 7f6762d9d700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f673c018730 0x7f673c01abc0 crc :-1 s=READY pgs=458 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.009+0000 7f6768b7e700 1 -- 172.21.15.80:0/143491640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6764106270 con 0x7f6764107e30 2019-11-28T11:36:58.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.013+0000 7f676359e700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6764107e30 0x7f6764167d70 secure :-1 s=THROTTLE_DONE pgs=1129 cs=0 l=1 rx=0x7f675c010420 tx=0x7f675c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:58.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.013+0000 7f675b7fe700 1 -- 172.21.15.80:0/143491640 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f675c007590 con 0x7f6764107e30 2019-11-28T11:36:58.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.180+0000 7f6768b7e700 1 -- 172.21.15.80:0/143491640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6764105ef0 con 0x7f6764107e30 2019-11-28T11:36:58.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.819+0000 7f676359e700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6764107e30 0x7f6764167d70 secure :-1 s=THROTTLE_DONE pgs=1129 cs=0 l=1 rx=0x7f675c010420 tx=0x7f675c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:58.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.819+0000 7f675b7fe700 1 -- 172.21.15.80:0/143491640 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) v1 ==== 173+0+0 (secure 0 0 0) 0x7f675c017560 con 0x7f6764107e30 2019-11-28T11:36:58.906 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:36:58.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.848+0000 7f6768b7e700 1 -- 172.21.15.80:0/143491640 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f673c018730 msgr2=0x7f673c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.848+0000 7f6768b7e700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f673c018730 0x7f673c01abc0 crc :-1 s=READY pgs=458 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.848+0000 7f6768b7e700 1 -- 172.21.15.80:0/143491640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6764107e30 msgr2=0x7f6764167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.848+0000 7f6768b7e700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6764107e30 0x7f6764167d70 secure :-1 s=READY pgs=1129 cs=0 l=1 rx=0x7f675c010420 tx=0x7f675c010280).stop 2019-11-28T11:36:58.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.848+0000 7f6768b7e700 1 -- 172.21.15.80:0/143491640 shutdown_connections 2019-11-28T11:36:58.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.848+0000 7f6768b7e700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f673c018730 0x7f673c01abc0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:58.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.848+0000 7f6768b7e700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6764107e30 0x7f6764167d70 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:58.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.848+0000 7f6768b7e700 1 --2- 172.21.15.80:0/143491640 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f676410e970 0x7f67641087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:58.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.849+0000 7f6768b7e700 1 -- 172.21.15.80:0/143491640 shutdown_connections 2019-11-28T11:36:58.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.849+0000 7f6768b7e700 1 -- 172.21.15.80:0/143491640 wait complete. 2019-11-28T11:36:58.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:58.849+0000 7f6768b7e700 1 -- 172.21.15.80:0/143491640 >> 172.21.15.80:0/143491640 conn(0x7f676415e2d0 msgr2=0x7f6764147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:58.924 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:36:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.009+0000 7f7c13ad7700 1 Processor -- start 2019-11-28T11:36:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.009+0000 7f7c13ad7700 1 -- start start 2019-11-28T11:36:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.010+0000 7f7c13ad7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7c0c06c0a0 0x7f7c0c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.010+0000 7f7c13ad7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c0c072620 0x7f7c0c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:36:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.010+0000 7f7c13ad7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c06db00 con 0x7f7c0c0734e0 2019-11-28T11:36:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.010+0000 7f7c13ad7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0c06fd60 con 0x7f7c0c072620 2019-11-28T11:36:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.010+0000 7f7c13ad7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0c070030 con 0x7f7c0c06c0a0 2019-11-28T11:36:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.010+0000 7f7c12875700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c0c072620 0x7f7c0c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.010+0000 7f7c11873700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7c0c0734e0 0x7f7c0c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36196/0 (socket says 172.21.15.80:36196) 2019-11-28T11:36:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.010+0000 7f7c11873700 1 -- 172.21.15.80:0/1431685672 learned_addr learned my addr 172.21.15.80:0/1431685672 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:36:59.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.010+0000 7f7c12074700 1 --2- 172.21.15.80:0/1431685672 >> v2:172.21.15.174:3300/0 conn(0x7f7c0c06c0a0 0x7f7c0c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:59.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.011+0000 7f7c12875700 1 -- 172.21.15.80:0/1431685672 >> v2:172.21.15.174:3300/0 conn(0x7f7c0c06c0a0 msgr2=0x7f7c0c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:36:59.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.011+0000 7f7c12875700 1 --2- 172.21.15.80:0/1431685672 >> v2:172.21.15.174:3300/0 conn(0x7f7c0c06c0a0 0x7f7c0c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:59.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.011+0000 7f7c12875700 1 -- 172.21.15.80:0/1431685672 >> v1:172.21.15.80:6789/0 conn(0x7f7c0c0734e0 legacy=0x7f7c0c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:59.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.011+0000 7f7c11072700 1 -- 172.21.15.80:0/1431685672 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813460308 0 0) 0x7f7bf40013f0 con 0x7f7c0c0734e0 2019-11-28T11:36:59.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.011+0000 7f7c12875700 1 -- 172.21.15.80:0/1431685672 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c0706c0 con 0x7f7c0c072620 2019-11-28T11:36:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.011+0000 7f7c12875700 1 --2- 172.21.15.80:0/1431685672 >> v2:172.21.15.80:3300/0 conn(0x7f7c0c072620 0x7f7c0c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c0400af50 tx=0x7f7c0400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:59.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.011+0000 7f7c12875700 1 --2- 172.21.15.80:0/1431685672 >> v2:172.21.15.80:3300/0 conn(0x7f7c0c072620 0x7f7c0c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c0400af50 tx=0x7f7c0400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:59.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.011+0000 7f7c12875700 1 --2- 172.21.15.80:0/1431685672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c0c072620 0x7f7c0c164d70 secure :-1 s=READY pgs=1131 cs=0 l=1 rx=0x7f7c0400af50 tx=0x7f7c0400b6e0).ready entity=mon.0 client_cookie=f06e903613c51a5e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:59.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.011+0000 7f7c12875700 1 --2- 172.21.15.80:0/1431685672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c0c072620 0x7f7c0c164d70 secure :-1 s=THROTTLE_DONE pgs=1131 cs=0 l=1 rx=0x7f7c0400af50 tx=0x7f7c0400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:59.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.011+0000 7f7c11072700 1 -- 172.21.15.80:0/1431685672 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c04009ba0 con 0x7f7c0c072620 2019-11-28T11:36:59.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.011+0000 7f7c12875700 1 --2- 172.21.15.80:0/1431685672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c0c072620 0x7f7c0c164d70 secure :-1 s=THROTTLE_DONE pgs=1131 cs=0 l=1 rx=0x7f7c0400af50 tx=0x7f7c0400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:59.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.011+0000 7f7c11072700 1 -- 172.21.15.80:0/1431685672 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c040097c0 con 0x7f7c0c072620 2019-11-28T11:36:59.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.011+0000 7f7c12875700 1 --2- 172.21.15.80:0/1431685672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c0c072620 0x7f7c0c164d70 secure :-1 s=THROTTLE_DONE pgs=1131 cs=0 l=1 rx=0x7f7c0400af50 tx=0x7f7c0400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:59.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.011+0000 7f7c11072700 1 -- 172.21.15.80:0/1431685672 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c04009ba0 con 0x7f7c0c072620 2019-11-28T11:36:59.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.011+0000 7f7c13ad7700 1 -- 172.21.15.80:0/1431685672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c0c072620 msgr2=0x7f7c0c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:59.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.011+0000 7f7c13ad7700 1 --2- 172.21.15.80:0/1431685672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c0c072620 0x7f7c0c164d70 secure :-1 s=READY pgs=1131 cs=0 l=1 rx=0x7f7c0400af50 tx=0x7f7c0400b6e0).stop 2019-11-28T11:36:59.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.012+0000 7f7c13ad7700 1 -- 172.21.15.80:0/1431685672 shutdown_connections 2019-11-28T11:36:59.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.012+0000 7f7c13ad7700 1 --2- 172.21.15.80:0/1431685672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c0c072620 0x7f7c0c164d70 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:59.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.012+0000 7f7c13ad7700 1 --2- 172.21.15.80:0/1431685672 >> v2:172.21.15.174:3300/0 conn(0x7f7c0c06c0a0 0x7f7c0c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:36:59.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.012+0000 7f7c13ad7700 1 -- 172.21.15.80:0/1431685672 shutdown_connections 2019-11-28T11:36:59.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.012+0000 7f7c13ad7700 1 -- 172.21.15.80:0/1431685672 wait complete. 2019-11-28T11:36:59.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.012+0000 7f7c13ad7700 1 -- 172.21.15.80:0/1431685672 >> 172.21.15.80:0/1431685672 conn(0x7f7c0c061cf0 msgr2=0x7f7c0c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:59.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.014+0000 7f7c13ad7700 1 Processor -- start 2019-11-28T11:36:59.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.014+0000 7f7c13ad7700 1 -- start start 2019-11-28T11:36:59.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.015+0000 7f7c13ad7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c104820 0x7f7c0c10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:59.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.015+0000 7f7c13ad7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7c0c10b9d0 0x7f7c0c167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:59.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.015+0000 7f7c13ad7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c13bcd0 con 0x7f7c0c10c890 2019-11-28T11:36:59.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.015+0000 7f7c13ad7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0c108700 con 0x7f7c0c10b9d0 2019-11-28T11:36:59.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.015+0000 7f7c13ad7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c1081f0 con 0x7f7c0c104820 2019-11-28T11:36:59.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c12875700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7c0c10b9d0 0x7f7c0c167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:59.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c12074700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c104820 0x7f7c0c10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:59.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c12074700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c104820 0x7f7c0c10c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:39142/0 (socket says 172.21.15.80:39142) 2019-11-28T11:36:59.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c12875700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7c0c10b9d0 0x7f7c0c167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:51772/0 (socket says 172.21.15.80:51772) 2019-11-28T11:36:59.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c12074700 1 -- 172.21.15.80:0/1255535705 learned_addr learned my addr 172.21.15.80:0/1255535705 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:36:59.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c12074700 1 -- 172.21.15.80:0/1255535705 >> v2:172.21.15.174:3300/0 conn(0x7f7c0c10b9d0 msgr2=0x7f7c0c167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:59.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c12074700 1 --2- 172.21.15.80:0/1255535705 >> v2:172.21.15.174:3300/0 conn(0x7f7c0c10b9d0 0x7f7c0c167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:59.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c12074700 1 -- 172.21.15.80:0/1255535705 >> v1:172.21.15.174:6789/0 conn(0x7f7c0c10c890 legacy=0x7f7c0c10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:59.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c0affd700 1 -- 172.21.15.80:0/1255535705 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734640089 0 0) 0x7f7bf4001430 con 0x7f7c0c10c890 2019-11-28T11:36:59.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c12074700 1 -- 172.21.15.80:0/1255535705 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c109a90 con 0x7f7c0c104820 2019-11-28T11:36:59.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c12875700 1 --2- 172.21.15.80:0/1255535705 >> v2:172.21.15.174:3300/0 conn(0x7f7c0c10b9d0 0x7f7c0c167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:36:59.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c12074700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c104820 0x7f7c0c10c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7bfc010400 tx=0x7f7bfc0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:59.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c12074700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c104820 0x7f7c0c10c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7bfc010400 tx=0x7f7bfc0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:59.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c12074700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c104820 0x7f7c0c10c350 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f7bfc010400 tx=0x7f7bfc0107a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:59.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c12074700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c104820 0x7f7c0c10c350 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f7bfc010400 tx=0x7f7bfc0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:59.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c0affd700 1 -- 172.21.15.80:0/1255535705 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bfc000940 con 0x7f7c0c104820 2019-11-28T11:36:59.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c12074700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c104820 0x7f7c0c10c350 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f7bfc010400 tx=0x7f7bfc0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:59.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c0affd700 1 -- 172.21.15.80:0/1255535705 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc000940 con 0x7f7c0c104820 2019-11-28T11:36:59.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c12074700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c104820 0x7f7c0c10c350 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f7bfc010400 tx=0x7f7bfc0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:59.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c0affd700 1 -- 172.21.15.80:0/1255535705 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bfc0075f0 con 0x7f7c0c104820 2019-11-28T11:36:59.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c13ad7700 1 -- 172.21.15.80:0/1255535705 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0c109e10 con 0x7f7c0c104820 2019-11-28T11:36:59.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.016+0000 7f7c13ad7700 1 -- 172.21.15.80:0/1255535705 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c109a90 con 0x7f7c0c104820 2019-11-28T11:36:59.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.017+0000 7f7c12074700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c104820 0x7f7c0c10c350 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f7bfc010400 tx=0x7f7bfc0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:59.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.017+0000 7f7c0affd700 1 -- 172.21.15.80:0/1255535705 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7bfc000ea0 con 0x7f7c0c104820 2019-11-28T11:36:59.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.017+0000 7f7c12074700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c104820 0x7f7c0c10c350 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f7bfc010400 tx=0x7f7bfc0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:59.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.017+0000 7f7c0affd700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bf0018730 0x7f7bf001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:36:59.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.017+0000 7f7c0affd700 1 -- 172.21.15.80:0/1255535705 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f7bfc031ab0 con 0x7f7c0c104820 2019-11-28T11:36:59.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.017+0000 7f7c11873700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bf0018730 0x7f7bf001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:36:59.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.017+0000 7f7c11873700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bf0018730 0x7f7bf001abc0 crc :-1 s=READY pgs=459 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:36:59.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.024+0000 7f7c13ad7700 1 -- 172.21.15.80:0/1255535705 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0c109e10 con 0x7f7c0c104820 2019-11-28T11:36:59.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.028+0000 7f7c12074700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c104820 0x7f7c0c10c350 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f7bfc010400 tx=0x7f7bfc0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:59.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.028+0000 7f7c0affd700 1 -- 172.21.15.80:0/1255535705 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7bfc0276d0 con 0x7f7c0c104820 2019-11-28T11:36:59.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.217+0000 7f7c13ad7700 1 -- 172.21.15.80:0/1255535705 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f7c0c109a90 con 0x7f7c0c104820 2019-11-28T11:36:59.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.822+0000 7f7c12074700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c104820 0x7f7c0c10c350 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f7bfc010400 tx=0x7f7bfc0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:36:59.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.822+0000 7f7c0affd700 1 -- 172.21.15.80:0/1255535705 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v88) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7bfc0276d0 con 0x7f7c0c104820 2019-11-28T11:36:59.891 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:36:59.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.834+0000 7f7c13ad7700 1 -- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bf0018730 msgr2=0x7f7bf001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:59.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.834+0000 7f7c13ad7700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bf0018730 0x7f7bf001abc0 crc :-1 s=READY pgs=459 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:59.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.834+0000 7f7c13ad7700 1 -- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c104820 msgr2=0x7f7c0c10c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:36:59.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.834+0000 7f7c13ad7700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c104820 0x7f7c0c10c350 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f7bfc010400 tx=0x7f7bfc0107a0).stop 2019-11-28T11:36:59.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.834+0000 7f7c13ad7700 1 -- 172.21.15.80:0/1255535705 shutdown_connections 2019-11-28T11:36:59.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.834+0000 7f7c13ad7700 1 --2- 172.21.15.80:0/1255535705 >> v2:172.21.15.174:3300/0 conn(0x7f7c0c10b9d0 0x7f7c0c167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:59.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.834+0000 7f7c13ad7700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bf0018730 0x7f7bf001abc0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:59.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.834+0000 7f7c13ad7700 1 --2- 172.21.15.80:0/1255535705 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c104820 0x7f7c0c10c350 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:36:59.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.834+0000 7f7c13ad7700 1 -- 172.21.15.80:0/1255535705 shutdown_connections 2019-11-28T11:36:59.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.834+0000 7f7c13ad7700 1 -- 172.21.15.80:0/1255535705 wait complete. 2019-11-28T11:36:59.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.834+0000 7f7c13ad7700 1 -- 172.21.15.80:0/1255535705 >> 172.21.15.80:0/1255535705 conn(0x7f7c0c13d620 msgr2=0x7f7c0c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:36:59.904 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:36:59.904 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:37:00.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.962+0000 7faf3748d700 1 Processor -- start 2019-11-28T11:37:00.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.963+0000 7faf3748d700 1 -- start start 2019-11-28T11:37:00.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.963+0000 7faf3748d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faf3006c0a0 0x7faf30072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:00.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.963+0000 7faf3748d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faf300734e0 0x7faf30071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:00.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.963+0000 7faf3748d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faf30072360 0x7faf300727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:00.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.963+0000 7faf3748d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3006f330 con 0x7faf30072360 2019-11-28T11:37:00.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3748d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf300706c0 con 0x7faf300734e0 2019-11-28T11:37:00.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3748d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf30070a40 con 0x7faf3006c0a0 2019-11-28T11:37:00.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3622b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faf30072360 0x7faf300727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:00.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3622b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faf30072360 0x7faf300727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36892/0 (socket says 172.21.15.80:36892) 2019-11-28T11:37:00.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3622b700 1 -- 172.21.15.80:0/2687620081 learned_addr learned my addr 172.21.15.80:0/2687620081 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:00.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf35a2a700 1 --2- 172.21.15.80:0/2687620081 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faf3006c0a0 0x7faf30072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:00.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf35229700 1 --2- 172.21.15.80:0/2687620081 >> v2:172.21.15.174:3300/0 conn(0x7faf300734e0 0x7faf30071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:00.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3622b700 1 -- 172.21.15.80:0/2687620081 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faf3006c0a0 msgr2=0x7faf30072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:00.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3622b700 1 --2- 172.21.15.80:0/2687620081 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faf3006c0a0 0x7faf30072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:00.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3622b700 1 -- 172.21.15.80:0/2687620081 >> v2:172.21.15.174:3300/0 conn(0x7faf300734e0 msgr2=0x7faf30071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:00.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3622b700 1 --2- 172.21.15.80:0/2687620081 >> v2:172.21.15.174:3300/0 conn(0x7faf300734e0 0x7faf30071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:00.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3622b700 1 -- 172.21.15.80:0/2687620081 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3006db00 con 0x7faf30072360 2019-11-28T11:37:00.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf35a2a700 1 --2- 172.21.15.80:0/2687620081 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faf3006c0a0 0x7faf30072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:37:00.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3622b700 1 --2- 172.21.15.80:0/2687620081 >> v2:172.21.15.80:3300/0 conn(0x7faf30072360 0x7faf300727e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faf2800fab0 tx=0x7faf2800f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3622b700 1 --2- 172.21.15.80:0/2687620081 >> v2:172.21.15.80:3300/0 conn(0x7faf30072360 0x7faf300727e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faf2800fab0 tx=0x7faf2800f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3622b700 1 --2- 172.21.15.80:0/2687620081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf30072360 0x7faf300727e0 secure :-1 s=READY pgs=1132 cs=0 l=1 rx=0x7faf2800fab0 tx=0x7faf2800f930).ready entity=mon.0 client_cookie=f095f5a2480ef164 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:00.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3622b700 1 --2- 172.21.15.80:0/2687620081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf30072360 0x7faf300727e0 secure :-1 s=THROTTLE_DONE pgs=1132 cs=0 l=1 rx=0x7faf2800fab0 tx=0x7faf2800f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3622b700 1 --2- 172.21.15.80:0/2687620081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf30072360 0x7faf300727e0 secure :-1 s=THROTTLE_DONE pgs=1132 cs=0 l=1 rx=0x7faf2800fab0 tx=0x7faf2800f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3622b700 1 --2- 172.21.15.80:0/2687620081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf30072360 0x7faf300727e0 secure :-1 s=THROTTLE_DONE pgs=1132 cs=0 l=1 rx=0x7faf2800fab0 tx=0x7faf2800f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf34a28700 1 -- 172.21.15.80:0/2687620081 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf28001460 con 0x7faf30072360 2019-11-28T11:37:00.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf34a28700 1 -- 172.21.15.80:0/2687620081 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf28000f10 con 0x7faf30072360 2019-11-28T11:37:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf34a28700 1 -- 172.21.15.80:0/2687620081 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf28001a40 con 0x7faf30072360 2019-11-28T11:37:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3748d700 1 -- 172.21.15.80:0/2687620081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf30072360 msgr2=0x7faf300727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.964+0000 7faf3748d700 1 --2- 172.21.15.80:0/2687620081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf30072360 0x7faf300727e0 secure :-1 s=READY pgs=1132 cs=0 l=1 rx=0x7faf2800fab0 tx=0x7faf2800f930).stop 2019-11-28T11:37:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.965+0000 7faf3748d700 1 -- 172.21.15.80:0/2687620081 shutdown_connections 2019-11-28T11:37:00.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.965+0000 7faf3748d700 1 --2- 172.21.15.80:0/2687620081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf30072360 0x7faf300727e0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:00.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.965+0000 7faf3748d700 1 --2- 172.21.15.80:0/2687620081 >> v2:172.21.15.174:3300/0 conn(0x7faf300734e0 0x7faf30071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:00.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.965+0000 7faf3748d700 1 --2- 172.21.15.80:0/2687620081 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faf3006c0a0 0x7faf30072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:00.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.965+0000 7faf3748d700 1 -- 172.21.15.80:0/2687620081 shutdown_connections 2019-11-28T11:37:00.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.965+0000 7faf3748d700 1 -- 172.21.15.80:0/2687620081 wait complete. 2019-11-28T11:37:00.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.965+0000 7faf3748d700 1 -- 172.21.15.80:0/2687620081 >> 172.21.15.80:0/2687620081 conn(0x7faf30061cf0 msgr2=0x7faf30064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:00.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.968+0000 7faf3748d700 1 Processor -- start 2019-11-28T11:37:00.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.968+0000 7faf3748d700 1 -- start start 2019-11-28T11:37:00.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.968+0000 7faf3748d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faf3013e9e0 0x7faf30108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:00.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.968+0000 7faf3748d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf301066e0 con 0x7faf3013e5f0 2019-11-28T11:37:00.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf3748d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3010ce40 con 0x7faf30109430 2019-11-28T11:37:00.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf3748d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3010e060 con 0x7faf3013e9e0 2019-11-28T11:37:00.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf35229700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faf3013e9e0 0x7faf30108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:00.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf35a2a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faf3013e5f0 0x7faf3010a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36212/0 (socket says 172.21.15.80:36212) 2019-11-28T11:37:00.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf35a2a700 1 -- 172.21.15.80:0/326763580 learned_addr learned my addr 172.21.15.80:0/326763580 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:00.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf35229700 1 -- 172.21.15.80:0/326763580 >> v1:172.21.15.174:6789/0 conn(0x7faf30109430 legacy=0x7faf30168ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf35229700 1 -- 172.21.15.80:0/326763580 >> v1:172.21.15.80:6789/0 conn(0x7faf3013e5f0 legacy=0x7faf3010a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf2e7fc700 1 -- 172.21.15.80:0/326763580 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666526534 0 0) 0x7faf20009c90 con 0x7faf3013e5f0 2019-11-28T11:37:00.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf35229700 1 -- 172.21.15.80:0/326763580 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3010e9c0 con 0x7faf3013e9e0 2019-11-28T11:37:00.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf35229700 1 --2- 172.21.15.80:0/326763580 >> v2:172.21.15.80:3300/0 conn(0x7faf3013e9e0 0x7faf30108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf180103a0 tx=0x7faf18010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf35229700 1 --2- 172.21.15.80:0/326763580 >> v2:172.21.15.80:3300/0 conn(0x7faf3013e9e0 0x7faf30108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf180103a0 tx=0x7faf18010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf35229700 1 --2- 172.21.15.80:0/326763580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf3013e9e0 0x7faf30108ef0 secure :-1 s=READY pgs=1134 cs=0 l=1 rx=0x7faf180103a0 tx=0x7faf18010740).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:00.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf35229700 1 --2- 172.21.15.80:0/326763580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf3013e9e0 0x7faf30108ef0 secure :-1 s=THROTTLE_DONE pgs=1134 cs=0 l=1 rx=0x7faf180103a0 tx=0x7faf18010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf2e7fc700 1 -- 172.21.15.80:0/326763580 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf18000940 con 0x7faf3013e9e0 2019-11-28T11:37:00.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf35229700 1 --2- 172.21.15.80:0/326763580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf3013e9e0 0x7faf30108ef0 secure :-1 s=THROTTLE_DONE pgs=1134 cs=0 l=1 rx=0x7faf180103a0 tx=0x7faf18010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf35229700 1 --2- 172.21.15.80:0/326763580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf3013e9e0 0x7faf30108ef0 secure :-1 s=THROTTLE_DONE pgs=1134 cs=0 l=1 rx=0x7faf180103a0 tx=0x7faf18010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf2e7fc700 1 -- 172.21.15.80:0/326763580 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf18009c40 con 0x7faf3013e9e0 2019-11-28T11:37:00.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf2e7fc700 1 -- 172.21.15.80:0/326763580 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf1800a250 con 0x7faf3013e9e0 2019-11-28T11:37:00.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf3748d700 1 -- 172.21.15.80:0/326763580 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3010ed40 con 0x7faf3013e9e0 2019-11-28T11:37:00.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.969+0000 7faf3748d700 1 -- 172.21.15.80:0/326763580 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3010e9c0 con 0x7faf3013e9e0 2019-11-28T11:37:00.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.970+0000 7faf35229700 1 --2- 172.21.15.80:0/326763580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf3013e9e0 0x7faf30108ef0 secure :-1 s=THROTTLE_DONE pgs=1134 cs=0 l=1 rx=0x7faf180103a0 tx=0x7faf18010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.970+0000 7faf2e7fc700 1 -- 172.21.15.80:0/326763580 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7faf18009750 con 0x7faf3013e9e0 2019-11-28T11:37:00.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.970+0000 7faf35229700 1 --2- 172.21.15.80:0/326763580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf3013e9e0 0x7faf30108ef0 secure :-1 s=THROTTLE_DONE pgs=1134 cs=0 l=1 rx=0x7faf180103a0 tx=0x7faf18010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.970+0000 7faf2e7fc700 1 --2- 172.21.15.80:0/326763580 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faf14018730 0x7faf1401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:00.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.970+0000 7faf2e7fc700 1 -- 172.21.15.80:0/326763580 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5200+0+0 (secure 0 0 0) 0x7faf18031ad0 con 0x7faf3013e9e0 2019-11-28T11:37:00.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.970+0000 7faf35a2a700 1 --2- 172.21.15.80:0/326763580 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faf14018730 0x7faf1401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:00.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.970+0000 7faf35a2a700 1 --2- 172.21.15.80:0/326763580 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faf14018730 0x7faf1401abc0 crc :-1 s=READY pgs=460 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:00.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.978+0000 7faf3748d700 1 -- 172.21.15.80:0/326763580 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3010ed40 con 0x7faf3013e9e0 2019-11-28T11:37:00.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.981+0000 7faf35229700 1 --2- 172.21.15.80:0/326763580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf3013e9e0 0x7faf30108ef0 secure :-1 s=THROTTLE_DONE pgs=1134 cs=0 l=1 rx=0x7faf180103a0 tx=0x7faf18010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:36:59.981+0000 7faf2e7fc700 1 -- 172.21.15.80:0/326763580 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7faf18000940 con 0x7faf3013e9e0 2019-11-28T11:37:00.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.156+0000 7faf3748d700 1 -- 172.21.15.80:0/326763580 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7faf3010e9c0 con 0x7faf3013e9e0 2019-11-28T11:37:00.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.157+0000 7faf35229700 1 --2- 172.21.15.80:0/326763580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf3013e9e0 0x7faf30108ef0 secure :-1 s=THROTTLE_DONE pgs=1134 cs=0 l=1 rx=0x7faf180103a0 tx=0x7faf18010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.157+0000 7faf2e7fc700 1 -- 172.21.15.80:0/326763580 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v31) v1 ==== 80+0+4797 (secure 0 0 0) 0x7faf18009660 con 0x7faf3013e9e0 2019-11-28T11:37:00.219 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:37:00.219 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:37:00.219 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:37:00.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.220 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:37:00.220 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:37:00.220 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.220 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:37:00.220 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:37:00.220 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:37:00.221 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:37:00.221 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.221 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:37:00.221 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:37:00.221 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.222 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:37:00.222 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:37:00.222 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:37:00.222 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:37:00.222 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.225 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:37:00.226 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:37:00.226 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.226 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:37:00.226 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:37:00.226 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:37:00.226 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:37:00.226 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.227 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:37:00.227 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:37:00.227 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.227 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:37:00.227 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:37:00.228 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:37:00.228 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.228 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:37:00.228 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:37:00.228 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.229 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:37:00.229 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:37:00.229 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:37:00.229 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.230 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:37:00.230 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:37:00.230 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.231 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:37:00.231 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:37:00.231 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:37:00.231 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.232 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:37:00.232 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:37:00.232 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.232 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:37:00.232 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:37:00.233 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:37:00.233 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.233 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:37:00.233 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:37:00.233 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.234 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:37:00.234 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:37:00.234 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:37:00.234 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.234 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:37:00.235 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:37:00.235 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.235 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:37:00.235 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:37:00.235 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:37:00.235 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.236 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:37:00.236 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:37:00.236 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.236 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:37:00.236 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:37:00.236 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:37:00.236 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.237 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:37:00.237 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:37:00.237 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.237 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:37:00.237 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:37:00.239 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:37:00.239 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.239 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:37:00.239 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:37:00.239 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.240 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:37:00.240 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:37:00.240 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:37:00.240 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.241 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:37:00.241 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:37:00.241 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.241 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:37:00.241 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:37:00.241 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:37:00.241 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.242 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:37:00.242 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:37:00.242 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.243 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:37:00.243 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:37:00.243 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:37:00.243 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.243 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:37:00.244 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:37:00.244 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.244 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:37:00.244 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:37:00.244 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:37:00.244 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.245 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:37:00.245 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:37:00.245 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.245 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:37:00.245 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:37:00.245 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:37:00.246 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:37:00.246 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.246 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:37:00.246 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:37:00.246 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.247 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:37:00.247 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:37:00.247 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:37:00.247 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:37:00.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:00.247 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:37:00.248 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:37:00.248 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:37:00.248 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:37:00.248 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:37:00.248 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:37:00.248 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.249 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:00.249 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:37:00.249 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:37:00.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.159+0000 7faf3748d700 1 -- 172.21.15.80:0/326763580 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faf14018730 msgr2=0x7faf1401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.159+0000 7faf3748d700 1 --2- 172.21.15.80:0/326763580 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faf14018730 0x7faf1401abc0 crc :-1 s=READY pgs=460 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:00.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.159+0000 7faf3748d700 1 -- 172.21.15.80:0/326763580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf3013e9e0 msgr2=0x7faf30108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.160+0000 7faf3748d700 1 --2- 172.21.15.80:0/326763580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf3013e9e0 0x7faf30108ef0 secure :-1 s=READY pgs=1134 cs=0 l=1 rx=0x7faf180103a0 tx=0x7faf18010740).stop 2019-11-28T11:37:00.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.160+0000 7faf3748d700 1 -- 172.21.15.80:0/326763580 shutdown_connections 2019-11-28T11:37:00.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.160+0000 7faf3748d700 1 --2- 172.21.15.80:0/326763580 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faf14018730 0x7faf1401abc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:00.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.160+0000 7faf3748d700 1 --2- 172.21.15.80:0/326763580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf3013e9e0 0x7faf30108ef0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:00.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.160+0000 7faf3748d700 1 -- 172.21.15.80:0/326763580 shutdown_connections 2019-11-28T11:37:00.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.160+0000 7faf3748d700 1 -- 172.21.15.80:0/326763580 wait complete. 2019-11-28T11:37:00.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.160+0000 7faf3748d700 1 -- 172.21.15.80:0/326763580 >> 172.21.15.80:0/326763580 conn(0x7faf3013d620 msgr2=0x7faf3013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:00.252 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:37:00.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.310+0000 7fabb5061700 1 Processor -- start 2019-11-28T11:37:00.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.310+0000 7fabb5061700 1 -- start start 2019-11-28T11:37:00.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.311+0000 7fabb5061700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabb006c490 0x7fabb006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:00.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.311+0000 7fabb5061700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fabb006ce60 0x7fabb0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:00.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.311+0000 7fabb5061700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb006db00 con 0x7fabb006c0a0 2019-11-28T11:37:00.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.311+0000 7fabb5061700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb006fd60 con 0x7fabb006ce60 2019-11-28T11:37:00.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.311+0000 7fabb5061700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0070030 con 0x7fabb006c490 2019-11-28T11:37:00.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.311+0000 7fabaf59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fabb006c0a0 0x7fabb0072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36220/0 (socket says 172.21.15.80:36220) 2019-11-28T11:37:00.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.311+0000 7fabaf59e700 1 -- 172.21.15.80:0/3581349826 learned_addr learned my addr 172.21.15.80:0/3581349826 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:00.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.311+0000 7fabb4860700 1 --2- 172.21.15.80:0/3581349826 >> v2:172.21.15.174:3300/0 conn(0x7fabb006ce60 0x7fabb0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:00.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.311+0000 7fabaed9d700 1 --2- 172.21.15.80:0/3581349826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabb006c490 0x7fabb006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:00.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.311+0000 7fabae59c700 1 -- 172.21.15.80:0/3581349826 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354776933 0 0) 0x7fab980014d0 con 0x7fabb006c0a0 2019-11-28T11:37:00.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.311+0000 7fabae59c700 1 -- 172.21.15.80:0/3581349826 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab90002e80 con 0x7fabb006c0a0 2019-11-28T11:37:00.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabae59c700 1 -- 172.21.15.80:0/3581349826 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2026988212 0 0) 0x7fab980014b0 con 0x7fabb006c0a0 2019-11-28T11:37:00.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabb4860700 1 -- 172.21.15.80:0/3581349826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabb006c490 msgr2=0x7fabb006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:00.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabb4860700 1 --2- 172.21.15.80:0/3581349826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabb006c490 0x7fabb006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:00.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabb4860700 1 -- 172.21.15.80:0/3581349826 >> v1:172.21.15.80:6789/0 conn(0x7fabb006c0a0 legacy=0x7fabb0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabb4860700 1 -- 172.21.15.80:0/3581349826 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb00706c0 con 0x7fabb006ce60 2019-11-28T11:37:00.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabaed9d700 1 --2- 172.21.15.80:0/3581349826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabb006c490 0x7fabb006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:37:00.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabb4860700 1 --2- 172.21.15.80:0/3581349826 >> v2:172.21.15.174:3300/0 conn(0x7fabb006ce60 0x7fabb0164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faba800af80 tx=0x7faba800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabb4860700 1 --2- 172.21.15.80:0/3581349826 >> v2:172.21.15.174:3300/0 conn(0x7fabb006ce60 0x7fabb0164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faba800af80 tx=0x7faba800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabb4860700 1 --2- 172.21.15.80:0/3581349826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb006ce60 0x7fabb0164d70 secure :-1 s=READY pgs=672 cs=0 l=1 rx=0x7faba800af80 tx=0x7faba800b790).ready entity=mon.1 client_cookie=7ab0d09df1deedc4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:00.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabb4860700 1 --2- 172.21.15.80:0/3581349826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb006ce60 0x7fabb0164d70 secure :-1 s=THROTTLE_DONE pgs=672 cs=0 l=1 rx=0x7faba800af80 tx=0x7faba800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabae59c700 1 -- 172.21.15.80:0/3581349826 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faba8000bc0 con 0x7fabb006ce60 2019-11-28T11:37:00.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabb4860700 1 --2- 172.21.15.80:0/3581349826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb006ce60 0x7fabb0164d70 secure :-1 s=THROTTLE_DONE pgs=672 cs=0 l=1 rx=0x7faba800af80 tx=0x7faba800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabb4860700 1 --2- 172.21.15.80:0/3581349826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb006ce60 0x7fabb0164d70 secure :-1 s=THROTTLE_DONE pgs=672 cs=0 l=1 rx=0x7faba800af80 tx=0x7faba800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabae59c700 1 -- 172.21.15.80:0/3581349826 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba80097f0 con 0x7fabb006ce60 2019-11-28T11:37:00.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabae59c700 1 -- 172.21.15.80:0/3581349826 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faba8009ec0 con 0x7fabb006ce60 2019-11-28T11:37:00.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabb5061700 1 -- 172.21.15.80:0/3581349826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb006ce60 msgr2=0x7fabb0164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.312+0000 7fabb5061700 1 --2- 172.21.15.80:0/3581349826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb006ce60 0x7fabb0164d70 secure :-1 s=READY pgs=672 cs=0 l=1 rx=0x7faba800af80 tx=0x7faba800b790).stop 2019-11-28T11:37:00.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.313+0000 7fabb5061700 1 -- 172.21.15.80:0/3581349826 shutdown_connections 2019-11-28T11:37:00.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.313+0000 7fabb5061700 1 --2- 172.21.15.80:0/3581349826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb006ce60 0x7fabb0164d70 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:00.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.313+0000 7fabb5061700 1 --2- 172.21.15.80:0/3581349826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabb006c490 0x7fabb006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:00.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.313+0000 7fabb5061700 1 -- 172.21.15.80:0/3581349826 shutdown_connections 2019-11-28T11:37:00.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.313+0000 7fabb5061700 1 -- 172.21.15.80:0/3581349826 wait complete. 2019-11-28T11:37:00.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.313+0000 7fabb5061700 1 -- 172.21.15.80:0/3581349826 >> 172.21.15.80:0/3581349826 conn(0x7fabb0061cf0 msgr2=0x7fabb0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:00.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.315+0000 7fabb5061700 1 Processor -- start 2019-11-28T11:37:00.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.315+0000 7fabb5061700 1 -- start start 2019-11-28T11:37:00.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.316+0000 7fabb5061700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fabb013a780 0x7fabb012d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:00.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.316+0000 7fabb5061700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fabb012cb00 0x7fabb0167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:00.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.316+0000 7fabb5061700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb0139a60 con 0x7fabb012d9c0 2019-11-28T11:37:00.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.316+0000 7fabb5061700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb012a260 con 0x7fabb013a780 2019-11-28T11:37:00.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.316+0000 7fabb5061700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb012a530 con 0x7fabb012cb00 2019-11-28T11:37:00.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.316+0000 7fabaf59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fabb013a780 0x7fabb012d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:00.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.316+0000 7fabaf59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fabb013a780 0x7fabb012d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36910/0 (socket says 172.21.15.80:36910) 2019-11-28T11:37:00.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.316+0000 7fabaf59e700 1 -- 172.21.15.80:0/1838670450 learned_addr learned my addr 172.21.15.80:0/1838670450 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:00.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.316+0000 7fabb4860700 1 --2- 172.21.15.80:0/1838670450 >> v2:172.21.15.174:3300/0 conn(0x7fabb012cb00 0x7fabb0167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:00.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7fabaf59e700 1 -- 172.21.15.80:0/1838670450 >> v2:172.21.15.174:3300/0 conn(0x7fabb012cb00 msgr2=0x7fabb0167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7fabaf59e700 1 --2- 172.21.15.80:0/1838670450 >> v2:172.21.15.174:3300/0 conn(0x7fabb012cb00 0x7fabb0167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:00.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7fabaf59e700 1 -- 172.21.15.80:0/1838670450 >> v1:172.21.15.80:6789/0 conn(0x7fabb012d9c0 legacy=0x7fabb012c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7faba7fff700 1 -- 172.21.15.80:0/1838670450 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699902714 0 0) 0x7faba000d970 con 0x7fabb012d9c0 2019-11-28T11:37:00.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7fabaf59e700 1 -- 172.21.15.80:0/1838670450 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb012abc0 con 0x7fabb013a780 2019-11-28T11:37:00.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7fabaf59e700 1 --2- 172.21.15.80:0/1838670450 >> v2:172.21.15.80:3300/0 conn(0x7fabb013a780 0x7fabb012d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab980105f0 tx=0x7fab98012c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7fabaf59e700 1 --2- 172.21.15.80:0/1838670450 >> v2:172.21.15.80:3300/0 conn(0x7fabb013a780 0x7fabb012d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab980105f0 tx=0x7fab98012c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7fabaf59e700 1 --2- 172.21.15.80:0/1838670450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabb013a780 0x7fabb012d480 secure :-1 s=READY pgs=1137 cs=0 l=1 rx=0x7fab980105f0 tx=0x7fab98012c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:00.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7fabaf59e700 1 --2- 172.21.15.80:0/1838670450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabb013a780 0x7fabb012d480 secure :-1 s=THROTTLE_DONE pgs=1137 cs=0 l=1 rx=0x7fab980105f0 tx=0x7fab98012c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7faba7fff700 1 -- 172.21.15.80:0/1838670450 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab98001010 con 0x7fabb013a780 2019-11-28T11:37:00.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7fabaf59e700 1 --2- 172.21.15.80:0/1838670450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabb013a780 0x7fabb012d480 secure :-1 s=THROTTLE_DONE pgs=1137 cs=0 l=1 rx=0x7fab980105f0 tx=0x7fab98012c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7fabb5061700 1 -- 172.21.15.80:0/1838670450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb012af40 con 0x7fabb013a780 2019-11-28T11:37:00.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7faba7fff700 1 -- 172.21.15.80:0/1838670450 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab98001010 con 0x7fabb013a780 2019-11-28T11:37:00.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7fabaf59e700 1 --2- 172.21.15.80:0/1838670450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabb013a780 0x7fabb012d480 secure :-1 s=THROTTLE_DONE pgs=1137 cs=0 l=1 rx=0x7fab980105f0 tx=0x7fab98012c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7faba7fff700 1 -- 172.21.15.80:0/1838670450 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab98001200 con 0x7fabb013a780 2019-11-28T11:37:00.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7fabb5061700 1 -- 172.21.15.80:0/1838670450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb012abc0 con 0x7fabb013a780 2019-11-28T11:37:00.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.317+0000 7fabaf59e700 1 --2- 172.21.15.80:0/1838670450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabb013a780 0x7fabb012d480 secure :-1 s=THROTTLE_DONE pgs=1137 cs=0 l=1 rx=0x7fab980105f0 tx=0x7fab98012c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.318+0000 7faba7fff700 1 -- 172.21.15.80:0/1838670450 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fab98001200 con 0x7fabb013a780 2019-11-28T11:37:00.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.318+0000 7fabaf59e700 1 --2- 172.21.15.80:0/1838670450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabb013a780 0x7fabb012d480 secure :-1 s=THROTTLE_DONE pgs=1137 cs=0 l=1 rx=0x7fab980105f0 tx=0x7fab98012c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.318+0000 7faba7fff700 1 --2- 172.21.15.80:0/1838670450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab88018730 0x7fab8801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:00.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.318+0000 7faba7fff700 1 -- 172.21.15.80:0/1838670450 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fab98034050 con 0x7fabb013a780 2019-11-28T11:37:00.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.318+0000 7fabaed9d700 1 --2- 172.21.15.80:0/1838670450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab88018730 0x7fab8801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:00.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.318+0000 7fabaed9d700 1 --2- 172.21.15.80:0/1838670450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab88018730 0x7fab8801abc0 crc :-1 s=READY pgs=461 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:00.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.325+0000 7fabb5061700 1 -- 172.21.15.80:0/1838670450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb012af40 con 0x7fabb013a780 2019-11-28T11:37:00.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.329+0000 7fabaf59e700 1 --2- 172.21.15.80:0/1838670450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabb013a780 0x7fabb012d480 secure :-1 s=THROTTLE_DONE pgs=1137 cs=0 l=1 rx=0x7fab980105f0 tx=0x7fab98012c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.329+0000 7faba7fff700 1 -- 172.21.15.80:0/1838670450 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fab98007930 con 0x7fabb013a780 2019-11-28T11:37:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.502+0000 7fabb5061700 1 -- 172.21.15.80:0/1838670450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabb012abc0 con 0x7fabb013a780 2019-11-28T11:37:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.503+0000 7fabaf59e700 1 --2- 172.21.15.80:0/1838670450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabb013a780 0x7fabb012d480 secure :-1 s=THROTTLE_DONE pgs=1137 cs=0 l=1 rx=0x7fab980105f0 tx=0x7fab98012c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.503+0000 7faba7fff700 1 -- 172.21.15.80:0/1838670450 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+12001 (secure 0 0 0) 0x7fab98019ac0 con 0x7fabb013a780 2019-11-28T11:37:00.565 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:37:00.565 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":88,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:36:59.818743+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:37:00.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.505+0000 7fabb5061700 1 -- 172.21.15.80:0/1838670450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab88018730 msgr2=0x7fab8801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.505+0000 7fabb5061700 1 --2- 172.21.15.80:0/1838670450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab88018730 0x7fab8801abc0 crc :-1 s=READY pgs=461 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.505+0000 7fabb5061700 1 -- 172.21.15.80:0/1838670450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabb013a780 msgr2=0x7fabb012d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.505+0000 7fabb5061700 1 --2- 172.21.15.80:0/1838670450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabb013a780 0x7fabb012d480 secure :-1 s=READY pgs=1137 cs=0 l=1 rx=0x7fab980105f0 tx=0x7fab98012c60).stop 2019-11-28T11:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.505+0000 7fabb5061700 1 -- 172.21.15.80:0/1838670450 shutdown_connections 2019-11-28T11:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.505+0000 7fabb5061700 1 --2- 172.21.15.80:0/1838670450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab88018730 0x7fab8801abc0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.505+0000 7fabb5061700 1 --2- 172.21.15.80:0/1838670450 >> v2:172.21.15.174:3300/0 conn(0x7fabb012cb00 0x7fabb0167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.505+0000 7fabb5061700 1 --2- 172.21.15.80:0/1838670450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabb013a780 0x7fabb012d480 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.505+0000 7fabb5061700 1 -- 172.21.15.80:0/1838670450 shutdown_connections 2019-11-28T11:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.505+0000 7fabb5061700 1 -- 172.21.15.80:0/1838670450 wait complete. 2019-11-28T11:37:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.505+0000 7fabb5061700 1 -- 172.21.15.80:0/1838670450 >> 172.21.15.80:0/1838670450 conn(0x7fabb0127dc0 msgr2=0x7fabb0141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:00.578 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:37:00.579 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:37:00.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.641+0000 7fb19f44d700 1 Processor -- start 2019-11-28T11:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.641+0000 7fb19f44d700 1 -- start start 2019-11-28T11:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.642+0000 7fb19f44d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb19815ed10 0x7fb19815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.642+0000 7fb19f44d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb198073020 0x7fb198071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.642+0000 7fb19f44d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19806db60 con 0x7fb1980734b0 2019-11-28T11:37:00.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.642+0000 7fb19f44d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19806fe00 con 0x7fb19815ed10 2019-11-28T11:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.642+0000 7fb19f44d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980700d0 con 0x7fb198073020 2019-11-28T11:37:00.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.642+0000 7fb19d9ea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb19815ed10 0x7fb19815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.642+0000 7fb19e1eb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb1980734b0 0x7fb1980723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36234/0 (socket says 172.21.15.80:36234) 2019-11-28T11:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.642+0000 7fb19e1eb700 1 -- 172.21.15.80:0/2525979679 learned_addr learned my addr 172.21.15.80:0/2525979679 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.642+0000 7fb19d1e9700 1 --2- 172.21.15.80:0/2525979679 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb198073020 0x7fb198071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:00.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.642+0000 7fb19d9ea700 1 -- 172.21.15.80:0/2525979679 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb198073020 msgr2=0x7fb198071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.642+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2525979679 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb198073020 0x7fb198071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.642+0000 7fb19d9ea700 1 -- 172.21.15.80:0/2525979679 >> v1:172.21.15.80:6789/0 conn(0x7fb1980734b0 legacy=0x7fb1980723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.642+0000 7fb19c9e8700 1 -- 172.21.15.80:0/2525979679 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715623304 0 0) 0x7fb190001150 con 0x7fb1980734b0 2019-11-28T11:37:00.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.642+0000 7fb19d9ea700 1 -- 172.21.15.80:0/2525979679 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198070760 con 0x7fb19815ed10 2019-11-28T11:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.642+0000 7fb19d1e9700 1 --2- 172.21.15.80:0/2525979679 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb198073020 0x7fb198071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.642+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2525979679 >> v2:172.21.15.80:3300/0 conn(0x7fb19815ed10 0x7fb19815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb18800b2d0 tx=0x7fb18800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.643+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2525979679 >> v2:172.21.15.80:3300/0 conn(0x7fb19815ed10 0x7fb19815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb18800b2d0 tx=0x7fb18800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.643+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2525979679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb19815ed10 0x7fb19815f100 secure :-1 s=READY pgs=1139 cs=0 l=1 rx=0x7fb18800b2d0 tx=0x7fb18800bae0).ready entity=mon.0 client_cookie=6dfdb5589f246e26 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.643+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2525979679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb19815ed10 0x7fb19815f100 secure :-1 s=THROTTLE_DONE pgs=1139 cs=0 l=1 rx=0x7fb18800b2d0 tx=0x7fb18800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.643+0000 7fb19c9e8700 1 -- 172.21.15.80:0/2525979679 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb188007590 con 0x7fb19815ed10 2019-11-28T11:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.643+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2525979679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb19815ed10 0x7fb19815f100 secure :-1 s=THROTTLE_DONE pgs=1139 cs=0 l=1 rx=0x7fb18800b2d0 tx=0x7fb18800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.643+0000 7fb19c9e8700 1 -- 172.21.15.80:0/2525979679 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb188009d30 con 0x7fb19815ed10 2019-11-28T11:37:00.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.643+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2525979679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb19815ed10 0x7fb19815f100 secure :-1 s=THROTTLE_DONE pgs=1139 cs=0 l=1 rx=0x7fb18800b2d0 tx=0x7fb18800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.643+0000 7fb19c9e8700 1 -- 172.21.15.80:0/2525979679 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb188009f20 con 0x7fb19815ed10 2019-11-28T11:37:00.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.643+0000 7fb19f44d700 1 -- 172.21.15.80:0/2525979679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb19815ed10 msgr2=0x7fb19815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.643+0000 7fb19f44d700 1 --2- 172.21.15.80:0/2525979679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb19815ed10 0x7fb19815f100 secure :-1 s=READY pgs=1139 cs=0 l=1 rx=0x7fb18800b2d0 tx=0x7fb18800bae0).stop 2019-11-28T11:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.643+0000 7fb19f44d700 1 -- 172.21.15.80:0/2525979679 shutdown_connections 2019-11-28T11:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.643+0000 7fb19f44d700 1 --2- 172.21.15.80:0/2525979679 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb198073020 0x7fb198071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:00.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.643+0000 7fb19f44d700 1 --2- 172.21.15.80:0/2525979679 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb19815ed10 0x7fb19815f100 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.644+0000 7fb19f44d700 1 -- 172.21.15.80:0/2525979679 shutdown_connections 2019-11-28T11:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.644+0000 7fb19f44d700 1 -- 172.21.15.80:0/2525979679 wait complete. 2019-11-28T11:37:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.644+0000 7fb19f44d700 1 -- 172.21.15.80:0/2525979679 >> 172.21.15.80:0/2525979679 conn(0x7fb198061d20 msgr2=0x7fb1980641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.646+0000 7fb19f44d700 1 Processor -- start 2019-11-28T11:37:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.646+0000 7fb19f44d700 1 -- start start 2019-11-28T11:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.647+0000 7fb19f44d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb198148320 0x7fb19810ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.647+0000 7fb19f44d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb19810f290 0x7fb19810dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:00.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.647+0000 7fb19f44d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb198148e00 con 0x7fb19810e110 2019-11-28T11:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.647+0000 7fb19f44d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19813aa20 con 0x7fb198148320 2019-11-28T11:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.647+0000 7fb19f44d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19813acf0 con 0x7fb19810f290 2019-11-28T11:37:00.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.647+0000 7fb19d9ea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb198148320 0x7fb19810ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.647+0000 7fb19d9ea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb198148320 0x7fb19810ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36924/0 (socket says 172.21.15.80:36924) 2019-11-28T11:37:00.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.647+0000 7fb19d9ea700 1 -- 172.21.15.80:0/2451648385 learned_addr learned my addr 172.21.15.80:0/2451648385 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.647+0000 7fb19d1e9700 1 --2- 172.21.15.80:0/2451648385 >> v2:172.21.15.174:3300/0 conn(0x7fb19810f290 0x7fb19810dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.647+0000 7fb19d9ea700 1 -- 172.21.15.80:0/2451648385 >> v2:172.21.15.174:3300/0 conn(0x7fb19810f290 msgr2=0x7fb19810dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.647+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2451648385 >> v2:172.21.15.174:3300/0 conn(0x7fb19810f290 0x7fb19810dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:00.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.647+0000 7fb19d9ea700 1 -- 172.21.15.80:0/2451648385 >> v1:172.21.15.80:6789/0 conn(0x7fb19810e110 legacy=0x7fb1981079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.647+0000 7fb19d9ea700 1 -- 172.21.15.80:0/2451648385 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19810c490 con 0x7fb198148320 2019-11-28T11:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.647+0000 7fb19d1e9700 1 --2- 172.21.15.80:0/2451648385 >> v2:172.21.15.174:3300/0 conn(0x7fb19810f290 0x7fb19810dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.647+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2451648385 >> v2:172.21.15.80:3300/0 conn(0x7fb198148320 0x7fb19810ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb1880547f0 tx=0x7fb188054b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.647+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2451648385 >> v2:172.21.15.80:3300/0 conn(0x7fb198148320 0x7fb19810ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb1880547f0 tx=0x7fb188054b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.648+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2451648385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb198148320 0x7fb19810ed50 secure :-1 s=READY pgs=1141 cs=0 l=1 rx=0x7fb1880547f0 tx=0x7fb188054b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.648+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2451648385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb198148320 0x7fb19810ed50 secure :-1 s=THROTTLE_DONE pgs=1141 cs=0 l=1 rx=0x7fb1880547f0 tx=0x7fb188054b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.648+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2451648385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb198148320 0x7fb19810ed50 secure :-1 s=THROTTLE_DONE pgs=1141 cs=0 l=1 rx=0x7fb1880547f0 tx=0x7fb188054b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.648+0000 7fb1967fc700 1 -- 172.21.15.80:0/2451648385 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb18800af10 con 0x7fb198148320 2019-11-28T11:37:00.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.648+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2451648385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb198148320 0x7fb19810ed50 secure :-1 s=THROTTLE_DONE pgs=1141 cs=0 l=1 rx=0x7fb1880547f0 tx=0x7fb188054b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.648+0000 7fb1967fc700 1 -- 172.21.15.80:0/2451648385 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb188009d00 con 0x7fb198148320 2019-11-28T11:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.648+0000 7fb19f44d700 1 -- 172.21.15.80:0/2451648385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19810c810 con 0x7fb198148320 2019-11-28T11:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.648+0000 7fb1967fc700 1 -- 172.21.15.80:0/2451648385 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb18800a3d0 con 0x7fb198148320 2019-11-28T11:37:00.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.648+0000 7fb19f44d700 1 -- 172.21.15.80:0/2451648385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19810c490 con 0x7fb198148320 2019-11-28T11:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.648+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2451648385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb198148320 0x7fb19810ed50 secure :-1 s=THROTTLE_DONE pgs=1141 cs=0 l=1 rx=0x7fb1880547f0 tx=0x7fb188054b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.648+0000 7fb1967fc700 1 -- 172.21.15.80:0/2451648385 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb188009900 con 0x7fb198148320 2019-11-28T11:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.648+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2451648385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb198148320 0x7fb19810ed50 secure :-1 s=THROTTLE_DONE pgs=1141 cs=0 l=1 rx=0x7fb1880547f0 tx=0x7fb188054b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.648+0000 7fb1967fc700 1 --2- 172.21.15.80:0/2451648385 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb178018730 0x7fb17801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:00.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.648+0000 7fb1967fc700 1 -- 172.21.15.80:0/2451648385 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fb188075f10 con 0x7fb198148320 2019-11-28T11:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.649+0000 7fb19d1e9700 1 --2- 172.21.15.80:0/2451648385 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb178018730 0x7fb17801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.649+0000 7fb19d1e9700 1 --2- 172.21.15.80:0/2451648385 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb178018730 0x7fb17801abe0 crc :-1 s=READY pgs=462 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.656+0000 7fb19f44d700 1 -- 172.21.15.80:0/2451648385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19810c810 con 0x7fb198148320 2019-11-28T11:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.660+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2451648385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb198148320 0x7fb19810ed50 secure :-1 s=THROTTLE_DONE pgs=1141 cs=0 l=1 rx=0x7fb1880547f0 tx=0x7fb188054b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.660+0000 7fb1967fc700 1 -- 172.21.15.80:0/2451648385 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb18800af10 con 0x7fb198148320 2019-11-28T11:37:00.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.829+0000 7fb19f44d700 1 -- 172.21.15.80:0/2451648385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fb19810c490 con 0x7fb198148320 2019-11-28T11:37:00.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.829+0000 7fb19d9ea700 1 --2- 172.21.15.80:0/2451648385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb198148320 0x7fb19810ed50 secure :-1 s=THROTTLE_DONE pgs=1141 cs=0 l=1 rx=0x7fb1880547f0 tx=0x7fb188054b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:00.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.829+0000 7fb1967fc700 1 -- 172.21.15.80:0/2451648385 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v88) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb188009900 con 0x7fb198148320 2019-11-28T11:37:00.890 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:37:00.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.832+0000 7fb19f44d700 1 -- 172.21.15.80:0/2451648385 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb178018730 msgr2=0x7fb17801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.832+0000 7fb19f44d700 1 --2- 172.21.15.80:0/2451648385 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb178018730 0x7fb17801abe0 crc :-1 s=READY pgs=462 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:00.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.832+0000 7fb19f44d700 1 -- 172.21.15.80:0/2451648385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb198148320 msgr2=0x7fb19810ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:00.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.832+0000 7fb19f44d700 1 --2- 172.21.15.80:0/2451648385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb198148320 0x7fb19810ed50 secure :-1 s=READY pgs=1141 cs=0 l=1 rx=0x7fb1880547f0 tx=0x7fb188054b90).stop 2019-11-28T11:37:00.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.832+0000 7fb19f44d700 1 -- 172.21.15.80:0/2451648385 shutdown_connections 2019-11-28T11:37:00.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.832+0000 7fb19f44d700 1 --2- 172.21.15.80:0/2451648385 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb178018730 0x7fb17801abe0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:00.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.832+0000 7fb19f44d700 1 --2- 172.21.15.80:0/2451648385 >> v2:172.21.15.174:3300/0 conn(0x7fb19810f290 0x7fb19810dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:00.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.832+0000 7fb19f44d700 1 --2- 172.21.15.80:0/2451648385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb198148320 0x7fb19810ed50 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:00.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.832+0000 7fb19f44d700 1 -- 172.21.15.80:0/2451648385 shutdown_connections 2019-11-28T11:37:00.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.832+0000 7fb19f44d700 1 -- 172.21.15.80:0/2451648385 wait complete. 2019-11-28T11:37:00.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.832+0000 7fb19f44d700 1 -- 172.21.15.80:0/2451648385 >> 172.21.15.80:0/2451648385 conn(0x7fb19815e2d0 msgr2=0x7fb198147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:00.902 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:37:01.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.961+0000 7f11df1ac700 1 Processor -- start 2019-11-28T11:37:01.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.961+0000 7f11df1ac700 1 -- start start 2019-11-28T11:37:01.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.962+0000 7f11df1ac700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f11d806d120 0x7f11d8165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:01.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.962+0000 7f11df1ac700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d806d5a0 con 0x7f11d806c0a0 2019-11-28T11:37:01.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.962+0000 7f11df1ac700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d806db00 con 0x7f11d806c490 2019-11-28T11:37:01.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.962+0000 7f11df1ac700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d806fd60 con 0x7f11d806d120 2019-11-28T11:37:01.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.962+0000 7f11dd749700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f11d806c0a0 0x7f11d8072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36248/0 (socket says 172.21.15.80:36248) 2019-11-28T11:37:01.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.962+0000 7f11dd749700 1 -- 172.21.15.80:0/2080348187 learned_addr learned my addr 172.21.15.80:0/2080348187 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:01.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.962+0000 7f11ddf4a700 1 --2- 172.21.15.80:0/2080348187 >> v2:172.21.15.174:3300/0 conn(0x7f11d806d120 0x7f11d8165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:01.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.962+0000 7f11d7fff700 1 -- 172.21.15.80:0/2080348187 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955036599 0 0) 0x7f11c0001150 con 0x7f11d806c0a0 2019-11-28T11:37:01.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.962+0000 7f11d7fff700 1 -- 172.21.15.80:0/2080348187 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11c4002e80 con 0x7f11d806c0a0 2019-11-28T11:37:01.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.963+0000 7f11d7fff700 1 -- 172.21.15.80:0/2080348187 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401432066 0 0) 0x7f11c8001080 con 0x7f11d806c490 2019-11-28T11:37:01.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.963+0000 7f11ddf4a700 1 -- 172.21.15.80:0/2080348187 >> v1:172.21.15.174:6789/0 conn(0x7f11d806c490 legacy=0x7f11d806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:01.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.963+0000 7f11ddf4a700 1 -- 172.21.15.80:0/2080348187 >> v1:172.21.15.80:6789/0 conn(0x7f11d806c0a0 legacy=0x7f11d8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:01.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.963+0000 7f11ddf4a700 1 -- 172.21.15.80:0/2080348187 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d80706c0 con 0x7f11d806d120 2019-11-28T11:37:01.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.963+0000 7f11ddf4a700 1 --2- 172.21.15.80:0/2080348187 >> v2:172.21.15.174:3300/0 conn(0x7f11d806d120 0x7f11d8165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f11d000b300 tx=0x7f11d000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.963+0000 7f11ddf4a700 1 --2- 172.21.15.80:0/2080348187 >> v2:172.21.15.174:3300/0 conn(0x7f11d806d120 0x7f11d8165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f11d000b300 tx=0x7f11d000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.963+0000 7f11ddf4a700 1 --2- 172.21.15.80:0/2080348187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11d806d120 0x7f11d8165d80 secure :-1 s=READY pgs=674 cs=0 l=1 rx=0x7f11d000b300 tx=0x7f11d000bb10).ready entity=mon.1 client_cookie=1118560de5125d3c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:01.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.963+0000 7f11ddf4a700 1 --2- 172.21.15.80:0/2080348187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11d806d120 0x7f11d8165d80 secure :-1 s=THROTTLE_DONE pgs=674 cs=0 l=1 rx=0x7f11d000b300 tx=0x7f11d000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.963+0000 7f11d7fff700 1 -- 172.21.15.80:0/2080348187 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d00075c0 con 0x7f11d806d120 2019-11-28T11:37:01.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.963+0000 7f11ddf4a700 1 --2- 172.21.15.80:0/2080348187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11d806d120 0x7f11d8165d80 secure :-1 s=THROTTLE_DONE pgs=674 cs=0 l=1 rx=0x7f11d000b300 tx=0x7f11d000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.963+0000 7f11ddf4a700 1 --2- 172.21.15.80:0/2080348187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11d806d120 0x7f11d8165d80 secure :-1 s=THROTTLE_DONE pgs=674 cs=0 l=1 rx=0x7f11d000b300 tx=0x7f11d000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.963+0000 7f11d7fff700 1 -- 172.21.15.80:0/2080348187 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d0000f30 con 0x7f11d806d120 2019-11-28T11:37:01.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.963+0000 7f11d7fff700 1 -- 172.21.15.80:0/2080348187 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d000a1e0 con 0x7f11d806d120 2019-11-28T11:37:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.963+0000 7f11df1ac700 1 -- 172.21.15.80:0/2080348187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11d806d120 msgr2=0x7f11d8165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.963+0000 7f11df1ac700 1 --2- 172.21.15.80:0/2080348187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11d806d120 0x7f11d8165d80 secure :-1 s=READY pgs=674 cs=0 l=1 rx=0x7f11d000b300 tx=0x7f11d000bb10).stop 2019-11-28T11:37:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.964+0000 7f11df1ac700 1 -- 172.21.15.80:0/2080348187 shutdown_connections 2019-11-28T11:37:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.964+0000 7f11df1ac700 1 --2- 172.21.15.80:0/2080348187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11d806d120 0x7f11d8165d80 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.964+0000 7f11df1ac700 1 -- 172.21.15.80:0/2080348187 shutdown_connections 2019-11-28T11:37:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.964+0000 7f11df1ac700 1 -- 172.21.15.80:0/2080348187 wait complete. 2019-11-28T11:37:01.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.964+0000 7f11df1ac700 1 -- 172.21.15.80:0/2080348187 >> 172.21.15.80:0/2080348187 conn(0x7f11d8061cf0 msgr2=0x7f11d8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:01.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.966+0000 7f11df1ac700 1 Processor -- start 2019-11-28T11:37:01.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.966+0000 7f11df1ac700 1 -- start start 2019-11-28T11:37:01.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.967+0000 7f11df1ac700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11d81145b0 0x7f11d8114a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:01.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.967+0000 7f11df1ac700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d813fc50 con 0x7f11d8114f80 2019-11-28T11:37:01.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.967+0000 7f11df1ac700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d8122ef0 con 0x7f11d813f580 2019-11-28T11:37:01.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.967+0000 7f11df1ac700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8112550 con 0x7f11d81145b0 2019-11-28T11:37:01.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.967+0000 7f11ddf4a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f11d8114f80 0x7f11d8168a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36258/0 (socket says 172.21.15.80:36258) 2019-11-28T11:37:01.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11ddf4a700 1 -- 172.21.15.80:0/3922917863 learned_addr learned my addr 172.21.15.80:0/3922917863 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:01.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11dcf48700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11d81145b0 0x7f11d8114a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:01.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11d5ffb700 1 -- 172.21.15.80:0/3922917863 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809940908 0 0) 0x7f11d0009930 con 0x7f11d8114f80 2019-11-28T11:37:01.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11d5ffb700 1 -- 172.21.15.80:0/3922917863 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11bc002e80 con 0x7f11d8114f80 2019-11-28T11:37:01.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11d5ffb700 1 -- 172.21.15.80:0/3922917863 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712296435 0 0) 0x7f11c0001100 con 0x7f11d813f580 2019-11-28T11:37:01.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11d5ffb700 1 -- 172.21.15.80:0/3922917863 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11bc004170 con 0x7f11d813f580 2019-11-28T11:37:01.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11dcf48700 1 -- 172.21.15.80:0/3922917863 >> v1:172.21.15.174:6789/0 conn(0x7f11d813f580 legacy=0x7f11d8115730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:01.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11dcf48700 1 -- 172.21.15.80:0/3922917863 >> v1:172.21.15.80:6789/0 conn(0x7f11d8114f80 legacy=0x7f11d8168a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:01.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11dcf48700 1 -- 172.21.15.80:0/3922917863 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d8112eb0 con 0x7f11d81145b0 2019-11-28T11:37:01.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11dcf48700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11d81145b0 0x7f11d8114a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f11c80103a0 tx=0x7f11c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11dcf48700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11d81145b0 0x7f11d8114a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f11c80103a0 tx=0x7f11c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11dcf48700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11d81145b0 0x7f11d8114a40 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f11c80103a0 tx=0x7f11c8010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:01.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11dcf48700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11d81145b0 0x7f11d8114a40 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f11c80103a0 tx=0x7f11c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11d5ffb700 1 -- 172.21.15.80:0/3922917863 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11c8009960 con 0x7f11d81145b0 2019-11-28T11:37:01.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11dcf48700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11d81145b0 0x7f11d8114a40 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f11c80103a0 tx=0x7f11c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11d5ffb700 1 -- 172.21.15.80:0/3922917863 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c8000a70 con 0x7f11d81145b0 2019-11-28T11:37:01.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11dcf48700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11d81145b0 0x7f11d8114a40 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f11c80103a0 tx=0x7f11c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11df1ac700 1 -- 172.21.15.80:0/3922917863 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d8113230 con 0x7f11d81145b0 2019-11-28T11:37:01.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11d5ffb700 1 -- 172.21.15.80:0/3922917863 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11c8009b40 con 0x7f11d81145b0 2019-11-28T11:37:01.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.968+0000 7f11df1ac700 1 -- 172.21.15.80:0/3922917863 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d8112eb0 con 0x7f11d81145b0 2019-11-28T11:37:01.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.969+0000 7f11dcf48700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11d81145b0 0x7f11d8114a40 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f11c80103a0 tx=0x7f11c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.969+0000 7f11d5ffb700 1 -- 172.21.15.80:0/3922917863 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f11c8009a20 con 0x7f11d81145b0 2019-11-28T11:37:01.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.969+0000 7f11dcf48700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11d81145b0 0x7f11d8114a40 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f11c80103a0 tx=0x7f11c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.969+0000 7f11d5ffb700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f11bc018750 0x7f11bc01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:01.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.969+0000 7f11d5ffb700 1 -- 172.21.15.80:0/3922917863 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f11c8031ab0 con 0x7f11d81145b0 2019-11-28T11:37:01.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.969+0000 7f11dd749700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f11bc018750 0x7f11bc01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:01.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.969+0000 7f11dd749700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f11bc018750 0x7f11bc01abe0 crc :-1 s=READY pgs=463 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:01.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.976+0000 7f11df1ac700 1 -- 172.21.15.80:0/3922917863 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d8113230 con 0x7f11d81145b0 2019-11-28T11:37:01.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.980+0000 7f11dcf48700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11d81145b0 0x7f11d8114a40 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f11c80103a0 tx=0x7f11c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:00.980+0000 7f11d5ffb700 1 -- 172.21.15.80:0/3922917863 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f11c80097f0 con 0x7f11d81145b0 2019-11-28T11:37:01.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.142+0000 7f11df1ac700 1 -- 172.21.15.80:0/3922917863 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f11d8112eb0 con 0x7f11d81145b0 2019-11-28T11:37:01.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.143+0000 7f11dcf48700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11d81145b0 0x7f11d8114a40 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f11c80103a0 tx=0x7f11c8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.143+0000 7f11d5ffb700 1 -- 172.21.15.80:0/3922917863 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v88) v1 ==== 84+0+64 (secure 0 0 0) 0x7f11c8009a00 con 0x7f11d81145b0 2019-11-28T11:37:01.204 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:37:01.204 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:37:01.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:37:01.205 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:37:01.205 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:37:01.205 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:37:01.205 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:37:01.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.145+0000 7f11df1ac700 1 -- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f11bc018750 msgr2=0x7f11bc01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:01.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.145+0000 7f11df1ac700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f11bc018750 0x7f11bc01abe0 crc :-1 s=READY pgs=463 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:01.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.145+0000 7f11df1ac700 1 -- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11d81145b0 msgr2=0x7f11d8114a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:01.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.145+0000 7f11df1ac700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11d81145b0 0x7f11d8114a40 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f11c80103a0 tx=0x7f11c8010740).stop 2019-11-28T11:37:01.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.145+0000 7f11df1ac700 1 -- 172.21.15.80:0/3922917863 shutdown_connections 2019-11-28T11:37:01.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.145+0000 7f11df1ac700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11d81145b0 0x7f11d8114a40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:01.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.145+0000 7f11df1ac700 1 --2- 172.21.15.80:0/3922917863 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f11bc018750 0x7f11bc01abe0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:01.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.145+0000 7f11df1ac700 1 -- 172.21.15.80:0/3922917863 shutdown_connections 2019-11-28T11:37:01.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.145+0000 7f11df1ac700 1 -- 172.21.15.80:0/3922917863 wait complete. 2019-11-28T11:37:01.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.145+0000 7f11df1ac700 1 -- 172.21.15.80:0/3922917863 >> 172.21.15.80:0/3922917863 conn(0x7f11d81426c0 msgr2=0x7f11d8110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:01.216 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:37:01.216 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:37:01.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.285+0000 7f6f75173700 1 Processor -- start 2019-11-28T11:37:01.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.285+0000 7f6f75173700 1 -- start start 2019-11-28T11:37:01.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.286+0000 7f6f75173700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6f7015ed10 0x7f6f7015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:01.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.286+0000 7f6f75173700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f70073020 0x7f6f70071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:01.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.286+0000 7f6f75173700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7006db60 con 0x7f6f700734b0 2019-11-28T11:37:01.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.286+0000 7f6f75173700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7006fe00 con 0x7f6f7015ed10 2019-11-28T11:37:01.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.286+0000 7f6f75173700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f700700d0 con 0x7f6f70073020 2019-11-28T11:37:01.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.286+0000 7f6f6ed9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f70073020 0x7f6f70071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:01.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.286+0000 7f6f6f59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6f7015ed10 0x7f6f7015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:01.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.286+0000 7f6f6f59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6f7015ed10 0x7f6f7015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:51832/0 (socket says 172.21.15.80:51832) 2019-11-28T11:37:01.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.286+0000 7f6f6ed9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f70073020 0x7f6f70071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:39206/0 (socket says 172.21.15.80:39206) 2019-11-28T11:37:01.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.286+0000 7f6f6f59e700 1 -- 172.21.15.80:0/470468726 learned_addr learned my addr 172.21.15.80:0/470468726 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:01.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.286+0000 7f6f74972700 1 --1- 172.21.15.80:0/470468726 >> v1:172.21.15.174:6789/0 conn(0x7f6f700734b0 0x7f6f700723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:51810/0 (socket says 172.21.15.80:51810) 2019-11-28T11:37:01.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f6ed9d700 1 -- 172.21.15.80:0/470468726 >> v2:172.21.15.174:3300/0 conn(0x7f6f7015ed10 msgr2=0x7f6f7015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:01.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f6ed9d700 1 --2- 172.21.15.80:0/470468726 >> v2:172.21.15.174:3300/0 conn(0x7f6f7015ed10 0x7f6f7015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:01.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f6ed9d700 1 -- 172.21.15.80:0/470468726 >> v1:172.21.15.174:6789/0 conn(0x7f6f700734b0 legacy=0x7f6f700723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:01.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f6ed9d700 1 -- 172.21.15.80:0/470468726 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f70070760 con 0x7f6f70073020 2019-11-28T11:37:01.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f6e59c700 1 -- 172.21.15.80:0/470468726 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910191409 0 0) 0x7f6f600009b0 con 0x7f6f700734b0 2019-11-28T11:37:01.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f6f59e700 1 --2- 172.21.15.80:0/470468726 >> v2:172.21.15.174:3300/0 conn(0x7f6f7015ed10 0x7f6f7015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:37:01.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f6ed9d700 1 --2- 172.21.15.80:0/470468726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f70073020 0x7f6f70071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6f5800af50 tx=0x7f6f5800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f6ed9d700 1 --2- 172.21.15.80:0/470468726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f70073020 0x7f6f70071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6f5800af50 tx=0x7f6f5800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f6ed9d700 1 --2- 172.21.15.80:0/470468726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f70073020 0x7f6f70071ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f6f5800af50 tx=0x7f6f5800b760).ready entity=mon.2 client_cookie=fe8014121b4f1c0a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:01.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f6ed9d700 1 --2- 172.21.15.80:0/470468726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f70073020 0x7f6f70071ea0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f6f5800af50 tx=0x7f6f5800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f6e59c700 1 -- 172.21.15.80:0/470468726 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f58007210 con 0x7f6f70073020 2019-11-28T11:37:01.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f6ed9d700 1 --2- 172.21.15.80:0/470468726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f70073020 0x7f6f70071ea0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f6f5800af50 tx=0x7f6f5800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f6e59c700 1 -- 172.21.15.80:0/470468726 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f580099b0 con 0x7f6f70073020 2019-11-28T11:37:01.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f6ed9d700 1 --2- 172.21.15.80:0/470468726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f70073020 0x7f6f70071ea0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f6f5800af50 tx=0x7f6f5800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f6e59c700 1 -- 172.21.15.80:0/470468726 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f58000960 con 0x7f6f70073020 2019-11-28T11:37:01.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f75173700 1 -- 172.21.15.80:0/470468726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f70073020 msgr2=0x7f6f70071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:01.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.287+0000 7f6f75173700 1 --2- 172.21.15.80:0/470468726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f70073020 0x7f6f70071ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f6f5800af50 tx=0x7f6f5800b760).stop 2019-11-28T11:37:01.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.288+0000 7f6f75173700 1 -- 172.21.15.80:0/470468726 shutdown_connections 2019-11-28T11:37:01.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.288+0000 7f6f75173700 1 --2- 172.21.15.80:0/470468726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f70073020 0x7f6f70071ea0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:01.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.288+0000 7f6f75173700 1 --2- 172.21.15.80:0/470468726 >> v2:172.21.15.174:3300/0 conn(0x7f6f7015ed10 0x7f6f7015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:01.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.288+0000 7f6f75173700 1 -- 172.21.15.80:0/470468726 shutdown_connections 2019-11-28T11:37:01.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.288+0000 7f6f75173700 1 -- 172.21.15.80:0/470468726 wait complete. 2019-11-28T11:37:01.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.288+0000 7f6f75173700 1 -- 172.21.15.80:0/470468726 >> 172.21.15.80:0/470468726 conn(0x7f6f70061d20 msgr2=0x7f6f700641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:01.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.290+0000 7f6f75173700 1 Processor -- start 2019-11-28T11:37:01.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.290+0000 7f6f75173700 1 -- start start 2019-11-28T11:37:01.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.291+0000 7f6f75173700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f7012e4b0 0x7f6f7012e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:01.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.291+0000 7f6f75173700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6f7013a430 0x7f6f70139620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:01.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.291+0000 7f6f75173700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7012ede0 con 0x7f6f70139fa0 2019-11-28T11:37:01.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.291+0000 7f6f75173700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f70136d80 con 0x7f6f7012e4b0 2019-11-28T11:37:01.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.291+0000 7f6f75173700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f70137050 con 0x7f6f7013a430 2019-11-28T11:37:01.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.291+0000 7f6f6f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f7012e4b0 0x7f6f7012e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:01.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.291+0000 7f6f6f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f7012e4b0 0x7f6f7012e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36952/0 (socket says 172.21.15.80:36952) 2019-11-28T11:37:01.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.291+0000 7f6f6f59e700 1 -- 172.21.15.80:0/3251054452 learned_addr learned my addr 172.21.15.80:0/3251054452 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:01.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.291+0000 7f6f74972700 1 --2- 172.21.15.80:0/3251054452 >> v2:172.21.15.174:3300/0 conn(0x7f6f7013a430 0x7f6f70139620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:01.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f6f59e700 1 -- 172.21.15.80:0/3251054452 >> v2:172.21.15.174:3300/0 conn(0x7f6f7013a430 msgr2=0x7f6f70139620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:01.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f6f59e700 1 --2- 172.21.15.80:0/3251054452 >> v2:172.21.15.174:3300/0 conn(0x7f6f7013a430 0x7f6f70139620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f6f59e700 1 -- 172.21.15.80:0/3251054452 >> v1:172.21.15.80:6789/0 conn(0x7f6f70139fa0 legacy=0x7f6f70138e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f6f59e700 1 -- 172.21.15.80:0/3251054452 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f701376e0 con 0x7f6f7012e4b0 2019-11-28T11:37:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f6f59e700 1 --2- 172.21.15.80:0/3251054452 >> v2:172.21.15.80:3300/0 conn(0x7f6f7012e4b0 0x7f6f7012e8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f680107e0 tx=0x7f6f68010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f6f59e700 1 --2- 172.21.15.80:0/3251054452 >> v2:172.21.15.80:3300/0 conn(0x7f6f7012e4b0 0x7f6f7012e8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f680107e0 tx=0x7f6f68010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f6f59e700 1 --2- 172.21.15.80:0/3251054452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f7012e4b0 0x7f6f7012e8a0 secure :-1 s=READY pgs=1145 cs=0 l=1 rx=0x7f6f680107e0 tx=0x7f6f68010610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f6f59e700 1 --2- 172.21.15.80:0/3251054452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f7012e4b0 0x7f6f7012e8a0 secure :-1 s=THROTTLE_DONE pgs=1145 cs=0 l=1 rx=0x7f6f680107e0 tx=0x7f6f68010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f67fff700 1 -- 172.21.15.80:0/3251054452 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f68000cc0 con 0x7f6f7012e4b0 2019-11-28T11:37:01.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f6f59e700 1 --2- 172.21.15.80:0/3251054452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f7012e4b0 0x7f6f7012e8a0 secure :-1 s=THROTTLE_DONE pgs=1145 cs=0 l=1 rx=0x7f6f680107e0 tx=0x7f6f68010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f6f59e700 1 --2- 172.21.15.80:0/3251054452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f7012e4b0 0x7f6f7012e8a0 secure :-1 s=THROTTLE_DONE pgs=1145 cs=0 l=1 rx=0x7f6f680107e0 tx=0x7f6f68010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f67fff700 1 -- 172.21.15.80:0/3251054452 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f68001200 con 0x7f6f7012e4b0 2019-11-28T11:37:01.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f75173700 1 -- 172.21.15.80:0/3251054452 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f70137a60 con 0x7f6f7012e4b0 2019-11-28T11:37:01.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f67fff700 1 -- 172.21.15.80:0/3251054452 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f680018d0 con 0x7f6f7012e4b0 2019-11-28T11:37:01.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f75173700 1 -- 172.21.15.80:0/3251054452 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f701376e0 con 0x7f6f7012e4b0 2019-11-28T11:37:01.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f6f59e700 1 --2- 172.21.15.80:0/3251054452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f7012e4b0 0x7f6f7012e8a0 secure :-1 s=THROTTLE_DONE pgs=1145 cs=0 l=1 rx=0x7f6f680107e0 tx=0x7f6f68010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f67fff700 1 -- 172.21.15.80:0/3251054452 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6f680013f0 con 0x7f6f7012e4b0 2019-11-28T11:37:01.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.292+0000 7f6f6f59e700 1 --2- 172.21.15.80:0/3251054452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f7012e4b0 0x7f6f7012e8a0 secure :-1 s=THROTTLE_DONE pgs=1145 cs=0 l=1 rx=0x7f6f680107e0 tx=0x7f6f68010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.293+0000 7f6f67fff700 1 --2- 172.21.15.80:0/3251054452 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6f48018730 0x7f6f4801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:01.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.293+0000 7f6f67fff700 1 -- 172.21.15.80:0/3251054452 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f6f68031e50 con 0x7f6f7012e4b0 2019-11-28T11:37:01.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.293+0000 7f6f6ed9d700 1 --2- 172.21.15.80:0/3251054452 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6f48018730 0x7f6f4801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:01.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.293+0000 7f6f6ed9d700 1 --2- 172.21.15.80:0/3251054452 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6f48018730 0x7f6f4801abc0 crc :-1 s=READY pgs=464 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:01.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.300+0000 7f6f75173700 1 -- 172.21.15.80:0/3251054452 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f70137a60 con 0x7f6f7012e4b0 2019-11-28T11:37:01.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.304+0000 7f6f6f59e700 1 --2- 172.21.15.80:0/3251054452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f7012e4b0 0x7f6f7012e8a0 secure :-1 s=THROTTLE_DONE pgs=1145 cs=0 l=1 rx=0x7f6f680107e0 tx=0x7f6f68010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.304+0000 7f6f67fff700 1 -- 172.21.15.80:0/3251054452 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6f68007990 con 0x7f6f7012e4b0 2019-11-28T11:37:01.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.470+0000 7f6f75173700 1 -- 172.21.15.80:0/3251054452 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f6f701376e0 con 0x7f6f7012e4b0 2019-11-28T11:37:01.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.835+0000 7f6f6f59e700 1 --2- 172.21.15.80:0/3251054452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f7012e4b0 0x7f6f7012e8a0 secure :-1 s=THROTTLE_DONE pgs=1145 cs=0 l=1 rx=0x7f6f680107e0 tx=0x7f6f68010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:01.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.835+0000 7f6f67fff700 1 -- 172.21.15.80:0/3251054452 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v89) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6f680013d0 con 0x7f6f7012e4b0 2019-11-28T11:37:01.945 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:37:01.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.886+0000 7f6f75173700 1 -- 172.21.15.80:0/3251054452 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6f48018730 msgr2=0x7f6f4801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:01.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.886+0000 7f6f75173700 1 --2- 172.21.15.80:0/3251054452 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6f48018730 0x7f6f4801abc0 crc :-1 s=READY pgs=464 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:01.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.886+0000 7f6f75173700 1 -- 172.21.15.80:0/3251054452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f7012e4b0 msgr2=0x7f6f7012e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:01.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.886+0000 7f6f75173700 1 --2- 172.21.15.80:0/3251054452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f7012e4b0 0x7f6f7012e8a0 secure :-1 s=READY pgs=1145 cs=0 l=1 rx=0x7f6f680107e0 tx=0x7f6f68010610).stop 2019-11-28T11:37:01.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.886+0000 7f6f75173700 1 -- 172.21.15.80:0/3251054452 shutdown_connections 2019-11-28T11:37:01.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.886+0000 7f6f75173700 1 --2- 172.21.15.80:0/3251054452 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6f48018730 0x7f6f4801abc0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:01.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.886+0000 7f6f75173700 1 --2- 172.21.15.80:0/3251054452 >> v2:172.21.15.174:3300/0 conn(0x7f6f7013a430 0x7f6f70139620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:01.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.886+0000 7f6f75173700 1 --2- 172.21.15.80:0/3251054452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f7012e4b0 0x7f6f7012e8a0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:01.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.887+0000 7f6f75173700 1 -- 172.21.15.80:0/3251054452 shutdown_connections 2019-11-28T11:37:01.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.887+0000 7f6f75173700 1 -- 172.21.15.80:0/3251054452 wait complete. 2019-11-28T11:37:01.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:01.887+0000 7f6f75173700 1 -- 172.21.15.80:0/3251054452 >> 172.21.15.80:0/3251054452 conn(0x7f6f7014c410 msgr2=0x7f6f70148660 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:01.958 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:37:02.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.021+0000 7fadf11b8700 1 Processor -- start 2019-11-28T11:37:02.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.021+0000 7fadf11b8700 1 -- start start 2019-11-28T11:37:02.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.022+0000 7fadf11b8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fadec15ed10 0x7fadec15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:02.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.022+0000 7fadf11b8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadec073020 0x7fadec071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:02.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.022+0000 7fadf11b8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec06db60 con 0x7fadec0734b0 2019-11-28T11:37:02.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.022+0000 7fadf11b8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadec06fe00 con 0x7fadec15ed10 2019-11-28T11:37:02.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.022+0000 7fadf11b8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0700d0 con 0x7fadec073020 2019-11-28T11:37:02.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadead9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadec073020 0x7fadec071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:02.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadeb59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fadec15ed10 0x7fadec15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:02.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadead9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadec073020 0x7fadec071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:39224/0 (socket says 172.21.15.80:39224) 2019-11-28T11:37:02.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadf09b7700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fadec0734b0 0x7fadec0723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:51822/0 (socket says 172.21.15.80:51822) 2019-11-28T11:37:02.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadead9d700 1 -- 172.21.15.80:0/570801882 learned_addr learned my addr 172.21.15.80:0/570801882 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:02.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadead9d700 1 -- 172.21.15.80:0/570801882 >> v2:172.21.15.174:3300/0 conn(0x7fadec15ed10 msgr2=0x7fadec15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:02.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadead9d700 1 --2- 172.21.15.80:0/570801882 >> v2:172.21.15.174:3300/0 conn(0x7fadec15ed10 0x7fadec15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:02.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadead9d700 1 -- 172.21.15.80:0/570801882 >> v1:172.21.15.174:6789/0 conn(0x7fadec0734b0 legacy=0x7fadec0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:02.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadead9d700 1 -- 172.21.15.80:0/570801882 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec070760 con 0x7fadec073020 2019-11-28T11:37:02.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadea59c700 1 -- 172.21.15.80:0/570801882 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533217613 0 0) 0x7fade4000d30 con 0x7fadec0734b0 2019-11-28T11:37:02.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadeb59e700 1 --2- 172.21.15.80:0/570801882 >> v2:172.21.15.174:3300/0 conn(0x7fadec15ed10 0x7fadec15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:37:02.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadead9d700 1 --2- 172.21.15.80:0/570801882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadec073020 0x7fadec071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fadd400f740 tx=0x7fadd400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:02.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadead9d700 1 --2- 172.21.15.80:0/570801882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadec073020 0x7fadec071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fadd400f740 tx=0x7fadd400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:02.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadead9d700 1 --2- 172.21.15.80:0/570801882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadec073020 0x7fadec071ea0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7fadd400f740 tx=0x7fadd400fae0).ready entity=mon.2 client_cookie=c4ea5578557c7729 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:02.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadead9d700 1 --2- 172.21.15.80:0/570801882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadec073020 0x7fadec071ea0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fadd400f740 tx=0x7fadd400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:02.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadea59c700 1 -- 172.21.15.80:0/570801882 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadd4000960 con 0x7fadec073020 2019-11-28T11:37:02.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadead9d700 1 --2- 172.21.15.80:0/570801882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadec073020 0x7fadec071ea0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fadd400f740 tx=0x7fadd400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:02.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadead9d700 1 --2- 172.21.15.80:0/570801882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadec073020 0x7fadec071ea0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fadd400f740 tx=0x7fadd400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:02.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadea59c700 1 -- 172.21.15.80:0/570801882 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd4000c90 con 0x7fadec073020 2019-11-28T11:37:02.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadea59c700 1 -- 172.21.15.80:0/570801882 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadd40013a0 con 0x7fadec073020 2019-11-28T11:37:02.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadf11b8700 1 -- 172.21.15.80:0/570801882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadec073020 msgr2=0x7fadec071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:02.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.023+0000 7fadf11b8700 1 --2- 172.21.15.80:0/570801882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadec073020 0x7fadec071ea0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7fadd400f740 tx=0x7fadd400fae0).stop 2019-11-28T11:37:02.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.024+0000 7fadf11b8700 1 -- 172.21.15.80:0/570801882 shutdown_connections 2019-11-28T11:37:02.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.024+0000 7fadf11b8700 1 --2- 172.21.15.80:0/570801882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadec073020 0x7fadec071ea0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:02.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.024+0000 7fadf11b8700 1 --2- 172.21.15.80:0/570801882 >> v2:172.21.15.174:3300/0 conn(0x7fadec15ed10 0x7fadec15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:02.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.024+0000 7fadf11b8700 1 -- 172.21.15.80:0/570801882 shutdown_connections 2019-11-28T11:37:02.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.024+0000 7fadf11b8700 1 -- 172.21.15.80:0/570801882 wait complete. 2019-11-28T11:37:02.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.024+0000 7fadf11b8700 1 -- 172.21.15.80:0/570801882 >> 172.21.15.80:0/570801882 conn(0x7fadec061d20 msgr2=0x7fadec0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:02.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.026+0000 7fadf11b8700 1 Processor -- start 2019-11-28T11:37:02.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.027+0000 7fadf11b8700 1 -- start start 2019-11-28T11:37:02.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.027+0000 7fadf11b8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fadec148320 0x7fadec10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:02.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadf11b8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadec10f290 0x7fadec10dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:02.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadf11b8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec148e00 con 0x7fadec10e110 2019-11-28T11:37:02.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadf11b8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadec13aa20 con 0x7fadec10f290 2019-11-28T11:37:02.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadf11b8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadec13acf0 con 0x7fadec148320 2019-11-28T11:37:02.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadead9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadec10f290 0x7fadec10dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:02.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadead9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadec10f290 0x7fadec10dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36968/0 (socket says 172.21.15.80:36968) 2019-11-28T11:37:02.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadead9d700 1 -- 172.21.15.80:0/863477662 learned_addr learned my addr 172.21.15.80:0/863477662 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:02.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadeb59e700 1 --2- 172.21.15.80:0/863477662 >> v2:172.21.15.174:3300/0 conn(0x7fadec148320 0x7fadec10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:02.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadead9d700 1 -- 172.21.15.80:0/863477662 >> v2:172.21.15.174:3300/0 conn(0x7fadec148320 msgr2=0x7fadec10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:02.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadead9d700 1 --2- 172.21.15.80:0/863477662 >> v2:172.21.15.174:3300/0 conn(0x7fadec148320 0x7fadec10ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:02.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadead9d700 1 -- 172.21.15.80:0/863477662 >> v1:172.21.15.174:6789/0 conn(0x7fadec10e110 legacy=0x7fadec1079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:02.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadead9d700 1 -- 172.21.15.80:0/863477662 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec10c490 con 0x7fadec10f290 2019-11-28T11:37:02.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadead9d700 1 --2- 172.21.15.80:0/863477662 >> v2:172.21.15.80:3300/0 conn(0x7fadec10f290 0x7fadec10dbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fadd4010440 tx=0x7fadd40102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:02.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadead9d700 1 --2- 172.21.15.80:0/863477662 >> v2:172.21.15.80:3300/0 conn(0x7fadec10f290 0x7fadec10dbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fadd4010440 tx=0x7fadd40102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:02.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadead9d700 1 --2- 172.21.15.80:0/863477662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadec10f290 0x7fadec10dbd0 secure :-1 s=READY pgs=1146 cs=0 l=1 rx=0x7fadd4010440 tx=0x7fadd40102f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:02.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadead9d700 1 --2- 172.21.15.80:0/863477662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadec10f290 0x7fadec10dbd0 secure :-1 s=THROTTLE_DONE pgs=1146 cs=0 l=1 rx=0x7fadd4010440 tx=0x7fadd40102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fade3fff700 1 -- 172.21.15.80:0/863477662 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadd4005560 con 0x7fadec10f290 2019-11-28T11:37:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadead9d700 1 --2- 172.21.15.80:0/863477662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadec10f290 0x7fadec10dbd0 secure :-1 s=THROTTLE_DONE pgs=1146 cs=0 l=1 rx=0x7fadd4010440 tx=0x7fadd40102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadead9d700 1 --2- 172.21.15.80:0/863477662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadec10f290 0x7fadec10dbd0 secure :-1 s=THROTTLE_DONE pgs=1146 cs=0 l=1 rx=0x7fadd4010440 tx=0x7fadd40102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fade3fff700 1 -- 172.21.15.80:0/863477662 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd4005180 con 0x7fadec10f290 2019-11-28T11:37:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fade3fff700 1 -- 172.21.15.80:0/863477662 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadd4005b40 con 0x7fadec10f290 2019-11-28T11:37:02.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadf11b8700 1 -- 172.21.15.80:0/863477662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadec10c810 con 0x7fadec10f290 2019-11-28T11:37:02.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.028+0000 7fadf11b8700 1 -- 172.21.15.80:0/863477662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadec10c490 con 0x7fadec10f290 2019-11-28T11:37:02.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.029+0000 7fadead9d700 1 --2- 172.21.15.80:0/863477662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadec10f290 0x7fadec10dbd0 secure :-1 s=THROTTLE_DONE pgs=1146 cs=0 l=1 rx=0x7fadd4010440 tx=0x7fadd40102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:02.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.029+0000 7fade3fff700 1 -- 172.21.15.80:0/863477662 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fadd4005370 con 0x7fadec10f290 2019-11-28T11:37:02.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.029+0000 7fadead9d700 1 --2- 172.21.15.80:0/863477662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadec10f290 0x7fadec10dbd0 secure :-1 s=THROTTLE_DONE pgs=1146 cs=0 l=1 rx=0x7fadd4010440 tx=0x7fadd40102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:02.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.029+0000 7fade3fff700 1 --2- 172.21.15.80:0/863477662 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fadc4018730 0x7fadc401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:02.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.029+0000 7fade3fff700 1 -- 172.21.15.80:0/863477662 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fadd4031aa0 con 0x7fadec10f290 2019-11-28T11:37:02.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.029+0000 7fadeb59e700 1 --2- 172.21.15.80:0/863477662 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fadc4018730 0x7fadc401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:02.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.029+0000 7fadeb59e700 1 --2- 172.21.15.80:0/863477662 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fadc4018730 0x7fadc401abc0 crc :-1 s=READY pgs=465 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:02.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.037+0000 7fadf11b8700 1 -- 172.21.15.80:0/863477662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadec10c810 con 0x7fadec10f290 2019-11-28T11:37:02.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.040+0000 7fadead9d700 1 --2- 172.21.15.80:0/863477662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadec10f290 0x7fadec10dbd0 secure :-1 s=THROTTLE_DONE pgs=1146 cs=0 l=1 rx=0x7fadd4010440 tx=0x7fadd40102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:02.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.040+0000 7fade3fff700 1 -- 172.21.15.80:0/863477662 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fadd40072a0 con 0x7fadec10f290 2019-11-28T11:37:02.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.210+0000 7fadf11b8700 1 -- 172.21.15.80:0/863477662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7fadec10c490 con 0x7fadec10f290 2019-11-28T11:37:02.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.842+0000 7fadead9d700 1 --2- 172.21.15.80:0/863477662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadec10f290 0x7fadec10dbd0 secure :-1 s=THROTTLE_DONE pgs=1146 cs=0 l=1 rx=0x7fadd4010440 tx=0x7fadd40102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:02.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.842+0000 7fade3fff700 1 -- 172.21.15.80:0/863477662 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v90) v1 ==== 125+0+0 (secure 0 0 0) 0x7fadd4005370 con 0x7fadec10f290 2019-11-28T11:37:02.935 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:37:02.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.877+0000 7fadf11b8700 1 -- 172.21.15.80:0/863477662 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fadc4018730 msgr2=0x7fadc401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:02.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.877+0000 7fadf11b8700 1 --2- 172.21.15.80:0/863477662 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fadc4018730 0x7fadc401abc0 crc :-1 s=READY pgs=465 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:02.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.877+0000 7fadf11b8700 1 -- 172.21.15.80:0/863477662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadec10f290 msgr2=0x7fadec10dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:02.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.877+0000 7fadf11b8700 1 --2- 172.21.15.80:0/863477662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadec10f290 0x7fadec10dbd0 secure :-1 s=READY pgs=1146 cs=0 l=1 rx=0x7fadd4010440 tx=0x7fadd40102f0).stop 2019-11-28T11:37:02.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.877+0000 7fadf11b8700 1 -- 172.21.15.80:0/863477662 shutdown_connections 2019-11-28T11:37:02.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.877+0000 7fadf11b8700 1 --2- 172.21.15.80:0/863477662 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fadc4018730 0x7fadc401abc0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:02.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.877+0000 7fadf11b8700 1 --2- 172.21.15.80:0/863477662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadec10f290 0x7fadec10dbd0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:02.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.877+0000 7fadf11b8700 1 --2- 172.21.15.80:0/863477662 >> v2:172.21.15.174:3300/0 conn(0x7fadec148320 0x7fadec10ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:02.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.877+0000 7fadf11b8700 1 -- 172.21.15.80:0/863477662 shutdown_connections 2019-11-28T11:37:02.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.877+0000 7fadf11b8700 1 -- 172.21.15.80:0/863477662 wait complete. 2019-11-28T11:37:02.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:02.877+0000 7fadf11b8700 1 -- 172.21.15.80:0/863477662 >> 172.21.15.80:0/863477662 conn(0x7fadec15e2d0 msgr2=0x7fadec147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:02.955 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:37:03.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.017+0000 7f3753bb8700 1 Processor -- start 2019-11-28T11:37:03.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.017+0000 7f3753bb8700 1 -- start start 2019-11-28T11:37:03.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.018+0000 7f3753bb8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f374c15f100 0x7f374c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:03.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.018+0000 7f3753bb8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c06db60 con 0x7f374c06c2f0 2019-11-28T11:37:03.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.018+0000 7f3753bb8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c06e060 con 0x7f374c15ed10 2019-11-28T11:37:03.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.018+0000 7f3753bb8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374c06fe00 con 0x7f374c15f100 2019-11-28T11:37:03.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.018+0000 7f3752956700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f374c06c2f0 0x7f374c06c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36292/0 (socket says 172.21.15.80:36292) 2019-11-28T11:37:03.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.018+0000 7f3752956700 1 -- 172.21.15.80:0/4011373322 learned_addr learned my addr 172.21.15.80:0/4011373322 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:03.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751954700 1 --2- 172.21.15.80:0/4011373322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f374c15f100 0x7f374c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:03.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751153700 1 -- 172.21.15.80:0/4011373322 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838159020 0 0) 0x7f3744001150 con 0x7f374c06c2f0 2019-11-28T11:37:03.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751153700 1 -- 172.21.15.80:0/4011373322 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3738002e80 con 0x7f374c06c2f0 2019-11-28T11:37:03.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751153700 1 -- 172.21.15.80:0/4011373322 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655821834 0 0) 0x7f3734001400 con 0x7f374c15ed10 2019-11-28T11:37:03.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751153700 1 -- 172.21.15.80:0/4011373322 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37380030b0 con 0x7f374c15ed10 2019-11-28T11:37:03.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751153700 1 -- 172.21.15.80:0/4011373322 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3527233091 0 0) 0x7f3744001130 con 0x7f374c06c2f0 2019-11-28T11:37:03.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751954700 1 -- 172.21.15.80:0/4011373322 >> v1:172.21.15.174:6789/0 conn(0x7f374c15ed10 legacy=0x7f374c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751954700 1 -- 172.21.15.80:0/4011373322 >> v1:172.21.15.80:6789/0 conn(0x7f374c06c2f0 legacy=0x7f374c06c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751954700 1 -- 172.21.15.80:0/4011373322 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c070760 con 0x7f374c15f100 2019-11-28T11:37:03.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751954700 1 --2- 172.21.15.80:0/4011373322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f374c15f100 0x7f374c06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f373c00af50 tx=0x7f373c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751954700 1 --2- 172.21.15.80:0/4011373322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f374c15f100 0x7f374c06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f373c00af50 tx=0x7f373c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751954700 1 --2- 172.21.15.80:0/4011373322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f374c15f100 0x7f374c06bdb0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7f373c00af50 tx=0x7f373c00b760).ready entity=mon.2 client_cookie=1e49c3b8807df4b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:03.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751954700 1 --2- 172.21.15.80:0/4011373322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f374c15f100 0x7f374c06bdb0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f373c00af50 tx=0x7f373c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751153700 1 -- 172.21.15.80:0/4011373322 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f373c000960 con 0x7f374c15f100 2019-11-28T11:37:03.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751954700 1 --2- 172.21.15.80:0/4011373322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f374c15f100 0x7f374c06bdb0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f373c00af50 tx=0x7f373c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751954700 1 --2- 172.21.15.80:0/4011373322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f374c15f100 0x7f374c06bdb0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f373c00af50 tx=0x7f373c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751153700 1 -- 172.21.15.80:0/4011373322 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c009860 con 0x7f374c15f100 2019-11-28T11:37:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3751153700 1 -- 172.21.15.80:0/4011373322 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f373c000960 con 0x7f374c15f100 2019-11-28T11:37:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3753bb8700 1 -- 172.21.15.80:0/4011373322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f374c15f100 msgr2=0x7f374c06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.019+0000 7f3753bb8700 1 --2- 172.21.15.80:0/4011373322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f374c15f100 0x7f374c06bdb0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7f373c00af50 tx=0x7f373c00b760).stop 2019-11-28T11:37:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.020+0000 7f3753bb8700 1 -- 172.21.15.80:0/4011373322 shutdown_connections 2019-11-28T11:37:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.020+0000 7f3753bb8700 1 --2- 172.21.15.80:0/4011373322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f374c15f100 0x7f374c06bdb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.020+0000 7f3753bb8700 1 -- 172.21.15.80:0/4011373322 shutdown_connections 2019-11-28T11:37:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.020+0000 7f3753bb8700 1 -- 172.21.15.80:0/4011373322 wait complete. 2019-11-28T11:37:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.020+0000 7f3753bb8700 1 -- 172.21.15.80:0/4011373322 >> 172.21.15.80:0/4011373322 conn(0x7f374c061d20 msgr2=0x7f374c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.023+0000 7f3753bb8700 1 Processor -- start 2019-11-28T11:37:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.023+0000 7f3753bb8700 1 -- start start 2019-11-28T11:37:03.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.023+0000 7f3753bb8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f374c148320 0x7f374c10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:03.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.023+0000 7f3753bb8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f374c10e3d0 0x7f374c168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:03.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.023+0000 7f3753bb8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c148e00 con 0x7f374c10f290 2019-11-28T11:37:03.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.023+0000 7f3753bb8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374c139ff0 con 0x7f374c10e3d0 2019-11-28T11:37:03.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.023+0000 7f3753bb8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374c13aa20 con 0x7f374c148320 2019-11-28T11:37:03.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3752956700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f374c10e3d0 0x7f374c168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:03.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3752956700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f374c10e3d0 0x7f374c168d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36984/0 (socket says 172.21.15.80:36984) 2019-11-28T11:37:03.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3752956700 1 -- 172.21.15.80:0/268722179 learned_addr learned my addr 172.21.15.80:0/268722179 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:03.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3752155700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f374c148320 0x7f374c10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:03.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3752956700 1 -- 172.21.15.80:0/268722179 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f374c148320 msgr2=0x7f374c10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3752956700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f374c148320 0x7f374c10ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:03.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3752956700 1 -- 172.21.15.80:0/268722179 >> v1:172.21.15.80:6789/0 conn(0x7f374c10f290 legacy=0x7f374c10dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f374affd700 1 -- 172.21.15.80:0/268722179 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113449966 0 0) 0x7f373c00abb0 con 0x7f374c10f290 2019-11-28T11:37:03.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3752956700 1 -- 172.21.15.80:0/268722179 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c10c490 con 0x7f374c10e3d0 2019-11-28T11:37:03.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3752956700 1 --2- 172.21.15.80:0/268722179 >> v2:172.21.15.80:3300/0 conn(0x7f374c10e3d0 0x7f374c168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3744010430 tx=0x7f3744010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3752956700 1 --2- 172.21.15.80:0/268722179 >> v2:172.21.15.80:3300/0 conn(0x7f374c10e3d0 0x7f374c168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3744010430 tx=0x7f3744010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3752956700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f374c10e3d0 0x7f374c168d80 secure :-1 s=READY pgs=1149 cs=0 l=1 rx=0x7f3744010430 tx=0x7f3744010260).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:03.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3752956700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f374c10e3d0 0x7f374c168d80 secure :-1 s=THROTTLE_DONE pgs=1149 cs=0 l=1 rx=0x7f3744010430 tx=0x7f3744010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f374affd700 1 -- 172.21.15.80:0/268722179 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3744000940 con 0x7f374c10e3d0 2019-11-28T11:37:03.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3752956700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f374c10e3d0 0x7f374c168d80 secure :-1 s=THROTTLE_DONE pgs=1149 cs=0 l=1 rx=0x7f3744010430 tx=0x7f3744010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3753bb8700 1 -- 172.21.15.80:0/268722179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374c10c810 con 0x7f374c10e3d0 2019-11-28T11:37:03.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3752956700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f374c10e3d0 0x7f374c168d80 secure :-1 s=THROTTLE_DONE pgs=1149 cs=0 l=1 rx=0x7f3744010430 tx=0x7f3744010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f374affd700 1 -- 172.21.15.80:0/268722179 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3744000940 con 0x7f374c10e3d0 2019-11-28T11:37:03.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f374affd700 1 -- 172.21.15.80:0/268722179 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3744004430 con 0x7f374c10e3d0 2019-11-28T11:37:03.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3753bb8700 1 -- 172.21.15.80:0/268722179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374c10c490 con 0x7f374c10e3d0 2019-11-28T11:37:03.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.024+0000 7f3752956700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f374c10e3d0 0x7f374c168d80 secure :-1 s=THROTTLE_DONE pgs=1149 cs=0 l=1 rx=0x7f3744010430 tx=0x7f3744010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.025+0000 7f374affd700 1 -- 172.21.15.80:0/268722179 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3744004240 con 0x7f374c10e3d0 2019-11-28T11:37:03.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.025+0000 7f3752956700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f374c10e3d0 0x7f374c168d80 secure :-1 s=THROTTLE_DONE pgs=1149 cs=0 l=1 rx=0x7f3744010430 tx=0x7f3744010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.025+0000 7f374affd700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3730018730 0x7f373001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:03.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.025+0000 7f374affd700 1 -- 172.21.15.80:0/268722179 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5904+0+0 (secure 0 0 0) 0x7f3744031d50 con 0x7f374c10e3d0 2019-11-28T11:37:03.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.025+0000 7f3752155700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3730018730 0x7f373001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:03.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.025+0000 7f3752155700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3730018730 0x7f373001abc0 crc :-1 s=READY pgs=466 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:03.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.032+0000 7f3753bb8700 1 -- 172.21.15.80:0/268722179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374c10c810 con 0x7f374c10e3d0 2019-11-28T11:37:03.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.036+0000 7f3752956700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f374c10e3d0 0x7f374c168d80 secure :-1 s=THROTTLE_DONE pgs=1149 cs=0 l=1 rx=0x7f3744010430 tx=0x7f3744010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.036+0000 7f374affd700 1 -- 172.21.15.80:0/268722179 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3744000940 con 0x7f374c10e3d0 2019-11-28T11:37:03.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.203+0000 7f3753bb8700 1 -- 172.21.15.80:0/268722179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f374c10c490 con 0x7f374c10e3d0 2019-11-28T11:37:03.265 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:37:03.204+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:37:03.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.207+0000 7f3752956700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f374c10e3d0 0x7f374c168d80 secure :-1 s=THROTTLE_DONE pgs=1149 cs=0 l=1 rx=0x7f3744010430 tx=0x7f3744010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.207+0000 7f374affd700 1 -- 172.21.15.80:0/268722179 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 14 and data pool 15 v56) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3744004240 con 0x7f374c10e3d0 2019-11-28T11:37:03.272 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 14 and data pool 15 2019-11-28T11:37:03.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.213+0000 7f3753bb8700 1 -- 172.21.15.80:0/268722179 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3730018730 msgr2=0x7f373001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.213+0000 7f3753bb8700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3730018730 0x7f373001abc0 crc :-1 s=READY pgs=466 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:03.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.213+0000 7f3753bb8700 1 -- 172.21.15.80:0/268722179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f374c10e3d0 msgr2=0x7f374c168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.213+0000 7f3753bb8700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f374c10e3d0 0x7f374c168d80 secure :-1 s=READY pgs=1149 cs=0 l=1 rx=0x7f3744010430 tx=0x7f3744010260).stop 2019-11-28T11:37:03.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.213+0000 7f3753bb8700 1 -- 172.21.15.80:0/268722179 shutdown_connections 2019-11-28T11:37:03.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.213+0000 7f3753bb8700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3730018730 0x7f373001abc0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:03.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.213+0000 7f3753bb8700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f374c10e3d0 0x7f374c168d80 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:03.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.213+0000 7f3753bb8700 1 --2- 172.21.15.80:0/268722179 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f374c148320 0x7f374c10ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:03.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.213+0000 7f3753bb8700 1 -- 172.21.15.80:0/268722179 shutdown_connections 2019-11-28T11:37:03.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.213+0000 7f3753bb8700 1 -- 172.21.15.80:0/268722179 wait complete. 2019-11-28T11:37:03.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.213+0000 7f3753bb8700 1 -- 172.21.15.80:0/268722179 >> 172.21.15.80:0/268722179 conn(0x7f374c15e2d0 msgr2=0x7f374c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:03.284 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:37:03.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.343+0000 7f6c159db700 1 Processor -- start 2019-11-28T11:37:03.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.343+0000 7f6c159db700 1 -- start start 2019-11-28T11:37:03.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.344+0000 7f6c159db700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c1006c0a0 0x7f6c10072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:03.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.344+0000 7f6c159db700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1006db00 con 0x7f6c10072620 2019-11-28T11:37:03.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.344+0000 7f6c159db700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1006e000 con 0x7f6c100734e0 2019-11-28T11:37:03.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.344+0000 7f6c159db700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1006f330 con 0x7f6c1006c0a0 2019-11-28T11:37:03.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.344+0000 7f6c0ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6c10072620 0x7f6c10164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36306/0 (socket says 172.21.15.80:36306) 2019-11-28T11:37:03.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.344+0000 7f6c0ffff700 1 -- 172.21.15.80:0/1343877645 learned_addr learned my addr 172.21.15.80:0/1343877645 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:03.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.344+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/1343877645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c1006c0a0 0x7f6c10072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:03.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.344+0000 7f6c0e7fc700 1 -- 172.21.15.80:0/1343877645 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664644269 0 0) 0x7f6c08001150 con 0x7f6c10072620 2019-11-28T11:37:03.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.344+0000 7f6c0e7fc700 1 -- 172.21.15.80:0/1343877645 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf0002e80 con 0x7f6c10072620 2019-11-28T11:37:03.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c0e7fc700 1 -- 172.21.15.80:0/1343877645 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184484726 0 0) 0x7f6bf80013b0 con 0x7f6c100734e0 2019-11-28T11:37:03.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c0e7fc700 1 -- 172.21.15.80:0/1343877645 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf00030b0 con 0x7f6c100734e0 2019-11-28T11:37:03.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c0e7fc700 1 -- 172.21.15.80:0/1343877645 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 197076133 0 0) 0x7f6c08001130 con 0x7f6c10072620 2019-11-28T11:37:03.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c0f7fe700 1 -- 172.21.15.80:0/1343877645 >> v1:172.21.15.174:6789/0 conn(0x7f6c100734e0 legacy=0x7f6c10071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c0f7fe700 1 -- 172.21.15.80:0/1343877645 >> v1:172.21.15.80:6789/0 conn(0x7f6c10072620 legacy=0x7f6c10164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c0f7fe700 1 -- 172.21.15.80:0/1343877645 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c100706c0 con 0x7f6c1006c0a0 2019-11-28T11:37:03.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/1343877645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c1006c0a0 0x7f6c10072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6c0000af50 tx=0x7f6c0000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/1343877645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c1006c0a0 0x7f6c10072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6c0000af50 tx=0x7f6c0000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/1343877645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c1006c0a0 0x7f6c10072fa0 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f6c0000af50 tx=0x7f6c0000b760).ready entity=mon.2 client_cookie=699f9670b21ec29b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:03.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/1343877645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c1006c0a0 0x7f6c10072fa0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f6c0000af50 tx=0x7f6c0000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c0e7fc700 1 -- 172.21.15.80:0/1343877645 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c00000960 con 0x7f6c1006c0a0 2019-11-28T11:37:03.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/1343877645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c1006c0a0 0x7f6c10072fa0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f6c0000af50 tx=0x7f6c0000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c0e7fc700 1 -- 172.21.15.80:0/1343877645 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c00009860 con 0x7f6c1006c0a0 2019-11-28T11:37:03.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/1343877645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c1006c0a0 0x7f6c10072fa0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f6c0000af50 tx=0x7f6c0000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c0e7fc700 1 -- 172.21.15.80:0/1343877645 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c00007210 con 0x7f6c1006c0a0 2019-11-28T11:37:03.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c159db700 1 -- 172.21.15.80:0/1343877645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c1006c0a0 msgr2=0x7f6c10072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.345+0000 7f6c159db700 1 --2- 172.21.15.80:0/1343877645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c1006c0a0 0x7f6c10072fa0 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f6c0000af50 tx=0x7f6c0000b760).stop 2019-11-28T11:37:03.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.346+0000 7f6c159db700 1 -- 172.21.15.80:0/1343877645 shutdown_connections 2019-11-28T11:37:03.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.346+0000 7f6c159db700 1 --2- 172.21.15.80:0/1343877645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c1006c0a0 0x7f6c10072fa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:03.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.346+0000 7f6c159db700 1 -- 172.21.15.80:0/1343877645 shutdown_connections 2019-11-28T11:37:03.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.346+0000 7f6c159db700 1 -- 172.21.15.80:0/1343877645 wait complete. 2019-11-28T11:37:03.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.346+0000 7f6c159db700 1 -- 172.21.15.80:0/1343877645 >> 172.21.15.80:0/1343877645 conn(0x7f6c10061cf0 msgr2=0x7f6c10064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:03.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.348+0000 7f6c159db700 1 Processor -- start 2019-11-28T11:37:03.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.348+0000 7f6c159db700 1 -- start start 2019-11-28T11:37:03.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.349+0000 7f6c159db700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6c1013f580 0x7f6c10115730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:03.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.349+0000 7f6c159db700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1013fc50 con 0x7f6c10115c70 2019-11-28T11:37:03.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.349+0000 7f6c159db700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c10122ef0 con 0x7f6c10122660 2019-11-28T11:37:03.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.349+0000 7f6c159db700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c10112550 con 0x7f6c1013f580 2019-11-28T11:37:03.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.349+0000 7f6c0effd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6c10115c70 0x7f6c10121e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36312/0 (socket says 172.21.15.80:36312) 2019-11-28T11:37:03.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.349+0000 7f6c0effd700 1 -- 172.21.15.80:0/3473020517 learned_addr learned my addr 172.21.15.80:0/3473020517 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:03.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.349+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/3473020517 >> v2:172.21.15.174:3300/0 conn(0x7f6c1013f580 0x7f6c10115730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:03.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.349+0000 7f6c07fff700 1 -- 172.21.15.80:0/3473020517 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458786394 0 0) 0x7f6bf80015c0 con 0x7f6c10115c70 2019-11-28T11:37:03.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.349+0000 7f6c07fff700 1 -- 172.21.15.80:0/3473020517 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6be8002e80 con 0x7f6c10115c70 2019-11-28T11:37:03.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.350+0000 7f6c0f7fe700 1 -- 172.21.15.80:0/3473020517 >> v1:172.21.15.174:6789/0 conn(0x7f6c10122660 legacy=0x7f6c10168a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.350+0000 7f6c07fff700 1 -- 172.21.15.80:0/3473020517 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793412925 0 0) 0x7f6c080009b0 con 0x7f6c10122660 2019-11-28T11:37:03.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.350+0000 7f6c0f7fe700 1 -- 172.21.15.80:0/3473020517 >> v1:172.21.15.80:6789/0 conn(0x7f6c10115c70 legacy=0x7f6c10121e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.350+0000 7f6c0f7fe700 1 -- 172.21.15.80:0/3473020517 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c10112eb0 con 0x7f6c1013f580 2019-11-28T11:37:03.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.350+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/3473020517 >> v2:172.21.15.174:3300/0 conn(0x7f6c1013f580 0x7f6c10115730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6c0000ab70 tx=0x7f6c00054770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.350+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/3473020517 >> v2:172.21.15.174:3300/0 conn(0x7f6c1013f580 0x7f6c10115730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6c0000ab70 tx=0x7f6c00054770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.350+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c1013f580 0x7f6c10115730 secure :-1 s=READY pgs=682 cs=0 l=1 rx=0x7f6c0000ab70 tx=0x7f6c00054770).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:03.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.350+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c1013f580 0x7f6c10115730 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f6c0000ab70 tx=0x7f6c00054770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.350+0000 7f6c07fff700 1 -- 172.21.15.80:0/3473020517 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c0000abb0 con 0x7f6c1013f580 2019-11-28T11:37:03.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.350+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c1013f580 0x7f6c10115730 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f6c0000ab70 tx=0x7f6c00054770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.350+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c1013f580 0x7f6c10115730 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f6c0000ab70 tx=0x7f6c00054770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.350+0000 7f6c07fff700 1 -- 172.21.15.80:0/3473020517 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c00009790 con 0x7f6c1013f580 2019-11-28T11:37:03.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.350+0000 7f6c07fff700 1 -- 172.21.15.80:0/3473020517 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c00009e20 con 0x7f6c1013f580 2019-11-28T11:37:03.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.350+0000 7f6c159db700 1 -- 172.21.15.80:0/3473020517 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c10113230 con 0x7f6c1013f580 2019-11-28T11:37:03.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.350+0000 7f6c159db700 1 -- 172.21.15.80:0/3473020517 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c10112eb0 con 0x7f6c1013f580 2019-11-28T11:37:03.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.350+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c1013f580 0x7f6c10115730 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f6c0000ab70 tx=0x7f6c00054770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.351+0000 7f6c07fff700 1 -- 172.21.15.80:0/3473020517 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6c0000abb0 con 0x7f6c1013f580 2019-11-28T11:37:03.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.351+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c1013f580 0x7f6c10115730 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f6c0000ab70 tx=0x7f6c00054770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.351+0000 7f6c07fff700 1 --2- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6be8018780 0x7f6be801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:03.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.351+0000 7f6c07fff700 1 -- 172.21.15.80:0/3473020517 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6c00075ae0 con 0x7f6c1013f580 2019-11-28T11:37:03.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.351+0000 7f6c0effd700 1 --2- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6be8018780 0x7f6be801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:03.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.351+0000 7f6c0effd700 1 --2- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6be8018780 0x7f6be801abf0 crc :-1 s=READY pgs=467 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:03.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.358+0000 7f6c159db700 1 -- 172.21.15.80:0/3473020517 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c10113230 con 0x7f6c1013f580 2019-11-28T11:37:03.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.362+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c1013f580 0x7f6c10115730 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f6c0000ab70 tx=0x7f6c00054770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.362+0000 7f6c07fff700 1 -- 172.21.15.80:0/3473020517 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6c00068ee0 con 0x7f6c1013f580 2019-11-28T11:37:03.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.537+0000 7f6c159db700 1 -- 172.21.15.80:0/3473020517 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c10112eb0 con 0x7f6c1013f580 2019-11-28T11:37:03.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.538+0000 7f6c0f7fe700 1 --2- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c1013f580 0x7f6c10115730 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f6c0000ab70 tx=0x7f6c00054770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.538+0000 7f6c07fff700 1 -- 172.21.15.80:0/3473020517 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+14886 (secure 0 0 0) 0x7f6c00068ee0 con 0x7f6c1013f580 2019-11-28T11:37:03.601 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:37:03.602 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":91,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:37:03.205165+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:37:01.482997+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2019-11-28T11:37:02.223344+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:37:03.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.542+0000 7f6c159db700 1 -- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6be8018780 msgr2=0x7f6be801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.542+0000 7f6c159db700 1 --2- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6be8018780 0x7f6be801abf0 crc :-1 s=READY pgs=467 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:03.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.542+0000 7f6c159db700 1 -- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c1013f580 msgr2=0x7f6c10115730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.542+0000 7f6c159db700 1 --2- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c1013f580 0x7f6c10115730 secure :-1 s=READY pgs=682 cs=0 l=1 rx=0x7f6c0000ab70 tx=0x7f6c00054770).stop 2019-11-28T11:37:03.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.542+0000 7f6c159db700 1 -- 172.21.15.80:0/3473020517 shutdown_connections 2019-11-28T11:37:03.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.542+0000 7f6c159db700 1 --2- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6be8018780 0x7f6be801abf0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:03.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.542+0000 7f6c159db700 1 --2- 172.21.15.80:0/3473020517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c1013f580 0x7f6c10115730 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:03.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.543+0000 7f6c159db700 1 -- 172.21.15.80:0/3473020517 shutdown_connections 2019-11-28T11:37:03.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.543+0000 7f6c159db700 1 -- 172.21.15.80:0/3473020517 wait complete. 2019-11-28T11:37:03.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.543+0000 7f6c159db700 1 -- 172.21.15.80:0/3473020517 >> 172.21.15.80:0/3473020517 conn(0x7f6c101426c0 msgr2=0x7f6c10110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:03.618 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:37:03.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.676+0000 7fa18eb40700 1 Processor -- start 2019-11-28T11:37:03.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.677+0000 7fa18eb40700 1 -- start start 2019-11-28T11:37:03.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa18eb40700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa18806c0a0 0x7fa188072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:03.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa18eb40700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18806db00 con 0x7fa1880734e0 2019-11-28T11:37:03.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa18eb40700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18806e000 con 0x7fa188072620 2019-11-28T11:37:03.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa18eb40700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18806fd60 con 0x7fa18806c0a0 2019-11-28T11:37:03.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa18c8dc700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa1880734e0 0x7fa188071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36322/0 (socket says 172.21.15.80:36322) 2019-11-28T11:37:03.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa18c8dc700 1 -- 172.21.15.80:0/4259413521 learned_addr learned my addr 172.21.15.80:0/4259413521 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:03.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa18d0dd700 1 --2- 172.21.15.80:0/4259413521 >> v2:172.21.15.174:3300/0 conn(0x7fa18806c0a0 0x7fa188072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:03.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa187fff700 1 -- 172.21.15.80:0/4259413521 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517344205 0 0) 0x7fa1700013f0 con 0x7fa1880734e0 2019-11-28T11:37:03.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa187fff700 1 -- 172.21.15.80:0/4259413521 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa174002e80 con 0x7fa1880734e0 2019-11-28T11:37:03.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa187fff700 1 -- 172.21.15.80:0/4259413521 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638760880 0 0) 0x7fa1800009b0 con 0x7fa188072620 2019-11-28T11:37:03.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa187fff700 1 -- 172.21.15.80:0/4259413521 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa174004170 con 0x7fa188072620 2019-11-28T11:37:03.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa18d0dd700 1 -- 172.21.15.80:0/4259413521 >> v1:172.21.15.174:6789/0 conn(0x7fa188072620 legacy=0x7fa188164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa18d0dd700 1 -- 172.21.15.80:0/4259413521 >> v1:172.21.15.80:6789/0 conn(0x7fa1880734e0 legacy=0x7fa188071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa18d0dd700 1 -- 172.21.15.80:0/4259413521 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1880706c0 con 0x7fa18806c0a0 2019-11-28T11:37:03.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa18d0dd700 1 --2- 172.21.15.80:0/4259413521 >> v2:172.21.15.174:3300/0 conn(0x7fa18806c0a0 0x7fa188072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa17800af50 tx=0x7fa17800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa18d0dd700 1 --2- 172.21.15.80:0/4259413521 >> v2:172.21.15.174:3300/0 conn(0x7fa18806c0a0 0x7fa188072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa17800af50 tx=0x7fa17800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.678+0000 7fa18d0dd700 1 --2- 172.21.15.80:0/4259413521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18806c0a0 0x7fa188072fa0 secure :-1 s=READY pgs=684 cs=0 l=1 rx=0x7fa17800af50 tx=0x7fa17800b760).ready entity=mon.1 client_cookie=c16dfff233c828da server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:03.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.679+0000 7fa18d0dd700 1 --2- 172.21.15.80:0/4259413521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18806c0a0 0x7fa188072fa0 secure :-1 s=THROTTLE_DONE pgs=684 cs=0 l=1 rx=0x7fa17800af50 tx=0x7fa17800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.679+0000 7fa187fff700 1 -- 172.21.15.80:0/4259413521 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa178000960 con 0x7fa18806c0a0 2019-11-28T11:37:03.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.679+0000 7fa18d0dd700 1 --2- 172.21.15.80:0/4259413521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18806c0a0 0x7fa188072fa0 secure :-1 s=THROTTLE_DONE pgs=684 cs=0 l=1 rx=0x7fa17800af50 tx=0x7fa17800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.679+0000 7fa18d0dd700 1 --2- 172.21.15.80:0/4259413521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18806c0a0 0x7fa188072fa0 secure :-1 s=THROTTLE_DONE pgs=684 cs=0 l=1 rx=0x7fa17800af50 tx=0x7fa17800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.679+0000 7fa187fff700 1 -- 172.21.15.80:0/4259413521 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa178009860 con 0x7fa18806c0a0 2019-11-28T11:37:03.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.679+0000 7fa187fff700 1 -- 172.21.15.80:0/4259413521 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa178009f30 con 0x7fa18806c0a0 2019-11-28T11:37:03.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.679+0000 7fa18eb40700 1 -- 172.21.15.80:0/4259413521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18806c0a0 msgr2=0x7fa188072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.679+0000 7fa18eb40700 1 --2- 172.21.15.80:0/4259413521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18806c0a0 0x7fa188072fa0 secure :-1 s=READY pgs=684 cs=0 l=1 rx=0x7fa17800af50 tx=0x7fa17800b760).stop 2019-11-28T11:37:03.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.679+0000 7fa18eb40700 1 -- 172.21.15.80:0/4259413521 shutdown_connections 2019-11-28T11:37:03.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.679+0000 7fa18eb40700 1 --2- 172.21.15.80:0/4259413521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18806c0a0 0x7fa188072fa0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:03.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.679+0000 7fa18eb40700 1 -- 172.21.15.80:0/4259413521 shutdown_connections 2019-11-28T11:37:03.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.679+0000 7fa18eb40700 1 -- 172.21.15.80:0/4259413521 wait complete. 2019-11-28T11:37:03.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.679+0000 7fa18eb40700 1 -- 172.21.15.80:0/4259413521 >> 172.21.15.80:0/4259413521 conn(0x7fa188061cf0 msgr2=0x7fa188064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:03.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.682+0000 7fa18eb40700 1 Processor -- start 2019-11-28T11:37:03.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.682+0000 7fa18eb40700 1 -- start start 2019-11-28T11:37:03.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.683+0000 7fa18eb40700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa188111db0 0x7fa1881238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:03.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.683+0000 7fa18eb40700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa188124260 con 0x7fa188165a00 2019-11-28T11:37:03.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.683+0000 7fa18eb40700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18812e5d0 con 0x7fa18812cea0 2019-11-28T11:37:03.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.683+0000 7fa18eb40700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa188121040 con 0x7fa188111db0 2019-11-28T11:37:03.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.683+0000 7fa18d0dd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa18812cea0 0x7fa1881230e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:51868/0 (socket says 172.21.15.80:51868) 2019-11-28T11:37:03.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.683+0000 7fa18d8de700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa188165a00 0x7fa188167e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36326/0 (socket says 172.21.15.80:36326) 2019-11-28T11:37:03.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.683+0000 7fa18d0dd700 1 -- 172.21.15.80:0/1257195737 learned_addr learned my addr 172.21.15.80:0/1257195737 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:03.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.683+0000 7fa18c8dc700 1 --2- 172.21.15.80:0/1257195737 >> v2:172.21.15.174:3300/0 conn(0x7fa188111db0 0x7fa1881238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:03.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.683+0000 7fa185ffb700 1 -- 172.21.15.80:0/1257195737 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567361987 0 0) 0x7fa180001240 con 0x7fa188165a00 2019-11-28T11:37:03.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.683+0000 7fa185ffb700 1 -- 172.21.15.80:0/1257195737 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa16c002e80 con 0x7fa188165a00 2019-11-28T11:37:03.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.683+0000 7fa185ffb700 1 -- 172.21.15.80:0/1257195737 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653544625 0 0) 0x7fa17800b3d0 con 0x7fa18812cea0 2019-11-28T11:37:03.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.683+0000 7fa185ffb700 1 -- 172.21.15.80:0/1257195737 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa16c0041b0 con 0x7fa18812cea0 2019-11-28T11:37:03.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.683+0000 7fa18c8dc700 1 -- 172.21.15.80:0/1257195737 >> v1:172.21.15.174:6789/0 conn(0x7fa18812cea0 legacy=0x7fa1881230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.683+0000 7fa18c8dc700 1 -- 172.21.15.80:0/1257195737 >> v1:172.21.15.80:6789/0 conn(0x7fa188165a00 legacy=0x7fa188167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.683+0000 7fa18c8dc700 1 -- 172.21.15.80:0/1257195737 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1881219a0 con 0x7fa188111db0 2019-11-28T11:37:03.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.683+0000 7fa18c8dc700 1 --2- 172.21.15.80:0/1257195737 >> v2:172.21.15.174:3300/0 conn(0x7fa188111db0 0x7fa1881238e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1700106b0 tx=0x7fa170010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.684+0000 7fa18c8dc700 1 --2- 172.21.15.80:0/1257195737 >> v2:172.21.15.174:3300/0 conn(0x7fa188111db0 0x7fa1881238e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1700106b0 tx=0x7fa170010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.684+0000 7fa18c8dc700 1 --2- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa188111db0 0x7fa1881238e0 secure :-1 s=READY pgs=686 cs=0 l=1 rx=0x7fa1700106b0 tx=0x7fa170010a50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:03.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.684+0000 7fa18c8dc700 1 --2- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa188111db0 0x7fa1881238e0 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7fa1700106b0 tx=0x7fa170010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.684+0000 7fa185ffb700 1 -- 172.21.15.80:0/1257195737 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1700015b0 con 0x7fa188111db0 2019-11-28T11:37:03.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.684+0000 7fa18c8dc700 1 --2- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa188111db0 0x7fa1881238e0 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7fa1700106b0 tx=0x7fa170010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.684+0000 7fa185ffb700 1 -- 172.21.15.80:0/1257195737 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1700015b0 con 0x7fa188111db0 2019-11-28T11:37:03.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.684+0000 7fa18c8dc700 1 --2- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa188111db0 0x7fa1881238e0 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7fa1700106b0 tx=0x7fa170010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.684+0000 7fa18eb40700 1 -- 172.21.15.80:0/1257195737 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa188121d20 con 0x7fa188111db0 2019-11-28T11:37:03.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.684+0000 7fa185ffb700 1 -- 172.21.15.80:0/1257195737 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa170004550 con 0x7fa188111db0 2019-11-28T11:37:03.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.684+0000 7fa18eb40700 1 -- 172.21.15.80:0/1257195737 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1881219a0 con 0x7fa188111db0 2019-11-28T11:37:03.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.684+0000 7fa18c8dc700 1 --2- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa188111db0 0x7fa1881238e0 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7fa1700106b0 tx=0x7fa170010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.685+0000 7fa185ffb700 1 -- 172.21.15.80:0/1257195737 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa170004360 con 0x7fa188111db0 2019-11-28T11:37:03.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.685+0000 7fa18c8dc700 1 --2- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa188111db0 0x7fa1881238e0 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7fa1700106b0 tx=0x7fa170010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.685+0000 7fa185ffb700 1 --2- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa16c018740 0x7fa16c01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:03.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.685+0000 7fa185ffb700 1 -- 172.21.15.80:0/1257195737 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa170031dc0 con 0x7fa188111db0 2019-11-28T11:37:03.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.685+0000 7fa18d0dd700 1 --2- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa16c018740 0x7fa16c01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:03.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.685+0000 7fa18d0dd700 1 --2- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa16c018740 0x7fa16c01abf0 crc :-1 s=READY pgs=468 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:03.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.692+0000 7fa18eb40700 1 -- 172.21.15.80:0/1257195737 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa188121d20 con 0x7fa188111db0 2019-11-28T11:37:03.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.695+0000 7fa18c8dc700 1 --2- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa188111db0 0x7fa1881238e0 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7fa1700106b0 tx=0x7fa170010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.695+0000 7fa185ffb700 1 -- 172.21.15.80:0/1257195737 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa17001c1c0 con 0x7fa188111db0 2019-11-28T11:37:03.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.871+0000 7fa18eb40700 1 -- 172.21.15.80:0/1257195737 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1881219a0 con 0x7fa188111db0 2019-11-28T11:37:03.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.873+0000 7fa18c8dc700 1 --2- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa188111db0 0x7fa1881238e0 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7fa1700106b0 tx=0x7fa170010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:03.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.873+0000 7fa185ffb700 1 -- 172.21.15.80:0/1257195737 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+14886 (secure 0 0 0) 0x7fa17001c1c0 con 0x7fa188111db0 2019-11-28T11:37:03.934 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:37:03.935 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":91,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:37:03.205165+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:37:01.482997+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2019-11-28T11:37:02.223344+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:37:03.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.874+0000 7fa18eb40700 1 -- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa16c018740 msgr2=0x7fa16c01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.874+0000 7fa18eb40700 1 --2- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa16c018740 0x7fa16c01abf0 crc :-1 s=READY pgs=468 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:03.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.874+0000 7fa18eb40700 1 -- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa188111db0 msgr2=0x7fa1881238e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:03.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.874+0000 7fa18eb40700 1 --2- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa188111db0 0x7fa1881238e0 secure :-1 s=READY pgs=686 cs=0 l=1 rx=0x7fa1700106b0 tx=0x7fa170010a50).stop 2019-11-28T11:37:03.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.875+0000 7fa18eb40700 1 -- 172.21.15.80:0/1257195737 shutdown_connections 2019-11-28T11:37:03.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.875+0000 7fa18eb40700 1 --2- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa188111db0 0x7fa1881238e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:03.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.875+0000 7fa18eb40700 1 --2- 172.21.15.80:0/1257195737 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa16c018740 0x7fa16c01abf0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:03.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.875+0000 7fa18eb40700 1 -- 172.21.15.80:0/1257195737 shutdown_connections 2019-11-28T11:37:03.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.875+0000 7fa18eb40700 1 -- 172.21.15.80:0/1257195737 wait complete. 2019-11-28T11:37:03.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:03.875+0000 7fa18eb40700 1 -- 172.21.15.80:0/1257195737 >> 172.21.15.80:0/1257195737 conn(0x7fa1881426c0 msgr2=0x7fa188110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:03.959 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:37:04.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.027+0000 7f3efeff4700 1 Processor -- start 2019-11-28T11:37:04.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.027+0000 7f3efeff4700 1 -- start start 2019-11-28T11:37:04.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.028+0000 7f3efeff4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ef815f100 0x7f3ef806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:04.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.028+0000 7f3efeff4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3ef806c2f0 0x7f3ef806c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:04.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.028+0000 7f3efeff4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef806db60 con 0x7f3ef815ed10 2019-11-28T11:37:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.028+0000 7f3efeff4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef806fe00 con 0x7f3ef815f100 2019-11-28T11:37:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.028+0000 7f3efeff4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef80700d0 con 0x7f3ef806c2f0 2019-11-28T11:37:04.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3efcd90700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ef815f100 0x7f3ef806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:04.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3efd591700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3ef815ed10 0x7f3ef8073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36332/0 (socket says 172.21.15.80:36332) 2019-11-28T11:37:04.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3efd591700 1 -- 172.21.15.80:0/2329611969 learned_addr learned my addr 172.21.15.80:0/2329611969 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:04.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3efdd92700 1 --2- 172.21.15.80:0/2329611969 >> v2:172.21.15.174:3300/0 conn(0x7f3ef806c2f0 0x7f3ef806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:04.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3efcd90700 1 -- 172.21.15.80:0/2329611969 >> v2:172.21.15.174:3300/0 conn(0x7f3ef806c2f0 msgr2=0x7f3ef806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:04.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3efcd90700 1 --2- 172.21.15.80:0/2329611969 >> v2:172.21.15.174:3300/0 conn(0x7f3ef806c2f0 0x7f3ef806c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:04.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3efcd90700 1 -- 172.21.15.80:0/2329611969 >> v1:172.21.15.80:6789/0 conn(0x7f3ef815ed10 legacy=0x7f3ef8073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:04.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3ef7fff700 1 -- 172.21.15.80:0/2329611969 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438297037 0 0) 0x7f3ee0001480 con 0x7f3ef815ed10 2019-11-28T11:37:04.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3efcd90700 1 -- 172.21.15.80:0/2329611969 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef8070760 con 0x7f3ef815f100 2019-11-28T11:37:04.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3efcd90700 1 --2- 172.21.15.80:0/2329611969 >> v2:172.21.15.80:3300/0 conn(0x7f3ef815f100 0x7f3ef806bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3ee800af50 tx=0x7f3ee800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:04.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3efcd90700 1 --2- 172.21.15.80:0/2329611969 >> v2:172.21.15.80:3300/0 conn(0x7f3ef815f100 0x7f3ef806bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3ee800af50 tx=0x7f3ee800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:04.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3efcd90700 1 --2- 172.21.15.80:0/2329611969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef815f100 0x7f3ef806bdb0 secure :-1 s=READY pgs=1155 cs=0 l=1 rx=0x7f3ee800af50 tx=0x7f3ee800b6e0).ready entity=mon.0 client_cookie=fee012655633196a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:04.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3efcd90700 1 --2- 172.21.15.80:0/2329611969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef815f100 0x7f3ef806bdb0 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7f3ee800af50 tx=0x7f3ee800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:04.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3ef7fff700 1 -- 172.21.15.80:0/2329611969 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee8007210 con 0x7f3ef815f100 2019-11-28T11:37:04.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3efcd90700 1 --2- 172.21.15.80:0/2329611969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef815f100 0x7f3ef806bdb0 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7f3ee800af50 tx=0x7f3ee800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:04.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3ef7fff700 1 -- 172.21.15.80:0/2329611969 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee80099b0 con 0x7f3ef815f100 2019-11-28T11:37:04.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3efcd90700 1 --2- 172.21.15.80:0/2329611969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef815f100 0x7f3ef806bdb0 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7f3ee800af50 tx=0x7f3ee800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:04.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3ef7fff700 1 -- 172.21.15.80:0/2329611969 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee8009ba0 con 0x7f3ef815f100 2019-11-28T11:37:04.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3efeff4700 1 -- 172.21.15.80:0/2329611969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef815f100 msgr2=0x7f3ef806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:04.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.029+0000 7f3efeff4700 1 --2- 172.21.15.80:0/2329611969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef815f100 0x7f3ef806bdb0 secure :-1 s=READY pgs=1155 cs=0 l=1 rx=0x7f3ee800af50 tx=0x7f3ee800b6e0).stop 2019-11-28T11:37:04.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.030+0000 7f3efeff4700 1 -- 172.21.15.80:0/2329611969 shutdown_connections 2019-11-28T11:37:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.030+0000 7f3efeff4700 1 --2- 172.21.15.80:0/2329611969 >> v2:172.21.15.174:3300/0 conn(0x7f3ef806c2f0 0x7f3ef806c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.030+0000 7f3efeff4700 1 --2- 172.21.15.80:0/2329611969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef815f100 0x7f3ef806bdb0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.030+0000 7f3efeff4700 1 -- 172.21.15.80:0/2329611969 shutdown_connections 2019-11-28T11:37:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.030+0000 7f3efeff4700 1 -- 172.21.15.80:0/2329611969 wait complete. 2019-11-28T11:37:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.030+0000 7f3efeff4700 1 -- 172.21.15.80:0/2329611969 >> 172.21.15.80:0/2329611969 conn(0x7f3ef8061d20 msgr2=0x7f3ef80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:04.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.033+0000 7f3efeff4700 1 Processor -- start 2019-11-28T11:37:04.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.033+0000 7f3efeff4700 1 -- start start 2019-11-28T11:37:04.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efeff4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3ef812e9a0 0x7f3ef8104800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:04.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efeff4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef815f9a0 0x7f3ef8148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:04.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efeff4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef807b5c0 con 0x7f3ef815f510 2019-11-28T11:37:04.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efeff4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef8111fc0 con 0x7f3ef812e9a0 2019-11-28T11:37:04.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efeff4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef8112290 con 0x7f3ef815f9a0 2019-11-28T11:37:04.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efcd90700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3ef815f510 0x7f3ef8148040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36340/0 (socket says 172.21.15.80:36340) 2019-11-28T11:37:04.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efcd90700 1 -- 172.21.15.80:0/1915595846 learned_addr learned my addr 172.21.15.80:0/1915595846 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:04.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efdd92700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef815f9a0 0x7f3ef8148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:04.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efd591700 1 --2- 172.21.15.80:0/1915595846 >> v2:172.21.15.174:3300/0 conn(0x7f3ef812e9a0 0x7f3ef8104800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:04.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3ef5ffb700 1 -- 172.21.15.80:0/1915595846 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198602074 0 0) 0x7f3ee80099a0 con 0x7f3ef815f510 2019-11-28T11:37:04.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3ef5ffb700 1 -- 172.21.15.80:0/1915595846 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3edc002e80 con 0x7f3ef815f510 2019-11-28T11:37:04.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3ef5ffb700 1 -- 172.21.15.80:0/1915595846 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1140151758 0 0) 0x7f3ee8000940 con 0x7f3ef815f510 2019-11-28T11:37:04.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efd591700 1 -- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef815f9a0 msgr2=0x7f3ef8148840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:04.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efd591700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef815f9a0 0x7f3ef8148840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:04.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efd591700 1 -- 172.21.15.80:0/1915595846 >> v1:172.21.15.80:6789/0 conn(0x7f3ef815f510 legacy=0x7f3ef8148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:04.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efd591700 1 -- 172.21.15.80:0/1915595846 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef8101f40 con 0x7f3ef812e9a0 2019-11-28T11:37:04.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efdd92700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef815f9a0 0x7f3ef8148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:37:04.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efd591700 1 --2- 172.21.15.80:0/1915595846 >> v2:172.21.15.174:3300/0 conn(0x7f3ef812e9a0 0x7f3ef8104800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ee00106f0 tx=0x7f3ee0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:04.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efd591700 1 --2- 172.21.15.80:0/1915595846 >> v2:172.21.15.174:3300/0 conn(0x7f3ef812e9a0 0x7f3ef8104800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ee00106f0 tx=0x7f3ee0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:04.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.034+0000 7f3efd591700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef812e9a0 0x7f3ef8104800 secure :-1 s=READY pgs=687 cs=0 l=1 rx=0x7f3ee00106f0 tx=0x7f3ee0010a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:04.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.035+0000 7f3efd591700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef812e9a0 0x7f3ef8104800 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7f3ee00106f0 tx=0x7f3ee0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:04.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.035+0000 7f3ef5ffb700 1 -- 172.21.15.80:0/1915595846 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee0001270 con 0x7f3ef812e9a0 2019-11-28T11:37:04.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.035+0000 7f3efd591700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef812e9a0 0x7f3ef8104800 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7f3ee00106f0 tx=0x7f3ee0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:04.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.035+0000 7f3efd591700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef812e9a0 0x7f3ef8104800 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7f3ee00106f0 tx=0x7f3ee0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:04.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.035+0000 7f3ef5ffb700 1 -- 172.21.15.80:0/1915595846 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee00045c0 con 0x7f3ef812e9a0 2019-11-28T11:37:04.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.035+0000 7f3efeff4700 1 -- 172.21.15.80:0/1915595846 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef81022c0 con 0x7f3ef812e9a0 2019-11-28T11:37:04.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.035+0000 7f3ef5ffb700 1 -- 172.21.15.80:0/1915595846 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee0004cd0 con 0x7f3ef812e9a0 2019-11-28T11:37:04.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.035+0000 7f3efeff4700 1 -- 172.21.15.80:0/1915595846 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef8101f40 con 0x7f3ef812e9a0 2019-11-28T11:37:04.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.035+0000 7f3efd591700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef812e9a0 0x7f3ef8104800 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7f3ee00106f0 tx=0x7f3ee0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:04.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.035+0000 7f3ef5ffb700 1 -- 172.21.15.80:0/1915595846 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3ee00047b0 con 0x7f3ef812e9a0 2019-11-28T11:37:04.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.035+0000 7f3efd591700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef812e9a0 0x7f3ef8104800 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7f3ee00106f0 tx=0x7f3ee0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:04.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.035+0000 7f3ef5ffb700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3edc018780 0x7f3edc01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:04.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.035+0000 7f3ef5ffb700 1 -- 172.21.15.80:0/1915595846 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3ee0031d40 con 0x7f3ef812e9a0 2019-11-28T11:37:04.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.036+0000 7f3efcd90700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3edc018780 0x7f3edc01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:04.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.036+0000 7f3efcd90700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3edc018780 0x7f3edc01abf0 crc :-1 s=READY pgs=469 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:04.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.043+0000 7f3efeff4700 1 -- 172.21.15.80:0/1915595846 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef81022c0 con 0x7f3ef812e9a0 2019-11-28T11:37:04.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.046+0000 7f3efd591700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef812e9a0 0x7f3ef8104800 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7f3ee00106f0 tx=0x7f3ee0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:04.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.046+0000 7f3ef5ffb700 1 -- 172.21.15.80:0/1915595846 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3ee0001010 con 0x7f3ef812e9a0 2019-11-28T11:37:04.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:04.224+0000 7f3efeff4700 1 -- 172.21.15.80:0/1915595846 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f3ef8101f40 con 0x7f3ef812e9a0 2019-11-28T11:37:05.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.211+0000 7f3efd591700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef812e9a0 0x7f3ef8104800 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7f3ee00106f0 tx=0x7f3ee0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.211+0000 7f3ef5ffb700 1 -- 172.21.15.80:0/1915595846 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v57) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3ee00047b0 con 0x7f3ef812e9a0 2019-11-28T11:37:05.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.242+0000 7f3efeff4700 1 -- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3edc018780 msgr2=0x7f3edc01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:05.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.242+0000 7f3efeff4700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3edc018780 0x7f3edc01abf0 crc :-1 s=READY pgs=469 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.242+0000 7f3efeff4700 1 -- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef812e9a0 msgr2=0x7f3ef8104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:05.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.242+0000 7f3efeff4700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef812e9a0 0x7f3ef8104800 secure :-1 s=READY pgs=687 cs=0 l=1 rx=0x7f3ee00106f0 tx=0x7f3ee0010a90).stop 2019-11-28T11:37:05.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.242+0000 7f3efeff4700 1 -- 172.21.15.80:0/1915595846 shutdown_connections 2019-11-28T11:37:05.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.242+0000 7f3efeff4700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3edc018780 0x7f3edc01abf0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.242+0000 7f3efeff4700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef815f9a0 0x7f3ef8148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.242+0000 7f3efeff4700 1 --2- 172.21.15.80:0/1915595846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ef812e9a0 0x7f3ef8104800 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.242+0000 7f3efeff4700 1 -- 172.21.15.80:0/1915595846 shutdown_connections 2019-11-28T11:37:05.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.242+0000 7f3efeff4700 1 -- 172.21.15.80:0/1915595846 wait complete. 2019-11-28T11:37:05.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.242+0000 7f3efeff4700 1 -- 172.21.15.80:0/1915595846 >> 172.21.15.80:0/1915595846 conn(0x7f3ef807c4f0 msgr2=0x7f3ef815ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:05.313 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:37:05.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.371+0000 7fa4d480d700 1 Processor -- start 2019-11-28T11:37:05.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.371+0000 7fa4d480d700 1 -- start start 2019-11-28T11:37:05.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.372+0000 7fa4d480d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa4d006c0a0 0x7fa4d0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:05.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.372+0000 7fa4d480d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4d00734e0 0x7fa4d0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:05.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.372+0000 7fa4d480d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d006db00 con 0x7fa4d0072360 2019-11-28T11:37:05.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.372+0000 7fa4d480d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d006fd60 con 0x7fa4d00734e0 2019-11-28T11:37:05.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.372+0000 7fa4d480d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d0070030 con 0x7fa4d006c0a0 2019-11-28T11:37:05.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.372+0000 7fa4ce59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4d00734e0 0x7fa4d0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:05.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4ce59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4d00734e0 0x7fa4d0071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37034/0 (socket says 172.21.15.80:37034) 2019-11-28T11:37:05.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4ce59c700 1 -- 172.21.15.80:0/1009628503 learned_addr learned my addr 172.21.15.80:0/1009628503 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:05.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4ced9d700 1 --2- 172.21.15.80:0/1009628503 >> v2:172.21.15.174:3300/0 conn(0x7fa4d006c0a0 0x7fa4d0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:05.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4ce59c700 1 -- 172.21.15.80:0/1009628503 >> v2:172.21.15.174:3300/0 conn(0x7fa4d006c0a0 msgr2=0x7fa4d0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:05.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/1009628503 >> v2:172.21.15.174:3300/0 conn(0x7fa4d006c0a0 0x7fa4d0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:05.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4ce59c700 1 -- 172.21.15.80:0/1009628503 >> v1:172.21.15.174:6789/0 conn(0x7fa4d0072360 legacy=0x7fa4d006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:05.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4ce59c700 1 -- 172.21.15.80:0/1009628503 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d00706c0 con 0x7fa4d00734e0 2019-11-28T11:37:05.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/1009628503 >> v2:172.21.15.80:3300/0 conn(0x7fa4d00734e0 0x7fa4d0071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa4c000f740 tx=0x7fa4c000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/1009628503 >> v2:172.21.15.80:3300/0 conn(0x7fa4d00734e0 0x7fa4d0071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa4c000f740 tx=0x7fa4c000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/1009628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d00734e0 0x7fa4d0071e20 secure :-1 s=READY pgs=1157 cs=0 l=1 rx=0x7fa4c000f740 tx=0x7fa4c000f570).ready entity=mon.0 client_cookie=b26e4260ffd99741 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:05.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/1009628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d00734e0 0x7fa4d0071e20 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7fa4c000f740 tx=0x7fa4c000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/1009628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d00734e0 0x7fa4d0071e20 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7fa4c000f740 tx=0x7fa4c000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4cdd9b700 1 -- 172.21.15.80:0/1009628503 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4c0000960 con 0x7fa4d00734e0 2019-11-28T11:37:05.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/1009628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d00734e0 0x7fa4d0071e20 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7fa4c000f740 tx=0x7fa4c000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4cdd9b700 1 -- 172.21.15.80:0/1009628503 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c0000c90 con 0x7fa4d00734e0 2019-11-28T11:37:05.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4cdd9b700 1 -- 172.21.15.80:0/1009628503 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4c00013a0 con 0x7fa4d00734e0 2019-11-28T11:37:05.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4d480d700 1 -- 172.21.15.80:0/1009628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d00734e0 msgr2=0x7fa4d0071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:05.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.373+0000 7fa4d480d700 1 --2- 172.21.15.80:0/1009628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d00734e0 0x7fa4d0071e20 secure :-1 s=READY pgs=1157 cs=0 l=1 rx=0x7fa4c000f740 tx=0x7fa4c000f570).stop 2019-11-28T11:37:05.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.374+0000 7fa4d480d700 1 -- 172.21.15.80:0/1009628503 shutdown_connections 2019-11-28T11:37:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.374+0000 7fa4d480d700 1 --2- 172.21.15.80:0/1009628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4d00734e0 0x7fa4d0071e20 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.374+0000 7fa4d480d700 1 --2- 172.21.15.80:0/1009628503 >> v2:172.21.15.174:3300/0 conn(0x7fa4d006c0a0 0x7fa4d0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.374+0000 7fa4d480d700 1 -- 172.21.15.80:0/1009628503 shutdown_connections 2019-11-28T11:37:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.374+0000 7fa4d480d700 1 -- 172.21.15.80:0/1009628503 wait complete. 2019-11-28T11:37:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.374+0000 7fa4d480d700 1 -- 172.21.15.80:0/1009628503 >> 172.21.15.80:0/1009628503 conn(0x7fa4d0061cf0 msgr2=0x7fa4d0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:05.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.376+0000 7fa4d480d700 1 Processor -- start 2019-11-28T11:37:05.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.377+0000 7fa4d480d700 1 -- start start 2019-11-28T11:37:05.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.377+0000 7fa4d480d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d01281b0 0x7fa4d0128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:05.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.377+0000 7fa4d480d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa4d0128b80 0x7fa4d0167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:05.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.377+0000 7fa4d480d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d0139a60 con 0x7fa4d013a780 2019-11-28T11:37:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.377+0000 7fa4d480d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d012a260 con 0x7fa4d0128b80 2019-11-28T11:37:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.377+0000 7fa4d480d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d012a530 con 0x7fa4d01281b0 2019-11-28T11:37:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.377+0000 7fa4ced9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa4d013a780 0x7fa4d012d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36352/0 (socket says 172.21.15.80:36352) 2019-11-28T11:37:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.377+0000 7fa4ced9d700 1 -- 172.21.15.80:0/4235963556 learned_addr learned my addr 172.21.15.80:0/4235963556 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:05.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193071388 0 0) 0x7fa4b8005b30 con 0x7fa4d013a780 2019-11-28T11:37:05.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a8002e80 con 0x7fa4d013a780 2019-11-28T11:37:05.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d01281b0 0x7fa4d0128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:05.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4cf59e700 1 --2- 172.21.15.80:0/4235963556 >> v2:172.21.15.174:3300/0 conn(0x7fa4d0128b80 0x7fa4d0167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:05.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1732987336 0 0) 0x7fa4b8001140 con 0x7fa4d013a780 2019-11-28T11:37:05.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa4a80032e0 con 0x7fa4d013a780 2019-11-28T11:37:05.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fa4b80016d0 con 0x7fa4d013a780 2019-11-28T11:37:05.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d01281b0 msgr2=0x7fa4d0128640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:05.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4c77fe700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d01281b0 0x7fa4d0128640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 >> v2:172.21.15.174:3300/0 conn(0x7fa4d0128b80 msgr2=0x7fa4d0167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:05.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4c77fe700 1 --2- 172.21.15.80:0/4235963556 >> v2:172.21.15.174:3300/0 conn(0x7fa4d0128b80 0x7fa4d0167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 >> v1:172.21.15.80:6789/0 conn(0x7fa4d013a780 legacy=0x7fa4d012d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:05.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4c77fe700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4a80033a0 0x7fa4a80037d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:05.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4c77fe700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4a8003d10 0x7fa4a80041b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:05.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4c77fe700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4a80048b0 0x7fa4a8004d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:05.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a800bbf0 con 0x7fa4a8003d10 2019-11-28T11:37:05.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a800bde0 con 0x7fa4a80048b0 2019-11-28T11:37:05.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a800c010 con 0x7fa4a80033a0 2019-11-28T11:37:05.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4cf59e700 1 --2- 172.21.15.80:0/4235963556 >> v2:172.21.15.174:3300/0 conn(0x7fa4d0128b80 0x7fa4d0167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:37:05.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4a8003d10 0x7fa4a80041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:05.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4cf59e700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4a80048b0 0x7fa4a8004d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:05.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4ced9d700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4a80033a0 0x7fa4a80037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:05.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4ce59c700 1 -- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4a80033a0 msgr2=0x7fa4a80037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:05.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4a80033a0 0x7fa4a80037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4ce59c700 1 -- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4a80048b0 msgr2=0x7fa4a8004d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:05.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4a80048b0 0x7fa4a8004d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4ce59c700 1 -- 172.21.15.80:0/4235963556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a800c2c0 con 0x7fa4a8003d10 2019-11-28T11:37:05.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4d480d700 1 -- 172.21.15.80:0/4235963556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d012af40 con 0x7fa4a8003d10 2019-11-28T11:37:05.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4cf59e700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4a80048b0 0x7fa4a8004d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:37:05.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4a8003d10 0x7fa4a80041b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4c0010390 tx=0x7fa4c0010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.378+0000 7fa4d480d700 1 -- 172.21.15.80:0/4235963556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d012abc0 con 0x7fa4a8003d10 2019-11-28T11:37:05.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.379+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4a8003d10 0x7fa4a80041b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4c0010390 tx=0x7fa4c0010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.379+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4a8003d10 0x7fa4a80041b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rx=0x7fa4c0010390 tx=0x7fa4c0010190).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:05.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.379+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4a8003d10 0x7fa4a80041b0 secure :-1 s=THROTTLE_DONE pgs=1159 cs=0 l=1 rx=0x7fa4c0010390 tx=0x7fa4c0010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.379+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4c0007cd0 con 0x7fa4a8003d10 2019-11-28T11:37:05.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.379+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4a8003d10 0x7fa4a80041b0 secure :-1 s=THROTTLE_DONE pgs=1159 cs=0 l=1 rx=0x7fa4c0010390 tx=0x7fa4c0010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.379+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4a8003d10 0x7fa4a80041b0 secure :-1 s=THROTTLE_DONE pgs=1159 cs=0 l=1 rx=0x7fa4c0010390 tx=0x7fa4c0010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.379+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c0005580 con 0x7fa4a8003d10 2019-11-28T11:37:05.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.379+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4c0005c50 con 0x7fa4a8003d10 2019-11-28T11:37:05.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.379+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4a8003d10 0x7fa4a80041b0 secure :-1 s=THROTTLE_DONE pgs=1159 cs=0 l=1 rx=0x7fa4c0010390 tx=0x7fa4c0010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.379+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa4c0007cd0 con 0x7fa4a8003d10 2019-11-28T11:37:05.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.379+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4a8003d10 0x7fa4a80041b0 secure :-1 s=THROTTLE_DONE pgs=1159 cs=0 l=1 rx=0x7fa4c0010390 tx=0x7fa4c0010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.379+0000 7fa4c77fe700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4a8020b20 0x7fa4a8022f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:05.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.379+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa4c0031b50 con 0x7fa4a8003d10 2019-11-28T11:37:05.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.380+0000 7fa4ced9d700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4a8020b20 0x7fa4a8022f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:05.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.380+0000 7fa4ced9d700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4a8020b20 0x7fa4a8022f50 crc :-1 s=READY pgs=470 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:05.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.387+0000 7fa4d480d700 1 -- 172.21.15.80:0/4235963556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d012af40 con 0x7fa4a8003d10 2019-11-28T11:37:05.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.390+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4a8003d10 0x7fa4a80041b0 secure :-1 s=THROTTLE_DONE pgs=1159 cs=0 l=1 rx=0x7fa4c0010390 tx=0x7fa4c0010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.390+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa4c0005180 con 0x7fa4a8003d10 2019-11-28T11:37:05.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.565+0000 7fa4d480d700 1 -- 172.21.15.80:0/4235963556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4d012abc0 con 0x7fa4a8003d10 2019-11-28T11:37:05.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.566+0000 7fa4ce59c700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4a8003d10 0x7fa4a80041b0 secure :-1 s=THROTTLE_DONE pgs=1159 cs=0 l=1 rx=0x7fa4c0010390 tx=0x7fa4c0010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.566+0000 7fa4c77fe700 1 -- 172.21.15.80:0/4235963556 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+1424 (secure 0 0 0) 0x7fa4c0007cd0 con 0x7fa4a8003d10 2019-11-28T11:37:05.628 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 57 2019-11-28T11:37:05.628 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:37:05.628 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:37:05.207937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:37:05.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.569+0000 7fa4d480d700 1 -- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4a8020b20 msgr2=0x7fa4a8022f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:05.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.569+0000 7fa4d480d700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4a8020b20 0x7fa4a8022f50 crc :-1 s=READY pgs=470 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.569+0000 7fa4d480d700 1 -- 172.21.15.80:0/4235963556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4a8003d10 msgr2=0x7fa4a80041b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:05.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.569+0000 7fa4d480d700 1 --2- 172.21.15.80:0/4235963556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4a8003d10 0x7fa4a80041b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rx=0x7fa4c0010390 tx=0x7fa4c0010190).stop 2019-11-28T11:37:05.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.569+0000 7fa4cf59e700 1 -- 172.21.15.80:0/4235963556 reap_dead start 2019-11-28T11:37:05.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.569+0000 7fa4cf59e700 1 -- 172.21.15.80:0/4235963556 reap_dead start 2019-11-28T11:37:05.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.569+0000 7fa4d480d700 1 -- 172.21.15.80:0/4235963556 shutdown_connections 2019-11-28T11:37:05.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.569+0000 7fa4d480d700 1 -- 172.21.15.80:0/4235963556 shutdown_connections 2019-11-28T11:37:05.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.569+0000 7fa4d480d700 1 -- 172.21.15.80:0/4235963556 wait complete. 2019-11-28T11:37:05.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.569+0000 7fa4d480d700 1 -- 172.21.15.80:0/4235963556 >> 172.21.15.80:0/4235963556 conn(0x7fa4d0127dc0 msgr2=0x7fa4d0141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:05.642 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:37:05.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.701+0000 7efe4a9fa700 1 Processor -- start 2019-11-28T11:37:05.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.701+0000 7efe4a9fa700 1 -- start start 2019-11-28T11:37:05.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.702+0000 7efe4a9fa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe4406c0a0 0x7efe44072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:05.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.702+0000 7efe4a9fa700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe44072620 0x7efe44164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:05.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.702+0000 7efe4a9fa700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4406db00 con 0x7efe440734e0 2019-11-28T11:37:05.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.702+0000 7efe4a9fa700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4406fd60 con 0x7efe4406c0a0 2019-11-28T11:37:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.702+0000 7efe4a9fa700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe44070030 con 0x7efe44072620 2019-11-28T11:37:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.702+0000 7efe48f97700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe4406c0a0 0x7efe44072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.702+0000 7efe43fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efe440734e0 0x7efe44071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36366/0 (socket says 172.21.15.80:36366) 2019-11-28T11:37:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.702+0000 7efe43fff700 1 -- 172.21.15.80:0/664168728 learned_addr learned my addr 172.21.15.80:0/664168728 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe49798700 1 --2- 172.21.15.80:0/664168728 >> v2:172.21.15.174:3300/0 conn(0x7efe44072620 0x7efe44164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe48f97700 1 -- 172.21.15.80:0/664168728 >> v2:172.21.15.174:3300/0 conn(0x7efe44072620 msgr2=0x7efe44164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:05.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe48f97700 1 --2- 172.21.15.80:0/664168728 >> v2:172.21.15.174:3300/0 conn(0x7efe44072620 0x7efe44164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:05.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe48f97700 1 -- 172.21.15.80:0/664168728 >> v1:172.21.15.80:6789/0 conn(0x7efe440734e0 legacy=0x7efe44071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:05.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe48f97700 1 -- 172.21.15.80:0/664168728 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe440706c0 con 0x7efe4406c0a0 2019-11-28T11:37:05.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe437fe700 1 -- 172.21.15.80:0/664168728 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994377992 0 0) 0x7efe34001480 con 0x7efe440734e0 2019-11-28T11:37:05.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe48f97700 1 --2- 172.21.15.80:0/664168728 >> v2:172.21.15.80:3300/0 conn(0x7efe4406c0a0 0x7efe44072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efe3c00af50 tx=0x7efe3c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe48f97700 1 --2- 172.21.15.80:0/664168728 >> v2:172.21.15.80:3300/0 conn(0x7efe4406c0a0 0x7efe44072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efe3c00af50 tx=0x7efe3c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe48f97700 1 --2- 172.21.15.80:0/664168728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4406c0a0 0x7efe44072fa0 secure :-1 s=READY pgs=1161 cs=0 l=1 rx=0x7efe3c00af50 tx=0x7efe3c00b6e0).ready entity=mon.0 client_cookie=a473f13e5df92bcc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:05.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe48f97700 1 --2- 172.21.15.80:0/664168728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4406c0a0 0x7efe44072fa0 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7efe3c00af50 tx=0x7efe3c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe437fe700 1 -- 172.21.15.80:0/664168728 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe3c007210 con 0x7efe4406c0a0 2019-11-28T11:37:05.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe48f97700 1 --2- 172.21.15.80:0/664168728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4406c0a0 0x7efe44072fa0 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7efe3c00af50 tx=0x7efe3c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe48f97700 1 --2- 172.21.15.80:0/664168728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4406c0a0 0x7efe44072fa0 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7efe3c00af50 tx=0x7efe3c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe437fe700 1 -- 172.21.15.80:0/664168728 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3c0099b0 con 0x7efe4406c0a0 2019-11-28T11:37:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe437fe700 1 -- 172.21.15.80:0/664168728 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe3c00a080 con 0x7efe4406c0a0 2019-11-28T11:37:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe4a9fa700 1 -- 172.21.15.80:0/664168728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4406c0a0 msgr2=0x7efe44072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:05.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.703+0000 7efe4a9fa700 1 --2- 172.21.15.80:0/664168728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4406c0a0 0x7efe44072fa0 secure :-1 s=READY pgs=1161 cs=0 l=1 rx=0x7efe3c00af50 tx=0x7efe3c00b6e0).stop 2019-11-28T11:37:05.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.704+0000 7efe4a9fa700 1 -- 172.21.15.80:0/664168728 shutdown_connections 2019-11-28T11:37:05.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.704+0000 7efe4a9fa700 1 --2- 172.21.15.80:0/664168728 >> v2:172.21.15.174:3300/0 conn(0x7efe44072620 0x7efe44164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:05.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.704+0000 7efe4a9fa700 1 --2- 172.21.15.80:0/664168728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4406c0a0 0x7efe44072fa0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.704+0000 7efe4a9fa700 1 -- 172.21.15.80:0/664168728 shutdown_connections 2019-11-28T11:37:05.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.704+0000 7efe4a9fa700 1 -- 172.21.15.80:0/664168728 wait complete. 2019-11-28T11:37:05.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.704+0000 7efe4a9fa700 1 -- 172.21.15.80:0/664168728 >> 172.21.15.80:0/664168728 conn(0x7efe44061cf0 msgr2=0x7efe44064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:05.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.706+0000 7efe4a9fa700 1 Processor -- start 2019-11-28T11:37:05.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.706+0000 7efe4a9fa700 1 -- start start 2019-11-28T11:37:05.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.707+0000 7efe4a9fa700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe4413e5f0 0x7efe4413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:05.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.707+0000 7efe4a9fa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe4410a070 0x7efe4410bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:05.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.707+0000 7efe4a9fa700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe4410a4e0 0x7efe4410c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:05.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.707+0000 7efe4a9fa700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4410d630 con 0x7efe4410a070 2019-11-28T11:37:05.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.707+0000 7efe4a9fa700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4410e060 con 0x7efe4410a4e0 2019-11-28T11:37:05.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.707+0000 7efe4a9fa700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4413f1c0 con 0x7efe4413e5f0 2019-11-28T11:37:05.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.707+0000 7efe43fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe4410a070 0x7efe4410bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:05.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.707+0000 7efe43fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe4410a070 0x7efe4410bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37058/0 (socket says 172.21.15.80:37058) 2019-11-28T11:37:05.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.707+0000 7efe43fff700 1 -- 172.21.15.80:0/3104164893 learned_addr learned my addr 172.21.15.80:0/3104164893 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:05.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.707+0000 7efe48f97700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe4413e5f0 0x7efe4413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:05.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.707+0000 7efe49798700 1 --2- 172.21.15.80:0/3104164893 >> v2:172.21.15.174:3300/0 conn(0x7efe4410a4e0 0x7efe4410c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:05.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.707+0000 7efe43fff700 1 -- 172.21.15.80:0/3104164893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe4413e5f0 msgr2=0x7efe4413e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:05.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.707+0000 7efe43fff700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe4413e5f0 0x7efe4413e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.707+0000 7efe43fff700 1 -- 172.21.15.80:0/3104164893 >> v2:172.21.15.174:3300/0 conn(0x7efe4410a4e0 msgr2=0x7efe4410c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:05.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.707+0000 7efe43fff700 1 --2- 172.21.15.80:0/3104164893 >> v2:172.21.15.174:3300/0 conn(0x7efe4410a4e0 0x7efe4410c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.707+0000 7efe43fff700 1 -- 172.21.15.80:0/3104164893 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4410e9c0 con 0x7efe4410a070 2019-11-28T11:37:05.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.708+0000 7efe43fff700 1 --2- 172.21.15.80:0/3104164893 >> v2:172.21.15.80:3300/0 conn(0x7efe4410a070 0x7efe4410bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe340107b0 tx=0x7efe34010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.708+0000 7efe43fff700 1 --2- 172.21.15.80:0/3104164893 >> v2:172.21.15.80:3300/0 conn(0x7efe4410a070 0x7efe4410bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe340107b0 tx=0x7efe34010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.708+0000 7efe43fff700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4410a070 0x7efe4410bdb0 secure :-1 s=READY pgs=1162 cs=0 l=1 rx=0x7efe340107b0 tx=0x7efe34010660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:05.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.708+0000 7efe43fff700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4410a070 0x7efe4410bdb0 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7efe340107b0 tx=0x7efe34010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.708+0000 7efe43fff700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4410a070 0x7efe4410bdb0 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7efe340107b0 tx=0x7efe34010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.708+0000 7efe417fa700 1 -- 172.21.15.80:0/3104164893 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe34001250 con 0x7efe4410a070 2019-11-28T11:37:05.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.708+0000 7efe43fff700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4410a070 0x7efe4410bdb0 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7efe340107b0 tx=0x7efe34010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.708+0000 7efe417fa700 1 -- 172.21.15.80:0/3104164893 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe340047b0 con 0x7efe4410a070 2019-11-28T11:37:05.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.708+0000 7efe4a9fa700 1 -- 172.21.15.80:0/3104164893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4410ed40 con 0x7efe4410a070 2019-11-28T11:37:05.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.708+0000 7efe417fa700 1 -- 172.21.15.80:0/3104164893 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe34004e80 con 0x7efe4410a070 2019-11-28T11:37:05.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.708+0000 7efe4a9fa700 1 -- 172.21.15.80:0/3104164893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4410e9c0 con 0x7efe4410a070 2019-11-28T11:37:05.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.708+0000 7efe43fff700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4410a070 0x7efe4410bdb0 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7efe340107b0 tx=0x7efe34010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.708+0000 7efe417fa700 1 -- 172.21.15.80:0/3104164893 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efe340049a0 con 0x7efe4410a070 2019-11-28T11:37:05.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.708+0000 7efe43fff700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4410a070 0x7efe4410bdb0 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7efe340107b0 tx=0x7efe34010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.708+0000 7efe417fa700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe28018730 0x7efe2801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:05.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.708+0000 7efe417fa700 1 -- 172.21.15.80:0/3104164893 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7efe34031dc0 con 0x7efe4410a070 2019-11-28T11:37:05.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.709+0000 7efe48f97700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe28018730 0x7efe2801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:05.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.709+0000 7efe48f97700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe28018730 0x7efe2801abc0 crc :-1 s=READY pgs=471 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:05.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.717+0000 7efe4a9fa700 1 -- 172.21.15.80:0/3104164893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4410ed40 con 0x7efe4410a070 2019-11-28T11:37:05.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.720+0000 7efe43fff700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4410a070 0x7efe4410bdb0 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7efe340107b0 tx=0x7efe34010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.720+0000 7efe417fa700 1 -- 172.21.15.80:0/3104164893 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efe3402ded0 con 0x7efe4410a070 2019-11-28T11:37:05.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.898+0000 7efe4a9fa700 1 -- 172.21.15.80:0/3104164893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe4410e9c0 con 0x7efe4410a070 2019-11-28T11:37:05.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.899+0000 7efe43fff700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4410a070 0x7efe4410bdb0 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7efe340107b0 tx=0x7efe34010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:05.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.899+0000 7efe417fa700 1 -- 172.21.15.80:0/3104164893 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+14860 (secure 0 0 0) 0x7efe3402ded0 con 0x7efe4410a070 2019-11-28T11:37:05.961 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:37:05.962 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":93,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:37:05.208345+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:37:01.482997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2019-11-28T11:37:02.223344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:37:05.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.901+0000 7efe4a9fa700 1 -- 172.21.15.80:0/3104164893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe28018730 msgr2=0x7efe2801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:05.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.901+0000 7efe4a9fa700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe28018730 0x7efe2801abc0 crc :-1 s=READY pgs=471 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.901+0000 7efe4a9fa700 1 -- 172.21.15.80:0/3104164893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4410a070 msgr2=0x7efe4410bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:05.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.901+0000 7efe4a9fa700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4410a070 0x7efe4410bdb0 secure :-1 s=READY pgs=1162 cs=0 l=1 rx=0x7efe340107b0 tx=0x7efe34010660).stop 2019-11-28T11:37:05.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.901+0000 7efe4a9fa700 1 -- 172.21.15.80:0/3104164893 shutdown_connections 2019-11-28T11:37:05.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.901+0000 7efe4a9fa700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe28018730 0x7efe2801abc0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.901+0000 7efe4a9fa700 1 --2- 172.21.15.80:0/3104164893 >> v2:172.21.15.174:3300/0 conn(0x7efe4410a4e0 0x7efe4410c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.901+0000 7efe4a9fa700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4410a070 0x7efe4410bdb0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.901+0000 7efe4a9fa700 1 --2- 172.21.15.80:0/3104164893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe4413e5f0 0x7efe4413e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:05.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.901+0000 7efe4a9fa700 1 -- 172.21.15.80:0/3104164893 shutdown_connections 2019-11-28T11:37:05.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.901+0000 7efe4a9fa700 1 -- 172.21.15.80:0/3104164893 wait complete. 2019-11-28T11:37:05.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:05.901+0000 7efe4a9fa700 1 -- 172.21.15.80:0/3104164893 >> 172.21.15.80:0/3104164893 conn(0x7efe4413d620 msgr2=0x7efe4413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:05.983 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:37:05.983 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:37:05.984 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:37:05.984 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:37:05.985 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:37:05.985 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:37:05.993 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:37:05.993 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:37:05.994 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:37:05.994 DEBUG:teuthology.parallel:result is None 2019-11-28T11:37:05.994 DEBUG:teuthology.parallel:result is None 2019-11-28T11:37:05.994 DEBUG:teuthology.parallel:result is None 2019-11-28T11:37:05.995 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:37:06.085 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:37:06.086 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:37:06.086 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:37:06.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.071+0000 7f5e0b7cb700 1 Processor -- start 2019-11-28T11:37:06.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.072+0000 7f5e0b7cb700 1 -- start start 2019-11-28T11:37:06.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e0b7cb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5e0415ed10 0x7f5e0415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:06.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e0b7cb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5e04073020 0x7f5e04071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:06.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e0b7cb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0406db60 con 0x7f5e040734b0 2019-11-28T11:37:06.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e0b7cb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0406fe00 con 0x7f5e0415ed10 2019-11-28T11:37:06.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e0b7cb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e040700d0 con 0x7f5e04073020 2019-11-28T11:37:06.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e09d68700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5e0415ed10 0x7f5e0415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:06.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e09d68700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5e0415ed10 0x7f5e0415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37088/0 (socket says 172.21.15.80:37088) 2019-11-28T11:37:06.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e09d68700 1 -- 172.21.15.80:0/2689033202 learned_addr learned my addr 172.21.15.80:0/2689033202 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:06.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e09567700 1 --2- 172.21.15.80:0/2689033202 >> v2:172.21.15.174:3300/0 conn(0x7f5e04073020 0x7f5e04071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:06.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e09d68700 1 -- 172.21.15.80:0/2689033202 >> v2:172.21.15.174:3300/0 conn(0x7f5e04073020 msgr2=0x7f5e04071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:06.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e09d68700 1 --2- 172.21.15.80:0/2689033202 >> v2:172.21.15.174:3300/0 conn(0x7f5e04073020 0x7f5e04071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:06.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e09d68700 1 -- 172.21.15.80:0/2689033202 >> v1:172.21.15.174:6789/0 conn(0x7f5e040734b0 legacy=0x7f5e040723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:06.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e09d68700 1 -- 172.21.15.80:0/2689033202 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e04070760 con 0x7f5e0415ed10 2019-11-28T11:37:06.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e09d68700 1 --2- 172.21.15.80:0/2689033202 >> v2:172.21.15.80:3300/0 conn(0x7f5e0415ed10 0x7f5e0415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5df400f740 tx=0x7f5df400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e09d68700 1 --2- 172.21.15.80:0/2689033202 >> v2:172.21.15.80:3300/0 conn(0x7f5e0415ed10 0x7f5e0415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5df400f740 tx=0x7f5df400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e09d68700 1 --2- 172.21.15.80:0/2689033202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e0415ed10 0x7f5e0415f100 secure :-1 s=READY pgs=1170 cs=0 l=1 rx=0x7f5df400f740 tx=0x7f5df400f570).ready entity=mon.0 client_cookie=cdde38f7b96681b3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:06.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e09d68700 1 --2- 172.21.15.80:0/2689033202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e0415ed10 0x7f5e0415f100 secure :-1 s=THROTTLE_DONE pgs=1170 cs=0 l=1 rx=0x7f5df400f740 tx=0x7f5df400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e09d68700 1 --2- 172.21.15.80:0/2689033202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e0415ed10 0x7f5e0415f100 secure :-1 s=THROTTLE_DONE pgs=1170 cs=0 l=1 rx=0x7f5df400f740 tx=0x7f5df400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e08d66700 1 -- 172.21.15.80:0/2689033202 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5df4000960 con 0x7f5e0415ed10 2019-11-28T11:37:06.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e09d68700 1 --2- 172.21.15.80:0/2689033202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e0415ed10 0x7f5e0415f100 secure :-1 s=THROTTLE_DONE pgs=1170 cs=0 l=1 rx=0x7f5df400f740 tx=0x7f5df400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e08d66700 1 -- 172.21.15.80:0/2689033202 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df4000c90 con 0x7f5e0415ed10 2019-11-28T11:37:06.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e08d66700 1 -- 172.21.15.80:0/2689033202 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5df40013a0 con 0x7f5e0415ed10 2019-11-28T11:37:06.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e0b7cb700 1 -- 172.21.15.80:0/2689033202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e0415ed10 msgr2=0x7f5e0415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.073+0000 7f5e0b7cb700 1 --2- 172.21.15.80:0/2689033202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e0415ed10 0x7f5e0415f100 secure :-1 s=READY pgs=1170 cs=0 l=1 rx=0x7f5df400f740 tx=0x7f5df400f570).stop 2019-11-28T11:37:06.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.074+0000 7f5e0b7cb700 1 -- 172.21.15.80:0/2689033202 shutdown_connections 2019-11-28T11:37:06.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.074+0000 7f5e0b7cb700 1 --2- 172.21.15.80:0/2689033202 >> v2:172.21.15.174:3300/0 conn(0x7f5e04073020 0x7f5e04071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:06.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.074+0000 7f5e0b7cb700 1 --2- 172.21.15.80:0/2689033202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e0415ed10 0x7f5e0415f100 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:06.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.074+0000 7f5e0b7cb700 1 -- 172.21.15.80:0/2689033202 shutdown_connections 2019-11-28T11:37:06.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.074+0000 7f5e0b7cb700 1 -- 172.21.15.80:0/2689033202 wait complete. 2019-11-28T11:37:06.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.074+0000 7f5e0b7cb700 1 -- 172.21.15.80:0/2689033202 >> 172.21.15.80:0/2689033202 conn(0x7f5e04061d40 msgr2=0x7f5e040641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:06.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.077+0000 7f5e0b7cb700 1 Processor -- start 2019-11-28T11:37:06.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.077+0000 7f5e0b7cb700 1 -- start start 2019-11-28T11:37:06.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e0b7cb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5e04152750 0x7f5e041058b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:06.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e0b7cb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e04107c20 con 0x7f5e04105df0 2019-11-28T11:37:06.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e0b7cb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0415de30 con 0x7f5e0412cb40 2019-11-28T11:37:06.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e0b7cb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e04106880 con 0x7f5e04152750 2019-11-28T11:37:06.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e09d68700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5e04152750 0x7f5e041058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:06.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e09d68700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5e04152750 0x7f5e041058b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37094/0 (socket says 172.21.15.80:37094) 2019-11-28T11:37:06.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e09d68700 1 -- 172.21.15.80:0/746531969 learned_addr learned my addr 172.21.15.80:0/746531969 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:06.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e09d68700 1 -- 172.21.15.80:0/746531969 >> v1:172.21.15.174:6789/0 conn(0x7f5e0412cb40 legacy=0x7f5e041047a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e09d68700 1 -- 172.21.15.80:0/746531969 >> v1:172.21.15.80:6789/0 conn(0x7f5e04105df0 legacy=0x7f5e0412c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e09d68700 1 -- 172.21.15.80:0/746531969 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e04106f10 con 0x7f5e04152750 2019-11-28T11:37:06.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e027fc700 1 -- 172.21.15.80:0/746531969 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302363485 0 0) 0x7f5dec001010 con 0x7f5e04105df0 2019-11-28T11:37:06.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e09d68700 1 --2- 172.21.15.80:0/746531969 >> v2:172.21.15.80:3300/0 conn(0x7f5e04152750 0x7f5e041058b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5df400c440 tx=0x7f5df4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e09d68700 1 --2- 172.21.15.80:0/746531969 >> v2:172.21.15.80:3300/0 conn(0x7f5e04152750 0x7f5e041058b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5df400c440 tx=0x7f5df4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e09d68700 1 --2- 172.21.15.80:0/746531969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e04152750 0x7f5e041058b0 secure :-1 s=READY pgs=1172 cs=0 l=1 rx=0x7f5df400c440 tx=0x7f5df4010820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:06.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e09d68700 1 --2- 172.21.15.80:0/746531969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e04152750 0x7f5e041058b0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7f5df400c440 tx=0x7f5df4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e027fc700 1 -- 172.21.15.80:0/746531969 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5df4007de0 con 0x7f5e04152750 2019-11-28T11:37:06.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e09d68700 1 --2- 172.21.15.80:0/746531969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e04152750 0x7f5e041058b0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7f5df400c440 tx=0x7f5df4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e09d68700 1 --2- 172.21.15.80:0/746531969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e04152750 0x7f5e041058b0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7f5df400c440 tx=0x7f5df4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e027fc700 1 -- 172.21.15.80:0/746531969 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df4005370 con 0x7f5e04152750 2019-11-28T11:37:06.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e027fc700 1 -- 172.21.15.80:0/746531969 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5df4005a40 con 0x7f5e04152750 2019-11-28T11:37:06.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e0b7cb700 1 -- 172.21.15.80:0/746531969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e04107290 con 0x7f5e04152750 2019-11-28T11:37:06.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.078+0000 7f5e0b7cb700 1 -- 172.21.15.80:0/746531969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e04106f10 con 0x7f5e04152750 2019-11-28T11:37:06.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.079+0000 7f5e09d68700 1 --2- 172.21.15.80:0/746531969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e04152750 0x7f5e041058b0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7f5df400c440 tx=0x7f5df4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.079+0000 7f5e027fc700 1 -- 172.21.15.80:0/746531969 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5df40029d0 con 0x7f5e04152750 2019-11-28T11:37:06.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.079+0000 7f5e09d68700 1 --2- 172.21.15.80:0/746531969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e04152750 0x7f5e041058b0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7f5df400c440 tx=0x7f5df4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.079+0000 7f5e027fc700 1 --2- 172.21.15.80:0/746531969 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5de8018730 0x7f5de801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:06.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.079+0000 7f5e027fc700 1 -- 172.21.15.80:0/746531969 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5df4031b90 con 0x7f5e04152750 2019-11-28T11:37:06.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.079+0000 7f5e09567700 1 --2- 172.21.15.80:0/746531969 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5de8018730 0x7f5de801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:06.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.079+0000 7f5e09567700 1 --2- 172.21.15.80:0/746531969 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5de8018730 0x7f5de801abc0 crc :-1 s=READY pgs=472 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:06.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.087+0000 7f5e0b7cb700 1 -- 172.21.15.80:0/746531969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e04107290 con 0x7f5e04152750 2019-11-28T11:37:06.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.091+0000 7f5e09d68700 1 --2- 172.21.15.80:0/746531969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e04152750 0x7f5e041058b0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7f5df400c440 tx=0x7f5df4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.091+0000 7f5e027fc700 1 -- 172.21.15.80:0/746531969 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5df4007de0 con 0x7f5e04152750 2019-11-28T11:37:06.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.263+0000 7f5e0b7cb700 1 -- 172.21.15.80:0/746531969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5e04106f10 con 0x7f5e04152750 2019-11-28T11:37:06.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.268+0000 7f5e09d68700 1 --2- 172.21.15.80:0/746531969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e04152750 0x7f5e041058b0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7f5df400c440 tx=0x7f5df4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.268+0000 7f5e027fc700 1 -- 172.21.15.80:0/746531969 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v32) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5df4017520 con 0x7f5e04152750 2019-11-28T11:37:06.331 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:37:06.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.272+0000 7f5e0b7cb700 1 -- 172.21.15.80:0/746531969 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5de8018730 msgr2=0x7f5de801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.272+0000 7f5e0b7cb700 1 --2- 172.21.15.80:0/746531969 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5de8018730 0x7f5de801abc0 crc :-1 s=READY pgs=472 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:06.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.272+0000 7f5e0b7cb700 1 -- 172.21.15.80:0/746531969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e04152750 msgr2=0x7f5e041058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.272+0000 7f5e0b7cb700 1 --2- 172.21.15.80:0/746531969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e04152750 0x7f5e041058b0 secure :-1 s=READY pgs=1172 cs=0 l=1 rx=0x7f5df400c440 tx=0x7f5df4010820).stop 2019-11-28T11:37:06.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.272+0000 7f5e0b7cb700 1 -- 172.21.15.80:0/746531969 shutdown_connections 2019-11-28T11:37:06.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.272+0000 7f5e0b7cb700 1 --2- 172.21.15.80:0/746531969 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5de8018730 0x7f5de801abc0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:06.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.272+0000 7f5e0b7cb700 1 --2- 172.21.15.80:0/746531969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e04152750 0x7f5e041058b0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:06.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.273+0000 7f5e0b7cb700 1 -- 172.21.15.80:0/746531969 shutdown_connections 2019-11-28T11:37:06.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.273+0000 7f5e0b7cb700 1 -- 172.21.15.80:0/746531969 wait complete. 2019-11-28T11:37:06.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.273+0000 7f5e0b7cb700 1 -- 172.21.15.80:0/746531969 >> 172.21.15.80:0/746531969 conn(0x7f5e041476e0 msgr2=0x7f5e0412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:06.344 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:37:06.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.415+0000 7f70cd235700 1 Processor -- start 2019-11-28T11:37:06.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.415+0000 7f70cd235700 1 -- start start 2019-11-28T11:37:06.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.416+0000 7f70cd235700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f70c815ed10 0x7f70c815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:06.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.416+0000 7f70cd235700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c806db60 con 0x7f70c8073020 2019-11-28T11:37:06.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.416+0000 7f70cd235700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c806e060 con 0x7f70c80734b0 2019-11-28T11:37:06.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.416+0000 7f70cd235700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c806fe00 con 0x7f70c815ed10 2019-11-28T11:37:06.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.416+0000 7f70c759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f70c815ed10 0x7f70c815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:06.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.416+0000 7f70c6d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f70c8073020 0x7f70c8071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36422/0 (socket says 172.21.15.80:36422) 2019-11-28T11:37:06.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.416+0000 7f70c6d9d700 1 -- 172.21.15.80:0/700183403 learned_addr learned my addr 172.21.15.80:0/700183403 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:06.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.416+0000 7f70c759e700 1 -- 172.21.15.80:0/700183403 >> v1:172.21.15.174:6789/0 conn(0x7f70c80734b0 legacy=0x7f70c80726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.416+0000 7f70c759e700 1 -- 172.21.15.80:0/700183403 >> v1:172.21.15.80:6789/0 conn(0x7f70c8073020 legacy=0x7f70c8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.416+0000 7f70c759e700 1 -- 172.21.15.80:0/700183403 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8070760 con 0x7f70c815ed10 2019-11-28T11:37:06.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.416+0000 7f70c659c700 1 -- 172.21.15.80:0/700183403 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890810574 0 0) 0x7f70b00013f0 con 0x7f70c8073020 2019-11-28T11:37:06.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.416+0000 7f70c759e700 1 --2- 172.21.15.80:0/700183403 >> v2:172.21.15.80:3300/0 conn(0x7f70c815ed10 0x7f70c815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f70c000af50 tx=0x7f70c000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.416+0000 7f70c759e700 1 --2- 172.21.15.80:0/700183403 >> v2:172.21.15.80:3300/0 conn(0x7f70c815ed10 0x7f70c815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f70c000af50 tx=0x7f70c000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.416+0000 7f70c759e700 1 --2- 172.21.15.80:0/700183403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c815ed10 0x7f70c815f100 secure :-1 s=READY pgs=1174 cs=0 l=1 rx=0x7f70c000af50 tx=0x7f70c000b760).ready entity=mon.0 client_cookie=4059d428918c280 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:06.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.417+0000 7f70c759e700 1 --2- 172.21.15.80:0/700183403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c815ed10 0x7f70c815f100 secure :-1 s=THROTTLE_DONE pgs=1174 cs=0 l=1 rx=0x7f70c000af50 tx=0x7f70c000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.417+0000 7f70c659c700 1 -- 172.21.15.80:0/700183403 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c0007210 con 0x7f70c815ed10 2019-11-28T11:37:06.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.417+0000 7f70c759e700 1 --2- 172.21.15.80:0/700183403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c815ed10 0x7f70c815f100 secure :-1 s=THROTTLE_DONE pgs=1174 cs=0 l=1 rx=0x7f70c000af50 tx=0x7f70c000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.417+0000 7f70c759e700 1 --2- 172.21.15.80:0/700183403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c815ed10 0x7f70c815f100 secure :-1 s=THROTTLE_DONE pgs=1174 cs=0 l=1 rx=0x7f70c000af50 tx=0x7f70c000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.417+0000 7f70c659c700 1 -- 172.21.15.80:0/700183403 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c00099b0 con 0x7f70c815ed10 2019-11-28T11:37:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.417+0000 7f70c659c700 1 -- 172.21.15.80:0/700183403 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c000a080 con 0x7f70c815ed10 2019-11-28T11:37:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.417+0000 7f70cd235700 1 -- 172.21.15.80:0/700183403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c815ed10 msgr2=0x7f70c815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.417+0000 7f70cd235700 1 --2- 172.21.15.80:0/700183403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c815ed10 0x7f70c815f100 secure :-1 s=READY pgs=1174 cs=0 l=1 rx=0x7f70c000af50 tx=0x7f70c000b760).stop 2019-11-28T11:37:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.417+0000 7f70cd235700 1 -- 172.21.15.80:0/700183403 shutdown_connections 2019-11-28T11:37:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.417+0000 7f70cd235700 1 --2- 172.21.15.80:0/700183403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c815ed10 0x7f70c815f100 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:06.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.417+0000 7f70cd235700 1 -- 172.21.15.80:0/700183403 shutdown_connections 2019-11-28T11:37:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.417+0000 7f70cd235700 1 -- 172.21.15.80:0/700183403 wait complete. 2019-11-28T11:37:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.417+0000 7f70cd235700 1 -- 172.21.15.80:0/700183403 >> 172.21.15.80:0/700183403 conn(0x7f70c8061d40 msgr2=0x7f70c80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.420+0000 7f70cd235700 1 Processor -- start 2019-11-28T11:37:06.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.420+0000 7f70cd235700 1 -- start start 2019-11-28T11:37:06.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70cd235700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f70c8167d80 0x7f70c816a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:06.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70cd235700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c8130b20 con 0x7f70c812e1a0 2019-11-28T11:37:06.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70cd235700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c8130620 con 0x7f70c8114f60 2019-11-28T11:37:06.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70cd235700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c8148b60 con 0x7f70c8167d80 2019-11-28T11:37:06.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70c6d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f70c812e1a0 0x7f70c812e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36426/0 (socket says 172.21.15.80:36426) 2019-11-28T11:37:06.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70c6d9d700 1 -- 172.21.15.80:0/2809379246 learned_addr learned my addr 172.21.15.80:0/2809379246 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:06.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70cca34700 1 --2- 172.21.15.80:0/2809379246 >> v2:172.21.15.80:3300/0 conn(0x7f70c8167d80 0x7f70c816a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:06.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70bffff700 1 -- 172.21.15.80:0/2809379246 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411405022 0 0) 0x7f70b0001500 con 0x7f70c812e1a0 2019-11-28T11:37:06.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70bffff700 1 -- 172.21.15.80:0/2809379246 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70a0002e80 con 0x7f70c812e1a0 2019-11-28T11:37:06.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70bffff700 1 -- 172.21.15.80:0/2809379246 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841206587 0 0) 0x7f70c000b3d0 con 0x7f70c8114f60 2019-11-28T11:37:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70cca34700 1 -- 172.21.15.80:0/2809379246 >> v1:172.21.15.174:6789/0 conn(0x7f70c8114f60 legacy=0x7f70c8106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70cca34700 1 -- 172.21.15.80:0/2809379246 >> v1:172.21.15.80:6789/0 conn(0x7f70c812e1a0 legacy=0x7f70c812e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70cca34700 1 -- 172.21.15.80:0/2809379246 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8104390 con 0x7f70c8167d80 2019-11-28T11:37:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70cca34700 1 --2- 172.21.15.80:0/2809379246 >> v2:172.21.15.80:3300/0 conn(0x7f70c8167d80 0x7f70c816a180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f70b80103b0 tx=0x7f70b8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70cca34700 1 --2- 172.21.15.80:0/2809379246 >> v2:172.21.15.80:3300/0 conn(0x7f70c8167d80 0x7f70c816a180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f70b80103b0 tx=0x7f70b8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70cca34700 1 --2- 172.21.15.80:0/2809379246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c8167d80 0x7f70c816a180 secure :-1 s=READY pgs=1176 cs=0 l=1 rx=0x7f70b80103b0 tx=0x7f70b8010750).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:06.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70cca34700 1 --2- 172.21.15.80:0/2809379246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c8167d80 0x7f70c816a180 secure :-1 s=THROTTLE_DONE pgs=1176 cs=0 l=1 rx=0x7f70b80103b0 tx=0x7f70b8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70bffff700 1 -- 172.21.15.80:0/2809379246 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70b8000960 con 0x7f70c8167d80 2019-11-28T11:37:06.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70cca34700 1 --2- 172.21.15.80:0/2809379246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c8167d80 0x7f70c816a180 secure :-1 s=THROTTLE_DONE pgs=1176 cs=0 l=1 rx=0x7f70b80103b0 tx=0x7f70b8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70cca34700 1 --2- 172.21.15.80:0/2809379246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c8167d80 0x7f70c816a180 secure :-1 s=THROTTLE_DONE pgs=1176 cs=0 l=1 rx=0x7f70b80103b0 tx=0x7f70b8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70bffff700 1 -- 172.21.15.80:0/2809379246 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b800ede0 con 0x7f70c8167d80 2019-11-28T11:37:06.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70bffff700 1 -- 172.21.15.80:0/2809379246 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70b800f4f0 con 0x7f70c8167d80 2019-11-28T11:37:06.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.421+0000 7f70cd235700 1 -- 172.21.15.80:0/2809379246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c8104710 con 0x7f70c8167d80 2019-11-28T11:37:06.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.422+0000 7f70cd235700 1 -- 172.21.15.80:0/2809379246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c8104390 con 0x7f70c8167d80 2019-11-28T11:37:06.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.422+0000 7f70cca34700 1 --2- 172.21.15.80:0/2809379246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c8167d80 0x7f70c816a180 secure :-1 s=THROTTLE_DONE pgs=1176 cs=0 l=1 rx=0x7f70b80103b0 tx=0x7f70b8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.422+0000 7f70bffff700 1 -- 172.21.15.80:0/2809379246 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f70b8000940 con 0x7f70c8167d80 2019-11-28T11:37:06.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.422+0000 7f70cca34700 1 --2- 172.21.15.80:0/2809379246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c8167d80 0x7f70c816a180 secure :-1 s=THROTTLE_DONE pgs=1176 cs=0 l=1 rx=0x7f70b80103b0 tx=0x7f70b8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.422+0000 7f70bffff700 1 --2- 172.21.15.80:0/2809379246 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70a0018780 0x7f70a001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:06.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.422+0000 7f70bffff700 1 -- 172.21.15.80:0/2809379246 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f70b8031a80 con 0x7f70c8167d80 2019-11-28T11:37:06.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.422+0000 7f70c759e700 1 --2- 172.21.15.80:0/2809379246 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70a0018780 0x7f70a001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:06.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.423+0000 7f70c759e700 1 --2- 172.21.15.80:0/2809379246 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70a0018780 0x7f70a001abf0 crc :-1 s=READY pgs=473 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:06.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.430+0000 7f70cd235700 1 -- 172.21.15.80:0/2809379246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c8104710 con 0x7f70c8167d80 2019-11-28T11:37:06.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.434+0000 7f70cca34700 1 --2- 172.21.15.80:0/2809379246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c8167d80 0x7f70c816a180 secure :-1 s=THROTTLE_DONE pgs=1176 cs=0 l=1 rx=0x7f70b80103b0 tx=0x7f70b8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.434+0000 7f70bffff700 1 -- 172.21.15.80:0/2809379246 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f70b800e9e0 con 0x7f70c8167d80 2019-11-28T11:37:06.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.605+0000 7f70cd235700 1 -- 172.21.15.80:0/2809379246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f70c8104390 con 0x7f70c8167d80 2019-11-28T11:37:06.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.610+0000 7f70cca34700 1 --2- 172.21.15.80:0/2809379246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c8167d80 0x7f70c816a180 secure :-1 s=THROTTLE_DONE pgs=1176 cs=0 l=1 rx=0x7f70b80103b0 tx=0x7f70b8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.610+0000 7f70bffff700 1 -- 172.21.15.80:0/2809379246 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v33) v1 ==== 184+0+0 (secure 0 0 0) 0x7f70b800efd0 con 0x7f70c8167d80 2019-11-28T11:37:06.673 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:37:06.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.615+0000 7f70cd235700 1 -- 172.21.15.80:0/2809379246 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70a0018780 msgr2=0x7f70a001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.615+0000 7f70cd235700 1 --2- 172.21.15.80:0/2809379246 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70a0018780 0x7f70a001abf0 crc :-1 s=READY pgs=473 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:06.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.615+0000 7f70cd235700 1 -- 172.21.15.80:0/2809379246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c8167d80 msgr2=0x7f70c816a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.615+0000 7f70cd235700 1 --2- 172.21.15.80:0/2809379246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c8167d80 0x7f70c816a180 secure :-1 s=READY pgs=1176 cs=0 l=1 rx=0x7f70b80103b0 tx=0x7f70b8010750).stop 2019-11-28T11:37:06.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.615+0000 7f70cd235700 1 -- 172.21.15.80:0/2809379246 shutdown_connections 2019-11-28T11:37:06.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.615+0000 7f70cd235700 1 --2- 172.21.15.80:0/2809379246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70c8167d80 0x7f70c816a180 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:06.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.615+0000 7f70cd235700 1 --2- 172.21.15.80:0/2809379246 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70a0018780 0x7f70a001abf0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:06.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.615+0000 7f70cd235700 1 -- 172.21.15.80:0/2809379246 shutdown_connections 2019-11-28T11:37:06.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.615+0000 7f70cd235700 1 -- 172.21.15.80:0/2809379246 wait complete. 2019-11-28T11:37:06.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.615+0000 7f70cd235700 1 -- 172.21.15.80:0/2809379246 >> 172.21.15.80:0/2809379246 conn(0x7f70c81476e0 msgr2=0x7f70c812fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:06.687 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:37:06.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.757+0000 7f380170e700 1 Processor -- start 2019-11-28T11:37:06.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.757+0000 7f380170e700 1 -- start start 2019-11-28T11:37:06.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.758+0000 7f380170e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f37fc1639f0 0x7f37fc165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:06.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.758+0000 7f380170e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37fc06db60 con 0x7f37fc15f100 2019-11-28T11:37:06.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.758+0000 7f380170e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37fc06e060 con 0x7f37fc15ed10 2019-11-28T11:37:06.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.758+0000 7f380170e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37fc06fe00 con 0x7f37fc1639f0 2019-11-28T11:37:06.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37faffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f37fc15f100 0x7f37fc06bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36436/0 (socket says 172.21.15.80:36436) 2019-11-28T11:37:06.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37faffd700 1 -- 172.21.15.80:0/2334176864 learned_addr learned my addr 172.21.15.80:0/2334176864 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:06.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37fbfff700 1 --2- 172.21.15.80:0/2334176864 >> v2:172.21.15.174:3300/0 conn(0x7f37fc1639f0 0x7f37fc165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:06.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37fa7fc700 1 -- 172.21.15.80:0/2334176864 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927971119 0 0) 0x7f37e4001150 con 0x7f37fc15f100 2019-11-28T11:37:06.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37fa7fc700 1 -- 172.21.15.80:0/2334176864 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37e8002e80 con 0x7f37fc15f100 2019-11-28T11:37:06.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37fbfff700 1 -- 172.21.15.80:0/2334176864 >> v1:172.21.15.174:6789/0 conn(0x7f37fc15ed10 legacy=0x7f37fc073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37fbfff700 1 -- 172.21.15.80:0/2334176864 >> v1:172.21.15.80:6789/0 conn(0x7f37fc15f100 legacy=0x7f37fc06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37fa7fc700 1 -- 172.21.15.80:0/2334176864 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3858266635 0 0) 0x7f37e4001130 con 0x7f37fc15f100 2019-11-28T11:37:06.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37fbfff700 1 -- 172.21.15.80:0/2334176864 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc070760 con 0x7f37fc1639f0 2019-11-28T11:37:06.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37fbfff700 1 --2- 172.21.15.80:0/2334176864 >> v2:172.21.15.174:3300/0 conn(0x7f37fc1639f0 0x7f37fc165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f37f400b300 tx=0x7f37f400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37fbfff700 1 --2- 172.21.15.80:0/2334176864 >> v2:172.21.15.174:3300/0 conn(0x7f37fc1639f0 0x7f37fc165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f37f400b300 tx=0x7f37f400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37fbfff700 1 --2- 172.21.15.80:0/2334176864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37fc1639f0 0x7f37fc165df0 secure :-1 s=READY pgs=698 cs=0 l=1 rx=0x7f37f400b300 tx=0x7f37f400bb10).ready entity=mon.1 client_cookie=35518c47a45bdd28 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:06.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37fbfff700 1 --2- 172.21.15.80:0/2334176864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37fc1639f0 0x7f37fc165df0 secure :-1 s=THROTTLE_DONE pgs=698 cs=0 l=1 rx=0x7f37f400b300 tx=0x7f37f400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37fa7fc700 1 -- 172.21.15.80:0/2334176864 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37f40075c0 con 0x7f37fc1639f0 2019-11-28T11:37:06.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37fbfff700 1 --2- 172.21.15.80:0/2334176864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37fc1639f0 0x7f37fc165df0 secure :-1 s=THROTTLE_DONE pgs=698 cs=0 l=1 rx=0x7f37f400b300 tx=0x7f37f400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37fbfff700 1 --2- 172.21.15.80:0/2334176864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37fc1639f0 0x7f37fc165df0 secure :-1 s=THROTTLE_DONE pgs=698 cs=0 l=1 rx=0x7f37f400b300 tx=0x7f37f400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37fa7fc700 1 -- 172.21.15.80:0/2334176864 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f4000f30 con 0x7f37fc1639f0 2019-11-28T11:37:06.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f37fa7fc700 1 -- 172.21.15.80:0/2334176864 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37f400a1e0 con 0x7f37fc1639f0 2019-11-28T11:37:06.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f380170e700 1 -- 172.21.15.80:0/2334176864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37fc1639f0 msgr2=0x7f37fc165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.759+0000 7f380170e700 1 --2- 172.21.15.80:0/2334176864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37fc1639f0 0x7f37fc165df0 secure :-1 s=READY pgs=698 cs=0 l=1 rx=0x7f37f400b300 tx=0x7f37f400bb10).stop 2019-11-28T11:37:06.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.760+0000 7f380170e700 1 -- 172.21.15.80:0/2334176864 shutdown_connections 2019-11-28T11:37:06.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.760+0000 7f380170e700 1 --2- 172.21.15.80:0/2334176864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37fc1639f0 0x7f37fc165df0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:06.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.760+0000 7f380170e700 1 -- 172.21.15.80:0/2334176864 shutdown_connections 2019-11-28T11:37:06.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.760+0000 7f380170e700 1 -- 172.21.15.80:0/2334176864 wait complete. 2019-11-28T11:37:06.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.760+0000 7f380170e700 1 -- 172.21.15.80:0/2334176864 >> 172.21.15.80:0/2334176864 conn(0x7f37fc061d40 msgr2=0x7f37fc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:06.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.763+0000 7f380170e700 1 Processor -- start 2019-11-28T11:37:06.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.763+0000 7f380170e700 1 -- start start 2019-11-28T11:37:06.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f380170e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37fc134610 0x7f37fc134aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:06.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f380170e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37fc135410 con 0x7f37fc152750 2019-11-28T11:37:06.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f380170e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37fc109d70 con 0x7f37fc134fe0 2019-11-28T11:37:06.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f380170e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc132570 con 0x7f37fc134610 2019-11-28T11:37:06.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37fb7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f37fc152750 0x7f37fc135790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36438/0 (socket says 172.21.15.80:36438) 2019-11-28T11:37:06.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37fb7fe700 1 -- 172.21.15.80:0/1871964956 learned_addr learned my addr 172.21.15.80:0/1871964956 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:06.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37faffd700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37fc134610 0x7f37fc134aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:06.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37f3fff700 1 -- 172.21.15.80:0/1871964956 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977658918 0 0) 0x7f37ec001150 con 0x7f37fc152750 2019-11-28T11:37:06.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37f3fff700 1 -- 172.21.15.80:0/1871964956 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37e0002e80 con 0x7f37fc152750 2019-11-28T11:37:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37f3fff700 1 -- 172.21.15.80:0/1871964956 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839956517 0 0) 0x7f37f4000ec0 con 0x7f37fc134fe0 2019-11-28T11:37:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37f3fff700 1 -- 172.21.15.80:0/1871964956 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37e00030b0 con 0x7f37fc134fe0 2019-11-28T11:37:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37faffd700 1 -- 172.21.15.80:0/1871964956 >> v1:172.21.15.174:6789/0 conn(0x7f37fc134fe0 legacy=0x7f37fc167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37faffd700 1 -- 172.21.15.80:0/1871964956 >> v1:172.21.15.80:6789/0 conn(0x7f37fc152750 legacy=0x7f37fc135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37faffd700 1 -- 172.21.15.80:0/1871964956 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc132ed0 con 0x7f37fc134610 2019-11-28T11:37:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37faffd700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37fc134610 0x7f37fc134aa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f37e40103a0 tx=0x7f37e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37faffd700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37fc134610 0x7f37fc134aa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f37e40103a0 tx=0x7f37e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37faffd700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37fc134610 0x7f37fc134aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f37e40103a0 tx=0x7f37e4010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37faffd700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37fc134610 0x7f37fc134aa0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f37e40103a0 tx=0x7f37e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37f3fff700 1 -- 172.21.15.80:0/1871964956 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37e4000c90 con 0x7f37fc134610 2019-11-28T11:37:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37faffd700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37fc134610 0x7f37fc134aa0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f37e40103a0 tx=0x7f37e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.764+0000 7f37faffd700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37fc134610 0x7f37fc134aa0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f37e40103a0 tx=0x7f37e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.765+0000 7f37f3fff700 1 -- 172.21.15.80:0/1871964956 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e4001470 con 0x7f37fc134610 2019-11-28T11:37:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.765+0000 7f37f3fff700 1 -- 172.21.15.80:0/1871964956 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37e4001bc0 con 0x7f37fc134610 2019-11-28T11:37:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.765+0000 7f380170e700 1 -- 172.21.15.80:0/1871964956 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37fc133250 con 0x7f37fc134610 2019-11-28T11:37:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.765+0000 7f380170e700 1 -- 172.21.15.80:0/1871964956 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37fc132ed0 con 0x7f37fc134610 2019-11-28T11:37:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.765+0000 7f37faffd700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37fc134610 0x7f37fc134aa0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f37e40103a0 tx=0x7f37e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.765+0000 7f37f3fff700 1 -- 172.21.15.80:0/1871964956 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f37e40010b0 con 0x7f37fc134610 2019-11-28T11:37:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.765+0000 7f37faffd700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37fc134610 0x7f37fc134aa0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f37e40103a0 tx=0x7f37e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.765+0000 7f37f3fff700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f37e0018750 0x7f37e001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:06.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.765+0000 7f37f3fff700 1 -- 172.21.15.80:0/1871964956 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f37e4031b00 con 0x7f37fc134610 2019-11-28T11:37:06.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.766+0000 7f37fb7fe700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f37e0018750 0x7f37e001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:06.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.766+0000 7f37fb7fe700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f37e0018750 0x7f37e001abe0 crc :-1 s=READY pgs=474 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:06.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.773+0000 7f380170e700 1 -- 172.21.15.80:0/1871964956 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37fc133250 con 0x7f37fc134610 2019-11-28T11:37:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.777+0000 7f37faffd700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37fc134610 0x7f37fc134aa0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f37e40103a0 tx=0x7f37e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.777+0000 7f37f3fff700 1 -- 172.21.15.80:0/1871964956 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f37e4000ea0 con 0x7f37fc134610 2019-11-28T11:37:07.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.946+0000 7f380170e700 1 -- 172.21.15.80:0/1871964956 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f37fc132ed0 con 0x7f37fc134610 2019-11-28T11:37:07.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.953+0000 7f37faffd700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37fc134610 0x7f37fc134aa0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f37e40103a0 tx=0x7f37e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.953+0000 7f37f3fff700 1 -- 172.21.15.80:0/1871964956 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v34) v1 ==== 184+0+0 (secure 0 0 0) 0x7f37e40011e0 con 0x7f37fc134610 2019-11-28T11:37:07.016 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:37:07.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.956+0000 7f380170e700 1 -- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f37e0018750 msgr2=0x7f37e001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:07.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.956+0000 7f380170e700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f37e0018750 0x7f37e001abe0 crc :-1 s=READY pgs=474 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:07.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.956+0000 7f380170e700 1 -- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37fc134610 msgr2=0x7f37fc134aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:07.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.956+0000 7f380170e700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37fc134610 0x7f37fc134aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f37e40103a0 tx=0x7f37e4010740).stop 2019-11-28T11:37:07.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.956+0000 7f380170e700 1 -- 172.21.15.80:0/1871964956 shutdown_connections 2019-11-28T11:37:07.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.956+0000 7f380170e700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f37e0018750 0x7f37e001abe0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:07.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.956+0000 7f380170e700 1 --2- 172.21.15.80:0/1871964956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37fc134610 0x7f37fc134aa0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:07.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.956+0000 7f380170e700 1 -- 172.21.15.80:0/1871964956 shutdown_connections 2019-11-28T11:37:07.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.956+0000 7f380170e700 1 -- 172.21.15.80:0/1871964956 wait complete. 2019-11-28T11:37:07.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:06.956+0000 7f380170e700 1 -- 172.21.15.80:0/1871964956 >> 172.21.15.80:0/1871964956 conn(0x7f37fc1476e0 msgr2=0x7f37fc12fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:07.027 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:37:07.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.098+0000 7f5304978700 1 Processor -- start 2019-11-28T11:37:07.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.098+0000 7f5304978700 1 -- start start 2019-11-28T11:37:07.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.099+0000 7f5304978700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f530015f100 0x7f530006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:07.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.099+0000 7f5304978700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530006c2f0 0x7f530006c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:07.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.099+0000 7f5304978700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530006db60 con 0x7f530015ed10 2019-11-28T11:37:07.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.099+0000 7f5304978700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530006fe00 con 0x7f530015f100 2019-11-28T11:37:07.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.099+0000 7f5304978700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53000700d0 con 0x7f530006c2f0 2019-11-28T11:37:07.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52fe59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f530015f100 0x7f530006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:07.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52fe59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f530015f100 0x7f530006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37134/0 (socket says 172.21.15.80:37134) 2019-11-28T11:37:07.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52fe59c700 1 -- 172.21.15.80:0/1615353822 learned_addr learned my addr 172.21.15.80:0/1615353822 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:07.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52ff59e700 1 --2- 172.21.15.80:0/1615353822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530006c2f0 0x7f530006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:07.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52fe59c700 1 -- 172.21.15.80:0/1615353822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530006c2f0 msgr2=0x7f530006c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:07.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52fe59c700 1 --2- 172.21.15.80:0/1615353822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530006c2f0 0x7f530006c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:07.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52fe59c700 1 -- 172.21.15.80:0/1615353822 >> v1:172.21.15.174:6789/0 conn(0x7f530015ed10 legacy=0x7f5300073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:07.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52fe59c700 1 -- 172.21.15.80:0/1615353822 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5300070760 con 0x7f530015f100 2019-11-28T11:37:07.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52ff59e700 1 --2- 172.21.15.80:0/1615353822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530006c2f0 0x7f530006c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:37:07.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52fe59c700 1 --2- 172.21.15.80:0/1615353822 >> v2:172.21.15.80:3300/0 conn(0x7f530015f100 0x7f530006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f52f000f740 tx=0x7f52f000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52fe59c700 1 --2- 172.21.15.80:0/1615353822 >> v2:172.21.15.80:3300/0 conn(0x7f530015f100 0x7f530006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f52f000f740 tx=0x7f52f000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52fe59c700 1 --2- 172.21.15.80:0/1615353822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530015f100 0x7f530006bdb0 secure :-1 s=READY pgs=1179 cs=0 l=1 rx=0x7f52f000f740 tx=0x7f52f000fae0).ready entity=mon.0 client_cookie=f353901d98ea8cc1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:07.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52fe59c700 1 --2- 172.21.15.80:0/1615353822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530015f100 0x7f530006bdb0 secure :-1 s=THROTTLE_DONE pgs=1179 cs=0 l=1 rx=0x7f52f000f740 tx=0x7f52f000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52fe59c700 1 --2- 172.21.15.80:0/1615353822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530015f100 0x7f530006bdb0 secure :-1 s=THROTTLE_DONE pgs=1179 cs=0 l=1 rx=0x7f52f000f740 tx=0x7f52f000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52fe59c700 1 --2- 172.21.15.80:0/1615353822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530015f100 0x7f530006bdb0 secure :-1 s=THROTTLE_DONE pgs=1179 cs=0 l=1 rx=0x7f52f000f740 tx=0x7f52f000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52fdd9b700 1 -- 172.21.15.80:0/1615353822 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52f0000960 con 0x7f530015f100 2019-11-28T11:37:07.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52fdd9b700 1 -- 172.21.15.80:0/1615353822 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f0000c90 con 0x7f530015f100 2019-11-28T11:37:07.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f52fdd9b700 1 -- 172.21.15.80:0/1615353822 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52f0001320 con 0x7f530015f100 2019-11-28T11:37:07.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f5304978700 1 -- 172.21.15.80:0/1615353822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530015f100 msgr2=0x7f530006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:07.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.100+0000 7f5304978700 1 --2- 172.21.15.80:0/1615353822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530015f100 0x7f530006bdb0 secure :-1 s=READY pgs=1179 cs=0 l=1 rx=0x7f52f000f740 tx=0x7f52f000fae0).stop 2019-11-28T11:37:07.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.101+0000 7f5304978700 1 -- 172.21.15.80:0/1615353822 shutdown_connections 2019-11-28T11:37:07.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.101+0000 7f5304978700 1 --2- 172.21.15.80:0/1615353822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530006c2f0 0x7f530006c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:07.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.101+0000 7f5304978700 1 --2- 172.21.15.80:0/1615353822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530015f100 0x7f530006bdb0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:07.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.101+0000 7f5304978700 1 -- 172.21.15.80:0/1615353822 shutdown_connections 2019-11-28T11:37:07.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.101+0000 7f5304978700 1 -- 172.21.15.80:0/1615353822 wait complete. 2019-11-28T11:37:07.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.101+0000 7f5304978700 1 -- 172.21.15.80:0/1615353822 >> 172.21.15.80:0/1615353822 conn(0x7f5300061d40 msgr2=0x7f53000641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:07.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.104+0000 7f5304978700 1 Processor -- start 2019-11-28T11:37:07.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.104+0000 7f5304978700 1 -- start start 2019-11-28T11:37:07.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.104+0000 7f5304978700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f530014d5e0 0x7f530010d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:07.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.104+0000 7f5304978700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530010d730 0x7f530012e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:07.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.104+0000 7f5304978700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530014dd80 con 0x7f530012ea20 2019-11-28T11:37:07.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.104+0000 7f5304978700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53001602a0 con 0x7f530014d5e0 2019-11-28T11:37:07.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.104+0000 7f5304978700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5300160570 con 0x7f530010d730 2019-11-28T11:37:07.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.104+0000 7f52fed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f530014d5e0 0x7f530010d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:07.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.104+0000 7f52fed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f530014d5e0 0x7f530010d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37136/0 (socket says 172.21.15.80:37136) 2019-11-28T11:37:07.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.104+0000 7f52fed9d700 1 -- 172.21.15.80:0/4003923963 learned_addr learned my addr 172.21.15.80:0/4003923963 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:07.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f52fe59c700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530010d730 0x7f530012e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:07.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f52fed9d700 1 -- 172.21.15.80:0/4003923963 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530010d730 msgr2=0x7f530012e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:07.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f52fed9d700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530010d730 0x7f530012e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:07.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f52fed9d700 1 -- 172.21.15.80:0/4003923963 >> v1:172.21.15.174:6789/0 conn(0x7f530012ea20 legacy=0x7f530010c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:07.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f52fed9d700 1 -- 172.21.15.80:0/4003923963 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5300160c00 con 0x7f530014d5e0 2019-11-28T11:37:07.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f52fed9d700 1 --2- 172.21.15.80:0/4003923963 >> v2:172.21.15.80:3300/0 conn(0x7f530014d5e0 0x7f530010d1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52e8010790 tx=0x7f52e80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f52fed9d700 1 --2- 172.21.15.80:0/4003923963 >> v2:172.21.15.80:3300/0 conn(0x7f530014d5e0 0x7f530010d1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52e8010790 tx=0x7f52e80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f52fed9d700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530014d5e0 0x7f530010d1f0 secure :-1 s=READY pgs=1180 cs=0 l=1 rx=0x7f52e8010790 tx=0x7f52e80105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:07.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f52fed9d700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530014d5e0 0x7f530010d1f0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f52e8010790 tx=0x7f52e80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f52fed9d700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530014d5e0 0x7f530010d1f0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f52e8010790 tx=0x7f52e80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f52f77fe700 1 -- 172.21.15.80:0/4003923963 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52e8000ce0 con 0x7f530014d5e0 2019-11-28T11:37:07.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f52fed9d700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530014d5e0 0x7f530010d1f0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f52e8010790 tx=0x7f52e80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f52f77fe700 1 -- 172.21.15.80:0/4003923963 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e8001420 con 0x7f530014d5e0 2019-11-28T11:37:07.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f5304978700 1 -- 172.21.15.80:0/4003923963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5300160f80 con 0x7f530014d5e0 2019-11-28T11:37:07.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f52f77fe700 1 -- 172.21.15.80:0/4003923963 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52e8001b70 con 0x7f530014d5e0 2019-11-28T11:37:07.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f5304978700 1 -- 172.21.15.80:0/4003923963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5300160c00 con 0x7f530014d5e0 2019-11-28T11:37:07.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.105+0000 7f52fed9d700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530014d5e0 0x7f530010d1f0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f52e8010790 tx=0x7f52e80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.106+0000 7f52f77fe700 1 -- 172.21.15.80:0/4003923963 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f52e8001610 con 0x7f530014d5e0 2019-11-28T11:37:07.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.106+0000 7f52fed9d700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530014d5e0 0x7f530010d1f0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f52e8010790 tx=0x7f52e80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.106+0000 7f52f77fe700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f52d8018730 0x7f52d801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:07.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.106+0000 7f52f77fe700 1 -- 172.21.15.80:0/4003923963 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f52e8031e40 con 0x7f530014d5e0 2019-11-28T11:37:07.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.106+0000 7f52fe59c700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f52d8018730 0x7f52d801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:07.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.106+0000 7f52fe59c700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f52d8018730 0x7f52d801abc0 crc :-1 s=READY pgs=475 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.114+0000 7f5304978700 1 -- 172.21.15.80:0/4003923963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5300160f80 con 0x7f530014d5e0 2019-11-28T11:37:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.117+0000 7f52fed9d700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530014d5e0 0x7f530010d1f0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f52e8010790 tx=0x7f52e80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.117+0000 7f52f77fe700 1 -- 172.21.15.80:0/4003923963 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f52e8007930 con 0x7f530014d5e0 2019-11-28T11:37:07.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.289+0000 7f5304978700 1 -- 172.21.15.80:0/4003923963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5300160c00 con 0x7f530014d5e0 2019-11-28T11:37:07.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.294+0000 7f52fed9d700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530014d5e0 0x7f530010d1f0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f52e8010790 tx=0x7f52e80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.294+0000 7f52f77fe700 1 -- 172.21.15.80:0/4003923963 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v35) v1 ==== 184+0+0 (secure 0 0 0) 0x7f52e8000f90 con 0x7f530014d5e0 2019-11-28T11:37:07.357 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:37:07.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.298+0000 7f5304978700 1 -- 172.21.15.80:0/4003923963 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f52d8018730 msgr2=0x7f52d801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:07.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.298+0000 7f5304978700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f52d8018730 0x7f52d801abc0 crc :-1 s=READY pgs=475 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:07.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.298+0000 7f5304978700 1 -- 172.21.15.80:0/4003923963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530014d5e0 msgr2=0x7f530010d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:07.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.298+0000 7f5304978700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530014d5e0 0x7f530010d1f0 secure :-1 s=READY pgs=1180 cs=0 l=1 rx=0x7f52e8010790 tx=0x7f52e80105f0).stop 2019-11-28T11:37:07.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.298+0000 7f5304978700 1 -- 172.21.15.80:0/4003923963 shutdown_connections 2019-11-28T11:37:07.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.298+0000 7f5304978700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f52d8018730 0x7f52d801abc0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:07.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.298+0000 7f5304978700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f530010d730 0x7f530012e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:07.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.298+0000 7f5304978700 1 --2- 172.21.15.80:0/4003923963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f530014d5e0 0x7f530010d1f0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:07.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.298+0000 7f5304978700 1 -- 172.21.15.80:0/4003923963 shutdown_connections 2019-11-28T11:37:07.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.298+0000 7f5304978700 1 -- 172.21.15.80:0/4003923963 wait complete. 2019-11-28T11:37:07.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.298+0000 7f5304978700 1 -- 172.21.15.80:0/4003923963 >> 172.21.15.80:0/4003923963 conn(0x7f530014eee0 msgr2=0x7f5300149850 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:07.379 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:37:07.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.443+0000 7f3a0c9a6700 1 Processor -- start 2019-11-28T11:37:07.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.443+0000 7f3a0c9a6700 1 -- start start 2019-11-28T11:37:07.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.444+0000 7f3a0c9a6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3a0806c0a0 0x7f3a08072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:07.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.444+0000 7f3a0c9a6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a080734e0 0x7f3a08071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:07.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.444+0000 7f3a0c9a6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0806db00 con 0x7f3a08072360 2019-11-28T11:37:07.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.444+0000 7f3a0c9a6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0806fd60 con 0x7f3a0806c0a0 2019-11-28T11:37:07.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.444+0000 7f3a0c9a6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a08070030 con 0x7f3a080734e0 2019-11-28T11:37:07.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.444+0000 7f3a0759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3a08072360 0x7f3a0806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36462/0 (socket says 172.21.15.80:36462) 2019-11-28T11:37:07.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.444+0000 7f3a0759e700 1 -- 172.21.15.80:0/3854709169 learned_addr learned my addr 172.21.15.80:0/3854709169 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:07.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a0659c700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a080734e0 0x7f3a08071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:07.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a06d9d700 1 --2- 172.21.15.80:0/3854709169 >> v2:172.21.15.174:3300/0 conn(0x7f3a0806c0a0 0x7f3a08072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:07.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a05d9b700 1 -- 172.21.15.80:0/3854709169 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067024154 0 0) 0x7f3a00001150 con 0x7f3a08072360 2019-11-28T11:37:07.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a05d9b700 1 -- 172.21.15.80:0/3854709169 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39e8002e80 con 0x7f3a08072360 2019-11-28T11:37:07.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a05d9b700 1 -- 172.21.15.80:0/3854709169 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1169938404 0 0) 0x7f3a00001130 con 0x7f3a08072360 2019-11-28T11:37:07.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a05d9b700 1 -- 172.21.15.80:0/3854709169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a080734e0 msgr2=0x7f3a08071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:07.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a05d9b700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a080734e0 0x7f3a08071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:07.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a05d9b700 1 -- 172.21.15.80:0/3854709169 >> v2:172.21.15.174:3300/0 conn(0x7f3a0806c0a0 msgr2=0x7f3a08072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:07.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a05d9b700 1 --2- 172.21.15.80:0/3854709169 >> v2:172.21.15.174:3300/0 conn(0x7f3a0806c0a0 0x7f3a08072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:07.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a05d9b700 1 -- 172.21.15.80:0/3854709169 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a080706c0 con 0x7f3a08072360 2019-11-28T11:37:07.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a05d9b700 1 -- 172.21.15.80:0/3854709169 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f3a00001660 con 0x7f3a08072360 2019-11-28T11:37:07.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a06d9d700 1 --2- 172.21.15.80:0/3854709169 >> v2:172.21.15.174:3300/0 conn(0x7f3a0806c0a0 0x7f3a08072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:37:07.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a05d9b700 1 -- 172.21.15.80:0/3854709169 >> v1:172.21.15.80:6789/0 conn(0x7f3a08072360 legacy=0x7f3a0806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:07.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a05d9b700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39e80479e0 0x7f39e8049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:07.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a05d9b700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39e804a5a0 0x7f39e804ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:07.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a05d9b700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39e804d270 0x7f39e804f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:07.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a05d9b700 1 -- 172.21.15.80:0/3854709169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e804ff50 con 0x7f39e804a5a0 2019-11-28T11:37:07.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a05d9b700 1 -- 172.21.15.80:0/3854709169 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e8050140 con 0x7f39e804d270 2019-11-28T11:37:07.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a05d9b700 1 -- 172.21.15.80:0/3854709169 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e8050370 con 0x7f39e80479e0 2019-11-28T11:37:07.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a0659c700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39e804a5a0 0x7f39e804ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:07.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a06d9d700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39e80479e0 0x7f39e8049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:07.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a0759e700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39e804d270 0x7f39e804f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:07.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a0659c700 1 -- 172.21.15.80:0/3854709169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39e80479e0 msgr2=0x7f39e8049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:07.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a0659c700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39e80479e0 0x7f39e8049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:07.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a0659c700 1 -- 172.21.15.80:0/3854709169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39e804d270 msgr2=0x7f39e804f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:07.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a0659c700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39e804d270 0x7f39e804f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:07.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a0659c700 1 -- 172.21.15.80:0/3854709169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e8050620 con 0x7f39e804a5a0 2019-11-28T11:37:07.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a0759e700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39e804d270 0x7f39e804f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:37:07.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.445+0000 7f3a0659c700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39e804a5a0 0x7f39e804ca70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f39f000f660 tx=0x7f39f0002b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.446+0000 7f3a0659c700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39e804a5a0 0x7f39e804ca70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f39f000f660 tx=0x7f39f0002b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.446+0000 7f3a0659c700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39e804a5a0 0x7f39e804ca70 secure :-1 s=READY pgs=1182 cs=0 l=1 rx=0x7f39f000f660 tx=0x7f39f0002b90).ready entity=mon.0 client_cookie=71805ffd003bf2cd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:07.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.446+0000 7f3a0659c700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39e804a5a0 0x7f39e804ca70 secure :-1 s=THROTTLE_DONE pgs=1182 cs=0 l=1 rx=0x7f39f000f660 tx=0x7f39f0002b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.446+0000 7f3a05d9b700 1 -- 172.21.15.80:0/3854709169 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f0000940 con 0x7f39e804a5a0 2019-11-28T11:37:07.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.446+0000 7f3a0659c700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39e804a5a0 0x7f39e804ca70 secure :-1 s=THROTTLE_DONE pgs=1182 cs=0 l=1 rx=0x7f39f000f660 tx=0x7f39f0002b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.446+0000 7f3a0659c700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39e804a5a0 0x7f39e804ca70 secure :-1 s=THROTTLE_DONE pgs=1182 cs=0 l=1 rx=0x7f39f000f660 tx=0x7f39f0002b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.446+0000 7f3a05d9b700 1 -- 172.21.15.80:0/3854709169 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f0000ea0 con 0x7f39e804a5a0 2019-11-28T11:37:07.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.446+0000 7f3a05d9b700 1 -- 172.21.15.80:0/3854709169 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f0001530 con 0x7f39e804a5a0 2019-11-28T11:37:07.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.446+0000 7f3a0c9a6700 1 -- 172.21.15.80:0/3854709169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39e804a5a0 msgr2=0x7f39e804ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:07.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.446+0000 7f3a0c9a6700 1 --2- 172.21.15.80:0/3854709169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39e804a5a0 0x7f39e804ca70 secure :-1 s=READY pgs=1182 cs=0 l=1 rx=0x7f39f000f660 tx=0x7f39f0002b90).stop 2019-11-28T11:37:07.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.446+0000 7f3a0759e700 1 -- 172.21.15.80:0/3854709169 reap_dead start 2019-11-28T11:37:07.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.446+0000 7f3a0c9a6700 1 -- 172.21.15.80:0/3854709169 shutdown_connections 2019-11-28T11:37:07.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.446+0000 7f3a0c9a6700 1 -- 172.21.15.80:0/3854709169 shutdown_connections 2019-11-28T11:37:07.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.446+0000 7f3a0c9a6700 1 -- 172.21.15.80:0/3854709169 wait complete. 2019-11-28T11:37:07.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.446+0000 7f3a0c9a6700 1 -- 172.21.15.80:0/3854709169 >> 172.21.15.80:0/3854709169 conn(0x7f3a08061cf0 msgr2=0x7f3a08064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:07.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.449+0000 7f3a0c9a6700 1 Processor -- start 2019-11-28T11:37:07.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.449+0000 7f3a0c9a6700 1 -- start start 2019-11-28T11:37:07.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0c9a6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a08107940 0x7f3a0810f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:07.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0c9a6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a0810f7a0 0x7f3a081629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:07.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0c9a6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a08107110 con 0x7f3a0813fb20 2019-11-28T11:37:07.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0c9a6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0813b5e0 con 0x7f3a08107940 2019-11-28T11:37:07.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0c9a6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0813b8b0 con 0x7f3a0810f7a0 2019-11-28T11:37:07.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a06d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3a0813fb20 0x7f3a081080b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36472/0 (socket says 172.21.15.80:36472) 2019-11-28T11:37:07.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a06d9d700 1 -- 172.21.15.80:0/2740863347 learned_addr learned my addr 172.21.15.80:0/2740863347 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:07.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0659c700 1 --2- 172.21.15.80:0/2740863347 >> v2:172.21.15.80:3300/0 conn(0x7f3a08107940 0x7f3a0810f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:07.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0759e700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a0810f7a0 0x7f3a081629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:07.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f39ff7fe700 1 -- 172.21.15.80:0/2740863347 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736965619 0 0) 0x7f39f8009c00 con 0x7f3a0813fb20 2019-11-28T11:37:07.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f39ff7fe700 1 -- 172.21.15.80:0/2740863347 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39e0002e80 con 0x7f3a0813fb20 2019-11-28T11:37:07.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0659c700 1 -- 172.21.15.80:0/2740863347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a0810f7a0 msgr2=0x7f3a081629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:07.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0659c700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a0810f7a0 0x7f3a081629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:07.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0659c700 1 -- 172.21.15.80:0/2740863347 >> v1:172.21.15.80:6789/0 conn(0x7f3a0813fb20 legacy=0x7f3a081080b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:07.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0659c700 1 -- 172.21.15.80:0/2740863347 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0813bf40 con 0x7f3a08107940 2019-11-28T11:37:07.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0759e700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a0810f7a0 0x7f3a081629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:37:07.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0659c700 1 --2- 172.21.15.80:0/2740863347 >> v2:172.21.15.80:3300/0 conn(0x7f3a08107940 0x7f3a0810f260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f39f00103b0 tx=0x7f39f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0659c700 1 --2- 172.21.15.80:0/2740863347 >> v2:172.21.15.80:3300/0 conn(0x7f3a08107940 0x7f3a0810f260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f39f00103b0 tx=0x7f39f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0659c700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a08107940 0x7f3a0810f260 secure :-1 s=READY pgs=1184 cs=0 l=1 rx=0x7f39f00103b0 tx=0x7f39f0010750).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:07.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0659c700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a08107940 0x7f3a0810f260 secure :-1 s=THROTTLE_DONE pgs=1184 cs=0 l=1 rx=0x7f39f00103b0 tx=0x7f39f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f39ff7fe700 1 -- 172.21.15.80:0/2740863347 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f00024f0 con 0x7f3a08107940 2019-11-28T11:37:07.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0659c700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a08107940 0x7f3a0810f260 secure :-1 s=THROTTLE_DONE pgs=1184 cs=0 l=1 rx=0x7f39f00103b0 tx=0x7f39f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0659c700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a08107940 0x7f3a0810f260 secure :-1 s=THROTTLE_DONE pgs=1184 cs=0 l=1 rx=0x7f39f00103b0 tx=0x7f39f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f39ff7fe700 1 -- 172.21.15.80:0/2740863347 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f0002140 con 0x7f3a08107940 2019-11-28T11:37:07.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f3a0c9a6700 1 -- 172.21.15.80:0/2740863347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0810dea0 con 0x7f3a08107940 2019-11-28T11:37:07.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.450+0000 7f39ff7fe700 1 -- 172.21.15.80:0/2740863347 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f0001120 con 0x7f3a08107940 2019-11-28T11:37:07.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.451+0000 7f3a0c9a6700 1 -- 172.21.15.80:0/2740863347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0813bf40 con 0x7f3a08107940 2019-11-28T11:37:07.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.451+0000 7f3a0659c700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a08107940 0x7f3a0810f260 secure :-1 s=THROTTLE_DONE pgs=1184 cs=0 l=1 rx=0x7f39f00103b0 tx=0x7f39f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.451+0000 7f39ff7fe700 1 -- 172.21.15.80:0/2740863347 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f39f0000b50 con 0x7f3a08107940 2019-11-28T11:37:07.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.451+0000 7f3a0659c700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a08107940 0x7f3a0810f260 secure :-1 s=THROTTLE_DONE pgs=1184 cs=0 l=1 rx=0x7f39f00103b0 tx=0x7f39f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.451+0000 7f39ff7fe700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f39e0018770 0x7f39e001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:07.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.451+0000 7f39ff7fe700 1 -- 172.21.15.80:0/2740863347 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f39f0031a50 con 0x7f3a08107940 2019-11-28T11:37:07.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.452+0000 7f3a06d9d700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f39e0018770 0x7f39e001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:07.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.452+0000 7f3a06d9d700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f39e0018770 0x7f39e001abe0 crc :-1 s=READY pgs=476 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:07.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.459+0000 7f3a0c9a6700 1 -- 172.21.15.80:0/2740863347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0810dea0 con 0x7f3a08107940 2019-11-28T11:37:07.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.462+0000 7f3a0659c700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a08107940 0x7f3a0810f260 secure :-1 s=THROTTLE_DONE pgs=1184 cs=0 l=1 rx=0x7f39f00103b0 tx=0x7f39f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.462+0000 7f39ff7fe700 1 -- 172.21.15.80:0/2740863347 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f39f0017420 con 0x7f3a08107940 2019-11-28T11:37:07.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.633+0000 7f3a0c9a6700 1 -- 172.21.15.80:0/2740863347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a0813bf40 con 0x7f3a08107940 2019-11-28T11:37:07.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.634+0000 7f3a0659c700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a08107940 0x7f3a0810f260 secure :-1 s=THROTTLE_DONE pgs=1184 cs=0 l=1 rx=0x7f39f00103b0 tx=0x7f39f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:07.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.634+0000 7f39ff7fe700 1 -- 172.21.15.80:0/2740863347 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+1424 (secure 0 0 0) 0x7f39f0000940 con 0x7f3a08107940 2019-11-28T11:37:07.700 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 57 2019-11-28T11:37:07.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.636+0000 7f3a0c9a6700 1 -- 172.21.15.80:0/2740863347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f39e0018770 msgr2=0x7f39e001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:07.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.636+0000 7f3a0c9a6700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f39e0018770 0x7f39e001abe0 crc :-1 s=READY pgs=476 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:07.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.636+0000 7f3a0c9a6700 1 -- 172.21.15.80:0/2740863347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a08107940 msgr2=0x7f3a0810f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:07.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.636+0000 7f3a0c9a6700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a08107940 0x7f3a0810f260 secure :-1 s=READY pgs=1184 cs=0 l=1 rx=0x7f39f00103b0 tx=0x7f39f0010750).stop 2019-11-28T11:37:07.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.636+0000 7f3a0c9a6700 1 -- 172.21.15.80:0/2740863347 shutdown_connections 2019-11-28T11:37:07.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.636+0000 7f3a0c9a6700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f39e0018770 0x7f39e001abe0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:07.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.636+0000 7f3a0c9a6700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a0810f7a0 0x7f3a081629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:07.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.636+0000 7f3a0c9a6700 1 --2- 172.21.15.80:0/2740863347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a08107940 0x7f3a0810f260 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:07.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.636+0000 7f3a0c9a6700 1 -- 172.21.15.80:0/2740863347 shutdown_connections 2019-11-28T11:37:07.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.636+0000 7f3a0c9a6700 1 -- 172.21.15.80:0/2740863347 wait complete. 2019-11-28T11:37:07.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:07.636+0000 7f3a0c9a6700 1 -- 172.21.15.80:0/2740863347 >> 172.21.15.80:0/2740863347 conn(0x7f3a08142090 msgr2=0x7f3a0810ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:07.704 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:37:07.704 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:37:05.207937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:37:08.016 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 14, u'failed': [], u'epoch': 57, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [15], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:37:03.205339+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:37:05.207937+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:37:08.016 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:37:09.020 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:37:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.081+0000 7f8a3f05c700 1 Processor -- start 2019-11-28T11:37:09.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.081+0000 7f8a3f05c700 1 -- start start 2019-11-28T11:37:09.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.082+0000 7f8a3f05c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806c490 0x7f8a3806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:09.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.082+0000 7f8a3f05c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8a3806ce60 0x7f8a38164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:09.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.082+0000 7f8a3f05c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3806db00 con 0x7f8a3806c0a0 2019-11-28T11:37:09.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.082+0000 7f8a3f05c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3806fd60 con 0x7f8a3806ce60 2019-11-28T11:37:09.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.082+0000 7f8a3f05c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a38070030 con 0x7f8a3806c490 2019-11-28T11:37:09.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.082+0000 7f8a3cdf8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806c490 0x7f8a3806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:09.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a3d5f9700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f8a3806c0a0 0x7f8a38072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:52024/0 (socket says 172.21.15.80:52024) 2019-11-28T11:37:09.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a3ddfa700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8a3806ce60 0x7f8a38164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:09.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a3d5f9700 1 -- 172.21.15.80:0/605950672 learned_addr learned my addr 172.21.15.80:0/605950672 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:09.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a3cdf8700 1 -- 172.21.15.80:0/605950672 >> v2:172.21.15.174:3300/0 conn(0x7f8a3806ce60 msgr2=0x7f8a38164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:09.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a3cdf8700 1 --2- 172.21.15.80:0/605950672 >> v2:172.21.15.174:3300/0 conn(0x7f8a3806ce60 0x7f8a38164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:09.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a3cdf8700 1 -- 172.21.15.80:0/605950672 >> v1:172.21.15.174:6789/0 conn(0x7f8a3806c0a0 legacy=0x7f8a38072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:09.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a37fff700 1 -- 172.21.15.80:0/605950672 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502643616 0 0) 0x7f8a20001480 con 0x7f8a3806c0a0 2019-11-28T11:37:09.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a3cdf8700 1 -- 172.21.15.80:0/605950672 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a380706c0 con 0x7f8a3806c490 2019-11-28T11:37:09.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a3ddfa700 1 --2- 172.21.15.80:0/605950672 >> v2:172.21.15.174:3300/0 conn(0x7f8a3806ce60 0x7f8a38164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:37:09.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a3cdf8700 1 --2- 172.21.15.80:0/605950672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806c490 0x7f8a3806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8a2800af50 tx=0x7f8a2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:09.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a3cdf8700 1 --2- 172.21.15.80:0/605950672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806c490 0x7f8a3806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8a2800af50 tx=0x7f8a2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:09.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a3cdf8700 1 --2- 172.21.15.80:0/605950672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806c490 0x7f8a3806c920 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f8a2800af50 tx=0x7f8a2800b760).ready entity=mon.2 client_cookie=7a7821f0e019e888 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:09.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a3cdf8700 1 --2- 172.21.15.80:0/605950672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806c490 0x7f8a3806c920 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f8a2800af50 tx=0x7f8a2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:09.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a37fff700 1 -- 172.21.15.80:0/605950672 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a28007210 con 0x7f8a3806c490 2019-11-28T11:37:09.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a3cdf8700 1 --2- 172.21.15.80:0/605950672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806c490 0x7f8a3806c920 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f8a2800af50 tx=0x7f8a2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:09.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a3cdf8700 1 --2- 172.21.15.80:0/605950672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806c490 0x7f8a3806c920 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f8a2800af50 tx=0x7f8a2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:09.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a37fff700 1 -- 172.21.15.80:0/605950672 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a280099b0 con 0x7f8a3806c490 2019-11-28T11:37:09.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a37fff700 1 -- 172.21.15.80:0/605950672 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a2800a080 con 0x7f8a3806c490 2019-11-28T11:37:09.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a3f05c700 1 -- 172.21.15.80:0/605950672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806c490 msgr2=0x7f8a3806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:09.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.083+0000 7f8a3f05c700 1 --2- 172.21.15.80:0/605950672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806c490 0x7f8a3806c920 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f8a2800af50 tx=0x7f8a2800b760).stop 2019-11-28T11:37:09.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.084+0000 7f8a3f05c700 1 -- 172.21.15.80:0/605950672 shutdown_connections 2019-11-28T11:37:09.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.084+0000 7f8a3f05c700 1 --2- 172.21.15.80:0/605950672 >> v2:172.21.15.174:3300/0 conn(0x7f8a3806ce60 0x7f8a38164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:09.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.084+0000 7f8a3f05c700 1 --2- 172.21.15.80:0/605950672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806c490 0x7f8a3806c920 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:09.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.084+0000 7f8a3f05c700 1 -- 172.21.15.80:0/605950672 shutdown_connections 2019-11-28T11:37:09.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.084+0000 7f8a3f05c700 1 -- 172.21.15.80:0/605950672 wait complete. 2019-11-28T11:37:09.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.084+0000 7f8a3f05c700 1 -- 172.21.15.80:0/605950672 >> 172.21.15.80:0/605950672 conn(0x7f8a38061cf0 msgr2=0x7f8a38064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:09.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.087+0000 7f8a3f05c700 1 Processor -- start 2019-11-28T11:37:09.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.087+0000 7f8a3f05c700 1 -- start start 2019-11-28T11:37:09.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a3f05c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3813a780 0x7f8a3812d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:09.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a3f05c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a3812cb00 0x7f8a38167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:09.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a3f05c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a38139a60 con 0x7f8a3812d9c0 2019-11-28T11:37:09.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a3f05c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a38129830 con 0x7f8a3812cb00 2019-11-28T11:37:09.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a3f05c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3812a260 con 0x7f8a3813a780 2019-11-28T11:37:09.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a3ddfa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a3812cb00 0x7f8a38167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:09.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a3ddfa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a3812cb00 0x7f8a38167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37174/0 (socket says 172.21.15.80:37174) 2019-11-28T11:37:09.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a3ddfa700 1 -- 172.21.15.80:0/3090654943 learned_addr learned my addr 172.21.15.80:0/3090654943 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:09.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a3d5f9700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3813a780 0x7f8a3812d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:09.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a35ffb700 1 -- 172.21.15.80:0/3090654943 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051658354 0 0) 0x7f8a2800adc0 con 0x7f8a3812d9c0 2019-11-28T11:37:09.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a3ddfa700 1 -- 172.21.15.80:0/3090654943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3813a780 msgr2=0x7f8a3812d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:09.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a3ddfa700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3813a780 0x7f8a3812d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:09.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a3ddfa700 1 -- 172.21.15.80:0/3090654943 >> v1:172.21.15.174:6789/0 conn(0x7f8a3812d9c0 legacy=0x7f8a3812c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:09.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a3ddfa700 1 -- 172.21.15.80:0/3090654943 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3812abc0 con 0x7f8a3812cb00 2019-11-28T11:37:09.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a3ddfa700 1 --2- 172.21.15.80:0/3090654943 >> v2:172.21.15.80:3300/0 conn(0x7f8a3812cb00 0x7f8a38167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a30010430 tx=0x7f8a300102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:09.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a3ddfa700 1 --2- 172.21.15.80:0/3090654943 >> v2:172.21.15.80:3300/0 conn(0x7f8a3812cb00 0x7f8a38167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a30010430 tx=0x7f8a300102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:09.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.088+0000 7f8a3ddfa700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3812cb00 0x7f8a38167d70 secure :-1 s=READY pgs=1185 cs=0 l=1 rx=0x7f8a30010430 tx=0x7f8a300102b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:09.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.089+0000 7f8a3ddfa700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3812cb00 0x7f8a38167d70 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f8a30010430 tx=0x7f8a300102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:09.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.089+0000 7f8a35ffb700 1 -- 172.21.15.80:0/3090654943 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a3000a750 con 0x7f8a3812cb00 2019-11-28T11:37:09.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.089+0000 7f8a3f05c700 1 -- 172.21.15.80:0/3090654943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3812af40 con 0x7f8a3812cb00 2019-11-28T11:37:09.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.089+0000 7f8a3ddfa700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3812cb00 0x7f8a38167d70 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f8a30010430 tx=0x7f8a300102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:09.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.089+0000 7f8a3f05c700 1 -- 172.21.15.80:0/3090654943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3812abc0 con 0x7f8a3812cb00 2019-11-28T11:37:09.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.089+0000 7f8a35ffb700 1 -- 172.21.15.80:0/3090654943 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3000aa60 con 0x7f8a3812cb00 2019-11-28T11:37:09.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.089+0000 7f8a3ddfa700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3812cb00 0x7f8a38167d70 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f8a30010430 tx=0x7f8a300102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:09.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.089+0000 7f8a35ffb700 1 -- 172.21.15.80:0/3090654943 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a30009990 con 0x7f8a3812cb00 2019-11-28T11:37:09.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.089+0000 7f8a3ddfa700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3812cb00 0x7f8a38167d70 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f8a30010430 tx=0x7f8a300102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:09.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.089+0000 7f8a35ffb700 1 -- 172.21.15.80:0/3090654943 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8a300095b0 con 0x7f8a3812cb00 2019-11-28T11:37:09.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.089+0000 7f8a3ddfa700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3812cb00 0x7f8a38167d70 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f8a30010430 tx=0x7f8a300102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:09.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.089+0000 7f8a35ffb700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a1c018730 0x7f8a1c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:09.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.089+0000 7f8a35ffb700 1 -- 172.21.15.80:0/3090654943 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8a30031d60 con 0x7f8a3812cb00 2019-11-28T11:37:09.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.089+0000 7f8a3d5f9700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a1c018730 0x7f8a1c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:09.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.090+0000 7f8a3d5f9700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a1c018730 0x7f8a1c01abe0 crc :-1 s=READY pgs=477 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:09.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.096+0000 7f8a3f05c700 1 -- 172.21.15.80:0/3090654943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3812af40 con 0x7f8a3812cb00 2019-11-28T11:37:09.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.100+0000 7f8a3ddfa700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3812cb00 0x7f8a38167d70 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f8a30010430 tx=0x7f8a300102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:09.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.100+0000 7f8a35ffb700 1 -- 172.21.15.80:0/3090654943 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8a3000aa60 con 0x7f8a3812cb00 2019-11-28T11:37:09.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.270+0000 7f8a3f05c700 1 -- 172.21.15.80:0/3090654943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a3812abc0 con 0x7f8a3812cb00 2019-11-28T11:37:09.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.271+0000 7f8a3ddfa700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3812cb00 0x7f8a38167d70 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f8a30010430 tx=0x7f8a300102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:09.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.271+0000 7f8a35ffb700 1 -- 172.21.15.80:0/3090654943 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+1424 (secure 0 0 0) 0x7f8a30001470 con 0x7f8a3812cb00 2019-11-28T11:37:09.332 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 57 2019-11-28T11:37:09.333 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:37:09.333 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:37:05.207937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:37:09.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.273+0000 7f8a3f05c700 1 -- 172.21.15.80:0/3090654943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a1c018730 msgr2=0x7f8a1c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:09.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.273+0000 7f8a3f05c700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a1c018730 0x7f8a1c01abe0 crc :-1 s=READY pgs=477 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:09.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.273+0000 7f8a3f05c700 1 -- 172.21.15.80:0/3090654943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3812cb00 msgr2=0x7f8a38167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:09.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.273+0000 7f8a3f05c700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3812cb00 0x7f8a38167d70 secure :-1 s=READY pgs=1185 cs=0 l=1 rx=0x7f8a30010430 tx=0x7f8a300102b0).stop 2019-11-28T11:37:09.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.273+0000 7f8a3f05c700 1 -- 172.21.15.80:0/3090654943 shutdown_connections 2019-11-28T11:37:09.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.273+0000 7f8a3f05c700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3812cb00 0x7f8a38167d70 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:09.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.273+0000 7f8a3f05c700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a1c018730 0x7f8a1c01abe0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:09.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.273+0000 7f8a3f05c700 1 --2- 172.21.15.80:0/3090654943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3813a780 0x7f8a3812d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:09.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.273+0000 7f8a3f05c700 1 -- 172.21.15.80:0/3090654943 shutdown_connections 2019-11-28T11:37:09.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.273+0000 7f8a3f05c700 1 -- 172.21.15.80:0/3090654943 wait complete. 2019-11-28T11:37:09.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:09.273+0000 7f8a3f05c700 1 -- 172.21.15.80:0/3090654943 >> 172.21.15.80:0/3090654943 conn(0x7f8a38127dc0 msgr2=0x7f8a38141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:09.646 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 14, u'failed': [], u'epoch': 57, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [15], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:37:03.205339+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:37:05.207937+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:37:09.647 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:37:10.647 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:37:10.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.705+0000 7fb26fed8700 1 Processor -- start 2019-11-28T11:37:10.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.705+0000 7fb26fed8700 1 -- start start 2019-11-28T11:37:10.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.706+0000 7fb26fed8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb26806c490 0x7fb26806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:10.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.706+0000 7fb26fed8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb26806ce60 0x7fb268164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:10.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26fed8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26806db00 con 0x7fb26806c0a0 2019-11-28T11:37:10.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26fed8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26806fd60 con 0x7fb26806c490 2019-11-28T11:37:10.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26fed8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb268070030 con 0x7fb26806ce60 2019-11-28T11:37:10.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26dc74700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb26806c490 0x7fb26806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:10.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26e475700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb26806c0a0 0x7fb268072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36498/0 (socket says 172.21.15.80:36498) 2019-11-28T11:37:10.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26e475700 1 -- 172.21.15.80:0/110712916 learned_addr learned my addr 172.21.15.80:0/110712916 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:10.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26ec76700 1 --2- 172.21.15.80:0/110712916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb26806ce60 0x7fb268164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:10.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26dc74700 1 -- 172.21.15.80:0/110712916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb26806ce60 msgr2=0x7fb268164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:10.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26dc74700 1 --2- 172.21.15.80:0/110712916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb26806ce60 0x7fb268164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:10.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26dc74700 1 -- 172.21.15.80:0/110712916 >> v1:172.21.15.80:6789/0 conn(0x7fb26806c0a0 legacy=0x7fb268072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:10.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26d473700 1 -- 172.21.15.80:0/110712916 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14806621 0 0) 0x7fb2600014d0 con 0x7fb26806c0a0 2019-11-28T11:37:10.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26dc74700 1 -- 172.21.15.80:0/110712916 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2680706c0 con 0x7fb26806c490 2019-11-28T11:37:10.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26ec76700 1 --2- 172.21.15.80:0/110712916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb26806ce60 0x7fb268164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:37:10.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26dc74700 1 --2- 172.21.15.80:0/110712916 >> v2:172.21.15.80:3300/0 conn(0x7fb26806c490 0x7fb26806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb25c00af50 tx=0x7fb25c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:10.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26dc74700 1 --2- 172.21.15.80:0/110712916 >> v2:172.21.15.80:3300/0 conn(0x7fb26806c490 0x7fb26806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb25c00af50 tx=0x7fb25c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:10.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26dc74700 1 --2- 172.21.15.80:0/110712916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26806c490 0x7fb26806c920 secure :-1 s=READY pgs=1187 cs=0 l=1 rx=0x7fb25c00af50 tx=0x7fb25c00b760).ready entity=mon.0 client_cookie=8c7880d744c59ec7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:10.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26dc74700 1 --2- 172.21.15.80:0/110712916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26806c490 0x7fb26806c920 secure :-1 s=THROTTLE_DONE pgs=1187 cs=0 l=1 rx=0x7fb25c00af50 tx=0x7fb25c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:10.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26dc74700 1 --2- 172.21.15.80:0/110712916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26806c490 0x7fb26806c920 secure :-1 s=THROTTLE_DONE pgs=1187 cs=0 l=1 rx=0x7fb25c00af50 tx=0x7fb25c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:10.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26d473700 1 -- 172.21.15.80:0/110712916 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb25c007210 con 0x7fb26806c490 2019-11-28T11:37:10.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26dc74700 1 --2- 172.21.15.80:0/110712916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26806c490 0x7fb26806c920 secure :-1 s=THROTTLE_DONE pgs=1187 cs=0 l=1 rx=0x7fb25c00af50 tx=0x7fb25c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:10.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26d473700 1 -- 172.21.15.80:0/110712916 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25c0099b0 con 0x7fb26806c490 2019-11-28T11:37:10.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26d473700 1 -- 172.21.15.80:0/110712916 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb25c00a080 con 0x7fb26806c490 2019-11-28T11:37:10.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26fed8700 1 -- 172.21.15.80:0/110712916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26806c490 msgr2=0x7fb26806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:10.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.707+0000 7fb26fed8700 1 --2- 172.21.15.80:0/110712916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26806c490 0x7fb26806c920 secure :-1 s=READY pgs=1187 cs=0 l=1 rx=0x7fb25c00af50 tx=0x7fb25c00b760).stop 2019-11-28T11:37:10.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.708+0000 7fb26fed8700 1 -- 172.21.15.80:0/110712916 shutdown_connections 2019-11-28T11:37:10.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.708+0000 7fb26fed8700 1 --2- 172.21.15.80:0/110712916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb26806ce60 0x7fb268164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:10.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.708+0000 7fb26fed8700 1 --2- 172.21.15.80:0/110712916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26806c490 0x7fb26806c920 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:10.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.708+0000 7fb26fed8700 1 -- 172.21.15.80:0/110712916 shutdown_connections 2019-11-28T11:37:10.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.708+0000 7fb26fed8700 1 -- 172.21.15.80:0/110712916 wait complete. 2019-11-28T11:37:10.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.708+0000 7fb26fed8700 1 -- 172.21.15.80:0/110712916 >> 172.21.15.80:0/110712916 conn(0x7fb268061cf0 msgr2=0x7fb268064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:10.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.711+0000 7fb26fed8700 1 Processor -- start 2019-11-28T11:37:10.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.711+0000 7fb26fed8700 1 -- start start 2019-11-28T11:37:10.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.711+0000 7fb26fed8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb26813e7b0 0x7fb26812abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:10.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.711+0000 7fb26fed8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb268139e00 con 0x7fb26813e320 2019-11-28T11:37:10.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.711+0000 7fb26fed8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26813b4e0 con 0x7fb26815fdf0 2019-11-28T11:37:10.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.711+0000 7fb26fed8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb268108820 con 0x7fb26813e7b0 2019-11-28T11:37:10.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb26ec76700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb26813e7b0 0x7fb26812abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:10.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb26ec76700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb26813e7b0 0x7fb26812abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37190/0 (socket says 172.21.15.80:37190) 2019-11-28T11:37:10.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb26ec76700 1 -- 172.21.15.80:0/2215558279 learned_addr learned my addr 172.21.15.80:0/2215558279 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:10.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb26ec76700 1 -- 172.21.15.80:0/2215558279 >> v1:172.21.15.174:6789/0 conn(0x7fb26815fdf0 legacy=0x7fb26812b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:10.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb26ec76700 1 -- 172.21.15.80:0/2215558279 >> v1:172.21.15.80:6789/0 conn(0x7fb26813e320 legacy=0x7fb26812a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:10.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb26ec76700 1 -- 172.21.15.80:0/2215558279 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26810a8c0 con 0x7fb26813e7b0 2019-11-28T11:37:10.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb26ec76700 1 --2- 172.21.15.80:0/2215558279 >> v2:172.21.15.80:3300/0 conn(0x7fb26813e7b0 0x7fb26812abc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb258010480 tx=0x7fb258010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:10.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb26ec76700 1 --2- 172.21.15.80:0/2215558279 >> v2:172.21.15.80:3300/0 conn(0x7fb26813e7b0 0x7fb26812abc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb258010480 tx=0x7fb258010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:10.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb26ec76700 1 --2- 172.21.15.80:0/2215558279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26813e7b0 0x7fb26812abc0 secure :-1 s=READY pgs=1189 cs=0 l=1 rx=0x7fb258010480 tx=0x7fb258010820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:10.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb26ec76700 1 --2- 172.21.15.80:0/2215558279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26813e7b0 0x7fb26812abc0 secure :-1 s=THROTTLE_DONE pgs=1189 cs=0 l=1 rx=0x7fb258010480 tx=0x7fb258010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:10.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb26ec76700 1 --2- 172.21.15.80:0/2215558279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26813e7b0 0x7fb26812abc0 secure :-1 s=THROTTLE_DONE pgs=1189 cs=0 l=1 rx=0x7fb258010480 tx=0x7fb258010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:10.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb266ffd700 1 -- 172.21.15.80:0/2215558279 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb258009bd0 con 0x7fb26813e7b0 2019-11-28T11:37:10.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb26ec76700 1 --2- 172.21.15.80:0/2215558279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26813e7b0 0x7fb26812abc0 secure :-1 s=THROTTLE_DONE pgs=1189 cs=0 l=1 rx=0x7fb258010480 tx=0x7fb258010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:10.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb266ffd700 1 -- 172.21.15.80:0/2215558279 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb258008480 con 0x7fb26813e7b0 2019-11-28T11:37:10.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb266ffd700 1 -- 172.21.15.80:0/2215558279 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb25800a1b0 con 0x7fb26813e7b0 2019-11-28T11:37:10.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb26fed8700 1 -- 172.21.15.80:0/2215558279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26810a8c0 con 0x7fb26813e7b0 2019-11-28T11:37:10.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.712+0000 7fb26fed8700 1 -- 172.21.15.80:0/2215558279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26810a8c0 con 0x7fb26813e7b0 2019-11-28T11:37:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.713+0000 7fb26ec76700 1 --2- 172.21.15.80:0/2215558279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26813e7b0 0x7fb26812abc0 secure :-1 s=THROTTLE_DONE pgs=1189 cs=0 l=1 rx=0x7fb258010480 tx=0x7fb258010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.713+0000 7fb266ffd700 1 -- 172.21.15.80:0/2215558279 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb258000b10 con 0x7fb26813e7b0 2019-11-28T11:37:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.713+0000 7fb26ec76700 1 --2- 172.21.15.80:0/2215558279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26813e7b0 0x7fb26812abc0 secure :-1 s=THROTTLE_DONE pgs=1189 cs=0 l=1 rx=0x7fb258010480 tx=0x7fb258010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.713+0000 7fb266ffd700 1 --2- 172.21.15.80:0/2215558279 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb248018730 0x7fb24801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.713+0000 7fb266ffd700 1 -- 172.21.15.80:0/2215558279 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb258031b90 con 0x7fb26813e7b0 2019-11-28T11:37:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.713+0000 7fb26e475700 1 --2- 172.21.15.80:0/2215558279 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb248018730 0x7fb24801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.713+0000 7fb26e475700 1 --2- 172.21.15.80:0/2215558279 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb248018730 0x7fb24801abc0 crc :-1 s=READY pgs=481 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:10.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.721+0000 7fb26fed8700 1 -- 172.21.15.80:0/2215558279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb268109180 con 0x7fb26813e7b0 2019-11-28T11:37:10.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.724+0000 7fb26ec76700 1 --2- 172.21.15.80:0/2215558279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26813e7b0 0x7fb26812abc0 secure :-1 s=THROTTLE_DONE pgs=1189 cs=0 l=1 rx=0x7fb258010480 tx=0x7fb258010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:10.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.724+0000 7fb266ffd700 1 -- 172.21.15.80:0/2215558279 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb2580095e0 con 0x7fb26813e7b0 2019-11-28T11:37:10.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.897+0000 7fb26fed8700 1 -- 172.21.15.80:0/2215558279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb268109500 con 0x7fb26813e7b0 2019-11-28T11:37:10.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.897+0000 7fb26ec76700 1 --2- 172.21.15.80:0/2215558279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26813e7b0 0x7fb26812abc0 secure :-1 s=THROTTLE_DONE pgs=1189 cs=0 l=1 rx=0x7fb258010480 tx=0x7fb258010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:10.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.897+0000 7fb266ffd700 1 -- 172.21.15.80:0/2215558279 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+2444 (secure 0 0 0) 0x7fb258001470 con 0x7fb26813e7b0 2019-11-28T11:37:10.959 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 59 2019-11-28T11:37:10.960 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:37:10.960 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1620047617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1620047617},{"type":"v1","addr":"172.21.15.80:6834","nonce":1620047617}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":58},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/612359803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":612359803},{"type":"v1","addr":"172.21.15.80:6835","nonce":612359803}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":58}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:37:10.300623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7108},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7108":{"gid":7108,"name":"c","rank":0,"incarnation":59,"state":"up:creating","state_seq":2,"addr":"172.21.15.174:6835/775911718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":775911718},{"type":"v1","addr":"172.21.15.174:6835","nonce":775911718}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:37:10.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.900+0000 7fb26fed8700 1 -- 172.21.15.80:0/2215558279 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb248018730 msgr2=0x7fb24801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:10.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.900+0000 7fb26fed8700 1 --2- 172.21.15.80:0/2215558279 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb248018730 0x7fb24801abc0 crc :-1 s=READY pgs=481 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:10.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.900+0000 7fb26fed8700 1 -- 172.21.15.80:0/2215558279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26813e7b0 msgr2=0x7fb26812abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:10.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.900+0000 7fb26fed8700 1 --2- 172.21.15.80:0/2215558279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26813e7b0 0x7fb26812abc0 secure :-1 s=READY pgs=1189 cs=0 l=1 rx=0x7fb258010480 tx=0x7fb258010820).stop 2019-11-28T11:37:10.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.900+0000 7fb26fed8700 1 -- 172.21.15.80:0/2215558279 shutdown_connections 2019-11-28T11:37:10.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.900+0000 7fb26fed8700 1 --2- 172.21.15.80:0/2215558279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb26813e7b0 0x7fb26812abc0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:10.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.900+0000 7fb26fed8700 1 --2- 172.21.15.80:0/2215558279 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb248018730 0x7fb24801abc0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:10.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.900+0000 7fb26fed8700 1 -- 172.21.15.80:0/2215558279 shutdown_connections 2019-11-28T11:37:10.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.900+0000 7fb26fed8700 1 -- 172.21.15.80:0/2215558279 wait complete. 2019-11-28T11:37:10.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:10.900+0000 7fb26fed8700 1 -- 172.21.15.80:0/2215558279 >> 172.21.15.80:0/2215558279 conn(0x7fb268127dc0 msgr2=0x7fb268141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:11.276 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7108}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 14, u'failed': [], u'epoch': 59, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [15], u'info': {u'gid_7108': {u'export_targets': [], u'name': u'c', u'incarnation': 59, u'state_seq': 2, u'state': u'up:creating', u'gid': 7108, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 775911718, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 775911718, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/775911718'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:37:03.205339+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:37:10.300623+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:37:11.276 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7108:up:creating 2019-11-28T11:37:12.277 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:37:12.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.343+0000 7f3a91a5e700 1 Processor -- start 2019-11-28T11:37:12.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.343+0000 7f3a91a5e700 1 -- start start 2019-11-28T11:37:12.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a91a5e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a8c06c490 0x7f3a8c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:12.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a91a5e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8c06db00 con 0x7f3a8c06ce60 2019-11-28T11:37:12.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a91a5e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8c06e000 con 0x7f3a8c06c0a0 2019-11-28T11:37:12.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a91a5e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8c06fd60 con 0x7f3a8c06c490 2019-11-28T11:37:12.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8affd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a8c06c490 0x7f3a8c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:12.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3a8c06ce60 0x7f3a8c164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36518/0 (socket says 172.21.15.80:36518) 2019-11-28T11:37:12.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8affd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a8c06c490 0x7f3a8c06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37204/0 (socket says 172.21.15.80:37204) 2019-11-28T11:37:12.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8bfff700 1 -- 172.21.15.80:0/1215658573 learned_addr learned my addr 172.21.15.80:0/1215658573 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:12.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8affd700 1 -- 172.21.15.80:0/1215658573 >> v1:172.21.15.174:6789/0 conn(0x7f3a8c06c0a0 legacy=0x7f3a8c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:12.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8affd700 1 -- 172.21.15.80:0/1215658573 >> v1:172.21.15.80:6789/0 conn(0x7f3a8c06ce60 legacy=0x7f3a8c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:12.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8a7fc700 1 -- 172.21.15.80:0/1215658573 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934434982 0 0) 0x7f3a84001150 con 0x7f3a8c06ce60 2019-11-28T11:37:12.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8affd700 1 -- 172.21.15.80:0/1215658573 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c0706c0 con 0x7f3a8c06c490 2019-11-28T11:37:12.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8affd700 1 --2- 172.21.15.80:0/1215658573 >> v2:172.21.15.80:3300/0 conn(0x7f3a8c06c490 0x7f3a8c06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3a7400b2d0 tx=0x7f3a7400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:12.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8affd700 1 --2- 172.21.15.80:0/1215658573 >> v2:172.21.15.80:3300/0 conn(0x7f3a8c06c490 0x7f3a8c06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3a7400b2d0 tx=0x7f3a7400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:12.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8affd700 1 --2- 172.21.15.80:0/1215658573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c06c490 0x7f3a8c06c920 secure :-1 s=READY pgs=1191 cs=0 l=1 rx=0x7f3a7400b2d0 tx=0x7f3a7400bae0).ready entity=mon.0 client_cookie=5d2d3d169557d3d3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:12.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8affd700 1 --2- 172.21.15.80:0/1215658573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c06c490 0x7f3a8c06c920 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7f3a7400b2d0 tx=0x7f3a7400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:12.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8a7fc700 1 -- 172.21.15.80:0/1215658573 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a74000ce0 con 0x7f3a8c06c490 2019-11-28T11:37:12.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8affd700 1 --2- 172.21.15.80:0/1215658573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c06c490 0x7f3a8c06c920 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7f3a7400b2d0 tx=0x7f3a7400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:12.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8affd700 1 --2- 172.21.15.80:0/1215658573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c06c490 0x7f3a8c06c920 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7f3a7400b2d0 tx=0x7f3a7400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:12.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8a7fc700 1 -- 172.21.15.80:0/1215658573 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a74009be0 con 0x7f3a8c06c490 2019-11-28T11:37:12.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.344+0000 7f3a8a7fc700 1 -- 172.21.15.80:0/1215658573 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a7400a2b0 con 0x7f3a8c06c490 2019-11-28T11:37:12.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.345+0000 7f3a91a5e700 1 -- 172.21.15.80:0/1215658573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c06c490 msgr2=0x7f3a8c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:12.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.345+0000 7f3a91a5e700 1 --2- 172.21.15.80:0/1215658573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c06c490 0x7f3a8c06c920 secure :-1 s=READY pgs=1191 cs=0 l=1 rx=0x7f3a7400b2d0 tx=0x7f3a7400bae0).stop 2019-11-28T11:37:12.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.345+0000 7f3a91a5e700 1 -- 172.21.15.80:0/1215658573 shutdown_connections 2019-11-28T11:37:12.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.345+0000 7f3a91a5e700 1 --2- 172.21.15.80:0/1215658573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c06c490 0x7f3a8c06c920 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:12.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.345+0000 7f3a91a5e700 1 -- 172.21.15.80:0/1215658573 shutdown_connections 2019-11-28T11:37:12.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.345+0000 7f3a91a5e700 1 -- 172.21.15.80:0/1215658573 wait complete. 2019-11-28T11:37:12.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.345+0000 7f3a91a5e700 1 -- 172.21.15.80:0/1215658573 >> 172.21.15.80:0/1215658573 conn(0x7f3a8c061cf0 msgr2=0x7f3a8c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:12.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.348+0000 7f3a91a5e700 1 Processor -- start 2019-11-28T11:37:12.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.348+0000 7f3a91a5e700 1 -- start start 2019-11-28T11:37:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.349+0000 7f3a91a5e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3a8c112fb0 0x7f3a8c113440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.349+0000 7f3a91a5e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a8c113980 0x7f3a8c168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.349+0000 7f3a91a5e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8c113db0 con 0x7f3a8c13f580 2019-11-28T11:37:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.349+0000 7f3a91a5e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8c1236b0 con 0x7f3a8c112fb0 2019-11-28T11:37:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.349+0000 7f3a91a5e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c123980 con 0x7f3a8c113980 2019-11-28T11:37:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.349+0000 7f3a8bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a8c113980 0x7f3a8c168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.349+0000 7f3a8affd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3a8c112fb0 0x7f3a8c113440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.349+0000 7f3a8affd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3a8c112fb0 0x7f3a8c113440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:52096/0 (socket says 172.21.15.80:52096) 2019-11-28T11:37:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.349+0000 7f3a8bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a8c113980 0x7f3a8c168a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:39468/0 (socket says 172.21.15.80:39468) 2019-11-28T11:37:12.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.349+0000 7f3a8affd700 1 -- 172.21.15.80:0/1250095952 learned_addr learned my addr 172.21.15.80:0/1250095952 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:12.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.349+0000 7f3a8bfff700 1 -- 172.21.15.80:0/1250095952 >> v2:172.21.15.174:3300/0 conn(0x7f3a8c112fb0 msgr2=0x7f3a8c113440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:12.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.349+0000 7f3a8bfff700 1 --2- 172.21.15.80:0/1250095952 >> v2:172.21.15.174:3300/0 conn(0x7f3a8c112fb0 0x7f3a8c113440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:12.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.349+0000 7f3a8bfff700 1 -- 172.21.15.80:0/1250095952 >> v1:172.21.15.174:6789/0 conn(0x7f3a8c13f580 legacy=0x7f3a8c114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:12.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.349+0000 7f3a8bfff700 1 -- 172.21.15.80:0/1250095952 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c124010 con 0x7f3a8c113980 2019-11-28T11:37:12.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.349+0000 7f3a8affd700 1 --2- 172.21.15.80:0/1250095952 >> v2:172.21.15.174:3300/0 conn(0x7f3a8c112fb0 0x7f3a8c113440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:37:12.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.349+0000 7f3a8bfff700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a8c113980 0x7f3a8c168a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a840103a0 tx=0x7f3a84010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:12.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.350+0000 7f3a8bfff700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a8c113980 0x7f3a8c168a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a840103a0 tx=0x7f3a84010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:12.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.350+0000 7f3a8bfff700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a8c113980 0x7f3a8c168a20 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f3a840103a0 tx=0x7f3a84010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:12.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.350+0000 7f3a8bfff700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a8c113980 0x7f3a8c168a20 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f3a840103a0 tx=0x7f3a84010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:12.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.350+0000 7f3a8bfff700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a8c113980 0x7f3a8c168a20 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f3a840103a0 tx=0x7f3a84010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:12.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.350+0000 7f3a83fff700 1 -- 172.21.15.80:0/1250095952 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a84000a50 con 0x7f3a8c113980 2019-11-28T11:37:12.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.350+0000 7f3a8bfff700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a8c113980 0x7f3a8c168a20 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f3a840103a0 tx=0x7f3a84010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:12.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.350+0000 7f3a83fff700 1 -- 172.21.15.80:0/1250095952 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a84001380 con 0x7f3a8c113980 2019-11-28T11:37:12.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.350+0000 7f3a83fff700 1 -- 172.21.15.80:0/1250095952 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a84001a50 con 0x7f3a8c113980 2019-11-28T11:37:12.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.350+0000 7f3a91a5e700 1 -- 172.21.15.80:0/1250095952 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8c124010 con 0x7f3a8c113980 2019-11-28T11:37:12.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.350+0000 7f3a91a5e700 1 -- 172.21.15.80:0/1250095952 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8c124010 con 0x7f3a8c113980 2019-11-28T11:37:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.350+0000 7f3a8bfff700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a8c113980 0x7f3a8c168a20 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f3a840103a0 tx=0x7f3a84010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.350+0000 7f3a83fff700 1 -- 172.21.15.80:0/1250095952 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3a84001570 con 0x7f3a8c113980 2019-11-28T11:37:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.350+0000 7f3a8bfff700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a8c113980 0x7f3a8c168a20 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f3a840103a0 tx=0x7f3a84010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.351+0000 7f3a83fff700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a64018730 0x7f3a6401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:12.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.351+0000 7f3a83fff700 1 -- 172.21.15.80:0/1250095952 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3a84031a00 con 0x7f3a8c113980 2019-11-28T11:37:12.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.351+0000 7f3a8b7fe700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a64018730 0x7f3a6401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:12.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.351+0000 7f3a8b7fe700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a64018730 0x7f3a6401abc0 crc :-1 s=READY pgs=485 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:12.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.358+0000 7f3a91a5e700 1 -- 172.21.15.80:0/1250095952 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8c124010 con 0x7f3a8c113980 2019-11-28T11:37:12.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.362+0000 7f3a8bfff700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a8c113980 0x7f3a8c168a20 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f3a840103a0 tx=0x7f3a84010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:12.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.362+0000 7f3a83fff700 1 -- 172.21.15.80:0/1250095952 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3a84000f80 con 0x7f3a8c113980 2019-11-28T11:37:12.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.537+0000 7f3a91a5e700 1 -- 172.21.15.80:0/1250095952 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a8c124010 con 0x7f3a8c113980 2019-11-28T11:37:12.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.537+0000 7f3a8bfff700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a8c113980 0x7f3a8c168a20 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f3a840103a0 tx=0x7f3a84010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:12.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.537+0000 7f3a83fff700 1 -- 172.21.15.80:0/1250095952 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+2442 (secure 0 0 0) 0x7f3a84001570 con 0x7f3a8c113980 2019-11-28T11:37:12.599 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 60 2019-11-28T11:37:12.600 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:37:12.600 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1620047617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1620047617},{"type":"v1","addr":"172.21.15.80:6834","nonce":1620047617}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":58},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/612359803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":612359803},{"type":"v1","addr":"172.21.15.80:6835","nonce":612359803}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":58}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:37:11.301943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7108},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7108":{"gid":7108,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/775911718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":775911718},{"type":"v1","addr":"172.21.15.174:6835","nonce":775911718}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:37:12.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.539+0000 7f3a91a5e700 1 -- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a64018730 msgr2=0x7f3a6401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:12.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.539+0000 7f3a91a5e700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a64018730 0x7f3a6401abc0 crc :-1 s=READY pgs=485 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:12.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.539+0000 7f3a91a5e700 1 -- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a8c113980 msgr2=0x7f3a8c168a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:12.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.539+0000 7f3a91a5e700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a8c113980 0x7f3a8c168a20 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f3a840103a0 tx=0x7f3a84010740).stop 2019-11-28T11:37:12.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.539+0000 7f3a91a5e700 1 -- 172.21.15.80:0/1250095952 shutdown_connections 2019-11-28T11:37:12.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.539+0000 7f3a91a5e700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a8c113980 0x7f3a8c168a20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:12.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.539+0000 7f3a91a5e700 1 --2- 172.21.15.80:0/1250095952 >> v2:172.21.15.174:3300/0 conn(0x7f3a8c112fb0 0x7f3a8c113440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:12.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.539+0000 7f3a91a5e700 1 --2- 172.21.15.80:0/1250095952 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a64018730 0x7f3a6401abc0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:12.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.540+0000 7f3a91a5e700 1 -- 172.21.15.80:0/1250095952 shutdown_connections 2019-11-28T11:37:12.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.540+0000 7f3a91a5e700 1 -- 172.21.15.80:0/1250095952 wait complete. 2019-11-28T11:37:12.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:12.540+0000 7f3a91a5e700 1 -- 172.21.15.80:0/1250095952 >> 172.21.15.80:0/1250095952 conn(0x7f3a8c1426c0 msgr2=0x7f3a8c110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:12.913 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7108}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 14, u'failed': [], u'epoch': 60, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [15], u'info': {u'gid_7108': {u'export_targets': [], u'name': u'c', u'incarnation': 59, u'state_seq': 3, u'state': u'up:active', u'gid': 7108, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 775911718, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 775911718, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/775911718'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:37:03.205339+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:37:11.301943+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:37:12.913 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:37:12.914 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:37:13.040 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:37:13.040 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:37:13.040 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:37:13.041 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 7108, 2019-11-28T11:37:13.041 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:37:13.041 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:37:13.041 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 2.676769653, 2019-11-28T11:37:13.042 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 60, 2019-11-28T11:37:13.042 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 93, 2019-11-28T11:37:13.042 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 93, 2019-11-28T11:37:13.043 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 6.9556918489999999 2019-11-28T11:37:13.043 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:37:13.046 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7108, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.676769653, "mdsmap_epoch": 60, "osdmap_epoch": 93, "osdmap_epoch_barrier": 93, "uptime": 6.9556918489999999 } 2019-11-28T11:37:13.046 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:37:13.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.106+0000 7fe169d1f700 1 Processor -- start 2019-11-28T11:37:13.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.106+0000 7fe169d1f700 1 -- start start 2019-11-28T11:37:13.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe169d1f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe16406c0a0 0x7fe164072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:13.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe169d1f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe164072620 0x7fe164164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:13.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe169d1f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16406db00 con 0x7fe1640734e0 2019-11-28T11:37:13.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe169d1f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16406fd60 con 0x7fe16406c0a0 2019-11-28T11:37:13.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe169d1f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe164070030 con 0x7fe164072620 2019-11-28T11:37:13.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe15bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe1640734e0 0x7fe164071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36530/0 (socket says 172.21.15.80:36530) 2019-11-28T11:37:13.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe15bfff700 1 -- 172.21.15.80:0/3144808289 learned_addr learned my addr 172.21.15.80:0/3144808289 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:13.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe163fff700 1 --2- 172.21.15.80:0/3144808289 >> v2:172.21.15.174:3300/0 conn(0x7fe16406c0a0 0x7fe164072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:13.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe168abd700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe164072620 0x7fe164164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:13.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe1637fe700 1 -- 172.21.15.80:0/3144808289 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187177187 0 0) 0x7fe14c001150 con 0x7fe1640734e0 2019-11-28T11:37:13.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe1637fe700 1 -- 172.21.15.80:0/3144808289 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe150002e80 con 0x7fe1640734e0 2019-11-28T11:37:13.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe1637fe700 1 -- 172.21.15.80:0/3144808289 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3276773248 0 0) 0x7fe14c001130 con 0x7fe1640734e0 2019-11-28T11:37:13.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe1637fe700 1 -- 172.21.15.80:0/3144808289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe164072620 msgr2=0x7fe164164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:13.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe1637fe700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe164072620 0x7fe164164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:13.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe1637fe700 1 -- 172.21.15.80:0/3144808289 >> v2:172.21.15.174:3300/0 conn(0x7fe16406c0a0 msgr2=0x7fe164072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:13.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe1637fe700 1 --2- 172.21.15.80:0/3144808289 >> v2:172.21.15.174:3300/0 conn(0x7fe16406c0a0 0x7fe164072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:13.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe1637fe700 1 -- 172.21.15.80:0/3144808289 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1640706c0 con 0x7fe1640734e0 2019-11-28T11:37:13.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe1637fe700 1 -- 172.21.15.80:0/3144808289 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fe14c001660 con 0x7fe1640734e0 2019-11-28T11:37:13.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe1637fe700 1 -- 172.21.15.80:0/3144808289 >> v1:172.21.15.80:6789/0 conn(0x7fe1640734e0 legacy=0x7fe164071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:13.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe1637fe700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1500479e0 0x7fe150049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:13.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe1637fe700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe15004a5c0 0x7fe15004ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:13.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe1637fe700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe15004d2f0 0x7fe15004f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:13.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe1637fe700 1 -- 172.21.15.80:0/3144808289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15004ff40 con 0x7fe15004a5c0 2019-11-28T11:37:13.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe1637fe700 1 -- 172.21.15.80:0/3144808289 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe150050130 con 0x7fe1500479e0 2019-11-28T11:37:13.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.107+0000 7fe1637fe700 1 -- 172.21.15.80:0/3144808289 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe150050360 con 0x7fe15004d2f0 2019-11-28T11:37:13.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe15bfff700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe15004a5c0 0x7fe15004ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:13.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe163fff700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1500479e0 0x7fe150049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:13.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe168abd700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe15004d2f0 0x7fe15004f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:13.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe15bfff700 1 -- 172.21.15.80:0/3144808289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe15004d2f0 msgr2=0x7fe15004f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:13.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe15bfff700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe15004d2f0 0x7fe15004f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:13.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe15bfff700 1 -- 172.21.15.80:0/3144808289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1500479e0 msgr2=0x7fe150049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:13.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe15bfff700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1500479e0 0x7fe150049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:13.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe15bfff700 1 -- 172.21.15.80:0/3144808289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150050610 con 0x7fe15004a5c0 2019-11-28T11:37:13.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe15bfff700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe15004a5c0 0x7fe15004ca90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe14c00f890 tx=0x7fe14c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe15bfff700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe15004a5c0 0x7fe15004ca90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe14c00f890 tx=0x7fe14c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe15bfff700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe15004a5c0 0x7fe15004ca90 secure :-1 s=READY pgs=1193 cs=0 l=1 rx=0x7fe14c00f890 tx=0x7fe14c00f790).ready entity=mon.0 client_cookie=e33e155574e0a672 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:13.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe15bfff700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe15004a5c0 0x7fe15004ca90 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fe14c00f890 tx=0x7fe14c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe1637fe700 1 -- 172.21.15.80:0/3144808289 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe14c001130 con 0x7fe15004a5c0 2019-11-28T11:37:13.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe15bfff700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe15004a5c0 0x7fe15004ca90 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fe14c00f890 tx=0x7fe14c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe15bfff700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe15004a5c0 0x7fe15004ca90 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fe14c00f890 tx=0x7fe14c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe1637fe700 1 -- 172.21.15.80:0/3144808289 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c004240 con 0x7fe15004a5c0 2019-11-28T11:37:13.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe1637fe700 1 -- 172.21.15.80:0/3144808289 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe14c001130 con 0x7fe15004a5c0 2019-11-28T11:37:13.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe169d1f700 1 -- 172.21.15.80:0/3144808289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe15004a5c0 msgr2=0x7fe15004ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:13.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe169d1f700 1 --2- 172.21.15.80:0/3144808289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe15004a5c0 0x7fe15004ca90 secure :-1 s=READY pgs=1193 cs=0 l=1 rx=0x7fe14c00f890 tx=0x7fe14c00f790).stop 2019-11-28T11:37:13.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.108+0000 7fe168abd700 1 -- 172.21.15.80:0/3144808289 reap_dead start 2019-11-28T11:37:13.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.109+0000 7fe169d1f700 1 -- 172.21.15.80:0/3144808289 shutdown_connections 2019-11-28T11:37:13.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.109+0000 7fe169d1f700 1 -- 172.21.15.80:0/3144808289 shutdown_connections 2019-11-28T11:37:13.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.109+0000 7fe169d1f700 1 -- 172.21.15.80:0/3144808289 wait complete. 2019-11-28T11:37:13.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.109+0000 7fe169d1f700 1 -- 172.21.15.80:0/3144808289 >> 172.21.15.80:0/3144808289 conn(0x7fe164061cf0 msgr2=0x7fe164064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:13.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.111+0000 7fe169d1f700 1 Processor -- start 2019-11-28T11:37:13.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.111+0000 7fe169d1f700 1 -- start start 2019-11-28T11:37:13.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.112+0000 7fe169d1f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe164114470 0x7fe164114900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:13.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.112+0000 7fe169d1f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe164115280 con 0x7fe164114e40 2019-11-28T11:37:13.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.112+0000 7fe169d1f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16411dd50 con 0x7fe164106c20 2019-11-28T11:37:13.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.112+0000 7fe169d1f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1641126a0 con 0x7fe164114470 2019-11-28T11:37:13.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.112+0000 7fe15bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe164114470 0x7fe164114900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:13.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.112+0000 7fe163fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe164106c20 0x7fe1641155f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:52086/0 (socket says 172.21.15.80:52086) 2019-11-28T11:37:13.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.112+0000 7fe15bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe164114470 0x7fe164114900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37228/0 (socket says 172.21.15.80:37228) 2019-11-28T11:37:13.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.112+0000 7fe163fff700 1 -- 172.21.15.80:0/2543995474 learned_addr learned my addr 172.21.15.80:0/2543995474 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:13.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.112+0000 7fe1617fa700 1 -- 172.21.15.80:0/2543995474 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280151271 0 0) 0x7fe154000fb0 con 0x7fe164106c20 2019-11-28T11:37:13.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.113+0000 7fe15bfff700 1 -- 172.21.15.80:0/2543995474 >> v1:172.21.15.174:6789/0 conn(0x7fe164106c20 legacy=0x7fe1641155f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:13.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.113+0000 7fe15bfff700 1 -- 172.21.15.80:0/2543995474 >> v1:172.21.15.80:6789/0 conn(0x7fe164114e40 legacy=0x7fe164167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:13.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.113+0000 7fe15bfff700 1 -- 172.21.15.80:0/2543995474 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe164112d30 con 0x7fe164114470 2019-11-28T11:37:13.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.113+0000 7fe15bfff700 1 --2- 172.21.15.80:0/2543995474 >> v2:172.21.15.80:3300/0 conn(0x7fe164114470 0x7fe164114900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe14c010390 tx=0x7fe14c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.113+0000 7fe15bfff700 1 --2- 172.21.15.80:0/2543995474 >> v2:172.21.15.80:3300/0 conn(0x7fe164114470 0x7fe164114900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe14c010390 tx=0x7fe14c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.113+0000 7fe15bfff700 1 --2- 172.21.15.80:0/2543995474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe164114470 0x7fe164114900 secure :-1 s=READY pgs=1195 cs=0 l=1 rx=0x7fe14c010390 tx=0x7fe14c010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:13.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.113+0000 7fe15bfff700 1 --2- 172.21.15.80:0/2543995474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe164114470 0x7fe164114900 secure :-1 s=THROTTLE_DONE pgs=1195 cs=0 l=1 rx=0x7fe14c010390 tx=0x7fe14c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.113+0000 7fe1617fa700 1 -- 172.21.15.80:0/2543995474 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe14c004450 con 0x7fe164114470 2019-11-28T11:37:13.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.113+0000 7fe15bfff700 1 --2- 172.21.15.80:0/2543995474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe164114470 0x7fe164114900 secure :-1 s=THROTTLE_DONE pgs=1195 cs=0 l=1 rx=0x7fe14c010390 tx=0x7fe14c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.113+0000 7fe15bfff700 1 --2- 172.21.15.80:0/2543995474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe164114470 0x7fe164114900 secure :-1 s=THROTTLE_DONE pgs=1195 cs=0 l=1 rx=0x7fe14c010390 tx=0x7fe14c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.113+0000 7fe1617fa700 1 -- 172.21.15.80:0/2543995474 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c000cf0 con 0x7fe164114470 2019-11-28T11:37:13.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.113+0000 7fe169d1f700 1 -- 172.21.15.80:0/2543995474 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1641130b0 con 0x7fe164114470 2019-11-28T11:37:13.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.113+0000 7fe1617fa700 1 -- 172.21.15.80:0/2543995474 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe14c004450 con 0x7fe164114470 2019-11-28T11:37:13.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.113+0000 7fe169d1f700 1 -- 172.21.15.80:0/2543995474 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe164112d30 con 0x7fe164114470 2019-11-28T11:37:13.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.113+0000 7fe15bfff700 1 --2- 172.21.15.80:0/2543995474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe164114470 0x7fe164114900 secure :-1 s=THROTTLE_DONE pgs=1195 cs=0 l=1 rx=0x7fe14c010390 tx=0x7fe14c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.114+0000 7fe1617fa700 1 -- 172.21.15.80:0/2543995474 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe14c004450 con 0x7fe164114470 2019-11-28T11:37:13.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.114+0000 7fe15bfff700 1 --2- 172.21.15.80:0/2543995474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe164114470 0x7fe164114900 secure :-1 s=THROTTLE_DONE pgs=1195 cs=0 l=1 rx=0x7fe14c010390 tx=0x7fe14c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.114+0000 7fe1617fa700 1 --2- 172.21.15.80:0/2543995474 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe148018730 0x7fe14801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:13.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.114+0000 7fe1617fa700 1 -- 172.21.15.80:0/2543995474 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe14c031aa0 con 0x7fe164114470 2019-11-28T11:37:13.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.114+0000 7fe163fff700 1 --2- 172.21.15.80:0/2543995474 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe148018730 0x7fe14801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:13.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.114+0000 7fe163fff700 1 --2- 172.21.15.80:0/2543995474 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe148018730 0x7fe14801abc0 crc :-1 s=READY pgs=486 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:13.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.121+0000 7fe169d1f700 1 -- 172.21.15.80:0/2543995474 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1641130b0 con 0x7fe164114470 2019-11-28T11:37:13.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.124+0000 7fe15bfff700 1 --2- 172.21.15.80:0/2543995474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe164114470 0x7fe164114900 secure :-1 s=THROTTLE_DONE pgs=1195 cs=0 l=1 rx=0x7fe14c010390 tx=0x7fe14c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.124+0000 7fe1617fa700 1 -- 172.21.15.80:0/2543995474 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe14c0262f0 con 0x7fe164114470 2019-11-28T11:37:13.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.299+0000 7fe169d1f700 1 -- 172.21.15.80:0/2543995474 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe164112d30 con 0x7fe164114470 2019-11-28T11:37:13.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.300+0000 7fe15bfff700 1 --2- 172.21.15.80:0/2543995474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe164114470 0x7fe164114900 secure :-1 s=THROTTLE_DONE pgs=1195 cs=0 l=1 rx=0x7fe14c010390 tx=0x7fe14c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.300+0000 7fe1617fa700 1 -- 172.21.15.80:0/2543995474 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+14860 (secure 0 0 0) 0x7fe14c0262f0 con 0x7fe164114470 2019-11-28T11:37:13.362 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:37:13.362 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":93,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:37:05.208345+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:37:01.482997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2019-11-28T11:37:02.223344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:37:13.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.302+0000 7fe169d1f700 1 -- 172.21.15.80:0/2543995474 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe148018730 msgr2=0x7fe14801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:13.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.302+0000 7fe169d1f700 1 --2- 172.21.15.80:0/2543995474 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe148018730 0x7fe14801abc0 crc :-1 s=READY pgs=486 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:13.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.302+0000 7fe169d1f700 1 -- 172.21.15.80:0/2543995474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe164114470 msgr2=0x7fe164114900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:13.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.302+0000 7fe169d1f700 1 --2- 172.21.15.80:0/2543995474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe164114470 0x7fe164114900 secure :-1 s=READY pgs=1195 cs=0 l=1 rx=0x7fe14c010390 tx=0x7fe14c010730).stop 2019-11-28T11:37:13.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.302+0000 7fe169d1f700 1 -- 172.21.15.80:0/2543995474 shutdown_connections 2019-11-28T11:37:13.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.302+0000 7fe169d1f700 1 --2- 172.21.15.80:0/2543995474 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe164114470 0x7fe164114900 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:13.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.302+0000 7fe169d1f700 1 --2- 172.21.15.80:0/2543995474 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe148018730 0x7fe14801abc0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:13.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.302+0000 7fe169d1f700 1 -- 172.21.15.80:0/2543995474 shutdown_connections 2019-11-28T11:37:13.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.302+0000 7fe169d1f700 1 -- 172.21.15.80:0/2543995474 wait complete. 2019-11-28T11:37:13.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.302+0000 7fe169d1f700 1 -- 172.21.15.80:0/2543995474 >> 172.21.15.80:0/2543995474 conn(0x7fe164141d10 msgr2=0x7fe16413ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:13.376 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:37:01.482997+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 14, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'92', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:37:02.223344+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 15, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'93', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:37:13.376 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:37:13.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.440+0000 7f4bd331b700 1 Processor -- start 2019-11-28T11:37:13.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.440+0000 7f4bd331b700 1 -- start start 2019-11-28T11:37:13.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd331b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4bcc15ed10 0x7f4bcc15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:13.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd331b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4bcc073020 0x7f4bcc071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:13.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd331b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bcc06db60 con 0x7f4bcc0734b0 2019-11-28T11:37:13.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd331b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bcc06fe00 con 0x7f4bcc073020 2019-11-28T11:37:13.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd331b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bcc0700d0 con 0x7f4bcc15ed10 2019-11-28T11:37:13.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd10b7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4bcc073020 0x7f4bcc071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd10b7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4bcc073020 0x7f4bcc071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37238/0 (socket says 172.21.15.80:37238) 2019-11-28T11:37:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd10b7700 1 -- 172.21.15.80:0/3107591984 learned_addr learned my addr 172.21.15.80:0/3107591984 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd20b9700 1 --1- 172.21.15.80:0/3107591984 >> v1:172.21.15.80:6789/0 conn(0x7f4bcc0734b0 0x7f4bcc0723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36552/0 (socket says 172.21.15.80:36552) 2019-11-28T11:37:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd18b8700 1 --2- 172.21.15.80:0/3107591984 >> v2:172.21.15.174:3300/0 conn(0x7f4bcc15ed10 0x7f4bcc15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd10b7700 1 -- 172.21.15.80:0/3107591984 >> v2:172.21.15.174:3300/0 conn(0x7f4bcc15ed10 msgr2=0x7f4bcc15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd10b7700 1 --2- 172.21.15.80:0/3107591984 >> v2:172.21.15.174:3300/0 conn(0x7f4bcc15ed10 0x7f4bcc15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:13.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd10b7700 1 -- 172.21.15.80:0/3107591984 >> v1:172.21.15.80:6789/0 conn(0x7f4bcc0734b0 legacy=0x7f4bcc0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:13.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd08b6700 1 -- 172.21.15.80:0/3107591984 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865421712 0 0) 0x7f4bc4000d30 con 0x7f4bcc0734b0 2019-11-28T11:37:13.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd10b7700 1 -- 172.21.15.80:0/3107591984 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc070760 con 0x7f4bcc073020 2019-11-28T11:37:13.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd18b8700 1 --2- 172.21.15.80:0/3107591984 >> v2:172.21.15.174:3300/0 conn(0x7f4bcc15ed10 0x7f4bcc15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:37:13.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.441+0000 7f4bd10b7700 1 --2- 172.21.15.80:0/3107591984 >> v2:172.21.15.80:3300/0 conn(0x7f4bcc073020 0x7f4bcc071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4bbc00f740 tx=0x7f4bbc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.442+0000 7f4bd10b7700 1 --2- 172.21.15.80:0/3107591984 >> v2:172.21.15.80:3300/0 conn(0x7f4bcc073020 0x7f4bcc071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4bbc00f740 tx=0x7f4bbc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.442+0000 7f4bd10b7700 1 --2- 172.21.15.80:0/3107591984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bcc073020 0x7f4bcc071ea0 secure :-1 s=READY pgs=1197 cs=0 l=1 rx=0x7f4bbc00f740 tx=0x7f4bbc00fae0).ready entity=mon.0 client_cookie=e17b546dc9de2993 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:13.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.442+0000 7f4bd10b7700 1 --2- 172.21.15.80:0/3107591984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bcc073020 0x7f4bcc071ea0 secure :-1 s=THROTTLE_DONE pgs=1197 cs=0 l=1 rx=0x7f4bbc00f740 tx=0x7f4bbc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.442+0000 7f4bd08b6700 1 -- 172.21.15.80:0/3107591984 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bbc000960 con 0x7f4bcc073020 2019-11-28T11:37:13.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.442+0000 7f4bd10b7700 1 --2- 172.21.15.80:0/3107591984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bcc073020 0x7f4bcc071ea0 secure :-1 s=THROTTLE_DONE pgs=1197 cs=0 l=1 rx=0x7f4bbc00f740 tx=0x7f4bbc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.442+0000 7f4bd10b7700 1 --2- 172.21.15.80:0/3107591984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bcc073020 0x7f4bcc071ea0 secure :-1 s=THROTTLE_DONE pgs=1197 cs=0 l=1 rx=0x7f4bbc00f740 tx=0x7f4bbc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.442+0000 7f4bd08b6700 1 -- 172.21.15.80:0/3107591984 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc000c90 con 0x7f4bcc073020 2019-11-28T11:37:13.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.442+0000 7f4bd08b6700 1 -- 172.21.15.80:0/3107591984 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bbc0013a0 con 0x7f4bcc073020 2019-11-28T11:37:13.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.442+0000 7f4bd331b700 1 -- 172.21.15.80:0/3107591984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bcc073020 msgr2=0x7f4bcc071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:13.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.442+0000 7f4bd331b700 1 --2- 172.21.15.80:0/3107591984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bcc073020 0x7f4bcc071ea0 secure :-1 s=READY pgs=1197 cs=0 l=1 rx=0x7f4bbc00f740 tx=0x7f4bbc00fae0).stop 2019-11-28T11:37:13.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.442+0000 7f4bd331b700 1 -- 172.21.15.80:0/3107591984 shutdown_connections 2019-11-28T11:37:13.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.442+0000 7f4bd331b700 1 --2- 172.21.15.80:0/3107591984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4bcc073020 0x7f4bcc071ea0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:13.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.442+0000 7f4bd331b700 1 --2- 172.21.15.80:0/3107591984 >> v2:172.21.15.174:3300/0 conn(0x7f4bcc15ed10 0x7f4bcc15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:13.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.443+0000 7f4bd331b700 1 -- 172.21.15.80:0/3107591984 shutdown_connections 2019-11-28T11:37:13.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.443+0000 7f4bd331b700 1 -- 172.21.15.80:0/3107591984 wait complete. 2019-11-28T11:37:13.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.443+0000 7f4bd331b700 1 -- 172.21.15.80:0/3107591984 >> 172.21.15.80:0/3107591984 conn(0x7f4bcc061d20 msgr2=0x7f4bcc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:13.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.445+0000 7f4bd331b700 1 Processor -- start 2019-11-28T11:37:13.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.445+0000 7f4bd331b700 1 -- start start 2019-11-28T11:37:13.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.446+0000 7f4bd331b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4bcc167d80 0x7f4bcc16a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:13.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.446+0000 7f4bd331b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bcc148e00 con 0x7f4bcc148320 2019-11-28T11:37:13.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.446+0000 7f4bd331b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bcc108b10 con 0x7f4bcc1079b0 2019-11-28T11:37:13.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.446+0000 7f4bd331b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bcc13aa20 con 0x7f4bcc167d80 2019-11-28T11:37:13.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.446+0000 7f4bd18b8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4bcc148320 0x7f4bcc10ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36556/0 (socket says 172.21.15.80:36556) 2019-11-28T11:37:13.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.446+0000 7f4bd18b8700 1 -- 172.21.15.80:0/3742093415 learned_addr learned my addr 172.21.15.80:0/3742093415 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:13.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.446+0000 7f4bd20b9700 1 --2- 172.21.15.80:0/3742093415 >> v2:172.21.15.174:3300/0 conn(0x7f4bcc167d80 0x7f4bcc16a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:13.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.446+0000 7f4bca7fc700 1 -- 172.21.15.80:0/3742093415 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103062059 0 0) 0x7f4bb4009c90 con 0x7f4bcc148320 2019-11-28T11:37:13.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.446+0000 7f4bca7fc700 1 -- 172.21.15.80:0/3742093415 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb0002e80 con 0x7f4bcc148320 2019-11-28T11:37:13.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.446+0000 7f4bd20b9700 1 -- 172.21.15.80:0/3742093415 >> v1:172.21.15.174:6789/0 conn(0x7f4bcc1079b0 legacy=0x7f4bcc107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:13.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.446+0000 7f4bca7fc700 1 -- 172.21.15.80:0/3742093415 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479908145 0 0) 0x7f4bbc0075d0 con 0x7f4bcc1079b0 2019-11-28T11:37:13.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.446+0000 7f4bd20b9700 1 -- 172.21.15.80:0/3742093415 >> v1:172.21.15.80:6789/0 conn(0x7f4bcc148320 legacy=0x7f4bcc10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:13.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.446+0000 7f4bd20b9700 1 -- 172.21.15.80:0/3742093415 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc10c490 con 0x7f4bcc167d80 2019-11-28T11:37:13.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.446+0000 7f4bd20b9700 1 --2- 172.21.15.80:0/3742093415 >> v2:172.21.15.174:3300/0 conn(0x7f4bcc167d80 0x7f4bcc16a180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4bc4010700 tx=0x7f4bc4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.446+0000 7f4bd20b9700 1 --2- 172.21.15.80:0/3742093415 >> v2:172.21.15.174:3300/0 conn(0x7f4bcc167d80 0x7f4bcc16a180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4bc4010700 tx=0x7f4bc4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.446+0000 7f4bd20b9700 1 --2- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4bcc167d80 0x7f4bcc16a180 secure :-1 s=READY pgs=709 cs=0 l=1 rx=0x7f4bc4010700 tx=0x7f4bc4010aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:13.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.447+0000 7f4bd20b9700 1 --2- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4bcc167d80 0x7f4bcc16a180 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7f4bc4010700 tx=0x7f4bc4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.447+0000 7f4bca7fc700 1 -- 172.21.15.80:0/3742093415 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bc4000cc0 con 0x7f4bcc167d80 2019-11-28T11:37:13.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.447+0000 7f4bd20b9700 1 --2- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4bcc167d80 0x7f4bcc16a180 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7f4bc4010700 tx=0x7f4bc4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.447+0000 7f4bd20b9700 1 --2- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4bcc167d80 0x7f4bcc16a180 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7f4bc4010700 tx=0x7f4bc4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.447+0000 7f4bca7fc700 1 -- 172.21.15.80:0/3742093415 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc40017f0 con 0x7f4bcc167d80 2019-11-28T11:37:13.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.447+0000 7f4bd331b700 1 -- 172.21.15.80:0/3742093415 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bcc10c810 con 0x7f4bcc167d80 2019-11-28T11:37:13.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.447+0000 7f4bca7fc700 1 -- 172.21.15.80:0/3742093415 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bc40019e0 con 0x7f4bcc167d80 2019-11-28T11:37:13.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.447+0000 7f4bd331b700 1 -- 172.21.15.80:0/3742093415 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc10c490 con 0x7f4bcc167d80 2019-11-28T11:37:13.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.447+0000 7f4bd20b9700 1 --2- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4bcc167d80 0x7f4bcc16a180 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7f4bc4010700 tx=0x7f4bc4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.447+0000 7f4bca7fc700 1 -- 172.21.15.80:0/3742093415 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4bc4001390 con 0x7f4bcc167d80 2019-11-28T11:37:13.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.447+0000 7f4bd20b9700 1 --2- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4bcc167d80 0x7f4bcc16a180 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7f4bc4010700 tx=0x7f4bc4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.447+0000 7f4bca7fc700 1 --2- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4bb0018780 0x7f4bb001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:13.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.447+0000 7f4bca7fc700 1 -- 172.21.15.80:0/3742093415 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4bc40320a0 con 0x7f4bcc167d80 2019-11-28T11:37:13.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.448+0000 7f4bd18b8700 1 --2- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4bb0018780 0x7f4bb001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:13.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.448+0000 7f4bd18b8700 1 --2- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4bb0018780 0x7f4bb001abf0 crc :-1 s=READY pgs=487 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:13.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.455+0000 7f4bd331b700 1 -- 172.21.15.80:0/3742093415 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bcc10c810 con 0x7f4bcc167d80 2019-11-28T11:37:13.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.459+0000 7f4bd20b9700 1 --2- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4bcc167d80 0x7f4bcc16a180 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7f4bc4010700 tx=0x7f4bc4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.459+0000 7f4bca7fc700 1 -- 172.21.15.80:0/3742093415 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4bc40017f0 con 0x7f4bcc167d80 2019-11-28T11:37:13.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.629+0000 7f4bd331b700 1 -- 172.21.15.80:0/3742093415 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f4bcc10c490 con 0x7f4bcc167d80 2019-11-28T11:37:13.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.630+0000 7f4bd20b9700 1 --2- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4bcc167d80 0x7f4bcc16a180 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7f4bc4010700 tx=0x7f4bc4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.630+0000 7f4bca7fc700 1 -- 172.21.15.80:0/3742093415 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v93) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4bc4001a00 con 0x7f4bcc167d80 2019-11-28T11:37:13.693 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:37:13.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.632+0000 7f4bd331b700 1 -- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4bb0018780 msgr2=0x7f4bb001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:13.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.632+0000 7f4bd331b700 1 --2- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4bb0018780 0x7f4bb001abf0 crc :-1 s=READY pgs=487 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:13.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.632+0000 7f4bd331b700 1 -- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4bcc167d80 msgr2=0x7f4bcc16a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:13.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.632+0000 7f4bd331b700 1 --2- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4bcc167d80 0x7f4bcc16a180 secure :-1 s=READY pgs=709 cs=0 l=1 rx=0x7f4bc4010700 tx=0x7f4bc4010aa0).stop 2019-11-28T11:37:13.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.632+0000 7f4bd331b700 1 -- 172.21.15.80:0/3742093415 shutdown_connections 2019-11-28T11:37:13.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.632+0000 7f4bd331b700 1 --2- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4bcc167d80 0x7f4bcc16a180 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:13.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.632+0000 7f4bd331b700 1 --2- 172.21.15.80:0/3742093415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4bb0018780 0x7f4bb001abf0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:13.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.633+0000 7f4bd331b700 1 -- 172.21.15.80:0/3742093415 shutdown_connections 2019-11-28T11:37:13.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.633+0000 7f4bd331b700 1 -- 172.21.15.80:0/3742093415 wait complete. 2019-11-28T11:37:13.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.633+0000 7f4bd331b700 1 -- 172.21.15.80:0/3742093415 >> 172.21.15.80:0/3742093415 conn(0x7f4bcc15e2d0 msgr2=0x7f4bcc147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:13.705 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:37:13.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.767+0000 7fd74e682700 1 Processor -- start 2019-11-28T11:37:13.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.767+0000 7fd74e682700 1 -- start start 2019-11-28T11:37:13.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.768+0000 7fd74e682700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd74815f100 0x7fd74806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:13.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.768+0000 7fd74e682700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd74806c2f0 0x7fd74806c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:13.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.768+0000 7fd74e682700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74806db60 con 0x7fd74815ed10 2019-11-28T11:37:13.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.768+0000 7fd74e682700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74806fe00 con 0x7fd74806c2f0 2019-11-28T11:37:13.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.768+0000 7fd74e682700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7480700d0 con 0x7fd74815f100 2019-11-28T11:37:13.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.768+0000 7fd74d420700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd74806c2f0 0x7fd74806c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:13.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.768+0000 7fd74d420700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd74806c2f0 0x7fd74806c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37248/0 (socket says 172.21.15.80:37248) 2019-11-28T11:37:13.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.768+0000 7fd74d420700 1 -- 172.21.15.80:0/1778734271 learned_addr learned my addr 172.21.15.80:0/1778734271 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:13.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.768+0000 7fd747fff700 1 --2- 172.21.15.80:0/1778734271 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd74815f100 0x7fd74806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:13.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.769+0000 7fd74d420700 1 -- 172.21.15.80:0/1778734271 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd74815f100 msgr2=0x7fd74806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:13.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.769+0000 7fd74d420700 1 --2- 172.21.15.80:0/1778734271 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd74815f100 0x7fd74806bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:13.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.769+0000 7fd74d420700 1 -- 172.21.15.80:0/1778734271 >> v1:172.21.15.174:6789/0 conn(0x7fd74815ed10 legacy=0x7fd748073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:13.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.769+0000 7fd74d420700 1 -- 172.21.15.80:0/1778734271 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd748070760 con 0x7fd74806c2f0 2019-11-28T11:37:13.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.769+0000 7fd74d420700 1 --2- 172.21.15.80:0/1778734271 >> v2:172.21.15.80:3300/0 conn(0x7fd74806c2f0 0x7fd74806c790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd74000f6b0 tx=0x7fd74000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.769+0000 7fd74d420700 1 --2- 172.21.15.80:0/1778734271 >> v2:172.21.15.80:3300/0 conn(0x7fd74806c2f0 0x7fd74806c790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd74000f6b0 tx=0x7fd74000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.769+0000 7fd74d420700 1 --2- 172.21.15.80:0/1778734271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74806c2f0 0x7fd74806c790 secure :-1 s=READY pgs=1199 cs=0 l=1 rx=0x7fd74000f6b0 tx=0x7fd74000fa50).ready entity=mon.0 client_cookie=62ebbabab8b3171f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:13.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.769+0000 7fd74d420700 1 --2- 172.21.15.80:0/1778734271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74806c2f0 0x7fd74806c790 secure :-1 s=THROTTLE_DONE pgs=1199 cs=0 l=1 rx=0x7fd74000f6b0 tx=0x7fd74000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.769+0000 7fd74d420700 1 --2- 172.21.15.80:0/1778734271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74806c2f0 0x7fd74806c790 secure :-1 s=THROTTLE_DONE pgs=1199 cs=0 l=1 rx=0x7fd74000f6b0 tx=0x7fd74000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.769+0000 7fd7477fe700 1 -- 172.21.15.80:0/1778734271 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd740000a70 con 0x7fd74806c2f0 2019-11-28T11:37:13.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.769+0000 7fd74d420700 1 --2- 172.21.15.80:0/1778734271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74806c2f0 0x7fd74806c790 secure :-1 s=THROTTLE_DONE pgs=1199 cs=0 l=1 rx=0x7fd74000f6b0 tx=0x7fd74000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.769+0000 7fd7477fe700 1 -- 172.21.15.80:0/1778734271 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7400010e0 con 0x7fd74806c2f0 2019-11-28T11:37:13.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.769+0000 7fd7477fe700 1 -- 172.21.15.80:0/1778734271 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7400017b0 con 0x7fd74806c2f0 2019-11-28T11:37:13.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.769+0000 7fd74e682700 1 -- 172.21.15.80:0/1778734271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74806c2f0 msgr2=0x7fd74806c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:13.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.769+0000 7fd74e682700 1 --2- 172.21.15.80:0/1778734271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74806c2f0 0x7fd74806c790 secure :-1 s=READY pgs=1199 cs=0 l=1 rx=0x7fd74000f6b0 tx=0x7fd74000fa50).stop 2019-11-28T11:37:13.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.770+0000 7fd74e682700 1 -- 172.21.15.80:0/1778734271 shutdown_connections 2019-11-28T11:37:13.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.770+0000 7fd74e682700 1 --2- 172.21.15.80:0/1778734271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd74806c2f0 0x7fd74806c790 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:13.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.770+0000 7fd74e682700 1 --2- 172.21.15.80:0/1778734271 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd74815f100 0x7fd74806bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:13.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.770+0000 7fd74e682700 1 -- 172.21.15.80:0/1778734271 shutdown_connections 2019-11-28T11:37:13.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.770+0000 7fd74e682700 1 -- 172.21.15.80:0/1778734271 wait complete. 2019-11-28T11:37:13.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.770+0000 7fd74e682700 1 -- 172.21.15.80:0/1778734271 >> 172.21.15.80:0/1778734271 conn(0x7fd748061d20 msgr2=0x7fd7480641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:13.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.772+0000 7fd74e682700 1 Processor -- start 2019-11-28T11:37:13.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.772+0000 7fd74e682700 1 -- start start 2019-11-28T11:37:13.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.773+0000 7fd74e682700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd748167d80 0x7fd74816a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:13.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.773+0000 7fd74e682700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd748148e00 con 0x7fd7481079b0 2019-11-28T11:37:13.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.773+0000 7fd74e682700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd748108b10 con 0x7fd748148320 2019-11-28T11:37:13.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.773+0000 7fd74e682700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74813aa20 con 0x7fd748167d80 2019-11-28T11:37:13.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.773+0000 7fd747fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd7481079b0 0x7fd748107e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36570/0 (socket says 172.21.15.80:36570) 2019-11-28T11:37:13.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.773+0000 7fd747fff700 1 -- 172.21.15.80:0/2260692627 learned_addr learned my addr 172.21.15.80:0/2260692627 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:13.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.773+0000 7fd74d420700 1 --2- 172.21.15.80:0/2260692627 >> v2:172.21.15.174:3300/0 conn(0x7fd748167d80 0x7fd74816a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:13.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.773+0000 7fd7457fa700 1 -- 172.21.15.80:0/2260692627 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214404326 0 0) 0x7fd738009900 con 0x7fd7481079b0 2019-11-28T11:37:13.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.773+0000 7fd7457fa700 1 -- 172.21.15.80:0/2260692627 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd72c002e80 con 0x7fd7481079b0 2019-11-28T11:37:13.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.774+0000 7fd74d420700 1 -- 172.21.15.80:0/2260692627 >> v1:172.21.15.174:6789/0 conn(0x7fd748148320 legacy=0x7fd74810ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:13.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.774+0000 7fd7457fa700 1 -- 172.21.15.80:0/2260692627 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015894505 0 0) 0x7fd730001080 con 0x7fd748148320 2019-11-28T11:37:13.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.774+0000 7fd74d420700 1 -- 172.21.15.80:0/2260692627 >> v1:172.21.15.80:6789/0 conn(0x7fd7481079b0 legacy=0x7fd748107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:13.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.774+0000 7fd74d420700 1 -- 172.21.15.80:0/2260692627 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74810c490 con 0x7fd748167d80 2019-11-28T11:37:13.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.774+0000 7fd74d420700 1 --2- 172.21.15.80:0/2260692627 >> v2:172.21.15.174:3300/0 conn(0x7fd748167d80 0x7fd74816a180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd740007c00 tx=0x7fd740010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.774+0000 7fd74d420700 1 --2- 172.21.15.80:0/2260692627 >> v2:172.21.15.174:3300/0 conn(0x7fd748167d80 0x7fd74816a180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd740007c00 tx=0x7fd740010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.774+0000 7fd74d420700 1 --2- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd748167d80 0x7fd74816a180 secure :-1 s=READY pgs=712 cs=0 l=1 rx=0x7fd740007c00 tx=0x7fd740010720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:13.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.774+0000 7fd74d420700 1 --2- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd748167d80 0x7fd74816a180 secure :-1 s=THROTTLE_DONE pgs=712 cs=0 l=1 rx=0x7fd740007c00 tx=0x7fd740010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.774+0000 7fd7457fa700 1 -- 172.21.15.80:0/2260692627 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd740008180 con 0x7fd748167d80 2019-11-28T11:37:13.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.774+0000 7fd74d420700 1 --2- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd748167d80 0x7fd74816a180 secure :-1 s=THROTTLE_DONE pgs=712 cs=0 l=1 rx=0x7fd740007c00 tx=0x7fd740010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.774+0000 7fd74d420700 1 --2- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd748167d80 0x7fd74816a180 secure :-1 s=THROTTLE_DONE pgs=712 cs=0 l=1 rx=0x7fd740007c00 tx=0x7fd740010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.774+0000 7fd7457fa700 1 -- 172.21.15.80:0/2260692627 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd740007f40 con 0x7fd748167d80 2019-11-28T11:37:13.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.774+0000 7fd74e682700 1 -- 172.21.15.80:0/2260692627 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74810c810 con 0x7fd748167d80 2019-11-28T11:37:13.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.774+0000 7fd7457fa700 1 -- 172.21.15.80:0/2260692627 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7400010c0 con 0x7fd748167d80 2019-11-28T11:37:13.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.774+0000 7fd74e682700 1 -- 172.21.15.80:0/2260692627 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74810c490 con 0x7fd748167d80 2019-11-28T11:37:13.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.774+0000 7fd74d420700 1 --2- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd748167d80 0x7fd74816a180 secure :-1 s=THROTTLE_DONE pgs=712 cs=0 l=1 rx=0x7fd740007c00 tx=0x7fd740010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.775+0000 7fd7457fa700 1 -- 172.21.15.80:0/2260692627 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd740000ff0 con 0x7fd748167d80 2019-11-28T11:37:13.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.775+0000 7fd74d420700 1 --2- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd748167d80 0x7fd74816a180 secure :-1 s=THROTTLE_DONE pgs=712 cs=0 l=1 rx=0x7fd740007c00 tx=0x7fd740010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.775+0000 7fd7457fa700 1 --2- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd72c018780 0x7fd72c01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:13.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.775+0000 7fd7457fa700 1 -- 172.21.15.80:0/2260692627 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd740031ad0 con 0x7fd748167d80 2019-11-28T11:37:13.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.775+0000 7fd74cc1f700 1 --2- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd72c018780 0x7fd72c01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:13.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.775+0000 7fd74cc1f700 1 --2- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd72c018780 0x7fd72c01abf0 crc :-1 s=READY pgs=488 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:13.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.782+0000 7fd74e682700 1 -- 172.21.15.80:0/2260692627 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd74810c810 con 0x7fd748167d80 2019-11-28T11:37:13.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.786+0000 7fd74d420700 1 --2- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd748167d80 0x7fd74816a180 secure :-1 s=THROTTLE_DONE pgs=712 cs=0 l=1 rx=0x7fd740007c00 tx=0x7fd740010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:13.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.786+0000 7fd7457fa700 1 -- 172.21.15.80:0/2260692627 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd740008180 con 0x7fd748167d80 2019-11-28T11:37:14.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.951+0000 7fd74e682700 1 -- 172.21.15.80:0/2260692627 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fd74810c490 con 0x7fd748167d80 2019-11-28T11:37:14.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.951+0000 7fd74d420700 1 --2- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd748167d80 0x7fd74816a180 secure :-1 s=THROTTLE_DONE pgs=712 cs=0 l=1 rx=0x7fd740007c00 tx=0x7fd740010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.951+0000 7fd7457fa700 1 -- 172.21.15.80:0/2260692627 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v93) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd740000f50 con 0x7fd748167d80 2019-11-28T11:37:14.014 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:37:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.953+0000 7fd74e682700 1 -- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd72c018780 msgr2=0x7fd72c01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.953+0000 7fd74e682700 1 --2- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd72c018780 0x7fd72c01abf0 crc :-1 s=READY pgs=488 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.953+0000 7fd74e682700 1 -- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd748167d80 msgr2=0x7fd74816a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.953+0000 7fd74e682700 1 --2- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd748167d80 0x7fd74816a180 secure :-1 s=READY pgs=712 cs=0 l=1 rx=0x7fd740007c00 tx=0x7fd740010720).stop 2019-11-28T11:37:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.954+0000 7fd74e682700 1 -- 172.21.15.80:0/2260692627 shutdown_connections 2019-11-28T11:37:14.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.954+0000 7fd74e682700 1 --2- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd748167d80 0x7fd74816a180 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:14.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.954+0000 7fd74e682700 1 --2- 172.21.15.80:0/2260692627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd72c018780 0x7fd72c01abf0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:14.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.954+0000 7fd74e682700 1 -- 172.21.15.80:0/2260692627 shutdown_connections 2019-11-28T11:37:14.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.954+0000 7fd74e682700 1 -- 172.21.15.80:0/2260692627 wait complete. 2019-11-28T11:37:14.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:13.954+0000 7fd74e682700 1 -- 172.21.15.80:0/2260692627 >> 172.21.15.80:0/2260692627 conn(0x7fd74815e2d0 msgr2=0x7fd748147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:14.025 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:37:14.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.088+0000 7f544bf5b700 1 Processor -- start 2019-11-28T11:37:14.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.088+0000 7f544bf5b700 1 -- start start 2019-11-28T11:37:14.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544bf5b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f544415ed10 0x7f544415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:14.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544bf5b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f54440734b0 0x7f54440726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:14.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544bf5b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f544406db60 con 0x7f5444073020 2019-11-28T11:37:14.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544bf5b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544406fe00 con 0x7f544415ed10 2019-11-28T11:37:14.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544bf5b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54440700d0 con 0x7f54440734b0 2019-11-28T11:37:14.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544a4f8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f544415ed10 0x7f544415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:14.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544a4f8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f544415ed10 0x7f544415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37260/0 (socket says 172.21.15.80:37260) 2019-11-28T11:37:14.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544a4f8700 1 -- 172.21.15.80:0/4201866526 learned_addr learned my addr 172.21.15.80:0/4201866526 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:14.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544acf9700 1 --2- 172.21.15.80:0/4201866526 >> v2:172.21.15.174:3300/0 conn(0x7f54440734b0 0x7f54440726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:14.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544a4f8700 1 -- 172.21.15.80:0/4201866526 >> v2:172.21.15.174:3300/0 conn(0x7f54440734b0 msgr2=0x7f54440726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:14.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544a4f8700 1 --2- 172.21.15.80:0/4201866526 >> v2:172.21.15.174:3300/0 conn(0x7f54440734b0 0x7f54440726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:14.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544a4f8700 1 -- 172.21.15.80:0/4201866526 >> v1:172.21.15.174:6789/0 conn(0x7f5444073020 legacy=0x7f5444071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544a4f8700 1 -- 172.21.15.80:0/4201866526 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5444070760 con 0x7f544415ed10 2019-11-28T11:37:14.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544a4f8700 1 --2- 172.21.15.80:0/4201866526 >> v2:172.21.15.80:3300/0 conn(0x7f544415ed10 0x7f544415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f542c00f6c0 tx=0x7f542c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544a4f8700 1 --2- 172.21.15.80:0/4201866526 >> v2:172.21.15.80:3300/0 conn(0x7f544415ed10 0x7f544415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f542c00f6c0 tx=0x7f542c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544a4f8700 1 --2- 172.21.15.80:0/4201866526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f544415ed10 0x7f544415f100 secure :-1 s=READY pgs=1201 cs=0 l=1 rx=0x7f542c00f6c0 tx=0x7f542c00fa60).ready entity=mon.0 client_cookie=4336c2c5f380eac7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:14.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544a4f8700 1 --2- 172.21.15.80:0/4201866526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f544415ed10 0x7f544415f100 secure :-1 s=THROTTLE_DONE pgs=1201 cs=0 l=1 rx=0x7f542c00f6c0 tx=0x7f542c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544a4f8700 1 --2- 172.21.15.80:0/4201866526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f544415ed10 0x7f544415f100 secure :-1 s=THROTTLE_DONE pgs=1201 cs=0 l=1 rx=0x7f542c00f6c0 tx=0x7f542c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f54494f6700 1 -- 172.21.15.80:0/4201866526 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542c000960 con 0x7f544415ed10 2019-11-28T11:37:14.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.089+0000 7f544a4f8700 1 --2- 172.21.15.80:0/4201866526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f544415ed10 0x7f544415f100 secure :-1 s=THROTTLE_DONE pgs=1201 cs=0 l=1 rx=0x7f542c00f6c0 tx=0x7f542c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.090+0000 7f54494f6700 1 -- 172.21.15.80:0/4201866526 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c000c90 con 0x7f544415ed10 2019-11-28T11:37:14.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.090+0000 7f54494f6700 1 -- 172.21.15.80:0/4201866526 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542c0013a0 con 0x7f544415ed10 2019-11-28T11:37:14.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.090+0000 7f544bf5b700 1 -- 172.21.15.80:0/4201866526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f544415ed10 msgr2=0x7f544415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.090+0000 7f544bf5b700 1 --2- 172.21.15.80:0/4201866526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f544415ed10 0x7f544415f100 secure :-1 s=READY pgs=1201 cs=0 l=1 rx=0x7f542c00f6c0 tx=0x7f542c00fa60).stop 2019-11-28T11:37:14.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.090+0000 7f544bf5b700 1 -- 172.21.15.80:0/4201866526 shutdown_connections 2019-11-28T11:37:14.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.090+0000 7f544bf5b700 1 --2- 172.21.15.80:0/4201866526 >> v2:172.21.15.174:3300/0 conn(0x7f54440734b0 0x7f54440726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:14.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.090+0000 7f544bf5b700 1 --2- 172.21.15.80:0/4201866526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f544415ed10 0x7f544415f100 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:14.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.090+0000 7f544bf5b700 1 -- 172.21.15.80:0/4201866526 shutdown_connections 2019-11-28T11:37:14.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.090+0000 7f544bf5b700 1 -- 172.21.15.80:0/4201866526 wait complete. 2019-11-28T11:37:14.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.090+0000 7f544bf5b700 1 -- 172.21.15.80:0/4201866526 >> 172.21.15.80:0/4201866526 conn(0x7f5444061d20 msgr2=0x7f54440641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:14.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.093+0000 7f544bf5b700 1 Processor -- start 2019-11-28T11:37:14.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.093+0000 7f544bf5b700 1 -- start start 2019-11-28T11:37:14.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f544bf5b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5444148320 0x7f544410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:14.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f544bf5b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f544410f290 0x7f544410dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:14.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f544bf5b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5444148e00 con 0x7f544410e110 2019-11-28T11:37:14.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f544bf5b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5444139ff0 con 0x7f544410f290 2019-11-28T11:37:14.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f544bf5b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544413aa20 con 0x7f5444148320 2019-11-28T11:37:14.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f544acf9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f544410e110 0x7f54441079b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36586/0 (socket says 172.21.15.80:36586) 2019-11-28T11:37:14.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f544acf9700 1 -- 172.21.15.80:0/2001323753 learned_addr learned my addr 172.21.15.80:0/2001323753 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:14.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725578399 0 0) 0x7f543c001150 con 0x7f544410e110 2019-11-28T11:37:14.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5449cf7700 1 --2- 172.21.15.80:0/2001323753 >> v2:172.21.15.174:3300/0 conn(0x7f544410f290 0x7f544410dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:14.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f544a4f8700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5444148320 0x7f544410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:14.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5428002e80 con 0x7f544410e110 2019-11-28T11:37:14.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3409149590 0 0) 0x7f543c001280 con 0x7f544410e110 2019-11-28T11:37:14.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f54280032e0 con 0x7f544410e110 2019-11-28T11:37:14.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f543c001830 con 0x7f544410e110 2019-11-28T11:37:14.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5444148320 msgr2=0x7f544410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5442ffd700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5444148320 0x7f544410ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:14.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 >> v2:172.21.15.174:3300/0 conn(0x7f544410f290 msgr2=0x7f544410dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5442ffd700 1 --2- 172.21.15.80:0/2001323753 >> v2:172.21.15.174:3300/0 conn(0x7f544410f290 0x7f544410dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:14.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 >> v1:172.21.15.80:6789/0 conn(0x7f544410e110 legacy=0x7f54441079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5442ffd700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54280033a0 0x7f54280037d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:14.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5442ffd700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5428003d10 0x7f54280041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:14.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5442ffd700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f54280048b0 0x7f5428004d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:14.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542800bbf0 con 0x7f5428003d10 2019-11-28T11:37:14.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542800bde0 con 0x7f54280048b0 2019-11-28T11:37:14.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542800c010 con 0x7f54280033a0 2019-11-28T11:37:14.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f544a4f8700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5444148320 0x7f544410ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:37:14.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f5449cf7700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5428003d10 0x7f54280041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:14.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f544acf9700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f54280048b0 0x7f5428004d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:14.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.094+0000 7f544a4f8700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54280033a0 0x7f54280037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:14.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f5449cf7700 1 -- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54280033a0 msgr2=0x7f54280037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f5449cf7700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54280033a0 0x7f54280037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:14.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f5449cf7700 1 -- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f54280048b0 msgr2=0x7f5428004d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f5449cf7700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f54280048b0 0x7f5428004d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:14.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f5449cf7700 1 -- 172.21.15.80:0/2001323753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542800c2c0 con 0x7f5428003d10 2019-11-28T11:37:14.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f544acf9700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f54280048b0 0x7f5428004d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:37:14.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f544bf5b700 1 -- 172.21.15.80:0/2001323753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544410c810 con 0x7f5428003d10 2019-11-28T11:37:14.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f5449cf7700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5428003d10 0x7f54280041d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54340109c0 tx=0x7f5434010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f544a4f8700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54280033a0 0x7f54280037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:37:14.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f544bf5b700 1 -- 172.21.15.80:0/2001323753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544410c490 con 0x7f5428003d10 2019-11-28T11:37:14.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f5449cf7700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5428003d10 0x7f54280041d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54340109c0 tx=0x7f5434010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f5449cf7700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5428003d10 0x7f54280041d0 secure :-1 s=READY pgs=1203 cs=0 l=1 rx=0x7f54340109c0 tx=0x7f5434010d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:14.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f5449cf7700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5428003d10 0x7f54280041d0 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7f54340109c0 tx=0x7f5434010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f543400b2d0 con 0x7f5428003d10 2019-11-28T11:37:14.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f5449cf7700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5428003d10 0x7f54280041d0 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7f54340109c0 tx=0x7f5434010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543400ac40 con 0x7f5428003d10 2019-11-28T11:37:14.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f5449cf7700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5428003d10 0x7f54280041d0 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7f54340109c0 tx=0x7f5434010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f543400b4c0 con 0x7f5428003d10 2019-11-28T11:37:14.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.095+0000 7f5449cf7700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5428003d10 0x7f54280041d0 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7f54340109c0 tx=0x7f5434010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.096+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f543400b0e0 con 0x7f5428003d10 2019-11-28T11:37:14.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.096+0000 7f5449cf7700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5428003d10 0x7f54280041d0 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7f54340109c0 tx=0x7f5434010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.096+0000 7f5442ffd700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5428020b20 0x7f5428022f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:14.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.096+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5434031fb0 con 0x7f5428003d10 2019-11-28T11:37:14.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.096+0000 7f544a4f8700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5428020b20 0x7f5428022f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:14.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.096+0000 7f544a4f8700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5428020b20 0x7f5428022f50 crc :-1 s=READY pgs=489 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:14.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.103+0000 7f544bf5b700 1 -- 172.21.15.80:0/2001323753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544410c810 con 0x7f5428003d10 2019-11-28T11:37:14.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.106+0000 7f5449cf7700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5428003d10 0x7f54280041d0 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7f54340109c0 tx=0x7f5434010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.106+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f543400aed0 con 0x7f5428003d10 2019-11-28T11:37:14.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.272+0000 7f544bf5b700 1 -- 172.21.15.80:0/2001323753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f544410c490 con 0x7f5428003d10 2019-11-28T11:37:14.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.273+0000 7f5449cf7700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5428003d10 0x7f54280041d0 secure :-1 s=THROTTLE_DONE pgs=1203 cs=0 l=1 rx=0x7f54340109c0 tx=0x7f5434010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.273+0000 7f5442ffd700 1 -- 172.21.15.80:0/2001323753 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v93) v1 ==== 100+0+10 (secure 0 0 0) 0x7f543400b0e0 con 0x7f5428003d10 2019-11-28T11:37:14.335 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:37:14.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.275+0000 7f544bf5b700 1 -- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5428020b20 msgr2=0x7f5428022f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.275+0000 7f544bf5b700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5428020b20 0x7f5428022f50 crc :-1 s=READY pgs=489 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:14.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.275+0000 7f544bf5b700 1 -- 172.21.15.80:0/2001323753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5428003d10 msgr2=0x7f54280041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.275+0000 7f544bf5b700 1 --2- 172.21.15.80:0/2001323753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5428003d10 0x7f54280041d0 secure :-1 s=READY pgs=1203 cs=0 l=1 rx=0x7f54340109c0 tx=0x7f5434010d60).stop 2019-11-28T11:37:14.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.275+0000 7f544acf9700 1 -- 172.21.15.80:0/2001323753 reap_dead start 2019-11-28T11:37:14.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.275+0000 7f544bf5b700 1 -- 172.21.15.80:0/2001323753 shutdown_connections 2019-11-28T11:37:14.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.275+0000 7f544bf5b700 1 -- 172.21.15.80:0/2001323753 shutdown_connections 2019-11-28T11:37:14.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.275+0000 7f544bf5b700 1 -- 172.21.15.80:0/2001323753 wait complete. 2019-11-28T11:37:14.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.276+0000 7f544bf5b700 1 -- 172.21.15.80:0/2001323753 >> 172.21.15.80:0/2001323753 conn(0x7f544415e2d0 msgr2=0x7f5444147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:14.348 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:37:14.348 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:37:14.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.406+0000 7fbcbcad3700 1 Processor -- start 2019-11-28T11:37:14.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.406+0000 7fbcbcad3700 1 -- start start 2019-11-28T11:37:14.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcbcad3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbcb806c0a0 0x7fbcb8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:14.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcbcad3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbcb80734e0 0x7fbcb8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:14.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcbcad3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb806db00 con 0x7fbcb8072360 2019-11-28T11:37:14.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcbcad3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb806fd60 con 0x7fbcb806c0a0 2019-11-28T11:37:14.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcbcad3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb8070030 con 0x7fbcb80734e0 2019-11-28T11:37:14.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcb6d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbcb806c0a0 0x7fbcb8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:14.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcb6d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbcb806c0a0 0x7fbcb8072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37280/0 (socket says 172.21.15.80:37280) 2019-11-28T11:37:14.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcb759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbcb8072360 0x7fbcb806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36596/0 (socket says 172.21.15.80:36596) 2019-11-28T11:37:14.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcb6d9d700 1 -- 172.21.15.80:0/1860662656 learned_addr learned my addr 172.21.15.80:0/1860662656 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:14.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcb659c700 1 --2- 172.21.15.80:0/1860662656 >> v2:172.21.15.174:3300/0 conn(0x7fbcb80734e0 0x7fbcb8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:14.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcb6d9d700 1 -- 172.21.15.80:0/1860662656 >> v2:172.21.15.174:3300/0 conn(0x7fbcb80734e0 msgr2=0x7fbcb8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:14.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcb6d9d700 1 --2- 172.21.15.80:0/1860662656 >> v2:172.21.15.174:3300/0 conn(0x7fbcb80734e0 0x7fbcb8071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:14.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcb6d9d700 1 -- 172.21.15.80:0/1860662656 >> v1:172.21.15.80:6789/0 conn(0x7fbcb8072360 legacy=0x7fbcb806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcb5d9b700 1 -- 172.21.15.80:0/1860662656 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402545793 0 0) 0x7fbcb00009b0 con 0x7fbcb8072360 2019-11-28T11:37:14.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcb6d9d700 1 -- 172.21.15.80:0/1860662656 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb80706c0 con 0x7fbcb806c0a0 2019-11-28T11:37:14.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcb659c700 1 --2- 172.21.15.80:0/1860662656 >> v2:172.21.15.174:3300/0 conn(0x7fbcb80734e0 0x7fbcb8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:37:14.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.407+0000 7fbcb6d9d700 1 --2- 172.21.15.80:0/1860662656 >> v2:172.21.15.80:3300/0 conn(0x7fbcb806c0a0 0x7fbcb8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbca000f740 tx=0x7fbca000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.408+0000 7fbcb6d9d700 1 --2- 172.21.15.80:0/1860662656 >> v2:172.21.15.80:3300/0 conn(0x7fbcb806c0a0 0x7fbcb8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbca000f740 tx=0x7fbca000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.408+0000 7fbcb6d9d700 1 --2- 172.21.15.80:0/1860662656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcb806c0a0 0x7fbcb8072fa0 secure :-1 s=READY pgs=1205 cs=0 l=1 rx=0x7fbca000f740 tx=0x7fbca000fae0).ready entity=mon.0 client_cookie=39b5e0cb409bdbd2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:14.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.408+0000 7fbcb6d9d700 1 --2- 172.21.15.80:0/1860662656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcb806c0a0 0x7fbcb8072fa0 secure :-1 s=THROTTLE_DONE pgs=1205 cs=0 l=1 rx=0x7fbca000f740 tx=0x7fbca000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.408+0000 7fbcb5d9b700 1 -- 172.21.15.80:0/1860662656 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbca0000960 con 0x7fbcb806c0a0 2019-11-28T11:37:14.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.408+0000 7fbcb6d9d700 1 --2- 172.21.15.80:0/1860662656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcb806c0a0 0x7fbcb8072fa0 secure :-1 s=THROTTLE_DONE pgs=1205 cs=0 l=1 rx=0x7fbca000f740 tx=0x7fbca000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.408+0000 7fbcb6d9d700 1 --2- 172.21.15.80:0/1860662656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcb806c0a0 0x7fbcb8072fa0 secure :-1 s=THROTTLE_DONE pgs=1205 cs=0 l=1 rx=0x7fbca000f740 tx=0x7fbca000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.408+0000 7fbcb5d9b700 1 -- 172.21.15.80:0/1860662656 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca0000c90 con 0x7fbcb806c0a0 2019-11-28T11:37:14.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.408+0000 7fbcb5d9b700 1 -- 172.21.15.80:0/1860662656 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbca0007210 con 0x7fbcb806c0a0 2019-11-28T11:37:14.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.408+0000 7fbcbcad3700 1 -- 172.21.15.80:0/1860662656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcb806c0a0 msgr2=0x7fbcb8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.408+0000 7fbcbcad3700 1 --2- 172.21.15.80:0/1860662656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcb806c0a0 0x7fbcb8072fa0 secure :-1 s=READY pgs=1205 cs=0 l=1 rx=0x7fbca000f740 tx=0x7fbca000fae0).stop 2019-11-28T11:37:14.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.409+0000 7fbcbcad3700 1 -- 172.21.15.80:0/1860662656 shutdown_connections 2019-11-28T11:37:14.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.409+0000 7fbcbcad3700 1 --2- 172.21.15.80:0/1860662656 >> v2:172.21.15.174:3300/0 conn(0x7fbcb80734e0 0x7fbcb8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:14.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.409+0000 7fbcbcad3700 1 --2- 172.21.15.80:0/1860662656 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcb806c0a0 0x7fbcb8072fa0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:14.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.409+0000 7fbcbcad3700 1 -- 172.21.15.80:0/1860662656 shutdown_connections 2019-11-28T11:37:14.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.409+0000 7fbcbcad3700 1 -- 172.21.15.80:0/1860662656 wait complete. 2019-11-28T11:37:14.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.409+0000 7fbcbcad3700 1 -- 172.21.15.80:0/1860662656 >> 172.21.15.80:0/1860662656 conn(0x7fbcb8061cf0 msgr2=0x7fbcb8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:14.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.411+0000 7fbcbcad3700 1 Processor -- start 2019-11-28T11:37:14.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.411+0000 7fbcbcad3700 1 -- start start 2019-11-28T11:37:14.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcbcad3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbcb813e9e0 0x7fbcb8108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:14.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcbcad3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbcb8109430 0x7fbcb81098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:14.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcbcad3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb81066e0 con 0x7fbcb813e5f0 2019-11-28T11:37:14.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcbcad3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb810e060 con 0x7fbcb813e9e0 2019-11-28T11:37:14.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcbcad3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb810e330 con 0x7fbcb8109430 2019-11-28T11:37:14.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcb6d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbcb813e5f0 0x7fbcb810a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36602/0 (socket says 172.21.15.80:36602) 2019-11-28T11:37:14.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcb6d9d700 1 -- 172.21.15.80:0/797763829 learned_addr learned my addr 172.21.15.80:0/797763829 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:14.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcb659c700 1 --2- 172.21.15.80:0/797763829 >> v2:172.21.15.174:3300/0 conn(0x7fbcb813e9e0 0x7fbcb8108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:14.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcb759e700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbcb8109430 0x7fbcb81098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:14.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcaf7fe700 1 -- 172.21.15.80:0/797763829 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542234975 0 0) 0x7fbca00075d0 con 0x7fbcb813e5f0 2019-11-28T11:37:14.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcaf7fe700 1 -- 172.21.15.80:0/797763829 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc90002e80 con 0x7fbcb813e5f0 2019-11-28T11:37:14.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcb659c700 1 -- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbcb8109430 msgr2=0x7fbcb81098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcb659c700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbcb8109430 0x7fbcb81098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:14.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcb659c700 1 -- 172.21.15.80:0/797763829 >> v1:172.21.15.80:6789/0 conn(0x7fbcb813e5f0 legacy=0x7fbcb810a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcaf7fe700 1 -- 172.21.15.80:0/797763829 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1075750971 0 0) 0x7fbca0007da0 con 0x7fbcb813e5f0 2019-11-28T11:37:14.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcb659c700 1 -- 172.21.15.80:0/797763829 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb810e9c0 con 0x7fbcb813e9e0 2019-11-28T11:37:14.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcb759e700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbcb8109430 0x7fbcb81098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:37:14.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.412+0000 7fbcb659c700 1 --2- 172.21.15.80:0/797763829 >> v2:172.21.15.174:3300/0 conn(0x7fbcb813e9e0 0x7fbcb8108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbca80106d0 tx=0x7fbca8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.413+0000 7fbcb659c700 1 --2- 172.21.15.80:0/797763829 >> v2:172.21.15.174:3300/0 conn(0x7fbcb813e9e0 0x7fbcb8108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbca80106d0 tx=0x7fbca8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.413+0000 7fbcb659c700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcb813e9e0 0x7fbcb8108ef0 secure :-1 s=READY pgs=714 cs=0 l=1 rx=0x7fbca80106d0 tx=0x7fbca8010a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:14.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.413+0000 7fbcb659c700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcb813e9e0 0x7fbcb8108ef0 secure :-1 s=THROTTLE_DONE pgs=714 cs=0 l=1 rx=0x7fbca80106d0 tx=0x7fbca8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.413+0000 7fbcaf7fe700 1 -- 172.21.15.80:0/797763829 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbca8009b20 con 0x7fbcb813e9e0 2019-11-28T11:37:14.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.413+0000 7fbcb659c700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcb813e9e0 0x7fbcb8108ef0 secure :-1 s=THROTTLE_DONE pgs=714 cs=0 l=1 rx=0x7fbca80106d0 tx=0x7fbca8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.413+0000 7fbcaf7fe700 1 -- 172.21.15.80:0/797763829 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca8000f40 con 0x7fbcb813e9e0 2019-11-28T11:37:14.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.413+0000 7fbcb659c700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcb813e9e0 0x7fbcb8108ef0 secure :-1 s=THROTTLE_DONE pgs=714 cs=0 l=1 rx=0x7fbca80106d0 tx=0x7fbca8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.413+0000 7fbcbcad3700 1 -- 172.21.15.80:0/797763829 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb810ed40 con 0x7fbcb813e9e0 2019-11-28T11:37:14.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.413+0000 7fbcaf7fe700 1 -- 172.21.15.80:0/797763829 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbca8001610 con 0x7fbcb813e9e0 2019-11-28T11:37:14.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.413+0000 7fbcbcad3700 1 -- 172.21.15.80:0/797763829 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb810e9c0 con 0x7fbcb813e9e0 2019-11-28T11:37:14.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.413+0000 7fbcb659c700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcb813e9e0 0x7fbcb8108ef0 secure :-1 s=THROTTLE_DONE pgs=714 cs=0 l=1 rx=0x7fbca80106d0 tx=0x7fbca8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.413+0000 7fbcaf7fe700 1 -- 172.21.15.80:0/797763829 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbca8001130 con 0x7fbcb813e9e0 2019-11-28T11:37:14.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.413+0000 7fbcb659c700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcb813e9e0 0x7fbcb8108ef0 secure :-1 s=THROTTLE_DONE pgs=714 cs=0 l=1 rx=0x7fbca80106d0 tx=0x7fbca8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.413+0000 7fbcaf7fe700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc90018770 0x7fbc9001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:14.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.413+0000 7fbcaf7fe700 1 -- 172.21.15.80:0/797763829 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fbca8031dc0 con 0x7fbcb813e9e0 2019-11-28T11:37:14.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.414+0000 7fbcb6d9d700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc90018770 0x7fbc9001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:14.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.414+0000 7fbcb6d9d700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc90018770 0x7fbc9001abe0 crc :-1 s=READY pgs=490 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:14.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.421+0000 7fbcbcad3700 1 -- 172.21.15.80:0/797763829 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb810ed40 con 0x7fbcb813e9e0 2019-11-28T11:37:14.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.425+0000 7fbcb659c700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcb813e9e0 0x7fbcb8108ef0 secure :-1 s=THROTTLE_DONE pgs=714 cs=0 l=1 rx=0x7fbca80106d0 tx=0x7fbca8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.425+0000 7fbcaf7fe700 1 -- 172.21.15.80:0/797763829 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbca8030650 con 0x7fbcb813e9e0 2019-11-28T11:37:14.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.597+0000 7fbcbcad3700 1 -- 172.21.15.80:0/797763829 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbcb810e9c0 con 0x7fbcb813e9e0 2019-11-28T11:37:14.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.598+0000 7fbcb659c700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcb813e9e0 0x7fbcb8108ef0 secure :-1 s=THROTTLE_DONE pgs=714 cs=0 l=1 rx=0x7fbca80106d0 tx=0x7fbca8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:14.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.598+0000 7fbcaf7fe700 1 -- 172.21.15.80:0/797763829 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+2442 (secure 0 0 0) 0x7fbca8030650 con 0x7fbcb813e9e0 2019-11-28T11:37:14.662 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 60 2019-11-28T11:37:14.662 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:37:14.662 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1620047617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1620047617},{"type":"v1","addr":"172.21.15.80:6834","nonce":1620047617}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":58},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/612359803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":612359803},{"type":"v1","addr":"172.21.15.80:6835","nonce":612359803}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":58}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:37:11.301943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7108},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7108":{"gid":7108,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/775911718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":775911718},{"type":"v1","addr":"172.21.15.174:6835","nonce":775911718}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:37:14.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.600+0000 7fbcbcad3700 1 -- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc90018770 msgr2=0x7fbc9001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.600+0000 7fbcbcad3700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc90018770 0x7fbc9001abe0 crc :-1 s=READY pgs=490 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:14.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.600+0000 7fbcbcad3700 1 -- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcb813e9e0 msgr2=0x7fbcb8108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:14.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.600+0000 7fbcbcad3700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcb813e9e0 0x7fbcb8108ef0 secure :-1 s=READY pgs=714 cs=0 l=1 rx=0x7fbca80106d0 tx=0x7fbca8010a70).stop 2019-11-28T11:37:14.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.600+0000 7fbcbcad3700 1 -- 172.21.15.80:0/797763829 shutdown_connections 2019-11-28T11:37:14.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.600+0000 7fbcbcad3700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc90018770 0x7fbc9001abe0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:14.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.600+0000 7fbcbcad3700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbcb8109430 0x7fbcb81098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:14.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.600+0000 7fbcbcad3700 1 --2- 172.21.15.80:0/797763829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcb813e9e0 0x7fbcb8108ef0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:14.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.600+0000 7fbcbcad3700 1 -- 172.21.15.80:0/797763829 shutdown_connections 2019-11-28T11:37:14.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.600+0000 7fbcbcad3700 1 -- 172.21.15.80:0/797763829 wait complete. 2019-11-28T11:37:14.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:14.600+0000 7fbcbcad3700 1 -- 172.21.15.80:0/797763829 >> 172.21.15.80:0/797763829 conn(0x7fbcb813d620 msgr2=0x7fbcb813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:14.974 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7108}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 14, u'failed': [], u'epoch': 60, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [15], u'info': {u'gid_7108': {u'export_targets': [], u'name': u'c', u'incarnation': 59, u'state_seq': 3, u'state': u'up:active', u'gid': 7108, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 775911718, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 775911718, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/775911718'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:37:03.205339+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:37:11.301943+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:37:14.974 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:37:14.975 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:37:15.104 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:37:15.104 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:37:15.104 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:37:15.104 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 7108, 2019-11-28T11:37:15.104 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:37:15.104 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:37:15.105 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 4.7389758669999997, 2019-11-28T11:37:15.105 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 60, 2019-11-28T11:37:15.105 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 93, 2019-11-28T11:37:15.105 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 93, 2019-11-28T11:37:15.105 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 9.0178961169999994 2019-11-28T11:37:15.105 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:37:15.113 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7108, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.7389758669999997, "mdsmap_epoch": 60, "osdmap_epoch": 93, "osdmap_epoch_barrier": 93, "uptime": 9.0178961169999994 } 2019-11-28T11:37:15.113 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:37:15.114 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:37:15.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:37:15.114 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:37:15.196 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:37:15.196 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:37:15.484 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:37:15.484 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:37:15.600 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:37:15.600 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:37:15.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:37:15.601 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:37:15.672 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:37:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.739+0000 7feffc0ae700 1 Processor -- start 2019-11-28T11:37:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.739+0000 7feffc0ae700 1 -- start start 2019-11-28T11:37:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffc0ae700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7feff406c490 0x7feff406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffc0ae700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feff406ce60 0x7feff4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:15.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffc0ae700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff406db00 con 0x7feff406c0a0 2019-11-28T11:37:15.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffc0ae700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff406fd60 con 0x7feff406ce60 2019-11-28T11:37:15.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffc0ae700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff4070030 con 0x7feff406c490 2019-11-28T11:37:15.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffae4c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feff406ce60 0x7feff4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:15.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffae4c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feff406ce60 0x7feff4164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37294/0 (socket says 172.21.15.80:37294) 2019-11-28T11:37:15.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffae4c700 1 -- 172.21.15.80:0/3910621645 learned_addr learned my addr 172.21.15.80:0/3910621645 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:15.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffae4c700 1 -- 172.21.15.80:0/3910621645 >> v2:172.21.15.174:3300/0 conn(0x7feff406c490 msgr2=0x7feff406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:15.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffae4c700 1 --2- 172.21.15.80:0/3910621645 >> v2:172.21.15.174:3300/0 conn(0x7feff406c490 0x7feff406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:15.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffae4c700 1 -- 172.21.15.80:0/3910621645 >> v1:172.21.15.174:6789/0 conn(0x7feff406c0a0 legacy=0x7feff4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:15.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffae4c700 1 -- 172.21.15.80:0/3910621645 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff40706c0 con 0x7feff406ce60 2019-11-28T11:37:15.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffae4c700 1 --2- 172.21.15.80:0/3910621645 >> v2:172.21.15.80:3300/0 conn(0x7feff406ce60 0x7feff4164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fefec00f730 tx=0x7fefec007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:15.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffae4c700 1 --2- 172.21.15.80:0/3910621645 >> v2:172.21.15.80:3300/0 conn(0x7feff406ce60 0x7feff4164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fefec00f730 tx=0x7fefec007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:15.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffae4c700 1 --2- 172.21.15.80:0/3910621645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feff406ce60 0x7feff4164d70 secure :-1 s=READY pgs=1208 cs=0 l=1 rx=0x7fefec00f730 tx=0x7fefec007d50).ready entity=mon.0 client_cookie=4d4b3103d1d393b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:15.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffae4c700 1 --2- 172.21.15.80:0/3910621645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feff406ce60 0x7feff4164d70 secure :-1 s=THROTTLE_DONE pgs=1208 cs=0 l=1 rx=0x7fefec00f730 tx=0x7fefec007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:15.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feff9649700 1 -- 172.21.15.80:0/3910621645 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefec000a70 con 0x7feff406ce60 2019-11-28T11:37:15.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffae4c700 1 --2- 172.21.15.80:0/3910621645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feff406ce60 0x7feff4164d70 secure :-1 s=THROTTLE_DONE pgs=1208 cs=0 l=1 rx=0x7fefec00f730 tx=0x7fefec007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:15.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feffae4c700 1 --2- 172.21.15.80:0/3910621645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feff406ce60 0x7feff4164d70 secure :-1 s=THROTTLE_DONE pgs=1208 cs=0 l=1 rx=0x7fefec00f730 tx=0x7fefec007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:15.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feff9649700 1 -- 172.21.15.80:0/3910621645 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec000a70 con 0x7feff406ce60 2019-11-28T11:37:15.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.741+0000 7feff9649700 1 -- 172.21.15.80:0/3910621645 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefec0012d0 con 0x7feff406ce60 2019-11-28T11:37:15.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.742+0000 7feffc0ae700 1 -- 172.21.15.80:0/3910621645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feff406ce60 msgr2=0x7feff4164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:15.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.742+0000 7feffc0ae700 1 --2- 172.21.15.80:0/3910621645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feff406ce60 0x7feff4164d70 secure :-1 s=READY pgs=1208 cs=0 l=1 rx=0x7fefec00f730 tx=0x7fefec007d50).stop 2019-11-28T11:37:15.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.742+0000 7feffc0ae700 1 -- 172.21.15.80:0/3910621645 shutdown_connections 2019-11-28T11:37:15.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.742+0000 7feffc0ae700 1 --2- 172.21.15.80:0/3910621645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feff406ce60 0x7feff4164d70 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:15.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.742+0000 7feffc0ae700 1 --2- 172.21.15.80:0/3910621645 >> v2:172.21.15.174:3300/0 conn(0x7feff406c490 0x7feff406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:15.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.742+0000 7feffc0ae700 1 -- 172.21.15.80:0/3910621645 shutdown_connections 2019-11-28T11:37:15.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.742+0000 7feffc0ae700 1 -- 172.21.15.80:0/3910621645 wait complete. 2019-11-28T11:37:15.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.742+0000 7feffc0ae700 1 -- 172.21.15.80:0/3910621645 >> 172.21.15.80:0/3910621645 conn(0x7feff4061cf0 msgr2=0x7feff4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:15.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.745+0000 7feffc0ae700 1 Processor -- start 2019-11-28T11:37:15.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.745+0000 7feffc0ae700 1 -- start start 2019-11-28T11:37:15.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feffc0ae700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7feff413dc00 0x7feff4109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:15.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feffc0ae700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feff410a3a0 0x7feff4108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:15.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feffc0ae700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff41312c0 con 0x7feff4109220 2019-11-28T11:37:15.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feffc0ae700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff4105830 con 0x7feff413dc00 2019-11-28T11:37:15.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feffc0ae700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff4105b00 con 0x7feff410a3a0 2019-11-28T11:37:15.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feffa64b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7feff413dc00 0x7feff4109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:15.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feffa64b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7feff413dc00 0x7feff4109e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:52184/0 (socket says 172.21.15.80:52184) 2019-11-28T11:37:15.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feffa64b700 1 -- 172.21.15.80:0/3965558222 learned_addr learned my addr 172.21.15.80:0/3965558222 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:15.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feff9e4a700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feff410a3a0 0x7feff4108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:15.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feff9e4a700 1 -- 172.21.15.80:0/3965558222 >> v2:172.21.15.174:3300/0 conn(0x7feff413dc00 msgr2=0x7feff4109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:15.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feff9e4a700 1 --2- 172.21.15.80:0/3965558222 >> v2:172.21.15.174:3300/0 conn(0x7feff413dc00 0x7feff4109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:15.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feff9e4a700 1 -- 172.21.15.80:0/3965558222 >> v1:172.21.15.174:6789/0 conn(0x7feff4109220 legacy=0x7feff4103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:15.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feff9e4a700 1 -- 172.21.15.80:0/3965558222 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff4106190 con 0x7feff410a3a0 2019-11-28T11:37:15.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feffa64b700 1 --2- 172.21.15.80:0/3965558222 >> v2:172.21.15.174:3300/0 conn(0x7feff413dc00 0x7feff4109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:37:15.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feff2ffd700 1 -- 172.21.15.80:0/3965558222 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382226403 0 0) 0x7fefec000940 con 0x7feff4109220 2019-11-28T11:37:15.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feff9e4a700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feff410a3a0 0x7feff4108ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fefe40103a0 tx=0x7fefe4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:15.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feff9e4a700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feff410a3a0 0x7feff4108ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fefe40103a0 tx=0x7fefe4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:15.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feff9e4a700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feff410a3a0 0x7feff4108ce0 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7fefe40103a0 tx=0x7fefe4010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:15.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feff9e4a700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feff410a3a0 0x7feff4108ce0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fefe40103a0 tx=0x7fefe4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:15.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feff2ffd700 1 -- 172.21.15.80:0/3965558222 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefe4007210 con 0x7feff410a3a0 2019-11-28T11:37:15.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feff9e4a700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feff410a3a0 0x7feff4108ce0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fefe40103a0 tx=0x7fefe4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:15.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feff9e4a700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feff410a3a0 0x7feff4108ce0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fefe40103a0 tx=0x7fefe4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:15.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feff2ffd700 1 -- 172.21.15.80:0/3965558222 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe4009980 con 0x7feff410a3a0 2019-11-28T11:37:15.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feffc0ae700 1 -- 172.21.15.80:0/3965558222 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff4106510 con 0x7feff410a3a0 2019-11-28T11:37:15.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.746+0000 7feff2ffd700 1 -- 172.21.15.80:0/3965558222 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefe4009b70 con 0x7feff410a3a0 2019-11-28T11:37:15.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.747+0000 7feffc0ae700 1 -- 172.21.15.80:0/3965558222 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff4106190 con 0x7feff410a3a0 2019-11-28T11:37:15.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.747+0000 7feff9e4a700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feff410a3a0 0x7feff4108ce0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fefe40103a0 tx=0x7fefe4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:15.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.747+0000 7feff2ffd700 1 -- 172.21.15.80:0/3965558222 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fefe4009b70 con 0x7feff410a3a0 2019-11-28T11:37:15.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.747+0000 7feff9e4a700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feff410a3a0 0x7feff4108ce0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fefe40103a0 tx=0x7fefe4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:15.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.747+0000 7feff2ffd700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fefd8018730 0x7fefd801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:15.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.747+0000 7feff2ffd700 1 -- 172.21.15.80:0/3965558222 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fefe40319c0 con 0x7feff410a3a0 2019-11-28T11:37:15.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.747+0000 7feffa64b700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fefd8018730 0x7fefd801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:15.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.748+0000 7feffa64b700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fefd8018730 0x7fefd801abc0 crc :-1 s=READY pgs=491 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:15.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.755+0000 7feffc0ae700 1 -- 172.21.15.80:0/3965558222 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff4106510 con 0x7feff410a3a0 2019-11-28T11:37:15.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.758+0000 7feff9e4a700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feff410a3a0 0x7feff4108ce0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fefe40103a0 tx=0x7fefe4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:15.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.759+0000 7feff2ffd700 1 -- 172.21.15.80:0/3965558222 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fefe4009580 con 0x7feff410a3a0 2019-11-28T11:37:15.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.935+0000 7feffc0ae700 1 -- 172.21.15.80:0/3965558222 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feff4106190 con 0x7feff410a3a0 2019-11-28T11:37:15.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.936+0000 7feff9e4a700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feff410a3a0 0x7feff4108ce0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fefe40103a0 tx=0x7fefe4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:15.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.936+0000 7feff2ffd700 1 -- 172.21.15.80:0/3965558222 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+14860 (secure 0 0 0) 0x7fefe4009b70 con 0x7feff410a3a0 2019-11-28T11:37:16.000 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:37:16.000 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":93,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:37:05.208345+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:37:01.482997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2019-11-28T11:37:02.223344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:37:16.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.940+0000 7feffc0ae700 1 -- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fefd8018730 msgr2=0x7fefd801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.940+0000 7feffc0ae700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fefd8018730 0x7fefd801abc0 crc :-1 s=READY pgs=491 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.940+0000 7feffc0ae700 1 -- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feff410a3a0 msgr2=0x7feff4108ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.940+0000 7feffc0ae700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feff410a3a0 0x7feff4108ce0 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7fefe40103a0 tx=0x7fefe4010740).stop 2019-11-28T11:37:16.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.940+0000 7feffc0ae700 1 -- 172.21.15.80:0/3965558222 shutdown_connections 2019-11-28T11:37:16.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.940+0000 7feffc0ae700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fefd8018730 0x7fefd801abc0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.940+0000 7feffc0ae700 1 --2- 172.21.15.80:0/3965558222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feff410a3a0 0x7feff4108ce0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.940+0000 7feffc0ae700 1 --2- 172.21.15.80:0/3965558222 >> v2:172.21.15.174:3300/0 conn(0x7feff413dc00 0x7feff4109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.940+0000 7feffc0ae700 1 -- 172.21.15.80:0/3965558222 shutdown_connections 2019-11-28T11:37:16.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.940+0000 7feffc0ae700 1 -- 172.21.15.80:0/3965558222 wait complete. 2019-11-28T11:37:16.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:15.940+0000 7feffc0ae700 1 -- 172.21.15.80:0/3965558222 >> 172.21.15.80:0/3965558222 conn(0x7feff411bfc0 msgr2=0x7feff4141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:16.013 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:37:01.482997+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 14, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'92', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:37:02.223344+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 15, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'93', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:37:16.014 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:37:16.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.077+0000 7fe0f8250700 1 Processor -- start 2019-11-28T11:37:16.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.077+0000 7fe0f8250700 1 -- start start 2019-11-28T11:37:16.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.078+0000 7fe0f8250700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe0f015f100 0x7fe0f006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:16.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.078+0000 7fe0f8250700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f006db60 con 0x7fe0f006c2f0 2019-11-28T11:37:16.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.078+0000 7fe0f8250700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f006e060 con 0x7fe0f015ed10 2019-11-28T11:37:16.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.078+0000 7fe0f8250700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f006fe00 con 0x7fe0f015f100 2019-11-28T11:37:16.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.078+0000 7fe0f5fec700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe0f015f100 0x7fe0f006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.078+0000 7fe0f6fee700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe0f006c2f0 0x7fe0f006c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36624/0 (socket says 172.21.15.80:36624) 2019-11-28T11:37:16.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.078+0000 7fe0f6fee700 1 -- 172.21.15.80:0/949942719 learned_addr learned my addr 172.21.15.80:0/949942719 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:16.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.079+0000 7fe0f5fec700 1 -- 172.21.15.80:0/949942719 >> v1:172.21.15.174:6789/0 conn(0x7fe0f015ed10 legacy=0x7fe0f0073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.079+0000 7fe0f5fec700 1 -- 172.21.15.80:0/949942719 >> v1:172.21.15.80:6789/0 conn(0x7fe0f006c2f0 legacy=0x7fe0f006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.079+0000 7fe0f57eb700 1 -- 172.21.15.80:0/949942719 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549527221 0 0) 0x7fe0e8001150 con 0x7fe0f006c2f0 2019-11-28T11:37:16.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.079+0000 7fe0f5fec700 1 -- 172.21.15.80:0/949942719 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f0070760 con 0x7fe0f015f100 2019-11-28T11:37:16.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.079+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/949942719 >> v2:172.21.15.80:3300/0 conn(0x7fe0f015f100 0x7fe0f006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe0d800b2d0 tx=0x7fe0d800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.079+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/949942719 >> v2:172.21.15.80:3300/0 conn(0x7fe0f015f100 0x7fe0f006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe0d800b2d0 tx=0x7fe0d800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.079+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/949942719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f015f100 0x7fe0f006bdb0 secure :-1 s=READY pgs=1210 cs=0 l=1 rx=0x7fe0d800b2d0 tx=0x7fe0d800bae0).ready entity=mon.0 client_cookie=c72de4ea8f6b8815 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:16.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.079+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/949942719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f015f100 0x7fe0f006bdb0 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7fe0d800b2d0 tx=0x7fe0d800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.079+0000 7fe0f57eb700 1 -- 172.21.15.80:0/949942719 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0d8000ce0 con 0x7fe0f015f100 2019-11-28T11:37:16.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.079+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/949942719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f015f100 0x7fe0f006bdb0 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7fe0d800b2d0 tx=0x7fe0d800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.079+0000 7fe0f57eb700 1 -- 172.21.15.80:0/949942719 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d8000ce0 con 0x7fe0f015f100 2019-11-28T11:37:16.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.079+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/949942719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f015f100 0x7fe0f006bdb0 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7fe0d800b2d0 tx=0x7fe0d800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.079+0000 7fe0f57eb700 1 -- 172.21.15.80:0/949942719 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0d800a060 con 0x7fe0f015f100 2019-11-28T11:37:16.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.079+0000 7fe0f8250700 1 -- 172.21.15.80:0/949942719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f015f100 msgr2=0x7fe0f006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.079+0000 7fe0f8250700 1 --2- 172.21.15.80:0/949942719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f015f100 0x7fe0f006bdb0 secure :-1 s=READY pgs=1210 cs=0 l=1 rx=0x7fe0d800b2d0 tx=0x7fe0d800bae0).stop 2019-11-28T11:37:16.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.080+0000 7fe0f8250700 1 -- 172.21.15.80:0/949942719 shutdown_connections 2019-11-28T11:37:16.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.080+0000 7fe0f8250700 1 --2- 172.21.15.80:0/949942719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f015f100 0x7fe0f006bdb0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.080+0000 7fe0f8250700 1 -- 172.21.15.80:0/949942719 shutdown_connections 2019-11-28T11:37:16.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.080+0000 7fe0f8250700 1 -- 172.21.15.80:0/949942719 wait complete. 2019-11-28T11:37:16.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.080+0000 7fe0f8250700 1 -- 172.21.15.80:0/949942719 >> 172.21.15.80:0/949942719 conn(0x7fe0f0061d20 msgr2=0x7fe0f00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:16.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.082+0000 7fe0f8250700 1 Processor -- start 2019-11-28T11:37:16.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.082+0000 7fe0f8250700 1 -- start start 2019-11-28T11:37:16.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.083+0000 7fe0f8250700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0f0148320 0x7fe0f010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:16.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.083+0000 7fe0f8250700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe0f010f290 0x7fe0f010dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:16.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.083+0000 7fe0f8250700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe0f010e110 0x7fe0f010e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:16.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.083+0000 7fe0f8250700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f0139ff0 con 0x7fe0f010f290 2019-11-28T11:37:16.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.083+0000 7fe0f8250700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f013aa20 con 0x7fe0f010e110 2019-11-28T11:37:16.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.083+0000 7fe0f8250700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f010c490 con 0x7fe0f0148320 2019-11-28T11:37:16.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.083+0000 7fe0f5fec700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe0f010f290 0x7fe0f010dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.083+0000 7fe0f5fec700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe0f010f290 0x7fe0f010dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37314/0 (socket says 172.21.15.80:37314) 2019-11-28T11:37:16.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.083+0000 7fe0f5fec700 1 -- 172.21.15.80:0/980053592 learned_addr learned my addr 172.21.15.80:0/980053592 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:16.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0f5fec700 1 -- 172.21.15.80:0/980053592 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0f0148320 msgr2=0x7fe0f010ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0f0148320 0x7fe0f010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0f5fec700 1 -- 172.21.15.80:0/980053592 >> v2:172.21.15.174:3300/0 conn(0x7fe0f010e110 msgr2=0x7fe0f010e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0f6fee700 1 --2- 172.21.15.80:0/980053592 >> v2:172.21.15.174:3300/0 conn(0x7fe0f010e110 0x7fe0f010e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/980053592 >> v2:172.21.15.174:3300/0 conn(0x7fe0f010e110 0x7fe0f010e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0f5fec700 1 -- 172.21.15.80:0/980053592 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f010c810 con 0x7fe0f010f290 2019-11-28T11:37:16.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/980053592 >> v2:172.21.15.80:3300/0 conn(0x7fe0f010f290 0x7fe0f010dbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0d8010710 tx=0x7fe0d8010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/980053592 >> v2:172.21.15.80:3300/0 conn(0x7fe0f010f290 0x7fe0f010dbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0d8010710 tx=0x7fe0d8010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f010f290 0x7fe0f010dbd0 secure :-1 s=READY pgs=1211 cs=0 l=1 rx=0x7fe0d8010710 tx=0x7fe0d8010640).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:16.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f010f290 0x7fe0f010dbd0 secure :-1 s=THROTTLE_DONE pgs=1211 cs=0 l=1 rx=0x7fe0d8010710 tx=0x7fe0d8010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f010f290 0x7fe0f010dbd0 secure :-1 s=THROTTLE_DONE pgs=1211 cs=0 l=1 rx=0x7fe0d8010710 tx=0x7fe0d8010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0eeffd700 1 -- 172.21.15.80:0/980053592 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0d8000cc0 con 0x7fe0f010f290 2019-11-28T11:37:16.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f010f290 0x7fe0f010dbd0 secure :-1 s=THROTTLE_DONE pgs=1211 cs=0 l=1 rx=0x7fe0d8010710 tx=0x7fe0d8010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0eeffd700 1 -- 172.21.15.80:0/980053592 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d8009d00 con 0x7fe0f010f290 2019-11-28T11:37:16.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0f8250700 1 -- 172.21.15.80:0/980053592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f010c810 con 0x7fe0f010f290 2019-11-28T11:37:16.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0eeffd700 1 -- 172.21.15.80:0/980053592 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0d800a410 con 0x7fe0f010f290 2019-11-28T11:37:16.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0f8250700 1 -- 172.21.15.80:0/980053592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f010c810 con 0x7fe0f010f290 2019-11-28T11:37:16.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.084+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f010f290 0x7fe0f010dbd0 secure :-1 s=THROTTLE_DONE pgs=1211 cs=0 l=1 rx=0x7fe0d8010710 tx=0x7fe0d8010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.085+0000 7fe0eeffd700 1 -- 172.21.15.80:0/980053592 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe0d8009ef0 con 0x7fe0f010f290 2019-11-28T11:37:16.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.085+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f010f290 0x7fe0f010dbd0 secure :-1 s=THROTTLE_DONE pgs=1211 cs=0 l=1 rx=0x7fe0d8010710 tx=0x7fe0d8010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.085+0000 7fe0eeffd700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe0d4018730 0x7fe0d401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:16.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.085+0000 7fe0eeffd700 1 -- 172.21.15.80:0/980053592 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe0d8031fd0 con 0x7fe0f010f290 2019-11-28T11:37:16.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.085+0000 7fe0f67ed700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe0d4018730 0x7fe0d401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.085+0000 7fe0f67ed700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe0d4018730 0x7fe0d401abc0 crc :-1 s=READY pgs=492 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:16.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.092+0000 7fe0f8250700 1 -- 172.21.15.80:0/980053592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f010c810 con 0x7fe0f010f290 2019-11-28T11:37:16.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.096+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f010f290 0x7fe0f010dbd0 secure :-1 s=THROTTLE_DONE pgs=1211 cs=0 l=1 rx=0x7fe0d8010710 tx=0x7fe0d8010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.096+0000 7fe0eeffd700 1 -- 172.21.15.80:0/980053592 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe0d8009900 con 0x7fe0f010f290 2019-11-28T11:37:16.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.264+0000 7fe0f8250700 1 -- 172.21.15.80:0/980053592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fe0f010c810 con 0x7fe0f010f290 2019-11-28T11:37:16.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.265+0000 7fe0f5fec700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f010f290 0x7fe0f010dbd0 secure :-1 s=THROTTLE_DONE pgs=1211 cs=0 l=1 rx=0x7fe0d8010710 tx=0x7fe0d8010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.265+0000 7fe0eeffd700 1 -- 172.21.15.80:0/980053592 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v93) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe0d8009d00 con 0x7fe0f010f290 2019-11-28T11:37:16.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.267+0000 7fe0f8250700 1 -- 172.21.15.80:0/980053592 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe0d4018730 msgr2=0x7fe0d401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.267+0000 7fe0f8250700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe0d4018730 0x7fe0d401abc0 crc :-1 s=READY pgs=492 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.267+0000 7fe0f8250700 1 -- 172.21.15.80:0/980053592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f010f290 msgr2=0x7fe0f010dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.267+0000 7fe0f8250700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f010f290 0x7fe0f010dbd0 secure :-1 s=READY pgs=1211 cs=0 l=1 rx=0x7fe0d8010710 tx=0x7fe0d8010640).stop 2019-11-28T11:37:16.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.267+0000 7fe0f8250700 1 -- 172.21.15.80:0/980053592 shutdown_connections 2019-11-28T11:37:16.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.267+0000 7fe0f8250700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe0d4018730 0x7fe0d401abc0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.267+0000 7fe0f8250700 1 --2- 172.21.15.80:0/980053592 >> v2:172.21.15.174:3300/0 conn(0x7fe0f010e110 0x7fe0f010e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.267+0000 7fe0f8250700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0f010f290 0x7fe0f010dbd0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.267+0000 7fe0f8250700 1 --2- 172.21.15.80:0/980053592 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0f0148320 0x7fe0f010ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.267+0000 7fe0f8250700 1 -- 172.21.15.80:0/980053592 shutdown_connections 2019-11-28T11:37:16.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.267+0000 7fe0f8250700 1 -- 172.21.15.80:0/980053592 wait complete. 2019-11-28T11:37:16.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.267+0000 7fe0f8250700 1 -- 172.21.15.80:0/980053592 >> 172.21.15.80:0/980053592 conn(0x7fe0f015e2d0 msgr2=0x7fe0f0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:16.333 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:37:16.339 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:37:16.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.410+0000 7fcf8c4b5700 1 Processor -- start 2019-11-28T11:37:16.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.410+0000 7fcf8c4b5700 1 -- start start 2019-11-28T11:37:16.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.411+0000 7fcf8c4b5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf8415f100 0x7fcf8406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:16.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.411+0000 7fcf8c4b5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcf8406c2f0 0x7fcf8406c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:16.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.411+0000 7fcf8c4b5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf8406db60 con 0x7fcf8415ed10 2019-11-28T11:37:16.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.411+0000 7fcf8c4b5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8406fe00 con 0x7fcf8406c2f0 2019-11-28T11:37:16.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.411+0000 7fcf8c4b5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840700d0 con 0x7fcf8415f100 2019-11-28T11:37:16.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.411+0000 7fcf8aa52700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcf8415ed10 0x7fcf84073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36636/0 (socket says 172.21.15.80:36636) 2019-11-28T11:37:16.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.411+0000 7fcf8aa52700 1 -- 172.21.15.80:0/3603306721 learned_addr learned my addr 172.21.15.80:0/3603306721 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:16.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.411+0000 7fcf8b253700 1 --2- 172.21.15.80:0/3603306721 >> v2:172.21.15.174:3300/0 conn(0x7fcf8406c2f0 0x7fcf8406c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.411+0000 7fcf8a251700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf8415f100 0x7fcf8406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.411+0000 7fcf89a50700 1 -- 172.21.15.80:0/3603306721 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306402348 0 0) 0x7fcf80001150 con 0x7fcf8415ed10 2019-11-28T11:37:16.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.411+0000 7fcf89a50700 1 -- 172.21.15.80:0/3603306721 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf70002e80 con 0x7fcf8415ed10 2019-11-28T11:37:16.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 -- 172.21.15.80:0/3603306721 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2080176004 0 0) 0x7fcf80001130 con 0x7fcf8415ed10 2019-11-28T11:37:16.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 -- 172.21.15.80:0/3603306721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf8415f100 msgr2=0x7fcf8406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:16.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf8415f100 0x7fcf8406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:16.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 -- 172.21.15.80:0/3603306721 >> v2:172.21.15.174:3300/0 conn(0x7fcf8406c2f0 msgr2=0x7fcf8406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:16.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 --2- 172.21.15.80:0/3603306721 >> v2:172.21.15.174:3300/0 conn(0x7fcf8406c2f0 0x7fcf8406c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:16.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 -- 172.21.15.80:0/3603306721 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf84070760 con 0x7fcf8415ed10 2019-11-28T11:37:16.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 -- 172.21.15.80:0/3603306721 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fcf80001660 con 0x7fcf8415ed10 2019-11-28T11:37:16.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 -- 172.21.15.80:0/3603306721 >> v1:172.21.15.80:6789/0 conn(0x7fcf8415ed10 legacy=0x7fcf84073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf700479e0 0x7fcf70049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:16.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7004a5a0 0x7fcf7004ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:16.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf7004d270 0x7fcf7004f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:16.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 -- 172.21.15.80:0/3603306721 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7004ff50 con 0x7fcf7004a5a0 2019-11-28T11:37:16.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 -- 172.21.15.80:0/3603306721 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf70050140 con 0x7fcf7004d270 2019-11-28T11:37:16.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 -- 172.21.15.80:0/3603306721 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf70050370 con 0x7fcf700479e0 2019-11-28T11:37:16.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf8a251700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7004a5a0 0x7fcf7004ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf8aa52700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf700479e0 0x7fcf70049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf8b253700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf7004d270 0x7fcf7004f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf8a251700 1 -- 172.21.15.80:0/3603306721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf700479e0 msgr2=0x7fcf70049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:16.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf8a251700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf700479e0 0x7fcf70049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:16.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf8a251700 1 -- 172.21.15.80:0/3603306721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf7004d270 msgr2=0x7fcf7004f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:16.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf8a251700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf7004d270 0x7fcf7004f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:16.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf8a251700 1 -- 172.21.15.80:0/3603306721 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf70050620 con 0x7fcf7004a5a0 2019-11-28T11:37:16.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf8a251700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7004a5a0 0x7fcf7004ca70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcf7400afa0 tx=0x7fcf7400b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf8a251700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7004a5a0 0x7fcf7004ca70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcf7400afa0 tx=0x7fcf7400b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf8a251700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7004a5a0 0x7fcf7004ca70 secure :-1 s=READY pgs=1213 cs=0 l=1 rx=0x7fcf7400afa0 tx=0x7fcf7400b300).ready entity=mon.0 client_cookie=78f5dba4c678b104 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:16.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf8a251700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7004a5a0 0x7fcf7004ca70 secure :-1 s=THROTTLE_DONE pgs=1213 cs=0 l=1 rx=0x7fcf7400afa0 tx=0x7fcf7400b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf8a251700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7004a5a0 0x7fcf7004ca70 secure :-1 s=THROTTLE_DONE pgs=1213 cs=0 l=1 rx=0x7fcf7400afa0 tx=0x7fcf7400b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 -- 172.21.15.80:0/3603306721 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf74000960 con 0x7fcf7004a5a0 2019-11-28T11:37:16.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf8a251700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7004a5a0 0x7fcf7004ca70 secure :-1 s=THROTTLE_DONE pgs=1213 cs=0 l=1 rx=0x7fcf7400afa0 tx=0x7fcf7400b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 -- 172.21.15.80:0/3603306721 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf74008a70 con 0x7fcf7004a5a0 2019-11-28T11:37:16.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.412+0000 7fcf89a50700 1 -- 172.21.15.80:0/3603306721 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf740091a0 con 0x7fcf7004a5a0 2019-11-28T11:37:16.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.413+0000 7fcf8c4b5700 1 -- 172.21.15.80:0/3603306721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7004a5a0 msgr2=0x7fcf7004ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.413+0000 7fcf8c4b5700 1 --2- 172.21.15.80:0/3603306721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf7004a5a0 0x7fcf7004ca70 secure :-1 s=READY pgs=1213 cs=0 l=1 rx=0x7fcf7400afa0 tx=0x7fcf7400b300).stop 2019-11-28T11:37:16.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.413+0000 7fcf8b253700 1 -- 172.21.15.80:0/3603306721 reap_dead start 2019-11-28T11:37:16.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.413+0000 7fcf8c4b5700 1 -- 172.21.15.80:0/3603306721 shutdown_connections 2019-11-28T11:37:16.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.413+0000 7fcf8c4b5700 1 -- 172.21.15.80:0/3603306721 shutdown_connections 2019-11-28T11:37:16.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.413+0000 7fcf8c4b5700 1 -- 172.21.15.80:0/3603306721 wait complete. 2019-11-28T11:37:16.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.413+0000 7fcf8c4b5700 1 -- 172.21.15.80:0/3603306721 >> 172.21.15.80:0/3603306721 conn(0x7fcf84061d20 msgr2=0x7fcf840641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:16.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.416+0000 7fcf8c4b5700 1 Processor -- start 2019-11-28T11:37:16.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.416+0000 7fcf8c4b5700 1 -- start start 2019-11-28T11:37:16.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8c4b5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcf84108630 0x7fcf84152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:16.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8c4b5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf8412caa0 0x7fcf841510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:16.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8c4b5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf8410a310 con 0x7fcf841527a0 2019-11-28T11:37:16.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8c4b5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8412ee80 con 0x7fcf84108630 2019-11-28T11:37:16.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8c4b5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf841329f0 con 0x7fcf8412caa0 2019-11-28T11:37:16.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8a251700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcf841527a0 0x7fcf8412c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36650/0 (socket says 172.21.15.80:36650) 2019-11-28T11:37:16.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8a251700 1 -- 172.21.15.80:0/2958208243 learned_addr learned my addr 172.21.15.80:0/2958208243 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:16.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8aa52700 1 --2- 172.21.15.80:0/2958208243 >> v2:172.21.15.174:3300/0 conn(0x7fcf84108630 0x7fcf84152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8b253700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf8412caa0 0x7fcf841510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf7b7fe700 1 -- 172.21.15.80:0/2958208243 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864923974 0 0) 0x7fcf740098a0 con 0x7fcf841527a0 2019-11-28T11:37:16.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf7b7fe700 1 -- 172.21.15.80:0/2958208243 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf6c002e80 con 0x7fcf841527a0 2019-11-28T11:37:16.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8aa52700 1 -- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf8412caa0 msgr2=0x7fcf841510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8aa52700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf8412caa0 0x7fcf841510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8aa52700 1 -- 172.21.15.80:0/2958208243 >> v1:172.21.15.80:6789/0 conn(0x7fcf841527a0 legacy=0x7fcf8412c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8aa52700 1 -- 172.21.15.80:0/2958208243 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf84133350 con 0x7fcf84108630 2019-11-28T11:37:16.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8aa52700 1 --2- 172.21.15.80:0/2958208243 >> v2:172.21.15.174:3300/0 conn(0x7fcf84108630 0x7fcf84152260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcf80010380 tx=0x7fcf80010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8aa52700 1 --2- 172.21.15.80:0/2958208243 >> v2:172.21.15.174:3300/0 conn(0x7fcf84108630 0x7fcf84152260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcf80010380 tx=0x7fcf80010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8aa52700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf84108630 0x7fcf84152260 secure :-1 s=READY pgs=717 cs=0 l=1 rx=0x7fcf80010380 tx=0x7fcf80010180).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:16.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8aa52700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf84108630 0x7fcf84152260 secure :-1 s=THROTTLE_DONE pgs=717 cs=0 l=1 rx=0x7fcf80010380 tx=0x7fcf80010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf7b7fe700 1 -- 172.21.15.80:0/2958208243 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf80000c90 con 0x7fcf84108630 2019-11-28T11:37:16.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8aa52700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf84108630 0x7fcf84152260 secure :-1 s=THROTTLE_DONE pgs=717 cs=0 l=1 rx=0x7fcf80010380 tx=0x7fcf80010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8aa52700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf84108630 0x7fcf84152260 secure :-1 s=THROTTLE_DONE pgs=717 cs=0 l=1 rx=0x7fcf80010380 tx=0x7fcf80010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf7b7fe700 1 -- 172.21.15.80:0/2958208243 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf80004430 con 0x7fcf84108630 2019-11-28T11:37:16.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf7b7fe700 1 -- 172.21.15.80:0/2958208243 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf80000c90 con 0x7fcf84108630 2019-11-28T11:37:16.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.417+0000 7fcf8c4b5700 1 -- 172.21.15.80:0/2958208243 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf841336d0 con 0x7fcf84108630 2019-11-28T11:37:16.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.418+0000 7fcf8c4b5700 1 -- 172.21.15.80:0/2958208243 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf84133350 con 0x7fcf84108630 2019-11-28T11:37:16.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.418+0000 7fcf8aa52700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf84108630 0x7fcf84152260 secure :-1 s=THROTTLE_DONE pgs=717 cs=0 l=1 rx=0x7fcf80010380 tx=0x7fcf80010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.418+0000 7fcf7b7fe700 1 -- 172.21.15.80:0/2958208243 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcf80004620 con 0x7fcf84108630 2019-11-28T11:37:16.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.418+0000 7fcf8aa52700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf84108630 0x7fcf84152260 secure :-1 s=THROTTLE_DONE pgs=717 cs=0 l=1 rx=0x7fcf80010380 tx=0x7fcf80010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.418+0000 7fcf7b7fe700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf6c018770 0x7fcf6c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:16.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.418+0000 7fcf7b7fe700 1 -- 172.21.15.80:0/2958208243 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fcf800319f0 con 0x7fcf84108630 2019-11-28T11:37:16.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.418+0000 7fcf8a251700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf6c018770 0x7fcf6c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.419+0000 7fcf8a251700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf6c018770 0x7fcf6c01abe0 crc :-1 s=READY pgs=493 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:16.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.425+0000 7fcf8c4b5700 1 -- 172.21.15.80:0/2958208243 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf841336d0 con 0x7fcf84108630 2019-11-28T11:37:16.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.429+0000 7fcf8aa52700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf84108630 0x7fcf84152260 secure :-1 s=THROTTLE_DONE pgs=717 cs=0 l=1 rx=0x7fcf80010380 tx=0x7fcf80010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.429+0000 7fcf7b7fe700 1 -- 172.21.15.80:0/2958208243 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcf8002cfa0 con 0x7fcf84108630 2019-11-28T11:37:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.597+0000 7fcf8c4b5700 1 -- 172.21.15.80:0/2958208243 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fcf84133350 con 0x7fcf84108630 2019-11-28T11:37:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.597+0000 7fcf8aa52700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf84108630 0x7fcf84152260 secure :-1 s=THROTTLE_DONE pgs=717 cs=0 l=1 rx=0x7fcf80010380 tx=0x7fcf80010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.597+0000 7fcf7b7fe700 1 -- 172.21.15.80:0/2958208243 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v93) v1 ==== 104+0+10 (secure 0 0 0) 0x7fcf8002cfa0 con 0x7fcf84108630 2019-11-28T11:37:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.600+0000 7fcf8c4b5700 1 -- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf6c018770 msgr2=0x7fcf6c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.600+0000 7fcf8c4b5700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf6c018770 0x7fcf6c01abe0 crc :-1 s=READY pgs=493 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.600+0000 7fcf8c4b5700 1 -- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf84108630 msgr2=0x7fcf84152260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.600+0000 7fcf8c4b5700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf84108630 0x7fcf84152260 secure :-1 s=READY pgs=717 cs=0 l=1 rx=0x7fcf80010380 tx=0x7fcf80010180).stop 2019-11-28T11:37:16.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.600+0000 7fcf8c4b5700 1 -- 172.21.15.80:0/2958208243 shutdown_connections 2019-11-28T11:37:16.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.600+0000 7fcf8c4b5700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf6c018770 0x7fcf6c01abe0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.600+0000 7fcf8c4b5700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf8412caa0 0x7fcf841510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.600+0000 7fcf8c4b5700 1 --2- 172.21.15.80:0/2958208243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf84108630 0x7fcf84152260 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.600+0000 7fcf8c4b5700 1 -- 172.21.15.80:0/2958208243 shutdown_connections 2019-11-28T11:37:16.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.600+0000 7fcf8c4b5700 1 -- 172.21.15.80:0/2958208243 wait complete. 2019-11-28T11:37:16.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.600+0000 7fcf8c4b5700 1 -- 172.21.15.80:0/2958208243 >> 172.21.15.80:0/2958208243 conn(0x7fcf8414dbb0 msgr2=0x7fcf84142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:16.667 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:37:16.672 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:37:16.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.734+0000 7f9467f0a700 1 Processor -- start 2019-11-28T11:37:16.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.734+0000 7f9467f0a700 1 -- start start 2019-11-28T11:37:16.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.735+0000 7f9467f0a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f946015f100 0x7f946006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:16.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.735+0000 7f9467f0a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f946006c2f0 0x7f946006c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:16.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.735+0000 7f9467f0a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946006db60 con 0x7f946015ed10 2019-11-28T11:37:16.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.735+0000 7f9467f0a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946006fe00 con 0x7f946006c2f0 2019-11-28T11:37:16.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.735+0000 7f9467f0a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94600700d0 con 0x7f946015f100 2019-11-28T11:37:16.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.735+0000 7f9466ca8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f946006c2f0 0x7f946006c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.735+0000 7f9466ca8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f946006c2f0 0x7f946006c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37342/0 (socket says 172.21.15.80:37342) 2019-11-28T11:37:16.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.735+0000 7f9465ca6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f946015f100 0x7f946006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.735+0000 7f9466ca8700 1 -- 172.21.15.80:0/599700696 learned_addr learned my addr 172.21.15.80:0/599700696 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:16.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.735+0000 7f94664a7700 1 --1- 172.21.15.80:0/599700696 >> v1:172.21.15.174:6789/0 conn(0x7f946015ed10 0x7f9460073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:52200/0 (socket says 172.21.15.80:52200) 2019-11-28T11:37:16.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.736+0000 7f9466ca8700 1 -- 172.21.15.80:0/599700696 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f946015f100 msgr2=0x7f946006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:16.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.736+0000 7f9466ca8700 1 --2- 172.21.15.80:0/599700696 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f946015f100 0x7f946006bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:16.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.736+0000 7f9466ca8700 1 -- 172.21.15.80:0/599700696 >> v1:172.21.15.174:6789/0 conn(0x7f946015ed10 legacy=0x7f9460073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.736+0000 7f94654a5700 1 -- 172.21.15.80:0/599700696 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840881788 0 0) 0x7f9448001080 con 0x7f946015ed10 2019-11-28T11:37:16.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.736+0000 7f9466ca8700 1 -- 172.21.15.80:0/599700696 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9460070760 con 0x7f946006c2f0 2019-11-28T11:37:16.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.736+0000 7f9466ca8700 1 --2- 172.21.15.80:0/599700696 >> v2:172.21.15.80:3300/0 conn(0x7f946006c2f0 0x7f946006c790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f945800fab0 tx=0x7f94580080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.736+0000 7f9466ca8700 1 --2- 172.21.15.80:0/599700696 >> v2:172.21.15.80:3300/0 conn(0x7f946006c2f0 0x7f946006c790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f945800fab0 tx=0x7f94580080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.736+0000 7f9466ca8700 1 --2- 172.21.15.80:0/599700696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f946006c2f0 0x7f946006c790 secure :-1 s=READY pgs=1215 cs=0 l=1 rx=0x7f945800fab0 tx=0x7f94580080d0).ready entity=mon.0 client_cookie=af9eb68c7b4d6b72 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:16.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.736+0000 7f9466ca8700 1 --2- 172.21.15.80:0/599700696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f946006c2f0 0x7f946006c790 secure :-1 s=THROTTLE_DONE pgs=1215 cs=0 l=1 rx=0x7f945800fab0 tx=0x7f94580080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.736+0000 7f94654a5700 1 -- 172.21.15.80:0/599700696 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9458000df0 con 0x7f946006c2f0 2019-11-28T11:37:16.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.736+0000 7f9466ca8700 1 --2- 172.21.15.80:0/599700696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f946006c2f0 0x7f946006c790 secure :-1 s=THROTTLE_DONE pgs=1215 cs=0 l=1 rx=0x7f945800fab0 tx=0x7f94580080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.736+0000 7f94654a5700 1 -- 172.21.15.80:0/599700696 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9458000ce0 con 0x7f946006c2f0 2019-11-28T11:37:16.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.736+0000 7f9466ca8700 1 --2- 172.21.15.80:0/599700696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f946006c2f0 0x7f946006c790 secure :-1 s=THROTTLE_DONE pgs=1215 cs=0 l=1 rx=0x7f945800fab0 tx=0x7f94580080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.736+0000 7f94654a5700 1 -- 172.21.15.80:0/599700696 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9458000ed0 con 0x7f946006c2f0 2019-11-28T11:37:16.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.736+0000 7f9467f0a700 1 -- 172.21.15.80:0/599700696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f946006c2f0 msgr2=0x7f946006c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.736+0000 7f9467f0a700 1 --2- 172.21.15.80:0/599700696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f946006c2f0 0x7f946006c790 secure :-1 s=READY pgs=1215 cs=0 l=1 rx=0x7f945800fab0 tx=0x7f94580080d0).stop 2019-11-28T11:37:16.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.737+0000 7f9467f0a700 1 -- 172.21.15.80:0/599700696 shutdown_connections 2019-11-28T11:37:16.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.737+0000 7f9467f0a700 1 --2- 172.21.15.80:0/599700696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f946006c2f0 0x7f946006c790 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.737+0000 7f9467f0a700 1 --2- 172.21.15.80:0/599700696 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f946015f100 0x7f946006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:16.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.737+0000 7f9467f0a700 1 -- 172.21.15.80:0/599700696 shutdown_connections 2019-11-28T11:37:16.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.737+0000 7f9467f0a700 1 -- 172.21.15.80:0/599700696 wait complete. 2019-11-28T11:37:16.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.737+0000 7f9467f0a700 1 -- 172.21.15.80:0/599700696 >> 172.21.15.80:0/599700696 conn(0x7f9460061d20 msgr2=0x7f94600641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:16.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.739+0000 7f9467f0a700 1 Processor -- start 2019-11-28T11:37:16.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.739+0000 7f9467f0a700 1 -- start start 2019-11-28T11:37:16.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.740+0000 7f9467f0a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f946010e970 0x7f94601087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:16.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.740+0000 7f9467f0a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9460107e30 0x7f9460167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:16.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.740+0000 7f9467f0a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946010c250 con 0x7f9460108cf0 2019-11-28T11:37:16.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.740+0000 7f9467f0a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946010e430 con 0x7f9460107e30 2019-11-28T11:37:16.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.740+0000 7f9467f0a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9460105860 con 0x7f946010e970 2019-11-28T11:37:16.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.740+0000 7f9466ca8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9460107e30 0x7f9460167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.740+0000 7f9465ca6700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9460108cf0 0x7f9460107630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36662/0 (socket says 172.21.15.80:36662) 2019-11-28T11:37:16.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.740+0000 7f9465ca6700 1 -- 172.21.15.80:0/92752331 learned_addr learned my addr 172.21.15.80:0/92752331 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:16.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.740+0000 7f94664a7700 1 --2- 172.21.15.80:0/92752331 >> v2:172.21.15.174:3300/0 conn(0x7f946010e970 0x7f94601087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f9466ca8700 1 -- 172.21.15.80:0/92752331 >> v2:172.21.15.174:3300/0 conn(0x7f946010e970 msgr2=0x7f94601087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f9466ca8700 1 --2- 172.21.15.80:0/92752331 >> v2:172.21.15.174:3300/0 conn(0x7f946010e970 0x7f94601087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f9466ca8700 1 -- 172.21.15.80:0/92752331 >> v1:172.21.15.80:6789/0 conn(0x7f9460108cf0 legacy=0x7f9460107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f945effd700 1 -- 172.21.15.80:0/92752331 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770297963 0 0) 0x7f94500010b0 con 0x7f9460108cf0 2019-11-28T11:37:16.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f9466ca8700 1 -- 172.21.15.80:0/92752331 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9460105ef0 con 0x7f9460107e30 2019-11-28T11:37:16.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f9466ca8700 1 --2- 172.21.15.80:0/92752331 >> v2:172.21.15.80:3300/0 conn(0x7f9460107e30 0x7f9460167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9458054780 tx=0x7f945800f960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f9466ca8700 1 --2- 172.21.15.80:0/92752331 >> v2:172.21.15.80:3300/0 conn(0x7f9460107e30 0x7f9460167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9458054780 tx=0x7f945800f960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f9466ca8700 1 --2- 172.21.15.80:0/92752331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9460107e30 0x7f9460167d70 secure :-1 s=READY pgs=1217 cs=0 l=1 rx=0x7f9458054780 tx=0x7f945800f960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:16.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f9466ca8700 1 --2- 172.21.15.80:0/92752331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9460107e30 0x7f9460167d70 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7f9458054780 tx=0x7f945800f960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f945effd700 1 -- 172.21.15.80:0/92752331 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9458008050 con 0x7f9460107e30 2019-11-28T11:37:16.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f9466ca8700 1 --2- 172.21.15.80:0/92752331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9460107e30 0x7f9460167d70 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7f9458054780 tx=0x7f945800f960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f9466ca8700 1 --2- 172.21.15.80:0/92752331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9460107e30 0x7f9460167d70 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7f9458054780 tx=0x7f945800f960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f945effd700 1 -- 172.21.15.80:0/92752331 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9458008500 con 0x7f9460107e30 2019-11-28T11:37:16.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f945effd700 1 -- 172.21.15.80:0/92752331 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9458001a10 con 0x7f9460107e30 2019-11-28T11:37:16.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f9467f0a700 1 -- 172.21.15.80:0/92752331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9460106270 con 0x7f9460107e30 2019-11-28T11:37:16.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f9467f0a700 1 -- 172.21.15.80:0/92752331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9460105ef0 con 0x7f9460107e30 2019-11-28T11:37:16.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.741+0000 7f9466ca8700 1 --2- 172.21.15.80:0/92752331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9460107e30 0x7f9460167d70 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7f9458054780 tx=0x7f945800f960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.742+0000 7f945effd700 1 -- 172.21.15.80:0/92752331 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9458001440 con 0x7f9460107e30 2019-11-28T11:37:16.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.742+0000 7f9466ca8700 1 --2- 172.21.15.80:0/92752331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9460107e30 0x7f9460167d70 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7f9458054780 tx=0x7f945800f960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.742+0000 7f945effd700 1 --2- 172.21.15.80:0/92752331 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9444018730 0x7f944401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:16.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.742+0000 7f945effd700 1 -- 172.21.15.80:0/92752331 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9458075db0 con 0x7f9460107e30 2019-11-28T11:37:16.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.742+0000 7f94664a7700 1 --2- 172.21.15.80:0/92752331 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9444018730 0x7f944401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:16.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.742+0000 7f94664a7700 1 --2- 172.21.15.80:0/92752331 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9444018730 0x7f944401abc0 crc :-1 s=READY pgs=494 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:16.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.749+0000 7f9467f0a700 1 -- 172.21.15.80:0/92752331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9460106270 con 0x7f9460107e30 2019-11-28T11:37:16.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.753+0000 7f9466ca8700 1 --2- 172.21.15.80:0/92752331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9460107e30 0x7f9460167d70 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7f9458054780 tx=0x7f945800f960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.753+0000 7f945effd700 1 -- 172.21.15.80:0/92752331 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9458001230 con 0x7f9460107e30 2019-11-28T11:37:16.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.921+0000 7f9467f0a700 1 -- 172.21.15.80:0/92752331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f9460105ef0 con 0x7f9460107e30 2019-11-28T11:37:16.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.921+0000 7f9466ca8700 1 --2- 172.21.15.80:0/92752331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9460107e30 0x7f9460167d70 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7f9458054780 tx=0x7f945800f960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:16.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.921+0000 7f945effd700 1 -- 172.21.15.80:0/92752331 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v93) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9458001440 con 0x7f9460107e30 2019-11-28T11:37:16.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.923+0000 7f9467f0a700 1 -- 172.21.15.80:0/92752331 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9444018730 msgr2=0x7f944401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.923+0000 7f9467f0a700 1 --2- 172.21.15.80:0/92752331 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9444018730 0x7f944401abc0 crc :-1 s=READY pgs=494 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.923+0000 7f9467f0a700 1 -- 172.21.15.80:0/92752331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9460107e30 msgr2=0x7f9460167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:16.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.923+0000 7f9467f0a700 1 --2- 172.21.15.80:0/92752331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9460107e30 0x7f9460167d70 secure :-1 s=READY pgs=1217 cs=0 l=1 rx=0x7f9458054780 tx=0x7f945800f960).stop 2019-11-28T11:37:16.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.923+0000 7f9467f0a700 1 -- 172.21.15.80:0/92752331 shutdown_connections 2019-11-28T11:37:16.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.923+0000 7f9467f0a700 1 --2- 172.21.15.80:0/92752331 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9444018730 0x7f944401abc0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.923+0000 7f9467f0a700 1 --2- 172.21.15.80:0/92752331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9460107e30 0x7f9460167d70 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.923+0000 7f9467f0a700 1 --2- 172.21.15.80:0/92752331 >> v2:172.21.15.174:3300/0 conn(0x7f946010e970 0x7f94601087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:16.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.924+0000 7f9467f0a700 1 -- 172.21.15.80:0/92752331 shutdown_connections 2019-11-28T11:37:16.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.924+0000 7f9467f0a700 1 -- 172.21.15.80:0/92752331 wait complete. 2019-11-28T11:37:16.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:16.924+0000 7f9467f0a700 1 -- 172.21.15.80:0/92752331 >> 172.21.15.80:0/92752331 conn(0x7f946015e2d0 msgr2=0x7f9460147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:16.990 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:37:16.995 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:37:16.996 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:37:17.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.055+0000 7f97f0971700 1 Processor -- start 2019-11-28T11:37:17.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.055+0000 7f97f0971700 1 -- start start 2019-11-28T11:37:17.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.056+0000 7f97f0971700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f97ec06c0a0 0x7f97ec072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:17.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.056+0000 7f97f0971700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec0734e0 0x7f97ec071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:17.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.056+0000 7f97f0971700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec06db00 con 0x7f97ec072360 2019-11-28T11:37:17.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.056+0000 7f97f0971700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ec06fd60 con 0x7f97ec06c0a0 2019-11-28T11:37:17.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.056+0000 7f97f0971700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec070030 con 0x7f97ec0734e0 2019-11-28T11:37:17.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.056+0000 7f97ead9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f97ec06c0a0 0x7f97ec072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:17.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.056+0000 7f97ead9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f97ec06c0a0 0x7f97ec072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37354/0 (socket says 172.21.15.80:37354) 2019-11-28T11:37:17.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.056+0000 7f97ead9d700 1 -- 172.21.15.80:0/174576843 learned_addr learned my addr 172.21.15.80:0/174576843 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:17.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.056+0000 7f97ea59c700 1 --2- 172.21.15.80:0/174576843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec0734e0 0x7f97ec071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:17.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.056+0000 7f97ead9d700 1 -- 172.21.15.80:0/174576843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec0734e0 msgr2=0x7f97ec071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:17.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.056+0000 7f97ead9d700 1 --2- 172.21.15.80:0/174576843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec0734e0 0x7f97ec071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:17.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.056+0000 7f97ead9d700 1 -- 172.21.15.80:0/174576843 >> v1:172.21.15.174:6789/0 conn(0x7f97ec072360 legacy=0x7f97ec06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:17.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.056+0000 7f97ead9d700 1 -- 172.21.15.80:0/174576843 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec0706c0 con 0x7f97ec06c0a0 2019-11-28T11:37:17.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.057+0000 7f97ead9d700 1 --2- 172.21.15.80:0/174576843 >> v2:172.21.15.80:3300/0 conn(0x7f97ec06c0a0 0x7f97ec072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f97d400fac0 tx=0x7f97d400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:17.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.057+0000 7f97ead9d700 1 --2- 172.21.15.80:0/174576843 >> v2:172.21.15.80:3300/0 conn(0x7f97ec06c0a0 0x7f97ec072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f97d400fac0 tx=0x7f97d400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:17.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.057+0000 7f97ead9d700 1 --2- 172.21.15.80:0/174576843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97ec06c0a0 0x7f97ec072fa0 secure :-1 s=READY pgs=1218 cs=0 l=1 rx=0x7f97d400fac0 tx=0x7f97d400f8f0).ready entity=mon.0 client_cookie=669c4e9c256a3e97 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:17.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.057+0000 7f97ead9d700 1 --2- 172.21.15.80:0/174576843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97ec06c0a0 0x7f97ec072fa0 secure :-1 s=THROTTLE_DONE pgs=1218 cs=0 l=1 rx=0x7f97d400fac0 tx=0x7f97d400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:17.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.057+0000 7f97ead9d700 1 --2- 172.21.15.80:0/174576843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97ec06c0a0 0x7f97ec072fa0 secure :-1 s=THROTTLE_DONE pgs=1218 cs=0 l=1 rx=0x7f97d400fac0 tx=0x7f97d400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:17.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.057+0000 7f97e9d9b700 1 -- 172.21.15.80:0/174576843 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97d4000ce0 con 0x7f97ec06c0a0 2019-11-28T11:37:17.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.057+0000 7f97ead9d700 1 --2- 172.21.15.80:0/174576843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97ec06c0a0 0x7f97ec072fa0 secure :-1 s=THROTTLE_DONE pgs=1218 cs=0 l=1 rx=0x7f97d400fac0 tx=0x7f97d400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:17.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.057+0000 7f97e9d9b700 1 -- 172.21.15.80:0/174576843 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d4001010 con 0x7f97ec06c0a0 2019-11-28T11:37:17.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.057+0000 7f97e9d9b700 1 -- 172.21.15.80:0/174576843 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97d4001720 con 0x7f97ec06c0a0 2019-11-28T11:37:17.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.057+0000 7f97f0971700 1 -- 172.21.15.80:0/174576843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97ec06c0a0 msgr2=0x7f97ec072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:17.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.057+0000 7f97f0971700 1 --2- 172.21.15.80:0/174576843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97ec06c0a0 0x7f97ec072fa0 secure :-1 s=READY pgs=1218 cs=0 l=1 rx=0x7f97d400fac0 tx=0x7f97d400f8f0).stop 2019-11-28T11:37:17.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.058+0000 7f97f0971700 1 -- 172.21.15.80:0/174576843 shutdown_connections 2019-11-28T11:37:17.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.058+0000 7f97f0971700 1 --2- 172.21.15.80:0/174576843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec0734e0 0x7f97ec071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:17.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.058+0000 7f97f0971700 1 --2- 172.21.15.80:0/174576843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97ec06c0a0 0x7f97ec072fa0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:17.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.058+0000 7f97f0971700 1 -- 172.21.15.80:0/174576843 shutdown_connections 2019-11-28T11:37:17.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.058+0000 7f97f0971700 1 -- 172.21.15.80:0/174576843 wait complete. 2019-11-28T11:37:17.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.058+0000 7f97f0971700 1 -- 172.21.15.80:0/174576843 >> 172.21.15.80:0/174576843 conn(0x7f97ec061cf0 msgr2=0x7f97ec064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:17.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.060+0000 7f97f0971700 1 Processor -- start 2019-11-28T11:37:17.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.060+0000 7f97f0971700 1 -- start start 2019-11-28T11:37:17.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.061+0000 7f97f0971700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec167c30 0x7f97ec16a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:17.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.061+0000 7f97f0971700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec13f1e0 con 0x7f97ec13eb40 2019-11-28T11:37:17.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.061+0000 7f97f0971700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec131a30 con 0x7f97ec109e40 2019-11-28T11:37:17.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.061+0000 7f97f0971700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec1234c0 con 0x7f97ec167c30 2019-11-28T11:37:17.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.061+0000 7f97ead9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f97ec13eb40 0x7f97ec10afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36676/0 (socket says 172.21.15.80:36676) 2019-11-28T11:37:17.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.061+0000 7f97ead9d700 1 -- 172.21.15.80:0/2510783774 learned_addr learned my addr 172.21.15.80:0/2510783774 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:17.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.061+0000 7f97eb59e700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec167c30 0x7f97ec16a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:17.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.061+0000 7f97e37fe700 1 -- 172.21.15.80:0/2510783774 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233768327 0 0) 0x7f97d4007d20 con 0x7f97ec13eb40 2019-11-28T11:37:17.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.061+0000 7f97e37fe700 1 -- 172.21.15.80:0/2510783774 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97c4002e80 con 0x7f97ec13eb40 2019-11-28T11:37:17.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.061+0000 7f97e37fe700 1 -- 172.21.15.80:0/2510783774 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170095388 0 0) 0x7f97dc000c90 con 0x7f97ec109e40 2019-11-28T11:37:17.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.061+0000 7f97e37fe700 1 -- 172.21.15.80:0/2510783774 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97c40030b0 con 0x7f97ec109e40 2019-11-28T11:37:17.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.061+0000 7f97eb59e700 1 -- 172.21.15.80:0/2510783774 >> v1:172.21.15.174:6789/0 conn(0x7f97ec109e40 legacy=0x7f97ec10a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:17.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.061+0000 7f97e37fe700 1 -- 172.21.15.80:0/2510783774 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 998635917 0 0) 0x7f97d4000cc0 con 0x7f97ec13eb40 2019-11-28T11:37:17.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.061+0000 7f97eb59e700 1 -- 172.21.15.80:0/2510783774 >> v1:172.21.15.80:6789/0 conn(0x7f97ec13eb40 legacy=0x7f97ec10afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:17.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.062+0000 7f97eb59e700 1 -- 172.21.15.80:0/2510783774 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec108700 con 0x7f97ec167c30 2019-11-28T11:37:17.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.062+0000 7f97eb59e700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec167c30 0x7f97ec16a030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f97e40103b0 tx=0x7f97e4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:17.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.062+0000 7f97eb59e700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec167c30 0x7f97ec16a030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f97e40103b0 tx=0x7f97e4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:17.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.062+0000 7f97eb59e700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec167c30 0x7f97ec16a030 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f97e40103b0 tx=0x7f97e4010750).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:17.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.062+0000 7f97eb59e700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec167c30 0x7f97ec16a030 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f97e40103b0 tx=0x7f97e4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:17.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.062+0000 7f97e37fe700 1 -- 172.21.15.80:0/2510783774 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97e4000960 con 0x7f97ec167c30 2019-11-28T11:37:17.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.062+0000 7f97eb59e700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec167c30 0x7f97ec16a030 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f97e40103b0 tx=0x7f97e4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:17.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.062+0000 7f97e37fe700 1 -- 172.21.15.80:0/2510783774 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e4009990 con 0x7f97ec167c30 2019-11-28T11:37:17.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.062+0000 7f97eb59e700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec167c30 0x7f97ec16a030 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f97e40103b0 tx=0x7f97e4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:17.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.062+0000 7f97e37fe700 1 -- 172.21.15.80:0/2510783774 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97e4000960 con 0x7f97ec167c30 2019-11-28T11:37:17.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.062+0000 7f97f0971700 1 -- 172.21.15.80:0/2510783774 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ec108a80 con 0x7f97ec167c30 2019-11-28T11:37:17.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.062+0000 7f97f0971700 1 -- 172.21.15.80:0/2510783774 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ec108700 con 0x7f97ec167c30 2019-11-28T11:37:17.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.062+0000 7f97eb59e700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec167c30 0x7f97ec16a030 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f97e40103b0 tx=0x7f97e4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:17.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.063+0000 7f97e37fe700 1 -- 172.21.15.80:0/2510783774 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f97e4009b80 con 0x7f97ec167c30 2019-11-28T11:37:17.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.063+0000 7f97eb59e700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec167c30 0x7f97ec16a030 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f97e40103b0 tx=0x7f97e4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:17.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.063+0000 7f97e37fe700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f97c4018750 0x7f97c401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:17.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.063+0000 7f97e37fe700 1 -- 172.21.15.80:0/2510783774 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f97e4031a90 con 0x7f97ec167c30 2019-11-28T11:37:17.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.063+0000 7f97ead9d700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f97c4018750 0x7f97c401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:17.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.063+0000 7f97ead9d700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f97c4018750 0x7f97c401abe0 crc :-1 s=READY pgs=495 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:17.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.070+0000 7f97f0971700 1 -- 172.21.15.80:0/2510783774 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ec108a80 con 0x7f97ec167c30 2019-11-28T11:37:17.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.074+0000 7f97eb59e700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec167c30 0x7f97ec16a030 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f97e40103b0 tx=0x7f97e4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:17.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.074+0000 7f97e37fe700 1 -- 172.21.15.80:0/2510783774 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f97e4009590 con 0x7f97ec167c30 2019-11-28T11:37:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.245+0000 7f97f0971700 1 -- 172.21.15.80:0/2510783774 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97ec108700 con 0x7f97ec167c30 2019-11-28T11:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.247+0000 7f97eb59e700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec167c30 0x7f97ec16a030 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f97e40103b0 tx=0x7f97e4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.247+0000 7f97e37fe700 1 -- 172.21.15.80:0/2510783774 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+2442 (secure 0 0 0) 0x7f97e4009b80 con 0x7f97ec167c30 2019-11-28T11:37:17.308 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 60 2019-11-28T11:37:17.309 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:37:17.310 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1620047617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1620047617},{"type":"v1","addr":"172.21.15.80:6834","nonce":1620047617}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":58},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/612359803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":612359803},{"type":"v1","addr":"172.21.15.80:6835","nonce":612359803}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":58}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:37:11.301943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7108},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7108":{"gid":7108,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/775911718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":775911718},{"type":"v1","addr":"172.21.15.174:6835","nonce":775911718}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.248+0000 7f97f0971700 1 -- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f97c4018750 msgr2=0x7f97c401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.248+0000 7f97f0971700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f97c4018750 0x7f97c401abe0 crc :-1 s=READY pgs=495 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.248+0000 7f97f0971700 1 -- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec167c30 msgr2=0x7f97ec16a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.248+0000 7f97f0971700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec167c30 0x7f97ec16a030 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f97e40103b0 tx=0x7f97e4010750).stop 2019-11-28T11:37:17.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.248+0000 7f97f0971700 1 -- 172.21.15.80:0/2510783774 shutdown_connections 2019-11-28T11:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.248+0000 7f97f0971700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97ec167c30 0x7f97ec16a030 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.248+0000 7f97f0971700 1 --2- 172.21.15.80:0/2510783774 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f97c4018750 0x7f97c401abe0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.248+0000 7f97f0971700 1 -- 172.21.15.80:0/2510783774 shutdown_connections 2019-11-28T11:37:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.248+0000 7f97f0971700 1 -- 172.21.15.80:0/2510783774 wait complete. 2019-11-28T11:37:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:17.248+0000 7f97f0971700 1 -- 172.21.15.80:0/2510783774 >> 172.21.15.80:0/2510783774 conn(0x7f97ec11bfc0 msgr2=0x7f97ec141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:17.625 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7108}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 14, u'failed': [], u'epoch': 60, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [15], u'info': {u'gid_7108': {u'export_targets': [], u'name': u'c', u'incarnation': 59, u'state_seq': 3, u'state': u'up:active', u'gid': 7108, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 775911718, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 775911718, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/775911718'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:37:03.205339+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:37:11.301943+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:37:17.626 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:37:17.626 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:37:17.758 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:37:17.759 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:37:17.759 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:37:17.759 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 7108, 2019-11-28T11:37:17.759 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:37:17.760 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:37:17.760 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 7.3889282940000003, 2019-11-28T11:37:17.760 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 60, 2019-11-28T11:37:17.769 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 93, 2019-11-28T11:37:17.769 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 93, 2019-11-28T11:37:17.769 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 11.667848336 2019-11-28T11:37:17.770 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:37:17.770 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7108, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.3889282940000003, "mdsmap_epoch": 60, "osdmap_epoch": 93, "osdmap_epoch_barrier": 93, "uptime": 11.667848336 } 2019-11-28T11:37:17.770 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:37:17.770 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:37:17.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:37:17.771 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:37:17.843 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:37:17.843 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:37:17.972 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:37:17.972 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:37:17.972 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:37:17.972 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:37:17.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:37:17.973 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:37:18.059 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:37:18.185 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:37:18.185 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:37:18.185 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:37:18.187 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:37:18.187 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:37:18.310 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:37:18.310 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:37:18.310 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:37:18.316 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:37:18.316 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:37:18.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:37:18.317 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:37:18.386 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:37:18.392 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:37:18.431 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits daemon-helper kill python -c ' 2019-11-28T11:37:18.431 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:37:18.432 INFO:teuthology.orchestra.run.smithi076:> import time 2019-11-28T11:37:18.432 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:37:18.432 INFO:teuthology.orchestra.run.smithi076:> path = "/home/ubuntu/cephtest/mnt.0/subdir" 2019-11-28T11:37:18.432 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:37:18.442 INFO:teuthology.orchestra.run.smithi076:> print("Starting creation...") 2019-11-28T11:37:18.442 INFO:teuthology.orchestra.run.smithi076:> start = time.time() 2019-11-28T11:37:18.443 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:37:18.443 INFO:teuthology.orchestra.run.smithi076:> os.mkdir(path) 2019-11-28T11:37:18.443 INFO:teuthology.orchestra.run.smithi076:> dfd = os.open(path, os.O_DIRECTORY) 2019-11-28T11:37:18.443 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:37:18.443 INFO:teuthology.orchestra.run.smithi076:> fd = open(os.path.join(path, "childfile"), "w") 2019-11-28T11:37:18.443 INFO:teuthology.orchestra.run.smithi076:> print("Finished creation in {0}s".format(time.time() - start)) 2019-11-28T11:37:18.444 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:37:18.444 INFO:teuthology.orchestra.run.smithi076:> print("Starting fsync...") 2019-11-28T11:37:18.444 INFO:teuthology.orchestra.run.smithi076:> start = time.time() 2019-11-28T11:37:18.444 INFO:teuthology.orchestra.run.smithi076:> if True: 2019-11-28T11:37:18.456 INFO:teuthology.orchestra.run.smithi076:> os.fsync(dfd) 2019-11-28T11:37:18.456 INFO:teuthology.orchestra.run.smithi076:> else: 2019-11-28T11:37:18.456 INFO:teuthology.orchestra.run.smithi076:> os.fsync(fd) 2019-11-28T11:37:18.456 INFO:teuthology.orchestra.run.smithi076:> print("Finished fsync in {0}s".format(time.time() - start)) 2019-11-28T11:37:18.457 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:37:19.506 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:37:19.511 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:37:19.516 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:37:19.520 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:37:19.525 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:37:19.529 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:37:21.089 INFO:teuthology.orchestra.run.smithi076.stdout:Starting creation... 2019-11-28T11:37:21.089 INFO:teuthology.orchestra.run.smithi076.stdout:Finished creation in 0.00426983833313s 2019-11-28T11:37:21.090 INFO:teuthology.orchestra.run.smithi076.stdout:Starting fsync... 2019-11-28T11:37:21.090 INFO:teuthology.orchestra.run.smithi076.stdout:Finished fsync in 2.53700304031s 2019-11-28T11:37:21.148 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:37:21.148 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:37:21.149 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:37:21.149 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:37:21.150 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:37:21.150 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:37:21.154 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:37:21.155 DEBUG:teuthology.parallel:result is None 2019-11-28T11:37:21.157 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:37:21.157 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:37:21.165 DEBUG:teuthology.parallel:result is None 2019-11-28T11:37:21.165 DEBUG:teuthology.parallel:result is None 2019-11-28T11:37:21.167 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:37:21.169 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:37:21.171 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:37:21.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.282+0000 7f8ed1f87700 1 Processor -- start 2019-11-28T11:37:21.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.282+0000 7f8ed1f87700 1 -- start start 2019-11-28T11:37:21.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.283+0000 7f8ed1f87700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06d120 0x7f8ecc165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:21.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.283+0000 7f8ed1f87700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ecc06d580 con 0x7f8ecc06c490 2019-11-28T11:37:21.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.283+0000 7f8ed1f87700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ecc06db00 con 0x7f8ecc06c0a0 2019-11-28T11:37:21.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.283+0000 7f8ed1f87700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc06fd60 con 0x7f8ecc06d120 2019-11-28T11:37:21.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.283+0000 7f8ecb7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8ecc06c490 0x7f8ecc06c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36684/0 (socket says 172.21.15.80:36684) 2019-11-28T11:37:21.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.283+0000 7f8ecb7fe700 1 -- 172.21.15.80:0/3347474504 learned_addr learned my addr 172.21.15.80:0/3347474504 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:37:21.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.283+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3347474504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06d120 0x7f8ecc165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:21.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.283+0000 7f8ecaffd700 1 -- 172.21.15.80:0/3347474504 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705234263 0 0) 0x7f8ec0001150 con 0x7f8ecc06c490 2019-11-28T11:37:21.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.283+0000 7f8ecaffd700 1 -- 172.21.15.80:0/3347474504 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8eb4002e80 con 0x7f8ecc06c490 2019-11-28T11:37:21.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.283+0000 7f8ecaffd700 1 -- 172.21.15.80:0/3347474504 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305601340 0 0) 0x7f8ebc001080 con 0x7f8ecc06c0a0 2019-11-28T11:37:21.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.283+0000 7f8ecaffd700 1 -- 172.21.15.80:0/3347474504 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8eb40030b0 con 0x7f8ecc06c0a0 2019-11-28T11:37:21.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.283+0000 7f8ed0d25700 1 -- 172.21.15.80:0/3347474504 >> v1:172.21.15.174:6789/0 conn(0x7f8ecc06c0a0 legacy=0x7f8ecc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.283+0000 7f8ed0d25700 1 -- 172.21.15.80:0/3347474504 >> v1:172.21.15.80:6789/0 conn(0x7f8ecc06c490 legacy=0x7f8ecc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.283+0000 7f8ed0d25700 1 -- 172.21.15.80:0/3347474504 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc0706c0 con 0x7f8ecc06d120 2019-11-28T11:37:21.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.283+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3347474504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06d120 0x7f8ecc165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8ec400b300 tx=0x7f8ec400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.284+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3347474504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06d120 0x7f8ecc165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8ec400b300 tx=0x7f8ec400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.284+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3347474504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06d120 0x7f8ecc165d80 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f8ec400b300 tx=0x7f8ec400bb10).ready entity=mon.2 client_cookie=4dad2aa090dfca2b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:21.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.284+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3347474504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06d120 0x7f8ecc165d80 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f8ec400b300 tx=0x7f8ec400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.284+0000 7f8ecaffd700 1 -- 172.21.15.80:0/3347474504 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ec40075c0 con 0x7f8ecc06d120 2019-11-28T11:37:21.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.284+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3347474504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06d120 0x7f8ecc165d80 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f8ec400b300 tx=0x7f8ec400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.284+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3347474504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06d120 0x7f8ecc165d80 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f8ec400b300 tx=0x7f8ec400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.284+0000 7f8ecaffd700 1 -- 172.21.15.80:0/3347474504 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec4000f30 con 0x7f8ecc06d120 2019-11-28T11:37:21.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.284+0000 7f8ecaffd700 1 -- 172.21.15.80:0/3347474504 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ec400a1e0 con 0x7f8ecc06d120 2019-11-28T11:37:21.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.284+0000 7f8ed1f87700 1 -- 172.21.15.80:0/3347474504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06d120 msgr2=0x7f8ecc165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.284+0000 7f8ed1f87700 1 --2- 172.21.15.80:0/3347474504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06d120 0x7f8ecc165d80 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f8ec400b300 tx=0x7f8ec400bb10).stop 2019-11-28T11:37:21.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.284+0000 7f8ed1f87700 1 -- 172.21.15.80:0/3347474504 shutdown_connections 2019-11-28T11:37:21.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.284+0000 7f8ed1f87700 1 --2- 172.21.15.80:0/3347474504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06d120 0x7f8ecc165d80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.284+0000 7f8ed1f87700 1 -- 172.21.15.80:0/3347474504 shutdown_connections 2019-11-28T11:37:21.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.285+0000 7f8ed1f87700 1 -- 172.21.15.80:0/3347474504 wait complete. 2019-11-28T11:37:21.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.285+0000 7f8ed1f87700 1 -- 172.21.15.80:0/3347474504 >> 172.21.15.80:0/3347474504 conn(0x7f8ecc061cf0 msgr2=0x7f8ecc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:21.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.287+0000 7f8ed1f87700 1 Processor -- start 2019-11-28T11:37:21.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.287+0000 7f8ed1f87700 1 -- start start 2019-11-28T11:37:21.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2019-11-28T11:37:21.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2019-11-28T11:37:21.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.288+0000 7f8ed1f87700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8ecc142d00 0x7f8ecc07b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:21.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.288+0000 7f8ed1f87700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ecc12dca0 0x7f8ecc12e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:21.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.288+0000 7f8ed1f87700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ecc125780 con 0x7f8ecc13e280 2019-11-28T11:37:21.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.288+0000 7f8ed1f87700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ecc13b3b0 con 0x7f8ecc12dca0 2019-11-28T11:37:21.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.288+0000 7f8ed1f87700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ecc111b70 con 0x7f8ecc142d00 2019-11-28T11:37:21.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.288+0000 7f8ed0d25700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ecc12dca0 0x7f8ecc12e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:21.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.288+0000 7f8ed0d25700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ecc12dca0 0x7f8ecc12e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37376/0 (socket says 172.21.15.80:37376) 2019-11-28T11:37:21.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.288+0000 7f8ed0d25700 1 -- 172.21.15.80:0/3866542627 learned_addr learned my addr 172.21.15.80:0/3866542627 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:21.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.288+0000 7f8ecbfff700 1 --2- 172.21.15.80:0/3866542627 >> v2:172.21.15.174:3300/0 conn(0x7f8ecc142d00 0x7f8ecc07b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:21.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.288+0000 7f8ed0d25700 1 -- 172.21.15.80:0/3866542627 >> v2:172.21.15.174:3300/0 conn(0x7f8ecc142d00 msgr2=0x7f8ecc07b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.288+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3866542627 >> v2:172.21.15.174:3300/0 conn(0x7f8ecc142d00 0x7f8ecc07b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.288+0000 7f8ed0d25700 1 -- 172.21.15.80:0/3866542627 >> v1:172.21.15.174:6789/0 conn(0x7f8ecc13e280 legacy=0x7f8ecc13e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.289+0000 7f8ed0d25700 1 -- 172.21.15.80:0/3866542627 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc0790b0 con 0x7f8ecc12dca0 2019-11-28T11:37:21.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.289+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3866542627 >> v2:172.21.15.80:3300/0 conn(0x7f8ecc12dca0 0x7f8ecc12e0d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ec40107d0 tx=0x7f8ec4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.289+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3866542627 >> v2:172.21.15.80:3300/0 conn(0x7f8ecc12dca0 0x7f8ecc12e0d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ec40107d0 tx=0x7f8ec4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.289+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3866542627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc12dca0 0x7f8ecc12e0d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rx=0x7f8ec40107d0 tx=0x7f8ec4010650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:21.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.289+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3866542627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc12dca0 0x7f8ecc12e0d0 secure :-1 s=THROTTLE_DONE pgs=1221 cs=0 l=1 rx=0x7f8ec40107d0 tx=0x7f8ec4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.289+0000 7f8ec8ff9700 1 -- 172.21.15.80:0/3866542627 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ec4009d30 con 0x7f8ecc12dca0 2019-11-28T11:37:21.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.289+0000 7f8ed1f87700 1 -- 172.21.15.80:0/3866542627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ecc079430 con 0x7f8ecc12dca0 2019-11-28T11:37:21.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.289+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3866542627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc12dca0 0x7f8ecc12e0d0 secure :-1 s=THROTTLE_DONE pgs=1221 cs=0 l=1 rx=0x7f8ec40107d0 tx=0x7f8ec4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.289+0000 7f8ed1f87700 1 -- 172.21.15.80:0/3866542627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc0790b0 con 0x7f8ecc12dca0 2019-11-28T11:37:21.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.289+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3866542627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc12dca0 0x7f8ecc12e0d0 secure :-1 s=THROTTLE_DONE pgs=1221 cs=0 l=1 rx=0x7f8ec40107d0 tx=0x7f8ec4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.289+0000 7f8ec8ff9700 1 -- 172.21.15.80:0/3866542627 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec4009930 con 0x7f8ecc12dca0 2019-11-28T11:37:21.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.289+0000 7f8ec8ff9700 1 -- 172.21.15.80:0/3866542627 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ec400a1d0 con 0x7f8ecc12dca0 2019-11-28T11:37:21.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3866542627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc12dca0 0x7f8ecc12e0d0 secure :-1 s=THROTTLE_DONE pgs=1221 cs=0 l=1 rx=0x7f8ec40107d0 tx=0x7f8ec4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f8ec8ff9700 1 -- 172.21.15.80:0/3866542627 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8ec4009fb0 con 0x7f8ecc12dca0 2019-11-28T11:37:21.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3866542627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc12dca0 0x7f8ecc12e0d0 secure :-1 s=THROTTLE_DONE pgs=1221 cs=0 l=1 rx=0x7f8ec40107d0 tx=0x7f8ec4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f8ec8ff9700 1 --2- 172.21.15.80:0/3866542627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8eac018730 0x7f8eac01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:21.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f8ec8ff9700 1 -- 172.21.15.80:0/3866542627 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8ec4031e20 con 0x7f8ecc12dca0 2019-11-28T11:37:21.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f8ecbfff700 1 --2- 172.21.15.80:0/3866542627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8eac018730 0x7f8eac01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:21.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f8ecbfff700 1 --2- 172.21.15.80:0/3866542627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8eac018730 0x7f8eac01abc0 crc :-1 s=READY pgs=496 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:21.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.297+0000 7f8ed1f87700 1 -- 172.21.15.80:0/3866542627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ecc079430 con 0x7f8ecc12dca0 2019-11-28T11:37:21.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.301+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3866542627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc12dca0 0x7f8ecc12e0d0 secure :-1 s=THROTTLE_DONE pgs=1221 cs=0 l=1 rx=0x7f8ec40107d0 tx=0x7f8ec4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.301+0000 7f8ec8ff9700 1 -- 172.21.15.80:0/3866542627 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8ec4009d50 con 0x7f8ecc12dca0 2019-11-28T11:37:21.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.289+0000 7f20c990f700 1 Processor -- start 2019-11-28T11:37:21.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.289+0000 7f20c990f700 1 -- start start 2019-11-28T11:37:21.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f20c990f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f20c406c0a0 0x7f20c4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:21.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f20c990f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20c4072620 0x7f20c4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:21.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f20c990f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c406db00 con 0x7f20c40734e0 2019-11-28T11:37:21.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f20c990f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c406fd60 con 0x7f20c4072620 2019-11-28T11:37:21.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f20c990f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c4070030 con 0x7f20c406c0a0 2019-11-28T11:37:21.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f20c37fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f20c406c0a0 0x7f20c4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:21.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f20c3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20c4072620 0x7f20c4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:21.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f20c37fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f20c406c0a0 0x7f20c4072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:52266/0 (socket says 172.21.15.80:52266) 2019-11-28T11:37:21.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f20c37fe700 1 -- 172.21.15.80:0/2788616408 learned_addr learned my addr 172.21.15.80:0/2788616408 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:21.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f20c3fff700 1 -- 172.21.15.80:0/2788616408 >> v2:172.21.15.174:3300/0 conn(0x7f20c406c0a0 msgr2=0x7f20c4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:21.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f20c3fff700 1 --2- 172.21.15.80:0/2788616408 >> v2:172.21.15.174:3300/0 conn(0x7f20c406c0a0 0x7f20c4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:21.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f20c3fff700 1 -- 172.21.15.80:0/2788616408 >> v1:172.21.15.174:6789/0 conn(0x7f20c40734e0 legacy=0x7f20c4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f20c2ffd700 1 -- 172.21.15.80:0/2788616408 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564242208 0 0) 0x7f20ac001080 con 0x7f20c40734e0 2019-11-28T11:37:21.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f20c3fff700 1 -- 172.21.15.80:0/2788616408 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c40706c0 con 0x7f20c4072620 2019-11-28T11:37:21.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f20c3fff700 1 --2- 172.21.15.80:0/2788616408 >> v2:172.21.15.80:3300/0 conn(0x7f20c4072620 0x7f20c4164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f20bc00af50 tx=0x7f20bc00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f20c3fff700 1 --2- 172.21.15.80:0/2788616408 >> v2:172.21.15.80:3300/0 conn(0x7f20c4072620 0x7f20c4164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f20bc00af50 tx=0x7f20bc00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f20c3fff700 1 --2- 172.21.15.80:0/2788616408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4072620 0x7f20c4164d70 secure :-1 s=READY pgs=1224 cs=0 l=1 rx=0x7f20bc00af50 tx=0x7f20bc00b250).ready entity=mon.0 client_cookie=fda8b9c629da1d35 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:21.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f20c3fff700 1 --2- 172.21.15.80:0/2788616408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4072620 0x7f20c4164d70 secure :-1 s=THROTTLE_DONE pgs=1224 cs=0 l=1 rx=0x7f20bc00af50 tx=0x7f20bc00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f20c2ffd700 1 -- 172.21.15.80:0/2788616408 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20bc009ba0 con 0x7f20c4072620 2019-11-28T11:37:21.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f20c3fff700 1 --2- 172.21.15.80:0/2788616408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4072620 0x7f20c4164d70 secure :-1 s=THROTTLE_DONE pgs=1224 cs=0 l=1 rx=0x7f20bc00af50 tx=0x7f20bc00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f20c3fff700 1 --2- 172.21.15.80:0/2788616408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4072620 0x7f20c4164d70 secure :-1 s=THROTTLE_DONE pgs=1224 cs=0 l=1 rx=0x7f20bc00af50 tx=0x7f20bc00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f20c2ffd700 1 -- 172.21.15.80:0/2788616408 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc0097c0 con 0x7f20c4072620 2019-11-28T11:37:21.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f20c2ffd700 1 -- 172.21.15.80:0/2788616408 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20bc00a180 con 0x7f20c4072620 2019-11-28T11:37:21.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f20c990f700 1 -- 172.21.15.80:0/2788616408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4072620 msgr2=0x7f20c4164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f20c990f700 1 --2- 172.21.15.80:0/2788616408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4072620 0x7f20c4164d70 secure :-1 s=READY pgs=1224 cs=0 l=1 rx=0x7f20bc00af50 tx=0x7f20bc00b250).stop 2019-11-28T11:37:21.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.292+0000 7f20c990f700 1 -- 172.21.15.80:0/2788616408 shutdown_connections 2019-11-28T11:37:21.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.292+0000 7f20c990f700 1 --2- 172.21.15.80:0/2788616408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4072620 0x7f20c4164d70 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.292+0000 7f20c990f700 1 --2- 172.21.15.80:0/2788616408 >> v2:172.21.15.174:3300/0 conn(0x7f20c406c0a0 0x7f20c4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:21.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.292+0000 7f20c990f700 1 -- 172.21.15.80:0/2788616408 shutdown_connections 2019-11-28T11:37:21.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.292+0000 7f20c990f700 1 -- 172.21.15.80:0/2788616408 wait complete. 2019-11-28T11:37:21.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.292+0000 7f20c990f700 1 -- 172.21.15.80:0/2788616408 >> 172.21.15.80:0/2788616408 conn(0x7f20c4061cf0 msgr2=0x7f20c4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:21.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.294+0000 7f20c990f700 1 Processor -- start 2019-11-28T11:37:21.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.295+0000 7f20c990f700 1 -- start start 2019-11-28T11:37:21.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.295+0000 7f20c990f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20c4104820 0x7f20c410c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:21.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.295+0000 7f20c990f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f20c410c890 0x7f20c410b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:21.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.295+0000 7f20c990f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c413bcd0 con 0x7f20c410b710 2019-11-28T11:37:21.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.295+0000 7f20c990f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c4109130 con 0x7f20c4104820 2019-11-28T11:37:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.295+0000 7f20c990f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c4109400 con 0x7f20c410c890 2019-11-28T11:37:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.295+0000 7f20c37fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20c4104820 0x7f20c410c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c37fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20c4104820 0x7f20c410c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37394/0 (socket says 172.21.15.80:37394) 2019-11-28T11:37:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c37fe700 1 -- 172.21.15.80:0/3500975274 learned_addr learned my addr 172.21.15.80:0/3500975274 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f20c410b710 0x7f20c4104c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36712/0 (socket says 172.21.15.80:36712) 2019-11-28T11:37:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20baffd700 1 --2- 172.21.15.80:0/3500975274 >> v2:172.21.15.174:3300/0 conn(0x7f20c410c890 0x7f20c410b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c37fe700 1 -- 172.21.15.80:0/3500975274 >> v2:172.21.15.174:3300/0 conn(0x7f20c410c890 msgr2=0x7f20c410b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c37fe700 1 --2- 172.21.15.80:0/3500975274 >> v2:172.21.15.174:3300/0 conn(0x7f20c410c890 0x7f20c410b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c37fe700 1 -- 172.21.15.80:0/3500975274 >> v1:172.21.15.80:6789/0 conn(0x7f20c410b710 legacy=0x7f20c4104c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c0ff9700 1 -- 172.21.15.80:0/3500975274 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710308810 0 0) 0x7f20bc009580 con 0x7f20c410b710 2019-11-28T11:37:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c37fe700 1 -- 172.21.15.80:0/3500975274 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c4109a90 con 0x7f20c4104820 2019-11-28T11:37:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c37fe700 1 --2- 172.21.15.80:0/3500975274 >> v2:172.21.15.80:3300/0 conn(0x7f20c4104820 0x7f20c410c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20b40107c0 tx=0x7f20b400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c37fe700 1 --2- 172.21.15.80:0/3500975274 >> v2:172.21.15.80:3300/0 conn(0x7f20c4104820 0x7f20c410c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20b40107c0 tx=0x7f20b400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c37fe700 1 --2- 172.21.15.80:0/3500975274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4104820 0x7f20c410c350 secure :-1 s=READY pgs=1226 cs=0 l=1 rx=0x7f20b40107c0 tx=0x7f20b400b790).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c37fe700 1 --2- 172.21.15.80:0/3500975274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4104820 0x7f20c410c350 secure :-1 s=THROTTLE_DONE pgs=1226 cs=0 l=1 rx=0x7f20b40107c0 tx=0x7f20b400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c0ff9700 1 -- 172.21.15.80:0/3500975274 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20b4000cc0 con 0x7f20c4104820 2019-11-28T11:37:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c37fe700 1 --2- 172.21.15.80:0/3500975274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4104820 0x7f20c410c350 secure :-1 s=THROTTLE_DONE pgs=1226 cs=0 l=1 rx=0x7f20b40107c0 tx=0x7f20b400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c37fe700 1 --2- 172.21.15.80:0/3500975274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4104820 0x7f20c410c350 secure :-1 s=THROTTLE_DONE pgs=1226 cs=0 l=1 rx=0x7f20b40107c0 tx=0x7f20b400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c0ff9700 1 -- 172.21.15.80:0/3500975274 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b400e2c0 con 0x7f20c4104820 2019-11-28T11:37:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c990f700 1 -- 172.21.15.80:0/3500975274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c4109e10 con 0x7f20c4104820 2019-11-28T11:37:21.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c0ff9700 1 -- 172.21.15.80:0/3500975274 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20b400e9f0 con 0x7f20c4104820 2019-11-28T11:37:21.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f20c990f700 1 -- 172.21.15.80:0/3500975274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c4109a90 con 0x7f20c4104820 2019-11-28T11:37:21.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.297+0000 7f20c37fe700 1 --2- 172.21.15.80:0/3500975274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4104820 0x7f20c410c350 secure :-1 s=THROTTLE_DONE pgs=1226 cs=0 l=1 rx=0x7f20b40107c0 tx=0x7f20b400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.297+0000 7f20c0ff9700 1 -- 172.21.15.80:0/3500975274 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f20b400e4b0 con 0x7f20c4104820 2019-11-28T11:37:21.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.297+0000 7f20c37fe700 1 --2- 172.21.15.80:0/3500975274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4104820 0x7f20c410c350 secure :-1 s=THROTTLE_DONE pgs=1226 cs=0 l=1 rx=0x7f20b40107c0 tx=0x7f20b400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.297+0000 7f20c0ff9700 1 --2- 172.21.15.80:0/3500975274 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f20a8018730 0x7f20a801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:21.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.297+0000 7f20c0ff9700 1 -- 172.21.15.80:0/3500975274 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f20b40320b0 con 0x7f20c4104820 2019-11-28T11:37:21.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.297+0000 7f20baffd700 1 --2- 172.21.15.80:0/3500975274 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f20a8018730 0x7f20a801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:21.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.298+0000 7f20baffd700 1 --2- 172.21.15.80:0/3500975274 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f20a8018730 0x7f20a801abe0 crc :-1 s=READY pgs=497 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:21.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.304+0000 7f20c990f700 1 -- 172.21.15.80:0/3500975274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c4109e10 con 0x7f20c4104820 2019-11-28T11:37:21.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.307+0000 7f20c37fe700 1 --2- 172.21.15.80:0/3500975274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4104820 0x7f20c410c350 secure :-1 s=THROTTLE_DONE pgs=1226 cs=0 l=1 rx=0x7f20b40107c0 tx=0x7f20b400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.308+0000 7f20c0ff9700 1 -- 172.21.15.80:0/3500975274 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f20b400e2c0 con 0x7f20c4104820 2019-11-28T11:37:21.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.289+0000 7f096785b700 1 Processor -- start 2019-11-28T11:37:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.289+0000 7f096785b700 1 -- start start 2019-11-28T11:37:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f096785b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f096006c0a0 0x7f0960072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f096785b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09600734e0 0x7f0960071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:37:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f096785b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f096006db00 con 0x7f0960072360 2019-11-28T11:37:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f096785b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f096006f330 con 0x7f09600734e0 2019-11-28T11:37:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f096785b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09600706c0 con 0x7f096006c0a0 2019-11-28T11:37:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f09655f7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09600734e0 0x7f0960071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f09655f7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09600734e0 0x7f0960071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37386/0 (socket says 172.21.15.80:37386) 2019-11-28T11:37:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f09655f7700 1 -- 172.21.15.80:0/3192400692 learned_addr learned my addr 172.21.15.80:0/3192400692 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.290+0000 7f0965df8700 1 --2- 172.21.15.80:0/3192400692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f096006c0a0 0x7f0960072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f09655f7700 1 -- 172.21.15.80:0/3192400692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f096006c0a0 msgr2=0x7f0960072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:37:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f09655f7700 1 --2- 172.21.15.80:0/3192400692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f096006c0a0 0x7f0960072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f09655f7700 1 -- 172.21.15.80:0/3192400692 >> v1:172.21.15.80:6789/0 conn(0x7f0960072360 legacy=0x7f096006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f09655f7700 1 -- 172.21.15.80:0/3192400692 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0960070a40 con 0x7f09600734e0 2019-11-28T11:37:21.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f09655f7700 1 --2- 172.21.15.80:0/3192400692 >> v2:172.21.15.80:3300/0 conn(0x7f09600734e0 0x7f0960071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f095400f6c0 tx=0x7f095400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f09655f7700 1 --2- 172.21.15.80:0/3192400692 >> v2:172.21.15.80:3300/0 conn(0x7f09600734e0 0x7f0960071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f095400f6c0 tx=0x7f095400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f09655f7700 1 --2- 172.21.15.80:0/3192400692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09600734e0 0x7f0960071e20 secure :-1 s=READY pgs=1223 cs=0 l=1 rx=0x7f095400f6c0 tx=0x7f095400fa60).ready entity=mon.0 client_cookie=faa82cc7838adb6a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:21.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f09655f7700 1 --2- 172.21.15.80:0/3192400692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09600734e0 0x7f0960071e20 secure :-1 s=THROTTLE_DONE pgs=1223 cs=0 l=1 rx=0x7f095400f6c0 tx=0x7f095400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f09655f7700 1 --2- 172.21.15.80:0/3192400692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09600734e0 0x7f0960071e20 secure :-1 s=THROTTLE_DONE pgs=1223 cs=0 l=1 rx=0x7f095400f6c0 tx=0x7f095400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f09655f7700 1 --2- 172.21.15.80:0/3192400692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09600734e0 0x7f0960071e20 secure :-1 s=THROTTLE_DONE pgs=1223 cs=0 l=1 rx=0x7f095400f6c0 tx=0x7f095400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f0964df6700 1 -- 172.21.15.80:0/3192400692 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0954000960 con 0x7f09600734e0 2019-11-28T11:37:21.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f0964df6700 1 -- 172.21.15.80:0/3192400692 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0954000c90 con 0x7f09600734e0 2019-11-28T11:37:21.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f0964df6700 1 -- 172.21.15.80:0/3192400692 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0954001320 con 0x7f09600734e0 2019-11-28T11:37:21.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f096785b700 1 -- 172.21.15.80:0/3192400692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09600734e0 msgr2=0x7f0960071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.291+0000 7f096785b700 1 --2- 172.21.15.80:0/3192400692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09600734e0 0x7f0960071e20 secure :-1 s=READY pgs=1223 cs=0 l=1 rx=0x7f095400f6c0 tx=0x7f095400fa60).stop 2019-11-28T11:37:21.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.292+0000 7f096785b700 1 -- 172.21.15.80:0/3192400692 shutdown_connections 2019-11-28T11:37:21.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.292+0000 7f096785b700 1 --2- 172.21.15.80:0/3192400692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09600734e0 0x7f0960071e20 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.292+0000 7f096785b700 1 --2- 172.21.15.80:0/3192400692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f096006c0a0 0x7f0960072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:37:21.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.292+0000 7f096785b700 1 -- 172.21.15.80:0/3192400692 shutdown_connections 2019-11-28T11:37:21.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.292+0000 7f096785b700 1 -- 172.21.15.80:0/3192400692 wait complete. 2019-11-28T11:37:21.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.292+0000 7f096785b700 1 -- 172.21.15.80:0/3192400692 >> 172.21.15.80:0/3192400692 conn(0x7f0960061cf0 msgr2=0x7f0960064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:21.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.295+0000 7f096785b700 1 Processor -- start 2019-11-28T11:37:21.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.295+0000 7f096785b700 1 -- start start 2019-11-28T11:37:21.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.295+0000 7f096785b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f096015fdf0 0x7f096012b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:21.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.295+0000 7f096785b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f096012b8a0 0x7f096013e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:21.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f096785b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0960139e00 con 0x7f096013e860 2019-11-28T11:37:21.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f096785b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0960108820 con 0x7f096015fdf0 2019-11-28T11:37:21.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f096785b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0960108af0 con 0x7f096012b8a0 2019-11-28T11:37:21.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f0965df8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f096015fdf0 0x7f096012b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:21.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f0965df8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f096015fdf0 0x7f096012b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:52286/0 (socket says 172.21.15.80:52286) 2019-11-28T11:37:21.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f0965df8700 1 -- 172.21.15.80:0/4028319679 learned_addr learned my addr 172.21.15.80:0/4028319679 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:37:21.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f09655f7700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f096012b8a0 0x7f096013e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:21.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f09665f9700 1 --1- 172.21.15.80:0/4028319679 >> v1:172.21.15.174:6789/0 conn(0x7f096013e860 0x7f096012a3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:52262/0 (socket says 172.21.15.80:52262) 2019-11-28T11:37:21.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f095e7fc700 1 -- 172.21.15.80:0/4028319679 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292830790 0 0) 0x7f0958001170 con 0x7f096013e860 2019-11-28T11:37:21.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f095e7fc700 1 -- 172.21.15.80:0/4028319679 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0940002e80 con 0x7f096013e860 2019-11-28T11:37:21.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f0965df8700 1 -- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f096012b8a0 msgr2=0x7f096013e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f0965df8700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f096012b8a0 0x7f096013e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f0965df8700 1 -- 172.21.15.80:0/4028319679 >> v1:172.21.15.174:6789/0 conn(0x7f096013e860 legacy=0x7f096012a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f0965df8700 1 -- 172.21.15.80:0/4028319679 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096010a8c0 con 0x7f096015fdf0 2019-11-28T11:37:21.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f09655f7700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f096012b8a0 0x7f096013e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:37:21.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f0965df8700 1 --2- 172.21.15.80:0/4028319679 >> v2:172.21.15.174:3300/0 conn(0x7f096015fdf0 0x7f096012b360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f09500107e0 tx=0x7f0950010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f0965df8700 1 --2- 172.21.15.80:0/4028319679 >> v2:172.21.15.174:3300/0 conn(0x7f096015fdf0 0x7f096012b360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f09500107e0 tx=0x7f0950010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.296+0000 7f0965df8700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f096015fdf0 0x7f096012b360 secure :-1 s=READY pgs=726 cs=0 l=1 rx=0x7f09500107e0 tx=0x7f0950010b80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:21.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.297+0000 7f0965df8700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f096015fdf0 0x7f096012b360 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7f09500107e0 tx=0x7f0950010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.297+0000 7f0965df8700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f096015fdf0 0x7f096012b360 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7f09500107e0 tx=0x7f0950010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.297+0000 7f0965df8700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f096015fdf0 0x7f096012b360 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7f09500107e0 tx=0x7f0950010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.297+0000 7f095e7fc700 1 -- 172.21.15.80:0/4028319679 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09500058e0 con 0x7f096015fdf0 2019-11-28T11:37:21.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.297+0000 7f095e7fc700 1 -- 172.21.15.80:0/4028319679 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0950005500 con 0x7f096015fdf0 2019-11-28T11:37:21.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.297+0000 7f095e7fc700 1 -- 172.21.15.80:0/4028319679 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0950006040 con 0x7f096015fdf0 2019-11-28T11:37:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.297+0000 7f096785b700 1 -- 172.21.15.80:0/4028319679 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f096010a8c0 con 0x7f096015fdf0 2019-11-28T11:37:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.297+0000 7f096785b700 1 -- 172.21.15.80:0/4028319679 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0960109180 con 0x7f096015fdf0 2019-11-28T11:37:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.298+0000 7f0965df8700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f096015fdf0 0x7f096012b360 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7f09500107e0 tx=0x7f0950010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.298+0000 7f095e7fc700 1 -- 172.21.15.80:0/4028319679 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f09500095c0 con 0x7f096015fdf0 2019-11-28T11:37:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.298+0000 7f0965df8700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f096015fdf0 0x7f096012b360 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7f09500107e0 tx=0x7f0950010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.298+0000 7f095e7fc700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0940018770 0x7f094001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:37:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.298+0000 7f095e7fc700 1 -- 172.21.15.80:0/4028319679 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0950031e60 con 0x7f096015fdf0 2019-11-28T11:37:21.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.298+0000 7f09655f7700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0940018770 0x7f094001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:37:21.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.298+0000 7f09655f7700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0940018770 0x7f094001abe0 crc :-1 s=READY pgs=498 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:37:21.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.304+0000 7f096785b700 1 -- 172.21.15.80:0/4028319679 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0960109500 con 0x7f096015fdf0 2019-11-28T11:37:21.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.308+0000 7f0965df8700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f096015fdf0 0x7f096012b360 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7f09500107e0 tx=0x7f0950010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.308+0000 7f095e7fc700 1 -- 172.21.15.80:0/4028319679 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0950006300 con 0x7f096015fdf0 2019-11-28T11:37:21.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.488+0000 7f8ed1f87700 1 -- 172.21.15.80:0/3866542627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f8ecc0790b0 con 0x7f8ecc12dca0 2019-11-28T11:37:21.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.496+0000 7f20c990f700 1 -- 172.21.15.80:0/3500975274 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f20c4109a90 con 0x7f20c4104820 2019-11-28T11:37:21.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.497+0000 7f096785b700 1 -- 172.21.15.80:0/4028319679 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f0960109180 con 0x7f096015fdf0 2019-11-28T11:37:21.611 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:37:21.539+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:37:21.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.541+0000 7f8ed0d25700 1 --2- 172.21.15.80:0/3866542627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc12dca0 0x7f8ecc12e0d0 secure :-1 s=THROTTLE_DONE pgs=1221 cs=0 l=1 rx=0x7f8ec40107d0 tx=0x7f8ec4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.541+0000 7f8ec8ff9700 1 -- 172.21.15.80:0/3866542627 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7482 v61) v1 ==== 95+0+0 (secure 0 0 0) 0x7f8ec4009f60 con 0x7f8ecc12dca0 2019-11-28T11:37:21.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.541+0000 7f20c37fe700 1 --2- 172.21.15.80:0/3500975274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4104820 0x7f20c410c350 secure :-1 s=THROTTLE_DONE pgs=1226 cs=0 l=1 rx=0x7f20b40107c0 tx=0x7f20b400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.541+0000 7f20c0ff9700 1 -- 172.21.15.80:0/3500975274 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7108 v61) v1 ==== 95+0+0 (secure 0 0 0) 0x7f20b400e4d0 con 0x7f20c4104820 2019-11-28T11:37:21.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.542+0000 7f0965df8700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f096015fdf0 0x7f096012b360 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7f09500107e0 tx=0x7f0950010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:37:21.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.542+0000 7f095e7fc700 1 -- 172.21.15.80:0/4028319679 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7476 v61) v1 ==== 95+0+0 (secure 0 0 0) 0x7f09500095c0 con 0x7f096015fdf0 2019-11-28T11:37:21.614 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 7482 2019-11-28T11:37:21.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.554+0000 7f8ed1f87700 1 -- 172.21.15.80:0/3866542627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8eac018730 msgr2=0x7f8eac01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.554+0000 7f8ed1f87700 1 --2- 172.21.15.80:0/3866542627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8eac018730 0x7f8eac01abc0 crc :-1 s=READY pgs=496 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.554+0000 7f8ed1f87700 1 -- 172.21.15.80:0/3866542627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc12dca0 msgr2=0x7f8ecc12e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.554+0000 7f8ed1f87700 1 --2- 172.21.15.80:0/3866542627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc12dca0 0x7f8ecc12e0d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rx=0x7f8ec40107d0 tx=0x7f8ec4010650).stop 2019-11-28T11:37:21.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.554+0000 7f8ed1f87700 1 -- 172.21.15.80:0/3866542627 shutdown_connections 2019-11-28T11:37:21.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.554+0000 7f8ed1f87700 1 --2- 172.21.15.80:0/3866542627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc12dca0 0x7f8ecc12e0d0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.554+0000 7f8ed1f87700 1 --2- 172.21.15.80:0/3866542627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8eac018730 0x7f8eac01abc0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.554+0000 7f8ed1f87700 1 --2- 172.21.15.80:0/3866542627 >> v2:172.21.15.174:3300/0 conn(0x7f8ecc142d00 0x7f8ecc07b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.554+0000 7f8ed1f87700 1 -- 172.21.15.80:0/3866542627 shutdown_connections 2019-11-28T11:37:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.554+0000 7f8ed1f87700 1 -- 172.21.15.80:0/3866542627 wait complete. 2019-11-28T11:37:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.554+0000 7f8ed1f87700 1 -- 172.21.15.80:0/3866542627 >> 172.21.15.80:0/3866542627 conn(0x7f8ecc07c680 msgr2=0x7f8ecc112150 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:21.621 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 7108 2019-11-28T11:37:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 7476 2019-11-28T11:37:21.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.561+0000 7f20c990f700 1 -- 172.21.15.80:0/3500975274 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f20a8018730 msgr2=0x7f20a801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.561+0000 7f20c990f700 1 --2- 172.21.15.80:0/3500975274 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f20a8018730 0x7f20a801abe0 crc :-1 s=READY pgs=497 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.561+0000 7f20c990f700 1 -- 172.21.15.80:0/3500975274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4104820 msgr2=0x7f20c410c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.561+0000 7f20c990f700 1 --2- 172.21.15.80:0/3500975274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4104820 0x7f20c410c350 secure :-1 s=READY pgs=1226 cs=0 l=1 rx=0x7f20b40107c0 tx=0x7f20b400b790).stop 2019-11-28T11:37:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.561+0000 7f20c990f700 1 -- 172.21.15.80:0/3500975274 shutdown_connections 2019-11-28T11:37:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.561+0000 7f20c990f700 1 --2- 172.21.15.80:0/3500975274 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f20a8018730 0x7f20a801abe0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.561+0000 7f20c990f700 1 --2- 172.21.15.80:0/3500975274 >> v2:172.21.15.174:3300/0 conn(0x7f20c410c890 0x7f20c410b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.561+0000 7f20c990f700 1 --2- 172.21.15.80:0/3500975274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20c4104820 0x7f20c410c350 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.562+0000 7f20c990f700 1 -- 172.21.15.80:0/3500975274 shutdown_connections 2019-11-28T11:37:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.562+0000 7f20c990f700 1 -- 172.21.15.80:0/3500975274 wait complete. 2019-11-28T11:37:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.562+0000 7f20c990f700 1 -- 172.21.15.80:0/3500975274 >> 172.21.15.80:0/3500975274 conn(0x7f20c413d620 msgr2=0x7f20c413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.563+0000 7f096785b700 1 -- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0940018770 msgr2=0x7f094001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.563+0000 7f096785b700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0940018770 0x7f094001abe0 crc :-1 s=READY pgs=498 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.563+0000 7f096785b700 1 -- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f096015fdf0 msgr2=0x7f096012b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:37:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.563+0000 7f096785b700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f096015fdf0 0x7f096012b360 secure :-1 s=READY pgs=726 cs=0 l=1 rx=0x7f09500107e0 tx=0x7f0950010b80).stop 2019-11-28T11:37:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.563+0000 7f096785b700 1 -- 172.21.15.80:0/4028319679 shutdown_connections 2019-11-28T11:37:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.563+0000 7f096785b700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0940018770 0x7f094001abe0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.563+0000 7f096785b700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f096012b8a0 0x7f096013e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.563+0000 7f096785b700 1 --2- 172.21.15.80:0/4028319679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f096015fdf0 0x7f096012b360 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:37:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.564+0000 7f096785b700 1 -- 172.21.15.80:0/4028319679 shutdown_connections 2019-11-28T11:37:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.564+0000 7f096785b700 1 -- 172.21.15.80:0/4028319679 wait complete. 2019-11-28T11:37:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:37:21.564+0000 7f096785b700 1 -- 172.21.15.80:0/4028319679 >> 172.21.15.80:0/4028319679 conn(0x7f0960127dc0 msgr2=0x7f0960141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:37:21.630 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:37:21.636 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:37:21.637 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:37:21.704 INFO:teuthology.orchestra.console:Performing hard reset of smithi076 2019-11-28T11:37:21.705 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power reset 2019-11-28T11:37:21.768 INFO:teuthology.orchestra.console:Hard reset for smithi076 completed 2019-11-28T11:37:27.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2019-11-28T11:37:27.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2019-11-28T11:37:49.633 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:37:49.640 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:37:49.653 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:37:51.871 INFO:teuthology.misc:Re-opening connections... 2019-11-28T11:37:51.871 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:37:51.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:37:51.873 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:37:51.883 DEBUG:tasks.ceph:Missed logrotate, EOFError 2019-11-28T11:38:02.040 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:38:02.041 DEBUG:teuthology.misc:waited 10.1697430611 2019-11-28T11:38:03.042 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:38:03.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:03.042 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:38:06.109 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:38:06.110 DEBUG:teuthology.misc:waited 14.2388510704 2019-11-28T11:38:07.110 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:38:07.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:07.111 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:38:09.176 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:38:09.177 DEBUG:teuthology.misc:waited 17.3057510853 2019-11-28T11:38:10.177 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:38:10.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:10.178 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:38:12.252 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:38:12.440 DEBUG:teuthology.misc:waited 20.5695691109 2019-11-28T11:38:13.442 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:38:13.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:13.443 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:38:15.321 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:38:15.321 DEBUG:teuthology.misc:waited 23.4502770901 2019-11-28T11:38:16.322 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:38:16.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:16.322 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:38:18.392 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:38:18.393 DEBUG:teuthology.misc:waited 26.521791935 2019-11-28T11:38:19.394 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:38:19.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:19.395 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:38:21.468 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:38:21.469 DEBUG:teuthology.misc:waited 29.5977339745 2019-11-28T11:38:21.884 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:38:21.889 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:38:21.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:21.894 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:38:22.469 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:38:22.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:22.470 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:38:24.549 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:38:24.549 DEBUG:teuthology.misc:waited 32.6781959534 2019-11-28T11:38:24.549 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:38:24.550 DEBUG:tasks.ceph:Missed logrotate, node 'smithi076' is offline 2019-11-28T11:38:25.550 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:38:25.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:25.551 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:38:27.612 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:38:27.613 DEBUG:teuthology.misc:waited 35.7417089939 2019-11-28T11:38:28.613 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:38:28.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:28.614 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:38:30.680 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:38:30.681 DEBUG:teuthology.misc:waited 38.8097190857 2019-11-28T11:38:31.681 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:38:31.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:31.682 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:38:33.759 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:38:33.760 DEBUG:teuthology.misc:waited 41.8886950016 2019-11-28T11:38:34.760 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:38:34.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:34.761 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:38:36.824 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:38:36.825 DEBUG:teuthology.misc:waited 44.9538929462 2019-11-28T11:38:37.825 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:38:37.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:37.826 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:38:39.896 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:38:44.804 DEBUG:teuthology.misc:waited 52.9326360226 2019-11-28T11:38:45.804 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:38:45.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:45.805 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:38:46.588 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:38:46.589 DEBUG:teuthology.misc:waited 54.7179889679 2019-11-28T11:38:47.590 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:38:47.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:47.590 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:38:50.649 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:38:50.649 DEBUG:teuthology.misc:waited 58.7780458927 2019-11-28T11:38:51.650 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:38:51.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:51.651 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:38:54.552 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:38:54.558 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:38:54.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:38:54.564 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:39:51.653 DEBUG:teuthology.orchestra.remote:timed out 2019-11-28T11:39:51.654 DEBUG:teuthology.misc:waited 119.782644987 2019-11-28T11:39:52.654 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:39:52.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:39:52.655 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:39:52.757 INFO:teuthology.orchestra.run.smithi076:> true 2019-11-28T11:39:53.118 DEBUG:teuthology.misc:waited 121.247394085 2019-11-28T11:39:54.120 INFO:teuthology.orchestra.run:Running command with timeout 10 2019-11-28T11:39:54.120 INFO:teuthology.orchestra.run.smithi076:> uptime 2019-11-28T11:39:54.192 INFO:teuthology.orchestra.run.smithi076.stdout: 11:39:54 up 0 min, 0 users, load average: 0.66, 0.22, 0.08 2019-11-28T11:39:54.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:39:54.193 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:39:54.267 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:39:54.268 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:39:54.268 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:39:54.268 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:39:54.269 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:39:54.269 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:39:54.274 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:39:54.275 DEBUG:teuthology.parallel:result is None 2019-11-28T11:39:54.276 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:39:54.276 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:39:54.277 DEBUG:teuthology.parallel:result is None 2019-11-28T11:39:54.277 DEBUG:teuthology.parallel:result is None 2019-11-28T11:39:54.277 INFO:tasks.cephfs.test_client_recovery:Waiting for reconnect... 2019-11-28T11:39:54.278 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:39:54.365 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:39:54.371 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:39:54.373 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:39:54.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.375+0000 7fd036c07700 1 Processor -- start 2019-11-28T11:39:54.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.375+0000 7fd036c07700 1 -- start start 2019-11-28T11:39:54.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd036c07700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd03006c0a0 0x7fd030072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:39:54.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd036c07700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd0300734e0 0x7fd030071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:39:54.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd036c07700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd03006db00 con 0x7fd030072360 2019-11-28T11:39:54.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd036c07700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03006fd60 con 0x7fd0300734e0 2019-11-28T11:39:54.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd036c07700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd030070030 con 0x7fd03006c0a0 2019-11-28T11:39:54.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd0349a3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd0300734e0 0x7fd030071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:54.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd0349a3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd0300734e0 0x7fd030071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37438/0 (socket says 172.21.15.80:37438) 2019-11-28T11:39:54.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd0349a3700 1 -- 172.21.15.80:0/826455058 learned_addr learned my addr 172.21.15.80:0/826455058 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:39:54.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd0351a4700 1 --2- 172.21.15.80:0/826455058 >> v2:172.21.15.174:3300/0 conn(0x7fd03006c0a0 0x7fd030072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:54.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd0349a3700 1 -- 172.21.15.80:0/826455058 >> v2:172.21.15.174:3300/0 conn(0x7fd03006c0a0 msgr2=0x7fd030072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:39:54.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd0349a3700 1 --2- 172.21.15.80:0/826455058 >> v2:172.21.15.174:3300/0 conn(0x7fd03006c0a0 0x7fd030072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:39:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd0349a3700 1 -- 172.21.15.80:0/826455058 >> v1:172.21.15.174:6789/0 conn(0x7fd030072360 legacy=0x7fd03006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd0349a3700 1 -- 172.21.15.80:0/826455058 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0300706c0 con 0x7fd0300734e0 2019-11-28T11:39:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd0349a3700 1 --2- 172.21.15.80:0/826455058 >> v2:172.21.15.80:3300/0 conn(0x7fd0300734e0 0x7fd030071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd01800fa40 tx=0x7fd01800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd0349a3700 1 --2- 172.21.15.80:0/826455058 >> v2:172.21.15.80:3300/0 conn(0x7fd0300734e0 0x7fd030071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd01800fa40 tx=0x7fd01800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd0349a3700 1 --2- 172.21.15.80:0/826455058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0300734e0 0x7fd030071e20 secure :-1 s=READY pgs=1231 cs=0 l=1 rx=0x7fd01800fa40 tx=0x7fd01800fde0).ready entity=mon.0 client_cookie=5f07349327fe1536 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:39:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd0349a3700 1 --2- 172.21.15.80:0/826455058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0300734e0 0x7fd030071e20 secure :-1 s=THROTTLE_DONE pgs=1231 cs=0 l=1 rx=0x7fd01800fa40 tx=0x7fd01800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd0349a3700 1 --2- 172.21.15.80:0/826455058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0300734e0 0x7fd030071e20 secure :-1 s=THROTTLE_DONE pgs=1231 cs=0 l=1 rx=0x7fd01800fa40 tx=0x7fd01800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd02ffff700 1 -- 172.21.15.80:0/826455058 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd018000ce0 con 0x7fd0300734e0 2019-11-28T11:39:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd0349a3700 1 --2- 172.21.15.80:0/826455058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0300734e0 0x7fd030071e20 secure :-1 s=THROTTLE_DONE pgs=1231 cs=0 l=1 rx=0x7fd01800fa40 tx=0x7fd01800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.376+0000 7fd02ffff700 1 -- 172.21.15.80:0/826455058 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd018001010 con 0x7fd0300734e0 2019-11-28T11:39:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.377+0000 7fd02ffff700 1 -- 172.21.15.80:0/826455058 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd018001720 con 0x7fd0300734e0 2019-11-28T11:39:54.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.377+0000 7fd036c07700 1 -- 172.21.15.80:0/826455058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0300734e0 msgr2=0x7fd030071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:54.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.377+0000 7fd036c07700 1 --2- 172.21.15.80:0/826455058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0300734e0 0x7fd030071e20 secure :-1 s=READY pgs=1231 cs=0 l=1 rx=0x7fd01800fa40 tx=0x7fd01800fde0).stop 2019-11-28T11:39:54.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.377+0000 7fd036c07700 1 -- 172.21.15.80:0/826455058 shutdown_connections 2019-11-28T11:39:54.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.377+0000 7fd036c07700 1 --2- 172.21.15.80:0/826455058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0300734e0 0x7fd030071e20 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:54.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.377+0000 7fd036c07700 1 --2- 172.21.15.80:0/826455058 >> v2:172.21.15.174:3300/0 conn(0x7fd03006c0a0 0x7fd030072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:39:54.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.377+0000 7fd036c07700 1 -- 172.21.15.80:0/826455058 shutdown_connections 2019-11-28T11:39:54.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.377+0000 7fd036c07700 1 -- 172.21.15.80:0/826455058 wait complete. 2019-11-28T11:39:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.377+0000 7fd036c07700 1 -- 172.21.15.80:0/826455058 >> 172.21.15.80:0/826455058 conn(0x7fd030061cf0 msgr2=0x7fd030064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:39:54.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.380+0000 7fd036c07700 1 Processor -- start 2019-11-28T11:39:54.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.380+0000 7fd036c07700 1 -- start start 2019-11-28T11:39:54.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd036c07700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd030128e40 0x7fd030168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:54.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd036c07700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd030139a60 con 0x7fd0301281b0 2019-11-28T11:39:54.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd036c07700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd03013b060 con 0x7fd03013a780 2019-11-28T11:39:54.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd036c07700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03012a260 con 0x7fd030128e40 2019-11-28T11:39:54.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd0349a3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd0301281b0 0x7fd030128640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36758/0 (socket says 172.21.15.80:36758) 2019-11-28T11:39:54.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd0349a3700 1 -- 172.21.15.80:0/3391643285 learned_addr learned my addr 172.21.15.80:0/3391643285 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:39:54.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd0359a5700 1 --2- 172.21.15.80:0/3391643285 >> v2:172.21.15.174:3300/0 conn(0x7fd030128e40 0x7fd030168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:54.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100932635 0 0) 0x7fd018008120 con 0x7fd0301281b0 2019-11-28T11:39:54.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd014002e80 con 0x7fd0301281b0 2019-11-28T11:39:54.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718065436 0 0) 0x7fd020009790 con 0x7fd03013a780 2019-11-28T11:39:54.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0140030b0 con 0x7fd03013a780 2019-11-28T11:39:54.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4293673611 0 0) 0x7fd018008120 con 0x7fd0301281b0 2019-11-28T11:39:54.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd0140033c0 con 0x7fd0301281b0 2019-11-28T11:39:54.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd018000cc0 con 0x7fd0301281b0 2019-11-28T11:39:54.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 >> v2:172.21.15.174:3300/0 conn(0x7fd030128e40 msgr2=0x7fd030168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:54.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 --2- 172.21.15.80:0/3391643285 >> v2:172.21.15.174:3300/0 conn(0x7fd030128e40 0x7fd030168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:54.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 >> v1:172.21.15.174:6789/0 conn(0x7fd03013a780 legacy=0x7fd03012d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:54.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 >> v1:172.21.15.80:6789/0 conn(0x7fd0301281b0 legacy=0x7fd030128640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:54.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd014005d40 0x7fd014006130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:54.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0140046f0 0x7fd014004b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:54.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0140051a0 0x7fd0140032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:54.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0140039f0 con 0x7fd0140046f0 2019-11-28T11:39:54.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd014003c20 con 0x7fd014005d40 2019-11-28T11:39:54.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd014003e50 con 0x7fd0140051a0 2019-11-28T11:39:54.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd0359a5700 1 --2- 172.21.15.80:0/3391643285 >> v2:172.21.15.174:3300/0 conn(0x7fd030128e40 0x7fd030168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:39:54.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.381+0000 7fd0349a3700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0140046f0 0x7fd014004b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:54.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd0351a4700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd014005d40 0x7fd014006130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:54.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd0359a5700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0140051a0 0x7fd0140032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:54.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd0349a3700 1 -- 172.21.15.80:0/3391643285 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0140051a0 msgr2=0x7fd0140032e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:54.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd0349a3700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0140051a0 0x7fd0140032e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:54.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd0349a3700 1 -- 172.21.15.80:0/3391643285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd014005d40 msgr2=0x7fd014006130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:54.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd0349a3700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd014005d40 0x7fd014006130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:54.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd0349a3700 1 -- 172.21.15.80:0/3391643285 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd014004100 con 0x7fd0140046f0 2019-11-28T11:39:54.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd0359a5700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0140051a0 0x7fd0140032e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:39:54.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd036c07700 1 -- 172.21.15.80:0/3391643285 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd03012af40 con 0x7fd0140046f0 2019-11-28T11:39:54.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd0359a5700 1 -- 172.21.15.80:0/3391643285 reap_dead start 2019-11-28T11:39:54.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd0349a3700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0140046f0 0x7fd014004b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0180107c0 tx=0x7fd0180106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:54.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd036c07700 1 -- 172.21.15.80:0/3391643285 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03012abc0 con 0x7fd0140046f0 2019-11-28T11:39:54.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd0349a3700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0140046f0 0x7fd014004b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0180107c0 tx=0x7fd0180106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:54.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd0349a3700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0140046f0 0x7fd014004b50 secure :-1 s=READY pgs=1233 cs=0 l=1 rx=0x7fd0180107c0 tx=0x7fd0180106c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:39:54.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd0349a3700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0140046f0 0x7fd014004b50 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7fd0180107c0 tx=0x7fd0180106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:54.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd018000eb0 con 0x7fd0140046f0 2019-11-28T11:39:54.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd0349a3700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0140046f0 0x7fd014004b50 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7fd0180107c0 tx=0x7fd0180106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:54.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd0349a3700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0140046f0 0x7fd014004b50 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7fd0180107c0 tx=0x7fd0180106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:54.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd018008120 con 0x7fd0140046f0 2019-11-28T11:39:54.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd018000cc0 con 0x7fd0140046f0 2019-11-28T11:39:54.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.382+0000 7fd0349a3700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0140046f0 0x7fd014004b50 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7fd0180107c0 tx=0x7fd0180106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:54.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.383+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd018000cc0 con 0x7fd0140046f0 2019-11-28T11:39:54.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.383+0000 7fd0349a3700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0140046f0 0x7fd014004b50 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7fd0180107c0 tx=0x7fd0180106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:54.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.383+0000 7fd02dffb700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd01401b4c0 0x7fd01401d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:54.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.383+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fd018031f80 con 0x7fd0140046f0 2019-11-28T11:39:54.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.383+0000 7fd0351a4700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd01401b4c0 0x7fd01401d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:54.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.383+0000 7fd0351a4700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd01401b4c0 0x7fd01401d8f0 crc :-1 s=READY pgs=499 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:39:54.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.390+0000 7fd036c07700 1 -- 172.21.15.80:0/3391643285 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd008002e60 con 0x7fd0140046f0 2019-11-28T11:39:54.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.394+0000 7fd0349a3700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0140046f0 0x7fd014004b50 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7fd0180107c0 tx=0x7fd0180106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:54.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.394+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd018007950 con 0x7fd0140046f0 2019-11-28T11:39:54.566 DEBUG:teuthology.orchestra.remote:timed out 2019-11-28T11:39:54.679 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:39:54.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.566+0000 7fd036c07700 1 -- 172.21.15.80:0/3391643285 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd008001d10 con 0x7fd0140046f0 2019-11-28T11:39:54.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.566+0000 7fd0349a3700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0140046f0 0x7fd014004b50 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7fd0180107c0 tx=0x7fd0180106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:54.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.566+0000 7fd02dffb700 1 -- 172.21.15.80:0/3391643285 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+1427 (secure 0 0 0) 0x7fd018001640 con 0x7fd0140046f0 2019-11-28T11:39:54.683 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 61 2019-11-28T11:39:54.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.569+0000 7fd036c07700 1 -- 172.21.15.80:0/3391643285 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd01401b4c0 msgr2=0x7fd01401d8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:54.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.569+0000 7fd036c07700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd01401b4c0 0x7fd01401d8f0 crc :-1 s=READY pgs=499 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:54.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.569+0000 7fd036c07700 1 -- 172.21.15.80:0/3391643285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0140046f0 msgr2=0x7fd014004b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:54.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.569+0000 7fd036c07700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0140046f0 0x7fd014004b50 secure :-1 s=READY pgs=1233 cs=0 l=1 rx=0x7fd0180107c0 tx=0x7fd0180106c0).stop 2019-11-28T11:39:54.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.569+0000 7fd036c07700 1 -- 172.21.15.80:0/3391643285 shutdown_connections 2019-11-28T11:39:54.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.569+0000 7fd036c07700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd01401b4c0 0x7fd01401d8f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:54.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.569+0000 7fd036c07700 1 --2- 172.21.15.80:0/3391643285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd0140046f0 0x7fd014004b50 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:54.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.569+0000 7fd036c07700 1 -- 172.21.15.80:0/3391643285 shutdown_connections 2019-11-28T11:39:54.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.569+0000 7fd036c07700 1 -- 172.21.15.80:0/3391643285 wait complete. 2019-11-28T11:39:54.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:54.569+0000 7fd036c07700 1 -- 172.21.15.80:0/3391643285 >> 172.21.15.80:0/3391643285 conn(0x7fd030127dc0 msgr2=0x7fd030141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:39:54.685 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:39:54.685 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:37:21.540890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:39:54.686 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T11:39:54.689 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:39:54.694 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:39:54.699 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:39:55.687 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:39:55.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.776+0000 7f5cad498700 1 Processor -- start 2019-11-28T11:39:55.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.776+0000 7f5cad498700 1 -- start start 2019-11-28T11:39:55.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.777+0000 7f5cad498700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5ca806c0a0 0x7f5ca8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:39:55.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.777+0000 7f5cad498700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8072620 0x7f5ca8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:39:55.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.777+0000 7f5cad498700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca806db00 con 0x7f5ca80734e0 2019-11-28T11:39:55.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.777+0000 7f5cad498700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca806fd60 con 0x7f5ca806c0a0 2019-11-28T11:39:55.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.777+0000 7f5cad498700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca8070030 con 0x7f5ca8072620 2019-11-28T11:39:55.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.777+0000 7f5ca6ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5ca80734e0 0x7f5ca8071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36784/0 (socket says 172.21.15.80:36784) 2019-11-28T11:39:55.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.777+0000 7f5ca6ffd700 1 -- 172.21.15.80:0/1899601824 learned_addr learned my addr 172.21.15.80:0/1899601824 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:39:55.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.777+0000 7f5ca77fe700 1 --2- 172.21.15.80:0/1899601824 >> v2:172.21.15.174:3300/0 conn(0x7f5ca806c0a0 0x7f5ca8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:55.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.777+0000 7f5ca7fff700 1 --2- 172.21.15.80:0/1899601824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8072620 0x7f5ca8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:55.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.777+0000 7f5ca67fc700 1 -- 172.21.15.80:0/1899601824 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870181113 0 0) 0x7f5c900013f0 con 0x7f5ca80734e0 2019-11-28T11:39:55.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5ca67fc700 1 -- 172.21.15.80:0/1899601824 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c88002e80 con 0x7f5ca80734e0 2019-11-28T11:39:55.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5ca7fff700 1 -- 172.21.15.80:0/1899601824 >> v2:172.21.15.174:3300/0 conn(0x7f5ca806c0a0 msgr2=0x7f5ca8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:39:55.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5ca7fff700 1 --2- 172.21.15.80:0/1899601824 >> v2:172.21.15.174:3300/0 conn(0x7f5ca806c0a0 0x7f5ca8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:39:55.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5ca7fff700 1 -- 172.21.15.80:0/1899601824 >> v1:172.21.15.80:6789/0 conn(0x7f5ca80734e0 legacy=0x7f5ca8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:55.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5ca7fff700 1 -- 172.21.15.80:0/1899601824 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca80706c0 con 0x7f5ca8072620 2019-11-28T11:39:55.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5ca77fe700 1 --2- 172.21.15.80:0/1899601824 >> v2:172.21.15.174:3300/0 conn(0x7f5ca806c0a0 0x7f5ca8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:39:55.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5ca7fff700 1 --2- 172.21.15.80:0/1899601824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8072620 0x7f5ca8164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5ca000af80 tx=0x7f5ca000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:55.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5ca7fff700 1 --2- 172.21.15.80:0/1899601824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8072620 0x7f5ca8164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5ca000af80 tx=0x7f5ca000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:55.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5ca7fff700 1 --2- 172.21.15.80:0/1899601824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8072620 0x7f5ca8164d70 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f5ca000af80 tx=0x7f5ca000b790).ready entity=mon.2 client_cookie=83d1336c27cb73f9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:39:55.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5ca7fff700 1 --2- 172.21.15.80:0/1899601824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8072620 0x7f5ca8164d70 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f5ca000af80 tx=0x7f5ca000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:55.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5ca67fc700 1 -- 172.21.15.80:0/1899601824 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca0000bc0 con 0x7f5ca8072620 2019-11-28T11:39:55.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5ca7fff700 1 --2- 172.21.15.80:0/1899601824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8072620 0x7f5ca8164d70 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f5ca000af80 tx=0x7f5ca000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:55.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5ca7fff700 1 --2- 172.21.15.80:0/1899601824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8072620 0x7f5ca8164d70 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f5ca000af80 tx=0x7f5ca000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:55.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5ca67fc700 1 -- 172.21.15.80:0/1899601824 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca00097f0 con 0x7f5ca8072620 2019-11-28T11:39:55.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5ca67fc700 1 -- 172.21.15.80:0/1899601824 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca0009ec0 con 0x7f5ca8072620 2019-11-28T11:39:55.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5cad498700 1 -- 172.21.15.80:0/1899601824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8072620 msgr2=0x7f5ca8164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:55.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.778+0000 7f5cad498700 1 --2- 172.21.15.80:0/1899601824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8072620 0x7f5ca8164d70 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f5ca000af80 tx=0x7f5ca000b790).stop 2019-11-28T11:39:55.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.779+0000 7f5cad498700 1 -- 172.21.15.80:0/1899601824 shutdown_connections 2019-11-28T11:39:55.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.779+0000 7f5cad498700 1 --2- 172.21.15.80:0/1899601824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8072620 0x7f5ca8164d70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:55.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.779+0000 7f5cad498700 1 --2- 172.21.15.80:0/1899601824 >> v2:172.21.15.174:3300/0 conn(0x7f5ca806c0a0 0x7f5ca8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:39:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.779+0000 7f5cad498700 1 -- 172.21.15.80:0/1899601824 shutdown_connections 2019-11-28T11:39:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.779+0000 7f5cad498700 1 -- 172.21.15.80:0/1899601824 wait complete. 2019-11-28T11:39:55.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.779+0000 7f5cad498700 1 -- 172.21.15.80:0/1899601824 >> 172.21.15.80:0/1899601824 conn(0x7f5ca8061cf0 msgr2=0x7f5ca8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:39:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.781+0000 7f5cad498700 1 Processor -- start 2019-11-28T11:39:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.781+0000 7f5cad498700 1 -- start start 2019-11-28T11:39:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.782+0000 7f5cad498700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8104820 0x7f5ca810c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.782+0000 7f5cad498700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5ca810c890 0x7f5ca810b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:55.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.782+0000 7f5cad498700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca813bcd0 con 0x7f5ca810b710 2019-11-28T11:39:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.782+0000 7f5cad498700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca8108700 con 0x7f5ca810c890 2019-11-28T11:39:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.782+0000 7f5cad498700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca81081f0 con 0x7f5ca8104820 2019-11-28T11:39:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.782+0000 7f5ca77fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8104820 0x7f5ca810c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.782+0000 7f5ca77fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8104820 0x7f5ca810c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:39730/0 (socket says 172.21.15.80:39730) 2019-11-28T11:39:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.782+0000 7f5ca77fe700 1 -- 172.21.15.80:0/2145286425 learned_addr learned my addr 172.21.15.80:0/2145286425 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:39:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.782+0000 7f5ca6ffd700 1 --2- 172.21.15.80:0/2145286425 >> v2:172.21.15.174:3300/0 conn(0x7f5ca810c890 0x7f5ca810b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5ca77fe700 1 -- 172.21.15.80:0/2145286425 >> v2:172.21.15.174:3300/0 conn(0x7f5ca810c890 msgr2=0x7f5ca810b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5ca77fe700 1 --2- 172.21.15.80:0/2145286425 >> v2:172.21.15.174:3300/0 conn(0x7f5ca810c890 0x7f5ca810b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5ca77fe700 1 -- 172.21.15.80:0/2145286425 >> v1:172.21.15.174:6789/0 conn(0x7f5ca810b710 legacy=0x7f5ca8104c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5ca77fe700 1 -- 172.21.15.80:0/2145286425 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca8109a90 con 0x7f5ca8104820 2019-11-28T11:39:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5c9ffff700 1 -- 172.21.15.80:0/2145286425 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920108485 0 0) 0x7f5ca00095b0 con 0x7f5ca810b710 2019-11-28T11:39:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5ca77fe700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8104820 0x7f5ca810c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c980103b0 tx=0x7f5c98010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5ca77fe700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8104820 0x7f5ca810c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c980103b0 tx=0x7f5c98010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5ca77fe700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8104820 0x7f5ca810c350 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f5c980103b0 tx=0x7f5c98010750).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:39:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5ca77fe700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8104820 0x7f5ca810c350 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f5c980103b0 tx=0x7f5c98010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5c9ffff700 1 -- 172.21.15.80:0/2145286425 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c98007510 con 0x7f5ca8104820 2019-11-28T11:39:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5ca77fe700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8104820 0x7f5ca810c350 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f5c980103b0 tx=0x7f5c98010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5ca77fe700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8104820 0x7f5ca810c350 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f5c980103b0 tx=0x7f5c98010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5c9ffff700 1 -- 172.21.15.80:0/2145286425 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9800edd0 con 0x7f5ca8104820 2019-11-28T11:39:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5c9ffff700 1 -- 172.21.15.80:0/2145286425 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c98007510 con 0x7f5ca8104820 2019-11-28T11:39:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5cad498700 1 -- 172.21.15.80:0/2145286425 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca8109e10 con 0x7f5ca8104820 2019-11-28T11:39:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5cad498700 1 -- 172.21.15.80:0/2145286425 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca8109a90 con 0x7f5ca8104820 2019-11-28T11:39:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.783+0000 7f5ca77fe700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8104820 0x7f5ca810c350 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f5c980103b0 tx=0x7f5c98010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.784+0000 7f5c9ffff700 1 -- 172.21.15.80:0/2145286425 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5c9800efc0 con 0x7f5ca8104820 2019-11-28T11:39:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.784+0000 7f5ca77fe700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8104820 0x7f5ca810c350 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f5c980103b0 tx=0x7f5c98010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.784+0000 7f5c9ffff700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c80018730 0x7f5c8001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.784+0000 7f5c9ffff700 1 -- 172.21.15.80:0/2145286425 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f5c98031a90 con 0x7f5ca8104820 2019-11-28T11:39:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.784+0000 7f5ca6ffd700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c80018730 0x7f5c8001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.784+0000 7f5ca6ffd700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c80018730 0x7f5c8001abc0 crc :-1 s=READY pgs=501 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:39:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.791+0000 7f5cad498700 1 -- 172.21.15.80:0/2145286425 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca8109e10 con 0x7f5ca8104820 2019-11-28T11:39:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.795+0000 7f5ca77fe700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8104820 0x7f5ca810c350 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f5c980103b0 tx=0x7f5c98010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.795+0000 7f5c9ffff700 1 -- 172.21.15.80:0/2145286425 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5c9800e9b0 con 0x7f5ca8104820 2019-11-28T11:39:55.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.966+0000 7f5cad498700 1 -- 172.21.15.80:0/2145286425 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ca8109a90 con 0x7f5ca8104820 2019-11-28T11:39:55.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.967+0000 7f5ca77fe700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8104820 0x7f5ca810c350 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f5c980103b0 tx=0x7f5c98010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:55.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.967+0000 7f5c9ffff700 1 -- 172.21.15.80:0/2145286425 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+1773 (secure 0 0 0) 0x7f5c9800efa0 con 0x7f5ca8104820 2019-11-28T11:39:55.999 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 63 2019-11-28T11:39:55.999 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:39:56.000 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:55.275163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:replay","state_seq":1,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:39:56.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.969+0000 7f5cad498700 1 -- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c80018730 msgr2=0x7f5c8001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:56.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.969+0000 7f5cad498700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c80018730 0x7f5c8001abc0 crc :-1 s=READY pgs=501 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:56.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.969+0000 7f5cad498700 1 -- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8104820 msgr2=0x7f5ca810c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:56.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.969+0000 7f5cad498700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8104820 0x7f5ca810c350 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f5c980103b0 tx=0x7f5c98010750).stop 2019-11-28T11:39:56.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.969+0000 7f5cad498700 1 -- 172.21.15.80:0/2145286425 shutdown_connections 2019-11-28T11:39:56.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.969+0000 7f5cad498700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c80018730 0x7f5c8001abc0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:56.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.969+0000 7f5cad498700 1 --2- 172.21.15.80:0/2145286425 >> v2:172.21.15.174:3300/0 conn(0x7f5ca810c890 0x7f5ca810b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:56.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.969+0000 7f5cad498700 1 --2- 172.21.15.80:0/2145286425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ca8104820 0x7f5ca810c350 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:56.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.969+0000 7f5cad498700 1 -- 172.21.15.80:0/2145286425 shutdown_connections 2019-11-28T11:39:56.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.969+0000 7f5cad498700 1 -- 172.21.15.80:0/2145286425 wait complete. 2019-11-28T11:39:56.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:55.969+0000 7f5cad498700 1 -- 172.21.15.80:0/2145286425 >> 172.21.15.80:0/2145286425 conn(0x7f5ca813d620 msgr2=0x7f5ca813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:39:56.010 INFO:tasks.cephfs.filesystem:mapped states [u'up:replay'] to None 2019-11-28T11:39:57.011 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:39:57.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.099+0000 7fab20bd0700 1 Processor -- start 2019-11-28T11:39:57.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.099+0000 7fab20bd0700 1 -- start start 2019-11-28T11:39:57.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.100+0000 7fab20bd0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fab1c06c0a0 0x7fab1c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:39:57.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.100+0000 7fab20bd0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab1c072620 0x7fab1c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:39:57.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.100+0000 7fab20bd0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab1c06db00 con 0x7fab1c0734e0 2019-11-28T11:39:57.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.100+0000 7fab20bd0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1c06fd60 con 0x7fab1c072620 2019-11-28T11:39:57.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.100+0000 7fab20bd0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1c070030 con 0x7fab1c06c0a0 2019-11-28T11:39:57.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.100+0000 7fab1b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab1c072620 0x7fab1c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:57.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.100+0000 7fab1b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab1c072620 0x7fab1c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37482/0 (socket says 172.21.15.80:37482) 2019-11-28T11:39:57.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.100+0000 7fab1b59e700 1 -- 172.21.15.80:0/750196559 learned_addr learned my addr 172.21.15.80:0/750196559 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:39:57.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.100+0000 7fab1a59c700 1 --1- 172.21.15.80:0/750196559 >> v1:172.21.15.80:6789/0 conn(0x7fab1c0734e0 0x7fab1c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36800/0 (socket says 172.21.15.80:36800) 2019-11-28T11:39:57.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.100+0000 7fab1ad9d700 1 --2- 172.21.15.80:0/750196559 >> v2:172.21.15.174:3300/0 conn(0x7fab1c06c0a0 0x7fab1c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:57.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.100+0000 7fab1b59e700 1 -- 172.21.15.80:0/750196559 >> v2:172.21.15.174:3300/0 conn(0x7fab1c06c0a0 msgr2=0x7fab1c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:39:57.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.100+0000 7fab1b59e700 1 --2- 172.21.15.80:0/750196559 >> v2:172.21.15.174:3300/0 conn(0x7fab1c06c0a0 0x7fab1c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:39:57.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.101+0000 7fab1b59e700 1 -- 172.21.15.80:0/750196559 >> v1:172.21.15.80:6789/0 conn(0x7fab1c0734e0 legacy=0x7fab1c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:57.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.101+0000 7fab19d9b700 1 -- 172.21.15.80:0/750196559 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632131955 0 0) 0x7fab0c001070 con 0x7fab1c0734e0 2019-11-28T11:39:57.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.101+0000 7fab1b59e700 1 -- 172.21.15.80:0/750196559 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c0706c0 con 0x7fab1c072620 2019-11-28T11:39:57.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.101+0000 7fab1b59e700 1 --2- 172.21.15.80:0/750196559 >> v2:172.21.15.80:3300/0 conn(0x7fab1c072620 0x7fab1c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fab1400f6b0 tx=0x7fab1400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.101+0000 7fab1b59e700 1 --2- 172.21.15.80:0/750196559 >> v2:172.21.15.80:3300/0 conn(0x7fab1c072620 0x7fab1c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fab1400f6b0 tx=0x7fab1400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.101+0000 7fab1b59e700 1 --2- 172.21.15.80:0/750196559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c072620 0x7fab1c164d70 secure :-1 s=READY pgs=1236 cs=0 l=1 rx=0x7fab1400f6b0 tx=0x7fab1400fa50).ready entity=mon.0 client_cookie=e05beb4ee3fee876 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:39:57.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.101+0000 7fab1b59e700 1 --2- 172.21.15.80:0/750196559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c072620 0x7fab1c164d70 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7fab1400f6b0 tx=0x7fab1400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.101+0000 7fab19d9b700 1 -- 172.21.15.80:0/750196559 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab14000a70 con 0x7fab1c072620 2019-11-28T11:39:57.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.101+0000 7fab1b59e700 1 --2- 172.21.15.80:0/750196559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c072620 0x7fab1c164d70 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7fab1400f6b0 tx=0x7fab1400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.101+0000 7fab1b59e700 1 --2- 172.21.15.80:0/750196559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c072620 0x7fab1c164d70 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7fab1400f6b0 tx=0x7fab1400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.101+0000 7fab19d9b700 1 -- 172.21.15.80:0/750196559 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab140010e0 con 0x7fab1c072620 2019-11-28T11:39:57.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.101+0000 7fab19d9b700 1 -- 172.21.15.80:0/750196559 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab14001350 con 0x7fab1c072620 2019-11-28T11:39:57.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.101+0000 7fab20bd0700 1 -- 172.21.15.80:0/750196559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c072620 msgr2=0x7fab1c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:57.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.101+0000 7fab20bd0700 1 --2- 172.21.15.80:0/750196559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c072620 0x7fab1c164d70 secure :-1 s=READY pgs=1236 cs=0 l=1 rx=0x7fab1400f6b0 tx=0x7fab1400fa50).stop 2019-11-28T11:39:57.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.102+0000 7fab20bd0700 1 -- 172.21.15.80:0/750196559 shutdown_connections 2019-11-28T11:39:57.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.102+0000 7fab20bd0700 1 --2- 172.21.15.80:0/750196559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c072620 0x7fab1c164d70 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:57.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.102+0000 7fab20bd0700 1 --2- 172.21.15.80:0/750196559 >> v2:172.21.15.174:3300/0 conn(0x7fab1c06c0a0 0x7fab1c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:39:57.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.102+0000 7fab20bd0700 1 -- 172.21.15.80:0/750196559 shutdown_connections 2019-11-28T11:39:57.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.102+0000 7fab20bd0700 1 -- 172.21.15.80:0/750196559 wait complete. 2019-11-28T11:39:57.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.102+0000 7fab20bd0700 1 -- 172.21.15.80:0/750196559 >> 172.21.15.80:0/750196559 conn(0x7fab1c061cf0 msgr2=0x7fab1c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:39:57.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.104+0000 7fab20bd0700 1 Processor -- start 2019-11-28T11:39:57.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.104+0000 7fab20bd0700 1 -- start start 2019-11-28T11:39:57.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab20bd0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab1c104820 0x7fab1c10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:57.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab20bd0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fab1c10c890 0x7fab1c10b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:57.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab20bd0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab1c10b710 0x7fab1c10bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:57.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab20bd0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1c108700 con 0x7fab1c10b710 2019-11-28T11:39:57.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab20bd0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1c1081f0 con 0x7fab1c10c890 2019-11-28T11:39:57.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab20bd0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c109130 con 0x7fab1c104820 2019-11-28T11:39:57.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab1b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab1c10b710 0x7fab1c10bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:57.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab1b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab1c10b710 0x7fab1c10bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37490/0 (socket says 172.21.15.80:37490) 2019-11-28T11:39:57.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab1b59e700 1 -- 172.21.15.80:0/347011046 learned_addr learned my addr 172.21.15.80:0/347011046 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:39:57.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab1ad9d700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab1c104820 0x7fab1c10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:57.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab1a59c700 1 --2- 172.21.15.80:0/347011046 >> v2:172.21.15.174:3300/0 conn(0x7fab1c10c890 0x7fab1c10b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:57.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab1b59e700 1 -- 172.21.15.80:0/347011046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab1c104820 msgr2=0x7fab1c10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:57.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab1b59e700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab1c104820 0x7fab1c10c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:57.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab1b59e700 1 -- 172.21.15.80:0/347011046 >> v2:172.21.15.174:3300/0 conn(0x7fab1c10c890 msgr2=0x7fab1c10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:57.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab1b59e700 1 --2- 172.21.15.80:0/347011046 >> v2:172.21.15.174:3300/0 conn(0x7fab1c10c890 0x7fab1c10b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:57.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab1b59e700 1 -- 172.21.15.80:0/347011046 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c109a90 con 0x7fab1c10b710 2019-11-28T11:39:57.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab1b59e700 1 --2- 172.21.15.80:0/347011046 >> v2:172.21.15.80:3300/0 conn(0x7fab1c10b710 0x7fab1c10bb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab14010420 tx=0x7fab14010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab1b59e700 1 --2- 172.21.15.80:0/347011046 >> v2:172.21.15.80:3300/0 conn(0x7fab1c10b710 0x7fab1c10bb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab14010420 tx=0x7fab14010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.105+0000 7fab1b59e700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c10b710 0x7fab1c10bb70 secure :-1 s=READY pgs=1237 cs=0 l=1 rx=0x7fab14010420 tx=0x7fab14010350).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:39:57.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.106+0000 7fab1b59e700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c10b710 0x7fab1c10bb70 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fab14010420 tx=0x7fab14010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.106+0000 7fab1b59e700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c10b710 0x7fab1c10bb70 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fab14010420 tx=0x7fab14010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.106+0000 7fab1b59e700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c10b710 0x7fab1c10bb70 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fab14010420 tx=0x7fab14010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.106+0000 7fab137fe700 1 -- 172.21.15.80:0/347011046 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab140010c0 con 0x7fab1c10b710 2019-11-28T11:39:57.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.106+0000 7fab137fe700 1 -- 172.21.15.80:0/347011046 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab14000940 con 0x7fab1c10b710 2019-11-28T11:39:57.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.106+0000 7fab20bd0700 1 -- 172.21.15.80:0/347011046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1c109e10 con 0x7fab1c10b710 2019-11-28T11:39:57.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.106+0000 7fab137fe700 1 -- 172.21.15.80:0/347011046 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab140016a0 con 0x7fab1c10b710 2019-11-28T11:39:57.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.106+0000 7fab20bd0700 1 -- 172.21.15.80:0/347011046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1c109a90 con 0x7fab1c10b710 2019-11-28T11:39:57.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.106+0000 7fab1b59e700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c10b710 0x7fab1c10bb70 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fab14010420 tx=0x7fab14010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.106+0000 7fab137fe700 1 -- 172.21.15.80:0/347011046 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fab140010c0 con 0x7fab1c10b710 2019-11-28T11:39:57.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.106+0000 7fab1b59e700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c10b710 0x7fab1c10bb70 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fab14010420 tx=0x7fab14010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.106+0000 7fab137fe700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaf4018730 0x7faaf401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:57.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.106+0000 7fab137fe700 1 -- 172.21.15.80:0/347011046 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fab14031a30 con 0x7fab1c10b710 2019-11-28T11:39:57.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.107+0000 7fab1ad9d700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaf4018730 0x7faaf401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:57.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.107+0000 7fab1ad9d700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaf4018730 0x7faaf401abc0 crc :-1 s=READY pgs=503 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:39:57.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.114+0000 7fab20bd0700 1 -- 172.21.15.80:0/347011046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1c109e10 con 0x7fab1c10b710 2019-11-28T11:39:57.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.118+0000 7fab1b59e700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c10b710 0x7fab1c10bb70 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fab14010420 tx=0x7fab14010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.118+0000 7fab137fe700 1 -- 172.21.15.80:0/347011046 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fab14000eb0 con 0x7fab1c10b710 2019-11-28T11:39:57.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.288+0000 7fab20bd0700 1 -- 172.21.15.80:0/347011046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab1c109a90 con 0x7fab1c10b710 2019-11-28T11:39:57.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.288+0000 7fab1b59e700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c10b710 0x7fab1c10bb70 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fab14010420 tx=0x7fab14010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.288+0000 7fab137fe700 1 -- 172.21.15.80:0/347011046 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+1776 (secure 0 0 0) 0x7fab140010c0 con 0x7fab1c10b710 2019-11-28T11:39:57.322 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 64 2019-11-28T11:39:57.322 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:39:57.322 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":64,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:39:57.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.291+0000 7fab20bd0700 1 -- 172.21.15.80:0/347011046 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaf4018730 msgr2=0x7faaf401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:57.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.291+0000 7fab20bd0700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaf4018730 0x7faaf401abc0 crc :-1 s=READY pgs=503 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:57.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.291+0000 7fab20bd0700 1 -- 172.21.15.80:0/347011046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c10b710 msgr2=0x7fab1c10bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:57.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.291+0000 7fab20bd0700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c10b710 0x7fab1c10bb70 secure :-1 s=READY pgs=1237 cs=0 l=1 rx=0x7fab14010420 tx=0x7fab14010350).stop 2019-11-28T11:39:57.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.291+0000 7fab20bd0700 1 -- 172.21.15.80:0/347011046 shutdown_connections 2019-11-28T11:39:57.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.291+0000 7fab20bd0700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaf4018730 0x7faaf401abc0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:57.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.291+0000 7fab20bd0700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab1c10b710 0x7fab1c10bb70 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:57.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.291+0000 7fab20bd0700 1 --2- 172.21.15.80:0/347011046 >> v2:172.21.15.174:3300/0 conn(0x7fab1c10c890 0x7fab1c10b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:57.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.291+0000 7fab20bd0700 1 --2- 172.21.15.80:0/347011046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab1c104820 0x7fab1c10c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:57.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.291+0000 7fab20bd0700 1 -- 172.21.15.80:0/347011046 shutdown_connections 2019-11-28T11:39:57.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.291+0000 7fab20bd0700 1 -- 172.21.15.80:0/347011046 wait complete. 2019-11-28T11:39:57.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.291+0000 7fab20bd0700 1 -- 172.21.15.80:0/347011046 >> 172.21.15.80:0/347011046 conn(0x7fab1c13d620 msgr2=0x7fab1c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:39:57.342 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to up:reconnect 2019-11-28T11:39:57.342 INFO:tasks.cephfs.filesystem:reached state 'up:reconnect' in 3.06446504593s 2019-11-28T11:39:57.343 INFO:tasks.cephfs.test_client_recovery:Waiting for active... 2019-11-28T11:39:57.343 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:39:57.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.432+0000 7fcaab974700 1 Processor -- start 2019-11-28T11:39:57.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.433+0000 7fcaab974700 1 -- start start 2019-11-28T11:39:57.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaab974700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcaa406c0a0 0x7fcaa4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:39:57.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaab974700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcaa40734e0 0x7fcaa4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:39:57.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaab974700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcaa4072360 0x7fcaa4072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:39:57.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaab974700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa406fd60 con 0x7fcaa40734e0 2019-11-28T11:39:57.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaab974700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa4070030 con 0x7fcaa406c0a0 2019-11-28T11:39:57.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaab974700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa406f330 con 0x7fcaa4072360 2019-11-28T11:39:57.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa9710700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcaa40734e0 0x7fcaa4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:57.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa9710700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcaa40734e0 0x7fcaa4071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37498/0 (socket says 172.21.15.80:37498) 2019-11-28T11:39:57.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa9710700 1 -- 172.21.15.80:0/2404421450 learned_addr learned my addr 172.21.15.80:0/2404421450 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:39:57.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaaa712700 1 --2- 172.21.15.80:0/2404421450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcaa4072360 0x7fcaa4072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:57.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa9f11700 1 --2- 172.21.15.80:0/2404421450 >> v2:172.21.15.174:3300/0 conn(0x7fcaa406c0a0 0x7fcaa4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:57.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa9710700 1 -- 172.21.15.80:0/2404421450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcaa4072360 msgr2=0x7fcaa4072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:39:57.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2404421450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcaa4072360 0x7fcaa4072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:39:57.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa9710700 1 -- 172.21.15.80:0/2404421450 >> v2:172.21.15.174:3300/0 conn(0x7fcaa406c0a0 msgr2=0x7fcaa4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:39:57.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2404421450 >> v2:172.21.15.174:3300/0 conn(0x7fcaa406c0a0 0x7fcaa4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:39:57.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa9710700 1 -- 172.21.15.80:0/2404421450 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa40706c0 con 0x7fcaa40734e0 2019-11-28T11:39:57.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaaa712700 1 --2- 172.21.15.80:0/2404421450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcaa4072360 0x7fcaa4072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:39:57.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2404421450 >> v2:172.21.15.80:3300/0 conn(0x7fcaa40734e0 0x7fcaa4071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fca9400f740 tx=0x7fca9400f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2404421450 >> v2:172.21.15.80:3300/0 conn(0x7fcaa40734e0 0x7fcaa4071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fca9400f740 tx=0x7fca9400f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2404421450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40734e0 0x7fcaa4071e20 secure :-1 s=READY pgs=1238 cs=0 l=1 rx=0x7fca9400f740 tx=0x7fca9400f5f0).ready entity=mon.0 client_cookie=2dc3a9d4da77c8d0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:39:57.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2404421450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40734e0 0x7fcaa4071e20 secure :-1 s=THROTTLE_DONE pgs=1238 cs=0 l=1 rx=0x7fca9400f740 tx=0x7fca9400f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa8f0f700 1 -- 172.21.15.80:0/2404421450 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca94000960 con 0x7fcaa40734e0 2019-11-28T11:39:57.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2404421450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40734e0 0x7fcaa4071e20 secure :-1 s=THROTTLE_DONE pgs=1238 cs=0 l=1 rx=0x7fca9400f740 tx=0x7fca9400f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2404421450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40734e0 0x7fcaa4071e20 secure :-1 s=THROTTLE_DONE pgs=1238 cs=0 l=1 rx=0x7fca9400f740 tx=0x7fca9400f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.434+0000 7fcaa8f0f700 1 -- 172.21.15.80:0/2404421450 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca94000c90 con 0x7fcaa40734e0 2019-11-28T11:39:57.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.435+0000 7fcaa8f0f700 1 -- 172.21.15.80:0/2404421450 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca940013a0 con 0x7fcaa40734e0 2019-11-28T11:39:57.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.435+0000 7fcaab974700 1 -- 172.21.15.80:0/2404421450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40734e0 msgr2=0x7fcaa4071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:57.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.435+0000 7fcaab974700 1 --2- 172.21.15.80:0/2404421450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40734e0 0x7fcaa4071e20 secure :-1 s=READY pgs=1238 cs=0 l=1 rx=0x7fca9400f740 tx=0x7fca9400f5f0).stop 2019-11-28T11:39:57.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.435+0000 7fcaab974700 1 -- 172.21.15.80:0/2404421450 shutdown_connections 2019-11-28T11:39:57.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.435+0000 7fcaab974700 1 --2- 172.21.15.80:0/2404421450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcaa4072360 0x7fcaa4072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:39:57.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.435+0000 7fcaab974700 1 --2- 172.21.15.80:0/2404421450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa40734e0 0x7fcaa4071e20 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:57.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.435+0000 7fcaab974700 1 --2- 172.21.15.80:0/2404421450 >> v2:172.21.15.174:3300/0 conn(0x7fcaa406c0a0 0x7fcaa4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:39:57.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.435+0000 7fcaab974700 1 -- 172.21.15.80:0/2404421450 shutdown_connections 2019-11-28T11:39:57.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.435+0000 7fcaab974700 1 -- 172.21.15.80:0/2404421450 wait complete. 2019-11-28T11:39:57.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.435+0000 7fcaab974700 1 -- 172.21.15.80:0/2404421450 >> 172.21.15.80:0/2404421450 conn(0x7fcaa4061cf0 msgr2=0x7fcaa4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:39:57.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.438+0000 7fcaab974700 1 Processor -- start 2019-11-28T11:39:57.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.438+0000 7fcaab974700 1 -- start start 2019-11-28T11:39:57.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.438+0000 7fcaab974700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcaa415fdf0 0x7fcaa412b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:57.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.438+0000 7fcaab974700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcaa412b8a0 0x7fcaa413e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:57.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaab974700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcaa413e860 0x7fcaa412a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:57.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaab974700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa4108820 con 0x7fcaa412b8a0 2019-11-28T11:39:57.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaab974700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa4108af0 con 0x7fcaa415fdf0 2019-11-28T11:39:57.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaab974700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa4107df0 con 0x7fcaa413e860 2019-11-28T11:39:57.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa9710700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcaa412b8a0 0x7fcaa413e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:57.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa9710700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcaa412b8a0 0x7fcaa413e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37502/0 (socket says 172.21.15.80:37502) 2019-11-28T11:39:57.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa9710700 1 -- 172.21.15.80:0/2476226906 learned_addr learned my addr 172.21.15.80:0/2476226906 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:39:57.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaaa712700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcaa413e860 0x7fcaa412a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:57.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa9f11700 1 --2- 172.21.15.80:0/2476226906 >> v2:172.21.15.174:3300/0 conn(0x7fcaa415fdf0 0x7fcaa412b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:57.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa9710700 1 -- 172.21.15.80:0/2476226906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcaa413e860 msgr2=0x7fcaa412a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:57.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcaa413e860 0x7fcaa412a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:57.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa9710700 1 -- 172.21.15.80:0/2476226906 >> v2:172.21.15.174:3300/0 conn(0x7fcaa415fdf0 msgr2=0x7fcaa412b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:57.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2476226906 >> v2:172.21.15.174:3300/0 conn(0x7fcaa415fdf0 0x7fcaa412b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:57.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa9710700 1 -- 172.21.15.80:0/2476226906 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa410a8c0 con 0x7fcaa412b8a0 2019-11-28T11:39:57.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa9f11700 1 --2- 172.21.15.80:0/2476226906 >> v2:172.21.15.174:3300/0 conn(0x7fcaa415fdf0 0x7fcaa412b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:39:57.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2476226906 >> v2:172.21.15.80:3300/0 conn(0x7fcaa412b8a0 0x7fcaa413e320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca940544a0 tx=0x7fca9400f600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2476226906 >> v2:172.21.15.80:3300/0 conn(0x7fcaa412b8a0 0x7fcaa413e320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca940544a0 tx=0x7fca9400f600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa412b8a0 0x7fcaa413e320 secure :-1 s=READY pgs=1239 cs=0 l=1 rx=0x7fca940544a0 tx=0x7fca9400f600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:39:57.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa412b8a0 0x7fcaa413e320 secure :-1 s=THROTTLE_DONE pgs=1239 cs=0 l=1 rx=0x7fca940544a0 tx=0x7fca9400f600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa412b8a0 0x7fcaa413e320 secure :-1 s=THROTTLE_DONE pgs=1239 cs=0 l=1 rx=0x7fca940544a0 tx=0x7fca9400f600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa27fc700 1 -- 172.21.15.80:0/2476226906 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca94007de0 con 0x7fcaa412b8a0 2019-11-28T11:39:57.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa412b8a0 0x7fcaa413e320 secure :-1 s=THROTTLE_DONE pgs=1239 cs=0 l=1 rx=0x7fca940544a0 tx=0x7fca9400f600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa27fc700 1 -- 172.21.15.80:0/2476226906 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca94005370 con 0x7fcaa412b8a0 2019-11-28T11:39:57.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaab974700 1 -- 172.21.15.80:0/2476226906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa410a8c0 con 0x7fcaa412b8a0 2019-11-28T11:39:57.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaa27fc700 1 -- 172.21.15.80:0/2476226906 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca94005a00 con 0x7fcaa412b8a0 2019-11-28T11:39:57.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.439+0000 7fcaab974700 1 -- 172.21.15.80:0/2476226906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa410a8c0 con 0x7fcaa412b8a0 2019-11-28T11:39:57.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.440+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa412b8a0 0x7fcaa413e320 secure :-1 s=THROTTLE_DONE pgs=1239 cs=0 l=1 rx=0x7fca940544a0 tx=0x7fca9400f600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.440+0000 7fcaa27fc700 1 -- 172.21.15.80:0/2476226906 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fca94007ce0 con 0x7fcaa412b8a0 2019-11-28T11:39:57.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.440+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa412b8a0 0x7fcaa413e320 secure :-1 s=THROTTLE_DONE pgs=1239 cs=0 l=1 rx=0x7fca940544a0 tx=0x7fca9400f600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.440+0000 7fcaa27fc700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca88018730 0x7fca8801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:57.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.440+0000 7fcaa27fc700 1 -- 172.21.15.80:0/2476226906 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fca94075c30 con 0x7fcaa412b8a0 2019-11-28T11:39:57.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.440+0000 7fcaa9f11700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca88018730 0x7fca8801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:57.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.440+0000 7fcaa9f11700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca88018730 0x7fca8801abe0 crc :-1 s=READY pgs=504 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:39:57.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.448+0000 7fcaab974700 1 -- 172.21.15.80:0/2476226906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa4109180 con 0x7fcaa412b8a0 2019-11-28T11:39:57.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.451+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa412b8a0 0x7fcaa413e320 secure :-1 s=THROTTLE_DONE pgs=1239 cs=0 l=1 rx=0x7fca940544a0 tx=0x7fca9400f600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.451+0000 7fcaa27fc700 1 -- 172.21.15.80:0/2476226906 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fca94007a60 con 0x7fcaa412b8a0 2019-11-28T11:39:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.624+0000 7fcaab974700 1 -- 172.21.15.80:0/2476226906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcaa4109500 con 0x7fcaa412b8a0 2019-11-28T11:39:57.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.625+0000 7fcaa9710700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa412b8a0 0x7fcaa413e320 secure :-1 s=THROTTLE_DONE pgs=1239 cs=0 l=1 rx=0x7fca940544a0 tx=0x7fca9400f600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:57.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.625+0000 7fcaa27fc700 1 -- 172.21.15.80:0/2476226906 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+1776 (secure 0 0 0) 0x7fca94007c70 con 0x7fcaa412b8a0 2019-11-28T11:39:57.657 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 64 2019-11-28T11:39:57.657 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:39:57.658 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":64,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:39:57.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.627+0000 7fcaab974700 1 -- 172.21.15.80:0/2476226906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca88018730 msgr2=0x7fca8801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:57.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.627+0000 7fcaab974700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca88018730 0x7fca8801abe0 crc :-1 s=READY pgs=504 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:57.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.627+0000 7fcaab974700 1 -- 172.21.15.80:0/2476226906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa412b8a0 msgr2=0x7fcaa413e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:57.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.627+0000 7fcaab974700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa412b8a0 0x7fcaa413e320 secure :-1 s=READY pgs=1239 cs=0 l=1 rx=0x7fca940544a0 tx=0x7fca9400f600).stop 2019-11-28T11:39:57.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.627+0000 7fcaab974700 1 -- 172.21.15.80:0/2476226906 shutdown_connections 2019-11-28T11:39:57.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.627+0000 7fcaab974700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca88018730 0x7fca8801abe0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:57.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.627+0000 7fcaab974700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcaa413e860 0x7fcaa412a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:57.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.627+0000 7fcaab974700 1 --2- 172.21.15.80:0/2476226906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcaa412b8a0 0x7fcaa413e320 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:57.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.627+0000 7fcaab974700 1 --2- 172.21.15.80:0/2476226906 >> v2:172.21.15.174:3300/0 conn(0x7fcaa415fdf0 0x7fcaa412b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:57.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.627+0000 7fcaab974700 1 -- 172.21.15.80:0/2476226906 shutdown_connections 2019-11-28T11:39:57.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.627+0000 7fcaab974700 1 -- 172.21.15.80:0/2476226906 wait complete. 2019-11-28T11:39:57.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:57.627+0000 7fcaab974700 1 -- 172.21.15.80:0/2476226906 >> 172.21.15.80:0/2476226906 conn(0x7fcaa4127dc0 msgr2=0x7fcaa4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:39:57.669 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:39:58.669 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:39:58.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.763+0000 7fb6f851f700 1 Processor -- start 2019-11-28T11:39:58.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.763+0000 7fb6f851f700 1 -- start start 2019-11-28T11:39:58.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f851f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f006c0a0 0x7fb6f0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:39:58.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f851f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb6f00734e0 0x7fb6f0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:39:58.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f851f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb6f0072360 0x7fb6f00727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:39:58.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f851f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f006f330 con 0x7fb6f00734e0 2019-11-28T11:39:58.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f851f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f00706c0 con 0x7fb6f0072360 2019-11-28T11:39:58.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f851f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f0070a40 con 0x7fb6f006c0a0 2019-11-28T11:39:58.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f62bb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb6f00734e0 0x7fb6f0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:58.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f62bb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb6f00734e0 0x7fb6f0071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37514/0 (socket says 172.21.15.80:37514) 2019-11-28T11:39:58.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f62bb700 1 -- 172.21.15.80:0/469730704 learned_addr learned my addr 172.21.15.80:0/469730704 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:39:58.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f6abc700 1 --2- 172.21.15.80:0/469730704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f006c0a0 0x7fb6f0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:58.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f72bd700 1 --2- 172.21.15.80:0/469730704 >> v2:172.21.15.174:3300/0 conn(0x7fb6f0072360 0x7fb6f00727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:58.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f62bb700 1 -- 172.21.15.80:0/469730704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f006c0a0 msgr2=0x7fb6f0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:39:58.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f62bb700 1 --2- 172.21.15.80:0/469730704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f006c0a0 0x7fb6f0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:39:58.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f62bb700 1 -- 172.21.15.80:0/469730704 >> v2:172.21.15.174:3300/0 conn(0x7fb6f0072360 msgr2=0x7fb6f00727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:39:58.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f62bb700 1 --2- 172.21.15.80:0/469730704 >> v2:172.21.15.174:3300/0 conn(0x7fb6f0072360 0x7fb6f00727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:39:58.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f62bb700 1 -- 172.21.15.80:0/469730704 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f006db00 con 0x7fb6f00734e0 2019-11-28T11:39:58.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f62bb700 1 --2- 172.21.15.80:0/469730704 >> v2:172.21.15.80:3300/0 conn(0x7fb6f00734e0 0x7fb6f0071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb6e000f6c0 tx=0x7fb6e000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:58.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f62bb700 1 --2- 172.21.15.80:0/469730704 >> v2:172.21.15.80:3300/0 conn(0x7fb6f00734e0 0x7fb6f0071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb6e000f6c0 tx=0x7fb6e000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:58.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f62bb700 1 --2- 172.21.15.80:0/469730704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f00734e0 0x7fb6f0071e20 secure :-1 s=READY pgs=1240 cs=0 l=1 rx=0x7fb6e000f6c0 tx=0x7fb6e000f570).ready entity=mon.0 client_cookie=bfc51575c8f66802 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:39:58.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f62bb700 1 --2- 172.21.15.80:0/469730704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f00734e0 0x7fb6f0071e20 secure :-1 s=THROTTLE_DONE pgs=1240 cs=0 l=1 rx=0x7fb6e000f6c0 tx=0x7fb6e000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:58.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f62bb700 1 --2- 172.21.15.80:0/469730704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f00734e0 0x7fb6f0071e20 secure :-1 s=THROTTLE_DONE pgs=1240 cs=0 l=1 rx=0x7fb6e000f6c0 tx=0x7fb6e000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:58.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f5aba700 1 -- 172.21.15.80:0/469730704 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e0000960 con 0x7fb6f00734e0 2019-11-28T11:39:58.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f62bb700 1 --2- 172.21.15.80:0/469730704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f00734e0 0x7fb6f0071e20 secure :-1 s=THROTTLE_DONE pgs=1240 cs=0 l=1 rx=0x7fb6e000f6c0 tx=0x7fb6e000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:58.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f5aba700 1 -- 172.21.15.80:0/469730704 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e0000c90 con 0x7fb6f00734e0 2019-11-28T11:39:58.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f5aba700 1 -- 172.21.15.80:0/469730704 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e00013a0 con 0x7fb6f00734e0 2019-11-28T11:39:58.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f851f700 1 -- 172.21.15.80:0/469730704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f00734e0 msgr2=0x7fb6f0071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:58.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.765+0000 7fb6f851f700 1 --2- 172.21.15.80:0/469730704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f00734e0 0x7fb6f0071e20 secure :-1 s=READY pgs=1240 cs=0 l=1 rx=0x7fb6e000f6c0 tx=0x7fb6e000f570).stop 2019-11-28T11:39:58.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.766+0000 7fb6f851f700 1 -- 172.21.15.80:0/469730704 shutdown_connections 2019-11-28T11:39:58.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.766+0000 7fb6f851f700 1 --2- 172.21.15.80:0/469730704 >> v2:172.21.15.174:3300/0 conn(0x7fb6f0072360 0x7fb6f00727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:39:58.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.766+0000 7fb6f851f700 1 --2- 172.21.15.80:0/469730704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f00734e0 0x7fb6f0071e20 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:58.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.766+0000 7fb6f851f700 1 --2- 172.21.15.80:0/469730704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f006c0a0 0x7fb6f0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:39:58.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.766+0000 7fb6f851f700 1 -- 172.21.15.80:0/469730704 shutdown_connections 2019-11-28T11:39:58.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.766+0000 7fb6f851f700 1 -- 172.21.15.80:0/469730704 wait complete. 2019-11-28T11:39:58.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.766+0000 7fb6f851f700 1 -- 172.21.15.80:0/469730704 >> 172.21.15.80:0/469730704 conn(0x7fb6f0061cf0 msgr2=0x7fb6f0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:39:58.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.769+0000 7fb6f851f700 1 Processor -- start 2019-11-28T11:39:58.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.769+0000 7fb6f851f700 1 -- start start 2019-11-28T11:39:58.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.769+0000 7fb6f851f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb6f0128e40 0x7fb6f0168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:58.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.769+0000 7fb6f851f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f0139a60 con 0x7fb6f01281b0 2019-11-28T11:39:58.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6f851f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f013b060 con 0x7fb6f013a780 2019-11-28T11:39:58.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6f851f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f012a260 con 0x7fb6f0128e40 2019-11-28T11:39:58.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6f72bd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb6f0128e40 0x7fb6f0168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:58.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6f72bd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb6f0128e40 0x7fb6f0168d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37518/0 (socket says 172.21.15.80:37518) 2019-11-28T11:39:58.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6f72bd700 1 -- 172.21.15.80:0/2973763560 learned_addr learned my addr 172.21.15.80:0/2973763560 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:39:58.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6f72bd700 1 -- 172.21.15.80:0/2973763560 >> v1:172.21.15.174:6789/0 conn(0x7fb6f013a780 legacy=0x7fb6f012d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:58.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6f72bd700 1 -- 172.21.15.80:0/2973763560 >> v1:172.21.15.80:6789/0 conn(0x7fb6f01281b0 legacy=0x7fb6f0128640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:58.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6f72bd700 1 -- 172.21.15.80:0/2973763560 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f012abc0 con 0x7fb6f0128e40 2019-11-28T11:39:58.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6f72bd700 1 --2- 172.21.15.80:0/2973763560 >> v2:172.21.15.80:3300/0 conn(0x7fb6f0128e40 0x7fb6f0168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb6e8010460 tx=0x7fb6e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:58.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6f72bd700 1 --2- 172.21.15.80:0/2973763560 >> v2:172.21.15.80:3300/0 conn(0x7fb6f0128e40 0x7fb6f0168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb6e8010460 tx=0x7fb6e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:58.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6f72bd700 1 --2- 172.21.15.80:0/2973763560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f0128e40 0x7fb6f0168d80 secure :-1 s=READY pgs=1242 cs=0 l=1 rx=0x7fb6e8010460 tx=0x7fb6e8010800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:39:58.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6f72bd700 1 --2- 172.21.15.80:0/2973763560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f0128e40 0x7fb6f0168d80 secure :-1 s=THROTTLE_DONE pgs=1242 cs=0 l=1 rx=0x7fb6e8010460 tx=0x7fb6e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:58.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6f72bd700 1 --2- 172.21.15.80:0/2973763560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f0128e40 0x7fb6f0168d80 secure :-1 s=THROTTLE_DONE pgs=1242 cs=0 l=1 rx=0x7fb6e8010460 tx=0x7fb6e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:58.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6ef7fe700 1 -- 172.21.15.80:0/2973763560 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e800a6b0 con 0x7fb6f0128e40 2019-11-28T11:39:58.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6f72bd700 1 --2- 172.21.15.80:0/2973763560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f0128e40 0x7fb6f0168d80 secure :-1 s=THROTTLE_DONE pgs=1242 cs=0 l=1 rx=0x7fb6e8010460 tx=0x7fb6e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:58.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6ef7fe700 1 -- 172.21.15.80:0/2973763560 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e8001060 con 0x7fb6f0128e40 2019-11-28T11:39:58.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6f851f700 1 -- 172.21.15.80:0/2973763560 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f012af40 con 0x7fb6f0128e40 2019-11-28T11:39:58.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6ef7fe700 1 -- 172.21.15.80:0/2973763560 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e8001670 con 0x7fb6f0128e40 2019-11-28T11:39:58.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.770+0000 7fb6f851f700 1 -- 172.21.15.80:0/2973763560 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f012abc0 con 0x7fb6f0128e40 2019-11-28T11:39:58.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.771+0000 7fb6f72bd700 1 --2- 172.21.15.80:0/2973763560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f0128e40 0x7fb6f0168d80 secure :-1 s=THROTTLE_DONE pgs=1242 cs=0 l=1 rx=0x7fb6e8010460 tx=0x7fb6e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:58.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.771+0000 7fb6ef7fe700 1 -- 172.21.15.80:0/2973763560 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb6e800a6b0 con 0x7fb6f0128e40 2019-11-28T11:39:58.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.771+0000 7fb6f72bd700 1 --2- 172.21.15.80:0/2973763560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f0128e40 0x7fb6f0168d80 secure :-1 s=THROTTLE_DONE pgs=1242 cs=0 l=1 rx=0x7fb6e8010460 tx=0x7fb6e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:58.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.771+0000 7fb6ef7fe700 1 --2- 172.21.15.80:0/2973763560 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb6d4018730 0x7fb6d401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:39:58.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.771+0000 7fb6ef7fe700 1 -- 172.21.15.80:0/2973763560 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fb6e8031b40 con 0x7fb6f0128e40 2019-11-28T11:39:58.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.771+0000 7fb6f6abc700 1 --2- 172.21.15.80:0/2973763560 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb6d4018730 0x7fb6d401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:39:58.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.771+0000 7fb6f6abc700 1 --2- 172.21.15.80:0/2973763560 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb6d4018730 0x7fb6d401abc0 crc :-1 s=READY pgs=507 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:39:58.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.779+0000 7fb6f851f700 1 -- 172.21.15.80:0/2973763560 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f012af40 con 0x7fb6f0128e40 2019-11-28T11:39:58.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.782+0000 7fb6f72bd700 1 --2- 172.21.15.80:0/2973763560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f0128e40 0x7fb6f0168d80 secure :-1 s=THROTTLE_DONE pgs=1242 cs=0 l=1 rx=0x7fb6e8010460 tx=0x7fb6e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:58.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.782+0000 7fb6ef7fe700 1 -- 172.21.15.80:0/2973763560 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb6e8000b60 con 0x7fb6f0128e40 2019-11-28T11:39:58.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.957+0000 7fb6f851f700 1 -- 172.21.15.80:0/2973763560 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6f012abc0 con 0x7fb6f0128e40 2019-11-28T11:39:58.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.957+0000 7fb6f72bd700 1 --2- 172.21.15.80:0/2973763560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f0128e40 0x7fb6f0168d80 secure :-1 s=THROTTLE_DONE pgs=1242 cs=0 l=1 rx=0x7fb6e8010460 tx=0x7fb6e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:39:58.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.957+0000 7fb6ef7fe700 1 -- 172.21.15.80:0/2973763560 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fb6e800a6b0 con 0x7fb6f0128e40 2019-11-28T11:39:58.989 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:39:58.989 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:39:58.989 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:39:58.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.960+0000 7fb6f851f700 1 -- 172.21.15.80:0/2973763560 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb6d4018730 msgr2=0x7fb6d401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:58.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.960+0000 7fb6f851f700 1 --2- 172.21.15.80:0/2973763560 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb6d4018730 0x7fb6d401abc0 crc :-1 s=READY pgs=507 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:58.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.960+0000 7fb6f851f700 1 -- 172.21.15.80:0/2973763560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f0128e40 msgr2=0x7fb6f0168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:39:58.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.960+0000 7fb6f851f700 1 --2- 172.21.15.80:0/2973763560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f0128e40 0x7fb6f0168d80 secure :-1 s=READY pgs=1242 cs=0 l=1 rx=0x7fb6e8010460 tx=0x7fb6e8010800).stop 2019-11-28T11:39:58.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.960+0000 7fb6f851f700 1 -- 172.21.15.80:0/2973763560 shutdown_connections 2019-11-28T11:39:58.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.960+0000 7fb6f851f700 1 --2- 172.21.15.80:0/2973763560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6f0128e40 0x7fb6f0168d80 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:58.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.960+0000 7fb6f851f700 1 --2- 172.21.15.80:0/2973763560 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb6d4018730 0x7fb6d401abc0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:39:58.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.960+0000 7fb6f851f700 1 -- 172.21.15.80:0/2973763560 shutdown_connections 2019-11-28T11:39:58.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.960+0000 7fb6f851f700 1 -- 172.21.15.80:0/2973763560 wait complete. 2019-11-28T11:39:58.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:39:58.960+0000 7fb6f851f700 1 -- 172.21.15.80:0/2973763560 >> 172.21.15.80:0/2973763560 conn(0x7fb6f0127dc0 msgr2=0x7fb6f0141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:39:59.005 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:00.007 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:00.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.095+0000 7fe30817e700 1 Processor -- start 2019-11-28T11:40:00.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.095+0000 7fe30817e700 1 -- start start 2019-11-28T11:40:00.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.096+0000 7fe30817e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe30006c0a0 0x7fe300072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:00.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.096+0000 7fe30817e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe300072620 0x7fe300164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:00.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.096+0000 7fe30817e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30006db00 con 0x7fe3000734e0 2019-11-28T11:40:00.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.096+0000 7fe30817e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30006fd60 con 0x7fe30006c0a0 2019-11-28T11:40:00.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.096+0000 7fe30817e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe300070030 con 0x7fe300072620 2019-11-28T11:40:00.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.096+0000 7fe30671b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe30006c0a0 0x7fe300072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:00.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.096+0000 7fe305f1a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe3000734e0 0x7fe300071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36846/0 (socket says 172.21.15.80:36846) 2019-11-28T11:40:00.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.096+0000 7fe305f1a700 1 -- 172.21.15.80:0/2248994504 learned_addr learned my addr 172.21.15.80:0/2248994504 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:00.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe306f1c700 1 --2- 172.21.15.80:0/2248994504 >> v2:172.21.15.174:3300/0 conn(0x7fe300072620 0x7fe300164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:00.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe30671b700 1 -- 172.21.15.80:0/2248994504 >> v2:172.21.15.174:3300/0 conn(0x7fe300072620 msgr2=0x7fe300164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:00.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe30671b700 1 --2- 172.21.15.80:0/2248994504 >> v2:172.21.15.174:3300/0 conn(0x7fe300072620 0x7fe300164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:00.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe30671b700 1 -- 172.21.15.80:0/2248994504 >> v1:172.21.15.80:6789/0 conn(0x7fe3000734e0 legacy=0x7fe300071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:00.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe305719700 1 -- 172.21.15.80:0/2248994504 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804541171 0 0) 0x7fe2e80013f0 con 0x7fe3000734e0 2019-11-28T11:40:00.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe30671b700 1 -- 172.21.15.80:0/2248994504 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3000706c0 con 0x7fe30006c0a0 2019-11-28T11:40:00.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe306f1c700 1 --2- 172.21.15.80:0/2248994504 >> v2:172.21.15.174:3300/0 conn(0x7fe300072620 0x7fe300164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:40:00.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe30671b700 1 --2- 172.21.15.80:0/2248994504 >> v2:172.21.15.80:3300/0 conn(0x7fe30006c0a0 0x7fe300072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe2f000af50 tx=0x7fe2f000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:00.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe30671b700 1 --2- 172.21.15.80:0/2248994504 >> v2:172.21.15.80:3300/0 conn(0x7fe30006c0a0 0x7fe300072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe2f000af50 tx=0x7fe2f000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:00.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe30671b700 1 --2- 172.21.15.80:0/2248994504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe30006c0a0 0x7fe300072fa0 secure :-1 s=READY pgs=1244 cs=0 l=1 rx=0x7fe2f000af50 tx=0x7fe2f000b760).ready entity=mon.0 client_cookie=ed63b437a40e442e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:00.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe30671b700 1 --2- 172.21.15.80:0/2248994504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe30006c0a0 0x7fe300072fa0 secure :-1 s=THROTTLE_DONE pgs=1244 cs=0 l=1 rx=0x7fe2f000af50 tx=0x7fe2f000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:00.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe305719700 1 -- 172.21.15.80:0/2248994504 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2f0007210 con 0x7fe30006c0a0 2019-11-28T11:40:00.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe30671b700 1 --2- 172.21.15.80:0/2248994504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe30006c0a0 0x7fe300072fa0 secure :-1 s=THROTTLE_DONE pgs=1244 cs=0 l=1 rx=0x7fe2f000af50 tx=0x7fe2f000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:00.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe30671b700 1 --2- 172.21.15.80:0/2248994504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe30006c0a0 0x7fe300072fa0 secure :-1 s=THROTTLE_DONE pgs=1244 cs=0 l=1 rx=0x7fe2f000af50 tx=0x7fe2f000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:00.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe305719700 1 -- 172.21.15.80:0/2248994504 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f00099b0 con 0x7fe30006c0a0 2019-11-28T11:40:00.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe305719700 1 -- 172.21.15.80:0/2248994504 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2f000a080 con 0x7fe30006c0a0 2019-11-28T11:40:00.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe30817e700 1 -- 172.21.15.80:0/2248994504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe30006c0a0 msgr2=0x7fe300072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:00.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.097+0000 7fe30817e700 1 --2- 172.21.15.80:0/2248994504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe30006c0a0 0x7fe300072fa0 secure :-1 s=READY pgs=1244 cs=0 l=1 rx=0x7fe2f000af50 tx=0x7fe2f000b760).stop 2019-11-28T11:40:00.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.098+0000 7fe30817e700 1 -- 172.21.15.80:0/2248994504 shutdown_connections 2019-11-28T11:40:00.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.098+0000 7fe30817e700 1 --2- 172.21.15.80:0/2248994504 >> v2:172.21.15.174:3300/0 conn(0x7fe300072620 0x7fe300164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:00.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.098+0000 7fe30817e700 1 --2- 172.21.15.80:0/2248994504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe30006c0a0 0x7fe300072fa0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:00.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.098+0000 7fe30817e700 1 -- 172.21.15.80:0/2248994504 shutdown_connections 2019-11-28T11:40:00.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.098+0000 7fe30817e700 1 -- 172.21.15.80:0/2248994504 wait complete. 2019-11-28T11:40:00.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.098+0000 7fe30817e700 1 -- 172.21.15.80:0/2248994504 >> 172.21.15.80:0/2248994504 conn(0x7fe300061cf0 msgr2=0x7fe300064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:00.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.100+0000 7fe30817e700 1 Processor -- start 2019-11-28T11:40:00.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.100+0000 7fe30817e700 1 -- start start 2019-11-28T11:40:00.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.101+0000 7fe30817e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe300104c10 0x7fe3001050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:00.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.101+0000 7fe30817e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe3001055e0 0x7fe300167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:00.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.101+0000 7fe30817e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe300105a30 con 0x7fe300104820 2019-11-28T11:40:00.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.101+0000 7fe30817e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe300109130 con 0x7fe3001055e0 2019-11-28T11:40:00.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.101+0000 7fe30817e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe300109400 con 0x7fe300104c10 2019-11-28T11:40:00.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.101+0000 7fe30671b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe300104820 0x7fe30010c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36848/0 (socket says 172.21.15.80:36848) 2019-11-28T11:40:00.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.101+0000 7fe30671b700 1 -- 172.21.15.80:0/496722493 learned_addr learned my addr 172.21.15.80:0/496722493 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:00.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.101+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124581425 0 0) 0x7fe2f000abb0 con 0x7fe300104820 2019-11-28T11:40:00.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.101+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e4002e80 con 0x7fe300104820 2019-11-28T11:40:00.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.101+0000 7fe306f1c700 1 --2- 172.21.15.80:0/496722493 >> v2:172.21.15.174:3300/0 conn(0x7fe3001055e0 0x7fe300167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:00.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe305f1a700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe300104c10 0x7fe3001050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:00.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2815632513 0 0) 0x7fe2f0000940 con 0x7fe300104820 2019-11-28T11:40:00.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe2e40032e0 con 0x7fe300104820 2019-11-28T11:40:00.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fe2f000b3f0 con 0x7fe300104820 2019-11-28T11:40:00.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe300104c10 msgr2=0x7fe3001050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:00.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe2feffd700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe300104c10 0x7fe3001050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:00.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 >> v2:172.21.15.174:3300/0 conn(0x7fe3001055e0 msgr2=0x7fe300167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:00.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe2feffd700 1 --2- 172.21.15.80:0/496722493 >> v2:172.21.15.174:3300/0 conn(0x7fe3001055e0 0x7fe300167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:00.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 >> v1:172.21.15.80:6789/0 conn(0x7fe300104820 legacy=0x7fe30010c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:00.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe2feffd700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2e40033a0 0x7fe2e40037d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:00.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe2feffd700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2e4003d10 0x7fe2e4004180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:00.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe2feffd700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2e4004940 0x7fe2e4004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:00.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e400bbf0 con 0x7fe2e4003d10 2019-11-28T11:40:00.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e400bde0 con 0x7fe2e40033a0 2019-11-28T11:40:00.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e400c010 con 0x7fe2e4004940 2019-11-28T11:40:00.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe305f1a700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe300104c10 0x7fe3001050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:40:00.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe30671b700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2e40033a0 0x7fe2e40037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:00.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe305f1a700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2e4003d10 0x7fe2e4004180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:00.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe306f1c700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2e4004940 0x7fe2e4004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:00.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe305f1a700 1 -- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2e4004940 msgr2=0x7fe2e4004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:00.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe305f1a700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2e4004940 0x7fe2e4004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:00.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe305f1a700 1 -- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2e40033a0 msgr2=0x7fe2e40037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:00.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe305f1a700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2e40033a0 0x7fe2e40037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:00.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe305f1a700 1 -- 172.21.15.80:0/496722493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e400c2c0 con 0x7fe2e4003d10 2019-11-28T11:40:00.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe30817e700 1 -- 172.21.15.80:0/496722493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe300109e10 con 0x7fe2e4003d10 2019-11-28T11:40:00.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe305f1a700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2e4003d10 0x7fe2e4004180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe2e8010720 tx=0x7fe2e80105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:00.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe30817e700 1 -- 172.21.15.80:0/496722493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe300109a90 con 0x7fe2e4003d10 2019-11-28T11:40:00.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe305f1a700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2e4003d10 0x7fe2e4004180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe2e8010720 tx=0x7fe2e80105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:00.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe305f1a700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2e4003d10 0x7fe2e4004180 secure :-1 s=READY pgs=1246 cs=0 l=1 rx=0x7fe2e8010720 tx=0x7fe2e80105d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:00.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe305f1a700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2e4003d10 0x7fe2e4004180 secure :-1 s=THROTTLE_DONE pgs=1246 cs=0 l=1 rx=0x7fe2e8010720 tx=0x7fe2e80105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:00.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.102+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2e80017e0 con 0x7fe2e4003d10 2019-11-28T11:40:00.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.103+0000 7fe305f1a700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2e4003d10 0x7fe2e4004180 secure :-1 s=THROTTLE_DONE pgs=1246 cs=0 l=1 rx=0x7fe2e8010720 tx=0x7fe2e80105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:00.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.103+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e80017e0 con 0x7fe2e4003d10 2019-11-28T11:40:00.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.103+0000 7fe305f1a700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2e4003d10 0x7fe2e4004180 secure :-1 s=THROTTLE_DONE pgs=1246 cs=0 l=1 rx=0x7fe2e8010720 tx=0x7fe2e80105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:00.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.103+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2e8004550 con 0x7fe2e4003d10 2019-11-28T11:40:00.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.103+0000 7fe305f1a700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2e4003d10 0x7fe2e4004180 secure :-1 s=THROTTLE_DONE pgs=1246 cs=0 l=1 rx=0x7fe2e8010720 tx=0x7fe2e80105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:00.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.103+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe2e80012c0 con 0x7fe2e4003d10 2019-11-28T11:40:00.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.103+0000 7fe305f1a700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2e4003d10 0x7fe2e4004180 secure :-1 s=THROTTLE_DONE pgs=1246 cs=0 l=1 rx=0x7fe2e8010720 tx=0x7fe2e80105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:00.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.103+0000 7fe2feffd700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2e4020b30 0x7fe2e4022f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:00.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.103+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fe2e8031fa0 con 0x7fe2e4003d10 2019-11-28T11:40:00.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.103+0000 7fe30671b700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2e4020b30 0x7fe2e4022f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:00.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.104+0000 7fe30671b700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2e4020b30 0x7fe2e4022f60 crc :-1 s=READY pgs=512 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:00.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.110+0000 7fe30817e700 1 -- 172.21.15.80:0/496722493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe300109e10 con 0x7fe2e4003d10 2019-11-28T11:40:00.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.114+0000 7fe305f1a700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2e4003d10 0x7fe2e4004180 secure :-1 s=THROTTLE_DONE pgs=1246 cs=0 l=1 rx=0x7fe2e8010720 tx=0x7fe2e80105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:00.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.114+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe2e8000d10 con 0x7fe2e4003d10 2019-11-28T11:40:00.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.287+0000 7fe30817e700 1 -- 172.21.15.80:0/496722493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe300109a90 con 0x7fe2e4003d10 2019-11-28T11:40:00.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.288+0000 7fe305f1a700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2e4003d10 0x7fe2e4004180 secure :-1 s=THROTTLE_DONE pgs=1246 cs=0 l=1 rx=0x7fe2e8010720 tx=0x7fe2e80105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:00.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.288+0000 7fe2feffd700 1 -- 172.21.15.80:0/496722493 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fe2e80012c0 con 0x7fe2e4003d10 2019-11-28T11:40:00.320 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:00.321 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:00.321 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:00.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.290+0000 7fe30817e700 1 -- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2e4020b30 msgr2=0x7fe2e4022f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:00.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.290+0000 7fe30817e700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2e4020b30 0x7fe2e4022f60 crc :-1 s=READY pgs=512 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:00.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.290+0000 7fe30817e700 1 -- 172.21.15.80:0/496722493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2e4003d10 msgr2=0x7fe2e4004180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:00.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.290+0000 7fe30817e700 1 --2- 172.21.15.80:0/496722493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2e4003d10 0x7fe2e4004180 secure :-1 s=READY pgs=1246 cs=0 l=1 rx=0x7fe2e8010720 tx=0x7fe2e80105d0).stop 2019-11-28T11:40:00.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.290+0000 7fe306f1c700 1 -- 172.21.15.80:0/496722493 reap_dead start 2019-11-28T11:40:00.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.291+0000 7fe306f1c700 1 -- 172.21.15.80:0/496722493 reap_dead start 2019-11-28T11:40:00.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.291+0000 7fe30817e700 1 -- 172.21.15.80:0/496722493 shutdown_connections 2019-11-28T11:40:00.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.291+0000 7fe30817e700 1 -- 172.21.15.80:0/496722493 shutdown_connections 2019-11-28T11:40:00.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.291+0000 7fe30817e700 1 -- 172.21.15.80:0/496722493 wait complete. 2019-11-28T11:40:00.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:00.291+0000 7fe30817e700 1 -- 172.21.15.80:0/496722493 >> 172.21.15.80:0/496722493 conn(0x7fe30013d620 msgr2=0x7fe30013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:00.335 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:01.337 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:01.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.433+0000 7fcea6847700 1 Processor -- start 2019-11-28T11:40:01.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.433+0000 7fcea6847700 1 -- start start 2019-11-28T11:40:01.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.434+0000 7fcea6847700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcea006c0a0 0x7fcea0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:01.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.434+0000 7fcea6847700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcea00734e0 0x7fcea0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.434+0000 7fcea6847700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea006db00 con 0x7fcea0072360 2019-11-28T11:40:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.434+0000 7fcea6847700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea006fd60 con 0x7fcea006c0a0 2019-11-28T11:40:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.434+0000 7fcea6847700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea0070030 con 0x7fcea00734e0 2019-11-28T11:40:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.434+0000 7fcea55e5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcea0072360 0x7fcea006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36862/0 (socket says 172.21.15.80:36862) 2019-11-28T11:40:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.434+0000 7fcea55e5700 1 -- 172.21.15.80:0/1605942406 learned_addr learned my addr 172.21.15.80:0/1605942406 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.434+0000 7fcea4de4700 1 --2- 172.21.15.80:0/1605942406 >> v2:172.21.15.174:3300/0 conn(0x7fcea006c0a0 0x7fcea0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:01.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.434+0000 7fce9ffff700 1 --2- 172.21.15.80:0/1605942406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcea00734e0 0x7fcea0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:01.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.434+0000 7fce9f7fe700 1 -- 172.21.15.80:0/1605942406 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114387914 0 0) 0x7fce980014d0 con 0x7fcea0072360 2019-11-28T11:40:01.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.434+0000 7fce9f7fe700 1 -- 172.21.15.80:0/1605942406 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce8c002e80 con 0x7fcea0072360 2019-11-28T11:40:01.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.434+0000 7fcea4de4700 1 -- 172.21.15.80:0/1605942406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcea00734e0 msgr2=0x7fcea0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:01.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.434+0000 7fce9f7fe700 1 -- 172.21.15.80:0/1605942406 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2043050006 0 0) 0x7fce980014b0 con 0x7fcea0072360 2019-11-28T11:40:01.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.435+0000 7fcea4de4700 1 --2- 172.21.15.80:0/1605942406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcea00734e0 0x7fcea0071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:01.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.435+0000 7fcea4de4700 1 -- 172.21.15.80:0/1605942406 >> v1:172.21.15.80:6789/0 conn(0x7fcea0072360 legacy=0x7fcea006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:01.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.435+0000 7fcea4de4700 1 -- 172.21.15.80:0/1605942406 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea00706c0 con 0x7fcea006c0a0 2019-11-28T11:40:01.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.435+0000 7fce9ffff700 1 --2- 172.21.15.80:0/1605942406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcea00734e0 0x7fcea0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:40:01.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.435+0000 7fcea4de4700 1 --2- 172.21.15.80:0/1605942406 >> v2:172.21.15.174:3300/0 conn(0x7fcea006c0a0 0x7fcea0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fce8800af50 tx=0x7fce8800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:01.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.435+0000 7fcea4de4700 1 --2- 172.21.15.80:0/1605942406 >> v2:172.21.15.174:3300/0 conn(0x7fcea006c0a0 0x7fcea0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fce8800af50 tx=0x7fce8800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:01.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.435+0000 7fcea4de4700 1 --2- 172.21.15.80:0/1605942406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea006c0a0 0x7fcea0072fa0 secure :-1 s=READY pgs=737 cs=0 l=1 rx=0x7fce8800af50 tx=0x7fce8800b760).ready entity=mon.1 client_cookie=4e03068719384ea4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:01.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.435+0000 7fcea4de4700 1 --2- 172.21.15.80:0/1605942406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea006c0a0 0x7fcea0072fa0 secure :-1 s=THROTTLE_DONE pgs=737 cs=0 l=1 rx=0x7fce8800af50 tx=0x7fce8800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:01.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.435+0000 7fce9f7fe700 1 -- 172.21.15.80:0/1605942406 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce88007210 con 0x7fcea006c0a0 2019-11-28T11:40:01.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.435+0000 7fcea4de4700 1 --2- 172.21.15.80:0/1605942406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea006c0a0 0x7fcea0072fa0 secure :-1 s=THROTTLE_DONE pgs=737 cs=0 l=1 rx=0x7fce8800af50 tx=0x7fce8800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:01.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.435+0000 7fcea4de4700 1 --2- 172.21.15.80:0/1605942406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea006c0a0 0x7fcea0072fa0 secure :-1 s=THROTTLE_DONE pgs=737 cs=0 l=1 rx=0x7fce8800af50 tx=0x7fce8800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:01.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.435+0000 7fce9f7fe700 1 -- 172.21.15.80:0/1605942406 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce880099b0 con 0x7fcea006c0a0 2019-11-28T11:40:01.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.435+0000 7fce9f7fe700 1 -- 172.21.15.80:0/1605942406 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce8800a080 con 0x7fcea006c0a0 2019-11-28T11:40:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.435+0000 7fcea6847700 1 -- 172.21.15.80:0/1605942406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea006c0a0 msgr2=0x7fcea0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.435+0000 7fcea6847700 1 --2- 172.21.15.80:0/1605942406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea006c0a0 0x7fcea0072fa0 secure :-1 s=READY pgs=737 cs=0 l=1 rx=0x7fce8800af50 tx=0x7fce8800b760).stop 2019-11-28T11:40:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.436+0000 7fcea6847700 1 -- 172.21.15.80:0/1605942406 shutdown_connections 2019-11-28T11:40:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.436+0000 7fcea6847700 1 --2- 172.21.15.80:0/1605942406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcea00734e0 0x7fcea0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.436+0000 7fcea6847700 1 --2- 172.21.15.80:0/1605942406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea006c0a0 0x7fcea0072fa0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.436+0000 7fcea6847700 1 -- 172.21.15.80:0/1605942406 shutdown_connections 2019-11-28T11:40:01.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.436+0000 7fcea6847700 1 -- 172.21.15.80:0/1605942406 wait complete. 2019-11-28T11:40:01.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.436+0000 7fcea6847700 1 -- 172.21.15.80:0/1605942406 >> 172.21.15.80:0/1605942406 conn(0x7fcea0061cf0 msgr2=0x7fcea0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:01.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.438+0000 7fcea6847700 1 Processor -- start 2019-11-28T11:40:01.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.438+0000 7fcea6847700 1 -- start start 2019-11-28T11:40:01.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.439+0000 7fcea6847700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcea0103000 0x7fcea0103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.439+0000 7fcea6847700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea01312c0 con 0x7fcea013dc00 2019-11-28T11:40:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.439+0000 7fcea6847700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea0131730 con 0x7fcea01039d0 2019-11-28T11:40:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.439+0000 7fcea6847700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea0105830 con 0x7fcea0103000 2019-11-28T11:40:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.439+0000 7fce9ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcea0103000 0x7fcea0103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.439+0000 7fcea4de4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcea013dc00 0x7fcea0109e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36866/0 (socket says 172.21.15.80:36866) 2019-11-28T11:40:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.439+0000 7fcea4de4700 1 -- 172.21.15.80:0/1719357702 learned_addr learned my addr 172.21.15.80:0/1719357702 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:01.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.440+0000 7fce9ffff700 1 -- 172.21.15.80:0/1719357702 >> v1:172.21.15.174:6789/0 conn(0x7fcea01039d0 legacy=0x7fcea0167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.440+0000 7fce9ffff700 1 -- 172.21.15.80:0/1719357702 >> v1:172.21.15.80:6789/0 conn(0x7fcea013dc00 legacy=0x7fcea0109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.440+0000 7fce9ffff700 1 -- 172.21.15.80:0/1719357702 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea0106190 con 0x7fcea0103000 2019-11-28T11:40:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.440+0000 7fce9d7fa700 1 -- 172.21.15.80:0/1719357702 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871676423 0 0) 0x7fce8800abb0 con 0x7fcea013dc00 2019-11-28T11:40:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.440+0000 7fce9ffff700 1 --2- 172.21.15.80:0/1719357702 >> v2:172.21.15.80:3300/0 conn(0x7fcea0103000 0x7fcea0103490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fce90010390 tx=0x7fce90010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.440+0000 7fce9ffff700 1 --2- 172.21.15.80:0/1719357702 >> v2:172.21.15.80:3300/0 conn(0x7fcea0103000 0x7fcea0103490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fce90010390 tx=0x7fce90010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:01.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.440+0000 7fce9ffff700 1 --2- 172.21.15.80:0/1719357702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcea0103000 0x7fcea0103490 secure :-1 s=READY pgs=1249 cs=0 l=1 rx=0x7fce90010390 tx=0x7fce90010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:01.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.440+0000 7fce9ffff700 1 --2- 172.21.15.80:0/1719357702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcea0103000 0x7fcea0103490 secure :-1 s=THROTTLE_DONE pgs=1249 cs=0 l=1 rx=0x7fce90010390 tx=0x7fce90010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:01.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.440+0000 7fce9d7fa700 1 -- 172.21.15.80:0/1719357702 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce90000940 con 0x7fcea0103000 2019-11-28T11:40:01.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.440+0000 7fce9ffff700 1 --2- 172.21.15.80:0/1719357702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcea0103000 0x7fcea0103490 secure :-1 s=THROTTLE_DONE pgs=1249 cs=0 l=1 rx=0x7fce90010390 tx=0x7fce90010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:01.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.440+0000 7fce9d7fa700 1 -- 172.21.15.80:0/1719357702 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce90009770 con 0x7fcea0103000 2019-11-28T11:40:01.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.440+0000 7fce9ffff700 1 --2- 172.21.15.80:0/1719357702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcea0103000 0x7fcea0103490 secure :-1 s=THROTTLE_DONE pgs=1249 cs=0 l=1 rx=0x7fce90010390 tx=0x7fce90010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:01.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.440+0000 7fcea6847700 1 -- 172.21.15.80:0/1719357702 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea0106510 con 0x7fcea0103000 2019-11-28T11:40:01.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.440+0000 7fce9d7fa700 1 -- 172.21.15.80:0/1719357702 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce90009960 con 0x7fcea0103000 2019-11-28T11:40:01.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.440+0000 7fcea6847700 1 -- 172.21.15.80:0/1719357702 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea0106190 con 0x7fcea0103000 2019-11-28T11:40:01.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.440+0000 7fce9ffff700 1 --2- 172.21.15.80:0/1719357702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcea0103000 0x7fcea0103490 secure :-1 s=THROTTLE_DONE pgs=1249 cs=0 l=1 rx=0x7fce90010390 tx=0x7fce90010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:01.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.441+0000 7fce9d7fa700 1 -- 172.21.15.80:0/1719357702 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fce90005180 con 0x7fcea0103000 2019-11-28T11:40:01.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.441+0000 7fce9ffff700 1 --2- 172.21.15.80:0/1719357702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcea0103000 0x7fcea0103490 secure :-1 s=THROTTLE_DONE pgs=1249 cs=0 l=1 rx=0x7fce90010390 tx=0x7fce90010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:01.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.441+0000 7fce9d7fa700 1 --2- 172.21.15.80:0/1719357702 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fce84018730 0x7fce8401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:01.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.441+0000 7fce9d7fa700 1 -- 172.21.15.80:0/1719357702 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fce90031ae0 con 0x7fcea0103000 2019-11-28T11:40:01.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.441+0000 7fcea4de4700 1 --2- 172.21.15.80:0/1719357702 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fce84018730 0x7fce8401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:01.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.441+0000 7fcea4de4700 1 --2- 172.21.15.80:0/1719357702 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fce84018730 0x7fce8401abc0 crc :-1 s=READY pgs=513 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:01.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.448+0000 7fcea6847700 1 -- 172.21.15.80:0/1719357702 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea0106510 con 0x7fcea0103000 2019-11-28T11:40:01.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.452+0000 7fce9ffff700 1 --2- 172.21.15.80:0/1719357702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcea0103000 0x7fcea0103490 secure :-1 s=THROTTLE_DONE pgs=1249 cs=0 l=1 rx=0x7fce90010390 tx=0x7fce90010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:01.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.452+0000 7fce9d7fa700 1 -- 172.21.15.80:0/1719357702 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fce90005180 con 0x7fcea0103000 2019-11-28T11:40:01.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.624+0000 7fcea6847700 1 -- 172.21.15.80:0/1719357702 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcea0106190 con 0x7fcea0103000 2019-11-28T11:40:01.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.625+0000 7fce9ffff700 1 --2- 172.21.15.80:0/1719357702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcea0103000 0x7fcea0103490 secure :-1 s=THROTTLE_DONE pgs=1249 cs=0 l=1 rx=0x7fce90010390 tx=0x7fce90010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:01.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.625+0000 7fce9d7fa700 1 -- 172.21.15.80:0/1719357702 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fce9000a080 con 0x7fcea0103000 2019-11-28T11:40:01.658 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:01.659 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:01.659 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:01.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.627+0000 7fcea6847700 1 -- 172.21.15.80:0/1719357702 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fce84018730 msgr2=0x7fce8401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:01.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.627+0000 7fcea6847700 1 --2- 172.21.15.80:0/1719357702 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fce84018730 0x7fce8401abc0 crc :-1 s=READY pgs=513 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:01.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.627+0000 7fcea6847700 1 -- 172.21.15.80:0/1719357702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcea0103000 msgr2=0x7fcea0103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:01.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.627+0000 7fcea6847700 1 --2- 172.21.15.80:0/1719357702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcea0103000 0x7fcea0103490 secure :-1 s=READY pgs=1249 cs=0 l=1 rx=0x7fce90010390 tx=0x7fce90010730).stop 2019-11-28T11:40:01.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.627+0000 7fcea6847700 1 -- 172.21.15.80:0/1719357702 shutdown_connections 2019-11-28T11:40:01.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.627+0000 7fcea6847700 1 --2- 172.21.15.80:0/1719357702 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fce84018730 0x7fce8401abc0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:01.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.627+0000 7fcea6847700 1 --2- 172.21.15.80:0/1719357702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcea0103000 0x7fcea0103490 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:01.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.628+0000 7fcea6847700 1 -- 172.21.15.80:0/1719357702 shutdown_connections 2019-11-28T11:40:01.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.628+0000 7fcea6847700 1 -- 172.21.15.80:0/1719357702 wait complete. 2019-11-28T11:40:01.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:01.628+0000 7fcea6847700 1 -- 172.21.15.80:0/1719357702 >> 172.21.15.80:0/1719357702 conn(0x7fcea011bfc0 msgr2=0x7fcea0141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:01.668 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:02.669 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:02.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.769+0000 7fbdd5356700 1 Processor -- start 2019-11-28T11:40:02.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.769+0000 7fbdd5356700 1 -- start start 2019-11-28T11:40:02.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.770+0000 7fbdd5356700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbdd006c0a0 0x7fbdd0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:02.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.770+0000 7fbdd5356700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbdd00734e0 0x7fbdd0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:02.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.770+0000 7fbdd5356700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd0072360 0x7fbdd0072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:02.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.770+0000 7fbdd5356700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd006fd60 con 0x7fbdd00734e0 2019-11-28T11:40:02.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.770+0000 7fbdd5356700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd0070030 con 0x7fbdd006c0a0 2019-11-28T11:40:02.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.770+0000 7fbdd5356700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd006f330 con 0x7fbdd0072360 2019-11-28T11:40:02.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.770+0000 7fbdceffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbdd00734e0 0x7fbdd0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:02.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.770+0000 7fbdceffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbdd00734e0 0x7fbdd0071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37558/0 (socket says 172.21.15.80:37558) 2019-11-28T11:40:02.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.770+0000 7fbdceffd700 1 -- 172.21.15.80:0/1011583634 learned_addr learned my addr 172.21.15.80:0/1011583634 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:02.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.770+0000 7fbdcf7fe700 1 --2- 172.21.15.80:0/1011583634 >> v2:172.21.15.174:3300/0 conn(0x7fbdd006c0a0 0x7fbdd0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:02.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.770+0000 7fbdcffff700 1 --2- 172.21.15.80:0/1011583634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd0072360 0x7fbdd0072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:02.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.770+0000 7fbdceffd700 1 -- 172.21.15.80:0/1011583634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd0072360 msgr2=0x7fbdd0072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:02.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.770+0000 7fbdceffd700 1 --2- 172.21.15.80:0/1011583634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd0072360 0x7fbdd0072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:02.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.770+0000 7fbdceffd700 1 -- 172.21.15.80:0/1011583634 >> v2:172.21.15.174:3300/0 conn(0x7fbdd006c0a0 msgr2=0x7fbdd0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:02.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.770+0000 7fbdceffd700 1 --2- 172.21.15.80:0/1011583634 >> v2:172.21.15.174:3300/0 conn(0x7fbdd006c0a0 0x7fbdd0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:02.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.770+0000 7fbdceffd700 1 -- 172.21.15.80:0/1011583634 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd00706c0 con 0x7fbdd00734e0 2019-11-28T11:40:02.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.771+0000 7fbdceffd700 1 --2- 172.21.15.80:0/1011583634 >> v2:172.21.15.80:3300/0 conn(0x7fbdd00734e0 0x7fbdd0071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbdb800fa40 tx=0x7fbdb800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:02.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.771+0000 7fbdceffd700 1 --2- 172.21.15.80:0/1011583634 >> v2:172.21.15.80:3300/0 conn(0x7fbdd00734e0 0x7fbdd0071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbdb800fa40 tx=0x7fbdb800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:02.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.771+0000 7fbdceffd700 1 --2- 172.21.15.80:0/1011583634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd00734e0 0x7fbdd0071e20 secure :-1 s=READY pgs=1250 cs=0 l=1 rx=0x7fbdb800fa40 tx=0x7fbdb800f8f0).ready entity=mon.0 client_cookie=beb6202153193eff server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:02.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.771+0000 7fbdceffd700 1 --2- 172.21.15.80:0/1011583634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd00734e0 0x7fbdd0071e20 secure :-1 s=THROTTLE_DONE pgs=1250 cs=0 l=1 rx=0x7fbdb800fa40 tx=0x7fbdb800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:02.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.771+0000 7fbdceffd700 1 --2- 172.21.15.80:0/1011583634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd00734e0 0x7fbdd0071e20 secure :-1 s=THROTTLE_DONE pgs=1250 cs=0 l=1 rx=0x7fbdb800fa40 tx=0x7fbdb800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:02.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.771+0000 7fbdceffd700 1 --2- 172.21.15.80:0/1011583634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd00734e0 0x7fbdd0071e20 secure :-1 s=THROTTLE_DONE pgs=1250 cs=0 l=1 rx=0x7fbdb800fa40 tx=0x7fbdb800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:02.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.771+0000 7fbdce7fc700 1 -- 172.21.15.80:0/1011583634 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdb8000ce0 con 0x7fbdd00734e0 2019-11-28T11:40:02.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.771+0000 7fbdce7fc700 1 -- 172.21.15.80:0/1011583634 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb8001010 con 0x7fbdd00734e0 2019-11-28T11:40:02.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.771+0000 7fbdce7fc700 1 -- 172.21.15.80:0/1011583634 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdb8001720 con 0x7fbdd00734e0 2019-11-28T11:40:02.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.771+0000 7fbdd5356700 1 -- 172.21.15.80:0/1011583634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd00734e0 msgr2=0x7fbdd0071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:02.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.771+0000 7fbdd5356700 1 --2- 172.21.15.80:0/1011583634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd00734e0 0x7fbdd0071e20 secure :-1 s=READY pgs=1250 cs=0 l=1 rx=0x7fbdb800fa40 tx=0x7fbdb800f8f0).stop 2019-11-28T11:40:02.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.771+0000 7fbdd5356700 1 -- 172.21.15.80:0/1011583634 shutdown_connections 2019-11-28T11:40:02.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.771+0000 7fbdd5356700 1 --2- 172.21.15.80:0/1011583634 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd0072360 0x7fbdd0072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:02.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.771+0000 7fbdd5356700 1 --2- 172.21.15.80:0/1011583634 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd00734e0 0x7fbdd0071e20 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:02.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.771+0000 7fbdd5356700 1 --2- 172.21.15.80:0/1011583634 >> v2:172.21.15.174:3300/0 conn(0x7fbdd006c0a0 0x7fbdd0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:02.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.772+0000 7fbdd5356700 1 -- 172.21.15.80:0/1011583634 shutdown_connections 2019-11-28T11:40:02.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.772+0000 7fbdd5356700 1 -- 172.21.15.80:0/1011583634 wait complete. 2019-11-28T11:40:02.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.772+0000 7fbdd5356700 1 -- 172.21.15.80:0/1011583634 >> 172.21.15.80:0/1011583634 conn(0x7fbdd0061cf0 msgr2=0x7fbdd0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:02.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.774+0000 7fbdd5356700 1 Processor -- start 2019-11-28T11:40:02.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.774+0000 7fbdd5356700 1 -- start start 2019-11-28T11:40:02.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.775+0000 7fbdd5356700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd013a780 0x7fbdd012d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:02.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.775+0000 7fbdd5356700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd0139a60 con 0x7fbdd012d9c0 2019-11-28T11:40:02.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.775+0000 7fbdd5356700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd013b060 con 0x7fbdd012cb00 2019-11-28T11:40:02.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.775+0000 7fbdd5356700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0129830 con 0x7fbdd013a780 2019-11-28T11:40:02.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.775+0000 7fbdcf7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd013a780 0x7fbdd012d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:02.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.775+0000 7fbdceffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbdd012d9c0 0x7fbdd012c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36880/0 (socket says 172.21.15.80:36880) 2019-11-28T11:40:02.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.775+0000 7fbdcf7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd013a780 0x7fbdd012d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:39822/0 (socket says 172.21.15.80:39822) 2019-11-28T11:40:02.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.775+0000 7fbdceffd700 1 -- 172.21.15.80:0/1874588698 learned_addr learned my addr 172.21.15.80:0/1874588698 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:02.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdc7fff700 1 -- 172.21.15.80:0/1874588698 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465458716 0 0) 0x7fbdb8008120 con 0x7fbdd012d9c0 2019-11-28T11:40:02.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdc7fff700 1 -- 172.21.15.80:0/1874588698 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbda8002e80 con 0x7fbdd012d9c0 2019-11-28T11:40:02.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdc7fff700 1 -- 172.21.15.80:0/1874588698 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065231293 0 0) 0x7fbdc80095b0 con 0x7fbdd012cb00 2019-11-28T11:40:02.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdc7fff700 1 -- 172.21.15.80:0/1874588698 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbda80030b0 con 0x7fbdd012cb00 2019-11-28T11:40:02.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdcf7fe700 1 -- 172.21.15.80:0/1874588698 >> v1:172.21.15.174:6789/0 conn(0x7fbdd012cb00 legacy=0x7fbdd0167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:02.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdcf7fe700 1 -- 172.21.15.80:0/1874588698 >> v1:172.21.15.80:6789/0 conn(0x7fbdd012d9c0 legacy=0x7fbdd012c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:02.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdcf7fe700 1 -- 172.21.15.80:0/1874588698 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd012abc0 con 0x7fbdd013a780 2019-11-28T11:40:02.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdcf7fe700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd013a780 0x7fbdd012d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbdc0010390 tx=0x7fbdc0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:02.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdcf7fe700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd013a780 0x7fbdd012d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbdc0010390 tx=0x7fbdc0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:02.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdcf7fe700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd013a780 0x7fbdd012d480 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fbdc0010390 tx=0x7fbdc0010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:02.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdcf7fe700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd013a780 0x7fbdd012d480 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fbdc0010390 tx=0x7fbdc0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:02.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdc7fff700 1 -- 172.21.15.80:0/1874588698 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdc0009640 con 0x7fbdd013a780 2019-11-28T11:40:02.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdcf7fe700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd013a780 0x7fbdd012d480 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fbdc0010390 tx=0x7fbdc0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:02.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdcf7fe700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd013a780 0x7fbdd012d480 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fbdc0010390 tx=0x7fbdc0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:02.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdc7fff700 1 -- 172.21.15.80:0/1874588698 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc0000940 con 0x7fbdd013a780 2019-11-28T11:40:02.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdd5356700 1 -- 172.21.15.80:0/1874588698 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd012af40 con 0x7fbdd013a780 2019-11-28T11:40:02.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdc7fff700 1 -- 172.21.15.80:0/1874588698 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdc000a0e0 con 0x7fbdd013a780 2019-11-28T11:40:02.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.776+0000 7fbdd5356700 1 -- 172.21.15.80:0/1874588698 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd012abc0 con 0x7fbdd013a780 2019-11-28T11:40:02.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.777+0000 7fbdcf7fe700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd013a780 0x7fbdd012d480 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fbdc0010390 tx=0x7fbdc0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:02.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.777+0000 7fbdc7fff700 1 -- 172.21.15.80:0/1874588698 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbdc0009a70 con 0x7fbdd013a780 2019-11-28T11:40:02.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.777+0000 7fbdcf7fe700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd013a780 0x7fbdd012d480 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fbdc0010390 tx=0x7fbdc0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:02.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.777+0000 7fbdc7fff700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbda8018750 0x7fbda801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:02.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.777+0000 7fbdc7fff700 1 -- 172.21.15.80:0/1874588698 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fbdc0031aa0 con 0x7fbdd013a780 2019-11-28T11:40:02.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.777+0000 7fbdceffd700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbda8018750 0x7fbda801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:02.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.777+0000 7fbdceffd700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbda8018750 0x7fbda801abe0 crc :-1 s=READY pgs=514 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:02.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.784+0000 7fbdd5356700 1 -- 172.21.15.80:0/1874588698 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd012af40 con 0x7fbdd013a780 2019-11-28T11:40:02.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.788+0000 7fbdcf7fe700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd013a780 0x7fbdd012d480 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fbdc0010390 tx=0x7fbdc0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:02.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.788+0000 7fbdc7fff700 1 -- 172.21.15.80:0/1874588698 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbdc0009860 con 0x7fbdd013a780 2019-11-28T11:40:02.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.961+0000 7fbdd5356700 1 -- 172.21.15.80:0/1874588698 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdd012abc0 con 0x7fbdd013a780 2019-11-28T11:40:02.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.961+0000 7fbdcf7fe700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd013a780 0x7fbdd012d480 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fbdc0010390 tx=0x7fbdc0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:02.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.961+0000 7fbdc7fff700 1 -- 172.21.15.80:0/1874588698 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fbdc0009a70 con 0x7fbdd013a780 2019-11-28T11:40:02.993 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:02.993 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:02.993 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:02.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.963+0000 7fbdd5356700 1 -- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbda8018750 msgr2=0x7fbda801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:02.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.963+0000 7fbdd5356700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbda8018750 0x7fbda801abe0 crc :-1 s=READY pgs=514 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:02.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.963+0000 7fbdd5356700 1 -- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd013a780 msgr2=0x7fbdd012d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:02.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.963+0000 7fbdd5356700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd013a780 0x7fbdd012d480 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fbdc0010390 tx=0x7fbdc0010730).stop 2019-11-28T11:40:02.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.963+0000 7fbdd5356700 1 -- 172.21.15.80:0/1874588698 shutdown_connections 2019-11-28T11:40:02.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.963+0000 7fbdd5356700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbda8018750 0x7fbda801abe0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:02.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.963+0000 7fbdd5356700 1 --2- 172.21.15.80:0/1874588698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd013a780 0x7fbdd012d480 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:02.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.964+0000 7fbdd5356700 1 -- 172.21.15.80:0/1874588698 shutdown_connections 2019-11-28T11:40:02.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.964+0000 7fbdd5356700 1 -- 172.21.15.80:0/1874588698 wait complete. 2019-11-28T11:40:02.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:02.964+0000 7fbdd5356700 1 -- 172.21.15.80:0/1874588698 >> 172.21.15.80:0/1874588698 conn(0x7fbdd0127dc0 msgr2=0x7fbdd0141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:03.005 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:04.006 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:04.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.098+0000 7f2d3438e700 1 Processor -- start 2019-11-28T11:40:04.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.098+0000 7f2d3438e700 1 -- start start 2019-11-28T11:40:04.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.099+0000 7f2d3438e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d2c06c0a0 0x7f2d2c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:04.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.099+0000 7f2d3438e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2d2c0734e0 0x7f2d2c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:04.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.099+0000 7f2d3438e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d2c072360 0x7f2d2c0727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:04.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.099+0000 7f2d3438e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c06f330 con 0x7f2d2c072360 2019-11-28T11:40:04.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.099+0000 7f2d3438e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c0706c0 con 0x7f2d2c0734e0 2019-11-28T11:40:04.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.099+0000 7f2d3438e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c070a40 con 0x7f2d2c06c0a0 2019-11-28T11:40:04.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.099+0000 7f2d3312c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d2c072360 0x7f2d2c0727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:04.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.099+0000 7f2d3312c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d2c072360 0x7f2d2c0727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37572/0 (socket says 172.21.15.80:37572) 2019-11-28T11:40:04.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.099+0000 7f2d3312c700 1 -- 172.21.15.80:0/78281081 learned_addr learned my addr 172.21.15.80:0/78281081 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:04.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.099+0000 7f2d3212a700 1 --2- 172.21.15.80:0/78281081 >> v2:172.21.15.174:3300/0 conn(0x7f2d2c0734e0 0x7f2d2c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:04.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.099+0000 7f2d3292b700 1 --2- 172.21.15.80:0/78281081 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d2c06c0a0 0x7f2d2c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:04.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.099+0000 7f2d3312c700 1 -- 172.21.15.80:0/78281081 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d2c06c0a0 msgr2=0x7f2d2c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:04.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.099+0000 7f2d3312c700 1 --2- 172.21.15.80:0/78281081 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d2c06c0a0 0x7f2d2c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:04.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.099+0000 7f2d3312c700 1 -- 172.21.15.80:0/78281081 >> v2:172.21.15.174:3300/0 conn(0x7f2d2c0734e0 msgr2=0x7f2d2c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:04.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.099+0000 7f2d3312c700 1 --2- 172.21.15.80:0/78281081 >> v2:172.21.15.174:3300/0 conn(0x7f2d2c0734e0 0x7f2d2c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:04.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.099+0000 7f2d3312c700 1 -- 172.21.15.80:0/78281081 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c06db00 con 0x7f2d2c072360 2019-11-28T11:40:04.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.100+0000 7f2d3312c700 1 --2- 172.21.15.80:0/78281081 >> v2:172.21.15.80:3300/0 conn(0x7f2d2c072360 0x7f2d2c0727e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2d2400fa30 tx=0x7f2d240080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:04.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.100+0000 7f2d3312c700 1 --2- 172.21.15.80:0/78281081 >> v2:172.21.15.80:3300/0 conn(0x7f2d2c072360 0x7f2d2c0727e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2d2400fa30 tx=0x7f2d240080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:04.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.100+0000 7f2d3312c700 1 --2- 172.21.15.80:0/78281081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c072360 0x7f2d2c0727e0 secure :-1 s=READY pgs=1252 cs=0 l=1 rx=0x7f2d2400fa30 tx=0x7f2d240080d0).ready entity=mon.0 client_cookie=12f2a1e4a2fb0ea3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:04.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.100+0000 7f2d3312c700 1 --2- 172.21.15.80:0/78281081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c072360 0x7f2d2c0727e0 secure :-1 s=THROTTLE_DONE pgs=1252 cs=0 l=1 rx=0x7f2d2400fa30 tx=0x7f2d240080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:04.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.100+0000 7f2d3312c700 1 --2- 172.21.15.80:0/78281081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c072360 0x7f2d2c0727e0 secure :-1 s=THROTTLE_DONE pgs=1252 cs=0 l=1 rx=0x7f2d2400fa30 tx=0x7f2d240080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:04.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.100+0000 7f2d31929700 1 -- 172.21.15.80:0/78281081 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d24000f20 con 0x7f2d2c072360 2019-11-28T11:40:04.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.100+0000 7f2d3312c700 1 --2- 172.21.15.80:0/78281081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c072360 0x7f2d2c0727e0 secure :-1 s=THROTTLE_DONE pgs=1252 cs=0 l=1 rx=0x7f2d2400fa30 tx=0x7f2d240080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:04.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.100+0000 7f2d31929700 1 -- 172.21.15.80:0/78281081 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d24001460 con 0x7f2d2c072360 2019-11-28T11:40:04.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.100+0000 7f2d31929700 1 -- 172.21.15.80:0/78281081 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d24001b30 con 0x7f2d2c072360 2019-11-28T11:40:04.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.100+0000 7f2d3438e700 1 -- 172.21.15.80:0/78281081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c072360 msgr2=0x7f2d2c0727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:04.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.100+0000 7f2d3438e700 1 --2- 172.21.15.80:0/78281081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c072360 0x7f2d2c0727e0 secure :-1 s=READY pgs=1252 cs=0 l=1 rx=0x7f2d2400fa30 tx=0x7f2d240080d0).stop 2019-11-28T11:40:04.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.101+0000 7f2d3438e700 1 -- 172.21.15.80:0/78281081 shutdown_connections 2019-11-28T11:40:04.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.101+0000 7f2d3438e700 1 --2- 172.21.15.80:0/78281081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c072360 0x7f2d2c0727e0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:04.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.101+0000 7f2d3438e700 1 --2- 172.21.15.80:0/78281081 >> v2:172.21.15.174:3300/0 conn(0x7f2d2c0734e0 0x7f2d2c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:04.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.101+0000 7f2d3438e700 1 --2- 172.21.15.80:0/78281081 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d2c06c0a0 0x7f2d2c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:04.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.101+0000 7f2d3438e700 1 -- 172.21.15.80:0/78281081 shutdown_connections 2019-11-28T11:40:04.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.101+0000 7f2d3438e700 1 -- 172.21.15.80:0/78281081 wait complete. 2019-11-28T11:40:04.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.101+0000 7f2d3438e700 1 -- 172.21.15.80:0/78281081 >> 172.21.15.80:0/78281081 conn(0x7f2d2c061cf0 msgr2=0x7f2d2c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:04.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.103+0000 7f2d3438e700 1 Processor -- start 2019-11-28T11:40:04.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.103+0000 7f2d3438e700 1 -- start start 2019-11-28T11:40:04.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3438e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d2c104820 0x7f2d2c10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:04.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3438e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2d2c10b9d0 0x7f2d2c167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:04.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3438e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2c13bcd0 con 0x7f2d2c10c890 2019-11-28T11:40:04.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3438e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c109130 con 0x7f2d2c104820 2019-11-28T11:40:04.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3438e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c109400 con 0x7f2d2c10b9d0 2019-11-28T11:40:04.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3292b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d2c104820 0x7f2d2c10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:04.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3292b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d2c104820 0x7f2d2c10c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37576/0 (socket says 172.21.15.80:37576) 2019-11-28T11:40:04.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3292b700 1 -- 172.21.15.80:0/4074095514 learned_addr learned my addr 172.21.15.80:0/4074095514 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:04.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3312c700 1 --2- 172.21.15.80:0/4074095514 >> v2:172.21.15.174:3300/0 conn(0x7f2d2c10b9d0 0x7f2d2c167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:04.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3292b700 1 -- 172.21.15.80:0/4074095514 >> v2:172.21.15.174:3300/0 conn(0x7f2d2c10b9d0 msgr2=0x7f2d2c167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:04.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3292b700 1 --2- 172.21.15.80:0/4074095514 >> v2:172.21.15.174:3300/0 conn(0x7f2d2c10b9d0 0x7f2d2c167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:04.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3292b700 1 -- 172.21.15.80:0/4074095514 >> v1:172.21.15.174:6789/0 conn(0x7f2d2c10c890 legacy=0x7f2d2c10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3292b700 1 -- 172.21.15.80:0/4074095514 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c109a90 con 0x7f2d2c104820 2019-11-28T11:40:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3312c700 1 --2- 172.21.15.80:0/4074095514 >> v2:172.21.15.174:3300/0 conn(0x7f2d2c10b9d0 0x7f2d2c167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:40:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3292b700 1 --2- 172.21.15.80:0/4074095514 >> v2:172.21.15.80:3300/0 conn(0x7f2d2c104820 0x7f2d2c10c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2d1c010470 tx=0x7f2d1c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3292b700 1 --2- 172.21.15.80:0/4074095514 >> v2:172.21.15.80:3300/0 conn(0x7f2d2c104820 0x7f2d2c10c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2d1c010470 tx=0x7f2d1c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.104+0000 7f2d3292b700 1 --2- 172.21.15.80:0/4074095514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c104820 0x7f2d2c10c350 secure :-1 s=READY pgs=1253 cs=0 l=1 rx=0x7f2d1c010470 tx=0x7f2d1c010810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.105+0000 7f2d3292b700 1 --2- 172.21.15.80:0/4074095514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c104820 0x7f2d2c10c350 secure :-1 s=THROTTLE_DONE pgs=1253 cs=0 l=1 rx=0x7f2d1c010470 tx=0x7f2d1c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.105+0000 7f2d3292b700 1 --2- 172.21.15.80:0/4074095514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c104820 0x7f2d2c10c350 secure :-1 s=THROTTLE_DONE pgs=1253 cs=0 l=1 rx=0x7f2d1c010470 tx=0x7f2d1c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.105+0000 7f2d2b7fe700 1 -- 172.21.15.80:0/4074095514 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d1c005180 con 0x7f2d2c104820 2019-11-28T11:40:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.105+0000 7f2d3292b700 1 --2- 172.21.15.80:0/4074095514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c104820 0x7f2d2c10c350 secure :-1 s=THROTTLE_DONE pgs=1253 cs=0 l=1 rx=0x7f2d1c010470 tx=0x7f2d1c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.105+0000 7f2d2b7fe700 1 -- 172.21.15.80:0/4074095514 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c005880 con 0x7f2d2c104820 2019-11-28T11:40:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.105+0000 7f2d2b7fe700 1 -- 172.21.15.80:0/4074095514 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d1c005fd0 con 0x7f2d2c104820 2019-11-28T11:40:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.105+0000 7f2d3438e700 1 -- 172.21.15.80:0/4074095514 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2c109e10 con 0x7f2d2c104820 2019-11-28T11:40:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.105+0000 7f2d3438e700 1 -- 172.21.15.80:0/4074095514 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2c109a90 con 0x7f2d2c104820 2019-11-28T11:40:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.105+0000 7f2d3292b700 1 --2- 172.21.15.80:0/4074095514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c104820 0x7f2d2c10c350 secure :-1 s=THROTTLE_DONE pgs=1253 cs=0 l=1 rx=0x7f2d1c010470 tx=0x7f2d1c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.105+0000 7f2d2b7fe700 1 -- 172.21.15.80:0/4074095514 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2d1c0055a0 con 0x7f2d2c104820 2019-11-28T11:40:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.105+0000 7f2d3292b700 1 --2- 172.21.15.80:0/4074095514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c104820 0x7f2d2c10c350 secure :-1 s=THROTTLE_DONE pgs=1253 cs=0 l=1 rx=0x7f2d1c010470 tx=0x7f2d1c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.105+0000 7f2d2b7fe700 1 --2- 172.21.15.80:0/4074095514 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d10018730 0x7f2d1001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.105+0000 7f2d2b7fe700 1 -- 172.21.15.80:0/4074095514 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f2d1c031d10 con 0x7f2d2c104820 2019-11-28T11:40:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.106+0000 7f2d3212a700 1 --2- 172.21.15.80:0/4074095514 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d10018730 0x7f2d1001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.106+0000 7f2d3212a700 1 --2- 172.21.15.80:0/4074095514 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d10018730 0x7f2d1001abc0 crc :-1 s=READY pgs=515 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.113+0000 7f2d3438e700 1 -- 172.21.15.80:0/4074095514 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2c109e10 con 0x7f2d2c104820 2019-11-28T11:40:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.116+0000 7f2d3292b700 1 --2- 172.21.15.80:0/4074095514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c104820 0x7f2d2c10c350 secure :-1 s=THROTTLE_DONE pgs=1253 cs=0 l=1 rx=0x7f2d1c010470 tx=0x7f2d1c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:04.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.117+0000 7f2d2b7fe700 1 -- 172.21.15.80:0/4074095514 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2d1c0174e0 con 0x7f2d2c104820 2019-11-28T11:40:04.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.290+0000 7f2d3438e700 1 -- 172.21.15.80:0/4074095514 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d2c109a90 con 0x7f2d2c104820 2019-11-28T11:40:04.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.290+0000 7f2d3292b700 1 --2- 172.21.15.80:0/4074095514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c104820 0x7f2d2c10c350 secure :-1 s=THROTTLE_DONE pgs=1253 cs=0 l=1 rx=0x7f2d1c010470 tx=0x7f2d1c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:04.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.290+0000 7f2d2b7fe700 1 -- 172.21.15.80:0/4074095514 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f2d1c0176f0 con 0x7f2d2c104820 2019-11-28T11:40:04.322 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:04.323 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:04.323 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:04.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.292+0000 7f2d3438e700 1 -- 172.21.15.80:0/4074095514 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d10018730 msgr2=0x7f2d1001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:04.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.292+0000 7f2d3438e700 1 --2- 172.21.15.80:0/4074095514 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d10018730 0x7f2d1001abc0 crc :-1 s=READY pgs=515 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:04.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.292+0000 7f2d3438e700 1 -- 172.21.15.80:0/4074095514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c104820 msgr2=0x7f2d2c10c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:04.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.292+0000 7f2d3438e700 1 --2- 172.21.15.80:0/4074095514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c104820 0x7f2d2c10c350 secure :-1 s=READY pgs=1253 cs=0 l=1 rx=0x7f2d1c010470 tx=0x7f2d1c010810).stop 2019-11-28T11:40:04.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.293+0000 7f2d3438e700 1 -- 172.21.15.80:0/4074095514 shutdown_connections 2019-11-28T11:40:04.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.293+0000 7f2d3438e700 1 --2- 172.21.15.80:0/4074095514 >> v2:172.21.15.174:3300/0 conn(0x7f2d2c10b9d0 0x7f2d2c167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:04.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.293+0000 7f2d3438e700 1 --2- 172.21.15.80:0/4074095514 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d10018730 0x7f2d1001abc0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:04.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.293+0000 7f2d3438e700 1 --2- 172.21.15.80:0/4074095514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d2c104820 0x7f2d2c10c350 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:04.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.293+0000 7f2d3438e700 1 -- 172.21.15.80:0/4074095514 shutdown_connections 2019-11-28T11:40:04.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.293+0000 7f2d3438e700 1 -- 172.21.15.80:0/4074095514 wait complete. 2019-11-28T11:40:04.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:04.293+0000 7f2d3438e700 1 -- 172.21.15.80:0/4074095514 >> 172.21.15.80:0/4074095514 conn(0x7f2d2c13d620 msgr2=0x7f2d2c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:04.333 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:05.334 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:05.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.638+0000 7f107bd07700 1 Processor -- start 2019-11-28T11:40:05.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.638+0000 7f107bd07700 1 -- start start 2019-11-28T11:40:05.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f107bd07700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f107406c0a0 0x7f1074072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:05.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f107bd07700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10740734e0 0x7f1074071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:05.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f107bd07700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107406db00 con 0x7f1074072360 2019-11-28T11:40:05.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f107bd07700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107406fd60 con 0x7f107406c0a0 2019-11-28T11:40:05.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f107bd07700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1074070030 con 0x7f10740734e0 2019-11-28T11:40:05.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f107aaa5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1074072360 0x7f107406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36904/0 (socket says 172.21.15.80:36904) 2019-11-28T11:40:05.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f107aaa5700 1 -- 172.21.15.80:0/4047584281 learned_addr learned my addr 172.21.15.80:0/4047584281 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:05.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f1079aa3700 1 --2- 172.21.15.80:0/4047584281 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10740734e0 0x7f1074071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:05.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f107a2a4700 1 --2- 172.21.15.80:0/4047584281 >> v2:172.21.15.174:3300/0 conn(0x7f107406c0a0 0x7f1074072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:05.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f10792a2700 1 -- 172.21.15.80:0/4047584281 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423463540 0 0) 0x7f106c001150 con 0x7f1074072360 2019-11-28T11:40:05.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f10792a2700 1 -- 172.21.15.80:0/4047584281 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1060002e80 con 0x7f1074072360 2019-11-28T11:40:05.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f107a2a4700 1 -- 172.21.15.80:0/4047584281 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10740734e0 msgr2=0x7f1074071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:05.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f107a2a4700 1 --2- 172.21.15.80:0/4047584281 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10740734e0 0x7f1074071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:05.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f107a2a4700 1 -- 172.21.15.80:0/4047584281 >> v1:172.21.15.80:6789/0 conn(0x7f1074072360 legacy=0x7f107406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:05.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f107a2a4700 1 -- 172.21.15.80:0/4047584281 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10740706c0 con 0x7f107406c0a0 2019-11-28T11:40:05.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f1079aa3700 1 --2- 172.21.15.80:0/4047584281 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10740734e0 0x7f1074071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:40:05.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f107a2a4700 1 --2- 172.21.15.80:0/4047584281 >> v2:172.21.15.174:3300/0 conn(0x7f107406c0a0 0x7f1074072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f106400af50 tx=0x7f106400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:05.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f107a2a4700 1 --2- 172.21.15.80:0/4047584281 >> v2:172.21.15.174:3300/0 conn(0x7f107406c0a0 0x7f1074072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f106400af50 tx=0x7f106400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:05.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.640+0000 7f107a2a4700 1 --2- 172.21.15.80:0/4047584281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f107406c0a0 0x7f1074072fa0 secure :-1 s=READY pgs=741 cs=0 l=1 rx=0x7f106400af50 tx=0x7f106400b760).ready entity=mon.1 client_cookie=1bcbe0125c989b03 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:05.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.641+0000 7f107a2a4700 1 --2- 172.21.15.80:0/4047584281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f107406c0a0 0x7f1074072fa0 secure :-1 s=THROTTLE_DONE pgs=741 cs=0 l=1 rx=0x7f106400af50 tx=0x7f106400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:05.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.641+0000 7f10792a2700 1 -- 172.21.15.80:0/4047584281 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1064007210 con 0x7f107406c0a0 2019-11-28T11:40:05.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.641+0000 7f107a2a4700 1 --2- 172.21.15.80:0/4047584281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f107406c0a0 0x7f1074072fa0 secure :-1 s=THROTTLE_DONE pgs=741 cs=0 l=1 rx=0x7f106400af50 tx=0x7f106400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:05.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.641+0000 7f107a2a4700 1 --2- 172.21.15.80:0/4047584281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f107406c0a0 0x7f1074072fa0 secure :-1 s=THROTTLE_DONE pgs=741 cs=0 l=1 rx=0x7f106400af50 tx=0x7f106400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:05.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.641+0000 7f10792a2700 1 -- 172.21.15.80:0/4047584281 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10640099b0 con 0x7f107406c0a0 2019-11-28T11:40:05.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.641+0000 7f10792a2700 1 -- 172.21.15.80:0/4047584281 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f106400a080 con 0x7f107406c0a0 2019-11-28T11:40:05.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.641+0000 7f107bd07700 1 -- 172.21.15.80:0/4047584281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f107406c0a0 msgr2=0x7f1074072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:05.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.641+0000 7f107bd07700 1 --2- 172.21.15.80:0/4047584281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f107406c0a0 0x7f1074072fa0 secure :-1 s=READY pgs=741 cs=0 l=1 rx=0x7f106400af50 tx=0x7f106400b760).stop 2019-11-28T11:40:05.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.641+0000 7f107bd07700 1 -- 172.21.15.80:0/4047584281 shutdown_connections 2019-11-28T11:40:05.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.641+0000 7f107bd07700 1 --2- 172.21.15.80:0/4047584281 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10740734e0 0x7f1074071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:05.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.641+0000 7f107bd07700 1 --2- 172.21.15.80:0/4047584281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f107406c0a0 0x7f1074072fa0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:05.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.641+0000 7f107bd07700 1 -- 172.21.15.80:0/4047584281 shutdown_connections 2019-11-28T11:40:05.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.641+0000 7f107bd07700 1 -- 172.21.15.80:0/4047584281 wait complete. 2019-11-28T11:40:05.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.641+0000 7f107bd07700 1 -- 172.21.15.80:0/4047584281 >> 172.21.15.80:0/4047584281 conn(0x7f1074061cf0 msgr2=0x7f1074064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:05.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.644+0000 7f107bd07700 1 Processor -- start 2019-11-28T11:40:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.644+0000 7f107bd07700 1 -- start start 2019-11-28T11:40:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f107bd07700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1074103000 0x7f1074103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f107bd07700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10741039d0 0x7f1074167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f107bd07700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10741312c0 con 0x7f107413dc00 2019-11-28T11:40:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f107bd07700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1074105830 con 0x7f1074103000 2019-11-28T11:40:05.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f107bd07700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1074105b00 con 0x7f10741039d0 2019-11-28T11:40:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f107a2a4700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f107413dc00 0x7f1074109e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:52450/0 (socket says 172.21.15.80:52450) 2019-11-28T11:40:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f107a2a4700 1 -- 172.21.15.80:0/907262610 learned_addr learned my addr 172.21.15.80:0/907262610 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f107aaa5700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10741039d0 0x7f1074167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f1079aa3700 1 --2- 172.21.15.80:0/907262610 >> v2:172.21.15.174:3300/0 conn(0x7f1074103000 0x7f1074103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f106affd700 1 -- 172.21.15.80:0/907262610 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375447977 0 0) 0x7f1064009580 con 0x7f107413dc00 2019-11-28T11:40:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f106affd700 1 -- 172.21.15.80:0/907262610 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f105c002e80 con 0x7f107413dc00 2019-11-28T11:40:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f1079aa3700 1 -- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10741039d0 msgr2=0x7f1074167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:05.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f1079aa3700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10741039d0 0x7f1074167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:05.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f1079aa3700 1 -- 172.21.15.80:0/907262610 >> v1:172.21.15.174:6789/0 conn(0x7f107413dc00 legacy=0x7f1074109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:05.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f1079aa3700 1 -- 172.21.15.80:0/907262610 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1074106190 con 0x7f1074103000 2019-11-28T11:40:05.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f107aaa5700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10741039d0 0x7f1074167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:40:05.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f1079aa3700 1 --2- 172.21.15.80:0/907262610 >> v2:172.21.15.174:3300/0 conn(0x7f1074103000 0x7f1074103490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1070010720 tx=0x7f1070010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:05.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f1079aa3700 1 --2- 172.21.15.80:0/907262610 >> v2:172.21.15.174:3300/0 conn(0x7f1074103000 0x7f1074103490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1070010720 tx=0x7f1070010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:05.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f1079aa3700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1074103000 0x7f1074103490 secure :-1 s=READY pgs=743 cs=0 l=1 rx=0x7f1070010720 tx=0x7f1070010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:05.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f1079aa3700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1074103000 0x7f1074103490 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7f1070010720 tx=0x7f1070010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:05.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f106affd700 1 -- 172.21.15.80:0/907262610 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1070000cc0 con 0x7f1074103000 2019-11-28T11:40:05.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f1079aa3700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1074103000 0x7f1074103490 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7f1070010720 tx=0x7f1070010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:05.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.645+0000 7f1079aa3700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1074103000 0x7f1074103490 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7f1070010720 tx=0x7f1070010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:05.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.646+0000 7f106affd700 1 -- 172.21.15.80:0/907262610 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107000e370 con 0x7f1074103000 2019-11-28T11:40:05.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.646+0000 7f106affd700 1 -- 172.21.15.80:0/907262610 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f107000ea00 con 0x7f1074103000 2019-11-28T11:40:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.646+0000 7f107bd07700 1 -- 172.21.15.80:0/907262610 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1074106510 con 0x7f1074103000 2019-11-28T11:40:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.646+0000 7f107bd07700 1 -- 172.21.15.80:0/907262610 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1074106190 con 0x7f1074103000 2019-11-28T11:40:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.646+0000 7f1079aa3700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1074103000 0x7f1074103490 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7f1070010720 tx=0x7f1070010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.646+0000 7f106affd700 1 -- 172.21.15.80:0/907262610 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f107000de80 con 0x7f1074103000 2019-11-28T11:40:05.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.646+0000 7f1079aa3700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1074103000 0x7f1074103490 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7f1070010720 tx=0x7f1070010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:05.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.646+0000 7f106affd700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f105c018770 0x7f105c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:05.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.646+0000 7f106affd700 1 -- 172.21.15.80:0/907262610 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f1070031d80 con 0x7f1074103000 2019-11-28T11:40:05.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.646+0000 7f107a2a4700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f105c018770 0x7f105c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:05.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.647+0000 7f107a2a4700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f105c018770 0x7f105c01abe0 crc :-1 s=READY pgs=516 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:05.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.654+0000 7f107bd07700 1 -- 172.21.15.80:0/907262610 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1074106510 con 0x7f1074103000 2019-11-28T11:40:05.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.658+0000 7f1079aa3700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1074103000 0x7f1074103490 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7f1070010720 tx=0x7f1070010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:05.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.658+0000 7f106affd700 1 -- 172.21.15.80:0/907262610 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1070000cc0 con 0x7f1074103000 2019-11-28T11:40:05.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.827+0000 7f107bd07700 1 -- 172.21.15.80:0/907262610 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1074106190 con 0x7f1074103000 2019-11-28T11:40:05.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.828+0000 7f1079aa3700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1074103000 0x7f1074103490 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7f1070010720 tx=0x7f1070010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:05.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.828+0000 7f106affd700 1 -- 172.21.15.80:0/907262610 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f107000dd70 con 0x7f1074103000 2019-11-28T11:40:05.860 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:05.860 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:05.860 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:05.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.830+0000 7f107bd07700 1 -- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f105c018770 msgr2=0x7f105c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:05.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.830+0000 7f107bd07700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f105c018770 0x7f105c01abe0 crc :-1 s=READY pgs=516 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:05.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.830+0000 7f107bd07700 1 -- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1074103000 msgr2=0x7f1074103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:05.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.830+0000 7f107bd07700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1074103000 0x7f1074103490 secure :-1 s=READY pgs=743 cs=0 l=1 rx=0x7f1070010720 tx=0x7f1070010ac0).stop 2019-11-28T11:40:05.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.830+0000 7f107bd07700 1 -- 172.21.15.80:0/907262610 shutdown_connections 2019-11-28T11:40:05.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.830+0000 7f107bd07700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10741039d0 0x7f1074167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:05.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.830+0000 7f107bd07700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1074103000 0x7f1074103490 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:05.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.830+0000 7f107bd07700 1 --2- 172.21.15.80:0/907262610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f105c018770 0x7f105c01abe0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:05.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.830+0000 7f107bd07700 1 -- 172.21.15.80:0/907262610 shutdown_connections 2019-11-28T11:40:05.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.830+0000 7f107bd07700 1 -- 172.21.15.80:0/907262610 wait complete. 2019-11-28T11:40:05.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:05.830+0000 7f107bd07700 1 -- 172.21.15.80:0/907262610 >> 172.21.15.80:0/907262610 conn(0x7f107411bfc0 msgr2=0x7f1074141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:05.871 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:06.872 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:07.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.990+0000 7f64e2727700 1 Processor -- start 2019-11-28T11:40:07.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.990+0000 7f64e2727700 1 -- start start 2019-11-28T11:40:07.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64e2727700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f64dc06c490 0x7f64dc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:07.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64e2727700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f64dc06ce60 0x7f64dc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:07.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64e2727700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64dc06db00 con 0x7f64dc06c0a0 2019-11-28T11:40:07.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64e2727700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64dc06fd60 con 0x7f64dc06c490 2019-11-28T11:40:07.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64e2727700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64dc070030 con 0x7f64dc06ce60 2019-11-28T11:40:07.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64dbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f64dc06c490 0x7f64dc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:07.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64dbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f64dc06c490 0x7f64dc06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37600/0 (socket says 172.21.15.80:37600) 2019-11-28T11:40:07.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64dbfff700 1 -- 172.21.15.80:0/11115070 learned_addr learned my addr 172.21.15.80:0/11115070 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:07.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64e0cc4700 1 --1- 172.21.15.80:0/11115070 >> v1:172.21.15.80:6789/0 conn(0x7f64dc06c0a0 0x7f64dc072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36914/0 (socket says 172.21.15.80:36914) 2019-11-28T11:40:07.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64e14c5700 1 --2- 172.21.15.80:0/11115070 >> v2:172.21.15.174:3300/0 conn(0x7f64dc06ce60 0x7f64dc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:07.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64dbfff700 1 -- 172.21.15.80:0/11115070 >> v2:172.21.15.174:3300/0 conn(0x7f64dc06ce60 msgr2=0x7f64dc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:07.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64dbfff700 1 --2- 172.21.15.80:0/11115070 >> v2:172.21.15.174:3300/0 conn(0x7f64dc06ce60 0x7f64dc164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:07.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64dbfff700 1 -- 172.21.15.80:0/11115070 >> v1:172.21.15.80:6789/0 conn(0x7f64dc06c0a0 legacy=0x7f64dc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:07.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64dbfff700 1 -- 172.21.15.80:0/11115070 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc0706c0 con 0x7f64dc06c490 2019-11-28T11:40:07.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64db7fe700 1 -- 172.21.15.80:0/11115070 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282664100 0 0) 0x7f64c4001100 con 0x7f64dc06c0a0 2019-11-28T11:40:07.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64dbfff700 1 --2- 172.21.15.80:0/11115070 >> v2:172.21.15.80:3300/0 conn(0x7f64dc06c490 0x7f64dc06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f64cc00fa40 tx=0x7f64cc00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:07.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64dbfff700 1 --2- 172.21.15.80:0/11115070 >> v2:172.21.15.80:3300/0 conn(0x7f64dc06c490 0x7f64dc06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f64cc00fa40 tx=0x7f64cc00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:07.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64dbfff700 1 --2- 172.21.15.80:0/11115070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64dc06c490 0x7f64dc06c920 secure :-1 s=READY pgs=1256 cs=0 l=1 rx=0x7f64cc00fa40 tx=0x7f64cc00fde0).ready entity=mon.0 client_cookie=fbf5adbf0cf0cacb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:07.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64dbfff700 1 --2- 172.21.15.80:0/11115070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64dc06c490 0x7f64dc06c920 secure :-1 s=THROTTLE_DONE pgs=1256 cs=0 l=1 rx=0x7f64cc00fa40 tx=0x7f64cc00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:07.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.991+0000 7f64db7fe700 1 -- 172.21.15.80:0/11115070 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64cc000ce0 con 0x7f64dc06c490 2019-11-28T11:40:07.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.992+0000 7f64dbfff700 1 --2- 172.21.15.80:0/11115070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64dc06c490 0x7f64dc06c920 secure :-1 s=THROTTLE_DONE pgs=1256 cs=0 l=1 rx=0x7f64cc00fa40 tx=0x7f64cc00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:07.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.992+0000 7f64dbfff700 1 --2- 172.21.15.80:0/11115070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64dc06c490 0x7f64dc06c920 secure :-1 s=THROTTLE_DONE pgs=1256 cs=0 l=1 rx=0x7f64cc00fa40 tx=0x7f64cc00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:07.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.992+0000 7f64db7fe700 1 -- 172.21.15.80:0/11115070 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc001010 con 0x7f64dc06c490 2019-11-28T11:40:07.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.992+0000 7f64db7fe700 1 -- 172.21.15.80:0/11115070 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64cc001720 con 0x7f64dc06c490 2019-11-28T11:40:07.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.992+0000 7f64e2727700 1 -- 172.21.15.80:0/11115070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64dc06c490 msgr2=0x7f64dc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:07.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.992+0000 7f64e2727700 1 --2- 172.21.15.80:0/11115070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64dc06c490 0x7f64dc06c920 secure :-1 s=READY pgs=1256 cs=0 l=1 rx=0x7f64cc00fa40 tx=0x7f64cc00fde0).stop 2019-11-28T11:40:07.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.992+0000 7f64e2727700 1 -- 172.21.15.80:0/11115070 shutdown_connections 2019-11-28T11:40:07.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.992+0000 7f64e2727700 1 --2- 172.21.15.80:0/11115070 >> v2:172.21.15.174:3300/0 conn(0x7f64dc06ce60 0x7f64dc164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:07.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.992+0000 7f64e2727700 1 --2- 172.21.15.80:0/11115070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64dc06c490 0x7f64dc06c920 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:07.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.992+0000 7f64e2727700 1 -- 172.21.15.80:0/11115070 shutdown_connections 2019-11-28T11:40:07.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.992+0000 7f64e2727700 1 -- 172.21.15.80:0/11115070 wait complete. 2019-11-28T11:40:07.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.992+0000 7f64e2727700 1 -- 172.21.15.80:0/11115070 >> 172.21.15.80:0/11115070 conn(0x7f64dc061cf0 msgr2=0x7f64dc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:07.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.995+0000 7f64e2727700 1 Processor -- start 2019-11-28T11:40:07.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.995+0000 7f64e2727700 1 -- start start 2019-11-28T11:40:07.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.996+0000 7f64e2727700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f64dc1281b0 0x7f64dc128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:07.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.996+0000 7f64e2727700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64dc139a60 con 0x7f64dc13a780 2019-11-28T11:40:07.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.996+0000 7f64e2727700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64dc13b060 con 0x7f64dc128b80 2019-11-28T11:40:07.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.996+0000 7f64e2727700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64dc12a260 con 0x7f64dc1281b0 2019-11-28T11:40:07.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.996+0000 7f64e0cc4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f64dc13a780 0x7f64dc12d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36920/0 (socket says 172.21.15.80:36920) 2019-11-28T11:40:07.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.996+0000 7f64e0cc4700 1 -- 172.21.15.80:0/2302120525 learned_addr learned my addr 172.21.15.80:0/2302120525 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:07.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.996+0000 7f64dbfff700 1 --2- 172.21.15.80:0/2302120525 >> v2:172.21.15.174:3300/0 conn(0x7f64dc1281b0 0x7f64dc128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:07.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.996+0000 7f64d97fa700 1 -- 172.21.15.80:0/2302120525 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252245516 0 0) 0x7f64c4001150 con 0x7f64dc13a780 2019-11-28T11:40:07.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.996+0000 7f64d97fa700 1 -- 172.21.15.80:0/2302120525 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64c0002e80 con 0x7f64dc13a780 2019-11-28T11:40:07.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.996+0000 7f64dbfff700 1 -- 172.21.15.80:0/2302120525 >> v1:172.21.15.174:6789/0 conn(0x7f64dc128b80 legacy=0x7f64dc167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:07.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.996+0000 7f64dbfff700 1 -- 172.21.15.80:0/2302120525 >> v1:172.21.15.80:6789/0 conn(0x7f64dc13a780 legacy=0x7f64dc12d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:07.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.996+0000 7f64d97fa700 1 -- 172.21.15.80:0/2302120525 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888195350 0 0) 0x7f64d40020d0 con 0x7f64dc128b80 2019-11-28T11:40:07.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.996+0000 7f64dbfff700 1 -- 172.21.15.80:0/2302120525 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc12abc0 con 0x7f64dc1281b0 2019-11-28T11:40:07.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.996+0000 7f64dbfff700 1 --2- 172.21.15.80:0/2302120525 >> v2:172.21.15.174:3300/0 conn(0x7f64dc1281b0 0x7f64dc128640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f64cc010720 tx=0x7f64cc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:07.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.996+0000 7f64dbfff700 1 --2- 172.21.15.80:0/2302120525 >> v2:172.21.15.174:3300/0 conn(0x7f64dc1281b0 0x7f64dc128640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f64cc010720 tx=0x7f64cc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:07.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.996+0000 7f64dbfff700 1 --2- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64dc1281b0 0x7f64dc128640 secure :-1 s=READY pgs=745 cs=0 l=1 rx=0x7f64cc010720 tx=0x7f64cc010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:07.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.997+0000 7f64dbfff700 1 --2- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64dc1281b0 0x7f64dc128640 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7f64cc010720 tx=0x7f64cc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:07.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.997+0000 7f64d97fa700 1 -- 172.21.15.80:0/2302120525 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64cc000cc0 con 0x7f64dc1281b0 2019-11-28T11:40:07.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.997+0000 7f64dbfff700 1 --2- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64dc1281b0 0x7f64dc128640 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7f64cc010720 tx=0x7f64cc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:07.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.997+0000 7f64dbfff700 1 --2- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64dc1281b0 0x7f64dc128640 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7f64cc010720 tx=0x7f64cc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:07.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.997+0000 7f64d97fa700 1 -- 172.21.15.80:0/2302120525 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc0012d0 con 0x7f64dc1281b0 2019-11-28T11:40:07.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.997+0000 7f64d97fa700 1 -- 172.21.15.80:0/2302120525 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64cc001a20 con 0x7f64dc1281b0 2019-11-28T11:40:07.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.997+0000 7f64e2727700 1 -- 172.21.15.80:0/2302120525 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64dc12af40 con 0x7f64dc1281b0 2019-11-28T11:40:07.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.997+0000 7f64e2727700 1 -- 172.21.15.80:0/2302120525 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc12abc0 con 0x7f64dc1281b0 2019-11-28T11:40:07.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.997+0000 7f64dbfff700 1 --2- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64dc1281b0 0x7f64dc128640 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7f64cc010720 tx=0x7f64cc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:07.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.997+0000 7f64d97fa700 1 -- 172.21.15.80:0/2302120525 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f64cc0014c0 con 0x7f64dc1281b0 2019-11-28T11:40:07.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.997+0000 7f64dbfff700 1 --2- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64dc1281b0 0x7f64dc128640 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7f64cc010720 tx=0x7f64cc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:07.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.997+0000 7f64d97fa700 1 --2- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f64c0018780 0x7f64c001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:07.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.997+0000 7f64d97fa700 1 -- 172.21.15.80:0/2302120525 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f64cc031e50 con 0x7f64dc1281b0 2019-11-28T11:40:07.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.998+0000 7f64e0cc4700 1 --2- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f64c0018780 0x7f64c001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:07.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:06.998+0000 7f64e0cc4700 1 --2- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f64c0018780 0x7f64c001abf0 crc :-1 s=READY pgs=517 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:07.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:07.005+0000 7f64e2727700 1 -- 172.21.15.80:0/2302120525 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64dc12af40 con 0x7f64dc1281b0 2019-11-28T11:40:07.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:07.009+0000 7f64dbfff700 1 --2- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64dc1281b0 0x7f64dc128640 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7f64cc010720 tx=0x7f64cc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:07.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:07.009+0000 7f64d97fa700 1 -- 172.21.15.80:0/2302120525 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f64cc000ed0 con 0x7f64dc1281b0 2019-11-28T11:40:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:07.180+0000 7f64e2727700 1 -- 172.21.15.80:0/2302120525 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64dc12abc0 con 0x7f64dc1281b0 2019-11-28T11:40:07.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:07.180+0000 7f64dbfff700 1 --2- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64dc1281b0 0x7f64dc128640 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7f64cc010720 tx=0x7f64cc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:07.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:07.180+0000 7f64d97fa700 1 -- 172.21.15.80:0/2302120525 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f64cc001ed0 con 0x7f64dc1281b0 2019-11-28T11:40:07.212 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:07.212 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:07.213 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:07.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:07.183+0000 7f64e2727700 1 -- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f64c0018780 msgr2=0x7f64c001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:07.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:07.183+0000 7f64e2727700 1 --2- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f64c0018780 0x7f64c001abf0 crc :-1 s=READY pgs=517 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:07.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:07.183+0000 7f64e2727700 1 -- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64dc1281b0 msgr2=0x7f64dc128640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:07.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:07.183+0000 7f64e2727700 1 --2- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64dc1281b0 0x7f64dc128640 secure :-1 s=READY pgs=745 cs=0 l=1 rx=0x7f64cc010720 tx=0x7f64cc010ac0).stop 2019-11-28T11:40:07.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:07.183+0000 7f64e2727700 1 -- 172.21.15.80:0/2302120525 shutdown_connections 2019-11-28T11:40:07.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:07.183+0000 7f64e2727700 1 --2- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f64c0018780 0x7f64c001abf0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:07.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:07.183+0000 7f64e2727700 1 --2- 172.21.15.80:0/2302120525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64dc1281b0 0x7f64dc128640 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:07.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:07.183+0000 7f64e2727700 1 -- 172.21.15.80:0/2302120525 shutdown_connections 2019-11-28T11:40:07.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:07.183+0000 7f64e2727700 1 -- 172.21.15.80:0/2302120525 wait complete. 2019-11-28T11:40:07.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:07.183+0000 7f64e2727700 1 -- 172.21.15.80:0/2302120525 >> 172.21.15.80:0/2302120525 conn(0x7f64dc127dc0 msgr2=0x7f64dc141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:07.224 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:08.227 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:08.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.321+0000 7ffbcffac700 1 Processor -- start 2019-11-28T11:40:08.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.321+0000 7ffbcffac700 1 -- start start 2019-11-28T11:40:08.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.322+0000 7ffbcffac700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc806d120 0x7ffbc8165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:08.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.322+0000 7ffbcffac700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc806d580 con 0x7ffbc806c490 2019-11-28T11:40:08.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.322+0000 7ffbcffac700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc806db00 con 0x7ffbc806c0a0 2019-11-28T11:40:08.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.322+0000 7ffbcffac700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc806fd60 con 0x7ffbc806d120 2019-11-28T11:40:08.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.322+0000 7ffbcdd48700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ffbc806c490 0x7ffbc806c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36934/0 (socket says 172.21.15.80:36934) 2019-11-28T11:40:08.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.322+0000 7ffbcdd48700 1 -- 172.21.15.80:0/3242288755 learned_addr learned my addr 172.21.15.80:0/3242288755 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:08.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.322+0000 7ffbced4a700 1 --2- 172.21.15.80:0/3242288755 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc806d120 0x7ffbc8165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:08.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.322+0000 7ffbcd547700 1 -- 172.21.15.80:0/3242288755 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879668480 0 0) 0x7ffbbc001150 con 0x7ffbc806c490 2019-11-28T11:40:08.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.322+0000 7ffbcd547700 1 -- 172.21.15.80:0/3242288755 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbb0002e80 con 0x7ffbc806c490 2019-11-28T11:40:08.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.322+0000 7ffbcd547700 1 -- 172.21.15.80:0/3242288755 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481438968 0 0) 0x7ffbc0001400 con 0x7ffbc806c0a0 2019-11-28T11:40:08.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.322+0000 7ffbcd547700 1 -- 172.21.15.80:0/3242288755 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbb00030b0 con 0x7ffbc806c0a0 2019-11-28T11:40:08.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.323+0000 7ffbcd547700 1 -- 172.21.15.80:0/3242288755 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3854321764 0 0) 0x7ffbbc001130 con 0x7ffbc806c490 2019-11-28T11:40:08.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.323+0000 7ffbced4a700 1 -- 172.21.15.80:0/3242288755 >> v1:172.21.15.174:6789/0 conn(0x7ffbc806c0a0 legacy=0x7ffbc8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:08.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.323+0000 7ffbced4a700 1 -- 172.21.15.80:0/3242288755 >> v1:172.21.15.80:6789/0 conn(0x7ffbc806c490 legacy=0x7ffbc806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:08.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.323+0000 7ffbced4a700 1 -- 172.21.15.80:0/3242288755 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc80706c0 con 0x7ffbc806d120 2019-11-28T11:40:08.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.323+0000 7ffbced4a700 1 --2- 172.21.15.80:0/3242288755 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc806d120 0x7ffbc8165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffbb800af80 tx=0x7ffbb800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:08.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.323+0000 7ffbced4a700 1 --2- 172.21.15.80:0/3242288755 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc806d120 0x7ffbc8165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffbb800af80 tx=0x7ffbb800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:08.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.323+0000 7ffbced4a700 1 --2- 172.21.15.80:0/3242288755 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc806d120 0x7ffbc8165d80 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7ffbb800af80 tx=0x7ffbb800b790).ready entity=mon.2 client_cookie=3cef0ad9efa772d1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:08.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.323+0000 7ffbced4a700 1 --2- 172.21.15.80:0/3242288755 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc806d120 0x7ffbc8165d80 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7ffbb800af80 tx=0x7ffbb800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:08.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.323+0000 7ffbcd547700 1 -- 172.21.15.80:0/3242288755 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbb8007240 con 0x7ffbc806d120 2019-11-28T11:40:08.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.323+0000 7ffbced4a700 1 --2- 172.21.15.80:0/3242288755 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc806d120 0x7ffbc8165d80 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7ffbb800af80 tx=0x7ffbb800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:08.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.323+0000 7ffbcd547700 1 -- 172.21.15.80:0/3242288755 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb8000bb0 con 0x7ffbc806d120 2019-11-28T11:40:08.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.323+0000 7ffbced4a700 1 --2- 172.21.15.80:0/3242288755 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc806d120 0x7ffbc8165d80 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7ffbb800af80 tx=0x7ffbb800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:08.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.323+0000 7ffbcd547700 1 -- 172.21.15.80:0/3242288755 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbb8009bd0 con 0x7ffbc806d120 2019-11-28T11:40:08.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.323+0000 7ffbcffac700 1 -- 172.21.15.80:0/3242288755 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc806d120 msgr2=0x7ffbc8165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:08.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.323+0000 7ffbcffac700 1 --2- 172.21.15.80:0/3242288755 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc806d120 0x7ffbc8165d80 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7ffbb800af80 tx=0x7ffbb800b790).stop 2019-11-28T11:40:08.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.324+0000 7ffbcffac700 1 -- 172.21.15.80:0/3242288755 shutdown_connections 2019-11-28T11:40:08.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.324+0000 7ffbcffac700 1 --2- 172.21.15.80:0/3242288755 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc806d120 0x7ffbc8165d80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:08.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.324+0000 7ffbcffac700 1 -- 172.21.15.80:0/3242288755 shutdown_connections 2019-11-28T11:40:08.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.324+0000 7ffbcffac700 1 -- 172.21.15.80:0/3242288755 wait complete. 2019-11-28T11:40:08.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.324+0000 7ffbcffac700 1 -- 172.21.15.80:0/3242288755 >> 172.21.15.80:0/3242288755 conn(0x7ffbc8061cf0 msgr2=0x7ffbc8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:08.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.326+0000 7ffbcffac700 1 Processor -- start 2019-11-28T11:40:08.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.326+0000 7ffbcffac700 1 -- start start 2019-11-28T11:40:08.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.327+0000 7ffbcffac700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffbc81145b0 0x7ffbc8114a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:08.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.327+0000 7ffbcffac700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc8114f80 0x7ffbc8168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:08.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.327+0000 7ffbcffac700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc813fc50 con 0x7ffbc813f580 2019-11-28T11:40:08.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.327+0000 7ffbcffac700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc8112550 con 0x7ffbc81145b0 2019-11-28T11:40:08.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.327+0000 7ffbcffac700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8112820 con 0x7ffbc8114f80 2019-11-28T11:40:08.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.327+0000 7ffbce549700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ffbc813f580 0x7ffbc8115730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36942/0 (socket says 172.21.15.80:36942) 2019-11-28T11:40:08.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.327+0000 7ffbce549700 1 -- 172.21.15.80:0/634774379 learned_addr learned my addr 172.21.15.80:0/634774379 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:08.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.327+0000 7ffbced4a700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc8114f80 0x7ffbc8168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:08.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.327+0000 7ffbcdd48700 1 --2- 172.21.15.80:0/634774379 >> v2:172.21.15.174:3300/0 conn(0x7ffbc81145b0 0x7ffbc8114a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:08.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.327+0000 7ffbc6ffd700 1 -- 172.21.15.80:0/634774379 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547572332 0 0) 0x7ffbc00015c0 con 0x7ffbc813f580 2019-11-28T11:40:08.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.327+0000 7ffbc6ffd700 1 -- 172.21.15.80:0/634774379 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffba8002e80 con 0x7ffbc813f580 2019-11-28T11:40:08.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbc6ffd700 1 -- 172.21.15.80:0/634774379 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1622141855 0 0) 0x7ffbc00017c0 con 0x7ffbc813f580 2019-11-28T11:40:08.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbced4a700 1 -- 172.21.15.80:0/634774379 >> v2:172.21.15.174:3300/0 conn(0x7ffbc81145b0 msgr2=0x7ffbc8114a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:08.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbced4a700 1 --2- 172.21.15.80:0/634774379 >> v2:172.21.15.174:3300/0 conn(0x7ffbc81145b0 0x7ffbc8114a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:08.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbced4a700 1 -- 172.21.15.80:0/634774379 >> v1:172.21.15.80:6789/0 conn(0x7ffbc813f580 legacy=0x7ffbc8115730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:08.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbced4a700 1 -- 172.21.15.80:0/634774379 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc8112eb0 con 0x7ffbc8114f80 2019-11-28T11:40:08.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbcdd48700 1 --2- 172.21.15.80:0/634774379 >> v2:172.21.15.174:3300/0 conn(0x7ffbc81145b0 0x7ffbc8114a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:40:08.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbced4a700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc8114f80 0x7ffbc8168a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffbb80543f0 tx=0x7ffbb8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:08.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbced4a700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc8114f80 0x7ffbc8168a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffbb80543f0 tx=0x7ffbb8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:08.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbced4a700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc8114f80 0x7ffbc8168a20 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7ffbb80543f0 tx=0x7ffbb8054790).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:08.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbced4a700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc8114f80 0x7ffbc8168a20 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7ffbb80543f0 tx=0x7ffbb8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:08.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbc6ffd700 1 -- 172.21.15.80:0/634774379 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbb800b050 con 0x7ffbc8114f80 2019-11-28T11:40:08.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbced4a700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc8114f80 0x7ffbc8168a20 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7ffbb80543f0 tx=0x7ffbb8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:08.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbced4a700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc8114f80 0x7ffbc8168a20 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7ffbb80543f0 tx=0x7ffbb8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:08.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbc6ffd700 1 -- 172.21.15.80:0/634774379 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb80099b0 con 0x7ffbc8114f80 2019-11-28T11:40:08.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbcffac700 1 -- 172.21.15.80:0/634774379 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc8113230 con 0x7ffbc8114f80 2019-11-28T11:40:08.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbc6ffd700 1 -- 172.21.15.80:0/634774379 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbb800a040 con 0x7ffbc8114f80 2019-11-28T11:40:08.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbcffac700 1 -- 172.21.15.80:0/634774379 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc8112eb0 con 0x7ffbc8114f80 2019-11-28T11:40:08.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.328+0000 7ffbced4a700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc8114f80 0x7ffbc8168a20 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7ffbb80543f0 tx=0x7ffbb8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:08.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.329+0000 7ffbc6ffd700 1 -- 172.21.15.80:0/634774379 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ffbb80095b0 con 0x7ffbc8114f80 2019-11-28T11:40:08.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.329+0000 7ffbced4a700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc8114f80 0x7ffbc8168a20 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7ffbb80543f0 tx=0x7ffbb8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:08.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.329+0000 7ffbc6ffd700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffba8018780 0x7ffba801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:08.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.329+0000 7ffbc6ffd700 1 -- 172.21.15.80:0/634774379 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7ffbb8075a60 con 0x7ffbc8114f80 2019-11-28T11:40:08.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.329+0000 7ffbce549700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffba8018780 0x7ffba801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:08.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.329+0000 7ffbce549700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffba8018780 0x7ffba801abf0 crc :-1 s=READY pgs=520 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:08.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.336+0000 7ffbcffac700 1 -- 172.21.15.80:0/634774379 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc8113230 con 0x7ffbc8114f80 2019-11-28T11:40:08.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.340+0000 7ffbced4a700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc8114f80 0x7ffbc8168a20 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7ffbb80543f0 tx=0x7ffbb8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:08.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.340+0000 7ffbc6ffd700 1 -- 172.21.15.80:0/634774379 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ffbb800b050 con 0x7ffbc8114f80 2019-11-28T11:40:08.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.510+0000 7ffbcffac700 1 -- 172.21.15.80:0/634774379 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbc8112eb0 con 0x7ffbc8114f80 2019-11-28T11:40:08.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.511+0000 7ffbced4a700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc8114f80 0x7ffbc8168a20 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7ffbb80543f0 tx=0x7ffbb8054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:08.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.511+0000 7ffbc6ffd700 1 -- 172.21.15.80:0/634774379 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7ffbb80095b0 con 0x7ffbc8114f80 2019-11-28T11:40:08.542 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:08.542 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:08.542 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:08.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.513+0000 7ffbcffac700 1 -- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffba8018780 msgr2=0x7ffba801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:08.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.513+0000 7ffbcffac700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffba8018780 0x7ffba801abf0 crc :-1 s=READY pgs=520 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:08.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.513+0000 7ffbcffac700 1 -- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc8114f80 msgr2=0x7ffbc8168a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:08.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.513+0000 7ffbcffac700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc8114f80 0x7ffbc8168a20 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7ffbb80543f0 tx=0x7ffbb8054790).stop 2019-11-28T11:40:08.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.513+0000 7ffbcffac700 1 -- 172.21.15.80:0/634774379 shutdown_connections 2019-11-28T11:40:08.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.513+0000 7ffbcffac700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffba8018780 0x7ffba801abf0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:08.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.513+0000 7ffbcffac700 1 --2- 172.21.15.80:0/634774379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbc8114f80 0x7ffbc8168a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:08.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.513+0000 7ffbcffac700 1 --2- 172.21.15.80:0/634774379 >> v2:172.21.15.174:3300/0 conn(0x7ffbc81145b0 0x7ffbc8114a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:08.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.513+0000 7ffbcffac700 1 -- 172.21.15.80:0/634774379 shutdown_connections 2019-11-28T11:40:08.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.513+0000 7ffbcffac700 1 -- 172.21.15.80:0/634774379 wait complete. 2019-11-28T11:40:08.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:08.513+0000 7ffbcffac700 1 -- 172.21.15.80:0/634774379 >> 172.21.15.80:0/634774379 conn(0x7ffbc81426c0 msgr2=0x7ffbc8110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:08.553 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:09.554 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:09.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.653+0000 7fa998068700 1 Processor -- start 2019-11-28T11:40:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.653+0000 7fa998068700 1 -- start start 2019-11-28T11:40:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.654+0000 7fa998068700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa99006d120 0x7fa990165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.654+0000 7fa998068700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99006d580 con 0x7fa99006c490 2019-11-28T11:40:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.654+0000 7fa998068700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99006db00 con 0x7fa99006c0a0 2019-11-28T11:40:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.654+0000 7fa998068700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99006fd60 con 0x7fa99006d120 2019-11-28T11:40:09.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.654+0000 7fa996e06700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa99006d120 0x7fa990165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:09.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.654+0000 7fa996605700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa99006c0a0 0x7fa990072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:52490/0 (socket says 172.21.15.80:52490) 2019-11-28T11:40:09.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.654+0000 7fa996605700 1 -- 172.21.15.80:0/1700968183 learned_addr learned my addr 172.21.15.80:0/1700968183 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:09.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa995603700 1 -- 172.21.15.80:0/1700968183 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513278534 0 0) 0x7fa97c001100 con 0x7fa99006c490 2019-11-28T11:40:09.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa995603700 1 -- 172.21.15.80:0/1700968183 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa980002e80 con 0x7fa99006c490 2019-11-28T11:40:09.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa995603700 1 -- 172.21.15.80:0/1700968183 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457394029 0 0) 0x7fa984001440 con 0x7fa99006c0a0 2019-11-28T11:40:09.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa995603700 1 -- 172.21.15.80:0/1700968183 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa980004170 con 0x7fa99006c0a0 2019-11-28T11:40:09.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa996e06700 1 -- 172.21.15.80:0/1700968183 >> v1:172.21.15.174:6789/0 conn(0x7fa99006c0a0 legacy=0x7fa990072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa996e06700 1 -- 172.21.15.80:0/1700968183 >> v1:172.21.15.80:6789/0 conn(0x7fa99006c490 legacy=0x7fa99006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa996e06700 1 -- 172.21.15.80:0/1700968183 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9900706c0 con 0x7fa99006d120 2019-11-28T11:40:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa996e06700 1 --2- 172.21.15.80:0/1700968183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa99006d120 0x7fa990165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa98800af80 tx=0x7fa98800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa996e06700 1 --2- 172.21.15.80:0/1700968183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa99006d120 0x7fa990165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa98800af80 tx=0x7fa98800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa996e06700 1 --2- 172.21.15.80:0/1700968183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa99006d120 0x7fa990165d80 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7fa98800af80 tx=0x7fa98800b790).ready entity=mon.2 client_cookie=17f092c006a305b5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:09.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa996e06700 1 --2- 172.21.15.80:0/1700968183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa99006d120 0x7fa990165d80 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fa98800af80 tx=0x7fa98800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa995603700 1 -- 172.21.15.80:0/1700968183 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa988007240 con 0x7fa99006d120 2019-11-28T11:40:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa996e06700 1 --2- 172.21.15.80:0/1700968183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa99006d120 0x7fa990165d80 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fa98800af80 tx=0x7fa98800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa996e06700 1 --2- 172.21.15.80:0/1700968183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa99006d120 0x7fa990165d80 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fa98800af80 tx=0x7fa98800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa995603700 1 -- 172.21.15.80:0/1700968183 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa988000bb0 con 0x7fa99006d120 2019-11-28T11:40:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa995603700 1 -- 172.21.15.80:0/1700968183 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa988009a80 con 0x7fa99006d120 2019-11-28T11:40:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa998068700 1 -- 172.21.15.80:0/1700968183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa99006d120 msgr2=0x7fa990165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:09.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.655+0000 7fa998068700 1 --2- 172.21.15.80:0/1700968183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa99006d120 0x7fa990165d80 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7fa98800af80 tx=0x7fa98800b790).stop 2019-11-28T11:40:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.656+0000 7fa998068700 1 -- 172.21.15.80:0/1700968183 shutdown_connections 2019-11-28T11:40:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.656+0000 7fa998068700 1 --2- 172.21.15.80:0/1700968183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa99006d120 0x7fa990165d80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.656+0000 7fa998068700 1 -- 172.21.15.80:0/1700968183 shutdown_connections 2019-11-28T11:40:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.656+0000 7fa998068700 1 -- 172.21.15.80:0/1700968183 wait complete. 2019-11-28T11:40:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.656+0000 7fa998068700 1 -- 172.21.15.80:0/1700968183 >> 172.21.15.80:0/1700968183 conn(0x7fa990061cf0 msgr2=0x7fa990064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.659+0000 7fa998068700 1 Processor -- start 2019-11-28T11:40:09.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.659+0000 7fa998068700 1 -- start start 2019-11-28T11:40:09.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.659+0000 7fa998068700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa990127360 0x7fa9901277f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:09.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.659+0000 7fa998068700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa99010ea60 0x7fa99010eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:09.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.659+0000 7fa998068700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa990102680 con 0x7fa990142ff0 2019-11-28T11:40:09.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.659+0000 7fa998068700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa990110350 con 0x7fa99010ea60 2019-11-28T11:40:09.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.659+0000 7fa998068700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa990110620 con 0x7fa990127360 2019-11-28T11:40:09.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa996e06700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa99010ea60 0x7fa99010eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:09.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa995e04700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa990127360 0x7fa9901277f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:09.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa996e06700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa99010ea60 0x7fa99010eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:52524/0 (socket says 172.21.15.80:52524) 2019-11-28T11:40:09.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa996e06700 1 -- 172.21.15.80:0/1438766776 learned_addr learned my addr 172.21.15.80:0/1438766776 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:09.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa996605700 1 --1- 172.21.15.80:0/1438766776 >> v1:172.21.15.174:6789/0 conn(0x7fa990142ff0 0x7fa99015a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:52494/0 (socket says 172.21.15.80:52494) 2019-11-28T11:40:09.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa995e04700 1 -- 172.21.15.80:0/1438766776 >> v2:172.21.15.174:3300/0 conn(0x7fa99010ea60 msgr2=0x7fa99010eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:09.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa995e04700 1 --2- 172.21.15.80:0/1438766776 >> v2:172.21.15.174:3300/0 conn(0x7fa99010ea60 0x7fa99010eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:09.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa995e04700 1 -- 172.21.15.80:0/1438766776 >> v1:172.21.15.174:6789/0 conn(0x7fa990142ff0 legacy=0x7fa99015a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:09.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa995e04700 1 -- 172.21.15.80:0/1438766776 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa990110cb0 con 0x7fa990127360 2019-11-28T11:40:09.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa995e04700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa990127360 0x7fa9901277f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa97c0125b0 tx=0x7fa97c00d4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:09.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa995e04700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa990127360 0x7fa9901277f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa97c0125b0 tx=0x7fa97c00d4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:09.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa995e04700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa990127360 0x7fa9901277f0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7fa97c0125b0 tx=0x7fa97c00d4f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:09.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa995e04700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa990127360 0x7fa9901277f0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa97c0125b0 tx=0x7fa97c00d4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:09.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa98effd700 1 -- 172.21.15.80:0/1438766776 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa97c007210 con 0x7fa990127360 2019-11-28T11:40:09.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa995e04700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa990127360 0x7fa9901277f0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa97c0125b0 tx=0x7fa97c00d4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:09.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa995e04700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa990127360 0x7fa9901277f0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa97c0125b0 tx=0x7fa97c00d4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:09.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa98effd700 1 -- 172.21.15.80:0/1438766776 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c00bb90 con 0x7fa990127360 2019-11-28T11:40:09.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa998068700 1 -- 172.21.15.80:0/1438766776 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa990111030 con 0x7fa990127360 2019-11-28T11:40:09.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa98effd700 1 -- 172.21.15.80:0/1438766776 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa97c00c2a0 con 0x7fa990127360 2019-11-28T11:40:09.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.660+0000 7fa998068700 1 -- 172.21.15.80:0/1438766776 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa990110cb0 con 0x7fa990127360 2019-11-28T11:40:09.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.661+0000 7fa995e04700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa990127360 0x7fa9901277f0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa97c0125b0 tx=0x7fa97c00d4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:09.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.661+0000 7fa98effd700 1 -- 172.21.15.80:0/1438766776 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa97c00bd80 con 0x7fa990127360 2019-11-28T11:40:09.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.661+0000 7fa995e04700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa990127360 0x7fa9901277f0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa97c0125b0 tx=0x7fa97c00d4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:09.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.661+0000 7fa98effd700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa978018730 0x7fa97801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:09.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.661+0000 7fa98effd700 1 -- 172.21.15.80:0/1438766776 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fa97c033c90 con 0x7fa990127360 2019-11-28T11:40:09.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.661+0000 7fa996605700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa978018730 0x7fa97801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:09.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.662+0000 7fa996605700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa978018730 0x7fa97801abc0 crc :-1 s=READY pgs=522 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:09.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.668+0000 7fa998068700 1 -- 172.21.15.80:0/1438766776 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa990111030 con 0x7fa990127360 2019-11-28T11:40:09.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.672+0000 7fa995e04700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa990127360 0x7fa9901277f0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa97c0125b0 tx=0x7fa97c00d4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:09.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.672+0000 7fa98effd700 1 -- 172.21.15.80:0/1438766776 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa97c00b790 con 0x7fa990127360 2019-11-28T11:40:09.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.841+0000 7fa998068700 1 -- 172.21.15.80:0/1438766776 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa990110cb0 con 0x7fa990127360 2019-11-28T11:40:09.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.842+0000 7fa995e04700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa990127360 0x7fa9901277f0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa97c0125b0 tx=0x7fa97c00d4f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:09.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.842+0000 7fa98effd700 1 -- 172.21.15.80:0/1438766776 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fa97c00bd60 con 0x7fa990127360 2019-11-28T11:40:09.873 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:09.874 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:09.874 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:09.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.844+0000 7fa998068700 1 -- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa978018730 msgr2=0x7fa97801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:09.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.844+0000 7fa998068700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa978018730 0x7fa97801abc0 crc :-1 s=READY pgs=522 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:09.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.844+0000 7fa998068700 1 -- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa990127360 msgr2=0x7fa9901277f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:09.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.844+0000 7fa998068700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa990127360 0x7fa9901277f0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7fa97c0125b0 tx=0x7fa97c00d4f0).stop 2019-11-28T11:40:09.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.844+0000 7fa998068700 1 -- 172.21.15.80:0/1438766776 shutdown_connections 2019-11-28T11:40:09.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.844+0000 7fa998068700 1 --2- 172.21.15.80:0/1438766776 >> v2:172.21.15.174:3300/0 conn(0x7fa99010ea60 0x7fa99010eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:09.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.844+0000 7fa998068700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa990127360 0x7fa9901277f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:09.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.844+0000 7fa998068700 1 --2- 172.21.15.80:0/1438766776 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa978018730 0x7fa97801abc0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:09.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.844+0000 7fa998068700 1 -- 172.21.15.80:0/1438766776 shutdown_connections 2019-11-28T11:40:09.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.844+0000 7fa998068700 1 -- 172.21.15.80:0/1438766776 wait complete. 2019-11-28T11:40:09.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:09.844+0000 7fa998068700 1 -- 172.21.15.80:0/1438766776 >> 172.21.15.80:0/1438766776 conn(0x7fa99007c680 msgr2=0x7fa990112150 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:09.888 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:10.888 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:11.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.985+0000 7f7ef49cc700 1 Processor -- start 2019-11-28T11:40:11.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.985+0000 7f7ef49cc700 1 -- start start 2019-11-28T11:40:11.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7ef49cc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7ef006c490 0x7f7ef006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:11.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7ef49cc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006db00 con 0x7f7ef006ce60 2019-11-28T11:40:11.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7ef49cc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006e000 con 0x7f7ef006c0a0 2019-11-28T11:40:11.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7ef49cc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006fd60 con 0x7f7ef006c490 2019-11-28T11:40:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eef59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7ef006ce60 0x7f7ef0164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36960/0 (socket says 172.21.15.80:36960) 2019-11-28T11:40:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eef59e700 1 -- 172.21.15.80:0/2202897520 learned_addr learned my addr 172.21.15.80:0/2202897520 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eee59c700 1 --2- 172.21.15.80:0/2202897520 >> v2:172.21.15.174:3300/0 conn(0x7f7ef006c490 0x7f7ef006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:11.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eedd9b700 1 -- 172.21.15.80:0/2202897520 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011570117 0 0) 0x7f7ee80014d0 con 0x7f7ef006ce60 2019-11-28T11:40:11.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eedd9b700 1 -- 172.21.15.80:0/2202897520 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7edc002e80 con 0x7f7ef006ce60 2019-11-28T11:40:11.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eedd9b700 1 -- 172.21.15.80:0/2202897520 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497645657 0 0) 0x7f7ee0001080 con 0x7f7ef006c0a0 2019-11-28T11:40:11.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eedd9b700 1 -- 172.21.15.80:0/2202897520 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7edc0030b0 con 0x7f7ef006c0a0 2019-11-28T11:40:11.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eedd9b700 1 -- 172.21.15.80:0/2202897520 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3937700509 0 0) 0x7f7ee80014b0 con 0x7f7ef006ce60 2019-11-28T11:40:11.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eedd9b700 1 -- 172.21.15.80:0/2202897520 >> v2:172.21.15.174:3300/0 conn(0x7f7ef006c490 msgr2=0x7f7ef006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:11.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eedd9b700 1 --2- 172.21.15.80:0/2202897520 >> v2:172.21.15.174:3300/0 conn(0x7f7ef006c490 0x7f7ef006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:11.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eedd9b700 1 -- 172.21.15.80:0/2202897520 >> v1:172.21.15.174:6789/0 conn(0x7f7ef006c0a0 legacy=0x7f7ef0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:11.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eedd9b700 1 -- 172.21.15.80:0/2202897520 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef00706c0 con 0x7f7ef006ce60 2019-11-28T11:40:11.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eedd9b700 1 -- 172.21.15.80:0/2202897520 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f7ee80019e0 con 0x7f7ef006ce60 2019-11-28T11:40:11.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eedd9b700 1 -- 172.21.15.80:0/2202897520 >> v1:172.21.15.80:6789/0 conn(0x7f7ef006ce60 legacy=0x7f7ef0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:11.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eedd9b700 1 --2- 172.21.15.80:0/2202897520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7edc003b30 0x7f7edc005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:11.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eedd9b700 1 --2- 172.21.15.80:0/2202897520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7edc0066c0 0x7f7edc008b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:11.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.987+0000 7f7eedd9b700 1 --2- 172.21.15.80:0/2202897520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7edc04d3a0 0x7f7edc04f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:11.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eedd9b700 1 -- 172.21.15.80:0/2202897520 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc04fff0 con 0x7f7edc04d3a0 2019-11-28T11:40:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eedd9b700 1 -- 172.21.15.80:0/2202897520 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc050220 con 0x7f7edc0066c0 2019-11-28T11:40:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eedd9b700 1 -- 172.21.15.80:0/2202897520 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc050450 con 0x7f7edc003b30 2019-11-28T11:40:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eef59e700 1 --2- 172.21.15.80:0/2202897520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7edc04d3a0 0x7f7edc04f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eee59c700 1 --2- 172.21.15.80:0/2202897520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7edc0066c0 0x7f7edc008b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eeed9d700 1 --2- 172.21.15.80:0/2202897520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7edc003b30 0x7f7edc005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eef59e700 1 -- 172.21.15.80:0/2202897520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7edc003b30 msgr2=0x7f7edc005f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:11.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eef59e700 1 --2- 172.21.15.80:0/2202897520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7edc003b30 0x7f7edc005f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:11.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eef59e700 1 -- 172.21.15.80:0/2202897520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7edc0066c0 msgr2=0x7f7edc008b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:11.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eef59e700 1 --2- 172.21.15.80:0/2202897520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7edc0066c0 0x7f7edc008b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:11.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eef59e700 1 -- 172.21.15.80:0/2202897520 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc050700 con 0x7f7edc04d3a0 2019-11-28T11:40:11.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eef59e700 1 --2- 172.21.15.80:0/2202897520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7edc04d3a0 0x7f7edc04f870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ee800fc90 tx=0x7f7ee800fb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:11.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eef59e700 1 -- 172.21.15.80:0/2202897520 reap_dead start 2019-11-28T11:40:11.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eef59e700 1 --2- 172.21.15.80:0/2202897520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7edc04d3a0 0x7f7edc04f870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ee800fc90 tx=0x7f7ee800fb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:11.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eef59e700 1 --2- 172.21.15.80:0/2202897520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7edc04d3a0 0x7f7edc04f870 secure :-1 s=READY pgs=1262 cs=0 l=1 rx=0x7f7ee800fc90 tx=0x7f7ee800fb90).ready entity=mon.0 client_cookie=295070909adb28f2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:11.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eef59e700 1 --2- 172.21.15.80:0/2202897520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7edc04d3a0 0x7f7edc04f870 secure :-1 s=THROTTLE_DONE pgs=1262 cs=0 l=1 rx=0x7f7ee800fc90 tx=0x7f7ee800fb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:11.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eef59e700 1 --2- 172.21.15.80:0/2202897520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7edc04d3a0 0x7f7edc04f870 secure :-1 s=THROTTLE_DONE pgs=1262 cs=0 l=1 rx=0x7f7ee800fc90 tx=0x7f7ee800fb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eedd9b700 1 -- 172.21.15.80:0/2202897520 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee8000d00 con 0x7f7edc04d3a0 2019-11-28T11:40:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eef59e700 1 --2- 172.21.15.80:0/2202897520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7edc04d3a0 0x7f7edc04f870 secure :-1 s=THROTTLE_DONE pgs=1262 cs=0 l=1 rx=0x7f7ee800fc90 tx=0x7f7ee800fb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eedd9b700 1 -- 172.21.15.80:0/2202897520 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee80045c0 con 0x7f7edc04d3a0 2019-11-28T11:40:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7eedd9b700 1 -- 172.21.15.80:0/2202897520 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee8004c90 con 0x7f7edc04d3a0 2019-11-28T11:40:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7ef49cc700 1 -- 172.21.15.80:0/2202897520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7edc04d3a0 msgr2=0x7f7edc04f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.988+0000 7f7ef49cc700 1 --2- 172.21.15.80:0/2202897520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7edc04d3a0 0x7f7edc04f870 secure :-1 s=READY pgs=1262 cs=0 l=1 rx=0x7f7ee800fc90 tx=0x7f7ee800fb90).stop 2019-11-28T11:40:11.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.989+0000 7f7ef49cc700 1 -- 172.21.15.80:0/2202897520 shutdown_connections 2019-11-28T11:40:11.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.989+0000 7f7ef49cc700 1 --2- 172.21.15.80:0/2202897520 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7edc04d3a0 0x7f7edc04f870 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:11.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.989+0000 7f7ef49cc700 1 -- 172.21.15.80:0/2202897520 shutdown_connections 2019-11-28T11:40:11.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.989+0000 7f7ef49cc700 1 -- 172.21.15.80:0/2202897520 wait complete. 2019-11-28T11:40:11.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.989+0000 7f7ef49cc700 1 -- 172.21.15.80:0/2202897520 >> 172.21.15.80:0/2202897520 conn(0x7f7ef0061cf0 msgr2=0x7f7ef0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:11.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.991+0000 7f7ef49cc700 1 Processor -- start 2019-11-28T11:40:11.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.991+0000 7f7ef49cc700 1 -- start start 2019-11-28T11:40:11.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.992+0000 7f7ef49cc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ef00750f0 0x7f7ef0151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:11.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.992+0000 7f7ef49cc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef0079230 con 0x7f7ef0074d00 2019-11-28T11:40:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.992+0000 7f7ef49cc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef0079890 con 0x7f7ef0151f90 2019-11-28T11:40:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.992+0000 7f7ef49cc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef007ab30 con 0x7f7ef00750f0 2019-11-28T11:40:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.992+0000 7f7eee59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ef00750f0 0x7f7ef0151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.992+0000 7f7eeed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7ef0074d00 0x7f7ef0152bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36970/0 (socket says 172.21.15.80:36970) 2019-11-28T11:40:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.992+0000 7f7eeed9d700 1 -- 172.21.15.80:0/108622108 learned_addr learned my addr 172.21.15.80:0/108622108 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.993+0000 7f7eee59c700 1 -- 172.21.15.80:0/108622108 >> v1:172.21.15.174:6789/0 conn(0x7f7ef0151f90 legacy=0x7f7ef0168d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:11.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.993+0000 7f7eee59c700 1 -- 172.21.15.80:0/108622108 >> v1:172.21.15.80:6789/0 conn(0x7f7ef0074d00 legacy=0x7f7ef0152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:11.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.993+0000 7f7eee59c700 1 -- 172.21.15.80:0/108622108 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef007b490 con 0x7f7ef00750f0 2019-11-28T11:40:11.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.993+0000 7f7ee77fe700 1 -- 172.21.15.80:0/108622108 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149595611 0 0) 0x7f7ee00079b0 con 0x7f7ef0074d00 2019-11-28T11:40:11.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.993+0000 7f7eee59c700 1 --2- 172.21.15.80:0/108622108 >> v2:172.21.15.80:3300/0 conn(0x7f7ef00750f0 0x7f7ef0151a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ed8010360 tx=0x7f7ed8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:11.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.993+0000 7f7eee59c700 1 --2- 172.21.15.80:0/108622108 >> v2:172.21.15.80:3300/0 conn(0x7f7ef00750f0 0x7f7ef0151a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ed8010360 tx=0x7f7ed8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:11.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.993+0000 7f7eee59c700 1 --2- 172.21.15.80:0/108622108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef00750f0 0x7f7ef0151a50 secure :-1 s=READY pgs=1264 cs=0 l=1 rx=0x7f7ed8010360 tx=0x7f7ed8010700).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:11.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.993+0000 7f7eee59c700 1 --2- 172.21.15.80:0/108622108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef00750f0 0x7f7ef0151a50 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f7ed8010360 tx=0x7f7ed8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:11.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.993+0000 7f7ee77fe700 1 -- 172.21.15.80:0/108622108 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed8000940 con 0x7f7ef00750f0 2019-11-28T11:40:11.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.993+0000 7f7eee59c700 1 --2- 172.21.15.80:0/108622108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef00750f0 0x7f7ef0151a50 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f7ed8010360 tx=0x7f7ed8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:11.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.993+0000 7f7eee59c700 1 --2- 172.21.15.80:0/108622108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef00750f0 0x7f7ef0151a50 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f7ed8010360 tx=0x7f7ed8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:11.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.993+0000 7f7ee77fe700 1 -- 172.21.15.80:0/108622108 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed8005580 con 0x7f7ef00750f0 2019-11-28T11:40:11.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.993+0000 7f7ef49cc700 1 -- 172.21.15.80:0/108622108 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef007b810 con 0x7f7ef00750f0 2019-11-28T11:40:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.993+0000 7f7ee77fe700 1 -- 172.21.15.80:0/108622108 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed8005c10 con 0x7f7ef00750f0 2019-11-28T11:40:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.993+0000 7f7ef49cc700 1 -- 172.21.15.80:0/108622108 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef007b490 con 0x7f7ef00750f0 2019-11-28T11:40:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.993+0000 7f7eee59c700 1 --2- 172.21.15.80:0/108622108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef00750f0 0x7f7ef0151a50 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f7ed8010360 tx=0x7f7ed8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.994+0000 7f7ee77fe700 1 -- 172.21.15.80:0/108622108 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7ed8005180 con 0x7f7ef00750f0 2019-11-28T11:40:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.994+0000 7f7eee59c700 1 --2- 172.21.15.80:0/108622108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef00750f0 0x7f7ef0151a50 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f7ed8010360 tx=0x7f7ed8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.994+0000 7f7ee77fe700 1 --2- 172.21.15.80:0/108622108 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ed4018730 0x7f7ed401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:11.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.994+0000 7f7ee77fe700 1 -- 172.21.15.80:0/108622108 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f7ed8031a80 con 0x7f7ef00750f0 2019-11-28T11:40:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.994+0000 7f7eeed9d700 1 --2- 172.21.15.80:0/108622108 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ed4018730 0x7f7ed401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:10.994+0000 7f7eeed9d700 1 --2- 172.21.15.80:0/108622108 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ed4018730 0x7f7ed401abc0 crc :-1 s=READY pgs=523 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:11.001+0000 7f7ef49cc700 1 -- 172.21.15.80:0/108622108 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef007b810 con 0x7f7ef00750f0 2019-11-28T11:40:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:11.004+0000 7f7eee59c700 1 --2- 172.21.15.80:0/108622108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef00750f0 0x7f7ef0151a50 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f7ed8010360 tx=0x7f7ed8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:11.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:11.004+0000 7f7ee77fe700 1 -- 172.21.15.80:0/108622108 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7ed802df10 con 0x7f7ef00750f0 2019-11-28T11:40:11.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:11.175+0000 7f7ef49cc700 1 -- 172.21.15.80:0/108622108 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ef007b490 con 0x7f7ef00750f0 2019-11-28T11:40:11.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:11.176+0000 7f7eee59c700 1 --2- 172.21.15.80:0/108622108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef00750f0 0x7f7ef0151a50 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f7ed8010360 tx=0x7f7ed8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:11.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:11.176+0000 7f7ee77fe700 1 -- 172.21.15.80:0/108622108 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f7ed802df10 con 0x7f7ef00750f0 2019-11-28T11:40:11.207 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:11.208 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:11.209 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:11.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:11.178+0000 7f7ef49cc700 1 -- 172.21.15.80:0/108622108 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ed4018730 msgr2=0x7f7ed401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:11.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:11.178+0000 7f7ef49cc700 1 --2- 172.21.15.80:0/108622108 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ed4018730 0x7f7ed401abc0 crc :-1 s=READY pgs=523 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:11.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:11.178+0000 7f7ef49cc700 1 -- 172.21.15.80:0/108622108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef00750f0 msgr2=0x7f7ef0151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:11.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:11.178+0000 7f7ef49cc700 1 --2- 172.21.15.80:0/108622108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef00750f0 0x7f7ef0151a50 secure :-1 s=READY pgs=1264 cs=0 l=1 rx=0x7f7ed8010360 tx=0x7f7ed8010700).stop 2019-11-28T11:40:11.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:11.178+0000 7f7ef49cc700 1 -- 172.21.15.80:0/108622108 shutdown_connections 2019-11-28T11:40:11.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:11.178+0000 7f7ef49cc700 1 --2- 172.21.15.80:0/108622108 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ed4018730 0x7f7ed401abc0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:11.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:11.178+0000 7f7ef49cc700 1 --2- 172.21.15.80:0/108622108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef00750f0 0x7f7ef0151a50 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:11.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:11.179+0000 7f7ef49cc700 1 -- 172.21.15.80:0/108622108 shutdown_connections 2019-11-28T11:40:11.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:11.179+0000 7f7ef49cc700 1 -- 172.21.15.80:0/108622108 wait complete. 2019-11-28T11:40:11.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:11.179+0000 7f7ef49cc700 1 -- 172.21.15.80:0/108622108 >> 172.21.15.80:0/108622108 conn(0x7f7ef013fa50 msgr2=0x7f7ef007c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:11.220 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:12.222 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:12.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.313+0000 7f7884d63700 1 Processor -- start 2019-11-28T11:40:12.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.313+0000 7f7884d63700 1 -- start start 2019-11-28T11:40:12.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.314+0000 7f7884d63700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f788006c0a0 0x7f7880072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:12.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.314+0000 7f7884d63700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78800734e0 0x7f7880071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:12.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.314+0000 7f7884d63700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788006db00 con 0x7f7880072360 2019-11-28T11:40:12.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.314+0000 7f7884d63700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788006fd60 con 0x7f78800734e0 2019-11-28T11:40:12.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.314+0000 7f7884d63700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7880070030 con 0x7f788006c0a0 2019-11-28T11:40:12.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.314+0000 7f787e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78800734e0 0x7f7880071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:12.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.314+0000 7f787e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78800734e0 0x7f7880071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37666/0 (socket says 172.21.15.80:37666) 2019-11-28T11:40:12.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.314+0000 7f787e59c700 1 -- 172.21.15.80:0/2093752444 learned_addr learned my addr 172.21.15.80:0/2093752444 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:12.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.315+0000 7f787ed9d700 1 --2- 172.21.15.80:0/2093752444 >> v2:172.21.15.174:3300/0 conn(0x7f788006c0a0 0x7f7880072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:12.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.315+0000 7f787e59c700 1 -- 172.21.15.80:0/2093752444 >> v2:172.21.15.174:3300/0 conn(0x7f788006c0a0 msgr2=0x7f7880072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:12.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.315+0000 7f787e59c700 1 --2- 172.21.15.80:0/2093752444 >> v2:172.21.15.174:3300/0 conn(0x7f788006c0a0 0x7f7880072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:12.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.315+0000 7f787e59c700 1 -- 172.21.15.80:0/2093752444 >> v1:172.21.15.174:6789/0 conn(0x7f7880072360 legacy=0x7f788006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:12.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.315+0000 7f787e59c700 1 -- 172.21.15.80:0/2093752444 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78800706c0 con 0x7f78800734e0 2019-11-28T11:40:12.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.315+0000 7f787e59c700 1 --2- 172.21.15.80:0/2093752444 >> v2:172.21.15.80:3300/0 conn(0x7f78800734e0 0x7f7880071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f786800fac0 tx=0x7f786800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:12.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.315+0000 7f787e59c700 1 --2- 172.21.15.80:0/2093752444 >> v2:172.21.15.80:3300/0 conn(0x7f78800734e0 0x7f7880071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f786800fac0 tx=0x7f786800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:12.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.315+0000 7f787e59c700 1 --2- 172.21.15.80:0/2093752444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78800734e0 0x7f7880071e20 secure :-1 s=READY pgs=1265 cs=0 l=1 rx=0x7f786800fac0 tx=0x7f786800f8f0).ready entity=mon.0 client_cookie=61049f3668d0535e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:12.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.315+0000 7f787e59c700 1 --2- 172.21.15.80:0/2093752444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78800734e0 0x7f7880071e20 secure :-1 s=THROTTLE_DONE pgs=1265 cs=0 l=1 rx=0x7f786800fac0 tx=0x7f786800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:12.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.315+0000 7f787e59c700 1 --2- 172.21.15.80:0/2093752444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78800734e0 0x7f7880071e20 secure :-1 s=THROTTLE_DONE pgs=1265 cs=0 l=1 rx=0x7f786800fac0 tx=0x7f786800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:12.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.315+0000 7f787e59c700 1 --2- 172.21.15.80:0/2093752444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78800734e0 0x7f7880071e20 secure :-1 s=THROTTLE_DONE pgs=1265 cs=0 l=1 rx=0x7f786800fac0 tx=0x7f786800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:12.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.315+0000 7f787dd9b700 1 -- 172.21.15.80:0/2093752444 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7868000ce0 con 0x7f78800734e0 2019-11-28T11:40:12.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.315+0000 7f787dd9b700 1 -- 172.21.15.80:0/2093752444 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7868001010 con 0x7f78800734e0 2019-11-28T11:40:12.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.315+0000 7f787dd9b700 1 -- 172.21.15.80:0/2093752444 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7868001720 con 0x7f78800734e0 2019-11-28T11:40:12.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.315+0000 7f7884d63700 1 -- 172.21.15.80:0/2093752444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78800734e0 msgr2=0x7f7880071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:12.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.315+0000 7f7884d63700 1 --2- 172.21.15.80:0/2093752444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78800734e0 0x7f7880071e20 secure :-1 s=READY pgs=1265 cs=0 l=1 rx=0x7f786800fac0 tx=0x7f786800f8f0).stop 2019-11-28T11:40:12.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.316+0000 7f7884d63700 1 -- 172.21.15.80:0/2093752444 shutdown_connections 2019-11-28T11:40:12.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.316+0000 7f7884d63700 1 --2- 172.21.15.80:0/2093752444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78800734e0 0x7f7880071e20 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:12.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.316+0000 7f7884d63700 1 --2- 172.21.15.80:0/2093752444 >> v2:172.21.15.174:3300/0 conn(0x7f788006c0a0 0x7f7880072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:12.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.316+0000 7f7884d63700 1 -- 172.21.15.80:0/2093752444 shutdown_connections 2019-11-28T11:40:12.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.316+0000 7f7884d63700 1 -- 172.21.15.80:0/2093752444 wait complete. 2019-11-28T11:40:12.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.316+0000 7f7884d63700 1 -- 172.21.15.80:0/2093752444 >> 172.21.15.80:0/2093752444 conn(0x7f7880061cf0 msgr2=0x7f7880064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:12.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.318+0000 7f7884d63700 1 Processor -- start 2019-11-28T11:40:12.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.318+0000 7f7884d63700 1 -- start start 2019-11-28T11:40:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.319+0000 7f7884d63700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7880167ee0 0x7f788016a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.319+0000 7f7884d63700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7880139e00 con 0x7f788012a6b0 2019-11-28T11:40:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.319+0000 7f7884d63700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788013a4d0 con 0x7f78801098d0 2019-11-28T11:40:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.319+0000 7f7884d63700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7880107b00 con 0x7f7880167ee0 2019-11-28T11:40:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.319+0000 7f787ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f788012a6b0 0x7f788012b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36984/0 (socket says 172.21.15.80:36984) 2019-11-28T11:40:12.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.319+0000 7f787ed9d700 1 -- 172.21.15.80:0/3771026416 learned_addr learned my addr 172.21.15.80:0/3771026416 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:12.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.319+0000 7f787f59e700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7880167ee0 0x7f788016a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:12.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.319+0000 7f78777fe700 1 -- 172.21.15.80:0/3771026416 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698819484 0 0) 0x7f7870000fb0 con 0x7f788012a6b0 2019-11-28T11:40:12.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.319+0000 7f78777fe700 1 -- 172.21.15.80:0/3771026416 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7858002e80 con 0x7f788012a6b0 2019-11-28T11:40:12.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f78777fe700 1 -- 172.21.15.80:0/3771026416 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657707363 0 0) 0x7f7868007c80 con 0x7f78801098d0 2019-11-28T11:40:12.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f78777fe700 1 -- 172.21.15.80:0/3771026416 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78580030b0 con 0x7f78801098d0 2019-11-28T11:40:12.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f78777fe700 1 -- 172.21.15.80:0/3771026416 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 324017214 0 0) 0x7f7870001140 con 0x7f788012a6b0 2019-11-28T11:40:12.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f78777fe700 1 -- 172.21.15.80:0/3771026416 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f78580033c0 con 0x7f788012a6b0 2019-11-28T11:40:12.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f78777fe700 1 -- 172.21.15.80:0/3771026416 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f7870001670 con 0x7f788012a6b0 2019-11-28T11:40:12.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f787f59e700 1 -- 172.21.15.80:0/3771026416 >> v1:172.21.15.174:6789/0 conn(0x7f78801098d0 legacy=0x7f7880109d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:12.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f787f59e700 1 -- 172.21.15.80:0/3771026416 >> v1:172.21.15.80:6789/0 conn(0x7f788012a6b0 legacy=0x7f788012b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:12.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f787f59e700 1 -- 172.21.15.80:0/3771026416 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7880108190 con 0x7f7880167ee0 2019-11-28T11:40:12.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f787f59e700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7880167ee0 0x7f788016a2e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78780103a0 tx=0x7f7878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:12.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f787f59e700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7880167ee0 0x7f788016a2e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78780103a0 tx=0x7f7878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:12.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f787f59e700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7880167ee0 0x7f788016a2e0 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f78780103a0 tx=0x7f7878010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:12.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f787f59e700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7880167ee0 0x7f788016a2e0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f78780103a0 tx=0x7f7878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:12.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f78777fe700 1 -- 172.21.15.80:0/3771026416 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7878009bc0 con 0x7f7880167ee0 2019-11-28T11:40:12.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f787f59e700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7880167ee0 0x7f788016a2e0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f78780103a0 tx=0x7f7878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:12.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f78777fe700 1 -- 172.21.15.80:0/3771026416 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7878007230 con 0x7f7880167ee0 2019-11-28T11:40:12.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f787f59e700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7880167ee0 0x7f788016a2e0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f78780103a0 tx=0x7f7878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:12.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f7884d63700 1 -- 172.21.15.80:0/3771026416 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7880108510 con 0x7f7880167ee0 2019-11-28T11:40:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f78777fe700 1 -- 172.21.15.80:0/3771026416 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7878009e20 con 0x7f7880167ee0 2019-11-28T11:40:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.320+0000 7f7884d63700 1 -- 172.21.15.80:0/3771026416 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7880108190 con 0x7f7880167ee0 2019-11-28T11:40:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.321+0000 7f787f59e700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7880167ee0 0x7f788016a2e0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f78780103a0 tx=0x7f7878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.321+0000 7f78777fe700 1 -- 172.21.15.80:0/3771026416 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f78780099f0 con 0x7f7880167ee0 2019-11-28T11:40:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.321+0000 7f787f59e700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7880167ee0 0x7f788016a2e0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f78780103a0 tx=0x7f7878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.321+0000 7f78777fe700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78580187a0 0x7f785801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.321+0000 7f78777fe700 1 -- 172.21.15.80:0/3771026416 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f7878031a90 con 0x7f7880167ee0 2019-11-28T11:40:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.321+0000 7f787ed9d700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78580187a0 0x7f785801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.321+0000 7f787ed9d700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78580187a0 0x7f785801abf0 crc :-1 s=READY pgs=524 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.329+0000 7f7884d63700 1 -- 172.21.15.80:0/3771026416 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7880108510 con 0x7f7880167ee0 2019-11-28T11:40:12.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.333+0000 7f787f59e700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7880167ee0 0x7f788016a2e0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f78780103a0 tx=0x7f7878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:12.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.333+0000 7f78777fe700 1 -- 172.21.15.80:0/3771026416 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7878026ee0 con 0x7f7880167ee0 2019-11-28T11:40:12.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.504+0000 7f7884d63700 1 -- 172.21.15.80:0/3771026416 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7880108190 con 0x7f7880167ee0 2019-11-28T11:40:12.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.505+0000 7f787f59e700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7880167ee0 0x7f788016a2e0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f78780103a0 tx=0x7f7878010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:12.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.505+0000 7f78777fe700 1 -- 172.21.15.80:0/3771026416 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f7878026ee0 con 0x7f7880167ee0 2019-11-28T11:40:12.536 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:12.536 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:12.537 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:12.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.507+0000 7f7884d63700 1 -- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78580187a0 msgr2=0x7f785801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:12.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.507+0000 7f7884d63700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78580187a0 0x7f785801abf0 crc :-1 s=READY pgs=524 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:12.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.507+0000 7f7884d63700 1 -- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7880167ee0 msgr2=0x7f788016a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:12.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.507+0000 7f7884d63700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7880167ee0 0x7f788016a2e0 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f78780103a0 tx=0x7f7878010740).stop 2019-11-28T11:40:12.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.507+0000 7f7884d63700 1 -- 172.21.15.80:0/3771026416 shutdown_connections 2019-11-28T11:40:12.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.507+0000 7f7884d63700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7880167ee0 0x7f788016a2e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:12.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.507+0000 7f7884d63700 1 --2- 172.21.15.80:0/3771026416 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78580187a0 0x7f785801abf0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:12.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.507+0000 7f7884d63700 1 -- 172.21.15.80:0/3771026416 shutdown_connections 2019-11-28T11:40:12.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.507+0000 7f7884d63700 1 -- 172.21.15.80:0/3771026416 wait complete. 2019-11-28T11:40:12.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:12.507+0000 7f7884d63700 1 -- 172.21.15.80:0/3771026416 >> 172.21.15.80:0/3771026416 conn(0x7f7880127dc0 msgr2=0x7f7880141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:12.547 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:13.548 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:13.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.641+0000 7ff8f7f23700 1 Processor -- start 2019-11-28T11:40:13.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.641+0000 7ff8f7f23700 1 -- start start 2019-11-28T11:40:13.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f7f23700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff8f006c0a0 0x7ff8f0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:13.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f7f23700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8f00734e0 0x7ff8f0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:13.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f7f23700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8f0072360 0x7ff8f0072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:13.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f7f23700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f006fd60 con 0x7ff8f0072360 2019-11-28T11:40:13.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f7f23700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f0070030 con 0x7ff8f006c0a0 2019-11-28T11:40:13.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f7f23700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f006f330 con 0x7ff8f00734e0 2019-11-28T11:40:13.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f6cc1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8f0072360 0x7ff8f0072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:13.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f6cc1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8f0072360 0x7ff8f0072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37678/0 (socket says 172.21.15.80:37678) 2019-11-28T11:40:13.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f6cc1700 1 -- 172.21.15.80:0/804734053 learned_addr learned my addr 172.21.15.80:0/804734053 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:13.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f5cbf700 1 --2- 172.21.15.80:0/804734053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8f00734e0 0x7ff8f0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:13.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f64c0700 1 --2- 172.21.15.80:0/804734053 >> v2:172.21.15.174:3300/0 conn(0x7ff8f006c0a0 0x7ff8f0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:13.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f6cc1700 1 -- 172.21.15.80:0/804734053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8f00734e0 msgr2=0x7ff8f0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:13.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f6cc1700 1 --2- 172.21.15.80:0/804734053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8f00734e0 0x7ff8f0071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:13.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f6cc1700 1 -- 172.21.15.80:0/804734053 >> v2:172.21.15.174:3300/0 conn(0x7ff8f006c0a0 msgr2=0x7ff8f0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:13.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f6cc1700 1 --2- 172.21.15.80:0/804734053 >> v2:172.21.15.174:3300/0 conn(0x7ff8f006c0a0 0x7ff8f0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:13.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f6cc1700 1 -- 172.21.15.80:0/804734053 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f00706c0 con 0x7ff8f0072360 2019-11-28T11:40:13.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f5cbf700 1 --2- 172.21.15.80:0/804734053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8f00734e0 0x7ff8f0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:40:13.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f64c0700 1 --2- 172.21.15.80:0/804734053 >> v2:172.21.15.174:3300/0 conn(0x7ff8f006c0a0 0x7ff8f0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:40:13.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f6cc1700 1 --2- 172.21.15.80:0/804734053 >> v2:172.21.15.80:3300/0 conn(0x7ff8f0072360 0x7ff8f0072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff8ec00f730 tx=0x7ff8ec00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:13.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f6cc1700 1 --2- 172.21.15.80:0/804734053 >> v2:172.21.15.80:3300/0 conn(0x7ff8f0072360 0x7ff8f0072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff8ec00f730 tx=0x7ff8ec00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:13.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f6cc1700 1 --2- 172.21.15.80:0/804734053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f0072360 0x7ff8f0072800 secure :-1 s=READY pgs=1267 cs=0 l=1 rx=0x7ff8ec00f730 tx=0x7ff8ec00fad0).ready entity=mon.0 client_cookie=c29a60253fd925a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:13.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.642+0000 7ff8f6cc1700 1 --2- 172.21.15.80:0/804734053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f0072360 0x7ff8f0072800 secure :-1 s=THROTTLE_DONE pgs=1267 cs=0 l=1 rx=0x7ff8ec00f730 tx=0x7ff8ec00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:13.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.643+0000 7ff8f54be700 1 -- 172.21.15.80:0/804734053 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8ec0010e0 con 0x7ff8f0072360 2019-11-28T11:40:13.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.643+0000 7ff8f6cc1700 1 --2- 172.21.15.80:0/804734053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f0072360 0x7ff8f0072800 secure :-1 s=THROTTLE_DONE pgs=1267 cs=0 l=1 rx=0x7ff8ec00f730 tx=0x7ff8ec00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:13.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.643+0000 7ff8f6cc1700 1 --2- 172.21.15.80:0/804734053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f0072360 0x7ff8f0072800 secure :-1 s=THROTTLE_DONE pgs=1267 cs=0 l=1 rx=0x7ff8ec00f730 tx=0x7ff8ec00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:13.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.643+0000 7ff8f54be700 1 -- 172.21.15.80:0/804734053 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec000b90 con 0x7ff8f0072360 2019-11-28T11:40:13.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.643+0000 7ff8f54be700 1 -- 172.21.15.80:0/804734053 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8ec0016c0 con 0x7ff8f0072360 2019-11-28T11:40:13.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.643+0000 7ff8f7f23700 1 -- 172.21.15.80:0/804734053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f0072360 msgr2=0x7ff8f0072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:13.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.643+0000 7ff8f7f23700 1 --2- 172.21.15.80:0/804734053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f0072360 0x7ff8f0072800 secure :-1 s=READY pgs=1267 cs=0 l=1 rx=0x7ff8ec00f730 tx=0x7ff8ec00fad0).stop 2019-11-28T11:40:13.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.643+0000 7ff8f7f23700 1 -- 172.21.15.80:0/804734053 shutdown_connections 2019-11-28T11:40:13.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.643+0000 7ff8f7f23700 1 --2- 172.21.15.80:0/804734053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f0072360 0x7ff8f0072800 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:13.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.643+0000 7ff8f7f23700 1 --2- 172.21.15.80:0/804734053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8f00734e0 0x7ff8f0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:13.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.643+0000 7ff8f7f23700 1 --2- 172.21.15.80:0/804734053 >> v2:172.21.15.174:3300/0 conn(0x7ff8f006c0a0 0x7ff8f0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:13.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.643+0000 7ff8f7f23700 1 -- 172.21.15.80:0/804734053 shutdown_connections 2019-11-28T11:40:13.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.643+0000 7ff8f7f23700 1 -- 172.21.15.80:0/804734053 wait complete. 2019-11-28T11:40:13.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.643+0000 7ff8f7f23700 1 -- 172.21.15.80:0/804734053 >> 172.21.15.80:0/804734053 conn(0x7ff8f0061cf0 msgr2=0x7ff8f0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:13.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.646+0000 7ff8f7f23700 1 Processor -- start 2019-11-28T11:40:13.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.646+0000 7ff8f7f23700 1 -- start start 2019-11-28T11:40:13.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8f7f23700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff8f0109e40 0x7ff8f010a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:13.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8f7f23700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f013f1e0 con 0x7ff8f010a810 2019-11-28T11:40:13.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8f7f23700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f0131a30 con 0x7ff8f013eb40 2019-11-28T11:40:13.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8f7f23700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f01234c0 con 0x7ff8f0109e40 2019-11-28T11:40:13.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8f6cc1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff8f010a810 0x7ff8f0105210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37002/0 (socket says 172.21.15.80:37002) 2019-11-28T11:40:13.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8f6cc1700 1 -- 172.21.15.80:0/138083454 learned_addr learned my addr 172.21.15.80:0/138083454 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:13.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8f5cbf700 1 --2- 172.21.15.80:0/138083454 >> v2:172.21.15.174:3300/0 conn(0x7ff8f0109e40 0x7ff8f010a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:13.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463748507 0 0) 0x7ff8ec000b90 con 0x7ff8f010a810 2019-11-28T11:40:13.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8d0002e80 con 0x7ff8f010a810 2019-11-28T11:40:13.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937443347 0 0) 0x7ff8e80012b0 con 0x7ff8f013eb40 2019-11-28T11:40:13.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8d00030b0 con 0x7ff8f013eb40 2019-11-28T11:40:13.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 929770418 0 0) 0x7ff8ec008180 con 0x7ff8f010a810 2019-11-28T11:40:13.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff8d00033c0 con 0x7ff8f010a810 2019-11-28T11:40:13.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff8ec007bf0 con 0x7ff8f010a810 2019-11-28T11:40:13.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 >> v2:172.21.15.174:3300/0 conn(0x7ff8f0109e40 msgr2=0x7ff8f010a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:13.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8e6ffd700 1 --2- 172.21.15.80:0/138083454 >> v2:172.21.15.174:3300/0 conn(0x7ff8f0109e40 0x7ff8f010a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:13.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 >> v1:172.21.15.174:6789/0 conn(0x7ff8f013eb40 legacy=0x7ff8f010afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:13.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 >> v1:172.21.15.80:6789/0 conn(0x7ff8f010a810 legacy=0x7ff8f0105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:13.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8e6ffd700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8d0005d40 0x7ff8d0006130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:13.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8e6ffd700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8d00046f0 0x7ff8d0004b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:13.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8e6ffd700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8d0005100 0x7ff8d00032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:13.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0003930 con 0x7ff8d00046f0 2019-11-28T11:40:13.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.647+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0003b60 con 0x7ff8d0005d40 2019-11-28T11:40:13.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0003d90 con 0x7ff8d0005100 2019-11-28T11:40:13.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f5cbf700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8d00046f0 0x7ff8d0004b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:13.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f64c0700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8d0005d40 0x7ff8d0006130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:13.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f6cc1700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8d0005100 0x7ff8d00032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:13.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f5cbf700 1 -- 172.21.15.80:0/138083454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8d0005100 msgr2=0x7ff8d00032e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:13.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f5cbf700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8d0005100 0x7ff8d00032e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:13.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f5cbf700 1 -- 172.21.15.80:0/138083454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8d0005d40 msgr2=0x7ff8d0006130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:13.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f5cbf700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8d0005d40 0x7ff8d0006130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:13.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f6cc1700 1 -- 172.21.15.80:0/138083454 reap_dead start 2019-11-28T11:40:13.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f5cbf700 1 -- 172.21.15.80:0/138083454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d0004040 con 0x7ff8d00046f0 2019-11-28T11:40:13.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f7f23700 1 -- 172.21.15.80:0/138083454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f0108a80 con 0x7ff8d00046f0 2019-11-28T11:40:13.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f5cbf700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8d00046f0 0x7ff8d0004b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8e000a860 tx=0x7ff8e000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:13.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f7f23700 1 -- 172.21.15.80:0/138083454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f0108700 con 0x7ff8d00046f0 2019-11-28T11:40:13.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f5cbf700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8d00046f0 0x7ff8d0004b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8e000a860 tx=0x7ff8e000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:13.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f5cbf700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8d00046f0 0x7ff8d0004b70 secure :-1 s=READY pgs=1269 cs=0 l=1 rx=0x7ff8e000a860 tx=0x7ff8e000ab00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:13.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f5cbf700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8d00046f0 0x7ff8d0004b70 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7ff8e000a860 tx=0x7ff8e000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:13.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f5cbf700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8d00046f0 0x7ff8d0004b70 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7ff8e000a860 tx=0x7ff8e000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:13.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f5cbf700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8d00046f0 0x7ff8d0004b70 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7ff8e000a860 tx=0x7ff8e000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:13.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e0000960 con 0x7ff8d00046f0 2019-11-28T11:40:13.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e0001090 con 0x7ff8d00046f0 2019-11-28T11:40:13.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e0001720 con 0x7ff8d00046f0 2019-11-28T11:40:13.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.648+0000 7ff8f5cbf700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8d00046f0 0x7ff8d0004b70 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7ff8e000a860 tx=0x7ff8e000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:13.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.649+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff8e0001280 con 0x7ff8d00046f0 2019-11-28T11:40:13.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.649+0000 7ff8f5cbf700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8d00046f0 0x7ff8d0004b70 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7ff8e000a860 tx=0x7ff8e000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:13.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.649+0000 7ff8e6ffd700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8d001b480 0x7ff8d001d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:13.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.649+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7ff8e0031ae0 con 0x7ff8d00046f0 2019-11-28T11:40:13.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.649+0000 7ff8f64c0700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8d001b480 0x7ff8d001d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:13.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.649+0000 7ff8f64c0700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8d001b480 0x7ff8d001d8f0 crc :-1 s=READY pgs=525 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:13.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.656+0000 7ff8f7f23700 1 -- 172.21.15.80:0/138083454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc002e60 con 0x7ff8d00046f0 2019-11-28T11:40:13.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.660+0000 7ff8f5cbf700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8d00046f0 0x7ff8d0004b70 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7ff8e000a860 tx=0x7ff8e000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:13.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.660+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff8e0000c90 con 0x7ff8d00046f0 2019-11-28T11:40:13.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.832+0000 7ff8f7f23700 1 -- 172.21.15.80:0/138083454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8cc001d10 con 0x7ff8d00046f0 2019-11-28T11:40:13.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.832+0000 7ff8f5cbf700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8d00046f0 0x7ff8d0004b70 secure :-1 s=THROTTLE_DONE pgs=1269 cs=0 l=1 rx=0x7ff8e000a860 tx=0x7ff8e000ab00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:13.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.832+0000 7ff8e6ffd700 1 -- 172.21.15.80:0/138083454 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7ff8e0000c90 con 0x7ff8d00046f0 2019-11-28T11:40:13.863 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:13.863 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:13.864 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:13.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.835+0000 7ff8f7f23700 1 -- 172.21.15.80:0/138083454 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8d001b480 msgr2=0x7ff8d001d8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:13.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.835+0000 7ff8f7f23700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8d001b480 0x7ff8d001d8f0 crc :-1 s=READY pgs=525 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:13.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.835+0000 7ff8f7f23700 1 -- 172.21.15.80:0/138083454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8d00046f0 msgr2=0x7ff8d0004b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:13.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.835+0000 7ff8f7f23700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8d00046f0 0x7ff8d0004b70 secure :-1 s=READY pgs=1269 cs=0 l=1 rx=0x7ff8e000a860 tx=0x7ff8e000ab00).stop 2019-11-28T11:40:13.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.835+0000 7ff8f7f23700 1 -- 172.21.15.80:0/138083454 shutdown_connections 2019-11-28T11:40:13.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.835+0000 7ff8f7f23700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8d001b480 0x7ff8d001d8f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:13.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.835+0000 7ff8f7f23700 1 --2- 172.21.15.80:0/138083454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8d00046f0 0x7ff8d0004b70 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:13.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.835+0000 7ff8f7f23700 1 -- 172.21.15.80:0/138083454 shutdown_connections 2019-11-28T11:40:13.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.835+0000 7ff8f7f23700 1 -- 172.21.15.80:0/138083454 wait complete. 2019-11-28T11:40:13.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:13.835+0000 7ff8f7f23700 1 -- 172.21.15.80:0/138083454 >> 172.21.15.80:0/138083454 conn(0x7ff8f011bfc0 msgr2=0x7ff8f0141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:13.875 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:14.875 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:15.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.972+0000 7f2e95c96700 1 Processor -- start 2019-11-28T11:40:15.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.972+0000 7f2e95c96700 1 -- start start 2019-11-28T11:40:15.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.973+0000 7f2e95c96700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2e9006d120 0x7f2e90165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.973+0000 7f2e95c96700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9006d5a0 con 0x7f2e9006c0a0 2019-11-28T11:40:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.973+0000 7f2e95c96700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9006db00 con 0x7f2e9006c490 2019-11-28T11:40:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.973+0000 7f2e95c96700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9006fd60 con 0x7f2e9006d120 2019-11-28T11:40:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.973+0000 7f2e8ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2e9006c0a0 0x7f2e90072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37012/0 (socket says 172.21.15.80:37012) 2019-11-28T11:40:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.973+0000 7f2e8ffff700 1 -- 172.21.15.80:0/2048010243 learned_addr learned my addr 172.21.15.80:0/2048010243 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.973+0000 7f2e94a34700 1 --2- 172.21.15.80:0/2048010243 >> v2:172.21.15.174:3300/0 conn(0x7f2e9006d120 0x7f2e90165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e8f7fe700 1 -- 172.21.15.80:0/2048010243 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219263075 0 0) 0x7f2e80001150 con 0x7f2e9006c0a0 2019-11-28T11:40:15.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e8f7fe700 1 -- 172.21.15.80:0/2048010243 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e7c002e80 con 0x7f2e9006c0a0 2019-11-28T11:40:15.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e8f7fe700 1 -- 172.21.15.80:0/2048010243 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512746793 0 0) 0x7f2e78001080 con 0x7f2e9006c490 2019-11-28T11:40:15.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e8f7fe700 1 -- 172.21.15.80:0/2048010243 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e7c0030b0 con 0x7f2e9006c490 2019-11-28T11:40:15.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e94a34700 1 -- 172.21.15.80:0/2048010243 >> v1:172.21.15.174:6789/0 conn(0x7f2e9006c490 legacy=0x7f2e9006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:15.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e94a34700 1 -- 172.21.15.80:0/2048010243 >> v1:172.21.15.80:6789/0 conn(0x7f2e9006c0a0 legacy=0x7f2e90072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:15.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e8f7fe700 1 -- 172.21.15.80:0/2048010243 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2547053322 0 0) 0x7f2e80001130 con 0x7f2e9006c0a0 2019-11-28T11:40:15.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e94a34700 1 -- 172.21.15.80:0/2048010243 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e900706c0 con 0x7f2e9006d120 2019-11-28T11:40:15.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e94a34700 1 --2- 172.21.15.80:0/2048010243 >> v2:172.21.15.174:3300/0 conn(0x7f2e9006d120 0x7f2e90165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2e8800b300 tx=0x7f2e8800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:15.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e94a34700 1 --2- 172.21.15.80:0/2048010243 >> v2:172.21.15.174:3300/0 conn(0x7f2e9006d120 0x7f2e90165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2e8800b300 tx=0x7f2e8800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:15.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e94a34700 1 --2- 172.21.15.80:0/2048010243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e9006d120 0x7f2e90165d80 secure :-1 s=READY pgs=754 cs=0 l=1 rx=0x7f2e8800b300 tx=0x7f2e8800bb10).ready entity=mon.1 client_cookie=2ae8f76a9df3b399 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:15.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e94a34700 1 --2- 172.21.15.80:0/2048010243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e9006d120 0x7f2e90165d80 secure :-1 s=THROTTLE_DONE pgs=754 cs=0 l=1 rx=0x7f2e8800b300 tx=0x7f2e8800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:15.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e8f7fe700 1 -- 172.21.15.80:0/2048010243 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e880075c0 con 0x7f2e9006d120 2019-11-28T11:40:15.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e94a34700 1 --2- 172.21.15.80:0/2048010243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e9006d120 0x7f2e90165d80 secure :-1 s=THROTTLE_DONE pgs=754 cs=0 l=1 rx=0x7f2e8800b300 tx=0x7f2e8800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:15.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e94a34700 1 --2- 172.21.15.80:0/2048010243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e9006d120 0x7f2e90165d80 secure :-1 s=THROTTLE_DONE pgs=754 cs=0 l=1 rx=0x7f2e8800b300 tx=0x7f2e8800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:15.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e8f7fe700 1 -- 172.21.15.80:0/2048010243 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e88000f30 con 0x7f2e9006d120 2019-11-28T11:40:15.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e8f7fe700 1 -- 172.21.15.80:0/2048010243 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e8800a1e0 con 0x7f2e9006d120 2019-11-28T11:40:15.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e95c96700 1 -- 172.21.15.80:0/2048010243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e9006d120 msgr2=0x7f2e90165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:15.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.974+0000 7f2e95c96700 1 --2- 172.21.15.80:0/2048010243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e9006d120 0x7f2e90165d80 secure :-1 s=READY pgs=754 cs=0 l=1 rx=0x7f2e8800b300 tx=0x7f2e8800bb10).stop 2019-11-28T11:40:15.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.975+0000 7f2e95c96700 1 -- 172.21.15.80:0/2048010243 shutdown_connections 2019-11-28T11:40:15.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.975+0000 7f2e95c96700 1 --2- 172.21.15.80:0/2048010243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e9006d120 0x7f2e90165d80 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.975+0000 7f2e95c96700 1 -- 172.21.15.80:0/2048010243 shutdown_connections 2019-11-28T11:40:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.975+0000 7f2e95c96700 1 -- 172.21.15.80:0/2048010243 wait complete. 2019-11-28T11:40:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.975+0000 7f2e95c96700 1 -- 172.21.15.80:0/2048010243 >> 172.21.15.80:0/2048010243 conn(0x7f2e90061cf0 msgr2=0x7f2e90064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.977+0000 7f2e95c96700 1 Processor -- start 2019-11-28T11:40:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.977+0000 7f2e95c96700 1 -- start start 2019-11-28T11:40:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.978+0000 7f2e95c96700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e90169c50 0x7f2e9016c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.978+0000 7f2e95c96700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e90116b90 con 0x7f2e901167a0 2019-11-28T11:40:15.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.978+0000 7f2e95c96700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e90154b40 con 0x7f2e90164a10 2019-11-28T11:40:15.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.978+0000 7f2e95c96700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e901563f0 con 0x7f2e90169c50 2019-11-28T11:40:15.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.978+0000 7f2e8ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2e901167a0 0x7f2e90121750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37018/0 (socket says 172.21.15.80:37018) 2019-11-28T11:40:15.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.978+0000 7f2e94a34700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e90169c50 0x7f2e9016c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:15.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.978+0000 7f2e8ffff700 1 -- 172.21.15.80:0/545304795 learned_addr learned my addr 172.21.15.80:0/545304795 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:15.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.979+0000 7f2e94a34700 1 -- 172.21.15.80:0/545304795 >> v1:172.21.15.174:6789/0 conn(0x7f2e90164a10 legacy=0x7f2e90164ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:15.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.979+0000 7f2e94a34700 1 -- 172.21.15.80:0/545304795 >> v1:172.21.15.80:6789/0 conn(0x7f2e901167a0 legacy=0x7f2e90121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:15.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.979+0000 7f2e94a34700 1 -- 172.21.15.80:0/545304795 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e90156d50 con 0x7f2e90169c50 2019-11-28T11:40:15.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.979+0000 7f2e8d7fa700 1 -- 172.21.15.80:0/545304795 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523026372 0 0) 0x7f2e80000f40 con 0x7f2e901167a0 2019-11-28T11:40:15.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.979+0000 7f2e94a34700 1 --2- 172.21.15.80:0/545304795 >> v2:172.21.15.80:3300/0 conn(0x7f2e90169c50 0x7f2e9016c050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2e88010730 tx=0x7f2e88010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:15.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.979+0000 7f2e94a34700 1 --2- 172.21.15.80:0/545304795 >> v2:172.21.15.80:3300/0 conn(0x7f2e90169c50 0x7f2e9016c050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2e88010730 tx=0x7f2e88010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:15.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.979+0000 7f2e94a34700 1 --2- 172.21.15.80:0/545304795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e90169c50 0x7f2e9016c050 secure :-1 s=READY pgs=1272 cs=0 l=1 rx=0x7f2e88010730 tx=0x7f2e88010ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:15.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.979+0000 7f2e94a34700 1 --2- 172.21.15.80:0/545304795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e90169c50 0x7f2e9016c050 secure :-1 s=THROTTLE_DONE pgs=1272 cs=0 l=1 rx=0x7f2e88010730 tx=0x7f2e88010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:15.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.979+0000 7f2e8d7fa700 1 -- 172.21.15.80:0/545304795 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e8800b120 con 0x7f2e90169c50 2019-11-28T11:40:15.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.979+0000 7f2e94a34700 1 --2- 172.21.15.80:0/545304795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e90169c50 0x7f2e9016c050 secure :-1 s=THROTTLE_DONE pgs=1272 cs=0 l=1 rx=0x7f2e88010730 tx=0x7f2e88010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:15.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.979+0000 7f2e95c96700 1 -- 172.21.15.80:0/545304795 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e901570d0 con 0x7f2e90169c50 2019-11-28T11:40:15.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.979+0000 7f2e8d7fa700 1 -- 172.21.15.80:0/545304795 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8800b120 con 0x7f2e90169c50 2019-11-28T11:40:15.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.979+0000 7f2e94a34700 1 --2- 172.21.15.80:0/545304795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e90169c50 0x7f2e9016c050 secure :-1 s=THROTTLE_DONE pgs=1272 cs=0 l=1 rx=0x7f2e88010730 tx=0x7f2e88010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:15.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.979+0000 7f2e8d7fa700 1 -- 172.21.15.80:0/545304795 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e8800b400 con 0x7f2e90169c50 2019-11-28T11:40:15.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.979+0000 7f2e95c96700 1 -- 172.21.15.80:0/545304795 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e90156d50 con 0x7f2e90169c50 2019-11-28T11:40:15.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.979+0000 7f2e94a34700 1 --2- 172.21.15.80:0/545304795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e90169c50 0x7f2e9016c050 secure :-1 s=THROTTLE_DONE pgs=1272 cs=0 l=1 rx=0x7f2e88010730 tx=0x7f2e88010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:15.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.980+0000 7f2e8d7fa700 1 -- 172.21.15.80:0/545304795 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2e88009b40 con 0x7f2e90169c50 2019-11-28T11:40:15.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.980+0000 7f2e94a34700 1 --2- 172.21.15.80:0/545304795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e90169c50 0x7f2e9016c050 secure :-1 s=THROTTLE_DONE pgs=1272 cs=0 l=1 rx=0x7f2e88010730 tx=0x7f2e88010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:15.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.980+0000 7f2e8d7fa700 1 --2- 172.21.15.80:0/545304795 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e74018730 0x7f2e7401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:15.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.980+0000 7f2e8d7fa700 1 -- 172.21.15.80:0/545304795 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f2e88031e70 con 0x7f2e90169c50 2019-11-28T11:40:15.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.980+0000 7f2e8ffff700 1 --2- 172.21.15.80:0/545304795 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e74018730 0x7f2e7401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:15.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.980+0000 7f2e8ffff700 1 --2- 172.21.15.80:0/545304795 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e74018730 0x7f2e7401abc0 crc :-1 s=READY pgs=526 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:15.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.987+0000 7f2e95c96700 1 -- 172.21.15.80:0/545304795 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e901570d0 con 0x7f2e90169c50 2019-11-28T11:40:15.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.991+0000 7f2e94a34700 1 --2- 172.21.15.80:0/545304795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e90169c50 0x7f2e9016c050 secure :-1 s=THROTTLE_DONE pgs=1272 cs=0 l=1 rx=0x7f2e88010730 tx=0x7f2e88010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:15.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:14.991+0000 7f2e8d7fa700 1 -- 172.21.15.80:0/545304795 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2e88009930 con 0x7f2e90169c50 2019-11-28T11:40:15.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:15.164+0000 7f2e95c96700 1 -- 172.21.15.80:0/545304795 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e90156d50 con 0x7f2e90169c50 2019-11-28T11:40:15.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:15.164+0000 7f2e94a34700 1 --2- 172.21.15.80:0/545304795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e90169c50 0x7f2e9016c050 secure :-1 s=THROTTLE_DONE pgs=1272 cs=0 l=1 rx=0x7f2e88010730 tx=0x7f2e88010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:15.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:15.164+0000 7f2e8d7fa700 1 -- 172.21.15.80:0/545304795 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f2e88009b40 con 0x7f2e90169c50 2019-11-28T11:40:15.196 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:15.196 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:15.197 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:15.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:15.166+0000 7f2e95c96700 1 -- 172.21.15.80:0/545304795 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e74018730 msgr2=0x7f2e7401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:15.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:15.166+0000 7f2e95c96700 1 --2- 172.21.15.80:0/545304795 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e74018730 0x7f2e7401abc0 crc :-1 s=READY pgs=526 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:15.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:15.166+0000 7f2e95c96700 1 -- 172.21.15.80:0/545304795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e90169c50 msgr2=0x7f2e9016c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:15.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:15.166+0000 7f2e95c96700 1 --2- 172.21.15.80:0/545304795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e90169c50 0x7f2e9016c050 secure :-1 s=READY pgs=1272 cs=0 l=1 rx=0x7f2e88010730 tx=0x7f2e88010ad0).stop 2019-11-28T11:40:15.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:15.167+0000 7f2e95c96700 1 -- 172.21.15.80:0/545304795 shutdown_connections 2019-11-28T11:40:15.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:15.167+0000 7f2e95c96700 1 --2- 172.21.15.80:0/545304795 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e90169c50 0x7f2e9016c050 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:15.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:15.167+0000 7f2e95c96700 1 --2- 172.21.15.80:0/545304795 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e74018730 0x7f2e7401abc0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:15.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:15.167+0000 7f2e95c96700 1 -- 172.21.15.80:0/545304795 shutdown_connections 2019-11-28T11:40:15.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:15.167+0000 7f2e95c96700 1 -- 172.21.15.80:0/545304795 wait complete. 2019-11-28T11:40:15.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:15.167+0000 7f2e95c96700 1 -- 172.21.15.80:0/545304795 >> 172.21.15.80:0/545304795 conn(0x7f2e901426c0 msgr2=0x7f2e90110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:15.208 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:16.211 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:16.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.300+0000 7ff75bed2700 1 Processor -- start 2019-11-28T11:40:16.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.300+0000 7ff75bed2700 1 -- start start 2019-11-28T11:40:16.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.301+0000 7ff75bed2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff75406c490 0x7ff75406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:16.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.301+0000 7ff75bed2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff75406ce60 0x7ff754164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:16.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.301+0000 7ff75bed2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75406db00 con 0x7ff75406c0a0 2019-11-28T11:40:16.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.301+0000 7ff75bed2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff75406fd60 con 0x7ff75406c490 2019-11-28T11:40:16.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.301+0000 7ff75bed2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff754070030 con 0x7ff75406ce60 2019-11-28T11:40:16.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.301+0000 7ff75a46f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff75406c0a0 0x7ff754072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37026/0 (socket says 172.21.15.80:37026) 2019-11-28T11:40:16.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.301+0000 7ff75a46f700 1 -- 172.21.15.80:0/4159126123 learned_addr learned my addr 172.21.15.80:0/4159126123 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:16.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.301+0000 7ff759c6e700 1 --2- 172.21.15.80:0/4159126123 >> v2:172.21.15.174:3300/0 conn(0x7ff75406c490 0x7ff75406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:16.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.301+0000 7ff75ac70700 1 --2- 172.21.15.80:0/4159126123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff75406ce60 0x7ff754164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:16.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.301+0000 7ff75946d700 1 -- 172.21.15.80:0/4159126123 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214203382 0 0) 0x7ff748001150 con 0x7ff75406c0a0 2019-11-28T11:40:16.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.301+0000 7ff75946d700 1 -- 172.21.15.80:0/4159126123 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff740002e80 con 0x7ff75406c0a0 2019-11-28T11:40:16.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.302+0000 7ff759c6e700 1 -- 172.21.15.80:0/4159126123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff75406ce60 msgr2=0x7ff754164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:16.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.302+0000 7ff759c6e700 1 --2- 172.21.15.80:0/4159126123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff75406ce60 0x7ff754164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:16.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.302+0000 7ff759c6e700 1 -- 172.21.15.80:0/4159126123 >> v1:172.21.15.80:6789/0 conn(0x7ff75406c0a0 legacy=0x7ff754072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:16.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.302+0000 7ff759c6e700 1 -- 172.21.15.80:0/4159126123 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7540706c0 con 0x7ff75406c490 2019-11-28T11:40:16.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.302+0000 7ff75ac70700 1 --2- 172.21.15.80:0/4159126123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff75406ce60 0x7ff754164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:40:16.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.302+0000 7ff759c6e700 1 --2- 172.21.15.80:0/4159126123 >> v2:172.21.15.174:3300/0 conn(0x7ff75406c490 0x7ff75406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff75000b2d0 tx=0x7ff75000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:16.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.302+0000 7ff759c6e700 1 --2- 172.21.15.80:0/4159126123 >> v2:172.21.15.174:3300/0 conn(0x7ff75406c490 0x7ff75406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff75000b2d0 tx=0x7ff75000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:16.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.302+0000 7ff759c6e700 1 --2- 172.21.15.80:0/4159126123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff75406c490 0x7ff75406c920 secure :-1 s=READY pgs=756 cs=0 l=1 rx=0x7ff75000b2d0 tx=0x7ff75000bae0).ready entity=mon.1 client_cookie=bf257c986f9aded7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:16.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.302+0000 7ff759c6e700 1 --2- 172.21.15.80:0/4159126123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff75406c490 0x7ff75406c920 secure :-1 s=THROTTLE_DONE pgs=756 cs=0 l=1 rx=0x7ff75000b2d0 tx=0x7ff75000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:16.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.302+0000 7ff75946d700 1 -- 172.21.15.80:0/4159126123 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff750007590 con 0x7ff75406c490 2019-11-28T11:40:16.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.302+0000 7ff759c6e700 1 --2- 172.21.15.80:0/4159126123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff75406c490 0x7ff75406c920 secure :-1 s=THROTTLE_DONE pgs=756 cs=0 l=1 rx=0x7ff75000b2d0 tx=0x7ff75000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:16.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.302+0000 7ff759c6e700 1 --2- 172.21.15.80:0/4159126123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff75406c490 0x7ff75406c920 secure :-1 s=THROTTLE_DONE pgs=756 cs=0 l=1 rx=0x7ff75000b2d0 tx=0x7ff75000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:16.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.302+0000 7ff75946d700 1 -- 172.21.15.80:0/4159126123 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff750009d30 con 0x7ff75406c490 2019-11-28T11:40:16.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.302+0000 7ff75946d700 1 -- 172.21.15.80:0/4159126123 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff750007590 con 0x7ff75406c490 2019-11-28T11:40:16.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.302+0000 7ff75bed2700 1 -- 172.21.15.80:0/4159126123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff75406c490 msgr2=0x7ff75406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:16.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.302+0000 7ff75bed2700 1 --2- 172.21.15.80:0/4159126123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff75406c490 0x7ff75406c920 secure :-1 s=READY pgs=756 cs=0 l=1 rx=0x7ff75000b2d0 tx=0x7ff75000bae0).stop 2019-11-28T11:40:16.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.303+0000 7ff75bed2700 1 -- 172.21.15.80:0/4159126123 shutdown_connections 2019-11-28T11:40:16.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.303+0000 7ff75bed2700 1 --2- 172.21.15.80:0/4159126123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff75406ce60 0x7ff754164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:16.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.303+0000 7ff75bed2700 1 --2- 172.21.15.80:0/4159126123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff75406c490 0x7ff75406c920 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:16.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.303+0000 7ff75bed2700 1 -- 172.21.15.80:0/4159126123 shutdown_connections 2019-11-28T11:40:16.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.303+0000 7ff75bed2700 1 -- 172.21.15.80:0/4159126123 wait complete. 2019-11-28T11:40:16.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.303+0000 7ff75bed2700 1 -- 172.21.15.80:0/4159126123 >> 172.21.15.80:0/4159126123 conn(0x7ff754061cf0 msgr2=0x7ff754064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:16.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.305+0000 7ff75bed2700 1 Processor -- start 2019-11-28T11:40:16.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.305+0000 7ff75bed2700 1 -- start start 2019-11-28T11:40:16.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.306+0000 7ff75bed2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff75413e900 0x7ff754121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:16.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.306+0000 7ff75bed2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7541211a0 0x7ff75413a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:16.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.306+0000 7ff75bed2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff754139df0 con 0x7ff754121c90 2019-11-28T11:40:16.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.306+0000 7ff75bed2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff75413b850 con 0x7ff7541211a0 2019-11-28T11:40:16.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.306+0000 7ff75bed2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff754128fb0 con 0x7ff75413e900 2019-11-28T11:40:16.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.306+0000 7ff75ac70700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7541211a0 0x7ff75413a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:16.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.306+0000 7ff759c6e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff754121c90 0x7ff7541209a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37032/0 (socket says 172.21.15.80:37032) 2019-11-28T11:40:16.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.306+0000 7ff759c6e700 1 -- 172.21.15.80:0/2590486064 learned_addr learned my addr 172.21.15.80:0/2590486064 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:16.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.306+0000 7ff75a46f700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff75413e900 0x7ff754121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:16.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.306+0000 7ff75ac70700 1 -- 172.21.15.80:0/2590486064 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff75413e900 msgr2=0x7ff754121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:16.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.306+0000 7ff75ac70700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff75413e900 0x7ff754121750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:16.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.306+0000 7ff75ac70700 1 -- 172.21.15.80:0/2590486064 >> v1:172.21.15.80:6789/0 conn(0x7ff754121c90 legacy=0x7ff7541209a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:16.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.307+0000 7ff75ac70700 1 -- 172.21.15.80:0/2590486064 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff754129330 con 0x7ff7541211a0 2019-11-28T11:40:16.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.306+0000 7ff746ffd700 1 -- 172.21.15.80:0/2590486064 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613201166 0 0) 0x7ff75000af30 con 0x7ff754121c90 2019-11-28T11:40:16.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.307+0000 7ff75ac70700 1 --2- 172.21.15.80:0/2590486064 >> v2:172.21.15.80:3300/0 conn(0x7ff7541211a0 0x7ff75413a490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff74c010380 tx=0x7ff74c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:16.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.307+0000 7ff75ac70700 1 --2- 172.21.15.80:0/2590486064 >> v2:172.21.15.80:3300/0 conn(0x7ff7541211a0 0x7ff75413a490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff74c010380 tx=0x7ff74c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:16.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.307+0000 7ff75ac70700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7541211a0 0x7ff75413a490 secure :-1 s=READY pgs=1275 cs=0 l=1 rx=0x7ff74c010380 tx=0x7ff74c010720).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:16.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.307+0000 7ff75ac70700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7541211a0 0x7ff75413a490 secure :-1 s=THROTTLE_DONE pgs=1275 cs=0 l=1 rx=0x7ff74c010380 tx=0x7ff74c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:16.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.307+0000 7ff746ffd700 1 -- 172.21.15.80:0/2590486064 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff74c00ab90 con 0x7ff7541211a0 2019-11-28T11:40:16.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.307+0000 7ff75ac70700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7541211a0 0x7ff75413a490 secure :-1 s=THROTTLE_DONE pgs=1275 cs=0 l=1 rx=0x7ff74c010380 tx=0x7ff74c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:16.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.307+0000 7ff75ac70700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7541211a0 0x7ff75413a490 secure :-1 s=THROTTLE_DONE pgs=1275 cs=0 l=1 rx=0x7ff74c010380 tx=0x7ff74c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:16.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.307+0000 7ff746ffd700 1 -- 172.21.15.80:0/2590486064 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74c0097a0 con 0x7ff7541211a0 2019-11-28T11:40:16.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.307+0000 7ff75bed2700 1 -- 172.21.15.80:0/2590486064 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7541281b0 con 0x7ff7541211a0 2019-11-28T11:40:16.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.307+0000 7ff746ffd700 1 -- 172.21.15.80:0/2590486064 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff74c00ab90 con 0x7ff7541211a0 2019-11-28T11:40:16.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.307+0000 7ff75bed2700 1 -- 172.21.15.80:0/2590486064 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff754129330 con 0x7ff7541211a0 2019-11-28T11:40:16.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.308+0000 7ff75ac70700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7541211a0 0x7ff75413a490 secure :-1 s=THROTTLE_DONE pgs=1275 cs=0 l=1 rx=0x7ff74c010380 tx=0x7ff74c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:16.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.308+0000 7ff746ffd700 1 -- 172.21.15.80:0/2590486064 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff74c0095b0 con 0x7ff7541211a0 2019-11-28T11:40:16.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.308+0000 7ff75ac70700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7541211a0 0x7ff75413a490 secure :-1 s=THROTTLE_DONE pgs=1275 cs=0 l=1 rx=0x7ff74c010380 tx=0x7ff74c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.308+0000 7ff746ffd700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff73c018730 0x7ff73c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.308+0000 7ff746ffd700 1 -- 172.21.15.80:0/2590486064 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7ff74c0319b0 con 0x7ff7541211a0 2019-11-28T11:40:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.308+0000 7ff75a46f700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff73c018730 0x7ff73c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.308+0000 7ff75a46f700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff73c018730 0x7ff73c01abc0 crc :-1 s=READY pgs=527 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:16.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.315+0000 7ff75bed2700 1 -- 172.21.15.80:0/2590486064 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7541281b0 con 0x7ff7541211a0 2019-11-28T11:40:16.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.319+0000 7ff75ac70700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7541211a0 0x7ff75413a490 secure :-1 s=THROTTLE_DONE pgs=1275 cs=0 l=1 rx=0x7ff74c010380 tx=0x7ff74c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:16.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.319+0000 7ff746ffd700 1 -- 172.21.15.80:0/2590486064 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff74c000a70 con 0x7ff7541211a0 2019-11-28T11:40:16.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.490+0000 7ff75bed2700 1 -- 172.21.15.80:0/2590486064 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff754129330 con 0x7ff7541211a0 2019-11-28T11:40:16.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.490+0000 7ff75ac70700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7541211a0 0x7ff75413a490 secure :-1 s=THROTTLE_DONE pgs=1275 cs=0 l=1 rx=0x7ff74c010380 tx=0x7ff74c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:16.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.490+0000 7ff746ffd700 1 -- 172.21.15.80:0/2590486064 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7ff74c0095b0 con 0x7ff7541211a0 2019-11-28T11:40:16.523 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:16.523 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:16.524 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:16.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.493+0000 7ff75bed2700 1 -- 172.21.15.80:0/2590486064 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff73c018730 msgr2=0x7ff73c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:16.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.493+0000 7ff75bed2700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff73c018730 0x7ff73c01abc0 crc :-1 s=READY pgs=527 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:16.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.493+0000 7ff75bed2700 1 -- 172.21.15.80:0/2590486064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7541211a0 msgr2=0x7ff75413a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:16.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.493+0000 7ff75bed2700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7541211a0 0x7ff75413a490 secure :-1 s=READY pgs=1275 cs=0 l=1 rx=0x7ff74c010380 tx=0x7ff74c010720).stop 2019-11-28T11:40:16.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.493+0000 7ff75bed2700 1 -- 172.21.15.80:0/2590486064 shutdown_connections 2019-11-28T11:40:16.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.493+0000 7ff75bed2700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff73c018730 0x7ff73c01abc0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:16.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.493+0000 7ff75bed2700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7541211a0 0x7ff75413a490 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:16.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.493+0000 7ff75bed2700 1 --2- 172.21.15.80:0/2590486064 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff75413e900 0x7ff754121750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:16.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.493+0000 7ff75bed2700 1 -- 172.21.15.80:0/2590486064 shutdown_connections 2019-11-28T11:40:16.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.493+0000 7ff75bed2700 1 -- 172.21.15.80:0/2590486064 wait complete. 2019-11-28T11:40:16.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:16.493+0000 7ff75bed2700 1 -- 172.21.15.80:0/2590486064 >> 172.21.15.80:0/2590486064 conn(0x7ff754127dc0 msgr2=0x7ff754141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:16.535 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:17.536 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:17.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.625+0000 7f6400697700 1 Processor -- start 2019-11-28T11:40:17.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.625+0000 7f6400697700 1 -- start start 2019-11-28T11:40:17.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.626+0000 7f6400697700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63f806c0a0 0x7f63f8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:17.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.626+0000 7f6400697700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f63f80734e0 0x7f63f8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:17.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.626+0000 7f6400697700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f806db00 con 0x7f63f8072360 2019-11-28T11:40:17.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.626+0000 7f6400697700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f806f330 con 0x7f63f80734e0 2019-11-28T11:40:17.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.626+0000 7f6400697700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f80706c0 con 0x7f63f806c0a0 2019-11-28T11:40:17.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.626+0000 7f63fe433700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f63f80734e0 0x7f63f8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:17.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.626+0000 7f63fe433700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f63f80734e0 0x7f63f8071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37726/0 (socket says 172.21.15.80:37726) 2019-11-28T11:40:17.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.626+0000 7f63fe433700 1 -- 172.21.15.80:0/3668239820 learned_addr learned my addr 172.21.15.80:0/3668239820 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:17.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.626+0000 7f63fec34700 1 --2- 172.21.15.80:0/3668239820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63f806c0a0 0x7f63f8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:17.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.626+0000 7f63fe433700 1 -- 172.21.15.80:0/3668239820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63f806c0a0 msgr2=0x7f63f8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:17.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.627+0000 7f63fe433700 1 --2- 172.21.15.80:0/3668239820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63f806c0a0 0x7f63f8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:17.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.627+0000 7f63fe433700 1 -- 172.21.15.80:0/3668239820 >> v1:172.21.15.174:6789/0 conn(0x7f63f8072360 legacy=0x7f63f806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:17.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.627+0000 7f63fe433700 1 -- 172.21.15.80:0/3668239820 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f8070a40 con 0x7f63f80734e0 2019-11-28T11:40:17.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.627+0000 7f63fe433700 1 --2- 172.21.15.80:0/3668239820 >> v2:172.21.15.80:3300/0 conn(0x7f63f80734e0 0x7f63f8071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f63e000fa40 tx=0x7f63e000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:17.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.627+0000 7f63fe433700 1 --2- 172.21.15.80:0/3668239820 >> v2:172.21.15.80:3300/0 conn(0x7f63f80734e0 0x7f63f8071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f63e000fa40 tx=0x7f63e000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:17.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.627+0000 7f63fe433700 1 --2- 172.21.15.80:0/3668239820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f80734e0 0x7f63f8071e20 secure :-1 s=READY pgs=1276 cs=0 l=1 rx=0x7f63e000fa40 tx=0x7f63e000fde0).ready entity=mon.0 client_cookie=b3d06eb022e6d482 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:17.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.627+0000 7f63fe433700 1 --2- 172.21.15.80:0/3668239820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f80734e0 0x7f63f8071e20 secure :-1 s=THROTTLE_DONE pgs=1276 cs=0 l=1 rx=0x7f63e000fa40 tx=0x7f63e000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:17.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.627+0000 7f63fe433700 1 --2- 172.21.15.80:0/3668239820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f80734e0 0x7f63f8071e20 secure :-1 s=THROTTLE_DONE pgs=1276 cs=0 l=1 rx=0x7f63e000fa40 tx=0x7f63e000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:17.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.627+0000 7f63fe433700 1 --2- 172.21.15.80:0/3668239820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f80734e0 0x7f63f8071e20 secure :-1 s=THROTTLE_DONE pgs=1276 cs=0 l=1 rx=0x7f63e000fa40 tx=0x7f63e000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:17.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.627+0000 7f63fdc32700 1 -- 172.21.15.80:0/3668239820 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e0000ce0 con 0x7f63f80734e0 2019-11-28T11:40:17.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.627+0000 7f63fdc32700 1 -- 172.21.15.80:0/3668239820 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e0001010 con 0x7f63f80734e0 2019-11-28T11:40:17.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.627+0000 7f63fdc32700 1 -- 172.21.15.80:0/3668239820 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e0001760 con 0x7f63f80734e0 2019-11-28T11:40:17.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.627+0000 7f6400697700 1 -- 172.21.15.80:0/3668239820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f80734e0 msgr2=0x7f63f8071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:17.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.627+0000 7f6400697700 1 --2- 172.21.15.80:0/3668239820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f80734e0 0x7f63f8071e20 secure :-1 s=READY pgs=1276 cs=0 l=1 rx=0x7f63e000fa40 tx=0x7f63e000fde0).stop 2019-11-28T11:40:17.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.628+0000 7f6400697700 1 -- 172.21.15.80:0/3668239820 shutdown_connections 2019-11-28T11:40:17.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.628+0000 7f6400697700 1 --2- 172.21.15.80:0/3668239820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f80734e0 0x7f63f8071e20 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:17.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.628+0000 7f6400697700 1 --2- 172.21.15.80:0/3668239820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63f806c0a0 0x7f63f8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:17.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.628+0000 7f6400697700 1 -- 172.21.15.80:0/3668239820 shutdown_connections 2019-11-28T11:40:17.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.628+0000 7f6400697700 1 -- 172.21.15.80:0/3668239820 wait complete. 2019-11-28T11:40:17.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.628+0000 7f6400697700 1 -- 172.21.15.80:0/3668239820 >> 172.21.15.80:0/3668239820 conn(0x7f63f8061cf0 msgr2=0x7f63f8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:17.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.630+0000 7f6400697700 1 Processor -- start 2019-11-28T11:40:17.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.630+0000 7f6400697700 1 -- start start 2019-11-28T11:40:17.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.631+0000 7f6400697700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f63f8128e40 0x7f63f8168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:17.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.631+0000 7f6400697700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f8139a60 con 0x7f63f81281b0 2019-11-28T11:40:17.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.631+0000 7f6400697700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f813b060 con 0x7f63f813a780 2019-11-28T11:40:17.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.631+0000 7f6400697700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f812a260 con 0x7f63f8128e40 2019-11-28T11:40:17.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.631+0000 7f63ff435700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f63f8128e40 0x7f63f8168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:17.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.631+0000 7f63fe433700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f63f81281b0 0x7f63f8128640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37046/0 (socket says 172.21.15.80:37046) 2019-11-28T11:40:17.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.631+0000 7f63fe433700 1 -- 172.21.15.80:0/2308983722 learned_addr learned my addr 172.21.15.80:0/2308983722 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:17.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f63ff435700 1 -- 172.21.15.80:0/2308983722 >> v1:172.21.15.174:6789/0 conn(0x7f63f813a780 legacy=0x7f63f812d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:17.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f63ff435700 1 -- 172.21.15.80:0/2308983722 >> v1:172.21.15.80:6789/0 conn(0x7f63f81281b0 legacy=0x7f63f8128640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:17.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f63ff435700 1 -- 172.21.15.80:0/2308983722 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f812abc0 con 0x7f63f8128e40 2019-11-28T11:40:17.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f63f77fe700 1 -- 172.21.15.80:0/2308983722 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060426903 0 0) 0x7f63e0008120 con 0x7f63f81281b0 2019-11-28T11:40:17.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f63ff435700 1 --2- 172.21.15.80:0/2308983722 >> v2:172.21.15.80:3300/0 conn(0x7f63f8128e40 0x7f63f8168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f63f00103b0 tx=0x7f63f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:17.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f63ff435700 1 --2- 172.21.15.80:0/2308983722 >> v2:172.21.15.80:3300/0 conn(0x7f63f8128e40 0x7f63f8168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f63f00103b0 tx=0x7f63f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:17.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f63ff435700 1 --2- 172.21.15.80:0/2308983722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f8128e40 0x7f63f8168d80 secure :-1 s=READY pgs=1278 cs=0 l=1 rx=0x7f63f00103b0 tx=0x7f63f0010750).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:17.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f63ff435700 1 --2- 172.21.15.80:0/2308983722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f8128e40 0x7f63f8168d80 secure :-1 s=THROTTLE_DONE pgs=1278 cs=0 l=1 rx=0x7f63f00103b0 tx=0x7f63f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:17.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f63f77fe700 1 -- 172.21.15.80:0/2308983722 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63f0000a50 con 0x7f63f8128e40 2019-11-28T11:40:17.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f63ff435700 1 --2- 172.21.15.80:0/2308983722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f8128e40 0x7f63f8168d80 secure :-1 s=THROTTLE_DONE pgs=1278 cs=0 l=1 rx=0x7f63f00103b0 tx=0x7f63f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:17.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f63ff435700 1 --2- 172.21.15.80:0/2308983722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f8128e40 0x7f63f8168d80 secure :-1 s=THROTTLE_DONE pgs=1278 cs=0 l=1 rx=0x7f63f00103b0 tx=0x7f63f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:17.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f6400697700 1 -- 172.21.15.80:0/2308983722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f812af40 con 0x7f63f8128e40 2019-11-28T11:40:17.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f63f77fe700 1 -- 172.21.15.80:0/2308983722 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f0000a30 con 0x7f63f8128e40 2019-11-28T11:40:17.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f63f77fe700 1 -- 172.21.15.80:0/2308983722 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63f000f070 con 0x7f63f8128e40 2019-11-28T11:40:17.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f6400697700 1 -- 172.21.15.80:0/2308983722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f812abc0 con 0x7f63f8128e40 2019-11-28T11:40:17.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f63ff435700 1 --2- 172.21.15.80:0/2308983722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f8128e40 0x7f63f8168d80 secure :-1 s=THROTTLE_DONE pgs=1278 cs=0 l=1 rx=0x7f63f00103b0 tx=0x7f63f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:17.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f63f77fe700 1 -- 172.21.15.80:0/2308983722 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f63f000ec90 con 0x7f63f8128e40 2019-11-28T11:40:17.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.632+0000 7f63ff435700 1 --2- 172.21.15.80:0/2308983722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f8128e40 0x7f63f8168d80 secure :-1 s=THROTTLE_DONE pgs=1278 cs=0 l=1 rx=0x7f63f00103b0 tx=0x7f63f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:17.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.633+0000 7f63f77fe700 1 --2- 172.21.15.80:0/2308983722 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f63dc018730 0x7f63dc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:17.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.633+0000 7f63f77fe700 1 -- 172.21.15.80:0/2308983722 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f63f0031aa0 con 0x7f63f8128e40 2019-11-28T11:40:17.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.633+0000 7f63fec34700 1 --2- 172.21.15.80:0/2308983722 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f63dc018730 0x7f63dc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:17.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.633+0000 7f63fec34700 1 --2- 172.21.15.80:0/2308983722 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f63dc018730 0x7f63dc01abc0 crc :-1 s=READY pgs=528 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:17.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.640+0000 7f6400697700 1 -- 172.21.15.80:0/2308983722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f812af40 con 0x7f63f8128e40 2019-11-28T11:40:17.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.644+0000 7f63ff435700 1 --2- 172.21.15.80:0/2308983722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f8128e40 0x7f63f8168d80 secure :-1 s=THROTTLE_DONE pgs=1278 cs=0 l=1 rx=0x7f63f00103b0 tx=0x7f63f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:17.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.644+0000 7f63f77fe700 1 -- 172.21.15.80:0/2308983722 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f63f000e9e0 con 0x7f63f8128e40 2019-11-28T11:40:17.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.814+0000 7f6400697700 1 -- 172.21.15.80:0/2308983722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63f812abc0 con 0x7f63f8128e40 2019-11-28T11:40:17.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.815+0000 7f63ff435700 1 --2- 172.21.15.80:0/2308983722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f8128e40 0x7f63f8168d80 secure :-1 s=THROTTLE_DONE pgs=1278 cs=0 l=1 rx=0x7f63f00103b0 tx=0x7f63f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:17.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.815+0000 7f63f77fe700 1 -- 172.21.15.80:0/2308983722 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f63f000ebf0 con 0x7f63f8128e40 2019-11-28T11:40:17.847 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:17.847 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:17.848 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:17.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.817+0000 7f6400697700 1 -- 172.21.15.80:0/2308983722 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f63dc018730 msgr2=0x7f63dc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:17.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.817+0000 7f6400697700 1 --2- 172.21.15.80:0/2308983722 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f63dc018730 0x7f63dc01abc0 crc :-1 s=READY pgs=528 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:17.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.817+0000 7f6400697700 1 -- 172.21.15.80:0/2308983722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f8128e40 msgr2=0x7f63f8168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:17.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.817+0000 7f6400697700 1 --2- 172.21.15.80:0/2308983722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f8128e40 0x7f63f8168d80 secure :-1 s=READY pgs=1278 cs=0 l=1 rx=0x7f63f00103b0 tx=0x7f63f0010750).stop 2019-11-28T11:40:17.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.817+0000 7f6400697700 1 -- 172.21.15.80:0/2308983722 shutdown_connections 2019-11-28T11:40:17.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.817+0000 7f6400697700 1 --2- 172.21.15.80:0/2308983722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f8128e40 0x7f63f8168d80 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:17.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.817+0000 7f6400697700 1 --2- 172.21.15.80:0/2308983722 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f63dc018730 0x7f63dc01abc0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:17.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.818+0000 7f6400697700 1 -- 172.21.15.80:0/2308983722 shutdown_connections 2019-11-28T11:40:17.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.818+0000 7f6400697700 1 -- 172.21.15.80:0/2308983722 wait complete. 2019-11-28T11:40:17.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:17.818+0000 7f6400697700 1 -- 172.21.15.80:0/2308983722 >> 172.21.15.80:0/2308983722 conn(0x7f63f8127dc0 msgr2=0x7f63f8141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:17.859 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:18.860 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:18.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.950+0000 7f0546a38700 1 Processor -- start 2019-11-28T11:40:18.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.950+0000 7f0546a38700 1 -- start start 2019-11-28T11:40:18.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.951+0000 7f0546a38700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f054006d120 0x7f0540165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:18.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.951+0000 7f0546a38700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054006d5a0 con 0x7f054006c490 2019-11-28T11:40:18.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.951+0000 7f0546a38700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054006db00 con 0x7f054006c0a0 2019-11-28T11:40:18.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.951+0000 7f0546a38700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054006fd60 con 0x7f054006d120 2019-11-28T11:40:18.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f053ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f054006c490 0x7f054006c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37052/0 (socket says 172.21.15.80:37052) 2019-11-28T11:40:18.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f053ffff700 1 -- 172.21.15.80:0/3537773030 learned_addr learned my addr 172.21.15.80:0/3537773030 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:18.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f05457d6700 1 --2- 172.21.15.80:0/3537773030 >> v2:172.21.15.174:3300/0 conn(0x7f054006d120 0x7f0540165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:18.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f053f7fe700 1 -- 172.21.15.80:0/3537773030 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405669242 0 0) 0x7f0528001150 con 0x7f054006c490 2019-11-28T11:40:18.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f053f7fe700 1 -- 172.21.15.80:0/3537773030 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f052c002e80 con 0x7f054006c490 2019-11-28T11:40:18.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f05457d6700 1 -- 172.21.15.80:0/3537773030 >> v1:172.21.15.174:6789/0 conn(0x7f054006c0a0 legacy=0x7f0540072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:18.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f053f7fe700 1 -- 172.21.15.80:0/3537773030 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313745642 0 0) 0x7f0530001400 con 0x7f054006c0a0 2019-11-28T11:40:18.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f05457d6700 1 -- 172.21.15.80:0/3537773030 >> v1:172.21.15.80:6789/0 conn(0x7f054006c490 legacy=0x7f054006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:18.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f05457d6700 1 -- 172.21.15.80:0/3537773030 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05400706c0 con 0x7f054006d120 2019-11-28T11:40:18.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f05457d6700 1 --2- 172.21.15.80:0/3537773030 >> v2:172.21.15.174:3300/0 conn(0x7f054006d120 0x7f0540165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f053800af80 tx=0x7f053800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:18.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f05457d6700 1 --2- 172.21.15.80:0/3537773030 >> v2:172.21.15.174:3300/0 conn(0x7f054006d120 0x7f0540165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f053800af80 tx=0x7f053800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:18.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f05457d6700 1 --2- 172.21.15.80:0/3537773030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f054006d120 0x7f0540165d80 secure :-1 s=READY pgs=760 cs=0 l=1 rx=0x7f053800af80 tx=0x7f053800b790).ready entity=mon.1 client_cookie=2a05ad5a8d5a1a10 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:18.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f05457d6700 1 --2- 172.21.15.80:0/3537773030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f054006d120 0x7f0540165d80 secure :-1 s=THROTTLE_DONE pgs=760 cs=0 l=1 rx=0x7f053800af80 tx=0x7f053800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:18.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f053f7fe700 1 -- 172.21.15.80:0/3537773030 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0538007240 con 0x7f054006d120 2019-11-28T11:40:18.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f05457d6700 1 --2- 172.21.15.80:0/3537773030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f054006d120 0x7f0540165d80 secure :-1 s=THROTTLE_DONE pgs=760 cs=0 l=1 rx=0x7f053800af80 tx=0x7f053800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:18.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f05457d6700 1 --2- 172.21.15.80:0/3537773030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f054006d120 0x7f0540165d80 secure :-1 s=THROTTLE_DONE pgs=760 cs=0 l=1 rx=0x7f053800af80 tx=0x7f053800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:18.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f053f7fe700 1 -- 172.21.15.80:0/3537773030 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0538000bb0 con 0x7f054006d120 2019-11-28T11:40:18.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f053f7fe700 1 -- 172.21.15.80:0/3537773030 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0538009e60 con 0x7f054006d120 2019-11-28T11:40:18.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f0546a38700 1 -- 172.21.15.80:0/3537773030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f054006d120 msgr2=0x7f0540165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:18.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.952+0000 7f0546a38700 1 --2- 172.21.15.80:0/3537773030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f054006d120 0x7f0540165d80 secure :-1 s=READY pgs=760 cs=0 l=1 rx=0x7f053800af80 tx=0x7f053800b790).stop 2019-11-28T11:40:18.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.953+0000 7f0546a38700 1 -- 172.21.15.80:0/3537773030 shutdown_connections 2019-11-28T11:40:18.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.953+0000 7f0546a38700 1 --2- 172.21.15.80:0/3537773030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f054006d120 0x7f0540165d80 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:18.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.953+0000 7f0546a38700 1 -- 172.21.15.80:0/3537773030 shutdown_connections 2019-11-28T11:40:18.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.953+0000 7f0546a38700 1 -- 172.21.15.80:0/3537773030 wait complete. 2019-11-28T11:40:18.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.953+0000 7f0546a38700 1 -- 172.21.15.80:0/3537773030 >> 172.21.15.80:0/3537773030 conn(0x7f0540061cf0 msgr2=0x7f0540064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:18.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.955+0000 7f0546a38700 1 Processor -- start 2019-11-28T11:40:18.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.956+0000 7f0546a38700 1 -- start start 2019-11-28T11:40:18.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f0546a38700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0540164a10 0x7f0540164ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:18.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f0546a38700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f05401653e0 0x7f05401205d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:18.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f0546a38700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0540116b90 con 0x7f05401167a0 2019-11-28T11:40:18.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f0546a38700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05401563f0 con 0x7f05401653e0 2019-11-28T11:40:18.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f0546a38700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05401566c0 con 0x7f0540164a10 2019-11-28T11:40:18.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f0544fd5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f05401167a0 0x7f0540121750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37058/0 (socket says 172.21.15.80:37058) 2019-11-28T11:40:18.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f0544fd5700 1 -- 172.21.15.80:0/2354423333 learned_addr learned my addr 172.21.15.80:0/2354423333 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:18.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f05457d6700 1 --2- 172.21.15.80:0/2354423333 >> v2:172.21.15.80:3300/0 conn(0x7f05401653e0 0x7f05401205d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:18.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f053ffff700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0540164a10 0x7f0540164ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:18.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f053d7fa700 1 -- 172.21.15.80:0/2354423333 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710026471 0 0) 0x7f0530001640 con 0x7f05401167a0 2019-11-28T11:40:18.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f053d7fa700 1 -- 172.21.15.80:0/2354423333 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0524002e80 con 0x7f05401167a0 2019-11-28T11:40:18.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f05457d6700 1 -- 172.21.15.80:0/2354423333 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0540164a10 msgr2=0x7f0540164ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:18.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f05457d6700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0540164a10 0x7f0540164ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:18.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f05457d6700 1 -- 172.21.15.80:0/2354423333 >> v1:172.21.15.80:6789/0 conn(0x7f05401167a0 legacy=0x7f0540121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:18.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f05457d6700 1 -- 172.21.15.80:0/2354423333 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0540156d50 con 0x7f05401653e0 2019-11-28T11:40:18.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f05457d6700 1 --2- 172.21.15.80:0/2354423333 >> v2:172.21.15.80:3300/0 conn(0x7f05401653e0 0x7f05401205d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05380103c0 tx=0x7f05380101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:18.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f05457d6700 1 --2- 172.21.15.80:0/2354423333 >> v2:172.21.15.80:3300/0 conn(0x7f05401653e0 0x7f05401205d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05380103c0 tx=0x7f05380101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:18.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f05457d6700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05401653e0 0x7f05401205d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rx=0x7f05380103c0 tx=0x7f05380101f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:18.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f05457d6700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05401653e0 0x7f05401205d0 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f05380103c0 tx=0x7f05380101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:18.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f053d7fa700 1 -- 172.21.15.80:0/2354423333 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05380099b0 con 0x7f05401653e0 2019-11-28T11:40:18.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f05457d6700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05401653e0 0x7f05401205d0 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f05380103c0 tx=0x7f05380101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:18.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f053d7fa700 1 -- 172.21.15.80:0/2354423333 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05380097c0 con 0x7f05401653e0 2019-11-28T11:40:18.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f05457d6700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05401653e0 0x7f05401205d0 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f05380103c0 tx=0x7f05380101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:18.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f0546a38700 1 -- 172.21.15.80:0/2354423333 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05401570d0 con 0x7f05401653e0 2019-11-28T11:40:18.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f053d7fa700 1 -- 172.21.15.80:0/2354423333 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0538009f30 con 0x7f05401653e0 2019-11-28T11:40:18.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.957+0000 7f0546a38700 1 -- 172.21.15.80:0/2354423333 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0540156d50 con 0x7f05401653e0 2019-11-28T11:40:18.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.958+0000 7f05457d6700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05401653e0 0x7f05401205d0 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f05380103c0 tx=0x7f05380101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:18.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.958+0000 7f053d7fa700 1 -- 172.21.15.80:0/2354423333 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0538009af0 con 0x7f05401653e0 2019-11-28T11:40:18.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.958+0000 7f05457d6700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05401653e0 0x7f05401205d0 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f05380103c0 tx=0x7f05380101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:18.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.958+0000 7f053d7fa700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0524018770 0x7f052401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:18.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.958+0000 7f053d7fa700 1 -- 172.21.15.80:0/2354423333 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f0538031cb0 con 0x7f05401653e0 2019-11-28T11:40:18.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.958+0000 7f0544fd5700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0524018770 0x7f052401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:18.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.958+0000 7f0544fd5700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0524018770 0x7f052401abe0 crc :-1 s=READY pgs=529 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:19.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.966+0000 7f0546a38700 1 -- 172.21.15.80:0/2354423333 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05401570d0 con 0x7f05401653e0 2019-11-28T11:40:19.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.969+0000 7f05457d6700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05401653e0 0x7f05401205d0 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f05380103c0 tx=0x7f05380101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:19.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:18.969+0000 7f053d7fa700 1 -- 172.21.15.80:0/2354423333 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f05380095b0 con 0x7f05401653e0 2019-11-28T11:40:19.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:19.142+0000 7f0546a38700 1 -- 172.21.15.80:0/2354423333 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0540156d50 con 0x7f05401653e0 2019-11-28T11:40:19.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:19.142+0000 7f05457d6700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05401653e0 0x7f05401205d0 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f05380103c0 tx=0x7f05380101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:19.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:19.142+0000 7f053d7fa700 1 -- 172.21.15.80:0/2354423333 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f0538009a50 con 0x7f05401653e0 2019-11-28T11:40:19.177 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:19.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:19.145+0000 7f0546a38700 1 -- 172.21.15.80:0/2354423333 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0524018770 msgr2=0x7f052401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:19.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:19.145+0000 7f0546a38700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0524018770 0x7f052401abe0 crc :-1 s=READY pgs=529 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:19.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:19.145+0000 7f0546a38700 1 -- 172.21.15.80:0/2354423333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05401653e0 msgr2=0x7f05401205d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:19.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:19.145+0000 7f0546a38700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05401653e0 0x7f05401205d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rx=0x7f05380103c0 tx=0x7f05380101f0).stop 2019-11-28T11:40:19.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:19.145+0000 7f0546a38700 1 -- 172.21.15.80:0/2354423333 shutdown_connections 2019-11-28T11:40:19.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:19.145+0000 7f0546a38700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0524018770 0x7f052401abe0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:19.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:19.145+0000 7f0546a38700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05401653e0 0x7f05401205d0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:19.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:19.145+0000 7f0546a38700 1 --2- 172.21.15.80:0/2354423333 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0540164a10 0x7f0540164ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:19.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:19.145+0000 7f0546a38700 1 -- 172.21.15.80:0/2354423333 shutdown_connections 2019-11-28T11:40:19.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:19.145+0000 7f0546a38700 1 -- 172.21.15.80:0/2354423333 wait complete. 2019-11-28T11:40:19.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:19.145+0000 7f0546a38700 1 -- 172.21.15.80:0/2354423333 >> 172.21.15.80:0/2354423333 conn(0x7f05401426c0 msgr2=0x7f0540110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:19.179 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:19.179 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:19.187 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:20.194 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:20.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.298+0000 7fed7ddc2700 1 Processor -- start 2019-11-28T11:40:20.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.298+0000 7fed7ddc2700 1 -- start start 2019-11-28T11:40:20.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.299+0000 7fed7ddc2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7806c0a0 0x7fed78072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:20.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.299+0000 7fed7ddc2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fed780734e0 0x7fed78071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:20.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.299+0000 7fed7ddc2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed78072360 0x7fed780727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:20.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.299+0000 7fed7ddc2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7806f330 con 0x7fed78072360 2019-11-28T11:40:20.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.299+0000 7fed7ddc2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed780706c0 con 0x7fed780734e0 2019-11-28T11:40:20.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.299+0000 7fed7ddc2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed78070a40 con 0x7fed7806c0a0 2019-11-28T11:40:20.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed7cb60700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed78072360 0x7fed780727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:20.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed7cb60700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed78072360 0x7fed780727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37754/0 (socket says 172.21.15.80:37754) 2019-11-28T11:40:20.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed7cb60700 1 -- 172.21.15.80:0/1637146821 learned_addr learned my addr 172.21.15.80:0/1637146821 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:20.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed77fff700 1 --2- 172.21.15.80:0/1637146821 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7806c0a0 0x7fed78072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:20.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed6ffff700 1 --2- 172.21.15.80:0/1637146821 >> v2:172.21.15.174:3300/0 conn(0x7fed780734e0 0x7fed78071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:20.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed7cb60700 1 -- 172.21.15.80:0/1637146821 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7806c0a0 msgr2=0x7fed78072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:20.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed7cb60700 1 --2- 172.21.15.80:0/1637146821 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7806c0a0 0x7fed78072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:20.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed7cb60700 1 -- 172.21.15.80:0/1637146821 >> v2:172.21.15.174:3300/0 conn(0x7fed780734e0 msgr2=0x7fed78071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:20.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed7cb60700 1 --2- 172.21.15.80:0/1637146821 >> v2:172.21.15.174:3300/0 conn(0x7fed780734e0 0x7fed78071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:20.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed7cb60700 1 -- 172.21.15.80:0/1637146821 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7806db00 con 0x7fed78072360 2019-11-28T11:40:20.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed6ffff700 1 --2- 172.21.15.80:0/1637146821 >> v2:172.21.15.174:3300/0 conn(0x7fed780734e0 0x7fed78071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:40:20.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed7cb60700 1 --2- 172.21.15.80:0/1637146821 >> v2:172.21.15.80:3300/0 conn(0x7fed78072360 0x7fed780727e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fed7000fa30 tx=0x7fed7000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:20.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed7cb60700 1 --2- 172.21.15.80:0/1637146821 >> v2:172.21.15.80:3300/0 conn(0x7fed78072360 0x7fed780727e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fed7000fa30 tx=0x7fed7000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:20.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed7cb60700 1 --2- 172.21.15.80:0/1637146821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed78072360 0x7fed780727e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rx=0x7fed7000fa30 tx=0x7fed7000fdd0).ready entity=mon.0 client_cookie=2e6cf5732d197f29 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:20.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed7cb60700 1 --2- 172.21.15.80:0/1637146821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed78072360 0x7fed780727e0 secure :-1 s=THROTTLE_DONE pgs=1282 cs=0 l=1 rx=0x7fed7000fa30 tx=0x7fed7000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:20.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed7cb60700 1 --2- 172.21.15.80:0/1637146821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed78072360 0x7fed780727e0 secure :-1 s=THROTTLE_DONE pgs=1282 cs=0 l=1 rx=0x7fed7000fa30 tx=0x7fed7000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:20.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed777fe700 1 -- 172.21.15.80:0/1637146821 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed70001460 con 0x7fed78072360 2019-11-28T11:40:20.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed7cb60700 1 --2- 172.21.15.80:0/1637146821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed78072360 0x7fed780727e0 secure :-1 s=THROTTLE_DONE pgs=1282 cs=0 l=1 rx=0x7fed7000fa30 tx=0x7fed7000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:20.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed777fe700 1 -- 172.21.15.80:0/1637146821 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed70000f10 con 0x7fed78072360 2019-11-28T11:40:20.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed777fe700 1 -- 172.21.15.80:0/1637146821 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed70001a40 con 0x7fed78072360 2019-11-28T11:40:20.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed7ddc2700 1 -- 172.21.15.80:0/1637146821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed78072360 msgr2=0x7fed780727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:20.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.300+0000 7fed7ddc2700 1 --2- 172.21.15.80:0/1637146821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed78072360 0x7fed780727e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rx=0x7fed7000fa30 tx=0x7fed7000fdd0).stop 2019-11-28T11:40:20.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.301+0000 7fed7ddc2700 1 -- 172.21.15.80:0/1637146821 shutdown_connections 2019-11-28T11:40:20.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.301+0000 7fed7ddc2700 1 --2- 172.21.15.80:0/1637146821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed78072360 0x7fed780727e0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:20.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.301+0000 7fed7ddc2700 1 --2- 172.21.15.80:0/1637146821 >> v2:172.21.15.174:3300/0 conn(0x7fed780734e0 0x7fed78071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:20.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.301+0000 7fed7ddc2700 1 --2- 172.21.15.80:0/1637146821 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7806c0a0 0x7fed78072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:20.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.301+0000 7fed7ddc2700 1 -- 172.21.15.80:0/1637146821 shutdown_connections 2019-11-28T11:40:20.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.301+0000 7fed7ddc2700 1 -- 172.21.15.80:0/1637146821 wait complete. 2019-11-28T11:40:20.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.301+0000 7fed7ddc2700 1 -- 172.21.15.80:0/1637146821 >> 172.21.15.80:0/1637146821 conn(0x7fed78061cf0 msgr2=0x7fed78064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.303+0000 7fed7ddc2700 1 Processor -- start 2019-11-28T11:40:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.303+0000 7fed7ddc2700 1 -- start start 2019-11-28T11:40:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.304+0000 7fed7ddc2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7813e9e0 0x7fed78108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:20.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.304+0000 7fed7ddc2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed781066e0 con 0x7fed7813e5f0 2019-11-28T11:40:20.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.304+0000 7fed7ddc2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed7810ce40 con 0x7fed78109430 2019-11-28T11:40:20.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.304+0000 7fed7ddc2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7810e060 con 0x7fed7813e9e0 2019-11-28T11:40:20.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.304+0000 7fed77fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fed7813e5f0 0x7fed7810a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37072/0 (socket says 172.21.15.80:37072) 2019-11-28T11:40:20.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.304+0000 7fed77fff700 1 -- 172.21.15.80:0/1398159489 learned_addr learned my addr 172.21.15.80:0/1398159489 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:20.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed6ffff700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7813e9e0 0x7fed78108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:20.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed757fa700 1 -- 172.21.15.80:0/1398159489 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997910244 0 0) 0x7fed68000f30 con 0x7fed7813e5f0 2019-11-28T11:40:20.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed757fa700 1 -- 172.21.15.80:0/1398159489 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed5c002e80 con 0x7fed7813e5f0 2019-11-28T11:40:20.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed757fa700 1 -- 172.21.15.80:0/1398159489 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897744257 0 0) 0x7fed70000f10 con 0x7fed78109430 2019-11-28T11:40:20.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed757fa700 1 -- 172.21.15.80:0/1398159489 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed5c0030b0 con 0x7fed78109430 2019-11-28T11:40:20.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed6ffff700 1 -- 172.21.15.80:0/1398159489 >> v1:172.21.15.174:6789/0 conn(0x7fed78109430 legacy=0x7fed78168ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:20.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed6ffff700 1 -- 172.21.15.80:0/1398159489 >> v1:172.21.15.80:6789/0 conn(0x7fed7813e5f0 legacy=0x7fed7810a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:20.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed757fa700 1 -- 172.21.15.80:0/1398159489 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3425289910 0 0) 0x7fed680010a0 con 0x7fed7813e5f0 2019-11-28T11:40:20.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed6ffff700 1 -- 172.21.15.80:0/1398159489 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7810e9c0 con 0x7fed7813e9e0 2019-11-28T11:40:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed6ffff700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7813e9e0 0x7fed78108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fed60010350 tx=0x7fed600106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed6ffff700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7813e9e0 0x7fed78108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fed60010350 tx=0x7fed600106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed6ffff700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7813e9e0 0x7fed78108ef0 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7fed60010350 tx=0x7fed600106f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed6ffff700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7813e9e0 0x7fed78108ef0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fed60010350 tx=0x7fed600106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed757fa700 1 -- 172.21.15.80:0/1398159489 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed60000db0 con 0x7fed7813e9e0 2019-11-28T11:40:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed6ffff700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7813e9e0 0x7fed78108ef0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fed60010350 tx=0x7fed600106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed757fa700 1 -- 172.21.15.80:0/1398159489 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed600097a0 con 0x7fed7813e9e0 2019-11-28T11:40:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed7ddc2700 1 -- 172.21.15.80:0/1398159489 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7810ed40 con 0x7fed7813e9e0 2019-11-28T11:40:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed6ffff700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7813e9e0 0x7fed78108ef0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fed60010350 tx=0x7fed600106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed757fa700 1 -- 172.21.15.80:0/1398159489 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed60000fa0 con 0x7fed7813e9e0 2019-11-28T11:40:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.305+0000 7fed7ddc2700 1 -- 172.21.15.80:0/1398159489 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7810e9c0 con 0x7fed7813e9e0 2019-11-28T11:40:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.306+0000 7fed6ffff700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7813e9e0 0x7fed78108ef0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fed60010350 tx=0x7fed600106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.306+0000 7fed6ffff700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7813e9e0 0x7fed78108ef0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fed60010350 tx=0x7fed600106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.306+0000 7fed757fa700 1 -- 172.21.15.80:0/1398159489 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fed60000bc0 con 0x7fed7813e9e0 2019-11-28T11:40:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.306+0000 7fed757fa700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed5c018720 0x7fed5c01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.306+0000 7fed757fa700 1 -- 172.21.15.80:0/1398159489 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fed60031ab0 con 0x7fed7813e9e0 2019-11-28T11:40:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.306+0000 7fed77fff700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed5c018720 0x7fed5c01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.307+0000 7fed77fff700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed5c018720 0x7fed5c01abf0 crc :-1 s=READY pgs=530 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.313+0000 7fed7ddc2700 1 -- 172.21.15.80:0/1398159489 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7810ed40 con 0x7fed7813e9e0 2019-11-28T11:40:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.318+0000 7fed6ffff700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7813e9e0 0x7fed78108ef0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fed60010350 tx=0x7fed600106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.318+0000 7fed757fa700 1 -- 172.21.15.80:0/1398159489 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fed60000940 con 0x7fed7813e9e0 2019-11-28T11:40:20.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.488+0000 7fed7ddc2700 1 -- 172.21.15.80:0/1398159489 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed7810e9c0 con 0x7fed7813e9e0 2019-11-28T11:40:20.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.490+0000 7fed6ffff700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7813e9e0 0x7fed78108ef0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fed60010350 tx=0x7fed600106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:20.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.490+0000 7fed757fa700 1 -- 172.21.15.80:0/1398159489 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fed60000b50 con 0x7fed7813e9e0 2019-11-28T11:40:20.522 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:20.522 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:20.522 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:20.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.491+0000 7fed7ddc2700 1 -- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed5c018720 msgr2=0x7fed5c01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:20.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.491+0000 7fed7ddc2700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed5c018720 0x7fed5c01abf0 crc :-1 s=READY pgs=530 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:20.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.491+0000 7fed7ddc2700 1 -- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7813e9e0 msgr2=0x7fed78108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:20.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.491+0000 7fed7ddc2700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7813e9e0 0x7fed78108ef0 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7fed60010350 tx=0x7fed600106f0).stop 2019-11-28T11:40:20.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.491+0000 7fed7ddc2700 1 -- 172.21.15.80:0/1398159489 shutdown_connections 2019-11-28T11:40:20.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.491+0000 7fed7ddc2700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed5c018720 0x7fed5c01abf0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:20.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.491+0000 7fed7ddc2700 1 --2- 172.21.15.80:0/1398159489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7813e9e0 0x7fed78108ef0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:20.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.491+0000 7fed7ddc2700 1 -- 172.21.15.80:0/1398159489 shutdown_connections 2019-11-28T11:40:20.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.491+0000 7fed7ddc2700 1 -- 172.21.15.80:0/1398159489 wait complete. 2019-11-28T11:40:20.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:20.491+0000 7fed7ddc2700 1 -- 172.21.15.80:0/1398159489 >> 172.21.15.80:0/1398159489 conn(0x7fed7813d620 msgr2=0x7fed7813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:20.533 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:21.534 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:21.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.632+0000 7f43506fe700 1 Processor -- start 2019-11-28T11:40:21.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.632+0000 7f43506fe700 1 -- start start 2019-11-28T11:40:21.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.633+0000 7f43506fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f434806c490 0x7f434806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:21.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.633+0000 7f43506fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f434806ce60 0x7f4348164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:21.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.633+0000 7f43506fe700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f434806db00 con 0x7f434806c0a0 2019-11-28T11:40:21.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.633+0000 7f43506fe700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f434806fd60 con 0x7f434806ce60 2019-11-28T11:40:21.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.633+0000 7f43506fe700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4348070030 con 0x7f434806c490 2019-11-28T11:40:21.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.634+0000 7f434f49c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f434806ce60 0x7f4348164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:21.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.634+0000 7f434e49a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f434806c490 0x7f434806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:21.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.634+0000 7f434f49c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f434806ce60 0x7f4348164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:52652/0 (socket says 172.21.15.80:52652) 2019-11-28T11:40:21.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.634+0000 7f434f49c700 1 -- 172.21.15.80:0/1111970232 learned_addr learned my addr 172.21.15.80:0/1111970232 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:21.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.634+0000 7f434e49a700 1 -- 172.21.15.80:0/1111970232 >> v2:172.21.15.174:3300/0 conn(0x7f434806ce60 msgr2=0x7f4348164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:21.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.634+0000 7f434e49a700 1 --2- 172.21.15.80:0/1111970232 >> v2:172.21.15.174:3300/0 conn(0x7f434806ce60 0x7f4348164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:21.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.634+0000 7f434e49a700 1 -- 172.21.15.80:0/1111970232 >> v1:172.21.15.174:6789/0 conn(0x7f434806c0a0 legacy=0x7f4348072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:21.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.634+0000 7f434e49a700 1 -- 172.21.15.80:0/1111970232 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43480706c0 con 0x7f434806c490 2019-11-28T11:40:21.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.634+0000 7f434e49a700 1 --2- 172.21.15.80:0/1111970232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f434806c490 0x7f434806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f433c00af50 tx=0x7f433c00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:21.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.634+0000 7f434e49a700 1 --2- 172.21.15.80:0/1111970232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f434806c490 0x7f434806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f433c00af50 tx=0x7f433c00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:21.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.634+0000 7f434e49a700 1 --2- 172.21.15.80:0/1111970232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f434806c490 0x7f434806c920 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f433c00af50 tx=0x7f433c00b250).ready entity=mon.2 client_cookie=ac5713d0e0526b62 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:21.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.635+0000 7f434e49a700 1 --2- 172.21.15.80:0/1111970232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f434806c490 0x7f434806c920 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f433c00af50 tx=0x7f433c00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:21.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.635+0000 7f434e49a700 1 --2- 172.21.15.80:0/1111970232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f434806c490 0x7f434806c920 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f433c00af50 tx=0x7f433c00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:21.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.635+0000 7f434dc99700 1 -- 172.21.15.80:0/1111970232 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f433c007210 con 0x7f434806c490 2019-11-28T11:40:21.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.635+0000 7f434e49a700 1 --2- 172.21.15.80:0/1111970232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f434806c490 0x7f434806c920 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f433c00af50 tx=0x7f433c00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:21.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.635+0000 7f434dc99700 1 -- 172.21.15.80:0/1111970232 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c0099b0 con 0x7f434806c490 2019-11-28T11:40:21.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.635+0000 7f434dc99700 1 -- 172.21.15.80:0/1111970232 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f433c00a080 con 0x7f434806c490 2019-11-28T11:40:21.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.635+0000 7f43506fe700 1 -- 172.21.15.80:0/1111970232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f434806c490 msgr2=0x7f434806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:21.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.635+0000 7f43506fe700 1 --2- 172.21.15.80:0/1111970232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f434806c490 0x7f434806c920 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f433c00af50 tx=0x7f433c00b250).stop 2019-11-28T11:40:21.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.635+0000 7f43506fe700 1 -- 172.21.15.80:0/1111970232 shutdown_connections 2019-11-28T11:40:21.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.635+0000 7f43506fe700 1 --2- 172.21.15.80:0/1111970232 >> v2:172.21.15.174:3300/0 conn(0x7f434806ce60 0x7f4348164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:21.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.635+0000 7f43506fe700 1 --2- 172.21.15.80:0/1111970232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f434806c490 0x7f434806c920 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:21.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.635+0000 7f43506fe700 1 -- 172.21.15.80:0/1111970232 shutdown_connections 2019-11-28T11:40:21.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.635+0000 7f43506fe700 1 -- 172.21.15.80:0/1111970232 wait complete. 2019-11-28T11:40:21.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.635+0000 7f43506fe700 1 -- 172.21.15.80:0/1111970232 >> 172.21.15.80:0/1111970232 conn(0x7f4348061cf0 msgr2=0x7f4348064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:21.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.638+0000 7f43506fe700 1 Processor -- start 2019-11-28T11:40:21.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.638+0000 7f43506fe700 1 -- start start 2019-11-28T11:40:21.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f43506fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f434813dc00 0x7f4348109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:21.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f43506fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f434810a3a0 0x7f4348108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:21.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f43506fe700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43481312c0 con 0x7f4348109220 2019-11-28T11:40:21.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f43506fe700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4348105830 con 0x7f434813dc00 2019-11-28T11:40:21.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f43506fe700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4348105b00 con 0x7f434810a3a0 2019-11-28T11:40:21.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f434ec9b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f434813dc00 0x7f4348109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:21.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f434ec9b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f434813dc00 0x7f4348109e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37770/0 (socket says 172.21.15.80:37770) 2019-11-28T11:40:21.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f434ec9b700 1 -- 172.21.15.80:0/2431828946 learned_addr learned my addr 172.21.15.80:0/2431828946 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:21.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f434f49c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4348109220 0x7f4348103000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37090/0 (socket says 172.21.15.80:37090) 2019-11-28T11:40:21.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f434e49a700 1 --2- 172.21.15.80:0/2431828946 >> v2:172.21.15.174:3300/0 conn(0x7f434810a3a0 0x7f4348108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:21.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f434ec9b700 1 -- 172.21.15.80:0/2431828946 >> v2:172.21.15.174:3300/0 conn(0x7f434810a3a0 msgr2=0x7f4348108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:21.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f434ec9b700 1 --2- 172.21.15.80:0/2431828946 >> v2:172.21.15.174:3300/0 conn(0x7f434810a3a0 0x7f4348108ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:21.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f434ec9b700 1 -- 172.21.15.80:0/2431828946 >> v1:172.21.15.80:6789/0 conn(0x7f4348109220 legacy=0x7f4348103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:21.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f434ec9b700 1 -- 172.21.15.80:0/2431828946 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4348106190 con 0x7f434813dc00 2019-11-28T11:40:21.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f43477fe700 1 -- 172.21.15.80:0/2431828946 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530556541 0 0) 0x7f4340001080 con 0x7f4348109220 2019-11-28T11:40:21.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f434ec9b700 1 --2- 172.21.15.80:0/2431828946 >> v2:172.21.15.80:3300/0 conn(0x7f434813dc00 0x7f4348109e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4338010790 tx=0x7f43380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:21.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f434ec9b700 1 --2- 172.21.15.80:0/2431828946 >> v2:172.21.15.80:3300/0 conn(0x7f434813dc00 0x7f4348109e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4338010790 tx=0x7f43380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:21.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f434ec9b700 1 --2- 172.21.15.80:0/2431828946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f434813dc00 0x7f4348109e60 secure :-1 s=READY pgs=1285 cs=0 l=1 rx=0x7f4338010790 tx=0x7f43380105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:21.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f434ec9b700 1 --2- 172.21.15.80:0/2431828946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f434813dc00 0x7f4348109e60 secure :-1 s=THROTTLE_DONE pgs=1285 cs=0 l=1 rx=0x7f4338010790 tx=0x7f43380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:21.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.639+0000 7f43477fe700 1 -- 172.21.15.80:0/2431828946 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4338000ce0 con 0x7f434813dc00 2019-11-28T11:40:21.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.640+0000 7f434ec9b700 1 --2- 172.21.15.80:0/2431828946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f434813dc00 0x7f4348109e60 secure :-1 s=THROTTLE_DONE pgs=1285 cs=0 l=1 rx=0x7f4338010790 tx=0x7f43380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:21.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.640+0000 7f43477fe700 1 -- 172.21.15.80:0/2431828946 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4338001420 con 0x7f434813dc00 2019-11-28T11:40:21.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.640+0000 7f434ec9b700 1 --2- 172.21.15.80:0/2431828946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f434813dc00 0x7f4348109e60 secure :-1 s=THROTTLE_DONE pgs=1285 cs=0 l=1 rx=0x7f4338010790 tx=0x7f43380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:21.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.640+0000 7f43477fe700 1 -- 172.21.15.80:0/2431828946 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4338001610 con 0x7f434813dc00 2019-11-28T11:40:21.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.640+0000 7f43506fe700 1 -- 172.21.15.80:0/2431828946 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4348106510 con 0x7f434813dc00 2019-11-28T11:40:21.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.640+0000 7f43506fe700 1 -- 172.21.15.80:0/2431828946 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4348106190 con 0x7f434813dc00 2019-11-28T11:40:21.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.640+0000 7f434ec9b700 1 --2- 172.21.15.80:0/2431828946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f434813dc00 0x7f4348109e60 secure :-1 s=THROTTLE_DONE pgs=1285 cs=0 l=1 rx=0x7f4338010790 tx=0x7f43380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:21.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.640+0000 7f43477fe700 1 -- 172.21.15.80:0/2431828946 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4338001610 con 0x7f434813dc00 2019-11-28T11:40:21.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.640+0000 7f434ec9b700 1 --2- 172.21.15.80:0/2431828946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f434813dc00 0x7f4348109e60 secure :-1 s=THROTTLE_DONE pgs=1285 cs=0 l=1 rx=0x7f4338010790 tx=0x7f43380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:21.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.640+0000 7f43477fe700 1 --2- 172.21.15.80:0/2431828946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4328018730 0x7f432801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:21.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.640+0000 7f43477fe700 1 -- 172.21.15.80:0/2431828946 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f4338031e40 con 0x7f434813dc00 2019-11-28T11:40:21.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.641+0000 7f434e49a700 1 --2- 172.21.15.80:0/2431828946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4328018730 0x7f432801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:21.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.641+0000 7f434e49a700 1 --2- 172.21.15.80:0/2431828946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4328018730 0x7f432801abc0 crc :-1 s=READY pgs=531 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:21.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.648+0000 7f43506fe700 1 -- 172.21.15.80:0/2431828946 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4348106510 con 0x7f434813dc00 2019-11-28T11:40:21.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.651+0000 7f434ec9b700 1 --2- 172.21.15.80:0/2431828946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f434813dc00 0x7f4348109e60 secure :-1 s=THROTTLE_DONE pgs=1285 cs=0 l=1 rx=0x7f4338010790 tx=0x7f43380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:21.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.651+0000 7f43477fe700 1 -- 172.21.15.80:0/2431828946 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4338007930 con 0x7f434813dc00 2019-11-28T11:40:21.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.827+0000 7f43506fe700 1 -- 172.21.15.80:0/2431828946 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4348106190 con 0x7f434813dc00 2019-11-28T11:40:21.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.827+0000 7f434ec9b700 1 --2- 172.21.15.80:0/2431828946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f434813dc00 0x7f4348109e60 secure :-1 s=THROTTLE_DONE pgs=1285 cs=0 l=1 rx=0x7f4338010790 tx=0x7f43380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:21.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.827+0000 7f43477fe700 1 -- 172.21.15.80:0/2431828946 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f4338000f90 con 0x7f434813dc00 2019-11-28T11:40:21.870 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:21.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.829+0000 7f43506fe700 1 -- 172.21.15.80:0/2431828946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4328018730 msgr2=0x7f432801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:21.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.829+0000 7f43506fe700 1 --2- 172.21.15.80:0/2431828946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4328018730 0x7f432801abc0 crc :-1 s=READY pgs=531 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:21.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.829+0000 7f43506fe700 1 -- 172.21.15.80:0/2431828946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f434813dc00 msgr2=0x7f4348109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:21.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.829+0000 7f43506fe700 1 --2- 172.21.15.80:0/2431828946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f434813dc00 0x7f4348109e60 secure :-1 s=READY pgs=1285 cs=0 l=1 rx=0x7f4338010790 tx=0x7f43380105f0).stop 2019-11-28T11:40:21.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.830+0000 7f43506fe700 1 -- 172.21.15.80:0/2431828946 shutdown_connections 2019-11-28T11:40:21.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.830+0000 7f43506fe700 1 --2- 172.21.15.80:0/2431828946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4328018730 0x7f432801abc0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:21.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.830+0000 7f43506fe700 1 --2- 172.21.15.80:0/2431828946 >> v2:172.21.15.174:3300/0 conn(0x7f434810a3a0 0x7f4348108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:21.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.830+0000 7f43506fe700 1 --2- 172.21.15.80:0/2431828946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f434813dc00 0x7f4348109e60 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:21.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.830+0000 7f43506fe700 1 -- 172.21.15.80:0/2431828946 shutdown_connections 2019-11-28T11:40:21.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.830+0000 7f43506fe700 1 -- 172.21.15.80:0/2431828946 wait complete. 2019-11-28T11:40:21.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:21.830+0000 7f43506fe700 1 -- 172.21.15.80:0/2431828946 >> 172.21.15.80:0/2431828946 conn(0x7f434811bfc0 msgr2=0x7f4348141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:21.873 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:21.873 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:21.874 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:22.876 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:23.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.964+0000 7efeb87be700 1 Processor -- start 2019-11-28T11:40:23.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.964+0000 7efeb87be700 1 -- start start 2019-11-28T11:40:23.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.965+0000 7efeb87be700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efeb006c0a0 0x7efeb0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:23.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.965+0000 7efeb87be700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efeb0072620 0x7efeb0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:23.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.965+0000 7efeb87be700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb006db00 con 0x7efeb00734e0 2019-11-28T11:40:23.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.965+0000 7efeb87be700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb006fd60 con 0x7efeb006c0a0 2019-11-28T11:40:23.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.965+0000 7efeb87be700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb0070030 con 0x7efeb0072620 2019-11-28T11:40:23.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.965+0000 7efeb6d5b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efeb006c0a0 0x7efeb0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:23.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.965+0000 7efeb6d5b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efeb006c0a0 0x7efeb0072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37778/0 (socket says 172.21.15.80:37778) 2019-11-28T11:40:23.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.965+0000 7efeb6d5b700 1 -- 172.21.15.80:0/1694110991 learned_addr learned my addr 172.21.15.80:0/1694110991 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:23.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.965+0000 7efeb755c700 1 --2- 172.21.15.80:0/1694110991 >> v2:172.21.15.174:3300/0 conn(0x7efeb0072620 0x7efeb0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:23.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.966+0000 7efeb6d5b700 1 -- 172.21.15.80:0/1694110991 >> v2:172.21.15.174:3300/0 conn(0x7efeb0072620 msgr2=0x7efeb0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:23.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.966+0000 7efeb6d5b700 1 --2- 172.21.15.80:0/1694110991 >> v2:172.21.15.174:3300/0 conn(0x7efeb0072620 0x7efeb0164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:23.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.966+0000 7efeb6d5b700 1 -- 172.21.15.80:0/1694110991 >> v1:172.21.15.174:6789/0 conn(0x7efeb00734e0 legacy=0x7efeb0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:23.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.966+0000 7efeb6d5b700 1 -- 172.21.15.80:0/1694110991 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb00706c0 con 0x7efeb006c0a0 2019-11-28T11:40:23.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.966+0000 7efeb6d5b700 1 --2- 172.21.15.80:0/1694110991 >> v2:172.21.15.80:3300/0 conn(0x7efeb006c0a0 0x7efeb0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efe9800fa40 tx=0x7efe9800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:23.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.966+0000 7efeb6d5b700 1 --2- 172.21.15.80:0/1694110991 >> v2:172.21.15.80:3300/0 conn(0x7efeb006c0a0 0x7efeb0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efe9800fa40 tx=0x7efe9800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:23.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.966+0000 7efeb6d5b700 1 --2- 172.21.15.80:0/1694110991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb006c0a0 0x7efeb0072fa0 secure :-1 s=READY pgs=1286 cs=0 l=1 rx=0x7efe9800fa40 tx=0x7efe9800fde0).ready entity=mon.0 client_cookie=4e9d3fb93113fe4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:23.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.966+0000 7efeb6d5b700 1 --2- 172.21.15.80:0/1694110991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb006c0a0 0x7efeb0072fa0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7efe9800fa40 tx=0x7efe9800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:23.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.966+0000 7efeb6d5b700 1 --2- 172.21.15.80:0/1694110991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb006c0a0 0x7efeb0072fa0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7efe9800fa40 tx=0x7efe9800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:23.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.966+0000 7efeb6d5b700 1 --2- 172.21.15.80:0/1694110991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb006c0a0 0x7efeb0072fa0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7efe9800fa40 tx=0x7efe9800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:23.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.966+0000 7efeb5d59700 1 -- 172.21.15.80:0/1694110991 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe98000ce0 con 0x7efeb006c0a0 2019-11-28T11:40:23.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.966+0000 7efeb5d59700 1 -- 172.21.15.80:0/1694110991 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe98001010 con 0x7efeb006c0a0 2019-11-28T11:40:23.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.966+0000 7efeb5d59700 1 -- 172.21.15.80:0/1694110991 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe98001720 con 0x7efeb006c0a0 2019-11-28T11:40:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.966+0000 7efeb87be700 1 -- 172.21.15.80:0/1694110991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb006c0a0 msgr2=0x7efeb0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.966+0000 7efeb87be700 1 --2- 172.21.15.80:0/1694110991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb006c0a0 0x7efeb0072fa0 secure :-1 s=READY pgs=1286 cs=0 l=1 rx=0x7efe9800fa40 tx=0x7efe9800fde0).stop 2019-11-28T11:40:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.967+0000 7efeb87be700 1 -- 172.21.15.80:0/1694110991 shutdown_connections 2019-11-28T11:40:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.967+0000 7efeb87be700 1 --2- 172.21.15.80:0/1694110991 >> v2:172.21.15.174:3300/0 conn(0x7efeb0072620 0x7efeb0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.967+0000 7efeb87be700 1 --2- 172.21.15.80:0/1694110991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb006c0a0 0x7efeb0072fa0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.967+0000 7efeb87be700 1 -- 172.21.15.80:0/1694110991 shutdown_connections 2019-11-28T11:40:23.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.967+0000 7efeb87be700 1 -- 172.21.15.80:0/1694110991 wait complete. 2019-11-28T11:40:23.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.967+0000 7efeb87be700 1 -- 172.21.15.80:0/1694110991 >> 172.21.15.80:0/1694110991 conn(0x7efeb0061cf0 msgr2=0x7efeb0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:23.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.969+0000 7efeb87be700 1 Processor -- start 2019-11-28T11:40:23.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.969+0000 7efeb87be700 1 -- start start 2019-11-28T11:40:23.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.970+0000 7efeb87be700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efeb0104c10 0x7efeb01050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:23.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.970+0000 7efeb87be700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efeb01055e0 0x7efeb0167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:23.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.970+0000 7efeb87be700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb0105a30 con 0x7efeb0104820 2019-11-28T11:40:23.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.970+0000 7efeb87be700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb0109130 con 0x7efeb01055e0 2019-11-28T11:40:23.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.970+0000 7efeb87be700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0109400 con 0x7efeb0104c10 2019-11-28T11:40:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.970+0000 7efeb6d5b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efeb0104820 0x7efeb010c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37100/0 (socket says 172.21.15.80:37100) 2019-11-28T11:40:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.970+0000 7efeb6d5b700 1 -- 172.21.15.80:0/3506086644 learned_addr learned my addr 172.21.15.80:0/3506086644 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.970+0000 7efeb755c700 1 --2- 172.21.15.80:0/3506086644 >> v2:172.21.15.80:3300/0 conn(0x7efeb01055e0 0x7efeb0167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.970+0000 7efeb655a700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efeb0104c10 0x7efeb01050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.970+0000 7efeaf7fe700 1 -- 172.21.15.80:0/3506086644 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003577622 0 0) 0x7efe98007950 con 0x7efeb0104820 2019-11-28T11:40:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.970+0000 7efeaf7fe700 1 -- 172.21.15.80:0/3506086644 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe94002e80 con 0x7efeb0104820 2019-11-28T11:40:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.970+0000 7efeb755c700 1 -- 172.21.15.80:0/3506086644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efeb0104c10 msgr2=0x7efeb01050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.970+0000 7efeb755c700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efeb0104c10 0x7efeb01050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.970+0000 7efeb755c700 1 -- 172.21.15.80:0/3506086644 >> v1:172.21.15.80:6789/0 conn(0x7efeb0104820 legacy=0x7efeb010c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.970+0000 7efeb755c700 1 -- 172.21.15.80:0/3506086644 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb0109a90 con 0x7efeb01055e0 2019-11-28T11:40:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.971+0000 7efeb755c700 1 --2- 172.21.15.80:0/3506086644 >> v2:172.21.15.80:3300/0 conn(0x7efeb01055e0 0x7efeb0167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efea8010390 tx=0x7efea8010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.971+0000 7efeb755c700 1 --2- 172.21.15.80:0/3506086644 >> v2:172.21.15.80:3300/0 conn(0x7efeb01055e0 0x7efeb0167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efea8010390 tx=0x7efea8010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.971+0000 7efeb755c700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb01055e0 0x7efeb0167a10 secure :-1 s=READY pgs=1288 cs=0 l=1 rx=0x7efea8010390 tx=0x7efea8010240).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.971+0000 7efeb755c700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb01055e0 0x7efeb0167a10 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7efea8010390 tx=0x7efea8010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.971+0000 7efeaf7fe700 1 -- 172.21.15.80:0/3506086644 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea8000b10 con 0x7efeb01055e0 2019-11-28T11:40:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.971+0000 7efeb755c700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb01055e0 0x7efeb0167a10 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7efea8010390 tx=0x7efea8010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.971+0000 7efeb755c700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb01055e0 0x7efeb0167a10 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7efea8010390 tx=0x7efea8010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.971+0000 7efeaf7fe700 1 -- 172.21.15.80:0/3506086644 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea800eff0 con 0x7efeb01055e0 2019-11-28T11:40:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.971+0000 7efeb87be700 1 -- 172.21.15.80:0/3506086644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb0109e10 con 0x7efeb01055e0 2019-11-28T11:40:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.971+0000 7efeaf7fe700 1 -- 172.21.15.80:0/3506086644 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea800f700 con 0x7efeb01055e0 2019-11-28T11:40:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.971+0000 7efeb87be700 1 -- 172.21.15.80:0/3506086644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb0109a90 con 0x7efeb01055e0 2019-11-28T11:40:23.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.971+0000 7efeb755c700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb01055e0 0x7efeb0167a10 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7efea8010390 tx=0x7efea8010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:23.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.971+0000 7efeaf7fe700 1 -- 172.21.15.80:0/3506086644 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efea8000a70 con 0x7efeb01055e0 2019-11-28T11:40:23.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.971+0000 7efeb755c700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb01055e0 0x7efeb0167a10 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7efea8010390 tx=0x7efea8010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:23.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.971+0000 7efeaf7fe700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe94018770 0x7efe9401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:23.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.971+0000 7efeaf7fe700 1 -- 172.21.15.80:0/3506086644 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7efea8031a20 con 0x7efeb01055e0 2019-11-28T11:40:23.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.972+0000 7efeb6d5b700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe94018770 0x7efe9401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:23.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.972+0000 7efeb6d5b700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe94018770 0x7efe9401abe0 crc :-1 s=READY pgs=532 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:23.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.979+0000 7efeb87be700 1 -- 172.21.15.80:0/3506086644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb0109e10 con 0x7efeb01055e0 2019-11-28T11:40:23.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.983+0000 7efeb755c700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb01055e0 0x7efeb0167a10 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7efea8010390 tx=0x7efea8010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:23.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:22.983+0000 7efeaf7fe700 1 -- 172.21.15.80:0/3506086644 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efea8000a70 con 0x7efeb01055e0 2019-11-28T11:40:23.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:23.152+0000 7efeb87be700 1 -- 172.21.15.80:0/3506086644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efeb0109a90 con 0x7efeb01055e0 2019-11-28T11:40:23.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:23.153+0000 7efeb755c700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb01055e0 0x7efeb0167a10 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7efea8010390 tx=0x7efea8010240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:23.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:23.153+0000 7efeaf7fe700 1 -- 172.21.15.80:0/3506086644 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7efea8000a70 con 0x7efeb01055e0 2019-11-28T11:40:23.185 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:23.185 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:23.185 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:23.155+0000 7efeb87be700 1 -- 172.21.15.80:0/3506086644 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe94018770 msgr2=0x7efe9401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:23.155+0000 7efeb87be700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe94018770 0x7efe9401abe0 crc :-1 s=READY pgs=532 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:23.155+0000 7efeb87be700 1 -- 172.21.15.80:0/3506086644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb01055e0 msgr2=0x7efeb0167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:23.155+0000 7efeb87be700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb01055e0 0x7efeb0167a10 secure :-1 s=READY pgs=1288 cs=0 l=1 rx=0x7efea8010390 tx=0x7efea8010240).stop 2019-11-28T11:40:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:23.155+0000 7efeb87be700 1 -- 172.21.15.80:0/3506086644 shutdown_connections 2019-11-28T11:40:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:23.155+0000 7efeb87be700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe94018770 0x7efe9401abe0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:23.155+0000 7efeb87be700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeb01055e0 0x7efeb0167a10 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:23.155+0000 7efeb87be700 1 --2- 172.21.15.80:0/3506086644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efeb0104c10 0x7efeb01050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:23.155+0000 7efeb87be700 1 -- 172.21.15.80:0/3506086644 shutdown_connections 2019-11-28T11:40:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:23.155+0000 7efeb87be700 1 -- 172.21.15.80:0/3506086644 wait complete. 2019-11-28T11:40:23.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:23.155+0000 7efeb87be700 1 -- 172.21.15.80:0/3506086644 >> 172.21.15.80:0/3506086644 conn(0x7efeb013d620 msgr2=0x7efeb013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:23.199 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:24.201 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:24.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.289+0000 7f2e9c34a700 1 Processor -- start 2019-11-28T11:40:24.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.289+0000 7f2e9c34a700 1 -- start start 2019-11-28T11:40:24.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.290+0000 7f2e9c34a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e9406c490 0x7f2e9406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:24.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.290+0000 7f2e9c34a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9406db00 con 0x7f2e9406ce60 2019-11-28T11:40:24.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.290+0000 7f2e9c34a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9406e000 con 0x7f2e9406c0a0 2019-11-28T11:40:24.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.290+0000 7f2e9c34a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9406fd60 con 0x7f2e9406c490 2019-11-28T11:40:24.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.290+0000 7f2e9a0e6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e9406c490 0x7f2e9406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:24.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e9a0e6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e9406c490 0x7f2e9406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37796/0 (socket says 172.21.15.80:37796) 2019-11-28T11:40:24.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e9a0e6700 1 -- 172.21.15.80:0/2412514896 learned_addr learned my addr 172.21.15.80:0/2412514896 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:24.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e9b0e8700 1 --1- 172.21.15.80:0/2412514896 >> v1:172.21.15.80:6789/0 conn(0x7f2e9406ce60 0x7f2e94164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37110/0 (socket says 172.21.15.80:37110) 2019-11-28T11:40:24.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e9a0e6700 1 -- 172.21.15.80:0/2412514896 >> v1:172.21.15.174:6789/0 conn(0x7f2e9406c0a0 legacy=0x7f2e94072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:24.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e9a0e6700 1 -- 172.21.15.80:0/2412514896 >> v1:172.21.15.80:6789/0 conn(0x7f2e9406ce60 legacy=0x7f2e94164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:24.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e9a0e6700 1 -- 172.21.15.80:0/2412514896 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e940706c0 con 0x7f2e9406c490 2019-11-28T11:40:24.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e998e5700 1 -- 172.21.15.80:0/2412514896 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246767141 0 0) 0x7f2e8c0009b0 con 0x7f2e9406ce60 2019-11-28T11:40:24.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e9a0e6700 1 --2- 172.21.15.80:0/2412514896 >> v2:172.21.15.80:3300/0 conn(0x7f2e9406c490 0x7f2e9406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2e8400f740 tx=0x7f2e8400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:24.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e9a0e6700 1 --2- 172.21.15.80:0/2412514896 >> v2:172.21.15.80:3300/0 conn(0x7f2e9406c490 0x7f2e9406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2e8400f740 tx=0x7f2e8400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:24.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e9a0e6700 1 --2- 172.21.15.80:0/2412514896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e9406c490 0x7f2e9406c920 secure :-1 s=READY pgs=1290 cs=0 l=1 rx=0x7f2e8400f740 tx=0x7f2e8400fae0).ready entity=mon.0 client_cookie=6b4e7a172d2ac5f6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:24.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e9a0e6700 1 --2- 172.21.15.80:0/2412514896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e9406c490 0x7f2e9406c920 secure :-1 s=THROTTLE_DONE pgs=1290 cs=0 l=1 rx=0x7f2e8400f740 tx=0x7f2e8400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:24.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e998e5700 1 -- 172.21.15.80:0/2412514896 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e84000960 con 0x7f2e9406c490 2019-11-28T11:40:24.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e9a0e6700 1 --2- 172.21.15.80:0/2412514896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e9406c490 0x7f2e9406c920 secure :-1 s=THROTTLE_DONE pgs=1290 cs=0 l=1 rx=0x7f2e8400f740 tx=0x7f2e8400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:24.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e9a0e6700 1 --2- 172.21.15.80:0/2412514896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e9406c490 0x7f2e9406c920 secure :-1 s=THROTTLE_DONE pgs=1290 cs=0 l=1 rx=0x7f2e8400f740 tx=0x7f2e8400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:24.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e998e5700 1 -- 172.21.15.80:0/2412514896 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e84000c90 con 0x7f2e9406c490 2019-11-28T11:40:24.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e998e5700 1 -- 172.21.15.80:0/2412514896 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e84001360 con 0x7f2e9406c490 2019-11-28T11:40:24.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e9c34a700 1 -- 172.21.15.80:0/2412514896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e9406c490 msgr2=0x7f2e9406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:24.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.291+0000 7f2e9c34a700 1 --2- 172.21.15.80:0/2412514896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e9406c490 0x7f2e9406c920 secure :-1 s=READY pgs=1290 cs=0 l=1 rx=0x7f2e8400f740 tx=0x7f2e8400fae0).stop 2019-11-28T11:40:24.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.292+0000 7f2e9c34a700 1 -- 172.21.15.80:0/2412514896 shutdown_connections 2019-11-28T11:40:24.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.292+0000 7f2e9c34a700 1 --2- 172.21.15.80:0/2412514896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e9406c490 0x7f2e9406c920 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:24.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.292+0000 7f2e9c34a700 1 -- 172.21.15.80:0/2412514896 shutdown_connections 2019-11-28T11:40:24.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.292+0000 7f2e9c34a700 1 -- 172.21.15.80:0/2412514896 wait complete. 2019-11-28T11:40:24.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.292+0000 7f2e9c34a700 1 -- 172.21.15.80:0/2412514896 >> 172.21.15.80:0/2412514896 conn(0x7f2e94061cf0 msgr2=0x7f2e94064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:24.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.294+0000 7f2e9c34a700 1 Processor -- start 2019-11-28T11:40:24.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.294+0000 7f2e9c34a700 1 -- start start 2019-11-28T11:40:24.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.295+0000 7f2e9c34a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2e9413f580 0x7f2e94115730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:24.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.295+0000 7f2e9c34a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e94115c70 0x7f2e94121e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:24.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.295+0000 7f2e9c34a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e941223a0 0x7f2e94122840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:24.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.295+0000 7f2e9c34a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e94112550 con 0x7f2e941223a0 2019-11-28T11:40:24.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.295+0000 7f2e9c34a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e94112820 con 0x7f2e9413f580 2019-11-28T11:40:24.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.295+0000 7f2e9c34a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e94124220 con 0x7f2e94115c70 2019-11-28T11:40:24.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.295+0000 7f2e9b0e8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e941223a0 0x7f2e94122840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:24.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.295+0000 7f2e9b0e8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e941223a0 0x7f2e94122840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37800/0 (socket says 172.21.15.80:37800) 2019-11-28T11:40:24.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.295+0000 7f2e9b0e8700 1 -- 172.21.15.80:0/627263370 learned_addr learned my addr 172.21.15.80:0/627263370 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:24.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.295+0000 7f2e9a8e7700 1 --2- 172.21.15.80:0/627263370 >> v2:172.21.15.174:3300/0 conn(0x7f2e9413f580 0x7f2e94115730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:24.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.295+0000 7f2e9a0e6700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e94115c70 0x7f2e94121e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:24.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e9b0e8700 1 -- 172.21.15.80:0/627263370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e94115c70 msgr2=0x7f2e94121e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:24.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e9b0e8700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e94115c70 0x7f2e94121e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:24.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e9b0e8700 1 -- 172.21.15.80:0/627263370 >> v2:172.21.15.174:3300/0 conn(0x7f2e9413f580 msgr2=0x7f2e94115730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:24.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e9b0e8700 1 --2- 172.21.15.80:0/627263370 >> v2:172.21.15.174:3300/0 conn(0x7f2e9413f580 0x7f2e94115730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:24.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e9b0e8700 1 -- 172.21.15.80:0/627263370 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e94112eb0 con 0x7f2e941223a0 2019-11-28T11:40:24.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e9a8e7700 1 --2- 172.21.15.80:0/627263370 >> v2:172.21.15.174:3300/0 conn(0x7f2e9413f580 0x7f2e94115730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:40:24.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e9b0e8700 1 --2- 172.21.15.80:0/627263370 >> v2:172.21.15.80:3300/0 conn(0x7f2e941223a0 0x7f2e94122840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2e8c0103e0 tx=0x7f2e8c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:24.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e9b0e8700 1 --2- 172.21.15.80:0/627263370 >> v2:172.21.15.80:3300/0 conn(0x7f2e941223a0 0x7f2e94122840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2e8c0103e0 tx=0x7f2e8c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:24.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e9b0e8700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e941223a0 0x7f2e94122840 secure :-1 s=READY pgs=1291 cs=0 l=1 rx=0x7f2e8c0103e0 tx=0x7f2e8c010260).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:24.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e9b0e8700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e941223a0 0x7f2e94122840 secure :-1 s=THROTTLE_DONE pgs=1291 cs=0 l=1 rx=0x7f2e8c0103e0 tx=0x7f2e8c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:24.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e9b0e8700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e941223a0 0x7f2e94122840 secure :-1 s=THROTTLE_DONE pgs=1291 cs=0 l=1 rx=0x7f2e8c0103e0 tx=0x7f2e8c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:24.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e937fe700 1 -- 172.21.15.80:0/627263370 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e8c000940 con 0x7f2e941223a0 2019-11-28T11:40:24.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e9b0e8700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e941223a0 0x7f2e94122840 secure :-1 s=THROTTLE_DONE pgs=1291 cs=0 l=1 rx=0x7f2e8c0103e0 tx=0x7f2e8c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:24.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e937fe700 1 -- 172.21.15.80:0/627263370 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c0010e0 con 0x7f2e941223a0 2019-11-28T11:40:24.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e9c34a700 1 -- 172.21.15.80:0/627263370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e94113230 con 0x7f2e941223a0 2019-11-28T11:40:24.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e937fe700 1 -- 172.21.15.80:0/627263370 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e8c0017f0 con 0x7f2e941223a0 2019-11-28T11:40:24.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e9c34a700 1 -- 172.21.15.80:0/627263370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e94112eb0 con 0x7f2e941223a0 2019-11-28T11:40:24.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.296+0000 7f2e9b0e8700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e941223a0 0x7f2e94122840 secure :-1 s=THROTTLE_DONE pgs=1291 cs=0 l=1 rx=0x7f2e8c0103e0 tx=0x7f2e8c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:24.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.297+0000 7f2e937fe700 1 -- 172.21.15.80:0/627263370 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2e8c0012d0 con 0x7f2e941223a0 2019-11-28T11:40:24.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.297+0000 7f2e9b0e8700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e941223a0 0x7f2e94122840 secure :-1 s=THROTTLE_DONE pgs=1291 cs=0 l=1 rx=0x7f2e8c0103e0 tx=0x7f2e8c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:24.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.297+0000 7f2e937fe700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e78018730 0x7f2e7801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:24.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.297+0000 7f2e937fe700 1 -- 172.21.15.80:0/627263370 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f2e8c0319e0 con 0x7f2e941223a0 2019-11-28T11:40:24.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.297+0000 7f2e9a8e7700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e78018730 0x7f2e7801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:24.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.297+0000 7f2e9a8e7700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e78018730 0x7f2e7801abc0 crc :-1 s=READY pgs=533 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:24.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.305+0000 7f2e9c34a700 1 -- 172.21.15.80:0/627263370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e94113230 con 0x7f2e941223a0 2019-11-28T11:40:24.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.308+0000 7f2e9b0e8700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e941223a0 0x7f2e94122840 secure :-1 s=THROTTLE_DONE pgs=1291 cs=0 l=1 rx=0x7f2e8c0103e0 tx=0x7f2e8c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:24.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.308+0000 7f2e937fe700 1 -- 172.21.15.80:0/627263370 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2e8c0075d0 con 0x7f2e941223a0 2019-11-28T11:40:24.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.481+0000 7f2e9c34a700 1 -- 172.21.15.80:0/627263370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e94112eb0 con 0x7f2e941223a0 2019-11-28T11:40:24.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.481+0000 7f2e9b0e8700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e941223a0 0x7f2e94122840 secure :-1 s=THROTTLE_DONE pgs=1291 cs=0 l=1 rx=0x7f2e8c0103e0 tx=0x7f2e8c010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:24.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.481+0000 7f2e937fe700 1 -- 172.21.15.80:0/627263370 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f2e8c0012d0 con 0x7f2e941223a0 2019-11-28T11:40:24.514 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:24.514 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:24.514 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.484+0000 7f2e9c34a700 1 -- 172.21.15.80:0/627263370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e78018730 msgr2=0x7f2e7801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.484+0000 7f2e9c34a700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e78018730 0x7f2e7801abc0 crc :-1 s=READY pgs=533 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.484+0000 7f2e9c34a700 1 -- 172.21.15.80:0/627263370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e941223a0 msgr2=0x7f2e94122840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.484+0000 7f2e9c34a700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e941223a0 0x7f2e94122840 secure :-1 s=READY pgs=1291 cs=0 l=1 rx=0x7f2e8c0103e0 tx=0x7f2e8c010260).stop 2019-11-28T11:40:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.484+0000 7f2e9c34a700 1 -- 172.21.15.80:0/627263370 shutdown_connections 2019-11-28T11:40:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.484+0000 7f2e9c34a700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e78018730 0x7f2e7801abc0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.484+0000 7f2e9c34a700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e941223a0 0x7f2e94122840 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.484+0000 7f2e9c34a700 1 --2- 172.21.15.80:0/627263370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e94115c70 0x7f2e94121e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.484+0000 7f2e9c34a700 1 --2- 172.21.15.80:0/627263370 >> v2:172.21.15.174:3300/0 conn(0x7f2e9413f580 0x7f2e94115730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.484+0000 7f2e9c34a700 1 -- 172.21.15.80:0/627263370 shutdown_connections 2019-11-28T11:40:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.484+0000 7f2e9c34a700 1 -- 172.21.15.80:0/627263370 wait complete. 2019-11-28T11:40:24.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:24.484+0000 7f2e9c34a700 1 -- 172.21.15.80:0/627263370 >> 172.21.15.80:0/627263370 conn(0x7f2e941426c0 msgr2=0x7f2e94110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:24.525 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:24.787 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:40:24.799 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:40:24.812 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:40:24.820 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:40:24.824 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:40:24.828 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:40:25.526 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:25.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.621+0000 7f27ba3f6700 1 Processor -- start 2019-11-28T11:40:25.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.621+0000 7f27ba3f6700 1 -- start start 2019-11-28T11:40:25.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.622+0000 7f27ba3f6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f27b406c0a0 0x7f27b4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:25.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.622+0000 7f27ba3f6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27b4072620 0x7f27b4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:25.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.622+0000 7f27ba3f6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b406db00 con 0x7f27b40734e0 2019-11-28T11:40:25.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.622+0000 7f27ba3f6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b406fd60 con 0x7f27b406c0a0 2019-11-28T11:40:25.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.622+0000 7f27ba3f6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b4070030 con 0x7f27b4072620 2019-11-28T11:40:25.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.622+0000 7f27b3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f27b40734e0 0x7f27b4071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37122/0 (socket says 172.21.15.80:37122) 2019-11-28T11:40:25.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.622+0000 7f27b3fff700 1 -- 172.21.15.80:0/3240446759 learned_addr learned my addr 172.21.15.80:0/3240446759 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:25.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.622+0000 7f27b9194700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27b4072620 0x7f27b4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:25.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.622+0000 7f27b8993700 1 --2- 172.21.15.80:0/3240446759 >> v2:172.21.15.174:3300/0 conn(0x7f27b406c0a0 0x7f27b4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:25.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.622+0000 7f27b37fe700 1 -- 172.21.15.80:0/3240446759 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243759815 0 0) 0x7f27a40014d0 con 0x7f27b40734e0 2019-11-28T11:40:25.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b37fe700 1 -- 172.21.15.80:0/3240446759 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27a0002e80 con 0x7f27b40734e0 2019-11-28T11:40:25.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b37fe700 1 -- 172.21.15.80:0/3240446759 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3324691105 0 0) 0x7f27a40014b0 con 0x7f27b40734e0 2019-11-28T11:40:25.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b37fe700 1 -- 172.21.15.80:0/3240446759 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27b4072620 msgr2=0x7f27b4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:25.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b37fe700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27b4072620 0x7f27b4164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:25.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b37fe700 1 -- 172.21.15.80:0/3240446759 >> v2:172.21.15.174:3300/0 conn(0x7f27b406c0a0 msgr2=0x7f27b4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:25.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b37fe700 1 --2- 172.21.15.80:0/3240446759 >> v2:172.21.15.174:3300/0 conn(0x7f27b406c0a0 0x7f27b4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:25.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b37fe700 1 -- 172.21.15.80:0/3240446759 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b40706c0 con 0x7f27b40734e0 2019-11-28T11:40:25.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b37fe700 1 -- 172.21.15.80:0/3240446759 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f27a40019e0 con 0x7f27b40734e0 2019-11-28T11:40:25.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b37fe700 1 -- 172.21.15.80:0/3240446759 >> v1:172.21.15.80:6789/0 conn(0x7f27b40734e0 legacy=0x7f27b4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:25.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b37fe700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27a00479e0 0x7f27a0049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:25.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b37fe700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27a004a5c0 0x7f27a004ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:25.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b37fe700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a004d260 0x7f27a004f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:25.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b37fe700 1 -- 172.21.15.80:0/3240446759 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a004ff40 con 0x7f27a004d260 2019-11-28T11:40:25.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b37fe700 1 -- 172.21.15.80:0/3240446759 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a0050130 con 0x7f27a00479e0 2019-11-28T11:40:25.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b37fe700 1 -- 172.21.15.80:0/3240446759 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a0050360 con 0x7f27a004a5c0 2019-11-28T11:40:25.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b9194700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a004d260 0x7f27a004f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:25.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b8993700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27a00479e0 0x7f27a0049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:25.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b3fff700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27a004a5c0 0x7f27a004ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:25.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b9194700 1 -- 172.21.15.80:0/3240446759 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27a004a5c0 msgr2=0x7f27a004ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:25.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b9194700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27a004a5c0 0x7f27a004ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:25.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b9194700 1 -- 172.21.15.80:0/3240446759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27a00479e0 msgr2=0x7f27a0049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:25.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b9194700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27a00479e0 0x7f27a0049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:25.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b9194700 1 -- 172.21.15.80:0/3240446759 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a0050610 con 0x7f27a004d260 2019-11-28T11:40:25.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b3fff700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27a004a5c0 0x7f27a004ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:40:25.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b9194700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a004d260 0x7f27a004f730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f27ac002a20 tx=0x7f27ac002920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:25.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b9194700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a004d260 0x7f27a004f730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f27ac002a20 tx=0x7f27ac002920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:25.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.623+0000 7f27b9194700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a004d260 0x7f27a004f730 secure :-1 s=READY pgs=1293 cs=0 l=1 rx=0x7f27ac002a20 tx=0x7f27ac002920).ready entity=mon.0 client_cookie=f04bca60be7baa03 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:25.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.624+0000 7f27b9194700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a004d260 0x7f27a004f730 secure :-1 s=THROTTLE_DONE pgs=1293 cs=0 l=1 rx=0x7f27ac002a20 tx=0x7f27ac002920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:25.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.624+0000 7f27b37fe700 1 -- 172.21.15.80:0/3240446759 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27ac000a70 con 0x7f27a004d260 2019-11-28T11:40:25.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.624+0000 7f27b9194700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a004d260 0x7f27a004f730 secure :-1 s=THROTTLE_DONE pgs=1293 cs=0 l=1 rx=0x7f27ac002a20 tx=0x7f27ac002920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:25.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.624+0000 7f27b9194700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a004d260 0x7f27a004f730 secure :-1 s=THROTTLE_DONE pgs=1293 cs=0 l=1 rx=0x7f27ac002a20 tx=0x7f27ac002920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:25.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.624+0000 7f27b37fe700 1 -- 172.21.15.80:0/3240446759 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac00ec90 con 0x7f27a004d260 2019-11-28T11:40:25.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.624+0000 7f27b37fe700 1 -- 172.21.15.80:0/3240446759 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27ac00f320 con 0x7f27a004d260 2019-11-28T11:40:25.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.624+0000 7f27ba3f6700 1 -- 172.21.15.80:0/3240446759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a004d260 msgr2=0x7f27a004f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:25.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.624+0000 7f27ba3f6700 1 --2- 172.21.15.80:0/3240446759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a004d260 0x7f27a004f730 secure :-1 s=READY pgs=1293 cs=0 l=1 rx=0x7f27ac002a20 tx=0x7f27ac002920).stop 2019-11-28T11:40:25.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.624+0000 7f27b9194700 1 -- 172.21.15.80:0/3240446759 reap_dead start 2019-11-28T11:40:25.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.624+0000 7f27ba3f6700 1 -- 172.21.15.80:0/3240446759 shutdown_connections 2019-11-28T11:40:25.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.624+0000 7f27ba3f6700 1 -- 172.21.15.80:0/3240446759 shutdown_connections 2019-11-28T11:40:25.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.624+0000 7f27ba3f6700 1 -- 172.21.15.80:0/3240446759 wait complete. 2019-11-28T11:40:25.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.624+0000 7f27ba3f6700 1 -- 172.21.15.80:0/3240446759 >> 172.21.15.80:0/3240446759 conn(0x7f27b4061cf0 msgr2=0x7f27b4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:25.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.627+0000 7f27ba3f6700 1 Processor -- start 2019-11-28T11:40:25.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.627+0000 7f27ba3f6700 1 -- start start 2019-11-28T11:40:25.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.628+0000 7f27ba3f6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f27b4106930 0x7f27b413a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:25.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.628+0000 7f27ba3f6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b4137060 con 0x7f27b4139e20 2019-11-28T11:40:25.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.628+0000 7f27ba3f6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b4116530 con 0x7f27b413aa40 2019-11-28T11:40:25.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.628+0000 7f27ba3f6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b4114e70 con 0x7f27b4106930 2019-11-28T11:40:25.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.628+0000 7f27b9194700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f27b4139e20 0x7f27b4168eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37136/0 (socket says 172.21.15.80:37136) 2019-11-28T11:40:25.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.628+0000 7f27b9194700 1 -- 172.21.15.80:0/2823739087 learned_addr learned my addr 172.21.15.80:0/2823739087 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:25.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.628+0000 7f27b8993700 1 --2- 172.21.15.80:0/2823739087 >> v2:172.21.15.174:3300/0 conn(0x7f27b4106930 0x7f27b413a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:25.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.628+0000 7f27b17fa700 1 -- 172.21.15.80:0/2823739087 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741123509 0 0) 0x7f27ac0029f0 con 0x7f27b4139e20 2019-11-28T11:40:25.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.628+0000 7f27b17fa700 1 -- 172.21.15.80:0/2823739087 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2798002e80 con 0x7f27b4139e20 2019-11-28T11:40:25.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.628+0000 7f27b17fa700 1 -- 172.21.15.80:0/2823739087 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979936675 0 0) 0x7f27a4000cc0 con 0x7f27b413aa40 2019-11-28T11:40:25.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.628+0000 7f27b17fa700 1 -- 172.21.15.80:0/2823739087 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27980030b0 con 0x7f27b413aa40 2019-11-28T11:40:25.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.628+0000 7f27b17fa700 1 -- 172.21.15.80:0/2823739087 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1232744473 0 0) 0x7f27ac0029f0 con 0x7f27b4139e20 2019-11-28T11:40:25.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.628+0000 7f27b17fa700 1 -- 172.21.15.80:0/2823739087 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f27980033c0 con 0x7f27b4139e20 2019-11-28T11:40:25.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.628+0000 7f27b17fa700 1 -- 172.21.15.80:0/2823739087 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f27ac000c80 con 0x7f27b4139e20 2019-11-28T11:40:25.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.628+0000 7f27b8993700 1 -- 172.21.15.80:0/2823739087 >> v1:172.21.15.174:6789/0 conn(0x7f27b413aa40 legacy=0x7f27b4139620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:25.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.629+0000 7f27b8993700 1 -- 172.21.15.80:0/2823739087 >> v1:172.21.15.80:6789/0 conn(0x7f27b4139e20 legacy=0x7f27b4168eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:25.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.629+0000 7f27b8993700 1 -- 172.21.15.80:0/2823739087 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b4115500 con 0x7f27b4106930 2019-11-28T11:40:25.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.629+0000 7f27b8993700 1 --2- 172.21.15.80:0/2823739087 >> v2:172.21.15.174:3300/0 conn(0x7f27b4106930 0x7f27b413a500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f279c010390 tx=0x7f279c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:25.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.629+0000 7f27b8993700 1 --2- 172.21.15.80:0/2823739087 >> v2:172.21.15.174:3300/0 conn(0x7f27b4106930 0x7f27b413a500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f279c010390 tx=0x7f279c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:25.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.629+0000 7f27b8993700 1 --2- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27b4106930 0x7f27b413a500 secure :-1 s=READY pgs=766 cs=0 l=1 rx=0x7f279c010390 tx=0x7f279c010730).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:25.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.629+0000 7f27b8993700 1 --2- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27b4106930 0x7f27b413a500 secure :-1 s=THROTTLE_DONE pgs=766 cs=0 l=1 rx=0x7f279c010390 tx=0x7f279c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:25.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.629+0000 7f27b17fa700 1 -- 172.21.15.80:0/2823739087 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f279c005180 con 0x7f27b4106930 2019-11-28T11:40:25.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.629+0000 7f27b8993700 1 --2- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27b4106930 0x7f27b413a500 secure :-1 s=THROTTLE_DONE pgs=766 cs=0 l=1 rx=0x7f279c010390 tx=0x7f279c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:25.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.629+0000 7f27b8993700 1 --2- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27b4106930 0x7f27b413a500 secure :-1 s=THROTTLE_DONE pgs=766 cs=0 l=1 rx=0x7f279c010390 tx=0x7f279c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:25.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.629+0000 7f27b17fa700 1 -- 172.21.15.80:0/2823739087 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279c005180 con 0x7f27b4106930 2019-11-28T11:40:25.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.629+0000 7f27ba3f6700 1 -- 172.21.15.80:0/2823739087 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b4115880 con 0x7f27b4106930 2019-11-28T11:40:25.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.629+0000 7f27b17fa700 1 -- 172.21.15.80:0/2823739087 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f279c005a20 con 0x7f27b4106930 2019-11-28T11:40:25.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.629+0000 7f27ba3f6700 1 -- 172.21.15.80:0/2823739087 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b41147b0 con 0x7f27b4106930 2019-11-28T11:40:25.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.629+0000 7f27b8993700 1 --2- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27b4106930 0x7f27b413a500 secure :-1 s=THROTTLE_DONE pgs=766 cs=0 l=1 rx=0x7f279c010390 tx=0x7f279c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:25.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.630+0000 7f27b17fa700 1 -- 172.21.15.80:0/2823739087 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f279c005640 con 0x7f27b4106930 2019-11-28T11:40:25.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.630+0000 7f27b8993700 1 --2- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27b4106930 0x7f27b413a500 secure :-1 s=THROTTLE_DONE pgs=766 cs=0 l=1 rx=0x7f279c010390 tx=0x7f279c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:25.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.630+0000 7f27b17fa700 1 --2- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27980187a0 0x7f279801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:25.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.630+0000 7f27b17fa700 1 -- 172.21.15.80:0/2823739087 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f279c031b10 con 0x7f27b4106930 2019-11-28T11:40:25.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.630+0000 7f27b3fff700 1 --2- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27980187a0 0x7f279801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:25.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.630+0000 7f27b3fff700 1 --2- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27980187a0 0x7f279801abf0 crc :-1 s=READY pgs=534 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:25.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.636+0000 7f27ba3f6700 1 -- 172.21.15.80:0/2823739087 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b4115500 con 0x7f27b4106930 2019-11-28T11:40:25.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.640+0000 7f27b8993700 1 --2- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27b4106930 0x7f27b413a500 secure :-1 s=THROTTLE_DONE pgs=766 cs=0 l=1 rx=0x7f279c010390 tx=0x7f279c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:25.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.640+0000 7f27b17fa700 1 -- 172.21.15.80:0/2823739087 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f279c012de0 con 0x7f27b4106930 2019-11-28T11:40:25.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.812+0000 7f27ba3f6700 1 -- 172.21.15.80:0/2823739087 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27b4115880 con 0x7f27b4106930 2019-11-28T11:40:25.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.813+0000 7f27b8993700 1 --2- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27b4106930 0x7f27b413a500 secure :-1 s=THROTTLE_DONE pgs=766 cs=0 l=1 rx=0x7f279c010390 tx=0x7f279c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:25.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.813+0000 7f27b17fa700 1 -- 172.21.15.80:0/2823739087 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f279c012de0 con 0x7f27b4106930 2019-11-28T11:40:25.845 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:25.845 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:25.845 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.815+0000 7f27ba3f6700 1 -- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27980187a0 msgr2=0x7f279801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.815+0000 7f27ba3f6700 1 --2- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27980187a0 0x7f279801abf0 crc :-1 s=READY pgs=534 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.815+0000 7f27ba3f6700 1 -- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27b4106930 msgr2=0x7f27b413a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.815+0000 7f27ba3f6700 1 --2- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27b4106930 0x7f27b413a500 secure :-1 s=READY pgs=766 cs=0 l=1 rx=0x7f279c010390 tx=0x7f279c010730).stop 2019-11-28T11:40:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.815+0000 7f27ba3f6700 1 -- 172.21.15.80:0/2823739087 shutdown_connections 2019-11-28T11:40:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.815+0000 7f27ba3f6700 1 --2- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27980187a0 0x7f279801abf0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:25.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.815+0000 7f27ba3f6700 1 --2- 172.21.15.80:0/2823739087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27b4106930 0x7f27b413a500 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:25.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.815+0000 7f27ba3f6700 1 -- 172.21.15.80:0/2823739087 shutdown_connections 2019-11-28T11:40:25.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.815+0000 7f27ba3f6700 1 -- 172.21.15.80:0/2823739087 wait complete. 2019-11-28T11:40:25.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:25.815+0000 7f27ba3f6700 1 -- 172.21.15.80:0/2823739087 >> 172.21.15.80:0/2823739087 conn(0x7f27b4141d10 msgr2=0x7f27b413ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:25.877 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:26.884 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:27.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.975+0000 7f6e8a135700 1 Processor -- start 2019-11-28T11:40:27.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.975+0000 7f6e8a135700 1 -- start start 2019-11-28T11:40:27.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.976+0000 7f6e8a135700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6e8406c0a0 0x7f6e84072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:27.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.976+0000 7f6e8a135700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e840734e0 0x7f6e84071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:27.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.976+0000 7f6e8a135700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e84072360 0x7f6e84072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:27.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.976+0000 7f6e8a135700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8406fd60 con 0x7f6e840734e0 2019-11-28T11:40:27.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.976+0000 7f6e8a135700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e84070030 con 0x7f6e8406c0a0 2019-11-28T11:40:27.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.976+0000 7f6e8a135700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8406f330 con 0x7f6e84072360 2019-11-28T11:40:27.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.976+0000 7f6e7bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e840734e0 0x7f6e84071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:27.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.976+0000 7f6e7bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e840734e0 0x7f6e84071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37824/0 (socket says 172.21.15.80:37824) 2019-11-28T11:40:27.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.976+0000 7f6e7bfff700 1 -- 172.21.15.80:0/1332573080 learned_addr learned my addr 172.21.15.80:0/1332573080 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:27.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.976+0000 7f6e88ed3700 1 --2- 172.21.15.80:0/1332573080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e84072360 0x7f6e84072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:27.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.976+0000 7f6e83fff700 1 --2- 172.21.15.80:0/1332573080 >> v2:172.21.15.174:3300/0 conn(0x7f6e8406c0a0 0x7f6e84072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:27.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.977+0000 7f6e7bfff700 1 -- 172.21.15.80:0/1332573080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e84072360 msgr2=0x7f6e84072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:27.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.977+0000 7f6e7bfff700 1 --2- 172.21.15.80:0/1332573080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e84072360 0x7f6e84072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:27.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.977+0000 7f6e7bfff700 1 -- 172.21.15.80:0/1332573080 >> v2:172.21.15.174:3300/0 conn(0x7f6e8406c0a0 msgr2=0x7f6e84072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:27.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.977+0000 7f6e7bfff700 1 --2- 172.21.15.80:0/1332573080 >> v2:172.21.15.174:3300/0 conn(0x7f6e8406c0a0 0x7f6e84072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:27.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.977+0000 7f6e7bfff700 1 -- 172.21.15.80:0/1332573080 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e840706c0 con 0x7f6e840734e0 2019-11-28T11:40:27.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.977+0000 7f6e7bfff700 1 --2- 172.21.15.80:0/1332573080 >> v2:172.21.15.80:3300/0 conn(0x7f6e840734e0 0x7f6e84071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6e6c00f6c0 tx=0x7f6e6c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:27.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.977+0000 7f6e7bfff700 1 --2- 172.21.15.80:0/1332573080 >> v2:172.21.15.80:3300/0 conn(0x7f6e840734e0 0x7f6e84071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6e6c00f6c0 tx=0x7f6e6c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:27.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.977+0000 7f6e7bfff700 1 --2- 172.21.15.80:0/1332573080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e840734e0 0x7f6e84071e20 secure :-1 s=READY pgs=1295 cs=0 l=1 rx=0x7f6e6c00f6c0 tx=0x7f6e6c00f570).ready entity=mon.0 client_cookie=54f53c600cc9f17e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:27.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.977+0000 7f6e7bfff700 1 --2- 172.21.15.80:0/1332573080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e840734e0 0x7f6e84071e20 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x7f6e6c00f6c0 tx=0x7f6e6c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:27.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.977+0000 7f6e837fe700 1 -- 172.21.15.80:0/1332573080 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e6c000960 con 0x7f6e840734e0 2019-11-28T11:40:27.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.977+0000 7f6e7bfff700 1 --2- 172.21.15.80:0/1332573080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e840734e0 0x7f6e84071e20 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x7f6e6c00f6c0 tx=0x7f6e6c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:27.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.977+0000 7f6e7bfff700 1 --2- 172.21.15.80:0/1332573080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e840734e0 0x7f6e84071e20 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x7f6e6c00f6c0 tx=0x7f6e6c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:27.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.977+0000 7f6e837fe700 1 -- 172.21.15.80:0/1332573080 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c000c90 con 0x7f6e840734e0 2019-11-28T11:40:27.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.977+0000 7f6e837fe700 1 -- 172.21.15.80:0/1332573080 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e6c0013a0 con 0x7f6e840734e0 2019-11-28T11:40:27.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.977+0000 7f6e8a135700 1 -- 172.21.15.80:0/1332573080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e840734e0 msgr2=0x7f6e84071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:27.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.977+0000 7f6e8a135700 1 --2- 172.21.15.80:0/1332573080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e840734e0 0x7f6e84071e20 secure :-1 s=READY pgs=1295 cs=0 l=1 rx=0x7f6e6c00f6c0 tx=0x7f6e6c00f570).stop 2019-11-28T11:40:27.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.978+0000 7f6e8a135700 1 -- 172.21.15.80:0/1332573080 shutdown_connections 2019-11-28T11:40:27.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.978+0000 7f6e8a135700 1 --2- 172.21.15.80:0/1332573080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e84072360 0x7f6e84072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:27.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.978+0000 7f6e8a135700 1 --2- 172.21.15.80:0/1332573080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e840734e0 0x7f6e84071e20 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:27.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.978+0000 7f6e8a135700 1 --2- 172.21.15.80:0/1332573080 >> v2:172.21.15.174:3300/0 conn(0x7f6e8406c0a0 0x7f6e84072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:27.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.978+0000 7f6e8a135700 1 -- 172.21.15.80:0/1332573080 shutdown_connections 2019-11-28T11:40:27.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.978+0000 7f6e8a135700 1 -- 172.21.15.80:0/1332573080 wait complete. 2019-11-28T11:40:27.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.978+0000 7f6e8a135700 1 -- 172.21.15.80:0/1332573080 >> 172.21.15.80:0/1332573080 conn(0x7f6e84061cf0 msgr2=0x7f6e84064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:27.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.980+0000 7f6e8a135700 1 Processor -- start 2019-11-28T11:40:27.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.980+0000 7f6e8a135700 1 -- start start 2019-11-28T11:40:27.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e8a135700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e8413a780 0x7f6e8412d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:27.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e8a135700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e8412cb00 0x7f6e84167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:27.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e8a135700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e84139a60 con 0x7f6e8412d9c0 2019-11-28T11:40:27.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e8a135700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8412a260 con 0x7f6e8413a780 2019-11-28T11:40:27.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e8a135700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8412a530 con 0x7f6e8412cb00 2019-11-28T11:40:27.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e83fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e8413a780 0x7f6e8412d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:27.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e83fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e8413a780 0x7f6e8412d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37828/0 (socket says 172.21.15.80:37828) 2019-11-28T11:40:27.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e83fff700 1 -- 172.21.15.80:0/2518119000 learned_addr learned my addr 172.21.15.80:0/2518119000 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:27.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e88ed3700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e8412cb00 0x7f6e84167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:27.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e83fff700 1 -- 172.21.15.80:0/2518119000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e8412cb00 msgr2=0x7f6e84167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:27.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e83fff700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e8412cb00 0x7f6e84167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:27.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e83fff700 1 -- 172.21.15.80:0/2518119000 >> v1:172.21.15.174:6789/0 conn(0x7f6e8412d9c0 legacy=0x7f6e8412c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:27.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e83fff700 1 -- 172.21.15.80:0/2518119000 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8412abc0 con 0x7f6e8413a780 2019-11-28T11:40:27.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e817fa700 1 -- 172.21.15.80:0/2518119000 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218057018 0 0) 0x7f6e6c007580 con 0x7f6e8412d9c0 2019-11-28T11:40:27.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e83fff700 1 --2- 172.21.15.80:0/2518119000 >> v2:172.21.15.80:3300/0 conn(0x7f6e8413a780 0x7f6e8412d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6e740103d0 tx=0x7f6e74010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:27.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e83fff700 1 --2- 172.21.15.80:0/2518119000 >> v2:172.21.15.80:3300/0 conn(0x7f6e8413a780 0x7f6e8412d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6e740103d0 tx=0x7f6e74010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:27.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.981+0000 7f6e83fff700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e8413a780 0x7f6e8412d480 secure :-1 s=READY pgs=1296 cs=0 l=1 rx=0x7f6e740103d0 tx=0x7f6e74010770).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:27.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.982+0000 7f6e83fff700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e8413a780 0x7f6e8412d480 secure :-1 s=THROTTLE_DONE pgs=1296 cs=0 l=1 rx=0x7f6e740103d0 tx=0x7f6e74010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:27.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.982+0000 7f6e817fa700 1 -- 172.21.15.80:0/2518119000 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e74000940 con 0x7f6e8413a780 2019-11-28T11:40:27.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.982+0000 7f6e83fff700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e8413a780 0x7f6e8412d480 secure :-1 s=THROTTLE_DONE pgs=1296 cs=0 l=1 rx=0x7f6e740103d0 tx=0x7f6e74010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:27.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.982+0000 7f6e83fff700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e8413a780 0x7f6e8412d480 secure :-1 s=THROTTLE_DONE pgs=1296 cs=0 l=1 rx=0x7f6e740103d0 tx=0x7f6e74010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:27.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.982+0000 7f6e817fa700 1 -- 172.21.15.80:0/2518119000 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e74000e80 con 0x7f6e8413a780 2019-11-28T11:40:27.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.982+0000 7f6e8a135700 1 -- 172.21.15.80:0/2518119000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8412af40 con 0x7f6e8413a780 2019-11-28T11:40:27.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.982+0000 7f6e817fa700 1 -- 172.21.15.80:0/2518119000 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e74001070 con 0x7f6e8413a780 2019-11-28T11:40:27.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.982+0000 7f6e8a135700 1 -- 172.21.15.80:0/2518119000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8412abc0 con 0x7f6e8413a780 2019-11-28T11:40:27.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.982+0000 7f6e83fff700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e8413a780 0x7f6e8412d480 secure :-1 s=THROTTLE_DONE pgs=1296 cs=0 l=1 rx=0x7f6e740103d0 tx=0x7f6e74010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:27.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.982+0000 7f6e817fa700 1 -- 172.21.15.80:0/2518119000 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6e74001070 con 0x7f6e8413a780 2019-11-28T11:40:27.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.982+0000 7f6e83fff700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e8413a780 0x7f6e8412d480 secure :-1 s=THROTTLE_DONE pgs=1296 cs=0 l=1 rx=0x7f6e740103d0 tx=0x7f6e74010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:27.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.982+0000 7f6e817fa700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e68018730 0x7f6e6801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:27.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.982+0000 7f6e817fa700 1 -- 172.21.15.80:0/2518119000 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f6e74031a90 con 0x7f6e8413a780 2019-11-28T11:40:27.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.982+0000 7f6e7bfff700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e68018730 0x7f6e6801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:27.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.983+0000 7f6e7bfff700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e68018730 0x7f6e6801abc0 crc :-1 s=READY pgs=535 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:27.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.991+0000 7f6e8a135700 1 -- 172.21.15.80:0/2518119000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8412af40 con 0x7f6e8413a780 2019-11-28T11:40:27.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.994+0000 7f6e83fff700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e8413a780 0x7f6e8412d480 secure :-1 s=THROTTLE_DONE pgs=1296 cs=0 l=1 rx=0x7f6e740103d0 tx=0x7f6e74010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:27.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:26.994+0000 7f6e817fa700 1 -- 172.21.15.80:0/2518119000 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6e740092e0 con 0x7f6e8413a780 2019-11-28T11:40:27.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:27.167+0000 7f6e8a135700 1 -- 172.21.15.80:0/2518119000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e8412abc0 con 0x7f6e8413a780 2019-11-28T11:40:27.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:27.167+0000 7f6e83fff700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e8413a780 0x7f6e8412d480 secure :-1 s=THROTTLE_DONE pgs=1296 cs=0 l=1 rx=0x7f6e740103d0 tx=0x7f6e74010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:27.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:27.167+0000 7f6e817fa700 1 -- 172.21.15.80:0/2518119000 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f6e74001070 con 0x7f6e8413a780 2019-11-28T11:40:27.199 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:27.199 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:27.199 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:27.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:27.170+0000 7f6e8a135700 1 -- 172.21.15.80:0/2518119000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e68018730 msgr2=0x7f6e6801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:27.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:27.170+0000 7f6e8a135700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e68018730 0x7f6e6801abc0 crc :-1 s=READY pgs=535 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:27.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:27.170+0000 7f6e8a135700 1 -- 172.21.15.80:0/2518119000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e8413a780 msgr2=0x7f6e8412d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:27.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:27.170+0000 7f6e8a135700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e8413a780 0x7f6e8412d480 secure :-1 s=READY pgs=1296 cs=0 l=1 rx=0x7f6e740103d0 tx=0x7f6e74010770).stop 2019-11-28T11:40:27.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:27.170+0000 7f6e8a135700 1 -- 172.21.15.80:0/2518119000 shutdown_connections 2019-11-28T11:40:27.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:27.170+0000 7f6e8a135700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e8412cb00 0x7f6e84167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:27.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:27.170+0000 7f6e8a135700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e68018730 0x7f6e6801abc0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:27.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:27.170+0000 7f6e8a135700 1 --2- 172.21.15.80:0/2518119000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e8413a780 0x7f6e8412d480 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:27.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:27.170+0000 7f6e8a135700 1 -- 172.21.15.80:0/2518119000 shutdown_connections 2019-11-28T11:40:27.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:27.170+0000 7f6e8a135700 1 -- 172.21.15.80:0/2518119000 wait complete. 2019-11-28T11:40:27.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:27.170+0000 7f6e8a135700 1 -- 172.21.15.80:0/2518119000 >> 172.21.15.80:0/2518119000 conn(0x7f6e84127dc0 msgr2=0x7f6e84141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:27.211 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:28.211 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:28.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.300+0000 7f52a31e4700 1 Processor -- start 2019-11-28T11:40:28.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.300+0000 7f52a31e4700 1 -- start start 2019-11-28T11:40:28.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.301+0000 7f52a31e4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f529c06c490 0x7f529c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:28.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.301+0000 7f52a31e4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f529c06ce60 0x7f529c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.301+0000 7f52a31e4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529c06db00 con 0x7f529c06c0a0 2019-11-28T11:40:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.301+0000 7f52a31e4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529c06fd60 con 0x7f529c06ce60 2019-11-28T11:40:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.301+0000 7f52a31e4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529c070030 con 0x7f529c06c490 2019-11-28T11:40:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.301+0000 7f52a1f82700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f529c06ce60 0x7f529c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.301+0000 7f52a1781700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f529c06c0a0 0x7f529c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37152/0 (socket says 172.21.15.80:37152) 2019-11-28T11:40:28.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.301+0000 7f52a1781700 1 -- 172.21.15.80:0/1645325932 learned_addr learned my addr 172.21.15.80:0/1645325932 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:28.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.301+0000 7f52a0f80700 1 --2- 172.21.15.80:0/1645325932 >> v2:172.21.15.174:3300/0 conn(0x7f529c06c490 0x7f529c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:28.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.301+0000 7f52a1f82700 1 -- 172.21.15.80:0/1645325932 >> v2:172.21.15.174:3300/0 conn(0x7f529c06c490 msgr2=0x7f529c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:28.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.301+0000 7f52a1f82700 1 --2- 172.21.15.80:0/1645325932 >> v2:172.21.15.174:3300/0 conn(0x7f529c06c490 0x7f529c06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:28.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.301+0000 7f52a1f82700 1 -- 172.21.15.80:0/1645325932 >> v1:172.21.15.80:6789/0 conn(0x7f529c06c0a0 legacy=0x7f529c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:28.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.301+0000 7f529bfff700 1 -- 172.21.15.80:0/1645325932 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144584868 0 0) 0x7f5290001150 con 0x7f529c06c0a0 2019-11-28T11:40:28.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.301+0000 7f52a1f82700 1 -- 172.21.15.80:0/1645325932 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c0706c0 con 0x7f529c06ce60 2019-11-28T11:40:28.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.301+0000 7f52a0f80700 1 --2- 172.21.15.80:0/1645325932 >> v2:172.21.15.174:3300/0 conn(0x7f529c06c490 0x7f529c06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:40:28.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.302+0000 7f52a1f82700 1 --2- 172.21.15.80:0/1645325932 >> v2:172.21.15.80:3300/0 conn(0x7f529c06ce60 0x7f529c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f529400b2d0 tx=0x7f529400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:28.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.302+0000 7f52a1f82700 1 --2- 172.21.15.80:0/1645325932 >> v2:172.21.15.80:3300/0 conn(0x7f529c06ce60 0x7f529c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f529400b2d0 tx=0x7f529400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:28.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.302+0000 7f52a1f82700 1 --2- 172.21.15.80:0/1645325932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c06ce60 0x7f529c164d70 secure :-1 s=READY pgs=1298 cs=0 l=1 rx=0x7f529400b2d0 tx=0x7f529400bae0).ready entity=mon.0 client_cookie=ed4048ccf9d9b7c1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:28.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.302+0000 7f52a1f82700 1 --2- 172.21.15.80:0/1645325932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c06ce60 0x7f529c164d70 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f529400b2d0 tx=0x7f529400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:28.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.302+0000 7f529bfff700 1 -- 172.21.15.80:0/1645325932 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5294009f20 con 0x7f529c06ce60 2019-11-28T11:40:28.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.302+0000 7f52a1f82700 1 --2- 172.21.15.80:0/1645325932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c06ce60 0x7f529c164d70 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f529400b2d0 tx=0x7f529400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:28.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.302+0000 7f52a1f82700 1 --2- 172.21.15.80:0/1645325932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c06ce60 0x7f529c164d70 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f529400b2d0 tx=0x7f529400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:28.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.302+0000 7f529bfff700 1 -- 172.21.15.80:0/1645325932 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5294009b40 con 0x7f529c06ce60 2019-11-28T11:40:28.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.302+0000 7f529bfff700 1 -- 172.21.15.80:0/1645325932 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5294000f40 con 0x7f529c06ce60 2019-11-28T11:40:28.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.302+0000 7f52a31e4700 1 -- 172.21.15.80:0/1645325932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c06ce60 msgr2=0x7f529c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:28.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.302+0000 7f52a31e4700 1 --2- 172.21.15.80:0/1645325932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c06ce60 0x7f529c164d70 secure :-1 s=READY pgs=1298 cs=0 l=1 rx=0x7f529400b2d0 tx=0x7f529400bae0).stop 2019-11-28T11:40:28.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.302+0000 7f52a31e4700 1 -- 172.21.15.80:0/1645325932 shutdown_connections 2019-11-28T11:40:28.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.302+0000 7f52a31e4700 1 --2- 172.21.15.80:0/1645325932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c06ce60 0x7f529c164d70 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:28.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.302+0000 7f52a31e4700 1 --2- 172.21.15.80:0/1645325932 >> v2:172.21.15.174:3300/0 conn(0x7f529c06c490 0x7f529c06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:28.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.303+0000 7f52a31e4700 1 -- 172.21.15.80:0/1645325932 shutdown_connections 2019-11-28T11:40:28.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.303+0000 7f52a31e4700 1 -- 172.21.15.80:0/1645325932 wait complete. 2019-11-28T11:40:28.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.303+0000 7f52a31e4700 1 -- 172.21.15.80:0/1645325932 >> 172.21.15.80:0/1645325932 conn(0x7f529c061cf0 msgr2=0x7f529c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:28.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.305+0000 7f52a31e4700 1 Processor -- start 2019-11-28T11:40:28.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.305+0000 7f52a31e4700 1 -- start start 2019-11-28T11:40:28.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a31e4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f529c13e5f0 0x7f529c10f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:28.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a31e4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f529c159590 0x7f529c158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:28.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a31e4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529c13edc0 con 0x7f529c159a20 2019-11-28T11:40:28.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a31e4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529c07bba0 con 0x7f529c13e5f0 2019-11-28T11:40:28.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a31e4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529c07b170 con 0x7f529c159590 2019-11-28T11:40:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a1781700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f529c13e5f0 0x7f529c10f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a1781700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f529c13e5f0 0x7f529c10f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37842/0 (socket says 172.21.15.80:37842) 2019-11-28T11:40:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a1781700 1 -- 172.21.15.80:0/2976903736 learned_addr learned my addr 172.21.15.80:0/2976903736 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a1f82700 1 --1- 172.21.15.80:0/2976903736 >> v1:172.21.15.80:6789/0 conn(0x7f529c159a20 0x7f529c118370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37160/0 (socket says 172.21.15.80:37160) 2019-11-28T11:40:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a0f80700 1 --2- 172.21.15.80:0/2976903736 >> v2:172.21.15.174:3300/0 conn(0x7f529c159590 0x7f529c158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:28.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a1781700 1 -- 172.21.15.80:0/2976903736 >> v2:172.21.15.174:3300/0 conn(0x7f529c159590 msgr2=0x7f529c158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:28.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a1781700 1 --2- 172.21.15.80:0/2976903736 >> v2:172.21.15.174:3300/0 conn(0x7f529c159590 0x7f529c158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:28.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a1781700 1 -- 172.21.15.80:0/2976903736 >> v1:172.21.15.80:6789/0 conn(0x7f529c159a20 legacy=0x7f529c118370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:28.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f5299ffb700 1 -- 172.21.15.80:0/2976903736 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937023947 0 0) 0x7f5294000cc0 con 0x7f529c159a20 2019-11-28T11:40:28.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a1781700 1 -- 172.21.15.80:0/2976903736 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c10dad0 con 0x7f529c13e5f0 2019-11-28T11:40:28.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a0f80700 1 --2- 172.21.15.80:0/2976903736 >> v2:172.21.15.174:3300/0 conn(0x7f529c159590 0x7f529c158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:40:28.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a1781700 1 --2- 172.21.15.80:0/2976903736 >> v2:172.21.15.80:3300/0 conn(0x7f529c13e5f0 0x7f529c10f210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5290010430 tx=0x7f52900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:28.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.306+0000 7f52a1781700 1 --2- 172.21.15.80:0/2976903736 >> v2:172.21.15.80:3300/0 conn(0x7f529c13e5f0 0x7f529c10f210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5290010430 tx=0x7f52900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.307+0000 7f52a1781700 1 --2- 172.21.15.80:0/2976903736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c13e5f0 0x7f529c10f210 secure :-1 s=READY pgs=1300 cs=0 l=1 rx=0x7f5290010430 tx=0x7f52900107d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.307+0000 7f52a1781700 1 --2- 172.21.15.80:0/2976903736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c13e5f0 0x7f529c10f210 secure :-1 s=THROTTLE_DONE pgs=1300 cs=0 l=1 rx=0x7f5290010430 tx=0x7f52900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.307+0000 7f5299ffb700 1 -- 172.21.15.80:0/2976903736 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5290000ed0 con 0x7f529c13e5f0 2019-11-28T11:40:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.307+0000 7f52a31e4700 1 -- 172.21.15.80:0/2976903736 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529c10de50 con 0x7f529c13e5f0 2019-11-28T11:40:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.307+0000 7f52a1781700 1 --2- 172.21.15.80:0/2976903736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c13e5f0 0x7f529c10f210 secure :-1 s=THROTTLE_DONE pgs=1300 cs=0 l=1 rx=0x7f5290010430 tx=0x7f52900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.307+0000 7f52a1781700 1 --2- 172.21.15.80:0/2976903736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c13e5f0 0x7f529c10f210 secure :-1 s=THROTTLE_DONE pgs=1300 cs=0 l=1 rx=0x7f5290010430 tx=0x7f52900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:28.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.307+0000 7f5299ffb700 1 -- 172.21.15.80:0/2976903736 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5290000ed0 con 0x7f529c13e5f0 2019-11-28T11:40:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.307+0000 7f52a31e4700 1 -- 172.21.15.80:0/2976903736 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529c10dad0 con 0x7f529c13e5f0 2019-11-28T11:40:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.307+0000 7f5299ffb700 1 -- 172.21.15.80:0/2976903736 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5290004620 con 0x7f529c13e5f0 2019-11-28T11:40:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.307+0000 7f52a1781700 1 --2- 172.21.15.80:0/2976903736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c13e5f0 0x7f529c10f210 secure :-1 s=THROTTLE_DONE pgs=1300 cs=0 l=1 rx=0x7f5290010430 tx=0x7f52900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.307+0000 7f5299ffb700 1 -- 172.21.15.80:0/2976903736 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5290004240 con 0x7f529c13e5f0 2019-11-28T11:40:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.307+0000 7f52a1781700 1 --2- 172.21.15.80:0/2976903736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c13e5f0 0x7f529c10f210 secure :-1 s=THROTTLE_DONE pgs=1300 cs=0 l=1 rx=0x7f5290010430 tx=0x7f52900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.307+0000 7f5299ffb700 1 --2- 172.21.15.80:0/2976903736 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f527c018730 0x7f527c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:28.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.307+0000 7f5299ffb700 1 -- 172.21.15.80:0/2976903736 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f5290031aa0 con 0x7f529c13e5f0 2019-11-28T11:40:28.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.308+0000 7f52a0f80700 1 --2- 172.21.15.80:0/2976903736 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f527c018730 0x7f527c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:28.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.308+0000 7f52a0f80700 1 --2- 172.21.15.80:0/2976903736 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f527c018730 0x7f527c01abc0 crc :-1 s=READY pgs=536 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:28.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.315+0000 7f52a31e4700 1 -- 172.21.15.80:0/2976903736 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529c10de50 con 0x7f529c13e5f0 2019-11-28T11:40:28.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.319+0000 7f52a1781700 1 --2- 172.21.15.80:0/2976903736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c13e5f0 0x7f529c10f210 secure :-1 s=THROTTLE_DONE pgs=1300 cs=0 l=1 rx=0x7f5290010430 tx=0x7f52900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:28.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.319+0000 7f5299ffb700 1 -- 172.21.15.80:0/2976903736 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f529001f8c0 con 0x7f529c13e5f0 2019-11-28T11:40:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.491+0000 7f52a31e4700 1 -- 172.21.15.80:0/2976903736 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f529c10dad0 con 0x7f529c13e5f0 2019-11-28T11:40:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.491+0000 7f52a1781700 1 --2- 172.21.15.80:0/2976903736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c13e5f0 0x7f529c10f210 secure :-1 s=THROTTLE_DONE pgs=1300 cs=0 l=1 rx=0x7f5290010430 tx=0x7f52900107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.491+0000 7f5299ffb700 1 -- 172.21.15.80:0/2976903736 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f5290004240 con 0x7f529c13e5f0 2019-11-28T11:40:28.523 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:28.523 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:28.523 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:28.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.494+0000 7f52a31e4700 1 -- 172.21.15.80:0/2976903736 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f527c018730 msgr2=0x7f527c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:28.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.494+0000 7f52a31e4700 1 --2- 172.21.15.80:0/2976903736 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f527c018730 0x7f527c01abc0 crc :-1 s=READY pgs=536 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:28.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.494+0000 7f52a31e4700 1 -- 172.21.15.80:0/2976903736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c13e5f0 msgr2=0x7f529c10f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:28.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.494+0000 7f52a31e4700 1 --2- 172.21.15.80:0/2976903736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c13e5f0 0x7f529c10f210 secure :-1 s=READY pgs=1300 cs=0 l=1 rx=0x7f5290010430 tx=0x7f52900107d0).stop 2019-11-28T11:40:28.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.494+0000 7f52a31e4700 1 -- 172.21.15.80:0/2976903736 shutdown_connections 2019-11-28T11:40:28.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.494+0000 7f52a31e4700 1 --2- 172.21.15.80:0/2976903736 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f527c018730 0x7f527c01abc0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:28.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.494+0000 7f52a31e4700 1 --2- 172.21.15.80:0/2976903736 >> v2:172.21.15.174:3300/0 conn(0x7f529c159590 0x7f529c158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:28.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.494+0000 7f52a31e4700 1 --2- 172.21.15.80:0/2976903736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f529c13e5f0 0x7f529c10f210 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:28.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.494+0000 7f52a31e4700 1 -- 172.21.15.80:0/2976903736 shutdown_connections 2019-11-28T11:40:28.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.494+0000 7f52a31e4700 1 -- 172.21.15.80:0/2976903736 wait complete. 2019-11-28T11:40:28.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:28.494+0000 7f52a31e4700 1 -- 172.21.15.80:0/2976903736 >> 172.21.15.80:0/2976903736 conn(0x7f529c07c6e0 msgr2=0x7f529c1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:28.537 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:29.543 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:29.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.651+0000 7fcd99210700 1 Processor -- start 2019-11-28T11:40:29.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.652+0000 7fcd99210700 1 -- start start 2019-11-28T11:40:29.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.652+0000 7fcd99210700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd9406c490 0x7fcd9406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd99210700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9406db00 con 0x7fcd9406c0a0 2019-11-28T11:40:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd99210700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9406e000 con 0x7fcd9406ce60 2019-11-28T11:40:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd99210700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9406fd60 con 0x7fcd9406c490 2019-11-28T11:40:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9359e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcd9406c0a0 0x7fcd94072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37166/0 (socket says 172.21.15.80:37166) 2019-11-28T11:40:29.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9359e700 1 -- 172.21.15.80:0/2209864127 learned_addr learned my addr 172.21.15.80:0/2209864127 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd9406c490 0x7fcd9406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 -- 172.21.15.80:0/2209864127 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127616815 0 0) 0x7fcd840014d0 con 0x7fcd9406c0a0 2019-11-28T11:40:29.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 -- 172.21.15.80:0/2209864127 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd74002e80 con 0x7fcd9406c0a0 2019-11-28T11:40:29.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 -- 172.21.15.80:0/2209864127 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236707373 0 0) 0x7fcd8c001080 con 0x7fcd9406ce60 2019-11-28T11:40:29.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 -- 172.21.15.80:0/2209864127 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd740030b0 con 0x7fcd9406ce60 2019-11-28T11:40:29.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 -- 172.21.15.80:0/2209864127 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2460380116 0 0) 0x7fcd840014b0 con 0x7fcd9406c0a0 2019-11-28T11:40:29.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 -- 172.21.15.80:0/2209864127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd9406c490 msgr2=0x7fcd9406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:29.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd9406c490 0x7fcd9406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:29.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 -- 172.21.15.80:0/2209864127 >> v1:172.21.15.174:6789/0 conn(0x7fcd9406ce60 legacy=0x7fcd94164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:29.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 -- 172.21.15.80:0/2209864127 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd940706c0 con 0x7fcd9406c0a0 2019-11-28T11:40:29.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 -- 172.21.15.80:0/2209864127 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fcd840019e0 con 0x7fcd9406c0a0 2019-11-28T11:40:29.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 -- 172.21.15.80:0/2209864127 >> v1:172.21.15.80:6789/0 conn(0x7fcd9406c0a0 legacy=0x7fcd94072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd74003b80 0x7fcd74005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd740066b0 0x7fcd74008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd7404d3b0 0x7fcd7404f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:29.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 -- 172.21.15.80:0/2209864127 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7404ffd0 con 0x7fcd740066b0 2019-11-28T11:40:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd740066b0 0x7fcd74008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 -- 172.21.15.80:0/2209864127 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd74050200 con 0x7fcd74003b80 2019-11-28T11:40:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9259c700 1 -- 172.21.15.80:0/2209864127 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd74050430 con 0x7fcd7404d3b0 2019-11-28T11:40:29.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.653+0000 7fcd9359e700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd74003b80 0x7fcd74005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd98a0f700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd7404d3b0 0x7fcd7404f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:29.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd92d9d700 1 -- 172.21.15.80:0/2209864127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd7404d3b0 msgr2=0x7fcd7404f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:29.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd7404d3b0 0x7fcd7404f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:29.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd92d9d700 1 -- 172.21.15.80:0/2209864127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd74003b80 msgr2=0x7fcd74005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:29.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd74003b80 0x7fcd74005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:29.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd92d9d700 1 -- 172.21.15.80:0/2209864127 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd740506e0 con 0x7fcd740066b0 2019-11-28T11:40:29.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd740066b0 0x7fcd74008b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcd7c00b560 tx=0x7fcd7c00b430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:29.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd740066b0 0x7fcd74008b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcd7c00b560 tx=0x7fcd7c00b430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:29.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd740066b0 0x7fcd74008b40 secure :-1 s=READY pgs=1302 cs=0 l=1 rx=0x7fcd7c00b560 tx=0x7fcd7c00b430).ready entity=mon.0 client_cookie=2bb8cf9035a35fc5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:29.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd740066b0 0x7fcd74008b40 secure :-1 s=THROTTLE_DONE pgs=1302 cs=0 l=1 rx=0x7fcd7c00b560 tx=0x7fcd7c00b430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:29.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd9259c700 1 -- 172.21.15.80:0/2209864127 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd7c000960 con 0x7fcd740066b0 2019-11-28T11:40:29.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd740066b0 0x7fcd74008b40 secure :-1 s=THROTTLE_DONE pgs=1302 cs=0 l=1 rx=0x7fcd7c00b560 tx=0x7fcd7c00b430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:29.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd740066b0 0x7fcd74008b40 secure :-1 s=THROTTLE_DONE pgs=1302 cs=0 l=1 rx=0x7fcd7c00b560 tx=0x7fcd7c00b430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:29.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd9259c700 1 -- 172.21.15.80:0/2209864127 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c009770 con 0x7fcd740066b0 2019-11-28T11:40:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd9259c700 1 -- 172.21.15.80:0/2209864127 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd7c000940 con 0x7fcd740066b0 2019-11-28T11:40:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd99210700 1 -- 172.21.15.80:0/2209864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd740066b0 msgr2=0x7fcd74008b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd99210700 1 --2- 172.21.15.80:0/2209864127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd740066b0 0x7fcd74008b40 secure :-1 s=READY pgs=1302 cs=0 l=1 rx=0x7fcd7c00b560 tx=0x7fcd7c00b430).stop 2019-11-28T11:40:29.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.654+0000 7fcd98a0f700 1 -- 172.21.15.80:0/2209864127 reap_dead start 2019-11-28T11:40:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.655+0000 7fcd99210700 1 -- 172.21.15.80:0/2209864127 shutdown_connections 2019-11-28T11:40:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.655+0000 7fcd99210700 1 -- 172.21.15.80:0/2209864127 shutdown_connections 2019-11-28T11:40:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.655+0000 7fcd99210700 1 -- 172.21.15.80:0/2209864127 wait complete. 2019-11-28T11:40:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.655+0000 7fcd99210700 1 -- 172.21.15.80:0/2209864127 >> 172.21.15.80:0/2209864127 conn(0x7fcd94061cf0 msgr2=0x7fcd94064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.657+0000 7fcd99210700 1 Processor -- start 2019-11-28T11:40:29.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.657+0000 7fcd99210700 1 -- start start 2019-11-28T11:40:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.658+0000 7fcd99210700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcd94074d00 0x7fcd940750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.658+0000 7fcd99210700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd94152bd0 0x7fcd94140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.658+0000 7fcd99210700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd94079230 con 0x7fcd94153040 2019-11-28T11:40:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.658+0000 7fcd99210700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9407ab30 con 0x7fcd94074d00 2019-11-28T11:40:29.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.658+0000 7fcd99210700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9407ae00 con 0x7fcd94152bd0 2019-11-28T11:40:29.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.658+0000 7fcd98a0f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcd94153040 0x7fcd94140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37182/0 (socket says 172.21.15.80:37182) 2019-11-28T11:40:29.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.658+0000 7fcd98a0f700 1 -- 172.21.15.80:0/1721082851 learned_addr learned my addr 172.21.15.80:0/1721082851 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:29.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.658+0000 7fcd9359e700 1 --2- 172.21.15.80:0/1721082851 >> v2:172.21.15.174:3300/0 conn(0x7fcd94074d00 0x7fcd940750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:29.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.658+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd94152bd0 0x7fcd94140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:29.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.658+0000 7fcd8bfff700 1 -- 172.21.15.80:0/1721082851 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477247698 0 0) 0x7fcd8c001190 con 0x7fcd94153040 2019-11-28T11:40:29.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd8bfff700 1 -- 172.21.15.80:0/1721082851 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd6c002e80 con 0x7fcd94153040 2019-11-28T11:40:29.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd92d9d700 1 -- 172.21.15.80:0/1721082851 >> v2:172.21.15.174:3300/0 conn(0x7fcd94074d00 msgr2=0x7fcd940750f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:29.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/1721082851 >> v2:172.21.15.174:3300/0 conn(0x7fcd94074d00 0x7fcd940750f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:29.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd92d9d700 1 -- 172.21.15.80:0/1721082851 >> v1:172.21.15.80:6789/0 conn(0x7fcd94153040 legacy=0x7fcd94140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:29.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd92d9d700 1 -- 172.21.15.80:0/1721082851 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9407b490 con 0x7fcd94152bd0 2019-11-28T11:40:29.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd9359e700 1 --2- 172.21.15.80:0/1721082851 >> v2:172.21.15.174:3300/0 conn(0x7fcd94074d00 0x7fcd940750f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:40:29.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd94152bd0 0x7fcd94140440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd7c0103a0 tx=0x7fcd7c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:29.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd94152bd0 0x7fcd94140440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd7c0103a0 tx=0x7fcd7c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:29.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd94152bd0 0x7fcd94140440 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7fcd7c0103a0 tx=0x7fcd7c010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:29.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd94152bd0 0x7fcd94140440 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7fcd7c0103a0 tx=0x7fcd7c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:29.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd8bfff700 1 -- 172.21.15.80:0/1721082851 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd7c000940 con 0x7fcd94152bd0 2019-11-28T11:40:29.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd94152bd0 0x7fcd94140440 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7fcd7c0103a0 tx=0x7fcd7c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:29.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd8bfff700 1 -- 172.21.15.80:0/1721082851 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c000940 con 0x7fcd94152bd0 2019-11-28T11:40:29.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd94152bd0 0x7fcd94140440 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7fcd7c0103a0 tx=0x7fcd7c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:29.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd99210700 1 -- 172.21.15.80:0/1721082851 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9407b810 con 0x7fcd94152bd0 2019-11-28T11:40:29.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd8bfff700 1 -- 172.21.15.80:0/1721082851 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd7c009b70 con 0x7fcd94152bd0 2019-11-28T11:40:29.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.659+0000 7fcd99210700 1 -- 172.21.15.80:0/1721082851 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9407b490 con 0x7fcd94152bd0 2019-11-28T11:40:29.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.660+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd94152bd0 0x7fcd94140440 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7fcd7c0103a0 tx=0x7fcd7c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.660+0000 7fcd8bfff700 1 -- 172.21.15.80:0/1721082851 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcd7c009790 con 0x7fcd94152bd0 2019-11-28T11:40:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.660+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd94152bd0 0x7fcd94140440 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7fcd7c0103a0 tx=0x7fcd7c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.660+0000 7fcd8bfff700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd6c018770 0x7fcd6c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.660+0000 7fcd8bfff700 1 -- 172.21.15.80:0/1721082851 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fcd7c0319d0 con 0x7fcd94152bd0 2019-11-28T11:40:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.660+0000 7fcd9359e700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd6c018770 0x7fcd6c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.660+0000 7fcd9359e700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd6c018770 0x7fcd6c01abe0 crc :-1 s=READY pgs=537 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:29.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.667+0000 7fcd99210700 1 -- 172.21.15.80:0/1721082851 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9407b810 con 0x7fcd94152bd0 2019-11-28T11:40:29.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.671+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd94152bd0 0x7fcd94140440 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7fcd7c0103a0 tx=0x7fcd7c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:29.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.671+0000 7fcd8bfff700 1 -- 172.21.15.80:0/1721082851 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcd7c009580 con 0x7fcd94152bd0 2019-11-28T11:40:29.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.843+0000 7fcd99210700 1 -- 172.21.15.80:0/1721082851 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd9407b490 con 0x7fcd94152bd0 2019-11-28T11:40:29.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.843+0000 7fcd92d9d700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd94152bd0 0x7fcd94140440 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7fcd7c0103a0 tx=0x7fcd7c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:29.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.844+0000 7fcd8bfff700 1 -- 172.21.15.80:0/1721082851 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fcd7c009790 con 0x7fcd94152bd0 2019-11-28T11:40:29.875 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:29.875 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:29.875 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:29.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.845+0000 7fcd99210700 1 -- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd6c018770 msgr2=0x7fcd6c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:29.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.845+0000 7fcd99210700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd6c018770 0x7fcd6c01abe0 crc :-1 s=READY pgs=537 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:29.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.845+0000 7fcd99210700 1 -- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd94152bd0 msgr2=0x7fcd94140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:29.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.846+0000 7fcd99210700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd94152bd0 0x7fcd94140440 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7fcd7c0103a0 tx=0x7fcd7c010740).stop 2019-11-28T11:40:29.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.846+0000 7fcd99210700 1 -- 172.21.15.80:0/1721082851 shutdown_connections 2019-11-28T11:40:29.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.846+0000 7fcd99210700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd6c018770 0x7fcd6c01abe0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:29.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.846+0000 7fcd99210700 1 --2- 172.21.15.80:0/1721082851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd94152bd0 0x7fcd94140440 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:29.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.846+0000 7fcd99210700 1 --2- 172.21.15.80:0/1721082851 >> v2:172.21.15.174:3300/0 conn(0x7fcd94074d00 0x7fcd940750f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:29.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.846+0000 7fcd99210700 1 -- 172.21.15.80:0/1721082851 shutdown_connections 2019-11-28T11:40:29.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.846+0000 7fcd99210700 1 -- 172.21.15.80:0/1721082851 wait complete. 2019-11-28T11:40:29.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:29.846+0000 7fcd99210700 1 -- 172.21.15.80:0/1721082851 >> 172.21.15.80:0/1721082851 conn(0x7fcd9413fa50 msgr2=0x7fcd9407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:29.887 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:30.888 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:31.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.977+0000 7f7dd79a6700 1 Processor -- start 2019-11-28T11:40:31.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.977+0000 7f7dd79a6700 1 -- start start 2019-11-28T11:40:31.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.978+0000 7f7dd79a6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7dd006c490 0x7f7dd006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:31.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.978+0000 7f7dd79a6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd006db00 con 0x7f7dd006ce60 2019-11-28T11:40:31.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.978+0000 7f7dd79a6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd006e000 con 0x7f7dd006c0a0 2019-11-28T11:40:31.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.978+0000 7f7dd79a6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd006fd60 con 0x7f7dd006c490 2019-11-28T11:40:31.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.978+0000 7f7dd6744700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7dd006ce60 0x7f7dd0164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37188/0 (socket says 172.21.15.80:37188) 2019-11-28T11:40:31.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.978+0000 7f7dd6744700 1 -- 172.21.15.80:0/4053302105 learned_addr learned my addr 172.21.15.80:0/4053302105 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:31.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.978+0000 7f7dd5742700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7dd006c490 0x7f7dd006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:31.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.978+0000 7f7dd4f41700 1 -- 172.21.15.80:0/4053302105 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277337493 0 0) 0x7f7dc80014d0 con 0x7f7dd006ce60 2019-11-28T11:40:31.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.978+0000 7f7dd4f41700 1 -- 172.21.15.80:0/4053302105 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7db8002e80 con 0x7f7dd006ce60 2019-11-28T11:40:31.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.978+0000 7f7dd4f41700 1 -- 172.21.15.80:0/4053302105 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423149109 0 0) 0x7f7dc4001080 con 0x7f7dd006c0a0 2019-11-28T11:40:31.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.978+0000 7f7dd4f41700 1 -- 172.21.15.80:0/4053302105 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7db80030b0 con 0x7f7dd006c0a0 2019-11-28T11:40:31.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.978+0000 7f7dd4f41700 1 -- 172.21.15.80:0/4053302105 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1291574507 0 0) 0x7f7dc80014b0 con 0x7f7dd006ce60 2019-11-28T11:40:31.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.978+0000 7f7dd4f41700 1 -- 172.21.15.80:0/4053302105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7dd006c490 msgr2=0x7f7dd006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:31.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.978+0000 7f7dd4f41700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7dd006c490 0x7f7dd006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:31.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.978+0000 7f7dd4f41700 1 -- 172.21.15.80:0/4053302105 >> v1:172.21.15.174:6789/0 conn(0x7f7dd006c0a0 legacy=0x7f7dd0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:31.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.978+0000 7f7dd4f41700 1 -- 172.21.15.80:0/4053302105 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd00706c0 con 0x7f7dd006ce60 2019-11-28T11:40:31.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd4f41700 1 -- 172.21.15.80:0/4053302105 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f7dc80019e0 con 0x7f7dd006ce60 2019-11-28T11:40:31.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd5742700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7dd006c490 0x7f7dd006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:40:31.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd4f41700 1 -- 172.21.15.80:0/4053302105 >> v1:172.21.15.80:6789/0 conn(0x7f7dd006ce60 legacy=0x7f7dd0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:31.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd4f41700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7db8003b80 0x7f7db8005fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:31.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd4f41700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7db8006670 0x7f7db8008b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:31.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd4f41700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db804d310 0x7f7db804f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:31.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd4f41700 1 -- 172.21.15.80:0/4053302105 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db804fff0 con 0x7f7db804d310 2019-11-28T11:40:31.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd4f41700 1 -- 172.21.15.80:0/4053302105 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db80501e0 con 0x7f7db8006670 2019-11-28T11:40:31.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd4f41700 1 -- 172.21.15.80:0/4053302105 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db8050410 con 0x7f7db8003b80 2019-11-28T11:40:31.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd6744700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db804d310 0x7f7db804f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:31.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd5f43700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7db8003b80 0x7f7db8005fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:31.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd5742700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7db8006670 0x7f7db8008b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:31.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd6744700 1 -- 172.21.15.80:0/4053302105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7db8003b80 msgr2=0x7f7db8005fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:31.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd6744700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7db8003b80 0x7f7db8005fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:31.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd6744700 1 -- 172.21.15.80:0/4053302105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7db8006670 msgr2=0x7f7db8008b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:31.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd6744700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7db8006670 0x7f7db8008b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:31.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd6744700 1 -- 172.21.15.80:0/4053302105 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db80506c0 con 0x7f7db804d310 2019-11-28T11:40:31.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd6744700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db804d310 0x7f7db804f7e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7dc800fc90 tx=0x7f7dc800fb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:31.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd6744700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db804d310 0x7f7db804f7e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7dc800fc90 tx=0x7f7dc800fb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:31.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd6744700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db804d310 0x7f7db804f7e0 secure :-1 s=READY pgs=1305 cs=0 l=1 rx=0x7f7dc800fc90 tx=0x7f7dc800fb90).ready entity=mon.0 client_cookie=35adca1772ab047 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:31.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd6744700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db804d310 0x7f7db804f7e0 secure :-1 s=THROTTLE_DONE pgs=1305 cs=0 l=1 rx=0x7f7dc800fc90 tx=0x7f7dc800fb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:31.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd6744700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db804d310 0x7f7db804f7e0 secure :-1 s=THROTTLE_DONE pgs=1305 cs=0 l=1 rx=0x7f7dc800fc90 tx=0x7f7dc800fb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:31.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd4f41700 1 -- 172.21.15.80:0/4053302105 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dc80014b0 con 0x7f7db804d310 2019-11-28T11:40:31.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd6744700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db804d310 0x7f7db804f7e0 secure :-1 s=THROTTLE_DONE pgs=1305 cs=0 l=1 rx=0x7f7dc800fc90 tx=0x7f7dc800fb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:31.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd4f41700 1 -- 172.21.15.80:0/4053302105 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc80045c0 con 0x7f7db804d310 2019-11-28T11:40:31.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd4f41700 1 -- 172.21.15.80:0/4053302105 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dc8004c90 con 0x7f7db804d310 2019-11-28T11:40:31.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd79a6700 1 -- 172.21.15.80:0/4053302105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db804d310 msgr2=0x7f7db804f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:31.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd79a6700 1 --2- 172.21.15.80:0/4053302105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db804d310 0x7f7db804f7e0 secure :-1 s=READY pgs=1305 cs=0 l=1 rx=0x7f7dc800fc90 tx=0x7f7dc800fb90).stop 2019-11-28T11:40:31.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.979+0000 7f7dd6744700 1 -- 172.21.15.80:0/4053302105 reap_dead start 2019-11-28T11:40:31.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.980+0000 7f7dd79a6700 1 -- 172.21.15.80:0/4053302105 shutdown_connections 2019-11-28T11:40:31.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.980+0000 7f7dd79a6700 1 -- 172.21.15.80:0/4053302105 shutdown_connections 2019-11-28T11:40:31.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.980+0000 7f7dd79a6700 1 -- 172.21.15.80:0/4053302105 wait complete. 2019-11-28T11:40:31.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.980+0000 7f7dd79a6700 1 -- 172.21.15.80:0/4053302105 >> 172.21.15.80:0/4053302105 conn(0x7f7dd0061cf0 msgr2=0x7f7dd0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:31.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.983+0000 7f7dd79a6700 1 Processor -- start 2019-11-28T11:40:31.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.983+0000 7f7dd79a6700 1 -- start start 2019-11-28T11:40:31.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.983+0000 7f7dd79a6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7dd0150f50 0x7f7dd007b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:31.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.983+0000 7f7dd79a6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7dd007bba0 0x7f7dd0167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:31.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.983+0000 7f7dd79a6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd00754d0 con 0x7f7dd0074d00 2019-11-28T11:40:31.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.983+0000 7f7dd79a6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd0078980 con 0x7f7dd0150f50 2019-11-28T11:40:31.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.983+0000 7f7dd79a6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd0078c50 con 0x7f7dd007bba0 2019-11-28T11:40:31.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd5742700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7dd0150f50 0x7f7dd007b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:31.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd5742700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7dd0150f50 0x7f7dd007b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37884/0 (socket says 172.21.15.80:37884) 2019-11-28T11:40:31.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd5742700 1 -- 172.21.15.80:0/2056191595 learned_addr learned my addr 172.21.15.80:0/2056191595 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:31.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd6744700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7dd007bba0 0x7f7dd0167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:31.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd5742700 1 -- 172.21.15.80:0/2056191595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7dd007bba0 msgr2=0x7f7dd0167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:31.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd5742700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7dd007bba0 0x7f7dd0167c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:31.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd5742700 1 -- 172.21.15.80:0/2056191595 >> v1:172.21.15.174:6789/0 conn(0x7f7dd0074d00 legacy=0x7f7dd007aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:31.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd5742700 1 -- 172.21.15.80:0/2056191595 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd00792e0 con 0x7f7dd0150f50 2019-11-28T11:40:31.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd5742700 1 --2- 172.21.15.80:0/2056191595 >> v2:172.21.15.80:3300/0 conn(0x7f7dd0150f50 0x7f7dd007b220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7dc0010430 tx=0x7f7dc00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:31.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd5742700 1 --2- 172.21.15.80:0/2056191595 >> v2:172.21.15.80:3300/0 conn(0x7f7dd0150f50 0x7f7dd007b220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7dc0010430 tx=0x7f7dc00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:31.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd5742700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd0150f50 0x7f7dd007b220 secure :-1 s=READY pgs=1306 cs=0 l=1 rx=0x7f7dc0010430 tx=0x7f7dc00102b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:31.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd5742700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd0150f50 0x7f7dd007b220 secure :-1 s=THROTTLE_DONE pgs=1306 cs=0 l=1 rx=0x7f7dc0010430 tx=0x7f7dc00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:31.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd5742700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd0150f50 0x7f7dd007b220 secure :-1 s=THROTTLE_DONE pgs=1306 cs=0 l=1 rx=0x7f7dc0010430 tx=0x7f7dc00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:31.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd5742700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd0150f50 0x7f7dd007b220 secure :-1 s=THROTTLE_DONE pgs=1306 cs=0 l=1 rx=0x7f7dc0010430 tx=0x7f7dc00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:31.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dce7fc700 1 -- 172.21.15.80:0/2056191595 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dc0000960 con 0x7f7dd0150f50 2019-11-28T11:40:31.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dce7fc700 1 -- 172.21.15.80:0/2056191595 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc000ef80 con 0x7f7dd0150f50 2019-11-28T11:40:31.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd79a6700 1 -- 172.21.15.80:0/2056191595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd0079660 con 0x7f7dd0150f50 2019-11-28T11:40:31.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dce7fc700 1 -- 172.21.15.80:0/2056191595 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dc000f650 con 0x7f7dd0150f50 2019-11-28T11:40:31.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd79a6700 1 -- 172.21.15.80:0/2056191595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd00792e0 con 0x7f7dd0150f50 2019-11-28T11:40:31.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.984+0000 7f7dd5742700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd0150f50 0x7f7dd007b220 secure :-1 s=THROTTLE_DONE pgs=1306 cs=0 l=1 rx=0x7f7dc0010430 tx=0x7f7dc00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:31.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.985+0000 7f7dce7fc700 1 -- 172.21.15.80:0/2056191595 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7dc000eb10 con 0x7f7dd0150f50 2019-11-28T11:40:31.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.985+0000 7f7dd5742700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd0150f50 0x7f7dd007b220 secure :-1 s=THROTTLE_DONE pgs=1306 cs=0 l=1 rx=0x7f7dc0010430 tx=0x7f7dc00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:31.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.985+0000 7f7dce7fc700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7db0018730 0x7f7db001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:31.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.985+0000 7f7dce7fc700 1 -- 172.21.15.80:0/2056191595 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f7dc0031d80 con 0x7f7dd0150f50 2019-11-28T11:40:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.985+0000 7f7dd5f43700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7db0018730 0x7f7db001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.985+0000 7f7dd5f43700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7db0018730 0x7f7db001abe0 crc :-1 s=READY pgs=538 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.992+0000 7f7dd79a6700 1 -- 172.21.15.80:0/2056191595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd0079660 con 0x7f7dd0150f50 2019-11-28T11:40:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.995+0000 7f7dd5742700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd0150f50 0x7f7dd007b220 secure :-1 s=THROTTLE_DONE pgs=1306 cs=0 l=1 rx=0x7f7dc0010430 tx=0x7f7dc00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:31.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:30.995+0000 7f7dce7fc700 1 -- 172.21.15.80:0/2056191595 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7dc0009250 con 0x7f7dd0150f50 2019-11-28T11:40:31.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:31.166+0000 7f7dd79a6700 1 -- 172.21.15.80:0/2056191595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dd00792e0 con 0x7f7dd0150f50 2019-11-28T11:40:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:31.166+0000 7f7dd5742700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd0150f50 0x7f7dd007b220 secure :-1 s=THROTTLE_DONE pgs=1306 cs=0 l=1 rx=0x7f7dc0010430 tx=0x7f7dc00102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:31.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:31.166+0000 7f7dce7fc700 1 -- 172.21.15.80:0/2056191595 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f7dc000ea70 con 0x7f7dd0150f50 2019-11-28T11:40:31.198 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:31.198 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:31.198 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:31.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:31.169+0000 7f7dd79a6700 1 -- 172.21.15.80:0/2056191595 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7db0018730 msgr2=0x7f7db001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:31.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:31.169+0000 7f7dd79a6700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7db0018730 0x7f7db001abe0 crc :-1 s=READY pgs=538 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:31.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:31.169+0000 7f7dd79a6700 1 -- 172.21.15.80:0/2056191595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd0150f50 msgr2=0x7f7dd007b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:31.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:31.169+0000 7f7dd79a6700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd0150f50 0x7f7dd007b220 secure :-1 s=READY pgs=1306 cs=0 l=1 rx=0x7f7dc0010430 tx=0x7f7dc00102b0).stop 2019-11-28T11:40:31.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:31.169+0000 7f7dd79a6700 1 -- 172.21.15.80:0/2056191595 shutdown_connections 2019-11-28T11:40:31.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:31.169+0000 7f7dd79a6700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7dd007bba0 0x7f7dd0167c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:31.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:31.169+0000 7f7dd79a6700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7dd0150f50 0x7f7dd007b220 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:31.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:31.169+0000 7f7dd79a6700 1 --2- 172.21.15.80:0/2056191595 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7db0018730 0x7f7db001abe0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:31.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:31.169+0000 7f7dd79a6700 1 -- 172.21.15.80:0/2056191595 shutdown_connections 2019-11-28T11:40:31.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:31.169+0000 7f7dd79a6700 1 -- 172.21.15.80:0/2056191595 wait complete. 2019-11-28T11:40:31.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:31.169+0000 7f7dd79a6700 1 -- 172.21.15.80:0/2056191595 >> 172.21.15.80:0/2056191595 conn(0x7f7dd013fa50 msgr2=0x7f7dd007c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:31.210 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:32.211 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:32.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.302+0000 7f20492e2700 1 Processor -- start 2019-11-28T11:40:32.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.302+0000 7f20492e2700 1 -- start start 2019-11-28T11:40:32.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.303+0000 7f20492e2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204406d120 0x7f2044165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:32.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.303+0000 7f20492e2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204406d580 con 0x7f204406c0a0 2019-11-28T11:40:32.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.303+0000 7f20492e2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204406db00 con 0x7f204406c490 2019-11-28T11:40:32.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.303+0000 7f20492e2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204406fd60 con 0x7f204406d120 2019-11-28T11:40:32.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.303+0000 7f20437fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f204406c0a0 0x7f2044072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37206/0 (socket says 172.21.15.80:37206) 2019-11-28T11:40:32.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.303+0000 7f20437fe700 1 -- 172.21.15.80:0/1173494137 learned_addr learned my addr 172.21.15.80:0/1173494137 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:32.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.303+0000 7f20427fc700 1 -- 172.21.15.80:0/1173494137 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941145366 0 0) 0x7f2034001480 con 0x7f204406c0a0 2019-11-28T11:40:32.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.303+0000 7f20427fc700 1 -- 172.21.15.80:0/1173494137 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2024002e80 con 0x7f204406c0a0 2019-11-28T11:40:32.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.303+0000 7f2043fff700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204406d120 0x7f2044165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:32.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20427fc700 1 -- 172.21.15.80:0/1173494137 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2827662947 0 0) 0x7f2034001460 con 0x7f204406c0a0 2019-11-28T11:40:32.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20427fc700 1 -- 172.21.15.80:0/1173494137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204406d120 msgr2=0x7f2044165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:32.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20427fc700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204406d120 0x7f2044165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:32.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20427fc700 1 -- 172.21.15.80:0/1173494137 >> v1:172.21.15.174:6789/0 conn(0x7f204406c490 legacy=0x7f204406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:32.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20427fc700 1 -- 172.21.15.80:0/1173494137 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20440706c0 con 0x7f204406c0a0 2019-11-28T11:40:32.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20427fc700 1 -- 172.21.15.80:0/1173494137 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f20340019f0 con 0x7f204406c0a0 2019-11-28T11:40:32.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20427fc700 1 -- 172.21.15.80:0/1173494137 >> v1:172.21.15.80:6789/0 conn(0x7f204406c0a0 legacy=0x7f2044072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:32.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20427fc700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2024003ab0 0x7f2024005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:32.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20427fc700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2024006670 0x7f2024008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:32.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20427fc700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2024009380 0x7f202400b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:32.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20427fc700 1 -- 172.21.15.80:0/1173494137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202400bfd0 con 0x7f2024003ab0 2019-11-28T11:40:32.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20427fc700 1 -- 172.21.15.80:0/1173494137 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20240501d0 con 0x7f2024006670 2019-11-28T11:40:32.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20427fc700 1 -- 172.21.15.80:0/1173494137 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2024050400 con 0x7f2024009380 2019-11-28T11:40:32.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20437fe700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2024003ab0 0x7f2024005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:32.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f2043fff700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2024009380 0x7f202400b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:32.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f2042ffd700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2024006670 0x7f2024008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:32.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20437fe700 1 -- 172.21.15.80:0/1173494137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2024009380 msgr2=0x7f202400b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:32.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20437fe700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2024009380 0x7f202400b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:32.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20437fe700 1 -- 172.21.15.80:0/1173494137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2024006670 msgr2=0x7f2024008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:32.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20437fe700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2024006670 0x7f2024008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:32.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20437fe700 1 -- 172.21.15.80:0/1173494137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20240506b0 con 0x7f2024003ab0 2019-11-28T11:40:32.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f2043fff700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2024009380 0x7f202400b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:40:32.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20437fe700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2024003ab0 0x7f2024005ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f203400fc90 tx=0x7f203400fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:32.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20437fe700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2024003ab0 0x7f2024005ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f203400fc90 tx=0x7f203400fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:32.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20437fe700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2024003ab0 0x7f2024005ef0 secure :-1 s=READY pgs=1308 cs=0 l=1 rx=0x7f203400fc90 tx=0x7f203400fb10).ready entity=mon.0 client_cookie=8f1038e4a7cfbdd7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:32.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20437fe700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2024003ab0 0x7f2024005ef0 secure :-1 s=THROTTLE_DONE pgs=1308 cs=0 l=1 rx=0x7f203400fc90 tx=0x7f203400fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:32.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20427fc700 1 -- 172.21.15.80:0/1173494137 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2034001b40 con 0x7f2024003ab0 2019-11-28T11:40:32.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20437fe700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2024003ab0 0x7f2024005ef0 secure :-1 s=THROTTLE_DONE pgs=1308 cs=0 l=1 rx=0x7f203400fc90 tx=0x7f203400fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20437fe700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2024003ab0 0x7f2024005ef0 secure :-1 s=THROTTLE_DONE pgs=1308 cs=0 l=1 rx=0x7f203400fc90 tx=0x7f203400fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20427fc700 1 -- 172.21.15.80:0/1173494137 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2034001460 con 0x7f2024003ab0 2019-11-28T11:40:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20427fc700 1 -- 172.21.15.80:0/1173494137 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20340049a0 con 0x7f2024003ab0 2019-11-28T11:40:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20492e2700 1 -- 172.21.15.80:0/1173494137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2024003ab0 msgr2=0x7f2024005ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f20492e2700 1 --2- 172.21.15.80:0/1173494137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2024003ab0 0x7f2024005ef0 secure :-1 s=READY pgs=1308 cs=0 l=1 rx=0x7f203400fc90 tx=0x7f203400fb10).stop 2019-11-28T11:40:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.304+0000 7f2043fff700 1 -- 172.21.15.80:0/1173494137 reap_dead start 2019-11-28T11:40:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.305+0000 7f20492e2700 1 -- 172.21.15.80:0/1173494137 shutdown_connections 2019-11-28T11:40:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.305+0000 7f20492e2700 1 -- 172.21.15.80:0/1173494137 shutdown_connections 2019-11-28T11:40:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.305+0000 7f20492e2700 1 -- 172.21.15.80:0/1173494137 wait complete. 2019-11-28T11:40:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.305+0000 7f20492e2700 1 -- 172.21.15.80:0/1173494137 >> 172.21.15.80:0/1173494137 conn(0x7f2044061cf0 msgr2=0x7f2044064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.307+0000 7f20492e2700 1 Processor -- start 2019-11-28T11:40:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.308+0000 7f20492e2700 1 -- start start 2019-11-28T11:40:32.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f20492e2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2044152250 0x7f2044169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:32.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f20492e2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2044079230 con 0x7f2044074d00 2019-11-28T11:40:32.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f20492e2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2044079890 con 0x7f20440750f0 2019-11-28T11:40:32.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f20492e2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204407ab30 con 0x7f2044152250 2019-11-28T11:40:32.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f20437fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2044074d00 0x7f2044152bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37218/0 (socket says 172.21.15.80:37218) 2019-11-28T11:40:32.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f20437fe700 1 -- 172.21.15.80:0/2036320303 learned_addr learned my addr 172.21.15.80:0/2036320303 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f2043fff700 1 --2- 172.21.15.80:0/2036320303 >> v2:172.21.15.174:3300/0 conn(0x7f2044152250 0x7f2044169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638599621 0 0) 0x7f2034001120 con 0x7f2044074d00 2019-11-28T11:40:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f201c002e80 con 0x7f2044074d00 2019-11-28T11:40:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3005741177 0 0) 0x7f2034001fe0 con 0x7f2044074d00 2019-11-28T11:40:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f201c0032e0 con 0x7f2044074d00 2019-11-28T11:40:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f2034001940 con 0x7f2044074d00 2019-11-28T11:40:32.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 >> v2:172.21.15.174:3300/0 conn(0x7f2044152250 msgr2=0x7f2044169d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:32.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f203bfff700 1 --2- 172.21.15.80:0/2036320303 >> v2:172.21.15.174:3300/0 conn(0x7f2044152250 0x7f2044169d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:32.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 >> v1:172.21.15.174:6789/0 conn(0x7f20440750f0 legacy=0x7f2044151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:32.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 >> v1:172.21.15.80:6789/0 conn(0x7f2044074d00 legacy=0x7f2044152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:32.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f203bfff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f201c003380 0x7f201c0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:32.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f203bfff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f201c003d10 0x7f201c004190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:32.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f203bfff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f201c004950 0x7f201c004df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:32.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c00bbf0 con 0x7f201c004950 2019-11-28T11:40:32.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c00be20 con 0x7f201c003d10 2019-11-28T11:40:32.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c00c050 con 0x7f201c003380 2019-11-28T11:40:32.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f2043fff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f201c004950 0x7f201c004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:32.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f20437fe700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f201c003380 0x7f201c0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:32.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.309+0000 7f2042ffd700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f201c003d10 0x7f201c004190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:32.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f2043fff700 1 -- 172.21.15.80:0/2036320303 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f201c003380 msgr2=0x7f201c0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:32.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f2043fff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f201c003380 0x7f201c0037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:32.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f2043fff700 1 -- 172.21.15.80:0/2036320303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f201c003d10 msgr2=0x7f201c004190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:32.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f2043fff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f201c003d10 0x7f201c004190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:32.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f2043fff700 1 -- 172.21.15.80:0/2036320303 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c00c300 con 0x7f201c004950 2019-11-28T11:40:32.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f20492e2700 1 -- 172.21.15.80:0/2036320303 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204407b810 con 0x7f201c004950 2019-11-28T11:40:32.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f2043fff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f201c004950 0x7f201c004df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f203c0105e0 tx=0x7f203c010490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:32.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f20492e2700 1 -- 172.21.15.80:0/2036320303 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204407b490 con 0x7f201c004950 2019-11-28T11:40:32.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f2043fff700 1 -- 172.21.15.80:0/2036320303 reap_dead start 2019-11-28T11:40:32.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f2043fff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f201c004950 0x7f201c004df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f203c0105e0 tx=0x7f203c010490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:32.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f2043fff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f201c004950 0x7f201c004df0 secure :-1 s=READY pgs=1310 cs=0 l=1 rx=0x7f203c0105e0 tx=0x7f203c010490).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:32.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f2043fff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f201c004950 0x7f201c004df0 secure :-1 s=THROTTLE_DONE pgs=1310 cs=0 l=1 rx=0x7f203c0105e0 tx=0x7f203c010490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:32.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f203c000a70 con 0x7f201c004950 2019-11-28T11:40:32.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f2043fff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f201c004950 0x7f201c004df0 secure :-1 s=THROTTLE_DONE pgs=1310 cs=0 l=1 rx=0x7f203c0105e0 tx=0x7f203c010490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:32.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c00aac0 con 0x7f201c004950 2019-11-28T11:40:32.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f2043fff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f201c004950 0x7f201c004df0 secure :-1 s=THROTTLE_DONE pgs=1310 cs=0 l=1 rx=0x7f203c0105e0 tx=0x7f203c010490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:32.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f203c000a70 con 0x7f201c004950 2019-11-28T11:40:32.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f2043fff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f201c004950 0x7f201c004df0 secure :-1 s=THROTTLE_DONE pgs=1310 cs=0 l=1 rx=0x7f203c0105e0 tx=0x7f203c010490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:32.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f203c00af80 con 0x7f201c004950 2019-11-28T11:40:32.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f2043fff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f201c004950 0x7f201c004df0 secure :-1 s=THROTTLE_DONE pgs=1310 cs=0 l=1 rx=0x7f203c0105e0 tx=0x7f203c010490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:32.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.310+0000 7f203bfff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f201c01b470 0x7f201c01d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:32.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.311+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f203c031b30 con 0x7f201c004950 2019-11-28T11:40:32.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.311+0000 7f20437fe700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f201c01b470 0x7f201c01d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:32.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.311+0000 7f20437fe700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f201c01b470 0x7f201c01d8c0 crc :-1 s=READY pgs=539 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:32.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.318+0000 7f20492e2700 1 -- 172.21.15.80:0/2036320303 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2020002e60 con 0x7f201c004950 2019-11-28T11:40:32.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.321+0000 7f2043fff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f201c004950 0x7f201c004df0 secure :-1 s=THROTTLE_DONE pgs=1310 cs=0 l=1 rx=0x7f203c0105e0 tx=0x7f203c010490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:32.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.321+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f203c00aac0 con 0x7f201c004950 2019-11-28T11:40:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.493+0000 7f20492e2700 1 -- 172.21.15.80:0/2036320303 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2020001d10 con 0x7f201c004950 2019-11-28T11:40:32.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.493+0000 7f2043fff700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f201c004950 0x7f201c004df0 secure :-1 s=THROTTLE_DONE pgs=1310 cs=0 l=1 rx=0x7f203c0105e0 tx=0x7f203c010490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:32.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.493+0000 7f203bfff700 1 -- 172.21.15.80:0/2036320303 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f203c00acd0 con 0x7f201c004950 2019-11-28T11:40:32.525 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:32.525 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:32.525 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:32.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.496+0000 7f20492e2700 1 -- 172.21.15.80:0/2036320303 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f201c01b470 msgr2=0x7f201c01d8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:32.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.496+0000 7f20492e2700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f201c01b470 0x7f201c01d8c0 crc :-1 s=READY pgs=539 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:32.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.496+0000 7f20492e2700 1 -- 172.21.15.80:0/2036320303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f201c004950 msgr2=0x7f201c004df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:32.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.496+0000 7f20492e2700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f201c004950 0x7f201c004df0 secure :-1 s=READY pgs=1310 cs=0 l=1 rx=0x7f203c0105e0 tx=0x7f203c010490).stop 2019-11-28T11:40:32.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.496+0000 7f20492e2700 1 -- 172.21.15.80:0/2036320303 shutdown_connections 2019-11-28T11:40:32.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.496+0000 7f20492e2700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f201c01b470 0x7f201c01d8c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:32.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.496+0000 7f20492e2700 1 --2- 172.21.15.80:0/2036320303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f201c004950 0x7f201c004df0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:32.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.496+0000 7f20492e2700 1 -- 172.21.15.80:0/2036320303 shutdown_connections 2019-11-28T11:40:32.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.496+0000 7f20492e2700 1 -- 172.21.15.80:0/2036320303 wait complete. 2019-11-28T11:40:32.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:32.496+0000 7f20492e2700 1 -- 172.21.15.80:0/2036320303 >> 172.21.15.80:0/2036320303 conn(0x7f204413fa50 msgr2=0x7f204407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:32.537 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:33.537 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.627+0000 7f416c12b700 1 Processor -- start 2019-11-28T11:40:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.627+0000 7f416c12b700 1 -- start start 2019-11-28T11:40:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.628+0000 7f416c12b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f416406c0a0 0x7f4164072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.628+0000 7f416c12b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41640734e0 0x7f4164071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.628+0000 7f416c12b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f416406db00 con 0x7f4164072360 2019-11-28T11:40:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.628+0000 7f416c12b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416406fd60 con 0x7f41640734e0 2019-11-28T11:40:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.628+0000 7f416c12b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4164070030 con 0x7f416406c0a0 2019-11-28T11:40:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.628+0000 7f4169ec7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41640734e0 0x7f4164071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.628+0000 7f4169ec7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41640734e0 0x7f4164071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37920/0 (socket says 172.21.15.80:37920) 2019-11-28T11:40:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.628+0000 7f4169ec7700 1 -- 172.21.15.80:0/1277156177 learned_addr learned my addr 172.21.15.80:0/1277156177 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.629+0000 7f416a6c8700 1 --2- 172.21.15.80:0/1277156177 >> v2:172.21.15.174:3300/0 conn(0x7f416406c0a0 0x7f4164072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:33.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.629+0000 7f4169ec7700 1 -- 172.21.15.80:0/1277156177 >> v2:172.21.15.174:3300/0 conn(0x7f416406c0a0 msgr2=0x7f4164072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:33.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.629+0000 7f4169ec7700 1 --2- 172.21.15.80:0/1277156177 >> v2:172.21.15.174:3300/0 conn(0x7f416406c0a0 0x7f4164072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:33.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.629+0000 7f4169ec7700 1 -- 172.21.15.80:0/1277156177 >> v1:172.21.15.174:6789/0 conn(0x7f4164072360 legacy=0x7f416406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:33.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.629+0000 7f4169ec7700 1 -- 172.21.15.80:0/1277156177 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41640706c0 con 0x7f41640734e0 2019-11-28T11:40:33.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.629+0000 7f4169ec7700 1 --2- 172.21.15.80:0/1277156177 >> v2:172.21.15.80:3300/0 conn(0x7f41640734e0 0x7f4164071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f414c00fa40 tx=0x7f414c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.629+0000 7f4169ec7700 1 --2- 172.21.15.80:0/1277156177 >> v2:172.21.15.80:3300/0 conn(0x7f41640734e0 0x7f4164071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f414c00fa40 tx=0x7f414c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.629+0000 7f4169ec7700 1 --2- 172.21.15.80:0/1277156177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41640734e0 0x7f4164071e20 secure :-1 s=READY pgs=1311 cs=0 l=1 rx=0x7f414c00fa40 tx=0x7f414c00fde0).ready entity=mon.0 client_cookie=42160583df312ce5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.629+0000 7f4169ec7700 1 --2- 172.21.15.80:0/1277156177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41640734e0 0x7f4164071e20 secure :-1 s=THROTTLE_DONE pgs=1311 cs=0 l=1 rx=0x7f414c00fa40 tx=0x7f414c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.629+0000 7f4169ec7700 1 --2- 172.21.15.80:0/1277156177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41640734e0 0x7f4164071e20 secure :-1 s=THROTTLE_DONE pgs=1311 cs=0 l=1 rx=0x7f414c00fa40 tx=0x7f414c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.629+0000 7f41696c6700 1 -- 172.21.15.80:0/1277156177 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414c000ce0 con 0x7f41640734e0 2019-11-28T11:40:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.629+0000 7f4169ec7700 1 --2- 172.21.15.80:0/1277156177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41640734e0 0x7f4164071e20 secure :-1 s=THROTTLE_DONE pgs=1311 cs=0 l=1 rx=0x7f414c00fa40 tx=0x7f414c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:33.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.629+0000 7f41696c6700 1 -- 172.21.15.80:0/1277156177 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414c001010 con 0x7f41640734e0 2019-11-28T11:40:33.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.629+0000 7f41696c6700 1 -- 172.21.15.80:0/1277156177 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414c001720 con 0x7f41640734e0 2019-11-28T11:40:33.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.629+0000 7f416c12b700 1 -- 172.21.15.80:0/1277156177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41640734e0 msgr2=0x7f4164071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:33.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.629+0000 7f416c12b700 1 --2- 172.21.15.80:0/1277156177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41640734e0 0x7f4164071e20 secure :-1 s=READY pgs=1311 cs=0 l=1 rx=0x7f414c00fa40 tx=0x7f414c00fde0).stop 2019-11-28T11:40:33.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.630+0000 7f416c12b700 1 -- 172.21.15.80:0/1277156177 shutdown_connections 2019-11-28T11:40:33.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.630+0000 7f416c12b700 1 --2- 172.21.15.80:0/1277156177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41640734e0 0x7f4164071e20 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:33.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.630+0000 7f416c12b700 1 --2- 172.21.15.80:0/1277156177 >> v2:172.21.15.174:3300/0 conn(0x7f416406c0a0 0x7f4164072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:33.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.630+0000 7f416c12b700 1 -- 172.21.15.80:0/1277156177 shutdown_connections 2019-11-28T11:40:33.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.630+0000 7f416c12b700 1 -- 172.21.15.80:0/1277156177 wait complete. 2019-11-28T11:40:33.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.630+0000 7f416c12b700 1 -- 172.21.15.80:0/1277156177 >> 172.21.15.80:0/1277156177 conn(0x7f4164061cf0 msgr2=0x7f4164064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:33.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.632+0000 7f416c12b700 1 Processor -- start 2019-11-28T11:40:33.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.633+0000 7f416c12b700 1 -- start start 2019-11-28T11:40:33.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.633+0000 7f416c12b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f416413e320 0x7f416413e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:33.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.633+0000 7f416c12b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f416412a3c0 0x7f416412a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:33.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.633+0000 7f416c12b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4164139e00 con 0x7f416415fdf0 2019-11-28T11:40:33.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.633+0000 7f416c12b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4164108820 con 0x7f416412a3c0 2019-11-28T11:40:33.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.633+0000 7f416c12b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4164108af0 con 0x7f416413e320 2019-11-28T11:40:33.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.633+0000 7f416aec9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f416412a3c0 0x7f416412a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:33.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.633+0000 7f416aec9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f416412a3c0 0x7f416412a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37926/0 (socket says 172.21.15.80:37926) 2019-11-28T11:40:33.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.633+0000 7f416aec9700 1 -- 172.21.15.80:0/3943864547 learned_addr learned my addr 172.21.15.80:0/3943864547 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:33.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.634+0000 7f4169ec7700 1 --2- 172.21.15.80:0/3943864547 >> v2:172.21.15.174:3300/0 conn(0x7f416413e320 0x7f416413e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:33.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.634+0000 7f416aec9700 1 -- 172.21.15.80:0/3943864547 >> v2:172.21.15.174:3300/0 conn(0x7f416413e320 msgr2=0x7f416413e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:33.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.634+0000 7f416aec9700 1 --2- 172.21.15.80:0/3943864547 >> v2:172.21.15.174:3300/0 conn(0x7f416413e320 0x7f416413e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:33.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.634+0000 7f416aec9700 1 -- 172.21.15.80:0/3943864547 >> v1:172.21.15.174:6789/0 conn(0x7f416415fdf0 legacy=0x7f416412b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:33.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.634+0000 7f416aec9700 1 -- 172.21.15.80:0/3943864547 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416410a8c0 con 0x7f416412a3c0 2019-11-28T11:40:33.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.634+0000 7f416aec9700 1 --2- 172.21.15.80:0/3943864547 >> v2:172.21.15.80:3300/0 conn(0x7f416412a3c0 0x7f416412a820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f415c010420 tx=0x7f415c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:33.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.634+0000 7f416aec9700 1 --2- 172.21.15.80:0/3943864547 >> v2:172.21.15.80:3300/0 conn(0x7f416412a3c0 0x7f416412a820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f415c010420 tx=0x7f415c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:33.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.634+0000 7f416aec9700 1 --2- 172.21.15.80:0/3943864547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f416412a3c0 0x7f416412a820 secure :-1 s=READY pgs=1312 cs=0 l=1 rx=0x7f415c010420 tx=0x7f415c010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:33.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.634+0000 7f416aec9700 1 --2- 172.21.15.80:0/3943864547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f416412a3c0 0x7f416412a820 secure :-1 s=THROTTLE_DONE pgs=1312 cs=0 l=1 rx=0x7f415c010420 tx=0x7f415c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:33.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.634+0000 7f416aec9700 1 --2- 172.21.15.80:0/3943864547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f416412a3c0 0x7f416412a820 secure :-1 s=THROTTLE_DONE pgs=1312 cs=0 l=1 rx=0x7f415c010420 tx=0x7f415c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:33.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.634+0000 7f4162ffd700 1 -- 172.21.15.80:0/3943864547 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f415c000960 con 0x7f416412a3c0 2019-11-28T11:40:33.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.634+0000 7f416aec9700 1 --2- 172.21.15.80:0/3943864547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f416412a3c0 0x7f416412a820 secure :-1 s=THROTTLE_DONE pgs=1312 cs=0 l=1 rx=0x7f415c010420 tx=0x7f415c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:33.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.634+0000 7f4162ffd700 1 -- 172.21.15.80:0/3943864547 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415c001090 con 0x7f416412a3c0 2019-11-28T11:40:33.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.634+0000 7f416c12b700 1 -- 172.21.15.80:0/3943864547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416410a8c0 con 0x7f416412a3c0 2019-11-28T11:40:33.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.634+0000 7f4162ffd700 1 -- 172.21.15.80:0/3943864547 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f415c001760 con 0x7f416412a3c0 2019-11-28T11:40:33.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.634+0000 7f416c12b700 1 -- 172.21.15.80:0/3943864547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f416410a8c0 con 0x7f416412a3c0 2019-11-28T11:40:33.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.635+0000 7f416aec9700 1 --2- 172.21.15.80:0/3943864547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f416412a3c0 0x7f416412a820 secure :-1 s=THROTTLE_DONE pgs=1312 cs=0 l=1 rx=0x7f415c010420 tx=0x7f415c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:33.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.635+0000 7f416aec9700 1 --2- 172.21.15.80:0/3943864547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f416412a3c0 0x7f416412a820 secure :-1 s=THROTTLE_DONE pgs=1312 cs=0 l=1 rx=0x7f415c010420 tx=0x7f415c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:33.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.635+0000 7f4162ffd700 1 -- 172.21.15.80:0/3943864547 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f415c000ea0 con 0x7f416412a3c0 2019-11-28T11:40:33.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.635+0000 7f4162ffd700 1 --2- 172.21.15.80:0/3943864547 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4148018730 0x7f414801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:33.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.635+0000 7f4162ffd700 1 -- 172.21.15.80:0/3943864547 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f415c031a20 con 0x7f416412a3c0 2019-11-28T11:40:33.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.635+0000 7f416a6c8700 1 --2- 172.21.15.80:0/3943864547 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4148018730 0x7f414801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:33.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.636+0000 7f416a6c8700 1 --2- 172.21.15.80:0/3943864547 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4148018730 0x7f414801abc0 crc :-1 s=READY pgs=540 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:33.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.642+0000 7f416c12b700 1 -- 172.21.15.80:0/3943864547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4164109180 con 0x7f416412a3c0 2019-11-28T11:40:33.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.646+0000 7f416aec9700 1 --2- 172.21.15.80:0/3943864547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f416412a3c0 0x7f416412a820 secure :-1 s=THROTTLE_DONE pgs=1312 cs=0 l=1 rx=0x7f415c010420 tx=0x7f415c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:33.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.646+0000 7f4162ffd700 1 -- 172.21.15.80:0/3943864547 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f415c031770 con 0x7f416412a3c0 2019-11-28T11:40:33.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.818+0000 7f416c12b700 1 -- 172.21.15.80:0/3943864547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4164109500 con 0x7f416412a3c0 2019-11-28T11:40:33.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.818+0000 7f416aec9700 1 --2- 172.21.15.80:0/3943864547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f416412a3c0 0x7f416412a820 secure :-1 s=THROTTLE_DONE pgs=1312 cs=0 l=1 rx=0x7f415c010420 tx=0x7f415c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:33.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.818+0000 7f4162ffd700 1 -- 172.21.15.80:0/3943864547 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f415c0173d0 con 0x7f416412a3c0 2019-11-28T11:40:33.851 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:33.852 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:33.852 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:33.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.821+0000 7f416c12b700 1 -- 172.21.15.80:0/3943864547 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4148018730 msgr2=0x7f414801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:33.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.821+0000 7f416c12b700 1 --2- 172.21.15.80:0/3943864547 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4148018730 0x7f414801abc0 crc :-1 s=READY pgs=540 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:33.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.821+0000 7f416c12b700 1 -- 172.21.15.80:0/3943864547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f416412a3c0 msgr2=0x7f416412a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:33.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.821+0000 7f416c12b700 1 --2- 172.21.15.80:0/3943864547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f416412a3c0 0x7f416412a820 secure :-1 s=READY pgs=1312 cs=0 l=1 rx=0x7f415c010420 tx=0x7f415c010280).stop 2019-11-28T11:40:33.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.821+0000 7f416c12b700 1 -- 172.21.15.80:0/3943864547 shutdown_connections 2019-11-28T11:40:33.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.821+0000 7f416c12b700 1 --2- 172.21.15.80:0/3943864547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f416412a3c0 0x7f416412a820 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:33.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.821+0000 7f416c12b700 1 --2- 172.21.15.80:0/3943864547 >> v2:172.21.15.174:3300/0 conn(0x7f416413e320 0x7f416413e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:33.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.821+0000 7f416c12b700 1 --2- 172.21.15.80:0/3943864547 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4148018730 0x7f414801abc0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:33.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.821+0000 7f416c12b700 1 -- 172.21.15.80:0/3943864547 shutdown_connections 2019-11-28T11:40:33.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.821+0000 7f416c12b700 1 -- 172.21.15.80:0/3943864547 wait complete. 2019-11-28T11:40:33.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:33.821+0000 7f416c12b700 1 -- 172.21.15.80:0/3943864547 >> 172.21.15.80:0/3943864547 conn(0x7f4164127dc0 msgr2=0x7f4164141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:33.863 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:34.864 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:34.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.955+0000 7f31b2819700 1 Processor -- start 2019-11-28T11:40:34.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.955+0000 7f31b2819700 1 -- start start 2019-11-28T11:40:34.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.956+0000 7f31b2819700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f31ac06c490 0x7f31ac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:34.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.956+0000 7f31b2819700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31ac06ce60 0x7f31ac164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:34.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.956+0000 7f31b2819700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ac06db00 con 0x7f31ac06c0a0 2019-11-28T11:40:34.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.956+0000 7f31b2819700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac06fd60 con 0x7f31ac06c490 2019-11-28T11:40:34.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.956+0000 7f31b2819700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac070030 con 0x7f31ac06ce60 2019-11-28T11:40:34.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.956+0000 7f31abfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f31ac06c490 0x7f31ac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:34.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.956+0000 7f31abfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f31ac06c490 0x7f31ac06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37930/0 (socket says 172.21.15.80:37930) 2019-11-28T11:40:34.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.956+0000 7f31abfff700 1 -- 172.21.15.80:0/898713082 learned_addr learned my addr 172.21.15.80:0/898713082 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:34.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.956+0000 7f31b15b7700 1 --2- 172.21.15.80:0/898713082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31ac06ce60 0x7f31ac164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:34.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.956+0000 7f31abfff700 1 -- 172.21.15.80:0/898713082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31ac06ce60 msgr2=0x7f31ac164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:34.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.956+0000 7f31abfff700 1 --2- 172.21.15.80:0/898713082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31ac06ce60 0x7f31ac164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:34.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.956+0000 7f31abfff700 1 -- 172.21.15.80:0/898713082 >> v1:172.21.15.174:6789/0 conn(0x7f31ac06c0a0 legacy=0x7f31ac072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:34.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.956+0000 7f31abfff700 1 -- 172.21.15.80:0/898713082 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac0706c0 con 0x7f31ac06c490 2019-11-28T11:40:34.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.956+0000 7f31abfff700 1 --2- 172.21.15.80:0/898713082 >> v2:172.21.15.80:3300/0 conn(0x7f31ac06c490 0x7f31ac06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f319400f6c0 tx=0x7f319400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:34.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.956+0000 7f31abfff700 1 --2- 172.21.15.80:0/898713082 >> v2:172.21.15.80:3300/0 conn(0x7f31ac06c490 0x7f31ac06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f319400f6c0 tx=0x7f319400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:34.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.956+0000 7f31abfff700 1 --2- 172.21.15.80:0/898713082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31ac06c490 0x7f31ac06c920 secure :-1 s=READY pgs=1313 cs=0 l=1 rx=0x7f319400f6c0 tx=0x7f319400fa60).ready entity=mon.0 client_cookie=c79250710f7870dd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:34.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.957+0000 7f31abfff700 1 --2- 172.21.15.80:0/898713082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31ac06c490 0x7f31ac06c920 secure :-1 s=THROTTLE_DONE pgs=1313 cs=0 l=1 rx=0x7f319400f6c0 tx=0x7f319400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:34.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.957+0000 7f31abfff700 1 --2- 172.21.15.80:0/898713082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31ac06c490 0x7f31ac06c920 secure :-1 s=THROTTLE_DONE pgs=1313 cs=0 l=1 rx=0x7f319400f6c0 tx=0x7f319400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:34.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.957+0000 7f31ab7fe700 1 -- 172.21.15.80:0/898713082 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3194000960 con 0x7f31ac06c490 2019-11-28T11:40:34.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.957+0000 7f31abfff700 1 --2- 172.21.15.80:0/898713082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31ac06c490 0x7f31ac06c920 secure :-1 s=THROTTLE_DONE pgs=1313 cs=0 l=1 rx=0x7f319400f6c0 tx=0x7f319400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:34.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.957+0000 7f31ab7fe700 1 -- 172.21.15.80:0/898713082 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3194000c90 con 0x7f31ac06c490 2019-11-28T11:40:34.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.957+0000 7f31ab7fe700 1 -- 172.21.15.80:0/898713082 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31940013a0 con 0x7f31ac06c490 2019-11-28T11:40:34.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.957+0000 7f31b2819700 1 -- 172.21.15.80:0/898713082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31ac06c490 msgr2=0x7f31ac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:34.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.957+0000 7f31b2819700 1 --2- 172.21.15.80:0/898713082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31ac06c490 0x7f31ac06c920 secure :-1 s=READY pgs=1313 cs=0 l=1 rx=0x7f319400f6c0 tx=0x7f319400fa60).stop 2019-11-28T11:40:34.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.957+0000 7f31b2819700 1 -- 172.21.15.80:0/898713082 shutdown_connections 2019-11-28T11:40:34.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.957+0000 7f31b2819700 1 --2- 172.21.15.80:0/898713082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31ac06ce60 0x7f31ac164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:34.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.957+0000 7f31b2819700 1 --2- 172.21.15.80:0/898713082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31ac06c490 0x7f31ac06c920 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:34.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.957+0000 7f31b2819700 1 -- 172.21.15.80:0/898713082 shutdown_connections 2019-11-28T11:40:34.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.957+0000 7f31b2819700 1 -- 172.21.15.80:0/898713082 wait complete. 2019-11-28T11:40:34.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.957+0000 7f31b2819700 1 -- 172.21.15.80:0/898713082 >> 172.21.15.80:0/898713082 conn(0x7f31ac061cf0 msgr2=0x7f31ac064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:35.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.960+0000 7f31b2819700 1 Processor -- start 2019-11-28T11:40:35.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.960+0000 7f31b2819700 1 -- start start 2019-11-28T11:40:35.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31b2819700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f31ac15fdf0 0x7f31ac12b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:35.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31b2819700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31ac12a3c0 0x7f31ac12a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:35.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31b2819700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ac13eb20 con 0x7f31ac12b8a0 2019-11-28T11:40:35.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31b2819700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac108820 con 0x7f31ac15fdf0 2019-11-28T11:40:35.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31b2819700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac108af0 con 0x7f31ac12a3c0 2019-11-28T11:40:35.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31abfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f31ac12b8a0 0x7f31ac13e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37252/0 (socket says 172.21.15.80:37252) 2019-11-28T11:40:35.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31abfff700 1 -- 172.21.15.80:0/4148525542 learned_addr learned my addr 172.21.15.80:0/4148525542 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:35.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31b0db6700 1 --2- 172.21.15.80:0/4148525542 >> v2:172.21.15.174:3300/0 conn(0x7f31ac15fdf0 0x7f31ac12b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:35.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31b15b7700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31ac12a3c0 0x7f31ac12a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:35.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484742347 0 0) 0x7f3194007b10 con 0x7f31ac12b8a0 2019-11-28T11:40:35.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3190002e80 con 0x7f31ac12b8a0 2019-11-28T11:40:35.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 148391934 0 0) 0x7f31940081b0 con 0x7f31ac12b8a0 2019-11-28T11:40:35.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f31900032e0 con 0x7f31ac12b8a0 2019-11-28T11:40:35.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f3194000940 con 0x7f31ac12b8a0 2019-11-28T11:40:35.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31ac12a3c0 msgr2=0x7f31ac12a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:35.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31a97fa700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31ac12a3c0 0x7f31ac12a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:35.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 >> v2:172.21.15.174:3300/0 conn(0x7f31ac15fdf0 msgr2=0x7f31ac12b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:35.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31a97fa700 1 --2- 172.21.15.80:0/4148525542 >> v2:172.21.15.174:3300/0 conn(0x7f31ac15fdf0 0x7f31ac12b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:35.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 >> v1:172.21.15.80:6789/0 conn(0x7f31ac12b8a0 legacy=0x7f31ac13e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:35.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31a97fa700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003370 0x7f31900037c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:35.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31a97fa700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3190003d00 0x7f3190004150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:35.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31a97fa700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3190004890 0x7f3190004d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:35.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319000bb60 con 0x7f3190003370 2019-11-28T11:40:35.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319000bd50 con 0x7f3190003d00 2019-11-28T11:40:35.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319000bf80 con 0x7f3190004890 2019-11-28T11:40:35.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.961+0000 7f31b0db6700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003370 0x7f31900037c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:35.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31abfff700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3190003d00 0x7f3190004150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:35.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31b15b7700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3190004890 0x7f3190004d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:35.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31b0db6700 1 -- 172.21.15.80:0/4148525542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3190004890 msgr2=0x7f3190004d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:35.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31b0db6700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3190004890 0x7f3190004d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:35.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31b0db6700 1 -- 172.21.15.80:0/4148525542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3190003d00 msgr2=0x7f3190004150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:35.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31b0db6700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3190003d00 0x7f3190004150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:35.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31b0db6700 1 -- 172.21.15.80:0/4148525542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3190010640 con 0x7f3190003370 2019-11-28T11:40:35.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31b2819700 1 -- 172.21.15.80:0/4148525542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ac10a8c0 con 0x7f3190003370 2019-11-28T11:40:35.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31b0db6700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003370 0x7f31900037c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f319c0105c0 tx=0x7f319c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:35.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31b2819700 1 -- 172.21.15.80:0/4148525542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ac109180 con 0x7f3190003370 2019-11-28T11:40:35.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31b0db6700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003370 0x7f31900037c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f319c0105c0 tx=0x7f319c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:35.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31b0db6700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003370 0x7f31900037c0 secure :-1 s=READY pgs=1315 cs=0 l=1 rx=0x7f319c0105c0 tx=0x7f319c010470).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:35.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31b0db6700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003370 0x7f31900037c0 secure :-1 s=THROTTLE_DONE pgs=1315 cs=0 l=1 rx=0x7f319c0105c0 tx=0x7f319c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:35.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f319c000960 con 0x7f3190003370 2019-11-28T11:40:35.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31b0db6700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003370 0x7f31900037c0 secure :-1 s=THROTTLE_DONE pgs=1315 cs=0 l=1 rx=0x7f319c0105c0 tx=0x7f319c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:35.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c000940 con 0x7f3190003370 2019-11-28T11:40:35.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31b0db6700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003370 0x7f31900037c0 secure :-1 s=THROTTLE_DONE pgs=1315 cs=0 l=1 rx=0x7f319c0105c0 tx=0x7f319c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:35.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f319c009960 con 0x7f3190003370 2019-11-28T11:40:35.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.962+0000 7f31b0db6700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003370 0x7f31900037c0 secure :-1 s=THROTTLE_DONE pgs=1315 cs=0 l=1 rx=0x7f319c0105c0 tx=0x7f319c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:35.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.963+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f319c009580 con 0x7f3190003370 2019-11-28T11:40:35.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.963+0000 7f31b0db6700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003370 0x7f31900037c0 secure :-1 s=THROTTLE_DONE pgs=1315 cs=0 l=1 rx=0x7f319c0105c0 tx=0x7f319c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:35.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.963+0000 7f31a97fa700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3190024f10 0x7f3190027340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:35.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.963+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f319c031e50 con 0x7f3190003370 2019-11-28T11:40:35.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.963+0000 7f31abfff700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3190024f10 0x7f3190027340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:35.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.963+0000 7f31abfff700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3190024f10 0x7f3190027340 crc :-1 s=READY pgs=541 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:35.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.970+0000 7f31b2819700 1 -- 172.21.15.80:0/4148525542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3184002e60 con 0x7f3190003370 2019-11-28T11:40:35.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.973+0000 7f31b0db6700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003370 0x7f31900037c0 secure :-1 s=THROTTLE_DONE pgs=1315 cs=0 l=1 rx=0x7f319c0105c0 tx=0x7f319c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:35.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:34.973+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f319c007210 con 0x7f3190003370 2019-11-28T11:40:35.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:35.145+0000 7f31b2819700 1 -- 172.21.15.80:0/4148525542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3184001d10 con 0x7f3190003370 2019-11-28T11:40:35.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:35.145+0000 7f31b0db6700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003370 0x7f31900037c0 secure :-1 s=THROTTLE_DONE pgs=1315 cs=0 l=1 rx=0x7f319c0105c0 tx=0x7f319c010470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:35.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:35.145+0000 7f31a97fa700 1 -- 172.21.15.80:0/4148525542 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f319c009580 con 0x7f3190003370 2019-11-28T11:40:35.178 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:35.178 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:35.178 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:35.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:35.148+0000 7f31b2819700 1 -- 172.21.15.80:0/4148525542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3190024f10 msgr2=0x7f3190027340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:35.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:35.148+0000 7f31b2819700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3190024f10 0x7f3190027340 crc :-1 s=READY pgs=541 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:35.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:35.148+0000 7f31b2819700 1 -- 172.21.15.80:0/4148525542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003370 msgr2=0x7f31900037c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:35.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:35.148+0000 7f31b2819700 1 --2- 172.21.15.80:0/4148525542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003370 0x7f31900037c0 secure :-1 s=READY pgs=1315 cs=0 l=1 rx=0x7f319c0105c0 tx=0x7f319c010470).stop 2019-11-28T11:40:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:35.148+0000 7f31b15b7700 1 -- 172.21.15.80:0/4148525542 reap_dead start 2019-11-28T11:40:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:35.148+0000 7f31b15b7700 1 -- 172.21.15.80:0/4148525542 reap_dead start 2019-11-28T11:40:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:35.148+0000 7f31b2819700 1 -- 172.21.15.80:0/4148525542 shutdown_connections 2019-11-28T11:40:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:35.148+0000 7f31b2819700 1 -- 172.21.15.80:0/4148525542 shutdown_connections 2019-11-28T11:40:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:35.148+0000 7f31b2819700 1 -- 172.21.15.80:0/4148525542 wait complete. 2019-11-28T11:40:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:35.148+0000 7f31b2819700 1 -- 172.21.15.80:0/4148525542 >> 172.21.15.80:0/4148525542 conn(0x7f31ac127dc0 msgr2=0x7f31ac141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:35.196 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:36.196 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:36.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.290+0000 7f885bf18700 1 Processor -- start 2019-11-28T11:40:36.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.290+0000 7f885bf18700 1 -- start start 2019-11-28T11:40:36.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.291+0000 7f885bf18700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f885406d120 0x7f8854165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:36.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.291+0000 7f885bf18700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885406d5a0 con 0x7f885406c0a0 2019-11-28T11:40:36.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.291+0000 7f885bf18700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885406db00 con 0x7f885406c490 2019-11-28T11:40:36.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.291+0000 7f885bf18700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885406fd60 con 0x7f885406d120 2019-11-28T11:40:36.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.291+0000 7f885a4b5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f885406c0a0 0x7f8854072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37264/0 (socket says 172.21.15.80:37264) 2019-11-28T11:40:36.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.291+0000 7f885a4b5700 1 -- 172.21.15.80:0/2849806981 learned_addr learned my addr 172.21.15.80:0/2849806981 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:36.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.291+0000 7f885acb6700 1 --2- 172.21.15.80:0/2849806981 >> v2:172.21.15.174:3300/0 conn(0x7f885406d120 0x7f8854165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:36.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.291+0000 7f88594b3700 1 -- 172.21.15.80:0/2849806981 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331574426 0 0) 0x7f883c001150 con 0x7f885406c0a0 2019-11-28T11:40:36.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.291+0000 7f88594b3700 1 -- 172.21.15.80:0/2849806981 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8840002e80 con 0x7f885406c0a0 2019-11-28T11:40:36.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.291+0000 7f88594b3700 1 -- 172.21.15.80:0/2849806981 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594134985 0 0) 0x7f8844001400 con 0x7f885406c490 2019-11-28T11:40:36.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.291+0000 7f88594b3700 1 -- 172.21.15.80:0/2849806981 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88400030b0 con 0x7f885406c490 2019-11-28T11:40:36.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.291+0000 7f885acb6700 1 -- 172.21.15.80:0/2849806981 >> v1:172.21.15.174:6789/0 conn(0x7f885406c490 legacy=0x7f885406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:36.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.291+0000 7f885acb6700 1 -- 172.21.15.80:0/2849806981 >> v1:172.21.15.80:6789/0 conn(0x7f885406c0a0 legacy=0x7f8854072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:36.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.291+0000 7f88594b3700 1 -- 172.21.15.80:0/2849806981 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3188690996 0 0) 0x7f883c001130 con 0x7f885406c0a0 2019-11-28T11:40:36.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.291+0000 7f885acb6700 1 -- 172.21.15.80:0/2849806981 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88540706c0 con 0x7f885406d120 2019-11-28T11:40:36.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.292+0000 7f885acb6700 1 --2- 172.21.15.80:0/2849806981 >> v2:172.21.15.174:3300/0 conn(0x7f885406d120 0x7f8854165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f884c00af80 tx=0x7f884c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:36.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.292+0000 7f885acb6700 1 --2- 172.21.15.80:0/2849806981 >> v2:172.21.15.174:3300/0 conn(0x7f885406d120 0x7f8854165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f884c00af80 tx=0x7f884c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:36.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.292+0000 7f885acb6700 1 --2- 172.21.15.80:0/2849806981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885406d120 0x7f8854165d80 secure :-1 s=READY pgs=777 cs=0 l=1 rx=0x7f884c00af80 tx=0x7f884c00b790).ready entity=mon.1 client_cookie=a16edb4764436a4d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:36.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.292+0000 7f885acb6700 1 --2- 172.21.15.80:0/2849806981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885406d120 0x7f8854165d80 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f884c00af80 tx=0x7f884c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:36.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.292+0000 7f88594b3700 1 -- 172.21.15.80:0/2849806981 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f884c007240 con 0x7f885406d120 2019-11-28T11:40:36.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.292+0000 7f885acb6700 1 --2- 172.21.15.80:0/2849806981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885406d120 0x7f8854165d80 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f884c00af80 tx=0x7f884c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:36.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.292+0000 7f885acb6700 1 --2- 172.21.15.80:0/2849806981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885406d120 0x7f8854165d80 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f884c00af80 tx=0x7f884c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:36.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.292+0000 7f88594b3700 1 -- 172.21.15.80:0/2849806981 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c000bb0 con 0x7f885406d120 2019-11-28T11:40:36.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.292+0000 7f88594b3700 1 -- 172.21.15.80:0/2849806981 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f884c009e60 con 0x7f885406d120 2019-11-28T11:40:36.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.292+0000 7f885bf18700 1 -- 172.21.15.80:0/2849806981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885406d120 msgr2=0x7f8854165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:36.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.292+0000 7f885bf18700 1 --2- 172.21.15.80:0/2849806981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885406d120 0x7f8854165d80 secure :-1 s=READY pgs=777 cs=0 l=1 rx=0x7f884c00af80 tx=0x7f884c00b790).stop 2019-11-28T11:40:36.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.293+0000 7f885bf18700 1 -- 172.21.15.80:0/2849806981 shutdown_connections 2019-11-28T11:40:36.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.293+0000 7f885bf18700 1 --2- 172.21.15.80:0/2849806981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885406d120 0x7f8854165d80 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:36.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.293+0000 7f885bf18700 1 -- 172.21.15.80:0/2849806981 shutdown_connections 2019-11-28T11:40:36.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.293+0000 7f885bf18700 1 -- 172.21.15.80:0/2849806981 wait complete. 2019-11-28T11:40:36.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.293+0000 7f885bf18700 1 -- 172.21.15.80:0/2849806981 >> 172.21.15.80:0/2849806981 conn(0x7f8854061cf0 msgr2=0x7f8854064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:36.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.295+0000 7f885bf18700 1 Processor -- start 2019-11-28T11:40:36.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.295+0000 7f885bf18700 1 -- start start 2019-11-28T11:40:36.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.296+0000 7f885bf18700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f885415a890 0x7f885415ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:36.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.296+0000 7f885bf18700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f885412dca0 0x7f885412e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:36.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.296+0000 7f885bf18700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8854125780 con 0x7f8854142d00 2019-11-28T11:40:36.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.296+0000 7f885bf18700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885413b3b0 con 0x7f885415a890 2019-11-28T11:40:36.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.296+0000 7f885bf18700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8854111b70 con 0x7f885412dca0 2019-11-28T11:40:36.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.296+0000 7f885a4b5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8854142d00 0x7f885415b640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37270/0 (socket says 172.21.15.80:37270) 2019-11-28T11:40:36.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.296+0000 7f885a4b5700 1 -- 172.21.15.80:0/3255814383 learned_addr learned my addr 172.21.15.80:0/3255814383 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:36.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.296+0000 7f8859cb4700 1 --2- 172.21.15.80:0/3255814383 >> v2:172.21.15.174:3300/0 conn(0x7f885415a890 0x7f885415ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:36.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.296+0000 7f885acb6700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f885412dca0 0x7f885412e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:36.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.296+0000 7f8852ffd700 1 -- 172.21.15.80:0/3255814383 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171663549 0 0) 0x7f883c000f40 con 0x7f8854142d00 2019-11-28T11:40:36.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.296+0000 7f8852ffd700 1 -- 172.21.15.80:0/3255814383 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8838002e80 con 0x7f8854142d00 2019-11-28T11:40:36.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.296+0000 7f8852ffd700 1 -- 172.21.15.80:0/3255814383 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4240287514 0 0) 0x7f883c000c90 con 0x7f8854142d00 2019-11-28T11:40:36.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.297+0000 7f8859cb4700 1 -- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f885412dca0 msgr2=0x7f885412e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:36.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.297+0000 7f8859cb4700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f885412dca0 0x7f885412e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:36.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.297+0000 7f8859cb4700 1 -- 172.21.15.80:0/3255814383 >> v1:172.21.15.80:6789/0 conn(0x7f8854142d00 legacy=0x7f885415b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:36.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.297+0000 7f8859cb4700 1 -- 172.21.15.80:0/3255814383 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8854158d10 con 0x7f885415a890 2019-11-28T11:40:36.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.297+0000 7f8859cb4700 1 --2- 172.21.15.80:0/3255814383 >> v2:172.21.15.174:3300/0 conn(0x7f885415a890 0x7f885415ad20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8844010720 tx=0x7f884400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:36.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.297+0000 7f8859cb4700 1 --2- 172.21.15.80:0/3255814383 >> v2:172.21.15.174:3300/0 conn(0x7f885415a890 0x7f885415ad20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8844010720 tx=0x7f884400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:36.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.297+0000 7f8859cb4700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885415a890 0x7f885415ad20 secure :-1 s=READY pgs=778 cs=0 l=1 rx=0x7f8844010720 tx=0x7f884400b660).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:36.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.297+0000 7f8859cb4700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885415a890 0x7f885415ad20 secure :-1 s=THROTTLE_DONE pgs=778 cs=0 l=1 rx=0x7f8844010720 tx=0x7f884400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:36.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.297+0000 7f8852ffd700 1 -- 172.21.15.80:0/3255814383 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8844009ce0 con 0x7f885415a890 2019-11-28T11:40:36.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.297+0000 7f8859cb4700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885415a890 0x7f885415ad20 secure :-1 s=THROTTLE_DONE pgs=778 cs=0 l=1 rx=0x7f8844010720 tx=0x7f884400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:36.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.297+0000 7f8859cb4700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885415a890 0x7f885415ad20 secure :-1 s=THROTTLE_DONE pgs=778 cs=0 l=1 rx=0x7f8844010720 tx=0x7f884400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:36.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.297+0000 7f8852ffd700 1 -- 172.21.15.80:0/3255814383 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8844000e20 con 0x7f885415a890 2019-11-28T11:40:36.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.297+0000 7f885bf18700 1 -- 172.21.15.80:0/3255814383 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8854159090 con 0x7f885415a890 2019-11-28T11:40:36.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.297+0000 7f8852ffd700 1 -- 172.21.15.80:0/3255814383 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8844009ec0 con 0x7f885415a890 2019-11-28T11:40:36.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.297+0000 7f885bf18700 1 -- 172.21.15.80:0/3255814383 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8854158d10 con 0x7f885415a890 2019-11-28T11:40:36.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.297+0000 7f8859cb4700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885415a890 0x7f885415ad20 secure :-1 s=THROTTLE_DONE pgs=778 cs=0 l=1 rx=0x7f8844010720 tx=0x7f884400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:36.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.298+0000 7f8852ffd700 1 -- 172.21.15.80:0/3255814383 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8844009980 con 0x7f885415a890 2019-11-28T11:40:36.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.298+0000 7f8859cb4700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885415a890 0x7f885415ad20 secure :-1 s=THROTTLE_DONE pgs=778 cs=0 l=1 rx=0x7f8844010720 tx=0x7f884400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:36.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.298+0000 7f8852ffd700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8838018780 0x7f883801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:36.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.298+0000 7f8852ffd700 1 -- 172.21.15.80:0/3255814383 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8844031d90 con 0x7f885415a890 2019-11-28T11:40:36.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.298+0000 7f885a4b5700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8838018780 0x7f883801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:36.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.298+0000 7f885a4b5700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8838018780 0x7f883801abf0 crc :-1 s=READY pgs=542 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:36.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.305+0000 7f885bf18700 1 -- 172.21.15.80:0/3255814383 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8854159090 con 0x7f885415a890 2019-11-28T11:40:36.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.309+0000 7f8859cb4700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885415a890 0x7f885415ad20 secure :-1 s=THROTTLE_DONE pgs=778 cs=0 l=1 rx=0x7f8844010720 tx=0x7f884400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:36.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.309+0000 7f8852ffd700 1 -- 172.21.15.80:0/3255814383 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8844024fa0 con 0x7f885415a890 2019-11-28T11:40:36.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.482+0000 7f885bf18700 1 -- 172.21.15.80:0/3255814383 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8854158d10 con 0x7f885415a890 2019-11-28T11:40:36.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.483+0000 7f8859cb4700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885415a890 0x7f885415ad20 secure :-1 s=THROTTLE_DONE pgs=778 cs=0 l=1 rx=0x7f8844010720 tx=0x7f884400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:36.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.483+0000 7f8852ffd700 1 -- 172.21.15.80:0/3255814383 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f8844024fa0 con 0x7f885415a890 2019-11-28T11:40:36.515 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:36.516 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:36.516 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:36.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.485+0000 7f885bf18700 1 -- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8838018780 msgr2=0x7f883801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:36.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.485+0000 7f885bf18700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8838018780 0x7f883801abf0 crc :-1 s=READY pgs=542 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:36.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.485+0000 7f885bf18700 1 -- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885415a890 msgr2=0x7f885415ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:36.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.485+0000 7f885bf18700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885415a890 0x7f885415ad20 secure :-1 s=READY pgs=778 cs=0 l=1 rx=0x7f8844010720 tx=0x7f884400b660).stop 2019-11-28T11:40:36.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.485+0000 7f885bf18700 1 -- 172.21.15.80:0/3255814383 shutdown_connections 2019-11-28T11:40:36.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.485+0000 7f885bf18700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8838018780 0x7f883801abf0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:36.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.485+0000 7f885bf18700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f885412dca0 0x7f885412e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:36.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.485+0000 7f885bf18700 1 --2- 172.21.15.80:0/3255814383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f885415a890 0x7f885415ad20 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:36.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.485+0000 7f885bf18700 1 -- 172.21.15.80:0/3255814383 shutdown_connections 2019-11-28T11:40:36.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.485+0000 7f885bf18700 1 -- 172.21.15.80:0/3255814383 wait complete. 2019-11-28T11:40:36.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:36.485+0000 7f885bf18700 1 -- 172.21.15.80:0/3255814383 >> 172.21.15.80:0/3255814383 conn(0x7f885407c680 msgr2=0x7f8854112150 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:36.527 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:37.528 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:37.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.616+0000 7fbe16eec700 1 Processor -- start 2019-11-28T11:40:37.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.616+0000 7fbe16eec700 1 -- start start 2019-11-28T11:40:37.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.617+0000 7fbe16eec700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbe1006c0a0 0x7fbe10072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:37.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.617+0000 7fbe16eec700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe100734e0 0x7fbe10071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:37.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.617+0000 7fbe16eec700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe10072360 0x7fbe10072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:37.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.617+0000 7fbe16eec700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1006fd60 con 0x7fbe10072360 2019-11-28T11:40:37.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.617+0000 7fbe16eec700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe10070030 con 0x7fbe1006c0a0 2019-11-28T11:40:37.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.617+0000 7fbe16eec700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1006f330 con 0x7fbe100734e0 2019-11-28T11:40:37.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.617+0000 7fbe15c8a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe10072360 0x7fbe10072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:37.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.617+0000 7fbe15c8a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe10072360 0x7fbe10072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37964/0 (socket says 172.21.15.80:37964) 2019-11-28T11:40:37.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.617+0000 7fbe15c8a700 1 -- 172.21.15.80:0/2359199175 learned_addr learned my addr 172.21.15.80:0/2359199175 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:37.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.617+0000 7fbe15489700 1 --2- 172.21.15.80:0/2359199175 >> v2:172.21.15.174:3300/0 conn(0x7fbe1006c0a0 0x7fbe10072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:37.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.617+0000 7fbe14c88700 1 --2- 172.21.15.80:0/2359199175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe100734e0 0x7fbe10071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:37.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.617+0000 7fbe15c8a700 1 -- 172.21.15.80:0/2359199175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe100734e0 msgr2=0x7fbe10071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:37.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.617+0000 7fbe15c8a700 1 --2- 172.21.15.80:0/2359199175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe100734e0 0x7fbe10071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:37.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.617+0000 7fbe15c8a700 1 -- 172.21.15.80:0/2359199175 >> v2:172.21.15.174:3300/0 conn(0x7fbe1006c0a0 msgr2=0x7fbe10072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:37.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.617+0000 7fbe15c8a700 1 --2- 172.21.15.80:0/2359199175 >> v2:172.21.15.174:3300/0 conn(0x7fbe1006c0a0 0x7fbe10072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:37.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.617+0000 7fbe15c8a700 1 -- 172.21.15.80:0/2359199175 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe100706c0 con 0x7fbe10072360 2019-11-28T11:40:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.618+0000 7fbe15c8a700 1 --2- 172.21.15.80:0/2359199175 >> v2:172.21.15.80:3300/0 conn(0x7fbe10072360 0x7fbe10072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbe0800fab0 tx=0x7fbe0800f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.618+0000 7fbe15c8a700 1 --2- 172.21.15.80:0/2359199175 >> v2:172.21.15.80:3300/0 conn(0x7fbe10072360 0x7fbe10072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbe0800fab0 tx=0x7fbe0800f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:37.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.618+0000 7fbe15c8a700 1 --2- 172.21.15.80:0/2359199175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe10072360 0x7fbe10072800 secure :-1 s=READY pgs=1318 cs=0 l=1 rx=0x7fbe0800fab0 tx=0x7fbe0800f930).ready entity=mon.0 client_cookie=724cf8a56d7e4dd4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.618+0000 7fbe15c8a700 1 --2- 172.21.15.80:0/2359199175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe10072360 0x7fbe10072800 secure :-1 s=THROTTLE_DONE pgs=1318 cs=0 l=1 rx=0x7fbe0800fab0 tx=0x7fbe0800f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:37.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.618+0000 7fbe15c8a700 1 --2- 172.21.15.80:0/2359199175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe10072360 0x7fbe10072800 secure :-1 s=THROTTLE_DONE pgs=1318 cs=0 l=1 rx=0x7fbe0800fab0 tx=0x7fbe0800f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:37.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.618+0000 7fbe0ffff700 1 -- 172.21.15.80:0/2359199175 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe08001460 con 0x7fbe10072360 2019-11-28T11:40:37.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.618+0000 7fbe15c8a700 1 --2- 172.21.15.80:0/2359199175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe10072360 0x7fbe10072800 secure :-1 s=THROTTLE_DONE pgs=1318 cs=0 l=1 rx=0x7fbe0800fab0 tx=0x7fbe0800f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:37.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.618+0000 7fbe0ffff700 1 -- 172.21.15.80:0/2359199175 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe08000f10 con 0x7fbe10072360 2019-11-28T11:40:37.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.618+0000 7fbe0ffff700 1 -- 172.21.15.80:0/2359199175 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe08001a40 con 0x7fbe10072360 2019-11-28T11:40:37.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.618+0000 7fbe16eec700 1 -- 172.21.15.80:0/2359199175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe10072360 msgr2=0x7fbe10072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:37.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.618+0000 7fbe16eec700 1 --2- 172.21.15.80:0/2359199175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe10072360 0x7fbe10072800 secure :-1 s=READY pgs=1318 cs=0 l=1 rx=0x7fbe0800fab0 tx=0x7fbe0800f930).stop 2019-11-28T11:40:37.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.618+0000 7fbe16eec700 1 -- 172.21.15.80:0/2359199175 shutdown_connections 2019-11-28T11:40:37.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.618+0000 7fbe16eec700 1 --2- 172.21.15.80:0/2359199175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe10072360 0x7fbe10072800 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:37.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.618+0000 7fbe16eec700 1 --2- 172.21.15.80:0/2359199175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe100734e0 0x7fbe10071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:37.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.618+0000 7fbe16eec700 1 --2- 172.21.15.80:0/2359199175 >> v2:172.21.15.174:3300/0 conn(0x7fbe1006c0a0 0x7fbe10072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:37.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.619+0000 7fbe16eec700 1 -- 172.21.15.80:0/2359199175 shutdown_connections 2019-11-28T11:40:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.619+0000 7fbe16eec700 1 -- 172.21.15.80:0/2359199175 wait complete. 2019-11-28T11:40:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.619+0000 7fbe16eec700 1 -- 172.21.15.80:0/2359199175 >> 172.21.15.80:0/2359199175 conn(0x7fbe10061cf0 msgr2=0x7fbe10064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.621+0000 7fbe16eec700 1 Processor -- start 2019-11-28T11:40:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.621+0000 7fbe16eec700 1 -- start start 2019-11-28T11:40:37.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.622+0000 7fbe16eec700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbe1013eb40 0x7fbe1010afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:37.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.622+0000 7fbe16eec700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe1010b500 0x7fbe101629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:37.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.622+0000 7fbe16eec700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1013f1e0 con 0x7fbe10162f30 2019-11-28T11:40:37.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.622+0000 7fbe16eec700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe101234c0 con 0x7fbe1010b500 2019-11-28T11:40:37.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.622+0000 7fbe16eec700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1013e0d0 con 0x7fbe1013eb40 2019-11-28T11:40:37.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.622+0000 7fbe14c88700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe1010b500 0x7fbe101629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:37.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.622+0000 7fbe14c88700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe1010b500 0x7fbe101629f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37970/0 (socket says 172.21.15.80:37970) 2019-11-28T11:40:37.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.622+0000 7fbe14c88700 1 -- 172.21.15.80:0/3948685152 learned_addr learned my addr 172.21.15.80:0/3948685152 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:37.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.622+0000 7fbe15489700 1 --2- 172.21.15.80:0/3948685152 >> v2:172.21.15.174:3300/0 conn(0x7fbe1013eb40 0x7fbe1010afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:37.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.622+0000 7fbe14c88700 1 -- 172.21.15.80:0/3948685152 >> v2:172.21.15.174:3300/0 conn(0x7fbe1013eb40 msgr2=0x7fbe1010afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:37.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.622+0000 7fbe14c88700 1 --2- 172.21.15.80:0/3948685152 >> v2:172.21.15.174:3300/0 conn(0x7fbe1013eb40 0x7fbe1010afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:37.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.622+0000 7fbe14c88700 1 -- 172.21.15.80:0/3948685152 >> v1:172.21.15.174:6789/0 conn(0x7fbe10162f30 legacy=0x7fbe10109e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:37.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.622+0000 7fbe14c88700 1 -- 172.21.15.80:0/3948685152 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe10108700 con 0x7fbe1010b500 2019-11-28T11:40:37.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.623+0000 7fbe14c88700 1 --2- 172.21.15.80:0/3948685152 >> v2:172.21.15.80:3300/0 conn(0x7fbe1010b500 0x7fbe101629f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbe04010470 tx=0x7fbe04010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:37.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.623+0000 7fbe14c88700 1 --2- 172.21.15.80:0/3948685152 >> v2:172.21.15.80:3300/0 conn(0x7fbe1010b500 0x7fbe101629f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbe04010470 tx=0x7fbe04010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:37.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.623+0000 7fbe14c88700 1 --2- 172.21.15.80:0/3948685152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe1010b500 0x7fbe101629f0 secure :-1 s=READY pgs=1319 cs=0 l=1 rx=0x7fbe04010470 tx=0x7fbe04010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:37.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.623+0000 7fbe14c88700 1 --2- 172.21.15.80:0/3948685152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe1010b500 0x7fbe101629f0 secure :-1 s=THROTTLE_DONE pgs=1319 cs=0 l=1 rx=0x7fbe04010470 tx=0x7fbe04010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:37.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.623+0000 7fbe14c88700 1 --2- 172.21.15.80:0/3948685152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe1010b500 0x7fbe101629f0 secure :-1 s=THROTTLE_DONE pgs=1319 cs=0 l=1 rx=0x7fbe04010470 tx=0x7fbe04010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:37.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.623+0000 7fbe0dffb700 1 -- 172.21.15.80:0/3948685152 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe04005180 con 0x7fbe1010b500 2019-11-28T11:40:37.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.623+0000 7fbe14c88700 1 --2- 172.21.15.80:0/3948685152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe1010b500 0x7fbe101629f0 secure :-1 s=THROTTLE_DONE pgs=1319 cs=0 l=1 rx=0x7fbe04010470 tx=0x7fbe04010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:37.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.623+0000 7fbe0dffb700 1 -- 172.21.15.80:0/3948685152 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe04005880 con 0x7fbe1010b500 2019-11-28T11:40:37.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.623+0000 7fbe16eec700 1 -- 172.21.15.80:0/3948685152 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe10108a80 con 0x7fbe1010b500 2019-11-28T11:40:37.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.623+0000 7fbe0dffb700 1 -- 172.21.15.80:0/3948685152 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe04005f90 con 0x7fbe1010b500 2019-11-28T11:40:37.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.623+0000 7fbe16eec700 1 -- 172.21.15.80:0/3948685152 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe10108700 con 0x7fbe1010b500 2019-11-28T11:40:37.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.623+0000 7fbe14c88700 1 --2- 172.21.15.80:0/3948685152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe1010b500 0x7fbe101629f0 secure :-1 s=THROTTLE_DONE pgs=1319 cs=0 l=1 rx=0x7fbe04010470 tx=0x7fbe04010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:37.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.623+0000 7fbe0dffb700 1 -- 172.21.15.80:0/3948685152 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbe04005180 con 0x7fbe1010b500 2019-11-28T11:40:37.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.623+0000 7fbe14c88700 1 --2- 172.21.15.80:0/3948685152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe1010b500 0x7fbe101629f0 secure :-1 s=THROTTLE_DONE pgs=1319 cs=0 l=1 rx=0x7fbe04010470 tx=0x7fbe04010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:37.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.623+0000 7fbe0dffb700 1 --2- 172.21.15.80:0/3948685152 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdf0018730 0x7fbdf001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:37.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.624+0000 7fbe0dffb700 1 -- 172.21.15.80:0/3948685152 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fbe04031d60 con 0x7fbe1010b500 2019-11-28T11:40:37.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.624+0000 7fbe15489700 1 --2- 172.21.15.80:0/3948685152 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdf0018730 0x7fbdf001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:37.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.624+0000 7fbe15489700 1 --2- 172.21.15.80:0/3948685152 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdf0018730 0x7fbdf001abc0 crc :-1 s=READY pgs=543 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:37.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.631+0000 7fbe16eec700 1 -- 172.21.15.80:0/3948685152 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe10108a80 con 0x7fbe1010b500 2019-11-28T11:40:37.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.635+0000 7fbe14c88700 1 --2- 172.21.15.80:0/3948685152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe1010b500 0x7fbe101629f0 secure :-1 s=THROTTLE_DONE pgs=1319 cs=0 l=1 rx=0x7fbe04010470 tx=0x7fbe04010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:37.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.635+0000 7fbe0dffb700 1 -- 172.21.15.80:0/3948685152 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbe04005390 con 0x7fbe1010b500 2019-11-28T11:40:37.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.807+0000 7fbe16eec700 1 -- 172.21.15.80:0/3948685152 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe10108700 con 0x7fbe1010b500 2019-11-28T11:40:37.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.807+0000 7fbe14c88700 1 --2- 172.21.15.80:0/3948685152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe1010b500 0x7fbe101629f0 secure :-1 s=THROTTLE_DONE pgs=1319 cs=0 l=1 rx=0x7fbe04010470 tx=0x7fbe04010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:37.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.807+0000 7fbe0dffb700 1 -- 172.21.15.80:0/3948685152 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fbe04005180 con 0x7fbe1010b500 2019-11-28T11:40:37.842 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:37.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.810+0000 7fbe16eec700 1 -- 172.21.15.80:0/3948685152 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdf0018730 msgr2=0x7fbdf001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:37.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.810+0000 7fbe16eec700 1 --2- 172.21.15.80:0/3948685152 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdf0018730 0x7fbdf001abc0 crc :-1 s=READY pgs=543 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:37.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.810+0000 7fbe16eec700 1 -- 172.21.15.80:0/3948685152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe1010b500 msgr2=0x7fbe101629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:37.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.810+0000 7fbe16eec700 1 --2- 172.21.15.80:0/3948685152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe1010b500 0x7fbe101629f0 secure :-1 s=READY pgs=1319 cs=0 l=1 rx=0x7fbe04010470 tx=0x7fbe04010270).stop 2019-11-28T11:40:37.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.810+0000 7fbe16eec700 1 -- 172.21.15.80:0/3948685152 shutdown_connections 2019-11-28T11:40:37.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.810+0000 7fbe16eec700 1 --2- 172.21.15.80:0/3948685152 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdf0018730 0x7fbdf001abc0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:37.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.810+0000 7fbe16eec700 1 --2- 172.21.15.80:0/3948685152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe1010b500 0x7fbe101629f0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:37.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.810+0000 7fbe16eec700 1 --2- 172.21.15.80:0/3948685152 >> v2:172.21.15.174:3300/0 conn(0x7fbe1013eb40 0x7fbe1010afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:37.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.810+0000 7fbe16eec700 1 -- 172.21.15.80:0/3948685152 shutdown_connections 2019-11-28T11:40:37.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.810+0000 7fbe16eec700 1 -- 172.21.15.80:0/3948685152 wait complete. 2019-11-28T11:40:37.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:37.810+0000 7fbe16eec700 1 -- 172.21.15.80:0/3948685152 >> 172.21.15.80:0/3948685152 conn(0x7fbe1011bfc0 msgr2=0x7fbe10141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:37.844 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:37.844 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:37.853 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:38.855 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.943+0000 7fd1f1b45700 1 Processor -- start 2019-11-28T11:40:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.943+0000 7fd1f1b45700 1 -- start start 2019-11-28T11:40:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.944+0000 7fd1f1b45700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd1ec06c490 0x7fd1ec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.944+0000 7fd1f1b45700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec06db00 con 0x7fd1ec06ce60 2019-11-28T11:40:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.944+0000 7fd1f1b45700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec06e000 con 0x7fd1ec06c0a0 2019-11-28T11:40:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.944+0000 7fd1f1b45700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ec06fd60 con 0x7fd1ec06c490 2019-11-28T11:40:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.944+0000 7fd1f08e3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd1ec06ce60 0x7fd1ec164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37296/0 (socket says 172.21.15.80:37296) 2019-11-28T11:40:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.944+0000 7fd1f08e3700 1 -- 172.21.15.80:0/548770454 learned_addr learned my addr 172.21.15.80:0/548770454 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1e3fff700 1 --2- 172.21.15.80:0/548770454 >> v2:172.21.15.174:3300/0 conn(0x7fd1ec06c490 0x7fd1ec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 -- 172.21.15.80:0/548770454 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467536526 0 0) 0x7fd1e40014d0 con 0x7fd1ec06ce60 2019-11-28T11:40:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 -- 172.21.15.80:0/548770454 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1d8002e80 con 0x7fd1ec06ce60 2019-11-28T11:40:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 -- 172.21.15.80:0/548770454 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250601085 0 0) 0x7fd1dc001080 con 0x7fd1ec06c0a0 2019-11-28T11:40:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 -- 172.21.15.80:0/548770454 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1d80030b0 con 0x7fd1ec06c0a0 2019-11-28T11:40:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 -- 172.21.15.80:0/548770454 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1255672201 0 0) 0x7fd1e40014b0 con 0x7fd1ec06ce60 2019-11-28T11:40:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 -- 172.21.15.80:0/548770454 >> v2:172.21.15.174:3300/0 conn(0x7fd1ec06c490 msgr2=0x7fd1ec06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 --2- 172.21.15.80:0/548770454 >> v2:172.21.15.174:3300/0 conn(0x7fd1ec06c490 0x7fd1ec06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 -- 172.21.15.80:0/548770454 >> v1:172.21.15.174:6789/0 conn(0x7fd1ec06c0a0 legacy=0x7fd1ec072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 -- 172.21.15.80:0/548770454 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec0706c0 con 0x7fd1ec06ce60 2019-11-28T11:40:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 -- 172.21.15.80:0/548770454 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd1e40019e0 con 0x7fd1ec06ce60 2019-11-28T11:40:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 -- 172.21.15.80:0/548770454 >> v1:172.21.15.80:6789/0 conn(0x7fd1ec06ce60 legacy=0x7fd1ec164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1d8003b30 0x7fd1d8005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1d8006680 0x7fd1d8008b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1d804d3c0 0x7fd1d804f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:38.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 -- 172.21.15.80:0/548770454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d8050040 con 0x7fd1d8003b30 2019-11-28T11:40:38.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 -- 172.21.15.80:0/548770454 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d8050270 con 0x7fd1d8006680 2019-11-28T11:40:38.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1ebfff700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1d8003b30 0x7fd1d8005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:38.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1eb7fe700 1 -- 172.21.15.80:0/548770454 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d80504a0 con 0x7fd1d804d3c0 2019-11-28T11:40:38.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1e3fff700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1d8006680 0x7fd1d8008b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:38.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1f08e3700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1d804d3c0 0x7fd1d804f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:38.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1ebfff700 1 -- 172.21.15.80:0/548770454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1d804d3c0 msgr2=0x7fd1d804f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:38.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1ebfff700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1d804d3c0 0x7fd1d804f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:38.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1ebfff700 1 -- 172.21.15.80:0/548770454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1d8006680 msgr2=0x7fd1d8008b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:38.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1ebfff700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1d8006680 0x7fd1d8008b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:38.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1ebfff700 1 -- 172.21.15.80:0/548770454 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d8050750 con 0x7fd1d8003b30 2019-11-28T11:40:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1f08e3700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1d804d3c0 0x7fd1d804f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:40:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1f08e3700 1 -- 172.21.15.80:0/548770454 reap_dead start 2019-11-28T11:40:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.945+0000 7fd1ebfff700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1d8003b30 0x7fd1d8005f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd1dc00af70 tx=0x7fd1dc00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.946+0000 7fd1ebfff700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1d8003b30 0x7fd1d8005f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd1dc00af70 tx=0x7fd1dc00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.946+0000 7fd1ebfff700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1d8003b30 0x7fd1d8005f90 secure :-1 s=READY pgs=1321 cs=0 l=1 rx=0x7fd1dc00af70 tx=0x7fd1dc00b2f0).ready entity=mon.0 client_cookie=3ae50f2a3cf9e17f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.946+0000 7fd1ebfff700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1d8003b30 0x7fd1d8005f90 secure :-1 s=THROTTLE_DONE pgs=1321 cs=0 l=1 rx=0x7fd1dc00af70 tx=0x7fd1dc00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:38.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.946+0000 7fd1ebfff700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1d8003b30 0x7fd1d8005f90 secure :-1 s=THROTTLE_DONE pgs=1321 cs=0 l=1 rx=0x7fd1dc00af70 tx=0x7fd1dc00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:38.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.946+0000 7fd1eb7fe700 1 -- 172.21.15.80:0/548770454 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1dc009d20 con 0x7fd1d8003b30 2019-11-28T11:40:38.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.946+0000 7fd1ebfff700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1d8003b30 0x7fd1d8005f90 secure :-1 s=THROTTLE_DONE pgs=1321 cs=0 l=1 rx=0x7fd1dc00af70 tx=0x7fd1dc00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:38.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.946+0000 7fd1eb7fe700 1 -- 172.21.15.80:0/548770454 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc0098a0 con 0x7fd1d8003b30 2019-11-28T11:40:38.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.946+0000 7fd1eb7fe700 1 -- 172.21.15.80:0/548770454 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1dc00a300 con 0x7fd1d8003b30 2019-11-28T11:40:38.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.946+0000 7fd1f1b45700 1 -- 172.21.15.80:0/548770454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1d8003b30 msgr2=0x7fd1d8005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:38.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.946+0000 7fd1f1b45700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1d8003b30 0x7fd1d8005f90 secure :-1 s=READY pgs=1321 cs=0 l=1 rx=0x7fd1dc00af70 tx=0x7fd1dc00b2f0).stop 2019-11-28T11:40:38.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.946+0000 7fd1f1b45700 1 -- 172.21.15.80:0/548770454 shutdown_connections 2019-11-28T11:40:38.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.946+0000 7fd1f1b45700 1 --2- 172.21.15.80:0/548770454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1d8003b30 0x7fd1d8005f90 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:38.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.946+0000 7fd1f1b45700 1 -- 172.21.15.80:0/548770454 shutdown_connections 2019-11-28T11:40:38.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.946+0000 7fd1f1b45700 1 -- 172.21.15.80:0/548770454 wait complete. 2019-11-28T11:40:38.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.946+0000 7fd1f1b45700 1 -- 172.21.15.80:0/548770454 >> 172.21.15.80:0/548770454 conn(0x7fd1ec061cf0 msgr2=0x7fd1ec064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:38.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.949+0000 7fd1f1b45700 1 Processor -- start 2019-11-28T11:40:38.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.949+0000 7fd1f1b45700 1 -- start start 2019-11-28T11:40:38.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1f1b45700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd1ec0750f0 0x7fd1ec151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:38.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1f1b45700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec079230 con 0x7fd1ec074d00 2019-11-28T11:40:38.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1f1b45700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec079890 con 0x7fd1ec151f90 2019-11-28T11:40:38.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1f1b45700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ec07ab30 con 0x7fd1ec0750f0 2019-11-28T11:40:38.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1ebfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd1ec074d00 0x7fd1ec152bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37304/0 (socket says 172.21.15.80:37304) 2019-11-28T11:40:38.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1ebfff700 1 -- 172.21.15.80:0/321545818 learned_addr learned my addr 172.21.15.80:0/321545818 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:38.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1e3fff700 1 --2- 172.21.15.80:0/321545818 >> v2:172.21.15.174:3300/0 conn(0x7fd1ec0750f0 0x7fd1ec151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:38.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1e97fa700 1 -- 172.21.15.80:0/321545818 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160683808 0 0) 0x7fd1dc0095a0 con 0x7fd1ec074d00 2019-11-28T11:40:38.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1e97fa700 1 -- 172.21.15.80:0/321545818 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1d0002e80 con 0x7fd1ec074d00 2019-11-28T11:40:38.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1e97fa700 1 -- 172.21.15.80:0/321545818 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854511971 0 0) 0x7fd1e40012c0 con 0x7fd1ec151f90 2019-11-28T11:40:38.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1e97fa700 1 -- 172.21.15.80:0/321545818 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1d00030b0 con 0x7fd1ec151f90 2019-11-28T11:40:38.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1e3fff700 1 -- 172.21.15.80:0/321545818 >> v1:172.21.15.174:6789/0 conn(0x7fd1ec151f90 legacy=0x7fd1ec168d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:38.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1e3fff700 1 -- 172.21.15.80:0/321545818 >> v1:172.21.15.80:6789/0 conn(0x7fd1ec074d00 legacy=0x7fd1ec152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:38.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1e97fa700 1 -- 172.21.15.80:0/321545818 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3938606332 0 0) 0x7fd1dc00ac20 con 0x7fd1ec074d00 2019-11-28T11:40:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1e3fff700 1 -- 172.21.15.80:0/321545818 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec07b490 con 0x7fd1ec0750f0 2019-11-28T11:40:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1e3fff700 1 --2- 172.21.15.80:0/321545818 >> v2:172.21.15.174:3300/0 conn(0x7fd1ec0750f0 0x7fd1ec151a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd1d4010390 tx=0x7fd1d4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1e3fff700 1 --2- 172.21.15.80:0/321545818 >> v2:172.21.15.174:3300/0 conn(0x7fd1ec0750f0 0x7fd1ec151a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd1d4010390 tx=0x7fd1d4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.950+0000 7fd1e3fff700 1 --2- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec0750f0 0x7fd1ec151a50 secure :-1 s=READY pgs=782 cs=0 l=1 rx=0x7fd1d4010390 tx=0x7fd1d4010730).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.951+0000 7fd1e3fff700 1 --2- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec0750f0 0x7fd1ec151a50 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fd1d4010390 tx=0x7fd1d4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.951+0000 7fd1e97fa700 1 -- 172.21.15.80:0/321545818 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1d4005180 con 0x7fd1ec0750f0 2019-11-28T11:40:38.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.951+0000 7fd1e3fff700 1 --2- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec0750f0 0x7fd1ec151a50 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fd1d4010390 tx=0x7fd1d4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:38.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.951+0000 7fd1e3fff700 1 --2- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec0750f0 0x7fd1ec151a50 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fd1d4010390 tx=0x7fd1d4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:38.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.951+0000 7fd1e97fa700 1 -- 172.21.15.80:0/321545818 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d4005640 con 0x7fd1ec0750f0 2019-11-28T11:40:38.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.951+0000 7fd1f1b45700 1 -- 172.21.15.80:0/321545818 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec07b810 con 0x7fd1ec0750f0 2019-11-28T11:40:38.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.951+0000 7fd1e97fa700 1 -- 172.21.15.80:0/321545818 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1d4000960 con 0x7fd1ec0750f0 2019-11-28T11:40:38.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.951+0000 7fd1f1b45700 1 -- 172.21.15.80:0/321545818 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ec07b490 con 0x7fd1ec0750f0 2019-11-28T11:40:38.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.951+0000 7fd1e3fff700 1 --2- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec0750f0 0x7fd1ec151a50 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fd1d4010390 tx=0x7fd1d4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:38.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.951+0000 7fd1e97fa700 1 -- 172.21.15.80:0/321545818 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd1d4005830 con 0x7fd1ec0750f0 2019-11-28T11:40:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.951+0000 7fd1e3fff700 1 --2- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec0750f0 0x7fd1ec151a50 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fd1d4010390 tx=0x7fd1d4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.951+0000 7fd1e97fa700 1 --2- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1d0018750 0x7fd1d001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.951+0000 7fd1e97fa700 1 -- 172.21.15.80:0/321545818 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fd1d4031aa0 con 0x7fd1ec0750f0 2019-11-28T11:40:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.952+0000 7fd1ebfff700 1 --2- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1d0018750 0x7fd1d001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.952+0000 7fd1ebfff700 1 --2- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1d0018750 0x7fd1d001abe0 crc :-1 s=READY pgs=544 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.958+0000 7fd1f1b45700 1 -- 172.21.15.80:0/321545818 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ec07b810 con 0x7fd1ec0750f0 2019-11-28T11:40:39.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.962+0000 7fd1e3fff700 1 --2- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec0750f0 0x7fd1ec151a50 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fd1d4010390 tx=0x7fd1d4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:39.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:38.962+0000 7fd1e97fa700 1 -- 172.21.15.80:0/321545818 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd1d4005430 con 0x7fd1ec0750f0 2019-11-28T11:40:39.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:39.132+0000 7fd1f1b45700 1 -- 172.21.15.80:0/321545818 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1ec07b490 con 0x7fd1ec0750f0 2019-11-28T11:40:39.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:39.133+0000 7fd1e3fff700 1 --2- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec0750f0 0x7fd1ec151a50 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fd1d4010390 tx=0x7fd1d4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:39.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:39.133+0000 7fd1e97fa700 1 -- 172.21.15.80:0/321545818 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fd1d4005830 con 0x7fd1ec0750f0 2019-11-28T11:40:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:39.166 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:39.167 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:39.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:39.135+0000 7fd1f1b45700 1 -- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1d0018750 msgr2=0x7fd1d001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:39.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:39.135+0000 7fd1f1b45700 1 --2- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1d0018750 0x7fd1d001abe0 crc :-1 s=READY pgs=544 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:39.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:39.135+0000 7fd1f1b45700 1 -- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec0750f0 msgr2=0x7fd1ec151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:39.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:39.135+0000 7fd1f1b45700 1 --2- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec0750f0 0x7fd1ec151a50 secure :-1 s=READY pgs=782 cs=0 l=1 rx=0x7fd1d4010390 tx=0x7fd1d4010730).stop 2019-11-28T11:40:39.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:39.135+0000 7fd1f1b45700 1 -- 172.21.15.80:0/321545818 shutdown_connections 2019-11-28T11:40:39.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:39.135+0000 7fd1f1b45700 1 --2- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd1d0018750 0x7fd1d001abe0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:39.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:39.135+0000 7fd1f1b45700 1 --2- 172.21.15.80:0/321545818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec0750f0 0x7fd1ec151a50 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:39.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:39.135+0000 7fd1f1b45700 1 -- 172.21.15.80:0/321545818 shutdown_connections 2019-11-28T11:40:39.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:39.135+0000 7fd1f1b45700 1 -- 172.21.15.80:0/321545818 wait complete. 2019-11-28T11:40:39.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:39.135+0000 7fd1f1b45700 1 -- 172.21.15.80:0/321545818 >> 172.21.15.80:0/321545818 conn(0x7fd1ec13fa50 msgr2=0x7fd1ec07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:39.178 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:40.180 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:40.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.269+0000 7fed88284700 1 Processor -- start 2019-11-28T11:40:40.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.269+0000 7fed88284700 1 -- start start 2019-11-28T11:40:40.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.270+0000 7fed88284700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fed8006c490 0x7fed8006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:40.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.270+0000 7fed88284700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed8006ce60 0x7fed80164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:40.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.270+0000 7fed88284700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8006db00 con 0x7fed8006c0a0 2019-11-28T11:40:40.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.270+0000 7fed88284700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8006fd60 con 0x7fed8006ce60 2019-11-28T11:40:40.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.270+0000 7fed88284700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed80070030 con 0x7fed8006c490 2019-11-28T11:40:40.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.270+0000 7fed87022700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed8006ce60 0x7fed80164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:40.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.270+0000 7fed87022700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed8006ce60 0x7fed80164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37998/0 (socket says 172.21.15.80:37998) 2019-11-28T11:40:40.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.270+0000 7fed87022700 1 -- 172.21.15.80:0/4206186946 learned_addr learned my addr 172.21.15.80:0/4206186946 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:40.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.270+0000 7fed86020700 1 --2- 172.21.15.80:0/4206186946 >> v2:172.21.15.174:3300/0 conn(0x7fed8006c490 0x7fed8006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:40.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.270+0000 7fed87022700 1 -- 172.21.15.80:0/4206186946 >> v2:172.21.15.174:3300/0 conn(0x7fed8006c490 msgr2=0x7fed8006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:40.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.270+0000 7fed87022700 1 --2- 172.21.15.80:0/4206186946 >> v2:172.21.15.174:3300/0 conn(0x7fed8006c490 0x7fed8006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:40.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.270+0000 7fed87022700 1 -- 172.21.15.80:0/4206186946 >> v1:172.21.15.80:6789/0 conn(0x7fed8006c0a0 legacy=0x7fed80072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:40.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.270+0000 7fed8581f700 1 -- 172.21.15.80:0/4206186946 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686122825 0 0) 0x7fed78001100 con 0x7fed8006c0a0 2019-11-28T11:40:40.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.270+0000 7fed87022700 1 -- 172.21.15.80:0/4206186946 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed800706c0 con 0x7fed8006ce60 2019-11-28T11:40:40.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.270+0000 7fed87022700 1 --2- 172.21.15.80:0/4206186946 >> v2:172.21.15.80:3300/0 conn(0x7fed8006ce60 0x7fed80164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fed7000fa30 tx=0x7fed7000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:40.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.271+0000 7fed87022700 1 --2- 172.21.15.80:0/4206186946 >> v2:172.21.15.80:3300/0 conn(0x7fed8006ce60 0x7fed80164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fed7000fa30 tx=0x7fed7000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:40.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.271+0000 7fed87022700 1 --2- 172.21.15.80:0/4206186946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed8006ce60 0x7fed80164d70 secure :-1 s=READY pgs=1324 cs=0 l=1 rx=0x7fed7000fa30 tx=0x7fed7000fdd0).ready entity=mon.0 client_cookie=82ebc2587c9bc8eb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:40.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.271+0000 7fed87022700 1 --2- 172.21.15.80:0/4206186946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed8006ce60 0x7fed80164d70 secure :-1 s=THROTTLE_DONE pgs=1324 cs=0 l=1 rx=0x7fed7000fa30 tx=0x7fed7000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:40.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.271+0000 7fed8581f700 1 -- 172.21.15.80:0/4206186946 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed70000df0 con 0x7fed8006ce60 2019-11-28T11:40:40.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.271+0000 7fed87022700 1 --2- 172.21.15.80:0/4206186946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed8006ce60 0x7fed80164d70 secure :-1 s=THROTTLE_DONE pgs=1324 cs=0 l=1 rx=0x7fed7000fa30 tx=0x7fed7000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:40.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.271+0000 7fed87022700 1 --2- 172.21.15.80:0/4206186946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed8006ce60 0x7fed80164d70 secure :-1 s=THROTTLE_DONE pgs=1324 cs=0 l=1 rx=0x7fed7000fa30 tx=0x7fed7000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:40.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.271+0000 7fed8581f700 1 -- 172.21.15.80:0/4206186946 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed70001460 con 0x7fed8006ce60 2019-11-28T11:40:40.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.271+0000 7fed8581f700 1 -- 172.21.15.80:0/4206186946 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed70001b50 con 0x7fed8006ce60 2019-11-28T11:40:40.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.271+0000 7fed88284700 1 -- 172.21.15.80:0/4206186946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed8006ce60 msgr2=0x7fed80164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:40.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.271+0000 7fed88284700 1 --2- 172.21.15.80:0/4206186946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed8006ce60 0x7fed80164d70 secure :-1 s=READY pgs=1324 cs=0 l=1 rx=0x7fed7000fa30 tx=0x7fed7000fdd0).stop 2019-11-28T11:40:40.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.271+0000 7fed88284700 1 -- 172.21.15.80:0/4206186946 shutdown_connections 2019-11-28T11:40:40.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.271+0000 7fed88284700 1 --2- 172.21.15.80:0/4206186946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed8006ce60 0x7fed80164d70 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:40.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.271+0000 7fed88284700 1 --2- 172.21.15.80:0/4206186946 >> v2:172.21.15.174:3300/0 conn(0x7fed8006c490 0x7fed8006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:40.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.271+0000 7fed88284700 1 -- 172.21.15.80:0/4206186946 shutdown_connections 2019-11-28T11:40:40.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.272+0000 7fed88284700 1 -- 172.21.15.80:0/4206186946 wait complete. 2019-11-28T11:40:40.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.272+0000 7fed88284700 1 -- 172.21.15.80:0/4206186946 >> 172.21.15.80:0/4206186946 conn(0x7fed80061cf0 msgr2=0x7fed80064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:40.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.274+0000 7fed88284700 1 Processor -- start 2019-11-28T11:40:40.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.274+0000 7fed88284700 1 -- start start 2019-11-28T11:40:40.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed88284700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fed8013eb40 0x7fed8010afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:40.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed88284700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed801631f0 0x7fed80105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:40.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed88284700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8013f1e0 con 0x7fed8010b500 2019-11-28T11:40:40.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed88284700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed801234c0 con 0x7fed8013eb40 2019-11-28T11:40:40.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed88284700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8013e0d0 con 0x7fed801631f0 2019-11-28T11:40:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed86020700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fed8010b500 0x7fed801629f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37320/0 (socket says 172.21.15.80:37320) 2019-11-28T11:40:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed86020700 1 -- 172.21.15.80:0/548973215 learned_addr learned my addr 172.21.15.80:0/548973215 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed87022700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed801631f0 0x7fed80105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed86821700 1 --2- 172.21.15.80:0/548973215 >> v2:172.21.15.174:3300/0 conn(0x7fed8013eb40 0x7fed8010afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed7f7fe700 1 -- 172.21.15.80:0/548973215 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557814571 0 0) 0x7fed740010b0 con 0x7fed8010b500 2019-11-28T11:40:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed7f7fe700 1 -- 172.21.15.80:0/548973215 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed60002e80 con 0x7fed8010b500 2019-11-28T11:40:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed7f7fe700 1 -- 172.21.15.80:0/548973215 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1530986677 0 0) 0x7fed740012b0 con 0x7fed8010b500 2019-11-28T11:40:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed87022700 1 -- 172.21.15.80:0/548973215 >> v2:172.21.15.174:3300/0 conn(0x7fed8013eb40 msgr2=0x7fed8010afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed87022700 1 --2- 172.21.15.80:0/548973215 >> v2:172.21.15.174:3300/0 conn(0x7fed8013eb40 0x7fed8010afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed87022700 1 -- 172.21.15.80:0/548973215 >> v1:172.21.15.80:6789/0 conn(0x7fed8010b500 legacy=0x7fed801629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed87022700 1 -- 172.21.15.80:0/548973215 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed80108700 con 0x7fed801631f0 2019-11-28T11:40:40.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.275+0000 7fed87022700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed801631f0 0x7fed80105210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fed70010700 tx=0x7fed70010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:40.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.276+0000 7fed87022700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed801631f0 0x7fed80105210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fed70010700 tx=0x7fed70010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:40.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.276+0000 7fed87022700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed801631f0 0x7fed80105210 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7fed70010700 tx=0x7fed70010530).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:40.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.276+0000 7fed87022700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed801631f0 0x7fed80105210 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fed70010700 tx=0x7fed70010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:40.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.276+0000 7fed7f7fe700 1 -- 172.21.15.80:0/548973215 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed70001610 con 0x7fed801631f0 2019-11-28T11:40:40.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.276+0000 7fed87022700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed801631f0 0x7fed80105210 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fed70010700 tx=0x7fed70010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:40.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.276+0000 7fed87022700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed801631f0 0x7fed80105210 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fed70010700 tx=0x7fed70010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:40.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.276+0000 7fed7f7fe700 1 -- 172.21.15.80:0/548973215 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed70001230 con 0x7fed801631f0 2019-11-28T11:40:40.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.276+0000 7fed88284700 1 -- 172.21.15.80:0/548973215 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed80108a80 con 0x7fed801631f0 2019-11-28T11:40:40.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.276+0000 7fed7f7fe700 1 -- 172.21.15.80:0/548973215 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed70001420 con 0x7fed801631f0 2019-11-28T11:40:40.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.276+0000 7fed88284700 1 -- 172.21.15.80:0/548973215 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed80108700 con 0x7fed801631f0 2019-11-28T11:40:40.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.276+0000 7fed87022700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed801631f0 0x7fed80105210 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fed70010700 tx=0x7fed70010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:40.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.276+0000 7fed7f7fe700 1 -- 172.21.15.80:0/548973215 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fed70001420 con 0x7fed801631f0 2019-11-28T11:40:40.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.276+0000 7fed87022700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed801631f0 0x7fed80105210 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fed70010700 tx=0x7fed70010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:40.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.276+0000 7fed7f7fe700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed60018780 0x7fed6001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:40.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.276+0000 7fed7f7fe700 1 -- 172.21.15.80:0/548973215 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fed70031dc0 con 0x7fed801631f0 2019-11-28T11:40:40.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.277+0000 7fed86821700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed60018780 0x7fed6001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:40.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.277+0000 7fed86821700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed60018780 0x7fed6001abf0 crc :-1 s=READY pgs=545 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:40.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.284+0000 7fed88284700 1 -- 172.21.15.80:0/548973215 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed80108a80 con 0x7fed801631f0 2019-11-28T11:40:40.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.288+0000 7fed87022700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed801631f0 0x7fed80105210 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fed70010700 tx=0x7fed70010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:40.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.288+0000 7fed7f7fe700 1 -- 172.21.15.80:0/548973215 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fed700079a0 con 0x7fed801631f0 2019-11-28T11:40:40.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.464+0000 7fed88284700 1 -- 172.21.15.80:0/548973215 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed80108700 con 0x7fed801631f0 2019-11-28T11:40:40.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.464+0000 7fed87022700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed801631f0 0x7fed80105210 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fed70010700 tx=0x7fed70010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:40.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.465+0000 7fed7f7fe700 1 -- 172.21.15.80:0/548973215 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fed70001400 con 0x7fed801631f0 2019-11-28T11:40:40.502 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:40.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.467+0000 7fed88284700 1 -- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed60018780 msgr2=0x7fed6001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:40.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.467+0000 7fed88284700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed60018780 0x7fed6001abf0 crc :-1 s=READY pgs=545 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:40.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.467+0000 7fed88284700 1 -- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed801631f0 msgr2=0x7fed80105210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:40.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.467+0000 7fed88284700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed801631f0 0x7fed80105210 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7fed70010700 tx=0x7fed70010530).stop 2019-11-28T11:40:40.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.467+0000 7fed88284700 1 -- 172.21.15.80:0/548973215 shutdown_connections 2019-11-28T11:40:40.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.467+0000 7fed88284700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed60018780 0x7fed6001abf0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:40.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.467+0000 7fed88284700 1 --2- 172.21.15.80:0/548973215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed801631f0 0x7fed80105210 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:40.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.467+0000 7fed88284700 1 --2- 172.21.15.80:0/548973215 >> v2:172.21.15.174:3300/0 conn(0x7fed8013eb40 0x7fed8010afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:40.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.467+0000 7fed88284700 1 -- 172.21.15.80:0/548973215 shutdown_connections 2019-11-28T11:40:40.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.467+0000 7fed88284700 1 -- 172.21.15.80:0/548973215 wait complete. 2019-11-28T11:40:40.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:40.467+0000 7fed88284700 1 -- 172.21.15.80:0/548973215 >> 172.21.15.80:0/548973215 conn(0x7fed8011bfc0 msgr2=0x7fed80141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:40.507 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:40.508 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:40.514 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:41.515 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:41.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.611+0000 7f99856b0700 1 Processor -- start 2019-11-28T11:40:41.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.611+0000 7f99856b0700 1 -- start start 2019-11-28T11:40:41.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.612+0000 7f99856b0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f998006c0a0 0x7f9980072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:41.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.612+0000 7f99856b0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998006db00 con 0x7f9980072620 2019-11-28T11:40:41.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.612+0000 7f99856b0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998006e000 con 0x7f99800734e0 2019-11-28T11:40:41.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.612+0000 7f99856b0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998006fd60 con 0x7f998006c0a0 2019-11-28T11:40:41.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.612+0000 7f997ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9980072620 0x7f9980164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37328/0 (socket says 172.21.15.80:37328) 2019-11-28T11:40:41.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.612+0000 7f997ffff700 1 -- 172.21.15.80:0/939022196 learned_addr learned my addr 172.21.15.80:0/939022196 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:41.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997f7fe700 1 --2- 172.21.15.80:0/939022196 >> v2:172.21.15.174:3300/0 conn(0x7f998006c0a0 0x7f9980072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:41.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997e7fc700 1 -- 172.21.15.80:0/939022196 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746461737 0 0) 0x7f99780014d0 con 0x7f9980072620 2019-11-28T11:40:41.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997e7fc700 1 -- 172.21.15.80:0/939022196 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f996c002e80 con 0x7f9980072620 2019-11-28T11:40:41.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997e7fc700 1 -- 172.21.15.80:0/939022196 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 85139096 0 0) 0x7f99780014b0 con 0x7f9980072620 2019-11-28T11:40:41.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997e7fc700 1 -- 172.21.15.80:0/939022196 >> v2:172.21.15.174:3300/0 conn(0x7f998006c0a0 msgr2=0x7f9980072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:41.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997e7fc700 1 --2- 172.21.15.80:0/939022196 >> v2:172.21.15.174:3300/0 conn(0x7f998006c0a0 0x7f9980072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:41.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997e7fc700 1 -- 172.21.15.80:0/939022196 >> v1:172.21.15.174:6789/0 conn(0x7f99800734e0 legacy=0x7f9980071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:41.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997e7fc700 1 -- 172.21.15.80:0/939022196 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99800706c0 con 0x7f9980072620 2019-11-28T11:40:41.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997e7fc700 1 -- 172.21.15.80:0/939022196 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f99780019e0 con 0x7f9980072620 2019-11-28T11:40:41.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997e7fc700 1 -- 172.21.15.80:0/939022196 >> v1:172.21.15.80:6789/0 conn(0x7f9980072620 legacy=0x7f9980164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:41.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997e7fc700 1 --2- 172.21.15.80:0/939022196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f996c003a80 0x7f996c005ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:41.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997e7fc700 1 --2- 172.21.15.80:0/939022196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f996c006670 0x7f996c008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:41.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997e7fc700 1 --2- 172.21.15.80:0/939022196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f996c0093a0 0x7f996c00b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:41.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997e7fc700 1 -- 172.21.15.80:0/939022196 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996c00c020 con 0x7f996c006670 2019-11-28T11:40:41.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997e7fc700 1 -- 172.21.15.80:0/939022196 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996c050220 con 0x7f996c003a80 2019-11-28T11:40:41.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997e7fc700 1 -- 172.21.15.80:0/939022196 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996c050450 con 0x7f996c0093a0 2019-11-28T11:40:41.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997effd700 1 --2- 172.21.15.80:0/939022196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f996c006670 0x7f996c008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:41.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997f7fe700 1 --2- 172.21.15.80:0/939022196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f996c003a80 0x7f996c005ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:41.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997ffff700 1 --2- 172.21.15.80:0/939022196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f996c0093a0 0x7f996c00b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:41.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997effd700 1 -- 172.21.15.80:0/939022196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f996c0093a0 msgr2=0x7f996c00b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:41.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997effd700 1 --2- 172.21.15.80:0/939022196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f996c0093a0 0x7f996c00b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:41.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997effd700 1 -- 172.21.15.80:0/939022196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f996c003a80 msgr2=0x7f996c005ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:41.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.613+0000 7f997effd700 1 --2- 172.21.15.80:0/939022196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f996c003a80 0x7f996c005ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:41.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.614+0000 7f997ffff700 1 -- 172.21.15.80:0/939022196 reap_dead start 2019-11-28T11:40:41.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.614+0000 7f997effd700 1 -- 172.21.15.80:0/939022196 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c050700 con 0x7f996c006670 2019-11-28T11:40:41.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.614+0000 7f997effd700 1 --2- 172.21.15.80:0/939022196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f996c006670 0x7f996c008b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f997000af50 tx=0x7f997000b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:41.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.614+0000 7f997effd700 1 --2- 172.21.15.80:0/939022196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f996c006670 0x7f996c008b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f997000af50 tx=0x7f997000b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:41.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.614+0000 7f997effd700 1 --2- 172.21.15.80:0/939022196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f996c006670 0x7f996c008b40 secure :-1 s=READY pgs=1327 cs=0 l=1 rx=0x7f997000af50 tx=0x7f997000b250).ready entity=mon.0 client_cookie=6478be94546e8215 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:41.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.614+0000 7f997effd700 1 --2- 172.21.15.80:0/939022196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f996c006670 0x7f996c008b40 secure :-1 s=THROTTLE_DONE pgs=1327 cs=0 l=1 rx=0x7f997000af50 tx=0x7f997000b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:41.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.614+0000 7f997e7fc700 1 -- 172.21.15.80:0/939022196 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9970000960 con 0x7f996c006670 2019-11-28T11:40:41.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.614+0000 7f997effd700 1 --2- 172.21.15.80:0/939022196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f996c006670 0x7f996c008b40 secure :-1 s=THROTTLE_DONE pgs=1327 cs=0 l=1 rx=0x7f997000af50 tx=0x7f997000b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:41.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.614+0000 7f997effd700 1 --2- 172.21.15.80:0/939022196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f996c006670 0x7f996c008b40 secure :-1 s=THROTTLE_DONE pgs=1327 cs=0 l=1 rx=0x7f997000af50 tx=0x7f997000b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:41.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.614+0000 7f997e7fc700 1 -- 172.21.15.80:0/939022196 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9970009980 con 0x7f996c006670 2019-11-28T11:40:41.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.614+0000 7f997e7fc700 1 -- 172.21.15.80:0/939022196 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f997000a050 con 0x7f996c006670 2019-11-28T11:40:41.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.614+0000 7f99856b0700 1 -- 172.21.15.80:0/939022196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f996c006670 msgr2=0x7f996c008b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:41.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.614+0000 7f99856b0700 1 --2- 172.21.15.80:0/939022196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f996c006670 0x7f996c008b40 secure :-1 s=READY pgs=1327 cs=0 l=1 rx=0x7f997000af50 tx=0x7f997000b250).stop 2019-11-28T11:40:41.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.614+0000 7f99856b0700 1 -- 172.21.15.80:0/939022196 shutdown_connections 2019-11-28T11:40:41.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.614+0000 7f99856b0700 1 --2- 172.21.15.80:0/939022196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f996c006670 0x7f996c008b40 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:41.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.614+0000 7f99856b0700 1 -- 172.21.15.80:0/939022196 shutdown_connections 2019-11-28T11:40:41.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.615+0000 7f99856b0700 1 -- 172.21.15.80:0/939022196 wait complete. 2019-11-28T11:40:41.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.615+0000 7f99856b0700 1 -- 172.21.15.80:0/939022196 >> 172.21.15.80:0/939022196 conn(0x7f9980061cf0 msgr2=0x7f9980064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:41.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.617+0000 7f99856b0700 1 Processor -- start 2019-11-28T11:40:41.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.617+0000 7f99856b0700 1 -- start start 2019-11-28T11:40:41.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.618+0000 7f99856b0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99801134e0 0x7f9980113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:41.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.618+0000 7f99856b0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9980113eb0 0x7f9980168c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:41.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.618+0000 7f99856b0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998015b940 con 0x7f9980140070 2019-11-28T11:40:41.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.618+0000 7f99856b0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99801598a0 con 0x7f99801134e0 2019-11-28T11:40:41.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.618+0000 7f99856b0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9980159b70 con 0x7f9980113eb0 2019-11-28T11:40:41.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.618+0000 7f997effd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99801134e0 0x7f9980113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:41.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.618+0000 7f997f7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9980140070 0x7f9980114440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37340/0 (socket says 172.21.15.80:37340) 2019-11-28T11:40:41.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.618+0000 7f997effd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99801134e0 0x7f9980113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38022/0 (socket says 172.21.15.80:38022) 2019-11-28T11:40:41.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.618+0000 7f997f7fe700 1 -- 172.21.15.80:0/1219324707 learned_addr learned my addr 172.21.15.80:0/1219324707 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:41.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.618+0000 7f997ffff700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9980113eb0 0x7f9980168c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:41.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.618+0000 7f997effd700 1 -- 172.21.15.80:0/1219324707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9980113eb0 msgr2=0x7f9980168c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:41.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.618+0000 7f997effd700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9980113eb0 0x7f9980168c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:41.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.618+0000 7f997effd700 1 -- 172.21.15.80:0/1219324707 >> v1:172.21.15.80:6789/0 conn(0x7f9980140070 legacy=0x7f9980114440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:41.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.618+0000 7f9977fff700 1 -- 172.21.15.80:0/1219324707 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685392980 0 0) 0x7f9968000c90 con 0x7f9980140070 2019-11-28T11:40:41.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.618+0000 7f997effd700 1 -- 172.21.15.80:0/1219324707 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998015a200 con 0x7f99801134e0 2019-11-28T11:40:41.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.619+0000 7f997effd700 1 --2- 172.21.15.80:0/1219324707 >> v2:172.21.15.80:3300/0 conn(0x7f99801134e0 0x7f9980113970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f99700103b0 tx=0x7f99700101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:41.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.619+0000 7f997effd700 1 --2- 172.21.15.80:0/1219324707 >> v2:172.21.15.80:3300/0 conn(0x7f99801134e0 0x7f9980113970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f99700103b0 tx=0x7f99700101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:41.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.619+0000 7f997effd700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99801134e0 0x7f9980113970 secure :-1 s=READY pgs=1329 cs=0 l=1 rx=0x7f99700103b0 tx=0x7f99700101e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:41.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.619+0000 7f997effd700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99801134e0 0x7f9980113970 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7f99700103b0 tx=0x7f99700101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:41.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.619+0000 7f9977fff700 1 -- 172.21.15.80:0/1219324707 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f997000abb0 con 0x7f99801134e0 2019-11-28T11:40:41.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.619+0000 7f997effd700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99801134e0 0x7f9980113970 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7f99700103b0 tx=0x7f99700101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:41.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.619+0000 7f997effd700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99801134e0 0x7f9980113970 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7f99700103b0 tx=0x7f99700101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:41.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.619+0000 7f9977fff700 1 -- 172.21.15.80:0/1219324707 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9970009770 con 0x7f99801134e0 2019-11-28T11:40:41.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.619+0000 7f99856b0700 1 -- 172.21.15.80:0/1219324707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998015a580 con 0x7f99801134e0 2019-11-28T11:40:41.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.619+0000 7f9977fff700 1 -- 172.21.15.80:0/1219324707 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9970009e80 con 0x7f99801134e0 2019-11-28T11:40:41.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.619+0000 7f99856b0700 1 -- 172.21.15.80:0/1219324707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998015a200 con 0x7f99801134e0 2019-11-28T11:40:41.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.619+0000 7f997effd700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99801134e0 0x7f9980113970 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7f99700103b0 tx=0x7f99700101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:41.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.619+0000 7f9977fff700 1 -- 172.21.15.80:0/1219324707 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9970009960 con 0x7f99801134e0 2019-11-28T11:40:41.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.619+0000 7f997effd700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99801134e0 0x7f9980113970 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7f99700103b0 tx=0x7f99700101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:41.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.620+0000 7f9977fff700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9964018730 0x7f996401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:41.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.620+0000 7f9977fff700 1 -- 172.21.15.80:0/1219324707 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f9970031a00 con 0x7f99801134e0 2019-11-28T11:40:41.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.620+0000 7f997f7fe700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9964018730 0x7f996401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:41.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.620+0000 7f997f7fe700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9964018730 0x7f996401abc0 crc :-1 s=READY pgs=546 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:41.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.627+0000 7f99856b0700 1 -- 172.21.15.80:0/1219324707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998015a580 con 0x7f99801134e0 2019-11-28T11:40:41.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.630+0000 7f997effd700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99801134e0 0x7f9980113970 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7f99700103b0 tx=0x7f99700101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:41.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.630+0000 7f9977fff700 1 -- 172.21.15.80:0/1219324707 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f997000af50 con 0x7f99801134e0 2019-11-28T11:40:41.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.806+0000 7f99856b0700 1 -- 172.21.15.80:0/1219324707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f998015a200 con 0x7f99801134e0 2019-11-28T11:40:41.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.806+0000 7f997effd700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99801134e0 0x7f9980113970 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7f99700103b0 tx=0x7f99700101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:41.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.806+0000 7f9977fff700 1 -- 172.21.15.80:0/1219324707 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7f9970009960 con 0x7f99801134e0 2019-11-28T11:40:41.839 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:41.840 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:41.840 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:41.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.809+0000 7f99856b0700 1 -- 172.21.15.80:0/1219324707 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9964018730 msgr2=0x7f996401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:41.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.809+0000 7f99856b0700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9964018730 0x7f996401abc0 crc :-1 s=READY pgs=546 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:41.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.809+0000 7f99856b0700 1 -- 172.21.15.80:0/1219324707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99801134e0 msgr2=0x7f9980113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:41.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.809+0000 7f99856b0700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99801134e0 0x7f9980113970 secure :-1 s=READY pgs=1329 cs=0 l=1 rx=0x7f99700103b0 tx=0x7f99700101e0).stop 2019-11-28T11:40:41.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.809+0000 7f99856b0700 1 -- 172.21.15.80:0/1219324707 shutdown_connections 2019-11-28T11:40:41.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.809+0000 7f99856b0700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9964018730 0x7f996401abc0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:41.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.809+0000 7f99856b0700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9980113eb0 0x7f9980168c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:41.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.809+0000 7f99856b0700 1 --2- 172.21.15.80:0/1219324707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99801134e0 0x7f9980113970 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:41.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.809+0000 7f99856b0700 1 -- 172.21.15.80:0/1219324707 shutdown_connections 2019-11-28T11:40:41.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.809+0000 7f99856b0700 1 -- 172.21.15.80:0/1219324707 wait complete. 2019-11-28T11:40:41.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:41.809+0000 7f99856b0700 1 -- 172.21.15.80:0/1219324707 >> 172.21.15.80:0/1219324707 conn(0x7f998014feb0 msgr2=0x7f998010c740 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:41.851 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:42.851 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:42.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.938+0000 7fda5d46c700 1 Processor -- start 2019-11-28T11:40:42.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.939+0000 7fda5d46c700 1 -- start start 2019-11-28T11:40:42.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.940+0000 7fda5d46c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fda5806c0a0 0x7fda58072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:42.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.940+0000 7fda5d46c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5806db00 con 0x7fda58072620 2019-11-28T11:40:42.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.940+0000 7fda5d46c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5806e000 con 0x7fda580734e0 2019-11-28T11:40:42.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.940+0000 7fda5d46c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5806fd60 con 0x7fda5806c0a0 2019-11-28T11:40:42.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.940+0000 7fda57fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fda58072620 0x7fda58164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37350/0 (socket says 172.21.15.80:37350) 2019-11-28T11:40:42.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.940+0000 7fda57fff700 1 -- 172.21.15.80:0/989102861 learned_addr learned my addr 172.21.15.80:0/989102861 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:42.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.940+0000 7fda577fe700 1 --2- 172.21.15.80:0/989102861 >> v2:172.21.15.174:3300/0 conn(0x7fda5806c0a0 0x7fda58072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:42.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.940+0000 7fda567fc700 1 -- 172.21.15.80:0/989102861 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412825618 0 0) 0x7fda48001150 con 0x7fda58072620 2019-11-28T11:40:42.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.940+0000 7fda567fc700 1 -- 172.21.15.80:0/989102861 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda38002e80 con 0x7fda58072620 2019-11-28T11:40:42.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.940+0000 7fda577fe700 1 -- 172.21.15.80:0/989102861 >> v1:172.21.15.174:6789/0 conn(0x7fda580734e0 legacy=0x7fda58071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:42.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.940+0000 7fda567fc700 1 -- 172.21.15.80:0/989102861 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17938547 0 0) 0x7fda40001400 con 0x7fda580734e0 2019-11-28T11:40:42.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.940+0000 7fda577fe700 1 -- 172.21.15.80:0/989102861 >> v1:172.21.15.80:6789/0 conn(0x7fda58072620 legacy=0x7fda58164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:42.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.940+0000 7fda577fe700 1 -- 172.21.15.80:0/989102861 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda580706c0 con 0x7fda5806c0a0 2019-11-28T11:40:42.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.940+0000 7fda577fe700 1 --2- 172.21.15.80:0/989102861 >> v2:172.21.15.174:3300/0 conn(0x7fda5806c0a0 0x7fda58072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fda5000af50 tx=0x7fda5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:42.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.940+0000 7fda577fe700 1 --2- 172.21.15.80:0/989102861 >> v2:172.21.15.174:3300/0 conn(0x7fda5806c0a0 0x7fda58072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fda5000af50 tx=0x7fda5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:42.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.940+0000 7fda577fe700 1 --2- 172.21.15.80:0/989102861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda5806c0a0 0x7fda58072fa0 secure :-1 s=READY pgs=785 cs=0 l=1 rx=0x7fda5000af50 tx=0x7fda5000b760).ready entity=mon.1 client_cookie=255ac62bbfa634b0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:42.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.941+0000 7fda577fe700 1 --2- 172.21.15.80:0/989102861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda5806c0a0 0x7fda58072fa0 secure :-1 s=THROTTLE_DONE pgs=785 cs=0 l=1 rx=0x7fda5000af50 tx=0x7fda5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:42.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.941+0000 7fda567fc700 1 -- 172.21.15.80:0/989102861 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda50000960 con 0x7fda5806c0a0 2019-11-28T11:40:42.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.941+0000 7fda577fe700 1 --2- 172.21.15.80:0/989102861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda5806c0a0 0x7fda58072fa0 secure :-1 s=THROTTLE_DONE pgs=785 cs=0 l=1 rx=0x7fda5000af50 tx=0x7fda5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:42.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.941+0000 7fda577fe700 1 --2- 172.21.15.80:0/989102861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda5806c0a0 0x7fda58072fa0 secure :-1 s=THROTTLE_DONE pgs=785 cs=0 l=1 rx=0x7fda5000af50 tx=0x7fda5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:42.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.941+0000 7fda567fc700 1 -- 172.21.15.80:0/989102861 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda50009860 con 0x7fda5806c0a0 2019-11-28T11:40:42.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.941+0000 7fda567fc700 1 -- 172.21.15.80:0/989102861 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda50009f30 con 0x7fda5806c0a0 2019-11-28T11:40:42.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.941+0000 7fda5d46c700 1 -- 172.21.15.80:0/989102861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda5806c0a0 msgr2=0x7fda58072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:42.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.941+0000 7fda5d46c700 1 --2- 172.21.15.80:0/989102861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda5806c0a0 0x7fda58072fa0 secure :-1 s=READY pgs=785 cs=0 l=1 rx=0x7fda5000af50 tx=0x7fda5000b760).stop 2019-11-28T11:40:42.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.941+0000 7fda5d46c700 1 -- 172.21.15.80:0/989102861 shutdown_connections 2019-11-28T11:40:42.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.941+0000 7fda5d46c700 1 --2- 172.21.15.80:0/989102861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda5806c0a0 0x7fda58072fa0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:42.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.941+0000 7fda5d46c700 1 -- 172.21.15.80:0/989102861 shutdown_connections 2019-11-28T11:40:42.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.941+0000 7fda5d46c700 1 -- 172.21.15.80:0/989102861 wait complete. 2019-11-28T11:40:42.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.941+0000 7fda5d46c700 1 -- 172.21.15.80:0/989102861 >> 172.21.15.80:0/989102861 conn(0x7fda58061cf0 msgr2=0x7fda58064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:42.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.944+0000 7fda5d46c700 1 Processor -- start 2019-11-28T11:40:42.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.944+0000 7fda5d46c700 1 -- start start 2019-11-28T11:40:42.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda5d46c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda5812cea0 0x7fda58111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:42.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda5d46c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda58124260 con 0x7fda581230e0 2019-11-28T11:40:42.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda5d46c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5812e5d0 con 0x7fda58165a00 2019-11-28T11:40:42.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda5d46c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda58120610 con 0x7fda5812cea0 2019-11-28T11:40:42.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda56ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fda581230e0 0x7fda58123570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37354/0 (socket says 172.21.15.80:37354) 2019-11-28T11:40:42.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda56ffd700 1 -- 172.21.15.80:0/888802559 learned_addr learned my addr 172.21.15.80:0/888802559 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:42.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda577fe700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda5812cea0 0x7fda58111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:42.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda4ffff700 1 -- 172.21.15.80:0/888802559 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395665806 0 0) 0x7fda40001640 con 0x7fda581230e0 2019-11-28T11:40:42.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda4ffff700 1 -- 172.21.15.80:0/888802559 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda30002e80 con 0x7fda581230e0 2019-11-28T11:40:42.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda4ffff700 1 -- 172.21.15.80:0/888802559 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192933423 0 0) 0x7fda480009b0 con 0x7fda58165a00 2019-11-28T11:40:42.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda4ffff700 1 -- 172.21.15.80:0/888802559 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda300030b0 con 0x7fda58165a00 2019-11-28T11:40:42.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda577fe700 1 -- 172.21.15.80:0/888802559 >> v1:172.21.15.174:6789/0 conn(0x7fda58165a00 legacy=0x7fda58167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:42.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda577fe700 1 -- 172.21.15.80:0/888802559 >> v1:172.21.15.80:6789/0 conn(0x7fda581230e0 legacy=0x7fda58123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:42.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda577fe700 1 -- 172.21.15.80:0/888802559 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda581219a0 con 0x7fda5812cea0 2019-11-28T11:40:42.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda577fe700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda5812cea0 0x7fda58111db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fda50010380 tx=0x7fda50010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:43.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda577fe700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda5812cea0 0x7fda58111db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fda50010380 tx=0x7fda50010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:43.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda577fe700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda5812cea0 0x7fda58111db0 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7fda50010380 tx=0x7fda50010720).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:43.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda577fe700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda5812cea0 0x7fda58111db0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7fda50010380 tx=0x7fda50010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:43.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda4ffff700 1 -- 172.21.15.80:0/888802559 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda50000940 con 0x7fda5812cea0 2019-11-28T11:40:43.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda577fe700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda5812cea0 0x7fda58111db0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7fda50010380 tx=0x7fda50010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:43.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda577fe700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda5812cea0 0x7fda58111db0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7fda50010380 tx=0x7fda50010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.945+0000 7fda4ffff700 1 -- 172.21.15.80:0/888802559 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda50009770 con 0x7fda5812cea0 2019-11-28T11:40:43.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.946+0000 7fda4ffff700 1 -- 172.21.15.80:0/888802559 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda50000940 con 0x7fda5812cea0 2019-11-28T11:40:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.946+0000 7fda5d46c700 1 -- 172.21.15.80:0/888802559 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda58121d20 con 0x7fda5812cea0 2019-11-28T11:40:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.946+0000 7fda5d46c700 1 -- 172.21.15.80:0/888802559 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda581122f0 con 0x7fda5812cea0 2019-11-28T11:40:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.946+0000 7fda577fe700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda5812cea0 0x7fda58111db0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7fda50010380 tx=0x7fda50010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.946+0000 7fda4ffff700 1 -- 172.21.15.80:0/888802559 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fda50009960 con 0x7fda5812cea0 2019-11-28T11:40:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.946+0000 7fda577fe700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda5812cea0 0x7fda58111db0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7fda50010380 tx=0x7fda50010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.946+0000 7fda4ffff700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda30018750 0x7fda3001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.946+0000 7fda4ffff700 1 -- 172.21.15.80:0/888802559 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fda50031a90 con 0x7fda5812cea0 2019-11-28T11:40:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.946+0000 7fda56ffd700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda30018750 0x7fda3001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.947+0000 7fda56ffd700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda30018750 0x7fda3001abe0 crc :-1 s=READY pgs=547 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.954+0000 7fda5d46c700 1 -- 172.21.15.80:0/888802559 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda581219a0 con 0x7fda5812cea0 2019-11-28T11:40:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.957+0000 7fda577fe700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda5812cea0 0x7fda58111db0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7fda50010380 tx=0x7fda50010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:42.957+0000 7fda4ffff700 1 -- 172.21.15.80:0/888802559 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fda5000b540 con 0x7fda5812cea0 2019-11-28T11:40:43.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:43.129+0000 7fda5d46c700 1 -- 172.21.15.80:0/888802559 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda58121d20 con 0x7fda5812cea0 2019-11-28T11:40:43.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:43.129+0000 7fda577fe700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda5812cea0 0x7fda58111db0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7fda50010380 tx=0x7fda50010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:43.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:43.129+0000 7fda4ffff700 1 -- 172.21.15.80:0/888802559 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fda50009960 con 0x7fda5812cea0 2019-11-28T11:40:43.162 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:43.163 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:43.163 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:43.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:43.131+0000 7fda5d46c700 1 -- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda30018750 msgr2=0x7fda3001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:43.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:43.131+0000 7fda5d46c700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda30018750 0x7fda3001abe0 crc :-1 s=READY pgs=547 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:43.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:43.131+0000 7fda5d46c700 1 -- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda5812cea0 msgr2=0x7fda58111db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:43.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:43.131+0000 7fda5d46c700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda5812cea0 0x7fda58111db0 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7fda50010380 tx=0x7fda50010720).stop 2019-11-28T11:40:43.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:43.131+0000 7fda5d46c700 1 -- 172.21.15.80:0/888802559 shutdown_connections 2019-11-28T11:40:43.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:43.131+0000 7fda5d46c700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda30018750 0x7fda3001abe0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:43.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:43.131+0000 7fda5d46c700 1 --2- 172.21.15.80:0/888802559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda5812cea0 0x7fda58111db0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:43.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:43.132+0000 7fda5d46c700 1 -- 172.21.15.80:0/888802559 shutdown_connections 2019-11-28T11:40:43.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:43.132+0000 7fda5d46c700 1 -- 172.21.15.80:0/888802559 wait complete. 2019-11-28T11:40:43.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:43.132+0000 7fda5d46c700 1 -- 172.21.15.80:0/888802559 >> 172.21.15.80:0/888802559 conn(0x7fda581426c0 msgr2=0x7fda58110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:43.173 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:44.181 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:44.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.268+0000 7fa33f0d6700 1 Processor -- start 2019-11-28T11:40:44.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.269+0000 7fa33f0d6700 1 -- start start 2019-11-28T11:40:44.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33f0d6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa33806c0a0 0x7fa338072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:44.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33f0d6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3380734e0 0x7fa338071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:44.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33f0d6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33806db00 con 0x7fa338072360 2019-11-28T11:40:44.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33f0d6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33806fd60 con 0x7fa33806c0a0 2019-11-28T11:40:44.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33f0d6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa338070030 con 0x7fa3380734e0 2019-11-28T11:40:44.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33d673700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa33806c0a0 0x7fa338072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:44.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33d673700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa33806c0a0 0x7fa338072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38044/0 (socket says 172.21.15.80:38044) 2019-11-28T11:40:44.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33de74700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa338072360 0x7fa33806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37362/0 (socket says 172.21.15.80:37362) 2019-11-28T11:40:44.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33d673700 1 -- 172.21.15.80:0/1418788920 learned_addr learned my addr 172.21.15.80:0/1418788920 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:44.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33ce72700 1 --2- 172.21.15.80:0/1418788920 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3380734e0 0x7fa338071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:44.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33d673700 1 -- 172.21.15.80:0/1418788920 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3380734e0 msgr2=0x7fa338071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:44.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33d673700 1 --2- 172.21.15.80:0/1418788920 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3380734e0 0x7fa338071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:44.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33d673700 1 -- 172.21.15.80:0/1418788920 >> v1:172.21.15.80:6789/0 conn(0x7fa338072360 legacy=0x7fa33806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:44.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa337fff700 1 -- 172.21.15.80:0/1418788920 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442450792 0 0) 0x7fa3200009b0 con 0x7fa338072360 2019-11-28T11:40:44.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33d673700 1 -- 172.21.15.80:0/1418788920 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3380706c0 con 0x7fa33806c0a0 2019-11-28T11:40:44.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33d673700 1 --2- 172.21.15.80:0/1418788920 >> v2:172.21.15.80:3300/0 conn(0x7fa33806c0a0 0x7fa338072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa32800f6c0 tx=0x7fa32800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:44.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33d673700 1 --2- 172.21.15.80:0/1418788920 >> v2:172.21.15.80:3300/0 conn(0x7fa33806c0a0 0x7fa338072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa32800f6c0 tx=0x7fa32800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:44.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33d673700 1 --2- 172.21.15.80:0/1418788920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa33806c0a0 0x7fa338072fa0 secure :-1 s=READY pgs=1333 cs=0 l=1 rx=0x7fa32800f6c0 tx=0x7fa32800fa60).ready entity=mon.0 client_cookie=3c1f7eeb7f0df38b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:44.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33d673700 1 --2- 172.21.15.80:0/1418788920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa33806c0a0 0x7fa338072fa0 secure :-1 s=THROTTLE_DONE pgs=1333 cs=0 l=1 rx=0x7fa32800f6c0 tx=0x7fa32800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:44.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa337fff700 1 -- 172.21.15.80:0/1418788920 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa328000960 con 0x7fa33806c0a0 2019-11-28T11:40:44.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33d673700 1 --2- 172.21.15.80:0/1418788920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa33806c0a0 0x7fa338072fa0 secure :-1 s=THROTTLE_DONE pgs=1333 cs=0 l=1 rx=0x7fa32800f6c0 tx=0x7fa32800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:44.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.270+0000 7fa33d673700 1 --2- 172.21.15.80:0/1418788920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa33806c0a0 0x7fa338072fa0 secure :-1 s=THROTTLE_DONE pgs=1333 cs=0 l=1 rx=0x7fa32800f6c0 tx=0x7fa32800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:44.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.271+0000 7fa337fff700 1 -- 172.21.15.80:0/1418788920 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa328000c90 con 0x7fa33806c0a0 2019-11-28T11:40:44.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.271+0000 7fa337fff700 1 -- 172.21.15.80:0/1418788920 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa328000960 con 0x7fa33806c0a0 2019-11-28T11:40:44.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.271+0000 7fa33f0d6700 1 -- 172.21.15.80:0/1418788920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa33806c0a0 msgr2=0x7fa338072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:44.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.271+0000 7fa33f0d6700 1 --2- 172.21.15.80:0/1418788920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa33806c0a0 0x7fa338072fa0 secure :-1 s=READY pgs=1333 cs=0 l=1 rx=0x7fa32800f6c0 tx=0x7fa32800fa60).stop 2019-11-28T11:40:44.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.271+0000 7fa33f0d6700 1 -- 172.21.15.80:0/1418788920 shutdown_connections 2019-11-28T11:40:44.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.271+0000 7fa33f0d6700 1 --2- 172.21.15.80:0/1418788920 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3380734e0 0x7fa338071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:44.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.271+0000 7fa33f0d6700 1 --2- 172.21.15.80:0/1418788920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa33806c0a0 0x7fa338072fa0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:44.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.271+0000 7fa33f0d6700 1 -- 172.21.15.80:0/1418788920 shutdown_connections 2019-11-28T11:40:44.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.271+0000 7fa33f0d6700 1 -- 172.21.15.80:0/1418788920 wait complete. 2019-11-28T11:40:44.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.271+0000 7fa33f0d6700 1 -- 172.21.15.80:0/1418788920 >> 172.21.15.80:0/1418788920 conn(0x7fa338061cf0 msgr2=0x7fa338064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:44.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.274+0000 7fa33f0d6700 1 Processor -- start 2019-11-28T11:40:44.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.274+0000 7fa33f0d6700 1 -- start start 2019-11-28T11:40:44.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa33f0d6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa33813dc00 0x7fa338109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:44.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa33f0d6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa33810a3a0 0x7fa338108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:44.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa33f0d6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3381312c0 con 0x7fa338109220 2019-11-28T11:40:44.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa33f0d6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa338104e00 con 0x7fa33810a3a0 2019-11-28T11:40:44.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa33f0d6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa338105830 con 0x7fa33813dc00 2019-11-28T11:40:44.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa33de74700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa338109220 0x7fa338103000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37370/0 (socket says 172.21.15.80:37370) 2019-11-28T11:40:44.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa33de74700 1 -- 172.21.15.80:0/2540025928 learned_addr learned my addr 172.21.15.80:0/2540025928 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa33d673700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa33813dc00 0x7fa338109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa33ce72700 1 --2- 172.21.15.80:0/2540025928 >> v2:172.21.15.174:3300/0 conn(0x7fa33810a3a0 0x7fa338108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa335ffb700 1 -- 172.21.15.80:0/2540025928 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035507953 0 0) 0x7fa320000f80 con 0x7fa338109220 2019-11-28T11:40:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa335ffb700 1 -- 172.21.15.80:0/2540025928 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa31c002e80 con 0x7fa338109220 2019-11-28T11:40:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa335ffb700 1 -- 172.21.15.80:0/2540025928 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2579266949 0 0) 0x7fa320000940 con 0x7fa338109220 2019-11-28T11:40:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa33d673700 1 -- 172.21.15.80:0/2540025928 >> v2:172.21.15.174:3300/0 conn(0x7fa33810a3a0 msgr2=0x7fa338108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:44.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa33d673700 1 --2- 172.21.15.80:0/2540025928 >> v2:172.21.15.174:3300/0 conn(0x7fa33810a3a0 0x7fa338108ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:44.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa33d673700 1 -- 172.21.15.80:0/2540025928 >> v1:172.21.15.80:6789/0 conn(0x7fa338109220 legacy=0x7fa338103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:44.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa33d673700 1 -- 172.21.15.80:0/2540025928 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa338106190 con 0x7fa33813dc00 2019-11-28T11:40:44.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa33d673700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa33813dc00 0x7fa338109e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa328010390 tx=0x7fa328010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:44.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa33d673700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa33813dc00 0x7fa338109e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa328010390 tx=0x7fa328010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:44.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.275+0000 7fa33d673700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa33813dc00 0x7fa338109e60 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7fa328010390 tx=0x7fa328010190).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:44.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.276+0000 7fa33d673700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa33813dc00 0x7fa338109e60 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fa328010390 tx=0x7fa328010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:44.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.276+0000 7fa335ffb700 1 -- 172.21.15.80:0/2540025928 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa328000940 con 0x7fa33813dc00 2019-11-28T11:40:44.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.276+0000 7fa33d673700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa33813dc00 0x7fa338109e60 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fa328010390 tx=0x7fa328010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:44.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.276+0000 7fa33d673700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa33813dc00 0x7fa338109e60 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fa328010390 tx=0x7fa328010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:44.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.276+0000 7fa335ffb700 1 -- 172.21.15.80:0/2540025928 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa328000f50 con 0x7fa33813dc00 2019-11-28T11:40:44.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.276+0000 7fa33f0d6700 1 -- 172.21.15.80:0/2540025928 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa338106510 con 0x7fa33813dc00 2019-11-28T11:40:44.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.276+0000 7fa335ffb700 1 -- 172.21.15.80:0/2540025928 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa328000940 con 0x7fa33813dc00 2019-11-28T11:40:44.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.276+0000 7fa33f0d6700 1 -- 172.21.15.80:0/2540025928 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa338106190 con 0x7fa33813dc00 2019-11-28T11:40:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.276+0000 7fa33d673700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa33813dc00 0x7fa338109e60 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fa328010390 tx=0x7fa328010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.276+0000 7fa335ffb700 1 -- 172.21.15.80:0/2540025928 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa328000b50 con 0x7fa33813dc00 2019-11-28T11:40:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.276+0000 7fa33d673700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa33813dc00 0x7fa338109e60 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fa328010390 tx=0x7fa328010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.276+0000 7fa335ffb700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa31c018780 0x7fa31c01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.276+0000 7fa335ffb700 1 -- 172.21.15.80:0/2540025928 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fa3280319e0 con 0x7fa33813dc00 2019-11-28T11:40:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.277+0000 7fa33ce72700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa31c018780 0x7fa31c01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.277+0000 7fa33ce72700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa31c018780 0x7fa31c01abf0 crc :-1 s=READY pgs=548 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:44.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.284+0000 7fa33f0d6700 1 -- 172.21.15.80:0/2540025928 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa338106510 con 0x7fa33813dc00 2019-11-28T11:40:44.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.288+0000 7fa33d673700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa33813dc00 0x7fa338109e60 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fa328010390 tx=0x7fa328010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:44.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.288+0000 7fa335ffb700 1 -- 172.21.15.80:0/2540025928 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa328000940 con 0x7fa33813dc00 2019-11-28T11:40:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.463+0000 7fa33f0d6700 1 -- 172.21.15.80:0/2540025928 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa338106190 con 0x7fa33813dc00 2019-11-28T11:40:44.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.464+0000 7fa33d673700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa33813dc00 0x7fa338109e60 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fa328010390 tx=0x7fa328010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:44.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.464+0000 7fa335ffb700 1 -- 172.21.15.80:0/2540025928 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2449 (secure 0 0 0) 0x7fa328000b50 con 0x7fa33813dc00 2019-11-28T11:40:44.496 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 65 2019-11-28T11:40:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:44.497 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:39:56.278526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.466+0000 7fa33f0d6700 1 -- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa31c018780 msgr2=0x7fa31c01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:44.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.466+0000 7fa33f0d6700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa31c018780 0x7fa31c01abf0 crc :-1 s=READY pgs=548 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:44.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.466+0000 7fa33f0d6700 1 -- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa33813dc00 msgr2=0x7fa338109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:44.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.466+0000 7fa33f0d6700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa33813dc00 0x7fa338109e60 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7fa328010390 tx=0x7fa328010190).stop 2019-11-28T11:40:44.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.466+0000 7fa33f0d6700 1 -- 172.21.15.80:0/2540025928 shutdown_connections 2019-11-28T11:40:44.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.466+0000 7fa33f0d6700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa31c018780 0x7fa31c01abf0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:44.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.466+0000 7fa33f0d6700 1 --2- 172.21.15.80:0/2540025928 >> v2:172.21.15.174:3300/0 conn(0x7fa33810a3a0 0x7fa338108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:44.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.466+0000 7fa33f0d6700 1 --2- 172.21.15.80:0/2540025928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa33813dc00 0x7fa338109e60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:44.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.466+0000 7fa33f0d6700 1 -- 172.21.15.80:0/2540025928 shutdown_connections 2019-11-28T11:40:44.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.466+0000 7fa33f0d6700 1 -- 172.21.15.80:0/2540025928 wait complete. 2019-11-28T11:40:44.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:44.466+0000 7fa33f0d6700 1 -- 172.21.15.80:0/2540025928 >> 172.21.15.80:0/2540025928 conn(0x7fa33811bfc0 msgr2=0x7fa338141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:44.508 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:40:45.510 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:45.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.596+0000 7fd160be5700 1 Processor -- start 2019-11-28T11:40:45.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.596+0000 7fd160be5700 1 -- start start 2019-11-28T11:40:45.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.597+0000 7fd160be5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd15c06c0a0 0x7fd15c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:45.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.597+0000 7fd160be5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd15c0734e0 0x7fd15c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:45.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.597+0000 7fd160be5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15c06db00 con 0x7fd15c072360 2019-11-28T11:40:45.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.597+0000 7fd160be5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15c06f330 con 0x7fd15c0734e0 2019-11-28T11:40:45.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.597+0000 7fd160be5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c0706c0 con 0x7fd15c06c0a0 2019-11-28T11:40:45.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.597+0000 7fd15a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd15c0734e0 0x7fd15c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:45.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.597+0000 7fd15a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd15c0734e0 0x7fd15c071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38062/0 (socket says 172.21.15.80:38062) 2019-11-28T11:40:45.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.597+0000 7fd15a59c700 1 -- 172.21.15.80:0/2774329467 learned_addr learned my addr 172.21.15.80:0/2774329467 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:45.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.597+0000 7fd15ad9d700 1 --2- 172.21.15.80:0/2774329467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd15c06c0a0 0x7fd15c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:45.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.597+0000 7fd15a59c700 1 -- 172.21.15.80:0/2774329467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd15c06c0a0 msgr2=0x7fd15c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:45.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.597+0000 7fd15a59c700 1 --2- 172.21.15.80:0/2774329467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd15c06c0a0 0x7fd15c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:45.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.597+0000 7fd15a59c700 1 -- 172.21.15.80:0/2774329467 >> v1:172.21.15.174:6789/0 conn(0x7fd15c072360 legacy=0x7fd15c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:45.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.597+0000 7fd159d9b700 1 -- 172.21.15.80:0/2774329467 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330051355 0 0) 0x7fd154000d30 con 0x7fd15c072360 2019-11-28T11:40:45.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.597+0000 7fd15a59c700 1 -- 172.21.15.80:0/2774329467 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c070a40 con 0x7fd15c0734e0 2019-11-28T11:40:45.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.597+0000 7fd15a59c700 1 --2- 172.21.15.80:0/2774329467 >> v2:172.21.15.80:3300/0 conn(0x7fd15c0734e0 0x7fd15c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd14c00f740 tx=0x7fd14c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:45.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.598+0000 7fd15a59c700 1 --2- 172.21.15.80:0/2774329467 >> v2:172.21.15.80:3300/0 conn(0x7fd15c0734e0 0x7fd15c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd14c00f740 tx=0x7fd14c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:45.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.598+0000 7fd15a59c700 1 --2- 172.21.15.80:0/2774329467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c0734e0 0x7fd15c071e20 secure :-1 s=READY pgs=1335 cs=0 l=1 rx=0x7fd14c00f740 tx=0x7fd14c00f570).ready entity=mon.0 client_cookie=c0b1ea103e372ec5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:45.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.598+0000 7fd15a59c700 1 --2- 172.21.15.80:0/2774329467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c0734e0 0x7fd15c071e20 secure :-1 s=THROTTLE_DONE pgs=1335 cs=0 l=1 rx=0x7fd14c00f740 tx=0x7fd14c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:45.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.598+0000 7fd15a59c700 1 --2- 172.21.15.80:0/2774329467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c0734e0 0x7fd15c071e20 secure :-1 s=THROTTLE_DONE pgs=1335 cs=0 l=1 rx=0x7fd14c00f740 tx=0x7fd14c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:45.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.598+0000 7fd159d9b700 1 -- 172.21.15.80:0/2774329467 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd14c000960 con 0x7fd15c0734e0 2019-11-28T11:40:45.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.598+0000 7fd15a59c700 1 --2- 172.21.15.80:0/2774329467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c0734e0 0x7fd15c071e20 secure :-1 s=THROTTLE_DONE pgs=1335 cs=0 l=1 rx=0x7fd14c00f740 tx=0x7fd14c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:45.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.598+0000 7fd159d9b700 1 -- 172.21.15.80:0/2774329467 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c000c90 con 0x7fd15c0734e0 2019-11-28T11:40:45.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.598+0000 7fd159d9b700 1 -- 172.21.15.80:0/2774329467 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd14c0013a0 con 0x7fd15c0734e0 2019-11-28T11:40:45.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.598+0000 7fd160be5700 1 -- 172.21.15.80:0/2774329467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c0734e0 msgr2=0x7fd15c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:45.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.598+0000 7fd160be5700 1 --2- 172.21.15.80:0/2774329467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c0734e0 0x7fd15c071e20 secure :-1 s=READY pgs=1335 cs=0 l=1 rx=0x7fd14c00f740 tx=0x7fd14c00f570).stop 2019-11-28T11:40:45.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.599+0000 7fd160be5700 1 -- 172.21.15.80:0/2774329467 shutdown_connections 2019-11-28T11:40:45.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.599+0000 7fd160be5700 1 --2- 172.21.15.80:0/2774329467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c0734e0 0x7fd15c071e20 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:45.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.599+0000 7fd160be5700 1 --2- 172.21.15.80:0/2774329467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd15c06c0a0 0x7fd15c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:45.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.599+0000 7fd160be5700 1 -- 172.21.15.80:0/2774329467 shutdown_connections 2019-11-28T11:40:45.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.599+0000 7fd160be5700 1 -- 172.21.15.80:0/2774329467 wait complete. 2019-11-28T11:40:45.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.599+0000 7fd160be5700 1 -- 172.21.15.80:0/2774329467 >> 172.21.15.80:0/2774329467 conn(0x7fd15c061cf0 msgr2=0x7fd15c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:45.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.601+0000 7fd160be5700 1 Processor -- start 2019-11-28T11:40:45.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.601+0000 7fd160be5700 1 -- start start 2019-11-28T11:40:45.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd160be5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd15c15fdf0 0x7fd15c12b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:45.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd160be5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd15c12b8a0 0x7fd15c13e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:45.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd160be5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15c139e00 con 0x7fd15c13e860 2019-11-28T11:40:45.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd160be5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15c108820 con 0x7fd15c15fdf0 2019-11-28T11:40:45.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd160be5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15c108af0 con 0x7fd15c12b8a0 2019-11-28T11:40:45.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd15ad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd15c15fdf0 0x7fd15c12b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:45.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd15ad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd15c15fdf0 0x7fd15c12b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38064/0 (socket says 172.21.15.80:38064) 2019-11-28T11:40:45.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd15b59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd15c13e860 0x7fd15c12a3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37384/0 (socket says 172.21.15.80:37384) 2019-11-28T11:40:45.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd15ad9d700 1 -- 172.21.15.80:0/974162946 learned_addr learned my addr 172.21.15.80:0/974162946 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:45.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd15a59c700 1 --2- 172.21.15.80:0/974162946 >> v2:172.21.15.174:3300/0 conn(0x7fd15c12b8a0 0x7fd15c13e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:45.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd15ad9d700 1 -- 172.21.15.80:0/974162946 >> v2:172.21.15.174:3300/0 conn(0x7fd15c12b8a0 msgr2=0x7fd15c13e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:45.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd15ad9d700 1 --2- 172.21.15.80:0/974162946 >> v2:172.21.15.174:3300/0 conn(0x7fd15c12b8a0 0x7fd15c13e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:45.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd15ad9d700 1 -- 172.21.15.80:0/974162946 >> v1:172.21.15.80:6789/0 conn(0x7fd15c13e860 legacy=0x7fd15c12a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:45.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd15ad9d700 1 -- 172.21.15.80:0/974162946 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c10a8c0 con 0x7fd15c15fdf0 2019-11-28T11:40:45.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd1537fe700 1 -- 172.21.15.80:0/974162946 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157789460 0 0) 0x7fd1540015c0 con 0x7fd15c13e860 2019-11-28T11:40:45.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd15ad9d700 1 --2- 172.21.15.80:0/974162946 >> v2:172.21.15.80:3300/0 conn(0x7fd15c15fdf0 0x7fd15c12b360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd144010450 tx=0x7fd144010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:45.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd15ad9d700 1 --2- 172.21.15.80:0/974162946 >> v2:172.21.15.80:3300/0 conn(0x7fd15c15fdf0 0x7fd15c12b360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd144010450 tx=0x7fd144010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:45.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd15ad9d700 1 --2- 172.21.15.80:0/974162946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c15fdf0 0x7fd15c12b360 secure :-1 s=READY pgs=1337 cs=0 l=1 rx=0x7fd144010450 tx=0x7fd144010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:45.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd15ad9d700 1 --2- 172.21.15.80:0/974162946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c15fdf0 0x7fd15c12b360 secure :-1 s=THROTTLE_DONE pgs=1337 cs=0 l=1 rx=0x7fd144010450 tx=0x7fd144010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:45.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd1537fe700 1 -- 172.21.15.80:0/974162946 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd144000940 con 0x7fd15c15fdf0 2019-11-28T11:40:45.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd15ad9d700 1 --2- 172.21.15.80:0/974162946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c15fdf0 0x7fd15c12b360 secure :-1 s=THROTTLE_DONE pgs=1337 cs=0 l=1 rx=0x7fd144010450 tx=0x7fd144010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:45.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd1537fe700 1 -- 172.21.15.80:0/974162946 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd144000e80 con 0x7fd15c15fdf0 2019-11-28T11:40:45.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd15ad9d700 1 --2- 172.21.15.80:0/974162946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c15fdf0 0x7fd15c12b360 secure :-1 s=THROTTLE_DONE pgs=1337 cs=0 l=1 rx=0x7fd144010450 tx=0x7fd144010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:45.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd160be5700 1 -- 172.21.15.80:0/974162946 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15c10a8c0 con 0x7fd15c15fdf0 2019-11-28T11:40:45.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd1537fe700 1 -- 172.21.15.80:0/974162946 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd144001070 con 0x7fd15c15fdf0 2019-11-28T11:40:45.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.602+0000 7fd160be5700 1 -- 172.21.15.80:0/974162946 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15c10a8c0 con 0x7fd15c15fdf0 2019-11-28T11:40:45.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.603+0000 7fd15ad9d700 1 --2- 172.21.15.80:0/974162946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c15fdf0 0x7fd15c12b360 secure :-1 s=THROTTLE_DONE pgs=1337 cs=0 l=1 rx=0x7fd144010450 tx=0x7fd144010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:45.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.603+0000 7fd1537fe700 1 -- 172.21.15.80:0/974162946 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd144001070 con 0x7fd15c15fdf0 2019-11-28T11:40:45.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.603+0000 7fd15ad9d700 1 --2- 172.21.15.80:0/974162946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c15fdf0 0x7fd15c12b360 secure :-1 s=THROTTLE_DONE pgs=1337 cs=0 l=1 rx=0x7fd144010450 tx=0x7fd144010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:45.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.603+0000 7fd1537fe700 1 --2- 172.21.15.80:0/974162946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd140018730 0x7fd14001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:45.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.603+0000 7fd1537fe700 1 -- 172.21.15.80:0/974162946 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fd144031ad0 con 0x7fd15c15fdf0 2019-11-28T11:40:45.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.603+0000 7fd15a59c700 1 --2- 172.21.15.80:0/974162946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd140018730 0x7fd14001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:45.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.604+0000 7fd15a59c700 1 --2- 172.21.15.80:0/974162946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd140018730 0x7fd14001abc0 crc :-1 s=READY pgs=549 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.611+0000 7fd160be5700 1 -- 172.21.15.80:0/974162946 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15c109180 con 0x7fd15c15fdf0 2019-11-28T11:40:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.614+0000 7fd15ad9d700 1 --2- 172.21.15.80:0/974162946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c15fdf0 0x7fd15c12b360 secure :-1 s=THROTTLE_DONE pgs=1337 cs=0 l=1 rx=0x7fd144010450 tx=0x7fd144010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:45.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.614+0000 7fd1537fe700 1 -- 172.21.15.80:0/974162946 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd144009250 con 0x7fd15c15fdf0 2019-11-28T11:40:45.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.790+0000 7fd160be5700 1 -- 172.21.15.80:0/974162946 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd15c109500 con 0x7fd15c15fdf0 2019-11-28T11:40:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.790+0000 7fd15ad9d700 1 --2- 172.21.15.80:0/974162946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c15fdf0 0x7fd15c12b360 secure :-1 s=THROTTLE_DONE pgs=1337 cs=0 l=1 rx=0x7fd144010450 tx=0x7fd144010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.790+0000 7fd1537fe700 1 -- 172.21.15.80:0/974162946 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2447 (secure 0 0 0) 0x7fd144001070 con 0x7fd15c15fdf0 2019-11-28T11:40:45.824 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 66 2019-11-28T11:40:45.824 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:45.824 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:40:45.672092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.793+0000 7fd160be5700 1 -- 172.21.15.80:0/974162946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd140018730 msgr2=0x7fd14001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.793+0000 7fd160be5700 1 --2- 172.21.15.80:0/974162946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd140018730 0x7fd14001abc0 crc :-1 s=READY pgs=549 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.793+0000 7fd160be5700 1 -- 172.21.15.80:0/974162946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c15fdf0 msgr2=0x7fd15c12b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.793+0000 7fd160be5700 1 --2- 172.21.15.80:0/974162946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c15fdf0 0x7fd15c12b360 secure :-1 s=READY pgs=1337 cs=0 l=1 rx=0x7fd144010450 tx=0x7fd144010280).stop 2019-11-28T11:40:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.793+0000 7fd160be5700 1 -- 172.21.15.80:0/974162946 shutdown_connections 2019-11-28T11:40:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.793+0000 7fd160be5700 1 --2- 172.21.15.80:0/974162946 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd140018730 0x7fd14001abc0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.793+0000 7fd160be5700 1 --2- 172.21.15.80:0/974162946 >> v2:172.21.15.174:3300/0 conn(0x7fd15c12b8a0 0x7fd15c13e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.793+0000 7fd160be5700 1 --2- 172.21.15.80:0/974162946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd15c15fdf0 0x7fd15c12b360 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.793+0000 7fd160be5700 1 -- 172.21.15.80:0/974162946 shutdown_connections 2019-11-28T11:40:45.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.793+0000 7fd160be5700 1 -- 172.21.15.80:0/974162946 wait complete. 2019-11-28T11:40:45.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:45.793+0000 7fd160be5700 1 -- 172.21.15.80:0/974162946 >> 172.21.15.80:0/974162946 conn(0x7fd15c127dc0 msgr2=0x7fd15c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:45.835 INFO:tasks.cephfs.filesystem:mapped states [u'up:rejoin'] to None 2019-11-28T11:40:46.836 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:46.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.931+0000 7ff308425700 1 Processor -- start 2019-11-28T11:40:46.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.931+0000 7ff308425700 1 -- start start 2019-11-28T11:40:46.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.932+0000 7ff308425700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30006c0a0 0x7ff300072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:46.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.932+0000 7ff308425700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff300072620 0x7ff300164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:46.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.932+0000 7ff308425700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff30006db00 con 0x7ff3000734e0 2019-11-28T11:40:46.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.932+0000 7ff308425700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff30006f330 con 0x7ff300072620 2019-11-28T11:40:46.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.932+0000 7ff308425700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3000706c0 con 0x7ff30006c0a0 2019-11-28T11:40:46.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.932+0000 7ff3071c3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff300072620 0x7ff300164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:46.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.932+0000 7ff3071c3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff300072620 0x7ff300164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38078/0 (socket says 172.21.15.80:38078) 2019-11-28T11:40:46.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.932+0000 7ff3071c3700 1 -- 172.21.15.80:0/1603633588 learned_addr learned my addr 172.21.15.80:0/1603633588 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:46.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.932+0000 7ff3069c2700 1 --2- 172.21.15.80:0/1603633588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30006c0a0 0x7ff300072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:46.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.932+0000 7ff3071c3700 1 -- 172.21.15.80:0/1603633588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30006c0a0 msgr2=0x7ff300072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:46.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.932+0000 7ff3071c3700 1 --2- 172.21.15.80:0/1603633588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30006c0a0 0x7ff300072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:46.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.932+0000 7ff3071c3700 1 -- 172.21.15.80:0/1603633588 >> v1:172.21.15.174:6789/0 conn(0x7ff3000734e0 legacy=0x7ff300071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:46.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.932+0000 7ff3071c3700 1 -- 172.21.15.80:0/1603633588 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff300070a40 con 0x7ff300072620 2019-11-28T11:40:46.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.932+0000 7ff3069c2700 1 --2- 172.21.15.80:0/1603633588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30006c0a0 0x7ff300072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:40:46.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.932+0000 7ff3071c3700 1 --2- 172.21.15.80:0/1603633588 >> v2:172.21.15.80:3300/0 conn(0x7ff300072620 0x7ff300164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff2fc00f730 tx=0x7ff2fc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:46.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.933+0000 7ff3071c3700 1 --2- 172.21.15.80:0/1603633588 >> v2:172.21.15.80:3300/0 conn(0x7ff300072620 0x7ff300164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff2fc00f730 tx=0x7ff2fc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:46.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.933+0000 7ff3071c3700 1 --2- 172.21.15.80:0/1603633588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff300072620 0x7ff300164d70 secure :-1 s=READY pgs=1338 cs=0 l=1 rx=0x7ff2fc00f730 tx=0x7ff2fc00fad0).ready entity=mon.0 client_cookie=460c1e8c73240890 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:46.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.933+0000 7ff3071c3700 1 --2- 172.21.15.80:0/1603633588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff300072620 0x7ff300164d70 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7ff2fc00f730 tx=0x7ff2fc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:46.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.933+0000 7ff3071c3700 1 --2- 172.21.15.80:0/1603633588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff300072620 0x7ff300164d70 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7ff2fc00f730 tx=0x7ff2fc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:46.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.933+0000 7ff3071c3700 1 --2- 172.21.15.80:0/1603633588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff300072620 0x7ff300164d70 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7ff2fc00f730 tx=0x7ff2fc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:46.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.933+0000 7ff3059c0700 1 -- 172.21.15.80:0/1603633588 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2fc000b90 con 0x7ff300072620 2019-11-28T11:40:46.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.933+0000 7ff3059c0700 1 -- 172.21.15.80:0/1603633588 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc0010e0 con 0x7ff300072620 2019-11-28T11:40:46.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.933+0000 7ff3059c0700 1 -- 172.21.15.80:0/1603633588 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2fc001830 con 0x7ff300072620 2019-11-28T11:40:46.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.933+0000 7ff308425700 1 -- 172.21.15.80:0/1603633588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff300072620 msgr2=0x7ff300164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:46.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.933+0000 7ff308425700 1 --2- 172.21.15.80:0/1603633588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff300072620 0x7ff300164d70 secure :-1 s=READY pgs=1338 cs=0 l=1 rx=0x7ff2fc00f730 tx=0x7ff2fc00fad0).stop 2019-11-28T11:40:46.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.934+0000 7ff308425700 1 -- 172.21.15.80:0/1603633588 shutdown_connections 2019-11-28T11:40:46.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.934+0000 7ff308425700 1 --2- 172.21.15.80:0/1603633588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff300072620 0x7ff300164d70 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:46.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.934+0000 7ff308425700 1 --2- 172.21.15.80:0/1603633588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30006c0a0 0x7ff300072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:46.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.934+0000 7ff308425700 1 -- 172.21.15.80:0/1603633588 shutdown_connections 2019-11-28T11:40:46.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.934+0000 7ff308425700 1 -- 172.21.15.80:0/1603633588 wait complete. 2019-11-28T11:40:46.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.934+0000 7ff308425700 1 -- 172.21.15.80:0/1603633588 >> 172.21.15.80:0/1603633588 conn(0x7ff300061cf0 msgr2=0x7ff300064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:46.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.936+0000 7ff308425700 1 Processor -- start 2019-11-28T11:40:46.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.936+0000 7ff308425700 1 -- start start 2019-11-28T11:40:46.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.937+0000 7ff308425700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff30013e8e0 0x7ff30007b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:46.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.937+0000 7ff308425700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30007ba00 0x7ff3001293f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:46.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.937+0000 7ff308425700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff30013f190 con 0x7ff300129930 2019-11-28T11:40:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.937+0000 7ff308425700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff300142d50 con 0x7ff30013e8e0 2019-11-28T11:40:46.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.937+0000 7ff308425700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff300143020 con 0x7ff30007ba00 2019-11-28T11:40:46.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.937+0000 7ff3069c2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff30013e8e0 0x7ff30007b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:46.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.937+0000 7ff3061c1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30007ba00 0x7ff3001293f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:46.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.937+0000 7ff3069c2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff30013e8e0 0x7ff30007b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:52968/0 (socket says 172.21.15.80:52968) 2019-11-28T11:40:46.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.937+0000 7ff3069c2700 1 -- 172.21.15.80:0/783923148 learned_addr learned my addr 172.21.15.80:0/783923148 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:46.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.938+0000 7ff3061c1700 1 -- 172.21.15.80:0/783923148 >> v2:172.21.15.174:3300/0 conn(0x7ff30013e8e0 msgr2=0x7ff30007b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:46.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.938+0000 7ff3061c1700 1 --2- 172.21.15.80:0/783923148 >> v2:172.21.15.174:3300/0 conn(0x7ff30013e8e0 0x7ff30007b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:46.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.938+0000 7ff3061c1700 1 -- 172.21.15.80:0/783923148 >> v1:172.21.15.174:6789/0 conn(0x7ff300129930 legacy=0x7ff300111010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:46.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.938+0000 7ff3061c1700 1 -- 172.21.15.80:0/783923148 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff300078c00 con 0x7ff30007ba00 2019-11-28T11:40:46.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.938+0000 7ff3069c2700 1 --2- 172.21.15.80:0/783923148 >> v2:172.21.15.174:3300/0 conn(0x7ff30013e8e0 0x7ff30007b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:40:46.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.938+0000 7ff3061c1700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30007ba00 0x7ff3001293f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff2f0010720 tx=0x7ff2f0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.938+0000 7ff3061c1700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30007ba00 0x7ff3001293f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff2f0010720 tx=0x7ff2f0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.938+0000 7ff3061c1700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30007ba00 0x7ff3001293f0 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7ff2f0010720 tx=0x7ff2f0010ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.938+0000 7ff3061c1700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30007ba00 0x7ff3001293f0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff2f0010720 tx=0x7ff2f0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:46.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.938+0000 7ff3061c1700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30007ba00 0x7ff3001293f0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff2f0010720 tx=0x7ff2f0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:46.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.938+0000 7ff2f77fe700 1 -- 172.21.15.80:0/783923148 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2f0007590 con 0x7ff30007ba00 2019-11-28T11:40:46.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.938+0000 7ff3061c1700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30007ba00 0x7ff3001293f0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff2f0010720 tx=0x7ff2f0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:46.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.938+0000 7ff2f77fe700 1 -- 172.21.15.80:0/783923148 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f0009bb0 con 0x7ff30007ba00 2019-11-28T11:40:46.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.938+0000 7ff308425700 1 -- 172.21.15.80:0/783923148 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff300078f80 con 0x7ff30007ba00 2019-11-28T11:40:46.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.938+0000 7ff2f77fe700 1 -- 172.21.15.80:0/783923148 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2f000a300 con 0x7ff30007ba00 2019-11-28T11:40:46.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.938+0000 7ff308425700 1 -- 172.21.15.80:0/783923148 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff300078c00 con 0x7ff30007ba00 2019-11-28T11:40:46.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.939+0000 7ff3061c1700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30007ba00 0x7ff3001293f0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff2f0010720 tx=0x7ff2f0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:46.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.939+0000 7ff2f77fe700 1 -- 172.21.15.80:0/783923148 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff2f0009b10 con 0x7ff30007ba00 2019-11-28T11:40:46.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.939+0000 7ff3061c1700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30007ba00 0x7ff3001293f0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff2f0010720 tx=0x7ff2f0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:46.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.939+0000 7ff2f77fe700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2e0018730 0x7ff2e001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:46.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.939+0000 7ff2f77fe700 1 -- 172.21.15.80:0/783923148 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6149+0+0 (secure 0 0 0) 0x7ff2f0031da0 con 0x7ff30007ba00 2019-11-28T11:40:46.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.940+0000 7ff3069c2700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2e0018730 0x7ff2e001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:47.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.940+0000 7ff3069c2700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2e0018730 0x7ff2e001abc0 crc :-1 s=READY pgs=550 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:47.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.946+0000 7ff308425700 1 -- 172.21.15.80:0/783923148 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff300078f80 con 0x7ff30007ba00 2019-11-28T11:40:47.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.950+0000 7ff3061c1700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30007ba00 0x7ff3001293f0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff2f0010720 tx=0x7ff2f0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:46.950+0000 7ff2f77fe700 1 -- 172.21.15.80:0/783923148 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff2f0009900 con 0x7ff30007ba00 2019-11-28T11:40:47.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.121+0000 7ff308425700 1 -- 172.21.15.80:0/783923148 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff300078c00 con 0x7ff30007ba00 2019-11-28T11:40:47.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.122+0000 7ff3061c1700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30007ba00 0x7ff3001293f0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff2f0010720 tx=0x7ff2f0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.122+0000 7ff2f77fe700 1 -- 172.21.15.80:0/783923148 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2447 (secure 0 0 0) 0x7ff2f0009b10 con 0x7ff30007ba00 2019-11-28T11:40:47.154 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 67 2019-11-28T11:40:47.155 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:47.155 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:40:46.673273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":16,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:47.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.124+0000 7ff308425700 1 -- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2e0018730 msgr2=0x7ff2e001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.124+0000 7ff308425700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2e0018730 0x7ff2e001abc0 crc :-1 s=READY pgs=550 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.124+0000 7ff308425700 1 -- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30007ba00 msgr2=0x7ff3001293f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.124+0000 7ff308425700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30007ba00 0x7ff3001293f0 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7ff2f0010720 tx=0x7ff2f0010ac0).stop 2019-11-28T11:40:47.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.124+0000 7ff308425700 1 -- 172.21.15.80:0/783923148 shutdown_connections 2019-11-28T11:40:47.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.124+0000 7ff308425700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2e0018730 0x7ff2e001abc0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.124+0000 7ff308425700 1 --2- 172.21.15.80:0/783923148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff30007ba00 0x7ff3001293f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.124+0000 7ff308425700 1 --2- 172.21.15.80:0/783923148 >> v2:172.21.15.174:3300/0 conn(0x7ff30013e8e0 0x7ff30007b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.124+0000 7ff308425700 1 -- 172.21.15.80:0/783923148 shutdown_connections 2019-11-28T11:40:47.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.124+0000 7ff308425700 1 -- 172.21.15.80:0/783923148 wait complete. 2019-11-28T11:40:47.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.124+0000 7ff308425700 1 -- 172.21.15.80:0/783923148 >> 172.21.15.80:0/783923148 conn(0x7ff30013b860 msgr2=0x7ff3001050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:47.165 INFO:tasks.cephfs.filesystem:mapped states [u'up:active'] to up:active 2019-11-28T11:40:47.165 INFO:tasks.cephfs.filesystem:reached state 'up:active' in 49.8225529194s 2019-11-28T11:40:47.165 INFO:tasks.cephfs.test_client_recovery:Reached active... 2019-11-28T11:40:47.166 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:40:47.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.254+0000 7fe0099bc700 1 Processor -- start 2019-11-28T11:40:47.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.254+0000 7fe0099bc700 1 -- start start 2019-11-28T11:40:47.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0099bc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe00406c0a0 0x7fe004072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:47.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0099bc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe0040734e0 0x7fe004071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:47.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0099bc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00406db00 con 0x7fe004072360 2019-11-28T11:40:47.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0099bc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00406fd60 con 0x7fe00406c0a0 2019-11-28T11:40:47.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0099bc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe004070030 con 0x7fe0040734e0 2019-11-28T11:40:47.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0037fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe00406c0a0 0x7fe004072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:47.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe003fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe004072360 0x7fe00406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37410/0 (socket says 172.21.15.80:37410) 2019-11-28T11:40:47.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe003fff700 1 -- 172.21.15.80:0/3715610150 learned_addr learned my addr 172.21.15.80:0/3715610150 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:47.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe002ffd700 1 --2- 172.21.15.80:0/3715610150 >> v2:172.21.15.174:3300/0 conn(0x7fe0040734e0 0x7fe004071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:47.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0037fe700 1 -- 172.21.15.80:0/3715610150 >> v2:172.21.15.174:3300/0 conn(0x7fe0040734e0 msgr2=0x7fe004071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:47.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0037fe700 1 --2- 172.21.15.80:0/3715610150 >> v2:172.21.15.174:3300/0 conn(0x7fe0040734e0 0x7fe004071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:47.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0037fe700 1 -- 172.21.15.80:0/3715610150 >> v1:172.21.15.80:6789/0 conn(0x7fe004072360 legacy=0x7fe00406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0037fe700 1 -- 172.21.15.80:0/3715610150 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0040706c0 con 0x7fe00406c0a0 2019-11-28T11:40:47.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0027fc700 1 -- 172.21.15.80:0/3715610150 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600939943 0 0) 0x7fdff4001150 con 0x7fe004072360 2019-11-28T11:40:47.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0037fe700 1 --2- 172.21.15.80:0/3715610150 >> v2:172.21.15.80:3300/0 conn(0x7fe00406c0a0 0x7fe004072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdffc00af50 tx=0x7fdffc00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0037fe700 1 --2- 172.21.15.80:0/3715610150 >> v2:172.21.15.80:3300/0 conn(0x7fe00406c0a0 0x7fe004072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdffc00af50 tx=0x7fdffc00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0037fe700 1 --2- 172.21.15.80:0/3715610150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00406c0a0 0x7fe004072fa0 secure :-1 s=READY pgs=1340 cs=0 l=1 rx=0x7fdffc00af50 tx=0x7fdffc00b6e0).ready entity=mon.0 client_cookie=bca39d0fc0ad6550 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:47.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0037fe700 1 --2- 172.21.15.80:0/3715610150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00406c0a0 0x7fe004072fa0 secure :-1 s=THROTTLE_DONE pgs=1340 cs=0 l=1 rx=0x7fdffc00af50 tx=0x7fdffc00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0027fc700 1 -- 172.21.15.80:0/3715610150 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdffc007210 con 0x7fe00406c0a0 2019-11-28T11:40:47.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0037fe700 1 --2- 172.21.15.80:0/3715610150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00406c0a0 0x7fe004072fa0 secure :-1 s=THROTTLE_DONE pgs=1340 cs=0 l=1 rx=0x7fdffc00af50 tx=0x7fdffc00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0037fe700 1 --2- 172.21.15.80:0/3715610150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00406c0a0 0x7fe004072fa0 secure :-1 s=THROTTLE_DONE pgs=1340 cs=0 l=1 rx=0x7fdffc00af50 tx=0x7fdffc00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0027fc700 1 -- 172.21.15.80:0/3715610150 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc0099b0 con 0x7fe00406c0a0 2019-11-28T11:40:47.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0027fc700 1 -- 172.21.15.80:0/3715610150 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdffc00a080 con 0x7fe00406c0a0 2019-11-28T11:40:47.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0099bc700 1 -- 172.21.15.80:0/3715610150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00406c0a0 msgr2=0x7fe004072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.255+0000 7fe0099bc700 1 --2- 172.21.15.80:0/3715610150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00406c0a0 0x7fe004072fa0 secure :-1 s=READY pgs=1340 cs=0 l=1 rx=0x7fdffc00af50 tx=0x7fdffc00b6e0).stop 2019-11-28T11:40:47.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.256+0000 7fe0099bc700 1 -- 172.21.15.80:0/3715610150 shutdown_connections 2019-11-28T11:40:47.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.256+0000 7fe0099bc700 1 --2- 172.21.15.80:0/3715610150 >> v2:172.21.15.174:3300/0 conn(0x7fe0040734e0 0x7fe004071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:47.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.256+0000 7fe0099bc700 1 --2- 172.21.15.80:0/3715610150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00406c0a0 0x7fe004072fa0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.256+0000 7fe0099bc700 1 -- 172.21.15.80:0/3715610150 shutdown_connections 2019-11-28T11:40:47.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.256+0000 7fe0099bc700 1 -- 172.21.15.80:0/3715610150 wait complete. 2019-11-28T11:40:47.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.256+0000 7fe0099bc700 1 -- 172.21.15.80:0/3715610150 >> 172.21.15.80:0/3715610150 conn(0x7fe004061cf0 msgr2=0x7fe004064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:47.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.258+0000 7fe0099bc700 1 Processor -- start 2019-11-28T11:40:47.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.259+0000 7fe0099bc700 1 -- start start 2019-11-28T11:40:47.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.259+0000 7fe0099bc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe004104820 0x7fe00410c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:47.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.259+0000 7fe0099bc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe00410c890 0x7fe00410b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:47.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.259+0000 7fe0099bc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe00410b710 0x7fe00410bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:47.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.259+0000 7fe0099bc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe004109130 con 0x7fe00410c890 2019-11-28T11:40:47.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.259+0000 7fe0099bc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe004109400 con 0x7fe004104820 2019-11-28T11:40:47.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.259+0000 7fe0099bc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe004108700 con 0x7fe00410b710 2019-11-28T11:40:47.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe002ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe00410c890 0x7fe00410b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:47.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe002ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe00410c890 0x7fe00410b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38098/0 (socket says 172.21.15.80:38098) 2019-11-28T11:40:47.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe002ffd700 1 -- 172.21.15.80:0/2593743443 learned_addr learned my addr 172.21.15.80:0/2593743443 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:47.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe0037fe700 1 --2- 172.21.15.80:0/2593743443 >> v2:172.21.15.174:3300/0 conn(0x7fe004104820 0x7fe00410c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:47.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe003fff700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe00410b710 0x7fe00410bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:47.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe002ffd700 1 -- 172.21.15.80:0/2593743443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe00410b710 msgr2=0x7fe00410bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe002ffd700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe00410b710 0x7fe00410bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe002ffd700 1 -- 172.21.15.80:0/2593743443 >> v2:172.21.15.174:3300/0 conn(0x7fe004104820 msgr2=0x7fe00410c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe002ffd700 1 --2- 172.21.15.80:0/2593743443 >> v2:172.21.15.174:3300/0 conn(0x7fe004104820 0x7fe00410c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe002ffd700 1 -- 172.21.15.80:0/2593743443 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe004109a90 con 0x7fe00410c890 2019-11-28T11:40:47.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe0037fe700 1 --2- 172.21.15.80:0/2593743443 >> v2:172.21.15.174:3300/0 conn(0x7fe004104820 0x7fe00410c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:40:47.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe002ffd700 1 --2- 172.21.15.80:0/2593743443 >> v2:172.21.15.80:3300/0 conn(0x7fe00410c890 0x7fe00410b1d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdfec0107d0 tx=0x7fdfec010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe002ffd700 1 --2- 172.21.15.80:0/2593743443 >> v2:172.21.15.80:3300/0 conn(0x7fe00410c890 0x7fe00410b1d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdfec0107d0 tx=0x7fdfec010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe002ffd700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00410c890 0x7fe00410b1d0 secure :-1 s=READY pgs=1341 cs=0 l=1 rx=0x7fdfec0107d0 tx=0x7fdfec010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:47.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe002ffd700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00410c890 0x7fe00410b1d0 secure :-1 s=THROTTLE_DONE pgs=1341 cs=0 l=1 rx=0x7fdfec0107d0 tx=0x7fdfec010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fdffbfff700 1 -- 172.21.15.80:0/2593743443 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfec000ce0 con 0x7fe00410c890 2019-11-28T11:40:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe002ffd700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00410c890 0x7fe00410b1d0 secure :-1 s=THROTTLE_DONE pgs=1341 cs=0 l=1 rx=0x7fdfec0107d0 tx=0x7fdfec010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe002ffd700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00410c890 0x7fe00410b1d0 secure :-1 s=THROTTLE_DONE pgs=1341 cs=0 l=1 rx=0x7fdfec0107d0 tx=0x7fdfec010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fdffbfff700 1 -- 172.21.15.80:0/2593743443 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec001200 con 0x7fe00410c890 2019-11-28T11:40:47.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe0099bc700 1 -- 172.21.15.80:0/2593743443 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe004109e10 con 0x7fe00410c890 2019-11-28T11:40:47.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fdffbfff700 1 -- 172.21.15.80:0/2593743443 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfec001930 con 0x7fe00410c890 2019-11-28T11:40:47.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.260+0000 7fe0099bc700 1 -- 172.21.15.80:0/2593743443 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe004109a90 con 0x7fe00410c890 2019-11-28T11:40:47.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.261+0000 7fe002ffd700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00410c890 0x7fe00410b1d0 secure :-1 s=THROTTLE_DONE pgs=1341 cs=0 l=1 rx=0x7fdfec0107d0 tx=0x7fdfec010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.261+0000 7fdffbfff700 1 -- 172.21.15.80:0/2593743443 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fdfec0013f0 con 0x7fe00410c890 2019-11-28T11:40:47.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.261+0000 7fe002ffd700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00410c890 0x7fe00410b1d0 secure :-1 s=THROTTLE_DONE pgs=1341 cs=0 l=1 rx=0x7fdfec0107d0 tx=0x7fdfec010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.261+0000 7fdffbfff700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdfe8018730 0x7fdfe801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:47.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.261+0000 7fdffbfff700 1 -- 172.21.15.80:0/2593743443 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fdfec031db0 con 0x7fe00410c890 2019-11-28T11:40:47.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.261+0000 7fe0037fe700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdfe8018730 0x7fdfe801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:47.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.261+0000 7fe0037fe700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdfe8018730 0x7fdfe801abc0 crc :-1 s=READY pgs=551 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:47.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.269+0000 7fe0099bc700 1 -- 172.21.15.80:0/2593743443 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe004109e10 con 0x7fe00410c890 2019-11-28T11:40:47.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.272+0000 7fe002ffd700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00410c890 0x7fe00410b1d0 secure :-1 s=THROTTLE_DONE pgs=1341 cs=0 l=1 rx=0x7fdfec0107d0 tx=0x7fdfec010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.272+0000 7fdffbfff700 1 -- 172.21.15.80:0/2593743443 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fdfec009660 con 0x7fe00410c890 2019-11-28T11:40:47.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.447+0000 7fe0099bc700 1 -- 172.21.15.80:0/2593743443 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe004109a90 con 0x7fe00410c890 2019-11-28T11:40:47.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.448+0000 7fe002ffd700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00410c890 0x7fe00410b1d0 secure :-1 s=THROTTLE_DONE pgs=1341 cs=0 l=1 rx=0x7fdfec0107d0 tx=0x7fdfec010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.448+0000 7fdffbfff700 1 -- 172.21.15.80:0/2593743443 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+15051 (secure 0 0 0) 0x7fdfec0013f0 con 0x7fe00410c890 2019-11-28T11:40:47.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.450+0000 7fe0099bc700 1 -- 172.21.15.80:0/2593743443 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdfe8018730 msgr2=0x7fdfe801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.450+0000 7fe0099bc700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdfe8018730 0x7fdfe801abc0 crc :-1 s=READY pgs=551 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.450+0000 7fe0099bc700 1 -- 172.21.15.80:0/2593743443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00410c890 msgr2=0x7fe00410b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.450+0000 7fe0099bc700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00410c890 0x7fe00410b1d0 secure :-1 s=READY pgs=1341 cs=0 l=1 rx=0x7fdfec0107d0 tx=0x7fdfec010600).stop 2019-11-28T11:40:47.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.450+0000 7fe0099bc700 1 -- 172.21.15.80:0/2593743443 shutdown_connections 2019-11-28T11:40:47.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.450+0000 7fe0099bc700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdfe8018730 0x7fdfe801abc0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.450+0000 7fe0099bc700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe00410b710 0x7fe00410bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.450+0000 7fe0099bc700 1 --2- 172.21.15.80:0/2593743443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe00410c890 0x7fe00410b1d0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.450+0000 7fe0099bc700 1 --2- 172.21.15.80:0/2593743443 >> v2:172.21.15.174:3300/0 conn(0x7fe004104820 0x7fe00410c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.451+0000 7fe0099bc700 1 -- 172.21.15.80:0/2593743443 shutdown_connections 2019-11-28T11:40:47.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.451+0000 7fe0099bc700 1 -- 172.21.15.80:0/2593743443 wait complete. 2019-11-28T11:40:47.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.451+0000 7fe0099bc700 1 -- 172.21.15.80:0/2593743443 >> 172.21.15.80:0/2593743443 conn(0x7fe00413d620 msgr2=0x7fe00413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:47.494 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:47.494 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":97,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:40:44.667093+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:37:01.482997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2019-11-28T11:37:02.223344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.76:0/1604329568":"2019-11-28T12:40:44.346703+0000","172.21.15.174:6835/775911718":"2019-11-29T11:37:21.497358+0000","172.21.15.174:6834/775911718":"2019-11-29T11:37:21.497358+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:40:47.507 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:37:01.482997+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 14, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'92', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:37:02.223344+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 15, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'93', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:40:47.507 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:40:47.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.598+0000 7f1ad7df0700 1 Processor -- start 2019-11-28T11:40:47.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.598+0000 7f1ad7df0700 1 -- start start 2019-11-28T11:40:47.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad7df0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1ad015ed10 0x7f1ad015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:47.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad7df0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1ad00734b0 0x7f1ad00726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:47.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad7df0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad006db60 con 0x7f1ad0073020 2019-11-28T11:40:47.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad7df0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad006fe00 con 0x7f1ad00734b0 2019-11-28T11:40:47.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad7df0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad00700d0 con 0x7f1ad015ed10 2019-11-28T11:40:47.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad6b8e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1ad00734b0 0x7f1ad00726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:47.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad5b8c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1ad0073020 0x7f1ad0071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37420/0 (socket says 172.21.15.80:37420) 2019-11-28T11:40:47.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad5b8c700 1 -- 172.21.15.80:0/550805537 learned_addr learned my addr 172.21.15.80:0/550805537 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:47.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad638d700 1 --2- 172.21.15.80:0/550805537 >> v2:172.21.15.174:3300/0 conn(0x7f1ad015ed10 0x7f1ad015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:47.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad538b700 1 -- 172.21.15.80:0/550805537 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898024197 0 0) 0x7f1ab80014d0 con 0x7f1ad0073020 2019-11-28T11:40:47.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad538b700 1 -- 172.21.15.80:0/550805537 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1abc002e80 con 0x7f1ad0073020 2019-11-28T11:40:47.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad6b8e700 1 -- 172.21.15.80:0/550805537 >> v2:172.21.15.174:3300/0 conn(0x7f1ad015ed10 msgr2=0x7f1ad015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:47.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad6b8e700 1 --2- 172.21.15.80:0/550805537 >> v2:172.21.15.174:3300/0 conn(0x7f1ad015ed10 0x7f1ad015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:47.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad6b8e700 1 -- 172.21.15.80:0/550805537 >> v1:172.21.15.80:6789/0 conn(0x7f1ad0073020 legacy=0x7f1ad0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad6b8e700 1 -- 172.21.15.80:0/550805537 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad0070760 con 0x7f1ad00734b0 2019-11-28T11:40:47.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad6b8e700 1 --2- 172.21.15.80:0/550805537 >> v2:172.21.15.80:3300/0 conn(0x7f1ad00734b0 0x7f1ad00726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1ac800af50 tx=0x7f1ac800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad6b8e700 1 --2- 172.21.15.80:0/550805537 >> v2:172.21.15.80:3300/0 conn(0x7f1ad00734b0 0x7f1ad00726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1ac800af50 tx=0x7f1ac800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad6b8e700 1 --2- 172.21.15.80:0/550805537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad00734b0 0x7f1ad00726a0 secure :-1 s=READY pgs=1343 cs=0 l=1 rx=0x7f1ac800af50 tx=0x7f1ac800b6e0).ready entity=mon.0 client_cookie=ff494c08cd1c6d99 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:47.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad6b8e700 1 --2- 172.21.15.80:0/550805537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad00734b0 0x7f1ad00726a0 secure :-1 s=THROTTLE_DONE pgs=1343 cs=0 l=1 rx=0x7f1ac800af50 tx=0x7f1ac800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad538b700 1 -- 172.21.15.80:0/550805537 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac8009ba0 con 0x7f1ad00734b0 2019-11-28T11:40:47.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad6b8e700 1 --2- 172.21.15.80:0/550805537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad00734b0 0x7f1ad00726a0 secure :-1 s=THROTTLE_DONE pgs=1343 cs=0 l=1 rx=0x7f1ac800af50 tx=0x7f1ac800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad6b8e700 1 --2- 172.21.15.80:0/550805537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad00734b0 0x7f1ad00726a0 secure :-1 s=THROTTLE_DONE pgs=1343 cs=0 l=1 rx=0x7f1ac800af50 tx=0x7f1ac800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad538b700 1 -- 172.21.15.80:0/550805537 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac80097c0 con 0x7f1ad00734b0 2019-11-28T11:40:47.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad538b700 1 -- 172.21.15.80:0/550805537 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac800a180 con 0x7f1ad00734b0 2019-11-28T11:40:47.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad7df0700 1 -- 172.21.15.80:0/550805537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad00734b0 msgr2=0x7f1ad00726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.600+0000 7f1ad7df0700 1 --2- 172.21.15.80:0/550805537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad00734b0 0x7f1ad00726a0 secure :-1 s=READY pgs=1343 cs=0 l=1 rx=0x7f1ac800af50 tx=0x7f1ac800b6e0).stop 2019-11-28T11:40:47.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.601+0000 7f1ad7df0700 1 -- 172.21.15.80:0/550805537 shutdown_connections 2019-11-28T11:40:47.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.601+0000 7f1ad7df0700 1 --2- 172.21.15.80:0/550805537 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad00734b0 0x7f1ad00726a0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.601+0000 7f1ad7df0700 1 --2- 172.21.15.80:0/550805537 >> v2:172.21.15.174:3300/0 conn(0x7f1ad015ed10 0x7f1ad015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:47.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.601+0000 7f1ad7df0700 1 -- 172.21.15.80:0/550805537 shutdown_connections 2019-11-28T11:40:47.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.601+0000 7f1ad7df0700 1 -- 172.21.15.80:0/550805537 wait complete. 2019-11-28T11:40:47.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.601+0000 7f1ad7df0700 1 -- 172.21.15.80:0/550805537 >> 172.21.15.80:0/550805537 conn(0x7f1ad0061d20 msgr2=0x7f1ad00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:47.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.604+0000 7f1ad7df0700 1 Processor -- start 2019-11-28T11:40:47.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.604+0000 7f1ad7df0700 1 -- start start 2019-11-28T11:40:47.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.604+0000 7f1ad7df0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ad010e970 0x7f1ad01087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:47.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.604+0000 7f1ad7df0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1ad0108cf0 0x7f1ad0107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:47.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.604+0000 7f1ad7df0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad010c250 con 0x7f1ad0107b70 2019-11-28T11:40:47.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.604+0000 7f1ad7df0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad010da00 con 0x7f1ad0108cf0 2019-11-28T11:40:47.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.604+0000 7f1ad7df0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad010e430 con 0x7f1ad010e970 2019-11-28T11:40:47.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad5b8c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1ad0108cf0 0x7f1ad0107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:47.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad6b8e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1ad0107b70 0x7f1ad010ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37430/0 (socket says 172.21.15.80:37430) 2019-11-28T11:40:47.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad6b8e700 1 -- 172.21.15.80:0/1445726338 learned_addr learned my addr 172.21.15.80:0/1445726338 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:47.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad5b8c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1ad0108cf0 0x7f1ad0107630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38112/0 (socket says 172.21.15.80:38112) 2019-11-28T11:40:47.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad638d700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ad010e970 0x7f1ad01087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:47.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1aceffd700 1 -- 172.21.15.80:0/1445726338 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970343529 0 0) 0x7f1ac8009580 con 0x7f1ad0107b70 2019-11-28T11:40:47.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1aceffd700 1 -- 172.21.15.80:0/1445726338 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab4002e80 con 0x7f1ad0107b70 2019-11-28T11:40:47.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad5b8c700 1 -- 172.21.15.80:0/1445726338 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ad010e970 msgr2=0x7f1ad01087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad5b8c700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ad010e970 0x7f1ad01087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad5b8c700 1 -- 172.21.15.80:0/1445726338 >> v1:172.21.15.80:6789/0 conn(0x7f1ad0107b70 legacy=0x7f1ad010ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad5b8c700 1 -- 172.21.15.80:0/1445726338 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad0105ef0 con 0x7f1ad0108cf0 2019-11-28T11:40:47.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad5b8c700 1 --2- 172.21.15.80:0/1445726338 >> v2:172.21.15.80:3300/0 conn(0x7f1ad0108cf0 0x7f1ad0107630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1ab8010700 tx=0x7f1ab8010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad5b8c700 1 --2- 172.21.15.80:0/1445726338 >> v2:172.21.15.80:3300/0 conn(0x7f1ad0108cf0 0x7f1ad0107630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1ab8010700 tx=0x7f1ab8010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad5b8c700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad0108cf0 0x7f1ad0107630 secure :-1 s=READY pgs=1345 cs=0 l=1 rx=0x7f1ab8010700 tx=0x7f1ab8010530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:47.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad5b8c700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad0108cf0 0x7f1ad0107630 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7f1ab8010700 tx=0x7f1ab8010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1aceffd700 1 -- 172.21.15.80:0/1445726338 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab800f4b0 con 0x7f1ad0108cf0 2019-11-28T11:40:47.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad5b8c700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad0108cf0 0x7f1ad0107630 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7f1ab8010700 tx=0x7f1ab8010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad5b8c700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad0108cf0 0x7f1ad0107630 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7f1ab8010700 tx=0x7f1ab8010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1aceffd700 1 -- 172.21.15.80:0/1445726338 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab800f0d0 con 0x7f1ad0108cf0 2019-11-28T11:40:47.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad7df0700 1 -- 172.21.15.80:0/1445726338 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad0106270 con 0x7f1ad0108cf0 2019-11-28T11:40:47.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1aceffd700 1 -- 172.21.15.80:0/1445726338 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab800fa90 con 0x7f1ad0108cf0 2019-11-28T11:40:47.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.605+0000 7f1ad7df0700 1 -- 172.21.15.80:0/1445726338 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad0105ef0 con 0x7f1ad0108cf0 2019-11-28T11:40:47.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.606+0000 7f1ad5b8c700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad0108cf0 0x7f1ad0107630 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7f1ab8010700 tx=0x7f1ab8010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.606+0000 7f1aceffd700 1 -- 172.21.15.80:0/1445726338 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1ab800f2c0 con 0x7f1ad0108cf0 2019-11-28T11:40:47.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.606+0000 7f1ad5b8c700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad0108cf0 0x7f1ad0107630 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7f1ab8010700 tx=0x7f1ab8010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.606+0000 7f1aceffd700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ab4018770 0x7f1ab401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:47.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.606+0000 7f1aceffd700 1 -- 172.21.15.80:0/1445726338 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f1ab8031d30 con 0x7f1ad0108cf0 2019-11-28T11:40:47.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.606+0000 7f1ad638d700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ab4018770 0x7f1ab401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.606+0000 7f1ad638d700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ab4018770 0x7f1ab401abe0 crc :-1 s=READY pgs=552 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.614+0000 7f1ad7df0700 1 -- 172.21.15.80:0/1445726338 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad0106270 con 0x7f1ad0108cf0 2019-11-28T11:40:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.617+0000 7f1ad5b8c700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad0108cf0 0x7f1ad0107630 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7f1ab8010700 tx=0x7f1ab8010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.617+0000 7f1aceffd700 1 -- 172.21.15.80:0/1445726338 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1ab800eec0 con 0x7f1ad0108cf0 2019-11-28T11:40:47.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.784+0000 7f1ad7df0700 1 -- 172.21.15.80:0/1445726338 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f1ad0105ef0 con 0x7f1ad0108cf0 2019-11-28T11:40:47.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.785+0000 7f1ad5b8c700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad0108cf0 0x7f1ad0107630 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7f1ab8010700 tx=0x7f1ab8010530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.785+0000 7f1aceffd700 1 -- 172.21.15.80:0/1445726338 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v97) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1ab800f2a0 con 0x7f1ad0108cf0 2019-11-28T11:40:47.817 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:40:47.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.787+0000 7f1ad7df0700 1 -- 172.21.15.80:0/1445726338 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ab4018770 msgr2=0x7f1ab401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.787+0000 7f1ad7df0700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ab4018770 0x7f1ab401abe0 crc :-1 s=READY pgs=552 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.787+0000 7f1ad7df0700 1 -- 172.21.15.80:0/1445726338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad0108cf0 msgr2=0x7f1ad0107630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.787+0000 7f1ad7df0700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad0108cf0 0x7f1ad0107630 secure :-1 s=READY pgs=1345 cs=0 l=1 rx=0x7f1ab8010700 tx=0x7f1ab8010530).stop 2019-11-28T11:40:47.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.787+0000 7f1ad7df0700 1 -- 172.21.15.80:0/1445726338 shutdown_connections 2019-11-28T11:40:47.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.787+0000 7f1ad7df0700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ab4018770 0x7f1ab401abe0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.787+0000 7f1ad7df0700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad0108cf0 0x7f1ad0107630 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.787+0000 7f1ad7df0700 1 --2- 172.21.15.80:0/1445726338 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ad010e970 0x7f1ad01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.788+0000 7f1ad7df0700 1 -- 172.21.15.80:0/1445726338 shutdown_connections 2019-11-28T11:40:47.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.788+0000 7f1ad7df0700 1 -- 172.21.15.80:0/1445726338 wait complete. 2019-11-28T11:40:47.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.788+0000 7f1ad7df0700 1 -- 172.21.15.80:0/1445726338 >> 172.21.15.80:0/1445726338 conn(0x7f1ad015e2d0 msgr2=0x7f1ad0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:47.829 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:40:47.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.920+0000 7ff17c94b700 1 Processor -- start 2019-11-28T11:40:47.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.920+0000 7ff17c94b700 1 -- start start 2019-11-28T11:40:47.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.921+0000 7ff17c94b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff17815f100 0x7ff17806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:47.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.921+0000 7ff17c94b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff17806c2f0 0x7ff17806c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:47.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.921+0000 7ff17c94b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17806db60 con 0x7ff17815ed10 2019-11-28T11:40:47.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.921+0000 7ff17c94b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17806fe00 con 0x7ff17815f100 2019-11-28T11:40:47.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.921+0000 7ff17c94b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1780700d0 con 0x7ff17806c2f0 2019-11-28T11:40:47.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.921+0000 7ff176d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff17815ed10 0x7ff178073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37434/0 (socket says 172.21.15.80:37434) 2019-11-28T11:40:47.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.921+0000 7ff176d9d700 1 -- 172.21.15.80:0/3308401504 learned_addr learned my addr 172.21.15.80:0/3308401504 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:47.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.921+0000 7ff17759e700 1 --2- 172.21.15.80:0/3308401504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff17806c2f0 0x7ff17806c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:47.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.921+0000 7ff17659c700 1 --2- 172.21.15.80:0/3308401504 >> v2:172.21.15.174:3300/0 conn(0x7ff17815f100 0x7ff17806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:47.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.921+0000 7ff175d9b700 1 -- 172.21.15.80:0/3308401504 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893435877 0 0) 0x7ff1680014d0 con 0x7ff17815ed10 2019-11-28T11:40:47.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.921+0000 7ff175d9b700 1 -- 172.21.15.80:0/3308401504 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff164002e80 con 0x7ff17815ed10 2019-11-28T11:40:47.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.921+0000 7ff17659c700 1 -- 172.21.15.80:0/3308401504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff17806c2f0 msgr2=0x7ff17806c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:47.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.921+0000 7ff17659c700 1 --2- 172.21.15.80:0/3308401504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff17806c2f0 0x7ff17806c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:47.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.922+0000 7ff17659c700 1 -- 172.21.15.80:0/3308401504 >> v1:172.21.15.80:6789/0 conn(0x7ff17815ed10 legacy=0x7ff178073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.922+0000 7ff175d9b700 1 -- 172.21.15.80:0/3308401504 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 442230711 0 0) 0x7ff1680014b0 con 0x7ff17815ed10 2019-11-28T11:40:47.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.922+0000 7ff17659c700 1 -- 172.21.15.80:0/3308401504 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff178070760 con 0x7ff17815f100 2019-11-28T11:40:47.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.922+0000 7ff17759e700 1 --2- 172.21.15.80:0/3308401504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff17806c2f0 0x7ff17806c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:40:47.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.922+0000 7ff17659c700 1 --2- 172.21.15.80:0/3308401504 >> v2:172.21.15.174:3300/0 conn(0x7ff17815f100 0x7ff17806bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff16000af50 tx=0x7ff16000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.922+0000 7ff17659c700 1 --2- 172.21.15.80:0/3308401504 >> v2:172.21.15.174:3300/0 conn(0x7ff17815f100 0x7ff17806bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff16000af50 tx=0x7ff16000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.922+0000 7ff17659c700 1 --2- 172.21.15.80:0/3308401504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff17815f100 0x7ff17806bdb0 secure :-1 s=READY pgs=789 cs=0 l=1 rx=0x7ff16000af50 tx=0x7ff16000b760).ready entity=mon.1 client_cookie=c7221c240445eb28 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:47.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.922+0000 7ff17659c700 1 --2- 172.21.15.80:0/3308401504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff17815f100 0x7ff17806bdb0 secure :-1 s=THROTTLE_DONE pgs=789 cs=0 l=1 rx=0x7ff16000af50 tx=0x7ff16000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.922+0000 7ff175d9b700 1 -- 172.21.15.80:0/3308401504 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff160007210 con 0x7ff17815f100 2019-11-28T11:40:47.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.922+0000 7ff17659c700 1 --2- 172.21.15.80:0/3308401504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff17815f100 0x7ff17806bdb0 secure :-1 s=THROTTLE_DONE pgs=789 cs=0 l=1 rx=0x7ff16000af50 tx=0x7ff16000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.922+0000 7ff17659c700 1 --2- 172.21.15.80:0/3308401504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff17815f100 0x7ff17806bdb0 secure :-1 s=THROTTLE_DONE pgs=789 cs=0 l=1 rx=0x7ff16000af50 tx=0x7ff16000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.922+0000 7ff175d9b700 1 -- 172.21.15.80:0/3308401504 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1600099b0 con 0x7ff17815f100 2019-11-28T11:40:47.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.922+0000 7ff175d9b700 1 -- 172.21.15.80:0/3308401504 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff16000a080 con 0x7ff17815f100 2019-11-28T11:40:47.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.922+0000 7ff17c94b700 1 -- 172.21.15.80:0/3308401504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff17815f100 msgr2=0x7ff17806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.922+0000 7ff17c94b700 1 --2- 172.21.15.80:0/3308401504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff17815f100 0x7ff17806bdb0 secure :-1 s=READY pgs=789 cs=0 l=1 rx=0x7ff16000af50 tx=0x7ff16000b760).stop 2019-11-28T11:40:47.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.923+0000 7ff17c94b700 1 -- 172.21.15.80:0/3308401504 shutdown_connections 2019-11-28T11:40:47.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.923+0000 7ff17c94b700 1 --2- 172.21.15.80:0/3308401504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff17806c2f0 0x7ff17806c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:47.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.923+0000 7ff17c94b700 1 --2- 172.21.15.80:0/3308401504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff17815f100 0x7ff17806bdb0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:47.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.923+0000 7ff17c94b700 1 -- 172.21.15.80:0/3308401504 shutdown_connections 2019-11-28T11:40:47.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.923+0000 7ff17c94b700 1 -- 172.21.15.80:0/3308401504 wait complete. 2019-11-28T11:40:47.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.923+0000 7ff17c94b700 1 -- 172.21.15.80:0/3308401504 >> 172.21.15.80:0/3308401504 conn(0x7ff178061d20 msgr2=0x7ff1780641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:47.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.925+0000 7ff17c94b700 1 Processor -- start 2019-11-28T11:40:47.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.926+0000 7ff17c94b700 1 -- start start 2019-11-28T11:40:47.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.926+0000 7ff17c94b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff178148320 0x7ff17810ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:47.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.926+0000 7ff17c94b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff178148e00 con 0x7ff17810e3d0 2019-11-28T11:40:47.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.926+0000 7ff17c94b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff178108b10 con 0x7ff17810f290 2019-11-28T11:40:47.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.926+0000 7ff17c94b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff178139ff0 con 0x7ff178148320 2019-11-28T11:40:47.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.926+0000 7ff17759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff17810e3d0 0x7ff178168d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37442/0 (socket says 172.21.15.80:37442) 2019-11-28T11:40:47.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.926+0000 7ff17759e700 1 -- 172.21.15.80:0/2868200496 learned_addr learned my addr 172.21.15.80:0/2868200496 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:47.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff176d9d700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff178148320 0x7ff17810ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:47.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff16f7fe700 1 -- 172.21.15.80:0/2868200496 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577296414 0 0) 0x7ff170009890 con 0x7ff17810e3d0 2019-11-28T11:40:47.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff16f7fe700 1 -- 172.21.15.80:0/2868200496 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff15c002e80 con 0x7ff17810e3d0 2019-11-28T11:40:47.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff16f7fe700 1 -- 172.21.15.80:0/2868200496 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826850197 0 0) 0x7ff16000adc0 con 0x7ff17810f290 2019-11-28T11:40:47.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff16f7fe700 1 -- 172.21.15.80:0/2868200496 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff15c0030b0 con 0x7ff17810f290 2019-11-28T11:40:47.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff176d9d700 1 -- 172.21.15.80:0/2868200496 >> v1:172.21.15.174:6789/0 conn(0x7ff17810f290 legacy=0x7ff17810dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff176d9d700 1 -- 172.21.15.80:0/2868200496 >> v1:172.21.15.80:6789/0 conn(0x7ff17810e3d0 legacy=0x7ff178168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:47.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff176d9d700 1 -- 172.21.15.80:0/2868200496 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17810c490 con 0x7ff178148320 2019-11-28T11:40:47.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff176d9d700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff178148320 0x7ff17810ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff168010720 tx=0x7ff168010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff176d9d700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff178148320 0x7ff17810ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff168010720 tx=0x7ff168010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff176d9d700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff178148320 0x7ff17810ed50 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7ff168010720 tx=0x7ff168010ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:47.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff176d9d700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff178148320 0x7ff17810ed50 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7ff168010720 tx=0x7ff168010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff16f7fe700 1 -- 172.21.15.80:0/2868200496 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff168001100 con 0x7ff178148320 2019-11-28T11:40:47.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff176d9d700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff178148320 0x7ff17810ed50 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7ff168010720 tx=0x7ff168010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff16f7fe700 1 -- 172.21.15.80:0/2868200496 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff168001700 con 0x7ff178148320 2019-11-28T11:40:47.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff176d9d700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff178148320 0x7ff17810ed50 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7ff168010720 tx=0x7ff168010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff17c94b700 1 -- 172.21.15.80:0/2868200496 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff17810c810 con 0x7ff178148320 2019-11-28T11:40:47.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff16f7fe700 1 -- 172.21.15.80:0/2868200496 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1680018f0 con 0x7ff178148320 2019-11-28T11:40:47.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.927+0000 7ff17c94b700 1 -- 172.21.15.80:0/2868200496 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17810c490 con 0x7ff178148320 2019-11-28T11:40:47.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.928+0000 7ff176d9d700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff178148320 0x7ff17810ed50 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7ff168010720 tx=0x7ff168010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.928+0000 7ff16f7fe700 1 -- 172.21.15.80:0/2868200496 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff1680018f0 con 0x7ff178148320 2019-11-28T11:40:47.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.928+0000 7ff176d9d700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff178148320 0x7ff17810ed50 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7ff168010720 tx=0x7ff168010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.928+0000 7ff16f7fe700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff15c018750 0x7ff15c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:47.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.928+0000 7ff16f7fe700 1 -- 172.21.15.80:0/2868200496 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6149+0+0 (secure 0 0 0) 0x7ff168031df0 con 0x7ff178148320 2019-11-28T11:40:47.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.928+0000 7ff17659c700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff15c018750 0x7ff15c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:47.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.928+0000 7ff17659c700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff15c018750 0x7ff15c01abe0 crc :-1 s=READY pgs=553 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:47.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.935+0000 7ff17c94b700 1 -- 172.21.15.80:0/2868200496 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17810c810 con 0x7ff178148320 2019-11-28T11:40:47.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.939+0000 7ff176d9d700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff178148320 0x7ff17810ed50 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7ff168010720 tx=0x7ff168010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:47.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:47.939+0000 7ff16f7fe700 1 -- 172.21.15.80:0/2868200496 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff16802cef0 con 0x7ff178148320 2019-11-28T11:40:48.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.104+0000 7ff17c94b700 1 -- 172.21.15.80:0/2868200496 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7ff17810c490 con 0x7ff178148320 2019-11-28T11:40:48.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.104+0000 7ff176d9d700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff178148320 0x7ff17810ed50 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7ff168010720 tx=0x7ff168010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.104+0000 7ff16f7fe700 1 -- 172.21.15.80:0/2868200496 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v97) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff16802cef0 con 0x7ff178148320 2019-11-28T11:40:48.137 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:40:48.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.107+0000 7ff17c94b700 1 -- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff15c018750 msgr2=0x7ff15c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:48.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.107+0000 7ff17c94b700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff15c018750 0x7ff15c01abe0 crc :-1 s=READY pgs=553 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:48.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.107+0000 7ff17c94b700 1 -- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff178148320 msgr2=0x7ff17810ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:48.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.107+0000 7ff17c94b700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff178148320 0x7ff17810ed50 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7ff168010720 tx=0x7ff168010ac0).stop 2019-11-28T11:40:48.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.107+0000 7ff17c94b700 1 -- 172.21.15.80:0/2868200496 shutdown_connections 2019-11-28T11:40:48.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.107+0000 7ff17c94b700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff15c018750 0x7ff15c01abe0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:48.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.107+0000 7ff17c94b700 1 --2- 172.21.15.80:0/2868200496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff178148320 0x7ff17810ed50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:48.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.107+0000 7ff17c94b700 1 -- 172.21.15.80:0/2868200496 shutdown_connections 2019-11-28T11:40:48.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.107+0000 7ff17c94b700 1 -- 172.21.15.80:0/2868200496 wait complete. 2019-11-28T11:40:48.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.107+0000 7ff17c94b700 1 -- 172.21.15.80:0/2868200496 >> 172.21.15.80:0/2868200496 conn(0x7ff17815e2d0 msgr2=0x7ff178147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:48.148 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:40:48.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.240+0000 7f548abf4700 1 Processor -- start 2019-11-28T11:40:48.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.240+0000 7f548abf4700 1 -- start start 2019-11-28T11:40:48.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.241+0000 7f548abf4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f548415ed10 0x7f548415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:48.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.241+0000 7f548abf4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5484073020 0x7f5484071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:48.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.241+0000 7f548abf4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54840734b0 0x7f54840723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:48.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.241+0000 7f548abf4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548406fe00 con 0x7f5484073020 2019-11-28T11:40:48.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.241+0000 7f548abf4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54840700d0 con 0x7f548415ed10 2019-11-28T11:40:48.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.241+0000 7f548abf4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548406f3d0 con 0x7f54840734b0 2019-11-28T11:40:48.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.241+0000 7f5488990700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5484073020 0x7f5484071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:48.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.241+0000 7f5488990700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5484073020 0x7f5484071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38132/0 (socket says 172.21.15.80:38132) 2019-11-28T11:40:48.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.241+0000 7f5488990700 1 -- 172.21.15.80:0/3658146447 learned_addr learned my addr 172.21.15.80:0/3658146447 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:48.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f5488990700 1 -- 172.21.15.80:0/3658146447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54840734b0 msgr2=0x7f54840723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:48.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f5489992700 1 --2- 172.21.15.80:0/3658146447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54840734b0 0x7f54840723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:48.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f5488990700 1 --2- 172.21.15.80:0/3658146447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54840734b0 0x7f54840723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:48.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f5488990700 1 -- 172.21.15.80:0/3658146447 >> v2:172.21.15.174:3300/0 conn(0x7f548415ed10 msgr2=0x7f548415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:48.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f5489191700 1 --2- 172.21.15.80:0/3658146447 >> v2:172.21.15.174:3300/0 conn(0x7f548415ed10 0x7f548415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:48.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f5488990700 1 --2- 172.21.15.80:0/3658146447 >> v2:172.21.15.174:3300/0 conn(0x7f548415ed10 0x7f548415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:48.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f5488990700 1 -- 172.21.15.80:0/3658146447 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5484070760 con 0x7f5484073020 2019-11-28T11:40:48.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f5488990700 1 --2- 172.21.15.80:0/3658146447 >> v2:172.21.15.80:3300/0 conn(0x7f5484073020 0x7f5484071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f547800f6c0 tx=0x7f547800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f5488990700 1 --2- 172.21.15.80:0/3658146447 >> v2:172.21.15.80:3300/0 conn(0x7f5484073020 0x7f5484071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f547800f6c0 tx=0x7f547800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f5488990700 1 --2- 172.21.15.80:0/3658146447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484073020 0x7f5484071ea0 secure :-1 s=READY pgs=1348 cs=0 l=1 rx=0x7f547800f6c0 tx=0x7f547800f570).ready entity=mon.0 client_cookie=c0da012ccda172ab server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:48.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f5488990700 1 --2- 172.21.15.80:0/3658146447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484073020 0x7f5484071ea0 secure :-1 s=THROTTLE_DONE pgs=1348 cs=0 l=1 rx=0x7f547800f6c0 tx=0x7f547800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f5488990700 1 --2- 172.21.15.80:0/3658146447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484073020 0x7f5484071ea0 secure :-1 s=THROTTLE_DONE pgs=1348 cs=0 l=1 rx=0x7f547800f6c0 tx=0x7f547800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f5483fff700 1 -- 172.21.15.80:0/3658146447 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5478000960 con 0x7f5484073020 2019-11-28T11:40:48.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f5488990700 1 --2- 172.21.15.80:0/3658146447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484073020 0x7f5484071ea0 secure :-1 s=THROTTLE_DONE pgs=1348 cs=0 l=1 rx=0x7f547800f6c0 tx=0x7f547800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f5483fff700 1 -- 172.21.15.80:0/3658146447 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5478000c90 con 0x7f5484073020 2019-11-28T11:40:48.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f5483fff700 1 -- 172.21.15.80:0/3658146447 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54780013a0 con 0x7f5484073020 2019-11-28T11:40:48.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f548abf4700 1 -- 172.21.15.80:0/3658146447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484073020 msgr2=0x7f5484071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:48.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.242+0000 7f548abf4700 1 --2- 172.21.15.80:0/3658146447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484073020 0x7f5484071ea0 secure :-1 s=READY pgs=1348 cs=0 l=1 rx=0x7f547800f6c0 tx=0x7f547800f570).stop 2019-11-28T11:40:48.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.243+0000 7f548abf4700 1 -- 172.21.15.80:0/3658146447 shutdown_connections 2019-11-28T11:40:48.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.243+0000 7f548abf4700 1 --2- 172.21.15.80:0/3658146447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54840734b0 0x7f54840723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:48.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.243+0000 7f548abf4700 1 --2- 172.21.15.80:0/3658146447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484073020 0x7f5484071ea0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:48.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.243+0000 7f548abf4700 1 --2- 172.21.15.80:0/3658146447 >> v2:172.21.15.174:3300/0 conn(0x7f548415ed10 0x7f548415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:48.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.243+0000 7f548abf4700 1 -- 172.21.15.80:0/3658146447 shutdown_connections 2019-11-28T11:40:48.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.243+0000 7f548abf4700 1 -- 172.21.15.80:0/3658146447 wait complete. 2019-11-28T11:40:48.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.243+0000 7f548abf4700 1 -- 172.21.15.80:0/3658146447 >> 172.21.15.80:0/3658146447 conn(0x7f5484061d20 msgr2=0x7f54840641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:48.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.245+0000 7f548abf4700 1 Processor -- start 2019-11-28T11:40:48.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.245+0000 7f548abf4700 1 -- start start 2019-11-28T11:40:48.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.246+0000 7f548abf4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5484167d80 0x7f548416a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:48.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.246+0000 7f548abf4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5484148e00 con 0x7f54841079b0 2019-11-28T11:40:48.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.246+0000 7f548abf4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5484108b10 con 0x7f5484148320 2019-11-28T11:40:48.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.246+0000 7f548abf4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548413aa20 con 0x7f5484167d80 2019-11-28T11:40:48.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.246+0000 7f5489992700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5484167d80 0x7f548416a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:48.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.246+0000 7f5489992700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5484167d80 0x7f548416a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38140/0 (socket says 172.21.15.80:38140) 2019-11-28T11:40:48.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.246+0000 7f5488990700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f54841079b0 0x7f5484107e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37456/0 (socket says 172.21.15.80:37456) 2019-11-28T11:40:48.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.246+0000 7f5489992700 1 -- 172.21.15.80:0/2600259961 learned_addr learned my addr 172.21.15.80:0/2600259961 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:48.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.247+0000 7f5489992700 1 -- 172.21.15.80:0/2600259961 >> v1:172.21.15.174:6789/0 conn(0x7f5484148320 legacy=0x7f548410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:48.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.247+0000 7f5489992700 1 -- 172.21.15.80:0/2600259961 >> v1:172.21.15.80:6789/0 conn(0x7f54841079b0 legacy=0x7f5484107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:48.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.247+0000 7f5489992700 1 -- 172.21.15.80:0/2600259961 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548410c490 con 0x7f5484167d80 2019-11-28T11:40:48.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.247+0000 7f5481ffb700 1 -- 172.21.15.80:0/2600259961 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520452722 0 0) 0x7f5478000940 con 0x7f54841079b0 2019-11-28T11:40:48.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.247+0000 7f5489992700 1 --2- 172.21.15.80:0/2600259961 >> v2:172.21.15.80:3300/0 conn(0x7f5484167d80 0x7f548416a180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5474010460 tx=0x7f5474010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.247+0000 7f5489992700 1 --2- 172.21.15.80:0/2600259961 >> v2:172.21.15.80:3300/0 conn(0x7f5484167d80 0x7f548416a180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5474010460 tx=0x7f5474010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.247+0000 7f5489992700 1 --2- 172.21.15.80:0/2600259961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484167d80 0x7f548416a180 secure :-1 s=READY pgs=1350 cs=0 l=1 rx=0x7f5474010460 tx=0x7f5474010800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:48.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.247+0000 7f5489992700 1 --2- 172.21.15.80:0/2600259961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484167d80 0x7f548416a180 secure :-1 s=THROTTLE_DONE pgs=1350 cs=0 l=1 rx=0x7f5474010460 tx=0x7f5474010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.247+0000 7f5481ffb700 1 -- 172.21.15.80:0/2600259961 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5474007330 con 0x7f5484167d80 2019-11-28T11:40:48.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.247+0000 7f5489992700 1 --2- 172.21.15.80:0/2600259961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484167d80 0x7f548416a180 secure :-1 s=THROTTLE_DONE pgs=1350 cs=0 l=1 rx=0x7f5474010460 tx=0x7f5474010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.247+0000 7f548abf4700 1 -- 172.21.15.80:0/2600259961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548410c810 con 0x7f5484167d80 2019-11-28T11:40:48.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.247+0000 7f5481ffb700 1 -- 172.21.15.80:0/2600259961 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5474007330 con 0x7f5484167d80 2019-11-28T11:40:48.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.247+0000 7f5489992700 1 --2- 172.21.15.80:0/2600259961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484167d80 0x7f548416a180 secure :-1 s=THROTTLE_DONE pgs=1350 cs=0 l=1 rx=0x7f5474010460 tx=0x7f5474010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.247+0000 7f5481ffb700 1 -- 172.21.15.80:0/2600259961 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5474001550 con 0x7f5484167d80 2019-11-28T11:40:48.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.247+0000 7f548abf4700 1 -- 172.21.15.80:0/2600259961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548410c490 con 0x7f5484167d80 2019-11-28T11:40:48.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.247+0000 7f5489992700 1 --2- 172.21.15.80:0/2600259961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484167d80 0x7f548416a180 secure :-1 s=THROTTLE_DONE pgs=1350 cs=0 l=1 rx=0x7f5474010460 tx=0x7f5474010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.248+0000 7f5481ffb700 1 -- 172.21.15.80:0/2600259961 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5474001170 con 0x7f5484167d80 2019-11-28T11:40:48.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.248+0000 7f5489992700 1 --2- 172.21.15.80:0/2600259961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484167d80 0x7f548416a180 secure :-1 s=THROTTLE_DONE pgs=1350 cs=0 l=1 rx=0x7f5474010460 tx=0x7f5474010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.248+0000 7f5481ffb700 1 --2- 172.21.15.80:0/2600259961 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5464018730 0x7f546401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:48.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.248+0000 7f5481ffb700 1 -- 172.21.15.80:0/2600259961 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f5474031d70 con 0x7f5484167d80 2019-11-28T11:40:48.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.248+0000 7f5489191700 1 --2- 172.21.15.80:0/2600259961 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5464018730 0x7f546401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:48.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.248+0000 7f5489191700 1 --2- 172.21.15.80:0/2600259961 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5464018730 0x7f546401abc0 crc :-1 s=READY pgs=554 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:48.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.255+0000 7f548abf4700 1 -- 172.21.15.80:0/2600259961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548410c810 con 0x7f5484167d80 2019-11-28T11:40:48.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.259+0000 7f5489992700 1 --2- 172.21.15.80:0/2600259961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484167d80 0x7f548416a180 secure :-1 s=THROTTLE_DONE pgs=1350 cs=0 l=1 rx=0x7f5474010460 tx=0x7f5474010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.259+0000 7f5481ffb700 1 -- 172.21.15.80:0/2600259961 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5474000e70 con 0x7f5484167d80 2019-11-28T11:40:48.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.426+0000 7f548abf4700 1 -- 172.21.15.80:0/2600259961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f548410c490 con 0x7f5484167d80 2019-11-28T11:40:48.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.426+0000 7f5489992700 1 --2- 172.21.15.80:0/2600259961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484167d80 0x7f548416a180 secure :-1 s=THROTTLE_DONE pgs=1350 cs=0 l=1 rx=0x7f5474010460 tx=0x7f5474010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.427+0000 7f5481ffb700 1 -- 172.21.15.80:0/2600259961 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v97) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5474001080 con 0x7f5484167d80 2019-11-28T11:40:48.460 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:40:48.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.429+0000 7f548abf4700 1 -- 172.21.15.80:0/2600259961 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5464018730 msgr2=0x7f546401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:48.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.429+0000 7f548abf4700 1 --2- 172.21.15.80:0/2600259961 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5464018730 0x7f546401abc0 crc :-1 s=READY pgs=554 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:48.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.429+0000 7f548abf4700 1 -- 172.21.15.80:0/2600259961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484167d80 msgr2=0x7f548416a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:48.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.429+0000 7f548abf4700 1 --2- 172.21.15.80:0/2600259961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484167d80 0x7f548416a180 secure :-1 s=READY pgs=1350 cs=0 l=1 rx=0x7f5474010460 tx=0x7f5474010800).stop 2019-11-28T11:40:48.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.429+0000 7f548abf4700 1 -- 172.21.15.80:0/2600259961 shutdown_connections 2019-11-28T11:40:48.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.429+0000 7f548abf4700 1 --2- 172.21.15.80:0/2600259961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5484167d80 0x7f548416a180 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:48.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.429+0000 7f548abf4700 1 --2- 172.21.15.80:0/2600259961 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5464018730 0x7f546401abc0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:48.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.429+0000 7f548abf4700 1 -- 172.21.15.80:0/2600259961 shutdown_connections 2019-11-28T11:40:48.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.429+0000 7f548abf4700 1 -- 172.21.15.80:0/2600259961 wait complete. 2019-11-28T11:40:48.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.429+0000 7f548abf4700 1 -- 172.21.15.80:0/2600259961 >> 172.21.15.80:0/2600259961 conn(0x7f548415e2d0 msgr2=0x7f5484147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:48.475 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:40:48.476 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:48.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.570+0000 7fd1157ae700 1 Processor -- start 2019-11-28T11:40:48.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.570+0000 7fd1157ae700 1 -- start start 2019-11-28T11:40:48.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.571+0000 7fd1157ae700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd11006c0a0 0x7fd110072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:48.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.571+0000 7fd1157ae700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100734e0 0x7fd110071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:48.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.571+0000 7fd1157ae700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11006db00 con 0x7fd110072360 2019-11-28T11:40:48.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.571+0000 7fd1157ae700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd11006fd60 con 0x7fd11006c0a0 2019-11-28T11:40:48.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.571+0000 7fd1157ae700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd110070030 con 0x7fd1100734e0 2019-11-28T11:40:48.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10effd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100734e0 0x7fd110071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:48.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10f7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd11006c0a0 0x7fd110072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:48.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10effd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100734e0 0x7fd110071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:40410/0 (socket says 172.21.15.80:40410) 2019-11-28T11:40:48.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10effd700 1 -- 172.21.15.80:0/98870124 learned_addr learned my addr 172.21.15.80:0/98870124 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:48.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10effd700 1 -- 172.21.15.80:0/98870124 >> v2:172.21.15.174:3300/0 conn(0x7fd11006c0a0 msgr2=0x7fd110072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:48.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10effd700 1 --2- 172.21.15.80:0/98870124 >> v2:172.21.15.174:3300/0 conn(0x7fd11006c0a0 0x7fd110072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:48.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10effd700 1 -- 172.21.15.80:0/98870124 >> v1:172.21.15.174:6789/0 conn(0x7fd110072360 legacy=0x7fd11006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:48.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10effd700 1 -- 172.21.15.80:0/98870124 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1100706c0 con 0x7fd1100734e0 2019-11-28T11:40:48.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10effd700 1 --2- 172.21.15.80:0/98870124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100734e0 0x7fd110071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd10000fac0 tx=0x7fd10000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10effd700 1 --2- 172.21.15.80:0/98870124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100734e0 0x7fd110071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd10000fac0 tx=0x7fd10000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10effd700 1 --2- 172.21.15.80:0/98870124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100734e0 0x7fd110071e20 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7fd10000fac0 tx=0x7fd10000f8f0).ready entity=mon.2 client_cookie=a1ad5f58f3ea8c1c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:48.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10effd700 1 --2- 172.21.15.80:0/98870124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100734e0 0x7fd110071e20 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fd10000fac0 tx=0x7fd10000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10effd700 1 --2- 172.21.15.80:0/98870124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100734e0 0x7fd110071e20 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fd10000fac0 tx=0x7fd10000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10e7fc700 1 -- 172.21.15.80:0/98870124 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd100000ce0 con 0x7fd1100734e0 2019-11-28T11:40:48.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10effd700 1 --2- 172.21.15.80:0/98870124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100734e0 0x7fd110071e20 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fd10000fac0 tx=0x7fd10000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10e7fc700 1 -- 172.21.15.80:0/98870124 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd100001010 con 0x7fd1100734e0 2019-11-28T11:40:48.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd10e7fc700 1 -- 172.21.15.80:0/98870124 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd100001720 con 0x7fd1100734e0 2019-11-28T11:40:48.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd1157ae700 1 -- 172.21.15.80:0/98870124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100734e0 msgr2=0x7fd110071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:48.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.572+0000 7fd1157ae700 1 --2- 172.21.15.80:0/98870124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100734e0 0x7fd110071e20 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7fd10000fac0 tx=0x7fd10000f8f0).stop 2019-11-28T11:40:48.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.573+0000 7fd1157ae700 1 -- 172.21.15.80:0/98870124 shutdown_connections 2019-11-28T11:40:48.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.573+0000 7fd1157ae700 1 --2- 172.21.15.80:0/98870124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1100734e0 0x7fd110071e20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:48.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.573+0000 7fd1157ae700 1 --2- 172.21.15.80:0/98870124 >> v2:172.21.15.174:3300/0 conn(0x7fd11006c0a0 0x7fd110072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:48.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.573+0000 7fd1157ae700 1 -- 172.21.15.80:0/98870124 shutdown_connections 2019-11-28T11:40:48.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.573+0000 7fd1157ae700 1 -- 172.21.15.80:0/98870124 wait complete. 2019-11-28T11:40:48.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.573+0000 7fd1157ae700 1 -- 172.21.15.80:0/98870124 >> 172.21.15.80:0/98870124 conn(0x7fd110061cf0 msgr2=0x7fd110064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:48.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.575+0000 7fd1157ae700 1 Processor -- start 2019-11-28T11:40:48.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.576+0000 7fd1157ae700 1 -- start start 2019-11-28T11:40:48.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd1157ae700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd11013eb40 0x7fd11010afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:48.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd1157ae700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd11010b500 0x7fd1101629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:48.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd1157ae700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11013f1e0 con 0x7fd110162f30 2019-11-28T11:40:48.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd1157ae700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1101234c0 con 0x7fd11013eb40 2019-11-28T11:40:48.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd1157ae700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11013e0d0 con 0x7fd11010b500 2019-11-28T11:40:48.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd10f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd11013eb40 0x7fd11010afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:48.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd10f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd11013eb40 0x7fd11010afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38152/0 (socket says 172.21.15.80:38152) 2019-11-28T11:40:48.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd10f7fe700 1 -- 172.21.15.80:0/3217802895 learned_addr learned my addr 172.21.15.80:0/3217802895 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:48.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd10effd700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd11010b500 0x7fd1101629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:48.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd10f7fe700 1 -- 172.21.15.80:0/3217802895 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd11010b500 msgr2=0x7fd1101629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:48.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd10f7fe700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd11010b500 0x7fd1101629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:48.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd10f7fe700 1 -- 172.21.15.80:0/3217802895 >> v1:172.21.15.174:6789/0 conn(0x7fd110162f30 legacy=0x7fd110109e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:48.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd10f7fe700 1 -- 172.21.15.80:0/3217802895 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd110108700 con 0x7fd11013eb40 2019-11-28T11:40:48.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd10f7fe700 1 --2- 172.21.15.80:0/3217802895 >> v2:172.21.15.80:3300/0 conn(0x7fd11013eb40 0x7fd11010afc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0f8010450 tx=0x7fd0f8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd10f7fe700 1 --2- 172.21.15.80:0/3217802895 >> v2:172.21.15.80:3300/0 conn(0x7fd11013eb40 0x7fd11010afc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0f8010450 tx=0x7fd0f8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd10f7fe700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd11013eb40 0x7fd11010afc0 secure :-1 s=READY pgs=1351 cs=0 l=1 rx=0x7fd0f8010450 tx=0x7fd0f8010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:48.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd10f7fe700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd11013eb40 0x7fd11010afc0 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7fd0f8010450 tx=0x7fd0f8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd107fff700 1 -- 172.21.15.80:0/3217802895 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0f8000940 con 0x7fd11013eb40 2019-11-28T11:40:48.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd10f7fe700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd11013eb40 0x7fd11010afc0 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7fd0f8010450 tx=0x7fd0f8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd107fff700 1 -- 172.21.15.80:0/3217802895 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f8000e80 con 0x7fd11013eb40 2019-11-28T11:40:48.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd10f7fe700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd11013eb40 0x7fd11010afc0 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7fd0f8010450 tx=0x7fd0f8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd107fff700 1 -- 172.21.15.80:0/3217802895 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0f8001070 con 0x7fd11013eb40 2019-11-28T11:40:48.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd1157ae700 1 -- 172.21.15.80:0/3217802895 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd110108a80 con 0x7fd11013eb40 2019-11-28T11:40:48.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.577+0000 7fd1157ae700 1 -- 172.21.15.80:0/3217802895 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd110108700 con 0x7fd11013eb40 2019-11-28T11:40:48.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.578+0000 7fd10f7fe700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd11013eb40 0x7fd11010afc0 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7fd0f8010450 tx=0x7fd0f8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.578+0000 7fd107fff700 1 -- 172.21.15.80:0/3217802895 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd0f8001070 con 0x7fd11013eb40 2019-11-28T11:40:48.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.578+0000 7fd10f7fe700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd11013eb40 0x7fd11010afc0 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7fd0f8010450 tx=0x7fd0f8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.578+0000 7fd107fff700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd0e8018730 0x7fd0e801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:48.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.578+0000 7fd107fff700 1 -- 172.21.15.80:0/3217802895 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fd0f8031ab0 con 0x7fd11013eb40 2019-11-28T11:40:48.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.578+0000 7fd10effd700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd0e8018730 0x7fd0e801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:48.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.578+0000 7fd10effd700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd0e8018730 0x7fd0e801abc0 crc :-1 s=READY pgs=555 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:48.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.585+0000 7fd1157ae700 1 -- 172.21.15.80:0/3217802895 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd110108a80 con 0x7fd11013eb40 2019-11-28T11:40:48.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.589+0000 7fd10f7fe700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd11013eb40 0x7fd11010afc0 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7fd0f8010450 tx=0x7fd0f8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.589+0000 7fd107fff700 1 -- 172.21.15.80:0/3217802895 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd0f8009250 con 0x7fd11013eb40 2019-11-28T11:40:48.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.764+0000 7fd1157ae700 1 -- 172.21.15.80:0/3217802895 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd110108700 con 0x7fd11013eb40 2019-11-28T11:40:48.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.764+0000 7fd10f7fe700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd11013eb40 0x7fd11010afc0 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7fd0f8010450 tx=0x7fd0f8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:48.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.764+0000 7fd107fff700 1 -- 172.21.15.80:0/3217802895 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2447 (secure 0 0 0) 0x7fd0f8001070 con 0x7fd11013eb40 2019-11-28T11:40:48.797 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 67 2019-11-28T11:40:48.797 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:48.798 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/117741785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":117741785},{"type":"v1","addr":"172.21.15.174:6835","nonce":117741785}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65},{"gid":5855,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3446984338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3446984338},{"type":"v1","addr":"172.21.15.80:6835","nonce":3446984338}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":65}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:40:46.673273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7261":{"gid":7261,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":16,"addr":"172.21.15.80:6833/2279612482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2279612482},{"type":"v1","addr":"172.21.15.80:6833","nonce":2279612482}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:48.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.767+0000 7fd1157ae700 1 -- 172.21.15.80:0/3217802895 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd0e8018730 msgr2=0x7fd0e801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:48.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.767+0000 7fd1157ae700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd0e8018730 0x7fd0e801abc0 crc :-1 s=READY pgs=555 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:48.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.767+0000 7fd1157ae700 1 -- 172.21.15.80:0/3217802895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd11013eb40 msgr2=0x7fd11010afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:48.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.767+0000 7fd1157ae700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd11013eb40 0x7fd11010afc0 secure :-1 s=READY pgs=1351 cs=0 l=1 rx=0x7fd0f8010450 tx=0x7fd0f8010280).stop 2019-11-28T11:40:48.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.767+0000 7fd1157ae700 1 -- 172.21.15.80:0/3217802895 shutdown_connections 2019-11-28T11:40:48.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.767+0000 7fd1157ae700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd0e8018730 0x7fd0e801abc0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:48.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.767+0000 7fd1157ae700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd11010b500 0x7fd1101629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:48.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.767+0000 7fd1157ae700 1 --2- 172.21.15.80:0/3217802895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd11013eb40 0x7fd11010afc0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:48.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.767+0000 7fd1157ae700 1 -- 172.21.15.80:0/3217802895 shutdown_connections 2019-11-28T11:40:48.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.767+0000 7fd1157ae700 1 -- 172.21.15.80:0/3217802895 wait complete. 2019-11-28T11:40:48.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:48.767+0000 7fd1157ae700 1 -- 172.21.15.80:0/3217802895 >> 172.21.15.80:0/3217802895 conn(0x7fd11011bfc0 msgr2=0x7fd110141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:49.113 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7261}, u'last_failure_osd_epoch': 95, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 14, u'failed': [], u'epoch': 67, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [15], u'info': {u'gid_7261': {u'export_targets': [], u'name': u'b', u'incarnation': 63, u'state_seq': 16, u'state': u'up:active', u'gid': 7261, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2279612482, u'type': u'v2', u'addr': u'172.21.15.80:6832'}, {u'nonce': 2279612482, u'type': u'v1', u'addr': u'172.21.15.80:6833'}]}, u'addr': u'172.21.15.80:6833/2279612482'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:37:03.205339+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:40:46.673273+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:40:49.114 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:40:49.114 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-11-28T11:40:49.241 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:40:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:40:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T11:40:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 7261, 2019-11-28T11:40:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2019-11-28T11:40:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2019-11-28T11:40:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 53.928348663999998, 2019-11-28T11:40:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 67, 2019-11-28T11:40:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 97, 2019-11-28T11:40:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 97, 2019-11-28T11:40:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 54.866332597000003 2019-11-28T11:40:49.469 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:40:49.470 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7261, "want_state": "up:active", "state": "up:active", "rank_uptime": 53.928348663999998, "mdsmap_epoch": 67, "osdmap_epoch": 97, "osdmap_epoch_barrier": 97, "uptime": 54.866332597000003 } 2019-11-28T11:40:49.470 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:40:49.470 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:40:49.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:40:49.471 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:40:49.549 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:40:49.550 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:40:49.671 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:40:49.671 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:40:49.672 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:40:49.672 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:40:49.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:40:49.673 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:40:49.745 INFO:teuthology.orchestra.run.smithi016:> cd /home/ubuntu/cephtest/mnt.1 && sudo ls subdir/childfile 2019-11-28T11:40:49.806 INFO:teuthology.orchestra.run.smithi016.stdout:subdir/childfile 2019-11-28T11:40:49.806 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync' 2019-11-28T11:40:49.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.893+0000 7f5d74fd6700 1 Processor -- start 2019-11-28T11:40:49.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.893+0000 7f5d74fd6700 1 -- start start 2019-11-28T11:40:49.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.894+0000 7f5d74fd6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5d7006c490 0x7f5d7006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:49.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.894+0000 7f5d74fd6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5d7006ce60 0x7f5d70164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:49.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.894+0000 7f5d74fd6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7006db00 con 0x7f5d7006c0a0 2019-11-28T11:40:49.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.894+0000 7f5d74fd6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7006fd60 con 0x7f5d7006ce60 2019-11-28T11:40:49.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.894+0000 7f5d74fd6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d70070030 con 0x7f5d7006c490 2019-11-28T11:40:49.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.894+0000 7f5d6f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5d7006ce60 0x7f5d70164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:49.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.894+0000 7f5d6f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5d7006ce60 0x7f5d70164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38164/0 (socket says 172.21.15.80:38164) 2019-11-28T11:40:49.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.894+0000 7f5d6f59e700 1 -- 172.21.15.80:0/3407234478 learned_addr learned my addr 172.21.15.80:0/3407234478 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:49.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.894+0000 7f5d6e59c700 1 --2- 172.21.15.80:0/3407234478 >> v2:172.21.15.174:3300/0 conn(0x7f5d7006c490 0x7f5d7006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:49.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.895+0000 7f5d6f59e700 1 -- 172.21.15.80:0/3407234478 >> v2:172.21.15.174:3300/0 conn(0x7f5d7006c490 msgr2=0x7f5d7006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:49.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.895+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/3407234478 >> v2:172.21.15.174:3300/0 conn(0x7f5d7006c490 0x7f5d7006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:49.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.895+0000 7f5d6f59e700 1 -- 172.21.15.80:0/3407234478 >> v1:172.21.15.174:6789/0 conn(0x7f5d7006c0a0 legacy=0x7f5d70072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:49.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.895+0000 7f5d6f59e700 1 -- 172.21.15.80:0/3407234478 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d700706c0 con 0x7f5d7006ce60 2019-11-28T11:40:49.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.895+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/3407234478 >> v2:172.21.15.80:3300/0 conn(0x7f5d7006ce60 0x7f5d70164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5d6800f6b0 tx=0x7f5d6800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:49.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.895+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/3407234478 >> v2:172.21.15.80:3300/0 conn(0x7f5d7006ce60 0x7f5d70164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5d6800f6b0 tx=0x7f5d6800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:49.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.895+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/3407234478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7006ce60 0x7f5d70164d70 secure :-1 s=READY pgs=1353 cs=0 l=1 rx=0x7f5d6800f6b0 tx=0x7f5d6800fa50).ready entity=mon.0 client_cookie=1a0ef012ad2b7ae0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:49.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.895+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/3407234478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7006ce60 0x7f5d70164d70 secure :-1 s=THROTTLE_DONE pgs=1353 cs=0 l=1 rx=0x7f5d6800f6b0 tx=0x7f5d6800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:49.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.895+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/3407234478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7006ce60 0x7f5d70164d70 secure :-1 s=THROTTLE_DONE pgs=1353 cs=0 l=1 rx=0x7f5d6800f6b0 tx=0x7f5d6800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:49.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.895+0000 7f5d6dd9b700 1 -- 172.21.15.80:0/3407234478 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d68000a70 con 0x7f5d7006ce60 2019-11-28T11:40:49.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.895+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/3407234478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7006ce60 0x7f5d70164d70 secure :-1 s=THROTTLE_DONE pgs=1353 cs=0 l=1 rx=0x7f5d6800f6b0 tx=0x7f5d6800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:49.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.895+0000 7f5d6dd9b700 1 -- 172.21.15.80:0/3407234478 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d680010e0 con 0x7f5d7006ce60 2019-11-28T11:40:49.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.895+0000 7f5d6dd9b700 1 -- 172.21.15.80:0/3407234478 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d680017b0 con 0x7f5d7006ce60 2019-11-28T11:40:49.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.895+0000 7f5d74fd6700 1 -- 172.21.15.80:0/3407234478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7006ce60 msgr2=0x7f5d70164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:49.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.895+0000 7f5d74fd6700 1 --2- 172.21.15.80:0/3407234478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7006ce60 0x7f5d70164d70 secure :-1 s=READY pgs=1353 cs=0 l=1 rx=0x7f5d6800f6b0 tx=0x7f5d6800fa50).stop 2019-11-28T11:40:49.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.896+0000 7f5d74fd6700 1 -- 172.21.15.80:0/3407234478 shutdown_connections 2019-11-28T11:40:49.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.896+0000 7f5d74fd6700 1 --2- 172.21.15.80:0/3407234478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7006ce60 0x7f5d70164d70 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:49.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.896+0000 7f5d74fd6700 1 --2- 172.21.15.80:0/3407234478 >> v2:172.21.15.174:3300/0 conn(0x7f5d7006c490 0x7f5d7006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:49.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.896+0000 7f5d74fd6700 1 -- 172.21.15.80:0/3407234478 shutdown_connections 2019-11-28T11:40:49.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.896+0000 7f5d74fd6700 1 -- 172.21.15.80:0/3407234478 wait complete. 2019-11-28T11:40:49.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.896+0000 7f5d74fd6700 1 -- 172.21.15.80:0/3407234478 >> 172.21.15.80:0/3407234478 conn(0x7f5d70061cf0 msgr2=0x7f5d70064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:49.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.898+0000 7f5d74fd6700 1 Processor -- start 2019-11-28T11:40:49.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.898+0000 7f5d74fd6700 1 -- start start 2019-11-28T11:40:49.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.899+0000 7f5d74fd6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d70109e40 0x7f5d7010a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:49.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.899+0000 7f5d74fd6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5d7010a810 0x7f5d70105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:49.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.899+0000 7f5d74fd6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7013f1e0 con 0x7f5d7013eb40 2019-11-28T11:40:49.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.899+0000 7f5d74fd6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d701234c0 con 0x7f5d7010a810 2019-11-28T11:40:49.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.899+0000 7f5d74fd6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7013e0d0 con 0x7f5d70109e40 2019-11-28T11:40:49.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.899+0000 7f5d6f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5d7010a810 0x7f5d70105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:49.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.899+0000 7f5d6ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5d7013eb40 0x7f5d7010afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37482/0 (socket says 172.21.15.80:37482) 2019-11-28T11:40:49.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.899+0000 7f5d6ed9d700 1 -- 172.21.15.80:0/497265541 learned_addr learned my addr 172.21.15.80:0/497265541 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:49.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.899+0000 7f5d6e59c700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d70109e40 0x7f5d7010a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:49.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d6f59e700 1 -- 172.21.15.80:0/497265541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d70109e40 msgr2=0x7f5d7010a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:49.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d70109e40 0x7f5d7010a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:49.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d6f59e700 1 -- 172.21.15.80:0/497265541 >> v1:172.21.15.80:6789/0 conn(0x7f5d7013eb40 legacy=0x7f5d7010afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:49.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d6f59e700 1 -- 172.21.15.80:0/497265541 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d70108700 con 0x7f5d7010a810 2019-11-28T11:40:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d677fe700 1 -- 172.21.15.80:0/497265541 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486853019 0 0) 0x7f5d600014d0 con 0x7f5d7013eb40 2019-11-28T11:40:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/497265541 >> v2:172.21.15.80:3300/0 conn(0x7f5d7010a810 0x7f5d70105210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5d68010390 tx=0x7f5d68010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/497265541 >> v2:172.21.15.80:3300/0 conn(0x7f5d7010a810 0x7f5d70105210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5d68010390 tx=0x7f5d68010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7010a810 0x7f5d70105210 secure :-1 s=READY pgs=1355 cs=0 l=1 rx=0x7f5d68010390 tx=0x7f5d68010210).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:49.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7010a810 0x7f5d70105210 secure :-1 s=THROTTLE_DONE pgs=1355 cs=0 l=1 rx=0x7f5d68010390 tx=0x7f5d68010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:49.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d677fe700 1 -- 172.21.15.80:0/497265541 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d680014a0 con 0x7f5d7010a810 2019-11-28T11:40:49.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7010a810 0x7f5d70105210 secure :-1 s=THROTTLE_DONE pgs=1355 cs=0 l=1 rx=0x7f5d68010390 tx=0x7f5d68010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:49.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d677fe700 1 -- 172.21.15.80:0/497265541 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d680010c0 con 0x7f5d7010a810 2019-11-28T11:40:49.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7010a810 0x7f5d70105210 secure :-1 s=THROTTLE_DONE pgs=1355 cs=0 l=1 rx=0x7f5d68010390 tx=0x7f5d68010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:49.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d74fd6700 1 -- 172.21.15.80:0/497265541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d70108a80 con 0x7f5d7010a810 2019-11-28T11:40:49.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d677fe700 1 -- 172.21.15.80:0/497265541 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d68001690 con 0x7f5d7010a810 2019-11-28T11:40:49.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d74fd6700 1 -- 172.21.15.80:0/497265541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d70108700 con 0x7f5d7010a810 2019-11-28T11:40:49.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.900+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7010a810 0x7f5d70105210 secure :-1 s=THROTTLE_DONE pgs=1355 cs=0 l=1 rx=0x7f5d68010390 tx=0x7f5d68010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:49.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.901+0000 7f5d677fe700 1 -- 172.21.15.80:0/497265541 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5d680012b0 con 0x7f5d7010a810 2019-11-28T11:40:49.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.901+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7010a810 0x7f5d70105210 secure :-1 s=THROTTLE_DONE pgs=1355 cs=0 l=1 rx=0x7f5d68010390 tx=0x7f5d68010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:49.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.901+0000 7f5d677fe700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5d54018730 0x7f5d5401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:49.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.901+0000 7f5d677fe700 1 -- 172.21.15.80:0/497265541 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f5d68031a30 con 0x7f5d7010a810 2019-11-28T11:40:49.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.901+0000 7f5d6ed9d700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5d54018730 0x7f5d5401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:49.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.901+0000 7f5d6ed9d700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5d54018730 0x7f5d5401abc0 crc :-1 s=READY pgs=556 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:49.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.908+0000 7f5d74fd6700 1 -- 172.21.15.80:0/497265541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d70108a80 con 0x7f5d7010a810 2019-11-28T11:40:49.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.912+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7010a810 0x7f5d70105210 secure :-1 s=THROTTLE_DONE pgs=1355 cs=0 l=1 rx=0x7f5d68010390 tx=0x7f5d68010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:49.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:49.912+0000 7f5d677fe700 1 -- 172.21.15.80:0/497265541 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5d68000eb0 con 0x7f5d7010a810 2019-11-28T11:40:50.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:50.082+0000 7f5d74fd6700 1 -- 172.21.15.80:0/497265541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync"]} v 0) v1 -- 0x7f5d70108700 con 0x7f5d7010a810 2019-11-28T11:40:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:50.697+0000 7f5d6f59e700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7010a810 0x7f5d70105210 secure :-1 s=THROTTLE_DONE pgs=1355 cs=0 l=1 rx=0x7f5d68010390 tx=0x7f5d68010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:50.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:50.697+0000 7f5d677fe700 1 -- 172.21.15.80:0/497265541 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync"]}]=0 v382) v1 ==== 146+0+0 (secure 0 0 0) 0x7f5d680173b0 con 0x7f5d7010a810 2019-11-28T11:40:50.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:50.699+0000 7f5d74fd6700 1 -- 172.21.15.80:0/497265541 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5d54018730 msgr2=0x7f5d5401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:50.699+0000 7f5d74fd6700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5d54018730 0x7f5d5401abc0 crc :-1 s=READY pgs=556 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:50.699+0000 7f5d74fd6700 1 -- 172.21.15.80:0/497265541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7010a810 msgr2=0x7f5d70105210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:50.699+0000 7f5d74fd6700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7010a810 0x7f5d70105210 secure :-1 s=READY pgs=1355 cs=0 l=1 rx=0x7f5d68010390 tx=0x7f5d68010210).stop 2019-11-28T11:40:50.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:50.700+0000 7f5d74fd6700 1 -- 172.21.15.80:0/497265541 shutdown_connections 2019-11-28T11:40:50.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:50.700+0000 7f5d74fd6700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5d54018730 0x7f5d5401abc0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:50.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:50.700+0000 7f5d74fd6700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d7010a810 0x7f5d70105210 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:50.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:50.700+0000 7f5d74fd6700 1 --2- 172.21.15.80:0/497265541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d70109e40 0x7f5d7010a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:50.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:50.700+0000 7f5d74fd6700 1 -- 172.21.15.80:0/497265541 shutdown_connections 2019-11-28T11:40:50.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:50.700+0000 7f5d74fd6700 1 -- 172.21.15.80:0/497265541 wait complete. 2019-11-28T11:40:50.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:50.700+0000 7f5d74fd6700 1 -- 172.21.15.80:0/497265541 >> 172.21.15.80:0/497265541 conn(0x7f5d7011bfc0 msgr2=0x7f5d70141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:50.741 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:40:50.741 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:40:50.841 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:40:50.912 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:40:51.007 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:40:51.066 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:40:51.136 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:40:51.194 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:40:51.194 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:40:51.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:40:51.194 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:40:51.314 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:40:51.318 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:40:51.359 INFO:tasks.cephfs_test_runner:test_dir_fsync (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2019-11-28T11:40:51.359 INFO:tasks.cephfs_test_runner:Starting test: test_dont_mark_unresponsive_client_stale (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T11:40:51.359 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale' 2019-11-28T11:40:51.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.455+0000 7fe639534700 1 Processor -- start 2019-11-28T11:40:51.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.455+0000 7fe639534700 1 -- start start 2019-11-28T11:40:51.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe639534700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe63406c490 0x7fe63406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:51.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe639534700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe63406ce60 0x7fe634164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:51.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe639534700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63406db00 con 0x7fe63406c0a0 2019-11-28T11:40:51.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe639534700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63406fd60 con 0x7fe63406ce60 2019-11-28T11:40:51.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe639534700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe634070030 con 0x7fe63406c490 2019-11-28T11:40:51.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe633fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe63406ce60 0x7fe634164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:51.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe633fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe63406ce60 0x7fe634164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38176/0 (socket says 172.21.15.80:38176) 2019-11-28T11:40:51.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe633fff700 1 -- 172.21.15.80:0/2730362321 learned_addr learned my addr 172.21.15.80:0/2730362321 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:51.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe632ffd700 1 --2- 172.21.15.80:0/2730362321 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe63406c490 0x7fe63406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:51.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe633fff700 1 -- 172.21.15.80:0/2730362321 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe63406c490 msgr2=0x7fe63406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:51.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe633fff700 1 --2- 172.21.15.80:0/2730362321 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe63406c490 0x7fe63406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:51.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe633fff700 1 -- 172.21.15.80:0/2730362321 >> v1:172.21.15.174:6789/0 conn(0x7fe63406c0a0 legacy=0x7fe634072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:51.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe633fff700 1 -- 172.21.15.80:0/2730362321 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6340706c0 con 0x7fe63406ce60 2019-11-28T11:40:51.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe633fff700 1 --2- 172.21.15.80:0/2730362321 >> v2:172.21.15.80:3300/0 conn(0x7fe63406ce60 0x7fe634164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe62c00f6b0 tx=0x7fe62c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:51.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe633fff700 1 --2- 172.21.15.80:0/2730362321 >> v2:172.21.15.80:3300/0 conn(0x7fe63406ce60 0x7fe634164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe62c00f6b0 tx=0x7fe62c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:51.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe633fff700 1 --2- 172.21.15.80:0/2730362321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63406ce60 0x7fe634164d70 secure :-1 s=READY pgs=1356 cs=0 l=1 rx=0x7fe62c00f6b0 tx=0x7fe62c00fa50).ready entity=mon.0 client_cookie=b4ae91ca0f1348ea server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:51.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe633fff700 1 --2- 172.21.15.80:0/2730362321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63406ce60 0x7fe634164d70 secure :-1 s=THROTTLE_DONE pgs=1356 cs=0 l=1 rx=0x7fe62c00f6b0 tx=0x7fe62c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:51.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe6327fc700 1 -- 172.21.15.80:0/2730362321 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe62c000a70 con 0x7fe63406ce60 2019-11-28T11:40:51.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe633fff700 1 --2- 172.21.15.80:0/2730362321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63406ce60 0x7fe634164d70 secure :-1 s=THROTTLE_DONE pgs=1356 cs=0 l=1 rx=0x7fe62c00f6b0 tx=0x7fe62c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:51.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe633fff700 1 --2- 172.21.15.80:0/2730362321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63406ce60 0x7fe634164d70 secure :-1 s=THROTTLE_DONE pgs=1356 cs=0 l=1 rx=0x7fe62c00f6b0 tx=0x7fe62c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:51.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe6327fc700 1 -- 172.21.15.80:0/2730362321 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c0010e0 con 0x7fe63406ce60 2019-11-28T11:40:51.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.456+0000 7fe6327fc700 1 -- 172.21.15.80:0/2730362321 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe62c0017b0 con 0x7fe63406ce60 2019-11-28T11:40:51.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.457+0000 7fe639534700 1 -- 172.21.15.80:0/2730362321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63406ce60 msgr2=0x7fe634164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:51.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.457+0000 7fe639534700 1 --2- 172.21.15.80:0/2730362321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63406ce60 0x7fe634164d70 secure :-1 s=READY pgs=1356 cs=0 l=1 rx=0x7fe62c00f6b0 tx=0x7fe62c00fa50).stop 2019-11-28T11:40:51.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.457+0000 7fe639534700 1 -- 172.21.15.80:0/2730362321 shutdown_connections 2019-11-28T11:40:51.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.457+0000 7fe639534700 1 --2- 172.21.15.80:0/2730362321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63406ce60 0x7fe634164d70 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:51.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.457+0000 7fe639534700 1 --2- 172.21.15.80:0/2730362321 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe63406c490 0x7fe63406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:51.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.457+0000 7fe639534700 1 -- 172.21.15.80:0/2730362321 shutdown_connections 2019-11-28T11:40:51.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.457+0000 7fe639534700 1 -- 172.21.15.80:0/2730362321 wait complete. 2019-11-28T11:40:51.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.457+0000 7fe639534700 1 -- 172.21.15.80:0/2730362321 >> 172.21.15.80:0/2730362321 conn(0x7fe634061cf0 msgr2=0x7fe634064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:51.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.460+0000 7fe639534700 1 Processor -- start 2019-11-28T11:40:51.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.460+0000 7fe639534700 1 -- start start 2019-11-28T11:40:51.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe639534700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe63413a780 0x7fe63412d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:51.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe639534700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe63412d9c0 0x7fe63412c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:51.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe639534700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe634139a60 con 0x7fe63412c840 2019-11-28T11:40:51.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe639534700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe634129830 con 0x7fe63412d9c0 2019-11-28T11:40:51.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe639534700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63412a260 con 0x7fe63413a780 2019-11-28T11:40:51.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe632ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe63412d9c0 0x7fe63412c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:51.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe632ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe63412d9c0 0x7fe63412c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38182/0 (socket says 172.21.15.80:38182) 2019-11-28T11:40:51.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe632ffd700 1 -- 172.21.15.80:0/70885815 learned_addr learned my addr 172.21.15.80:0/70885815 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:51.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe6337fe700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe63413a780 0x7fe63412d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:51.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe632ffd700 1 -- 172.21.15.80:0/70885815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe63413a780 msgr2=0x7fe63412d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:51.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe632ffd700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe63413a780 0x7fe63412d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:51.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe632ffd700 1 -- 172.21.15.80:0/70885815 >> v1:172.21.15.174:6789/0 conn(0x7fe63412c840 legacy=0x7fe6341281b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2019-11-28T11:40:51.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe632ffd700 1 -- 172.21.15.80:0/70885815 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63412abc0 con 0x7fe63412d9c0 2019-11-28T11:40:51.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe6337fe700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe63413a780 0x7fe63412d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:40:51.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe632ffd700 1 --2- 172.21.15.80:0/70885815 >> v2:172.21.15.80:3300/0 conn(0x7fe63412d9c0 0x7fe63412c300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe624010450 tx=0x7fe6240107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:51.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe632ffd700 1 --2- 172.21.15.80:0/70885815 >> v2:172.21.15.80:3300/0 conn(0x7fe63412d9c0 0x7fe63412c300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe624010450 tx=0x7fe6240107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:51.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe632ffd700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63412d9c0 0x7fe63412c300 secure :-1 s=READY pgs=1357 cs=0 l=1 rx=0x7fe624010450 tx=0x7fe6240107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:51.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe632ffd700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63412d9c0 0x7fe63412c300 secure :-1 s=THROTTLE_DONE pgs=1357 cs=0 l=1 rx=0x7fe624010450 tx=0x7fe6240107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:51.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe62bfff700 1 -- 172.21.15.80:0/70885815 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe624000960 con 0x7fe63412d9c0 2019-11-28T11:40:51.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe632ffd700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63412d9c0 0x7fe63412c300 secure :-1 s=THROTTLE_DONE pgs=1357 cs=0 l=1 rx=0x7fe624010450 tx=0x7fe6240107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:51.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe632ffd700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63412d9c0 0x7fe63412c300 secure :-1 s=THROTTLE_DONE pgs=1357 cs=0 l=1 rx=0x7fe624010450 tx=0x7fe6240107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:51.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe62bfff700 1 -- 172.21.15.80:0/70885815 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe624000fc0 con 0x7fe63412d9c0 2019-11-28T11:40:51.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe639534700 1 -- 172.21.15.80:0/70885815 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63412af40 con 0x7fe63412d9c0 2019-11-28T11:40:51.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe62bfff700 1 -- 172.21.15.80:0/70885815 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe624000b60 con 0x7fe63412d9c0 2019-11-28T11:40:51.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.461+0000 7fe639534700 1 -- 172.21.15.80:0/70885815 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63412abc0 con 0x7fe63412d9c0 2019-11-28T11:40:51.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.462+0000 7fe632ffd700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63412d9c0 0x7fe63412c300 secure :-1 s=THROTTLE_DONE pgs=1357 cs=0 l=1 rx=0x7fe624010450 tx=0x7fe6240107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:51.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.462+0000 7fe62bfff700 1 -- 172.21.15.80:0/70885815 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe624000940 con 0x7fe63412d9c0 2019-11-28T11:40:51.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.462+0000 7fe632ffd700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63412d9c0 0x7fe63412c300 secure :-1 s=THROTTLE_DONE pgs=1357 cs=0 l=1 rx=0x7fe624010450 tx=0x7fe6240107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:51.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.462+0000 7fe62bfff700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe618018730 0x7fe61801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:51.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.462+0000 7fe62bfff700 1 -- 172.21.15.80:0/70885815 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fe624031b20 con 0x7fe63412d9c0 2019-11-28T11:40:51.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.462+0000 7fe6337fe700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe618018730 0x7fe61801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:51.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.462+0000 7fe6337fe700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe618018730 0x7fe61801abc0 crc :-1 s=READY pgs=557 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:51.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.470+0000 7fe639534700 1 -- 172.21.15.80:0/70885815 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63412af40 con 0x7fe63412d9c0 2019-11-28T11:40:51.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.473+0000 7fe632ffd700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63412d9c0 0x7fe63412c300 secure :-1 s=THROTTLE_DONE pgs=1357 cs=0 l=1 rx=0x7fe624010450 tx=0x7fe6240107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:51.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.473+0000 7fe62bfff700 1 -- 172.21.15.80:0/70885815 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe624001eb0 con 0x7fe63412d9c0 2019-11-28T11:40:51.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.647+0000 7fe639534700 1 -- 172.21.15.80:0/70885815 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale"]} v 0) v1 -- 0x7fe63412abc0 con 0x7fe63412d9c0 2019-11-28T11:40:51.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.698+0000 7fe632ffd700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63412d9c0 0x7fe63412c300 secure :-1 s=THROTTLE_DONE pgs=1357 cs=0 l=1 rx=0x7fe624010450 tx=0x7fe6240107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:51.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.698+0000 7fe62bfff700 1 -- 172.21.15.80:0/70885815 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale"]}]=0 v383) v1 ==== 175+0+0 (secure 0 0 0) 0x7fe624001190 con 0x7fe63412d9c0 2019-11-28T11:40:51.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.713+0000 7fe639534700 1 -- 172.21.15.80:0/70885815 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe618018730 msgr2=0x7fe61801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.713+0000 7fe639534700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe618018730 0x7fe61801abc0 crc :-1 s=READY pgs=557 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.713+0000 7fe639534700 1 -- 172.21.15.80:0/70885815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63412d9c0 msgr2=0x7fe63412c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.713+0000 7fe639534700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63412d9c0 0x7fe63412c300 secure :-1 s=READY pgs=1357 cs=0 l=1 rx=0x7fe624010450 tx=0x7fe6240107f0).stop 2019-11-28T11:40:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.713+0000 7fe639534700 1 -- 172.21.15.80:0/70885815 shutdown_connections 2019-11-28T11:40:51.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.713+0000 7fe639534700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe618018730 0x7fe61801abc0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.713+0000 7fe639534700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe63412d9c0 0x7fe63412c300 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.713+0000 7fe639534700 1 --2- 172.21.15.80:0/70885815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe63413a780 0x7fe63412d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.713+0000 7fe639534700 1 -- 172.21.15.80:0/70885815 shutdown_connections 2019-11-28T11:40:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.713+0000 7fe639534700 1 -- 172.21.15.80:0/70885815 wait complete. 2019-11-28T11:40:51.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:51.713+0000 7fe639534700 1 -- 172.21.15.80:0/70885815 >> 172.21.15.80:0/70885815 conn(0x7fe634127dc0 msgr2=0x7fe634141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:51.754 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:40:51.754 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:40:51.822 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:40:51.883 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:40:51.945 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:40:52.002 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:40:52.065 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:40:52.121 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:40:52.122 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:40:52.122 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:40:52.123 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:40:52.123 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:40:52.123 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:40:52.123 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:40:52.128 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:40:52.128 DEBUG:teuthology.parallel:result is None 2019-11-28T11:40:52.129 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:40:52.130 DEBUG:teuthology.parallel:result is None 2019-11-28T11:40:52.132 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:40:52.133 DEBUG:teuthology.parallel:result is None 2019-11-28T11:40:52.133 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:40:52.134 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:40:52.134 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:40:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.302+0000 7f88b888f700 1 Processor -- start 2019-11-28T11:40:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.302+0000 7f88b888f700 1 -- start start 2019-11-28T11:40:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.303+0000 7f88b888f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f88b406c490 0x7f88b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.303+0000 7f88b888f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b406db00 con 0x7f88b406ce60 2019-11-28T11:40:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.303+0000 7f88b888f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b406e000 con 0x7f88b406c0a0 2019-11-28T11:40:52.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.303+0000 7f88b888f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b406fd60 con 0x7f88b406c490 2019-11-28T11:40:52.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.303+0000 7f88b259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f88b406c490 0x7f88b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:52.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.303+0000 7f88b259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f88b406c490 0x7f88b406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38190/0 (socket says 172.21.15.80:38190) 2019-11-28T11:40:52.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.303+0000 7f88b259c700 1 -- 172.21.15.80:0/3894053600 learned_addr learned my addr 172.21.15.80:0/3894053600 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:52.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.303+0000 7f88b359e700 1 --1- 172.21.15.80:0/3894053600 >> v1:172.21.15.80:6789/0 conn(0x7f88b406ce60 0x7f88b4164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37508/0 (socket says 172.21.15.80:37508) 2019-11-28T11:40:52.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f88b259c700 1 -- 172.21.15.80:0/3894053600 >> v1:172.21.15.174:6789/0 conn(0x7f88b406c0a0 legacy=0x7f88b4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f88b259c700 1 -- 172.21.15.80:0/3894053600 >> v1:172.21.15.80:6789/0 conn(0x7f88b406ce60 legacy=0x7f88b4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f88b1d9b700 1 -- 172.21.15.80:0/3894053600 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574007352 0 0) 0x7f889c000d30 con 0x7f88b406ce60 2019-11-28T11:40:52.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f88b259c700 1 -- 172.21.15.80:0/3894053600 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b40706c0 con 0x7f88b406c490 2019-11-28T11:40:52.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f88b259c700 1 --2- 172.21.15.80:0/3894053600 >> v2:172.21.15.80:3300/0 conn(0x7f88b406c490 0x7f88b406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f88a400f740 tx=0x7f88a400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f88b259c700 1 --2- 172.21.15.80:0/3894053600 >> v2:172.21.15.80:3300/0 conn(0x7f88b406c490 0x7f88b406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f88a400f740 tx=0x7f88a400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f88b259c700 1 --2- 172.21.15.80:0/3894053600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88b406c490 0x7f88b406c920 secure :-1 s=READY pgs=1359 cs=0 l=1 rx=0x7f88a400f740 tx=0x7f88a400fae0).ready entity=mon.0 client_cookie=156ddfc46b4493ef server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:52.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f88b259c700 1 --2- 172.21.15.80:0/3894053600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88b406c490 0x7f88b406c920 secure :-1 s=THROTTLE_DONE pgs=1359 cs=0 l=1 rx=0x7f88a400f740 tx=0x7f88a400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f88b1d9b700 1 -- 172.21.15.80:0/3894053600 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88a4000960 con 0x7f88b406c490 2019-11-28T11:40:52.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f88b259c700 1 --2- 172.21.15.80:0/3894053600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88b406c490 0x7f88b406c920 secure :-1 s=THROTTLE_DONE pgs=1359 cs=0 l=1 rx=0x7f88a400f740 tx=0x7f88a400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f88b1d9b700 1 -- 172.21.15.80:0/3894053600 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a4007210 con 0x7f88b406c490 2019-11-28T11:40:52.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f88b259c700 1 --2- 172.21.15.80:0/3894053600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88b406c490 0x7f88b406c920 secure :-1 s=THROTTLE_DONE pgs=1359 cs=0 l=1 rx=0x7f88a400f740 tx=0x7f88a400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f88b1d9b700 1 -- 172.21.15.80:0/3894053600 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88a4000e80 con 0x7f88b406c490 2019-11-28T11:40:52.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f88b888f700 1 -- 172.21.15.80:0/3894053600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88b406c490 msgr2=0x7f88b406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f88b888f700 1 --2- 172.21.15.80:0/3894053600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88b406c490 0x7f88b406c920 secure :-1 s=READY pgs=1359 cs=0 l=1 rx=0x7f88a400f740 tx=0x7f88a400fae0).stop 2019-11-28T11:40:52.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f88b888f700 1 -- 172.21.15.80:0/3894053600 shutdown_connections 2019-11-28T11:40:52.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f88b888f700 1 --2- 172.21.15.80:0/3894053600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88b406c490 0x7f88b406c920 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:52.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f88b888f700 1 -- 172.21.15.80:0/3894053600 shutdown_connections 2019-11-28T11:40:52.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f88b888f700 1 -- 172.21.15.80:0/3894053600 wait complete. 2019-11-28T11:40:52.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f88b888f700 1 -- 172.21.15.80:0/3894053600 >> 172.21.15.80:0/3894053600 conn(0x7f88b4061cf0 msgr2=0x7f88b4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:52.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.303+0000 7f4e3e905700 1 Processor -- start 2019-11-28T11:40:52.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.303+0000 7f4e3e905700 1 -- start start 2019-11-28T11:40:52.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f4e3e905700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e3806c0a0 0x7f4e38072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:52.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f4e3e905700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3806db00 con 0x7f4e380734e0 2019-11-28T11:40:52.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f4e3e905700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3806e000 con 0x7f4e38072620 2019-11-28T11:40:52.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f4e3e905700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3806fd60 con 0x7f4e3806c0a0 2019-11-28T11:40:52.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f4e37fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4e380734e0 0x7f4e38071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37512/0 (socket says 172.21.15.80:37512) 2019-11-28T11:40:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f4e3cea2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e3806c0a0 0x7f4e38072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7f4e37fff700 1 -- 172.21.15.80:0/2763221039 learned_addr learned my addr 172.21.15.80:0/2763221039 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f4e3cea2700 1 -- 172.21.15.80:0/2763221039 >> v1:172.21.15.174:6789/0 conn(0x7f4e38072620 legacy=0x7f4e38164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f4e3cea2700 1 -- 172.21.15.80:0/2763221039 >> v1:172.21.15.80:6789/0 conn(0x7f4e380734e0 legacy=0x7f4e38071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f4e377fe700 1 -- 172.21.15.80:0/2763221039 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 883282740 0 0) 0x7f4e30000d30 con 0x7f4e38072620 2019-11-28T11:40:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f4e3cea2700 1 -- 172.21.15.80:0/2763221039 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e380706c0 con 0x7f4e3806c0a0 2019-11-28T11:40:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f4e3cea2700 1 --2- 172.21.15.80:0/2763221039 >> v2:172.21.15.80:3300/0 conn(0x7f4e3806c0a0 0x7f4e38072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4e2800af50 tx=0x7f4e2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f4e3cea2700 1 --2- 172.21.15.80:0/2763221039 >> v2:172.21.15.80:3300/0 conn(0x7f4e3806c0a0 0x7f4e38072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4e2800af50 tx=0x7f4e2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f4e3cea2700 1 --2- 172.21.15.80:0/2763221039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e3806c0a0 0x7f4e38072fa0 secure :-1 s=READY pgs=1361 cs=0 l=1 rx=0x7f4e2800af50 tx=0x7f4e2800b760).ready entity=mon.0 client_cookie=aa1ac5acdee6e37 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f4e3cea2700 1 --2- 172.21.15.80:0/2763221039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e3806c0a0 0x7f4e38072fa0 secure :-1 s=THROTTLE_DONE pgs=1361 cs=0 l=1 rx=0x7f4e2800af50 tx=0x7f4e2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f4e3cea2700 1 --2- 172.21.15.80:0/2763221039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e3806c0a0 0x7f4e38072fa0 secure :-1 s=THROTTLE_DONE pgs=1361 cs=0 l=1 rx=0x7f4e2800af50 tx=0x7f4e2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f4e377fe700 1 -- 172.21.15.80:0/2763221039 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e28000960 con 0x7f4e3806c0a0 2019-11-28T11:40:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f4e3cea2700 1 --2- 172.21.15.80:0/2763221039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e3806c0a0 0x7f4e38072fa0 secure :-1 s=THROTTLE_DONE pgs=1361 cs=0 l=1 rx=0x7f4e2800af50 tx=0x7f4e2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f4e377fe700 1 -- 172.21.15.80:0/2763221039 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e280098e0 con 0x7f4e3806c0a0 2019-11-28T11:40:52.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f4e377fe700 1 -- 172.21.15.80:0/2763221039 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e2800a050 con 0x7f4e3806c0a0 2019-11-28T11:40:52.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f4e3e905700 1 -- 172.21.15.80:0/2763221039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e3806c0a0 msgr2=0x7f4e38072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7f4e3e905700 1 --2- 172.21.15.80:0/2763221039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e3806c0a0 0x7f4e38072fa0 secure :-1 s=READY pgs=1361 cs=0 l=1 rx=0x7f4e2800af50 tx=0x7f4e2800b760).stop 2019-11-28T11:40:52.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.306+0000 7f4e3e905700 1 -- 172.21.15.80:0/2763221039 shutdown_connections 2019-11-28T11:40:52.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.306+0000 7f4e3e905700 1 --2- 172.21.15.80:0/2763221039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e3806c0a0 0x7f4e38072fa0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:52.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.306+0000 7f4e3e905700 1 -- 172.21.15.80:0/2763221039 shutdown_connections 2019-11-28T11:40:52.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.306+0000 7f4e3e905700 1 -- 172.21.15.80:0/2763221039 wait complete. 2019-11-28T11:40:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.306+0000 7f4e3e905700 1 -- 172.21.15.80:0/2763221039 >> 172.21.15.80:0/2763221039 conn(0x7f4e38061cf0 msgr2=0x7f4e38064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.308+0000 7f4e3e905700 1 Processor -- start 2019-11-28T11:40:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.308+0000 7f4e3e905700 1 -- start start 2019-11-28T11:40:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f4e3e905700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e38130140 0x7f4e3815fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3e905700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3815da00 con 0x7f4e38160340 2019-11-28T11:40:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3e905700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e38138db0 con 0x7f4e3815f660 2019-11-28T11:40:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3e905700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e38141e10 con 0x7f4e38130140 2019-11-28T11:40:52.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3cea2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e38130140 0x7f4e3815fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:52.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3cea2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e38130140 0x7f4e3815fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38214/0 (socket says 172.21.15.80:38214) 2019-11-28T11:40:52.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3cea2700 1 -- 172.21.15.80:0/4109502575 learned_addr learned my addr 172.21.15.80:0/4109502575 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:52.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3cea2700 1 -- 172.21.15.80:0/4109502575 >> v1:172.21.15.174:6789/0 conn(0x7f4e3815f660 legacy=0x7f4e3812d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3cea2700 1 -- 172.21.15.80:0/4109502575 >> v1:172.21.15.80:6789/0 conn(0x7f4e38160340 legacy=0x7f4e3815ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e357fa700 1 -- 172.21.15.80:0/4109502575 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225254375 0 0) 0x7f4e20001170 con 0x7f4e38160340 2019-11-28T11:40:52.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3cea2700 1 -- 172.21.15.80:0/4109502575 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e381424a0 con 0x7f4e38130140 2019-11-28T11:40:52.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3cea2700 1 --2- 172.21.15.80:0/4109502575 >> v2:172.21.15.80:3300/0 conn(0x7f4e38130140 0x7f4e3815fe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4e28014850 tx=0x7f4e28014bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3cea2700 1 --2- 172.21.15.80:0/4109502575 >> v2:172.21.15.80:3300/0 conn(0x7f4e38130140 0x7f4e3815fe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4e28014850 tx=0x7f4e28014bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3cea2700 1 --2- 172.21.15.80:0/4109502575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e38130140 0x7f4e3815fe00 secure :-1 s=READY pgs=1365 cs=0 l=1 rx=0x7f4e28014850 tx=0x7f4e28014bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:52.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3cea2700 1 --2- 172.21.15.80:0/4109502575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e38130140 0x7f4e3815fe00 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f4e28014850 tx=0x7f4e28014bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3cea2700 1 --2- 172.21.15.80:0/4109502575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e38130140 0x7f4e3815fe00 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f4e28014850 tx=0x7f4e28014bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e357fa700 1 -- 172.21.15.80:0/4109502575 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e28000940 con 0x7f4e38130140 2019-11-28T11:40:52.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3cea2700 1 --2- 172.21.15.80:0/4109502575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e38130140 0x7f4e3815fe00 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f4e28014850 tx=0x7f4e28014bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e357fa700 1 -- 172.21.15.80:0/4109502575 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e28009980 con 0x7f4e38130140 2019-11-28T11:40:52.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3e905700 1 -- 172.21.15.80:0/4109502575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e38142820 con 0x7f4e38130140 2019-11-28T11:40:52.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e357fa700 1 -- 172.21.15.80:0/4109502575 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e2800a050 con 0x7f4e38130140 2019-11-28T11:40:52.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f4e3e905700 1 -- 172.21.15.80:0/4109502575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e381424a0 con 0x7f4e38130140 2019-11-28T11:40:52.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.311+0000 7f4e3cea2700 1 --2- 172.21.15.80:0/4109502575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e38130140 0x7f4e3815fe00 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f4e28014850 tx=0x7f4e28014bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.311+0000 7f4e357fa700 1 -- 172.21.15.80:0/4109502575 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4e28009b70 con 0x7f4e38130140 2019-11-28T11:40:52.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.311+0000 7f4e3cea2700 1 --2- 172.21.15.80:0/4109502575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e38130140 0x7f4e3815fe00 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f4e28014850 tx=0x7f4e28014bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.311+0000 7f4e357fa700 1 --2- 172.21.15.80:0/4109502575 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e1c018730 0x7f4e1c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:52.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.311+0000 7f4e357fa700 1 -- 172.21.15.80:0/4109502575 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f4e280361f0 con 0x7f4e38130140 2019-11-28T11:40:52.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.311+0000 7f4e37fff700 1 --2- 172.21.15.80:0/4109502575 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e1c018730 0x7f4e1c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:52.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.312+0000 7f4e37fff700 1 --2- 172.21.15.80:0/4109502575 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e1c018730 0x7f4e1c01abe0 crc :-1 s=READY pgs=559 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:52.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.317+0000 7f4e3e905700 1 -- 172.21.15.80:0/4109502575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e38142820 con 0x7f4e38130140 2019-11-28T11:40:52.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.307+0000 7f88b888f700 1 Processor -- start 2019-11-28T11:40:52.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.307+0000 7f88b888f700 1 -- start start 2019-11-28T11:40:52.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.308+0000 7f88b888f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f88b412cea0 0x7f88b4111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:52.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.308+0000 7f88b888f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b4124260 con 0x7f88b41230e0 2019-11-28T11:40:52.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.308+0000 7f88b888f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b412e5d0 con 0x7f88b4165a00 2019-11-28T11:40:52.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.308+0000 7f88b888f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b4121040 con 0x7f88b412cea0 2019-11-28T11:40:52.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.308+0000 7f88b259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f88b41230e0 0x7f88b4123570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37522/0 (socket says 172.21.15.80:37522) 2019-11-28T11:40:52.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.308+0000 7f88b259c700 1 -- 172.21.15.80:0/108035075 learned_addr learned my addr 172.21.15.80:0/108035075 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:52.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88b2d9d700 1 --2- 172.21.15.80:0/108035075 >> v2:172.21.15.174:3300/0 conn(0x7f88b412cea0 0x7f88b4111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:52.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88ab7fe700 1 -- 172.21.15.80:0/108035075 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803908452 0 0) 0x7f88a4007da0 con 0x7f88b41230e0 2019-11-28T11:40:52.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88ab7fe700 1 -- 172.21.15.80:0/108035075 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f888c002e80 con 0x7f88b41230e0 2019-11-28T11:40:52.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88b2d9d700 1 -- 172.21.15.80:0/108035075 >> v1:172.21.15.174:6789/0 conn(0x7f88b4165a00 legacy=0x7f88b4167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88b2d9d700 1 -- 172.21.15.80:0/108035075 >> v1:172.21.15.80:6789/0 conn(0x7f88b41230e0 legacy=0x7f88b4123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88b2d9d700 1 -- 172.21.15.80:0/108035075 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b41219a0 con 0x7f88b412cea0 2019-11-28T11:40:52.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88b2d9d700 1 --2- 172.21.15.80:0/108035075 >> v2:172.21.15.174:3300/0 conn(0x7f88b412cea0 0x7f88b4111db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f88ac0103b0 tx=0x7f88ac010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88b2d9d700 1 --2- 172.21.15.80:0/108035075 >> v2:172.21.15.174:3300/0 conn(0x7f88b412cea0 0x7f88b4111db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f88ac0103b0 tx=0x7f88ac010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88b2d9d700 1 --2- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88b412cea0 0x7f88b4111db0 secure :-1 s=READY pgs=800 cs=0 l=1 rx=0x7f88ac0103b0 tx=0x7f88ac010750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:52.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88b2d9d700 1 --2- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88b412cea0 0x7f88b4111db0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7f88ac0103b0 tx=0x7f88ac010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88ab7fe700 1 -- 172.21.15.80:0/108035075 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88ac009c70 con 0x7f88b412cea0 2019-11-28T11:40:52.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88b2d9d700 1 --2- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88b412cea0 0x7f88b4111db0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7f88ac0103b0 tx=0x7f88ac010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88ab7fe700 1 -- 172.21.15.80:0/108035075 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac009890 con 0x7f88b412cea0 2019-11-28T11:40:52.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88b2d9d700 1 --2- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88b412cea0 0x7f88b4111db0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7f88ac0103b0 tx=0x7f88ac010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88b888f700 1 -- 172.21.15.80:0/108035075 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b4121d20 con 0x7f88b412cea0 2019-11-28T11:40:52.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88ab7fe700 1 -- 172.21.15.80:0/108035075 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88ac009a80 con 0x7f88b412cea0 2019-11-28T11:40:52.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.309+0000 7f88b888f700 1 -- 172.21.15.80:0/108035075 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b41122f0 con 0x7f88b412cea0 2019-11-28T11:40:52.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f88b2d9d700 1 --2- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88b412cea0 0x7f88b4111db0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7f88ac0103b0 tx=0x7f88ac010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f88b2d9d700 1 --2- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88b412cea0 0x7f88b4111db0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7f88ac0103b0 tx=0x7f88ac010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f88ab7fe700 1 -- 172.21.15.80:0/108035075 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f88ac009a80 con 0x7f88b412cea0 2019-11-28T11:40:52.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f88ab7fe700 1 --2- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f888c018770 0x7f888c01ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:52.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f88ab7fe700 1 -- 172.21.15.80:0/108035075 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f88ac031d50 con 0x7f88b412cea0 2019-11-28T11:40:52.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.310+0000 7f88b259c700 1 --2- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f888c018770 0x7f888c01ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:52.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.311+0000 7f88b259c700 1 --2- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f888c018770 0x7f888c01ac00 crc :-1 s=READY pgs=558 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:52.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.317+0000 7f88b888f700 1 -- 172.21.15.80:0/108035075 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b41219a0 con 0x7f88b412cea0 2019-11-28T11:40:52.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.322+0000 7f88b2d9d700 1 --2- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88b412cea0 0x7f88b4111db0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7f88ac0103b0 tx=0x7f88ac010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.322+0000 7f88ab7fe700 1 -- 172.21.15.80:0/108035075 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f88ac000940 con 0x7f88b412cea0 2019-11-28T11:40:52.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.302+0000 7fde141ee700 1 Processor -- start 2019-11-28T11:40:52.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.302+0000 7fde141ee700 1 -- start start 2019-11-28T11:40:52.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7fde141ee700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde0c06c490 0x7fde0c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:52.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7fde141ee700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fde0c06ce60 0x7fde0c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:52.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7fde141ee700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c06db00 con 0x7fde0c06c0a0 2019-11-28T11:40:52.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7fde141ee700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0c06fd60 con 0x7fde0c06ce60 2019-11-28T11:40:52.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7fde141ee700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c070030 con 0x7fde0c06c490 2019-11-28T11:40:52.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7fde12f8c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fde0c06ce60 0x7fde0c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:52.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7fde12f8c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fde0c06ce60 0x7fde0c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38202/0 (socket says 172.21.15.80:38202) 2019-11-28T11:40:52.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.304+0000 7fde12f8c700 1 -- 172.21.15.80:0/3295034796 learned_addr learned my addr 172.21.15.80:0/3295034796 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:52.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7fde11f8a700 1 --2- 172.21.15.80:0/3295034796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde0c06c490 0x7fde0c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:52.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7fde11789700 1 -- 172.21.15.80:0/3295034796 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459857363 0 0) 0x7fde04001370 con 0x7fde0c06c0a0 2019-11-28T11:40:52.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7fde12f8c700 1 -- 172.21.15.80:0/3295034796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde0c06c490 msgr2=0x7fde0c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:52.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7fde12f8c700 1 --2- 172.21.15.80:0/3295034796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde0c06c490 0x7fde0c06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:52.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7fde12f8c700 1 -- 172.21.15.80:0/3295034796 >> v1:172.21.15.174:6789/0 conn(0x7fde0c06c0a0 legacy=0x7fde0c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7fde12f8c700 1 -- 172.21.15.80:0/3295034796 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c0706c0 con 0x7fde0c06ce60 2019-11-28T11:40:52.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7fde11f8a700 1 --2- 172.21.15.80:0/3295034796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde0c06c490 0x7fde0c06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:40:52.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7fde12f8c700 1 --2- 172.21.15.80:0/3295034796 >> v2:172.21.15.80:3300/0 conn(0x7fde0c06ce60 0x7fde0c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fddfc00f730 tx=0x7fddfc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7fde12f8c700 1 --2- 172.21.15.80:0/3295034796 >> v2:172.21.15.80:3300/0 conn(0x7fde0c06ce60 0x7fde0c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fddfc00f730 tx=0x7fddfc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7fde12f8c700 1 --2- 172.21.15.80:0/3295034796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c06ce60 0x7fde0c164d70 secure :-1 s=READY pgs=1362 cs=0 l=1 rx=0x7fddfc00f730 tx=0x7fddfc00fad0).ready entity=mon.0 client_cookie=1f828e406a88821e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:52.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7fde12f8c700 1 --2- 172.21.15.80:0/3295034796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c06ce60 0x7fde0c164d70 secure :-1 s=THROTTLE_DONE pgs=1362 cs=0 l=1 rx=0x7fddfc00f730 tx=0x7fddfc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7fde11789700 1 -- 172.21.15.80:0/3295034796 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddfc000b90 con 0x7fde0c06ce60 2019-11-28T11:40:52.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7fde12f8c700 1 --2- 172.21.15.80:0/3295034796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c06ce60 0x7fde0c164d70 secure :-1 s=THROTTLE_DONE pgs=1362 cs=0 l=1 rx=0x7fddfc00f730 tx=0x7fddfc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7fde12f8c700 1 --2- 172.21.15.80:0/3295034796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c06ce60 0x7fde0c164d70 secure :-1 s=THROTTLE_DONE pgs=1362 cs=0 l=1 rx=0x7fddfc00f730 tx=0x7fddfc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7fde11789700 1 -- 172.21.15.80:0/3295034796 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc0010e0 con 0x7fde0c06ce60 2019-11-28T11:40:52.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.305+0000 7fde11789700 1 -- 172.21.15.80:0/3295034796 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddfc001830 con 0x7fde0c06ce60 2019-11-28T11:40:52.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.306+0000 7fde141ee700 1 -- 172.21.15.80:0/3295034796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c06ce60 msgr2=0x7fde0c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.306+0000 7fde141ee700 1 --2- 172.21.15.80:0/3295034796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c06ce60 0x7fde0c164d70 secure :-1 s=READY pgs=1362 cs=0 l=1 rx=0x7fddfc00f730 tx=0x7fddfc00fad0).stop 2019-11-28T11:40:52.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.307+0000 7fde141ee700 1 -- 172.21.15.80:0/3295034796 shutdown_connections 2019-11-28T11:40:52.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.307+0000 7fde141ee700 1 --2- 172.21.15.80:0/3295034796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c06ce60 0x7fde0c164d70 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:52.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.307+0000 7fde141ee700 1 --2- 172.21.15.80:0/3295034796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde0c06c490 0x7fde0c06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:52.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.307+0000 7fde141ee700 1 -- 172.21.15.80:0/3295034796 shutdown_connections 2019-11-28T11:40:52.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.308+0000 7fde141ee700 1 -- 172.21.15.80:0/3295034796 wait complete. 2019-11-28T11:40:52.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.308+0000 7fde141ee700 1 -- 172.21.15.80:0/3295034796 >> 172.21.15.80:0/3295034796 conn(0x7fde0c061cf0 msgr2=0x7fde0c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:52.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.311+0000 7fde141ee700 1 Processor -- start 2019-11-28T11:40:52.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.311+0000 7fde141ee700 1 -- start start 2019-11-28T11:40:52.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.312+0000 7fde141ee700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fde0c164ff0 0x7fde0c1653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:52.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.312+0000 7fde141ee700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c13b3f0 con 0x7fde0c114380 2019-11-28T11:40:52.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.312+0000 7fde141ee700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c13b8a0 con 0x7fde0c113ef0 2019-11-28T11:40:52.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.312+0000 7fde141ee700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0c155a60 con 0x7fde0c164ff0 2019-11-28T11:40:52.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.312+0000 7fde1278b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fde0c164ff0 0x7fde0c1653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:52.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.312+0000 7fde12f8c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fde0c114380 0x7fde0c113570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37542/0 (socket says 172.21.15.80:37542) 2019-11-28T11:40:52.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.312+0000 7fde1278b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fde0c164ff0 0x7fde0c1653e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38222/0 (socket says 172.21.15.80:38222) 2019-11-28T11:40:52.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.312+0000 7fde12f8c700 1 -- 172.21.15.80:0/829333117 learned_addr learned my addr 172.21.15.80:0/829333117 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:52.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.312+0000 7fde0affd700 1 -- 172.21.15.80:0/829333117 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123278744 0 0) 0x7fde00007480 con 0x7fde0c113ef0 2019-11-28T11:40:52.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.313+0000 7fde1278b700 1 -- 172.21.15.80:0/829333117 >> v1:172.21.15.174:6789/0 conn(0x7fde0c113ef0 legacy=0x7fde0c112d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.313+0000 7fde1278b700 1 -- 172.21.15.80:0/829333117 >> v1:172.21.15.80:6789/0 conn(0x7fde0c114380 legacy=0x7fde0c113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.313+0000 7fde1278b700 1 -- 172.21.15.80:0/829333117 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c1563c0 con 0x7fde0c164ff0 2019-11-28T11:40:52.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.313+0000 7fde1278b700 1 --2- 172.21.15.80:0/829333117 >> v2:172.21.15.80:3300/0 conn(0x7fde0c164ff0 0x7fde0c1653e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde04010730 tx=0x7fde04010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.313+0000 7fde1278b700 1 --2- 172.21.15.80:0/829333117 >> v2:172.21.15.80:3300/0 conn(0x7fde0c164ff0 0x7fde0c1653e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde04010730 tx=0x7fde04010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.313+0000 7fde1278b700 1 --2- 172.21.15.80:0/829333117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c164ff0 0x7fde0c1653e0 secure :-1 s=READY pgs=1367 cs=0 l=1 rx=0x7fde04010730 tx=0x7fde04010ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:52.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.313+0000 7fde1278b700 1 --2- 172.21.15.80:0/829333117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c164ff0 0x7fde0c1653e0 secure :-1 s=THROTTLE_DONE pgs=1367 cs=0 l=1 rx=0x7fde04010730 tx=0x7fde04010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.313+0000 7fde1278b700 1 --2- 172.21.15.80:0/829333117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c164ff0 0x7fde0c1653e0 secure :-1 s=THROTTLE_DONE pgs=1367 cs=0 l=1 rx=0x7fde04010730 tx=0x7fde04010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.313+0000 7fde1278b700 1 --2- 172.21.15.80:0/829333117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c164ff0 0x7fde0c1653e0 secure :-1 s=THROTTLE_DONE pgs=1367 cs=0 l=1 rx=0x7fde04010730 tx=0x7fde04010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.313+0000 7fde0affd700 1 -- 172.21.15.80:0/829333117 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde0400f3e0 con 0x7fde0c164ff0 2019-11-28T11:40:52.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.313+0000 7fde0affd700 1 -- 172.21.15.80:0/829333117 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde04000cc0 con 0x7fde0c164ff0 2019-11-28T11:40:52.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.313+0000 7fde141ee700 1 -- 172.21.15.80:0/829333117 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0c156740 con 0x7fde0c164ff0 2019-11-28T11:40:52.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.313+0000 7fde0affd700 1 -- 172.21.15.80:0/829333117 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde0400f660 con 0x7fde0c164ff0 2019-11-28T11:40:52.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.313+0000 7fde141ee700 1 -- 172.21.15.80:0/829333117 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c157820 con 0x7fde0c164ff0 2019-11-28T11:40:52.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.314+0000 7fde1278b700 1 --2- 172.21.15.80:0/829333117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c164ff0 0x7fde0c1653e0 secure :-1 s=THROTTLE_DONE pgs=1367 cs=0 l=1 rx=0x7fde04010730 tx=0x7fde04010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.314+0000 7fde0affd700 1 -- 172.21.15.80:0/829333117 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fde0400f550 con 0x7fde0c164ff0 2019-11-28T11:40:52.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.314+0000 7fde1278b700 1 --2- 172.21.15.80:0/829333117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c164ff0 0x7fde0c1653e0 secure :-1 s=THROTTLE_DONE pgs=1367 cs=0 l=1 rx=0x7fde04010730 tx=0x7fde04010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.314+0000 7fde0affd700 1 --2- 172.21.15.80:0/829333117 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fddec018730 0x7fddec01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:52.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.314+0000 7fde0affd700 1 -- 172.21.15.80:0/829333117 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fde04031e00 con 0x7fde0c164ff0 2019-11-28T11:40:52.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.314+0000 7fde11f8a700 1 --2- 172.21.15.80:0/829333117 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fddec018730 0x7fddec01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:52.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.315+0000 7fde11f8a700 1 --2- 172.21.15.80:0/829333117 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fddec018730 0x7fddec01abc0 crc :-1 s=READY pgs=560 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:52.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.317+0000 7fde141ee700 1 -- 172.21.15.80:0/829333117 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0c1563c0 con 0x7fde0c164ff0 2019-11-28T11:40:52.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.321+0000 7fde1278b700 1 --2- 172.21.15.80:0/829333117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c164ff0 0x7fde0c1653e0 secure :-1 s=THROTTLE_DONE pgs=1367 cs=0 l=1 rx=0x7fde04010730 tx=0x7fde04010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.321+0000 7fde0affd700 1 -- 172.21.15.80:0/829333117 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fde0400f340 con 0x7fde0c164ff0 2019-11-28T11:40:52.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.324+0000 7f4e3cea2700 1 --2- 172.21.15.80:0/4109502575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e38130140 0x7f4e3815fe00 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f4e28014850 tx=0x7f4e28014bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.324+0000 7f4e357fa700 1 -- 172.21.15.80:0/4109502575 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4e28009580 con 0x7f4e38130140 2019-11-28T11:40:52.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.501+0000 7fde141ee700 1 -- 172.21.15.80:0/829333117 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7fde0c156740 con 0x7fde0c164ff0 2019-11-28T11:40:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.596+0000 7f88b888f700 1 -- 172.21.15.80:0/108035075 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f88b4121d20 con 0x7f88b412cea0 2019-11-28T11:40:52.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.597+0000 7f4e3e905700 1 -- 172.21.15.80:0/4109502575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f4e381424a0 con 0x7f4e38130140 2019-11-28T11:40:52.729 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:40:52.696+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:40:52.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.706+0000 7fde1278b700 1 --2- 172.21.15.80:0/829333117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c164ff0 0x7fde0c1653e0 secure :-1 s=THROTTLE_DONE pgs=1367 cs=0 l=1 rx=0x7fde04010730 tx=0x7fde04010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.706+0000 7fde0affd700 1 -- 172.21.15.80:0/829333117 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 5855 v68) v1 ==== 95+0+0 (secure 0 0 0) 0x7fde0400f550 con 0x7fde0c164ff0 2019-11-28T11:40:52.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.706+0000 7f4e3cea2700 1 --2- 172.21.15.80:0/4109502575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e38130140 0x7f4e3815fe00 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f4e28014850 tx=0x7f4e28014bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.706+0000 7f4e357fa700 1 -- 172.21.15.80:0/4109502575 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 5846 v68) v1 ==== 95+0+0 (secure 0 0 0) 0x7f4e28009960 con 0x7f4e38130140 2019-11-28T11:40:52.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.706+0000 7f88b2d9d700 1 --2- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88b412cea0 0x7f88b4111db0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7f88ac0103b0 tx=0x7f88ac010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.706+0000 7f88ab7fe700 1 -- 172.21.15.80:0/108035075 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7261 v68) v1 ==== 95+0+0 (secure 0 0 0) 0x7f88ac009680 con 0x7f88b412cea0 2019-11-28T11:40:52.742 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 7261 2019-11-28T11:40:52.743 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 5846 2019-11-28T11:40:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.713+0000 7f88b888f700 1 -- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f888c018770 msgr2=0x7f888c01ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.713+0000 7f88b888f700 1 --2- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f888c018770 0x7f888c01ac00 crc :-1 s=READY pgs=558 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.713+0000 7f88b888f700 1 -- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88b412cea0 msgr2=0x7f88b4111db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.713+0000 7f88b888f700 1 --2- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88b412cea0 0x7f88b4111db0 secure :-1 s=READY pgs=800 cs=0 l=1 rx=0x7f88ac0103b0 tx=0x7f88ac010750).stop 2019-11-28T11:40:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.713+0000 7f88b888f700 1 -- 172.21.15.80:0/108035075 shutdown_connections 2019-11-28T11:40:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.713+0000 7f88b888f700 1 --2- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f888c018770 0x7f888c01ac00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.713+0000 7f88b888f700 1 --2- 172.21.15.80:0/108035075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88b412cea0 0x7f88b4111db0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.713+0000 7f88b888f700 1 -- 172.21.15.80:0/108035075 shutdown_connections 2019-11-28T11:40:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.713+0000 7f88b888f700 1 -- 172.21.15.80:0/108035075 wait complete. 2019-11-28T11:40:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.713+0000 7f88b888f700 1 -- 172.21.15.80:0/108035075 >> 172.21.15.80:0/108035075 conn(0x7f88b41426c0 msgr2=0x7f88b4110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:52.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.713+0000 7f4e3e905700 1 -- 172.21.15.80:0/4109502575 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e1c018730 msgr2=0x7f4e1c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.713+0000 7f4e3e905700 1 --2- 172.21.15.80:0/4109502575 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e1c018730 0x7f4e1c01abe0 crc :-1 s=READY pgs=559 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:52.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.713+0000 7f4e3e905700 1 -- 172.21.15.80:0/4109502575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e38130140 msgr2=0x7f4e3815fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.713+0000 7f4e3e905700 1 --2- 172.21.15.80:0/4109502575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e38130140 0x7f4e3815fe00 secure :-1 s=READY pgs=1365 cs=0 l=1 rx=0x7f4e28014850 tx=0x7f4e28014bf0).stop 2019-11-28T11:40:52.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.714+0000 7f4e3e905700 1 -- 172.21.15.80:0/4109502575 shutdown_connections 2019-11-28T11:40:52.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.714+0000 7f4e3e905700 1 --2- 172.21.15.80:0/4109502575 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e1c018730 0x7f4e1c01abe0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:52.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.714+0000 7f4e3e905700 1 --2- 172.21.15.80:0/4109502575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e38130140 0x7f4e3815fe00 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:52.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.714+0000 7f4e3e905700 1 -- 172.21.15.80:0/4109502575 shutdown_connections 2019-11-28T11:40:52.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.714+0000 7f4e3e905700 1 -- 172.21.15.80:0/4109502575 wait complete. 2019-11-28T11:40:52.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.714+0000 7f4e3e905700 1 -- 172.21.15.80:0/4109502575 >> 172.21.15.80:0/4109502575 conn(0x7f4e38159ae0 msgr2=0x7f4e3813d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:52.752 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 5855 2019-11-28T11:40:52.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.717+0000 7fde141ee700 1 -- 172.21.15.80:0/829333117 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fddec018730 msgr2=0x7fddec01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.717+0000 7fde141ee700 1 --2- 172.21.15.80:0/829333117 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fddec018730 0x7fddec01abc0 crc :-1 s=READY pgs=560 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:52.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.717+0000 7fde141ee700 1 -- 172.21.15.80:0/829333117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c164ff0 msgr2=0x7fde0c1653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.717+0000 7fde141ee700 1 --2- 172.21.15.80:0/829333117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c164ff0 0x7fde0c1653e0 secure :-1 s=READY pgs=1367 cs=0 l=1 rx=0x7fde04010730 tx=0x7fde04010ad0).stop 2019-11-28T11:40:52.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.717+0000 7fde141ee700 1 -- 172.21.15.80:0/829333117 shutdown_connections 2019-11-28T11:40:52.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.717+0000 7fde141ee700 1 --2- 172.21.15.80:0/829333117 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fddec018730 0x7fddec01abc0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:52.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.717+0000 7fde141ee700 1 --2- 172.21.15.80:0/829333117 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde0c164ff0 0x7fde0c1653e0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:52.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.717+0000 7fde141ee700 1 -- 172.21.15.80:0/829333117 shutdown_connections 2019-11-28T11:40:52.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.717+0000 7fde141ee700 1 -- 172.21.15.80:0/829333117 wait complete. 2019-11-28T11:40:52.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.717+0000 7fde141ee700 1 -- 172.21.15.80:0/829333117 >> 172.21.15.80:0/829333117 conn(0x7fde0c11beb0 msgr2=0x7fde0c13ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:52.757 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:40:52.759 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:40:52.760 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:40:52.760 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:40:52.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.857+0000 7f49f05ba700 1 Processor -- start 2019-11-28T11:40:52.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.857+0000 7f49f05ba700 1 -- start start 2019-11-28T11:40:52.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.858+0000 7f49f05ba700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f49e806c0a0 0x7f49e8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:52.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.858+0000 7f49f05ba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f49e8072620 0x7f49e8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:52.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49f05ba700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e806db00 con 0x7f49e80734e0 2019-11-28T11:40:52.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49f05ba700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e806fd60 con 0x7f49e8072620 2019-11-28T11:40:52.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49f05ba700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e8070030 con 0x7f49e806c0a0 2019-11-28T11:40:52.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49ef358700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f49e8072620 0x7f49e8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:52.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49ef358700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f49e8072620 0x7f49e8164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38232/0 (socket says 172.21.15.80:38232) 2019-11-28T11:40:52.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49ef358700 1 -- 172.21.15.80:0/824481242 learned_addr learned my addr 172.21.15.80:0/824481242 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:52.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49eeb57700 1 --2- 172.21.15.80:0/824481242 >> v2:172.21.15.174:3300/0 conn(0x7f49e806c0a0 0x7f49e8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:52.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49ef358700 1 -- 172.21.15.80:0/824481242 >> v2:172.21.15.174:3300/0 conn(0x7f49e806c0a0 msgr2=0x7f49e8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:52.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49ef358700 1 --2- 172.21.15.80:0/824481242 >> v2:172.21.15.174:3300/0 conn(0x7f49e806c0a0 0x7f49e8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:52.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49ef358700 1 -- 172.21.15.80:0/824481242 >> v1:172.21.15.174:6789/0 conn(0x7f49e80734e0 legacy=0x7f49e8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49ef358700 1 -- 172.21.15.80:0/824481242 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e80706c0 con 0x7f49e8072620 2019-11-28T11:40:52.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49ef358700 1 --2- 172.21.15.80:0/824481242 >> v2:172.21.15.80:3300/0 conn(0x7f49e8072620 0x7f49e8164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f49e000f6b0 tx=0x7f49e000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49ef358700 1 --2- 172.21.15.80:0/824481242 >> v2:172.21.15.80:3300/0 conn(0x7f49e8072620 0x7f49e8164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f49e000f6b0 tx=0x7f49e000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49ef358700 1 --2- 172.21.15.80:0/824481242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e8072620 0x7f49e8164d70 secure :-1 s=READY pgs=1368 cs=0 l=1 rx=0x7f49e000f6b0 tx=0x7f49e000fa50).ready entity=mon.0 client_cookie=cf75eb1acf682c19 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:52.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49ef358700 1 --2- 172.21.15.80:0/824481242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e8072620 0x7f49e8164d70 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f49e000f6b0 tx=0x7f49e000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49ef358700 1 --2- 172.21.15.80:0/824481242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e8072620 0x7f49e8164d70 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f49e000f6b0 tx=0x7f49e000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49edb55700 1 -- 172.21.15.80:0/824481242 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49e0000a70 con 0x7f49e8072620 2019-11-28T11:40:52.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49ef358700 1 --2- 172.21.15.80:0/824481242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e8072620 0x7f49e8164d70 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f49e000f6b0 tx=0x7f49e000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49edb55700 1 -- 172.21.15.80:0/824481242 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e00010e0 con 0x7f49e8072620 2019-11-28T11:40:52.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49edb55700 1 -- 172.21.15.80:0/824481242 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49e00017b0 con 0x7f49e8072620 2019-11-28T11:40:52.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49f05ba700 1 -- 172.21.15.80:0/824481242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e8072620 msgr2=0x7f49e8164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.859+0000 7f49f05ba700 1 --2- 172.21.15.80:0/824481242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e8072620 0x7f49e8164d70 secure :-1 s=READY pgs=1368 cs=0 l=1 rx=0x7f49e000f6b0 tx=0x7f49e000fa50).stop 2019-11-28T11:40:52.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.860+0000 7f49f05ba700 1 -- 172.21.15.80:0/824481242 shutdown_connections 2019-11-28T11:40:52.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.860+0000 7f49f05ba700 1 --2- 172.21.15.80:0/824481242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e8072620 0x7f49e8164d70 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:52.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.860+0000 7f49f05ba700 1 --2- 172.21.15.80:0/824481242 >> v2:172.21.15.174:3300/0 conn(0x7f49e806c0a0 0x7f49e8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:52.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.860+0000 7f49f05ba700 1 -- 172.21.15.80:0/824481242 shutdown_connections 2019-11-28T11:40:52.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.860+0000 7f49f05ba700 1 -- 172.21.15.80:0/824481242 wait complete. 2019-11-28T11:40:52.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.860+0000 7f49f05ba700 1 -- 172.21.15.80:0/824481242 >> 172.21.15.80:0/824481242 conn(0x7f49e8061cf0 msgr2=0x7f49e8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:52.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.863+0000 7f49f05ba700 1 Processor -- start 2019-11-28T11:40:52.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.863+0000 7f49f05ba700 1 -- start start 2019-11-28T11:40:52.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.863+0000 7f49f05ba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f49e813e5f0 0x7f49e813e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:52.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.863+0000 7f49f05ba700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f49e810a4e0 0x7f49e810c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:52.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.863+0000 7f49f05ba700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e81066e0 con 0x7f49e810a070 2019-11-28T11:40:52.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.863+0000 7f49f05ba700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e810e060 con 0x7f49e813e5f0 2019-11-28T11:40:52.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.863+0000 7f49f05ba700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e810e330 con 0x7f49e810a4e0 2019-11-28T11:40:52.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49eeb57700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f49e813e5f0 0x7f49e813e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:52.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49eeb57700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f49e813e5f0 0x7f49e813e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38236/0 (socket says 172.21.15.80:38236) 2019-11-28T11:40:52.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49eeb57700 1 -- 172.21.15.80:0/300116911 learned_addr learned my addr 172.21.15.80:0/300116911 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:52.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49ef358700 1 --2- 172.21.15.80:0/300116911 >> v2:172.21.15.174:3300/0 conn(0x7f49e810a4e0 0x7f49e810c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:52.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49eeb57700 1 -- 172.21.15.80:0/300116911 >> v2:172.21.15.174:3300/0 conn(0x7f49e810a4e0 msgr2=0x7f49e810c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49eeb57700 1 --2- 172.21.15.80:0/300116911 >> v2:172.21.15.174:3300/0 conn(0x7f49e810a4e0 0x7f49e810c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:52.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49eeb57700 1 -- 172.21.15.80:0/300116911 >> v1:172.21.15.80:6789/0 conn(0x7f49e810a070 legacy=0x7f49e810bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:52.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49eeb57700 1 -- 172.21.15.80:0/300116911 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e810e9c0 con 0x7f49e813e5f0 2019-11-28T11:40:52.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49eeb57700 1 --2- 172.21.15.80:0/300116911 >> v2:172.21.15.80:3300/0 conn(0x7f49e813e5f0 0x7f49e813e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49d00107d0 tx=0x7f49d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49eeb57700 1 --2- 172.21.15.80:0/300116911 >> v2:172.21.15.80:3300/0 conn(0x7f49e813e5f0 0x7f49e813e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49d00107d0 tx=0x7f49d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49eeb57700 1 --2- 172.21.15.80:0/300116911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e813e5f0 0x7f49e813e9e0 secure :-1 s=READY pgs=1370 cs=0 l=1 rx=0x7f49d00107d0 tx=0x7f49d0010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:52.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49eeb57700 1 --2- 172.21.15.80:0/300116911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e813e5f0 0x7f49e813e9e0 secure :-1 s=THROTTLE_DONE pgs=1370 cs=0 l=1 rx=0x7f49d00107d0 tx=0x7f49d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49eeb57700 1 --2- 172.21.15.80:0/300116911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e813e5f0 0x7f49e813e9e0 secure :-1 s=THROTTLE_DONE pgs=1370 cs=0 l=1 rx=0x7f49d00107d0 tx=0x7f49d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49eeb57700 1 --2- 172.21.15.80:0/300116911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e813e5f0 0x7f49e813e9e0 secure :-1 s=THROTTLE_DONE pgs=1370 cs=0 l=1 rx=0x7f49d00107d0 tx=0x7f49d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49e77fe700 1 -- 172.21.15.80:0/300116911 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49d0000cc0 con 0x7f49e813e5f0 2019-11-28T11:40:52.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49e77fe700 1 -- 172.21.15.80:0/300116911 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d0001200 con 0x7f49e813e5f0 2019-11-28T11:40:52.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49f05ba700 1 -- 172.21.15.80:0/300116911 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e810ed40 con 0x7f49e813e5f0 2019-11-28T11:40:52.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49e77fe700 1 -- 172.21.15.80:0/300116911 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49d0001850 con 0x7f49e813e5f0 2019-11-28T11:40:52.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.864+0000 7f49f05ba700 1 -- 172.21.15.80:0/300116911 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e810e9c0 con 0x7f49e813e5f0 2019-11-28T11:40:52.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.865+0000 7f49eeb57700 1 --2- 172.21.15.80:0/300116911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e813e5f0 0x7f49e813e9e0 secure :-1 s=THROTTLE_DONE pgs=1370 cs=0 l=1 rx=0x7f49d00107d0 tx=0x7f49d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.865+0000 7f49e77fe700 1 -- 172.21.15.80:0/300116911 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f49d00013f0 con 0x7f49e813e5f0 2019-11-28T11:40:52.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.865+0000 7f49eeb57700 1 --2- 172.21.15.80:0/300116911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e813e5f0 0x7f49e813e9e0 secure :-1 s=THROTTLE_DONE pgs=1370 cs=0 l=1 rx=0x7f49d00107d0 tx=0x7f49d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.865+0000 7f49e77fe700 1 --2- 172.21.15.80:0/300116911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49cc018730 0x7f49cc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:52.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.865+0000 7f49e77fe700 1 -- 172.21.15.80:0/300116911 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f49d0031e50 con 0x7f49e813e5f0 2019-11-28T11:40:52.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.865+0000 7f49ee356700 1 --2- 172.21.15.80:0/300116911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49cc018730 0x7f49cc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:52.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.866+0000 7f49ee356700 1 --2- 172.21.15.80:0/300116911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49cc018730 0x7f49cc01abc0 crc :-1 s=READY pgs=561 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:52.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.873+0000 7f49f05ba700 1 -- 172.21.15.80:0/300116911 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e810ed40 con 0x7f49e813e5f0 2019-11-28T11:40:52.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.876+0000 7f49eeb57700 1 --2- 172.21.15.80:0/300116911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e813e5f0 0x7f49e813e9e0 secure :-1 s=THROTTLE_DONE pgs=1370 cs=0 l=1 rx=0x7f49d00107d0 tx=0x7f49d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:52.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:52.876+0000 7f49e77fe700 1 -- 172.21.15.80:0/300116911 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f49d00095d0 con 0x7f49e813e5f0 2019-11-28T11:40:53.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.050+0000 7f49f05ba700 1 -- 172.21.15.80:0/300116911 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f49e810e9c0 con 0x7f49e813e5f0 2019-11-28T11:40:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.051+0000 7f49eeb57700 1 --2- 172.21.15.80:0/300116911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e813e5f0 0x7f49e813e9e0 secure :-1 s=THROTTLE_DONE pgs=1370 cs=0 l=1 rx=0x7f49d00107d0 tx=0x7f49d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.051+0000 7f49e77fe700 1 -- 172.21.15.80:0/300116911 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v100) v1 ==== 81+0+31987 (secure 0 0 0) 0x7f49d00013f0 con 0x7f49e813e5f0 2019-11-28T11:40:53.086 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:53.087 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:40:53.087 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 100, 2019-11-28T11:40:53.087 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:40:53.087 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:40:53.087 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:40:52.605680+0000", 2019-11-28T11:40:53.087 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:40:53.087 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:40:53.088 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:40:53.088 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:40:53.088 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:40:53.089 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:40:53.089 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:40:53.089 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:40:53.089 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:40:53.089 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:40:53.089 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:40:53.089 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:40:53.090 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:40:53.090 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:40:53.090 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:40:53.090 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 15, 2019-11-28T11:40:53.090 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:40:53.091 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:40:53.091 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:40:53.091 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:40:53.091 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:40:53.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.091 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:40:53.091 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:40:53.092 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:40:53.092 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:40:53.092 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:40:53.092 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:40:53.092 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:40:53.092 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:40:53.092 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:40:53.093 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:40:53.093 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:40:53.093 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:40:53.093 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:40:53.093 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:40:53.093 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:40:53.093 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:40:53.094 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:40:53.094 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:40:53.094 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:40:53.094 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:40:53.094 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:40:53.094 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:40:53.094 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:40:53.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.095 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:40:53.095 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:40:53.095 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:40:53.096 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:40:53.096 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:40:53.096 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:40:53.097 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:40:53.097 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:40:53.097 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:40:53.097 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:40:53.097 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:40:53.097 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:40:53.097 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:40:53.098 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:40:53.098 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:40:53.098 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:40:53.098 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:40:53.099 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:40:53.099 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:40:53.099 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:40:53.099 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:40:53.099 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:40:53.099 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:40:53.100 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:40:53.100 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:40:53.100 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:40:53.100 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:40:53.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.100 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:40:53.100 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:40:53.101 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:40:53.101 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:40:53.101 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:40:53.101 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:40:53.101 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:40:53.101 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:40:53.101 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:40:53.102 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:40:53.102 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:40:53.102 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:40:53.102 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:40:53.102 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:40:53.102 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.103 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 14, 2019-11-28T11:40:53.103 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:40:53.103 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:37:01.482997+0000", 2019-11-28T11:40:53.103 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:40:53.103 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:40:53.103 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:40:53.104 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:40:53.104 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:40:53.104 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:40:53.104 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:40:53.104 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:40:53.104 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:40:53.104 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:40:53.105 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:40:53.105 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:40:53.105 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:40:53.105 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:40:53.105 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:40:53.105 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:40:53.105 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:40:53.105 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:40:53.107 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:40:53.107 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:40:53.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.107 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "92", 2019-11-28T11:40:53.107 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:40:53.107 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:40:53.108 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:40:53.108 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:40:53.108 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:40:53.108 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:40:53.108 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:40:53.108 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:40:53.109 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:40:53.110 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:40:53.110 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:40:53.110 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:40:53.110 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:40:53.110 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:40:53.110 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:40:53.110 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:40:53.111 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:40:53.111 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:40:53.111 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:40:53.111 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:40:53.111 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:40:53.111 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:40:53.111 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:40:53.112 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:40:53.112 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:40:53.112 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:40:53.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.112 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:40:53.112 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:40:53.112 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:40:53.113 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:40:53.113 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:40:53.113 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:40:53.113 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:40:53.113 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:40:53.113 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:40:53.113 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:40:53.114 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:40:53.114 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:40:53.114 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:40:53.114 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:40:53.114 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:40:53.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.114 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:40:53.115 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:40:53.115 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:40:53.115 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.115 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.115 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 15, 2019-11-28T11:40:53.116 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:40:53.116 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:37:02.223344+0000", 2019-11-28T11:40:53.116 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:40:53.116 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:40:53.116 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:40:53.117 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:40:53.117 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:40:53.118 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:40:53.118 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:40:53.118 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:40:53.118 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:40:53.118 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:40:53.118 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:40:53.119 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:40:53.119 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:40:53.119 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:40:53.119 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:40:53.120 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:40:53.120 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:40:53.120 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:40:53.120 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:40:53.120 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:40:53.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.121 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "93", 2019-11-28T11:40:53.121 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:40:53.121 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:40:53.121 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:40:53.121 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:40:53.121 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:40:53.122 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:40:53.122 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:40:53.122 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:40:53.122 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:40:53.122 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:40:53.122 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:40:53.122 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:40:53.123 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:40:53.123 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:40:53.123 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:40:53.123 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:40:53.123 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:40:53.123 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:40:53.123 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:40:53.124 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:40:53.124 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:40:53.124 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:40:53.124 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:40:53.124 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:40:53.124 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:40:53.124 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:40:53.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.125 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:40:53.125 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:40:53.125 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:40:53.125 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:40:53.125 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:40:53.125 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:40:53.126 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:40:53.126 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:40:53.126 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:40:53.126 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:40:53.126 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:40:53.126 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:40:53.126 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:40:53.126 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:40:53.127 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:40:53.127 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.128 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.128 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.128 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:40:53.128 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:40:53.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.129 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:40:53.129 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:40:53.129 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:40:53.129 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:40:53.129 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:40:53.129 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:40:53.130 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:40:53.130 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:40:53.130 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:40:53.131 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 90, 2019-11-28T11:40:53.131 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:40:53.131 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:40:53.131 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:40:53.131 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.132 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.132 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:40:53.132 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:40:53.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.132 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.132 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:40:53.133 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:40:53.133 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.133 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.133 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:40:53.133 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.134 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.134 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:40:53.134 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:40:53.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.134 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.134 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:40:53.135 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:40:53.135 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.135 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.135 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:40:53.135 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.136 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.136 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:40:53.136 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:40:53.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.136 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.136 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:40:53.137 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:40:53.137 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.137 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.137 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:40:53.137 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.138 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.138 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:40:53.139 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:40:53.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.139 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.139 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:40:53.140 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:40:53.140 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.140 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.140 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:40:53.141 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:40:53.141 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:40:53.141 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:40:53.141 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:40:53.141 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:40:53.142 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:40:53.142 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.143 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:40:53.143 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:40:53.143 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:40:53.144 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:40:53.144 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:40:53.144 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:40:53.144 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:40:53.144 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:40:53.145 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:40:53.145 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 91, 2019-11-28T11:40:53.145 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:40:53.145 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:40:53.145 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:40:53.145 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.146 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.146 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:40:53.146 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:40:53.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.146 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.146 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:40:53.147 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:40:53.147 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.147 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.147 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:40:53.147 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.148 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.148 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:40:53.148 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:40:53.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.148 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.148 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:40:53.149 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:40:53.149 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.149 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.149 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:40:53.149 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.149 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.150 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:40:53.150 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:40:53.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.150 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.150 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:40:53.150 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:40:53.151 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.151 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.151 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:40:53.151 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.151 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.152 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:40:53.152 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:40:53.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.152 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.152 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:40:53.152 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:40:53.153 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.153 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.153 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:40:53.153 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:40:53.153 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:40:53.154 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:40:53.154 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:40:53.154 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:40:53.154 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:40:53.154 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:40:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:40:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:40:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:40:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:40:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:40:53.155 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:40:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:40:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:40:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 90, 2019-11-28T11:40:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:40:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:40:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:40:53.156 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:40:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:40:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.157 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:40:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:40:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:40:53.158 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:40:53.159 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:40:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.160 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:40:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:40:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:40:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.162 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:40:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:40:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:40:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:40:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:40:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:40:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:40:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:40:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:40:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:40:53.169 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:40:53.169 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:40:53.169 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:40:53.169 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:40:53.170 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:40:53.170 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:40:53.170 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:40:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:40:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:40:53.171 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:40:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:40:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:40:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:40:53.172 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:40:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:40:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 89, 2019-11-28T11:40:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:40:53.173 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:40:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:40:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.174 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:40:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:40:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:40:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:40:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:40:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:40:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:40:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:40:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:40:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:40:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:40:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:40:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:40:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:40:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:40:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:40:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:40:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:40:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:40:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:40:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:40:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:40:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:40:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:40:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:40:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:40:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:40:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:40:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:40:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:40:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:40:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:40:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:40:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:40:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:40:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 90, 2019-11-28T11:40:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:40:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:40:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:40:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:40:53.192 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:40:53.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.192 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.192 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:40:53.192 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:40:53.192 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:40:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:40:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:40:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:40:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:40:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:40:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:40:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:40:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:40:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:40:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:40:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:40:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:40:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:40:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:40:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:40:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:40:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:40:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:40:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:40:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:40:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:40:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:40:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:40:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:40:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:40:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:40:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:40:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:40:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:40:53.202 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:40:53.202 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 89, 2019-11-28T11:40:53.202 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:40:53.202 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:40:53.202 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:40:53.203 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.203 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.203 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:40:53.204 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:40:53.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.204 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.205 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:40:53.205 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:40:53.205 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.205 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.206 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:40:53.206 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.207 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.207 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:40:53.207 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:40:53.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.208 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.208 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:40:53.208 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:40:53.208 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.209 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.209 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:40:53.209 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.210 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.210 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:40:53.210 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:40:53.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.211 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.211 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:40:53.212 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:40:53.212 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.212 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.213 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:40:53.213 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.213 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.213 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:40:53.214 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:40:53.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.214 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.214 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:40:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:40:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:40:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:40:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:40:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:40:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:40:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:40:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:40:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:40:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:40:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:40:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:40:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:40:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:40:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:40:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:40:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:40:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 90, 2019-11-28T11:40:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:40:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:40:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:40:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:40:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:40:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:40:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:40:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:40:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:40:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:40:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:40:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:40:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:40:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:40:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:40:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:40:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:40:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:40:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:40:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:40:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:40:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:40:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:40:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:40:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:40:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:40:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:40:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:40:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:40:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:40:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:40:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:40:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:40:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:40:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:40:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:40:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:40:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:40:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 76, 2019-11-28T11:40:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:40:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:40:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:40:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:40:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:40:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:40:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:40:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:40:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:40:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:40:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:40:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:40:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:40:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:40:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:40:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:40:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:40:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:40:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:40:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:40:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:40:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:40:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:40:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:40:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:40:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:40:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:40:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:40:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:40:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:40:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:40:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:40:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:40:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:40:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:40:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:40:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:40:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:40:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:40:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:40:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:40:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:40:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:40:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:40:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:40:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:40:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:40:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:40:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:40:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:40:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:40:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:40:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:40:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:40:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:40:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:40:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:40:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:40:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:40:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:40:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:40:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:40:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:40:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:40:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:40:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:40:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:40:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:40:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:40:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:40:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:40:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:40:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:40:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:40:53.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.252 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:40:53.252 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:40:53.253 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:40:53.253 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:40:53.253 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:40:53.253 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:40:53.253 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:40:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:40:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:40:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:40:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:40:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:40:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:40:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:40:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:40:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:40:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:40:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:40:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:40:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:40:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:40:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:40:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:40:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:40:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:40:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:40:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:40:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:40:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:40:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:40:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6833/2279612482": "2019-11-29T11:40:52.598812+0000", 2019-11-28T11:40:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6832/2279612482": "2019-11-29T11:40:52.598812+0000", 2019-11-28T11:40:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.76:0/1604329568": "2019-11-28T12:40:44.346703+0000", 2019-11-28T11:40:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/775911718": "2019-11-29T11:37:21.497358+0000", 2019-11-28T11:40:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/775911718": "2019-11-29T11:37:21.497358+0000" 2019-11-28T11:40:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:40:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:40:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:40:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:40:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:40:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:40:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:40:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:40:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:40:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:40:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:40:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:40:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:40:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:40:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:40:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:40:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:40:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:40:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:40:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:40:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:40:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:40:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:40:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:40:53.263 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:40:53.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.056+0000 7f49f05ba700 1 -- 172.21.15.80:0/300116911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49cc018730 msgr2=0x7f49cc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:53.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.056+0000 7f49f05ba700 1 --2- 172.21.15.80:0/300116911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49cc018730 0x7f49cc01abc0 crc :-1 s=READY pgs=561 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:53.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.056+0000 7f49f05ba700 1 -- 172.21.15.80:0/300116911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e813e5f0 msgr2=0x7f49e813e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:53.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.056+0000 7f49f05ba700 1 --2- 172.21.15.80:0/300116911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e813e5f0 0x7f49e813e9e0 secure :-1 s=READY pgs=1370 cs=0 l=1 rx=0x7f49d00107d0 tx=0x7f49d0010600).stop 2019-11-28T11:40:53.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.056+0000 7f49f05ba700 1 -- 172.21.15.80:0/300116911 shutdown_connections 2019-11-28T11:40:53.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.056+0000 7f49f05ba700 1 --2- 172.21.15.80:0/300116911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f49cc018730 0x7f49cc01abc0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:53.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.056+0000 7f49f05ba700 1 --2- 172.21.15.80:0/300116911 >> v2:172.21.15.174:3300/0 conn(0x7f49e810a4e0 0x7f49e810c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:53.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.056+0000 7f49f05ba700 1 --2- 172.21.15.80:0/300116911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f49e813e5f0 0x7f49e813e9e0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:53.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.056+0000 7f49f05ba700 1 -- 172.21.15.80:0/300116911 shutdown_connections 2019-11-28T11:40:53.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.056+0000 7f49f05ba700 1 -- 172.21.15.80:0/300116911 wait complete. 2019-11-28T11:40:53.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.056+0000 7f49f05ba700 1 -- 172.21.15.80:0/300116911 >> 172.21.15.80:0/300116911 conn(0x7f49e813d620 msgr2=0x7f49e813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:53.268 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:53.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.354+0000 7f33e2a3a700 1 Processor -- start 2019-11-28T11:40:53.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.354+0000 7f33e2a3a700 1 -- start start 2019-11-28T11:40:53.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.355+0000 7f33e2a3a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f33dc06d120 0x7f33dc165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:53.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.355+0000 7f33e2a3a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33dc06d5a0 con 0x7f33dc06c0a0 2019-11-28T11:40:53.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.355+0000 7f33e2a3a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33dc06db00 con 0x7f33dc06c490 2019-11-28T11:40:53.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.355+0000 7f33e2a3a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33dc06fd60 con 0x7f33dc06d120 2019-11-28T11:40:53.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.355+0000 7f33e17d8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f33dc06d120 0x7f33dc165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:53.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.355+0000 7f33e0fd7700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f33dc06c0a0 0x7f33dc072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37560/0 (socket says 172.21.15.80:37560) 2019-11-28T11:40:53.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.355+0000 7f33e0fd7700 1 -- 172.21.15.80:0/1662145834 learned_addr learned my addr 172.21.15.80:0/1662145834 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:53.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.355+0000 7f33e17d8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f33dc06d120 0x7f33dc165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38248/0 (socket says 172.21.15.80:38248) 2019-11-28T11:40:53.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.356+0000 7f33e17d8700 1 -- 172.21.15.80:0/1662145834 >> v1:172.21.15.174:6789/0 conn(0x7f33dc06c490 legacy=0x7f33dc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:53.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.356+0000 7f33e17d8700 1 -- 172.21.15.80:0/1662145834 >> v1:172.21.15.80:6789/0 conn(0x7f33dc06c0a0 legacy=0x7f33dc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:53.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.356+0000 7f33e17d8700 1 -- 172.21.15.80:0/1662145834 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc0706c0 con 0x7f33dc06d120 2019-11-28T11:40:53.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.356+0000 7f33db7fe700 1 -- 172.21.15.80:0/1662145834 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482355685 0 0) 0x7f33c4001150 con 0x7f33dc06c0a0 2019-11-28T11:40:53.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.356+0000 7f33e17d8700 1 --2- 172.21.15.80:0/1662145834 >> v2:172.21.15.80:3300/0 conn(0x7f33dc06d120 0x7f33dc165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f33d400af50 tx=0x7f33d400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.356+0000 7f33e17d8700 1 --2- 172.21.15.80:0/1662145834 >> v2:172.21.15.80:3300/0 conn(0x7f33dc06d120 0x7f33dc165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f33d400af50 tx=0x7f33d400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.356+0000 7f33e17d8700 1 --2- 172.21.15.80:0/1662145834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc06d120 0x7f33dc165d80 secure :-1 s=READY pgs=1372 cs=0 l=1 rx=0x7f33d400af50 tx=0x7f33d400b760).ready entity=mon.0 client_cookie=90440928045c7d16 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:53.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.356+0000 7f33e17d8700 1 --2- 172.21.15.80:0/1662145834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc06d120 0x7f33dc165d80 secure :-1 s=THROTTLE_DONE pgs=1372 cs=0 l=1 rx=0x7f33d400af50 tx=0x7f33d400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.356+0000 7f33db7fe700 1 -- 172.21.15.80:0/1662145834 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d4009ba0 con 0x7f33dc06d120 2019-11-28T11:40:53.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.356+0000 7f33e17d8700 1 --2- 172.21.15.80:0/1662145834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc06d120 0x7f33dc165d80 secure :-1 s=THROTTLE_DONE pgs=1372 cs=0 l=1 rx=0x7f33d400af50 tx=0x7f33d400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.356+0000 7f33e17d8700 1 --2- 172.21.15.80:0/1662145834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc06d120 0x7f33dc165d80 secure :-1 s=THROTTLE_DONE pgs=1372 cs=0 l=1 rx=0x7f33d400af50 tx=0x7f33d400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.356+0000 7f33db7fe700 1 -- 172.21.15.80:0/1662145834 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d4000a70 con 0x7f33dc06d120 2019-11-28T11:40:53.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.356+0000 7f33db7fe700 1 -- 172.21.15.80:0/1662145834 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d400a180 con 0x7f33dc06d120 2019-11-28T11:40:53.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.356+0000 7f33e2a3a700 1 -- 172.21.15.80:0/1662145834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc06d120 msgr2=0x7f33dc165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:53.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.356+0000 7f33e2a3a700 1 --2- 172.21.15.80:0/1662145834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc06d120 0x7f33dc165d80 secure :-1 s=READY pgs=1372 cs=0 l=1 rx=0x7f33d400af50 tx=0x7f33d400b760).stop 2019-11-28T11:40:53.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.357+0000 7f33e2a3a700 1 -- 172.21.15.80:0/1662145834 shutdown_connections 2019-11-28T11:40:53.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.357+0000 7f33e2a3a700 1 --2- 172.21.15.80:0/1662145834 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc06d120 0x7f33dc165d80 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:53.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.357+0000 7f33e2a3a700 1 -- 172.21.15.80:0/1662145834 shutdown_connections 2019-11-28T11:40:53.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.357+0000 7f33e2a3a700 1 -- 172.21.15.80:0/1662145834 wait complete. 2019-11-28T11:40:53.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.357+0000 7f33e2a3a700 1 -- 172.21.15.80:0/1662145834 >> 172.21.15.80:0/1662145834 conn(0x7f33dc061cf0 msgr2=0x7f33dc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:53.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.359+0000 7f33e2a3a700 1 Processor -- start 2019-11-28T11:40:53.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.359+0000 7f33e2a3a700 1 -- start start 2019-11-28T11:40:53.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.360+0000 7f33e2a3a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f33dc12cea0 0x7f33dc111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:53.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.360+0000 7f33e2a3a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33dc1230e0 0x7f33dc123570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:53.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.360+0000 7f33e2a3a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f33dc123ab0 0x7f33dc12d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:53.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.360+0000 7f33e2a3a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33dc121040 con 0x7f33dc12cea0 2019-11-28T11:40:53.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.360+0000 7f33e2a3a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33dc121310 con 0x7f33dc123ab0 2019-11-28T11:40:53.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.360+0000 7f33e2a3a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc120610 con 0x7f33dc1230e0 2019-11-28T11:40:53.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.360+0000 7f33e0fd7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f33dc12cea0 0x7f33dc111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:53.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.360+0000 7f33e0fd7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f33dc12cea0 0x7f33dc111db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38250/0 (socket says 172.21.15.80:38250) 2019-11-28T11:40:53.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.360+0000 7f33e0fd7700 1 -- 172.21.15.80:0/1458349480 learned_addr learned my addr 172.21.15.80:0/1458349480 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:53.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33dbfff700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33dc1230e0 0x7f33dc123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:53.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33e0fd7700 1 -- 172.21.15.80:0/1458349480 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33dc1230e0 msgr2=0x7f33dc123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:53.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33e0fd7700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33dc1230e0 0x7f33dc123570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:53.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33e0fd7700 1 -- 172.21.15.80:0/1458349480 >> v2:172.21.15.174:3300/0 conn(0x7f33dc123ab0 msgr2=0x7f33dc12d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:53.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33e17d8700 1 --2- 172.21.15.80:0/1458349480 >> v2:172.21.15.174:3300/0 conn(0x7f33dc123ab0 0x7f33dc12d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:53.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33e0fd7700 1 --2- 172.21.15.80:0/1458349480 >> v2:172.21.15.174:3300/0 conn(0x7f33dc123ab0 0x7f33dc12d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:53.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33e0fd7700 1 -- 172.21.15.80:0/1458349480 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc1219a0 con 0x7f33dc12cea0 2019-11-28T11:40:53.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33e0fd7700 1 --2- 172.21.15.80:0/1458349480 >> v2:172.21.15.80:3300/0 conn(0x7f33dc12cea0 0x7f33dc111db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f33c40103b0 tx=0x7f33c4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33e0fd7700 1 --2- 172.21.15.80:0/1458349480 >> v2:172.21.15.80:3300/0 conn(0x7f33dc12cea0 0x7f33dc111db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f33c40103b0 tx=0x7f33c4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33e0fd7700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc12cea0 0x7f33dc111db0 secure :-1 s=READY pgs=1373 cs=0 l=1 rx=0x7f33c40103b0 tx=0x7f33c4010260).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:53.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33e0fd7700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc12cea0 0x7f33dc111db0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7f33c40103b0 tx=0x7f33c4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33d97fa700 1 -- 172.21.15.80:0/1458349480 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33c4000ef0 con 0x7f33dc12cea0 2019-11-28T11:40:53.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33e0fd7700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc12cea0 0x7f33dc111db0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7f33c40103b0 tx=0x7f33c4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33d97fa700 1 -- 172.21.15.80:0/1458349480 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c4004430 con 0x7f33dc12cea0 2019-11-28T11:40:53.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33e0fd7700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc12cea0 0x7f33dc111db0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7f33c40103b0 tx=0x7f33c4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33e2a3a700 1 -- 172.21.15.80:0/1458349480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33dc121d20 con 0x7f33dc12cea0 2019-11-28T11:40:53.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33d97fa700 1 -- 172.21.15.80:0/1458349480 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33c4004620 con 0x7f33dc12cea0 2019-11-28T11:40:53.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33e2a3a700 1 -- 172.21.15.80:0/1458349480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33dc1122f0 con 0x7f33dc12cea0 2019-11-28T11:40:53.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.361+0000 7f33e0fd7700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc12cea0 0x7f33dc111db0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7f33c40103b0 tx=0x7f33c4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.362+0000 7f33d97fa700 1 -- 172.21.15.80:0/1458349480 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f33c4004620 con 0x7f33dc12cea0 2019-11-28T11:40:53.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.362+0000 7f33e0fd7700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc12cea0 0x7f33dc111db0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7f33c40103b0 tx=0x7f33c4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.362+0000 7f33d97fa700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f33c0018730 0x7f33c001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:53.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.362+0000 7f33d97fa700 1 -- 172.21.15.80:0/1458349480 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f33c4031c80 con 0x7f33dc12cea0 2019-11-28T11:40:53.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.362+0000 7f33dbfff700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f33c0018730 0x7f33c001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:53.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.362+0000 7f33dbfff700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f33c0018730 0x7f33c001abc0 crc :-1 s=READY pgs=562 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:53.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.370+0000 7f33e2a3a700 1 -- 172.21.15.80:0/1458349480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33dc1219a0 con 0x7f33dc12cea0 2019-11-28T11:40:53.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.373+0000 7f33e0fd7700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc12cea0 0x7f33dc111db0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7f33c40103b0 tx=0x7f33c4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.373+0000 7f33d97fa700 1 -- 172.21.15.80:0/1458349480 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f33c40012b0 con 0x7f33dc12cea0 2019-11-28T11:40:53.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.544+0000 7f33e2a3a700 1 -- 172.21.15.80:0/1458349480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33dc121d20 con 0x7f33dc12cea0 2019-11-28T11:40:53.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.544+0000 7f33e0fd7700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc12cea0 0x7f33dc111db0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7f33c40103b0 tx=0x7f33c4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.544+0000 7f33d97fa700 1 -- 172.21.15.80:0/1458349480 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+1427 (secure 0 0 0) 0x7f33c401fe50 con 0x7f33dc12cea0 2019-11-28T11:40:53.578 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 68 2019-11-28T11:40:53.578 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:53.578 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:40:52.698170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:53.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.547+0000 7f33e2a3a700 1 -- 172.21.15.80:0/1458349480 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f33c0018730 msgr2=0x7f33c001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:53.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.547+0000 7f33e2a3a700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f33c0018730 0x7f33c001abc0 crc :-1 s=READY pgs=562 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:53.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.547+0000 7f33e2a3a700 1 -- 172.21.15.80:0/1458349480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc12cea0 msgr2=0x7f33dc111db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:53.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.547+0000 7f33e2a3a700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc12cea0 0x7f33dc111db0 secure :-1 s=READY pgs=1373 cs=0 l=1 rx=0x7f33c40103b0 tx=0x7f33c4010260).stop 2019-11-28T11:40:53.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.547+0000 7f33e2a3a700 1 -- 172.21.15.80:0/1458349480 shutdown_connections 2019-11-28T11:40:53.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.547+0000 7f33e2a3a700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f33c0018730 0x7f33c001abc0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:53.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.547+0000 7f33e2a3a700 1 --2- 172.21.15.80:0/1458349480 >> v2:172.21.15.174:3300/0 conn(0x7f33dc123ab0 0x7f33dc12d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:53.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.547+0000 7f33e2a3a700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33dc1230e0 0x7f33dc123570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:53.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.547+0000 7f33e2a3a700 1 --2- 172.21.15.80:0/1458349480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33dc12cea0 0x7f33dc111db0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:53.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.547+0000 7f33e2a3a700 1 -- 172.21.15.80:0/1458349480 shutdown_connections 2019-11-28T11:40:53.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.547+0000 7f33e2a3a700 1 -- 172.21.15.80:0/1458349480 wait complete. 2019-11-28T11:40:53.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.547+0000 7f33e2a3a700 1 -- 172.21.15.80:0/1458349480 >> 172.21.15.80:0/1458349480 conn(0x7f33dc1426c0 msgr2=0x7f33dc110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:53.590 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:40:53.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.680+0000 7f351acbb700 1 Processor -- start 2019-11-28T11:40:53.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.680+0000 7f351acbb700 1 -- start start 2019-11-28T11:40:53.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.681+0000 7f351acbb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f351406c0a0 0x7f3514072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:53.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.681+0000 7f351acbb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35140734e0 0x7f3514071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:53.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.681+0000 7f351acbb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3514072360 0x7f35140727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:53.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.681+0000 7f351acbb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351406f330 con 0x7f35140734e0 2019-11-28T11:40:53.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.681+0000 7f351acbb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35140706c0 con 0x7f3514072360 2019-11-28T11:40:53.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.681+0000 7f351acbb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3514070a40 con 0x7f351406c0a0 2019-11-28T11:40:53.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.681+0000 7f3518a57700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35140734e0 0x7f3514071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:53.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.681+0000 7f3518a57700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35140734e0 0x7f3514071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38262/0 (socket says 172.21.15.80:38262) 2019-11-28T11:40:53.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.681+0000 7f3518a57700 1 -- 172.21.15.80:0/3432000991 learned_addr learned my addr 172.21.15.80:0/3432000991 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:53.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.681+0000 7f3519258700 1 --2- 172.21.15.80:0/3432000991 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f351406c0a0 0x7f3514072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:53.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.681+0000 7f3519a59700 1 --2- 172.21.15.80:0/3432000991 >> v2:172.21.15.174:3300/0 conn(0x7f3514072360 0x7f35140727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:53.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.682+0000 7f3518a57700 1 -- 172.21.15.80:0/3432000991 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f351406c0a0 msgr2=0x7f3514072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.682+0000 7f3518a57700 1 --2- 172.21.15.80:0/3432000991 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f351406c0a0 0x7f3514072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.682+0000 7f3518a57700 1 -- 172.21.15.80:0/3432000991 >> v2:172.21.15.174:3300/0 conn(0x7f3514072360 msgr2=0x7f35140727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.682+0000 7f3518a57700 1 --2- 172.21.15.80:0/3432000991 >> v2:172.21.15.174:3300/0 conn(0x7f3514072360 0x7f35140727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:53.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.682+0000 7f3518a57700 1 -- 172.21.15.80:0/3432000991 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351406db00 con 0x7f35140734e0 2019-11-28T11:40:53.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.682+0000 7f3518a57700 1 --2- 172.21.15.80:0/3432000991 >> v2:172.21.15.80:3300/0 conn(0x7f35140734e0 0x7f3514071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f350400f6c0 tx=0x7f350400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.682+0000 7f3518a57700 1 --2- 172.21.15.80:0/3432000991 >> v2:172.21.15.80:3300/0 conn(0x7f35140734e0 0x7f3514071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f350400f6c0 tx=0x7f350400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.682+0000 7f3518a57700 1 --2- 172.21.15.80:0/3432000991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35140734e0 0x7f3514071e20 secure :-1 s=READY pgs=1374 cs=0 l=1 rx=0x7f350400f6c0 tx=0x7f350400f570).ready entity=mon.0 client_cookie=5ef1750800b0544c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:53.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.682+0000 7f3518a57700 1 --2- 172.21.15.80:0/3432000991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35140734e0 0x7f3514071e20 secure :-1 s=THROTTLE_DONE pgs=1374 cs=0 l=1 rx=0x7f350400f6c0 tx=0x7f350400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.682+0000 7f3518a57700 1 --2- 172.21.15.80:0/3432000991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35140734e0 0x7f3514071e20 secure :-1 s=THROTTLE_DONE pgs=1374 cs=0 l=1 rx=0x7f350400f6c0 tx=0x7f350400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.682+0000 7f3513fff700 1 -- 172.21.15.80:0/3432000991 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3504000960 con 0x7f35140734e0 2019-11-28T11:40:53.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.682+0000 7f3518a57700 1 --2- 172.21.15.80:0/3432000991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35140734e0 0x7f3514071e20 secure :-1 s=THROTTLE_DONE pgs=1374 cs=0 l=1 rx=0x7f350400f6c0 tx=0x7f350400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.682+0000 7f3513fff700 1 -- 172.21.15.80:0/3432000991 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3504000c90 con 0x7f35140734e0 2019-11-28T11:40:53.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.682+0000 7f3513fff700 1 -- 172.21.15.80:0/3432000991 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35040013a0 con 0x7f35140734e0 2019-11-28T11:40:53.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.682+0000 7f351acbb700 1 -- 172.21.15.80:0/3432000991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35140734e0 msgr2=0x7f3514071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:53.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.682+0000 7f351acbb700 1 --2- 172.21.15.80:0/3432000991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35140734e0 0x7f3514071e20 secure :-1 s=READY pgs=1374 cs=0 l=1 rx=0x7f350400f6c0 tx=0x7f350400f570).stop 2019-11-28T11:40:53.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.683+0000 7f351acbb700 1 -- 172.21.15.80:0/3432000991 shutdown_connections 2019-11-28T11:40:53.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.683+0000 7f351acbb700 1 --2- 172.21.15.80:0/3432000991 >> v2:172.21.15.174:3300/0 conn(0x7f3514072360 0x7f35140727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:53.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.683+0000 7f351acbb700 1 --2- 172.21.15.80:0/3432000991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35140734e0 0x7f3514071e20 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:53.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.683+0000 7f351acbb700 1 --2- 172.21.15.80:0/3432000991 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f351406c0a0 0x7f3514072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:53.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.683+0000 7f351acbb700 1 -- 172.21.15.80:0/3432000991 shutdown_connections 2019-11-28T11:40:53.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.683+0000 7f351acbb700 1 -- 172.21.15.80:0/3432000991 wait complete. 2019-11-28T11:40:53.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.683+0000 7f351acbb700 1 -- 172.21.15.80:0/3432000991 >> 172.21.15.80:0/3432000991 conn(0x7f3514061cf0 msgr2=0x7f3514064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:53.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.685+0000 7f351acbb700 1 Processor -- start 2019-11-28T11:40:53.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.685+0000 7f351acbb700 1 -- start start 2019-11-28T11:40:53.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.686+0000 7f351acbb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f351413a780 0x7f351412d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:53.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.686+0000 7f351acbb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3514139a60 con 0x7f351412cb00 2019-11-28T11:40:53.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.686+0000 7f351acbb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351413b060 con 0x7f351412d9c0 2019-11-28T11:40:53.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.686+0000 7f351acbb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351412a260 con 0x7f351413a780 2019-11-28T11:40:53.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.686+0000 7f3519258700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f351413a780 0x7f351412d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:53.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.686+0000 7f3519a59700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f351412cb00 0x7f3514167d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37584/0 (socket says 172.21.15.80:37584) 2019-11-28T11:40:53.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.686+0000 7f3519258700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f351413a780 0x7f351412d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38264/0 (socket says 172.21.15.80:38264) 2019-11-28T11:40:53.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.686+0000 7f3519a59700 1 -- 172.21.15.80:0/3196622143 learned_addr learned my addr 172.21.15.80:0/3196622143 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:53.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.687+0000 7f3519258700 1 -- 172.21.15.80:0/3196622143 >> v1:172.21.15.174:6789/0 conn(0x7f351412d9c0 legacy=0x7f351412c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:53.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.687+0000 7f3519258700 1 -- 172.21.15.80:0/3196622143 >> v1:172.21.15.80:6789/0 conn(0x7f351412cb00 legacy=0x7f3514167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:53.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.687+0000 7f3519258700 1 -- 172.21.15.80:0/3196622143 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351412abc0 con 0x7f351413a780 2019-11-28T11:40:53.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.687+0000 7f3511ffb700 1 -- 172.21.15.80:0/3196622143 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32522229 0 0) 0x7f350c001150 con 0x7f351412cb00 2019-11-28T11:40:53.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.687+0000 7f3519258700 1 --2- 172.21.15.80:0/3196622143 >> v2:172.21.15.80:3300/0 conn(0x7f351413a780 0x7f351412d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f34fc010710 tx=0x7f34fc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.687+0000 7f3519258700 1 --2- 172.21.15.80:0/3196622143 >> v2:172.21.15.80:3300/0 conn(0x7f351413a780 0x7f351412d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f34fc010710 tx=0x7f34fc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.687+0000 7f3519258700 1 --2- 172.21.15.80:0/3196622143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f351413a780 0x7f351412d480 secure :-1 s=READY pgs=1376 cs=0 l=1 rx=0x7f34fc010710 tx=0x7f34fc010ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:53.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.687+0000 7f3519258700 1 --2- 172.21.15.80:0/3196622143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f351413a780 0x7f351412d480 secure :-1 s=THROTTLE_DONE pgs=1376 cs=0 l=1 rx=0x7f34fc010710 tx=0x7f34fc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.687+0000 7f3511ffb700 1 -- 172.21.15.80:0/3196622143 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34fc005af0 con 0x7f351413a780 2019-11-28T11:40:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.687+0000 7f3519258700 1 --2- 172.21.15.80:0/3196622143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f351413a780 0x7f351412d480 secure :-1 s=THROTTLE_DONE pgs=1376 cs=0 l=1 rx=0x7f34fc010710 tx=0x7f34fc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.687+0000 7f3519258700 1 --2- 172.21.15.80:0/3196622143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f351413a780 0x7f351412d480 secure :-1 s=THROTTLE_DONE pgs=1376 cs=0 l=1 rx=0x7f34fc010710 tx=0x7f34fc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.687+0000 7f3511ffb700 1 -- 172.21.15.80:0/3196622143 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc005710 con 0x7f351413a780 2019-11-28T11:40:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.687+0000 7f351acbb700 1 -- 172.21.15.80:0/3196622143 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351412af40 con 0x7f351413a780 2019-11-28T11:40:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.687+0000 7f3511ffb700 1 -- 172.21.15.80:0/3196622143 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34fc0060d0 con 0x7f351413a780 2019-11-28T11:40:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.687+0000 7f351acbb700 1 -- 172.21.15.80:0/3196622143 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351412abc0 con 0x7f351413a780 2019-11-28T11:40:53.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.687+0000 7f3519258700 1 --2- 172.21.15.80:0/3196622143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f351413a780 0x7f351412d480 secure :-1 s=THROTTLE_DONE pgs=1376 cs=0 l=1 rx=0x7f34fc010710 tx=0x7f34fc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.688+0000 7f3511ffb700 1 -- 172.21.15.80:0/3196622143 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f34fc005900 con 0x7f351413a780 2019-11-28T11:40:53.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.688+0000 7f3519258700 1 --2- 172.21.15.80:0/3196622143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f351413a780 0x7f351412d480 secure :-1 s=THROTTLE_DONE pgs=1376 cs=0 l=1 rx=0x7f34fc010710 tx=0x7f34fc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.688+0000 7f3511ffb700 1 --2- 172.21.15.80:0/3196622143 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f34f8018730 0x7f34f801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:53.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.688+0000 7f3511ffb700 1 -- 172.21.15.80:0/3196622143 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f34fc031ea0 con 0x7f351413a780 2019-11-28T11:40:53.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.688+0000 7f3518a57700 1 --2- 172.21.15.80:0/3196622143 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f34f8018730 0x7f34f801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:53.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.688+0000 7f3518a57700 1 --2- 172.21.15.80:0/3196622143 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f34f8018730 0x7f34f801abc0 crc :-1 s=READY pgs=563 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:53.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.695+0000 7f351acbb700 1 -- 172.21.15.80:0/3196622143 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351412af40 con 0x7f351413a780 2019-11-28T11:40:53.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.699+0000 7f3519258700 1 --2- 172.21.15.80:0/3196622143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f351413a780 0x7f351412d480 secure :-1 s=THROTTLE_DONE pgs=1376 cs=0 l=1 rx=0x7f34fc010710 tx=0x7f34fc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:53.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.699+0000 7f3511ffb700 1 -- 172.21.15.80:0/3196622143 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f34fc005500 con 0x7f351413a780 2019-11-28T11:40:53.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:53.864+0000 7f351acbb700 1 -- 172.21.15.80:0/3196622143 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f351412abc0 con 0x7f351413a780 2019-11-28T11:40:54.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.712+0000 7f3519258700 1 --2- 172.21.15.80:0/3196622143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f351413a780 0x7f351412d480 secure :-1 s=THROTTLE_DONE pgs=1376 cs=0 l=1 rx=0x7f34fc010710 tx=0x7f34fc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:54.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.712+0000 7f3511ffb700 1 -- 172.21.15.80:0/3196622143 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) v1 ==== 161+0+0 (secure 0 0 0) 0x7f34fc017910 con 0x7f351413a780 2019-11-28T11:40:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:40:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.732+0000 7f351acbb700 1 -- 172.21.15.80:0/3196622143 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f34f8018730 msgr2=0x7f34f801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.732+0000 7f351acbb700 1 --2- 172.21.15.80:0/3196622143 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f34f8018730 0x7f34f801abc0 crc :-1 s=READY pgs=563 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.732+0000 7f351acbb700 1 -- 172.21.15.80:0/3196622143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f351413a780 msgr2=0x7f351412d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.732+0000 7f351acbb700 1 --2- 172.21.15.80:0/3196622143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f351413a780 0x7f351412d480 secure :-1 s=READY pgs=1376 cs=0 l=1 rx=0x7f34fc010710 tx=0x7f34fc010ab0).stop 2019-11-28T11:40:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.732+0000 7f351acbb700 1 -- 172.21.15.80:0/3196622143 shutdown_connections 2019-11-28T11:40:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.732+0000 7f351acbb700 1 --2- 172.21.15.80:0/3196622143 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f34f8018730 0x7f34f801abc0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.732+0000 7f351acbb700 1 --2- 172.21.15.80:0/3196622143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f351413a780 0x7f351412d480 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.732+0000 7f351acbb700 1 -- 172.21.15.80:0/3196622143 shutdown_connections 2019-11-28T11:40:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.732+0000 7f351acbb700 1 -- 172.21.15.80:0/3196622143 wait complete. 2019-11-28T11:40:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.732+0000 7f351acbb700 1 -- 172.21.15.80:0/3196622143 >> 172.21.15.80:0/3196622143 conn(0x7f3514127dc0 msgr2=0x7f3514141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:54.774 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:40:54.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.860+0000 7ff474ed0700 1 Processor -- start 2019-11-28T11:40:54.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.860+0000 7ff474ed0700 1 -- start start 2019-11-28T11:40:54.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.861+0000 7ff474ed0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff47006d120 0x7ff470165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:54.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.861+0000 7ff474ed0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47006d5a0 con 0x7ff47006c490 2019-11-28T11:40:54.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.861+0000 7ff474ed0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47006db00 con 0x7ff47006c0a0 2019-11-28T11:40:54.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.861+0000 7ff474ed0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47006fd60 con 0x7ff47006d120 2019-11-28T11:40:54.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.861+0000 7ff46e59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff47006c490 0x7ff47006c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37592/0 (socket says 172.21.15.80:37592) 2019-11-28T11:40:54.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.861+0000 7ff46e59c700 1 -- 172.21.15.80:0/1533441896 learned_addr learned my addr 172.21.15.80:0/1533441896 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:54.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.861+0000 7ff46f59e700 1 --2- 172.21.15.80:0/1533441896 >> v2:172.21.15.174:3300/0 conn(0x7ff47006d120 0x7ff470165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:54.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.861+0000 7ff46dd9b700 1 -- 172.21.15.80:0/1533441896 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432122394 0 0) 0x7ff464001100 con 0x7ff47006c490 2019-11-28T11:40:54.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46dd9b700 1 -- 172.21.15.80:0/1533441896 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff458002e80 con 0x7ff47006c490 2019-11-28T11:40:54.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46dd9b700 1 -- 172.21.15.80:0/1533441896 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3631750292 0 0) 0x7ff4640010e0 con 0x7ff47006c490 2019-11-28T11:40:54.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46dd9b700 1 -- 172.21.15.80:0/1533441896 >> v2:172.21.15.174:3300/0 conn(0x7ff47006d120 msgr2=0x7ff470165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:54.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46dd9b700 1 --2- 172.21.15.80:0/1533441896 >> v2:172.21.15.174:3300/0 conn(0x7ff47006d120 0x7ff470165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:54.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46dd9b700 1 -- 172.21.15.80:0/1533441896 >> v1:172.21.15.174:6789/0 conn(0x7ff47006c0a0 legacy=0x7ff470072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:54.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46dd9b700 1 -- 172.21.15.80:0/1533441896 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4700706c0 con 0x7ff47006c490 2019-11-28T11:40:54.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46dd9b700 1 -- 172.21.15.80:0/1533441896 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff464001610 con 0x7ff47006c490 2019-11-28T11:40:54.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46dd9b700 1 -- 172.21.15.80:0/1533441896 >> v1:172.21.15.80:6789/0 conn(0x7ff47006c490 legacy=0x7ff47006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:54.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46dd9b700 1 --2- 172.21.15.80:0/1533441896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff458003b20 0x7ff458005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:54.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46dd9b700 1 --2- 172.21.15.80:0/1533441896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff458006730 0x7ff458008be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:54.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46dd9b700 1 --2- 172.21.15.80:0/1533441896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff458009440 0x7ff45800b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:54.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46dd9b700 1 -- 172.21.15.80:0/1533441896 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45800c0c0 con 0x7ff458009440 2019-11-28T11:40:54.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46dd9b700 1 -- 172.21.15.80:0/1533441896 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4580502c0 con 0x7ff458006730 2019-11-28T11:40:54.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46dd9b700 1 -- 172.21.15.80:0/1533441896 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4580504f0 con 0x7ff458003b20 2019-11-28T11:40:54.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46f59e700 1 --2- 172.21.15.80:0/1533441896 >> v2:172.21.15.174:3300/0 conn(0x7ff47006d120 0x7ff470165d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:40:54.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46f59e700 1 --2- 172.21.15.80:0/1533441896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff458009440 0x7ff45800b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:54.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46ed9d700 1 --2- 172.21.15.80:0/1533441896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff458003b20 0x7ff458005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:54.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46e59c700 1 --2- 172.21.15.80:0/1533441896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff458006730 0x7ff458008be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:54.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46f59e700 1 -- 172.21.15.80:0/1533441896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff458003b20 msgr2=0x7ff458005f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:54.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46f59e700 1 --2- 172.21.15.80:0/1533441896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff458003b20 0x7ff458005f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:54.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46f59e700 1 -- 172.21.15.80:0/1533441896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff458006730 msgr2=0x7ff458008be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:54.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46f59e700 1 --2- 172.21.15.80:0/1533441896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff458006730 0x7ff458008be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:54.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46f59e700 1 -- 172.21.15.80:0/1533441896 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4580507a0 con 0x7ff458009440 2019-11-28T11:40:54.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46f59e700 1 --2- 172.21.15.80:0/1533441896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff458009440 0x7ff45800b910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff46800d5c0 tx=0x7ff46800d850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:54.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46f59e700 1 -- 172.21.15.80:0/1533441896 reap_dead start 2019-11-28T11:40:54.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46f59e700 1 --2- 172.21.15.80:0/1533441896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff458009440 0x7ff45800b910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff46800d5c0 tx=0x7ff46800d850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:54.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.862+0000 7ff46f59e700 1 --2- 172.21.15.80:0/1533441896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff458009440 0x7ff45800b910 secure :-1 s=READY pgs=1378 cs=0 l=1 rx=0x7ff46800d5c0 tx=0x7ff46800d850).ready entity=mon.0 client_cookie=3bd8029cd5c7d911 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:54.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.863+0000 7ff46f59e700 1 --2- 172.21.15.80:0/1533441896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff458009440 0x7ff45800b910 secure :-1 s=THROTTLE_DONE pgs=1378 cs=0 l=1 rx=0x7ff46800d5c0 tx=0x7ff46800d850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:54.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.863+0000 7ff46dd9b700 1 -- 172.21.15.80:0/1533441896 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff468000a70 con 0x7ff458009440 2019-11-28T11:40:54.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.863+0000 7ff46f59e700 1 --2- 172.21.15.80:0/1533441896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff458009440 0x7ff45800b910 secure :-1 s=THROTTLE_DONE pgs=1378 cs=0 l=1 rx=0x7ff46800d5c0 tx=0x7ff46800d850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:54.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.863+0000 7ff46f59e700 1 --2- 172.21.15.80:0/1533441896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff458009440 0x7ff45800b910 secure :-1 s=THROTTLE_DONE pgs=1378 cs=0 l=1 rx=0x7ff46800d5c0 tx=0x7ff46800d850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:54.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.863+0000 7ff46dd9b700 1 -- 172.21.15.80:0/1533441896 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff468009bc0 con 0x7ff458009440 2019-11-28T11:40:54.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.863+0000 7ff46dd9b700 1 -- 172.21.15.80:0/1533441896 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4680095b0 con 0x7ff458009440 2019-11-28T11:40:54.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.863+0000 7ff474ed0700 1 -- 172.21.15.80:0/1533441896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff458009440 msgr2=0x7ff45800b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:54.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.863+0000 7ff474ed0700 1 --2- 172.21.15.80:0/1533441896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff458009440 0x7ff45800b910 secure :-1 s=READY pgs=1378 cs=0 l=1 rx=0x7ff46800d5c0 tx=0x7ff46800d850).stop 2019-11-28T11:40:54.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.863+0000 7ff474ed0700 1 -- 172.21.15.80:0/1533441896 shutdown_connections 2019-11-28T11:40:54.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.863+0000 7ff474ed0700 1 --2- 172.21.15.80:0/1533441896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff458009440 0x7ff45800b910 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:54.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.863+0000 7ff474ed0700 1 -- 172.21.15.80:0/1533441896 shutdown_connections 2019-11-28T11:40:54.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.863+0000 7ff474ed0700 1 -- 172.21.15.80:0/1533441896 wait complete. 2019-11-28T11:40:54.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.863+0000 7ff474ed0700 1 -- 172.21.15.80:0/1533441896 >> 172.21.15.80:0/1533441896 conn(0x7ff470061cf0 msgr2=0x7ff470064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:54.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.866+0000 7ff474ed0700 1 Processor -- start 2019-11-28T11:40:54.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.866+0000 7ff474ed0700 1 -- start start 2019-11-28T11:40:54.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff474ed0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff470140070 0x7ff470114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:54.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff474ed0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47015b940 con 0x7ff470113ce0 2019-11-28T11:40:54.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff474ed0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47012c640 con 0x7ff470114980 2019-11-28T11:40:54.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff474ed0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff470114140 con 0x7ff470140070 2019-11-28T11:40:54.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff46ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff470140070 0x7ff470114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:54.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff46ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff470140070 0x7ff470114440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38284/0 (socket says 172.21.15.80:38284) 2019-11-28T11:40:54.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff46ed9d700 1 -- 172.21.15.80:0/3447152316 learned_addr learned my addr 172.21.15.80:0/3447152316 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:54.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff46ed9d700 1 -- 172.21.15.80:0/3447152316 >> v1:172.21.15.174:6789/0 conn(0x7ff470114980 legacy=0x7ff4701134e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:54.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff46ed9d700 1 -- 172.21.15.80:0/3447152316 >> v1:172.21.15.80:6789/0 conn(0x7ff470113ce0 legacy=0x7ff470168c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:54.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff46ed9d700 1 -- 172.21.15.80:0/3447152316 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47015a200 con 0x7ff470140070 2019-11-28T11:40:54.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff46ed9d700 1 --2- 172.21.15.80:0/3447152316 >> v2:172.21.15.80:3300/0 conn(0x7ff470140070 0x7ff470114440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4600107b0 tx=0x7ff460010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:54.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff46ed9d700 1 --2- 172.21.15.80:0/3447152316 >> v2:172.21.15.80:3300/0 conn(0x7ff470140070 0x7ff470114440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4600107b0 tx=0x7ff460010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:54.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff46ed9d700 1 --2- 172.21.15.80:0/3447152316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470140070 0x7ff470114440 secure :-1 s=READY pgs=1380 cs=0 l=1 rx=0x7ff4600107b0 tx=0x7ff460010b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:54.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff46ed9d700 1 --2- 172.21.15.80:0/3447152316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470140070 0x7ff470114440 secure :-1 s=THROTTLE_DONE pgs=1380 cs=0 l=1 rx=0x7ff4600107b0 tx=0x7ff460010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:54.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff45f7fe700 1 -- 172.21.15.80:0/3447152316 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff460000cc0 con 0x7ff470140070 2019-11-28T11:40:54.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff46ed9d700 1 --2- 172.21.15.80:0/3447152316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470140070 0x7ff470114440 secure :-1 s=THROTTLE_DONE pgs=1380 cs=0 l=1 rx=0x7ff4600107b0 tx=0x7ff460010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:54.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff46ed9d700 1 --2- 172.21.15.80:0/3447152316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470140070 0x7ff470114440 secure :-1 s=THROTTLE_DONE pgs=1380 cs=0 l=1 rx=0x7ff4600107b0 tx=0x7ff460010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:54.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff45f7fe700 1 -- 172.21.15.80:0/3447152316 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff460001210 con 0x7ff470140070 2019-11-28T11:40:54.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff474ed0700 1 -- 172.21.15.80:0/3447152316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47015a580 con 0x7ff470140070 2019-11-28T11:40:54.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff45f7fe700 1 -- 172.21.15.80:0/3447152316 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4600018a0 con 0x7ff470140070 2019-11-28T11:40:54.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.867+0000 7ff474ed0700 1 -- 172.21.15.80:0/3447152316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47015a200 con 0x7ff470140070 2019-11-28T11:40:54.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.868+0000 7ff46ed9d700 1 --2- 172.21.15.80:0/3447152316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470140070 0x7ff470114440 secure :-1 s=THROTTLE_DONE pgs=1380 cs=0 l=1 rx=0x7ff4600107b0 tx=0x7ff460010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:54.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.868+0000 7ff45f7fe700 1 -- 172.21.15.80:0/3447152316 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff460001400 con 0x7ff470140070 2019-11-28T11:40:54.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.868+0000 7ff46ed9d700 1 --2- 172.21.15.80:0/3447152316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470140070 0x7ff470114440 secure :-1 s=THROTTLE_DONE pgs=1380 cs=0 l=1 rx=0x7ff4600107b0 tx=0x7ff460010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:54.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.868+0000 7ff45f7fe700 1 --2- 172.21.15.80:0/3447152316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff454018730 0x7ff45401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:54.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.868+0000 7ff45f7fe700 1 -- 172.21.15.80:0/3447152316 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6235+0+0 (secure 0 0 0) 0x7ff460031f30 con 0x7ff470140070 2019-11-28T11:40:54.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.868+0000 7ff46e59c700 1 --2- 172.21.15.80:0/3447152316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff454018730 0x7ff45401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:54.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.869+0000 7ff46e59c700 1 --2- 172.21.15.80:0/3447152316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff454018730 0x7ff45401abc0 crc :-1 s=READY pgs=564 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:54.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.875+0000 7ff474ed0700 1 -- 172.21.15.80:0/3447152316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47015a580 con 0x7ff470140070 2019-11-28T11:40:54.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.879+0000 7ff46ed9d700 1 --2- 172.21.15.80:0/3447152316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470140070 0x7ff470114440 secure :-1 s=THROTTLE_DONE pgs=1380 cs=0 l=1 rx=0x7ff4600107b0 tx=0x7ff460010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:54.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:54.879+0000 7ff45f7fe700 1 -- 172.21.15.80:0/3447152316 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff4600095d0 con 0x7ff470140070 2019-11-28T11:40:55.028 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:40:55.033 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:40:55.038 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:40:55.043 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:40:55.047 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:40:55.052 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:40:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.056+0000 7ff474ed0700 1 -- 172.21.15.80:0/3447152316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff47015a200 con 0x7ff470140070 2019-11-28T11:40:55.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.057+0000 7ff46ed9d700 1 --2- 172.21.15.80:0/3447152316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470140070 0x7ff470114440 secure :-1 s=THROTTLE_DONE pgs=1380 cs=0 l=1 rx=0x7ff4600107b0 tx=0x7ff460010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.057+0000 7ff45f7fe700 1 -- 172.21.15.80:0/3447152316 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+1427 (secure 0 0 0) 0x7ff460001dd0 con 0x7ff470140070 2019-11-28T11:40:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 69 2019-11-28T11:40:55.092 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:55.092 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":69,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":69,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:37:03.205339+0000","modified":"2019-11-28T11:40:54.707781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2019-11-28T11:40:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.059+0000 7ff474ed0700 1 -- 172.21.15.80:0/3447152316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff454018730 msgr2=0x7ff45401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:55.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.059+0000 7ff474ed0700 1 --2- 172.21.15.80:0/3447152316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff454018730 0x7ff45401abc0 crc :-1 s=READY pgs=564 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:55.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.059+0000 7ff474ed0700 1 -- 172.21.15.80:0/3447152316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470140070 msgr2=0x7ff470114440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:55.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.059+0000 7ff474ed0700 1 --2- 172.21.15.80:0/3447152316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470140070 0x7ff470114440 secure :-1 s=READY pgs=1380 cs=0 l=1 rx=0x7ff4600107b0 tx=0x7ff460010b50).stop 2019-11-28T11:40:55.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.059+0000 7ff474ed0700 1 -- 172.21.15.80:0/3447152316 shutdown_connections 2019-11-28T11:40:55.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.059+0000 7ff474ed0700 1 --2- 172.21.15.80:0/3447152316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff454018730 0x7ff45401abc0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:55.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.059+0000 7ff474ed0700 1 --2- 172.21.15.80:0/3447152316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff470140070 0x7ff470114440 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:55.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.059+0000 7ff474ed0700 1 -- 172.21.15.80:0/3447152316 shutdown_connections 2019-11-28T11:40:55.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.059+0000 7ff474ed0700 1 -- 172.21.15.80:0/3447152316 wait complete. 2019-11-28T11:40:55.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.059+0000 7ff474ed0700 1 -- 172.21.15.80:0/3447152316 >> 172.21.15.80:0/3447152316 conn(0x7ff47014feb0 msgr2=0x7ff47010c740 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:55.107 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:40:55.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.199+0000 7faad035d700 1 Processor -- start 2019-11-28T11:40:55.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.199+0000 7faad035d700 1 -- start start 2019-11-28T11:40:55.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faad035d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac806c490 0x7faac806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:55.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faad035d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac806db00 con 0x7faac806ce60 2019-11-28T11:40:55.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faad035d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac806e000 con 0x7faac806c0a0 2019-11-28T11:40:55.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faad035d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac806fd60 con 0x7faac806c490 2019-11-28T11:40:55.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faacf0fb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faac806ce60 0x7faac8164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37610/0 (socket says 172.21.15.80:37610) 2019-11-28T11:40:55.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faacf0fb700 1 -- 172.21.15.80:0/3515993421 learned_addr learned my addr 172.21.15.80:0/3515993421 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:55.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faace0f9700 1 --2- 172.21.15.80:0/3515993421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac806c490 0x7faac806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:55.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faacd8f8700 1 -- 172.21.15.80:0/3515993421 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110911451 0 0) 0x7faac00014d0 con 0x7faac806ce60 2019-11-28T11:40:55.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faacd8f8700 1 -- 172.21.15.80:0/3515993421 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab4002e80 con 0x7faac806ce60 2019-11-28T11:40:55.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faacd8f8700 1 -- 172.21.15.80:0/3515993421 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199990454 0 0) 0x7faab8001080 con 0x7faac806c0a0 2019-11-28T11:40:55.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faacd8f8700 1 -- 172.21.15.80:0/3515993421 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab40030b0 con 0x7faac806c0a0 2019-11-28T11:40:55.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faace0f9700 1 -- 172.21.15.80:0/3515993421 >> v1:172.21.15.174:6789/0 conn(0x7faac806c0a0 legacy=0x7faac8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:55.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faace0f9700 1 -- 172.21.15.80:0/3515993421 >> v1:172.21.15.80:6789/0 conn(0x7faac806ce60 legacy=0x7faac8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:55.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faace0f9700 1 -- 172.21.15.80:0/3515993421 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac80706c0 con 0x7faac806c490 2019-11-28T11:40:55.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faace0f9700 1 --2- 172.21.15.80:0/3515993421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac806c490 0x7faac806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faab000af50 tx=0x7faab000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:55.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faace0f9700 1 --2- 172.21.15.80:0/3515993421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac806c490 0x7faac806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faab000af50 tx=0x7faab000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:55.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.200+0000 7faace0f9700 1 --2- 172.21.15.80:0/3515993421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac806c490 0x7faac806c920 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7faab000af50 tx=0x7faab000b760).ready entity=mon.2 client_cookie=c7cd2dfabfd9d758 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:55.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.201+0000 7faace0f9700 1 --2- 172.21.15.80:0/3515993421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac806c490 0x7faac806c920 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7faab000af50 tx=0x7faab000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:55.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.201+0000 7faacd8f8700 1 -- 172.21.15.80:0/3515993421 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faab0000960 con 0x7faac806c490 2019-11-28T11:40:55.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.201+0000 7faace0f9700 1 --2- 172.21.15.80:0/3515993421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac806c490 0x7faac806c920 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7faab000af50 tx=0x7faab000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:55.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.201+0000 7faace0f9700 1 --2- 172.21.15.80:0/3515993421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac806c490 0x7faac806c920 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7faab000af50 tx=0x7faab000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:55.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.201+0000 7faacd8f8700 1 -- 172.21.15.80:0/3515993421 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab0007210 con 0x7faac806c490 2019-11-28T11:40:55.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.201+0000 7faacd8f8700 1 -- 172.21.15.80:0/3515993421 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faab0009ba0 con 0x7faac806c490 2019-11-28T11:40:55.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.201+0000 7faad035d700 1 -- 172.21.15.80:0/3515993421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac806c490 msgr2=0x7faac806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:55.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.201+0000 7faad035d700 1 --2- 172.21.15.80:0/3515993421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac806c490 0x7faac806c920 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7faab000af50 tx=0x7faab000b760).stop 2019-11-28T11:40:55.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.201+0000 7faad035d700 1 -- 172.21.15.80:0/3515993421 shutdown_connections 2019-11-28T11:40:55.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.201+0000 7faad035d700 1 --2- 172.21.15.80:0/3515993421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faac806c490 0x7faac806c920 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:55.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.202+0000 7faad035d700 1 -- 172.21.15.80:0/3515993421 shutdown_connections 2019-11-28T11:40:55.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.202+0000 7faad035d700 1 -- 172.21.15.80:0/3515993421 wait complete. 2019-11-28T11:40:55.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.202+0000 7faad035d700 1 -- 172.21.15.80:0/3515993421 >> 172.21.15.80:0/3515993421 conn(0x7faac8061cf0 msgr2=0x7faac8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.204+0000 7faad035d700 1 Processor -- start 2019-11-28T11:40:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.204+0000 7faad035d700 1 -- start start 2019-11-28T11:40:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faad035d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faac812cea0 0x7faac8111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faad035d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac8124260 con 0x7faac8165a00 2019-11-28T11:40:55.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faad035d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac812e5d0 con 0x7faac81230e0 2019-11-28T11:40:55.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faad035d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac8121040 con 0x7faac812cea0 2019-11-28T11:40:55.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faacf0fb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faac8165a00 0x7faac8167e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37618/0 (socket says 172.21.15.80:37618) 2019-11-28T11:40:55.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faacf0fb700 1 -- 172.21.15.80:0/1429106417 learned_addr learned my addr 172.21.15.80:0/1429106417 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:55.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faace8fa700 1 --2- 172.21.15.80:0/1429106417 >> v2:172.21.15.174:3300/0 conn(0x7faac812cea0 0x7faac8111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:55.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123873689 0 0) 0x7faac0000d30 con 0x7faac8165a00 2019-11-28T11:40:55.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaac002e80 con 0x7faac8165a00 2019-11-28T11:40:55.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3407170486 0 0) 0x7faac0001680 con 0x7faac8165a00 2019-11-28T11:40:55.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faaac0032e0 con 0x7faac8165a00 2019-11-28T11:40:55.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7faac0001c10 con 0x7faac8165a00 2019-11-28T11:40:55.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 >> v2:172.21.15.174:3300/0 conn(0x7faac812cea0 msgr2=0x7faac8111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:55.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faac77fe700 1 --2- 172.21.15.80:0/1429106417 >> v2:172.21.15.174:3300/0 conn(0x7faac812cea0 0x7faac8111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:55.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 >> v1:172.21.15.174:6789/0 conn(0x7faac81230e0 legacy=0x7faac8123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:55.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 >> v1:172.21.15.80:6789/0 conn(0x7faac8165a00 legacy=0x7faac8167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:55.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faac77fe700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faaac003400 0x7faaac003850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:55.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faac77fe700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaac003d90 0x7faaac004250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:55.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faac77fe700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faaac0049e0 0x7faaac004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:55.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac00bc80 con 0x7faaac003d90 2019-11-28T11:40:55.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac00beb0 con 0x7faaac0049e0 2019-11-28T11:40:55.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac00c0e0 con 0x7faaac003400 2019-11-28T11:40:55.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.205+0000 7faace8fa700 1 --2- 172.21.15.80:0/1429106417 >> v2:172.21.15.174:3300/0 conn(0x7faac812cea0 0x7faac8111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:40:55.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faace0f9700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaac003d90 0x7faaac004250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:55.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faacf0fb700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faaac0049e0 0x7faaac004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:55.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faace8fa700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faaac003400 0x7faaac003850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:55.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faace0f9700 1 -- 172.21.15.80:0/1429106417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faaac003400 msgr2=0x7faaac003850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:55.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faace0f9700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faaac003400 0x7faaac003850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:55.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faace0f9700 1 -- 172.21.15.80:0/1429106417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faaac0049e0 msgr2=0x7faaac004ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:55.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faace0f9700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faaac0049e0 0x7faaac004ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:55.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faace0f9700 1 -- 172.21.15.80:0/1429106417 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac00c390 con 0x7faaac003d90 2019-11-28T11:40:55.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faacf0fb700 1 -- 172.21.15.80:0/1429106417 reap_dead start 2019-11-28T11:40:55.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faad035d700 1 -- 172.21.15.80:0/1429106417 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac8121d20 con 0x7faaac003d90 2019-11-28T11:40:55.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faace0f9700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaac003d90 0x7faaac004250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faab0010300 tx=0x7faab0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:55.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faad035d700 1 -- 172.21.15.80:0/1429106417 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac81219a0 con 0x7faaac003d90 2019-11-28T11:40:55.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faace0f9700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaac003d90 0x7faaac004250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faab0010300 tx=0x7faab0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:55.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faace0f9700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaac003d90 0x7faaac004250 secure :-1 s=READY pgs=1383 cs=0 l=1 rx=0x7faab0010300 tx=0x7faab0010200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:55.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faace0f9700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaac003d90 0x7faaac004250 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7faab0010300 tx=0x7faab0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:55.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faab0000940 con 0x7faaac003d90 2019-11-28T11:40:55.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faace0f9700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaac003d90 0x7faaac004250 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7faab0010300 tx=0x7faab0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:55.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faace0f9700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaac003d90 0x7faaac004250 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7faab0010300 tx=0x7faab0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:55.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab0009770 con 0x7faaac003d90 2019-11-28T11:40:55.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faab0009960 con 0x7faaac003d90 2019-11-28T11:40:55.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.206+0000 7faace0f9700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaac003d90 0x7faaac004250 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7faab0010300 tx=0x7faab0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:55.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.207+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7faab0009960 con 0x7faaac003d90 2019-11-28T11:40:55.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.207+0000 7faace0f9700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaac003d90 0x7faaac004250 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7faab0010300 tx=0x7faab0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:55.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.207+0000 7faac77fe700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaac01b4c0 0x7faaac01d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:55.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.207+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6235+0+0 (secure 0 0 0) 0x7faab0031af0 con 0x7faaac003d90 2019-11-28T11:40:55.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.207+0000 7faace8fa700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaac01b4c0 0x7faaac01d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:55.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.207+0000 7faace8fa700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaac01b4c0 0x7faaac01d8f0 crc :-1 s=READY pgs=565 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:55.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.214+0000 7faad035d700 1 -- 172.21.15.80:0/1429106417 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac8121d20 con 0x7faaac003d90 2019-11-28T11:40:55.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.217+0000 7faace0f9700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaac003d90 0x7faaac004250 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7faab0010300 tx=0x7faab0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:55.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.217+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7faab000b3d0 con 0x7faaac003d90 2019-11-28T11:40:55.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.393+0000 7faad035d700 1 -- 172.21.15.80:0/1429106417 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7faac81219a0 con 0x7faaac003d90 2019-11-28T11:40:55.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.719+0000 7faace0f9700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaac003d90 0x7faaac004250 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7faab0010300 tx=0x7faab0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:55.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.719+0000 7faac77fe700 1 -- 172.21.15.80:0/1429106417 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v70) v1 ==== 104+0+0 (secure 0 0 0) 0x7faab0009770 con 0x7faaac003d90 2019-11-28T11:40:55.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.760+0000 7faad035d700 1 -- 172.21.15.80:0/1429106417 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaac01b4c0 msgr2=0x7faaac01d8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:55.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.760+0000 7faad035d700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaac01b4c0 0x7faaac01d8f0 crc :-1 s=READY pgs=565 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:55.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.760+0000 7faad035d700 1 -- 172.21.15.80:0/1429106417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaac003d90 msgr2=0x7faaac004250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:55.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.760+0000 7faad035d700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaac003d90 0x7faaac004250 secure :-1 s=READY pgs=1383 cs=0 l=1 rx=0x7faab0010300 tx=0x7faab0010200).stop 2019-11-28T11:40:55.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.760+0000 7faad035d700 1 -- 172.21.15.80:0/1429106417 shutdown_connections 2019-11-28T11:40:55.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.760+0000 7faad035d700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faaac01b4c0 0x7faaac01d8f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:55.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.760+0000 7faad035d700 1 --2- 172.21.15.80:0/1429106417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaac003d90 0x7faaac004250 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:55.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.760+0000 7faad035d700 1 -- 172.21.15.80:0/1429106417 shutdown_connections 2019-11-28T11:40:55.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.760+0000 7faad035d700 1 -- 172.21.15.80:0/1429106417 wait complete. 2019-11-28T11:40:55.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.760+0000 7faad035d700 1 -- 172.21.15.80:0/1429106417 >> 172.21.15.80:0/1429106417 conn(0x7faac81426c0 msgr2=0x7faac8110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:55.803 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:40:55.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.958+0000 7f359b5a1700 1 Processor -- start 2019-11-28T11:40:55.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.958+0000 7f359b5a1700 1 -- start start 2019-11-28T11:40:55.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.959+0000 7f359b5a1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359415ed10 0x7f359415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:55.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.959+0000 7f359b5a1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3594073020 0x7f3594071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:55.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.959+0000 7f359b5a1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359406db60 con 0x7f35940734b0 2019-11-28T11:40:55.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.959+0000 7f359b5a1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359406f3d0 con 0x7f3594073020 2019-11-28T11:40:55.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.959+0000 7f359b5a1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359406fe00 con 0x7f359415ed10 2019-11-28T11:40:55.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f359933d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3594073020 0x7f3594071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:55.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f3599b3e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359415ed10 0x7f359415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:55.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f359a33f700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f35940734b0 0x7f35940723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:53174/0 (socket says 172.21.15.80:53174) 2019-11-28T11:40:55.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f3599b3e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359415ed10 0x7f359415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:40572/0 (socket says 172.21.15.80:40572) 2019-11-28T11:40:56.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f359a33f700 1 -- 172.21.15.80:0/3774651971 learned_addr learned my addr 172.21.15.80:0/3774651971 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:56.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f359933d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3594073020 0x7f3594071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:53202/0 (socket says 172.21.15.80:53202) 2019-11-28T11:40:56.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f3599b3e700 1 -- 172.21.15.80:0/3774651971 >> v2:172.21.15.174:3300/0 conn(0x7f3594073020 msgr2=0x7f3594071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:56.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f3599b3e700 1 --2- 172.21.15.80:0/3774651971 >> v2:172.21.15.174:3300/0 conn(0x7f3594073020 0x7f3594071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:56.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f3599b3e700 1 -- 172.21.15.80:0/3774651971 >> v1:172.21.15.174:6789/0 conn(0x7f35940734b0 legacy=0x7f35940723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:56.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f3599b3e700 1 -- 172.21.15.80:0/3774651971 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3594070760 con 0x7f359415ed10 2019-11-28T11:40:56.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f359933d700 1 --2- 172.21.15.80:0/3774651971 >> v2:172.21.15.174:3300/0 conn(0x7f3594073020 0x7f3594071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:40:56.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f3599b3e700 1 --2- 172.21.15.80:0/3774651971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359415ed10 0x7f359415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f357c00af50 tx=0x7f357c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f3599b3e700 1 --2- 172.21.15.80:0/3774651971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359415ed10 0x7f359415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f357c00af50 tx=0x7f357c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f3599b3e700 1 --2- 172.21.15.80:0/3774651971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359415ed10 0x7f359415f100 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f357c00af50 tx=0x7f357c00b760).ready entity=mon.2 client_cookie=eb6cc6c8b72dd314 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:56.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f3599b3e700 1 --2- 172.21.15.80:0/3774651971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359415ed10 0x7f359415f100 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f357c00af50 tx=0x7f357c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f3598b3c700 1 -- 172.21.15.80:0/3774651971 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f357c007210 con 0x7f359415ed10 2019-11-28T11:40:56.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f3599b3e700 1 --2- 172.21.15.80:0/3774651971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359415ed10 0x7f359415f100 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f357c00af50 tx=0x7f357c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f3599b3e700 1 --2- 172.21.15.80:0/3774651971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359415ed10 0x7f359415f100 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f357c00af50 tx=0x7f357c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f3598b3c700 1 -- 172.21.15.80:0/3774651971 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c0099b0 con 0x7f359415ed10 2019-11-28T11:40:56.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f3598b3c700 1 -- 172.21.15.80:0/3774651971 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f357c00a080 con 0x7f359415ed10 2019-11-28T11:40:56.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f359b5a1700 1 -- 172.21.15.80:0/3774651971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359415ed10 msgr2=0x7f359415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:56.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.960+0000 7f359b5a1700 1 --2- 172.21.15.80:0/3774651971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359415ed10 0x7f359415f100 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f357c00af50 tx=0x7f357c00b760).stop 2019-11-28T11:40:56.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.961+0000 7f359b5a1700 1 -- 172.21.15.80:0/3774651971 shutdown_connections 2019-11-28T11:40:56.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.961+0000 7f359b5a1700 1 --2- 172.21.15.80:0/3774651971 >> v2:172.21.15.174:3300/0 conn(0x7f3594073020 0x7f3594071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:56.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.961+0000 7f359b5a1700 1 --2- 172.21.15.80:0/3774651971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f359415ed10 0x7f359415f100 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:56.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.961+0000 7f359b5a1700 1 -- 172.21.15.80:0/3774651971 shutdown_connections 2019-11-28T11:40:56.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.961+0000 7f359b5a1700 1 -- 172.21.15.80:0/3774651971 wait complete. 2019-11-28T11:40:56.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.961+0000 7f359b5a1700 1 -- 172.21.15.80:0/3774651971 >> 172.21.15.80:0/3774651971 conn(0x7f3594061d20 msgr2=0x7f35940641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:56.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.964+0000 7f359b5a1700 1 Processor -- start 2019-11-28T11:40:56.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.964+0000 7f359b5a1700 1 -- start start 2019-11-28T11:40:56.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.964+0000 7f359b5a1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f359410e970 0x7f35941087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:56.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359b5a1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3594107e30 0x7f3594167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:56.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359b5a1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359410c250 con 0x7f3594108cf0 2019-11-28T11:40:56.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359b5a1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359410e430 con 0x7f3594107e30 2019-11-28T11:40:56.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359b5a1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3594105860 con 0x7f359410e970 2019-11-28T11:40:56.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359a33f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3594107e30 0x7f3594167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359a33f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3594107e30 0x7f3594167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38322/0 (socket says 172.21.15.80:38322) 2019-11-28T11:40:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359a33f700 1 -- 172.21.15.80:0/880282923 learned_addr learned my addr 172.21.15.80:0/880282923 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f3599b3e700 1 --2- 172.21.15.80:0/880282923 >> v2:172.21.15.174:3300/0 conn(0x7f359410e970 0x7f35941087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359a33f700 1 -- 172.21.15.80:0/880282923 >> v2:172.21.15.174:3300/0 conn(0x7f359410e970 msgr2=0x7f35941087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359a33f700 1 --2- 172.21.15.80:0/880282923 >> v2:172.21.15.174:3300/0 conn(0x7f359410e970 0x7f35941087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359a33f700 1 -- 172.21.15.80:0/880282923 >> v1:172.21.15.174:6789/0 conn(0x7f3594108cf0 legacy=0x7f3594107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:56.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359a33f700 1 -- 172.21.15.80:0/880282923 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3594105ef0 con 0x7f3594107e30 2019-11-28T11:40:56.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359a33f700 1 --2- 172.21.15.80:0/880282923 >> v2:172.21.15.80:3300/0 conn(0x7f3594107e30 0x7f3594167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f358c010440 tx=0x7f358c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359a33f700 1 --2- 172.21.15.80:0/880282923 >> v2:172.21.15.80:3300/0 conn(0x7f3594107e30 0x7f3594167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f358c010440 tx=0x7f358c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359a33f700 1 --2- 172.21.15.80:0/880282923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3594107e30 0x7f3594167d70 secure :-1 s=READY pgs=1384 cs=0 l=1 rx=0x7f358c010440 tx=0x7f358c010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:56.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359a33f700 1 --2- 172.21.15.80:0/880282923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3594107e30 0x7f3594167d70 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7f358c010440 tx=0x7f358c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f35927fc700 1 -- 172.21.15.80:0/880282923 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f358c000960 con 0x7f3594107e30 2019-11-28T11:40:56.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359a33f700 1 --2- 172.21.15.80:0/880282923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3594107e30 0x7f3594167d70 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7f358c010440 tx=0x7f358c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359a33f700 1 --2- 172.21.15.80:0/880282923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3594107e30 0x7f3594167d70 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7f358c010440 tx=0x7f358c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f35927fc700 1 -- 172.21.15.80:0/880282923 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c0041c0 con 0x7f3594107e30 2019-11-28T11:40:56.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f359b5a1700 1 -- 172.21.15.80:0/880282923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3594106270 con 0x7f3594107e30 2019-11-28T11:40:56.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.965+0000 7f35927fc700 1 -- 172.21.15.80:0/880282923 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f358c000960 con 0x7f3594107e30 2019-11-28T11:40:56.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.966+0000 7f359b5a1700 1 -- 172.21.15.80:0/880282923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3594105ef0 con 0x7f3594107e30 2019-11-28T11:40:56.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.966+0000 7f359a33f700 1 --2- 172.21.15.80:0/880282923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3594107e30 0x7f3594167d70 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7f358c010440 tx=0x7f358c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.966+0000 7f35927fc700 1 -- 172.21.15.80:0/880282923 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f358c0043b0 con 0x7f3594107e30 2019-11-28T11:40:56.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.966+0000 7f359a33f700 1 --2- 172.21.15.80:0/880282923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3594107e30 0x7f3594167d70 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7f358c010440 tx=0x7f358c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.966+0000 7f35927fc700 1 --2- 172.21.15.80:0/880282923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3578018730 0x7f357801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:56.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.966+0000 7f35927fc700 1 -- 172.21.15.80:0/880282923 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f358c031d00 con 0x7f3594107e30 2019-11-28T11:40:56.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.966+0000 7f3599b3e700 1 --2- 172.21.15.80:0/880282923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3578018730 0x7f357801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:56.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.967+0000 7f3599b3e700 1 --2- 172.21.15.80:0/880282923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3578018730 0x7f357801abe0 crc :-1 s=READY pgs=566 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:56.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.973+0000 7f359b5a1700 1 -- 172.21.15.80:0/880282923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3594106270 con 0x7f3594107e30 2019-11-28T11:40:56.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.977+0000 7f359a33f700 1 --2- 172.21.15.80:0/880282923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3594107e30 0x7f3594167d70 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7f358c010440 tx=0x7f358c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:55.977+0000 7f35927fc700 1 -- 172.21.15.80:0/880282923 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f358c001300 con 0x7f3594107e30 2019-11-28T11:40:56.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.143+0000 7f359b5a1700 1 -- 172.21.15.80:0/880282923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3594105ef0 con 0x7f3594107e30 2019-11-28T11:40:56.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.724+0000 7f359a33f700 1 --2- 172.21.15.80:0/880282923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3594107e30 0x7f3594167d70 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7f358c010440 tx=0x7f358c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.724+0000 7f35927fc700 1 -- 172.21.15.80:0/880282923 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v101) v1 ==== 185+0+0 (secure 0 0 0) 0x7f358c0041c0 con 0x7f3594107e30 2019-11-28T11:40:56.791 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:40:56.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.760+0000 7f359b5a1700 1 -- 172.21.15.80:0/880282923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3578018730 msgr2=0x7f357801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:56.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.760+0000 7f359b5a1700 1 --2- 172.21.15.80:0/880282923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3578018730 0x7f357801abe0 crc :-1 s=READY pgs=566 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:56.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.760+0000 7f359b5a1700 1 -- 172.21.15.80:0/880282923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3594107e30 msgr2=0x7f3594167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:56.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.760+0000 7f359b5a1700 1 --2- 172.21.15.80:0/880282923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3594107e30 0x7f3594167d70 secure :-1 s=READY pgs=1384 cs=0 l=1 rx=0x7f358c010440 tx=0x7f358c010270).stop 2019-11-28T11:40:56.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.761+0000 7f359b5a1700 1 -- 172.21.15.80:0/880282923 shutdown_connections 2019-11-28T11:40:56.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.761+0000 7f359b5a1700 1 --2- 172.21.15.80:0/880282923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3594107e30 0x7f3594167d70 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:56.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.761+0000 7f359b5a1700 1 --2- 172.21.15.80:0/880282923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3578018730 0x7f357801abe0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:56.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.761+0000 7f359b5a1700 1 --2- 172.21.15.80:0/880282923 >> v2:172.21.15.174:3300/0 conn(0x7f359410e970 0x7f35941087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:56.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.761+0000 7f359b5a1700 1 -- 172.21.15.80:0/880282923 shutdown_connections 2019-11-28T11:40:56.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.761+0000 7f359b5a1700 1 -- 172.21.15.80:0/880282923 wait complete. 2019-11-28T11:40:56.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.761+0000 7f359b5a1700 1 -- 172.21.15.80:0/880282923 >> 172.21.15.80:0/880282923 conn(0x7f359415e2d0 msgr2=0x7f3594147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:56.805 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:40:56.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.896+0000 7fd97134b700 1 Processor -- start 2019-11-28T11:40:56.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.896+0000 7fd97134b700 1 -- start start 2019-11-28T11:40:56.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd97134b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd96c15f100 0x7fd96c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:56.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd97134b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd96c06c2f0 0x7fd96c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:56.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd97134b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96c06db60 con 0x7fd96c15ed10 2019-11-28T11:40:56.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd97134b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c06fe00 con 0x7fd96c15f100 2019-11-28T11:40:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd97134b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c0700d0 con 0x7fd96c06c2f0 2019-11-28T11:40:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96affd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd96c15f100 0x7fd96c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:56.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96affd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd96c15f100 0x7fd96c06bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38330/0 (socket says 172.21.15.80:38330) 2019-11-28T11:40:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96affd700 1 -- 172.21.15.80:0/989078000 learned_addr learned my addr 172.21.15.80:0/989078000 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96bfff700 1 --2- 172.21.15.80:0/989078000 >> v2:172.21.15.174:3300/0 conn(0x7fd96c06c2f0 0x7fd96c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96affd700 1 -- 172.21.15.80:0/989078000 >> v2:172.21.15.174:3300/0 conn(0x7fd96c06c2f0 msgr2=0x7fd96c06c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96affd700 1 --2- 172.21.15.80:0/989078000 >> v2:172.21.15.174:3300/0 conn(0x7fd96c06c2f0 0x7fd96c06c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96affd700 1 -- 172.21.15.80:0/989078000 >> v1:172.21.15.174:6789/0 conn(0x7fd96c15ed10 legacy=0x7fd96c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96affd700 1 -- 172.21.15.80:0/989078000 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c070760 con 0x7fd96c15f100 2019-11-28T11:40:56.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96bfff700 1 --2- 172.21.15.80:0/989078000 >> v2:172.21.15.174:3300/0 conn(0x7fd96c06c2f0 0x7fd96c06c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:40:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96affd700 1 --2- 172.21.15.80:0/989078000 >> v2:172.21.15.80:3300/0 conn(0x7fd96c15f100 0x7fd96c06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd96000f740 tx=0x7fd96000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96affd700 1 --2- 172.21.15.80:0/989078000 >> v2:172.21.15.80:3300/0 conn(0x7fd96c15f100 0x7fd96c06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd96000f740 tx=0x7fd96000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96affd700 1 --2- 172.21.15.80:0/989078000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f100 0x7fd96c06bdb0 secure :-1 s=READY pgs=1385 cs=0 l=1 rx=0x7fd96000f740 tx=0x7fd96000fae0).ready entity=mon.0 client_cookie=d039104ae3d87cc1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96affd700 1 --2- 172.21.15.80:0/989078000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f100 0x7fd96c06bdb0 secure :-1 s=THROTTLE_DONE pgs=1385 cs=0 l=1 rx=0x7fd96000f740 tx=0x7fd96000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96affd700 1 --2- 172.21.15.80:0/989078000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f100 0x7fd96c06bdb0 secure :-1 s=THROTTLE_DONE pgs=1385 cs=0 l=1 rx=0x7fd96000f740 tx=0x7fd96000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96a7fc700 1 -- 172.21.15.80:0/989078000 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd960000960 con 0x7fd96c15f100 2019-11-28T11:40:56.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96affd700 1 --2- 172.21.15.80:0/989078000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f100 0x7fd96c06bdb0 secure :-1 s=THROTTLE_DONE pgs=1385 cs=0 l=1 rx=0x7fd96000f740 tx=0x7fd96000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96a7fc700 1 -- 172.21.15.80:0/989078000 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd960000c90 con 0x7fd96c15f100 2019-11-28T11:40:56.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.897+0000 7fd96a7fc700 1 -- 172.21.15.80:0/989078000 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9600013a0 con 0x7fd96c15f100 2019-11-28T11:40:56.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.898+0000 7fd97134b700 1 -- 172.21.15.80:0/989078000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f100 msgr2=0x7fd96c06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:56.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.898+0000 7fd97134b700 1 --2- 172.21.15.80:0/989078000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f100 0x7fd96c06bdb0 secure :-1 s=READY pgs=1385 cs=0 l=1 rx=0x7fd96000f740 tx=0x7fd96000fae0).stop 2019-11-28T11:40:56.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.898+0000 7fd97134b700 1 -- 172.21.15.80:0/989078000 shutdown_connections 2019-11-28T11:40:56.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.898+0000 7fd97134b700 1 --2- 172.21.15.80:0/989078000 >> v2:172.21.15.174:3300/0 conn(0x7fd96c06c2f0 0x7fd96c06c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:56.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.898+0000 7fd97134b700 1 --2- 172.21.15.80:0/989078000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f100 0x7fd96c06bdb0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:56.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.898+0000 7fd97134b700 1 -- 172.21.15.80:0/989078000 shutdown_connections 2019-11-28T11:40:56.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.898+0000 7fd97134b700 1 -- 172.21.15.80:0/989078000 wait complete. 2019-11-28T11:40:56.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.898+0000 7fd97134b700 1 -- 172.21.15.80:0/989078000 >> 172.21.15.80:0/989078000 conn(0x7fd96c061d20 msgr2=0x7fd96c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:56.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.901+0000 7fd97134b700 1 Processor -- start 2019-11-28T11:40:56.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.901+0000 7fd97134b700 1 -- start start 2019-11-28T11:40:56.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd97134b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd96c12e9a0 0x7fd96c104800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:56.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd97134b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd96c15f9a0 0x7fd96c148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:56.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd97134b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96c07b5c0 con 0x7fd96c15f510 2019-11-28T11:40:56.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd97134b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c111590 con 0x7fd96c15f9a0 2019-11-28T11:40:56.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd97134b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c111fc0 con 0x7fd96c12e9a0 2019-11-28T11:40:56.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd96bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd96c15f9a0 0x7fd96c148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:56.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd96bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd96c15f9a0 0x7fd96c148840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38336/0 (socket says 172.21.15.80:38336) 2019-11-28T11:40:56.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd96bfff700 1 -- 172.21.15.80:0/665646610 learned_addr learned my addr 172.21.15.80:0/665646610 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:56.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd96b7fe700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd96c12e9a0 0x7fd96c104800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:56.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd96bfff700 1 -- 172.21.15.80:0/665646610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd96c12e9a0 msgr2=0x7fd96c104800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:56.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd96bfff700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd96c12e9a0 0x7fd96c104800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:56.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd96bfff700 1 -- 172.21.15.80:0/665646610 >> v1:172.21.15.174:6789/0 conn(0x7fd96c15f510 legacy=0x7fd96c148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:56.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd96bfff700 1 -- 172.21.15.80:0/665646610 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c101f40 con 0x7fd96c15f9a0 2019-11-28T11:40:56.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd96bfff700 1 --2- 172.21.15.80:0/665646610 >> v2:172.21.15.80:3300/0 conn(0x7fd96c15f9a0 0x7fd96c148840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd964010800 tx=0x7fd964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd96bfff700 1 --2- 172.21.15.80:0/665646610 >> v2:172.21.15.80:3300/0 conn(0x7fd96c15f9a0 0x7fd96c148840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd964010800 tx=0x7fd964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd96bfff700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f9a0 0x7fd96c148840 secure :-1 s=READY pgs=1386 cs=0 l=1 rx=0x7fd964010800 tx=0x7fd964010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:56.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd96bfff700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f9a0 0x7fd96c148840 secure :-1 s=THROTTLE_DONE pgs=1386 cs=0 l=1 rx=0x7fd964010800 tx=0x7fd964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd96bfff700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f9a0 0x7fd96c148840 secure :-1 s=THROTTLE_DONE pgs=1386 cs=0 l=1 rx=0x7fd964010800 tx=0x7fd964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd953fff700 1 -- 172.21.15.80:0/665646610 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd964008800 con 0x7fd96c15f9a0 2019-11-28T11:40:56.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd96bfff700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f9a0 0x7fd96c148840 secure :-1 s=THROTTLE_DONE pgs=1386 cs=0 l=1 rx=0x7fd964010800 tx=0x7fd964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd953fff700 1 -- 172.21.15.80:0/665646610 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd964009e00 con 0x7fd96c15f9a0 2019-11-28T11:40:56.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd97134b700 1 -- 172.21.15.80:0/665646610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96c1022c0 con 0x7fd96c15f9a0 2019-11-28T11:40:56.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd953fff700 1 -- 172.21.15.80:0/665646610 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd96400a530 con 0x7fd96c15f9a0 2019-11-28T11:40:56.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.902+0000 7fd97134b700 1 -- 172.21.15.80:0/665646610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96c101f40 con 0x7fd96c15f9a0 2019-11-28T11:40:56.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.903+0000 7fd96bfff700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f9a0 0x7fd96c148840 secure :-1 s=THROTTLE_DONE pgs=1386 cs=0 l=1 rx=0x7fd964010800 tx=0x7fd964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.903+0000 7fd953fff700 1 -- 172.21.15.80:0/665646610 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd964000df0 con 0x7fd96c15f9a0 2019-11-28T11:40:56.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.903+0000 7fd96bfff700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f9a0 0x7fd96c148840 secure :-1 s=THROTTLE_DONE pgs=1386 cs=0 l=1 rx=0x7fd964010800 tx=0x7fd964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.903+0000 7fd953fff700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd94c018730 0x7fd94c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:56.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.903+0000 7fd953fff700 1 -- 172.21.15.80:0/665646610 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5797+0+0 (secure 0 0 0) 0x7fd964031e40 con 0x7fd96c15f9a0 2019-11-28T11:40:56.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.903+0000 7fd96b7fe700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd94c018730 0x7fd94c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:56.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.904+0000 7fd96b7fe700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd94c018730 0x7fd94c01abc0 crc :-1 s=READY pgs=567 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:56.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.911+0000 7fd97134b700 1 -- 172.21.15.80:0/665646610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96c1022c0 con 0x7fd96c15f9a0 2019-11-28T11:40:56.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.914+0000 7fd96bfff700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f9a0 0x7fd96c148840 secure :-1 s=THROTTLE_DONE pgs=1386 cs=0 l=1 rx=0x7fd964010800 tx=0x7fd964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:56.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:56.914+0000 7fd953fff700 1 -- 172.21.15.80:0/665646610 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd964009960 con 0x7fd96c15f9a0 2019-11-28T11:40:57.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.083+0000 7fd97134b700 1 -- 172.21.15.80:0/665646610 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd96c101f40 con 0x7fd96c15f9a0 2019-11-28T11:40:57.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.726+0000 7fd96bfff700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f9a0 0x7fd96c148840 secure :-1 s=THROTTLE_DONE pgs=1386 cs=0 l=1 rx=0x7fd964010800 tx=0x7fd964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:57.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.726+0000 7fd953fff700 1 -- 172.21.15.80:0/665646610 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v102) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd964000df0 con 0x7fd96c15f9a0 2019-11-28T11:40:57.780 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:40:57.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.750+0000 7fd97134b700 1 -- 172.21.15.80:0/665646610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd94c018730 msgr2=0x7fd94c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:57.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.750+0000 7fd97134b700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd94c018730 0x7fd94c01abc0 crc :-1 s=READY pgs=567 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:57.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.750+0000 7fd97134b700 1 -- 172.21.15.80:0/665646610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f9a0 msgr2=0x7fd96c148840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:57.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.750+0000 7fd97134b700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f9a0 0x7fd96c148840 secure :-1 s=READY pgs=1386 cs=0 l=1 rx=0x7fd964010800 tx=0x7fd964010600).stop 2019-11-28T11:40:57.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.750+0000 7fd97134b700 1 -- 172.21.15.80:0/665646610 shutdown_connections 2019-11-28T11:40:57.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.750+0000 7fd97134b700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15f9a0 0x7fd96c148840 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:57.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.750+0000 7fd97134b700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd94c018730 0x7fd94c01abc0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:57.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.750+0000 7fd97134b700 1 --2- 172.21.15.80:0/665646610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd96c12e9a0 0x7fd96c104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:57.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.751+0000 7fd97134b700 1 -- 172.21.15.80:0/665646610 shutdown_connections 2019-11-28T11:40:57.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.751+0000 7fd97134b700 1 -- 172.21.15.80:0/665646610 wait complete. 2019-11-28T11:40:57.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.751+0000 7fd97134b700 1 -- 172.21.15.80:0/665646610 >> 172.21.15.80:0/665646610 conn(0x7fd96c07c4f0 msgr2=0x7fd96c15ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:57.793 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:40:57.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.884+0000 7f575df6d700 1 Processor -- start 2019-11-28T11:40:57.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.884+0000 7f575df6d700 1 -- start start 2019-11-28T11:40:57.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.885+0000 7f575df6d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f575806c0a0 0x7f5758072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:57.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.885+0000 7f575df6d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f57580734e0 0x7f5758071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:57.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.885+0000 7f575df6d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5758072360 0x7f57580727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:57.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.885+0000 7f575df6d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575806f330 con 0x7f5758072360 2019-11-28T11:40:57.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.885+0000 7f575df6d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57580706c0 con 0x7f57580734e0 2019-11-28T11:40:57.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.885+0000 7f575df6d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5758070a40 con 0x7f575806c0a0 2019-11-28T11:40:57.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f575cd0b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5758072360 0x7f57580727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:57.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f575cd0b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5758072360 0x7f57580727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38342/0 (socket says 172.21.15.80:38342) 2019-11-28T11:40:57.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f575cd0b700 1 -- 172.21.15.80:0/2264328574 learned_addr learned my addr 172.21.15.80:0/2264328574 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:57.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f5757fff700 1 --2- 172.21.15.80:0/2264328574 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f575806c0a0 0x7f5758072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:57.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f574ffff700 1 --2- 172.21.15.80:0/2264328574 >> v2:172.21.15.174:3300/0 conn(0x7f57580734e0 0x7f5758071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:57.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f575cd0b700 1 -- 172.21.15.80:0/2264328574 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f575806c0a0 msgr2=0x7f5758072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:57.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f575cd0b700 1 --2- 172.21.15.80:0/2264328574 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f575806c0a0 0x7f5758072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:57.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f575cd0b700 1 -- 172.21.15.80:0/2264328574 >> v2:172.21.15.174:3300/0 conn(0x7f57580734e0 msgr2=0x7f5758071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:57.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f575cd0b700 1 --2- 172.21.15.80:0/2264328574 >> v2:172.21.15.174:3300/0 conn(0x7f57580734e0 0x7f5758071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:57.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f575cd0b700 1 -- 172.21.15.80:0/2264328574 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575806db00 con 0x7f5758072360 2019-11-28T11:40:57.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f575cd0b700 1 --2- 172.21.15.80:0/2264328574 >> v2:172.21.15.80:3300/0 conn(0x7f5758072360 0x7f57580727e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f575000fa30 tx=0x7f57500080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:57.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f575cd0b700 1 --2- 172.21.15.80:0/2264328574 >> v2:172.21.15.80:3300/0 conn(0x7f5758072360 0x7f57580727e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f575000fa30 tx=0x7f57500080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:57.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f575cd0b700 1 --2- 172.21.15.80:0/2264328574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5758072360 0x7f57580727e0 secure :-1 s=READY pgs=1387 cs=0 l=1 rx=0x7f575000fa30 tx=0x7f57500080d0).ready entity=mon.0 client_cookie=7f3520ba751cb023 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:57.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f575cd0b700 1 --2- 172.21.15.80:0/2264328574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5758072360 0x7f57580727e0 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f575000fa30 tx=0x7f57500080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:57.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f57577fe700 1 -- 172.21.15.80:0/2264328574 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5750000df0 con 0x7f5758072360 2019-11-28T11:40:57.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f575cd0b700 1 --2- 172.21.15.80:0/2264328574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5758072360 0x7f57580727e0 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f575000fa30 tx=0x7f57500080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:57.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f575cd0b700 1 --2- 172.21.15.80:0/2264328574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5758072360 0x7f57580727e0 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f575000fa30 tx=0x7f57500080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:57.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f57577fe700 1 -- 172.21.15.80:0/2264328574 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5750001460 con 0x7f5758072360 2019-11-28T11:40:57.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f57577fe700 1 -- 172.21.15.80:0/2264328574 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5750001bb0 con 0x7f5758072360 2019-11-28T11:40:57.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f575df6d700 1 -- 172.21.15.80:0/2264328574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5758072360 msgr2=0x7f57580727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:57.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.886+0000 7f575df6d700 1 --2- 172.21.15.80:0/2264328574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5758072360 0x7f57580727e0 secure :-1 s=READY pgs=1387 cs=0 l=1 rx=0x7f575000fa30 tx=0x7f57500080d0).stop 2019-11-28T11:40:57.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.887+0000 7f575df6d700 1 -- 172.21.15.80:0/2264328574 shutdown_connections 2019-11-28T11:40:57.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.887+0000 7f575df6d700 1 --2- 172.21.15.80:0/2264328574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5758072360 0x7f57580727e0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:57.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.887+0000 7f575df6d700 1 --2- 172.21.15.80:0/2264328574 >> v2:172.21.15.174:3300/0 conn(0x7f57580734e0 0x7f5758071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:57.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.887+0000 7f575df6d700 1 --2- 172.21.15.80:0/2264328574 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f575806c0a0 0x7f5758072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:57.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.887+0000 7f575df6d700 1 -- 172.21.15.80:0/2264328574 shutdown_connections 2019-11-28T11:40:57.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.887+0000 7f575df6d700 1 -- 172.21.15.80:0/2264328574 wait complete. 2019-11-28T11:40:57.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.887+0000 7f575df6d700 1 -- 172.21.15.80:0/2264328574 >> 172.21.15.80:0/2264328574 conn(0x7f5758061cf0 msgr2=0x7f5758064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:57.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.889+0000 7f575df6d700 1 Processor -- start 2019-11-28T11:40:57.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.889+0000 7f575df6d700 1 -- start start 2019-11-28T11:40:57.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.890+0000 7f575df6d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f575813e8e0 0x7f575814fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:57.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.890+0000 7f575df6d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57581067a0 0x7f5758164c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:57.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.890+0000 7f575df6d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575813bd00 con 0x7f57581500d0 2019-11-28T11:40:57.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.890+0000 7f575df6d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575810df40 con 0x7f575813e8e0 2019-11-28T11:40:57.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.890+0000 7f575df6d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5758104240 con 0x7f57581067a0 2019-11-28T11:40:57.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.890+0000 7f574ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f57581500d0 0x7f5758105fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37664/0 (socket says 172.21.15.80:37664) 2019-11-28T11:40:57.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.890+0000 7f574ffff700 1 -- 172.21.15.80:0/784078221 learned_addr learned my addr 172.21.15.80:0/784078221 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:57.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.890+0000 7f5757fff700 1 --2- 172.21.15.80:0/784078221 >> v2:172.21.15.174:3300/0 conn(0x7f575813e8e0 0x7f575814fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:57.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f575cd0b700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57581067a0 0x7f5758164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:57.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f57557fa700 1 -- 172.21.15.80:0/784078221 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075568052 0 0) 0x7f57400010b0 con 0x7f57581500d0 2019-11-28T11:40:57.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f57557fa700 1 -- 172.21.15.80:0/784078221 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f573c002e80 con 0x7f57581500d0 2019-11-28T11:40:57.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f5757fff700 1 -- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57581067a0 msgr2=0x7f5758164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:57.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f5757fff700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57581067a0 0x7f5758164c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:57.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f5757fff700 1 -- 172.21.15.80:0/784078221 >> v1:172.21.15.80:6789/0 conn(0x7f57581500d0 legacy=0x7f5758105fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:57.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f5757fff700 1 -- 172.21.15.80:0/784078221 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57581048d0 con 0x7f575813e8e0 2019-11-28T11:40:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f575cd0b700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57581067a0 0x7f5758164c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:40:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f5757fff700 1 --2- 172.21.15.80:0/784078221 >> v2:172.21.15.174:3300/0 conn(0x7f575813e8e0 0x7f575814fb90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57480103b0 tx=0x7f5748010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f5757fff700 1 --2- 172.21.15.80:0/784078221 >> v2:172.21.15.174:3300/0 conn(0x7f575813e8e0 0x7f575814fb90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57480103b0 tx=0x7f5748010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f5757fff700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575813e8e0 0x7f575814fb90 secure :-1 s=READY pgs=813 cs=0 l=1 rx=0x7f57480103b0 tx=0x7f5748010750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f5757fff700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575813e8e0 0x7f575814fb90 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f57480103b0 tx=0x7f5748010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f57557fa700 1 -- 172.21.15.80:0/784078221 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5748000940 con 0x7f575813e8e0 2019-11-28T11:40:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f5757fff700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575813e8e0 0x7f575814fb90 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f57480103b0 tx=0x7f5748010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:57.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f57557fa700 1 -- 172.21.15.80:0/784078221 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5748005580 con 0x7f575813e8e0 2019-11-28T11:40:57.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f5757fff700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575813e8e0 0x7f575814fb90 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f57480103b0 tx=0x7f5748010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:57.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f575df6d700 1 -- 172.21.15.80:0/784078221 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5758104c50 con 0x7f575813e8e0 2019-11-28T11:40:57.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f57557fa700 1 -- 172.21.15.80:0/784078221 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5748005770 con 0x7f575813e8e0 2019-11-28T11:40:57.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.891+0000 7f575df6d700 1 -- 172.21.15.80:0/784078221 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57581048d0 con 0x7f575813e8e0 2019-11-28T11:40:57.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.892+0000 7f5757fff700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575813e8e0 0x7f575814fb90 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f57480103b0 tx=0x7f5748010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:57.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.892+0000 7f5757fff700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575813e8e0 0x7f575814fb90 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f57480103b0 tx=0x7f5748010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:57.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.892+0000 7f57557fa700 1 -- 172.21.15.80:0/784078221 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5748005770 con 0x7f575813e8e0 2019-11-28T11:40:57.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.892+0000 7f57557fa700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f573c018770 0x7f573c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:57.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.892+0000 7f57557fa700 1 -- 172.21.15.80:0/784078221 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f5748031a00 con 0x7f575813e8e0 2019-11-28T11:40:57.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.892+0000 7f574ffff700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f573c018770 0x7f573c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:57.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.892+0000 7f574ffff700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f573c018770 0x7f573c01abe0 crc :-1 s=READY pgs=568 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:57.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.899+0000 7f575df6d700 1 -- 172.21.15.80:0/784078221 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5758104c50 con 0x7f575813e8e0 2019-11-28T11:40:57.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.903+0000 7f5757fff700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575813e8e0 0x7f575814fb90 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f57480103b0 tx=0x7f5748010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:57.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:57.903+0000 7f57557fa700 1 -- 172.21.15.80:0/784078221 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5748014cf0 con 0x7f575813e8e0 2019-11-28T11:40:58.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.093+0000 7f575df6d700 1 -- 172.21.15.80:0/784078221 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f57581048d0 con 0x7f575813e8e0 2019-11-28T11:40:58.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.738+0000 7f5757fff700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575813e8e0 0x7f575814fb90 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f57480103b0 tx=0x7f5748010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:58.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.738+0000 7f57557fa700 1 -- 172.21.15.80:0/784078221 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v103) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5748014cf0 con 0x7f575813e8e0 2019-11-28T11:40:58.790 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:40:58.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.760+0000 7f575df6d700 1 -- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f573c018770 msgr2=0x7f573c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:58.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.760+0000 7f575df6d700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f573c018770 0x7f573c01abe0 crc :-1 s=READY pgs=568 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:58.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.760+0000 7f575df6d700 1 -- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575813e8e0 msgr2=0x7f575814fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:58.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.760+0000 7f575df6d700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575813e8e0 0x7f575814fb90 secure :-1 s=READY pgs=813 cs=0 l=1 rx=0x7f57480103b0 tx=0x7f5748010750).stop 2019-11-28T11:40:58.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.760+0000 7f575df6d700 1 -- 172.21.15.80:0/784078221 shutdown_connections 2019-11-28T11:40:58.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.760+0000 7f575df6d700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f573c018770 0x7f573c01abe0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:58.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.760+0000 7f575df6d700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57581067a0 0x7f5758164c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:58.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.760+0000 7f575df6d700 1 --2- 172.21.15.80:0/784078221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575813e8e0 0x7f575814fb90 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:58.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.760+0000 7f575df6d700 1 -- 172.21.15.80:0/784078221 shutdown_connections 2019-11-28T11:40:58.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.760+0000 7f575df6d700 1 -- 172.21.15.80:0/784078221 wait complete. 2019-11-28T11:40:58.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.760+0000 7f575df6d700 1 -- 172.21.15.80:0/784078221 >> 172.21.15.80:0/784078221 conn(0x7f575813d620 msgr2=0x7f575813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:58.803 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:40:58.803 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:40:58.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.890+0000 7f436e121700 1 Processor -- start 2019-11-28T11:40:58.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.890+0000 7f436e121700 1 -- start start 2019-11-28T11:40:58.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.891+0000 7f436e121700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f436806c0a0 0x7f4368072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:58.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.891+0000 7f436e121700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43680734e0 0x7f4368071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:58.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.891+0000 7f436e121700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4368072360 0x7f4368072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:58.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.891+0000 7f436e121700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436806fd60 con 0x7f4368072360 2019-11-28T11:40:58.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.891+0000 7f436e121700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4368070030 con 0x7f436806c0a0 2019-11-28T11:40:58.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.891+0000 7f436e121700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436806f330 con 0x7f43680734e0 2019-11-28T11:40:58.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.891+0000 7f436cebf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4368072360 0x7f4368072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:58.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.891+0000 7f436cebf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4368072360 0x7f4368072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38356/0 (socket says 172.21.15.80:38356) 2019-11-28T11:40:58.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.891+0000 7f436cebf700 1 -- 172.21.15.80:0/1920258077 learned_addr learned my addr 172.21.15.80:0/1920258077 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:58.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f435ffff700 1 --2- 172.21.15.80:0/1920258077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43680734e0 0x7f4368071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:58.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f4367fff700 1 --2- 172.21.15.80:0/1920258077 >> v2:172.21.15.174:3300/0 conn(0x7f436806c0a0 0x7f4368072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:58.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f436cebf700 1 -- 172.21.15.80:0/1920258077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43680734e0 msgr2=0x7f4368071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:58.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f436cebf700 1 --2- 172.21.15.80:0/1920258077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43680734e0 0x7f4368071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:58.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f436cebf700 1 -- 172.21.15.80:0/1920258077 >> v2:172.21.15.174:3300/0 conn(0x7f436806c0a0 msgr2=0x7f4368072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:58.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f436cebf700 1 --2- 172.21.15.80:0/1920258077 >> v2:172.21.15.174:3300/0 conn(0x7f436806c0a0 0x7f4368072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:58.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f436cebf700 1 -- 172.21.15.80:0/1920258077 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43680706c0 con 0x7f4368072360 2019-11-28T11:40:58.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f436cebf700 1 --2- 172.21.15.80:0/1920258077 >> v2:172.21.15.80:3300/0 conn(0x7f4368072360 0x7f4368072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f436000fa30 tx=0x7f43600080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:58.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f436cebf700 1 --2- 172.21.15.80:0/1920258077 >> v2:172.21.15.80:3300/0 conn(0x7f4368072360 0x7f4368072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f436000fa30 tx=0x7f43600080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:58.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f436cebf700 1 --2- 172.21.15.80:0/1920258077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4368072360 0x7f4368072800 secure :-1 s=READY pgs=1389 cs=0 l=1 rx=0x7f436000fa30 tx=0x7f43600080d0).ready entity=mon.0 client_cookie=c4ec5348daf186f0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:58.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f436cebf700 1 --2- 172.21.15.80:0/1920258077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4368072360 0x7f4368072800 secure :-1 s=THROTTLE_DONE pgs=1389 cs=0 l=1 rx=0x7f436000fa30 tx=0x7f43600080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:58.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f43677fe700 1 -- 172.21.15.80:0/1920258077 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4360000f20 con 0x7f4368072360 2019-11-28T11:40:58.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f436cebf700 1 --2- 172.21.15.80:0/1920258077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4368072360 0x7f4368072800 secure :-1 s=THROTTLE_DONE pgs=1389 cs=0 l=1 rx=0x7f436000fa30 tx=0x7f43600080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:58.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f436cebf700 1 --2- 172.21.15.80:0/1920258077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4368072360 0x7f4368072800 secure :-1 s=THROTTLE_DONE pgs=1389 cs=0 l=1 rx=0x7f436000fa30 tx=0x7f43600080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:58.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f43677fe700 1 -- 172.21.15.80:0/1920258077 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4360000f20 con 0x7f4368072360 2019-11-28T11:40:58.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f43677fe700 1 -- 172.21.15.80:0/1920258077 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4360001650 con 0x7f4368072360 2019-11-28T11:40:58.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f436e121700 1 -- 172.21.15.80:0/1920258077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4368072360 msgr2=0x7f4368072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:58.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.892+0000 7f436e121700 1 --2- 172.21.15.80:0/1920258077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4368072360 0x7f4368072800 secure :-1 s=READY pgs=1389 cs=0 l=1 rx=0x7f436000fa30 tx=0x7f43600080d0).stop 2019-11-28T11:40:58.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.893+0000 7f436e121700 1 -- 172.21.15.80:0/1920258077 shutdown_connections 2019-11-28T11:40:58.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.893+0000 7f436e121700 1 --2- 172.21.15.80:0/1920258077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4368072360 0x7f4368072800 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:58.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.893+0000 7f436e121700 1 --2- 172.21.15.80:0/1920258077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43680734e0 0x7f4368071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:58.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.893+0000 7f436e121700 1 --2- 172.21.15.80:0/1920258077 >> v2:172.21.15.174:3300/0 conn(0x7f436806c0a0 0x7f4368072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:58.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.893+0000 7f436e121700 1 -- 172.21.15.80:0/1920258077 shutdown_connections 2019-11-28T11:40:58.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.893+0000 7f436e121700 1 -- 172.21.15.80:0/1920258077 wait complete. 2019-11-28T11:40:58.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.893+0000 7f436e121700 1 -- 172.21.15.80:0/1920258077 >> 172.21.15.80:0/1920258077 conn(0x7f4368061cf0 msgr2=0x7f4368064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:58.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.895+0000 7f436e121700 1 Processor -- start 2019-11-28T11:40:58.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.895+0000 7f436e121700 1 -- start start 2019-11-28T11:40:58.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.896+0000 7f436e121700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4368103000 0x7f4368103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:58.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.896+0000 7f436e121700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f43681039d0 0x7f4368167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:58.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.896+0000 7f436e121700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43681312c0 con 0x7f436813dc00 2019-11-28T11:40:58.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.896+0000 7f436e121700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4368105830 con 0x7f43681039d0 2019-11-28T11:40:58.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.896+0000 7f436e121700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4368105b00 con 0x7f4368103000 2019-11-28T11:40:58.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.896+0000 7f4367fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f436813dc00 0x7f4368109e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37676/0 (socket says 172.21.15.80:37676) 2019-11-28T11:40:58.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.896+0000 7f4367fff700 1 -- 172.21.15.80:0/935375146 learned_addr learned my addr 172.21.15.80:0/935375146 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:58.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.896+0000 7f435ffff700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4368103000 0x7f4368103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:58.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.896+0000 7f436cebf700 1 --2- 172.21.15.80:0/935375146 >> v2:172.21.15.174:3300/0 conn(0x7f43681039d0 0x7f4368167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:58.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.896+0000 7f43657fa700 1 -- 172.21.15.80:0/935375146 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606001046 0 0) 0x7f43580010b0 con 0x7f436813dc00 2019-11-28T11:40:58.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.896+0000 7f43657fa700 1 -- 172.21.15.80:0/935375146 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4340002e80 con 0x7f436813dc00 2019-11-28T11:40:58.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f435ffff700 1 -- 172.21.15.80:0/935375146 >> v2:172.21.15.174:3300/0 conn(0x7f43681039d0 msgr2=0x7f4368167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:58.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f435ffff700 1 --2- 172.21.15.80:0/935375146 >> v2:172.21.15.174:3300/0 conn(0x7f43681039d0 0x7f4368167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:58.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f435ffff700 1 -- 172.21.15.80:0/935375146 >> v1:172.21.15.80:6789/0 conn(0x7f436813dc00 legacy=0x7f4368109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:58.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f43657fa700 1 -- 172.21.15.80:0/935375146 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3953184786 0 0) 0x7f43580012b0 con 0x7f436813dc00 2019-11-28T11:40:58.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f435ffff700 1 -- 172.21.15.80:0/935375146 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4368106190 con 0x7f4368103000 2019-11-28T11:40:58.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f436cebf700 1 --2- 172.21.15.80:0/935375146 >> v2:172.21.15.174:3300/0 conn(0x7f43681039d0 0x7f4368167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:40:58.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f435ffff700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4368103000 0x7f4368103490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4350010370 tx=0x7f4350010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:58.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f435ffff700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4368103000 0x7f4368103490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4350010370 tx=0x7f4350010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:58.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f435ffff700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4368103000 0x7f4368103490 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7f4350010370 tx=0x7f4350010710).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:58.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f435ffff700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4368103000 0x7f4368103490 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f4350010370 tx=0x7f4350010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:58.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f43657fa700 1 -- 172.21.15.80:0/935375146 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4350002a00 con 0x7f4368103000 2019-11-28T11:40:58.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f435ffff700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4368103000 0x7f4368103490 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f4350010370 tx=0x7f4350010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:58.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f436e121700 1 -- 172.21.15.80:0/935375146 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4368106510 con 0x7f4368103000 2019-11-28T11:40:58.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f43657fa700 1 -- 172.21.15.80:0/935375146 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4350002a00 con 0x7f4368103000 2019-11-28T11:40:58.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f435ffff700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4368103000 0x7f4368103490 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f4350010370 tx=0x7f4350010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:58.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f43657fa700 1 -- 172.21.15.80:0/935375146 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f435000bf40 con 0x7f4368103000 2019-11-28T11:40:58.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f436e121700 1 -- 172.21.15.80:0/935375146 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4368106190 con 0x7f4368103000 2019-11-28T11:40:58.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.897+0000 7f435ffff700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4368103000 0x7f4368103490 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f4350010370 tx=0x7f4350010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:58.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.898+0000 7f43657fa700 1 -- 172.21.15.80:0/935375146 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f435000bb60 con 0x7f4368103000 2019-11-28T11:40:58.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.898+0000 7f435ffff700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4368103000 0x7f4368103490 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f4350010370 tx=0x7f4350010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:58.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.898+0000 7f43657fa700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4340018780 0x7f434001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:58.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.898+0000 7f43657fa700 1 -- 172.21.15.80:0/935375146 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f43500319a0 con 0x7f4368103000 2019-11-28T11:40:58.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.898+0000 7f4367fff700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4340018780 0x7f434001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:58.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.898+0000 7f4367fff700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4340018780 0x7f434001abf0 crc :-1 s=READY pgs=569 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:58.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.905+0000 7f436e121700 1 -- 172.21.15.80:0/935375146 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4368106510 con 0x7f4368103000 2019-11-28T11:40:58.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.909+0000 7f435ffff700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4368103000 0x7f4368103490 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f4350010370 tx=0x7f4350010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:58.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:58.910+0000 7f43657fa700 1 -- 172.21.15.80:0/935375146 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f435000b950 con 0x7f4368103000 2019-11-28T11:40:59.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.078+0000 7f436e121700 1 -- 172.21.15.80:0/935375146 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4368106190 con 0x7f4368103000 2019-11-28T11:40:59.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.079+0000 7f435ffff700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4368103000 0x7f4368103490 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f4350010370 tx=0x7f4350010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.079+0000 7f43657fa700 1 -- 172.21.15.80:0/935375146 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v35) v1 ==== 80+0+4797 (secure 0 0 0) 0x7f435000bb60 con 0x7f4368103000 2019-11-28T11:40:59.112 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:59.112 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:40:59.112 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:40:59.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.112 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:40:59.112 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:40:59.113 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.113 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:40:59.113 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:40:59.113 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:40:59.114 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:40:59.114 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.114 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:40:59.114 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:40:59.114 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.115 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:40:59.115 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:40:59.115 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:40:59.115 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:40:59.115 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.116 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:40:59.116 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:40:59.116 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.116 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:40:59.116 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:40:59.116 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:40:59.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:40:59.117 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.117 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:40:59.118 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:40:59.118 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.118 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:40:59.118 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:40:59.118 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:40:59.119 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.120 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:40:59.120 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:40:59.120 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.120 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:40:59.121 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:40:59.121 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:40:59.121 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.122 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:40:59.122 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:40:59.122 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.122 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:40:59.122 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:40:59.123 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:40:59.123 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.124 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:40:59.124 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:40:59.124 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.125 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:40:59.125 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:40:59.125 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:40:59.125 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.126 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:40:59.126 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:40:59.126 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.126 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:40:59.127 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:40:59.127 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:40:59.127 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.128 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:40:59.128 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:40:59.128 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.128 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:40:59.129 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:40:59.129 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:40:59.129 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.130 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:40:59.130 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:40:59.130 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.130 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:40:59.131 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:40:59.131 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:40:59.131 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.132 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:40:59.132 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:40:59.132 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.132 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:40:59.133 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:40:59.133 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:40:59.133 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.134 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:40:59.134 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:40:59.134 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.135 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:40:59.135 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:40:59.135 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:40:59.135 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.136 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:40:59.136 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:40:59.136 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.137 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:40:59.137 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:40:59.137 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:40:59.137 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.138 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:40:59.138 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:40:59.138 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.138 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:40:59.139 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:40:59.139 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:40:59.139 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.140 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:40:59.140 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:40:59.140 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.140 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:40:59.140 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:40:59.141 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:40:59.141 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.141 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:40:59.142 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:40:59.142 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.142 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:40:59.143 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:40:59.143 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:40:59.143 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:40:59.143 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.144 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:40:59.144 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:40:59.145 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.145 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:40:59.145 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:40:59.145 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:40:59.146 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:40:59.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:40:59.146 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:40:59.146 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:40:59.147 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:40:59.147 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:40:59.147 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:40:59.147 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:40:59.147 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.148 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:40:59.148 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:40:59.148 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:40:59.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.080+0000 7f436e121700 1 -- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4340018780 msgr2=0x7f434001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.080+0000 7f436e121700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4340018780 0x7f434001abf0 crc :-1 s=READY pgs=569 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:59.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.081+0000 7f436e121700 1 -- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4368103000 msgr2=0x7f4368103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.081+0000 7f436e121700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4368103000 0x7f4368103490 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7f4350010370 tx=0x7f4350010710).stop 2019-11-28T11:40:59.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.081+0000 7f436e121700 1 -- 172.21.15.80:0/935375146 shutdown_connections 2019-11-28T11:40:59.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.081+0000 7f436e121700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4340018780 0x7f434001abf0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:59.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.081+0000 7f436e121700 1 --2- 172.21.15.80:0/935375146 >> v2:172.21.15.174:3300/0 conn(0x7f43681039d0 0x7f4368167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:59.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.081+0000 7f436e121700 1 --2- 172.21.15.80:0/935375146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4368103000 0x7f4368103490 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:59.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.081+0000 7f436e121700 1 -- 172.21.15.80:0/935375146 shutdown_connections 2019-11-28T11:40:59.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.081+0000 7f436e121700 1 -- 172.21.15.80:0/935375146 wait complete. 2019-11-28T11:40:59.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.081+0000 7f436e121700 1 -- 172.21.15.80:0/935375146 >> 172.21.15.80:0/935375146 conn(0x7f436811bfc0 msgr2=0x7f4368141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:59.154 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:40:59.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.241+0000 7fd2b98a3700 1 Processor -- start 2019-11-28T11:40:59.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.241+0000 7fd2b98a3700 1 -- start start 2019-11-28T11:40:59.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.241+0000 7fd2b98a3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2b406c0a0 0x7fd2b4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:59.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b98a3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd2b4072620 0x7fd2b4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:59.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b98a3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b406db00 con 0x7fd2b40734e0 2019-11-28T11:40:59.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b98a3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b406fd60 con 0x7fd2b406c0a0 2019-11-28T11:40:59.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b98a3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b4070030 con 0x7fd2b4072620 2019-11-28T11:40:59.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b37fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2b406c0a0 0x7fd2b4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:59.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b37fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2b406c0a0 0x7fd2b4072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38368/0 (socket says 172.21.15.80:38368) 2019-11-28T11:40:59.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b2ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd2b40734e0 0x7fd2b4071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37688/0 (socket says 172.21.15.80:37688) 2019-11-28T11:40:59.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b37fe700 1 -- 172.21.15.80:0/2208334481 learned_addr learned my addr 172.21.15.80:0/2208334481 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:59.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b3fff700 1 --2- 172.21.15.80:0/2208334481 >> v2:172.21.15.174:3300/0 conn(0x7fd2b4072620 0x7fd2b4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:59.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b37fe700 1 -- 172.21.15.80:0/2208334481 >> v2:172.21.15.174:3300/0 conn(0x7fd2b4072620 msgr2=0x7fd2b4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:59.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b37fe700 1 --2- 172.21.15.80:0/2208334481 >> v2:172.21.15.174:3300/0 conn(0x7fd2b4072620 0x7fd2b4164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:59.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b37fe700 1 -- 172.21.15.80:0/2208334481 >> v1:172.21.15.80:6789/0 conn(0x7fd2b40734e0 legacy=0x7fd2b4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b37fe700 1 -- 172.21.15.80:0/2208334481 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b40706c0 con 0x7fd2b406c0a0 2019-11-28T11:40:59.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b27fc700 1 -- 172.21.15.80:0/2208334481 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456462625 0 0) 0x7fd29c001070 con 0x7fd2b40734e0 2019-11-28T11:40:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b37fe700 1 --2- 172.21.15.80:0/2208334481 >> v2:172.21.15.80:3300/0 conn(0x7fd2b406c0a0 0x7fd2b4072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2a400f6c0 tx=0x7fd2a400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b37fe700 1 --2- 172.21.15.80:0/2208334481 >> v2:172.21.15.80:3300/0 conn(0x7fd2b406c0a0 0x7fd2b4072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2a400f6c0 tx=0x7fd2a400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b37fe700 1 --2- 172.21.15.80:0/2208334481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b406c0a0 0x7fd2b4072fa0 secure :-1 s=READY pgs=1392 cs=0 l=1 rx=0x7fd2a400f6c0 tx=0x7fd2a400fa60).ready entity=mon.0 client_cookie=7f11a412c212396 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b37fe700 1 --2- 172.21.15.80:0/2208334481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b406c0a0 0x7fd2b4072fa0 secure :-1 s=THROTTLE_DONE pgs=1392 cs=0 l=1 rx=0x7fd2a400f6c0 tx=0x7fd2a400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b27fc700 1 -- 172.21.15.80:0/2208334481 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2a4000960 con 0x7fd2b406c0a0 2019-11-28T11:40:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b37fe700 1 --2- 172.21.15.80:0/2208334481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b406c0a0 0x7fd2b4072fa0 secure :-1 s=THROTTLE_DONE pgs=1392 cs=0 l=1 rx=0x7fd2a400f6c0 tx=0x7fd2a400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b37fe700 1 --2- 172.21.15.80:0/2208334481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b406c0a0 0x7fd2b4072fa0 secure :-1 s=THROTTLE_DONE pgs=1392 cs=0 l=1 rx=0x7fd2a400f6c0 tx=0x7fd2a400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b27fc700 1 -- 172.21.15.80:0/2208334481 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a4000c90 con 0x7fd2b406c0a0 2019-11-28T11:40:59.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b27fc700 1 -- 172.21.15.80:0/2208334481 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2a4000f80 con 0x7fd2b406c0a0 2019-11-28T11:40:59.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b98a3700 1 -- 172.21.15.80:0/2208334481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b406c0a0 msgr2=0x7fd2b4072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.242+0000 7fd2b98a3700 1 --2- 172.21.15.80:0/2208334481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b406c0a0 0x7fd2b4072fa0 secure :-1 s=READY pgs=1392 cs=0 l=1 rx=0x7fd2a400f6c0 tx=0x7fd2a400fa60).stop 2019-11-28T11:40:59.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.243+0000 7fd2b98a3700 1 -- 172.21.15.80:0/2208334481 shutdown_connections 2019-11-28T11:40:59.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.243+0000 7fd2b98a3700 1 --2- 172.21.15.80:0/2208334481 >> v2:172.21.15.174:3300/0 conn(0x7fd2b4072620 0x7fd2b4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:59.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.243+0000 7fd2b98a3700 1 --2- 172.21.15.80:0/2208334481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b406c0a0 0x7fd2b4072fa0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:59.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.243+0000 7fd2b98a3700 1 -- 172.21.15.80:0/2208334481 shutdown_connections 2019-11-28T11:40:59.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.243+0000 7fd2b98a3700 1 -- 172.21.15.80:0/2208334481 wait complete. 2019-11-28T11:40:59.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.243+0000 7fd2b98a3700 1 -- 172.21.15.80:0/2208334481 >> 172.21.15.80:0/2208334481 conn(0x7fd2b4061cf0 msgr2=0x7fd2b4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:59.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.245+0000 7fd2b98a3700 1 Processor -- start 2019-11-28T11:40:59.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.246+0000 7fd2b98a3700 1 -- start start 2019-11-28T11:40:59.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.246+0000 7fd2b98a3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd2b4167c30 0x7fd2b416a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:59.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.246+0000 7fd2b98a3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b4112970 con 0x7fd2b4162fd0 2019-11-28T11:40:59.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.246+0000 7fd2b98a3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b4112e20 con 0x7fd2b41633c0 2019-11-28T11:40:59.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2b98a3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b41146d0 con 0x7fd2b4167c30 2019-11-28T11:40:59.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2b37fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd2b4162fd0 0x7fd2b4119b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37690/0 (socket says 172.21.15.80:37690) 2019-11-28T11:40:59.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2b37fe700 1 -- 172.21.15.80:0/3787281800 learned_addr learned my addr 172.21.15.80:0/3787281800 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:59.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2b3fff700 1 --2- 172.21.15.80:0/3787281800 >> v2:172.21.15.174:3300/0 conn(0x7fd2b4167c30 0x7fd2b416a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:59.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2abfff700 1 -- 172.21.15.80:0/3787281800 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623014361 0 0) 0x7fd2a4007da0 con 0x7fd2b4162fd0 2019-11-28T11:40:59.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2abfff700 1 -- 172.21.15.80:0/3787281800 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd298002e80 con 0x7fd2b4162fd0 2019-11-28T11:40:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2abfff700 1 -- 172.21.15.80:0/3787281800 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951700904 0 0) 0x7fd29c001280 con 0x7fd2b41633c0 2019-11-28T11:40:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2abfff700 1 -- 172.21.15.80:0/3787281800 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2980030b0 con 0x7fd2b41633c0 2019-11-28T11:40:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2abfff700 1 -- 172.21.15.80:0/3787281800 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1085152828 0 0) 0x7fd2a40081b0 con 0x7fd2b4162fd0 2019-11-28T11:40:59.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2abfff700 1 -- 172.21.15.80:0/3787281800 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd2980033c0 con 0x7fd2b4162fd0 2019-11-28T11:40:59.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2abfff700 1 -- 172.21.15.80:0/3787281800 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd2a4007810 con 0x7fd2b4162fd0 2019-11-28T11:40:59.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2b3fff700 1 -- 172.21.15.80:0/3787281800 >> v1:172.21.15.174:6789/0 conn(0x7fd2b41633c0 legacy=0x7fd2b4114a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2b3fff700 1 -- 172.21.15.80:0/3787281800 >> v1:172.21.15.80:6789/0 conn(0x7fd2b4162fd0 legacy=0x7fd2b4119b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2b3fff700 1 -- 172.21.15.80:0/3787281800 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b41172d0 con 0x7fd2b4167c30 2019-11-28T11:40:59.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2b3fff700 1 --2- 172.21.15.80:0/3787281800 >> v2:172.21.15.174:3300/0 conn(0x7fd2b4167c30 0x7fd2b416a030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2ac010710 tx=0x7fd2ac010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2b3fff700 1 --2- 172.21.15.80:0/3787281800 >> v2:172.21.15.174:3300/0 conn(0x7fd2b4167c30 0x7fd2b416a030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2ac010710 tx=0x7fd2ac010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2b3fff700 1 --2- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b4167c30 0x7fd2b416a030 secure :-1 s=READY pgs=815 cs=0 l=1 rx=0x7fd2ac010710 tx=0x7fd2ac010ab0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:59.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2b3fff700 1 --2- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b4167c30 0x7fd2b416a030 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7fd2ac010710 tx=0x7fd2ac010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2abfff700 1 -- 172.21.15.80:0/3787281800 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2ac009d30 con 0x7fd2b4167c30 2019-11-28T11:40:59.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2b3fff700 1 --2- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b4167c30 0x7fd2b416a030 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7fd2ac010710 tx=0x7fd2ac010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2abfff700 1 -- 172.21.15.80:0/3787281800 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac000f80 con 0x7fd2b4167c30 2019-11-28T11:40:59.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2b3fff700 1 --2- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b4167c30 0x7fd2b416a030 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7fd2ac010710 tx=0x7fd2ac010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2b98a3700 1 -- 172.21.15.80:0/3787281800 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b4117650 con 0x7fd2b4167c30 2019-11-28T11:40:59.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.247+0000 7fd2abfff700 1 -- 172.21.15.80:0/3787281800 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2ac00a0c0 con 0x7fd2b4167c30 2019-11-28T11:40:59.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.248+0000 7fd2b98a3700 1 -- 172.21.15.80:0/3787281800 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b41172d0 con 0x7fd2b4167c30 2019-11-28T11:40:59.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.248+0000 7fd2b3fff700 1 --2- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b4167c30 0x7fd2b416a030 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7fd2ac010710 tx=0x7fd2ac010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.248+0000 7fd2abfff700 1 -- 172.21.15.80:0/3787281800 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd2ac00ee00 con 0x7fd2b4167c30 2019-11-28T11:40:59.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.248+0000 7fd2b3fff700 1 --2- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b4167c30 0x7fd2b416a030 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7fd2ac010710 tx=0x7fd2ac010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.248+0000 7fd2abfff700 1 --2- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd2980187a0 0x7fd29801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:59.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.248+0000 7fd2abfff700 1 -- 172.21.15.80:0/3787281800 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fd2ac031dc0 con 0x7fd2b4167c30 2019-11-28T11:40:59.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.248+0000 7fd2b37fe700 1 --2- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd2980187a0 0x7fd29801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:59.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.249+0000 7fd2b37fe700 1 --2- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd2980187a0 0x7fd29801abf0 crc :-1 s=READY pgs=570 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:59.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.256+0000 7fd2b98a3700 1 -- 172.21.15.80:0/3787281800 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b4117650 con 0x7fd2b4167c30 2019-11-28T11:40:59.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.260+0000 7fd2b3fff700 1 --2- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b4167c30 0x7fd2b416a030 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7fd2ac010710 tx=0x7fd2ac010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.260+0000 7fd2abfff700 1 -- 172.21.15.80:0/3787281800 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd2ac014290 con 0x7fd2b4167c30 2019-11-28T11:40:59.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.435+0000 7fd2b98a3700 1 -- 172.21.15.80:0/3787281800 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2b41172d0 con 0x7fd2b4167c30 2019-11-28T11:40:59.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.436+0000 7fd2b3fff700 1 --2- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b4167c30 0x7fd2b416a030 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7fd2ac010710 tx=0x7fd2ac010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.436+0000 7fd2abfff700 1 -- 172.21.15.80:0/3787281800 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+12002 (secure 0 0 0) 0x7fd2ac014290 con 0x7fd2b4167c30 2019-11-28T11:40:59.469 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:40:59.469 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":103,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:40:58.729792+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:40:59.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.437+0000 7fd2b98a3700 1 -- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd2980187a0 msgr2=0x7fd29801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.437+0000 7fd2b98a3700 1 --2- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd2980187a0 0x7fd29801abf0 crc :-1 s=READY pgs=570 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:59.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.437+0000 7fd2b98a3700 1 -- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b4167c30 msgr2=0x7fd2b416a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.437+0000 7fd2b98a3700 1 --2- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b4167c30 0x7fd2b416a030 secure :-1 s=READY pgs=815 cs=0 l=1 rx=0x7fd2ac010710 tx=0x7fd2ac010ab0).stop 2019-11-28T11:40:59.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.438+0000 7fd2b98a3700 1 -- 172.21.15.80:0/3787281800 shutdown_connections 2019-11-28T11:40:59.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.438+0000 7fd2b98a3700 1 --2- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2b4167c30 0x7fd2b416a030 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:59.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.438+0000 7fd2b98a3700 1 --2- 172.21.15.80:0/3787281800 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd2980187a0 0x7fd29801abf0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:59.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.438+0000 7fd2b98a3700 1 -- 172.21.15.80:0/3787281800 shutdown_connections 2019-11-28T11:40:59.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.438+0000 7fd2b98a3700 1 -- 172.21.15.80:0/3787281800 wait complete. 2019-11-28T11:40:59.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.438+0000 7fd2b98a3700 1 -- 172.21.15.80:0/3787281800 >> 172.21.15.80:0/3787281800 conn(0x7fd2b4141f40 msgr2=0x7fd2b414fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:59.481 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:40:59.482 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:40:59.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.571+0000 7f352eb1a700 1 Processor -- start 2019-11-28T11:40:59.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.571+0000 7f352eb1a700 1 -- start start 2019-11-28T11:40:59.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.572+0000 7f352eb1a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f352815f100 0x7f352806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:59.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.572+0000 7f352eb1a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352806db60 con 0x7f352806c2f0 2019-11-28T11:40:59.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.572+0000 7f352eb1a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352806e060 con 0x7f352815ed10 2019-11-28T11:40:59.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.572+0000 7f352eb1a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352806fe00 con 0x7f352815f100 2019-11-28T11:40:59.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f352c8b6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f352815f100 0x7f352806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:59.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f352c8b6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f352815f100 0x7f352806bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38386/0 (socket says 172.21.15.80:38386) 2019-11-28T11:40:59.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f352d8b8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f352806c2f0 0x7f352806c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37700/0 (socket says 172.21.15.80:37700) 2019-11-28T11:40:59.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f352c8b6700 1 -- 172.21.15.80:0/3833546633 learned_addr learned my addr 172.21.15.80:0/3833546633 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:59.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f352c8b6700 1 -- 172.21.15.80:0/3833546633 >> v1:172.21.15.174:6789/0 conn(0x7f352815ed10 legacy=0x7f3528073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f352c8b6700 1 -- 172.21.15.80:0/3833546633 >> v1:172.21.15.80:6789/0 conn(0x7f352806c2f0 legacy=0x7f352806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f352c8b6700 1 -- 172.21.15.80:0/3833546633 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3528070760 con 0x7f352815f100 2019-11-28T11:40:59.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f3527fff700 1 -- 172.21.15.80:0/3833546633 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480145136 0 0) 0x7f35200009b0 con 0x7f352806c2f0 2019-11-28T11:40:59.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f352c8b6700 1 --2- 172.21.15.80:0/3833546633 >> v2:172.21.15.80:3300/0 conn(0x7f352815f100 0x7f352806bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f351000fac0 tx=0x7f351000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f352c8b6700 1 --2- 172.21.15.80:0/3833546633 >> v2:172.21.15.80:3300/0 conn(0x7f352815f100 0x7f352806bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f351000fac0 tx=0x7f351000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f352c8b6700 1 --2- 172.21.15.80:0/3833546633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352815f100 0x7f352806bdb0 secure :-1 s=READY pgs=1395 cs=0 l=1 rx=0x7f351000fac0 tx=0x7f351000fe60).ready entity=mon.0 client_cookie=bd1d505baa9b1dc5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:59.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f352c8b6700 1 --2- 172.21.15.80:0/3833546633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352815f100 0x7f352806bdb0 secure :-1 s=THROTTLE_DONE pgs=1395 cs=0 l=1 rx=0x7f351000fac0 tx=0x7f351000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f3527fff700 1 -- 172.21.15.80:0/3833546633 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3510000ce0 con 0x7f352815f100 2019-11-28T11:40:59.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f352c8b6700 1 --2- 172.21.15.80:0/3833546633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352815f100 0x7f352806bdb0 secure :-1 s=THROTTLE_DONE pgs=1395 cs=0 l=1 rx=0x7f351000fac0 tx=0x7f351000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f352c8b6700 1 --2- 172.21.15.80:0/3833546633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352815f100 0x7f352806bdb0 secure :-1 s=THROTTLE_DONE pgs=1395 cs=0 l=1 rx=0x7f351000fac0 tx=0x7f351000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f3527fff700 1 -- 172.21.15.80:0/3833546633 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3510001010 con 0x7f352815f100 2019-11-28T11:40:59.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f3527fff700 1 -- 172.21.15.80:0/3833546633 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3510000ce0 con 0x7f352815f100 2019-11-28T11:40:59.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f352eb1a700 1 -- 172.21.15.80:0/3833546633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352815f100 msgr2=0x7f352806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.573+0000 7f352eb1a700 1 --2- 172.21.15.80:0/3833546633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352815f100 0x7f352806bdb0 secure :-1 s=READY pgs=1395 cs=0 l=1 rx=0x7f351000fac0 tx=0x7f351000fe60).stop 2019-11-28T11:40:59.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.574+0000 7f352eb1a700 1 -- 172.21.15.80:0/3833546633 shutdown_connections 2019-11-28T11:40:59.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.574+0000 7f352eb1a700 1 --2- 172.21.15.80:0/3833546633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352815f100 0x7f352806bdb0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:59.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.574+0000 7f352eb1a700 1 -- 172.21.15.80:0/3833546633 shutdown_connections 2019-11-28T11:40:59.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.574+0000 7f352eb1a700 1 -- 172.21.15.80:0/3833546633 wait complete. 2019-11-28T11:40:59.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.574+0000 7f352eb1a700 1 -- 172.21.15.80:0/3833546633 >> 172.21.15.80:0/3833546633 conn(0x7f3528061d20 msgr2=0x7f35280641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:59.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.577+0000 7f352eb1a700 1 Processor -- start 2019-11-28T11:40:59.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.577+0000 7f352eb1a700 1 -- start start 2019-11-28T11:40:59.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352eb1a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f352810ed60 0x7f352810f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:59.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352eb1a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f352810f730 0x7f3528167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:59.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352eb1a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352810c250 con 0x7f352810e970 2019-11-28T11:40:59.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352eb1a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352810e430 con 0x7f352810f730 2019-11-28T11:40:59.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352eb1a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3528105860 con 0x7f352810ed60 2019-11-28T11:40:59.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352d0b7700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f352810e970 0x7f35281087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37704/0 (socket says 172.21.15.80:37704) 2019-11-28T11:40:59.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352d0b7700 1 -- 172.21.15.80:0/49529575 learned_addr learned my addr 172.21.15.80:0/49529575 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:59.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352d8b8700 1 --2- 172.21.15.80:0/49529575 >> v2:172.21.15.80:3300/0 conn(0x7f352810f730 0x7f3528167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:59.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f3525ffb700 1 -- 172.21.15.80:0/49529575 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719715363 0 0) 0x7f3518001150 con 0x7f352810e970 2019-11-28T11:40:59.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f3525ffb700 1 -- 172.21.15.80:0/49529575 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f350c002e80 con 0x7f352810e970 2019-11-28T11:40:59.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352d8b8700 1 -- 172.21.15.80:0/49529575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f352810ed60 msgr2=0x7f352810f1f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2019-11-28T11:40:59.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352d8b8700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f352810ed60 0x7f352810f1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:59.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352d8b8700 1 -- 172.21.15.80:0/49529575 >> v1:172.21.15.80:6789/0 conn(0x7f352810e970 legacy=0x7f35281087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352d8b8700 1 -- 172.21.15.80:0/49529575 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3528105ef0 con 0x7f352810f730 2019-11-28T11:40:59.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352d8b8700 1 --2- 172.21.15.80:0/49529575 >> v2:172.21.15.80:3300/0 conn(0x7f352810f730 0x7f3528167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3520010380 tx=0x7f35200101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352d8b8700 1 --2- 172.21.15.80:0/49529575 >> v2:172.21.15.80:3300/0 conn(0x7f352810f730 0x7f3528167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3520010380 tx=0x7f35200101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352d8b8700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352810f730 0x7f3528167d70 secure :-1 s=READY pgs=1397 cs=0 l=1 rx=0x7f3520010380 tx=0x7f35200101b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:59.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352d8b8700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352810f730 0x7f3528167d70 secure :-1 s=THROTTLE_DONE pgs=1397 cs=0 l=1 rx=0x7f3520010380 tx=0x7f35200101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f3525ffb700 1 -- 172.21.15.80:0/49529575 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3520000940 con 0x7f352810f730 2019-11-28T11:40:59.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352d8b8700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352810f730 0x7f3528167d70 secure :-1 s=THROTTLE_DONE pgs=1397 cs=0 l=1 rx=0x7f3520010380 tx=0x7f35200101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352d8b8700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352810f730 0x7f3528167d70 secure :-1 s=THROTTLE_DONE pgs=1397 cs=0 l=1 rx=0x7f3520010380 tx=0x7f35200101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f3525ffb700 1 -- 172.21.15.80:0/49529575 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3520001380 con 0x7f352810f730 2019-11-28T11:40:59.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f3525ffb700 1 -- 172.21.15.80:0/49529575 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3520001a50 con 0x7f352810f730 2019-11-28T11:40:59.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352eb1a700 1 -- 172.21.15.80:0/49529575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3528106270 con 0x7f352810f730 2019-11-28T11:40:59.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.578+0000 7f352eb1a700 1 -- 172.21.15.80:0/49529575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3528105ef0 con 0x7f352810f730 2019-11-28T11:40:59.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.579+0000 7f352d8b8700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352810f730 0x7f3528167d70 secure :-1 s=THROTTLE_DONE pgs=1397 cs=0 l=1 rx=0x7f3520010380 tx=0x7f35200101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.579+0000 7f3525ffb700 1 -- 172.21.15.80:0/49529575 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3520000940 con 0x7f352810f730 2019-11-28T11:40:59.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.579+0000 7f352d8b8700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352810f730 0x7f3528167d70 secure :-1 s=THROTTLE_DONE pgs=1397 cs=0 l=1 rx=0x7f3520010380 tx=0x7f35200101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.579+0000 7f3525ffb700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f350c018770 0x7f350c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:59.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.579+0000 7f3525ffb700 1 -- 172.21.15.80:0/49529575 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f35200319b0 con 0x7f352810f730 2019-11-28T11:40:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.580+0000 7f352d0b7700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f350c018770 0x7f350c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.581+0000 7f352d0b7700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f350c018770 0x7f350c01abe0 crc :-1 s=READY pgs=571 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.587+0000 7f352eb1a700 1 -- 172.21.15.80:0/49529575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3528106270 con 0x7f352810f730 2019-11-28T11:40:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.590+0000 7f352d8b8700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352810f730 0x7f3528167d70 secure :-1 s=THROTTLE_DONE pgs=1397 cs=0 l=1 rx=0x7f3520010380 tx=0x7f35200101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.590+0000 7f3525ffb700 1 -- 172.21.15.80:0/49529575 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f35200275d0 con 0x7f352810f730 2019-11-28T11:40:59.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.757+0000 7f352eb1a700 1 -- 172.21.15.80:0/49529575 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f3528105ef0 con 0x7f352810f730 2019-11-28T11:40:59.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.757+0000 7f352d8b8700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352810f730 0x7f3528167d70 secure :-1 s=THROTTLE_DONE pgs=1397 cs=0 l=1 rx=0x7f3520010380 tx=0x7f35200101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.757+0000 7f3525ffb700 1 -- 172.21.15.80:0/49529575 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v103) v1 ==== 92+0+10 (secure 0 0 0) 0x7f35200275d0 con 0x7f352810f730 2019-11-28T11:40:59.791 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:40:59.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.760+0000 7f352eb1a700 1 -- 172.21.15.80:0/49529575 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f350c018770 msgr2=0x7f350c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.760+0000 7f352eb1a700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f350c018770 0x7f350c01abe0 crc :-1 s=READY pgs=571 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:59.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.760+0000 7f352eb1a700 1 -- 172.21.15.80:0/49529575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352810f730 msgr2=0x7f3528167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.760+0000 7f352eb1a700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352810f730 0x7f3528167d70 secure :-1 s=READY pgs=1397 cs=0 l=1 rx=0x7f3520010380 tx=0x7f35200101b0).stop 2019-11-28T11:40:59.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.760+0000 7f352eb1a700 1 -- 172.21.15.80:0/49529575 shutdown_connections 2019-11-28T11:40:59.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.760+0000 7f352eb1a700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f350c018770 0x7f350c01abe0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:59.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.760+0000 7f352eb1a700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f352810f730 0x7f3528167d70 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:59.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.760+0000 7f352eb1a700 1 --2- 172.21.15.80:0/49529575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f352810ed60 0x7f352810f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:59.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.760+0000 7f352eb1a700 1 -- 172.21.15.80:0/49529575 shutdown_connections 2019-11-28T11:40:59.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.760+0000 7f352eb1a700 1 -- 172.21.15.80:0/49529575 wait complete. 2019-11-28T11:40:59.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.760+0000 7f352eb1a700 1 -- 172.21.15.80:0/49529575 >> 172.21.15.80:0/49529575 conn(0x7f352815e2d0 msgr2=0x7f3528147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:59.803 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:40:59.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.889+0000 7f25e25f5700 1 Processor -- start 2019-11-28T11:40:59.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.889+0000 7f25e25f5700 1 -- start start 2019-11-28T11:40:59.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.890+0000 7f25e25f5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25dc06c490 0x7f25dc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:59.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.890+0000 7f25e25f5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25dc06db00 con 0x7f25dc06ce60 2019-11-28T11:40:59.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.890+0000 7f25e25f5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25dc06e000 con 0x7f25dc06c0a0 2019-11-28T11:40:59.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.890+0000 7f25e25f5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc06fd60 con 0x7f25dc06c490 2019-11-28T11:40:59.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.890+0000 7f25e1393700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f25dc06ce60 0x7f25dc164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37712/0 (socket says 172.21.15.80:37712) 2019-11-28T11:40:59.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.890+0000 7f25e1393700 1 -- 172.21.15.80:0/4036073873 learned_addr learned my addr 172.21.15.80:0/4036073873 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:40:59.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.890+0000 7f25db7fe700 1 -- 172.21.15.80:0/4036073873 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980634728 0 0) 0x7f25d4001150 con 0x7f25dc06ce60 2019-11-28T11:40:59.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.890+0000 7f25dbfff700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25dc06c490 0x7f25dc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:59.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.890+0000 7f25db7fe700 1 -- 172.21.15.80:0/4036073873 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25c8002e80 con 0x7f25dc06ce60 2019-11-28T11:40:59.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25db7fe700 1 -- 172.21.15.80:0/4036073873 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3274600335 0 0) 0x7f25d4001130 con 0x7f25dc06ce60 2019-11-28T11:40:59.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25db7fe700 1 -- 172.21.15.80:0/4036073873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25dc06c490 msgr2=0x7f25dc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:59.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25db7fe700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25dc06c490 0x7f25dc06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:59.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25db7fe700 1 -- 172.21.15.80:0/4036073873 >> v1:172.21.15.174:6789/0 conn(0x7f25dc06c0a0 legacy=0x7f25dc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25db7fe700 1 -- 172.21.15.80:0/4036073873 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc0706c0 con 0x7f25dc06ce60 2019-11-28T11:40:59.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25db7fe700 1 -- 172.21.15.80:0/4036073873 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f25d4001660 con 0x7f25dc06ce60 2019-11-28T11:40:59.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25db7fe700 1 -- 172.21.15.80:0/4036073873 >> v1:172.21.15.80:6789/0 conn(0x7f25dc06ce60 legacy=0x7f25dc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25db7fe700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25c8003ab0 0x7f25c8005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:59.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25db7fe700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c8006670 0x7f25c8008b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:59.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25db7fe700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25c8009300 0x7f25c800b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:40:59.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25db7fe700 1 -- 172.21.15.80:0/4036073873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c800bfe0 con 0x7f25c8006670 2019-11-28T11:40:59.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25dbfff700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c8006670 0x7f25c8008b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:59.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25db7fe700 1 -- 172.21.15.80:0/4036073873 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80501e0 con 0x7f25c8009300 2019-11-28T11:40:59.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25db7fe700 1 -- 172.21.15.80:0/4036073873 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c8050410 con 0x7f25c8003ab0 2019-11-28T11:40:59.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25e0b92700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25c8003ab0 0x7f25c8005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:59.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25e1393700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25c8009300 0x7f25c800b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:59.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25dbfff700 1 -- 172.21.15.80:0/4036073873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25c8003ab0 msgr2=0x7f25c8005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:59.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25dbfff700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25c8003ab0 0x7f25c8005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:59.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25dbfff700 1 -- 172.21.15.80:0/4036073873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25c8009300 msgr2=0x7f25c800b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:40:59.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25dbfff700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25c8009300 0x7f25c800b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:40:59.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25dbfff700 1 -- 172.21.15.80:0/4036073873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c80506c0 con 0x7f25c8006670 2019-11-28T11:40:59.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25e1393700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25c8009300 0x7f25c800b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:40:59.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25dbfff700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c8006670 0x7f25c8008b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f25cc00b3b0 tx=0x7f25cc00bb50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25dbfff700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c8006670 0x7f25c8008b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f25cc00b3b0 tx=0x7f25cc00bb50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25dbfff700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c8006670 0x7f25c8008b00 secure :-1 s=READY pgs=1399 cs=0 l=1 rx=0x7f25cc00b3b0 tx=0x7f25cc00bb50).ready entity=mon.0 client_cookie=542b993123ffb819 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:59.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25dbfff700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c8006670 0x7f25c8008b00 secure :-1 s=THROTTLE_DONE pgs=1399 cs=0 l=1 rx=0x7f25cc00b3b0 tx=0x7f25cc00bb50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25db7fe700 1 -- 172.21.15.80:0/4036073873 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25cc00aa60 con 0x7f25c8006670 2019-11-28T11:40:59.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25dbfff700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c8006670 0x7f25c8008b00 secure :-1 s=THROTTLE_DONE pgs=1399 cs=0 l=1 rx=0x7f25cc00b3b0 tx=0x7f25cc00bb50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25dbfff700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c8006670 0x7f25c8008b00 secure :-1 s=THROTTLE_DONE pgs=1399 cs=0 l=1 rx=0x7f25cc00b3b0 tx=0x7f25cc00bb50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25db7fe700 1 -- 172.21.15.80:0/4036073873 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25cc005500 con 0x7f25c8006670 2019-11-28T11:40:59.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25db7fe700 1 -- 172.21.15.80:0/4036073873 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25cc009ce0 con 0x7f25c8006670 2019-11-28T11:40:59.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25e25f5700 1 -- 172.21.15.80:0/4036073873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c8006670 msgr2=0x7f25c8008b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25e25f5700 1 --2- 172.21.15.80:0/4036073873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c8006670 0x7f25c8008b00 secure :-1 s=READY pgs=1399 cs=0 l=1 rx=0x7f25cc00b3b0 tx=0x7f25cc00bb50).stop 2019-11-28T11:40:59.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.891+0000 7f25e1393700 1 -- 172.21.15.80:0/4036073873 reap_dead start 2019-11-28T11:40:59.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.892+0000 7f25e25f5700 1 -- 172.21.15.80:0/4036073873 shutdown_connections 2019-11-28T11:40:59.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.892+0000 7f25e25f5700 1 -- 172.21.15.80:0/4036073873 shutdown_connections 2019-11-28T11:40:59.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.892+0000 7f25e25f5700 1 -- 172.21.15.80:0/4036073873 wait complete. 2019-11-28T11:40:59.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.892+0000 7f25e25f5700 1 -- 172.21.15.80:0/4036073873 >> 172.21.15.80:0/4036073873 conn(0x7f25dc061cf0 msgr2=0x7f25dc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:40:59.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.895+0000 7f25e25f5700 1 Processor -- start 2019-11-28T11:40:59.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.895+0000 7f25e25f5700 1 -- start start 2019-11-28T11:40:59.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e25f5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25dc074d00 0x7f25dc0750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:59.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e25f5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f25dc153040 0x7f25dc140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:59.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e25f5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25dc079230 con 0x7f25dc152bd0 2019-11-28T11:40:59.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e25f5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25dc079e30 con 0x7f25dc153040 2019-11-28T11:40:59.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e25f5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc07a100 con 0x7f25dc074d00 2019-11-28T11:40:59.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e1393700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f25dc153040 0x7f25dc140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:59.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e1393700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f25dc153040 0x7f25dc140c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38410/0 (socket says 172.21.15.80:38410) 2019-11-28T11:40:59.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e1393700 1 -- 172.21.15.80:0/2504563036 learned_addr learned my addr 172.21.15.80:0/2504563036 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:40:59.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e0b92700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25dc074d00 0x7f25dc0750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:59.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e1393700 1 -- 172.21.15.80:0/2504563036 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25dc074d00 msgr2=0x7f25dc0750f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e1393700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25dc074d00 0x7f25dc0750f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:40:59.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e1393700 1 -- 172.21.15.80:0/2504563036 >> v1:172.21.15.174:6789/0 conn(0x7f25dc152bd0 legacy=0x7f25dc140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:40:59.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e1393700 1 -- 172.21.15.80:0/2504563036 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc07b490 con 0x7f25dc153040 2019-11-28T11:40:59.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e1393700 1 --2- 172.21.15.80:0/2504563036 >> v2:172.21.15.80:3300/0 conn(0x7f25dc153040 0x7f25dc140c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25d4010440 tx=0x7f25d4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e1393700 1 --2- 172.21.15.80:0/2504563036 >> v2:172.21.15.80:3300/0 conn(0x7f25dc153040 0x7f25dc140c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25d4010440 tx=0x7f25d4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e1393700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc153040 0x7f25dc140c40 secure :-1 s=READY pgs=1400 cs=0 l=1 rx=0x7f25d4010440 tx=0x7f25d4010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:59.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e1393700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc153040 0x7f25dc140c40 secure :-1 s=THROTTLE_DONE pgs=1400 cs=0 l=1 rx=0x7f25d4010440 tx=0x7f25d4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e1393700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc153040 0x7f25dc140c40 secure :-1 s=THROTTLE_DONE pgs=1400 cs=0 l=1 rx=0x7f25d4010440 tx=0x7f25d4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25d97fa700 1 -- 172.21.15.80:0/2504563036 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25d4001660 con 0x7f25dc153040 2019-11-28T11:40:59.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e1393700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc153040 0x7f25dc140c40 secure :-1 s=THROTTLE_DONE pgs=1400 cs=0 l=1 rx=0x7f25d4010440 tx=0x7f25d4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25d97fa700 1 -- 172.21.15.80:0/2504563036 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d4004240 con 0x7f25dc153040 2019-11-28T11:40:59.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25d97fa700 1 -- 172.21.15.80:0/2504563036 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25d40048d0 con 0x7f25dc153040 2019-11-28T11:40:59.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e25f5700 1 -- 172.21.15.80:0/2504563036 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25dc07b810 con 0x7f25dc153040 2019-11-28T11:40:59.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.896+0000 7f25e25f5700 1 -- 172.21.15.80:0/2504563036 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25dc07b490 con 0x7f25dc153040 2019-11-28T11:40:59.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.897+0000 7f25e1393700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc153040 0x7f25dc140c40 secure :-1 s=THROTTLE_DONE pgs=1400 cs=0 l=1 rx=0x7f25d4010440 tx=0x7f25d4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.897+0000 7f25d97fa700 1 -- 172.21.15.80:0/2504563036 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f25d4004430 con 0x7f25dc153040 2019-11-28T11:40:59.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.897+0000 7f25e1393700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc153040 0x7f25dc140c40 secure :-1 s=THROTTLE_DONE pgs=1400 cs=0 l=1 rx=0x7f25d4010440 tx=0x7f25d4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.897+0000 7f25d97fa700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f25c0018730 0x7f25c001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:40:59.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.897+0000 7f25d97fa700 1 -- 172.21.15.80:0/2504563036 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f25d4031a80 con 0x7f25dc153040 2019-11-28T11:40:59.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.897+0000 7f25e0b92700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f25c0018730 0x7f25c001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:40:59.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.897+0000 7f25e0b92700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f25c0018730 0x7f25c001abc0 crc :-1 s=READY pgs=572 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:40:59.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.904+0000 7f25e25f5700 1 -- 172.21.15.80:0/2504563036 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25dc07b810 con 0x7f25dc153040 2019-11-28T11:40:59.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.908+0000 7f25e1393700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc153040 0x7f25dc140c40 secure :-1 s=THROTTLE_DONE pgs=1400 cs=0 l=1 rx=0x7f25d4010440 tx=0x7f25d4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:40:59.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:40:59.908+0000 7f25d97fa700 1 -- 172.21.15.80:0/2504563036 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f25d4000940 con 0x7f25dc153040 2019-11-28T11:41:00.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.072+0000 7f25e25f5700 1 -- 172.21.15.80:0/2504563036 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f25dc07b490 con 0x7f25dc153040 2019-11-28T11:41:00.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.072+0000 7f25e1393700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc153040 0x7f25dc140c40 secure :-1 s=THROTTLE_DONE pgs=1400 cs=0 l=1 rx=0x7f25d4010440 tx=0x7f25d4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.072+0000 7f25d97fa700 1 -- 172.21.15.80:0/2504563036 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v103) v1 ==== 84+0+64 (secure 0 0 0) 0x7f25d4004430 con 0x7f25dc153040 2019-11-28T11:41:00.106 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:00.106 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:41:00.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:00.106 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:41:00.106 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:41:00.107 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:00.107 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:41:00.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.075+0000 7f25e25f5700 1 -- 172.21.15.80:0/2504563036 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f25c0018730 msgr2=0x7f25c001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:00.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.075+0000 7f25e25f5700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f25c0018730 0x7f25c001abc0 crc :-1 s=READY pgs=572 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:00.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.075+0000 7f25e25f5700 1 -- 172.21.15.80:0/2504563036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc153040 msgr2=0x7f25dc140c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:00.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.075+0000 7f25e25f5700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc153040 0x7f25dc140c40 secure :-1 s=READY pgs=1400 cs=0 l=1 rx=0x7f25d4010440 tx=0x7f25d4010270).stop 2019-11-28T11:41:00.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.075+0000 7f25e25f5700 1 -- 172.21.15.80:0/2504563036 shutdown_connections 2019-11-28T11:41:00.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.075+0000 7f25e25f5700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25dc153040 0x7f25dc140c40 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:00.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.075+0000 7f25e25f5700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f25c0018730 0x7f25c001abc0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:00.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.075+0000 7f25e25f5700 1 --2- 172.21.15.80:0/2504563036 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f25dc074d00 0x7f25dc0750f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:00.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.075+0000 7f25e25f5700 1 -- 172.21.15.80:0/2504563036 shutdown_connections 2019-11-28T11:41:00.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.075+0000 7f25e25f5700 1 -- 172.21.15.80:0/2504563036 wait complete. 2019-11-28T11:41:00.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.075+0000 7f25e25f5700 1 -- 172.21.15.80:0/2504563036 >> 172.21.15.80:0/2504563036 conn(0x7f25dc13fa50 msgr2=0x7f25dc07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:00.117 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:41:00.118 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:41:00.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.209+0000 7fc081688700 1 Processor -- start 2019-11-28T11:41:00.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.209+0000 7fc081688700 1 -- start start 2019-11-28T11:41:00.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.210+0000 7fc081688700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc07c15f100 0x7fc07c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:00.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.210+0000 7fc081688700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc07c06c2f0 0x7fc07c06c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:00.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.210+0000 7fc081688700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07c06db60 con 0x7fc07c15ed10 2019-11-28T11:41:00.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.210+0000 7fc081688700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07c06fe00 con 0x7fc07c15f100 2019-11-28T11:41:00.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.210+0000 7fc081688700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0700d0 con 0x7fc07c06c2f0 2019-11-28T11:41:00.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.210+0000 7fc07b7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc07c15ed10 0x7fc07c073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37730/0 (socket says 172.21.15.80:37730) 2019-11-28T11:41:00.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.210+0000 7fc07b7fe700 1 -- 172.21.15.80:0/3828283344 learned_addr learned my addr 172.21.15.80:0/3828283344 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:00.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.210+0000 7fc07bfff700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc07c06c2f0 0x7fc07c06c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:00.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.210+0000 7fc07affd700 1 --2- 172.21.15.80:0/3828283344 >> v2:172.21.15.174:3300/0 conn(0x7fc07c15f100 0x7fc07c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:00.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.210+0000 7fc07a7fc700 1 -- 172.21.15.80:0/3828283344 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474322592 0 0) 0x7fc06c001150 con 0x7fc07c15ed10 2019-11-28T11:41:00.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.210+0000 7fc07a7fc700 1 -- 172.21.15.80:0/3828283344 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc05c002e80 con 0x7fc07c15ed10 2019-11-28T11:41:00.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 -- 172.21.15.80:0/3828283344 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2508692513 0 0) 0x7fc06c001130 con 0x7fc07c15ed10 2019-11-28T11:41:00.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 -- 172.21.15.80:0/3828283344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc07c06c2f0 msgr2=0x7fc07c06c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:00.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc07c06c2f0 0x7fc07c06c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:00.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 -- 172.21.15.80:0/3828283344 >> v2:172.21.15.174:3300/0 conn(0x7fc07c15f100 msgr2=0x7fc07c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:00.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 --2- 172.21.15.80:0/3828283344 >> v2:172.21.15.174:3300/0 conn(0x7fc07c15f100 0x7fc07c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:00.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 -- 172.21.15.80:0/3828283344 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c070760 con 0x7fc07c15ed10 2019-11-28T11:41:00.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 -- 172.21.15.80:0/3828283344 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc06c001660 con 0x7fc07c15ed10 2019-11-28T11:41:00.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 -- 172.21.15.80:0/3828283344 >> v1:172.21.15.80:6789/0 conn(0x7fc07c15ed10 legacy=0x7fc07c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:00.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc05c0479e0 0x7fc05c049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:00.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05c04a5c0 0x7fc05c04ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:00.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc05c04d270 0x7fc05c04f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:00.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 -- 172.21.15.80:0/3828283344 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c04ff50 con 0x7fc05c04a5c0 2019-11-28T11:41:00.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 -- 172.21.15.80:0/3828283344 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c050140 con 0x7fc05c04d270 2019-11-28T11:41:00.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 -- 172.21.15.80:0/3828283344 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c050370 con 0x7fc05c0479e0 2019-11-28T11:41:00.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07affd700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05c04a5c0 0x7fc05c04ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:00.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07b7fe700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc05c0479e0 0x7fc05c049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:00.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07bfff700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc05c04d270 0x7fc05c04f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:00.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07affd700 1 -- 172.21.15.80:0/3828283344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc05c0479e0 msgr2=0x7fc05c049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:00.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07affd700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc05c0479e0 0x7fc05c049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:00.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07affd700 1 -- 172.21.15.80:0/3828283344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc05c04d270 msgr2=0x7fc05c04f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:00.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07affd700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc05c04d270 0x7fc05c04f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:00.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07affd700 1 -- 172.21.15.80:0/3828283344 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c050620 con 0x7fc05c04a5c0 2019-11-28T11:41:00.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07affd700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05c04a5c0 0x7fc05c04ca70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc06400b9e0 tx=0x7fc06400b8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07affd700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05c04a5c0 0x7fc05c04ca70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc06400b9e0 tx=0x7fc06400b8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07affd700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05c04a5c0 0x7fc05c04ca70 secure :-1 s=READY pgs=1402 cs=0 l=1 rx=0x7fc06400b9e0 tx=0x7fc06400b8b0).ready entity=mon.0 client_cookie=117521217bd00bbe server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:00.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07affd700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05c04a5c0 0x7fc05c04ca70 secure :-1 s=THROTTLE_DONE pgs=1402 cs=0 l=1 rx=0x7fc06400b9e0 tx=0x7fc06400b8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 -- 172.21.15.80:0/3828283344 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc064000ce0 con 0x7fc05c04a5c0 2019-11-28T11:41:00.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07affd700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05c04a5c0 0x7fc05c04ca70 secure :-1 s=THROTTLE_DONE pgs=1402 cs=0 l=1 rx=0x7fc06400b9e0 tx=0x7fc06400b8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07affd700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05c04a5c0 0x7fc05c04ca70 secure :-1 s=THROTTLE_DONE pgs=1402 cs=0 l=1 rx=0x7fc06400b9e0 tx=0x7fc06400b8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 -- 172.21.15.80:0/3828283344 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc064009d00 con 0x7fc05c04a5c0 2019-11-28T11:41:00.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07a7fc700 1 -- 172.21.15.80:0/3828283344 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc064000ce0 con 0x7fc05c04a5c0 2019-11-28T11:41:00.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc081688700 1 -- 172.21.15.80:0/3828283344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05c04a5c0 msgr2=0x7fc05c04ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:00.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc081688700 1 --2- 172.21.15.80:0/3828283344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc05c04a5c0 0x7fc05c04ca70 secure :-1 s=READY pgs=1402 cs=0 l=1 rx=0x7fc06400b9e0 tx=0x7fc06400b8b0).stop 2019-11-28T11:41:00.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.211+0000 7fc07bfff700 1 -- 172.21.15.80:0/3828283344 reap_dead start 2019-11-28T11:41:00.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.212+0000 7fc081688700 1 -- 172.21.15.80:0/3828283344 shutdown_connections 2019-11-28T11:41:00.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.212+0000 7fc081688700 1 -- 172.21.15.80:0/3828283344 shutdown_connections 2019-11-28T11:41:00.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.212+0000 7fc081688700 1 -- 172.21.15.80:0/3828283344 wait complete. 2019-11-28T11:41:00.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.212+0000 7fc081688700 1 -- 172.21.15.80:0/3828283344 >> 172.21.15.80:0/3828283344 conn(0x7fc07c061d20 msgr2=0x7fc07c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:00.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.215+0000 7fc081688700 1 Processor -- start 2019-11-28T11:41:00.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.215+0000 7fc081688700 1 -- start start 2019-11-28T11:41:00.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc081688700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc07c108630 0x7fc07c152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:00.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc081688700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc07c1527a0 0x7fc07c12c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:00.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc081688700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc07c12c7e0 0x7fc07c14b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:00.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc081688700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07c12ee80 con 0x7fc07c12c7e0 2019-11-28T11:41:00.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc081688700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07c131fc0 con 0x7fc07c1527a0 2019-11-28T11:41:00.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc081688700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c1329f0 con 0x7fc07c108630 2019-11-28T11:41:00.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc07bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc07c12c7e0 0x7fc07c14b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:00.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc07bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc07c12c7e0 0x7fc07c14b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38430/0 (socket says 172.21.15.80:38430) 2019-11-28T11:41:00.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc07bfff700 1 -- 172.21.15.80:0/2808397446 learned_addr learned my addr 172.21.15.80:0/2808397446 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:00.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc07b7fe700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc07c108630 0x7fc07c152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:00.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc07affd700 1 --2- 172.21.15.80:0/2808397446 >> v2:172.21.15.174:3300/0 conn(0x7fc07c1527a0 0x7fc07c12c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:00.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc07bfff700 1 -- 172.21.15.80:0/2808397446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc07c108630 msgr2=0x7fc07c152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:00.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc07bfff700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc07c108630 0x7fc07c152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:00.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc07bfff700 1 -- 172.21.15.80:0/2808397446 >> v2:172.21.15.174:3300/0 conn(0x7fc07c1527a0 msgr2=0x7fc07c12c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:00.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc07bfff700 1 --2- 172.21.15.80:0/2808397446 >> v2:172.21.15.174:3300/0 conn(0x7fc07c1527a0 0x7fc07c12c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:00.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc07bfff700 1 -- 172.21.15.80:0/2808397446 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c133350 con 0x7fc07c12c7e0 2019-11-28T11:41:00.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc07bfff700 1 --2- 172.21.15.80:0/2808397446 >> v2:172.21.15.80:3300/0 conn(0x7fc07c12c7e0 0x7fc07c14b0e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc0740103b0 tx=0x7fc074010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc07bfff700 1 --2- 172.21.15.80:0/2808397446 >> v2:172.21.15.80:3300/0 conn(0x7fc07c12c7e0 0x7fc07c14b0e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc0740103b0 tx=0x7fc074010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc07bfff700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc07c12c7e0 0x7fc07c14b0e0 secure :-1 s=READY pgs=1403 cs=0 l=1 rx=0x7fc0740103b0 tx=0x7fc074010260).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:00.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc07bfff700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc07c12c7e0 0x7fc07c14b0e0 secure :-1 s=THROTTLE_DONE pgs=1403 cs=0 l=1 rx=0x7fc0740103b0 tx=0x7fc074010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc07bfff700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc07c12c7e0 0x7fc07c14b0e0 secure :-1 s=THROTTLE_DONE pgs=1403 cs=0 l=1 rx=0x7fc0740103b0 tx=0x7fc074010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc073fff700 1 -- 172.21.15.80:0/2808397446 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc074000b10 con 0x7fc07c12c7e0 2019-11-28T11:41:00.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc07bfff700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc07c12c7e0 0x7fc07c14b0e0 secure :-1 s=THROTTLE_DONE pgs=1403 cs=0 l=1 rx=0x7fc0740103b0 tx=0x7fc074010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc073fff700 1 -- 172.21.15.80:0/2808397446 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07400ec90 con 0x7fc07c12c7e0 2019-11-28T11:41:00.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc081688700 1 -- 172.21.15.80:0/2808397446 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07c1336d0 con 0x7fc07c12c7e0 2019-11-28T11:41:00.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc073fff700 1 -- 172.21.15.80:0/2808397446 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc07400f320 con 0x7fc07c12c7e0 2019-11-28T11:41:00.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.216+0000 7fc081688700 1 -- 172.21.15.80:0/2808397446 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07c133350 con 0x7fc07c12c7e0 2019-11-28T11:41:00.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.217+0000 7fc07bfff700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc07c12c7e0 0x7fc07c14b0e0 secure :-1 s=THROTTLE_DONE pgs=1403 cs=0 l=1 rx=0x7fc0740103b0 tx=0x7fc074010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.217+0000 7fc073fff700 1 -- 172.21.15.80:0/2808397446 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc074000a70 con 0x7fc07c12c7e0 2019-11-28T11:41:00.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.217+0000 7fc07bfff700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc07c12c7e0 0x7fc07c14b0e0 secure :-1 s=THROTTLE_DONE pgs=1403 cs=0 l=1 rx=0x7fc0740103b0 tx=0x7fc074010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.217+0000 7fc073fff700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc054018730 0x7fc05401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:00.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.217+0000 7fc073fff700 1 -- 172.21.15.80:0/2808397446 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fc0740319d0 con 0x7fc07c12c7e0 2019-11-28T11:41:00.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.217+0000 7fc07b7fe700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc054018730 0x7fc05401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:00.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.218+0000 7fc07b7fe700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc054018730 0x7fc05401abc0 crc :-1 s=READY pgs=573 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:00.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.224+0000 7fc081688700 1 -- 172.21.15.80:0/2808397446 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc07c1336d0 con 0x7fc07c12c7e0 2019-11-28T11:41:00.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.228+0000 7fc07bfff700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc07c12c7e0 0x7fc07c14b0e0 secure :-1 s=THROTTLE_DONE pgs=1403 cs=0 l=1 rx=0x7fc0740103b0 tx=0x7fc074010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.228+0000 7fc073fff700 1 -- 172.21.15.80:0/2808397446 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc07400ea80 con 0x7fc07c12c7e0 2019-11-28T11:41:00.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.397+0000 7fc081688700 1 -- 172.21.15.80:0/2808397446 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7fc07c133350 con 0x7fc07c12c7e0 2019-11-28T11:41:00.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.747+0000 7fc07bfff700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc07c12c7e0 0x7fc07c14b0e0 secure :-1 s=THROTTLE_DONE pgs=1403 cs=0 l=1 rx=0x7fc0740103b0 tx=0x7fc074010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.747+0000 7fc073fff700 1 -- 172.21.15.80:0/2808397446 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v104) v1 ==== 133+0+0 (secure 0 0 0) 0x7fc07400ea80 con 0x7fc07c12c7e0 2019-11-28T11:41:00.793 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:41:00.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.763+0000 7fc081688700 1 -- 172.21.15.80:0/2808397446 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc054018730 msgr2=0x7fc05401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:00.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.763+0000 7fc081688700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc054018730 0x7fc05401abc0 crc :-1 s=READY pgs=573 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:00.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.763+0000 7fc081688700 1 -- 172.21.15.80:0/2808397446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc07c12c7e0 msgr2=0x7fc07c14b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:00.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.763+0000 7fc081688700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc07c12c7e0 0x7fc07c14b0e0 secure :-1 s=READY pgs=1403 cs=0 l=1 rx=0x7fc0740103b0 tx=0x7fc074010260).stop 2019-11-28T11:41:00.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.763+0000 7fc081688700 1 -- 172.21.15.80:0/2808397446 shutdown_connections 2019-11-28T11:41:00.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.763+0000 7fc081688700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc054018730 0x7fc05401abc0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:00.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.763+0000 7fc081688700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc07c12c7e0 0x7fc07c14b0e0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:00.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.763+0000 7fc081688700 1 --2- 172.21.15.80:0/2808397446 >> v2:172.21.15.174:3300/0 conn(0x7fc07c1527a0 0x7fc07c12c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:00.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.763+0000 7fc081688700 1 --2- 172.21.15.80:0/2808397446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc07c108630 0x7fc07c152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:00.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.763+0000 7fc081688700 1 -- 172.21.15.80:0/2808397446 shutdown_connections 2019-11-28T11:41:00.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.763+0000 7fc081688700 1 -- 172.21.15.80:0/2808397446 wait complete. 2019-11-28T11:41:00.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.763+0000 7fc081688700 1 -- 172.21.15.80:0/2808397446 >> 172.21.15.80:0/2808397446 conn(0x7fc07c14dbb0 msgr2=0x7fc07c142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:00.806 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:41:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.898+0000 7f01475b5700 1 Processor -- start 2019-11-28T11:41:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.898+0000 7f01475b5700 1 -- start start 2019-11-28T11:41:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.899+0000 7f01475b5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01401639f0 0x7f0140165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:00.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.899+0000 7f01475b5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014006db60 con 0x7f014015f100 2019-11-28T11:41:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.899+0000 7f01475b5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014006e060 con 0x7f014015ed10 2019-11-28T11:41:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.899+0000 7f01475b5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014006fe00 con 0x7f01401639f0 2019-11-28T11:41:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.899+0000 7f0146353700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01401639f0 0x7f0140165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.899+0000 7f0145351700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f014015f100 0x7f014006bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37754/0 (socket says 172.21.15.80:37754) 2019-11-28T11:41:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.899+0000 7f0145351700 1 -- 172.21.15.80:0/210517449 learned_addr learned my addr 172.21.15.80:0/210517449 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:00.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.899+0000 7f0146353700 1 -- 172.21.15.80:0/210517449 >> v1:172.21.15.174:6789/0 conn(0x7f014015ed10 legacy=0x7f0140073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:00.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.899+0000 7f0146353700 1 -- 172.21.15.80:0/210517449 >> v1:172.21.15.80:6789/0 conn(0x7f014015f100 legacy=0x7f014006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:00.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.899+0000 7f0146353700 1 -- 172.21.15.80:0/210517449 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0140070760 con 0x7f01401639f0 2019-11-28T11:41:00.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.899+0000 7f0144b50700 1 -- 172.21.15.80:0/210517449 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912161275 0 0) 0x7f0128001150 con 0x7f014015f100 2019-11-28T11:41:00.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.899+0000 7f0146353700 1 --2- 172.21.15.80:0/210517449 >> v2:172.21.15.80:3300/0 conn(0x7f01401639f0 0x7f0140165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f013800af50 tx=0x7f013800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.899+0000 7f0146353700 1 --2- 172.21.15.80:0/210517449 >> v2:172.21.15.80:3300/0 conn(0x7f01401639f0 0x7f0140165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f013800af50 tx=0x7f013800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.899+0000 7f0146353700 1 --2- 172.21.15.80:0/210517449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01401639f0 0x7f0140165df0 secure :-1 s=READY pgs=1405 cs=0 l=1 rx=0x7f013800af50 tx=0x7f013800b760).ready entity=mon.0 client_cookie=f3d9911a52284d6d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:00.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.900+0000 7f0146353700 1 --2- 172.21.15.80:0/210517449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01401639f0 0x7f0140165df0 secure :-1 s=THROTTLE_DONE pgs=1405 cs=0 l=1 rx=0x7f013800af50 tx=0x7f013800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.900+0000 7f0144b50700 1 -- 172.21.15.80:0/210517449 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0138009ba0 con 0x7f01401639f0 2019-11-28T11:41:00.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.900+0000 7f0146353700 1 --2- 172.21.15.80:0/210517449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01401639f0 0x7f0140165df0 secure :-1 s=THROTTLE_DONE pgs=1405 cs=0 l=1 rx=0x7f013800af50 tx=0x7f013800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.900+0000 7f0146353700 1 --2- 172.21.15.80:0/210517449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01401639f0 0x7f0140165df0 secure :-1 s=THROTTLE_DONE pgs=1405 cs=0 l=1 rx=0x7f013800af50 tx=0x7f013800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.900+0000 7f0144b50700 1 -- 172.21.15.80:0/210517449 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0138000a70 con 0x7f01401639f0 2019-11-28T11:41:00.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.900+0000 7f0144b50700 1 -- 172.21.15.80:0/210517449 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f013800a180 con 0x7f01401639f0 2019-11-28T11:41:00.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.900+0000 7f01475b5700 1 -- 172.21.15.80:0/210517449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01401639f0 msgr2=0x7f0140165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:00.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.900+0000 7f01475b5700 1 --2- 172.21.15.80:0/210517449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01401639f0 0x7f0140165df0 secure :-1 s=READY pgs=1405 cs=0 l=1 rx=0x7f013800af50 tx=0x7f013800b760).stop 2019-11-28T11:41:00.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.900+0000 7f01475b5700 1 -- 172.21.15.80:0/210517449 shutdown_connections 2019-11-28T11:41:00.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.900+0000 7f01475b5700 1 --2- 172.21.15.80:0/210517449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01401639f0 0x7f0140165df0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:00.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.900+0000 7f01475b5700 1 -- 172.21.15.80:0/210517449 shutdown_connections 2019-11-28T11:41:00.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.901+0000 7f01475b5700 1 -- 172.21.15.80:0/210517449 wait complete. 2019-11-28T11:41:00.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.901+0000 7f01475b5700 1 -- 172.21.15.80:0/210517449 >> 172.21.15.80:0/210517449 conn(0x7f0140061d20 msgr2=0x7f01400641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:00.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.903+0000 7f01475b5700 1 Processor -- start 2019-11-28T11:41:00.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.903+0000 7f01475b5700 1 -- start start 2019-11-28T11:41:00.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f01475b5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f014010e970 0x7f01401087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:00.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f01475b5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0140108cf0 0x7f0140107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:00.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f01475b5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0140107b70 0x7f0140107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:00.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f01475b5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014010e430 con 0x7f0140108cf0 2019-11-28T11:41:00.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f01475b5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0140105860 con 0x7f014010e970 2019-11-28T11:41:00.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f01475b5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014010da00 con 0x7f0140107b70 2019-11-28T11:41:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f0145351700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0140108cf0 0x7f0140107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f0145351700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0140108cf0 0x7f0140107630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38442/0 (socket says 172.21.15.80:38442) 2019-11-28T11:41:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f0145351700 1 -- 172.21.15.80:0/2365012726 learned_addr learned my addr 172.21.15.80:0/2365012726 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f0146353700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0140107b70 0x7f0140107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f0145b52700 1 --2- 172.21.15.80:0/2365012726 >> v2:172.21.15.174:3300/0 conn(0x7f014010e970 0x7f01401087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f0145351700 1 -- 172.21.15.80:0/2365012726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0140107b70 msgr2=0x7f0140107fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:00.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f0145351700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0140107b70 0x7f0140107fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:00.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f0145351700 1 -- 172.21.15.80:0/2365012726 >> v2:172.21.15.174:3300/0 conn(0x7f014010e970 msgr2=0x7f01401087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:00.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f0145351700 1 --2- 172.21.15.80:0/2365012726 >> v2:172.21.15.174:3300/0 conn(0x7f014010e970 0x7f01401087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:00.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f0145351700 1 -- 172.21.15.80:0/2365012726 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0140105ef0 con 0x7f0140108cf0 2019-11-28T11:41:00.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f0145351700 1 --2- 172.21.15.80:0/2365012726 >> v2:172.21.15.80:3300/0 conn(0x7f0140108cf0 0x7f0140107630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f01280125c0 tx=0x7f01280102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f0145351700 1 --2- 172.21.15.80:0/2365012726 >> v2:172.21.15.80:3300/0 conn(0x7f0140108cf0 0x7f0140107630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f01280125c0 tx=0x7f01280102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f0145351700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0140108cf0 0x7f0140107630 secure :-1 s=READY pgs=1406 cs=0 l=1 rx=0x7f01280125c0 tx=0x7f01280102e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:00.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f0145351700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0140108cf0 0x7f0140107630 secure :-1 s=THROTTLE_DONE pgs=1406 cs=0 l=1 rx=0x7f01280125c0 tx=0x7f01280102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f0145351700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0140108cf0 0x7f0140107630 secure :-1 s=THROTTLE_DONE pgs=1406 cs=0 l=1 rx=0x7f01280125c0 tx=0x7f01280102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f013e7fc700 1 -- 172.21.15.80:0/2365012726 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0128000ef0 con 0x7f0140108cf0 2019-11-28T11:41:00.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f0145351700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0140108cf0 0x7f0140107630 secure :-1 s=THROTTLE_DONE pgs=1406 cs=0 l=1 rx=0x7f01280125c0 tx=0x7f01280102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f013e7fc700 1 -- 172.21.15.80:0/2365012726 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0128004430 con 0x7f0140108cf0 2019-11-28T11:41:00.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f01475b5700 1 -- 172.21.15.80:0/2365012726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0140106270 con 0x7f0140108cf0 2019-11-28T11:41:00.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.904+0000 7f013e7fc700 1 -- 172.21.15.80:0/2365012726 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0128004b00 con 0x7f0140108cf0 2019-11-28T11:41:00.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.905+0000 7f01475b5700 1 -- 172.21.15.80:0/2365012726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0140105ef0 con 0x7f0140108cf0 2019-11-28T11:41:00.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.905+0000 7f0145351700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0140108cf0 0x7f0140107630 secure :-1 s=THROTTLE_DONE pgs=1406 cs=0 l=1 rx=0x7f01280125c0 tx=0x7f01280102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.905+0000 7f013e7fc700 1 -- 172.21.15.80:0/2365012726 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0128004620 con 0x7f0140108cf0 2019-11-28T11:41:00.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.905+0000 7f0145351700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0140108cf0 0x7f0140107630 secure :-1 s=THROTTLE_DONE pgs=1406 cs=0 l=1 rx=0x7f01280125c0 tx=0x7f01280102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.905+0000 7f013e7fc700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0124018730 0x7f012401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:00.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.905+0000 7f013e7fc700 1 -- 172.21.15.80:0/2365012726 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f0128033bf0 con 0x7f0140108cf0 2019-11-28T11:41:00.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.906+0000 7f0145b52700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0124018730 0x7f012401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:00.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.906+0000 7f0145b52700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0124018730 0x7f012401abc0 crc :-1 s=READY pgs=574 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:00.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.913+0000 7f01475b5700 1 -- 172.21.15.80:0/2365012726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0140106270 con 0x7f0140108cf0 2019-11-28T11:41:00.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.917+0000 7f0145351700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0140108cf0 0x7f0140107630 secure :-1 s=THROTTLE_DONE pgs=1406 cs=0 l=1 rx=0x7f01280125c0 tx=0x7f01280102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:00.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:00.917+0000 7f013e7fc700 1 -- 172.21.15.80:0/2365012726 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f01280012b0 con 0x7f0140108cf0 2019-11-28T11:41:01.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.087+0000 7f01475b5700 1 -- 172.21.15.80:0/2365012726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f0140105ef0 con 0x7f0140108cf0 2019-11-28T11:41:01.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.753+0000 7f0145351700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0140108cf0 0x7f0140107630 secure :-1 s=THROTTLE_DONE pgs=1406 cs=0 l=1 rx=0x7f01280125c0 tx=0x7f01280102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:01.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.753+0000 7f013e7fc700 1 -- 172.21.15.80:0/2365012726 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v105) v1 ==== 125+0+0 (secure 0 0 0) 0x7f0128021a10 con 0x7f0140108cf0 2019-11-28T11:41:01.835 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:41:01.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.804+0000 7f01475b5700 1 -- 172.21.15.80:0/2365012726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0124018730 msgr2=0x7f012401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:01.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.804+0000 7f01475b5700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0124018730 0x7f012401abc0 crc :-1 s=READY pgs=574 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:01.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.804+0000 7f01475b5700 1 -- 172.21.15.80:0/2365012726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0140108cf0 msgr2=0x7f0140107630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:01.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.804+0000 7f01475b5700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0140108cf0 0x7f0140107630 secure :-1 s=READY pgs=1406 cs=0 l=1 rx=0x7f01280125c0 tx=0x7f01280102e0).stop 2019-11-28T11:41:01.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.804+0000 7f01475b5700 1 -- 172.21.15.80:0/2365012726 shutdown_connections 2019-11-28T11:41:01.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.804+0000 7f01475b5700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0124018730 0x7f012401abc0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:01.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.804+0000 7f01475b5700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0140107b70 0x7f0140107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:01.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.804+0000 7f01475b5700 1 --2- 172.21.15.80:0/2365012726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0140108cf0 0x7f0140107630 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:01.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.804+0000 7f01475b5700 1 --2- 172.21.15.80:0/2365012726 >> v2:172.21.15.174:3300/0 conn(0x7f014010e970 0x7f01401087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:01.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.805+0000 7f01475b5700 1 -- 172.21.15.80:0/2365012726 shutdown_connections 2019-11-28T11:41:01.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.805+0000 7f01475b5700 1 -- 172.21.15.80:0/2365012726 wait complete. 2019-11-28T11:41:01.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.805+0000 7f01475b5700 1 -- 172.21.15.80:0/2365012726 >> 172.21.15.80:0/2365012726 conn(0x7f014015e2d0 msgr2=0x7f0140147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:01.847 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:41:01.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.937+0000 7f9eeb069700 1 Processor -- start 2019-11-28T11:41:01.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.937+0000 7f9eeb069700 1 -- start start 2019-11-28T11:41:01.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.938+0000 7f9eeb069700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ee415f100 0x7f9ee406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:01.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.938+0000 7f9eeb069700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee406db60 con 0x7f9ee406c2f0 2019-11-28T11:41:01.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.938+0000 7f9eeb069700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee406e060 con 0x7f9ee415ed10 2019-11-28T11:41:01.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.938+0000 7f9eeb069700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee406fe00 con 0x7f9ee415f100 2019-11-28T11:41:01.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.938+0000 7f9ee9e07700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9ee406c2f0 0x7f9ee406c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37766/0 (socket says 172.21.15.80:37766) 2019-11-28T11:41:01.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.938+0000 7f9ee9e07700 1 -- 172.21.15.80:0/3876749881 learned_addr learned my addr 172.21.15.80:0/3876749881 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:01.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.938+0000 7f9ee8e05700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ee415f100 0x7f9ee406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:01.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.938+0000 7f9ee3fff700 1 -- 172.21.15.80:0/3876749881 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737678626 0 0) 0x7f9edc001150 con 0x7f9ee406c2f0 2019-11-28T11:41:01.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.938+0000 7f9ee3fff700 1 -- 172.21.15.80:0/3876749881 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ecc002e80 con 0x7f9ee406c2f0 2019-11-28T11:41:01.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.938+0000 7f9ee3fff700 1 -- 172.21.15.80:0/3876749881 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185719795 0 0) 0x7f9ed4001400 con 0x7f9ee415ed10 2019-11-28T11:41:01.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.938+0000 7f9ee3fff700 1 -- 172.21.15.80:0/3876749881 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ecc0030b0 con 0x7f9ee415ed10 2019-11-28T11:41:01.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee3fff700 1 -- 172.21.15.80:0/3876749881 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2890383440 0 0) 0x7f9edc001130 con 0x7f9ee406c2f0 2019-11-28T11:41:01.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee3fff700 1 -- 172.21.15.80:0/3876749881 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ee415f100 msgr2=0x7f9ee406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:01.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee3fff700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ee415f100 0x7f9ee406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:01.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee3fff700 1 -- 172.21.15.80:0/3876749881 >> v1:172.21.15.174:6789/0 conn(0x7f9ee415ed10 legacy=0x7f9ee4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:01.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee3fff700 1 -- 172.21.15.80:0/3876749881 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee4070760 con 0x7f9ee406c2f0 2019-11-28T11:41:01.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee3fff700 1 -- 172.21.15.80:0/3876749881 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f9edc001660 con 0x7f9ee406c2f0 2019-11-28T11:41:01.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee8e05700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ee415f100 0x7f9ee406bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:01.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee3fff700 1 -- 172.21.15.80:0/3876749881 >> v1:172.21.15.80:6789/0 conn(0x7f9ee406c2f0 legacy=0x7f9ee406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:01.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee3fff700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ecc003b80 0x7f9ecc005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:01.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee3fff700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ecc006690 0x7f9ecc008b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:01.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee3fff700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc04d310 0x7f9ecc04f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:01.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee3fff700 1 -- 172.21.15.80:0/3876749881 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc04fff0 con 0x7f9ecc04d310 2019-11-28T11:41:01.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee3fff700 1 -- 172.21.15.80:0/3876749881 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0501e0 con 0x7f9ecc006690 2019-11-28T11:41:01.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee3fff700 1 -- 172.21.15.80:0/3876749881 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc050410 con 0x7f9ecc003b80 2019-11-28T11:41:01.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc04d310 0x7f9ecc04f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:01.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee9606700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ecc003b80 0x7f9ecc005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:01.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee8e05700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ecc006690 0x7f9ecc008b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:01.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee9e07700 1 -- 172.21.15.80:0/3876749881 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ecc003b80 msgr2=0x7f9ecc005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:01.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ecc003b80 0x7f9ecc005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:01.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee9e07700 1 -- 172.21.15.80:0/3876749881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ecc006690 msgr2=0x7f9ecc008b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:01.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ecc006690 0x7f9ecc008b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:01.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee9e07700 1 -- 172.21.15.80:0/3876749881 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0506c0 con 0x7f9ecc04d310 2019-11-28T11:41:01.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc04d310 0x7f9ecc04f7e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9edc00f910 tx=0x7f9edc00f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:01.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc04d310 0x7f9ecc04f7e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9edc00f910 tx=0x7f9edc00f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:01.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc04d310 0x7f9ecc04f7e0 secure :-1 s=READY pgs=1408 cs=0 l=1 rx=0x7f9edc00f910 tx=0x7f9edc00f810).ready entity=mon.0 client_cookie=493b247deec65823 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:01.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc04d310 0x7f9ecc04f7e0 secure :-1 s=THROTTLE_DONE pgs=1408 cs=0 l=1 rx=0x7f9edc00f910 tx=0x7f9edc00f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:01.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee3fff700 1 -- 172.21.15.80:0/3876749881 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9edc001130 con 0x7f9ecc04d310 2019-11-28T11:41:01.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc04d310 0x7f9ecc04f7e0 secure :-1 s=THROTTLE_DONE pgs=1408 cs=0 l=1 rx=0x7f9edc00f910 tx=0x7f9edc00f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:01.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc04d310 0x7f9ecc04f7e0 secure :-1 s=THROTTLE_DONE pgs=1408 cs=0 l=1 rx=0x7f9edc00f910 tx=0x7f9edc00f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:01.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee3fff700 1 -- 172.21.15.80:0/3876749881 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc004240 con 0x7f9ecc04d310 2019-11-28T11:41:01.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee3fff700 1 -- 172.21.15.80:0/3876749881 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9edc004910 con 0x7f9ecc04d310 2019-11-28T11:41:01.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9eeb069700 1 -- 172.21.15.80:0/3876749881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc04d310 msgr2=0x7f9ecc04f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:01.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9eeb069700 1 --2- 172.21.15.80:0/3876749881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ecc04d310 0x7f9ecc04f7e0 secure :-1 s=READY pgs=1408 cs=0 l=1 rx=0x7f9edc00f910 tx=0x7f9edc00f810).stop 2019-11-28T11:41:01.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.939+0000 7f9ee9e07700 1 -- 172.21.15.80:0/3876749881 reap_dead start 2019-11-28T11:41:01.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.940+0000 7f9eeb069700 1 -- 172.21.15.80:0/3876749881 shutdown_connections 2019-11-28T11:41:01.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.940+0000 7f9eeb069700 1 -- 172.21.15.80:0/3876749881 shutdown_connections 2019-11-28T11:41:01.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.940+0000 7f9eeb069700 1 -- 172.21.15.80:0/3876749881 wait complete. 2019-11-28T11:41:01.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.940+0000 7f9eeb069700 1 -- 172.21.15.80:0/3876749881 >> 172.21.15.80:0/3876749881 conn(0x7f9ee4061d20 msgr2=0x7f9ee40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:01.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.943+0000 7f9eeb069700 1 Processor -- start 2019-11-28T11:41:01.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.943+0000 7f9eeb069700 1 -- start start 2019-11-28T11:41:01.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9eeb069700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9ee41502e0 0x7f9ee4150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:01.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9eeb069700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee4133a20 con 0x7f9ee4150cb0 2019-11-28T11:41:01.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9eeb069700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee4109fc0 con 0x7f9ee4108630 2019-11-28T11:41:01.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9eeb069700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee4131980 con 0x7f9ee41502e0 2019-11-28T11:41:01.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee9e07700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9ee4150cb0 0x7f9ee4167d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37780/0 (socket says 172.21.15.80:37780) 2019-11-28T11:41:01.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee9e07700 1 -- 172.21.15.80:0/3368289215 learned_addr learned my addr 172.21.15.80:0/3368289215 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:01.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee8e05700 1 --2- 172.21.15.80:0/3368289215 >> v2:172.21.15.174:3300/0 conn(0x7f9ee41502e0 0x7f9ee4150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:01.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213881819 0 0) 0x7f9edc000ef0 con 0x7f9ee4150cb0 2019-11-28T11:41:01.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ec4002e80 con 0x7f9ee4150cb0 2019-11-28T11:41:01.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4101316788 0 0) 0x7f9edc000b50 con 0x7f9ee4150cb0 2019-11-28T11:41:01.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9ec40032e0 con 0x7f9ee4150cb0 2019-11-28T11:41:01.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f9edc0016a0 con 0x7f9ee4150cb0 2019-11-28T11:41:01.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 >> v2:172.21.15.174:3300/0 conn(0x7f9ee41502e0 msgr2=0x7f9ee4150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:01.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee1ffb700 1 --2- 172.21.15.80:0/3368289215 >> v2:172.21.15.174:3300/0 conn(0x7f9ee41502e0 0x7f9ee4150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:01.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 >> v1:172.21.15.174:6789/0 conn(0x7f9ee4108630 legacy=0x7f9ee4151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:01.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 >> v1:172.21.15.80:6789/0 conn(0x7f9ee4150cb0 legacy=0x7f9ee4167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:01.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee1ffb700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ec4003400 0x7f9ec4003850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:01.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee1ffb700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ec4003d90 0x7f9ec4004230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:01.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee1ffb700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec40049f0 0x7f9ec4004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:01.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec400bcb0 con 0x7f9ec40049f0 2019-11-28T11:41:01.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec400bee0 con 0x7f9ec4003400 2019-11-28T11:41:01.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec400c110 con 0x7f9ec4003d90 2019-11-28T11:41:01.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee8e05700 1 --2- 172.21.15.80:0/3368289215 >> v2:172.21.15.174:3300/0 conn(0x7f9ee41502e0 0x7f9ee4150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:01.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec40049f0 0x7f9ec4004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:01.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.944+0000 7f9ee9606700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ec4003400 0x7f9ec4003850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:01.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee8e05700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ec4003d90 0x7f9ec4004230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:01.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee9e07700 1 -- 172.21.15.80:0/3368289215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ec4003d90 msgr2=0x7f9ec4004230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:01.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ec4003d90 0x7f9ec4004230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:01.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee9e07700 1 -- 172.21.15.80:0/3368289215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ec4003400 msgr2=0x7f9ec4003850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:01.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ec4003400 0x7f9ec4003850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:01.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee9e07700 1 -- 172.21.15.80:0/3368289215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec400c3c0 con 0x7f9ec40049f0 2019-11-28T11:41:01.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9eeb069700 1 -- 172.21.15.80:0/3368289215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee4132660 con 0x7f9ec40049f0 2019-11-28T11:41:01.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec40049f0 0x7f9ec4004eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9edc010450 tx=0x7f9edc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:01.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee9e07700 1 -- 172.21.15.80:0/3368289215 reap_dead start 2019-11-28T11:41:01.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9eeb069700 1 -- 172.21.15.80:0/3368289215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee41322e0 con 0x7f9ec40049f0 2019-11-28T11:41:01.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec40049f0 0x7f9ec4004eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9edc010450 tx=0x7f9edc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:01.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec40049f0 0x7f9ec4004eb0 secure :-1 s=READY pgs=1410 cs=0 l=1 rx=0x7f9edc010450 tx=0x7f9edc010300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:01.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec40049f0 0x7f9ec4004eb0 secure :-1 s=THROTTLE_DONE pgs=1410 cs=0 l=1 rx=0x7f9edc010450 tx=0x7f9edc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:01.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9edc000fa0 con 0x7f9ec40049f0 2019-11-28T11:41:01.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec40049f0 0x7f9ec4004eb0 secure :-1 s=THROTTLE_DONE pgs=1410 cs=0 l=1 rx=0x7f9edc010450 tx=0x7f9edc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:01.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc000c40 con 0x7f9ec40049f0 2019-11-28T11:41:01.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec40049f0 0x7f9ec4004eb0 secure :-1 s=THROTTLE_DONE pgs=1410 cs=0 l=1 rx=0x7f9edc010450 tx=0x7f9edc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:01.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9edc000fa0 con 0x7f9ec40049f0 2019-11-28T11:41:01.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.945+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec40049f0 0x7f9ec4004eb0 secure :-1 s=THROTTLE_DONE pgs=1410 cs=0 l=1 rx=0x7f9edc010450 tx=0x7f9edc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:01.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.946+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9edc004240 con 0x7f9ec40049f0 2019-11-28T11:41:01.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.946+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec40049f0 0x7f9ec4004eb0 secure :-1 s=THROTTLE_DONE pgs=1410 cs=0 l=1 rx=0x7f9edc010450 tx=0x7f9edc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:01.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.946+0000 7f9ee1ffb700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ec401b490 0x7f9ec401d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:01.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.946+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5904+0+0 (secure 0 0 0) 0x7f9edc031be0 con 0x7f9ec40049f0 2019-11-28T11:41:01.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.946+0000 7f9ee9606700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ec401b490 0x7f9ec401d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:01.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.946+0000 7f9ee9606700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ec401b490 0x7f9ec401d8c0 crc :-1 s=READY pgs=575 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:01.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.952+0000 7f9eeb069700 1 -- 172.21.15.80:0/3368289215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ebc002e60 con 0x7f9ec40049f0 2019-11-28T11:41:01.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.956+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec40049f0 0x7f9ec4004eb0 secure :-1 s=THROTTLE_DONE pgs=1410 cs=0 l=1 rx=0x7f9edc010450 tx=0x7f9edc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:01.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:01.956+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9edc000a30 con 0x7f9ec40049f0 2019-11-28T11:41:02.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.121+0000 7f9eeb069700 1 -- 172.21.15.80:0/3368289215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f9ebc001d40 con 0x7f9ec40049f0 2019-11-28T11:41:02.154 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:41:02.121+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:41:02.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.124+0000 7f9ee9e07700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec40049f0 0x7f9ec4004eb0 secure :-1 s=THROTTLE_DONE pgs=1410 cs=0 l=1 rx=0x7f9edc010450 tx=0x7f9edc010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.124+0000 7f9ee1ffb700 1 -- 172.21.15.80:0/3368289215 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 16 and data pool 17 v71) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9edc01f7a0 con 0x7f9ec40049f0 2019-11-28T11:41:02.160 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 16 and data pool 17 2019-11-28T11:41:02.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.130+0000 7f9eeb069700 1 -- 172.21.15.80:0/3368289215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ec401b490 msgr2=0x7f9ec401d8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.130+0000 7f9eeb069700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ec401b490 0x7f9ec401d8c0 crc :-1 s=READY pgs=575 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:02.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.130+0000 7f9eeb069700 1 -- 172.21.15.80:0/3368289215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec40049f0 msgr2=0x7f9ec4004eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.130+0000 7f9eeb069700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec40049f0 0x7f9ec4004eb0 secure :-1 s=READY pgs=1410 cs=0 l=1 rx=0x7f9edc010450 tx=0x7f9edc010300).stop 2019-11-28T11:41:02.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.130+0000 7f9eeb069700 1 -- 172.21.15.80:0/3368289215 shutdown_connections 2019-11-28T11:41:02.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.130+0000 7f9eeb069700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ec401b490 0x7f9ec401d8c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:02.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.130+0000 7f9eeb069700 1 --2- 172.21.15.80:0/3368289215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ec40049f0 0x7f9ec4004eb0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:02.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.131+0000 7f9eeb069700 1 -- 172.21.15.80:0/3368289215 shutdown_connections 2019-11-28T11:41:02.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.131+0000 7f9eeb069700 1 -- 172.21.15.80:0/3368289215 wait complete. 2019-11-28T11:41:02.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.131+0000 7f9eeb069700 1 -- 172.21.15.80:0/3368289215 >> 172.21.15.80:0/3368289215 conn(0x7f9ee414dbb0 msgr2=0x7f9ee4142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:02.173 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:41:02.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.258+0000 7f35b8e14700 1 Processor -- start 2019-11-28T11:41:02.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.258+0000 7f35b8e14700 1 -- start start 2019-11-28T11:41:02.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.259+0000 7f35b8e14700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f35b406c490 0x7f35b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:02.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.259+0000 7f35b8e14700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35b406ce60 0x7f35b4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:02.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.259+0000 7f35b8e14700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b406db00 con 0x7f35b406c0a0 2019-11-28T11:41:02.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.259+0000 7f35b8e14700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b406fd60 con 0x7f35b406c490 2019-11-28T11:41:02.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.259+0000 7f35b8e14700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b4070030 con 0x7f35b406ce60 2019-11-28T11:41:02.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.259+0000 7f35b2d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f35b406c0a0 0x7f35b4072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37790/0 (socket says 172.21.15.80:37790) 2019-11-28T11:41:02.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.259+0000 7f35b2d9d700 1 -- 172.21.15.80:0/1764721441 learned_addr learned my addr 172.21.15.80:0/1764721441 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:02.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.259+0000 7f35b259c700 1 --2- 172.21.15.80:0/1764721441 >> v2:172.21.15.174:3300/0 conn(0x7f35b406c490 0x7f35b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:02.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.259+0000 7f35b359e700 1 --2- 172.21.15.80:0/1764721441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35b406ce60 0x7f35b4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:02.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b1d9b700 1 -- 172.21.15.80:0/1764721441 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650793742 0 0) 0x7f35a4001150 con 0x7f35b406c0a0 2019-11-28T11:41:02.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b1d9b700 1 -- 172.21.15.80:0/1764721441 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3594002e80 con 0x7f35b406c0a0 2019-11-28T11:41:02.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b259c700 1 -- 172.21.15.80:0/1764721441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35b406ce60 msgr2=0x7f35b4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:02.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b259c700 1 --2- 172.21.15.80:0/1764721441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35b406ce60 0x7f35b4164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:02.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b259c700 1 -- 172.21.15.80:0/1764721441 >> v1:172.21.15.80:6789/0 conn(0x7f35b406c0a0 legacy=0x7f35b4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b259c700 1 -- 172.21.15.80:0/1764721441 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b40706c0 con 0x7f35b406c490 2019-11-28T11:41:02.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b259c700 1 --2- 172.21.15.80:0/1764721441 >> v2:172.21.15.174:3300/0 conn(0x7f35b406c490 0x7f35b406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f359c00b2d0 tx=0x7f359c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b259c700 1 --2- 172.21.15.80:0/1764721441 >> v2:172.21.15.174:3300/0 conn(0x7f35b406c490 0x7f35b406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f359c00b2d0 tx=0x7f359c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b259c700 1 --2- 172.21.15.80:0/1764721441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b406c490 0x7f35b406c920 secure :-1 s=READY pgs=822 cs=0 l=1 rx=0x7f359c00b2d0 tx=0x7f359c00b5d0).ready entity=mon.1 client_cookie=10e7a2b9eb3a8ac2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:02.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b259c700 1 --2- 172.21.15.80:0/1764721441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b406c490 0x7f35b406c920 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7f359c00b2d0 tx=0x7f359c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b1d9b700 1 -- 172.21.15.80:0/1764721441 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f359c007590 con 0x7f35b406c490 2019-11-28T11:41:02.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b259c700 1 --2- 172.21.15.80:0/1764721441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b406c490 0x7f35b406c920 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7f359c00b2d0 tx=0x7f359c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b259c700 1 --2- 172.21.15.80:0/1764721441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b406c490 0x7f35b406c920 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7f359c00b2d0 tx=0x7f359c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b1d9b700 1 -- 172.21.15.80:0/1764721441 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c009d30 con 0x7f35b406c490 2019-11-28T11:41:02.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b1d9b700 1 -- 172.21.15.80:0/1764721441 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f359c00a400 con 0x7f35b406c490 2019-11-28T11:41:02.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b8e14700 1 -- 172.21.15.80:0/1764721441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b406c490 msgr2=0x7f35b406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.260+0000 7f35b8e14700 1 --2- 172.21.15.80:0/1764721441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b406c490 0x7f35b406c920 secure :-1 s=READY pgs=822 cs=0 l=1 rx=0x7f359c00b2d0 tx=0x7f359c00b5d0).stop 2019-11-28T11:41:02.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.261+0000 7f35b8e14700 1 -- 172.21.15.80:0/1764721441 shutdown_connections 2019-11-28T11:41:02.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.261+0000 7f35b8e14700 1 --2- 172.21.15.80:0/1764721441 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35b406ce60 0x7f35b4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:02.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.261+0000 7f35b8e14700 1 --2- 172.21.15.80:0/1764721441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b406c490 0x7f35b406c920 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:02.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.261+0000 7f35b8e14700 1 -- 172.21.15.80:0/1764721441 shutdown_connections 2019-11-28T11:41:02.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.261+0000 7f35b8e14700 1 -- 172.21.15.80:0/1764721441 wait complete. 2019-11-28T11:41:02.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.261+0000 7f35b8e14700 1 -- 172.21.15.80:0/1764721441 >> 172.21.15.80:0/1764721441 conn(0x7f35b4061cf0 msgr2=0x7f35b4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:02.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.263+0000 7f35b8e14700 1 Processor -- start 2019-11-28T11:41:02.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.264+0000 7f35b8e14700 1 -- start start 2019-11-28T11:41:02.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.264+0000 7f35b8e14700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f35b415fdf0 0x7f35b412b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:02.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.264+0000 7f35b8e14700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b413eb20 con 0x7f35b412b8a0 2019-11-28T11:41:02.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.264+0000 7f35b8e14700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b4139e00 con 0x7f35b412a3c0 2019-11-28T11:41:02.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.264+0000 7f35b8e14700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b4108820 con 0x7f35b415fdf0 2019-11-28T11:41:02.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.264+0000 7f35b259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f35b412b8a0 0x7f35b413e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37798/0 (socket says 172.21.15.80:37798) 2019-11-28T11:41:02.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.264+0000 7f35b259c700 1 -- 172.21.15.80:0/2552110653 learned_addr learned my addr 172.21.15.80:0/2552110653 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:02.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35b2d9d700 1 --2- 172.21.15.80:0/2552110653 >> v2:172.21.15.174:3300/0 conn(0x7f35b415fdf0 0x7f35b412b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:02.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35ab7fe700 1 -- 172.21.15.80:0/2552110653 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170181232 0 0) 0x7f359c00b3c0 con 0x7f35b412b8a0 2019-11-28T11:41:02.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35ab7fe700 1 -- 172.21.15.80:0/2552110653 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f358c002e80 con 0x7f35b412b8a0 2019-11-28T11:41:02.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35b2d9d700 1 -- 172.21.15.80:0/2552110653 >> v1:172.21.15.174:6789/0 conn(0x7f35b412a3c0 legacy=0x7f35b412a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35ab7fe700 1 -- 172.21.15.80:0/2552110653 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472928703 0 0) 0x7f35ac001080 con 0x7f35b412a3c0 2019-11-28T11:41:02.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35b2d9d700 1 -- 172.21.15.80:0/2552110653 >> v1:172.21.15.80:6789/0 conn(0x7f35b412b8a0 legacy=0x7f35b413e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35b2d9d700 1 -- 172.21.15.80:0/2552110653 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b410a8c0 con 0x7f35b415fdf0 2019-11-28T11:41:02.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35b2d9d700 1 --2- 172.21.15.80:0/2552110653 >> v2:172.21.15.174:3300/0 conn(0x7f35b415fdf0 0x7f35b412b360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f35a4010380 tx=0x7f35a4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35b2d9d700 1 --2- 172.21.15.80:0/2552110653 >> v2:172.21.15.174:3300/0 conn(0x7f35b415fdf0 0x7f35b412b360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f35a4010380 tx=0x7f35a4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35b2d9d700 1 --2- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b415fdf0 0x7f35b412b360 secure :-1 s=READY pgs=824 cs=0 l=1 rx=0x7f35a4010380 tx=0x7f35a4010720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:02.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35b2d9d700 1 --2- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b415fdf0 0x7f35b412b360 secure :-1 s=THROTTLE_DONE pgs=824 cs=0 l=1 rx=0x7f35a4010380 tx=0x7f35a4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35ab7fe700 1 -- 172.21.15.80:0/2552110653 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35a4000d80 con 0x7f35b415fdf0 2019-11-28T11:41:02.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35b2d9d700 1 --2- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b415fdf0 0x7f35b412b360 secure :-1 s=THROTTLE_DONE pgs=824 cs=0 l=1 rx=0x7f35a4010380 tx=0x7f35a4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35ab7fe700 1 -- 172.21.15.80:0/2552110653 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a4001380 con 0x7f35b415fdf0 2019-11-28T11:41:02.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35b2d9d700 1 --2- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b415fdf0 0x7f35b412b360 secure :-1 s=THROTTLE_DONE pgs=824 cs=0 l=1 rx=0x7f35a4010380 tx=0x7f35a4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35ab7fe700 1 -- 172.21.15.80:0/2552110653 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35a4000c90 con 0x7f35b415fdf0 2019-11-28T11:41:02.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35b8e14700 1 -- 172.21.15.80:0/2552110653 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b410a8c0 con 0x7f35b415fdf0 2019-11-28T11:41:02.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.265+0000 7f35b8e14700 1 -- 172.21.15.80:0/2552110653 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b410a8c0 con 0x7f35b415fdf0 2019-11-28T11:41:02.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.266+0000 7f35b2d9d700 1 --2- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b415fdf0 0x7f35b412b360 secure :-1 s=THROTTLE_DONE pgs=824 cs=0 l=1 rx=0x7f35a4010380 tx=0x7f35a4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.266+0000 7f35b2d9d700 1 --2- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b415fdf0 0x7f35b412b360 secure :-1 s=THROTTLE_DONE pgs=824 cs=0 l=1 rx=0x7f35a4010380 tx=0x7f35a4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.266+0000 7f35ab7fe700 1 -- 172.21.15.80:0/2552110653 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f35a4001570 con 0x7f35b415fdf0 2019-11-28T11:41:02.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.266+0000 7f35ab7fe700 1 --2- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f358c018780 0x7f358c01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:02.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.266+0000 7f35ab7fe700 1 -- 172.21.15.80:0/2552110653 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f35a4031a20 con 0x7f35b415fdf0 2019-11-28T11:41:02.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.266+0000 7f35b259c700 1 --2- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f358c018780 0x7f358c01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:02.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.266+0000 7f35b259c700 1 --2- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f358c018780 0x7f358c01abf0 crc :-1 s=READY pgs=576 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:02.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.274+0000 7f35b8e14700 1 -- 172.21.15.80:0/2552110653 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b4109180 con 0x7f35b415fdf0 2019-11-28T11:41:02.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.277+0000 7f35b2d9d700 1 --2- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b415fdf0 0x7f35b412b360 secure :-1 s=THROTTLE_DONE pgs=824 cs=0 l=1 rx=0x7f35a4010380 tx=0x7f35a4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.278+0000 7f35ab7fe700 1 -- 172.21.15.80:0/2552110653 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f35a4006410 con 0x7f35b415fdf0 2019-11-28T11:41:02.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.453+0000 7f35b8e14700 1 -- 172.21.15.80:0/2552110653 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35b4109500 con 0x7f35b415fdf0 2019-11-28T11:41:02.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.454+0000 7f35b2d9d700 1 --2- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b415fdf0 0x7f35b412b360 secure :-1 s=THROTTLE_DONE pgs=824 cs=0 l=1 rx=0x7f35a4010380 tx=0x7f35a4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.454+0000 7f35ab7fe700 1 -- 172.21.15.80:0/2552110653 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+14883 (secure 0 0 0) 0x7f35a4006410 con 0x7f35b415fdf0 2019-11-28T11:41:02.489 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:02.489 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":106,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:41:02.122639+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:41:00.409798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2019-11-28T11:41:01.100729+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:41:02.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.458+0000 7f35b8e14700 1 -- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f358c018780 msgr2=0x7f358c01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.458+0000 7f35b8e14700 1 --2- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f358c018780 0x7f358c01abf0 crc :-1 s=READY pgs=576 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:02.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.458+0000 7f35b8e14700 1 -- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b415fdf0 msgr2=0x7f35b412b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.458+0000 7f35b8e14700 1 --2- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b415fdf0 0x7f35b412b360 secure :-1 s=READY pgs=824 cs=0 l=1 rx=0x7f35a4010380 tx=0x7f35a4010720).stop 2019-11-28T11:41:02.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.458+0000 7f35b8e14700 1 -- 172.21.15.80:0/2552110653 shutdown_connections 2019-11-28T11:41:02.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.458+0000 7f35b8e14700 1 --2- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f358c018780 0x7f358c01abf0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:02.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.458+0000 7f35b8e14700 1 --2- 172.21.15.80:0/2552110653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35b415fdf0 0x7f35b412b360 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:02.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.458+0000 7f35b8e14700 1 -- 172.21.15.80:0/2552110653 shutdown_connections 2019-11-28T11:41:02.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.458+0000 7f35b8e14700 1 -- 172.21.15.80:0/2552110653 wait complete. 2019-11-28T11:41:02.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.458+0000 7f35b8e14700 1 -- 172.21.15.80:0/2552110653 >> 172.21.15.80:0/2552110653 conn(0x7f35b4127dc0 msgr2=0x7f35b4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:02.502 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:41:02.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.587+0000 7f8cf9147700 1 Processor -- start 2019-11-28T11:41:02.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.587+0000 7f8cf9147700 1 -- start start 2019-11-28T11:41:02.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.588+0000 7f8cf9147700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8cf406c490 0x7f8cf406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:02.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.588+0000 7f8cf9147700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8cf406ce60 0x7f8cf4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:02.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.588+0000 7f8cf9147700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf406db00 con 0x7f8cf406c0a0 2019-11-28T11:41:02.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.588+0000 7f8cf9147700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf406fd60 con 0x7f8cf406c490 2019-11-28T11:41:02.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.588+0000 7f8cf9147700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf4070030 con 0x7f8cf406ce60 2019-11-28T11:41:02.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.588+0000 7f8cf2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8cf406c490 0x7f8cf406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:02.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.588+0000 7f8cf2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8cf406c490 0x7f8cf406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38492/0 (socket says 172.21.15.80:38492) 2019-11-28T11:41:02.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.588+0000 7f8cf2d9d700 1 -- 172.21.15.80:0/3104069586 learned_addr learned my addr 172.21.15.80:0/3104069586 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:02.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.588+0000 7f8cf8946700 1 --2- 172.21.15.80:0/3104069586 >> v2:172.21.15.174:3300/0 conn(0x7f8cf406ce60 0x7f8cf4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:02.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.589+0000 7f8cf2d9d700 1 -- 172.21.15.80:0/3104069586 >> v2:172.21.15.174:3300/0 conn(0x7f8cf406ce60 msgr2=0x7f8cf4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:02.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.589+0000 7f8cf2d9d700 1 --2- 172.21.15.80:0/3104069586 >> v2:172.21.15.174:3300/0 conn(0x7f8cf406ce60 0x7f8cf4164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:02.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.589+0000 7f8cf2d9d700 1 -- 172.21.15.80:0/3104069586 >> v1:172.21.15.80:6789/0 conn(0x7f8cf406c0a0 legacy=0x7f8cf4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.589+0000 7f8cf2d9d700 1 -- 172.21.15.80:0/3104069586 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf40706c0 con 0x7f8cf406c490 2019-11-28T11:41:02.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.589+0000 7f8cf8946700 1 --2- 172.21.15.80:0/3104069586 >> v2:172.21.15.174:3300/0 conn(0x7f8cf406ce60 0x7f8cf4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:41:02.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.589+0000 7f8cf2d9d700 1 --2- 172.21.15.80:0/3104069586 >> v2:172.21.15.80:3300/0 conn(0x7f8cf406c490 0x7f8cf406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8ce400f740 tx=0x7f8ce400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.589+0000 7f8cf2d9d700 1 --2- 172.21.15.80:0/3104069586 >> v2:172.21.15.80:3300/0 conn(0x7f8cf406c490 0x7f8cf406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8ce400f740 tx=0x7f8ce400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.589+0000 7f8cf2d9d700 1 --2- 172.21.15.80:0/3104069586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf406c490 0x7f8cf406c920 secure :-1 s=READY pgs=1414 cs=0 l=1 rx=0x7f8ce400f740 tx=0x7f8ce400fae0).ready entity=mon.0 client_cookie=74fb2d6358d6c980 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:02.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.589+0000 7f8cf2d9d700 1 --2- 172.21.15.80:0/3104069586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf406c490 0x7f8cf406c920 secure :-1 s=THROTTLE_DONE pgs=1414 cs=0 l=1 rx=0x7f8ce400f740 tx=0x7f8ce400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.589+0000 7f8cf2d9d700 1 --2- 172.21.15.80:0/3104069586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf406c490 0x7f8cf406c920 secure :-1 s=THROTTLE_DONE pgs=1414 cs=0 l=1 rx=0x7f8ce400f740 tx=0x7f8ce400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.589+0000 7f8cf259c700 1 -- 172.21.15.80:0/3104069586 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ce4000960 con 0x7f8cf406c490 2019-11-28T11:41:02.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.589+0000 7f8cf2d9d700 1 --2- 172.21.15.80:0/3104069586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf406c490 0x7f8cf406c920 secure :-1 s=THROTTLE_DONE pgs=1414 cs=0 l=1 rx=0x7f8ce400f740 tx=0x7f8ce400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.589+0000 7f8cf259c700 1 -- 172.21.15.80:0/3104069586 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce4000c90 con 0x7f8cf406c490 2019-11-28T11:41:02.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.589+0000 7f8cf259c700 1 -- 172.21.15.80:0/3104069586 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ce40013a0 con 0x7f8cf406c490 2019-11-28T11:41:02.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.589+0000 7f8cf9147700 1 -- 172.21.15.80:0/3104069586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf406c490 msgr2=0x7f8cf406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.589+0000 7f8cf9147700 1 --2- 172.21.15.80:0/3104069586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf406c490 0x7f8cf406c920 secure :-1 s=READY pgs=1414 cs=0 l=1 rx=0x7f8ce400f740 tx=0x7f8ce400fae0).stop 2019-11-28T11:41:02.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.590+0000 7f8cf9147700 1 -- 172.21.15.80:0/3104069586 shutdown_connections 2019-11-28T11:41:02.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.590+0000 7f8cf9147700 1 --2- 172.21.15.80:0/3104069586 >> v2:172.21.15.174:3300/0 conn(0x7f8cf406ce60 0x7f8cf4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:02.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.590+0000 7f8cf9147700 1 --2- 172.21.15.80:0/3104069586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf406c490 0x7f8cf406c920 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:02.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.590+0000 7f8cf9147700 1 -- 172.21.15.80:0/3104069586 shutdown_connections 2019-11-28T11:41:02.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.590+0000 7f8cf9147700 1 -- 172.21.15.80:0/3104069586 wait complete. 2019-11-28T11:41:02.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.590+0000 7f8cf9147700 1 -- 172.21.15.80:0/3104069586 >> 172.21.15.80:0/3104069586 conn(0x7f8cf4061cf0 msgr2=0x7f8cf4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:02.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.592+0000 7f8cf9147700 1 Processor -- start 2019-11-28T11:41:02.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.592+0000 7f8cf9147700 1 -- start start 2019-11-28T11:41:02.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.593+0000 7f8cf9147700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8cf413e320 0x7f8cf413e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:02.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.593+0000 7f8cf9147700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8cf412a3c0 0x7f8cf412a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:02.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.593+0000 7f8cf9147700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf4139e00 con 0x7f8cf415fdf0 2019-11-28T11:41:02.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.593+0000 7f8cf9147700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf4108820 con 0x7f8cf412a3c0 2019-11-28T11:41:02.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.593+0000 7f8cf9147700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf4108af0 con 0x7f8cf413e320 2019-11-28T11:41:02.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.593+0000 7f8cf8946700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8cf412a3c0 0x7f8cf412a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:02.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.593+0000 7f8cf8946700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8cf412a3c0 0x7f8cf412a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38496/0 (socket says 172.21.15.80:38496) 2019-11-28T11:41:02.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.593+0000 7f8cf8946700 1 -- 172.21.15.80:0/446496675 learned_addr learned my addr 172.21.15.80:0/446496675 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:02.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.593+0000 7f8cf8946700 1 -- 172.21.15.80:0/446496675 >> v2:172.21.15.174:3300/0 conn(0x7f8cf413e320 msgr2=0x7f8cf413e7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2019-11-28T11:41:02.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.593+0000 7f8cf8946700 1 --2- 172.21.15.80:0/446496675 >> v2:172.21.15.174:3300/0 conn(0x7f8cf413e320 0x7f8cf413e7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:02.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.593+0000 7f8cf8946700 1 -- 172.21.15.80:0/446496675 >> v1:172.21.15.80:6789/0 conn(0x7f8cf415fdf0 legacy=0x7f8cf412b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.593+0000 7f8cebfff700 1 -- 172.21.15.80:0/446496675 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521801479 0 0) 0x7f8cdc001480 con 0x7f8cf415fdf0 2019-11-28T11:41:02.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.593+0000 7f8cf8946700 1 -- 172.21.15.80:0/446496675 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf410a8c0 con 0x7f8cf412a3c0 2019-11-28T11:41:02.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.593+0000 7f8cf8946700 1 --2- 172.21.15.80:0/446496675 >> v2:172.21.15.80:3300/0 conn(0x7f8cf412a3c0 0x7f8cf412a820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8cec010480 tx=0x7f8cec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.594+0000 7f8cf8946700 1 --2- 172.21.15.80:0/446496675 >> v2:172.21.15.80:3300/0 conn(0x7f8cf412a3c0 0x7f8cf412a820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8cec010480 tx=0x7f8cec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.594+0000 7f8cf8946700 1 --2- 172.21.15.80:0/446496675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf412a3c0 0x7f8cf412a820 secure :-1 s=READY pgs=1416 cs=0 l=1 rx=0x7f8cec010480 tx=0x7f8cec010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:02.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.594+0000 7f8cf8946700 1 --2- 172.21.15.80:0/446496675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf412a3c0 0x7f8cf412a820 secure :-1 s=THROTTLE_DONE pgs=1416 cs=0 l=1 rx=0x7f8cec010480 tx=0x7f8cec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.594+0000 7f8cebfff700 1 -- 172.21.15.80:0/446496675 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cec008480 con 0x7f8cf412a3c0 2019-11-28T11:41:02.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.594+0000 7f8cf8946700 1 --2- 172.21.15.80:0/446496675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf412a3c0 0x7f8cf412a820 secure :-1 s=THROTTLE_DONE pgs=1416 cs=0 l=1 rx=0x7f8cec010480 tx=0x7f8cec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.594+0000 7f8cebfff700 1 -- 172.21.15.80:0/446496675 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec009a80 con 0x7f8cf412a3c0 2019-11-28T11:41:02.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.594+0000 7f8cf8946700 1 --2- 172.21.15.80:0/446496675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf412a3c0 0x7f8cf412a820 secure :-1 s=THROTTLE_DONE pgs=1416 cs=0 l=1 rx=0x7f8cec010480 tx=0x7f8cec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.594+0000 7f8cf9147700 1 -- 172.21.15.80:0/446496675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf410a8c0 con 0x7f8cf412a3c0 2019-11-28T11:41:02.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.594+0000 7f8cebfff700 1 -- 172.21.15.80:0/446496675 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cec0097f0 con 0x7f8cf412a3c0 2019-11-28T11:41:02.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.594+0000 7f8cf9147700 1 -- 172.21.15.80:0/446496675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf410a8c0 con 0x7f8cf412a3c0 2019-11-28T11:41:02.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.594+0000 7f8cf8946700 1 --2- 172.21.15.80:0/446496675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf412a3c0 0x7f8cf412a820 secure :-1 s=THROTTLE_DONE pgs=1416 cs=0 l=1 rx=0x7f8cec010480 tx=0x7f8cec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.594+0000 7f8cebfff700 1 -- 172.21.15.80:0/446496675 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8cec000a70 con 0x7f8cf412a3c0 2019-11-28T11:41:02.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.594+0000 7f8cf8946700 1 --2- 172.21.15.80:0/446496675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf412a3c0 0x7f8cf412a820 secure :-1 s=THROTTLE_DONE pgs=1416 cs=0 l=1 rx=0x7f8cec010480 tx=0x7f8cec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.594+0000 7f8cebfff700 1 --2- 172.21.15.80:0/446496675 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ccc018730 0x7f8ccc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:02.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.594+0000 7f8cebfff700 1 -- 172.21.15.80:0/446496675 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8cec031a90 con 0x7f8cf412a3c0 2019-11-28T11:41:02.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.595+0000 7f8cf359e700 1 --2- 172.21.15.80:0/446496675 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ccc018730 0x7f8ccc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:02.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.595+0000 7f8cf359e700 1 --2- 172.21.15.80:0/446496675 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ccc018730 0x7f8ccc01abc0 crc :-1 s=READY pgs=577 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:02.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.603+0000 7f8cf9147700 1 -- 172.21.15.80:0/446496675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf4109180 con 0x7f8cf412a3c0 2019-11-28T11:41:02.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.606+0000 7f8cf8946700 1 --2- 172.21.15.80:0/446496675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf412a3c0 0x7f8cf412a820 secure :-1 s=THROTTLE_DONE pgs=1416 cs=0 l=1 rx=0x7f8cec010480 tx=0x7f8cec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.606+0000 7f8cebfff700 1 -- 172.21.15.80:0/446496675 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8cec0095e0 con 0x7f8cf412a3c0 2019-11-28T11:41:02.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.782+0000 7f8cf9147700 1 -- 172.21.15.80:0/446496675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cf4109500 con 0x7f8cf412a3c0 2019-11-28T11:41:02.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.783+0000 7f8cf8946700 1 --2- 172.21.15.80:0/446496675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf412a3c0 0x7f8cf412a820 secure :-1 s=THROTTLE_DONE pgs=1416 cs=0 l=1 rx=0x7f8cec010480 tx=0x7f8cec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.783+0000 7f8cebfff700 1 -- 172.21.15.80:0/446496675 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+14883 (secure 0 0 0) 0x7f8cec000a70 con 0x7f8cf412a3c0 2019-11-28T11:41:02.816 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:02.817 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":106,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:41:02.122639+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:41:00.409798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2019-11-28T11:41:01.100729+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:41:02.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.785+0000 7f8cf9147700 1 -- 172.21.15.80:0/446496675 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ccc018730 msgr2=0x7f8ccc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.785+0000 7f8cf9147700 1 --2- 172.21.15.80:0/446496675 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ccc018730 0x7f8ccc01abc0 crc :-1 s=READY pgs=577 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:02.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.785+0000 7f8cf9147700 1 -- 172.21.15.80:0/446496675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf412a3c0 msgr2=0x7f8cf412a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.785+0000 7f8cf9147700 1 --2- 172.21.15.80:0/446496675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf412a3c0 0x7f8cf412a820 secure :-1 s=READY pgs=1416 cs=0 l=1 rx=0x7f8cec010480 tx=0x7f8cec010280).stop 2019-11-28T11:41:02.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.785+0000 7f8cf9147700 1 -- 172.21.15.80:0/446496675 shutdown_connections 2019-11-28T11:41:02.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.785+0000 7f8cf9147700 1 --2- 172.21.15.80:0/446496675 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ccc018730 0x7f8ccc01abc0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:02.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.785+0000 7f8cf9147700 1 --2- 172.21.15.80:0/446496675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cf412a3c0 0x7f8cf412a820 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:02.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.785+0000 7f8cf9147700 1 --2- 172.21.15.80:0/446496675 >> v2:172.21.15.174:3300/0 conn(0x7f8cf413e320 0x7f8cf413e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:02.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.786+0000 7f8cf9147700 1 -- 172.21.15.80:0/446496675 shutdown_connections 2019-11-28T11:41:02.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.786+0000 7f8cf9147700 1 -- 172.21.15.80:0/446496675 wait complete. 2019-11-28T11:41:02.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.786+0000 7f8cf9147700 1 -- 172.21.15.80:0/446496675 >> 172.21.15.80:0/446496675 conn(0x7f8cf4127dc0 msgr2=0x7f8cf4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:02.831 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:41:02.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.921+0000 7fae453a2700 1 Processor -- start 2019-11-28T11:41:02.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.921+0000 7fae453a2700 1 -- start start 2019-11-28T11:41:02.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.922+0000 7fae453a2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae4015ed10 0x7fae4015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:02.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.922+0000 7fae453a2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4006db60 con 0x7fae40073020 2019-11-28T11:41:02.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.922+0000 7fae453a2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4006e060 con 0x7fae400734b0 2019-11-28T11:41:02.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.922+0000 7fae453a2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4006f3d0 con 0x7fae4015ed10 2019-11-28T11:41:02.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3effd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fae40073020 0x7fae40071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37822/0 (socket says 172.21.15.80:37822) 2019-11-28T11:41:02.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3effd700 1 -- 172.21.15.80:0/3501441757 learned_addr learned my addr 172.21.15.80:0/3501441757 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:02.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3f7fe700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae4015ed10 0x7fae4015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:02.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3e7fc700 1 -- 172.21.15.80:0/3501441757 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227067233 0 0) 0x7fae30001070 con 0x7fae40073020 2019-11-28T11:41:02.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3e7fc700 1 -- 172.21.15.80:0/3501441757 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae20002e80 con 0x7fae40073020 2019-11-28T11:41:02.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3e7fc700 1 -- 172.21.15.80:0/3501441757 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2630315800 0 0) 0x7fae30001050 con 0x7fae40073020 2019-11-28T11:41:02.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3e7fc700 1 -- 172.21.15.80:0/3501441757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae4015ed10 msgr2=0x7fae4015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:02.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3e7fc700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae4015ed10 0x7fae4015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:02.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3e7fc700 1 -- 172.21.15.80:0/3501441757 >> v1:172.21.15.174:6789/0 conn(0x7fae400734b0 legacy=0x7fae400726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3e7fc700 1 -- 172.21.15.80:0/3501441757 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae40070760 con 0x7fae40073020 2019-11-28T11:41:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3e7fc700 1 -- 172.21.15.80:0/3501441757 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fae30001580 con 0x7fae40073020 2019-11-28T11:41:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3e7fc700 1 -- 172.21.15.80:0/3501441757 >> v1:172.21.15.80:6789/0 conn(0x7fae40073020 legacy=0x7fae40071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3e7fc700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae20003ab0 0x7fae20005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3e7fc700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae20006650 0x7fae20008b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3e7fc700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae20009300 0x7fae2000b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3e7fc700 1 -- 172.21.15.80:0/3501441757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2000bfe0 con 0x7fae20006650 2019-11-28T11:41:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3e7fc700 1 -- 172.21.15.80:0/3501441757 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae200501e0 con 0x7fae20009300 2019-11-28T11:41:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3e7fc700 1 -- 172.21.15.80:0/3501441757 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae20050410 con 0x7fae20003ab0 2019-11-28T11:41:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3effd700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae20006650 0x7fae20008b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.923+0000 7fae3f7fe700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae20003ab0 0x7fae20005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae3ffff700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae20009300 0x7fae2000b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae3effd700 1 -- 172.21.15.80:0/3501441757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae20003ab0 msgr2=0x7fae20005ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae3effd700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae20003ab0 0x7fae20005ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:02.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae3effd700 1 -- 172.21.15.80:0/3501441757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae20009300 msgr2=0x7fae2000b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:02.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae3effd700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae20009300 0x7fae2000b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:02.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae3effd700 1 -- 172.21.15.80:0/3501441757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200506c0 con 0x7fae20006650 2019-11-28T11:41:02.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae3effd700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae20006650 0x7fae20008b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae3000f910 tx=0x7fae3000f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae3effd700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae20006650 0x7fae20008b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae3000f910 tx=0x7fae3000f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae3effd700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae20006650 0x7fae20008b00 secure :-1 s=READY pgs=1418 cs=0 l=1 rx=0x7fae3000f910 tx=0x7fae3000f790).ready entity=mon.0 client_cookie=9c8109a845407049 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:02.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae3effd700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae20006650 0x7fae20008b00 secure :-1 s=THROTTLE_DONE pgs=1418 cs=0 l=1 rx=0x7fae3000f910 tx=0x7fae3000f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae3e7fc700 1 -- 172.21.15.80:0/3501441757 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae30001050 con 0x7fae20006650 2019-11-28T11:41:02.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae3effd700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae20006650 0x7fae20008b00 secure :-1 s=THROTTLE_DONE pgs=1418 cs=0 l=1 rx=0x7fae3000f910 tx=0x7fae3000f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae3effd700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae20006650 0x7fae20008b00 secure :-1 s=THROTTLE_DONE pgs=1418 cs=0 l=1 rx=0x7fae3000f910 tx=0x7fae3000f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae3e7fc700 1 -- 172.21.15.80:0/3501441757 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae30004290 con 0x7fae20006650 2019-11-28T11:41:02.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae3e7fc700 1 -- 172.21.15.80:0/3501441757 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae30004a00 con 0x7fae20006650 2019-11-28T11:41:02.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae453a2700 1 -- 172.21.15.80:0/3501441757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae20006650 msgr2=0x7fae20008b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae453a2700 1 --2- 172.21.15.80:0/3501441757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae20006650 0x7fae20008b00 secure :-1 s=READY pgs=1418 cs=0 l=1 rx=0x7fae3000f910 tx=0x7fae3000f790).stop 2019-11-28T11:41:02.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.924+0000 7fae3ffff700 1 -- 172.21.15.80:0/3501441757 reap_dead start 2019-11-28T11:41:02.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.925+0000 7fae453a2700 1 -- 172.21.15.80:0/3501441757 shutdown_connections 2019-11-28T11:41:02.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.925+0000 7fae453a2700 1 -- 172.21.15.80:0/3501441757 shutdown_connections 2019-11-28T11:41:02.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.925+0000 7fae453a2700 1 -- 172.21.15.80:0/3501441757 wait complete. 2019-11-28T11:41:02.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.925+0000 7fae453a2700 1 -- 172.21.15.80:0/3501441757 >> 172.21.15.80:0/3501441757 conn(0x7fae40061d20 msgr2=0x7fae400641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:02.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.927+0000 7fae453a2700 1 Processor -- start 2019-11-28T11:41:02.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.927+0000 7fae453a2700 1 -- start start 2019-11-28T11:41:02.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.928+0000 7fae453a2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fae4015dd80 0x7fae4010f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:02.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.928+0000 7fae453a2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae4010ff10 0x7fae40118980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:02.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.928+0000 7fae453a2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae40119ad0 con 0x7fae40118ec0 2019-11-28T11:41:02.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.928+0000 7fae453a2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4014d8f0 con 0x7fae4015dd80 2019-11-28T11:41:02.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.928+0000 7fae453a2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4014dbc0 con 0x7fae4010ff10 2019-11-28T11:41:02.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.928+0000 7fae3f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fae4015dd80 0x7fae4010f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:02.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.928+0000 7fae3ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fae40118ec0 0x7fae4010e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37832/0 (socket says 172.21.15.80:37832) 2019-11-28T11:41:02.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.928+0000 7fae3ffff700 1 -- 172.21.15.80:0/1408515173 learned_addr learned my addr 172.21.15.80:0/1408515173 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:02.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.928+0000 7fae3effd700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae4010ff10 0x7fae40118980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:02.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.928+0000 7fae3f7fe700 1 -- 172.21.15.80:0/1408515173 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae4010ff10 msgr2=0x7fae40118980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.928+0000 7fae3f7fe700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae4010ff10 0x7fae40118980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:02.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.928+0000 7fae37fff700 1 -- 172.21.15.80:0/1408515173 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605823782 0 0) 0x7fae38000c80 con 0x7fae40118ec0 2019-11-28T11:41:02.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.928+0000 7fae3f7fe700 1 -- 172.21.15.80:0/1408515173 >> v1:172.21.15.80:6789/0 conn(0x7fae40118ec0 legacy=0x7fae4010e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:02.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.928+0000 7fae3f7fe700 1 -- 172.21.15.80:0/1408515173 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4010d500 con 0x7fae4015dd80 2019-11-28T11:41:02.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.928+0000 7fae3f7fe700 1 --2- 172.21.15.80:0/1408515173 >> v2:172.21.15.80:3300/0 conn(0x7fae4015dd80 0x7fae4010f9d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae28010710 tx=0x7fae28010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.928+0000 7fae3f7fe700 1 --2- 172.21.15.80:0/1408515173 >> v2:172.21.15.80:3300/0 conn(0x7fae4015dd80 0x7fae4010f9d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae28010710 tx=0x7fae28010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.929+0000 7fae3f7fe700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae4015dd80 0x7fae4010f9d0 secure :-1 s=READY pgs=1420 cs=0 l=1 rx=0x7fae28010710 tx=0x7fae28010540).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:02.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.929+0000 7fae3f7fe700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae4015dd80 0x7fae4010f9d0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7fae28010710 tx=0x7fae28010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.929+0000 7fae3f7fe700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae4015dd80 0x7fae4010f9d0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7fae28010710 tx=0x7fae28010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.929+0000 7fae37fff700 1 -- 172.21.15.80:0/1408515173 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae280095d0 con 0x7fae4015dd80 2019-11-28T11:41:02.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.929+0000 7fae3f7fe700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae4015dd80 0x7fae4010f9d0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7fae28010710 tx=0x7fae28010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.929+0000 7fae37fff700 1 -- 172.21.15.80:0/1408515173 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae280012a0 con 0x7fae4015dd80 2019-11-28T11:41:02.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.929+0000 7fae453a2700 1 -- 172.21.15.80:0/1408515173 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4010d500 con 0x7fae4015dd80 2019-11-28T11:41:02.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.929+0000 7fae37fff700 1 -- 172.21.15.80:0/1408515173 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae28001870 con 0x7fae4015dd80 2019-11-28T11:41:02.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.929+0000 7fae453a2700 1 -- 172.21.15.80:0/1408515173 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4010d500 con 0x7fae4015dd80 2019-11-28T11:41:02.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.929+0000 7fae3f7fe700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae4015dd80 0x7fae4010f9d0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7fae28010710 tx=0x7fae28010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.929+0000 7fae37fff700 1 -- 172.21.15.80:0/1408515173 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fae28001490 con 0x7fae4015dd80 2019-11-28T11:41:02.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.929+0000 7fae3f7fe700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae4015dd80 0x7fae4010f9d0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7fae28010710 tx=0x7fae28010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.929+0000 7fae37fff700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae18018730 0x7fae1801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:02.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.929+0000 7fae37fff700 1 -- 172.21.15.80:0/1408515173 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fae28031d70 con 0x7fae4015dd80 2019-11-28T11:41:02.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.930+0000 7fae3effd700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae18018730 0x7fae1801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:02.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.930+0000 7fae3effd700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae18018730 0x7fae1801abc0 crc :-1 s=READY pgs=578 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:02.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.937+0000 7fae453a2700 1 -- 172.21.15.80:0/1408515173 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4010d500 con 0x7fae4015dd80 2019-11-28T11:41:02.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.940+0000 7fae3f7fe700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae4015dd80 0x7fae4010f9d0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7fae28010710 tx=0x7fae28010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:02.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:02.940+0000 7fae37fff700 1 -- 172.21.15.80:0/1408515173 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fae28001010 con 0x7fae4015dd80 2019-11-28T11:41:03.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.113+0000 7fae453a2700 1 -- 172.21.15.80:0/1408515173 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7fae4010d500 con 0x7fae4015dd80 2019-11-28T11:41:03.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.755+0000 7fae3f7fe700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae4015dd80 0x7fae4010f9d0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7fae28010710 tx=0x7fae28010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:03.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.755+0000 7fae37fff700 1 -- 172.21.15.80:0/1408515173 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v72) v1 ==== 118+0+0 (secure 0 0 0) 0x7fae28001490 con 0x7fae4015dd80 2019-11-28T11:41:03.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.781+0000 7fae453a2700 1 -- 172.21.15.80:0/1408515173 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae18018730 msgr2=0x7fae1801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:03.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.781+0000 7fae453a2700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae18018730 0x7fae1801abc0 crc :-1 s=READY pgs=578 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:03.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.781+0000 7fae453a2700 1 -- 172.21.15.80:0/1408515173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae4015dd80 msgr2=0x7fae4010f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:03.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.781+0000 7fae453a2700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae4015dd80 0x7fae4010f9d0 secure :-1 s=READY pgs=1420 cs=0 l=1 rx=0x7fae28010710 tx=0x7fae28010540).stop 2019-11-28T11:41:03.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.781+0000 7fae453a2700 1 -- 172.21.15.80:0/1408515173 shutdown_connections 2019-11-28T11:41:03.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.781+0000 7fae453a2700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fae18018730 0x7fae1801abc0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:03.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.781+0000 7fae453a2700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae4010ff10 0x7fae40118980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:03.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.781+0000 7fae453a2700 1 --2- 172.21.15.80:0/1408515173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae4015dd80 0x7fae4010f9d0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:03.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.781+0000 7fae453a2700 1 -- 172.21.15.80:0/1408515173 shutdown_connections 2019-11-28T11:41:03.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.781+0000 7fae453a2700 1 -- 172.21.15.80:0/1408515173 wait complete. 2019-11-28T11:41:03.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.781+0000 7fae453a2700 1 -- 172.21.15.80:0/1408515173 >> 172.21.15.80:0/1408515173 conn(0x7fae4007c000 msgr2=0x7fae4014b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:03.830 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:41:03.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.920+0000 7fd3d911f700 1 Processor -- start 2019-11-28T11:41:03.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.920+0000 7fd3d911f700 1 -- start start 2019-11-28T11:41:03.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.921+0000 7fd3d911f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d406c490 0x7fd3d406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:03.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.921+0000 7fd3d911f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd3d406ce60 0x7fd3d4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:03.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.921+0000 7fd3d911f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d406db00 con 0x7fd3d406c0a0 2019-11-28T11:41:03.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.921+0000 7fd3d911f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d406fd60 con 0x7fd3d406ce60 2019-11-28T11:41:03.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.921+0000 7fd3d911f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d4070030 con 0x7fd3d406c490 2019-11-28T11:41:03.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d891e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd3d406ce60 0x7fd3d4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:03.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d2d9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d406c490 0x7fd3d406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:03.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d359e700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd3d406c0a0 0x7fd3d4072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:53382/0 (socket says 172.21.15.80:53382) 2019-11-28T11:41:03.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d359e700 1 -- 172.21.15.80:0/3368957108 learned_addr learned my addr 172.21.15.80:0/3368957108 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:03.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d259c700 1 -- 172.21.15.80:0/3368957108 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176703216 0 0) 0x7fd3bc001480 con 0x7fd3d406c0a0 2019-11-28T11:41:03.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d259c700 1 -- 172.21.15.80:0/3368957108 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3b4002e80 con 0x7fd3d406c0a0 2019-11-28T11:41:03.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d891e700 1 -- 172.21.15.80:0/3368957108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d406c490 msgr2=0x7fd3d406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:03.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d891e700 1 --2- 172.21.15.80:0/3368957108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d406c490 0x7fd3d406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:03.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d891e700 1 -- 172.21.15.80:0/3368957108 >> v1:172.21.15.174:6789/0 conn(0x7fd3d406c0a0 legacy=0x7fd3d4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:03.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d891e700 1 -- 172.21.15.80:0/3368957108 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d40706c0 con 0x7fd3d406ce60 2019-11-28T11:41:03.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d2d9d700 1 --2- 172.21.15.80:0/3368957108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d406c490 0x7fd3d406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:03.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d891e700 1 --2- 172.21.15.80:0/3368957108 >> v2:172.21.15.174:3300/0 conn(0x7fd3d406ce60 0x7fd3d4164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd3cc00af80 tx=0x7fd3cc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:03.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d891e700 1 --2- 172.21.15.80:0/3368957108 >> v2:172.21.15.174:3300/0 conn(0x7fd3d406ce60 0x7fd3d4164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd3cc00af80 tx=0x7fd3cc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:03.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d891e700 1 --2- 172.21.15.80:0/3368957108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3d406ce60 0x7fd3d4164d70 secure :-1 s=READY pgs=827 cs=0 l=1 rx=0x7fd3cc00af80 tx=0x7fd3cc00b790).ready entity=mon.1 client_cookie=89482c0c1d6937d4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:03.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d891e700 1 --2- 172.21.15.80:0/3368957108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3d406ce60 0x7fd3d4164d70 secure :-1 s=THROTTLE_DONE pgs=827 cs=0 l=1 rx=0x7fd3cc00af80 tx=0x7fd3cc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:03.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d259c700 1 -- 172.21.15.80:0/3368957108 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3cc000bc0 con 0x7fd3d406ce60 2019-11-28T11:41:03.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d891e700 1 --2- 172.21.15.80:0/3368957108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3d406ce60 0x7fd3d4164d70 secure :-1 s=THROTTLE_DONE pgs=827 cs=0 l=1 rx=0x7fd3cc00af80 tx=0x7fd3cc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:03.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.922+0000 7fd3d891e700 1 --2- 172.21.15.80:0/3368957108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3d406ce60 0x7fd3d4164d70 secure :-1 s=THROTTLE_DONE pgs=827 cs=0 l=1 rx=0x7fd3cc00af80 tx=0x7fd3cc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:03.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.923+0000 7fd3d259c700 1 -- 172.21.15.80:0/3368957108 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3cc0097f0 con 0x7fd3d406ce60 2019-11-28T11:41:03.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.923+0000 7fd3d259c700 1 -- 172.21.15.80:0/3368957108 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3cc009ec0 con 0x7fd3d406ce60 2019-11-28T11:41:03.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.923+0000 7fd3d911f700 1 -- 172.21.15.80:0/3368957108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3d406ce60 msgr2=0x7fd3d4164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:03.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.923+0000 7fd3d911f700 1 --2- 172.21.15.80:0/3368957108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3d406ce60 0x7fd3d4164d70 secure :-1 s=READY pgs=827 cs=0 l=1 rx=0x7fd3cc00af80 tx=0x7fd3cc00b790).stop 2019-11-28T11:41:03.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.923+0000 7fd3d911f700 1 -- 172.21.15.80:0/3368957108 shutdown_connections 2019-11-28T11:41:03.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.923+0000 7fd3d911f700 1 --2- 172.21.15.80:0/3368957108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3d406ce60 0x7fd3d4164d70 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:03.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.923+0000 7fd3d911f700 1 --2- 172.21.15.80:0/3368957108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d406c490 0x7fd3d406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:03.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.923+0000 7fd3d911f700 1 -- 172.21.15.80:0/3368957108 shutdown_connections 2019-11-28T11:41:03.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.923+0000 7fd3d911f700 1 -- 172.21.15.80:0/3368957108 wait complete. 2019-11-28T11:41:03.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.923+0000 7fd3d911f700 1 -- 172.21.15.80:0/3368957108 >> 172.21.15.80:0/3368957108 conn(0x7fd3d4061cf0 msgr2=0x7fd3d4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:03.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.925+0000 7fd3d911f700 1 Processor -- start 2019-11-28T11:41:03.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.926+0000 7fd3d911f700 1 -- start start 2019-11-28T11:41:03.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d911f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d413e320 0x7fd3d413e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:03.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d911f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3d412a3c0 0x7fd3d412a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:03.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d911f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d4139e00 con 0x7fd3d415fdf0 2019-11-28T11:41:03.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d911f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d4108820 con 0x7fd3d412a3c0 2019-11-28T11:41:03.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d911f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d4108af0 con 0x7fd3d413e320 2019-11-28T11:41:03.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d891e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3d412a3c0 0x7fd3d412a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:03.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d359e700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd3d415fdf0 0x7fd3d412b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:53388/0 (socket says 172.21.15.80:53388) 2019-11-28T11:41:03.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d359e700 1 -- 172.21.15.80:0/62633652 learned_addr learned my addr 172.21.15.80:0/62633652 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:03.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d891e700 1 --2- 172.21.15.80:0/62633652 >> v2:172.21.15.80:3300/0 conn(0x7fd3d412a3c0 0x7fd3d412a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38532/0 (socket says 172.21.15.80:38532) 2019-11-28T11:41:03.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d2d9d700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d413e320 0x7fd3d413e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3cbfff700 1 -- 172.21.15.80:0/62633652 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655542474 0 0) 0x7fd3bc001070 con 0x7fd3d415fdf0 2019-11-28T11:41:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3cbfff700 1 -- 172.21.15.80:0/62633652 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3ac002e80 con 0x7fd3d415fdf0 2019-11-28T11:41:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d891e700 1 -- 172.21.15.80:0/62633652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d413e320 msgr2=0x7fd3d413e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d891e700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d413e320 0x7fd3d413e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d891e700 1 -- 172.21.15.80:0/62633652 >> v1:172.21.15.174:6789/0 conn(0x7fd3d415fdf0 legacy=0x7fd3d412b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d891e700 1 -- 172.21.15.80:0/62633652 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d410a8c0 con 0x7fd3d412a3c0 2019-11-28T11:41:03.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d2d9d700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d413e320 0x7fd3d413e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:03.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d891e700 1 --2- 172.21.15.80:0/62633652 >> v2:172.21.15.80:3300/0 conn(0x7fd3d412a3c0 0x7fd3d412a810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3cc0543e0 tx=0x7fd3cc054780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:03.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d891e700 1 --2- 172.21.15.80:0/62633652 >> v2:172.21.15.80:3300/0 conn(0x7fd3d412a3c0 0x7fd3d412a810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3cc0543e0 tx=0x7fd3cc054780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:03.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d891e700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3d412a3c0 0x7fd3d412a810 secure :-1 s=READY pgs=1421 cs=0 l=1 rx=0x7fd3cc0543e0 tx=0x7fd3cc054780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:03.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d891e700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3d412a3c0 0x7fd3d412a810 secure :-1 s=THROTTLE_DONE pgs=1421 cs=0 l=1 rx=0x7fd3cc0543e0 tx=0x7fd3cc054780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:03.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3cbfff700 1 -- 172.21.15.80:0/62633652 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3cc00acf0 con 0x7fd3d412a3c0 2019-11-28T11:41:03.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d891e700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3d412a3c0 0x7fd3d412a810 secure :-1 s=THROTTLE_DONE pgs=1421 cs=0 l=1 rx=0x7fd3cc0543e0 tx=0x7fd3cc054780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:03.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d911f700 1 -- 172.21.15.80:0/62633652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d410a8c0 con 0x7fd3d412a3c0 2019-11-28T11:41:03.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3cbfff700 1 -- 172.21.15.80:0/62633652 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3cc00acd0 con 0x7fd3d412a3c0 2019-11-28T11:41:03.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d891e700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3d412a3c0 0x7fd3d412a810 secure :-1 s=THROTTLE_DONE pgs=1421 cs=0 l=1 rx=0x7fd3cc0543e0 tx=0x7fd3cc054780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:03.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3cbfff700 1 -- 172.21.15.80:0/62633652 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3cc009c40 con 0x7fd3d412a3c0 2019-11-28T11:41:03.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.927+0000 7fd3d911f700 1 -- 172.21.15.80:0/62633652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d410a8c0 con 0x7fd3d412a3c0 2019-11-28T11:41:03.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.928+0000 7fd3d891e700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3d412a3c0 0x7fd3d412a810 secure :-1 s=THROTTLE_DONE pgs=1421 cs=0 l=1 rx=0x7fd3cc0543e0 tx=0x7fd3cc054780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:03.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.928+0000 7fd3cbfff700 1 -- 172.21.15.80:0/62633652 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd3cc009860 con 0x7fd3d412a3c0 2019-11-28T11:41:03.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.928+0000 7fd3d891e700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3d412a3c0 0x7fd3d412a810 secure :-1 s=THROTTLE_DONE pgs=1421 cs=0 l=1 rx=0x7fd3cc0543e0 tx=0x7fd3cc054780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:03.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.928+0000 7fd3cbfff700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3ac018770 0x7fd3ac01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:03.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.928+0000 7fd3cbfff700 1 -- 172.21.15.80:0/62633652 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd3cc0759d0 con 0x7fd3d412a3c0 2019-11-28T11:41:03.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.928+0000 7fd3d359e700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3ac018770 0x7fd3ac01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:03.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.929+0000 7fd3d359e700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3ac018770 0x7fd3ac01abe0 crc :-1 s=READY pgs=579 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:03.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.935+0000 7fd3d911f700 1 -- 172.21.15.80:0/62633652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d4109180 con 0x7fd3d412a3c0 2019-11-28T11:41:03.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.939+0000 7fd3d891e700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3d412a3c0 0x7fd3d412a810 secure :-1 s=THROTTLE_DONE pgs=1421 cs=0 l=1 rx=0x7fd3cc0543e0 tx=0x7fd3cc054780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:03.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:03.939+0000 7fd3cbfff700 1 -- 172.21.15.80:0/62633652 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd3cc0095b0 con 0x7fd3d412a3c0 2019-11-28T11:41:04.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.111+0000 7fd3d911f700 1 -- 172.21.15.80:0/62633652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3d4109500 con 0x7fd3d412a3c0 2019-11-28T11:41:04.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.111+0000 7fd3d891e700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3d412a3c0 0x7fd3d412a810 secure :-1 s=THROTTLE_DONE pgs=1421 cs=0 l=1 rx=0x7fd3cc0543e0 tx=0x7fd3cc054780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.111+0000 7fd3cbfff700 1 -- 172.21.15.80:0/62633652 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+1424 (secure 0 0 0) 0x7fd3cc00a1f0 con 0x7fd3d412a3c0 2019-11-28T11:41:04.144 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 72 2019-11-28T11:41:04.145 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:04.145 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":72,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:02.122819+0000","modified":"2019-11-28T11:41:03.754650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2019-11-28T11:41:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.113+0000 7fd3d911f700 1 -- 172.21.15.80:0/62633652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3ac018770 msgr2=0x7fd3ac01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:04.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.113+0000 7fd3d911f700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3ac018770 0x7fd3ac01abe0 crc :-1 s=READY pgs=579 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.113+0000 7fd3d911f700 1 -- 172.21.15.80:0/62633652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3d412a3c0 msgr2=0x7fd3d412a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.113+0000 7fd3d911f700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3d412a3c0 0x7fd3d412a810 secure :-1 s=READY pgs=1421 cs=0 l=1 rx=0x7fd3cc0543e0 tx=0x7fd3cc054780).stop 2019-11-28T11:41:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.113+0000 7fd3d911f700 1 -- 172.21.15.80:0/62633652 shutdown_connections 2019-11-28T11:41:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.113+0000 7fd3d911f700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3d412a3c0 0x7fd3d412a810 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.113+0000 7fd3d911f700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd3d413e320 0x7fd3d413e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.113+0000 7fd3d911f700 1 --2- 172.21.15.80:0/62633652 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3ac018770 0x7fd3ac01abe0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:04.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.114+0000 7fd3d911f700 1 -- 172.21.15.80:0/62633652 shutdown_connections 2019-11-28T11:41:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.114+0000 7fd3d911f700 1 -- 172.21.15.80:0/62633652 wait complete. 2019-11-28T11:41:04.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.114+0000 7fd3d911f700 1 -- 172.21.15.80:0/62633652 >> 172.21.15.80:0/62633652 conn(0x7fd3d4127dc0 msgr2=0x7fd3d4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:04.156 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:41:04.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.242+0000 7f286e862700 1 Processor -- start 2019-11-28T11:41:04.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.242+0000 7f286e862700 1 -- start start 2019-11-28T11:41:04.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.243+0000 7f286e862700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f286806c490 0x7f286806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:04.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.243+0000 7f286e862700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f286806ce60 0x7f2868164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:04.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.243+0000 7f286e862700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286806db00 con 0x7f286806c0a0 2019-11-28T11:41:04.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.243+0000 7f286e862700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286806fd60 con 0x7f286806ce60 2019-11-28T11:41:04.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.243+0000 7f286e862700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2868070030 con 0x7f286806c490 2019-11-28T11:41:04.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.243+0000 7f286cdff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f286806c0a0 0x7f2868072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37852/0 (socket says 172.21.15.80:37852) 2019-11-28T11:41:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.243+0000 7f286cdff700 1 -- 172.21.15.80:0/3269283269 learned_addr learned my addr 172.21.15.80:0/3269283269 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.243+0000 7f286d600700 1 --2- 172.21.15.80:0/3269283269 >> v2:172.21.15.80:3300/0 conn(0x7f286806ce60 0x7f2868164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.244+0000 7f2867fff700 1 --2- 172.21.15.80:0/3269283269 >> v2:172.21.15.174:3300/0 conn(0x7f286806c490 0x7f286806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.244+0000 7f286d600700 1 -- 172.21.15.80:0/3269283269 >> v2:172.21.15.174:3300/0 conn(0x7f286806c490 msgr2=0x7f286806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.244+0000 7f286d600700 1 --2- 172.21.15.80:0/3269283269 >> v2:172.21.15.174:3300/0 conn(0x7f286806c490 0x7f286806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:04.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.244+0000 7f286d600700 1 -- 172.21.15.80:0/3269283269 >> v1:172.21.15.80:6789/0 conn(0x7f286806c0a0 legacy=0x7f2868072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:04.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.244+0000 7f286d600700 1 -- 172.21.15.80:0/3269283269 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28680706c0 con 0x7f286806ce60 2019-11-28T11:41:04.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.244+0000 7f286d600700 1 --2- 172.21.15.80:0/3269283269 >> v2:172.21.15.80:3300/0 conn(0x7f286806ce60 0x7f2868164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f286000b2d0 tx=0x7f286000b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.244+0000 7f286d600700 1 --2- 172.21.15.80:0/3269283269 >> v2:172.21.15.80:3300/0 conn(0x7f286806ce60 0x7f2868164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f286000b2d0 tx=0x7f286000b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.244+0000 7f286d600700 1 --2- 172.21.15.80:0/3269283269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286806ce60 0x7f2868164d70 secure :-1 s=READY pgs=1423 cs=0 l=1 rx=0x7f286000b2d0 tx=0x7f286000b5d0).ready entity=mon.0 client_cookie=c5c789a647211758 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:04.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.244+0000 7f286d600700 1 --2- 172.21.15.80:0/3269283269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286806ce60 0x7f2868164d70 secure :-1 s=THROTTLE_DONE pgs=1423 cs=0 l=1 rx=0x7f286000b2d0 tx=0x7f286000b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.244+0000 7f28677fe700 1 -- 172.21.15.80:0/3269283269 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2860009f20 con 0x7f286806ce60 2019-11-28T11:41:04.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.244+0000 7f286d600700 1 --2- 172.21.15.80:0/3269283269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286806ce60 0x7f2868164d70 secure :-1 s=THROTTLE_DONE pgs=1423 cs=0 l=1 rx=0x7f286000b2d0 tx=0x7f286000b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.244+0000 7f286d600700 1 --2- 172.21.15.80:0/3269283269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286806ce60 0x7f2868164d70 secure :-1 s=THROTTLE_DONE pgs=1423 cs=0 l=1 rx=0x7f286000b2d0 tx=0x7f286000b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.244+0000 7f28677fe700 1 -- 172.21.15.80:0/3269283269 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2860009b40 con 0x7f286806ce60 2019-11-28T11:41:04.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.244+0000 7f28677fe700 1 -- 172.21.15.80:0/3269283269 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286000a500 con 0x7f286806ce60 2019-11-28T11:41:04.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.244+0000 7f286e862700 1 -- 172.21.15.80:0/3269283269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286806ce60 msgr2=0x7f2868164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:04.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.244+0000 7f286e862700 1 --2- 172.21.15.80:0/3269283269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286806ce60 0x7f2868164d70 secure :-1 s=READY pgs=1423 cs=0 l=1 rx=0x7f286000b2d0 tx=0x7f286000b5d0).stop 2019-11-28T11:41:04.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.245+0000 7f286e862700 1 -- 172.21.15.80:0/3269283269 shutdown_connections 2019-11-28T11:41:04.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.245+0000 7f286e862700 1 --2- 172.21.15.80:0/3269283269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f286806ce60 0x7f2868164d70 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:04.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.245+0000 7f286e862700 1 --2- 172.21.15.80:0/3269283269 >> v2:172.21.15.174:3300/0 conn(0x7f286806c490 0x7f286806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:04.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.245+0000 7f286e862700 1 -- 172.21.15.80:0/3269283269 shutdown_connections 2019-11-28T11:41:04.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.245+0000 7f286e862700 1 -- 172.21.15.80:0/3269283269 wait complete. 2019-11-28T11:41:04.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.245+0000 7f286e862700 1 -- 172.21.15.80:0/3269283269 >> 172.21.15.80:0/3269283269 conn(0x7f2868061cf0 msgr2=0x7f2868064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:04.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.247+0000 7f286e862700 1 Processor -- start 2019-11-28T11:41:04.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.247+0000 7f286e862700 1 -- start start 2019-11-28T11:41:04.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.248+0000 7f286e862700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2868103c90 0x7f2868168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:04.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.248+0000 7f286e862700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28681312c0 con 0x7f2868103000 2019-11-28T11:41:04.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.248+0000 7f286e862700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2868131730 con 0x7f286813dc00 2019-11-28T11:41:04.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.248+0000 7f286e862700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2868105830 con 0x7f2868103c90 2019-11-28T11:41:04.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.248+0000 7f2867fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2868103000 0x7f2868103490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37860/0 (socket says 172.21.15.80:37860) 2019-11-28T11:41:04.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.248+0000 7f2867fff700 1 -- 172.21.15.80:0/1042596126 learned_addr learned my addr 172.21.15.80:0/1042596126 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:04.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f286d600700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2868103c90 0x7f2868168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:04.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f28657fa700 1 -- 172.21.15.80:0/1042596126 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801239016 0 0) 0x7f28540010b0 con 0x7f2868103000 2019-11-28T11:41:04.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f28657fa700 1 -- 172.21.15.80:0/1042596126 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2848002e80 con 0x7f2868103000 2019-11-28T11:41:04.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f28657fa700 1 -- 172.21.15.80:0/1042596126 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261065066 0 0) 0x7f285c000f40 con 0x7f286813dc00 2019-11-28T11:41:04.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f28657fa700 1 -- 172.21.15.80:0/1042596126 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28480030b0 con 0x7f286813dc00 2019-11-28T11:41:04.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f28657fa700 1 -- 172.21.15.80:0/1042596126 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4158325421 0 0) 0x7f28540012b0 con 0x7f2868103000 2019-11-28T11:41:04.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f286d600700 1 -- 172.21.15.80:0/1042596126 >> v1:172.21.15.174:6789/0 conn(0x7f286813dc00 legacy=0x7f2868109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:04.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f286d600700 1 -- 172.21.15.80:0/1042596126 >> v1:172.21.15.80:6789/0 conn(0x7f2868103000 legacy=0x7f2868103490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:04.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f286d600700 1 -- 172.21.15.80:0/1042596126 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2868106190 con 0x7f2868103c90 2019-11-28T11:41:04.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f286d600700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2868103c90 0x7f2868168a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28600106f0 tx=0x7f2860010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f286d600700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2868103c90 0x7f2868168a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28600106f0 tx=0x7f2860010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f286d600700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2868103c90 0x7f2868168a20 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7f28600106f0 tx=0x7f2860010a90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:04.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f286d600700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2868103c90 0x7f2868168a20 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f28600106f0 tx=0x7f2860010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f28657fa700 1 -- 172.21.15.80:0/1042596126 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2860009ce0 con 0x7f2868103c90 2019-11-28T11:41:04.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f286d600700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2868103c90 0x7f2868168a20 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f28600106f0 tx=0x7f2860010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f28657fa700 1 -- 172.21.15.80:0/1042596126 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286000b000 con 0x7f2868103c90 2019-11-28T11:41:04.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f286e862700 1 -- 172.21.15.80:0/1042596126 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2868106510 con 0x7f2868103c90 2019-11-28T11:41:04.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f286d600700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2868103c90 0x7f2868168a20 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f28600106f0 tx=0x7f2860010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f28657fa700 1 -- 172.21.15.80:0/1042596126 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2860009ce0 con 0x7f2868103c90 2019-11-28T11:41:04.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.249+0000 7f286e862700 1 -- 172.21.15.80:0/1042596126 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2868106190 con 0x7f2868103c90 2019-11-28T11:41:04.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.250+0000 7f286d600700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2868103c90 0x7f2868168a20 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f28600106f0 tx=0x7f2860010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.250+0000 7f28657fa700 1 -- 172.21.15.80:0/1042596126 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2860009900 con 0x7f2868103c90 2019-11-28T11:41:04.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.250+0000 7f286d600700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2868103c90 0x7f2868168a20 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f28600106f0 tx=0x7f2860010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.250+0000 7f28657fa700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2848018750 0x7f284801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:04.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.250+0000 7f28657fa700 1 -- 172.21.15.80:0/1042596126 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2860031e50 con 0x7f2868103c90 2019-11-28T11:41:04.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.250+0000 7f286cdff700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2848018750 0x7f284801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:04.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.250+0000 7f286cdff700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2848018750 0x7f284801abe0 crc :-1 s=READY pgs=580 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:04.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.257+0000 7f286e862700 1 -- 172.21.15.80:0/1042596126 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2868106510 con 0x7f2868103c90 2019-11-28T11:41:04.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.261+0000 7f286d600700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2868103c90 0x7f2868168a20 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f28600106f0 tx=0x7f2860010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.261+0000 7f28657fa700 1 -- 172.21.15.80:0/1042596126 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2860000d70 con 0x7f2868103c90 2019-11-28T11:41:04.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.436+0000 7f286e862700 1 -- 172.21.15.80:0/1042596126 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2868106190 con 0x7f2868103c90 2019-11-28T11:41:04.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.438+0000 7f286d600700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2868103c90 0x7f2868168a20 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f28600106f0 tx=0x7f2860010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.438+0000 7f28657fa700 1 -- 172.21.15.80:0/1042596126 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+14870 (secure 0 0 0) 0x7f2860009900 con 0x7f2868103c90 2019-11-28T11:41:04.472 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:04.473 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":107,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:41:03.124379+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:41:00.409798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2019-11-28T11:41:01.100729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:41:04.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.441+0000 7f286e862700 1 -- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2848018750 msgr2=0x7f284801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:04.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.441+0000 7f286e862700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2848018750 0x7f284801abe0 crc :-1 s=READY pgs=580 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:04.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.441+0000 7f286e862700 1 -- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2868103c90 msgr2=0x7f2868168a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:04.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.441+0000 7f286e862700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2868103c90 0x7f2868168a20 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7f28600106f0 tx=0x7f2860010a90).stop 2019-11-28T11:41:04.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.441+0000 7f286e862700 1 -- 172.21.15.80:0/1042596126 shutdown_connections 2019-11-28T11:41:04.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.441+0000 7f286e862700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2868103c90 0x7f2868168a20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:04.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.441+0000 7f286e862700 1 --2- 172.21.15.80:0/1042596126 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2848018750 0x7f284801abe0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:04.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.441+0000 7f286e862700 1 -- 172.21.15.80:0/1042596126 shutdown_connections 2019-11-28T11:41:04.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.441+0000 7f286e862700 1 -- 172.21.15.80:0/1042596126 wait complete. 2019-11-28T11:41:04.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.441+0000 7f286e862700 1 -- 172.21.15.80:0/1042596126 >> 172.21.15.80:0/1042596126 conn(0x7f286811bfc0 msgr2=0x7f2868141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:04.490 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:41:04.491 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:41:04.491 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:41:04.491 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:41:04.492 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:41:04.492 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:41:04.513 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:41:04.513 DEBUG:teuthology.parallel:result is None 2019-11-28T11:41:04.513 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:41:04.514 DEBUG:teuthology.parallel:result is None 2019-11-28T11:41:04.514 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:41:04.514 DEBUG:teuthology.parallel:result is None 2019-11-28T11:41:04.515 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:41:04.605 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:41:04.605 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:41:04.605 INFO:tasks.ceph.mds.a.smithi080.stderr:2019-11-28T11:41:04.573+0000 7f86ad842700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2019-11-28T11:41:04.607 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:41:04.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.620+0000 7fd3b2494700 1 Processor -- start 2019-11-28T11:41:04.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.620+0000 7fd3b2494700 1 -- start start 2019-11-28T11:41:04.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.621+0000 7fd3b2494700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3ac15f100 0x7fd3ac06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:04.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.621+0000 7fd3b2494700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd3ac06c2f0 0x7fd3ac06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:04.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.621+0000 7fd3b2494700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ac06db60 con 0x7fd3ac15ed10 2019-11-28T11:41:04.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.621+0000 7fd3b2494700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ac06fe00 con 0x7fd3ac15f100 2019-11-28T11:41:04.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.621+0000 7fd3b2494700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ac0700d0 con 0x7fd3ac06c2f0 2019-11-28T11:41:04.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3abfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3ac15f100 0x7fd3ac06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:04.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3abfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3ac15f100 0x7fd3ac06bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38576/0 (socket says 172.21.15.80:38576) 2019-11-28T11:41:04.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3abfff700 1 -- 172.21.15.80:0/2997190250 learned_addr learned my addr 172.21.15.80:0/2997190250 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:04.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3b1232700 1 --2- 172.21.15.80:0/2997190250 >> v2:172.21.15.174:3300/0 conn(0x7fd3ac06c2f0 0x7fd3ac06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:04.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3abfff700 1 -- 172.21.15.80:0/2997190250 >> v2:172.21.15.174:3300/0 conn(0x7fd3ac06c2f0 msgr2=0x7fd3ac06c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:04.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3abfff700 1 --2- 172.21.15.80:0/2997190250 >> v2:172.21.15.174:3300/0 conn(0x7fd3ac06c2f0 0x7fd3ac06c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:04.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3abfff700 1 -- 172.21.15.80:0/2997190250 >> v1:172.21.15.174:6789/0 conn(0x7fd3ac15ed10 legacy=0x7fd3ac073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:04.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3abfff700 1 -- 172.21.15.80:0/2997190250 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac070760 con 0x7fd3ac15f100 2019-11-28T11:41:04.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3abfff700 1 --2- 172.21.15.80:0/2997190250 >> v2:172.21.15.80:3300/0 conn(0x7fd3ac15f100 0x7fd3ac06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd39c00fa40 tx=0x7fd39c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3abfff700 1 --2- 172.21.15.80:0/2997190250 >> v2:172.21.15.80:3300/0 conn(0x7fd3ac15f100 0x7fd3ac06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd39c00fa40 tx=0x7fd39c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3abfff700 1 --2- 172.21.15.80:0/2997190250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac15f100 0x7fd3ac06bdb0 secure :-1 s=READY pgs=1433 cs=0 l=1 rx=0x7fd39c00fa40 tx=0x7fd39c00fde0).ready entity=mon.0 client_cookie=9640c51013928c4a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:04.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3abfff700 1 --2- 172.21.15.80:0/2997190250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac15f100 0x7fd3ac06bdb0 secure :-1 s=THROTTLE_DONE pgs=1433 cs=0 l=1 rx=0x7fd39c00fa40 tx=0x7fd39c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3abfff700 1 --2- 172.21.15.80:0/2997190250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac15f100 0x7fd3ac06bdb0 secure :-1 s=THROTTLE_DONE pgs=1433 cs=0 l=1 rx=0x7fd39c00fa40 tx=0x7fd39c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3ab7fe700 1 -- 172.21.15.80:0/2997190250 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd39c000ce0 con 0x7fd3ac15f100 2019-11-28T11:41:04.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3abfff700 1 --2- 172.21.15.80:0/2997190250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac15f100 0x7fd3ac06bdb0 secure :-1 s=THROTTLE_DONE pgs=1433 cs=0 l=1 rx=0x7fd39c00fa40 tx=0x7fd39c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3ab7fe700 1 -- 172.21.15.80:0/2997190250 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39c001010 con 0x7fd3ac15f100 2019-11-28T11:41:04.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3ab7fe700 1 -- 172.21.15.80:0/2997190250 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd39c001720 con 0x7fd3ac15f100 2019-11-28T11:41:04.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3b2494700 1 -- 172.21.15.80:0/2997190250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac15f100 msgr2=0x7fd3ac06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:04.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.622+0000 7fd3b2494700 1 --2- 172.21.15.80:0/2997190250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac15f100 0x7fd3ac06bdb0 secure :-1 s=READY pgs=1433 cs=0 l=1 rx=0x7fd39c00fa40 tx=0x7fd39c00fde0).stop 2019-11-28T11:41:04.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.623+0000 7fd3b2494700 1 -- 172.21.15.80:0/2997190250 shutdown_connections 2019-11-28T11:41:04.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.623+0000 7fd3b2494700 1 --2- 172.21.15.80:0/2997190250 >> v2:172.21.15.174:3300/0 conn(0x7fd3ac06c2f0 0x7fd3ac06c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:04.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.623+0000 7fd3b2494700 1 --2- 172.21.15.80:0/2997190250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac15f100 0x7fd3ac06bdb0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:04.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.623+0000 7fd3b2494700 1 -- 172.21.15.80:0/2997190250 shutdown_connections 2019-11-28T11:41:04.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.623+0000 7fd3b2494700 1 -- 172.21.15.80:0/2997190250 wait complete. 2019-11-28T11:41:04.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.623+0000 7fd3b2494700 1 -- 172.21.15.80:0/2997190250 >> 172.21.15.80:0/2997190250 conn(0x7fd3ac061d40 msgr2=0x7fd3ac0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:04.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.625+0000 7fd3b2494700 1 Processor -- start 2019-11-28T11:41:04.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.625+0000 7fd3b2494700 1 -- start start 2019-11-28T11:41:04.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.626+0000 7fd3b2494700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd3ac152750 0x7fd3ac135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:04.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.626+0000 7fd3b2494700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3ac165d60 0x7fd3ac168160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:04.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.626+0000 7fd3b2494700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ac109d70 con 0x7fd3ac130dc0 2019-11-28T11:41:04.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.626+0000 7fd3b2494700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ac132570 con 0x7fd3ac165d60 2019-11-28T11:41:04.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.626+0000 7fd3b2494700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ac132840 con 0x7fd3ac152750 2019-11-28T11:41:04.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.626+0000 7fd3b1232700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3ac165d60 0x7fd3ac168160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:04.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3b1232700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd3ac165d60 0x7fd3ac168160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38584/0 (socket says 172.21.15.80:38584) 2019-11-28T11:41:04.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3b1232700 1 -- 172.21.15.80:0/2570500041 learned_addr learned my addr 172.21.15.80:0/2570500041 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:04.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3b0a31700 1 --2- 172.21.15.80:0/2570500041 >> v2:172.21.15.174:3300/0 conn(0x7fd3ac152750 0x7fd3ac135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:04.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3b1232700 1 -- 172.21.15.80:0/2570500041 >> v2:172.21.15.174:3300/0 conn(0x7fd3ac152750 msgr2=0x7fd3ac135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:04.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3b1232700 1 --2- 172.21.15.80:0/2570500041 >> v2:172.21.15.174:3300/0 conn(0x7fd3ac152750 0x7fd3ac135790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:04.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3b1232700 1 -- 172.21.15.80:0/2570500041 >> v1:172.21.15.174:6789/0 conn(0x7fd3ac130dc0 legacy=0x7fd3ac131250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:04.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3b1232700 1 -- 172.21.15.80:0/2570500041 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac132ed0 con 0x7fd3ac165d60 2019-11-28T11:41:04.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3b1232700 1 --2- 172.21.15.80:0/2570500041 >> v2:172.21.15.80:3300/0 conn(0x7fd3ac165d60 0x7fd3ac168160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3a4010440 tx=0x7fd3a4006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3b1232700 1 --2- 172.21.15.80:0/2570500041 >> v2:172.21.15.80:3300/0 conn(0x7fd3ac165d60 0x7fd3ac168160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3a4010440 tx=0x7fd3a4006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3b1232700 1 --2- 172.21.15.80:0/2570500041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac165d60 0x7fd3ac168160 secure :-1 s=READY pgs=1434 cs=0 l=1 rx=0x7fd3a4010440 tx=0x7fd3a4006f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:04.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3b1232700 1 --2- 172.21.15.80:0/2570500041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac165d60 0x7fd3ac168160 secure :-1 s=THROTTLE_DONE pgs=1434 cs=0 l=1 rx=0x7fd3a4010440 tx=0x7fd3a4006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3b1232700 1 --2- 172.21.15.80:0/2570500041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac165d60 0x7fd3ac168160 secure :-1 s=THROTTLE_DONE pgs=1434 cs=0 l=1 rx=0x7fd3a4010440 tx=0x7fd3a4006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3a97fa700 1 -- 172.21.15.80:0/2570500041 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3a4000a70 con 0x7fd3ac165d60 2019-11-28T11:41:04.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3b1232700 1 --2- 172.21.15.80:0/2570500041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac165d60 0x7fd3ac168160 secure :-1 s=THROTTLE_DONE pgs=1434 cs=0 l=1 rx=0x7fd3a4010440 tx=0x7fd3a4006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3a97fa700 1 -- 172.21.15.80:0/2570500041 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a400ecb0 con 0x7fd3ac165d60 2019-11-28T11:41:04.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3a97fa700 1 -- 172.21.15.80:0/2570500041 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3a400f380 con 0x7fd3ac165d60 2019-11-28T11:41:04.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3b2494700 1 -- 172.21.15.80:0/2570500041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ac133250 con 0x7fd3ac165d60 2019-11-28T11:41:04.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.627+0000 7fd3b2494700 1 -- 172.21.15.80:0/2570500041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ac132ed0 con 0x7fd3ac165d60 2019-11-28T11:41:04.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.628+0000 7fd3b1232700 1 --2- 172.21.15.80:0/2570500041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac165d60 0x7fd3ac168160 secure :-1 s=THROTTLE_DONE pgs=1434 cs=0 l=1 rx=0x7fd3a4010440 tx=0x7fd3a4006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.628+0000 7fd3a97fa700 1 -- 172.21.15.80:0/2570500041 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd3a4000a70 con 0x7fd3ac165d60 2019-11-28T11:41:04.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.628+0000 7fd3b1232700 1 --2- 172.21.15.80:0/2570500041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac165d60 0x7fd3ac168160 secure :-1 s=THROTTLE_DONE pgs=1434 cs=0 l=1 rx=0x7fd3a4010440 tx=0x7fd3a4006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.628+0000 7fd3a97fa700 1 --2- 172.21.15.80:0/2570500041 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd390018730 0x7fd39001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:04.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.628+0000 7fd3a97fa700 1 -- 172.21.15.80:0/2570500041 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd3a4031a70 con 0x7fd3ac165d60 2019-11-28T11:41:04.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.628+0000 7fd3b0a31700 1 --2- 172.21.15.80:0/2570500041 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd390018730 0x7fd39001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:04.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.628+0000 7fd3b0a31700 1 --2- 172.21.15.80:0/2570500041 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd390018730 0x7fd39001abc0 crc :-1 s=READY pgs=581 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:04.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.636+0000 7fd3b2494700 1 -- 172.21.15.80:0/2570500041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ac133250 con 0x7fd3ac165d60 2019-11-28T11:41:04.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.639+0000 7fd3b1232700 1 --2- 172.21.15.80:0/2570500041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac165d60 0x7fd3ac168160 secure :-1 s=THROTTLE_DONE pgs=1434 cs=0 l=1 rx=0x7fd3a4010440 tx=0x7fd3a4006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.639+0000 7fd3a97fa700 1 -- 172.21.15.80:0/2570500041 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd3a4006530 con 0x7fd3ac165d60 2019-11-28T11:41:04.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.816+0000 7fd3b2494700 1 -- 172.21.15.80:0/2570500041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd3ac132ed0 con 0x7fd3ac165d60 2019-11-28T11:41:04.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.818+0000 7fd3b1232700 1 --2- 172.21.15.80:0/2570500041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac165d60 0x7fd3ac168160 secure :-1 s=THROTTLE_DONE pgs=1434 cs=0 l=1 rx=0x7fd3a4010440 tx=0x7fd3a4006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:04.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.818+0000 7fd3a97fa700 1 -- 172.21.15.80:0/2570500041 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v36) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd3a40173f0 con 0x7fd3ac165d60 2019-11-28T11:41:04.853 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:41:04.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.821+0000 7fd3b2494700 1 -- 172.21.15.80:0/2570500041 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd390018730 msgr2=0x7fd39001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:04.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.821+0000 7fd3b2494700 1 --2- 172.21.15.80:0/2570500041 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd390018730 0x7fd39001abc0 crc :-1 s=READY pgs=581 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:04.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.821+0000 7fd3b2494700 1 -- 172.21.15.80:0/2570500041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac165d60 msgr2=0x7fd3ac168160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:04.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.821+0000 7fd3b2494700 1 --2- 172.21.15.80:0/2570500041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac165d60 0x7fd3ac168160 secure :-1 s=READY pgs=1434 cs=0 l=1 rx=0x7fd3a4010440 tx=0x7fd3a4006f90).stop 2019-11-28T11:41:04.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.821+0000 7fd3b2494700 1 -- 172.21.15.80:0/2570500041 shutdown_connections 2019-11-28T11:41:04.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.821+0000 7fd3b2494700 1 --2- 172.21.15.80:0/2570500041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd3ac165d60 0x7fd3ac168160 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:04.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.821+0000 7fd3b2494700 1 --2- 172.21.15.80:0/2570500041 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd390018730 0x7fd39001abc0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:04.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.821+0000 7fd3b2494700 1 --2- 172.21.15.80:0/2570500041 >> v2:172.21.15.174:3300/0 conn(0x7fd3ac152750 0x7fd3ac135790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:04.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.821+0000 7fd3b2494700 1 -- 172.21.15.80:0/2570500041 shutdown_connections 2019-11-28T11:41:04.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.821+0000 7fd3b2494700 1 -- 172.21.15.80:0/2570500041 wait complete. 2019-11-28T11:41:04.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.821+0000 7fd3b2494700 1 -- 172.21.15.80:0/2570500041 >> 172.21.15.80:0/2570500041 conn(0x7fd3ac1476e0 msgr2=0x7fd3ac12fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:04.874 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:41:05.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.977+0000 7f6add497700 1 Processor -- start 2019-11-28T11:41:05.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.977+0000 7f6add497700 1 -- start start 2019-11-28T11:41:05.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.978+0000 7f6add497700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ad81639f0 0x7f6ad8165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.978+0000 7f6add497700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad806db60 con 0x7f6ad815f100 2019-11-28T11:41:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.978+0000 7f6add497700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad806e060 con 0x7f6ad815ed10 2019-11-28T11:41:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.978+0000 7f6add497700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad806fe00 con 0x7f6ad81639f0 2019-11-28T11:41:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.978+0000 7f6ad6ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6ad815f100 0x7f6ad806bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37904/0 (socket says 172.21.15.80:37904) 2019-11-28T11:41:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.978+0000 7f6ad6ffd700 1 -- 172.21.15.80:0/905379827 learned_addr learned my addr 172.21.15.80:0/905379827 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.978+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/905379827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ad81639f0 0x7f6ad8165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:05.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.978+0000 7f6ad67fc700 1 -- 172.21.15.80:0/905379827 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190995719 0 0) 0x7f6acc001150 con 0x7f6ad815f100 2019-11-28T11:41:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.978+0000 7f6ad67fc700 1 -- 172.21.15.80:0/905379827 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac0002e80 con 0x7f6ad815f100 2019-11-28T11:41:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.978+0000 7f6ad67fc700 1 -- 172.21.15.80:0/905379827 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981711313 0 0) 0x7f6ac8001080 con 0x7f6ad815ed10 2019-11-28T11:41:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.978+0000 7f6ad67fc700 1 -- 172.21.15.80:0/905379827 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac00030b0 con 0x7f6ad815ed10 2019-11-28T11:41:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.978+0000 7f6ad67fc700 1 -- 172.21.15.80:0/905379827 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2313337758 0 0) 0x7f6acc001130 con 0x7f6ad815f100 2019-11-28T11:41:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.978+0000 7f6ad7fff700 1 -- 172.21.15.80:0/905379827 >> v1:172.21.15.174:6789/0 conn(0x7f6ad815ed10 legacy=0x7f6ad8073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.978+0000 7f6ad7fff700 1 -- 172.21.15.80:0/905379827 >> v1:172.21.15.80:6789/0 conn(0x7f6ad815f100 legacy=0x7f6ad806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.978+0000 7f6ad7fff700 1 -- 172.21.15.80:0/905379827 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad8070760 con 0x7f6ad81639f0 2019-11-28T11:41:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.978+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/905379827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ad81639f0 0x7f6ad8165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ad000b300 tx=0x7f6ad000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.979+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/905379827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ad81639f0 0x7f6ad8165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ad000b300 tx=0x7f6ad000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.979+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/905379827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ad81639f0 0x7f6ad8165df0 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f6ad000b300 tx=0x7f6ad000bb10).ready entity=mon.2 client_cookie=57b7f621fe21ec67 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.979+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/905379827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ad81639f0 0x7f6ad8165df0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f6ad000b300 tx=0x7f6ad000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.979+0000 7f6ad67fc700 1 -- 172.21.15.80:0/905379827 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ad00075c0 con 0x7f6ad81639f0 2019-11-28T11:41:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.979+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/905379827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ad81639f0 0x7f6ad8165df0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f6ad000b300 tx=0x7f6ad000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.979+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/905379827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ad81639f0 0x7f6ad8165df0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f6ad000b300 tx=0x7f6ad000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.979+0000 7f6ad67fc700 1 -- 172.21.15.80:0/905379827 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad0000f30 con 0x7f6ad81639f0 2019-11-28T11:41:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.979+0000 7f6ad67fc700 1 -- 172.21.15.80:0/905379827 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ad000a1e0 con 0x7f6ad81639f0 2019-11-28T11:41:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.979+0000 7f6add497700 1 -- 172.21.15.80:0/905379827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ad81639f0 msgr2=0x7f6ad8165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.979+0000 7f6add497700 1 --2- 172.21.15.80:0/905379827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ad81639f0 0x7f6ad8165df0 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f6ad000b300 tx=0x7f6ad000bb10).stop 2019-11-28T11:41:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.979+0000 7f6add497700 1 -- 172.21.15.80:0/905379827 shutdown_connections 2019-11-28T11:41:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.979+0000 7f6add497700 1 --2- 172.21.15.80:0/905379827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ad81639f0 0x7f6ad8165df0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:05.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.979+0000 7f6add497700 1 -- 172.21.15.80:0/905379827 shutdown_connections 2019-11-28T11:41:05.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.979+0000 7f6add497700 1 -- 172.21.15.80:0/905379827 wait complete. 2019-11-28T11:41:05.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.979+0000 7f6add497700 1 -- 172.21.15.80:0/905379827 >> 172.21.15.80:0/905379827 conn(0x7f6ad8061d40 msgr2=0x7f6ad80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:05.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.982+0000 7f6add497700 1 Processor -- start 2019-11-28T11:41:05.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.982+0000 7f6add497700 1 -- start start 2019-11-28T11:41:05.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.983+0000 7f6add497700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6ad812e1a0 0x7f6ad812e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:05.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.983+0000 7f6add497700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ad812eb70 0x7f6ad8105a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:05.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.983+0000 7f6add497700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad8130b20 con 0x7f6ad8114f60 2019-11-28T11:41:05.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.983+0000 7f6add497700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad8148b60 con 0x7f6ad812eb70 2019-11-28T11:41:05.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.983+0000 7f6add497700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad8148e30 con 0x7f6ad812e1a0 2019-11-28T11:41:05.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.983+0000 7f6ad7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ad812eb70 0x7f6ad8105a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:05.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.983+0000 7f6ad7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ad812eb70 0x7f6ad8105a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38598/0 (socket says 172.21.15.80:38598) 2019-11-28T11:41:05.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.983+0000 7f6ad7fff700 1 -- 172.21.15.80:0/667317515 learned_addr learned my addr 172.21.15.80:0/667317515 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:05.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.983+0000 7f6ad6ffd700 1 --2- 172.21.15.80:0/667317515 >> v2:172.21.15.174:3300/0 conn(0x7f6ad812e1a0 0x7f6ad812e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:05.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.983+0000 7f6ad7fff700 1 -- 172.21.15.80:0/667317515 >> v2:172.21.15.174:3300/0 conn(0x7f6ad812e1a0 msgr2=0x7f6ad812e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.983+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/667317515 >> v2:172.21.15.174:3300/0 conn(0x7f6ad812e1a0 0x7f6ad812e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.983+0000 7f6ad7fff700 1 -- 172.21.15.80:0/667317515 >> v1:172.21.15.174:6789/0 conn(0x7f6ad8114f60 legacy=0x7f6ad8106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.983+0000 7f6ad7fff700 1 -- 172.21.15.80:0/667317515 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad8104390 con 0x7f6ad812eb70 2019-11-28T11:41:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.983+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/667317515 >> v2:172.21.15.80:3300/0 conn(0x7f6ad812eb70 0x7f6ad8105a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ad00107c0 tx=0x7f6ad0010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.983+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/667317515 >> v2:172.21.15.80:3300/0 conn(0x7f6ad812eb70 0x7f6ad8105a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ad00107c0 tx=0x7f6ad0010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.983+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/667317515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ad812eb70 0x7f6ad8105a10 secure :-1 s=READY pgs=1436 cs=0 l=1 rx=0x7f6ad00107c0 tx=0x7f6ad0010640).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.984+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/667317515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ad812eb70 0x7f6ad8105a10 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7f6ad00107c0 tx=0x7f6ad0010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.984+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/667317515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ad812eb70 0x7f6ad8105a10 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7f6ad00107c0 tx=0x7f6ad0010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.984+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/667317515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ad812eb70 0x7f6ad8105a10 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7f6ad00107c0 tx=0x7f6ad0010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.984+0000 7f6abffff700 1 -- 172.21.15.80:0/667317515 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ad000b360 con 0x7f6ad812eb70 2019-11-28T11:41:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.984+0000 7f6abffff700 1 -- 172.21.15.80:0/667317515 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad0009d30 con 0x7f6ad812eb70 2019-11-28T11:41:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.984+0000 7f6abffff700 1 -- 172.21.15.80:0/667317515 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ad000a400 con 0x7f6ad812eb70 2019-11-28T11:41:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.984+0000 7f6add497700 1 -- 172.21.15.80:0/667317515 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad8104710 con 0x7f6ad812eb70 2019-11-28T11:41:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.984+0000 7f6add497700 1 -- 172.21.15.80:0/667317515 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad8104390 con 0x7f6ad812eb70 2019-11-28T11:41:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.984+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/667317515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ad812eb70 0x7f6ad8105a10 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7f6ad00107c0 tx=0x7f6ad0010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.984+0000 7f6abffff700 1 -- 172.21.15.80:0/667317515 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6ad0009930 con 0x7f6ad812eb70 2019-11-28T11:41:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.984+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/667317515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ad812eb70 0x7f6ad8105a10 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7f6ad00107c0 tx=0x7f6ad0010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.984+0000 7f6abffff700 1 --2- 172.21.15.80:0/667317515 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ab8018730 0x7f6ab801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.984+0000 7f6abffff700 1 -- 172.21.15.80:0/667317515 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6ad0031e00 con 0x7f6ad812eb70 2019-11-28T11:41:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.985+0000 7f6ad77fe700 1 --2- 172.21.15.80:0/667317515 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ab8018730 0x7f6ab801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.985+0000 7f6ad77fe700 1 --2- 172.21.15.80:0/667317515 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ab8018730 0x7f6ab801abc0 crc :-1 s=READY pgs=583 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:05.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.992+0000 7f6add497700 1 -- 172.21.15.80:0/667317515 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad8104710 con 0x7f6ad812eb70 2019-11-28T11:41:05.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.996+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/667317515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ad812eb70 0x7f6ad8105a10 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7f6ad00107c0 tx=0x7f6ad0010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:04.996+0000 7f6abffff700 1 -- 172.21.15.80:0/667317515 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6ad000b360 con 0x7f6ad812eb70 2019-11-28T11:41:05.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.165+0000 7f6add497700 1 -- 172.21.15.80:0/667317515 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6ad8104390 con 0x7f6ad812eb70 2019-11-28T11:41:05.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.168+0000 7f6ad7fff700 1 --2- 172.21.15.80:0/667317515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ad812eb70 0x7f6ad8105a10 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7f6ad00107c0 tx=0x7f6ad0010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.168+0000 7f6abffff700 1 -- 172.21.15.80:0/667317515 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v37) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6ad0009f20 con 0x7f6ad812eb70 2019-11-28T11:41:05.205 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:41:05.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.174+0000 7f6add497700 1 -- 172.21.15.80:0/667317515 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ab8018730 msgr2=0x7f6ab801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.174+0000 7f6add497700 1 --2- 172.21.15.80:0/667317515 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ab8018730 0x7f6ab801abc0 crc :-1 s=READY pgs=583 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:05.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.174+0000 7f6add497700 1 -- 172.21.15.80:0/667317515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ad812eb70 msgr2=0x7f6ad8105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.174+0000 7f6add497700 1 --2- 172.21.15.80:0/667317515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ad812eb70 0x7f6ad8105a10 secure :-1 s=READY pgs=1436 cs=0 l=1 rx=0x7f6ad00107c0 tx=0x7f6ad0010640).stop 2019-11-28T11:41:05.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.174+0000 7f6add497700 1 -- 172.21.15.80:0/667317515 shutdown_connections 2019-11-28T11:41:05.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.174+0000 7f6add497700 1 --2- 172.21.15.80:0/667317515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ad812eb70 0x7f6ad8105a10 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:05.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.174+0000 7f6add497700 1 --2- 172.21.15.80:0/667317515 >> v2:172.21.15.174:3300/0 conn(0x7f6ad812e1a0 0x7f6ad812e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:05.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.174+0000 7f6add497700 1 --2- 172.21.15.80:0/667317515 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ab8018730 0x7f6ab801abc0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:05.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.174+0000 7f6add497700 1 -- 172.21.15.80:0/667317515 shutdown_connections 2019-11-28T11:41:05.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.174+0000 7f6add497700 1 -- 172.21.15.80:0/667317515 wait complete. 2019-11-28T11:41:05.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.174+0000 7f6add497700 1 -- 172.21.15.80:0/667317515 >> 172.21.15.80:0/667317515 conn(0x7f6ad81476e0 msgr2=0x7f6ad812fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:05.217 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:41:05.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.316+0000 7fd414b56700 1 Processor -- start 2019-11-28T11:41:05.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.316+0000 7fd414b56700 1 -- start start 2019-11-28T11:41:05.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd414b56700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd41015ed10 0x7fd41015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:05.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd414b56700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd410073020 0x7fd410071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:05.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd414b56700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4100734b0 0x7fd4100723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:05.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd414b56700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41006fe00 con 0x7fd41015ed10 2019-11-28T11:41:05.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd414b56700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4100700d0 con 0x7fd410073020 2019-11-28T11:41:05.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd414b56700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41006f3d0 con 0x7fd4100734b0 2019-11-28T11:41:05.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd41015ed10 0x7fd41015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:05.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd41015ed10 0x7fd41015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38602/0 (socket says 172.21.15.80:38602) 2019-11-28T11:41:05.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40ed9d700 1 -- 172.21.15.80:0/1424120588 learned_addr learned my addr 172.21.15.80:0/1424120588 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:05.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40f59e700 1 --2- 172.21.15.80:0/1424120588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4100734b0 0x7fd4100723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:05.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40e59c700 1 --2- 172.21.15.80:0/1424120588 >> v2:172.21.15.174:3300/0 conn(0x7fd410073020 0x7fd410071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:05.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40ed9d700 1 -- 172.21.15.80:0/1424120588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4100734b0 msgr2=0x7fd4100723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:05.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40ed9d700 1 --2- 172.21.15.80:0/1424120588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4100734b0 0x7fd4100723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:05.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40ed9d700 1 -- 172.21.15.80:0/1424120588 >> v2:172.21.15.174:3300/0 conn(0x7fd410073020 msgr2=0x7fd410071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:05.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40ed9d700 1 --2- 172.21.15.80:0/1424120588 >> v2:172.21.15.174:3300/0 conn(0x7fd410073020 0x7fd410071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:05.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40ed9d700 1 -- 172.21.15.80:0/1424120588 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd410070760 con 0x7fd41015ed10 2019-11-28T11:41:05.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40f59e700 1 --2- 172.21.15.80:0/1424120588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4100734b0 0x7fd4100723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:05.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40ed9d700 1 --2- 172.21.15.80:0/1424120588 >> v2:172.21.15.80:3300/0 conn(0x7fd41015ed10 0x7fd41015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd40000f740 tx=0x7fd40000f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40ed9d700 1 --2- 172.21.15.80:0/1424120588 >> v2:172.21.15.80:3300/0 conn(0x7fd41015ed10 0x7fd41015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd40000f740 tx=0x7fd40000f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40ed9d700 1 --2- 172.21.15.80:0/1424120588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41015ed10 0x7fd41015f100 secure :-1 s=READY pgs=1437 cs=0 l=1 rx=0x7fd40000f740 tx=0x7fd40000f5f0).ready entity=mon.0 client_cookie=b20d1e352e429e25 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:05.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40ed9d700 1 --2- 172.21.15.80:0/1424120588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41015ed10 0x7fd41015f100 secure :-1 s=THROTTLE_DONE pgs=1437 cs=0 l=1 rx=0x7fd40000f740 tx=0x7fd40000f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40ed9d700 1 --2- 172.21.15.80:0/1424120588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41015ed10 0x7fd41015f100 secure :-1 s=THROTTLE_DONE pgs=1437 cs=0 l=1 rx=0x7fd40000f740 tx=0x7fd40000f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40ed9d700 1 --2- 172.21.15.80:0/1424120588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41015ed10 0x7fd41015f100 secure :-1 s=THROTTLE_DONE pgs=1437 cs=0 l=1 rx=0x7fd40000f740 tx=0x7fd40000f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40dd9b700 1 -- 172.21.15.80:0/1424120588 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd400000960 con 0x7fd41015ed10 2019-11-28T11:41:05.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40dd9b700 1 -- 172.21.15.80:0/1424120588 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd400000c90 con 0x7fd41015ed10 2019-11-28T11:41:05.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd40dd9b700 1 -- 172.21.15.80:0/1424120588 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4000013a0 con 0x7fd41015ed10 2019-11-28T11:41:05.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd414b56700 1 -- 172.21.15.80:0/1424120588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41015ed10 msgr2=0x7fd41015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.318+0000 7fd414b56700 1 --2- 172.21.15.80:0/1424120588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41015ed10 0x7fd41015f100 secure :-1 s=READY pgs=1437 cs=0 l=1 rx=0x7fd40000f740 tx=0x7fd40000f5f0).stop 2019-11-28T11:41:05.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.319+0000 7fd414b56700 1 -- 172.21.15.80:0/1424120588 shutdown_connections 2019-11-28T11:41:05.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.319+0000 7fd414b56700 1 --2- 172.21.15.80:0/1424120588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4100734b0 0x7fd4100723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:05.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.319+0000 7fd414b56700 1 --2- 172.21.15.80:0/1424120588 >> v2:172.21.15.174:3300/0 conn(0x7fd410073020 0x7fd410071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:05.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.319+0000 7fd414b56700 1 --2- 172.21.15.80:0/1424120588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41015ed10 0x7fd41015f100 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:05.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.319+0000 7fd414b56700 1 -- 172.21.15.80:0/1424120588 shutdown_connections 2019-11-28T11:41:05.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.319+0000 7fd414b56700 1 -- 172.21.15.80:0/1424120588 wait complete. 2019-11-28T11:41:05.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.319+0000 7fd414b56700 1 -- 172.21.15.80:0/1424120588 >> 172.21.15.80:0/1424120588 conn(0x7fd410061d40 msgr2=0x7fd4100641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:05.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.322+0000 7fd414b56700 1 Processor -- start 2019-11-28T11:41:05.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.322+0000 7fd414b56700 1 -- start start 2019-11-28T11:41:05.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.322+0000 7fd414b56700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd41012c340 0x7fd41012c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:05.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.322+0000 7fd414b56700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd4101047a0 0x7fd410104c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:05.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd414b56700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd410107c20 con 0x7fd410152750 2019-11-28T11:41:05.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd414b56700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd410106880 con 0x7fd41012c340 2019-11-28T11:41:05.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd414b56700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd410109d70 con 0x7fd4101047a0 2019-11-28T11:41:05.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd40ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd410152750 0x7fd4101058b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37924/0 (socket says 172.21.15.80:37924) 2019-11-28T11:41:05.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd40ed9d700 1 -- 172.21.15.80:0/3116176845 learned_addr learned my addr 172.21.15.80:0/3116176845 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:05.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd40e59c700 1 --2- 172.21.15.80:0/3116176845 >> v2:172.21.15.80:3300/0 conn(0x7fd41012c340 0x7fd41012c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:05.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd40f59e700 1 --2- 172.21.15.80:0/3116176845 >> v2:172.21.15.174:3300/0 conn(0x7fd4101047a0 0x7fd410104c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:05.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd40e59c700 1 -- 172.21.15.80:0/3116176845 >> v2:172.21.15.174:3300/0 conn(0x7fd4101047a0 msgr2=0x7fd410104c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd40e59c700 1 --2- 172.21.15.80:0/3116176845 >> v2:172.21.15.174:3300/0 conn(0x7fd4101047a0 0x7fd410104c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:05.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd40e59c700 1 -- 172.21.15.80:0/3116176845 >> v1:172.21.15.80:6789/0 conn(0x7fd410152750 legacy=0x7fd4101058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd40e59c700 1 -- 172.21.15.80:0/3116176845 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd410106f10 con 0x7fd41012c340 2019-11-28T11:41:05.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd4077fe700 1 -- 172.21.15.80:0/3116176845 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458655960 0 0) 0x7fd400007580 con 0x7fd410152750 2019-11-28T11:41:05.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd40e59c700 1 --2- 172.21.15.80:0/3116176845 >> v2:172.21.15.80:3300/0 conn(0x7fd41012c340 0x7fd41012c7d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3f8010660 tx=0x7fd3f8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd40e59c700 1 --2- 172.21.15.80:0/3116176845 >> v2:172.21.15.80:3300/0 conn(0x7fd41012c340 0x7fd41012c7d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3f8010660 tx=0x7fd3f8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd40e59c700 1 --2- 172.21.15.80:0/3116176845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41012c340 0x7fd41012c7d0 secure :-1 s=READY pgs=1439 cs=0 l=1 rx=0x7fd3f8010660 tx=0x7fd3f8010a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:05.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd40e59c700 1 --2- 172.21.15.80:0/3116176845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41012c340 0x7fd41012c7d0 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7fd3f8010660 tx=0x7fd3f8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd4077fe700 1 -- 172.21.15.80:0/3116176845 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3f8000cc0 con 0x7fd41012c340 2019-11-28T11:41:05.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd40e59c700 1 --2- 172.21.15.80:0/3116176845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41012c340 0x7fd41012c7d0 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7fd3f8010660 tx=0x7fd3f8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd40e59c700 1 --2- 172.21.15.80:0/3116176845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41012c340 0x7fd41012c7d0 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7fd3f8010660 tx=0x7fd3f8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd4077fe700 1 -- 172.21.15.80:0/3116176845 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f8001010 con 0x7fd41012c340 2019-11-28T11:41:05.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd414b56700 1 -- 172.21.15.80:0/3116176845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd410107290 con 0x7fd41012c340 2019-11-28T11:41:05.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd4077fe700 1 -- 172.21.15.80:0/3116176845 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3f80016e0 con 0x7fd41012c340 2019-11-28T11:41:05.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.323+0000 7fd414b56700 1 -- 172.21.15.80:0/3116176845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd410106f10 con 0x7fd41012c340 2019-11-28T11:41:05.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.324+0000 7fd40e59c700 1 --2- 172.21.15.80:0/3116176845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41012c340 0x7fd41012c7d0 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7fd3f8010660 tx=0x7fd3f8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.324+0000 7fd4077fe700 1 -- 172.21.15.80:0/3116176845 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd3f8001200 con 0x7fd41012c340 2019-11-28T11:41:05.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.324+0000 7fd40e59c700 1 --2- 172.21.15.80:0/3116176845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41012c340 0x7fd41012c7d0 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7fd3f8010660 tx=0x7fd3f8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.324+0000 7fd4077fe700 1 --2- 172.21.15.80:0/3116176845 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3e8018730 0x7fd3e801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:05.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.324+0000 7fd4077fe700 1 -- 172.21.15.80:0/3116176845 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd3f8031d60 con 0x7fd41012c340 2019-11-28T11:41:05.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.324+0000 7fd40ed9d700 1 --2- 172.21.15.80:0/3116176845 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3e8018730 0x7fd3e801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:05.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.324+0000 7fd40ed9d700 1 --2- 172.21.15.80:0/3116176845 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3e8018730 0x7fd3e801abc0 crc :-1 s=READY pgs=584 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:05.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.332+0000 7fd414b56700 1 -- 172.21.15.80:0/3116176845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd410107290 con 0x7fd41012c340 2019-11-28T11:41:05.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.335+0000 7fd40e59c700 1 --2- 172.21.15.80:0/3116176845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41012c340 0x7fd41012c7d0 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7fd3f8010660 tx=0x7fd3f8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.335+0000 7fd4077fe700 1 -- 172.21.15.80:0/3116176845 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd3f80095d0 con 0x7fd41012c340 2019-11-28T11:41:05.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.505+0000 7fd414b56700 1 -- 172.21.15.80:0/3116176845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd410106f10 con 0x7fd41012c340 2019-11-28T11:41:05.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.508+0000 7fd40e59c700 1 --2- 172.21.15.80:0/3116176845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41012c340 0x7fd41012c7d0 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7fd3f8010660 tx=0x7fd3f8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.508+0000 7fd4077fe700 1 -- 172.21.15.80:0/3116176845 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v38) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd3f8001510 con 0x7fd41012c340 2019-11-28T11:41:05.544 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:41:05.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.515+0000 7fd414b56700 1 -- 172.21.15.80:0/3116176845 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3e8018730 msgr2=0x7fd3e801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.515+0000 7fd414b56700 1 --2- 172.21.15.80:0/3116176845 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3e8018730 0x7fd3e801abc0 crc :-1 s=READY pgs=584 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:05.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.515+0000 7fd414b56700 1 -- 172.21.15.80:0/3116176845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41012c340 msgr2=0x7fd41012c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.515+0000 7fd414b56700 1 --2- 172.21.15.80:0/3116176845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41012c340 0x7fd41012c7d0 secure :-1 s=READY pgs=1439 cs=0 l=1 rx=0x7fd3f8010660 tx=0x7fd3f8010a00).stop 2019-11-28T11:41:05.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.515+0000 7fd414b56700 1 -- 172.21.15.80:0/3116176845 shutdown_connections 2019-11-28T11:41:05.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.515+0000 7fd414b56700 1 --2- 172.21.15.80:0/3116176845 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd3e8018730 0x7fd3e801abc0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:05.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.515+0000 7fd414b56700 1 --2- 172.21.15.80:0/3116176845 >> v2:172.21.15.174:3300/0 conn(0x7fd4101047a0 0x7fd410104c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:05.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.515+0000 7fd414b56700 1 --2- 172.21.15.80:0/3116176845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd41012c340 0x7fd41012c7d0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:05.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.515+0000 7fd414b56700 1 -- 172.21.15.80:0/3116176845 shutdown_connections 2019-11-28T11:41:05.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.515+0000 7fd414b56700 1 -- 172.21.15.80:0/3116176845 wait complete. 2019-11-28T11:41:05.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.515+0000 7fd414b56700 1 -- 172.21.15.80:0/3116176845 >> 172.21.15.80:0/3116176845 conn(0x7fd4101476e0 msgr2=0x7fd41012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:05.556 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:41:05.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.655+0000 7f21a926b700 1 Processor -- start 2019-11-28T11:41:05.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.655+0000 7f21a926b700 1 -- start start 2019-11-28T11:41:05.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.656+0000 7f21a926b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f21a415f100 0x7f21a406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:05.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.656+0000 7f21a926b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f21a406c2f0 0x7f21a406c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:05.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.656+0000 7f21a926b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a406db60 con 0x7f21a415ed10 2019-11-28T11:41:05.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.656+0000 7f21a926b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a406fe00 con 0x7f21a406c2f0 2019-11-28T11:41:05.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.656+0000 7f21a926b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a40700d0 con 0x7f21a415f100 2019-11-28T11:41:05.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.656+0000 7f21a3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f21a406c2f0 0x7f21a406c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:05.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f21a406c2f0 0x7f21a406c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38618/0 (socket says 172.21.15.80:38618) 2019-11-28T11:41:05.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a3fff700 1 -- 172.21.15.80:0/778553823 learned_addr learned my addr 172.21.15.80:0/778553823 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:05.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a2ffd700 1 --2- 172.21.15.80:0/778553823 >> v2:172.21.15.174:3300/0 conn(0x7f21a415f100 0x7f21a406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:05.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a3fff700 1 -- 172.21.15.80:0/778553823 >> v2:172.21.15.174:3300/0 conn(0x7f21a415f100 msgr2=0x7f21a406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:05.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a3fff700 1 --2- 172.21.15.80:0/778553823 >> v2:172.21.15.174:3300/0 conn(0x7f21a415f100 0x7f21a406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:05.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a3fff700 1 -- 172.21.15.80:0/778553823 >> v1:172.21.15.174:6789/0 conn(0x7f21a415ed10 legacy=0x7f21a4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:05.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a3fff700 1 -- 172.21.15.80:0/778553823 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a4070760 con 0x7f21a406c2f0 2019-11-28T11:41:05.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a3fff700 1 --2- 172.21.15.80:0/778553823 >> v2:172.21.15.80:3300/0 conn(0x7f21a406c2f0 0x7f21a406c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f219c00f730 tx=0x7f219c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a3fff700 1 --2- 172.21.15.80:0/778553823 >> v2:172.21.15.80:3300/0 conn(0x7f21a406c2f0 0x7f21a406c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f219c00f730 tx=0x7f219c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a3fff700 1 --2- 172.21.15.80:0/778553823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21a406c2f0 0x7f21a406c770 secure :-1 s=READY pgs=1440 cs=0 l=1 rx=0x7f219c00f730 tx=0x7f219c007d50).ready entity=mon.0 client_cookie=225b440c22347602 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:05.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a3fff700 1 --2- 172.21.15.80:0/778553823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21a406c2f0 0x7f21a406c770 secure :-1 s=THROTTLE_DONE pgs=1440 cs=0 l=1 rx=0x7f219c00f730 tx=0x7f219c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a3fff700 1 --2- 172.21.15.80:0/778553823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21a406c2f0 0x7f21a406c770 secure :-1 s=THROTTLE_DONE pgs=1440 cs=0 l=1 rx=0x7f219c00f730 tx=0x7f219c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a27fc700 1 -- 172.21.15.80:0/778553823 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f219c000a70 con 0x7f21a406c2f0 2019-11-28T11:41:05.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a3fff700 1 --2- 172.21.15.80:0/778553823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21a406c2f0 0x7f21a406c770 secure :-1 s=THROTTLE_DONE pgs=1440 cs=0 l=1 rx=0x7f219c00f730 tx=0x7f219c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a27fc700 1 -- 172.21.15.80:0/778553823 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c0010e0 con 0x7f21a406c2f0 2019-11-28T11:41:05.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a27fc700 1 -- 172.21.15.80:0/778553823 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f219c0017b0 con 0x7f21a406c2f0 2019-11-28T11:41:05.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a926b700 1 -- 172.21.15.80:0/778553823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21a406c2f0 msgr2=0x7f21a406c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.657+0000 7f21a926b700 1 --2- 172.21.15.80:0/778553823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21a406c2f0 0x7f21a406c770 secure :-1 s=READY pgs=1440 cs=0 l=1 rx=0x7f219c00f730 tx=0x7f219c007d50).stop 2019-11-28T11:41:05.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.658+0000 7f21a926b700 1 -- 172.21.15.80:0/778553823 shutdown_connections 2019-11-28T11:41:05.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.658+0000 7f21a926b700 1 --2- 172.21.15.80:0/778553823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21a406c2f0 0x7f21a406c770 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:05.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.658+0000 7f21a926b700 1 --2- 172.21.15.80:0/778553823 >> v2:172.21.15.174:3300/0 conn(0x7f21a415f100 0x7f21a406bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:05.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.658+0000 7f21a926b700 1 -- 172.21.15.80:0/778553823 shutdown_connections 2019-11-28T11:41:05.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.658+0000 7f21a926b700 1 -- 172.21.15.80:0/778553823 wait complete. 2019-11-28T11:41:05.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.658+0000 7f21a926b700 1 -- 172.21.15.80:0/778553823 >> 172.21.15.80:0/778553823 conn(0x7f21a4061d40 msgr2=0x7f21a40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:05.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.660+0000 7f21a926b700 1 Processor -- start 2019-11-28T11:41:05.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.660+0000 7f21a926b700 1 -- start start 2019-11-28T11:41:05.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.661+0000 7f21a926b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a412e1a0 0x7f21a412e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:05.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.661+0000 7f21a926b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a4130b20 con 0x7f21a412eb70 2019-11-28T11:41:05.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.661+0000 7f21a926b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a4130620 con 0x7f21a4114f60 2019-11-28T11:41:05.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.661+0000 7f21a926b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a4148b60 con 0x7f21a412e1a0 2019-11-28T11:41:05.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.661+0000 7f21a3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f21a412eb70 0x7f21a4105a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37942/0 (socket says 172.21.15.80:37942) 2019-11-28T11:41:05.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.661+0000 7f21a3fff700 1 -- 172.21.15.80:0/3212771388 learned_addr learned my addr 172.21.15.80:0/3212771388 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:05.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f21a2ffd700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a412e1a0 0x7f21a412e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:05.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f219bfff700 1 -- 172.21.15.80:0/3212771388 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214236084 0 0) 0x7f219c0079e0 con 0x7f21a412eb70 2019-11-28T11:41:05.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f219bfff700 1 -- 172.21.15.80:0/3212771388 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f217c002e80 con 0x7f21a412eb70 2019-11-28T11:41:05.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f219bfff700 1 -- 172.21.15.80:0/3212771388 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715447194 0 0) 0x7f2194001080 con 0x7f21a4114f60 2019-11-28T11:41:05.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f219bfff700 1 -- 172.21.15.80:0/3212771388 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f217c0030b0 con 0x7f21a4114f60 2019-11-28T11:41:05.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f21a2ffd700 1 -- 172.21.15.80:0/3212771388 >> v1:172.21.15.174:6789/0 conn(0x7f21a4114f60 legacy=0x7f21a4106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f21a2ffd700 1 -- 172.21.15.80:0/3212771388 >> v1:172.21.15.80:6789/0 conn(0x7f21a412eb70 legacy=0x7f21a4105a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f21a2ffd700 1 -- 172.21.15.80:0/3212771388 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a4104390 con 0x7f21a412e1a0 2019-11-28T11:41:05.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f21a2ffd700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a412e1a0 0x7f21a412e630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f218c0106f0 tx=0x7f218c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f21a2ffd700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a412e1a0 0x7f21a412e630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f218c0106f0 tx=0x7f218c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f21a2ffd700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a412e1a0 0x7f21a412e630 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f218c0106f0 tx=0x7f218c010a90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:05.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f21a2ffd700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a412e1a0 0x7f21a412e630 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f218c0106f0 tx=0x7f218c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f219bfff700 1 -- 172.21.15.80:0/3212771388 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f218c00c2c0 con 0x7f21a412e1a0 2019-11-28T11:41:05.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f21a2ffd700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a412e1a0 0x7f21a412e630 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f218c0106f0 tx=0x7f218c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f21a926b700 1 -- 172.21.15.80:0/3212771388 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a4104710 con 0x7f21a412e1a0 2019-11-28T11:41:05.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f219bfff700 1 -- 172.21.15.80:0/3212771388 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c00bee0 con 0x7f21a412e1a0 2019-11-28T11:41:05.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f21a2ffd700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a412e1a0 0x7f21a412e630 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f218c0106f0 tx=0x7f218c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f219bfff700 1 -- 172.21.15.80:0/3212771388 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f218c00c630 con 0x7f21a412e1a0 2019-11-28T11:41:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.662+0000 7f21a926b700 1 -- 172.21.15.80:0/3212771388 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a4104390 con 0x7f21a412e1a0 2019-11-28T11:41:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.663+0000 7f21a2ffd700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a412e1a0 0x7f21a412e630 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f218c0106f0 tx=0x7f218c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.663+0000 7f219bfff700 1 -- 172.21.15.80:0/3212771388 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f218c00c0d0 con 0x7f21a412e1a0 2019-11-28T11:41:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.663+0000 7f21a2ffd700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a412e1a0 0x7f21a412e630 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f218c0106f0 tx=0x7f218c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.663+0000 7f219bfff700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f217c018750 0x7f217c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:05.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.663+0000 7f219bfff700 1 -- 172.21.15.80:0/3212771388 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f218c031e00 con 0x7f21a412e1a0 2019-11-28T11:41:05.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.663+0000 7f21a37fe700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f217c018750 0x7f217c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:05.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.663+0000 7f21a37fe700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f217c018750 0x7f217c01abe0 crc :-1 s=READY pgs=585 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:05.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.671+0000 7f21a926b700 1 -- 172.21.15.80:0/3212771388 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a4104710 con 0x7f21a412e1a0 2019-11-28T11:41:05.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.675+0000 7f21a2ffd700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a412e1a0 0x7f21a412e630 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f218c0106f0 tx=0x7f218c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.675+0000 7f219bfff700 1 -- 172.21.15.80:0/3212771388 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f218c00bcd0 con 0x7f21a412e1a0 2019-11-28T11:41:05.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.849+0000 7f21a926b700 1 -- 172.21.15.80:0/3212771388 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f21a4104390 con 0x7f21a412e1a0 2019-11-28T11:41:05.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.853+0000 7f21a2ffd700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a412e1a0 0x7f21a412e630 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f218c0106f0 tx=0x7f218c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:05.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.853+0000 7f219bfff700 1 -- 172.21.15.80:0/3212771388 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v39) v1 ==== 184+0+0 (secure 0 0 0) 0x7f218c00c0d0 con 0x7f21a412e1a0 2019-11-28T11:41:05.888 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:41:05.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.858+0000 7f21a926b700 1 -- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f217c018750 msgr2=0x7f217c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.858+0000 7f21a926b700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f217c018750 0x7f217c01abe0 crc :-1 s=READY pgs=585 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:05.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.858+0000 7f21a926b700 1 -- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a412e1a0 msgr2=0x7f21a412e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:05.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.858+0000 7f21a926b700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a412e1a0 0x7f21a412e630 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f218c0106f0 tx=0x7f218c010a90).stop 2019-11-28T11:41:05.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.858+0000 7f21a926b700 1 -- 172.21.15.80:0/3212771388 shutdown_connections 2019-11-28T11:41:05.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.858+0000 7f21a926b700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a412e1a0 0x7f21a412e630 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:05.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.858+0000 7f21a926b700 1 --2- 172.21.15.80:0/3212771388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f217c018750 0x7f217c01abe0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:05.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.859+0000 7f21a926b700 1 -- 172.21.15.80:0/3212771388 shutdown_connections 2019-11-28T11:41:05.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.859+0000 7f21a926b700 1 -- 172.21.15.80:0/3212771388 wait complete. 2019-11-28T11:41:05.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.859+0000 7f21a926b700 1 -- 172.21.15.80:0/3212771388 >> 172.21.15.80:0/3212771388 conn(0x7f21a41476e0 msgr2=0x7f21a412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:05.901 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:41:06.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.987+0000 7f80dd367700 1 Processor -- start 2019-11-28T11:41:06.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.987+0000 7f80dd367700 1 -- start start 2019-11-28T11:41:06.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.988+0000 7f80dd367700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80d806c490 0x7f80d806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:06.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.988+0000 7f80dd367700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f80d806ce60 0x7f80d8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:06.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.988+0000 7f80dd367700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d806db00 con 0x7f80d806c0a0 2019-11-28T11:41:06.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.988+0000 7f80dd367700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d806fd60 con 0x7f80d806c490 2019-11-28T11:41:06.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.988+0000 7f80dd367700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d8070030 con 0x7f80d806ce60 2019-11-28T11:41:06.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.988+0000 7f80d6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80d806c490 0x7f80d806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:06.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.988+0000 7f80d6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80d806c490 0x7f80d806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38634/0 (socket says 172.21.15.80:38634) 2019-11-28T11:41:06.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.988+0000 7f80d6ffd700 1 -- 172.21.15.80:0/3091751552 learned_addr learned my addr 172.21.15.80:0/3091751552 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:06.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.988+0000 7f80d7fff700 1 --2- 172.21.15.80:0/3091751552 >> v2:172.21.15.174:3300/0 conn(0x7f80d806ce60 0x7f80d8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:06.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.989+0000 7f80d6ffd700 1 -- 172.21.15.80:0/3091751552 >> v2:172.21.15.174:3300/0 conn(0x7f80d806ce60 msgr2=0x7f80d8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:06.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.989+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/3091751552 >> v2:172.21.15.174:3300/0 conn(0x7f80d806ce60 0x7f80d8164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:06.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.989+0000 7f80d6ffd700 1 -- 172.21.15.80:0/3091751552 >> v1:172.21.15.174:6789/0 conn(0x7f80d806c0a0 legacy=0x7f80d8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:06.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.989+0000 7f80d6ffd700 1 -- 172.21.15.80:0/3091751552 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d80706c0 con 0x7f80d806c490 2019-11-28T11:41:06.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.989+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/3091751552 >> v2:172.21.15.80:3300/0 conn(0x7f80d806c490 0x7f80d806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f80c000fa40 tx=0x7f80c000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.989+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/3091751552 >> v2:172.21.15.80:3300/0 conn(0x7f80d806c490 0x7f80d806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f80c000fa40 tx=0x7f80c000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.989+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/3091751552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d806c490 0x7f80d806c920 secure :-1 s=READY pgs=1442 cs=0 l=1 rx=0x7f80c000fa40 tx=0x7f80c000fde0).ready entity=mon.0 client_cookie=9138ad477b100dac server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:06.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.989+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/3091751552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d806c490 0x7f80d806c920 secure :-1 s=THROTTLE_DONE pgs=1442 cs=0 l=1 rx=0x7f80c000fa40 tx=0x7f80c000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.989+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/3091751552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d806c490 0x7f80d806c920 secure :-1 s=THROTTLE_DONE pgs=1442 cs=0 l=1 rx=0x7f80c000fa40 tx=0x7f80c000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.989+0000 7f80d67fc700 1 -- 172.21.15.80:0/3091751552 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80c0000ce0 con 0x7f80d806c490 2019-11-28T11:41:06.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.989+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/3091751552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d806c490 0x7f80d806c920 secure :-1 s=THROTTLE_DONE pgs=1442 cs=0 l=1 rx=0x7f80c000fa40 tx=0x7f80c000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.989+0000 7f80d67fc700 1 -- 172.21.15.80:0/3091751552 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c0001010 con 0x7f80d806c490 2019-11-28T11:41:06.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.989+0000 7f80d67fc700 1 -- 172.21.15.80:0/3091751552 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80c0001720 con 0x7f80d806c490 2019-11-28T11:41:06.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.989+0000 7f80dd367700 1 -- 172.21.15.80:0/3091751552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d806c490 msgr2=0x7f80d806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:06.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.989+0000 7f80dd367700 1 --2- 172.21.15.80:0/3091751552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d806c490 0x7f80d806c920 secure :-1 s=READY pgs=1442 cs=0 l=1 rx=0x7f80c000fa40 tx=0x7f80c000fde0).stop 2019-11-28T11:41:06.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.990+0000 7f80dd367700 1 -- 172.21.15.80:0/3091751552 shutdown_connections 2019-11-28T11:41:06.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.990+0000 7f80dd367700 1 --2- 172.21.15.80:0/3091751552 >> v2:172.21.15.174:3300/0 conn(0x7f80d806ce60 0x7f80d8164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:06.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.990+0000 7f80dd367700 1 --2- 172.21.15.80:0/3091751552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d806c490 0x7f80d806c920 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:06.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.990+0000 7f80dd367700 1 -- 172.21.15.80:0/3091751552 shutdown_connections 2019-11-28T11:41:06.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.990+0000 7f80dd367700 1 -- 172.21.15.80:0/3091751552 wait complete. 2019-11-28T11:41:06.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.990+0000 7f80dd367700 1 -- 172.21.15.80:0/3091751552 >> 172.21.15.80:0/3091751552 conn(0x7f80d8061cf0 msgr2=0x7f80d8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:06.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.992+0000 7f80dd367700 1 Processor -- start 2019-11-28T11:41:06.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.992+0000 7f80dd367700 1 -- start start 2019-11-28T11:41:06.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80dd367700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f80d813a780 0x7f80d812d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:06.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80dd367700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80d812d9c0 0x7f80d812c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:06.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80dd367700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80d812c840 0x7f80d812cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:06.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80dd367700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d812a260 con 0x7f80d812d9c0 2019-11-28T11:41:06.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80dd367700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d812a530 con 0x7f80d813a780 2019-11-28T11:41:06.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80dd367700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d8129830 con 0x7f80d812c840 2019-11-28T11:41:06.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80d6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80d812d9c0 0x7f80d812c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:06.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80d6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80d812d9c0 0x7f80d812c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38636/0 (socket says 172.21.15.80:38636) 2019-11-28T11:41:06.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80d6ffd700 1 -- 172.21.15.80:0/2185020633 learned_addr learned my addr 172.21.15.80:0/2185020633 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:06.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80d7fff700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80d812c840 0x7f80d812cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:06.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80d77fe700 1 --2- 172.21.15.80:0/2185020633 >> v2:172.21.15.174:3300/0 conn(0x7f80d813a780 0x7f80d812d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:06.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80d6ffd700 1 -- 172.21.15.80:0/2185020633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80d812c840 msgr2=0x7f80d812cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:06.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80d812c840 0x7f80d812cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:06.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80d6ffd700 1 -- 172.21.15.80:0/2185020633 >> v2:172.21.15.174:3300/0 conn(0x7f80d813a780 msgr2=0x7f80d812d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:06.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/2185020633 >> v2:172.21.15.174:3300/0 conn(0x7f80d813a780 0x7f80d812d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:06.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80d6ffd700 1 -- 172.21.15.80:0/2185020633 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d812abc0 con 0x7f80d812d9c0 2019-11-28T11:41:06.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.993+0000 7f80d77fe700 1 --2- 172.21.15.80:0/2185020633 >> v2:172.21.15.174:3300/0 conn(0x7f80d813a780 0x7f80d812d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:41:06.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.994+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/2185020633 >> v2:172.21.15.80:3300/0 conn(0x7f80d812d9c0 0x7f80d812c300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80c00107c0 tx=0x7f80c0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.994+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/2185020633 >> v2:172.21.15.80:3300/0 conn(0x7f80d812d9c0 0x7f80d812c300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80c00107c0 tx=0x7f80c0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.994+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d812d9c0 0x7f80d812c300 secure :-1 s=READY pgs=1443 cs=0 l=1 rx=0x7f80c00107c0 tx=0x7f80c0010670).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:06.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.994+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d812d9c0 0x7f80d812c300 secure :-1 s=THROTTLE_DONE pgs=1443 cs=0 l=1 rx=0x7f80c00107c0 tx=0x7f80c0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.994+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d812d9c0 0x7f80d812c300 secure :-1 s=THROTTLE_DONE pgs=1443 cs=0 l=1 rx=0x7f80c00107c0 tx=0x7f80c0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.994+0000 7f80cffff700 1 -- 172.21.15.80:0/2185020633 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80c0000cc0 con 0x7f80d812d9c0 2019-11-28T11:41:06.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.994+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d812d9c0 0x7f80d812c300 secure :-1 s=THROTTLE_DONE pgs=1443 cs=0 l=1 rx=0x7f80c00107c0 tx=0x7f80c0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.994+0000 7f80cffff700 1 -- 172.21.15.80:0/2185020633 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c00012d0 con 0x7f80d812d9c0 2019-11-28T11:41:06.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.994+0000 7f80dd367700 1 -- 172.21.15.80:0/2185020633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d812af40 con 0x7f80d812d9c0 2019-11-28T11:41:06.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.994+0000 7f80cffff700 1 -- 172.21.15.80:0/2185020633 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80c0001920 con 0x7f80d812d9c0 2019-11-28T11:41:06.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.994+0000 7f80dd367700 1 -- 172.21.15.80:0/2185020633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d812abc0 con 0x7f80d812d9c0 2019-11-28T11:41:06.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.994+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d812d9c0 0x7f80d812c300 secure :-1 s=THROTTLE_DONE pgs=1443 cs=0 l=1 rx=0x7f80c00107c0 tx=0x7f80c0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.994+0000 7f80cffff700 1 -- 172.21.15.80:0/2185020633 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f80c00014c0 con 0x7f80d812d9c0 2019-11-28T11:41:06.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.994+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d812d9c0 0x7f80d812c300 secure :-1 s=THROTTLE_DONE pgs=1443 cs=0 l=1 rx=0x7f80c00107c0 tx=0x7f80c0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.995+0000 7f80cffff700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f80b0018730 0x7f80b001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:06.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.995+0000 7f80cffff700 1 -- 172.21.15.80:0/2185020633 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f80c0031e30 con 0x7f80d812d9c0 2019-11-28T11:41:06.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.995+0000 7f80d77fe700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f80b0018730 0x7f80b001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:06.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:05.995+0000 7f80d77fe700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f80b0018730 0x7f80b001abc0 crc :-1 s=READY pgs=586 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:06.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.002+0000 7f80dd367700 1 -- 172.21.15.80:0/2185020633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d812af40 con 0x7f80d812d9c0 2019-11-28T11:41:06.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.006+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d812d9c0 0x7f80d812c300 secure :-1 s=THROTTLE_DONE pgs=1443 cs=0 l=1 rx=0x7f80c00107c0 tx=0x7f80c0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.006+0000 7f80cffff700 1 -- 172.21.15.80:0/2185020633 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f80c0000eb0 con 0x7f80d812d9c0 2019-11-28T11:41:06.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.177+0000 7f80dd367700 1 -- 172.21.15.80:0/2185020633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80d812abc0 con 0x7f80d812d9c0 2019-11-28T11:41:06.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.178+0000 7f80d6ffd700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d812d9c0 0x7f80d812c300 secure :-1 s=THROTTLE_DONE pgs=1443 cs=0 l=1 rx=0x7f80c00107c0 tx=0x7f80c0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.178+0000 7f80cffff700 1 -- 172.21.15.80:0/2185020633 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+1772 (secure 0 0 0) 0x7f80c00014a0 con 0x7f80d812d9c0 2019-11-28T11:41:06.210 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 75 2019-11-28T11:41:06.211 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:06.211 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:02.122819+0000","modified":"2019-11-28T11:41:05.774868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7747},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7747":{"gid":7747,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/332155288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":332155288},{"type":"v1","addr":"172.21.15.174:6835","nonce":332155288}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2019-11-28T11:41:06.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.180+0000 7f80dd367700 1 -- 172.21.15.80:0/2185020633 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f80b0018730 msgr2=0x7f80b001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:06.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.180+0000 7f80dd367700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f80b0018730 0x7f80b001abc0 crc :-1 s=READY pgs=586 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:06.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.180+0000 7f80dd367700 1 -- 172.21.15.80:0/2185020633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d812d9c0 msgr2=0x7f80d812c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:06.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.180+0000 7f80dd367700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d812d9c0 0x7f80d812c300 secure :-1 s=READY pgs=1443 cs=0 l=1 rx=0x7f80c00107c0 tx=0x7f80c0010670).stop 2019-11-28T11:41:06.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.180+0000 7f80dd367700 1 -- 172.21.15.80:0/2185020633 shutdown_connections 2019-11-28T11:41:06.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.180+0000 7f80dd367700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f80b0018730 0x7f80b001abc0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:06.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.180+0000 7f80dd367700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80d812c840 0x7f80d812cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:06.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.180+0000 7f80dd367700 1 --2- 172.21.15.80:0/2185020633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80d812d9c0 0x7f80d812c300 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:06.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.180+0000 7f80dd367700 1 --2- 172.21.15.80:0/2185020633 >> v2:172.21.15.174:3300/0 conn(0x7f80d813a780 0x7f80d812d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:06.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.180+0000 7f80dd367700 1 -- 172.21.15.80:0/2185020633 shutdown_connections 2019-11-28T11:41:06.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.180+0000 7f80dd367700 1 -- 172.21.15.80:0/2185020633 wait complete. 2019-11-28T11:41:06.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.180+0000 7f80dd367700 1 -- 172.21.15.80:0/2185020633 >> 172.21.15.80:0/2185020633 conn(0x7f80d8127dc0 msgr2=0x7f80d8141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:06.523 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7747}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 16, u'failed': [], u'epoch': 75, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [17], u'info': {u'gid_7747': {u'export_targets': [], u'name': u'c', u'incarnation': 74, u'state_seq': 2, u'state': u'up:active', u'gid': 7747, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 332155288, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 332155288, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/332155288'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:41:02.122819+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:41:05.774868+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:41:06.523 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:41:06.524 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:41:06.652 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:41:06.652 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:41:06.653 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:41:06.653 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 7747, 2019-11-28T11:41:06.673 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:41:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:41:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 1.845697707, 2019-11-28T11:41:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 75, 2019-11-28T11:41:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 107, 2019-11-28T11:41:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 107, 2019-11-28T11:41:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 2.0437176830000001 2019-11-28T11:41:06.674 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:41:06.676 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7747, "want_state": "up:active", "state": "up:active", "rank_uptime": 1.845697707, "mdsmap_epoch": 75, "osdmap_epoch": 107, "osdmap_epoch_barrier": 107, "uptime": 2.0437176830000001 } 2019-11-28T11:41:06.677 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:41:06.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.767+0000 7f1ad6c79700 1 Processor -- start 2019-11-28T11:41:06.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.767+0000 7f1ad6c79700 1 -- start start 2019-11-28T11:41:06.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.768+0000 7f1ad6c79700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1ad006c490 0x7f1ad006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:06.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.768+0000 7f1ad6c79700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ad006ce60 0x7f1ad0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:06.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.768+0000 7f1ad6c79700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad006db00 con 0x7f1ad006c0a0 2019-11-28T11:41:06.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.768+0000 7f1ad6c79700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad006fd60 con 0x7f1ad006c490 2019-11-28T11:41:06.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.768+0000 7f1ad6c79700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad0070030 con 0x7f1ad006ce60 2019-11-28T11:41:06.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad5216700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1ad006c0a0 0x7f1ad0072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37960/0 (socket says 172.21.15.80:37960) 2019-11-28T11:41:06.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad5216700 1 -- 172.21.15.80:0/4046054381 learned_addr learned my addr 172.21.15.80:0/4046054381 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:06.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad4a15700 1 --2- 172.21.15.80:0/4046054381 >> v2:172.21.15.174:3300/0 conn(0x7f1ad006c490 0x7f1ad006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:06.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad5a17700 1 --2- 172.21.15.80:0/4046054381 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ad006ce60 0x7f1ad0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:06.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1acffff700 1 -- 172.21.15.80:0/4046054381 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100522372 0 0) 0x7f1ac00014d0 con 0x7f1ad006c0a0 2019-11-28T11:41:06.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1acffff700 1 -- 172.21.15.80:0/4046054381 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1abc002e80 con 0x7f1ad006c0a0 2019-11-28T11:41:06.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad4a15700 1 -- 172.21.15.80:0/4046054381 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ad006ce60 msgr2=0x7f1ad0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:06.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad4a15700 1 --2- 172.21.15.80:0/4046054381 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ad006ce60 0x7f1ad0164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:06.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad4a15700 1 -- 172.21.15.80:0/4046054381 >> v1:172.21.15.80:6789/0 conn(0x7f1ad006c0a0 legacy=0x7f1ad0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:06.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad4a15700 1 -- 172.21.15.80:0/4046054381 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad00706c0 con 0x7f1ad006c490 2019-11-28T11:41:06.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad5a17700 1 --2- 172.21.15.80:0/4046054381 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ad006ce60 0x7f1ad0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:06.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad4a15700 1 --2- 172.21.15.80:0/4046054381 >> v2:172.21.15.174:3300/0 conn(0x7f1ad006c490 0x7f1ad006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1ab800af50 tx=0x7f1ab800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad4a15700 1 --2- 172.21.15.80:0/4046054381 >> v2:172.21.15.174:3300/0 conn(0x7f1ad006c490 0x7f1ad006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1ab800af50 tx=0x7f1ab800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad4a15700 1 --2- 172.21.15.80:0/4046054381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ad006c490 0x7f1ad006c920 secure :-1 s=READY pgs=840 cs=0 l=1 rx=0x7f1ab800af50 tx=0x7f1ab800b760).ready entity=mon.1 client_cookie=d1a79b46deeb9f11 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:06.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad4a15700 1 --2- 172.21.15.80:0/4046054381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ad006c490 0x7f1ad006c920 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7f1ab800af50 tx=0x7f1ab800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1acffff700 1 -- 172.21.15.80:0/4046054381 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab8007210 con 0x7f1ad006c490 2019-11-28T11:41:06.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad4a15700 1 --2- 172.21.15.80:0/4046054381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ad006c490 0x7f1ad006c920 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7f1ab800af50 tx=0x7f1ab800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad4a15700 1 --2- 172.21.15.80:0/4046054381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ad006c490 0x7f1ad006c920 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7f1ab800af50 tx=0x7f1ab800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1acffff700 1 -- 172.21.15.80:0/4046054381 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab80099b0 con 0x7f1ad006c490 2019-11-28T11:41:06.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1acffff700 1 -- 172.21.15.80:0/4046054381 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab800a080 con 0x7f1ad006c490 2019-11-28T11:41:06.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad6c79700 1 -- 172.21.15.80:0/4046054381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ad006c490 msgr2=0x7f1ad006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:06.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.769+0000 7f1ad6c79700 1 --2- 172.21.15.80:0/4046054381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ad006c490 0x7f1ad006c920 secure :-1 s=READY pgs=840 cs=0 l=1 rx=0x7f1ab800af50 tx=0x7f1ab800b760).stop 2019-11-28T11:41:06.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.770+0000 7f1ad6c79700 1 -- 172.21.15.80:0/4046054381 shutdown_connections 2019-11-28T11:41:06.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.770+0000 7f1ad6c79700 1 --2- 172.21.15.80:0/4046054381 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ad006ce60 0x7f1ad0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:06.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.770+0000 7f1ad6c79700 1 --2- 172.21.15.80:0/4046054381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ad006c490 0x7f1ad006c920 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:06.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.770+0000 7f1ad6c79700 1 -- 172.21.15.80:0/4046054381 shutdown_connections 2019-11-28T11:41:06.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.770+0000 7f1ad6c79700 1 -- 172.21.15.80:0/4046054381 wait complete. 2019-11-28T11:41:06.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.770+0000 7f1ad6c79700 1 -- 172.21.15.80:0/4046054381 >> 172.21.15.80:0/4046054381 conn(0x7f1ad0061cf0 msgr2=0x7f1ad0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:06.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.773+0000 7f1ad6c79700 1 Processor -- start 2019-11-28T11:41:06.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.773+0000 7f1ad6c79700 1 -- start start 2019-11-28T11:41:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad6c79700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1ad015fdf0 0x7f1ad012b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad6c79700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad013eb20 con 0x7f1ad012b8a0 2019-11-28T11:41:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad6c79700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad0139e00 con 0x7f1ad012a3c0 2019-11-28T11:41:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad6c79700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad0108820 con 0x7f1ad015fdf0 2019-11-28T11:41:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad5216700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1ad015fdf0 0x7f1ad012b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad5216700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1ad015fdf0 0x7f1ad012b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38650/0 (socket says 172.21.15.80:38650) 2019-11-28T11:41:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad5216700 1 -- 172.21.15.80:0/829943734 learned_addr learned my addr 172.21.15.80:0/829943734 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad5216700 1 -- 172.21.15.80:0/829943734 >> v1:172.21.15.174:6789/0 conn(0x7f1ad012a3c0 legacy=0x7f1ad012a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad5216700 1 -- 172.21.15.80:0/829943734 >> v1:172.21.15.80:6789/0 conn(0x7f1ad012b8a0 legacy=0x7f1ad013e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad5216700 1 -- 172.21.15.80:0/829943734 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad010a8c0 con 0x7f1ad015fdf0 2019-11-28T11:41:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad5216700 1 --2- 172.21.15.80:0/829943734 >> v2:172.21.15.80:3300/0 conn(0x7f1ad015fdf0 0x7f1ad012b360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1ac0010760 tx=0x7f1ac0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad5216700 1 --2- 172.21.15.80:0/829943734 >> v2:172.21.15.80:3300/0 conn(0x7f1ad015fdf0 0x7f1ad012b360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1ac0010760 tx=0x7f1ac0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad5216700 1 --2- 172.21.15.80:0/829943734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad015fdf0 0x7f1ad012b360 secure :-1 s=READY pgs=1446 cs=0 l=1 rx=0x7f1ac0010760 tx=0x7f1ac0010b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad5216700 1 --2- 172.21.15.80:0/829943734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad015fdf0 0x7f1ad012b360 secure :-1 s=THROTTLE_DONE pgs=1446 cs=0 l=1 rx=0x7f1ac0010760 tx=0x7f1ac0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1acdffb700 1 -- 172.21.15.80:0/829943734 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac0001010 con 0x7f1ad015fdf0 2019-11-28T11:41:06.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad5216700 1 --2- 172.21.15.80:0/829943734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad015fdf0 0x7f1ad012b360 secure :-1 s=THROTTLE_DONE pgs=1446 cs=0 l=1 rx=0x7f1ac0010760 tx=0x7f1ac0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1acdffb700 1 -- 172.21.15.80:0/829943734 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac0001010 con 0x7f1ad015fdf0 2019-11-28T11:41:06.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad6c79700 1 -- 172.21.15.80:0/829943734 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad010a8c0 con 0x7f1ad015fdf0 2019-11-28T11:41:06.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad5216700 1 --2- 172.21.15.80:0/829943734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad015fdf0 0x7f1ad012b360 secure :-1 s=THROTTLE_DONE pgs=1446 cs=0 l=1 rx=0x7f1ac0010760 tx=0x7f1ac0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1acdffb700 1 -- 172.21.15.80:0/829943734 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac0001200 con 0x7f1ad015fdf0 2019-11-28T11:41:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.774+0000 7f1ad6c79700 1 -- 172.21.15.80:0/829943734 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad010a8c0 con 0x7f1ad015fdf0 2019-11-28T11:41:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.775+0000 7f1ad5216700 1 --2- 172.21.15.80:0/829943734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad015fdf0 0x7f1ad012b360 secure :-1 s=THROTTLE_DONE pgs=1446 cs=0 l=1 rx=0x7f1ac0010760 tx=0x7f1ac0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.775+0000 7f1acdffb700 1 -- 172.21.15.80:0/829943734 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1ac0001200 con 0x7f1ad015fdf0 2019-11-28T11:41:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.775+0000 7f1ad5216700 1 --2- 172.21.15.80:0/829943734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad015fdf0 0x7f1ad012b360 secure :-1 s=THROTTLE_DONE pgs=1446 cs=0 l=1 rx=0x7f1ac0010760 tx=0x7f1ac0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.775+0000 7f1acdffb700 1 --2- 172.21.15.80:0/829943734 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ab4018730 0x7f1ab401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.775+0000 7f1acdffb700 1 -- 172.21.15.80:0/829943734 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1ac0032100 con 0x7f1ad015fdf0 2019-11-28T11:41:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.775+0000 7f1ad4a15700 1 --2- 172.21.15.80:0/829943734 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ab4018730 0x7f1ab401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.776+0000 7f1ad4a15700 1 --2- 172.21.15.80:0/829943734 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ab4018730 0x7f1ab401abc0 crc :-1 s=READY pgs=587 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.783+0000 7f1ad6c79700 1 -- 172.21.15.80:0/829943734 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad0109180 con 0x7f1ad015fdf0 2019-11-28T11:41:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.786+0000 7f1ad5216700 1 --2- 172.21.15.80:0/829943734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad015fdf0 0x7f1ad012b360 secure :-1 s=THROTTLE_DONE pgs=1446 cs=0 l=1 rx=0x7f1ac0010760 tx=0x7f1ac0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.786+0000 7f1acdffb700 1 -- 172.21.15.80:0/829943734 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1ac0007950 con 0x7f1ad015fdf0 2019-11-28T11:41:07.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.963+0000 7f1ad6c79700 1 -- 172.21.15.80:0/829943734 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ad0109500 con 0x7f1ad015fdf0 2019-11-28T11:41:07.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.964+0000 7f1ad5216700 1 --2- 172.21.15.80:0/829943734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad015fdf0 0x7f1ad012b360 secure :-1 s=THROTTLE_DONE pgs=1446 cs=0 l=1 rx=0x7f1ac0010760 tx=0x7f1ac0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.964+0000 7f1acdffb700 1 -- 172.21.15.80:0/829943734 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+14870 (secure 0 0 0) 0x7f1ac0021460 con 0x7f1ad015fdf0 2019-11-28T11:41:07.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.966+0000 7f1ad6c79700 1 -- 172.21.15.80:0/829943734 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ab4018730 msgr2=0x7f1ab401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.966+0000 7f1ad6c79700 1 --2- 172.21.15.80:0/829943734 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ab4018730 0x7f1ab401abc0 crc :-1 s=READY pgs=587 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.966+0000 7f1ad6c79700 1 -- 172.21.15.80:0/829943734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad015fdf0 msgr2=0x7f1ad012b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.966+0000 7f1ad6c79700 1 --2- 172.21.15.80:0/829943734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad015fdf0 0x7f1ad012b360 secure :-1 s=READY pgs=1446 cs=0 l=1 rx=0x7f1ac0010760 tx=0x7f1ac0010b00).stop 2019-11-28T11:41:07.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.966+0000 7f1ad6c79700 1 -- 172.21.15.80:0/829943734 shutdown_connections 2019-11-28T11:41:07.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.966+0000 7f1ad6c79700 1 --2- 172.21.15.80:0/829943734 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ab4018730 0x7f1ab401abc0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.966+0000 7f1ad6c79700 1 --2- 172.21.15.80:0/829943734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ad015fdf0 0x7f1ad012b360 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.966+0000 7f1ad6c79700 1 -- 172.21.15.80:0/829943734 shutdown_connections 2019-11-28T11:41:07.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.966+0000 7f1ad6c79700 1 -- 172.21.15.80:0/829943734 wait complete. 2019-11-28T11:41:07.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:06.967+0000 7f1ad6c79700 1 -- 172.21.15.80:0/829943734 >> 172.21.15.80:0/829943734 conn(0x7f1ad0127dc0 msgr2=0x7f1ad0141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:07.008 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:07.008 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":107,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:41:03.124379+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:41:00.409798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2019-11-28T11:41:01.100729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:41:07.012 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:41:00.409798+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 16, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'106', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:41:01.100729+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 17, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'107', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:41:07.014 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:41:07.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.108+0000 7f1852937700 1 Processor -- start 2019-11-28T11:41:07.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.108+0000 7f1852937700 1 -- start start 2019-11-28T11:41:07.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.109+0000 7f1852937700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f184c15ed10 0x7f184c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:07.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.109+0000 7f1852937700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f184c073020 0x7f184c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:07.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.109+0000 7f1852937700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f184c06db60 con 0x7f184c0734b0 2019-11-28T11:41:07.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.109+0000 7f1852937700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184c06fe00 con 0x7f184c073020 2019-11-28T11:41:07.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.109+0000 7f1852937700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184c0700d0 con 0x7f184c15ed10 2019-11-28T11:41:07.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.109+0000 7f184bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f184c073020 0x7f184c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:07.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.109+0000 7f184bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f184c073020 0x7f184c071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38658/0 (socket says 172.21.15.80:38658) 2019-11-28T11:41:07.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.109+0000 7f184bfff700 1 -- 172.21.15.80:0/409970096 learned_addr learned my addr 172.21.15.80:0/409970096 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:07.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.109+0000 7f1850ed4700 1 --2- 172.21.15.80:0/409970096 >> v2:172.21.15.174:3300/0 conn(0x7f184c15ed10 0x7f184c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:07.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.109+0000 7f184bfff700 1 -- 172.21.15.80:0/409970096 >> v2:172.21.15.174:3300/0 conn(0x7f184c15ed10 msgr2=0x7f184c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.109+0000 7f184bfff700 1 --2- 172.21.15.80:0/409970096 >> v2:172.21.15.174:3300/0 conn(0x7f184c15ed10 0x7f184c15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.109+0000 7f184bfff700 1 -- 172.21.15.80:0/409970096 >> v1:172.21.15.174:6789/0 conn(0x7f184c0734b0 legacy=0x7f184c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.109+0000 7f184bfff700 1 -- 172.21.15.80:0/409970096 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c070760 con 0x7f184c073020 2019-11-28T11:41:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.109+0000 7f184bfff700 1 --2- 172.21.15.80:0/409970096 >> v2:172.21.15.80:3300/0 conn(0x7f184c073020 0x7f184c071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f183c00fa40 tx=0x7f183c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.110+0000 7f184bfff700 1 --2- 172.21.15.80:0/409970096 >> v2:172.21.15.80:3300/0 conn(0x7f184c073020 0x7f184c071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f183c00fa40 tx=0x7f183c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.110+0000 7f184bfff700 1 --2- 172.21.15.80:0/409970096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c073020 0x7f184c071ea0 secure :-1 s=READY pgs=1447 cs=0 l=1 rx=0x7f183c00fa40 tx=0x7f183c00fde0).ready entity=mon.0 client_cookie=b81c9f74dde1c0dd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:07.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.110+0000 7f184bfff700 1 --2- 172.21.15.80:0/409970096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c073020 0x7f184c071ea0 secure :-1 s=THROTTLE_DONE pgs=1447 cs=0 l=1 rx=0x7f183c00fa40 tx=0x7f183c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.110+0000 7f184b7fe700 1 -- 172.21.15.80:0/409970096 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f183c000ce0 con 0x7f184c073020 2019-11-28T11:41:07.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.110+0000 7f184bfff700 1 --2- 172.21.15.80:0/409970096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c073020 0x7f184c071ea0 secure :-1 s=THROTTLE_DONE pgs=1447 cs=0 l=1 rx=0x7f183c00fa40 tx=0x7f183c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.110+0000 7f184bfff700 1 --2- 172.21.15.80:0/409970096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c073020 0x7f184c071ea0 secure :-1 s=THROTTLE_DONE pgs=1447 cs=0 l=1 rx=0x7f183c00fa40 tx=0x7f183c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.110+0000 7f184b7fe700 1 -- 172.21.15.80:0/409970096 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c001010 con 0x7f184c073020 2019-11-28T11:41:07.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.110+0000 7f184b7fe700 1 -- 172.21.15.80:0/409970096 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f183c001720 con 0x7f184c073020 2019-11-28T11:41:07.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.110+0000 7f1852937700 1 -- 172.21.15.80:0/409970096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c073020 msgr2=0x7f184c071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.110+0000 7f1852937700 1 --2- 172.21.15.80:0/409970096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c073020 0x7f184c071ea0 secure :-1 s=READY pgs=1447 cs=0 l=1 rx=0x7f183c00fa40 tx=0x7f183c00fde0).stop 2019-11-28T11:41:07.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.110+0000 7f1852937700 1 -- 172.21.15.80:0/409970096 shutdown_connections 2019-11-28T11:41:07.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.110+0000 7f1852937700 1 --2- 172.21.15.80:0/409970096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c073020 0x7f184c071ea0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.110+0000 7f1852937700 1 --2- 172.21.15.80:0/409970096 >> v2:172.21.15.174:3300/0 conn(0x7f184c15ed10 0x7f184c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:07.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.110+0000 7f1852937700 1 -- 172.21.15.80:0/409970096 shutdown_connections 2019-11-28T11:41:07.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.110+0000 7f1852937700 1 -- 172.21.15.80:0/409970096 wait complete. 2019-11-28T11:41:07.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.110+0000 7f1852937700 1 -- 172.21.15.80:0/409970096 >> 172.21.15.80:0/409970096 conn(0x7f184c061d20 msgr2=0x7f184c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:07.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.113+0000 7f1852937700 1 Processor -- start 2019-11-28T11:41:07.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.113+0000 7f1852937700 1 -- start start 2019-11-28T11:41:07.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f1852937700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f184c148320 0x7f184c10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:07.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f1852937700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184c10f290 0x7f184c10dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:07.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f1852937700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f184c148e00 con 0x7f184c10e110 2019-11-28T11:41:07.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f1852937700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184c13aa20 con 0x7f184c148320 2019-11-28T11:41:07.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f1852937700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184c13acf0 con 0x7f184c10f290 2019-11-28T11:41:07.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f1850ed4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f184c148320 0x7f184c10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:07.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f1850ed4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f184c148320 0x7f184c10ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38662/0 (socket says 172.21.15.80:38662) 2019-11-28T11:41:07.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f1850ed4700 1 -- 172.21.15.80:0/1455909748 learned_addr learned my addr 172.21.15.80:0/1455909748 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:07.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f184bfff700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184c10f290 0x7f184c10dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:07.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f1850ed4700 1 -- 172.21.15.80:0/1455909748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184c10f290 msgr2=0x7f184c10dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f1850ed4700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184c10f290 0x7f184c10dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f1850ed4700 1 -- 172.21.15.80:0/1455909748 >> v1:172.21.15.174:6789/0 conn(0x7f184c10e110 legacy=0x7f184c1079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f1850ed4700 1 -- 172.21.15.80:0/1455909748 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c10c490 con 0x7f184c148320 2019-11-28T11:41:07.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f18497fa700 1 -- 172.21.15.80:0/1455909748 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207181729 0 0) 0x7f1844000b80 con 0x7f184c10e110 2019-11-28T11:41:07.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f1850ed4700 1 --2- 172.21.15.80:0/1455909748 >> v2:172.21.15.80:3300/0 conn(0x7f184c148320 0x7f184c10ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18340103d0 tx=0x7f1834010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f1850ed4700 1 --2- 172.21.15.80:0/1455909748 >> v2:172.21.15.80:3300/0 conn(0x7f184c148320 0x7f184c10ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18340103d0 tx=0x7f1834010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.114+0000 7f1850ed4700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c148320 0x7f184c10ed50 secure :-1 s=READY pgs=1448 cs=0 l=1 rx=0x7f18340103d0 tx=0x7f1834010770).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:07.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.115+0000 7f1850ed4700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c148320 0x7f184c10ed50 secure :-1 s=THROTTLE_DONE pgs=1448 cs=0 l=1 rx=0x7f18340103d0 tx=0x7f1834010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.115+0000 7f18497fa700 1 -- 172.21.15.80:0/1455909748 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1834005770 con 0x7f184c148320 2019-11-28T11:41:07.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.115+0000 7f1850ed4700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c148320 0x7f184c10ed50 secure :-1 s=THROTTLE_DONE pgs=1448 cs=0 l=1 rx=0x7f18340103d0 tx=0x7f1834010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.115+0000 7f1850ed4700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c148320 0x7f184c10ed50 secure :-1 s=THROTTLE_DONE pgs=1448 cs=0 l=1 rx=0x7f18340103d0 tx=0x7f1834010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.115+0000 7f18497fa700 1 -- 172.21.15.80:0/1455909748 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1834005390 con 0x7f184c148320 2019-11-28T11:41:07.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.115+0000 7f18497fa700 1 -- 172.21.15.80:0/1455909748 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1834005d50 con 0x7f184c148320 2019-11-28T11:41:07.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.115+0000 7f1852937700 1 -- 172.21.15.80:0/1455909748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184c10c810 con 0x7f184c148320 2019-11-28T11:41:07.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.115+0000 7f1852937700 1 -- 172.21.15.80:0/1455909748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184c10c490 con 0x7f184c148320 2019-11-28T11:41:07.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.115+0000 7f1850ed4700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c148320 0x7f184c10ed50 secure :-1 s=THROTTLE_DONE pgs=1448 cs=0 l=1 rx=0x7f18340103d0 tx=0x7f1834010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.116+0000 7f18497fa700 1 -- 172.21.15.80:0/1455909748 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1834005390 con 0x7f184c148320 2019-11-28T11:41:07.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.116+0000 7f1850ed4700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c148320 0x7f184c10ed50 secure :-1 s=THROTTLE_DONE pgs=1448 cs=0 l=1 rx=0x7f18340103d0 tx=0x7f1834010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.116+0000 7f18497fa700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1830018730 0x7f183001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:07.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.116+0000 7f18497fa700 1 -- 172.21.15.80:0/1455909748 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1834031a50 con 0x7f184c148320 2019-11-28T11:41:07.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.116+0000 7f184bfff700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1830018730 0x7f183001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:07.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.116+0000 7f184bfff700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1830018730 0x7f183001abc0 crc :-1 s=READY pgs=588 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:07.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.123+0000 7f1852937700 1 -- 172.21.15.80:0/1455909748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184c10c810 con 0x7f184c148320 2019-11-28T11:41:07.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.127+0000 7f1850ed4700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c148320 0x7f184c10ed50 secure :-1 s=THROTTLE_DONE pgs=1448 cs=0 l=1 rx=0x7f18340103d0 tx=0x7f1834010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.127+0000 7f18497fa700 1 -- 172.21.15.80:0/1455909748 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1834005180 con 0x7f184c148320 2019-11-28T11:41:07.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.292+0000 7f1852937700 1 -- 172.21.15.80:0/1455909748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f184c10c490 con 0x7f184c148320 2019-11-28T11:41:07.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.293+0000 7f1850ed4700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c148320 0x7f184c10ed50 secure :-1 s=THROTTLE_DONE pgs=1448 cs=0 l=1 rx=0x7f18340103d0 tx=0x7f1834010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.293+0000 7f18497fa700 1 -- 172.21.15.80:0/1455909748 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v107) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1834017180 con 0x7f184c148320 2019-11-28T11:41:07.325 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:41:07.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.295+0000 7f1852937700 1 -- 172.21.15.80:0/1455909748 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1830018730 msgr2=0x7f183001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.295+0000 7f1852937700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1830018730 0x7f183001abc0 crc :-1 s=READY pgs=588 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.295+0000 7f1852937700 1 -- 172.21.15.80:0/1455909748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c148320 msgr2=0x7f184c10ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.295+0000 7f1852937700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c148320 0x7f184c10ed50 secure :-1 s=READY pgs=1448 cs=0 l=1 rx=0x7f18340103d0 tx=0x7f1834010770).stop 2019-11-28T11:41:07.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.296+0000 7f1852937700 1 -- 172.21.15.80:0/1455909748 shutdown_connections 2019-11-28T11:41:07.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.296+0000 7f1852937700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1830018730 0x7f183001abc0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.296+0000 7f1852937700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184c10f290 0x7f184c10dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.296+0000 7f1852937700 1 --2- 172.21.15.80:0/1455909748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f184c148320 0x7f184c10ed50 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.296+0000 7f1852937700 1 -- 172.21.15.80:0/1455909748 shutdown_connections 2019-11-28T11:41:07.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.296+0000 7f1852937700 1 -- 172.21.15.80:0/1455909748 wait complete. 2019-11-28T11:41:07.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.296+0000 7f1852937700 1 -- 172.21.15.80:0/1455909748 >> 172.21.15.80:0/1455909748 conn(0x7f184c15e2d0 msgr2=0x7f184c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:07.337 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:41:07.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.429+0000 7f01efbac700 1 Processor -- start 2019-11-28T11:41:07.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.429+0000 7f01efbac700 1 -- start start 2019-11-28T11:41:07.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.430+0000 7f01efbac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01e815ed10 0x7f01e815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:07.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.430+0000 7f01efbac700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e806db60 con 0x7f01e80734b0 2019-11-28T11:41:07.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.430+0000 7f01efbac700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e806e060 con 0x7f01e8073020 2019-11-28T11:41:07.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.430+0000 7f01efbac700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e806fe00 con 0x7f01e815ed10 2019-11-28T11:41:07.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.430+0000 7f01ee149700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01e815ed10 0x7f01e815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:07.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.430+0000 7f01ee149700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01e815ed10 0x7f01e815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38670/0 (socket says 172.21.15.80:38670) 2019-11-28T11:41:07.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.430+0000 7f01ee94a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f01e80734b0 0x7f01e80726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37986/0 (socket says 172.21.15.80:37986) 2019-11-28T11:41:07.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.430+0000 7f01ee149700 1 -- 172.21.15.80:0/64766054 learned_addr learned my addr 172.21.15.80:0/64766054 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:07.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.431+0000 7f01ee149700 1 -- 172.21.15.80:0/64766054 >> v1:172.21.15.174:6789/0 conn(0x7f01e8073020 legacy=0x7f01e8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.431+0000 7f01ee149700 1 -- 172.21.15.80:0/64766054 >> v1:172.21.15.80:6789/0 conn(0x7f01e80734b0 legacy=0x7f01e80726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.431+0000 7f01ed147700 1 -- 172.21.15.80:0/64766054 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203824377 0 0) 0x7f01d8000fb0 con 0x7f01e8073020 2019-11-28T11:41:07.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.431+0000 7f01ee149700 1 -- 172.21.15.80:0/64766054 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e8070760 con 0x7f01e815ed10 2019-11-28T11:41:07.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.431+0000 7f01ee149700 1 --2- 172.21.15.80:0/64766054 >> v2:172.21.15.80:3300/0 conn(0x7f01e815ed10 0x7f01e815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f01d000fac0 tx=0x7f01d000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.431+0000 7f01ee149700 1 --2- 172.21.15.80:0/64766054 >> v2:172.21.15.80:3300/0 conn(0x7f01e815ed10 0x7f01e815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f01d000fac0 tx=0x7f01d000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.431+0000 7f01ee149700 1 --2- 172.21.15.80:0/64766054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e815ed10 0x7f01e815f100 secure :-1 s=READY pgs=1450 cs=0 l=1 rx=0x7f01d000fac0 tx=0x7f01d000fe60).ready entity=mon.0 client_cookie=fc83d174724cfe54 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:07.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.431+0000 7f01ee149700 1 --2- 172.21.15.80:0/64766054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e815ed10 0x7f01e815f100 secure :-1 s=THROTTLE_DONE pgs=1450 cs=0 l=1 rx=0x7f01d000fac0 tx=0x7f01d000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.431+0000 7f01ed147700 1 -- 172.21.15.80:0/64766054 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01d0000ce0 con 0x7f01e815ed10 2019-11-28T11:41:07.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.431+0000 7f01ee149700 1 --2- 172.21.15.80:0/64766054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e815ed10 0x7f01e815f100 secure :-1 s=THROTTLE_DONE pgs=1450 cs=0 l=1 rx=0x7f01d000fac0 tx=0x7f01d000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.431+0000 7f01ed147700 1 -- 172.21.15.80:0/64766054 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d0001010 con 0x7f01e815ed10 2019-11-28T11:41:07.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.431+0000 7f01ee149700 1 --2- 172.21.15.80:0/64766054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e815ed10 0x7f01e815f100 secure :-1 s=THROTTLE_DONE pgs=1450 cs=0 l=1 rx=0x7f01d000fac0 tx=0x7f01d000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.431+0000 7f01ed147700 1 -- 172.21.15.80:0/64766054 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01d0007590 con 0x7f01e815ed10 2019-11-28T11:41:07.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.431+0000 7f01efbac700 1 -- 172.21.15.80:0/64766054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e815ed10 msgr2=0x7f01e815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.431+0000 7f01efbac700 1 --2- 172.21.15.80:0/64766054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e815ed10 0x7f01e815f100 secure :-1 s=READY pgs=1450 cs=0 l=1 rx=0x7f01d000fac0 tx=0x7f01d000fe60).stop 2019-11-28T11:41:07.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.432+0000 7f01efbac700 1 -- 172.21.15.80:0/64766054 shutdown_connections 2019-11-28T11:41:07.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.432+0000 7f01efbac700 1 --2- 172.21.15.80:0/64766054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01e815ed10 0x7f01e815f100 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.432+0000 7f01efbac700 1 -- 172.21.15.80:0/64766054 shutdown_connections 2019-11-28T11:41:07.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.432+0000 7f01efbac700 1 -- 172.21.15.80:0/64766054 wait complete. 2019-11-28T11:41:07.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.432+0000 7f01efbac700 1 -- 172.21.15.80:0/64766054 >> 172.21.15.80:0/64766054 conn(0x7f01e8061d20 msgr2=0x7f01e80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:07.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.434+0000 7f01efbac700 1 Processor -- start 2019-11-28T11:41:07.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.434+0000 7f01efbac700 1 -- start start 2019-11-28T11:41:07.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.435+0000 7f01efbac700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01e810ed60 0x7f01e810f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:07.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.435+0000 7f01efbac700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e810c250 con 0x7f01e810e970 2019-11-28T11:41:07.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.435+0000 7f01efbac700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e810c6d0 con 0x7f01e810f730 2019-11-28T11:41:07.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.435+0000 7f01efbac700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e810e430 con 0x7f01e810ed60 2019-11-28T11:41:07.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.435+0000 7f01ee149700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f01e810e970 0x7f01e81087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37992/0 (socket says 172.21.15.80:37992) 2019-11-28T11:41:07.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.435+0000 7f01ee149700 1 -- 172.21.15.80:0/1119905015 learned_addr learned my addr 172.21.15.80:0/1119905015 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:07.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.435+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080378385 0 0) 0x7f01d0007cb0 con 0x7f01e810e970 2019-11-28T11:41:07.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.435+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01cc002e80 con 0x7f01e810e970 2019-11-28T11:41:07.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.435+0000 7f01ed948700 1 --2- 172.21.15.80:0/1119905015 >> v2:172.21.15.174:3300/0 conn(0x7f01e810ed60 0x7f01e810f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:07.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1490111885 0 0) 0x7f01d0007950 con 0x7f01e810e970 2019-11-28T11:41:07.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f01cc0032e0 con 0x7f01e810e970 2019-11-28T11:41:07.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f01d0000cc0 con 0x7f01e810e970 2019-11-28T11:41:07.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 >> v2:172.21.15.174:3300/0 conn(0x7f01e810ed60 msgr2=0x7f01e810f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01e6ffd700 1 --2- 172.21.15.80:0/1119905015 >> v2:172.21.15.174:3300/0 conn(0x7f01e810ed60 0x7f01e810f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 >> v1:172.21.15.174:6789/0 conn(0x7f01e810f730 legacy=0x7f01e8167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 >> v1:172.21.15.80:6789/0 conn(0x7f01e810e970 legacy=0x7f01e81087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01e6ffd700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01cc003680 0x7f01cc003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:07.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01e6ffd700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01cc003ff0 0x7f01cc004470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01e6ffd700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01cc004c30 0x7f01cc00b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc005360 con 0x7f01cc003680 2019-11-28T11:41:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc00be10 con 0x7f01cc003ff0 2019-11-28T11:41:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc00c040 con 0x7f01cc004c30 2019-11-28T11:41:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01ee149700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01cc003680 0x7f01cc003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:07.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01ed948700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01cc003ff0 0x7f01cc004470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:07.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01ee94a700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01cc004c30 0x7f01cc00b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:07.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01ee149700 1 -- 172.21.15.80:0/1119905015 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01cc004c30 msgr2=0x7f01cc00b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01ee149700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01cc004c30 0x7f01cc00b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01ee149700 1 -- 172.21.15.80:0/1119905015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01cc003ff0 msgr2=0x7f01cc004470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01ee149700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01cc003ff0 0x7f01cc004470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01ee149700 1 -- 172.21.15.80:0/1119905015 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc00c2f0 con 0x7f01cc003680 2019-11-28T11:41:07.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01efbac700 1 -- 172.21.15.80:0/1119905015 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e8106270 con 0x7f01cc003680 2019-11-28T11:41:07.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01ee149700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01cc003680 0x7f01cc003ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f01d00107d0 tx=0x7f01d0010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01ee94a700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01cc004c30 0x7f01cc00b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:41:07.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01ee94a700 1 -- 172.21.15.80:0/1119905015 reap_dead start 2019-11-28T11:41:07.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01efbac700 1 -- 172.21.15.80:0/1119905015 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e8105ef0 con 0x7f01cc003680 2019-11-28T11:41:07.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01ee149700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01cc003680 0x7f01cc003ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f01d00107d0 tx=0x7f01d0010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01ee149700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01cc003680 0x7f01cc003ab0 secure :-1 s=READY pgs=1452 cs=0 l=1 rx=0x7f01d00107d0 tx=0x7f01d0010650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:07.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01ee149700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01cc003680 0x7f01cc003ab0 secure :-1 s=THROTTLE_DONE pgs=1452 cs=0 l=1 rx=0x7f01d00107d0 tx=0x7f01d0010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01d0005900 con 0x7f01cc003680 2019-11-28T11:41:07.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01ee149700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01cc003680 0x7f01cc003ab0 secure :-1 s=THROTTLE_DONE pgs=1452 cs=0 l=1 rx=0x7f01d00107d0 tx=0x7f01d0010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d0007950 con 0x7f01cc003680 2019-11-28T11:41:07.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01ee149700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01cc003680 0x7f01cc003ab0 secure :-1 s=THROTTLE_DONE pgs=1452 cs=0 l=1 rx=0x7f01d00107d0 tx=0x7f01d0010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.436+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01d0007b40 con 0x7f01cc003680 2019-11-28T11:41:07.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.437+0000 7f01ee149700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01cc003680 0x7f01cc003ab0 secure :-1 s=THROTTLE_DONE pgs=1452 cs=0 l=1 rx=0x7f01d00107d0 tx=0x7f01d0010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.437+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f01d0007b40 con 0x7f01cc003680 2019-11-28T11:41:07.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.437+0000 7f01ee149700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01cc003680 0x7f01cc003ab0 secure :-1 s=THROTTLE_DONE pgs=1452 cs=0 l=1 rx=0x7f01d00107d0 tx=0x7f01d0010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.437+0000 7f01e6ffd700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01cc01b480 0x7f01cc01d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:07.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.437+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f01d0031d60 con 0x7f01cc003680 2019-11-28T11:41:07.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.437+0000 7f01ed948700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01cc01b480 0x7f01cc01d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:07.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.438+0000 7f01ed948700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01cc01b480 0x7f01cc01d8d0 crc :-1 s=READY pgs=589 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:07.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.444+0000 7f01efbac700 1 -- 172.21.15.80:0/1119905015 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e8106270 con 0x7f01cc003680 2019-11-28T11:41:07.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.448+0000 7f01ee149700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01cc003680 0x7f01cc003ab0 secure :-1 s=THROTTLE_DONE pgs=1452 cs=0 l=1 rx=0x7f01d00107d0 tx=0x7f01d0010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.448+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f01d0017780 con 0x7f01cc003680 2019-11-28T11:41:07.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.614+0000 7f01efbac700 1 -- 172.21.15.80:0/1119905015 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f01e8105ef0 con 0x7f01cc003680 2019-11-28T11:41:07.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.614+0000 7f01ee149700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01cc003680 0x7f01cc003ab0 secure :-1 s=THROTTLE_DONE pgs=1452 cs=0 l=1 rx=0x7f01d00107d0 tx=0x7f01d0010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.614+0000 7f01e6ffd700 1 -- 172.21.15.80:0/1119905015 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v107) v1 ==== 104+0+10 (secure 0 0 0) 0x7f01d0007a20 con 0x7f01cc003680 2019-11-28T11:41:07.706 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:41:07.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.616+0000 7f01efbac700 1 -- 172.21.15.80:0/1119905015 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01cc01b480 msgr2=0x7f01cc01d8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.616+0000 7f01efbac700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01cc01b480 0x7f01cc01d8d0 crc :-1 s=READY pgs=589 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.616+0000 7f01efbac700 1 -- 172.21.15.80:0/1119905015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01cc003680 msgr2=0x7f01cc003ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.616+0000 7f01efbac700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01cc003680 0x7f01cc003ab0 secure :-1 s=READY pgs=1452 cs=0 l=1 rx=0x7f01d00107d0 tx=0x7f01d0010650).stop 2019-11-28T11:41:07.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.617+0000 7f01efbac700 1 -- 172.21.15.80:0/1119905015 shutdown_connections 2019-11-28T11:41:07.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.617+0000 7f01efbac700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01cc01b480 0x7f01cc01d8d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.617+0000 7f01efbac700 1 --2- 172.21.15.80:0/1119905015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01cc003680 0x7f01cc003ab0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.617+0000 7f01efbac700 1 -- 172.21.15.80:0/1119905015 shutdown_connections 2019-11-28T11:41:07.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.617+0000 7f01efbac700 1 -- 172.21.15.80:0/1119905015 wait complete. 2019-11-28T11:41:07.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.617+0000 7f01efbac700 1 -- 172.21.15.80:0/1119905015 >> 172.21.15.80:0/1119905015 conn(0x7f01e815e2d0 msgr2=0x7f01e8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:07.709 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:41:07.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.801+0000 7f1183bc3700 1 Processor -- start 2019-11-28T11:41:07.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.801+0000 7f1183bc3700 1 -- start start 2019-11-28T11:41:07.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.802+0000 7f1183bc3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f117c1639f0 0x7f117c165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:07.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.802+0000 7f1183bc3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117c06db60 con 0x7f117c15f100 2019-11-28T11:41:07.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.802+0000 7f1183bc3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117c06e060 con 0x7f117c15ed10 2019-11-28T11:41:07.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.802+0000 7f1183bc3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117c06fe00 con 0x7f117c1639f0 2019-11-28T11:41:07.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.802+0000 7f1182961700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f117c1639f0 0x7f117c165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:07.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.802+0000 7f118195f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f117c15f100 0x7f117c06bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38010/0 (socket says 172.21.15.80:38010) 2019-11-28T11:41:07.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.802+0000 7f118195f700 1 -- 172.21.15.80:0/3578529674 learned_addr learned my addr 172.21.15.80:0/3578529674 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:07.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.803+0000 7f1182961700 1 -- 172.21.15.80:0/3578529674 >> v1:172.21.15.174:6789/0 conn(0x7f117c15ed10 legacy=0x7f117c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.803+0000 7f1182961700 1 -- 172.21.15.80:0/3578529674 >> v1:172.21.15.80:6789/0 conn(0x7f117c15f100 legacy=0x7f117c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.803+0000 7f118115e700 1 -- 172.21.15.80:0/3578529674 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174122026 0 0) 0x7f1164001150 con 0x7f117c15f100 2019-11-28T11:41:07.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.803+0000 7f1182961700 1 -- 172.21.15.80:0/3578529674 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c070760 con 0x7f117c1639f0 2019-11-28T11:41:07.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.803+0000 7f1182961700 1 --2- 172.21.15.80:0/3578529674 >> v2:172.21.15.80:3300/0 conn(0x7f117c1639f0 0x7f117c165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f117400af50 tx=0x7f117400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.803+0000 7f1182961700 1 --2- 172.21.15.80:0/3578529674 >> v2:172.21.15.80:3300/0 conn(0x7f117c1639f0 0x7f117c165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f117400af50 tx=0x7f117400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.803+0000 7f1182961700 1 --2- 172.21.15.80:0/3578529674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c1639f0 0x7f117c165df0 secure :-1 s=READY pgs=1454 cs=0 l=1 rx=0x7f117400af50 tx=0x7f117400b760).ready entity=mon.0 client_cookie=c37a958fbbfb02fb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.803+0000 7f1182961700 1 --2- 172.21.15.80:0/3578529674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c1639f0 0x7f117c165df0 secure :-1 s=THROTTLE_DONE pgs=1454 cs=0 l=1 rx=0x7f117400af50 tx=0x7f117400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.803+0000 7f118115e700 1 -- 172.21.15.80:0/3578529674 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1174009ba0 con 0x7f117c1639f0 2019-11-28T11:41:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.803+0000 7f1182961700 1 --2- 172.21.15.80:0/3578529674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c1639f0 0x7f117c165df0 secure :-1 s=THROTTLE_DONE pgs=1454 cs=0 l=1 rx=0x7f117400af50 tx=0x7f117400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.803+0000 7f1182961700 1 --2- 172.21.15.80:0/3578529674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c1639f0 0x7f117c165df0 secure :-1 s=THROTTLE_DONE pgs=1454 cs=0 l=1 rx=0x7f117400af50 tx=0x7f117400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.803+0000 7f118115e700 1 -- 172.21.15.80:0/3578529674 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1174000a70 con 0x7f117c1639f0 2019-11-28T11:41:07.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.803+0000 7f118115e700 1 -- 172.21.15.80:0/3578529674 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f117400a180 con 0x7f117c1639f0 2019-11-28T11:41:07.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.803+0000 7f1183bc3700 1 -- 172.21.15.80:0/3578529674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c1639f0 msgr2=0x7f117c165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.803+0000 7f1183bc3700 1 --2- 172.21.15.80:0/3578529674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c1639f0 0x7f117c165df0 secure :-1 s=READY pgs=1454 cs=0 l=1 rx=0x7f117400af50 tx=0x7f117400b760).stop 2019-11-28T11:41:07.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.804+0000 7f1183bc3700 1 -- 172.21.15.80:0/3578529674 shutdown_connections 2019-11-28T11:41:07.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.804+0000 7f1183bc3700 1 --2- 172.21.15.80:0/3578529674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c1639f0 0x7f117c165df0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.804+0000 7f1183bc3700 1 -- 172.21.15.80:0/3578529674 shutdown_connections 2019-11-28T11:41:07.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.804+0000 7f1183bc3700 1 -- 172.21.15.80:0/3578529674 wait complete. 2019-11-28T11:41:07.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.804+0000 7f1183bc3700 1 -- 172.21.15.80:0/3578529674 >> 172.21.15.80:0/3578529674 conn(0x7f117c061d20 msgr2=0x7f117c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:07.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.806+0000 7f1183bc3700 1 Processor -- start 2019-11-28T11:41:07.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.806+0000 7f1183bc3700 1 -- start start 2019-11-28T11:41:07.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.807+0000 7f1183bc3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f117c073580 0x7f117c12e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:07.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.807+0000 7f1183bc3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f117c075520 0x7f117c148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:07.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.807+0000 7f1183bc3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117c1321a0 con 0x7f117c0759b0 2019-11-28T11:41:07.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.807+0000 7f1183bc3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117c07a4f0 con 0x7f117c075520 2019-11-28T11:41:07.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.807+0000 7f1183bc3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117c07a7c0 con 0x7f117c073580 2019-11-28T11:41:07.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.807+0000 7f118195f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f117c075520 0x7f117c148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:07.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.807+0000 7f118195f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f117c075520 0x7f117c148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38698/0 (socket says 172.21.15.80:38698) 2019-11-28T11:41:07.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.807+0000 7f118195f700 1 -- 172.21.15.80:0/4237366185 learned_addr learned my addr 172.21.15.80:0/4237366185 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:07.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f1182160700 1 --2- 172.21.15.80:0/4237366185 >> v2:172.21.15.174:3300/0 conn(0x7f117c073580 0x7f117c12e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:07.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f118195f700 1 -- 172.21.15.80:0/4237366185 >> v2:172.21.15.174:3300/0 conn(0x7f117c073580 msgr2=0x7f117c12e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f118195f700 1 --2- 172.21.15.80:0/4237366185 >> v2:172.21.15.174:3300/0 conn(0x7f117c073580 0x7f117c12e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:07.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f118195f700 1 -- 172.21.15.80:0/4237366185 >> v1:172.21.15.174:6789/0 conn(0x7f117c0759b0 legacy=0x7f117c148580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:07.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f118195f700 1 -- 172.21.15.80:0/4237366185 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c07ae50 con 0x7f117c075520 2019-11-28T11:41:07.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f1182160700 1 --2- 172.21.15.80:0/4237366185 >> v2:172.21.15.174:3300/0 conn(0x7f117c073580 0x7f117c12e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:41:07.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f118195f700 1 --2- 172.21.15.80:0/4237366185 >> v2:172.21.15.80:3300/0 conn(0x7f117c075520 0x7f117c148040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1164010430 tx=0x7f11640107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f118195f700 1 --2- 172.21.15.80:0/4237366185 >> v2:172.21.15.80:3300/0 conn(0x7f117c075520 0x7f117c148040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1164010430 tx=0x7f11640107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f118195f700 1 --2- 172.21.15.80:0/4237366185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c075520 0x7f117c148040 secure :-1 s=READY pgs=1455 cs=0 l=1 rx=0x7f1164010430 tx=0x7f11640107d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:07.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f118195f700 1 --2- 172.21.15.80:0/4237366185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c075520 0x7f117c148040 secure :-1 s=THROTTLE_DONE pgs=1455 cs=0 l=1 rx=0x7f1164010430 tx=0x7f11640107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f118195f700 1 --2- 172.21.15.80:0/4237366185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c075520 0x7f117c148040 secure :-1 s=THROTTLE_DONE pgs=1455 cs=0 l=1 rx=0x7f1164010430 tx=0x7f11640107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f117affd700 1 -- 172.21.15.80:0/4237366185 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1164000ed0 con 0x7f117c075520 2019-11-28T11:41:07.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f118195f700 1 --2- 172.21.15.80:0/4237366185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c075520 0x7f117c148040 secure :-1 s=THROTTLE_DONE pgs=1455 cs=0 l=1 rx=0x7f1164010430 tx=0x7f11640107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f117affd700 1 -- 172.21.15.80:0/4237366185 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1164004430 con 0x7f117c075520 2019-11-28T11:41:07.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f1183bc3700 1 -- 172.21.15.80:0/4237366185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117c07b1d0 con 0x7f117c075520 2019-11-28T11:41:07.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f117affd700 1 -- 172.21.15.80:0/4237366185 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1164004a80 con 0x7f117c075520 2019-11-28T11:41:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f1183bc3700 1 -- 172.21.15.80:0/4237366185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117c07ae50 con 0x7f117c075520 2019-11-28T11:41:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.808+0000 7f118195f700 1 --2- 172.21.15.80:0/4237366185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c075520 0x7f117c148040 secure :-1 s=THROTTLE_DONE pgs=1455 cs=0 l=1 rx=0x7f1164010430 tx=0x7f11640107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.809+0000 7f117affd700 1 -- 172.21.15.80:0/4237366185 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1164004620 con 0x7f117c075520 2019-11-28T11:41:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.809+0000 7f118195f700 1 --2- 172.21.15.80:0/4237366185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c075520 0x7f117c148040 secure :-1 s=THROTTLE_DONE pgs=1455 cs=0 l=1 rx=0x7f1164010430 tx=0x7f11640107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.809+0000 7f117affd700 1 --2- 172.21.15.80:0/4237366185 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1160018730 0x7f116001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:07.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.809+0000 7f117affd700 1 -- 172.21.15.80:0/4237366185 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1164031af0 con 0x7f117c075520 2019-11-28T11:41:07.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.809+0000 7f1182160700 1 --2- 172.21.15.80:0/4237366185 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1160018730 0x7f116001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:07.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.809+0000 7f1182160700 1 --2- 172.21.15.80:0/4237366185 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1160018730 0x7f116001abc0 crc :-1 s=READY pgs=590 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:07.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.817+0000 7f1183bc3700 1 -- 172.21.15.80:0/4237366185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117c07b1d0 con 0x7f117c075520 2019-11-28T11:41:07.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.820+0000 7f118195f700 1 --2- 172.21.15.80:0/4237366185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c075520 0x7f117c148040 secure :-1 s=THROTTLE_DONE pgs=1455 cs=0 l=1 rx=0x7f1164010430 tx=0x7f11640107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:07.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.820+0000 7f117affd700 1 -- 172.21.15.80:0/4237366185 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f11640012b0 con 0x7f117c075520 2019-11-28T11:41:08.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.988+0000 7f1183bc3700 1 -- 172.21.15.80:0/4237366185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f117c07ae50 con 0x7f117c075520 2019-11-28T11:41:08.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.988+0000 7f118195f700 1 --2- 172.21.15.80:0/4237366185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c075520 0x7f117c148040 secure :-1 s=THROTTLE_DONE pgs=1455 cs=0 l=1 rx=0x7f1164010430 tx=0x7f11640107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:08.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.988+0000 7f117affd700 1 -- 172.21.15.80:0/4237366185 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v107) v1 ==== 100+0+10 (secure 0 0 0) 0x7f11640045e0 con 0x7f117c075520 2019-11-28T11:41:08.022 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:41:08.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.991+0000 7f1183bc3700 1 -- 172.21.15.80:0/4237366185 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1160018730 msgr2=0x7f116001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:08.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.991+0000 7f1183bc3700 1 --2- 172.21.15.80:0/4237366185 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1160018730 0x7f116001abc0 crc :-1 s=READY pgs=590 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:08.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.991+0000 7f1183bc3700 1 -- 172.21.15.80:0/4237366185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c075520 msgr2=0x7f117c148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:08.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.991+0000 7f1183bc3700 1 --2- 172.21.15.80:0/4237366185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c075520 0x7f117c148040 secure :-1 s=READY pgs=1455 cs=0 l=1 rx=0x7f1164010430 tx=0x7f11640107d0).stop 2019-11-28T11:41:08.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.991+0000 7f1183bc3700 1 -- 172.21.15.80:0/4237366185 shutdown_connections 2019-11-28T11:41:08.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.991+0000 7f1183bc3700 1 --2- 172.21.15.80:0/4237366185 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1160018730 0x7f116001abc0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:08.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.991+0000 7f1183bc3700 1 --2- 172.21.15.80:0/4237366185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f117c075520 0x7f117c148040 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:08.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.991+0000 7f1183bc3700 1 --2- 172.21.15.80:0/4237366185 >> v2:172.21.15.174:3300/0 conn(0x7f117c073580 0x7f117c12e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:08.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.991+0000 7f1183bc3700 1 -- 172.21.15.80:0/4237366185 shutdown_connections 2019-11-28T11:41:08.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.991+0000 7f1183bc3700 1 -- 172.21.15.80:0/4237366185 wait complete. 2019-11-28T11:41:08.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:07.991+0000 7f1183bc3700 1 -- 172.21.15.80:0/4237366185 >> 172.21.15.80:0/4237366185 conn(0x7f117c147670 msgr2=0x7f117c1641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:08.034 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:41:08.034 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:41:08.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.121+0000 7f6067938700 1 Processor -- start 2019-11-28T11:41:08.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.121+0000 7f6067938700 1 -- start start 2019-11-28T11:41:08.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.122+0000 7f6067938700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f606006c490 0x7f606006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:08.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.122+0000 7f6067938700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f606006ce60 0x7f6060164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:08.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.122+0000 7f6067938700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606006db00 con 0x7f606006c0a0 2019-11-28T11:41:08.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.122+0000 7f6067938700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606006fd60 con 0x7f606006c490 2019-11-28T11:41:08.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.122+0000 7f6067938700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6060070030 con 0x7f606006ce60 2019-11-28T11:41:08.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.122+0000 7f60656d4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f606006c490 0x7f606006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:08.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.122+0000 7f6065ed5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f606006c0a0 0x7f6060072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38020/0 (socket says 172.21.15.80:38020) 2019-11-28T11:41:08.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.122+0000 7f6065ed5700 1 -- 172.21.15.80:0/2487319975 learned_addr learned my addr 172.21.15.80:0/2487319975 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:08.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.122+0000 7f60656d4700 1 -- 172.21.15.80:0/2487319975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f606006ce60 msgr2=0x7f6060164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:08.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.122+0000 7f60656d4700 1 --2- 172.21.15.80:0/2487319975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f606006ce60 0x7f6060164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:08.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.122+0000 7f60656d4700 1 -- 172.21.15.80:0/2487319975 >> v1:172.21.15.80:6789/0 conn(0x7f606006c0a0 legacy=0x7f6060072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:08.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.122+0000 7f60656d4700 1 -- 172.21.15.80:0/2487319975 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60600706c0 con 0x7f606006c490 2019-11-28T11:41:08.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.122+0000 7f6064ed3700 1 -- 172.21.15.80:0/2487319975 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225716293 0 0) 0x7f6054001150 con 0x7f606006c0a0 2019-11-28T11:41:08.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.122+0000 7f60656d4700 1 --2- 172.21.15.80:0/2487319975 >> v2:172.21.15.80:3300/0 conn(0x7f606006c490 0x7f606006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f605000af50 tx=0x7f605000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:08.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.122+0000 7f60656d4700 1 --2- 172.21.15.80:0/2487319975 >> v2:172.21.15.80:3300/0 conn(0x7f606006c490 0x7f606006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f605000af50 tx=0x7f605000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:08.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.122+0000 7f60656d4700 1 --2- 172.21.15.80:0/2487319975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606006c490 0x7f606006c920 secure :-1 s=READY pgs=1457 cs=0 l=1 rx=0x7f605000af50 tx=0x7f605000b6e0).ready entity=mon.0 client_cookie=2c3d0c9f071bb3a3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:08.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.123+0000 7f60656d4700 1 --2- 172.21.15.80:0/2487319975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606006c490 0x7f606006c920 secure :-1 s=THROTTLE_DONE pgs=1457 cs=0 l=1 rx=0x7f605000af50 tx=0x7f605000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:08.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.123+0000 7f6064ed3700 1 -- 172.21.15.80:0/2487319975 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6050007210 con 0x7f606006c490 2019-11-28T11:41:08.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.123+0000 7f60656d4700 1 --2- 172.21.15.80:0/2487319975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606006c490 0x7f606006c920 secure :-1 s=THROTTLE_DONE pgs=1457 cs=0 l=1 rx=0x7f605000af50 tx=0x7f605000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:08.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.123+0000 7f60656d4700 1 --2- 172.21.15.80:0/2487319975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606006c490 0x7f606006c920 secure :-1 s=THROTTLE_DONE pgs=1457 cs=0 l=1 rx=0x7f605000af50 tx=0x7f605000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:08.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.123+0000 7f6064ed3700 1 -- 172.21.15.80:0/2487319975 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60500099b0 con 0x7f606006c490 2019-11-28T11:41:08.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.123+0000 7f6064ed3700 1 -- 172.21.15.80:0/2487319975 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f605000a080 con 0x7f606006c490 2019-11-28T11:41:08.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.123+0000 7f6067938700 1 -- 172.21.15.80:0/2487319975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606006c490 msgr2=0x7f606006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:08.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.123+0000 7f6067938700 1 --2- 172.21.15.80:0/2487319975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606006c490 0x7f606006c920 secure :-1 s=READY pgs=1457 cs=0 l=1 rx=0x7f605000af50 tx=0x7f605000b6e0).stop 2019-11-28T11:41:08.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.123+0000 7f6067938700 1 -- 172.21.15.80:0/2487319975 shutdown_connections 2019-11-28T11:41:08.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.123+0000 7f6067938700 1 --2- 172.21.15.80:0/2487319975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f606006ce60 0x7f6060164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:08.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.123+0000 7f6067938700 1 --2- 172.21.15.80:0/2487319975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606006c490 0x7f606006c920 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:08.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.123+0000 7f6067938700 1 -- 172.21.15.80:0/2487319975 shutdown_connections 2019-11-28T11:41:08.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.123+0000 7f6067938700 1 -- 172.21.15.80:0/2487319975 wait complete. 2019-11-28T11:41:08.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.123+0000 7f6067938700 1 -- 172.21.15.80:0/2487319975 >> 172.21.15.80:0/2487319975 conn(0x7f6060061cf0 msgr2=0x7f6060064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:08.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.126+0000 7f6067938700 1 Processor -- start 2019-11-28T11:41:08.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.126+0000 7f6067938700 1 -- start start 2019-11-28T11:41:08.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f6067938700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6060142160 0x7f606010de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:08.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f6067938700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f606012e240 0x7f606012e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:08.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f6067938700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6060101e80 con 0x7f606010e340 2019-11-28T11:41:08.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f6067938700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6060106af0 con 0x7f606012e240 2019-11-28T11:41:08.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f6067938700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6060107520 con 0x7f6060142160 2019-11-28T11:41:08.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f60666d6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f606012e240 0x7f606012e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:08.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f60666d6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f606012e240 0x7f606012e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38714/0 (socket says 172.21.15.80:38714) 2019-11-28T11:41:08.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f60666d6700 1 -- 172.21.15.80:0/1242072464 learned_addr learned my addr 172.21.15.80:0/1242072464 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:08.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f6065ed5700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6060142160 0x7f606010de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:08.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f60666d6700 1 -- 172.21.15.80:0/1242072464 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6060142160 msgr2=0x7f606010de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:08.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f60666d6700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6060142160 0x7f606010de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:08.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f60666d6700 1 -- 172.21.15.80:0/1242072464 >> v1:172.21.15.174:6789/0 conn(0x7f606010e340 legacy=0x7f60601284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:08.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f60666d6700 1 -- 172.21.15.80:0/1242072464 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6060107e80 con 0x7f606012e240 2019-11-28T11:41:08.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f60666d6700 1 --2- 172.21.15.80:0/1242072464 >> v2:172.21.15.80:3300/0 conn(0x7f606012e240 0x7f606012e6d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6058010790 tx=0x7f6058010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:08.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f60666d6700 1 --2- 172.21.15.80:0/1242072464 >> v2:172.21.15.80:3300/0 conn(0x7f606012e240 0x7f606012e6d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6058010790 tx=0x7f6058010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:08.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f60666d6700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606012e240 0x7f606012e6d0 secure :-1 s=READY pgs=1458 cs=0 l=1 rx=0x7f6058010790 tx=0x7f6058010610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:08.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f60666d6700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606012e240 0x7f606012e6d0 secure :-1 s=THROTTLE_DONE pgs=1458 cs=0 l=1 rx=0x7f6058010790 tx=0x7f6058010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:08.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f60666d6700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606012e240 0x7f606012e6d0 secure :-1 s=THROTTLE_DONE pgs=1458 cs=0 l=1 rx=0x7f6058010790 tx=0x7f6058010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:08.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f60666d6700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606012e240 0x7f606012e6d0 secure :-1 s=THROTTLE_DONE pgs=1458 cs=0 l=1 rx=0x7f6058010790 tx=0x7f6058010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:08.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f605e7fc700 1 -- 172.21.15.80:0/1242072464 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6058007950 con 0x7f606012e240 2019-11-28T11:41:08.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f605e7fc700 1 -- 172.21.15.80:0/1242072464 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6058005900 con 0x7f606012e240 2019-11-28T11:41:08.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f6067938700 1 -- 172.21.15.80:0/1242072464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6060108200 con 0x7f606012e240 2019-11-28T11:41:08.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.127+0000 7f605e7fc700 1 -- 172.21.15.80:0/1242072464 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6058006010 con 0x7f606012e240 2019-11-28T11:41:08.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.128+0000 7f6067938700 1 -- 172.21.15.80:0/1242072464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6060107e80 con 0x7f606012e240 2019-11-28T11:41:08.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.128+0000 7f60666d6700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606012e240 0x7f606012e6d0 secure :-1 s=THROTTLE_DONE pgs=1458 cs=0 l=1 rx=0x7f6058010790 tx=0x7f6058010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:08.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.128+0000 7f605e7fc700 1 -- 172.21.15.80:0/1242072464 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6058005d00 con 0x7f606012e240 2019-11-28T11:41:08.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.128+0000 7f60666d6700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606012e240 0x7f606012e6d0 secure :-1 s=THROTTLE_DONE pgs=1458 cs=0 l=1 rx=0x7f6058010790 tx=0x7f6058010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:08.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.128+0000 7f605e7fc700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6040018730 0x7f604001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:08.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.128+0000 7f605e7fc700 1 -- 172.21.15.80:0/1242072464 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6058031f00 con 0x7f606012e240 2019-11-28T11:41:08.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.128+0000 7f6065ed5700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6040018730 0x7f604001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:08.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.129+0000 7f6065ed5700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6040018730 0x7f604001abe0 crc :-1 s=READY pgs=591 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:08.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.136+0000 7f6067938700 1 -- 172.21.15.80:0/1242072464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6060108200 con 0x7f606012e240 2019-11-28T11:41:08.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.139+0000 7f60666d6700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606012e240 0x7f606012e6d0 secure :-1 s=THROTTLE_DONE pgs=1458 cs=0 l=1 rx=0x7f6058010790 tx=0x7f6058010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:08.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.139+0000 7f605e7fc700 1 -- 172.21.15.80:0/1242072464 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6058005900 con 0x7f606012e240 2019-11-28T11:41:08.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.312+0000 7f6067938700 1 -- 172.21.15.80:0/1242072464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6060107e80 con 0x7f606012e240 2019-11-28T11:41:08.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.312+0000 7f60666d6700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606012e240 0x7f606012e6d0 secure :-1 s=THROTTLE_DONE pgs=1458 cs=0 l=1 rx=0x7f6058010790 tx=0x7f6058010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:08.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.312+0000 7f605e7fc700 1 -- 172.21.15.80:0/1242072464 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+1772 (secure 0 0 0) 0x7f6058005b10 con 0x7f606012e240 2019-11-28T11:41:08.345 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 75 2019-11-28T11:41:08.345 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:08.345 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:02.122819+0000","modified":"2019-11-28T11:41:05.774868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7747},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7747":{"gid":7747,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/332155288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":332155288},{"type":"v1","addr":"172.21.15.174:6835","nonce":332155288}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2019-11-28T11:41:08.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.315+0000 7f6067938700 1 -- 172.21.15.80:0/1242072464 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6040018730 msgr2=0x7f604001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:08.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.315+0000 7f6067938700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6040018730 0x7f604001abe0 crc :-1 s=READY pgs=591 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:08.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.315+0000 7f6067938700 1 -- 172.21.15.80:0/1242072464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606012e240 msgr2=0x7f606012e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:08.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.315+0000 7f6067938700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606012e240 0x7f606012e6d0 secure :-1 s=READY pgs=1458 cs=0 l=1 rx=0x7f6058010790 tx=0x7f6058010610).stop 2019-11-28T11:41:08.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.315+0000 7f6067938700 1 -- 172.21.15.80:0/1242072464 shutdown_connections 2019-11-28T11:41:08.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.315+0000 7f6067938700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f606012e240 0x7f606012e6d0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:08.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.315+0000 7f6067938700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6040018730 0x7f604001abe0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:08.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.315+0000 7f6067938700 1 --2- 172.21.15.80:0/1242072464 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6060142160 0x7f606010de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:08.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.315+0000 7f6067938700 1 -- 172.21.15.80:0/1242072464 shutdown_connections 2019-11-28T11:41:08.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.315+0000 7f6067938700 1 -- 172.21.15.80:0/1242072464 wait complete. 2019-11-28T11:41:08.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:08.315+0000 7f6067938700 1 -- 172.21.15.80:0/1242072464 >> 172.21.15.80:0/1242072464 conn(0x7f606015e210 msgr2=0x7f606010b140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:08.659 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7747}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 16, u'failed': [], u'epoch': 75, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [17], u'info': {u'gid_7747': {u'export_targets': [], u'name': u'c', u'incarnation': 74, u'state_seq': 2, u'state': u'up:active', u'gid': 7747, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 332155288, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 332155288, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/332155288'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:41:02.122819+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:41:05.774868+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:41:08.659 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:41:08.660 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:41:08.786 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:41:08.786 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:41:08.787 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:41:08.787 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 7747, 2019-11-28T11:41:08.787 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:41:08.787 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:41:08.788 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 3.9794442609999998, 2019-11-28T11:41:08.788 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 75, 2019-11-28T11:41:08.788 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 107, 2019-11-28T11:41:08.788 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 107, 2019-11-28T11:41:08.788 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 4.1774675859999997 2019-11-28T11:41:08.789 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:41:08.792 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7747, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.9794442609999998, "mdsmap_epoch": 75, "osdmap_epoch": 107, "osdmap_epoch_barrier": 107, "uptime": 4.1774675859999997 } 2019-11-28T11:41:08.792 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:41:08.793 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:41:08.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:41:08.793 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:41:08.865 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:41:08.866 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:41:09.139 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:41:09.140 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:41:09.257 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:41:09.257 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:41:09.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:41:09.259 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:41:09.345 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:41:09.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.443+0000 7fa022cda700 1 Processor -- start 2019-11-28T11:41:09.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.443+0000 7fa022cda700 1 -- start start 2019-11-28T11:41:09.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.444+0000 7fa022cda700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa01c06c0a0 0x7fa01c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:09.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.444+0000 7fa022cda700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa01c0734e0 0x7fa01c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:09.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.444+0000 7fa022cda700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa01c072360 0x7fa01c0727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:09.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.444+0000 7fa022cda700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01c06f330 con 0x7fa01c072360 2019-11-28T11:41:09.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.444+0000 7fa022cda700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01c0706c0 con 0x7fa01c0734e0 2019-11-28T11:41:09.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.444+0000 7fa022cda700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c070a40 con 0x7fa01c06c0a0 2019-11-28T11:41:09.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.444+0000 7fa021a78700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa01c072360 0x7fa01c0727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:09.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.444+0000 7fa021a78700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa01c072360 0x7fa01c0727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38724/0 (socket says 172.21.15.80:38724) 2019-11-28T11:41:09.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.444+0000 7fa021a78700 1 -- 172.21.15.80:0/1597707422 learned_addr learned my addr 172.21.15.80:0/1597707422 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:09.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.444+0000 7fa020a76700 1 --2- 172.21.15.80:0/1597707422 >> v2:172.21.15.174:3300/0 conn(0x7fa01c0734e0 0x7fa01c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:09.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.444+0000 7fa021277700 1 --2- 172.21.15.80:0/1597707422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa01c06c0a0 0x7fa01c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:09.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.444+0000 7fa021a78700 1 -- 172.21.15.80:0/1597707422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa01c06c0a0 msgr2=0x7fa01c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:09.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa021a78700 1 --2- 172.21.15.80:0/1597707422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa01c06c0a0 0x7fa01c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:09.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa021a78700 1 -- 172.21.15.80:0/1597707422 >> v2:172.21.15.174:3300/0 conn(0x7fa01c0734e0 msgr2=0x7fa01c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:09.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa021a78700 1 --2- 172.21.15.80:0/1597707422 >> v2:172.21.15.174:3300/0 conn(0x7fa01c0734e0 0x7fa01c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:09.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa021a78700 1 -- 172.21.15.80:0/1597707422 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c06db00 con 0x7fa01c072360 2019-11-28T11:41:09.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa021a78700 1 --2- 172.21.15.80:0/1597707422 >> v2:172.21.15.80:3300/0 conn(0x7fa01c072360 0x7fa01c0727e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa01400fab0 tx=0x7fa01400f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa021a78700 1 --2- 172.21.15.80:0/1597707422 >> v2:172.21.15.80:3300/0 conn(0x7fa01c072360 0x7fa01c0727e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa01400fab0 tx=0x7fa01400f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa021a78700 1 --2- 172.21.15.80:0/1597707422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c072360 0x7fa01c0727e0 secure :-1 s=READY pgs=1459 cs=0 l=1 rx=0x7fa01400fab0 tx=0x7fa01400f930).ready entity=mon.0 client_cookie=fbd66f0006ccea75 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:09.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa021a78700 1 --2- 172.21.15.80:0/1597707422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c072360 0x7fa01c0727e0 secure :-1 s=THROTTLE_DONE pgs=1459 cs=0 l=1 rx=0x7fa01400fab0 tx=0x7fa01400f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa01bfff700 1 -- 172.21.15.80:0/1597707422 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa014001460 con 0x7fa01c072360 2019-11-28T11:41:09.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa021a78700 1 --2- 172.21.15.80:0/1597707422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c072360 0x7fa01c0727e0 secure :-1 s=THROTTLE_DONE pgs=1459 cs=0 l=1 rx=0x7fa01400fab0 tx=0x7fa01400f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa021a78700 1 --2- 172.21.15.80:0/1597707422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c072360 0x7fa01c0727e0 secure :-1 s=THROTTLE_DONE pgs=1459 cs=0 l=1 rx=0x7fa01400fab0 tx=0x7fa01400f930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa01bfff700 1 -- 172.21.15.80:0/1597707422 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa014000f10 con 0x7fa01c072360 2019-11-28T11:41:09.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa01bfff700 1 -- 172.21.15.80:0/1597707422 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa014001a40 con 0x7fa01c072360 2019-11-28T11:41:09.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa022cda700 1 -- 172.21.15.80:0/1597707422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c072360 msgr2=0x7fa01c0727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:09.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa022cda700 1 --2- 172.21.15.80:0/1597707422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c072360 0x7fa01c0727e0 secure :-1 s=READY pgs=1459 cs=0 l=1 rx=0x7fa01400fab0 tx=0x7fa01400f930).stop 2019-11-28T11:41:09.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa022cda700 1 -- 172.21.15.80:0/1597707422 shutdown_connections 2019-11-28T11:41:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.445+0000 7fa022cda700 1 --2- 172.21.15.80:0/1597707422 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c072360 0x7fa01c0727e0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.446+0000 7fa022cda700 1 --2- 172.21.15.80:0/1597707422 >> v2:172.21.15.174:3300/0 conn(0x7fa01c0734e0 0x7fa01c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.446+0000 7fa022cda700 1 --2- 172.21.15.80:0/1597707422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa01c06c0a0 0x7fa01c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.446+0000 7fa022cda700 1 -- 172.21.15.80:0/1597707422 shutdown_connections 2019-11-28T11:41:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.446+0000 7fa022cda700 1 -- 172.21.15.80:0/1597707422 wait complete. 2019-11-28T11:41:09.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.446+0000 7fa022cda700 1 -- 172.21.15.80:0/1597707422 >> 172.21.15.80:0/1597707422 conn(0x7fa01c061cf0 msgr2=0x7fa01c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:09.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.448+0000 7fa022cda700 1 Processor -- start 2019-11-28T11:41:09.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.448+0000 7fa022cda700 1 -- start start 2019-11-28T11:41:09.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.449+0000 7fa022cda700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa01c1505b0 0x7fa01c150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:09.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.449+0000 7fa022cda700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa01c150f80 0x7fa01c12ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:09.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.449+0000 7fa022cda700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01c140ae0 con 0x7fa01c142410 2019-11-28T11:41:09.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.449+0000 7fa022cda700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01c139130 con 0x7fa01c1505b0 2019-11-28T11:41:09.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.449+0000 7fa022cda700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c139400 con 0x7fa01c150f80 2019-11-28T11:41:09.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.449+0000 7fa020a76700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa01c1505b0 0x7fa01c150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:09.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.449+0000 7fa020a76700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa01c1505b0 0x7fa01c150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38730/0 (socket says 172.21.15.80:38730) 2019-11-28T11:41:09.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.449+0000 7fa020a76700 1 -- 172.21.15.80:0/2046804276 learned_addr learned my addr 172.21.15.80:0/2046804276 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:09.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.449+0000 7fa021a78700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa01c150f80 0x7fa01c12ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:09.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.449+0000 7fa020a76700 1 -- 172.21.15.80:0/2046804276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa01c150f80 msgr2=0x7fa01c12ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:09.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.449+0000 7fa020a76700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa01c150f80 0x7fa01c12ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:09.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.449+0000 7fa020a76700 1 -- 172.21.15.80:0/2046804276 >> v1:172.21.15.80:6789/0 conn(0x7fa01c142410 legacy=0x7fa01c151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:09.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa020a76700 1 -- 172.21.15.80:0/2046804276 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c139a90 con 0x7fa01c1505b0 2019-11-28T11:41:09.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.449+0000 7fa019ffb700 1 -- 172.21.15.80:0/2046804276 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672942979 0 0) 0x7fa00c000c90 con 0x7fa01c142410 2019-11-28T11:41:09.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa021a78700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa01c150f80 0x7fa01c12ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:41:09.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa020a76700 1 --2- 172.21.15.80:0/2046804276 >> v2:172.21.15.80:3300/0 conn(0x7fa01c1505b0 0x7fa01c150a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa010010400 tx=0x7fa0100107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa020a76700 1 --2- 172.21.15.80:0/2046804276 >> v2:172.21.15.80:3300/0 conn(0x7fa01c1505b0 0x7fa01c150a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa010010400 tx=0x7fa0100107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa020a76700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c1505b0 0x7fa01c150a40 secure :-1 s=READY pgs=1461 cs=0 l=1 rx=0x7fa010010400 tx=0x7fa0100107a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:09.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa020a76700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c1505b0 0x7fa01c150a40 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7fa010010400 tx=0x7fa0100107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa019ffb700 1 -- 172.21.15.80:0/2046804276 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa010000960 con 0x7fa01c1505b0 2019-11-28T11:41:09.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa020a76700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c1505b0 0x7fa01c150a40 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7fa010010400 tx=0x7fa0100107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa019ffb700 1 -- 172.21.15.80:0/2046804276 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa010000ea0 con 0x7fa01c1505b0 2019-11-28T11:41:09.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa020a76700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c1505b0 0x7fa01c150a40 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7fa010010400 tx=0x7fa0100107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa022cda700 1 -- 172.21.15.80:0/2046804276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01c139e10 con 0x7fa01c1505b0 2019-11-28T11:41:09.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa019ffb700 1 -- 172.21.15.80:0/2046804276 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0100075f0 con 0x7fa01c1505b0 2019-11-28T11:41:09.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa022cda700 1 -- 172.21.15.80:0/2046804276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01c138ba0 con 0x7fa01c1505b0 2019-11-28T11:41:09.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa020a76700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c1505b0 0x7fa01c150a40 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7fa010010400 tx=0x7fa0100107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa019ffb700 1 -- 172.21.15.80:0/2046804276 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa010001090 con 0x7fa01c1505b0 2019-11-28T11:41:09.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa020a76700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c1505b0 0x7fa01c150a40 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7fa010010400 tx=0x7fa0100107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.450+0000 7fa019ffb700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ffc018730 0x7f9ffc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:09.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.451+0000 7fa019ffb700 1 -- 172.21.15.80:0/2046804276 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa010031a40 con 0x7fa01c1505b0 2019-11-28T11:41:09.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.451+0000 7fa021277700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ffc018730 0x7f9ffc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:09.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.451+0000 7fa021277700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ffc018730 0x7f9ffc01abc0 crc :-1 s=READY pgs=594 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:09.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.458+0000 7fa022cda700 1 -- 172.21.15.80:0/2046804276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01c139a90 con 0x7fa01c1505b0 2019-11-28T11:41:09.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.462+0000 7fa020a76700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c1505b0 0x7fa01c150a40 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7fa010010400 tx=0x7fa0100107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.462+0000 7fa019ffb700 1 -- 172.21.15.80:0/2046804276 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa010000c90 con 0x7fa01c1505b0 2019-11-28T11:41:09.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.637+0000 7fa022cda700 1 -- 172.21.15.80:0/2046804276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa01c139e10 con 0x7fa01c1505b0 2019-11-28T11:41:09.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.637+0000 7fa020a76700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c1505b0 0x7fa01c150a40 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7fa010010400 tx=0x7fa0100107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.637+0000 7fa019ffb700 1 -- 172.21.15.80:0/2046804276 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+14870 (secure 0 0 0) 0x7fa010001090 con 0x7fa01c1505b0 2019-11-28T11:41:09.670 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:09.670 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":107,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:41:03.124379+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:41:00.409798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2019-11-28T11:41:01.100729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:41:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.639+0000 7fa022cda700 1 -- 172.21.15.80:0/2046804276 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ffc018730 msgr2=0x7f9ffc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.639+0000 7fa022cda700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ffc018730 0x7f9ffc01abc0 crc :-1 s=READY pgs=594 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.639+0000 7fa022cda700 1 -- 172.21.15.80:0/2046804276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c1505b0 msgr2=0x7fa01c150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.639+0000 7fa022cda700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c1505b0 0x7fa01c150a40 secure :-1 s=READY pgs=1461 cs=0 l=1 rx=0x7fa010010400 tx=0x7fa0100107a0).stop 2019-11-28T11:41:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.640+0000 7fa022cda700 1 -- 172.21.15.80:0/2046804276 shutdown_connections 2019-11-28T11:41:09.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.640+0000 7fa022cda700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ffc018730 0x7f9ffc01abc0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:09.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.640+0000 7fa022cda700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa01c150f80 0x7fa01c12ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:09.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.640+0000 7fa022cda700 1 --2- 172.21.15.80:0/2046804276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa01c1505b0 0x7fa01c150a40 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:09.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.640+0000 7fa022cda700 1 -- 172.21.15.80:0/2046804276 shutdown_connections 2019-11-28T11:41:09.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.640+0000 7fa022cda700 1 -- 172.21.15.80:0/2046804276 wait complete. 2019-11-28T11:41:09.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.640+0000 7fa022cda700 1 -- 172.21.15.80:0/2046804276 >> 172.21.15.80:0/2046804276 conn(0x7fa01c13d930 msgr2=0x7fa01c1415c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:09.682 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:41:00.409798+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 16, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'106', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:41:01.100729+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 17, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'107', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:41:09.683 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:41:09.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.775+0000 7fed80a5d700 1 Processor -- start 2019-11-28T11:41:09.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.775+0000 7fed80a5d700 1 -- start start 2019-11-28T11:41:09.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.776+0000 7fed80a5d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7c15f100 0x7fed7c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:09.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.776+0000 7fed80a5d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fed7c06c2f0 0x7fed7c06c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:09.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.776+0000 7fed80a5d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed7c06db60 con 0x7fed7c15ed10 2019-11-28T11:41:09.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.776+0000 7fed80a5d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7c06fe00 con 0x7fed7c06c2f0 2019-11-28T11:41:09.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed80a5d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c0700d0 con 0x7fed7c15f100 2019-11-28T11:41:09.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed7ad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fed7c15ed10 0x7fed7c073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38052/0 (socket says 172.21.15.80:38052) 2019-11-28T11:41:09.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed7ad9d700 1 -- 172.21.15.80:0/2057334219 learned_addr learned my addr 172.21.15.80:0/2057334219 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:09.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed7a59c700 1 --2- 172.21.15.80:0/2057334219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7c15f100 0x7fed7c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:09.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed7b59e700 1 --2- 172.21.15.80:0/2057334219 >> v2:172.21.15.174:3300/0 conn(0x7fed7c06c2f0 0x7fed7c06c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:09.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed79d9b700 1 -- 172.21.15.80:0/2057334219 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874818554 0 0) 0x7fed640014d0 con 0x7fed7c15ed10 2019-11-28T11:41:09.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed79d9b700 1 -- 172.21.15.80:0/2057334219 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed5c002e80 con 0x7fed7c15ed10 2019-11-28T11:41:09.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed7b59e700 1 -- 172.21.15.80:0/2057334219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7c15f100 msgr2=0x7fed7c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:09.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed7b59e700 1 --2- 172.21.15.80:0/2057334219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7c15f100 0x7fed7c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:09.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed79d9b700 1 -- 172.21.15.80:0/2057334219 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1062431250 0 0) 0x7fed640014b0 con 0x7fed7c15ed10 2019-11-28T11:41:09.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed7b59e700 1 -- 172.21.15.80:0/2057334219 >> v1:172.21.15.80:6789/0 conn(0x7fed7c15ed10 legacy=0x7fed7c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:09.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed7b59e700 1 -- 172.21.15.80:0/2057334219 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7c070760 con 0x7fed7c06c2f0 2019-11-28T11:41:09.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed7a59c700 1 --2- 172.21.15.80:0/2057334219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7c15f100 0x7fed7c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:09.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed7b59e700 1 --2- 172.21.15.80:0/2057334219 >> v2:172.21.15.174:3300/0 conn(0x7fed7c06c2f0 0x7fed7c06c790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fed7400af80 tx=0x7fed7400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed7b59e700 1 --2- 172.21.15.80:0/2057334219 >> v2:172.21.15.174:3300/0 conn(0x7fed7c06c2f0 0x7fed7c06c790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fed7400af80 tx=0x7fed7400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed7b59e700 1 --2- 172.21.15.80:0/2057334219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed7c06c2f0 0x7fed7c06c790 secure :-1 s=READY pgs=849 cs=0 l=1 rx=0x7fed7400af80 tx=0x7fed7400b790).ready entity=mon.1 client_cookie=34cca9027da5dbae server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:09.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed7b59e700 1 --2- 172.21.15.80:0/2057334219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed7c06c2f0 0x7fed7c06c790 secure :-1 s=THROTTLE_DONE pgs=849 cs=0 l=1 rx=0x7fed7400af80 tx=0x7fed7400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed79d9b700 1 -- 172.21.15.80:0/2057334219 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed74000bc0 con 0x7fed7c06c2f0 2019-11-28T11:41:09.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.777+0000 7fed7b59e700 1 --2- 172.21.15.80:0/2057334219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed7c06c2f0 0x7fed7c06c790 secure :-1 s=THROTTLE_DONE pgs=849 cs=0 l=1 rx=0x7fed7400af80 tx=0x7fed7400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.778+0000 7fed7b59e700 1 --2- 172.21.15.80:0/2057334219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed7c06c2f0 0x7fed7c06c790 secure :-1 s=THROTTLE_DONE pgs=849 cs=0 l=1 rx=0x7fed7400af80 tx=0x7fed7400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.778+0000 7fed79d9b700 1 -- 172.21.15.80:0/2057334219 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed740097f0 con 0x7fed7c06c2f0 2019-11-28T11:41:09.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.778+0000 7fed79d9b700 1 -- 172.21.15.80:0/2057334219 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed74009ec0 con 0x7fed7c06c2f0 2019-11-28T11:41:09.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.778+0000 7fed80a5d700 1 -- 172.21.15.80:0/2057334219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed7c06c2f0 msgr2=0x7fed7c06c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:09.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.778+0000 7fed80a5d700 1 --2- 172.21.15.80:0/2057334219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed7c06c2f0 0x7fed7c06c790 secure :-1 s=READY pgs=849 cs=0 l=1 rx=0x7fed7400af80 tx=0x7fed7400b790).stop 2019-11-28T11:41:09.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.778+0000 7fed80a5d700 1 -- 172.21.15.80:0/2057334219 shutdown_connections 2019-11-28T11:41:09.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.778+0000 7fed80a5d700 1 --2- 172.21.15.80:0/2057334219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed7c06c2f0 0x7fed7c06c790 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:09.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.778+0000 7fed80a5d700 1 --2- 172.21.15.80:0/2057334219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7c15f100 0x7fed7c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:09.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.778+0000 7fed80a5d700 1 -- 172.21.15.80:0/2057334219 shutdown_connections 2019-11-28T11:41:09.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.778+0000 7fed80a5d700 1 -- 172.21.15.80:0/2057334219 wait complete. 2019-11-28T11:41:09.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.778+0000 7fed80a5d700 1 -- 172.21.15.80:0/2057334219 >> 172.21.15.80:0/2057334219 conn(0x7fed7c061d20 msgr2=0x7fed7c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:09.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.781+0000 7fed80a5d700 1 Processor -- start 2019-11-28T11:41:09.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.781+0000 7fed80a5d700 1 -- start start 2019-11-28T11:41:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed80a5d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed7c10e970 0x7fed7c1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:09.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed80a5d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7c108cf0 0x7fed7c107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed80a5d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed7c10c250 con 0x7fed7c107b70 2019-11-28T11:41:09.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed80a5d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7c10e430 con 0x7fed7c10e970 2019-11-28T11:41:09.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed80a5d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c105860 con 0x7fed7c108cf0 2019-11-28T11:41:09.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed7ad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed7c10e970 0x7fed7c1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:09.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed7ad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fed7c10e970 0x7fed7c1087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38742/0 (socket says 172.21.15.80:38742) 2019-11-28T11:41:09.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed7ad9d700 1 -- 172.21.15.80:0/163814819 learned_addr learned my addr 172.21.15.80:0/163814819 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:09.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed7a59c700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7c108cf0 0x7fed7c107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:09.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed7ad9d700 1 -- 172.21.15.80:0/163814819 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7c108cf0 msgr2=0x7fed7c107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:09.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed7ad9d700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7c108cf0 0x7fed7c107630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:09.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed7ad9d700 1 -- 172.21.15.80:0/163814819 >> v1:172.21.15.174:6789/0 conn(0x7fed7c107b70 legacy=0x7fed7c10ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:09.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed7ad9d700 1 -- 172.21.15.80:0/163814819 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7c105ef0 con 0x7fed7c10e970 2019-11-28T11:41:09.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed737fe700 1 -- 172.21.15.80:0/163814819 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634727633 0 0) 0x7fed740095b0 con 0x7fed7c107b70 2019-11-28T11:41:09.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed7a59c700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7c108cf0 0x7fed7c107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed7ad9d700 1 --2- 172.21.15.80:0/163814819 >> v2:172.21.15.80:3300/0 conn(0x7fed7c10e970 0x7fed7c1087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fed64010790 tx=0x7fed64010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed7ad9d700 1 --2- 172.21.15.80:0/163814819 >> v2:172.21.15.80:3300/0 conn(0x7fed7c10e970 0x7fed7c1087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fed64010790 tx=0x7fed64010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed7ad9d700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c10e970 0x7fed7c1087b0 secure :-1 s=READY pgs=1463 cs=0 l=1 rx=0x7fed64010790 tx=0x7fed64010b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed7ad9d700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c10e970 0x7fed7c1087b0 secure :-1 s=THROTTLE_DONE pgs=1463 cs=0 l=1 rx=0x7fed64010790 tx=0x7fed64010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed737fe700 1 -- 172.21.15.80:0/163814819 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed64001010 con 0x7fed7c10e970 2019-11-28T11:41:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed7ad9d700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c10e970 0x7fed7c1087b0 secure :-1 s=THROTTLE_DONE pgs=1463 cs=0 l=1 rx=0x7fed64010790 tx=0x7fed64010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed737fe700 1 -- 172.21.15.80:0/163814819 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed64001440 con 0x7fed7c10e970 2019-11-28T11:41:09.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed7ad9d700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c10e970 0x7fed7c1087b0 secure :-1 s=THROTTLE_DONE pgs=1463 cs=0 l=1 rx=0x7fed64010790 tx=0x7fed64010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed80a5d700 1 -- 172.21.15.80:0/163814819 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7c106270 con 0x7fed7c10e970 2019-11-28T11:41:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed737fe700 1 -- 172.21.15.80:0/163814819 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed64001210 con 0x7fed7c10e970 2019-11-28T11:41:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.782+0000 7fed80a5d700 1 -- 172.21.15.80:0/163814819 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7c105ef0 con 0x7fed7c10e970 2019-11-28T11:41:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.783+0000 7fed7ad9d700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c10e970 0x7fed7c1087b0 secure :-1 s=THROTTLE_DONE pgs=1463 cs=0 l=1 rx=0x7fed64010790 tx=0x7fed64010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.783+0000 7fed737fe700 1 -- 172.21.15.80:0/163814819 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fed64001010 con 0x7fed7c10e970 2019-11-28T11:41:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.783+0000 7fed7ad9d700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c10e970 0x7fed7c1087b0 secure :-1 s=THROTTLE_DONE pgs=1463 cs=0 l=1 rx=0x7fed64010790 tx=0x7fed64010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.783+0000 7fed737fe700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed54018730 0x7fed5401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.783+0000 7fed737fe700 1 -- 172.21.15.80:0/163814819 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fed64031e50 con 0x7fed7c10e970 2019-11-28T11:41:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.783+0000 7fed7a59c700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed54018730 0x7fed5401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.784+0000 7fed7a59c700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed54018730 0x7fed5401abc0 crc :-1 s=READY pgs=595 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:09.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.791+0000 7fed80a5d700 1 -- 172.21.15.80:0/163814819 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7c106270 con 0x7fed7c10e970 2019-11-28T11:41:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.794+0000 7fed7ad9d700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c10e970 0x7fed7c1087b0 secure :-1 s=THROTTLE_DONE pgs=1463 cs=0 l=1 rx=0x7fed64010790 tx=0x7fed64010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.794+0000 7fed737fe700 1 -- 172.21.15.80:0/163814819 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fed6402df60 con 0x7fed7c10e970 2019-11-28T11:41:09.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.961+0000 7fed80a5d700 1 -- 172.21.15.80:0/163814819 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fed7c105ef0 con 0x7fed7c10e970 2019-11-28T11:41:09.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.961+0000 7fed7ad9d700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c10e970 0x7fed7c1087b0 secure :-1 s=THROTTLE_DONE pgs=1463 cs=0 l=1 rx=0x7fed64010790 tx=0x7fed64010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:09.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.961+0000 7fed737fe700 1 -- 172.21.15.80:0/163814819 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v107) v1 ==== 92+0+10 (secure 0 0 0) 0x7fed6402df60 con 0x7fed7c10e970 2019-11-28T11:41:09.994 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:41:09.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.964+0000 7fed80a5d700 1 -- 172.21.15.80:0/163814819 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed54018730 msgr2=0x7fed5401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:09.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.964+0000 7fed80a5d700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed54018730 0x7fed5401abc0 crc :-1 s=READY pgs=595 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:09.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.964+0000 7fed80a5d700 1 -- 172.21.15.80:0/163814819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c10e970 msgr2=0x7fed7c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:09.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.964+0000 7fed80a5d700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c10e970 0x7fed7c1087b0 secure :-1 s=READY pgs=1463 cs=0 l=1 rx=0x7fed64010790 tx=0x7fed64010b30).stop 2019-11-28T11:41:09.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.964+0000 7fed80a5d700 1 -- 172.21.15.80:0/163814819 shutdown_connections 2019-11-28T11:41:09.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.964+0000 7fed80a5d700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fed54018730 0x7fed5401abc0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:09.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.964+0000 7fed80a5d700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fed7c108cf0 0x7fed7c107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:09.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.964+0000 7fed80a5d700 1 --2- 172.21.15.80:0/163814819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed7c10e970 0x7fed7c1087b0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:09.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.964+0000 7fed80a5d700 1 -- 172.21.15.80:0/163814819 shutdown_connections 2019-11-28T11:41:09.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.964+0000 7fed80a5d700 1 -- 172.21.15.80:0/163814819 wait complete. 2019-11-28T11:41:09.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:09.964+0000 7fed80a5d700 1 -- 172.21.15.80:0/163814819 >> 172.21.15.80:0/163814819 conn(0x7fed7c15e2d0 msgr2=0x7fed7c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:10.005 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:41:10.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.106+0000 7f6742afc700 1 Processor -- start 2019-11-28T11:41:10.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.106+0000 7f6742afc700 1 -- start start 2019-11-28T11:41:10.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.107+0000 7f6742afc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f673c15f100 0x7f673c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:10.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.107+0000 7f6742afc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f673c06c2f0 0x7f673c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:10.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.107+0000 7f6742afc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673c06db60 con 0x7f673c15ed10 2019-11-28T11:41:10.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.107+0000 7f6742afc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673c06fe00 con 0x7f673c06c2f0 2019-11-28T11:41:10.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.107+0000 7f6742afc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673c0700d0 con 0x7f673c15f100 2019-11-28T11:41:10.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.107+0000 7f674189a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f673c06c2f0 0x7f673c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:10.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.107+0000 7f674189a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f673c06c2f0 0x7f673c06c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38752/0 (socket says 172.21.15.80:38752) 2019-11-28T11:41:10.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.107+0000 7f674189a700 1 -- 172.21.15.80:0/365747536 learned_addr learned my addr 172.21.15.80:0/365747536 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:10.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.107+0000 7f6740898700 1 --2- 172.21.15.80:0/365747536 >> v2:172.21.15.174:3300/0 conn(0x7f673c15f100 0x7f673c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:10.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f674189a700 1 -- 172.21.15.80:0/365747536 >> v2:172.21.15.174:3300/0 conn(0x7f673c15f100 msgr2=0x7f673c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:10.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f674189a700 1 --2- 172.21.15.80:0/365747536 >> v2:172.21.15.174:3300/0 conn(0x7f673c15f100 0x7f673c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:10.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f674189a700 1 -- 172.21.15.80:0/365747536 >> v1:172.21.15.80:6789/0 conn(0x7f673c15ed10 legacy=0x7f673c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f673bfff700 1 -- 172.21.15.80:0/365747536 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910599398 0 0) 0x7f672c001100 con 0x7f673c15ed10 2019-11-28T11:41:10.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f674189a700 1 -- 172.21.15.80:0/365747536 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673c070760 con 0x7f673c06c2f0 2019-11-28T11:41:10.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f6740898700 1 --2- 172.21.15.80:0/365747536 >> v2:172.21.15.174:3300/0 conn(0x7f673c15f100 0x7f673c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:41:10.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f674189a700 1 --2- 172.21.15.80:0/365747536 >> v2:172.21.15.80:3300/0 conn(0x7f673c06c2f0 0x7f673c06c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f673400f730 tx=0x7f673400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f674189a700 1 --2- 172.21.15.80:0/365747536 >> v2:172.21.15.80:3300/0 conn(0x7f673c06c2f0 0x7f673c06c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f673400f730 tx=0x7f673400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f674189a700 1 --2- 172.21.15.80:0/365747536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c06c2f0 0x7f673c06c770 secure :-1 s=READY pgs=1465 cs=0 l=1 rx=0x7f673400f730 tx=0x7f673400fad0).ready entity=mon.0 client_cookie=fae0412a462f6942 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:10.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f674189a700 1 --2- 172.21.15.80:0/365747536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c06c2f0 0x7f673c06c770 secure :-1 s=THROTTLE_DONE pgs=1465 cs=0 l=1 rx=0x7f673400f730 tx=0x7f673400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f673bfff700 1 -- 172.21.15.80:0/365747536 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6734000b90 con 0x7f673c06c2f0 2019-11-28T11:41:10.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f674189a700 1 --2- 172.21.15.80:0/365747536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c06c2f0 0x7f673c06c770 secure :-1 s=THROTTLE_DONE pgs=1465 cs=0 l=1 rx=0x7f673400f730 tx=0x7f673400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f674189a700 1 --2- 172.21.15.80:0/365747536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c06c2f0 0x7f673c06c770 secure :-1 s=THROTTLE_DONE pgs=1465 cs=0 l=1 rx=0x7f673400f730 tx=0x7f673400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f673bfff700 1 -- 172.21.15.80:0/365747536 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6734000b90 con 0x7f673c06c2f0 2019-11-28T11:41:10.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f673bfff700 1 -- 172.21.15.80:0/365747536 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67340012d0 con 0x7f673c06c2f0 2019-11-28T11:41:10.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f6742afc700 1 -- 172.21.15.80:0/365747536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c06c2f0 msgr2=0x7f673c06c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.108+0000 7f6742afc700 1 --2- 172.21.15.80:0/365747536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c06c2f0 0x7f673c06c770 secure :-1 s=READY pgs=1465 cs=0 l=1 rx=0x7f673400f730 tx=0x7f673400fad0).stop 2019-11-28T11:41:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.109+0000 7f6742afc700 1 -- 172.21.15.80:0/365747536 shutdown_connections 2019-11-28T11:41:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.109+0000 7f6742afc700 1 --2- 172.21.15.80:0/365747536 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c06c2f0 0x7f673c06c770 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.109+0000 7f6742afc700 1 --2- 172.21.15.80:0/365747536 >> v2:172.21.15.174:3300/0 conn(0x7f673c15f100 0x7f673c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.109+0000 7f6742afc700 1 -- 172.21.15.80:0/365747536 shutdown_connections 2019-11-28T11:41:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.109+0000 7f6742afc700 1 -- 172.21.15.80:0/365747536 wait complete. 2019-11-28T11:41:10.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.109+0000 7f6742afc700 1 -- 172.21.15.80:0/365747536 >> 172.21.15.80:0/365747536 conn(0x7f673c061d20 msgr2=0x7f673c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:10.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.111+0000 7f6742afc700 1 Processor -- start 2019-11-28T11:41:10.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.111+0000 7f6742afc700 1 -- start start 2019-11-28T11:41:10.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.112+0000 7f6742afc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f673c10e970 0x7f673c1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:10.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.112+0000 7f6742afc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673c107e30 0x7f673c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:10.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.112+0000 7f6742afc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673c10c250 con 0x7f673c108cf0 2019-11-28T11:41:10.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.112+0000 7f6742afc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673c10e430 con 0x7f673c10e970 2019-11-28T11:41:10.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.112+0000 7f6742afc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c105860 con 0x7f673c107e30 2019-11-28T11:41:10.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.112+0000 7f6741099700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f673c10e970 0x7f673c1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:10.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.112+0000 7f6741099700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f673c10e970 0x7f673c1087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38756/0 (socket says 172.21.15.80:38756) 2019-11-28T11:41:10.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.112+0000 7f6741099700 1 -- 172.21.15.80:0/2583089990 learned_addr learned my addr 172.21.15.80:0/2583089990 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:10.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f674189a700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673c107e30 0x7f673c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:10.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f6741099700 1 -- 172.21.15.80:0/2583089990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673c107e30 msgr2=0x7f673c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f6741099700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673c107e30 0x7f673c167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f6741099700 1 -- 172.21.15.80:0/2583089990 >> v1:172.21.15.174:6789/0 conn(0x7f673c108cf0 legacy=0x7f673c107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f6741099700 1 -- 172.21.15.80:0/2583089990 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673c105ef0 con 0x7f673c10e970 2019-11-28T11:41:10.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f674189a700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673c107e30 0x7f673c167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:41:10.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f6741099700 1 --2- 172.21.15.80:0/2583089990 >> v2:172.21.15.80:3300/0 conn(0x7f673c10e970 0x7f673c1087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f672c010450 tx=0x7f672c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f6741099700 1 --2- 172.21.15.80:0/2583089990 >> v2:172.21.15.80:3300/0 conn(0x7f673c10e970 0x7f673c1087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f672c010450 tx=0x7f672c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f6741099700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c10e970 0x7f673c1087b0 secure :-1 s=READY pgs=1466 cs=0 l=1 rx=0x7f672c010450 tx=0x7f672c0107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:10.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f6741099700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c10e970 0x7f673c1087b0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7f672c010450 tx=0x7f672c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f6741099700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c10e970 0x7f673c1087b0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7f672c010450 tx=0x7f672c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f6739ffb700 1 -- 172.21.15.80:0/2583089990 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f672c000cc0 con 0x7f673c10e970 2019-11-28T11:41:10.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f6741099700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c10e970 0x7f673c1087b0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7f672c010450 tx=0x7f672c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f6739ffb700 1 -- 172.21.15.80:0/2583089990 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c00ee80 con 0x7f673c10e970 2019-11-28T11:41:10.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f6742afc700 1 -- 172.21.15.80:0/2583089990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673c106270 con 0x7f673c10e970 2019-11-28T11:41:10.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f6739ffb700 1 -- 172.21.15.80:0/2583089990 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f672c00f550 con 0x7f673c10e970 2019-11-28T11:41:10.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f6742afc700 1 -- 172.21.15.80:0/2583089990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673c105ef0 con 0x7f673c10e970 2019-11-28T11:41:10.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.113+0000 7f6741099700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c10e970 0x7f673c1087b0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7f672c010450 tx=0x7f672c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.114+0000 7f6739ffb700 1 -- 172.21.15.80:0/2583089990 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f672c00f070 con 0x7f673c10e970 2019-11-28T11:41:10.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.114+0000 7f6741099700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c10e970 0x7f673c1087b0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7f672c010450 tx=0x7f672c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.114+0000 7f6739ffb700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6720018730 0x7f672001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:10.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.114+0000 7f6739ffb700 1 -- 172.21.15.80:0/2583089990 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f672c031ab0 con 0x7f673c10e970 2019-11-28T11:41:10.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.114+0000 7f6740898700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6720018730 0x7f672001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:10.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.114+0000 7f6740898700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6720018730 0x7f672001abc0 crc :-1 s=READY pgs=596 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:10.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.121+0000 7f6742afc700 1 -- 172.21.15.80:0/2583089990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673c106270 con 0x7f673c10e970 2019-11-28T11:41:10.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.125+0000 7f6741099700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c10e970 0x7f673c1087b0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7f672c010450 tx=0x7f672c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.125+0000 7f6739ffb700 1 -- 172.21.15.80:0/2583089990 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f672c00f280 con 0x7f673c10e970 2019-11-28T11:41:10.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.292+0000 7f6742afc700 1 -- 172.21.15.80:0/2583089990 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f673c105ef0 con 0x7f673c10e970 2019-11-28T11:41:10.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.292+0000 7f6741099700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c10e970 0x7f673c1087b0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7f672c010450 tx=0x7f672c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.292+0000 7f6739ffb700 1 -- 172.21.15.80:0/2583089990 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v107) v1 ==== 104+0+10 (secure 0 0 0) 0x7f672c00f070 con 0x7f673c10e970 2019-11-28T11:41:10.325 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:41:10.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.294+0000 7f6742afc700 1 -- 172.21.15.80:0/2583089990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6720018730 msgr2=0x7f672001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.294+0000 7f6742afc700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6720018730 0x7f672001abc0 crc :-1 s=READY pgs=596 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.294+0000 7f6742afc700 1 -- 172.21.15.80:0/2583089990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c10e970 msgr2=0x7f673c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.294+0000 7f6742afc700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c10e970 0x7f673c1087b0 secure :-1 s=READY pgs=1466 cs=0 l=1 rx=0x7f672c010450 tx=0x7f672c0107f0).stop 2019-11-28T11:41:10.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.295+0000 7f6742afc700 1 -- 172.21.15.80:0/2583089990 shutdown_connections 2019-11-28T11:41:10.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.295+0000 7f6742afc700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f673c107e30 0x7f673c167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.295+0000 7f6742afc700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6720018730 0x7f672001abc0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.295+0000 7f6742afc700 1 --2- 172.21.15.80:0/2583089990 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673c10e970 0x7f673c1087b0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.295+0000 7f6742afc700 1 -- 172.21.15.80:0/2583089990 shutdown_connections 2019-11-28T11:41:10.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.295+0000 7f6742afc700 1 -- 172.21.15.80:0/2583089990 wait complete. 2019-11-28T11:41:10.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.295+0000 7f6742afc700 1 -- 172.21.15.80:0/2583089990 >> 172.21.15.80:0/2583089990 conn(0x7f673c15e2d0 msgr2=0x7f673c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:10.337 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:41:10.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.427+0000 7fab64ec6700 1 Processor -- start 2019-11-28T11:41:10.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.427+0000 7fab64ec6700 1 -- start start 2019-11-28T11:41:10.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab64ec6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab6015f100 0x7fab6006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:10.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab64ec6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab6006c2f0 0x7fab6006c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:10.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab64ec6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6006db60 con 0x7fab6015ed10 2019-11-28T11:41:10.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab64ec6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6006fe00 con 0x7fab6006c2f0 2019-11-28T11:41:10.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab64ec6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab600700d0 con 0x7fab6015f100 2019-11-28T11:41:10.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab6006c2f0 0x7fab6006c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:10.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fab6015ed10 0x7fab60073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38080/0 (socket says 172.21.15.80:38080) 2019-11-28T11:41:10.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5ed9d700 1 -- 172.21.15.80:0/1618430508 learned_addr learned my addr 172.21.15.80:0/1618430508 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:10.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5e59c700 1 --2- 172.21.15.80:0/1618430508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab6015f100 0x7fab6006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:10.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5f59e700 1 -- 172.21.15.80:0/1618430508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab6015f100 msgr2=0x7fab6006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:10.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5f59e700 1 --2- 172.21.15.80:0/1618430508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab6015f100 0x7fab6006bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:10.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5f59e700 1 -- 172.21.15.80:0/1618430508 >> v1:172.21.15.80:6789/0 conn(0x7fab6015ed10 legacy=0x7fab60073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5f59e700 1 -- 172.21.15.80:0/1618430508 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab60070760 con 0x7fab6006c2f0 2019-11-28T11:41:10.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5dd9b700 1 -- 172.21.15.80:0/1618430508 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301630661 0 0) 0x7fab480014d0 con 0x7fab6015ed10 2019-11-28T11:41:10.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5e59c700 1 --2- 172.21.15.80:0/1618430508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab6015f100 0x7fab6006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:41:10.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5f59e700 1 --2- 172.21.15.80:0/1618430508 >> v2:172.21.15.80:3300/0 conn(0x7fab6006c2f0 0x7fab6006c790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fab5800af50 tx=0x7fab5800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5f59e700 1 --2- 172.21.15.80:0/1618430508 >> v2:172.21.15.80:3300/0 conn(0x7fab6006c2f0 0x7fab6006c790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fab5800af50 tx=0x7fab5800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5f59e700 1 --2- 172.21.15.80:0/1618430508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6006c2f0 0x7fab6006c790 secure :-1 s=READY pgs=1468 cs=0 l=1 rx=0x7fab5800af50 tx=0x7fab5800b760).ready entity=mon.0 client_cookie=d71cedf9fc27a8c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:10.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5f59e700 1 --2- 172.21.15.80:0/1618430508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6006c2f0 0x7fab6006c790 secure :-1 s=THROTTLE_DONE pgs=1468 cs=0 l=1 rx=0x7fab5800af50 tx=0x7fab5800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5dd9b700 1 -- 172.21.15.80:0/1618430508 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab58009ba0 con 0x7fab6006c2f0 2019-11-28T11:41:10.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5f59e700 1 --2- 172.21.15.80:0/1618430508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6006c2f0 0x7fab6006c790 secure :-1 s=THROTTLE_DONE pgs=1468 cs=0 l=1 rx=0x7fab5800af50 tx=0x7fab5800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5f59e700 1 --2- 172.21.15.80:0/1618430508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6006c2f0 0x7fab6006c790 secure :-1 s=THROTTLE_DONE pgs=1468 cs=0 l=1 rx=0x7fab5800af50 tx=0x7fab5800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5dd9b700 1 -- 172.21.15.80:0/1618430508 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab580097c0 con 0x7fab6006c2f0 2019-11-28T11:41:10.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab5dd9b700 1 -- 172.21.15.80:0/1618430508 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab58000bc0 con 0x7fab6006c2f0 2019-11-28T11:41:10.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab64ec6700 1 -- 172.21.15.80:0/1618430508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6006c2f0 msgr2=0x7fab6006c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.429+0000 7fab64ec6700 1 --2- 172.21.15.80:0/1618430508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6006c2f0 0x7fab6006c790 secure :-1 s=READY pgs=1468 cs=0 l=1 rx=0x7fab5800af50 tx=0x7fab5800b760).stop 2019-11-28T11:41:10.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.430+0000 7fab64ec6700 1 -- 172.21.15.80:0/1618430508 shutdown_connections 2019-11-28T11:41:10.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.430+0000 7fab64ec6700 1 --2- 172.21.15.80:0/1618430508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6006c2f0 0x7fab6006c790 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.430+0000 7fab64ec6700 1 --2- 172.21.15.80:0/1618430508 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab6015f100 0x7fab6006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:10.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.430+0000 7fab64ec6700 1 -- 172.21.15.80:0/1618430508 shutdown_connections 2019-11-28T11:41:10.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.430+0000 7fab64ec6700 1 -- 172.21.15.80:0/1618430508 wait complete. 2019-11-28T11:41:10.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.430+0000 7fab64ec6700 1 -- 172.21.15.80:0/1618430508 >> 172.21.15.80:0/1618430508 conn(0x7fab60061d20 msgr2=0x7fab600641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:10.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.433+0000 7fab64ec6700 1 Processor -- start 2019-11-28T11:41:10.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.433+0000 7fab64ec6700 1 -- start start 2019-11-28T11:41:10.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.433+0000 7fab64ec6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab6010ed60 0x7fab6010f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:10.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab64ec6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fab6010f730 0x7fab60167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:10.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab64ec6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6010c250 con 0x7fab6010e970 2019-11-28T11:41:10.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab64ec6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6010e430 con 0x7fab6010ed60 2019-11-28T11:41:10.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab64ec6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab60105860 con 0x7fab6010f730 2019-11-28T11:41:10.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab5e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab6010ed60 0x7fab6010f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:10.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab5e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab6010ed60 0x7fab6010f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38774/0 (socket says 172.21.15.80:38774) 2019-11-28T11:41:10.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab5e59c700 1 -- 172.21.15.80:0/2301310492 learned_addr learned my addr 172.21.15.80:0/2301310492 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:10.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab5f59e700 1 --2- 172.21.15.80:0/2301310492 >> v2:172.21.15.174:3300/0 conn(0x7fab6010f730 0x7fab60167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:10.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab5e59c700 1 -- 172.21.15.80:0/2301310492 >> v2:172.21.15.174:3300/0 conn(0x7fab6010f730 msgr2=0x7fab60167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab5e59c700 1 --2- 172.21.15.80:0/2301310492 >> v2:172.21.15.174:3300/0 conn(0x7fab6010f730 0x7fab60167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab5e59c700 1 -- 172.21.15.80:0/2301310492 >> v1:172.21.15.174:6789/0 conn(0x7fab6010e970 legacy=0x7fab601087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab5e59c700 1 -- 172.21.15.80:0/2301310492 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab60105ef0 con 0x7fab6010ed60 2019-11-28T11:41:10.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab5e59c700 1 --2- 172.21.15.80:0/2301310492 >> v2:172.21.15.80:3300/0 conn(0x7fab6010ed60 0x7fab6010f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab50010430 tx=0x7fab500102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab5e59c700 1 --2- 172.21.15.80:0/2301310492 >> v2:172.21.15.80:3300/0 conn(0x7fab6010ed60 0x7fab6010f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab50010430 tx=0x7fab500102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab5e59c700 1 --2- 172.21.15.80:0/2301310492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6010ed60 0x7fab6010f1f0 secure :-1 s=READY pgs=1469 cs=0 l=1 rx=0x7fab50010430 tx=0x7fab500102b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:10.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab5e59c700 1 --2- 172.21.15.80:0/2301310492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6010ed60 0x7fab6010f1f0 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7fab50010430 tx=0x7fab500102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab5e59c700 1 --2- 172.21.15.80:0/2301310492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6010ed60 0x7fab6010f1f0 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7fab50010430 tx=0x7fab500102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab577fe700 1 -- 172.21.15.80:0/2301310492 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab500094b0 con 0x7fab6010ed60 2019-11-28T11:41:10.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab5e59c700 1 --2- 172.21.15.80:0/2301310492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6010ed60 0x7fab6010f1f0 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7fab50010430 tx=0x7fab500102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab577fe700 1 -- 172.21.15.80:0/2301310492 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab500096b0 con 0x7fab6010ed60 2019-11-28T11:41:10.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab64ec6700 1 -- 172.21.15.80:0/2301310492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab60106270 con 0x7fab6010ed60 2019-11-28T11:41:10.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab577fe700 1 -- 172.21.15.80:0/2301310492 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab500012d0 con 0x7fab6010ed60 2019-11-28T11:41:10.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.434+0000 7fab64ec6700 1 -- 172.21.15.80:0/2301310492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab60105ef0 con 0x7fab6010ed60 2019-11-28T11:41:10.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.435+0000 7fab5e59c700 1 --2- 172.21.15.80:0/2301310492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6010ed60 0x7fab6010f1f0 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7fab50010430 tx=0x7fab500102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.435+0000 7fab577fe700 1 -- 172.21.15.80:0/2301310492 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fab50000bc0 con 0x7fab6010ed60 2019-11-28T11:41:10.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.435+0000 7fab5e59c700 1 --2- 172.21.15.80:0/2301310492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6010ed60 0x7fab6010f1f0 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7fab50010430 tx=0x7fab500102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.435+0000 7fab577fe700 1 --2- 172.21.15.80:0/2301310492 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab38018730 0x7fab3801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:10.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.435+0000 7fab577fe700 1 -- 172.21.15.80:0/2301310492 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fab50031a80 con 0x7fab6010ed60 2019-11-28T11:41:10.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.435+0000 7fab5ed9d700 1 --2- 172.21.15.80:0/2301310492 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab38018730 0x7fab3801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:10.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.435+0000 7fab5ed9d700 1 --2- 172.21.15.80:0/2301310492 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab38018730 0x7fab3801abc0 crc :-1 s=READY pgs=597 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:10.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.443+0000 7fab64ec6700 1 -- 172.21.15.80:0/2301310492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab60106270 con 0x7fab6010ed60 2019-11-28T11:41:10.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.447+0000 7fab5e59c700 1 --2- 172.21.15.80:0/2301310492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6010ed60 0x7fab6010f1f0 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7fab50010430 tx=0x7fab500102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.447+0000 7fab577fe700 1 -- 172.21.15.80:0/2301310492 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fab50000990 con 0x7fab6010ed60 2019-11-28T11:41:10.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.612+0000 7fab64ec6700 1 -- 172.21.15.80:0/2301310492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fab60105ef0 con 0x7fab6010ed60 2019-11-28T11:41:10.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.613+0000 7fab5e59c700 1 --2- 172.21.15.80:0/2301310492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6010ed60 0x7fab6010f1f0 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7fab50010430 tx=0x7fab500102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.613+0000 7fab577fe700 1 -- 172.21.15.80:0/2301310492 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v107) v1 ==== 100+0+10 (secure 0 0 0) 0x7fab50009780 con 0x7fab6010ed60 2019-11-28T11:41:10.646 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:41:10.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.615+0000 7fab64ec6700 1 -- 172.21.15.80:0/2301310492 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab38018730 msgr2=0x7fab3801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.615+0000 7fab64ec6700 1 --2- 172.21.15.80:0/2301310492 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab38018730 0x7fab3801abc0 crc :-1 s=READY pgs=597 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.615+0000 7fab64ec6700 1 -- 172.21.15.80:0/2301310492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6010ed60 msgr2=0x7fab6010f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.615+0000 7fab64ec6700 1 --2- 172.21.15.80:0/2301310492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6010ed60 0x7fab6010f1f0 secure :-1 s=READY pgs=1469 cs=0 l=1 rx=0x7fab50010430 tx=0x7fab500102b0).stop 2019-11-28T11:41:10.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.615+0000 7fab64ec6700 1 -- 172.21.15.80:0/2301310492 shutdown_connections 2019-11-28T11:41:10.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.615+0000 7fab64ec6700 1 --2- 172.21.15.80:0/2301310492 >> v2:172.21.15.174:3300/0 conn(0x7fab6010f730 0x7fab60167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.615+0000 7fab64ec6700 1 --2- 172.21.15.80:0/2301310492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab6010ed60 0x7fab6010f1f0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.615+0000 7fab64ec6700 1 --2- 172.21.15.80:0/2301310492 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab38018730 0x7fab3801abc0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.615+0000 7fab64ec6700 1 -- 172.21.15.80:0/2301310492 shutdown_connections 2019-11-28T11:41:10.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.615+0000 7fab64ec6700 1 -- 172.21.15.80:0/2301310492 wait complete. 2019-11-28T11:41:10.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.615+0000 7fab64ec6700 1 -- 172.21.15.80:0/2301310492 >> 172.21.15.80:0/2301310492 conn(0x7fab6015e2d0 msgr2=0x7fab60147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:10.657 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:41:10.658 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:41:10.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.746+0000 7fa805d4c700 1 Processor -- start 2019-11-28T11:41:10.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.746+0000 7fa805d4c700 1 -- start start 2019-11-28T11:41:10.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.747+0000 7fa805d4c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa80006c490 0x7fa80006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:10.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.747+0000 7fa805d4c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa80006ce60 0x7fa800164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:10.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.747+0000 7fa805d4c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80006db00 con 0x7fa80006c0a0 2019-11-28T11:41:10.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.747+0000 7fa805d4c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80006fd60 con 0x7fa80006ce60 2019-11-28T11:41:10.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.747+0000 7fa805d4c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa800070030 con 0x7fa80006c490 2019-11-28T11:41:10.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.747+0000 7fa804aea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa80006ce60 0x7fa800164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:10.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.747+0000 7fa7fffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa80006c0a0 0x7fa800072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38094/0 (socket says 172.21.15.80:38094) 2019-11-28T11:41:10.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.747+0000 7fa7fffff700 1 -- 172.21.15.80:0/4026081371 learned_addr learned my addr 172.21.15.80:0/4026081371 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:10.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.747+0000 7fa7f7fff700 1 --2- 172.21.15.80:0/4026081371 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa80006c490 0x7fa80006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:10.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.747+0000 7fa804aea700 1 -- 172.21.15.80:0/4026081371 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa80006c490 msgr2=0x7fa80006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:10.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.747+0000 7fa804aea700 1 --2- 172.21.15.80:0/4026081371 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa80006c490 0x7fa80006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:10.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.747+0000 7fa804aea700 1 -- 172.21.15.80:0/4026081371 >> v1:172.21.15.80:6789/0 conn(0x7fa80006c0a0 legacy=0x7fa800072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.747+0000 7fa7ff7fe700 1 -- 172.21.15.80:0/4026081371 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875183355 0 0) 0x7fa7f0001150 con 0x7fa80006c0a0 2019-11-28T11:41:10.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.747+0000 7fa804aea700 1 -- 172.21.15.80:0/4026081371 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000706c0 con 0x7fa80006ce60 2019-11-28T11:41:10.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.747+0000 7fa7f7fff700 1 --2- 172.21.15.80:0/4026081371 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa80006c490 0x7fa80006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:10.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.748+0000 7fa804aea700 1 --2- 172.21.15.80:0/4026081371 >> v2:172.21.15.80:3300/0 conn(0x7fa80006ce60 0x7fa800164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa7f800b2d0 tx=0x7fa7f800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.748+0000 7fa804aea700 1 --2- 172.21.15.80:0/4026081371 >> v2:172.21.15.80:3300/0 conn(0x7fa80006ce60 0x7fa800164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa7f800b2d0 tx=0x7fa7f800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.748+0000 7fa804aea700 1 --2- 172.21.15.80:0/4026081371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa80006ce60 0x7fa800164d70 secure :-1 s=READY pgs=1471 cs=0 l=1 rx=0x7fa7f800b2d0 tx=0x7fa7f800bae0).ready entity=mon.0 client_cookie=6ec5adcd2d15de20 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:10.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.748+0000 7fa804aea700 1 --2- 172.21.15.80:0/4026081371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa80006ce60 0x7fa800164d70 secure :-1 s=THROTTLE_DONE pgs=1471 cs=0 l=1 rx=0x7fa7f800b2d0 tx=0x7fa7f800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.748+0000 7fa7ff7fe700 1 -- 172.21.15.80:0/4026081371 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7f8009f20 con 0x7fa80006ce60 2019-11-28T11:41:10.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.748+0000 7fa804aea700 1 --2- 172.21.15.80:0/4026081371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa80006ce60 0x7fa800164d70 secure :-1 s=THROTTLE_DONE pgs=1471 cs=0 l=1 rx=0x7fa7f800b2d0 tx=0x7fa7f800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.748+0000 7fa804aea700 1 --2- 172.21.15.80:0/4026081371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa80006ce60 0x7fa800164d70 secure :-1 s=THROTTLE_DONE pgs=1471 cs=0 l=1 rx=0x7fa7f800b2d0 tx=0x7fa7f800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.748+0000 7fa7ff7fe700 1 -- 172.21.15.80:0/4026081371 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f8009b40 con 0x7fa80006ce60 2019-11-28T11:41:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.748+0000 7fa7ff7fe700 1 -- 172.21.15.80:0/4026081371 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7f8000f40 con 0x7fa80006ce60 2019-11-28T11:41:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.748+0000 7fa805d4c700 1 -- 172.21.15.80:0/4026081371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa80006ce60 msgr2=0x7fa800164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.748+0000 7fa805d4c700 1 --2- 172.21.15.80:0/4026081371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa80006ce60 0x7fa800164d70 secure :-1 s=READY pgs=1471 cs=0 l=1 rx=0x7fa7f800b2d0 tx=0x7fa7f800bae0).stop 2019-11-28T11:41:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.748+0000 7fa805d4c700 1 -- 172.21.15.80:0/4026081371 shutdown_connections 2019-11-28T11:41:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.748+0000 7fa805d4c700 1 --2- 172.21.15.80:0/4026081371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa80006ce60 0x7fa800164d70 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.748+0000 7fa805d4c700 1 --2- 172.21.15.80:0/4026081371 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa80006c490 0x7fa80006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:10.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.749+0000 7fa805d4c700 1 -- 172.21.15.80:0/4026081371 shutdown_connections 2019-11-28T11:41:10.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.749+0000 7fa805d4c700 1 -- 172.21.15.80:0/4026081371 wait complete. 2019-11-28T11:41:10.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.749+0000 7fa805d4c700 1 -- 172.21.15.80:0/4026081371 >> 172.21.15.80:0/4026081371 conn(0x7fa800061cf0 msgr2=0x7fa800064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:10.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.751+0000 7fa805d4c700 1 Processor -- start 2019-11-28T11:41:10.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.751+0000 7fa805d4c700 1 -- start start 2019-11-28T11:41:10.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa805d4c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa800103000 0x7fa800103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:10.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa805d4c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa8001039d0 0x7fa800167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:10.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa805d4c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8001312c0 con 0x7fa80013dc00 2019-11-28T11:41:10.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa805d4c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa800105830 con 0x7fa800103000 2019-11-28T11:41:10.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa805d4c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa800105b00 con 0x7fa8001039d0 2019-11-28T11:41:10.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa7f7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa800103000 0x7fa800103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:10.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa7f7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa800103000 0x7fa800103490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38786/0 (socket says 172.21.15.80:38786) 2019-11-28T11:41:10.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa7f7fff700 1 -- 172.21.15.80:0/2590332493 learned_addr learned my addr 172.21.15.80:0/2590332493 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:10.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa804aea700 1 --2- 172.21.15.80:0/2590332493 >> v2:172.21.15.174:3300/0 conn(0x7fa8001039d0 0x7fa800167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:10.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa7f7fff700 1 -- 172.21.15.80:0/2590332493 >> v2:172.21.15.174:3300/0 conn(0x7fa8001039d0 msgr2=0x7fa800167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa7f7fff700 1 --2- 172.21.15.80:0/2590332493 >> v2:172.21.15.174:3300/0 conn(0x7fa8001039d0 0x7fa800167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa7f7fff700 1 -- 172.21.15.80:0/2590332493 >> v1:172.21.15.174:6789/0 conn(0x7fa80013dc00 legacy=0x7fa800109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa7f7fff700 1 -- 172.21.15.80:0/2590332493 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa800106190 con 0x7fa800103000 2019-11-28T11:41:10.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa7f7fff700 1 --2- 172.21.15.80:0/2590332493 >> v2:172.21.15.80:3300/0 conn(0x7fa800103000 0x7fa800103490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7e8010410 tx=0x7fa7e8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa7f7fff700 1 --2- 172.21.15.80:0/2590332493 >> v2:172.21.15.80:3300/0 conn(0x7fa800103000 0x7fa800103490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7e8010410 tx=0x7fa7e8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa7f7fff700 1 --2- 172.21.15.80:0/2590332493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa800103000 0x7fa800103490 secure :-1 s=READY pgs=1472 cs=0 l=1 rx=0x7fa7e8010410 tx=0x7fa7e8010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:10.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa7f7fff700 1 --2- 172.21.15.80:0/2590332493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa800103000 0x7fa800103490 secure :-1 s=THROTTLE_DONE pgs=1472 cs=0 l=1 rx=0x7fa7e8010410 tx=0x7fa7e8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa7f7fff700 1 --2- 172.21.15.80:0/2590332493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa800103000 0x7fa800103490 secure :-1 s=THROTTLE_DONE pgs=1472 cs=0 l=1 rx=0x7fa7e8010410 tx=0x7fa7e8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa7f7fff700 1 --2- 172.21.15.80:0/2590332493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa800103000 0x7fa800103490 secure :-1 s=THROTTLE_DONE pgs=1472 cs=0 l=1 rx=0x7fa7e8010410 tx=0x7fa7e8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa7fd7fa700 1 -- 172.21.15.80:0/2590332493 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7e8000960 con 0x7fa800103000 2019-11-28T11:41:10.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa7fd7fa700 1 -- 172.21.15.80:0/2590332493 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e8009770 con 0x7fa800103000 2019-11-28T11:41:10.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa805d4c700 1 -- 172.21.15.80:0/2590332493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa800106510 con 0x7fa800103000 2019-11-28T11:41:10.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa7fd7fa700 1 -- 172.21.15.80:0/2590332493 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7e8009ec0 con 0x7fa800103000 2019-11-28T11:41:10.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.752+0000 7fa805d4c700 1 -- 172.21.15.80:0/2590332493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa800106190 con 0x7fa800103000 2019-11-28T11:41:10.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.753+0000 7fa7f7fff700 1 --2- 172.21.15.80:0/2590332493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa800103000 0x7fa800103490 secure :-1 s=THROTTLE_DONE pgs=1472 cs=0 l=1 rx=0x7fa7e8010410 tx=0x7fa7e8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.753+0000 7fa7fd7fa700 1 -- 172.21.15.80:0/2590332493 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa7e8009960 con 0x7fa800103000 2019-11-28T11:41:10.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.753+0000 7fa7f7fff700 1 --2- 172.21.15.80:0/2590332493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa800103000 0x7fa800103490 secure :-1 s=THROTTLE_DONE pgs=1472 cs=0 l=1 rx=0x7fa7e8010410 tx=0x7fa7e8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.753+0000 7fa7fd7fa700 1 --2- 172.21.15.80:0/2590332493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7e4018730 0x7fa7e401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:10.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.753+0000 7fa7fd7fa700 1 -- 172.21.15.80:0/2590332493 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa7e8031a70 con 0x7fa800103000 2019-11-28T11:41:10.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.753+0000 7fa7fffff700 1 --2- 172.21.15.80:0/2590332493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7e4018730 0x7fa7e401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:10.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.754+0000 7fa7fffff700 1 --2- 172.21.15.80:0/2590332493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7e4018730 0x7fa7e401abc0 crc :-1 s=READY pgs=598 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:10.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.761+0000 7fa805d4c700 1 -- 172.21.15.80:0/2590332493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa800106510 con 0x7fa800103000 2019-11-28T11:41:10.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.764+0000 7fa7f7fff700 1 --2- 172.21.15.80:0/2590332493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa800103000 0x7fa800103490 secure :-1 s=THROTTLE_DONE pgs=1472 cs=0 l=1 rx=0x7fa7e8010410 tx=0x7fa7e8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.764+0000 7fa7fd7fa700 1 -- 172.21.15.80:0/2590332493 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa7e8017540 con 0x7fa800103000 2019-11-28T11:41:10.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.939+0000 7fa805d4c700 1 -- 172.21.15.80:0/2590332493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa800106190 con 0x7fa800103000 2019-11-28T11:41:10.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.939+0000 7fa7f7fff700 1 --2- 172.21.15.80:0/2590332493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa800103000 0x7fa800103490 secure :-1 s=THROTTLE_DONE pgs=1472 cs=0 l=1 rx=0x7fa7e8010410 tx=0x7fa7e8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:10.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.939+0000 7fa7fd7fa700 1 -- 172.21.15.80:0/2590332493 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2442 (secure 0 0 0) 0x7fa7e800a360 con 0x7fa800103000 2019-11-28T11:41:10.972 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 76 2019-11-28T11:41:10.972 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:10.972 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":76,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/957474503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":957474503},{"type":"v1","addr":"172.21.15.80:6834","nonce":957474503}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":76},{"gid":8226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/2176158567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":2176158567},{"type":"v1","addr":"172.21.15.80:6835","nonce":2176158567}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":76}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:02.122819+0000","modified":"2019-11-28T11:41:05.774868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7747},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7747":{"gid":7747,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/332155288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":332155288},{"type":"v1","addr":"172.21.15.174:6835","nonce":332155288}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2019-11-28T11:41:10.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.942+0000 7fa805d4c700 1 -- 172.21.15.80:0/2590332493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7e4018730 msgr2=0x7fa7e401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.942+0000 7fa805d4c700 1 --2- 172.21.15.80:0/2590332493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7e4018730 0x7fa7e401abc0 crc :-1 s=READY pgs=598 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.942+0000 7fa805d4c700 1 -- 172.21.15.80:0/2590332493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa800103000 msgr2=0x7fa800103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:10.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.942+0000 7fa805d4c700 1 --2- 172.21.15.80:0/2590332493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa800103000 0x7fa800103490 secure :-1 s=READY pgs=1472 cs=0 l=1 rx=0x7fa7e8010410 tx=0x7fa7e8010290).stop 2019-11-28T11:41:10.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.942+0000 7fa805d4c700 1 -- 172.21.15.80:0/2590332493 shutdown_connections 2019-11-28T11:41:10.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.942+0000 7fa805d4c700 1 --2- 172.21.15.80:0/2590332493 >> v2:172.21.15.174:3300/0 conn(0x7fa8001039d0 0x7fa800167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.942+0000 7fa805d4c700 1 --2- 172.21.15.80:0/2590332493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa800103000 0x7fa800103490 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.942+0000 7fa805d4c700 1 --2- 172.21.15.80:0/2590332493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7e4018730 0x7fa7e401abc0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:10.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.942+0000 7fa805d4c700 1 -- 172.21.15.80:0/2590332493 shutdown_connections 2019-11-28T11:41:10.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.942+0000 7fa805d4c700 1 -- 172.21.15.80:0/2590332493 wait complete. 2019-11-28T11:41:10.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:10.942+0000 7fa805d4c700 1 -- 172.21.15.80:0/2590332493 >> 172.21.15.80:0/2590332493 conn(0x7fa80011bfc0 msgr2=0x7fa800141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:11.289 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7747}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 16, u'failed': [], u'epoch': 75, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [17], u'info': {u'gid_7747': {u'export_targets': [], u'name': u'c', u'incarnation': 74, u'state_seq': 2, u'state': u'up:active', u'gid': 7747, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 332155288, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 332155288, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/332155288'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:41:02.122819+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:41:05.774868+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:41:11.289 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:41:11.290 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:41:11.423 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:41:11.423 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:41:11.423 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:41:11.423 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 7747, 2019-11-28T11:41:11.424 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:41:11.424 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:41:11.424 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 6.6164385750000001, 2019-11-28T11:41:11.425 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 75, 2019-11-28T11:41:11.425 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 107, 2019-11-28T11:41:11.425 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 107, 2019-11-28T11:41:11.426 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 6.8144603610000001 2019-11-28T11:41:11.426 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:41:11.429 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7747, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.6164385750000001, "mdsmap_epoch": 75, "osdmap_epoch": 107, "osdmap_epoch_barrier": 107, "uptime": 6.8144603610000001 } 2019-11-28T11:41:11.429 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:41:11.429 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:41:11.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:41:11.429 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:41:11.499 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:41:11.500 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:41:11.628 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:41:11.628 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:41:11.628 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:41:11.629 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:41:11.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:41:11.630 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:41:11.703 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:41:11.825 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:41:11.825 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:41:11.826 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:41:11.831 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:41:11.832 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:41:11.965 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:41:11.965 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:41:11.965 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:41:11.966 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:41:11.966 INFO:tasks.cephfs_test_runner:test_dont_mark_unresponsive_client_stale (tasks.cephfs.test_client_recovery.TestClientRecovery) ... skipped 'Require FUSE client to handle signal STOP/CONT' 2019-11-28T11:41:11.966 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale' 2019-11-28T11:41:12.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.056+0000 7fb299bf8700 1 Processor -- start 2019-11-28T11:41:12.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.056+0000 7fb299bf8700 1 -- start start 2019-11-28T11:41:12.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.057+0000 7fb299bf8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb29406c490 0x7fb29406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:12.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.057+0000 7fb299bf8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb29406ce60 0x7fb294164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:12.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.057+0000 7fb299bf8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29406db00 con 0x7fb29406c0a0 2019-11-28T11:41:12.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.057+0000 7fb299bf8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29406fd60 con 0x7fb29406ce60 2019-11-28T11:41:12.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.057+0000 7fb299bf8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb294070030 con 0x7fb29406c490 2019-11-28T11:41:12.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.057+0000 7fb298996700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb29406ce60 0x7fb294164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:12.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.057+0000 7fb298996700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb29406ce60 0x7fb294164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38792/0 (socket says 172.21.15.80:38792) 2019-11-28T11:41:12.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.057+0000 7fb298996700 1 -- 172.21.15.80:0/3212373531 learned_addr learned my addr 172.21.15.80:0/3212373531 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:12.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb28bfff700 1 --2- 172.21.15.80:0/3212373531 >> v2:172.21.15.174:3300/0 conn(0x7fb29406c490 0x7fb29406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:12.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb298996700 1 -- 172.21.15.80:0/3212373531 >> v2:172.21.15.174:3300/0 conn(0x7fb29406c490 msgr2=0x7fb29406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:12.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb298996700 1 --2- 172.21.15.80:0/3212373531 >> v2:172.21.15.174:3300/0 conn(0x7fb29406c490 0x7fb29406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:12.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb298996700 1 -- 172.21.15.80:0/3212373531 >> v1:172.21.15.174:6789/0 conn(0x7fb29406c0a0 legacy=0x7fb294072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:12.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb298996700 1 -- 172.21.15.80:0/3212373531 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2940706c0 con 0x7fb29406ce60 2019-11-28T11:41:12.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb28bfff700 1 --2- 172.21.15.80:0/3212373531 >> v2:172.21.15.174:3300/0 conn(0x7fb29406c490 0x7fb29406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:41:12.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb298996700 1 --2- 172.21.15.80:0/3212373531 >> v2:172.21.15.80:3300/0 conn(0x7fb29406ce60 0x7fb294164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb28c00fab0 tx=0x7fb28c00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:12.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb298996700 1 --2- 172.21.15.80:0/3212373531 >> v2:172.21.15.80:3300/0 conn(0x7fb29406ce60 0x7fb294164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb28c00fab0 tx=0x7fb28c00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:12.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb298996700 1 --2- 172.21.15.80:0/3212373531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29406ce60 0x7fb294164d70 secure :-1 s=READY pgs=1474 cs=0 l=1 rx=0x7fb28c00fab0 tx=0x7fb28c00fe50).ready entity=mon.0 client_cookie=b2da11c8ca25c3c0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:12.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb298996700 1 --2- 172.21.15.80:0/3212373531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29406ce60 0x7fb294164d70 secure :-1 s=THROTTLE_DONE pgs=1474 cs=0 l=1 rx=0x7fb28c00fab0 tx=0x7fb28c00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:12.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb298996700 1 --2- 172.21.15.80:0/3212373531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29406ce60 0x7fb294164d70 secure :-1 s=THROTTLE_DONE pgs=1474 cs=0 l=1 rx=0x7fb28c00fab0 tx=0x7fb28c00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:12.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb2937fe700 1 -- 172.21.15.80:0/3212373531 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb28c000f10 con 0x7fb29406ce60 2019-11-28T11:41:12.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb298996700 1 --2- 172.21.15.80:0/3212373531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29406ce60 0x7fb294164d70 secure :-1 s=THROTTLE_DONE pgs=1474 cs=0 l=1 rx=0x7fb28c00fab0 tx=0x7fb28c00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:12.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb2937fe700 1 -- 172.21.15.80:0/3212373531 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c001460 con 0x7fb29406ce60 2019-11-28T11:41:12.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb2937fe700 1 -- 172.21.15.80:0/3212373531 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb28c001bb0 con 0x7fb29406ce60 2019-11-28T11:41:12.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb299bf8700 1 -- 172.21.15.80:0/3212373531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29406ce60 msgr2=0x7fb294164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:12.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.058+0000 7fb299bf8700 1 --2- 172.21.15.80:0/3212373531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29406ce60 0x7fb294164d70 secure :-1 s=READY pgs=1474 cs=0 l=1 rx=0x7fb28c00fab0 tx=0x7fb28c00fe50).stop 2019-11-28T11:41:12.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.059+0000 7fb299bf8700 1 -- 172.21.15.80:0/3212373531 shutdown_connections 2019-11-28T11:41:12.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.059+0000 7fb299bf8700 1 --2- 172.21.15.80:0/3212373531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29406ce60 0x7fb294164d70 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:12.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.059+0000 7fb299bf8700 1 --2- 172.21.15.80:0/3212373531 >> v2:172.21.15.174:3300/0 conn(0x7fb29406c490 0x7fb29406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:12.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.059+0000 7fb299bf8700 1 -- 172.21.15.80:0/3212373531 shutdown_connections 2019-11-28T11:41:12.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.059+0000 7fb299bf8700 1 -- 172.21.15.80:0/3212373531 wait complete. 2019-11-28T11:41:12.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.059+0000 7fb299bf8700 1 -- 172.21.15.80:0/3212373531 >> 172.21.15.80:0/3212373531 conn(0x7fb294061cf0 msgr2=0x7fb294064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:12.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.061+0000 7fb299bf8700 1 Processor -- start 2019-11-28T11:41:12.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.061+0000 7fb299bf8700 1 -- start start 2019-11-28T11:41:12.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.062+0000 7fb299bf8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb294128990 0x7fb294117fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:12.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.062+0000 7fb299bf8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb29412e850 0x7fb29410d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:12.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.062+0000 7fb299bf8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29412ff40 con 0x7fb2941184e0 2019-11-28T11:41:12.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.062+0000 7fb299bf8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb294131240 con 0x7fb29412e850 2019-11-28T11:41:12.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.062+0000 7fb299bf8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2941325d0 con 0x7fb294128990 2019-11-28T11:41:12.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.062+0000 7fb298996700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb29412e850 0x7fb29410d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:12.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.062+0000 7fb298996700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb29412e850 0x7fb29410d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38800/0 (socket says 172.21.15.80:38800) 2019-11-28T11:41:12.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.062+0000 7fb298996700 1 -- 172.21.15.80:0/1970261886 learned_addr learned my addr 172.21.15.80:0/1970261886 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:12.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.062+0000 7fb293fff700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb294128990 0x7fb294117fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:12.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb298996700 1 -- 172.21.15.80:0/1970261886 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb294128990 msgr2=0x7fb294117fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:12.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb298996700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb294128990 0x7fb294117fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:12.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb298996700 1 -- 172.21.15.80:0/1970261886 >> v1:172.21.15.174:6789/0 conn(0x7fb2941184e0 legacy=0x7fb29412e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:12.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb2917fa700 1 -- 172.21.15.80:0/1970261886 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015606900 0 0) 0x7fb27c009c10 con 0x7fb2941184e0 2019-11-28T11:41:12.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb298996700 1 -- 172.21.15.80:0/1970261886 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb294132950 con 0x7fb29412e850 2019-11-28T11:41:12.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb298996700 1 --2- 172.21.15.80:0/1970261886 >> v2:172.21.15.80:3300/0 conn(0x7fb29412e850 0x7fb29410d560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb28c010710 tx=0x7fb28c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:12.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb298996700 1 --2- 172.21.15.80:0/1970261886 >> v2:172.21.15.80:3300/0 conn(0x7fb29412e850 0x7fb29410d560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb28c010710 tx=0x7fb28c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:12.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb298996700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29412e850 0x7fb29410d560 secure :-1 s=READY pgs=1475 cs=0 l=1 rx=0x7fb28c010710 tx=0x7fb28c010ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:12.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb298996700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29412e850 0x7fb29410d560 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7fb28c010710 tx=0x7fb28c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:12.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb2917fa700 1 -- 172.21.15.80:0/1970261886 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb28c001610 con 0x7fb29412e850 2019-11-28T11:41:12.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb298996700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29412e850 0x7fb29410d560 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7fb28c010710 tx=0x7fb28c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:12.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb298996700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29412e850 0x7fb29410d560 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7fb28c010710 tx=0x7fb28c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:12.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb2917fa700 1 -- 172.21.15.80:0/1970261886 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c001230 con 0x7fb29412e850 2019-11-28T11:41:12.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb299bf8700 1 -- 172.21.15.80:0/1970261886 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb294132950 con 0x7fb29412e850 2019-11-28T11:41:12.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb2917fa700 1 -- 172.21.15.80:0/1970261886 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb28c001bf0 con 0x7fb29412e850 2019-11-28T11:41:12.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb299bf8700 1 -- 172.21.15.80:0/1970261886 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb294132950 con 0x7fb29412e850 2019-11-28T11:41:12.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.063+0000 7fb298996700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29412e850 0x7fb29410d560 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7fb28c010710 tx=0x7fb28c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:12.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.064+0000 7fb2917fa700 1 -- 172.21.15.80:0/1970261886 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb28c001420 con 0x7fb29412e850 2019-11-28T11:41:12.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.064+0000 7fb298996700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29412e850 0x7fb29410d560 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7fb28c010710 tx=0x7fb28c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:12.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.064+0000 7fb2917fa700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb278018730 0x7fb27801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:12.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.064+0000 7fb2917fa700 1 -- 172.21.15.80:0/1970261886 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb28c031db0 con 0x7fb29412e850 2019-11-28T11:41:12.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.064+0000 7fb293fff700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb278018730 0x7fb27801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:12.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.064+0000 7fb293fff700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb278018730 0x7fb27801abc0 crc :-1 s=READY pgs=599 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:12.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.071+0000 7fb299bf8700 1 -- 172.21.15.80:0/1970261886 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb294132950 con 0x7fb29412e850 2019-11-28T11:41:12.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.075+0000 7fb298996700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29412e850 0x7fb29410d560 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7fb28c010710 tx=0x7fb28c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:12.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.075+0000 7fb2917fa700 1 -- 172.21.15.80:0/1970261886 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb28c000f70 con 0x7fb29412e850 2019-11-28T11:41:12.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.250+0000 7fb299bf8700 1 -- 172.21.15.80:0/1970261886 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale"]} v 0) v1 -- 0x7fb2941325d0 con 0x7fb29412e850 2019-11-28T11:41:12.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.875+0000 7fb298996700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29412e850 0x7fb29410d560 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7fb28c010710 tx=0x7fb28c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:12.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.875+0000 7fb2917fa700 1 -- 172.21.15.80:0/1970261886 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale"]}]=0 v404) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb28c017720 con 0x7fb29412e850 2019-11-28T11:41:12.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.917+0000 7fb299bf8700 1 -- 172.21.15.80:0/1970261886 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb278018730 msgr2=0x7fb27801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:12.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.917+0000 7fb299bf8700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb278018730 0x7fb27801abc0 crc :-1 s=READY pgs=599 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:12.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.917+0000 7fb299bf8700 1 -- 172.21.15.80:0/1970261886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29412e850 msgr2=0x7fb29410d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:12.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.917+0000 7fb299bf8700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29412e850 0x7fb29410d560 secure :-1 s=READY pgs=1475 cs=0 l=1 rx=0x7fb28c010710 tx=0x7fb28c010ab0).stop 2019-11-28T11:41:12.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.917+0000 7fb299bf8700 1 -- 172.21.15.80:0/1970261886 shutdown_connections 2019-11-28T11:41:12.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.917+0000 7fb299bf8700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb29412e850 0x7fb29410d560 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:12.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.917+0000 7fb299bf8700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb278018730 0x7fb27801abc0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:12.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.917+0000 7fb299bf8700 1 --2- 172.21.15.80:0/1970261886 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb294128990 0x7fb294117fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:12.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.917+0000 7fb299bf8700 1 -- 172.21.15.80:0/1970261886 shutdown_connections 2019-11-28T11:41:12.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.917+0000 7fb299bf8700 1 -- 172.21.15.80:0/1970261886 wait complete. 2019-11-28T11:41:12.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:12.917+0000 7fb299bf8700 1 -- 172.21.15.80:0/1970261886 >> 172.21.15.80:0/1970261886 conn(0x7fb29407c6e0 msgr2=0x7fb2941050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:12.960 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:41:12.960 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:41:13.026 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:41:13.089 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:41:13.158 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:41:13.216 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:41:13.279 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:41:13.337 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:41:13.337 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:41:13.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:41:13.338 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T11:41:13.466 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:41:13.471 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:41:13.508 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:41:13.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:41:13.509 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:41:13.630 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:41:13.634 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:41:13.676 INFO:tasks.cephfs_test_runner:Starting test: test_evicted_caps (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T11:41:13.677 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps' 2019-11-28T11:41:13.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.762+0000 7eff548de700 1 Processor -- start 2019-11-28T11:41:13.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.762+0000 7eff548de700 1 -- start start 2019-11-28T11:41:13.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.763+0000 7eff548de700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff5006c0a0 0x7eff50072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:13.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.763+0000 7eff548de700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5006db00 con 0x7eff50072620 2019-11-28T11:41:13.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.763+0000 7eff548de700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5006e000 con 0x7eff500734e0 2019-11-28T11:41:13.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.763+0000 7eff548de700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5006f330 con 0x7eff5006c0a0 2019-11-28T11:41:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.763+0000 7eff4f59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7eff50072620 0x7eff50164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38122/0 (socket says 172.21.15.80:38122) 2019-11-28T11:41:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.763+0000 7eff4f59e700 1 -- 172.21.15.80:0/3115904716 learned_addr learned my addr 172.21.15.80:0/3115904716 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4ed9d700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff5006c0a0 0x7eff50072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:13.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 -- 172.21.15.80:0/3115904716 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271084540 0 0) 0x7eff48001150 con 0x7eff50072620 2019-11-28T11:41:13.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 -- 172.21.15.80:0/3115904716 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff30002e80 con 0x7eff50072620 2019-11-28T11:41:13.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 -- 172.21.15.80:0/3115904716 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485517309 0 0) 0x7eff40001030 con 0x7eff500734e0 2019-11-28T11:41:13.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 -- 172.21.15.80:0/3115904716 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff300030b0 con 0x7eff500734e0 2019-11-28T11:41:13.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 -- 172.21.15.80:0/3115904716 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4108761103 0 0) 0x7eff48001130 con 0x7eff50072620 2019-11-28T11:41:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 -- 172.21.15.80:0/3115904716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff5006c0a0 msgr2=0x7eff50072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff5006c0a0 0x7eff50072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 -- 172.21.15.80:0/3115904716 >> v1:172.21.15.174:6789/0 conn(0x7eff500734e0 legacy=0x7eff50071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:13.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 -- 172.21.15.80:0/3115904716 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff500706c0 con 0x7eff50072620 2019-11-28T11:41:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 -- 172.21.15.80:0/3115904716 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7eff48001660 con 0x7eff50072620 2019-11-28T11:41:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4ed9d700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff5006c0a0 0x7eff50072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 -- 172.21.15.80:0/3115904716 >> v1:172.21.15.80:6789/0 conn(0x7eff50072620 legacy=0x7eff50164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:13.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff30003b80 0x7eff30005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff300066d0 0x7eff30008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff3004d320 0x7eff3004f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4ed9d700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff30003b80 0x7eff30005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:13.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 -- 172.21.15.80:0/3115904716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3004ffd0 con 0x7eff30003b80 2019-11-28T11:41:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 -- 172.21.15.80:0/3115904716 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff30050200 con 0x7eff3004d320 2019-11-28T11:41:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4dd9b700 1 -- 172.21.15.80:0/3115904716 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff30050430 con 0x7eff300066d0 2019-11-28T11:41:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4e59c700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff300066d0 0x7eff30008b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:13.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4f59e700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff3004d320 0x7eff3004f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:13.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4ed9d700 1 -- 172.21.15.80:0/3115904716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff300066d0 msgr2=0x7eff30008b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:13.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4ed9d700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff300066d0 0x7eff30008b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:13.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4ed9d700 1 -- 172.21.15.80:0/3115904716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff3004d320 msgr2=0x7eff3004f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:13.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4ed9d700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff3004d320 0x7eff3004f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:13.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4ed9d700 1 -- 172.21.15.80:0/3115904716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff300506e0 con 0x7eff30003b80 2019-11-28T11:41:13.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4e59c700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff300066d0 0x7eff30008b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:41:13.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4f59e700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff3004d320 0x7eff3004f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:41:13.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4ed9d700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff30003b80 0x7eff30005fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7eff3800f9b0 tx=0x7eff3800fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:13.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4ed9d700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff30003b80 0x7eff30005fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7eff3800f9b0 tx=0x7eff3800fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:13.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.764+0000 7eff4ed9d700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff30003b80 0x7eff30005fe0 secure :-1 s=READY pgs=1477 cs=0 l=1 rx=0x7eff3800f9b0 tx=0x7eff3800fd50).ready entity=mon.0 client_cookie=61debaf94413728 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:13.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.765+0000 7eff4ed9d700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff30003b80 0x7eff30005fe0 secure :-1 s=THROTTLE_DONE pgs=1477 cs=0 l=1 rx=0x7eff3800f9b0 tx=0x7eff3800fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:13.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.765+0000 7eff4dd9b700 1 -- 172.21.15.80:0/3115904716 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff38000ce0 con 0x7eff30003b80 2019-11-28T11:41:13.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.765+0000 7eff4ed9d700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff30003b80 0x7eff30005fe0 secure :-1 s=THROTTLE_DONE pgs=1477 cs=0 l=1 rx=0x7eff3800f9b0 tx=0x7eff3800fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:13.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.765+0000 7eff4ed9d700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff30003b80 0x7eff30005fe0 secure :-1 s=THROTTLE_DONE pgs=1477 cs=0 l=1 rx=0x7eff3800f9b0 tx=0x7eff3800fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:13.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.765+0000 7eff4dd9b700 1 -- 172.21.15.80:0/3115904716 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff38001200 con 0x7eff30003b80 2019-11-28T11:41:13.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.765+0000 7eff4dd9b700 1 -- 172.21.15.80:0/3115904716 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff38001910 con 0x7eff30003b80 2019-11-28T11:41:13.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.765+0000 7eff548de700 1 -- 172.21.15.80:0/3115904716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff30003b80 msgr2=0x7eff30005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:13.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.765+0000 7eff548de700 1 --2- 172.21.15.80:0/3115904716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff30003b80 0x7eff30005fe0 secure :-1 s=READY pgs=1477 cs=0 l=1 rx=0x7eff3800f9b0 tx=0x7eff3800fd50).stop 2019-11-28T11:41:13.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.765+0000 7eff4f59e700 1 -- 172.21.15.80:0/3115904716 reap_dead start 2019-11-28T11:41:13.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.765+0000 7eff548de700 1 -- 172.21.15.80:0/3115904716 shutdown_connections 2019-11-28T11:41:13.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.765+0000 7eff548de700 1 -- 172.21.15.80:0/3115904716 shutdown_connections 2019-11-28T11:41:13.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.765+0000 7eff548de700 1 -- 172.21.15.80:0/3115904716 wait complete. 2019-11-28T11:41:13.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.765+0000 7eff548de700 1 -- 172.21.15.80:0/3115904716 >> 172.21.15.80:0/3115904716 conn(0x7eff50061cf0 msgr2=0x7eff50064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:13.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.768+0000 7eff548de700 1 Processor -- start 2019-11-28T11:41:13.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.768+0000 7eff548de700 1 -- start start 2019-11-28T11:41:13.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff548de700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff50156340 0x7eff501567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:13.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff548de700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7eff50156d10 0x7eff5016aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:13.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff548de700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff50157150 con 0x7eff50077040 2019-11-28T11:41:13.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff548de700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff50137110 con 0x7eff50156340 2019-11-28T11:41:13.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff548de700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff501373e0 con 0x7eff50156d10 2019-11-28T11:41:13.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff4ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7eff50077040 0x7eff501574c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38132/0 (socket says 172.21.15.80:38132) 2019-11-28T11:41:13.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff4e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff50156340 0x7eff501567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:13.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff4ed9d700 1 -- 172.21.15.80:0/2853085729 learned_addr learned my addr 172.21.15.80:0/2853085729 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:13.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff4f59e700 1 --2- 172.21.15.80:0/2853085729 >> v2:172.21.15.174:3300/0 conn(0x7eff50156d10 0x7eff5016aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:13.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff4e59c700 1 -- 172.21.15.80:0/2853085729 >> v2:172.21.15.174:3300/0 conn(0x7eff50156d10 msgr2=0x7eff5016aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:13.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff4e59c700 1 --2- 172.21.15.80:0/2853085729 >> v2:172.21.15.174:3300/0 conn(0x7eff50156d10 0x7eff5016aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:13.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff4e59c700 1 -- 172.21.15.80:0/2853085729 >> v1:172.21.15.80:6789/0 conn(0x7eff50077040 legacy=0x7eff501574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:13.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff4e59c700 1 -- 172.21.15.80:0/2853085729 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff50137a70 con 0x7eff50156340 2019-11-28T11:41:13.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff477fe700 1 -- 172.21.15.80:0/2853085729 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982831415 0 0) 0x7eff380024e0 con 0x7eff50077040 2019-11-28T11:41:13.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff4e59c700 1 --2- 172.21.15.80:0/2853085729 >> v2:172.21.15.80:3300/0 conn(0x7eff50156340 0x7eff501567d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff400103a0 tx=0x7eff400101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:13.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff4e59c700 1 --2- 172.21.15.80:0/2853085729 >> v2:172.21.15.80:3300/0 conn(0x7eff50156340 0x7eff501567d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff400103a0 tx=0x7eff400101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:13.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff4e59c700 1 --2- 172.21.15.80:0/2853085729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff50156340 0x7eff501567d0 secure :-1 s=READY pgs=1479 cs=0 l=1 rx=0x7eff400103a0 tx=0x7eff400101d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:13.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff4e59c700 1 --2- 172.21.15.80:0/2853085729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff50156340 0x7eff501567d0 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7eff400103a0 tx=0x7eff400101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:13.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff477fe700 1 -- 172.21.15.80:0/2853085729 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff40000940 con 0x7eff50156340 2019-11-28T11:41:13.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff4e59c700 1 --2- 172.21.15.80:0/2853085729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff50156340 0x7eff501567d0 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7eff400103a0 tx=0x7eff400101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:13.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff4e59c700 1 --2- 172.21.15.80:0/2853085729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff50156340 0x7eff501567d0 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7eff400103a0 tx=0x7eff400101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:13.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff477fe700 1 -- 172.21.15.80:0/2853085729 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff400099d0 con 0x7eff50156340 2019-11-28T11:41:13.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff548de700 1 -- 172.21.15.80:0/2853085729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff50137df0 con 0x7eff50156340 2019-11-28T11:41:13.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff477fe700 1 -- 172.21.15.80:0/2853085729 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff4000a0e0 con 0x7eff50156340 2019-11-28T11:41:13.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.769+0000 7eff548de700 1 -- 172.21.15.80:0/2853085729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff50137a70 con 0x7eff50156340 2019-11-28T11:41:13.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.770+0000 7eff4e59c700 1 --2- 172.21.15.80:0/2853085729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff50156340 0x7eff501567d0 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7eff400103a0 tx=0x7eff400101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:13.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.770+0000 7eff477fe700 1 -- 172.21.15.80:0/2853085729 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7eff40009bc0 con 0x7eff50156340 2019-11-28T11:41:13.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.770+0000 7eff4e59c700 1 --2- 172.21.15.80:0/2853085729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff50156340 0x7eff501567d0 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7eff400103a0 tx=0x7eff400101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:13.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.770+0000 7eff477fe700 1 --2- 172.21.15.80:0/2853085729 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff28018730 0x7eff2801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:13.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.770+0000 7eff477fe700 1 -- 172.21.15.80:0/2853085729 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7eff40031a10 con 0x7eff50156340 2019-11-28T11:41:13.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.770+0000 7eff4ed9d700 1 --2- 172.21.15.80:0/2853085729 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff28018730 0x7eff2801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:13.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.771+0000 7eff4ed9d700 1 --2- 172.21.15.80:0/2853085729 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff28018730 0x7eff2801abc0 crc :-1 s=READY pgs=600 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:13.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.778+0000 7eff548de700 1 -- 172.21.15.80:0/2853085729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff50137df0 con 0x7eff50156340 2019-11-28T11:41:13.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.781+0000 7eff4e59c700 1 --2- 172.21.15.80:0/2853085729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff50156340 0x7eff501567d0 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7eff400103a0 tx=0x7eff400101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:13.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.781+0000 7eff477fe700 1 -- 172.21.15.80:0/2853085729 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7eff400095d0 con 0x7eff50156340 2019-11-28T11:41:13.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:13.958+0000 7eff548de700 1 -- 172.21.15.80:0/2853085729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps"]} v 0) v1 -- 0x7eff50137a70 con 0x7eff50156340 2019-11-28T11:41:14.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:14.884+0000 7eff4e59c700 1 --2- 172.21.15.80:0/2853085729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff50156340 0x7eff501567d0 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7eff400103a0 tx=0x7eff400101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:14.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:14.884+0000 7eff477fe700 1 -- 172.21.15.80:0/2853085729 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps"]}]=0 v406) v1 ==== 152+0+0 (secure 0 0 0) 0x7eff400174f0 con 0x7eff50156340 2019-11-28T11:41:14.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:14.926+0000 7eff548de700 1 -- 172.21.15.80:0/2853085729 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff28018730 msgr2=0x7eff2801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:14.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:14.926+0000 7eff548de700 1 --2- 172.21.15.80:0/2853085729 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff28018730 0x7eff2801abc0 crc :-1 s=READY pgs=600 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:14.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:14.926+0000 7eff548de700 1 -- 172.21.15.80:0/2853085729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff50156340 msgr2=0x7eff501567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:14.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:14.926+0000 7eff548de700 1 --2- 172.21.15.80:0/2853085729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff50156340 0x7eff501567d0 secure :-1 s=READY pgs=1479 cs=0 l=1 rx=0x7eff400103a0 tx=0x7eff400101d0).stop 2019-11-28T11:41:14.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:14.926+0000 7eff548de700 1 -- 172.21.15.80:0/2853085729 shutdown_connections 2019-11-28T11:41:14.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:14.926+0000 7eff548de700 1 --2- 172.21.15.80:0/2853085729 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff28018730 0x7eff2801abc0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:14.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:14.926+0000 7eff548de700 1 --2- 172.21.15.80:0/2853085729 >> v2:172.21.15.174:3300/0 conn(0x7eff50156d10 0x7eff5016aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:14.926+0000 7eff548de700 1 --2- 172.21.15.80:0/2853085729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff50156340 0x7eff501567d0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:14.926+0000 7eff548de700 1 -- 172.21.15.80:0/2853085729 shutdown_connections 2019-11-28T11:41:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:14.926+0000 7eff548de700 1 -- 172.21.15.80:0/2853085729 wait complete. 2019-11-28T11:41:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:14.926+0000 7eff548de700 1 -- 172.21.15.80:0/2853085729 >> 172.21.15.80:0/2853085729 conn(0x7eff5013fa50 msgr2=0x7eff5007c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:14.976 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:41:14.976 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:41:15.062 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:41:15.132 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:41:15.193 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:41:15.251 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:41:15.312 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:41:15.377 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:41:15.379 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:41:15.379 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:41:15.380 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:41:15.380 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:41:15.380 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:41:15.380 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:41:15.388 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:41:15.388 DEBUG:teuthology.parallel:result is None 2019-11-28T11:41:15.390 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:41:15.390 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:41:15.391 DEBUG:teuthology.parallel:result is None 2019-11-28T11:41:15.391 DEBUG:teuthology.parallel:result is None 2019-11-28T11:41:15.391 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:41:15.392 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:41:15.392 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:41:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.562+0000 7f2db507f700 1 Processor -- start 2019-11-28T11:41:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.562+0000 7f2db507f700 1 -- start start 2019-11-28T11:41:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.563+0000 7f2db507f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2db006c490 0x7f2db006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.563+0000 7f2db507f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db006db00 con 0x7f2db006c0a0 2019-11-28T11:41:15.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.563+0000 7f2db507f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db006e000 con 0x7f2db006ce60 2019-11-28T11:41:15.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.563+0000 7f2db507f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db006fd60 con 0x7f2db006c490 2019-11-28T11:41:15.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.563+0000 7f2daed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2db006c490 0x7f2db006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:15.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.563+0000 7f2daf59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2db006c0a0 0x7f2db0072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38140/0 (socket says 172.21.15.80:38140) 2019-11-28T11:41:15.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.563+0000 7f2daf59e700 1 -- 172.21.15.80:0/3824190519 learned_addr learned my addr 172.21.15.80:0/3824190519 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:15.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f2daed9d700 1 -- 172.21.15.80:0/3824190519 >> v1:172.21.15.174:6789/0 conn(0x7f2db006ce60 legacy=0x7f2db0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f2daed9d700 1 -- 172.21.15.80:0/3824190519 >> v1:172.21.15.80:6789/0 conn(0x7f2db006c0a0 legacy=0x7f2db0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f2daed9d700 1 -- 172.21.15.80:0/3824190519 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db00706c0 con 0x7f2db006c490 2019-11-28T11:41:15.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f2daed9d700 1 --2- 172.21.15.80:0/3824190519 >> v2:172.21.15.80:3300/0 conn(0x7f2db006c490 0x7f2db006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2da000af50 tx=0x7f2da000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f2daed9d700 1 --2- 172.21.15.80:0/3824190519 >> v2:172.21.15.80:3300/0 conn(0x7f2db006c490 0x7f2db006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2da000af50 tx=0x7f2da000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f2daed9d700 1 --2- 172.21.15.80:0/3824190519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db006c490 0x7f2db006c920 secure :-1 s=READY pgs=1481 cs=0 l=1 rx=0x7f2da000af50 tx=0x7f2da000b760).ready entity=mon.0 client_cookie=ae9d3791ece48681 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:15.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f2daed9d700 1 --2- 172.21.15.80:0/3824190519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db006c490 0x7f2db006c920 secure :-1 s=THROTTLE_DONE pgs=1481 cs=0 l=1 rx=0x7f2da000af50 tx=0x7f2da000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f2daed9d700 1 --2- 172.21.15.80:0/3824190519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db006c490 0x7f2db006c920 secure :-1 s=THROTTLE_DONE pgs=1481 cs=0 l=1 rx=0x7f2da000af50 tx=0x7f2da000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f2dae59c700 1 -- 172.21.15.80:0/3824190519 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da0000960 con 0x7f2db006c490 2019-11-28T11:41:15.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f2daed9d700 1 --2- 172.21.15.80:0/3824190519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db006c490 0x7f2db006c920 secure :-1 s=THROTTLE_DONE pgs=1481 cs=0 l=1 rx=0x7f2da000af50 tx=0x7f2da000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f2dae59c700 1 -- 172.21.15.80:0/3824190519 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da0009860 con 0x7f2db006c490 2019-11-28T11:41:15.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f2dae59c700 1 -- 172.21.15.80:0/3824190519 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da0009f30 con 0x7f2db006c490 2019-11-28T11:41:15.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f2db507f700 1 -- 172.21.15.80:0/3824190519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db006c490 msgr2=0x7f2db006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f2db507f700 1 --2- 172.21.15.80:0/3824190519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db006c490 0x7f2db006c920 secure :-1 s=READY pgs=1481 cs=0 l=1 rx=0x7f2da000af50 tx=0x7f2da000b760).stop 2019-11-28T11:41:15.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.565+0000 7f2db507f700 1 -- 172.21.15.80:0/3824190519 shutdown_connections 2019-11-28T11:41:15.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.565+0000 7f2db507f700 1 --2- 172.21.15.80:0/3824190519 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2db006c490 0x7f2db006c920 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:15.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.565+0000 7f2db507f700 1 -- 172.21.15.80:0/3824190519 shutdown_connections 2019-11-28T11:41:15.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.565+0000 7f2db507f700 1 -- 172.21.15.80:0/3824190519 wait complete. 2019-11-28T11:41:15.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.565+0000 7f2db507f700 1 -- 172.21.15.80:0/3824190519 >> 172.21.15.80:0/3824190519 conn(0x7f2db0061cf0 msgr2=0x7f2db0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:15.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.567+0000 7f2db507f700 1 Processor -- start 2019-11-28T11:41:15.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.567+0000 7f2db507f700 1 -- start start 2019-11-28T11:41:15.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.568+0000 7f2db507f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2db0135760 0x7f2db0137480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:15.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.562+0000 7f4d83184700 1 Processor -- start 2019-11-28T11:41:15.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.562+0000 7f4d83184700 1 -- start start 2019-11-28T11:41:15.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.563+0000 7f4d83184700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4d7c06c490 0x7f4d7c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:15.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.563+0000 7f4d83184700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c06ce60 0x7f4d7c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:15.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.563+0000 7f4d83184700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c06db00 con 0x7f4d7c06c0a0 2019-11-28T11:41:15.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.563+0000 7f4d83184700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7c06fd60 con 0x7f4d7c06c490 2019-11-28T11:41:15.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.563+0000 7f4d83184700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c070030 con 0x7f4d7c06ce60 2019-11-28T11:41:15.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d80f20700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4d7c06c490 0x7f4d7c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:15.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d80f20700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4d7c06c490 0x7f4d7c06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38832/0 (socket says 172.21.15.80:38832) 2019-11-28T11:41:15.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d80f20700 1 -- 172.21.15.80:0/1836056396 learned_addr learned my addr 172.21.15.80:0/1836056396 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:15.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d81f22700 1 --2- 172.21.15.80:0/1836056396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c06ce60 0x7f4d7c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:15.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d80f20700 1 -- 172.21.15.80:0/1836056396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c06ce60 msgr2=0x7f4d7c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:15.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d80f20700 1 --2- 172.21.15.80:0/1836056396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c06ce60 0x7f4d7c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:15.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d80f20700 1 -- 172.21.15.80:0/1836056396 >> v1:172.21.15.174:6789/0 conn(0x7f4d7c06c0a0 legacy=0x7f4d7c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d7bfff700 1 -- 172.21.15.80:0/1836056396 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037232931 0 0) 0x7f4d6c001370 con 0x7f4d7c06c0a0 2019-11-28T11:41:15.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d80f20700 1 -- 172.21.15.80:0/1836056396 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c0706c0 con 0x7f4d7c06c490 2019-11-28T11:41:15.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d80f20700 1 --2- 172.21.15.80:0/1836056396 >> v2:172.21.15.80:3300/0 conn(0x7f4d7c06c490 0x7f4d7c06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4d7000f6c0 tx=0x7f4d7000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d80f20700 1 --2- 172.21.15.80:0/1836056396 >> v2:172.21.15.80:3300/0 conn(0x7f4d7c06c490 0x7f4d7c06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4d7000f6c0 tx=0x7f4d7000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d80f20700 1 --2- 172.21.15.80:0/1836056396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d7c06c490 0x7f4d7c06c920 secure :-1 s=READY pgs=1482 cs=0 l=1 rx=0x7f4d7000f6c0 tx=0x7f4d7000fa60).ready entity=mon.0 client_cookie=88b64deb4e941eb4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:15.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d80f20700 1 --2- 172.21.15.80:0/1836056396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d7c06c490 0x7f4d7c06c920 secure :-1 s=THROTTLE_DONE pgs=1482 cs=0 l=1 rx=0x7f4d7000f6c0 tx=0x7f4d7000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d80f20700 1 --2- 172.21.15.80:0/1836056396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d7c06c490 0x7f4d7c06c920 secure :-1 s=THROTTLE_DONE pgs=1482 cs=0 l=1 rx=0x7f4d7000f6c0 tx=0x7f4d7000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d7bfff700 1 -- 172.21.15.80:0/1836056396 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d70000960 con 0x7f4d7c06c490 2019-11-28T11:41:15.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d80f20700 1 --2- 172.21.15.80:0/1836056396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d7c06c490 0x7f4d7c06c920 secure :-1 s=THROTTLE_DONE pgs=1482 cs=0 l=1 rx=0x7f4d7000f6c0 tx=0x7f4d7000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d7bfff700 1 -- 172.21.15.80:0/1836056396 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d70000c90 con 0x7f4d7c06c490 2019-11-28T11:41:15.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d7bfff700 1 -- 172.21.15.80:0/1836056396 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d700013a0 con 0x7f4d7c06c490 2019-11-28T11:41:15.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d83184700 1 -- 172.21.15.80:0/1836056396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d7c06c490 msgr2=0x7f4d7c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.564+0000 7f4d83184700 1 --2- 172.21.15.80:0/1836056396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d7c06c490 0x7f4d7c06c920 secure :-1 s=READY pgs=1482 cs=0 l=1 rx=0x7f4d7000f6c0 tx=0x7f4d7000fa60).stop 2019-11-28T11:41:15.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.565+0000 7f4d83184700 1 -- 172.21.15.80:0/1836056396 shutdown_connections 2019-11-28T11:41:15.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.565+0000 7f4d83184700 1 --2- 172.21.15.80:0/1836056396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c06ce60 0x7f4d7c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:15.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.565+0000 7f4d83184700 1 --2- 172.21.15.80:0/1836056396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d7c06c490 0x7f4d7c06c920 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:15.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.565+0000 7f4d83184700 1 -- 172.21.15.80:0/1836056396 shutdown_connections 2019-11-28T11:41:15.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.565+0000 7f4d83184700 1 -- 172.21.15.80:0/1836056396 wait complete. 2019-11-28T11:41:15.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.565+0000 7f4d83184700 1 -- 172.21.15.80:0/1836056396 >> 172.21.15.80:0/1836056396 conn(0x7f4d7c061cf0 msgr2=0x7f4d7c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:15.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.567+0000 7f4d83184700 1 Processor -- start 2019-11-28T11:41:15.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.568+0000 7f4d83184700 1 -- start start 2019-11-28T11:41:15.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.568+0000 7f2db507f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2db01330b0 0x7f2db0133540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:15.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.568+0000 7f2db507f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db0136480 con 0x7f2db012a150 2019-11-28T11:41:15.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.568+0000 7f2db507f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db0104370 con 0x7f2db0135760 2019-11-28T11:41:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.568+0000 7f2db507f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db01346a0 con 0x7f2db01330b0 2019-11-28T11:41:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.568+0000 7f2daed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2db012a150 0x7f2db012a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38154/0 (socket says 172.21.15.80:38154) 2019-11-28T11:41:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.568+0000 7f2daed9d700 1 -- 172.21.15.80:0/4101922491 learned_addr learned my addr 172.21.15.80:0/4101922491 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2daf59e700 1 --2- 172.21.15.80:0/4101922491 >> v2:172.21.15.174:3300/0 conn(0x7f2db0135760 0x7f2db0137480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2db487e700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2db01330b0 0x7f2db0133540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:15.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2da7fff700 1 -- 172.21.15.80:0/4101922491 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625056374 0 0) 0x7f2da000abb0 con 0x7f2db012a150 2019-11-28T11:41:15.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2da7fff700 1 -- 172.21.15.80:0/4101922491 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d94002e80 con 0x7f2db012a150 2019-11-28T11:41:15.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2daf59e700 1 -- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2db01330b0 msgr2=0x7f2db0133540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2daf59e700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2db01330b0 0x7f2db0133540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:15.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2daf59e700 1 -- 172.21.15.80:0/4101922491 >> v1:172.21.15.80:6789/0 conn(0x7f2db012a150 legacy=0x7f2db012a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2daf59e700 1 -- 172.21.15.80:0/4101922491 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db0104a00 con 0x7f2db0135760 2019-11-28T11:41:15.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2daf59e700 1 --2- 172.21.15.80:0/4101922491 >> v2:172.21.15.174:3300/0 conn(0x7f2db0135760 0x7f2db0137480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2da8010700 tx=0x7f2da8010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2daf59e700 1 --2- 172.21.15.80:0/4101922491 >> v2:172.21.15.174:3300/0 conn(0x7f2db0135760 0x7f2db0137480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2da8010700 tx=0x7f2da8010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2daf59e700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db0135760 0x7f2db0137480 secure :-1 s=READY pgs=860 cs=0 l=1 rx=0x7f2da8010700 tx=0x7f2da8010500).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2daf59e700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db0135760 0x7f2db0137480 secure :-1 s=THROTTLE_DONE pgs=860 cs=0 l=1 rx=0x7f2da8010700 tx=0x7f2da8010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2da7fff700 1 -- 172.21.15.80:0/4101922491 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da80010c0 con 0x7f2db0135760 2019-11-28T11:41:15.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2daf59e700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db0135760 0x7f2db0137480 secure :-1 s=THROTTLE_DONE pgs=860 cs=0 l=1 rx=0x7f2da8010700 tx=0x7f2da8010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2daf59e700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db0135760 0x7f2db0137480 secure :-1 s=THROTTLE_DONE pgs=860 cs=0 l=1 rx=0x7f2da8010700 tx=0x7f2da8010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2da7fff700 1 -- 172.21.15.80:0/4101922491 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da80045c0 con 0x7f2db0135760 2019-11-28T11:41:15.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2da7fff700 1 -- 172.21.15.80:0/4101922491 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da80010c0 con 0x7f2db0135760 2019-11-28T11:41:15.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f2db507f700 1 -- 172.21.15.80:0/4101922491 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db0104d80 con 0x7f2db0135760 2019-11-28T11:41:15.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f2db507f700 1 -- 172.21.15.80:0/4101922491 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db0104a00 con 0x7f2db0135760 2019-11-28T11:41:15.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f2daf59e700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db0135760 0x7f2db0137480 secure :-1 s=THROTTLE_DONE pgs=860 cs=0 l=1 rx=0x7f2da8010700 tx=0x7f2da8010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f2da7fff700 1 -- 172.21.15.80:0/4101922491 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2da8001060 con 0x7f2db0135760 2019-11-28T11:41:15.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f2daf59e700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db0135760 0x7f2db0137480 secure :-1 s=THROTTLE_DONE pgs=860 cs=0 l=1 rx=0x7f2da8010700 tx=0x7f2da8010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f2da7fff700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d94018770 0x7f2d9401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:15.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f2da7fff700 1 -- 172.21.15.80:0/4101922491 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2da8031d20 con 0x7f2db0135760 2019-11-28T11:41:15.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.571+0000 7f2daed9d700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d94018770 0x7f2d9401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.571+0000 7f2daed9d700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d94018770 0x7f2d9401abe0 crc :-1 s=READY pgs=601 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.578+0000 7f2db507f700 1 -- 172.21.15.80:0/4101922491 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db0104d80 con 0x7f2db0135760 2019-11-28T11:41:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.582+0000 7f2daf59e700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db0135760 0x7f2db0137480 secure :-1 s=THROTTLE_DONE pgs=860 cs=0 l=1 rx=0x7f2da8010700 tx=0x7f2da8010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.582+0000 7f2da7fff700 1 -- 172.21.15.80:0/4101922491 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2da8000cc0 con 0x7f2db0135760 2019-11-28T11:41:15.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d83184700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c120e30 0x7f4d7c13ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:15.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d83184700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c139df0 con 0x7f4d7c13e900 2019-11-28T11:41:15.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d83184700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c13ef30 con 0x7f4d7c1209a0 2019-11-28T11:41:15.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d83184700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c128920 con 0x7f4d7c120e30 2019-11-28T11:41:15.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d81721700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4d7c13e900 0x7f4d7c121750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38158/0 (socket says 172.21.15.80:38158) 2019-11-28T11:41:15.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d81721700 1 -- 172.21.15.80:0/240042072 learned_addr learned my addr 172.21.15.80:0/240042072 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:15.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d81f22700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c120e30 0x7f4d7c13ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:15.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d79ffb700 1 -- 172.21.15.80:0/240042072 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847989744 0 0) 0x7f4d6c001480 con 0x7f4d7c13e900 2019-11-28T11:41:15.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d79ffb700 1 -- 172.21.15.80:0/240042072 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d5c002e80 con 0x7f4d7c13e900 2019-11-28T11:41:15.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d79ffb700 1 -- 172.21.15.80:0/240042072 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530125783 0 0) 0x7f4d70000940 con 0x7f4d7c1209a0 2019-11-28T11:41:15.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d79ffb700 1 -- 172.21.15.80:0/240042072 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d5c004170 con 0x7f4d7c1209a0 2019-11-28T11:41:15.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d81f22700 1 -- 172.21.15.80:0/240042072 >> v1:172.21.15.174:6789/0 conn(0x7f4d7c1209a0 legacy=0x7f4d7c13a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d81f22700 1 -- 172.21.15.80:0/240042072 >> v1:172.21.15.80:6789/0 conn(0x7f4d7c13e900 legacy=0x7f4d7c121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d81f22700 1 -- 172.21.15.80:0/240042072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c128fb0 con 0x7f4d7c120e30 2019-11-28T11:41:15.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d81f22700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c120e30 0x7f4d7c13ac90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d74010390 tx=0x7f4d74010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d81f22700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c120e30 0x7f4d7c13ac90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d74010390 tx=0x7f4d74010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.569+0000 7f4d81f22700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c120e30 0x7f4d7c13ac90 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f4d74010390 tx=0x7f4d74010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:15.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f4d81f22700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c120e30 0x7f4d7c13ac90 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f4d74010390 tx=0x7f4d74010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f4d81f22700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c120e30 0x7f4d7c13ac90 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f4d74010390 tx=0x7f4d74010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f4d79ffb700 1 -- 172.21.15.80:0/240042072 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d740099b0 con 0x7f4d7c120e30 2019-11-28T11:41:15.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f4d81f22700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c120e30 0x7f4d7c13ac90 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f4d74010390 tx=0x7f4d74010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f4d79ffb700 1 -- 172.21.15.80:0/240042072 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d74009bb0 con 0x7f4d7c120e30 2019-11-28T11:41:15.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f4d83184700 1 -- 172.21.15.80:0/240042072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7c129330 con 0x7f4d7c120e30 2019-11-28T11:41:15.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f4d79ffb700 1 -- 172.21.15.80:0/240042072 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d7400a200 con 0x7f4d7c120e30 2019-11-28T11:41:15.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f4d83184700 1 -- 172.21.15.80:0/240042072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7c1281b0 con 0x7f4d7c120e30 2019-11-28T11:41:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f4d81f22700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c120e30 0x7f4d7c13ac90 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f4d74010390 tx=0x7f4d74010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f4d79ffb700 1 -- 172.21.15.80:0/240042072 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4d74009860 con 0x7f4d7c120e30 2019-11-28T11:41:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7f4d81f22700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c120e30 0x7f4d7c13ac90 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f4d74010390 tx=0x7f4d74010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.571+0000 7f4d79ffb700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d5c018770 0x7f4d5c01ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:15.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.571+0000 7f4d79ffb700 1 -- 172.21.15.80:0/240042072 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4d74031d30 con 0x7f4d7c120e30 2019-11-28T11:41:15.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7f4d81721700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d5c018770 0x7f4d5c01ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:15.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7f4d81721700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d5c018770 0x7f4d5c01ac00 crc :-1 s=READY pgs=602 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:15.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.578+0000 7f4d83184700 1 -- 172.21.15.80:0/240042072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7c128fb0 con 0x7f4d7c120e30 2019-11-28T11:41:15.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.582+0000 7f4d81f22700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c120e30 0x7f4d7c13ac90 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f4d74010390 tx=0x7f4d74010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.582+0000 7f4d79ffb700 1 -- 172.21.15.80:0/240042072 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4d740095b0 con 0x7f4d7c120e30 2019-11-28T11:41:15.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.570+0000 7fc0e726a700 1 Processor -- start 2019-11-28T11:41:15.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.571+0000 7fc0e726a700 1 -- start start 2019-11-28T11:41:15.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e726a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc0e006c0a0 0x7fc0e0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:15.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e726a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0e00734e0 0x7fc0e0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:15.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e726a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0e0072360 0x7fc0e0072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:15.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e726a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e006fd60 con 0x7fc0e0072360 2019-11-28T11:41:15.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e726a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e0070030 con 0x7fc0e006c0a0 2019-11-28T11:41:15.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e726a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e006f330 con 0x7fc0e00734e0 2019-11-28T11:41:15.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e6008700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0e0072360 0x7fc0e0072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:15.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e5807700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc0e006c0a0 0x7fc0e0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:15.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e5006700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0e00734e0 0x7fc0e0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:15.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e6008700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0e0072360 0x7fc0e0072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38854/0 (socket says 172.21.15.80:38854) 2019-11-28T11:41:15.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e6008700 1 -- 172.21.15.80:0/1623708355 learned_addr learned my addr 172.21.15.80:0/1623708355 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:15.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e6008700 1 -- 172.21.15.80:0/1623708355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0e00734e0 msgr2=0x7fc0e0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:15.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e6008700 1 --2- 172.21.15.80:0/1623708355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0e00734e0 0x7fc0e0071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:15.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e6008700 1 -- 172.21.15.80:0/1623708355 >> v2:172.21.15.174:3300/0 conn(0x7fc0e006c0a0 msgr2=0x7fc0e0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:15.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e6008700 1 --2- 172.21.15.80:0/1623708355 >> v2:172.21.15.174:3300/0 conn(0x7fc0e006c0a0 0x7fc0e0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:15.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e6008700 1 -- 172.21.15.80:0/1623708355 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e00706c0 con 0x7fc0e0072360 2019-11-28T11:41:15.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e6008700 1 --2- 172.21.15.80:0/1623708355 >> v2:172.21.15.80:3300/0 conn(0x7fc0e0072360 0x7fc0e0072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc0d00088d0 tx=0x7fc0d00087a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e6008700 1 --2- 172.21.15.80:0/1623708355 >> v2:172.21.15.80:3300/0 conn(0x7fc0e0072360 0x7fc0e0072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc0d00088d0 tx=0x7fc0d00087a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.572+0000 7fc0e6008700 1 --2- 172.21.15.80:0/1623708355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0e0072360 0x7fc0e0072800 secure :-1 s=READY pgs=1485 cs=0 l=1 rx=0x7fc0d00088d0 tx=0x7fc0d00087a0).ready entity=mon.0 client_cookie=eda0965ddd61570e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:15.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.573+0000 7fc0e6008700 1 --2- 172.21.15.80:0/1623708355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0e0072360 0x7fc0e0072800 secure :-1 s=THROTTLE_DONE pgs=1485 cs=0 l=1 rx=0x7fc0d00088d0 tx=0x7fc0d00087a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.573+0000 7fc0e4805700 1 -- 172.21.15.80:0/1623708355 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d0000f40 con 0x7fc0e0072360 2019-11-28T11:41:15.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.573+0000 7fc0e6008700 1 --2- 172.21.15.80:0/1623708355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0e0072360 0x7fc0e0072800 secure :-1 s=THROTTLE_DONE pgs=1485 cs=0 l=1 rx=0x7fc0d00088d0 tx=0x7fc0d00087a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.573+0000 7fc0e6008700 1 --2- 172.21.15.80:0/1623708355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0e0072360 0x7fc0e0072800 secure :-1 s=THROTTLE_DONE pgs=1485 cs=0 l=1 rx=0x7fc0d00088d0 tx=0x7fc0d00087a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.573+0000 7fc0e4805700 1 -- 172.21.15.80:0/1623708355 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d0001270 con 0x7fc0e0072360 2019-11-28T11:41:15.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.573+0000 7fc0e4805700 1 -- 172.21.15.80:0/1623708355 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d00019c0 con 0x7fc0e0072360 2019-11-28T11:41:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.573+0000 7fc0e726a700 1 -- 172.21.15.80:0/1623708355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0e0072360 msgr2=0x7fc0e0072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.573+0000 7fc0e726a700 1 --2- 172.21.15.80:0/1623708355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0e0072360 0x7fc0e0072800 secure :-1 s=READY pgs=1485 cs=0 l=1 rx=0x7fc0d00088d0 tx=0x7fc0d00087a0).stop 2019-11-28T11:41:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.573+0000 7fc0e726a700 1 -- 172.21.15.80:0/1623708355 shutdown_connections 2019-11-28T11:41:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.573+0000 7fc0e726a700 1 --2- 172.21.15.80:0/1623708355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0e0072360 0x7fc0e0072800 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.573+0000 7fc0e726a700 1 --2- 172.21.15.80:0/1623708355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0e00734e0 0x7fc0e0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.573+0000 7fc0e726a700 1 --2- 172.21.15.80:0/1623708355 >> v2:172.21.15.174:3300/0 conn(0x7fc0e006c0a0 0x7fc0e0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:15.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.573+0000 7fc0e726a700 1 -- 172.21.15.80:0/1623708355 shutdown_connections 2019-11-28T11:41:15.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.574+0000 7fc0e726a700 1 -- 172.21.15.80:0/1623708355 wait complete. 2019-11-28T11:41:15.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.574+0000 7fc0e726a700 1 -- 172.21.15.80:0/1623708355 >> 172.21.15.80:0/1623708355 conn(0x7fc0e0061cf0 msgr2=0x7fc0e0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:15.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.576+0000 7fc0e726a700 1 Processor -- start 2019-11-28T11:41:15.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.576+0000 7fc0e726a700 1 -- start start 2019-11-28T11:41:15.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0e726a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc0e01653e0 0x7fc0e013d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:15.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0e726a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0e013db60 0x7fc0e013df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:15.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0e726a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e0131680 con 0x7fc0e0164ff0 2019-11-28T11:41:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0e726a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e010dd90 con 0x7fc0e01653e0 2019-11-28T11:41:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0e726a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e010e060 con 0x7fc0e013db60 2019-11-28T11:41:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0e5006700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc0e01653e0 0x7fc0e013d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0e5006700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc0e01653e0 0x7fc0e013d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:53746/0 (socket says 172.21.15.80:53746) 2019-11-28T11:41:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0e5006700 1 -- 172.21.15.80:0/422862000 learned_addr learned my addr 172.21.15.80:0/422862000 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0e6008700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0e013db60 0x7fc0e013df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:15.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0e5006700 1 -- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0e013db60 msgr2=0x7fc0e013df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0de7fc700 1 -- 172.21.15.80:0/422862000 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806136011 0 0) 0x7fc0d8000f30 con 0x7fc0e0164ff0 2019-11-28T11:41:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0e5006700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0e013db60 0x7fc0e013df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0e5006700 1 -- 172.21.15.80:0/422862000 >> v1:172.21.15.174:6789/0 conn(0x7fc0e0164ff0 legacy=0x7fc0e0133820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0e5006700 1 -- 172.21.15.80:0/422862000 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e010e6f0 con 0x7fc0e01653e0 2019-11-28T11:41:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0e6008700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0e013db60 0x7fc0e013df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0e5006700 1 --2- 172.21.15.80:0/422862000 >> v2:172.21.15.174:3300/0 conn(0x7fc0e01653e0 0x7fc0e013d620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc0d4010460 tx=0x7fc0d4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.577+0000 7fc0e5006700 1 --2- 172.21.15.80:0/422862000 >> v2:172.21.15.174:3300/0 conn(0x7fc0e01653e0 0x7fc0e013d620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc0d4010460 tx=0x7fc0d4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.578+0000 7fc0e5006700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e01653e0 0x7fc0e013d620 secure :-1 s=READY pgs=862 cs=0 l=1 rx=0x7fc0d4010460 tx=0x7fc0d4010800).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:15.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.578+0000 7fc0e5006700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e01653e0 0x7fc0e013d620 secure :-1 s=THROTTLE_DONE pgs=862 cs=0 l=1 rx=0x7fc0d4010460 tx=0x7fc0d4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.578+0000 7fc0de7fc700 1 -- 172.21.15.80:0/422862000 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d4005560 con 0x7fc0e01653e0 2019-11-28T11:41:15.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.578+0000 7fc0e5006700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e01653e0 0x7fc0e013d620 secure :-1 s=THROTTLE_DONE pgs=862 cs=0 l=1 rx=0x7fc0d4010460 tx=0x7fc0d4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.578+0000 7fc0e5006700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e01653e0 0x7fc0e013d620 secure :-1 s=THROTTLE_DONE pgs=862 cs=0 l=1 rx=0x7fc0d4010460 tx=0x7fc0d4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.578+0000 7fc0de7fc700 1 -- 172.21.15.80:0/422862000 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d4005180 con 0x7fc0e01653e0 2019-11-28T11:41:15.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.578+0000 7fc0de7fc700 1 -- 172.21.15.80:0/422862000 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d4005b40 con 0x7fc0e01653e0 2019-11-28T11:41:15.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.578+0000 7fc0e726a700 1 -- 172.21.15.80:0/422862000 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e010ea70 con 0x7fc0e01653e0 2019-11-28T11:41:15.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.578+0000 7fc0e726a700 1 -- 172.21.15.80:0/422862000 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e010e6f0 con 0x7fc0e01653e0 2019-11-28T11:41:15.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.578+0000 7fc0e5006700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e01653e0 0x7fc0e013d620 secure :-1 s=THROTTLE_DONE pgs=862 cs=0 l=1 rx=0x7fc0d4010460 tx=0x7fc0d4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.578+0000 7fc0de7fc700 1 -- 172.21.15.80:0/422862000 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc0d4005370 con 0x7fc0e01653e0 2019-11-28T11:41:15.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.579+0000 7fc0de7fc700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0c0018730 0x7fc0c001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:15.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.579+0000 7fc0e5807700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0c0018730 0x7fc0c001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:15.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.579+0000 7fc0e5807700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0c0018730 0x7fc0c001abc0 crc :-1 s=READY pgs=603 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:15.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.581+0000 7fc0e5006700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e01653e0 0x7fc0e013d620 secure :-1 s=THROTTLE_DONE pgs=862 cs=0 l=1 rx=0x7fc0d4010460 tx=0x7fc0d4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.581+0000 7fc0de7fc700 1 -- 172.21.15.80:0/422862000 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc0d4005370 con 0x7fc0e01653e0 2019-11-28T11:41:15.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.586+0000 7fc0e726a700 1 -- 172.21.15.80:0/422862000 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e010ea70 con 0x7fc0e01653e0 2019-11-28T11:41:15.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.590+0000 7fc0e5006700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e01653e0 0x7fc0e013d620 secure :-1 s=THROTTLE_DONE pgs=862 cs=0 l=1 rx=0x7fc0d4010460 tx=0x7fc0d4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.590+0000 7fc0de7fc700 1 -- 172.21.15.80:0/422862000 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc0d4009240 con 0x7fc0e01653e0 2019-11-28T11:41:15.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.769+0000 7f2db507f700 1 -- 172.21.15.80:0/4101922491 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f2db0104a00 con 0x7f2db0135760 2019-11-28T11:41:15.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.771+0000 7f4d83184700 1 -- 172.21.15.80:0/240042072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f4d7c129330 con 0x7f4d7c120e30 2019-11-28T11:41:15.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.777+0000 7fc0e726a700 1 -- 172.21.15.80:0/422862000 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fc0e010e6f0 con 0x7fc0e01653e0 2019-11-28T11:41:15.920 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:41:15.883+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:41:15.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.889+0000 7f4d81f22700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c120e30 0x7f4d7c13ac90 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f4d74010390 tx=0x7f4d74010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.889+0000 7f4d79ffb700 1 -- 172.21.15.80:0/240042072 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 8226 v77) v1 ==== 95+0+0 (secure 0 0 0) 0x7f4d740095b0 con 0x7f4d7c120e30 2019-11-28T11:41:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.889+0000 7f2daf59e700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db0135760 0x7f2db0137480 secure :-1 s=THROTTLE_DONE pgs=860 cs=0 l=1 rx=0x7f2da8010700 tx=0x7f2da8010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.889+0000 7f2da7fff700 1 -- 172.21.15.80:0/4101922491 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7747 v77) v1 ==== 95+0+0 (secure 0 0 0) 0x7f2da8001060 con 0x7f2db0135760 2019-11-28T11:41:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.889+0000 7fc0e5006700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e01653e0 0x7fc0e013d620 secure :-1 s=THROTTLE_DONE pgs=862 cs=0 l=1 rx=0x7fc0d4010460 tx=0x7fc0d4010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:15.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.889+0000 7fc0de7fc700 1 -- 172.21.15.80:0/422862000 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6107 v77) v1 ==== 95+0+0 (secure 0 0 0) 0x7fc0d4005370 con 0x7fc0e01653e0 2019-11-28T11:41:15.925 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 6107 2019-11-28T11:41:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.893+0000 7fc0e726a700 1 -- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0c0018730 msgr2=0x7fc0c001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.893+0000 7fc0e726a700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0c0018730 0x7fc0c001abc0 crc :-1 s=READY pgs=603 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:15.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.893+0000 7fc0e726a700 1 -- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e01653e0 msgr2=0x7fc0e013d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.893+0000 7fc0e726a700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e01653e0 0x7fc0e013d620 secure :-1 s=READY pgs=862 cs=0 l=1 rx=0x7fc0d4010460 tx=0x7fc0d4010800).stop 2019-11-28T11:41:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.893+0000 7fc0e726a700 1 -- 172.21.15.80:0/422862000 shutdown_connections 2019-11-28T11:41:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.893+0000 7fc0e726a700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0e013db60 0x7fc0e013df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.893+0000 7fc0e726a700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e01653e0 0x7fc0e013d620 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.893+0000 7fc0e726a700 1 --2- 172.21.15.80:0/422862000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0c0018730 0x7fc0c001abc0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:15.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.893+0000 7fc0e726a700 1 -- 172.21.15.80:0/422862000 shutdown_connections 2019-11-28T11:41:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.893+0000 7fc0e726a700 1 -- 172.21.15.80:0/422862000 wait complete. 2019-11-28T11:41:15.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.893+0000 7fc0e726a700 1 -- 172.21.15.80:0/422862000 >> 172.21.15.80:0/422862000 conn(0x7fc0e011bfc0 msgr2=0x7fc0e0141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:15.937 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:41:15.966 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 7747 2019-11-28T11:41:15.967 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 8226 2019-11-28T11:41:15.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.935+0000 7f2db507f700 1 -- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d94018770 msgr2=0x7f2d9401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.935+0000 7f2db507f700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d94018770 0x7f2d9401abe0 crc :-1 s=READY pgs=601 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:15.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.935+0000 7f2db507f700 1 -- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db0135760 msgr2=0x7f2db0137480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.935+0000 7f2db507f700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db0135760 0x7f2db0137480 secure :-1 s=READY pgs=860 cs=0 l=1 rx=0x7f2da8010700 tx=0x7f2da8010500).stop 2019-11-28T11:41:15.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.935+0000 7f2db507f700 1 -- 172.21.15.80:0/4101922491 shutdown_connections 2019-11-28T11:41:15.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.935+0000 7f2db507f700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d94018770 0x7f2d9401abe0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:15.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.935+0000 7f2db507f700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2db01330b0 0x7f2db0133540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:15.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.935+0000 7f2db507f700 1 --2- 172.21.15.80:0/4101922491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db0135760 0x7f2db0137480 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:15.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.935+0000 7f2db507f700 1 -- 172.21.15.80:0/4101922491 shutdown_connections 2019-11-28T11:41:15.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.935+0000 7f2db507f700 1 -- 172.21.15.80:0/4101922491 wait complete. 2019-11-28T11:41:15.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.935+0000 7f2db507f700 1 -- 172.21.15.80:0/4101922491 >> 172.21.15.80:0/4101922491 conn(0x7f2db013d930 msgr2=0x7f2db0102360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:15.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.937+0000 7f4d83184700 1 -- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d5c018770 msgr2=0x7f4d5c01ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.937+0000 7f4d83184700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d5c018770 0x7f4d5c01ac00 crc :-1 s=READY pgs=602 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:15.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.937+0000 7f4d83184700 1 -- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c120e30 msgr2=0x7f4d7c13ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:15.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.937+0000 7f4d83184700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c120e30 0x7f4d7c13ac90 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f4d74010390 tx=0x7f4d74010730).stop 2019-11-28T11:41:15.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.937+0000 7f4d83184700 1 -- 172.21.15.80:0/240042072 shutdown_connections 2019-11-28T11:41:15.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.937+0000 7f4d83184700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d7c120e30 0x7f4d7c13ac90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:15.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.937+0000 7f4d83184700 1 --2- 172.21.15.80:0/240042072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d5c018770 0x7f4d5c01ac00 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:15.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.937+0000 7f4d83184700 1 -- 172.21.15.80:0/240042072 shutdown_connections 2019-11-28T11:41:15.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.937+0000 7f4d83184700 1 -- 172.21.15.80:0/240042072 wait complete. 2019-11-28T11:41:15.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:15.937+0000 7f4d83184700 1 -- 172.21.15.80:0/240042072 >> 172.21.15.80:0/240042072 conn(0x7f4d7c127dc0 msgr2=0x7f4d7c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:15.979 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:41:15.980 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:41:15.980 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:41:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.132+0000 7f6c9dce8700 1 Processor -- start 2019-11-28T11:41:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.132+0000 7f6c9dce8700 1 -- start start 2019-11-28T11:41:16.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.133+0000 7f6c9dce8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6c9806c490 0x7f6c9806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:16.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.133+0000 7f6c9dce8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c9806ce60 0x7f6c98164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:16.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.133+0000 7f6c9dce8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9806db00 con 0x7f6c9806c0a0 2019-11-28T11:41:16.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.133+0000 7f6c9dce8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9806fd60 con 0x7f6c9806ce60 2019-11-28T11:41:16.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.133+0000 7f6c9dce8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c98070030 con 0x7f6c9806c490 2019-11-28T11:41:16.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.133+0000 7f6c9ca86700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c9806ce60 0x7f6c98164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:16.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.133+0000 7f6c9ca86700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c9806ce60 0x7f6c98164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38870/0 (socket says 172.21.15.80:38870) 2019-11-28T11:41:16.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.133+0000 7f6c9ca86700 1 -- 172.21.15.80:0/2215733617 learned_addr learned my addr 172.21.15.80:0/2215733617 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:16.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.133+0000 7f6c97fff700 1 --1- 172.21.15.80:0/2215733617 >> v1:172.21.15.174:6789/0 conn(0x7f6c9806c0a0 0x7f6c98072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:53726/0 (socket says 172.21.15.80:53726) 2019-11-28T11:41:16.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.133+0000 7f6c8ffff700 1 --2- 172.21.15.80:0/2215733617 >> v2:172.21.15.174:3300/0 conn(0x7f6c9806c490 0x7f6c9806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:16.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.133+0000 7f6c9ca86700 1 -- 172.21.15.80:0/2215733617 >> v2:172.21.15.174:3300/0 conn(0x7f6c9806c490 msgr2=0x7f6c9806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:16.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.133+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/2215733617 >> v2:172.21.15.174:3300/0 conn(0x7f6c9806c490 0x7f6c9806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:16.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.133+0000 7f6c9ca86700 1 -- 172.21.15.80:0/2215733617 >> v1:172.21.15.174:6789/0 conn(0x7f6c9806c0a0 legacy=0x7f6c98072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:16.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.133+0000 7f6c9ca86700 1 -- 172.21.15.80:0/2215733617 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c980706c0 con 0x7f6c9806ce60 2019-11-28T11:41:16.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.133+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/2215733617 >> v2:172.21.15.80:3300/0 conn(0x7f6c9806ce60 0x7f6c98164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6c9000fab0 tx=0x7f6c900080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.134+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/2215733617 >> v2:172.21.15.80:3300/0 conn(0x7f6c9806ce60 0x7f6c98164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6c9000fab0 tx=0x7f6c900080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.134+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/2215733617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9806ce60 0x7f6c98164d70 secure :-1 s=READY pgs=1486 cs=0 l=1 rx=0x7f6c9000fab0 tx=0x7f6c900080d0).ready entity=mon.0 client_cookie=d92c72fc85b3e1be server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:16.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.134+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/2215733617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9806ce60 0x7f6c98164d70 secure :-1 s=THROTTLE_DONE pgs=1486 cs=0 l=1 rx=0x7f6c9000fab0 tx=0x7f6c900080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.134+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/2215733617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9806ce60 0x7f6c98164d70 secure :-1 s=THROTTLE_DONE pgs=1486 cs=0 l=1 rx=0x7f6c9000fab0 tx=0x7f6c900080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.134+0000 7f6c977fe700 1 -- 172.21.15.80:0/2215733617 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c90000df0 con 0x7f6c9806ce60 2019-11-28T11:41:16.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.134+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/2215733617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9806ce60 0x7f6c98164d70 secure :-1 s=THROTTLE_DONE pgs=1486 cs=0 l=1 rx=0x7f6c9000fab0 tx=0x7f6c900080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.134+0000 7f6c977fe700 1 -- 172.21.15.80:0/2215733617 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c90001460 con 0x7f6c9806ce60 2019-11-28T11:41:16.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.134+0000 7f6c977fe700 1 -- 172.21.15.80:0/2215733617 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c90001b30 con 0x7f6c9806ce60 2019-11-28T11:41:16.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.134+0000 7f6c9dce8700 1 -- 172.21.15.80:0/2215733617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9806ce60 msgr2=0x7f6c98164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:16.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.134+0000 7f6c9dce8700 1 --2- 172.21.15.80:0/2215733617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9806ce60 0x7f6c98164d70 secure :-1 s=READY pgs=1486 cs=0 l=1 rx=0x7f6c9000fab0 tx=0x7f6c900080d0).stop 2019-11-28T11:41:16.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.134+0000 7f6c9dce8700 1 -- 172.21.15.80:0/2215733617 shutdown_connections 2019-11-28T11:41:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.134+0000 7f6c9dce8700 1 --2- 172.21.15.80:0/2215733617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9806ce60 0x7f6c98164d70 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.134+0000 7f6c9dce8700 1 --2- 172.21.15.80:0/2215733617 >> v2:172.21.15.174:3300/0 conn(0x7f6c9806c490 0x7f6c9806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.134+0000 7f6c9dce8700 1 -- 172.21.15.80:0/2215733617 shutdown_connections 2019-11-28T11:41:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.134+0000 7f6c9dce8700 1 -- 172.21.15.80:0/2215733617 wait complete. 2019-11-28T11:41:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.134+0000 7f6c9dce8700 1 -- 172.21.15.80:0/2215733617 >> 172.21.15.80:0/2215733617 conn(0x7f6c98061cf0 msgr2=0x7f6c98064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.137+0000 7f6c9dce8700 1 Processor -- start 2019-11-28T11:41:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.137+0000 7f6c9dce8700 1 -- start start 2019-11-28T11:41:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9dce8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c9812e050 0x7f6c9812e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9dce8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c9812ea20 0x7f6c9810d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9dce8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9812ff40 con 0x7f6c98128990 2019-11-28T11:41:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9dce8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c98131c70 con 0x7f6c9812ea20 2019-11-28T11:41:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9dce8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c98131f40 con 0x7f6c9812e050 2019-11-28T11:41:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c97fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6c98128990 0x7f6c98117fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38188/0 (socket says 172.21.15.80:38188) 2019-11-28T11:41:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c97fff700 1 -- 172.21.15.80:0/33496730 learned_addr learned my addr 172.21.15.80:0/33496730 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/33496730 >> v2:172.21.15.80:3300/0 conn(0x7f6c9812ea20 0x7f6c9810d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c8ffff700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c9812e050 0x7f6c9812e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c957fa700 1 -- 172.21.15.80:0/33496730 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784010292 0 0) 0x7f6c88001100 con 0x7f6c98128990 2019-11-28T11:41:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c957fa700 1 -- 172.21.15.80:0/33496730 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c7c002e80 con 0x7f6c98128990 2019-11-28T11:41:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9ca86700 1 -- 172.21.15.80:0/33496730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c9812e050 msgr2=0x7f6c9812e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c9812e050 0x7f6c9812e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9ca86700 1 -- 172.21.15.80:0/33496730 >> v1:172.21.15.80:6789/0 conn(0x7f6c98128990 legacy=0x7f6c98117fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9ca86700 1 -- 172.21.15.80:0/33496730 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c981325d0 con 0x7f6c9812ea20 2019-11-28T11:41:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/33496730 >> v2:172.21.15.80:3300/0 conn(0x7f6c9812ea20 0x7f6c9810d560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6c900106d0 tx=0x7f6c90010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/33496730 >> v2:172.21.15.80:3300/0 conn(0x7f6c9812ea20 0x7f6c9810d560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6c900106d0 tx=0x7f6c90010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9812ea20 0x7f6c9810d560 secure :-1 s=READY pgs=1488 cs=0 l=1 rx=0x7f6c900106d0 tx=0x7f6c90010550).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9812ea20 0x7f6c9810d560 secure :-1 s=THROTTLE_DONE pgs=1488 cs=0 l=1 rx=0x7f6c900106d0 tx=0x7f6c90010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c957fa700 1 -- 172.21.15.80:0/33496730 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c90001820 con 0x7f6c9812ea20 2019-11-28T11:41:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9dce8700 1 -- 172.21.15.80:0/33496730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c98132950 con 0x7f6c9812ea20 2019-11-28T11:41:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9812ea20 0x7f6c9810d560 secure :-1 s=THROTTLE_DONE pgs=1488 cs=0 l=1 rx=0x7f6c900106d0 tx=0x7f6c90010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9812ea20 0x7f6c9810d560 secure :-1 s=THROTTLE_DONE pgs=1488 cs=0 l=1 rx=0x7f6c900106d0 tx=0x7f6c90010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.138+0000 7f6c957fa700 1 -- 172.21.15.80:0/33496730 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c90007e50 con 0x7f6c9812ea20 2019-11-28T11:41:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.139+0000 7f6c957fa700 1 -- 172.21.15.80:0/33496730 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c90001820 con 0x7f6c9812ea20 2019-11-28T11:41:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.139+0000 7f6c9dce8700 1 -- 172.21.15.80:0/33496730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c981325d0 con 0x7f6c9812ea20 2019-11-28T11:41:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.139+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9812ea20 0x7f6c9810d560 secure :-1 s=THROTTLE_DONE pgs=1488 cs=0 l=1 rx=0x7f6c900106d0 tx=0x7f6c90010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.140+0000 7f6c957fa700 1 -- 172.21.15.80:0/33496730 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6c90001440 con 0x7f6c9812ea20 2019-11-28T11:41:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.140+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9812ea20 0x7f6c9810d560 secure :-1 s=THROTTLE_DONE pgs=1488 cs=0 l=1 rx=0x7f6c900106d0 tx=0x7f6c90010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.140+0000 7f6c957fa700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c7c018770 0x7f6c7c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.140+0000 7f6c957fa700 1 -- 172.21.15.80:0/33496730 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f6c90031d00 con 0x7f6c9812ea20 2019-11-28T11:41:16.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.140+0000 7f6c97fff700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c7c018770 0x7f6c7c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:16.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.140+0000 7f6c97fff700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c7c018770 0x7f6c7c01abe0 crc :-1 s=READY pgs=604 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:16.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.147+0000 7f6c9dce8700 1 -- 172.21.15.80:0/33496730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c98132950 con 0x7f6c9812ea20 2019-11-28T11:41:16.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.150+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9812ea20 0x7f6c9810d560 secure :-1 s=THROTTLE_DONE pgs=1488 cs=0 l=1 rx=0x7f6c900106d0 tx=0x7f6c90010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.150+0000 7f6c957fa700 1 -- 172.21.15.80:0/33496730 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6c90001230 con 0x7f6c9812ea20 2019-11-28T11:41:16.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.325+0000 7f6c9dce8700 1 -- 172.21.15.80:0/33496730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6c981325d0 con 0x7f6c9812ea20 2019-11-28T11:41:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.326+0000 7f6c9ca86700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9812ea20 0x7f6c9810d560 secure :-1 s=THROTTLE_DONE pgs=1488 cs=0 l=1 rx=0x7f6c900106d0 tx=0x7f6c90010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.326+0000 7f6c957fa700 1 -- 172.21.15.80:0/33496730 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+31774 (secure 0 0 0) 0x7f6c90001440 con 0x7f6c9812ea20 2019-11-28T11:41:16.361 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:16.362 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:41:16.362 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 110, 2019-11-28T11:41:16.362 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:41:16.362 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:41:16.362 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:41:15.788772+0000", 2019-11-28T11:41:16.362 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:41:16.362 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:41:16.363 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:41:16.363 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:41:16.363 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:41:16.363 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:41:16.363 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:41:16.363 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:41:16.363 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:41:16.364 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:41:16.364 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:41:16.364 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:41:16.364 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:41:16.364 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:41:16.364 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:41:16.365 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 17, 2019-11-28T11:41:16.365 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:41:16.365 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:41:16.365 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:41:16.365 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:41:16.365 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:41:16.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.366 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:41:16.366 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:41:16.366 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:41:16.366 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:41:16.366 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:41:16.366 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:41:16.367 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:41:16.367 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:41:16.367 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:41:16.367 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:41:16.367 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:41:16.367 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:41:16.368 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:41:16.368 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:41:16.368 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:41:16.368 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:41:16.368 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:41:16.368 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:41:16.368 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:41:16.369 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:41:16.369 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:41:16.369 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:41:16.369 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:41:16.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.369 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:41:16.369 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:41:16.370 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:41:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:41:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:41:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:41:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:41:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:41:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:41:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:41:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:41:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:41:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:41:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:41:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:41:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:41:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:41:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:41:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:41:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:41:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:41:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:41:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:41:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:41:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:41:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:41:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:41:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:41:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:41:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:41:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:41:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:41:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:41:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:41:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:41:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:41:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:41:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:41:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:41:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:41:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:41:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 16, 2019-11-28T11:41:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:41:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:41:00.409798+0000", 2019-11-28T11:41:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:41:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:41:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:41:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:41:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:41:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:41:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:41:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:41:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:41:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:41:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:41:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:41:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:41:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:41:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:41:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:41:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:41:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:41:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:41:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:41:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "106", 2019-11-28T11:41:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:41:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:41:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:41:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:41:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:41:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:41:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:41:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:41:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:41:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:41:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:41:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:41:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:41:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:41:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:41:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:41:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:41:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:41:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:41:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:41:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:41:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:41:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:41:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:41:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:41:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:41:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:41:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:41:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:41:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:41:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:41:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:41:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:41:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:41:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:41:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:41:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:41:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:41:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:41:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:41:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:41:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:41:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:41:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:41:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 17, 2019-11-28T11:41:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:41:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:41:01.100729+0000", 2019-11-28T11:41:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:41:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:41:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:41:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:41:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:41:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:41:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:41:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:41:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:41:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:41:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:41:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:41:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:41:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:41:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:41:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:41:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:41:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:41:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:41:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:41:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "107", 2019-11-28T11:41:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:41:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:41:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:41:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:41:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:41:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:41:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:41:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:41:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:41:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:41:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:41:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:41:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:41:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:41:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:41:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:41:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:41:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:41:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:41:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:41:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:41:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:41:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:41:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:41:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:41:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:41:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:41:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:41:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:41:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:41:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:41:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:41:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:41:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:41:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:41:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:41:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:41:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:41:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:41:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:41:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:41:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:41:16.402 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:41:16.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.402 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:41:16.402 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:41:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:41:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:41:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:41:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:41:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:41:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:41:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:41:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 105, 2019-11-28T11:41:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:41:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:41:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:41:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:41:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:41:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:41:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:41:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:41:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:41:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:41:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:41:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:41:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:41:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:41:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:41:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:41:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:41:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:41:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.412 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:41:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:41:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:41:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:41:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:41:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:41:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:41:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:41:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:41:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:41:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:41:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:41:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:41:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:41:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:41:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:41:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:41:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:41:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:41:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:41:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 91, 2019-11-28T11:41:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:41:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:41:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:41:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:41:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:41:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:41:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:41:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:41:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:41:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:41:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:41:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:41:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:41:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:41:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:41:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:41:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:41:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:41:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:41:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:41:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:41:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:41:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:41:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:41:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:41:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:41:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:41:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:41:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:41:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:41:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:41:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:41:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:41:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:41:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:41:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:41:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:41:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:41:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 104, 2019-11-28T11:41:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:41:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:41:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:41:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:41:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:41:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:41:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:41:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:41:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:41:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:41:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:41:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:41:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:41:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:41:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:41:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:41:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:41:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:41:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:41:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:41:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:41:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:41:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:41:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:41:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:41:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:41:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:41:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:41:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:41:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:41:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:41:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:41:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:41:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:41:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:41:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:41:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:41:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:41:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 104, 2019-11-28T11:41:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:41:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:41:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:41:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:41:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:41:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:41:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:41:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:41:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:41:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:41:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:41:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:41:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:41:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:41:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:41:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:41:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:41:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:41:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:41:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:41:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:41:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:41:16.455 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:41:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:41:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:41:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:41:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:41:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:41:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:41:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:41:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:41:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:41:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:41:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:41:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:41:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:41:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:41:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:41:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 105, 2019-11-28T11:41:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:41:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:41:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:41:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:41:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:41:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:41:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:41:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:41:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:41:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:41:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:41:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:41:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:41:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:41:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:41:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:41:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:41:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:41:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.470 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:41:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:41:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:41:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:41:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:41:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:41:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:41:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:41:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:41:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:41:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:41:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:41:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:41:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:41:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:41:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:41:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:41:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:41:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:41:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:41:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 104, 2019-11-28T11:41:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:41:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:41:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:41:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:41:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:41:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.477 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.477 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:41:16.477 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:41:16.477 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.477 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.478 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:41:16.478 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.478 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.478 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:41:16.479 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:41:16.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.479 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.479 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:41:16.480 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:41:16.480 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.480 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.480 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:41:16.480 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.481 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.481 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:41:16.481 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:41:16.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.481 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.481 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:41:16.482 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:41:16.482 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.482 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.482 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:41:16.482 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.483 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.483 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:41:16.483 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:41:16.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.483 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.483 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:41:16.484 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:41:16.484 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.484 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.484 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:41:16.484 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:41:16.485 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:41:16.485 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:41:16.485 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:41:16.485 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:41:16.485 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:41:16.485 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.486 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:41:16.486 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:41:16.486 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:41:16.486 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:41:16.486 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:41:16.487 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:41:16.487 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:41:16.487 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:41:16.487 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:41:16.487 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 105, 2019-11-28T11:41:16.487 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:41:16.488 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:41:16.488 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:41:16.488 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.488 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.489 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:41:16.489 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:41:16.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.489 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.489 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:41:16.489 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:41:16.490 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.490 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.490 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:41:16.491 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.491 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.491 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:41:16.492 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:41:16.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.492 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.492 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:41:16.493 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:41:16.493 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.493 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.493 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:41:16.493 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.494 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.494 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:41:16.494 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:41:16.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.494 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.495 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:41:16.495 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:41:16.495 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.495 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.495 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:41:16.495 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.496 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.496 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:41:16.496 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:41:16.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.496 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.497 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:41:16.497 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:41:16.497 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.497 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.498 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:41:16.498 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:41:16.498 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:41:16.498 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:41:16.498 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:41:16.498 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:41:16.499 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:41:16.499 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.499 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:41:16.499 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:41:16.500 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:41:16.500 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:41:16.500 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:41:16.500 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:41:16.500 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:41:16.500 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:41:16.501 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:41:16.501 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 105, 2019-11-28T11:41:16.501 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:41:16.501 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:41:16.501 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:41:16.501 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.502 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.502 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:41:16.502 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:41:16.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.502 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.503 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:41:16.503 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:41:16.503 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.503 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.503 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:41:16.503 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.504 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.504 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:41:16.504 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:41:16.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.505 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.505 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:41:16.505 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:41:16.505 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.505 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.505 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:41:16.506 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.506 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.506 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:41:16.506 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:41:16.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.507 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.507 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:41:16.507 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:41:16.507 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.507 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.508 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:41:16.508 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:41:16.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.508 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:41:16.508 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:41:16.508 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:41:16.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.509 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:41:16.509 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:41:16.509 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:41:16.509 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.509 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.510 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:41:16.510 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:41:16.510 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:41:16.510 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:41:16.510 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:41:16.510 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:41:16.510 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:41:16.511 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:16.511 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.511 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:41:16.511 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:41:16.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.511 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:41:16.511 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:41:16.512 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:41:16.512 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:41:16.512 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:41:16.512 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:41:16.512 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:41:16.512 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:41:16.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.513 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:41:16.513 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:41:16.513 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:41:16.513 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:41:16.514 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:41:16.514 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:41:16.514 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:41:16.514 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:41:16.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.514 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:41:16.515 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:41:16.515 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:41:16.515 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:41:16.515 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:41:16.515 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:41:16.515 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:41:16.515 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:41:16.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.516 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:41:16.516 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:41:16.516 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:41:16.516 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:41:16.517 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:41:16.517 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:41:16.517 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:41:16.517 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:41:16.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.517 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:41:16.518 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:41:16.518 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:41:16.518 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:41:16.518 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:41:16.518 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:41:16.518 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:41:16.518 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:41:16.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.519 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:41:16.519 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:41:16.519 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:41:16.520 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:41:16.520 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:41:16.520 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:41:16.520 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:41:16.520 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:41:16.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.521 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:41:16.521 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:41:16.521 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:41:16.521 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:41:16.521 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:41:16.521 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:41:16.521 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:41:16.522 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:41:16.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:16.522 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:41:16.522 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:41:16.522 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:41:16.522 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:41:16.523 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:41:16.523 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:41:16.523 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:41:16.523 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:41:16.523 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.523 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:41:16.524 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:41:16.524 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:41:16.524 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:41:16.524 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:41:16.524 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:41:16.524 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/332155288": "2019-11-29T11:41:15.771500+0000", 2019-11-28T11:41:16.525 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/332155288": "2019-11-29T11:41:15.771500+0000" 2019-11-28T11:41:16.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.525 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:41:16.525 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:41:16.525 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:41:16.526 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:41:16.526 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:41:16.526 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:41:16.526 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:41:16.526 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:41:16.527 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:41:16.527 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:41:16.527 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:41:16.527 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:41:16.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.528 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:41:16.528 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:41:16.528 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:41:16.528 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:41:16.528 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:41:16.529 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:41:16.529 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:41:16.529 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:16.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:16.529 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:41:16.529 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:41:16.529 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:41:16.530 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:41:16.530 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:41:16.530 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:41:16.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.330+0000 7f6c9dce8700 1 -- 172.21.15.80:0/33496730 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c7c018770 msgr2=0x7f6c7c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:16.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.330+0000 7f6c9dce8700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c7c018770 0x7f6c7c01abe0 crc :-1 s=READY pgs=604 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:16.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.330+0000 7f6c9dce8700 1 -- 172.21.15.80:0/33496730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9812ea20 msgr2=0x7f6c9810d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:16.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.330+0000 7f6c9dce8700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9812ea20 0x7f6c9810d560 secure :-1 s=READY pgs=1488 cs=0 l=1 rx=0x7f6c900106d0 tx=0x7f6c90010550).stop 2019-11-28T11:41:16.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.330+0000 7f6c9dce8700 1 -- 172.21.15.80:0/33496730 shutdown_connections 2019-11-28T11:41:16.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.330+0000 7f6c9dce8700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c7c018770 0x7f6c7c01abe0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:16.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.330+0000 7f6c9dce8700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c9812ea20 0x7f6c9810d560 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:16.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.330+0000 7f6c9dce8700 1 --2- 172.21.15.80:0/33496730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c9812e050 0x7f6c9812e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:16.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.330+0000 7f6c9dce8700 1 -- 172.21.15.80:0/33496730 shutdown_connections 2019-11-28T11:41:16.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.330+0000 7f6c9dce8700 1 -- 172.21.15.80:0/33496730 wait complete. 2019-11-28T11:41:16.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.330+0000 7f6c9dce8700 1 -- 172.21.15.80:0/33496730 >> 172.21.15.80:0/33496730 conn(0x7f6c9807c6e0 msgr2=0x7f6c981050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:16.535 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:41:16.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.621+0000 7eff77af6700 1 Processor -- start 2019-11-28T11:41:16.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.621+0000 7eff77af6700 1 -- start start 2019-11-28T11:41:16.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.622+0000 7eff77af6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff7006c0a0 0x7eff70072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:16.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.622+0000 7eff77af6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff700734e0 0x7eff70071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:16.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.622+0000 7eff77af6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7006db00 con 0x7eff70072360 2019-11-28T11:41:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.622+0000 7eff77af6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7006fd60 con 0x7eff7006c0a0 2019-11-28T11:41:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.622+0000 7eff77af6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff70070030 con 0x7eff700734e0 2019-11-28T11:41:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.622+0000 7eff76093700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff7006c0a0 0x7eff70072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.622+0000 7eff76093700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff7006c0a0 0x7eff70072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38880/0 (socket says 172.21.15.80:38880) 2019-11-28T11:41:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.622+0000 7eff76093700 1 -- 172.21.15.80:0/2391813136 learned_addr learned my addr 172.21.15.80:0/2391813136 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff75892700 1 --2- 172.21.15.80:0/2391813136 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff700734e0 0x7eff70071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff76093700 1 -- 172.21.15.80:0/2391813136 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff700734e0 msgr2=0x7eff70071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff76093700 1 --2- 172.21.15.80:0/2391813136 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff700734e0 0x7eff70071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff76093700 1 -- 172.21.15.80:0/2391813136 >> v1:172.21.15.174:6789/0 conn(0x7eff70072360 legacy=0x7eff7006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff76093700 1 -- 172.21.15.80:0/2391813136 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff700706c0 con 0x7eff7006c0a0 2019-11-28T11:41:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff75892700 1 --2- 172.21.15.80:0/2391813136 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff700734e0 0x7eff70071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:41:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff76093700 1 --2- 172.21.15.80:0/2391813136 >> v2:172.21.15.80:3300/0 conn(0x7eff7006c0a0 0x7eff70072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7eff5800f740 tx=0x7eff5800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff76093700 1 --2- 172.21.15.80:0/2391813136 >> v2:172.21.15.80:3300/0 conn(0x7eff7006c0a0 0x7eff70072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7eff5800f740 tx=0x7eff5800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff76093700 1 --2- 172.21.15.80:0/2391813136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff7006c0a0 0x7eff70072fa0 secure :-1 s=READY pgs=1489 cs=0 l=1 rx=0x7eff5800f740 tx=0x7eff5800fae0).ready entity=mon.0 client_cookie=1795cfb47a97c185 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff76093700 1 --2- 172.21.15.80:0/2391813136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff7006c0a0 0x7eff70072fa0 secure :-1 s=THROTTLE_DONE pgs=1489 cs=0 l=1 rx=0x7eff5800f740 tx=0x7eff5800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff76093700 1 --2- 172.21.15.80:0/2391813136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff7006c0a0 0x7eff70072fa0 secure :-1 s=THROTTLE_DONE pgs=1489 cs=0 l=1 rx=0x7eff5800f740 tx=0x7eff5800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff75091700 1 -- 172.21.15.80:0/2391813136 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff58000960 con 0x7eff7006c0a0 2019-11-28T11:41:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff76093700 1 --2- 172.21.15.80:0/2391813136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff7006c0a0 0x7eff70072fa0 secure :-1 s=THROTTLE_DONE pgs=1489 cs=0 l=1 rx=0x7eff5800f740 tx=0x7eff5800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff75091700 1 -- 172.21.15.80:0/2391813136 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff58000c90 con 0x7eff7006c0a0 2019-11-28T11:41:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff75091700 1 -- 172.21.15.80:0/2391813136 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff580013a0 con 0x7eff7006c0a0 2019-11-28T11:41:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff77af6700 1 -- 172.21.15.80:0/2391813136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff7006c0a0 msgr2=0x7eff70072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.623+0000 7eff77af6700 1 --2- 172.21.15.80:0/2391813136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff7006c0a0 0x7eff70072fa0 secure :-1 s=READY pgs=1489 cs=0 l=1 rx=0x7eff5800f740 tx=0x7eff5800fae0).stop 2019-11-28T11:41:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.624+0000 7eff77af6700 1 -- 172.21.15.80:0/2391813136 shutdown_connections 2019-11-28T11:41:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.624+0000 7eff77af6700 1 --2- 172.21.15.80:0/2391813136 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff700734e0 0x7eff70071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.624+0000 7eff77af6700 1 --2- 172.21.15.80:0/2391813136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff7006c0a0 0x7eff70072fa0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.624+0000 7eff77af6700 1 -- 172.21.15.80:0/2391813136 shutdown_connections 2019-11-28T11:41:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.624+0000 7eff77af6700 1 -- 172.21.15.80:0/2391813136 wait complete. 2019-11-28T11:41:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.624+0000 7eff77af6700 1 -- 172.21.15.80:0/2391813136 >> 172.21.15.80:0/2391813136 conn(0x7eff70061cf0 msgr2=0x7eff70064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:16.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.626+0000 7eff77af6700 1 Processor -- start 2019-11-28T11:41:16.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.626+0000 7eff77af6700 1 -- start start 2019-11-28T11:41:16.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.627+0000 7eff77af6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff70143180 0x7eff7012e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:16.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.627+0000 7eff77af6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7eff7013efb0 0x7eff7013da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:16.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.627+0000 7eff77af6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7007b6d0 con 0x7eff7013eb20 2019-11-28T11:41:16.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.627+0000 7eff77af6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff701142a0 con 0x7eff7013efb0 2019-11-28T11:41:16.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.627+0000 7eff77af6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff70114a00 con 0x7eff70143180 2019-11-28T11:41:16.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.627+0000 7eff75892700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7eff7013eb20 0x7eff70128990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38202/0 (socket says 172.21.15.80:38202) 2019-11-28T11:41:16.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.627+0000 7eff75892700 1 -- 172.21.15.80:0/1602843545 learned_addr learned my addr 172.21.15.80:0/1602843545 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:16.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.627+0000 7eff76894700 1 --2- 172.21.15.80:0/1602843545 >> v2:172.21.15.174:3300/0 conn(0x7eff7013efb0 0x7eff7013da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:16.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.627+0000 7eff76093700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff70143180 0x7eff7012e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:16.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff6effd700 1 -- 172.21.15.80:0/1602843545 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424729611 0 0) 0x7eff60009c90 con 0x7eff7013eb20 2019-11-28T11:41:16.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff6effd700 1 -- 172.21.15.80:0/1602843545 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff54002e80 con 0x7eff7013eb20 2019-11-28T11:41:16.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff76093700 1 -- 172.21.15.80:0/1602843545 >> v2:172.21.15.174:3300/0 conn(0x7eff7013efb0 msgr2=0x7eff7013da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:16.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff76093700 1 --2- 172.21.15.80:0/1602843545 >> v2:172.21.15.174:3300/0 conn(0x7eff7013efb0 0x7eff7013da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:16.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff76093700 1 -- 172.21.15.80:0/1602843545 >> v1:172.21.15.80:6789/0 conn(0x7eff7013eb20 legacy=0x7eff70128990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:16.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff76093700 1 -- 172.21.15.80:0/1602843545 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7015b580 con 0x7eff70143180 2019-11-28T11:41:16.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff76894700 1 --2- 172.21.15.80:0/1602843545 >> v2:172.21.15.174:3300/0 conn(0x7eff7013efb0 0x7eff7013da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:16.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff76093700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff70143180 0x7eff7012e6d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff58010390 tx=0x7eff58010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff76093700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff70143180 0x7eff7012e6d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff58010390 tx=0x7eff58010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff76093700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff70143180 0x7eff7012e6d0 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7eff58010390 tx=0x7eff58010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:16.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff76093700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff70143180 0x7eff7012e6d0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7eff58010390 tx=0x7eff58010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff6effd700 1 -- 172.21.15.80:0/1602843545 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff58000940 con 0x7eff70143180 2019-11-28T11:41:16.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff76093700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff70143180 0x7eff7012e6d0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7eff58010390 tx=0x7eff58010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff77af6700 1 -- 172.21.15.80:0/1602843545 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff7015c660 con 0x7eff70143180 2019-11-28T11:41:16.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff6effd700 1 -- 172.21.15.80:0/1602843545 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff58000940 con 0x7eff70143180 2019-11-28T11:41:16.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff76093700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff70143180 0x7eff7012e6d0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7eff58010390 tx=0x7eff58010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff6effd700 1 -- 172.21.15.80:0/1602843545 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff58001140 con 0x7eff70143180 2019-11-28T11:41:16.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.628+0000 7eff77af6700 1 -- 172.21.15.80:0/1602843545 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7015b580 con 0x7eff70143180 2019-11-28T11:41:16.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.629+0000 7eff76093700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff70143180 0x7eff7012e6d0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7eff58010390 tx=0x7eff58010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.629+0000 7eff76093700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff70143180 0x7eff7012e6d0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7eff58010390 tx=0x7eff58010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.629+0000 7eff6effd700 1 -- 172.21.15.80:0/1602843545 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7eff58000d60 con 0x7eff70143180 2019-11-28T11:41:16.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.629+0000 7eff6effd700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff54018770 0x7eff5401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:16.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.629+0000 7eff6effd700 1 -- 172.21.15.80:0/1602843545 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6106+0+0 (secure 0 0 0) 0x7eff580319d0 con 0x7eff70143180 2019-11-28T11:41:16.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.629+0000 7eff75892700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff54018770 0x7eff5401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:16.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.629+0000 7eff75892700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff54018770 0x7eff5401abe0 crc :-1 s=READY pgs=605 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:16.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.636+0000 7eff77af6700 1 -- 172.21.15.80:0/1602843545 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff7015c660 con 0x7eff70143180 2019-11-28T11:41:16.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.640+0000 7eff76093700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff70143180 0x7eff7012e6d0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7eff58010390 tx=0x7eff58010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.640+0000 7eff6effd700 1 -- 172.21.15.80:0/1602843545 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7eff58000b30 con 0x7eff70143180 2019-11-28T11:41:16.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.815+0000 7eff77af6700 1 -- 172.21.15.80:0/1602843545 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff7015b580 con 0x7eff70143180 2019-11-28T11:41:16.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.816+0000 7eff76093700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff70143180 0x7eff7012e6d0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7eff58010390 tx=0x7eff58010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:16.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.816+0000 7eff6effd700 1 -- 172.21.15.80:0/1602843545 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+1428 (secure 0 0 0) 0x7eff580179d0 con 0x7eff70143180 2019-11-28T11:41:16.849 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 77 2019-11-28T11:41:16.849 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:16.850 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":77,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:02.122819+0000","modified":"2019-11-28T11:41:15.884673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2019-11-28T11:41:16.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.818+0000 7eff77af6700 1 -- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff54018770 msgr2=0x7eff5401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:16.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.818+0000 7eff77af6700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff54018770 0x7eff5401abe0 crc :-1 s=READY pgs=605 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:16.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.818+0000 7eff77af6700 1 -- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff70143180 msgr2=0x7eff7012e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:16.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.818+0000 7eff77af6700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff70143180 0x7eff7012e6d0 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7eff58010390 tx=0x7eff58010730).stop 2019-11-28T11:41:16.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.818+0000 7eff77af6700 1 -- 172.21.15.80:0/1602843545 shutdown_connections 2019-11-28T11:41:16.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.818+0000 7eff77af6700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7eff54018770 0x7eff5401abe0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:16.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.818+0000 7eff77af6700 1 --2- 172.21.15.80:0/1602843545 >> v2:172.21.15.174:3300/0 conn(0x7eff7013efb0 0x7eff7013da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:16.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.818+0000 7eff77af6700 1 --2- 172.21.15.80:0/1602843545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff70143180 0x7eff7012e6d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:16.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.818+0000 7eff77af6700 1 -- 172.21.15.80:0/1602843545 shutdown_connections 2019-11-28T11:41:16.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.818+0000 7eff77af6700 1 -- 172.21.15.80:0/1602843545 wait complete. 2019-11-28T11:41:16.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.818+0000 7eff77af6700 1 -- 172.21.15.80:0/1602843545 >> 172.21.15.80:0/1602843545 conn(0x7eff7013d620 msgr2=0x7eff70140470 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:16.861 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:41:17.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.953+0000 7f725a09d700 1 Processor -- start 2019-11-28T11:41:17.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.953+0000 7f725a09d700 1 -- start start 2019-11-28T11:41:17.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f725a09d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f725406c0a0 0x7f7254072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:17.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f725a09d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7254072620 0x7f7254164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:17.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f725a09d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725406db00 con 0x7f72540734e0 2019-11-28T11:41:17.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f725a09d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725406fd60 con 0x7f725406c0a0 2019-11-28T11:41:17.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f725a09d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7254070030 con 0x7f7254072620 2019-11-28T11:41:17.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f7258e3b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7254072620 0x7f7254164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:17.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f7253fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f725406c0a0 0x7f7254072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:17.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f7253fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f725406c0a0 0x7f7254072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:53780/0 (socket says 172.21.15.80:53780) 2019-11-28T11:41:17.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f7258e3b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7254072620 0x7f7254164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:41158/0 (socket says 172.21.15.80:41158) 2019-11-28T11:41:17.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f724bfff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f72540734e0 0x7f7254071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:53754/0 (socket says 172.21.15.80:53754) 2019-11-28T11:41:17.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f7253fff700 1 -- 172.21.15.80:0/1071581337 learned_addr learned my addr 172.21.15.80:0/1071581337 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:17.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f72537fe700 1 -- 172.21.15.80:0/1071581337 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667529150 0 0) 0x7f723c001080 con 0x7f72540734e0 2019-11-28T11:41:17.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f72537fe700 1 -- 172.21.15.80:0/1071581337 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7240002e80 con 0x7f72540734e0 2019-11-28T11:41:17.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f7253fff700 1 -- 172.21.15.80:0/1071581337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7254072620 msgr2=0x7f7254164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:17.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f7253fff700 1 --2- 172.21.15.80:0/1071581337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7254072620 0x7f7254164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:17.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f7253fff700 1 -- 172.21.15.80:0/1071581337 >> v1:172.21.15.174:6789/0 conn(0x7f72540734e0 legacy=0x7f7254071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:17.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f7253fff700 1 -- 172.21.15.80:0/1071581337 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72540706c0 con 0x7f725406c0a0 2019-11-28T11:41:17.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f7258e3b700 1 --2- 172.21.15.80:0/1071581337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7254072620 0x7f7254164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f7253fff700 1 --2- 172.21.15.80:0/1071581337 >> v2:172.21.15.174:3300/0 conn(0x7f725406c0a0 0x7f7254072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f724400f740 tx=0x7f724400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f7253fff700 1 --2- 172.21.15.80:0/1071581337 >> v2:172.21.15.174:3300/0 conn(0x7f725406c0a0 0x7f7254072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f724400f740 tx=0x7f724400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.954+0000 7f7253fff700 1 --2- 172.21.15.80:0/1071581337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f725406c0a0 0x7f7254072fa0 secure :-1 s=READY pgs=866 cs=0 l=1 rx=0x7f724400f740 tx=0x7f724400fae0).ready entity=mon.1 client_cookie=fe420c3e4b5f5c82 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.955+0000 7f7253fff700 1 --2- 172.21.15.80:0/1071581337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f725406c0a0 0x7f7254072fa0 secure :-1 s=THROTTLE_DONE pgs=866 cs=0 l=1 rx=0x7f724400f740 tx=0x7f724400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.955+0000 7f72537fe700 1 -- 172.21.15.80:0/1071581337 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7244000960 con 0x7f725406c0a0 2019-11-28T11:41:17.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.955+0000 7f7253fff700 1 --2- 172.21.15.80:0/1071581337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f725406c0a0 0x7f7254072fa0 secure :-1 s=THROTTLE_DONE pgs=866 cs=0 l=1 rx=0x7f724400f740 tx=0x7f724400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:17.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.955+0000 7f7253fff700 1 --2- 172.21.15.80:0/1071581337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f725406c0a0 0x7f7254072fa0 secure :-1 s=THROTTLE_DONE pgs=866 cs=0 l=1 rx=0x7f724400f740 tx=0x7f724400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:17.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.955+0000 7f72537fe700 1 -- 172.21.15.80:0/1071581337 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7244000c90 con 0x7f725406c0a0 2019-11-28T11:41:17.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.955+0000 7f72537fe700 1 -- 172.21.15.80:0/1071581337 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72440013a0 con 0x7f725406c0a0 2019-11-28T11:41:17.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.955+0000 7f725a09d700 1 -- 172.21.15.80:0/1071581337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f725406c0a0 msgr2=0x7f7254072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:17.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.955+0000 7f725a09d700 1 --2- 172.21.15.80:0/1071581337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f725406c0a0 0x7f7254072fa0 secure :-1 s=READY pgs=866 cs=0 l=1 rx=0x7f724400f740 tx=0x7f724400fae0).stop 2019-11-28T11:41:17.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.955+0000 7f725a09d700 1 -- 172.21.15.80:0/1071581337 shutdown_connections 2019-11-28T11:41:17.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.955+0000 7f725a09d700 1 --2- 172.21.15.80:0/1071581337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7254072620 0x7f7254164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.955+0000 7f725a09d700 1 --2- 172.21.15.80:0/1071581337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f725406c0a0 0x7f7254072fa0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.955+0000 7f725a09d700 1 -- 172.21.15.80:0/1071581337 shutdown_connections 2019-11-28T11:41:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.955+0000 7f725a09d700 1 -- 172.21.15.80:0/1071581337 wait complete. 2019-11-28T11:41:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.955+0000 7f725a09d700 1 -- 172.21.15.80:0/1071581337 >> 172.21.15.80:0/1071581337 conn(0x7f7254061cf0 msgr2=0x7f7254064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.958+0000 7f725a09d700 1 Processor -- start 2019-11-28T11:41:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.958+0000 7f725a09d700 1 -- start start 2019-11-28T11:41:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f725a09d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7254104820 0x7f725410c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f725a09d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f725410c890 0x7f725410b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f725a09d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725413bcd0 con 0x7f725410b710 2019-11-28T11:41:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f725a09d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7254109130 con 0x7f7254104820 2019-11-28T11:41:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f725a09d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7254109400 con 0x7f725410c890 2019-11-28T11:41:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f7253fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7254104820 0x7f725410c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f7253fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7254104820 0x7f725410c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38900/0 (socket says 172.21.15.80:38900) 2019-11-28T11:41:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f7253fff700 1 -- 172.21.15.80:0/1340121872 learned_addr learned my addr 172.21.15.80:0/1340121872 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f724bfff700 1 --2- 172.21.15.80:0/1340121872 >> v2:172.21.15.174:3300/0 conn(0x7f725410c890 0x7f725410b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f7253fff700 1 -- 172.21.15.80:0/1340121872 >> v2:172.21.15.174:3300/0 conn(0x7f725410c890 msgr2=0x7f725410b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f7253fff700 1 --2- 172.21.15.80:0/1340121872 >> v2:172.21.15.174:3300/0 conn(0x7f725410c890 0x7f725410b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f7253fff700 1 -- 172.21.15.80:0/1340121872 >> v1:172.21.15.174:6789/0 conn(0x7f725410b710 legacy=0x7f7254104c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f7253fff700 1 -- 172.21.15.80:0/1340121872 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7254109a90 con 0x7f7254104820 2019-11-28T11:41:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f7253fff700 1 --2- 172.21.15.80:0/1340121872 >> v2:172.21.15.80:3300/0 conn(0x7f7254104820 0x7f725410c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7244054470 tx=0x7f7244007370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f7253fff700 1 --2- 172.21.15.80:0/1340121872 >> v2:172.21.15.80:3300/0 conn(0x7f7254104820 0x7f725410c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7244054470 tx=0x7f7244007370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f7253fff700 1 --2- 172.21.15.80:0/1340121872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7254104820 0x7f725410c350 secure :-1 s=READY pgs=1491 cs=0 l=1 rx=0x7f7244054470 tx=0x7f7244007370).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f7253fff700 1 --2- 172.21.15.80:0/1340121872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7254104820 0x7f725410c350 secure :-1 s=THROTTLE_DONE pgs=1491 cs=0 l=1 rx=0x7f7244054470 tx=0x7f7244007370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f72517fa700 1 -- 172.21.15.80:0/1340121872 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7244005560 con 0x7f7254104820 2019-11-28T11:41:17.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f7253fff700 1 --2- 172.21.15.80:0/1340121872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7254104820 0x7f725410c350 secure :-1 s=THROTTLE_DONE pgs=1491 cs=0 l=1 rx=0x7f7244054470 tx=0x7f7244007370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:17.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f7253fff700 1 --2- 172.21.15.80:0/1340121872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7254104820 0x7f725410c350 secure :-1 s=THROTTLE_DONE pgs=1491 cs=0 l=1 rx=0x7f7244054470 tx=0x7f7244007370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:17.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f72517fa700 1 -- 172.21.15.80:0/1340121872 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7244007e60 con 0x7f7254104820 2019-11-28T11:41:17.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f725a09d700 1 -- 172.21.15.80:0/1340121872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7254109e10 con 0x7f7254104820 2019-11-28T11:41:17.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f72517fa700 1 -- 172.21.15.80:0/1340121872 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7244005220 con 0x7f7254104820 2019-11-28T11:41:17.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.959+0000 7f725a09d700 1 -- 172.21.15.80:0/1340121872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7254109a90 con 0x7f7254104820 2019-11-28T11:41:17.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.960+0000 7f7253fff700 1 --2- 172.21.15.80:0/1340121872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7254104820 0x7f725410c350 secure :-1 s=THROTTLE_DONE pgs=1491 cs=0 l=1 rx=0x7f7244054470 tx=0x7f7244007370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.960+0000 7f72517fa700 1 -- 172.21.15.80:0/1340121872 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7244005220 con 0x7f7254104820 2019-11-28T11:41:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.960+0000 7f7253fff700 1 --2- 172.21.15.80:0/1340121872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7254104820 0x7f725410c350 secure :-1 s=THROTTLE_DONE pgs=1491 cs=0 l=1 rx=0x7f7244054470 tx=0x7f7244007370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.960+0000 7f72517fa700 1 --2- 172.21.15.80:0/1340121872 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7238018730 0x7f723801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.960+0000 7f72517fa700 1 -- 172.21.15.80:0/1340121872 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f7244075aa0 con 0x7f7254104820 2019-11-28T11:41:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.961+0000 7f724bfff700 1 --2- 172.21.15.80:0/1340121872 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7238018730 0x7f723801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.962+0000 7f724bfff700 1 --2- 172.21.15.80:0/1340121872 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7238018730 0x7f723801abc0 crc :-1 s=READY pgs=606 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.968+0000 7f725a09d700 1 -- 172.21.15.80:0/1340121872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7254109e10 con 0x7f7254104820 2019-11-28T11:41:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.971+0000 7f7253fff700 1 --2- 172.21.15.80:0/1340121872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7254104820 0x7f725410c350 secure :-1 s=THROTTLE_DONE pgs=1491 cs=0 l=1 rx=0x7f7244054470 tx=0x7f7244007370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:17.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:16.971+0000 7f72517fa700 1 -- 172.21.15.80:0/1340121872 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f72440080f0 con 0x7f7254104820 2019-11-28T11:41:17.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:17.135+0000 7f725a09d700 1 -- 172.21.15.80:0/1340121872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7254109a90 con 0x7f7254104820 2019-11-28T11:41:17.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:17.908+0000 7f7253fff700 1 --2- 172.21.15.80:0/1340121872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7254104820 0x7f725410c350 secure :-1 s=THROTTLE_DONE pgs=1491 cs=0 l=1 rx=0x7f7244054470 tx=0x7f7244007370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:17.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:17.908+0000 7f72517fa700 1 -- 172.21.15.80:0/1340121872 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v78) v1 ==== 161+0+0 (secure 0 0 0) 0x7f72440052a0 con 0x7f7254104820 2019-11-28T11:41:17.983 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:41:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:17.952+0000 7f725a09d700 1 -- 172.21.15.80:0/1340121872 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7238018730 msgr2=0x7f723801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:17.952+0000 7f725a09d700 1 --2- 172.21.15.80:0/1340121872 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7238018730 0x7f723801abc0 crc :-1 s=READY pgs=606 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:17.952+0000 7f725a09d700 1 -- 172.21.15.80:0/1340121872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7254104820 msgr2=0x7f725410c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:17.952+0000 7f725a09d700 1 --2- 172.21.15.80:0/1340121872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7254104820 0x7f725410c350 secure :-1 s=READY pgs=1491 cs=0 l=1 rx=0x7f7244054470 tx=0x7f7244007370).stop 2019-11-28T11:41:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:17.952+0000 7f725a09d700 1 -- 172.21.15.80:0/1340121872 shutdown_connections 2019-11-28T11:41:17.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:17.952+0000 7f725a09d700 1 --2- 172.21.15.80:0/1340121872 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7238018730 0x7f723801abc0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:17.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:17.952+0000 7f725a09d700 1 --2- 172.21.15.80:0/1340121872 >> v2:172.21.15.174:3300/0 conn(0x7f725410c890 0x7f725410b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:17.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:17.952+0000 7f725a09d700 1 --2- 172.21.15.80:0/1340121872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7254104820 0x7f725410c350 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:17.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:17.953+0000 7f725a09d700 1 -- 172.21.15.80:0/1340121872 shutdown_connections 2019-11-28T11:41:17.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:17.953+0000 7f725a09d700 1 -- 172.21.15.80:0/1340121872 wait complete. 2019-11-28T11:41:17.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:17.953+0000 7f725a09d700 1 -- 172.21.15.80:0/1340121872 >> 172.21.15.80:0/1340121872 conn(0x7f725413d620 msgr2=0x7f725413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:17.996 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:41:18.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.082+0000 7f2bc5bf9700 1 Processor -- start 2019-11-28T11:41:18.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.082+0000 7f2bc5bf9700 1 -- start start 2019-11-28T11:41:18.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bc5bf9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c0a0 0x7f2bc0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:18.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bc5bf9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2bc00734e0 0x7f2bc0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:18.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bc5bf9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc006db00 con 0x7f2bc0072360 2019-11-28T11:41:18.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bc5bf9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc006f330 con 0x7f2bc00734e0 2019-11-28T11:41:18.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bc5bf9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc00706c0 con 0x7f2bc006c0a0 2019-11-28T11:41:18.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bb7fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2bc00734e0 0x7f2bc0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:18.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bbffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c0a0 0x7f2bc0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:18.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bb7fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2bc00734e0 0x7f2bc0071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:53794/0 (socket says 172.21.15.80:53794) 2019-11-28T11:41:18.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bb7fff700 1 -- 172.21.15.80:0/1363311578 learned_addr learned my addr 172.21.15.80:0/1363311578 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:18.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bc4997700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f2bc0072360 0x7f2bc006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:53770/0 (socket says 172.21.15.80:53770) 2019-11-28T11:41:18.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bbf7fe700 1 -- 172.21.15.80:0/1363311578 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158668494 0 0) 0x7f2bb8001400 con 0x7f2bc0072360 2019-11-28T11:41:18.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bbf7fe700 1 -- 172.21.15.80:0/1363311578 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bac002e80 con 0x7f2bc0072360 2019-11-28T11:41:18.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bbffff700 1 -- 172.21.15.80:0/1363311578 >> v2:172.21.15.174:3300/0 conn(0x7f2bc00734e0 msgr2=0x7f2bc0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:18.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1363311578 >> v2:172.21.15.174:3300/0 conn(0x7f2bc00734e0 0x7f2bc0071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:18.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bbffff700 1 -- 172.21.15.80:0/1363311578 >> v1:172.21.15.174:6789/0 conn(0x7f2bc0072360 legacy=0x7f2bc006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:18.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bbffff700 1 -- 172.21.15.80:0/1363311578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc0070a40 con 0x7f2bc006c0a0 2019-11-28T11:41:18.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bb7fff700 1 --2- 172.21.15.80:0/1363311578 >> v2:172.21.15.174:3300/0 conn(0x7f2bc00734e0 0x7f2bc0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:18.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1363311578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c0a0 0x7f2bc0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2bb000af50 tx=0x7f2bb000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.083+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1363311578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c0a0 0x7f2bc0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2bb000af50 tx=0x7f2bb000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.084+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1363311578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c0a0 0x7f2bc0072fa0 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7f2bb000af50 tx=0x7f2bb000b760).ready entity=mon.2 client_cookie=4ead29df5a7cd068 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:18.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.084+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1363311578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c0a0 0x7f2bc0072fa0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f2bb000af50 tx=0x7f2bb000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.084+0000 7f2bbf7fe700 1 -- 172.21.15.80:0/1363311578 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bb0007210 con 0x7f2bc006c0a0 2019-11-28T11:41:18.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.084+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1363311578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c0a0 0x7f2bc0072fa0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f2bb000af50 tx=0x7f2bb000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.084+0000 7f2bbffff700 1 --2- 172.21.15.80:0/1363311578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c0a0 0x7f2bc0072fa0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f2bb000af50 tx=0x7f2bb000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.084+0000 7f2bbf7fe700 1 -- 172.21.15.80:0/1363311578 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb00099b0 con 0x7f2bc006c0a0 2019-11-28T11:41:18.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.084+0000 7f2bbf7fe700 1 -- 172.21.15.80:0/1363311578 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bb0009ba0 con 0x7f2bc006c0a0 2019-11-28T11:41:18.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.084+0000 7f2bc5bf9700 1 -- 172.21.15.80:0/1363311578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c0a0 msgr2=0x7f2bc0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:18.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.084+0000 7f2bc5bf9700 1 --2- 172.21.15.80:0/1363311578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c0a0 0x7f2bc0072fa0 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7f2bb000af50 tx=0x7f2bb000b760).stop 2019-11-28T11:41:18.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.084+0000 7f2bc5bf9700 1 -- 172.21.15.80:0/1363311578 shutdown_connections 2019-11-28T11:41:18.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.084+0000 7f2bc5bf9700 1 --2- 172.21.15.80:0/1363311578 >> v2:172.21.15.174:3300/0 conn(0x7f2bc00734e0 0x7f2bc0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:18.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.084+0000 7f2bc5bf9700 1 --2- 172.21.15.80:0/1363311578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc006c0a0 0x7f2bc0072fa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:18.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.084+0000 7f2bc5bf9700 1 -- 172.21.15.80:0/1363311578 shutdown_connections 2019-11-28T11:41:18.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.084+0000 7f2bc5bf9700 1 -- 172.21.15.80:0/1363311578 wait complete. 2019-11-28T11:41:18.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.084+0000 7f2bc5bf9700 1 -- 172.21.15.80:0/1363311578 >> 172.21.15.80:0/1363311578 conn(0x7f2bc0061cf0 msgr2=0x7f2bc0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:18.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.087+0000 7f2bc5bf9700 1 Processor -- start 2019-11-28T11:41:18.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.087+0000 7f2bc5bf9700 1 -- start start 2019-11-28T11:41:18.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.088+0000 7f2bc5bf9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2bc013e9e0 0x7f2bc0108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:18.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.088+0000 7f2bc5bf9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc0109430 0x7f2bc01098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:18.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.088+0000 7f2bc5bf9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc01066e0 con 0x7f2bc013e5f0 2019-11-28T11:41:18.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.088+0000 7f2bc5bf9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc010e060 con 0x7f2bc013e9e0 2019-11-28T11:41:18.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.088+0000 7f2bc5bf9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc010e330 con 0x7f2bc0109430 2019-11-28T11:41:18.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.088+0000 7f2bb7fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2bc013e9e0 0x7f2bc0108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:18.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.088+0000 7f2bc4997700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc0109430 0x7f2bc01098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:18.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.088+0000 7f2bb7fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2bc013e9e0 0x7f2bc0108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:53800/0 (socket says 172.21.15.80:53800) 2019-11-28T11:41:18.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.088+0000 7f2bb7fff700 1 -- 172.21.15.80:0/695870578 learned_addr learned my addr 172.21.15.80:0/695870578 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:18.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.088+0000 7f2bc4997700 1 -- 172.21.15.80:0/695870578 >> v2:172.21.15.174:3300/0 conn(0x7f2bc013e9e0 msgr2=0x7f2bc0108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:18.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.088+0000 7f2bc4997700 1 --2- 172.21.15.80:0/695870578 >> v2:172.21.15.174:3300/0 conn(0x7f2bc013e9e0 0x7f2bc0108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:18.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.088+0000 7f2bc4997700 1 -- 172.21.15.80:0/695870578 >> v1:172.21.15.174:6789/0 conn(0x7f2bc013e5f0 legacy=0x7f2bc010a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:18.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.088+0000 7f2bc4997700 1 -- 172.21.15.80:0/695870578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc010e9c0 con 0x7f2bc0109430 2019-11-28T11:41:18.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.088+0000 7f2bc4997700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc0109430 0x7f2bc01098a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2bb80106e0 tx=0x7f2bb8010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.088+0000 7f2bc4997700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc0109430 0x7f2bc01098a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2bb80106e0 tx=0x7f2bb8010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.088+0000 7f2bc4997700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc0109430 0x7f2bc01098a0 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7f2bb80106e0 tx=0x7f2bb8010560).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:18.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.089+0000 7f2bc4997700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc0109430 0x7f2bc01098a0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f2bb80106e0 tx=0x7f2bb8010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.089+0000 7f2bc4997700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc0109430 0x7f2bc01098a0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f2bb80106e0 tx=0x7f2bb8010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.089+0000 7f2bc4997700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc0109430 0x7f2bc01098a0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f2bb80106e0 tx=0x7f2bb8010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.089+0000 7f2bbd7fa700 1 -- 172.21.15.80:0/695870578 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bb80011f0 con 0x7f2bc0109430 2019-11-28T11:41:18.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.089+0000 7f2bbd7fa700 1 -- 172.21.15.80:0/695870578 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb8000db0 con 0x7f2bc0109430 2019-11-28T11:41:18.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.089+0000 7f2bc5bf9700 1 -- 172.21.15.80:0/695870578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc010ed40 con 0x7f2bc0109430 2019-11-28T11:41:18.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.089+0000 7f2bbd7fa700 1 -- 172.21.15.80:0/695870578 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bb8004b10 con 0x7f2bc0109430 2019-11-28T11:41:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.089+0000 7f2bc5bf9700 1 -- 172.21.15.80:0/695870578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc010e9c0 con 0x7f2bc0109430 2019-11-28T11:41:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.089+0000 7f2bc4997700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc0109430 0x7f2bc01098a0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f2bb80106e0 tx=0x7f2bb8010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.089+0000 7f2bbd7fa700 1 -- 172.21.15.80:0/695870578 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2bb8004540 con 0x7f2bc0109430 2019-11-28T11:41:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.089+0000 7f2bc4997700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc0109430 0x7f2bc01098a0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f2bb80106e0 tx=0x7f2bb8010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.089+0000 7f2bbd7fa700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ba4018730 0x7f2ba401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:18.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.089+0000 7f2bbd7fa700 1 -- 172.21.15.80:0/695870578 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f2bb8031d20 con 0x7f2bc0109430 2019-11-28T11:41:18.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.090+0000 7f2bbffff700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ba4018730 0x7f2ba401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:18.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.090+0000 7f2bbffff700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ba4018730 0x7f2ba401abc0 crc :-1 s=READY pgs=607 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:18.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.097+0000 7f2bc5bf9700 1 -- 172.21.15.80:0/695870578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc010ed40 con 0x7f2bc0109430 2019-11-28T11:41:18.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.101+0000 7f2bc4997700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc0109430 0x7f2bc01098a0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f2bb80106e0 tx=0x7f2bb8010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.101+0000 7f2bbd7fa700 1 -- 172.21.15.80:0/695870578 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2bb80015c0 con 0x7f2bc0109430 2019-11-28T11:41:18.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.278+0000 7f2bc5bf9700 1 -- 172.21.15.80:0/695870578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bc010e9c0 con 0x7f2bc0109430 2019-11-28T11:41:18.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.278+0000 7f2bc4997700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc0109430 0x7f2bc01098a0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f2bb80106e0 tx=0x7f2bb8010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.278+0000 7f2bbd7fa700 1 -- 172.21.15.80:0/695870578 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+1428 (secure 0 0 0) 0x7f2bb8004540 con 0x7f2bc0109430 2019-11-28T11:41:18.312 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 78 2019-11-28T11:41:18.312 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:18.313 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":78,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":78,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:02.122819+0000","modified":"2019-11-28T11:41:17.904709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2019-11-28T11:41:18.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.281+0000 7f2bc5bf9700 1 -- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ba4018730 msgr2=0x7f2ba401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:18.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.281+0000 7f2bc5bf9700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ba4018730 0x7f2ba401abc0 crc :-1 s=READY pgs=607 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:18.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.281+0000 7f2bc5bf9700 1 -- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc0109430 msgr2=0x7f2bc01098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:18.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.281+0000 7f2bc5bf9700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc0109430 0x7f2bc01098a0 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7f2bb80106e0 tx=0x7f2bb8010560).stop 2019-11-28T11:41:18.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.281+0000 7f2bc5bf9700 1 -- 172.21.15.80:0/695870578 shutdown_connections 2019-11-28T11:41:18.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.281+0000 7f2bc5bf9700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bc0109430 0x7f2bc01098a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:18.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.281+0000 7f2bc5bf9700 1 --2- 172.21.15.80:0/695870578 >> v2:172.21.15.174:3300/0 conn(0x7f2bc013e9e0 0x7f2bc0108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:18.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.281+0000 7f2bc5bf9700 1 --2- 172.21.15.80:0/695870578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2ba4018730 0x7f2ba401abc0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:18.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.281+0000 7f2bc5bf9700 1 -- 172.21.15.80:0/695870578 shutdown_connections 2019-11-28T11:41:18.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.281+0000 7f2bc5bf9700 1 -- 172.21.15.80:0/695870578 wait complete. 2019-11-28T11:41:18.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.281+0000 7f2bc5bf9700 1 -- 172.21.15.80:0/695870578 >> 172.21.15.80:0/695870578 conn(0x7f2bc013d620 msgr2=0x7f2bc013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:18.324 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:41:18.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.415+0000 7f90f657c700 1 Processor -- start 2019-11-28T11:41:18.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.415+0000 7f90f657c700 1 -- start start 2019-11-28T11:41:18.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90f657c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90f006c0a0 0x7f90f0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:18.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90f657c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f006db00 con 0x7f90f00734e0 2019-11-28T11:41:18.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90f657c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f006e000 con 0x7f90f0072620 2019-11-28T11:41:18.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90f657c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f006fd60 con 0x7f90f006c0a0 2019-11-28T11:41:18.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90f4b19700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90f006c0a0 0x7f90f0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:18.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90effff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f90f00734e0 0x7f90f0071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38236/0 (socket says 172.21.15.80:38236) 2019-11-28T11:41:18.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90effff700 1 -- 172.21.15.80:0/3747279783 learned_addr learned my addr 172.21.15.80:0/3747279783 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:18.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90f4b19700 1 -- 172.21.15.80:0/3747279783 >> v1:172.21.15.174:6789/0 conn(0x7f90f0072620 legacy=0x7f90f0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:18.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90f4b19700 1 -- 172.21.15.80:0/3747279783 >> v1:172.21.15.80:6789/0 conn(0x7f90f00734e0 legacy=0x7f90f0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:18.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90f4b19700 1 -- 172.21.15.80:0/3747279783 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f00706c0 con 0x7f90f006c0a0 2019-11-28T11:41:18.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90ef7fe700 1 -- 172.21.15.80:0/3747279783 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991434184 0 0) 0x7f90e0001150 con 0x7f90f00734e0 2019-11-28T11:41:18.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90f4b19700 1 --2- 172.21.15.80:0/3747279783 >> v2:172.21.15.80:3300/0 conn(0x7f90f006c0a0 0x7f90f0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f90d800af50 tx=0x7f90d800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90f4b19700 1 --2- 172.21.15.80:0/3747279783 >> v2:172.21.15.80:3300/0 conn(0x7f90f006c0a0 0x7f90f0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f90d800af50 tx=0x7f90d800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90f4b19700 1 --2- 172.21.15.80:0/3747279783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f006c0a0 0x7f90f0072fa0 secure :-1 s=READY pgs=1493 cs=0 l=1 rx=0x7f90d800af50 tx=0x7f90d800b760).ready entity=mon.0 client_cookie=fc7295df1bd48631 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:18.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90f4b19700 1 --2- 172.21.15.80:0/3747279783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f006c0a0 0x7f90f0072fa0 secure :-1 s=THROTTLE_DONE pgs=1493 cs=0 l=1 rx=0x7f90d800af50 tx=0x7f90d800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90ef7fe700 1 -- 172.21.15.80:0/3747279783 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90d8000960 con 0x7f90f006c0a0 2019-11-28T11:41:18.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90f4b19700 1 --2- 172.21.15.80:0/3747279783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f006c0a0 0x7f90f0072fa0 secure :-1 s=THROTTLE_DONE pgs=1493 cs=0 l=1 rx=0x7f90d800af50 tx=0x7f90d800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90f4b19700 1 --2- 172.21.15.80:0/3747279783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f006c0a0 0x7f90f0072fa0 secure :-1 s=THROTTLE_DONE pgs=1493 cs=0 l=1 rx=0x7f90d800af50 tx=0x7f90d800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90ef7fe700 1 -- 172.21.15.80:0/3747279783 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d8000960 con 0x7f90f006c0a0 2019-11-28T11:41:18.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90ef7fe700 1 -- 172.21.15.80:0/3747279783 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90d8009ce0 con 0x7f90f006c0a0 2019-11-28T11:41:18.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90f657c700 1 -- 172.21.15.80:0/3747279783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f006c0a0 msgr2=0x7f90f0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:18.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.416+0000 7f90f657c700 1 --2- 172.21.15.80:0/3747279783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f006c0a0 0x7f90f0072fa0 secure :-1 s=READY pgs=1493 cs=0 l=1 rx=0x7f90d800af50 tx=0x7f90d800b760).stop 2019-11-28T11:41:18.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.417+0000 7f90f657c700 1 -- 172.21.15.80:0/3747279783 shutdown_connections 2019-11-28T11:41:18.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.417+0000 7f90f657c700 1 --2- 172.21.15.80:0/3747279783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f006c0a0 0x7f90f0072fa0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:18.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.417+0000 7f90f657c700 1 -- 172.21.15.80:0/3747279783 shutdown_connections 2019-11-28T11:41:18.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.417+0000 7f90f657c700 1 -- 172.21.15.80:0/3747279783 wait complete. 2019-11-28T11:41:18.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.417+0000 7f90f657c700 1 -- 172.21.15.80:0/3747279783 >> 172.21.15.80:0/3747279783 conn(0x7f90f0061cf0 msgr2=0x7f90f0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:18.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.419+0000 7f90f657c700 1 Processor -- start 2019-11-28T11:41:18.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.420+0000 7f90f657c700 1 -- start start 2019-11-28T11:41:18.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f657c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90f01342c0 0x7f90f01346b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:18.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f657c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90f01361c0 0x7f90f015c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:18.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f657c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f013f410 con 0x7f90f0136650 2019-11-28T11:41:18.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f657c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f0141670 con 0x7f90f01342c0 2019-11-28T11:41:18.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f657c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f0141940 con 0x7f90f01361c0 2019-11-28T11:41:18.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f4b19700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90f01342c0 0x7f90f01346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:18.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f4b19700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90f01342c0 0x7f90f01346b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38926/0 (socket says 172.21.15.80:38926) 2019-11-28T11:41:18.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f4b19700 1 -- 172.21.15.80:0/1549163200 learned_addr learned my addr 172.21.15.80:0/1549163200 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:18.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90effff700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90f01361c0 0x7f90f015c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:18.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f4b19700 1 -- 172.21.15.80:0/1549163200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90f01361c0 msgr2=0x7f90f015c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:18.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f4b19700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90f01361c0 0x7f90f015c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:18.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f4b19700 1 -- 172.21.15.80:0/1549163200 >> v1:172.21.15.174:6789/0 conn(0x7f90f0136650 legacy=0x7f90f015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:18.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f4b19700 1 -- 172.21.15.80:0/1549163200 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f0141fd0 con 0x7f90f01342c0 2019-11-28T11:41:18.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f4b19700 1 --2- 172.21.15.80:0/1549163200 >> v2:172.21.15.80:3300/0 conn(0x7f90f01342c0 0x7f90f01346b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f90d8010400 tx=0x7f90d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f4b19700 1 --2- 172.21.15.80:0/1549163200 >> v2:172.21.15.80:3300/0 conn(0x7f90f01342c0 0x7f90f01346b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f90d8010400 tx=0x7f90d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f4b19700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f01342c0 0x7f90f01346b0 secure :-1 s=READY pgs=1494 cs=0 l=1 rx=0x7f90d8010400 tx=0x7f90d8010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:18.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f4b19700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f01342c0 0x7f90f01346b0 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7f90d8010400 tx=0x7f90d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f4b19700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f01342c0 0x7f90f01346b0 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7f90d8010400 tx=0x7f90d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90ed7fa700 1 -- 172.21.15.80:0/1549163200 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90d8000940 con 0x7f90f01342c0 2019-11-28T11:41:18.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f4b19700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f01342c0 0x7f90f01346b0 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7f90d8010400 tx=0x7f90d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90ed7fa700 1 -- 172.21.15.80:0/1549163200 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d8009980 con 0x7f90f01342c0 2019-11-28T11:41:18.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f657c700 1 -- 172.21.15.80:0/1549163200 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f0142350 con 0x7f90f01342c0 2019-11-28T11:41:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90ed7fa700 1 -- 172.21.15.80:0/1549163200 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90d800a0d0 con 0x7f90f01342c0 2019-11-28T11:41:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.421+0000 7f90f657c700 1 -- 172.21.15.80:0/1549163200 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f0141fd0 con 0x7f90f01342c0 2019-11-28T11:41:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.422+0000 7f90f4b19700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f01342c0 0x7f90f01346b0 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7f90d8010400 tx=0x7f90d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.422+0000 7f90ed7fa700 1 -- 172.21.15.80:0/1549163200 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f90d8009b70 con 0x7f90f01342c0 2019-11-28T11:41:18.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.422+0000 7f90f4b19700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f01342c0 0x7f90f01346b0 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7f90d8010400 tx=0x7f90d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.422+0000 7f90ed7fa700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90d4018730 0x7f90d401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:18.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.422+0000 7f90ed7fa700 1 -- 172.21.15.80:0/1549163200 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f90d8031b10 con 0x7f90f01342c0 2019-11-28T11:41:18.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.422+0000 7f90effff700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90d4018730 0x7f90d401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:18.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.422+0000 7f90effff700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90d4018730 0x7f90d401abc0 crc :-1 s=READY pgs=608 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:18.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.430+0000 7f90f657c700 1 -- 172.21.15.80:0/1549163200 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f0142350 con 0x7f90f01342c0 2019-11-28T11:41:18.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.433+0000 7f90f4b19700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f01342c0 0x7f90f01346b0 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7f90d8010400 tx=0x7f90d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.433+0000 7f90ed7fa700 1 -- 172.21.15.80:0/1549163200 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f90d8009580 con 0x7f90f01342c0 2019-11-28T11:41:18.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.607+0000 7f90f657c700 1 -- 172.21.15.80:0/1549163200 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f90f0141fd0 con 0x7f90f01342c0 2019-11-28T11:41:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.914+0000 7f90f4b19700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f01342c0 0x7f90f01346b0 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7f90d8010400 tx=0x7f90d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:18.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.914+0000 7f90ed7fa700 1 -- 172.21.15.80:0/1549163200 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v79) v1 ==== 104+0+0 (secure 0 0 0) 0x7f90d8009b70 con 0x7f90f01342c0 2019-11-28T11:41:18.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.924+0000 7f90f657c700 1 -- 172.21.15.80:0/1549163200 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90d4018730 msgr2=0x7f90d401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:18.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.924+0000 7f90f657c700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90d4018730 0x7f90d401abc0 crc :-1 s=READY pgs=608 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:18.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.924+0000 7f90f657c700 1 -- 172.21.15.80:0/1549163200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f01342c0 msgr2=0x7f90f01346b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:18.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.924+0000 7f90f657c700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f01342c0 0x7f90f01346b0 secure :-1 s=READY pgs=1494 cs=0 l=1 rx=0x7f90d8010400 tx=0x7f90d8010280).stop 2019-11-28T11:41:18.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.924+0000 7f90f657c700 1 -- 172.21.15.80:0/1549163200 shutdown_connections 2019-11-28T11:41:18.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.924+0000 7f90f657c700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90d4018730 0x7f90d401abc0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:18.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.924+0000 7f90f657c700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90f01361c0 0x7f90f015c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:18.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.924+0000 7f90f657c700 1 --2- 172.21.15.80:0/1549163200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90f01342c0 0x7f90f01346b0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:18.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.924+0000 7f90f657c700 1 -- 172.21.15.80:0/1549163200 shutdown_connections 2019-11-28T11:41:18.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.924+0000 7f90f657c700 1 -- 172.21.15.80:0/1549163200 wait complete. 2019-11-28T11:41:18.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:18.924+0000 7f90f657c700 1 -- 172.21.15.80:0/1549163200 >> 172.21.15.80:0/1549163200 conn(0x7f90f0159ae0 msgr2=0x7f90f013d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:18.969 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:41:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.059+0000 7f04580bc700 1 Processor -- start 2019-11-28T11:41:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.059+0000 7f04580bc700 1 -- start start 2019-11-28T11:41:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.060+0000 7f04580bc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f045015ed10 0x7f045015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:19.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.060+0000 7f04580bc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045006db60 con 0x7f0450073020 2019-11-28T11:41:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.060+0000 7f04580bc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045006e060 con 0x7f04500734b0 2019-11-28T11:41:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.060+0000 7f04580bc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045006fe00 con 0x7f045015ed10 2019-11-28T11:41:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0455e58700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0450073020 0x7f0450071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38254/0 (socket says 172.21.15.80:38254) 2019-11-28T11:41:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0455e58700 1 -- 172.21.15.80:0/253480028 learned_addr learned my addr 172.21.15.80:0/253480028 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0456659700 1 --2- 172.21.15.80:0/253480028 >> v2:172.21.15.174:3300/0 conn(0x7f045015ed10 0x7f045015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0455657700 1 -- 172.21.15.80:0/253480028 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585529178 0 0) 0x7f0438001070 con 0x7f0450073020 2019-11-28T11:41:19.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0455657700 1 -- 172.21.15.80:0/253480028 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f043c002e80 con 0x7f0450073020 2019-11-28T11:41:19.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0456659700 1 -- 172.21.15.80:0/253480028 >> v1:172.21.15.174:6789/0 conn(0x7f04500734b0 legacy=0x7f04500726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:19.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0456659700 1 -- 172.21.15.80:0/253480028 >> v1:172.21.15.80:6789/0 conn(0x7f0450073020 legacy=0x7f0450071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:19.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0455657700 1 -- 172.21.15.80:0/253480028 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848637915 0 0) 0x7f04480009b0 con 0x7f04500734b0 2019-11-28T11:41:19.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0456659700 1 -- 172.21.15.80:0/253480028 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0450070760 con 0x7f045015ed10 2019-11-28T11:41:19.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0456659700 1 --2- 172.21.15.80:0/253480028 >> v2:172.21.15.174:3300/0 conn(0x7f045015ed10 0x7f045015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f044000b2d0 tx=0x7f044000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:19.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0456659700 1 --2- 172.21.15.80:0/253480028 >> v2:172.21.15.174:3300/0 conn(0x7f045015ed10 0x7f045015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f044000b2d0 tx=0x7f044000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:19.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0456659700 1 --2- 172.21.15.80:0/253480028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045015ed10 0x7f045015f100 secure :-1 s=READY pgs=873 cs=0 l=1 rx=0x7f044000b2d0 tx=0x7f044000bae0).ready entity=mon.1 client_cookie=753b3c7fb316bd7f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:19.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0456659700 1 --2- 172.21.15.80:0/253480028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045015ed10 0x7f045015f100 secure :-1 s=THROTTLE_DONE pgs=873 cs=0 l=1 rx=0x7f044000b2d0 tx=0x7f044000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:19.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0455657700 1 -- 172.21.15.80:0/253480028 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0440000ce0 con 0x7f045015ed10 2019-11-28T11:41:19.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0456659700 1 --2- 172.21.15.80:0/253480028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045015ed10 0x7f045015f100 secure :-1 s=THROTTLE_DONE pgs=873 cs=0 l=1 rx=0x7f044000b2d0 tx=0x7f044000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:19.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0456659700 1 --2- 172.21.15.80:0/253480028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045015ed10 0x7f045015f100 secure :-1 s=THROTTLE_DONE pgs=873 cs=0 l=1 rx=0x7f044000b2d0 tx=0x7f044000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:19.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0455657700 1 -- 172.21.15.80:0/253480028 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0440009be0 con 0x7f045015ed10 2019-11-28T11:41:19.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f0455657700 1 -- 172.21.15.80:0/253480028 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0440000ce0 con 0x7f045015ed10 2019-11-28T11:41:19.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f04580bc700 1 -- 172.21.15.80:0/253480028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045015ed10 msgr2=0x7f045015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:19.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.061+0000 7f04580bc700 1 --2- 172.21.15.80:0/253480028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045015ed10 0x7f045015f100 secure :-1 s=READY pgs=873 cs=0 l=1 rx=0x7f044000b2d0 tx=0x7f044000bae0).stop 2019-11-28T11:41:19.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.062+0000 7f04580bc700 1 -- 172.21.15.80:0/253480028 shutdown_connections 2019-11-28T11:41:19.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.062+0000 7f04580bc700 1 --2- 172.21.15.80:0/253480028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045015ed10 0x7f045015f100 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:19.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.062+0000 7f04580bc700 1 -- 172.21.15.80:0/253480028 shutdown_connections 2019-11-28T11:41:19.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.062+0000 7f04580bc700 1 -- 172.21.15.80:0/253480028 wait complete. 2019-11-28T11:41:19.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.062+0000 7f04580bc700 1 -- 172.21.15.80:0/253480028 >> 172.21.15.80:0/253480028 conn(0x7f0450061d20 msgr2=0x7f04500641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:19.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.065+0000 7f04580bc700 1 Processor -- start 2019-11-28T11:41:19.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.065+0000 7f04580bc700 1 -- start start 2019-11-28T11:41:19.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.065+0000 7f04580bc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f045010e970 0x7f04501087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:19.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.065+0000 7f04580bc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0450108cf0 0x7f0450107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:19.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.065+0000 7f04580bc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045010c250 con 0x7f0450107b70 2019-11-28T11:41:19.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.065+0000 7f04580bc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045010e430 con 0x7f045010e970 2019-11-28T11:41:19.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.065+0000 7f04580bc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0450105860 con 0x7f0450108cf0 2019-11-28T11:41:19.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f0456e5a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0450107b70 0x7f045010ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38258/0 (socket says 172.21.15.80:38258) 2019-11-28T11:41:19.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f0456e5a700 1 -- 172.21.15.80:0/915897796 learned_addr learned my addr 172.21.15.80:0/915897796 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:19.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f0456659700 1 --2- 172.21.15.80:0/915897796 >> v2:172.21.15.174:3300/0 conn(0x7f045010e970 0x7f04501087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:19.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f0455e58700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0450108cf0 0x7f0450107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:19.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f044effd700 1 -- 172.21.15.80:0/915897796 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253659120 0 0) 0x7f0448001240 con 0x7f0450107b70 2019-11-28T11:41:19.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f044effd700 1 -- 172.21.15.80:0/915897796 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0434002e80 con 0x7f0450107b70 2019-11-28T11:41:19.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f0456659700 1 -- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0450108cf0 msgr2=0x7f0450107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:19.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f0456659700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0450108cf0 0x7f0450107630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:19.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f0456659700 1 -- 172.21.15.80:0/915897796 >> v1:172.21.15.80:6789/0 conn(0x7f0450107b70 legacy=0x7f045010ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:19.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f0456659700 1 -- 172.21.15.80:0/915897796 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0450105ef0 con 0x7f045010e970 2019-11-28T11:41:19.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f0455e58700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0450108cf0 0x7f0450107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:19.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f0456659700 1 --2- 172.21.15.80:0/915897796 >> v2:172.21.15.174:3300/0 conn(0x7f045010e970 0x7f04501087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0440010740 tx=0x7f0440010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:19.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f0456659700 1 --2- 172.21.15.80:0/915897796 >> v2:172.21.15.174:3300/0 conn(0x7f045010e970 0x7f04501087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0440010740 tx=0x7f0440010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:19.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f0456659700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045010e970 0x7f04501087b0 secure :-1 s=READY pgs=874 cs=0 l=1 rx=0x7f0440010740 tx=0x7f0440010ae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:19.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f0456659700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045010e970 0x7f04501087b0 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7f0440010740 tx=0x7f0440010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:19.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f044effd700 1 -- 172.21.15.80:0/915897796 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0440000cc0 con 0x7f045010e970 2019-11-28T11:41:19.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f0456659700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045010e970 0x7f04501087b0 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7f0440010740 tx=0x7f0440010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:19.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f0456659700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045010e970 0x7f04501087b0 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7f0440010740 tx=0x7f0440010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:19.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f044effd700 1 -- 172.21.15.80:0/915897796 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0440009d00 con 0x7f045010e970 2019-11-28T11:41:19.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f04580bc700 1 -- 172.21.15.80:0/915897796 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0450106270 con 0x7f045010e970 2019-11-28T11:41:19.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f044effd700 1 -- 172.21.15.80:0/915897796 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f044000a450 con 0x7f045010e970 2019-11-28T11:41:19.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.066+0000 7f04580bc700 1 -- 172.21.15.80:0/915897796 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0450105ef0 con 0x7f045010e970 2019-11-28T11:41:19.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.067+0000 7f0456659700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045010e970 0x7f04501087b0 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7f0440010740 tx=0x7f0440010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:19.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.067+0000 7f044effd700 1 -- 172.21.15.80:0/915897796 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0440009ef0 con 0x7f045010e970 2019-11-28T11:41:19.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.067+0000 7f0456659700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045010e970 0x7f04501087b0 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7f0440010740 tx=0x7f0440010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:19.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.067+0000 7f044effd700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0434018770 0x7f043401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:19.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.067+0000 7f044effd700 1 -- 172.21.15.80:0/915897796 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f0440031d40 con 0x7f045010e970 2019-11-28T11:41:19.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.067+0000 7f0455e58700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0434018770 0x7f043401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:19.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.067+0000 7f0455e58700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0434018770 0x7f043401abe0 crc :-1 s=READY pgs=609 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:19.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.075+0000 7f04580bc700 1 -- 172.21.15.80:0/915897796 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0450106270 con 0x7f045010e970 2019-11-28T11:41:19.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.078+0000 7f0456659700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045010e970 0x7f04501087b0 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7f0440010740 tx=0x7f0440010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:19.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.078+0000 7f044effd700 1 -- 172.21.15.80:0/915897796 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0440009900 con 0x7f045010e970 2019-11-28T11:41:19.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.247+0000 7f04580bc700 1 -- 172.21.15.80:0/915897796 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0450105ef0 con 0x7f045010e970 2019-11-28T11:41:19.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.927+0000 7f0456659700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045010e970 0x7f04501087b0 secure :-1 s=THROTTLE_DONE pgs=874 cs=0 l=1 rx=0x7f0440010740 tx=0x7f0440010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:19.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.927+0000 7f044effd700 1 -- 172.21.15.80:0/915897796 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v111) v1 ==== 185+0+0 (secure 0 0 0) 0x7f0440009ed0 con 0x7f045010e970 2019-11-28T11:41:19.995 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:41:20.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.964+0000 7f04580bc700 1 -- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0434018770 msgr2=0x7f043401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:20.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.964+0000 7f04580bc700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0434018770 0x7f043401abe0 crc :-1 s=READY pgs=609 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:20.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.964+0000 7f04580bc700 1 -- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045010e970 msgr2=0x7f04501087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:20.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.964+0000 7f04580bc700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045010e970 0x7f04501087b0 secure :-1 s=READY pgs=874 cs=0 l=1 rx=0x7f0440010740 tx=0x7f0440010ae0).stop 2019-11-28T11:41:20.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.964+0000 7f04580bc700 1 -- 172.21.15.80:0/915897796 shutdown_connections 2019-11-28T11:41:20.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.964+0000 7f04580bc700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0434018770 0x7f043401abe0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:20.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.964+0000 7f04580bc700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0450108cf0 0x7f0450107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:20.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.965+0000 7f04580bc700 1 --2- 172.21.15.80:0/915897796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f045010e970 0x7f04501087b0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:20.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.965+0000 7f04580bc700 1 -- 172.21.15.80:0/915897796 shutdown_connections 2019-11-28T11:41:20.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.965+0000 7f04580bc700 1 -- 172.21.15.80:0/915897796 wait complete. 2019-11-28T11:41:20.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:19.965+0000 7f04580bc700 1 -- 172.21.15.80:0/915897796 >> 172.21.15.80:0/915897796 conn(0x7f045015e2d0 msgr2=0x7f0450147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:20.009 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:41:20.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.105+0000 7f1b50b2a700 1 Processor -- start 2019-11-28T11:41:20.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.105+0000 7f1b50b2a700 1 -- start start 2019-11-28T11:41:20.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.106+0000 7f1b50b2a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1b4c15ed10 0x7f1b4c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:20.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.106+0000 7f1b50b2a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c06db60 con 0x7f1b4c073020 2019-11-28T11:41:20.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.106+0000 7f1b50b2a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c06e060 con 0x7f1b4c0734b0 2019-11-28T11:41:20.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.106+0000 7f1b50b2a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4c06fe00 con 0x7f1b4c15ed10 2019-11-28T11:41:20.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.106+0000 7f1b4ad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1b4c15ed10 0x7f1b4c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:20.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.106+0000 7f1b4a59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1b4c073020 0x7f1b4c071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38268/0 (socket says 172.21.15.80:38268) 2019-11-28T11:41:20.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.106+0000 7f1b4ad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1b4c15ed10 0x7f1b4c15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38948/0 (socket says 172.21.15.80:38948) 2019-11-28T11:41:20.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.106+0000 7f1b4a59c700 1 -- 172.21.15.80:0/3602471428 learned_addr learned my addr 172.21.15.80:0/3602471428 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:20.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.106+0000 7f1b4ad9d700 1 -- 172.21.15.80:0/3602471428 >> v1:172.21.15.174:6789/0 conn(0x7f1b4c0734b0 legacy=0x7f1b4c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:20.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.106+0000 7f1b4ad9d700 1 -- 172.21.15.80:0/3602471428 >> v1:172.21.15.80:6789/0 conn(0x7f1b4c073020 legacy=0x7f1b4c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:20.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.107+0000 7f1b4ad9d700 1 -- 172.21.15.80:0/3602471428 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c070760 con 0x7f1b4c15ed10 2019-11-28T11:41:20.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.107+0000 7f1b49d9b700 1 -- 172.21.15.80:0/3602471428 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296172944 0 0) 0x7f1b3c001070 con 0x7f1b4c073020 2019-11-28T11:41:20.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.107+0000 7f1b4ad9d700 1 --2- 172.21.15.80:0/3602471428 >> v2:172.21.15.80:3300/0 conn(0x7f1b4c15ed10 0x7f1b4c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1b3400af50 tx=0x7f1b3400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:20.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.107+0000 7f1b4ad9d700 1 --2- 172.21.15.80:0/3602471428 >> v2:172.21.15.80:3300/0 conn(0x7f1b4c15ed10 0x7f1b4c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1b3400af50 tx=0x7f1b3400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:20.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.107+0000 7f1b4ad9d700 1 --2- 172.21.15.80:0/3602471428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c15ed10 0x7f1b4c15f100 secure :-1 s=READY pgs=1498 cs=0 l=1 rx=0x7f1b3400af50 tx=0x7f1b3400b760).ready entity=mon.0 client_cookie=b2177539fbc754a2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:20.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.107+0000 7f1b4ad9d700 1 --2- 172.21.15.80:0/3602471428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c15ed10 0x7f1b4c15f100 secure :-1 s=THROTTLE_DONE pgs=1498 cs=0 l=1 rx=0x7f1b3400af50 tx=0x7f1b3400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:20.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.107+0000 7f1b49d9b700 1 -- 172.21.15.80:0/3602471428 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b34000960 con 0x7f1b4c15ed10 2019-11-28T11:41:20.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.107+0000 7f1b4ad9d700 1 --2- 172.21.15.80:0/3602471428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c15ed10 0x7f1b4c15f100 secure :-1 s=THROTTLE_DONE pgs=1498 cs=0 l=1 rx=0x7f1b3400af50 tx=0x7f1b3400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:20.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.107+0000 7f1b4ad9d700 1 --2- 172.21.15.80:0/3602471428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c15ed10 0x7f1b4c15f100 secure :-1 s=THROTTLE_DONE pgs=1498 cs=0 l=1 rx=0x7f1b3400af50 tx=0x7f1b3400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:20.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.107+0000 7f1b49d9b700 1 -- 172.21.15.80:0/3602471428 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b34009860 con 0x7f1b4c15ed10 2019-11-28T11:41:20.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.107+0000 7f1b49d9b700 1 -- 172.21.15.80:0/3602471428 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b34009f30 con 0x7f1b4c15ed10 2019-11-28T11:41:20.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.107+0000 7f1b50b2a700 1 -- 172.21.15.80:0/3602471428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c15ed10 msgr2=0x7f1b4c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:20.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.107+0000 7f1b50b2a700 1 --2- 172.21.15.80:0/3602471428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c15ed10 0x7f1b4c15f100 secure :-1 s=READY pgs=1498 cs=0 l=1 rx=0x7f1b3400af50 tx=0x7f1b3400b760).stop 2019-11-28T11:41:20.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.108+0000 7f1b50b2a700 1 -- 172.21.15.80:0/3602471428 shutdown_connections 2019-11-28T11:41:20.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.108+0000 7f1b50b2a700 1 --2- 172.21.15.80:0/3602471428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4c15ed10 0x7f1b4c15f100 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:20.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.108+0000 7f1b50b2a700 1 -- 172.21.15.80:0/3602471428 shutdown_connections 2019-11-28T11:41:20.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.108+0000 7f1b50b2a700 1 -- 172.21.15.80:0/3602471428 wait complete. 2019-11-28T11:41:20.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.108+0000 7f1b50b2a700 1 -- 172.21.15.80:0/3602471428 >> 172.21.15.80:0/3602471428 conn(0x7f1b4c061d20 msgr2=0x7f1b4c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:20.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.110+0000 7f1b50b2a700 1 Processor -- start 2019-11-28T11:41:20.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.110+0000 7f1b50b2a700 1 -- start start 2019-11-28T11:41:20.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.111+0000 7f1b50b2a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b4c105e30 0x7f1b4c169d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:20.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.111+0000 7f1b50b2a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c102b00 con 0x7f1b4c102460 2019-11-28T11:41:20.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.111+0000 7f1b50b2a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c147850 con 0x7f1b4c1051a0 2019-11-28T11:41:20.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.111+0000 7f1b50b2a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c112800 con 0x7f1b4c105e30 2019-11-28T11:41:20.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.111+0000 7f1b4ad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1b4c102460 0x7f1b4c115710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38270/0 (socket says 172.21.15.80:38270) 2019-11-28T11:41:20.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.111+0000 7f1b4ad9d700 1 -- 172.21.15.80:0/2067288642 learned_addr learned my addr 172.21.15.80:0/2067288642 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:20.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.111+0000 7f1b4b59e700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b4c105e30 0x7f1b4c169d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:20.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.111+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416758386 0 0) 0x7f1b3400b3d0 con 0x7f1b4c102460 2019-11-28T11:41:20.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.111+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b24002e80 con 0x7f1b4c102460 2019-11-28T11:41:20.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.111+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648550623 0 0) 0x7f1b3c001280 con 0x7f1b4c1051a0 2019-11-28T11:41:20.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.111+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b240030b0 con 0x7f1b4c1051a0 2019-11-28T11:41:20.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.111+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1816964008 0 0) 0x7f1b34000940 con 0x7f1b4c102460 2019-11-28T11:41:20.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.111+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1b240033c0 con 0x7f1b4c102460 2019-11-28T11:41:20.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.111+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f1b34009580 con 0x7f1b4c102460 2019-11-28T11:41:20.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.111+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b4c105e30 msgr2=0x7f1b4c169d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:20.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.111+0000 7f1b437fe700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b4c105e30 0x7f1b4c169d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:20.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 >> v1:172.21.15.174:6789/0 conn(0x7f1b4c1051a0 legacy=0x7f1b4c105630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:20.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 >> v1:172.21.15.80:6789/0 conn(0x7f1b4c102460 legacy=0x7f1b4c115710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:20.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b437fe700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b24005d20 0x7f1b24006110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:20.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b437fe700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b240046f0 0x7f1b24004b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:20.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b437fe700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b24005100 0x7f1b240032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:20.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240038e0 con 0x7f1b240046f0 2019-11-28T11:41:20.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b24003b10 con 0x7f1b24005d20 2019-11-28T11:41:20.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b24003d40 con 0x7f1b24005100 2019-11-28T11:41:20.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b4a59c700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b240046f0 0x7f1b24004b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:20.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b4ad9d700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b24005d20 0x7f1b24006110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:20.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b4b59e700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b24005100 0x7f1b240032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:20.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b4a59c700 1 -- 172.21.15.80:0/2067288642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b24005100 msgr2=0x7f1b240032e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:20.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b4a59c700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b24005100 0x7f1b240032e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:20.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b4a59c700 1 -- 172.21.15.80:0/2067288642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b24005d20 msgr2=0x7f1b24006110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:20.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b4a59c700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b24005d20 0x7f1b24006110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:20.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b4a59c700 1 -- 172.21.15.80:0/2067288642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24003ff0 con 0x7f1b240046f0 2019-11-28T11:41:20.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b50b2a700 1 -- 172.21.15.80:0/2067288642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4c113210 con 0x7f1b240046f0 2019-11-28T11:41:20.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b4a59c700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b240046f0 0x7f1b24004b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1b3c010320 tx=0x7f1b3c0101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:20.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b50b2a700 1 -- 172.21.15.80:0/2067288642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c112e90 con 0x7f1b240046f0 2019-11-28T11:41:20.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b4a59c700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b240046f0 0x7f1b24004b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1b3c010320 tx=0x7f1b3c0101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:20.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b4a59c700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b240046f0 0x7f1b24004b70 secure :-1 s=READY pgs=1500 cs=0 l=1 rx=0x7f1b3c010320 tx=0x7f1b3c0101d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:20.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b4a59c700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b240046f0 0x7f1b24004b70 secure :-1 s=THROTTLE_DONE pgs=1500 cs=0 l=1 rx=0x7f1b3c010320 tx=0x7f1b3c0101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:20.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b3c000dd0 con 0x7f1b240046f0 2019-11-28T11:41:20.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b4a59c700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b240046f0 0x7f1b24004b70 secure :-1 s=THROTTLE_DONE pgs=1500 cs=0 l=1 rx=0x7f1b3c010320 tx=0x7f1b3c0101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:20.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b4a59c700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b240046f0 0x7f1b24004b70 secure :-1 s=THROTTLE_DONE pgs=1500 cs=0 l=1 rx=0x7f1b3c010320 tx=0x7f1b3c0101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:20.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c0041d0 con 0x7f1b240046f0 2019-11-28T11:41:20.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.112+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b3c000dd0 con 0x7f1b240046f0 2019-11-28T11:41:20.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.113+0000 7f1b4a59c700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b240046f0 0x7f1b24004b70 secure :-1 s=THROTTLE_DONE pgs=1500 cs=0 l=1 rx=0x7f1b3c010320 tx=0x7f1b3c0101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:20.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.113+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1b3c0043c0 con 0x7f1b240046f0 2019-11-28T11:41:20.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.113+0000 7f1b4a59c700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b240046f0 0x7f1b24004b70 secure :-1 s=THROTTLE_DONE pgs=1500 cs=0 l=1 rx=0x7f1b3c010320 tx=0x7f1b3c0101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:20.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.113+0000 7f1b437fe700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1b24020b90 0x7f1b24022fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:20.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.113+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5668+0+0 (secure 0 0 0) 0x7f1b3c031bd0 con 0x7f1b240046f0 2019-11-28T11:41:20.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.113+0000 7f1b4ad9d700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1b24020b90 0x7f1b24022fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:20.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.113+0000 7f1b4ad9d700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1b24020b90 0x7f1b24022fc0 crc :-1 s=READY pgs=610 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:20.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.120+0000 7f1b50b2a700 1 -- 172.21.15.80:0/2067288642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4c113210 con 0x7f1b240046f0 2019-11-28T11:41:20.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.124+0000 7f1b4a59c700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b240046f0 0x7f1b24004b70 secure :-1 s=THROTTLE_DONE pgs=1500 cs=0 l=1 rx=0x7f1b3c010320 tx=0x7f1b3c0101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:20.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.124+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1b3c001230 con 0x7f1b240046f0 2019-11-28T11:41:20.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.292+0000 7f1b50b2a700 1 -- 172.21.15.80:0/2067288642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1b4c112e90 con 0x7f1b240046f0 2019-11-28T11:41:20.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.928+0000 7f1b4a59c700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b240046f0 0x7f1b24004b70 secure :-1 s=THROTTLE_DONE pgs=1500 cs=0 l=1 rx=0x7f1b3c010320 tx=0x7f1b3c0101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:20.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.928+0000 7f1b437fe700 1 -- 172.21.15.80:0/2067288642 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v112) v1 ==== 173+0+0 (secure 0 0 0) 0x7f1b3c0041b0 con 0x7f1b240046f0 2019-11-28T11:41:20.990 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:41:20.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.959+0000 7f1b50b2a700 1 -- 172.21.15.80:0/2067288642 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1b24020b90 msgr2=0x7f1b24022fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:20.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.959+0000 7f1b50b2a700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1b24020b90 0x7f1b24022fc0 crc :-1 s=READY pgs=610 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:20.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.959+0000 7f1b50b2a700 1 -- 172.21.15.80:0/2067288642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b240046f0 msgr2=0x7f1b24004b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:20.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.959+0000 7f1b50b2a700 1 --2- 172.21.15.80:0/2067288642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b240046f0 0x7f1b24004b70 secure :-1 s=READY pgs=1500 cs=0 l=1 rx=0x7f1b3c010320 tx=0x7f1b3c0101d0).stop 2019-11-28T11:41:20.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.959+0000 7f1b4b59e700 1 -- 172.21.15.80:0/2067288642 reap_dead start 2019-11-28T11:41:20.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.959+0000 7f1b4b59e700 1 -- 172.21.15.80:0/2067288642 reap_dead start 2019-11-28T11:41:20.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.959+0000 7f1b50b2a700 1 -- 172.21.15.80:0/2067288642 shutdown_connections 2019-11-28T11:41:20.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.959+0000 7f1b50b2a700 1 -- 172.21.15.80:0/2067288642 shutdown_connections 2019-11-28T11:41:20.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.959+0000 7f1b50b2a700 1 -- 172.21.15.80:0/2067288642 wait complete. 2019-11-28T11:41:20.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:20.959+0000 7f1b50b2a700 1 -- 172.21.15.80:0/2067288642 >> 172.21.15.80:0/2067288642 conn(0x7f1b4c14c4a0 msgr2=0x7f1b4c152400 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:21.004 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:41:21.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.094+0000 7f7784da6700 1 Processor -- start 2019-11-28T11:41:21.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.094+0000 7f7784da6700 1 -- start start 2019-11-28T11:41:21.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f7784da6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f778006c0a0 0x7f7780072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:21.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f7784da6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7780072620 0x7f7780164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:21.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f7784da6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f778006db00 con 0x7f77800734e0 2019-11-28T11:41:21.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f7784da6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778006f330 con 0x7f7780072620 2019-11-28T11:41:21.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f7784da6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77800706c0 con 0x7f778006c0a0 2019-11-28T11:41:21.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f777ed9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f778006c0a0 0x7f7780072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:21.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f777f59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7780072620 0x7f7780164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:21.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f777e59c700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f77800734e0 0x7f7780071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:53832/0 (socket says 172.21.15.80:53832) 2019-11-28T11:41:21.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f777e59c700 1 -- 172.21.15.80:0/1010868335 learned_addr learned my addr 172.21.15.80:0/1010868335 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:21.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f777ed9d700 1 -- 172.21.15.80:0/1010868335 >> v2:172.21.15.174:3300/0 conn(0x7f7780072620 msgr2=0x7f7780164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:21.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f777ed9d700 1 --2- 172.21.15.80:0/1010868335 >> v2:172.21.15.174:3300/0 conn(0x7f7780072620 0x7f7780164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:21.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f777ed9d700 1 -- 172.21.15.80:0/1010868335 >> v1:172.21.15.174:6789/0 conn(0x7f77800734e0 legacy=0x7f7780071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:21.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f777ed9d700 1 -- 172.21.15.80:0/1010868335 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7780070a40 con 0x7f778006c0a0 2019-11-28T11:41:21.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f777dd9b700 1 -- 172.21.15.80:0/1010868335 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097007295 0 0) 0x7f77680013f0 con 0x7f77800734e0 2019-11-28T11:41:21.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f777f59e700 1 --2- 172.21.15.80:0/1010868335 >> v2:172.21.15.174:3300/0 conn(0x7f7780072620 0x7f7780164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:21.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f777ed9d700 1 --2- 172.21.15.80:0/1010868335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f778006c0a0 0x7f7780072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f777000af50 tx=0x7f777000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:21.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f777ed9d700 1 --2- 172.21.15.80:0/1010868335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f778006c0a0 0x7f7780072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f777000af50 tx=0x7f777000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:21.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.096+0000 7f777ed9d700 1 --2- 172.21.15.80:0/1010868335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f778006c0a0 0x7f7780072fa0 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7f777000af50 tx=0x7f777000b760).ready entity=mon.2 client_cookie=19ab43638efdc13e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:21.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.097+0000 7f777ed9d700 1 --2- 172.21.15.80:0/1010868335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f778006c0a0 0x7f7780072fa0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f777000af50 tx=0x7f777000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:21.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.097+0000 7f777dd9b700 1 -- 172.21.15.80:0/1010868335 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7770007210 con 0x7f778006c0a0 2019-11-28T11:41:21.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.097+0000 7f777ed9d700 1 --2- 172.21.15.80:0/1010868335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f778006c0a0 0x7f7780072fa0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f777000af50 tx=0x7f777000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:21.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.097+0000 7f777ed9d700 1 --2- 172.21.15.80:0/1010868335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f778006c0a0 0x7f7780072fa0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f777000af50 tx=0x7f777000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:21.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.097+0000 7f777dd9b700 1 -- 172.21.15.80:0/1010868335 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77700099b0 con 0x7f778006c0a0 2019-11-28T11:41:21.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.097+0000 7f777dd9b700 1 -- 172.21.15.80:0/1010868335 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7770009c60 con 0x7f778006c0a0 2019-11-28T11:41:21.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.097+0000 7f7784da6700 1 -- 172.21.15.80:0/1010868335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f778006c0a0 msgr2=0x7f7780072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:21.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.097+0000 7f7784da6700 1 --2- 172.21.15.80:0/1010868335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f778006c0a0 0x7f7780072fa0 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7f777000af50 tx=0x7f777000b760).stop 2019-11-28T11:41:21.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.097+0000 7f7784da6700 1 -- 172.21.15.80:0/1010868335 shutdown_connections 2019-11-28T11:41:21.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.097+0000 7f7784da6700 1 --2- 172.21.15.80:0/1010868335 >> v2:172.21.15.174:3300/0 conn(0x7f7780072620 0x7f7780164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:21.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.097+0000 7f7784da6700 1 --2- 172.21.15.80:0/1010868335 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f778006c0a0 0x7f7780072fa0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:21.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.097+0000 7f7784da6700 1 -- 172.21.15.80:0/1010868335 shutdown_connections 2019-11-28T11:41:21.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.097+0000 7f7784da6700 1 -- 172.21.15.80:0/1010868335 wait complete. 2019-11-28T11:41:21.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.097+0000 7f7784da6700 1 -- 172.21.15.80:0/1010868335 >> 172.21.15.80:0/1010868335 conn(0x7f7780061cf0 msgr2=0x7f7780064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:21.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.100+0000 7f7784da6700 1 Processor -- start 2019-11-28T11:41:21.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.100+0000 7f7784da6700 1 -- start start 2019-11-28T11:41:21.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f7784da6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f778013e9e0 0x7f7780108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:21.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f7784da6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77801066e0 con 0x7f7780109430 2019-11-28T11:41:21.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f7784da6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f778010ce40 con 0x7f778013e5f0 2019-11-28T11:41:21.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f7784da6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778010e060 con 0x7f778013e9e0 2019-11-28T11:41:21.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f777f59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7780109430 0x7f7780168ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38294/0 (socket says 172.21.15.80:38294) 2019-11-28T11:41:21.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f777f59e700 1 -- 172.21.15.80:0/973284998 learned_addr learned my addr 172.21.15.80:0/973284998 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:21.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f777e59c700 1 --2- 172.21.15.80:0/973284998 >> v2:172.21.15.174:3300/0 conn(0x7f778013e9e0 0x7f7780108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:21.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f77777fe700 1 -- 172.21.15.80:0/973284998 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765359714 0 0) 0x7f7778009890 con 0x7f7780109430 2019-11-28T11:41:21.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f77777fe700 1 -- 172.21.15.80:0/973284998 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7758002e80 con 0x7f7780109430 2019-11-28T11:41:21.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f77777fe700 1 -- 172.21.15.80:0/973284998 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471487739 0 0) 0x7f777000abb0 con 0x7f778013e5f0 2019-11-28T11:41:21.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f77777fe700 1 -- 172.21.15.80:0/973284998 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7758004170 con 0x7f778013e5f0 2019-11-28T11:41:21.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f777e59c700 1 -- 172.21.15.80:0/973284998 >> v1:172.21.15.174:6789/0 conn(0x7f778013e5f0 legacy=0x7f778010a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:21.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f777e59c700 1 -- 172.21.15.80:0/973284998 >> v1:172.21.15.80:6789/0 conn(0x7f7780109430 legacy=0x7f7780168ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:21.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f77777fe700 1 -- 172.21.15.80:0/973284998 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2996709916 0 0) 0x7f7778001280 con 0x7f7780109430 2019-11-28T11:41:21.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f777e59c700 1 -- 172.21.15.80:0/973284998 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778010e9c0 con 0x7f778013e9e0 2019-11-28T11:41:21.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f777e59c700 1 --2- 172.21.15.80:0/973284998 >> v2:172.21.15.174:3300/0 conn(0x7f778013e9e0 0x7f7780108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f77680106b0 tx=0x7f7768010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:21.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f777e59c700 1 --2- 172.21.15.80:0/973284998 >> v2:172.21.15.174:3300/0 conn(0x7f778013e9e0 0x7f7780108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f77680106b0 tx=0x7f7768010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:21.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.101+0000 7f777e59c700 1 --2- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f778013e9e0 0x7f7780108ef0 secure :-1 s=READY pgs=879 cs=0 l=1 rx=0x7f77680106b0 tx=0x7f7768010a50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:21.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.102+0000 7f777e59c700 1 --2- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f778013e9e0 0x7f7780108ef0 secure :-1 s=THROTTLE_DONE pgs=879 cs=0 l=1 rx=0x7f77680106b0 tx=0x7f7768010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:21.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.102+0000 7f77777fe700 1 -- 172.21.15.80:0/973284998 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7768004550 con 0x7f778013e9e0 2019-11-28T11:41:21.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.102+0000 7f777e59c700 1 --2- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f778013e9e0 0x7f7780108ef0 secure :-1 s=THROTTLE_DONE pgs=879 cs=0 l=1 rx=0x7f77680106b0 tx=0x7f7768010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:21.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.102+0000 7f777e59c700 1 --2- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f778013e9e0 0x7f7780108ef0 secure :-1 s=THROTTLE_DONE pgs=879 cs=0 l=1 rx=0x7f77680106b0 tx=0x7f7768010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:21.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.102+0000 7f77777fe700 1 -- 172.21.15.80:0/973284998 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77680010d0 con 0x7f778013e9e0 2019-11-28T11:41:21.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.102+0000 7f7784da6700 1 -- 172.21.15.80:0/973284998 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778010ed40 con 0x7f778013e9e0 2019-11-28T11:41:21.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.102+0000 7f77777fe700 1 -- 172.21.15.80:0/973284998 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7768004b30 con 0x7f778013e9e0 2019-11-28T11:41:21.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.102+0000 7f7784da6700 1 -- 172.21.15.80:0/973284998 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778010e9c0 con 0x7f778013e9e0 2019-11-28T11:41:21.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.102+0000 7f777e59c700 1 --2- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f778013e9e0 0x7f7780108ef0 secure :-1 s=THROTTLE_DONE pgs=879 cs=0 l=1 rx=0x7f77680106b0 tx=0x7f7768010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:21.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.102+0000 7f77777fe700 1 -- 172.21.15.80:0/973284998 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7768004360 con 0x7f778013e9e0 2019-11-28T11:41:21.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.102+0000 7f777e59c700 1 --2- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f778013e9e0 0x7f7780108ef0 secure :-1 s=THROTTLE_DONE pgs=879 cs=0 l=1 rx=0x7f77680106b0 tx=0x7f7768010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:21.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.102+0000 7f77777fe700 1 --2- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7758018740 0x7f775801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:21.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.102+0000 7f77777fe700 1 -- 172.21.15.80:0/973284998 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5286+0+0 (secure 0 0 0) 0x7f7768031dc0 con 0x7f778013e9e0 2019-11-28T11:41:21.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.103+0000 7f777ed9d700 1 --2- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7758018740 0x7f775801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:21.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.103+0000 7f777ed9d700 1 --2- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7758018740 0x7f775801abf0 crc :-1 s=READY pgs=611 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:21.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.110+0000 7f7784da6700 1 -- 172.21.15.80:0/973284998 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778010ed40 con 0x7f778013e9e0 2019-11-28T11:41:21.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.114+0000 7f777e59c700 1 --2- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f778013e9e0 0x7f7780108ef0 secure :-1 s=THROTTLE_DONE pgs=879 cs=0 l=1 rx=0x7f77680106b0 tx=0x7f7768010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:21.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.114+0000 7f77777fe700 1 -- 172.21.15.80:0/973284998 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f77680015b0 con 0x7f778013e9e0 2019-11-28T11:41:21.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.302+0000 7f7784da6700 1 -- 172.21.15.80:0/973284998 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f778010e9c0 con 0x7f778013e9e0 2019-11-28T11:41:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.930+0000 7f777e59c700 1 --2- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f778013e9e0 0x7f7780108ef0 secure :-1 s=THROTTLE_DONE pgs=879 cs=0 l=1 rx=0x7f77680106b0 tx=0x7f7768010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:21.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.930+0000 7f77777fe700 1 -- 172.21.15.80:0/973284998 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v113) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7768004360 con 0x7f778013e9e0 2019-11-28T11:41:22.000 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:41:22.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.969+0000 7f7784da6700 1 -- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7758018740 msgr2=0x7f775801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.969+0000 7f7784da6700 1 --2- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7758018740 0x7f775801abf0 crc :-1 s=READY pgs=611 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:22.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.969+0000 7f7784da6700 1 -- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f778013e9e0 msgr2=0x7f7780108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.969+0000 7f7784da6700 1 --2- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f778013e9e0 0x7f7780108ef0 secure :-1 s=READY pgs=879 cs=0 l=1 rx=0x7f77680106b0 tx=0x7f7768010a50).stop 2019-11-28T11:41:22.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.969+0000 7f7784da6700 1 -- 172.21.15.80:0/973284998 shutdown_connections 2019-11-28T11:41:22.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.969+0000 7f7784da6700 1 --2- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f778013e9e0 0x7f7780108ef0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:22.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.969+0000 7f7784da6700 1 --2- 172.21.15.80:0/973284998 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7758018740 0x7f775801abf0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:22.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.969+0000 7f7784da6700 1 -- 172.21.15.80:0/973284998 shutdown_connections 2019-11-28T11:41:22.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.969+0000 7f7784da6700 1 -- 172.21.15.80:0/973284998 wait complete. 2019-11-28T11:41:22.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:21.969+0000 7f7784da6700 1 -- 172.21.15.80:0/973284998 >> 172.21.15.80:0/973284998 conn(0x7f778013d620 msgr2=0x7f778013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:22.013 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:41:22.014 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:41:22.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.099+0000 7ff6cb13b700 1 Processor -- start 2019-11-28T11:41:22.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.099+0000 7ff6cb13b700 1 -- start start 2019-11-28T11:41:22.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.100+0000 7ff6cb13b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6c406d120 0x7ff6c4165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:22.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.100+0000 7ff6cb13b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c406d580 con 0x7ff6c406c0a0 2019-11-28T11:41:22.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.100+0000 7ff6cb13b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c406db00 con 0x7ff6c406c490 2019-11-28T11:41:22.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.100+0000 7ff6cb13b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c406fd60 con 0x7ff6c406d120 2019-11-28T11:41:22.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.100+0000 7ff6c96d8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff6c406c0a0 0x7ff6c4072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38298/0 (socket says 172.21.15.80:38298) 2019-11-28T11:41:22.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.100+0000 7ff6c96d8700 1 -- 172.21.15.80:0/3531904642 learned_addr learned my addr 172.21.15.80:0/3531904642 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:22.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.100+0000 7ff6c3fff700 1 -- 172.21.15.80:0/3531904642 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662436349 0 0) 0x7ff6b40014d0 con 0x7ff6c406c0a0 2019-11-28T11:41:22.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.100+0000 7ff6c9ed9700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6c406d120 0x7ff6c4165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:22.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.100+0000 7ff6c3fff700 1 -- 172.21.15.80:0/3531904642 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6ac002e80 con 0x7ff6c406c0a0 2019-11-28T11:41:22.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c3fff700 1 -- 172.21.15.80:0/3531904642 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3606175097 0 0) 0x7ff6b40014b0 con 0x7ff6c406c0a0 2019-11-28T11:41:22.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c3fff700 1 -- 172.21.15.80:0/3531904642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6c406d120 msgr2=0x7ff6c4165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:22.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c3fff700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6c406d120 0x7ff6c4165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:22.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c3fff700 1 -- 172.21.15.80:0/3531904642 >> v1:172.21.15.174:6789/0 conn(0x7ff6c406c490 legacy=0x7ff6c406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c3fff700 1 -- 172.21.15.80:0/3531904642 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c40706c0 con 0x7ff6c406c0a0 2019-11-28T11:41:22.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c3fff700 1 -- 172.21.15.80:0/3531904642 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff6b40019e0 con 0x7ff6c406c0a0 2019-11-28T11:41:22.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c3fff700 1 -- 172.21.15.80:0/3531904642 >> v1:172.21.15.80:6789/0 conn(0x7ff6c406c0a0 legacy=0x7ff6c4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c3fff700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ac003ab0 0x7ff6ac005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:22.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c3fff700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ac006690 0x7ff6ac008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:22.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c3fff700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6ac009380 0x7ff6ac00b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:22.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c3fff700 1 -- 172.21.15.80:0/3531904642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac00bfd0 con 0x7ff6ac003ab0 2019-11-28T11:41:22.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c96d8700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ac003ab0 0x7ff6ac005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:22.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c3fff700 1 -- 172.21.15.80:0/3531904642 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0501d0 con 0x7ff6ac006690 2019-11-28T11:41:22.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c3fff700 1 -- 172.21.15.80:0/3531904642 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac050400 con 0x7ff6ac009380 2019-11-28T11:41:22.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c8ed7700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ac006690 0x7ff6ac008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:22.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c9ed9700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6ac009380 0x7ff6ac00b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:22.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c96d8700 1 -- 172.21.15.80:0/3531904642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6ac009380 msgr2=0x7ff6ac00b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:22.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c96d8700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6ac009380 0x7ff6ac00b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:22.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c96d8700 1 -- 172.21.15.80:0/3531904642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ac006690 msgr2=0x7ff6ac008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:22.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c96d8700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ac006690 0x7ff6ac008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:22.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c96d8700 1 -- 172.21.15.80:0/3531904642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac0506b0 con 0x7ff6ac003ab0 2019-11-28T11:41:22.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c8ed7700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ac006690 0x7ff6ac008b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:41:22.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c96d8700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ac003ab0 0x7ff6ac005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff6b400fc10 tx=0x7ff6b400ffb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c96d8700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ac003ab0 0x7ff6ac005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff6b400fc10 tx=0x7ff6b400ffb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c96d8700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ac003ab0 0x7ff6ac005f10 secure :-1 s=READY pgs=1503 cs=0 l=1 rx=0x7ff6b400fc10 tx=0x7ff6b400ffb0).ready entity=mon.0 client_cookie=ba3f2e60ab01d746 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:22.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c96d8700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ac003ab0 0x7ff6ac005f10 secure :-1 s=THROTTLE_DONE pgs=1503 cs=0 l=1 rx=0x7ff6b400fc10 tx=0x7ff6b400ffb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c3fff700 1 -- 172.21.15.80:0/3531904642 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6b40045c0 con 0x7ff6ac003ab0 2019-11-28T11:41:22.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c96d8700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ac003ab0 0x7ff6ac005f10 secure :-1 s=THROTTLE_DONE pgs=1503 cs=0 l=1 rx=0x7ff6b400fc10 tx=0x7ff6b400ffb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c96d8700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ac003ab0 0x7ff6ac005f10 secure :-1 s=THROTTLE_DONE pgs=1503 cs=0 l=1 rx=0x7ff6b400fc10 tx=0x7ff6b400ffb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c3fff700 1 -- 172.21.15.80:0/3531904642 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b40014b0 con 0x7ff6ac003ab0 2019-11-28T11:41:22.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c3fff700 1 -- 172.21.15.80:0/3531904642 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6b4004ba0 con 0x7ff6ac003ab0 2019-11-28T11:41:22.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6cb13b700 1 -- 172.21.15.80:0/3531904642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ac003ab0 msgr2=0x7ff6ac005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6cb13b700 1 --2- 172.21.15.80:0/3531904642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ac003ab0 0x7ff6ac005f10 secure :-1 s=READY pgs=1503 cs=0 l=1 rx=0x7ff6b400fc10 tx=0x7ff6b400ffb0).stop 2019-11-28T11:41:22.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.101+0000 7ff6c9ed9700 1 -- 172.21.15.80:0/3531904642 reap_dead start 2019-11-28T11:41:22.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.102+0000 7ff6cb13b700 1 -- 172.21.15.80:0/3531904642 shutdown_connections 2019-11-28T11:41:22.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.102+0000 7ff6cb13b700 1 -- 172.21.15.80:0/3531904642 shutdown_connections 2019-11-28T11:41:22.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.102+0000 7ff6cb13b700 1 -- 172.21.15.80:0/3531904642 wait complete. 2019-11-28T11:41:22.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.102+0000 7ff6cb13b700 1 -- 172.21.15.80:0/3531904642 >> 172.21.15.80:0/3531904642 conn(0x7ff6c4061cf0 msgr2=0x7ff6c4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:22.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.105+0000 7ff6cb13b700 1 Processor -- start 2019-11-28T11:41:22.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.105+0000 7ff6cb13b700 1 -- start start 2019-11-28T11:41:22.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6cb13b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff6c4074d00 0x7ff6c407aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:22.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6cb13b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6c4150f50 0x7ff6c407af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:22.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6cb13b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6c407bba0 0x7ff6c407b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:22.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6cb13b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c4078980 con 0x7ff6c4150f50 2019-11-28T11:41:22.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6cb13b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c4078c50 con 0x7ff6c4074d00 2019-11-28T11:41:22.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6cb13b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c4077f50 con 0x7ff6c407bba0 2019-11-28T11:41:22.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c8ed7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6c4150f50 0x7ff6c407af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:22.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c8ed7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6c4150f50 0x7ff6c407af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38996/0 (socket says 172.21.15.80:38996) 2019-11-28T11:41:22.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c8ed7700 1 -- 172.21.15.80:0/3632052473 learned_addr learned my addr 172.21.15.80:0/3632052473 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:22.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c8ed7700 1 -- 172.21.15.80:0/3632052473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6c407bba0 msgr2=0x7ff6c407b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c8ed7700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6c407bba0 0x7ff6c407b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:22.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c8ed7700 1 -- 172.21.15.80:0/3632052473 >> v2:172.21.15.174:3300/0 conn(0x7ff6c4074d00 msgr2=0x7ff6c407aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c8ed7700 1 --2- 172.21.15.80:0/3632052473 >> v2:172.21.15.174:3300/0 conn(0x7ff6c4074d00 0x7ff6c407aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:22.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c8ed7700 1 -- 172.21.15.80:0/3632052473 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c40792e0 con 0x7ff6c4150f50 2019-11-28T11:41:22.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c8ed7700 1 --2- 172.21.15.80:0/3632052473 >> v2:172.21.15.80:3300/0 conn(0x7ff6c4150f50 0x7ff6c407af60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff6b80103e0 tx=0x7ff6b8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c8ed7700 1 --2- 172.21.15.80:0/3632052473 >> v2:172.21.15.80:3300/0 conn(0x7ff6c4150f50 0x7ff6c407af60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff6b80103e0 tx=0x7ff6b8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c8ed7700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c4150f50 0x7ff6c407af60 secure :-1 s=READY pgs=1504 cs=0 l=1 rx=0x7ff6b80103e0 tx=0x7ff6b8010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:22.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c8ed7700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c4150f50 0x7ff6c407af60 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7ff6b80103e0 tx=0x7ff6b8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c8ed7700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c4150f50 0x7ff6c407af60 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7ff6b80103e0 tx=0x7ff6b8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c8ed7700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c4150f50 0x7ff6c407af60 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7ff6b80103e0 tx=0x7ff6b8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c1ffb700 1 -- 172.21.15.80:0/3632052473 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6b8009250 con 0x7ff6c4150f50 2019-11-28T11:41:22.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c1ffb700 1 -- 172.21.15.80:0/3632052473 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8000940 con 0x7ff6c4150f50 2019-11-28T11:41:22.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6cb13b700 1 -- 172.21.15.80:0/3632052473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c4079660 con 0x7ff6c4150f50 2019-11-28T11:41:22.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6c1ffb700 1 -- 172.21.15.80:0/3632052473 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6b8001230 con 0x7ff6c4150f50 2019-11-28T11:41:22.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.106+0000 7ff6cb13b700 1 -- 172.21.15.80:0/3632052473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c40792e0 con 0x7ff6c4150f50 2019-11-28T11:41:22.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.107+0000 7ff6c8ed7700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c4150f50 0x7ff6c407af60 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7ff6b80103e0 tx=0x7ff6b8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.107+0000 7ff6c1ffb700 1 -- 172.21.15.80:0/3632052473 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff6b8000c60 con 0x7ff6c4150f50 2019-11-28T11:41:22.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.107+0000 7ff6c8ed7700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c4150f50 0x7ff6c407af60 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7ff6b80103e0 tx=0x7ff6b8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.107+0000 7ff6c1ffb700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6a4018730 0x7ff6a401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:22.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.107+0000 7ff6c1ffb700 1 -- 172.21.15.80:0/3632052473 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5200+0+0 (secure 0 0 0) 0x7ff6b8031a60 con 0x7ff6c4150f50 2019-11-28T11:41:22.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.107+0000 7ff6c96d8700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6a4018730 0x7ff6a401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:22.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.108+0000 7ff6c96d8700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6a4018730 0x7ff6a401abc0 crc :-1 s=READY pgs=612 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:22.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.114+0000 7ff6cb13b700 1 -- 172.21.15.80:0/3632052473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c4079660 con 0x7ff6c4150f50 2019-11-28T11:41:22.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.118+0000 7ff6c8ed7700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c4150f50 0x7ff6c407af60 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7ff6b80103e0 tx=0x7ff6b8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.118+0000 7ff6c1ffb700 1 -- 172.21.15.80:0/3632052473 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff6b802cfe0 con 0x7ff6c4150f50 2019-11-28T11:41:22.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.290+0000 7ff6cb13b700 1 -- 172.21.15.80:0/3632052473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff6c40792e0 con 0x7ff6c4150f50 2019-11-28T11:41:22.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.290+0000 7ff6c8ed7700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c4150f50 0x7ff6c407af60 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7ff6b80103e0 tx=0x7ff6b8010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.290+0000 7ff6c1ffb700 1 -- 172.21.15.80:0/3632052473 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v39) v1 ==== 80+0+4797 (secure 0 0 0) 0x7ff6b802cfe0 con 0x7ff6c4150f50 2019-11-28T11:41:22.325 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:22.325 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:41:22.325 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:41:22.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.326 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:41:22.326 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:41:22.326 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.326 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:41:22.326 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:41:22.326 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:41:22.327 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:41:22.327 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.327 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:41:22.327 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:41:22.327 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.328 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:41:22.328 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:41:22.329 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:41:22.329 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:41:22.329 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.330 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:41:22.331 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:41:22.331 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.331 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:41:22.332 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:41:22.332 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:41:22.332 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:41:22.332 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.333 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:41:22.333 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:41:22.333 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.333 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:41:22.333 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:41:22.333 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:41:22.334 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.334 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:41:22.334 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:41:22.334 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.335 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:41:22.335 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:41:22.335 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:41:22.335 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.336 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:41:22.336 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:41:22.336 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.336 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:41:22.336 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:41:22.336 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:41:22.336 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.337 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:41:22.337 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:41:22.337 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.338 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:41:22.338 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:41:22.338 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:41:22.338 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.342 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:41:22.342 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:41:22.342 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.342 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:41:22.342 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:41:22.342 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:41:22.343 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.343 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:41:22.343 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:41:22.343 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.343 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:41:22.344 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:41:22.344 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:41:22.344 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.344 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:41:22.344 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:41:22.345 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.345 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:41:22.345 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:41:22.345 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:41:22.345 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.346 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:41:22.346 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:41:22.346 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.347 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:41:22.347 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:41:22.347 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:41:22.347 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.348 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:41:22.348 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:41:22.348 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.348 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:41:22.349 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:41:22.349 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:41:22.349 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.352 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:41:22.353 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:41:22.353 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.353 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:41:22.353 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:41:22.353 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:41:22.353 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.354 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:41:22.354 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:41:22.354 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.354 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:41:22.355 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:41:22.355 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:41:22.355 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.355 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:41:22.356 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:41:22.356 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.356 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:41:22.356 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:41:22.356 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:41:22.357 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.357 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:41:22.358 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:41:22.358 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.358 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:41:22.358 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:41:22.358 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:41:22.358 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:41:22.359 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.359 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:41:22.359 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:41:22.359 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.360 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:41:22.360 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:41:22.360 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:41:22.361 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:41:22.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:22.362 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:41:22.362 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:41:22.363 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:41:22.363 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:41:22.363 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:41:22.364 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:41:22.364 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.364 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:22.364 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:41:22.364 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:41:22.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.293+0000 7ff6cb13b700 1 -- 172.21.15.80:0/3632052473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6a4018730 msgr2=0x7ff6a401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.293+0000 7ff6cb13b700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6a4018730 0x7ff6a401abc0 crc :-1 s=READY pgs=612 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:22.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.293+0000 7ff6cb13b700 1 -- 172.21.15.80:0/3632052473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c4150f50 msgr2=0x7ff6c407af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.293+0000 7ff6cb13b700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c4150f50 0x7ff6c407af60 secure :-1 s=READY pgs=1504 cs=0 l=1 rx=0x7ff6b80103e0 tx=0x7ff6b8010290).stop 2019-11-28T11:41:22.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.293+0000 7ff6cb13b700 1 -- 172.21.15.80:0/3632052473 shutdown_connections 2019-11-28T11:41:22.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.293+0000 7ff6cb13b700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6a4018730 0x7ff6a401abc0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:22.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.293+0000 7ff6cb13b700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6c407bba0 0x7ff6c407b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:22.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.293+0000 7ff6cb13b700 1 --2- 172.21.15.80:0/3632052473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6c4150f50 0x7ff6c407af60 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:22.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.293+0000 7ff6cb13b700 1 --2- 172.21.15.80:0/3632052473 >> v2:172.21.15.174:3300/0 conn(0x7ff6c4074d00 0x7ff6c407aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:22.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.293+0000 7ff6cb13b700 1 -- 172.21.15.80:0/3632052473 shutdown_connections 2019-11-28T11:41:22.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.293+0000 7ff6cb13b700 1 -- 172.21.15.80:0/3632052473 wait complete. 2019-11-28T11:41:22.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.293+0000 7ff6cb13b700 1 -- 172.21.15.80:0/3632052473 >> 172.21.15.80:0/3632052473 conn(0x7ff6c413fa50 msgr2=0x7ff6c407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:22.369 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:41:22.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.455+0000 7f5f99542700 1 Processor -- start 2019-11-28T11:41:22.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.455+0000 7f5f99542700 1 -- start start 2019-11-28T11:41:22.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.456+0000 7f5f99542700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f9406c0a0 0x7f5f94072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:22.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.456+0000 7f5f99542700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f940734e0 0x7f5f94071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:22.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.456+0000 7f5f99542700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5f94072360 0x7f5f940727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:22.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.456+0000 7f5f99542700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9406f330 con 0x7f5f940734e0 2019-11-28T11:41:22.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.456+0000 7f5f99542700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f940706c0 con 0x7f5f94072360 2019-11-28T11:41:22.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.456+0000 7f5f99542700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f94070a40 con 0x7f5f9406c0a0 2019-11-28T11:41:22.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.456+0000 7f5f92ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f940734e0 0x7f5f94071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:22.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.456+0000 7f5f92ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f940734e0 0x7f5f94071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39006/0 (socket says 172.21.15.80:39006) 2019-11-28T11:41:22.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.456+0000 7f5f92ffd700 1 -- 172.21.15.80:0/2585038887 learned_addr learned my addr 172.21.15.80:0/2585038887 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:22.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.456+0000 7f5f937fe700 1 --2- 172.21.15.80:0/2585038887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f9406c0a0 0x7f5f94072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:22.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f93fff700 1 --2- 172.21.15.80:0/2585038887 >> v2:172.21.15.174:3300/0 conn(0x7f5f94072360 0x7f5f940727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:22.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f92ffd700 1 -- 172.21.15.80:0/2585038887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f9406c0a0 msgr2=0x7f5f94072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:22.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f92ffd700 1 --2- 172.21.15.80:0/2585038887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f9406c0a0 0x7f5f94072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:22.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f92ffd700 1 -- 172.21.15.80:0/2585038887 >> v2:172.21.15.174:3300/0 conn(0x7f5f94072360 msgr2=0x7f5f940727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:22.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f92ffd700 1 --2- 172.21.15.80:0/2585038887 >> v2:172.21.15.174:3300/0 conn(0x7f5f94072360 0x7f5f940727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:22.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f92ffd700 1 -- 172.21.15.80:0/2585038887 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9406db00 con 0x7f5f940734e0 2019-11-28T11:41:22.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f92ffd700 1 --2- 172.21.15.80:0/2585038887 >> v2:172.21.15.80:3300/0 conn(0x7f5f940734e0 0x7f5f94071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5f7c00f6c0 tx=0x7f5f7c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f92ffd700 1 --2- 172.21.15.80:0/2585038887 >> v2:172.21.15.80:3300/0 conn(0x7f5f940734e0 0x7f5f94071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5f7c00f6c0 tx=0x7f5f7c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f92ffd700 1 --2- 172.21.15.80:0/2585038887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f940734e0 0x7f5f94071e20 secure :-1 s=READY pgs=1505 cs=0 l=1 rx=0x7f5f7c00f6c0 tx=0x7f5f7c00f570).ready entity=mon.0 client_cookie=d63778c24ed7dbf2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:22.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f92ffd700 1 --2- 172.21.15.80:0/2585038887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f940734e0 0x7f5f94071e20 secure :-1 s=THROTTLE_DONE pgs=1505 cs=0 l=1 rx=0x7f5f7c00f6c0 tx=0x7f5f7c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f92ffd700 1 --2- 172.21.15.80:0/2585038887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f940734e0 0x7f5f94071e20 secure :-1 s=THROTTLE_DONE pgs=1505 cs=0 l=1 rx=0x7f5f7c00f6c0 tx=0x7f5f7c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f92ffd700 1 --2- 172.21.15.80:0/2585038887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f940734e0 0x7f5f94071e20 secure :-1 s=THROTTLE_DONE pgs=1505 cs=0 l=1 rx=0x7f5f7c00f6c0 tx=0x7f5f7c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f927fc700 1 -- 172.21.15.80:0/2585038887 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f7c000960 con 0x7f5f940734e0 2019-11-28T11:41:22.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f927fc700 1 -- 172.21.15.80:0/2585038887 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c000c90 con 0x7f5f940734e0 2019-11-28T11:41:22.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f927fc700 1 -- 172.21.15.80:0/2585038887 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f7c0013a0 con 0x7f5f940734e0 2019-11-28T11:41:22.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f99542700 1 -- 172.21.15.80:0/2585038887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f940734e0 msgr2=0x7f5f94071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.457+0000 7f5f99542700 1 --2- 172.21.15.80:0/2585038887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f940734e0 0x7f5f94071e20 secure :-1 s=READY pgs=1505 cs=0 l=1 rx=0x7f5f7c00f6c0 tx=0x7f5f7c00f570).stop 2019-11-28T11:41:22.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.458+0000 7f5f99542700 1 -- 172.21.15.80:0/2585038887 shutdown_connections 2019-11-28T11:41:22.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.458+0000 7f5f99542700 1 --2- 172.21.15.80:0/2585038887 >> v2:172.21.15.174:3300/0 conn(0x7f5f94072360 0x7f5f940727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:22.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.458+0000 7f5f99542700 1 --2- 172.21.15.80:0/2585038887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f940734e0 0x7f5f94071e20 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:22.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.458+0000 7f5f99542700 1 --2- 172.21.15.80:0/2585038887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f9406c0a0 0x7f5f94072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:22.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.458+0000 7f5f99542700 1 -- 172.21.15.80:0/2585038887 shutdown_connections 2019-11-28T11:41:22.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.458+0000 7f5f99542700 1 -- 172.21.15.80:0/2585038887 wait complete. 2019-11-28T11:41:22.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.458+0000 7f5f99542700 1 -- 172.21.15.80:0/2585038887 >> 172.21.15.80:0/2585038887 conn(0x7f5f94061cf0 msgr2=0x7f5f94064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:22.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.460+0000 7f5f99542700 1 Processor -- start 2019-11-28T11:41:22.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.460+0000 7f5f99542700 1 -- start start 2019-11-28T11:41:22.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.461+0000 7f5f99542700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5f94128e40 0x7f5f94168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:22.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.461+0000 7f5f99542700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f94139a60 con 0x7f5f9413a780 2019-11-28T11:41:22.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.461+0000 7f5f99542700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9413b060 con 0x7f5f941281b0 2019-11-28T11:41:22.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.461+0000 7f5f99542700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9412a260 con 0x7f5f94128e40 2019-11-28T11:41:22.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.461+0000 7f5f937fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5f9413a780 0x7f5f9412d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38324/0 (socket says 172.21.15.80:38324) 2019-11-28T11:41:22.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.461+0000 7f5f937fe700 1 -- 172.21.15.80:0/2930207538 learned_addr learned my addr 172.21.15.80:0/2930207538 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:22.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.461+0000 7f5f93fff700 1 --2- 172.21.15.80:0/2930207538 >> v2:172.21.15.174:3300/0 conn(0x7f5f94128e40 0x7f5f94168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:22.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.461+0000 7f5f8bfff700 1 -- 172.21.15.80:0/2930207538 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790047185 0 0) 0x7f5f8c001430 con 0x7f5f9413a780 2019-11-28T11:41:22.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f8bfff700 1 -- 172.21.15.80:0/2930207538 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f78002e80 con 0x7f5f9413a780 2019-11-28T11:41:22.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f8bfff700 1 -- 172.21.15.80:0/2930207538 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272406067 0 0) 0x7f5f7c007a60 con 0x7f5f941281b0 2019-11-28T11:41:22.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f8bfff700 1 -- 172.21.15.80:0/2930207538 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f780030b0 con 0x7f5f941281b0 2019-11-28T11:41:22.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f8bfff700 1 -- 172.21.15.80:0/2930207538 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3363653888 0 0) 0x7f5f8c001630 con 0x7f5f9413a780 2019-11-28T11:41:22.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f93fff700 1 -- 172.21.15.80:0/2930207538 >> v1:172.21.15.174:6789/0 conn(0x7f5f941281b0 legacy=0x7f5f94128640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f93fff700 1 -- 172.21.15.80:0/2930207538 >> v1:172.21.15.80:6789/0 conn(0x7f5f9413a780 legacy=0x7f5f9412d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f93fff700 1 -- 172.21.15.80:0/2930207538 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9412abc0 con 0x7f5f94128e40 2019-11-28T11:41:22.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f93fff700 1 --2- 172.21.15.80:0/2930207538 >> v2:172.21.15.174:3300/0 conn(0x7f5f94128e40 0x7f5f94168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5f840103b0 tx=0x7f5f84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f93fff700 1 --2- 172.21.15.80:0/2930207538 >> v2:172.21.15.174:3300/0 conn(0x7f5f94128e40 0x7f5f94168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5f840103b0 tx=0x7f5f84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f93fff700 1 --2- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f94128e40 0x7f5f94168d80 secure :-1 s=READY pgs=882 cs=0 l=1 rx=0x7f5f840103b0 tx=0x7f5f84010750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:22.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f93fff700 1 --2- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f94128e40 0x7f5f94168d80 secure :-1 s=THROTTLE_DONE pgs=882 cs=0 l=1 rx=0x7f5f840103b0 tx=0x7f5f84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f8bfff700 1 -- 172.21.15.80:0/2930207538 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f8400a6b0 con 0x7f5f94128e40 2019-11-28T11:41:22.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f93fff700 1 --2- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f94128e40 0x7f5f94168d80 secure :-1 s=THROTTLE_DONE pgs=882 cs=0 l=1 rx=0x7f5f840103b0 tx=0x7f5f84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f8bfff700 1 -- 172.21.15.80:0/2930207538 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f84001060 con 0x7f5f94128e40 2019-11-28T11:41:22.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f93fff700 1 --2- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f94128e40 0x7f5f94168d80 secure :-1 s=THROTTLE_DONE pgs=882 cs=0 l=1 rx=0x7f5f840103b0 tx=0x7f5f84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f99542700 1 -- 172.21.15.80:0/2930207538 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f9412af40 con 0x7f5f94128e40 2019-11-28T11:41:22.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f8bfff700 1 -- 172.21.15.80:0/2930207538 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f84001250 con 0x7f5f94128e40 2019-11-28T11:41:22.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.462+0000 7f5f99542700 1 -- 172.21.15.80:0/2930207538 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9412abc0 con 0x7f5f94128e40 2019-11-28T11:41:22.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.463+0000 7f5f93fff700 1 --2- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f94128e40 0x7f5f94168d80 secure :-1 s=THROTTLE_DONE pgs=882 cs=0 l=1 rx=0x7f5f840103b0 tx=0x7f5f84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.463+0000 7f5f8bfff700 1 -- 172.21.15.80:0/2930207538 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5f84001250 con 0x7f5f94128e40 2019-11-28T11:41:22.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.463+0000 7f5f93fff700 1 --2- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f94128e40 0x7f5f94168d80 secure :-1 s=THROTTLE_DONE pgs=882 cs=0 l=1 rx=0x7f5f840103b0 tx=0x7f5f84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.463+0000 7f5f8bfff700 1 --2- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f78018750 0x7f5f7801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:22.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.463+0000 7f5f8bfff700 1 -- 172.21.15.80:0/2930207538 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f5f84031ab0 con 0x7f5f94128e40 2019-11-28T11:41:22.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.463+0000 7f5f937fe700 1 --2- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f78018750 0x7f5f7801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:22.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.464+0000 7f5f937fe700 1 --2- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f78018750 0x7f5f7801abe0 crc :-1 s=READY pgs=613 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:22.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.470+0000 7f5f99542700 1 -- 172.21.15.80:0/2930207538 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9412af40 con 0x7f5f94128e40 2019-11-28T11:41:22.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.474+0000 7f5f93fff700 1 --2- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f94128e40 0x7f5f94168d80 secure :-1 s=THROTTLE_DONE pgs=882 cs=0 l=1 rx=0x7f5f840103b0 tx=0x7f5f84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.474+0000 7f5f8bfff700 1 -- 172.21.15.80:0/2930207538 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5f84000a70 con 0x7f5f94128e40 2019-11-28T11:41:22.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.651+0000 7f5f99542700 1 -- 172.21.15.80:0/2930207538 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f9412abc0 con 0x7f5f94128e40 2019-11-28T11:41:22.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.652+0000 7f5f93fff700 1 --2- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f94128e40 0x7f5f94168d80 secure :-1 s=THROTTLE_DONE pgs=882 cs=0 l=1 rx=0x7f5f840103b0 tx=0x7f5f84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.652+0000 7f5f8bfff700 1 -- 172.21.15.80:0/2930207538 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+12009 (secure 0 0 0) 0x7f5f84001250 con 0x7f5f94128e40 2019-11-28T11:41:22.685 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:22.686 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":113,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:41:21.928639+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:41:22.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.654+0000 7f5f99542700 1 -- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f78018750 msgr2=0x7f5f7801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.654+0000 7f5f99542700 1 --2- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f78018750 0x7f5f7801abe0 crc :-1 s=READY pgs=613 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:22.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.654+0000 7f5f99542700 1 -- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f94128e40 msgr2=0x7f5f94168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.654+0000 7f5f99542700 1 --2- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f94128e40 0x7f5f94168d80 secure :-1 s=READY pgs=882 cs=0 l=1 rx=0x7f5f840103b0 tx=0x7f5f84010750).stop 2019-11-28T11:41:22.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.654+0000 7f5f99542700 1 -- 172.21.15.80:0/2930207538 shutdown_connections 2019-11-28T11:41:22.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.654+0000 7f5f99542700 1 --2- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f94128e40 0x7f5f94168d80 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:22.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.654+0000 7f5f99542700 1 --2- 172.21.15.80:0/2930207538 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f78018750 0x7f5f7801abe0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:22.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.654+0000 7f5f99542700 1 -- 172.21.15.80:0/2930207538 shutdown_connections 2019-11-28T11:41:22.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.654+0000 7f5f99542700 1 -- 172.21.15.80:0/2930207538 wait complete. 2019-11-28T11:41:22.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.654+0000 7f5f99542700 1 -- 172.21.15.80:0/2930207538 >> 172.21.15.80:0/2930207538 conn(0x7f5f94127dc0 msgr2=0x7f5f94141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:22.698 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:41:22.700 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:41:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.791+0000 7f4f4ebfc700 1 Processor -- start 2019-11-28T11:41:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.791+0000 7f4f4ebfc700 1 -- start start 2019-11-28T11:41:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.792+0000 7f4f4ebfc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4f4815f100 0x7f4f4806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.792+0000 7f4f4ebfc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4f4806c2f0 0x7f4f4806c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:22.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.792+0000 7f4f4ebfc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4806db60 con 0x7f4f4815ed10 2019-11-28T11:41:22.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.792+0000 7f4f4ebfc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4806fe00 con 0x7f4f4806c2f0 2019-11-28T11:41:22.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.792+0000 7f4f4ebfc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f480700d0 con 0x7f4f4815f100 2019-11-28T11:41:22.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.792+0000 7f4f4d99a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4f4806c2f0 0x7f4f4806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:22.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.792+0000 7f4f4d99a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4f4806c2f0 0x7f4f4806c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39018/0 (socket says 172.21.15.80:39018) 2019-11-28T11:41:22.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.792+0000 7f4f4d99a700 1 -- 172.21.15.80:0/248990471 learned_addr learned my addr 172.21.15.80:0/248990471 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:22.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.793+0000 7f4f4c998700 1 --2- 172.21.15.80:0/248990471 >> v2:172.21.15.174:3300/0 conn(0x7f4f4815f100 0x7f4f4806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:22.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.793+0000 7f4f4d99a700 1 -- 172.21.15.80:0/248990471 >> v2:172.21.15.174:3300/0 conn(0x7f4f4815f100 msgr2=0x7f4f4806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:22.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.793+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/248990471 >> v2:172.21.15.174:3300/0 conn(0x7f4f4815f100 0x7f4f4806bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:22.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.793+0000 7f4f4d99a700 1 -- 172.21.15.80:0/248990471 >> v1:172.21.15.174:6789/0 conn(0x7f4f4815ed10 legacy=0x7f4f48073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.793+0000 7f4f4d99a700 1 -- 172.21.15.80:0/248990471 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f48070760 con 0x7f4f4806c2f0 2019-11-28T11:41:22.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.793+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/248990471 >> v2:172.21.15.80:3300/0 conn(0x7f4f4806c2f0 0x7f4f4806c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4f4000f6b0 tx=0x7f4f4000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.793+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/248990471 >> v2:172.21.15.80:3300/0 conn(0x7f4f4806c2f0 0x7f4f4806c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4f4000f6b0 tx=0x7f4f4000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.793+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/248990471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4806c2f0 0x7f4f4806c770 secure :-1 s=READY pgs=1507 cs=0 l=1 rx=0x7f4f4000f6b0 tx=0x7f4f4000fa50).ready entity=mon.0 client_cookie=fabc7d59eea51d58 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:22.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.793+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/248990471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4806c2f0 0x7f4f4806c770 secure :-1 s=THROTTLE_DONE pgs=1507 cs=0 l=1 rx=0x7f4f4000f6b0 tx=0x7f4f4000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.793+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/248990471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4806c2f0 0x7f4f4806c770 secure :-1 s=THROTTLE_DONE pgs=1507 cs=0 l=1 rx=0x7f4f4000f6b0 tx=0x7f4f4000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.793+0000 7f4f47fff700 1 -- 172.21.15.80:0/248990471 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f40000a70 con 0x7f4f4806c2f0 2019-11-28T11:41:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.793+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/248990471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4806c2f0 0x7f4f4806c770 secure :-1 s=THROTTLE_DONE pgs=1507 cs=0 l=1 rx=0x7f4f4000f6b0 tx=0x7f4f4000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.793+0000 7f4f47fff700 1 -- 172.21.15.80:0/248990471 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f400010e0 con 0x7f4f4806c2f0 2019-11-28T11:41:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.793+0000 7f4f47fff700 1 -- 172.21.15.80:0/248990471 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f400017b0 con 0x7f4f4806c2f0 2019-11-28T11:41:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.793+0000 7f4f4ebfc700 1 -- 172.21.15.80:0/248990471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4806c2f0 msgr2=0x7f4f4806c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.793+0000 7f4f4ebfc700 1 --2- 172.21.15.80:0/248990471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4806c2f0 0x7f4f4806c770 secure :-1 s=READY pgs=1507 cs=0 l=1 rx=0x7f4f4000f6b0 tx=0x7f4f4000fa50).stop 2019-11-28T11:41:22.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.794+0000 7f4f4ebfc700 1 -- 172.21.15.80:0/248990471 shutdown_connections 2019-11-28T11:41:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.794+0000 7f4f4ebfc700 1 --2- 172.21.15.80:0/248990471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4806c2f0 0x7f4f4806c770 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.794+0000 7f4f4ebfc700 1 --2- 172.21.15.80:0/248990471 >> v2:172.21.15.174:3300/0 conn(0x7f4f4815f100 0x7f4f4806bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.794+0000 7f4f4ebfc700 1 -- 172.21.15.80:0/248990471 shutdown_connections 2019-11-28T11:41:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.794+0000 7f4f4ebfc700 1 -- 172.21.15.80:0/248990471 wait complete. 2019-11-28T11:41:22.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.794+0000 7f4f4ebfc700 1 -- 172.21.15.80:0/248990471 >> 172.21.15.80:0/248990471 conn(0x7f4f48061d20 msgr2=0x7f4f480641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.796+0000 7f4f4ebfc700 1 Processor -- start 2019-11-28T11:41:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.796+0000 7f4f4ebfc700 1 -- start start 2019-11-28T11:41:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.797+0000 7f4f4ebfc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f4810ed60 0x7f4f4810f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.797+0000 7f4f4ebfc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4f4810f730 0x7f4f48167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.797+0000 7f4f4ebfc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4810c250 con 0x7f4f4810e970 2019-11-28T11:41:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.797+0000 7f4f4ebfc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4810e430 con 0x7f4f4810f730 2019-11-28T11:41:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.797+0000 7f4f4ebfc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f48105860 con 0x7f4f4810ed60 2019-11-28T11:41:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.797+0000 7f4f4d99a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4f4810f730 0x7f4f48167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.797+0000 7f4f4d99a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4f4810f730 0x7f4f48167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39026/0 (socket says 172.21.15.80:39026) 2019-11-28T11:41:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.797+0000 7f4f4d99a700 1 -- 172.21.15.80:0/1558767322 learned_addr learned my addr 172.21.15.80:0/1558767322 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:22.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.798+0000 7f4f4d99a700 1 -- 172.21.15.80:0/1558767322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f4810ed60 msgr2=0x7f4f4810f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.798+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f4810ed60 0x7f4f4810f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:22.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.798+0000 7f4f4d99a700 1 -- 172.21.15.80:0/1558767322 >> v1:172.21.15.174:6789/0 conn(0x7f4f4810e970 legacy=0x7f4f481087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:22.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.798+0000 7f4f4d99a700 1 -- 172.21.15.80:0/1558767322 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f48105ef0 con 0x7f4f4810f730 2019-11-28T11:41:22.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.798+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/1558767322 >> v2:172.21.15.80:3300/0 conn(0x7f4f4810f730 0x7f4f48167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f40010430 tx=0x7f4f400102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.798+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/1558767322 >> v2:172.21.15.80:3300/0 conn(0x7f4f4810f730 0x7f4f48167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f40010430 tx=0x7f4f400102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.798+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4810f730 0x7f4f48167d70 secure :-1 s=READY pgs=1508 cs=0 l=1 rx=0x7f4f40010430 tx=0x7f4f400102b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:22.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.798+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4810f730 0x7f4f48167d70 secure :-1 s=THROTTLE_DONE pgs=1508 cs=0 l=1 rx=0x7f4f40010430 tx=0x7f4f400102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.798+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4810f730 0x7f4f48167d70 secure :-1 s=THROTTLE_DONE pgs=1508 cs=0 l=1 rx=0x7f4f40010430 tx=0x7f4f400102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.798+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4810f730 0x7f4f48167d70 secure :-1 s=THROTTLE_DONE pgs=1508 cs=0 l=1 rx=0x7f4f40010430 tx=0x7f4f400102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.798+0000 7f4f45ffb700 1 -- 172.21.15.80:0/1558767322 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f400012b0 con 0x7f4f4810f730 2019-11-28T11:41:22.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.798+0000 7f4f45ffb700 1 -- 172.21.15.80:0/1558767322 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f40008180 con 0x7f4f4810f730 2019-11-28T11:41:22.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.798+0000 7f4f4ebfc700 1 -- 172.21.15.80:0/1558767322 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f48106270 con 0x7f4f4810f730 2019-11-28T11:41:22.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.798+0000 7f4f45ffb700 1 -- 172.21.15.80:0/1558767322 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f40001890 con 0x7f4f4810f730 2019-11-28T11:41:22.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.798+0000 7f4f4ebfc700 1 -- 172.21.15.80:0/1558767322 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f48105ef0 con 0x7f4f4810f730 2019-11-28T11:41:22.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.798+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4810f730 0x7f4f48167d70 secure :-1 s=THROTTLE_DONE pgs=1508 cs=0 l=1 rx=0x7f4f40010430 tx=0x7f4f400102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.799+0000 7f4f45ffb700 1 -- 172.21.15.80:0/1558767322 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4f400010c0 con 0x7f4f4810f730 2019-11-28T11:41:22.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.799+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4810f730 0x7f4f48167d70 secure :-1 s=THROTTLE_DONE pgs=1508 cs=0 l=1 rx=0x7f4f40010430 tx=0x7f4f400102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.799+0000 7f4f45ffb700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f2c018730 0x7f4f2c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:22.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.799+0000 7f4f45ffb700 1 -- 172.21.15.80:0/1558767322 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f4f40031ae0 con 0x7f4f4810f730 2019-11-28T11:41:22.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.799+0000 7f4f4d199700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f2c018730 0x7f4f2c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:22.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.799+0000 7f4f4d199700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f2c018730 0x7f4f2c01abc0 crc :-1 s=READY pgs=614 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:22.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.806+0000 7f4f4ebfc700 1 -- 172.21.15.80:0/1558767322 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f48106270 con 0x7f4f4810f730 2019-11-28T11:41:22.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.810+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4810f730 0x7f4f48167d70 secure :-1 s=THROTTLE_DONE pgs=1508 cs=0 l=1 rx=0x7f4f40010430 tx=0x7f4f400102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:22.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.810+0000 7f4f45ffb700 1 -- 172.21.15.80:0/1558767322 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4f4002e8b0 con 0x7f4f4810f730 2019-11-28T11:41:23.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.976+0000 7f4f4ebfc700 1 -- 172.21.15.80:0/1558767322 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f4f48105ef0 con 0x7f4f4810f730 2019-11-28T11:41:23.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.976+0000 7f4f4d99a700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4810f730 0x7f4f48167d70 secure :-1 s=THROTTLE_DONE pgs=1508 cs=0 l=1 rx=0x7f4f40010430 tx=0x7f4f400102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.976+0000 7f4f45ffb700 1 -- 172.21.15.80:0/1558767322 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v113) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4f4002e8b0 con 0x7f4f4810f730 2019-11-28T11:41:23.010 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:41:23.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.978+0000 7f4f4ebfc700 1 -- 172.21.15.80:0/1558767322 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f2c018730 msgr2=0x7f4f2c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.978+0000 7f4f4ebfc700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f2c018730 0x7f4f2c01abc0 crc :-1 s=READY pgs=614 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.978+0000 7f4f4ebfc700 1 -- 172.21.15.80:0/1558767322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4810f730 msgr2=0x7f4f48167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:23.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.978+0000 7f4f4ebfc700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4810f730 0x7f4f48167d70 secure :-1 s=READY pgs=1508 cs=0 l=1 rx=0x7f4f40010430 tx=0x7f4f400102b0).stop 2019-11-28T11:41:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.979+0000 7f4f4ebfc700 1 -- 172.21.15.80:0/1558767322 shutdown_connections 2019-11-28T11:41:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.979+0000 7f4f4ebfc700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f4810f730 0x7f4f48167d70 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.979+0000 7f4f4ebfc700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f4810ed60 0x7f4f4810f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:23.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.979+0000 7f4f4ebfc700 1 --2- 172.21.15.80:0/1558767322 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f2c018730 0x7f4f2c01abc0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.979+0000 7f4f4ebfc700 1 -- 172.21.15.80:0/1558767322 shutdown_connections 2019-11-28T11:41:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.979+0000 7f4f4ebfc700 1 -- 172.21.15.80:0/1558767322 wait complete. 2019-11-28T11:41:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:22.979+0000 7f4f4ebfc700 1 -- 172.21.15.80:0/1558767322 >> 172.21.15.80:0/1558767322 conn(0x7f4f4815e2d0 msgr2=0x7f4f48147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:23.022 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:41:23.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.108+0000 7f908d589700 1 Processor -- start 2019-11-28T11:41:23.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.108+0000 7f908d589700 1 -- start start 2019-11-28T11:41:23.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.109+0000 7f908d589700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f908806c490 0x7f908806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:23.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.109+0000 7f908d589700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f908806ce60 0x7f9088164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:23.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.109+0000 7f908d589700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908806db00 con 0x7f908806c0a0 2019-11-28T11:41:23.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.109+0000 7f908d589700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f908806fd60 con 0x7f908806ce60 2019-11-28T11:41:23.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.109+0000 7f908d589700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9088070030 con 0x7f908806c490 2019-11-28T11:41:23.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.109+0000 7f9087fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f908806ce60 0x7f9088164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:23.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.109+0000 7f9086ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f908806c490 0x7f908806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:23.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.109+0000 7f9087fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f908806ce60 0x7f9088164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:53920/0 (socket says 172.21.15.80:53920) 2019-11-28T11:41:23.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.109+0000 7f9086ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f908806c490 0x7f908806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:41292/0 (socket says 172.21.15.80:41292) 2019-11-28T11:41:23.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.109+0000 7f9087fff700 1 -- 172.21.15.80:0/1030534693 learned_addr learned my addr 172.21.15.80:0/1030534693 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:23.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.110+0000 7f9086ffd700 1 -- 172.21.15.80:0/1030534693 >> v2:172.21.15.174:3300/0 conn(0x7f908806ce60 msgr2=0x7f9088164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:23.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.110+0000 7f9086ffd700 1 --2- 172.21.15.80:0/1030534693 >> v2:172.21.15.174:3300/0 conn(0x7f908806ce60 0x7f9088164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:23.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.110+0000 7f9086ffd700 1 -- 172.21.15.80:0/1030534693 >> v1:172.21.15.174:6789/0 conn(0x7f908806c0a0 legacy=0x7f9088072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:23.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.110+0000 7f9086ffd700 1 -- 172.21.15.80:0/1030534693 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90880706c0 con 0x7f908806c490 2019-11-28T11:41:23.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.110+0000 7f9086ffd700 1 --2- 172.21.15.80:0/1030534693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f908806c490 0x7f908806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f907000af50 tx=0x7f907000b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.110+0000 7f9086ffd700 1 --2- 172.21.15.80:0/1030534693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f908806c490 0x7f908806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f907000af50 tx=0x7f907000b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.110+0000 7f9086ffd700 1 --2- 172.21.15.80:0/1030534693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f908806c490 0x7f908806c920 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7f907000af50 tx=0x7f907000b250).ready entity=mon.2 client_cookie=3bcd36804c364349 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:23.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.110+0000 7f9086ffd700 1 --2- 172.21.15.80:0/1030534693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f908806c490 0x7f908806c920 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f907000af50 tx=0x7f907000b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.110+0000 7f9086ffd700 1 --2- 172.21.15.80:0/1030534693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f908806c490 0x7f908806c920 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f907000af50 tx=0x7f907000b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.110+0000 7f90867fc700 1 -- 172.21.15.80:0/1030534693 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9070007210 con 0x7f908806c490 2019-11-28T11:41:23.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.110+0000 7f9086ffd700 1 --2- 172.21.15.80:0/1030534693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f908806c490 0x7f908806c920 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f907000af50 tx=0x7f907000b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.110+0000 7f90867fc700 1 -- 172.21.15.80:0/1030534693 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90700099b0 con 0x7f908806c490 2019-11-28T11:41:23.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.110+0000 7f90867fc700 1 -- 172.21.15.80:0/1030534693 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f907000a080 con 0x7f908806c490 2019-11-28T11:41:23.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.110+0000 7f908d589700 1 -- 172.21.15.80:0/1030534693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f908806c490 msgr2=0x7f908806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:23.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.110+0000 7f908d589700 1 --2- 172.21.15.80:0/1030534693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f908806c490 0x7f908806c920 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7f907000af50 tx=0x7f907000b250).stop 2019-11-28T11:41:23.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.111+0000 7f908d589700 1 -- 172.21.15.80:0/1030534693 shutdown_connections 2019-11-28T11:41:23.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.111+0000 7f908d589700 1 --2- 172.21.15.80:0/1030534693 >> v2:172.21.15.174:3300/0 conn(0x7f908806ce60 0x7f9088164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:23.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.111+0000 7f908d589700 1 --2- 172.21.15.80:0/1030534693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f908806c490 0x7f908806c920 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:23.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.111+0000 7f908d589700 1 -- 172.21.15.80:0/1030534693 shutdown_connections 2019-11-28T11:41:23.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.111+0000 7f908d589700 1 -- 172.21.15.80:0/1030534693 wait complete. 2019-11-28T11:41:23.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.111+0000 7f908d589700 1 -- 172.21.15.80:0/1030534693 >> 172.21.15.80:0/1030534693 conn(0x7f9088061cf0 msgr2=0x7f9088064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:23.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.113+0000 7f908d589700 1 Processor -- start 2019-11-28T11:41:23.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.114+0000 7f908d589700 1 -- start start 2019-11-28T11:41:23.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f908d589700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9088109e40 0x7f908810a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:23.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f908d589700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908813f1e0 con 0x7f908813eb40 2019-11-28T11:41:23.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f908d589700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9088131a30 con 0x7f908810a810 2019-11-28T11:41:23.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f908d589700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90881234c0 con 0x7f9088109e40 2019-11-28T11:41:23.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f90877fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f908813eb40 0x7f908810afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38352/0 (socket says 172.21.15.80:38352) 2019-11-28T11:41:23.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f90877fe700 1 -- 172.21.15.80:0/2488826481 learned_addr learned my addr 172.21.15.80:0/2488826481 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:23.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f9086ffd700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9088109e40 0x7f908810a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:23.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f907ffff700 1 -- 172.21.15.80:0/2488826481 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290391318 0 0) 0x7f9078001150 con 0x7f908813eb40 2019-11-28T11:41:23.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f907ffff700 1 -- 172.21.15.80:0/2488826481 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9060002e80 con 0x7f908813eb40 2019-11-28T11:41:23.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f907ffff700 1 -- 172.21.15.80:0/2488826481 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766247841 0 0) 0x7f9080007950 con 0x7f908810a810 2019-11-28T11:41:23.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f907ffff700 1 -- 172.21.15.80:0/2488826481 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90600030b0 con 0x7f908810a810 2019-11-28T11:41:23.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f9086ffd700 1 -- 172.21.15.80:0/2488826481 >> v1:172.21.15.174:6789/0 conn(0x7f908810a810 legacy=0x7f9088105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:23.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f907ffff700 1 -- 172.21.15.80:0/2488826481 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1699461266 0 0) 0x7f90780012c0 con 0x7f908813eb40 2019-11-28T11:41:23.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f9086ffd700 1 -- 172.21.15.80:0/2488826481 >> v1:172.21.15.80:6789/0 conn(0x7f908813eb40 legacy=0x7f908810afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:23.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f9086ffd700 1 -- 172.21.15.80:0/2488826481 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9088108700 con 0x7f9088109e40 2019-11-28T11:41:23.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f9086ffd700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9088109e40 0x7f908810a2d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9070010390 tx=0x7f9070010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f9086ffd700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9088109e40 0x7f908810a2d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9070010390 tx=0x7f9070010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f9086ffd700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9088109e40 0x7f908810a2d0 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f9070010390 tx=0x7f9070010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:23.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.115+0000 7f9086ffd700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9088109e40 0x7f908810a2d0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f9070010390 tx=0x7f9070010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.116+0000 7f907ffff700 1 -- 172.21.15.80:0/2488826481 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9070000940 con 0x7f9088109e40 2019-11-28T11:41:23.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.116+0000 7f9086ffd700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9088109e40 0x7f908810a2d0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f9070010390 tx=0x7f9070010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.116+0000 7f907ffff700 1 -- 172.21.15.80:0/2488826481 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907000a980 con 0x7f9088109e40 2019-11-28T11:41:23.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.116+0000 7f9086ffd700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9088109e40 0x7f908810a2d0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f9070010390 tx=0x7f9070010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.116+0000 7f907ffff700 1 -- 172.21.15.80:0/2488826481 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90700009e0 con 0x7f9088109e40 2019-11-28T11:41:23.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.116+0000 7f908d589700 1 -- 172.21.15.80:0/2488826481 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9088108a80 con 0x7f9088109e40 2019-11-28T11:41:23.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.116+0000 7f908d589700 1 -- 172.21.15.80:0/2488826481 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9088108700 con 0x7f9088109e40 2019-11-28T11:41:23.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.116+0000 7f9086ffd700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9088109e40 0x7f908810a2d0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f9070010390 tx=0x7f9070010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.116+0000 7f907ffff700 1 -- 172.21.15.80:0/2488826481 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9070009790 con 0x7f9088109e40 2019-11-28T11:41:23.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.116+0000 7f9086ffd700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9088109e40 0x7f908810a2d0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f9070010390 tx=0x7f9070010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.116+0000 7f907ffff700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9060018750 0x7f906001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:23.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.116+0000 7f907ffff700 1 -- 172.21.15.80:0/2488826481 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f9070031aa0 con 0x7f9088109e40 2019-11-28T11:41:23.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.117+0000 7f90877fe700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9060018750 0x7f906001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:23.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.117+0000 7f90877fe700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9060018750 0x7f906001abe0 crc :-1 s=READY pgs=615 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:23.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.124+0000 7f908d589700 1 -- 172.21.15.80:0/2488826481 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9088108a80 con 0x7f9088109e40 2019-11-28T11:41:23.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.128+0000 7f9086ffd700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9088109e40 0x7f908810a2d0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f9070010390 tx=0x7f9070010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.128+0000 7f907ffff700 1 -- 172.21.15.80:0/2488826481 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9070009580 con 0x7f9088109e40 2019-11-28T11:41:23.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.289+0000 7f908d589700 1 -- 172.21.15.80:0/2488826481 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9088108700 con 0x7f9088109e40 2019-11-28T11:41:23.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.289+0000 7f9086ffd700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9088109e40 0x7f908810a2d0 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f9070010390 tx=0x7f9070010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.289+0000 7f907ffff700 1 -- 172.21.15.80:0/2488826481 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v113) v1 ==== 84+0+64 (secure 0 0 0) 0x7f9070009790 con 0x7f9088109e40 2019-11-28T11:41:23.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.291+0000 7f908d589700 1 -- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9060018750 msgr2=0x7f906001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:23.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.291+0000 7f908d589700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9060018750 0x7f906001abe0 crc :-1 s=READY pgs=615 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:23.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.291+0000 7f908d589700 1 -- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9088109e40 msgr2=0x7f908810a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:23.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.291+0000 7f908d589700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9088109e40 0x7f908810a2d0 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f9070010390 tx=0x7f9070010730).stop 2019-11-28T11:41:23.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.291+0000 7f908d589700 1 -- 172.21.15.80:0/2488826481 shutdown_connections 2019-11-28T11:41:23.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.291+0000 7f908d589700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9060018750 0x7f906001abe0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:23.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.291+0000 7f908d589700 1 --2- 172.21.15.80:0/2488826481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9088109e40 0x7f908810a2d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:23.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.292+0000 7f908d589700 1 -- 172.21.15.80:0/2488826481 shutdown_connections 2019-11-28T11:41:23.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.292+0000 7f908d589700 1 -- 172.21.15.80:0/2488826481 wait complete. 2019-11-28T11:41:23.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.292+0000 7f908d589700 1 -- 172.21.15.80:0/2488826481 >> 172.21.15.80:0/2488826481 conn(0x7f908811bfc0 msgr2=0x7f9088141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:23.327 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:23.328 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:41:23.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:41:23.328 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:41:23.328 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:41:23.329 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:41:23.329 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:41:23.335 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:41:23.335 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:41:23.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.424+0000 7f275081f700 1 Processor -- start 2019-11-28T11:41:23.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.424+0000 7f275081f700 1 -- start start 2019-11-28T11:41:23.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f275081f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f274c15f100 0x7f274c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:23.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f275081f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f274c06c2f0 0x7f274c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:23.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f275081f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c06db60 con 0x7f274c15ed10 2019-11-28T11:41:23.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f275081f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274c06fe00 con 0x7f274c06c2f0 2019-11-28T11:41:23.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f275081f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274c0700d0 con 0x7f274c15f100 2019-11-28T11:41:23.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f274b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f274c06c2f0 0x7f274c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:23.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f274b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f274c06c2f0 0x7f274c06c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39048/0 (socket says 172.21.15.80:39048) 2019-11-28T11:41:23.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f274b59e700 1 -- 172.21.15.80:0/4108005505 learned_addr learned my addr 172.21.15.80:0/4108005505 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:23.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f274a59c700 1 --2- 172.21.15.80:0/4108005505 >> v2:172.21.15.174:3300/0 conn(0x7f274c15f100 0x7f274c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:23.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f274b59e700 1 -- 172.21.15.80:0/4108005505 >> v2:172.21.15.174:3300/0 conn(0x7f274c15f100 msgr2=0x7f274c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:23.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f274b59e700 1 --2- 172.21.15.80:0/4108005505 >> v2:172.21.15.174:3300/0 conn(0x7f274c15f100 0x7f274c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:23.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f274b59e700 1 -- 172.21.15.80:0/4108005505 >> v1:172.21.15.174:6789/0 conn(0x7f274c15ed10 legacy=0x7f274c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:23.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f274b59e700 1 -- 172.21.15.80:0/4108005505 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c070760 con 0x7f274c06c2f0 2019-11-28T11:41:23.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f274a59c700 1 --2- 172.21.15.80:0/4108005505 >> v2:172.21.15.174:3300/0 conn(0x7f274c15f100 0x7f274c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:41:23.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f274b59e700 1 --2- 172.21.15.80:0/4108005505 >> v2:172.21.15.80:3300/0 conn(0x7f274c06c2f0 0x7f274c06c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f274400f730 tx=0x7f274400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f274b59e700 1 --2- 172.21.15.80:0/4108005505 >> v2:172.21.15.80:3300/0 conn(0x7f274c06c2f0 0x7f274c06c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f274400f730 tx=0x7f274400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f274b59e700 1 --2- 172.21.15.80:0/4108005505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c06c2f0 0x7f274c06c770 secure :-1 s=READY pgs=1510 cs=0 l=1 rx=0x7f274400f730 tx=0x7f274400fad0).ready entity=mon.0 client_cookie=d96e86de68fa4756 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:23.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f274b59e700 1 --2- 172.21.15.80:0/4108005505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c06c2f0 0x7f274c06c770 secure :-1 s=THROTTLE_DONE pgs=1510 cs=0 l=1 rx=0x7f274400f730 tx=0x7f274400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f274b59e700 1 --2- 172.21.15.80:0/4108005505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c06c2f0 0x7f274c06c770 secure :-1 s=THROTTLE_DONE pgs=1510 cs=0 l=1 rx=0x7f274400f730 tx=0x7f274400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f274b59e700 1 --2- 172.21.15.80:0/4108005505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c06c2f0 0x7f274c06c770 secure :-1 s=THROTTLE_DONE pgs=1510 cs=0 l=1 rx=0x7f274400f730 tx=0x7f274400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f2749d9b700 1 -- 172.21.15.80:0/4108005505 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2744000b90 con 0x7f274c06c2f0 2019-11-28T11:41:23.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f2749d9b700 1 -- 172.21.15.80:0/4108005505 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27440010e0 con 0x7f274c06c2f0 2019-11-28T11:41:23.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.426+0000 7f2749d9b700 1 -- 172.21.15.80:0/4108005505 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2744001830 con 0x7f274c06c2f0 2019-11-28T11:41:23.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.427+0000 7f275081f700 1 -- 172.21.15.80:0/4108005505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c06c2f0 msgr2=0x7f274c06c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:23.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.427+0000 7f275081f700 1 --2- 172.21.15.80:0/4108005505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c06c2f0 0x7f274c06c770 secure :-1 s=READY pgs=1510 cs=0 l=1 rx=0x7f274400f730 tx=0x7f274400fad0).stop 2019-11-28T11:41:23.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.427+0000 7f275081f700 1 -- 172.21.15.80:0/4108005505 shutdown_connections 2019-11-28T11:41:23.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.427+0000 7f275081f700 1 --2- 172.21.15.80:0/4108005505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c06c2f0 0x7f274c06c770 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:23.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.427+0000 7f275081f700 1 --2- 172.21.15.80:0/4108005505 >> v2:172.21.15.174:3300/0 conn(0x7f274c15f100 0x7f274c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:23.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.427+0000 7f275081f700 1 -- 172.21.15.80:0/4108005505 shutdown_connections 2019-11-28T11:41:23.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.427+0000 7f275081f700 1 -- 172.21.15.80:0/4108005505 wait complete. 2019-11-28T11:41:23.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.427+0000 7f275081f700 1 -- 172.21.15.80:0/4108005505 >> 172.21.15.80:0/4108005505 conn(0x7f274c061d20 msgr2=0x7f274c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.430+0000 7f275081f700 1 Processor -- start 2019-11-28T11:41:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.430+0000 7f275081f700 1 -- start start 2019-11-28T11:41:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f275081f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f274c15f800 0x7f274c156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f275081f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f274c1566b0 0x7f274c155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f275081f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c15cb50 con 0x7f274c1555a0 2019-11-28T11:41:23.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f275081f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274c102e00 con 0x7f274c15f800 2019-11-28T11:41:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f275081f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c1030d0 con 0x7f274c1566b0 2019-11-28T11:41:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f274ad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f274c15f800 0x7f274c156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f274b59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f274c1555a0 0x7f274c110bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38370/0 (socket says 172.21.15.80:38370) 2019-11-28T11:41:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f274ad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f274c15f800 0x7f274c156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39050/0 (socket says 172.21.15.80:39050) 2019-11-28T11:41:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f274b59e700 1 -- 172.21.15.80:0/4118184769 learned_addr learned my addr 172.21.15.80:0/4118184769 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:23.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f274a59c700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f274c1566b0 0x7f274c155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:23.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f274ad9d700 1 -- 172.21.15.80:0/4118184769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f274c1566b0 msgr2=0x7f274c155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:23.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f274ad9d700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f274c1566b0 0x7f274c155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:23.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f274ad9d700 1 -- 172.21.15.80:0/4118184769 >> v1:172.21.15.80:6789/0 conn(0x7f274c1555a0 legacy=0x7f274c110bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:23.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f274ad9d700 1 -- 172.21.15.80:0/4118184769 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c103760 con 0x7f274c15f800 2019-11-28T11:41:23.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f27437fe700 1 -- 172.21.15.80:0/4118184769 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122850315 0 0) 0x7f2744007580 con 0x7f274c1555a0 2019-11-28T11:41:23.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f274a59c700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f274c1566b0 0x7f274c155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:41:23.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f274ad9d700 1 --2- 172.21.15.80:0/4118184769 >> v2:172.21.15.80:3300/0 conn(0x7f274c15f800 0x7f274c156170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f273c0103a0 tx=0x7f273c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f274ad9d700 1 --2- 172.21.15.80:0/4118184769 >> v2:172.21.15.80:3300/0 conn(0x7f274c15f800 0x7f274c156170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f273c0103a0 tx=0x7f273c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f274ad9d700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c15f800 0x7f274c156170 secure :-1 s=READY pgs=1512 cs=0 l=1 rx=0x7f273c0103a0 tx=0x7f273c010740).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:23.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f274ad9d700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c15f800 0x7f274c156170 secure :-1 s=THROTTLE_DONE pgs=1512 cs=0 l=1 rx=0x7f273c0103a0 tx=0x7f273c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f27437fe700 1 -- 172.21.15.80:0/4118184769 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f273c000960 con 0x7f274c15f800 2019-11-28T11:41:23.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f274ad9d700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c15f800 0x7f274c156170 secure :-1 s=THROTTLE_DONE pgs=1512 cs=0 l=1 rx=0x7f273c0103a0 tx=0x7f273c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f274ad9d700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c15f800 0x7f274c156170 secure :-1 s=THROTTLE_DONE pgs=1512 cs=0 l=1 rx=0x7f273c0103a0 tx=0x7f273c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f27437fe700 1 -- 172.21.15.80:0/4118184769 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c009980 con 0x7f274c15f800 2019-11-28T11:41:23.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f275081f700 1 -- 172.21.15.80:0/4118184769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274c103ae0 con 0x7f274c15f800 2019-11-28T11:41:23.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f27437fe700 1 -- 172.21.15.80:0/4118184769 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f273c009b70 con 0x7f274c15f800 2019-11-28T11:41:23.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.431+0000 7f275081f700 1 -- 172.21.15.80:0/4118184769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c104bc0 con 0x7f274c15f800 2019-11-28T11:41:23.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.432+0000 7f274ad9d700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c15f800 0x7f274c156170 secure :-1 s=THROTTLE_DONE pgs=1512 cs=0 l=1 rx=0x7f273c0103a0 tx=0x7f273c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.432+0000 7f27437fe700 1 -- 172.21.15.80:0/4118184769 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f273c009580 con 0x7f274c15f800 2019-11-28T11:41:23.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.432+0000 7f274ad9d700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c15f800 0x7f274c156170 secure :-1 s=THROTTLE_DONE pgs=1512 cs=0 l=1 rx=0x7f273c0103a0 tx=0x7f273c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.432+0000 7f27437fe700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2724018730 0x7f272401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:23.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.432+0000 7f27437fe700 1 -- 172.21.15.80:0/4118184769 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f273c031a00 con 0x7f274c15f800 2019-11-28T11:41:23.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.432+0000 7f274a59c700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2724018730 0x7f272401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:23.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.433+0000 7f274a59c700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2724018730 0x7f272401abc0 crc :-1 s=READY pgs=616 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:23.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.440+0000 7f275081f700 1 -- 172.21.15.80:0/4118184769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274c103760 con 0x7f274c15f800 2019-11-28T11:41:23.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.443+0000 7f274ad9d700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c15f800 0x7f274c156170 secure :-1 s=THROTTLE_DONE pgs=1512 cs=0 l=1 rx=0x7f273c0103a0 tx=0x7f273c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.443+0000 7f27437fe700 1 -- 172.21.15.80:0/4118184769 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f273c000940 con 0x7f274c15f800 2019-11-28T11:41:23.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.610+0000 7f275081f700 1 -- 172.21.15.80:0/4118184769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f274c103ae0 con 0x7f274c15f800 2019-11-28T11:41:23.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.949+0000 7f274ad9d700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c15f800 0x7f274c156170 secure :-1 s=THROTTLE_DONE pgs=1512 cs=0 l=1 rx=0x7f273c0103a0 tx=0x7f273c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:23.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.949+0000 7f27437fe700 1 -- 172.21.15.80:0/4118184769 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v114) v1 ==== 133+0+0 (secure 0 0 0) 0x7f273c009580 con 0x7f274c15f800 2019-11-28T11:41:24.007 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:41:24.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.977+0000 7f275081f700 1 -- 172.21.15.80:0/4118184769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2724018730 msgr2=0x7f272401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.977+0000 7f275081f700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2724018730 0x7f272401abc0 crc :-1 s=READY pgs=616 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.977+0000 7f275081f700 1 -- 172.21.15.80:0/4118184769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c15f800 msgr2=0x7f274c156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.977+0000 7f275081f700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c15f800 0x7f274c156170 secure :-1 s=READY pgs=1512 cs=0 l=1 rx=0x7f273c0103a0 tx=0x7f273c010740).stop 2019-11-28T11:41:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.977+0000 7f275081f700 1 -- 172.21.15.80:0/4118184769 shutdown_connections 2019-11-28T11:41:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.977+0000 7f275081f700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2724018730 0x7f272401abc0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.977+0000 7f275081f700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f274c1566b0 0x7f274c155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:24.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.977+0000 7f275081f700 1 --2- 172.21.15.80:0/4118184769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274c15f800 0x7f274c156170 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.977+0000 7f275081f700 1 -- 172.21.15.80:0/4118184769 shutdown_connections 2019-11-28T11:41:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.977+0000 7f275081f700 1 -- 172.21.15.80:0/4118184769 wait complete. 2019-11-28T11:41:24.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:23.977+0000 7f275081f700 1 -- 172.21.15.80:0/4118184769 >> 172.21.15.80:0/4118184769 conn(0x7f274c07c4f0 msgr2=0x7f274c15ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:24.020 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:41:24.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.116+0000 7f0a56b69700 1 Processor -- start 2019-11-28T11:41:24.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.116+0000 7f0a56b69700 1 -- start start 2019-11-28T11:41:24.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.116+0000 7f0a56b69700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0a5015ed10 0x7f0a5015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:24.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.116+0000 7f0a56b69700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0a500734b0 0x7f0a500726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:24.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.116+0000 7f0a56b69700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5006db60 con 0x7f0a50073020 2019-11-28T11:41:24.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.116+0000 7f0a56b69700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a5006fe00 con 0x7f0a500734b0 2019-11-28T11:41:24.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.116+0000 7f0a56b69700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a500700d0 con 0x7f0a5015ed10 2019-11-28T11:41:24.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a55907700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0a500734b0 0x7f0a500726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:24.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a54905700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0a50073020 0x7f0a50071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38374/0 (socket says 172.21.15.80:38374) 2019-11-28T11:41:24.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a54905700 1 -- 172.21.15.80:0/2569966114 learned_addr learned my addr 172.21.15.80:0/2569966114 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:24.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a55106700 1 --2- 172.21.15.80:0/2569966114 >> v2:172.21.15.174:3300/0 conn(0x7f0a5015ed10 0x7f0a5015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:24.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a55907700 1 -- 172.21.15.80:0/2569966114 >> v2:172.21.15.174:3300/0 conn(0x7f0a5015ed10 msgr2=0x7f0a5015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:24.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a55907700 1 --2- 172.21.15.80:0/2569966114 >> v2:172.21.15.174:3300/0 conn(0x7f0a5015ed10 0x7f0a5015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:24.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a55907700 1 -- 172.21.15.80:0/2569966114 >> v1:172.21.15.80:6789/0 conn(0x7f0a50073020 legacy=0x7f0a50071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:24.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a4ffff700 1 -- 172.21.15.80:0/2569966114 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895808371 0 0) 0x7f0a44001150 con 0x7f0a50073020 2019-11-28T11:41:24.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a55907700 1 -- 172.21.15.80:0/2569966114 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a50070760 con 0x7f0a500734b0 2019-11-28T11:41:24.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a55106700 1 --2- 172.21.15.80:0/2569966114 >> v2:172.21.15.174:3300/0 conn(0x7f0a5015ed10 0x7f0a5015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:41:24.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a55907700 1 --2- 172.21.15.80:0/2569966114 >> v2:172.21.15.80:3300/0 conn(0x7f0a500734b0 0x7f0a500726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0a4800af50 tx=0x7f0a4800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:24.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a55907700 1 --2- 172.21.15.80:0/2569966114 >> v2:172.21.15.80:3300/0 conn(0x7f0a500734b0 0x7f0a500726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0a4800af50 tx=0x7f0a4800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:24.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a55907700 1 --2- 172.21.15.80:0/2569966114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a500734b0 0x7f0a500726a0 secure :-1 s=READY pgs=1514 cs=0 l=1 rx=0x7f0a4800af50 tx=0x7f0a4800b760).ready entity=mon.0 client_cookie=c03109c0a62ef11 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:24.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a55907700 1 --2- 172.21.15.80:0/2569966114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a500734b0 0x7f0a500726a0 secure :-1 s=THROTTLE_DONE pgs=1514 cs=0 l=1 rx=0x7f0a4800af50 tx=0x7f0a4800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:24.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a4ffff700 1 -- 172.21.15.80:0/2569966114 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a48009ba0 con 0x7f0a500734b0 2019-11-28T11:41:24.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a55907700 1 --2- 172.21.15.80:0/2569966114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a500734b0 0x7f0a500726a0 secure :-1 s=THROTTLE_DONE pgs=1514 cs=0 l=1 rx=0x7f0a4800af50 tx=0x7f0a4800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:24.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a55907700 1 --2- 172.21.15.80:0/2569966114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a500734b0 0x7f0a500726a0 secure :-1 s=THROTTLE_DONE pgs=1514 cs=0 l=1 rx=0x7f0a4800af50 tx=0x7f0a4800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:24.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a4ffff700 1 -- 172.21.15.80:0/2569966114 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a480097c0 con 0x7f0a500734b0 2019-11-28T11:41:24.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a4ffff700 1 -- 172.21.15.80:0/2569966114 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a48000bc0 con 0x7f0a500734b0 2019-11-28T11:41:24.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a56b69700 1 -- 172.21.15.80:0/2569966114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a500734b0 msgr2=0x7f0a500726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:24.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.117+0000 7f0a56b69700 1 --2- 172.21.15.80:0/2569966114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a500734b0 0x7f0a500726a0 secure :-1 s=READY pgs=1514 cs=0 l=1 rx=0x7f0a4800af50 tx=0x7f0a4800b760).stop 2019-11-28T11:41:24.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.118+0000 7f0a56b69700 1 -- 172.21.15.80:0/2569966114 shutdown_connections 2019-11-28T11:41:24.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.118+0000 7f0a56b69700 1 --2- 172.21.15.80:0/2569966114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a500734b0 0x7f0a500726a0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:24.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.118+0000 7f0a56b69700 1 --2- 172.21.15.80:0/2569966114 >> v2:172.21.15.174:3300/0 conn(0x7f0a5015ed10 0x7f0a5015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:24.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.118+0000 7f0a56b69700 1 -- 172.21.15.80:0/2569966114 shutdown_connections 2019-11-28T11:41:24.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.118+0000 7f0a56b69700 1 -- 172.21.15.80:0/2569966114 wait complete. 2019-11-28T11:41:24.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.118+0000 7f0a56b69700 1 -- 172.21.15.80:0/2569966114 >> 172.21.15.80:0/2569966114 conn(0x7f0a50061d20 msgr2=0x7f0a500641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:24.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.120+0000 7f0a56b69700 1 Processor -- start 2019-11-28T11:41:24.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.120+0000 7f0a56b69700 1 -- start start 2019-11-28T11:41:24.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.121+0000 7f0a56b69700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0a5010e970 0x7f0a501087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:24.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.121+0000 7f0a56b69700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0a50108cf0 0x7f0a50107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:24.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.121+0000 7f0a56b69700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5010c250 con 0x7f0a50107b70 2019-11-28T11:41:24.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.121+0000 7f0a56b69700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a5010e430 con 0x7f0a5010e970 2019-11-28T11:41:24.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.121+0000 7f0a56b69700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a50105860 con 0x7f0a50108cf0 2019-11-28T11:41:24.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a55106700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0a5010e970 0x7f0a501087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:24.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a55106700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0a5010e970 0x7f0a501087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39062/0 (socket says 172.21.15.80:39062) 2019-11-28T11:41:24.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a55106700 1 -- 172.21.15.80:0/729986878 learned_addr learned my addr 172.21.15.80:0/729986878 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:24.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a54905700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0a50108cf0 0x7f0a50107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:24.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a55106700 1 -- 172.21.15.80:0/729986878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0a50108cf0 msgr2=0x7f0a50107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:24.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a55106700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0a50108cf0 0x7f0a50107630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:24.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a55106700 1 -- 172.21.15.80:0/729986878 >> v1:172.21.15.80:6789/0 conn(0x7f0a50107b70 legacy=0x7f0a5010ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:24.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a55106700 1 -- 172.21.15.80:0/729986878 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a50105ef0 con 0x7f0a5010e970 2019-11-28T11:41:24.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a54905700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0a50108cf0 0x7f0a50107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:41:24.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a55106700 1 --2- 172.21.15.80:0/729986878 >> v2:172.21.15.80:3300/0 conn(0x7f0a5010e970 0x7f0a501087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0a400107b0 tx=0x7f0a40010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:24.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a55106700 1 --2- 172.21.15.80:0/729986878 >> v2:172.21.15.80:3300/0 conn(0x7f0a5010e970 0x7f0a501087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0a400107b0 tx=0x7f0a40010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:24.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a55106700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a5010e970 0x7f0a501087b0 secure :-1 s=READY pgs=1516 cs=0 l=1 rx=0x7f0a400107b0 tx=0x7f0a40010b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:24.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a55106700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a5010e970 0x7f0a501087b0 secure :-1 s=THROTTLE_DONE pgs=1516 cs=0 l=1 rx=0x7f0a400107b0 tx=0x7f0a40010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:24.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a55106700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a5010e970 0x7f0a501087b0 secure :-1 s=THROTTLE_DONE pgs=1516 cs=0 l=1 rx=0x7f0a400107b0 tx=0x7f0a40010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:24.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a4dffb700 1 -- 172.21.15.80:0/729986878 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a40000f40 con 0x7f0a5010e970 2019-11-28T11:41:24.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a55106700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a5010e970 0x7f0a501087b0 secure :-1 s=THROTTLE_DONE pgs=1516 cs=0 l=1 rx=0x7f0a400107b0 tx=0x7f0a40010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:24.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a4dffb700 1 -- 172.21.15.80:0/729986878 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40009830 con 0x7f0a5010e970 2019-11-28T11:41:24.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a56b69700 1 -- 172.21.15.80:0/729986878 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a50106270 con 0x7f0a5010e970 2019-11-28T11:41:24.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a4dffb700 1 -- 172.21.15.80:0/729986878 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a40001520 con 0x7f0a5010e970 2019-11-28T11:41:24.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.122+0000 7f0a56b69700 1 -- 172.21.15.80:0/729986878 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a50105ef0 con 0x7f0a5010e970 2019-11-28T11:41:24.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.123+0000 7f0a55106700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a5010e970 0x7f0a501087b0 secure :-1 s=THROTTLE_DONE pgs=1516 cs=0 l=1 rx=0x7f0a400107b0 tx=0x7f0a40010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:24.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.123+0000 7f0a4dffb700 1 -- 172.21.15.80:0/729986878 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0a40000f40 con 0x7f0a5010e970 2019-11-28T11:41:24.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.123+0000 7f0a55106700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a5010e970 0x7f0a501087b0 secure :-1 s=THROTTLE_DONE pgs=1516 cs=0 l=1 rx=0x7f0a400107b0 tx=0x7f0a40010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:24.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.123+0000 7f0a4dffb700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0a30018730 0x7f0a3001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:24.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.123+0000 7f0a4dffb700 1 -- 172.21.15.80:0/729986878 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f0a40031de0 con 0x7f0a5010e970 2019-11-28T11:41:24.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.123+0000 7f0a54905700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0a30018730 0x7f0a3001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:24.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.123+0000 7f0a54905700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0a30018730 0x7f0a3001abc0 crc :-1 s=READY pgs=617 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:24.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.132+0000 7f0a56b69700 1 -- 172.21.15.80:0/729986878 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a50106270 con 0x7f0a5010e970 2019-11-28T11:41:24.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.135+0000 7f0a55106700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a5010e970 0x7f0a501087b0 secure :-1 s=THROTTLE_DONE pgs=1516 cs=0 l=1 rx=0x7f0a400107b0 tx=0x7f0a40010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:24.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.135+0000 7f0a4dffb700 1 -- 172.21.15.80:0/729986878 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0a40017820 con 0x7f0a5010e970 2019-11-28T11:41:24.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.304+0000 7f0a56b69700 1 -- 172.21.15.80:0/729986878 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f0a50105ef0 con 0x7f0a5010e970 2019-11-28T11:41:24.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.953+0000 7f0a55106700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a5010e970 0x7f0a501087b0 secure :-1 s=THROTTLE_DONE pgs=1516 cs=0 l=1 rx=0x7f0a400107b0 tx=0x7f0a40010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:24.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.954+0000 7f0a4dffb700 1 -- 172.21.15.80:0/729986878 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v115) v1 ==== 125+0+0 (secure 0 0 0) 0x7f0a40017a30 con 0x7f0a5010e970 2019-11-28T11:41:25.001 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:41:25.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.971+0000 7f0a56b69700 1 -- 172.21.15.80:0/729986878 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0a30018730 msgr2=0x7f0a3001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.971+0000 7f0a56b69700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0a30018730 0x7f0a3001abc0 crc :-1 s=READY pgs=617 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.971+0000 7f0a56b69700 1 -- 172.21.15.80:0/729986878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a5010e970 msgr2=0x7f0a501087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.971+0000 7f0a56b69700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a5010e970 0x7f0a501087b0 secure :-1 s=READY pgs=1516 cs=0 l=1 rx=0x7f0a400107b0 tx=0x7f0a40010b50).stop 2019-11-28T11:41:25.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.971+0000 7f0a56b69700 1 -- 172.21.15.80:0/729986878 shutdown_connections 2019-11-28T11:41:25.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.971+0000 7f0a56b69700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0a30018730 0x7f0a3001abc0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.971+0000 7f0a56b69700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0a50108cf0 0x7f0a50107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.971+0000 7f0a56b69700 1 --2- 172.21.15.80:0/729986878 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a5010e970 0x7f0a501087b0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.971+0000 7f0a56b69700 1 -- 172.21.15.80:0/729986878 shutdown_connections 2019-11-28T11:41:25.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.971+0000 7f0a56b69700 1 -- 172.21.15.80:0/729986878 wait complete. 2019-11-28T11:41:25.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:24.971+0000 7f0a56b69700 1 -- 172.21.15.80:0/729986878 >> 172.21.15.80:0/729986878 conn(0x7f0a5015e2d0 msgr2=0x7f0a50147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:25.014 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:41:25.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.110+0000 7fa8c9333700 1 Processor -- start 2019-11-28T11:41:25.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.110+0000 7fa8c9333700 1 -- start start 2019-11-28T11:41:25.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.111+0000 7fa8c9333700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8c415ed10 0x7fa8c415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:25.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.111+0000 7fa8c9333700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa8c4073020 0x7fa8c4071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:25.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.111+0000 7fa8c9333700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8c40734b0 0x7fa8c40723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:25.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.111+0000 7fa8c9333700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c406f3d0 con 0x7fa8c40734b0 2019-11-28T11:41:25.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.111+0000 7fa8c9333700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c406fe00 con 0x7fa8c4073020 2019-11-28T11:41:25.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.111+0000 7fa8c9333700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c4070760 con 0x7fa8c415ed10 2019-11-28T11:41:25.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.111+0000 7fa8c3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8c40734b0 0x7fa8c40723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.111+0000 7fa8c3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8c40734b0 0x7fa8c40723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39072/0 (socket says 172.21.15.80:39072) 2019-11-28T11:41:25.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.111+0000 7fa8c3fff700 1 -- 172.21.15.80:0/1920025217 learned_addr learned my addr 172.21.15.80:0/1920025217 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:25.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c2ffd700 1 --2- 172.21.15.80:0/1920025217 >> v2:172.21.15.174:3300/0 conn(0x7fa8c4073020 0x7fa8c4071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c37fe700 1 --2- 172.21.15.80:0/1920025217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8c415ed10 0x7fa8c415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c3fff700 1 -- 172.21.15.80:0/1920025217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8c415ed10 msgr2=0x7fa8c415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:25.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c3fff700 1 --2- 172.21.15.80:0/1920025217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8c415ed10 0x7fa8c415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:25.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c3fff700 1 -- 172.21.15.80:0/1920025217 >> v2:172.21.15.174:3300/0 conn(0x7fa8c4073020 msgr2=0x7fa8c4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:25.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c3fff700 1 --2- 172.21.15.80:0/1920025217 >> v2:172.21.15.174:3300/0 conn(0x7fa8c4073020 0x7fa8c4071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:25.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c3fff700 1 -- 172.21.15.80:0/1920025217 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c4070ae0 con 0x7fa8c40734b0 2019-11-28T11:41:25.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c2ffd700 1 --2- 172.21.15.80:0/1920025217 >> v2:172.21.15.174:3300/0 conn(0x7fa8c4073020 0x7fa8c4071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:41:25.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c3fff700 1 --2- 172.21.15.80:0/1920025217 >> v2:172.21.15.80:3300/0 conn(0x7fa8c40734b0 0x7fa8c40723e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa8bc00f6b0 tx=0x7fa8bc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c3fff700 1 --2- 172.21.15.80:0/1920025217 >> v2:172.21.15.80:3300/0 conn(0x7fa8c40734b0 0x7fa8c40723e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa8bc00f6b0 tx=0x7fa8bc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c3fff700 1 --2- 172.21.15.80:0/1920025217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c40734b0 0x7fa8c40723e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rx=0x7fa8bc00f6b0 tx=0x7fa8bc00fa50).ready entity=mon.0 client_cookie=3849590fcdc7aba9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c3fff700 1 --2- 172.21.15.80:0/1920025217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c40734b0 0x7fa8c40723e0 secure :-1 s=THROTTLE_DONE pgs=1517 cs=0 l=1 rx=0x7fa8bc00f6b0 tx=0x7fa8bc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c27fc700 1 -- 172.21.15.80:0/1920025217 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8bc0010e0 con 0x7fa8c40734b0 2019-11-28T11:41:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c3fff700 1 --2- 172.21.15.80:0/1920025217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c40734b0 0x7fa8c40723e0 secure :-1 s=THROTTLE_DONE pgs=1517 cs=0 l=1 rx=0x7fa8bc00f6b0 tx=0x7fa8bc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c3fff700 1 --2- 172.21.15.80:0/1920025217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c40734b0 0x7fa8c40723e0 secure :-1 s=THROTTLE_DONE pgs=1517 cs=0 l=1 rx=0x7fa8bc00f6b0 tx=0x7fa8bc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c27fc700 1 -- 172.21.15.80:0/1920025217 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc000b90 con 0x7fa8c40734b0 2019-11-28T11:41:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c27fc700 1 -- 172.21.15.80:0/1920025217 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8bc0012d0 con 0x7fa8c40734b0 2019-11-28T11:41:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c9333700 1 -- 172.21.15.80:0/1920025217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c40734b0 msgr2=0x7fa8c40723e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.112+0000 7fa8c9333700 1 --2- 172.21.15.80:0/1920025217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c40734b0 0x7fa8c40723e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rx=0x7fa8bc00f6b0 tx=0x7fa8bc00fa50).stop 2019-11-28T11:41:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.113+0000 7fa8c9333700 1 -- 172.21.15.80:0/1920025217 shutdown_connections 2019-11-28T11:41:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.113+0000 7fa8c9333700 1 --2- 172.21.15.80:0/1920025217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c40734b0 0x7fa8c40723e0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.113+0000 7fa8c9333700 1 --2- 172.21.15.80:0/1920025217 >> v2:172.21.15.174:3300/0 conn(0x7fa8c4073020 0x7fa8c4071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.113+0000 7fa8c9333700 1 --2- 172.21.15.80:0/1920025217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8c415ed10 0x7fa8c415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.113+0000 7fa8c9333700 1 -- 172.21.15.80:0/1920025217 shutdown_connections 2019-11-28T11:41:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.113+0000 7fa8c9333700 1 -- 172.21.15.80:0/1920025217 wait complete. 2019-11-28T11:41:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.113+0000 7fa8c9333700 1 -- 172.21.15.80:0/1920025217 >> 172.21.15.80:0/1920025217 conn(0x7fa8c4061d20 msgr2=0x7fa8c40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.115+0000 7fa8c9333700 1 Processor -- start 2019-11-28T11:41:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.115+0000 7fa8c9333700 1 -- start start 2019-11-28T11:41:25.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.116+0000 7fa8c9333700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa8c4148320 0x7fa8c410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.116+0000 7fa8c9333700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8c410f290 0x7fa8c410dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.116+0000 7fa8c9333700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c4148e00 con 0x7fa8c410e110 2019-11-28T11:41:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.116+0000 7fa8c9333700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c413aa20 con 0x7fa8c410f290 2019-11-28T11:41:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.116+0000 7fa8c9333700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c413acf0 con 0x7fa8c4148320 2019-11-28T11:41:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.116+0000 7fa8c2ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8c410f290 0x7fa8c410dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.116+0000 7fa8c2ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8c410f290 0x7fa8c410dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39076/0 (socket says 172.21.15.80:39076) 2019-11-28T11:41:25.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.116+0000 7fa8c2ffd700 1 -- 172.21.15.80:0/2582699012 learned_addr learned my addr 172.21.15.80:0/2582699012 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:25.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.116+0000 7fa8c37fe700 1 --2- 172.21.15.80:0/2582699012 >> v2:172.21.15.174:3300/0 conn(0x7fa8c4148320 0x7fa8c410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.116+0000 7fa8c2ffd700 1 -- 172.21.15.80:0/2582699012 >> v2:172.21.15.174:3300/0 conn(0x7fa8c4148320 msgr2=0x7fa8c410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.116+0000 7fa8c2ffd700 1 --2- 172.21.15.80:0/2582699012 >> v2:172.21.15.174:3300/0 conn(0x7fa8c4148320 0x7fa8c410ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.116+0000 7fa8c2ffd700 1 -- 172.21.15.80:0/2582699012 >> v1:172.21.15.80:6789/0 conn(0x7fa8c410e110 legacy=0x7fa8c41079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.116+0000 7fa8c2ffd700 1 -- 172.21.15.80:0/2582699012 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c410c490 con 0x7fa8c410f290 2019-11-28T11:41:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.116+0000 7fa8bbfff700 1 -- 172.21.15.80:0/2582699012 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490536878 0 0) 0x7fa8bc000b90 con 0x7fa8c410e110 2019-11-28T11:41:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.117+0000 7fa8c2ffd700 1 --2- 172.21.15.80:0/2582699012 >> v2:172.21.15.80:3300/0 conn(0x7fa8c410f290 0x7fa8c410dbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa8ac010460 tx=0x7fa8ac010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.117+0000 7fa8c2ffd700 1 --2- 172.21.15.80:0/2582699012 >> v2:172.21.15.80:3300/0 conn(0x7fa8c410f290 0x7fa8c410dbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa8ac010460 tx=0x7fa8ac010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.117+0000 7fa8c2ffd700 1 --2- 172.21.15.80:0/2582699012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c410f290 0x7fa8c410dbd0 secure :-1 s=READY pgs=1519 cs=0 l=1 rx=0x7fa8ac010460 tx=0x7fa8ac010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:25.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.117+0000 7fa8c2ffd700 1 --2- 172.21.15.80:0/2582699012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c410f290 0x7fa8c410dbd0 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7fa8ac010460 tx=0x7fa8ac010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.117+0000 7fa8bbfff700 1 -- 172.21.15.80:0/2582699012 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8ac000940 con 0x7fa8c410f290 2019-11-28T11:41:25.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.117+0000 7fa8c2ffd700 1 --2- 172.21.15.80:0/2582699012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c410f290 0x7fa8c410dbd0 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7fa8ac010460 tx=0x7fa8ac010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.117+0000 7fa8c9333700 1 -- 172.21.15.80:0/2582699012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c410c810 con 0x7fa8c410f290 2019-11-28T11:41:25.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.117+0000 7fa8bbfff700 1 -- 172.21.15.80:0/2582699012 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac000940 con 0x7fa8c410f290 2019-11-28T11:41:25.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.117+0000 7fa8c2ffd700 1 --2- 172.21.15.80:0/2582699012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c410f290 0x7fa8c410dbd0 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7fa8ac010460 tx=0x7fa8ac010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.117+0000 7fa8bbfff700 1 -- 172.21.15.80:0/2582699012 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8ac001320 con 0x7fa8c410f290 2019-11-28T11:41:25.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.117+0000 7fa8c9333700 1 -- 172.21.15.80:0/2582699012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c410c490 con 0x7fa8c410f290 2019-11-28T11:41:25.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.117+0000 7fa8c2ffd700 1 --2- 172.21.15.80:0/2582699012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c410f290 0x7fa8c410dbd0 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7fa8ac010460 tx=0x7fa8ac010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.117+0000 7fa8bbfff700 1 -- 172.21.15.80:0/2582699012 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa8ac000f40 con 0x7fa8c410f290 2019-11-28T11:41:25.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.117+0000 7fa8c2ffd700 1 --2- 172.21.15.80:0/2582699012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c410f290 0x7fa8c410dbd0 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7fa8ac010460 tx=0x7fa8ac010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.117+0000 7fa8bbfff700 1 --2- 172.21.15.80:0/2582699012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa89c018730 0x7fa89c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:25.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.118+0000 7fa8bbfff700 1 -- 172.21.15.80:0/2582699012 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5904+0+0 (secure 0 0 0) 0x7fa8ac031ab0 con 0x7fa8c410f290 2019-11-28T11:41:25.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.118+0000 7fa8c37fe700 1 --2- 172.21.15.80:0/2582699012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa89c018730 0x7fa89c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.118+0000 7fa8c37fe700 1 --2- 172.21.15.80:0/2582699012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa89c018730 0x7fa89c01abc0 crc :-1 s=READY pgs=618 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:25.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.125+0000 7fa8c9333700 1 -- 172.21.15.80:0/2582699012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c410c810 con 0x7fa8c410f290 2019-11-28T11:41:25.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.129+0000 7fa8c2ffd700 1 --2- 172.21.15.80:0/2582699012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c410f290 0x7fa8c410dbd0 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7fa8ac010460 tx=0x7fa8ac010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.129+0000 7fa8bbfff700 1 -- 172.21.15.80:0/2582699012 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa8ac000c90 con 0x7fa8c410f290 2019-11-28T11:41:25.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.296+0000 7fa8c9333700 1 -- 172.21.15.80:0/2582699012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7fa8c410c490 con 0x7fa8c410f290 2019-11-28T11:41:25.329 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:41:25.296+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:41:25.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.300+0000 7fa8c2ffd700 1 --2- 172.21.15.80:0/2582699012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c410f290 0x7fa8c410dbd0 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7fa8ac010460 tx=0x7fa8ac010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.300+0000 7fa8bbfff700 1 -- 172.21.15.80:0/2582699012 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 18 and data pool 19 v80) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa8ac017410 con 0x7fa8c410f290 2019-11-28T11:41:25.341 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 18 and data pool 19 2019-11-28T11:41:25.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.305+0000 7fa8c9333700 1 -- 172.21.15.80:0/2582699012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa89c018730 msgr2=0x7fa89c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.305+0000 7fa8c9333700 1 --2- 172.21.15.80:0/2582699012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa89c018730 0x7fa89c01abc0 crc :-1 s=READY pgs=618 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.305+0000 7fa8c9333700 1 -- 172.21.15.80:0/2582699012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c410f290 msgr2=0x7fa8c410dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.305+0000 7fa8c9333700 1 --2- 172.21.15.80:0/2582699012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c410f290 0x7fa8c410dbd0 secure :-1 s=READY pgs=1519 cs=0 l=1 rx=0x7fa8ac010460 tx=0x7fa8ac010290).stop 2019-11-28T11:41:25.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.305+0000 7fa8c9333700 1 -- 172.21.15.80:0/2582699012 shutdown_connections 2019-11-28T11:41:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.305+0000 7fa8c9333700 1 --2- 172.21.15.80:0/2582699012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa89c018730 0x7fa89c01abc0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.306+0000 7fa8c9333700 1 --2- 172.21.15.80:0/2582699012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8c410f290 0x7fa8c410dbd0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.306+0000 7fa8c9333700 1 --2- 172.21.15.80:0/2582699012 >> v2:172.21.15.174:3300/0 conn(0x7fa8c4148320 0x7fa8c410ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.306+0000 7fa8c9333700 1 -- 172.21.15.80:0/2582699012 shutdown_connections 2019-11-28T11:41:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.306+0000 7fa8c9333700 1 -- 172.21.15.80:0/2582699012 wait complete. 2019-11-28T11:41:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.306+0000 7fa8c9333700 1 -- 172.21.15.80:0/2582699012 >> 172.21.15.80:0/2582699012 conn(0x7fa8c415e2d0 msgr2=0x7fa8c4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:25.348 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:41:25.368 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:41:25.377 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:41:25.381 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:41:25.386 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:41:25.396 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:41:25.400 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:41:25.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.437+0000 7fd7c6059700 1 Processor -- start 2019-11-28T11:41:25.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.437+0000 7fd7c6059700 1 -- start start 2019-11-28T11:41:25.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.438+0000 7fd7c6059700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd7c006c0a0 0x7fd7c0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:25.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.438+0000 7fd7c6059700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd7c00734e0 0x7fd7c0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:25.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.438+0000 7fd7c6059700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c006db00 con 0x7fd7c0072360 2019-11-28T11:41:25.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.438+0000 7fd7c6059700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c006fd60 con 0x7fd7c00734e0 2019-11-28T11:41:25.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.438+0000 7fd7c6059700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c0070030 con 0x7fd7c006c0a0 2019-11-28T11:41:25.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.438+0000 7fd7b7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd7c00734e0 0x7fd7c0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.438+0000 7fd7c4df7700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd7c0072360 0x7fd7c006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38402/0 (socket says 172.21.15.80:38402) 2019-11-28T11:41:25.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.438+0000 7fd7c4df7700 1 -- 172.21.15.80:0/3720667511 learned_addr learned my addr 172.21.15.80:0/3720667511 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:25.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7bffff700 1 --2- 172.21.15.80:0/3720667511 >> v2:172.21.15.174:3300/0 conn(0x7fd7c006c0a0 0x7fd7c0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7b7fff700 1 -- 172.21.15.80:0/3720667511 >> v2:172.21.15.174:3300/0 conn(0x7fd7c006c0a0 msgr2=0x7fd7c0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:25.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7b7fff700 1 --2- 172.21.15.80:0/3720667511 >> v2:172.21.15.174:3300/0 conn(0x7fd7c006c0a0 0x7fd7c0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:25.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7b7fff700 1 -- 172.21.15.80:0/3720667511 >> v1:172.21.15.80:6789/0 conn(0x7fd7c0072360 legacy=0x7fd7c006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7bf7fe700 1 -- 172.21.15.80:0/3720667511 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454231911 0 0) 0x7fd7b80014d0 con 0x7fd7c0072360 2019-11-28T11:41:25.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7b7fff700 1 -- 172.21.15.80:0/3720667511 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c00706c0 con 0x7fd7c00734e0 2019-11-28T11:41:25.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7bffff700 1 --2- 172.21.15.80:0/3720667511 >> v2:172.21.15.174:3300/0 conn(0x7fd7c006c0a0 0x7fd7c0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:41:25.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7b7fff700 1 --2- 172.21.15.80:0/3720667511 >> v2:172.21.15.80:3300/0 conn(0x7fd7c00734e0 0x7fd7c0071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd7a800af50 tx=0x7fd7a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7b7fff700 1 --2- 172.21.15.80:0/3720667511 >> v2:172.21.15.80:3300/0 conn(0x7fd7c00734e0 0x7fd7c0071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd7a800af50 tx=0x7fd7a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7b7fff700 1 --2- 172.21.15.80:0/3720667511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7c00734e0 0x7fd7c0071e20 secure :-1 s=READY pgs=1521 cs=0 l=1 rx=0x7fd7a800af50 tx=0x7fd7a800b760).ready entity=mon.0 client_cookie=477ebd9a85aa2e18 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:25.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7b7fff700 1 --2- 172.21.15.80:0/3720667511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7c00734e0 0x7fd7c0071e20 secure :-1 s=THROTTLE_DONE pgs=1521 cs=0 l=1 rx=0x7fd7a800af50 tx=0x7fd7a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7bf7fe700 1 -- 172.21.15.80:0/3720667511 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7a8007210 con 0x7fd7c00734e0 2019-11-28T11:41:25.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7b7fff700 1 --2- 172.21.15.80:0/3720667511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7c00734e0 0x7fd7c0071e20 secure :-1 s=THROTTLE_DONE pgs=1521 cs=0 l=1 rx=0x7fd7a800af50 tx=0x7fd7a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7b7fff700 1 --2- 172.21.15.80:0/3720667511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7c00734e0 0x7fd7c0071e20 secure :-1 s=THROTTLE_DONE pgs=1521 cs=0 l=1 rx=0x7fd7a800af50 tx=0x7fd7a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7bf7fe700 1 -- 172.21.15.80:0/3720667511 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a80099b0 con 0x7fd7c00734e0 2019-11-28T11:41:25.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7bf7fe700 1 -- 172.21.15.80:0/3720667511 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7a800a080 con 0x7fd7c00734e0 2019-11-28T11:41:25.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7c6059700 1 -- 172.21.15.80:0/3720667511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7c00734e0 msgr2=0x7fd7c0071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.439+0000 7fd7c6059700 1 --2- 172.21.15.80:0/3720667511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7c00734e0 0x7fd7c0071e20 secure :-1 s=READY pgs=1521 cs=0 l=1 rx=0x7fd7a800af50 tx=0x7fd7a800b760).stop 2019-11-28T11:41:25.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.440+0000 7fd7c6059700 1 -- 172.21.15.80:0/3720667511 shutdown_connections 2019-11-28T11:41:25.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.440+0000 7fd7c6059700 1 --2- 172.21.15.80:0/3720667511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7c00734e0 0x7fd7c0071e20 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.440+0000 7fd7c6059700 1 --2- 172.21.15.80:0/3720667511 >> v2:172.21.15.174:3300/0 conn(0x7fd7c006c0a0 0x7fd7c0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:25.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.440+0000 7fd7c6059700 1 -- 172.21.15.80:0/3720667511 shutdown_connections 2019-11-28T11:41:25.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.440+0000 7fd7c6059700 1 -- 172.21.15.80:0/3720667511 wait complete. 2019-11-28T11:41:25.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.440+0000 7fd7c6059700 1 -- 172.21.15.80:0/3720667511 >> 172.21.15.80:0/3720667511 conn(0x7fd7c0061cf0 msgr2=0x7fd7c0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:25.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.443+0000 7fd7c6059700 1 Processor -- start 2019-11-28T11:41:25.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.443+0000 7fd7c6059700 1 -- start start 2019-11-28T11:41:25.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.443+0000 7fd7c6059700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7c00741a0 0x7fd7c0117630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:25.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.443+0000 7fd7c6059700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd7c0116cb0 0x7fd7c012cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:25.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.443+0000 7fd7c6059700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c011a2b0 con 0x7fd7c0117b70 2019-11-28T11:41:25.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.443+0000 7fd7c6059700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c0076410 con 0x7fd7c0116cb0 2019-11-28T11:41:25.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.443+0000 7fd7c6059700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c0076e40 con 0x7fd7c00741a0 2019-11-28T11:41:25.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7b7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd7c0117b70 0x7fd7c01164b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38406/0 (socket says 172.21.15.80:38406) 2019-11-28T11:41:25.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7b7fff700 1 -- 172.21.15.80:0/3082307074 learned_addr learned my addr 172.21.15.80:0/3082307074 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:25.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380061257 0 0) 0x7fd7a800abb0 con 0x7fd7c0117b70 2019-11-28T11:41:25.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7a4002e80 con 0x7fd7c0117b70 2019-11-28T11:41:25.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7c4df7700 1 --2- 172.21.15.80:0/3082307074 >> v2:172.21.15.174:3300/0 conn(0x7fd7c0116cb0 0x7fd7c012cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bffff700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7c00741a0 0x7fd7c0117630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2395112716 0 0) 0x7fd7a8000940 con 0x7fd7c0117b70 2019-11-28T11:41:25.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd7a40032e0 con 0x7fd7c0117b70 2019-11-28T11:41:25.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd7a800b3f0 con 0x7fd7c0117b70 2019-11-28T11:41:25.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7c00741a0 msgr2=0x7fd7c0117630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bd7fa700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7c00741a0 0x7fd7c0117630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 >> v2:172.21.15.174:3300/0 conn(0x7fd7c0116cb0 msgr2=0x7fd7c012cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bd7fa700 1 --2- 172.21.15.80:0/3082307074 >> v2:172.21.15.174:3300/0 conn(0x7fd7c0116cb0 0x7fd7c012cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 >> v1:172.21.15.80:6789/0 conn(0x7fd7c0117b70 legacy=0x7fd7c01164b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bd7fa700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7a4003930 0x7fd7a4005d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:25.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bd7fa700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7a4006270 0x7fd7a40086b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:25.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bd7fa700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a4008eb0 0x7fd7a400b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:25.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a400bb90 con 0x7fd7a4008eb0 2019-11-28T11:41:25.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a400bdc0 con 0x7fd7a4003930 2019-11-28T11:41:25.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a400bff0 con 0x7fd7a4006270 2019-11-28T11:41:25.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7bffff700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7a4003930 0x7fd7a4005d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7c4df7700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a4008eb0 0x7fd7a400b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.444+0000 7fd7b7fff700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7a4006270 0x7fd7a40086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7c4df7700 1 -- 172.21.15.80:0/3082307074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7a4006270 msgr2=0x7fd7a40086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7c4df7700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7a4006270 0x7fd7a40086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7c4df7700 1 -- 172.21.15.80:0/3082307074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7a4003930 msgr2=0x7fd7a4005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7c4df7700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7a4003930 0x7fd7a4005d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7c4df7700 1 -- 172.21.15.80:0/3082307074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a400c2a0 con 0x7fd7a4008eb0 2019-11-28T11:41:25.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7c6059700 1 -- 172.21.15.80:0/3082307074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c0077b20 con 0x7fd7a4008eb0 2019-11-28T11:41:25.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7c4df7700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a4008eb0 0x7fd7a400b380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd7b8012b10 tx=0x7fd7b8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7c6059700 1 -- 172.21.15.80:0/3082307074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c00777a0 con 0x7fd7a4008eb0 2019-11-28T11:41:25.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7c4df7700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a4008eb0 0x7fd7a400b380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd7b8012b10 tx=0x7fd7b8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7c4df7700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a4008eb0 0x7fd7a400b380 secure :-1 s=READY pgs=1523 cs=0 l=1 rx=0x7fd7b8012b10 tx=0x7fd7b8010880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:25.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7c4df7700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a4008eb0 0x7fd7a400b380 secure :-1 s=THROTTLE_DONE pgs=1523 cs=0 l=1 rx=0x7fd7b8012b10 tx=0x7fd7b8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7c4df7700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a4008eb0 0x7fd7a400b380 secure :-1 s=THROTTLE_DONE pgs=1523 cs=0 l=1 rx=0x7fd7b8012b10 tx=0x7fd7b8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7c4df7700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a4008eb0 0x7fd7a400b380 secure :-1 s=THROTTLE_DONE pgs=1523 cs=0 l=1 rx=0x7fd7b8012b10 tx=0x7fd7b8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7b800ac20 con 0x7fd7a4008eb0 2019-11-28T11:41:25.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b8001670 con 0x7fd7a4008eb0 2019-11-28T11:41:25.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7b8001d00 con 0x7fd7a4008eb0 2019-11-28T11:41:25.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7c4df7700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a4008eb0 0x7fd7a400b380 secure :-1 s=THROTTLE_DONE pgs=1523 cs=0 l=1 rx=0x7fd7b8012b10 tx=0x7fd7b8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd7b8001860 con 0x7fd7a4008eb0 2019-11-28T11:41:25.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7c4df7700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a4008eb0 0x7fd7a400b380 secure :-1 s=THROTTLE_DONE pgs=1523 cs=0 l=1 rx=0x7fd7b8012b10 tx=0x7fd7b8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7bd7fa700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd7a4020ac0 0x7fd7a4022ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:25.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.445+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd7b8034400 con 0x7fd7a4008eb0 2019-11-28T11:41:25.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.446+0000 7fd7bffff700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd7a4020ac0 0x7fd7a4022ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.446+0000 7fd7bffff700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd7a4020ac0 0x7fd7a4022ef0 crc :-1 s=READY pgs=619 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:25.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.452+0000 7fd7c6059700 1 -- 172.21.15.80:0/3082307074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd798002e60 con 0x7fd7a4008eb0 2019-11-28T11:41:25.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.456+0000 7fd7c4df7700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a4008eb0 0x7fd7a400b380 secure :-1 s=THROTTLE_DONE pgs=1523 cs=0 l=1 rx=0x7fd7b8012b10 tx=0x7fd7b8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.456+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd7b8001270 con 0x7fd7a4008eb0 2019-11-28T11:41:25.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.631+0000 7fd7c6059700 1 -- 172.21.15.80:0/3082307074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd798001d10 con 0x7fd7a4008eb0 2019-11-28T11:41:25.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.632+0000 7fd7c4df7700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a4008eb0 0x7fd7a400b380 secure :-1 s=THROTTLE_DONE pgs=1523 cs=0 l=1 rx=0x7fd7b8012b10 tx=0x7fd7b8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.632+0000 7fd7bd7fa700 1 -- 172.21.15.80:0/3082307074 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+14884 (secure 0 0 0) 0x7fd7b8001670 con 0x7fd7a4008eb0 2019-11-28T11:41:25.665 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:25.665 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":116,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:41:25.297004+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:41:23.623555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2019-11-28T11:41:24.315901+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:41:25.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.634+0000 7fd7c6059700 1 -- 172.21.15.80:0/3082307074 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd7a4020ac0 msgr2=0x7fd7a4022ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.634+0000 7fd7c6059700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd7a4020ac0 0x7fd7a4022ef0 crc :-1 s=READY pgs=619 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.634+0000 7fd7c6059700 1 -- 172.21.15.80:0/3082307074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a4008eb0 msgr2=0x7fd7a400b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.634+0000 7fd7c6059700 1 --2- 172.21.15.80:0/3082307074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7a4008eb0 0x7fd7a400b380 secure :-1 s=READY pgs=1523 cs=0 l=1 rx=0x7fd7b8012b10 tx=0x7fd7b8010880).stop 2019-11-28T11:41:25.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.634+0000 7fd7c4df7700 1 -- 172.21.15.80:0/3082307074 reap_dead start 2019-11-28T11:41:25.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.634+0000 7fd7c4df7700 1 -- 172.21.15.80:0/3082307074 reap_dead start 2019-11-28T11:41:25.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.634+0000 7fd7c6059700 1 -- 172.21.15.80:0/3082307074 shutdown_connections 2019-11-28T11:41:25.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.634+0000 7fd7c6059700 1 -- 172.21.15.80:0/3082307074 shutdown_connections 2019-11-28T11:41:25.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.634+0000 7fd7c6059700 1 -- 172.21.15.80:0/3082307074 wait complete. 2019-11-28T11:41:25.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.634+0000 7fd7c6059700 1 -- 172.21.15.80:0/3082307074 >> 172.21.15.80:0/3082307074 conn(0x7fd7c013d930 msgr2=0x7fd7c007b940 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:25.680 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:41:25.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.808+0000 7fcb47c53700 1 Processor -- start 2019-11-28T11:41:25.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.808+0000 7fcb47c53700 1 -- start start 2019-11-28T11:41:25.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.809+0000 7fcb47c53700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcb4006d120 0x7fcb40165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:25.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.809+0000 7fcb47c53700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4006d5a0 con 0x7fcb4006c490 2019-11-28T11:41:25.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.809+0000 7fcb47c53700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4006db00 con 0x7fcb4006c0a0 2019-11-28T11:41:25.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.809+0000 7fcb47c53700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4006fd60 con 0x7fcb4006d120 2019-11-28T11:41:25.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.809+0000 7fcb469f1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcb4006d120 0x7fcb40165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.809+0000 7fcb459ef700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcb4006c490 0x7fcb4006c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38422/0 (socket says 172.21.15.80:38422) 2019-11-28T11:41:25.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.809+0000 7fcb459ef700 1 -- 172.21.15.80:0/1882482480 learned_addr learned my addr 172.21.15.80:0/1882482480 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:25.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.809+0000 7fcb469f1700 1 -- 172.21.15.80:0/1882482480 >> v1:172.21.15.174:6789/0 conn(0x7fcb4006c0a0 legacy=0x7fcb40072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:25.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.809+0000 7fcb469f1700 1 -- 172.21.15.80:0/1882482480 >> v1:172.21.15.80:6789/0 conn(0x7fcb4006c490 legacy=0x7fcb4006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.809+0000 7fcb469f1700 1 -- 172.21.15.80:0/1882482480 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb400706c0 con 0x7fcb4006d120 2019-11-28T11:41:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.809+0000 7fcb451ee700 1 -- 172.21.15.80:0/1882482480 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181788612 0 0) 0x7fcb34001150 con 0x7fcb4006c490 2019-11-28T11:41:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.810+0000 7fcb469f1700 1 --2- 172.21.15.80:0/1882482480 >> v2:172.21.15.80:3300/0 conn(0x7fcb4006d120 0x7fcb40165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcb3800af50 tx=0x7fcb3800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.810+0000 7fcb469f1700 1 --2- 172.21.15.80:0/1882482480 >> v2:172.21.15.80:3300/0 conn(0x7fcb4006d120 0x7fcb40165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcb3800af50 tx=0x7fcb3800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.810+0000 7fcb469f1700 1 --2- 172.21.15.80:0/1882482480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4006d120 0x7fcb40165d80 secure :-1 s=READY pgs=1525 cs=0 l=1 rx=0x7fcb3800af50 tx=0x7fcb3800b760).ready entity=mon.0 client_cookie=6b2f129d9223b037 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.810+0000 7fcb469f1700 1 --2- 172.21.15.80:0/1882482480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4006d120 0x7fcb40165d80 secure :-1 s=THROTTLE_DONE pgs=1525 cs=0 l=1 rx=0x7fcb3800af50 tx=0x7fcb3800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.810+0000 7fcb451ee700 1 -- 172.21.15.80:0/1882482480 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb38009ba0 con 0x7fcb4006d120 2019-11-28T11:41:25.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.810+0000 7fcb469f1700 1 --2- 172.21.15.80:0/1882482480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4006d120 0x7fcb40165d80 secure :-1 s=THROTTLE_DONE pgs=1525 cs=0 l=1 rx=0x7fcb3800af50 tx=0x7fcb3800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.810+0000 7fcb469f1700 1 --2- 172.21.15.80:0/1882482480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4006d120 0x7fcb40165d80 secure :-1 s=THROTTLE_DONE pgs=1525 cs=0 l=1 rx=0x7fcb3800af50 tx=0x7fcb3800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.810+0000 7fcb451ee700 1 -- 172.21.15.80:0/1882482480 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb38000a70 con 0x7fcb4006d120 2019-11-28T11:41:25.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.810+0000 7fcb451ee700 1 -- 172.21.15.80:0/1882482480 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb3800a180 con 0x7fcb4006d120 2019-11-28T11:41:25.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.810+0000 7fcb47c53700 1 -- 172.21.15.80:0/1882482480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4006d120 msgr2=0x7fcb40165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.810+0000 7fcb47c53700 1 --2- 172.21.15.80:0/1882482480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4006d120 0x7fcb40165d80 secure :-1 s=READY pgs=1525 cs=0 l=1 rx=0x7fcb3800af50 tx=0x7fcb3800b760).stop 2019-11-28T11:41:25.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.811+0000 7fcb47c53700 1 -- 172.21.15.80:0/1882482480 shutdown_connections 2019-11-28T11:41:25.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.811+0000 7fcb47c53700 1 --2- 172.21.15.80:0/1882482480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4006d120 0x7fcb40165d80 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.811+0000 7fcb47c53700 1 -- 172.21.15.80:0/1882482480 shutdown_connections 2019-11-28T11:41:25.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.811+0000 7fcb47c53700 1 -- 172.21.15.80:0/1882482480 wait complete. 2019-11-28T11:41:25.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.811+0000 7fcb47c53700 1 -- 172.21.15.80:0/1882482480 >> 172.21.15.80:0/1882482480 conn(0x7fcb40061cf0 msgr2=0x7fcb40064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:25.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.813+0000 7fcb47c53700 1 Processor -- start 2019-11-28T11:41:25.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.813+0000 7fcb47c53700 1 -- start start 2019-11-28T11:41:25.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.814+0000 7fcb47c53700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcb4013f580 0x7fcb40115730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:25.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.814+0000 7fcb47c53700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb40115c70 0x7fcb40121e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:25.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.814+0000 7fcb47c53700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4013fc50 con 0x7fcb401223a0 2019-11-28T11:41:25.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.814+0000 7fcb47c53700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb40112550 con 0x7fcb4013f580 2019-11-28T11:41:25.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.814+0000 7fcb47c53700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb40112820 con 0x7fcb40115c70 2019-11-28T11:41:25.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.814+0000 7fcb461f0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcb4013f580 0x7fcb40115730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.814+0000 7fcb461f0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcb4013f580 0x7fcb40115730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39108/0 (socket says 172.21.15.80:39108) 2019-11-28T11:41:25.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.814+0000 7fcb461f0700 1 -- 172.21.15.80:0/1116318615 learned_addr learned my addr 172.21.15.80:0/1116318615 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:25.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.814+0000 7fcb469f1700 1 --1- 172.21.15.80:0/1116318615 >> v1:172.21.15.80:6789/0 conn(0x7fcb401223a0 0x7fcb401145b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38426/0 (socket says 172.21.15.80:38426) 2019-11-28T11:41:25.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.814+0000 7fcb459ef700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb40115c70 0x7fcb40121e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.814+0000 7fcb461f0700 1 -- 172.21.15.80:0/1116318615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb40115c70 msgr2=0x7fcb40121e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.814+0000 7fcb461f0700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb40115c70 0x7fcb40121e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:25.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.814+0000 7fcb461f0700 1 -- 172.21.15.80:0/1116318615 >> v1:172.21.15.80:6789/0 conn(0x7fcb401223a0 legacy=0x7fcb401145b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:25.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.815+0000 7fcb461f0700 1 -- 172.21.15.80:0/1116318615 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40112eb0 con 0x7fcb4013f580 2019-11-28T11:41:25.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.814+0000 7fcb3effd700 1 -- 172.21.15.80:0/1116318615 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998021679 0 0) 0x7fcb3800b3d0 con 0x7fcb401223a0 2019-11-28T11:41:25.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.815+0000 7fcb461f0700 1 --2- 172.21.15.80:0/1116318615 >> v2:172.21.15.80:3300/0 conn(0x7fcb4013f580 0x7fcb40115730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcb30010790 tx=0x7fcb30010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.815+0000 7fcb461f0700 1 --2- 172.21.15.80:0/1116318615 >> v2:172.21.15.80:3300/0 conn(0x7fcb4013f580 0x7fcb40115730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcb30010790 tx=0x7fcb30010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.815+0000 7fcb461f0700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4013f580 0x7fcb40115730 secure :-1 s=READY pgs=1527 cs=0 l=1 rx=0x7fcb30010790 tx=0x7fcb30010b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:25.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.815+0000 7fcb461f0700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4013f580 0x7fcb40115730 secure :-1 s=THROTTLE_DONE pgs=1527 cs=0 l=1 rx=0x7fcb30010790 tx=0x7fcb30010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.815+0000 7fcb3effd700 1 -- 172.21.15.80:0/1116318615 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb30001420 con 0x7fcb4013f580 2019-11-28T11:41:25.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.815+0000 7fcb461f0700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4013f580 0x7fcb40115730 secure :-1 s=THROTTLE_DONE pgs=1527 cs=0 l=1 rx=0x7fcb30010790 tx=0x7fcb30010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.815+0000 7fcb461f0700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4013f580 0x7fcb40115730 secure :-1 s=THROTTLE_DONE pgs=1527 cs=0 l=1 rx=0x7fcb30010790 tx=0x7fcb30010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.815+0000 7fcb3effd700 1 -- 172.21.15.80:0/1116318615 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb30000f90 con 0x7fcb4013f580 2019-11-28T11:41:25.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.815+0000 7fcb3effd700 1 -- 172.21.15.80:0/1116318615 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb30001a00 con 0x7fcb4013f580 2019-11-28T11:41:25.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.815+0000 7fcb47c53700 1 -- 172.21.15.80:0/1116318615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb40113230 con 0x7fcb4013f580 2019-11-28T11:41:25.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.815+0000 7fcb47c53700 1 -- 172.21.15.80:0/1116318615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb40112eb0 con 0x7fcb4013f580 2019-11-28T11:41:25.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.815+0000 7fcb461f0700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4013f580 0x7fcb40115730 secure :-1 s=THROTTLE_DONE pgs=1527 cs=0 l=1 rx=0x7fcb30010790 tx=0x7fcb30010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.815+0000 7fcb3effd700 1 -- 172.21.15.80:0/1116318615 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcb30001230 con 0x7fcb4013f580 2019-11-28T11:41:25.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.815+0000 7fcb461f0700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4013f580 0x7fcb40115730 secure :-1 s=THROTTLE_DONE pgs=1527 cs=0 l=1 rx=0x7fcb30010790 tx=0x7fcb30010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.816+0000 7fcb3effd700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb20018730 0x7fcb2001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:25.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.816+0000 7fcb3effd700 1 -- 172.21.15.80:0/1116318615 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fcb30031e70 con 0x7fcb4013f580 2019-11-28T11:41:25.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.816+0000 7fcb459ef700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb20018730 0x7fcb2001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:25.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.816+0000 7fcb459ef700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb20018730 0x7fcb2001abc0 crc :-1 s=READY pgs=620 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:25.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.823+0000 7fcb47c53700 1 -- 172.21.15.80:0/1116318615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb40113230 con 0x7fcb4013f580 2019-11-28T11:41:25.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.827+0000 7fcb461f0700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4013f580 0x7fcb40115730 secure :-1 s=THROTTLE_DONE pgs=1527 cs=0 l=1 rx=0x7fcb30010790 tx=0x7fcb30010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:25.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:25.827+0000 7fcb3effd700 1 -- 172.21.15.80:0/1116318615 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcb30007930 con 0x7fcb4013f580 2019-11-28T11:41:26.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.003+0000 7fcb47c53700 1 -- 172.21.15.80:0/1116318615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb40112eb0 con 0x7fcb4013f580 2019-11-28T11:41:26.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.004+0000 7fcb461f0700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4013f580 0x7fcb40115730 secure :-1 s=THROTTLE_DONE pgs=1527 cs=0 l=1 rx=0x7fcb30010790 tx=0x7fcb30010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:26.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.004+0000 7fcb3effd700 1 -- 172.21.15.80:0/1116318615 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+14884 (secure 0 0 0) 0x7fcb30021480 con 0x7fcb4013f580 2019-11-28T11:41:26.039 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:26.039 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":116,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:41:25.297004+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:41:23.623555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2019-11-28T11:41:24.315901+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:41:26.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.006+0000 7fcb47c53700 1 -- 172.21.15.80:0/1116318615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb20018730 msgr2=0x7fcb2001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:26.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.006+0000 7fcb47c53700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb20018730 0x7fcb2001abc0 crc :-1 s=READY pgs=620 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:26.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.006+0000 7fcb47c53700 1 -- 172.21.15.80:0/1116318615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4013f580 msgr2=0x7fcb40115730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:26.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.006+0000 7fcb47c53700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4013f580 0x7fcb40115730 secure :-1 s=READY pgs=1527 cs=0 l=1 rx=0x7fcb30010790 tx=0x7fcb30010b30).stop 2019-11-28T11:41:26.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.006+0000 7fcb47c53700 1 -- 172.21.15.80:0/1116318615 shutdown_connections 2019-11-28T11:41:26.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.006+0000 7fcb47c53700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb20018730 0x7fcb2001abc0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:26.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.006+0000 7fcb47c53700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb40115c70 0x7fcb40121e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:26.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.006+0000 7fcb47c53700 1 --2- 172.21.15.80:0/1116318615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb4013f580 0x7fcb40115730 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:26.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.006+0000 7fcb47c53700 1 -- 172.21.15.80:0/1116318615 shutdown_connections 2019-11-28T11:41:26.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.006+0000 7fcb47c53700 1 -- 172.21.15.80:0/1116318615 wait complete. 2019-11-28T11:41:26.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.006+0000 7fcb47c53700 1 -- 172.21.15.80:0/1116318615 >> 172.21.15.80:0/1116318615 conn(0x7fcb401426c0 msgr2=0x7fcb40110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:26.050 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:41:26.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.140+0000 7f5a79290700 1 Processor -- start 2019-11-28T11:41:26.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.140+0000 7f5a79290700 1 -- start start 2019-11-28T11:41:26.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.141+0000 7f5a79290700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5a7415f100 0x7f5a7406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:26.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.141+0000 7f5a79290700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7406db60 con 0x7f5a7406c2f0 2019-11-28T11:41:26.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.141+0000 7f5a79290700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7406e060 con 0x7f5a7415ed10 2019-11-28T11:41:26.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.141+0000 7f5a79290700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7406fe00 con 0x7f5a7415f100 2019-11-28T11:41:26.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a73fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5a7406c2f0 0x7f5a7406c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38434/0 (socket says 172.21.15.80:38434) 2019-11-28T11:41:26.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a73fff700 1 -- 172.21.15.80:0/953999873 learned_addr learned my addr 172.21.15.80:0/953999873 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:26.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a72ffd700 1 --2- 172.21.15.80:0/953999873 >> v2:172.21.15.174:3300/0 conn(0x7f5a7415f100 0x7f5a7406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:26.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a727fc700 1 -- 172.21.15.80:0/953999873 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480729921 0 0) 0x7f5a6c0014d0 con 0x7f5a7406c2f0 2019-11-28T11:41:26.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a727fc700 1 -- 172.21.15.80:0/953999873 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a5c002e80 con 0x7f5a7406c2f0 2019-11-28T11:41:26.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a727fc700 1 -- 172.21.15.80:0/953999873 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4235657933 0 0) 0x7f5a6c0014b0 con 0x7f5a7406c2f0 2019-11-28T11:41:26.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a727fc700 1 -- 172.21.15.80:0/953999873 >> v2:172.21.15.174:3300/0 conn(0x7f5a7415f100 msgr2=0x7f5a7406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:26.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a727fc700 1 --2- 172.21.15.80:0/953999873 >> v2:172.21.15.174:3300/0 conn(0x7f5a7415f100 0x7f5a7406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:26.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a727fc700 1 -- 172.21.15.80:0/953999873 >> v1:172.21.15.174:6789/0 conn(0x7f5a7415ed10 legacy=0x7f5a74073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:26.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a727fc700 1 -- 172.21.15.80:0/953999873 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a74070760 con 0x7f5a7406c2f0 2019-11-28T11:41:26.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a727fc700 1 -- 172.21.15.80:0/953999873 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f5a6c0019e0 con 0x7f5a7406c2f0 2019-11-28T11:41:26.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a727fc700 1 -- 172.21.15.80:0/953999873 >> v1:172.21.15.80:6789/0 conn(0x7f5a7406c2f0 legacy=0x7f5a7406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:26.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a727fc700 1 --2- 172.21.15.80:0/953999873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a5c003ab0 0x7f5a5c005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:26.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a727fc700 1 --2- 172.21.15.80:0/953999873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a5c006690 0x7f5a5c008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:26.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a727fc700 1 --2- 172.21.15.80:0/953999873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c009380 0x7f5a5c00b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:26.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a727fc700 1 -- 172.21.15.80:0/953999873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c00c000 con 0x7f5a5c009380 2019-11-28T11:41:26.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a727fc700 1 -- 172.21.15.80:0/953999873 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c050200 con 0x7f5a5c006690 2019-11-28T11:41:26.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a727fc700 1 -- 172.21.15.80:0/953999873 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c050430 con 0x7f5a5c003ab0 2019-11-28T11:41:26.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a73fff700 1 --2- 172.21.15.80:0/953999873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c009380 0x7f5a5c00b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:26.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a72ffd700 1 --2- 172.21.15.80:0/953999873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a5c006690 0x7f5a5c008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:26.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.142+0000 7f5a737fe700 1 --2- 172.21.15.80:0/953999873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a5c003ab0 0x7f5a5c005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:26.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a73fff700 1 -- 172.21.15.80:0/953999873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a5c003ab0 msgr2=0x7f5a5c005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:26.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a73fff700 1 --2- 172.21.15.80:0/953999873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a5c003ab0 0x7f5a5c005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:26.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a73fff700 1 -- 172.21.15.80:0/953999873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a5c006690 msgr2=0x7f5a5c008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:26.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a73fff700 1 --2- 172.21.15.80:0/953999873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a5c006690 0x7f5a5c008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:26.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a73fff700 1 -- 172.21.15.80:0/953999873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c0506e0 con 0x7f5a5c009380 2019-11-28T11:41:26.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a73fff700 1 --2- 172.21.15.80:0/953999873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c009380 0x7f5a5c00b850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a6c00fbe0 tx=0x7f5a6c00fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:26.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a73fff700 1 -- 172.21.15.80:0/953999873 reap_dead start 2019-11-28T11:41:26.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a73fff700 1 --2- 172.21.15.80:0/953999873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c009380 0x7f5a5c00b850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a6c00fbe0 tx=0x7f5a6c00fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:26.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a73fff700 1 --2- 172.21.15.80:0/953999873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c009380 0x7f5a5c00b850 secure :-1 s=READY pgs=1529 cs=0 l=1 rx=0x7f5a6c00fbe0 tx=0x7f5a6c00fb10).ready entity=mon.0 client_cookie=8edb0375de16c030 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:26.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a73fff700 1 --2- 172.21.15.80:0/953999873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c009380 0x7f5a5c00b850 secure :-1 s=THROTTLE_DONE pgs=1529 cs=0 l=1 rx=0x7f5a6c00fbe0 tx=0x7f5a6c00fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:26.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a727fc700 1 -- 172.21.15.80:0/953999873 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a6c0047b0 con 0x7f5a5c009380 2019-11-28T11:41:26.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a73fff700 1 --2- 172.21.15.80:0/953999873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c009380 0x7f5a5c00b850 secure :-1 s=THROTTLE_DONE pgs=1529 cs=0 l=1 rx=0x7f5a6c00fbe0 tx=0x7f5a6c00fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:26.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a73fff700 1 --2- 172.21.15.80:0/953999873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c009380 0x7f5a5c00b850 secure :-1 s=THROTTLE_DONE pgs=1529 cs=0 l=1 rx=0x7f5a6c00fbe0 tx=0x7f5a6c00fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:26.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a727fc700 1 -- 172.21.15.80:0/953999873 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c0019e0 con 0x7f5a5c009380 2019-11-28T11:41:26.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a727fc700 1 -- 172.21.15.80:0/953999873 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a6c004d90 con 0x7f5a5c009380 2019-11-28T11:41:26.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a79290700 1 -- 172.21.15.80:0/953999873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c009380 msgr2=0x7f5a5c00b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:26.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a79290700 1 --2- 172.21.15.80:0/953999873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c009380 0x7f5a5c00b850 secure :-1 s=READY pgs=1529 cs=0 l=1 rx=0x7f5a6c00fbe0 tx=0x7f5a6c00fb10).stop 2019-11-28T11:41:26.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a79290700 1 -- 172.21.15.80:0/953999873 shutdown_connections 2019-11-28T11:41:26.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a79290700 1 --2- 172.21.15.80:0/953999873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c009380 0x7f5a5c00b850 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:26.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.143+0000 7f5a79290700 1 -- 172.21.15.80:0/953999873 shutdown_connections 2019-11-28T11:41:26.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.144+0000 7f5a79290700 1 -- 172.21.15.80:0/953999873 wait complete. 2019-11-28T11:41:26.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.144+0000 7f5a79290700 1 -- 172.21.15.80:0/953999873 >> 172.21.15.80:0/953999873 conn(0x7f5a74061d20 msgr2=0x7f5a740641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:26.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.146+0000 7f5a79290700 1 Processor -- start 2019-11-28T11:41:26.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.146+0000 7f5a79290700 1 -- start start 2019-11-28T11:41:26.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.147+0000 7f5a79290700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5a74108920 0x7f5a74132610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:26.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.147+0000 7f5a79290700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a7414b8e0 0x7f5a7416ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:26.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.147+0000 7f5a79290700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7415ddb0 con 0x7f5a74132b50 2019-11-28T11:41:26.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.147+0000 7f5a79290700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7411ec40 con 0x7f5a7414b8e0 2019-11-28T11:41:26.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.147+0000 7f5a79290700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a741197e0 con 0x7f5a74108920 2019-11-28T11:41:26.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.147+0000 7f5a73fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a7414b8e0 0x7f5a7416ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:26.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.147+0000 7f5a73fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a7414b8e0 0x7f5a7416ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39130/0 (socket says 172.21.15.80:39130) 2019-11-28T11:41:26.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.147+0000 7f5a73fff700 1 -- 172.21.15.80:0/3557479453 learned_addr learned my addr 172.21.15.80:0/3557479453 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:26.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.147+0000 7f5a737fe700 1 --2- 172.21.15.80:0/3557479453 >> v2:172.21.15.174:3300/0 conn(0x7f5a74108920 0x7f5a74132610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:26.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.147+0000 7f5a73fff700 1 -- 172.21.15.80:0/3557479453 >> v2:172.21.15.174:3300/0 conn(0x7f5a74108920 msgr2=0x7f5a74132610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:26.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.147+0000 7f5a73fff700 1 --2- 172.21.15.80:0/3557479453 >> v2:172.21.15.174:3300/0 conn(0x7f5a74108920 0x7f5a74132610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:26.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.147+0000 7f5a73fff700 1 -- 172.21.15.80:0/3557479453 >> v1:172.21.15.174:6789/0 conn(0x7f5a74132b50 legacy=0x7f5a7414b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:26.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.147+0000 7f5a73fff700 1 -- 172.21.15.80:0/3557479453 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a741300d0 con 0x7f5a7414b8e0 2019-11-28T11:41:26.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.147+0000 7f5a73fff700 1 --2- 172.21.15.80:0/3557479453 >> v2:172.21.15.80:3300/0 conn(0x7f5a7414b8e0 0x7f5a7416ada0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a6c0107c0 tx=0x7f5a6c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:26.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.147+0000 7f5a73fff700 1 --2- 172.21.15.80:0/3557479453 >> v2:172.21.15.80:3300/0 conn(0x7f5a7414b8e0 0x7f5a7416ada0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a6c0107c0 tx=0x7f5a6c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:26.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.147+0000 7f5a73fff700 1 --2- 172.21.15.80:0/3557479453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7414b8e0 0x7f5a7416ada0 secure :-1 s=READY pgs=1530 cs=0 l=1 rx=0x7f5a6c0107c0 tx=0x7f5a6c0105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:26.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.148+0000 7f5a73fff700 1 --2- 172.21.15.80:0/3557479453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7414b8e0 0x7f5a7416ada0 secure :-1 s=THROTTLE_DONE pgs=1530 cs=0 l=1 rx=0x7f5a6c0107c0 tx=0x7f5a6c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:26.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.148+0000 7f5a73fff700 1 --2- 172.21.15.80:0/3557479453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7414b8e0 0x7f5a7416ada0 secure :-1 s=THROTTLE_DONE pgs=1530 cs=0 l=1 rx=0x7f5a6c0107c0 tx=0x7f5a6c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:26.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.148+0000 7f5a5bfff700 1 -- 172.21.15.80:0/3557479453 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a6c0019a0 con 0x7f5a7414b8e0 2019-11-28T11:41:26.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.148+0000 7f5a73fff700 1 --2- 172.21.15.80:0/3557479453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7414b8e0 0x7f5a7416ada0 secure :-1 s=THROTTLE_DONE pgs=1530 cs=0 l=1 rx=0x7f5a6c0107c0 tx=0x7f5a6c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:26.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.148+0000 7f5a5bfff700 1 -- 172.21.15.80:0/3557479453 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c00f900 con 0x7f5a7414b8e0 2019-11-28T11:41:26.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.148+0000 7f5a79290700 1 -- 172.21.15.80:0/3557479453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7411e510 con 0x7f5a7414b8e0 2019-11-28T11:41:26.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.148+0000 7f5a5bfff700 1 -- 172.21.15.80:0/3557479453 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a6c004b90 con 0x7f5a7414b8e0 2019-11-28T11:41:26.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.148+0000 7f5a79290700 1 -- 172.21.15.80:0/3557479453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a741300d0 con 0x7f5a7414b8e0 2019-11-28T11:41:26.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.148+0000 7f5a73fff700 1 --2- 172.21.15.80:0/3557479453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7414b8e0 0x7f5a7416ada0 secure :-1 s=THROTTLE_DONE pgs=1530 cs=0 l=1 rx=0x7f5a6c0107c0 tx=0x7f5a6c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:26.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.148+0000 7f5a5bfff700 1 -- 172.21.15.80:0/3557479453 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5a6c0045c0 con 0x7f5a7414b8e0 2019-11-28T11:41:26.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.148+0000 7f5a73fff700 1 --2- 172.21.15.80:0/3557479453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7414b8e0 0x7f5a7416ada0 secure :-1 s=THROTTLE_DONE pgs=1530 cs=0 l=1 rx=0x7f5a6c0107c0 tx=0x7f5a6c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:26.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.149+0000 7f5a5bfff700 1 --2- 172.21.15.80:0/3557479453 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a54018730 0x7f5a5401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:26.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.149+0000 7f5a5bfff700 1 -- 172.21.15.80:0/3557479453 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5a6c031dc0 con 0x7f5a7414b8e0 2019-11-28T11:41:26.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.149+0000 7f5a737fe700 1 --2- 172.21.15.80:0/3557479453 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a54018730 0x7f5a5401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:26.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.149+0000 7f5a737fe700 1 --2- 172.21.15.80:0/3557479453 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a54018730 0x7f5a5401abc0 crc :-1 s=READY pgs=621 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:26.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.156+0000 7f5a79290700 1 -- 172.21.15.80:0/3557479453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7411e510 con 0x7f5a7414b8e0 2019-11-28T11:41:26.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.159+0000 7f5a73fff700 1 --2- 172.21.15.80:0/3557479453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7414b8e0 0x7f5a7416ada0 secure :-1 s=THROTTLE_DONE pgs=1530 cs=0 l=1 rx=0x7f5a6c0107c0 tx=0x7f5a6c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:26.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.159+0000 7f5a5bfff700 1 -- 172.21.15.80:0/3557479453 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5a6c000ec0 con 0x7f5a7414b8e0 2019-11-28T11:41:26.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:26.336+0000 7f5a79290700 1 -- 172.21.15.80:0/3557479453 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f5a741300d0 con 0x7f5a7414b8e0 2019-11-28T11:41:27.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.302+0000 7f5a73fff700 1 --2- 172.21.15.80:0/3557479453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7414b8e0 0x7f5a7416ada0 secure :-1 s=THROTTLE_DONE pgs=1530 cs=0 l=1 rx=0x7f5a6c0107c0 tx=0x7f5a6c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.302+0000 7f5a5bfff700 1 -- 172.21.15.80:0/3557479453 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v81) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5a6c0045c0 con 0x7f5a7414b8e0 2019-11-28T11:41:27.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.354+0000 7f5a79290700 1 -- 172.21.15.80:0/3557479453 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a54018730 msgr2=0x7f5a5401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:27.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.354+0000 7f5a79290700 1 --2- 172.21.15.80:0/3557479453 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a54018730 0x7f5a5401abc0 crc :-1 s=READY pgs=621 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:27.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.354+0000 7f5a79290700 1 -- 172.21.15.80:0/3557479453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7414b8e0 msgr2=0x7f5a7416ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:27.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.354+0000 7f5a79290700 1 --2- 172.21.15.80:0/3557479453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7414b8e0 0x7f5a7416ada0 secure :-1 s=READY pgs=1530 cs=0 l=1 rx=0x7f5a6c0107c0 tx=0x7f5a6c0105f0).stop 2019-11-28T11:41:27.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.354+0000 7f5a79290700 1 -- 172.21.15.80:0/3557479453 shutdown_connections 2019-11-28T11:41:27.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.354+0000 7f5a79290700 1 --2- 172.21.15.80:0/3557479453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a7414b8e0 0x7f5a7416ada0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:27.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.354+0000 7f5a79290700 1 --2- 172.21.15.80:0/3557479453 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a54018730 0x7f5a5401abc0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:27.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.354+0000 7f5a79290700 1 --2- 172.21.15.80:0/3557479453 >> v2:172.21.15.174:3300/0 conn(0x7f5a74108920 0x7f5a74132610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:27.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.354+0000 7f5a79290700 1 -- 172.21.15.80:0/3557479453 shutdown_connections 2019-11-28T11:41:27.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.354+0000 7f5a79290700 1 -- 172.21.15.80:0/3557479453 wait complete. 2019-11-28T11:41:27.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.354+0000 7f5a79290700 1 -- 172.21.15.80:0/3557479453 >> 172.21.15.80:0/3557479453 conn(0x7f5a7414dbb0 msgr2=0x7f5a74142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:27.397 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:41:27.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.484+0000 7f5968b72700 1 Processor -- start 2019-11-28T11:41:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.484+0000 7f5968b72700 1 -- start start 2019-11-28T11:41:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.485+0000 7f5968b72700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f596406c490 0x7f596406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.485+0000 7f5968b72700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596406db00 con 0x7f596406c0a0 2019-11-28T11:41:27.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.485+0000 7f5968b72700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596406e000 con 0x7f596406ce60 2019-11-28T11:41:27.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.485+0000 7f5968b72700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596406fd60 con 0x7f596406c490 2019-11-28T11:41:27.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.485+0000 7f5962d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f596406c0a0 0x7f5964072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38452/0 (socket says 172.21.15.80:38452) 2019-11-28T11:41:27.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.485+0000 7f5962d9d700 1 -- 172.21.15.80:0/3268008823 learned_addr learned my addr 172.21.15.80:0/3268008823 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:27.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.485+0000 7f596259c700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f596406c490 0x7f596406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:27.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.485+0000 7f5961d9b700 1 -- 172.21.15.80:0/3268008823 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299615016 0 0) 0x7f594c0014d0 con 0x7f596406c0a0 2019-11-28T11:41:27.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.485+0000 7f5961d9b700 1 -- 172.21.15.80:0/3268008823 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5944002e80 con 0x7f596406c0a0 2019-11-28T11:41:27.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 -- 172.21.15.80:0/3268008823 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995333757 0 0) 0x7f595c0009b0 con 0x7f596406ce60 2019-11-28T11:41:27.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 -- 172.21.15.80:0/3268008823 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59440030b0 con 0x7f596406ce60 2019-11-28T11:41:27.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 -- 172.21.15.80:0/3268008823 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2822969885 0 0) 0x7f594c0014b0 con 0x7f596406c0a0 2019-11-28T11:41:27.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 -- 172.21.15.80:0/3268008823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f596406c490 msgr2=0x7f596406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:27.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f596406c490 0x7f596406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:27.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 -- 172.21.15.80:0/3268008823 >> v1:172.21.15.174:6789/0 conn(0x7f596406ce60 legacy=0x7f5964164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:27.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 -- 172.21.15.80:0/3268008823 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59640706c0 con 0x7f596406c0a0 2019-11-28T11:41:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 -- 172.21.15.80:0/3268008823 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f594c001a40 con 0x7f596406c0a0 2019-11-28T11:41:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 -- 172.21.15.80:0/3268008823 >> v1:172.21.15.80:6789/0 conn(0x7f596406c0a0 legacy=0x7f5964072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5944003b30 0x7f5944005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5944006680 0x7f5944008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f594404d320 0x7f594404f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 -- 172.21.15.80:0/3268008823 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594404ffd0 con 0x7f594404d320 2019-11-28T11:41:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 -- 172.21.15.80:0/3268008823 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5944050200 con 0x7f5944006680 2019-11-28T11:41:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 -- 172.21.15.80:0/3268008823 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5944050430 con 0x7f5944003b30 2019-11-28T11:41:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f596359e700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f594404d320 0x7f594404f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:27.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5962d9d700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5944003b30 0x7f5944005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:27.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f596259c700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5944006680 0x7f5944008b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:27.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f596359e700 1 -- 172.21.15.80:0/3268008823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5944003b30 msgr2=0x7f5944005f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:27.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f596359e700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5944003b30 0x7f5944005f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:27.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f596359e700 1 -- 172.21.15.80:0/3268008823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5944006680 msgr2=0x7f5944008b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:27.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f596359e700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5944006680 0x7f5944008b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:27.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f596359e700 1 -- 172.21.15.80:0/3268008823 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59440506e0 con 0x7f594404d320 2019-11-28T11:41:27.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f596359e700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f594404d320 0x7f594404f7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f595c00af60 tx=0x7f595c00b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f596359e700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f594404d320 0x7f594404f7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f595c00af60 tx=0x7f595c00b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f596359e700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f594404d320 0x7f594404f7f0 secure :-1 s=READY pgs=1532 cs=0 l=1 rx=0x7f595c00af60 tx=0x7f595c00b2e0).ready entity=mon.0 client_cookie=ffef5e23f8617b11 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:27.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f596359e700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f594404d320 0x7f594404f7f0 secure :-1 s=THROTTLE_DONE pgs=1532 cs=0 l=1 rx=0x7f595c00af60 tx=0x7f595c00b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 -- 172.21.15.80:0/3268008823 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f595c000940 con 0x7f594404d320 2019-11-28T11:41:27.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f596359e700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f594404d320 0x7f594404f7f0 secure :-1 s=THROTTLE_DONE pgs=1532 cs=0 l=1 rx=0x7f595c00af60 tx=0x7f595c00b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 -- 172.21.15.80:0/3268008823 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c0097d0 con 0x7f594404d320 2019-11-28T11:41:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f596359e700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f594404d320 0x7f594404f7f0 secure :-1 s=THROTTLE_DONE pgs=1532 cs=0 l=1 rx=0x7f595c00af60 tx=0x7f595c00b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.486+0000 7f5961d9b700 1 -- 172.21.15.80:0/3268008823 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f595c009da0 con 0x7f594404d320 2019-11-28T11:41:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.487+0000 7f5968b72700 1 -- 172.21.15.80:0/3268008823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f594404d320 msgr2=0x7f594404f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.487+0000 7f5968b72700 1 --2- 172.21.15.80:0/3268008823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f594404d320 0x7f594404f7f0 secure :-1 s=READY pgs=1532 cs=0 l=1 rx=0x7f595c00af60 tx=0x7f595c00b2e0).stop 2019-11-28T11:41:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.487+0000 7f596359e700 1 -- 172.21.15.80:0/3268008823 reap_dead start 2019-11-28T11:41:27.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.487+0000 7f5968b72700 1 -- 172.21.15.80:0/3268008823 shutdown_connections 2019-11-28T11:41:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.487+0000 7f5968b72700 1 -- 172.21.15.80:0/3268008823 shutdown_connections 2019-11-28T11:41:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.487+0000 7f5968b72700 1 -- 172.21.15.80:0/3268008823 wait complete. 2019-11-28T11:41:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.487+0000 7f5968b72700 1 -- 172.21.15.80:0/3268008823 >> 172.21.15.80:0/3268008823 conn(0x7f5964061cf0 msgr2=0x7f5964064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:27.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.490+0000 7f5968b72700 1 Processor -- start 2019-11-28T11:41:27.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.490+0000 7f5968b72700 1 -- start start 2019-11-28T11:41:27.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f5968b72700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5964074d00 0x7f596407aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:27.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f5968b72700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5964150f50 0x7f596407af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:27.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f5968b72700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59640754d0 con 0x7f596407bba0 2019-11-28T11:41:27.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f5968b72700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5964078980 con 0x7f5964150f50 2019-11-28T11:41:27.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f5968b72700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5964078c50 con 0x7f5964074d00 2019-11-28T11:41:27.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f596259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5964150f50 0x7f596407af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:27.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f596259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5964150f50 0x7f596407af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39152/0 (socket says 172.21.15.80:39152) 2019-11-28T11:41:27.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f596259c700 1 -- 172.21.15.80:0/226547462 learned_addr learned my addr 172.21.15.80:0/226547462 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:27.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f5962d9d700 1 --2- 172.21.15.80:0/226547462 >> v2:172.21.15.174:3300/0 conn(0x7f5964074d00 0x7f596407aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:27.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f596259c700 1 -- 172.21.15.80:0/226547462 >> v2:172.21.15.174:3300/0 conn(0x7f5964074d00 msgr2=0x7f596407aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:27.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f596259c700 1 --2- 172.21.15.80:0/226547462 >> v2:172.21.15.174:3300/0 conn(0x7f5964074d00 0x7f596407aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:27.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f596259c700 1 -- 172.21.15.80:0/226547462 >> v1:172.21.15.80:6789/0 conn(0x7f596407bba0 legacy=0x7f5964076d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:27.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f596259c700 1 -- 172.21.15.80:0/226547462 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59640792e0 con 0x7f5964150f50 2019-11-28T11:41:27.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f595b7fe700 1 -- 172.21.15.80:0/226547462 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155696403 0 0) 0x7f595c009870 con 0x7f596407bba0 2019-11-28T11:41:27.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f596259c700 1 --2- 172.21.15.80:0/226547462 >> v2:172.21.15.80:3300/0 conn(0x7f5964150f50 0x7f596407af60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59540102b0 tx=0x7f59540128f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f596259c700 1 --2- 172.21.15.80:0/226547462 >> v2:172.21.15.80:3300/0 conn(0x7f5964150f50 0x7f596407af60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59540102b0 tx=0x7f59540128f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f596259c700 1 --2- 172.21.15.80:0/226547462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5964150f50 0x7f596407af60 secure :-1 s=READY pgs=1534 cs=0 l=1 rx=0x7f59540102b0 tx=0x7f59540128f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:27.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f596259c700 1 --2- 172.21.15.80:0/226547462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5964150f50 0x7f596407af60 secure :-1 s=THROTTLE_DONE pgs=1534 cs=0 l=1 rx=0x7f59540102b0 tx=0x7f59540128f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f595b7fe700 1 -- 172.21.15.80:0/226547462 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5954009250 con 0x7f5964150f50 2019-11-28T11:41:27.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f596259c700 1 --2- 172.21.15.80:0/226547462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5964150f50 0x7f596407af60 secure :-1 s=THROTTLE_DONE pgs=1534 cs=0 l=1 rx=0x7f59540102b0 tx=0x7f59540128f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f596259c700 1 --2- 172.21.15.80:0/226547462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5964150f50 0x7f596407af60 secure :-1 s=THROTTLE_DONE pgs=1534 cs=0 l=1 rx=0x7f59540102b0 tx=0x7f59540128f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f595b7fe700 1 -- 172.21.15.80:0/226547462 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5954001090 con 0x7f5964150f50 2019-11-28T11:41:27.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f5968b72700 1 -- 172.21.15.80:0/226547462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5964079660 con 0x7f5964150f50 2019-11-28T11:41:27.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f595b7fe700 1 -- 172.21.15.80:0/226547462 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5954001760 con 0x7f5964150f50 2019-11-28T11:41:27.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.491+0000 7f5968b72700 1 -- 172.21.15.80:0/226547462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59640792e0 con 0x7f5964150f50 2019-11-28T11:41:27.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.492+0000 7f596259c700 1 --2- 172.21.15.80:0/226547462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5964150f50 0x7f596407af60 secure :-1 s=THROTTLE_DONE pgs=1534 cs=0 l=1 rx=0x7f59540102b0 tx=0x7f59540128f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.492+0000 7f595b7fe700 1 -- 172.21.15.80:0/226547462 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5954000c90 con 0x7f5964150f50 2019-11-28T11:41:27.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.492+0000 7f596259c700 1 --2- 172.21.15.80:0/226547462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5964150f50 0x7f596407af60 secure :-1 s=THROTTLE_DONE pgs=1534 cs=0 l=1 rx=0x7f59540102b0 tx=0x7f59540128f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.492+0000 7f595b7fe700 1 --2- 172.21.15.80:0/226547462 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f593c018730 0x7f593c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:27.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.492+0000 7f595b7fe700 1 -- 172.21.15.80:0/226547462 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5954033d10 con 0x7f5964150f50 2019-11-28T11:41:27.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.492+0000 7f5962d9d700 1 --2- 172.21.15.80:0/226547462 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f593c018730 0x7f593c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:27.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.492+0000 7f5962d9d700 1 --2- 172.21.15.80:0/226547462 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f593c018730 0x7f593c01abc0 crc :-1 s=READY pgs=622 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:27.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.499+0000 7f5968b72700 1 -- 172.21.15.80:0/226547462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5964079660 con 0x7f5964150f50 2019-11-28T11:41:27.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.503+0000 7f596259c700 1 --2- 172.21.15.80:0/226547462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5964150f50 0x7f596407af60 secure :-1 s=THROTTLE_DONE pgs=1534 cs=0 l=1 rx=0x7f59540102b0 tx=0x7f59540128f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.503+0000 7f595b7fe700 1 -- 172.21.15.80:0/226547462 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5954000940 con 0x7f5964150f50 2019-11-28T11:41:27.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.674+0000 7f5968b72700 1 -- 172.21.15.80:0/226547462 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59640792e0 con 0x7f5964150f50 2019-11-28T11:41:27.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.675+0000 7f596259c700 1 --2- 172.21.15.80:0/226547462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5964150f50 0x7f596407af60 secure :-1 s=THROTTLE_DONE pgs=1534 cs=0 l=1 rx=0x7f59540102b0 tx=0x7f59540128f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.675+0000 7f595b7fe700 1 -- 172.21.15.80:0/226547462 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+1424 (secure 0 0 0) 0x7f5954000c90 con 0x7f5964150f50 2019-11-28T11:41:27.708 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 81 2019-11-28T11:41:27.709 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:27.709 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:25.297182+0000","modified":"2019-11-28T11:41:27.300122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2019-11-28T11:41:27.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.677+0000 7f5968b72700 1 -- 172.21.15.80:0/226547462 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f593c018730 msgr2=0x7f593c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:27.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.677+0000 7f5968b72700 1 --2- 172.21.15.80:0/226547462 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f593c018730 0x7f593c01abc0 crc :-1 s=READY pgs=622 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:27.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.677+0000 7f5968b72700 1 -- 172.21.15.80:0/226547462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5964150f50 msgr2=0x7f596407af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:27.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.677+0000 7f5968b72700 1 --2- 172.21.15.80:0/226547462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5964150f50 0x7f596407af60 secure :-1 s=READY pgs=1534 cs=0 l=1 rx=0x7f59540102b0 tx=0x7f59540128f0).stop 2019-11-28T11:41:27.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.677+0000 7f5968b72700 1 -- 172.21.15.80:0/226547462 shutdown_connections 2019-11-28T11:41:27.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.677+0000 7f5968b72700 1 --2- 172.21.15.80:0/226547462 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f593c018730 0x7f593c01abc0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:27.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.677+0000 7f5968b72700 1 --2- 172.21.15.80:0/226547462 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5964150f50 0x7f596407af60 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:27.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.677+0000 7f5968b72700 1 --2- 172.21.15.80:0/226547462 >> v2:172.21.15.174:3300/0 conn(0x7f5964074d00 0x7f596407aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:27.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.677+0000 7f5968b72700 1 -- 172.21.15.80:0/226547462 shutdown_connections 2019-11-28T11:41:27.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.677+0000 7f5968b72700 1 -- 172.21.15.80:0/226547462 wait complete. 2019-11-28T11:41:27.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.677+0000 7f5968b72700 1 -- 172.21.15.80:0/226547462 >> 172.21.15.80:0/226547462 conn(0x7f596413fa50 msgr2=0x7f596407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:27.722 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:41:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.808+0000 7f6be6c28700 1 Processor -- start 2019-11-28T11:41:27.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.808+0000 7f6be6c28700 1 -- start start 2019-11-28T11:41:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.809+0000 7f6be6c28700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6be006c0a0 0x7f6be0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.809+0000 7f6be6c28700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6be0072620 0x7f6be0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.809+0000 7f6be6c28700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be006db00 con 0x7f6be00734e0 2019-11-28T11:41:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.809+0000 7f6be6c28700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be006f330 con 0x7f6be0072620 2019-11-28T11:41:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.809+0000 7f6be6c28700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be00706c0 con 0x7f6be006c0a0 2019-11-28T11:41:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.809+0000 7f6be51c5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6be006c0a0 0x7f6be0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.809+0000 7f6be59c6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6be0072620 0x7f6be0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.809+0000 7f6be49c4700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f6be00734e0 0x7f6be0071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:54020/0 (socket says 172.21.15.80:54020) 2019-11-28T11:41:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.809+0000 7f6be51c5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6be006c0a0 0x7f6be0072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:41416/0 (socket says 172.21.15.80:41416) 2019-11-28T11:41:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.809+0000 7f6be49c4700 1 -- 172.21.15.80:0/4145191428 learned_addr learned my addr 172.21.15.80:0/4145191428 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6bd7fff700 1 -- 172.21.15.80:0/4145191428 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22458288 0 0) 0x7f6bd0001030 con 0x7f6be00734e0 2019-11-28T11:41:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6bd7fff700 1 -- 172.21.15.80:0/4145191428 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bcc002e80 con 0x7f6be00734e0 2019-11-28T11:41:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6be59c6700 1 -- 172.21.15.80:0/4145191428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6be006c0a0 msgr2=0x7f6be0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:27.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6be59c6700 1 --2- 172.21.15.80:0/4145191428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6be006c0a0 0x7f6be0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6be59c6700 1 -- 172.21.15.80:0/4145191428 >> v1:172.21.15.174:6789/0 conn(0x7f6be00734e0 legacy=0x7f6be0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6be59c6700 1 -- 172.21.15.80:0/4145191428 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0070a40 con 0x7f6be0072620 2019-11-28T11:41:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6be51c5700 1 --2- 172.21.15.80:0/4145191428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6be006c0a0 0x7f6be0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6be59c6700 1 --2- 172.21.15.80:0/4145191428 >> v2:172.21.15.174:3300/0 conn(0x7f6be0072620 0x7f6be0164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6bd800af80 tx=0x7f6bd800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6be59c6700 1 --2- 172.21.15.80:0/4145191428 >> v2:172.21.15.174:3300/0 conn(0x7f6be0072620 0x7f6be0164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6bd800af80 tx=0x7f6bd800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6be59c6700 1 --2- 172.21.15.80:0/4145191428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6be0072620 0x7f6be0164d70 secure :-1 s=READY pgs=893 cs=0 l=1 rx=0x7f6bd800af80 tx=0x7f6bd800b790).ready entity=mon.1 client_cookie=9d98fa70d662a4dd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:27.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6be59c6700 1 --2- 172.21.15.80:0/4145191428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6be0072620 0x7f6be0164d70 secure :-1 s=THROTTLE_DONE pgs=893 cs=0 l=1 rx=0x7f6bd800af80 tx=0x7f6bd800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6bd7fff700 1 -- 172.21.15.80:0/4145191428 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bd8000bc0 con 0x7f6be0072620 2019-11-28T11:41:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6be59c6700 1 --2- 172.21.15.80:0/4145191428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6be0072620 0x7f6be0164d70 secure :-1 s=THROTTLE_DONE pgs=893 cs=0 l=1 rx=0x7f6bd800af80 tx=0x7f6bd800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6be59c6700 1 --2- 172.21.15.80:0/4145191428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6be0072620 0x7f6be0164d70 secure :-1 s=THROTTLE_DONE pgs=893 cs=0 l=1 rx=0x7f6bd800af80 tx=0x7f6bd800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6bd7fff700 1 -- 172.21.15.80:0/4145191428 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd80097f0 con 0x7f6be0072620 2019-11-28T11:41:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6bd7fff700 1 -- 172.21.15.80:0/4145191428 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bd8009ec0 con 0x7f6be0072620 2019-11-28T11:41:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6be6c28700 1 -- 172.21.15.80:0/4145191428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6be0072620 msgr2=0x7f6be0164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:27.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.810+0000 7f6be6c28700 1 --2- 172.21.15.80:0/4145191428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6be0072620 0x7f6be0164d70 secure :-1 s=READY pgs=893 cs=0 l=1 rx=0x7f6bd800af80 tx=0x7f6bd800b790).stop 2019-11-28T11:41:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.811+0000 7f6be6c28700 1 -- 172.21.15.80:0/4145191428 shutdown_connections 2019-11-28T11:41:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.811+0000 7f6be6c28700 1 --2- 172.21.15.80:0/4145191428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6be0072620 0x7f6be0164d70 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.811+0000 7f6be6c28700 1 --2- 172.21.15.80:0/4145191428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6be006c0a0 0x7f6be0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.811+0000 7f6be6c28700 1 -- 172.21.15.80:0/4145191428 shutdown_connections 2019-11-28T11:41:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.811+0000 7f6be6c28700 1 -- 172.21.15.80:0/4145191428 wait complete. 2019-11-28T11:41:27.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.811+0000 7f6be6c28700 1 -- 172.21.15.80:0/4145191428 >> 172.21.15.80:0/4145191428 conn(0x7f6be0061cf0 msgr2=0x7f6be0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:27.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.813+0000 7f6be6c28700 1 Processor -- start 2019-11-28T11:41:27.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.813+0000 7f6be6c28700 1 -- start start 2019-11-28T11:41:27.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.814+0000 7f6be6c28700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6be0104820 0x7f6be010c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:27.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.814+0000 7f6be6c28700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6be010b9d0 0x7f6be0167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:27.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be6c28700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be013bcd0 con 0x7f6be010c890 2019-11-28T11:41:27.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be6c28700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be0109130 con 0x7f6be0104820 2019-11-28T11:41:27.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be6c28700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be0109400 con 0x7f6be010b9d0 2019-11-28T11:41:27.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be51c5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6be0104820 0x7f6be010c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:27.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be51c5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6be0104820 0x7f6be010c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39162/0 (socket says 172.21.15.80:39162) 2019-11-28T11:41:27.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be51c5700 1 -- 172.21.15.80:0/2630222129 learned_addr learned my addr 172.21.15.80:0/2630222129 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:27.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be59c6700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6be010b9d0 0x7f6be0167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:27.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be51c5700 1 -- 172.21.15.80:0/2630222129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6be010b9d0 msgr2=0x7f6be0167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be51c5700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6be010b9d0 0x7f6be0167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be51c5700 1 -- 172.21.15.80:0/2630222129 >> v1:172.21.15.174:6789/0 conn(0x7f6be010c890 legacy=0x7f6be010b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be51c5700 1 -- 172.21.15.80:0/2630222129 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0109a90 con 0x7f6be0104820 2019-11-28T11:41:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be51c5700 1 --2- 172.21.15.80:0/2630222129 >> v2:172.21.15.80:3300/0 conn(0x7f6be0104820 0x7f6be010c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6bdc010790 tx=0x7f6bdc010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be51c5700 1 --2- 172.21.15.80:0/2630222129 >> v2:172.21.15.80:3300/0 conn(0x7f6be0104820 0x7f6be010c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6bdc010790 tx=0x7f6bdc010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be51c5700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be0104820 0x7f6be010c350 secure :-1 s=READY pgs=1535 cs=0 l=1 rx=0x7f6bdc010790 tx=0x7f6bdc010610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:27.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be51c5700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be0104820 0x7f6be010c350 secure :-1 s=THROTTLE_DONE pgs=1535 cs=0 l=1 rx=0x7f6bdc010790 tx=0x7f6bdc010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6bd5ffb700 1 -- 172.21.15.80:0/2630222129 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bdc000ce0 con 0x7f6be0104820 2019-11-28T11:41:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be51c5700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be0104820 0x7f6be010c350 secure :-1 s=THROTTLE_DONE pgs=1535 cs=0 l=1 rx=0x7f6bdc010790 tx=0x7f6bdc010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be6c28700 1 -- 172.21.15.80:0/2630222129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be0109e10 con 0x7f6be0104820 2019-11-28T11:41:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be51c5700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be0104820 0x7f6be010c350 secure :-1 s=THROTTLE_DONE pgs=1535 cs=0 l=1 rx=0x7f6bdc010790 tx=0x7f6bdc010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6bd5ffb700 1 -- 172.21.15.80:0/2630222129 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc000ce0 con 0x7f6be0104820 2019-11-28T11:41:27.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6bd5ffb700 1 -- 172.21.15.80:0/2630222129 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bdc00f130 con 0x7f6be0104820 2019-11-28T11:41:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.815+0000 7f6be6c28700 1 -- 172.21.15.80:0/2630222129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be0109a90 con 0x7f6be0104820 2019-11-28T11:41:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.816+0000 7f6be51c5700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be0104820 0x7f6be010c350 secure :-1 s=THROTTLE_DONE pgs=1535 cs=0 l=1 rx=0x7f6bdc010790 tx=0x7f6bdc010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.816+0000 7f6bd5ffb700 1 -- 172.21.15.80:0/2630222129 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6bdc009900 con 0x7f6be0104820 2019-11-28T11:41:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.816+0000 7f6be51c5700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be0104820 0x7f6be010c350 secure :-1 s=THROTTLE_DONE pgs=1535 cs=0 l=1 rx=0x7f6bdc010790 tx=0x7f6bdc010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.816+0000 7f6bd5ffb700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bc0018730 0x7f6bc001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.816+0000 7f6bd5ffb700 1 -- 172.21.15.80:0/2630222129 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6bdc031f00 con 0x7f6be0104820 2019-11-28T11:41:27.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.816+0000 7f6be49c4700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bc0018730 0x7f6bc001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:27.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.816+0000 7f6be49c4700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bc0018730 0x7f6bc001abc0 crc :-1 s=READY pgs=623 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:27.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.823+0000 7f6be6c28700 1 -- 172.21.15.80:0/2630222129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be0109e10 con 0x7f6be0104820 2019-11-28T11:41:27.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.827+0000 7f6be51c5700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be0104820 0x7f6be010c350 secure :-1 s=THROTTLE_DONE pgs=1535 cs=0 l=1 rx=0x7f6bdc010790 tx=0x7f6bdc010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:27.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:27.827+0000 7f6bd5ffb700 1 -- 172.21.15.80:0/2630222129 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6bdc00a810 con 0x7f6be0104820 2019-11-28T11:41:28.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.003+0000 7f6be6c28700 1 -- 172.21.15.80:0/2630222129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6be0109a90 con 0x7f6be0104820 2019-11-28T11:41:28.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.004+0000 7f6be51c5700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be0104820 0x7f6be010c350 secure :-1 s=THROTTLE_DONE pgs=1535 cs=0 l=1 rx=0x7f6bdc010790 tx=0x7f6bdc010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.004+0000 7f6bd5ffb700 1 -- 172.21.15.80:0/2630222129 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f6bdc000cc0 con 0x7f6be0104820 2019-11-28T11:41:28.038 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:28.038 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":117,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:41:26.298582+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:41:23.623555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2019-11-28T11:41:24.315901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:41:28.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.006+0000 7f6be6c28700 1 -- 172.21.15.80:0/2630222129 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bc0018730 msgr2=0x7f6bc001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.006+0000 7f6be6c28700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bc0018730 0x7f6bc001abc0 crc :-1 s=READY pgs=623 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.006+0000 7f6be6c28700 1 -- 172.21.15.80:0/2630222129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be0104820 msgr2=0x7f6be010c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.006+0000 7f6be6c28700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be0104820 0x7f6be010c350 secure :-1 s=READY pgs=1535 cs=0 l=1 rx=0x7f6bdc010790 tx=0x7f6bdc010610).stop 2019-11-28T11:41:28.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.006+0000 7f6be6c28700 1 -- 172.21.15.80:0/2630222129 shutdown_connections 2019-11-28T11:41:28.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.006+0000 7f6be6c28700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6be010b9d0 0x7f6be0167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.006+0000 7f6be6c28700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bc0018730 0x7f6bc001abc0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.006+0000 7f6be6c28700 1 --2- 172.21.15.80:0/2630222129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be0104820 0x7f6be010c350 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.006+0000 7f6be6c28700 1 -- 172.21.15.80:0/2630222129 shutdown_connections 2019-11-28T11:41:28.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.006+0000 7f6be6c28700 1 -- 172.21.15.80:0/2630222129 wait complete. 2019-11-28T11:41:28.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.006+0000 7f6be6c28700 1 -- 172.21.15.80:0/2630222129 >> 172.21.15.80:0/2630222129 conn(0x7f6be013d620 msgr2=0x7f6be013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:28.049 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:41:28.049 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:41:28.050 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:41:28.050 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:41:28.051 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:41:28.051 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:41:28.055 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:41:28.055 DEBUG:teuthology.parallel:result is None 2019-11-28T11:41:28.056 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:41:28.056 DEBUG:teuthology.parallel:result is None 2019-11-28T11:41:28.056 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:41:28.057 DEBUG:teuthology.parallel:result is None 2019-11-28T11:41:28.057 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:41:28.141 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:41:28.148 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:41:28.148 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:41:28.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.160+0000 7f66ab07d700 1 Processor -- start 2019-11-28T11:41:28.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.160+0000 7f66ab07d700 1 -- start start 2019-11-28T11:41:28.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.161+0000 7f66ab07d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66a415ed10 0x7f66a415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:28.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.161+0000 7f66ab07d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66a4073020 0x7f66a4071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:28.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.161+0000 7f66ab07d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f66a40734b0 0x7f66a40723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:28.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.161+0000 7f66ab07d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a406fe00 con 0x7f66a415ed10 2019-11-28T11:41:28.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.161+0000 7f66ab07d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a40700d0 con 0x7f66a40734b0 2019-11-28T11:41:28.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.161+0000 7f66ab07d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a406f3d0 con 0x7f66a4073020 2019-11-28T11:41:28.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a961a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66a415ed10 0x7f66a415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:28.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a961a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66a415ed10 0x7f66a415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39192/0 (socket says 172.21.15.80:39192) 2019-11-28T11:41:28.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a961a700 1 -- 172.21.15.80:0/1840383290 learned_addr learned my addr 172.21.15.80:0/1840383290 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:28.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a9e1b700 1 --2- 172.21.15.80:0/1840383290 >> v2:172.21.15.174:3300/0 conn(0x7f66a40734b0 0x7f66a40723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:28.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a8e19700 1 --2- 172.21.15.80:0/1840383290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66a4073020 0x7f66a4071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:28.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a961a700 1 -- 172.21.15.80:0/1840383290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66a4073020 msgr2=0x7f66a4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:28.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a961a700 1 --2- 172.21.15.80:0/1840383290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66a4073020 0x7f66a4071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:28.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a961a700 1 -- 172.21.15.80:0/1840383290 >> v2:172.21.15.174:3300/0 conn(0x7f66a40734b0 msgr2=0x7f66a40723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:28.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a961a700 1 --2- 172.21.15.80:0/1840383290 >> v2:172.21.15.174:3300/0 conn(0x7f66a40734b0 0x7f66a40723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:28.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a961a700 1 -- 172.21.15.80:0/1840383290 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a4070760 con 0x7f66a415ed10 2019-11-28T11:41:28.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a8e19700 1 --2- 172.21.15.80:0/1840383290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66a4073020 0x7f66a4071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:41:28.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a9e1b700 1 --2- 172.21.15.80:0/1840383290 >> v2:172.21.15.174:3300/0 conn(0x7f66a40734b0 0x7f66a40723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:41:28.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a961a700 1 --2- 172.21.15.80:0/1840383290 >> v2:172.21.15.80:3300/0 conn(0x7f66a415ed10 0x7f66a415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f669400f740 tx=0x7f669400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a961a700 1 --2- 172.21.15.80:0/1840383290 >> v2:172.21.15.80:3300/0 conn(0x7f66a415ed10 0x7f66a415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f669400f740 tx=0x7f669400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a961a700 1 --2- 172.21.15.80:0/1840383290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a415ed10 0x7f66a415f100 secure :-1 s=READY pgs=1543 cs=0 l=1 rx=0x7f669400f740 tx=0x7f669400fae0).ready entity=mon.0 client_cookie=95daeba2d7deeb60 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:28.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a961a700 1 --2- 172.21.15.80:0/1840383290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a415ed10 0x7f66a415f100 secure :-1 s=THROTTLE_DONE pgs=1543 cs=0 l=1 rx=0x7f669400f740 tx=0x7f669400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a3fff700 1 -- 172.21.15.80:0/1840383290 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6694000960 con 0x7f66a415ed10 2019-11-28T11:41:28.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a961a700 1 --2- 172.21.15.80:0/1840383290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a415ed10 0x7f66a415f100 secure :-1 s=THROTTLE_DONE pgs=1543 cs=0 l=1 rx=0x7f669400f740 tx=0x7f669400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a961a700 1 --2- 172.21.15.80:0/1840383290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a415ed10 0x7f66a415f100 secure :-1 s=THROTTLE_DONE pgs=1543 cs=0 l=1 rx=0x7f669400f740 tx=0x7f669400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a3fff700 1 -- 172.21.15.80:0/1840383290 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6694000e80 con 0x7f66a415ed10 2019-11-28T11:41:28.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66a3fff700 1 -- 172.21.15.80:0/1840383290 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66940015d0 con 0x7f66a415ed10 2019-11-28T11:41:28.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66ab07d700 1 -- 172.21.15.80:0/1840383290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a415ed10 msgr2=0x7f66a415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.162+0000 7f66ab07d700 1 --2- 172.21.15.80:0/1840383290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a415ed10 0x7f66a415f100 secure :-1 s=READY pgs=1543 cs=0 l=1 rx=0x7f669400f740 tx=0x7f669400fae0).stop 2019-11-28T11:41:28.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.163+0000 7f66ab07d700 1 -- 172.21.15.80:0/1840383290 shutdown_connections 2019-11-28T11:41:28.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.163+0000 7f66ab07d700 1 --2- 172.21.15.80:0/1840383290 >> v2:172.21.15.174:3300/0 conn(0x7f66a40734b0 0x7f66a40723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:28.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.163+0000 7f66ab07d700 1 --2- 172.21.15.80:0/1840383290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66a4073020 0x7f66a4071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:28.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.163+0000 7f66ab07d700 1 --2- 172.21.15.80:0/1840383290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a415ed10 0x7f66a415f100 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.163+0000 7f66ab07d700 1 -- 172.21.15.80:0/1840383290 shutdown_connections 2019-11-28T11:41:28.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.163+0000 7f66ab07d700 1 -- 172.21.15.80:0/1840383290 wait complete. 2019-11-28T11:41:28.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.163+0000 7f66ab07d700 1 -- 172.21.15.80:0/1840383290 >> 172.21.15.80:0/1840383290 conn(0x7f66a4061d40 msgr2=0x7f66a40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:28.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.166+0000 7f66ab07d700 1 Processor -- start 2019-11-28T11:41:28.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.166+0000 7f66ab07d700 1 -- start start 2019-11-28T11:41:28.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66ab07d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f66a4134610 0x7f66a4134aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:28.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66ab07d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66a4134fe0 0x7f66a4167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:28.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66ab07d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a4109d70 con 0x7f66a4152750 2019-11-28T11:41:28.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66ab07d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a4132570 con 0x7f66a4134fe0 2019-11-28T11:41:28.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66ab07d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a4132840 con 0x7f66a4134610 2019-11-28T11:41:28.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a9e1b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66a4134fe0 0x7f66a4167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:28.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a9e1b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66a4134fe0 0x7f66a4167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39202/0 (socket says 172.21.15.80:39202) 2019-11-28T11:41:28.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a8e19700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f66a4134610 0x7f66a4134aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:28.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a9e1b700 1 -- 172.21.15.80:0/3250362571 learned_addr learned my addr 172.21.15.80:0/3250362571 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:28.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a9e1b700 1 -- 172.21.15.80:0/3250362571 >> v2:172.21.15.174:3300/0 conn(0x7f66a4134610 msgr2=0x7f66a4134aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a9e1b700 1 --2- 172.21.15.80:0/3250362571 >> v2:172.21.15.174:3300/0 conn(0x7f66a4134610 0x7f66a4134aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a9e1b700 1 -- 172.21.15.80:0/3250362571 >> v1:172.21.15.174:6789/0 conn(0x7f66a4152750 legacy=0x7f66a4135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a9e1b700 1 -- 172.21.15.80:0/3250362571 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a4135460 con 0x7f66a4134fe0 2019-11-28T11:41:28.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a9e1b700 1 --2- 172.21.15.80:0/3250362571 >> v2:172.21.15.80:3300/0 conn(0x7f66a4134fe0 0x7f66a4167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f669c010480 tx=0x7f669c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a9e1b700 1 --2- 172.21.15.80:0/3250362571 >> v2:172.21.15.80:3300/0 conn(0x7f66a4134fe0 0x7f66a4167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f669c010480 tx=0x7f669c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a9e1b700 1 --2- 172.21.15.80:0/3250362571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a4134fe0 0x7f66a4167d70 secure :-1 s=READY pgs=1544 cs=0 l=1 rx=0x7f669c010480 tx=0x7f669c010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:28.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a9e1b700 1 --2- 172.21.15.80:0/3250362571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a4134fe0 0x7f66a4167d70 secure :-1 s=THROTTLE_DONE pgs=1544 cs=0 l=1 rx=0x7f669c010480 tx=0x7f669c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a1ffb700 1 -- 172.21.15.80:0/3250362571 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f669c008480 con 0x7f66a4134fe0 2019-11-28T11:41:28.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a9e1b700 1 --2- 172.21.15.80:0/3250362571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a4134fe0 0x7f66a4167d70 secure :-1 s=THROTTLE_DONE pgs=1544 cs=0 l=1 rx=0x7f669c010480 tx=0x7f669c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a9e1b700 1 --2- 172.21.15.80:0/3250362571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a4134fe0 0x7f66a4167d70 secure :-1 s=THROTTLE_DONE pgs=1544 cs=0 l=1 rx=0x7f669c010480 tx=0x7f669c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a1ffb700 1 -- 172.21.15.80:0/3250362571 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c009a80 con 0x7f66a4134fe0 2019-11-28T11:41:28.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66ab07d700 1 -- 172.21.15.80:0/3250362571 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a4135460 con 0x7f66a4134fe0 2019-11-28T11:41:28.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66a1ffb700 1 -- 172.21.15.80:0/3250362571 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f669c00a1b0 con 0x7f66a4134fe0 2019-11-28T11:41:28.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.167+0000 7f66ab07d700 1 -- 172.21.15.80:0/3250362571 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a4135460 con 0x7f66a4134fe0 2019-11-28T11:41:28.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.168+0000 7f66a9e1b700 1 --2- 172.21.15.80:0/3250362571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a4134fe0 0x7f66a4167d70 secure :-1 s=THROTTLE_DONE pgs=1544 cs=0 l=1 rx=0x7f669c010480 tx=0x7f669c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.168+0000 7f66a1ffb700 1 -- 172.21.15.80:0/3250362571 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f669c000a70 con 0x7f66a4134fe0 2019-11-28T11:41:28.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.168+0000 7f66a9e1b700 1 --2- 172.21.15.80:0/3250362571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a4134fe0 0x7f66a4167d70 secure :-1 s=THROTTLE_DONE pgs=1544 cs=0 l=1 rx=0x7f669c010480 tx=0x7f669c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.168+0000 7f66a1ffb700 1 --2- 172.21.15.80:0/3250362571 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6688018730 0x7f668801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:28.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.168+0000 7f66a1ffb700 1 -- 172.21.15.80:0/3250362571 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f669c031ac0 con 0x7f66a4134fe0 2019-11-28T11:41:28.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.168+0000 7f66a961a700 1 --2- 172.21.15.80:0/3250362571 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6688018730 0x7f668801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:28.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.169+0000 7f66a961a700 1 --2- 172.21.15.80:0/3250362571 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6688018730 0x7f668801abc0 crc :-1 s=READY pgs=624 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:28.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.176+0000 7f66ab07d700 1 -- 172.21.15.80:0/3250362571 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a4132ed0 con 0x7f66a4134fe0 2019-11-28T11:41:28.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.179+0000 7f66a9e1b700 1 --2- 172.21.15.80:0/3250362571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a4134fe0 0x7f66a4167d70 secure :-1 s=THROTTLE_DONE pgs=1544 cs=0 l=1 rx=0x7f669c010480 tx=0x7f669c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.179+0000 7f66a1ffb700 1 -- 172.21.15.80:0/3250362571 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f669c0095e0 con 0x7f66a4134fe0 2019-11-28T11:41:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.352+0000 7f66ab07d700 1 -- 172.21.15.80:0/3250362571 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f66a4133250 con 0x7f66a4134fe0 2019-11-28T11:41:28.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.354+0000 7f66a9e1b700 1 --2- 172.21.15.80:0/3250362571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a4134fe0 0x7f66a4167d70 secure :-1 s=THROTTLE_DONE pgs=1544 cs=0 l=1 rx=0x7f669c010480 tx=0x7f669c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.354+0000 7f66a1ffb700 1 -- 172.21.15.80:0/3250362571 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v40) v1 ==== 184+0+0 (secure 0 0 0) 0x7f669c000ba0 con 0x7f66a4134fe0 2019-11-28T11:41:28.387 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:41:28.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.357+0000 7f66ab07d700 1 -- 172.21.15.80:0/3250362571 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6688018730 msgr2=0x7f668801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.357+0000 7f66ab07d700 1 --2- 172.21.15.80:0/3250362571 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6688018730 0x7f668801abc0 crc :-1 s=READY pgs=624 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.357+0000 7f66ab07d700 1 -- 172.21.15.80:0/3250362571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a4134fe0 msgr2=0x7f66a4167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.357+0000 7f66ab07d700 1 --2- 172.21.15.80:0/3250362571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a4134fe0 0x7f66a4167d70 secure :-1 s=READY pgs=1544 cs=0 l=1 rx=0x7f669c010480 tx=0x7f669c010280).stop 2019-11-28T11:41:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.357+0000 7f66ab07d700 1 -- 172.21.15.80:0/3250362571 shutdown_connections 2019-11-28T11:41:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.357+0000 7f66ab07d700 1 --2- 172.21.15.80:0/3250362571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66a4134fe0 0x7f66a4167d70 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.357+0000 7f66ab07d700 1 --2- 172.21.15.80:0/3250362571 >> v2:172.21.15.174:3300/0 conn(0x7f66a4134610 0x7f66a4134aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.357+0000 7f66ab07d700 1 --2- 172.21.15.80:0/3250362571 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6688018730 0x7f668801abc0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.357+0000 7f66ab07d700 1 -- 172.21.15.80:0/3250362571 shutdown_connections 2019-11-28T11:41:28.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.357+0000 7f66ab07d700 1 -- 172.21.15.80:0/3250362571 wait complete. 2019-11-28T11:41:28.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.357+0000 7f66ab07d700 1 -- 172.21.15.80:0/3250362571 >> 172.21.15.80:0/3250362571 conn(0x7f66a41476e0 msgr2=0x7f66a412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:28.399 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:41:28.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.499+0000 7f4548481700 1 Processor -- start 2019-11-28T11:41:28.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.499+0000 7f4548481700 1 -- start start 2019-11-28T11:41:28.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.500+0000 7f4548481700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f454015f100 0x7f454006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:28.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.500+0000 7f4548481700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454006db60 con 0x7f454006c2f0 2019-11-28T11:41:28.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.500+0000 7f4548481700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454006e060 con 0x7f454015ed10 2019-11-28T11:41:28.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.500+0000 7f4548481700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454006fe00 con 0x7f454015f100 2019-11-28T11:41:28.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.500+0000 7f454621d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f454015f100 0x7f454006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:28.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.500+0000 7f454621d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f454015f100 0x7f454006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39210/0 (socket says 172.21.15.80:39210) 2019-11-28T11:41:28.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.500+0000 7f454621d700 1 -- 172.21.15.80:0/3771653326 learned_addr learned my addr 172.21.15.80:0/3771653326 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:28.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.500+0000 7f454721f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f454006c2f0 0x7f454006c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38524/0 (socket says 172.21.15.80:38524) 2019-11-28T11:41:28.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.500+0000 7f454621d700 1 -- 172.21.15.80:0/3771653326 >> v1:172.21.15.174:6789/0 conn(0x7f454015ed10 legacy=0x7f4540073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.500+0000 7f454621d700 1 -- 172.21.15.80:0/3771653326 >> v1:172.21.15.80:6789/0 conn(0x7f454006c2f0 legacy=0x7f454006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.500+0000 7f454621d700 1 -- 172.21.15.80:0/3771653326 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4540070760 con 0x7f454015f100 2019-11-28T11:41:28.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.500+0000 7f4545a1c700 1 -- 172.21.15.80:0/3771653326 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741579279 0 0) 0x7f45380009b0 con 0x7f454006c2f0 2019-11-28T11:41:28.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.501+0000 7f454621d700 1 --2- 172.21.15.80:0/3771653326 >> v2:172.21.15.80:3300/0 conn(0x7f454015f100 0x7f454006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f453400f740 tx=0x7f453400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.501+0000 7f454621d700 1 --2- 172.21.15.80:0/3771653326 >> v2:172.21.15.80:3300/0 conn(0x7f454015f100 0x7f454006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f453400f740 tx=0x7f453400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.501+0000 7f454621d700 1 --2- 172.21.15.80:0/3771653326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454015f100 0x7f454006bdb0 secure :-1 s=READY pgs=1546 cs=0 l=1 rx=0x7f453400f740 tx=0x7f453400fae0).ready entity=mon.0 client_cookie=932dd9b581ab317a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.501+0000 7f454621d700 1 --2- 172.21.15.80:0/3771653326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454015f100 0x7f454006bdb0 secure :-1 s=THROTTLE_DONE pgs=1546 cs=0 l=1 rx=0x7f453400f740 tx=0x7f453400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.501+0000 7f4545a1c700 1 -- 172.21.15.80:0/3771653326 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4534000960 con 0x7f454015f100 2019-11-28T11:41:28.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.501+0000 7f454621d700 1 --2- 172.21.15.80:0/3771653326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454015f100 0x7f454006bdb0 secure :-1 s=THROTTLE_DONE pgs=1546 cs=0 l=1 rx=0x7f453400f740 tx=0x7f453400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.501+0000 7f454621d700 1 --2- 172.21.15.80:0/3771653326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454015f100 0x7f454006bdb0 secure :-1 s=THROTTLE_DONE pgs=1546 cs=0 l=1 rx=0x7f453400f740 tx=0x7f453400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.501+0000 7f4545a1c700 1 -- 172.21.15.80:0/3771653326 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4534000c90 con 0x7f454015f100 2019-11-28T11:41:28.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.501+0000 7f4545a1c700 1 -- 172.21.15.80:0/3771653326 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45340013e0 con 0x7f454015f100 2019-11-28T11:41:28.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.501+0000 7f4548481700 1 -- 172.21.15.80:0/3771653326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454015f100 msgr2=0x7f454006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.501+0000 7f4548481700 1 --2- 172.21.15.80:0/3771653326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454015f100 0x7f454006bdb0 secure :-1 s=READY pgs=1546 cs=0 l=1 rx=0x7f453400f740 tx=0x7f453400fae0).stop 2019-11-28T11:41:28.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.502+0000 7f4548481700 1 -- 172.21.15.80:0/3771653326 shutdown_connections 2019-11-28T11:41:28.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.502+0000 7f4548481700 1 --2- 172.21.15.80:0/3771653326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454015f100 0x7f454006bdb0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.502+0000 7f4548481700 1 -- 172.21.15.80:0/3771653326 shutdown_connections 2019-11-28T11:41:28.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.502+0000 7f4548481700 1 -- 172.21.15.80:0/3771653326 wait complete. 2019-11-28T11:41:28.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.502+0000 7f4548481700 1 -- 172.21.15.80:0/3771653326 >> 172.21.15.80:0/3771653326 conn(0x7f4540061d40 msgr2=0x7f45400641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:28.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.504+0000 7f4548481700 1 Processor -- start 2019-11-28T11:41:28.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.504+0000 7f4548481700 1 -- start start 2019-11-28T11:41:28.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f4548481700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f454012e1a0 0x7f454012e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:28.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f4548481700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f454012eb70 0x7f4540105a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:28.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f4548481700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4540130b20 con 0x7f4540114f60 2019-11-28T11:41:28.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f4548481700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4540148b60 con 0x7f454012e1a0 2019-11-28T11:41:28.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f4548481700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4540148e30 con 0x7f454012eb70 2019-11-28T11:41:28.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f454621d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f454012e1a0 0x7f454012e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:28.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f454621d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f454012e1a0 0x7f454012e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39216/0 (socket says 172.21.15.80:39216) 2019-11-28T11:41:28.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f454621d700 1 -- 172.21.15.80:0/3244200012 learned_addr learned my addr 172.21.15.80:0/3244200012 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:28.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f454721f700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f454012eb70 0x7f4540105a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:28.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f454621d700 1 -- 172.21.15.80:0/3244200012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f454012eb70 msgr2=0x7f4540105a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f454621d700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f454012eb70 0x7f4540105a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f453f7fe700 1 -- 172.21.15.80:0/3244200012 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611716739 0 0) 0x7f4530001400 con 0x7f4540114f60 2019-11-28T11:41:28.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f454621d700 1 -- 172.21.15.80:0/3244200012 >> v1:172.21.15.174:6789/0 conn(0x7f4540114f60 legacy=0x7f4540106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f454621d700 1 -- 172.21.15.80:0/3244200012 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4540104390 con 0x7f454012e1a0 2019-11-28T11:41:28.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f454621d700 1 --2- 172.21.15.80:0/3244200012 >> v2:172.21.15.80:3300/0 conn(0x7f454012e1a0 0x7f454012e630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4534010440 tx=0x7f45340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f454621d700 1 --2- 172.21.15.80:0/3244200012 >> v2:172.21.15.80:3300/0 conn(0x7f454012e1a0 0x7f454012e630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4534010440 tx=0x7f45340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f454621d700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454012e1a0 0x7f454012e630 secure :-1 s=READY pgs=1547 cs=0 l=1 rx=0x7f4534010440 tx=0x7f45340102f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:28.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f454621d700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454012e1a0 0x7f454012e630 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7f4534010440 tx=0x7f45340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f453f7fe700 1 -- 172.21.15.80:0/3244200012 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4534000940 con 0x7f454012e1a0 2019-11-28T11:41:28.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f454621d700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454012e1a0 0x7f454012e630 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7f4534010440 tx=0x7f45340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f454621d700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454012e1a0 0x7f454012e630 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7f4534010440 tx=0x7f45340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f453f7fe700 1 -- 172.21.15.80:0/3244200012 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4534000f50 con 0x7f454012e1a0 2019-11-28T11:41:28.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f453f7fe700 1 -- 172.21.15.80:0/3244200012 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45340015a0 con 0x7f454012e1a0 2019-11-28T11:41:28.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.505+0000 7f4548481700 1 -- 172.21.15.80:0/3244200012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4540104710 con 0x7f454012e1a0 2019-11-28T11:41:28.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.506+0000 7f4548481700 1 -- 172.21.15.80:0/3244200012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4540104390 con 0x7f454012e1a0 2019-11-28T11:41:28.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.506+0000 7f454621d700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454012e1a0 0x7f454012e630 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7f4534010440 tx=0x7f45340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.506+0000 7f453f7fe700 1 -- 172.21.15.80:0/3244200012 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4534001140 con 0x7f454012e1a0 2019-11-28T11:41:28.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.506+0000 7f454621d700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454012e1a0 0x7f454012e630 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7f4534010440 tx=0x7f45340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.506+0000 7f453f7fe700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4520018730 0x7f452001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:28.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.506+0000 7f453f7fe700 1 -- 172.21.15.80:0/3244200012 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4534031a90 con 0x7f454012e1a0 2019-11-28T11:41:28.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.506+0000 7f4546a1e700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4520018730 0x7f452001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:28.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.507+0000 7f4546a1e700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4520018730 0x7f452001abc0 crc :-1 s=READY pgs=625 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:28.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.514+0000 7f4548481700 1 -- 172.21.15.80:0/3244200012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4540104710 con 0x7f454012e1a0 2019-11-28T11:41:28.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.518+0000 7f454621d700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454012e1a0 0x7f454012e630 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7f4534010440 tx=0x7f45340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.518+0000 7f453f7fe700 1 -- 172.21.15.80:0/3244200012 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f453402ffa0 con 0x7f454012e1a0 2019-11-28T11:41:28.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.687+0000 7f4548481700 1 -- 172.21.15.80:0/3244200012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4540104390 con 0x7f454012e1a0 2019-11-28T11:41:28.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.690+0000 7f454621d700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454012e1a0 0x7f454012e630 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7f4534010440 tx=0x7f45340102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.690+0000 7f453f7fe700 1 -- 172.21.15.80:0/3244200012 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v41) v1 ==== 184+0+0 (secure 0 0 0) 0x7f453402ffa0 con 0x7f454012e1a0 2019-11-28T11:41:28.726 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:41:28.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.692+0000 7f4548481700 1 -- 172.21.15.80:0/3244200012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4520018730 msgr2=0x7f452001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.692+0000 7f4548481700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4520018730 0x7f452001abc0 crc :-1 s=READY pgs=625 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.692+0000 7f4548481700 1 -- 172.21.15.80:0/3244200012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454012e1a0 msgr2=0x7f454012e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.692+0000 7f4548481700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454012e1a0 0x7f454012e630 secure :-1 s=READY pgs=1547 cs=0 l=1 rx=0x7f4534010440 tx=0x7f45340102f0).stop 2019-11-28T11:41:28.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.693+0000 7f4548481700 1 -- 172.21.15.80:0/3244200012 shutdown_connections 2019-11-28T11:41:28.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.693+0000 7f4548481700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f454012eb70 0x7f4540105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.693+0000 7f4548481700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f454012e1a0 0x7f454012e630 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.693+0000 7f4548481700 1 --2- 172.21.15.80:0/3244200012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4520018730 0x7f452001abc0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.693+0000 7f4548481700 1 -- 172.21.15.80:0/3244200012 shutdown_connections 2019-11-28T11:41:28.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.693+0000 7f4548481700 1 -- 172.21.15.80:0/3244200012 wait complete. 2019-11-28T11:41:28.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.693+0000 7f4548481700 1 -- 172.21.15.80:0/3244200012 >> 172.21.15.80:0/3244200012 conn(0x7f45401476e0 msgr2=0x7f454012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:28.735 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:41:28.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.870+0000 7f0e0a965700 1 Processor -- start 2019-11-28T11:41:28.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.870+0000 7f0e0a965700 1 -- start start 2019-11-28T11:41:28.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.871+0000 7f0e0a965700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e0415f100 0x7f0e0406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:28.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.871+0000 7f0e0a965700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0406db60 con 0x7f0e0415ed10 2019-11-28T11:41:28.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.871+0000 7f0e0a965700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0406e060 con 0x7f0e0406c2f0 2019-11-28T11:41:28.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.871+0000 7f0e0a965700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0406fe00 con 0x7f0e0415f100 2019-11-28T11:41:28.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e03fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e0415f100 0x7f0e0406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:28.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e08f02700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0e0415ed10 0x7f0e04073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38536/0 (socket says 172.21.15.80:38536) 2019-11-28T11:41:28.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e08f02700 1 -- 172.21.15.80:0/2926442562 learned_addr learned my addr 172.21.15.80:0/2926442562 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:28.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e03fff700 1 -- 172.21.15.80:0/2926442562 >> v1:172.21.15.174:6789/0 conn(0x7f0e0406c2f0 legacy=0x7f0e0406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e03fff700 1 -- 172.21.15.80:0/2926442562 >> v1:172.21.15.80:6789/0 conn(0x7f0e0415ed10 legacy=0x7f0e04073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e03fff700 1 -- 172.21.15.80:0/2926442562 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e04070760 con 0x7f0e0415f100 2019-11-28T11:41:28.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e037fe700 1 -- 172.21.15.80:0/2926442562 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557537302 0 0) 0x7f0dec001150 con 0x7f0e0415ed10 2019-11-28T11:41:28.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e03fff700 1 --2- 172.21.15.80:0/2926442562 >> v2:172.21.15.80:3300/0 conn(0x7f0e0415f100 0x7f0e0406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0df400af50 tx=0x7f0df400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e03fff700 1 --2- 172.21.15.80:0/2926442562 >> v2:172.21.15.80:3300/0 conn(0x7f0e0415f100 0x7f0e0406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0df400af50 tx=0x7f0df400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e03fff700 1 --2- 172.21.15.80:0/2926442562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e0415f100 0x7f0e0406bdb0 secure :-1 s=READY pgs=1549 cs=0 l=1 rx=0x7f0df400af50 tx=0x7f0df400b760).ready entity=mon.0 client_cookie=ff8f5796b9456eed server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:28.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e03fff700 1 --2- 172.21.15.80:0/2926442562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e0415f100 0x7f0e0406bdb0 secure :-1 s=THROTTLE_DONE pgs=1549 cs=0 l=1 rx=0x7f0df400af50 tx=0x7f0df400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e037fe700 1 -- 172.21.15.80:0/2926442562 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0df4000960 con 0x7f0e0415f100 2019-11-28T11:41:28.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e03fff700 1 --2- 172.21.15.80:0/2926442562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e0415f100 0x7f0e0406bdb0 secure :-1 s=THROTTLE_DONE pgs=1549 cs=0 l=1 rx=0x7f0df400af50 tx=0x7f0df400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e037fe700 1 -- 172.21.15.80:0/2926442562 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df4009860 con 0x7f0e0415f100 2019-11-28T11:41:28.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e03fff700 1 --2- 172.21.15.80:0/2926442562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e0415f100 0x7f0e0406bdb0 secure :-1 s=THROTTLE_DONE pgs=1549 cs=0 l=1 rx=0x7f0df400af50 tx=0x7f0df400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e037fe700 1 -- 172.21.15.80:0/2926442562 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0df4000960 con 0x7f0e0415f100 2019-11-28T11:41:28.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e0a965700 1 -- 172.21.15.80:0/2926442562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e0415f100 msgr2=0x7f0e0406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.872+0000 7f0e0a965700 1 --2- 172.21.15.80:0/2926442562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e0415f100 0x7f0e0406bdb0 secure :-1 s=READY pgs=1549 cs=0 l=1 rx=0x7f0df400af50 tx=0x7f0df400b760).stop 2019-11-28T11:41:28.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.873+0000 7f0e0a965700 1 -- 172.21.15.80:0/2926442562 shutdown_connections 2019-11-28T11:41:28.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.873+0000 7f0e0a965700 1 --2- 172.21.15.80:0/2926442562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e0415f100 0x7f0e0406bdb0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.873+0000 7f0e0a965700 1 -- 172.21.15.80:0/2926442562 shutdown_connections 2019-11-28T11:41:28.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.873+0000 7f0e0a965700 1 -- 172.21.15.80:0/2926442562 wait complete. 2019-11-28T11:41:28.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.873+0000 7f0e0a965700 1 -- 172.21.15.80:0/2926442562 >> 172.21.15.80:0/2926442562 conn(0x7f0e04061d40 msgr2=0x7f0e040641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.875+0000 7f0e0a965700 1 Processor -- start 2019-11-28T11:41:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.875+0000 7f0e0a965700 1 -- start start 2019-11-28T11:41:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.876+0000 7f0e0a965700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0e04101e80 0x7f0e0412ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.876+0000 7f0e0a965700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e04139d60 0x7f0e0413a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.876+0000 7f0e0a965700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e04115830 con 0x7f0e041273e0 2019-11-28T11:41:28.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.876+0000 7f0e0a965700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e04137f90 con 0x7f0e04101e80 2019-11-28T11:41:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.876+0000 7f0e0a965700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e04113e00 con 0x7f0e04139d60 2019-11-28T11:41:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e03fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0e04101e80 0x7f0e0412ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e09703700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e04139d60 0x7f0e0413a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e03fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0e04101e80 0x7f0e0412ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:54114/0 (socket says 172.21.15.80:54114) 2019-11-28T11:41:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e03fff700 1 -- 172.21.15.80:0/1472178948 learned_addr learned my addr 172.21.15.80:0/1472178948 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e09703700 1 -- 172.21.15.80:0/1472178948 >> v2:172.21.15.174:3300/0 conn(0x7f0e04101e80 msgr2=0x7f0e0412ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e09703700 1 --2- 172.21.15.80:0/1472178948 >> v2:172.21.15.174:3300/0 conn(0x7f0e04101e80 0x7f0e0412ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:28.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e09703700 1 -- 172.21.15.80:0/1472178948 >> v1:172.21.15.174:6789/0 conn(0x7f0e041273e0 legacy=0x7f0e04114970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:28.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e09703700 1 -- 172.21.15.80:0/1472178948 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e04138620 con 0x7f0e04139d60 2019-11-28T11:41:28.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e09703700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e04139d60 0x7f0e0413a190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0dfc010730 tx=0x7f0dfc00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e09703700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e04139d60 0x7f0e0413a190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0dfc010730 tx=0x7f0dfc00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e09703700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e04139d60 0x7f0e0413a190 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f0dfc010730 tx=0x7f0dfc00b670).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:28.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e09703700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e04139d60 0x7f0e0413a190 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f0dfc010730 tx=0x7f0dfc00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e09703700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e04139d60 0x7f0e0413a190 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f0dfc010730 tx=0x7f0dfc00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e017fa700 1 -- 172.21.15.80:0/1472178948 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dfc000ce0 con 0x7f0e04139d60 2019-11-28T11:41:28.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e09703700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e04139d60 0x7f0e0413a190 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f0dfc010730 tx=0x7f0dfc00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e017fa700 1 -- 172.21.15.80:0/1472178948 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc009ba0 con 0x7f0e04139d60 2019-11-28T11:41:28.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e0a965700 1 -- 172.21.15.80:0/1472178948 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e041389a0 con 0x7f0e04139d60 2019-11-28T11:41:28.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e017fa700 1 -- 172.21.15.80:0/1472178948 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dfc00a2f0 con 0x7f0e04139d60 2019-11-28T11:41:28.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.877+0000 7f0e0a965700 1 -- 172.21.15.80:0/1472178948 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e04138620 con 0x7f0e04139d60 2019-11-28T11:41:28.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.878+0000 7f0e09703700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e04139d60 0x7f0e0413a190 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f0dfc010730 tx=0x7f0dfc00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.878+0000 7f0e017fa700 1 -- 172.21.15.80:0/1472178948 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0dfc009d90 con 0x7f0e04139d60 2019-11-28T11:41:28.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.878+0000 7f0e09703700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e04139d60 0x7f0e0413a190 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f0dfc010730 tx=0x7f0dfc00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.878+0000 7f0e017fa700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0de8018730 0x7f0de801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:28.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.878+0000 7f0e017fa700 1 -- 172.21.15.80:0/1472178948 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0dfc031d70 con 0x7f0e04139d60 2019-11-28T11:41:28.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.878+0000 7f0e08f02700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0de8018730 0x7f0de801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:28.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.878+0000 7f0e08f02700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0de8018730 0x7f0de801abc0 crc :-1 s=READY pgs=626 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:28.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.886+0000 7f0e0a965700 1 -- 172.21.15.80:0/1472178948 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e041389a0 con 0x7f0e04139d60 2019-11-28T11:41:28.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.890+0000 7f0e09703700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e04139d60 0x7f0e0413a190 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f0dfc010730 tx=0x7f0dfc00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:28.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:28.890+0000 7f0e017fa700 1 -- 172.21.15.80:0/1472178948 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0dfc0075a0 con 0x7f0e04139d60 2019-11-28T11:41:29.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.058+0000 7f0e0a965700 1 -- 172.21.15.80:0/1472178948 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0e04138620 con 0x7f0e04139d60 2019-11-28T11:41:29.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.065+0000 7f0e09703700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e04139d60 0x7f0e0413a190 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f0dfc010730 tx=0x7f0dfc00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.065+0000 7f0e017fa700 1 -- 172.21.15.80:0/1472178948 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v42) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0dfc0176f0 con 0x7f0e04139d60 2019-11-28T11:41:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:41:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.075+0000 7f0e0a965700 1 -- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0de8018730 msgr2=0x7f0de801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:29.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.075+0000 7f0e0a965700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0de8018730 0x7f0de801abc0 crc :-1 s=READY pgs=626 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:29.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.076+0000 7f0e0a965700 1 -- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e04139d60 msgr2=0x7f0e0413a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:29.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.076+0000 7f0e0a965700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e04139d60 0x7f0e0413a190 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f0dfc010730 tx=0x7f0dfc00b670).stop 2019-11-28T11:41:29.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.076+0000 7f0e0a965700 1 -- 172.21.15.80:0/1472178948 shutdown_connections 2019-11-28T11:41:29.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.076+0000 7f0e0a965700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e04139d60 0x7f0e0413a190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:29.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.076+0000 7f0e0a965700 1 --2- 172.21.15.80:0/1472178948 >> v2:172.21.15.174:3300/0 conn(0x7f0e04101e80 0x7f0e0412ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:29.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.076+0000 7f0e0a965700 1 --2- 172.21.15.80:0/1472178948 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0de8018730 0x7f0de801abc0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:29.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.076+0000 7f0e0a965700 1 -- 172.21.15.80:0/1472178948 shutdown_connections 2019-11-28T11:41:29.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.076+0000 7f0e0a965700 1 -- 172.21.15.80:0/1472178948 wait complete. 2019-11-28T11:41:29.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.076+0000 7f0e0a965700 1 -- 172.21.15.80:0/1472178948 >> 172.21.15.80:0/1472178948 conn(0x7f0e04166610 msgr2=0x7f0e041473d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:29.123 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:41:29.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.223+0000 7fe3f7934700 1 Processor -- start 2019-11-28T11:41:29.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.223+0000 7fe3f7934700 1 -- start start 2019-11-28T11:41:29.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.224+0000 7fe3f7934700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3f015ed10 0x7fe3f015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:29.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.224+0000 7fe3f7934700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f00734b0 0x7fe3f00726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:29.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.224+0000 7fe3f7934700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f006db60 con 0x7fe3f0073020 2019-11-28T11:41:29.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.224+0000 7fe3f7934700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f006fe00 con 0x7fe3f015ed10 2019-11-28T11:41:29.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.224+0000 7fe3f7934700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f00700d0 con 0x7fe3f00734b0 2019-11-28T11:41:29.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.224+0000 7fe3f5ed1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3f015ed10 0x7fe3f015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:29.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f5ed1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3f015ed10 0x7fe3f015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39234/0 (socket says 172.21.15.80:39234) 2019-11-28T11:41:29.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f5ed1700 1 -- 172.21.15.80:0/2507624387 learned_addr learned my addr 172.21.15.80:0/2507624387 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:29.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f66d2700 1 --2- 172.21.15.80:0/2507624387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f00734b0 0x7fe3f00726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:29.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f5ed1700 1 -- 172.21.15.80:0/2507624387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f00734b0 msgr2=0x7fe3f00726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:29.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f5ed1700 1 --2- 172.21.15.80:0/2507624387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f00734b0 0x7fe3f00726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:29.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f5ed1700 1 -- 172.21.15.80:0/2507624387 >> v1:172.21.15.174:6789/0 conn(0x7fe3f0073020 legacy=0x7fe3f0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:29.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f5ed1700 1 -- 172.21.15.80:0/2507624387 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f0070760 con 0x7fe3f015ed10 2019-11-28T11:41:29.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f5ed1700 1 --2- 172.21.15.80:0/2507624387 >> v2:172.21.15.80:3300/0 conn(0x7fe3f015ed10 0x7fe3f015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe3d800fac0 tx=0x7fe3d800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f5ed1700 1 --2- 172.21.15.80:0/2507624387 >> v2:172.21.15.80:3300/0 conn(0x7fe3f015ed10 0x7fe3f015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe3d800fac0 tx=0x7fe3d800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f5ed1700 1 --2- 172.21.15.80:0/2507624387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3f015ed10 0x7fe3f015f100 secure :-1 s=READY pgs=1550 cs=0 l=1 rx=0x7fe3d800fac0 tx=0x7fe3d800f8f0).ready entity=mon.0 client_cookie=ff5d9779b5950f58 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:29.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f5ed1700 1 --2- 172.21.15.80:0/2507624387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3f015ed10 0x7fe3f015f100 secure :-1 s=THROTTLE_DONE pgs=1550 cs=0 l=1 rx=0x7fe3d800fac0 tx=0x7fe3d800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f4ecf700 1 -- 172.21.15.80:0/2507624387 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3d8000ce0 con 0x7fe3f015ed10 2019-11-28T11:41:29.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f5ed1700 1 --2- 172.21.15.80:0/2507624387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3f015ed10 0x7fe3f015f100 secure :-1 s=THROTTLE_DONE pgs=1550 cs=0 l=1 rx=0x7fe3d800fac0 tx=0x7fe3d800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f5ed1700 1 --2- 172.21.15.80:0/2507624387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3f015ed10 0x7fe3f015f100 secure :-1 s=THROTTLE_DONE pgs=1550 cs=0 l=1 rx=0x7fe3d800fac0 tx=0x7fe3d800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f4ecf700 1 -- 172.21.15.80:0/2507624387 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d8001010 con 0x7fe3f015ed10 2019-11-28T11:41:29.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f4ecf700 1 -- 172.21.15.80:0/2507624387 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3d8001720 con 0x7fe3f015ed10 2019-11-28T11:41:29.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f7934700 1 -- 172.21.15.80:0/2507624387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3f015ed10 msgr2=0x7fe3f015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:29.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.225+0000 7fe3f7934700 1 --2- 172.21.15.80:0/2507624387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3f015ed10 0x7fe3f015f100 secure :-1 s=READY pgs=1550 cs=0 l=1 rx=0x7fe3d800fac0 tx=0x7fe3d800f8f0).stop 2019-11-28T11:41:29.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.226+0000 7fe3f7934700 1 -- 172.21.15.80:0/2507624387 shutdown_connections 2019-11-28T11:41:29.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.226+0000 7fe3f7934700 1 --2- 172.21.15.80:0/2507624387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f00734b0 0x7fe3f00726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:29.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.226+0000 7fe3f7934700 1 --2- 172.21.15.80:0/2507624387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3f015ed10 0x7fe3f015f100 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:29.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.226+0000 7fe3f7934700 1 -- 172.21.15.80:0/2507624387 shutdown_connections 2019-11-28T11:41:29.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.226+0000 7fe3f7934700 1 -- 172.21.15.80:0/2507624387 wait complete. 2019-11-28T11:41:29.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.226+0000 7fe3f7934700 1 -- 172.21.15.80:0/2507624387 >> 172.21.15.80:0/2507624387 conn(0x7fe3f0061d40 msgr2=0x7fe3f00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:29.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.228+0000 7fe3f7934700 1 Processor -- start 2019-11-28T11:41:29.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.229+0000 7fe3f7934700 1 -- start start 2019-11-28T11:41:29.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.229+0000 7fe3f7934700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f012e1a0 0x7fe3f012e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:29.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.229+0000 7fe3f7934700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe3f012eb70 0x7fe3f0105a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:29.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.229+0000 7fe3f7934700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f0130b20 con 0x7fe3f0114f60 2019-11-28T11:41:29.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.229+0000 7fe3f7934700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f0148b60 con 0x7fe3f012eb70 2019-11-28T11:41:29.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.229+0000 7fe3f7934700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f0148e30 con 0x7fe3f012e1a0 2019-11-28T11:41:29.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f5ed1700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe3f0114f60 0x7fe3f0106b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:54100/0 (socket says 172.21.15.80:54100) 2019-11-28T11:41:29.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f5ed1700 1 -- 172.21.15.80:0/702666247 learned_addr learned my addr 172.21.15.80:0/702666247 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:29.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f56d0700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f012e1a0 0x7fe3f012e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:29.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f66d2700 1 --2- 172.21.15.80:0/702666247 >> v2:172.21.15.174:3300/0 conn(0x7fe3f012eb70 0x7fe3f0105a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:29.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3ee7fc700 1 -- 172.21.15.80:0/702666247 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008352856 0 0) 0x7fe3d80083f0 con 0x7fe3f0114f60 2019-11-28T11:41:29.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3ee7fc700 1 -- 172.21.15.80:0/702666247 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3d4002e80 con 0x7fe3f0114f60 2019-11-28T11:41:29.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f56d0700 1 -- 172.21.15.80:0/702666247 >> v2:172.21.15.174:3300/0 conn(0x7fe3f012eb70 msgr2=0x7fe3f0105a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:29.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f56d0700 1 --2- 172.21.15.80:0/702666247 >> v2:172.21.15.174:3300/0 conn(0x7fe3f012eb70 0x7fe3f0105a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:29.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f56d0700 1 -- 172.21.15.80:0/702666247 >> v1:172.21.15.174:6789/0 conn(0x7fe3f0114f60 legacy=0x7fe3f0106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:29.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f56d0700 1 -- 172.21.15.80:0/702666247 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f0104390 con 0x7fe3f012e1a0 2019-11-28T11:41:29.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f66d2700 1 --2- 172.21.15.80:0/702666247 >> v2:172.21.15.174:3300/0 conn(0x7fe3f012eb70 0x7fe3f0105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:29.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f56d0700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f012e1a0 0x7fe3f012e630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe3e00103a0 tx=0x7fe3e0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f56d0700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f012e1a0 0x7fe3f012e630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe3e00103a0 tx=0x7fe3e0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f56d0700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f012e1a0 0x7fe3f012e630 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7fe3e00103a0 tx=0x7fe3e0010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:29.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f56d0700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f012e1a0 0x7fe3f012e630 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fe3e00103a0 tx=0x7fe3e0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3ee7fc700 1 -- 172.21.15.80:0/702666247 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3e00099d0 con 0x7fe3f012e1a0 2019-11-28T11:41:29.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f56d0700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f012e1a0 0x7fe3f012e630 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fe3e00103a0 tx=0x7fe3e0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f56d0700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f012e1a0 0x7fe3f012e630 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fe3e00103a0 tx=0x7fe3e0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3ee7fc700 1 -- 172.21.15.80:0/702666247 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e0009bd0 con 0x7fe3f012e1a0 2019-11-28T11:41:29.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f7934700 1 -- 172.21.15.80:0/702666247 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f0104710 con 0x7fe3f012e1a0 2019-11-28T11:41:29.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3ee7fc700 1 -- 172.21.15.80:0/702666247 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3e0009dc0 con 0x7fe3f012e1a0 2019-11-28T11:41:29.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.230+0000 7fe3f7934700 1 -- 172.21.15.80:0/702666247 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f0104390 con 0x7fe3f012e1a0 2019-11-28T11:41:29.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.231+0000 7fe3f56d0700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f012e1a0 0x7fe3f012e630 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fe3e00103a0 tx=0x7fe3e0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.231+0000 7fe3ee7fc700 1 -- 172.21.15.80:0/702666247 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe3e0009dc0 con 0x7fe3f012e1a0 2019-11-28T11:41:29.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.231+0000 7fe3f56d0700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f012e1a0 0x7fe3f012e630 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fe3e00103a0 tx=0x7fe3e0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.231+0000 7fe3ee7fc700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe3d4018770 0x7fe3d401ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:29.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.231+0000 7fe3ee7fc700 1 -- 172.21.15.80:0/702666247 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe3e0031c20 con 0x7fe3f012e1a0 2019-11-28T11:41:29.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.231+0000 7fe3f5ed1700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe3d4018770 0x7fe3d401ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:29.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.231+0000 7fe3f5ed1700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe3d4018770 0x7fe3d401ac00 crc :-1 s=READY pgs=627 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:29.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.238+0000 7fe3f7934700 1 -- 172.21.15.80:0/702666247 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f0104710 con 0x7fe3f012e1a0 2019-11-28T11:41:29.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.242+0000 7fe3f56d0700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f012e1a0 0x7fe3f012e630 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fe3e00103a0 tx=0x7fe3e0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.242+0000 7fe3ee7fc700 1 -- 172.21.15.80:0/702666247 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe3e00095d0 con 0x7fe3f012e1a0 2019-11-28T11:41:29.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.415+0000 7fe3f7934700 1 -- 172.21.15.80:0/702666247 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fe3f0104390 con 0x7fe3f012e1a0 2019-11-28T11:41:29.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.421+0000 7fe3f56d0700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f012e1a0 0x7fe3f012e630 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fe3e00103a0 tx=0x7fe3e0010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.421+0000 7fe3ee7fc700 1 -- 172.21.15.80:0/702666247 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v43) v1 ==== 184+0+0 (secure 0 0 0) 0x7fe3e0009d10 con 0x7fe3f012e1a0 2019-11-28T11:41:29.454 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:41:29.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.424+0000 7fe3f7934700 1 -- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe3d4018770 msgr2=0x7fe3d401ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:29.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.424+0000 7fe3f7934700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe3d4018770 0x7fe3d401ac00 crc :-1 s=READY pgs=627 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:29.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.424+0000 7fe3f7934700 1 -- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f012e1a0 msgr2=0x7fe3f012e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:29.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.424+0000 7fe3f7934700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f012e1a0 0x7fe3f012e630 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7fe3e00103a0 tx=0x7fe3e0010740).stop 2019-11-28T11:41:29.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.425+0000 7fe3f7934700 1 -- 172.21.15.80:0/702666247 shutdown_connections 2019-11-28T11:41:29.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.425+0000 7fe3f7934700 1 --2- 172.21.15.80:0/702666247 >> v2:172.21.15.174:3300/0 conn(0x7fe3f012eb70 0x7fe3f0105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:29.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.425+0000 7fe3f7934700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3f012e1a0 0x7fe3f012e630 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:29.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.425+0000 7fe3f7934700 1 --2- 172.21.15.80:0/702666247 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe3d4018770 0x7fe3d401ac00 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:29.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.425+0000 7fe3f7934700 1 -- 172.21.15.80:0/702666247 shutdown_connections 2019-11-28T11:41:29.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.425+0000 7fe3f7934700 1 -- 172.21.15.80:0/702666247 wait complete. 2019-11-28T11:41:29.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.425+0000 7fe3f7934700 1 -- 172.21.15.80:0/702666247 >> 172.21.15.80:0/702666247 conn(0x7fe3f01476e0 msgr2=0x7fe3f012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:29.468 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:41:29.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.554+0000 7f0570d28700 1 Processor -- start 2019-11-28T11:41:29.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.554+0000 7f0570d28700 1 -- start start 2019-11-28T11:41:29.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.555+0000 7f0570d28700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f056c06c490 0x7f056c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:29.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.555+0000 7f0570d28700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056c06db00 con 0x7f056c06c0a0 2019-11-28T11:41:29.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.555+0000 7f0570d28700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056c06e000 con 0x7f056c06ce60 2019-11-28T11:41:29.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.555+0000 7f0570d28700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c06fd60 con 0x7f056c06c490 2019-11-28T11:41:29.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.555+0000 7f056ad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f056c06c0a0 0x7f056c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38564/0 (socket says 172.21.15.80:38564) 2019-11-28T11:41:29.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.555+0000 7f056ad9d700 1 -- 172.21.15.80:0/2469619988 learned_addr learned my addr 172.21.15.80:0/2469619988 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:29.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.555+0000 7f056a59c700 1 --2- 172.21.15.80:0/2469619988 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f056c06c490 0x7f056c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:29.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f0569d9b700 1 -- 172.21.15.80:0/2469619988 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696762836 0 0) 0x7f0560001150 con 0x7f056c06c0a0 2019-11-28T11:41:29.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f0569d9b700 1 -- 172.21.15.80:0/2469619988 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0554002e80 con 0x7f056c06c0a0 2019-11-28T11:41:29.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f0569d9b700 1 -- 172.21.15.80:0/2469619988 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633653866 0 0) 0x7f0564000d30 con 0x7f056c06ce60 2019-11-28T11:41:29.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f0569d9b700 1 -- 172.21.15.80:0/2469619988 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0554004170 con 0x7f056c06ce60 2019-11-28T11:41:29.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f056a59c700 1 -- 172.21.15.80:0/2469619988 >> v1:172.21.15.174:6789/0 conn(0x7f056c06ce60 legacy=0x7f056c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:29.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f056a59c700 1 -- 172.21.15.80:0/2469619988 >> v1:172.21.15.80:6789/0 conn(0x7f056c06c0a0 legacy=0x7f056c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:29.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f056a59c700 1 -- 172.21.15.80:0/2469619988 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c0706c0 con 0x7f056c06c490 2019-11-28T11:41:29.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f056a59c700 1 --2- 172.21.15.80:0/2469619988 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f056c06c490 0x7f056c06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f055c00af50 tx=0x7f055c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f056a59c700 1 --2- 172.21.15.80:0/2469619988 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f056c06c490 0x7f056c06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f055c00af50 tx=0x7f055c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f056a59c700 1 --2- 172.21.15.80:0/2469619988 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f056c06c490 0x7f056c06c920 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f055c00af50 tx=0x7f055c00b760).ready entity=mon.2 client_cookie=a6c5fad28496f09b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f056a59c700 1 --2- 172.21.15.80:0/2469619988 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f056c06c490 0x7f056c06c920 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f055c00af50 tx=0x7f055c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f0569d9b700 1 -- 172.21.15.80:0/2469619988 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f055c000960 con 0x7f056c06c490 2019-11-28T11:41:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f056a59c700 1 --2- 172.21.15.80:0/2469619988 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f056c06c490 0x7f056c06c920 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f055c00af50 tx=0x7f055c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f056a59c700 1 --2- 172.21.15.80:0/2469619988 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f056c06c490 0x7f056c06c920 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f055c00af50 tx=0x7f055c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f0569d9b700 1 -- 172.21.15.80:0/2469619988 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c009860 con 0x7f056c06c490 2019-11-28T11:41:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f0569d9b700 1 -- 172.21.15.80:0/2469619988 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f055c009f30 con 0x7f056c06c490 2019-11-28T11:41:29.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f0570d28700 1 -- 172.21.15.80:0/2469619988 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f056c06c490 msgr2=0x7f056c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:29.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.556+0000 7f0570d28700 1 --2- 172.21.15.80:0/2469619988 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f056c06c490 0x7f056c06c920 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f055c00af50 tx=0x7f055c00b760).stop 2019-11-28T11:41:29.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.557+0000 7f0570d28700 1 -- 172.21.15.80:0/2469619988 shutdown_connections 2019-11-28T11:41:29.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.557+0000 7f0570d28700 1 --2- 172.21.15.80:0/2469619988 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f056c06c490 0x7f056c06c920 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:29.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.557+0000 7f0570d28700 1 -- 172.21.15.80:0/2469619988 shutdown_connections 2019-11-28T11:41:29.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.557+0000 7f0570d28700 1 -- 172.21.15.80:0/2469619988 wait complete. 2019-11-28T11:41:29.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.557+0000 7f0570d28700 1 -- 172.21.15.80:0/2469619988 >> 172.21.15.80:0/2469619988 conn(0x7f056c061cf0 msgr2=0x7f056c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:29.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.560+0000 7f0570d28700 1 Processor -- start 2019-11-28T11:41:29.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.560+0000 7f0570d28700 1 -- start start 2019-11-28T11:41:29.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.560+0000 7f0570d28700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f056c135760 0x7f056c137480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:29.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.560+0000 7f0570d28700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056c136480 con 0x7f056c1330b0 2019-11-28T11:41:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.560+0000 7f0570d28700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056c1033c0 con 0x7f056c12a150 2019-11-28T11:41:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.560+0000 7f0570d28700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c104370 con 0x7f056c135760 2019-11-28T11:41:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f056ad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f056c135760 0x7f056c137480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f056ad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f056c135760 0x7f056c137480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39254/0 (socket says 172.21.15.80:39254) 2019-11-28T11:41:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f056ad9d700 1 -- 172.21.15.80:0/1016030225 learned_addr learned my addr 172.21.15.80:0/1016030225 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f056ad9d700 1 -- 172.21.15.80:0/1016030225 >> v1:172.21.15.174:6789/0 conn(0x7f056c12a150 legacy=0x7f056c12a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f056ad9d700 1 -- 172.21.15.80:0/1016030225 >> v1:172.21.15.80:6789/0 conn(0x7f056c1330b0 legacy=0x7f056c133550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:29.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f056ad9d700 1 -- 172.21.15.80:0/1016030225 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c104a00 con 0x7f056c135760 2019-11-28T11:41:29.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f056ad9d700 1 --2- 172.21.15.80:0/1016030225 >> v2:172.21.15.80:3300/0 conn(0x7f056c135760 0x7f056c137480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05600103e0 tx=0x7f0560010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f056ad9d700 1 --2- 172.21.15.80:0/1016030225 >> v2:172.21.15.80:3300/0 conn(0x7f056c135760 0x7f056c137480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05600103e0 tx=0x7f0560010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f056ad9d700 1 --2- 172.21.15.80:0/1016030225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f056c135760 0x7f056c137480 secure :-1 s=READY pgs=1553 cs=0 l=1 rx=0x7f05600103e0 tx=0x7f0560010780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:29.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f056ad9d700 1 --2- 172.21.15.80:0/1016030225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f056c135760 0x7f056c137480 secure :-1 s=THROTTLE_DONE pgs=1553 cs=0 l=1 rx=0x7f05600103e0 tx=0x7f0560010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f055b7fe700 1 -- 172.21.15.80:0/1016030225 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0560000c90 con 0x7f056c135760 2019-11-28T11:41:29.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f056ad9d700 1 --2- 172.21.15.80:0/1016030225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f056c135760 0x7f056c137480 secure :-1 s=THROTTLE_DONE pgs=1553 cs=0 l=1 rx=0x7f05600103e0 tx=0x7f0560010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f056ad9d700 1 --2- 172.21.15.80:0/1016030225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f056c135760 0x7f056c137480 secure :-1 s=THROTTLE_DONE pgs=1553 cs=0 l=1 rx=0x7f05600103e0 tx=0x7f0560010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f055b7fe700 1 -- 172.21.15.80:0/1016030225 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05600010c0 con 0x7f056c135760 2019-11-28T11:41:29.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f0570d28700 1 -- 172.21.15.80:0/1016030225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c104d80 con 0x7f056c135760 2019-11-28T11:41:29.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f055b7fe700 1 -- 172.21.15.80:0/1016030225 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05600017d0 con 0x7f056c135760 2019-11-28T11:41:29.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f0570d28700 1 -- 172.21.15.80:0/1016030225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c104a00 con 0x7f056c135760 2019-11-28T11:41:29.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.561+0000 7f056ad9d700 1 --2- 172.21.15.80:0/1016030225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f056c135760 0x7f056c137480 secure :-1 s=THROTTLE_DONE pgs=1553 cs=0 l=1 rx=0x7f05600103e0 tx=0x7f0560010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.562+0000 7f055b7fe700 1 -- 172.21.15.80:0/1016030225 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0560000c90 con 0x7f056c135760 2019-11-28T11:41:29.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.562+0000 7f056ad9d700 1 --2- 172.21.15.80:0/1016030225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f056c135760 0x7f056c137480 secure :-1 s=THROTTLE_DONE pgs=1553 cs=0 l=1 rx=0x7f05600103e0 tx=0x7f0560010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.562+0000 7f055b7fe700 1 --2- 172.21.15.80:0/1016030225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0550018730 0x7f055001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:29.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.562+0000 7f055b7fe700 1 -- 172.21.15.80:0/1016030225 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0560031d50 con 0x7f056c135760 2019-11-28T11:41:29.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.562+0000 7f056a59c700 1 --2- 172.21.15.80:0/1016030225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0550018730 0x7f055001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:29.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.562+0000 7f056a59c700 1 --2- 172.21.15.80:0/1016030225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0550018730 0x7f055001abc0 crc :-1 s=READY pgs=628 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:29.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.569+0000 7f0570d28700 1 -- 172.21.15.80:0/1016030225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c104d80 con 0x7f056c135760 2019-11-28T11:41:29.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.573+0000 7f056ad9d700 1 --2- 172.21.15.80:0/1016030225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f056c135760 0x7f056c137480 secure :-1 s=THROTTLE_DONE pgs=1553 cs=0 l=1 rx=0x7f05600103e0 tx=0x7f0560010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.573+0000 7f055b7fe700 1 -- 172.21.15.80:0/1016030225 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f05600075d0 con 0x7f056c135760 2019-11-28T11:41:29.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.746+0000 7f0570d28700 1 -- 172.21.15.80:0/1016030225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f056c104a00 con 0x7f056c135760 2019-11-28T11:41:29.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.746+0000 7f056ad9d700 1 --2- 172.21.15.80:0/1016030225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f056c135760 0x7f056c137480 secure :-1 s=THROTTLE_DONE pgs=1553 cs=0 l=1 rx=0x7f05600103e0 tx=0x7f0560010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:29.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.746+0000 7f055b7fe700 1 -- 172.21.15.80:0/1016030225 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+1424 (secure 0 0 0) 0x7f0560017b80 con 0x7f056c135760 2019-11-28T11:41:29.781 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 81 2019-11-28T11:41:29.781 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:29.781 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:25.297182+0000","modified":"2019-11-28T11:41:27.300122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2019-11-28T11:41:29.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.749+0000 7f0570d28700 1 -- 172.21.15.80:0/1016030225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0550018730 msgr2=0x7f055001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:29.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.749+0000 7f0570d28700 1 --2- 172.21.15.80:0/1016030225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0550018730 0x7f055001abc0 crc :-1 s=READY pgs=628 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:29.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.749+0000 7f0570d28700 1 -- 172.21.15.80:0/1016030225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f056c135760 msgr2=0x7f056c137480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:29.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.749+0000 7f0570d28700 1 --2- 172.21.15.80:0/1016030225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f056c135760 0x7f056c137480 secure :-1 s=READY pgs=1553 cs=0 l=1 rx=0x7f05600103e0 tx=0x7f0560010780).stop 2019-11-28T11:41:29.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.749+0000 7f0570d28700 1 -- 172.21.15.80:0/1016030225 shutdown_connections 2019-11-28T11:41:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.749+0000 7f0570d28700 1 --2- 172.21.15.80:0/1016030225 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0550018730 0x7f055001abc0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.749+0000 7f0570d28700 1 --2- 172.21.15.80:0/1016030225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f056c135760 0x7f056c137480 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.749+0000 7f0570d28700 1 -- 172.21.15.80:0/1016030225 shutdown_connections 2019-11-28T11:41:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.749+0000 7f0570d28700 1 -- 172.21.15.80:0/1016030225 wait complete. 2019-11-28T11:41:29.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:29.749+0000 7f0570d28700 1 -- 172.21.15.80:0/1016030225 >> 172.21.15.80:0/1016030225 conn(0x7f056c13d930 msgr2=0x7f056c102360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:30.095 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 18, u'failed': [], u'epoch': 81, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [19], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:41:25.297182+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:41:27.300122+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:41:30.096 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:41:31.107 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:41:31.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.202+0000 7f51c0865700 1 Processor -- start 2019-11-28T11:41:31.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.202+0000 7f51c0865700 1 -- start start 2019-11-28T11:41:31.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.203+0000 7f51c0865700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f51bc06c490 0x7f51bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:31.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.203+0000 7f51c0865700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc06db00 con 0x7f51bc06c0a0 2019-11-28T11:41:31.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.203+0000 7f51c0865700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc06e000 con 0x7f51bc06ce60 2019-11-28T11:41:31.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.203+0000 7f51c0865700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc06fd60 con 0x7f51bc06c490 2019-11-28T11:41:31.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.203+0000 7f51ba59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f51bc06c490 0x7f51bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:31.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.203+0000 7f51bad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f51bc06c0a0 0x7f51bc072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38578/0 (socket says 172.21.15.80:38578) 2019-11-28T11:41:31.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.203+0000 7f51bad9d700 1 -- 172.21.15.80:0/554612190 learned_addr learned my addr 172.21.15.80:0/554612190 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:31.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.203+0000 7f51ba59c700 1 -- 172.21.15.80:0/554612190 >> v1:172.21.15.174:6789/0 conn(0x7f51bc06ce60 legacy=0x7f51bc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:31.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.203+0000 7f51ba59c700 1 -- 172.21.15.80:0/554612190 >> v1:172.21.15.80:6789/0 conn(0x7f51bc06c0a0 legacy=0x7f51bc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:31.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.203+0000 7f51ba59c700 1 -- 172.21.15.80:0/554612190 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc0706c0 con 0x7f51bc06c490 2019-11-28T11:41:31.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.203+0000 7f51b9d9b700 1 -- 172.21.15.80:0/554612190 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749070180 0 0) 0x7f51ac0014d0 con 0x7f51bc06c0a0 2019-11-28T11:41:31.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.204+0000 7f51ba59c700 1 --2- 172.21.15.80:0/554612190 >> v2:172.21.15.80:3300/0 conn(0x7f51bc06c490 0x7f51bc06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f51b000af50 tx=0x7f51b000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:31.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.204+0000 7f51ba59c700 1 --2- 172.21.15.80:0/554612190 >> v2:172.21.15.80:3300/0 conn(0x7f51bc06c490 0x7f51bc06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f51b000af50 tx=0x7f51b000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:31.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.204+0000 7f51ba59c700 1 --2- 172.21.15.80:0/554612190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51bc06c490 0x7f51bc06c920 secure :-1 s=READY pgs=1555 cs=0 l=1 rx=0x7f51b000af50 tx=0x7f51b000b760).ready entity=mon.0 client_cookie=f1dfb0ac6215219a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:31.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.204+0000 7f51ba59c700 1 --2- 172.21.15.80:0/554612190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51bc06c490 0x7f51bc06c920 secure :-1 s=THROTTLE_DONE pgs=1555 cs=0 l=1 rx=0x7f51b000af50 tx=0x7f51b000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:31.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.204+0000 7f51b9d9b700 1 -- 172.21.15.80:0/554612190 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51b0000960 con 0x7f51bc06c490 2019-11-28T11:41:31.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.204+0000 7f51ba59c700 1 --2- 172.21.15.80:0/554612190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51bc06c490 0x7f51bc06c920 secure :-1 s=THROTTLE_DONE pgs=1555 cs=0 l=1 rx=0x7f51b000af50 tx=0x7f51b000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:31.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.204+0000 7f51b9d9b700 1 -- 172.21.15.80:0/554612190 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b0000960 con 0x7f51bc06c490 2019-11-28T11:41:31.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.204+0000 7f51ba59c700 1 --2- 172.21.15.80:0/554612190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51bc06c490 0x7f51bc06c920 secure :-1 s=THROTTLE_DONE pgs=1555 cs=0 l=1 rx=0x7f51b000af50 tx=0x7f51b000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:31.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.204+0000 7f51b9d9b700 1 -- 172.21.15.80:0/554612190 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51b0009ce0 con 0x7f51bc06c490 2019-11-28T11:41:31.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.204+0000 7f51c0865700 1 -- 172.21.15.80:0/554612190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51bc06c490 msgr2=0x7f51bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:31.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.204+0000 7f51c0865700 1 --2- 172.21.15.80:0/554612190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51bc06c490 0x7f51bc06c920 secure :-1 s=READY pgs=1555 cs=0 l=1 rx=0x7f51b000af50 tx=0x7f51b000b760).stop 2019-11-28T11:41:31.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.205+0000 7f51c0865700 1 -- 172.21.15.80:0/554612190 shutdown_connections 2019-11-28T11:41:31.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.205+0000 7f51c0865700 1 --2- 172.21.15.80:0/554612190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51bc06c490 0x7f51bc06c920 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:31.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.205+0000 7f51c0865700 1 -- 172.21.15.80:0/554612190 shutdown_connections 2019-11-28T11:41:31.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.205+0000 7f51c0865700 1 -- 172.21.15.80:0/554612190 wait complete. 2019-11-28T11:41:31.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.205+0000 7f51c0865700 1 -- 172.21.15.80:0/554612190 >> 172.21.15.80:0/554612190 conn(0x7f51bc061cf0 msgr2=0x7f51bc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:31.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.207+0000 7f51c0865700 1 Processor -- start 2019-11-28T11:41:31.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.207+0000 7f51c0865700 1 -- start start 2019-11-28T11:41:31.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.208+0000 7f51c0865700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f51bc1065d0 0x7f51bc138680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:31.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.208+0000 7f51c0865700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51bc138bc0 0x7f51bc13e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:31.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.208+0000 7f51c0865700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc106fc0 con 0x7f51bc13e840 2019-11-28T11:41:31.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.208+0000 7f51c0865700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc134680 con 0x7f51bc1065d0 2019-11-28T11:41:31.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.208+0000 7f51c0865700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc134950 con 0x7f51bc138bc0 2019-11-28T11:41:31.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.208+0000 7f51bad9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f51bc1065d0 0x7f51bc138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:31.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.208+0000 7f51ba59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51bc138bc0 0x7f51bc13e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:31.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.208+0000 7f51bad9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f51bc1065d0 0x7f51bc138680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:54154/0 (socket says 172.21.15.80:54154) 2019-11-28T11:41:31.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.208+0000 7f51ba59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51bc138bc0 0x7f51bc13e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:41530/0 (socket says 172.21.15.80:41530) 2019-11-28T11:41:31.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.208+0000 7f51bad9d700 1 -- 172.21.15.80:0/1228451804 learned_addr learned my addr 172.21.15.80:0/1228451804 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:31.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.208+0000 7f51bad9d700 1 -- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51bc138bc0 msgr2=0x7f51bc13e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:31.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.208+0000 7f51bad9d700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51bc138bc0 0x7f51bc13e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:31.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.208+0000 7f51ab7fe700 1 -- 172.21.15.80:0/1228451804 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941437563 0 0) 0x7f51b4001030 con 0x7f51bc13e840 2019-11-28T11:41:31.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.208+0000 7f51bad9d700 1 -- 172.21.15.80:0/1228451804 >> v1:172.21.15.174:6789/0 conn(0x7f51bc13e840 legacy=0x7f51bc137500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:31.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.208+0000 7f51bad9d700 1 -- 172.21.15.80:0/1228451804 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc134fe0 con 0x7f51bc1065d0 2019-11-28T11:41:31.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.208+0000 7f51ba59c700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51bc138bc0 0x7f51bc13e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.209+0000 7f51bad9d700 1 --2- 172.21.15.80:0/1228451804 >> v2:172.21.15.174:3300/0 conn(0x7f51bc1065d0 0x7f51bc138680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51ac0107b0 tx=0x7f51ac010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.209+0000 7f51bad9d700 1 --2- 172.21.15.80:0/1228451804 >> v2:172.21.15.174:3300/0 conn(0x7f51bc1065d0 0x7f51bc138680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51ac0107b0 tx=0x7f51ac010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.209+0000 7f51bad9d700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51bc1065d0 0x7f51bc138680 secure :-1 s=READY pgs=910 cs=0 l=1 rx=0x7f51ac0107b0 tx=0x7f51ac010b50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.209+0000 7f51bad9d700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51bc1065d0 0x7f51bc138680 secure :-1 s=THROTTLE_DONE pgs=910 cs=0 l=1 rx=0x7f51ac0107b0 tx=0x7f51ac010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.209+0000 7f51ab7fe700 1 -- 172.21.15.80:0/1228451804 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51ac001250 con 0x7f51bc1065d0 2019-11-28T11:41:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.209+0000 7f51bad9d700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51bc1065d0 0x7f51bc138680 secure :-1 s=THROTTLE_DONE pgs=910 cs=0 l=1 rx=0x7f51ac0107b0 tx=0x7f51ac010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.209+0000 7f51ab7fe700 1 -- 172.21.15.80:0/1228451804 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac0047b0 con 0x7f51bc1065d0 2019-11-28T11:41:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.209+0000 7f51bad9d700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51bc1065d0 0x7f51bc138680 secure :-1 s=THROTTLE_DONE pgs=910 cs=0 l=1 rx=0x7f51ac0107b0 tx=0x7f51ac010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.209+0000 7f51ab7fe700 1 -- 172.21.15.80:0/1228451804 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51ac0049a0 con 0x7f51bc1065d0 2019-11-28T11:41:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.209+0000 7f51c0865700 1 -- 172.21.15.80:0/1228451804 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51bc135360 con 0x7f51bc1065d0 2019-11-28T11:41:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.209+0000 7f51c0865700 1 -- 172.21.15.80:0/1228451804 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc136440 con 0x7f51bc1065d0 2019-11-28T11:41:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.209+0000 7f51bad9d700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51bc1065d0 0x7f51bc138680 secure :-1 s=THROTTLE_DONE pgs=910 cs=0 l=1 rx=0x7f51ac0107b0 tx=0x7f51ac010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.209+0000 7f51ab7fe700 1 -- 172.21.15.80:0/1228451804 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f51ac0049a0 con 0x7f51bc1065d0 2019-11-28T11:41:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.209+0000 7f51bad9d700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51bc1065d0 0x7f51bc138680 secure :-1 s=THROTTLE_DONE pgs=910 cs=0 l=1 rx=0x7f51ac0107b0 tx=0x7f51ac010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.210+0000 7f51ab7fe700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f51a0018730 0x7f51a001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.210+0000 7f51ab7fe700 1 -- 172.21.15.80:0/1228451804 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f51ac031e70 con 0x7f51bc1065d0 2019-11-28T11:41:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.210+0000 7f51ba59c700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f51a0018730 0x7f51a001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:31.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.210+0000 7f51ba59c700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f51a0018730 0x7f51a001abc0 crc :-1 s=READY pgs=629 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:31.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.217+0000 7f51c0865700 1 -- 172.21.15.80:0/1228451804 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51bc134fe0 con 0x7f51bc1065d0 2019-11-28T11:41:31.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.221+0000 7f51bad9d700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51bc1065d0 0x7f51bc138680 secure :-1 s=THROTTLE_DONE pgs=910 cs=0 l=1 rx=0x7f51ac0107b0 tx=0x7f51ac010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:31.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.221+0000 7f51ab7fe700 1 -- 172.21.15.80:0/1228451804 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f51ac001630 con 0x7f51bc1065d0 2019-11-28T11:41:31.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.392+0000 7f51c0865700 1 -- 172.21.15.80:0/1228451804 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51bc135360 con 0x7f51bc1065d0 2019-11-28T11:41:31.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.393+0000 7f51bad9d700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51bc1065d0 0x7f51bc138680 secure :-1 s=THROTTLE_DONE pgs=910 cs=0 l=1 rx=0x7f51ac0107b0 tx=0x7f51ac010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:31.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.393+0000 7f51ab7fe700 1 -- 172.21.15.80:0/1228451804 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+1424 (secure 0 0 0) 0x7f51ac0202b0 con 0x7f51bc1065d0 2019-11-28T11:41:31.428 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 81 2019-11-28T11:41:31.428 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:31.430 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:25.297182+0000","modified":"2019-11-28T11:41:27.300122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2019-11-28T11:41:31.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.395+0000 7f51c0865700 1 -- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f51a0018730 msgr2=0x7f51a001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:31.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.395+0000 7f51c0865700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f51a0018730 0x7f51a001abc0 crc :-1 s=READY pgs=629 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:31.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.395+0000 7f51c0865700 1 -- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51bc1065d0 msgr2=0x7f51bc138680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:31.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.395+0000 7f51c0865700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51bc1065d0 0x7f51bc138680 secure :-1 s=READY pgs=910 cs=0 l=1 rx=0x7f51ac0107b0 tx=0x7f51ac010b50).stop 2019-11-28T11:41:31.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.395+0000 7f51c0865700 1 -- 172.21.15.80:0/1228451804 shutdown_connections 2019-11-28T11:41:31.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.395+0000 7f51c0865700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f51a0018730 0x7f51a001abc0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:31.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.395+0000 7f51c0865700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51bc138bc0 0x7f51bc13e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:31.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.395+0000 7f51c0865700 1 --2- 172.21.15.80:0/1228451804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51bc1065d0 0x7f51bc138680 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:31.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.395+0000 7f51c0865700 1 -- 172.21.15.80:0/1228451804 shutdown_connections 2019-11-28T11:41:31.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.395+0000 7f51c0865700 1 -- 172.21.15.80:0/1228451804 wait complete. 2019-11-28T11:41:31.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:31.395+0000 7f51c0865700 1 -- 172.21.15.80:0/1228451804 >> 172.21.15.80:0/1228451804 conn(0x7f51bc13d930 msgr2=0x7f51bc102360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:31.742 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 18, u'failed': [], u'epoch': 81, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [19], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:41:25.297182+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:41:27.300122+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:41:31.742 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:41:32.743 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:41:32.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.833+0000 7f87f552f700 1 Processor -- start 2019-11-28T11:41:32.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.833+0000 7f87f552f700 1 -- start start 2019-11-28T11:41:32.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.834+0000 7f87f552f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f87f006c0a0 0x7f87f0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:32.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.834+0000 7f87f552f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f00734e0 0x7f87f0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:32.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.834+0000 7f87f552f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f87f0072360 0x7f87f0072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:32.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.834+0000 7f87f552f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f006fd60 con 0x7f87f0072360 2019-11-28T11:41:32.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.834+0000 7f87f552f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f0070030 con 0x7f87f006c0a0 2019-11-28T11:41:32.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.834+0000 7f87f552f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f006f330 con 0x7f87f00734e0 2019-11-28T11:41:32.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.834+0000 7f87effff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f87f0072360 0x7f87f0072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:32.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.834+0000 7f87effff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f87f0072360 0x7f87f0072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39282/0 (socket says 172.21.15.80:39282) 2019-11-28T11:41:32.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.834+0000 7f87effff700 1 -- 172.21.15.80:0/3774204676 learned_addr learned my addr 172.21.15.80:0/3774204676 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:32.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.834+0000 7f87eeffd700 1 --2- 172.21.15.80:0/3774204676 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f00734e0 0x7f87f0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:32.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.834+0000 7f87ef7fe700 1 --2- 172.21.15.80:0/3774204676 >> v2:172.21.15.174:3300/0 conn(0x7f87f006c0a0 0x7f87f0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:32.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.835+0000 7f87effff700 1 -- 172.21.15.80:0/3774204676 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f00734e0 msgr2=0x7f87f0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:32.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.835+0000 7f87effff700 1 --2- 172.21.15.80:0/3774204676 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f00734e0 0x7f87f0071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:32.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.835+0000 7f87effff700 1 -- 172.21.15.80:0/3774204676 >> v2:172.21.15.174:3300/0 conn(0x7f87f006c0a0 msgr2=0x7f87f0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:32.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.835+0000 7f87effff700 1 --2- 172.21.15.80:0/3774204676 >> v2:172.21.15.174:3300/0 conn(0x7f87f006c0a0 0x7f87f0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:32.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.835+0000 7f87effff700 1 -- 172.21.15.80:0/3774204676 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f00706c0 con 0x7f87f0072360 2019-11-28T11:41:32.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.835+0000 7f87effff700 1 --2- 172.21.15.80:0/3774204676 >> v2:172.21.15.80:3300/0 conn(0x7f87f0072360 0x7f87f0072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f87e800f6b0 tx=0x7f87e8007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:32.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.835+0000 7f87effff700 1 --2- 172.21.15.80:0/3774204676 >> v2:172.21.15.80:3300/0 conn(0x7f87f0072360 0x7f87f0072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f87e800f6b0 tx=0x7f87e8007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:32.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.835+0000 7f87effff700 1 --2- 172.21.15.80:0/3774204676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87f0072360 0x7f87f0072800 secure :-1 s=READY pgs=1556 cs=0 l=1 rx=0x7f87e800f6b0 tx=0x7f87e8007d50).ready entity=mon.0 client_cookie=7aa5032e64557cfd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:32.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.835+0000 7f87effff700 1 --2- 172.21.15.80:0/3774204676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87f0072360 0x7f87f0072800 secure :-1 s=THROTTLE_DONE pgs=1556 cs=0 l=1 rx=0x7f87e800f6b0 tx=0x7f87e8007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:32.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.835+0000 7f87ee7fc700 1 -- 172.21.15.80:0/3774204676 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87e8000ba0 con 0x7f87f0072360 2019-11-28T11:41:32.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.835+0000 7f87effff700 1 --2- 172.21.15.80:0/3774204676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87f0072360 0x7f87f0072800 secure :-1 s=THROTTLE_DONE pgs=1556 cs=0 l=1 rx=0x7f87e800f6b0 tx=0x7f87e8007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:32.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.835+0000 7f87effff700 1 --2- 172.21.15.80:0/3774204676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87f0072360 0x7f87f0072800 secure :-1 s=THROTTLE_DONE pgs=1556 cs=0 l=1 rx=0x7f87e800f6b0 tx=0x7f87e8007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:32.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.835+0000 7f87ee7fc700 1 -- 172.21.15.80:0/3774204676 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e80010e0 con 0x7f87f0072360 2019-11-28T11:41:32.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.835+0000 7f87ee7fc700 1 -- 172.21.15.80:0/3774204676 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87e80017b0 con 0x7f87f0072360 2019-11-28T11:41:32.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.835+0000 7f87f552f700 1 -- 172.21.15.80:0/3774204676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87f0072360 msgr2=0x7f87f0072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.835+0000 7f87f552f700 1 --2- 172.21.15.80:0/3774204676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87f0072360 0x7f87f0072800 secure :-1 s=READY pgs=1556 cs=0 l=1 rx=0x7f87e800f6b0 tx=0x7f87e8007d50).stop 2019-11-28T11:41:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.836+0000 7f87f552f700 1 -- 172.21.15.80:0/3774204676 shutdown_connections 2019-11-28T11:41:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.836+0000 7f87f552f700 1 --2- 172.21.15.80:0/3774204676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87f0072360 0x7f87f0072800 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.836+0000 7f87f552f700 1 --2- 172.21.15.80:0/3774204676 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f00734e0 0x7f87f0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.836+0000 7f87f552f700 1 --2- 172.21.15.80:0/3774204676 >> v2:172.21.15.174:3300/0 conn(0x7f87f006c0a0 0x7f87f0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.836+0000 7f87f552f700 1 -- 172.21.15.80:0/3774204676 shutdown_connections 2019-11-28T11:41:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.836+0000 7f87f552f700 1 -- 172.21.15.80:0/3774204676 wait complete. 2019-11-28T11:41:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.836+0000 7f87f552f700 1 -- 172.21.15.80:0/3774204676 >> 172.21.15.80:0/3774204676 conn(0x7f87f0061cf0 msgr2=0x7f87f0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.838+0000 7f87f552f700 1 Processor -- start 2019-11-28T11:41:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.838+0000 7f87f552f700 1 -- start start 2019-11-28T11:41:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.839+0000 7f87f552f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f013eb40 0x7f87f010afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.839+0000 7f87f552f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f87f010b500 0x7f87f01629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.839+0000 7f87f552f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f013f1e0 con 0x7f87f0162f30 2019-11-28T11:41:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.839+0000 7f87f552f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f01234c0 con 0x7f87f010b500 2019-11-28T11:41:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.839+0000 7f87f552f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f013d6a0 con 0x7f87f013eb40 2019-11-28T11:41:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.839+0000 7f87ef7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f013eb40 0x7f87f010afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.839+0000 7f87eeffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f87f010b500 0x7f87f01629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.839+0000 7f87ef7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f013eb40 0x7f87f010afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:41546/0 (socket says 172.21.15.80:41546) 2019-11-28T11:41:32.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.839+0000 7f87ef7fe700 1 -- 172.21.15.80:0/416909072 learned_addr learned my addr 172.21.15.80:0/416909072 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:32.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.840+0000 7f87e7fff700 1 -- 172.21.15.80:0/416909072 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172534781 0 0) 0x7f87e8007610 con 0x7f87f0162f30 2019-11-28T11:41:32.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.840+0000 7f87ef7fe700 1 -- 172.21.15.80:0/416909072 >> v2:172.21.15.174:3300/0 conn(0x7f87f010b500 msgr2=0x7f87f01629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:32.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.840+0000 7f87ef7fe700 1 --2- 172.21.15.80:0/416909072 >> v2:172.21.15.174:3300/0 conn(0x7f87f010b500 0x7f87f01629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:32.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.840+0000 7f87ef7fe700 1 -- 172.21.15.80:0/416909072 >> v1:172.21.15.174:6789/0 conn(0x7f87f0162f30 legacy=0x7f87f0109e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.840+0000 7f87ef7fe700 1 -- 172.21.15.80:0/416909072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f0108700 con 0x7f87f013eb40 2019-11-28T11:41:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.840+0000 7f87ef7fe700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f013eb40 0x7f87f010afc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f87d8010400 tx=0x7f87d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.840+0000 7f87ef7fe700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f013eb40 0x7f87f010afc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f87d8010400 tx=0x7f87d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.840+0000 7f87ef7fe700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f013eb40 0x7f87f010afc0 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f87d8010400 tx=0x7f87d8010280).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.840+0000 7f87ef7fe700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f013eb40 0x7f87f010afc0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f87d8010400 tx=0x7f87d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.840+0000 7f87e7fff700 1 -- 172.21.15.80:0/416909072 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87d8000940 con 0x7f87f013eb40 2019-11-28T11:41:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.840+0000 7f87ef7fe700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f013eb40 0x7f87f010afc0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f87d8010400 tx=0x7f87d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.840+0000 7f87e7fff700 1 -- 172.21.15.80:0/416909072 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d8000940 con 0x7f87f013eb40 2019-11-28T11:41:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.840+0000 7f87f552f700 1 -- 172.21.15.80:0/416909072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f0108a80 con 0x7f87f013eb40 2019-11-28T11:41:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.840+0000 7f87ef7fe700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f013eb40 0x7f87f010afc0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f87d8010400 tx=0x7f87d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.840+0000 7f87e7fff700 1 -- 172.21.15.80:0/416909072 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87d8001090 con 0x7f87f013eb40 2019-11-28T11:41:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.840+0000 7f87f552f700 1 -- 172.21.15.80:0/416909072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f0108700 con 0x7f87f013eb40 2019-11-28T11:41:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.841+0000 7f87ef7fe700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f013eb40 0x7f87f010afc0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f87d8010400 tx=0x7f87d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.841+0000 7f87e7fff700 1 -- 172.21.15.80:0/416909072 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f87d8000ea0 con 0x7f87f013eb40 2019-11-28T11:41:32.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.841+0000 7f87ef7fe700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f013eb40 0x7f87f010afc0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f87d8010400 tx=0x7f87d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:32.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.841+0000 7f87e7fff700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f87c8018730 0x7f87c801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:32.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.841+0000 7f87e7fff700 1 -- 172.21.15.80:0/416909072 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f87d8031a70 con 0x7f87f013eb40 2019-11-28T11:41:32.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.841+0000 7f87eeffd700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f87c8018730 0x7f87c801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:32.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.841+0000 7f87eeffd700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f87c8018730 0x7f87c801abc0 crc :-1 s=READY pgs=633 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:32.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.848+0000 7f87f552f700 1 -- 172.21.15.80:0/416909072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f0108a80 con 0x7f87f013eb40 2019-11-28T11:41:32.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.852+0000 7f87ef7fe700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f013eb40 0x7f87f010afc0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f87d8010400 tx=0x7f87d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:32.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:32.852+0000 7f87e7fff700 1 -- 172.21.15.80:0/416909072 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f87d8000c90 con 0x7f87f013eb40 2019-11-28T11:41:33.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:33.025+0000 7f87f552f700 1 -- 172.21.15.80:0/416909072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87f0108700 con 0x7f87f013eb40 2019-11-28T11:41:33.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:33.025+0000 7f87ef7fe700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f013eb40 0x7f87f010afc0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f87d8010400 tx=0x7f87d8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:33.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:33.025+0000 7f87e7fff700 1 -- 172.21.15.80:0/416909072 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+2450 (secure 0 0 0) 0x7f87d80018b0 con 0x7f87f013eb40 2019-11-28T11:41:33.061 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 83 2019-11-28T11:41:33.062 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:33.062 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":83,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1010023901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1010023901},{"type":"v1","addr":"172.21.15.80:6834","nonce":1010023901}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":82},{"gid":8556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3440274141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3440274141},{"type":"v1","addr":"172.21.15.80:6835","nonce":3440274141}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":82}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:25.297182+0000","modified":"2019-11-28T11:41:32.670747+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6242":{"gid":6242,"name":"c","rank":0,"incarnation":83,"state":"up:creating","state_seq":2,"addr":"172.21.15.174:6835/2489382286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2489382286},{"type":"v1","addr":"172.21.15.174:6835","nonce":2489382286}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2019-11-28T11:41:33.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:33.028+0000 7f87f552f700 1 -- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f87c8018730 msgr2=0x7f87c801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:33.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:33.028+0000 7f87f552f700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f87c8018730 0x7f87c801abc0 crc :-1 s=READY pgs=633 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:33.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:33.028+0000 7f87f552f700 1 -- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f013eb40 msgr2=0x7f87f010afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:33.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:33.028+0000 7f87f552f700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f013eb40 0x7f87f010afc0 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f87d8010400 tx=0x7f87d8010280).stop 2019-11-28T11:41:33.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:33.028+0000 7f87f552f700 1 -- 172.21.15.80:0/416909072 shutdown_connections 2019-11-28T11:41:33.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:33.028+0000 7f87f552f700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f87c8018730 0x7f87c801abc0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:33.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:33.028+0000 7f87f552f700 1 --2- 172.21.15.80:0/416909072 >> v2:172.21.15.174:3300/0 conn(0x7f87f010b500 0x7f87f01629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:33.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:33.028+0000 7f87f552f700 1 --2- 172.21.15.80:0/416909072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87f013eb40 0x7f87f010afc0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:33.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:33.028+0000 7f87f552f700 1 -- 172.21.15.80:0/416909072 shutdown_connections 2019-11-28T11:41:33.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:33.028+0000 7f87f552f700 1 -- 172.21.15.80:0/416909072 wait complete. 2019-11-28T11:41:33.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:33.028+0000 7f87f552f700 1 -- 172.21.15.80:0/416909072 >> 172.21.15.80:0/416909072 conn(0x7f87f011bfc0 msgr2=0x7f87f0141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:33.376 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6242}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 18, u'failed': [], u'epoch': 83, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [19], u'info': {u'gid_6242': {u'export_targets': [], u'name': u'c', u'incarnation': 83, u'state_seq': 2, u'state': u'up:creating', u'gid': 6242, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2489382286, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2489382286, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2489382286'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:41:25.297182+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:41:32.670747+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:41:33.376 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6242:up:creating 2019-11-28T11:41:34.379 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:41:34.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.481+0000 7f72771d8700 1 Processor -- start 2019-11-28T11:41:34.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.481+0000 7f72771d8700 1 -- start start 2019-11-28T11:41:34.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.482+0000 7f72771d8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f727006c0a0 0x7f7270072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:34.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.482+0000 7f72771d8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f72700734e0 0x7f7270071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:34.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.482+0000 7f72771d8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7270072360 0x7f7270072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:34.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.482+0000 7f72771d8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727006fd60 con 0x7f727006c0a0 2019-11-28T11:41:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.482+0000 7f72771d8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7270070030 con 0x7f72700734e0 2019-11-28T11:41:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.482+0000 7f72771d8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727006f330 con 0x7f7270072360 2019-11-28T11:41:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7275775700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f727006c0a0 0x7f7270072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7275775700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f727006c0a0 0x7f7270072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39294/0 (socket says 172.21.15.80:39294) 2019-11-28T11:41:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7275775700 1 -- 172.21.15.80:0/1604841095 learned_addr learned my addr 172.21.15.80:0/1604841095 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7275f76700 1 --2- 172.21.15.80:0/1604841095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7270072360 0x7f7270072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7274f74700 1 --2- 172.21.15.80:0/1604841095 >> v2:172.21.15.174:3300/0 conn(0x7f72700734e0 0x7f7270071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7275775700 1 -- 172.21.15.80:0/1604841095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7270072360 msgr2=0x7f7270072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7275775700 1 --2- 172.21.15.80:0/1604841095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7270072360 0x7f7270072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7275775700 1 -- 172.21.15.80:0/1604841095 >> v2:172.21.15.174:3300/0 conn(0x7f72700734e0 msgr2=0x7f7270071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7275775700 1 --2- 172.21.15.80:0/1604841095 >> v2:172.21.15.174:3300/0 conn(0x7f72700734e0 0x7f7270071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7275775700 1 -- 172.21.15.80:0/1604841095 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72700706c0 con 0x7f727006c0a0 2019-11-28T11:41:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7274f74700 1 --2- 172.21.15.80:0/1604841095 >> v2:172.21.15.174:3300/0 conn(0x7f72700734e0 0x7f7270071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:41:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7275775700 1 --2- 172.21.15.80:0/1604841095 >> v2:172.21.15.80:3300/0 conn(0x7f727006c0a0 0x7f7270072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f726000f6c0 tx=0x7f726000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7275775700 1 --2- 172.21.15.80:0/1604841095 >> v2:172.21.15.80:3300/0 conn(0x7f727006c0a0 0x7f7270072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f726000f6c0 tx=0x7f726000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7275775700 1 --2- 172.21.15.80:0/1604841095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f727006c0a0 0x7f7270072fa0 secure :-1 s=READY pgs=1557 cs=0 l=1 rx=0x7f726000f6c0 tx=0x7f726000fa60).ready entity=mon.0 client_cookie=73e9c42520f360d6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7275775700 1 --2- 172.21.15.80:0/1604841095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f727006c0a0 0x7f7270072fa0 secure :-1 s=THROTTLE_DONE pgs=1557 cs=0 l=1 rx=0x7f726000f6c0 tx=0x7f726000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7275775700 1 --2- 172.21.15.80:0/1604841095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f727006c0a0 0x7f7270072fa0 secure :-1 s=THROTTLE_DONE pgs=1557 cs=0 l=1 rx=0x7f726000f6c0 tx=0x7f726000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f726ffff700 1 -- 172.21.15.80:0/1604841095 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7260000960 con 0x7f727006c0a0 2019-11-28T11:41:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f7275775700 1 --2- 172.21.15.80:0/1604841095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f727006c0a0 0x7f7270072fa0 secure :-1 s=THROTTLE_DONE pgs=1557 cs=0 l=1 rx=0x7f726000f6c0 tx=0x7f726000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f726ffff700 1 -- 172.21.15.80:0/1604841095 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7260000c90 con 0x7f727006c0a0 2019-11-28T11:41:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f726ffff700 1 -- 172.21.15.80:0/1604841095 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7260001440 con 0x7f727006c0a0 2019-11-28T11:41:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f72771d8700 1 -- 172.21.15.80:0/1604841095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f727006c0a0 msgr2=0x7f7270072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.483+0000 7f72771d8700 1 --2- 172.21.15.80:0/1604841095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f727006c0a0 0x7f7270072fa0 secure :-1 s=READY pgs=1557 cs=0 l=1 rx=0x7f726000f6c0 tx=0x7f726000fa60).stop 2019-11-28T11:41:34.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.484+0000 7f72771d8700 1 -- 172.21.15.80:0/1604841095 shutdown_connections 2019-11-28T11:41:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.484+0000 7f72771d8700 1 --2- 172.21.15.80:0/1604841095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7270072360 0x7f7270072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.484+0000 7f72771d8700 1 --2- 172.21.15.80:0/1604841095 >> v2:172.21.15.174:3300/0 conn(0x7f72700734e0 0x7f7270071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.484+0000 7f72771d8700 1 --2- 172.21.15.80:0/1604841095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f727006c0a0 0x7f7270072fa0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.484+0000 7f72771d8700 1 -- 172.21.15.80:0/1604841095 shutdown_connections 2019-11-28T11:41:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.484+0000 7f72771d8700 1 -- 172.21.15.80:0/1604841095 wait complete. 2019-11-28T11:41:34.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.484+0000 7f72771d8700 1 -- 172.21.15.80:0/1604841095 >> 172.21.15.80:0/1604841095 conn(0x7f7270061cf0 msgr2=0x7f7270064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.487+0000 7f72771d8700 1 Processor -- start 2019-11-28T11:41:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.487+0000 7f72771d8700 1 -- start start 2019-11-28T11:41:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f72771d8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7270104c10 0x7f72701050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f72771d8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727013bcd0 con 0x7f7270104820 2019-11-28T11:41:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f72771d8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7270105ea0 con 0x7f72701055e0 2019-11-28T11:41:34.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f72771d8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7270109130 con 0x7f7270104c10 2019-11-28T11:41:34.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f7275775700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7270104820 0x7f727010c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38616/0 (socket says 172.21.15.80:38616) 2019-11-28T11:41:34.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f7275775700 1 -- 172.21.15.80:0/221731360 learned_addr learned my addr 172.21.15.80:0/221731360 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:34.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f7274f74700 1 --2- 172.21.15.80:0/221731360 >> v2:172.21.15.174:3300/0 conn(0x7f7270104c10 0x7f72701050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:34.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f726dffb700 1 -- 172.21.15.80:0/221731360 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602463793 0 0) 0x7f72600075d0 con 0x7f7270104820 2019-11-28T11:41:34.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f726dffb700 1 -- 172.21.15.80:0/221731360 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7254002e80 con 0x7f7270104820 2019-11-28T11:41:34.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f726dffb700 1 -- 172.21.15.80:0/221731360 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090303107 0 0) 0x7f72680059c0 con 0x7f72701055e0 2019-11-28T11:41:34.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f726dffb700 1 -- 172.21.15.80:0/221731360 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7254004170 con 0x7f72701055e0 2019-11-28T11:41:34.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f7274f74700 1 -- 172.21.15.80:0/221731360 >> v1:172.21.15.174:6789/0 conn(0x7f72701055e0 legacy=0x7f7270167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:34.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f726dffb700 1 -- 172.21.15.80:0/221731360 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2034324220 0 0) 0x7f72600009a0 con 0x7f7270104820 2019-11-28T11:41:34.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f7274f74700 1 -- 172.21.15.80:0/221731360 >> v1:172.21.15.80:6789/0 conn(0x7f7270104820 legacy=0x7f727010c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:34.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f7274f74700 1 -- 172.21.15.80:0/221731360 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7270109a90 con 0x7f7270104c10 2019-11-28T11:41:34.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f7274f74700 1 --2- 172.21.15.80:0/221731360 >> v2:172.21.15.174:3300/0 conn(0x7f7270104c10 0x7f72701050a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7258010380 tx=0x7f7258010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:34.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f7274f74700 1 --2- 172.21.15.80:0/221731360 >> v2:172.21.15.174:3300/0 conn(0x7f7270104c10 0x7f72701050a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7258010380 tx=0x7f7258010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:34.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.488+0000 7f7274f74700 1 --2- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7270104c10 0x7f72701050a0 secure :-1 s=READY pgs=913 cs=0 l=1 rx=0x7f7258010380 tx=0x7f7258010720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:34.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.489+0000 7f7274f74700 1 --2- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7270104c10 0x7f72701050a0 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f7258010380 tx=0x7f7258010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:34.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.489+0000 7f726dffb700 1 -- 172.21.15.80:0/221731360 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7258000940 con 0x7f7270104c10 2019-11-28T11:41:34.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.489+0000 7f7274f74700 1 --2- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7270104c10 0x7f72701050a0 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f7258010380 tx=0x7f7258010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:34.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.489+0000 7f7274f74700 1 --2- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7270104c10 0x7f72701050a0 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f7258010380 tx=0x7f7258010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:34.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.489+0000 7f726dffb700 1 -- 172.21.15.80:0/221731360 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7258001170 con 0x7f7270104c10 2019-11-28T11:41:34.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.489+0000 7f72771d8700 1 -- 172.21.15.80:0/221731360 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7270109e10 con 0x7f7270104c10 2019-11-28T11:41:34.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.489+0000 7f726dffb700 1 -- 172.21.15.80:0/221731360 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7258000940 con 0x7f7270104c10 2019-11-28T11:41:34.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.489+0000 7f72771d8700 1 -- 172.21.15.80:0/221731360 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7270109a90 con 0x7f7270104c10 2019-11-28T11:41:34.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.489+0000 7f7274f74700 1 --2- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7270104c10 0x7f72701050a0 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f7258010380 tx=0x7f7258010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:34.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.489+0000 7f726dffb700 1 -- 172.21.15.80:0/221731360 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7258000d70 con 0x7f7270104c10 2019-11-28T11:41:34.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.489+0000 7f7274f74700 1 --2- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7270104c10 0x7f72701050a0 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f7258010380 tx=0x7f7258010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:34.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.489+0000 7f726dffb700 1 --2- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7254018750 0x7f725401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:34.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.489+0000 7f726dffb700 1 -- 172.21.15.80:0/221731360 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7258031a80 con 0x7f7270104c10 2019-11-28T11:41:34.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.490+0000 7f7275775700 1 --2- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7254018750 0x7f725401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:34.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.490+0000 7f7275775700 1 --2- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7254018750 0x7f725401abe0 crc :-1 s=READY pgs=634 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:34.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.497+0000 7f72771d8700 1 -- 172.21.15.80:0/221731360 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7270109e10 con 0x7f7270104c10 2019-11-28T11:41:34.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.501+0000 7f7274f74700 1 --2- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7270104c10 0x7f72701050a0 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f7258010380 tx=0x7f7258010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:34.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.501+0000 7f726dffb700 1 -- 172.21.15.80:0/221731360 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7258000940 con 0x7f7270104c10 2019-11-28T11:41:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.672+0000 7f72771d8700 1 -- 172.21.15.80:0/221731360 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7270109a90 con 0x7f7270104c10 2019-11-28T11:41:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.672+0000 7f7274f74700 1 --2- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7270104c10 0x7f72701050a0 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f7258010380 tx=0x7f7258010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.672+0000 7f726dffb700 1 -- 172.21.15.80:0/221731360 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+2448 (secure 0 0 0) 0x7f7258000940 con 0x7f7270104c10 2019-11-28T11:41:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 84 2019-11-28T11:41:34.707 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:34.708 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":84,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1010023901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1010023901},{"type":"v1","addr":"172.21.15.80:6834","nonce":1010023901}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":82},{"gid":8556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3440274141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3440274141},{"type":"v1","addr":"172.21.15.80:6835","nonce":3440274141}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":82}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:25.297182+0000","modified":"2019-11-28T11:41:33.675187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6242":{"gid":6242,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2489382286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2489382286},{"type":"v1","addr":"172.21.15.174:6835","nonce":2489382286}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2019-11-28T11:41:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.674+0000 7f72771d8700 1 -- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7254018750 msgr2=0x7f725401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.674+0000 7f72771d8700 1 --2- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7254018750 0x7f725401abe0 crc :-1 s=READY pgs=634 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.674+0000 7f72771d8700 1 -- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7270104c10 msgr2=0x7f72701050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.674+0000 7f72771d8700 1 --2- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7270104c10 0x7f72701050a0 secure :-1 s=READY pgs=913 cs=0 l=1 rx=0x7f7258010380 tx=0x7f7258010720).stop 2019-11-28T11:41:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.675+0000 7f72771d8700 1 -- 172.21.15.80:0/221731360 shutdown_connections 2019-11-28T11:41:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.675+0000 7f72771d8700 1 --2- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7254018750 0x7f725401abe0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.675+0000 7f72771d8700 1 --2- 172.21.15.80:0/221731360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7270104c10 0x7f72701050a0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.675+0000 7f72771d8700 1 -- 172.21.15.80:0/221731360 shutdown_connections 2019-11-28T11:41:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.675+0000 7f72771d8700 1 -- 172.21.15.80:0/221731360 wait complete. 2019-11-28T11:41:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:34.675+0000 7f72771d8700 1 -- 172.21.15.80:0/221731360 >> 172.21.15.80:0/221731360 conn(0x7f727013d620 msgr2=0x7f727013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:35.025 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6242}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 18, u'failed': [], u'epoch': 84, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [19], u'info': {u'gid_6242': {u'export_targets': [], u'name': u'c', u'incarnation': 83, u'state_seq': 3, u'state': u'up:active', u'gid': 6242, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2489382286, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2489382286, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2489382286'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:41:25.297182+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:41:33.675187+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:41:35.025 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:41:35.025 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:41:35.152 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:41:35.153 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:41:35.153 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:41:35.153 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 6242, 2019-11-28T11:41:35.153 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:41:35.153 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:41:35.153 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 2.4442984459999999, 2019-11-28T11:41:35.154 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 84, 2019-11-28T11:41:35.154 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 117, 2019-11-28T11:41:35.154 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 117, 2019-11-28T11:41:35.154 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 7.0098081829999996 2019-11-28T11:41:35.154 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:41:35.158 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 6242, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.4442984459999999, "mdsmap_epoch": 84, "osdmap_epoch": 117, "osdmap_epoch_barrier": 117, "uptime": 7.0098081829999996 } 2019-11-28T11:41:35.159 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:41:35.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.249+0000 7fbead991700 1 Processor -- start 2019-11-28T11:41:35.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.249+0000 7fbead991700 1 -- start start 2019-11-28T11:41:35.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.250+0000 7fbead991700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbea806c490 0x7fbea806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:35.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.250+0000 7fbead991700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea806db00 con 0x7fbea806c0a0 2019-11-28T11:41:35.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.250+0000 7fbead991700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea806e000 con 0x7fbea806ce60 2019-11-28T11:41:35.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.250+0000 7fbead991700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea806fd60 con 0x7fbea806c490 2019-11-28T11:41:35.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.250+0000 7fbea77fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbea806c0a0 0x7fbea8072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38624/0 (socket says 172.21.15.80:38624) 2019-11-28T11:41:35.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.250+0000 7fbea77fe700 1 -- 172.21.15.80:0/1891784603 learned_addr learned my addr 172.21.15.80:0/1891784603 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:35.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.250+0000 7fbea67fc700 1 -- 172.21.15.80:0/1891784603 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692822835 0 0) 0x7fbe98001150 con 0x7fbea806c0a0 2019-11-28T11:41:35.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.250+0000 7fbea6ffd700 1 --2- 172.21.15.80:0/1891784603 >> v2:172.21.15.174:3300/0 conn(0x7fbea806c490 0x7fbea806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.250+0000 7fbea67fc700 1 -- 172.21.15.80:0/1891784603 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe88002e80 con 0x7fbea806c0a0 2019-11-28T11:41:35.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea67fc700 1 -- 172.21.15.80:0/1891784603 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1566314989 0 0) 0x7fbe98001130 con 0x7fbea806c0a0 2019-11-28T11:41:35.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea67fc700 1 -- 172.21.15.80:0/1891784603 >> v2:172.21.15.174:3300/0 conn(0x7fbea806c490 msgr2=0x7fbea806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:35.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea67fc700 1 --2- 172.21.15.80:0/1891784603 >> v2:172.21.15.174:3300/0 conn(0x7fbea806c490 0x7fbea806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:35.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea67fc700 1 -- 172.21.15.80:0/1891784603 >> v1:172.21.15.174:6789/0 conn(0x7fbea806ce60 legacy=0x7fbea8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:35.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea67fc700 1 -- 172.21.15.80:0/1891784603 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea80706c0 con 0x7fbea806c0a0 2019-11-28T11:41:35.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea67fc700 1 -- 172.21.15.80:0/1891784603 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fbe980016c0 con 0x7fbea806c0a0 2019-11-28T11:41:35.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea67fc700 1 -- 172.21.15.80:0/1891784603 >> v1:172.21.15.80:6789/0 conn(0x7fbea806c0a0 legacy=0x7fbea8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:35.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea67fc700 1 --2- 172.21.15.80:0/1891784603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe88003ab0 0x7fbe88005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:35.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea67fc700 1 --2- 172.21.15.80:0/1891784603 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe88006670 0x7fbe88008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:35.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea67fc700 1 --2- 172.21.15.80:0/1891784603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe88009380 0x7fbe8800b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:35.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea67fc700 1 -- 172.21.15.80:0/1891784603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8800c000 con 0x7fbe88009380 2019-11-28T11:41:35.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea67fc700 1 -- 172.21.15.80:0/1891784603 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe88050200 con 0x7fbe88003ab0 2019-11-28T11:41:35.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea67fc700 1 -- 172.21.15.80:0/1891784603 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe88050430 con 0x7fbe88006670 2019-11-28T11:41:35.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea7fff700 1 --2- 172.21.15.80:0/1891784603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe88009380 0x7fbe8800b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea6ffd700 1 --2- 172.21.15.80:0/1891784603 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe88006670 0x7fbe88008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea77fe700 1 --2- 172.21.15.80:0/1891784603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe88003ab0 0x7fbe88005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea7fff700 1 -- 172.21.15.80:0/1891784603 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe88006670 msgr2=0x7fbe88008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:35.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea7fff700 1 --2- 172.21.15.80:0/1891784603 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe88006670 0x7fbe88008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:35.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea7fff700 1 -- 172.21.15.80:0/1891784603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe88003ab0 msgr2=0x7fbe88005ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:35.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea7fff700 1 --2- 172.21.15.80:0/1891784603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe88003ab0 0x7fbe88005ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:35.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea7fff700 1 -- 172.21.15.80:0/1891784603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe880506e0 con 0x7fbe88009380 2019-11-28T11:41:35.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea7fff700 1 --2- 172.21.15.80:0/1891784603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe88009380 0x7fbe8800b850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbea000af60 tx=0x7fbea000b260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea7fff700 1 -- 172.21.15.80:0/1891784603 reap_dead start 2019-11-28T11:41:35.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea7fff700 1 --2- 172.21.15.80:0/1891784603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe88009380 0x7fbe8800b850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbea000af60 tx=0x7fbea000b260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea7fff700 1 --2- 172.21.15.80:0/1891784603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe88009380 0x7fbe8800b850 secure :-1 s=READY pgs=1560 cs=0 l=1 rx=0x7fbea000af60 tx=0x7fbea000b260).ready entity=mon.0 client_cookie=5577676c4e71c921 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:35.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea7fff700 1 --2- 172.21.15.80:0/1891784603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe88009380 0x7fbe8800b850 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7fbea000af60 tx=0x7fbea000b260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea67fc700 1 -- 172.21.15.80:0/1891784603 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbea0009b80 con 0x7fbe88009380 2019-11-28T11:41:35.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea7fff700 1 --2- 172.21.15.80:0/1891784603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe88009380 0x7fbe8800b850 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7fbea000af60 tx=0x7fbea000b260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea7fff700 1 --2- 172.21.15.80:0/1891784603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe88009380 0x7fbe8800b850 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7fbea000af60 tx=0x7fbea000b260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea67fc700 1 -- 172.21.15.80:0/1891784603 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea00097a0 con 0x7fbe88009380 2019-11-28T11:41:35.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.251+0000 7fbea67fc700 1 -- 172.21.15.80:0/1891784603 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbea000a160 con 0x7fbe88009380 2019-11-28T11:41:35.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.252+0000 7fbead991700 1 -- 172.21.15.80:0/1891784603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe88009380 msgr2=0x7fbe8800b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:35.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.252+0000 7fbead991700 1 --2- 172.21.15.80:0/1891784603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe88009380 0x7fbe8800b850 secure :-1 s=READY pgs=1560 cs=0 l=1 rx=0x7fbea000af60 tx=0x7fbea000b260).stop 2019-11-28T11:41:35.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.252+0000 7fbead991700 1 -- 172.21.15.80:0/1891784603 shutdown_connections 2019-11-28T11:41:35.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.252+0000 7fbead991700 1 --2- 172.21.15.80:0/1891784603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe88009380 0x7fbe8800b850 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:35.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.252+0000 7fbead991700 1 -- 172.21.15.80:0/1891784603 shutdown_connections 2019-11-28T11:41:35.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.252+0000 7fbead991700 1 -- 172.21.15.80:0/1891784603 wait complete. 2019-11-28T11:41:35.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.252+0000 7fbead991700 1 -- 172.21.15.80:0/1891784603 >> 172.21.15.80:0/1891784603 conn(0x7fbea8061cf0 msgr2=0x7fbea8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:35.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.255+0000 7fbead991700 1 Processor -- start 2019-11-28T11:41:35.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.255+0000 7fbead991700 1 -- start start 2019-11-28T11:41:35.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbead991700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbea8074d00 0x7fbea807aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:35.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbead991700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea80754d0 con 0x7fbea8150f50 2019-11-28T11:41:35.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbead991700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea812eb20 con 0x7fbea807bba0 2019-11-28T11:41:35.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbead991700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea8078980 con 0x7fbea8074d00 2019-11-28T11:41:35.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbea77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbea8074d00 0x7fbea807aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbea77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbea8074d00 0x7fbea807aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39320/0 (socket says 172.21.15.80:39320) 2019-11-28T11:41:35.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbea6ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbea8150f50 0x7fbea807af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38638/0 (socket says 172.21.15.80:38638) 2019-11-28T11:41:35.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbea6ffd700 1 -- 172.21.15.80:0/2018175263 learned_addr learned my addr 172.21.15.80:0/2018175263 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:35.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbea77fe700 1 -- 172.21.15.80:0/2018175263 >> v1:172.21.15.174:6789/0 conn(0x7fbea807bba0 legacy=0x7fbea8167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:35.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbea77fe700 1 -- 172.21.15.80:0/2018175263 >> v1:172.21.15.80:6789/0 conn(0x7fbea8150f50 legacy=0x7fbea807af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:35.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbe9ffff700 1 -- 172.21.15.80:0/2018175263 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157295963 0 0) 0x7fbea000b500 con 0x7fbea807bba0 2019-11-28T11:41:35.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbea77fe700 1 -- 172.21.15.80:0/2018175263 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea80792e0 con 0x7fbea8074d00 2019-11-28T11:41:35.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbea77fe700 1 --2- 172.21.15.80:0/2018175263 >> v2:172.21.15.80:3300/0 conn(0x7fbea8074d00 0x7fbea807aa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbe98010370 tx=0x7fbe98010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbea77fe700 1 --2- 172.21.15.80:0/2018175263 >> v2:172.21.15.80:3300/0 conn(0x7fbea8074d00 0x7fbea807aa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbe98010370 tx=0x7fbe98010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbea77fe700 1 --2- 172.21.15.80:0/2018175263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbea8074d00 0x7fbea807aa20 secure :-1 s=READY pgs=1562 cs=0 l=1 rx=0x7fbe98010370 tx=0x7fbe98010710).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:35.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbea77fe700 1 --2- 172.21.15.80:0/2018175263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbea8074d00 0x7fbea807aa20 secure :-1 s=THROTTLE_DONE pgs=1562 cs=0 l=1 rx=0x7fbe98010370 tx=0x7fbe98010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbe9ffff700 1 -- 172.21.15.80:0/2018175263 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe98000c90 con 0x7fbea8074d00 2019-11-28T11:41:35.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbea77fe700 1 --2- 172.21.15.80:0/2018175263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbea8074d00 0x7fbea807aa20 secure :-1 s=THROTTLE_DONE pgs=1562 cs=0 l=1 rx=0x7fbe98010370 tx=0x7fbe98010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbea77fe700 1 --2- 172.21.15.80:0/2018175263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbea8074d00 0x7fbea807aa20 secure :-1 s=THROTTLE_DONE pgs=1562 cs=0 l=1 rx=0x7fbe98010370 tx=0x7fbe98010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbe9ffff700 1 -- 172.21.15.80:0/2018175263 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe980010e0 con 0x7fbea8074d00 2019-11-28T11:41:35.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbead991700 1 -- 172.21.15.80:0/2018175263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea8079660 con 0x7fbea8074d00 2019-11-28T11:41:35.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbe9ffff700 1 -- 172.21.15.80:0/2018175263 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe98004810 con 0x7fbea8074d00 2019-11-28T11:41:35.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.256+0000 7fbead991700 1 -- 172.21.15.80:0/2018175263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea80792e0 con 0x7fbea8074d00 2019-11-28T11:41:35.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.257+0000 7fbea77fe700 1 --2- 172.21.15.80:0/2018175263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbea8074d00 0x7fbea807aa20 secure :-1 s=THROTTLE_DONE pgs=1562 cs=0 l=1 rx=0x7fbe98010370 tx=0x7fbe98010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.257+0000 7fbe9ffff700 1 -- 172.21.15.80:0/2018175263 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbe98004240 con 0x7fbea8074d00 2019-11-28T11:41:35.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.257+0000 7fbea77fe700 1 --2- 172.21.15.80:0/2018175263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbea8074d00 0x7fbea807aa20 secure :-1 s=THROTTLE_DONE pgs=1562 cs=0 l=1 rx=0x7fbe98010370 tx=0x7fbe98010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.257+0000 7fbe9ffff700 1 --2- 172.21.15.80:0/2018175263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe80018730 0x7fbe8001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:35.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.257+0000 7fbe9ffff700 1 -- 172.21.15.80:0/2018175263 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fbe98031ae0 con 0x7fbea8074d00 2019-11-28T11:41:35.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.257+0000 7fbea6ffd700 1 --2- 172.21.15.80:0/2018175263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe80018730 0x7fbe8001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.258+0000 7fbea6ffd700 1 --2- 172.21.15.80:0/2018175263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe80018730 0x7fbe8001abc0 crc :-1 s=READY pgs=635 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:35.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.264+0000 7fbead991700 1 -- 172.21.15.80:0/2018175263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea8079660 con 0x7fbea8074d00 2019-11-28T11:41:35.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.268+0000 7fbea77fe700 1 --2- 172.21.15.80:0/2018175263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbea8074d00 0x7fbea807aa20 secure :-1 s=THROTTLE_DONE pgs=1562 cs=0 l=1 rx=0x7fbe98010370 tx=0x7fbe98010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.268+0000 7fbe9ffff700 1 -- 172.21.15.80:0/2018175263 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbe9802fff0 con 0x7fbea8074d00 2019-11-28T11:41:35.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.444+0000 7fbead991700 1 -- 172.21.15.80:0/2018175263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbea80792e0 con 0x7fbea8074d00 2019-11-28T11:41:35.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.445+0000 7fbea77fe700 1 --2- 172.21.15.80:0/2018175263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbea8074d00 0x7fbea807aa20 secure :-1 s=THROTTLE_DONE pgs=1562 cs=0 l=1 rx=0x7fbe98010370 tx=0x7fbe98010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.445+0000 7fbe9ffff700 1 -- 172.21.15.80:0/2018175263 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+14871 (secure 0 0 0) 0x7fbe9802fff0 con 0x7fbea8074d00 2019-11-28T11:41:35.479 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:35.479 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":117,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:41:26.298582+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:41:23.623555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2019-11-28T11:41:24.315901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:41:35.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.447+0000 7fbead991700 1 -- 172.21.15.80:0/2018175263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe80018730 msgr2=0x7fbe8001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:35.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.447+0000 7fbead991700 1 --2- 172.21.15.80:0/2018175263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe80018730 0x7fbe8001abc0 crc :-1 s=READY pgs=635 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:35.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.447+0000 7fbead991700 1 -- 172.21.15.80:0/2018175263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbea8074d00 msgr2=0x7fbea807aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:35.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.447+0000 7fbead991700 1 --2- 172.21.15.80:0/2018175263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbea8074d00 0x7fbea807aa20 secure :-1 s=READY pgs=1562 cs=0 l=1 rx=0x7fbe98010370 tx=0x7fbe98010710).stop 2019-11-28T11:41:35.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.447+0000 7fbead991700 1 -- 172.21.15.80:0/2018175263 shutdown_connections 2019-11-28T11:41:35.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.447+0000 7fbead991700 1 --2- 172.21.15.80:0/2018175263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe80018730 0x7fbe8001abc0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:35.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.447+0000 7fbead991700 1 --2- 172.21.15.80:0/2018175263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbea8074d00 0x7fbea807aa20 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:35.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.447+0000 7fbead991700 1 -- 172.21.15.80:0/2018175263 shutdown_connections 2019-11-28T11:41:35.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.447+0000 7fbead991700 1 -- 172.21.15.80:0/2018175263 wait complete. 2019-11-28T11:41:35.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.447+0000 7fbead991700 1 -- 172.21.15.80:0/2018175263 >> 172.21.15.80:0/2018175263 conn(0x7fbea813fa50 msgr2=0x7fbea807c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:35.491 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:41:23.623555+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 18, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'116', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:41:24.315901+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 19, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'117', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:41:35.492 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:41:35.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.583+0000 7f9678b13700 1 Processor -- start 2019-11-28T11:41:35.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.583+0000 7f9678b13700 1 -- start start 2019-11-28T11:41:35.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f9678b13700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f967415ed10 0x7f967415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:35.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f9678b13700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9674073020 0x7f9674071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:35.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f9678b13700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f96740734b0 0x7f96740723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:35.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f9678b13700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967406f3d0 con 0x7f9674073020 2019-11-28T11:41:35.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f9678b13700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967406fe00 con 0x7f96740734b0 2019-11-28T11:41:35.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f9678b13700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9674070760 con 0x7f967415ed10 2019-11-28T11:41:35.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f967259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9674073020 0x7f9674071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f967259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9674073020 0x7f9674071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39332/0 (socket says 172.21.15.80:39332) 2019-11-28T11:41:35.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f967259c700 1 -- 172.21.15.80:0/2571650835 learned_addr learned my addr 172.21.15.80:0/2571650835 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:35.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f9672d9d700 1 --2- 172.21.15.80:0/2571650835 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f967415ed10 0x7f967415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f967359e700 1 --2- 172.21.15.80:0/2571650835 >> v2:172.21.15.174:3300/0 conn(0x7f96740734b0 0x7f96740723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f967259c700 1 -- 172.21.15.80:0/2571650835 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f967415ed10 msgr2=0x7f967415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:35.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f967259c700 1 --2- 172.21.15.80:0/2571650835 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f967415ed10 0x7f967415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:35.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f967259c700 1 -- 172.21.15.80:0/2571650835 >> v2:172.21.15.174:3300/0 conn(0x7f96740734b0 msgr2=0x7f96740723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:35.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f967259c700 1 --2- 172.21.15.80:0/2571650835 >> v2:172.21.15.174:3300/0 conn(0x7f96740734b0 0x7f96740723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:35.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f967259c700 1 -- 172.21.15.80:0/2571650835 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9674070ae0 con 0x7f9674073020 2019-11-28T11:41:35.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f967259c700 1 --2- 172.21.15.80:0/2571650835 >> v2:172.21.15.80:3300/0 conn(0x7f9674073020 0x7f9674071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f966c00f6c0 tx=0x7f966c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f967259c700 1 --2- 172.21.15.80:0/2571650835 >> v2:172.21.15.80:3300/0 conn(0x7f9674073020 0x7f9674071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f966c00f6c0 tx=0x7f966c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.584+0000 7f967259c700 1 --2- 172.21.15.80:0/2571650835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9674073020 0x7f9674071ea0 secure :-1 s=READY pgs=1563 cs=0 l=1 rx=0x7f966c00f6c0 tx=0x7f966c00f570).ready entity=mon.0 client_cookie=11bd231ce9a4513b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:35.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.585+0000 7f967259c700 1 --2- 172.21.15.80:0/2571650835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9674073020 0x7f9674071ea0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f966c00f6c0 tx=0x7f966c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.585+0000 7f967259c700 1 --2- 172.21.15.80:0/2571650835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9674073020 0x7f9674071ea0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f966c00f6c0 tx=0x7f966c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.585+0000 7f967259c700 1 --2- 172.21.15.80:0/2571650835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9674073020 0x7f9674071ea0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f966c00f6c0 tx=0x7f966c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.585+0000 7f9671d9b700 1 -- 172.21.15.80:0/2571650835 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f966c000960 con 0x7f9674073020 2019-11-28T11:41:35.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.585+0000 7f9671d9b700 1 -- 172.21.15.80:0/2571650835 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966c000c90 con 0x7f9674073020 2019-11-28T11:41:35.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.585+0000 7f9671d9b700 1 -- 172.21.15.80:0/2571650835 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f966c0013a0 con 0x7f9674073020 2019-11-28T11:41:35.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.585+0000 7f9678b13700 1 -- 172.21.15.80:0/2571650835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9674073020 msgr2=0x7f9674071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:35.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.585+0000 7f9678b13700 1 --2- 172.21.15.80:0/2571650835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9674073020 0x7f9674071ea0 secure :-1 s=READY pgs=1563 cs=0 l=1 rx=0x7f966c00f6c0 tx=0x7f966c00f570).stop 2019-11-28T11:41:35.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.585+0000 7f9678b13700 1 -- 172.21.15.80:0/2571650835 shutdown_connections 2019-11-28T11:41:35.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.585+0000 7f9678b13700 1 --2- 172.21.15.80:0/2571650835 >> v2:172.21.15.174:3300/0 conn(0x7f96740734b0 0x7f96740723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:35.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.585+0000 7f9678b13700 1 --2- 172.21.15.80:0/2571650835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9674073020 0x7f9674071ea0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:35.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.585+0000 7f9678b13700 1 --2- 172.21.15.80:0/2571650835 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f967415ed10 0x7f967415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:35.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.585+0000 7f9678b13700 1 -- 172.21.15.80:0/2571650835 shutdown_connections 2019-11-28T11:41:35.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.586+0000 7f9678b13700 1 -- 172.21.15.80:0/2571650835 wait complete. 2019-11-28T11:41:35.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.586+0000 7f9678b13700 1 -- 172.21.15.80:0/2571650835 >> 172.21.15.80:0/2571650835 conn(0x7f9674061d20 msgr2=0x7f96740641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:35.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.588+0000 7f9678b13700 1 Processor -- start 2019-11-28T11:41:35.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.588+0000 7f9678b13700 1 -- start start 2019-11-28T11:41:35.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9678b13700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f967410e970 0x7f96741087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:35.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9678b13700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9674108cf0 0x7f9674107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:35.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9678b13700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9674107b70 0x7f9674107fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:35.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9678b13700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967410e430 con 0x7f967410e970 2019-11-28T11:41:35.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9678b13700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9674105860 con 0x7f9674107b70 2019-11-28T11:41:35.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9678b13700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967410da00 con 0x7f9674108cf0 2019-11-28T11:41:35.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9672d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f967410e970 0x7f96741087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9672d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f967410e970 0x7f96741087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39334/0 (socket says 172.21.15.80:39334) 2019-11-28T11:41:35.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9672d9d700 1 -- 172.21.15.80:0/375437534 learned_addr learned my addr 172.21.15.80:0/375437534 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:35.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f967259c700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9674108cf0 0x7f9674107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f967359e700 1 --2- 172.21.15.80:0/375437534 >> v2:172.21.15.174:3300/0 conn(0x7f9674107b70 0x7f9674107fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9672d9d700 1 -- 172.21.15.80:0/375437534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9674108cf0 msgr2=0x7f9674107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:35.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9672d9d700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9674108cf0 0x7f9674107630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:35.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9672d9d700 1 -- 172.21.15.80:0/375437534 >> v2:172.21.15.174:3300/0 conn(0x7f9674107b70 msgr2=0x7f9674107fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:35.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9672d9d700 1 --2- 172.21.15.80:0/375437534 >> v2:172.21.15.174:3300/0 conn(0x7f9674107b70 0x7f9674107fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:35.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9672d9d700 1 -- 172.21.15.80:0/375437534 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9674105ef0 con 0x7f967410e970 2019-11-28T11:41:35.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f967259c700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9674108cf0 0x7f9674107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:41:35.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9672d9d700 1 --2- 172.21.15.80:0/375437534 >> v2:172.21.15.80:3300/0 conn(0x7f967410e970 0x7f96741087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f965c0107d0 tx=0x7f965c010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9672d9d700 1 --2- 172.21.15.80:0/375437534 >> v2:172.21.15.80:3300/0 conn(0x7f967410e970 0x7f96741087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f965c0107d0 tx=0x7f965c010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9672d9d700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f967410e970 0x7f96741087b0 secure :-1 s=READY pgs=1564 cs=0 l=1 rx=0x7f965c0107d0 tx=0x7f965c010650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:35.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9672d9d700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f967410e970 0x7f96741087b0 secure :-1 s=THROTTLE_DONE pgs=1564 cs=0 l=1 rx=0x7f965c0107d0 tx=0x7f965c010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9672d9d700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f967410e970 0x7f96741087b0 secure :-1 s=THROTTLE_DONE pgs=1564 cs=0 l=1 rx=0x7f965c0107d0 tx=0x7f965c010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9672d9d700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f967410e970 0x7f96741087b0 secure :-1 s=THROTTLE_DONE pgs=1564 cs=0 l=1 rx=0x7f965c0107d0 tx=0x7f965c010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f966b7fe700 1 -- 172.21.15.80:0/375437534 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f965c005af0 con 0x7f967410e970 2019-11-28T11:41:35.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f966b7fe700 1 -- 172.21.15.80:0/375437534 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c005710 con 0x7f967410e970 2019-11-28T11:41:35.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f966b7fe700 1 -- 172.21.15.80:0/375437534 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f965c0060d0 con 0x7f967410e970 2019-11-28T11:41:35.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.589+0000 7f9678b13700 1 -- 172.21.15.80:0/375437534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9674106270 con 0x7f967410e970 2019-11-28T11:41:35.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.590+0000 7f9678b13700 1 -- 172.21.15.80:0/375437534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9674105ef0 con 0x7f967410e970 2019-11-28T11:41:35.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.590+0000 7f9672d9d700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f967410e970 0x7f96741087b0 secure :-1 s=THROTTLE_DONE pgs=1564 cs=0 l=1 rx=0x7f965c0107d0 tx=0x7f965c010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.590+0000 7f966b7fe700 1 -- 172.21.15.80:0/375437534 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f965c005900 con 0x7f967410e970 2019-11-28T11:41:35.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.590+0000 7f9672d9d700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f967410e970 0x7f96741087b0 secure :-1 s=THROTTLE_DONE pgs=1564 cs=0 l=1 rx=0x7f965c0107d0 tx=0x7f965c010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.590+0000 7f966b7fe700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f964c018730 0x7f964c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:35.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.590+0000 7f966b7fe700 1 -- 172.21.15.80:0/375437534 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f965c031d80 con 0x7f967410e970 2019-11-28T11:41:35.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.590+0000 7f967259c700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f964c018730 0x7f964c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.591+0000 7f967259c700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f964c018730 0x7f964c01abc0 crc :-1 s=READY pgs=636 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:35.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.598+0000 7f9678b13700 1 -- 172.21.15.80:0/375437534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9674106270 con 0x7f967410e970 2019-11-28T11:41:35.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.601+0000 7f9672d9d700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f967410e970 0x7f96741087b0 secure :-1 s=THROTTLE_DONE pgs=1564 cs=0 l=1 rx=0x7f965c0107d0 tx=0x7f965c010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.601+0000 7f966b7fe700 1 -- 172.21.15.80:0/375437534 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f965c02cfe0 con 0x7f967410e970 2019-11-28T11:41:35.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.768+0000 7f9678b13700 1 -- 172.21.15.80:0/375437534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f9674105ef0 con 0x7f967410e970 2019-11-28T11:41:35.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.768+0000 7f9672d9d700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f967410e970 0x7f96741087b0 secure :-1 s=THROTTLE_DONE pgs=1564 cs=0 l=1 rx=0x7f965c0107d0 tx=0x7f965c010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.768+0000 7f966b7fe700 1 -- 172.21.15.80:0/375437534 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v117) v1 ==== 92+0+10 (secure 0 0 0) 0x7f965c02cfe0 con 0x7f967410e970 2019-11-28T11:41:35.803 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:41:35.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.771+0000 7f9678b13700 1 -- 172.21.15.80:0/375437534 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f964c018730 msgr2=0x7f964c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:35.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.771+0000 7f9678b13700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f964c018730 0x7f964c01abc0 crc :-1 s=READY pgs=636 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:35.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.771+0000 7f9678b13700 1 -- 172.21.15.80:0/375437534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f967410e970 msgr2=0x7f96741087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:35.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.771+0000 7f9678b13700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f967410e970 0x7f96741087b0 secure :-1 s=READY pgs=1564 cs=0 l=1 rx=0x7f965c0107d0 tx=0x7f965c010650).stop 2019-11-28T11:41:35.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.771+0000 7f9678b13700 1 -- 172.21.15.80:0/375437534 shutdown_connections 2019-11-28T11:41:35.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.771+0000 7f9678b13700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f964c018730 0x7f964c01abc0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:35.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.771+0000 7f9678b13700 1 --2- 172.21.15.80:0/375437534 >> v2:172.21.15.174:3300/0 conn(0x7f9674107b70 0x7f9674107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:35.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.771+0000 7f9678b13700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9674108cf0 0x7f9674107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:35.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.771+0000 7f9678b13700 1 --2- 172.21.15.80:0/375437534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f967410e970 0x7f96741087b0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:35.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.771+0000 7f9678b13700 1 -- 172.21.15.80:0/375437534 shutdown_connections 2019-11-28T11:41:35.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.771+0000 7f9678b13700 1 -- 172.21.15.80:0/375437534 wait complete. 2019-11-28T11:41:35.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.771+0000 7f9678b13700 1 -- 172.21.15.80:0/375437534 >> 172.21.15.80:0/375437534 conn(0x7f967415e2d0 msgr2=0x7f9674147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:35.815 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:41:35.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.906+0000 7f2c6bbce700 1 Processor -- start 2019-11-28T11:41:35.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.906+0000 7f2c6bbce700 1 -- start start 2019-11-28T11:41:35.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.907+0000 7f2c6bbce700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2c6415ed10 0x7f2c6415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:35.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.907+0000 7f2c6bbce700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c640734b0 0x7f2c640726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:35.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.907+0000 7f2c6bbce700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6406db60 con 0x7f2c64073020 2019-11-28T11:41:35.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.907+0000 7f2c6bbce700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6406fe00 con 0x7f2c640734b0 2019-11-28T11:41:35.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.907+0000 7f2c6bbce700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c640700d0 con 0x7f2c6415ed10 2019-11-28T11:41:35.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.907+0000 7f2c6a96c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c640734b0 0x7f2c640726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.907+0000 7f2c6996a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2c64073020 0x7f2c64071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38662/0 (socket says 172.21.15.80:38662) 2019-11-28T11:41:35.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.907+0000 7f2c6996a700 1 -- 172.21.15.80:0/2582523629 learned_addr learned my addr 172.21.15.80:0/2582523629 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:35.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.907+0000 7f2c6a16b700 1 --2- 172.21.15.80:0/2582523629 >> v2:172.21.15.174:3300/0 conn(0x7f2c6415ed10 0x7f2c6415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.908+0000 7f2c6a96c700 1 -- 172.21.15.80:0/2582523629 >> v2:172.21.15.174:3300/0 conn(0x7f2c6415ed10 msgr2=0x7f2c6415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:35.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.908+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2582523629 >> v2:172.21.15.174:3300/0 conn(0x7f2c6415ed10 0x7f2c6415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:35.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.908+0000 7f2c6a96c700 1 -- 172.21.15.80:0/2582523629 >> v1:172.21.15.80:6789/0 conn(0x7f2c64073020 legacy=0x7f2c64071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:35.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.908+0000 7f2c6a96c700 1 -- 172.21.15.80:0/2582523629 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c64070760 con 0x7f2c640734b0 2019-11-28T11:41:35.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.908+0000 7f2c69169700 1 -- 172.21.15.80:0/2582523629 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204465183 0 0) 0x7f2c4c001070 con 0x7f2c64073020 2019-11-28T11:41:35.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.908+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2582523629 >> v2:172.21.15.80:3300/0 conn(0x7f2c640734b0 0x7f2c640726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2c5c00b2d0 tx=0x7f2c5c00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.908+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2582523629 >> v2:172.21.15.80:3300/0 conn(0x7f2c640734b0 0x7f2c640726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2c5c00b2d0 tx=0x7f2c5c00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.908+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2582523629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c640734b0 0x7f2c640726a0 secure :-1 s=READY pgs=1566 cs=0 l=1 rx=0x7f2c5c00b2d0 tx=0x7f2c5c00ba60).ready entity=mon.0 client_cookie=38835f2c0fadc3fc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:35.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.908+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2582523629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c640734b0 0x7f2c640726a0 secure :-1 s=THROTTLE_DONE pgs=1566 cs=0 l=1 rx=0x7f2c5c00b2d0 tx=0x7f2c5c00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.908+0000 7f2c69169700 1 -- 172.21.15.80:0/2582523629 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c5c009f20 con 0x7f2c640734b0 2019-11-28T11:41:35.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.908+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2582523629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c640734b0 0x7f2c640726a0 secure :-1 s=THROTTLE_DONE pgs=1566 cs=0 l=1 rx=0x7f2c5c00b2d0 tx=0x7f2c5c00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.908+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2582523629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c640734b0 0x7f2c640726a0 secure :-1 s=THROTTLE_DONE pgs=1566 cs=0 l=1 rx=0x7f2c5c00b2d0 tx=0x7f2c5c00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.908+0000 7f2c69169700 1 -- 172.21.15.80:0/2582523629 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c009b40 con 0x7f2c640734b0 2019-11-28T11:41:35.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.908+0000 7f2c69169700 1 -- 172.21.15.80:0/2582523629 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c5c00a500 con 0x7f2c640734b0 2019-11-28T11:41:35.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.908+0000 7f2c6bbce700 1 -- 172.21.15.80:0/2582523629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c640734b0 msgr2=0x7f2c640726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:35.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.908+0000 7f2c6bbce700 1 --2- 172.21.15.80:0/2582523629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c640734b0 0x7f2c640726a0 secure :-1 s=READY pgs=1566 cs=0 l=1 rx=0x7f2c5c00b2d0 tx=0x7f2c5c00ba60).stop 2019-11-28T11:41:35.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.909+0000 7f2c6bbce700 1 -- 172.21.15.80:0/2582523629 shutdown_connections 2019-11-28T11:41:35.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.909+0000 7f2c6bbce700 1 --2- 172.21.15.80:0/2582523629 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c640734b0 0x7f2c640726a0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:35.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.909+0000 7f2c6bbce700 1 --2- 172.21.15.80:0/2582523629 >> v2:172.21.15.174:3300/0 conn(0x7f2c6415ed10 0x7f2c6415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:35.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.909+0000 7f2c6bbce700 1 -- 172.21.15.80:0/2582523629 shutdown_connections 2019-11-28T11:41:35.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.909+0000 7f2c6bbce700 1 -- 172.21.15.80:0/2582523629 wait complete. 2019-11-28T11:41:35.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.909+0000 7f2c6bbce700 1 -- 172.21.15.80:0/2582523629 >> 172.21.15.80:0/2582523629 conn(0x7f2c64061d20 msgr2=0x7f2c640641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:35.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.911+0000 7f2c6bbce700 1 Processor -- start 2019-11-28T11:41:35.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.911+0000 7f2c6bbce700 1 -- start start 2019-11-28T11:41:35.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.912+0000 7f2c6bbce700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2c6410e970 0x7f2c641087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:35.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.912+0000 7f2c6bbce700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c64107e30 0x7f2c64167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:35.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.912+0000 7f2c6bbce700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6410c250 con 0x7f2c64108cf0 2019-11-28T11:41:35.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.912+0000 7f2c6bbce700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6410e430 con 0x7f2c6410e970 2019-11-28T11:41:35.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.912+0000 7f2c6bbce700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c64105860 con 0x7f2c64107e30 2019-11-28T11:41:35.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.912+0000 7f2c6a16b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2c6410e970 0x7f2c641087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.912+0000 7f2c6a96c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c64107e30 0x7f2c64167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.912+0000 7f2c6a16b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2c6410e970 0x7f2c641087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:54234/0 (socket says 172.21.15.80:54234) 2019-11-28T11:41:35.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.912+0000 7f2c6a96c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c64107e30 0x7f2c64167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:41610/0 (socket says 172.21.15.80:41610) 2019-11-28T11:41:35.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.912+0000 7f2c6a16b700 1 -- 172.21.15.80:0/2551977116 learned_addr learned my addr 172.21.15.80:0/2551977116 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:35.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.912+0000 7f2c6996a700 1 --1- 172.21.15.80:0/2551977116 >> v1:172.21.15.174:6789/0 conn(0x7f2c64108cf0 0x7f2c64107630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:54210/0 (socket says 172.21.15.80:54210) 2019-11-28T11:41:35.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c6a96c700 1 -- 172.21.15.80:0/2551977116 >> v2:172.21.15.174:3300/0 conn(0x7f2c6410e970 msgr2=0x7f2c641087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:35.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2551977116 >> v2:172.21.15.174:3300/0 conn(0x7f2c6410e970 0x7f2c641087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:35.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c6a96c700 1 -- 172.21.15.80:0/2551977116 >> v1:172.21.15.174:6789/0 conn(0x7f2c64108cf0 legacy=0x7f2c64107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:35.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c6a96c700 1 -- 172.21.15.80:0/2551977116 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c64105ef0 con 0x7f2c64107e30 2019-11-28T11:41:35.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c62ffd700 1 -- 172.21.15.80:0/2551977116 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261878772 0 0) 0x7f2c4c001280 con 0x7f2c64108cf0 2019-11-28T11:41:35.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c6a16b700 1 --2- 172.21.15.80:0/2551977116 >> v2:172.21.15.174:3300/0 conn(0x7f2c6410e970 0x7f2c641087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:35.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c64107e30 0x7f2c64167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2c5c0106f0 tx=0x7f2c5c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c64107e30 0x7f2c64167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2c5c0106f0 tx=0x7f2c5c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c64107e30 0x7f2c64167d70 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f2c5c0106f0 tx=0x7f2c5c010a90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:35.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c64107e30 0x7f2c64167d70 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f2c5c0106f0 tx=0x7f2c5c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c62ffd700 1 -- 172.21.15.80:0/2551977116 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c5c009d80 con 0x7f2c64107e30 2019-11-28T11:41:35.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c64107e30 0x7f2c64167d70 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f2c5c0106f0 tx=0x7f2c5c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c62ffd700 1 -- 172.21.15.80:0/2551977116 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c009900 con 0x7f2c64107e30 2019-11-28T11:41:35.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c6bbce700 1 -- 172.21.15.80:0/2551977116 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c64106270 con 0x7f2c64107e30 2019-11-28T11:41:35.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c64107e30 0x7f2c64167d70 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f2c5c0106f0 tx=0x7f2c5c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c62ffd700 1 -- 172.21.15.80:0/2551977116 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c5c00a070 con 0x7f2c64107e30 2019-11-28T11:41:35.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c6bbce700 1 -- 172.21.15.80:0/2551977116 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c64105ef0 con 0x7f2c64107e30 2019-11-28T11:41:35.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.913+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c64107e30 0x7f2c64167d70 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f2c5c0106f0 tx=0x7f2c5c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.914+0000 7f2c62ffd700 1 -- 172.21.15.80:0/2551977116 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2c5c009c30 con 0x7f2c64107e30 2019-11-28T11:41:35.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.914+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c64107e30 0x7f2c64167d70 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f2c5c0106f0 tx=0x7f2c5c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.914+0000 7f2c62ffd700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c48018730 0x7f2c4801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:35.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.914+0000 7f2c62ffd700 1 -- 172.21.15.80:0/2551977116 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2c5c031d50 con 0x7f2c64107e30 2019-11-28T11:41:35.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.914+0000 7f2c6a16b700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c48018730 0x7f2c4801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:35.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.914+0000 7f2c6a16b700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c48018730 0x7f2c4801abc0 crc :-1 s=READY pgs=637 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:35.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.921+0000 7f2c6bbce700 1 -- 172.21.15.80:0/2551977116 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c64106270 con 0x7f2c64107e30 2019-11-28T11:41:35.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.925+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c64107e30 0x7f2c64167d70 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f2c5c0106f0 tx=0x7f2c5c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:35.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:35.926+0000 7f2c62ffd700 1 -- 172.21.15.80:0/2551977116 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2c5c000d70 con 0x7f2c64107e30 2019-11-28T11:41:36.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.091+0000 7f2c6bbce700 1 -- 172.21.15.80:0/2551977116 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f2c64105ef0 con 0x7f2c64107e30 2019-11-28T11:41:36.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.092+0000 7f2c6a96c700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c64107e30 0x7f2c64167d70 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f2c5c0106f0 tx=0x7f2c5c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.092+0000 7f2c62ffd700 1 -- 172.21.15.80:0/2551977116 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v117) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2c5c009b90 con 0x7f2c64107e30 2019-11-28T11:41:36.126 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:41:36.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.094+0000 7f2c6bbce700 1 -- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c48018730 msgr2=0x7f2c4801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:36.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.094+0000 7f2c6bbce700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c48018730 0x7f2c4801abc0 crc :-1 s=READY pgs=637 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:36.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.094+0000 7f2c6bbce700 1 -- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c64107e30 msgr2=0x7f2c64167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:36.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.094+0000 7f2c6bbce700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c64107e30 0x7f2c64167d70 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f2c5c0106f0 tx=0x7f2c5c010a90).stop 2019-11-28T11:41:36.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.094+0000 7f2c6bbce700 1 -- 172.21.15.80:0/2551977116 shutdown_connections 2019-11-28T11:41:36.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.094+0000 7f2c6bbce700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c64107e30 0x7f2c64167d70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:36.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.094+0000 7f2c6bbce700 1 --2- 172.21.15.80:0/2551977116 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c48018730 0x7f2c4801abc0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:36.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.094+0000 7f2c6bbce700 1 --2- 172.21.15.80:0/2551977116 >> v2:172.21.15.174:3300/0 conn(0x7f2c6410e970 0x7f2c641087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:36.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.094+0000 7f2c6bbce700 1 -- 172.21.15.80:0/2551977116 shutdown_connections 2019-11-28T11:41:36.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.094+0000 7f2c6bbce700 1 -- 172.21.15.80:0/2551977116 wait complete. 2019-11-28T11:41:36.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.094+0000 7f2c6bbce700 1 -- 172.21.15.80:0/2551977116 >> 172.21.15.80:0/2551977116 conn(0x7f2c6415e2d0 msgr2=0x7f2c64147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:36.138 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:41:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.227+0000 7f790394f700 1 Processor -- start 2019-11-28T11:41:36.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.228+0000 7f790394f700 1 -- start start 2019-11-28T11:41:36.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f790394f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc15f100 0x7f78fc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:36.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f790394f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78fc06c2f0 0x7f78fc06c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:36.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f790394f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc06db60 con 0x7f78fc15ed10 2019-11-28T11:41:36.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f790394f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78fc06fe00 con 0x7f78fc06c2f0 2019-11-28T11:41:36.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f790394f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0700d0 con 0x7f78fc15f100 2019-11-28T11:41:36.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f79026ed700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78fc06c2f0 0x7f78fc06c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:36.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f7901eec700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f78fc15ed10 0x7f78fc073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38672/0 (socket says 172.21.15.80:38672) 2019-11-28T11:41:36.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f7901eec700 1 -- 172.21.15.80:0/66357542 learned_addr learned my addr 172.21.15.80:0/66357542 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:36.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f79016eb700 1 --2- 172.21.15.80:0/66357542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc15f100 0x7f78fc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:36.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f79026ed700 1 -- 172.21.15.80:0/66357542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc15f100 msgr2=0x7f78fc06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:36.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f79026ed700 1 --2- 172.21.15.80:0/66357542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc15f100 0x7f78fc06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:36.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f79026ed700 1 -- 172.21.15.80:0/66357542 >> v1:172.21.15.80:6789/0 conn(0x7f78fc15ed10 legacy=0x7f78fc073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:36.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f79026ed700 1 -- 172.21.15.80:0/66357542 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc070760 con 0x7f78fc06c2f0 2019-11-28T11:41:36.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f7900eea700 1 -- 172.21.15.80:0/66357542 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733212393 0 0) 0x7f78e4001150 con 0x7f78fc15ed10 2019-11-28T11:41:36.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f79026ed700 1 --2- 172.21.15.80:0/66357542 >> v2:172.21.15.80:3300/0 conn(0x7f78fc06c2f0 0x7f78fc06c790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f78f400b2d0 tx=0x7f78f400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f79026ed700 1 --2- 172.21.15.80:0/66357542 >> v2:172.21.15.80:3300/0 conn(0x7f78fc06c2f0 0x7f78fc06c790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f78f400b2d0 tx=0x7f78f400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f79026ed700 1 --2- 172.21.15.80:0/66357542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78fc06c2f0 0x7f78fc06c790 secure :-1 s=READY pgs=1568 cs=0 l=1 rx=0x7f78f400b2d0 tx=0x7f78f400ba60).ready entity=mon.0 client_cookie=d739ed9c5b5931ff server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:36.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f79026ed700 1 --2- 172.21.15.80:0/66357542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78fc06c2f0 0x7f78fc06c790 secure :-1 s=THROTTLE_DONE pgs=1568 cs=0 l=1 rx=0x7f78f400b2d0 tx=0x7f78f400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f7900eea700 1 -- 172.21.15.80:0/66357542 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78f4009f20 con 0x7f78fc06c2f0 2019-11-28T11:41:36.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f79026ed700 1 --2- 172.21.15.80:0/66357542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78fc06c2f0 0x7f78fc06c790 secure :-1 s=THROTTLE_DONE pgs=1568 cs=0 l=1 rx=0x7f78f400b2d0 tx=0x7f78f400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f79026ed700 1 --2- 172.21.15.80:0/66357542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78fc06c2f0 0x7f78fc06c790 secure :-1 s=THROTTLE_DONE pgs=1568 cs=0 l=1 rx=0x7f78f400b2d0 tx=0x7f78f400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f7900eea700 1 -- 172.21.15.80:0/66357542 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f4009b40 con 0x7f78fc06c2f0 2019-11-28T11:41:36.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f7900eea700 1 -- 172.21.15.80:0/66357542 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78f400a500 con 0x7f78fc06c2f0 2019-11-28T11:41:36.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f790394f700 1 -- 172.21.15.80:0/66357542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78fc06c2f0 msgr2=0x7f78fc06c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:36.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.229+0000 7f790394f700 1 --2- 172.21.15.80:0/66357542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78fc06c2f0 0x7f78fc06c790 secure :-1 s=READY pgs=1568 cs=0 l=1 rx=0x7f78f400b2d0 tx=0x7f78f400ba60).stop 2019-11-28T11:41:36.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.230+0000 7f790394f700 1 -- 172.21.15.80:0/66357542 shutdown_connections 2019-11-28T11:41:36.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.230+0000 7f790394f700 1 --2- 172.21.15.80:0/66357542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78fc06c2f0 0x7f78fc06c790 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:36.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.230+0000 7f790394f700 1 --2- 172.21.15.80:0/66357542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc15f100 0x7f78fc06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:36.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.230+0000 7f790394f700 1 -- 172.21.15.80:0/66357542 shutdown_connections 2019-11-28T11:41:36.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.230+0000 7f790394f700 1 -- 172.21.15.80:0/66357542 wait complete. 2019-11-28T11:41:36.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.230+0000 7f790394f700 1 -- 172.21.15.80:0/66357542 >> 172.21.15.80:0/66357542 conn(0x7f78fc061d20 msgr2=0x7f78fc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:36.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.233+0000 7f790394f700 1 Processor -- start 2019-11-28T11:41:36.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.233+0000 7f790394f700 1 -- start start 2019-11-28T11:41:36.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.233+0000 7f790394f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc148320 0x7f78fc10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:36.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.233+0000 7f790394f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f78fc10f290 0x7f78fc10dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:36.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.233+0000 7f790394f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc148e00 con 0x7f78fc10e110 2019-11-28T11:41:36.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.233+0000 7f790394f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78fc139ff0 con 0x7f78fc10f290 2019-11-28T11:41:36.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.233+0000 7f790394f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc13aa20 con 0x7f78fc148320 2019-11-28T11:41:36.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f79026ed700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f78fc10e110 0x7f78fc1079b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38680/0 (socket says 172.21.15.80:38680) 2019-11-28T11:41:36.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f79026ed700 1 -- 172.21.15.80:0/2940653552 learned_addr learned my addr 172.21.15.80:0/2940653552 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:36.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f7901eec700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc148320 0x7f78fc10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:36.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f79016eb700 1 --2- 172.21.15.80:0/2940653552 >> v2:172.21.15.174:3300/0 conn(0x7f78fc10f290 0x7f78fc10dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:36.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f78fa7fc700 1 -- 172.21.15.80:0/2940653552 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848416126 0 0) 0x7f78f4000cc0 con 0x7f78fc10e110 2019-11-28T11:41:36.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f78fa7fc700 1 -- 172.21.15.80:0/2940653552 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78e0002e80 con 0x7f78fc10e110 2019-11-28T11:41:36.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f7901eec700 1 -- 172.21.15.80:0/2940653552 >> v2:172.21.15.174:3300/0 conn(0x7f78fc10f290 msgr2=0x7f78fc10dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:36.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f7901eec700 1 --2- 172.21.15.80:0/2940653552 >> v2:172.21.15.174:3300/0 conn(0x7f78fc10f290 0x7f78fc10dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:36.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f78fa7fc700 1 -- 172.21.15.80:0/2940653552 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3722358170 0 0) 0x7f78f400af80 con 0x7f78fc10e110 2019-11-28T11:41:36.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f7901eec700 1 -- 172.21.15.80:0/2940653552 >> v1:172.21.15.80:6789/0 conn(0x7f78fc10e110 legacy=0x7f78fc1079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:36.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f7901eec700 1 -- 172.21.15.80:0/2940653552 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc10c490 con 0x7f78fc148320 2019-11-28T11:41:36.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f79016eb700 1 --2- 172.21.15.80:0/2940653552 >> v2:172.21.15.174:3300/0 conn(0x7f78fc10f290 0x7f78fc10dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:36.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f7901eec700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc148320 0x7f78fc10ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78e4010370 tx=0x7f78e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f7901eec700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc148320 0x7f78fc10ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78e4010370 tx=0x7f78e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f7901eec700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc148320 0x7f78fc10ed50 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7f78e4010370 tx=0x7f78e4010710).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:36.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f7901eec700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc148320 0x7f78fc10ed50 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f78e4010370 tx=0x7f78e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f78fa7fc700 1 -- 172.21.15.80:0/2940653552 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e4000ed0 con 0x7f78fc148320 2019-11-28T11:41:36.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f7901eec700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc148320 0x7f78fc10ed50 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f78e4010370 tx=0x7f78e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f7901eec700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc148320 0x7f78fc10ed50 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f78e4010370 tx=0x7f78e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f78fa7fc700 1 -- 172.21.15.80:0/2940653552 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e4004240 con 0x7f78fc148320 2019-11-28T11:41:36.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f790394f700 1 -- 172.21.15.80:0/2940653552 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc10c810 con 0x7f78fc148320 2019-11-28T11:41:36.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.234+0000 7f78fa7fc700 1 -- 172.21.15.80:0/2940653552 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e4004910 con 0x7f78fc148320 2019-11-28T11:41:36.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.235+0000 7f790394f700 1 -- 172.21.15.80:0/2940653552 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc10c490 con 0x7f78fc148320 2019-11-28T11:41:36.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.235+0000 7f7901eec700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc148320 0x7f78fc10ed50 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f78e4010370 tx=0x7f78e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.235+0000 7f78fa7fc700 1 -- 172.21.15.80:0/2940653552 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f78e4004430 con 0x7f78fc148320 2019-11-28T11:41:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.235+0000 7f7901eec700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc148320 0x7f78fc10ed50 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f78e4010370 tx=0x7f78e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.235+0000 7f78fa7fc700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78e0018780 0x7f78e001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.235+0000 7f78fa7fc700 1 -- 172.21.15.80:0/2940653552 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f78e4031c60 con 0x7f78fc148320 2019-11-28T11:41:36.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.235+0000 7f79016eb700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78e0018780 0x7f78e001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:36.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.235+0000 7f79016eb700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78e0018780 0x7f78e001abf0 crc :-1 s=READY pgs=638 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:36.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.243+0000 7f790394f700 1 -- 172.21.15.80:0/2940653552 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc10c810 con 0x7f78fc148320 2019-11-28T11:41:36.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.247+0000 7f7901eec700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc148320 0x7f78fc10ed50 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f78e4010370 tx=0x7f78e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.247+0000 7f78fa7fc700 1 -- 172.21.15.80:0/2940653552 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f78e4000c90 con 0x7f78fc148320 2019-11-28T11:41:36.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.413+0000 7f790394f700 1 -- 172.21.15.80:0/2940653552 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f78fc10c490 con 0x7f78fc148320 2019-11-28T11:41:36.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.413+0000 7f7901eec700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc148320 0x7f78fc10ed50 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f78e4010370 tx=0x7f78e4010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.413+0000 7f78fa7fc700 1 -- 172.21.15.80:0/2940653552 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v117) v1 ==== 100+0+10 (secure 0 0 0) 0x7f78e4004240 con 0x7f78fc148320 2019-11-28T11:41:36.448 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:41:36.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.416+0000 7f790394f700 1 -- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78e0018780 msgr2=0x7f78e001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:36.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.416+0000 7f790394f700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78e0018780 0x7f78e001abf0 crc :-1 s=READY pgs=638 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:36.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.416+0000 7f790394f700 1 -- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc148320 msgr2=0x7f78fc10ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:36.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.416+0000 7f790394f700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc148320 0x7f78fc10ed50 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7f78e4010370 tx=0x7f78e4010710).stop 2019-11-28T11:41:36.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.416+0000 7f790394f700 1 -- 172.21.15.80:0/2940653552 shutdown_connections 2019-11-28T11:41:36.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.416+0000 7f790394f700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78e0018780 0x7f78e001abf0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:36.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.416+0000 7f790394f700 1 --2- 172.21.15.80:0/2940653552 >> v2:172.21.15.174:3300/0 conn(0x7f78fc10f290 0x7f78fc10dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:36.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.416+0000 7f790394f700 1 --2- 172.21.15.80:0/2940653552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc148320 0x7f78fc10ed50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:36.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.416+0000 7f790394f700 1 -- 172.21.15.80:0/2940653552 shutdown_connections 2019-11-28T11:41:36.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.416+0000 7f790394f700 1 -- 172.21.15.80:0/2940653552 wait complete. 2019-11-28T11:41:36.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.416+0000 7f790394f700 1 -- 172.21.15.80:0/2940653552 >> 172.21.15.80:0/2940653552 conn(0x7f78fc15e2d0 msgr2=0x7f78fc147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:36.469 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:41:36.469 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:41:36.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.554+0000 7fc09d645700 1 Processor -- start 2019-11-28T11:41:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.554+0000 7fc09d645700 1 -- start start 2019-11-28T11:41:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.555+0000 7fc09d645700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc09806c0a0 0x7fc098072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.555+0000 7fc09d645700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09806db00 con 0x7fc0980734e0 2019-11-28T11:41:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.555+0000 7fc09d645700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09806e000 con 0x7fc098072620 2019-11-28T11:41:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.555+0000 7fc09d645700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09806fd60 con 0x7fc09806c0a0 2019-11-28T11:41:36.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.555+0000 7fc096ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc0980734e0 0x7fc098071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38686/0 (socket says 172.21.15.80:38686) 2019-11-28T11:41:36.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc096ffd700 1 -- 172.21.15.80:0/3633415709 learned_addr learned my addr 172.21.15.80:0/3633415709 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:36.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc0977fe700 1 --2- 172.21.15.80:0/3633415709 >> v2:172.21.15.174:3300/0 conn(0x7fc09806c0a0 0x7fc098072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:36.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc0967fc700 1 -- 172.21.15.80:0/3633415709 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390838267 0 0) 0x7fc08c001150 con 0x7fc0980734e0 2019-11-28T11:41:36.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc0967fc700 1 -- 172.21.15.80:0/3633415709 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc080002e80 con 0x7fc0980734e0 2019-11-28T11:41:36.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc0967fc700 1 -- 172.21.15.80:0/3633415709 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4253590076 0 0) 0x7fc08c001130 con 0x7fc0980734e0 2019-11-28T11:41:36.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc0977fe700 1 -- 172.21.15.80:0/3633415709 >> v1:172.21.15.174:6789/0 conn(0x7fc098072620 legacy=0x7fc098164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:36.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc0977fe700 1 -- 172.21.15.80:0/3633415709 >> v1:172.21.15.80:6789/0 conn(0x7fc0980734e0 legacy=0x7fc098071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:36.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc0977fe700 1 -- 172.21.15.80:0/3633415709 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0980706c0 con 0x7fc09806c0a0 2019-11-28T11:41:36.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc0977fe700 1 --2- 172.21.15.80:0/3633415709 >> v2:172.21.15.174:3300/0 conn(0x7fc09806c0a0 0x7fc098072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc08800b2d0 tx=0x7fc08800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc0977fe700 1 --2- 172.21.15.80:0/3633415709 >> v2:172.21.15.174:3300/0 conn(0x7fc09806c0a0 0x7fc098072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc08800b2d0 tx=0x7fc08800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc0977fe700 1 --2- 172.21.15.80:0/3633415709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc09806c0a0 0x7fc098072fa0 secure :-1 s=READY pgs=918 cs=0 l=1 rx=0x7fc08800b2d0 tx=0x7fc08800bae0).ready entity=mon.1 client_cookie=6e05b1a9b790d098 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:36.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc0977fe700 1 --2- 172.21.15.80:0/3633415709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc09806c0a0 0x7fc098072fa0 secure :-1 s=THROTTLE_DONE pgs=918 cs=0 l=1 rx=0x7fc08800b2d0 tx=0x7fc08800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc0967fc700 1 -- 172.21.15.80:0/3633415709 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc088000ce0 con 0x7fc09806c0a0 2019-11-28T11:41:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc0977fe700 1 --2- 172.21.15.80:0/3633415709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc09806c0a0 0x7fc098072fa0 secure :-1 s=THROTTLE_DONE pgs=918 cs=0 l=1 rx=0x7fc08800b2d0 tx=0x7fc08800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc0977fe700 1 --2- 172.21.15.80:0/3633415709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc09806c0a0 0x7fc098072fa0 secure :-1 s=THROTTLE_DONE pgs=918 cs=0 l=1 rx=0x7fc08800b2d0 tx=0x7fc08800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc0967fc700 1 -- 172.21.15.80:0/3633415709 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc088009be0 con 0x7fc09806c0a0 2019-11-28T11:41:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc0967fc700 1 -- 172.21.15.80:0/3633415709 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc08800a2b0 con 0x7fc09806c0a0 2019-11-28T11:41:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc09d645700 1 -- 172.21.15.80:0/3633415709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc09806c0a0 msgr2=0x7fc098072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.556+0000 7fc09d645700 1 --2- 172.21.15.80:0/3633415709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc09806c0a0 0x7fc098072fa0 secure :-1 s=READY pgs=918 cs=0 l=1 rx=0x7fc08800b2d0 tx=0x7fc08800bae0).stop 2019-11-28T11:41:36.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.557+0000 7fc09d645700 1 -- 172.21.15.80:0/3633415709 shutdown_connections 2019-11-28T11:41:36.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.557+0000 7fc09d645700 1 --2- 172.21.15.80:0/3633415709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc09806c0a0 0x7fc098072fa0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:36.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.557+0000 7fc09d645700 1 -- 172.21.15.80:0/3633415709 shutdown_connections 2019-11-28T11:41:36.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.557+0000 7fc09d645700 1 -- 172.21.15.80:0/3633415709 wait complete. 2019-11-28T11:41:36.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.557+0000 7fc09d645700 1 -- 172.21.15.80:0/3633415709 >> 172.21.15.80:0/3633415709 conn(0x7fc098061cf0 msgr2=0x7fc098064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:36.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.560+0000 7fc09d645700 1 Processor -- start 2019-11-28T11:41:36.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.560+0000 7fc09d645700 1 -- start start 2019-11-28T11:41:36.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc09d645700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc098112fb0 0x7fc098113440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:36.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc09d645700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09813fc20 con 0x7fc09813f580 2019-11-28T11:41:36.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc09d645700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc098122460 con 0x7fc098113980 2019-11-28T11:41:36.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc09d645700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0981236b0 con 0x7fc098112fb0 2019-11-28T11:41:36.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc0977fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc09813f580 0x7fc098114130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38694/0 (socket says 172.21.15.80:38694) 2019-11-28T11:41:36.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc0977fe700 1 -- 172.21.15.80:0/1985429159 learned_addr learned my addr 172.21.15.80:0/1985429159 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:36.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc096ffd700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc098112fb0 0x7fc098113440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:36.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc07ffff700 1 -- 172.21.15.80:0/1985429159 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645560523 0 0) 0x7fc08800b750 con 0x7fc09813f580 2019-11-28T11:41:36.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc07ffff700 1 -- 172.21.15.80:0/1985429159 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc078002e80 con 0x7fc09813f580 2019-11-28T11:41:36.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc07ffff700 1 -- 172.21.15.80:0/1985429159 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377734792 0 0) 0x7fc090000e70 con 0x7fc098113980 2019-11-28T11:41:36.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc07ffff700 1 -- 172.21.15.80:0/1985429159 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0780030b0 con 0x7fc098113980 2019-11-28T11:41:36.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc096ffd700 1 -- 172.21.15.80:0/1985429159 >> v1:172.21.15.174:6789/0 conn(0x7fc098113980 legacy=0x7fc098168a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:36.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc096ffd700 1 -- 172.21.15.80:0/1985429159 >> v1:172.21.15.80:6789/0 conn(0x7fc09813f580 legacy=0x7fc098114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:36.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc096ffd700 1 -- 172.21.15.80:0/1985429159 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc098113e00 con 0x7fc098112fb0 2019-11-28T11:41:36.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc096ffd700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc098112fb0 0x7fc098113440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc08c0103a0 tx=0x7fc08c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc096ffd700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc098112fb0 0x7fc098113440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc08c0103a0 tx=0x7fc08c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.561+0000 7fc096ffd700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc098112fb0 0x7fc098113440 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7fc08c0103a0 tx=0x7fc08c010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:36.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.562+0000 7fc096ffd700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc098112fb0 0x7fc098113440 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fc08c0103a0 tx=0x7fc08c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.562+0000 7fc07ffff700 1 -- 172.21.15.80:0/1985429159 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc08c000c90 con 0x7fc098112fb0 2019-11-28T11:41:36.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.562+0000 7fc096ffd700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc098112fb0 0x7fc098113440 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fc08c0103a0 tx=0x7fc08c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.562+0000 7fc096ffd700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc098112fb0 0x7fc098113440 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fc08c0103a0 tx=0x7fc08c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.562+0000 7fc07ffff700 1 -- 172.21.15.80:0/1985429159 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c001470 con 0x7fc098112fb0 2019-11-28T11:41:36.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.562+0000 7fc09d645700 1 -- 172.21.15.80:0/1985429159 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc098113e00 con 0x7fc098112fb0 2019-11-28T11:41:36.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.562+0000 7fc07ffff700 1 -- 172.21.15.80:0/1985429159 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc08c001bc0 con 0x7fc098112fb0 2019-11-28T11:41:36.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.562+0000 7fc09d645700 1 -- 172.21.15.80:0/1985429159 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc098113e00 con 0x7fc098112fb0 2019-11-28T11:41:36.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.562+0000 7fc096ffd700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc098112fb0 0x7fc098113440 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fc08c0103a0 tx=0x7fc08c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.562+0000 7fc07ffff700 1 -- 172.21.15.80:0/1985429159 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc08c001ae0 con 0x7fc098112fb0 2019-11-28T11:41:36.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.562+0000 7fc096ffd700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc098112fb0 0x7fc098113440 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fc08c0103a0 tx=0x7fc08c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.562+0000 7fc07ffff700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc078018750 0x7fc07801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:36.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.562+0000 7fc07ffff700 1 -- 172.21.15.80:0/1985429159 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc08c031a60 con 0x7fc098112fb0 2019-11-28T11:41:36.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.562+0000 7fc0977fe700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc078018750 0x7fc07801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:36.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.563+0000 7fc0977fe700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc078018750 0x7fc07801abe0 crc :-1 s=READY pgs=639 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.570+0000 7fc09d645700 1 -- 172.21.15.80:0/1985429159 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc098124010 con 0x7fc098112fb0 2019-11-28T11:41:36.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.573+0000 7fc096ffd700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc098112fb0 0x7fc098113440 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fc08c0103a0 tx=0x7fc08c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.574+0000 7fc07ffff700 1 -- 172.21.15.80:0/1985429159 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc08c02af10 con 0x7fc098112fb0 2019-11-28T11:41:36.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.747+0000 7fc09d645700 1 -- 172.21.15.80:0/1985429159 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc098124010 con 0x7fc098112fb0 2019-11-28T11:41:36.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.747+0000 7fc096ffd700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc098112fb0 0x7fc098113440 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fc08c0103a0 tx=0x7fc08c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:36.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.747+0000 7fc07ffff700 1 -- 172.21.15.80:0/1985429159 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+2448 (secure 0 0 0) 0x7fc08c02af10 con 0x7fc098112fb0 2019-11-28T11:41:36.789 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 84 2019-11-28T11:41:36.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.750+0000 7fc09d645700 1 -- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc078018750 msgr2=0x7fc07801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:36.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.750+0000 7fc09d645700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc078018750 0x7fc07801abe0 crc :-1 s=READY pgs=639 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:36.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.750+0000 7fc09d645700 1 -- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc098112fb0 msgr2=0x7fc098113440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:36.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.750+0000 7fc09d645700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc098112fb0 0x7fc098113440 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7fc08c0103a0 tx=0x7fc08c010740).stop 2019-11-28T11:41:36.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.750+0000 7fc09d645700 1 -- 172.21.15.80:0/1985429159 shutdown_connections 2019-11-28T11:41:36.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.750+0000 7fc09d645700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc078018750 0x7fc07801abe0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:36.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.750+0000 7fc09d645700 1 --2- 172.21.15.80:0/1985429159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc098112fb0 0x7fc098113440 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:36.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.750+0000 7fc09d645700 1 -- 172.21.15.80:0/1985429159 shutdown_connections 2019-11-28T11:41:36.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.750+0000 7fc09d645700 1 -- 172.21.15.80:0/1985429159 wait complete. 2019-11-28T11:41:36.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:36.750+0000 7fc09d645700 1 -- 172.21.15.80:0/1985429159 >> 172.21.15.80:0/1985429159 conn(0x7fc0981426c0 msgr2=0x7fc098110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:36.796 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:36.797 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":84,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1010023901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1010023901},{"type":"v1","addr":"172.21.15.80:6834","nonce":1010023901}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":82},{"gid":8556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3440274141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3440274141},{"type":"v1","addr":"172.21.15.80:6835","nonce":3440274141}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":82}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:25.297182+0000","modified":"2019-11-28T11:41:33.675187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6242":{"gid":6242,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2489382286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2489382286},{"type":"v1","addr":"172.21.15.174:6835","nonce":2489382286}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2019-11-28T11:41:37.111 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6242}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 18, u'failed': [], u'epoch': 84, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [19], u'info': {u'gid_6242': {u'export_targets': [], u'name': u'c', u'incarnation': 83, u'state_seq': 3, u'state': u'up:active', u'gid': 6242, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2489382286, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2489382286, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2489382286'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:41:25.297182+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:41:33.675187+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:41:37.111 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:41:37.112 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:41:37.243 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:41:37.243 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:41:37.243 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:41:37.244 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 6242, 2019-11-28T11:41:37.244 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:41:37.244 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:41:37.245 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 4.5332883349999999, 2019-11-28T11:41:37.245 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 84, 2019-11-28T11:41:37.245 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 117, 2019-11-28T11:41:37.245 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 117, 2019-11-28T11:41:37.246 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 9.0987977430000004 2019-11-28T11:41:37.246 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:41:37.247 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 6242, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.5332883349999999, "mdsmap_epoch": 84, "osdmap_epoch": 117, "osdmap_epoch_barrier": 117, "uptime": 9.0987977430000004 } 2019-11-28T11:41:37.248 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:41:37.248 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:41:37.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:41:37.251 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:41:37.322 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:41:37.323 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:41:37.444 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:41:37.444 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:41:37.444 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:41:37.444 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:41:37.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:41:37.445 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:41:37.516 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:41:37.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.602+0000 7f9ee3805700 1 Processor -- start 2019-11-28T11:41:37.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.602+0000 7f9ee3805700 1 -- start start 2019-11-28T11:41:37.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee3805700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9edc06c0a0 0x7f9edc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:37.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee3805700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9edc0734e0 0x7f9edc071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:37.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee3805700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc06db00 con 0x7f9edc072360 2019-11-28T11:41:37.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee3805700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9edc06fd60 con 0x7f9edc0734e0 2019-11-28T11:41:37.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee3805700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9edc070030 con 0x7f9edc06c0a0 2019-11-28T11:41:37.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee15a1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9edc0734e0 0x7f9edc071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:37.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee25a3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9edc072360 0x7f9edc06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38704/0 (socket says 172.21.15.80:38704) 2019-11-28T11:41:37.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee25a3700 1 -- 172.21.15.80:0/1042521953 learned_addr learned my addr 172.21.15.80:0/1042521953 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:37.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee1da2700 1 --2- 172.21.15.80:0/1042521953 >> v2:172.21.15.174:3300/0 conn(0x7f9edc06c0a0 0x7f9edc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:37.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee15a1700 1 -- 172.21.15.80:0/1042521953 >> v2:172.21.15.174:3300/0 conn(0x7f9edc06c0a0 msgr2=0x7f9edc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:37.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee15a1700 1 --2- 172.21.15.80:0/1042521953 >> v2:172.21.15.174:3300/0 conn(0x7f9edc06c0a0 0x7f9edc072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:37.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee15a1700 1 -- 172.21.15.80:0/1042521953 >> v1:172.21.15.80:6789/0 conn(0x7f9edc072360 legacy=0x7f9edc06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:37.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee15a1700 1 -- 172.21.15.80:0/1042521953 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc0706c0 con 0x7f9edc0734e0 2019-11-28T11:41:37.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee0da0700 1 -- 172.21.15.80:0/1042521953 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157943173 0 0) 0x7f9ecc0014d0 con 0x7f9edc072360 2019-11-28T11:41:37.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee15a1700 1 --2- 172.21.15.80:0/1042521953 >> v2:172.21.15.80:3300/0 conn(0x7f9edc0734e0 0x7f9edc071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9ed000af50 tx=0x7f9ed000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee15a1700 1 --2- 172.21.15.80:0/1042521953 >> v2:172.21.15.80:3300/0 conn(0x7f9edc0734e0 0x7f9edc071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9ed000af50 tx=0x7f9ed000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.603+0000 7f9ee15a1700 1 --2- 172.21.15.80:0/1042521953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc0734e0 0x7f9edc071e20 secure :-1 s=READY pgs=1574 cs=0 l=1 rx=0x7f9ed000af50 tx=0x7f9ed000b6e0).ready entity=mon.0 client_cookie=c78b5e527f90d885 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:37.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.604+0000 7f9ee15a1700 1 --2- 172.21.15.80:0/1042521953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc0734e0 0x7f9edc071e20 secure :-1 s=THROTTLE_DONE pgs=1574 cs=0 l=1 rx=0x7f9ed000af50 tx=0x7f9ed000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.604+0000 7f9ee0da0700 1 -- 172.21.15.80:0/1042521953 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed0007210 con 0x7f9edc0734e0 2019-11-28T11:41:37.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.604+0000 7f9ee15a1700 1 --2- 172.21.15.80:0/1042521953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc0734e0 0x7f9edc071e20 secure :-1 s=THROTTLE_DONE pgs=1574 cs=0 l=1 rx=0x7f9ed000af50 tx=0x7f9ed000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.604+0000 7f9ee15a1700 1 --2- 172.21.15.80:0/1042521953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc0734e0 0x7f9edc071e20 secure :-1 s=THROTTLE_DONE pgs=1574 cs=0 l=1 rx=0x7f9ed000af50 tx=0x7f9ed000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.604+0000 7f9ee0da0700 1 -- 172.21.15.80:0/1042521953 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed00099b0 con 0x7f9edc0734e0 2019-11-28T11:41:37.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.604+0000 7f9ee0da0700 1 -- 172.21.15.80:0/1042521953 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed000a080 con 0x7f9edc0734e0 2019-11-28T11:41:37.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.604+0000 7f9ee3805700 1 -- 172.21.15.80:0/1042521953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc0734e0 msgr2=0x7f9edc071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:37.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.604+0000 7f9ee3805700 1 --2- 172.21.15.80:0/1042521953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc0734e0 0x7f9edc071e20 secure :-1 s=READY pgs=1574 cs=0 l=1 rx=0x7f9ed000af50 tx=0x7f9ed000b6e0).stop 2019-11-28T11:41:37.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.604+0000 7f9ee3805700 1 -- 172.21.15.80:0/1042521953 shutdown_connections 2019-11-28T11:41:37.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.604+0000 7f9ee3805700 1 --2- 172.21.15.80:0/1042521953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc0734e0 0x7f9edc071e20 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:37.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.604+0000 7f9ee3805700 1 --2- 172.21.15.80:0/1042521953 >> v2:172.21.15.174:3300/0 conn(0x7f9edc06c0a0 0x7f9edc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:37.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.604+0000 7f9ee3805700 1 -- 172.21.15.80:0/1042521953 shutdown_connections 2019-11-28T11:41:37.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.604+0000 7f9ee3805700 1 -- 172.21.15.80:0/1042521953 wait complete. 2019-11-28T11:41:37.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.604+0000 7f9ee3805700 1 -- 172.21.15.80:0/1042521953 >> 172.21.15.80:0/1042521953 conn(0x7f9edc061cf0 msgr2=0x7f9edc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:37.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.607+0000 7f9ee3805700 1 Processor -- start 2019-11-28T11:41:37.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.607+0000 7f9ee3805700 1 -- start start 2019-11-28T11:41:37.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee3805700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9edc13e320 0x7f9edc13e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:37.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee3805700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9edc12a3c0 0x7f9edc12a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:37.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee3805700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc139e00 con 0x7f9edc15fdf0 2019-11-28T11:41:37.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee3805700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9edc108820 con 0x7f9edc12a3c0 2019-11-28T11:41:37.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee3805700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc108af0 con 0x7f9edc13e320 2019-11-28T11:41:37.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee25a3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9edc12a3c0 0x7f9edc12a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:37.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee25a3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9edc12a3c0 0x7f9edc12a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39394/0 (socket says 172.21.15.80:39394) 2019-11-28T11:41:37.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee25a3700 1 -- 172.21.15.80:0/3523540290 learned_addr learned my addr 172.21.15.80:0/3523540290 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:37.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee15a1700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9edc13e320 0x7f9edc13e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:37.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee25a3700 1 -- 172.21.15.80:0/3523540290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9edc13e320 msgr2=0x7f9edc13e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:37.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee25a3700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9edc13e320 0x7f9edc13e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:37.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee25a3700 1 -- 172.21.15.80:0/3523540290 >> v1:172.21.15.80:6789/0 conn(0x7f9edc15fdf0 legacy=0x7f9edc12b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:37.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee25a3700 1 -- 172.21.15.80:0/3523540290 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc10a8c0 con 0x7f9edc12a3c0 2019-11-28T11:41:37.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee25a3700 1 --2- 172.21.15.80:0/3523540290 >> v2:172.21.15.80:3300/0 conn(0x7f9edc12a3c0 0x7f9edc12a810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9ecc010790 tx=0x7f9ecc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee25a3700 1 --2- 172.21.15.80:0/3523540290 >> v2:172.21.15.80:3300/0 conn(0x7f9edc12a3c0 0x7f9edc12a810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9ecc010790 tx=0x7f9ecc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee25a3700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc12a3c0 0x7f9edc12a810 secure :-1 s=READY pgs=1576 cs=0 l=1 rx=0x7f9ecc010790 tx=0x7f9ecc0105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:37.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee25a3700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc12a3c0 0x7f9edc12a810 secure :-1 s=THROTTLE_DONE pgs=1576 cs=0 l=1 rx=0x7f9ecc010790 tx=0x7f9ecc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee25a3700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc12a3c0 0x7f9edc12a810 secure :-1 s=THROTTLE_DONE pgs=1576 cs=0 l=1 rx=0x7f9ecc010790 tx=0x7f9ecc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9eda7fc700 1 -- 172.21.15.80:0/3523540290 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ecc000cc0 con 0x7f9edc12a3c0 2019-11-28T11:41:37.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee25a3700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc12a3c0 0x7f9edc12a810 secure :-1 s=THROTTLE_DONE pgs=1576 cs=0 l=1 rx=0x7f9ecc010790 tx=0x7f9ecc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9eda7fc700 1 -- 172.21.15.80:0/3523540290 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc001460 con 0x7f9edc12a3c0 2019-11-28T11:41:37.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9ee3805700 1 -- 172.21.15.80:0/3523540290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc10a8c0 con 0x7f9edc12a3c0 2019-11-28T11:41:37.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.608+0000 7f9eda7fc700 1 -- 172.21.15.80:0/3523540290 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ecc001b70 con 0x7f9edc12a3c0 2019-11-28T11:41:37.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.609+0000 7f9ee3805700 1 -- 172.21.15.80:0/3523540290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc10a8c0 con 0x7f9edc12a3c0 2019-11-28T11:41:37.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.609+0000 7f9ee25a3700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc12a3c0 0x7f9edc12a810 secure :-1 s=THROTTLE_DONE pgs=1576 cs=0 l=1 rx=0x7f9ecc010790 tx=0x7f9ecc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.609+0000 7f9eda7fc700 1 -- 172.21.15.80:0/3523540290 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9ecc000cc0 con 0x7f9edc12a3c0 2019-11-28T11:41:37.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.609+0000 7f9ee25a3700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc12a3c0 0x7f9edc12a810 secure :-1 s=THROTTLE_DONE pgs=1576 cs=0 l=1 rx=0x7f9ecc010790 tx=0x7f9ecc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.609+0000 7f9eda7fc700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ebc018730 0x7f9ebc01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:37.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.609+0000 7f9eda7fc700 1 -- 172.21.15.80:0/3523540290 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9ecc0320b0 con 0x7f9edc12a3c0 2019-11-28T11:41:37.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.609+0000 7f9ee1da2700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ebc018730 0x7f9ebc01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:37.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.610+0000 7f9ee1da2700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ebc018730 0x7f9ebc01abe0 crc :-1 s=READY pgs=640 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:37.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.617+0000 7f9ee3805700 1 -- 172.21.15.80:0/3523540290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc109180 con 0x7f9edc12a3c0 2019-11-28T11:41:37.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.620+0000 7f9ee25a3700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc12a3c0 0x7f9edc12a810 secure :-1 s=THROTTLE_DONE pgs=1576 cs=0 l=1 rx=0x7f9ecc010790 tx=0x7f9ecc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.620+0000 7f9eda7fc700 1 -- 172.21.15.80:0/3523540290 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9ecc007930 con 0x7f9edc12a3c0 2019-11-28T11:41:37.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.797+0000 7f9ee3805700 1 -- 172.21.15.80:0/3523540290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9edc109500 con 0x7f9edc12a3c0 2019-11-28T11:41:37.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.798+0000 7f9ee25a3700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc12a3c0 0x7f9edc12a810 secure :-1 s=THROTTLE_DONE pgs=1576 cs=0 l=1 rx=0x7f9ecc010790 tx=0x7f9ecc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.798+0000 7f9eda7fc700 1 -- 172.21.15.80:0/3523540290 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f9ecc000cc0 con 0x7f9edc12a3c0 2019-11-28T11:41:37.832 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:37.832 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":117,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:41:26.298582+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:41:23.623555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2019-11-28T11:41:24.315901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:41:37.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.800+0000 7f9ee3805700 1 -- 172.21.15.80:0/3523540290 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ebc018730 msgr2=0x7f9ebc01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:37.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.800+0000 7f9ee3805700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ebc018730 0x7f9ebc01abe0 crc :-1 s=READY pgs=640 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:37.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.800+0000 7f9ee3805700 1 -- 172.21.15.80:0/3523540290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc12a3c0 msgr2=0x7f9edc12a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:37.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.800+0000 7f9ee3805700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc12a3c0 0x7f9edc12a810 secure :-1 s=READY pgs=1576 cs=0 l=1 rx=0x7f9ecc010790 tx=0x7f9ecc0105f0).stop 2019-11-28T11:41:37.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.800+0000 7f9ee3805700 1 -- 172.21.15.80:0/3523540290 shutdown_connections 2019-11-28T11:41:37.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.800+0000 7f9ee3805700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9ebc018730 0x7f9ebc01abe0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:37.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.800+0000 7f9ee3805700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9edc12a3c0 0x7f9edc12a810 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:37.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.800+0000 7f9ee3805700 1 --2- 172.21.15.80:0/3523540290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9edc13e320 0x7f9edc13e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:37.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.800+0000 7f9ee3805700 1 -- 172.21.15.80:0/3523540290 shutdown_connections 2019-11-28T11:41:37.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.800+0000 7f9ee3805700 1 -- 172.21.15.80:0/3523540290 wait complete. 2019-11-28T11:41:37.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.800+0000 7f9ee3805700 1 -- 172.21.15.80:0/3523540290 >> 172.21.15.80:0/3523540290 conn(0x7f9edc127dc0 msgr2=0x7f9edc141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:37.845 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:41:23.623555+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 18, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'116', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:41:24.315901+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 19, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'117', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:41:37.846 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:41:37.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.935+0000 7fc7f97be700 1 Processor -- start 2019-11-28T11:41:37.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.935+0000 7fc7f97be700 1 -- start start 2019-11-28T11:41:37.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.936+0000 7fc7f97be700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7f415ed10 0x7fc7f415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:37.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.936+0000 7fc7f97be700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f406db60 con 0x7fc7f40734b0 2019-11-28T11:41:37.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.936+0000 7fc7f97be700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f406e060 con 0x7fc7f4073020 2019-11-28T11:41:37.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.936+0000 7fc7f97be700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f406fe00 con 0x7fc7f415ed10 2019-11-28T11:41:37.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.936+0000 7fc7f37fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7f415ed10 0x7fc7f415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:37.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.936+0000 7fc7f3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc7f40734b0 0x7fc7f40726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38716/0 (socket says 172.21.15.80:38716) 2019-11-28T11:41:37.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.936+0000 7fc7f3fff700 1 -- 172.21.15.80:0/914806306 learned_addr learned my addr 172.21.15.80:0/914806306 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.936+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/914806306 >> v2:172.21.15.80:3300/0 conn(0x7fc7f415ed10 0x7fc7f415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39398/0 (socket says 172.21.15.80:39398) 2019-11-28T11:41:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.937+0000 7fc7f37fe700 1 -- 172.21.15.80:0/914806306 >> v1:172.21.15.174:6789/0 conn(0x7fc7f4073020 legacy=0x7fc7f4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.937+0000 7fc7f37fe700 1 -- 172.21.15.80:0/914806306 >> v1:172.21.15.80:6789/0 conn(0x7fc7f40734b0 legacy=0x7fc7f40726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.937+0000 7fc7f27fc700 1 -- 172.21.15.80:0/914806306 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027279518 0 0) 0x7fc7ec001150 con 0x7fc7f40734b0 2019-11-28T11:41:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.937+0000 7fc7f37fe700 1 -- 172.21.15.80:0/914806306 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f4070760 con 0x7fc7f415ed10 2019-11-28T11:41:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.937+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/914806306 >> v2:172.21.15.80:3300/0 conn(0x7fc7f415ed10 0x7fc7f415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc7e400af50 tx=0x7fc7e400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.937+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/914806306 >> v2:172.21.15.80:3300/0 conn(0x7fc7f415ed10 0x7fc7f415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc7e400af50 tx=0x7fc7e400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.937+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/914806306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f415ed10 0x7fc7f415f100 secure :-1 s=READY pgs=1578 cs=0 l=1 rx=0x7fc7e400af50 tx=0x7fc7e400b760).ready entity=mon.0 client_cookie=79a7ace777f43673 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:37.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.937+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/914806306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f415ed10 0x7fc7f415f100 secure :-1 s=THROTTLE_DONE pgs=1578 cs=0 l=1 rx=0x7fc7e400af50 tx=0x7fc7e400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.937+0000 7fc7f27fc700 1 -- 172.21.15.80:0/914806306 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7e4000960 con 0x7fc7f415ed10 2019-11-28T11:41:37.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.937+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/914806306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f415ed10 0x7fc7f415f100 secure :-1 s=THROTTLE_DONE pgs=1578 cs=0 l=1 rx=0x7fc7e400af50 tx=0x7fc7e400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.937+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/914806306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f415ed10 0x7fc7f415f100 secure :-1 s=THROTTLE_DONE pgs=1578 cs=0 l=1 rx=0x7fc7e400af50 tx=0x7fc7e400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.937+0000 7fc7f27fc700 1 -- 172.21.15.80:0/914806306 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e4009860 con 0x7fc7f415ed10 2019-11-28T11:41:37.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.937+0000 7fc7f27fc700 1 -- 172.21.15.80:0/914806306 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7e4009f30 con 0x7fc7f415ed10 2019-11-28T11:41:37.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.937+0000 7fc7f97be700 1 -- 172.21.15.80:0/914806306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f415ed10 msgr2=0x7fc7f415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:37.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.937+0000 7fc7f97be700 1 --2- 172.21.15.80:0/914806306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f415ed10 0x7fc7f415f100 secure :-1 s=READY pgs=1578 cs=0 l=1 rx=0x7fc7e400af50 tx=0x7fc7e400b760).stop 2019-11-28T11:41:37.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.938+0000 7fc7f97be700 1 -- 172.21.15.80:0/914806306 shutdown_connections 2019-11-28T11:41:37.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.938+0000 7fc7f97be700 1 --2- 172.21.15.80:0/914806306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f415ed10 0x7fc7f415f100 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:37.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.938+0000 7fc7f97be700 1 -- 172.21.15.80:0/914806306 shutdown_connections 2019-11-28T11:41:37.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.938+0000 7fc7f97be700 1 -- 172.21.15.80:0/914806306 wait complete. 2019-11-28T11:41:37.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.938+0000 7fc7f97be700 1 -- 172.21.15.80:0/914806306 >> 172.21.15.80:0/914806306 conn(0x7fc7f4061d20 msgr2=0x7fc7f40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.940+0000 7fc7f97be700 1 Processor -- start 2019-11-28T11:41:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.940+0000 7fc7f97be700 1 -- start start 2019-11-28T11:41:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.941+0000 7fc7f97be700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7f410e970 0x7fc7f41087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.941+0000 7fc7f97be700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc7f4108cf0 0x7fc7f4107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.941+0000 7fc7f97be700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f410c250 con 0x7fc7f4107b70 2019-11-28T11:41:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.941+0000 7fc7f97be700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f410e430 con 0x7fc7f410e970 2019-11-28T11:41:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.941+0000 7fc7f97be700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f4105860 con 0x7fc7f4108cf0 2019-11-28T11:41:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.941+0000 7fc7f37fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7f410e970 0x7fc7f41087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.941+0000 7fc7f37fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7f410e970 0x7fc7f41087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39406/0 (socket says 172.21.15.80:39406) 2019-11-28T11:41:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.941+0000 7fc7f37fe700 1 -- 172.21.15.80:0/2319212577 learned_addr learned my addr 172.21.15.80:0/2319212577 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7f2ffd700 1 --2- 172.21.15.80:0/2319212577 >> v2:172.21.15.174:3300/0 conn(0x7fc7f4108cf0 0x7fc7f4107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7f37fe700 1 -- 172.21.15.80:0/2319212577 >> v2:172.21.15.174:3300/0 conn(0x7fc7f4108cf0 msgr2=0x7fc7f4107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:37.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/2319212577 >> v2:172.21.15.174:3300/0 conn(0x7fc7f4108cf0 0x7fc7f4107630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:37.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7f37fe700 1 -- 172.21.15.80:0/2319212577 >> v1:172.21.15.80:6789/0 conn(0x7fc7f4107b70 legacy=0x7fc7f410ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:37.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7f37fe700 1 -- 172.21.15.80:0/2319212577 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f4105ef0 con 0x7fc7f410e970 2019-11-28T11:41:37.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/2319212577 >> v2:172.21.15.80:3300/0 conn(0x7fc7f410e970 0x7fc7f41087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7e4010470 tx=0x7fc7e40102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/2319212577 >> v2:172.21.15.80:3300/0 conn(0x7fc7f410e970 0x7fc7f41087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7e4010470 tx=0x7fc7e40102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/2319212577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f410e970 0x7fc7f41087b0 secure :-1 s=READY pgs=1580 cs=0 l=1 rx=0x7fc7e4010470 tx=0x7fc7e40102a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:37.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/2319212577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f410e970 0x7fc7f41087b0 secure :-1 s=THROTTLE_DONE pgs=1580 cs=0 l=1 rx=0x7fc7e4010470 tx=0x7fc7e40102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/2319212577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f410e970 0x7fc7f41087b0 secure :-1 s=THROTTLE_DONE pgs=1580 cs=0 l=1 rx=0x7fc7e4010470 tx=0x7fc7e40102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7ebfff700 1 -- 172.21.15.80:0/2319212577 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7e4000940 con 0x7fc7f410e970 2019-11-28T11:41:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/2319212577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f410e970 0x7fc7f41087b0 secure :-1 s=THROTTLE_DONE pgs=1580 cs=0 l=1 rx=0x7fc7e4010470 tx=0x7fc7e40102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7ebfff700 1 -- 172.21.15.80:0/2319212577 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e4009980 con 0x7fc7f410e970 2019-11-28T11:41:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7ebfff700 1 -- 172.21.15.80:0/2319212577 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7e4009fd0 con 0x7fc7f410e970 2019-11-28T11:41:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7f97be700 1 -- 172.21.15.80:0/2319212577 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f4106270 con 0x7fc7f410e970 2019-11-28T11:41:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7f97be700 1 -- 172.21.15.80:0/2319212577 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f4105ef0 con 0x7fc7f410e970 2019-11-28T11:41:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.942+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/2319212577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f410e970 0x7fc7f41087b0 secure :-1 s=THROTTLE_DONE pgs=1580 cs=0 l=1 rx=0x7fc7e4010470 tx=0x7fc7e40102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.943+0000 7fc7ebfff700 1 -- 172.21.15.80:0/2319212577 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc7e4009580 con 0x7fc7f410e970 2019-11-28T11:41:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.943+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/2319212577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f410e970 0x7fc7f41087b0 secure :-1 s=THROTTLE_DONE pgs=1580 cs=0 l=1 rx=0x7fc7e4010470 tx=0x7fc7e40102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.943+0000 7fc7ebfff700 1 --2- 172.21.15.80:0/2319212577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7cc018730 0x7fc7cc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.943+0000 7fc7ebfff700 1 -- 172.21.15.80:0/2319212577 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc7e4031ab0 con 0x7fc7f410e970 2019-11-28T11:41:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.943+0000 7fc7f2ffd700 1 --2- 172.21.15.80:0/2319212577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7cc018730 0x7fc7cc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:37.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.943+0000 7fc7f2ffd700 1 --2- 172.21.15.80:0/2319212577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7cc018730 0x7fc7cc01abc0 crc :-1 s=READY pgs=641 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:37.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.951+0000 7fc7f97be700 1 -- 172.21.15.80:0/2319212577 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f4106270 con 0x7fc7f410e970 2019-11-28T11:41:37.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.954+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/2319212577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f410e970 0x7fc7f41087b0 secure :-1 s=THROTTLE_DONE pgs=1580 cs=0 l=1 rx=0x7fc7e4010470 tx=0x7fc7e40102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:37.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:37.954+0000 7fc7ebfff700 1 -- 172.21.15.80:0/2319212577 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc7e4000940 con 0x7fc7f410e970 2019-11-28T11:41:38.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.119+0000 7fc7f97be700 1 -- 172.21.15.80:0/2319212577 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fc7f4105ef0 con 0x7fc7f410e970 2019-11-28T11:41:38.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.119+0000 7fc7f37fe700 1 --2- 172.21.15.80:0/2319212577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f410e970 0x7fc7f41087b0 secure :-1 s=THROTTLE_DONE pgs=1580 cs=0 l=1 rx=0x7fc7e4010470 tx=0x7fc7e40102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.119+0000 7fc7ebfff700 1 -- 172.21.15.80:0/2319212577 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v117) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc7e4009580 con 0x7fc7f410e970 2019-11-28T11:41:38.154 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:41:38.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.122+0000 7fc7f97be700 1 -- 172.21.15.80:0/2319212577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7cc018730 msgr2=0x7fc7cc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.122+0000 7fc7f97be700 1 --2- 172.21.15.80:0/2319212577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7cc018730 0x7fc7cc01abc0 crc :-1 s=READY pgs=641 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.122+0000 7fc7f97be700 1 -- 172.21.15.80:0/2319212577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f410e970 msgr2=0x7fc7f41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.122+0000 7fc7f97be700 1 --2- 172.21.15.80:0/2319212577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f410e970 0x7fc7f41087b0 secure :-1 s=READY pgs=1580 cs=0 l=1 rx=0x7fc7e4010470 tx=0x7fc7e40102a0).stop 2019-11-28T11:41:38.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.122+0000 7fc7f97be700 1 -- 172.21.15.80:0/2319212577 shutdown_connections 2019-11-28T11:41:38.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.122+0000 7fc7f97be700 1 --2- 172.21.15.80:0/2319212577 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7cc018730 0x7fc7cc01abc0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.122+0000 7fc7f97be700 1 --2- 172.21.15.80:0/2319212577 >> v2:172.21.15.174:3300/0 conn(0x7fc7f4108cf0 0x7fc7f4107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.122+0000 7fc7f97be700 1 --2- 172.21.15.80:0/2319212577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7f410e970 0x7fc7f41087b0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.122+0000 7fc7f97be700 1 -- 172.21.15.80:0/2319212577 shutdown_connections 2019-11-28T11:41:38.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.122+0000 7fc7f97be700 1 -- 172.21.15.80:0/2319212577 wait complete. 2019-11-28T11:41:38.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.122+0000 7fc7f97be700 1 -- 172.21.15.80:0/2319212577 >> 172.21.15.80:0/2319212577 conn(0x7fc7f415e2d0 msgr2=0x7fc7f4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:38.166 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:41:38.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.256+0000 7f2458afb700 1 Processor -- start 2019-11-28T11:41:38.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.256+0000 7f2458afb700 1 -- start start 2019-11-28T11:41:38.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2458afb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f245415ed10 0x7f245415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:38.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2458afb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245406db60 con 0x7f24540734b0 2019-11-28T11:41:38.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2458afb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245406e060 con 0x7f2454073020 2019-11-28T11:41:38.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2458afb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245406fe00 con 0x7f245415ed10 2019-11-28T11:41:38.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f245359e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f24540734b0 0x7f24540726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38730/0 (socket says 172.21.15.80:38730) 2019-11-28T11:41:38.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f245359e700 1 -- 172.21.15.80:0/428519889 learned_addr learned my addr 172.21.15.80:0/428519889 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:38.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2452d9d700 1 --2- 172.21.15.80:0/428519889 >> v2:172.21.15.174:3300/0 conn(0x7f245415ed10 0x7f245415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2451d9b700 1 -- 172.21.15.80:0/428519889 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259531730 0 0) 0x7f2444001150 con 0x7f24540734b0 2019-11-28T11:41:38.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2451d9b700 1 -- 172.21.15.80:0/428519889 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2434002e80 con 0x7f24540734b0 2019-11-28T11:41:38.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2451d9b700 1 -- 172.21.15.80:0/428519889 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 324927307 0 0) 0x7f2444001130 con 0x7f24540734b0 2019-11-28T11:41:38.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2451d9b700 1 -- 172.21.15.80:0/428519889 >> v2:172.21.15.174:3300/0 conn(0x7f245415ed10 msgr2=0x7f245415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:38.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2451d9b700 1 --2- 172.21.15.80:0/428519889 >> v2:172.21.15.174:3300/0 conn(0x7f245415ed10 0x7f245415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:38.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2451d9b700 1 -- 172.21.15.80:0/428519889 >> v1:172.21.15.174:6789/0 conn(0x7f2454073020 legacy=0x7f2454071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2451d9b700 1 -- 172.21.15.80:0/428519889 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2454070760 con 0x7f24540734b0 2019-11-28T11:41:38.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2451d9b700 1 -- 172.21.15.80:0/428519889 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f2444001660 con 0x7f24540734b0 2019-11-28T11:41:38.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2451d9b700 1 -- 172.21.15.80:0/428519889 >> v1:172.21.15.80:6789/0 conn(0x7f24540734b0 legacy=0x7f24540726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2451d9b700 1 --2- 172.21.15.80:0/428519889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434003ab0 0x7f2434005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:38.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2451d9b700 1 --2- 172.21.15.80:0/428519889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2434006670 0x7f2434008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:38.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.257+0000 7f2451d9b700 1 --2- 172.21.15.80:0/428519889 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24340093a0 0x7f243400b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:38.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2451d9b700 1 -- 172.21.15.80:0/428519889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243400c020 con 0x7f2434003ab0 2019-11-28T11:41:38.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2451d9b700 1 -- 172.21.15.80:0/428519889 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2434050220 con 0x7f2434006670 2019-11-28T11:41:38.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2451d9b700 1 -- 172.21.15.80:0/428519889 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2434050450 con 0x7f24340093a0 2019-11-28T11:41:38.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2452d9d700 1 --2- 172.21.15.80:0/428519889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434003ab0 0x7f2434005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f245359e700 1 --2- 172.21.15.80:0/428519889 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24340093a0 0x7f243400b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f245259c700 1 --2- 172.21.15.80:0/428519889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2434006670 0x7f2434008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2452d9d700 1 -- 172.21.15.80:0/428519889 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24340093a0 msgr2=0x7f243400b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:38.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2452d9d700 1 --2- 172.21.15.80:0/428519889 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24340093a0 0x7f243400b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:38.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2452d9d700 1 -- 172.21.15.80:0/428519889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2434006670 msgr2=0x7f2434008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:38.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2452d9d700 1 --2- 172.21.15.80:0/428519889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2434006670 0x7f2434008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:38.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2452d9d700 1 -- 172.21.15.80:0/428519889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2434050700 con 0x7f2434003ab0 2019-11-28T11:41:38.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f245359e700 1 -- 172.21.15.80:0/428519889 reap_dead start 2019-11-28T11:41:38.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2452d9d700 1 --2- 172.21.15.80:0/428519889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434003ab0 0x7f2434005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f243c00b6e0 tx=0x7f243c00b5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2452d9d700 1 --2- 172.21.15.80:0/428519889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434003ab0 0x7f2434005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f243c00b6e0 tx=0x7f243c00b5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2452d9d700 1 --2- 172.21.15.80:0/428519889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434003ab0 0x7f2434005f10 secure :-1 s=READY pgs=1582 cs=0 l=1 rx=0x7f243c00b6e0 tx=0x7f243c00b5b0).ready entity=mon.0 client_cookie=e1b9a430beb20131 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:38.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2452d9d700 1 --2- 172.21.15.80:0/428519889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434003ab0 0x7f2434005f10 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f243c00b6e0 tx=0x7f243c00b5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2451d9b700 1 -- 172.21.15.80:0/428519889 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f243c000960 con 0x7f2434003ab0 2019-11-28T11:41:38.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2452d9d700 1 --2- 172.21.15.80:0/428519889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434003ab0 0x7f2434005f10 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f243c00b6e0 tx=0x7f243c00b5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2452d9d700 1 --2- 172.21.15.80:0/428519889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434003ab0 0x7f2434005f10 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f243c00b6e0 tx=0x7f243c00b5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2451d9b700 1 -- 172.21.15.80:0/428519889 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c009770 con 0x7f2434003ab0 2019-11-28T11:41:38.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2451d9b700 1 -- 172.21.15.80:0/428519889 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f243c000960 con 0x7f2434003ab0 2019-11-28T11:41:38.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2458afb700 1 -- 172.21.15.80:0/428519889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434003ab0 msgr2=0x7f2434005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.258+0000 7f2458afb700 1 --2- 172.21.15.80:0/428519889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434003ab0 0x7f2434005f10 secure :-1 s=READY pgs=1582 cs=0 l=1 rx=0x7f243c00b6e0 tx=0x7f243c00b5b0).stop 2019-11-28T11:41:38.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.259+0000 7f2458afb700 1 -- 172.21.15.80:0/428519889 shutdown_connections 2019-11-28T11:41:38.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.259+0000 7f2458afb700 1 --2- 172.21.15.80:0/428519889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2434003ab0 0x7f2434005f10 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.259+0000 7f2458afb700 1 -- 172.21.15.80:0/428519889 shutdown_connections 2019-11-28T11:41:38.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.259+0000 7f2458afb700 1 -- 172.21.15.80:0/428519889 wait complete. 2019-11-28T11:41:38.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.259+0000 7f2458afb700 1 -- 172.21.15.80:0/428519889 >> 172.21.15.80:0/428519889 conn(0x7f2454061d20 msgr2=0x7f24540641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:38.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.261+0000 7f2458afb700 1 Processor -- start 2019-11-28T11:41:38.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.261+0000 7f2458afb700 1 -- start start 2019-11-28T11:41:38.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.262+0000 7f2458afb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f245412c2a0 0x7f245412c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:38.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.262+0000 7f2458afb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f24541510e0 0x7f2454151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:38.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.262+0000 7f2458afb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245410a310 con 0x7f2454108630 2019-11-28T11:41:38.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.262+0000 7f2458afb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245412ee80 con 0x7f24541510e0 2019-11-28T11:41:38.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.262+0000 7f2458afb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24541329f0 con 0x7f245412c2a0 2019-11-28T11:41:38.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.262+0000 7f245359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f24541510e0 0x7f2454151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.262+0000 7f245359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f24541510e0 0x7f2454151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39428/0 (socket says 172.21.15.80:39428) 2019-11-28T11:41:38.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.262+0000 7f245359e700 1 -- 172.21.15.80:0/2660241882 learned_addr learned my addr 172.21.15.80:0/2660241882 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:38.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.262+0000 7f245259c700 1 --2- 172.21.15.80:0/2660241882 >> v2:172.21.15.174:3300/0 conn(0x7f245412c2a0 0x7f245412c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.263+0000 7f245359e700 1 -- 172.21.15.80:0/2660241882 >> v2:172.21.15.174:3300/0 conn(0x7f245412c2a0 msgr2=0x7f245412c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.263+0000 7f245359e700 1 --2- 172.21.15.80:0/2660241882 >> v2:172.21.15.174:3300/0 conn(0x7f245412c2a0 0x7f245412c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.263+0000 7f245359e700 1 -- 172.21.15.80:0/2660241882 >> v1:172.21.15.174:6789/0 conn(0x7f2454108630 legacy=0x7f2454152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.263+0000 7f245359e700 1 -- 172.21.15.80:0/2660241882 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2454133350 con 0x7f24541510e0 2019-11-28T11:41:38.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.263+0000 7f245359e700 1 --2- 172.21.15.80:0/2660241882 >> v2:172.21.15.80:3300/0 conn(0x7f24541510e0 0x7f2454151560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2444010420 tx=0x7f24440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.263+0000 7f245359e700 1 --2- 172.21.15.80:0/2660241882 >> v2:172.21.15.80:3300/0 conn(0x7f24541510e0 0x7f2454151560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2444010420 tx=0x7f24440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.263+0000 7f245359e700 1 --2- 172.21.15.80:0/2660241882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24541510e0 0x7f2454151560 secure :-1 s=READY pgs=1583 cs=0 l=1 rx=0x7f2444010420 tx=0x7f24440102a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:38.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.263+0000 7f245359e700 1 --2- 172.21.15.80:0/2660241882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24541510e0 0x7f2454151560 secure :-1 s=THROTTLE_DONE pgs=1583 cs=0 l=1 rx=0x7f2444010420 tx=0x7f24440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.263+0000 7f245359e700 1 --2- 172.21.15.80:0/2660241882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24541510e0 0x7f2454151560 secure :-1 s=THROTTLE_DONE pgs=1583 cs=0 l=1 rx=0x7f2444010420 tx=0x7f24440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.263+0000 7f245359e700 1 --2- 172.21.15.80:0/2660241882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24541510e0 0x7f2454151560 secure :-1 s=THROTTLE_DONE pgs=1583 cs=0 l=1 rx=0x7f2444010420 tx=0x7f24440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.263+0000 7f244b7fe700 1 -- 172.21.15.80:0/2660241882 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2444000ef0 con 0x7f24541510e0 2019-11-28T11:41:38.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.263+0000 7f244b7fe700 1 -- 172.21.15.80:0/2660241882 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2444004240 con 0x7f24541510e0 2019-11-28T11:41:38.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.263+0000 7f2458afb700 1 -- 172.21.15.80:0/2660241882 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24541336d0 con 0x7f24541510e0 2019-11-28T11:41:38.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.263+0000 7f244b7fe700 1 -- 172.21.15.80:0/2660241882 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2444004890 con 0x7f24541510e0 2019-11-28T11:41:38.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.263+0000 7f2458afb700 1 -- 172.21.15.80:0/2660241882 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2454133350 con 0x7f24541510e0 2019-11-28T11:41:38.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.263+0000 7f245359e700 1 --2- 172.21.15.80:0/2660241882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24541510e0 0x7f2454151560 secure :-1 s=THROTTLE_DONE pgs=1583 cs=0 l=1 rx=0x7f2444010420 tx=0x7f24440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.264+0000 7f244b7fe700 1 -- 172.21.15.80:0/2660241882 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2444000ef0 con 0x7f24541510e0 2019-11-28T11:41:38.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.264+0000 7f245359e700 1 --2- 172.21.15.80:0/2660241882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24541510e0 0x7f2454151560 secure :-1 s=THROTTLE_DONE pgs=1583 cs=0 l=1 rx=0x7f2444010420 tx=0x7f24440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.264+0000 7f244b7fe700 1 --2- 172.21.15.80:0/2660241882 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f242c018730 0x7f242c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:38.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.264+0000 7f244b7fe700 1 -- 172.21.15.80:0/2660241882 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2444031ac0 con 0x7f24541510e0 2019-11-28T11:41:38.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.264+0000 7f2452d9d700 1 --2- 172.21.15.80:0/2660241882 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f242c018730 0x7f242c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.264+0000 7f2452d9d700 1 --2- 172.21.15.80:0/2660241882 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f242c018730 0x7f242c01abc0 crc :-1 s=READY pgs=642 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:38.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.271+0000 7f2458afb700 1 -- 172.21.15.80:0/2660241882 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24541336d0 con 0x7f24541510e0 2019-11-28T11:41:38.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.275+0000 7f245359e700 1 --2- 172.21.15.80:0/2660241882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24541510e0 0x7f2454151560 secure :-1 s=THROTTLE_DONE pgs=1583 cs=0 l=1 rx=0x7f2444010420 tx=0x7f24440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.275+0000 7f244b7fe700 1 -- 172.21.15.80:0/2660241882 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2444001340 con 0x7f24541510e0 2019-11-28T11:41:38.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.440+0000 7f2458afb700 1 -- 172.21.15.80:0/2660241882 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f2454133350 con 0x7f24541510e0 2019-11-28T11:41:38.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.441+0000 7f245359e700 1 --2- 172.21.15.80:0/2660241882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24541510e0 0x7f2454151560 secure :-1 s=THROTTLE_DONE pgs=1583 cs=0 l=1 rx=0x7f2444010420 tx=0x7f24440102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.441+0000 7f244b7fe700 1 -- 172.21.15.80:0/2660241882 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v117) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2444000ef0 con 0x7f24541510e0 2019-11-28T11:41:38.475 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:41:38.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.443+0000 7f2458afb700 1 -- 172.21.15.80:0/2660241882 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f242c018730 msgr2=0x7f242c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.443+0000 7f2458afb700 1 --2- 172.21.15.80:0/2660241882 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f242c018730 0x7f242c01abc0 crc :-1 s=READY pgs=642 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.443+0000 7f2458afb700 1 -- 172.21.15.80:0/2660241882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24541510e0 msgr2=0x7f2454151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.443+0000 7f2458afb700 1 --2- 172.21.15.80:0/2660241882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24541510e0 0x7f2454151560 secure :-1 s=READY pgs=1583 cs=0 l=1 rx=0x7f2444010420 tx=0x7f24440102a0).stop 2019-11-28T11:41:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.443+0000 7f2458afb700 1 -- 172.21.15.80:0/2660241882 shutdown_connections 2019-11-28T11:41:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.443+0000 7f2458afb700 1 --2- 172.21.15.80:0/2660241882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24541510e0 0x7f2454151560 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.443+0000 7f2458afb700 1 --2- 172.21.15.80:0/2660241882 >> v2:172.21.15.174:3300/0 conn(0x7f245412c2a0 0x7f245412c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.443+0000 7f2458afb700 1 --2- 172.21.15.80:0/2660241882 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f242c018730 0x7f242c01abc0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.443+0000 7f2458afb700 1 -- 172.21.15.80:0/2660241882 shutdown_connections 2019-11-28T11:41:38.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.443+0000 7f2458afb700 1 -- 172.21.15.80:0/2660241882 wait complete. 2019-11-28T11:41:38.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.443+0000 7f2458afb700 1 -- 172.21.15.80:0/2660241882 >> 172.21.15.80:0/2660241882 conn(0x7f245414dbb0 msgr2=0x7f2454142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:38.487 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:41:38.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.576+0000 7fef52bea700 1 Processor -- start 2019-11-28T11:41:38.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.576+0000 7fef52bea700 1 -- start start 2019-11-28T11:41:38.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.577+0000 7fef52bea700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c15ed10 0x7fef4c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:38.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.577+0000 7fef52bea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef4c0734b0 0x7fef4c0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:38.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.577+0000 7fef52bea700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef4c06db60 con 0x7fef4c073020 2019-11-28T11:41:38.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.577+0000 7fef52bea700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4c06f3d0 con 0x7fef4c0734b0 2019-11-28T11:41:38.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.577+0000 7fef52bea700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c06fe00 con 0x7fef4c15ed10 2019-11-28T11:41:38.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.577+0000 7fef51988700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef4c0734b0 0x7fef4c0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef51187700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c15ed10 0x7fef4c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef51187700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c15ed10 0x7fef4c15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:41692/0 (socket says 172.21.15.80:41692) 2019-11-28T11:41:38.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef51988700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef4c0734b0 0x7fef4c0726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39434/0 (socket says 172.21.15.80:39434) 2019-11-28T11:41:38.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef51187700 1 -- 172.21.15.80:0/523879228 learned_addr learned my addr 172.21.15.80:0/523879228 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:38.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef4bfff700 1 -- 172.21.15.80:0/523879228 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444697348 0 0) 0x7fef3c001030 con 0x7fef4c073020 2019-11-28T11:41:38.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef51988700 1 -- 172.21.15.80:0/523879228 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c15ed10 msgr2=0x7fef4c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:38.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef51988700 1 --2- 172.21.15.80:0/523879228 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c15ed10 0x7fef4c15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:38.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef51988700 1 -- 172.21.15.80:0/523879228 >> v1:172.21.15.174:6789/0 conn(0x7fef4c073020 legacy=0x7fef4c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef51988700 1 -- 172.21.15.80:0/523879228 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c070760 con 0x7fef4c0734b0 2019-11-28T11:41:38.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef51187700 1 --2- 172.21.15.80:0/523879228 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c15ed10 0x7fef4c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:38.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef51988700 1 --2- 172.21.15.80:0/523879228 >> v2:172.21.15.80:3300/0 conn(0x7fef4c0734b0 0x7fef4c0726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fef4400af50 tx=0x7fef4400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef51988700 1 --2- 172.21.15.80:0/523879228 >> v2:172.21.15.80:3300/0 conn(0x7fef4c0734b0 0x7fef4c0726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fef4400af50 tx=0x7fef4400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef51988700 1 --2- 172.21.15.80:0/523879228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef4c0734b0 0x7fef4c0726a0 secure :-1 s=READY pgs=1584 cs=0 l=1 rx=0x7fef4400af50 tx=0x7fef4400b760).ready entity=mon.0 client_cookie=3e8b4c665c5d4c95 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:38.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef51988700 1 --2- 172.21.15.80:0/523879228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef4c0734b0 0x7fef4c0726a0 secure :-1 s=THROTTLE_DONE pgs=1584 cs=0 l=1 rx=0x7fef4400af50 tx=0x7fef4400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef4bfff700 1 -- 172.21.15.80:0/523879228 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef44009ba0 con 0x7fef4c0734b0 2019-11-28T11:41:38.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef51988700 1 --2- 172.21.15.80:0/523879228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef4c0734b0 0x7fef4c0726a0 secure :-1 s=THROTTLE_DONE pgs=1584 cs=0 l=1 rx=0x7fef4400af50 tx=0x7fef4400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef51988700 1 --2- 172.21.15.80:0/523879228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef4c0734b0 0x7fef4c0726a0 secure :-1 s=THROTTLE_DONE pgs=1584 cs=0 l=1 rx=0x7fef4400af50 tx=0x7fef4400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef4bfff700 1 -- 172.21.15.80:0/523879228 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef440097c0 con 0x7fef4c0734b0 2019-11-28T11:41:38.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef4bfff700 1 -- 172.21.15.80:0/523879228 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef44000bc0 con 0x7fef4c0734b0 2019-11-28T11:41:38.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef52bea700 1 -- 172.21.15.80:0/523879228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef4c0734b0 msgr2=0x7fef4c0726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.578+0000 7fef52bea700 1 --2- 172.21.15.80:0/523879228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef4c0734b0 0x7fef4c0726a0 secure :-1 s=READY pgs=1584 cs=0 l=1 rx=0x7fef4400af50 tx=0x7fef4400b760).stop 2019-11-28T11:41:38.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.579+0000 7fef52bea700 1 -- 172.21.15.80:0/523879228 shutdown_connections 2019-11-28T11:41:38.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.579+0000 7fef52bea700 1 --2- 172.21.15.80:0/523879228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef4c0734b0 0x7fef4c0726a0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.579+0000 7fef52bea700 1 --2- 172.21.15.80:0/523879228 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c15ed10 0x7fef4c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:38.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.579+0000 7fef52bea700 1 -- 172.21.15.80:0/523879228 shutdown_connections 2019-11-28T11:41:38.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.579+0000 7fef52bea700 1 -- 172.21.15.80:0/523879228 wait complete. 2019-11-28T11:41:38.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.579+0000 7fef52bea700 1 -- 172.21.15.80:0/523879228 >> 172.21.15.80:0/523879228 conn(0x7fef4c061d20 msgr2=0x7fef4c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.582+0000 7fef52bea700 1 Processor -- start 2019-11-28T11:41:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.582+0000 7fef52bea700 1 -- start start 2019-11-28T11:41:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef52bea700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c148320 0x7fef4c10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:38.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef52bea700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fef4c10e3d0 0x7fef4c168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:38.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef52bea700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef4c148e00 con 0x7fef4c10f290 2019-11-28T11:41:38.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef52bea700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4c139ff0 con 0x7fef4c10e3d0 2019-11-28T11:41:38.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef52bea700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c13aa20 con 0x7fef4c148320 2019-11-28T11:41:38.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef51187700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c148320 0x7fef4c10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef51988700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fef4c10e3d0 0x7fef4c168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef51187700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c148320 0x7fef4c10ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:41698/0 (socket says 172.21.15.80:41698) 2019-11-28T11:41:38.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef51988700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fef4c10e3d0 0x7fef4c168d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:54328/0 (socket says 172.21.15.80:54328) 2019-11-28T11:41:38.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef51187700 1 -- 172.21.15.80:0/613645102 learned_addr learned my addr 172.21.15.80:0/613645102 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:38.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef51187700 1 -- 172.21.15.80:0/613645102 >> v2:172.21.15.174:3300/0 conn(0x7fef4c10e3d0 msgr2=0x7fef4c168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef51187700 1 --2- 172.21.15.80:0/613645102 >> v2:172.21.15.174:3300/0 conn(0x7fef4c10e3d0 0x7fef4c168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef51187700 1 -- 172.21.15.80:0/613645102 >> v1:172.21.15.174:6789/0 conn(0x7fef4c10f290 legacy=0x7fef4c10dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef51187700 1 -- 172.21.15.80:0/613645102 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c10c490 con 0x7fef4c148320 2019-11-28T11:41:38.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef51187700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c148320 0x7fef4c10ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fef340107e0 tx=0x7fef34010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef51187700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c148320 0x7fef4c10ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fef340107e0 tx=0x7fef34010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef51187700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c148320 0x7fef4c10ed50 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7fef340107e0 tx=0x7fef34010610).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:38.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef51187700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c148320 0x7fef4c10ed50 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fef340107e0 tx=0x7fef34010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef49ffb700 1 -- 172.21.15.80:0/613645102 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef34000cc0 con 0x7fef4c148320 2019-11-28T11:41:38.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef51187700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c148320 0x7fef4c10ed50 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fef340107e0 tx=0x7fef34010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef51187700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c148320 0x7fef4c10ed50 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fef340107e0 tx=0x7fef34010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef49ffb700 1 -- 172.21.15.80:0/613645102 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef34001220 con 0x7fef4c148320 2019-11-28T11:41:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef49ffb700 1 -- 172.21.15.80:0/613645102 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef34001830 con 0x7fef4c148320 2019-11-28T11:41:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef52bea700 1 -- 172.21.15.80:0/613645102 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4c10c810 con 0x7fef4c148320 2019-11-28T11:41:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.583+0000 7fef52bea700 1 -- 172.21.15.80:0/613645102 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4c10c490 con 0x7fef4c148320 2019-11-28T11:41:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.584+0000 7fef51187700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c148320 0x7fef4c10ed50 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fef340107e0 tx=0x7fef34010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.584+0000 7fef49ffb700 1 -- 172.21.15.80:0/613645102 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fef34001410 con 0x7fef4c148320 2019-11-28T11:41:38.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.584+0000 7fef51187700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c148320 0x7fef4c10ed50 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fef340107e0 tx=0x7fef34010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.584+0000 7fef49ffb700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef30018730 0x7fef3001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.584+0000 7fef49ffb700 1 -- 172.21.15.80:0/613645102 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fef34031e10 con 0x7fef4c148320 2019-11-28T11:41:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.584+0000 7fef50986700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef30018730 0x7fef3001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.585+0000 7fef50986700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef30018730 0x7fef3001abc0 crc :-1 s=READY pgs=643 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:38.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.592+0000 7fef52bea700 1 -- 172.21.15.80:0/613645102 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4c10c810 con 0x7fef4c148320 2019-11-28T11:41:38.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.596+0000 7fef51187700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c148320 0x7fef4c10ed50 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fef340107e0 tx=0x7fef34010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.596+0000 7fef49ffb700 1 -- 172.21.15.80:0/613645102 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fef34001010 con 0x7fef4c148320 2019-11-28T11:41:38.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.763+0000 7fef52bea700 1 -- 172.21.15.80:0/613645102 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fef4c10c490 con 0x7fef4c148320 2019-11-28T11:41:38.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.763+0000 7fef51187700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c148320 0x7fef4c10ed50 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7fef340107e0 tx=0x7fef34010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.763+0000 7fef49ffb700 1 -- 172.21.15.80:0/613645102 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v117) v1 ==== 100+0+10 (secure 0 0 0) 0x7fef340175b0 con 0x7fef4c148320 2019-11-28T11:41:38.800 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:41:38.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.766+0000 7fef52bea700 1 -- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef30018730 msgr2=0x7fef3001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.766+0000 7fef52bea700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef30018730 0x7fef3001abc0 crc :-1 s=READY pgs=643 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.766+0000 7fef52bea700 1 -- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c148320 msgr2=0x7fef4c10ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.766+0000 7fef52bea700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c148320 0x7fef4c10ed50 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7fef340107e0 tx=0x7fef34010610).stop 2019-11-28T11:41:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.766+0000 7fef52bea700 1 -- 172.21.15.80:0/613645102 shutdown_connections 2019-11-28T11:41:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.766+0000 7fef52bea700 1 --2- 172.21.15.80:0/613645102 >> v2:172.21.15.174:3300/0 conn(0x7fef4c10e3d0 0x7fef4c168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.766+0000 7fef52bea700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef30018730 0x7fef3001abc0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.766+0000 7fef52bea700 1 --2- 172.21.15.80:0/613645102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef4c148320 0x7fef4c10ed50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.766+0000 7fef52bea700 1 -- 172.21.15.80:0/613645102 shutdown_connections 2019-11-28T11:41:38.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.766+0000 7fef52bea700 1 -- 172.21.15.80:0/613645102 wait complete. 2019-11-28T11:41:38.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.766+0000 7fef52bea700 1 -- 172.21.15.80:0/613645102 >> 172.21.15.80:0/613645102 conn(0x7fef4c15e2d0 msgr2=0x7fef4c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:38.810 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:41:38.811 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:41:38.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.897+0000 7fe2b9a2b700 1 Processor -- start 2019-11-28T11:41:38.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.897+0000 7fe2b9a2b700 1 -- start start 2019-11-28T11:41:38.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.897+0000 7fe2b9a2b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b406c0a0 0x7fe2b4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:38.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b9a2b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2b40734e0 0x7fe2b4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b9a2b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe2b4072360 0x7fe2b40727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b9a2b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b406f330 con 0x7fe2b40734e0 2019-11-28T11:41:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b9a2b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b40706c0 con 0x7fe2b4072360 2019-11-28T11:41:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b9a2b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b4070a40 con 0x7fe2b406c0a0 2019-11-28T11:41:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b2ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2b40734e0 0x7fe2b4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b2ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2b40734e0 0x7fe2b4071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39446/0 (socket says 172.21.15.80:39446) 2019-11-28T11:41:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b2ffd700 1 -- 172.21.15.80:0/2547603131 learned_addr learned my addr 172.21.15.80:0/2547603131 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b37fe700 1 --2- 172.21.15.80:0/2547603131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b406c0a0 0x7fe2b4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b3fff700 1 --2- 172.21.15.80:0/2547603131 >> v2:172.21.15.174:3300/0 conn(0x7fe2b4072360 0x7fe2b40727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b2ffd700 1 -- 172.21.15.80:0/2547603131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b406c0a0 msgr2=0x7fe2b4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2547603131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b406c0a0 0x7fe2b4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b2ffd700 1 -- 172.21.15.80:0/2547603131 >> v2:172.21.15.174:3300/0 conn(0x7fe2b4072360 msgr2=0x7fe2b40727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2547603131 >> v2:172.21.15.174:3300/0 conn(0x7fe2b4072360 0x7fe2b40727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:38.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b2ffd700 1 -- 172.21.15.80:0/2547603131 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b406db00 con 0x7fe2b40734e0 2019-11-28T11:41:38.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2547603131 >> v2:172.21.15.80:3300/0 conn(0x7fe2b40734e0 0x7fe2b4071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe29c00f6c0 tx=0x7fe29c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2547603131 >> v2:172.21.15.80:3300/0 conn(0x7fe2b40734e0 0x7fe2b4071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe29c00f6c0 tx=0x7fe29c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2547603131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2b40734e0 0x7fe2b4071e20 secure :-1 s=READY pgs=1585 cs=0 l=1 rx=0x7fe29c00f6c0 tx=0x7fe29c00f570).ready entity=mon.0 client_cookie=32ed0573024e23c7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:38.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2547603131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2b40734e0 0x7fe2b4071e20 secure :-1 s=THROTTLE_DONE pgs=1585 cs=0 l=1 rx=0x7fe29c00f6c0 tx=0x7fe29c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2547603131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2b40734e0 0x7fe2b4071e20 secure :-1 s=THROTTLE_DONE pgs=1585 cs=0 l=1 rx=0x7fe29c00f6c0 tx=0x7fe29c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b27fc700 1 -- 172.21.15.80:0/2547603131 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe29c000960 con 0x7fe2b40734e0 2019-11-28T11:41:38.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2547603131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2b40734e0 0x7fe2b4071e20 secure :-1 s=THROTTLE_DONE pgs=1585 cs=0 l=1 rx=0x7fe29c00f6c0 tx=0x7fe29c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b27fc700 1 -- 172.21.15.80:0/2547603131 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c000c90 con 0x7fe2b40734e0 2019-11-28T11:41:38.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b27fc700 1 -- 172.21.15.80:0/2547603131 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe29c0013a0 con 0x7fe2b40734e0 2019-11-28T11:41:38.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b9a2b700 1 -- 172.21.15.80:0/2547603131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2b40734e0 msgr2=0x7fe2b4071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.898+0000 7fe2b9a2b700 1 --2- 172.21.15.80:0/2547603131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2b40734e0 0x7fe2b4071e20 secure :-1 s=READY pgs=1585 cs=0 l=1 rx=0x7fe29c00f6c0 tx=0x7fe29c00f570).stop 2019-11-28T11:41:38.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.899+0000 7fe2b9a2b700 1 -- 172.21.15.80:0/2547603131 shutdown_connections 2019-11-28T11:41:38.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.899+0000 7fe2b9a2b700 1 --2- 172.21.15.80:0/2547603131 >> v2:172.21.15.174:3300/0 conn(0x7fe2b4072360 0x7fe2b40727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:38.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.899+0000 7fe2b9a2b700 1 --2- 172.21.15.80:0/2547603131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2b40734e0 0x7fe2b4071e20 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.899+0000 7fe2b9a2b700 1 --2- 172.21.15.80:0/2547603131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b406c0a0 0x7fe2b4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:38.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.899+0000 7fe2b9a2b700 1 -- 172.21.15.80:0/2547603131 shutdown_connections 2019-11-28T11:41:38.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.899+0000 7fe2b9a2b700 1 -- 172.21.15.80:0/2547603131 wait complete. 2019-11-28T11:41:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.899+0000 7fe2b9a2b700 1 -- 172.21.15.80:0/2547603131 >> 172.21.15.80:0/2547603131 conn(0x7fe2b4061cf0 msgr2=0x7fe2b4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:38.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.902+0000 7fe2b9a2b700 1 Processor -- start 2019-11-28T11:41:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.902+0000 7fe2b9a2b700 1 -- start start 2019-11-28T11:41:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b9a2b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b413a780 0x7fe2b412d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b9a2b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe2b412d9c0 0x7fe2b412c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b9a2b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b4139a60 con 0x7fe2b412c840 2019-11-28T11:41:38.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b9a2b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b4129830 con 0x7fe2b412d9c0 2019-11-28T11:41:38.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b9a2b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b412a260 con 0x7fe2b413a780 2019-11-28T11:41:38.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b37fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b413a780 0x7fe2b412d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b37fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b413a780 0x7fe2b412d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:41712/0 (socket says 172.21.15.80:41712) 2019-11-28T11:41:38.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b2ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe2b412d9c0 0x7fe2b412c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b37fe700 1 -- 172.21.15.80:0/2342257219 learned_addr learned my addr 172.21.15.80:0/2342257219 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:38.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b2ffd700 1 -- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b413a780 msgr2=0x7fe2b412d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b413a780 0x7fe2b412d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:38.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b2ffd700 1 -- 172.21.15.80:0/2342257219 >> v1:172.21.15.174:6789/0 conn(0x7fe2b412c840 legacy=0x7fe2b41281b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:38.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b2ffd700 1 -- 172.21.15.80:0/2342257219 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b412abc0 con 0x7fe2b412d9c0 2019-11-28T11:41:38.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b37fe700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b413a780 0x7fe2b412d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:41:38.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2abfff700 1 -- 172.21.15.80:0/2342257219 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793325622 0 0) 0x7fe2ac001400 con 0x7fe2b412c840 2019-11-28T11:41:38.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2342257219 >> v2:172.21.15.174:3300/0 conn(0x7fe2b412d9c0 0x7fe2b412c300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe29c010380 tx=0x7fe29c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2342257219 >> v2:172.21.15.174:3300/0 conn(0x7fe2b412d9c0 0x7fe2b412c300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe29c010380 tx=0x7fe29c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b412d9c0 0x7fe2b412c300 secure :-1 s=READY pgs=926 cs=0 l=1 rx=0x7fe29c010380 tx=0x7fe29c010720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:38.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b412d9c0 0x7fe2b412c300 secure :-1 s=THROTTLE_DONE pgs=926 cs=0 l=1 rx=0x7fe29c010380 tx=0x7fe29c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2abfff700 1 -- 172.21.15.80:0/2342257219 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe29c001050 con 0x7fe2b412d9c0 2019-11-28T11:41:38.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b412d9c0 0x7fe2b412c300 secure :-1 s=THROTTLE_DONE pgs=926 cs=0 l=1 rx=0x7fe29c010380 tx=0x7fe29c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b412d9c0 0x7fe2b412c300 secure :-1 s=THROTTLE_DONE pgs=926 cs=0 l=1 rx=0x7fe29c010380 tx=0x7fe29c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2abfff700 1 -- 172.21.15.80:0/2342257219 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c007a60 con 0x7fe2b412d9c0 2019-11-28T11:41:38.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2b9a2b700 1 -- 172.21.15.80:0/2342257219 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b412af40 con 0x7fe2b412d9c0 2019-11-28T11:41:38.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.903+0000 7fe2abfff700 1 -- 172.21.15.80:0/2342257219 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe29c001240 con 0x7fe2b412d9c0 2019-11-28T11:41:38.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.904+0000 7fe2b9a2b700 1 -- 172.21.15.80:0/2342257219 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b412abc0 con 0x7fe2b412d9c0 2019-11-28T11:41:38.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.904+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b412d9c0 0x7fe2b412c300 secure :-1 s=THROTTLE_DONE pgs=926 cs=0 l=1 rx=0x7fe29c010380 tx=0x7fe29c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.904+0000 7fe2abfff700 1 -- 172.21.15.80:0/2342257219 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe29c000e60 con 0x7fe2b412d9c0 2019-11-28T11:41:38.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.904+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b412d9c0 0x7fe2b412c300 secure :-1 s=THROTTLE_DONE pgs=926 cs=0 l=1 rx=0x7fe29c010380 tx=0x7fe29c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.904+0000 7fe2abfff700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe298018730 0x7fe29801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:38.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.904+0000 7fe2abfff700 1 -- 172.21.15.80:0/2342257219 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe29c0319d0 con 0x7fe2b412d9c0 2019-11-28T11:41:38.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.904+0000 7fe2b37fe700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe298018730 0x7fe29801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:38.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.905+0000 7fe2b37fe700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe298018730 0x7fe29801abc0 crc :-1 s=READY pgs=644 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:38.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.912+0000 7fe2b9a2b700 1 -- 172.21.15.80:0/2342257219 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b412af40 con 0x7fe2b412d9c0 2019-11-28T11:41:38.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.916+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b412d9c0 0x7fe2b412c300 secure :-1 s=THROTTLE_DONE pgs=926 cs=0 l=1 rx=0x7fe29c010380 tx=0x7fe29c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:38.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:38.916+0000 7fe2abfff700 1 -- 172.21.15.80:0/2342257219 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe29c02cf50 con 0x7fe2b412d9c0 2019-11-28T11:41:39.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:39.088+0000 7fe2b9a2b700 1 -- 172.21.15.80:0/2342257219 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2b412abc0 con 0x7fe2b412d9c0 2019-11-28T11:41:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:39.088+0000 7fe2b2ffd700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b412d9c0 0x7fe2b412c300 secure :-1 s=THROTTLE_DONE pgs=926 cs=0 l=1 rx=0x7fe29c010380 tx=0x7fe29c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:39.088+0000 7fe2abfff700 1 -- 172.21.15.80:0/2342257219 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+2448 (secure 0 0 0) 0x7fe29c02cf50 con 0x7fe2b412d9c0 2019-11-28T11:41:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 84 2019-11-28T11:41:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:39.090+0000 7fe2b9a2b700 1 -- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe298018730 msgr2=0x7fe29801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:39.090+0000 7fe2b9a2b700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe298018730 0x7fe29801abc0 crc :-1 s=READY pgs=644 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:39.090+0000 7fe2b9a2b700 1 -- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b412d9c0 msgr2=0x7fe2b412c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:39.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:39.090+0000 7fe2b9a2b700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b412d9c0 0x7fe2b412c300 secure :-1 s=READY pgs=926 cs=0 l=1 rx=0x7fe29c010380 tx=0x7fe29c010720).stop 2019-11-28T11:41:39.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:39.090+0000 7fe2b9a2b700 1 -- 172.21.15.80:0/2342257219 shutdown_connections 2019-11-28T11:41:39.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:39.090+0000 7fe2b9a2b700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe298018730 0x7fe29801abc0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:39.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:39.090+0000 7fe2b9a2b700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b412d9c0 0x7fe2b412c300 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:39.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:39.090+0000 7fe2b9a2b700 1 --2- 172.21.15.80:0/2342257219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b413a780 0x7fe2b412d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:39.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:39.091+0000 7fe2b9a2b700 1 -- 172.21.15.80:0/2342257219 shutdown_connections 2019-11-28T11:41:39.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:39.091+0000 7fe2b9a2b700 1 -- 172.21.15.80:0/2342257219 wait complete. 2019-11-28T11:41:39.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:39.091+0000 7fe2b9a2b700 1 -- 172.21.15.80:0/2342257219 >> 172.21.15.80:0/2342257219 conn(0x7fe2b4127dc0 msgr2=0x7fe2b4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:39.131 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:39.131 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":84,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1010023901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1010023901},{"type":"v1","addr":"172.21.15.80:6834","nonce":1010023901}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":82},{"gid":8556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3440274141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3440274141},{"type":"v1","addr":"172.21.15.80:6835","nonce":3440274141}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":82}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:25.297182+0000","modified":"2019-11-28T11:41:33.675187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6242":{"gid":6242,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2489382286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2489382286},{"type":"v1","addr":"172.21.15.174:6835","nonce":2489382286}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2019-11-28T11:41:39.436 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6242}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 18, u'failed': [], u'epoch': 84, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [19], u'info': {u'gid_6242': {u'export_targets': [], u'name': u'c', u'incarnation': 83, u'state_seq': 3, u'state': u'up:active', u'gid': 6242, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2489382286, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2489382286, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2489382286'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:41:25.297182+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:41:33.675187+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:41:39.436 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:41:39.437 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:41:39.572 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:41:39.574 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:41:39.574 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:41:39.574 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 6242, 2019-11-28T11:41:39.574 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:41:39.575 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:41:39.575 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 6.8639646409999999, 2019-11-28T11:41:39.575 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 84, 2019-11-28T11:41:39.575 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 117, 2019-11-28T11:41:39.575 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 117, 2019-11-28T11:41:39.575 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 11.429476221 2019-11-28T11:41:39.575 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:41:39.578 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 6242, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.8639646409999999, "mdsmap_epoch": 84, "osdmap_epoch": 117, "osdmap_epoch_barrier": 117, "uptime": 11.429476221 } 2019-11-28T11:41:39.580 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:41:39.580 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:41:39.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:41:39.581 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:41:39.654 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:41:39.654 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:41:39.779 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:41:39.780 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:41:39.780 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:41:39.781 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:41:39.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:41:39.781 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:41:39.887 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:41:40.009 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:41:40.009 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:41:40.009 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:41:40.015 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:41:40.015 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:41:40.136 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:41:40.137 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:41:40.137 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:41:40.143 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:41:40.143 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:41:40.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.228+0000 7f9b4a77a700 1 Processor -- start 2019-11-28T11:41:40.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.228+0000 7f9b4a77a700 1 -- start start 2019-11-28T11:41:40.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.229+0000 7f9b4a77a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9b4406c0a0 0x7f9b44072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:40.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.229+0000 7f9b4a77a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4406db00 con 0x7f9b44072620 2019-11-28T11:41:40.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.229+0000 7f9b4a77a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4406e000 con 0x7f9b440734e0 2019-11-28T11:41:40.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.229+0000 7f9b4a77a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4406fd60 con 0x7f9b4406c0a0 2019-11-28T11:41:40.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b49518700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9b44072620 0x7f9b44164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38776/0 (socket says 172.21.15.80:38776) 2019-11-28T11:41:40.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b49518700 1 -- 172.21.15.80:0/4081765871 learned_addr learned my addr 172.21.15.80:0/4081765871 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:40.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b48d17700 1 --2- 172.21.15.80:0/4081765871 >> v2:172.21.15.174:3300/0 conn(0x7f9b4406c0a0 0x7f9b44072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:40.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b437fe700 1 -- 172.21.15.80:0/4081765871 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474156536 0 0) 0x7f9b3c001150 con 0x7f9b44072620 2019-11-28T11:41:40.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b437fe700 1 -- 172.21.15.80:0/4081765871 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b30002e80 con 0x7f9b44072620 2019-11-28T11:41:40.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b437fe700 1 -- 172.21.15.80:0/4081765871 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 145845943 0 0) 0x7f9b3c001130 con 0x7f9b44072620 2019-11-28T11:41:40.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b437fe700 1 -- 172.21.15.80:0/4081765871 >> v2:172.21.15.174:3300/0 conn(0x7f9b4406c0a0 msgr2=0x7f9b44072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:40.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b437fe700 1 --2- 172.21.15.80:0/4081765871 >> v2:172.21.15.174:3300/0 conn(0x7f9b4406c0a0 0x7f9b44072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:40.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b437fe700 1 -- 172.21.15.80:0/4081765871 >> v1:172.21.15.174:6789/0 conn(0x7f9b440734e0 legacy=0x7f9b44071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:40.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b437fe700 1 -- 172.21.15.80:0/4081765871 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b440706c0 con 0x7f9b44072620 2019-11-28T11:41:40.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b437fe700 1 -- 172.21.15.80:0/4081765871 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f9b3c001660 con 0x7f9b44072620 2019-11-28T11:41:40.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b437fe700 1 -- 172.21.15.80:0/4081765871 >> v1:172.21.15.80:6789/0 conn(0x7f9b44072620 legacy=0x7f9b44164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:40.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b437fe700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b30003ab0 0x7f9b30005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:40.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b437fe700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b30006690 0x7f9b30008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:40.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b437fe700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b30009380 0x7f9b3000b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:40.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b437fe700 1 -- 172.21.15.80:0/4081765871 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3000c000 con 0x7f9b30009380 2019-11-28T11:41:40.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b437fe700 1 -- 172.21.15.80:0/4081765871 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b30050200 con 0x7f9b30003ab0 2019-11-28T11:41:40.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b437fe700 1 -- 172.21.15.80:0/4081765871 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b30050430 con 0x7f9b30006690 2019-11-28T11:41:40.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b49518700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b30009380 0x7f9b3000b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:40.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b48d17700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b30003ab0 0x7f9b30005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:40.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b43fff700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b30006690 0x7f9b30008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:40.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b49518700 1 -- 172.21.15.80:0/4081765871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b30006690 msgr2=0x7f9b30008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:40.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b49518700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b30006690 0x7f9b30008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:40.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b49518700 1 -- 172.21.15.80:0/4081765871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b30003ab0 msgr2=0x7f9b30005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:40.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b49518700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b30003ab0 0x7f9b30005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:40.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b49518700 1 -- 172.21.15.80:0/4081765871 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b300506e0 con 0x7f9b30009380 2019-11-28T11:41:40.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.230+0000 7f9b43fff700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b30006690 0x7f9b30008b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:41:40.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b49518700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b30009380 0x7f9b3000b850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9b3c00f910 tx=0x7f9b3c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:40.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b49518700 1 -- 172.21.15.80:0/4081765871 reap_dead start 2019-11-28T11:41:40.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b49518700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b30009380 0x7f9b3000b850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9b3c00f910 tx=0x7f9b3c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:40.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b49518700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b30009380 0x7f9b3000b850 secure :-1 s=READY pgs=1587 cs=0 l=1 rx=0x7f9b3c00f910 tx=0x7f9b3c00f790).ready entity=mon.0 client_cookie=5c6267670f5d3fc8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:40.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b49518700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b30009380 0x7f9b3000b850 secure :-1 s=THROTTLE_DONE pgs=1587 cs=0 l=1 rx=0x7f9b3c00f910 tx=0x7f9b3c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:40.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b437fe700 1 -- 172.21.15.80:0/4081765871 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b3c0014e0 con 0x7f9b30009380 2019-11-28T11:41:40.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b49518700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b30009380 0x7f9b3000b850 secure :-1 s=THROTTLE_DONE pgs=1587 cs=0 l=1 rx=0x7f9b3c00f910 tx=0x7f9b3c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:40.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b49518700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b30009380 0x7f9b3000b850 secure :-1 s=THROTTLE_DONE pgs=1587 cs=0 l=1 rx=0x7f9b3c00f910 tx=0x7f9b3c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:40.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b437fe700 1 -- 172.21.15.80:0/4081765871 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c004430 con 0x7f9b30009380 2019-11-28T11:41:40.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b437fe700 1 -- 172.21.15.80:0/4081765871 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b3c004620 con 0x7f9b30009380 2019-11-28T11:41:40.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b4a77a700 1 -- 172.21.15.80:0/4081765871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b30009380 msgr2=0x7f9b3000b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:40.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b4a77a700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b30009380 0x7f9b3000b850 secure :-1 s=READY pgs=1587 cs=0 l=1 rx=0x7f9b3c00f910 tx=0x7f9b3c00f790).stop 2019-11-28T11:41:40.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b4a77a700 1 -- 172.21.15.80:0/4081765871 shutdown_connections 2019-11-28T11:41:40.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b4a77a700 1 --2- 172.21.15.80:0/4081765871 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b30009380 0x7f9b3000b850 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:40.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b4a77a700 1 -- 172.21.15.80:0/4081765871 shutdown_connections 2019-11-28T11:41:40.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b4a77a700 1 -- 172.21.15.80:0/4081765871 wait complete. 2019-11-28T11:41:40.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.231+0000 7f9b4a77a700 1 -- 172.21.15.80:0/4081765871 >> 172.21.15.80:0/4081765871 conn(0x7f9b44061cf0 msgr2=0x7f9b44064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:40.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.234+0000 7f9b4a77a700 1 Processor -- start 2019-11-28T11:41:40.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.234+0000 7f9b4a77a700 1 -- start start 2019-11-28T11:41:40.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.235+0000 7f9b4a77a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b44167c50 0x7f9b4416a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:40.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.235+0000 7f9b4a77a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4415b940 con 0x7f9b441134e0 2019-11-28T11:41:40.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.235+0000 7f9b4a77a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4412c640 con 0x7f9b44140070 2019-11-28T11:41:40.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.235+0000 7f9b4a77a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b441598a0 con 0x7f9b44167c50 2019-11-28T11:41:40.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.235+0000 7f9b43fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9b441134e0 0x7f9b44113970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38788/0 (socket says 172.21.15.80:38788) 2019-11-28T11:41:40.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.235+0000 7f9b43fff700 1 -- 172.21.15.80:0/3849167255 learned_addr learned my addr 172.21.15.80:0/3849167255 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:40.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.235+0000 7f9b49518700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b44167c50 0x7f9b4416a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:40.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.235+0000 7f9b417fa700 1 -- 172.21.15.80:0/3849167255 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623336110 0 0) 0x7f9b340059b0 con 0x7f9b441134e0 2019-11-28T11:41:40.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.235+0000 7f9b417fa700 1 -- 172.21.15.80:0/3849167255 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b28002e80 con 0x7f9b441134e0 2019-11-28T11:41:40.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.235+0000 7f9b417fa700 1 -- 172.21.15.80:0/3849167255 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533070506 0 0) 0x7f9b2c000a50 con 0x7f9b44140070 2019-11-28T11:41:40.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.235+0000 7f9b417fa700 1 -- 172.21.15.80:0/3849167255 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b280030b0 con 0x7f9b44140070 2019-11-28T11:41:40.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.235+0000 7f9b417fa700 1 -- 172.21.15.80:0/3849167255 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 509638279 0 0) 0x7f9b34005fe0 con 0x7f9b441134e0 2019-11-28T11:41:40.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.235+0000 7f9b417fa700 1 -- 172.21.15.80:0/3849167255 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9b280033c0 con 0x7f9b441134e0 2019-11-28T11:41:40.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.235+0000 7f9b417fa700 1 -- 172.21.15.80:0/3849167255 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f9b34006590 con 0x7f9b441134e0 2019-11-28T11:41:40.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.235+0000 7f9b49518700 1 -- 172.21.15.80:0/3849167255 >> v1:172.21.15.174:6789/0 conn(0x7f9b44140070 legacy=0x7f9b44114440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:40.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.235+0000 7f9b49518700 1 -- 172.21.15.80:0/3849167255 >> v1:172.21.15.80:6789/0 conn(0x7f9b441134e0 legacy=0x7f9b44113970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:40.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.236+0000 7f9b49518700 1 -- 172.21.15.80:0/3849167255 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4415a200 con 0x7f9b44167c50 2019-11-28T11:41:40.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.236+0000 7f9b49518700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b44167c50 0x7f9b4416a050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b3c010350 tx=0x7f9b3c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:40.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.236+0000 7f9b49518700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b44167c50 0x7f9b4416a050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b3c010350 tx=0x7f9b3c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:40.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.236+0000 7f9b49518700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b44167c50 0x7f9b4416a050 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7f9b3c010350 tx=0x7f9b3c0106f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:40.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.236+0000 7f9b49518700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b44167c50 0x7f9b4416a050 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f9b3c010350 tx=0x7f9b3c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:40.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.236+0000 7f9b417fa700 1 -- 172.21.15.80:0/3849167255 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b3c00f580 con 0x7f9b44167c50 2019-11-28T11:41:40.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.236+0000 7f9b49518700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b44167c50 0x7f9b4416a050 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f9b3c010350 tx=0x7f9b3c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:40.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.236+0000 7f9b49518700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b44167c50 0x7f9b4416a050 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f9b3c010350 tx=0x7f9b3c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:40.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.236+0000 7f9b417fa700 1 -- 172.21.15.80:0/3849167255 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c004240 con 0x7f9b44167c50 2019-11-28T11:41:40.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.236+0000 7f9b417fa700 1 -- 172.21.15.80:0/3849167255 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b3c004990 con 0x7f9b44167c50 2019-11-28T11:41:40.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.236+0000 7f9b4a77a700 1 -- 172.21.15.80:0/3849167255 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4415a580 con 0x7f9b44167c50 2019-11-28T11:41:40.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.236+0000 7f9b4a77a700 1 -- 172.21.15.80:0/3849167255 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4415a200 con 0x7f9b44167c50 2019-11-28T11:41:40.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.236+0000 7f9b49518700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b44167c50 0x7f9b4416a050 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f9b3c010350 tx=0x7f9b3c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:40.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.237+0000 7f9b417fa700 1 -- 172.21.15.80:0/3849167255 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9b3c004430 con 0x7f9b44167c50 2019-11-28T11:41:40.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.237+0000 7f9b49518700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b44167c50 0x7f9b4416a050 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f9b3c010350 tx=0x7f9b3c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:40.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.237+0000 7f9b417fa700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b280187d0 0x7f9b2801ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:40.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.237+0000 7f9b417fa700 1 -- 172.21.15.80:0/3849167255 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9b3c031c90 con 0x7f9b44167c50 2019-11-28T11:41:40.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.237+0000 7f9b48d17700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b280187d0 0x7f9b2801ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:40.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.237+0000 7f9b48d17700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b280187d0 0x7f9b2801ac00 crc :-1 s=READY pgs=645 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:40.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.244+0000 7f9b4a77a700 1 -- 172.21.15.80:0/3849167255 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4415a580 con 0x7f9b44167c50 2019-11-28T11:41:40.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.248+0000 7f9b49518700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b44167c50 0x7f9b4416a050 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f9b3c010350 tx=0x7f9b3c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:40.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.248+0000 7f9b417fa700 1 -- 172.21.15.80:0/3849167255 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9b3c000b10 con 0x7f9b44167c50 2019-11-28T11:41:40.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.422+0000 7f9b4a77a700 1 -- 172.21.15.80:0/3849167255 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b4415a200 con 0x7f9b44167c50 2019-11-28T11:41:40.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.422+0000 7f9b49518700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b44167c50 0x7f9b4416a050 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f9b3c010350 tx=0x7f9b3c0106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:40.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.422+0000 7f9b417fa700 1 -- 172.21.15.80:0/3849167255 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+2448 (secure 0 0 0) 0x7f9b3c004240 con 0x7f9b44167c50 2019-11-28T11:41:40.457 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 84 2019-11-28T11:41:40.458 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:40.458 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":84,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1010023901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1010023901},{"type":"v1","addr":"172.21.15.80:6834","nonce":1010023901}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":82},{"gid":8556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3440274141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3440274141},{"type":"v1","addr":"172.21.15.80:6835","nonce":3440274141}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":82}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:25.297182+0000","modified":"2019-11-28T11:41:33.675187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6242":{"gid":6242,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2489382286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2489382286},{"type":"v1","addr":"172.21.15.174:6835","nonce":2489382286}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2019-11-28T11:41:40.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.424+0000 7f9b4a77a700 1 -- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b280187d0 msgr2=0x7f9b2801ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:40.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.424+0000 7f9b4a77a700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b280187d0 0x7f9b2801ac00 crc :-1 s=READY pgs=645 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:40.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.424+0000 7f9b4a77a700 1 -- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b44167c50 msgr2=0x7f9b4416a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:40.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.424+0000 7f9b4a77a700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b44167c50 0x7f9b4416a050 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7f9b3c010350 tx=0x7f9b3c0106f0).stop 2019-11-28T11:41:40.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.425+0000 7f9b4a77a700 1 -- 172.21.15.80:0/3849167255 shutdown_connections 2019-11-28T11:41:40.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.425+0000 7f9b4a77a700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b44167c50 0x7f9b4416a050 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:40.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.425+0000 7f9b4a77a700 1 --2- 172.21.15.80:0/3849167255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b280187d0 0x7f9b2801ac00 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:40.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.425+0000 7f9b4a77a700 1 -- 172.21.15.80:0/3849167255 shutdown_connections 2019-11-28T11:41:40.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.425+0000 7f9b4a77a700 1 -- 172.21.15.80:0/3849167255 wait complete. 2019-11-28T11:41:40.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:40.425+0000 7f9b4a77a700 1 -- 172.21.15.80:0/3849167255 >> 172.21.15.80:0/3849167255 conn(0x7f9b4414feb0 msgr2=0x7f9b4410c740 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:40.469 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits daemon-helper kill python -c ' 2019-11-28T11:41:40.469 INFO:teuthology.orchestra.run.smithi076:> import time 2019-11-28T11:41:40.469 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:41:40.470 INFO:teuthology.orchestra.run.smithi076:> f = open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') 2019-11-28T11:41:40.470 INFO:teuthology.orchestra.run.smithi076:> f.write('"'"'content'"'"') 2019-11-28T11:41:40.470 INFO:teuthology.orchestra.run.smithi076:> f.flush() 2019-11-28T11:41:40.470 INFO:teuthology.orchestra.run.smithi076:> f.write('"'"'content2'"'"') 2019-11-28T11:41:40.470 INFO:teuthology.orchestra.run.smithi076:> while True: 2019-11-28T11:41:40.470 INFO:teuthology.orchestra.run.smithi076:> time.sleep(1) 2019-11-28T11:41:40.471 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:41:40.475 INFO:teuthology.orchestra.run.smithi076:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2019-11-28T11:41:40.535 INFO:teuthology.orchestra.run.smithi076.stderr:ls: cannot access /home/ubuntu/cephtest/mnt.0/background_file: No such file or directory 2019-11-28T11:41:40.536 DEBUG:teuthology.orchestra.run:got remote process result: 2 2019-11-28T11:41:41.538 INFO:teuthology.orchestra.run.smithi076:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2019-11-28T11:41:41.601 INFO:teuthology.orchestra.run.smithi076.stdout:/home/ubuntu/cephtest/mnt.0/background_file 2019-11-28T11:41:41.602 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 1s 2019-11-28T11:41:41.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:41:41.602 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:41:41.603 INFO:teuthology.orchestra.run.smithi076:> import glob 2019-11-28T11:41:41.603 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:41:41.605 INFO:teuthology.orchestra.run.smithi076:> import json 2019-11-28T11:41:41.605 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:41:41.605 INFO:teuthology.orchestra.run.smithi076:> def get_id_to_dir(): 2019-11-28T11:41:41.605 INFO:teuthology.orchestra.run.smithi076:> result = {} 2019-11-28T11:41:41.606 INFO:teuthology.orchestra.run.smithi076:> for dir in glob.glob("/sys/kernel/debug/ceph/*"): 2019-11-28T11:41:41.607 INFO:teuthology.orchestra.run.smithi076:> mds_sessions_lines = open(os.path.join(dir, "mds_sessions")).readlines() 2019-11-28T11:41:41.607 INFO:teuthology.orchestra.run.smithi076:> client_id = mds_sessions_lines[1].split()[1].strip('"'"'"'"'"') 2019-11-28T11:41:41.607 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:41:41.607 INFO:teuthology.orchestra.run.smithi076:> result[client_id] = dir 2019-11-28T11:41:41.608 INFO:teuthology.orchestra.run.smithi076:> return result 2019-11-28T11:41:41.608 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:41:41.608 INFO:teuthology.orchestra.run.smithi076:> print(json.dumps(get_id_to_dir())) 2019-11-28T11:41:41.608 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:41:41.678 INFO:teuthology.orchestra.run.smithi076.stdout:{"0": "/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client8646"} 2019-11-28T11:41:41.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:41:41.679 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:41:41.679 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:41:41.679 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:41:41.679 INFO:teuthology.orchestra.run.smithi076:> print(open(os.path.join("/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client8646", "mds_sessions")).read()) 2019-11-28T11:41:41.679 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:41:41.753 INFO:teuthology.orchestra.run.smithi076.stdout:global_id 8646 2019-11-28T11:41:41.754 INFO:teuthology.orchestra.run.smithi076.stdout:name "0" 2019-11-28T11:41:41.754 INFO:teuthology.orchestra.run.smithi076.stdout:mds.0 open 2019-11-28T11:41:41.754 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:41:41.754 INFO:teuthology.orchestra.run.smithi016:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file 2019-11-28T11:41:41.826 INFO:teuthology.orchestra.run.smithi016.stdout:/home/ubuntu/cephtest/mnt.1/background_file 2019-11-28T11:41:41.827 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2019-11-28T11:41:41.880 INFO:teuthology.orchestra.console:Performing hard reset of smithi076 2019-11-28T11:41:41.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power reset 2019-11-28T11:41:41.968 INFO:teuthology.orchestra.console:Hard reset for smithi076 completed 2019-11-28T11:41:47.070 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits daemon-helper kill python -c ' 2019-11-28T11:41:47.071 INFO:teuthology.orchestra.run.smithi016:> import os 2019-11-28T11:41:47.071 INFO:teuthology.orchestra.run.smithi016:> import time 2019-11-28T11:41:47.071 INFO:teuthology.orchestra.run.smithi016:> 2019-11-28T11:41:47.071 INFO:teuthology.orchestra.run.smithi016:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0644) 2019-11-28T11:41:47.071 INFO:teuthology.orchestra.run.smithi016:> try: 2019-11-28T11:41:47.072 INFO:teuthology.orchestra.run.smithi016:> while True: 2019-11-28T11:41:47.072 INFO:teuthology.orchestra.run.smithi016:> os.write(fd, '"'"'content'"'"') 2019-11-28T11:41:47.085 INFO:teuthology.orchestra.run.smithi016:> time.sleep(1) 2019-11-28T11:41:47.085 INFO:teuthology.orchestra.run.smithi016:> if not False: 2019-11-28T11:41:47.085 INFO:teuthology.orchestra.run.smithi016:> break 2019-11-28T11:41:47.086 INFO:teuthology.orchestra.run.smithi016:> except IOError, e: 2019-11-28T11:41:47.086 INFO:teuthology.orchestra.run.smithi016:> pass 2019-11-28T11:41:47.086 INFO:teuthology.orchestra.run.smithi016:> os.close(fd) 2019-11-28T11:41:47.086 INFO:teuthology.orchestra.run.smithi016:> ' 2019-11-28T11:41:52.196 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:41:52.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.298+0000 7f7441f18700 1 Processor -- start 2019-11-28T11:41:52.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.298+0000 7f7441f18700 1 -- start start 2019-11-28T11:41:52.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f7441f18700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f743c06c490 0x7f743c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:52.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f7441f18700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c06db00 con 0x7f743c06ce60 2019-11-28T11:41:52.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f7441f18700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c06e000 con 0x7f743c06c0a0 2019-11-28T11:41:52.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f7441f18700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c06fd60 con 0x7f743c06c490 2019-11-28T11:41:52.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f7440cb6700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f743c06ce60 0x7f743c164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38798/0 (socket says 172.21.15.80:38798) 2019-11-28T11:41:52.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f7440cb6700 1 -- 172.21.15.80:0/2988257319 learned_addr learned my addr 172.21.15.80:0/2988257319 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:41:52.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f7433fff700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f743c06c490 0x7f743c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:52.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f743b7fe700 1 -- 172.21.15.80:0/2988257319 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171885153 0 0) 0x7f74340014d0 con 0x7f743c06ce60 2019-11-28T11:41:52.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f743b7fe700 1 -- 172.21.15.80:0/2988257319 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f741c002e80 con 0x7f743c06ce60 2019-11-28T11:41:52.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f743b7fe700 1 -- 172.21.15.80:0/2988257319 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141521638 0 0) 0x7f742c001080 con 0x7f743c06c0a0 2019-11-28T11:41:52.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f743b7fe700 1 -- 172.21.15.80:0/2988257319 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f741c0030b0 con 0x7f743c06c0a0 2019-11-28T11:41:52.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f743b7fe700 1 -- 172.21.15.80:0/2988257319 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3469813271 0 0) 0x7f74340014b0 con 0x7f743c06ce60 2019-11-28T11:41:52.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f743b7fe700 1 -- 172.21.15.80:0/2988257319 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f743c06c490 msgr2=0x7f743c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:52.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f743b7fe700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f743c06c490 0x7f743c06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:52.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f743b7fe700 1 -- 172.21.15.80:0/2988257319 >> v1:172.21.15.174:6789/0 conn(0x7f743c06c0a0 legacy=0x7f743c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:52.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f743b7fe700 1 -- 172.21.15.80:0/2988257319 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c0706c0 con 0x7f743c06ce60 2019-11-28T11:41:52.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f743b7fe700 1 -- 172.21.15.80:0/2988257319 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f7434001a40 con 0x7f743c06ce60 2019-11-28T11:41:52.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.299+0000 7f743b7fe700 1 -- 172.21.15.80:0/2988257319 >> v1:172.21.15.80:6789/0 conn(0x7f743c06ce60 legacy=0x7f743c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:52.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743b7fe700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f741c003b80 0x7f741c005fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:52.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743b7fe700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f741c0066b0 0x7f741c008b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:52.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743b7fe700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f741c04d3a0 0x7f741c04f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:41:52.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743bfff700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f741c003b80 0x7f741c005fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:52.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743b7fe700 1 -- 172.21.15.80:0/2988257319 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c04fff0 con 0x7f741c003b80 2019-11-28T11:41:52.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743b7fe700 1 -- 172.21.15.80:0/2988257319 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0501e0 con 0x7f741c0066b0 2019-11-28T11:41:52.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743b7fe700 1 -- 172.21.15.80:0/2988257319 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c050410 con 0x7f741c04d3a0 2019-11-28T11:41:52.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f7433fff700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f741c0066b0 0x7f741c008b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:52.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f7440cb6700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f741c04d3a0 0x7f741c04f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:52.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743bfff700 1 -- 172.21.15.80:0/2988257319 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f741c04d3a0 msgr2=0x7f741c04f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:52.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743bfff700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f741c04d3a0 0x7f741c04f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:52.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743bfff700 1 -- 172.21.15.80:0/2988257319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f741c0066b0 msgr2=0x7f741c008b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:41:52.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743bfff700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f741c0066b0 0x7f741c008b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:41:52.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743bfff700 1 -- 172.21.15.80:0/2988257319 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c0506c0 con 0x7f741c003b80 2019-11-28T11:41:52.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f7433fff700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f741c0066b0 0x7f741c008b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:41:52.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743bfff700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f741c003b80 0x7f741c005fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f742c00af70 tx=0x7f742c00b700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:52.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743bfff700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f741c003b80 0x7f741c005fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f742c00af70 tx=0x7f742c00b700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:52.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743bfff700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f741c003b80 0x7f741c005fc0 secure :-1 s=READY pgs=1590 cs=0 l=1 rx=0x7f742c00af70 tx=0x7f742c00b700).ready entity=mon.0 client_cookie=fd6086c4a2e199fc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:52.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743bfff700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f741c003b80 0x7f741c005fc0 secure :-1 s=THROTTLE_DONE pgs=1590 cs=0 l=1 rx=0x7f742c00af70 tx=0x7f742c00b700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:52.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743bfff700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f741c003b80 0x7f741c005fc0 secure :-1 s=THROTTLE_DONE pgs=1590 cs=0 l=1 rx=0x7f742c00af70 tx=0x7f742c00b700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:52.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743b7fe700 1 -- 172.21.15.80:0/2988257319 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f742c009cb0 con 0x7f741c003b80 2019-11-28T11:41:52.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743bfff700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f741c003b80 0x7f741c005fc0 secure :-1 s=THROTTLE_DONE pgs=1590 cs=0 l=1 rx=0x7f742c00af70 tx=0x7f742c00b700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:52.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743b7fe700 1 -- 172.21.15.80:0/2988257319 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c0098d0 con 0x7f741c003b80 2019-11-28T11:41:52.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f743b7fe700 1 -- 172.21.15.80:0/2988257319 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f742c00a350 con 0x7f741c003b80 2019-11-28T11:41:52.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f7441f18700 1 -- 172.21.15.80:0/2988257319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f741c003b80 msgr2=0x7f741c005fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:52.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f7441f18700 1 --2- 172.21.15.80:0/2988257319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f741c003b80 0x7f741c005fc0 secure :-1 s=READY pgs=1590 cs=0 l=1 rx=0x7f742c00af70 tx=0x7f742c00b700).stop 2019-11-28T11:41:52.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.300+0000 7f7440cb6700 1 -- 172.21.15.80:0/2988257319 reap_dead start 2019-11-28T11:41:52.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.301+0000 7f7441f18700 1 -- 172.21.15.80:0/2988257319 shutdown_connections 2019-11-28T11:41:52.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.301+0000 7f7441f18700 1 -- 172.21.15.80:0/2988257319 shutdown_connections 2019-11-28T11:41:52.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.301+0000 7f7441f18700 1 -- 172.21.15.80:0/2988257319 wait complete. 2019-11-28T11:41:52.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.301+0000 7f7441f18700 1 -- 172.21.15.80:0/2988257319 >> 172.21.15.80:0/2988257319 conn(0x7f743c061cf0 msgr2=0x7f743c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:52.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.304+0000 7f7441f18700 1 Processor -- start 2019-11-28T11:41:52.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.304+0000 7f7441f18700 1 -- start start 2019-11-28T11:41:52.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.304+0000 7f7441f18700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f743c156340 0x7f743c1567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:52.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.304+0000 7f7441f18700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f743c156d10 0x7f743c16aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:52.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.304+0000 7f7441f18700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c157150 con 0x7f743c077040 2019-11-28T11:41:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.304+0000 7f7441f18700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743c137110 con 0x7f743c156340 2019-11-28T11:41:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.304+0000 7f7441f18700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c1373e0 con 0x7f743c156d10 2019-11-28T11:41:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f7433fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f743c156340 0x7f743c1567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f7433fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f743c156340 0x7f743c1567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39492/0 (socket says 172.21.15.80:39492) 2019-11-28T11:41:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f7433fff700 1 -- 172.21.15.80:0/3395924116 learned_addr learned my addr 172.21.15.80:0/3395924116 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:41:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f7440cb6700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f743c156d10 0x7f743c16aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f7433fff700 1 -- 172.21.15.80:0/3395924116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f743c156d10 msgr2=0x7f743c16aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f7433fff700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f743c156d10 0x7f743c16aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f7433fff700 1 -- 172.21.15.80:0/3395924116 >> v1:172.21.15.174:6789/0 conn(0x7f743c077040 legacy=0x7f743c1574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f7433fff700 1 -- 172.21.15.80:0/3395924116 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c137a70 con 0x7f743c156340 2019-11-28T11:41:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f7433fff700 1 --2- 172.21.15.80:0/3395924116 >> v2:172.21.15.80:3300/0 conn(0x7f743c156340 0x7f743c1567d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7424010480 tx=0x7f74240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f7433fff700 1 --2- 172.21.15.80:0/3395924116 >> v2:172.21.15.80:3300/0 conn(0x7f743c156340 0x7f743c1567d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7424010480 tx=0x7f74240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f7433fff700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f743c156340 0x7f743c1567d0 secure :-1 s=READY pgs=1591 cs=0 l=1 rx=0x7f7424010480 tx=0x7f74240102b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:52.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f7433fff700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f743c156340 0x7f743c1567d0 secure :-1 s=THROTTLE_DONE pgs=1591 cs=0 l=1 rx=0x7f7424010480 tx=0x7f74240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:52.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f7433fff700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f743c156340 0x7f743c1567d0 secure :-1 s=THROTTLE_DONE pgs=1591 cs=0 l=1 rx=0x7f7424010480 tx=0x7f74240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:52.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f7433fff700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f743c156340 0x7f743c1567d0 secure :-1 s=THROTTLE_DONE pgs=1591 cs=0 l=1 rx=0x7f7424010480 tx=0x7f74240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f74397fa700 1 -- 172.21.15.80:0/3395924116 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7424000bc0 con 0x7f743c156340 2019-11-28T11:41:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f74397fa700 1 -- 172.21.15.80:0/3395924116 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74240095a0 con 0x7f743c156340 2019-11-28T11:41:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f74397fa700 1 -- 172.21.15.80:0/3395924116 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74240011a0 con 0x7f743c156340 2019-11-28T11:41:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f7441f18700 1 -- 172.21.15.80:0/3395924116 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c137df0 con 0x7f743c156340 2019-11-28T11:41:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.305+0000 7f7441f18700 1 -- 172.21.15.80:0/3395924116 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c137a70 con 0x7f743c156340 2019-11-28T11:41:52.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.306+0000 7f7433fff700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f743c156340 0x7f743c1567d0 secure :-1 s=THROTTLE_DONE pgs=1591 cs=0 l=1 rx=0x7f7424010480 tx=0x7f74240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:52.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.306+0000 7f74397fa700 1 -- 172.21.15.80:0/3395924116 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7424000b50 con 0x7f743c156340 2019-11-28T11:41:52.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.306+0000 7f7433fff700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f743c156340 0x7f743c1567d0 secure :-1 s=THROTTLE_DONE pgs=1591 cs=0 l=1 rx=0x7f7424010480 tx=0x7f74240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:52.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.306+0000 7f74397fa700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7414018730 0x7f741401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:41:52.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.306+0000 7f74397fa700 1 -- 172.21.15.80:0/3395924116 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7424031b30 con 0x7f743c156340 2019-11-28T11:41:52.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.306+0000 7f743bfff700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7414018730 0x7f741401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:41:52.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.307+0000 7f743bfff700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7414018730 0x7f741401abc0 crc :-1 s=READY pgs=646 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:41:52.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.312+0000 7f7441f18700 1 -- 172.21.15.80:0/3395924116 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743c137df0 con 0x7f743c156340 2019-11-28T11:41:52.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.316+0000 7f7433fff700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f743c156340 0x7f743c1567d0 secure :-1 s=THROTTLE_DONE pgs=1591 cs=0 l=1 rx=0x7f7424010480 tx=0x7f74240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:52.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.316+0000 7f74397fa700 1 -- 172.21.15.80:0/3395924116 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7424000940 con 0x7f743c156340 2019-11-28T11:41:52.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.488+0000 7f7441f18700 1 -- 172.21.15.80:0/3395924116 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f743c137a70 con 0x7f743c156340 2019-11-28T11:41:52.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.488+0000 7f7433fff700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f743c156340 0x7f743c1567d0 secure :-1 s=THROTTLE_DONE pgs=1591 cs=0 l=1 rx=0x7f7424010480 tx=0x7f74240102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:41:52.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.488+0000 7f74397fa700 1 -- 172.21.15.80:0/3395924116 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+2448 (secure 0 0 0) 0x7f7424000b50 con 0x7f743c156340 2019-11-28T11:41:52.523 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 84 2019-11-28T11:41:52.523 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:41:52.524 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":84,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1010023901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1010023901},{"type":"v1","addr":"172.21.15.80:6834","nonce":1010023901}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":82},{"gid":8556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3440274141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3440274141},{"type":"v1","addr":"172.21.15.80:6835","nonce":3440274141}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":82}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:25.297182+0000","modified":"2019-11-28T11:41:33.675187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6242":{"gid":6242,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2489382286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2489382286},{"type":"v1","addr":"172.21.15.174:6835","nonce":2489382286}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2019-11-28T11:41:52.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.491+0000 7f7441f18700 1 -- 172.21.15.80:0/3395924116 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7414018730 msgr2=0x7f741401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:52.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.491+0000 7f7441f18700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7414018730 0x7f741401abc0 crc :-1 s=READY pgs=646 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:52.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.491+0000 7f7441f18700 1 -- 172.21.15.80:0/3395924116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f743c156340 msgr2=0x7f743c1567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:41:52.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.491+0000 7f7441f18700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f743c156340 0x7f743c1567d0 secure :-1 s=READY pgs=1591 cs=0 l=1 rx=0x7f7424010480 tx=0x7f74240102b0).stop 2019-11-28T11:41:52.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.491+0000 7f7441f18700 1 -- 172.21.15.80:0/3395924116 shutdown_connections 2019-11-28T11:41:52.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.491+0000 7f7441f18700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f743c156d10 0x7f743c16aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:52.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.491+0000 7f7441f18700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f743c156340 0x7f743c1567d0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:52.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.491+0000 7f7441f18700 1 --2- 172.21.15.80:0/3395924116 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7414018730 0x7f741401abc0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:41:52.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.491+0000 7f7441f18700 1 -- 172.21.15.80:0/3395924116 shutdown_connections 2019-11-28T11:41:52.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.491+0000 7f7441f18700 1 -- 172.21.15.80:0/3395924116 wait complete. 2019-11-28T11:41:52.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:41:52.491+0000 7f7441f18700 1 -- 172.21.15.80:0/3395924116 >> 172.21.15.80:0/3395924116 conn(0x7f743c13fa50 msgr2=0x7f743c07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:41:52.536 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session evict 8646 2019-11-28T11:41:52.721 INFO:tasks.cephfs.filesystem:_json_asok output: 2019-11-28T11:41:53.789 INFO:tasks.cephfs.test_client_recovery:cap_waiter waited 1.06767916679s 2019-11-28T11:41:55.802 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:41:55.807 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:41:55.812 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:44:14.008 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2019-11-28T11:44:14.009 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T11:44:14.017 DEBUG:tasks.ceph:Missed logrotate, host unreachable 2019-11-28T11:44:44.010 INFO:teuthology.misc:Re-opening connections... 2019-11-28T11:44:44.010 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:44:44.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:44:44.011 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:44:44.018 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:44:44.025 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:44:44.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:44:44.031 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:44:44.131 INFO:teuthology.orchestra.run.smithi076:> true 2019-11-28T11:44:44.133 INFO:teuthology.orchestra.run.smithi076:> true 2019-11-28T11:44:44.454 DEBUG:teuthology.misc:waited 0.443099975586 2019-11-28T11:44:44.454 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:44:44.464 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:44:44.472 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:44:44.477 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:44:45.454 INFO:teuthology.orchestra.run:Running command with timeout 10 2019-11-28T11:44:45.454 INFO:teuthology.orchestra.run.smithi076:> uptime 2019-11-28T11:44:45.524 INFO:teuthology.orchestra.run.smithi076.stdout: 11:44:45 up 1 min, 0 users, load average: 0.53, 0.24, 0.09 2019-11-28T11:44:45.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:44:45.525 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:44:45.611 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:44:45.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.698+0000 7fc9e9939700 1 Processor -- start 2019-11-28T11:44:45.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.698+0000 7fc9e9939700 1 -- start start 2019-11-28T11:44:45.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.699+0000 7fc9e9939700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9e406c0a0 0x7fc9e4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:45.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.699+0000 7fc9e9939700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc9e40734e0 0x7fc9e4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:45.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.699+0000 7fc9e9939700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9e4072360 0x7fc9e40727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:45.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.699+0000 7fc9e9939700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e406f330 con 0x7fc9e4072360 2019-11-28T11:44:45.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.699+0000 7fc9e9939700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e40706c0 con 0x7fc9e40734e0 2019-11-28T11:44:45.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.699+0000 7fc9e9939700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e4070a40 con 0x7fc9e406c0a0 2019-11-28T11:44:45.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.699+0000 7fc9e3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9e4072360 0x7fc9e40727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:45.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.699+0000 7fc9e3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9e4072360 0x7fc9e40727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39500/0 (socket says 172.21.15.80:39500) 2019-11-28T11:44:45.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.699+0000 7fc9e3fff700 1 -- 172.21.15.80:0/223970958 learned_addr learned my addr 172.21.15.80:0/223970958 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:45.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e37fe700 1 --2- 172.21.15.80:0/223970958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9e406c0a0 0x7fc9e4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:45.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e2ffd700 1 --2- 172.21.15.80:0/223970958 >> v2:172.21.15.174:3300/0 conn(0x7fc9e40734e0 0x7fc9e4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:45.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e3fff700 1 -- 172.21.15.80:0/223970958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9e406c0a0 msgr2=0x7fc9e4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:45.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/223970958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9e406c0a0 0x7fc9e4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:45.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e3fff700 1 -- 172.21.15.80:0/223970958 >> v2:172.21.15.174:3300/0 conn(0x7fc9e40734e0 msgr2=0x7fc9e4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:45.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/223970958 >> v2:172.21.15.174:3300/0 conn(0x7fc9e40734e0 0x7fc9e4071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:45.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e3fff700 1 -- 172.21.15.80:0/223970958 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e406db00 con 0x7fc9e4072360 2019-11-28T11:44:45.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/223970958 >> v2:172.21.15.80:3300/0 conn(0x7fc9e4072360 0x7fc9e40727e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc9dc00f6b0 tx=0x7fc9dc007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:45.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/223970958 >> v2:172.21.15.80:3300/0 conn(0x7fc9e4072360 0x7fc9e40727e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc9dc00f6b0 tx=0x7fc9dc007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:45.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/223970958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4072360 0x7fc9e40727e0 secure :-1 s=READY pgs=1592 cs=0 l=1 rx=0x7fc9dc00f6b0 tx=0x7fc9dc007d50).ready entity=mon.0 client_cookie=531f54998f5a5cbb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:45.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/223970958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4072360 0x7fc9e40727e0 secure :-1 s=THROTTLE_DONE pgs=1592 cs=0 l=1 rx=0x7fc9dc00f6b0 tx=0x7fc9dc007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:45.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/223970958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4072360 0x7fc9e40727e0 secure :-1 s=THROTTLE_DONE pgs=1592 cs=0 l=1 rx=0x7fc9dc00f6b0 tx=0x7fc9dc007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:45.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e27fc700 1 -- 172.21.15.80:0/223970958 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9dc000ba0 con 0x7fc9e4072360 2019-11-28T11:44:45.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/223970958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4072360 0x7fc9e40727e0 secure :-1 s=THROTTLE_DONE pgs=1592 cs=0 l=1 rx=0x7fc9dc00f6b0 tx=0x7fc9dc007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:45.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e27fc700 1 -- 172.21.15.80:0/223970958 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc0010e0 con 0x7fc9e4072360 2019-11-28T11:44:45.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e27fc700 1 -- 172.21.15.80:0/223970958 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9dc0017b0 con 0x7fc9e4072360 2019-11-28T11:44:45.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e9939700 1 -- 172.21.15.80:0/223970958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4072360 msgr2=0x7fc9e40727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:45.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.700+0000 7fc9e9939700 1 --2- 172.21.15.80:0/223970958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4072360 0x7fc9e40727e0 secure :-1 s=READY pgs=1592 cs=0 l=1 rx=0x7fc9dc00f6b0 tx=0x7fc9dc007d50).stop 2019-11-28T11:44:45.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.701+0000 7fc9e9939700 1 -- 172.21.15.80:0/223970958 shutdown_connections 2019-11-28T11:44:45.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.701+0000 7fc9e9939700 1 --2- 172.21.15.80:0/223970958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4072360 0x7fc9e40727e0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:45.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.701+0000 7fc9e9939700 1 --2- 172.21.15.80:0/223970958 >> v2:172.21.15.174:3300/0 conn(0x7fc9e40734e0 0x7fc9e4071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:45.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.701+0000 7fc9e9939700 1 --2- 172.21.15.80:0/223970958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9e406c0a0 0x7fc9e4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:45.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.701+0000 7fc9e9939700 1 -- 172.21.15.80:0/223970958 shutdown_connections 2019-11-28T11:44:45.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.701+0000 7fc9e9939700 1 -- 172.21.15.80:0/223970958 wait complete. 2019-11-28T11:44:45.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.701+0000 7fc9e9939700 1 -- 172.21.15.80:0/223970958 >> 172.21.15.80:0/223970958 conn(0x7fc9e4061cf0 msgr2=0x7fc9e4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:45.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.703+0000 7fc9e9939700 1 Processor -- start 2019-11-28T11:44:45.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.703+0000 7fc9e9939700 1 -- start start 2019-11-28T11:44:45.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.704+0000 7fc9e9939700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9e413e9e0 0x7fc9e4108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:45.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.704+0000 7fc9e9939700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9e4109430 0x7fc9e41098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:45.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.704+0000 7fc9e9939700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e41066e0 con 0x7fc9e413e5f0 2019-11-28T11:44:45.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.704+0000 7fc9e9939700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e410e060 con 0x7fc9e4109430 2019-11-28T11:44:45.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.704+0000 7fc9e9939700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e410e330 con 0x7fc9e413e9e0 2019-11-28T11:44:45.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.704+0000 7fc9e3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9e4109430 0x7fc9e41098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:45.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.704+0000 7fc9e37fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc9e413e5f0 0x7fc9e410a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38820/0 (socket says 172.21.15.80:38820) 2019-11-28T11:44:45.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.704+0000 7fc9e37fe700 1 -- 172.21.15.80:0/2370593562 learned_addr learned my addr 172.21.15.80:0/2370593562 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:45.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.704+0000 7fc9e2ffd700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9e413e9e0 0x7fc9e4108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:45.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.704+0000 7fc9e3fff700 1 -- 172.21.15.80:0/2370593562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9e413e9e0 msgr2=0x7fc9e4108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:45.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.704+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9e413e9e0 0x7fc9e4108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:45.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.704+0000 7fc9e3fff700 1 -- 172.21.15.80:0/2370593562 >> v1:172.21.15.80:6789/0 conn(0x7fc9e413e5f0 legacy=0x7fc9e410a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:45.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.704+0000 7fc9e3fff700 1 -- 172.21.15.80:0/2370593562 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e410e9c0 con 0x7fc9e4109430 2019-11-28T11:44:45.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.704+0000 7fc9dbfff700 1 -- 172.21.15.80:0/2370593562 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606090462 0 0) 0x7fc9d40057b0 con 0x7fc9e413e5f0 2019-11-28T11:44:45.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.705+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/2370593562 >> v2:172.21.15.80:3300/0 conn(0x7fc9e4109430 0x7fc9e41098a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9dc0103a0 tx=0x7fc9dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:45.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.705+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/2370593562 >> v2:172.21.15.80:3300/0 conn(0x7fc9e4109430 0x7fc9e41098a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9dc0103a0 tx=0x7fc9dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:45.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.705+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4109430 0x7fc9e41098a0 secure :-1 s=READY pgs=1594 cs=0 l=1 rx=0x7fc9dc0103a0 tx=0x7fc9dc010740).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:45.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.705+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4109430 0x7fc9e41098a0 secure :-1 s=THROTTLE_DONE pgs=1594 cs=0 l=1 rx=0x7fc9dc0103a0 tx=0x7fc9dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:45.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.705+0000 7fc9dbfff700 1 -- 172.21.15.80:0/2370593562 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9dc008180 con 0x7fc9e4109430 2019-11-28T11:44:45.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.705+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4109430 0x7fc9e41098a0 secure :-1 s=THROTTLE_DONE pgs=1594 cs=0 l=1 rx=0x7fc9dc0103a0 tx=0x7fc9dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:45.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.705+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4109430 0x7fc9e41098a0 secure :-1 s=THROTTLE_DONE pgs=1594 cs=0 l=1 rx=0x7fc9dc0103a0 tx=0x7fc9dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:45.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.705+0000 7fc9dbfff700 1 -- 172.21.15.80:0/2370593562 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc0010a0 con 0x7fc9e4109430 2019-11-28T11:44:45.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.705+0000 7fc9e9939700 1 -- 172.21.15.80:0/2370593562 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e410ed40 con 0x7fc9e4109430 2019-11-28T11:44:45.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.705+0000 7fc9dbfff700 1 -- 172.21.15.80:0/2370593562 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9dc001770 con 0x7fc9e4109430 2019-11-28T11:44:45.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.705+0000 7fc9e9939700 1 -- 172.21.15.80:0/2370593562 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e410e9c0 con 0x7fc9e4109430 2019-11-28T11:44:45.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.705+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4109430 0x7fc9e41098a0 secure :-1 s=THROTTLE_DONE pgs=1594 cs=0 l=1 rx=0x7fc9dc0103a0 tx=0x7fc9dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:45.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.706+0000 7fc9dbfff700 1 -- 172.21.15.80:0/2370593562 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc9dc001290 con 0x7fc9e4109430 2019-11-28T11:44:45.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.706+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4109430 0x7fc9e41098a0 secure :-1 s=THROTTLE_DONE pgs=1594 cs=0 l=1 rx=0x7fc9dc0103a0 tx=0x7fc9dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:45.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.706+0000 7fc9dbfff700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9bc018730 0x7fc9bc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:45.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.706+0000 7fc9dbfff700 1 -- 172.21.15.80:0/2370593562 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fc9dc0319e0 con 0x7fc9e4109430 2019-11-28T11:44:45.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.706+0000 7fc9e37fe700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9bc018730 0x7fc9bc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:45.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.706+0000 7fc9e37fe700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9bc018730 0x7fc9bc01abc0 crc :-1 s=READY pgs=647 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:45.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.714+0000 7fc9e9939700 1 -- 172.21.15.80:0/2370593562 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e410ed40 con 0x7fc9e4109430 2019-11-28T11:44:45.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.717+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4109430 0x7fc9e41098a0 secure :-1 s=THROTTLE_DONE pgs=1594 cs=0 l=1 rx=0x7fc9dc0103a0 tx=0x7fc9dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:45.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.717+0000 7fc9dbfff700 1 -- 172.21.15.80:0/2370593562 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc9dc000ba0 con 0x7fc9e4109430 2019-11-28T11:44:45.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.893+0000 7fc9e9939700 1 -- 172.21.15.80:0/2370593562 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9e410e9c0 con 0x7fc9e4109430 2019-11-28T11:44:45.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.893+0000 7fc9e3fff700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4109430 0x7fc9e41098a0 secure :-1 s=THROTTLE_DONE pgs=1594 cs=0 l=1 rx=0x7fc9dc0103a0 tx=0x7fc9dc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:45.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.893+0000 7fc9dbfff700 1 -- 172.21.15.80:0/2370593562 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+14932 (secure 0 0 0) 0x7fc9dc001290 con 0x7fc9e4109430 2019-11-28T11:44:45.935 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:44:45.936 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":118,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:41:52.667891+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:41:23.623555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2019-11-28T11:41:24.315901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.76:0/3038579724":"2019-11-28T12:41:52.640330+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:44:45.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.896+0000 7fc9e9939700 1 -- 172.21.15.80:0/2370593562 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9bc018730 msgr2=0x7fc9bc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:45.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.896+0000 7fc9e9939700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9bc018730 0x7fc9bc01abc0 crc :-1 s=READY pgs=647 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:45.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.896+0000 7fc9e9939700 1 -- 172.21.15.80:0/2370593562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4109430 msgr2=0x7fc9e41098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:45.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.896+0000 7fc9e9939700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4109430 0x7fc9e41098a0 secure :-1 s=READY pgs=1594 cs=0 l=1 rx=0x7fc9dc0103a0 tx=0x7fc9dc010740).stop 2019-11-28T11:44:45.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.896+0000 7fc9e9939700 1 -- 172.21.15.80:0/2370593562 shutdown_connections 2019-11-28T11:44:45.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.896+0000 7fc9e9939700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9bc018730 0x7fc9bc01abc0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:45.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.896+0000 7fc9e9939700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e4109430 0x7fc9e41098a0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:45.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.896+0000 7fc9e9939700 1 --2- 172.21.15.80:0/2370593562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9e413e9e0 0x7fc9e4108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:45.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.896+0000 7fc9e9939700 1 -- 172.21.15.80:0/2370593562 shutdown_connections 2019-11-28T11:44:45.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.896+0000 7fc9e9939700 1 -- 172.21.15.80:0/2370593562 wait complete. 2019-11-28T11:44:45.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:45.896+0000 7fc9e9939700 1 -- 172.21.15.80:0/2370593562 >> 172.21.15.80:0/2370593562 conn(0x7fc9e413d620 msgr2=0x7fc9e413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:45.946 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:41:23.623555+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 18, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'116', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:41:24.315901+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 19, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'117', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:44:45.947 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:44:46.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.030+0000 7fc0b0eb2700 1 Processor -- start 2019-11-28T11:44:46.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.031+0000 7fc0b0eb2700 1 -- start start 2019-11-28T11:44:46.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0b0eb2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0ac15ed10 0x7fc0ac15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:46.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0b0eb2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0ac06db60 con 0x7fc0ac0734b0 2019-11-28T11:44:46.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0b0eb2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0ac06e060 con 0x7fc0ac073020 2019-11-28T11:44:46.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0b0eb2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ac06fe00 con 0x7fc0ac15ed10 2019-11-28T11:44:46.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0aad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0ac15ed10 0x7fc0ac15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:46.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0aad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc0ac15ed10 0x7fc0ac15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39512/0 (socket says 172.21.15.80:39512) 2019-11-28T11:44:46.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0aad9d700 1 -- 172.21.15.80:0/1320121572 learned_addr learned my addr 172.21.15.80:0/1320121572 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:46.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0aad9d700 1 -- 172.21.15.80:0/1320121572 >> v1:172.21.15.174:6789/0 conn(0x7fc0ac073020 legacy=0x7fc0ac071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0aad9d700 1 -- 172.21.15.80:0/1320121572 >> v1:172.21.15.80:6789/0 conn(0x7fc0ac0734b0 legacy=0x7fc0ac0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0aad9d700 1 -- 172.21.15.80:0/1320121572 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ac070760 con 0x7fc0ac15ed10 2019-11-28T11:44:46.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0a9d9b700 1 -- 172.21.15.80:0/1320121572 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953468456 0 0) 0x7fc0a4000a40 con 0x7fc0ac0734b0 2019-11-28T11:44:46.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/1320121572 >> v2:172.21.15.80:3300/0 conn(0x7fc0ac15ed10 0x7fc0ac15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc09400f740 tx=0x7fc09400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/1320121572 >> v2:172.21.15.80:3300/0 conn(0x7fc0ac15ed10 0x7fc0ac15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc09400f740 tx=0x7fc09400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/1320121572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0ac15ed10 0x7fc0ac15f100 secure :-1 s=READY pgs=1596 cs=0 l=1 rx=0x7fc09400f740 tx=0x7fc09400fae0).ready entity=mon.0 client_cookie=ed7a9940e1e05585 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:46.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/1320121572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0ac15ed10 0x7fc0ac15f100 secure :-1 s=THROTTLE_DONE pgs=1596 cs=0 l=1 rx=0x7fc09400f740 tx=0x7fc09400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0a9d9b700 1 -- 172.21.15.80:0/1320121572 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc094000960 con 0x7fc0ac15ed10 2019-11-28T11:44:46.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/1320121572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0ac15ed10 0x7fc0ac15f100 secure :-1 s=THROTTLE_DONE pgs=1596 cs=0 l=1 rx=0x7fc09400f740 tx=0x7fc09400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/1320121572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0ac15ed10 0x7fc0ac15f100 secure :-1 s=THROTTLE_DONE pgs=1596 cs=0 l=1 rx=0x7fc09400f740 tx=0x7fc09400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0a9d9b700 1 -- 172.21.15.80:0/1320121572 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc094000c90 con 0x7fc0ac15ed10 2019-11-28T11:44:46.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0a9d9b700 1 -- 172.21.15.80:0/1320121572 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc094000960 con 0x7fc0ac15ed10 2019-11-28T11:44:46.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0b0eb2700 1 -- 172.21.15.80:0/1320121572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0ac15ed10 msgr2=0x7fc0ac15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.032+0000 7fc0b0eb2700 1 --2- 172.21.15.80:0/1320121572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0ac15ed10 0x7fc0ac15f100 secure :-1 s=READY pgs=1596 cs=0 l=1 rx=0x7fc09400f740 tx=0x7fc09400fae0).stop 2019-11-28T11:44:46.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.033+0000 7fc0b0eb2700 1 -- 172.21.15.80:0/1320121572 shutdown_connections 2019-11-28T11:44:46.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.033+0000 7fc0b0eb2700 1 --2- 172.21.15.80:0/1320121572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0ac15ed10 0x7fc0ac15f100 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:46.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.033+0000 7fc0b0eb2700 1 -- 172.21.15.80:0/1320121572 shutdown_connections 2019-11-28T11:44:46.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.033+0000 7fc0b0eb2700 1 -- 172.21.15.80:0/1320121572 wait complete. 2019-11-28T11:44:46.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.033+0000 7fc0b0eb2700 1 -- 172.21.15.80:0/1320121572 >> 172.21.15.80:0/1320121572 conn(0x7fc0ac061d20 msgr2=0x7fc0ac0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:46.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.036+0000 7fc0b0eb2700 1 Processor -- start 2019-11-28T11:44:46.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.036+0000 7fc0b0eb2700 1 -- start start 2019-11-28T11:44:46.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.036+0000 7fc0b0eb2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0ac10ac30 0x7fc0ac10d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:46.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.036+0000 7fc0b0eb2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc0ac10cd00 0x7fc0ac12d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:46.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.036+0000 7fc0b0eb2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0ac147a70 con 0x7fc0ac10d7f0 2019-11-28T11:44:46.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.036+0000 7fc0b0eb2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ac076a60 con 0x7fc0ac10cd00 2019-11-28T11:44:46.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.036+0000 7fc0b0eb2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac076d30 con 0x7fc0ac10ac30 2019-11-28T11:44:46.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0aa59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc0ac10d7f0 0x7fc0ac10c500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38836/0 (socket says 172.21.15.80:38836) 2019-11-28T11:44:46.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0aa59c700 1 -- 172.21.15.80:0/2558985615 learned_addr learned my addr 172.21.15.80:0/2558985615 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:46.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0ac10ac30 0x7fc0ac10d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:46.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648111998 0 0) 0x7fc09c0014d0 con 0x7fc0ac10d7f0 2019-11-28T11:44:46.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0ab59e700 1 --2- 172.21.15.80:0/2558985615 >> v2:172.21.15.174:3300/0 conn(0x7fc0ac10cd00 0x7fc0ac12d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:46.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc084002e80 con 0x7fc0ac10d7f0 2019-11-28T11:44:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1647663193 0 0) 0x7fc09c001640 con 0x7fc0ac10d7f0 2019-11-28T11:44:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc0840032e0 con 0x7fc0ac10d7f0 2019-11-28T11:44:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc09c001bf0 con 0x7fc0ac10d7f0 2019-11-28T11:44:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0ac10ac30 msgr2=0x7fc0ac10d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0a37fe700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0ac10ac30 0x7fc0ac10d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 >> v2:172.21.15.174:3300/0 conn(0x7fc0ac10cd00 msgr2=0x7fc0ac12d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0a37fe700 1 --2- 172.21.15.80:0/2558985615 >> v2:172.21.15.174:3300/0 conn(0x7fc0ac10cd00 0x7fc0ac12d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:46.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 >> v1:172.21.15.80:6789/0 conn(0x7fc0ac10d7f0 legacy=0x7fc0ac10c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0a37fe700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc084003310 0x7fc084003740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:46.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0a37fe700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc084003c80 0x7fc084004100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:46.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0a37fe700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc084004890 0x7fc084004d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:46.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08400bb60 con 0x7fc084003310 2019-11-28T11:44:46.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08400bd50 con 0x7fc084003c80 2019-11-28T11:44:46.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08400bf80 con 0x7fc084004890 2019-11-28T11:44:46.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc084003310 0x7fc084003740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:46.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0aa59c700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc084003c80 0x7fc084004100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:46.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0ab59e700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc084004890 0x7fc084004d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:46.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0aad9d700 1 -- 172.21.15.80:0/2558985615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc084004890 msgr2=0x7fc084004d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc084004890 0x7fc084004d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:46.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0aad9d700 1 -- 172.21.15.80:0/2558985615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc084003c80 msgr2=0x7fc084004100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc084003c80 0x7fc084004100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:46.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.037+0000 7fc0aad9d700 1 -- 172.21.15.80:0/2558985615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08400c230 con 0x7fc084003310 2019-11-28T11:44:46.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.038+0000 7fc0b0eb2700 1 -- 172.21.15.80:0/2558985615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ac164850 con 0x7fc084003310 2019-11-28T11:44:46.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.038+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc084003310 0x7fc084003740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc094010310 tx=0x7fc094010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.038+0000 7fc0b0eb2700 1 -- 172.21.15.80:0/2558985615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ac163800 con 0x7fc084003310 2019-11-28T11:44:46.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.038+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc084003310 0x7fc084003740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc094010310 tx=0x7fc094010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.038+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc084003310 0x7fc084003740 secure :-1 s=READY pgs=1598 cs=0 l=1 rx=0x7fc094010310 tx=0x7fc094010190).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:46.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.038+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc084003310 0x7fc084003740 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7fc094010310 tx=0x7fc094010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.038+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc094000b30 con 0x7fc084003310 2019-11-28T11:44:46.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.038+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc084003310 0x7fc084003740 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7fc094010310 tx=0x7fc094010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.038+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc094007c90 con 0x7fc084003310 2019-11-28T11:44:46.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.038+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc084003310 0x7fc084003740 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7fc094010310 tx=0x7fc094010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.038+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc094000d20 con 0x7fc084003310 2019-11-28T11:44:46.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.038+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc084003310 0x7fc084003740 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7fc094010310 tx=0x7fc094010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.038+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc094000940 con 0x7fc084003310 2019-11-28T11:44:46.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.038+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc084003310 0x7fc084003740 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7fc094010310 tx=0x7fc094010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.038+0000 7fc0a37fe700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc084020ad0 0x7fc084022f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:46.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.038+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fc094031bd0 con 0x7fc084003310 2019-11-28T11:44:46.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.039+0000 7fc0aa59c700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc084020ad0 0x7fc084022f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:46.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.039+0000 7fc0aa59c700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc084020ad0 0x7fc084022f00 crc :-1 s=READY pgs=648 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:46.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.046+0000 7fc0b0eb2700 1 -- 172.21.15.80:0/2558985615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ac1644d0 con 0x7fc084003310 2019-11-28T11:44:46.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.049+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc084003310 0x7fc084003740 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7fc094010310 tx=0x7fc094010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.049+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc094007c40 con 0x7fc084003310 2019-11-28T11:44:46.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.216+0000 7fc0b0eb2700 1 -- 172.21.15.80:0/2558985615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fc0ac164850 con 0x7fc084003310 2019-11-28T11:44:46.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.216+0000 7fc0aad9d700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc084003310 0x7fc084003740 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7fc094010310 tx=0x7fc094010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.216+0000 7fc0a37fe700 1 -- 172.21.15.80:0/2558985615 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v118) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc0940075d0 con 0x7fc084003310 2019-11-28T11:44:46.256 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:44:46.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.219+0000 7fc0b0eb2700 1 -- 172.21.15.80:0/2558985615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc084020ad0 msgr2=0x7fc084022f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.219+0000 7fc0b0eb2700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc084020ad0 0x7fc084022f00 crc :-1 s=READY pgs=648 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:46.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.219+0000 7fc0b0eb2700 1 -- 172.21.15.80:0/2558985615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc084003310 msgr2=0x7fc084003740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.219+0000 7fc0b0eb2700 1 --2- 172.21.15.80:0/2558985615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc084003310 0x7fc084003740 secure :-1 s=READY pgs=1598 cs=0 l=1 rx=0x7fc094010310 tx=0x7fc094010190).stop 2019-11-28T11:44:46.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.219+0000 7fc0ab59e700 1 -- 172.21.15.80:0/2558985615 reap_dead start 2019-11-28T11:44:46.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.219+0000 7fc0ab59e700 1 -- 172.21.15.80:0/2558985615 reap_dead start 2019-11-28T11:44:46.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.219+0000 7fc0b0eb2700 1 -- 172.21.15.80:0/2558985615 shutdown_connections 2019-11-28T11:44:46.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.219+0000 7fc0b0eb2700 1 -- 172.21.15.80:0/2558985615 shutdown_connections 2019-11-28T11:44:46.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.219+0000 7fc0b0eb2700 1 -- 172.21.15.80:0/2558985615 wait complete. 2019-11-28T11:44:46.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.219+0000 7fc0b0eb2700 1 -- 172.21.15.80:0/2558985615 >> 172.21.15.80:0/2558985615 conn(0x7fc0ac160bf0 msgr2=0x7fc0ac132ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:46.268 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:44:46.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.352+0000 7f6171d13700 1 Processor -- start 2019-11-28T11:44:46.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.352+0000 7f6171d13700 1 -- start start 2019-11-28T11:44:46.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.353+0000 7f6171d13700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f616c15ed10 0x7f616c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:46.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.353+0000 7f6171d13700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c06db60 con 0x7f616c0734b0 2019-11-28T11:44:46.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.353+0000 7f6171d13700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c06e060 con 0x7f616c073020 2019-11-28T11:44:46.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.353+0000 7f6171d13700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c06f3d0 con 0x7f616c15ed10 2019-11-28T11:44:46.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.353+0000 7f6170ab1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f616c0734b0 0x7f616c0726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38852/0 (socket says 172.21.15.80:38852) 2019-11-28T11:44:46.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.353+0000 7f6170ab1700 1 -- 172.21.15.80:0/3153578855 learned_addr learned my addr 172.21.15.80:0/3153578855 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:46.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.353+0000 7f616bfff700 1 --2- 172.21.15.80:0/3153578855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f616c15ed10 0x7f616c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:46.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.353+0000 7f616b7fe700 1 -- 172.21.15.80:0/3153578855 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527251091 0 0) 0x7f61640014d0 con 0x7f616c0734b0 2019-11-28T11:44:46.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f616b7fe700 1 -- 172.21.15.80:0/3153578855 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f614c002e80 con 0x7f616c0734b0 2019-11-28T11:44:46.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f616b7fe700 1 -- 172.21.15.80:0/3153578855 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669762375 0 0) 0x7f6154001080 con 0x7f616c073020 2019-11-28T11:44:46.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f616b7fe700 1 -- 172.21.15.80:0/3153578855 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f614c0030b0 con 0x7f616c073020 2019-11-28T11:44:46.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f616bfff700 1 -- 172.21.15.80:0/3153578855 >> v1:172.21.15.174:6789/0 conn(0x7f616c073020 legacy=0x7f616c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f616bfff700 1 -- 172.21.15.80:0/3153578855 >> v1:172.21.15.80:6789/0 conn(0x7f616c0734b0 legacy=0x7f616c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f616b7fe700 1 -- 172.21.15.80:0/3153578855 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3031835176 0 0) 0x7f61640014b0 con 0x7f616c0734b0 2019-11-28T11:44:46.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f616bfff700 1 -- 172.21.15.80:0/3153578855 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c070760 con 0x7f616c15ed10 2019-11-28T11:44:46.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f616bfff700 1 --2- 172.21.15.80:0/3153578855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f616c15ed10 0x7f616c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f615c00af50 tx=0x7f615c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f616bfff700 1 --2- 172.21.15.80:0/3153578855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f616c15ed10 0x7f616c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f615c00af50 tx=0x7f615c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f616bfff700 1 --2- 172.21.15.80:0/3153578855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f616c15ed10 0x7f616c15f100 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f615c00af50 tx=0x7f615c00b760).ready entity=mon.2 client_cookie=6ed13ad81999445a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:46.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f616bfff700 1 --2- 172.21.15.80:0/3153578855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f616c15ed10 0x7f616c15f100 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f615c00af50 tx=0x7f615c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f616b7fe700 1 -- 172.21.15.80:0/3153578855 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f615c007210 con 0x7f616c15ed10 2019-11-28T11:44:46.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f616bfff700 1 --2- 172.21.15.80:0/3153578855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f616c15ed10 0x7f616c15f100 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f615c00af50 tx=0x7f615c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f616bfff700 1 --2- 172.21.15.80:0/3153578855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f616c15ed10 0x7f616c15f100 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f615c00af50 tx=0x7f615c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f616b7fe700 1 -- 172.21.15.80:0/3153578855 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c0099b0 con 0x7f616c15ed10 2019-11-28T11:44:46.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f616b7fe700 1 -- 172.21.15.80:0/3153578855 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f615c009ba0 con 0x7f616c15ed10 2019-11-28T11:44:46.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f6171d13700 1 -- 172.21.15.80:0/3153578855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f616c15ed10 msgr2=0x7f616c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.354+0000 7f6171d13700 1 --2- 172.21.15.80:0/3153578855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f616c15ed10 0x7f616c15f100 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f615c00af50 tx=0x7f615c00b760).stop 2019-11-28T11:44:46.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.355+0000 7f6171d13700 1 -- 172.21.15.80:0/3153578855 shutdown_connections 2019-11-28T11:44:46.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.355+0000 7f6171d13700 1 --2- 172.21.15.80:0/3153578855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f616c15ed10 0x7f616c15f100 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:46.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.355+0000 7f6171d13700 1 -- 172.21.15.80:0/3153578855 shutdown_connections 2019-11-28T11:44:46.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.355+0000 7f6171d13700 1 -- 172.21.15.80:0/3153578855 wait complete. 2019-11-28T11:44:46.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.355+0000 7f6171d13700 1 -- 172.21.15.80:0/3153578855 >> 172.21.15.80:0/3153578855 conn(0x7f616c061d20 msgr2=0x7f616c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:46.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.357+0000 7f6171d13700 1 Processor -- start 2019-11-28T11:44:46.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.357+0000 7f6171d13700 1 -- start start 2019-11-28T11:44:46.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.358+0000 7f6171d13700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f616c1079b0 0x7f616c107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:46.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.358+0000 7f6171d13700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c148e00 con 0x7f616c108380 2019-11-28T11:44:46.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.358+0000 7f6171d13700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c108b10 con 0x7f616c148320 2019-11-28T11:44:46.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.358+0000 7f6171d13700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c13aa20 con 0x7f616c1079b0 2019-11-28T11:44:46.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.358+0000 7f6163fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f616c1079b0 0x7f616c107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:46.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.358+0000 7f6163fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f616c1079b0 0x7f616c107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39540/0 (socket says 172.21.15.80:39540) 2019-11-28T11:44:46.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.358+0000 7f6163fff700 1 -- 172.21.15.80:0/1669234068 learned_addr learned my addr 172.21.15.80:0/1669234068 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:46.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.358+0000 7f6170ab1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f616c108380 0x7f616c168d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38858/0 (socket says 172.21.15.80:38858) 2019-11-28T11:44:46.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.359+0000 7f6163fff700 1 -- 172.21.15.80:0/1669234068 >> v1:172.21.15.174:6789/0 conn(0x7f616c148320 legacy=0x7f616c10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.359+0000 7f6163fff700 1 -- 172.21.15.80:0/1669234068 >> v1:172.21.15.80:6789/0 conn(0x7f616c108380 legacy=0x7f616c168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.359+0000 7f6163fff700 1 -- 172.21.15.80:0/1669234068 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c10c490 con 0x7f616c1079b0 2019-11-28T11:44:46.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.359+0000 7f61697fa700 1 -- 172.21.15.80:0/1669234068 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676969561 0 0) 0x7f615c00ac20 con 0x7f616c148320 2019-11-28T11:44:46.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.359+0000 7f6163fff700 1 --2- 172.21.15.80:0/1669234068 >> v2:172.21.15.80:3300/0 conn(0x7f616c1079b0 0x7f616c107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6154010410 tx=0x7f61540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.359+0000 7f6163fff700 1 --2- 172.21.15.80:0/1669234068 >> v2:172.21.15.80:3300/0 conn(0x7f616c1079b0 0x7f616c107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6154010410 tx=0x7f61540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.359+0000 7f6163fff700 1 --2- 172.21.15.80:0/1669234068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f616c1079b0 0x7f616c107e40 secure :-1 s=READY pgs=1601 cs=0 l=1 rx=0x7f6154010410 tx=0x7f61540107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:46.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.359+0000 7f6163fff700 1 --2- 172.21.15.80:0/1669234068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f616c1079b0 0x7f616c107e40 secure :-1 s=THROTTLE_DONE pgs=1601 cs=0 l=1 rx=0x7f6154010410 tx=0x7f61540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.359+0000 7f61697fa700 1 -- 172.21.15.80:0/1669234068 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6154005770 con 0x7f616c1079b0 2019-11-28T11:44:46.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.359+0000 7f6163fff700 1 --2- 172.21.15.80:0/1669234068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f616c1079b0 0x7f616c107e40 secure :-1 s=THROTTLE_DONE pgs=1601 cs=0 l=1 rx=0x7f6154010410 tx=0x7f61540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.359+0000 7f61697fa700 1 -- 172.21.15.80:0/1669234068 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6154005390 con 0x7f616c1079b0 2019-11-28T11:44:46.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.359+0000 7f6163fff700 1 --2- 172.21.15.80:0/1669234068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f616c1079b0 0x7f616c107e40 secure :-1 s=THROTTLE_DONE pgs=1601 cs=0 l=1 rx=0x7f6154010410 tx=0x7f61540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.359+0000 7f61697fa700 1 -- 172.21.15.80:0/1669234068 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6154005960 con 0x7f616c1079b0 2019-11-28T11:44:46.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.359+0000 7f6171d13700 1 -- 172.21.15.80:0/1669234068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c10c810 con 0x7f616c1079b0 2019-11-28T11:44:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.359+0000 7f6171d13700 1 -- 172.21.15.80:0/1669234068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616c108820 con 0x7f616c1079b0 2019-11-28T11:44:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.360+0000 7f6163fff700 1 --2- 172.21.15.80:0/1669234068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f616c1079b0 0x7f616c107e40 secure :-1 s=THROTTLE_DONE pgs=1601 cs=0 l=1 rx=0x7f6154010410 tx=0x7f61540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.360+0000 7f61697fa700 1 -- 172.21.15.80:0/1669234068 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6154005390 con 0x7f616c1079b0 2019-11-28T11:44:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.360+0000 7f6163fff700 1 --2- 172.21.15.80:0/1669234068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f616c1079b0 0x7f616c107e40 secure :-1 s=THROTTLE_DONE pgs=1601 cs=0 l=1 rx=0x7f6154010410 tx=0x7f61540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.360+0000 7f61697fa700 1 --2- 172.21.15.80:0/1669234068 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6144018730 0x7f614401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.360+0000 7f61697fa700 1 -- 172.21.15.80:0/1669234068 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f6154031b20 con 0x7f616c1079b0 2019-11-28T11:44:46.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.360+0000 7f616bfff700 1 --2- 172.21.15.80:0/1669234068 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6144018730 0x7f614401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:46.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.361+0000 7f616bfff700 1 --2- 172.21.15.80:0/1669234068 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6144018730 0x7f614401abc0 crc :-1 s=READY pgs=649 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:46.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.367+0000 7f6171d13700 1 -- 172.21.15.80:0/1669234068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616c10c490 con 0x7f616c1079b0 2019-11-28T11:44:46.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.371+0000 7f6163fff700 1 --2- 172.21.15.80:0/1669234068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f616c1079b0 0x7f616c107e40 secure :-1 s=THROTTLE_DONE pgs=1601 cs=0 l=1 rx=0x7f6154010410 tx=0x7f61540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.371+0000 7f61697fa700 1 -- 172.21.15.80:0/1669234068 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f61540075a0 con 0x7f616c1079b0 2019-11-28T11:44:46.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.537+0000 7f6171d13700 1 -- 172.21.15.80:0/1669234068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f616c10c810 con 0x7f616c1079b0 2019-11-28T11:44:46.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.537+0000 7f6163fff700 1 --2- 172.21.15.80:0/1669234068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f616c1079b0 0x7f616c107e40 secure :-1 s=THROTTLE_DONE pgs=1601 cs=0 l=1 rx=0x7f6154010410 tx=0x7f61540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.537+0000 7f61697fa700 1 -- 172.21.15.80:0/1669234068 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v118) v1 ==== 104+0+10 (secure 0 0 0) 0x7f61540172c0 con 0x7f616c1079b0 2019-11-28T11:44:46.577 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:44:46.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.540+0000 7f6171d13700 1 -- 172.21.15.80:0/1669234068 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6144018730 msgr2=0x7f614401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.540+0000 7f6171d13700 1 --2- 172.21.15.80:0/1669234068 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6144018730 0x7f614401abc0 crc :-1 s=READY pgs=649 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:46.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.540+0000 7f6171d13700 1 -- 172.21.15.80:0/1669234068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f616c1079b0 msgr2=0x7f616c107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.540+0000 7f6171d13700 1 --2- 172.21.15.80:0/1669234068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f616c1079b0 0x7f616c107e40 secure :-1 s=READY pgs=1601 cs=0 l=1 rx=0x7f6154010410 tx=0x7f61540107b0).stop 2019-11-28T11:44:46.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.540+0000 7f6171d13700 1 -- 172.21.15.80:0/1669234068 shutdown_connections 2019-11-28T11:44:46.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.540+0000 7f6171d13700 1 --2- 172.21.15.80:0/1669234068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f616c1079b0 0x7f616c107e40 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:46.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.540+0000 7f6171d13700 1 --2- 172.21.15.80:0/1669234068 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6144018730 0x7f614401abc0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:46.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.540+0000 7f6171d13700 1 -- 172.21.15.80:0/1669234068 shutdown_connections 2019-11-28T11:44:46.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.540+0000 7f6171d13700 1 -- 172.21.15.80:0/1669234068 wait complete. 2019-11-28T11:44:46.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.540+0000 7f6171d13700 1 -- 172.21.15.80:0/1669234068 >> 172.21.15.80:0/1669234068 conn(0x7f616c15e2d0 msgr2=0x7f616c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:46.589 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:44:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.673+0000 7fd97200c700 1 Processor -- start 2019-11-28T11:44:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.673+0000 7fd97200c700 1 -- start start 2019-11-28T11:44:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.674+0000 7fd97200c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd96c15ed10 0x7fd96c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.674+0000 7fd97200c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd96c073020 0x7fd96c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.674+0000 7fd97200c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96c06db60 con 0x7fd96c0734b0 2019-11-28T11:44:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.674+0000 7fd97200c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c06fe00 con 0x7fd96c15ed10 2019-11-28T11:44:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.674+0000 7fd97200c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c0700d0 con 0x7fd96c073020 2019-11-28T11:44:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd96bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd96c15ed10 0x7fd96c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd96bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd96c15ed10 0x7fd96c15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39546/0 (socket says 172.21.15.80:39546) 2019-11-28T11:44:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd96bfff700 1 -- 172.21.15.80:0/1269114071 learned_addr learned my addr 172.21.15.80:0/1269114071 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd963fff700 1 --2- 172.21.15.80:0/1269114071 >> v2:172.21.15.174:3300/0 conn(0x7fd96c073020 0x7fd96c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd96bfff700 1 -- 172.21.15.80:0/1269114071 >> v2:172.21.15.174:3300/0 conn(0x7fd96c073020 msgr2=0x7fd96c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd96bfff700 1 --2- 172.21.15.80:0/1269114071 >> v2:172.21.15.174:3300/0 conn(0x7fd96c073020 0x7fd96c071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:46.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd96bfff700 1 -- 172.21.15.80:0/1269114071 >> v1:172.21.15.174:6789/0 conn(0x7fd96c0734b0 legacy=0x7fd96c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd96bfff700 1 -- 172.21.15.80:0/1269114071 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c070760 con 0x7fd96c15ed10 2019-11-28T11:44:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd963fff700 1 --2- 172.21.15.80:0/1269114071 >> v2:172.21.15.174:3300/0 conn(0x7fd96c073020 0x7fd96c071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:44:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd96bfff700 1 --2- 172.21.15.80:0/1269114071 >> v2:172.21.15.80:3300/0 conn(0x7fd96c15ed10 0x7fd96c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd95c00f740 tx=0x7fd95c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd96bfff700 1 --2- 172.21.15.80:0/1269114071 >> v2:172.21.15.80:3300/0 conn(0x7fd96c15ed10 0x7fd96c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd95c00f740 tx=0x7fd95c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd96bfff700 1 --2- 172.21.15.80:0/1269114071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15ed10 0x7fd96c15f100 secure :-1 s=READY pgs=1602 cs=0 l=1 rx=0x7fd95c00f740 tx=0x7fd95c00fae0).ready entity=mon.0 client_cookie=88eab24bad16844f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd96bfff700 1 --2- 172.21.15.80:0/1269114071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15ed10 0x7fd96c15f100 secure :-1 s=THROTTLE_DONE pgs=1602 cs=0 l=1 rx=0x7fd95c00f740 tx=0x7fd95c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd96bfff700 1 --2- 172.21.15.80:0/1269114071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15ed10 0x7fd96c15f100 secure :-1 s=THROTTLE_DONE pgs=1602 cs=0 l=1 rx=0x7fd95c00f740 tx=0x7fd95c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd96bfff700 1 --2- 172.21.15.80:0/1269114071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15ed10 0x7fd96c15f100 secure :-1 s=THROTTLE_DONE pgs=1602 cs=0 l=1 rx=0x7fd95c00f740 tx=0x7fd95c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd96b7fe700 1 -- 172.21.15.80:0/1269114071 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd95c000960 con 0x7fd96c15ed10 2019-11-28T11:44:46.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd96b7fe700 1 -- 172.21.15.80:0/1269114071 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c000c90 con 0x7fd96c15ed10 2019-11-28T11:44:46.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd96b7fe700 1 -- 172.21.15.80:0/1269114071 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd95c0013a0 con 0x7fd96c15ed10 2019-11-28T11:44:46.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd97200c700 1 -- 172.21.15.80:0/1269114071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15ed10 msgr2=0x7fd96c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.675+0000 7fd97200c700 1 --2- 172.21.15.80:0/1269114071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15ed10 0x7fd96c15f100 secure :-1 s=READY pgs=1602 cs=0 l=1 rx=0x7fd95c00f740 tx=0x7fd95c00fae0).stop 2019-11-28T11:44:46.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.676+0000 7fd97200c700 1 -- 172.21.15.80:0/1269114071 shutdown_connections 2019-11-28T11:44:46.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.676+0000 7fd97200c700 1 --2- 172.21.15.80:0/1269114071 >> v2:172.21.15.174:3300/0 conn(0x7fd96c073020 0x7fd96c071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:46.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.676+0000 7fd97200c700 1 --2- 172.21.15.80:0/1269114071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c15ed10 0x7fd96c15f100 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:46.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.676+0000 7fd97200c700 1 -- 172.21.15.80:0/1269114071 shutdown_connections 2019-11-28T11:44:46.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.676+0000 7fd97200c700 1 -- 172.21.15.80:0/1269114071 wait complete. 2019-11-28T11:44:46.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.676+0000 7fd97200c700 1 -- 172.21.15.80:0/1269114071 >> 172.21.15.80:0/1269114071 conn(0x7fd96c061d20 msgr2=0x7fd96c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.678+0000 7fd97200c700 1 Processor -- start 2019-11-28T11:44:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.678+0000 7fd97200c700 1 -- start start 2019-11-28T11:44:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.679+0000 7fd97200c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd96c15faf0 0x7fd96c1573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.679+0000 7fd97200c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd96c1578e0 0x7fd96c148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.679+0000 7fd97200c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96c104420 con 0x7fd96c148580 2019-11-28T11:44:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.679+0000 7fd97200c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c111980 con 0x7fd96c1578e0 2019-11-28T11:44:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.679+0000 7fd97200c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c111c50 con 0x7fd96c15faf0 2019-11-28T11:44:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.679+0000 7fd963fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd96c1578e0 0x7fd96c148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.679+0000 7fd963fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd96c1578e0 0x7fd96c148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39554/0 (socket says 172.21.15.80:39554) 2019-11-28T11:44:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.679+0000 7fd963fff700 1 -- 172.21.15.80:0/3693150847 learned_addr learned my addr 172.21.15.80:0/3693150847 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.679+0000 7fd96bfff700 1 --2- 172.21.15.80:0/3693150847 >> v2:172.21.15.174:3300/0 conn(0x7fd96c15faf0 0x7fd96c1573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd963fff700 1 -- 172.21.15.80:0/3693150847 >> v2:172.21.15.174:3300/0 conn(0x7fd96c15faf0 msgr2=0x7fd96c1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd963fff700 1 --2- 172.21.15.80:0/3693150847 >> v2:172.21.15.174:3300/0 conn(0x7fd96c15faf0 0x7fd96c1573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd963fff700 1 -- 172.21.15.80:0/3693150847 >> v1:172.21.15.80:6789/0 conn(0x7fd96c148580 legacy=0x7fd96c12bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd963fff700 1 -- 172.21.15.80:0/3693150847 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c1122e0 con 0x7fd96c1578e0 2019-11-28T11:44:46.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd9697fa700 1 -- 172.21.15.80:0/3693150847 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969740956 0 0) 0x7fd964000ed0 con 0x7fd96c148580 2019-11-28T11:44:46.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd963fff700 1 --2- 172.21.15.80:0/3693150847 >> v2:172.21.15.80:3300/0 conn(0x7fd96c1578e0 0x7fd96c148040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd9540103b0 tx=0x7fd954010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd963fff700 1 --2- 172.21.15.80:0/3693150847 >> v2:172.21.15.80:3300/0 conn(0x7fd96c1578e0 0x7fd96c148040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd9540103b0 tx=0x7fd954010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd963fff700 1 --2- 172.21.15.80:0/3693150847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c1578e0 0x7fd96c148040 secure :-1 s=READY pgs=1604 cs=0 l=1 rx=0x7fd9540103b0 tx=0x7fd954010750).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:46.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd963fff700 1 --2- 172.21.15.80:0/3693150847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c1578e0 0x7fd96c148040 secure :-1 s=THROTTLE_DONE pgs=1604 cs=0 l=1 rx=0x7fd9540103b0 tx=0x7fd954010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd9697fa700 1 -- 172.21.15.80:0/3693150847 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9540094b0 con 0x7fd96c1578e0 2019-11-28T11:44:46.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd963fff700 1 --2- 172.21.15.80:0/3693150847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c1578e0 0x7fd96c148040 secure :-1 s=THROTTLE_DONE pgs=1604 cs=0 l=1 rx=0x7fd9540103b0 tx=0x7fd954010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd963fff700 1 --2- 172.21.15.80:0/3693150847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c1578e0 0x7fd96c148040 secure :-1 s=THROTTLE_DONE pgs=1604 cs=0 l=1 rx=0x7fd9540103b0 tx=0x7fd954010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd9697fa700 1 -- 172.21.15.80:0/3693150847 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9540096b0 con 0x7fd96c1578e0 2019-11-28T11:44:46.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd97200c700 1 -- 172.21.15.80:0/3693150847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96c112660 con 0x7fd96c1578e0 2019-11-28T11:44:46.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd9697fa700 1 -- 172.21.15.80:0/3693150847 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9540012d0 con 0x7fd96c1578e0 2019-11-28T11:44:46.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd97200c700 1 -- 172.21.15.80:0/3693150847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96c1122e0 con 0x7fd96c1578e0 2019-11-28T11:44:46.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.680+0000 7fd963fff700 1 --2- 172.21.15.80:0/3693150847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c1578e0 0x7fd96c148040 secure :-1 s=THROTTLE_DONE pgs=1604 cs=0 l=1 rx=0x7fd9540103b0 tx=0x7fd954010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.681+0000 7fd9697fa700 1 -- 172.21.15.80:0/3693150847 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd954000bc0 con 0x7fd96c1578e0 2019-11-28T11:44:46.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.681+0000 7fd963fff700 1 --2- 172.21.15.80:0/3693150847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c1578e0 0x7fd96c148040 secure :-1 s=THROTTLE_DONE pgs=1604 cs=0 l=1 rx=0x7fd9540103b0 tx=0x7fd954010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.681+0000 7fd9697fa700 1 --2- 172.21.15.80:0/3693150847 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd950018730 0x7fd95001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:46.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.681+0000 7fd9697fa700 1 -- 172.21.15.80:0/3693150847 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fd954031a80 con 0x7fd96c1578e0 2019-11-28T11:44:46.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.681+0000 7fd96bfff700 1 --2- 172.21.15.80:0/3693150847 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd950018730 0x7fd95001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:46.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.681+0000 7fd96bfff700 1 --2- 172.21.15.80:0/3693150847 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd950018730 0x7fd95001abc0 crc :-1 s=READY pgs=650 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:46.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.688+0000 7fd97200c700 1 -- 172.21.15.80:0/3693150847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96c112660 con 0x7fd96c1578e0 2019-11-28T11:44:46.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.692+0000 7fd963fff700 1 --2- 172.21.15.80:0/3693150847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c1578e0 0x7fd96c148040 secure :-1 s=THROTTLE_DONE pgs=1604 cs=0 l=1 rx=0x7fd9540103b0 tx=0x7fd954010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.692+0000 7fd9697fa700 1 -- 172.21.15.80:0/3693150847 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd954000990 con 0x7fd96c1578e0 2019-11-28T11:44:46.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.859+0000 7fd97200c700 1 -- 172.21.15.80:0/3693150847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fd96c1122e0 con 0x7fd96c1578e0 2019-11-28T11:44:46.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.860+0000 7fd963fff700 1 --2- 172.21.15.80:0/3693150847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c1578e0 0x7fd96c148040 secure :-1 s=THROTTLE_DONE pgs=1604 cs=0 l=1 rx=0x7fd9540103b0 tx=0x7fd954010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:46.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.860+0000 7fd9697fa700 1 -- 172.21.15.80:0/3693150847 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v118) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd9540175b0 con 0x7fd96c1578e0 2019-11-28T11:44:46.900 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:44:46.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.862+0000 7fd97200c700 1 -- 172.21.15.80:0/3693150847 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd950018730 msgr2=0x7fd95001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.862+0000 7fd97200c700 1 --2- 172.21.15.80:0/3693150847 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd950018730 0x7fd95001abc0 crc :-1 s=READY pgs=650 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:46.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.862+0000 7fd97200c700 1 -- 172.21.15.80:0/3693150847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c1578e0 msgr2=0x7fd96c148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:46.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.862+0000 7fd97200c700 1 --2- 172.21.15.80:0/3693150847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c1578e0 0x7fd96c148040 secure :-1 s=READY pgs=1604 cs=0 l=1 rx=0x7fd9540103b0 tx=0x7fd954010750).stop 2019-11-28T11:44:46.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.862+0000 7fd97200c700 1 -- 172.21.15.80:0/3693150847 shutdown_connections 2019-11-28T11:44:46.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.862+0000 7fd97200c700 1 --2- 172.21.15.80:0/3693150847 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd950018730 0x7fd95001abc0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:46.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.862+0000 7fd97200c700 1 --2- 172.21.15.80:0/3693150847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd96c1578e0 0x7fd96c148040 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:46.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.862+0000 7fd97200c700 1 --2- 172.21.15.80:0/3693150847 >> v2:172.21.15.174:3300/0 conn(0x7fd96c15faf0 0x7fd96c1573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:46.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.862+0000 7fd97200c700 1 -- 172.21.15.80:0/3693150847 shutdown_connections 2019-11-28T11:44:46.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.862+0000 7fd97200c700 1 -- 172.21.15.80:0/3693150847 wait complete. 2019-11-28T11:44:46.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.862+0000 7fd97200c700 1 -- 172.21.15.80:0/3693150847 >> 172.21.15.80:0/3693150847 conn(0x7fd96c07c4f0 msgr2=0x7fd96c15ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:46.912 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:44:46.912 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:44:47.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.993+0000 7f42da65d700 1 Processor -- start 2019-11-28T11:44:47.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.993+0000 7f42da65d700 1 -- start start 2019-11-28T11:44:47.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42da65d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f42d406d120 0x7f42d4165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:47.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42da65d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d406d5a0 con 0x7f42d406c0a0 2019-11-28T11:44:47.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42da65d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d406db00 con 0x7f42d406c490 2019-11-28T11:44:47.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42da65d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d406fd60 con 0x7f42d406d120 2019-11-28T11:44:47.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42d8bfa700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f42d406c0a0 0x7f42d4072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38876/0 (socket says 172.21.15.80:38876) 2019-11-28T11:44:47.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42d8bfa700 1 -- 172.21.15.80:0/2561695590 learned_addr learned my addr 172.21.15.80:0/2561695590 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:47.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2561695590 >> v2:172.21.15.174:3300/0 conn(0x7f42d406d120 0x7f42d4165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:47.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42d37fe700 1 -- 172.21.15.80:0/2561695590 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267445624 0 0) 0x7f42bc001150 con 0x7f42d406c0a0 2019-11-28T11:44:47.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42d37fe700 1 -- 172.21.15.80:0/2561695590 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c0002e80 con 0x7f42d406c0a0 2019-11-28T11:44:47.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42d37fe700 1 -- 172.21.15.80:0/2561695590 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301188317 0 0) 0x7f42c4001400 con 0x7f42d406c490 2019-11-28T11:44:47.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42d37fe700 1 -- 172.21.15.80:0/2561695590 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c00030b0 con 0x7f42d406c490 2019-11-28T11:44:47.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42d93fb700 1 -- 172.21.15.80:0/2561695590 >> v1:172.21.15.174:6789/0 conn(0x7f42d406c490 legacy=0x7f42d406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:47.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42d37fe700 1 -- 172.21.15.80:0/2561695590 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2851539225 0 0) 0x7f42bc001130 con 0x7f42d406c0a0 2019-11-28T11:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42d93fb700 1 -- 172.21.15.80:0/2561695590 >> v1:172.21.15.80:6789/0 conn(0x7f42d406c0a0 legacy=0x7f42d4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42d93fb700 1 -- 172.21.15.80:0/2561695590 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d40706c0 con 0x7f42d406d120 2019-11-28T11:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2561695590 >> v2:172.21.15.174:3300/0 conn(0x7f42d406d120 0x7f42d4165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f42cc00af80 tx=0x7f42cc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2561695590 >> v2:172.21.15.174:3300/0 conn(0x7f42d406d120 0x7f42d4165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f42cc00af80 tx=0x7f42cc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2561695590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d406d120 0x7f42d4165d80 secure :-1 s=READY pgs=936 cs=0 l=1 rx=0x7f42cc00af80 tx=0x7f42cc00b790).ready entity=mon.1 client_cookie=d42068f9e71a33b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2561695590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d406d120 0x7f42d4165d80 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f42cc00af80 tx=0x7f42cc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.994+0000 7f42d37fe700 1 -- 172.21.15.80:0/2561695590 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42cc007240 con 0x7f42d406d120 2019-11-28T11:44:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.995+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2561695590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d406d120 0x7f42d4165d80 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f42cc00af80 tx=0x7f42cc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.995+0000 7f42d37fe700 1 -- 172.21.15.80:0/2561695590 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc000bb0 con 0x7f42d406d120 2019-11-28T11:44:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.995+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2561695590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d406d120 0x7f42d4165d80 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f42cc00af80 tx=0x7f42cc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.995+0000 7f42d37fe700 1 -- 172.21.15.80:0/2561695590 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42cc009bd0 con 0x7f42d406d120 2019-11-28T11:44:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.995+0000 7f42da65d700 1 -- 172.21.15.80:0/2561695590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d406d120 msgr2=0x7f42d4165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.995+0000 7f42da65d700 1 --2- 172.21.15.80:0/2561695590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d406d120 0x7f42d4165d80 secure :-1 s=READY pgs=936 cs=0 l=1 rx=0x7f42cc00af80 tx=0x7f42cc00b790).stop 2019-11-28T11:44:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.995+0000 7f42da65d700 1 -- 172.21.15.80:0/2561695590 shutdown_connections 2019-11-28T11:44:47.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.995+0000 7f42da65d700 1 --2- 172.21.15.80:0/2561695590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d406d120 0x7f42d4165d80 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:47.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.995+0000 7f42da65d700 1 -- 172.21.15.80:0/2561695590 shutdown_connections 2019-11-28T11:44:47.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.995+0000 7f42da65d700 1 -- 172.21.15.80:0/2561695590 wait complete. 2019-11-28T11:44:47.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.995+0000 7f42da65d700 1 -- 172.21.15.80:0/2561695590 >> 172.21.15.80:0/2561695590 conn(0x7f42d4061cf0 msgr2=0x7f42d4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:47.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.998+0000 7f42da65d700 1 Processor -- start 2019-11-28T11:44:47.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.998+0000 7f42da65d700 1 -- start start 2019-11-28T11:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42da65d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42d412cea0 0x7f42d4111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42da65d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42d4165a00 0x7f42d4167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42da65d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d4124260 con 0x7f42d41230e0 2019-11-28T11:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42da65d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d4120610 con 0x7f42d4165a00 2019-11-28T11:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42da65d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4121040 con 0x7f42d412cea0 2019-11-28T11:44:47.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d93fb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42d4165a00 0x7f42d4167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:47.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d93fb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42d4165a00 0x7f42d4167e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39570/0 (socket says 172.21.15.80:39570) 2019-11-28T11:44:47.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d93fb700 1 -- 172.21.15.80:0/2868795906 learned_addr learned my addr 172.21.15.80:0/2868795906 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:47.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d8bfa700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42d412cea0 0x7f42d4111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:47.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d93fb700 1 -- 172.21.15.80:0/2868795906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42d412cea0 msgr2=0x7f42d4111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:47.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42d412cea0 0x7f42d4111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:47.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d93fb700 1 -- 172.21.15.80:0/2868795906 >> v1:172.21.15.174:6789/0 conn(0x7f42d41230e0 legacy=0x7f42d4123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:47.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d93fb700 1 -- 172.21.15.80:0/2868795906 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d41219a0 con 0x7f42d4165a00 2019-11-28T11:44:47.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d8bfa700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42d412cea0 0x7f42d4111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:44:47.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2868795906 >> v2:172.21.15.80:3300/0 conn(0x7f42d4165a00 0x7f42d4167e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42cc0544d0 tx=0x7f42cc054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:47.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2868795906 >> v2:172.21.15.80:3300/0 conn(0x7f42d4165a00 0x7f42d4167e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42cc0544d0 tx=0x7f42cc054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:47.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42d4165a00 0x7f42d4167e00 secure :-1 s=READY pgs=1606 cs=0 l=1 rx=0x7f42cc0544d0 tx=0x7f42cc054870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:47.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42d4165a00 0x7f42d4167e00 secure :-1 s=THROTTLE_DONE pgs=1606 cs=0 l=1 rx=0x7f42cc0544d0 tx=0x7f42cc054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:47.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d17fa700 1 -- 172.21.15.80:0/2868795906 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42cc00b050 con 0x7f42d4165a00 2019-11-28T11:44:47.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42d4165a00 0x7f42d4167e00 secure :-1 s=THROTTLE_DONE pgs=1606 cs=0 l=1 rx=0x7f42cc0544d0 tx=0x7f42cc054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:47.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d17fa700 1 -- 172.21.15.80:0/2868795906 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc0099b0 con 0x7f42d4165a00 2019-11-28T11:44:47.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42d4165a00 0x7f42d4167e00 secure :-1 s=THROTTLE_DONE pgs=1606 cs=0 l=1 rx=0x7f42cc0544d0 tx=0x7f42cc054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:47.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:46.999+0000 7f42da65d700 1 -- 172.21.15.80:0/2868795906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d4121d20 con 0x7f42d4165a00 2019-11-28T11:44:47.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.000+0000 7f42d17fa700 1 -- 172.21.15.80:0/2868795906 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42cc009ba0 con 0x7f42d4165a00 2019-11-28T11:44:47.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.000+0000 7f42da65d700 1 -- 172.21.15.80:0/2868795906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d41122f0 con 0x7f42d4165a00 2019-11-28T11:44:47.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.000+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42d4165a00 0x7f42d4167e00 secure :-1 s=THROTTLE_DONE pgs=1606 cs=0 l=1 rx=0x7f42cc0544d0 tx=0x7f42cc054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:47.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.000+0000 7f42d17fa700 1 -- 172.21.15.80:0/2868795906 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f42cc0095b0 con 0x7f42d4165a00 2019-11-28T11:44:47.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.000+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42d4165a00 0x7f42d4167e00 secure :-1 s=THROTTLE_DONE pgs=1606 cs=0 l=1 rx=0x7f42cc0544d0 tx=0x7f42cc054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:47.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.000+0000 7f42d17fa700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42b8018730 0x7f42b801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:47.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.000+0000 7f42d17fa700 1 -- 172.21.15.80:0/2868795906 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f42cc075b50 con 0x7f42d4165a00 2019-11-28T11:44:47.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.000+0000 7f42d8bfa700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42b8018730 0x7f42b801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:47.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.001+0000 7f42d8bfa700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42b8018730 0x7f42b801abc0 crc :-1 s=READY pgs=651 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:47.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.008+0000 7f42da65d700 1 -- 172.21.15.80:0/2868795906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d41219a0 con 0x7f42d4165a00 2019-11-28T11:44:47.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.011+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42d4165a00 0x7f42d4167e00 secure :-1 s=THROTTLE_DONE pgs=1606 cs=0 l=1 rx=0x7f42cc0544d0 tx=0x7f42cc054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:47.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.011+0000 7f42d17fa700 1 -- 172.21.15.80:0/2868795906 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f42cc00b050 con 0x7f42d4165a00 2019-11-28T11:44:47.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.183+0000 7f42da65d700 1 -- 172.21.15.80:0/2868795906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42d4121d20 con 0x7f42d4165a00 2019-11-28T11:44:47.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.183+0000 7f42d93fb700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42d4165a00 0x7f42d4167e00 secure :-1 s=THROTTLE_DONE pgs=1606 cs=0 l=1 rx=0x7f42cc0544d0 tx=0x7f42cc054870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:47.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.183+0000 7f42d17fa700 1 -- 172.21.15.80:0/2868795906 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+2448 (secure 0 0 0) 0x7f42cc0095b0 con 0x7f42d4165a00 2019-11-28T11:44:47.223 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 84 2019-11-28T11:44:47.224 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:44:47.224 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":84,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1010023901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1010023901},{"type":"v1","addr":"172.21.15.80:6834","nonce":1010023901}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":82},{"gid":8556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3440274141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3440274141},{"type":"v1","addr":"172.21.15.80:6835","nonce":3440274141}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":82}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:25.297182+0000","modified":"2019-11-28T11:41:33.675187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6242":{"gid":6242,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/2489382286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2489382286},{"type":"v1","addr":"172.21.15.174:6835","nonce":2489382286}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2019-11-28T11:44:47.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.186+0000 7f42da65d700 1 -- 172.21.15.80:0/2868795906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42b8018730 msgr2=0x7f42b801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:47.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.186+0000 7f42da65d700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42b8018730 0x7f42b801abc0 crc :-1 s=READY pgs=651 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:47.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.186+0000 7f42da65d700 1 -- 172.21.15.80:0/2868795906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42d4165a00 msgr2=0x7f42d4167e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:47.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.186+0000 7f42da65d700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42d4165a00 0x7f42d4167e00 secure :-1 s=READY pgs=1606 cs=0 l=1 rx=0x7f42cc0544d0 tx=0x7f42cc054870).stop 2019-11-28T11:44:47.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.186+0000 7f42da65d700 1 -- 172.21.15.80:0/2868795906 shutdown_connections 2019-11-28T11:44:47.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.186+0000 7f42da65d700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42d4165a00 0x7f42d4167e00 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:47.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.186+0000 7f42da65d700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42b8018730 0x7f42b801abc0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:47.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.186+0000 7f42da65d700 1 --2- 172.21.15.80:0/2868795906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42d412cea0 0x7f42d4111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:47.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.186+0000 7f42da65d700 1 -- 172.21.15.80:0/2868795906 shutdown_connections 2019-11-28T11:44:47.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.186+0000 7f42da65d700 1 -- 172.21.15.80:0/2868795906 wait complete. 2019-11-28T11:44:47.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:47.186+0000 7f42da65d700 1 -- 172.21.15.80:0/2868795906 >> 172.21.15.80:0/2868795906 conn(0x7f42d41426c0 msgr2=0x7f42d4110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:47.537 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6242}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 18, u'failed': [], u'epoch': 84, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [19], u'info': {u'gid_6242': {u'export_targets': [], u'name': u'c', u'incarnation': 83, u'state_seq': 3, u'state': u'up:active', u'gid': 6242, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2489382286, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2489382286, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2489382286'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:41:25.297182+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:41:33.675187+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:44:47.538 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:44:47.538 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:44:47.670 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:44:47.670 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:44:47.670 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:44:47.670 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 6242, 2019-11-28T11:44:47.670 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:44:47.670 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:44:47.671 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 194.96217401600001, 2019-11-28T11:44:47.671 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 84, 2019-11-28T11:44:47.671 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 118, 2019-11-28T11:44:47.671 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 118, 2019-11-28T11:44:47.671 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 199.52768404 2019-11-28T11:44:47.671 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:44:47.675 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 6242, "want_state": "up:active", "state": "up:active", "rank_uptime": 194.96217401600001, "mdsmap_epoch": 84, "osdmap_epoch": 118, "osdmap_epoch_barrier": 118, "uptime": 199.52768404 } 2019-11-28T11:44:47.676 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:44:47.676 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:44:47.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:44:47.676 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:44:47.748 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:44:47.748 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:44:48.051 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:44:48.052 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:44:48.117 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:44:48.117 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:44:48.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:44:48.155 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:44:48.241 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps' 2019-11-28T11:44:48.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.321+0000 7efbe315e700 1 Processor -- start 2019-11-28T11:44:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.321+0000 7efbe315e700 1 -- start start 2019-11-28T11:44:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.322+0000 7efbe315e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efbdc06c490 0x7efbdc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.322+0000 7efbe315e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc06ce60 0x7efbdc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.322+0000 7efbe315e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbdc06db00 con 0x7efbdc06c0a0 2019-11-28T11:44:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.322+0000 7efbe315e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbdc06fd60 con 0x7efbdc06c490 2019-11-28T11:44:48.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.322+0000 7efbe315e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbdc070030 con 0x7efbdc06ce60 2019-11-28T11:44:48.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.322+0000 7efbe16fb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efbdc06c0a0 0x7efbdc072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38890/0 (socket says 172.21.15.80:38890) 2019-11-28T11:44:48.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.322+0000 7efbe16fb700 1 -- 172.21.15.80:0/3067076646 learned_addr learned my addr 172.21.15.80:0/3067076646 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:48.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.322+0000 7efbe1efc700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc06ce60 0x7efbdc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:48.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.322+0000 7efbe0efa700 1 --2- 172.21.15.80:0/3067076646 >> v2:172.21.15.174:3300/0 conn(0x7efbdc06c490 0x7efbdc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:48.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.322+0000 7efbdbfff700 1 -- 172.21.15.80:0/3067076646 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197957799 0 0) 0x7efbcc001150 con 0x7efbdc06c0a0 2019-11-28T11:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.322+0000 7efbdbfff700 1 -- 172.21.15.80:0/3067076646 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbc8002e80 con 0x7efbdc06c0a0 2019-11-28T11:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 -- 172.21.15.80:0/3067076646 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 860824525 0 0) 0x7efbcc001130 con 0x7efbdc06c0a0 2019-11-28T11:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 -- 172.21.15.80:0/3067076646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc06ce60 msgr2=0x7efbdc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc06ce60 0x7efbdc164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 -- 172.21.15.80:0/3067076646 >> v2:172.21.15.174:3300/0 conn(0x7efbdc06c490 msgr2=0x7efbdc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 --2- 172.21.15.80:0/3067076646 >> v2:172.21.15.174:3300/0 conn(0x7efbdc06c490 0x7efbdc06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 -- 172.21.15.80:0/3067076646 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbdc0706c0 con 0x7efbdc06c0a0 2019-11-28T11:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 -- 172.21.15.80:0/3067076646 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7efbcc0016c0 con 0x7efbdc06c0a0 2019-11-28T11:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe0efa700 1 --2- 172.21.15.80:0/3067076646 >> v2:172.21.15.174:3300/0 conn(0x7efbdc06c490 0x7efbdc06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe1efc700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc06ce60 0x7efbdc164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 -- 172.21.15.80:0/3067076646 >> v1:172.21.15.80:6789/0 conn(0x7efbdc06c0a0 legacy=0x7efbdc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:48.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbc80479e0 0x7efbc8049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:48.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbc804a5f0 0x7efbc804ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:48.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efbc804d270 0x7efbc804f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:48.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 -- 172.21.15.80:0/3067076646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbc804ff50 con 0x7efbc80479e0 2019-11-28T11:44:48.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 -- 172.21.15.80:0/3067076646 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbc8050140 con 0x7efbc804d270 2019-11-28T11:44:48.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 -- 172.21.15.80:0/3067076646 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbc8050370 con 0x7efbc804a5f0 2019-11-28T11:44:48.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe16fb700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbc80479e0 0x7efbc8049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:48.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe0efa700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbc804a5f0 0x7efbc804ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:48.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe1efc700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efbc804d270 0x7efbc804f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:48.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe16fb700 1 -- 172.21.15.80:0/3067076646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbc804a5f0 msgr2=0x7efbc804ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:48.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe16fb700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbc804a5f0 0x7efbc804ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:48.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe16fb700 1 -- 172.21.15.80:0/3067076646 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efbc804d270 msgr2=0x7efbc804f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:48.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe16fb700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efbc804d270 0x7efbc804f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:48.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe16fb700 1 -- 172.21.15.80:0/3067076646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbc8050620 con 0x7efbc80479e0 2019-11-28T11:44:48.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe16fb700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbc80479e0 0x7efbc8049e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efbcc00f830 tx=0x7efbcc001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe16fb700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbc80479e0 0x7efbc8049e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efbcc00f830 tx=0x7efbcc001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe16fb700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbc80479e0 0x7efbc8049e40 secure :-1 s=READY pgs=1609 cs=0 l=1 rx=0x7efbcc00f830 tx=0x7efbcc001810).ready entity=mon.0 client_cookie=c642225aa6b59983 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe16fb700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbc80479e0 0x7efbc8049e40 secure :-1 s=THROTTLE_DONE pgs=1609 cs=0 l=1 rx=0x7efbcc00f830 tx=0x7efbcc001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 -- 172.21.15.80:0/3067076646 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbcc001890 con 0x7efbc80479e0 2019-11-28T11:44:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe16fb700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbc80479e0 0x7efbc8049e40 secure :-1 s=THROTTLE_DONE pgs=1609 cs=0 l=1 rx=0x7efbcc00f830 tx=0x7efbcc001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe16fb700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbc80479e0 0x7efbc8049e40 secure :-1 s=THROTTLE_DONE pgs=1609 cs=0 l=1 rx=0x7efbcc00f830 tx=0x7efbcc001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 -- 172.21.15.80:0/3067076646 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbcc004240 con 0x7efbc80479e0 2019-11-28T11:44:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbdbfff700 1 -- 172.21.15.80:0/3067076646 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbcc000c90 con 0x7efbc80479e0 2019-11-28T11:44:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe315e700 1 -- 172.21.15.80:0/3067076646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbc80479e0 msgr2=0x7efbc8049e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe315e700 1 --2- 172.21.15.80:0/3067076646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbc80479e0 0x7efbc8049e40 secure :-1 s=READY pgs=1609 cs=0 l=1 rx=0x7efbcc00f830 tx=0x7efbcc001810).stop 2019-11-28T11:44:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.323+0000 7efbe1efc700 1 -- 172.21.15.80:0/3067076646 reap_dead start 2019-11-28T11:44:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.324+0000 7efbe315e700 1 -- 172.21.15.80:0/3067076646 shutdown_connections 2019-11-28T11:44:48.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.324+0000 7efbe315e700 1 -- 172.21.15.80:0/3067076646 shutdown_connections 2019-11-28T11:44:48.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.324+0000 7efbe315e700 1 -- 172.21.15.80:0/3067076646 wait complete. 2019-11-28T11:44:48.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.324+0000 7efbe315e700 1 -- 172.21.15.80:0/3067076646 >> 172.21.15.80:0/3067076646 conn(0x7efbdc061cf0 msgr2=0x7efbdc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:48.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.327+0000 7efbe315e700 1 Processor -- start 2019-11-28T11:44:48.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.327+0000 7efbe315e700 1 -- start start 2019-11-28T11:44:48.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe315e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efbdc13fb20 0x7efbdc10df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:48.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe315e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc10d6d0 0x7efbdc164c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:48.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe315e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbdc10fa50 con 0x7efbdc10e4a0 2019-11-28T11:44:48.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe315e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbdc1073b0 con 0x7efbdc13fb20 2019-11-28T11:44:48.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe315e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbdc106980 con 0x7efbdc10d6d0 2019-11-28T11:44:48.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe0efa700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efbdc10e4a0 0x7efbdc10ced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38904/0 (socket says 172.21.15.80:38904) 2019-11-28T11:44:48.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe0efa700 1 -- 172.21.15.80:0/3691991172 learned_addr learned my addr 172.21.15.80:0/3691991172 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:48.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe16fb700 1 --2- 172.21.15.80:0/3691991172 >> v2:172.21.15.174:3300/0 conn(0x7efbdc13fb20 0x7efbdc10df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:48.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe1efc700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc10d6d0 0x7efbdc164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:48.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbd9ffb700 1 -- 172.21.15.80:0/3691991172 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509292994 0 0) 0x7efbc4009be0 con 0x7efbdc10e4a0 2019-11-28T11:44:48.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbd9ffb700 1 -- 172.21.15.80:0/3691991172 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbc0002e80 con 0x7efbdc10e4a0 2019-11-28T11:44:48.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbd9ffb700 1 -- 172.21.15.80:0/3691991172 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3505860408 0 0) 0x7efbc4009d90 con 0x7efbdc10e4a0 2019-11-28T11:44:48.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe1efc700 1 -- 172.21.15.80:0/3691991172 >> v2:172.21.15.174:3300/0 conn(0x7efbdc13fb20 msgr2=0x7efbdc10df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:48.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe1efc700 1 --2- 172.21.15.80:0/3691991172 >> v2:172.21.15.174:3300/0 conn(0x7efbdc13fb20 0x7efbdc10df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:48.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe1efc700 1 -- 172.21.15.80:0/3691991172 >> v1:172.21.15.80:6789/0 conn(0x7efbdc10e4a0 legacy=0x7efbdc10ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:48.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe1efc700 1 -- 172.21.15.80:0/3691991172 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbdc13a950 con 0x7efbdc10d6d0 2019-11-28T11:44:48.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe16fb700 1 --2- 172.21.15.80:0/3691991172 >> v2:172.21.15.174:3300/0 conn(0x7efbdc13fb20 0x7efbdc10df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:44:48.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe1efc700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc10d6d0 0x7efbdc164c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efbd4010380 tx=0x7efbd4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:48.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe1efc700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc10d6d0 0x7efbdc164c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efbd4010380 tx=0x7efbd4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:48.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.328+0000 7efbe1efc700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc10d6d0 0x7efbdc164c20 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7efbd4010380 tx=0x7efbd4010720).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:48.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.329+0000 7efbe1efc700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc10d6d0 0x7efbdc164c20 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7efbd4010380 tx=0x7efbd4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:48.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.329+0000 7efbd9ffb700 1 -- 172.21.15.80:0/3691991172 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbd4000a70 con 0x7efbdc10d6d0 2019-11-28T11:44:48.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.329+0000 7efbe1efc700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc10d6d0 0x7efbdc164c20 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7efbd4010380 tx=0x7efbd4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:48.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.329+0000 7efbe1efc700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc10d6d0 0x7efbdc164c20 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7efbd4010380 tx=0x7efbd4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:48.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.329+0000 7efbd9ffb700 1 -- 172.21.15.80:0/3691991172 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbd40099b0 con 0x7efbdc10d6d0 2019-11-28T11:44:48.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.329+0000 7efbe315e700 1 -- 172.21.15.80:0/3691991172 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbdc13acd0 con 0x7efbdc10d6d0 2019-11-28T11:44:48.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.329+0000 7efbd9ffb700 1 -- 172.21.15.80:0/3691991172 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbd4000a70 con 0x7efbdc10d6d0 2019-11-28T11:44:48.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.329+0000 7efbe315e700 1 -- 172.21.15.80:0/3691991172 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbdc13a950 con 0x7efbdc10d6d0 2019-11-28T11:44:48.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.329+0000 7efbe1efc700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc10d6d0 0x7efbdc164c20 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7efbd4010380 tx=0x7efbd4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:48.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.329+0000 7efbd9ffb700 1 -- 172.21.15.80:0/3691991172 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efbd4000a70 con 0x7efbdc10d6d0 2019-11-28T11:44:48.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.329+0000 7efbe1efc700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc10d6d0 0x7efbdc164c20 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7efbd4010380 tx=0x7efbd4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:48.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.329+0000 7efbd9ffb700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbc0018780 0x7efbc001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:48.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.329+0000 7efbd9ffb700 1 -- 172.21.15.80:0/3691991172 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6063+0+0 (secure 0 0 0) 0x7efbd40319a0 con 0x7efbdc10d6d0 2019-11-28T11:44:48.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.330+0000 7efbe16fb700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbc0018780 0x7efbc001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:48.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.330+0000 7efbe16fb700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbc0018780 0x7efbc001abf0 crc :-1 s=READY pgs=652 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:48.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.336+0000 7efbe315e700 1 -- 172.21.15.80:0/3691991172 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbdc13acd0 con 0x7efbdc10d6d0 2019-11-28T11:44:48.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.340+0000 7efbe1efc700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc10d6d0 0x7efbdc164c20 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7efbd4010380 tx=0x7efbd4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:48.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.340+0000 7efbd9ffb700 1 -- 172.21.15.80:0/3691991172 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efbd40095b0 con 0x7efbdc10d6d0 2019-11-28T11:44:48.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.514+0000 7efbe315e700 1 -- 172.21.15.80:0/3691991172 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps"]} v 0) v1 -- 0x7efbdc13a950 con 0x7efbdc10d6d0 2019-11-28T11:44:49.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.966+0000 7efbe1efc700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc10d6d0 0x7efbdc164c20 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7efbd4010380 tx=0x7efbd4010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:49.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.966+0000 7efbd9ffb700 1 -- 172.21.15.80:0/3691991172 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps"]}]=0 v455) v1 ==== 149+0+0 (secure 0 0 0) 0x7efbd4009ba0 con 0x7efbdc10d6d0 2019-11-28T11:44:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.981+0000 7efbe315e700 1 -- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbc0018780 msgr2=0x7efbc001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.981+0000 7efbe315e700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbc0018780 0x7efbc001abf0 crc :-1 s=READY pgs=652 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.981+0000 7efbe315e700 1 -- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc10d6d0 msgr2=0x7efbdc164c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.981+0000 7efbe315e700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc10d6d0 0x7efbdc164c20 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7efbd4010380 tx=0x7efbd4010720).stop 2019-11-28T11:44:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.981+0000 7efbe315e700 1 -- 172.21.15.80:0/3691991172 shutdown_connections 2019-11-28T11:44:49.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.981+0000 7efbe315e700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbc0018780 0x7efbc001abf0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:49.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.981+0000 7efbe315e700 1 --2- 172.21.15.80:0/3691991172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbdc10d6d0 0x7efbdc164c20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:49.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.981+0000 7efbe315e700 1 --2- 172.21.15.80:0/3691991172 >> v2:172.21.15.174:3300/0 conn(0x7efbdc13fb20 0x7efbdc10df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:49.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.981+0000 7efbe315e700 1 -- 172.21.15.80:0/3691991172 shutdown_connections 2019-11-28T11:44:49.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.981+0000 7efbe315e700 1 -- 172.21.15.80:0/3691991172 wait complete. 2019-11-28T11:44:49.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:48.981+0000 7efbe315e700 1 -- 172.21.15.80:0/3691991172 >> 172.21.15.80:0/3691991172 conn(0x7efbdc142090 msgr2=0x7efbdc10ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:49.030 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:44:49.031 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:44:49.100 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:44:49.167 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:44:49.259 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:44:49.325 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:44:49.387 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:44:49.445 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:44:49.445 INFO:tasks.cephfs.mount:Terminating background process 2019-11-28T11:44:49.446 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T11:44:49.446 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:44:49.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:44:49.446 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T11:44:49.575 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:44:49.580 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:44:49.622 INFO:tasks.cephfs.mount:Terminating background process 2019-11-28T11:44:49.622 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:44:49.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:44:49.622 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:44:49.745 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:44:49.750 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:44:49.793 INFO:tasks.cephfs_test_runner:test_evicted_caps (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2019-11-28T11:44:49.793 INFO:tasks.cephfs_test_runner:Starting test: test_filelock (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T11:44:49.794 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock' 2019-11-28T11:44:49.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.882+0000 7f27a6133700 1 Processor -- start 2019-11-28T11:44:49.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.882+0000 7f27a6133700 1 -- start start 2019-11-28T11:44:49.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.883+0000 7f27a6133700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27a006c0a0 0x7f27a0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:49.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.883+0000 7f27a6133700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27a00734e0 0x7f27a0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:49.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.883+0000 7f27a6133700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a006db00 con 0x7f27a0072360 2019-11-28T11:44:49.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.883+0000 7f27a6133700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a006fd60 con 0x7f27a006c0a0 2019-11-28T11:44:49.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.883+0000 7f27a6133700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a0070030 con 0x7f27a00734e0 2019-11-28T11:44:49.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.883+0000 7f279ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27a006c0a0 0x7f27a0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:49.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.883+0000 7f279ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27a006c0a0 0x7f27a0072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39594/0 (socket says 172.21.15.80:39594) 2019-11-28T11:44:49.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.883+0000 7f279ffff700 1 -- 172.21.15.80:0/1369560349 learned_addr learned my addr 172.21.15.80:0/1369560349 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:49.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.883+0000 7f2797fff700 1 --2- 172.21.15.80:0/1369560349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27a00734e0 0x7f27a0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:49.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.883+0000 7f279ffff700 1 -- 172.21.15.80:0/1369560349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27a00734e0 msgr2=0x7f27a0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:49.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.883+0000 7f279ffff700 1 --2- 172.21.15.80:0/1369560349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27a00734e0 0x7f27a0071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:49.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.883+0000 7f279ffff700 1 -- 172.21.15.80:0/1369560349 >> v1:172.21.15.174:6789/0 conn(0x7f27a0072360 legacy=0x7f27a006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:49.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.883+0000 7f279ffff700 1 -- 172.21.15.80:0/1369560349 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a00706c0 con 0x7f27a006c0a0 2019-11-28T11:44:49.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.883+0000 7f279ffff700 1 --2- 172.21.15.80:0/1369560349 >> v2:172.21.15.80:3300/0 conn(0x7f27a006c0a0 0x7f27a0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f279000f6c0 tx=0x7f279000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:49.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.884+0000 7f279ffff700 1 --2- 172.21.15.80:0/1369560349 >> v2:172.21.15.80:3300/0 conn(0x7f27a006c0a0 0x7f27a0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f279000f6c0 tx=0x7f279000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:49.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.884+0000 7f279ffff700 1 --2- 172.21.15.80:0/1369560349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a006c0a0 0x7f27a0072fa0 secure :-1 s=READY pgs=1611 cs=0 l=1 rx=0x7f279000f6c0 tx=0x7f279000fa60).ready entity=mon.0 client_cookie=72469112a4a4244f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:49.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.884+0000 7f279ffff700 1 --2- 172.21.15.80:0/1369560349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a006c0a0 0x7f27a0072fa0 secure :-1 s=THROTTLE_DONE pgs=1611 cs=0 l=1 rx=0x7f279000f6c0 tx=0x7f279000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:49.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.884+0000 7f279ffff700 1 --2- 172.21.15.80:0/1369560349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a006c0a0 0x7f27a0072fa0 secure :-1 s=THROTTLE_DONE pgs=1611 cs=0 l=1 rx=0x7f279000f6c0 tx=0x7f279000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:49.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.884+0000 7f279f7fe700 1 -- 172.21.15.80:0/1369560349 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2790000960 con 0x7f27a006c0a0 2019-11-28T11:44:49.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.884+0000 7f279ffff700 1 --2- 172.21.15.80:0/1369560349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a006c0a0 0x7f27a0072fa0 secure :-1 s=THROTTLE_DONE pgs=1611 cs=0 l=1 rx=0x7f279000f6c0 tx=0x7f279000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:49.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.884+0000 7f279f7fe700 1 -- 172.21.15.80:0/1369560349 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2790000c90 con 0x7f27a006c0a0 2019-11-28T11:44:49.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.884+0000 7f279f7fe700 1 -- 172.21.15.80:0/1369560349 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27900013a0 con 0x7f27a006c0a0 2019-11-28T11:44:49.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.884+0000 7f27a6133700 1 -- 172.21.15.80:0/1369560349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a006c0a0 msgr2=0x7f27a0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:49.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.884+0000 7f27a6133700 1 --2- 172.21.15.80:0/1369560349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a006c0a0 0x7f27a0072fa0 secure :-1 s=READY pgs=1611 cs=0 l=1 rx=0x7f279000f6c0 tx=0x7f279000fa60).stop 2019-11-28T11:44:49.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.884+0000 7f27a6133700 1 -- 172.21.15.80:0/1369560349 shutdown_connections 2019-11-28T11:44:49.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.884+0000 7f27a6133700 1 --2- 172.21.15.80:0/1369560349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27a00734e0 0x7f27a0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:49.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.884+0000 7f27a6133700 1 --2- 172.21.15.80:0/1369560349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a006c0a0 0x7f27a0072fa0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:49.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.884+0000 7f27a6133700 1 -- 172.21.15.80:0/1369560349 shutdown_connections 2019-11-28T11:44:49.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.884+0000 7f27a6133700 1 -- 172.21.15.80:0/1369560349 wait complete. 2019-11-28T11:44:49.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.884+0000 7f27a6133700 1 -- 172.21.15.80:0/1369560349 >> 172.21.15.80:0/1369560349 conn(0x7f27a0061cf0 msgr2=0x7f27a0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:49.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.887+0000 7f27a6133700 1 Processor -- start 2019-11-28T11:44:49.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.887+0000 7f27a6133700 1 -- start start 2019-11-28T11:44:49.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f27a6133700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f27a0164ff0 0x7f27a01653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:49.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f27a6133700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27a0133820 0x7f27a01326a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f27a6133700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a0131680 con 0x7f27a0133cb0 2019-11-28T11:44:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f27a6133700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a010dd90 con 0x7f27a0133820 2019-11-28T11:44:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f27a6133700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a010e060 con 0x7f27a0164ff0 2019-11-28T11:44:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f2797fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27a0133820 0x7f27a01326a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f2797fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27a0133820 0x7f27a01326a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39602/0 (socket says 172.21.15.80:39602) 2019-11-28T11:44:49.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f27a4ed1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f27a0133cb0 0x7f27a0132be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38918/0 (socket says 172.21.15.80:38918) 2019-11-28T11:44:49.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f2797fff700 1 -- 172.21.15.80:0/2658703348 learned_addr learned my addr 172.21.15.80:0/2658703348 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:49.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f279ffff700 1 --2- 172.21.15.80:0/2658703348 >> v2:172.21.15.174:3300/0 conn(0x7f27a0164ff0 0x7f27a01653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:49.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f2797fff700 1 -- 172.21.15.80:0/2658703348 >> v2:172.21.15.174:3300/0 conn(0x7f27a0164ff0 msgr2=0x7f27a01653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:49.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f2797fff700 1 --2- 172.21.15.80:0/2658703348 >> v2:172.21.15.174:3300/0 conn(0x7f27a0164ff0 0x7f27a01653e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:49.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f2797fff700 1 -- 172.21.15.80:0/2658703348 >> v1:172.21.15.80:6789/0 conn(0x7f27a0133cb0 legacy=0x7f27a0132be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:49.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f279d7fa700 1 -- 172.21.15.80:0/2658703348 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112837649 0 0) 0x7f2798001430 con 0x7f27a0133cb0 2019-11-28T11:44:49.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f2797fff700 1 -- 172.21.15.80:0/2658703348 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a010e6f0 con 0x7f27a0133820 2019-11-28T11:44:49.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f2797fff700 1 --2- 172.21.15.80:0/2658703348 >> v2:172.21.15.80:3300/0 conn(0x7f27a0133820 0x7f27a01326a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2788010470 tx=0x7f2788010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:49.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f2797fff700 1 --2- 172.21.15.80:0/2658703348 >> v2:172.21.15.80:3300/0 conn(0x7f27a0133820 0x7f27a01326a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2788010470 tx=0x7f2788010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:49.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f2797fff700 1 --2- 172.21.15.80:0/2658703348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a0133820 0x7f27a01326a0 secure :-1 s=READY pgs=1613 cs=0 l=1 rx=0x7f2788010470 tx=0x7f2788010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:49.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f2797fff700 1 --2- 172.21.15.80:0/2658703348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a0133820 0x7f27a01326a0 secure :-1 s=THROTTLE_DONE pgs=1613 cs=0 l=1 rx=0x7f2788010470 tx=0x7f2788010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:49.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f279d7fa700 1 -- 172.21.15.80:0/2658703348 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2788005180 con 0x7f27a0133820 2019-11-28T11:44:49.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f2797fff700 1 --2- 172.21.15.80:0/2658703348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a0133820 0x7f27a01326a0 secure :-1 s=THROTTLE_DONE pgs=1613 cs=0 l=1 rx=0x7f2788010470 tx=0x7f2788010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:49.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f2797fff700 1 --2- 172.21.15.80:0/2658703348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a0133820 0x7f27a01326a0 secure :-1 s=THROTTLE_DONE pgs=1613 cs=0 l=1 rx=0x7f2788010470 tx=0x7f2788010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:49.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f279d7fa700 1 -- 172.21.15.80:0/2658703348 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2788005880 con 0x7f27a0133820 2019-11-28T11:44:49.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f27a6133700 1 -- 172.21.15.80:0/2658703348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a010ea70 con 0x7f27a0133820 2019-11-28T11:44:49.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f279d7fa700 1 -- 172.21.15.80:0/2658703348 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2788005180 con 0x7f27a0133820 2019-11-28T11:44:49.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.888+0000 7f27a6133700 1 -- 172.21.15.80:0/2658703348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a010e6f0 con 0x7f27a0133820 2019-11-28T11:44:49.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.889+0000 7f2797fff700 1 --2- 172.21.15.80:0/2658703348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a0133820 0x7f27a01326a0 secure :-1 s=THROTTLE_DONE pgs=1613 cs=0 l=1 rx=0x7f2788010470 tx=0x7f2788010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:49.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.889+0000 7f279d7fa700 1 -- 172.21.15.80:0/2658703348 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2788005180 con 0x7f27a0133820 2019-11-28T11:44:49.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.889+0000 7f2797fff700 1 --2- 172.21.15.80:0/2658703348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a0133820 0x7f27a01326a0 secure :-1 s=THROTTLE_DONE pgs=1613 cs=0 l=1 rx=0x7f2788010470 tx=0x7f2788010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:49.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.889+0000 7f279d7fa700 1 --2- 172.21.15.80:0/2658703348 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2784018730 0x7f278401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:49.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.889+0000 7f279d7fa700 1 -- 172.21.15.80:0/2658703348 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f2788031b00 con 0x7f27a0133820 2019-11-28T11:44:49.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.889+0000 7f279ffff700 1 --2- 172.21.15.80:0/2658703348 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2784018730 0x7f278401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:49.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.890+0000 7f279ffff700 1 --2- 172.21.15.80:0/2658703348 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2784018730 0x7f278401abc0 crc :-1 s=READY pgs=653 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:49.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.897+0000 7f27a6133700 1 -- 172.21.15.80:0/2658703348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a010ea70 con 0x7f27a0133820 2019-11-28T11:44:49.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.900+0000 7f2797fff700 1 --2- 172.21.15.80:0/2658703348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a0133820 0x7f27a01326a0 secure :-1 s=THROTTLE_DONE pgs=1613 cs=0 l=1 rx=0x7f2788010470 tx=0x7f2788010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:49.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:49.900+0000 7f279d7fa700 1 -- 172.21.15.80:0/2658703348 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2788005480 con 0x7f27a0133820 2019-11-28T11:44:50.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:50.077+0000 7f27a6133700 1 -- 172.21.15.80:0/2658703348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock"]} v 0) v1 -- 0x7f27a010e6f0 con 0x7f27a0133820 2019-11-28T11:44:51.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:50.966+0000 7f2797fff700 1 --2- 172.21.15.80:0/2658703348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a0133820 0x7f27a01326a0 secure :-1 s=THROTTLE_DONE pgs=1613 cs=0 l=1 rx=0x7f2788010470 tx=0x7f2788010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:50.966+0000 7f279d7fa700 1 -- 172.21.15.80:0/2658703348 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock"]}]=0 v457) v1 ==== 148+0+0 (secure 0 0 0) 0x7f2788005a50 con 0x7f27a0133820 2019-11-28T11:44:51.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:50.995+0000 7f27a6133700 1 -- 172.21.15.80:0/2658703348 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2784018730 msgr2=0x7f278401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:51.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:50.995+0000 7f27a6133700 1 --2- 172.21.15.80:0/2658703348 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2784018730 0x7f278401abc0 crc :-1 s=READY pgs=653 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:51.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:50.995+0000 7f27a6133700 1 -- 172.21.15.80:0/2658703348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a0133820 msgr2=0x7f27a01326a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:51.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:50.995+0000 7f27a6133700 1 --2- 172.21.15.80:0/2658703348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a0133820 0x7f27a01326a0 secure :-1 s=READY pgs=1613 cs=0 l=1 rx=0x7f2788010470 tx=0x7f2788010270).stop 2019-11-28T11:44:51.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:50.996+0000 7f27a6133700 1 -- 172.21.15.80:0/2658703348 shutdown_connections 2019-11-28T11:44:51.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:50.996+0000 7f27a6133700 1 --2- 172.21.15.80:0/2658703348 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2784018730 0x7f278401abc0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:51.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:50.996+0000 7f27a6133700 1 --2- 172.21.15.80:0/2658703348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27a0133820 0x7f27a01326a0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:51.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:50.996+0000 7f27a6133700 1 --2- 172.21.15.80:0/2658703348 >> v2:172.21.15.174:3300/0 conn(0x7f27a0164ff0 0x7f27a01653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:51.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:50.996+0000 7f27a6133700 1 -- 172.21.15.80:0/2658703348 shutdown_connections 2019-11-28T11:44:51.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:50.996+0000 7f27a6133700 1 -- 172.21.15.80:0/2658703348 wait complete. 2019-11-28T11:44:51.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:50.996+0000 7f27a6133700 1 -- 172.21.15.80:0/2658703348 >> 172.21.15.80:0/2658703348 conn(0x7f27a011bfc0 msgr2=0x7f27a0141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:51.047 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:44:51.047 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:44:51.119 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:44:51.179 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:44:51.239 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:44:51.300 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:44:51.361 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:44:51.417 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:44:51.418 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:44:51.418 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:44:51.419 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:44:51.419 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:44:51.420 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:44:51.420 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:44:51.425 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:44:51.425 DEBUG:teuthology.parallel:result is None 2019-11-28T11:44:51.427 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:44:51.427 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:44:51.428 DEBUG:teuthology.parallel:result is None 2019-11-28T11:44:51.428 DEBUG:teuthology.parallel:result is None 2019-11-28T11:44:51.429 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:44:51.430 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:44:51.431 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:44:51.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.599+0000 7f1f51c12700 1 Processor -- start 2019-11-28T11:44:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.599+0000 7f1f51c12700 1 -- start start 2019-11-28T11:44:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f51c12700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1f4c06c0a0 0x7f1f4c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f51c12700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1f4c0734e0 0x7f1f4c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f51c12700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4c06db00 con 0x7f1f4c072360 2019-11-28T11:44:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f51c12700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c06fd60 con 0x7f1f4c06c0a0 2019-11-28T11:44:51.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f51c12700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c070030 con 0x7f1f4c0734e0 2019-11-28T11:44:51.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f509b0700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1f4c072360 0x7f1f4c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38926/0 (socket says 172.21.15.80:38926) 2019-11-28T11:44:51.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f509b0700 1 -- 172.21.15.80:0/4128037897 learned_addr learned my addr 172.21.15.80:0/4128037897 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:51.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f4bfff700 1 --2- 172.21.15.80:0/4128037897 >> v2:172.21.15.80:3300/0 conn(0x7f1f4c06c0a0 0x7f1f4c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:51.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f43fff700 1 --2- 172.21.15.80:0/4128037897 >> v2:172.21.15.174:3300/0 conn(0x7f1f4c0734e0 0x7f1f4c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:51.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f4bfff700 1 -- 172.21.15.80:0/4128037897 >> v2:172.21.15.174:3300/0 conn(0x7f1f4c0734e0 msgr2=0x7f1f4c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:51.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f4bfff700 1 --2- 172.21.15.80:0/4128037897 >> v2:172.21.15.174:3300/0 conn(0x7f1f4c0734e0 0x7f1f4c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:51.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f4bfff700 1 -- 172.21.15.80:0/4128037897 >> v1:172.21.15.80:6789/0 conn(0x7f1f4c072360 legacy=0x7f1f4c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:51.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f4b7fe700 1 -- 172.21.15.80:0/4128037897 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913269928 0 0) 0x7f1f440014d0 con 0x7f1f4c072360 2019-11-28T11:44:51.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f4bfff700 1 -- 172.21.15.80:0/4128037897 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c0706c0 con 0x7f1f4c06c0a0 2019-11-28T11:44:51.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f4bfff700 1 --2- 172.21.15.80:0/4128037897 >> v2:172.21.15.80:3300/0 conn(0x7f1f4c06c0a0 0x7f1f4c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1f3c00af50 tx=0x7f1f3c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f4bfff700 1 --2- 172.21.15.80:0/4128037897 >> v2:172.21.15.80:3300/0 conn(0x7f1f4c06c0a0 0x7f1f4c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1f3c00af50 tx=0x7f1f3c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f4bfff700 1 --2- 172.21.15.80:0/4128037897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f4c06c0a0 0x7f1f4c072fa0 secure :-1 s=READY pgs=1615 cs=0 l=1 rx=0x7f1f3c00af50 tx=0x7f1f3c00b6e0).ready entity=mon.0 client_cookie=a9cb37e4125a8f43 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:51.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f4bfff700 1 --2- 172.21.15.80:0/4128037897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f4c06c0a0 0x7f1f4c072fa0 secure :-1 s=THROTTLE_DONE pgs=1615 cs=0 l=1 rx=0x7f1f3c00af50 tx=0x7f1f3c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f4b7fe700 1 -- 172.21.15.80:0/4128037897 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f3c007210 con 0x7f1f4c06c0a0 2019-11-28T11:44:51.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.600+0000 7f1f4bfff700 1 --2- 172.21.15.80:0/4128037897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f4c06c0a0 0x7f1f4c072fa0 secure :-1 s=THROTTLE_DONE pgs=1615 cs=0 l=1 rx=0x7f1f3c00af50 tx=0x7f1f3c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.601+0000 7f1f4bfff700 1 --2- 172.21.15.80:0/4128037897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f4c06c0a0 0x7f1f4c072fa0 secure :-1 s=THROTTLE_DONE pgs=1615 cs=0 l=1 rx=0x7f1f3c00af50 tx=0x7f1f3c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.601+0000 7f1f4b7fe700 1 -- 172.21.15.80:0/4128037897 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c0099b0 con 0x7f1f4c06c0a0 2019-11-28T11:44:51.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.601+0000 7f1f4b7fe700 1 -- 172.21.15.80:0/4128037897 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f3c009ba0 con 0x7f1f4c06c0a0 2019-11-28T11:44:51.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.601+0000 7f1f51c12700 1 -- 172.21.15.80:0/4128037897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f4c06c0a0 msgr2=0x7f1f4c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:51.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.601+0000 7f1f51c12700 1 --2- 172.21.15.80:0/4128037897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f4c06c0a0 0x7f1f4c072fa0 secure :-1 s=READY pgs=1615 cs=0 l=1 rx=0x7f1f3c00af50 tx=0x7f1f3c00b6e0).stop 2019-11-28T11:44:51.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.601+0000 7f1f51c12700 1 -- 172.21.15.80:0/4128037897 shutdown_connections 2019-11-28T11:44:51.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.601+0000 7f1f51c12700 1 --2- 172.21.15.80:0/4128037897 >> v2:172.21.15.174:3300/0 conn(0x7f1f4c0734e0 0x7f1f4c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:51.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.601+0000 7f1f51c12700 1 --2- 172.21.15.80:0/4128037897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f4c06c0a0 0x7f1f4c072fa0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:51.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.601+0000 7f1f51c12700 1 -- 172.21.15.80:0/4128037897 shutdown_connections 2019-11-28T11:44:51.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.601+0000 7f1f51c12700 1 -- 172.21.15.80:0/4128037897 wait complete. 2019-11-28T11:44:51.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.601+0000 7f1f51c12700 1 -- 172.21.15.80:0/4128037897 >> 172.21.15.80:0/4128037897 conn(0x7f1f4c061cf0 msgr2=0x7f1f4c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:51.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f1f51c12700 1 Processor -- start 2019-11-28T11:44:51.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f1f51c12700 1 -- start start 2019-11-28T11:44:51.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f51c12700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1f4c075a00 0x7f1f4c075e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:51.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f51c12700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f4c0763d0 0x7f1f4c112e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:51.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f51c12700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4c1141d0 con 0x7f1f4c10adf0 2019-11-28T11:44:51.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f51c12700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c073960 con 0x7f1f4c075a00 2019-11-28T11:44:51.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f51c12700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c073c30 con 0x7f1f4c0763d0 2019-11-28T11:44:51.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f4bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1f4c10adf0 0x7f1f4c1592b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38940/0 (socket says 172.21.15.80:38940) 2019-11-28T11:44:51.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f4bfff700 1 -- 172.21.15.80:0/3998426773 learned_addr learned my addr 172.21.15.80:0/3998426773 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:51.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f509b0700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f4c0763d0 0x7f1f4c112e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f497fa700 1 -- 172.21.15.80:0/3998426773 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118355238 0 0) 0x7f1f3c00acb0 con 0x7f1f4c10adf0 2019-11-28T11:44:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f497fa700 1 -- 172.21.15.80:0/3998426773 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f30002e80 con 0x7f1f4c10adf0 2019-11-28T11:44:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f509b0700 1 -- 172.21.15.80:0/3998426773 >> v2:172.21.15.80:3300/0 conn(0x7f1f4c075a00 msgr2=0x7f1f4c075e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2019-11-28T11:44:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f509b0700 1 --2- 172.21.15.80:0/3998426773 >> v2:172.21.15.80:3300/0 conn(0x7f1f4c075a00 0x7f1f4c075e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f509b0700 1 -- 172.21.15.80:0/3998426773 >> v1:172.21.15.80:6789/0 conn(0x7f1f4c10adf0 legacy=0x7f1f4c1592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f509b0700 1 -- 172.21.15.80:0/3998426773 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c0742c0 con 0x7f1f4c0763d0 2019-11-28T11:44:51.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f509b0700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f4c0763d0 0x7f1f4c112e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f44010720 tx=0x7f1f44010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f509b0700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f4c0763d0 0x7f1f4c112e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f44010720 tx=0x7f1f44010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f1f509b0700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f4c0763d0 0x7f1f4c112e40 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f1f44010720 tx=0x7f1f44010ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:51.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f1f509b0700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f4c0763d0 0x7f1f4c112e40 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f1f44010720 tx=0x7f1f44010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f1f509b0700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f4c0763d0 0x7f1f4c112e40 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f1f44010720 tx=0x7f1f44010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f1f509b0700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f4c0763d0 0x7f1f4c112e40 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f1f44010720 tx=0x7f1f44010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f1f497fa700 1 -- 172.21.15.80:0/3998426773 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f44000cc0 con 0x7f1f4c0763d0 2019-11-28T11:44:51.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f1f497fa700 1 -- 172.21.15.80:0/3998426773 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f44001700 con 0x7f1f4c0763d0 2019-11-28T11:44:51.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f1f497fa700 1 -- 172.21.15.80:0/3998426773 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f44001e30 con 0x7f1f4c0763d0 2019-11-28T11:44:51.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f1f51c12700 1 -- 172.21.15.80:0/3998426773 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4c074640 con 0x7f1f4c0763d0 2019-11-28T11:44:51.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f1f51c12700 1 -- 172.21.15.80:0/3998426773 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4c0742c0 con 0x7f1f4c0763d0 2019-11-28T11:44:51.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f1f509b0700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f4c0763d0 0x7f1f4c112e40 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f1f44010720 tx=0x7f1f44010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f1f497fa700 1 -- 172.21.15.80:0/3998426773 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1f44001270 con 0x7f1f4c0763d0 2019-11-28T11:44:51.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f1f509b0700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f4c0763d0 0x7f1f4c112e40 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f1f44010720 tx=0x7f1f44010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f1f497fa700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f30018770 0x7f1f3001ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:51.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f1f497fa700 1 -- 172.21.15.80:0/3998426773 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f1f44031ff0 con 0x7f1f4c0763d0 2019-11-28T11:44:51.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.608+0000 7f1f4bfff700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f30018770 0x7f1f3001ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:51.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.608+0000 7f1f4bfff700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f30018770 0x7f1f3001ac00 crc :-1 s=READY pgs=654 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:51.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.614+0000 7f1f51c12700 1 -- 172.21.15.80:0/3998426773 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4c074640 con 0x7f1f4c0763d0 2019-11-28T11:44:51.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.617+0000 7f1f509b0700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f4c0763d0 0x7f1f4c112e40 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f1f44010720 tx=0x7f1f44010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.618+0000 7f1f497fa700 1 -- 172.21.15.80:0/3998426773 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1f44000cc0 con 0x7f1f4c0763d0 2019-11-28T11:44:51.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.602+0000 7f3ada646700 1 Processor -- start 2019-11-28T11:44:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.602+0000 7f3ada646700 1 -- start start 2019-11-28T11:44:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f3ada646700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad406c490 0x7f3ad406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f3ada646700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ad406ce60 0x7f3ad4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f3ada646700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad406db00 con 0x7f3ad406c0a0 2019-11-28T11:44:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f3ada646700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad406fd60 con 0x7f3ad406ce60 2019-11-28T11:44:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f3ada646700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad4070030 con 0x7f3ad406c490 2019-11-28T11:44:51.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f3ad93e4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ad406ce60 0x7f3ad4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:51.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f3ad93e4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ad406ce60 0x7f3ad4164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39616/0 (socket says 172.21.15.80:39616) 2019-11-28T11:44:51.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f3ad93e4700 1 -- 172.21.15.80:0/332278732 learned_addr learned my addr 172.21.15.80:0/332278732 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:51.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f3ad3fff700 1 --2- 172.21.15.80:0/332278732 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad406c490 0x7f3ad406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:51.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f3ad93e4700 1 -- 172.21.15.80:0/332278732 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad406c490 msgr2=0x7f3ad406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:51.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/332278732 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad406c490 0x7f3ad406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:51.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f3ad93e4700 1 -- 172.21.15.80:0/332278732 >> v1:172.21.15.80:6789/0 conn(0x7f3ad406c0a0 legacy=0x7f3ad4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:51.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f3ad93e4700 1 -- 172.21.15.80:0/332278732 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad40706c0 con 0x7f3ad406ce60 2019-11-28T11:44:51.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/332278732 >> v2:172.21.15.80:3300/0 conn(0x7f3ad406ce60 0x7f3ad4164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3acc00fa30 tx=0x7f3acc00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/332278732 >> v2:172.21.15.80:3300/0 conn(0x7f3ad406ce60 0x7f3ad4164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3acc00fa30 tx=0x7f3acc00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/332278732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad406ce60 0x7f3ad4164d70 secure :-1 s=READY pgs=1617 cs=0 l=1 rx=0x7f3acc00fa30 tx=0x7f3acc00fdd0).ready entity=mon.0 client_cookie=6e9bf63748154c3f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:51.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/332278732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad406ce60 0x7f3ad4164d70 secure :-1 s=THROTTLE_DONE pgs=1617 cs=0 l=1 rx=0x7f3acc00fa30 tx=0x7f3acc00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/332278732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad406ce60 0x7f3ad4164d70 secure :-1 s=THROTTLE_DONE pgs=1617 cs=0 l=1 rx=0x7f3acc00fa30 tx=0x7f3acc00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/332278732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad406ce60 0x7f3ad4164d70 secure :-1 s=THROTTLE_DONE pgs=1617 cs=0 l=1 rx=0x7f3acc00fa30 tx=0x7f3acc00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f3ad37fe700 1 -- 172.21.15.80:0/332278732 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3acc000df0 con 0x7f3ad406ce60 2019-11-28T11:44:51.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f3ad37fe700 1 -- 172.21.15.80:0/332278732 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc001460 con 0x7f3ad406ce60 2019-11-28T11:44:51.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f3ad37fe700 1 -- 172.21.15.80:0/332278732 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3acc001a30 con 0x7f3ad406ce60 2019-11-28T11:44:51.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f3ada646700 1 -- 172.21.15.80:0/332278732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad406ce60 msgr2=0x7f3ad4164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:51.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f3ada646700 1 --2- 172.21.15.80:0/332278732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad406ce60 0x7f3ad4164d70 secure :-1 s=READY pgs=1617 cs=0 l=1 rx=0x7f3acc00fa30 tx=0x7f3acc00fdd0).stop 2019-11-28T11:44:51.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f3ada646700 1 -- 172.21.15.80:0/332278732 shutdown_connections 2019-11-28T11:44:51.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f3ada646700 1 --2- 172.21.15.80:0/332278732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad406ce60 0x7f3ad4164d70 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:51.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f3ada646700 1 --2- 172.21.15.80:0/332278732 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad406c490 0x7f3ad406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:51.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f3ada646700 1 -- 172.21.15.80:0/332278732 shutdown_connections 2019-11-28T11:44:51.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f3ada646700 1 -- 172.21.15.80:0/332278732 wait complete. 2019-11-28T11:44:51.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f3ada646700 1 -- 172.21.15.80:0/332278732 >> 172.21.15.80:0/332278732 conn(0x7f3ad4061cf0 msgr2=0x7f3ad4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:51.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.608+0000 7f3ada646700 1 Processor -- start 2019-11-28T11:44:51.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.608+0000 7f3ada646700 1 -- start start 2019-11-28T11:44:51.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ada646700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3ad415fdf0 0x7f3ad412b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:51.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ada646700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad412a3c0 0x7f3ad412a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:51.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ada646700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad413eb20 con 0x7f3ad412b8a0 2019-11-28T11:44:51.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ada646700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad4108820 con 0x7f3ad415fdf0 2019-11-28T11:44:51.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ada646700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad4108af0 con 0x7f3ad412a3c0 2019-11-28T11:44:51.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ad93e4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad412a3c0 0x7f3ad412a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:51.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ad8be3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3ad415fdf0 0x7f3ad412b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:51.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ad3fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f3ad412b8a0 0x7f3ad413e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:54492/0 (socket says 172.21.15.80:54492) 2019-11-28T11:44:51.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ad3fff700 1 -- 172.21.15.80:0/3378830352 learned_addr learned my addr 172.21.15.80:0/3378830352 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:51.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ad93e4700 1 -- 172.21.15.80:0/3378830352 >> v2:172.21.15.174:3300/0 conn(0x7f3ad415fdf0 msgr2=0x7f3ad412b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:51.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/3378830352 >> v2:172.21.15.174:3300/0 conn(0x7f3ad415fdf0 0x7f3ad412b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:51.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ad93e4700 1 -- 172.21.15.80:0/3378830352 >> v1:172.21.15.174:6789/0 conn(0x7f3ad412b8a0 legacy=0x7f3ad413e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:51.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ad93e4700 1 -- 172.21.15.80:0/3378830352 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad410a8c0 con 0x7f3ad412a3c0 2019-11-28T11:44:51.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad412a3c0 0x7f3ad412a7d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3acc010710 tx=0x7f3acc010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad412a3c0 0x7f3ad412a7d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3acc010710 tx=0x7f3acc010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad412a3c0 0x7f3ad412a7d0 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7f3acc010710 tx=0x7f3acc010540).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:51.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad412a3c0 0x7f3ad412a7d0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f3acc010710 tx=0x7f3acc010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad412a3c0 0x7f3ad412a7d0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f3acc010710 tx=0x7f3acc010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f3ad17fa700 1 -- 172.21.15.80:0/3378830352 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3acc001820 con 0x7f3ad412a3c0 2019-11-28T11:44:51.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad412a3c0 0x7f3ad412a7d0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f3acc010710 tx=0x7f3acc010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f3ad17fa700 1 -- 172.21.15.80:0/3378830352 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc001440 con 0x7f3ad412a3c0 2019-11-28T11:44:51.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f3ad17fa700 1 -- 172.21.15.80:0/3378830352 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3acc001e00 con 0x7f3ad412a3c0 2019-11-28T11:44:51.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f3ada646700 1 -- 172.21.15.80:0/3378830352 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad410a8c0 con 0x7f3ad412a3c0 2019-11-28T11:44:51.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f3ada646700 1 -- 172.21.15.80:0/3378830352 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad410a8c0 con 0x7f3ad412a3c0 2019-11-28T11:44:51.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad412a3c0 0x7f3ad412a7d0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f3acc010710 tx=0x7f3acc010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f3ad17fa700 1 -- 172.21.15.80:0/3378830352 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3acc001630 con 0x7f3ad412a3c0 2019-11-28T11:44:51.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad412a3c0 0x7f3ad412a7d0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f3acc010710 tx=0x7f3acc010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f3ad17fa700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ab8018730 0x7f3ab801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:51.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f3ad17fa700 1 -- 172.21.15.80:0/3378830352 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f3acc031e80 con 0x7f3ad412a3c0 2019-11-28T11:44:51.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f3ad8be3700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ab8018730 0x7f3ab801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:51.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f3ad8be3700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ab8018730 0x7f3ab801abc0 crc :-1 s=READY pgs=655 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:51.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.617+0000 7f3ada646700 1 -- 172.21.15.80:0/3378830352 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad4109180 con 0x7f3ad412a3c0 2019-11-28T11:44:51.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.621+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad412a3c0 0x7f3ad412a7d0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f3acc010710 tx=0x7f3acc010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.621+0000 7f3ad17fa700 1 -- 172.21.15.80:0/3378830352 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3acc001230 con 0x7f3ad412a3c0 2019-11-28T11:44:51.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f941b130700 1 Processor -- start 2019-11-28T11:44:51.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.603+0000 7f941b130700 1 -- start start 2019-11-28T11:44:51.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f941b130700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f941406c0a0 0x7f9414072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:51.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f941b130700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f94140734e0 0x7f9414071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:51.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f941b130700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9414072360 0x7f94140727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:51.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f941b130700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941406f330 con 0x7f94140734e0 2019-11-28T11:44:51.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f941b130700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94140706c0 con 0x7f9414072360 2019-11-28T11:44:51.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f941b130700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9414070a40 con 0x7f941406c0a0 2019-11-28T11:44:51.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.604+0000 7f9418ecc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f94140734e0 0x7f9414071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:51.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f9418ecc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f94140734e0 0x7f9414071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39618/0 (socket says 172.21.15.80:39618) 2019-11-28T11:44:51.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f9418ecc700 1 -- 172.21.15.80:0/1672048891 learned_addr learned my addr 172.21.15.80:0/1672048891 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:51.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f94196cd700 1 --2- 172.21.15.80:0/1672048891 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f941406c0a0 0x7f9414072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:51.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f9419ece700 1 --2- 172.21.15.80:0/1672048891 >> v2:172.21.15.174:3300/0 conn(0x7f9414072360 0x7f94140727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:51.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f9418ecc700 1 -- 172.21.15.80:0/1672048891 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f941406c0a0 msgr2=0x7f9414072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:51.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f9418ecc700 1 --2- 172.21.15.80:0/1672048891 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f941406c0a0 0x7f9414072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:51.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f9418ecc700 1 -- 172.21.15.80:0/1672048891 >> v2:172.21.15.174:3300/0 conn(0x7f9414072360 msgr2=0x7f94140727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:51.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f9418ecc700 1 --2- 172.21.15.80:0/1672048891 >> v2:172.21.15.174:3300/0 conn(0x7f9414072360 0x7f94140727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:51.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f9418ecc700 1 -- 172.21.15.80:0/1672048891 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941406db00 con 0x7f94140734e0 2019-11-28T11:44:51.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f9419ece700 1 --2- 172.21.15.80:0/1672048891 >> v2:172.21.15.174:3300/0 conn(0x7f9414072360 0x7f94140727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:44:51.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f9418ecc700 1 --2- 172.21.15.80:0/1672048891 >> v2:172.21.15.80:3300/0 conn(0x7f94140734e0 0x7f9414071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f940400f6c0 tx=0x7f940400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f9418ecc700 1 --2- 172.21.15.80:0/1672048891 >> v2:172.21.15.80:3300/0 conn(0x7f94140734e0 0x7f9414071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f940400f6c0 tx=0x7f940400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f9418ecc700 1 --2- 172.21.15.80:0/1672048891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94140734e0 0x7f9414071e20 secure :-1 s=READY pgs=1619 cs=0 l=1 rx=0x7f940400f6c0 tx=0x7f940400fa60).ready entity=mon.0 client_cookie=1cf8df5aba3c80ad server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:51.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f9418ecc700 1 --2- 172.21.15.80:0/1672048891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94140734e0 0x7f9414071e20 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f940400f6c0 tx=0x7f940400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f9418ecc700 1 --2- 172.21.15.80:0/1672048891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94140734e0 0x7f9414071e20 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f940400f6c0 tx=0x7f940400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f940bfff700 1 -- 172.21.15.80:0/1672048891 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9404000960 con 0x7f94140734e0 2019-11-28T11:44:51.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f9418ecc700 1 --2- 172.21.15.80:0/1672048891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94140734e0 0x7f9414071e20 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f940400f6c0 tx=0x7f940400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f940bfff700 1 -- 172.21.15.80:0/1672048891 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9404000c90 con 0x7f94140734e0 2019-11-28T11:44:51.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f940bfff700 1 -- 172.21.15.80:0/1672048891 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9404001440 con 0x7f94140734e0 2019-11-28T11:44:51.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f941b130700 1 -- 172.21.15.80:0/1672048891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94140734e0 msgr2=0x7f9414071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:51.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.605+0000 7f941b130700 1 --2- 172.21.15.80:0/1672048891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94140734e0 0x7f9414071e20 secure :-1 s=READY pgs=1619 cs=0 l=1 rx=0x7f940400f6c0 tx=0x7f940400fa60).stop 2019-11-28T11:44:51.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f941b130700 1 -- 172.21.15.80:0/1672048891 shutdown_connections 2019-11-28T11:44:51.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f941b130700 1 --2- 172.21.15.80:0/1672048891 >> v2:172.21.15.174:3300/0 conn(0x7f9414072360 0x7f94140727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:51.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f941b130700 1 --2- 172.21.15.80:0/1672048891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94140734e0 0x7f9414071e20 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:51.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.606+0000 7f941b130700 1 --2- 172.21.15.80:0/1672048891 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f941406c0a0 0x7f9414072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:51.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.607+0000 7f941b130700 1 -- 172.21.15.80:0/1672048891 shutdown_connections 2019-11-28T11:44:51.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.607+0000 7f941b130700 1 -- 172.21.15.80:0/1672048891 wait complete. 2019-11-28T11:44:51.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.607+0000 7f941b130700 1 -- 172.21.15.80:0/1672048891 >> 172.21.15.80:0/1672048891 conn(0x7f9414061cf0 msgr2=0x7f9414064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:51.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f941b130700 1 Processor -- start 2019-11-28T11:44:51.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.609+0000 7f941b130700 1 -- start start 2019-11-28T11:44:51.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f941b130700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f941413e900 0x7f941412b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:51.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f941b130700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f941412b6c0 0x7f9414165f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:51.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f941b130700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9414166490 0x7f941412a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:51.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f941b130700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94141117b0 con 0x7f9414166490 2019-11-28T11:44:51.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f941b130700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9414128230 con 0x7f941413e900 2019-11-28T11:44:51.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f941b130700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941413bae0 con 0x7f941412b6c0 2019-11-28T11:44:51.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f9419ece700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9414166490 0x7f941412a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f94196cd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f941413e900 0x7f941412b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f9419ece700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9414166490 0x7f941412a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39638/0 (socket says 172.21.15.80:39638) 2019-11-28T11:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f9419ece700 1 -- 172.21.15.80:0/1462964914 learned_addr learned my addr 172.21.15.80:0/1462964914 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f9419ece700 1 -- 172.21.15.80:0/1462964914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f941412b6c0 msgr2=0x7f9414165f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2019-11-28T11:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f9419ece700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f941412b6c0 0x7f9414165f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:51.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f9419ece700 1 -- 172.21.15.80:0/1462964914 >> v2:172.21.15.174:3300/0 conn(0x7f941413e900 msgr2=0x7f941412b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:51.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.610+0000 7f9419ece700 1 --2- 172.21.15.80:0/1462964914 >> v2:172.21.15.174:3300/0 conn(0x7f941413e900 0x7f941412b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:51.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f9419ece700 1 -- 172.21.15.80:0/1462964914 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94141288c0 con 0x7f9414166490 2019-11-28T11:44:51.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f94196cd700 1 --2- 172.21.15.80:0/1462964914 >> v2:172.21.15.174:3300/0 conn(0x7f941413e900 0x7f941412b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:44:51.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f9419ece700 1 --2- 172.21.15.80:0/1462964914 >> v2:172.21.15.80:3300/0 conn(0x7f9414166490 0x7f941412a000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f940c010800 tx=0x7f940c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f9419ece700 1 --2- 172.21.15.80:0/1462964914 >> v2:172.21.15.80:3300/0 conn(0x7f9414166490 0x7f941412a000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f940c010800 tx=0x7f940c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f9419ece700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9414166490 0x7f941412a000 secure :-1 s=READY pgs=1620 cs=0 l=1 rx=0x7f940c010800 tx=0x7f940c010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f9419ece700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9414166490 0x7f941412a000 secure :-1 s=THROTTLE_DONE pgs=1620 cs=0 l=1 rx=0x7f940c010800 tx=0x7f940c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f9419ece700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9414166490 0x7f941412a000 secure :-1 s=THROTTLE_DONE pgs=1620 cs=0 l=1 rx=0x7f940c010800 tx=0x7f940c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f9419ece700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9414166490 0x7f941412a000 secure :-1 s=THROTTLE_DONE pgs=1620 cs=0 l=1 rx=0x7f940c010800 tx=0x7f940c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f9409ffb700 1 -- 172.21.15.80:0/1462964914 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f940c009f50 con 0x7f9414166490 2019-11-28T11:44:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f9409ffb700 1 -- 172.21.15.80:0/1462964914 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c009b70 con 0x7f9414166490 2019-11-28T11:44:51.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f941b130700 1 -- 172.21.15.80:0/1462964914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9414128c40 con 0x7f9414166490 2019-11-28T11:44:51.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f9409ffb700 1 -- 172.21.15.80:0/1462964914 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f940c00a630 con 0x7f9414166490 2019-11-28T11:44:51.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f941b130700 1 -- 172.21.15.80:0/1462964914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94141288c0 con 0x7f9414166490 2019-11-28T11:44:51.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f9419ece700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9414166490 0x7f941412a000 secure :-1 s=THROTTLE_DONE pgs=1620 cs=0 l=1 rx=0x7f940c010800 tx=0x7f940c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f9409ffb700 1 -- 172.21.15.80:0/1462964914 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f940c000e90 con 0x7f9414166490 2019-11-28T11:44:51.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.611+0000 7f9419ece700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9414166490 0x7f941412a000 secure :-1 s=THROTTLE_DONE pgs=1620 cs=0 l=1 rx=0x7f940c010800 tx=0x7f940c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.612+0000 7f9409ffb700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93f4018730 0x7f93f401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:51.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.612+0000 7f9409ffb700 1 -- 172.21.15.80:0/1462964914 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f940c031fc0 con 0x7f9414166490 2019-11-28T11:44:51.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.612+0000 7f94196cd700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93f4018730 0x7f93f401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:51.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.612+0000 7f94196cd700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93f4018730 0x7f93f401abe0 crc :-1 s=READY pgs=656 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:51.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.618+0000 7f941b130700 1 -- 172.21.15.80:0/1462964914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9414128c40 con 0x7f9414166490 2019-11-28T11:44:51.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.622+0000 7f9419ece700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9414166490 0x7f941412a000 secure :-1 s=THROTTLE_DONE pgs=1620 cs=0 l=1 rx=0x7f940c010800 tx=0x7f940c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:51.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.622+0000 7f9409ffb700 1 -- 172.21.15.80:0/1462964914 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f940c009930 con 0x7f9414166490 2019-11-28T11:44:51.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.805+0000 7f1f51c12700 1 -- 172.21.15.80:0/3998426773 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f1f4c0742c0 con 0x7f1f4c0763d0 2019-11-28T11:44:51.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.809+0000 7f3ada646700 1 -- 172.21.15.80:0/3378830352 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f3ad4109500 con 0x7f3ad412a3c0 2019-11-28T11:44:51.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:51.810+0000 7f941b130700 1 -- 172.21.15.80:0/1462964914 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f94141288c0 con 0x7f9414166490 2019-11-28T11:44:52.733 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:44:52.694+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:44:52.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.696+0000 7f9419ece700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9414166490 0x7f941412a000 secure :-1 s=THROTTLE_DONE pgs=1620 cs=0 l=1 rx=0x7f940c010800 tx=0x7f940c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:52.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.696+0000 7f9409ffb700 1 -- 172.21.15.80:0/1462964914 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 8553 v85) v1 ==== 95+0+0 (secure 0 0 0) 0x7f940c009b70 con 0x7f9414166490 2019-11-28T11:44:52.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.697+0000 7f1f509b0700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f4c0763d0 0x7f1f4c112e40 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f1f44010720 tx=0x7f1f44010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:52.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.697+0000 7f1f497fa700 1 -- 172.21.15.80:0/3998426773 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6242 v85) v1 ==== 95+0+0 (secure 0 0 0) 0x7f1f44001270 con 0x7f1f4c0763d0 2019-11-28T11:44:52.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.697+0000 7f3ad93e4700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad412a3c0 0x7f3ad412a7d0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f3acc010710 tx=0x7f3acc010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:52.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.697+0000 7f3ad17fa700 1 -- 172.21.15.80:0/3378830352 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 8556 v85) v1 ==== 95+0+0 (secure 0 0 0) 0x7f3acc001440 con 0x7f3ad412a3c0 2019-11-28T11:44:52.759 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 6242 2019-11-28T11:44:52.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.721+0000 7f1f51c12700 1 -- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f30018770 msgr2=0x7f1f3001ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:52.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.721+0000 7f1f51c12700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f30018770 0x7f1f3001ac00 crc :-1 s=READY pgs=654 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:52.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.721+0000 7f1f51c12700 1 -- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f4c0763d0 msgr2=0x7f1f4c112e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:52.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.721+0000 7f1f51c12700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f4c0763d0 0x7f1f4c112e40 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f1f44010720 tx=0x7f1f44010ac0).stop 2019-11-28T11:44:52.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.722+0000 7f1f51c12700 1 -- 172.21.15.80:0/3998426773 shutdown_connections 2019-11-28T11:44:52.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.722+0000 7f1f51c12700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f30018770 0x7f1f3001ac00 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:52.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.722+0000 7f1f51c12700 1 --2- 172.21.15.80:0/3998426773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f4c0763d0 0x7f1f4c112e40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:52.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.722+0000 7f1f51c12700 1 --2- 172.21.15.80:0/3998426773 >> v2:172.21.15.80:3300/0 conn(0x7f1f4c075a00 0x7f1f4c075e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:52.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.722+0000 7f1f51c12700 1 -- 172.21.15.80:0/3998426773 shutdown_connections 2019-11-28T11:44:52.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.722+0000 7f1f51c12700 1 -- 172.21.15.80:0/3998426773 wait complete. 2019-11-28T11:44:52.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.722+0000 7f1f51c12700 1 -- 172.21.15.80:0/3998426773 >> 172.21.15.80:0/3998426773 conn(0x7f1f4c13d930 msgr2=0x7f1f4c111550 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 8556 2019-11-28T11:44:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.727+0000 7f3ada646700 1 -- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ab8018730 msgr2=0x7f3ab801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.727+0000 7f3ada646700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ab8018730 0x7f3ab801abc0 crc :-1 s=READY pgs=655 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.727+0000 7f3ada646700 1 -- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad412a3c0 msgr2=0x7f3ad412a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.727+0000 7f3ada646700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad412a3c0 0x7f3ad412a7d0 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7f3acc010710 tx=0x7f3acc010540).stop 2019-11-28T11:44:52.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.727+0000 7f3ada646700 1 -- 172.21.15.80:0/3378830352 shutdown_connections 2019-11-28T11:44:52.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.727+0000 7f3ada646700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ad412a3c0 0x7f3ad412a7d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:52.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.727+0000 7f3ada646700 1 --2- 172.21.15.80:0/3378830352 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ab8018730 0x7f3ab801abc0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:52.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.727+0000 7f3ada646700 1 --2- 172.21.15.80:0/3378830352 >> v2:172.21.15.174:3300/0 conn(0x7f3ad415fdf0 0x7f3ad412b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:52.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.727+0000 7f3ada646700 1 -- 172.21.15.80:0/3378830352 shutdown_connections 2019-11-28T11:44:52.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.727+0000 7f3ada646700 1 -- 172.21.15.80:0/3378830352 wait complete. 2019-11-28T11:44:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.727+0000 7f3ada646700 1 -- 172.21.15.80:0/3378830352 >> 172.21.15.80:0/3378830352 conn(0x7f3ad4127dc0 msgr2=0x7f3ad4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 8553 2019-11-28T11:44:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.727+0000 7f941b130700 1 -- 172.21.15.80:0/1462964914 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93f4018730 msgr2=0x7f93f401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.727+0000 7f941b130700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93f4018730 0x7f93f401abe0 crc :-1 s=READY pgs=656 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.727+0000 7f941b130700 1 -- 172.21.15.80:0/1462964914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9414166490 msgr2=0x7f941412a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:52.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.727+0000 7f941b130700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9414166490 0x7f941412a000 secure :-1 s=READY pgs=1620 cs=0 l=1 rx=0x7f940c010800 tx=0x7f940c010600).stop 2019-11-28T11:44:52.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.728+0000 7f941b130700 1 -- 172.21.15.80:0/1462964914 shutdown_connections 2019-11-28T11:44:52.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.728+0000 7f941b130700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93f4018730 0x7f93f401abe0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:52.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.728+0000 7f941b130700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9414166490 0x7f941412a000 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:52.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.728+0000 7f941b130700 1 --2- 172.21.15.80:0/1462964914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f941412b6c0 0x7f9414165f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:52.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.728+0000 7f941b130700 1 --2- 172.21.15.80:0/1462964914 >> v2:172.21.15.174:3300/0 conn(0x7f941413e900 0x7f941412b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:52.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.728+0000 7f941b130700 1 -- 172.21.15.80:0/1462964914 shutdown_connections 2019-11-28T11:44:52.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.728+0000 7f941b130700 1 -- 172.21.15.80:0/1462964914 wait complete. 2019-11-28T11:44:52.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.728+0000 7f941b130700 1 -- 172.21.15.80:0/1462964914 >> 172.21.15.80:0/1462964914 conn(0x7f9414127dc0 msgr2=0x7f9414141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:52.777 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:44:52.780 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:44:52.781 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:44:52.781 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:44:52.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.924+0000 7ff2db898700 1 Processor -- start 2019-11-28T11:44:52.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.924+0000 7ff2db898700 1 -- start start 2019-11-28T11:44:52.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.925+0000 7ff2db898700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff2d406c490 0x7ff2d406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:52.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.925+0000 7ff2db898700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d406db00 con 0x7ff2d406ce60 2019-11-28T11:44:52.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.925+0000 7ff2db898700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d406e000 con 0x7ff2d406c0a0 2019-11-28T11:44:52.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.925+0000 7ff2db898700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d406fd60 con 0x7ff2d406c490 2019-11-28T11:44:52.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.925+0000 7ff2d9634700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff2d406c490 0x7ff2d406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:52.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2d9634700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff2d406c490 0x7ff2d406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39648/0 (socket says 172.21.15.80:39648) 2019-11-28T11:44:52.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2d9634700 1 -- 172.21.15.80:0/2466015967 learned_addr learned my addr 172.21.15.80:0/2466015967 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:52.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2da636700 1 --1- 172.21.15.80:0/2466015967 >> v1:172.21.15.80:6789/0 conn(0x7ff2d406ce60 0x7ff2d4164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38962/0 (socket says 172.21.15.80:38962) 2019-11-28T11:44:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2d9634700 1 -- 172.21.15.80:0/2466015967 >> v1:172.21.15.174:6789/0 conn(0x7ff2d406c0a0 legacy=0x7ff2d4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2d9634700 1 -- 172.21.15.80:0/2466015967 >> v1:172.21.15.80:6789/0 conn(0x7ff2d406ce60 legacy=0x7ff2d4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2d8e33700 1 -- 172.21.15.80:0/2466015967 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701595435 0 0) 0x7ff2cc0009b0 con 0x7ff2d406ce60 2019-11-28T11:44:52.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2d9634700 1 -- 172.21.15.80:0/2466015967 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d40706c0 con 0x7ff2d406c490 2019-11-28T11:44:52.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2d9634700 1 --2- 172.21.15.80:0/2466015967 >> v2:172.21.15.80:3300/0 conn(0x7ff2d406c490 0x7ff2d406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff2bc00fac0 tx=0x7ff2bc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:52.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2d9634700 1 --2- 172.21.15.80:0/2466015967 >> v2:172.21.15.80:3300/0 conn(0x7ff2d406c490 0x7ff2d406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff2bc00fac0 tx=0x7ff2bc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:52.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2d9634700 1 --2- 172.21.15.80:0/2466015967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d406c490 0x7ff2d406c920 secure :-1 s=READY pgs=1622 cs=0 l=1 rx=0x7ff2bc00fac0 tx=0x7ff2bc00fe60).ready entity=mon.0 client_cookie=d976acc996bc7e4c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:52.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2d9634700 1 --2- 172.21.15.80:0/2466015967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d406c490 0x7ff2d406c920 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7ff2bc00fac0 tx=0x7ff2bc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:52.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2d8e33700 1 -- 172.21.15.80:0/2466015967 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2bc000ce0 con 0x7ff2d406c490 2019-11-28T11:44:52.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2d9634700 1 --2- 172.21.15.80:0/2466015967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d406c490 0x7ff2d406c920 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7ff2bc00fac0 tx=0x7ff2bc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:52.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2d9634700 1 --2- 172.21.15.80:0/2466015967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d406c490 0x7ff2d406c920 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7ff2bc00fac0 tx=0x7ff2bc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:52.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2d8e33700 1 -- 172.21.15.80:0/2466015967 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc001010 con 0x7ff2d406c490 2019-11-28T11:44:52.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2d8e33700 1 -- 172.21.15.80:0/2466015967 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2bc001760 con 0x7ff2d406c490 2019-11-28T11:44:52.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2db898700 1 -- 172.21.15.80:0/2466015967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d406c490 msgr2=0x7ff2d406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:52.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.926+0000 7ff2db898700 1 --2- 172.21.15.80:0/2466015967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d406c490 0x7ff2d406c920 secure :-1 s=READY pgs=1622 cs=0 l=1 rx=0x7ff2bc00fac0 tx=0x7ff2bc00fe60).stop 2019-11-28T11:44:52.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.927+0000 7ff2db898700 1 -- 172.21.15.80:0/2466015967 shutdown_connections 2019-11-28T11:44:52.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.927+0000 7ff2db898700 1 --2- 172.21.15.80:0/2466015967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2d406c490 0x7ff2d406c920 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:52.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.927+0000 7ff2db898700 1 -- 172.21.15.80:0/2466015967 shutdown_connections 2019-11-28T11:44:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.927+0000 7ff2db898700 1 -- 172.21.15.80:0/2466015967 wait complete. 2019-11-28T11:44:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.927+0000 7ff2db898700 1 -- 172.21.15.80:0/2466015967 >> 172.21.15.80:0/2466015967 conn(0x7ff2d4061cf0 msgr2=0x7ff2d4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.929+0000 7ff2db898700 1 Processor -- start 2019-11-28T11:44:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.929+0000 7ff2db898700 1 -- start start 2019-11-28T11:44:52.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.930+0000 7ff2db898700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2d4166a10 0x7ff2d4168e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:52.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.930+0000 7ff2db898700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d4124260 con 0x7ff2d412cea0 2019-11-28T11:44:52.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.930+0000 7ff2db898700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d412e5d0 con 0x7ff2d4111db0 2019-11-28T11:44:52.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.930+0000 7ff2db898700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d4121040 con 0x7ff2d4166a10 2019-11-28T11:44:52.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.930+0000 7ff2d9e35700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff2d412cea0 0x7ff2d41230e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38968/0 (socket says 172.21.15.80:38968) 2019-11-28T11:44:52.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.930+0000 7ff2d9e35700 1 -- 172.21.15.80:0/1513239217 learned_addr learned my addr 172.21.15.80:0/1513239217 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:52.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.930+0000 7ff2da636700 1 --2- 172.21.15.80:0/1513239217 >> v2:172.21.15.174:3300/0 conn(0x7ff2d4166a10 0x7ff2d4168e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:52.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2d27fc700 1 -- 172.21.15.80:0/1513239217 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219868454 0 0) 0x7ff2c4001150 con 0x7ff2d412cea0 2019-11-28T11:44:52.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2d27fc700 1 -- 172.21.15.80:0/1513239217 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2b8002e80 con 0x7ff2d412cea0 2019-11-28T11:44:52.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2d27fc700 1 -- 172.21.15.80:0/1513239217 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3677529898 0 0) 0x7ff2c40012c0 con 0x7ff2d412cea0 2019-11-28T11:44:52.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2d27fc700 1 -- 172.21.15.80:0/1513239217 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff2b80032e0 con 0x7ff2d412cea0 2019-11-28T11:44:52.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2d27fc700 1 -- 172.21.15.80:0/1513239217 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff2c4001870 con 0x7ff2d412cea0 2019-11-28T11:44:53.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2da636700 1 -- 172.21.15.80:0/1513239217 >> v1:172.21.15.174:6789/0 conn(0x7ff2d4111db0 legacy=0x7ff2d41238e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:53.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2da636700 1 -- 172.21.15.80:0/1513239217 >> v1:172.21.15.80:6789/0 conn(0x7ff2d412cea0 legacy=0x7ff2d41230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:53.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2da636700 1 -- 172.21.15.80:0/1513239217 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d41219a0 con 0x7ff2d4166a10 2019-11-28T11:44:53.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2da636700 1 --2- 172.21.15.80:0/1513239217 >> v2:172.21.15.174:3300/0 conn(0x7ff2d4166a10 0x7ff2d4168e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff2cc010380 tx=0x7ff2cc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2da636700 1 --2- 172.21.15.80:0/1513239217 >> v2:172.21.15.174:3300/0 conn(0x7ff2d4166a10 0x7ff2d4168e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff2cc010380 tx=0x7ff2cc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2da636700 1 --2- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4166a10 0x7ff2d4168e10 secure :-1 s=READY pgs=941 cs=0 l=1 rx=0x7ff2cc010380 tx=0x7ff2cc010720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:53.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2da636700 1 --2- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4166a10 0x7ff2d4168e10 secure :-1 s=THROTTLE_DONE pgs=941 cs=0 l=1 rx=0x7ff2cc010380 tx=0x7ff2cc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2d27fc700 1 -- 172.21.15.80:0/1513239217 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2cc000940 con 0x7ff2d4166a10 2019-11-28T11:44:53.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2da636700 1 --2- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4166a10 0x7ff2d4168e10 secure :-1 s=THROTTLE_DONE pgs=941 cs=0 l=1 rx=0x7ff2cc010380 tx=0x7ff2cc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2d27fc700 1 -- 172.21.15.80:0/1513239217 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc001470 con 0x7ff2d4166a10 2019-11-28T11:44:53.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2da636700 1 --2- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4166a10 0x7ff2d4168e10 secure :-1 s=THROTTLE_DONE pgs=941 cs=0 l=1 rx=0x7ff2cc010380 tx=0x7ff2cc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2db898700 1 -- 172.21.15.80:0/1513239217 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d4121d20 con 0x7ff2d4166a10 2019-11-28T11:44:53.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2d27fc700 1 -- 172.21.15.80:0/1513239217 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2cc001660 con 0x7ff2d4166a10 2019-11-28T11:44:53.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.931+0000 7ff2db898700 1 -- 172.21.15.80:0/1513239217 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d41219a0 con 0x7ff2d4166a10 2019-11-28T11:44:53.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.932+0000 7ff2da636700 1 --2- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4166a10 0x7ff2d4168e10 secure :-1 s=THROTTLE_DONE pgs=941 cs=0 l=1 rx=0x7ff2cc010380 tx=0x7ff2cc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.932+0000 7ff2d27fc700 1 -- 172.21.15.80:0/1513239217 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff2cc001010 con 0x7ff2d4166a10 2019-11-28T11:44:53.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.932+0000 7ff2da636700 1 --2- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4166a10 0x7ff2d4168e10 secure :-1 s=THROTTLE_DONE pgs=941 cs=0 l=1 rx=0x7ff2cc010380 tx=0x7ff2cc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.932+0000 7ff2d27fc700 1 --2- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2b8018770 0x7ff2b801ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:53.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.932+0000 7ff2d27fc700 1 -- 172.21.15.80:0/1513239217 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6149+0+0 (secure 0 0 0) 0x7ff2cc031d20 con 0x7ff2d4166a10 2019-11-28T11:44:53.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.932+0000 7ff2d9e35700 1 --2- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2b8018770 0x7ff2b801ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:53.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.932+0000 7ff2d9e35700 1 --2- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2b8018770 0x7ff2b801ac00 crc :-1 s=READY pgs=657 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:53.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.940+0000 7ff2db898700 1 -- 172.21.15.80:0/1513239217 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d4121d20 con 0x7ff2d4166a10 2019-11-28T11:44:53.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.944+0000 7ff2da636700 1 --2- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4166a10 0x7ff2d4168e10 secure :-1 s=THROTTLE_DONE pgs=941 cs=0 l=1 rx=0x7ff2cc010380 tx=0x7ff2cc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:52.944+0000 7ff2d27fc700 1 -- 172.21.15.80:0/1513239217 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff2cc001b70 con 0x7ff2d4166a10 2019-11-28T11:44:53.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.120+0000 7ff2db898700 1 -- 172.21.15.80:0/1513239217 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff2d41219a0 con 0x7ff2d4166a10 2019-11-28T11:44:53.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.122+0000 7ff2da636700 1 --2- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4166a10 0x7ff2d4168e10 secure :-1 s=THROTTLE_DONE pgs=941 cs=0 l=1 rx=0x7ff2cc010380 tx=0x7ff2cc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.122+0000 7ff2d27fc700 1 -- 172.21.15.80:0/1513239217 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v121) v1 ==== 81+0+31849 (secure 0 0 0) 0x7ff2cc001470 con 0x7ff2d4166a10 2019-11-28T11:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:44:53.163 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:44:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 121, 2019-11-28T11:44:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:44:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:44:53.164 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:44:51.820246+0000", 2019-11-28T11:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:44:53.165 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:44:53.166 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:44:53.167 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:44:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:44:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:44:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:44:53.168 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 19, 2019-11-28T11:44:53.169 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.175 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:44:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:44:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:44:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:44:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:44:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:44:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:44:53.176 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:44:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:44:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:44:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:44:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:44:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:44:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:44:53.177 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:44:53.178 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:44:53.179 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:44:53.180 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:44:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:44:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:44:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:44:53.181 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:44:53.182 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:44:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:44:53.183 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:44:53.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:44:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:44:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:44:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:44:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:44:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:44:53.185 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:44:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:44:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:44:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:44:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:44:53.186 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:44:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:44:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:44:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 18, 2019-11-28T11:44:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:44:53.187 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:41:23.623555+0000", 2019-11-28T11:44:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:44:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:44:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:44:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:44:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:44:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:44:53.188 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:44:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:44:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:44:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:44:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:44:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:44:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:44:53.189 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:44:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:44:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:44:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:44:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:44:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:44:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:44:53.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "116", 2019-11-28T11:44:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:44:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:44:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:44:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:44:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:44:53.191 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:44:53.192 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:44:53.192 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:44:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:44:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:44:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:44:53.193 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:44:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:44:53.194 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:44:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:44:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:44:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:44:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:44:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:44:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:44:53.195 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:44:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:44:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:44:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:44:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:44:53.196 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:44:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:44:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:44:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:44:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:44:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:44:53.197 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:44:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:44:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:44:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:44:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:44:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:44:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:44:53.198 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:44:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:44:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:44:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:44:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:44:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:44:53.199 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 19, 2019-11-28T11:44:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:44:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:41:24.315901+0000", 2019-11-28T11:44:53.200 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:44:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:44:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:44:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:44:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:44:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:44:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:44:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:44:53.201 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:44:53.202 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:44:53.202 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:44:53.202 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:44:53.202 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:44:53.203 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:44:53.203 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:44:53.203 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:44:53.203 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:44:53.203 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:44:53.203 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:44:53.204 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:44:53.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.205 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "117", 2019-11-28T11:44:53.205 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:44:53.205 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:44:53.205 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:44:53.205 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:44:53.206 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:44:53.206 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:44:53.206 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:44:53.206 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:44:53.206 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:44:53.207 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:44:53.207 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:44:53.207 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:44:53.207 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:44:53.207 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:44:53.207 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:44:53.207 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:44:53.208 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:44:53.208 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:44:53.208 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:44:53.208 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:44:53.208 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:44:53.208 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:44:53.208 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:44:53.209 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:44:53.209 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:44:53.209 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:44:53.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.209 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:44:53.209 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:44:53.209 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:44:53.210 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:44:53.210 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:44:53.210 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:44:53.210 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:44:53.210 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:44:53.210 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:44:53.210 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:44:53.211 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:44:53.211 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:44:53.211 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:44:53.211 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:44:53.211 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:44:53.211 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.211 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.212 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.212 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:44:53.212 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:44:53.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.212 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:44:53.212 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:44:53.212 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:44:53.212 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:44:53.213 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:44:53.213 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:44:53.214 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:44:53.214 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:44:53.214 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:44:53.214 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 114, 2019-11-28T11:44:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:44:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:44:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:44:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:44:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:44:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:44:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:44:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:44:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:44:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:44:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:44:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:44:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:44:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:44:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:44:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:44:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:44:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:44:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:44:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:44:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:44:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:44:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:44:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:44:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:44:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:44:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:44:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:44:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:44:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:44:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:44:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:44:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:44:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:44:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:44:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:44:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:44:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:44:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 115, 2019-11-28T11:44:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:44:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:44:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:44:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:44:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:44:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:44:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:44:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:44:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:44:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:44:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:44:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:44:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:44:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:44:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:44:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:44:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:44:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:44:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:44:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:44:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:44:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:44:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:44:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:44:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:44:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:44:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:44:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:44:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:44:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:44:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:44:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:44:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:44:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:44:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:44:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:44:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:44:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:44:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 115, 2019-11-28T11:44:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:44:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:44:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:44:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:44:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:44:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:44:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:44:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:44:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:44:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:44:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:44:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:44:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:44:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:44:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:44:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:44:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:44:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:44:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:44:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:44:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:44:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:44:53.252 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.252 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.252 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:44:53.252 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:44:53.252 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:44:53.252 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:44:53.253 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:44:53.253 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:44:53.253 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:44:53.253 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.253 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:44:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:44:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:44:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:44:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:44:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:44:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:44:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:44:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:44:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 115, 2019-11-28T11:44:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:44:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:44:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:44:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:44:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:44:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:44:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:44:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:44:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:44:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:44:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:44:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:44:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:44:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:44:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:44:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:44:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:44:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:44:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:44:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:44:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:44:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:44:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:44:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:44:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:44:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:44:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:44:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:44:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:44:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:44:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:44:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:44:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:44:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:44:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:44:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:44:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:44:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:44:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 115, 2019-11-28T11:44:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:44:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:44:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:44:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:44:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:44:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:44:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:44:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.274 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:44:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:44:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:44:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:44:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:44:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:44:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:44:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:44:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:44:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:44:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:44:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:44:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:44:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:44:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:44:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:44:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:44:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:44:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:44:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:44:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:44:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:44:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:44:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:44:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:44:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:44:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:44:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:44:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:44:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:44:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:44:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 115, 2019-11-28T11:44:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:44:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:44:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:44:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:44:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:44:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:44:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:44:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:44:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:44:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:44:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:44:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:44:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:44:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:44:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:44:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:44:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:44:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:44:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:44:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:44:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:44:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:44:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:44:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:44:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:44:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:44:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:44:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:44:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:44:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:44:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:44:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:44:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:44:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:44:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:44:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:44:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:44:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:44:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 105, 2019-11-28T11:44:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:44:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:44:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:44:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:44:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:44:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:44:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:44:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:44:53.298 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.298 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:44:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:44:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:44:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:44:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:44:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:44:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:44:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:44:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:44:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:44:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:44:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:44:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:44:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:44:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:44:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:44:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:44:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:44:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:44:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:44:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:44:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:44:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:44:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:44:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:44:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:44:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:44:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:44:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:44:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:44:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 115, 2019-11-28T11:44:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:44:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:44:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:44:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:44:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:44:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:44:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:44:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:44:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:44:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:44:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:44:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:44:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:44:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:44:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:44:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:44:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:44:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:44:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:44:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:44:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:44:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:44:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:44:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:44:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:44:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:44:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:44:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:44:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:44:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:44:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:44:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:44:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:44:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:44:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:44:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:44:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:44:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:44:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:44:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:44:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:44:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:44:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:44:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:44:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:44:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:44:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:44:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:44:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:44:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:44:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:44:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:44:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:44:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:44:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:44:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:44:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:44:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:44:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:44:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:44:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:44:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:44:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:44:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:44:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:44:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:44:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:44:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:44:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:44:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:44:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:44:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:44:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:44:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:44:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:44:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:44:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:44:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:44:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:44:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:44:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:44:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:44:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.327 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:44:53.327 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:44:53.327 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:44:53.327 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:44:53.327 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:44:53.327 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:44:53.328 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:44:53.328 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:44:53.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:53.328 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:44:53.331 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:44:53.332 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:44:53.332 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:44:53.332 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:44:53.332 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:44:53.332 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:44:53.332 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:44:53.333 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.333 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:44:53.333 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:44:53.333 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:44:53.333 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:44:53.333 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:44:53.333 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:44:53.333 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/2489382286": "2019-11-29T11:44:51.807379+0000", 2019-11-28T11:44:53.334 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/2489382286": "2019-11-29T11:44:51.807379+0000", 2019-11-28T11:44:53.334 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.76:0/3038579724": "2019-11-28T12:41:52.640330+0000" 2019-11-28T11:44:53.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.334 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:44:53.334 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:44:53.334 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:44:53.334 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:44:53.335 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:44:53.335 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:44:53.335 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:44:53.335 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:44:53.335 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:44:53.335 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:44:53.335 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:44:53.336 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:44:53.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.336 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:44:53.336 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:44:53.336 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:44:53.336 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:44:53.336 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:44:53.337 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:44:53.337 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:44:53.337 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:53.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:53.337 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:44:53.337 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:44:53.337 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:44:53.338 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:44:53.338 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:44:53.338 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:44:53.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.125+0000 7ff2db898700 1 -- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2b8018770 msgr2=0x7ff2b801ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:53.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.125+0000 7ff2db898700 1 --2- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2b8018770 0x7ff2b801ac00 crc :-1 s=READY pgs=657 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:53.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.125+0000 7ff2db898700 1 -- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4166a10 msgr2=0x7ff2d4168e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:53.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.125+0000 7ff2db898700 1 --2- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4166a10 0x7ff2d4168e10 secure :-1 s=READY pgs=941 cs=0 l=1 rx=0x7ff2cc010380 tx=0x7ff2cc010720).stop 2019-11-28T11:44:53.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.125+0000 7ff2db898700 1 -- 172.21.15.80:0/1513239217 shutdown_connections 2019-11-28T11:44:53.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.125+0000 7ff2db898700 1 --2- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4166a10 0x7ff2d4168e10 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:53.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.125+0000 7ff2db898700 1 --2- 172.21.15.80:0/1513239217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff2b8018770 0x7ff2b801ac00 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:53.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.125+0000 7ff2db898700 1 -- 172.21.15.80:0/1513239217 shutdown_connections 2019-11-28T11:44:53.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.125+0000 7ff2db898700 1 -- 172.21.15.80:0/1513239217 wait complete. 2019-11-28T11:44:53.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.125+0000 7ff2db898700 1 -- 172.21.15.80:0/1513239217 >> 172.21.15.80:0/1513239217 conn(0x7ff2d41426c0 msgr2=0x7ff2d4110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:53.341 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:44:53.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.421+0000 7fc93464b700 1 Processor -- start 2019-11-28T11:44:53.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.421+0000 7fc93464b700 1 -- start start 2019-11-28T11:44:53.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.422+0000 7fc93464b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc92c06c0a0 0x7fc92c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:53.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.422+0000 7fc93464b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc92c0734e0 0x7fc92c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:53.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.422+0000 7fc93464b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92c06db00 con 0x7fc92c072360 2019-11-28T11:44:53.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.422+0000 7fc93464b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92c06fd60 con 0x7fc92c06c0a0 2019-11-28T11:44:53.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.422+0000 7fc93464b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92c070030 con 0x7fc92c0734e0 2019-11-28T11:44:53.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.422+0000 7fc932be8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc92c06c0a0 0x7fc92c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:53.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.422+0000 7fc932be8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc92c06c0a0 0x7fc92c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39656/0 (socket says 172.21.15.80:39656) 2019-11-28T11:44:53.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.422+0000 7fc932be8700 1 -- 172.21.15.80:0/3219003614 learned_addr learned my addr 172.21.15.80:0/3219003614 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:53.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.422+0000 7fc9323e7700 1 --2- 172.21.15.80:0/3219003614 >> v2:172.21.15.174:3300/0 conn(0x7fc92c0734e0 0x7fc92c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:53.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.422+0000 7fc932be8700 1 -- 172.21.15.80:0/3219003614 >> v2:172.21.15.174:3300/0 conn(0x7fc92c0734e0 msgr2=0x7fc92c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:53.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.422+0000 7fc932be8700 1 --2- 172.21.15.80:0/3219003614 >> v2:172.21.15.174:3300/0 conn(0x7fc92c0734e0 0x7fc92c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:53.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.422+0000 7fc932be8700 1 -- 172.21.15.80:0/3219003614 >> v1:172.21.15.174:6789/0 conn(0x7fc92c072360 legacy=0x7fc92c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:53.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.422+0000 7fc932be8700 1 -- 172.21.15.80:0/3219003614 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c0706c0 con 0x7fc92c06c0a0 2019-11-28T11:44:53.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.423+0000 7fc932be8700 1 --2- 172.21.15.80:0/3219003614 >> v2:172.21.15.80:3300/0 conn(0x7fc92c06c0a0 0x7fc92c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc91400f740 tx=0x7fc91400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.423+0000 7fc932be8700 1 --2- 172.21.15.80:0/3219003614 >> v2:172.21.15.80:3300/0 conn(0x7fc92c06c0a0 0x7fc92c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc91400f740 tx=0x7fc91400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.423+0000 7fc932be8700 1 --2- 172.21.15.80:0/3219003614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c06c0a0 0x7fc92c072fa0 secure :-1 s=READY pgs=1624 cs=0 l=1 rx=0x7fc91400f740 tx=0x7fc91400f570).ready entity=mon.0 client_cookie=803104fd23bb372b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:53.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.423+0000 7fc932be8700 1 --2- 172.21.15.80:0/3219003614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c06c0a0 0x7fc92c072fa0 secure :-1 s=THROTTLE_DONE pgs=1624 cs=0 l=1 rx=0x7fc91400f740 tx=0x7fc91400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.423+0000 7fc932be8700 1 --2- 172.21.15.80:0/3219003614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c06c0a0 0x7fc92c072fa0 secure :-1 s=THROTTLE_DONE pgs=1624 cs=0 l=1 rx=0x7fc91400f740 tx=0x7fc91400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.423+0000 7fc931be6700 1 -- 172.21.15.80:0/3219003614 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc914000960 con 0x7fc92c06c0a0 2019-11-28T11:44:53.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.423+0000 7fc932be8700 1 --2- 172.21.15.80:0/3219003614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c06c0a0 0x7fc92c072fa0 secure :-1 s=THROTTLE_DONE pgs=1624 cs=0 l=1 rx=0x7fc91400f740 tx=0x7fc91400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.423+0000 7fc931be6700 1 -- 172.21.15.80:0/3219003614 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc914000c90 con 0x7fc92c06c0a0 2019-11-28T11:44:53.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.423+0000 7fc931be6700 1 -- 172.21.15.80:0/3219003614 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9140013a0 con 0x7fc92c06c0a0 2019-11-28T11:44:53.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.423+0000 7fc93464b700 1 -- 172.21.15.80:0/3219003614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c06c0a0 msgr2=0x7fc92c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:53.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.423+0000 7fc93464b700 1 --2- 172.21.15.80:0/3219003614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c06c0a0 0x7fc92c072fa0 secure :-1 s=READY pgs=1624 cs=0 l=1 rx=0x7fc91400f740 tx=0x7fc91400f570).stop 2019-11-28T11:44:53.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.424+0000 7fc93464b700 1 -- 172.21.15.80:0/3219003614 shutdown_connections 2019-11-28T11:44:53.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.424+0000 7fc93464b700 1 --2- 172.21.15.80:0/3219003614 >> v2:172.21.15.174:3300/0 conn(0x7fc92c0734e0 0x7fc92c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:53.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.424+0000 7fc93464b700 1 --2- 172.21.15.80:0/3219003614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c06c0a0 0x7fc92c072fa0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:53.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.424+0000 7fc93464b700 1 -- 172.21.15.80:0/3219003614 shutdown_connections 2019-11-28T11:44:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.424+0000 7fc93464b700 1 -- 172.21.15.80:0/3219003614 wait complete. 2019-11-28T11:44:53.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.424+0000 7fc93464b700 1 -- 172.21.15.80:0/3219003614 >> 172.21.15.80:0/3219003614 conn(0x7fc92c061cf0 msgr2=0x7fc92c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:53.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.426+0000 7fc93464b700 1 Processor -- start 2019-11-28T11:44:53.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.426+0000 7fc93464b700 1 -- start start 2019-11-28T11:44:53.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.427+0000 7fc93464b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc92c10adf0 0x7fc92c1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:53.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.427+0000 7fc93464b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc92c1597f0 0x7fc92c075a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:53.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.427+0000 7fc93464b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92c1141d0 con 0x7fc92c075f40 2019-11-28T11:44:53.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.427+0000 7fc93464b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92c073960 con 0x7fc92c10adf0 2019-11-28T11:44:53.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.427+0000 7fc93464b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c073c30 con 0x7fc92c1597f0 2019-11-28T11:44:53.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.427+0000 7fc932be8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc92c10adf0 0x7fc92c1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:53.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.427+0000 7fc932be8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc92c10adf0 0x7fc92c1592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39662/0 (socket says 172.21.15.80:39662) 2019-11-28T11:44:53.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.427+0000 7fc9333e9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc92c075f40 0x7fc92c12a9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38982/0 (socket says 172.21.15.80:38982) 2019-11-28T11:44:53.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.427+0000 7fc932be8700 1 -- 172.21.15.80:0/1319004038 learned_addr learned my addr 172.21.15.80:0/1319004038 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:53.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.427+0000 7fc9323e7700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc92c1597f0 0x7fc92c075a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:53.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc932be8700 1 -- 172.21.15.80:0/1319004038 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc92c1597f0 msgr2=0x7fc92c075a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:53.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc932be8700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc92c1597f0 0x7fc92c075a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:53.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc932be8700 1 -- 172.21.15.80:0/1319004038 >> v1:172.21.15.80:6789/0 conn(0x7fc92c075f40 legacy=0x7fc92c12a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:53.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc932be8700 1 -- 172.21.15.80:0/1319004038 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c0742c0 con 0x7fc92c10adf0 2019-11-28T11:44:53.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc92b7fe700 1 -- 172.21.15.80:0/1319004038 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889356615 0 0) 0x7fc924000b50 con 0x7fc92c075f40 2019-11-28T11:44:53.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc932be8700 1 --2- 172.21.15.80:0/1319004038 >> v2:172.21.15.80:3300/0 conn(0x7fc92c10adf0 0x7fc92c1592b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc914010440 tx=0x7fc914010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc932be8700 1 --2- 172.21.15.80:0/1319004038 >> v2:172.21.15.80:3300/0 conn(0x7fc92c10adf0 0x7fc92c1592b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc914010440 tx=0x7fc914010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc932be8700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c10adf0 0x7fc92c1592b0 secure :-1 s=READY pgs=1626 cs=0 l=1 rx=0x7fc914010440 tx=0x7fc914010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:53.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc932be8700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c10adf0 0x7fc92c1592b0 secure :-1 s=THROTTLE_DONE pgs=1626 cs=0 l=1 rx=0x7fc914010440 tx=0x7fc914010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc92b7fe700 1 -- 172.21.15.80:0/1319004038 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc914000d40 con 0x7fc92c10adf0 2019-11-28T11:44:53.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc932be8700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c10adf0 0x7fc92c1592b0 secure :-1 s=THROTTLE_DONE pgs=1626 cs=0 l=1 rx=0x7fc914010440 tx=0x7fc914010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc932be8700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c10adf0 0x7fc92c1592b0 secure :-1 s=THROTTLE_DONE pgs=1626 cs=0 l=1 rx=0x7fc914010440 tx=0x7fc914010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc92b7fe700 1 -- 172.21.15.80:0/1319004038 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc914007d70 con 0x7fc92c10adf0 2019-11-28T11:44:53.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc93464b700 1 -- 172.21.15.80:0/1319004038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92c074640 con 0x7fc92c10adf0 2019-11-28T11:44:53.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc92b7fe700 1 -- 172.21.15.80:0/1319004038 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc914000b50 con 0x7fc92c10adf0 2019-11-28T11:44:53.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc93464b700 1 -- 172.21.15.80:0/1319004038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92c0742c0 con 0x7fc92c10adf0 2019-11-28T11:44:53.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc932be8700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c10adf0 0x7fc92c1592b0 secure :-1 s=THROTTLE_DONE pgs=1626 cs=0 l=1 rx=0x7fc914010440 tx=0x7fc914010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc92b7fe700 1 -- 172.21.15.80:0/1319004038 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc914000bf0 con 0x7fc92c10adf0 2019-11-28T11:44:53.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.428+0000 7fc932be8700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c10adf0 0x7fc92c1592b0 secure :-1 s=THROTTLE_DONE pgs=1626 cs=0 l=1 rx=0x7fc914010440 tx=0x7fc914010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.429+0000 7fc92b7fe700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc910018730 0x7fc91001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:53.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.429+0000 7fc92b7fe700 1 -- 172.21.15.80:0/1319004038 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fc914031b20 con 0x7fc92c10adf0 2019-11-28T11:44:53.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.429+0000 7fc9323e7700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc910018730 0x7fc91001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:53.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.429+0000 7fc9323e7700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc910018730 0x7fc91001abc0 crc :-1 s=READY pgs=658 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:53.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.436+0000 7fc93464b700 1 -- 172.21.15.80:0/1319004038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92c074640 con 0x7fc92c10adf0 2019-11-28T11:44:53.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.440+0000 7fc932be8700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c10adf0 0x7fc92c1592b0 secure :-1 s=THROTTLE_DONE pgs=1626 cs=0 l=1 rx=0x7fc914010440 tx=0x7fc914010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.440+0000 7fc92b7fe700 1 -- 172.21.15.80:0/1319004038 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc914000940 con 0x7fc92c10adf0 2019-11-28T11:44:53.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.613+0000 7fc93464b700 1 -- 172.21.15.80:0/1319004038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc92c0742c0 con 0x7fc92c10adf0 2019-11-28T11:44:53.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.613+0000 7fc932be8700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c10adf0 0x7fc92c1592b0 secure :-1 s=THROTTLE_DONE pgs=1626 cs=0 l=1 rx=0x7fc914010440 tx=0x7fc914010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.613+0000 7fc92b7fe700 1 -- 172.21.15.80:0/1319004038 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+1428 (secure 0 0 0) 0x7fc914007d70 con 0x7fc92c10adf0 2019-11-28T11:44:53.654 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:44:53.654 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":85,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:25.297182+0000","modified":"2019-11-28T11:44:52.695375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2019-11-28T11:44:53.654 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 85 2019-11-28T11:44:53.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.616+0000 7fc93464b700 1 -- 172.21.15.80:0/1319004038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc910018730 msgr2=0x7fc91001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:53.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.616+0000 7fc93464b700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc910018730 0x7fc91001abc0 crc :-1 s=READY pgs=658 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:53.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.616+0000 7fc93464b700 1 -- 172.21.15.80:0/1319004038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c10adf0 msgr2=0x7fc92c1592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:53.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.616+0000 7fc93464b700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c10adf0 0x7fc92c1592b0 secure :-1 s=READY pgs=1626 cs=0 l=1 rx=0x7fc914010440 tx=0x7fc914010270).stop 2019-11-28T11:44:53.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.616+0000 7fc93464b700 1 -- 172.21.15.80:0/1319004038 shutdown_connections 2019-11-28T11:44:53.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.616+0000 7fc93464b700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc910018730 0x7fc91001abc0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:53.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.616+0000 7fc93464b700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc92c1597f0 0x7fc92c075a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:53.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.616+0000 7fc93464b700 1 --2- 172.21.15.80:0/1319004038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc92c10adf0 0x7fc92c1592b0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:53.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.616+0000 7fc93464b700 1 -- 172.21.15.80:0/1319004038 shutdown_connections 2019-11-28T11:44:53.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.616+0000 7fc93464b700 1 -- 172.21.15.80:0/1319004038 wait complete. 2019-11-28T11:44:53.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.616+0000 7fc93464b700 1 -- 172.21.15.80:0/1319004038 >> 172.21.15.80:0/1319004038 conn(0x7fc92c13d930 msgr2=0x7fc92c111550 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:53.666 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:44:53.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.750+0000 7f91e3bc9700 1 Processor -- start 2019-11-28T11:44:53.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.750+0000 7f91e3bc9700 1 -- start start 2019-11-28T11:44:53.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.751+0000 7f91e3bc9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91dc06c0a0 0x7f91dc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:53.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.751+0000 7f91e3bc9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f91dc072620 0x7f91dc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:53.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.751+0000 7f91e3bc9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91dc06db00 con 0x7f91dc0734e0 2019-11-28T11:44:53.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.751+0000 7f91e3bc9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc06fd60 con 0x7f91dc06c0a0 2019-11-28T11:44:53.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.751+0000 7f91e3bc9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc070030 con 0x7f91dc072620 2019-11-28T11:44:53.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.751+0000 7f91e2166700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91dc06c0a0 0x7f91dc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:53.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.751+0000 7f91e2166700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91dc06c0a0 0x7f91dc072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39670/0 (socket says 172.21.15.80:39670) 2019-11-28T11:44:53.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.751+0000 7f91e2166700 1 -- 172.21.15.80:0/1903504182 learned_addr learned my addr 172.21.15.80:0/1903504182 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:53.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.751+0000 7f91e2967700 1 --2- 172.21.15.80:0/1903504182 >> v2:172.21.15.174:3300/0 conn(0x7f91dc072620 0x7f91dc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:53.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.751+0000 7f91e2166700 1 -- 172.21.15.80:0/1903504182 >> v2:172.21.15.174:3300/0 conn(0x7f91dc072620 msgr2=0x7f91dc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:53.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.751+0000 7f91e2166700 1 --2- 172.21.15.80:0/1903504182 >> v2:172.21.15.174:3300/0 conn(0x7f91dc072620 0x7f91dc164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:53.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.751+0000 7f91e2166700 1 -- 172.21.15.80:0/1903504182 >> v1:172.21.15.174:6789/0 conn(0x7f91dc0734e0 legacy=0x7f91dc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:53.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.752+0000 7f91e2166700 1 -- 172.21.15.80:0/1903504182 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc0706c0 con 0x7f91dc06c0a0 2019-11-28T11:44:53.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.752+0000 7f91e2166700 1 --2- 172.21.15.80:0/1903504182 >> v2:172.21.15.80:3300/0 conn(0x7f91dc06c0a0 0x7f91dc072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f91d000f6c0 tx=0x7f91d000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.752+0000 7f91e2166700 1 --2- 172.21.15.80:0/1903504182 >> v2:172.21.15.80:3300/0 conn(0x7f91dc06c0a0 0x7f91dc072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f91d000f6c0 tx=0x7f91d000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.752+0000 7f91e2166700 1 --2- 172.21.15.80:0/1903504182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc06c0a0 0x7f91dc072fa0 secure :-1 s=READY pgs=1627 cs=0 l=1 rx=0x7f91d000f6c0 tx=0x7f91d000fa60).ready entity=mon.0 client_cookie=44419b4d4d7097de server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:53.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.752+0000 7f91e2166700 1 --2- 172.21.15.80:0/1903504182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc06c0a0 0x7f91dc072fa0 secure :-1 s=THROTTLE_DONE pgs=1627 cs=0 l=1 rx=0x7f91d000f6c0 tx=0x7f91d000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.752+0000 7f91e2166700 1 --2- 172.21.15.80:0/1903504182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc06c0a0 0x7f91dc072fa0 secure :-1 s=THROTTLE_DONE pgs=1627 cs=0 l=1 rx=0x7f91d000f6c0 tx=0x7f91d000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.752+0000 7f91e2166700 1 --2- 172.21.15.80:0/1903504182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc06c0a0 0x7f91dc072fa0 secure :-1 s=THROTTLE_DONE pgs=1627 cs=0 l=1 rx=0x7f91d000f6c0 tx=0x7f91d000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.752+0000 7f91e1164700 1 -- 172.21.15.80:0/1903504182 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91d0000960 con 0x7f91dc06c0a0 2019-11-28T11:44:53.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.752+0000 7f91e1164700 1 -- 172.21.15.80:0/1903504182 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d0000c90 con 0x7f91dc06c0a0 2019-11-28T11:44:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.752+0000 7f91e1164700 1 -- 172.21.15.80:0/1903504182 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91d00013a0 con 0x7f91dc06c0a0 2019-11-28T11:44:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.752+0000 7f91e3bc9700 1 -- 172.21.15.80:0/1903504182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc06c0a0 msgr2=0x7f91dc072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.752+0000 7f91e3bc9700 1 --2- 172.21.15.80:0/1903504182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc06c0a0 0x7f91dc072fa0 secure :-1 s=READY pgs=1627 cs=0 l=1 rx=0x7f91d000f6c0 tx=0x7f91d000fa60).stop 2019-11-28T11:44:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.753+0000 7f91e3bc9700 1 -- 172.21.15.80:0/1903504182 shutdown_connections 2019-11-28T11:44:53.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.753+0000 7f91e3bc9700 1 --2- 172.21.15.80:0/1903504182 >> v2:172.21.15.174:3300/0 conn(0x7f91dc072620 0x7f91dc164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.753+0000 7f91e3bc9700 1 --2- 172.21.15.80:0/1903504182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc06c0a0 0x7f91dc072fa0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.753+0000 7f91e3bc9700 1 -- 172.21.15.80:0/1903504182 shutdown_connections 2019-11-28T11:44:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.753+0000 7f91e3bc9700 1 -- 172.21.15.80:0/1903504182 wait complete. 2019-11-28T11:44:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.753+0000 7f91e3bc9700 1 -- 172.21.15.80:0/1903504182 >> 172.21.15.80:0/1903504182 conn(0x7f91dc061cf0 msgr2=0x7f91dc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:53.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.755+0000 7f91e3bc9700 1 Processor -- start 2019-11-28T11:44:53.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.755+0000 7f91e3bc9700 1 -- start start 2019-11-28T11:44:53.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.756+0000 7f91e3bc9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc13e5f0 0x7f91dc13e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:53.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.756+0000 7f91e3bc9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f91dc10a070 0x7f91dc10bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:53.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.756+0000 7f91e3bc9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91dc1066e0 con 0x7f91dc10a4e0 2019-11-28T11:44:53.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.756+0000 7f91e3bc9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc10d630 con 0x7f91dc10a070 2019-11-28T11:44:53.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.756+0000 7f91e3bc9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc10e060 con 0x7f91dc13e5f0 2019-11-28T11:44:53.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.756+0000 7f91e2967700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f91dc10a4e0 0x7f91dc10c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38996/0 (socket says 172.21.15.80:38996) 2019-11-28T11:44:53.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.756+0000 7f91e2967700 1 -- 172.21.15.80:0/2541868917 learned_addr learned my addr 172.21.15.80:0/2541868917 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:53.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.756+0000 7f91e2166700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc13e5f0 0x7f91dc13e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:53.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.756+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309715416 0 0) 0x7f91d4005c50 con 0x7f91dc10a4e0 2019-11-28T11:44:53.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.756+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91c4002e80 con 0x7f91dc10a4e0 2019-11-28T11:44:53.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.756+0000 7f91e1965700 1 --2- 172.21.15.80:0/2541868917 >> v2:172.21.15.174:3300/0 conn(0x7f91dc10a070 0x7f91dc10bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:53.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.756+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 43630806 0 0) 0x7f91d4005e50 con 0x7f91dc10a4e0 2019-11-28T11:44:53.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.756+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f91c40032e0 con 0x7f91dc10a4e0 2019-11-28T11:44:53.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.756+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f91d4006420 con 0x7f91dc10a4e0 2019-11-28T11:44:53.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc13e5f0 msgr2=0x7f91dc13e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:53.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91ceffd700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc13e5f0 0x7f91dc13e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:53.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 >> v2:172.21.15.174:3300/0 conn(0x7f91dc10a070 msgr2=0x7f91dc10bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:53.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91ceffd700 1 --2- 172.21.15.80:0/2541868917 >> v2:172.21.15.174:3300/0 conn(0x7f91dc10a070 0x7f91dc10bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:53.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 >> v1:172.21.15.80:6789/0 conn(0x7f91dc10a4e0 legacy=0x7f91dc10c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:53.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91ceffd700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91c4003880 0x7f91c4003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:53.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91ceffd700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91c4004210 0x7f91c40046d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:53.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91ceffd700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c4004d40 0x7f91c400b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:53.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c400bc10 con 0x7f91c4004d40 2019-11-28T11:44:53.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c400bdd0 con 0x7f91c4004210 2019-11-28T11:44:53.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c400c000 con 0x7f91c4003880 2019-11-28T11:44:53.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e2166700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc13e5f0 0x7f91dc13e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:44:53.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e2967700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c4004d40 0x7f91c400b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:53.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e1965700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91c4004210 0x7f91c40046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:53.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e2166700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91c4003880 0x7f91c4003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:53.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e2967700 1 -- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91c4003880 msgr2=0x7f91c4003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:53.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e2967700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91c4003880 0x7f91c4003cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:53.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e2967700 1 -- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91c4004210 msgr2=0x7f91c40046d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:53.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e2967700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91c4004210 0x7f91c40046d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:53.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e2967700 1 -- 172.21.15.80:0/2541868917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c400c2b0 con 0x7f91c4004d40 2019-11-28T11:44:53.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e2166700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91c4003880 0x7f91c4003cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:44:53.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e3bc9700 1 -- 172.21.15.80:0/2541868917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91dc10ed40 con 0x7f91c4004d40 2019-11-28T11:44:53.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e2967700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c4004d40 0x7f91c400b6d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f91d40107b0 tx=0x7f91d40106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e3bc9700 1 -- 172.21.15.80:0/2541868917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91dc10e9c0 con 0x7f91c4004d40 2019-11-28T11:44:53.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e2967700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c4004d40 0x7f91c400b6d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f91d40107b0 tx=0x7f91d40106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e2967700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c4004d40 0x7f91c400b6d0 secure :-1 s=READY pgs=1629 cs=0 l=1 rx=0x7f91d40107b0 tx=0x7f91d40106b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:53.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e2967700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c4004d40 0x7f91c400b6d0 secure :-1 s=THROTTLE_DONE pgs=1629 cs=0 l=1 rx=0x7f91d40107b0 tx=0x7f91d40106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91d40011f0 con 0x7f91c4004d40 2019-11-28T11:44:53.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e2967700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c4004d40 0x7f91c400b6d0 secure :-1 s=THROTTLE_DONE pgs=1629 cs=0 l=1 rx=0x7f91d40107b0 tx=0x7f91d40106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91e2967700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c4004d40 0x7f91c400b6d0 secure :-1 s=THROTTLE_DONE pgs=1629 cs=0 l=1 rx=0x7f91d40107b0 tx=0x7f91d40106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d4005760 con 0x7f91c4004d40 2019-11-28T11:44:53.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.757+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91d40017d0 con 0x7f91c4004d40 2019-11-28T11:44:53.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.758+0000 7f91e2967700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c4004d40 0x7f91c400b6d0 secure :-1 s=THROTTLE_DONE pgs=1629 cs=0 l=1 rx=0x7f91d40107b0 tx=0x7f91d40106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.758+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f91d4001000 con 0x7f91c4004d40 2019-11-28T11:44:53.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.758+0000 7f91e2967700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c4004d40 0x7f91c400b6d0 secure :-1 s=THROTTLE_DONE pgs=1629 cs=0 l=1 rx=0x7f91d40107b0 tx=0x7f91d40106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.758+0000 7f91ceffd700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91c4020ad0 0x7f91c4022f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:53.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.758+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f91d4031fd0 con 0x7f91c4004d40 2019-11-28T11:44:53.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.758+0000 7f91e2166700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91c4020ad0 0x7f91c4022f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:53.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.758+0000 7f91e2166700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91c4020ad0 0x7f91c4022f00 crc :-1 s=READY pgs=659 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:53.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.766+0000 7f91e3bc9700 1 -- 172.21.15.80:0/2541868917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91dc10ed40 con 0x7f91c4004d40 2019-11-28T11:44:53.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.770+0000 7f91e2967700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c4004d40 0x7f91c400b6d0 secure :-1 s=THROTTLE_DONE pgs=1629 cs=0 l=1 rx=0x7f91d40107b0 tx=0x7f91d40106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:53.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.770+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f91d4005760 con 0x7f91c4004d40 2019-11-28T11:44:53.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.935+0000 7f91e3bc9700 1 -- 172.21.15.80:0/2541868917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f91dc10e9c0 con 0x7f91c4004d40 2019-11-28T11:44:54.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.973+0000 7f91e2967700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c4004d40 0x7f91c400b6d0 secure :-1 s=THROTTLE_DONE pgs=1629 cs=0 l=1 rx=0x7f91d40107b0 tx=0x7f91d40106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:53.973+0000 7f91ceffd700 1 -- 172.21.15.80:0/2541868917 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v86) v1 ==== 161+0+0 (secure 0 0 0) 0x7f91d4001000 con 0x7f91c4004d40 2019-11-28T11:44:54.037 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:44:54.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.001+0000 7f91e3bc9700 1 -- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91c4020ad0 msgr2=0x7f91c4022f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:54.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.001+0000 7f91e3bc9700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91c4020ad0 0x7f91c4022f00 crc :-1 s=READY pgs=659 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:54.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.001+0000 7f91e3bc9700 1 -- 172.21.15.80:0/2541868917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c4004d40 msgr2=0x7f91c400b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:54.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.001+0000 7f91e3bc9700 1 --2- 172.21.15.80:0/2541868917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91c4004d40 0x7f91c400b6d0 secure :-1 s=READY pgs=1629 cs=0 l=1 rx=0x7f91d40107b0 tx=0x7f91d40106b0).stop 2019-11-28T11:44:54.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.001+0000 7f91e2967700 1 -- 172.21.15.80:0/2541868917 reap_dead start 2019-11-28T11:44:54.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.001+0000 7f91e2967700 1 -- 172.21.15.80:0/2541868917 reap_dead start 2019-11-28T11:44:54.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.001+0000 7f91e3bc9700 1 -- 172.21.15.80:0/2541868917 shutdown_connections 2019-11-28T11:44:54.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.001+0000 7f91e3bc9700 1 -- 172.21.15.80:0/2541868917 shutdown_connections 2019-11-28T11:44:54.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.001+0000 7f91e3bc9700 1 -- 172.21.15.80:0/2541868917 wait complete. 2019-11-28T11:44:54.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.001+0000 7f91e3bc9700 1 -- 172.21.15.80:0/2541868917 >> 172.21.15.80:0/2541868917 conn(0x7f91dc13d620 msgr2=0x7f91dc13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:54.050 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:44:54.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.130+0000 7f8e05b3d700 1 Processor -- start 2019-11-28T11:44:54.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.130+0000 7f8e05b3d700 1 -- start start 2019-11-28T11:44:54.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8e05b3d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e0006c0a0 0x7f8e00072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:54.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8e05b3d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0006db00 con 0x7f8e00072620 2019-11-28T11:44:54.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8e05b3d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0006e000 con 0x7f8e000734e0 2019-11-28T11:44:54.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8e05b3d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0006fd60 con 0x7f8e0006c0a0 2019-11-28T11:44:54.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8dfffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e0006c0a0 0x7f8e00072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:54.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8e048db700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8e00072620 0x7f8e00164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39010/0 (socket says 172.21.15.80:39010) 2019-11-28T11:44:54.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8e048db700 1 -- 172.21.15.80:0/910258232 learned_addr learned my addr 172.21.15.80:0/910258232 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:54.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8dfffff700 1 -- 172.21.15.80:0/910258232 >> v1:172.21.15.174:6789/0 conn(0x7f8e000734e0 legacy=0x7f8e00071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:54.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8dfffff700 1 -- 172.21.15.80:0/910258232 >> v1:172.21.15.80:6789/0 conn(0x7f8e00072620 legacy=0x7f8e00164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:54.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8dfffff700 1 -- 172.21.15.80:0/910258232 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e000706c0 con 0x7f8e0006c0a0 2019-11-28T11:44:54.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8dff7fe700 1 -- 172.21.15.80:0/910258232 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283711792 0 0) 0x7f8df80014d0 con 0x7f8e00072620 2019-11-28T11:44:54.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8dfffff700 1 --2- 172.21.15.80:0/910258232 >> v2:172.21.15.80:3300/0 conn(0x7f8e0006c0a0 0x7f8e00072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8df000af50 tx=0x7f8df000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8dfffff700 1 --2- 172.21.15.80:0/910258232 >> v2:172.21.15.80:3300/0 conn(0x7f8e0006c0a0 0x7f8e00072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8df000af50 tx=0x7f8df000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8dfffff700 1 --2- 172.21.15.80:0/910258232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0006c0a0 0x7f8e00072fa0 secure :-1 s=READY pgs=1631 cs=0 l=1 rx=0x7f8df000af50 tx=0x7f8df000b760).ready entity=mon.0 client_cookie=ea24b41ef6cbb045 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:54.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8dfffff700 1 --2- 172.21.15.80:0/910258232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0006c0a0 0x7f8e00072fa0 secure :-1 s=THROTTLE_DONE pgs=1631 cs=0 l=1 rx=0x7f8df000af50 tx=0x7f8df000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8dff7fe700 1 -- 172.21.15.80:0/910258232 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8df0000960 con 0x7f8e0006c0a0 2019-11-28T11:44:54.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8dfffff700 1 --2- 172.21.15.80:0/910258232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0006c0a0 0x7f8e00072fa0 secure :-1 s=THROTTLE_DONE pgs=1631 cs=0 l=1 rx=0x7f8df000af50 tx=0x7f8df000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8dfffff700 1 --2- 172.21.15.80:0/910258232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0006c0a0 0x7f8e00072fa0 secure :-1 s=THROTTLE_DONE pgs=1631 cs=0 l=1 rx=0x7f8df000af50 tx=0x7f8df000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8dff7fe700 1 -- 172.21.15.80:0/910258232 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df0009860 con 0x7f8e0006c0a0 2019-11-28T11:44:54.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8dff7fe700 1 -- 172.21.15.80:0/910258232 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8df0000960 con 0x7f8e0006c0a0 2019-11-28T11:44:54.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.131+0000 7f8e05b3d700 1 -- 172.21.15.80:0/910258232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0006c0a0 msgr2=0x7f8e00072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:54.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.132+0000 7f8e05b3d700 1 --2- 172.21.15.80:0/910258232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0006c0a0 0x7f8e00072fa0 secure :-1 s=READY pgs=1631 cs=0 l=1 rx=0x7f8df000af50 tx=0x7f8df000b760).stop 2019-11-28T11:44:54.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.132+0000 7f8e05b3d700 1 -- 172.21.15.80:0/910258232 shutdown_connections 2019-11-28T11:44:54.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.132+0000 7f8e05b3d700 1 --2- 172.21.15.80:0/910258232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e0006c0a0 0x7f8e00072fa0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:54.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.132+0000 7f8e05b3d700 1 -- 172.21.15.80:0/910258232 shutdown_connections 2019-11-28T11:44:54.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.132+0000 7f8e05b3d700 1 -- 172.21.15.80:0/910258232 wait complete. 2019-11-28T11:44:54.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.132+0000 7f8e05b3d700 1 -- 172.21.15.80:0/910258232 >> 172.21.15.80:0/910258232 conn(0x7f8e00061cf0 msgr2=0x7f8e00064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:54.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.135+0000 7f8e05b3d700 1 Processor -- start 2019-11-28T11:44:54.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.135+0000 7f8e05b3d700 1 -- start start 2019-11-28T11:44:54.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.135+0000 7f8e05b3d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e001342c0 0x7f8e001346b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:54.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.135+0000 7f8e05b3d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e001361c0 0x7f8e0015c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:54.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.135+0000 7f8e05b3d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8e00136650 0x7f8e0015cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:54.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.135+0000 7f8e05b3d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e00140970 con 0x7f8e001361c0 2019-11-28T11:44:54.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.135+0000 7f8e05b3d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e00140c40 con 0x7f8e00136650 2019-11-28T11:44:54.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.135+0000 7f8e05b3d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e00140f10 con 0x7f8e001342c0 2019-11-28T11:44:54.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8df7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e001361c0 0x7f8e0015c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:54.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8df7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e001361c0 0x7f8e0015c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39698/0 (socket says 172.21.15.80:39698) 2019-11-28T11:44:54.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8df7fff700 1 -- 172.21.15.80:0/343233738 learned_addr learned my addr 172.21.15.80:0/343233738 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:54.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8e048db700 1 --2- 172.21.15.80:0/343233738 >> v2:172.21.15.174:3300/0 conn(0x7f8e00136650 0x7f8e0015cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:54.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8dfffff700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e001342c0 0x7f8e001346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:54.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8df7fff700 1 -- 172.21.15.80:0/343233738 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e001342c0 msgr2=0x7f8e001346b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:54.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8df7fff700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e001342c0 0x7f8e001346b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:54.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8df7fff700 1 -- 172.21.15.80:0/343233738 >> v2:172.21.15.174:3300/0 conn(0x7f8e00136650 msgr2=0x7f8e0015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:54.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8df7fff700 1 --2- 172.21.15.80:0/343233738 >> v2:172.21.15.174:3300/0 conn(0x7f8e00136650 0x7f8e0015cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:54.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8df7fff700 1 -- 172.21.15.80:0/343233738 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e00141fd0 con 0x7f8e001361c0 2019-11-28T11:44:54.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8df7fff700 1 --2- 172.21.15.80:0/343233738 >> v2:172.21.15.80:3300/0 conn(0x7f8e001361c0 0x7f8e0015c9a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8de8010410 tx=0x7f8de80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8df7fff700 1 --2- 172.21.15.80:0/343233738 >> v2:172.21.15.80:3300/0 conn(0x7f8e001361c0 0x7f8e0015c9a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8de8010410 tx=0x7f8de80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8df7fff700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e001361c0 0x7f8e0015c9a0 secure :-1 s=READY pgs=1632 cs=0 l=1 rx=0x7f8de8010410 tx=0x7f8de80102f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:54.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8df7fff700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e001361c0 0x7f8e0015c9a0 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f8de8010410 tx=0x7f8de80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8df7fff700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e001361c0 0x7f8e0015c9a0 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f8de8010410 tx=0x7f8de80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8dfd7fa700 1 -- 172.21.15.80:0/343233738 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8de80010a0 con 0x7f8e001361c0 2019-11-28T11:44:54.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8df7fff700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e001361c0 0x7f8e0015c9a0 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f8de8010410 tx=0x7f8de80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8dfd7fa700 1 -- 172.21.15.80:0/343233738 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de8000c10 con 0x7f8e001361c0 2019-11-28T11:44:54.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8e05b3d700 1 -- 172.21.15.80:0/343233738 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e00142350 con 0x7f8e001361c0 2019-11-28T11:44:54.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8dfd7fa700 1 -- 172.21.15.80:0/343233738 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8de8001680 con 0x7f8e001361c0 2019-11-28T11:44:54.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8e05b3d700 1 -- 172.21.15.80:0/343233738 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e00141fd0 con 0x7f8e001361c0 2019-11-28T11:44:54.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.136+0000 7f8df7fff700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e001361c0 0x7f8e0015c9a0 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f8de8010410 tx=0x7f8de80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.137+0000 7f8dfd7fa700 1 -- 172.21.15.80:0/343233738 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8de8000eb0 con 0x7f8e001361c0 2019-11-28T11:44:54.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.137+0000 7f8df7fff700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e001361c0 0x7f8e0015c9a0 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f8de8010410 tx=0x7f8de80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.137+0000 7f8dfd7fa700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8de4018730 0x7f8de401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:54.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.137+0000 7f8dfd7fa700 1 -- 172.21.15.80:0/343233738 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f8de8031a20 con 0x7f8e001361c0 2019-11-28T11:44:54.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.137+0000 7f8dfffff700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8de4018730 0x7f8de401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:54.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.137+0000 7f8dfffff700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8de4018730 0x7f8de401abc0 crc :-1 s=READY pgs=660 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:54.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.145+0000 7f8e05b3d700 1 -- 172.21.15.80:0/343233738 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e00142350 con 0x7f8e001361c0 2019-11-28T11:44:54.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.148+0000 7f8df7fff700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e001361c0 0x7f8e0015c9a0 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f8de8010410 tx=0x7f8de80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.148+0000 7f8dfd7fa700 1 -- 172.21.15.80:0/343233738 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8de802dfb0 con 0x7f8e001361c0 2019-11-28T11:44:54.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.320+0000 7f8e05b3d700 1 -- 172.21.15.80:0/343233738 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e00141fd0 con 0x7f8e001361c0 2019-11-28T11:44:54.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.320+0000 7f8df7fff700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e001361c0 0x7f8e0015c9a0 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f8de8010410 tx=0x7f8de80102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.320+0000 7f8dfd7fa700 1 -- 172.21.15.80:0/343233738 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+1428 (secure 0 0 0) 0x7f8de802dfb0 con 0x7f8e001361c0 2019-11-28T11:44:54.360 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 86 2019-11-28T11:44:54.360 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:44:54.361 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":86,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":86,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:41:25.297182+0000","modified":"2019-11-28T11:44:53.971487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2019-11-28T11:44:54.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.323+0000 7f8e05b3d700 1 -- 172.21.15.80:0/343233738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8de4018730 msgr2=0x7f8de401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:54.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.323+0000 7f8e05b3d700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8de4018730 0x7f8de401abc0 crc :-1 s=READY pgs=660 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:54.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.323+0000 7f8e05b3d700 1 -- 172.21.15.80:0/343233738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e001361c0 msgr2=0x7f8e0015c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:54.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.323+0000 7f8e05b3d700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e001361c0 0x7f8e0015c9a0 secure :-1 s=READY pgs=1632 cs=0 l=1 rx=0x7f8de8010410 tx=0x7f8de80102f0).stop 2019-11-28T11:44:54.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.323+0000 7f8e05b3d700 1 -- 172.21.15.80:0/343233738 shutdown_connections 2019-11-28T11:44:54.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.323+0000 7f8e05b3d700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8de4018730 0x7f8de401abc0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:54.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.323+0000 7f8e05b3d700 1 --2- 172.21.15.80:0/343233738 >> v2:172.21.15.174:3300/0 conn(0x7f8e00136650 0x7f8e0015cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:54.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.323+0000 7f8e05b3d700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e001361c0 0x7f8e0015c9a0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:54.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.323+0000 7f8e05b3d700 1 --2- 172.21.15.80:0/343233738 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e001342c0 0x7f8e001346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:54.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.323+0000 7f8e05b3d700 1 -- 172.21.15.80:0/343233738 shutdown_connections 2019-11-28T11:44:54.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.323+0000 7f8e05b3d700 1 -- 172.21.15.80:0/343233738 wait complete. 2019-11-28T11:44:54.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.323+0000 7f8e05b3d700 1 -- 172.21.15.80:0/343233738 >> 172.21.15.80:0/343233738 conn(0x7f8e00159ae0 msgr2=0x7f8e0013d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:54.372 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:44:54.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.458+0000 7f28fcfe6700 1 Processor -- start 2019-11-28T11:44:54.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.458+0000 7f28fcfe6700 1 -- start start 2019-11-28T11:44:54.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28fcfe6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28f806c0a0 0x7f28f8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:54.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28fcfe6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f28f80734e0 0x7f28f8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:54.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28fcfe6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f806db00 con 0x7f28f8072360 2019-11-28T11:44:54.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28fcfe6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f806fd60 con 0x7f28f806c0a0 2019-11-28T11:44:54.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28fcfe6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f8070030 con 0x7f28f80734e0 2019-11-28T11:44:54.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28f6d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28f806c0a0 0x7f28f8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:54.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28f6d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28f806c0a0 0x7f28f8072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39704/0 (socket says 172.21.15.80:39704) 2019-11-28T11:44:54.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28f6d9d700 1 -- 172.21.15.80:0/3790345797 learned_addr learned my addr 172.21.15.80:0/3790345797 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:54.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28f659c700 1 --2- 172.21.15.80:0/3790345797 >> v2:172.21.15.174:3300/0 conn(0x7f28f80734e0 0x7f28f8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:54.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28f6d9d700 1 -- 172.21.15.80:0/3790345797 >> v2:172.21.15.174:3300/0 conn(0x7f28f80734e0 msgr2=0x7f28f8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:54.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3790345797 >> v2:172.21.15.174:3300/0 conn(0x7f28f80734e0 0x7f28f8071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:54.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28f6d9d700 1 -- 172.21.15.80:0/3790345797 >> v1:172.21.15.174:6789/0 conn(0x7f28f8072360 legacy=0x7f28f806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:54.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28f6d9d700 1 -- 172.21.15.80:0/3790345797 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f80706c0 con 0x7f28f806c0a0 2019-11-28T11:44:54.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28f659c700 1 --2- 172.21.15.80:0/3790345797 >> v2:172.21.15.174:3300/0 conn(0x7f28f80734e0 0x7f28f8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:44:54.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3790345797 >> v2:172.21.15.80:3300/0 conn(0x7f28f806c0a0 0x7f28f8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f28e800f740 tx=0x7f28e800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3790345797 >> v2:172.21.15.80:3300/0 conn(0x7f28f806c0a0 0x7f28f8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f28e800f740 tx=0x7f28e800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.459+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3790345797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28f806c0a0 0x7f28f8072fa0 secure :-1 s=READY pgs=1633 cs=0 l=1 rx=0x7f28e800f740 tx=0x7f28e800fae0).ready entity=mon.0 client_cookie=f69079bbb4123365 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:54.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.460+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3790345797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28f806c0a0 0x7f28f8072fa0 secure :-1 s=THROTTLE_DONE pgs=1633 cs=0 l=1 rx=0x7f28e800f740 tx=0x7f28e800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.460+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3790345797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28f806c0a0 0x7f28f8072fa0 secure :-1 s=THROTTLE_DONE pgs=1633 cs=0 l=1 rx=0x7f28e800f740 tx=0x7f28e800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.460+0000 7f28f5d9b700 1 -- 172.21.15.80:0/3790345797 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28e8000960 con 0x7f28f806c0a0 2019-11-28T11:44:54.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.460+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3790345797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28f806c0a0 0x7f28f8072fa0 secure :-1 s=THROTTLE_DONE pgs=1633 cs=0 l=1 rx=0x7f28e800f740 tx=0x7f28e800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.460+0000 7f28f5d9b700 1 -- 172.21.15.80:0/3790345797 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e8000c90 con 0x7f28f806c0a0 2019-11-28T11:44:54.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.460+0000 7f28f5d9b700 1 -- 172.21.15.80:0/3790345797 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28e80013a0 con 0x7f28f806c0a0 2019-11-28T11:44:54.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.460+0000 7f28fcfe6700 1 -- 172.21.15.80:0/3790345797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28f806c0a0 msgr2=0x7f28f8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:54.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.460+0000 7f28fcfe6700 1 --2- 172.21.15.80:0/3790345797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28f806c0a0 0x7f28f8072fa0 secure :-1 s=READY pgs=1633 cs=0 l=1 rx=0x7f28e800f740 tx=0x7f28e800fae0).stop 2019-11-28T11:44:54.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.460+0000 7f28fcfe6700 1 -- 172.21.15.80:0/3790345797 shutdown_connections 2019-11-28T11:44:54.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.460+0000 7f28fcfe6700 1 --2- 172.21.15.80:0/3790345797 >> v2:172.21.15.174:3300/0 conn(0x7f28f80734e0 0x7f28f8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:54.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.460+0000 7f28fcfe6700 1 --2- 172.21.15.80:0/3790345797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28f806c0a0 0x7f28f8072fa0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:54.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.460+0000 7f28fcfe6700 1 -- 172.21.15.80:0/3790345797 shutdown_connections 2019-11-28T11:44:54.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.461+0000 7f28fcfe6700 1 -- 172.21.15.80:0/3790345797 wait complete. 2019-11-28T11:44:54.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.461+0000 7f28fcfe6700 1 -- 172.21.15.80:0/3790345797 >> 172.21.15.80:0/3790345797 conn(0x7f28f8061cf0 msgr2=0x7f28f8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:54.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.463+0000 7f28fcfe6700 1 Processor -- start 2019-11-28T11:44:54.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.463+0000 7f28fcfe6700 1 -- start start 2019-11-28T11:44:54.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.464+0000 7f28fcfe6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28f8104820 0x7f28f810c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:54.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.464+0000 7f28fcfe6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f28f810c890 0x7f28f810b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:54.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.464+0000 7f28fcfe6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f813bcd0 con 0x7f28f810b710 2019-11-28T11:44:54.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.464+0000 7f28fcfe6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f8108700 con 0x7f28f810c890 2019-11-28T11:44:54.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.464+0000 7f28fcfe6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f81081f0 con 0x7f28f8104820 2019-11-28T11:44:54.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.464+0000 7f28f659c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f28f810c890 0x7f28f810b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:54.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.464+0000 7f28f6d9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28f8104820 0x7f28f810c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:54.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.464+0000 7f28f659c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f28f810c890 0x7f28f810b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:54598/0 (socket says 172.21.15.80:54598) 2019-11-28T11:44:54.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.464+0000 7f28f659c700 1 -- 172.21.15.80:0/3956478487 learned_addr learned my addr 172.21.15.80:0/3956478487 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:54.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.464+0000 7f28f6d9d700 1 -- 172.21.15.80:0/3956478487 >> v2:172.21.15.174:3300/0 conn(0x7f28f810c890 msgr2=0x7f28f810b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:54.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.464+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3956478487 >> v2:172.21.15.174:3300/0 conn(0x7f28f810c890 0x7f28f810b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:54.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.464+0000 7f28f6d9d700 1 -- 172.21.15.80:0/3956478487 >> v1:172.21.15.174:6789/0 conn(0x7f28f810b710 legacy=0x7f28f8104c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:54.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.464+0000 7f28f6d9d700 1 -- 172.21.15.80:0/3956478487 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f8109a90 con 0x7f28f8104820 2019-11-28T11:44:54.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.464+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28f8104820 0x7f28f810c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28e80103a0 tx=0x7f28e80101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.465+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28f8104820 0x7f28f810c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28e80103a0 tx=0x7f28e80101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.465+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28f8104820 0x7f28f810c350 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7f28e80103a0 tx=0x7f28e80101d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:54.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.465+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28f8104820 0x7f28f810c350 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f28e80103a0 tx=0x7f28e80101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.465+0000 7f28e77fe700 1 -- 172.21.15.80:0/3956478487 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28e8005560 con 0x7f28f8104820 2019-11-28T11:44:54.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.465+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28f8104820 0x7f28f810c350 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f28e80103a0 tx=0x7f28e80101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.465+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28f8104820 0x7f28f810c350 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f28e80103a0 tx=0x7f28e80101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.465+0000 7f28e77fe700 1 -- 172.21.15.80:0/3956478487 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e8005180 con 0x7f28f8104820 2019-11-28T11:44:54.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.465+0000 7f28fcfe6700 1 -- 172.21.15.80:0/3956478487 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f8109e10 con 0x7f28f8104820 2019-11-28T11:44:54.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.465+0000 7f28e77fe700 1 -- 172.21.15.80:0/3956478487 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28e8005b40 con 0x7f28f8104820 2019-11-28T11:44:54.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.465+0000 7f28fcfe6700 1 -- 172.21.15.80:0/3956478487 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f8109a90 con 0x7f28f8104820 2019-11-28T11:44:54.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.465+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28f8104820 0x7f28f810c350 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f28e80103a0 tx=0x7f28e80101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.465+0000 7f28e77fe700 1 -- 172.21.15.80:0/3956478487 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f28e8005370 con 0x7f28f8104820 2019-11-28T11:44:54.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.465+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28f8104820 0x7f28f810c350 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f28e80103a0 tx=0x7f28e80101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.465+0000 7f28e77fe700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28dc018730 0x7f28dc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:54.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.466+0000 7f28e77fe700 1 -- 172.21.15.80:0/3956478487 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f28e8031970 con 0x7f28f8104820 2019-11-28T11:44:54.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.466+0000 7f28f659c700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28dc018730 0x7f28dc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:54.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.466+0000 7f28f659c700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28dc018730 0x7f28dc01abc0 crc :-1 s=READY pgs=661 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:54.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.473+0000 7f28fcfe6700 1 -- 172.21.15.80:0/3956478487 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f8109e10 con 0x7f28f8104820 2019-11-28T11:44:54.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.477+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28f8104820 0x7f28f810c350 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f28e80103a0 tx=0x7f28e80101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:54.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.477+0000 7f28e77fe700 1 -- 172.21.15.80:0/3956478487 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f28e8007310 con 0x7f28f8104820 2019-11-28T11:44:54.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.650+0000 7f28fcfe6700 1 -- 172.21.15.80:0/3956478487 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f28f8109a90 con 0x7f28f8104820 2019-11-28T11:44:55.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.980+0000 7f28f6d9d700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28f8104820 0x7f28f810c350 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7f28e80103a0 tx=0x7f28e80101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:55.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:54.980+0000 7f28e77fe700 1 -- 172.21.15.80:0/3956478487 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v87) v1 ==== 104+0+0 (secure 0 0 0) 0x7f28e8017390 con 0x7f28f8104820 2019-11-28T11:44:55.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.016+0000 7f28fcfe6700 1 -- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28dc018730 msgr2=0x7f28dc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:55.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.016+0000 7f28fcfe6700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28dc018730 0x7f28dc01abc0 crc :-1 s=READY pgs=661 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:55.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.016+0000 7f28fcfe6700 1 -- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28f8104820 msgr2=0x7f28f810c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:55.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.016+0000 7f28fcfe6700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28f8104820 0x7f28f810c350 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7f28e80103a0 tx=0x7f28e80101d0).stop 2019-11-28T11:44:55.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.016+0000 7f28fcfe6700 1 -- 172.21.15.80:0/3956478487 shutdown_connections 2019-11-28T11:44:55.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.016+0000 7f28fcfe6700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28dc018730 0x7f28dc01abc0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:55.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.016+0000 7f28fcfe6700 1 --2- 172.21.15.80:0/3956478487 >> v2:172.21.15.174:3300/0 conn(0x7f28f810c890 0x7f28f810b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:55.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.016+0000 7f28fcfe6700 1 --2- 172.21.15.80:0/3956478487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28f8104820 0x7f28f810c350 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:55.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.016+0000 7f28fcfe6700 1 -- 172.21.15.80:0/3956478487 shutdown_connections 2019-11-28T11:44:55.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.017+0000 7f28fcfe6700 1 -- 172.21.15.80:0/3956478487 wait complete. 2019-11-28T11:44:55.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.017+0000 7f28fcfe6700 1 -- 172.21.15.80:0/3956478487 >> 172.21.15.80:0/3956478487 conn(0x7f28f813d620 msgr2=0x7f28f813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:55.065 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:44:55.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.150+0000 7f8bbfc9e700 1 Processor -- start 2019-11-28T11:44:55.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.150+0000 7f8bbfc9e700 1 -- start start 2019-11-28T11:44:55.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.151+0000 7f8bbfc9e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8bb81639f0 0x7f8bb8165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:55.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.151+0000 7f8bbfc9e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb806db60 con 0x7f8bb815f100 2019-11-28T11:44:55.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.151+0000 7f8bbfc9e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb806e060 con 0x7f8bb815ed10 2019-11-28T11:44:55.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.151+0000 7f8bbfc9e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb806fe00 con 0x7f8bb81639f0 2019-11-28T11:44:55.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.151+0000 7f8bbea3c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8bb81639f0 0x7f8bb8165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:55.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.151+0000 7f8bbea3c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8bb81639f0 0x7f8bb8165df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39718/0 (socket says 172.21.15.80:39718) 2019-11-28T11:44:55.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.151+0000 7f8bbea3c700 1 -- 172.21.15.80:0/513150842 learned_addr learned my addr 172.21.15.80:0/513150842 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:55.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.151+0000 7f8bbea3c700 1 -- 172.21.15.80:0/513150842 >> v1:172.21.15.174:6789/0 conn(0x7f8bb815ed10 legacy=0x7f8bb8073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:55.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.151+0000 7f8bbea3c700 1 -- 172.21.15.80:0/513150842 >> v1:172.21.15.80:6789/0 conn(0x7f8bb815f100 legacy=0x7f8bb806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:55.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.151+0000 7f8bbd239700 1 -- 172.21.15.80:0/513150842 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615026290 0 0) 0x7f8ba8001100 con 0x7f8bb815f100 2019-11-28T11:44:55.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.151+0000 7f8bbea3c700 1 -- 172.21.15.80:0/513150842 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb8070760 con 0x7f8bb81639f0 2019-11-28T11:44:55.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.151+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/513150842 >> v2:172.21.15.80:3300/0 conn(0x7f8bb81639f0 0x7f8bb8165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8bb000fab0 tx=0x7f8bb000fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:55.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.152+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/513150842 >> v2:172.21.15.80:3300/0 conn(0x7f8bb81639f0 0x7f8bb8165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8bb000fab0 tx=0x7f8bb000fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:55.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.152+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/513150842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bb81639f0 0x7f8bb8165df0 secure :-1 s=READY pgs=1635 cs=0 l=1 rx=0x7f8bb000fab0 tx=0x7f8bb000fe50).ready entity=mon.0 client_cookie=ecaecda8ddc8b2c4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:55.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.152+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/513150842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bb81639f0 0x7f8bb8165df0 secure :-1 s=THROTTLE_DONE pgs=1635 cs=0 l=1 rx=0x7f8bb000fab0 tx=0x7f8bb000fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:55.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.152+0000 7f8bbd239700 1 -- 172.21.15.80:0/513150842 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bb0000df0 con 0x7f8bb81639f0 2019-11-28T11:44:55.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.152+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/513150842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bb81639f0 0x7f8bb8165df0 secure :-1 s=THROTTLE_DONE pgs=1635 cs=0 l=1 rx=0x7f8bb000fab0 tx=0x7f8bb000fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:55.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.152+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/513150842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bb81639f0 0x7f8bb8165df0 secure :-1 s=THROTTLE_DONE pgs=1635 cs=0 l=1 rx=0x7f8bb000fab0 tx=0x7f8bb000fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:55.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.152+0000 7f8bbd239700 1 -- 172.21.15.80:0/513150842 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb0001460 con 0x7f8bb81639f0 2019-11-28T11:44:55.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.152+0000 7f8bbd239700 1 -- 172.21.15.80:0/513150842 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bb0001b30 con 0x7f8bb81639f0 2019-11-28T11:44:55.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.152+0000 7f8bbfc9e700 1 -- 172.21.15.80:0/513150842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bb81639f0 msgr2=0x7f8bb8165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:55.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.152+0000 7f8bbfc9e700 1 --2- 172.21.15.80:0/513150842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bb81639f0 0x7f8bb8165df0 secure :-1 s=READY pgs=1635 cs=0 l=1 rx=0x7f8bb000fab0 tx=0x7f8bb000fe50).stop 2019-11-28T11:44:55.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.153+0000 7f8bbfc9e700 1 -- 172.21.15.80:0/513150842 shutdown_connections 2019-11-28T11:44:55.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.153+0000 7f8bbfc9e700 1 --2- 172.21.15.80:0/513150842 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bb81639f0 0x7f8bb8165df0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:55.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.153+0000 7f8bbfc9e700 1 -- 172.21.15.80:0/513150842 shutdown_connections 2019-11-28T11:44:55.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.153+0000 7f8bbfc9e700 1 -- 172.21.15.80:0/513150842 wait complete. 2019-11-28T11:44:55.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.153+0000 7f8bbfc9e700 1 -- 172.21.15.80:0/513150842 >> 172.21.15.80:0/513150842 conn(0x7f8bb8061d20 msgr2=0x7f8bb80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:55.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.155+0000 7f8bbfc9e700 1 Processor -- start 2019-11-28T11:44:55.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.155+0000 7f8bbfc9e700 1 -- start start 2019-11-28T11:44:55.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bbfc9e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8bb80743a0 0x7f8bb8074830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:55.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bbfc9e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bb8074d70 0x7f8bb812db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:55.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bbfc9e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb81321a0 con 0x7f8bb8073290 2019-11-28T11:44:55.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bbfc9e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb807a4f0 con 0x7f8bb80743a0 2019-11-28T11:44:55.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bbfc9e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb807a7c0 con 0x7f8bb8074d70 2019-11-28T11:44:55.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bbe23b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8bb8073290 0x7f8bb8075520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39038/0 (socket says 172.21.15.80:39038) 2019-11-28T11:44:55.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bbe23b700 1 -- 172.21.15.80:0/1081504324 learned_addr learned my addr 172.21.15.80:0/1081504324 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:55.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bb8074d70 0x7f8bb812db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:55.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bbda3a700 1 --2- 172.21.15.80:0/1081504324 >> v2:172.21.15.174:3300/0 conn(0x7f8bb80743a0 0x7f8bb8074830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:55.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bb6ffd700 1 -- 172.21.15.80:0/1081504324 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274234743 0 0) 0x7f8ba0001150 con 0x7f8bb8073290 2019-11-28T11:44:55.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bb6ffd700 1 -- 172.21.15.80:0/1081504324 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b9c002e80 con 0x7f8bb8073290 2019-11-28T11:44:55.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bbea3c700 1 -- 172.21.15.80:0/1081504324 >> v2:172.21.15.174:3300/0 conn(0x7f8bb80743a0 msgr2=0x7f8bb8074830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:55.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/1081504324 >> v2:172.21.15.174:3300/0 conn(0x7f8bb80743a0 0x7f8bb8074830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:55.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bbea3c700 1 -- 172.21.15.80:0/1081504324 >> v1:172.21.15.80:6789/0 conn(0x7f8bb8073290 legacy=0x7f8bb8075520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:55.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bb6ffd700 1 -- 172.21.15.80:0/1081504324 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1804025956 0 0) 0x7f8ba00012c0 con 0x7f8bb8073290 2019-11-28T11:44:55.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bbea3c700 1 -- 172.21.15.80:0/1081504324 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb807ae50 con 0x7f8bb8074d70 2019-11-28T11:44:55.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bb8074d70 0x7f8bb812db30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8bb0010650 tx=0x7f8bb00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:55.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bb8074d70 0x7f8bb812db30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8bb0010650 tx=0x7f8bb00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:55.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.156+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bb8074d70 0x7f8bb812db30 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7f8bb0010650 tx=0x7f8bb00109f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:55.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.157+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bb8074d70 0x7f8bb812db30 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f8bb0010650 tx=0x7f8bb00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:55.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.157+0000 7f8bb6ffd700 1 -- 172.21.15.80:0/1081504324 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bb0001610 con 0x7f8bb8074d70 2019-11-28T11:44:55.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.157+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bb8074d70 0x7f8bb812db30 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f8bb0010650 tx=0x7f8bb00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:55.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.157+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bb8074d70 0x7f8bb812db30 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f8bb0010650 tx=0x7f8bb00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:55.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.157+0000 7f8bb6ffd700 1 -- 172.21.15.80:0/1081504324 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb0001230 con 0x7f8bb8074d70 2019-11-28T11:44:55.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.157+0000 7f8bbfc9e700 1 -- 172.21.15.80:0/1081504324 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb807b1d0 con 0x7f8bb8074d70 2019-11-28T11:44:55.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.157+0000 7f8bb6ffd700 1 -- 172.21.15.80:0/1081504324 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bb0001bf0 con 0x7f8bb8074d70 2019-11-28T11:44:55.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.157+0000 7f8bbfc9e700 1 -- 172.21.15.80:0/1081504324 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb807ae50 con 0x7f8bb8074d70 2019-11-28T11:44:55.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.157+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bb8074d70 0x7f8bb812db30 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f8bb0010650 tx=0x7f8bb00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:55.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.157+0000 7f8bb6ffd700 1 -- 172.21.15.80:0/1081504324 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8bb0001420 con 0x7f8bb8074d70 2019-11-28T11:44:55.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.157+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bb8074d70 0x7f8bb812db30 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f8bb0010650 tx=0x7f8bb00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:55.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.157+0000 7f8bb6ffd700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b9c018780 0x7f8b9c01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:55.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.157+0000 7f8bb6ffd700 1 -- 172.21.15.80:0/1081504324 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f8bb0031d40 con 0x7f8bb8074d70 2019-11-28T11:44:55.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.157+0000 7f8bbe23b700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b9c018780 0x7f8b9c01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:55.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.158+0000 7f8bbe23b700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b9c018780 0x7f8b9c01abf0 crc :-1 s=READY pgs=662 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:55.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.165+0000 7f8bbfc9e700 1 -- 172.21.15.80:0/1081504324 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb807b1d0 con 0x7f8bb8074d70 2019-11-28T11:44:55.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.169+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bb8074d70 0x7f8bb812db30 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f8bb0010650 tx=0x7f8bb00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:55.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.169+0000 7f8bb6ffd700 1 -- 172.21.15.80:0/1081504324 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8bb0007900 con 0x7f8bb8074d70 2019-11-28T11:44:55.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.336+0000 7f8bbfc9e700 1 -- 172.21.15.80:0/1081504324 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8bb807ae50 con 0x7f8bb8074d70 2019-11-28T11:44:56.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.982+0000 7f8bbea3c700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bb8074d70 0x7f8bb812db30 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f8bb0010650 tx=0x7f8bb00109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:56.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:55.982+0000 7f8bb6ffd700 1 -- 172.21.15.80:0/1081504324 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v122) v1 ==== 185+0+0 (secure 0 0 0) 0x7f8bb00176f0 con 0x7f8bb8074d70 2019-11-28T11:44:56.039 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:44:56.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.003+0000 7f8bbfc9e700 1 -- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b9c018780 msgr2=0x7f8b9c01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:56.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.003+0000 7f8bbfc9e700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b9c018780 0x7f8b9c01abf0 crc :-1 s=READY pgs=662 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:56.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.003+0000 7f8bbfc9e700 1 -- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bb8074d70 msgr2=0x7f8bb812db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:56.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.003+0000 7f8bbfc9e700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bb8074d70 0x7f8bb812db30 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7f8bb0010650 tx=0x7f8bb00109f0).stop 2019-11-28T11:44:56.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.003+0000 7f8bbfc9e700 1 -- 172.21.15.80:0/1081504324 shutdown_connections 2019-11-28T11:44:56.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.003+0000 7f8bbfc9e700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b9c018780 0x7f8b9c01abf0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:56.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.003+0000 7f8bbfc9e700 1 --2- 172.21.15.80:0/1081504324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bb8074d70 0x7f8bb812db30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:56.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.003+0000 7f8bbfc9e700 1 --2- 172.21.15.80:0/1081504324 >> v2:172.21.15.174:3300/0 conn(0x7f8bb80743a0 0x7f8bb8074830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:56.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.003+0000 7f8bbfc9e700 1 -- 172.21.15.80:0/1081504324 shutdown_connections 2019-11-28T11:44:56.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.003+0000 7f8bbfc9e700 1 -- 172.21.15.80:0/1081504324 wait complete. 2019-11-28T11:44:56.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.003+0000 7f8bbfc9e700 1 -- 172.21.15.80:0/1081504324 >> 172.21.15.80:0/1081504324 conn(0x7f8bb8147670 msgr2=0x7f8bb81641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:56.053 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:44:56.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.137+0000 7f8b4b400700 1 Processor -- start 2019-11-28T11:44:56.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.137+0000 7f8b4b400700 1 -- start start 2019-11-28T11:44:56.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.138+0000 7f8b4b400700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4415f100 0x7f8b4406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:56.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.138+0000 7f8b4b400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4406db60 con 0x7f8b4415ed10 2019-11-28T11:44:56.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.138+0000 7f8b4b400700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4406e060 con 0x7f8b4406c2f0 2019-11-28T11:44:56.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.138+0000 7f8b4b400700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4406fe00 con 0x7f8b4415f100 2019-11-28T11:44:56.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.138+0000 7f8b4999d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8b4415ed10 0x7f8b44073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39046/0 (socket says 172.21.15.80:39046) 2019-11-28T11:44:56.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.138+0000 7f8b4999d700 1 -- 172.21.15.80:0/1227270170 learned_addr learned my addr 172.21.15.80:0/1227270170 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:56.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.138+0000 7f8b4919c700 1 --2- 172.21.15.80:0/1227270170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4415f100 0x7f8b4406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:56.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.138+0000 7f8b4899b700 1 -- 172.21.15.80:0/1227270170 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877753420 0 0) 0x7f8b2c001100 con 0x7f8b4415ed10 2019-11-28T11:44:56.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.138+0000 7f8b4899b700 1 -- 172.21.15.80:0/1227270170 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b30002e80 con 0x7f8b4415ed10 2019-11-28T11:44:56.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.138+0000 7f8b4899b700 1 -- 172.21.15.80:0/1227270170 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158303426 0 0) 0x7f8b3c0009b0 con 0x7f8b4406c2f0 2019-11-28T11:44:56.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.138+0000 7f8b4899b700 1 -- 172.21.15.80:0/1227270170 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b30004170 con 0x7f8b4406c2f0 2019-11-28T11:44:56.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.139+0000 7f8b4919c700 1 -- 172.21.15.80:0/1227270170 >> v1:172.21.15.174:6789/0 conn(0x7f8b4406c2f0 legacy=0x7f8b4406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:56.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.139+0000 7f8b4899b700 1 -- 172.21.15.80:0/1227270170 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1525244220 0 0) 0x7f8b2c0010e0 con 0x7f8b4415ed10 2019-11-28T11:44:56.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.139+0000 7f8b4919c700 1 -- 172.21.15.80:0/1227270170 >> v1:172.21.15.80:6789/0 conn(0x7f8b4415ed10 legacy=0x7f8b44073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:56.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.139+0000 7f8b4919c700 1 -- 172.21.15.80:0/1227270170 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b44070760 con 0x7f8b4415f100 2019-11-28T11:44:56.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.139+0000 7f8b4919c700 1 --2- 172.21.15.80:0/1227270170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4415f100 0x7f8b4406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8b3400b2d0 tx=0x7f8b3400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:56.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.139+0000 7f8b4919c700 1 --2- 172.21.15.80:0/1227270170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4415f100 0x7f8b4406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8b3400b2d0 tx=0x7f8b3400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:56.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.139+0000 7f8b4919c700 1 --2- 172.21.15.80:0/1227270170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4415f100 0x7f8b4406bdb0 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7f8b3400b2d0 tx=0x7f8b3400bae0).ready entity=mon.2 client_cookie=56962d71e0abd85e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:56.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.139+0000 7f8b4919c700 1 --2- 172.21.15.80:0/1227270170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4415f100 0x7f8b4406bdb0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f8b3400b2d0 tx=0x7f8b3400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:56.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.139+0000 7f8b4899b700 1 -- 172.21.15.80:0/1227270170 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b34000ce0 con 0x7f8b4415f100 2019-11-28T11:44:56.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.139+0000 7f8b4919c700 1 --2- 172.21.15.80:0/1227270170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4415f100 0x7f8b4406bdb0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f8b3400b2d0 tx=0x7f8b3400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:56.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.139+0000 7f8b4919c700 1 --2- 172.21.15.80:0/1227270170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4415f100 0x7f8b4406bdb0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f8b3400b2d0 tx=0x7f8b3400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:56.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.139+0000 7f8b4899b700 1 -- 172.21.15.80:0/1227270170 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b34007590 con 0x7f8b4415f100 2019-11-28T11:44:56.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.139+0000 7f8b4899b700 1 -- 172.21.15.80:0/1227270170 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b34009f20 con 0x7f8b4415f100 2019-11-28T11:44:56.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.139+0000 7f8b4b400700 1 -- 172.21.15.80:0/1227270170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4415f100 msgr2=0x7f8b4406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:56.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.139+0000 7f8b4b400700 1 --2- 172.21.15.80:0/1227270170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4415f100 0x7f8b4406bdb0 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7f8b3400b2d0 tx=0x7f8b3400bae0).stop 2019-11-28T11:44:56.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.140+0000 7f8b4b400700 1 -- 172.21.15.80:0/1227270170 shutdown_connections 2019-11-28T11:44:56.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.140+0000 7f8b4b400700 1 --2- 172.21.15.80:0/1227270170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4415f100 0x7f8b4406bdb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:56.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.140+0000 7f8b4b400700 1 -- 172.21.15.80:0/1227270170 shutdown_connections 2019-11-28T11:44:56.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.140+0000 7f8b4b400700 1 -- 172.21.15.80:0/1227270170 wait complete. 2019-11-28T11:44:56.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.140+0000 7f8b4b400700 1 -- 172.21.15.80:0/1227270170 >> 172.21.15.80:0/1227270170 conn(0x7f8b44061d20 msgr2=0x7f8b440641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:56.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.142+0000 7f8b4b400700 1 Processor -- start 2019-11-28T11:44:56.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.142+0000 7f8b4b400700 1 -- start start 2019-11-28T11:44:56.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.143+0000 7f8b4b400700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4412e130 0x7f8b4412e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:56.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.143+0000 7f8b4b400700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b441542b0 con 0x7f8b44153890 2019-11-28T11:44:56.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.143+0000 7f8b4b400700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b44120910 con 0x7f8b4412eb00 2019-11-28T11:44:56.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.143+0000 7f8b4b400700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b44110bb0 con 0x7f8b4412e130 2019-11-28T11:44:56.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.143+0000 7f8b4999d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8b44153890 0x7f8b44115020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39052/0 (socket says 172.21.15.80:39052) 2019-11-28T11:44:56.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.143+0000 7f8b4999d700 1 -- 172.21.15.80:0/4056861549 learned_addr learned my addr 172.21.15.80:0/4056861549 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:56.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.143+0000 7f8b4919c700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4412e130 0x7f8b4412e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:56.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.143+0000 7f8b427fc700 1 -- 172.21.15.80:0/4056861549 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374344828 0 0) 0x7f8b2c000f30 con 0x7f8b44153890 2019-11-28T11:44:56.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.143+0000 7f8b427fc700 1 -- 172.21.15.80:0/4056861549 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b28002e80 con 0x7f8b44153890 2019-11-28T11:44:56.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b427fc700 1 -- 172.21.15.80:0/4056861549 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627173125 0 0) 0x7f8b3c001070 con 0x7f8b4412eb00 2019-11-28T11:44:56.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b427fc700 1 -- 172.21.15.80:0/4056861549 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b280030b0 con 0x7f8b4412eb00 2019-11-28T11:44:56.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b4919c700 1 -- 172.21.15.80:0/4056861549 >> v1:172.21.15.174:6789/0 conn(0x7f8b4412eb00 legacy=0x7f8b4410e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:56.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b4919c700 1 -- 172.21.15.80:0/4056861549 >> v1:172.21.15.80:6789/0 conn(0x7f8b44153890 legacy=0x7f8b44115020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:56.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b427fc700 1 -- 172.21.15.80:0/4056861549 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3860771536 0 0) 0x7f8b2c000c90 con 0x7f8b44153890 2019-11-28T11:44:56.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b4919c700 1 -- 172.21.15.80:0/4056861549 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b44112760 con 0x7f8b4412e130 2019-11-28T11:44:56.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b4919c700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4412e130 0x7f8b4412e5c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8b34010700 tx=0x7f8b34010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:56.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b4919c700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4412e130 0x7f8b4412e5c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8b34010700 tx=0x7f8b34010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:56.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b4919c700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4412e130 0x7f8b4412e5c0 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7f8b34010700 tx=0x7f8b34010aa0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:56.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b4919c700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4412e130 0x7f8b4412e5c0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f8b34010700 tx=0x7f8b34010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:56.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b427fc700 1 -- 172.21.15.80:0/4056861549 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b34000cc0 con 0x7f8b4412e130 2019-11-28T11:44:56.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b4919c700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4412e130 0x7f8b4412e5c0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f8b34010700 tx=0x7f8b34010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:56.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b427fc700 1 -- 172.21.15.80:0/4056861549 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b34009b10 con 0x7f8b4412e130 2019-11-28T11:44:56.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b4919c700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4412e130 0x7f8b4412e5c0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f8b34010700 tx=0x7f8b34010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:56.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b4b400700 1 -- 172.21.15.80:0/4056861549 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b44112ae0 con 0x7f8b4412e130 2019-11-28T11:44:56.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b427fc700 1 -- 172.21.15.80:0/4056861549 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b34000cc0 con 0x7f8b4412e130 2019-11-28T11:44:56.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b4b400700 1 -- 172.21.15.80:0/4056861549 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b44112760 con 0x7f8b4412e130 2019-11-28T11:44:56.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.144+0000 7f8b4919c700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4412e130 0x7f8b4412e5c0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f8b34010700 tx=0x7f8b34010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:56.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.145+0000 7f8b427fc700 1 -- 172.21.15.80:0/4056861549 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8b34009d00 con 0x7f8b4412e130 2019-11-28T11:44:56.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.145+0000 7f8b4919c700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4412e130 0x7f8b4412e5c0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f8b34010700 tx=0x7f8b34010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:56.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.145+0000 7f8b427fc700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b28018750 0x7f8b2801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:56.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.145+0000 7f8b427fc700 1 -- 172.21.15.80:0/4056861549 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5711+0+0 (secure 0 0 0) 0x7f8b340320a0 con 0x7f8b4412e130 2019-11-28T11:44:56.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.145+0000 7f8b4999d700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b28018750 0x7f8b2801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:56.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.145+0000 7f8b4999d700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b28018750 0x7f8b2801abe0 crc :-1 s=READY pgs=663 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:56.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.152+0000 7f8b4b400700 1 -- 172.21.15.80:0/4056861549 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b44112ae0 con 0x7f8b4412e130 2019-11-28T11:44:56.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.156+0000 7f8b4919c700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4412e130 0x7f8b4412e5c0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f8b34010700 tx=0x7f8b34010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:56.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.156+0000 7f8b427fc700 1 -- 172.21.15.80:0/4056861549 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8b34009900 con 0x7f8b4412e130 2019-11-28T11:44:56.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.325+0000 7f8b4b400700 1 -- 172.21.15.80:0/4056861549 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8b44112760 con 0x7f8b4412e130 2019-11-28T11:44:57.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.994+0000 7f8b4919c700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4412e130 0x7f8b4412e5c0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f8b34010700 tx=0x7f8b34010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:57.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:56.994+0000 7f8b427fc700 1 -- 172.21.15.80:0/4056861549 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v123) v1 ==== 173+0+0 (secure 0 0 0) 0x7f8b34009d50 con 0x7f8b4412e130 2019-11-28T11:44:57.078 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:44:57.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.043+0000 7f8b4b400700 1 -- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b28018750 msgr2=0x7f8b2801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:57.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.043+0000 7f8b4b400700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b28018750 0x7f8b2801abe0 crc :-1 s=READY pgs=663 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:57.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.043+0000 7f8b4b400700 1 -- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4412e130 msgr2=0x7f8b4412e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:57.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.043+0000 7f8b4b400700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4412e130 0x7f8b4412e5c0 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7f8b34010700 tx=0x7f8b34010aa0).stop 2019-11-28T11:44:57.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.043+0000 7f8b4b400700 1 -- 172.21.15.80:0/4056861549 shutdown_connections 2019-11-28T11:44:57.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.043+0000 7f8b4b400700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b28018750 0x7f8b2801abe0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:57.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.043+0000 7f8b4b400700 1 --2- 172.21.15.80:0/4056861549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b4412e130 0x7f8b4412e5c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:57.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.043+0000 7f8b4b400700 1 -- 172.21.15.80:0/4056861549 shutdown_connections 2019-11-28T11:44:57.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.043+0000 7f8b4b400700 1 -- 172.21.15.80:0/4056861549 wait complete. 2019-11-28T11:44:57.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.043+0000 7f8b4b400700 1 -- 172.21.15.80:0/4056861549 >> 172.21.15.80:0/4056861549 conn(0x7f8b4414f9f0 msgr2=0x7f8b44111c60 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:57.092 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:44:57.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.178+0000 7fa79ecfd700 1 Processor -- start 2019-11-28T11:44:57.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.178+0000 7fa79ecfd700 1 -- start start 2019-11-28T11:44:57.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.179+0000 7fa79ecfd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa79806c0a0 0x7fa798072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:57.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.179+0000 7fa79ecfd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7980734e0 0x7fa798071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:57.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.179+0000 7fa79ecfd700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79806db00 con 0x7fa798072360 2019-11-28T11:44:57.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.179+0000 7fa79ecfd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79806fd60 con 0x7fa79806c0a0 2019-11-28T11:44:57.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.179+0000 7fa79ecfd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa798070030 con 0x7fa7980734e0 2019-11-28T11:44:57.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.179+0000 7fa79d29a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa79806c0a0 0x7fa798072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:57.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.179+0000 7fa79d29a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa79806c0a0 0x7fa798072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39744/0 (socket says 172.21.15.80:39744) 2019-11-28T11:44:57.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.179+0000 7fa79da9b700 1 --1- 172.21.15.80:0/1359399786 >> v1:172.21.15.80:6789/0 conn(0x7fa798072360 0x7fa79806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39062/0 (socket says 172.21.15.80:39062) 2019-11-28T11:44:57.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.179+0000 7fa79d29a700 1 -- 172.21.15.80:0/1359399786 learned_addr learned my addr 172.21.15.80:0/1359399786 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:57.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.179+0000 7fa79ca99700 1 --2- 172.21.15.80:0/1359399786 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7980734e0 0x7fa798071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:57.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.179+0000 7fa79d29a700 1 -- 172.21.15.80:0/1359399786 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7980734e0 msgr2=0x7fa798071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:57.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.179+0000 7fa79d29a700 1 --2- 172.21.15.80:0/1359399786 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7980734e0 0x7fa798071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:57.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.179+0000 7fa79d29a700 1 -- 172.21.15.80:0/1359399786 >> v1:172.21.15.80:6789/0 conn(0x7fa798072360 legacy=0x7fa79806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:57.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.179+0000 7fa79d29a700 1 -- 172.21.15.80:0/1359399786 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7980706c0 con 0x7fa79806c0a0 2019-11-28T11:44:57.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.179+0000 7fa797fff700 1 -- 172.21.15.80:0/1359399786 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263987103 0 0) 0x7fa790000d30 con 0x7fa798072360 2019-11-28T11:44:57.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.180+0000 7fa79d29a700 1 --2- 172.21.15.80:0/1359399786 >> v2:172.21.15.80:3300/0 conn(0x7fa79806c0a0 0x7fa798072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa78000f6c0 tx=0x7fa78000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:57.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.180+0000 7fa79d29a700 1 --2- 172.21.15.80:0/1359399786 >> v2:172.21.15.80:3300/0 conn(0x7fa79806c0a0 0x7fa798072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa78000f6c0 tx=0x7fa78000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:57.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.180+0000 7fa79d29a700 1 --2- 172.21.15.80:0/1359399786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79806c0a0 0x7fa798072fa0 secure :-1 s=READY pgs=1640 cs=0 l=1 rx=0x7fa78000f6c0 tx=0x7fa78000fa60).ready entity=mon.0 client_cookie=83bceae540d167de server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.180+0000 7fa79d29a700 1 --2- 172.21.15.80:0/1359399786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79806c0a0 0x7fa798072fa0 secure :-1 s=THROTTLE_DONE pgs=1640 cs=0 l=1 rx=0x7fa78000f6c0 tx=0x7fa78000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.180+0000 7fa797fff700 1 -- 172.21.15.80:0/1359399786 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa780000960 con 0x7fa79806c0a0 2019-11-28T11:44:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.180+0000 7fa79d29a700 1 --2- 172.21.15.80:0/1359399786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79806c0a0 0x7fa798072fa0 secure :-1 s=THROTTLE_DONE pgs=1640 cs=0 l=1 rx=0x7fa78000f6c0 tx=0x7fa78000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.180+0000 7fa79d29a700 1 --2- 172.21.15.80:0/1359399786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79806c0a0 0x7fa798072fa0 secure :-1 s=THROTTLE_DONE pgs=1640 cs=0 l=1 rx=0x7fa78000f6c0 tx=0x7fa78000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.180+0000 7fa797fff700 1 -- 172.21.15.80:0/1359399786 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa780000c90 con 0x7fa79806c0a0 2019-11-28T11:44:57.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.180+0000 7fa797fff700 1 -- 172.21.15.80:0/1359399786 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7800013a0 con 0x7fa79806c0a0 2019-11-28T11:44:57.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.180+0000 7fa79ecfd700 1 -- 172.21.15.80:0/1359399786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79806c0a0 msgr2=0x7fa798072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:57.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.180+0000 7fa79ecfd700 1 --2- 172.21.15.80:0/1359399786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79806c0a0 0x7fa798072fa0 secure :-1 s=READY pgs=1640 cs=0 l=1 rx=0x7fa78000f6c0 tx=0x7fa78000fa60).stop 2019-11-28T11:44:57.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.180+0000 7fa79ecfd700 1 -- 172.21.15.80:0/1359399786 shutdown_connections 2019-11-28T11:44:57.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.180+0000 7fa79ecfd700 1 --2- 172.21.15.80:0/1359399786 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7980734e0 0x7fa798071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:57.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.180+0000 7fa79ecfd700 1 --2- 172.21.15.80:0/1359399786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79806c0a0 0x7fa798072fa0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:57.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.181+0000 7fa79ecfd700 1 -- 172.21.15.80:0/1359399786 shutdown_connections 2019-11-28T11:44:57.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.181+0000 7fa79ecfd700 1 -- 172.21.15.80:0/1359399786 wait complete. 2019-11-28T11:44:57.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.181+0000 7fa79ecfd700 1 -- 172.21.15.80:0/1359399786 >> 172.21.15.80:0/1359399786 conn(0x7fa798061cf0 msgr2=0x7fa798064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:57.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.183+0000 7fa79ecfd700 1 Processor -- start 2019-11-28T11:44:57.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.183+0000 7fa79ecfd700 1 -- start start 2019-11-28T11:44:57.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.184+0000 7fa79ecfd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa79813eb40 0x7fa79810afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:57.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.184+0000 7fa79ecfd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa7981631f0 0x7fa798105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:57.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.184+0000 7fa79ecfd700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79813f1e0 con 0x7fa79810b500 2019-11-28T11:44:57.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.184+0000 7fa79ecfd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7981234c0 con 0x7fa79813eb40 2019-11-28T11:44:57.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.184+0000 7fa79ecfd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79813e0d0 con 0x7fa7981631f0 2019-11-28T11:44:57.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.184+0000 7fa79d29a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa79813eb40 0x7fa79810afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:57.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.184+0000 7fa79ca99700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa79810b500 0x7fa7981629f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39068/0 (socket says 172.21.15.80:39068) 2019-11-28T11:44:57.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.184+0000 7fa79ca99700 1 -- 172.21.15.80:0/3728753175 learned_addr learned my addr 172.21.15.80:0/3728753175 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:57.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.184+0000 7fa79da9b700 1 --2- 172.21.15.80:0/3728753175 >> v2:172.21.15.174:3300/0 conn(0x7fa7981631f0 0x7fa798105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:57.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa79d29a700 1 -- 172.21.15.80:0/3728753175 >> v2:172.21.15.174:3300/0 conn(0x7fa7981631f0 msgr2=0x7fa798105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:57.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa79d29a700 1 --2- 172.21.15.80:0/3728753175 >> v2:172.21.15.174:3300/0 conn(0x7fa7981631f0 0x7fa798105210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:57.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa79d29a700 1 -- 172.21.15.80:0/3728753175 >> v1:172.21.15.80:6789/0 conn(0x7fa79810b500 legacy=0x7fa7981629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:57.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa795ffb700 1 -- 172.21.15.80:0/3728753175 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112492292 0 0) 0x7fa788000fb0 con 0x7fa79810b500 2019-11-28T11:44:57.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa79d29a700 1 -- 172.21.15.80:0/3728753175 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa798108700 con 0x7fa79813eb40 2019-11-28T11:44:57.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa79da9b700 1 --2- 172.21.15.80:0/3728753175 >> v2:172.21.15.174:3300/0 conn(0x7fa7981631f0 0x7fa798105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:44:57.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa79d29a700 1 --2- 172.21.15.80:0/3728753175 >> v2:172.21.15.80:3300/0 conn(0x7fa79813eb40 0x7fa79810afc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7800543c0 tx=0x7fa780054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:57.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa79d29a700 1 --2- 172.21.15.80:0/3728753175 >> v2:172.21.15.80:3300/0 conn(0x7fa79813eb40 0x7fa79810afc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7800543c0 tx=0x7fa780054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:57.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa79d29a700 1 --2- 172.21.15.80:0/3728753175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79813eb40 0x7fa79810afc0 secure :-1 s=READY pgs=1642 cs=0 l=1 rx=0x7fa7800543c0 tx=0x7fa780054760).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:57.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa79d29a700 1 --2- 172.21.15.80:0/3728753175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79813eb40 0x7fa79810afc0 secure :-1 s=THROTTLE_DONE pgs=1642 cs=0 l=1 rx=0x7fa7800543c0 tx=0x7fa780054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:57.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa795ffb700 1 -- 172.21.15.80:0/3728753175 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa780005390 con 0x7fa79813eb40 2019-11-28T11:44:57.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa79d29a700 1 --2- 172.21.15.80:0/3728753175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79813eb40 0x7fa79810afc0 secure :-1 s=THROTTLE_DONE pgs=1642 cs=0 l=1 rx=0x7fa7800543c0 tx=0x7fa780054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:57.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa79d29a700 1 --2- 172.21.15.80:0/3728753175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79813eb40 0x7fa79810afc0 secure :-1 s=THROTTLE_DONE pgs=1642 cs=0 l=1 rx=0x7fa7800543c0 tx=0x7fa780054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:57.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa795ffb700 1 -- 172.21.15.80:0/3728753175 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa780007e10 con 0x7fa79813eb40 2019-11-28T11:44:57.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa79ecfd700 1 -- 172.21.15.80:0/3728753175 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa798108a80 con 0x7fa79813eb40 2019-11-28T11:44:57.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa795ffb700 1 -- 172.21.15.80:0/3728753175 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa780005970 con 0x7fa79813eb40 2019-11-28T11:44:57.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa79ecfd700 1 -- 172.21.15.80:0/3728753175 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa798108700 con 0x7fa79813eb40 2019-11-28T11:44:57.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa79d29a700 1 --2- 172.21.15.80:0/3728753175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79813eb40 0x7fa79810afc0 secure :-1 s=THROTTLE_DONE pgs=1642 cs=0 l=1 rx=0x7fa7800543c0 tx=0x7fa780054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:57.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa795ffb700 1 -- 172.21.15.80:0/3728753175 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa780005390 con 0x7fa79813eb40 2019-11-28T11:44:57.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.185+0000 7fa79d29a700 1 --2- 172.21.15.80:0/3728753175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79813eb40 0x7fa79810afc0 secure :-1 s=THROTTLE_DONE pgs=1642 cs=0 l=1 rx=0x7fa7800543c0 tx=0x7fa780054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:57.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.186+0000 7fa795ffb700 1 --2- 172.21.15.80:0/3728753175 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa77c018730 0x7fa77c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:57.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.186+0000 7fa795ffb700 1 -- 172.21.15.80:0/3728753175 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5329+0+0 (secure 0 0 0) 0x7fa780075a70 con 0x7fa79813eb40 2019-11-28T11:44:57.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.186+0000 7fa79ca99700 1 --2- 172.21.15.80:0/3728753175 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa77c018730 0x7fa77c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:57.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.186+0000 7fa79ca99700 1 --2- 172.21.15.80:0/3728753175 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa77c018730 0x7fa77c01abc0 crc :-1 s=READY pgs=664 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:57.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.193+0000 7fa79ecfd700 1 -- 172.21.15.80:0/3728753175 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa798108a80 con 0x7fa79813eb40 2019-11-28T11:44:57.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.197+0000 7fa79d29a700 1 --2- 172.21.15.80:0/3728753175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79813eb40 0x7fa79810afc0 secure :-1 s=THROTTLE_DONE pgs=1642 cs=0 l=1 rx=0x7fa7800543c0 tx=0x7fa780054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:57.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.197+0000 7fa795ffb700 1 -- 172.21.15.80:0/3728753175 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa780007e10 con 0x7fa79813eb40 2019-11-28T11:44:57.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.387+0000 7fa79ecfd700 1 -- 172.21.15.80:0/3728753175 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fa798108700 con 0x7fa79813eb40 2019-11-28T11:44:58.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.998+0000 7fa79d29a700 1 --2- 172.21.15.80:0/3728753175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79813eb40 0x7fa79810afc0 secure :-1 s=THROTTLE_DONE pgs=1642 cs=0 l=1 rx=0x7fa7800543c0 tx=0x7fa780054760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:57.998+0000 7fa795ffb700 1 -- 172.21.15.80:0/3728753175 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v124) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa780005180 con 0x7fa79813eb40 2019-11-28T11:44:58.041 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:44:58.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.004+0000 7fa79ecfd700 1 -- 172.21.15.80:0/3728753175 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa77c018730 msgr2=0x7fa77c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.004+0000 7fa79ecfd700 1 --2- 172.21.15.80:0/3728753175 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa77c018730 0x7fa77c01abc0 crc :-1 s=READY pgs=664 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:58.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.004+0000 7fa79ecfd700 1 -- 172.21.15.80:0/3728753175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79813eb40 msgr2=0x7fa79810afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.004+0000 7fa79ecfd700 1 --2- 172.21.15.80:0/3728753175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79813eb40 0x7fa79810afc0 secure :-1 s=READY pgs=1642 cs=0 l=1 rx=0x7fa7800543c0 tx=0x7fa780054760).stop 2019-11-28T11:44:58.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.005+0000 7fa79ecfd700 1 -- 172.21.15.80:0/3728753175 shutdown_connections 2019-11-28T11:44:58.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.005+0000 7fa79ecfd700 1 --2- 172.21.15.80:0/3728753175 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa77c018730 0x7fa77c01abc0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:58.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.005+0000 7fa79ecfd700 1 --2- 172.21.15.80:0/3728753175 >> v2:172.21.15.174:3300/0 conn(0x7fa7981631f0 0x7fa798105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:58.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.005+0000 7fa79ecfd700 1 --2- 172.21.15.80:0/3728753175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa79813eb40 0x7fa79810afc0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:58.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.005+0000 7fa79ecfd700 1 -- 172.21.15.80:0/3728753175 shutdown_connections 2019-11-28T11:44:58.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.005+0000 7fa79ecfd700 1 -- 172.21.15.80:0/3728753175 wait complete. 2019-11-28T11:44:58.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.005+0000 7fa79ecfd700 1 -- 172.21.15.80:0/3728753175 >> 172.21.15.80:0/3728753175 conn(0x7fa79811bfc0 msgr2=0x7fa798141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:58.054 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:44:58.054 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:44:58.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.136+0000 7f8266335700 1 Processor -- start 2019-11-28T11:44:58.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.136+0000 7f8266335700 1 -- start start 2019-11-28T11:44:58.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.137+0000 7f8266335700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f826006c0a0 0x7f8260072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:58.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.137+0000 7f8266335700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826006db00 con 0x7f8260072620 2019-11-28T11:44:58.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.137+0000 7f8266335700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826006e000 con 0x7f82600734e0 2019-11-28T11:44:58.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.137+0000 7f8266335700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826006fd60 con 0x7f826006c0a0 2019-11-28T11:44:58.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.137+0000 7f82650d3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8260072620 0x7f8260164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39074/0 (socket says 172.21.15.80:39074) 2019-11-28T11:44:58.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.137+0000 7f82650d3700 1 -- 172.21.15.80:0/3454600452 learned_addr learned my addr 172.21.15.80:0/3454600452 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:58.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.137+0000 7f82648d2700 1 --2- 172.21.15.80:0/3454600452 >> v2:172.21.15.174:3300/0 conn(0x7f826006c0a0 0x7f8260072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:58.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f825f7fe700 1 -- 172.21.15.80:0/3454600452 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665846858 0 0) 0x7f82580014d0 con 0x7f8260072620 2019-11-28T11:44:58.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f825f7fe700 1 -- 172.21.15.80:0/3454600452 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f824c002e80 con 0x7f8260072620 2019-11-28T11:44:58.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f82648d2700 1 -- 172.21.15.80:0/3454600452 >> v1:172.21.15.174:6789/0 conn(0x7f82600734e0 legacy=0x7f8260071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f825f7fe700 1 -- 172.21.15.80:0/3454600452 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514160337 0 0) 0x7f8250001080 con 0x7f82600734e0 2019-11-28T11:44:58.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f82648d2700 1 -- 172.21.15.80:0/3454600452 >> v1:172.21.15.80:6789/0 conn(0x7f8260072620 legacy=0x7f8260164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f82648d2700 1 -- 172.21.15.80:0/3454600452 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82600706c0 con 0x7f826006c0a0 2019-11-28T11:44:58.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f82648d2700 1 --2- 172.21.15.80:0/3454600452 >> v2:172.21.15.174:3300/0 conn(0x7f826006c0a0 0x7f8260072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f824800af50 tx=0x7f824800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f82648d2700 1 --2- 172.21.15.80:0/3454600452 >> v2:172.21.15.174:3300/0 conn(0x7f826006c0a0 0x7f8260072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f824800af50 tx=0x7f824800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f82648d2700 1 --2- 172.21.15.80:0/3454600452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f826006c0a0 0x7f8260072fa0 secure :-1 s=READY pgs=951 cs=0 l=1 rx=0x7f824800af50 tx=0x7f824800b760).ready entity=mon.1 client_cookie=fffaef2ae6effc23 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:58.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f82648d2700 1 --2- 172.21.15.80:0/3454600452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f826006c0a0 0x7f8260072fa0 secure :-1 s=THROTTLE_DONE pgs=951 cs=0 l=1 rx=0x7f824800af50 tx=0x7f824800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f82648d2700 1 --2- 172.21.15.80:0/3454600452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f826006c0a0 0x7f8260072fa0 secure :-1 s=THROTTLE_DONE pgs=951 cs=0 l=1 rx=0x7f824800af50 tx=0x7f824800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f825f7fe700 1 -- 172.21.15.80:0/3454600452 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8248000960 con 0x7f826006c0a0 2019-11-28T11:44:58.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f82648d2700 1 --2- 172.21.15.80:0/3454600452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f826006c0a0 0x7f8260072fa0 secure :-1 s=THROTTLE_DONE pgs=951 cs=0 l=1 rx=0x7f824800af50 tx=0x7f824800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f825f7fe700 1 -- 172.21.15.80:0/3454600452 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82480098e0 con 0x7f826006c0a0 2019-11-28T11:44:58.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f825f7fe700 1 -- 172.21.15.80:0/3454600452 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f824800a050 con 0x7f826006c0a0 2019-11-28T11:44:58.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f8266335700 1 -- 172.21.15.80:0/3454600452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f826006c0a0 msgr2=0x7f8260072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.138+0000 7f8266335700 1 --2- 172.21.15.80:0/3454600452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f826006c0a0 0x7f8260072fa0 secure :-1 s=READY pgs=951 cs=0 l=1 rx=0x7f824800af50 tx=0x7f824800b760).stop 2019-11-28T11:44:58.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.139+0000 7f8266335700 1 -- 172.21.15.80:0/3454600452 shutdown_connections 2019-11-28T11:44:58.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.139+0000 7f8266335700 1 --2- 172.21.15.80:0/3454600452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f826006c0a0 0x7f8260072fa0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:58.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.139+0000 7f8266335700 1 -- 172.21.15.80:0/3454600452 shutdown_connections 2019-11-28T11:44:58.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.139+0000 7f8266335700 1 -- 172.21.15.80:0/3454600452 wait complete. 2019-11-28T11:44:58.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.139+0000 7f8266335700 1 -- 172.21.15.80:0/3454600452 >> 172.21.15.80:0/3454600452 conn(0x7f8260061cf0 msgr2=0x7f8260064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:58.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.141+0000 7f8266335700 1 Processor -- start 2019-11-28T11:44:58.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.141+0000 7f8266335700 1 -- start start 2019-11-28T11:44:58.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.142+0000 7f8266335700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8260166a10 0x7f8260168e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:58.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.142+0000 7f8266335700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8260124260 con 0x7f826012cea0 2019-11-28T11:44:58.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.142+0000 7f8266335700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826012e5d0 con 0x7f8260111db0 2019-11-28T11:44:58.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.142+0000 7f8266335700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8260121040 con 0x7f8260166a10 2019-11-28T11:44:58.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.142+0000 7f82648d2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f826012cea0 0x7f82601230e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39078/0 (socket says 172.21.15.80:39078) 2019-11-28T11:44:58.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.142+0000 7f82648d2700 1 -- 172.21.15.80:0/2822720141 learned_addr learned my addr 172.21.15.80:0/2822720141 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:58.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.142+0000 7f82650d3700 1 --2- 172.21.15.80:0/2822720141 >> v2:172.21.15.174:3300/0 conn(0x7f8260166a10 0x7f8260168e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:58.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f825d7fa700 1 -- 172.21.15.80:0/2822720141 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151071252 0 0) 0x7f824800b3d0 con 0x7f826012cea0 2019-11-28T11:44:58.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f825d7fa700 1 -- 172.21.15.80:0/2822720141 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8244002e80 con 0x7f826012cea0 2019-11-28T11:44:58.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f825d7fa700 1 -- 172.21.15.80:0/2822720141 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818109051 0 0) 0x7f8250001240 con 0x7f8260111db0 2019-11-28T11:44:58.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f825d7fa700 1 -- 172.21.15.80:0/2822720141 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82440030b0 con 0x7f8260111db0 2019-11-28T11:44:58.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f825d7fa700 1 -- 172.21.15.80:0/2822720141 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2827106608 0 0) 0x7f8248000940 con 0x7f826012cea0 2019-11-28T11:44:58.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f82650d3700 1 -- 172.21.15.80:0/2822720141 >> v1:172.21.15.174:6789/0 conn(0x7f8260111db0 legacy=0x7f82601238e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f82650d3700 1 -- 172.21.15.80:0/2822720141 >> v1:172.21.15.80:6789/0 conn(0x7f826012cea0 legacy=0x7f82601230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f82650d3700 1 -- 172.21.15.80:0/2822720141 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82601219a0 con 0x7f8260166a10 2019-11-28T11:44:58.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f82650d3700 1 --2- 172.21.15.80:0/2822720141 >> v2:172.21.15.174:3300/0 conn(0x7f8260166a10 0x7f8260168e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f82580106f0 tx=0x7f8258010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f82650d3700 1 --2- 172.21.15.80:0/2822720141 >> v2:172.21.15.174:3300/0 conn(0x7f8260166a10 0x7f8260168e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f82580106f0 tx=0x7f8258010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f82650d3700 1 --2- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8260166a10 0x7f8260168e10 secure :-1 s=READY pgs=953 cs=0 l=1 rx=0x7f82580106f0 tx=0x7f8258010a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:58.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f82650d3700 1 --2- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8260166a10 0x7f8260168e10 secure :-1 s=THROTTLE_DONE pgs=953 cs=0 l=1 rx=0x7f82580106f0 tx=0x7f8258010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f825d7fa700 1 -- 172.21.15.80:0/2822720141 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8258001270 con 0x7f8260166a10 2019-11-28T11:44:58.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f82650d3700 1 --2- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8260166a10 0x7f8260168e10 secure :-1 s=THROTTLE_DONE pgs=953 cs=0 l=1 rx=0x7f82580106f0 tx=0x7f8258010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f82650d3700 1 --2- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8260166a10 0x7f8260168e10 secure :-1 s=THROTTLE_DONE pgs=953 cs=0 l=1 rx=0x7f82580106f0 tx=0x7f8258010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f825d7fa700 1 -- 172.21.15.80:0/2822720141 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82580045c0 con 0x7f8260166a10 2019-11-28T11:44:58.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f825d7fa700 1 -- 172.21.15.80:0/2822720141 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8258004c90 con 0x7f8260166a10 2019-11-28T11:44:58.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f8266335700 1 -- 172.21.15.80:0/2822720141 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8260121d20 con 0x7f8260166a10 2019-11-28T11:44:58.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.143+0000 7f8266335700 1 -- 172.21.15.80:0/2822720141 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82601219a0 con 0x7f8260166a10 2019-11-28T11:44:58.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.144+0000 7f82650d3700 1 --2- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8260166a10 0x7f8260168e10 secure :-1 s=THROTTLE_DONE pgs=953 cs=0 l=1 rx=0x7f82580106f0 tx=0x7f8258010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.144+0000 7f82650d3700 1 --2- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8260166a10 0x7f8260168e10 secure :-1 s=THROTTLE_DONE pgs=953 cs=0 l=1 rx=0x7f82580106f0 tx=0x7f8258010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.144+0000 7f825d7fa700 1 -- 172.21.15.80:0/2822720141 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8258000cc0 con 0x7f8260166a10 2019-11-28T11:44:58.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.144+0000 7f825d7fa700 1 --2- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8244018750 0x7f824401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:58.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.144+0000 7f825d7fa700 1 -- 172.21.15.80:0/2822720141 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f8258031db0 con 0x7f8260166a10 2019-11-28T11:44:58.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.144+0000 7f82648d2700 1 --2- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8244018750 0x7f824401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:58.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.144+0000 7f82648d2700 1 --2- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8244018750 0x7f824401abe0 crc :-1 s=READY pgs=665 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:58.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.152+0000 7f8266335700 1 -- 172.21.15.80:0/2822720141 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8260121d20 con 0x7f8260166a10 2019-11-28T11:44:58.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.155+0000 7f82650d3700 1 --2- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8260166a10 0x7f8260168e10 secure :-1 s=THROTTLE_DONE pgs=953 cs=0 l=1 rx=0x7f82580106f0 tx=0x7f8258010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.155+0000 7f825d7fa700 1 -- 172.21.15.80:0/2822720141 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8258001580 con 0x7f8260166a10 2019-11-28T11:44:58.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.327+0000 7f8266335700 1 -- 172.21.15.80:0/2822720141 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f82601219a0 con 0x7f8260166a10 2019-11-28T11:44:58.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.327+0000 7f82650d3700 1 --2- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8260166a10 0x7f8260168e10 secure :-1 s=THROTTLE_DONE pgs=953 cs=0 l=1 rx=0x7f82580106f0 tx=0x7f8258010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.327+0000 7f825d7fa700 1 -- 172.21.15.80:0/2822720141 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v43) v1 ==== 80+0+4797 (secure 0 0 0) 0x7f8258000cc0 con 0x7f8260166a10 2019-11-28T11:44:58.367 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:44:58.367 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:44:58.367 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:44:58.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.368 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:44:58.369 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:44:58.369 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.369 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:44:58.370 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:44:58.370 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:44:58.370 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:44:58.370 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.371 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:44:58.371 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:44:58.371 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.372 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:44:58.372 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:44:58.372 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:44:58.373 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:44:58.373 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.373 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:44:58.374 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:44:58.374 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.374 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:44:58.374 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:44:58.374 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:44:58.375 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:44:58.375 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.376 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:44:58.376 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:44:58.376 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.376 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:44:58.376 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:44:58.377 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:44:58.377 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.378 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:44:58.378 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:44:58.378 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.378 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:44:58.378 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:44:58.378 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:44:58.378 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.379 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:44:58.379 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:44:58.380 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.380 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:44:58.380 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:44:58.380 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:44:58.380 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.381 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:44:58.381 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:44:58.381 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.381 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:44:58.381 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:44:58.381 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:44:58.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.382 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:44:58.382 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:44:58.382 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.382 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:44:58.382 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:44:58.383 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:44:58.383 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.383 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:44:58.383 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:44:58.383 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.384 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:44:58.384 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:44:58.384 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:44:58.384 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.385 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:44:58.385 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:44:58.385 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.385 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:44:58.385 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:44:58.385 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:44:58.385 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.386 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:44:58.386 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:44:58.386 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.386 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:44:58.386 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:44:58.386 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:44:58.387 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.387 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:44:58.387 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:44:58.387 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.387 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:44:58.388 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:44:58.388 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:44:58.388 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.388 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:44:58.388 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:44:58.389 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.389 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:44:58.389 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:44:58.389 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:44:58.389 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.390 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:44:58.390 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:44:58.390 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.391 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:44:58.391 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:44:58.391 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:44:58.391 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.391 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:44:58.392 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:44:58.392 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.392 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:44:58.392 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:44:58.392 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:44:58.392 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.393 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:44:58.393 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:44:58.393 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.393 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:44:58.393 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:44:58.394 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:44:58.394 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:44:58.394 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.394 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:44:58.394 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:44:58.394 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.395 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:44:58.395 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:44:58.395 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:44:58.395 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:44:58.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:58.395 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:44:58.396 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:44:58.396 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:44:58.396 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:44:58.396 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:44:58.396 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:44:58.396 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.397 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:58.397 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:44:58.397 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:44:58.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.329+0000 7f8266335700 1 -- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8244018750 msgr2=0x7f824401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.329+0000 7f8266335700 1 --2- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8244018750 0x7f824401abe0 crc :-1 s=READY pgs=665 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.329+0000 7f8266335700 1 -- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8260166a10 msgr2=0x7f8260168e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.329+0000 7f8266335700 1 --2- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8260166a10 0x7f8260168e10 secure :-1 s=READY pgs=953 cs=0 l=1 rx=0x7f82580106f0 tx=0x7f8258010a90).stop 2019-11-28T11:44:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.330+0000 7f8266335700 1 -- 172.21.15.80:0/2822720141 shutdown_connections 2019-11-28T11:44:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.330+0000 7f8266335700 1 --2- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8260166a10 0x7f8260168e10 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:58.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.330+0000 7f8266335700 1 --2- 172.21.15.80:0/2822720141 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8244018750 0x7f824401abe0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.330+0000 7f8266335700 1 -- 172.21.15.80:0/2822720141 shutdown_connections 2019-11-28T11:44:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.330+0000 7f8266335700 1 -- 172.21.15.80:0/2822720141 wait complete. 2019-11-28T11:44:58.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.330+0000 7f8266335700 1 -- 172.21.15.80:0/2822720141 >> 172.21.15.80:0/2822720141 conn(0x7f82601426c0 msgr2=0x7f8260110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:58.401 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:44:58.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.482+0000 7fa4facbb700 1 Processor -- start 2019-11-28T11:44:58.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.482+0000 7fa4facbb700 1 -- start start 2019-11-28T11:44:58.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.483+0000 7fa4facbb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4f406c0a0 0x7fa4f4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:58.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.483+0000 7fa4facbb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa4f40734e0 0x7fa4f4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:58.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.483+0000 7fa4facbb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f406db00 con 0x7fa4f4072360 2019-11-28T11:44:58.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.483+0000 7fa4facbb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f406fd60 con 0x7fa4f406c0a0 2019-11-28T11:44:58.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.483+0000 7fa4facbb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f4070030 con 0x7fa4f40734e0 2019-11-28T11:44:58.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.483+0000 7fa4f9258700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4f406c0a0 0x7fa4f4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:58.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.483+0000 7fa4f9258700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4f406c0a0 0x7fa4f4072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39770/0 (socket says 172.21.15.80:39770) 2019-11-28T11:44:58.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.483+0000 7fa4f9258700 1 -- 172.21.15.80:0/634970242 learned_addr learned my addr 172.21.15.80:0/634970242 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:58.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.483+0000 7fa4f8a57700 1 --2- 172.21.15.80:0/634970242 >> v2:172.21.15.174:3300/0 conn(0x7fa4f40734e0 0x7fa4f4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:58.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.484+0000 7fa4f9258700 1 -- 172.21.15.80:0/634970242 >> v2:172.21.15.174:3300/0 conn(0x7fa4f40734e0 msgr2=0x7fa4f4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:58.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.484+0000 7fa4f9258700 1 --2- 172.21.15.80:0/634970242 >> v2:172.21.15.174:3300/0 conn(0x7fa4f40734e0 0x7fa4f4071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:58.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.484+0000 7fa4f9258700 1 -- 172.21.15.80:0/634970242 >> v1:172.21.15.174:6789/0 conn(0x7fa4f4072360 legacy=0x7fa4f406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.484+0000 7fa4f9258700 1 -- 172.21.15.80:0/634970242 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f40706c0 con 0x7fa4f406c0a0 2019-11-28T11:44:58.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.484+0000 7fa4f8a57700 1 --2- 172.21.15.80:0/634970242 >> v2:172.21.15.174:3300/0 conn(0x7fa4f40734e0 0x7fa4f4071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:44:58.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.484+0000 7fa4f9258700 1 --2- 172.21.15.80:0/634970242 >> v2:172.21.15.80:3300/0 conn(0x7fa4f406c0a0 0x7fa4f4072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa4e400fac0 tx=0x7fa4e400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.484+0000 7fa4f9258700 1 --2- 172.21.15.80:0/634970242 >> v2:172.21.15.80:3300/0 conn(0x7fa4f406c0a0 0x7fa4f4072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa4e400fac0 tx=0x7fa4e400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.484+0000 7fa4f9258700 1 --2- 172.21.15.80:0/634970242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f406c0a0 0x7fa4f4072fa0 secure :-1 s=READY pgs=1645 cs=0 l=1 rx=0x7fa4e400fac0 tx=0x7fa4e400fe60).ready entity=mon.0 client_cookie=48f0901daf4a1271 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:58.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.484+0000 7fa4f9258700 1 --2- 172.21.15.80:0/634970242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f406c0a0 0x7fa4f4072fa0 secure :-1 s=THROTTLE_DONE pgs=1645 cs=0 l=1 rx=0x7fa4e400fac0 tx=0x7fa4e400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.484+0000 7fa4f9258700 1 --2- 172.21.15.80:0/634970242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f406c0a0 0x7fa4f4072fa0 secure :-1 s=THROTTLE_DONE pgs=1645 cs=0 l=1 rx=0x7fa4e400fac0 tx=0x7fa4e400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.484+0000 7fa4f9258700 1 --2- 172.21.15.80:0/634970242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f406c0a0 0x7fa4f4072fa0 secure :-1 s=THROTTLE_DONE pgs=1645 cs=0 l=1 rx=0x7fa4e400fac0 tx=0x7fa4e400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.484+0000 7fa4f3fff700 1 -- 172.21.15.80:0/634970242 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4e4000ce0 con 0x7fa4f406c0a0 2019-11-28T11:44:58.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.484+0000 7fa4f3fff700 1 -- 172.21.15.80:0/634970242 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e4001010 con 0x7fa4f406c0a0 2019-11-28T11:44:58.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.484+0000 7fa4f3fff700 1 -- 172.21.15.80:0/634970242 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4e4001720 con 0x7fa4f406c0a0 2019-11-28T11:44:58.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.484+0000 7fa4facbb700 1 -- 172.21.15.80:0/634970242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f406c0a0 msgr2=0x7fa4f4072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.484+0000 7fa4facbb700 1 --2- 172.21.15.80:0/634970242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f406c0a0 0x7fa4f4072fa0 secure :-1 s=READY pgs=1645 cs=0 l=1 rx=0x7fa4e400fac0 tx=0x7fa4e400fe60).stop 2019-11-28T11:44:58.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.485+0000 7fa4facbb700 1 -- 172.21.15.80:0/634970242 shutdown_connections 2019-11-28T11:44:58.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.485+0000 7fa4facbb700 1 --2- 172.21.15.80:0/634970242 >> v2:172.21.15.174:3300/0 conn(0x7fa4f40734e0 0x7fa4f4071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:58.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.485+0000 7fa4facbb700 1 --2- 172.21.15.80:0/634970242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f406c0a0 0x7fa4f4072fa0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:58.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.485+0000 7fa4facbb700 1 -- 172.21.15.80:0/634970242 shutdown_connections 2019-11-28T11:44:58.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.485+0000 7fa4facbb700 1 -- 172.21.15.80:0/634970242 wait complete. 2019-11-28T11:44:58.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.485+0000 7fa4facbb700 1 -- 172.21.15.80:0/634970242 >> 172.21.15.80:0/634970242 conn(0x7fa4f4061cf0 msgr2=0x7fa4f4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:58.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.487+0000 7fa4facbb700 1 Processor -- start 2019-11-28T11:44:58.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.487+0000 7fa4facbb700 1 -- start start 2019-11-28T11:44:58.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.488+0000 7fa4facbb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4f413e5f0 0x7fa4f413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:58.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.488+0000 7fa4facbb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa4f410a070 0x7fa4f410bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:58.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.488+0000 7fa4facbb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f41066e0 con 0x7fa4f410a4e0 2019-11-28T11:44:58.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.488+0000 7fa4facbb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f410e060 con 0x7fa4f413e5f0 2019-11-28T11:44:58.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.488+0000 7fa4facbb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f410e330 con 0x7fa4f410a070 2019-11-28T11:44:58.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.488+0000 7fa4f9258700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4f413e5f0 0x7fa4f413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:58.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.488+0000 7fa4f9258700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4f413e5f0 0x7fa4f413e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39776/0 (socket says 172.21.15.80:39776) 2019-11-28T11:44:58.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.488+0000 7fa4f9258700 1 -- 172.21.15.80:0/3200223774 learned_addr learned my addr 172.21.15.80:0/3200223774 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:58.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.488+0000 7fa4f8a57700 1 --2- 172.21.15.80:0/3200223774 >> v2:172.21.15.174:3300/0 conn(0x7fa4f410a070 0x7fa4f410bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:58.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.488+0000 7fa4f9258700 1 -- 172.21.15.80:0/3200223774 >> v2:172.21.15.174:3300/0 conn(0x7fa4f410a070 msgr2=0x7fa4f410bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.488+0000 7fa4f9258700 1 --2- 172.21.15.80:0/3200223774 >> v2:172.21.15.174:3300/0 conn(0x7fa4f410a070 0x7fa4f410bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:58.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.488+0000 7fa4f9258700 1 -- 172.21.15.80:0/3200223774 >> v1:172.21.15.174:6789/0 conn(0x7fa4f410a4e0 legacy=0x7fa4f410c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.488+0000 7fa4f9258700 1 -- 172.21.15.80:0/3200223774 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f410e9c0 con 0x7fa4f413e5f0 2019-11-28T11:44:58.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.489+0000 7fa4f9258700 1 --2- 172.21.15.80:0/3200223774 >> v2:172.21.15.80:3300/0 conn(0x7fa4f413e5f0 0x7fa4f413e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4e40107d0 tx=0x7fa4e4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.489+0000 7fa4f9258700 1 --2- 172.21.15.80:0/3200223774 >> v2:172.21.15.80:3300/0 conn(0x7fa4f413e5f0 0x7fa4f413e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4e40107d0 tx=0x7fa4e4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.489+0000 7fa4f9258700 1 --2- 172.21.15.80:0/3200223774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f413e5f0 0x7fa4f413e9e0 secure :-1 s=READY pgs=1646 cs=0 l=1 rx=0x7fa4e40107d0 tx=0x7fa4e4010650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:58.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.489+0000 7fa4f9258700 1 --2- 172.21.15.80:0/3200223774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f413e5f0 0x7fa4f413e9e0 secure :-1 s=THROTTLE_DONE pgs=1646 cs=0 l=1 rx=0x7fa4e40107d0 tx=0x7fa4e4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.489+0000 7fa4f1ffb700 1 -- 172.21.15.80:0/3200223774 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4e4005af0 con 0x7fa4f413e5f0 2019-11-28T11:44:58.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.489+0000 7fa4f9258700 1 --2- 172.21.15.80:0/3200223774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f413e5f0 0x7fa4f413e9e0 secure :-1 s=THROTTLE_DONE pgs=1646 cs=0 l=1 rx=0x7fa4e40107d0 tx=0x7fa4e4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.489+0000 7fa4f9258700 1 --2- 172.21.15.80:0/3200223774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f413e5f0 0x7fa4f413e9e0 secure :-1 s=THROTTLE_DONE pgs=1646 cs=0 l=1 rx=0x7fa4e40107d0 tx=0x7fa4e4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.489+0000 7fa4f1ffb700 1 -- 172.21.15.80:0/3200223774 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e4005710 con 0x7fa4f413e5f0 2019-11-28T11:44:58.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.489+0000 7fa4facbb700 1 -- 172.21.15.80:0/3200223774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f410ed40 con 0x7fa4f413e5f0 2019-11-28T11:44:58.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.489+0000 7fa4f1ffb700 1 -- 172.21.15.80:0/3200223774 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4e40060d0 con 0x7fa4f413e5f0 2019-11-28T11:44:58.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.489+0000 7fa4facbb700 1 -- 172.21.15.80:0/3200223774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f410e9c0 con 0x7fa4f413e5f0 2019-11-28T11:44:58.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.489+0000 7fa4f9258700 1 --2- 172.21.15.80:0/3200223774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f413e5f0 0x7fa4f413e9e0 secure :-1 s=THROTTLE_DONE pgs=1646 cs=0 l=1 rx=0x7fa4e40107d0 tx=0x7fa4e4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.490+0000 7fa4f1ffb700 1 -- 172.21.15.80:0/3200223774 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa4e4005900 con 0x7fa4f413e5f0 2019-11-28T11:44:58.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.490+0000 7fa4f9258700 1 --2- 172.21.15.80:0/3200223774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f413e5f0 0x7fa4f413e9e0 secure :-1 s=THROTTLE_DONE pgs=1646 cs=0 l=1 rx=0x7fa4e40107d0 tx=0x7fa4e4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.490+0000 7fa4f1ffb700 1 --2- 172.21.15.80:0/3200223774 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4d4018730 0x7fa4d401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:58.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.490+0000 7fa4f1ffb700 1 -- 172.21.15.80:0/3200223774 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fa4e4031e40 con 0x7fa4f413e5f0 2019-11-28T11:44:58.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.490+0000 7fa4f8a57700 1 --2- 172.21.15.80:0/3200223774 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4d4018730 0x7fa4d401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:58.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.490+0000 7fa4f8a57700 1 --2- 172.21.15.80:0/3200223774 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4d4018730 0x7fa4d401abc0 crc :-1 s=READY pgs=666 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:58.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.497+0000 7fa4facbb700 1 -- 172.21.15.80:0/3200223774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f410ed40 con 0x7fa4f413e5f0 2019-11-28T11:44:58.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.501+0000 7fa4f9258700 1 --2- 172.21.15.80:0/3200223774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f413e5f0 0x7fa4f413e9e0 secure :-1 s=THROTTLE_DONE pgs=1646 cs=0 l=1 rx=0x7fa4e40107d0 tx=0x7fa4e4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.501+0000 7fa4f1ffb700 1 -- 172.21.15.80:0/3200223774 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa4e402b030 con 0x7fa4f413e5f0 2019-11-28T11:44:58.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.677+0000 7fa4facbb700 1 -- 172.21.15.80:0/3200223774 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4f410e9c0 con 0x7fa4f413e5f0 2019-11-28T11:44:58.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.678+0000 7fa4f9258700 1 --2- 172.21.15.80:0/3200223774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f413e5f0 0x7fa4f413e9e0 secure :-1 s=THROTTLE_DONE pgs=1646 cs=0 l=1 rx=0x7fa4e40107d0 tx=0x7fa4e4010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.678+0000 7fa4f1ffb700 1 -- 172.21.15.80:0/3200223774 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+12010 (secure 0 0 0) 0x7fa4e402b030 con 0x7fa4f413e5f0 2019-11-28T11:44:58.717 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:44:58.718 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":124,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:44:57.988224+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:44:58.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.680+0000 7fa4facbb700 1 -- 172.21.15.80:0/3200223774 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4d4018730 msgr2=0x7fa4d401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.680+0000 7fa4facbb700 1 --2- 172.21.15.80:0/3200223774 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4d4018730 0x7fa4d401abc0 crc :-1 s=READY pgs=666 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:58.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.680+0000 7fa4facbb700 1 -- 172.21.15.80:0/3200223774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f413e5f0 msgr2=0x7fa4f413e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.680+0000 7fa4facbb700 1 --2- 172.21.15.80:0/3200223774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f413e5f0 0x7fa4f413e9e0 secure :-1 s=READY pgs=1646 cs=0 l=1 rx=0x7fa4e40107d0 tx=0x7fa4e4010650).stop 2019-11-28T11:44:58.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.680+0000 7fa4facbb700 1 -- 172.21.15.80:0/3200223774 shutdown_connections 2019-11-28T11:44:58.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.680+0000 7fa4facbb700 1 --2- 172.21.15.80:0/3200223774 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4d4018730 0x7fa4d401abc0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:58.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.680+0000 7fa4facbb700 1 --2- 172.21.15.80:0/3200223774 >> v2:172.21.15.174:3300/0 conn(0x7fa4f410a070 0x7fa4f410bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:58.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.680+0000 7fa4facbb700 1 --2- 172.21.15.80:0/3200223774 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4f413e5f0 0x7fa4f413e9e0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:58.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.680+0000 7fa4facbb700 1 -- 172.21.15.80:0/3200223774 shutdown_connections 2019-11-28T11:44:58.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.680+0000 7fa4facbb700 1 -- 172.21.15.80:0/3200223774 wait complete. 2019-11-28T11:44:58.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.680+0000 7fa4facbb700 1 -- 172.21.15.80:0/3200223774 >> 172.21.15.80:0/3200223774 conn(0x7fa4f413d620 msgr2=0x7fa4f413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:58.730 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:44:58.730 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:44:58.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.815+0000 7f5ee0c63700 1 Processor -- start 2019-11-28T11:44:58.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.815+0000 7f5ee0c63700 1 -- start start 2019-11-28T11:44:58.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5ee0c63700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5edc15f100 0x7f5edc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:58.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5ee0c63700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc06db60 con 0x7f5edc06c2f0 2019-11-28T11:44:58.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5ee0c63700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc06e060 con 0x7f5edc15ed10 2019-11-28T11:44:58.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5ee0c63700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5edc06fe00 con 0x7f5edc15f100 2019-11-28T11:44:58.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5eda59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5edc15f100 0x7f5edc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:58.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5edb59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5edc06c2f0 0x7f5edc06c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39102/0 (socket says 172.21.15.80:39102) 2019-11-28T11:44:58.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5eda59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5edc15f100 0x7f5edc06bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39788/0 (socket says 172.21.15.80:39788) 2019-11-28T11:44:58.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5edb59e700 1 -- 172.21.15.80:0/785088981 learned_addr learned my addr 172.21.15.80:0/785088981 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:58.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5eda59c700 1 -- 172.21.15.80:0/785088981 >> v1:172.21.15.174:6789/0 conn(0x7f5edc15ed10 legacy=0x7f5edc073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5eda59c700 1 -- 172.21.15.80:0/785088981 >> v1:172.21.15.80:6789/0 conn(0x7f5edc06c2f0 legacy=0x7f5edc06c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5ed9d9b700 1 -- 172.21.15.80:0/785088981 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494491203 0 0) 0x7f5ecc001400 con 0x7f5edc15ed10 2019-11-28T11:44:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5eda59c700 1 -- 172.21.15.80:0/785088981 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc070760 con 0x7f5edc15f100 2019-11-28T11:44:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5eda59c700 1 --2- 172.21.15.80:0/785088981 >> v2:172.21.15.80:3300/0 conn(0x7f5edc15f100 0x7f5edc06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5ec400af50 tx=0x7f5ec400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5eda59c700 1 --2- 172.21.15.80:0/785088981 >> v2:172.21.15.80:3300/0 conn(0x7f5edc15f100 0x7f5edc06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5ec400af50 tx=0x7f5ec400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5eda59c700 1 --2- 172.21.15.80:0/785088981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc15f100 0x7f5edc06bdb0 secure :-1 s=READY pgs=1648 cs=0 l=1 rx=0x7f5ec400af50 tx=0x7f5ec400b760).ready entity=mon.0 client_cookie=860b743a9bcbdd73 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5eda59c700 1 --2- 172.21.15.80:0/785088981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc15f100 0x7f5edc06bdb0 secure :-1 s=THROTTLE_DONE pgs=1648 cs=0 l=1 rx=0x7f5ec400af50 tx=0x7f5ec400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.816+0000 7f5ed9d9b700 1 -- 172.21.15.80:0/785088981 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ec4000960 con 0x7f5edc15f100 2019-11-28T11:44:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.817+0000 7f5eda59c700 1 --2- 172.21.15.80:0/785088981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc15f100 0x7f5edc06bdb0 secure :-1 s=THROTTLE_DONE pgs=1648 cs=0 l=1 rx=0x7f5ec400af50 tx=0x7f5ec400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.817+0000 7f5eda59c700 1 --2- 172.21.15.80:0/785088981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc15f100 0x7f5edc06bdb0 secure :-1 s=THROTTLE_DONE pgs=1648 cs=0 l=1 rx=0x7f5ec400af50 tx=0x7f5ec400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.817+0000 7f5ed9d9b700 1 -- 172.21.15.80:0/785088981 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec4009860 con 0x7f5edc15f100 2019-11-28T11:44:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.817+0000 7f5ed9d9b700 1 -- 172.21.15.80:0/785088981 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ec4009f30 con 0x7f5edc15f100 2019-11-28T11:44:58.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.817+0000 7f5ee0c63700 1 -- 172.21.15.80:0/785088981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc15f100 msgr2=0x7f5edc06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.817+0000 7f5ee0c63700 1 --2- 172.21.15.80:0/785088981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc15f100 0x7f5edc06bdb0 secure :-1 s=READY pgs=1648 cs=0 l=1 rx=0x7f5ec400af50 tx=0x7f5ec400b760).stop 2019-11-28T11:44:58.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.817+0000 7f5ee0c63700 1 -- 172.21.15.80:0/785088981 shutdown_connections 2019-11-28T11:44:58.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.817+0000 7f5ee0c63700 1 --2- 172.21.15.80:0/785088981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc15f100 0x7f5edc06bdb0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:58.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.817+0000 7f5ee0c63700 1 -- 172.21.15.80:0/785088981 shutdown_connections 2019-11-28T11:44:58.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.817+0000 7f5ee0c63700 1 -- 172.21.15.80:0/785088981 wait complete. 2019-11-28T11:44:58.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.817+0000 7f5ee0c63700 1 -- 172.21.15.80:0/785088981 >> 172.21.15.80:0/785088981 conn(0x7f5edc061d20 msgr2=0x7f5edc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:58.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.820+0000 7f5ee0c63700 1 Processor -- start 2019-11-28T11:44:58.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.820+0000 7f5ee0c63700 1 -- start start 2019-11-28T11:44:58.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5ee0c63700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5edc10e970 0x7f5edc1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:58.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5ee0c63700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5edc107e30 0x7f5edc167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:58.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5ee0c63700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc10c250 con 0x7f5edc108cf0 2019-11-28T11:44:58.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5ee0c63700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5edc10e430 con 0x7f5edc107e30 2019-11-28T11:44:58.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5ee0c63700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5edc105860 con 0x7f5edc10e970 2019-11-28T11:44:58.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5edb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5edc107e30 0x7f5edc167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:58.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5edb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5edc107e30 0x7f5edc167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39794/0 (socket says 172.21.15.80:39794) 2019-11-28T11:44:58.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5edb59e700 1 -- 172.21.15.80:0/1850703154 learned_addr learned my addr 172.21.15.80:0/1850703154 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:58.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5edb59e700 1 -- 172.21.15.80:0/1850703154 >> v2:172.21.15.174:3300/0 conn(0x7f5edc10e970 msgr2=0x7f5edc1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5edad9d700 1 --2- 172.21.15.80:0/1850703154 >> v2:172.21.15.174:3300/0 conn(0x7f5edc10e970 0x7f5edc1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:58.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5edb59e700 1 --2- 172.21.15.80:0/1850703154 >> v2:172.21.15.174:3300/0 conn(0x7f5edc10e970 0x7f5edc1087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:58.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5edb59e700 1 -- 172.21.15.80:0/1850703154 >> v1:172.21.15.174:6789/0 conn(0x7f5edc108cf0 legacy=0x7f5edc107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:58.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5edb59e700 1 -- 172.21.15.80:0/1850703154 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc105ef0 con 0x7f5edc107e30 2019-11-28T11:44:58.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5edad9d700 1 --2- 172.21.15.80:0/1850703154 >> v2:172.21.15.174:3300/0 conn(0x7f5edc10e970 0x7f5edc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:44:58.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5edb59e700 1 --2- 172.21.15.80:0/1850703154 >> v2:172.21.15.80:3300/0 conn(0x7f5edc107e30 0x7f5edc167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ed4010410 tx=0x7f5ed40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5edb59e700 1 --2- 172.21.15.80:0/1850703154 >> v2:172.21.15.80:3300/0 conn(0x7f5edc107e30 0x7f5edc167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ed4010410 tx=0x7f5ed40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5edb59e700 1 --2- 172.21.15.80:0/1850703154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc107e30 0x7f5edc167d70 secure :-1 s=READY pgs=1649 cs=0 l=1 rx=0x7f5ed4010410 tx=0x7f5ed40107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:58.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5edb59e700 1 --2- 172.21.15.80:0/1850703154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc107e30 0x7f5edc167d70 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7f5ed4010410 tx=0x7f5ed40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5edb59e700 1 --2- 172.21.15.80:0/1850703154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc107e30 0x7f5edc167d70 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7f5ed4010410 tx=0x7f5ed40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5edb59e700 1 --2- 172.21.15.80:0/1850703154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc107e30 0x7f5edc167d70 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7f5ed4010410 tx=0x7f5ed40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5ed37fe700 1 -- 172.21.15.80:0/1850703154 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ed4000960 con 0x7f5edc107e30 2019-11-28T11:44:58.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5ed37fe700 1 -- 172.21.15.80:0/1850703154 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed40010e0 con 0x7f5edc107e30 2019-11-28T11:44:58.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5ee0c63700 1 -- 172.21.15.80:0/1850703154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5edc106270 con 0x7f5edc107e30 2019-11-28T11:44:58.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5ed37fe700 1 -- 172.21.15.80:0/1850703154 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ed4001770 con 0x7f5edc107e30 2019-11-28T11:44:58.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.821+0000 7f5ee0c63700 1 -- 172.21.15.80:0/1850703154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5edc105ef0 con 0x7f5edc107e30 2019-11-28T11:44:58.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.822+0000 7f5edb59e700 1 --2- 172.21.15.80:0/1850703154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc107e30 0x7f5edc167d70 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7f5ed4010410 tx=0x7f5ed40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.822+0000 7f5ed37fe700 1 -- 172.21.15.80:0/1850703154 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5ed40012d0 con 0x7f5edc107e30 2019-11-28T11:44:58.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.822+0000 7f5edb59e700 1 --2- 172.21.15.80:0/1850703154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc107e30 0x7f5edc167d70 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7f5ed4010410 tx=0x7f5ed40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.822+0000 7f5ed37fe700 1 --2- 172.21.15.80:0/1850703154 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5ec0018730 0x7f5ec001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:58.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.822+0000 7f5ed37fe700 1 -- 172.21.15.80:0/1850703154 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f5ed4031a70 con 0x7f5edc107e30 2019-11-28T11:44:58.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.822+0000 7f5edad9d700 1 --2- 172.21.15.80:0/1850703154 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5ec0018730 0x7f5ec001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:58.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.822+0000 7f5edad9d700 1 --2- 172.21.15.80:0/1850703154 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5ec0018730 0x7f5ec001abc0 crc :-1 s=READY pgs=667 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:58.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.830+0000 7f5ee0c63700 1 -- 172.21.15.80:0/1850703154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5edc106270 con 0x7f5edc107e30 2019-11-28T11:44:58.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.833+0000 7f5edb59e700 1 --2- 172.21.15.80:0/1850703154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc107e30 0x7f5edc167d70 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7f5ed4010410 tx=0x7f5ed40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:58.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:58.833+0000 7f5ed37fe700 1 -- 172.21.15.80:0/1850703154 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5ed40075b0 con 0x7f5edc107e30 2019-11-28T11:44:59.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.001+0000 7f5ee0c63700 1 -- 172.21.15.80:0/1850703154 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f5edc105ef0 con 0x7f5edc107e30 2019-11-28T11:44:59.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.001+0000 7f5edb59e700 1 --2- 172.21.15.80:0/1850703154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc107e30 0x7f5edc167d70 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7f5ed4010410 tx=0x7f5ed40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.001+0000 7f5ed37fe700 1 -- 172.21.15.80:0/1850703154 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v124) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5ed40012d0 con 0x7f5edc107e30 2019-11-28T11:44:59.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.004+0000 7f5ee0c63700 1 -- 172.21.15.80:0/1850703154 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5ec0018730 msgr2=0x7f5ec001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:59.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.004+0000 7f5ee0c63700 1 --2- 172.21.15.80:0/1850703154 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5ec0018730 0x7f5ec001abc0 crc :-1 s=READY pgs=667 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:59.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.004+0000 7f5ee0c63700 1 -- 172.21.15.80:0/1850703154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc107e30 msgr2=0x7f5edc167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:59.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.004+0000 7f5ee0c63700 1 --2- 172.21.15.80:0/1850703154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc107e30 0x7f5edc167d70 secure :-1 s=READY pgs=1649 cs=0 l=1 rx=0x7f5ed4010410 tx=0x7f5ed40107b0).stop 2019-11-28T11:44:59.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.004+0000 7f5ee0c63700 1 -- 172.21.15.80:0/1850703154 shutdown_connections 2019-11-28T11:44:59.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.004+0000 7f5ee0c63700 1 --2- 172.21.15.80:0/1850703154 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5edc107e30 0x7f5edc167d70 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:59.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.004+0000 7f5ee0c63700 1 --2- 172.21.15.80:0/1850703154 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5ec0018730 0x7f5ec001abc0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:59.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.004+0000 7f5ee0c63700 1 --2- 172.21.15.80:0/1850703154 >> v2:172.21.15.174:3300/0 conn(0x7f5edc10e970 0x7f5edc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:59.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.004+0000 7f5ee0c63700 1 -- 172.21.15.80:0/1850703154 shutdown_connections 2019-11-28T11:44:59.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.004+0000 7f5ee0c63700 1 -- 172.21.15.80:0/1850703154 wait complete. 2019-11-28T11:44:59.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.004+0000 7f5ee0c63700 1 -- 172.21.15.80:0/1850703154 >> 172.21.15.80:0/1850703154 conn(0x7f5edc15e2d0 msgr2=0x7f5edc147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:59.048 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:44:59.053 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:44:59.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.133+0000 7fef8af91700 1 Processor -- start 2019-11-28T11:44:59.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.133+0000 7fef8af91700 1 -- start start 2019-11-28T11:44:59.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.134+0000 7fef8af91700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fef8406c0a0 0x7fef84072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:59.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.134+0000 7fef8af91700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef840734e0 0x7fef84071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:59.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.134+0000 7fef8af91700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8406db00 con 0x7fef84072360 2019-11-28T11:44:59.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.134+0000 7fef8af91700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8406fd60 con 0x7fef8406c0a0 2019-11-28T11:44:59.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.134+0000 7fef8af91700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef84070030 con 0x7fef840734e0 2019-11-28T11:44:59.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef88d2d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef840734e0 0x7fef84071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:59.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef8952e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fef8406c0a0 0x7fef84072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:59.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef89d2f700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fef84072360 0x7fef8406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:54660/0 (socket says 172.21.15.80:54660) 2019-11-28T11:44:59.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef89d2f700 1 -- 172.21.15.80:0/2891823455 learned_addr learned my addr 172.21.15.80:0/2891823455 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:59.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef8952e700 1 --2- 172.21.15.80:0/2891823455 >> v2:172.21.15.174:3300/0 conn(0x7fef8406c0a0 0x7fef84072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:54684/0 (socket says 172.21.15.80:54684) 2019-11-28T11:44:59.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef8952e700 1 -- 172.21.15.80:0/2891823455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef840734e0 msgr2=0x7fef84071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:44:59.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef8952e700 1 --2- 172.21.15.80:0/2891823455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef840734e0 0x7fef84071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:59.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef8952e700 1 -- 172.21.15.80:0/2891823455 >> v1:172.21.15.174:6789/0 conn(0x7fef84072360 legacy=0x7fef8406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:59.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef83fff700 1 -- 172.21.15.80:0/2891823455 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162888152 0 0) 0x7fef7c001100 con 0x7fef84072360 2019-11-28T11:44:59.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef8952e700 1 -- 172.21.15.80:0/2891823455 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef840706c0 con 0x7fef8406c0a0 2019-11-28T11:44:59.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef88d2d700 1 --2- 172.21.15.80:0/2891823455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef840734e0 0x7fef84071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:44:59.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef8952e700 1 --2- 172.21.15.80:0/2891823455 >> v2:172.21.15.174:3300/0 conn(0x7fef8406c0a0 0x7fef84072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fef7400af50 tx=0x7fef7400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef8952e700 1 --2- 172.21.15.80:0/2891823455 >> v2:172.21.15.174:3300/0 conn(0x7fef8406c0a0 0x7fef84072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fef7400af50 tx=0x7fef7400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef8952e700 1 --2- 172.21.15.80:0/2891823455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef8406c0a0 0x7fef84072fa0 secure :-1 s=READY pgs=959 cs=0 l=1 rx=0x7fef7400af50 tx=0x7fef7400b760).ready entity=mon.1 client_cookie=14d03c2c92fc815d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef8952e700 1 --2- 172.21.15.80:0/2891823455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef8406c0a0 0x7fef84072fa0 secure :-1 s=THROTTLE_DONE pgs=959 cs=0 l=1 rx=0x7fef7400af50 tx=0x7fef7400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef83fff700 1 -- 172.21.15.80:0/2891823455 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef74007210 con 0x7fef8406c0a0 2019-11-28T11:44:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef8952e700 1 --2- 172.21.15.80:0/2891823455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef8406c0a0 0x7fef84072fa0 secure :-1 s=THROTTLE_DONE pgs=959 cs=0 l=1 rx=0x7fef7400af50 tx=0x7fef7400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef8952e700 1 --2- 172.21.15.80:0/2891823455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef8406c0a0 0x7fef84072fa0 secure :-1 s=THROTTLE_DONE pgs=959 cs=0 l=1 rx=0x7fef7400af50 tx=0x7fef7400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef83fff700 1 -- 172.21.15.80:0/2891823455 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef740099b0 con 0x7fef8406c0a0 2019-11-28T11:44:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef83fff700 1 -- 172.21.15.80:0/2891823455 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef7400a080 con 0x7fef8406c0a0 2019-11-28T11:44:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef8af91700 1 -- 172.21.15.80:0/2891823455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef8406c0a0 msgr2=0x7fef84072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.135+0000 7fef8af91700 1 --2- 172.21.15.80:0/2891823455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef8406c0a0 0x7fef84072fa0 secure :-1 s=READY pgs=959 cs=0 l=1 rx=0x7fef7400af50 tx=0x7fef7400b760).stop 2019-11-28T11:44:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.136+0000 7fef8af91700 1 -- 172.21.15.80:0/2891823455 shutdown_connections 2019-11-28T11:44:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.136+0000 7fef8af91700 1 --2- 172.21.15.80:0/2891823455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef840734e0 0x7fef84071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:44:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.136+0000 7fef8af91700 1 --2- 172.21.15.80:0/2891823455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef8406c0a0 0x7fef84072fa0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.136+0000 7fef8af91700 1 -- 172.21.15.80:0/2891823455 shutdown_connections 2019-11-28T11:44:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.136+0000 7fef8af91700 1 -- 172.21.15.80:0/2891823455 wait complete. 2019-11-28T11:44:59.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.136+0000 7fef8af91700 1 -- 172.21.15.80:0/2891823455 >> 172.21.15.80:0/2891823455 conn(0x7fef84061cf0 msgr2=0x7fef84064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:59.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.139+0000 7fef8af91700 1 Processor -- start 2019-11-28T11:44:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.139+0000 7fef8af91700 1 -- start start 2019-11-28T11:44:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef8af91700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef84164ff0 0x7fef841653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef8af91700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef84133cb0 0x7fef84132ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:59.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef8af91700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef84131680 con 0x7fef84133820 2019-11-28T11:44:59.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef8af91700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8410d360 con 0x7fef84133cb0 2019-11-28T11:44:59.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef8af91700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8410dd90 con 0x7fef84164ff0 2019-11-28T11:44:59.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef89d2f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef84133cb0 0x7fef84132ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:59.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef89d2f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef84133cb0 0x7fef84132ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39808/0 (socket says 172.21.15.80:39808) 2019-11-28T11:44:59.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef8952e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef84164ff0 0x7fef841653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:59.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef89d2f700 1 -- 172.21.15.80:0/3389434363 learned_addr learned my addr 172.21.15.80:0/3389434363 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:44:59.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef89d2f700 1 -- 172.21.15.80:0/3389434363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef84164ff0 msgr2=0x7fef841653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:59.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef89d2f700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef84164ff0 0x7fef841653e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:59.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef81ffb700 1 -- 172.21.15.80:0/3389434363 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940003225 0 0) 0x7fef6c00df00 con 0x7fef84133820 2019-11-28T11:44:59.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef89d2f700 1 -- 172.21.15.80:0/3389434363 >> v1:172.21.15.174:6789/0 conn(0x7fef84133820 legacy=0x7fef841326a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:59.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef89d2f700 1 -- 172.21.15.80:0/3389434363 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8410e6f0 con 0x7fef84133cb0 2019-11-28T11:44:59.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef8952e700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef84164ff0 0x7fef841653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:44:59.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef89d2f700 1 --2- 172.21.15.80:0/3389434363 >> v2:172.21.15.80:3300/0 conn(0x7fef84133cb0 0x7fef84132ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fef7c010450 tx=0x7fef7c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef89d2f700 1 --2- 172.21.15.80:0/3389434363 >> v2:172.21.15.80:3300/0 conn(0x7fef84133cb0 0x7fef84132ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fef7c010450 tx=0x7fef7c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef89d2f700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef84133cb0 0x7fef84132ea0 secure :-1 s=READY pgs=1650 cs=0 l=1 rx=0x7fef7c010450 tx=0x7fef7c0107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:59.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef89d2f700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef84133cb0 0x7fef84132ea0 secure :-1 s=THROTTLE_DONE pgs=1650 cs=0 l=1 rx=0x7fef7c010450 tx=0x7fef7c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef81ffb700 1 -- 172.21.15.80:0/3389434363 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef7c000ef0 con 0x7fef84133cb0 2019-11-28T11:44:59.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef89d2f700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef84133cb0 0x7fef84132ea0 secure :-1 s=THROTTLE_DONE pgs=1650 cs=0 l=1 rx=0x7fef7c010450 tx=0x7fef7c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef8af91700 1 -- 172.21.15.80:0/3389434363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8410ea70 con 0x7fef84133cb0 2019-11-28T11:44:59.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef81ffb700 1 -- 172.21.15.80:0/3389434363 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c000ef0 con 0x7fef84133cb0 2019-11-28T11:44:59.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef89d2f700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef84133cb0 0x7fef84132ea0 secure :-1 s=THROTTLE_DONE pgs=1650 cs=0 l=1 rx=0x7fef7c010450 tx=0x7fef7c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef81ffb700 1 -- 172.21.15.80:0/3389434363 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef7c0043b0 con 0x7fef84133cb0 2019-11-28T11:44:59.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.140+0000 7fef8af91700 1 -- 172.21.15.80:0/3389434363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8410e6f0 con 0x7fef84133cb0 2019-11-28T11:44:59.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.141+0000 7fef89d2f700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef84133cb0 0x7fef84132ea0 secure :-1 s=THROTTLE_DONE pgs=1650 cs=0 l=1 rx=0x7fef7c010450 tx=0x7fef7c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.141+0000 7fef81ffb700 1 -- 172.21.15.80:0/3389434363 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fef7c0041c0 con 0x7fef84133cb0 2019-11-28T11:44:59.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.141+0000 7fef89d2f700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef84133cb0 0x7fef84132ea0 secure :-1 s=THROTTLE_DONE pgs=1650 cs=0 l=1 rx=0x7fef7c010450 tx=0x7fef7c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.141+0000 7fef81ffb700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef68018730 0x7fef6801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:59.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.141+0000 7fef81ffb700 1 -- 172.21.15.80:0/3389434363 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fef7c031ab0 con 0x7fef84133cb0 2019-11-28T11:44:59.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.141+0000 7fef8952e700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef68018730 0x7fef6801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:59.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.141+0000 7fef8952e700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef68018730 0x7fef6801abc0 crc :-1 s=READY pgs=668 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:59.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.149+0000 7fef8af91700 1 -- 172.21.15.80:0/3389434363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8410ea70 con 0x7fef84133cb0 2019-11-28T11:44:59.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.152+0000 7fef89d2f700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef84133cb0 0x7fef84132ea0 secure :-1 s=THROTTLE_DONE pgs=1650 cs=0 l=1 rx=0x7fef7c010450 tx=0x7fef7c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.152+0000 7fef81ffb700 1 -- 172.21.15.80:0/3389434363 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fef7c001310 con 0x7fef84133cb0 2019-11-28T11:44:59.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.315+0000 7fef8af91700 1 -- 172.21.15.80:0/3389434363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fef8410e6f0 con 0x7fef84133cb0 2019-11-28T11:44:59.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.316+0000 7fef89d2f700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef84133cb0 0x7fef84132ea0 secure :-1 s=THROTTLE_DONE pgs=1650 cs=0 l=1 rx=0x7fef7c010450 tx=0x7fef7c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.316+0000 7fef81ffb700 1 -- 172.21.15.80:0/3389434363 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v124) v1 ==== 84+0+64 (secure 0 0 0) 0x7fef7c01f8e0 con 0x7fef84133cb0 2019-11-28T11:44:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:44:59.355 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:44:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:44:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:44:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:44:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:44:59.356 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:44:59.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.318+0000 7fef8af91700 1 -- 172.21.15.80:0/3389434363 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef68018730 msgr2=0x7fef6801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:59.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.318+0000 7fef8af91700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef68018730 0x7fef6801abc0 crc :-1 s=READY pgs=668 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:59.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.318+0000 7fef8af91700 1 -- 172.21.15.80:0/3389434363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef84133cb0 msgr2=0x7fef84132ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:59.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.318+0000 7fef8af91700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef84133cb0 0x7fef84132ea0 secure :-1 s=READY pgs=1650 cs=0 l=1 rx=0x7fef7c010450 tx=0x7fef7c0107f0).stop 2019-11-28T11:44:59.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.318+0000 7fef8af91700 1 -- 172.21.15.80:0/3389434363 shutdown_connections 2019-11-28T11:44:59.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.318+0000 7fef8af91700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef84133cb0 0x7fef84132ea0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:59.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.318+0000 7fef8af91700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef68018730 0x7fef6801abc0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:59.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.318+0000 7fef8af91700 1 --2- 172.21.15.80:0/3389434363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef84164ff0 0x7fef841653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:59.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.318+0000 7fef8af91700 1 -- 172.21.15.80:0/3389434363 shutdown_connections 2019-11-28T11:44:59.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.318+0000 7fef8af91700 1 -- 172.21.15.80:0/3389434363 wait complete. 2019-11-28T11:44:59.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.318+0000 7fef8af91700 1 -- 172.21.15.80:0/3389434363 >> 172.21.15.80:0/3389434363 conn(0x7fef8411bfc0 msgr2=0x7fef84141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:59.367 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:44:59.367 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:44:59.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.451+0000 7fa58808d700 1 Processor -- start 2019-11-28T11:44:59.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.451+0000 7fa58808d700 1 -- start start 2019-11-28T11:44:59.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.452+0000 7fa58808d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5801639f0 0x7fa580165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:44:59.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.452+0000 7fa58808d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58006db60 con 0x7fa58015f100 2019-11-28T11:44:59.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.452+0000 7fa58808d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58006e060 con 0x7fa58015ed10 2019-11-28T11:44:59.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.452+0000 7fa58808d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58006fe00 con 0x7fa5801639f0 2019-11-28T11:44:59.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.452+0000 7fa585e29700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa58015f100 0x7fa58006bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39132/0 (socket says 172.21.15.80:39132) 2019-11-28T11:44:59.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.452+0000 7fa585e29700 1 -- 172.21.15.80:0/4210051349 learned_addr learned my addr 172.21.15.80:0/4210051349 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:59.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa586e2b700 1 --2- 172.21.15.80:0/4210051349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5801639f0 0x7fa580165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:59.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa585628700 1 -- 172.21.15.80:0/4210051349 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176093311 0 0) 0x7fa5680014d0 con 0x7fa58015f100 2019-11-28T11:44:59.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa585628700 1 -- 172.21.15.80:0/4210051349 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa56c002e80 con 0x7fa58015f100 2019-11-28T11:44:59.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa585628700 1 -- 172.21.15.80:0/4210051349 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457266415 0 0) 0x7fa570001080 con 0x7fa58015ed10 2019-11-28T11:44:59.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa585628700 1 -- 172.21.15.80:0/4210051349 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa56c0030b0 con 0x7fa58015ed10 2019-11-28T11:44:59.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa586e2b700 1 -- 172.21.15.80:0/4210051349 >> v1:172.21.15.174:6789/0 conn(0x7fa58015ed10 legacy=0x7fa580073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:59.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa586e2b700 1 -- 172.21.15.80:0/4210051349 >> v1:172.21.15.80:6789/0 conn(0x7fa58015f100 legacy=0x7fa58006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:59.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa586e2b700 1 -- 172.21.15.80:0/4210051349 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580070760 con 0x7fa5801639f0 2019-11-28T11:44:59.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa586e2b700 1 --2- 172.21.15.80:0/4210051349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5801639f0 0x7fa580165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa57800af80 tx=0x7fa57800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa586e2b700 1 --2- 172.21.15.80:0/4210051349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5801639f0 0x7fa580165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa57800af80 tx=0x7fa57800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa586e2b700 1 --2- 172.21.15.80:0/4210051349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5801639f0 0x7fa580165df0 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7fa57800af80 tx=0x7fa57800b790).ready entity=mon.2 client_cookie=4fc295aea0d8e85a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:59.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa586e2b700 1 --2- 172.21.15.80:0/4210051349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5801639f0 0x7fa580165df0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fa57800af80 tx=0x7fa57800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa585628700 1 -- 172.21.15.80:0/4210051349 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa578007240 con 0x7fa5801639f0 2019-11-28T11:44:59.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa586e2b700 1 --2- 172.21.15.80:0/4210051349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5801639f0 0x7fa580165df0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fa57800af80 tx=0x7fa57800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa586e2b700 1 --2- 172.21.15.80:0/4210051349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5801639f0 0x7fa580165df0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fa57800af80 tx=0x7fa57800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa585628700 1 -- 172.21.15.80:0/4210051349 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa578000bb0 con 0x7fa5801639f0 2019-11-28T11:44:59.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa585628700 1 -- 172.21.15.80:0/4210051349 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa578009e60 con 0x7fa5801639f0 2019-11-28T11:44:59.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa58808d700 1 -- 172.21.15.80:0/4210051349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5801639f0 msgr2=0x7fa580165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:59.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.453+0000 7fa58808d700 1 --2- 172.21.15.80:0/4210051349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5801639f0 0x7fa580165df0 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7fa57800af80 tx=0x7fa57800b790).stop 2019-11-28T11:44:59.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.454+0000 7fa58808d700 1 -- 172.21.15.80:0/4210051349 shutdown_connections 2019-11-28T11:44:59.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.454+0000 7fa58808d700 1 --2- 172.21.15.80:0/4210051349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5801639f0 0x7fa580165df0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:44:59.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.454+0000 7fa58808d700 1 -- 172.21.15.80:0/4210051349 shutdown_connections 2019-11-28T11:44:59.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.454+0000 7fa58808d700 1 -- 172.21.15.80:0/4210051349 wait complete. 2019-11-28T11:44:59.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.454+0000 7fa58808d700 1 -- 172.21.15.80:0/4210051349 >> 172.21.15.80:0/4210051349 conn(0x7fa580061d20 msgr2=0x7fa5800641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:44:59.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.457+0000 7fa58808d700 1 Processor -- start 2019-11-28T11:44:59.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.457+0000 7fa58808d700 1 -- start start 2019-11-28T11:44:59.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.457+0000 7fa58808d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa5800777a0 0x7fa58012d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:59.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.457+0000 7fa58808d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5801320f0 con 0x7fa58012dc80 2019-11-28T11:44:59.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.457+0000 7fa58808d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa580106a40 con 0x7fa5800773b0 2019-11-28T11:44:59.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.457+0000 7fa58808d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa580078220 con 0x7fa5800777a0 2019-11-28T11:44:59.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa586e2b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa58012dc80 0x7fa58007a2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39136/0 (socket says 172.21.15.80:39136) 2019-11-28T11:44:59.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa586e2b700 1 -- 172.21.15.80:0/1995214441 learned_addr learned my addr 172.21.15.80:0/1995214441 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:44:59.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa585e29700 1 --2- 172.21.15.80:0/1995214441 >> v2:172.21.15.174:3300/0 conn(0x7fa5800777a0 0x7fa58012d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:59.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa57effd700 1 -- 172.21.15.80:0/1995214441 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169930616 0 0) 0x7fa57800ae60 con 0x7fa58012dc80 2019-11-28T11:44:59.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa57effd700 1 -- 172.21.15.80:0/1995214441 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa564002e80 con 0x7fa58012dc80 2019-11-28T11:44:59.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa57effd700 1 -- 172.21.15.80:0/1995214441 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185791998 0 0) 0x7fa570000b80 con 0x7fa5800773b0 2019-11-28T11:44:59.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa57effd700 1 -- 172.21.15.80:0/1995214441 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa564004170 con 0x7fa5800773b0 2019-11-28T11:44:59.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa585e29700 1 -- 172.21.15.80:0/1995214441 >> v1:172.21.15.174:6789/0 conn(0x7fa5800773b0 legacy=0x7fa58007b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:59.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa57effd700 1 -- 172.21.15.80:0/1995214441 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3677246692 0 0) 0x7fa570001230 con 0x7fa5800773b0 2019-11-28T11:44:59.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa585e29700 1 -- 172.21.15.80:0/1995214441 >> v1:172.21.15.80:6789/0 conn(0x7fa58012dc80 legacy=0x7fa58007a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:44:59.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa585e29700 1 -- 172.21.15.80:0/1995214441 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580078b80 con 0x7fa5800777a0 2019-11-28T11:44:59.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa585e29700 1 --2- 172.21.15.80:0/1995214441 >> v2:172.21.15.174:3300/0 conn(0x7fa5800777a0 0x7fa58012d740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa568010700 tx=0x7fa568010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa585e29700 1 --2- 172.21.15.80:0/1995214441 >> v2:172.21.15.174:3300/0 conn(0x7fa5800777a0 0x7fa58012d740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa568010700 tx=0x7fa568010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa585e29700 1 --2- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5800777a0 0x7fa58012d740 secure :-1 s=READY pgs=963 cs=0 l=1 rx=0x7fa568010700 tx=0x7fa568010aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:59.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa585e29700 1 --2- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5800777a0 0x7fa58012d740 secure :-1 s=THROTTLE_DONE pgs=963 cs=0 l=1 rx=0x7fa568010700 tx=0x7fa568010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa57effd700 1 -- 172.21.15.80:0/1995214441 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa568001100 con 0x7fa5800777a0 2019-11-28T11:44:59.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa585e29700 1 --2- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5800777a0 0x7fa58012d740 secure :-1 s=THROTTLE_DONE pgs=963 cs=0 l=1 rx=0x7fa568010700 tx=0x7fa568010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa585e29700 1 --2- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5800777a0 0x7fa58012d740 secure :-1 s=THROTTLE_DONE pgs=963 cs=0 l=1 rx=0x7fa568010700 tx=0x7fa568010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa57effd700 1 -- 172.21.15.80:0/1995214441 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa568001700 con 0x7fa5800777a0 2019-11-28T11:44:59.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa58808d700 1 -- 172.21.15.80:0/1995214441 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa580078f00 con 0x7fa5800777a0 2019-11-28T11:44:59.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa57effd700 1 -- 172.21.15.80:0/1995214441 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa568001eb0 con 0x7fa5800777a0 2019-11-28T11:44:59.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.458+0000 7fa58808d700 1 -- 172.21.15.80:0/1995214441 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa580078b80 con 0x7fa5800777a0 2019-11-28T11:44:59.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.459+0000 7fa585e29700 1 --2- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5800777a0 0x7fa58012d740 secure :-1 s=THROTTLE_DONE pgs=963 cs=0 l=1 rx=0x7fa568010700 tx=0x7fa568010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.459+0000 7fa57effd700 1 -- 172.21.15.80:0/1995214441 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa568001ed0 con 0x7fa5800777a0 2019-11-28T11:44:59.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.459+0000 7fa585e29700 1 --2- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5800777a0 0x7fa58012d740 secure :-1 s=THROTTLE_DONE pgs=963 cs=0 l=1 rx=0x7fa568010700 tx=0x7fa568010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.459+0000 7fa57effd700 1 --2- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa564018750 0x7fa56401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:44:59.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.459+0000 7fa57effd700 1 -- 172.21.15.80:0/1995214441 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fa568031de0 con 0x7fa5800777a0 2019-11-28T11:44:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.459+0000 7fa58662a700 1 --2- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa564018750 0x7fa56401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:44:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.460+0000 7fa58662a700 1 --2- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa564018750 0x7fa56401abe0 crc :-1 s=READY pgs=669 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:44:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.467+0000 7fa58808d700 1 -- 172.21.15.80:0/1995214441 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa580078f00 con 0x7fa5800777a0 2019-11-28T11:44:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.471+0000 7fa585e29700 1 --2- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5800777a0 0x7fa58012d740 secure :-1 s=THROTTLE_DONE pgs=963 cs=0 l=1 rx=0x7fa568010700 tx=0x7fa568010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:44:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.471+0000 7fa57effd700 1 -- 172.21.15.80:0/1995214441 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa568001cc0 con 0x7fa5800777a0 2019-11-28T11:44:59.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:44:59.637+0000 7fa58808d700 1 -- 172.21.15.80:0/1995214441 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7fa580078b80 con 0x7fa5800777a0 2019-11-28T11:45:00.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.006+0000 7fa585e29700 1 --2- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5800777a0 0x7fa58012d740 secure :-1 s=THROTTLE_DONE pgs=963 cs=0 l=1 rx=0x7fa568010700 tx=0x7fa568010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:00.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.007+0000 7fa57effd700 1 -- 172.21.15.80:0/1995214441 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v125) v1 ==== 133+0+0 (secure 0 0 0) 0x7fa568001ed0 con 0x7fa5800777a0 2019-11-28T11:45:00.090 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:45:00.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.052+0000 7fa58808d700 1 -- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa564018750 msgr2=0x7fa56401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:00.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.052+0000 7fa58808d700 1 --2- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa564018750 0x7fa56401abe0 crc :-1 s=READY pgs=669 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:00.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.052+0000 7fa58808d700 1 -- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5800777a0 msgr2=0x7fa58012d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:00.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.052+0000 7fa58808d700 1 --2- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5800777a0 0x7fa58012d740 secure :-1 s=READY pgs=963 cs=0 l=1 rx=0x7fa568010700 tx=0x7fa568010aa0).stop 2019-11-28T11:45:00.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.053+0000 7fa58808d700 1 -- 172.21.15.80:0/1995214441 shutdown_connections 2019-11-28T11:45:00.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.053+0000 7fa58808d700 1 --2- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5800777a0 0x7fa58012d740 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:00.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.053+0000 7fa58808d700 1 --2- 172.21.15.80:0/1995214441 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa564018750 0x7fa56401abe0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:00.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.053+0000 7fa58808d700 1 -- 172.21.15.80:0/1995214441 shutdown_connections 2019-11-28T11:45:00.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.053+0000 7fa58808d700 1 -- 172.21.15.80:0/1995214441 wait complete. 2019-11-28T11:45:00.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.053+0000 7fa58808d700 1 -- 172.21.15.80:0/1995214441 >> 172.21.15.80:0/1995214441 conn(0x7fa580147670 msgr2=0x7fa5801641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:00.102 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:45:00.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.186+0000 7f31a9cbb700 1 Processor -- start 2019-11-28T11:45:00.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.186+0000 7f31a9cbb700 1 -- start start 2019-11-28T11:45:00.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f31a9cbb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f31a415ed10 0x7f31a415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:00.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f31a9cbb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f31a4073020 0x7f31a4071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:00.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f31a9cbb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a40734b0 0x7f31a40723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:00.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f31a9cbb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a406fe00 con 0x7f31a415ed10 2019-11-28T11:45:00.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f31a9cbb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a40700d0 con 0x7f31a4073020 2019-11-28T11:45:00.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f31a9cbb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a406f3d0 con 0x7f31a40734b0 2019-11-28T11:45:00.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f31a3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f31a415ed10 0x7f31a415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:00.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f31a3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f31a415ed10 0x7f31a415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39826/0 (socket says 172.21.15.80:39826) 2019-11-28T11:45:00.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f31a3fff700 1 -- 172.21.15.80:0/2391191051 learned_addr learned my addr 172.21.15.80:0/2391191051 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:00.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f31a8a59700 1 --2- 172.21.15.80:0/2391191051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a40734b0 0x7f31a40723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:00.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f319bfff700 1 --2- 172.21.15.80:0/2391191051 >> v2:172.21.15.174:3300/0 conn(0x7f31a4073020 0x7f31a4071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:00.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f31a3fff700 1 -- 172.21.15.80:0/2391191051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a40734b0 msgr2=0x7f31a40723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:00.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f31a3fff700 1 --2- 172.21.15.80:0/2391191051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a40734b0 0x7f31a40723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:00.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f31a3fff700 1 -- 172.21.15.80:0/2391191051 >> v2:172.21.15.174:3300/0 conn(0x7f31a4073020 msgr2=0x7f31a4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:00.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f31a3fff700 1 --2- 172.21.15.80:0/2391191051 >> v2:172.21.15.174:3300/0 conn(0x7f31a4073020 0x7f31a4071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:00.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f31a3fff700 1 -- 172.21.15.80:0/2391191051 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a4070760 con 0x7f31a415ed10 2019-11-28T11:45:00.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.187+0000 7f31a3fff700 1 --2- 172.21.15.80:0/2391191051 >> v2:172.21.15.80:3300/0 conn(0x7f31a415ed10 0x7f31a415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f319400f6c0 tx=0x7f319400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:00.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a3fff700 1 --2- 172.21.15.80:0/2391191051 >> v2:172.21.15.80:3300/0 conn(0x7f31a415ed10 0x7f31a415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f319400f6c0 tx=0x7f319400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:00.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a3fff700 1 --2- 172.21.15.80:0/2391191051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31a415ed10 0x7f31a415f100 secure :-1 s=READY pgs=1653 cs=0 l=1 rx=0x7f319400f6c0 tx=0x7f319400f570).ready entity=mon.0 client_cookie=84beab8670e5bc16 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:00.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a3fff700 1 --2- 172.21.15.80:0/2391191051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31a415ed10 0x7f31a415f100 secure :-1 s=THROTTLE_DONE pgs=1653 cs=0 l=1 rx=0x7f319400f6c0 tx=0x7f319400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:00.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a37fe700 1 -- 172.21.15.80:0/2391191051 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3194000960 con 0x7f31a415ed10 2019-11-28T11:45:00.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a3fff700 1 --2- 172.21.15.80:0/2391191051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31a415ed10 0x7f31a415f100 secure :-1 s=THROTTLE_DONE pgs=1653 cs=0 l=1 rx=0x7f319400f6c0 tx=0x7f319400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:00.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a3fff700 1 --2- 172.21.15.80:0/2391191051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31a415ed10 0x7f31a415f100 secure :-1 s=THROTTLE_DONE pgs=1653 cs=0 l=1 rx=0x7f319400f6c0 tx=0x7f319400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:00.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a37fe700 1 -- 172.21.15.80:0/2391191051 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3194000c90 con 0x7f31a415ed10 2019-11-28T11:45:00.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a37fe700 1 -- 172.21.15.80:0/2391191051 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31940013a0 con 0x7f31a415ed10 2019-11-28T11:45:00.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a9cbb700 1 -- 172.21.15.80:0/2391191051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31a415ed10 msgr2=0x7f31a415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:00.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a9cbb700 1 --2- 172.21.15.80:0/2391191051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31a415ed10 0x7f31a415f100 secure :-1 s=READY pgs=1653 cs=0 l=1 rx=0x7f319400f6c0 tx=0x7f319400f570).stop 2019-11-28T11:45:00.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a9cbb700 1 -- 172.21.15.80:0/2391191051 shutdown_connections 2019-11-28T11:45:00.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a9cbb700 1 --2- 172.21.15.80:0/2391191051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a40734b0 0x7f31a40723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:00.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a9cbb700 1 --2- 172.21.15.80:0/2391191051 >> v2:172.21.15.174:3300/0 conn(0x7f31a4073020 0x7f31a4071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:00.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a9cbb700 1 --2- 172.21.15.80:0/2391191051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31a415ed10 0x7f31a415f100 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:00.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a9cbb700 1 -- 172.21.15.80:0/2391191051 shutdown_connections 2019-11-28T11:45:00.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a9cbb700 1 -- 172.21.15.80:0/2391191051 wait complete. 2019-11-28T11:45:00.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.188+0000 7f31a9cbb700 1 -- 172.21.15.80:0/2391191051 >> 172.21.15.80:0/2391191051 conn(0x7f31a4061d20 msgr2=0x7f31a40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:00.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.191+0000 7f31a9cbb700 1 Processor -- start 2019-11-28T11:45:00.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.191+0000 7f31a9cbb700 1 -- start start 2019-11-28T11:45:00.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f31a9cbb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a410ed60 0x7f31a410f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:00.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f31a9cbb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f31a410f730 0x7f31a4167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:00.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f31a9cbb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a410c250 con 0x7f31a410e970 2019-11-28T11:45:00.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f31a9cbb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a410e430 con 0x7f31a410f730 2019-11-28T11:45:00.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f31a9cbb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a4105860 con 0x7f31a410ed60 2019-11-28T11:45:00.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f31a3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f31a410e970 0x7f31a41087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39148/0 (socket says 172.21.15.80:39148) 2019-11-28T11:45:00.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f31a3fff700 1 -- 172.21.15.80:0/448988557 learned_addr learned my addr 172.21.15.80:0/448988557 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:00.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f31a8a59700 1 --2- 172.21.15.80:0/448988557 >> v2:172.21.15.174:3300/0 conn(0x7f31a410f730 0x7f31a4167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:00.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f319bfff700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a410ed60 0x7f31a410f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:00.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f31a17fa700 1 -- 172.21.15.80:0/448988557 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371832191 0 0) 0x7f3194007da0 con 0x7f31a410e970 2019-11-28T11:45:00.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f31a17fa700 1 -- 172.21.15.80:0/448988557 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3188002e80 con 0x7f31a410e970 2019-11-28T11:45:00.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f31a17fa700 1 -- 172.21.15.80:0/448988557 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 995325209 0 0) 0x7f3194000940 con 0x7f31a410e970 2019-11-28T11:45:00.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f319bfff700 1 -- 172.21.15.80:0/448988557 >> v2:172.21.15.174:3300/0 conn(0x7f31a410f730 msgr2=0x7f31a4167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:00.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f319bfff700 1 --2- 172.21.15.80:0/448988557 >> v2:172.21.15.174:3300/0 conn(0x7f31a410f730 0x7f31a4167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:00.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f319bfff700 1 -- 172.21.15.80:0/448988557 >> v1:172.21.15.80:6789/0 conn(0x7f31a410e970 legacy=0x7f31a41087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:00.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f319bfff700 1 -- 172.21.15.80:0/448988557 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a4105ef0 con 0x7f31a410ed60 2019-11-28T11:45:00.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f31a8a59700 1 --2- 172.21.15.80:0/448988557 >> v2:172.21.15.174:3300/0 conn(0x7f31a410f730 0x7f31a4167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:00.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f319bfff700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a410ed60 0x7f31a410f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f318c010390 tx=0x7f318c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:00.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f319bfff700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a410ed60 0x7f31a410f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f318c010390 tx=0x7f318c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:00.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.192+0000 7f319bfff700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a410ed60 0x7f31a410f1f0 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f318c010390 tx=0x7f318c010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:00.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.193+0000 7f319bfff700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a410ed60 0x7f31a410f1f0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f318c010390 tx=0x7f318c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:00.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.193+0000 7f31a17fa700 1 -- 172.21.15.80:0/448988557 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f318c000940 con 0x7f31a410ed60 2019-11-28T11:45:00.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.193+0000 7f319bfff700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a410ed60 0x7f31a410f1f0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f318c010390 tx=0x7f318c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:00.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.193+0000 7f31a9cbb700 1 -- 172.21.15.80:0/448988557 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a4106270 con 0x7f31a410ed60 2019-11-28T11:45:00.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.193+0000 7f31a17fa700 1 -- 172.21.15.80:0/448988557 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c000940 con 0x7f31a410ed60 2019-11-28T11:45:00.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.193+0000 7f319bfff700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a410ed60 0x7f31a410f1f0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f318c010390 tx=0x7f318c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:00.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.193+0000 7f31a17fa700 1 -- 172.21.15.80:0/448988557 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f318c009dc0 con 0x7f31a410ed60 2019-11-28T11:45:00.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.193+0000 7f31a9cbb700 1 -- 172.21.15.80:0/448988557 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a4105ef0 con 0x7f31a410ed60 2019-11-28T11:45:00.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.193+0000 7f319bfff700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a410ed60 0x7f31a410f1f0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f318c010390 tx=0x7f318c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:00.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.193+0000 7f31a17fa700 1 -- 172.21.15.80:0/448988557 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f318c00a560 con 0x7f31a410ed60 2019-11-28T11:45:00.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.193+0000 7f319bfff700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a410ed60 0x7f31a410f1f0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f318c010390 tx=0x7f318c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:00.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.193+0000 7f31a17fa700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3188018780 0x7f318801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:00.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.193+0000 7f31a17fa700 1 -- 172.21.15.80:0/448988557 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f318c0319e0 con 0x7f31a410ed60 2019-11-28T11:45:00.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.194+0000 7f31a3fff700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3188018780 0x7f318801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:00.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.194+0000 7f31a3fff700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3188018780 0x7f318801abf0 crc :-1 s=READY pgs=670 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:00.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.201+0000 7f31a9cbb700 1 -- 172.21.15.80:0/448988557 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a4106270 con 0x7f31a410ed60 2019-11-28T11:45:00.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.205+0000 7f319bfff700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a410ed60 0x7f31a410f1f0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f318c010390 tx=0x7f318c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:00.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.205+0000 7f31a17fa700 1 -- 172.21.15.80:0/448988557 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f318c00a2b0 con 0x7f31a410ed60 2019-11-28T11:45:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:00.374+0000 7f31a9cbb700 1 -- 172.21.15.80:0/448988557 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f31a4105ef0 con 0x7f31a410ed60 2019-11-28T11:45:01.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.013+0000 7f319bfff700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a410ed60 0x7f31a410f1f0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f318c010390 tx=0x7f318c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.014+0000 7f31a17fa700 1 -- 172.21.15.80:0/448988557 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v126) v1 ==== 125+0+0 (secure 0 0 0) 0x7f318c00a4c0 con 0x7f31a410ed60 2019-11-28T11:45:01.078 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:45:01.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.041+0000 7f31a9cbb700 1 -- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3188018780 msgr2=0x7f318801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.041+0000 7f31a9cbb700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3188018780 0x7f318801abf0 crc :-1 s=READY pgs=670 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:01.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.041+0000 7f31a9cbb700 1 -- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a410ed60 msgr2=0x7f31a410f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.041+0000 7f31a9cbb700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a410ed60 0x7f31a410f1f0 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f318c010390 tx=0x7f318c010730).stop 2019-11-28T11:45:01.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.041+0000 7f31a9cbb700 1 -- 172.21.15.80:0/448988557 shutdown_connections 2019-11-28T11:45:01.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.041+0000 7f31a9cbb700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3188018780 0x7f318801abf0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:01.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.041+0000 7f31a9cbb700 1 --2- 172.21.15.80:0/448988557 >> v2:172.21.15.174:3300/0 conn(0x7f31a410f730 0x7f31a4167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:01.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.041+0000 7f31a9cbb700 1 --2- 172.21.15.80:0/448988557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31a410ed60 0x7f31a410f1f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:01.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.041+0000 7f31a9cbb700 1 -- 172.21.15.80:0/448988557 shutdown_connections 2019-11-28T11:45:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.041+0000 7f31a9cbb700 1 -- 172.21.15.80:0/448988557 wait complete. 2019-11-28T11:45:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.041+0000 7f31a9cbb700 1 -- 172.21.15.80:0/448988557 >> 172.21.15.80:0/448988557 conn(0x7f31a415e2d0 msgr2=0x7f31a4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:01.092 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:45:01.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.177+0000 7f261b5fa700 1 Processor -- start 2019-11-28T11:45:01.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.177+0000 7f261b5fa700 1 -- start start 2019-11-28T11:45:01.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.178+0000 7f261b5fa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f261415f100 0x7f261406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:01.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.178+0000 7f261b5fa700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261406db60 con 0x7f261415ed10 2019-11-28T11:45:01.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.178+0000 7f261b5fa700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261406e060 con 0x7f261406c2f0 2019-11-28T11:45:01.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.178+0000 7f261b5fa700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261406fe00 con 0x7f261415f100 2019-11-28T11:45:01.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.178+0000 7f2619396700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f261415f100 0x7f261406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:01.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f2619396700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f261415f100 0x7f261406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39844/0 (socket says 172.21.15.80:39844) 2019-11-28T11:45:01.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f2619396700 1 -- 172.21.15.80:0/664058718 learned_addr learned my addr 172.21.15.80:0/664058718 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:01.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f2619b97700 1 --1- 172.21.15.80:0/664058718 >> v1:172.21.15.80:6789/0 conn(0x7f261415ed10 0x7f2614073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39156/0 (socket says 172.21.15.80:39156) 2019-11-28T11:45:01.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f2619396700 1 -- 172.21.15.80:0/664058718 >> v1:172.21.15.174:6789/0 conn(0x7f261406c2f0 legacy=0x7f261406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f2619396700 1 -- 172.21.15.80:0/664058718 >> v1:172.21.15.80:6789/0 conn(0x7f261415ed10 legacy=0x7f2614073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f2618b95700 1 -- 172.21.15.80:0/664058718 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785742319 0 0) 0x7f260c0009b0 con 0x7f261406c2f0 2019-11-28T11:45:01.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f2619396700 1 -- 172.21.15.80:0/664058718 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2614070760 con 0x7f261415f100 2019-11-28T11:45:01.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f2619396700 1 --2- 172.21.15.80:0/664058718 >> v2:172.21.15.80:3300/0 conn(0x7f261415f100 0x7f261406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f261000fac0 tx=0x7f261000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f2619396700 1 --2- 172.21.15.80:0/664058718 >> v2:172.21.15.80:3300/0 conn(0x7f261415f100 0x7f261406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f261000fac0 tx=0x7f261000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f2619396700 1 --2- 172.21.15.80:0/664058718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f261415f100 0x7f261406bdb0 secure :-1 s=READY pgs=1656 cs=0 l=1 rx=0x7f261000fac0 tx=0x7f261000fe60).ready entity=mon.0 client_cookie=a81e932e3e29ceef server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:01.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f2619396700 1 --2- 172.21.15.80:0/664058718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f261415f100 0x7f261406bdb0 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7f261000fac0 tx=0x7f261000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f2618b95700 1 -- 172.21.15.80:0/664058718 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2610000ce0 con 0x7f261415f100 2019-11-28T11:45:01.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f2619396700 1 --2- 172.21.15.80:0/664058718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f261415f100 0x7f261406bdb0 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7f261000fac0 tx=0x7f261000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f2618b95700 1 -- 172.21.15.80:0/664058718 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2610001010 con 0x7f261415f100 2019-11-28T11:45:01.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f2619396700 1 --2- 172.21.15.80:0/664058718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f261415f100 0x7f261406bdb0 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7f261000fac0 tx=0x7f261000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f2618b95700 1 -- 172.21.15.80:0/664058718 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2610007590 con 0x7f261415f100 2019-11-28T11:45:01.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f261b5fa700 1 -- 172.21.15.80:0/664058718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f261415f100 msgr2=0x7f261406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.179+0000 7f261b5fa700 1 --2- 172.21.15.80:0/664058718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f261415f100 0x7f261406bdb0 secure :-1 s=READY pgs=1656 cs=0 l=1 rx=0x7f261000fac0 tx=0x7f261000fe60).stop 2019-11-28T11:45:01.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.180+0000 7f261b5fa700 1 -- 172.21.15.80:0/664058718 shutdown_connections 2019-11-28T11:45:01.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.180+0000 7f261b5fa700 1 --2- 172.21.15.80:0/664058718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f261415f100 0x7f261406bdb0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:01.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.180+0000 7f261b5fa700 1 -- 172.21.15.80:0/664058718 shutdown_connections 2019-11-28T11:45:01.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.180+0000 7f261b5fa700 1 -- 172.21.15.80:0/664058718 wait complete. 2019-11-28T11:45:01.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.180+0000 7f261b5fa700 1 -- 172.21.15.80:0/664058718 >> 172.21.15.80:0/664058718 conn(0x7f2614061d20 msgr2=0x7f26140641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:01.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.182+0000 7f261b5fa700 1 Processor -- start 2019-11-28T11:45:01.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.183+0000 7f261b5fa700 1 -- start start 2019-11-28T11:45:01.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.183+0000 7f261b5fa700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f261410ed60 0x7f261410f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:01.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.183+0000 7f261b5fa700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261410c250 con 0x7f261410e970 2019-11-28T11:45:01.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.183+0000 7f261b5fa700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261410c6d0 con 0x7f261410f730 2019-11-28T11:45:01.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.183+0000 7f261b5fa700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261410e430 con 0x7f261410ed60 2019-11-28T11:45:01.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.183+0000 7f2619b97700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f261410e970 0x7f26141087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39162/0 (socket says 172.21.15.80:39162) 2019-11-28T11:45:01.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.183+0000 7f2619b97700 1 -- 172.21.15.80:0/2240417264 learned_addr learned my addr 172.21.15.80:0/2240417264 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:01.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f2619396700 1 --2- 172.21.15.80:0/2240417264 >> v2:172.21.15.174:3300/0 conn(0x7f261410ed60 0x7f261410f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:01.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f260a7fc700 1 -- 172.21.15.80:0/2240417264 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941078416 0 0) 0x7f2604001150 con 0x7f261410e970 2019-11-28T11:45:01.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f260a7fc700 1 -- 172.21.15.80:0/2240417264 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f4002e80 con 0x7f261410e970 2019-11-28T11:45:01.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f260a7fc700 1 -- 172.21.15.80:0/2240417264 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1116053178 0 0) 0x7f2604001300 con 0x7f261410e970 2019-11-28T11:45:01.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f260a7fc700 1 -- 172.21.15.80:0/2240417264 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f25f40032e0 con 0x7f261410e970 2019-11-28T11:45:01.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f260a7fc700 1 -- 172.21.15.80:0/2240417264 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f26040018d0 con 0x7f261410e970 2019-11-28T11:45:01.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f2619396700 1 -- 172.21.15.80:0/2240417264 >> v1:172.21.15.174:6789/0 conn(0x7f261410f730 legacy=0x7f2614167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f2619396700 1 -- 172.21.15.80:0/2240417264 >> v1:172.21.15.80:6789/0 conn(0x7f261410e970 legacy=0x7f26141087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f2619396700 1 -- 172.21.15.80:0/2240417264 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2614105ef0 con 0x7f261410ed60 2019-11-28T11:45:01.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f2619396700 1 --2- 172.21.15.80:0/2240417264 >> v2:172.21.15.174:3300/0 conn(0x7f261410ed60 0x7f261410f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2610010710 tx=0x7f2610010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f2619396700 1 --2- 172.21.15.80:0/2240417264 >> v2:172.21.15.174:3300/0 conn(0x7f261410ed60 0x7f261410f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2610010710 tx=0x7f2610010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f2619396700 1 --2- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f261410ed60 0x7f261410f1f0 secure :-1 s=READY pgs=966 cs=0 l=1 rx=0x7f2610010710 tx=0x7f2610010ab0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f2619396700 1 --2- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f261410ed60 0x7f261410f1f0 secure :-1 s=THROTTLE_DONE pgs=966 cs=0 l=1 rx=0x7f2610010710 tx=0x7f2610010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f260a7fc700 1 -- 172.21.15.80:0/2240417264 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2610005af0 con 0x7f261410ed60 2019-11-28T11:45:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f2619396700 1 --2- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f261410ed60 0x7f261410f1f0 secure :-1 s=THROTTLE_DONE pgs=966 cs=0 l=1 rx=0x7f2610010710 tx=0x7f2610010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f260a7fc700 1 -- 172.21.15.80:0/2240417264 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2610005710 con 0x7f261410ed60 2019-11-28T11:45:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f2619396700 1 --2- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f261410ed60 0x7f261410f1f0 secure :-1 s=THROTTLE_DONE pgs=966 cs=0 l=1 rx=0x7f2610010710 tx=0x7f2610010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f261b5fa700 1 -- 172.21.15.80:0/2240417264 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2614106270 con 0x7f261410ed60 2019-11-28T11:45:01.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.184+0000 7f260a7fc700 1 -- 172.21.15.80:0/2240417264 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2610005ce0 con 0x7f261410ed60 2019-11-28T11:45:01.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.185+0000 7f261b5fa700 1 -- 172.21.15.80:0/2240417264 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2614105ef0 con 0x7f261410ed60 2019-11-28T11:45:01.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.185+0000 7f2619396700 1 --2- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f261410ed60 0x7f261410f1f0 secure :-1 s=THROTTLE_DONE pgs=966 cs=0 l=1 rx=0x7f2610010710 tx=0x7f2610010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.185+0000 7f260a7fc700 1 -- 172.21.15.80:0/2240417264 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2610007af0 con 0x7f261410ed60 2019-11-28T11:45:01.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.185+0000 7f2619396700 1 --2- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f261410ed60 0x7f261410f1f0 secure :-1 s=THROTTLE_DONE pgs=966 cs=0 l=1 rx=0x7f2610010710 tx=0x7f2610010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.185+0000 7f260a7fc700 1 --2- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f25f4018770 0x7f25f401ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:01.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.185+0000 7f260a7fc700 1 -- 172.21.15.80:0/2240417264 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5904+0+0 (secure 0 0 0) 0x7f2610032050 con 0x7f261410ed60 2019-11-28T11:45:01.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.185+0000 7f2619b97700 1 --2- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f25f4018770 0x7f25f401ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:01.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.186+0000 7f2619b97700 1 --2- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f25f4018770 0x7f25f401ac00 crc :-1 s=READY pgs=671 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:01.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.192+0000 7f261b5fa700 1 -- 172.21.15.80:0/2240417264 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2614106270 con 0x7f261410ed60 2019-11-28T11:45:01.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.196+0000 7f2619396700 1 --2- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f261410ed60 0x7f261410f1f0 secure :-1 s=THROTTLE_DONE pgs=966 cs=0 l=1 rx=0x7f2610010710 tx=0x7f2610010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.196+0000 7f260a7fc700 1 -- 172.21.15.80:0/2240417264 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2610017780 con 0x7f261410ed60 2019-11-28T11:45:01.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.364+0000 7f261b5fa700 1 -- 172.21.15.80:0/2240417264 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f2614105ef0 con 0x7f261410ed60 2019-11-28T11:45:01.405 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:45:01.365+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:45:01.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.370+0000 7f2619396700 1 --2- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f261410ed60 0x7f261410f1f0 secure :-1 s=THROTTLE_DONE pgs=966 cs=0 l=1 rx=0x7f2610010710 tx=0x7f2610010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.370+0000 7f260a7fc700 1 -- 172.21.15.80:0/2240417264 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 20 and data pool 21 v88) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2610017990 con 0x7f261410ed60 2019-11-28T11:45:01.410 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 20 and data pool 21 2019-11-28T11:45:01.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.374+0000 7f261b5fa700 1 -- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f25f4018770 msgr2=0x7f25f401ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.374+0000 7f261b5fa700 1 --2- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f25f4018770 0x7f25f401ac00 crc :-1 s=READY pgs=671 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:01.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.374+0000 7f261b5fa700 1 -- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f261410ed60 msgr2=0x7f261410f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.374+0000 7f261b5fa700 1 --2- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f261410ed60 0x7f261410f1f0 secure :-1 s=READY pgs=966 cs=0 l=1 rx=0x7f2610010710 tx=0x7f2610010ab0).stop 2019-11-28T11:45:01.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.374+0000 7f261b5fa700 1 -- 172.21.15.80:0/2240417264 shutdown_connections 2019-11-28T11:45:01.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.374+0000 7f261b5fa700 1 --2- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f25f4018770 0x7f25f401ac00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:01.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.374+0000 7f261b5fa700 1 --2- 172.21.15.80:0/2240417264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f261410ed60 0x7f261410f1f0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:01.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.374+0000 7f261b5fa700 1 -- 172.21.15.80:0/2240417264 shutdown_connections 2019-11-28T11:45:01.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.374+0000 7f261b5fa700 1 -- 172.21.15.80:0/2240417264 wait complete. 2019-11-28T11:45:01.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.374+0000 7f261b5fa700 1 -- 172.21.15.80:0/2240417264 >> 172.21.15.80:0/2240417264 conn(0x7f261415e2d0 msgr2=0x7f2614147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:01.426 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:45:01.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.509+0000 7f1b649b9700 1 Processor -- start 2019-11-28T11:45:01.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.509+0000 7f1b649b9700 1 -- start start 2019-11-28T11:45:01.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.510+0000 7f1b649b9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b6006d120 0x7f1b60165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:01.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.510+0000 7f1b649b9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6006d580 con 0x7f1b6006c0a0 2019-11-28T11:45:01.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.510+0000 7f1b649b9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6006db00 con 0x7f1b6006c490 2019-11-28T11:45:01.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.510+0000 7f1b649b9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6006fd60 con 0x7f1b6006d120 2019-11-28T11:45:01.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1b6006c0a0 0x7f1b60072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39170/0 (socket says 172.21.15.80:39170) 2019-11-28T11:45:01.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5ed9d700 1 -- 172.21.15.80:0/1897000400 learned_addr learned my addr 172.21.15.80:0/1897000400 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:01.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5f59e700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b6006d120 0x7f1b60165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:01.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 -- 172.21.15.80:0/1897000400 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121858775 0 0) 0x7f1b48001150 con 0x7f1b6006c0a0 2019-11-28T11:45:01.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 -- 172.21.15.80:0/1897000400 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b40002e80 con 0x7f1b6006c0a0 2019-11-28T11:45:01.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 -- 172.21.15.80:0/1897000400 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732316877 0 0) 0x7f1b50001080 con 0x7f1b6006c490 2019-11-28T11:45:01.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 -- 172.21.15.80:0/1897000400 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b400030b0 con 0x7f1b6006c490 2019-11-28T11:45:01.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 -- 172.21.15.80:0/1897000400 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2284398006 0 0) 0x7f1b48001130 con 0x7f1b6006c0a0 2019-11-28T11:45:01.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 -- 172.21.15.80:0/1897000400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b6006d120 msgr2=0x7f1b60165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:01.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b6006d120 0x7f1b60165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:01.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 -- 172.21.15.80:0/1897000400 >> v1:172.21.15.174:6789/0 conn(0x7f1b6006c490 legacy=0x7f1b6006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 -- 172.21.15.80:0/1897000400 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b600706c0 con 0x7f1b6006c0a0 2019-11-28T11:45:01.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 -- 172.21.15.80:0/1897000400 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f1b48001660 con 0x7f1b6006c0a0 2019-11-28T11:45:01.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5f59e700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b6006d120 0x7f1b60165d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:01.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 -- 172.21.15.80:0/1897000400 >> v1:172.21.15.80:6789/0 conn(0x7f1b6006c0a0 legacy=0x7f1b60072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b40003b80 0x7f1b40005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:01.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b40006650 0x7f1b40008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:01.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4004d330 0x7f1b4004f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:01.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 -- 172.21.15.80:0/1897000400 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4004ffe0 con 0x7f1b4004d330 2019-11-28T11:45:01.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 -- 172.21.15.80:0/1897000400 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b40050210 con 0x7f1b40006650 2019-11-28T11:45:01.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5dd9b700 1 -- 172.21.15.80:0/1897000400 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b40050440 con 0x7f1b40003b80 2019-11-28T11:45:01.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5ed9d700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b40003b80 0x7f1b40005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:01.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5f59e700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4004d330 0x7f1b4004f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:01.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.511+0000 7f1b5e59c700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b40006650 0x7f1b40008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:01.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b5f59e700 1 -- 172.21.15.80:0/1897000400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b40003b80 msgr2=0x7f1b40005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:01.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b5f59e700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b40003b80 0x7f1b40005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:01.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b5f59e700 1 -- 172.21.15.80:0/1897000400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b40006650 msgr2=0x7f1b40008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:01.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b5f59e700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b40006650 0x7f1b40008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:01.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b5f59e700 1 -- 172.21.15.80:0/1897000400 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b400506f0 con 0x7f1b4004d330 2019-11-28T11:45:01.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b5ed9d700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b40003b80 0x7f1b40005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:01.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b5f59e700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4004d330 0x7f1b4004f800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1b5800f9d0 tx=0x7f1b5800f8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b5f59e700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4004d330 0x7f1b4004f800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1b5800f9d0 tx=0x7f1b5800f8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b5f59e700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4004d330 0x7f1b4004f800 secure :-1 s=READY pgs=1659 cs=0 l=1 rx=0x7f1b5800f9d0 tx=0x7f1b5800f8d0).ready entity=mon.0 client_cookie=962981602535eb52 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:01.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b5f59e700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4004d330 0x7f1b4004f800 secure :-1 s=THROTTLE_DONE pgs=1659 cs=0 l=1 rx=0x7f1b5800f9d0 tx=0x7f1b5800f8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b5dd9b700 1 -- 172.21.15.80:0/1897000400 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b58000e90 con 0x7f1b4004d330 2019-11-28T11:45:01.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b5f59e700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4004d330 0x7f1b4004f800 secure :-1 s=THROTTLE_DONE pgs=1659 cs=0 l=1 rx=0x7f1b5800f9d0 tx=0x7f1b5800f8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b5f59e700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4004d330 0x7f1b4004f800 secure :-1 s=THROTTLE_DONE pgs=1659 cs=0 l=1 rx=0x7f1b5800f9d0 tx=0x7f1b5800f8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b5dd9b700 1 -- 172.21.15.80:0/1897000400 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b58009b20 con 0x7f1b4004d330 2019-11-28T11:45:01.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b5dd9b700 1 -- 172.21.15.80:0/1897000400 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b58009d10 con 0x7f1b4004d330 2019-11-28T11:45:01.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b649b9700 1 -- 172.21.15.80:0/1897000400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4004d330 msgr2=0x7f1b4004f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b649b9700 1 --2- 172.21.15.80:0/1897000400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b4004d330 0x7f1b4004f800 secure :-1 s=READY pgs=1659 cs=0 l=1 rx=0x7f1b5800f9d0 tx=0x7f1b5800f8d0).stop 2019-11-28T11:45:01.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.512+0000 7f1b5f59e700 1 -- 172.21.15.80:0/1897000400 reap_dead start 2019-11-28T11:45:01.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.513+0000 7f1b649b9700 1 -- 172.21.15.80:0/1897000400 shutdown_connections 2019-11-28T11:45:01.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.513+0000 7f1b649b9700 1 -- 172.21.15.80:0/1897000400 shutdown_connections 2019-11-28T11:45:01.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.513+0000 7f1b649b9700 1 -- 172.21.15.80:0/1897000400 wait complete. 2019-11-28T11:45:01.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.513+0000 7f1b649b9700 1 -- 172.21.15.80:0/1897000400 >> 172.21.15.80:0/1897000400 conn(0x7f1b60061cf0 msgr2=0x7f1b60064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:01.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.515+0000 7f1b649b9700 1 Processor -- start 2019-11-28T11:45:01.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.515+0000 7f1b649b9700 1 -- start start 2019-11-28T11:45:01.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.516+0000 7f1b649b9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1b60074d00 0x7f1b6007aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:01.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.516+0000 7f1b649b9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b600754d0 con 0x7f1b60150f50 2019-11-28T11:45:01.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.516+0000 7f1b649b9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6012eb20 con 0x7f1b6007bba0 2019-11-28T11:45:01.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.516+0000 7f1b649b9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b60078980 con 0x7f1b60074d00 2019-11-28T11:45:01.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.516+0000 7f1b5e59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1b60150f50 0x7f1b6007af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39184/0 (socket says 172.21.15.80:39184) 2019-11-28T11:45:01.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.516+0000 7f1b5e59c700 1 -- 172.21.15.80:0/288725673 learned_addr learned my addr 172.21.15.80:0/288725673 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:01.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.516+0000 7f1b5ed9d700 1 --2- 172.21.15.80:0/288725673 >> v2:172.21.15.174:3300/0 conn(0x7f1b60074d00 0x7f1b6007aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:01.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.516+0000 7f1b577fe700 1 -- 172.21.15.80:0/288725673 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2867891075 0 0) 0x7f1b500079b0 con 0x7f1b60150f50 2019-11-28T11:45:01.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.516+0000 7f1b577fe700 1 -- 172.21.15.80:0/288725673 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b38002e80 con 0x7f1b60150f50 2019-11-28T11:45:01.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.516+0000 7f1b577fe700 1 -- 172.21.15.80:0/288725673 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364229577 0 0) 0x7f1b58009930 con 0x7f1b6007bba0 2019-11-28T11:45:01.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.516+0000 7f1b5ed9d700 1 -- 172.21.15.80:0/288725673 >> v1:172.21.15.174:6789/0 conn(0x7f1b6007bba0 legacy=0x7f1b60167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.516+0000 7f1b5ed9d700 1 -- 172.21.15.80:0/288725673 >> v1:172.21.15.80:6789/0 conn(0x7f1b60150f50 legacy=0x7f1b6007af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.516+0000 7f1b5ed9d700 1 -- 172.21.15.80:0/288725673 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b600792e0 con 0x7f1b60074d00 2019-11-28T11:45:01.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.517+0000 7f1b5ed9d700 1 --2- 172.21.15.80:0/288725673 >> v2:172.21.15.174:3300/0 conn(0x7f1b60074d00 0x7f1b6007aa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1b480103b0 tx=0x7f1b48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.517+0000 7f1b5ed9d700 1 --2- 172.21.15.80:0/288725673 >> v2:172.21.15.174:3300/0 conn(0x7f1b60074d00 0x7f1b6007aa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1b480103b0 tx=0x7f1b48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.517+0000 7f1b5ed9d700 1 --2- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b60074d00 0x7f1b6007aa20 secure :-1 s=READY pgs=969 cs=0 l=1 rx=0x7f1b480103b0 tx=0x7f1b48010750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:01.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.517+0000 7f1b5ed9d700 1 --2- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b60074d00 0x7f1b6007aa20 secure :-1 s=THROTTLE_DONE pgs=969 cs=0 l=1 rx=0x7f1b480103b0 tx=0x7f1b48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.517+0000 7f1b577fe700 1 -- 172.21.15.80:0/288725673 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b480018f0 con 0x7f1b60074d00 2019-11-28T11:45:01.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.517+0000 7f1b5ed9d700 1 --2- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b60074d00 0x7f1b6007aa20 secure :-1 s=THROTTLE_DONE pgs=969 cs=0 l=1 rx=0x7f1b480103b0 tx=0x7f1b48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.517+0000 7f1b5ed9d700 1 --2- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b60074d00 0x7f1b6007aa20 secure :-1 s=THROTTLE_DONE pgs=969 cs=0 l=1 rx=0x7f1b480103b0 tx=0x7f1b48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.517+0000 7f1b577fe700 1 -- 172.21.15.80:0/288725673 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b48004430 con 0x7f1b60074d00 2019-11-28T11:45:01.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.517+0000 7f1b577fe700 1 -- 172.21.15.80:0/288725673 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b48004620 con 0x7f1b60074d00 2019-11-28T11:45:01.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.517+0000 7f1b649b9700 1 -- 172.21.15.80:0/288725673 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b60079660 con 0x7f1b60074d00 2019-11-28T11:45:01.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.517+0000 7f1b649b9700 1 -- 172.21.15.80:0/288725673 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b600792e0 con 0x7f1b60074d00 2019-11-28T11:45:01.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.517+0000 7f1b5ed9d700 1 --2- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b60074d00 0x7f1b6007aa20 secure :-1 s=THROTTLE_DONE pgs=969 cs=0 l=1 rx=0x7f1b480103b0 tx=0x7f1b48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.518+0000 7f1b577fe700 1 -- 172.21.15.80:0/288725673 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1b48004620 con 0x7f1b60074d00 2019-11-28T11:45:01.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.518+0000 7f1b5ed9d700 1 --2- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b60074d00 0x7f1b6007aa20 secure :-1 s=THROTTLE_DONE pgs=969 cs=0 l=1 rx=0x7f1b480103b0 tx=0x7f1b48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.518+0000 7f1b577fe700 1 --2- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1b38018780 0x7f1b3801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.518+0000 7f1b577fe700 1 -- 172.21.15.80:0/288725673 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1b48031a70 con 0x7f1b60074d00 2019-11-28T11:45:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.518+0000 7f1b5e59c700 1 --2- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1b38018780 0x7f1b3801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.518+0000 7f1b5e59c700 1 --2- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1b38018780 0x7f1b3801abf0 crc :-1 s=READY pgs=672 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.525+0000 7f1b649b9700 1 -- 172.21.15.80:0/288725673 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b60079660 con 0x7f1b60074d00 2019-11-28T11:45:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.528+0000 7f1b5ed9d700 1 --2- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b60074d00 0x7f1b6007aa20 secure :-1 s=THROTTLE_DONE pgs=969 cs=0 l=1 rx=0x7f1b480103b0 tx=0x7f1b48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.529+0000 7f1b577fe700 1 -- 172.21.15.80:0/288725673 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1b48001ba0 con 0x7f1b60074d00 2019-11-28T11:45:01.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.704+0000 7f1b649b9700 1 -- 172.21.15.80:0/288725673 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b600792e0 con 0x7f1b60074d00 2019-11-28T11:45:01.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.705+0000 7f1b5ed9d700 1 --2- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b60074d00 0x7f1b6007aa20 secure :-1 s=THROTTLE_DONE pgs=969 cs=0 l=1 rx=0x7f1b480103b0 tx=0x7f1b48010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.705+0000 7f1b577fe700 1 -- 172.21.15.80:0/288725673 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+14884 (secure 0 0 0) 0x7f1b48004600 con 0x7f1b60074d00 2019-11-28T11:45:01.745 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:01.745 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":127,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:45:01.366152+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:44:59.649701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2019-11-28T11:45:00.387932+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:45:01.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.707+0000 7f1b649b9700 1 -- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1b38018780 msgr2=0x7f1b3801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.707+0000 7f1b649b9700 1 --2- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1b38018780 0x7f1b3801abf0 crc :-1 s=READY pgs=672 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:01.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.707+0000 7f1b649b9700 1 -- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b60074d00 msgr2=0x7f1b6007aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.707+0000 7f1b649b9700 1 --2- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b60074d00 0x7f1b6007aa20 secure :-1 s=READY pgs=969 cs=0 l=1 rx=0x7f1b480103b0 tx=0x7f1b48010750).stop 2019-11-28T11:45:01.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.707+0000 7f1b649b9700 1 -- 172.21.15.80:0/288725673 shutdown_connections 2019-11-28T11:45:01.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.707+0000 7f1b649b9700 1 --2- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1b38018780 0x7f1b3801abf0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:01.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.707+0000 7f1b649b9700 1 --2- 172.21.15.80:0/288725673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b60074d00 0x7f1b6007aa20 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:01.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.707+0000 7f1b649b9700 1 -- 172.21.15.80:0/288725673 shutdown_connections 2019-11-28T11:45:01.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.707+0000 7f1b649b9700 1 -- 172.21.15.80:0/288725673 wait complete. 2019-11-28T11:45:01.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.707+0000 7f1b649b9700 1 -- 172.21.15.80:0/288725673 >> 172.21.15.80:0/288725673 conn(0x7f1b6013fa50 msgr2=0x7f1b6007c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:01.758 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:45:01.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.838+0000 7efc08dd4700 1 Processor -- start 2019-11-28T11:45:01.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.838+0000 7efc08dd4700 1 -- start start 2019-11-28T11:45:01.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc08dd4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efc0406c490 0x7efc0406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc08dd4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc0406ce60 0x7efc04164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc08dd4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0406db00 con 0x7efc0406c0a0 2019-11-28T11:45:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc08dd4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc0406fd60 con 0x7efc0406ce60 2019-11-28T11:45:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc08dd4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc04070030 con 0x7efc0406c490 2019-11-28T11:45:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc0359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc0406ce60 0x7efc04164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc0359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc0406ce60 0x7efc04164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39876/0 (socket says 172.21.15.80:39876) 2019-11-28T11:45:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc0359e700 1 -- 172.21.15.80:0/220484331 learned_addr learned my addr 172.21.15.80:0/220484331 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc0259c700 1 --2- 172.21.15.80:0/220484331 >> v2:172.21.15.174:3300/0 conn(0x7efc0406c490 0x7efc0406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc0359e700 1 -- 172.21.15.80:0/220484331 >> v2:172.21.15.174:3300/0 conn(0x7efc0406c490 msgr2=0x7efc0406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc0359e700 1 --2- 172.21.15.80:0/220484331 >> v2:172.21.15.174:3300/0 conn(0x7efc0406c490 0x7efc0406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc0359e700 1 -- 172.21.15.80:0/220484331 >> v1:172.21.15.174:6789/0 conn(0x7efc0406c0a0 legacy=0x7efc04072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc0359e700 1 -- 172.21.15.80:0/220484331 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc040706c0 con 0x7efc0406ce60 2019-11-28T11:45:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc01d9b700 1 -- 172.21.15.80:0/220484331 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196346270 0 0) 0x7efbec001400 con 0x7efc0406c0a0 2019-11-28T11:45:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc0259c700 1 --2- 172.21.15.80:0/220484331 >> v2:172.21.15.174:3300/0 conn(0x7efc0406c490 0x7efc0406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc0359e700 1 --2- 172.21.15.80:0/220484331 >> v2:172.21.15.80:3300/0 conn(0x7efc0406ce60 0x7efc04164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efbfc00f730 tx=0x7efbfc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc0359e700 1 --2- 172.21.15.80:0/220484331 >> v2:172.21.15.80:3300/0 conn(0x7efc0406ce60 0x7efc04164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efbfc00f730 tx=0x7efbfc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc0359e700 1 --2- 172.21.15.80:0/220484331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0406ce60 0x7efc04164d70 secure :-1 s=READY pgs=1661 cs=0 l=1 rx=0x7efbfc00f730 tx=0x7efbfc00fad0).ready entity=mon.0 client_cookie=7b72c3b169522cae server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:01.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.839+0000 7efc0359e700 1 --2- 172.21.15.80:0/220484331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0406ce60 0x7efc04164d70 secure :-1 s=THROTTLE_DONE pgs=1661 cs=0 l=1 rx=0x7efbfc00f730 tx=0x7efbfc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.840+0000 7efc01d9b700 1 -- 172.21.15.80:0/220484331 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbfc000b90 con 0x7efc0406ce60 2019-11-28T11:45:01.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.840+0000 7efc0359e700 1 --2- 172.21.15.80:0/220484331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0406ce60 0x7efc04164d70 secure :-1 s=THROTTLE_DONE pgs=1661 cs=0 l=1 rx=0x7efbfc00f730 tx=0x7efbfc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.840+0000 7efc0359e700 1 --2- 172.21.15.80:0/220484331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0406ce60 0x7efc04164d70 secure :-1 s=THROTTLE_DONE pgs=1661 cs=0 l=1 rx=0x7efbfc00f730 tx=0x7efbfc00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.840+0000 7efc01d9b700 1 -- 172.21.15.80:0/220484331 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc0010e0 con 0x7efc0406ce60 2019-11-28T11:45:01.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.840+0000 7efc01d9b700 1 -- 172.21.15.80:0/220484331 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbfc001830 con 0x7efc0406ce60 2019-11-28T11:45:01.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.840+0000 7efc08dd4700 1 -- 172.21.15.80:0/220484331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0406ce60 msgr2=0x7efc04164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.840+0000 7efc08dd4700 1 --2- 172.21.15.80:0/220484331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0406ce60 0x7efc04164d70 secure :-1 s=READY pgs=1661 cs=0 l=1 rx=0x7efbfc00f730 tx=0x7efbfc00fad0).stop 2019-11-28T11:45:01.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.840+0000 7efc08dd4700 1 -- 172.21.15.80:0/220484331 shutdown_connections 2019-11-28T11:45:01.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.840+0000 7efc08dd4700 1 --2- 172.21.15.80:0/220484331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0406ce60 0x7efc04164d70 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:01.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.840+0000 7efc08dd4700 1 --2- 172.21.15.80:0/220484331 >> v2:172.21.15.174:3300/0 conn(0x7efc0406c490 0x7efc0406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:01.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.840+0000 7efc08dd4700 1 -- 172.21.15.80:0/220484331 shutdown_connections 2019-11-28T11:45:01.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.840+0000 7efc08dd4700 1 -- 172.21.15.80:0/220484331 wait complete. 2019-11-28T11:45:01.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.840+0000 7efc08dd4700 1 -- 172.21.15.80:0/220484331 >> 172.21.15.80:0/220484331 conn(0x7efc04061cf0 msgr2=0x7efc04064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.843+0000 7efc08dd4700 1 Processor -- start 2019-11-28T11:45:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.843+0000 7efc08dd4700 1 -- start start 2019-11-28T11:45:01.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc08dd4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efc0413dc00 0x7efc04109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc08dd4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc0410a3a0 0x7efc04108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc08dd4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc04109220 0x7efc04109680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc08dd4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc04105830 con 0x7efc0410a3a0 2019-11-28T11:45:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc08dd4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc04105b00 con 0x7efc0413dc00 2019-11-28T11:45:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc08dd4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc04104e00 con 0x7efc04109220 2019-11-28T11:45:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc0259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc0410a3a0 0x7efc04108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:01.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc0259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc0410a3a0 0x7efc04108ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39882/0 (socket says 172.21.15.80:39882) 2019-11-28T11:45:01.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc0259c700 1 -- 172.21.15.80:0/972811619 learned_addr learned my addr 172.21.15.80:0/972811619 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:01.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc0359e700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc04109220 0x7efc04109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:01.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc02d9d700 1 --2- 172.21.15.80:0/972811619 >> v2:172.21.15.174:3300/0 conn(0x7efc0413dc00 0x7efc04109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:01.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc0259c700 1 -- 172.21.15.80:0/972811619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc04109220 msgr2=0x7efc04109680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc0259c700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc04109220 0x7efc04109680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc0259c700 1 -- 172.21.15.80:0/972811619 >> v2:172.21.15.174:3300/0 conn(0x7efc0413dc00 msgr2=0x7efc04109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc0259c700 1 --2- 172.21.15.80:0/972811619 >> v2:172.21.15.174:3300/0 conn(0x7efc0413dc00 0x7efc04109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc0259c700 1 -- 172.21.15.80:0/972811619 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc04106190 con 0x7efc0410a3a0 2019-11-28T11:45:01.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc0259c700 1 --2- 172.21.15.80:0/972811619 >> v2:172.21.15.80:3300/0 conn(0x7efc0410a3a0 0x7efc04108ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efbf4010410 tx=0x7efbf4010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc0259c700 1 --2- 172.21.15.80:0/972811619 >> v2:172.21.15.80:3300/0 conn(0x7efc0410a3a0 0x7efc04108ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efbf4010410 tx=0x7efbf4010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc0259c700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0410a3a0 0x7efc04108ce0 secure :-1 s=READY pgs=1662 cs=0 l=1 rx=0x7efbf4010410 tx=0x7efbf4010310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:01.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc0259c700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0410a3a0 0x7efc04108ce0 secure :-1 s=THROTTLE_DONE pgs=1662 cs=0 l=1 rx=0x7efbf4010410 tx=0x7efbf4010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc0259c700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0410a3a0 0x7efc04108ce0 secure :-1 s=THROTTLE_DONE pgs=1662 cs=0 l=1 rx=0x7efbf4010410 tx=0x7efbf4010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efbfb7fe700 1 -- 172.21.15.80:0/972811619 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbf400a8c0 con 0x7efc0410a3a0 2019-11-28T11:45:01.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc0259c700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0410a3a0 0x7efc04108ce0 secure :-1 s=THROTTLE_DONE pgs=1662 cs=0 l=1 rx=0x7efbf4010410 tx=0x7efbf4010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efbfb7fe700 1 -- 172.21.15.80:0/972811619 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf400db40 con 0x7efc0410a3a0 2019-11-28T11:45:01.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efbfb7fe700 1 -- 172.21.15.80:0/972811619 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbf400e190 con 0x7efc0410a3a0 2019-11-28T11:45:01.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc08dd4700 1 -- 172.21.15.80:0/972811619 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc04106510 con 0x7efc0410a3a0 2019-11-28T11:45:01.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.844+0000 7efc08dd4700 1 -- 172.21.15.80:0/972811619 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc04106190 con 0x7efc0410a3a0 2019-11-28T11:45:01.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.845+0000 7efc0259c700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0410a3a0 0x7efc04108ce0 secure :-1 s=THROTTLE_DONE pgs=1662 cs=0 l=1 rx=0x7efbf4010410 tx=0x7efbf4010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.845+0000 7efbfb7fe700 1 -- 172.21.15.80:0/972811619 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efbf4009580 con 0x7efc0410a3a0 2019-11-28T11:45:01.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.845+0000 7efc0259c700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0410a3a0 0x7efc04108ce0 secure :-1 s=THROTTLE_DONE pgs=1662 cs=0 l=1 rx=0x7efbf4010410 tx=0x7efbf4010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.845+0000 7efbfb7fe700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbdc018730 0x7efbdc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:01.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.845+0000 7efbfb7fe700 1 -- 172.21.15.80:0/972811619 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6020+0+0 (secure 0 0 0) 0x7efbf40319f0 con 0x7efc0410a3a0 2019-11-28T11:45:01.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.845+0000 7efc02d9d700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbdc018730 0x7efbdc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:01.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.846+0000 7efc02d9d700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbdc018730 0x7efbdc01abc0 crc :-1 s=READY pgs=673 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:01.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.853+0000 7efc08dd4700 1 -- 172.21.15.80:0/972811619 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc04106510 con 0x7efc0410a3a0 2019-11-28T11:45:01.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.856+0000 7efc0259c700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0410a3a0 0x7efc04108ce0 secure :-1 s=THROTTLE_DONE pgs=1662 cs=0 l=1 rx=0x7efbf4010410 tx=0x7efbf4010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:01.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:01.856+0000 7efbfb7fe700 1 -- 172.21.15.80:0/972811619 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efbf4010b10 con 0x7efc0410a3a0 2019-11-28T11:45:02.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.035+0000 7efc08dd4700 1 -- 172.21.15.80:0/972811619 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc04106190 con 0x7efc0410a3a0 2019-11-28T11:45:02.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.035+0000 7efc0259c700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0410a3a0 0x7efc04108ce0 secure :-1 s=THROTTLE_DONE pgs=1662 cs=0 l=1 rx=0x7efbf4010410 tx=0x7efbf4010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:02.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.035+0000 7efbfb7fe700 1 -- 172.21.15.80:0/972811619 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+14884 (secure 0 0 0) 0x7efbf4010b10 con 0x7efc0410a3a0 2019-11-28T11:45:02.076 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:02.076 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":127,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:45:01.366152+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:44:59.649701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2019-11-28T11:45:00.387932+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:45:02.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.038+0000 7efc08dd4700 1 -- 172.21.15.80:0/972811619 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbdc018730 msgr2=0x7efbdc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:02.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.038+0000 7efc08dd4700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbdc018730 0x7efbdc01abc0 crc :-1 s=READY pgs=673 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:02.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.038+0000 7efc08dd4700 1 -- 172.21.15.80:0/972811619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0410a3a0 msgr2=0x7efc04108ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:02.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.038+0000 7efc08dd4700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0410a3a0 0x7efc04108ce0 secure :-1 s=READY pgs=1662 cs=0 l=1 rx=0x7efbf4010410 tx=0x7efbf4010310).stop 2019-11-28T11:45:02.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.038+0000 7efc08dd4700 1 -- 172.21.15.80:0/972811619 shutdown_connections 2019-11-28T11:45:02.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.038+0000 7efc08dd4700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbdc018730 0x7efbdc01abc0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:02.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.038+0000 7efc08dd4700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc04109220 0x7efc04109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:02.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.038+0000 7efc08dd4700 1 --2- 172.21.15.80:0/972811619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0410a3a0 0x7efc04108ce0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:02.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.038+0000 7efc08dd4700 1 --2- 172.21.15.80:0/972811619 >> v2:172.21.15.174:3300/0 conn(0x7efc0413dc00 0x7efc04109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:02.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.038+0000 7efc08dd4700 1 -- 172.21.15.80:0/972811619 shutdown_connections 2019-11-28T11:45:02.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.038+0000 7efc08dd4700 1 -- 172.21.15.80:0/972811619 wait complete. 2019-11-28T11:45:02.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.038+0000 7efc08dd4700 1 -- 172.21.15.80:0/972811619 >> 172.21.15.80:0/972811619 conn(0x7efc0411bfc0 msgr2=0x7efc04141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:02.090 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:45:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.174+0000 7fe0292f3700 1 Processor -- start 2019-11-28T11:45:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.174+0000 7fe0292f3700 1 -- start start 2019-11-28T11:45:02.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.175+0000 7fe0292f3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe02415ed10 0x7fe02415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.175+0000 7fe0292f3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe0240734b0 0x7fe0240726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.175+0000 7fe0292f3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02406db60 con 0x7fe024073020 2019-11-28T11:45:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.175+0000 7fe0292f3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe02406fe00 con 0x7fe02415ed10 2019-11-28T11:45:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.175+0000 7fe0292f3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0240700d0 con 0x7fe0240734b0 2019-11-28T11:45:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.175+0000 7fe0237fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe02415ed10 0x7fe02415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.175+0000 7fe022ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe024073020 0x7fe024071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39208/0 (socket says 172.21.15.80:39208) 2019-11-28T11:45:02.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.175+0000 7fe0237fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe02415ed10 0x7fe02415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39888/0 (socket says 172.21.15.80:39888) 2019-11-28T11:45:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.175+0000 7fe022ffd700 1 -- 172.21.15.80:0/3838845868 learned_addr learned my addr 172.21.15.80:0/3838845868 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.175+0000 7fe023fff700 1 --2- 172.21.15.80:0/3838845868 >> v2:172.21.15.174:3300/0 conn(0x7fe0240734b0 0x7fe0240726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.175+0000 7fe0237fe700 1 -- 172.21.15.80:0/3838845868 >> v2:172.21.15.174:3300/0 conn(0x7fe0240734b0 msgr2=0x7fe0240726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.175+0000 7fe0237fe700 1 --2- 172.21.15.80:0/3838845868 >> v2:172.21.15.174:3300/0 conn(0x7fe0240734b0 0x7fe0240726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0237fe700 1 -- 172.21.15.80:0/3838845868 >> v1:172.21.15.80:6789/0 conn(0x7fe024073020 legacy=0x7fe024071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:02.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0237fe700 1 -- 172.21.15.80:0/3838845868 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe024070760 con 0x7fe02415ed10 2019-11-28T11:45:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0227fc700 1 -- 172.21.15.80:0/3838845868 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427667274 0 0) 0x7fe00c0013f0 con 0x7fe024073020 2019-11-28T11:45:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0237fe700 1 --2- 172.21.15.80:0/3838845868 >> v2:172.21.15.80:3300/0 conn(0x7fe02415ed10 0x7fe02415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe01400af50 tx=0x7fe01400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0237fe700 1 --2- 172.21.15.80:0/3838845868 >> v2:172.21.15.80:3300/0 conn(0x7fe02415ed10 0x7fe02415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe01400af50 tx=0x7fe01400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0237fe700 1 --2- 172.21.15.80:0/3838845868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02415ed10 0x7fe02415f100 secure :-1 s=READY pgs=1664 cs=0 l=1 rx=0x7fe01400af50 tx=0x7fe01400b250).ready entity=mon.0 client_cookie=146051ec2dc3c8c5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0237fe700 1 --2- 172.21.15.80:0/3838845868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02415ed10 0x7fe02415f100 secure :-1 s=THROTTLE_DONE pgs=1664 cs=0 l=1 rx=0x7fe01400af50 tx=0x7fe01400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0237fe700 1 --2- 172.21.15.80:0/3838845868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02415ed10 0x7fe02415f100 secure :-1 s=THROTTLE_DONE pgs=1664 cs=0 l=1 rx=0x7fe01400af50 tx=0x7fe01400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:02.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0227fc700 1 -- 172.21.15.80:0/3838845868 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe014007210 con 0x7fe02415ed10 2019-11-28T11:45:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0237fe700 1 --2- 172.21.15.80:0/3838845868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02415ed10 0x7fe02415f100 secure :-1 s=THROTTLE_DONE pgs=1664 cs=0 l=1 rx=0x7fe01400af50 tx=0x7fe01400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0227fc700 1 -- 172.21.15.80:0/3838845868 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0140099b0 con 0x7fe02415ed10 2019-11-28T11:45:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0227fc700 1 -- 172.21.15.80:0/3838845868 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe01400a080 con 0x7fe02415ed10 2019-11-28T11:45:02.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0292f3700 1 -- 172.21.15.80:0/3838845868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02415ed10 msgr2=0x7fe02415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:02.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0292f3700 1 --2- 172.21.15.80:0/3838845868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02415ed10 0x7fe02415f100 secure :-1 s=READY pgs=1664 cs=0 l=1 rx=0x7fe01400af50 tx=0x7fe01400b250).stop 2019-11-28T11:45:02.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0292f3700 1 -- 172.21.15.80:0/3838845868 shutdown_connections 2019-11-28T11:45:02.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0292f3700 1 --2- 172.21.15.80:0/3838845868 >> v2:172.21.15.174:3300/0 conn(0x7fe0240734b0 0x7fe0240726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:02.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.176+0000 7fe0292f3700 1 --2- 172.21.15.80:0/3838845868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02415ed10 0x7fe02415f100 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:02.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.177+0000 7fe0292f3700 1 -- 172.21.15.80:0/3838845868 shutdown_connections 2019-11-28T11:45:02.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.177+0000 7fe0292f3700 1 -- 172.21.15.80:0/3838845868 wait complete. 2019-11-28T11:45:02.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.177+0000 7fe0292f3700 1 -- 172.21.15.80:0/3838845868 >> 172.21.15.80:0/3838845868 conn(0x7fe024061d20 msgr2=0x7fe0240641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:02.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.179+0000 7fe0292f3700 1 Processor -- start 2019-11-28T11:45:02.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.179+0000 7fe0292f3700 1 -- start start 2019-11-28T11:45:02.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.180+0000 7fe0292f3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe024148320 0x7fe02410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:02.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.180+0000 7fe0292f3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe02410f290 0x7fe02410dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:02.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.180+0000 7fe0292f3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe024148e00 con 0x7fe02410e110 2019-11-28T11:45:02.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.180+0000 7fe0292f3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe024139ff0 con 0x7fe02410f290 2019-11-28T11:45:02.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.180+0000 7fe0292f3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02413aa20 con 0x7fe024148320 2019-11-28T11:45:02.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.180+0000 7fe022ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe02410f290 0x7fe02410dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:02.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.180+0000 7fe022ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe02410f290 0x7fe02410dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39898/0 (socket says 172.21.15.80:39898) 2019-11-28T11:45:02.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.180+0000 7fe022ffd700 1 -- 172.21.15.80:0/3608623006 learned_addr learned my addr 172.21.15.80:0/3608623006 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:02.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.180+0000 7fe0237fe700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe024148320 0x7fe02410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:02.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.180+0000 7fe022ffd700 1 -- 172.21.15.80:0/3608623006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe024148320 msgr2=0x7fe02410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:02.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.180+0000 7fe022ffd700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe024148320 0x7fe02410ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:02.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.180+0000 7fe022ffd700 1 -- 172.21.15.80:0/3608623006 >> v1:172.21.15.174:6789/0 conn(0x7fe02410e110 legacy=0x7fe0241079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:02.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.180+0000 7fe022ffd700 1 -- 172.21.15.80:0/3608623006 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02410c490 con 0x7fe02410f290 2019-11-28T11:45:02.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.180+0000 7fe01bfff700 1 -- 172.21.15.80:0/3608623006 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363954810 0 0) 0x7fe01c001080 con 0x7fe02410e110 2019-11-28T11:45:02.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.180+0000 7fe022ffd700 1 --2- 172.21.15.80:0/3608623006 >> v2:172.21.15.80:3300/0 conn(0x7fe02410f290 0x7fe02410dbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe00c0107c0 tx=0x7fe00c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:02.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.181+0000 7fe022ffd700 1 --2- 172.21.15.80:0/3608623006 >> v2:172.21.15.80:3300/0 conn(0x7fe02410f290 0x7fe02410dbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe00c0107c0 tx=0x7fe00c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:02.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.181+0000 7fe022ffd700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02410f290 0x7fe02410dbd0 secure :-1 s=READY pgs=1665 cs=0 l=1 rx=0x7fe00c0107c0 tx=0x7fe00c0105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:02.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.181+0000 7fe022ffd700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02410f290 0x7fe02410dbd0 secure :-1 s=THROTTLE_DONE pgs=1665 cs=0 l=1 rx=0x7fe00c0107c0 tx=0x7fe00c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:02.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.181+0000 7fe01bfff700 1 -- 172.21.15.80:0/3608623006 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe00c0010d0 con 0x7fe02410f290 2019-11-28T11:45:02.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.181+0000 7fe022ffd700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02410f290 0x7fe02410dbd0 secure :-1 s=THROTTLE_DONE pgs=1665 cs=0 l=1 rx=0x7fe00c0107c0 tx=0x7fe00c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:02.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.181+0000 7fe01bfff700 1 -- 172.21.15.80:0/3608623006 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c004360 con 0x7fe02410f290 2019-11-28T11:45:02.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.181+0000 7fe022ffd700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02410f290 0x7fe02410dbd0 secure :-1 s=THROTTLE_DONE pgs=1665 cs=0 l=1 rx=0x7fe00c0107c0 tx=0x7fe00c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:02.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.181+0000 7fe0292f3700 1 -- 172.21.15.80:0/3608623006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe02410c810 con 0x7fe02410f290 2019-11-28T11:45:02.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.181+0000 7fe01bfff700 1 -- 172.21.15.80:0/3608623006 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe00c004740 con 0x7fe02410f290 2019-11-28T11:45:02.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.181+0000 7fe0292f3700 1 -- 172.21.15.80:0/3608623006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02410c490 con 0x7fe02410f290 2019-11-28T11:45:02.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.181+0000 7fe022ffd700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02410f290 0x7fe02410dbd0 secure :-1 s=THROTTLE_DONE pgs=1665 cs=0 l=1 rx=0x7fe00c0107c0 tx=0x7fe00c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:02.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.181+0000 7fe01bfff700 1 -- 172.21.15.80:0/3608623006 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe00c0010b0 con 0x7fe02410f290 2019-11-28T11:45:02.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.181+0000 7fe022ffd700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02410f290 0x7fe02410dbd0 secure :-1 s=THROTTLE_DONE pgs=1665 cs=0 l=1 rx=0x7fe00c0107c0 tx=0x7fe00c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:02.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.181+0000 7fe01bfff700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdffc018730 0x7fdffc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:02.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.181+0000 7fe01bfff700 1 -- 172.21.15.80:0/3608623006 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe00c031e20 con 0x7fe02410f290 2019-11-28T11:45:02.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.182+0000 7fe0237fe700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdffc018730 0x7fdffc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:02.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.182+0000 7fe0237fe700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdffc018730 0x7fdffc01abc0 crc :-1 s=READY pgs=674 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:02.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.189+0000 7fe0292f3700 1 -- 172.21.15.80:0/3608623006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02410c810 con 0x7fe02410f290 2019-11-28T11:45:02.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.193+0000 7fe022ffd700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02410f290 0x7fe02410dbd0 secure :-1 s=THROTTLE_DONE pgs=1665 cs=0 l=1 rx=0x7fe00c0107c0 tx=0x7fe00c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:02.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.193+0000 7fe01bfff700 1 -- 172.21.15.80:0/3608623006 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe00c000cc0 con 0x7fe02410f290 2019-11-28T11:45:02.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:02.368+0000 7fe0292f3700 1 -- 172.21.15.80:0/3608623006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7fe02410c490 con 0x7fe02410f290 2019-11-28T11:45:03.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.369+0000 7fe022ffd700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02410f290 0x7fe02410dbd0 secure :-1 s=THROTTLE_DONE pgs=1665 cs=0 l=1 rx=0x7fe00c0107c0 tx=0x7fe00c0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.369+0000 7fe01bfff700 1 -- 172.21.15.80:0/3608623006 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v89) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe00c0010b0 con 0x7fe02410f290 2019-11-28T11:45:03.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.386+0000 7fe0292f3700 1 -- 172.21.15.80:0/3608623006 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdffc018730 msgr2=0x7fdffc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:03.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.386+0000 7fe0292f3700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdffc018730 0x7fdffc01abc0 crc :-1 s=READY pgs=674 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:03.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.386+0000 7fe0292f3700 1 -- 172.21.15.80:0/3608623006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02410f290 msgr2=0x7fe02410dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:03.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.386+0000 7fe0292f3700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02410f290 0x7fe02410dbd0 secure :-1 s=READY pgs=1665 cs=0 l=1 rx=0x7fe00c0107c0 tx=0x7fe00c0105f0).stop 2019-11-28T11:45:03.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.386+0000 7fe0292f3700 1 -- 172.21.15.80:0/3608623006 shutdown_connections 2019-11-28T11:45:03.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.386+0000 7fe0292f3700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdffc018730 0x7fdffc01abc0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:03.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.386+0000 7fe0292f3700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe02410f290 0x7fe02410dbd0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:03.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.386+0000 7fe0292f3700 1 --2- 172.21.15.80:0/3608623006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe024148320 0x7fe02410ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:03.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.386+0000 7fe0292f3700 1 -- 172.21.15.80:0/3608623006 shutdown_connections 2019-11-28T11:45:03.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.387+0000 7fe0292f3700 1 -- 172.21.15.80:0/3608623006 wait complete. 2019-11-28T11:45:03.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.387+0000 7fe0292f3700 1 -- 172.21.15.80:0/3608623006 >> 172.21.15.80:0/3608623006 conn(0x7fe02415e2d0 msgr2=0x7fe024147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:03.437 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:03.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.516+0000 7f23f8809700 1 Processor -- start 2019-11-28T11:45:03.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.516+0000 7f23f8809700 1 -- start start 2019-11-28T11:45:03.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.517+0000 7f23f8809700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f23f406c0a0 0x7f23f4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:03.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.517+0000 7f23f8809700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23f4072620 0x7f23f4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:03.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.517+0000 7f23f8809700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f406db00 con 0x7f23f40734e0 2019-11-28T11:45:03.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.517+0000 7f23f8809700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f406fd60 con 0x7f23f4072620 2019-11-28T11:45:03.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.517+0000 7f23f8809700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f4070030 con 0x7f23f406c0a0 2019-11-28T11:45:03.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.517+0000 7f23f359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23f4072620 0x7f23f4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:03.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.517+0000 7f23f359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23f4072620 0x7f23f4164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39904/0 (socket says 172.21.15.80:39904) 2019-11-28T11:45:03.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.517+0000 7f23f359e700 1 -- 172.21.15.80:0/1851605936 learned_addr learned my addr 172.21.15.80:0/1851605936 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:03.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.518+0000 7f23f2d9d700 1 --2- 172.21.15.80:0/1851605936 >> v2:172.21.15.174:3300/0 conn(0x7f23f406c0a0 0x7f23f4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:03.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.518+0000 7f23f359e700 1 -- 172.21.15.80:0/1851605936 >> v2:172.21.15.174:3300/0 conn(0x7f23f406c0a0 msgr2=0x7f23f4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:03.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.518+0000 7f23f359e700 1 --2- 172.21.15.80:0/1851605936 >> v2:172.21.15.174:3300/0 conn(0x7f23f406c0a0 0x7f23f4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:03.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.518+0000 7f23f359e700 1 -- 172.21.15.80:0/1851605936 >> v1:172.21.15.174:6789/0 conn(0x7f23f40734e0 legacy=0x7f23f4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:03.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.518+0000 7f23f359e700 1 -- 172.21.15.80:0/1851605936 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f40706c0 con 0x7f23f4072620 2019-11-28T11:45:03.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.518+0000 7f23f359e700 1 --2- 172.21.15.80:0/1851605936 >> v2:172.21.15.80:3300/0 conn(0x7f23f4072620 0x7f23f4164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f23ec00fa30 tx=0x7f23ec00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.518+0000 7f23f359e700 1 --2- 172.21.15.80:0/1851605936 >> v2:172.21.15.80:3300/0 conn(0x7f23f4072620 0x7f23f4164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f23ec00fa30 tx=0x7f23ec00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.518+0000 7f23f359e700 1 --2- 172.21.15.80:0/1851605936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23f4072620 0x7f23f4164d70 secure :-1 s=READY pgs=1666 cs=0 l=1 rx=0x7f23ec00fa30 tx=0x7f23ec00fdd0).ready entity=mon.0 client_cookie=3bebfa09932a25a8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:03.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.518+0000 7f23f359e700 1 --2- 172.21.15.80:0/1851605936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23f4072620 0x7f23f4164d70 secure :-1 s=THROTTLE_DONE pgs=1666 cs=0 l=1 rx=0x7f23ec00fa30 tx=0x7f23ec00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.518+0000 7f23f359e700 1 --2- 172.21.15.80:0/1851605936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23f4072620 0x7f23f4164d70 secure :-1 s=THROTTLE_DONE pgs=1666 cs=0 l=1 rx=0x7f23ec00fa30 tx=0x7f23ec00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.518+0000 7f23f359e700 1 --2- 172.21.15.80:0/1851605936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23f4072620 0x7f23f4164d70 secure :-1 s=THROTTLE_DONE pgs=1666 cs=0 l=1 rx=0x7f23ec00fa30 tx=0x7f23ec00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.518+0000 7f23f1d9b700 1 -- 172.21.15.80:0/1851605936 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23ec000df0 con 0x7f23f4072620 2019-11-28T11:45:03.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.518+0000 7f23f1d9b700 1 -- 172.21.15.80:0/1851605936 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec001460 con 0x7f23f4072620 2019-11-28T11:45:03.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.518+0000 7f23f1d9b700 1 -- 172.21.15.80:0/1851605936 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23ec001b30 con 0x7f23f4072620 2019-11-28T11:45:03.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.518+0000 7f23f8809700 1 -- 172.21.15.80:0/1851605936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23f4072620 msgr2=0x7f23f4164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:03.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.518+0000 7f23f8809700 1 --2- 172.21.15.80:0/1851605936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23f4072620 0x7f23f4164d70 secure :-1 s=READY pgs=1666 cs=0 l=1 rx=0x7f23ec00fa30 tx=0x7f23ec00fdd0).stop 2019-11-28T11:45:03.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.519+0000 7f23f8809700 1 -- 172.21.15.80:0/1851605936 shutdown_connections 2019-11-28T11:45:03.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.519+0000 7f23f8809700 1 --2- 172.21.15.80:0/1851605936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23f4072620 0x7f23f4164d70 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:03.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.519+0000 7f23f8809700 1 --2- 172.21.15.80:0/1851605936 >> v2:172.21.15.174:3300/0 conn(0x7f23f406c0a0 0x7f23f4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:03.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.519+0000 7f23f8809700 1 -- 172.21.15.80:0/1851605936 shutdown_connections 2019-11-28T11:45:03.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.519+0000 7f23f8809700 1 -- 172.21.15.80:0/1851605936 wait complete. 2019-11-28T11:45:03.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.519+0000 7f23f8809700 1 -- 172.21.15.80:0/1851605936 >> 172.21.15.80:0/1851605936 conn(0x7f23f4061cf0 msgr2=0x7f23f4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:03.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.521+0000 7f23f8809700 1 Processor -- start 2019-11-28T11:45:03.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.521+0000 7f23f8809700 1 -- start start 2019-11-28T11:45:03.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.522+0000 7f23f8809700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f23f413e5f0 0x7f23f413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.522+0000 7f23f8809700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f41066e0 con 0x7f23f410a070 2019-11-28T11:45:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.522+0000 7f23f8809700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f410ce40 con 0x7f23f410a4e0 2019-11-28T11:45:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.522+0000 7f23f8809700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f410e060 con 0x7f23f413e5f0 2019-11-28T11:45:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.522+0000 7f23f259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f23f410a070 0x7f23f410bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39228/0 (socket says 172.21.15.80:39228) 2019-11-28T11:45:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.522+0000 7f23f259c700 1 -- 172.21.15.80:0/2252856750 learned_addr learned my addr 172.21.15.80:0/2252856750 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.522+0000 7f23f2d9d700 1 --2- 172.21.15.80:0/2252856750 >> v2:172.21.15.174:3300/0 conn(0x7f23f413e5f0 0x7f23f413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:03.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23eb7fe700 1 -- 172.21.15.80:0/2252856750 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285295312 0 0) 0x7f23e40009b0 con 0x7f23f410a070 2019-11-28T11:45:03.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23eb7fe700 1 -- 172.21.15.80:0/2252856750 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23cc002e80 con 0x7f23f410a070 2019-11-28T11:45:03.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23f2d9d700 1 -- 172.21.15.80:0/2252856750 >> v1:172.21.15.174:6789/0 conn(0x7f23f410a4e0 legacy=0x7f23f410c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:03.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23eb7fe700 1 -- 172.21.15.80:0/2252856750 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316356349 0 0) 0x7f23ec007d60 con 0x7f23f410a4e0 2019-11-28T11:45:03.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23f2d9d700 1 -- 172.21.15.80:0/2252856750 >> v1:172.21.15.80:6789/0 conn(0x7f23f410a070 legacy=0x7f23f410bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:03.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23f2d9d700 1 -- 172.21.15.80:0/2252856750 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f410e9c0 con 0x7f23f413e5f0 2019-11-28T11:45:03.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23f2d9d700 1 --2- 172.21.15.80:0/2252856750 >> v2:172.21.15.174:3300/0 conn(0x7f23f413e5f0 0x7f23f413e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23dc0103b0 tx=0x7f23dc010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23f2d9d700 1 --2- 172.21.15.80:0/2252856750 >> v2:172.21.15.174:3300/0 conn(0x7f23f413e5f0 0x7f23f413e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23dc0103b0 tx=0x7f23dc010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23f2d9d700 1 --2- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f413e5f0 0x7f23f413e9e0 secure :-1 s=READY pgs=974 cs=0 l=1 rx=0x7f23dc0103b0 tx=0x7f23dc010750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:03.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23f2d9d700 1 --2- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f413e5f0 0x7f23f413e9e0 secure :-1 s=THROTTLE_DONE pgs=974 cs=0 l=1 rx=0x7f23dc0103b0 tx=0x7f23dc010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23eb7fe700 1 -- 172.21.15.80:0/2252856750 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23dc000940 con 0x7f23f413e5f0 2019-11-28T11:45:03.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23f2d9d700 1 --2- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f413e5f0 0x7f23f413e9e0 secure :-1 s=THROTTLE_DONE pgs=974 cs=0 l=1 rx=0x7f23dc0103b0 tx=0x7f23dc010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23f8809700 1 -- 172.21.15.80:0/2252856750 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f410ed40 con 0x7f23f413e5f0 2019-11-28T11:45:03.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23eb7fe700 1 -- 172.21.15.80:0/2252856750 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc000940 con 0x7f23f413e5f0 2019-11-28T11:45:03.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23f2d9d700 1 --2- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f413e5f0 0x7f23f413e9e0 secure :-1 s=THROTTLE_DONE pgs=974 cs=0 l=1 rx=0x7f23dc0103b0 tx=0x7f23dc010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23eb7fe700 1 -- 172.21.15.80:0/2252856750 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23dc005770 con 0x7f23f413e5f0 2019-11-28T11:45:03.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.523+0000 7f23f8809700 1 -- 172.21.15.80:0/2252856750 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f410e9c0 con 0x7f23f413e5f0 2019-11-28T11:45:03.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.524+0000 7f23f2d9d700 1 --2- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f413e5f0 0x7f23f413e9e0 secure :-1 s=THROTTLE_DONE pgs=974 cs=0 l=1 rx=0x7f23dc0103b0 tx=0x7f23dc010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.524+0000 7f23eb7fe700 1 -- 172.21.15.80:0/2252856750 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f23dc005e50 con 0x7f23f413e5f0 2019-11-28T11:45:03.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.524+0000 7f23f2d9d700 1 --2- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f413e5f0 0x7f23f413e9e0 secure :-1 s=THROTTLE_DONE pgs=974 cs=0 l=1 rx=0x7f23dc0103b0 tx=0x7f23dc010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.524+0000 7f23eb7fe700 1 --2- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f23cc018780 0x7f23cc01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:03.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.524+0000 7f23eb7fe700 1 -- 172.21.15.80:0/2252856750 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f23dc031a10 con 0x7f23f413e5f0 2019-11-28T11:45:03.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.524+0000 7f23f259c700 1 --2- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f23cc018780 0x7f23cc01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:03.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.524+0000 7f23f259c700 1 --2- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f23cc018780 0x7f23cc01abf0 crc :-1 s=READY pgs=675 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:03.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.532+0000 7f23f8809700 1 -- 172.21.15.80:0/2252856750 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f410ed40 con 0x7f23f413e5f0 2019-11-28T11:45:03.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.536+0000 7f23f2d9d700 1 --2- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f413e5f0 0x7f23f413e9e0 secure :-1 s=THROTTLE_DONE pgs=974 cs=0 l=1 rx=0x7f23dc0103b0 tx=0x7f23dc010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.536+0000 7f23eb7fe700 1 -- 172.21.15.80:0/2252856750 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f23dc005c40 con 0x7f23f413e5f0 2019-11-28T11:45:03.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.707+0000 7f23f8809700 1 -- 172.21.15.80:0/2252856750 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23f410e9c0 con 0x7f23f413e5f0 2019-11-28T11:45:03.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.708+0000 7f23f2d9d700 1 --2- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f413e5f0 0x7f23f413e9e0 secure :-1 s=THROTTLE_DONE pgs=974 cs=0 l=1 rx=0x7f23dc0103b0 tx=0x7f23dc010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.708+0000 7f23eb7fe700 1 -- 172.21.15.80:0/2252856750 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+1426 (secure 0 0 0) 0x7f23dc005e50 con 0x7f23f413e5f0 2019-11-28T11:45:03.749 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 89 2019-11-28T11:45:03.752 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:03.752 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":89,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:01.366373+0000","modified":"2019-11-28T11:45:03.368624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2019-11-28T11:45:03.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.710+0000 7f23f8809700 1 -- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f23cc018780 msgr2=0x7f23cc01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:03.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.710+0000 7f23f8809700 1 --2- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f23cc018780 0x7f23cc01abf0 crc :-1 s=READY pgs=675 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:03.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.710+0000 7f23f8809700 1 -- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f413e5f0 msgr2=0x7f23f413e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:03.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.710+0000 7f23f8809700 1 --2- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f413e5f0 0x7f23f413e9e0 secure :-1 s=READY pgs=974 cs=0 l=1 rx=0x7f23dc0103b0 tx=0x7f23dc010750).stop 2019-11-28T11:45:03.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.710+0000 7f23f8809700 1 -- 172.21.15.80:0/2252856750 shutdown_connections 2019-11-28T11:45:03.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.710+0000 7f23f8809700 1 --2- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f23cc018780 0x7f23cc01abf0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:03.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.710+0000 7f23f8809700 1 --2- 172.21.15.80:0/2252856750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f413e5f0 0x7f23f413e9e0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:03.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.710+0000 7f23f8809700 1 -- 172.21.15.80:0/2252856750 shutdown_connections 2019-11-28T11:45:03.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.710+0000 7f23f8809700 1 -- 172.21.15.80:0/2252856750 wait complete. 2019-11-28T11:45:03.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.710+0000 7f23f8809700 1 -- 172.21.15.80:0/2252856750 >> 172.21.15.80:0/2252856750 conn(0x7f23f413d620 msgr2=0x7f23f413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:03.762 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:45:03.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.842+0000 7efe466ab700 1 Processor -- start 2019-11-28T11:45:03.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.842+0000 7efe466ab700 1 -- start start 2019-11-28T11:45:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.843+0000 7efe466ab700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe4006c0a0 0x7efe40072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.843+0000 7efe466ab700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe400734e0 0x7efe40071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.843+0000 7efe466ab700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe40072360 0x7efe40072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.843+0000 7efe466ab700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4006fd60 con 0x7efe40072360 2019-11-28T11:45:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.843+0000 7efe466ab700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe40070030 con 0x7efe4006c0a0 2019-11-28T11:45:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.843+0000 7efe466ab700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4006f330 con 0x7efe400734e0 2019-11-28T11:45:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.843+0000 7efe45449700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe40072360 0x7efe40072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.843+0000 7efe45449700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe40072360 0x7efe40072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39920/0 (socket says 172.21.15.80:39920) 2019-11-28T11:45:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.843+0000 7efe45449700 1 -- 172.21.15.80:0/3912722752 learned_addr learned my addr 172.21.15.80:0/3912722752 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.843+0000 7efe44c48700 1 --2- 172.21.15.80:0/3912722752 >> v2:172.21.15.174:3300/0 conn(0x7efe4006c0a0 0x7efe40072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.843+0000 7efe3ffff700 1 --2- 172.21.15.80:0/3912722752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe400734e0 0x7efe40071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:03.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe45449700 1 -- 172.21.15.80:0/3912722752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe400734e0 msgr2=0x7efe40071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe45449700 1 --2- 172.21.15.80:0/3912722752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe400734e0 0x7efe40071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe45449700 1 -- 172.21.15.80:0/3912722752 >> v2:172.21.15.174:3300/0 conn(0x7efe4006c0a0 msgr2=0x7efe40072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe45449700 1 --2- 172.21.15.80:0/3912722752 >> v2:172.21.15.174:3300/0 conn(0x7efe4006c0a0 0x7efe40072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe45449700 1 -- 172.21.15.80:0/3912722752 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe400706c0 con 0x7efe40072360 2019-11-28T11:45:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe44c48700 1 --2- 172.21.15.80:0/3912722752 >> v2:172.21.15.174:3300/0 conn(0x7efe4006c0a0 0x7efe40072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe3ffff700 1 --2- 172.21.15.80:0/3912722752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe400734e0 0x7efe40071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:03.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe45449700 1 --2- 172.21.15.80:0/3912722752 >> v2:172.21.15.80:3300/0 conn(0x7efe40072360 0x7efe40072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efe3800f730 tx=0x7efe3800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe45449700 1 --2- 172.21.15.80:0/3912722752 >> v2:172.21.15.80:3300/0 conn(0x7efe40072360 0x7efe40072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efe3800f730 tx=0x7efe3800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe45449700 1 --2- 172.21.15.80:0/3912722752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe40072360 0x7efe40072800 secure :-1 s=READY pgs=1668 cs=0 l=1 rx=0x7efe3800f730 tx=0x7efe3800fad0).ready entity=mon.0 client_cookie=51f686bcd837044e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:03.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe45449700 1 --2- 172.21.15.80:0/3912722752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe40072360 0x7efe40072800 secure :-1 s=THROTTLE_DONE pgs=1668 cs=0 l=1 rx=0x7efe3800f730 tx=0x7efe3800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe45449700 1 --2- 172.21.15.80:0/3912722752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe40072360 0x7efe40072800 secure :-1 s=THROTTLE_DONE pgs=1668 cs=0 l=1 rx=0x7efe3800f730 tx=0x7efe3800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe3f7fe700 1 -- 172.21.15.80:0/3912722752 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe380010e0 con 0x7efe40072360 2019-11-28T11:45:03.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe45449700 1 --2- 172.21.15.80:0/3912722752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe40072360 0x7efe40072800 secure :-1 s=THROTTLE_DONE pgs=1668 cs=0 l=1 rx=0x7efe3800f730 tx=0x7efe3800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe3f7fe700 1 -- 172.21.15.80:0/3912722752 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe38000b90 con 0x7efe40072360 2019-11-28T11:45:03.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe3f7fe700 1 -- 172.21.15.80:0/3912722752 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe380016c0 con 0x7efe40072360 2019-11-28T11:45:03.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe466ab700 1 -- 172.21.15.80:0/3912722752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe40072360 msgr2=0x7efe40072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:03.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.844+0000 7efe466ab700 1 --2- 172.21.15.80:0/3912722752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe40072360 0x7efe40072800 secure :-1 s=READY pgs=1668 cs=0 l=1 rx=0x7efe3800f730 tx=0x7efe3800fad0).stop 2019-11-28T11:45:03.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.845+0000 7efe466ab700 1 -- 172.21.15.80:0/3912722752 shutdown_connections 2019-11-28T11:45:03.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.845+0000 7efe466ab700 1 --2- 172.21.15.80:0/3912722752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe40072360 0x7efe40072800 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:03.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.845+0000 7efe466ab700 1 --2- 172.21.15.80:0/3912722752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe400734e0 0x7efe40071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:03.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.845+0000 7efe466ab700 1 --2- 172.21.15.80:0/3912722752 >> v2:172.21.15.174:3300/0 conn(0x7efe4006c0a0 0x7efe40072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:03.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.845+0000 7efe466ab700 1 -- 172.21.15.80:0/3912722752 shutdown_connections 2019-11-28T11:45:03.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.845+0000 7efe466ab700 1 -- 172.21.15.80:0/3912722752 wait complete. 2019-11-28T11:45:03.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.845+0000 7efe466ab700 1 -- 172.21.15.80:0/3912722752 >> 172.21.15.80:0/3912722752 conn(0x7efe40061cf0 msgr2=0x7efe40064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.847+0000 7efe466ab700 1 Processor -- start 2019-11-28T11:45:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.847+0000 7efe466ab700 1 -- start start 2019-11-28T11:45:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.848+0000 7efe466ab700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe4013dc00 0x7efe40109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:03.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.848+0000 7efe466ab700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe4010a3a0 0x7efe40108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.848+0000 7efe466ab700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe401312c0 con 0x7efe40109220 2019-11-28T11:45:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.848+0000 7efe466ab700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe40105830 con 0x7efe4013dc00 2019-11-28T11:45:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.848+0000 7efe466ab700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe40105b00 con 0x7efe4010a3a0 2019-11-28T11:45:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.848+0000 7efe44c48700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe4013dc00 0x7efe40109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.848+0000 7efe44c48700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe4013dc00 0x7efe40109e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39924/0 (socket says 172.21.15.80:39924) 2019-11-28T11:45:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.848+0000 7efe44c48700 1 -- 172.21.15.80:0/897607627 learned_addr learned my addr 172.21.15.80:0/897607627 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.848+0000 7efe3ffff700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe4010a3a0 0x7efe40108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.848+0000 7efe44c48700 1 -- 172.21.15.80:0/897607627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe4010a3a0 msgr2=0x7efe40108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.848+0000 7efe44c48700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe4010a3a0 0x7efe40108ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.848+0000 7efe44c48700 1 -- 172.21.15.80:0/897607627 >> v1:172.21.15.174:6789/0 conn(0x7efe40109220 legacy=0x7efe40103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.848+0000 7efe44c48700 1 -- 172.21.15.80:0/897607627 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe40106190 con 0x7efe4013dc00 2019-11-28T11:45:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.848+0000 7efe3ffff700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe4010a3a0 0x7efe40108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.848+0000 7efe44c48700 1 --2- 172.21.15.80:0/897607627 >> v2:172.21.15.80:3300/0 conn(0x7efe4013dc00 0x7efe40109e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe28010430 tx=0x7efe280107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.849+0000 7efe44c48700 1 --2- 172.21.15.80:0/897607627 >> v2:172.21.15.80:3300/0 conn(0x7efe4013dc00 0x7efe40109e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe28010430 tx=0x7efe280107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.849+0000 7efe44c48700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4013dc00 0x7efe40109e60 secure :-1 s=READY pgs=1669 cs=0 l=1 rx=0x7efe28010430 tx=0x7efe280107d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.849+0000 7efe44c48700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4013dc00 0x7efe40109e60 secure :-1 s=THROTTLE_DONE pgs=1669 cs=0 l=1 rx=0x7efe28010430 tx=0x7efe280107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.849+0000 7efe44c48700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4013dc00 0x7efe40109e60 secure :-1 s=THROTTLE_DONE pgs=1669 cs=0 l=1 rx=0x7efe28010430 tx=0x7efe280107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.849+0000 7efe3d7fa700 1 -- 172.21.15.80:0/897607627 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe28000bc0 con 0x7efe4013dc00 2019-11-28T11:45:03.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.849+0000 7efe44c48700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4013dc00 0x7efe40109e60 secure :-1 s=THROTTLE_DONE pgs=1669 cs=0 l=1 rx=0x7efe28010430 tx=0x7efe280107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.849+0000 7efe3d7fa700 1 -- 172.21.15.80:0/897607627 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe280094b0 con 0x7efe4013dc00 2019-11-28T11:45:03.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.849+0000 7efe466ab700 1 -- 172.21.15.80:0/897607627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe40106510 con 0x7efe4013dc00 2019-11-28T11:45:03.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.849+0000 7efe3d7fa700 1 -- 172.21.15.80:0/897607627 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe280011a0 con 0x7efe4013dc00 2019-11-28T11:45:03.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.849+0000 7efe466ab700 1 -- 172.21.15.80:0/897607627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe40106190 con 0x7efe4013dc00 2019-11-28T11:45:03.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.849+0000 7efe44c48700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4013dc00 0x7efe40109e60 secure :-1 s=THROTTLE_DONE pgs=1669 cs=0 l=1 rx=0x7efe28010430 tx=0x7efe280107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.849+0000 7efe3d7fa700 1 -- 172.21.15.80:0/897607627 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efe28000bc0 con 0x7efe4013dc00 2019-11-28T11:45:03.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.850+0000 7efe44c48700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4013dc00 0x7efe40109e60 secure :-1 s=THROTTLE_DONE pgs=1669 cs=0 l=1 rx=0x7efe28010430 tx=0x7efe280107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.850+0000 7efe3d7fa700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe24018730 0x7efe2401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:03.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.850+0000 7efe3d7fa700 1 -- 172.21.15.80:0/897607627 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7efe28031aa0 con 0x7efe4013dc00 2019-11-28T11:45:03.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.850+0000 7efe3ffff700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe24018730 0x7efe2401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:03.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.850+0000 7efe3ffff700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe24018730 0x7efe2401abc0 crc :-1 s=READY pgs=676 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:03.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.858+0000 7efe466ab700 1 -- 172.21.15.80:0/897607627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe40106510 con 0x7efe4013dc00 2019-11-28T11:45:03.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.861+0000 7efe44c48700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4013dc00 0x7efe40109e60 secure :-1 s=THROTTLE_DONE pgs=1669 cs=0 l=1 rx=0x7efe28010430 tx=0x7efe280107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:03.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:03.861+0000 7efe3d7fa700 1 -- 172.21.15.80:0/897607627 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efe280174a0 con 0x7efe4013dc00 2019-11-28T11:45:04.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.041+0000 7efe466ab700 1 -- 172.21.15.80:0/897607627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe40106190 con 0x7efe4013dc00 2019-11-28T11:45:04.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.042+0000 7efe44c48700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4013dc00 0x7efe40109e60 secure :-1 s=THROTTLE_DONE pgs=1669 cs=0 l=1 rx=0x7efe28010430 tx=0x7efe280107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.042+0000 7efe3d7fa700 1 -- 172.21.15.80:0/897607627 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+14871 (secure 0 0 0) 0x7efe280176b0 con 0x7efe4013dc00 2019-11-28T11:45:04.082 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:04.082 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":128,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:45:02.367501+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:44:59.649701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2019-11-28T11:45:00.387932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:45:04.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.044+0000 7efe466ab700 1 -- 172.21.15.80:0/897607627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe24018730 msgr2=0x7efe2401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.044+0000 7efe466ab700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe24018730 0x7efe2401abc0 crc :-1 s=READY pgs=676 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:04.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.044+0000 7efe466ab700 1 -- 172.21.15.80:0/897607627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4013dc00 msgr2=0x7efe40109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.044+0000 7efe466ab700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4013dc00 0x7efe40109e60 secure :-1 s=READY pgs=1669 cs=0 l=1 rx=0x7efe28010430 tx=0x7efe280107d0).stop 2019-11-28T11:45:04.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.044+0000 7efe466ab700 1 -- 172.21.15.80:0/897607627 shutdown_connections 2019-11-28T11:45:04.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.044+0000 7efe466ab700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efe24018730 0x7efe2401abc0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:04.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.044+0000 7efe466ab700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe4010a3a0 0x7efe40108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:04.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.044+0000 7efe466ab700 1 --2- 172.21.15.80:0/897607627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe4013dc00 0x7efe40109e60 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:04.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.044+0000 7efe466ab700 1 -- 172.21.15.80:0/897607627 shutdown_connections 2019-11-28T11:45:04.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.044+0000 7efe466ab700 1 -- 172.21.15.80:0/897607627 wait complete. 2019-11-28T11:45:04.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.044+0000 7efe466ab700 1 -- 172.21.15.80:0/897607627 >> 172.21.15.80:0/897607627 conn(0x7efe4011bfc0 msgr2=0x7efe40141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:04.096 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:45:04.096 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:45:04.097 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:45:04.097 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:45:04.097 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:45:04.097 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:45:04.101 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:45:04.102 DEBUG:teuthology.parallel:result is None 2019-11-28T11:45:04.103 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:45:04.103 DEBUG:teuthology.parallel:result is None 2019-11-28T11:45:04.105 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:45:04.105 DEBUG:teuthology.parallel:result is None 2019-11-28T11:45:04.105 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:45:04.190 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:45:04.193 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:45:04.193 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:45:04.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.201+0000 7f1887c37700 1 Processor -- start 2019-11-28T11:45:04.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.201+0000 7f1887c37700 1 -- start start 2019-11-28T11:45:04.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.202+0000 7f1887c37700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f188015ed10 0x7f188015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:04.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.202+0000 7f1887c37700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f18800734b0 0x7f18800726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:04.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.202+0000 7f1887c37700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188006db60 con 0x7f1880073020 2019-11-28T11:45:04.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.202+0000 7f1887c37700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188006f3d0 con 0x7f18800734b0 2019-11-28T11:45:04.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.202+0000 7f1887c37700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188006fe00 con 0x7f188015ed10 2019-11-28T11:45:04.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.202+0000 7f18869d5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f18800734b0 0x7f18800726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:04.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.202+0000 7f18859d3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1880073020 0x7f1880071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39272/0 (socket says 172.21.15.80:39272) 2019-11-28T11:45:04.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.202+0000 7f18859d3700 1 -- 172.21.15.80:0/4113994207 learned_addr learned my addr 172.21.15.80:0/4113994207 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:04.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f18861d4700 1 --2- 172.21.15.80:0/4113994207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f188015ed10 0x7f188015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:04.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f18869d5700 1 -- 172.21.15.80:0/4113994207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f188015ed10 msgr2=0x7f188015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:04.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f18869d5700 1 --2- 172.21.15.80:0/4113994207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f188015ed10 0x7f188015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:04.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f18869d5700 1 -- 172.21.15.80:0/4113994207 >> v1:172.21.15.80:6789/0 conn(0x7f1880073020 legacy=0x7f1880071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f18869d5700 1 -- 172.21.15.80:0/4113994207 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1880070760 con 0x7f18800734b0 2019-11-28T11:45:04.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f18851d2700 1 -- 172.21.15.80:0/4113994207 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712000637 0 0) 0x7f1874001070 con 0x7f1880073020 2019-11-28T11:45:04.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f18869d5700 1 --2- 172.21.15.80:0/4113994207 >> v2:172.21.15.80:3300/0 conn(0x7f18800734b0 0x7f18800726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f187800af50 tx=0x7f187800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f18869d5700 1 --2- 172.21.15.80:0/4113994207 >> v2:172.21.15.80:3300/0 conn(0x7f18800734b0 0x7f18800726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f187800af50 tx=0x7f187800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f18869d5700 1 --2- 172.21.15.80:0/4113994207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18800734b0 0x7f18800726a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rx=0x7f187800af50 tx=0x7f187800b6e0).ready entity=mon.0 client_cookie=1fd71c5247acc9a9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:04.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f18869d5700 1 --2- 172.21.15.80:0/4113994207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18800734b0 0x7f18800726a0 secure :-1 s=THROTTLE_DONE pgs=1680 cs=0 l=1 rx=0x7f187800af50 tx=0x7f187800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f18851d2700 1 -- 172.21.15.80:0/4113994207 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1878009ba0 con 0x7f18800734b0 2019-11-28T11:45:04.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f18869d5700 1 --2- 172.21.15.80:0/4113994207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18800734b0 0x7f18800726a0 secure :-1 s=THROTTLE_DONE pgs=1680 cs=0 l=1 rx=0x7f187800af50 tx=0x7f187800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f18869d5700 1 --2- 172.21.15.80:0/4113994207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18800734b0 0x7f18800726a0 secure :-1 s=THROTTLE_DONE pgs=1680 cs=0 l=1 rx=0x7f187800af50 tx=0x7f187800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f18851d2700 1 -- 172.21.15.80:0/4113994207 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18780097c0 con 0x7f18800734b0 2019-11-28T11:45:04.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f18851d2700 1 -- 172.21.15.80:0/4113994207 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f187800a180 con 0x7f18800734b0 2019-11-28T11:45:04.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f1887c37700 1 -- 172.21.15.80:0/4113994207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18800734b0 msgr2=0x7f18800726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.203+0000 7f1887c37700 1 --2- 172.21.15.80:0/4113994207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18800734b0 0x7f18800726a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rx=0x7f187800af50 tx=0x7f187800b6e0).stop 2019-11-28T11:45:04.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.204+0000 7f1887c37700 1 -- 172.21.15.80:0/4113994207 shutdown_connections 2019-11-28T11:45:04.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.204+0000 7f1887c37700 1 --2- 172.21.15.80:0/4113994207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18800734b0 0x7f18800726a0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:04.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.204+0000 7f1887c37700 1 --2- 172.21.15.80:0/4113994207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f188015ed10 0x7f188015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:04.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.204+0000 7f1887c37700 1 -- 172.21.15.80:0/4113994207 shutdown_connections 2019-11-28T11:45:04.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.204+0000 7f1887c37700 1 -- 172.21.15.80:0/4113994207 wait complete. 2019-11-28T11:45:04.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.204+0000 7f1887c37700 1 -- 172.21.15.80:0/4113994207 >> 172.21.15.80:0/4113994207 conn(0x7f1880061d40 msgr2=0x7f18800641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:04.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.206+0000 7f1887c37700 1 Processor -- start 2019-11-28T11:45:04.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.206+0000 7f1887c37700 1 -- start start 2019-11-28T11:45:04.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.207+0000 7f1887c37700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1880152750 0x7f1880135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:04.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.207+0000 7f1887c37700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1880130dc0 0x7f1880131250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:04.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.207+0000 7f1887c37700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1880109d70 con 0x7f1880131790 2019-11-28T11:45:04.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.207+0000 7f1887c37700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1880131c10 con 0x7f1880130dc0 2019-11-28T11:45:04.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.207+0000 7f1887c37700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1880132570 con 0x7f1880152750 2019-11-28T11:45:04.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.207+0000 7f18859d3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1880130dc0 0x7f1880131250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:04.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.207+0000 7f18869d5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1880131790 0x7f1880134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39274/0 (socket says 172.21.15.80:39274) 2019-11-28T11:45:04.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.207+0000 7f18869d5700 1 -- 172.21.15.80:0/2671239118 learned_addr learned my addr 172.21.15.80:0/2671239118 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:04.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.207+0000 7f18861d4700 1 --2- 172.21.15.80:0/2671239118 >> v2:172.21.15.174:3300/0 conn(0x7f1880152750 0x7f1880135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:04.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f18859d3700 1 -- 172.21.15.80:0/2671239118 >> v2:172.21.15.174:3300/0 conn(0x7f1880152750 msgr2=0x7f1880135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f18859d3700 1 --2- 172.21.15.80:0/2671239118 >> v2:172.21.15.174:3300/0 conn(0x7f1880152750 0x7f1880135790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:04.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f18859d3700 1 -- 172.21.15.80:0/2671239118 >> v1:172.21.15.80:6789/0 conn(0x7f1880131790 legacy=0x7f1880134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f18859d3700 1 -- 172.21.15.80:0/2671239118 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1880132ed0 con 0x7f1880130dc0 2019-11-28T11:45:04.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f187effd700 1 -- 172.21.15.80:0/2671239118 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482291257 0 0) 0x7f1878009580 con 0x7f1880131790 2019-11-28T11:45:04.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f18859d3700 1 --2- 172.21.15.80:0/2671239118 >> v2:172.21.15.80:3300/0 conn(0x7f1880130dc0 0x7f1880131250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18740103a0 tx=0x7f18740101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f18859d3700 1 --2- 172.21.15.80:0/2671239118 >> v2:172.21.15.80:3300/0 conn(0x7f1880130dc0 0x7f1880131250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18740103a0 tx=0x7f18740101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f18859d3700 1 --2- 172.21.15.80:0/2671239118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1880130dc0 0x7f1880131250 secure :-1 s=READY pgs=1682 cs=0 l=1 rx=0x7f18740103a0 tx=0x7f18740101d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:04.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f18859d3700 1 --2- 172.21.15.80:0/2671239118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1880130dc0 0x7f1880131250 secure :-1 s=THROTTLE_DONE pgs=1682 cs=0 l=1 rx=0x7f18740103a0 tx=0x7f18740101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f187effd700 1 -- 172.21.15.80:0/2671239118 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1874001230 con 0x7f1880130dc0 2019-11-28T11:45:04.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f18859d3700 1 --2- 172.21.15.80:0/2671239118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1880130dc0 0x7f1880131250 secure :-1 s=THROTTLE_DONE pgs=1682 cs=0 l=1 rx=0x7f18740103a0 tx=0x7f18740101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f18859d3700 1 --2- 172.21.15.80:0/2671239118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1880130dc0 0x7f1880131250 secure :-1 s=THROTTLE_DONE pgs=1682 cs=0 l=1 rx=0x7f18740103a0 tx=0x7f18740101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f187effd700 1 -- 172.21.15.80:0/2671239118 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1874003fe0 con 0x7f1880130dc0 2019-11-28T11:45:04.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f187effd700 1 -- 172.21.15.80:0/2671239118 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1874004730 con 0x7f1880130dc0 2019-11-28T11:45:04.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f1887c37700 1 -- 172.21.15.80:0/2671239118 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1880133250 con 0x7f1880130dc0 2019-11-28T11:45:04.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f1887c37700 1 -- 172.21.15.80:0/2671239118 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1880132ed0 con 0x7f1880130dc0 2019-11-28T11:45:04.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.208+0000 7f18859d3700 1 --2- 172.21.15.80:0/2671239118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1880130dc0 0x7f1880131250 secure :-1 s=THROTTLE_DONE pgs=1682 cs=0 l=1 rx=0x7f18740103a0 tx=0x7f18740101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.209+0000 7f187effd700 1 -- 172.21.15.80:0/2671239118 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1874000dd0 con 0x7f1880130dc0 2019-11-28T11:45:04.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.209+0000 7f18859d3700 1 --2- 172.21.15.80:0/2671239118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1880130dc0 0x7f1880131250 secure :-1 s=THROTTLE_DONE pgs=1682 cs=0 l=1 rx=0x7f18740103a0 tx=0x7f18740101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.209+0000 7f187effd700 1 --2- 172.21.15.80:0/2671239118 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1860018730 0x7f186001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:04.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.209+0000 7f187effd700 1 -- 172.21.15.80:0/2671239118 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f18740319c0 con 0x7f1880130dc0 2019-11-28T11:45:04.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.209+0000 7f18861d4700 1 --2- 172.21.15.80:0/2671239118 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1860018730 0x7f186001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:04.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.209+0000 7f18861d4700 1 --2- 172.21.15.80:0/2671239118 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1860018730 0x7f186001abc0 crc :-1 s=READY pgs=677 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:04.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.217+0000 7f1887c37700 1 -- 172.21.15.80:0/2671239118 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1880133250 con 0x7f1880130dc0 2019-11-28T11:45:04.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.220+0000 7f18859d3700 1 --2- 172.21.15.80:0/2671239118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1880130dc0 0x7f1880131250 secure :-1 s=THROTTLE_DONE pgs=1682 cs=0 l=1 rx=0x7f18740103a0 tx=0x7f18740101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.220+0000 7f187effd700 1 -- 172.21.15.80:0/2671239118 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1874026210 con 0x7f1880130dc0 2019-11-28T11:45:04.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.397+0000 7f1887c37700 1 -- 172.21.15.80:0/2671239118 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1880132ed0 con 0x7f1880130dc0 2019-11-28T11:45:04.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.400+0000 7f18859d3700 1 --2- 172.21.15.80:0/2671239118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1880130dc0 0x7f1880131250 secure :-1 s=THROTTLE_DONE pgs=1682 cs=0 l=1 rx=0x7f18740103a0 tx=0x7f18740101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.400+0000 7f187effd700 1 -- 172.21.15.80:0/2671239118 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v44) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1874026210 con 0x7f1880130dc0 2019-11-28T11:45:04.440 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:45:04.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.403+0000 7f1887c37700 1 -- 172.21.15.80:0/2671239118 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1860018730 msgr2=0x7f186001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.403+0000 7f1887c37700 1 --2- 172.21.15.80:0/2671239118 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1860018730 0x7f186001abc0 crc :-1 s=READY pgs=677 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:04.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.403+0000 7f1887c37700 1 -- 172.21.15.80:0/2671239118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1880130dc0 msgr2=0x7f1880131250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.403+0000 7f1887c37700 1 --2- 172.21.15.80:0/2671239118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1880130dc0 0x7f1880131250 secure :-1 s=READY pgs=1682 cs=0 l=1 rx=0x7f18740103a0 tx=0x7f18740101d0).stop 2019-11-28T11:45:04.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.403+0000 7f1887c37700 1 -- 172.21.15.80:0/2671239118 shutdown_connections 2019-11-28T11:45:04.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.403+0000 7f1887c37700 1 --2- 172.21.15.80:0/2671239118 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1860018730 0x7f186001abc0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:04.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.403+0000 7f1887c37700 1 --2- 172.21.15.80:0/2671239118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1880130dc0 0x7f1880131250 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:04.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.403+0000 7f1887c37700 1 --2- 172.21.15.80:0/2671239118 >> v2:172.21.15.174:3300/0 conn(0x7f1880152750 0x7f1880135790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:04.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.403+0000 7f1887c37700 1 -- 172.21.15.80:0/2671239118 shutdown_connections 2019-11-28T11:45:04.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.403+0000 7f1887c37700 1 -- 172.21.15.80:0/2671239118 wait complete. 2019-11-28T11:45:04.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.403+0000 7f1887c37700 1 -- 172.21.15.80:0/2671239118 >> 172.21.15.80:0/2671239118 conn(0x7f18801476e0 msgr2=0x7f188012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:04.452 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:45:04.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.544+0000 7f9a46ea3700 1 Processor -- start 2019-11-28T11:45:04.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.545+0000 7f9a46ea3700 1 -- start start 2019-11-28T11:45:04.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.545+0000 7f9a46ea3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a401639f0 0x7f9a40165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:04.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.545+0000 7f9a46ea3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4006db60 con 0x7f9a4015ed10 2019-11-28T11:45:04.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.545+0000 7f9a46ea3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4006e060 con 0x7f9a4015f100 2019-11-28T11:45:04.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.545+0000 7f9a46ea3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4006fe00 con 0x7f9a401639f0 2019-11-28T11:45:04.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a45c41700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a401639f0 0x7f9a40165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:04.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a45c41700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a401639f0 0x7f9a40165df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39968/0 (socket says 172.21.15.80:39968) 2019-11-28T11:45:04.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a45c41700 1 -- 172.21.15.80:0/528655449 learned_addr learned my addr 172.21.15.80:0/528655449 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:04.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a45c41700 1 -- 172.21.15.80:0/528655449 >> v1:172.21.15.174:6789/0 conn(0x7f9a4015f100 legacy=0x7f9a4006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a45c41700 1 -- 172.21.15.80:0/528655449 >> v1:172.21.15.80:6789/0 conn(0x7f9a4015ed10 legacy=0x7f9a40073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a3ffff700 1 -- 172.21.15.80:0/528655449 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856901586 0 0) 0x7f9a28001480 con 0x7f9a4015ed10 2019-11-28T11:45:04.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a45c41700 1 -- 172.21.15.80:0/528655449 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a40070760 con 0x7f9a401639f0 2019-11-28T11:45:04.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a45c41700 1 --2- 172.21.15.80:0/528655449 >> v2:172.21.15.80:3300/0 conn(0x7f9a401639f0 0x7f9a40165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9a3800f730 tx=0x7f9a3800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a45c41700 1 --2- 172.21.15.80:0/528655449 >> v2:172.21.15.80:3300/0 conn(0x7f9a401639f0 0x7f9a40165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9a3800f730 tx=0x7f9a3800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a45c41700 1 --2- 172.21.15.80:0/528655449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a401639f0 0x7f9a40165df0 secure :-1 s=READY pgs=1684 cs=0 l=1 rx=0x7f9a3800f730 tx=0x7f9a3800fad0).ready entity=mon.0 client_cookie=3ea34df0ac179e37 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:04.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a45c41700 1 --2- 172.21.15.80:0/528655449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a401639f0 0x7f9a40165df0 secure :-1 s=THROTTLE_DONE pgs=1684 cs=0 l=1 rx=0x7f9a3800f730 tx=0x7f9a3800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a3ffff700 1 -- 172.21.15.80:0/528655449 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a38000a70 con 0x7f9a401639f0 2019-11-28T11:45:04.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a45c41700 1 --2- 172.21.15.80:0/528655449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a401639f0 0x7f9a40165df0 secure :-1 s=THROTTLE_DONE pgs=1684 cs=0 l=1 rx=0x7f9a3800f730 tx=0x7f9a3800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a45c41700 1 --2- 172.21.15.80:0/528655449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a401639f0 0x7f9a40165df0 secure :-1 s=THROTTLE_DONE pgs=1684 cs=0 l=1 rx=0x7f9a3800f730 tx=0x7f9a3800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a3ffff700 1 -- 172.21.15.80:0/528655449 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a380010e0 con 0x7f9a401639f0 2019-11-28T11:45:04.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a3ffff700 1 -- 172.21.15.80:0/528655449 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a38001350 con 0x7f9a401639f0 2019-11-28T11:45:04.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a46ea3700 1 -- 172.21.15.80:0/528655449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a401639f0 msgr2=0x7f9a40165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.546+0000 7f9a46ea3700 1 --2- 172.21.15.80:0/528655449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a401639f0 0x7f9a40165df0 secure :-1 s=READY pgs=1684 cs=0 l=1 rx=0x7f9a3800f730 tx=0x7f9a3800fad0).stop 2019-11-28T11:45:04.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.547+0000 7f9a46ea3700 1 -- 172.21.15.80:0/528655449 shutdown_connections 2019-11-28T11:45:04.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.547+0000 7f9a46ea3700 1 --2- 172.21.15.80:0/528655449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a401639f0 0x7f9a40165df0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:04.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.547+0000 7f9a46ea3700 1 -- 172.21.15.80:0/528655449 shutdown_connections 2019-11-28T11:45:04.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.547+0000 7f9a46ea3700 1 -- 172.21.15.80:0/528655449 wait complete. 2019-11-28T11:45:04.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.547+0000 7f9a46ea3700 1 -- 172.21.15.80:0/528655449 >> 172.21.15.80:0/528655449 conn(0x7f9a40061d40 msgr2=0x7f9a400641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:04.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.550+0000 7f9a46ea3700 1 Processor -- start 2019-11-28T11:45:04.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.550+0000 7f9a46ea3700 1 -- start start 2019-11-28T11:45:04.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a46ea3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9a4007bfd0 0x7f9a4012ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:04.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a46ea3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a40163090 con 0x7f9a401476c0 2019-11-28T11:45:04.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a46ea3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a40165f50 con 0x7f9a4015ed10 2019-11-28T11:45:04.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a46ea3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a40164910 con 0x7f9a4007bfd0 2019-11-28T11:45:04.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a45440700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9a401476c0 0x7f9a4015f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39288/0 (socket says 172.21.15.80:39288) 2019-11-28T11:45:04.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a45440700 1 -- 172.21.15.80:0/2252572419 learned_addr learned my addr 172.21.15.80:0/2252572419 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:04.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a44c3f700 1 --2- 172.21.15.80:0/2252572419 >> v2:172.21.15.174:3300/0 conn(0x7f9a4007bfd0 0x7f9a4012ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:04.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2252572419 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732019892 0 0) 0x7f9a280012c0 con 0x7f9a401476c0 2019-11-28T11:45:04.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2252572419 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a24002e80 con 0x7f9a401476c0 2019-11-28T11:45:04.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2252572419 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1177637632 0 0) 0x7f9a280018f0 con 0x7f9a401476c0 2019-11-28T11:45:04.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2252572419 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9a240032e0 con 0x7f9a401476c0 2019-11-28T11:45:04.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2252572419 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f9a28001e80 con 0x7f9a401476c0 2019-11-28T11:45:04.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a44c3f700 1 -- 172.21.15.80:0/2252572419 >> v1:172.21.15.174:6789/0 conn(0x7f9a4015ed10 legacy=0x7f9a401ac350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a44c3f700 1 -- 172.21.15.80:0/2252572419 >> v1:172.21.15.80:6789/0 conn(0x7f9a401476c0 legacy=0x7f9a4015f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a44c3f700 1 -- 172.21.15.80:0/2252572419 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4007a890 con 0x7f9a4007bfd0 2019-11-28T11:45:04.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a44c3f700 1 --2- 172.21.15.80:0/2252572419 >> v2:172.21.15.174:3300/0 conn(0x7f9a4007bfd0 0x7f9a4012ea90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a300103a0 tx=0x7f9a30010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a44c3f700 1 --2- 172.21.15.80:0/2252572419 >> v2:172.21.15.174:3300/0 conn(0x7f9a4007bfd0 0x7f9a4012ea90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a300103a0 tx=0x7f9a30010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a44c3f700 1 --2- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a4007bfd0 0x7f9a4012ea90 secure :-1 s=READY pgs=983 cs=0 l=1 rx=0x7f9a300103a0 tx=0x7f9a30010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:04.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a44c3f700 1 --2- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a4007bfd0 0x7f9a4012ea90 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7f9a300103a0 tx=0x7f9a30010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.551+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2252572419 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a30000960 con 0x7f9a4007bfd0 2019-11-28T11:45:04.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.552+0000 7f9a44c3f700 1 --2- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a4007bfd0 0x7f9a4012ea90 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7f9a300103a0 tx=0x7f9a30010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.552+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2252572419 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3000eef0 con 0x7f9a4007bfd0 2019-11-28T11:45:04.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.552+0000 7f9a44c3f700 1 --2- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a4007bfd0 0x7f9a4012ea90 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7f9a300103a0 tx=0x7f9a30010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.552+0000 7f9a46ea3700 1 -- 172.21.15.80:0/2252572419 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4007ac10 con 0x7f9a4007bfd0 2019-11-28T11:45:04.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.552+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2252572419 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a3000f0e0 con 0x7f9a4007bfd0 2019-11-28T11:45:04.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.552+0000 7f9a46ea3700 1 -- 172.21.15.80:0/2252572419 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4007a890 con 0x7f9a4007bfd0 2019-11-28T11:45:04.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.552+0000 7f9a44c3f700 1 --2- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a4007bfd0 0x7f9a4012ea90 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7f9a300103a0 tx=0x7f9a30010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.552+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2252572419 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9a3000f2f0 con 0x7f9a4007bfd0 2019-11-28T11:45:04.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.552+0000 7f9a44c3f700 1 --2- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a4007bfd0 0x7f9a4012ea90 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7f9a300103a0 tx=0x7f9a30010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.552+0000 7f9a3dffb700 1 --2- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a24018770 0x7f9a2401ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:04.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.552+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2252572419 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9a30031a50 con 0x7f9a4007bfd0 2019-11-28T11:45:04.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.552+0000 7f9a45440700 1 --2- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a24018770 0x7f9a2401ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:04.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.553+0000 7f9a45440700 1 --2- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a24018770 0x7f9a2401ac00 crc :-1 s=READY pgs=679 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:04.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.560+0000 7f9a46ea3700 1 -- 172.21.15.80:0/2252572419 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4007ac10 con 0x7f9a4007bfd0 2019-11-28T11:45:04.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.563+0000 7f9a44c3f700 1 --2- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a4007bfd0 0x7f9a4012ea90 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7f9a300103a0 tx=0x7f9a30010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.563+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2252572419 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9a3000f0e0 con 0x7f9a4007bfd0 2019-11-28T11:45:04.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.733+0000 7f9a46ea3700 1 -- 172.21.15.80:0/2252572419 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9a4007a890 con 0x7f9a4007bfd0 2019-11-28T11:45:04.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.740+0000 7f9a44c3f700 1 --2- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a4007bfd0 0x7f9a4012ea90 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7f9a300103a0 tx=0x7f9a30010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.740+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2252572419 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v45) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9a30009580 con 0x7f9a4007bfd0 2019-11-28T11:45:04.780 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:45:04.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.742+0000 7f9a46ea3700 1 -- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a24018770 msgr2=0x7f9a2401ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.742+0000 7f9a46ea3700 1 --2- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a24018770 0x7f9a2401ac00 crc :-1 s=READY pgs=679 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:04.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.742+0000 7f9a46ea3700 1 -- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a4007bfd0 msgr2=0x7f9a4012ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.742+0000 7f9a46ea3700 1 --2- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a4007bfd0 0x7f9a4012ea90 secure :-1 s=READY pgs=983 cs=0 l=1 rx=0x7f9a300103a0 tx=0x7f9a30010740).stop 2019-11-28T11:45:04.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.743+0000 7f9a46ea3700 1 -- 172.21.15.80:0/2252572419 shutdown_connections 2019-11-28T11:45:04.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.743+0000 7f9a46ea3700 1 --2- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a24018770 0x7f9a2401ac00 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:04.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.743+0000 7f9a46ea3700 1 --2- 172.21.15.80:0/2252572419 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a4007bfd0 0x7f9a4012ea90 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:04.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.743+0000 7f9a46ea3700 1 -- 172.21.15.80:0/2252572419 shutdown_connections 2019-11-28T11:45:04.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.743+0000 7f9a46ea3700 1 -- 172.21.15.80:0/2252572419 wait complete. 2019-11-28T11:45:04.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.743+0000 7f9a46ea3700 1 -- 172.21.15.80:0/2252572419 >> 172.21.15.80:0/2252572419 conn(0x7f9a4007c750 msgr2=0x7f9a4013b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:04.792 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:45:04.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.883+0000 7fb4cf0f8700 1 Processor -- start 2019-11-28T11:45:04.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.884+0000 7fb4cf0f8700 1 -- start start 2019-11-28T11:45:04.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.884+0000 7fb4cf0f8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb4c815ed10 0x7fb4c815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:04.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.884+0000 7fb4cf0f8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb4c80734b0 0x7fb4c80726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:04.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.884+0000 7fb4cf0f8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c806db60 con 0x7fb4c8073020 2019-11-28T11:45:04.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cf0f8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c806fe00 con 0x7fb4c815ed10 2019-11-28T11:45:04.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cf0f8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c80700d0 con 0x7fb4c80734b0 2019-11-28T11:45:04.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cd695700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb4c815ed10 0x7fb4c815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:04.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cd695700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb4c815ed10 0x7fb4c815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39980/0 (socket says 172.21.15.80:39980) 2019-11-28T11:45:04.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cd695700 1 -- 172.21.15.80:0/467657776 learned_addr learned my addr 172.21.15.80:0/467657776 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:04.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cde96700 1 --2- 172.21.15.80:0/467657776 >> v2:172.21.15.174:3300/0 conn(0x7fb4c80734b0 0x7fb4c80726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:04.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cd695700 1 -- 172.21.15.80:0/467657776 >> v2:172.21.15.174:3300/0 conn(0x7fb4c80734b0 msgr2=0x7fb4c80726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:04.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cd695700 1 --2- 172.21.15.80:0/467657776 >> v2:172.21.15.174:3300/0 conn(0x7fb4c80734b0 0x7fb4c80726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:04.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cd695700 1 -- 172.21.15.80:0/467657776 >> v1:172.21.15.80:6789/0 conn(0x7fb4c8073020 legacy=0x7fb4c8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cd695700 1 -- 172.21.15.80:0/467657776 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c8070760 con 0x7fb4c815ed10 2019-11-28T11:45:04.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4c7fff700 1 -- 172.21.15.80:0/467657776 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787158812 0 0) 0x7fb4b8001030 con 0x7fb4c8073020 2019-11-28T11:45:04.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cde96700 1 --2- 172.21.15.80:0/467657776 >> v2:172.21.15.174:3300/0 conn(0x7fb4c80734b0 0x7fb4c80726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:04.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cd695700 1 --2- 172.21.15.80:0/467657776 >> v2:172.21.15.80:3300/0 conn(0x7fb4c815ed10 0x7fb4c815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb4b000fac0 tx=0x7fb4b000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cd695700 1 --2- 172.21.15.80:0/467657776 >> v2:172.21.15.80:3300/0 conn(0x7fb4c815ed10 0x7fb4c815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb4b000fac0 tx=0x7fb4b000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cd695700 1 --2- 172.21.15.80:0/467657776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c815ed10 0x7fb4c815f100 secure :-1 s=READY pgs=1687 cs=0 l=1 rx=0x7fb4b000fac0 tx=0x7fb4b000fe60).ready entity=mon.0 client_cookie=30f856853c10cda server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:04.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cd695700 1 --2- 172.21.15.80:0/467657776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c815ed10 0x7fb4c815f100 secure :-1 s=THROTTLE_DONE pgs=1687 cs=0 l=1 rx=0x7fb4b000fac0 tx=0x7fb4b000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4c7fff700 1 -- 172.21.15.80:0/467657776 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4b0000ce0 con 0x7fb4c815ed10 2019-11-28T11:45:04.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cd695700 1 --2- 172.21.15.80:0/467657776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c815ed10 0x7fb4c815f100 secure :-1 s=THROTTLE_DONE pgs=1687 cs=0 l=1 rx=0x7fb4b000fac0 tx=0x7fb4b000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cd695700 1 --2- 172.21.15.80:0/467657776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c815ed10 0x7fb4c815f100 secure :-1 s=THROTTLE_DONE pgs=1687 cs=0 l=1 rx=0x7fb4b000fac0 tx=0x7fb4b000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4c7fff700 1 -- 172.21.15.80:0/467657776 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b0001010 con 0x7fb4c815ed10 2019-11-28T11:45:04.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4c7fff700 1 -- 172.21.15.80:0/467657776 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4b0007590 con 0x7fb4c815ed10 2019-11-28T11:45:04.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cf0f8700 1 -- 172.21.15.80:0/467657776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c815ed10 msgr2=0x7fb4c815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.885+0000 7fb4cf0f8700 1 --2- 172.21.15.80:0/467657776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c815ed10 0x7fb4c815f100 secure :-1 s=READY pgs=1687 cs=0 l=1 rx=0x7fb4b000fac0 tx=0x7fb4b000fe60).stop 2019-11-28T11:45:04.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.886+0000 7fb4cf0f8700 1 -- 172.21.15.80:0/467657776 shutdown_connections 2019-11-28T11:45:04.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.886+0000 7fb4cf0f8700 1 --2- 172.21.15.80:0/467657776 >> v2:172.21.15.174:3300/0 conn(0x7fb4c80734b0 0x7fb4c80726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:04.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.886+0000 7fb4cf0f8700 1 --2- 172.21.15.80:0/467657776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c815ed10 0x7fb4c815f100 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:04.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.886+0000 7fb4cf0f8700 1 -- 172.21.15.80:0/467657776 shutdown_connections 2019-11-28T11:45:04.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.886+0000 7fb4cf0f8700 1 -- 172.21.15.80:0/467657776 wait complete. 2019-11-28T11:45:04.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.886+0000 7fb4cf0f8700 1 -- 172.21.15.80:0/467657776 >> 172.21.15.80:0/467657776 conn(0x7fb4c8061d40 msgr2=0x7fb4c80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:04.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.889+0000 7fb4cf0f8700 1 Processor -- start 2019-11-28T11:45:04.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.889+0000 7fb4cf0f8700 1 -- start start 2019-11-28T11:45:04.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cf0f8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb4c8114f60 0x7fb4c8106b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:04.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cf0f8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c8130b20 con 0x7fb4c81070d0 2019-11-28T11:45:04.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cf0f8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c8130620 con 0x7fb4c812e9a0 2019-11-28T11:45:04.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cf0f8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c8148b60 con 0x7fb4c8114f60 2019-11-28T11:45:04.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cd695700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb4c8114f60 0x7fb4c8106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:04.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cce94700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb4c81070d0 0x7fb4c812e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39304/0 (socket says 172.21.15.80:39304) 2019-11-28T11:45:04.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cd695700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb4c8114f60 0x7fb4c8106b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39986/0 (socket says 172.21.15.80:39986) 2019-11-28T11:45:04.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cce94700 1 -- 172.21.15.80:0/2576624187 learned_addr learned my addr 172.21.15.80:0/2576624187 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:04.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cd695700 1 -- 172.21.15.80:0/2576624187 >> v1:172.21.15.174:6789/0 conn(0x7fb4c812e9a0 legacy=0x7fb4c8105a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cd695700 1 -- 172.21.15.80:0/2576624187 >> v1:172.21.15.80:6789/0 conn(0x7fb4c81070d0 legacy=0x7fb4c812e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:04.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4c5ffb700 1 -- 172.21.15.80:0/2576624187 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564482361 0 0) 0x7fb4b8001190 con 0x7fb4c81070d0 2019-11-28T11:45:04.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cd695700 1 -- 172.21.15.80:0/2576624187 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c8104390 con 0x7fb4c8114f60 2019-11-28T11:45:04.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cd695700 1 --2- 172.21.15.80:0/2576624187 >> v2:172.21.15.80:3300/0 conn(0x7fb4c8114f60 0x7fb4c8106b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb4b0010710 tx=0x7fb4b0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cd695700 1 --2- 172.21.15.80:0/2576624187 >> v2:172.21.15.80:3300/0 conn(0x7fb4c8114f60 0x7fb4c8106b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb4b0010710 tx=0x7fb4b0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cd695700 1 --2- 172.21.15.80:0/2576624187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c8114f60 0x7fb4c8106b90 secure :-1 s=READY pgs=1689 cs=0 l=1 rx=0x7fb4b0010710 tx=0x7fb4b0010ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:04.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cd695700 1 --2- 172.21.15.80:0/2576624187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c8114f60 0x7fb4c8106b90 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7fb4b0010710 tx=0x7fb4b0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4c5ffb700 1 -- 172.21.15.80:0/2576624187 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4b00012d0 con 0x7fb4c8114f60 2019-11-28T11:45:04.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cd695700 1 --2- 172.21.15.80:0/2576624187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c8114f60 0x7fb4c8106b90 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7fb4b0010710 tx=0x7fb4b0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cd695700 1 --2- 172.21.15.80:0/2576624187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c8114f60 0x7fb4c8106b90 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7fb4b0010710 tx=0x7fb4b0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4c5ffb700 1 -- 172.21.15.80:0/2576624187 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b0000cc0 con 0x7fb4c8114f60 2019-11-28T11:45:04.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cf0f8700 1 -- 172.21.15.80:0/2576624187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c8104710 con 0x7fb4c8114f60 2019-11-28T11:45:04.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4c5ffb700 1 -- 172.21.15.80:0/2576624187 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4b00018b0 con 0x7fb4c8114f60 2019-11-28T11:45:04.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.890+0000 7fb4cf0f8700 1 -- 172.21.15.80:0/2576624187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c8104390 con 0x7fb4c8114f60 2019-11-28T11:45:04.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.891+0000 7fb4cd695700 1 --2- 172.21.15.80:0/2576624187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c8114f60 0x7fb4c8106b90 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7fb4b0010710 tx=0x7fb4b0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.891+0000 7fb4c5ffb700 1 -- 172.21.15.80:0/2576624187 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb4b00010e0 con 0x7fb4c8114f60 2019-11-28T11:45:04.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.891+0000 7fb4cd695700 1 --2- 172.21.15.80:0/2576624187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c8114f60 0x7fb4c8106b90 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7fb4b0010710 tx=0x7fb4b0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.891+0000 7fb4c5ffb700 1 --2- 172.21.15.80:0/2576624187 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb4ac018730 0x7fb4ac01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:04.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.891+0000 7fb4c5ffb700 1 -- 172.21.15.80:0/2576624187 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb4b0031de0 con 0x7fb4c8114f60 2019-11-28T11:45:04.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.891+0000 7fb4cce94700 1 --2- 172.21.15.80:0/2576624187 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb4ac018730 0x7fb4ac01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:04.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.891+0000 7fb4cce94700 1 --2- 172.21.15.80:0/2576624187 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb4ac018730 0x7fb4ac01abc0 crc :-1 s=READY pgs=680 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:04.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.899+0000 7fb4cf0f8700 1 -- 172.21.15.80:0/2576624187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c8104710 con 0x7fb4c8114f60 2019-11-28T11:45:04.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.902+0000 7fb4cd695700 1 --2- 172.21.15.80:0/2576624187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c8114f60 0x7fb4c8106b90 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7fb4b0010710 tx=0x7fb4b0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:04.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:04.902+0000 7fb4c5ffb700 1 -- 172.21.15.80:0/2576624187 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb4b0000eb0 con 0x7fb4c8114f60 2019-11-28T11:45:05.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.073+0000 7fb4cf0f8700 1 -- 172.21.15.80:0/2576624187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fb4c8104390 con 0x7fb4c8114f60 2019-11-28T11:45:05.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.076+0000 7fb4cd695700 1 --2- 172.21.15.80:0/2576624187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c8114f60 0x7fb4c8106b90 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7fb4b0010710 tx=0x7fb4b0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.076+0000 7fb4c5ffb700 1 -- 172.21.15.80:0/2576624187 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v46) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb4b00013f0 con 0x7fb4c8114f60 2019-11-28T11:45:05.116 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:45:05.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.078+0000 7fb4cf0f8700 1 -- 172.21.15.80:0/2576624187 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb4ac018730 msgr2=0x7fb4ac01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:05.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.078+0000 7fb4cf0f8700 1 --2- 172.21.15.80:0/2576624187 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb4ac018730 0x7fb4ac01abc0 crc :-1 s=READY pgs=680 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:05.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.078+0000 7fb4cf0f8700 1 -- 172.21.15.80:0/2576624187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c8114f60 msgr2=0x7fb4c8106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:05.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.078+0000 7fb4cf0f8700 1 --2- 172.21.15.80:0/2576624187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c8114f60 0x7fb4c8106b90 secure :-1 s=READY pgs=1689 cs=0 l=1 rx=0x7fb4b0010710 tx=0x7fb4b0010ab0).stop 2019-11-28T11:45:05.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.078+0000 7fb4cf0f8700 1 -- 172.21.15.80:0/2576624187 shutdown_connections 2019-11-28T11:45:05.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.078+0000 7fb4cf0f8700 1 --2- 172.21.15.80:0/2576624187 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb4ac018730 0x7fb4ac01abc0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:05.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.078+0000 7fb4cf0f8700 1 --2- 172.21.15.80:0/2576624187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4c8114f60 0x7fb4c8106b90 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:05.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.079+0000 7fb4cf0f8700 1 -- 172.21.15.80:0/2576624187 shutdown_connections 2019-11-28T11:45:05.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.079+0000 7fb4cf0f8700 1 -- 172.21.15.80:0/2576624187 wait complete. 2019-11-28T11:45:05.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.079+0000 7fb4cf0f8700 1 -- 172.21.15.80:0/2576624187 >> 172.21.15.80:0/2576624187 conn(0x7fb4c81476e0 msgr2=0x7fb4c812fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:05.128 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:45:05.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.219+0000 7ff9575a4700 1 Processor -- start 2019-11-28T11:45:05.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.219+0000 7ff9575a4700 1 -- start start 2019-11-28T11:45:05.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.220+0000 7ff9575a4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff95015f100 0x7ff95006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:05.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.220+0000 7ff9575a4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95006c2f0 0x7ff95006c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:05.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.220+0000 7ff9575a4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff95006db60 con 0x7ff95015ed10 2019-11-28T11:45:05.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.220+0000 7ff9575a4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff95006fe00 con 0x7ff95015f100 2019-11-28T11:45:05.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.220+0000 7ff9575a4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9500700d0 con 0x7ff95006c2f0 2019-11-28T11:45:05.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.220+0000 7ff955340700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff95015f100 0x7ff95006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:05.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.220+0000 7ff955340700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff95015f100 0x7ff95006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39994/0 (socket says 172.21.15.80:39994) 2019-11-28T11:45:05.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.220+0000 7ff955340700 1 -- 172.21.15.80:0/1099015304 learned_addr learned my addr 172.21.15.80:0/1099015304 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:05.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.220+0000 7ff956342700 1 --2- 172.21.15.80:0/1099015304 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95006c2f0 0x7ff95006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:05.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.220+0000 7ff955340700 1 -- 172.21.15.80:0/1099015304 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95006c2f0 msgr2=0x7ff95006c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:05.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.220+0000 7ff955340700 1 --2- 172.21.15.80:0/1099015304 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95006c2f0 0x7ff95006c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:05.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.220+0000 7ff955340700 1 -- 172.21.15.80:0/1099015304 >> v1:172.21.15.174:6789/0 conn(0x7ff95015ed10 legacy=0x7ff950073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:05.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.221+0000 7ff955340700 1 -- 172.21.15.80:0/1099015304 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff950070760 con 0x7ff95015f100 2019-11-28T11:45:05.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.220+0000 7ff954b3f700 1 -- 172.21.15.80:0/1099015304 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575089735 0 0) 0x7ff944001080 con 0x7ff95015ed10 2019-11-28T11:45:05.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.221+0000 7ff955340700 1 --2- 172.21.15.80:0/1099015304 >> v2:172.21.15.80:3300/0 conn(0x7ff95015f100 0x7ff95006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff94c00fa40 tx=0x7ff94c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.221+0000 7ff955340700 1 --2- 172.21.15.80:0/1099015304 >> v2:172.21.15.80:3300/0 conn(0x7ff95015f100 0x7ff95006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff94c00fa40 tx=0x7ff94c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.221+0000 7ff955340700 1 --2- 172.21.15.80:0/1099015304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95015f100 0x7ff95006bdb0 secure :-1 s=READY pgs=1690 cs=0 l=1 rx=0x7ff94c00fa40 tx=0x7ff94c00fde0).ready entity=mon.0 client_cookie=4ad6066ba72830ef server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:05.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.221+0000 7ff955340700 1 --2- 172.21.15.80:0/1099015304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95015f100 0x7ff95006bdb0 secure :-1 s=THROTTLE_DONE pgs=1690 cs=0 l=1 rx=0x7ff94c00fa40 tx=0x7ff94c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.221+0000 7ff954b3f700 1 -- 172.21.15.80:0/1099015304 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff94c000ce0 con 0x7ff95015f100 2019-11-28T11:45:05.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.221+0000 7ff955340700 1 --2- 172.21.15.80:0/1099015304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95015f100 0x7ff95006bdb0 secure :-1 s=THROTTLE_DONE pgs=1690 cs=0 l=1 rx=0x7ff94c00fa40 tx=0x7ff94c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.221+0000 7ff954b3f700 1 -- 172.21.15.80:0/1099015304 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c007590 con 0x7ff95015f100 2019-11-28T11:45:05.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.221+0000 7ff955340700 1 --2- 172.21.15.80:0/1099015304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95015f100 0x7ff95006bdb0 secure :-1 s=THROTTLE_DONE pgs=1690 cs=0 l=1 rx=0x7ff94c00fa40 tx=0x7ff94c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.221+0000 7ff954b3f700 1 -- 172.21.15.80:0/1099015304 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff94c001200 con 0x7ff95015f100 2019-11-28T11:45:05.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.221+0000 7ff9575a4700 1 -- 172.21.15.80:0/1099015304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95015f100 msgr2=0x7ff95006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:05.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.221+0000 7ff9575a4700 1 --2- 172.21.15.80:0/1099015304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95015f100 0x7ff95006bdb0 secure :-1 s=READY pgs=1690 cs=0 l=1 rx=0x7ff94c00fa40 tx=0x7ff94c00fde0).stop 2019-11-28T11:45:05.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.221+0000 7ff9575a4700 1 -- 172.21.15.80:0/1099015304 shutdown_connections 2019-11-28T11:45:05.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.221+0000 7ff9575a4700 1 --2- 172.21.15.80:0/1099015304 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95006c2f0 0x7ff95006c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:05.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.221+0000 7ff9575a4700 1 --2- 172.21.15.80:0/1099015304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff95015f100 0x7ff95006bdb0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:05.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.222+0000 7ff9575a4700 1 -- 172.21.15.80:0/1099015304 shutdown_connections 2019-11-28T11:45:05.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.222+0000 7ff9575a4700 1 -- 172.21.15.80:0/1099015304 wait complete. 2019-11-28T11:45:05.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.222+0000 7ff9575a4700 1 -- 172.21.15.80:0/1099015304 >> 172.21.15.80:0/1099015304 conn(0x7ff950061d40 msgr2=0x7ff9500641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:05.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.224+0000 7ff9575a4700 1 Processor -- start 2019-11-28T11:45:05.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.224+0000 7ff9575a4700 1 -- start start 2019-11-28T11:45:05.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.225+0000 7ff9575a4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff95010f000 0x7ff95015ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:05.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.225+0000 7ff9575a4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95012d320 0x7ff95012d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:05.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.225+0000 7ff9575a4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff95010f890 con 0x7ff95014cc70 2019-11-28T11:45:05.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.225+0000 7ff9575a4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff95010e7c0 con 0x7ff95010f000 2019-11-28T11:45:05.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.225+0000 7ff9575a4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95010ea90 con 0x7ff95012d320 2019-11-28T11:45:05.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.225+0000 7ff955b41700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff95010f000 0x7ff95015ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:05.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.225+0000 7ff955b41700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff95010f000 0x7ff95015ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:54884/0 (socket says 172.21.15.80:54884) 2019-11-28T11:45:05.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.225+0000 7ff955b41700 1 -- 172.21.15.80:0/1260476557 learned_addr learned my addr 172.21.15.80:0/1260476557 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:05.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.225+0000 7ff956342700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95012d320 0x7ff95012d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:05.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.225+0000 7ff956342700 1 -- 172.21.15.80:0/1260476557 >> v2:172.21.15.174:3300/0 conn(0x7ff95010f000 msgr2=0x7ff95015ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:05.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.225+0000 7ff956342700 1 --2- 172.21.15.80:0/1260476557 >> v2:172.21.15.174:3300/0 conn(0x7ff95010f000 0x7ff95015ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:05.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.225+0000 7ff956342700 1 -- 172.21.15.80:0/1260476557 >> v1:172.21.15.174:6789/0 conn(0x7ff95014cc70 legacy=0x7ff95014d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:05.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.225+0000 7ff956342700 1 -- 172.21.15.80:0/1260476557 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95014b530 con 0x7ff95012d320 2019-11-28T11:45:05.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.225+0000 7ff9427fc700 1 -- 172.21.15.80:0/1260476557 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658705620 0 0) 0x7ff94c007cf0 con 0x7ff95014cc70 2019-11-28T11:45:05.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.225+0000 7ff955b41700 1 --2- 172.21.15.80:0/1260476557 >> v2:172.21.15.174:3300/0 conn(0x7ff95010f000 0x7ff95015ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:05.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.226+0000 7ff956342700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95012d320 0x7ff95012d7a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff948010390 tx=0x7ff948010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.226+0000 7ff956342700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95012d320 0x7ff95012d7a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff948010390 tx=0x7ff948010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.226+0000 7ff956342700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95012d320 0x7ff95012d7a0 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7ff948010390 tx=0x7ff948010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:05.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.226+0000 7ff956342700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95012d320 0x7ff95012d7a0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7ff948010390 tx=0x7ff948010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.226+0000 7ff9427fc700 1 -- 172.21.15.80:0/1260476557 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff948009990 con 0x7ff95012d320 2019-11-28T11:45:05.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.226+0000 7ff956342700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95012d320 0x7ff95012d7a0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7ff948010390 tx=0x7ff948010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.226+0000 7ff956342700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95012d320 0x7ff95012d7a0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7ff948010390 tx=0x7ff948010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.226+0000 7ff9427fc700 1 -- 172.21.15.80:0/1260476557 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9480095b0 con 0x7ff95012d320 2019-11-28T11:45:05.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.226+0000 7ff9427fc700 1 -- 172.21.15.80:0/1260476557 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff948009f70 con 0x7ff95012d320 2019-11-28T11:45:05.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.226+0000 7ff9575a4700 1 -- 172.21.15.80:0/1260476557 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95014b8b0 con 0x7ff95012d320 2019-11-28T11:45:05.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.226+0000 7ff9575a4700 1 -- 172.21.15.80:0/1260476557 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95014b530 con 0x7ff95012d320 2019-11-28T11:45:05.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.226+0000 7ff956342700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95012d320 0x7ff95012d7a0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7ff948010390 tx=0x7ff948010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.226+0000 7ff9427fc700 1 -- 172.21.15.80:0/1260476557 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff94800ea80 con 0x7ff95012d320 2019-11-28T11:45:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.226+0000 7ff956342700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95012d320 0x7ff95012d7a0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7ff948010390 tx=0x7ff948010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.227+0000 7ff9427fc700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff938018730 0x7ff93801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.227+0000 7ff9427fc700 1 -- 172.21.15.80:0/1260476557 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff9480319f0 con 0x7ff95012d320 2019-11-28T11:45:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.227+0000 7ff955b41700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff938018730 0x7ff93801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.227+0000 7ff955b41700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff938018730 0x7ff93801abc0 crc :-1 s=READY pgs=681 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:05.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.234+0000 7ff9575a4700 1 -- 172.21.15.80:0/1260476557 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff95014b8b0 con 0x7ff95012d320 2019-11-28T11:45:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.238+0000 7ff956342700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95012d320 0x7ff95012d7a0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7ff948010390 tx=0x7ff948010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.238+0000 7ff9427fc700 1 -- 172.21.15.80:0/1260476557 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff948009680 con 0x7ff95012d320 2019-11-28T11:45:05.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.411+0000 7ff9575a4700 1 -- 172.21.15.80:0/1260476557 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff95014b530 con 0x7ff95012d320 2019-11-28T11:45:05.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.416+0000 7ff956342700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95012d320 0x7ff95012d7a0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7ff948010390 tx=0x7ff948010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.416+0000 7ff9427fc700 1 -- 172.21.15.80:0/1260476557 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v47) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff948009890 con 0x7ff95012d320 2019-11-28T11:45:05.457 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:45:05.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.420+0000 7ff9575a4700 1 -- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff938018730 msgr2=0x7ff93801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:05.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.420+0000 7ff9575a4700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff938018730 0x7ff93801abc0 crc :-1 s=READY pgs=681 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:05.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.420+0000 7ff9575a4700 1 -- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95012d320 msgr2=0x7ff95012d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:05.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.420+0000 7ff9575a4700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95012d320 0x7ff95012d7a0 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7ff948010390 tx=0x7ff948010730).stop 2019-11-28T11:45:05.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.420+0000 7ff9575a4700 1 -- 172.21.15.80:0/1260476557 shutdown_connections 2019-11-28T11:45:05.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.420+0000 7ff9575a4700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95012d320 0x7ff95012d7a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:05.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.420+0000 7ff9575a4700 1 --2- 172.21.15.80:0/1260476557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff938018730 0x7ff93801abc0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:05.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.420+0000 7ff9575a4700 1 --2- 172.21.15.80:0/1260476557 >> v2:172.21.15.174:3300/0 conn(0x7ff95010f000 0x7ff95015ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:05.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.420+0000 7ff9575a4700 1 -- 172.21.15.80:0/1260476557 shutdown_connections 2019-11-28T11:45:05.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.420+0000 7ff9575a4700 1 -- 172.21.15.80:0/1260476557 wait complete. 2019-11-28T11:45:05.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.420+0000 7ff9575a4700 1 -- 172.21.15.80:0/1260476557 >> 172.21.15.80:0/1260476557 conn(0x7ff95014eee0 msgr2=0x7ff950149850 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:05.470 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:05.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.550+0000 7f8c236de700 1 Processor -- start 2019-11-28T11:45:05.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.550+0000 7f8c236de700 1 -- start start 2019-11-28T11:45:05.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c236de700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8c1c06c490 0x7f8c1c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:05.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c236de700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8c1c06ce60 0x7f8c1c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:05.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c236de700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1c06db00 con 0x7f8c1c06c0a0 2019-11-28T11:45:05.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c236de700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1c06fd60 con 0x7f8c1c06c490 2019-11-28T11:45:05.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c236de700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1c070030 con 0x7f8c1c06ce60 2019-11-28T11:45:05.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c2147a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8c1c06c490 0x7f8c1c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:05.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c2147a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8c1c06c490 0x7f8c1c06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40010/0 (socket says 172.21.15.80:40010) 2019-11-28T11:45:05.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c2147a700 1 -- 172.21.15.80:0/1842913460 learned_addr learned my addr 172.21.15.80:0/1842913460 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:05.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c2247c700 1 --2- 172.21.15.80:0/1842913460 >> v2:172.21.15.174:3300/0 conn(0x7f8c1c06ce60 0x7f8c1c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:05.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c2147a700 1 -- 172.21.15.80:0/1842913460 >> v2:172.21.15.174:3300/0 conn(0x7f8c1c06ce60 msgr2=0x7f8c1c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:05.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c2147a700 1 --2- 172.21.15.80:0/1842913460 >> v2:172.21.15.174:3300/0 conn(0x7f8c1c06ce60 0x7f8c1c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:05.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c2147a700 1 -- 172.21.15.80:0/1842913460 >> v1:172.21.15.174:6789/0 conn(0x7f8c1c06c0a0 legacy=0x7f8c1c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:05.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c2147a700 1 -- 172.21.15.80:0/1842913460 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c0706c0 con 0x7f8c1c06c490 2019-11-28T11:45:05.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c2147a700 1 --2- 172.21.15.80:0/1842913460 >> v2:172.21.15.80:3300/0 conn(0x7f8c1c06c490 0x7f8c1c06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8c1000f6c0 tx=0x7f8c1000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c2147a700 1 --2- 172.21.15.80:0/1842913460 >> v2:172.21.15.80:3300/0 conn(0x7f8c1c06c490 0x7f8c1c06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8c1000f6c0 tx=0x7f8c1000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c2147a700 1 --2- 172.21.15.80:0/1842913460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c1c06c490 0x7f8c1c06c920 secure :-1 s=READY pgs=1691 cs=0 l=1 rx=0x7f8c1000f6c0 tx=0x7f8c1000fa60).ready entity=mon.0 client_cookie=aee5979e8af6afe8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:05.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c2147a700 1 --2- 172.21.15.80:0/1842913460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c1c06c490 0x7f8c1c06c920 secure :-1 s=THROTTLE_DONE pgs=1691 cs=0 l=1 rx=0x7f8c1000f6c0 tx=0x7f8c1000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c2147a700 1 --2- 172.21.15.80:0/1842913460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c1c06c490 0x7f8c1c06c920 secure :-1 s=THROTTLE_DONE pgs=1691 cs=0 l=1 rx=0x7f8c1000f6c0 tx=0x7f8c1000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c20c79700 1 -- 172.21.15.80:0/1842913460 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c10000960 con 0x7f8c1c06c490 2019-11-28T11:45:05.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.551+0000 7f8c2147a700 1 --2- 172.21.15.80:0/1842913460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c1c06c490 0x7f8c1c06c920 secure :-1 s=THROTTLE_DONE pgs=1691 cs=0 l=1 rx=0x7f8c1000f6c0 tx=0x7f8c1000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.552+0000 7f8c20c79700 1 -- 172.21.15.80:0/1842913460 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c10000c90 con 0x7f8c1c06c490 2019-11-28T11:45:05.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.552+0000 7f8c20c79700 1 -- 172.21.15.80:0/1842913460 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c100013a0 con 0x7f8c1c06c490 2019-11-28T11:45:05.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.552+0000 7f8c236de700 1 -- 172.21.15.80:0/1842913460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c1c06c490 msgr2=0x7f8c1c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:05.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.552+0000 7f8c236de700 1 --2- 172.21.15.80:0/1842913460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c1c06c490 0x7f8c1c06c920 secure :-1 s=READY pgs=1691 cs=0 l=1 rx=0x7f8c1000f6c0 tx=0x7f8c1000fa60).stop 2019-11-28T11:45:05.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.552+0000 7f8c236de700 1 -- 172.21.15.80:0/1842913460 shutdown_connections 2019-11-28T11:45:05.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.552+0000 7f8c236de700 1 --2- 172.21.15.80:0/1842913460 >> v2:172.21.15.174:3300/0 conn(0x7f8c1c06ce60 0x7f8c1c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:05.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.552+0000 7f8c236de700 1 --2- 172.21.15.80:0/1842913460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c1c06c490 0x7f8c1c06c920 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:05.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.552+0000 7f8c236de700 1 -- 172.21.15.80:0/1842913460 shutdown_connections 2019-11-28T11:45:05.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.552+0000 7f8c236de700 1 -- 172.21.15.80:0/1842913460 wait complete. 2019-11-28T11:45:05.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.553+0000 7f8c236de700 1 -- 172.21.15.80:0/1842913460 >> 172.21.15.80:0/1842913460 conn(0x7f8c1c061cf0 msgr2=0x7f8c1c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:05.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.555+0000 7f8c236de700 1 Processor -- start 2019-11-28T11:45:05.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.555+0000 7f8c236de700 1 -- start start 2019-11-28T11:45:05.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c236de700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c1281b0 0x7f8c1c128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:05.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c236de700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1c139a60 con 0x7f8c1c13a780 2019-11-28T11:45:05.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c236de700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1c13b060 con 0x7f8c1c128b80 2019-11-28T11:45:05.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c236de700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c12a260 con 0x7f8c1c1281b0 2019-11-28T11:45:05.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c21c7b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8c1c13a780 0x7f8c1c12d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39328/0 (socket says 172.21.15.80:39328) 2019-11-28T11:45:05.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c21c7b700 1 -- 172.21.15.80:0/2501410990 learned_addr learned my addr 172.21.15.80:0/2501410990 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:05.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c2147a700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c1281b0 0x7f8c1c128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:05.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c1a7fc700 1 -- 172.21.15.80:0/2501410990 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187036055 0 0) 0x7f8c0c0014d0 con 0x7f8c1c13a780 2019-11-28T11:45:05.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c1a7fc700 1 -- 172.21.15.80:0/2501410990 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bfc002e80 con 0x7f8c1c13a780 2019-11-28T11:45:05.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c1a7fc700 1 -- 172.21.15.80:0/2501410990 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586994834 0 0) 0x7f8c14001080 con 0x7f8c1c128b80 2019-11-28T11:45:05.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c1a7fc700 1 -- 172.21.15.80:0/2501410990 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bfc0030b0 con 0x7f8c1c128b80 2019-11-28T11:45:05.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c2147a700 1 -- 172.21.15.80:0/2501410990 >> v1:172.21.15.174:6789/0 conn(0x7f8c1c128b80 legacy=0x7f8c1c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:05.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c2147a700 1 -- 172.21.15.80:0/2501410990 >> v1:172.21.15.80:6789/0 conn(0x7f8c1c13a780 legacy=0x7f8c1c12d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:05.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c2147a700 1 -- 172.21.15.80:0/2501410990 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c12abc0 con 0x7f8c1c1281b0 2019-11-28T11:45:05.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c2147a700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c1281b0 0x7f8c1c128640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8c100103a0 tx=0x7f8c10010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c2147a700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c1281b0 0x7f8c1c128640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8c100103a0 tx=0x7f8c10010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.556+0000 7f8c2147a700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c1281b0 0x7f8c1c128640 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7f8c100103a0 tx=0x7f8c10010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:05.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.557+0000 7f8c2147a700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c1281b0 0x7f8c1c128640 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f8c100103a0 tx=0x7f8c10010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.557+0000 7f8c1a7fc700 1 -- 172.21.15.80:0/2501410990 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c10000940 con 0x7f8c1c1281b0 2019-11-28T11:45:05.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.557+0000 7f8c2147a700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c1281b0 0x7f8c1c128640 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f8c100103a0 tx=0x7f8c10010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.557+0000 7f8c2147a700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c1281b0 0x7f8c1c128640 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f8c100103a0 tx=0x7f8c10010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.557+0000 7f8c1a7fc700 1 -- 172.21.15.80:0/2501410990 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c10000f50 con 0x7f8c1c1281b0 2019-11-28T11:45:05.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.557+0000 7f8c1a7fc700 1 -- 172.21.15.80:0/2501410990 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c100016a0 con 0x7f8c1c1281b0 2019-11-28T11:45:05.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.557+0000 7f8c236de700 1 -- 172.21.15.80:0/2501410990 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1c12af40 con 0x7f8c1c1281b0 2019-11-28T11:45:05.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.557+0000 7f8c236de700 1 -- 172.21.15.80:0/2501410990 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1c12abc0 con 0x7f8c1c1281b0 2019-11-28T11:45:05.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.557+0000 7f8c2147a700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c1281b0 0x7f8c1c128640 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f8c100103a0 tx=0x7f8c10010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.557+0000 7f8c1a7fc700 1 -- 172.21.15.80:0/2501410990 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8c10001140 con 0x7f8c1c1281b0 2019-11-28T11:45:05.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.557+0000 7f8c2147a700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c1281b0 0x7f8c1c128640 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f8c100103a0 tx=0x7f8c10010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.557+0000 7f8c1a7fc700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bfc018750 0x7f8bfc01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:05.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.557+0000 7f8c1a7fc700 1 -- 172.21.15.80:0/2501410990 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8c10031aa0 con 0x7f8c1c1281b0 2019-11-28T11:45:05.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.558+0000 7f8c21c7b700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bfc018750 0x7f8bfc01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:05.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.558+0000 7f8c21c7b700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bfc018750 0x7f8bfc01abe0 crc :-1 s=READY pgs=683 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:05.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.565+0000 7f8c236de700 1 -- 172.21.15.80:0/2501410990 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1c12af40 con 0x7f8c1c1281b0 2019-11-28T11:45:05.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.569+0000 7f8c2147a700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c1281b0 0x7f8c1c128640 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f8c100103a0 tx=0x7f8c10010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.569+0000 7f8c1a7fc700 1 -- 172.21.15.80:0/2501410990 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8c10000b50 con 0x7f8c1c1281b0 2019-11-28T11:45:05.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.740+0000 7f8c236de700 1 -- 172.21.15.80:0/2501410990 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c1c12abc0 con 0x7f8c1c1281b0 2019-11-28T11:45:05.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.740+0000 7f8c2147a700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c1281b0 0x7f8c1c128640 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f8c100103a0 tx=0x7f8c10010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:05.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.740+0000 7f8c1a7fc700 1 -- 172.21.15.80:0/2501410990 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+1777 (secure 0 0 0) 0x7f8c10001120 con 0x7f8c1c1281b0 2019-11-28T11:45:05.783 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 92 2019-11-28T11:45:05.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.743+0000 7f8c236de700 1 -- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bfc018750 msgr2=0x7f8bfc01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:05.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.743+0000 7f8c236de700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bfc018750 0x7f8bfc01abe0 crc :-1 s=READY pgs=683 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:05.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.743+0000 7f8c236de700 1 -- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c1281b0 msgr2=0x7f8c1c128640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:05.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.743+0000 7f8c236de700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c1281b0 0x7f8c1c128640 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7f8c100103a0 tx=0x7f8c10010740).stop 2019-11-28T11:45:05.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.743+0000 7f8c236de700 1 -- 172.21.15.80:0/2501410990 shutdown_connections 2019-11-28T11:45:05.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.743+0000 7f8c236de700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bfc018750 0x7f8bfc01abe0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:05.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.743+0000 7f8c236de700 1 --2- 172.21.15.80:0/2501410990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c1281b0 0x7f8c1c128640 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:05.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.743+0000 7f8c236de700 1 -- 172.21.15.80:0/2501410990 shutdown_connections 2019-11-28T11:45:05.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.743+0000 7f8c236de700 1 -- 172.21.15.80:0/2501410990 wait complete. 2019-11-28T11:45:05.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:05.743+0000 7f8c236de700 1 -- 172.21.15.80:0/2501410990 >> 172.21.15.80:0/2501410990 conn(0x7f8c1c127dc0 msgr2=0x7f8c1c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:05.786 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:05.786 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":92,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:01.366373+0000","modified":"2019-11-28T11:45:05.381121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8937},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8937":{"gid":8937,"name":"c","rank":0,"incarnation":91,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/1730908433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1730908433},{"type":"v1","addr":"172.21.15.174:6835","nonce":1730908433}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2019-11-28T11:45:06.096 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8937}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 20, u'failed': [], u'epoch': 92, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [21], u'info': {u'gid_8937': {u'export_targets': [], u'name': u'c', u'incarnation': 91, u'state_seq': 2, u'state': u'up:active', u'gid': 8937, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1730908433, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 1730908433, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/1730908433'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:45:01.366373+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:45:05.381121+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:45:06.096 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:45:06.097 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:45:06.223 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:45:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:45:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:45:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 8937, 2019-11-28T11:45:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:45:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:45:06.225 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 1.8044734739999999, 2019-11-28T11:45:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 92, 2019-11-28T11:45:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 128, 2019-11-28T11:45:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 128, 2019-11-28T11:45:06.226 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 2.0317977310000002 2019-11-28T11:45:06.226 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:45:06.228 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8937, "want_state": "up:active", "state": "up:active", "rank_uptime": 1.8044734739999999, "mdsmap_epoch": 92, "osdmap_epoch": 128, "osdmap_epoch_barrier": 128, "uptime": 2.0317977310000002 } 2019-11-28T11:45:06.229 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:45:06.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.316+0000 7fda2bc1e700 1 Processor -- start 2019-11-28T11:45:06.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.317+0000 7fda2bc1e700 1 -- start start 2019-11-28T11:45:06.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2bc1e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fda2406c0a0 0x7fda24072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:06.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2bc1e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda240734e0 0x7fda24071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:06.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2bc1e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fda24072360 0x7fda24072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:06.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2bc1e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2406fd60 con 0x7fda24072360 2019-11-28T11:45:06.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2bc1e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda24070030 con 0x7fda2406c0a0 2019-11-28T11:45:06.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2bc1e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2406f330 con 0x7fda240734e0 2019-11-28T11:45:06.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2a9bc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fda24072360 0x7fda24072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:06.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2a9bc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fda24072360 0x7fda24072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40022/0 (socket says 172.21.15.80:40022) 2019-11-28T11:45:06.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2a9bc700 1 -- 172.21.15.80:0/965576837 learned_addr learned my addr 172.21.15.80:0/965576837 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:06.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2a1bb700 1 --2- 172.21.15.80:0/965576837 >> v2:172.21.15.174:3300/0 conn(0x7fda2406c0a0 0x7fda24072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:06.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda299ba700 1 --2- 172.21.15.80:0/965576837 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda240734e0 0x7fda24071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:06.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2a9bc700 1 -- 172.21.15.80:0/965576837 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda240734e0 msgr2=0x7fda24071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:06.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/965576837 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda240734e0 0x7fda24071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:06.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2a9bc700 1 -- 172.21.15.80:0/965576837 >> v2:172.21.15.174:3300/0 conn(0x7fda2406c0a0 msgr2=0x7fda24072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:06.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/965576837 >> v2:172.21.15.174:3300/0 conn(0x7fda2406c0a0 0x7fda24072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:06.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2a9bc700 1 -- 172.21.15.80:0/965576837 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda240706c0 con 0x7fda24072360 2019-11-28T11:45:06.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/965576837 >> v2:172.21.15.80:3300/0 conn(0x7fda24072360 0x7fda24072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fda1c00f6b0 tx=0x7fda1c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/965576837 >> v2:172.21.15.80:3300/0 conn(0x7fda24072360 0x7fda24072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fda1c00f6b0 tx=0x7fda1c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/965576837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda24072360 0x7fda24072800 secure :-1 s=READY pgs=1693 cs=0 l=1 rx=0x7fda1c00f6b0 tx=0x7fda1c007d50).ready entity=mon.0 client_cookie=1dfdbd0f8317f565 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:06.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/965576837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda24072360 0x7fda24072800 secure :-1 s=THROTTLE_DONE pgs=1693 cs=0 l=1 rx=0x7fda1c00f6b0 tx=0x7fda1c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/965576837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda24072360 0x7fda24072800 secure :-1 s=THROTTLE_DONE pgs=1693 cs=0 l=1 rx=0x7fda1c00f6b0 tx=0x7fda1c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.319+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/965576837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda24072360 0x7fda24072800 secure :-1 s=THROTTLE_DONE pgs=1693 cs=0 l=1 rx=0x7fda1c00f6b0 tx=0x7fda1c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.318+0000 7fda291b9700 1 -- 172.21.15.80:0/965576837 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda1c000a70 con 0x7fda24072360 2019-11-28T11:45:06.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.319+0000 7fda291b9700 1 -- 172.21.15.80:0/965576837 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c0010e0 con 0x7fda24072360 2019-11-28T11:45:06.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.319+0000 7fda291b9700 1 -- 172.21.15.80:0/965576837 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda1c001830 con 0x7fda24072360 2019-11-28T11:45:06.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.319+0000 7fda2bc1e700 1 -- 172.21.15.80:0/965576837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda24072360 msgr2=0x7fda24072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:06.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.319+0000 7fda2bc1e700 1 --2- 172.21.15.80:0/965576837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda24072360 0x7fda24072800 secure :-1 s=READY pgs=1693 cs=0 l=1 rx=0x7fda1c00f6b0 tx=0x7fda1c007d50).stop 2019-11-28T11:45:06.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.319+0000 7fda2bc1e700 1 -- 172.21.15.80:0/965576837 shutdown_connections 2019-11-28T11:45:06.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.319+0000 7fda2bc1e700 1 --2- 172.21.15.80:0/965576837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda24072360 0x7fda24072800 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:06.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.319+0000 7fda2bc1e700 1 --2- 172.21.15.80:0/965576837 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda240734e0 0x7fda24071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:06.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.319+0000 7fda2bc1e700 1 --2- 172.21.15.80:0/965576837 >> v2:172.21.15.174:3300/0 conn(0x7fda2406c0a0 0x7fda24072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:06.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.319+0000 7fda2bc1e700 1 -- 172.21.15.80:0/965576837 shutdown_connections 2019-11-28T11:45:06.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.319+0000 7fda2bc1e700 1 -- 172.21.15.80:0/965576837 wait complete. 2019-11-28T11:45:06.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.319+0000 7fda2bc1e700 1 -- 172.21.15.80:0/965576837 >> 172.21.15.80:0/965576837 conn(0x7fda24061cf0 msgr2=0x7fda24064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:06.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.322+0000 7fda2bc1e700 1 Processor -- start 2019-11-28T11:45:06.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.322+0000 7fda2bc1e700 1 -- start start 2019-11-28T11:45:06.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2bc1e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda2413dc00 0x7fda24109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:06.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2bc1e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fda241094e0 0x7fda24167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:06.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2bc1e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda241312c0 con 0x7fda2410a3a0 2019-11-28T11:45:06.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2bc1e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda24104e00 con 0x7fda241094e0 2019-11-28T11:45:06.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2bc1e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda24105830 con 0x7fda2413dc00 2019-11-28T11:45:06.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2a9bc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fda241094e0 0x7fda24167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:06.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2a9bc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fda241094e0 0x7fda24167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40030/0 (socket says 172.21.15.80:40030) 2019-11-28T11:45:06.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2a9bc700 1 -- 172.21.15.80:0/2726962266 learned_addr learned my addr 172.21.15.80:0/2726962266 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:06.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda299ba700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fda2410a3a0 0x7fda24108ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39344/0 (socket says 172.21.15.80:39344) 2019-11-28T11:45:06.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2a1bb700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda2413dc00 0x7fda24109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:06.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2a9bc700 1 -- 172.21.15.80:0/2726962266 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda2413dc00 msgr2=0x7fda24109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:06.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda2413dc00 0x7fda24109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:06.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2a9bc700 1 -- 172.21.15.80:0/2726962266 >> v1:172.21.15.80:6789/0 conn(0x7fda2410a3a0 legacy=0x7fda24108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:06.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2a9bc700 1 -- 172.21.15.80:0/2726962266 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24106190 con 0x7fda241094e0 2019-11-28T11:45:06.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda1affd700 1 -- 172.21.15.80:0/2726962266 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088171497 0 0) 0x7fda200012b0 con 0x7fda2410a3a0 2019-11-28T11:45:06.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2a1bb700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda2413dc00 0x7fda24109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:06.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/2726962266 >> v2:172.21.15.80:3300/0 conn(0x7fda241094e0 0x7fda24167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fda1c054460 tx=0x7fda1c054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/2726962266 >> v2:172.21.15.80:3300/0 conn(0x7fda241094e0 0x7fda24167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fda1c054460 tx=0x7fda1c054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda241094e0 0x7fda24167a10 secure :-1 s=READY pgs=1695 cs=0 l=1 rx=0x7fda1c054460 tx=0x7fda1c054800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:06.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda241094e0 0x7fda24167a10 secure :-1 s=THROTTLE_DONE pgs=1695 cs=0 l=1 rx=0x7fda1c054460 tx=0x7fda1c054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda1affd700 1 -- 172.21.15.80:0/2726962266 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda1c0012b0 con 0x7fda241094e0 2019-11-28T11:45:06.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda241094e0 0x7fda24167a10 secure :-1 s=THROTTLE_DONE pgs=1695 cs=0 l=1 rx=0x7fda1c054460 tx=0x7fda1c054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda1affd700 1 -- 172.21.15.80:0/2726962266 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c0081f0 con 0x7fda241094e0 2019-11-28T11:45:06.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda241094e0 0x7fda24167a10 secure :-1 s=THROTTLE_DONE pgs=1695 cs=0 l=1 rx=0x7fda1c054460 tx=0x7fda1c054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2bc1e700 1 -- 172.21.15.80:0/2726962266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda24106510 con 0x7fda241094e0 2019-11-28T11:45:06.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda1affd700 1 -- 172.21.15.80:0/2726962266 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda1c0014a0 con 0x7fda241094e0 2019-11-28T11:45:06.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.323+0000 7fda2bc1e700 1 -- 172.21.15.80:0/2726962266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda24106190 con 0x7fda241094e0 2019-11-28T11:45:06.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.324+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda241094e0 0x7fda24167a10 secure :-1 s=THROTTLE_DONE pgs=1695 cs=0 l=1 rx=0x7fda1c054460 tx=0x7fda1c054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.325+0000 7fda1affd700 1 -- 172.21.15.80:0/2726962266 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fda1c0010c0 con 0x7fda241094e0 2019-11-28T11:45:06.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.325+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda241094e0 0x7fda24167a10 secure :-1 s=THROTTLE_DONE pgs=1695 cs=0 l=1 rx=0x7fda1c054460 tx=0x7fda1c054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.325+0000 7fda1affd700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda04018730 0x7fda0401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:06.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.325+0000 7fda1affd700 1 -- 172.21.15.80:0/2726962266 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fda1c075ae0 con 0x7fda241094e0 2019-11-28T11:45:06.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.325+0000 7fda2a1bb700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda04018730 0x7fda0401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:06.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.325+0000 7fda2a1bb700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda04018730 0x7fda0401abc0 crc :-1 s=READY pgs=684 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:06.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.332+0000 7fda2bc1e700 1 -- 172.21.15.80:0/2726962266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda24106510 con 0x7fda241094e0 2019-11-28T11:45:06.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.335+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda241094e0 0x7fda24167a10 secure :-1 s=THROTTLE_DONE pgs=1695 cs=0 l=1 rx=0x7fda1c054460 tx=0x7fda1c054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.335+0000 7fda1affd700 1 -- 172.21.15.80:0/2726962266 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fda1c000eb0 con 0x7fda241094e0 2019-11-28T11:45:06.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.514+0000 7fda2bc1e700 1 -- 172.21.15.80:0/2726962266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda24106190 con 0x7fda241094e0 2019-11-28T11:45:06.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.515+0000 7fda2a9bc700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda241094e0 0x7fda24167a10 secure :-1 s=THROTTLE_DONE pgs=1695 cs=0 l=1 rx=0x7fda1c054460 tx=0x7fda1c054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.515+0000 7fda1affd700 1 -- 172.21.15.80:0/2726962266 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+14871 (secure 0 0 0) 0x7fda1c0010c0 con 0x7fda241094e0 2019-11-28T11:45:06.556 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:06.556 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":128,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:45:02.367501+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:44:59.649701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2019-11-28T11:45:00.387932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:45:06.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.517+0000 7fda2bc1e700 1 -- 172.21.15.80:0/2726962266 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda04018730 msgr2=0x7fda0401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:06.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.517+0000 7fda2bc1e700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda04018730 0x7fda0401abc0 crc :-1 s=READY pgs=684 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:06.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.517+0000 7fda2bc1e700 1 -- 172.21.15.80:0/2726962266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda241094e0 msgr2=0x7fda24167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:06.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.517+0000 7fda2bc1e700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda241094e0 0x7fda24167a10 secure :-1 s=READY pgs=1695 cs=0 l=1 rx=0x7fda1c054460 tx=0x7fda1c054800).stop 2019-11-28T11:45:06.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.517+0000 7fda2bc1e700 1 -- 172.21.15.80:0/2726962266 shutdown_connections 2019-11-28T11:45:06.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.517+0000 7fda2bc1e700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda04018730 0x7fda0401abc0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:06.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.517+0000 7fda2bc1e700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda241094e0 0x7fda24167a10 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:06.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.517+0000 7fda2bc1e700 1 --2- 172.21.15.80:0/2726962266 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda2413dc00 0x7fda24109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:06.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.517+0000 7fda2bc1e700 1 -- 172.21.15.80:0/2726962266 shutdown_connections 2019-11-28T11:45:06.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.517+0000 7fda2bc1e700 1 -- 172.21.15.80:0/2726962266 wait complete. 2019-11-28T11:45:06.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.517+0000 7fda2bc1e700 1 -- 172.21.15.80:0/2726962266 >> 172.21.15.80:0/2726962266 conn(0x7fda2411bfc0 msgr2=0x7fda24141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:06.568 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:44:59.649701+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 20, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'127', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:45:00.387932+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 21, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'128', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:45:06.568 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:45:06.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.653+0000 7ff92f73e700 1 Processor -- start 2019-11-28T11:45:06.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.653+0000 7ff92f73e700 1 -- start start 2019-11-28T11:45:06.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.654+0000 7ff92f73e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff92815f100 0x7ff92806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:06.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.654+0000 7ff92f73e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92806db60 con 0x7ff92815ed10 2019-11-28T11:45:06.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.654+0000 7ff92f73e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92806e060 con 0x7ff92806c2f0 2019-11-28T11:45:06.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.654+0000 7ff92f73e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92806fe00 con 0x7ff92815f100 2019-11-28T11:45:06.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.654+0000 7ff92d4da700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff92815f100 0x7ff92806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:06.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.654+0000 7ff92d4da700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff92815f100 0x7ff92806bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40038/0 (socket says 172.21.15.80:40038) 2019-11-28T11:45:06.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.654+0000 7ff92d4da700 1 -- 172.21.15.80:0/3460812408 learned_addr learned my addr 172.21.15.80:0/3460812408 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:06.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.654+0000 7ff92d4da700 1 -- 172.21.15.80:0/3460812408 >> v1:172.21.15.174:6789/0 conn(0x7ff92806c2f0 legacy=0x7ff92806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:06.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.654+0000 7ff92d4da700 1 -- 172.21.15.80:0/3460812408 >> v1:172.21.15.80:6789/0 conn(0x7ff92815ed10 legacy=0x7ff928073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:06.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.654+0000 7ff92d4da700 1 -- 172.21.15.80:0/3460812408 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff928070760 con 0x7ff92815f100 2019-11-28T11:45:06.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.654+0000 7ff92ccd9700 1 -- 172.21.15.80:0/3460812408 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306210477 0 0) 0x7ff910001480 con 0x7ff92815ed10 2019-11-28T11:45:06.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.654+0000 7ff92d4da700 1 --2- 172.21.15.80:0/3460812408 >> v2:172.21.15.80:3300/0 conn(0x7ff92815f100 0x7ff92806bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff91800f740 tx=0x7ff91800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.655+0000 7ff92d4da700 1 --2- 172.21.15.80:0/3460812408 >> v2:172.21.15.80:3300/0 conn(0x7ff92815f100 0x7ff92806bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff91800f740 tx=0x7ff91800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.655+0000 7ff92d4da700 1 --2- 172.21.15.80:0/3460812408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92815f100 0x7ff92806bdb0 secure :-1 s=READY pgs=1697 cs=0 l=1 rx=0x7ff91800f740 tx=0x7ff91800fae0).ready entity=mon.0 client_cookie=8931e00c2e133fbd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:06.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.655+0000 7ff92d4da700 1 --2- 172.21.15.80:0/3460812408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92815f100 0x7ff92806bdb0 secure :-1 s=THROTTLE_DONE pgs=1697 cs=0 l=1 rx=0x7ff91800f740 tx=0x7ff91800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.655+0000 7ff92ccd9700 1 -- 172.21.15.80:0/3460812408 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff918000960 con 0x7ff92815f100 2019-11-28T11:45:06.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.655+0000 7ff92d4da700 1 --2- 172.21.15.80:0/3460812408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92815f100 0x7ff92806bdb0 secure :-1 s=THROTTLE_DONE pgs=1697 cs=0 l=1 rx=0x7ff91800f740 tx=0x7ff91800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.655+0000 7ff92d4da700 1 --2- 172.21.15.80:0/3460812408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92815f100 0x7ff92806bdb0 secure :-1 s=THROTTLE_DONE pgs=1697 cs=0 l=1 rx=0x7ff91800f740 tx=0x7ff91800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.655+0000 7ff92ccd9700 1 -- 172.21.15.80:0/3460812408 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff918000c90 con 0x7ff92815f100 2019-11-28T11:45:06.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.655+0000 7ff92ccd9700 1 -- 172.21.15.80:0/3460812408 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff918007210 con 0x7ff92815f100 2019-11-28T11:45:06.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.655+0000 7ff92f73e700 1 -- 172.21.15.80:0/3460812408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92815f100 msgr2=0x7ff92806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:06.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.655+0000 7ff92f73e700 1 --2- 172.21.15.80:0/3460812408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92815f100 0x7ff92806bdb0 secure :-1 s=READY pgs=1697 cs=0 l=1 rx=0x7ff91800f740 tx=0x7ff91800fae0).stop 2019-11-28T11:45:06.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.655+0000 7ff92f73e700 1 -- 172.21.15.80:0/3460812408 shutdown_connections 2019-11-28T11:45:06.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.655+0000 7ff92f73e700 1 --2- 172.21.15.80:0/3460812408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff92815f100 0x7ff92806bdb0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:06.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.656+0000 7ff92f73e700 1 -- 172.21.15.80:0/3460812408 shutdown_connections 2019-11-28T11:45:06.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.656+0000 7ff92f73e700 1 -- 172.21.15.80:0/3460812408 wait complete. 2019-11-28T11:45:06.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.656+0000 7ff92f73e700 1 -- 172.21.15.80:0/3460812408 >> 172.21.15.80:0/3460812408 conn(0x7ff928061d20 msgr2=0x7ff9280641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:06.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.658+0000 7ff92f73e700 1 Processor -- start 2019-11-28T11:45:06.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.658+0000 7ff92f73e700 1 -- start start 2019-11-28T11:45:06.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff92f73e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff928101e80 0x7ff92807c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:06.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff92f73e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff928165990 con 0x7ff928128430 2019-11-28T11:45:06.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff92f73e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff928106bb0 con 0x7ff92807b450 2019-11-28T11:45:06.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff92f73e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9280793b0 con 0x7ff928101e80 2019-11-28T11:45:06.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff92dcdb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff928128430 0x7ff928165190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39356/0 (socket says 172.21.15.80:39356) 2019-11-28T11:45:06.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff92dcdb700 1 -- 172.21.15.80:0/149844665 learned_addr learned my addr 172.21.15.80:0/149844665 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:06.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff92d4da700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff928101e80 0x7ff92807c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:06.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff9267fc700 1 -- 172.21.15.80:0/149844665 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495511624 0 0) 0x7ff9100012c0 con 0x7ff928128430 2019-11-28T11:45:06.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff9267fc700 1 -- 172.21.15.80:0/149844665 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff90c002e80 con 0x7ff928128430 2019-11-28T11:45:06.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff9267fc700 1 -- 172.21.15.80:0/149844665 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257615569 0 0) 0x7ff920001030 con 0x7ff92807b450 2019-11-28T11:45:06.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff9267fc700 1 -- 172.21.15.80:0/149844665 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff90c0030b0 con 0x7ff92807b450 2019-11-28T11:45:06.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff92d4da700 1 -- 172.21.15.80:0/149844665 >> v1:172.21.15.174:6789/0 conn(0x7ff92807b450 legacy=0x7ff92807b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:06.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff92d4da700 1 -- 172.21.15.80:0/149844665 >> v1:172.21.15.80:6789/0 conn(0x7ff928128430 legacy=0x7ff928165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:06.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff92d4da700 1 -- 172.21.15.80:0/149844665 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff928079d10 con 0x7ff928101e80 2019-11-28T11:45:06.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff92d4da700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff928101e80 0x7ff92807c5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff9180103a0 tx=0x7ff918010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff92d4da700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff928101e80 0x7ff92807c5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff9180103a0 tx=0x7ff918010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.659+0000 7ff92d4da700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff928101e80 0x7ff92807c5d0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7ff9180103a0 tx=0x7ff918010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:06.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.660+0000 7ff92d4da700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff928101e80 0x7ff92807c5d0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7ff9180103a0 tx=0x7ff918010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.660+0000 7ff9267fc700 1 -- 172.21.15.80:0/149844665 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff918000940 con 0x7ff928101e80 2019-11-28T11:45:06.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.660+0000 7ff92d4da700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff928101e80 0x7ff92807c5d0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7ff9180103a0 tx=0x7ff918010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.660+0000 7ff9267fc700 1 -- 172.21.15.80:0/149844665 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff918000940 con 0x7ff928101e80 2019-11-28T11:45:06.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.660+0000 7ff92d4da700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff928101e80 0x7ff92807c5d0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7ff9180103a0 tx=0x7ff918010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.660+0000 7ff92f73e700 1 -- 172.21.15.80:0/149844665 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92807a090 con 0x7ff928101e80 2019-11-28T11:45:06.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.660+0000 7ff9267fc700 1 -- 172.21.15.80:0/149844665 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff918001140 con 0x7ff928101e80 2019-11-28T11:45:06.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.660+0000 7ff92f73e700 1 -- 172.21.15.80:0/149844665 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff928079d10 con 0x7ff928101e80 2019-11-28T11:45:06.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.660+0000 7ff92d4da700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff928101e80 0x7ff92807c5d0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7ff9180103a0 tx=0x7ff918010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.660+0000 7ff9267fc700 1 -- 172.21.15.80:0/149844665 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff918000d60 con 0x7ff928101e80 2019-11-28T11:45:06.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.660+0000 7ff92d4da700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff928101e80 0x7ff92807c5d0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7ff9180103a0 tx=0x7ff918010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.660+0000 7ff9267fc700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff90c018750 0x7ff90c01ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:06.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.660+0000 7ff9267fc700 1 -- 172.21.15.80:0/149844665 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff918031d70 con 0x7ff928101e80 2019-11-28T11:45:06.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.660+0000 7ff92dcdb700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff90c018750 0x7ff90c01ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:06.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.661+0000 7ff92dcdb700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff90c018750 0x7ff90c01ac00 crc :-1 s=READY pgs=685 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:06.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.668+0000 7ff92f73e700 1 -- 172.21.15.80:0/149844665 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff92807a090 con 0x7ff928101e80 2019-11-28T11:45:06.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.672+0000 7ff92d4da700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff928101e80 0x7ff92807c5d0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7ff9180103a0 tx=0x7ff918010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.672+0000 7ff9267fc700 1 -- 172.21.15.80:0/149844665 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff918000b50 con 0x7ff928101e80 2019-11-28T11:45:06.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.839+0000 7ff92f73e700 1 -- 172.21.15.80:0/149844665 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7ff928079d10 con 0x7ff928101e80 2019-11-28T11:45:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.840+0000 7ff92d4da700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff928101e80 0x7ff92807c5d0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7ff9180103a0 tx=0x7ff918010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.840+0000 7ff9267fc700 1 -- 172.21.15.80:0/149844665 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v128) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff918000940 con 0x7ff928101e80 2019-11-28T11:45:06.881 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:45:06.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.842+0000 7ff92f73e700 1 -- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff90c018750 msgr2=0x7ff90c01ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:06.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.842+0000 7ff92f73e700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff90c018750 0x7ff90c01ac00 crc :-1 s=READY pgs=685 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:06.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.842+0000 7ff92f73e700 1 -- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff928101e80 msgr2=0x7ff92807c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:06.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.842+0000 7ff92f73e700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff928101e80 0x7ff92807c5d0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7ff9180103a0 tx=0x7ff918010740).stop 2019-11-28T11:45:06.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.842+0000 7ff92f73e700 1 -- 172.21.15.80:0/149844665 shutdown_connections 2019-11-28T11:45:06.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.842+0000 7ff92f73e700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff90c018750 0x7ff90c01ac00 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.842+0000 7ff92f73e700 1 --2- 172.21.15.80:0/149844665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff928101e80 0x7ff92807c5d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.842+0000 7ff92f73e700 1 -- 172.21.15.80:0/149844665 shutdown_connections 2019-11-28T11:45:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.842+0000 7ff92f73e700 1 -- 172.21.15.80:0/149844665 wait complete. 2019-11-28T11:45:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.842+0000 7ff92f73e700 1 -- 172.21.15.80:0/149844665 >> 172.21.15.80:0/149844665 conn(0x7ff928166440 msgr2=0x7ff9281494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:06.892 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:45:07.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.976+0000 7fa88e9ff700 1 Processor -- start 2019-11-28T11:45:07.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.976+0000 7fa88e9ff700 1 -- start start 2019-11-28T11:45:07.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.977+0000 7fa88e9ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa88815f100 0x7fa88806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:07.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.977+0000 7fa88e9ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88806c2f0 0x7fa88806c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:07.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.977+0000 7fa88e9ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88806db60 con 0x7fa88815ed10 2019-11-28T11:45:07.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.977+0000 7fa88e9ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88806fe00 con 0x7fa88815f100 2019-11-28T11:45:07.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.977+0000 7fa88e9ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880700d0 con 0x7fa88806c2f0 2019-11-28T11:45:07.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa887fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa88815f100 0x7fa88806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa88d79d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88806c2f0 0x7fa88806c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa887fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa88815f100 0x7fa88806bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:54936/0 (socket says 172.21.15.80:54936) 2019-11-28T11:45:07.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa887fff700 1 -- 172.21.15.80:0/140495807 learned_addr learned my addr 172.21.15.80:0/140495807 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:07.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa88d79d700 1 -- 172.21.15.80:0/140495807 >> v2:172.21.15.174:3300/0 conn(0x7fa88815f100 msgr2=0x7fa88806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:07.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa88d79d700 1 --2- 172.21.15.80:0/140495807 >> v2:172.21.15.174:3300/0 conn(0x7fa88815f100 0x7fa88806bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:07.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa88d79d700 1 -- 172.21.15.80:0/140495807 >> v1:172.21.15.174:6789/0 conn(0x7fa88815ed10 legacy=0x7fa888073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa88d79d700 1 -- 172.21.15.80:0/140495807 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa888070760 con 0x7fa88806c2f0 2019-11-28T11:45:07.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa887fff700 1 --2- 172.21.15.80:0/140495807 >> v2:172.21.15.174:3300/0 conn(0x7fa88815f100 0x7fa88806bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:07.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa88d79d700 1 --2- 172.21.15.80:0/140495807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88806c2f0 0x7fa88806c740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa88000af80 tx=0x7fa88000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa88d79d700 1 --2- 172.21.15.80:0/140495807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88806c2f0 0x7fa88806c740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa88000af80 tx=0x7fa88000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa88d79d700 1 --2- 172.21.15.80:0/140495807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88806c2f0 0x7fa88806c740 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7fa88000af80 tx=0x7fa88000b790).ready entity=mon.2 client_cookie=11f3d3ac75ccc96e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:07.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa88d79d700 1 --2- 172.21.15.80:0/140495807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88806c2f0 0x7fa88806c740 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fa88000af80 tx=0x7fa88000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa88d79d700 1 --2- 172.21.15.80:0/140495807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88806c2f0 0x7fa88806c740 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fa88000af80 tx=0x7fa88000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa8877fe700 1 -- 172.21.15.80:0/140495807 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa880000bc0 con 0x7fa88806c2f0 2019-11-28T11:45:07.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa88d79d700 1 --2- 172.21.15.80:0/140495807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88806c2f0 0x7fa88806c740 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fa88000af80 tx=0x7fa88000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa8877fe700 1 -- 172.21.15.80:0/140495807 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8800097f0 con 0x7fa88806c2f0 2019-11-28T11:45:07.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa8877fe700 1 -- 172.21.15.80:0/140495807 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa880009ec0 con 0x7fa88806c2f0 2019-11-28T11:45:07.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa88e9ff700 1 -- 172.21.15.80:0/140495807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88806c2f0 msgr2=0x7fa88806c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.978+0000 7fa88e9ff700 1 --2- 172.21.15.80:0/140495807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88806c2f0 0x7fa88806c740 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7fa88000af80 tx=0x7fa88000b790).stop 2019-11-28T11:45:07.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.979+0000 7fa88e9ff700 1 -- 172.21.15.80:0/140495807 shutdown_connections 2019-11-28T11:45:07.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.979+0000 7fa88e9ff700 1 --2- 172.21.15.80:0/140495807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88806c2f0 0x7fa88806c740 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.979+0000 7fa88e9ff700 1 --2- 172.21.15.80:0/140495807 >> v2:172.21.15.174:3300/0 conn(0x7fa88815f100 0x7fa88806bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:07.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.979+0000 7fa88e9ff700 1 -- 172.21.15.80:0/140495807 shutdown_connections 2019-11-28T11:45:07.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.979+0000 7fa88e9ff700 1 -- 172.21.15.80:0/140495807 wait complete. 2019-11-28T11:45:07.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.979+0000 7fa88e9ff700 1 -- 172.21.15.80:0/140495807 >> 172.21.15.80:0/140495807 conn(0x7fa888061d20 msgr2=0x7fa8880641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:07.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.982+0000 7fa88e9ff700 1 Processor -- start 2019-11-28T11:45:07.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.982+0000 7fa88e9ff700 1 -- start start 2019-11-28T11:45:07.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa88e9ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88812e9a0 0x7fa888104800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:07.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa88e9ff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa88815f510 0x7fa88815f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:07.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa88e9ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa888148040 0x7fa8881484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:07.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa88e9ff700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa888111590 con 0x7fa88815f510 2019-11-28T11:45:07.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa88e9ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa888111fc0 con 0x7fa888148040 2019-11-28T11:45:07.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa88e9ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa888101f40 con 0x7fa88812e9a0 2019-11-28T11:45:07.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa887fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa88815f510 0x7fa88815f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa887fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa88815f510 0x7fa88815f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40056/0 (socket says 172.21.15.80:40056) 2019-11-28T11:45:07.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa887fff700 1 -- 172.21.15.80:0/1631402278 learned_addr learned my addr 172.21.15.80:0/1631402278 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:07.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa88cf9c700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88812e9a0 0x7fa888104800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa88d79d700 1 --2- 172.21.15.80:0/1631402278 >> v2:172.21.15.174:3300/0 conn(0x7fa888148040 0x7fa8881484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa887fff700 1 -- 172.21.15.80:0/1631402278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88812e9a0 msgr2=0x7fa888104800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa887fff700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88812e9a0 0x7fa888104800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa887fff700 1 -- 172.21.15.80:0/1631402278 >> v2:172.21.15.174:3300/0 conn(0x7fa888148040 msgr2=0x7fa8881484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa887fff700 1 --2- 172.21.15.80:0/1631402278 >> v2:172.21.15.174:3300/0 conn(0x7fa888148040 0x7fa8881484e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa887fff700 1 -- 172.21.15.80:0/1631402278 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8881022c0 con 0x7fa88815f510 2019-11-28T11:45:07.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa88cf9c700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88812e9a0 0x7fa888104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:07.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa887fff700 1 --2- 172.21.15.80:0/1631402278 >> v2:172.21.15.80:3300/0 conn(0x7fa88815f510 0x7fa88815f9a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa8780107e0 tx=0x7fa878010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa887fff700 1 --2- 172.21.15.80:0/1631402278 >> v2:172.21.15.80:3300/0 conn(0x7fa88815f510 0x7fa88815f9a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa8780107e0 tx=0x7fa878010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa887fff700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa88815f510 0x7fa88815f9a0 secure :-1 s=READY pgs=1699 cs=0 l=1 rx=0x7fa8780107e0 tx=0x7fa878010b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:07.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa887fff700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa88815f510 0x7fa88815f9a0 secure :-1 s=THROTTLE_DONE pgs=1699 cs=0 l=1 rx=0x7fa8780107e0 tx=0x7fa878010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa887fff700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa88815f510 0x7fa88815f9a0 secure :-1 s=THROTTLE_DONE pgs=1699 cs=0 l=1 rx=0x7fa8780107e0 tx=0x7fa878010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa8857fa700 1 -- 172.21.15.80:0/1631402278 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa878000cc0 con 0x7fa88815f510 2019-11-28T11:45:07.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa887fff700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa88815f510 0x7fa88815f9a0 secure :-1 s=THROTTLE_DONE pgs=1699 cs=0 l=1 rx=0x7fa8780107e0 tx=0x7fa878010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa8857fa700 1 -- 172.21.15.80:0/1631402278 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa878001200 con 0x7fa88815f510 2019-11-28T11:45:07.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa88e9ff700 1 -- 172.21.15.80:0/1631402278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8881022c0 con 0x7fa88815f510 2019-11-28T11:45:07.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa8857fa700 1 -- 172.21.15.80:0/1631402278 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8780018d0 con 0x7fa88815f510 2019-11-28T11:45:07.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.983+0000 7fa88e9ff700 1 -- 172.21.15.80:0/1631402278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8881022c0 con 0x7fa88815f510 2019-11-28T11:45:07.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.984+0000 7fa887fff700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa88815f510 0x7fa88815f9a0 secure :-1 s=THROTTLE_DONE pgs=1699 cs=0 l=1 rx=0x7fa8780107e0 tx=0x7fa878010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.984+0000 7fa8857fa700 1 -- 172.21.15.80:0/1631402278 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa8780013f0 con 0x7fa88815f510 2019-11-28T11:45:07.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.984+0000 7fa887fff700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa88815f510 0x7fa88815f9a0 secure :-1 s=THROTTLE_DONE pgs=1699 cs=0 l=1 rx=0x7fa8780107e0 tx=0x7fa878010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.984+0000 7fa8857fa700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa86c018730 0x7fa86c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:07.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.984+0000 7fa8857fa700 1 -- 172.21.15.80:0/1631402278 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa878031ed0 con 0x7fa88815f510 2019-11-28T11:45:07.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.984+0000 7fa88cf9c700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa86c018730 0x7fa86c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.985+0000 7fa88cf9c700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa86c018730 0x7fa86c01abc0 crc :-1 s=READY pgs=686 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:07.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.992+0000 7fa88e9ff700 1 -- 172.21.15.80:0/1631402278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8881022c0 con 0x7fa88815f510 2019-11-28T11:45:07.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.995+0000 7fa887fff700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa88815f510 0x7fa88815f9a0 secure :-1 s=THROTTLE_DONE pgs=1699 cs=0 l=1 rx=0x7fa8780107e0 tx=0x7fa878010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:06.995+0000 7fa8857fa700 1 -- 172.21.15.80:0/1631402278 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa878007990 con 0x7fa88815f510 2019-11-28T11:45:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.162+0000 7fa88e9ff700 1 -- 172.21.15.80:0/1631402278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fa8881022c0 con 0x7fa88815f510 2019-11-28T11:45:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.162+0000 7fa887fff700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa88815f510 0x7fa88815f9a0 secure :-1 s=THROTTLE_DONE pgs=1699 cs=0 l=1 rx=0x7fa8780107e0 tx=0x7fa878010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.162+0000 7fa8857fa700 1 -- 172.21.15.80:0/1631402278 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v128) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa878001200 con 0x7fa88815f510 2019-11-28T11:45:07.203 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:45:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.164+0000 7fa88e9ff700 1 -- 172.21.15.80:0/1631402278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa86c018730 msgr2=0x7fa86c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.164+0000 7fa88e9ff700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa86c018730 0x7fa86c01abc0 crc :-1 s=READY pgs=686 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.164+0000 7fa88e9ff700 1 -- 172.21.15.80:0/1631402278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa88815f510 msgr2=0x7fa88815f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.164+0000 7fa88e9ff700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa88815f510 0x7fa88815f9a0 secure :-1 s=READY pgs=1699 cs=0 l=1 rx=0x7fa8780107e0 tx=0x7fa878010b80).stop 2019-11-28T11:45:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.165+0000 7fa88e9ff700 1 -- 172.21.15.80:0/1631402278 shutdown_connections 2019-11-28T11:45:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.165+0000 7fa88e9ff700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa86c018730 0x7fa86c01abc0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.165+0000 7fa88e9ff700 1 --2- 172.21.15.80:0/1631402278 >> v2:172.21.15.174:3300/0 conn(0x7fa888148040 0x7fa8881484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.165+0000 7fa88e9ff700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa88815f510 0x7fa88815f9a0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.165+0000 7fa88e9ff700 1 --2- 172.21.15.80:0/1631402278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa88812e9a0 0x7fa888104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.165+0000 7fa88e9ff700 1 -- 172.21.15.80:0/1631402278 shutdown_connections 2019-11-28T11:45:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.165+0000 7fa88e9ff700 1 -- 172.21.15.80:0/1631402278 wait complete. 2019-11-28T11:45:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.165+0000 7fa88e9ff700 1 -- 172.21.15.80:0/1631402278 >> 172.21.15.80:0/1631402278 conn(0x7fa88807c4f0 msgr2=0x7fa88815ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:07.215 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:45:07.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.297+0000 7fe175837700 1 Processor -- start 2019-11-28T11:45:07.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.297+0000 7fe175837700 1 -- start start 2019-11-28T11:45:07.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.298+0000 7fe175837700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe17015f100 0x7fe17006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:07.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.298+0000 7fe175837700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe17006c2f0 0x7fe17006c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:07.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.298+0000 7fe175837700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17006db60 con 0x7fe17015ed10 2019-11-28T11:45:07.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.298+0000 7fe175837700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17006fe00 con 0x7fe17015f100 2019-11-28T11:45:07.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.298+0000 7fe175837700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1700700d0 con 0x7fe17006c2f0 2019-11-28T11:45:07.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16f7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe17015ed10 0x7fe170073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39378/0 (socket says 172.21.15.80:39378) 2019-11-28T11:45:07.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16f7fe700 1 -- 172.21.15.80:0/155672710 learned_addr learned my addr 172.21.15.80:0/155672710 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:07.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16effd700 1 --2- 172.21.15.80:0/155672710 >> v2:172.21.15.174:3300/0 conn(0x7fe17015f100 0x7fe17006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16ffff700 1 --2- 172.21.15.80:0/155672710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe17006c2f0 0x7fe17006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16e7fc700 1 -- 172.21.15.80:0/155672710 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217204336 0 0) 0x7fe160001150 con 0x7fe17015ed10 2019-11-28T11:45:07.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16e7fc700 1 -- 172.21.15.80:0/155672710 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe15c002e80 con 0x7fe17015ed10 2019-11-28T11:45:07.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16ffff700 1 -- 172.21.15.80:0/155672710 >> v2:172.21.15.174:3300/0 conn(0x7fe17015f100 msgr2=0x7fe17006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:07.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16ffff700 1 --2- 172.21.15.80:0/155672710 >> v2:172.21.15.174:3300/0 conn(0x7fe17015f100 0x7fe17006bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:07.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16ffff700 1 -- 172.21.15.80:0/155672710 >> v1:172.21.15.80:6789/0 conn(0x7fe17015ed10 legacy=0x7fe170073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16ffff700 1 -- 172.21.15.80:0/155672710 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe170070760 con 0x7fe17006c2f0 2019-11-28T11:45:07.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16effd700 1 --2- 172.21.15.80:0/155672710 >> v2:172.21.15.174:3300/0 conn(0x7fe17015f100 0x7fe17006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:07.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16ffff700 1 --2- 172.21.15.80:0/155672710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe17006c2f0 0x7fe17006c740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe16800b300 tx=0x7fe16800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16ffff700 1 --2- 172.21.15.80:0/155672710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe17006c2f0 0x7fe17006c740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe16800b300 tx=0x7fe16800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16ffff700 1 --2- 172.21.15.80:0/155672710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe17006c2f0 0x7fe17006c740 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7fe16800b300 tx=0x7fe16800bb10).ready entity=mon.2 client_cookie=d36d7e92256eb590 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:07.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16ffff700 1 --2- 172.21.15.80:0/155672710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe17006c2f0 0x7fe17006c740 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fe16800b300 tx=0x7fe16800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16e7fc700 1 -- 172.21.15.80:0/155672710 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe168000f40 con 0x7fe17006c2f0 2019-11-28T11:45:07.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16ffff700 1 --2- 172.21.15.80:0/155672710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe17006c2f0 0x7fe17006c740 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fe16800b300 tx=0x7fe16800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16ffff700 1 --2- 172.21.15.80:0/155672710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe17006c2f0 0x7fe17006c740 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fe16800b300 tx=0x7fe16800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16e7fc700 1 -- 172.21.15.80:0/155672710 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe168009b70 con 0x7fe17006c2f0 2019-11-28T11:45:07.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe16e7fc700 1 -- 172.21.15.80:0/155672710 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe16800a240 con 0x7fe17006c2f0 2019-11-28T11:45:07.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe175837700 1 -- 172.21.15.80:0/155672710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe17006c2f0 msgr2=0x7fe17006c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.299+0000 7fe175837700 1 --2- 172.21.15.80:0/155672710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe17006c2f0 0x7fe17006c740 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7fe16800b300 tx=0x7fe16800bb10).stop 2019-11-28T11:45:07.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.300+0000 7fe175837700 1 -- 172.21.15.80:0/155672710 shutdown_connections 2019-11-28T11:45:07.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.300+0000 7fe175837700 1 --2- 172.21.15.80:0/155672710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe17006c2f0 0x7fe17006c740 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.300+0000 7fe175837700 1 --2- 172.21.15.80:0/155672710 >> v2:172.21.15.174:3300/0 conn(0x7fe17015f100 0x7fe17006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:07.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.300+0000 7fe175837700 1 -- 172.21.15.80:0/155672710 shutdown_connections 2019-11-28T11:45:07.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.300+0000 7fe175837700 1 -- 172.21.15.80:0/155672710 wait complete. 2019-11-28T11:45:07.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.300+0000 7fe175837700 1 -- 172.21.15.80:0/155672710 >> 172.21.15.80:0/155672710 conn(0x7fe170061d20 msgr2=0x7fe1700641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:07.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.302+0000 7fe175837700 1 Processor -- start 2019-11-28T11:45:07.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.303+0000 7fe175837700 1 -- start start 2019-11-28T11:45:07.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.303+0000 7fe175837700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe170153890 0x7fe170115020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:07.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.303+0000 7fe175837700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe170115560 0x7fe17012e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:07.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe175837700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1701542b0 con 0x7fe17012e670 2019-11-28T11:45:07.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe175837700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe170110180 con 0x7fe170115560 2019-11-28T11:45:07.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe175837700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe170110bb0 con 0x7fe170153890 2019-11-28T11:45:07.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe16effd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe170115560 0x7fe17012e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe16effd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe170115560 0x7fe17012e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40070/0 (socket says 172.21.15.80:40070) 2019-11-28T11:45:07.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe16effd700 1 -- 172.21.15.80:0/2393152639 learned_addr learned my addr 172.21.15.80:0/2393152639 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:07.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe16f7fe700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe170153890 0x7fe170115020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe16effd700 1 -- 172.21.15.80:0/2393152639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe170153890 msgr2=0x7fe170115020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe16effd700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe170153890 0x7fe170115020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe16effd700 1 -- 172.21.15.80:0/2393152639 >> v1:172.21.15.80:6789/0 conn(0x7fe17012e670 legacy=0x7fe170113ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe16effd700 1 -- 172.21.15.80:0/2393152639 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe170112760 con 0x7fe170115560 2019-11-28T11:45:07.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe16effd700 1 --2- 172.21.15.80:0/2393152639 >> v2:172.21.15.80:3300/0 conn(0x7fe170115560 0x7fe17012e130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe158010410 tx=0x7fe158010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe16effd700 1 --2- 172.21.15.80:0/2393152639 >> v2:172.21.15.80:3300/0 conn(0x7fe170115560 0x7fe17012e130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe158010410 tx=0x7fe158010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe16effd700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe170115560 0x7fe17012e130 secure :-1 s=READY pgs=1702 cs=0 l=1 rx=0x7fe158010410 tx=0x7fe158010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:07.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe16effd700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe170115560 0x7fe17012e130 secure :-1 s=THROTTLE_DONE pgs=1702 cs=0 l=1 rx=0x7fe158010410 tx=0x7fe158010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe167fff700 1 -- 172.21.15.80:0/2393152639 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe158000960 con 0x7fe170115560 2019-11-28T11:45:07.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe16effd700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe170115560 0x7fe17012e130 secure :-1 s=THROTTLE_DONE pgs=1702 cs=0 l=1 rx=0x7fe158010410 tx=0x7fe158010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe16effd700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe170115560 0x7fe17012e130 secure :-1 s=THROTTLE_DONE pgs=1702 cs=0 l=1 rx=0x7fe158010410 tx=0x7fe158010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe167fff700 1 -- 172.21.15.80:0/2393152639 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe158009770 con 0x7fe170115560 2019-11-28T11:45:07.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe175837700 1 -- 172.21.15.80:0/2393152639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe170112ae0 con 0x7fe170115560 2019-11-28T11:45:07.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe167fff700 1 -- 172.21.15.80:0/2393152639 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe158009ec0 con 0x7fe170115560 2019-11-28T11:45:07.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.304+0000 7fe175837700 1 -- 172.21.15.80:0/2393152639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe170112760 con 0x7fe170115560 2019-11-28T11:45:07.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.305+0000 7fe16effd700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe170115560 0x7fe17012e130 secure :-1 s=THROTTLE_DONE pgs=1702 cs=0 l=1 rx=0x7fe158010410 tx=0x7fe158010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.305+0000 7fe167fff700 1 -- 172.21.15.80:0/2393152639 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe158009960 con 0x7fe170115560 2019-11-28T11:45:07.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.305+0000 7fe16effd700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe170115560 0x7fe17012e130 secure :-1 s=THROTTLE_DONE pgs=1702 cs=0 l=1 rx=0x7fe158010410 tx=0x7fe158010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.305+0000 7fe167fff700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe154018730 0x7fe15401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:07.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.305+0000 7fe167fff700 1 -- 172.21.15.80:0/2393152639 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe158031cd0 con 0x7fe170115560 2019-11-28T11:45:07.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.305+0000 7fe16f7fe700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe154018730 0x7fe15401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.305+0000 7fe16f7fe700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe154018730 0x7fe15401abc0 crc :-1 s=READY pgs=687 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:07.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.313+0000 7fe175837700 1 -- 172.21.15.80:0/2393152639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe170112ae0 con 0x7fe170115560 2019-11-28T11:45:07.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.316+0000 7fe16effd700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe170115560 0x7fe17012e130 secure :-1 s=THROTTLE_DONE pgs=1702 cs=0 l=1 rx=0x7fe158010410 tx=0x7fe158010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.316+0000 7fe167fff700 1 -- 172.21.15.80:0/2393152639 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe158017540 con 0x7fe170115560 2019-11-28T11:45:07.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.483+0000 7fe175837700 1 -- 172.21.15.80:0/2393152639 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fe170112760 con 0x7fe170115560 2019-11-28T11:45:07.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.484+0000 7fe16effd700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe170115560 0x7fe17012e130 secure :-1 s=THROTTLE_DONE pgs=1702 cs=0 l=1 rx=0x7fe158010410 tx=0x7fe158010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.484+0000 7fe167fff700 1 -- 172.21.15.80:0/2393152639 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v128) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe158017750 con 0x7fe170115560 2019-11-28T11:45:07.525 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:45:07.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.486+0000 7fe175837700 1 -- 172.21.15.80:0/2393152639 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe154018730 msgr2=0x7fe15401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.486+0000 7fe175837700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe154018730 0x7fe15401abc0 crc :-1 s=READY pgs=687 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.486+0000 7fe175837700 1 -- 172.21.15.80:0/2393152639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe170115560 msgr2=0x7fe17012e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.486+0000 7fe175837700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe170115560 0x7fe17012e130 secure :-1 s=READY pgs=1702 cs=0 l=1 rx=0x7fe158010410 tx=0x7fe158010290).stop 2019-11-28T11:45:07.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.486+0000 7fe175837700 1 -- 172.21.15.80:0/2393152639 shutdown_connections 2019-11-28T11:45:07.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.486+0000 7fe175837700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe154018730 0x7fe15401abc0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.486+0000 7fe175837700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe170115560 0x7fe17012e130 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.486+0000 7fe175837700 1 --2- 172.21.15.80:0/2393152639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe170153890 0x7fe170115020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.487+0000 7fe175837700 1 -- 172.21.15.80:0/2393152639 shutdown_connections 2019-11-28T11:45:07.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.487+0000 7fe175837700 1 -- 172.21.15.80:0/2393152639 wait complete. 2019-11-28T11:45:07.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.487+0000 7fe175837700 1 -- 172.21.15.80:0/2393152639 >> 172.21.15.80:0/2393152639 conn(0x7fe17014f9f0 msgr2=0x7fe170111c60 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:07.537 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:45:07.537 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:07.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.618+0000 7f5f21d2b700 1 Processor -- start 2019-11-28T11:45:07.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.618+0000 7f5f21d2b700 1 -- start start 2019-11-28T11:45:07.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.619+0000 7f5f21d2b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5f1c06d120 0x7f5f1c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:07.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.619+0000 7f5f21d2b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1c06d5a0 con 0x7f5f1c06c0a0 2019-11-28T11:45:07.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.619+0000 7f5f21d2b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1c06db00 con 0x7f5f1c06c490 2019-11-28T11:45:07.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.619+0000 7f5f21d2b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1c06fd60 con 0x7f5f1c06d120 2019-11-28T11:45:07.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.619+0000 7f5f1bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5f1c06c0a0 0x7f5f1c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39392/0 (socket says 172.21.15.80:39392) 2019-11-28T11:45:07.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.619+0000 7f5f1bfff700 1 -- 172.21.15.80:0/2620027971 learned_addr learned my addr 172.21.15.80:0/2620027971 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:07.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.619+0000 7f5f20ac9700 1 --2- 172.21.15.80:0/2620027971 >> v2:172.21.15.174:3300/0 conn(0x7f5f1c06d120 0x7f5f1c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.619+0000 7f5f1b7fe700 1 -- 172.21.15.80:0/2620027971 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245484255 0 0) 0x7f5f0c001150 con 0x7f5f1c06c0a0 2019-11-28T11:45:07.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 -- 172.21.15.80:0/2620027971 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f08002e80 con 0x7f5f1c06c0a0 2019-11-28T11:45:07.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 -- 172.21.15.80:0/2620027971 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1155260143 0 0) 0x7f5f0c001130 con 0x7f5f1c06c0a0 2019-11-28T11:45:07.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 -- 172.21.15.80:0/2620027971 >> v2:172.21.15.174:3300/0 conn(0x7f5f1c06d120 msgr2=0x7f5f1c165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:07.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 --2- 172.21.15.80:0/2620027971 >> v2:172.21.15.174:3300/0 conn(0x7f5f1c06d120 0x7f5f1c165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:07.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 -- 172.21.15.80:0/2620027971 >> v1:172.21.15.174:6789/0 conn(0x7f5f1c06c490 legacy=0x7f5f1c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 -- 172.21.15.80:0/2620027971 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c0706c0 con 0x7f5f1c06c0a0 2019-11-28T11:45:07.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 -- 172.21.15.80:0/2620027971 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f5f0c001660 con 0x7f5f1c06c0a0 2019-11-28T11:45:07.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 -- 172.21.15.80:0/2620027971 >> v1:172.21.15.80:6789/0 conn(0x7f5f1c06c0a0 legacy=0x7f5f1c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f08003ab0 0x7f5f08005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:07.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f08006690 0x7f5f08008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:07.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f08009380 0x7f5f0800b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:07.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 -- 172.21.15.80:0/2620027971 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0800c000 con 0x7f5f08009380 2019-11-28T11:45:07.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 -- 172.21.15.80:0/2620027971 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f08050200 con 0x7f5f08006690 2019-11-28T11:45:07.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 -- 172.21.15.80:0/2620027971 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f08050430 con 0x7f5f08003ab0 2019-11-28T11:45:07.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f20ac9700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f08009380 0x7f5f0800b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f13fff700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f08006690 0x7f5f08008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1bfff700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f08003ab0 0x7f5f08005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f20ac9700 1 -- 172.21.15.80:0/2620027971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f08003ab0 msgr2=0x7f5f08005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:07.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f20ac9700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f08003ab0 0x7f5f08005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:07.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f20ac9700 1 -- 172.21.15.80:0/2620027971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f08006690 msgr2=0x7f5f08008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:07.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f20ac9700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f08006690 0x7f5f08008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:07.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f20ac9700 1 -- 172.21.15.80:0/2620027971 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f080506e0 con 0x7f5f08009380 2019-11-28T11:45:07.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f13fff700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f08006690 0x7f5f08008b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:07.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f20ac9700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f08009380 0x7f5f0800b850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5f1400e7f0 tx=0x7f5f1400eaf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f20ac9700 1 -- 172.21.15.80:0/2620027971 reap_dead start 2019-11-28T11:45:07.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f20ac9700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f08009380 0x7f5f0800b850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5f1400e7f0 tx=0x7f5f1400eaf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f20ac9700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f08009380 0x7f5f0800b850 secure :-1 s=READY pgs=1704 cs=0 l=1 rx=0x7f5f1400e7f0 tx=0x7f5f1400eaf0).ready entity=mon.0 client_cookie=8fe72c2e6470f018 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:07.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f20ac9700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f08009380 0x7f5f0800b850 secure :-1 s=THROTTLE_DONE pgs=1704 cs=0 l=1 rx=0x7f5f1400e7f0 tx=0x7f5f1400eaf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 -- 172.21.15.80:0/2620027971 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f1400f200 con 0x7f5f08009380 2019-11-28T11:45:07.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f20ac9700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f08009380 0x7f5f0800b850 secure :-1 s=THROTTLE_DONE pgs=1704 cs=0 l=1 rx=0x7f5f1400e7f0 tx=0x7f5f1400eaf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 -- 172.21.15.80:0/2620027971 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1400ee20 con 0x7f5f08009380 2019-11-28T11:45:07.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f20ac9700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f08009380 0x7f5f0800b850 secure :-1 s=THROTTLE_DONE pgs=1704 cs=0 l=1 rx=0x7f5f1400e7f0 tx=0x7f5f1400eaf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.620+0000 7f5f1b7fe700 1 -- 172.21.15.80:0/2620027971 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f1400f3f0 con 0x7f5f08009380 2019-11-28T11:45:07.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.621+0000 7f5f21d2b700 1 -- 172.21.15.80:0/2620027971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f08009380 msgr2=0x7f5f0800b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.621+0000 7f5f21d2b700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f08009380 0x7f5f0800b850 secure :-1 s=READY pgs=1704 cs=0 l=1 rx=0x7f5f1400e7f0 tx=0x7f5f1400eaf0).stop 2019-11-28T11:45:07.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.621+0000 7f5f21d2b700 1 -- 172.21.15.80:0/2620027971 shutdown_connections 2019-11-28T11:45:07.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.621+0000 7f5f21d2b700 1 --2- 172.21.15.80:0/2620027971 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f08009380 0x7f5f0800b850 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.621+0000 7f5f21d2b700 1 -- 172.21.15.80:0/2620027971 shutdown_connections 2019-11-28T11:45:07.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.621+0000 7f5f21d2b700 1 -- 172.21.15.80:0/2620027971 wait complete. 2019-11-28T11:45:07.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.621+0000 7f5f21d2b700 1 -- 172.21.15.80:0/2620027971 >> 172.21.15.80:0/2620027971 conn(0x7f5f1c061cf0 msgr2=0x7f5f1c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:07.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.624+0000 7f5f21d2b700 1 Processor -- start 2019-11-28T11:45:07.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.624+0000 7f5f21d2b700 1 -- start start 2019-11-28T11:45:07.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f21d2b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5f1c150f50 0x7f5f1c07b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:07.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f21d2b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1c0754d0 con 0x7f5f1c074d00 2019-11-28T11:45:07.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f21d2b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1c12eb20 con 0x7f5f1c07bba0 2019-11-28T11:45:07.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f21d2b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1c078980 con 0x7f5f1c150f50 2019-11-28T11:45:07.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f1bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5f1c074d00 0x7f5f1c07aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39402/0 (socket says 172.21.15.80:39402) 2019-11-28T11:45:07.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f1bfff700 1 -- 172.21.15.80:0/1404072582 learned_addr learned my addr 172.21.15.80:0/1404072582 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:07.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f13fff700 1 --2- 172.21.15.80:0/1404072582 >> v2:172.21.15.174:3300/0 conn(0x7f5f1c150f50 0x7f5f1c07b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f197fa700 1 -- 172.21.15.80:0/1404072582 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204486291 0 0) 0x7f5f0c001110 con 0x7f5f1c074d00 2019-11-28T11:45:07.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f197fa700 1 -- 172.21.15.80:0/1404072582 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f00002e80 con 0x7f5f1c074d00 2019-11-28T11:45:07.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f197fa700 1 -- 172.21.15.80:0/1404072582 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631980243 0 0) 0x7f5f1400e640 con 0x7f5f1c07bba0 2019-11-28T11:45:07.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f13fff700 1 -- 172.21.15.80:0/1404072582 >> v1:172.21.15.174:6789/0 conn(0x7f5f1c07bba0 legacy=0x7f5f1c167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f13fff700 1 -- 172.21.15.80:0/1404072582 >> v1:172.21.15.80:6789/0 conn(0x7f5f1c074d00 legacy=0x7f5f1c07aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f13fff700 1 -- 172.21.15.80:0/1404072582 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c0792e0 con 0x7f5f1c150f50 2019-11-28T11:45:07.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f13fff700 1 --2- 172.21.15.80:0/1404072582 >> v2:172.21.15.174:3300/0 conn(0x7f5f1c150f50 0x7f5f1c07b220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5f040103b0 tx=0x7f5f04010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f13fff700 1 --2- 172.21.15.80:0/1404072582 >> v2:172.21.15.174:3300/0 conn(0x7f5f1c150f50 0x7f5f1c07b220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5f040103b0 tx=0x7f5f04010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f13fff700 1 --2- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f1c150f50 0x7f5f1c07b220 secure :-1 s=READY pgs=994 cs=0 l=1 rx=0x7f5f040103b0 tx=0x7f5f04010750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:07.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f13fff700 1 --2- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f1c150f50 0x7f5f1c07b220 secure :-1 s=THROTTLE_DONE pgs=994 cs=0 l=1 rx=0x7f5f040103b0 tx=0x7f5f04010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f197fa700 1 -- 172.21.15.80:0/1404072582 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f04000fc0 con 0x7f5f1c150f50 2019-11-28T11:45:07.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f13fff700 1 --2- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f1c150f50 0x7f5f1c07b220 secure :-1 s=THROTTLE_DONE pgs=994 cs=0 l=1 rx=0x7f5f040103b0 tx=0x7f5f04010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f13fff700 1 --2- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f1c150f50 0x7f5f1c07b220 secure :-1 s=THROTTLE_DONE pgs=994 cs=0 l=1 rx=0x7f5f040103b0 tx=0x7f5f04010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f197fa700 1 -- 172.21.15.80:0/1404072582 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f040095d0 con 0x7f5f1c150f50 2019-11-28T11:45:07.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f197fa700 1 -- 172.21.15.80:0/1404072582 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f040015a0 con 0x7f5f1c150f50 2019-11-28T11:45:07.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f21d2b700 1 -- 172.21.15.80:0/1404072582 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f1c079660 con 0x7f5f1c150f50 2019-11-28T11:45:07.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.625+0000 7f5f21d2b700 1 -- 172.21.15.80:0/1404072582 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1c0792e0 con 0x7f5f1c150f50 2019-11-28T11:45:07.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.626+0000 7f5f13fff700 1 --2- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f1c150f50 0x7f5f1c07b220 secure :-1 s=THROTTLE_DONE pgs=994 cs=0 l=1 rx=0x7f5f040103b0 tx=0x7f5f04010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.626+0000 7f5f197fa700 1 -- 172.21.15.80:0/1404072582 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5f04000da0 con 0x7f5f1c150f50 2019-11-28T11:45:07.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.626+0000 7f5f13fff700 1 --2- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f1c150f50 0x7f5f1c07b220 secure :-1 s=THROTTLE_DONE pgs=994 cs=0 l=1 rx=0x7f5f040103b0 tx=0x7f5f04010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.626+0000 7f5f197fa700 1 --2- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f00018780 0x7f5f0001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:07.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.626+0000 7f5f197fa700 1 -- 172.21.15.80:0/1404072582 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5f04031aa0 con 0x7f5f1c150f50 2019-11-28T11:45:07.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.626+0000 7f5f1bfff700 1 --2- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f00018780 0x7f5f0001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:07.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.627+0000 7f5f1bfff700 1 --2- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f00018780 0x7f5f0001abf0 crc :-1 s=READY pgs=688 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:07.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.633+0000 7f5f21d2b700 1 -- 172.21.15.80:0/1404072582 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1c079660 con 0x7f5f1c150f50 2019-11-28T11:45:07.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.637+0000 7f5f13fff700 1 --2- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f1c150f50 0x7f5f1c07b220 secure :-1 s=THROTTLE_DONE pgs=994 cs=0 l=1 rx=0x7f5f040103b0 tx=0x7f5f04010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.637+0000 7f5f197fa700 1 -- 172.21.15.80:0/1404072582 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5f04000af0 con 0x7f5f1c150f50 2019-11-28T11:45:07.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.809+0000 7f5f21d2b700 1 -- 172.21.15.80:0/1404072582 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f1c0792e0 con 0x7f5f1c150f50 2019-11-28T11:45:07.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.809+0000 7f5f13fff700 1 --2- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f1c150f50 0x7f5f1c07b220 secure :-1 s=THROTTLE_DONE pgs=994 cs=0 l=1 rx=0x7f5f040103b0 tx=0x7f5f04010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:07.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.809+0000 7f5f197fa700 1 -- 172.21.15.80:0/1404072582 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+1777 (secure 0 0 0) 0x7f5f04000d00 con 0x7f5f1c150f50 2019-11-28T11:45:07.850 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 92 2019-11-28T11:45:07.850 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:07.851 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":92,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:01.366373+0000","modified":"2019-11-28T11:45:05.381121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8937},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8937":{"gid":8937,"name":"c","rank":0,"incarnation":91,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/1730908433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1730908433},{"type":"v1","addr":"172.21.15.174:6835","nonce":1730908433}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2019-11-28T11:45:07.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.811+0000 7f5f21d2b700 1 -- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f00018780 msgr2=0x7f5f0001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.811+0000 7f5f21d2b700 1 --2- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f00018780 0x7f5f0001abf0 crc :-1 s=READY pgs=688 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.811+0000 7f5f21d2b700 1 -- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f1c150f50 msgr2=0x7f5f1c07b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:07.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.811+0000 7f5f21d2b700 1 --2- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f1c150f50 0x7f5f1c07b220 secure :-1 s=READY pgs=994 cs=0 l=1 rx=0x7f5f040103b0 tx=0x7f5f04010750).stop 2019-11-28T11:45:07.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.811+0000 7f5f21d2b700 1 -- 172.21.15.80:0/1404072582 shutdown_connections 2019-11-28T11:45:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.811+0000 7f5f21d2b700 1 --2- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f00018780 0x7f5f0001abf0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.811+0000 7f5f21d2b700 1 --2- 172.21.15.80:0/1404072582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f1c150f50 0x7f5f1c07b220 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.812+0000 7f5f21d2b700 1 -- 172.21.15.80:0/1404072582 shutdown_connections 2019-11-28T11:45:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.812+0000 7f5f21d2b700 1 -- 172.21.15.80:0/1404072582 wait complete. 2019-11-28T11:45:07.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:07.812+0000 7f5f21d2b700 1 -- 172.21.15.80:0/1404072582 >> 172.21.15.80:0/1404072582 conn(0x7f5f1c13fa50 msgr2=0x7f5f1c07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:08.163 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8937}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 20, u'failed': [], u'epoch': 92, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [21], u'info': {u'gid_8937': {u'export_targets': [], u'name': u'c', u'incarnation': 91, u'state_seq': 2, u'state': u'up:active', u'gid': 8937, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1730908433, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 1730908433, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/1730908433'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:45:01.366373+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:45:05.381121+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:45:08.164 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:45:08.164 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:45:08.290 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:45:08.290 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:45:08.290 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:45:08.290 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 8937, 2019-11-28T11:45:08.290 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:45:08.291 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:45:08.291 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 3.8716686739999999, 2019-11-28T11:45:08.291 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 92, 2019-11-28T11:45:08.291 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 128, 2019-11-28T11:45:08.291 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 128, 2019-11-28T11:45:08.291 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 4.098990337 2019-11-28T11:45:08.291 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:45:08.296 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8937, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.8716686739999999, "mdsmap_epoch": 92, "osdmap_epoch": 128, "osdmap_epoch_barrier": 128, "uptime": 4.098990337 } 2019-11-28T11:45:08.297 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:45:08.297 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:45:08.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:45:08.297 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:45:08.368 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:45:08.368 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:45:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:45:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:45:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:45:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:45:08.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:45:08.491 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:45:08.562 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:45:08.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.643+0000 7f72d9a68700 1 Processor -- start 2019-11-28T11:45:08.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.643+0000 7f72d9a68700 1 -- start start 2019-11-28T11:45:08.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d9a68700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72d406d120 0x7f72d4165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:08.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d9a68700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d406d5a0 con 0x7f72d406c490 2019-11-28T11:45:08.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d9a68700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d406db00 con 0x7f72d406c0a0 2019-11-28T11:45:08.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d9a68700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d406fd60 con 0x7f72d406d120 2019-11-28T11:45:08.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d8806700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72d406d120 0x7f72d4165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:08.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d8806700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72d406d120 0x7f72d4165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40100/0 (socket says 172.21.15.80:40100) 2019-11-28T11:45:08.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d8806700 1 -- 172.21.15.80:0/4235465928 learned_addr learned my addr 172.21.15.80:0/4235465928 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:08.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72cbfff700 1 --1- 172.21.15.80:0/4235465928 >> v1:172.21.15.80:6789/0 conn(0x7f72d406c490 0x7f72d406c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39416/0 (socket says 172.21.15.80:39416) 2019-11-28T11:45:08.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d8806700 1 -- 172.21.15.80:0/4235465928 >> v1:172.21.15.174:6789/0 conn(0x7f72d406c0a0 legacy=0x7f72d4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:08.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d8806700 1 -- 172.21.15.80:0/4235465928 >> v1:172.21.15.80:6789/0 conn(0x7f72d406c490 legacy=0x7f72d406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:08.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d37fe700 1 -- 172.21.15.80:0/4235465928 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831219332 0 0) 0x7f72c4001080 con 0x7f72d406c0a0 2019-11-28T11:45:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d8806700 1 -- 172.21.15.80:0/4235465928 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d40706c0 con 0x7f72d406d120 2019-11-28T11:45:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d8806700 1 --2- 172.21.15.80:0/4235465928 >> v2:172.21.15.80:3300/0 conn(0x7f72d406d120 0x7f72d4165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f72cc00fab0 tx=0x7f72cc00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d8806700 1 --2- 172.21.15.80:0/4235465928 >> v2:172.21.15.80:3300/0 conn(0x7f72d406d120 0x7f72d4165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f72cc00fab0 tx=0x7f72cc00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d8806700 1 --2- 172.21.15.80:0/4235465928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72d406d120 0x7f72d4165d80 secure :-1 s=READY pgs=1707 cs=0 l=1 rx=0x7f72cc00fab0 tx=0x7f72cc00fe50).ready entity=mon.0 client_cookie=6877cca00058b9a7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d8806700 1 --2- 172.21.15.80:0/4235465928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72d406d120 0x7f72d4165d80 secure :-1 s=THROTTLE_DONE pgs=1707 cs=0 l=1 rx=0x7f72cc00fab0 tx=0x7f72cc00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:08.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d37fe700 1 -- 172.21.15.80:0/4235465928 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72cc001460 con 0x7f72d406d120 2019-11-28T11:45:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d8806700 1 --2- 172.21.15.80:0/4235465928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72d406d120 0x7f72d4165d80 secure :-1 s=THROTTLE_DONE pgs=1707 cs=0 l=1 rx=0x7f72cc00fab0 tx=0x7f72cc00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d8806700 1 --2- 172.21.15.80:0/4235465928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72d406d120 0x7f72d4165d80 secure :-1 s=THROTTLE_DONE pgs=1707 cs=0 l=1 rx=0x7f72cc00fab0 tx=0x7f72cc00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d37fe700 1 -- 172.21.15.80:0/4235465928 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc000df0 con 0x7f72d406d120 2019-11-28T11:45:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.644+0000 7f72d37fe700 1 -- 172.21.15.80:0/4235465928 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72cc001a40 con 0x7f72d406d120 2019-11-28T11:45:08.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.645+0000 7f72d9a68700 1 -- 172.21.15.80:0/4235465928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72d406d120 msgr2=0x7f72d4165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:08.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.645+0000 7f72d9a68700 1 --2- 172.21.15.80:0/4235465928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72d406d120 0x7f72d4165d80 secure :-1 s=READY pgs=1707 cs=0 l=1 rx=0x7f72cc00fab0 tx=0x7f72cc00fe50).stop 2019-11-28T11:45:08.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.645+0000 7f72d9a68700 1 -- 172.21.15.80:0/4235465928 shutdown_connections 2019-11-28T11:45:08.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.645+0000 7f72d9a68700 1 --2- 172.21.15.80:0/4235465928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72d406d120 0x7f72d4165d80 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:08.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.645+0000 7f72d9a68700 1 -- 172.21.15.80:0/4235465928 shutdown_connections 2019-11-28T11:45:08.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.645+0000 7f72d9a68700 1 -- 172.21.15.80:0/4235465928 wait complete. 2019-11-28T11:45:08.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.645+0000 7f72d9a68700 1 -- 172.21.15.80:0/4235465928 >> 172.21.15.80:0/4235465928 conn(0x7f72d4061cf0 msgr2=0x7f72d4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.648+0000 7f72d9a68700 1 Processor -- start 2019-11-28T11:45:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.648+0000 7f72d9a68700 1 -- start start 2019-11-28T11:45:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.648+0000 7f72d9a68700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d4166a10 0x7f72d4168e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.648+0000 7f72d9a68700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d4124260 con 0x7f72d412cea0 2019-11-28T11:45:08.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.648+0000 7f72d9a68700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d412e5d0 con 0x7f72d4111db0 2019-11-28T11:45:08.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.648+0000 7f72d9a68700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d4121040 con 0x7f72d4166a10 2019-11-28T11:45:08.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f72d412cea0 0x7f72d41230e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39418/0 (socket says 172.21.15.80:39418) 2019-11-28T11:45:08.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d3fff700 1 -- 172.21.15.80:0/177898091 learned_addr learned my addr 172.21.15.80:0/177898091 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:08.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d8806700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d4166a10 0x7f72d4168e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:08.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d17fa700 1 -- 172.21.15.80:0/177898091 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178865577 0 0) 0x7f72c40012c0 con 0x7f72d412cea0 2019-11-28T11:45:08.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d17fa700 1 -- 172.21.15.80:0/177898091 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72b8002e80 con 0x7f72d412cea0 2019-11-28T11:45:08.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d17fa700 1 -- 172.21.15.80:0/177898091 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518794952 0 0) 0x7f72bc001100 con 0x7f72d4111db0 2019-11-28T11:45:08.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d17fa700 1 -- 172.21.15.80:0/177898091 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72b80030b0 con 0x7f72d4111db0 2019-11-28T11:45:08.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d17fa700 1 -- 172.21.15.80:0/177898091 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3844366371 0 0) 0x7f72c4000aa0 con 0x7f72d412cea0 2019-11-28T11:45:08.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d17fa700 1 -- 172.21.15.80:0/177898091 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f72b80033c0 con 0x7f72d412cea0 2019-11-28T11:45:08.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d17fa700 1 -- 172.21.15.80:0/177898091 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f72c4001750 con 0x7f72d412cea0 2019-11-28T11:45:08.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d8806700 1 -- 172.21.15.80:0/177898091 >> v1:172.21.15.174:6789/0 conn(0x7f72d4111db0 legacy=0x7f72d41238e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:08.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d8806700 1 -- 172.21.15.80:0/177898091 >> v1:172.21.15.80:6789/0 conn(0x7f72d412cea0 legacy=0x7f72d41230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:08.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d8806700 1 -- 172.21.15.80:0/177898091 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d41219a0 con 0x7f72d4166a10 2019-11-28T11:45:08.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d8806700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d4166a10 0x7f72d4168e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f72cc000d40 tx=0x7f72cc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:08.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d8806700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d4166a10 0x7f72d4168e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f72cc000d40 tx=0x7f72cc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:08.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d8806700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d4166a10 0x7f72d4168e10 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7f72cc000d40 tx=0x7f72cc010af0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:08.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d8806700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d4166a10 0x7f72d4168e10 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f72cc000d40 tx=0x7f72cc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:08.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d17fa700 1 -- 172.21.15.80:0/177898091 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72cc007e60 con 0x7f72d4166a10 2019-11-28T11:45:08.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d8806700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d4166a10 0x7f72d4168e10 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f72cc000d40 tx=0x7f72cc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:08.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d17fa700 1 -- 172.21.15.80:0/177898091 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc001630 con 0x7f72d4166a10 2019-11-28T11:45:08.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d8806700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d4166a10 0x7f72d4168e10 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f72cc000d40 tx=0x7f72cc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:08.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d9a68700 1 -- 172.21.15.80:0/177898091 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d4121d20 con 0x7f72d4166a10 2019-11-28T11:45:08.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d17fa700 1 -- 172.21.15.80:0/177898091 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72cc001820 con 0x7f72d4166a10 2019-11-28T11:45:08.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.649+0000 7f72d9a68700 1 -- 172.21.15.80:0/177898091 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d41219a0 con 0x7f72d4166a10 2019-11-28T11:45:08.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.650+0000 7f72d8806700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d4166a10 0x7f72d4168e10 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f72cc000d40 tx=0x7f72cc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:08.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.650+0000 7f72d17fa700 1 -- 172.21.15.80:0/177898091 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f72cc001820 con 0x7f72d4166a10 2019-11-28T11:45:08.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.650+0000 7f72d8806700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d4166a10 0x7f72d4168e10 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f72cc000d40 tx=0x7f72cc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:08.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.650+0000 7f72d17fa700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f72b80187a0 0x7f72b801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:08.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.650+0000 7f72d17fa700 1 -- 172.21.15.80:0/177898091 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f72cc031e10 con 0x7f72d4166a10 2019-11-28T11:45:08.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.650+0000 7f72d3fff700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f72b80187a0 0x7f72b801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:08.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.650+0000 7f72d3fff700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f72b80187a0 0x7f72b801abf0 crc :-1 s=READY pgs=691 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:08.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.658+0000 7f72d9a68700 1 -- 172.21.15.80:0/177898091 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d4121d20 con 0x7f72d4166a10 2019-11-28T11:45:08.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.662+0000 7f72d8806700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d4166a10 0x7f72d4168e10 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f72cc000d40 tx=0x7f72cc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:08.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.662+0000 7f72d17fa700 1 -- 172.21.15.80:0/177898091 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f72cc001230 con 0x7f72d4166a10 2019-11-28T11:45:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.834+0000 7f72d9a68700 1 -- 172.21.15.80:0/177898091 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72d41219a0 con 0x7f72d4166a10 2019-11-28T11:45:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.836+0000 7f72d8806700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d4166a10 0x7f72d4168e10 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f72cc000d40 tx=0x7f72cc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:08.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.836+0000 7f72d17fa700 1 -- 172.21.15.80:0/177898091 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f72cc001820 con 0x7f72d4166a10 2019-11-28T11:45:08.878 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:08.878 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":128,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:45:02.367501+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:44:59.649701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2019-11-28T11:45:00.387932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:45:08.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.839+0000 7f72d9a68700 1 -- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f72b80187a0 msgr2=0x7f72b801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:08.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.839+0000 7f72d9a68700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f72b80187a0 0x7f72b801abf0 crc :-1 s=READY pgs=691 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:08.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.839+0000 7f72d9a68700 1 -- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d4166a10 msgr2=0x7f72d4168e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:08.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.839+0000 7f72d9a68700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d4166a10 0x7f72d4168e10 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7f72cc000d40 tx=0x7f72cc010af0).stop 2019-11-28T11:45:08.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.839+0000 7f72d9a68700 1 -- 172.21.15.80:0/177898091 shutdown_connections 2019-11-28T11:45:08.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.839+0000 7f72d9a68700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72d4166a10 0x7f72d4168e10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:08.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.839+0000 7f72d9a68700 1 --2- 172.21.15.80:0/177898091 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f72b80187a0 0x7f72b801abf0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:08.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.839+0000 7f72d9a68700 1 -- 172.21.15.80:0/177898091 shutdown_connections 2019-11-28T11:45:08.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.839+0000 7f72d9a68700 1 -- 172.21.15.80:0/177898091 wait complete. 2019-11-28T11:45:08.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.839+0000 7f72d9a68700 1 -- 172.21.15.80:0/177898091 >> 172.21.15.80:0/177898091 conn(0x7f72d41426c0 msgr2=0x7f72d4110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:08.890 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:44:59.649701+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 20, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'127', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:45:00.387932+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 21, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'128', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:45:08.891 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:45:09.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.974+0000 7fde0403d700 1 Processor -- start 2019-11-28T11:45:09.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.974+0000 7fde0403d700 1 -- start start 2019-11-28T11:45:09.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.975+0000 7fde0403d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fddfc15ed10 0x7fddfc15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:09.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.975+0000 7fde0403d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fddfc0734b0 0x7fddfc0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:09.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.975+0000 7fde0403d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddfc06db60 con 0x7fddfc073020 2019-11-28T11:45:09.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.975+0000 7fde0403d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddfc06f3d0 con 0x7fddfc0734b0 2019-11-28T11:45:09.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.975+0000 7fde0403d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc06fe00 con 0x7fddfc15ed10 2019-11-28T11:45:09.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.975+0000 7fde025da700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fddfc15ed10 0x7fddfc15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.975+0000 7fde02ddb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fddfc0734b0 0x7fddfc0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.975+0000 7fde02ddb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fddfc0734b0 0x7fddfc0726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:54998/0 (socket says 172.21.15.80:54998) 2019-11-28T11:45:09.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.975+0000 7fde025da700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fddfc15ed10 0x7fddfc15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:42370/0 (socket says 172.21.15.80:42370) 2019-11-28T11:45:09.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.975+0000 7fde01dd9700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fddfc073020 0x7fddfc071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:54974/0 (socket says 172.21.15.80:54974) 2019-11-28T11:45:09.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.975+0000 7fde02ddb700 1 -- 172.21.15.80:0/2844525815 learned_addr learned my addr 172.21.15.80:0/2844525815 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:09.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde02ddb700 1 -- 172.21.15.80:0/2844525815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fddfc15ed10 msgr2=0x7fddfc15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:09.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde02ddb700 1 --2- 172.21.15.80:0/2844525815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fddfc15ed10 0x7fddfc15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:09.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde02ddb700 1 -- 172.21.15.80:0/2844525815 >> v1:172.21.15.174:6789/0 conn(0x7fddfc073020 legacy=0x7fddfc071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde015d8700 1 -- 172.21.15.80:0/2844525815 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90134385 0 0) 0x7fddec001070 con 0x7fddfc073020 2019-11-28T11:45:09.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde02ddb700 1 -- 172.21.15.80:0/2844525815 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc070760 con 0x7fddfc0734b0 2019-11-28T11:45:09.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde025da700 1 --2- 172.21.15.80:0/2844525815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fddfc15ed10 0x7fddfc15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:09.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde02ddb700 1 --2- 172.21.15.80:0/2844525815 >> v2:172.21.15.174:3300/0 conn(0x7fddfc0734b0 0x7fddfc0726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fddf400f760 tx=0x7fddf400fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde02ddb700 1 --2- 172.21.15.80:0/2844525815 >> v2:172.21.15.174:3300/0 conn(0x7fddfc0734b0 0x7fddfc0726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fddf400f760 tx=0x7fddf400fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde02ddb700 1 --2- 172.21.15.80:0/2844525815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddfc0734b0 0x7fddfc0726a0 secure :-1 s=READY pgs=998 cs=0 l=1 rx=0x7fddf400f760 tx=0x7fddf400fb00).ready entity=mon.1 client_cookie=8046ade43f6c3f07 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:09.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde02ddb700 1 --2- 172.21.15.80:0/2844525815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddfc0734b0 0x7fddfc0726a0 secure :-1 s=THROTTLE_DONE pgs=998 cs=0 l=1 rx=0x7fddf400f760 tx=0x7fddf400fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde015d8700 1 -- 172.21.15.80:0/2844525815 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddf4000a70 con 0x7fddfc0734b0 2019-11-28T11:45:09.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde02ddb700 1 --2- 172.21.15.80:0/2844525815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddfc0734b0 0x7fddfc0726a0 secure :-1 s=THROTTLE_DONE pgs=998 cs=0 l=1 rx=0x7fddf400f760 tx=0x7fddf400fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde015d8700 1 -- 172.21.15.80:0/2844525815 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4000e70 con 0x7fddfc0734b0 2019-11-28T11:45:09.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde02ddb700 1 --2- 172.21.15.80:0/2844525815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddfc0734b0 0x7fddfc0726a0 secure :-1 s=THROTTLE_DONE pgs=998 cs=0 l=1 rx=0x7fddf400f760 tx=0x7fddf400fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde015d8700 1 -- 172.21.15.80:0/2844525815 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddf4001060 con 0x7fddfc0734b0 2019-11-28T11:45:09.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde0403d700 1 -- 172.21.15.80:0/2844525815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddfc0734b0 msgr2=0x7fddfc0726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.976+0000 7fde0403d700 1 --2- 172.21.15.80:0/2844525815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddfc0734b0 0x7fddfc0726a0 secure :-1 s=READY pgs=998 cs=0 l=1 rx=0x7fddf400f760 tx=0x7fddf400fb00).stop 2019-11-28T11:45:09.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.977+0000 7fde0403d700 1 -- 172.21.15.80:0/2844525815 shutdown_connections 2019-11-28T11:45:09.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.977+0000 7fde0403d700 1 --2- 172.21.15.80:0/2844525815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddfc0734b0 0x7fddfc0726a0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.977+0000 7fde0403d700 1 --2- 172.21.15.80:0/2844525815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fddfc15ed10 0x7fddfc15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:09.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.977+0000 7fde0403d700 1 -- 172.21.15.80:0/2844525815 shutdown_connections 2019-11-28T11:45:09.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.977+0000 7fde0403d700 1 -- 172.21.15.80:0/2844525815 wait complete. 2019-11-28T11:45:09.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.977+0000 7fde0403d700 1 -- 172.21.15.80:0/2844525815 >> 172.21.15.80:0/2844525815 conn(0x7fddfc061d20 msgr2=0x7fddfc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:09.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.979+0000 7fde0403d700 1 Processor -- start 2019-11-28T11:45:09.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.979+0000 7fde0403d700 1 -- start start 2019-11-28T11:45:09.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.980+0000 7fde0403d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fddfc10e970 0x7fddfc1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:09.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.980+0000 7fde0403d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fddfc107e30 0x7fddfc167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:09.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.980+0000 7fde0403d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddfc10c250 con 0x7fddfc108cf0 2019-11-28T11:45:09.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.980+0000 7fde0403d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddfc10e430 con 0x7fddfc107e30 2019-11-28T11:45:09.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.980+0000 7fde0403d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddfc105860 con 0x7fddfc10e970 2019-11-28T11:45:09.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.980+0000 7fde02ddb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fddfc107e30 0x7fddfc167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.980+0000 7fde02ddb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fddfc107e30 0x7fddfc167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40118/0 (socket says 172.21.15.80:40118) 2019-11-28T11:45:09.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.980+0000 7fde02ddb700 1 -- 172.21.15.80:0/1815653037 learned_addr learned my addr 172.21.15.80:0/1815653037 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:09.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.980+0000 7fde025da700 1 --2- 172.21.15.80:0/1815653037 >> v2:172.21.15.174:3300/0 conn(0x7fddfc10e970 0x7fddfc1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.981+0000 7fde02ddb700 1 -- 172.21.15.80:0/1815653037 >> v2:172.21.15.174:3300/0 conn(0x7fddfc10e970 msgr2=0x7fddfc1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.981+0000 7fde02ddb700 1 --2- 172.21.15.80:0/1815653037 >> v2:172.21.15.174:3300/0 conn(0x7fddfc10e970 0x7fddfc1087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.981+0000 7fde02ddb700 1 -- 172.21.15.80:0/1815653037 >> v1:172.21.15.80:6789/0 conn(0x7fddfc108cf0 legacy=0x7fddfc107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.981+0000 7fde02ddb700 1 -- 172.21.15.80:0/1815653037 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc105ef0 con 0x7fddfc107e30 2019-11-28T11:45:09.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.981+0000 7fde02ddb700 1 --2- 172.21.15.80:0/1815653037 >> v2:172.21.15.80:3300/0 conn(0x7fddfc107e30 0x7fddfc167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fddf40544c0 tx=0x7fddf4007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.981+0000 7fde02ddb700 1 --2- 172.21.15.80:0/1815653037 >> v2:172.21.15.80:3300/0 conn(0x7fddfc107e30 0x7fddfc167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fddf40544c0 tx=0x7fddf4007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.981+0000 7fde02ddb700 1 --2- 172.21.15.80:0/1815653037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc107e30 0x7fddfc167d70 secure :-1 s=READY pgs=1710 cs=0 l=1 rx=0x7fddf40544c0 tx=0x7fddf4007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:09.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.981+0000 7fde02ddb700 1 --2- 172.21.15.80:0/1815653037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc107e30 0x7fddfc167d70 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7fddf40544c0 tx=0x7fddf4007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.981+0000 7fddfaffd700 1 -- 172.21.15.80:0/1815653037 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddf4000c60 con 0x7fddfc107e30 2019-11-28T11:45:09.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.981+0000 7fde02ddb700 1 --2- 172.21.15.80:0/1815653037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc107e30 0x7fddfc167d70 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7fddf40544c0 tx=0x7fddf4007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.981+0000 7fde02ddb700 1 --2- 172.21.15.80:0/1815653037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc107e30 0x7fddfc167d70 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7fddf40544c0 tx=0x7fddf4007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.981+0000 7fddfaffd700 1 -- 172.21.15.80:0/1815653037 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4007680 con 0x7fddfc107e30 2019-11-28T11:45:09.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.981+0000 7fde0403d700 1 -- 172.21.15.80:0/1815653037 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddfc106270 con 0x7fddfc107e30 2019-11-28T11:45:09.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.981+0000 7fddfaffd700 1 -- 172.21.15.80:0/1815653037 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddf4001240 con 0x7fddfc107e30 2019-11-28T11:45:09.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.981+0000 7fde0403d700 1 -- 172.21.15.80:0/1815653037 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc105ef0 con 0x7fddfc107e30 2019-11-28T11:45:09.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.981+0000 7fde02ddb700 1 --2- 172.21.15.80:0/1815653037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc107e30 0x7fddfc167d70 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7fddf40544c0 tx=0x7fddf4007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.982+0000 7fddfaffd700 1 -- 172.21.15.80:0/1815653037 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fddf4000a70 con 0x7fddfc107e30 2019-11-28T11:45:09.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.982+0000 7fde02ddb700 1 --2- 172.21.15.80:0/1815653037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc107e30 0x7fddfc167d70 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7fddf40544c0 tx=0x7fddf4007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.982+0000 7fddfaffd700 1 --2- 172.21.15.80:0/1815653037 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdde0018730 0x7fdde001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:09.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.982+0000 7fddfaffd700 1 -- 172.21.15.80:0/1815653037 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fddf4075d80 con 0x7fddfc107e30 2019-11-28T11:45:09.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.982+0000 7fde025da700 1 --2- 172.21.15.80:0/1815653037 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdde0018730 0x7fdde001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.982+0000 7fde025da700 1 --2- 172.21.15.80:0/1815653037 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdde0018730 0x7fdde001abc0 crc :-1 s=READY pgs=692 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:09.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.989+0000 7fde0403d700 1 -- 172.21.15.80:0/1815653037 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddfc106270 con 0x7fddfc107e30 2019-11-28T11:45:09.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.992+0000 7fde02ddb700 1 --2- 172.21.15.80:0/1815653037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc107e30 0x7fddfc167d70 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7fddf40544c0 tx=0x7fddf4007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:08.993+0000 7fddfaffd700 1 -- 172.21.15.80:0/1815653037 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fddf4007df0 con 0x7fddfc107e30 2019-11-28T11:45:09.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.161+0000 7fde0403d700 1 -- 172.21.15.80:0/1815653037 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fddfc105ef0 con 0x7fddfc107e30 2019-11-28T11:45:09.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.161+0000 7fde02ddb700 1 --2- 172.21.15.80:0/1815653037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc107e30 0x7fddfc167d70 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7fddf40544c0 tx=0x7fddf4007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.161+0000 7fddfaffd700 1 -- 172.21.15.80:0/1815653037 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v128) v1 ==== 92+0+10 (secure 0 0 0) 0x7fddf405b4b0 con 0x7fddfc107e30 2019-11-28T11:45:09.202 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:45:09.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.164+0000 7fde0403d700 1 -- 172.21.15.80:0/1815653037 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdde0018730 msgr2=0x7fdde001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.164+0000 7fde0403d700 1 --2- 172.21.15.80:0/1815653037 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdde0018730 0x7fdde001abc0 crc :-1 s=READY pgs=692 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.164+0000 7fde0403d700 1 -- 172.21.15.80:0/1815653037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc107e30 msgr2=0x7fddfc167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.164+0000 7fde0403d700 1 --2- 172.21.15.80:0/1815653037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc107e30 0x7fddfc167d70 secure :-1 s=READY pgs=1710 cs=0 l=1 rx=0x7fddf40544c0 tx=0x7fddf4007d00).stop 2019-11-28T11:45:09.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.164+0000 7fde0403d700 1 -- 172.21.15.80:0/1815653037 shutdown_connections 2019-11-28T11:45:09.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.164+0000 7fde0403d700 1 --2- 172.21.15.80:0/1815653037 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdde0018730 0x7fdde001abc0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.164+0000 7fde0403d700 1 --2- 172.21.15.80:0/1815653037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc107e30 0x7fddfc167d70 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.164+0000 7fde0403d700 1 --2- 172.21.15.80:0/1815653037 >> v2:172.21.15.174:3300/0 conn(0x7fddfc10e970 0x7fddfc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.164+0000 7fde0403d700 1 -- 172.21.15.80:0/1815653037 shutdown_connections 2019-11-28T11:45:09.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.164+0000 7fde0403d700 1 -- 172.21.15.80:0/1815653037 wait complete. 2019-11-28T11:45:09.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.164+0000 7fde0403d700 1 -- 172.21.15.80:0/1815653037 >> 172.21.15.80:0/1815653037 conn(0x7fddfc15e2d0 msgr2=0x7fddfc147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:09.214 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:45:09.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.298+0000 7f246eca4700 1 Processor -- start 2019-11-28T11:45:09.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.299+0000 7f246eca4700 1 -- start start 2019-11-28T11:45:09.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246eca4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f246815ed10 0x7f246815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:09.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246eca4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2468073020 0x7f2468071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:09.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246eca4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246806db60 con 0x7f24680734b0 2019-11-28T11:45:09.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246eca4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246806fe00 con 0x7f246815ed10 2019-11-28T11:45:09.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246eca4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24680700d0 con 0x7f2468073020 2019-11-28T11:45:09.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246d241700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f246815ed10 0x7f246815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246da42700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f24680734b0 0x7f24680723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39440/0 (socket says 172.21.15.80:39440) 2019-11-28T11:45:09.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246da42700 1 -- 172.21.15.80:0/2646549801 learned_addr learned my addr 172.21.15.80:0/2646549801 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:09.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246ca40700 1 --2- 172.21.15.80:0/2646549801 >> v2:172.21.15.174:3300/0 conn(0x7f2468073020 0x7f2468071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246d241700 1 -- 172.21.15.80:0/2646549801 >> v2:172.21.15.174:3300/0 conn(0x7f2468073020 msgr2=0x7f2468071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:09.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246d241700 1 --2- 172.21.15.80:0/2646549801 >> v2:172.21.15.174:3300/0 conn(0x7f2468073020 0x7f2468071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:09.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246d241700 1 -- 172.21.15.80:0/2646549801 >> v1:172.21.15.80:6789/0 conn(0x7f24680734b0 legacy=0x7f24680723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f2467fff700 1 -- 172.21.15.80:0/2646549801 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287606422 0 0) 0x7f2460001100 con 0x7f24680734b0 2019-11-28T11:45:09.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246d241700 1 -- 172.21.15.80:0/2646549801 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2468070760 con 0x7f246815ed10 2019-11-28T11:45:09.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246d241700 1 --2- 172.21.15.80:0/2646549801 >> v2:172.21.15.80:3300/0 conn(0x7f246815ed10 0x7f246815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f245800af50 tx=0x7f245800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246d241700 1 --2- 172.21.15.80:0/2646549801 >> v2:172.21.15.80:3300/0 conn(0x7f246815ed10 0x7f246815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f245800af50 tx=0x7f245800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246d241700 1 --2- 172.21.15.80:0/2646549801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815ed10 0x7f246815f100 secure :-1 s=READY pgs=1712 cs=0 l=1 rx=0x7f245800af50 tx=0x7f245800b6e0).ready entity=mon.0 client_cookie=66e86174290c3955 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:09.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246d241700 1 --2- 172.21.15.80:0/2646549801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815ed10 0x7f246815f100 secure :-1 s=THROTTLE_DONE pgs=1712 cs=0 l=1 rx=0x7f245800af50 tx=0x7f245800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f2467fff700 1 -- 172.21.15.80:0/2646549801 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2458007210 con 0x7f246815ed10 2019-11-28T11:45:09.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246d241700 1 --2- 172.21.15.80:0/2646549801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815ed10 0x7f246815f100 secure :-1 s=THROTTLE_DONE pgs=1712 cs=0 l=1 rx=0x7f245800af50 tx=0x7f245800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f2467fff700 1 -- 172.21.15.80:0/2646549801 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24580099b0 con 0x7f246815ed10 2019-11-28T11:45:09.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246d241700 1 --2- 172.21.15.80:0/2646549801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815ed10 0x7f246815f100 secure :-1 s=THROTTLE_DONE pgs=1712 cs=0 l=1 rx=0x7f245800af50 tx=0x7f245800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f2467fff700 1 -- 172.21.15.80:0/2646549801 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2458009ba0 con 0x7f246815ed10 2019-11-28T11:45:09.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246eca4700 1 -- 172.21.15.80:0/2646549801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815ed10 msgr2=0x7f246815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.300+0000 7f246eca4700 1 --2- 172.21.15.80:0/2646549801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815ed10 0x7f246815f100 secure :-1 s=READY pgs=1712 cs=0 l=1 rx=0x7f245800af50 tx=0x7f245800b6e0).stop 2019-11-28T11:45:09.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.301+0000 7f246eca4700 1 -- 172.21.15.80:0/2646549801 shutdown_connections 2019-11-28T11:45:09.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.301+0000 7f246eca4700 1 --2- 172.21.15.80:0/2646549801 >> v2:172.21.15.174:3300/0 conn(0x7f2468073020 0x7f2468071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:09.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.301+0000 7f246eca4700 1 --2- 172.21.15.80:0/2646549801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815ed10 0x7f246815f100 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.301+0000 7f246eca4700 1 -- 172.21.15.80:0/2646549801 shutdown_connections 2019-11-28T11:45:09.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.301+0000 7f246eca4700 1 -- 172.21.15.80:0/2646549801 wait complete. 2019-11-28T11:45:09.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.301+0000 7f246eca4700 1 -- 172.21.15.80:0/2646549801 >> 172.21.15.80:0/2646549801 conn(0x7f2468061d20 msgr2=0x7f24680641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:09.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.304+0000 7f246eca4700 1 Processor -- start 2019-11-28T11:45:09.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.304+0000 7f246eca4700 1 -- start start 2019-11-28T11:45:09.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246eca4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f246815f800 0x7f2468156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:09.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246eca4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2468155860 0x7f246812d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:09.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246eca4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246815cb50 con 0x7f24681566b0 2019-11-28T11:45:09.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246eca4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2468102e00 con 0x7f246815f800 2019-11-28T11:45:09.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246eca4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24681030d0 con 0x7f2468155860 2019-11-28T11:45:09.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246d241700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f246815f800 0x7f2468156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246d241700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f246815f800 0x7f2468156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40128/0 (socket says 172.21.15.80:40128) 2019-11-28T11:45:09.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246d241700 1 -- 172.21.15.80:0/3914841444 learned_addr learned my addr 172.21.15.80:0/3914841444 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:09.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246da42700 1 --2- 172.21.15.80:0/3914841444 >> v2:172.21.15.174:3300/0 conn(0x7f2468155860 0x7f246812d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246d241700 1 -- 172.21.15.80:0/3914841444 >> v2:172.21.15.174:3300/0 conn(0x7f2468155860 msgr2=0x7f246812d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246d241700 1 --2- 172.21.15.80:0/3914841444 >> v2:172.21.15.174:3300/0 conn(0x7f2468155860 0x7f246812d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246d241700 1 -- 172.21.15.80:0/3914841444 >> v1:172.21.15.80:6789/0 conn(0x7f24681566b0 legacy=0x7f2468155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246d241700 1 -- 172.21.15.80:0/3914841444 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2468103760 con 0x7f246815f800 2019-11-28T11:45:09.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246d241700 1 --2- 172.21.15.80:0/3914841444 >> v2:172.21.15.80:3300/0 conn(0x7f246815f800 0x7f2468156170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2458010480 tx=0x7f24580102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246d241700 1 --2- 172.21.15.80:0/3914841444 >> v2:172.21.15.80:3300/0 conn(0x7f246815f800 0x7f2468156170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2458010480 tx=0x7f24580102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246d241700 1 --2- 172.21.15.80:0/3914841444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815f800 0x7f2468156170 secure :-1 s=READY pgs=1714 cs=0 l=1 rx=0x7f2458010480 tx=0x7f24580102b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:09.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246d241700 1 --2- 172.21.15.80:0/3914841444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815f800 0x7f2468156170 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f2458010480 tx=0x7f24580102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f2465ffb700 1 -- 172.21.15.80:0/3914841444 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2458009960 con 0x7f246815f800 2019-11-28T11:45:09.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246d241700 1 --2- 172.21.15.80:0/3914841444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815f800 0x7f2468156170 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f2458010480 tx=0x7f24580102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246d241700 1 --2- 172.21.15.80:0/3914841444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815f800 0x7f2468156170 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f2458010480 tx=0x7f24580102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f2465ffb700 1 -- 172.21.15.80:0/3914841444 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2458009580 con 0x7f246815f800 2019-11-28T11:45:09.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246eca4700 1 -- 172.21.15.80:0/3914841444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2468103ae0 con 0x7f246815f800 2019-11-28T11:45:09.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f2465ffb700 1 -- 172.21.15.80:0/3914841444 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2458009f40 con 0x7f246815f800 2019-11-28T11:45:09.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.305+0000 7f246eca4700 1 -- 172.21.15.80:0/3914841444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2468104bc0 con 0x7f246815f800 2019-11-28T11:45:09.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.306+0000 7f246d241700 1 --2- 172.21.15.80:0/3914841444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815f800 0x7f2468156170 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f2458010480 tx=0x7f24580102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.306+0000 7f2465ffb700 1 -- 172.21.15.80:0/3914841444 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2458009770 con 0x7f246815f800 2019-11-28T11:45:09.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.306+0000 7f246d241700 1 --2- 172.21.15.80:0/3914841444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815f800 0x7f2468156170 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f2458010480 tx=0x7f24580102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.306+0000 7f2465ffb700 1 --2- 172.21.15.80:0/3914841444 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f244c018730 0x7f244c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:09.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.306+0000 7f2465ffb700 1 -- 172.21.15.80:0/3914841444 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2458031b70 con 0x7f246815f800 2019-11-28T11:45:09.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.306+0000 7f246ca40700 1 --2- 172.21.15.80:0/3914841444 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f244c018730 0x7f244c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.307+0000 7f246ca40700 1 --2- 172.21.15.80:0/3914841444 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f244c018730 0x7f244c01abc0 crc :-1 s=READY pgs=693 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:09.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.314+0000 7f246eca4700 1 -- 172.21.15.80:0/3914841444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2468103760 con 0x7f246815f800 2019-11-28T11:45:09.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.317+0000 7f246d241700 1 --2- 172.21.15.80:0/3914841444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815f800 0x7f2468156170 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f2458010480 tx=0x7f24580102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.317+0000 7f2465ffb700 1 -- 172.21.15.80:0/3914841444 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f245800a930 con 0x7f246815f800 2019-11-28T11:45:09.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.488+0000 7f246eca4700 1 -- 172.21.15.80:0/3914841444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f2468103ae0 con 0x7f246815f800 2019-11-28T11:45:09.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.488+0000 7f246d241700 1 --2- 172.21.15.80:0/3914841444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815f800 0x7f2468156170 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f2458010480 tx=0x7f24580102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.488+0000 7f2465ffb700 1 -- 172.21.15.80:0/3914841444 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v128) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2458009750 con 0x7f246815f800 2019-11-28T11:45:09.529 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.490+0000 7f246eca4700 1 -- 172.21.15.80:0/3914841444 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f244c018730 msgr2=0x7f244c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.490+0000 7f246eca4700 1 --2- 172.21.15.80:0/3914841444 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f244c018730 0x7f244c01abc0 crc :-1 s=READY pgs=693 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.490+0000 7f246eca4700 1 -- 172.21.15.80:0/3914841444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815f800 msgr2=0x7f2468156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.490+0000 7f246eca4700 1 --2- 172.21.15.80:0/3914841444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815f800 0x7f2468156170 secure :-1 s=READY pgs=1714 cs=0 l=1 rx=0x7f2458010480 tx=0x7f24580102b0).stop 2019-11-28T11:45:09.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.491+0000 7f246eca4700 1 -- 172.21.15.80:0/3914841444 shutdown_connections 2019-11-28T11:45:09.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.491+0000 7f246eca4700 1 --2- 172.21.15.80:0/3914841444 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f244c018730 0x7f244c01abc0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.491+0000 7f246eca4700 1 --2- 172.21.15.80:0/3914841444 >> v2:172.21.15.174:3300/0 conn(0x7f2468155860 0x7f246812d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.491+0000 7f246eca4700 1 --2- 172.21.15.80:0/3914841444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f246815f800 0x7f2468156170 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.491+0000 7f246eca4700 1 -- 172.21.15.80:0/3914841444 shutdown_connections 2019-11-28T11:45:09.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.491+0000 7f246eca4700 1 -- 172.21.15.80:0/3914841444 wait complete. 2019-11-28T11:45:09.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.491+0000 7f246eca4700 1 -- 172.21.15.80:0/3914841444 >> 172.21.15.80:0/3914841444 conn(0x7f246807c4f0 msgr2=0x7f246815ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:09.541 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:45:09.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.624+0000 7f99dee9f700 1 Processor -- start 2019-11-28T11:45:09.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.624+0000 7f99dee9f700 1 -- start start 2019-11-28T11:45:09.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.625+0000 7f99dee9f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f99d815ed10 0x7f99d815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:09.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.625+0000 7f99dee9f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d8073020 0x7f99d8071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:09.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.625+0000 7f99dee9f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99d80734b0 0x7f99d80723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:09.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.625+0000 7f99dee9f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d806fe00 con 0x7f99d80734b0 2019-11-28T11:45:09.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.625+0000 7f99dee9f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d80700d0 con 0x7f99d815ed10 2019-11-28T11:45:09.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.625+0000 7f99dee9f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d806f3d0 con 0x7f99d8073020 2019-11-28T11:45:09.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99ddc3d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99d80734b0 0x7f99d80723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99ddc3d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99d80734b0 0x7f99d80723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40142/0 (socket says 172.21.15.80:40142) 2019-11-28T11:45:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99ddc3d700 1 -- 172.21.15.80:0/101624148 learned_addr learned my addr 172.21.15.80:0/101624148 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:09.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99dcc3b700 1 --2- 172.21.15.80:0/101624148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d8073020 0x7f99d8071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99dd43c700 1 --2- 172.21.15.80:0/101624148 >> v2:172.21.15.174:3300/0 conn(0x7f99d815ed10 0x7f99d815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99ddc3d700 1 -- 172.21.15.80:0/101624148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d8073020 msgr2=0x7f99d8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:09.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99ddc3d700 1 --2- 172.21.15.80:0/101624148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d8073020 0x7f99d8071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:09.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99ddc3d700 1 -- 172.21.15.80:0/101624148 >> v2:172.21.15.174:3300/0 conn(0x7f99d815ed10 msgr2=0x7f99d815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:09.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99ddc3d700 1 --2- 172.21.15.80:0/101624148 >> v2:172.21.15.174:3300/0 conn(0x7f99d815ed10 0x7f99d815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:09.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99ddc3d700 1 -- 172.21.15.80:0/101624148 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d8070760 con 0x7f99d80734b0 2019-11-28T11:45:09.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99ddc3d700 1 --2- 172.21.15.80:0/101624148 >> v2:172.21.15.80:3300/0 conn(0x7f99d80734b0 0x7f99d80723e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f99d000f6b0 tx=0x7f99d0007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99ddc3d700 1 --2- 172.21.15.80:0/101624148 >> v2:172.21.15.80:3300/0 conn(0x7f99d80734b0 0x7f99d80723e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f99d000f6b0 tx=0x7f99d0007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99ddc3d700 1 --2- 172.21.15.80:0/101624148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99d80734b0 0x7f99d80723e0 secure :-1 s=READY pgs=1715 cs=0 l=1 rx=0x7f99d000f6b0 tx=0x7f99d0007d50).ready entity=mon.0 client_cookie=7befc84b06d00e0d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:09.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99ddc3d700 1 --2- 172.21.15.80:0/101624148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99d80734b0 0x7f99d80723e0 secure :-1 s=THROTTLE_DONE pgs=1715 cs=0 l=1 rx=0x7f99d000f6b0 tx=0x7f99d0007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99d7fff700 1 -- 172.21.15.80:0/101624148 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99d0000a70 con 0x7f99d80734b0 2019-11-28T11:45:09.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99ddc3d700 1 --2- 172.21.15.80:0/101624148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99d80734b0 0x7f99d80723e0 secure :-1 s=THROTTLE_DONE pgs=1715 cs=0 l=1 rx=0x7f99d000f6b0 tx=0x7f99d0007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99ddc3d700 1 --2- 172.21.15.80:0/101624148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99d80734b0 0x7f99d80723e0 secure :-1 s=THROTTLE_DONE pgs=1715 cs=0 l=1 rx=0x7f99d000f6b0 tx=0x7f99d0007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99d7fff700 1 -- 172.21.15.80:0/101624148 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d00010e0 con 0x7f99d80734b0 2019-11-28T11:45:09.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99d7fff700 1 -- 172.21.15.80:0/101624148 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99d00012d0 con 0x7f99d80734b0 2019-11-28T11:45:09.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99dee9f700 1 -- 172.21.15.80:0/101624148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99d80734b0 msgr2=0x7f99d80723e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.626+0000 7f99dee9f700 1 --2- 172.21.15.80:0/101624148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99d80734b0 0x7f99d80723e0 secure :-1 s=READY pgs=1715 cs=0 l=1 rx=0x7f99d000f6b0 tx=0x7f99d0007d50).stop 2019-11-28T11:45:09.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.627+0000 7f99dee9f700 1 -- 172.21.15.80:0/101624148 shutdown_connections 2019-11-28T11:45:09.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.627+0000 7f99dee9f700 1 --2- 172.21.15.80:0/101624148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99d80734b0 0x7f99d80723e0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.627+0000 7f99dee9f700 1 --2- 172.21.15.80:0/101624148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d8073020 0x7f99d8071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:09.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.627+0000 7f99dee9f700 1 --2- 172.21.15.80:0/101624148 >> v2:172.21.15.174:3300/0 conn(0x7f99d815ed10 0x7f99d815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:09.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.627+0000 7f99dee9f700 1 -- 172.21.15.80:0/101624148 shutdown_connections 2019-11-28T11:45:09.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.627+0000 7f99dee9f700 1 -- 172.21.15.80:0/101624148 wait complete. 2019-11-28T11:45:09.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.627+0000 7f99dee9f700 1 -- 172.21.15.80:0/101624148 >> 172.21.15.80:0/101624148 conn(0x7f99d8061d20 msgr2=0x7f99d80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.630+0000 7f99dee9f700 1 Processor -- start 2019-11-28T11:45:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.630+0000 7f99dee9f700 1 -- start start 2019-11-28T11:45:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99dee9f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d810f9f0 0x7f99d8168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:09.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99dee9f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d810c250 con 0x7f99d810e970 2019-11-28T11:45:09.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99dee9f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d810fe60 con 0x7f99d810ed60 2019-11-28T11:45:09.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99dee9f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d810e430 con 0x7f99d810f9f0 2019-11-28T11:45:09.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99dd43c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f99d810e970 0x7f99d81087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39462/0 (socket says 172.21.15.80:39462) 2019-11-28T11:45:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99dd43c700 1 -- 172.21.15.80:0/3250992252 learned_addr learned my addr 172.21.15.80:0/3250992252 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883801264 0 0) 0x7f99c80010b0 con 0x7f99d810e970 2019-11-28T11:45:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99ddc3d700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d810f9f0 0x7f99d8168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99bc002e80 con 0x7f99d810e970 2019-11-28T11:45:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1063308875 0 0) 0x7f99c80012b0 con 0x7f99d810e970 2019-11-28T11:45:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f99bc0032e0 con 0x7f99d810e970 2019-11-28T11:45:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f99c8001880 con 0x7f99d810e970 2019-11-28T11:45:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d810f9f0 msgr2=0x7f99d8168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99d5ffb700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d810f9f0 0x7f99d8168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 >> v1:172.21.15.174:6789/0 conn(0x7f99d810ed60 legacy=0x7f99d810f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 >> v1:172.21.15.80:6789/0 conn(0x7f99d810e970 legacy=0x7f99d81087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99d5ffb700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99bc003330 0x7f99bc003740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:09.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99d5ffb700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99bc003c80 0x7f99bc004140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:09.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99d5ffb700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99bc0048a0 0x7f99bc004d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:09.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc00bbf0 con 0x7f99bc003c80 2019-11-28T11:45:09.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc00bde0 con 0x7f99bc0048a0 2019-11-28T11:45:09.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc00c010 con 0x7f99bc003330 2019-11-28T11:45:09.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99dcc3b700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99bc003c80 0x7f99bc004140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.631+0000 7f99dd43c700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99bc003330 0x7f99bc003740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99ddc3d700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99bc0048a0 0x7f99bc004d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99dcc3b700 1 -- 172.21.15.80:0/3250992252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99bc003330 msgr2=0x7f99bc003740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99dcc3b700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99bc003330 0x7f99bc003740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99dcc3b700 1 -- 172.21.15.80:0/3250992252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99bc0048a0 msgr2=0x7f99bc004d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99dcc3b700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99bc0048a0 0x7f99bc004d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99dcc3b700 1 -- 172.21.15.80:0/3250992252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc00c2c0 con 0x7f99bc003c80 2019-11-28T11:45:09.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99dee9f700 1 -- 172.21.15.80:0/3250992252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d8106270 con 0x7f99bc003c80 2019-11-28T11:45:09.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99dcc3b700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99bc003c80 0x7f99bc004140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f99c0010740 tx=0x7f99c00105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99dee9f700 1 -- 172.21.15.80:0/3250992252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d8105ef0 con 0x7f99bc003c80 2019-11-28T11:45:09.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99dcc3b700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99bc003c80 0x7f99bc004140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f99c0010740 tx=0x7f99c00105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99dcc3b700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99bc003c80 0x7f99bc004140 secure :-1 s=READY pgs=1717 cs=0 l=1 rx=0x7f99c0010740 tx=0x7f99c00105c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:09.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99dcc3b700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99bc003c80 0x7f99bc004140 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f99c0010740 tx=0x7f99c00105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99c0009900 con 0x7f99bc003c80 2019-11-28T11:45:09.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99dcc3b700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99bc003c80 0x7f99bc004140 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f99c0010740 tx=0x7f99c00105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99dcc3b700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99bc003c80 0x7f99bc004140 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f99c0010740 tx=0x7f99c00105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c000a000 con 0x7f99bc003c80 2019-11-28T11:45:09.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99c0009900 con 0x7f99bc003c80 2019-11-28T11:45:09.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.632+0000 7f99dcc3b700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99bc003c80 0x7f99bc004140 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f99c0010740 tx=0x7f99c00105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.633+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f99c0009900 con 0x7f99bc003c80 2019-11-28T11:45:09.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.633+0000 7f99dcc3b700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99bc003c80 0x7f99bc004140 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f99c0010740 tx=0x7f99c00105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.633+0000 7f99d5ffb700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f99bc020bf0 0x7f99bc023020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:09.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.633+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f99c0031cb0 con 0x7f99bc003c80 2019-11-28T11:45:09.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.633+0000 7f99dd43c700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f99bc020bf0 0x7f99bc023020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.633+0000 7f99dd43c700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f99bc020bf0 0x7f99bc023020 crc :-1 s=READY pgs=696 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:09.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.639+0000 7f99dee9f700 1 -- 172.21.15.80:0/3250992252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b0002e60 con 0x7f99bc003c80 2019-11-28T11:45:09.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.643+0000 7f99dcc3b700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99bc003c80 0x7f99bc004140 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f99c0010740 tx=0x7f99c00105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.643+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f99c0029f50 con 0x7f99bc003c80 2019-11-28T11:45:09.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.811+0000 7f99dee9f700 1 -- 172.21.15.80:0/3250992252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f99b0001d30 con 0x7f99bc003c80 2019-11-28T11:45:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.812+0000 7f99dcc3b700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99bc003c80 0x7f99bc004140 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f99c0010740 tx=0x7f99c00105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:09.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.812+0000 7f99d5ffb700 1 -- 172.21.15.80:0/3250992252 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v128) v1 ==== 100+0+10 (secure 0 0 0) 0x7f99c0029f50 con 0x7f99bc003c80 2019-11-28T11:45:09.852 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:45:09.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.814+0000 7f99dee9f700 1 -- 172.21.15.80:0/3250992252 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f99bc020bf0 msgr2=0x7f99bc023020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.814+0000 7f99dee9f700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f99bc020bf0 0x7f99bc023020 crc :-1 s=READY pgs=696 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.814+0000 7f99dee9f700 1 -- 172.21.15.80:0/3250992252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99bc003c80 msgr2=0x7f99bc004140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.814+0000 7f99dee9f700 1 --2- 172.21.15.80:0/3250992252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99bc003c80 0x7f99bc004140 secure :-1 s=READY pgs=1717 cs=0 l=1 rx=0x7f99c0010740 tx=0x7f99c00105c0).stop 2019-11-28T11:45:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.814+0000 7f99ddc3d700 1 -- 172.21.15.80:0/3250992252 reap_dead start 2019-11-28T11:45:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.814+0000 7f99ddc3d700 1 -- 172.21.15.80:0/3250992252 reap_dead start 2019-11-28T11:45:09.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.814+0000 7f99dee9f700 1 -- 172.21.15.80:0/3250992252 shutdown_connections 2019-11-28T11:45:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.814+0000 7f99dee9f700 1 -- 172.21.15.80:0/3250992252 shutdown_connections 2019-11-28T11:45:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.814+0000 7f99dee9f700 1 -- 172.21.15.80:0/3250992252 wait complete. 2019-11-28T11:45:09.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.814+0000 7f99dee9f700 1 -- 172.21.15.80:0/3250992252 >> 172.21.15.80:0/3250992252 conn(0x7f99d815e2d0 msgr2=0x7f99d8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:09.866 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:45:09.867 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:09.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.946+0000 7f5400ab4700 1 Processor -- start 2019-11-28T11:45:09.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.946+0000 7f5400ab4700 1 -- start start 2019-11-28T11:45:09.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.947+0000 7f5400ab4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f53fc06c0a0 0x7f53fc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:09.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.947+0000 7f5400ab4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53fc072620 0x7f53fc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:09.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.947+0000 7f5400ab4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53fc06db00 con 0x7f53fc0734e0 2019-11-28T11:45:09.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.947+0000 7f5400ab4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53fc06fd60 con 0x7f53fc072620 2019-11-28T11:45:09.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.947+0000 7f5400ab4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53fc070030 con 0x7f53fc06c0a0 2019-11-28T11:45:09.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53fb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53fc072620 0x7f53fc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53fa59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f53fc0734e0 0x7f53fc071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39480/0 (socket says 172.21.15.80:39480) 2019-11-28T11:45:09.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53fa59c700 1 -- 172.21.15.80:0/1564772823 learned_addr learned my addr 172.21.15.80:0/1564772823 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:09.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53fad9d700 1 --2- 172.21.15.80:0/1564772823 >> v2:172.21.15.174:3300/0 conn(0x7f53fc06c0a0 0x7f53fc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:09.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53fb59e700 1 -- 172.21.15.80:0/1564772823 >> v2:172.21.15.174:3300/0 conn(0x7f53fc06c0a0 msgr2=0x7f53fc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:09.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53fb59e700 1 --2- 172.21.15.80:0/1564772823 >> v2:172.21.15.174:3300/0 conn(0x7f53fc06c0a0 0x7f53fc072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53fb59e700 1 -- 172.21.15.80:0/1564772823 >> v1:172.21.15.80:6789/0 conn(0x7f53fc0734e0 legacy=0x7f53fc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53f9d9b700 1 -- 172.21.15.80:0/1564772823 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129022496 0 0) 0x7f53ec001070 con 0x7f53fc0734e0 2019-11-28T11:45:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53fb59e700 1 -- 172.21.15.80:0/1564772823 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc0706c0 con 0x7f53fc072620 2019-11-28T11:45:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53fad9d700 1 --2- 172.21.15.80:0/1564772823 >> v2:172.21.15.174:3300/0 conn(0x7f53fc06c0a0 0x7f53fc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53fb59e700 1 --2- 172.21.15.80:0/1564772823 >> v2:172.21.15.80:3300/0 conn(0x7f53fc072620 0x7f53fc164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f53f400af50 tx=0x7f53f400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53fb59e700 1 --2- 172.21.15.80:0/1564772823 >> v2:172.21.15.80:3300/0 conn(0x7f53fc072620 0x7f53fc164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f53f400af50 tx=0x7f53f400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53fb59e700 1 --2- 172.21.15.80:0/1564772823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc072620 0x7f53fc164d70 secure :-1 s=READY pgs=1719 cs=0 l=1 rx=0x7f53f400af50 tx=0x7f53f400b760).ready entity=mon.0 client_cookie=e4cb32fc1dd76daa server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:10.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53fb59e700 1 --2- 172.21.15.80:0/1564772823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc072620 0x7f53fc164d70 secure :-1 s=THROTTLE_DONE pgs=1719 cs=0 l=1 rx=0x7f53f400af50 tx=0x7f53f400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:10.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53f9d9b700 1 -- 172.21.15.80:0/1564772823 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53f4009ba0 con 0x7f53fc072620 2019-11-28T11:45:10.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53fb59e700 1 --2- 172.21.15.80:0/1564772823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc072620 0x7f53fc164d70 secure :-1 s=THROTTLE_DONE pgs=1719 cs=0 l=1 rx=0x7f53f400af50 tx=0x7f53f400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:10.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53f9d9b700 1 -- 172.21.15.80:0/1564772823 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f4000bc0 con 0x7f53fc072620 2019-11-28T11:45:10.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53fb59e700 1 --2- 172.21.15.80:0/1564772823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc072620 0x7f53fc164d70 secure :-1 s=THROTTLE_DONE pgs=1719 cs=0 l=1 rx=0x7f53f400af50 tx=0x7f53f400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:10.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f53f9d9b700 1 -- 172.21.15.80:0/1564772823 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53f4009ba0 con 0x7f53fc072620 2019-11-28T11:45:10.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f5400ab4700 1 -- 172.21.15.80:0/1564772823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc072620 msgr2=0x7f53fc164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:10.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.948+0000 7f5400ab4700 1 --2- 172.21.15.80:0/1564772823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc072620 0x7f53fc164d70 secure :-1 s=READY pgs=1719 cs=0 l=1 rx=0x7f53f400af50 tx=0x7f53f400b760).stop 2019-11-28T11:45:10.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.949+0000 7f5400ab4700 1 -- 172.21.15.80:0/1564772823 shutdown_connections 2019-11-28T11:45:10.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.949+0000 7f5400ab4700 1 --2- 172.21.15.80:0/1564772823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc072620 0x7f53fc164d70 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:10.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.949+0000 7f5400ab4700 1 --2- 172.21.15.80:0/1564772823 >> v2:172.21.15.174:3300/0 conn(0x7f53fc06c0a0 0x7f53fc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:10.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.949+0000 7f5400ab4700 1 -- 172.21.15.80:0/1564772823 shutdown_connections 2019-11-28T11:45:10.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.949+0000 7f5400ab4700 1 -- 172.21.15.80:0/1564772823 wait complete. 2019-11-28T11:45:10.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.949+0000 7f5400ab4700 1 -- 172.21.15.80:0/1564772823 >> 172.21.15.80:0/1564772823 conn(0x7f53fc061cf0 msgr2=0x7f53fc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:10.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.952+0000 7f5400ab4700 1 Processor -- start 2019-11-28T11:45:10.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.952+0000 7f5400ab4700 1 -- start start 2019-11-28T11:45:10.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.952+0000 7f5400ab4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53fc13e5f0 0x7f53fc13e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:10.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.952+0000 7f5400ab4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53fc1066e0 con 0x7f53fc10a070 2019-11-28T11:45:10.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.952+0000 7f5400ab4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53fc10ce40 con 0x7f53fc10a4e0 2019-11-28T11:45:10.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.952+0000 7f5400ab4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53fc10e060 con 0x7f53fc13e5f0 2019-11-28T11:45:10.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f53fad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53fc13e5f0 0x7f53fc13e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:10.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f53fad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53fc13e5f0 0x7f53fc13e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40166/0 (socket says 172.21.15.80:40166) 2019-11-28T11:45:10.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f53fad9d700 1 -- 172.21.15.80:0/3808107322 learned_addr learned my addr 172.21.15.80:0/3808107322 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:10.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f53fad9d700 1 -- 172.21.15.80:0/3808107322 >> v1:172.21.15.174:6789/0 conn(0x7f53fc10a4e0 legacy=0x7f53fc10c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:10.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f53fad9d700 1 -- 172.21.15.80:0/3808107322 >> v1:172.21.15.80:6789/0 conn(0x7f53fc10a070 legacy=0x7f53fc10bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:10.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f53f37fe700 1 -- 172.21.15.80:0/3808107322 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24387341 0 0) 0x7f53ec0010b0 con 0x7f53fc10a070 2019-11-28T11:45:10.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f53fad9d700 1 -- 172.21.15.80:0/3808107322 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc10e9c0 con 0x7f53fc13e5f0 2019-11-28T11:45:10.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f53fad9d700 1 --2- 172.21.15.80:0/3808107322 >> v2:172.21.15.80:3300/0 conn(0x7f53fc13e5f0 0x7f53fc13e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f53e40107b0 tx=0x7f53e4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:10.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f53fad9d700 1 --2- 172.21.15.80:0/3808107322 >> v2:172.21.15.80:3300/0 conn(0x7f53fc13e5f0 0x7f53fc13e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f53e40107b0 tx=0x7f53e4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:10.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f53fad9d700 1 --2- 172.21.15.80:0/3808107322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc13e5f0 0x7f53fc13e9e0 secure :-1 s=READY pgs=1721 cs=0 l=1 rx=0x7f53e40107b0 tx=0x7f53e4010b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:10.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f53fad9d700 1 --2- 172.21.15.80:0/3808107322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc13e5f0 0x7f53fc13e9e0 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7f53e40107b0 tx=0x7f53e4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:10.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f53f37fe700 1 -- 172.21.15.80:0/3808107322 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53e4000f40 con 0x7f53fc13e5f0 2019-11-28T11:45:10.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f53fad9d700 1 --2- 172.21.15.80:0/3808107322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc13e5f0 0x7f53fc13e9e0 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7f53e40107b0 tx=0x7f53e4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:10.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f53fad9d700 1 --2- 172.21.15.80:0/3808107322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc13e5f0 0x7f53fc13e9e0 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7f53e40107b0 tx=0x7f53e4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:10.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f53f37fe700 1 -- 172.21.15.80:0/3808107322 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e4009830 con 0x7f53fc13e5f0 2019-11-28T11:45:10.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f53f37fe700 1 -- 172.21.15.80:0/3808107322 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53e4001520 con 0x7f53fc13e5f0 2019-11-28T11:45:10.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f5400ab4700 1 -- 172.21.15.80:0/3808107322 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53fc10ed40 con 0x7f53fc13e5f0 2019-11-28T11:45:10.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.953+0000 7f5400ab4700 1 -- 172.21.15.80:0/3808107322 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc10e9c0 con 0x7f53fc13e5f0 2019-11-28T11:45:10.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.954+0000 7f53fad9d700 1 --2- 172.21.15.80:0/3808107322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc13e5f0 0x7f53fc13e9e0 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7f53e40107b0 tx=0x7f53e4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:10.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.954+0000 7f53f37fe700 1 -- 172.21.15.80:0/3808107322 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f53e4009970 con 0x7f53fc13e5f0 2019-11-28T11:45:10.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.954+0000 7f53fad9d700 1 --2- 172.21.15.80:0/3808107322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc13e5f0 0x7f53fc13e9e0 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7f53e40107b0 tx=0x7f53e4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:10.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.954+0000 7f53f37fe700 1 --2- 172.21.15.80:0/3808107322 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f53d4018730 0x7f53d401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:10.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.954+0000 7f53f37fe700 1 -- 172.21.15.80:0/3808107322 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f53e4031e80 con 0x7f53fc13e5f0 2019-11-28T11:45:10.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.955+0000 7f53fa59c700 1 --2- 172.21.15.80:0/3808107322 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f53d4018730 0x7f53d401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:10.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.955+0000 7f53fa59c700 1 --2- 172.21.15.80:0/3808107322 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f53d4018730 0x7f53d401abc0 crc :-1 s=READY pgs=697 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:10.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.962+0000 7f5400ab4700 1 -- 172.21.15.80:0/3808107322 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53fc10ed40 con 0x7f53fc13e5f0 2019-11-28T11:45:10.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.965+0000 7f53fad9d700 1 --2- 172.21.15.80:0/3808107322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc13e5f0 0x7f53fc13e9e0 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7f53e40107b0 tx=0x7f53e4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:10.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:09.965+0000 7f53f37fe700 1 -- 172.21.15.80:0/3808107322 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f53e4017690 con 0x7f53fc13e5f0 2019-11-28T11:45:10.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:10.136+0000 7f5400ab4700 1 -- 172.21.15.80:0/3808107322 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53fc10e9c0 con 0x7f53fc13e5f0 2019-11-28T11:45:10.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:10.137+0000 7f53fad9d700 1 --2- 172.21.15.80:0/3808107322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc13e5f0 0x7f53fc13e9e0 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7f53e40107b0 tx=0x7f53e4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:10.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:10.137+0000 7f53f37fe700 1 -- 172.21.15.80:0/3808107322 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+2441 (secure 0 0 0) 0x7f53e40098b0 con 0x7f53fc13e5f0 2019-11-28T11:45:10.178 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 93 2019-11-28T11:45:10.178 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:10.178 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":93,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8943,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/35606746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":35606746},{"type":"v1","addr":"172.21.15.80:6834","nonce":35606746}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":93},{"gid":8949,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/423452986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":423452986},{"type":"v1","addr":"172.21.15.80:6835","nonce":423452986}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":93}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:01.366373+0000","modified":"2019-11-28T11:45:05.381121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8937},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8937":{"gid":8937,"name":"c","rank":0,"incarnation":91,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/1730908433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1730908433},{"type":"v1","addr":"172.21.15.174:6835","nonce":1730908433}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2019-11-28T11:45:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:10.139+0000 7f5400ab4700 1 -- 172.21.15.80:0/3808107322 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f53d4018730 msgr2=0x7f53d401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:10.139+0000 7f5400ab4700 1 --2- 172.21.15.80:0/3808107322 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f53d4018730 0x7f53d401abc0 crc :-1 s=READY pgs=697 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:10.139+0000 7f5400ab4700 1 -- 172.21.15.80:0/3808107322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc13e5f0 msgr2=0x7f53fc13e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:10.139+0000 7f5400ab4700 1 --2- 172.21.15.80:0/3808107322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc13e5f0 0x7f53fc13e9e0 secure :-1 s=READY pgs=1721 cs=0 l=1 rx=0x7f53e40107b0 tx=0x7f53e4010b50).stop 2019-11-28T11:45:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:10.139+0000 7f5400ab4700 1 -- 172.21.15.80:0/3808107322 shutdown_connections 2019-11-28T11:45:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:10.139+0000 7f5400ab4700 1 --2- 172.21.15.80:0/3808107322 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f53d4018730 0x7f53d401abc0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:10.139+0000 7f5400ab4700 1 --2- 172.21.15.80:0/3808107322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53fc13e5f0 0x7f53fc13e9e0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:10.139+0000 7f5400ab4700 1 -- 172.21.15.80:0/3808107322 shutdown_connections 2019-11-28T11:45:10.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:10.139+0000 7f5400ab4700 1 -- 172.21.15.80:0/3808107322 wait complete. 2019-11-28T11:45:10.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:10.139+0000 7f5400ab4700 1 -- 172.21.15.80:0/3808107322 >> 172.21.15.80:0/3808107322 conn(0x7f53fc13d620 msgr2=0x7f53fc13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:10.492 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8937}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 20, u'failed': [], u'epoch': 92, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [21], u'info': {u'gid_8937': {u'export_targets': [], u'name': u'c', u'incarnation': 91, u'state_seq': 2, u'state': u'up:active', u'gid': 8937, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1730908433, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 1730908433, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/1730908433'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:45:01.366373+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:45:05.381121+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:45:10.493 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:45:10.493 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:45:10.622 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:45:10.622 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:45:10.622 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:45:10.623 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 8937, 2019-11-28T11:45:10.623 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:45:10.623 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:45:10.623 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 6.20285771, 2019-11-28T11:45:10.623 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 92, 2019-11-28T11:45:10.623 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 128, 2019-11-28T11:45:10.624 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 128, 2019-11-28T11:45:10.624 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 6.4301783160000001 2019-11-28T11:45:10.624 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:45:10.627 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8937, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.20285771, "mdsmap_epoch": 92, "osdmap_epoch": 128, "osdmap_epoch_barrier": 128, "uptime": 6.4301783160000001 } 2019-11-28T11:45:10.627 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:45:10.627 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:45:10.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:45:10.628 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:45:10.698 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:45:10.698 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:45:10.819 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:45:10.820 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:45:10.820 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:45:10.820 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:45:10.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:45:10.820 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:45:10.892 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:45:11.013 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:45:11.014 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:45:11.014 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:45:11.019 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:45:11.019 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:45:11.141 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:45:11.141 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:45:11.141 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:45:11.147 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:45:11.147 INFO:teuthology.orchestra.run.smithi076:> rpm -q fuse --qf '%{VERSION}-%{RELEASE}' 2019-11-28T11:45:11.451 INFO:teuthology.orchestra.run.smithi076.stdout:2.9.2-11.el7 2019-11-28T11:45:11.451 INFO:teuthology.packaging:The installed version of fuse is 2.9.2-11.el7 2019-11-28T11:45:11.451 INFO:teuthology.orchestra.run.smithi016:> rpm -q fuse --qf '%{VERSION}-%{RELEASE}' 2019-11-28T11:45:11.524 INFO:teuthology.orchestra.run.smithi016.stdout:2.9.2-11.el7 2019-11-28T11:45:11.525 INFO:teuthology.packaging:The installed version of fuse is 2.9.2-11.el7 2019-11-28T11:45:11.526 INFO:tasks.cephfs.test_client_recovery:flock locks are available 2019-11-28T11:45:11.527 INFO:tasks.cephfs.mount:lock_background file background_file 2019-11-28T11:45:11.528 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits daemon-helper kill python -c ' 2019-11-28T11:45:11.528 INFO:teuthology.orchestra.run.smithi076:> import time 2019-11-28T11:45:11.529 INFO:teuthology.orchestra.run.smithi076:> import fcntl 2019-11-28T11:45:11.529 INFO:teuthology.orchestra.run.smithi076:> import struct 2019-11-28T11:45:11.529 INFO:teuthology.orchestra.run.smithi076:> f1 = open("/home/ubuntu/cephtest/mnt.0/background_file-1", '"'"'w'"'"') 2019-11-28T11:45:11.529 INFO:teuthology.orchestra.run.smithi076:> fcntl.flock(f1, fcntl.LOCK_EX | fcntl.LOCK_NB) 2019-11-28T11:45:11.529 INFO:teuthology.orchestra.run.smithi076:> f2 = open("/home/ubuntu/cephtest/mnt.0/background_file-2", '"'"'w'"'"') 2019-11-28T11:45:11.529 INFO:teuthology.orchestra.run.smithi076:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2019-11-28T11:45:11.529 INFO:teuthology.orchestra.run.smithi076:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2019-11-28T11:45:11.530 INFO:teuthology.orchestra.run.smithi076:> while True: 2019-11-28T11:45:11.530 INFO:teuthology.orchestra.run.smithi076:> time.sleep(1) 2019-11-28T11:45:11.530 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:45:11.535 INFO:teuthology.orchestra.run.smithi016:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file-2 2019-11-28T11:45:11.594 INFO:teuthology.orchestra.run.smithi016.stderr:ls: cannot access /home/ubuntu/cephtest/mnt.1/background_file-2: No such file or directory 2019-11-28T11:45:11.595 DEBUG:teuthology.orchestra.run:got remote process result: 2 2019-11-28T11:45:12.596 INFO:teuthology.orchestra.run.smithi016:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file-2 2019-11-28T11:45:12.670 INFO:teuthology.orchestra.run.smithi016.stdout:/home/ubuntu/cephtest/mnt.1/background_file-2 2019-11-28T11:45:12.671 DEBUG:tasks.cephfs.mount:File background_file-2 became visible from 1 after 1s 2019-11-28T11:45:12.671 INFO:tasks.cephfs.mount:check lock on file background_file 2019-11-28T11:45:12.672 INFO:teuthology.orchestra.run.smithi016:> sudo python -c ' 2019-11-28T11:45:12.672 INFO:teuthology.orchestra.run.smithi016:> import fcntl 2019-11-28T11:45:12.672 INFO:teuthology.orchestra.run.smithi016:> import errno 2019-11-28T11:45:12.672 INFO:teuthology.orchestra.run.smithi016:> import struct 2019-11-28T11:45:12.673 INFO:teuthology.orchestra.run.smithi016:> f1 = open("/home/ubuntu/cephtest/mnt.1/background_file-1", '"'"'r'"'"') 2019-11-28T11:45:12.673 INFO:teuthology.orchestra.run.smithi016:> try: 2019-11-28T11:45:12.673 INFO:teuthology.orchestra.run.smithi016:> fcntl.flock(f1, fcntl.LOCK_EX | fcntl.LOCK_NB) 2019-11-28T11:45:12.673 INFO:teuthology.orchestra.run.smithi016:> except IOError, e: 2019-11-28T11:45:12.673 INFO:teuthology.orchestra.run.smithi016:> if e.errno == errno.EAGAIN: 2019-11-28T11:45:12.673 INFO:teuthology.orchestra.run.smithi016:> pass 2019-11-28T11:45:12.673 INFO:teuthology.orchestra.run.smithi016:> else: 2019-11-28T11:45:12.675 INFO:teuthology.orchestra.run.smithi016:> raise RuntimeError("flock on file /home/ubuntu/cephtest/mnt.1/background_file-1 not found") 2019-11-28T11:45:12.675 INFO:teuthology.orchestra.run.smithi016:> f2 = open("/home/ubuntu/cephtest/mnt.1/background_file-2", '"'"'r'"'"') 2019-11-28T11:45:12.675 INFO:teuthology.orchestra.run.smithi016:> try: 2019-11-28T11:45:12.675 INFO:teuthology.orchestra.run.smithi016:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2019-11-28T11:45:12.675 INFO:teuthology.orchestra.run.smithi016:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2019-11-28T11:45:12.676 INFO:teuthology.orchestra.run.smithi016:> except IOError, e: 2019-11-28T11:45:12.676 INFO:teuthology.orchestra.run.smithi016:> if e.errno == errno.EAGAIN: 2019-11-28T11:45:12.676 INFO:teuthology.orchestra.run.smithi016:> pass 2019-11-28T11:45:12.676 INFO:teuthology.orchestra.run.smithi016:> else: 2019-11-28T11:45:12.676 INFO:teuthology.orchestra.run.smithi016:> raise RuntimeError("posix lock on file /home/ubuntu/cephtest/mnt.1/background_file-2 not found") 2019-11-28T11:45:12.676 INFO:teuthology.orchestra.run.smithi016:> ' 2019-11-28T11:45:12.751 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:45:12.752 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:45:12.752 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:45:12.752 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:45:12.753 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:45:12.753 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:45:12.757 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:45:12.758 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:45:12.761 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:45:12.761 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:45:12.762 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:45:12.762 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:45:12.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.883+0000 7ff93b26f700 1 Processor -- start 2019-11-28T11:45:12.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.883+0000 7ff93b26f700 1 -- start start 2019-11-28T11:45:12.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.884+0000 7ff93b26f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff93406c0a0 0x7ff934072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:12.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.884+0000 7ff93b26f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff934072620 0x7ff934164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:12.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.884+0000 7ff93b26f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93406db00 con 0x7ff9340734e0 2019-11-28T11:45:12.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.884+0000 7ff93b26f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93406fd60 con 0x7ff93406c0a0 2019-11-28T11:45:12.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.884+0000 7ff93b26f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff934070030 con 0x7ff934072620 2019-11-28T11:45:12.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.884+0000 7ff93980c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff93406c0a0 0x7ff934072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:12.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.884+0000 7ff93900b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff9340734e0 0x7ff934071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39490/0 (socket says 172.21.15.80:39490) 2019-11-28T11:45:12.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.884+0000 7ff93900b700 1 -- 172.21.15.80:0/2893204863 learned_addr learned my addr 172.21.15.80:0/2893204863 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:12.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.884+0000 7ff93a00d700 1 --2- 172.21.15.80:0/2893204863 >> v2:172.21.15.174:3300/0 conn(0x7ff934072620 0x7ff934164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:12.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.884+0000 7ff93980c700 1 -- 172.21.15.80:0/2893204863 >> v2:172.21.15.174:3300/0 conn(0x7ff934072620 msgr2=0x7ff934164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:12.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.884+0000 7ff93980c700 1 --2- 172.21.15.80:0/2893204863 >> v2:172.21.15.174:3300/0 conn(0x7ff934072620 0x7ff934164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:12.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.884+0000 7ff93980c700 1 -- 172.21.15.80:0/2893204863 >> v1:172.21.15.80:6789/0 conn(0x7ff9340734e0 legacy=0x7ff934071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:12.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.884+0000 7ff93880a700 1 -- 172.21.15.80:0/2893204863 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268503258 0 0) 0x7ff928001170 con 0x7ff9340734e0 2019-11-28T11:45:12.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.885+0000 7ff93980c700 1 -- 172.21.15.80:0/2893204863 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340706c0 con 0x7ff93406c0a0 2019-11-28T11:45:12.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.885+0000 7ff93980c700 1 --2- 172.21.15.80:0/2893204863 >> v2:172.21.15.80:3300/0 conn(0x7ff93406c0a0 0x7ff934072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff92400b2d0 tx=0x7ff92400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.885+0000 7ff93980c700 1 --2- 172.21.15.80:0/2893204863 >> v2:172.21.15.80:3300/0 conn(0x7ff93406c0a0 0x7ff934072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff92400b2d0 tx=0x7ff92400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.885+0000 7ff93980c700 1 --2- 172.21.15.80:0/2893204863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff93406c0a0 0x7ff934072fa0 secure :-1 s=READY pgs=1723 cs=0 l=1 rx=0x7ff92400b2d0 tx=0x7ff92400ba60).ready entity=mon.0 client_cookie=1bb9b6ef0c4b8c2d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:12.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.885+0000 7ff93980c700 1 --2- 172.21.15.80:0/2893204863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff93406c0a0 0x7ff934072fa0 secure :-1 s=THROTTLE_DONE pgs=1723 cs=0 l=1 rx=0x7ff92400b2d0 tx=0x7ff92400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.885+0000 7ff93980c700 1 --2- 172.21.15.80:0/2893204863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff93406c0a0 0x7ff934072fa0 secure :-1 s=THROTTLE_DONE pgs=1723 cs=0 l=1 rx=0x7ff92400b2d0 tx=0x7ff92400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.885+0000 7ff93880a700 1 -- 172.21.15.80:0/2893204863 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff924007590 con 0x7ff93406c0a0 2019-11-28T11:45:12.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.885+0000 7ff93980c700 1 --2- 172.21.15.80:0/2893204863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff93406c0a0 0x7ff934072fa0 secure :-1 s=THROTTLE_DONE pgs=1723 cs=0 l=1 rx=0x7ff92400b2d0 tx=0x7ff92400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.885+0000 7ff93880a700 1 -- 172.21.15.80:0/2893204863 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff924009d30 con 0x7ff93406c0a0 2019-11-28T11:45:12.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.885+0000 7ff93880a700 1 -- 172.21.15.80:0/2893204863 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff92400a340 con 0x7ff93406c0a0 2019-11-28T11:45:12.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.885+0000 7ff93b26f700 1 -- 172.21.15.80:0/2893204863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff93406c0a0 msgr2=0x7ff934072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:12.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.885+0000 7ff93b26f700 1 --2- 172.21.15.80:0/2893204863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff93406c0a0 0x7ff934072fa0 secure :-1 s=READY pgs=1723 cs=0 l=1 rx=0x7ff92400b2d0 tx=0x7ff92400ba60).stop 2019-11-28T11:45:12.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.886+0000 7ff93b26f700 1 -- 172.21.15.80:0/2893204863 shutdown_connections 2019-11-28T11:45:12.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.886+0000 7ff93b26f700 1 --2- 172.21.15.80:0/2893204863 >> v2:172.21.15.174:3300/0 conn(0x7ff934072620 0x7ff934164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:12.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.886+0000 7ff93b26f700 1 --2- 172.21.15.80:0/2893204863 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff93406c0a0 0x7ff934072fa0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:12.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.886+0000 7ff93b26f700 1 -- 172.21.15.80:0/2893204863 shutdown_connections 2019-11-28T11:45:12.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.886+0000 7ff93b26f700 1 -- 172.21.15.80:0/2893204863 wait complete. 2019-11-28T11:45:12.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.886+0000 7ff93b26f700 1 -- 172.21.15.80:0/2893204863 >> 172.21.15.80:0/2893204863 conn(0x7ff934061cf0 msgr2=0x7ff934064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:12.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.890+0000 7ff93b26f700 1 Processor -- start 2019-11-28T11:45:12.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.890+0000 7ff93b26f700 1 -- start start 2019-11-28T11:45:12.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.891+0000 7ff93b26f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff9341096f0 0x7ff934169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:12.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.891+0000 7ff93b26f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9341066e0 con 0x7ff93413e9e0 2019-11-28T11:45:12.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.891+0000 7ff93b26f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93410ce40 con 0x7ff93413e5f0 2019-11-28T11:45:12.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.891+0000 7ff93b26f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93410e060 con 0x7ff9341096f0 2019-11-28T11:45:12.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.891+0000 7ff93900b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff93413e9e0 0x7ff934108ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39498/0 (socket says 172.21.15.80:39498) 2019-11-28T11:45:12.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.891+0000 7ff93900b700 1 -- 172.21.15.80:0/369670690 learned_addr learned my addr 172.21.15.80:0/369670690 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:12.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.891+0000 7ff93a00d700 1 --2- 172.21.15.80:0/369670690 >> v2:172.21.15.174:3300/0 conn(0x7ff9341096f0 0x7ff934169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:12.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.891+0000 7ff9327fc700 1 -- 172.21.15.80:0/369670690 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761282432 0 0) 0x7ff928001170 con 0x7ff93413e9e0 2019-11-28T11:45:12.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.891+0000 7ff9327fc700 1 -- 172.21.15.80:0/369670690 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff914002e80 con 0x7ff93413e9e0 2019-11-28T11:45:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.892+0000 7ff93a00d700 1 -- 172.21.15.80:0/369670690 >> v1:172.21.15.174:6789/0 conn(0x7ff93413e5f0 legacy=0x7ff93410a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.892+0000 7ff93a00d700 1 -- 172.21.15.80:0/369670690 >> v1:172.21.15.80:6789/0 conn(0x7ff93413e9e0 legacy=0x7ff934108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:12.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.892+0000 7ff93a00d700 1 -- 172.21.15.80:0/369670690 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93410e9c0 con 0x7ff9341096f0 2019-11-28T11:45:12.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.892+0000 7ff93a00d700 1 --2- 172.21.15.80:0/369670690 >> v2:172.21.15.174:3300/0 conn(0x7ff9341096f0 0x7ff934169ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff92c0103b0 tx=0x7ff92c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.892+0000 7ff93a00d700 1 --2- 172.21.15.80:0/369670690 >> v2:172.21.15.174:3300/0 conn(0x7ff9341096f0 0x7ff934169ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff92c0103b0 tx=0x7ff92c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.892+0000 7ff93a00d700 1 --2- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9341096f0 0x7ff934169ed0 secure :-1 s=READY pgs=1002 cs=0 l=1 rx=0x7ff92c0103b0 tx=0x7ff92c010750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:12.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.892+0000 7ff93a00d700 1 --2- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9341096f0 0x7ff934169ed0 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7ff92c0103b0 tx=0x7ff92c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.892+0000 7ff9327fc700 1 -- 172.21.15.80:0/369670690 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff92c00a6b0 con 0x7ff9341096f0 2019-11-28T11:45:12.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.892+0000 7ff93a00d700 1 --2- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9341096f0 0x7ff934169ed0 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7ff92c0103b0 tx=0x7ff92c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.892+0000 7ff93a00d700 1 --2- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9341096f0 0x7ff934169ed0 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7ff92c0103b0 tx=0x7ff92c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.892+0000 7ff9327fc700 1 -- 172.21.15.80:0/369670690 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c001060 con 0x7ff9341096f0 2019-11-28T11:45:12.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.892+0000 7ff9327fc700 1 -- 172.21.15.80:0/369670690 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff92c001770 con 0x7ff9341096f0 2019-11-28T11:45:12.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.892+0000 7ff93b26f700 1 -- 172.21.15.80:0/369670690 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93410ed40 con 0x7ff9341096f0 2019-11-28T11:45:12.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.892+0000 7ff93b26f700 1 -- 172.21.15.80:0/369670690 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93410e9c0 con 0x7ff9341096f0 2019-11-28T11:45:12.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.893+0000 7ff93a00d700 1 --2- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9341096f0 0x7ff934169ed0 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7ff92c0103b0 tx=0x7ff92c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.893+0000 7ff9327fc700 1 -- 172.21.15.80:0/369670690 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff92c001250 con 0x7ff9341096f0 2019-11-28T11:45:12.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.893+0000 7ff93a00d700 1 --2- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9341096f0 0x7ff934169ed0 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7ff92c0103b0 tx=0x7ff92c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.893+0000 7ff9327fc700 1 --2- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff914018770 0x7ff91401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:12.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.893+0000 7ff9327fc700 1 -- 172.21.15.80:0/369670690 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff92c031a90 con 0x7ff9341096f0 2019-11-28T11:45:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.893+0000 7ff93980c700 1 --2- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff914018770 0x7ff91401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.894+0000 7ff93980c700 1 --2- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff914018770 0x7ff91401abe0 crc :-1 s=READY pgs=698 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:12.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.900+0000 7ff93b26f700 1 -- 172.21.15.80:0/369670690 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93410ed40 con 0x7ff9341096f0 2019-11-28T11:45:12.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.902+0000 7ff93a00d700 1 --2- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9341096f0 0x7ff934169ed0 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7ff92c0103b0 tx=0x7ff92c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.902+0000 7ff9327fc700 1 -- 172.21.15.80:0/369670690 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff92c000a70 con 0x7ff9341096f0 2019-11-28T11:45:12.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.932+0000 7f7e0f33b700 1 Processor -- start 2019-11-28T11:45:12.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.932+0000 7f7e0f33b700 1 -- start start 2019-11-28T11:45:12.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0f33b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e0806c490 0x7f7e0806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:12.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0f33b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e0806ce60 0x7f7e08164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:12.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0f33b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0806db00 con 0x7f7e0806c0a0 2019-11-28T11:45:12.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0f33b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0806fd60 con 0x7f7e0806c490 2019-11-28T11:45:12.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0f33b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e08070030 con 0x7f7e0806ce60 2019-11-28T11:45:12.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0d0d7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e0806c490 0x7f7e0806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:12.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0d0d7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e0806c490 0x7f7e0806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40190/0 (socket says 172.21.15.80:40190) 2019-11-28T11:45:12.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0d0d7700 1 -- 172.21.15.80:0/146883020 learned_addr learned my addr 172.21.15.80:0/146883020 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:12.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0e0d9700 1 --2- 172.21.15.80:0/146883020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e0806ce60 0x7f7e08164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:12.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0d0d7700 1 -- 172.21.15.80:0/146883020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e0806ce60 msgr2=0x7f7e08164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:12.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/146883020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e0806ce60 0x7f7e08164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:12.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0d0d7700 1 -- 172.21.15.80:0/146883020 >> v1:172.21.15.174:6789/0 conn(0x7f7e0806c0a0 legacy=0x7f7e08072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:12.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0c8d6700 1 -- 172.21.15.80:0/146883020 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598399035 0 0) 0x7f7e00001400 con 0x7f7e0806c0a0 2019-11-28T11:45:12.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0d0d7700 1 -- 172.21.15.80:0/146883020 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e080706c0 con 0x7f7e0806c490 2019-11-28T11:45:12.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/146883020 >> v2:172.21.15.80:3300/0 conn(0x7f7e0806c490 0x7f7e0806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7dfc00f6c0 tx=0x7f7dfc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/146883020 >> v2:172.21.15.80:3300/0 conn(0x7f7e0806c490 0x7f7e0806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7dfc00f6c0 tx=0x7f7dfc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/146883020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0806c490 0x7f7e0806c920 secure :-1 s=READY pgs=1725 cs=0 l=1 rx=0x7f7dfc00f6c0 tx=0x7f7dfc00fa60).ready entity=mon.0 client_cookie=9241afe1e401273 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:12.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.933+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/146883020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0806c490 0x7f7e0806c920 secure :-1 s=THROTTLE_DONE pgs=1725 cs=0 l=1 rx=0x7f7dfc00f6c0 tx=0x7f7dfc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.934+0000 7f7e0c8d6700 1 -- 172.21.15.80:0/146883020 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dfc000960 con 0x7f7e0806c490 2019-11-28T11:45:12.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.934+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/146883020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0806c490 0x7f7e0806c920 secure :-1 s=THROTTLE_DONE pgs=1725 cs=0 l=1 rx=0x7f7dfc00f6c0 tx=0x7f7dfc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.934+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/146883020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0806c490 0x7f7e0806c920 secure :-1 s=THROTTLE_DONE pgs=1725 cs=0 l=1 rx=0x7f7dfc00f6c0 tx=0x7f7dfc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.934+0000 7f7e0c8d6700 1 -- 172.21.15.80:0/146883020 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc000960 con 0x7f7e0806c490 2019-11-28T11:45:12.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.934+0000 7f7e0c8d6700 1 -- 172.21.15.80:0/146883020 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dfc001070 con 0x7f7e0806c490 2019-11-28T11:45:12.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.934+0000 7f7e0f33b700 1 -- 172.21.15.80:0/146883020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0806c490 msgr2=0x7f7e0806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:12.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.934+0000 7f7e0f33b700 1 --2- 172.21.15.80:0/146883020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0806c490 0x7f7e0806c920 secure :-1 s=READY pgs=1725 cs=0 l=1 rx=0x7f7dfc00f6c0 tx=0x7f7dfc00fa60).stop 2019-11-28T11:45:12.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.934+0000 7f7e0f33b700 1 -- 172.21.15.80:0/146883020 shutdown_connections 2019-11-28T11:45:12.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.934+0000 7f7e0f33b700 1 --2- 172.21.15.80:0/146883020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e0806ce60 0x7f7e08164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:12.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.934+0000 7f7e0f33b700 1 --2- 172.21.15.80:0/146883020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0806c490 0x7f7e0806c920 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:12.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.934+0000 7f7e0f33b700 1 -- 172.21.15.80:0/146883020 shutdown_connections 2019-11-28T11:45:12.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.934+0000 7f7e0f33b700 1 -- 172.21.15.80:0/146883020 wait complete. 2019-11-28T11:45:12.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.934+0000 7f7e0f33b700 1 -- 172.21.15.80:0/146883020 >> 172.21.15.80:0/146883020 conn(0x7f7e08061cf0 msgr2=0x7f7e08064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:12.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.937+0000 7f7e0f33b700 1 Processor -- start 2019-11-28T11:45:12.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.937+0000 7f7e0f33b700 1 -- start start 2019-11-28T11:45:12.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0f33b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e08104d10 0x7f7e0810e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:12.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0f33b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e0810e670 0x7f7e0813e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:12.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0f33b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7e0813e830 0x7f7e0813ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:12.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0f33b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e08107cb0 con 0x7f7e0810e670 2019-11-28T11:45:12.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0f33b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e081424f0 con 0x7f7e0813e830 2019-11-28T11:45:12.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0f33b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e08135c60 con 0x7f7e08104d10 2019-11-28T11:45:12.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0d0d7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e0810e670 0x7f7e0813e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:12.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0d0d7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e0810e670 0x7f7e0813e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40198/0 (socket says 172.21.15.80:40198) 2019-11-28T11:45:12.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0d0d7700 1 -- 172.21.15.80:0/4024497965 learned_addr learned my addr 172.21.15.80:0/4024497965 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:12.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0e0d9700 1 --2- 172.21.15.80:0/4024497965 >> v2:172.21.15.174:3300/0 conn(0x7f7e0813e830 0x7f7e0813ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:12.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0d8d8700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e08104d10 0x7f7e0810e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:12.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0d0d7700 1 -- 172.21.15.80:0/4024497965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e08104d10 msgr2=0x7f7e0810e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:12.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e08104d10 0x7f7e0810e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:12.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0d0d7700 1 -- 172.21.15.80:0/4024497965 >> v2:172.21.15.174:3300/0 conn(0x7f7e0813e830 msgr2=0x7f7e0813ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:12.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/4024497965 >> v2:172.21.15.174:3300/0 conn(0x7f7e0813e830 0x7f7e0813ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:12.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0d0d7700 1 -- 172.21.15.80:0/4024497965 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e08101f00 con 0x7f7e0810e670 2019-11-28T11:45:12.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0e0d9700 1 --2- 172.21.15.80:0/4024497965 >> v2:172.21.15.174:3300/0 conn(0x7f7e0813e830 0x7f7e0813ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:12.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/4024497965 >> v2:172.21.15.80:3300/0 conn(0x7f7e0810e670 0x7f7e0813e2f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7dfc010440 tx=0x7f7dfc0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/4024497965 >> v2:172.21.15.80:3300/0 conn(0x7f7e0810e670 0x7f7e0813e2f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7dfc010440 tx=0x7f7dfc0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0810e670 0x7f7e0813e2f0 secure :-1 s=READY pgs=1726 cs=0 l=1 rx=0x7f7dfc010440 tx=0x7f7dfc0102f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:12.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.939+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0810e670 0x7f7e0813e2f0 secure :-1 s=THROTTLE_DONE pgs=1726 cs=0 l=1 rx=0x7f7dfc010440 tx=0x7f7dfc0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.939+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0810e670 0x7f7e0813e2f0 secure :-1 s=THROTTLE_DONE pgs=1726 cs=0 l=1 rx=0x7f7dfc010440 tx=0x7f7dfc0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.939+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0810e670 0x7f7e0813e2f0 secure :-1 s=THROTTLE_DONE pgs=1726 cs=0 l=1 rx=0x7f7dfc010440 tx=0x7f7dfc0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:12.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.939+0000 7f7e067fc700 1 -- 172.21.15.80:0/4024497965 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dfc000940 con 0x7f7e0810e670 2019-11-28T11:45:12.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.939+0000 7f7e067fc700 1 -- 172.21.15.80:0/4024497965 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc000f50 con 0x7f7e0810e670 2019-11-28T11:45:12.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.939+0000 7f7e067fc700 1 -- 172.21.15.80:0/4024497965 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dfc0015a0 con 0x7f7e0810e670 2019-11-28T11:45:12.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.939+0000 7f7e0f33b700 1 -- 172.21.15.80:0/4024497965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e08101f00 con 0x7f7e0810e670 2019-11-28T11:45:12.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.939+0000 7f7e0f33b700 1 -- 172.21.15.80:0/4024497965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e08101f00 con 0x7f7e0810e670 2019-11-28T11:45:12.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.939+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0810e670 0x7f7e0813e2f0 secure :-1 s=THROTTLE_DONE pgs=1726 cs=0 l=1 rx=0x7f7dfc010440 tx=0x7f7dfc0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.939+0000 7f7e067fc700 1 -- 172.21.15.80:0/4024497965 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7dfc001140 con 0x7f7e0810e670 2019-11-28T11:45:13.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.939+0000 7f7e067fc700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7de8018730 0x7f7de801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:13.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f7e0d8d8700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7de8018730 0x7f7de801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:13.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0810e670 0x7f7e0813e2f0 secure :-1 s=THROTTLE_DONE pgs=1726 cs=0 l=1 rx=0x7f7dfc010440 tx=0x7f7dfc0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f7e067fc700 1 -- 172.21.15.80:0/4024497965 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7dfc000f30 con 0x7f7e0810e670 2019-11-28T11:45:13.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f7e0d8d8700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7de8018730 0x7f7de801abe0 crc :-1 s=READY pgs=699 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:13.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.947+0000 7f7e0f33b700 1 -- 172.21.15.80:0/4024497965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e081424f0 con 0x7f7e0810e670 2019-11-28T11:45:13.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.952+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0810e670 0x7f7e0813e2f0 secure :-1 s=THROTTLE_DONE pgs=1726 cs=0 l=1 rx=0x7f7dfc010440 tx=0x7f7dfc0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.952+0000 7f7e067fc700 1 -- 172.21.15.80:0/4024497965 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7dfc001140 con 0x7f7e0810e670 2019-11-28T11:45:13.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f2d6d70e700 1 Processor -- start 2019-11-28T11:45:13.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.938+0000 7f2d6d70e700 1 -- start start 2019-11-28T11:45:13.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.939+0000 7f2d6d70e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2d6806c0a0 0x7f2d68072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:13.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.939+0000 7f2d6d70e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d680734e0 0x7f2d68071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:13.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d6d70e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6806db00 con 0x7f2d68072360 2019-11-28T11:45:13.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d6d70e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6806fd60 con 0x7f2d6806c0a0 2019-11-28T11:45:13.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d6d70e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d68070030 con 0x7f2d680734e0 2019-11-28T11:45:13.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d677fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2d6806c0a0 0x7f2d68072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:13.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d67fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2d68072360 0x7f2d6806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39522/0 (socket says 172.21.15.80:39522) 2019-11-28T11:45:13.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d67fff700 1 -- 172.21.15.80:0/1900325732 learned_addr learned my addr 172.21.15.80:0/1900325732 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:13.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d66ffd700 1 --2- 172.21.15.80:0/1900325732 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d680734e0 0x7f2d68071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:13.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d667fc700 1 -- 172.21.15.80:0/1900325732 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531298211 0 0) 0x7f2d600014d0 con 0x7f2d68072360 2019-11-28T11:45:13.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d677fe700 1 -- 172.21.15.80:0/1900325732 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d680734e0 msgr2=0x7f2d68071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:13.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d677fe700 1 --2- 172.21.15.80:0/1900325732 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d680734e0 0x7f2d68071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:13.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d677fe700 1 -- 172.21.15.80:0/1900325732 >> v1:172.21.15.80:6789/0 conn(0x7f2d68072360 legacy=0x7f2d6806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:13.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d677fe700 1 -- 172.21.15.80:0/1900325732 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d680706c0 con 0x7f2d6806c0a0 2019-11-28T11:45:13.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d66ffd700 1 --2- 172.21.15.80:0/1900325732 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d680734e0 0x7f2d68071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:13.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d677fe700 1 --2- 172.21.15.80:0/1900325732 >> v2:172.21.15.174:3300/0 conn(0x7f2d6806c0a0 0x7f2d68072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2d5800af50 tx=0x7f2d5800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d677fe700 1 --2- 172.21.15.80:0/1900325732 >> v2:172.21.15.174:3300/0 conn(0x7f2d6806c0a0 0x7f2d68072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2d5800af50 tx=0x7f2d5800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d677fe700 1 --2- 172.21.15.80:0/1900325732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d6806c0a0 0x7f2d68072fa0 secure :-1 s=READY pgs=1004 cs=0 l=1 rx=0x7f2d5800af50 tx=0x7f2d5800b760).ready entity=mon.1 client_cookie=24f5834ad127bc3e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:13.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d677fe700 1 --2- 172.21.15.80:0/1900325732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d6806c0a0 0x7f2d68072fa0 secure :-1 s=THROTTLE_DONE pgs=1004 cs=0 l=1 rx=0x7f2d5800af50 tx=0x7f2d5800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d667fc700 1 -- 172.21.15.80:0/1900325732 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d58007210 con 0x7f2d6806c0a0 2019-11-28T11:45:13.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d677fe700 1 --2- 172.21.15.80:0/1900325732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d6806c0a0 0x7f2d68072fa0 secure :-1 s=THROTTLE_DONE pgs=1004 cs=0 l=1 rx=0x7f2d5800af50 tx=0x7f2d5800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d677fe700 1 --2- 172.21.15.80:0/1900325732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d6806c0a0 0x7f2d68072fa0 secure :-1 s=THROTTLE_DONE pgs=1004 cs=0 l=1 rx=0x7f2d5800af50 tx=0x7f2d5800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d667fc700 1 -- 172.21.15.80:0/1900325732 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d580099b0 con 0x7f2d6806c0a0 2019-11-28T11:45:13.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d667fc700 1 -- 172.21.15.80:0/1900325732 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d5800a080 con 0x7f2d6806c0a0 2019-11-28T11:45:13.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d6d70e700 1 -- 172.21.15.80:0/1900325732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d6806c0a0 msgr2=0x7f2d68072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:13.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.940+0000 7f2d6d70e700 1 --2- 172.21.15.80:0/1900325732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d6806c0a0 0x7f2d68072fa0 secure :-1 s=READY pgs=1004 cs=0 l=1 rx=0x7f2d5800af50 tx=0x7f2d5800b760).stop 2019-11-28T11:45:13.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.941+0000 7f2d6d70e700 1 -- 172.21.15.80:0/1900325732 shutdown_connections 2019-11-28T11:45:13.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.941+0000 7f2d6d70e700 1 --2- 172.21.15.80:0/1900325732 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d680734e0 0x7f2d68071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:13.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.941+0000 7f2d6d70e700 1 --2- 172.21.15.80:0/1900325732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d6806c0a0 0x7f2d68072fa0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:13.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.941+0000 7f2d6d70e700 1 -- 172.21.15.80:0/1900325732 shutdown_connections 2019-11-28T11:45:13.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.941+0000 7f2d6d70e700 1 -- 172.21.15.80:0/1900325732 wait complete. 2019-11-28T11:45:13.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.941+0000 7f2d6d70e700 1 -- 172.21.15.80:0/1900325732 >> 172.21.15.80:0/1900325732 conn(0x7f2d68061cf0 msgr2=0x7f2d68064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d6d70e700 1 Processor -- start 2019-11-28T11:45:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d6d70e700 1 -- start start 2019-11-28T11:45:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d6d70e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d6813eb40 0x7f2d6810afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d6d70e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d6810b500 0x7f2d681629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d6d70e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6813f1e0 con 0x7f2d68162f30 2019-11-28T11:45:13.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d6d70e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d681234c0 con 0x7f2d6810b500 2019-11-28T11:45:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d6d70e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6813d6a0 con 0x7f2d6813eb40 2019-11-28T11:45:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d66ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d6810b500 0x7f2d681629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d677fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d6813eb40 0x7f2d6810afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d66ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2d6810b500 0x7f2d681629f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40212/0 (socket says 172.21.15.80:40212) 2019-11-28T11:45:13.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d66ffd700 1 -- 172.21.15.80:0/1056909255 learned_addr learned my addr 172.21.15.80:0/1056909255 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:13.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d66ffd700 1 -- 172.21.15.80:0/1056909255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d6813eb40 msgr2=0x7f2d6810afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:13.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d66ffd700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d6813eb40 0x7f2d6810afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:13.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d66ffd700 1 -- 172.21.15.80:0/1056909255 >> v1:172.21.15.174:6789/0 conn(0x7f2d68162f30 legacy=0x7f2d68109e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:13.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d66ffd700 1 -- 172.21.15.80:0/1056909255 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d68108700 con 0x7f2d6810b500 2019-11-28T11:45:13.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d677fe700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d6813eb40 0x7f2d6810afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:13.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d4ffff700 1 -- 172.21.15.80:0/1056909255 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090840448 0 0) 0x7f2d600012c0 con 0x7f2d68162f30 2019-11-28T11:45:13.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d66ffd700 1 --2- 172.21.15.80:0/1056909255 >> v2:172.21.15.80:3300/0 conn(0x7f2d6810b500 0x7f2d681629f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2d5c010410 tx=0x7f2d5c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d66ffd700 1 --2- 172.21.15.80:0/1056909255 >> v2:172.21.15.80:3300/0 conn(0x7f2d6810b500 0x7f2d681629f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2d5c010410 tx=0x7f2d5c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d66ffd700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d6810b500 0x7f2d681629f0 secure :-1 s=READY pgs=1728 cs=0 l=1 rx=0x7f2d5c010410 tx=0x7f2d5c0107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:13.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d66ffd700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d6810b500 0x7f2d681629f0 secure :-1 s=THROTTLE_DONE pgs=1728 cs=0 l=1 rx=0x7f2d5c010410 tx=0x7f2d5c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d4ffff700 1 -- 172.21.15.80:0/1056909255 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d5c00a8c0 con 0x7f2d6810b500 2019-11-28T11:45:13.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d6d70e700 1 -- 172.21.15.80:0/1056909255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d68108a80 con 0x7f2d6810b500 2019-11-28T11:45:13.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d66ffd700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d6810b500 0x7f2d681629f0 secure :-1 s=THROTTLE_DONE pgs=1728 cs=0 l=1 rx=0x7f2d5c010410 tx=0x7f2d5c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d66ffd700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d6810b500 0x7f2d681629f0 secure :-1 s=THROTTLE_DONE pgs=1728 cs=0 l=1 rx=0x7f2d5c010410 tx=0x7f2d5c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d6d70e700 1 -- 172.21.15.80:0/1056909255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d68108700 con 0x7f2d6810b500 2019-11-28T11:45:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d4ffff700 1 -- 172.21.15.80:0/1056909255 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c000960 con 0x7f2d6810b500 2019-11-28T11:45:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.945+0000 7f2d4ffff700 1 -- 172.21.15.80:0/1056909255 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d5c009960 con 0x7f2d6810b500 2019-11-28T11:45:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.946+0000 7f2d66ffd700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d6810b500 0x7f2d681629f0 secure :-1 s=THROTTLE_DONE pgs=1728 cs=0 l=1 rx=0x7f2d5c010410 tx=0x7f2d5c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.946+0000 7f2d4ffff700 1 -- 172.21.15.80:0/1056909255 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2d5c009580 con 0x7f2d6810b500 2019-11-28T11:45:13.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.946+0000 7f2d66ffd700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d6810b500 0x7f2d681629f0 secure :-1 s=THROTTLE_DONE pgs=1728 cs=0 l=1 rx=0x7f2d5c010410 tx=0x7f2d5c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.946+0000 7f2d4ffff700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d48018730 0x7f2d4801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:13.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.946+0000 7f2d4ffff700 1 -- 172.21.15.80:0/1056909255 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2d5c031d20 con 0x7f2d6810b500 2019-11-28T11:45:13.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.946+0000 7f2d677fe700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d48018730 0x7f2d4801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:13.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.947+0000 7f2d677fe700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d48018730 0x7f2d4801abe0 crc :-1 s=READY pgs=700 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:13.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.955+0000 7f2d6d70e700 1 -- 172.21.15.80:0/1056909255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d68108a80 con 0x7f2d6810b500 2019-11-28T11:45:13.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.958+0000 7f2d66ffd700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d6810b500 0x7f2d681629f0 secure :-1 s=THROTTLE_DONE pgs=1728 cs=0 l=1 rx=0x7f2d5c010410 tx=0x7f2d5c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:12.958+0000 7f2d4ffff700 1 -- 172.21.15.80:0/1056909255 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2d5c00a5b0 con 0x7f2d6810b500 2019-11-28T11:45:13.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.133+0000 7f7e0f33b700 1 -- 172.21.15.80:0/4024497965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f7e081424f0 con 0x7f7e0810e670 2019-11-28T11:45:13.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.230+0000 7ff93b26f700 1 -- 172.21.15.80:0/369670690 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7ff93410e9c0 con 0x7ff9341096f0 2019-11-28T11:45:13.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.276+0000 7f2d6d70e700 1 -- 172.21.15.80:0/1056909255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f2d68108700 con 0x7f2d6810b500 2019-11-28T11:45:13.738 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:45:13.699+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:45:13.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.707+0000 7f7e0d0d7700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0810e670 0x7f7e0813e2f0 secure :-1 s=THROTTLE_DONE pgs=1726 cs=0 l=1 rx=0x7f7dfc010440 tx=0x7f7dfc0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.707+0000 7f7e067fc700 1 -- 172.21.15.80:0/4024497965 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 8943 v94) v1 ==== 95+0+0 (secure 0 0 0) 0x7f7dfc000f30 con 0x7f7e0810e670 2019-11-28T11:45:13.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.707+0000 7f2d66ffd700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d6810b500 0x7f2d681629f0 secure :-1 s=THROTTLE_DONE pgs=1728 cs=0 l=1 rx=0x7f2d5c010410 tx=0x7f2d5c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.707+0000 7f2d4ffff700 1 -- 172.21.15.80:0/1056909255 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 8949 v94) v1 ==== 95+0+0 (secure 0 0 0) 0x7f2d5c000940 con 0x7f2d6810b500 2019-11-28T11:45:13.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.707+0000 7ff93a00d700 1 --2- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9341096f0 0x7ff934169ed0 secure :-1 s=THROTTLE_DONE pgs=1002 cs=0 l=1 rx=0x7ff92c0103b0 tx=0x7ff92c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:13.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.707+0000 7ff9327fc700 1 -- 172.21.15.80:0/369670690 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 8937 v94) v1 ==== 95+0+0 (secure 0 0 0) 0x7ff92c001250 con 0x7ff9341096f0 2019-11-28T11:45:13.779 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 8949 2019-11-28T11:45:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.742+0000 7f2d6d70e700 1 -- 172.21.15.80:0/1056909255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d48018730 msgr2=0x7f2d4801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.742+0000 7f2d6d70e700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d48018730 0x7f2d4801abe0 crc :-1 s=READY pgs=700 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.742+0000 7f2d6d70e700 1 -- 172.21.15.80:0/1056909255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d6810b500 msgr2=0x7f2d681629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.742+0000 7f2d6d70e700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d6810b500 0x7f2d681629f0 secure :-1 s=READY pgs=1728 cs=0 l=1 rx=0x7f2d5c010410 tx=0x7f2d5c0107b0).stop 2019-11-28T11:45:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.743+0000 7f2d6d70e700 1 -- 172.21.15.80:0/1056909255 shutdown_connections 2019-11-28T11:45:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.743+0000 7f2d6d70e700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2d48018730 0x7f2d4801abe0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.743+0000 7f2d6d70e700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d6810b500 0x7f2d681629f0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.743+0000 7f2d6d70e700 1 --2- 172.21.15.80:0/1056909255 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d6813eb40 0x7f2d6810afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.743+0000 7f2d6d70e700 1 -- 172.21.15.80:0/1056909255 shutdown_connections 2019-11-28T11:45:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.743+0000 7f2d6d70e700 1 -- 172.21.15.80:0/1056909255 wait complete. 2019-11-28T11:45:13.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.743+0000 7f2d6d70e700 1 -- 172.21.15.80:0/1056909255 >> 172.21.15.80:0/1056909255 conn(0x7f2d6811bfc0 msgr2=0x7f2d68141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:13.784 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 8937 2019-11-28T11:45:13.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.747+0000 7ff93b26f700 1 -- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff914018770 msgr2=0x7ff91401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:13.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.747+0000 7ff93b26f700 1 --2- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff914018770 0x7ff91401abe0 crc :-1 s=READY pgs=698 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:13.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.747+0000 7ff93b26f700 1 -- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9341096f0 msgr2=0x7ff934169ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:13.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.747+0000 7ff93b26f700 1 --2- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9341096f0 0x7ff934169ed0 secure :-1 s=READY pgs=1002 cs=0 l=1 rx=0x7ff92c0103b0 tx=0x7ff92c010750).stop 2019-11-28T11:45:13.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.747+0000 7ff93b26f700 1 -- 172.21.15.80:0/369670690 shutdown_connections 2019-11-28T11:45:13.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.747+0000 7ff93b26f700 1 --2- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9341096f0 0x7ff934169ed0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:13.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.747+0000 7ff93b26f700 1 --2- 172.21.15.80:0/369670690 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff914018770 0x7ff91401abe0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:13.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.747+0000 7ff93b26f700 1 -- 172.21.15.80:0/369670690 shutdown_connections 2019-11-28T11:45:13.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.747+0000 7ff93b26f700 1 -- 172.21.15.80:0/369670690 wait complete. 2019-11-28T11:45:13.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.747+0000 7ff93b26f700 1 -- 172.21.15.80:0/369670690 >> 172.21.15.80:0/369670690 conn(0x7ff93413d620 msgr2=0x7ff93413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:13.788 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 8943 2019-11-28T11:45:13.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.750+0000 7f7e0f33b700 1 -- 172.21.15.80:0/4024497965 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7de8018730 msgr2=0x7f7de801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:13.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.750+0000 7f7e0f33b700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7de8018730 0x7f7de801abe0 crc :-1 s=READY pgs=699 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:13.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.750+0000 7f7e0f33b700 1 -- 172.21.15.80:0/4024497965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0810e670 msgr2=0x7f7e0813e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:13.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.750+0000 7f7e0f33b700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0810e670 0x7f7e0813e2f0 secure :-1 s=READY pgs=1726 cs=0 l=1 rx=0x7f7dfc010440 tx=0x7f7dfc0102f0).stop 2019-11-28T11:45:13.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.750+0000 7f7e0f33b700 1 -- 172.21.15.80:0/4024497965 shutdown_connections 2019-11-28T11:45:13.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.750+0000 7f7e0f33b700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7de8018730 0x7f7de801abe0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:13.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.750+0000 7f7e0f33b700 1 --2- 172.21.15.80:0/4024497965 >> v2:172.21.15.174:3300/0 conn(0x7f7e0813e830 0x7f7e0813ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:13.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.750+0000 7f7e0f33b700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e0810e670 0x7f7e0813e2f0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:13.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.750+0000 7f7e0f33b700 1 --2- 172.21.15.80:0/4024497965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e08104d10 0x7f7e0810e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:13.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.750+0000 7f7e0f33b700 1 -- 172.21.15.80:0/4024497965 shutdown_connections 2019-11-28T11:45:13.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.750+0000 7f7e0f33b700 1 -- 172.21.15.80:0/4024497965 wait complete. 2019-11-28T11:45:13.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.750+0000 7f7e0f33b700 1 -- 172.21.15.80:0/4024497965 >> 172.21.15.80:0/4024497965 conn(0x7f7e0815e210 msgr2=0x7f7e0810b140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:13.802 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:45:13.802 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:45:13.804 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:45:13.804 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:45:13.804 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:45:13.805 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:45:13.809 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:45:13.809 DEBUG:teuthology.parallel:result is None 2019-11-28T11:45:13.846 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:45:13.846 DEBUG:teuthology.parallel:result is None 2019-11-28T11:45:13.878 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:45:13.879 DEBUG:teuthology.parallel:result is None 2019-11-28T11:45:13.879 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:13.893 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:45:13.930 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:45:13.965 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:45:14.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.963+0000 7f78f3ca7700 1 Processor -- start 2019-11-28T11:45:14.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.963+0000 7f78f3ca7700 1 -- start start 2019-11-28T11:45:14.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.964+0000 7f78f3ca7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78ec06c490 0x7f78ec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:14.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.964+0000 7f78f3ca7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78ec06ce60 0x7f78ec164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:14.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.964+0000 7f78f3ca7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec06db00 con 0x7f78ec06c0a0 2019-11-28T11:45:14.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.964+0000 7f78f3ca7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ec06fd60 con 0x7f78ec06ce60 2019-11-28T11:45:14.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.964+0000 7f78f3ca7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec070030 con 0x7f78ec06c490 2019-11-28T11:45:14.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.964+0000 7f78f2a45700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78ec06ce60 0x7f78ec164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:14.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.964+0000 7f78f2244700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f78ec06c0a0 0x7f78ec072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39552/0 (socket says 172.21.15.80:39552) 2019-11-28T11:45:14.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.964+0000 7f78f2244700 1 -- 172.21.15.80:0/1641428102 learned_addr learned my addr 172.21.15.80:0/1641428102 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:14.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.964+0000 7f78f1a43700 1 --2- 172.21.15.80:0/1641428102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78ec06c490 0x7f78ec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:14.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.965+0000 7f78f2a45700 1 -- 172.21.15.80:0/1641428102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78ec06c490 msgr2=0x7f78ec06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:14.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.965+0000 7f78f2a45700 1 --2- 172.21.15.80:0/1641428102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78ec06c490 0x7f78ec06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:14.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.965+0000 7f78f2a45700 1 -- 172.21.15.80:0/1641428102 >> v1:172.21.15.80:6789/0 conn(0x7f78ec06c0a0 legacy=0x7f78ec072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:14.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.965+0000 7f78f2a45700 1 -- 172.21.15.80:0/1641428102 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec0706c0 con 0x7f78ec06ce60 2019-11-28T11:45:14.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.965+0000 7f78f1242700 1 -- 172.21.15.80:0/1641428102 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109294572 0 0) 0x7f78dc001480 con 0x7f78ec06c0a0 2019-11-28T11:45:14.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.965+0000 7f78f2a45700 1 --2- 172.21.15.80:0/1641428102 >> v2:172.21.15.80:3300/0 conn(0x7f78ec06ce60 0x7f78ec164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f78e400af50 tx=0x7f78e400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:14.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.965+0000 7f78f2a45700 1 --2- 172.21.15.80:0/1641428102 >> v2:172.21.15.80:3300/0 conn(0x7f78ec06ce60 0x7f78ec164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f78e400af50 tx=0x7f78e400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:14.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.965+0000 7f78f2a45700 1 --2- 172.21.15.80:0/1641428102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78ec06ce60 0x7f78ec164d70 secure :-1 s=READY pgs=1736 cs=0 l=1 rx=0x7f78e400af50 tx=0x7f78e400b6e0).ready entity=mon.0 client_cookie=d957f591d61a21a2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:14.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.965+0000 7f78f2a45700 1 --2- 172.21.15.80:0/1641428102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78ec06ce60 0x7f78ec164d70 secure :-1 s=THROTTLE_DONE pgs=1736 cs=0 l=1 rx=0x7f78e400af50 tx=0x7f78e400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:14.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.965+0000 7f78f1242700 1 -- 172.21.15.80:0/1641428102 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e4009ba0 con 0x7f78ec06ce60 2019-11-28T11:45:14.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.965+0000 7f78f2a45700 1 --2- 172.21.15.80:0/1641428102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78ec06ce60 0x7f78ec164d70 secure :-1 s=THROTTLE_DONE pgs=1736 cs=0 l=1 rx=0x7f78e400af50 tx=0x7f78e400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:14.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.965+0000 7f78f1242700 1 -- 172.21.15.80:0/1641428102 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e40097c0 con 0x7f78ec06ce60 2019-11-28T11:45:14.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.965+0000 7f78f2a45700 1 --2- 172.21.15.80:0/1641428102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78ec06ce60 0x7f78ec164d70 secure :-1 s=THROTTLE_DONE pgs=1736 cs=0 l=1 rx=0x7f78e400af50 tx=0x7f78e400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:14.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.965+0000 7f78f1242700 1 -- 172.21.15.80:0/1641428102 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e4009d90 con 0x7f78ec06ce60 2019-11-28T11:45:14.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.965+0000 7f78f3ca7700 1 -- 172.21.15.80:0/1641428102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78ec06ce60 msgr2=0x7f78ec164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:14.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.965+0000 7f78f3ca7700 1 --2- 172.21.15.80:0/1641428102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78ec06ce60 0x7f78ec164d70 secure :-1 s=READY pgs=1736 cs=0 l=1 rx=0x7f78e400af50 tx=0x7f78e400b6e0).stop 2019-11-28T11:45:14.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.966+0000 7f78f3ca7700 1 -- 172.21.15.80:0/1641428102 shutdown_connections 2019-11-28T11:45:14.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.966+0000 7f78f3ca7700 1 --2- 172.21.15.80:0/1641428102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78ec06ce60 0x7f78ec164d70 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:14.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.966+0000 7f78f3ca7700 1 --2- 172.21.15.80:0/1641428102 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78ec06c490 0x7f78ec06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:14.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.966+0000 7f78f3ca7700 1 -- 172.21.15.80:0/1641428102 shutdown_connections 2019-11-28T11:45:14.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.966+0000 7f78f3ca7700 1 -- 172.21.15.80:0/1641428102 wait complete. 2019-11-28T11:45:14.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.966+0000 7f78f3ca7700 1 -- 172.21.15.80:0/1641428102 >> 172.21.15.80:0/1641428102 conn(0x7f78ec061cf0 msgr2=0x7f78ec064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:14.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.968+0000 7f78f3ca7700 1 Processor -- start 2019-11-28T11:45:14.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.968+0000 7f78f3ca7700 1 -- start start 2019-11-28T11:45:14.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.969+0000 7f78f3ca7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f78ec1284f0 0x7f78ec128980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:14.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.969+0000 7f78f3ca7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec101e80 con 0x7f78ec142160 2019-11-28T11:45:14.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.969+0000 7f78f3ca7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec1049c0 con 0x7f78ec12e240 2019-11-28T11:45:14.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.969+0000 7f78f3ca7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ec107520 con 0x7f78ec1284f0 2019-11-28T11:45:14.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.969+0000 7f78f2244700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f78ec142160 0x7f78ec10de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39558/0 (socket says 172.21.15.80:39558) 2019-11-28T11:45:14.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.969+0000 7f78f2244700 1 -- 172.21.15.80:0/3398295409 learned_addr learned my addr 172.21.15.80:0/3398295409 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:14.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.969+0000 7f78f1a43700 1 --2- 172.21.15.80:0/3398295409 >> v2:172.21.15.174:3300/0 conn(0x7f78ec1284f0 0x7f78ec128980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:14.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.969+0000 7f78eaffd700 1 -- 172.21.15.80:0/3398295409 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2881592688 0 0) 0x7f78dc0014d0 con 0x7f78ec142160 2019-11-28T11:45:14.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.969+0000 7f78eaffd700 1 -- 172.21.15.80:0/3398295409 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78cc002e80 con 0x7f78ec142160 2019-11-28T11:45:14.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.970+0000 7f78eaffd700 1 -- 172.21.15.80:0/3398295409 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3734085188 0 0) 0x7f78dc0018e0 con 0x7f78ec142160 2019-11-28T11:45:14.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.970+0000 7f78f1a43700 1 -- 172.21.15.80:0/3398295409 >> v1:172.21.15.174:6789/0 conn(0x7f78ec12e240 legacy=0x7f78ec12e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:14.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.970+0000 7f78f1a43700 1 -- 172.21.15.80:0/3398295409 >> v1:172.21.15.80:6789/0 conn(0x7f78ec142160 legacy=0x7f78ec10de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:14.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.970+0000 7f78f1a43700 1 -- 172.21.15.80:0/3398295409 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec107e80 con 0x7f78ec1284f0 2019-11-28T11:45:14.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.970+0000 7f78f1a43700 1 --2- 172.21.15.80:0/3398295409 >> v2:172.21.15.174:3300/0 conn(0x7f78ec1284f0 0x7f78ec128980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78e0010390 tx=0x7f78e0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:14.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.970+0000 7f78f1a43700 1 --2- 172.21.15.80:0/3398295409 >> v2:172.21.15.174:3300/0 conn(0x7f78ec1284f0 0x7f78ec128980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78e0010390 tx=0x7f78e0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:14.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.970+0000 7f78f1a43700 1 --2- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78ec1284f0 0x7f78ec128980 secure :-1 s=READY pgs=1013 cs=0 l=1 rx=0x7f78e0010390 tx=0x7f78e0010730).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:14.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.970+0000 7f78f1a43700 1 --2- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78ec1284f0 0x7f78ec128980 secure :-1 s=THROTTLE_DONE pgs=1013 cs=0 l=1 rx=0x7f78e0010390 tx=0x7f78e0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:14.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.970+0000 7f78eaffd700 1 -- 172.21.15.80:0/3398295409 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e0009640 con 0x7f78ec1284f0 2019-11-28T11:45:14.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.970+0000 7f78f1a43700 1 --2- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78ec1284f0 0x7f78ec128980 secure :-1 s=THROTTLE_DONE pgs=1013 cs=0 l=1 rx=0x7f78e0010390 tx=0x7f78e0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:14.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.970+0000 7f78f1a43700 1 --2- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78ec1284f0 0x7f78ec128980 secure :-1 s=THROTTLE_DONE pgs=1013 cs=0 l=1 rx=0x7f78e0010390 tx=0x7f78e0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:14.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.970+0000 7f78eaffd700 1 -- 172.21.15.80:0/3398295409 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e0000940 con 0x7f78ec1284f0 2019-11-28T11:45:14.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.970+0000 7f78f3ca7700 1 -- 172.21.15.80:0/3398295409 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ec108200 con 0x7f78ec1284f0 2019-11-28T11:45:14.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.970+0000 7f78eaffd700 1 -- 172.21.15.80:0/3398295409 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e000a0e0 con 0x7f78ec1284f0 2019-11-28T11:45:14.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.970+0000 7f78f3ca7700 1 -- 172.21.15.80:0/3398295409 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ec107e80 con 0x7f78ec1284f0 2019-11-28T11:45:14.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.970+0000 7f78f1a43700 1 --2- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78ec1284f0 0x7f78ec128980 secure :-1 s=THROTTLE_DONE pgs=1013 cs=0 l=1 rx=0x7f78e0010390 tx=0x7f78e0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:14.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.971+0000 7f78eaffd700 1 -- 172.21.15.80:0/3398295409 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f78e0009a70 con 0x7f78ec1284f0 2019-11-28T11:45:14.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.971+0000 7f78f1a43700 1 --2- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78ec1284f0 0x7f78ec128980 secure :-1 s=THROTTLE_DONE pgs=1013 cs=0 l=1 rx=0x7f78e0010390 tx=0x7f78e0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:14.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.971+0000 7f78eaffd700 1 --2- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78cc018780 0x7f78cc01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:14.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.971+0000 7f78eaffd700 1 -- 172.21.15.80:0/3398295409 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f78e0031aa0 con 0x7f78ec1284f0 2019-11-28T11:45:14.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.971+0000 7f78f2244700 1 --2- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78cc018780 0x7f78cc01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:14.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.971+0000 7f78f2244700 1 --2- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78cc018780 0x7f78cc01abf0 crc :-1 s=READY pgs=701 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:14.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.978+0000 7f78f3ca7700 1 -- 172.21.15.80:0/3398295409 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ec108200 con 0x7f78ec1284f0 2019-11-28T11:45:14.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.982+0000 7f78f1a43700 1 --2- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78ec1284f0 0x7f78ec128980 secure :-1 s=THROTTLE_DONE pgs=1013 cs=0 l=1 rx=0x7f78e0010390 tx=0x7f78e0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:14.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:13.983+0000 7f78eaffd700 1 -- 172.21.15.80:0/3398295409 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f78e0009860 con 0x7f78ec1284f0 2019-11-28T11:45:14.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:14.153+0000 7f78f3ca7700 1 -- 172.21.15.80:0/3398295409 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78ec107e80 con 0x7f78ec1284f0 2019-11-28T11:45:14.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:14.153+0000 7f78f1a43700 1 --2- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78ec1284f0 0x7f78ec128980 secure :-1 s=THROTTLE_DONE pgs=1013 cs=0 l=1 rx=0x7f78e0010390 tx=0x7f78e0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:14.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:14.153+0000 7f78eaffd700 1 -- 172.21.15.80:0/3398295409 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+1430 (secure 0 0 0) 0x7f78e000a410 con 0x7f78ec1284f0 2019-11-28T11:45:14.193 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 94 2019-11-28T11:45:14.193 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:14.194 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":94,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:01.366373+0000","modified":"2019-11-28T11:45:13.699678+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":130,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2019-11-28T11:45:14.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:14.156+0000 7f78f3ca7700 1 -- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78cc018780 msgr2=0x7f78cc01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:14.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:14.156+0000 7f78f3ca7700 1 --2- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78cc018780 0x7f78cc01abf0 crc :-1 s=READY pgs=701 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:14.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:14.156+0000 7f78f3ca7700 1 -- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78ec1284f0 msgr2=0x7f78ec128980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:14.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:14.156+0000 7f78f3ca7700 1 --2- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78ec1284f0 0x7f78ec128980 secure :-1 s=READY pgs=1013 cs=0 l=1 rx=0x7f78e0010390 tx=0x7f78e0010730).stop 2019-11-28T11:45:14.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:14.156+0000 7f78f3ca7700 1 -- 172.21.15.80:0/3398295409 shutdown_connections 2019-11-28T11:45:14.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:14.156+0000 7f78f3ca7700 1 --2- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f78cc018780 0x7f78cc01abf0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:14.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:14.156+0000 7f78f3ca7700 1 --2- 172.21.15.80:0/3398295409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78ec1284f0 0x7f78ec128980 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:14.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:14.156+0000 7f78f3ca7700 1 -- 172.21.15.80:0/3398295409 shutdown_connections 2019-11-28T11:45:14.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:14.156+0000 7f78f3ca7700 1 -- 172.21.15.80:0/3398295409 wait complete. 2019-11-28T11:45:14.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:14.156+0000 7f78f3ca7700 1 -- 172.21.15.80:0/3398295409 >> 172.21.15.80:0/3398295409 conn(0x7f78ec15e210 msgr2=0x7f78ec10b140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:14.205 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T11:45:14.567 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:45:14.572 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:45:14.576 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:45:14.580 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:45:14.584 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:45:14.588 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:45:15.206 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.287+0000 7fd4fc4c1700 1 Processor -- start 2019-11-28T11:45:15.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.287+0000 7fd4fc4c1700 1 -- start start 2019-11-28T11:45:15.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.288+0000 7fd4fc4c1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f406c0a0 0x7fd4f4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:15.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.288+0000 7fd4fc4c1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f406db00 con 0x7fd4f40734e0 2019-11-28T11:45:15.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.288+0000 7fd4fc4c1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f406e000 con 0x7fd4f4072620 2019-11-28T11:45:15.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.288+0000 7fd4fc4c1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f406f330 con 0x7fd4f406c0a0 2019-11-28T11:45:15.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.288+0000 7fd4fa25d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd4f40734e0 0x7fd4f4071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39572/0 (socket says 172.21.15.80:39572) 2019-11-28T11:45:15.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.288+0000 7fd4fa25d700 1 -- 172.21.15.80:0/3524857577 learned_addr learned my addr 172.21.15.80:0/3524857577 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:15.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.288+0000 7fd4faa5e700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f406c0a0 0x7fd4f4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:15.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.288+0000 7fd4f9a5c700 1 -- 172.21.15.80:0/3524857577 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346891923 0 0) 0x7fd4e4001070 con 0x7fd4f40734e0 2019-11-28T11:45:15.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 -- 172.21.15.80:0/3524857577 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4e0002e80 con 0x7fd4f40734e0 2019-11-28T11:45:15.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 -- 172.21.15.80:0/3524857577 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756913296 0 0) 0x7fd4ec001080 con 0x7fd4f4072620 2019-11-28T11:45:15.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 -- 172.21.15.80:0/3524857577 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4e00030b0 con 0x7fd4f4072620 2019-11-28T11:45:15.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 -- 172.21.15.80:0/3524857577 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 161656971 0 0) 0x7fd4e4001050 con 0x7fd4f40734e0 2019-11-28T11:45:15.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 -- 172.21.15.80:0/3524857577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f406c0a0 msgr2=0x7fd4f4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:15.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f406c0a0 0x7fd4f4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:15.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 -- 172.21.15.80:0/3524857577 >> v1:172.21.15.174:6789/0 conn(0x7fd4f4072620 legacy=0x7fd4f4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:15.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 -- 172.21.15.80:0/3524857577 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f40706c0 con 0x7fd4f40734e0 2019-11-28T11:45:15.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 -- 172.21.15.80:0/3524857577 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd4e4001580 con 0x7fd4f40734e0 2019-11-28T11:45:15.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 -- 172.21.15.80:0/3524857577 >> v1:172.21.15.80:6789/0 conn(0x7fd4f40734e0 legacy=0x7fd4f4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e0003b80 0x7fd4e0005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e0006650 0x7fd4e0008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e004d330 0x7fd4e004f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 -- 172.21.15.80:0/3524857577 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e004ffe0 con 0x7fd4e0006650 2019-11-28T11:45:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 -- 172.21.15.80:0/3524857577 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e0050210 con 0x7fd4e004d330 2019-11-28T11:45:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 -- 172.21.15.80:0/3524857577 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e0050440 con 0x7fd4e0003b80 2019-11-28T11:45:15.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4fa25d700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e0006650 0x7fd4e0008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4faa5e700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e0003b80 0x7fd4e0005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4fb25f700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e004d330 0x7fd4e004f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4fa25d700 1 -- 172.21.15.80:0/3524857577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e0003b80 msgr2=0x7fd4e0005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4fa25d700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e0003b80 0x7fd4e0005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4fa25d700 1 -- 172.21.15.80:0/3524857577 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e004d330 msgr2=0x7fd4e004f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4fa25d700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e004d330 0x7fd4e004f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:15.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4fa25d700 1 -- 172.21.15.80:0/3524857577 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e00506f0 con 0x7fd4e0006650 2019-11-28T11:45:15.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4fb25f700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e004d330 0x7fd4e004f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:15.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4fa25d700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e0006650 0x7fd4e0008b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd4e400f910 tx=0x7fd4e400f710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:15.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4fa25d700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e0006650 0x7fd4e0008b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd4e400f910 tx=0x7fd4e400f710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:15.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4fa25d700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e0006650 0x7fd4e0008b20 secure :-1 s=READY pgs=1739 cs=0 l=1 rx=0x7fd4e400f910 tx=0x7fd4e400f710).ready entity=mon.0 client_cookie=455a9ad1e96b42cb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:15.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4fa25d700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e0006650 0x7fd4e0008b20 secure :-1 s=THROTTLE_DONE pgs=1739 cs=0 l=1 rx=0x7fd4e400f910 tx=0x7fd4e400f710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:15.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 -- 172.21.15.80:0/3524857577 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4e4001050 con 0x7fd4e0006650 2019-11-28T11:45:15.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4fa25d700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e0006650 0x7fd4e0008b20 secure :-1 s=THROTTLE_DONE pgs=1739 cs=0 l=1 rx=0x7fd4e400f910 tx=0x7fd4e400f710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:15.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4fa25d700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e0006650 0x7fd4e0008b20 secure :-1 s=THROTTLE_DONE pgs=1739 cs=0 l=1 rx=0x7fd4e400f910 tx=0x7fd4e400f710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:15.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 -- 172.21.15.80:0/3524857577 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e4004290 con 0x7fd4e0006650 2019-11-28T11:45:15.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4f9a5c700 1 -- 172.21.15.80:0/3524857577 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4e40049e0 con 0x7fd4e0006650 2019-11-28T11:45:15.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4fc4c1700 1 -- 172.21.15.80:0/3524857577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e0006650 msgr2=0x7fd4e0008b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:15.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.289+0000 7fd4fc4c1700 1 --2- 172.21.15.80:0/3524857577 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e0006650 0x7fd4e0008b20 secure :-1 s=READY pgs=1739 cs=0 l=1 rx=0x7fd4e400f910 tx=0x7fd4e400f710).stop 2019-11-28T11:45:15.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.290+0000 7fd4fb25f700 1 -- 172.21.15.80:0/3524857577 reap_dead start 2019-11-28T11:45:15.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.290+0000 7fd4fc4c1700 1 -- 172.21.15.80:0/3524857577 shutdown_connections 2019-11-28T11:45:15.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.290+0000 7fd4fc4c1700 1 -- 172.21.15.80:0/3524857577 shutdown_connections 2019-11-28T11:45:15.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.290+0000 7fd4fc4c1700 1 -- 172.21.15.80:0/3524857577 wait complete. 2019-11-28T11:45:15.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.290+0000 7fd4fc4c1700 1 -- 172.21.15.80:0/3524857577 >> 172.21.15.80:0/3524857577 conn(0x7fd4f4061cf0 msgr2=0x7fd4f4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:15.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.293+0000 7fd4fc4c1700 1 Processor -- start 2019-11-28T11:45:15.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.293+0000 7fd4fc4c1700 1 -- start start 2019-11-28T11:45:15.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4fc4c1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd4f4074d00 0x7fd4f407aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:15.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4fc4c1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f4150f50 0x7fd4f407af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:15.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4fc4c1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd4f407bba0 0x7fd4f407b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:15.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4fc4c1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f4078980 con 0x7fd4f4074d00 2019-11-28T11:45:15.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4fc4c1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f4078c50 con 0x7fd4f407bba0 2019-11-28T11:45:15.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4fc4c1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f4077f50 con 0x7fd4f4150f50 2019-11-28T11:45:15.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4faa5e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd4f4074d00 0x7fd4f407aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:15.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4faa5e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd4f4074d00 0x7fd4f407aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40264/0 (socket says 172.21.15.80:40264) 2019-11-28T11:45:15.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4faa5e700 1 -- 172.21.15.80:0/3445929402 learned_addr learned my addr 172.21.15.80:0/3445929402 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:15.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4fa25d700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f4150f50 0x7fd4f407af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:15.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4fb25f700 1 --2- 172.21.15.80:0/3445929402 >> v2:172.21.15.174:3300/0 conn(0x7fd4f407bba0 0x7fd4f407b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:15.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4faa5e700 1 -- 172.21.15.80:0/3445929402 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f4150f50 msgr2=0x7fd4f407af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:15.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4faa5e700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f4150f50 0x7fd4f407af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:15.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4faa5e700 1 -- 172.21.15.80:0/3445929402 >> v2:172.21.15.174:3300/0 conn(0x7fd4f407bba0 msgr2=0x7fd4f407b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:15.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4faa5e700 1 --2- 172.21.15.80:0/3445929402 >> v2:172.21.15.174:3300/0 conn(0x7fd4f407bba0 0x7fd4f407b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:15.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4faa5e700 1 -- 172.21.15.80:0/3445929402 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f40792e0 con 0x7fd4f4074d00 2019-11-28T11:45:15.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4fa25d700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f4150f50 0x7fd4f407af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:15.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4fb25f700 1 --2- 172.21.15.80:0/3445929402 >> v2:172.21.15.174:3300/0 conn(0x7fd4f407bba0 0x7fd4f407b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:15.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4faa5e700 1 --2- 172.21.15.80:0/3445929402 >> v2:172.21.15.80:3300/0 conn(0x7fd4f4074d00 0x7fd4f407aa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4dc0107d0 tx=0x7fd4dc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:15.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4faa5e700 1 --2- 172.21.15.80:0/3445929402 >> v2:172.21.15.80:3300/0 conn(0x7fd4f4074d00 0x7fd4f407aa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4dc0107d0 tx=0x7fd4dc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:15.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4faa5e700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4f4074d00 0x7fd4f407aa20 secure :-1 s=READY pgs=1740 cs=0 l=1 rx=0x7fd4dc0107d0 tx=0x7fd4dc010b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:15.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4faa5e700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4f4074d00 0x7fd4f407aa20 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fd4dc0107d0 tx=0x7fd4dc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:15.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4faa5e700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4f4074d00 0x7fd4f407aa20 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fd4dc0107d0 tx=0x7fd4dc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:15.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4f37fe700 1 -- 172.21.15.80:0/3445929402 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4dc001200 con 0x7fd4f4074d00 2019-11-28T11:45:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4faa5e700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4f4074d00 0x7fd4f407aa20 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fd4dc0107d0 tx=0x7fd4dc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4f37fe700 1 -- 172.21.15.80:0/3445929402 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc000cc0 con 0x7fd4f4074d00 2019-11-28T11:45:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4f37fe700 1 -- 172.21.15.80:0/3445929402 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4dc0017e0 con 0x7fd4f4074d00 2019-11-28T11:45:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4fc4c1700 1 -- 172.21.15.80:0/3445929402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f4079660 con 0x7fd4f4074d00 2019-11-28T11:45:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.294+0000 7fd4fc4c1700 1 -- 172.21.15.80:0/3445929402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f40792e0 con 0x7fd4f4074d00 2019-11-28T11:45:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.295+0000 7fd4faa5e700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4f4074d00 0x7fd4f407aa20 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fd4dc0107d0 tx=0x7fd4dc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:15.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.295+0000 7fd4f37fe700 1 -- 172.21.15.80:0/3445929402 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd4dc001010 con 0x7fd4f4074d00 2019-11-28T11:45:15.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.295+0000 7fd4faa5e700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4f4074d00 0x7fd4f407aa20 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fd4dc0107d0 tx=0x7fd4dc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:15.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.295+0000 7fd4f37fe700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4d8018730 0x7fd4d801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:15.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.295+0000 7fd4f37fe700 1 -- 172.21.15.80:0/3445929402 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fd4dc031dc0 con 0x7fd4f4074d00 2019-11-28T11:45:15.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.295+0000 7fd4fa25d700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4d8018730 0x7fd4d801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:15.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.295+0000 7fd4fa25d700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4d8018730 0x7fd4d801abc0 crc :-1 s=READY pgs=704 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:15.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.302+0000 7fd4fc4c1700 1 -- 172.21.15.80:0/3445929402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f4079660 con 0x7fd4f4074d00 2019-11-28T11:45:15.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.306+0000 7fd4faa5e700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4f4074d00 0x7fd4f407aa20 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fd4dc0107d0 tx=0x7fd4dc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:15.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.306+0000 7fd4f37fe700 1 -- 172.21.15.80:0/3445929402 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd4dc023460 con 0x7fd4f4074d00 2019-11-28T11:45:15.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.477+0000 7fd4fc4c1700 1 -- 172.21.15.80:0/3445929402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4f40792e0 con 0x7fd4f4074d00 2019-11-28T11:45:15.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.477+0000 7fd4faa5e700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4f4074d00 0x7fd4f407aa20 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fd4dc0107d0 tx=0x7fd4dc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:15.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.477+0000 7fd4f37fe700 1 -- 172.21.15.80:0/3445929402 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+2109 (secure 0 0 0) 0x7fd4dc023460 con 0x7fd4f4074d00 2019-11-28T11:45:15.518 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 96 2019-11-28T11:45:15.518 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:15.518 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":96,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/622188474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":622188474},{"type":"v1","addr":"172.21.15.80:6835","nonce":622188474}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":95}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:01.366373+0000","modified":"2019-11-28T11:45:14.711225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":130,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8530":{"gid":8530,"name":"c","rank":0,"incarnation":96,"state":"up:replay","state_seq":1,"addr":"172.21.15.174:6835/588051121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588051121},{"type":"v1","addr":"172.21.15.174:6835","nonce":588051121}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2019-11-28T11:45:15.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.480+0000 7fd4fc4c1700 1 -- 172.21.15.80:0/3445929402 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4d8018730 msgr2=0x7fd4d801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:15.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.480+0000 7fd4fc4c1700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4d8018730 0x7fd4d801abc0 crc :-1 s=READY pgs=704 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:15.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.480+0000 7fd4fc4c1700 1 -- 172.21.15.80:0/3445929402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4f4074d00 msgr2=0x7fd4f407aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:15.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.480+0000 7fd4fc4c1700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4f4074d00 0x7fd4f407aa20 secure :-1 s=READY pgs=1740 cs=0 l=1 rx=0x7fd4dc0107d0 tx=0x7fd4dc010b70).stop 2019-11-28T11:45:15.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.480+0000 7fd4fc4c1700 1 -- 172.21.15.80:0/3445929402 shutdown_connections 2019-11-28T11:45:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.480+0000 7fd4fc4c1700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4d8018730 0x7fd4d801abc0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.480+0000 7fd4fc4c1700 1 --2- 172.21.15.80:0/3445929402 >> v2:172.21.15.174:3300/0 conn(0x7fd4f407bba0 0x7fd4f407b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.480+0000 7fd4fc4c1700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4f4150f50 0x7fd4f407af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.480+0000 7fd4fc4c1700 1 --2- 172.21.15.80:0/3445929402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4f4074d00 0x7fd4f407aa20 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.480+0000 7fd4fc4c1700 1 -- 172.21.15.80:0/3445929402 shutdown_connections 2019-11-28T11:45:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.480+0000 7fd4fc4c1700 1 -- 172.21.15.80:0/3445929402 wait complete. 2019-11-28T11:45:15.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:15.480+0000 7fd4fc4c1700 1 -- 172.21.15.80:0/3445929402 >> 172.21.15.80:0/3445929402 conn(0x7fd4f413fa50 msgr2=0x7fd4f407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:15.529 INFO:tasks.cephfs.filesystem:mapped states [u'up:replay'] to None 2019-11-28T11:45:16.530 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:16.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.616+0000 7f2e6bcbe700 1 Processor -- start 2019-11-28T11:45:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.616+0000 7f2e6bcbe700 1 -- start start 2019-11-28T11:45:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.617+0000 7f2e6bcbe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2e6406c0a0 0x7f2e64072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.617+0000 7f2e6bcbe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e640734e0 0x7f2e64071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.617+0000 7f2e6bcbe700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6406db00 con 0x7f2e64072360 2019-11-28T11:45:16.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.617+0000 7f2e6bcbe700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6406fd60 con 0x7f2e640734e0 2019-11-28T11:45:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.617+0000 7f2e6bcbe700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e64070030 con 0x7f2e6406c0a0 2019-11-28T11:45:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.617+0000 7f2e69a5a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e640734e0 0x7f2e64071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.617+0000 7f2e69a5a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e640734e0 0x7f2e64071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40278/0 (socket says 172.21.15.80:40278) 2019-11-28T11:45:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.617+0000 7f2e69a5a700 1 -- 172.21.15.80:0/1283462938 learned_addr learned my addr 172.21.15.80:0/1283462938 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.617+0000 7f2e6a25b700 1 --2- 172.21.15.80:0/1283462938 >> v2:172.21.15.174:3300/0 conn(0x7f2e6406c0a0 0x7f2e64072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.617+0000 7f2e69a5a700 1 -- 172.21.15.80:0/1283462938 >> v2:172.21.15.174:3300/0 conn(0x7f2e6406c0a0 msgr2=0x7f2e64072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:16.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.617+0000 7f2e69a5a700 1 --2- 172.21.15.80:0/1283462938 >> v2:172.21.15.174:3300/0 conn(0x7f2e6406c0a0 0x7f2e64072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.617+0000 7f2e69a5a700 1 -- 172.21.15.80:0/1283462938 >> v1:172.21.15.174:6789/0 conn(0x7f2e64072360 legacy=0x7f2e6406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.617+0000 7f2e69a5a700 1 -- 172.21.15.80:0/1283462938 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e640706c0 con 0x7f2e640734e0 2019-11-28T11:45:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.617+0000 7f2e69a5a700 1 --2- 172.21.15.80:0/1283462938 >> v2:172.21.15.80:3300/0 conn(0x7f2e640734e0 0x7f2e64071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2e5c00f6c0 tx=0x7f2e5c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.618+0000 7f2e69a5a700 1 --2- 172.21.15.80:0/1283462938 >> v2:172.21.15.80:3300/0 conn(0x7f2e640734e0 0x7f2e64071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2e5c00f6c0 tx=0x7f2e5c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.618+0000 7f2e69a5a700 1 --2- 172.21.15.80:0/1283462938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e640734e0 0x7f2e64071e20 secure :-1 s=READY pgs=1741 cs=0 l=1 rx=0x7f2e5c00f6c0 tx=0x7f2e5c00fa60).ready entity=mon.0 client_cookie=e0bc00ddaacd512f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.618+0000 7f2e69a5a700 1 --2- 172.21.15.80:0/1283462938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e640734e0 0x7f2e64071e20 secure :-1 s=THROTTLE_DONE pgs=1741 cs=0 l=1 rx=0x7f2e5c00f6c0 tx=0x7f2e5c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.618+0000 7f2e69a5a700 1 --2- 172.21.15.80:0/1283462938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e640734e0 0x7f2e64071e20 secure :-1 s=THROTTLE_DONE pgs=1741 cs=0 l=1 rx=0x7f2e5c00f6c0 tx=0x7f2e5c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.618+0000 7f2e69a5a700 1 --2- 172.21.15.80:0/1283462938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e640734e0 0x7f2e64071e20 secure :-1 s=THROTTLE_DONE pgs=1741 cs=0 l=1 rx=0x7f2e5c00f6c0 tx=0x7f2e5c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.618+0000 7f2e69259700 1 -- 172.21.15.80:0/1283462938 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e5c000960 con 0x7f2e640734e0 2019-11-28T11:45:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.618+0000 7f2e69259700 1 -- 172.21.15.80:0/1283462938 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c000c90 con 0x7f2e640734e0 2019-11-28T11:45:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.618+0000 7f2e69259700 1 -- 172.21.15.80:0/1283462938 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e5c0013a0 con 0x7f2e640734e0 2019-11-28T11:45:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.618+0000 7f2e6bcbe700 1 -- 172.21.15.80:0/1283462938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e640734e0 msgr2=0x7f2e64071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.618+0000 7f2e6bcbe700 1 --2- 172.21.15.80:0/1283462938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e640734e0 0x7f2e64071e20 secure :-1 s=READY pgs=1741 cs=0 l=1 rx=0x7f2e5c00f6c0 tx=0x7f2e5c00fa60).stop 2019-11-28T11:45:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.619+0000 7f2e6bcbe700 1 -- 172.21.15.80:0/1283462938 shutdown_connections 2019-11-28T11:45:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.619+0000 7f2e6bcbe700 1 --2- 172.21.15.80:0/1283462938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e640734e0 0x7f2e64071e20 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.619+0000 7f2e6bcbe700 1 --2- 172.21.15.80:0/1283462938 >> v2:172.21.15.174:3300/0 conn(0x7f2e6406c0a0 0x7f2e64072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.619+0000 7f2e6bcbe700 1 -- 172.21.15.80:0/1283462938 shutdown_connections 2019-11-28T11:45:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.619+0000 7f2e6bcbe700 1 -- 172.21.15.80:0/1283462938 wait complete. 2019-11-28T11:45:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.619+0000 7f2e6bcbe700 1 -- 172.21.15.80:0/1283462938 >> 172.21.15.80:0/1283462938 conn(0x7f2e64061cf0 msgr2=0x7f2e64064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:16.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.621+0000 7f2e6bcbe700 1 Processor -- start 2019-11-28T11:45:16.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.621+0000 7f2e6bcbe700 1 -- start start 2019-11-28T11:45:16.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.622+0000 7f2e6bcbe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2e6413e320 0x7f2e6413e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:16.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.622+0000 7f2e6bcbe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e6412a3c0 0x7f2e6412a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:16.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.622+0000 7f2e6bcbe700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e64139e00 con 0x7f2e6415fdf0 2019-11-28T11:45:16.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.622+0000 7f2e6bcbe700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e64108820 con 0x7f2e6412a3c0 2019-11-28T11:45:16.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.622+0000 7f2e6bcbe700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e64108af0 con 0x7f2e6413e320 2019-11-28T11:45:16.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.622+0000 7f2e6a25b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2e6415fdf0 0x7f2e6412b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39596/0 (socket says 172.21.15.80:39596) 2019-11-28T11:45:16.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.622+0000 7f2e6a25b700 1 -- 172.21.15.80:0/556718016 learned_addr learned my addr 172.21.15.80:0/556718016 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:16.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.622+0000 7f2e6aa5c700 1 --2- 172.21.15.80:0/556718016 >> v2:172.21.15.80:3300/0 conn(0x7f2e6412a3c0 0x7f2e6412a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:16.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.622+0000 7f2e69a5a700 1 --2- 172.21.15.80:0/556718016 >> v2:172.21.15.174:3300/0 conn(0x7f2e6413e320 0x7f2e6413e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:16.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.622+0000 7f2e6aa5c700 1 -- 172.21.15.80:0/556718016 >> v2:172.21.15.174:3300/0 conn(0x7f2e6413e320 msgr2=0x7f2e6413e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:16.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.622+0000 7f2e6aa5c700 1 --2- 172.21.15.80:0/556718016 >> v2:172.21.15.174:3300/0 conn(0x7f2e6413e320 0x7f2e6413e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:16.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.622+0000 7f2e6aa5c700 1 -- 172.21.15.80:0/556718016 >> v1:172.21.15.80:6789/0 conn(0x7f2e6415fdf0 legacy=0x7f2e6412b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:16.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.622+0000 7f2e62ffd700 1 -- 172.21.15.80:0/556718016 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279251315 0 0) 0x7f2e4c001330 con 0x7f2e6415fdf0 2019-11-28T11:45:16.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.622+0000 7f2e6aa5c700 1 -- 172.21.15.80:0/556718016 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6410a8c0 con 0x7f2e6412a3c0 2019-11-28T11:45:16.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.622+0000 7f2e6aa5c700 1 --2- 172.21.15.80:0/556718016 >> v2:172.21.15.80:3300/0 conn(0x7f2e6412a3c0 0x7f2e6412a820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2e540103b0 tx=0x7f2e5400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:16.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.623+0000 7f2e6aa5c700 1 --2- 172.21.15.80:0/556718016 >> v2:172.21.15.80:3300/0 conn(0x7f2e6412a3c0 0x7f2e6412a820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2e540103b0 tx=0x7f2e5400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:16.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.623+0000 7f2e6aa5c700 1 --2- 172.21.15.80:0/556718016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e6412a3c0 0x7f2e6412a820 secure :-1 s=READY pgs=1743 cs=0 l=1 rx=0x7f2e540103b0 tx=0x7f2e5400b2f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:16.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.623+0000 7f2e6aa5c700 1 --2- 172.21.15.80:0/556718016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e6412a3c0 0x7f2e6412a820 secure :-1 s=THROTTLE_DONE pgs=1743 cs=0 l=1 rx=0x7f2e540103b0 tx=0x7f2e5400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:16.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.623+0000 7f2e62ffd700 1 -- 172.21.15.80:0/556718016 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e54000a50 con 0x7f2e6412a3c0 2019-11-28T11:45:16.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.623+0000 7f2e6aa5c700 1 --2- 172.21.15.80:0/556718016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e6412a3c0 0x7f2e6412a820 secure :-1 s=THROTTLE_DONE pgs=1743 cs=0 l=1 rx=0x7f2e540103b0 tx=0x7f2e5400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:16.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.623+0000 7f2e6aa5c700 1 --2- 172.21.15.80:0/556718016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e6412a3c0 0x7f2e6412a820 secure :-1 s=THROTTLE_DONE pgs=1743 cs=0 l=1 rx=0x7f2e540103b0 tx=0x7f2e5400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:16.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.623+0000 7f2e62ffd700 1 -- 172.21.15.80:0/556718016 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5400ede0 con 0x7f2e6412a3c0 2019-11-28T11:45:16.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.623+0000 7f2e6bcbe700 1 -- 172.21.15.80:0/556718016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6410a8c0 con 0x7f2e6412a3c0 2019-11-28T11:45:16.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.623+0000 7f2e62ffd700 1 -- 172.21.15.80:0/556718016 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e5400f4f0 con 0x7f2e6412a3c0 2019-11-28T11:45:16.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.623+0000 7f2e6bcbe700 1 -- 172.21.15.80:0/556718016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6410a8c0 con 0x7f2e6412a3c0 2019-11-28T11:45:16.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.623+0000 7f2e6aa5c700 1 --2- 172.21.15.80:0/556718016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e6412a3c0 0x7f2e6412a820 secure :-1 s=THROTTLE_DONE pgs=1743 cs=0 l=1 rx=0x7f2e540103b0 tx=0x7f2e5400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:16.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.623+0000 7f2e62ffd700 1 -- 172.21.15.80:0/556718016 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2e5400efd0 con 0x7f2e6412a3c0 2019-11-28T11:45:16.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.623+0000 7f2e6aa5c700 1 --2- 172.21.15.80:0/556718016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e6412a3c0 0x7f2e6412a820 secure :-1 s=THROTTLE_DONE pgs=1743 cs=0 l=1 rx=0x7f2e540103b0 tx=0x7f2e5400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:16.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.623+0000 7f2e62ffd700 1 --2- 172.21.15.80:0/556718016 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e48018730 0x7f2e4801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:16.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.623+0000 7f2e62ffd700 1 -- 172.21.15.80:0/556718016 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f2e54031a00 con 0x7f2e6412a3c0 2019-11-28T11:45:16.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.624+0000 7f2e6a25b700 1 --2- 172.21.15.80:0/556718016 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e48018730 0x7f2e4801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:16.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.624+0000 7f2e6a25b700 1 --2- 172.21.15.80:0/556718016 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e48018730 0x7f2e4801abc0 crc :-1 s=READY pgs=707 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:16.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.631+0000 7f2e6bcbe700 1 -- 172.21.15.80:0/556718016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e64109180 con 0x7f2e6412a3c0 2019-11-28T11:45:16.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.635+0000 7f2e6aa5c700 1 --2- 172.21.15.80:0/556718016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e6412a3c0 0x7f2e6412a820 secure :-1 s=THROTTLE_DONE pgs=1743 cs=0 l=1 rx=0x7f2e540103b0 tx=0x7f2e5400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:16.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.635+0000 7f2e62ffd700 1 -- 172.21.15.80:0/556718016 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2e54000a10 con 0x7f2e6412a3c0 2019-11-28T11:45:16.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.813+0000 7f2e6bcbe700 1 -- 172.21.15.80:0/556718016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e64109500 con 0x7f2e6412a3c0 2019-11-28T11:45:16.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.813+0000 7f2e6aa5c700 1 --2- 172.21.15.80:0/556718016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e6412a3c0 0x7f2e6412a820 secure :-1 s=THROTTLE_DONE pgs=1743 cs=0 l=1 rx=0x7f2e540103b0 tx=0x7f2e5400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:16.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.813+0000 7f2e62ffd700 1 -- 172.21.15.80:0/556718016 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+2109 (secure 0 0 0) 0x7f2e5400efd0 con 0x7f2e6412a3c0 2019-11-28T11:45:16.853 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 98 2019-11-28T11:45:16.853 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:16.854 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":98,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/622188474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":622188474},{"type":"v1","addr":"172.21.15.80:6835","nonce":622188474}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":95}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:01.366373+0000","modified":"2019-11-28T11:45:16.716804+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":130,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8530":{"gid":8530,"name":"c","rank":0,"incarnation":96,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.174:6835/588051121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588051121},{"type":"v1","addr":"172.21.15.174:6835","nonce":588051121}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2019-11-28T11:45:16.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.816+0000 7f2e6bcbe700 1 -- 172.21.15.80:0/556718016 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e48018730 msgr2=0x7f2e4801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:16.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.816+0000 7f2e6bcbe700 1 --2- 172.21.15.80:0/556718016 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e48018730 0x7f2e4801abc0 crc :-1 s=READY pgs=707 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:16.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.816+0000 7f2e6bcbe700 1 -- 172.21.15.80:0/556718016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e6412a3c0 msgr2=0x7f2e6412a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:16.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.816+0000 7f2e6bcbe700 1 --2- 172.21.15.80:0/556718016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e6412a3c0 0x7f2e6412a820 secure :-1 s=READY pgs=1743 cs=0 l=1 rx=0x7f2e540103b0 tx=0x7f2e5400b2f0).stop 2019-11-28T11:45:16.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.816+0000 7f2e6bcbe700 1 -- 172.21.15.80:0/556718016 shutdown_connections 2019-11-28T11:45:16.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.816+0000 7f2e6bcbe700 1 --2- 172.21.15.80:0/556718016 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2e48018730 0x7f2e4801abc0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:16.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.816+0000 7f2e6bcbe700 1 --2- 172.21.15.80:0/556718016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e6412a3c0 0x7f2e6412a820 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:16.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.816+0000 7f2e6bcbe700 1 --2- 172.21.15.80:0/556718016 >> v2:172.21.15.174:3300/0 conn(0x7f2e6413e320 0x7f2e6413e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:16.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.816+0000 7f2e6bcbe700 1 -- 172.21.15.80:0/556718016 shutdown_connections 2019-11-28T11:45:16.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.816+0000 7f2e6bcbe700 1 -- 172.21.15.80:0/556718016 wait complete. 2019-11-28T11:45:16.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:16.816+0000 7f2e6bcbe700 1 -- 172.21.15.80:0/556718016 >> 172.21.15.80:0/556718016 conn(0x7f2e64127dc0 msgr2=0x7f2e64141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:16.865 INFO:tasks.cephfs.filesystem:mapped states [u'up:rejoin'] to None 2019-11-28T11:45:17.866 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:17.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.948+0000 7fb11aac6700 1 Processor -- start 2019-11-28T11:45:17.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.948+0000 7fb11aac6700 1 -- start start 2019-11-28T11:45:17.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.949+0000 7fb11aac6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb11406c0a0 0x7fb114072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:17.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.949+0000 7fb11aac6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb114072620 0x7fb114164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:17.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.949+0000 7fb11aac6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11406db00 con 0x7fb1140734e0 2019-11-28T11:45:17.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.949+0000 7fb11aac6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11406f330 con 0x7fb114072620 2019-11-28T11:45:17.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.949+0000 7fb11aac6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1140706c0 con 0x7fb11406c0a0 2019-11-28T11:45:17.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.949+0000 7fb119864700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb114072620 0x7fb114164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:17.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.949+0000 7fb119864700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb114072620 0x7fb114164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40290/0 (socket says 172.21.15.80:40290) 2019-11-28T11:45:17.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.949+0000 7fb119864700 1 -- 172.21.15.80:0/995839336 learned_addr learned my addr 172.21.15.80:0/995839336 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:17.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.949+0000 7fb119063700 1 --2- 172.21.15.80:0/995839336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb11406c0a0 0x7fb114072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:17.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.949+0000 7fb119864700 1 -- 172.21.15.80:0/995839336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb11406c0a0 msgr2=0x7fb114072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:17.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.949+0000 7fb119864700 1 --2- 172.21.15.80:0/995839336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb11406c0a0 0x7fb114072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:17.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.949+0000 7fb119864700 1 -- 172.21.15.80:0/995839336 >> v1:172.21.15.174:6789/0 conn(0x7fb1140734e0 legacy=0x7fb114071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:17.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.949+0000 7fb119864700 1 -- 172.21.15.80:0/995839336 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb114070a40 con 0x7fb114072620 2019-11-28T11:45:17.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.949+0000 7fb113fff700 1 -- 172.21.15.80:0/995839336 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436621784 0 0) 0x7fb0fc0013b0 con 0x7fb1140734e0 2019-11-28T11:45:17.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.950+0000 7fb119864700 1 --2- 172.21.15.80:0/995839336 >> v2:172.21.15.80:3300/0 conn(0x7fb114072620 0x7fb114164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb10c00f6b0 tx=0x7fb10c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:17.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.950+0000 7fb119864700 1 --2- 172.21.15.80:0/995839336 >> v2:172.21.15.80:3300/0 conn(0x7fb114072620 0x7fb114164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb10c00f6b0 tx=0x7fb10c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:17.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.950+0000 7fb119864700 1 --2- 172.21.15.80:0/995839336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb114072620 0x7fb114164d70 secure :-1 s=READY pgs=1744 cs=0 l=1 rx=0x7fb10c00f6b0 tx=0x7fb10c00fa50).ready entity=mon.0 client_cookie=f700f1f46219ddad server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:17.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.950+0000 7fb119864700 1 --2- 172.21.15.80:0/995839336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb114072620 0x7fb114164d70 secure :-1 s=THROTTLE_DONE pgs=1744 cs=0 l=1 rx=0x7fb10c00f6b0 tx=0x7fb10c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:17.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.950+0000 7fb113fff700 1 -- 172.21.15.80:0/995839336 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb10c000a70 con 0x7fb114072620 2019-11-28T11:45:17.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.950+0000 7fb119864700 1 --2- 172.21.15.80:0/995839336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb114072620 0x7fb114164d70 secure :-1 s=THROTTLE_DONE pgs=1744 cs=0 l=1 rx=0x7fb10c00f6b0 tx=0x7fb10c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:17.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.950+0000 7fb119864700 1 --2- 172.21.15.80:0/995839336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb114072620 0x7fb114164d70 secure :-1 s=THROTTLE_DONE pgs=1744 cs=0 l=1 rx=0x7fb10c00f6b0 tx=0x7fb10c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:17.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.950+0000 7fb113fff700 1 -- 172.21.15.80:0/995839336 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c000960 con 0x7fb114072620 2019-11-28T11:45:17.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.950+0000 7fb113fff700 1 -- 172.21.15.80:0/995839336 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb10c000b50 con 0x7fb114072620 2019-11-28T11:45:17.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.950+0000 7fb11aac6700 1 -- 172.21.15.80:0/995839336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb114072620 msgr2=0x7fb114164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:17.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.950+0000 7fb11aac6700 1 --2- 172.21.15.80:0/995839336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb114072620 0x7fb114164d70 secure :-1 s=READY pgs=1744 cs=0 l=1 rx=0x7fb10c00f6b0 tx=0x7fb10c00fa50).stop 2019-11-28T11:45:17.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.950+0000 7fb11aac6700 1 -- 172.21.15.80:0/995839336 shutdown_connections 2019-11-28T11:45:17.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.950+0000 7fb11aac6700 1 --2- 172.21.15.80:0/995839336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb114072620 0x7fb114164d70 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:17.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.950+0000 7fb11aac6700 1 --2- 172.21.15.80:0/995839336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb11406c0a0 0x7fb114072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:17.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.951+0000 7fb11aac6700 1 -- 172.21.15.80:0/995839336 shutdown_connections 2019-11-28T11:45:17.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.951+0000 7fb11aac6700 1 -- 172.21.15.80:0/995839336 wait complete. 2019-11-28T11:45:17.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.951+0000 7fb11aac6700 1 -- 172.21.15.80:0/995839336 >> 172.21.15.80:0/995839336 conn(0x7fb114061cf0 msgr2=0x7fb114064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:18.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.953+0000 7fb11aac6700 1 Processor -- start 2019-11-28T11:45:18.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.953+0000 7fb11aac6700 1 -- start start 2019-11-28T11:45:18.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.954+0000 7fb11aac6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb11413e8e0 0x7fb11407b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:18.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.954+0000 7fb11aac6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb11407ba00 0x7fb1141293f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:18.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.954+0000 7fb11aac6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11413f190 con 0x7fb114129930 2019-11-28T11:45:18.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.954+0000 7fb11aac6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb114142d50 con 0x7fb11413e8e0 2019-11-28T11:45:18.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.954+0000 7fb11aac6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb114143020 con 0x7fb11407ba00 2019-11-28T11:45:18.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.954+0000 7fb119063700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb11413e8e0 0x7fb11407b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:18.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.954+0000 7fb119864700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb114129930 0x7fb114111010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39612/0 (socket says 172.21.15.80:39612) 2019-11-28T11:45:18.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.954+0000 7fb119063700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb11413e8e0 0x7fb11407b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40294/0 (socket says 172.21.15.80:40294) 2019-11-28T11:45:18.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.954+0000 7fb119864700 1 -- 172.21.15.80:0/1716131545 learned_addr learned my addr 172.21.15.80:0/1716131545 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:18.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.954+0000 7fb118862700 1 --2- 172.21.15.80:0/1716131545 >> v2:172.21.15.174:3300/0 conn(0x7fb11407ba00 0x7fb1141293f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:18.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.954+0000 7fb119063700 1 -- 172.21.15.80:0/1716131545 >> v2:172.21.15.174:3300/0 conn(0x7fb11407ba00 msgr2=0x7fb1141293f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:18.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.954+0000 7fb119063700 1 --2- 172.21.15.80:0/1716131545 >> v2:172.21.15.174:3300/0 conn(0x7fb11407ba00 0x7fb1141293f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:18.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.954+0000 7fb119063700 1 -- 172.21.15.80:0/1716131545 >> v1:172.21.15.80:6789/0 conn(0x7fb114129930 legacy=0x7fb114111010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:18.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.954+0000 7fb111ffb700 1 -- 172.21.15.80:0/1716131545 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580365985 0 0) 0x7fb10c000b50 con 0x7fb114129930 2019-11-28T11:45:18.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.954+0000 7fb119063700 1 -- 172.21.15.80:0/1716131545 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb114078c00 con 0x7fb11413e8e0 2019-11-28T11:45:18.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.955+0000 7fb119063700 1 --2- 172.21.15.80:0/1716131545 >> v2:172.21.15.80:3300/0 conn(0x7fb11413e8e0 0x7fb11407b4c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb104010360 tx=0x7fb1040101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.955+0000 7fb119063700 1 --2- 172.21.15.80:0/1716131545 >> v2:172.21.15.80:3300/0 conn(0x7fb11413e8e0 0x7fb11407b4c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb104010360 tx=0x7fb1040101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.955+0000 7fb119063700 1 --2- 172.21.15.80:0/1716131545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb11413e8e0 0x7fb11407b4c0 secure :-1 s=READY pgs=1746 cs=0 l=1 rx=0x7fb104010360 tx=0x7fb1040101c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:18.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.955+0000 7fb119063700 1 --2- 172.21.15.80:0/1716131545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb11413e8e0 0x7fb11407b4c0 secure :-1 s=THROTTLE_DONE pgs=1746 cs=0 l=1 rx=0x7fb104010360 tx=0x7fb1040101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.955+0000 7fb111ffb700 1 -- 172.21.15.80:0/1716131545 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb104000940 con 0x7fb11413e8e0 2019-11-28T11:45:18.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.955+0000 7fb119063700 1 --2- 172.21.15.80:0/1716131545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb11413e8e0 0x7fb11407b4c0 secure :-1 s=THROTTLE_DONE pgs=1746 cs=0 l=1 rx=0x7fb104010360 tx=0x7fb1040101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.955+0000 7fb119063700 1 --2- 172.21.15.80:0/1716131545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb11413e8e0 0x7fb11407b4c0 secure :-1 s=THROTTLE_DONE pgs=1746 cs=0 l=1 rx=0x7fb104010360 tx=0x7fb1040101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.955+0000 7fb111ffb700 1 -- 172.21.15.80:0/1716131545 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb104000c90 con 0x7fb11413e8e0 2019-11-28T11:45:18.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.955+0000 7fb111ffb700 1 -- 172.21.15.80:0/1716131545 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb104001360 con 0x7fb11413e8e0 2019-11-28T11:45:18.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.955+0000 7fb11aac6700 1 -- 172.21.15.80:0/1716131545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb114078f80 con 0x7fb11413e8e0 2019-11-28T11:45:18.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.955+0000 7fb11aac6700 1 -- 172.21.15.80:0/1716131545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb114078c00 con 0x7fb11413e8e0 2019-11-28T11:45:18.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.955+0000 7fb119063700 1 --2- 172.21.15.80:0/1716131545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb11413e8e0 0x7fb11407b4c0 secure :-1 s=THROTTLE_DONE pgs=1746 cs=0 l=1 rx=0x7fb104010360 tx=0x7fb1040101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.955+0000 7fb111ffb700 1 -- 172.21.15.80:0/1716131545 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb104000e80 con 0x7fb11413e8e0 2019-11-28T11:45:18.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.955+0000 7fb119063700 1 --2- 172.21.15.80:0/1716131545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb11413e8e0 0x7fb11407b4c0 secure :-1 s=THROTTLE_DONE pgs=1746 cs=0 l=1 rx=0x7fb104010360 tx=0x7fb1040101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.956+0000 7fb111ffb700 1 --2- 172.21.15.80:0/1716131545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0f8018730 0x7fb0f801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:18.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.956+0000 7fb111ffb700 1 -- 172.21.15.80:0/1716131545 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fb1040319d0 con 0x7fb11413e8e0 2019-11-28T11:45:18.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.956+0000 7fb118862700 1 --2- 172.21.15.80:0/1716131545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0f8018730 0x7fb0f801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:18.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.956+0000 7fb118862700 1 --2- 172.21.15.80:0/1716131545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0f8018730 0x7fb0f801abc0 crc :-1 s=READY pgs=708 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:18.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.963+0000 7fb11aac6700 1 -- 172.21.15.80:0/1716131545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb114078f80 con 0x7fb11413e8e0 2019-11-28T11:45:18.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.967+0000 7fb119063700 1 --2- 172.21.15.80:0/1716131545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb11413e8e0 0x7fb11407b4c0 secure :-1 s=THROTTLE_DONE pgs=1746 cs=0 l=1 rx=0x7fb104010360 tx=0x7fb1040101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:17.967+0000 7fb111ffb700 1 -- 172.21.15.80:0/1716131545 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb104009250 con 0x7fb11413e8e0 2019-11-28T11:45:18.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.137+0000 7fb11aac6700 1 -- 172.21.15.80:0/1716131545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb114078c00 con 0x7fb11413e8e0 2019-11-28T11:45:18.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.138+0000 7fb119063700 1 --2- 172.21.15.80:0/1716131545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb11413e8e0 0x7fb11407b4c0 secure :-1 s=THROTTLE_DONE pgs=1746 cs=0 l=1 rx=0x7fb104010360 tx=0x7fb1040101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.138+0000 7fb111ffb700 1 -- 172.21.15.80:0/1716131545 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+2109 (secure 0 0 0) 0x7fb104000e80 con 0x7fb11413e8e0 2019-11-28T11:45:18.178 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 99 2019-11-28T11:45:18.178 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:18.178 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":99,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6835/622188474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":622188474},{"type":"v1","addr":"172.21.15.80:6835","nonce":622188474}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":95}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:01.366373+0000","modified":"2019-11-28T11:45:17.723967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":130,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8530":{"gid":8530,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":4,"addr":"172.21.15.174:6835/588051121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":588051121},{"type":"v1","addr":"172.21.15.174:6835","nonce":588051121}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2019-11-28T11:45:18.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.140+0000 7fb11aac6700 1 -- 172.21.15.80:0/1716131545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0f8018730 msgr2=0x7fb0f801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:18.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.140+0000 7fb11aac6700 1 --2- 172.21.15.80:0/1716131545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0f8018730 0x7fb0f801abc0 crc :-1 s=READY pgs=708 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:18.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.140+0000 7fb11aac6700 1 -- 172.21.15.80:0/1716131545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb11413e8e0 msgr2=0x7fb11407b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:18.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.140+0000 7fb11aac6700 1 --2- 172.21.15.80:0/1716131545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb11413e8e0 0x7fb11407b4c0 secure :-1 s=READY pgs=1746 cs=0 l=1 rx=0x7fb104010360 tx=0x7fb1040101c0).stop 2019-11-28T11:45:18.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.140+0000 7fb11aac6700 1 -- 172.21.15.80:0/1716131545 shutdown_connections 2019-11-28T11:45:18.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.140+0000 7fb11aac6700 1 --2- 172.21.15.80:0/1716131545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb0f8018730 0x7fb0f801abc0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:18.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.140+0000 7fb11aac6700 1 --2- 172.21.15.80:0/1716131545 >> v2:172.21.15.174:3300/0 conn(0x7fb11407ba00 0x7fb1141293f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:18.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.140+0000 7fb11aac6700 1 --2- 172.21.15.80:0/1716131545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb11413e8e0 0x7fb11407b4c0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:18.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.140+0000 7fb11aac6700 1 -- 172.21.15.80:0/1716131545 shutdown_connections 2019-11-28T11:45:18.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.140+0000 7fb11aac6700 1 -- 172.21.15.80:0/1716131545 wait complete. 2019-11-28T11:45:18.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.140+0000 7fb11aac6700 1 -- 172.21.15.80:0/1716131545 >> 172.21.15.80:0/1716131545 conn(0x7fb11413b860 msgr2=0x7fb1141050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:18.189 INFO:tasks.cephfs.filesystem:mapped states [u'up:active'] to up:active 2019-11-28T11:45:18.190 INFO:tasks.cephfs.filesystem:reached state 'up:active' in 4.31048202515s 2019-11-28T11:45:18.190 INFO:tasks.cephfs.mount:check lock on file background_file 2019-11-28T11:45:18.190 INFO:teuthology.orchestra.run.smithi016:> sudo python -c ' 2019-11-28T11:45:18.190 INFO:teuthology.orchestra.run.smithi016:> import fcntl 2019-11-28T11:45:18.190 INFO:teuthology.orchestra.run.smithi016:> import errno 2019-11-28T11:45:18.191 INFO:teuthology.orchestra.run.smithi016:> import struct 2019-11-28T11:45:18.191 INFO:teuthology.orchestra.run.smithi016:> f1 = open("/home/ubuntu/cephtest/mnt.1/background_file-1", '"'"'r'"'"') 2019-11-28T11:45:18.191 INFO:teuthology.orchestra.run.smithi016:> try: 2019-11-28T11:45:18.191 INFO:teuthology.orchestra.run.smithi016:> fcntl.flock(f1, fcntl.LOCK_EX | fcntl.LOCK_NB) 2019-11-28T11:45:18.191 INFO:teuthology.orchestra.run.smithi016:> except IOError, e: 2019-11-28T11:45:18.191 INFO:teuthology.orchestra.run.smithi016:> if e.errno == errno.EAGAIN: 2019-11-28T11:45:18.191 INFO:teuthology.orchestra.run.smithi016:> pass 2019-11-28T11:45:18.191 INFO:teuthology.orchestra.run.smithi016:> else: 2019-11-28T11:45:18.192 INFO:teuthology.orchestra.run.smithi016:> raise RuntimeError("flock on file /home/ubuntu/cephtest/mnt.1/background_file-1 not found") 2019-11-28T11:45:18.192 INFO:teuthology.orchestra.run.smithi016:> f2 = open("/home/ubuntu/cephtest/mnt.1/background_file-2", '"'"'r'"'"') 2019-11-28T11:45:18.192 INFO:teuthology.orchestra.run.smithi016:> try: 2019-11-28T11:45:18.192 INFO:teuthology.orchestra.run.smithi016:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2019-11-28T11:45:18.192 INFO:teuthology.orchestra.run.smithi016:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2019-11-28T11:45:18.192 INFO:teuthology.orchestra.run.smithi016:> except IOError, e: 2019-11-28T11:45:18.192 INFO:teuthology.orchestra.run.smithi016:> if e.errno == errno.EAGAIN: 2019-11-28T11:45:18.193 INFO:teuthology.orchestra.run.smithi016:> pass 2019-11-28T11:45:18.193 INFO:teuthology.orchestra.run.smithi016:> else: 2019-11-28T11:45:18.193 INFO:teuthology.orchestra.run.smithi016:> raise RuntimeError("posix lock on file /home/ubuntu/cephtest/mnt.1/background_file-2 not found") 2019-11-28T11:45:18.193 INFO:teuthology.orchestra.run.smithi016:> ' 2019-11-28T11:45:18.282 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock' 2019-11-28T11:45:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.362+0000 7ff56f710700 1 Processor -- start 2019-11-28T11:45:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.362+0000 7ff56f710700 1 -- start start 2019-11-28T11:45:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.363+0000 7ff56f710700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff56806c0a0 0x7ff568072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.363+0000 7ff56f710700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56806db00 con 0x7ff568072620 2019-11-28T11:45:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.363+0000 7ff56f710700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56806e000 con 0x7ff5680734e0 2019-11-28T11:45:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.363+0000 7ff56f710700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56806fd60 con 0x7ff56806c0a0 2019-11-28T11:45:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.363+0000 7ff56e4ae700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff568072620 0x7ff568164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39620/0 (socket says 172.21.15.80:39620) 2019-11-28T11:45:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.363+0000 7ff56e4ae700 1 -- 172.21.15.80:0/2714636260 learned_addr learned my addr 172.21.15.80:0/2714636260 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.363+0000 7ff56dcad700 1 --2- 172.21.15.80:0/2714636260 >> v2:172.21.15.174:3300/0 conn(0x7ff56806c0a0 0x7ff568072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.363+0000 7ff56ccab700 1 -- 172.21.15.80:0/2714636260 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917746626 0 0) 0x7ff560001150 con 0x7ff568072620 2019-11-28T11:45:18.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.363+0000 7ff56ccab700 1 -- 172.21.15.80:0/2714636260 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff554002e80 con 0x7ff568072620 2019-11-28T11:45:18.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 -- 172.21.15.80:0/2714636260 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147778224 0 0) 0x7ff558001030 con 0x7ff5680734e0 2019-11-28T11:45:18.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 -- 172.21.15.80:0/2714636260 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5540030b0 con 0x7ff5680734e0 2019-11-28T11:45:18.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 -- 172.21.15.80:0/2714636260 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1367302891 0 0) 0x7ff560001130 con 0x7ff568072620 2019-11-28T11:45:18.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 -- 172.21.15.80:0/2714636260 >> v2:172.21.15.174:3300/0 conn(0x7ff56806c0a0 msgr2=0x7ff568072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:18.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 --2- 172.21.15.80:0/2714636260 >> v2:172.21.15.174:3300/0 conn(0x7ff56806c0a0 0x7ff568072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:18.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 -- 172.21.15.80:0/2714636260 >> v1:172.21.15.174:6789/0 conn(0x7ff5680734e0 legacy=0x7ff568071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 -- 172.21.15.80:0/2714636260 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5680706c0 con 0x7ff568072620 2019-11-28T11:45:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 -- 172.21.15.80:0/2714636260 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff560001660 con 0x7ff568072620 2019-11-28T11:45:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 -- 172.21.15.80:0/2714636260 >> v1:172.21.15.80:6789/0 conn(0x7ff568072620 legacy=0x7ff568164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff554003b80 0x7ff554005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5540066d0 0x7ff554008b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff55404d3a0 0x7ff55404f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 -- 172.21.15.80:0/2714636260 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55404fff0 con 0x7ff5540066d0 2019-11-28T11:45:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 -- 172.21.15.80:0/2714636260 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff554050220 con 0x7ff554003b80 2019-11-28T11:45:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 -- 172.21.15.80:0/2714636260 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff554050450 con 0x7ff55404d3a0 2019-11-28T11:45:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56d4ac700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5540066d0 0x7ff554008b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56e4ae700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff55404d3a0 0x7ff55404f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56dcad700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff554003b80 0x7ff554005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56d4ac700 1 -- 172.21.15.80:0/2714636260 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff55404d3a0 msgr2=0x7ff55404f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56d4ac700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff55404d3a0 0x7ff55404f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56d4ac700 1 -- 172.21.15.80:0/2714636260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff554003b80 msgr2=0x7ff554005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56d4ac700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff554003b80 0x7ff554005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56e4ae700 1 -- 172.21.15.80:0/2714636260 reap_dead start 2019-11-28T11:45:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56d4ac700 1 -- 172.21.15.80:0/2714636260 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff554050700 con 0x7ff5540066d0 2019-11-28T11:45:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56dcad700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff554003b80 0x7ff554005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:45:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56d4ac700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5540066d0 0x7ff554008b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff55800af70 tx=0x7ff55800b700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56d4ac700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5540066d0 0x7ff554008b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff55800af70 tx=0x7ff55800b700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56d4ac700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5540066d0 0x7ff554008b50 secure :-1 s=READY pgs=1748 cs=0 l=1 rx=0x7ff55800af70 tx=0x7ff55800b700).ready entity=mon.0 client_cookie=17d2c2c83c99418c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56d4ac700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5540066d0 0x7ff554008b50 secure :-1 s=THROTTLE_DONE pgs=1748 cs=0 l=1 rx=0x7ff55800af70 tx=0x7ff55800b700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56d4ac700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5540066d0 0x7ff554008b50 secure :-1 s=THROTTLE_DONE pgs=1748 cs=0 l=1 rx=0x7ff55800af70 tx=0x7ff55800b700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 -- 172.21.15.80:0/2714636260 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff558000940 con 0x7ff5540066d0 2019-11-28T11:45:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56d4ac700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5540066d0 0x7ff554008b50 secure :-1 s=THROTTLE_DONE pgs=1748 cs=0 l=1 rx=0x7ff55800af70 tx=0x7ff55800b700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 -- 172.21.15.80:0/2714636260 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff558009a30 con 0x7ff5540066d0 2019-11-28T11:45:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56ccab700 1 -- 172.21.15.80:0/2714636260 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff55800a100 con 0x7ff5540066d0 2019-11-28T11:45:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56f710700 1 -- 172.21.15.80:0/2714636260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5540066d0 msgr2=0x7ff554008b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.364+0000 7ff56f710700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5540066d0 0x7ff554008b50 secure :-1 s=READY pgs=1748 cs=0 l=1 rx=0x7ff55800af70 tx=0x7ff55800b700).stop 2019-11-28T11:45:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.365+0000 7ff56f710700 1 -- 172.21.15.80:0/2714636260 shutdown_connections 2019-11-28T11:45:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.365+0000 7ff56f710700 1 --2- 172.21.15.80:0/2714636260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5540066d0 0x7ff554008b50 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.365+0000 7ff56f710700 1 -- 172.21.15.80:0/2714636260 shutdown_connections 2019-11-28T11:45:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.365+0000 7ff56f710700 1 -- 172.21.15.80:0/2714636260 wait complete. 2019-11-28T11:45:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.365+0000 7ff56f710700 1 -- 172.21.15.80:0/2714636260 >> 172.21.15.80:0/2714636260 conn(0x7ff568061cf0 msgr2=0x7ff568064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.368+0000 7ff56f710700 1 Processor -- start 2019-11-28T11:45:18.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.368+0000 7ff56f710700 1 -- start start 2019-11-28T11:45:18.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.368+0000 7ff56f710700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff568152250 0x7ff568169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:18.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.368+0000 7ff56f710700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff568079230 con 0x7ff5680750f0 2019-11-28T11:45:18.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.368+0000 7ff56f710700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff568079890 con 0x7ff568074d00 2019-11-28T11:45:18.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.368+0000 7ff56f710700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56807ab30 con 0x7ff568152250 2019-11-28T11:45:18.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff56d4ac700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff5680750f0 0x7ff568151a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39630/0 (socket says 172.21.15.80:39630) 2019-11-28T11:45:18.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff56d4ac700 1 -- 172.21.15.80:0/1744521498 learned_addr learned my addr 172.21.15.80:0/1744521498 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:18.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff56e4ae700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff568152250 0x7ff568169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:18.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff5667fc700 1 -- 172.21.15.80:0/1744521498 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426016316 0 0) 0x7ff5580095a0 con 0x7ff5680750f0 2019-11-28T11:45:18.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff5667fc700 1 -- 172.21.15.80:0/1744521498 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff54c002e80 con 0x7ff5680750f0 2019-11-28T11:45:18.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff5667fc700 1 -- 172.21.15.80:0/1744521498 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702859741 0 0) 0x7ff550009b10 con 0x7ff568074d00 2019-11-28T11:45:18.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff5667fc700 1 -- 172.21.15.80:0/1744521498 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff54c0030b0 con 0x7ff568074d00 2019-11-28T11:45:18.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff5667fc700 1 -- 172.21.15.80:0/1744521498 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3551680917 0 0) 0x7ff5580009f0 con 0x7ff5680750f0 2019-11-28T11:45:18.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff5667fc700 1 -- 172.21.15.80:0/1744521498 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff54c0033c0 con 0x7ff5680750f0 2019-11-28T11:45:18.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff5667fc700 1 -- 172.21.15.80:0/1744521498 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff558009d40 con 0x7ff5680750f0 2019-11-28T11:45:18.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff56e4ae700 1 -- 172.21.15.80:0/1744521498 >> v1:172.21.15.174:6789/0 conn(0x7ff568074d00 legacy=0x7ff568152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:18.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff56e4ae700 1 -- 172.21.15.80:0/1744521498 >> v1:172.21.15.80:6789/0 conn(0x7ff5680750f0 legacy=0x7ff568151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:18.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff56e4ae700 1 -- 172.21.15.80:0/1744521498 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56807b490 con 0x7ff568152250 2019-11-28T11:45:18.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff56e4ae700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff568152250 0x7ff568169d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff560010370 tx=0x7ff560010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff56e4ae700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff568152250 0x7ff568169d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff560010370 tx=0x7ff560010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff56e4ae700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff568152250 0x7ff568169d50 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7ff560010370 tx=0x7ff560010710).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff56e4ae700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff568152250 0x7ff568169d50 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7ff560010370 tx=0x7ff560010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff5667fc700 1 -- 172.21.15.80:0/1744521498 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff560000ef0 con 0x7ff568152250 2019-11-28T11:45:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff56e4ae700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff568152250 0x7ff568169d50 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7ff560010370 tx=0x7ff560010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff5667fc700 1 -- 172.21.15.80:0/1744521498 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff560004240 con 0x7ff568152250 2019-11-28T11:45:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff56e4ae700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff568152250 0x7ff568169d50 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7ff560010370 tx=0x7ff560010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff56f710700 1 -- 172.21.15.80:0/1744521498 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56807b810 con 0x7ff568152250 2019-11-28T11:45:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.369+0000 7ff5667fc700 1 -- 172.21.15.80:0/1744521498 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff560000ef0 con 0x7ff568152250 2019-11-28T11:45:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.370+0000 7ff56f710700 1 -- 172.21.15.80:0/1744521498 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56807b490 con 0x7ff568152250 2019-11-28T11:45:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.370+0000 7ff56e4ae700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff568152250 0x7ff568169d50 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7ff560010370 tx=0x7ff560010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.370+0000 7ff5667fc700 1 -- 172.21.15.80:0/1744521498 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff560004430 con 0x7ff568152250 2019-11-28T11:45:18.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.370+0000 7ff56e4ae700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff568152250 0x7ff568169d50 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7ff560010370 tx=0x7ff560010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.370+0000 7ff5667fc700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff54c0187a0 0x7ff54c01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.370+0000 7ff5667fc700 1 -- 172.21.15.80:0/1744521498 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6106+0+0 (secure 0 0 0) 0x7ff560031a80 con 0x7ff568152250 2019-11-28T11:45:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.370+0000 7ff56dcad700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff54c0187a0 0x7ff54c01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.371+0000 7ff56dcad700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff54c0187a0 0x7ff54c01abf0 crc :-1 s=READY pgs=709 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.377+0000 7ff56f710700 1 -- 172.21.15.80:0/1744521498 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56807b810 con 0x7ff568152250 2019-11-28T11:45:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.381+0000 7ff56e4ae700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff568152250 0x7ff568169d50 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7ff560010370 tx=0x7ff560010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.381+0000 7ff5667fc700 1 -- 172.21.15.80:0/1744521498 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff560001200 con 0x7ff568152250 2019-11-28T11:45:18.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.554+0000 7ff56f710700 1 -- 172.21.15.80:0/1744521498 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock"]} v 0) v1 -- 0x7ff56807b490 con 0x7ff568152250 2019-11-28T11:45:18.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.738+0000 7ff56e4ae700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff568152250 0x7ff568169d50 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7ff560010370 tx=0x7ff560010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:18.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.738+0000 7ff5667fc700 1 -- 172.21.15.80:0/1744521498 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock"]}]=0 v482) v1 ==== 145+0+0 (secure 0 0 0) 0x7ff560004240 con 0x7ff568152250 2019-11-28T11:45:18.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.770+0000 7ff56f710700 1 -- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff54c0187a0 msgr2=0x7ff54c01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:18.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.770+0000 7ff56f710700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff54c0187a0 0x7ff54c01abf0 crc :-1 s=READY pgs=709 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:18.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.770+0000 7ff56f710700 1 -- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff568152250 msgr2=0x7ff568169d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:18.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.770+0000 7ff56f710700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff568152250 0x7ff568169d50 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7ff560010370 tx=0x7ff560010710).stop 2019-11-28T11:45:18.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.770+0000 7ff56f710700 1 -- 172.21.15.80:0/1744521498 shutdown_connections 2019-11-28T11:45:18.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.770+0000 7ff56f710700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff568152250 0x7ff568169d50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:18.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.770+0000 7ff56f710700 1 --2- 172.21.15.80:0/1744521498 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff54c0187a0 0x7ff54c01abf0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:18.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.770+0000 7ff56f710700 1 -- 172.21.15.80:0/1744521498 shutdown_connections 2019-11-28T11:45:18.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.770+0000 7ff56f710700 1 -- 172.21.15.80:0/1744521498 wait complete. 2019-11-28T11:45:18.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:18.770+0000 7ff56f710700 1 -- 172.21.15.80:0/1744521498 >> 172.21.15.80:0/1744521498 conn(0x7ff56813fa50 msgr2=0x7ff56807c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:18.819 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:45:18.819 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:45:18.888 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:45:18.948 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:45:19.011 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:45:19.066 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:45:19.131 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:45:19.198 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:45:19.198 INFO:tasks.cephfs.mount:Terminating background process 2019-11-28T11:45:19.198 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:45:19.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:45:19.199 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T11:45:19.274 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:45:19.279 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:45:19.319 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:45:19.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:45:19.319 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:45:19.398 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:45:19.402 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:45:19.442 INFO:tasks.cephfs_test_runner:test_filelock (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2019-11-28T11:45:19.442 INFO:tasks.cephfs_test_runner:Starting test: test_filelock_eviction (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T11:45:19.442 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction' 2019-11-28T11:45:19.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.521+0000 7f230ae33700 1 Processor -- start 2019-11-28T11:45:19.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.521+0000 7f230ae33700 1 -- start start 2019-11-28T11:45:19.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.522+0000 7f230ae33700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f230406c0a0 0x7f2304072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:19.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.522+0000 7f230ae33700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23040734e0 0x7f2304071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:19.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.522+0000 7f230ae33700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230406db00 con 0x7f2304072360 2019-11-28T11:45:19.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.522+0000 7f230ae33700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230406f330 con 0x7f23040734e0 2019-11-28T11:45:19.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.522+0000 7f230ae33700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23040706c0 con 0x7f230406c0a0 2019-11-28T11:45:19.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.522+0000 7f2308bcf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23040734e0 0x7f2304071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:19.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.522+0000 7f2308bcf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23040734e0 0x7f2304071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40328/0 (socket says 172.21.15.80:40328) 2019-11-28T11:45:19.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.522+0000 7f2308bcf700 1 -- 172.21.15.80:0/973712982 learned_addr learned my addr 172.21.15.80:0/973712982 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:19.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.522+0000 7f2309bd1700 1 --1- 172.21.15.80:0/973712982 >> v1:172.21.15.80:6789/0 conn(0x7f2304072360 0x7f230406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39642/0 (socket says 172.21.15.80:39642) 2019-11-28T11:45:19.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f23093d0700 1 --2- 172.21.15.80:0/973712982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f230406c0a0 0x7f2304072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:19.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f2308bcf700 1 -- 172.21.15.80:0/973712982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f230406c0a0 msgr2=0x7f2304072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:19.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f2308bcf700 1 --2- 172.21.15.80:0/973712982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f230406c0a0 0x7f2304072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:19.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f2308bcf700 1 -- 172.21.15.80:0/973712982 >> v1:172.21.15.80:6789/0 conn(0x7f2304072360 legacy=0x7f230406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:19.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f2303fff700 1 -- 172.21.15.80:0/973712982 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511357022 0 0) 0x7f22fc0009b0 con 0x7f2304072360 2019-11-28T11:45:19.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f2308bcf700 1 -- 172.21.15.80:0/973712982 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2304070a40 con 0x7f23040734e0 2019-11-28T11:45:19.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f23093d0700 1 --2- 172.21.15.80:0/973712982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f230406c0a0 0x7f2304072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:19.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f2308bcf700 1 --2- 172.21.15.80:0/973712982 >> v2:172.21.15.80:3300/0 conn(0x7f23040734e0 0x7f2304071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f22ec00fac0 tx=0x7f22ec00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:19.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f2308bcf700 1 --2- 172.21.15.80:0/973712982 >> v2:172.21.15.80:3300/0 conn(0x7f23040734e0 0x7f2304071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f22ec00fac0 tx=0x7f22ec00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:19.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f2308bcf700 1 --2- 172.21.15.80:0/973712982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23040734e0 0x7f2304071e20 secure :-1 s=READY pgs=1751 cs=0 l=1 rx=0x7f22ec00fac0 tx=0x7f22ec00fe60).ready entity=mon.0 client_cookie=54779af59edfc8b4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:19.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f2308bcf700 1 --2- 172.21.15.80:0/973712982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23040734e0 0x7f2304071e20 secure :-1 s=THROTTLE_DONE pgs=1751 cs=0 l=1 rx=0x7f22ec00fac0 tx=0x7f22ec00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:19.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f2303fff700 1 -- 172.21.15.80:0/973712982 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22ec000ce0 con 0x7f23040734e0 2019-11-28T11:45:19.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f2308bcf700 1 --2- 172.21.15.80:0/973712982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23040734e0 0x7f2304071e20 secure :-1 s=THROTTLE_DONE pgs=1751 cs=0 l=1 rx=0x7f22ec00fac0 tx=0x7f22ec00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:19.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f2308bcf700 1 --2- 172.21.15.80:0/973712982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23040734e0 0x7f2304071e20 secure :-1 s=THROTTLE_DONE pgs=1751 cs=0 l=1 rx=0x7f22ec00fac0 tx=0x7f22ec00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:19.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f2303fff700 1 -- 172.21.15.80:0/973712982 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec007590 con 0x7f23040734e0 2019-11-28T11:45:19.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f2303fff700 1 -- 172.21.15.80:0/973712982 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22ec000cc0 con 0x7f23040734e0 2019-11-28T11:45:19.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f230ae33700 1 -- 172.21.15.80:0/973712982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23040734e0 msgr2=0x7f2304071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:19.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.523+0000 7f230ae33700 1 --2- 172.21.15.80:0/973712982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23040734e0 0x7f2304071e20 secure :-1 s=READY pgs=1751 cs=0 l=1 rx=0x7f22ec00fac0 tx=0x7f22ec00fe60).stop 2019-11-28T11:45:19.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.524+0000 7f230ae33700 1 -- 172.21.15.80:0/973712982 shutdown_connections 2019-11-28T11:45:19.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.524+0000 7f230ae33700 1 --2- 172.21.15.80:0/973712982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23040734e0 0x7f2304071e20 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:19.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.524+0000 7f230ae33700 1 --2- 172.21.15.80:0/973712982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f230406c0a0 0x7f2304072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:19.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.524+0000 7f230ae33700 1 -- 172.21.15.80:0/973712982 shutdown_connections 2019-11-28T11:45:19.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.524+0000 7f230ae33700 1 -- 172.21.15.80:0/973712982 wait complete. 2019-11-28T11:45:19.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.524+0000 7f230ae33700 1 -- 172.21.15.80:0/973712982 >> 172.21.15.80:0/973712982 conn(0x7f2304061cf0 msgr2=0x7f2304064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:19.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.527+0000 7f230ae33700 1 Processor -- start 2019-11-28T11:45:19.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.527+0000 7f230ae33700 1 -- start start 2019-11-28T11:45:19.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f230ae33700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f230413e320 0x7f230413e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:19.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f230ae33700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2304139e00 con 0x7f230412a3c0 2019-11-28T11:45:19.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f230ae33700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230413b4e0 con 0x7f230415fdf0 2019-11-28T11:45:19.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f230ae33700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2304108820 con 0x7f230413e320 2019-11-28T11:45:19.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2309bd1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f230412a3c0 0x7f230412a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39650/0 (socket says 172.21.15.80:39650) 2019-11-28T11:45:19.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2309bd1700 1 -- 172.21.15.80:0/2052918473 learned_addr learned my addr 172.21.15.80:0/2052918473 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:19.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2308bcf700 1 --2- 172.21.15.80:0/2052918473 >> v2:172.21.15.174:3300/0 conn(0x7f230413e320 0x7f230413e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:19.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196589562 0 0) 0x7f22fc000f80 con 0x7f230412a3c0 2019-11-28T11:45:19.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e8002e80 con 0x7f230412a3c0 2019-11-28T11:45:19.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 554582002 0 0) 0x7f22fc000940 con 0x7f230412a3c0 2019-11-28T11:45:19.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f22e80032e0 con 0x7f230412a3c0 2019-11-28T11:45:19.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f22fc001740 con 0x7f230412a3c0 2019-11-28T11:45:19.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 >> v2:172.21.15.174:3300/0 conn(0x7f230413e320 msgr2=0x7f230413e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:19.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2301ffb700 1 --2- 172.21.15.80:0/2052918473 >> v2:172.21.15.174:3300/0 conn(0x7f230413e320 0x7f230413e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:19.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 >> v1:172.21.15.174:6789/0 conn(0x7f230415fdf0 legacy=0x7f230412b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:19.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 >> v1:172.21.15.80:6789/0 conn(0x7f230412a3c0 legacy=0x7f230412a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:19.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2301ffb700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22e8003330 0x7f22e8003740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:19.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2301ffb700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e8003c80 0x7f22e8004140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:19.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2301ffb700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e80049a0 0x7f22e8004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:19.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e800bbf0 con 0x7f22e8003c80 2019-11-28T11:45:19.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e800be20 con 0x7f22e80049a0 2019-11-28T11:45:19.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e800c050 con 0x7f22e8003330 2019-11-28T11:45:19.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f2308bcf700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e8003c80 0x7f22e8004140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:19.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.528+0000 7f23093d0700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22e8003330 0x7f22e8003740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:19.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2309bd1700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e80049a0 0x7f22e8004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:19.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2308bcf700 1 -- 172.21.15.80:0/2052918473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22e8003330 msgr2=0x7f22e8003740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:19.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2308bcf700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22e8003330 0x7f22e8003740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:19.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2308bcf700 1 -- 172.21.15.80:0/2052918473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e80049a0 msgr2=0x7f22e8004e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:19.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2308bcf700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e80049a0 0x7f22e8004e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:19.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2309bd1700 1 -- 172.21.15.80:0/2052918473 reap_dead start 2019-11-28T11:45:19.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2308bcf700 1 -- 172.21.15.80:0/2052918473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e800c300 con 0x7f22e8003c80 2019-11-28T11:45:19.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f230ae33700 1 -- 172.21.15.80:0/2052918473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230410a8c0 con 0x7f22e8003c80 2019-11-28T11:45:19.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2308bcf700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e8003c80 0x7f22e8004140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22ec008480 tx=0x7f22ec002e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:19.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f230ae33700 1 -- 172.21.15.80:0/2052918473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2304109180 con 0x7f22e8003c80 2019-11-28T11:45:19.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2308bcf700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e8003c80 0x7f22e8004140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22ec008480 tx=0x7f22ec002e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:19.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2308bcf700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e8003c80 0x7f22e8004140 secure :-1 s=READY pgs=1753 cs=0 l=1 rx=0x7f22ec008480 tx=0x7f22ec002e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:19.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2308bcf700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e8003c80 0x7f22e8004140 secure :-1 s=THROTTLE_DONE pgs=1753 cs=0 l=1 rx=0x7f22ec008480 tx=0x7f22ec002e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:19.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22ec008050 con 0x7f22e8003c80 2019-11-28T11:45:19.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2308bcf700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e8003c80 0x7f22e8004140 secure :-1 s=THROTTLE_DONE pgs=1753 cs=0 l=1 rx=0x7f22ec008480 tx=0x7f22ec002e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:19.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2308bcf700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e8003c80 0x7f22e8004140 secure :-1 s=THROTTLE_DONE pgs=1753 cs=0 l=1 rx=0x7f22ec008480 tx=0x7f22ec002e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:19.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec005500 con 0x7f22e8003c80 2019-11-28T11:45:19.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22ec008050 con 0x7f22e8003c80 2019-11-28T11:45:19.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.529+0000 7f2308bcf700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e8003c80 0x7f22e8004140 secure :-1 s=THROTTLE_DONE pgs=1753 cs=0 l=1 rx=0x7f22ec008480 tx=0x7f22ec002e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:19.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.530+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f22ec008050 con 0x7f22e8003c80 2019-11-28T11:45:19.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.530+0000 7f2308bcf700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e8003c80 0x7f22e8004140 secure :-1 s=THROTTLE_DONE pgs=1753 cs=0 l=1 rx=0x7f22ec008480 tx=0x7f22ec002e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:19.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.530+0000 7f2301ffb700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f22e801b480 0x7f22e801d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:19.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.530+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f22ec075f40 con 0x7f22e8003c80 2019-11-28T11:45:19.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.530+0000 7f23093d0700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f22e801b480 0x7f22e801d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:19.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.530+0000 7f23093d0700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f22e801b480 0x7f22e801d8b0 crc :-1 s=READY pgs=711 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:19.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.537+0000 7f230ae33700 1 -- 172.21.15.80:0/2052918473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22dc002e60 con 0x7f22e8003c80 2019-11-28T11:45:19.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.540+0000 7f2308bcf700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e8003c80 0x7f22e8004140 secure :-1 s=THROTTLE_DONE pgs=1753 cs=0 l=1 rx=0x7f22ec008480 tx=0x7f22ec002e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:19.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.540+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f22ec007a00 con 0x7f22e8003c80 2019-11-28T11:45:19.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.712+0000 7f230ae33700 1 -- 172.21.15.80:0/2052918473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction"]} v 0) v1 -- 0x7f22dc001d60 con 0x7f22e8003c80 2019-11-28T11:45:19.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.739+0000 7f2308bcf700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e8003c80 0x7f22e8004140 secure :-1 s=THROTTLE_DONE pgs=1753 cs=0 l=1 rx=0x7f22ec008480 tx=0x7f22ec002e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:19.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.739+0000 7f2301ffb700 1 -- 172.21.15.80:0/2052918473 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction"]}]=0 v483) v1 ==== 157+0+0 (secure 0 0 0) 0x7f22ec008050 con 0x7f22e8003c80 2019-11-28T11:45:19.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.746+0000 7f230ae33700 1 -- 172.21.15.80:0/2052918473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f22e801b480 msgr2=0x7f22e801d8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:19.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.746+0000 7f230ae33700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f22e801b480 0x7f22e801d8b0 crc :-1 s=READY pgs=711 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:19.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.746+0000 7f230ae33700 1 -- 172.21.15.80:0/2052918473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e8003c80 msgr2=0x7f22e8004140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:19.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.746+0000 7f230ae33700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e8003c80 0x7f22e8004140 secure :-1 s=READY pgs=1753 cs=0 l=1 rx=0x7f22ec008480 tx=0x7f22ec002e90).stop 2019-11-28T11:45:19.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.746+0000 7f230ae33700 1 -- 172.21.15.80:0/2052918473 shutdown_connections 2019-11-28T11:45:19.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.746+0000 7f230ae33700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f22e801b480 0x7f22e801d8b0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:19.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.746+0000 7f230ae33700 1 --2- 172.21.15.80:0/2052918473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22e8003c80 0x7f22e8004140 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:19.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.746+0000 7f230ae33700 1 -- 172.21.15.80:0/2052918473 shutdown_connections 2019-11-28T11:45:19.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.746+0000 7f230ae33700 1 -- 172.21.15.80:0/2052918473 wait complete. 2019-11-28T11:45:19.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:19.746+0000 7f230ae33700 1 -- 172.21.15.80:0/2052918473 >> 172.21.15.80:0/2052918473 conn(0x7f2304127dc0 msgr2=0x7f2304141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:19.799 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:45:19.802 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:45:19.869 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:45:19.930 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:45:19.993 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:45:20.049 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:45:20.114 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:45:20.175 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:45:20.176 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:45:20.176 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:45:20.176 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:45:20.178 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:45:20.178 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:45:20.178 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:45:20.186 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:45:20.186 DEBUG:teuthology.parallel:result is None 2019-11-28T11:45:20.189 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:45:20.189 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:45:20.189 DEBUG:teuthology.parallel:result is None 2019-11-28T11:45:20.190 DEBUG:teuthology.parallel:result is None 2019-11-28T11:45:20.190 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:45:20.191 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:45:20.196 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:45:20.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.327+0000 7fc781f73700 1 Processor -- start 2019-11-28T11:45:20.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.327+0000 7fc781f73700 1 -- start start 2019-11-28T11:45:20.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.328+0000 7fc781f73700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc77c06c0a0 0x7fc77c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:20.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.328+0000 7fc781f73700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc77c0734e0 0x7fc77c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:20.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.328+0000 7fc781f73700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77c06db00 con 0x7fc77c072360 2019-11-28T11:45:20.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.328+0000 7fc781f73700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c06fd60 con 0x7fc77c06c0a0 2019-11-28T11:45:20.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.328+0000 7fc781f73700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c070030 con 0x7fc77c0734e0 2019-11-28T11:45:20.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.328+0000 7fc780d11700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc77c072360 0x7fc77c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39668/0 (socket says 172.21.15.80:39668) 2019-11-28T11:45:20.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.328+0000 7fc780d11700 1 -- 172.21.15.80:0/4086988585 learned_addr learned my addr 172.21.15.80:0/4086988585 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:20.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fc77b7fe700 1 --2- 172.21.15.80:0/4086988585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc77c0734e0 0x7fc77c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:20.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fc77bfff700 1 --2- 172.21.15.80:0/4086988585 >> v2:172.21.15.174:3300/0 conn(0x7fc77c06c0a0 0x7fc77c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:20.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fc77affd700 1 -- 172.21.15.80:0/4086988585 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74723091 0 0) 0x7fc76c001150 con 0x7fc77c072360 2019-11-28T11:45:20.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fc77affd700 1 -- 172.21.15.80:0/4086988585 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc764002e80 con 0x7fc77c072360 2019-11-28T11:45:20.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fc77b7fe700 1 -- 172.21.15.80:0/4086988585 >> v2:172.21.15.174:3300/0 conn(0x7fc77c06c0a0 msgr2=0x7fc77c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:20.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fc77b7fe700 1 --2- 172.21.15.80:0/4086988585 >> v2:172.21.15.174:3300/0 conn(0x7fc77c06c0a0 0x7fc77c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:20.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fc77b7fe700 1 -- 172.21.15.80:0/4086988585 >> v1:172.21.15.80:6789/0 conn(0x7fc77c072360 legacy=0x7fc77c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fc77b7fe700 1 -- 172.21.15.80:0/4086988585 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c0706c0 con 0x7fc77c0734e0 2019-11-28T11:45:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fc77b7fe700 1 --2- 172.21.15.80:0/4086988585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc77c0734e0 0x7fc77c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc77000af50 tx=0x7fc77000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fc77b7fe700 1 --2- 172.21.15.80:0/4086988585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc77c0734e0 0x7fc77c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc77000af50 tx=0x7fc77000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fc77b7fe700 1 --2- 172.21.15.80:0/4086988585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc77c0734e0 0x7fc77c071e20 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7fc77000af50 tx=0x7fc77000b760).ready entity=mon.2 client_cookie=49cb0b5dbb8373d1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fc77b7fe700 1 --2- 172.21.15.80:0/4086988585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc77c0734e0 0x7fc77c071e20 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fc77000af50 tx=0x7fc77000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fc77affd700 1 -- 172.21.15.80:0/4086988585 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc770007210 con 0x7fc77c0734e0 2019-11-28T11:45:20.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fc77b7fe700 1 --2- 172.21.15.80:0/4086988585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc77c0734e0 0x7fc77c071e20 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fc77000af50 tx=0x7fc77000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fc77affd700 1 -- 172.21.15.80:0/4086988585 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7700097c0 con 0x7fc77c0734e0 2019-11-28T11:45:20.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fc77b7fe700 1 --2- 172.21.15.80:0/4086988585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc77c0734e0 0x7fc77c071e20 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fc77000af50 tx=0x7fc77000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fc77affd700 1 -- 172.21.15.80:0/4086988585 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7700099b0 con 0x7fc77c0734e0 2019-11-28T11:45:20.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fc781f73700 1 -- 172.21.15.80:0/4086988585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc77c0734e0 msgr2=0x7fc77c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fc781f73700 1 --2- 172.21.15.80:0/4086988585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc77c0734e0 0x7fc77c071e20 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7fc77000af50 tx=0x7fc77000b760).stop 2019-11-28T11:45:20.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fc781f73700 1 -- 172.21.15.80:0/4086988585 shutdown_connections 2019-11-28T11:45:20.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fc781f73700 1 --2- 172.21.15.80:0/4086988585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc77c0734e0 0x7fc77c071e20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:20.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fc781f73700 1 --2- 172.21.15.80:0/4086988585 >> v2:172.21.15.174:3300/0 conn(0x7fc77c06c0a0 0x7fc77c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:20.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fc781f73700 1 -- 172.21.15.80:0/4086988585 shutdown_connections 2019-11-28T11:45:20.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fc781f73700 1 -- 172.21.15.80:0/4086988585 wait complete. 2019-11-28T11:45:20.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fc781f73700 1 -- 172.21.15.80:0/4086988585 >> 172.21.15.80:0/4086988585 conn(0x7fc77c061cf0 msgr2=0x7fc77c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:20.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.333+0000 7fc781f73700 1 Processor -- start 2019-11-28T11:45:20.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.333+0000 7fc781f73700 1 -- start start 2019-11-28T11:45:20.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fc781f73700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc77c13eb40 0x7fc77c10afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:20.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fc781f73700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc77c1631f0 0x7fc77c105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:20.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fc781f73700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77c13f1e0 con 0x7fc77c10b500 2019-11-28T11:45:20.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fc781f73700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c1234c0 con 0x7fc77c13eb40 2019-11-28T11:45:20.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fc781f73700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c13e0d0 con 0x7fc77c1631f0 2019-11-28T11:45:20.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fc77bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc77c13eb40 0x7fc77c10afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:20.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fc780d11700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc77c1631f0 0x7fc77c105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:20.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fc77bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc77c13eb40 0x7fc77c10afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:55252/0 (socket says 172.21.15.80:55252) 2019-11-28T11:45:20.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fc77bfff700 1 -- 172.21.15.80:0/1045100382 learned_addr learned my addr 172.21.15.80:0/1045100382 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:20.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fc77bfff700 1 -- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc77c1631f0 msgr2=0x7fc77c105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fc77bfff700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc77c1631f0 0x7fc77c105210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:20.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fc77bfff700 1 -- 172.21.15.80:0/1045100382 >> v1:172.21.15.80:6789/0 conn(0x7fc77c10b500 legacy=0x7fc77c1629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fc77bfff700 1 -- 172.21.15.80:0/1045100382 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c108700 con 0x7fc77c13eb40 2019-11-28T11:45:20.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fc77bfff700 1 --2- 172.21.15.80:0/1045100382 >> v2:172.21.15.174:3300/0 conn(0x7fc77c13eb40 0x7fc77c10afc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7740107d0 tx=0x7fc774010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fc77bfff700 1 --2- 172.21.15.80:0/1045100382 >> v2:172.21.15.174:3300/0 conn(0x7fc77c13eb40 0x7fc77c10afc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7740107d0 tx=0x7fc774010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fc77bfff700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc77c13eb40 0x7fc77c10afc0 secure :-1 s=READY pgs=1025 cs=0 l=1 rx=0x7fc7740107d0 tx=0x7fc774010b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:20.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fc77bfff700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc77c13eb40 0x7fc77c10afc0 secure :-1 s=THROTTLE_DONE pgs=1025 cs=0 l=1 rx=0x7fc7740107d0 tx=0x7fc774010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fc77bfff700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc77c13eb40 0x7fc77c10afc0 secure :-1 s=THROTTLE_DONE pgs=1025 cs=0 l=1 rx=0x7fc7740107d0 tx=0x7fc774010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fc77bfff700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc77c13eb40 0x7fc77c10afc0 secure :-1 s=THROTTLE_DONE pgs=1025 cs=0 l=1 rx=0x7fc7740107d0 tx=0x7fc774010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fc778ff9700 1 -- 172.21.15.80:0/1045100382 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc774000cc0 con 0x7fc77c13eb40 2019-11-28T11:45:20.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fc778ff9700 1 -- 172.21.15.80:0/1045100382 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc774008c70 con 0x7fc77c13eb40 2019-11-28T11:45:20.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fc781f73700 1 -- 172.21.15.80:0/1045100382 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77c108a80 con 0x7fc77c13eb40 2019-11-28T11:45:20.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fc778ff9700 1 -- 172.21.15.80:0/1045100382 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc774009300 con 0x7fc77c13eb40 2019-11-28T11:45:20.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fc781f73700 1 -- 172.21.15.80:0/1045100382 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77c108700 con 0x7fc77c13eb40 2019-11-28T11:45:20.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fc77bfff700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc77c13eb40 0x7fc77c10afc0 secure :-1 s=THROTTLE_DONE pgs=1025 cs=0 l=1 rx=0x7fc7740107d0 tx=0x7fc774010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fc77bfff700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc77c13eb40 0x7fc77c10afc0 secure :-1 s=THROTTLE_DONE pgs=1025 cs=0 l=1 rx=0x7fc7740107d0 tx=0x7fc774010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fc778ff9700 1 -- 172.21.15.80:0/1045100382 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc774008870 con 0x7fc77c13eb40 2019-11-28T11:45:20.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fc778ff9700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc75c018730 0x7fc75c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:20.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fc778ff9700 1 -- 172.21.15.80:0/1045100382 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fc774031f60 con 0x7fc77c13eb40 2019-11-28T11:45:20.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fc77b7fe700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc75c018730 0x7fc75c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.337+0000 7fc77b7fe700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc75c018730 0x7fc75c01abc0 crc :-1 s=READY pgs=714 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.342+0000 7fc781f73700 1 -- 172.21.15.80:0/1045100382 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77c108a80 con 0x7fc77c13eb40 2019-11-28T11:45:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.327+0000 7fd331a8b700 1 Processor -- start 2019-11-28T11:45:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.327+0000 7fd331a8b700 1 -- start start 2019-11-28T11:45:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.328+0000 7fd331a8b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c06c0a0 0x7fd32c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.328+0000 7fd331a8b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd32c072620 0x7fd32c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.328+0000 7fd331a8b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32c06db00 con 0x7fd32c0734e0 2019-11-28T11:45:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.328+0000 7fd331a8b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32c06f330 con 0x7fd32c072620 2019-11-28T11:45:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.328+0000 7fd331a8b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c0706c0 con 0x7fd32c06c0a0 2019-11-28T11:45:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd32bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c06c0a0 0x7fd32c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd330829700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd32c072620 0x7fd32c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:20.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd32b7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd32c0734e0 0x7fd32c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:55204/0 (socket says 172.21.15.80:55204) 2019-11-28T11:45:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd32b7fe700 1 -- 172.21.15.80:0/1828228386 learned_addr learned my addr 172.21.15.80:0/1828228386 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd32affd700 1 -- 172.21.15.80:0/1828228386 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1528097276 0 0) 0x7fd320001100 con 0x7fd32c0734e0 2019-11-28T11:45:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd32affd700 1 -- 172.21.15.80:0/1828228386 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd314002e80 con 0x7fd32c0734e0 2019-11-28T11:45:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd330829700 1 -- 172.21.15.80:0/1828228386 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c06c0a0 msgr2=0x7fd32c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:20.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd330829700 1 --2- 172.21.15.80:0/1828228386 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c06c0a0 0x7fd32c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd330829700 1 -- 172.21.15.80:0/1828228386 >> v1:172.21.15.174:6789/0 conn(0x7fd32c0734e0 legacy=0x7fd32c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd330829700 1 -- 172.21.15.80:0/1828228386 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c070a40 con 0x7fd32c072620 2019-11-28T11:45:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd32bfff700 1 --2- 172.21.15.80:0/1828228386 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c06c0a0 0x7fd32c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd330829700 1 --2- 172.21.15.80:0/1828228386 >> v2:172.21.15.174:3300/0 conn(0x7fd32c072620 0x7fd32c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd31c00af80 tx=0x7fd31c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd330829700 1 --2- 172.21.15.80:0/1828228386 >> v2:172.21.15.174:3300/0 conn(0x7fd32c072620 0x7fd32c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd31c00af80 tx=0x7fd31c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd330829700 1 --2- 172.21.15.80:0/1828228386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd32c072620 0x7fd32c164d70 secure :-1 s=READY pgs=1022 cs=0 l=1 rx=0x7fd31c00af80 tx=0x7fd31c00b790).ready entity=mon.1 client_cookie=cb4bd0508f86c9ca server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd330829700 1 --2- 172.21.15.80:0/1828228386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd32c072620 0x7fd32c164d70 secure :-1 s=THROTTLE_DONE pgs=1022 cs=0 l=1 rx=0x7fd31c00af80 tx=0x7fd31c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd330829700 1 --2- 172.21.15.80:0/1828228386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd32c072620 0x7fd32c164d70 secure :-1 s=THROTTLE_DONE pgs=1022 cs=0 l=1 rx=0x7fd31c00af80 tx=0x7fd31c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd32affd700 1 -- 172.21.15.80:0/1828228386 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd31c000bc0 con 0x7fd32c072620 2019-11-28T11:45:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd330829700 1 --2- 172.21.15.80:0/1828228386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd32c072620 0x7fd32c164d70 secure :-1 s=THROTTLE_DONE pgs=1022 cs=0 l=1 rx=0x7fd31c00af80 tx=0x7fd31c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd32affd700 1 -- 172.21.15.80:0/1828228386 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c0097f0 con 0x7fd32c072620 2019-11-28T11:45:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd32affd700 1 -- 172.21.15.80:0/1828228386 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd31c009ec0 con 0x7fd32c072620 2019-11-28T11:45:20.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd331a8b700 1 -- 172.21.15.80:0/1828228386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd32c072620 msgr2=0x7fd32c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd331a8b700 1 --2- 172.21.15.80:0/1828228386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd32c072620 0x7fd32c164d70 secure :-1 s=READY pgs=1022 cs=0 l=1 rx=0x7fd31c00af80 tx=0x7fd31c00b790).stop 2019-11-28T11:45:20.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd331a8b700 1 -- 172.21.15.80:0/1828228386 shutdown_connections 2019-11-28T11:45:20.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd331a8b700 1 --2- 172.21.15.80:0/1828228386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd32c072620 0x7fd32c164d70 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:20.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd331a8b700 1 --2- 172.21.15.80:0/1828228386 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c06c0a0 0x7fd32c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:20.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd331a8b700 1 -- 172.21.15.80:0/1828228386 shutdown_connections 2019-11-28T11:45:20.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd331a8b700 1 -- 172.21.15.80:0/1828228386 wait complete. 2019-11-28T11:45:20.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd331a8b700 1 -- 172.21.15.80:0/1828228386 >> 172.21.15.80:0/1828228386 conn(0x7fd32c061cf0 msgr2=0x7fd32c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:20.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.333+0000 7fd331a8b700 1 Processor -- start 2019-11-28T11:45:20.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.333+0000 7fd331a8b700 1 -- start start 2019-11-28T11:45:20.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fd331a8b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c166a10 0x7fd32c168e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:20.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fd331a8b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32c13bcd0 con 0x7fd32c104820 2019-11-28T11:45:20.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fd331a8b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32c105ea0 con 0x7fd32c104c10 2019-11-28T11:45:20.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fd331a8b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c109130 con 0x7fd32c166a10 2019-11-28T11:45:20.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fd330829700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c166a10 0x7fd32c168e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:20.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fd32b7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd32c104c10 0x7fd32c1050a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:55220/0 (socket says 172.21.15.80:55220) 2019-11-28T11:45:20.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fd32b7fe700 1 -- 172.21.15.80:0/200966576 learned_addr learned my addr 172.21.15.80:0/200966576 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:20.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd330829700 1 -- 172.21.15.80:0/200966576 >> v1:172.21.15.174:6789/0 conn(0x7fd32c104c10 legacy=0x7fd32c1050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd330829700 1 -- 172.21.15.80:0/200966576 >> v1:172.21.15.80:6789/0 conn(0x7fd32c104820 legacy=0x7fd32c10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd330829700 1 -- 172.21.15.80:0/200966576 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c109a90 con 0x7fd32c166a10 2019-11-28T11:45:20.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd330829700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c166a10 0x7fd32c168e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd31c054390 tx=0x7fd31c054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd330829700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c166a10 0x7fd32c168e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd31c054390 tx=0x7fd31c054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd330829700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c166a10 0x7fd32c168e10 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7fd31c054390 tx=0x7fd31c054730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:20.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd330829700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c166a10 0x7fd32c168e10 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7fd31c054390 tx=0x7fd31c054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd330829700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c166a10 0x7fd32c168e10 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7fd31c054390 tx=0x7fd31c054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd328ff9700 1 -- 172.21.15.80:0/200966576 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd31c009990 con 0x7fd32c166a10 2019-11-28T11:45:20.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd330829700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c166a10 0x7fd32c168e10 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7fd31c054390 tx=0x7fd31c054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd328ff9700 1 -- 172.21.15.80:0/200966576 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c0095b0 con 0x7fd32c166a10 2019-11-28T11:45:20.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd328ff9700 1 -- 172.21.15.80:0/200966576 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd31c00a010 con 0x7fd32c166a10 2019-11-28T11:45:20.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd331a8b700 1 -- 172.21.15.80:0/200966576 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32c109e10 con 0x7fd32c166a10 2019-11-28T11:45:20.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd331a8b700 1 -- 172.21.15.80:0/200966576 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32c109a90 con 0x7fd32c166a10 2019-11-28T11:45:20.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fd330829700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c166a10 0x7fd32c168e10 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7fd31c054390 tx=0x7fd31c054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fd328ff9700 1 -- 172.21.15.80:0/200966576 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd31c0097a0 con 0x7fd32c166a10 2019-11-28T11:45:20.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fd330829700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c166a10 0x7fd32c168e10 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7fd31c054390 tx=0x7fd31c054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fd328ff9700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd30c01a940 0x7fd30c01cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:20.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fd328ff9700 1 -- 172.21.15.80:0/200966576 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fd31c075da0 con 0x7fd32c166a10 2019-11-28T11:45:20.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fd32bfff700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd30c01a940 0x7fd30c01cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:20.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fd32bfff700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd30c01a940 0x7fd30c01cdf0 crc :-1 s=READY pgs=712 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:20.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.342+0000 7fd331a8b700 1 -- 172.21.15.80:0/200966576 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32c109e10 con 0x7fd32c166a10 2019-11-28T11:45:20.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.327+0000 7fd552c4f700 1 Processor -- start 2019-11-28T11:45:20.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.327+0000 7fd552c4f700 1 -- start start 2019-11-28T11:45:20.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.328+0000 7fd552c4f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd54c06c490 0x7fd54c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:20.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd552c4f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c06db00 con 0x7fd54c06c0a0 2019-11-28T11:45:20.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd552c4f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c06e000 con 0x7fd54c06ce60 2019-11-28T11:45:20.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd552c4f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c06fd60 con 0x7fd54c06c490 2019-11-28T11:45:20.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd5509eb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd54c06c490 0x7fd54c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:20.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd5511ec700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd54c06c0a0 0x7fd54c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39670/0 (socket says 172.21.15.80:39670) 2019-11-28T11:45:20.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd5511ec700 1 -- 172.21.15.80:0/2064739432 learned_addr learned my addr 172.21.15.80:0/2064739432 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:20.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd54bfff700 1 -- 172.21.15.80:0/2064739432 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976681526 0 0) 0x7fd5440014f0 con 0x7fd54c06c0a0 2019-11-28T11:45:20.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd54bfff700 1 -- 172.21.15.80:0/2064739432 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd534002e80 con 0x7fd54c06c0a0 2019-11-28T11:45:20.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd5509eb700 1 -- 172.21.15.80:0/2064739432 >> v1:172.21.15.174:6789/0 conn(0x7fd54c06ce60 legacy=0x7fd54c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd5509eb700 1 -- 172.21.15.80:0/2064739432 >> v1:172.21.15.80:6789/0 conn(0x7fd54c06c0a0 legacy=0x7fd54c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd5509eb700 1 -- 172.21.15.80:0/2064739432 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c0706c0 con 0x7fd54c06c490 2019-11-28T11:45:20.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd5509eb700 1 --2- 172.21.15.80:0/2064739432 >> v2:172.21.15.80:3300/0 conn(0x7fd54c06c490 0x7fd54c06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd54000af50 tx=0x7fd54000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd5509eb700 1 --2- 172.21.15.80:0/2064739432 >> v2:172.21.15.80:3300/0 conn(0x7fd54c06c490 0x7fd54c06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd54000af50 tx=0x7fd54000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd5509eb700 1 --2- 172.21.15.80:0/2064739432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c490 0x7fd54c06c920 secure :-1 s=READY pgs=1756 cs=0 l=1 rx=0x7fd54000af50 tx=0x7fd54000b760).ready entity=mon.0 client_cookie=b5d738b4b23dcb09 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:20.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd5509eb700 1 --2- 172.21.15.80:0/2064739432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c490 0x7fd54c06c920 secure :-1 s=THROTTLE_DONE pgs=1756 cs=0 l=1 rx=0x7fd54000af50 tx=0x7fd54000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd5509eb700 1 --2- 172.21.15.80:0/2064739432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c490 0x7fd54c06c920 secure :-1 s=THROTTLE_DONE pgs=1756 cs=0 l=1 rx=0x7fd54000af50 tx=0x7fd54000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd54bfff700 1 -- 172.21.15.80:0/2064739432 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd540007210 con 0x7fd54c06c490 2019-11-28T11:45:20.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd5509eb700 1 --2- 172.21.15.80:0/2064739432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c490 0x7fd54c06c920 secure :-1 s=THROTTLE_DONE pgs=1756 cs=0 l=1 rx=0x7fd54000af50 tx=0x7fd54000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd54bfff700 1 -- 172.21.15.80:0/2064739432 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5400099b0 con 0x7fd54c06c490 2019-11-28T11:45:20.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.329+0000 7fd54bfff700 1 -- 172.21.15.80:0/2064739432 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd54000a000 con 0x7fd54c06c490 2019-11-28T11:45:20.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd552c4f700 1 -- 172.21.15.80:0/2064739432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c490 msgr2=0x7fd54c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd552c4f700 1 --2- 172.21.15.80:0/2064739432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c490 0x7fd54c06c920 secure :-1 s=READY pgs=1756 cs=0 l=1 rx=0x7fd54000af50 tx=0x7fd54000b760).stop 2019-11-28T11:45:20.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd552c4f700 1 -- 172.21.15.80:0/2064739432 shutdown_connections 2019-11-28T11:45:20.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.330+0000 7fd552c4f700 1 --2- 172.21.15.80:0/2064739432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c490 0x7fd54c06c920 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:20.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.331+0000 7fd552c4f700 1 -- 172.21.15.80:0/2064739432 shutdown_connections 2019-11-28T11:45:20.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.331+0000 7fd552c4f700 1 -- 172.21.15.80:0/2064739432 wait complete. 2019-11-28T11:45:20.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.331+0000 7fd552c4f700 1 -- 172.21.15.80:0/2064739432 >> 172.21.15.80:0/2064739432 conn(0x7fd54c061cf0 msgr2=0x7fd54c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:20.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.333+0000 7fd552c4f700 1 Processor -- start 2019-11-28T11:45:20.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.333+0000 7fd552c4f700 1 -- start start 2019-11-28T11:45:20.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fd552c4f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd54c1145b0 0x7fd54c114a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:20.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fd552c4f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd54c114f80 0x7fd54c168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:20.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fd552c4f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c13fc50 con 0x7fd54c13f580 2019-11-28T11:45:20.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fd552c4f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c112550 con 0x7fd54c114f80 2019-11-28T11:45:20.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fd552c4f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c112820 con 0x7fd54c1145b0 2019-11-28T11:45:20.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fd5511ec700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd54c13f580 0x7fd54c115730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:55232/0 (socket says 172.21.15.80:55232) 2019-11-28T11:45:20.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fd5509eb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd54c1145b0 0x7fd54c114a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:20.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fd5511ec700 1 -- 172.21.15.80:0/925715931 learned_addr learned my addr 172.21.15.80:0/925715931 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:20.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.334+0000 7fd5519ed700 1 --2- 172.21.15.80:0/925715931 >> v2:172.21.15.80:3300/0 conn(0x7fd54c114f80 0x7fd54c168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:20.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd5509eb700 1 -- 172.21.15.80:0/925715931 >> v2:172.21.15.80:3300/0 conn(0x7fd54c114f80 msgr2=0x7fd54c168a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd5509eb700 1 --2- 172.21.15.80:0/925715931 >> v2:172.21.15.80:3300/0 conn(0x7fd54c114f80 0x7fd54c168a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:20.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd5509eb700 1 -- 172.21.15.80:0/925715931 >> v1:172.21.15.174:6789/0 conn(0x7fd54c13f580 legacy=0x7fd54c115730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd5509eb700 1 -- 172.21.15.80:0/925715931 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c112eb0 con 0x7fd54c1145b0 2019-11-28T11:45:20.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd549ffb700 1 -- 172.21.15.80:0/925715931 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566617304 0 0) 0x7fd5440014f0 con 0x7fd54c13f580 2019-11-28T11:45:20.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd5509eb700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd54c1145b0 0x7fd54c114a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd5400103c0 tx=0x7fd540010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd5509eb700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd54c1145b0 0x7fd54c114a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd5400103c0 tx=0x7fd540010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd5509eb700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd54c1145b0 0x7fd54c114a40 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7fd5400103c0 tx=0x7fd540010760).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:20.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd5509eb700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd54c1145b0 0x7fd54c114a40 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fd5400103c0 tx=0x7fd540010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd5509eb700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd54c1145b0 0x7fd54c114a40 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fd5400103c0 tx=0x7fd540010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd5509eb700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd54c1145b0 0x7fd54c114a40 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fd5400103c0 tx=0x7fd540010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd549ffb700 1 -- 172.21.15.80:0/925715931 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd54000ac20 con 0x7fd54c1145b0 2019-11-28T11:45:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd549ffb700 1 -- 172.21.15.80:0/925715931 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd540009790 con 0x7fd54c1145b0 2019-11-28T11:45:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd552c4f700 1 -- 172.21.15.80:0/925715931 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c113230 con 0x7fd54c1145b0 2019-11-28T11:45:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd552c4f700 1 -- 172.21.15.80:0/925715931 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54c112eb0 con 0x7fd54c1145b0 2019-11-28T11:45:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.335+0000 7fd549ffb700 1 -- 172.21.15.80:0/925715931 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd540009e20 con 0x7fd54c1145b0 2019-11-28T11:45:20.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fd5509eb700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd54c1145b0 0x7fd54c114a40 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fd5400103c0 tx=0x7fd540010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fd549ffb700 1 -- 172.21.15.80:0/925715931 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd540009980 con 0x7fd54c1145b0 2019-11-28T11:45:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fd5509eb700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd54c1145b0 0x7fd54c114a40 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fd5400103c0 tx=0x7fd540010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fd549ffb700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd52c018730 0x7fd52c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fd549ffb700 1 -- 172.21.15.80:0/925715931 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fd540031a20 con 0x7fd54c1145b0 2019-11-28T11:45:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.336+0000 7fd5511ec700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd52c018730 0x7fd52c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.337+0000 7fd5511ec700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd52c018730 0x7fd52c01abc0 crc :-1 s=READY pgs=713 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:20.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.343+0000 7fd552c4f700 1 -- 172.21.15.80:0/925715931 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd524002e60 con 0x7fd54c1145b0 2019-11-28T11:45:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.349+0000 7fd330829700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c166a10 0x7fd32c168e10 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7fd31c054390 tx=0x7fd31c054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.349+0000 7fd328ff9700 1 -- 172.21.15.80:0/200966576 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd31c00ad40 con 0x7fd32c166a10 2019-11-28T11:45:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.349+0000 7fc77bfff700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc77c13eb40 0x7fc77c10afc0 secure :-1 s=THROTTLE_DONE pgs=1025 cs=0 l=1 rx=0x7fc7740107d0 tx=0x7fc774010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.349+0000 7fc778ff9700 1 -- 172.21.15.80:0/1045100382 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc774000cc0 con 0x7fc77c13eb40 2019-11-28T11:45:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.352+0000 7fd5509eb700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd54c1145b0 0x7fd54c114a40 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fd5400103c0 tx=0x7fd540010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.352+0000 7fd549ffb700 1 -- 172.21.15.80:0/925715931 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd54002df80 con 0x7fd54c1145b0 2019-11-28T11:45:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.533+0000 7fc781f73700 1 -- 172.21.15.80:0/1045100382 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7fc77c108700 con 0x7fc77c13eb40 2019-11-28T11:45:20.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.535+0000 7fd331a8b700 1 -- 172.21.15.80:0/200966576 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7fd32c109a90 con 0x7fd32c166a10 2019-11-28T11:45:20.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.543+0000 7fd552c4f700 1 -- 172.21.15.80:0/925715931 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fd524001d10 con 0x7fd54c1145b0 2019-11-28T11:45:20.780 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:45:20.738+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:45:20.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.743+0000 7fd5509eb700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd54c1145b0 0x7fd54c114a40 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7fd5400103c0 tx=0x7fd540010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.743+0000 7fd549ffb700 1 -- 172.21.15.80:0/925715931 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 9123 v101) v1 ==== 95+0+0 (secure 0 0 0) 0x7fd54002df80 con 0x7fd54c1145b0 2019-11-28T11:45:20.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.744+0000 7fd330829700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c166a10 0x7fd32c168e10 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7fd31c054390 tx=0x7fd31c054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.744+0000 7fd328ff9700 1 -- 172.21.15.80:0/200966576 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6497 v101) v1 ==== 95+0+0 (secure 0 0 0) 0x7fd31c0095b0 con 0x7fd32c166a10 2019-11-28T11:45:20.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.745+0000 7fc77bfff700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc77c13eb40 0x7fc77c10afc0 secure :-1 s=THROTTLE_DONE pgs=1025 cs=0 l=1 rx=0x7fc7740107d0 tx=0x7fc774010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:20.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.745+0000 7fc778ff9700 1 -- 172.21.15.80:0/1045100382 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 8530 v101) v1 ==== 95+0+0 (secure 0 0 0) 0x7fc7740078e0 con 0x7fc77c13eb40 2019-11-28T11:45:20.787 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 8530 2019-11-28T11:45:20.789 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 6497 2019-11-28T11:45:20.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.749+0000 7fc781f73700 1 -- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc75c018730 msgr2=0x7fc75c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.749+0000 7fc781f73700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc75c018730 0x7fc75c01abc0 crc :-1 s=READY pgs=714 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:20.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.749+0000 7fc781f73700 1 -- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc77c13eb40 msgr2=0x7fc77c10afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.749+0000 7fc781f73700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc77c13eb40 0x7fc77c10afc0 secure :-1 s=READY pgs=1025 cs=0 l=1 rx=0x7fc7740107d0 tx=0x7fc774010b70).stop 2019-11-28T11:45:20.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.749+0000 7fc781f73700 1 -- 172.21.15.80:0/1045100382 shutdown_connections 2019-11-28T11:45:20.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.749+0000 7fc781f73700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc75c018730 0x7fc75c01abc0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:20.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.749+0000 7fc781f73700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc77c1631f0 0x7fc77c105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:20.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.749+0000 7fc781f73700 1 --2- 172.21.15.80:0/1045100382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc77c13eb40 0x7fc77c10afc0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:20.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.750+0000 7fc781f73700 1 -- 172.21.15.80:0/1045100382 shutdown_connections 2019-11-28T11:45:20.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.750+0000 7fc781f73700 1 -- 172.21.15.80:0/1045100382 wait complete. 2019-11-28T11:45:20.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.750+0000 7fc781f73700 1 -- 172.21.15.80:0/1045100382 >> 172.21.15.80:0/1045100382 conn(0x7fc77c11bfc0 msgr2=0x7fc77c141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:20.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.751+0000 7fd331a8b700 1 -- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd30c01a940 msgr2=0x7fd30c01cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.751+0000 7fd331a8b700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd30c01a940 0x7fd30c01cdf0 crc :-1 s=READY pgs=712 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:20.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.751+0000 7fd331a8b700 1 -- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c166a10 msgr2=0x7fd32c168e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.751+0000 7fd331a8b700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c166a10 0x7fd32c168e10 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7fd31c054390 tx=0x7fd31c054730).stop 2019-11-28T11:45:20.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.751+0000 7fd331a8b700 1 -- 172.21.15.80:0/200966576 shutdown_connections 2019-11-28T11:45:20.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.751+0000 7fd331a8b700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd32c166a10 0x7fd32c168e10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:20.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.751+0000 7fd331a8b700 1 --2- 172.21.15.80:0/200966576 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd30c01a940 0x7fd30c01cdf0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:20.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.751+0000 7fd331a8b700 1 -- 172.21.15.80:0/200966576 shutdown_connections 2019-11-28T11:45:20.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.751+0000 7fd331a8b700 1 -- 172.21.15.80:0/200966576 wait complete. 2019-11-28T11:45:20.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.751+0000 7fd331a8b700 1 -- 172.21.15.80:0/200966576 >> 172.21.15.80:0/200966576 conn(0x7fd32c13d620 msgr2=0x7fd32c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:20.797 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 9123 2019-11-28T11:45:20.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.759+0000 7fd552c4f700 1 -- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd52c018730 msgr2=0x7fd52c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.759+0000 7fd552c4f700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd52c018730 0x7fd52c01abc0 crc :-1 s=READY pgs=713 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:20.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.759+0000 7fd552c4f700 1 -- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd54c1145b0 msgr2=0x7fd54c114a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:20.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.759+0000 7fd552c4f700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd54c1145b0 0x7fd54c114a40 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7fd5400103c0 tx=0x7fd540010760).stop 2019-11-28T11:45:20.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.760+0000 7fd552c4f700 1 -- 172.21.15.80:0/925715931 shutdown_connections 2019-11-28T11:45:20.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.760+0000 7fd552c4f700 1 --2- 172.21.15.80:0/925715931 >> v2:172.21.15.80:3300/0 conn(0x7fd54c114f80 0x7fd54c168a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:20.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.760+0000 7fd552c4f700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd54c1145b0 0x7fd54c114a40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:20.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.760+0000 7fd552c4f700 1 --2- 172.21.15.80:0/925715931 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd52c018730 0x7fd52c01abc0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:20.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.760+0000 7fd552c4f700 1 -- 172.21.15.80:0/925715931 shutdown_connections 2019-11-28T11:45:20.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.760+0000 7fd552c4f700 1 -- 172.21.15.80:0/925715931 wait complete. 2019-11-28T11:45:20.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.760+0000 7fd552c4f700 1 -- 172.21.15.80:0/925715931 >> 172.21.15.80:0/925715931 conn(0x7fd54c1426c0 msgr2=0x7fd54c110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:20.803 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:45:20.804 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:45:20.810 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:45:20.810 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:45:21.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.955+0000 7fddc8262700 1 Processor -- start 2019-11-28T11:45:21.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.955+0000 7fddc8262700 1 -- start start 2019-11-28T11:45:21.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.956+0000 7fddc8262700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fddc006c0a0 0x7fddc0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:21.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.956+0000 7fddc8262700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fddc00734e0 0x7fddc0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:21.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.956+0000 7fddc8262700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc006db00 con 0x7fddc0072360 2019-11-28T11:45:21.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.956+0000 7fddc8262700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc006fd60 con 0x7fddc006c0a0 2019-11-28T11:45:21.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.956+0000 7fddc8262700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc0070030 con 0x7fddc00734e0 2019-11-28T11:45:21.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc67ff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fddc006c0a0 0x7fddc0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:21.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc67ff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fddc006c0a0 0x7fddc0072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40384/0 (socket says 172.21.15.80:40384) 2019-11-28T11:45:21.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc7000700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fddc0072360 0x7fddc006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39702/0 (socket says 172.21.15.80:39702) 2019-11-28T11:45:21.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc67ff700 1 -- 172.21.15.80:0/3213475812 learned_addr learned my addr 172.21.15.80:0/3213475812 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:21.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc5ffe700 1 --2- 172.21.15.80:0/3213475812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fddc00734e0 0x7fddc0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:21.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc67ff700 1 -- 172.21.15.80:0/3213475812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fddc00734e0 msgr2=0x7fddc0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:21.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc67ff700 1 --2- 172.21.15.80:0/3213475812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fddc00734e0 0x7fddc0071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:21.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc67ff700 1 -- 172.21.15.80:0/3213475812 >> v1:172.21.15.80:6789/0 conn(0x7fddc0072360 legacy=0x7fddc006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:21.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc57fd700 1 -- 172.21.15.80:0/3213475812 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280638448 0 0) 0x7fddb8000d30 con 0x7fddc0072360 2019-11-28T11:45:21.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc67ff700 1 -- 172.21.15.80:0/3213475812 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc00706c0 con 0x7fddc006c0a0 2019-11-28T11:45:21.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc67ff700 1 --2- 172.21.15.80:0/3213475812 >> v2:172.21.15.80:3300/0 conn(0x7fddc006c0a0 0x7fddc0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fddb000f6c0 tx=0x7fddb000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc67ff700 1 --2- 172.21.15.80:0/3213475812 >> v2:172.21.15.80:3300/0 conn(0x7fddc006c0a0 0x7fddc0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fddb000f6c0 tx=0x7fddb000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc67ff700 1 --2- 172.21.15.80:0/3213475812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc006c0a0 0x7fddc0072fa0 secure :-1 s=READY pgs=1760 cs=0 l=1 rx=0x7fddb000f6c0 tx=0x7fddb000fa60).ready entity=mon.0 client_cookie=c9c892e9f72b951c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:21.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc67ff700 1 --2- 172.21.15.80:0/3213475812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc006c0a0 0x7fddc0072fa0 secure :-1 s=THROTTLE_DONE pgs=1760 cs=0 l=1 rx=0x7fddb000f6c0 tx=0x7fddb000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc57fd700 1 -- 172.21.15.80:0/3213475812 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddb0000960 con 0x7fddc006c0a0 2019-11-28T11:45:21.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc67ff700 1 --2- 172.21.15.80:0/3213475812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc006c0a0 0x7fddc0072fa0 secure :-1 s=THROTTLE_DONE pgs=1760 cs=0 l=1 rx=0x7fddb000f6c0 tx=0x7fddb000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc67ff700 1 --2- 172.21.15.80:0/3213475812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc006c0a0 0x7fddc0072fa0 secure :-1 s=THROTTLE_DONE pgs=1760 cs=0 l=1 rx=0x7fddb000f6c0 tx=0x7fddb000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc57fd700 1 -- 172.21.15.80:0/3213475812 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb0000c90 con 0x7fddc006c0a0 2019-11-28T11:45:21.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc57fd700 1 -- 172.21.15.80:0/3213475812 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddb0007210 con 0x7fddc006c0a0 2019-11-28T11:45:21.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc8262700 1 -- 172.21.15.80:0/3213475812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc006c0a0 msgr2=0x7fddc0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:21.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.957+0000 7fddc8262700 1 --2- 172.21.15.80:0/3213475812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc006c0a0 0x7fddc0072fa0 secure :-1 s=READY pgs=1760 cs=0 l=1 rx=0x7fddb000f6c0 tx=0x7fddb000fa60).stop 2019-11-28T11:45:21.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.958+0000 7fddc8262700 1 -- 172.21.15.80:0/3213475812 shutdown_connections 2019-11-28T11:45:21.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.958+0000 7fddc8262700 1 --2- 172.21.15.80:0/3213475812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fddc00734e0 0x7fddc0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:21.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.958+0000 7fddc8262700 1 --2- 172.21.15.80:0/3213475812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc006c0a0 0x7fddc0072fa0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:21.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.958+0000 7fddc8262700 1 -- 172.21.15.80:0/3213475812 shutdown_connections 2019-11-28T11:45:21.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.958+0000 7fddc8262700 1 -- 172.21.15.80:0/3213475812 wait complete. 2019-11-28T11:45:21.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.958+0000 7fddc8262700 1 -- 172.21.15.80:0/3213475812 >> 172.21.15.80:0/3213475812 conn(0x7fddc0061cf0 msgr2=0x7fddc0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:21.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.961+0000 7fddc8262700 1 Processor -- start 2019-11-28T11:45:21.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.961+0000 7fddc8262700 1 -- start start 2019-11-28T11:45:21.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.961+0000 7fddc8262700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fddc0164ff0 0x7fddc01653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:21.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.961+0000 7fddc8262700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc0131680 con 0x7fddc0133820 2019-11-28T11:45:21.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.961+0000 7fddc8262700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc010cb40 con 0x7fddc0133cb0 2019-11-28T11:45:21.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.961+0000 7fddc8262700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc010dd90 con 0x7fddc0164ff0 2019-11-28T11:45:21.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddc67ff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fddc0164ff0 0x7fddc01653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:21.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddc5ffe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fddc0133820 0x7fddc01326a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39708/0 (socket says 172.21.15.80:39708) 2019-11-28T11:45:21.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddc5ffe700 1 -- 172.21.15.80:0/2630543255 learned_addr learned my addr 172.21.15.80:0/2630543255 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:21.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddc67ff700 1 -- 172.21.15.80:0/2630543255 >> v1:172.21.15.174:6789/0 conn(0x7fddc0133cb0 legacy=0x7fddc0132ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:21.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddc67ff700 1 -- 172.21.15.80:0/2630543255 >> v1:172.21.15.80:6789/0 conn(0x7fddc0133820 legacy=0x7fddc01326a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:21.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddb6ffd700 1 -- 172.21.15.80:0/2630543255 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160101804 0 0) 0x7fddbc000fb0 con 0x7fddc0133820 2019-11-28T11:45:21.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddc67ff700 1 -- 172.21.15.80:0/2630543255 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc010e6f0 con 0x7fddc0164ff0 2019-11-28T11:45:21.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddc67ff700 1 --2- 172.21.15.80:0/2630543255 >> v2:172.21.15.80:3300/0 conn(0x7fddc0164ff0 0x7fddc01653e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fddb0010380 tx=0x7fddb0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddc67ff700 1 --2- 172.21.15.80:0/2630543255 >> v2:172.21.15.80:3300/0 conn(0x7fddc0164ff0 0x7fddc01653e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fddb0010380 tx=0x7fddb0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddc67ff700 1 --2- 172.21.15.80:0/2630543255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc0164ff0 0x7fddc01653e0 secure :-1 s=READY pgs=1762 cs=0 l=1 rx=0x7fddb0010380 tx=0x7fddb0010720).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:21.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddc67ff700 1 --2- 172.21.15.80:0/2630543255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc0164ff0 0x7fddc01653e0 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7fddb0010380 tx=0x7fddb0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddb6ffd700 1 -- 172.21.15.80:0/2630543255 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddb0000940 con 0x7fddc0164ff0 2019-11-28T11:45:21.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddc67ff700 1 --2- 172.21.15.80:0/2630543255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc0164ff0 0x7fddc01653e0 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7fddb0010380 tx=0x7fddb0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddc67ff700 1 --2- 172.21.15.80:0/2630543255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc0164ff0 0x7fddc01653e0 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7fddb0010380 tx=0x7fddb0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddb6ffd700 1 -- 172.21.15.80:0/2630543255 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb0000f50 con 0x7fddc0164ff0 2019-11-28T11:45:21.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddc8262700 1 -- 172.21.15.80:0/2630543255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc010ea70 con 0x7fddc0164ff0 2019-11-28T11:45:21.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddb6ffd700 1 -- 172.21.15.80:0/2630543255 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddb0000940 con 0x7fddc0164ff0 2019-11-28T11:45:21.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddc8262700 1 -- 172.21.15.80:0/2630543255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc010e6f0 con 0x7fddc0164ff0 2019-11-28T11:45:21.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.962+0000 7fddc67ff700 1 --2- 172.21.15.80:0/2630543255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc0164ff0 0x7fddc01653e0 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7fddb0010380 tx=0x7fddb0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.963+0000 7fddb6ffd700 1 -- 172.21.15.80:0/2630543255 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fddb0000b50 con 0x7fddc0164ff0 2019-11-28T11:45:21.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.963+0000 7fddc67ff700 1 --2- 172.21.15.80:0/2630543255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc0164ff0 0x7fddc01653e0 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7fddb0010380 tx=0x7fddb0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.963+0000 7fddb6ffd700 1 --2- 172.21.15.80:0/2630543255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdda8018730 0x7fdda801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:21.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.963+0000 7fddb6ffd700 1 -- 172.21.15.80:0/2630543255 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fddb0031cf0 con 0x7fddc0164ff0 2019-11-28T11:45:21.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.963+0000 7fddc5ffe700 1 --2- 172.21.15.80:0/2630543255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdda8018730 0x7fdda801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:21.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.963+0000 7fddc5ffe700 1 --2- 172.21.15.80:0/2630543255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdda8018730 0x7fdda801abc0 crc :-1 s=READY pgs=715 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:21.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.971+0000 7fddc8262700 1 -- 172.21.15.80:0/2630543255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc010ea70 con 0x7fddc0164ff0 2019-11-28T11:45:21.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.974+0000 7fddc67ff700 1 --2- 172.21.15.80:0/2630543255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc0164ff0 0x7fddc01653e0 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7fddb0010380 tx=0x7fddb0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:20.974+0000 7fddb6ffd700 1 -- 172.21.15.80:0/2630543255 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fddb0000940 con 0x7fddc0164ff0 2019-11-28T11:45:21.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.147+0000 7fddc8262700 1 -- 172.21.15.80:0/2630543255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fddc010e6f0 con 0x7fddc0164ff0 2019-11-28T11:45:21.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.148+0000 7fddc67ff700 1 --2- 172.21.15.80:0/2630543255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc0164ff0 0x7fddc01653e0 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7fddb0010380 tx=0x7fddb0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.148+0000 7fddb6ffd700 1 -- 172.21.15.80:0/2630543255 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v134) v1 ==== 81+0+31927 (secure 0 0 0) 0x7fddb0017420 con 0x7fddc0164ff0 2019-11-28T11:45:21.192 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:21.192 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:45:21.192 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 134, 2019-11-28T11:45:21.192 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:45:21.192 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:45:21.192 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:45:20.545508+0000", 2019-11-28T11:45:21.193 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:45:21.193 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:45:21.193 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:45:21.193 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:45:21.193 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:45:21.193 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:45:21.193 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:45:21.194 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:45:21.194 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:45:21.194 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:45:21.194 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:45:21.194 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:45:21.194 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:45:21.194 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:45:21.195 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:45:21.195 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 21, 2019-11-28T11:45:21.195 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:45:21.195 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:45:21.195 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:45:21.195 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:45:21.196 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:45:21.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.196 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:45:21.196 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:45:21.196 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:45:21.196 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:45:21.196 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:45:21.197 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:45:21.197 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:45:21.197 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:45:21.197 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:45:21.197 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:45:21.197 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:45:21.198 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:45:21.198 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:45:21.198 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:45:21.199 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:45:21.199 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:45:21.199 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:45:21.199 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:45:21.199 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:45:21.200 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:45:21.200 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:45:21.200 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:45:21.200 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:45:21.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.200 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:45:21.200 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:45:21.201 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:45:21.201 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:45:21.201 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:45:21.201 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:45:21.201 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:45:21.201 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:45:21.201 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:45:21.202 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:45:21.202 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:45:21.202 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:45:21.202 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:45:21.202 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:45:21.202 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:45:21.202 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:45:21.203 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:45:21.203 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:45:21.203 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:45:21.203 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:45:21.203 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:45:21.204 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:45:21.204 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:45:21.204 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:45:21.204 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:45:21.204 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:45:21.204 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:45:21.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.205 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:45:21.205 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:45:21.205 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:45:21.205 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:45:21.205 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:45:21.205 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:45:21.205 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:45:21.206 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:45:21.206 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:45:21.206 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:45:21.206 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:45:21.206 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:45:21.206 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:45:21.206 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:45:21.207 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.207 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 20, 2019-11-28T11:45:21.207 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:45:21.207 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:44:59.649701+0000", 2019-11-28T11:45:21.210 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:45:21.210 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:45:21.210 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:45:21.210 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:45:21.211 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:45:21.211 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:45:21.211 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:45:21.211 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:45:21.211 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:45:21.211 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:45:21.211 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:45:21.212 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:45:21.212 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:45:21.212 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:45:21.212 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:45:21.212 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:45:21.212 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:45:21.213 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:45:21.213 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:45:21.213 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:45:21.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.213 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "127", 2019-11-28T11:45:21.213 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:45:21.213 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:45:21.214 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:45:21.214 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:45:21.214 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:45:21.214 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:45:21.214 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:45:21.214 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:45:21.214 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:45:21.215 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:45:21.215 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:45:21.215 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:45:21.215 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:45:21.215 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:45:21.215 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:45:21.215 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:45:21.216 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:45:21.216 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:45:21.216 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:45:21.216 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:45:21.216 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:45:21.216 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:45:21.216 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:45:21.217 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:45:21.217 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:45:21.217 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:45:21.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.217 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:45:21.217 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:45:21.217 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:45:21.218 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:45:21.227 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:45:21.227 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:45:21.227 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:45:21.228 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:45:21.228 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:45:21.228 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:45:21.228 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:45:21.228 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:45:21.229 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:45:21.229 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:45:21.230 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:45:21.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.230 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:45:21.230 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:45:21.230 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:45:21.230 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.230 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.231 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 21, 2019-11-28T11:45:21.231 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:45:21.231 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:45:00.387932+0000", 2019-11-28T11:45:21.231 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:45:21.231 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:45:21.232 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:45:21.232 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:45:21.232 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:45:21.232 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:45:21.232 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:45:21.232 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:45:21.233 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:45:21.233 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:45:21.233 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:45:21.233 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:45:21.233 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:45:21.233 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:45:21.233 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:45:21.234 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:45:21.234 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:45:21.234 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:45:21.234 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:45:21.234 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:45:21.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.234 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "128", 2019-11-28T11:45:21.235 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:45:21.235 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:45:21.235 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:45:21.235 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:45:21.235 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:45:21.235 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:45:21.235 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:45:21.237 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:45:21.237 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:45:21.237 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:45:21.237 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:45:21.237 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:45:21.237 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:45:21.238 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:45:21.238 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:45:21.238 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:45:21.238 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:45:21.238 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:45:21.238 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:45:21.238 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:45:21.239 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:45:21.239 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:45:21.239 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:45:21.239 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:45:21.239 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:45:21.239 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:45:21.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.240 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:45:21.240 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:45:21.240 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:45:21.240 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:45:21.240 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:45:21.240 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:45:21.240 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:45:21.241 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:45:21.241 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:45:21.241 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:45:21.241 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:45:21.241 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:45:21.241 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:45:21.241 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:45:21.242 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:45:21.242 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.242 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.242 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.242 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:45:21.243 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:45:21.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.243 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:45:21.243 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:45:21.243 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:45:21.244 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:45:21.244 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:45:21.244 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:45:21.244 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:45:21.244 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:45:21.244 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:45:21.244 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 125, 2019-11-28T11:45:21.245 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:45:21.245 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:45:21.245 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:45:21.245 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.245 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.245 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:45:21.246 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:45:21.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.246 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.247 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:45:21.248 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:45:21.248 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.248 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.248 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:45:21.248 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.249 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.249 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:45:21.249 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:45:21.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.250 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.250 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:45:21.250 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:45:21.250 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.250 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.250 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:45:21.251 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.251 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.251 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:45:21.251 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:45:21.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.252 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.252 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:45:21.252 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:45:21.252 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.252 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.252 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:45:21.253 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.253 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.253 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:45:21.253 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:45:21.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.254 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.254 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:45:21.254 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:45:21.254 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.254 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.254 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:45:21.255 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:45:21.255 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:45:21.255 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:45:21.255 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:45:21.255 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:45:21.255 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:45:21.255 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.256 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:45:21.256 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:45:21.256 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:45:21.256 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:45:21.257 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:45:21.257 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:45:21.258 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:45:21.258 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:45:21.258 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:45:21.258 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 126, 2019-11-28T11:45:21.258 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:45:21.259 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:45:21.259 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:45:21.259 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.260 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.260 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:45:21.260 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:45:21.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.261 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.261 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:45:21.261 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:45:21.261 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.261 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.262 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:45:21.262 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.262 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.262 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:45:21.262 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:45:21.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.263 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.263 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:45:21.263 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:45:21.263 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.264 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.264 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:45:21.264 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.264 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.265 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:45:21.265 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:45:21.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.265 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.265 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:45:21.266 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:45:21.266 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.266 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.267 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:45:21.267 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.267 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.267 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:45:21.267 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:45:21.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.268 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.269 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:45:21.269 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:45:21.269 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.269 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.269 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:45:21.269 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:45:21.270 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:45:21.270 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:45:21.270 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:45:21.270 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:45:21.270 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:45:21.271 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.272 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:45:21.272 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:45:21.272 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:45:21.272 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:45:21.273 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:45:21.273 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:45:21.273 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:45:21.273 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:45:21.273 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:45:21.274 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 126, 2019-11-28T11:45:21.274 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:45:21.274 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:45:21.274 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:45:21.275 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.275 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.275 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:45:21.276 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:45:21.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.276 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.276 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:45:21.276 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:45:21.277 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.277 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.277 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:45:21.278 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.278 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.278 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:45:21.278 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:45:21.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.279 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.279 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:45:21.279 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:45:21.279 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.279 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.279 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:45:21.280 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.280 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.280 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:45:21.280 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:45:21.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.281 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.281 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:45:21.281 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:45:21.281 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.281 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.282 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:45:21.282 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.282 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.282 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:45:21.282 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:45:21.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.283 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.283 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:45:21.283 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:45:21.283 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.283 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.284 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:45:21.284 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:45:21.284 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:45:21.284 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:45:21.284 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:45:21.284 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:45:21.284 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:45:21.285 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.285 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:45:21.285 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:45:21.285 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:45:21.285 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:45:21.285 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:45:21.286 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:45:21.286 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:45:21.286 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:45:21.286 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:45:21.286 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 126, 2019-11-28T11:45:21.286 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:45:21.286 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:45:21.287 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:45:21.287 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.287 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.287 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:45:21.287 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:45:21.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.288 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.288 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:45:21.288 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:45:21.288 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.288 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.289 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:45:21.289 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.289 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.289 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:45:21.289 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:45:21.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.290 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.290 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:45:21.290 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:45:21.290 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.291 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.291 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:45:21.291 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.291 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.291 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:45:21.292 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:45:21.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.292 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.292 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:45:21.292 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:45:21.292 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.293 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.293 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:45:21.293 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.293 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.293 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:45:21.294 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:45:21.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.294 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.294 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:45:21.294 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:45:21.294 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.295 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.295 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:45:21.295 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:45:21.295 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:45:21.295 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:45:21.295 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:45:21.296 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:45:21.296 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:45:21.296 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.296 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:45:21.296 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:45:21.297 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:45:21.297 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:45:21.297 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:45:21.297 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:45:21.297 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:45:21.297 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:45:21.297 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:45:21.298 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 115, 2019-11-28T11:45:21.298 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:45:21.298 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:45:21.298 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:45:21.298 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.298 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.299 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:45:21.299 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:45:21.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.299 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.299 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:45:21.299 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:45:21.300 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.300 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.300 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:45:21.300 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.300 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.301 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:45:21.301 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:45:21.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.301 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.302 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:45:21.302 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:45:21.302 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.302 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.302 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:45:21.302 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.303 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.303 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:45:21.303 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:45:21.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.303 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.304 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:45:21.304 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:45:21.304 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.304 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.304 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:45:21.304 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.305 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.305 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:45:21.305 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:45:21.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.305 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.305 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:45:21.306 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:45:21.306 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.306 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.306 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:45:21.306 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:45:21.306 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:45:21.307 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:45:21.307 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:45:21.307 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:45:21.307 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:45:21.307 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.308 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:45:21.308 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:45:21.308 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:45:21.308 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:45:21.308 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:45:21.308 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:45:21.308 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:45:21.309 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:45:21.309 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:45:21.309 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 126, 2019-11-28T11:45:21.309 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:45:21.309 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:45:21.309 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:45:21.309 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.310 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.310 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:45:21.310 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:45:21.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.310 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.311 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:45:21.311 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:45:21.311 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.311 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.312 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:45:21.312 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.312 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.312 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:45:21.313 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:45:21.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.313 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.313 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:45:21.314 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:45:21.314 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.314 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.315 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:45:21.315 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.315 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.315 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:45:21.316 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:45:21.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.316 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.316 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:45:21.317 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:45:21.317 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.317 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.317 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:45:21.318 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.318 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.318 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:45:21.318 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:45:21.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.319 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.319 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:45:21.319 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:45:21.320 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.320 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.320 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:45:21.321 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:45:21.321 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:45:21.321 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:45:21.321 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:45:21.321 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:45:21.322 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:45:21.322 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.322 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:45:21.322 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:45:21.322 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:45:21.323 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:45:21.323 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:45:21.323 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:45:21.323 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:45:21.323 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:45:21.323 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:45:21.323 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 126, 2019-11-28T11:45:21.323 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:45:21.324 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:45:21.324 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:45:21.324 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.324 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.324 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:45:21.325 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:45:21.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.325 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.325 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:45:21.325 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:45:21.325 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.326 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.326 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:45:21.326 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.326 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.326 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:45:21.326 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:45:21.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.327 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.327 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:45:21.327 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:45:21.327 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.327 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.328 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:45:21.328 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.328 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.328 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:45:21.329 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:45:21.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.329 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.329 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:45:21.329 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:45:21.330 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.330 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.330 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:45:21.330 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.330 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.331 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:45:21.331 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:45:21.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.331 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.332 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:45:21.332 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:45:21.332 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.332 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.332 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:45:21.332 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:45:21.333 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:45:21.333 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:45:21.333 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:45:21.333 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:45:21.333 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:45:21.333 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.334 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:45:21.334 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:45:21.334 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:45:21.334 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:45:21.334 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:45:21.334 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:45:21.334 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:45:21.335 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:45:21.335 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:45:21.335 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 126, 2019-11-28T11:45:21.335 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:45:21.335 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:45:21.335 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:45:21.335 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.336 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.336 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:45:21.336 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:45:21.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.337 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.337 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:45:21.337 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:45:21.337 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.337 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.337 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:45:21.338 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.338 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.338 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:45:21.338 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:45:21.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.339 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.339 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:45:21.339 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:45:21.339 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.340 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.340 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:45:21.340 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.340 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.341 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:45:21.341 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:45:21.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.341 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.341 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:45:21.341 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:45:21.342 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.342 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.342 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:45:21.342 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:45:21.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.343 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:45:21.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:45:21.343 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:45:21.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.343 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:45:21.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:45:21.344 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:45:21.344 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.344 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.344 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:45:21.344 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:45:21.344 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:45:21.345 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:45:21.345 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:45:21.345 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:45:21.345 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:45:21.345 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:21.345 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.345 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:45:21.346 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:45:21.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.346 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:45:21.346 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:45:21.346 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:45:21.346 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:45:21.346 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:45:21.347 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:45:21.347 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:45:21.347 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:45:21.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.347 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:45:21.347 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:45:21.347 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:45:21.348 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:45:21.348 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:45:21.348 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:45:21.348 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:45:21.348 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:45:21.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.349 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:45:21.349 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:45:21.349 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:45:21.349 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:45:21.350 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:45:21.350 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:45:21.350 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:45:21.350 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:45:21.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.351 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:45:21.351 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:45:21.351 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:45:21.351 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:45:21.352 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:45:21.352 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:45:21.352 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:45:21.352 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:45:21.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.353 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:45:21.353 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:45:21.353 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:45:21.353 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:45:21.354 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:45:21.354 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:45:21.354 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:45:21.354 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:45:21.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.354 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:45:21.355 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:45:21.355 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:45:21.355 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:45:21.355 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:45:21.355 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:45:21.355 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:45:21.355 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:45:21.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.356 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:45:21.356 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:45:21.356 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:45:21.356 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:45:21.356 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:45:21.357 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:45:21.357 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:45:21.357 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:45:21.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:21.357 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:45:21.357 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:45:21.358 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:45:21.358 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:45:21.358 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:45:21.358 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:45:21.358 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:45:21.358 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:45:21.358 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.359 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:45:21.359 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:45:21.359 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:45:21.359 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:45:21.359 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:45:21.359 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:45:21.359 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/588051121": "2019-11-29T11:45:20.536087+0000", 2019-11-28T11:45:21.359 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/1730908433": "2019-11-29T11:45:13.231482+0000", 2019-11-28T11:45:21.360 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/588051121": "2019-11-29T11:45:20.536087+0000", 2019-11-28T11:45:21.360 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/1730908433": "2019-11-29T11:45:13.231482+0000" 2019-11-28T11:45:21.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.361 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:45:21.362 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:45:21.362 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:45:21.362 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:45:21.362 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:45:21.362 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:45:21.362 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:45:21.362 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:45:21.363 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:45:21.363 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:45:21.363 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:45:21.363 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:45:21.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.364 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:45:21.364 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:45:21.364 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:45:21.365 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:45:21.365 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:45:21.365 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:45:21.365 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:45:21.366 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:21.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:21.366 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:45:21.366 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:45:21.367 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:45:21.367 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:45:21.367 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:45:21.367 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:45:21.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.152+0000 7fddc8262700 1 -- 172.21.15.80:0/2630543255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdda8018730 msgr2=0x7fdda801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:21.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.152+0000 7fddc8262700 1 --2- 172.21.15.80:0/2630543255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdda8018730 0x7fdda801abc0 crc :-1 s=READY pgs=715 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:21.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.152+0000 7fddc8262700 1 -- 172.21.15.80:0/2630543255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc0164ff0 msgr2=0x7fddc01653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:21.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.152+0000 7fddc8262700 1 --2- 172.21.15.80:0/2630543255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc0164ff0 0x7fddc01653e0 secure :-1 s=READY pgs=1762 cs=0 l=1 rx=0x7fddb0010380 tx=0x7fddb0010720).stop 2019-11-28T11:45:21.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.152+0000 7fddc8262700 1 -- 172.21.15.80:0/2630543255 shutdown_connections 2019-11-28T11:45:21.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.152+0000 7fddc8262700 1 --2- 172.21.15.80:0/2630543255 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdda8018730 0x7fdda801abc0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:21.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.152+0000 7fddc8262700 1 --2- 172.21.15.80:0/2630543255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddc0164ff0 0x7fddc01653e0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:21.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.152+0000 7fddc8262700 1 -- 172.21.15.80:0/2630543255 shutdown_connections 2019-11-28T11:45:21.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.152+0000 7fddc8262700 1 -- 172.21.15.80:0/2630543255 wait complete. 2019-11-28T11:45:21.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.152+0000 7fddc8262700 1 -- 172.21.15.80:0/2630543255 >> 172.21.15.80:0/2630543255 conn(0x7fddc011bfc0 msgr2=0x7fddc0141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:21.375 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:21.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.453+0000 7efd67a42700 1 Processor -- start 2019-11-28T11:45:21.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.454+0000 7efd67a42700 1 -- start start 2019-11-28T11:45:21.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd67a42700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efd6006c490 0x7efd6006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:21.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd67a42700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd6006ce60 0x7efd60164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:21.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd67a42700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6006db00 con 0x7efd6006c0a0 2019-11-28T11:45:21.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd67a42700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6006fd60 con 0x7efd6006c490 2019-11-28T11:45:21.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd67a42700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd60070030 con 0x7efd6006ce60 2019-11-28T11:45:21.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd657de700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efd6006c490 0x7efd6006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:21.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd65fdf700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efd6006c0a0 0x7efd60072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39714/0 (socket says 172.21.15.80:39714) 2019-11-28T11:45:21.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd65fdf700 1 -- 172.21.15.80:0/176929979 learned_addr learned my addr 172.21.15.80:0/176929979 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:21.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd667e0700 1 --2- 172.21.15.80:0/176929979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd6006ce60 0x7efd60164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:21.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd657de700 1 -- 172.21.15.80:0/176929979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd6006ce60 msgr2=0x7efd60164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:21.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd657de700 1 --2- 172.21.15.80:0/176929979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd6006ce60 0x7efd60164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:21.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd657de700 1 -- 172.21.15.80:0/176929979 >> v1:172.21.15.80:6789/0 conn(0x7efd6006c0a0 legacy=0x7efd60072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:21.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd64fdd700 1 -- 172.21.15.80:0/176929979 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843248186 0 0) 0x7efd480014d0 con 0x7efd6006c0a0 2019-11-28T11:45:21.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd657de700 1 -- 172.21.15.80:0/176929979 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd600706c0 con 0x7efd6006c490 2019-11-28T11:45:21.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd667e0700 1 --2- 172.21.15.80:0/176929979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd6006ce60 0x7efd60164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:45:21.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd657de700 1 --2- 172.21.15.80:0/176929979 >> v2:172.21.15.80:3300/0 conn(0x7efd6006c490 0x7efd6006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efd5000af50 tx=0x7efd5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd657de700 1 --2- 172.21.15.80:0/176929979 >> v2:172.21.15.80:3300/0 conn(0x7efd6006c490 0x7efd6006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efd5000af50 tx=0x7efd5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd657de700 1 --2- 172.21.15.80:0/176929979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6006c490 0x7efd6006c920 secure :-1 s=READY pgs=1764 cs=0 l=1 rx=0x7efd5000af50 tx=0x7efd5000b760).ready entity=mon.0 client_cookie=83cf2ba41d39dc27 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:21.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd657de700 1 --2- 172.21.15.80:0/176929979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6006c490 0x7efd6006c920 secure :-1 s=THROTTLE_DONE pgs=1764 cs=0 l=1 rx=0x7efd5000af50 tx=0x7efd5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd64fdd700 1 -- 172.21.15.80:0/176929979 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd50007210 con 0x7efd6006c490 2019-11-28T11:45:21.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd657de700 1 --2- 172.21.15.80:0/176929979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6006c490 0x7efd6006c920 secure :-1 s=THROTTLE_DONE pgs=1764 cs=0 l=1 rx=0x7efd5000af50 tx=0x7efd5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd657de700 1 --2- 172.21.15.80:0/176929979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6006c490 0x7efd6006c920 secure :-1 s=THROTTLE_DONE pgs=1764 cs=0 l=1 rx=0x7efd5000af50 tx=0x7efd5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd64fdd700 1 -- 172.21.15.80:0/176929979 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd500099b0 con 0x7efd6006c490 2019-11-28T11:45:21.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd64fdd700 1 -- 172.21.15.80:0/176929979 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd5000a080 con 0x7efd6006c490 2019-11-28T11:45:21.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd67a42700 1 -- 172.21.15.80:0/176929979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6006c490 msgr2=0x7efd6006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:21.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.455+0000 7efd67a42700 1 --2- 172.21.15.80:0/176929979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6006c490 0x7efd6006c920 secure :-1 s=READY pgs=1764 cs=0 l=1 rx=0x7efd5000af50 tx=0x7efd5000b760).stop 2019-11-28T11:45:21.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.456+0000 7efd67a42700 1 -- 172.21.15.80:0/176929979 shutdown_connections 2019-11-28T11:45:21.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.456+0000 7efd67a42700 1 --2- 172.21.15.80:0/176929979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd6006ce60 0x7efd60164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:21.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.456+0000 7efd67a42700 1 --2- 172.21.15.80:0/176929979 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6006c490 0x7efd6006c920 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:21.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.456+0000 7efd67a42700 1 -- 172.21.15.80:0/176929979 shutdown_connections 2019-11-28T11:45:21.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.456+0000 7efd67a42700 1 -- 172.21.15.80:0/176929979 wait complete. 2019-11-28T11:45:21.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.456+0000 7efd67a42700 1 -- 172.21.15.80:0/176929979 >> 172.21.15.80:0/176929979 conn(0x7efd60061cf0 msgr2=0x7efd60064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:21.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.459+0000 7efd67a42700 1 Processor -- start 2019-11-28T11:45:21.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.459+0000 7efd67a42700 1 -- start start 2019-11-28T11:45:21.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd67a42700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efd6010cfb0 0x7efd6010d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:21.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd67a42700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efd6010d980 0x7efd6012c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:21.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd67a42700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd60135c60 con 0x7efd60104d10 2019-11-28T11:45:21.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd67a42700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd60141e60 con 0x7efd6010cfb0 2019-11-28T11:45:21.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd67a42700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd60107cb0 con 0x7efd6010d980 2019-11-28T11:45:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd657de700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efd6010cfb0 0x7efd6010d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd657de700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efd6010cfb0 0x7efd6010d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40406/0 (socket says 172.21.15.80:40406) 2019-11-28T11:45:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd657de700 1 -- 172.21.15.80:0/2579662646 learned_addr learned my addr 172.21.15.80:0/2579662646 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd667e0700 1 --2- 172.21.15.80:0/2579662646 >> v2:172.21.15.174:3300/0 conn(0x7efd6010d980 0x7efd6012c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:21.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd657de700 1 -- 172.21.15.80:0/2579662646 >> v2:172.21.15.174:3300/0 conn(0x7efd6010d980 msgr2=0x7efd6012c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:21.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd657de700 1 --2- 172.21.15.80:0/2579662646 >> v2:172.21.15.174:3300/0 conn(0x7efd6010d980 0x7efd6012c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:21.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd657de700 1 -- 172.21.15.80:0/2579662646 >> v1:172.21.15.174:6789/0 conn(0x7efd60104d10 legacy=0x7efd6010e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:21.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd657de700 1 -- 172.21.15.80:0/2579662646 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd601424f0 con 0x7efd6010cfb0 2019-11-28T11:45:21.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd657de700 1 --2- 172.21.15.80:0/2579662646 >> v2:172.21.15.80:3300/0 conn(0x7efd6010cfb0 0x7efd6010d440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efd50010470 tx=0x7efd50010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd657de700 1 --2- 172.21.15.80:0/2579662646 >> v2:172.21.15.80:3300/0 conn(0x7efd6010cfb0 0x7efd6010d440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efd50010470 tx=0x7efd50010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd657de700 1 --2- 172.21.15.80:0/2579662646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6010cfb0 0x7efd6010d440 secure :-1 s=READY pgs=1765 cs=0 l=1 rx=0x7efd50010470 tx=0x7efd50010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:21.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd657de700 1 --2- 172.21.15.80:0/2579662646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6010cfb0 0x7efd6010d440 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7efd50010470 tx=0x7efd50010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd5e7fc700 1 -- 172.21.15.80:0/2579662646 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd50000940 con 0x7efd6010cfb0 2019-11-28T11:45:21.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd657de700 1 --2- 172.21.15.80:0/2579662646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6010cfb0 0x7efd6010d440 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7efd50010470 tx=0x7efd50010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd657de700 1 --2- 172.21.15.80:0/2579662646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6010cfb0 0x7efd6010d440 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7efd50010470 tx=0x7efd50010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd5e7fc700 1 -- 172.21.15.80:0/2579662646 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5000b380 con 0x7efd6010cfb0 2019-11-28T11:45:21.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd67a42700 1 -- 172.21.15.80:0/2579662646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd601424f0 con 0x7efd6010cfb0 2019-11-28T11:45:21.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.460+0000 7efd5e7fc700 1 -- 172.21.15.80:0/2579662646 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd50009d60 con 0x7efd6010cfb0 2019-11-28T11:45:21.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.461+0000 7efd67a42700 1 -- 172.21.15.80:0/2579662646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd601424f0 con 0x7efd6010cfb0 2019-11-28T11:45:21.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.461+0000 7efd657de700 1 --2- 172.21.15.80:0/2579662646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6010cfb0 0x7efd6010d440 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7efd50010470 tx=0x7efd50010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.461+0000 7efd5e7fc700 1 -- 172.21.15.80:0/2579662646 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efd50009790 con 0x7efd6010cfb0 2019-11-28T11:45:21.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.461+0000 7efd657de700 1 --2- 172.21.15.80:0/2579662646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6010cfb0 0x7efd6010d440 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7efd50010470 tx=0x7efd50010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.461+0000 7efd5e7fc700 1 --2- 172.21.15.80:0/2579662646 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efd44018730 0x7efd4401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:21.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.461+0000 7efd5e7fc700 1 -- 172.21.15.80:0/2579662646 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6192+0+0 (secure 0 0 0) 0x7efd50031d20 con 0x7efd6010cfb0 2019-11-28T11:45:21.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.461+0000 7efd65fdf700 1 --2- 172.21.15.80:0/2579662646 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efd44018730 0x7efd4401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:21.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.462+0000 7efd65fdf700 1 --2- 172.21.15.80:0/2579662646 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efd44018730 0x7efd4401abe0 crc :-1 s=READY pgs=716 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:21.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.469+0000 7efd67a42700 1 -- 172.21.15.80:0/2579662646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd601424f0 con 0x7efd6010cfb0 2019-11-28T11:45:21.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.472+0000 7efd657de700 1 --2- 172.21.15.80:0/2579662646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6010cfb0 0x7efd6010d440 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7efd50010470 tx=0x7efd50010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.472+0000 7efd5e7fc700 1 -- 172.21.15.80:0/2579662646 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efd50009580 con 0x7efd6010cfb0 2019-11-28T11:45:21.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.647+0000 7efd67a42700 1 -- 172.21.15.80:0/2579662646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd601424f0 con 0x7efd6010cfb0 2019-11-28T11:45:21.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.647+0000 7efd657de700 1 --2- 172.21.15.80:0/2579662646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6010cfb0 0x7efd6010d440 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7efd50010470 tx=0x7efd50010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.647+0000 7efd5e7fc700 1 -- 172.21.15.80:0/2579662646 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+1432 (secure 0 0 0) 0x7efd50009790 con 0x7efd6010cfb0 2019-11-28T11:45:21.690 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 101 2019-11-28T11:45:21.690 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:21.691 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":101,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:01.366373+0000","modified":"2019-11-28T11:45:20.739644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":132,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2019-11-28T11:45:21.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.650+0000 7efd67a42700 1 -- 172.21.15.80:0/2579662646 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efd44018730 msgr2=0x7efd4401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:21.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.650+0000 7efd67a42700 1 --2- 172.21.15.80:0/2579662646 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efd44018730 0x7efd4401abe0 crc :-1 s=READY pgs=716 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:21.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.650+0000 7efd67a42700 1 -- 172.21.15.80:0/2579662646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6010cfb0 msgr2=0x7efd6010d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:21.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.650+0000 7efd67a42700 1 --2- 172.21.15.80:0/2579662646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6010cfb0 0x7efd6010d440 secure :-1 s=READY pgs=1765 cs=0 l=1 rx=0x7efd50010470 tx=0x7efd50010270).stop 2019-11-28T11:45:21.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.650+0000 7efd67a42700 1 -- 172.21.15.80:0/2579662646 shutdown_connections 2019-11-28T11:45:21.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.650+0000 7efd67a42700 1 --2- 172.21.15.80:0/2579662646 >> v2:172.21.15.174:3300/0 conn(0x7efd6010d980 0x7efd6012c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:21.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.650+0000 7efd67a42700 1 --2- 172.21.15.80:0/2579662646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd6010cfb0 0x7efd6010d440 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:21.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.650+0000 7efd67a42700 1 --2- 172.21.15.80:0/2579662646 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efd44018730 0x7efd4401abe0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:21.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.650+0000 7efd67a42700 1 -- 172.21.15.80:0/2579662646 shutdown_connections 2019-11-28T11:45:21.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.650+0000 7efd67a42700 1 -- 172.21.15.80:0/2579662646 wait complete. 2019-11-28T11:45:21.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.650+0000 7efd67a42700 1 -- 172.21.15.80:0/2579662646 >> 172.21.15.80:0/2579662646 conn(0x7efd6015e210 msgr2=0x7efd6010b140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:21.701 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:45:21.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.786+0000 7f38ed3ee700 1 Processor -- start 2019-11-28T11:45:21.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.786+0000 7f38ed3ee700 1 -- start start 2019-11-28T11:45:21.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.787+0000 7f38ed3ee700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f38e806c0a0 0x7f38e8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:21.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.787+0000 7f38ed3ee700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38e80734e0 0x7f38e8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:21.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.787+0000 7f38ed3ee700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e806db00 con 0x7f38e8072360 2019-11-28T11:45:21.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.787+0000 7f38ed3ee700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e806fd60 con 0x7f38e806c0a0 2019-11-28T11:45:21.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.787+0000 7f38ed3ee700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e8070030 con 0x7f38e80734e0 2019-11-28T11:45:21.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.787+0000 7f38e6ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38e80734e0 0x7f38e8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:21.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.787+0000 7f38e77fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f38e806c0a0 0x7f38e8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:21.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.787+0000 7f38e7fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f38e8072360 0x7f38e806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:55274/0 (socket says 172.21.15.80:55274) 2019-11-28T11:45:21.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.787+0000 7f38e7fff700 1 -- 172.21.15.80:0/3751363849 learned_addr learned my addr 172.21.15.80:0/3751363849 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:21.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38e77fe700 1 -- 172.21.15.80:0/3751363849 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38e80734e0 msgr2=0x7f38e8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:21.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38e77fe700 1 --2- 172.21.15.80:0/3751363849 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38e80734e0 0x7f38e8071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:21.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38e77fe700 1 -- 172.21.15.80:0/3751363849 >> v1:172.21.15.174:6789/0 conn(0x7f38e8072360 legacy=0x7f38e806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:21.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38e67fc700 1 -- 172.21.15.80:0/3751363849 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032591313 0 0) 0x7f38e00009b0 con 0x7f38e8072360 2019-11-28T11:45:21.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38e77fe700 1 -- 172.21.15.80:0/3751363849 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e80706c0 con 0x7f38e806c0a0 2019-11-28T11:45:21.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38e6ffd700 1 --2- 172.21.15.80:0/3751363849 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38e80734e0 0x7f38e8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:21.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38e77fe700 1 --2- 172.21.15.80:0/3751363849 >> v2:172.21.15.174:3300/0 conn(0x7f38e806c0a0 0x7f38e8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f38d800af50 tx=0x7f38d800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38e77fe700 1 --2- 172.21.15.80:0/3751363849 >> v2:172.21.15.174:3300/0 conn(0x7f38e806c0a0 0x7f38e8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f38d800af50 tx=0x7f38d800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38e77fe700 1 --2- 172.21.15.80:0/3751363849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e806c0a0 0x7f38e8072fa0 secure :-1 s=READY pgs=1029 cs=0 l=1 rx=0x7f38d800af50 tx=0x7f38d800b760).ready entity=mon.1 client_cookie=2350ebf09e20ec8b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:21.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38e77fe700 1 --2- 172.21.15.80:0/3751363849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e806c0a0 0x7f38e8072fa0 secure :-1 s=THROTTLE_DONE pgs=1029 cs=0 l=1 rx=0x7f38d800af50 tx=0x7f38d800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38e67fc700 1 -- 172.21.15.80:0/3751363849 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38d8007210 con 0x7f38e806c0a0 2019-11-28T11:45:21.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38e77fe700 1 --2- 172.21.15.80:0/3751363849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e806c0a0 0x7f38e8072fa0 secure :-1 s=THROTTLE_DONE pgs=1029 cs=0 l=1 rx=0x7f38d800af50 tx=0x7f38d800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38e77fe700 1 --2- 172.21.15.80:0/3751363849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e806c0a0 0x7f38e8072fa0 secure :-1 s=THROTTLE_DONE pgs=1029 cs=0 l=1 rx=0x7f38d800af50 tx=0x7f38d800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38e67fc700 1 -- 172.21.15.80:0/3751363849 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d80099b0 con 0x7f38e806c0a0 2019-11-28T11:45:21.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38e67fc700 1 -- 172.21.15.80:0/3751363849 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38d8007210 con 0x7f38e806c0a0 2019-11-28T11:45:21.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38ed3ee700 1 -- 172.21.15.80:0/3751363849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e806c0a0 msgr2=0x7f38e8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:21.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.788+0000 7f38ed3ee700 1 --2- 172.21.15.80:0/3751363849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e806c0a0 0x7f38e8072fa0 secure :-1 s=READY pgs=1029 cs=0 l=1 rx=0x7f38d800af50 tx=0x7f38d800b760).stop 2019-11-28T11:45:21.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.789+0000 7f38ed3ee700 1 -- 172.21.15.80:0/3751363849 shutdown_connections 2019-11-28T11:45:21.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.789+0000 7f38ed3ee700 1 --2- 172.21.15.80:0/3751363849 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38e80734e0 0x7f38e8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:21.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.789+0000 7f38ed3ee700 1 --2- 172.21.15.80:0/3751363849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e806c0a0 0x7f38e8072fa0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:21.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.789+0000 7f38ed3ee700 1 -- 172.21.15.80:0/3751363849 shutdown_connections 2019-11-28T11:45:21.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.789+0000 7f38ed3ee700 1 -- 172.21.15.80:0/3751363849 wait complete. 2019-11-28T11:45:21.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.789+0000 7f38ed3ee700 1 -- 172.21.15.80:0/3751363849 >> 172.21.15.80:0/3751363849 conn(0x7f38e8061cf0 msgr2=0x7f38e8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:21.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.791+0000 7f38ed3ee700 1 Processor -- start 2019-11-28T11:45:21.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.791+0000 7f38ed3ee700 1 -- start start 2019-11-28T11:45:21.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.792+0000 7f38ed3ee700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f38e8162fd0 0x7f38e81633c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:21.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.792+0000 7f38ed3ee700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38e8115170 0x7f38e8114300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:21.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.792+0000 7f38ed3ee700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e8131340 con 0x7f38e8114ce0 2019-11-28T11:45:21.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.792+0000 7f38ed3ee700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e81234c0 con 0x7f38e8162fd0 2019-11-28T11:45:21.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.792+0000 7f38ed3ee700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e813ef50 con 0x7f38e8115170 2019-11-28T11:45:21.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.792+0000 7f38e77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f38e8162fd0 0x7f38e81633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:21.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.792+0000 7f38e6ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f38e8114ce0 0x7f38e8113b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39736/0 (socket says 172.21.15.80:39736) 2019-11-28T11:45:21.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.792+0000 7f38e77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f38e8162fd0 0x7f38e81633c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40418/0 (socket says 172.21.15.80:40418) 2019-11-28T11:45:21.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.792+0000 7f38e6ffd700 1 -- 172.21.15.80:0/988626623 learned_addr learned my addr 172.21.15.80:0/988626623 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:21.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38e7fff700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38e8115170 0x7f38e8114300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:21.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38e77fe700 1 -- 172.21.15.80:0/988626623 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38e8115170 msgr2=0x7f38e8114300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:21.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38e77fe700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38e8115170 0x7f38e8114300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:21.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38e77fe700 1 -- 172.21.15.80:0/988626623 >> v1:172.21.15.80:6789/0 conn(0x7f38e8114ce0 legacy=0x7f38e8113b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:21.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38e77fe700 1 -- 172.21.15.80:0/988626623 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e81123c0 con 0x7f38e8162fd0 2019-11-28T11:45:21.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38dffff700 1 -- 172.21.15.80:0/988626623 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665623608 0 0) 0x7f38d000e110 con 0x7f38e8114ce0 2019-11-28T11:45:21.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38e77fe700 1 --2- 172.21.15.80:0/988626623 >> v2:172.21.15.80:3300/0 conn(0x7f38e8162fd0 0x7f38e81633c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f38d80103b0 tx=0x7f38d80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38e77fe700 1 --2- 172.21.15.80:0/988626623 >> v2:172.21.15.80:3300/0 conn(0x7f38e8162fd0 0x7f38e81633c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f38d80103b0 tx=0x7f38d80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38e77fe700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38e8162fd0 0x7f38e81633c0 secure :-1 s=READY pgs=1767 cs=0 l=1 rx=0x7f38d80103b0 tx=0x7f38d80101b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:21.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38e77fe700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38e8162fd0 0x7f38e81633c0 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f38d80103b0 tx=0x7f38d80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38dffff700 1 -- 172.21.15.80:0/988626623 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38d8000940 con 0x7f38e8162fd0 2019-11-28T11:45:21.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38e77fe700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38e8162fd0 0x7f38e81633c0 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f38d80103b0 tx=0x7f38d80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38dffff700 1 -- 172.21.15.80:0/988626623 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d8009770 con 0x7f38e8162fd0 2019-11-28T11:45:21.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38ed3ee700 1 -- 172.21.15.80:0/988626623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e8112740 con 0x7f38e8162fd0 2019-11-28T11:45:21.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38e77fe700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38e8162fd0 0x7f38e81633c0 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f38d80103b0 tx=0x7f38d80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38dffff700 1 -- 172.21.15.80:0/988626623 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38d8000940 con 0x7f38e8162fd0 2019-11-28T11:45:21.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38ed3ee700 1 -- 172.21.15.80:0/988626623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e81123c0 con 0x7f38e8162fd0 2019-11-28T11:45:21.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.793+0000 7f38e77fe700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38e8162fd0 0x7f38e81633c0 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f38d80103b0 tx=0x7f38d80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.794+0000 7f38dffff700 1 -- 172.21.15.80:0/988626623 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f38d8009960 con 0x7f38e8162fd0 2019-11-28T11:45:21.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.794+0000 7f38e77fe700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38e8162fd0 0x7f38e81633c0 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f38d80103b0 tx=0x7f38d80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.794+0000 7f38dffff700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f38c0018730 0x7f38c001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:21.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.794+0000 7f38dffff700 1 -- 172.21.15.80:0/988626623 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f38d80319c0 con 0x7f38e8162fd0 2019-11-28T11:45:21.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.794+0000 7f38e6ffd700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f38c0018730 0x7f38c001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:21.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.794+0000 7f38e6ffd700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f38c0018730 0x7f38c001abc0 crc :-1 s=READY pgs=717 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:21.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.801+0000 7f38ed3ee700 1 -- 172.21.15.80:0/988626623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e8112740 con 0x7f38e8162fd0 2019-11-28T11:45:21.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.805+0000 7f38e77fe700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38e8162fd0 0x7f38e81633c0 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f38d80103b0 tx=0x7f38d80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:21.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.805+0000 7f38dffff700 1 -- 172.21.15.80:0/988626623 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f38d802df20 con 0x7f38e8162fd0 2019-11-28T11:45:22.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:21.968+0000 7f38ed3ee700 1 -- 172.21.15.80:0/988626623 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f38e81123c0 con 0x7f38e8162fd0 2019-11-28T11:45:22.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.748+0000 7f38e77fe700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38e8162fd0 0x7f38e81633c0 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f38d80103b0 tx=0x7f38d80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:22.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.748+0000 7f38dffff700 1 -- 172.21.15.80:0/988626623 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v102) v1 ==== 161+0+0 (secure 0 0 0) 0x7f38d8009960 con 0x7f38e8162fd0 2019-11-28T11:45:22.824 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:45:22.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.786+0000 7f38ed3ee700 1 -- 172.21.15.80:0/988626623 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f38c0018730 msgr2=0x7f38c001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:22.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.786+0000 7f38ed3ee700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f38c0018730 0x7f38c001abc0 crc :-1 s=READY pgs=717 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:22.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.786+0000 7f38ed3ee700 1 -- 172.21.15.80:0/988626623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38e8162fd0 msgr2=0x7f38e81633c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:22.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.786+0000 7f38ed3ee700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38e8162fd0 0x7f38e81633c0 secure :-1 s=READY pgs=1767 cs=0 l=1 rx=0x7f38d80103b0 tx=0x7f38d80101b0).stop 2019-11-28T11:45:22.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.786+0000 7f38ed3ee700 1 -- 172.21.15.80:0/988626623 shutdown_connections 2019-11-28T11:45:22.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.786+0000 7f38ed3ee700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f38c0018730 0x7f38c001abc0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:22.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.786+0000 7f38ed3ee700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38e8115170 0x7f38e8114300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.786+0000 7f38ed3ee700 1 --2- 172.21.15.80:0/988626623 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38e8162fd0 0x7f38e81633c0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.786+0000 7f38ed3ee700 1 -- 172.21.15.80:0/988626623 shutdown_connections 2019-11-28T11:45:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.786+0000 7f38ed3ee700 1 -- 172.21.15.80:0/988626623 wait complete. 2019-11-28T11:45:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.786+0000 7f38ed3ee700 1 -- 172.21.15.80:0/988626623 >> 172.21.15.80:0/988626623 conn(0x7f38e811bfc0 msgr2=0x7f38e8141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:22.836 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:22.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.915+0000 7f955478f700 1 Processor -- start 2019-11-28T11:45:22.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.915+0000 7f955478f700 1 -- start start 2019-11-28T11:45:22.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.916+0000 7f955478f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f954c06c0a0 0x7f954c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:22.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.916+0000 7f955478f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c06db00 con 0x7f954c0734e0 2019-11-28T11:45:22.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.916+0000 7f955478f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c06e000 con 0x7f954c072620 2019-11-28T11:45:22.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.916+0000 7f955478f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954c06fd60 con 0x7f954c06c0a0 2019-11-28T11:45:22.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.916+0000 7f9552d2c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f954c06c0a0 0x7f954c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:22.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.916+0000 7f955252b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f954c0734e0 0x7f954c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39746/0 (socket says 172.21.15.80:39746) 2019-11-28T11:45:22.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.916+0000 7f9552d2c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f954c06c0a0 0x7f954c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40426/0 (socket says 172.21.15.80:40426) 2019-11-28T11:45:22.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.916+0000 7f955252b700 1 -- 172.21.15.80:0/128163281 learned_addr learned my addr 172.21.15.80:0/128163281 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:22.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.917+0000 7f9552d2c700 1 -- 172.21.15.80:0/128163281 >> v1:172.21.15.174:6789/0 conn(0x7f954c072620 legacy=0x7f954c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:22.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.917+0000 7f9552d2c700 1 -- 172.21.15.80:0/128163281 >> v1:172.21.15.80:6789/0 conn(0x7f954c0734e0 legacy=0x7f954c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:22.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.917+0000 7f9552d2c700 1 -- 172.21.15.80:0/128163281 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c0706c0 con 0x7f954c06c0a0 2019-11-28T11:45:22.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.917+0000 7f9551d2a700 1 -- 172.21.15.80:0/128163281 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155931031 0 0) 0x7f9534001070 con 0x7f954c0734e0 2019-11-28T11:45:22.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.917+0000 7f9552d2c700 1 --2- 172.21.15.80:0/128163281 >> v2:172.21.15.80:3300/0 conn(0x7f954c06c0a0 0x7f954c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f953c00b2d0 tx=0x7f953c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:22.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.917+0000 7f9552d2c700 1 --2- 172.21.15.80:0/128163281 >> v2:172.21.15.80:3300/0 conn(0x7f954c06c0a0 0x7f954c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f953c00b2d0 tx=0x7f953c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:22.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.917+0000 7f9552d2c700 1 --2- 172.21.15.80:0/128163281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c06c0a0 0x7f954c072fa0 secure :-1 s=READY pgs=1769 cs=0 l=1 rx=0x7f953c00b2d0 tx=0x7f953c00bae0).ready entity=mon.0 client_cookie=ce2a9d8066edac9c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:22.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.917+0000 7f9552d2c700 1 --2- 172.21.15.80:0/128163281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c06c0a0 0x7f954c072fa0 secure :-1 s=THROTTLE_DONE pgs=1769 cs=0 l=1 rx=0x7f953c00b2d0 tx=0x7f953c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:22.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.917+0000 7f9551d2a700 1 -- 172.21.15.80:0/128163281 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f953c007590 con 0x7f954c06c0a0 2019-11-28T11:45:22.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.917+0000 7f9552d2c700 1 --2- 172.21.15.80:0/128163281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c06c0a0 0x7f954c072fa0 secure :-1 s=THROTTLE_DONE pgs=1769 cs=0 l=1 rx=0x7f953c00b2d0 tx=0x7f953c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:22.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.917+0000 7f9551d2a700 1 -- 172.21.15.80:0/128163281 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c009d30 con 0x7f954c06c0a0 2019-11-28T11:45:22.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.917+0000 7f9552d2c700 1 --2- 172.21.15.80:0/128163281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c06c0a0 0x7f954c072fa0 secure :-1 s=THROTTLE_DONE pgs=1769 cs=0 l=1 rx=0x7f953c00b2d0 tx=0x7f953c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:22.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.917+0000 7f9551d2a700 1 -- 172.21.15.80:0/128163281 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f953c007590 con 0x7f954c06c0a0 2019-11-28T11:45:22.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.917+0000 7f955478f700 1 -- 172.21.15.80:0/128163281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c06c0a0 msgr2=0x7f954c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:22.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.917+0000 7f955478f700 1 --2- 172.21.15.80:0/128163281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c06c0a0 0x7f954c072fa0 secure :-1 s=READY pgs=1769 cs=0 l=1 rx=0x7f953c00b2d0 tx=0x7f953c00bae0).stop 2019-11-28T11:45:22.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.918+0000 7f955478f700 1 -- 172.21.15.80:0/128163281 shutdown_connections 2019-11-28T11:45:22.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.918+0000 7f955478f700 1 --2- 172.21.15.80:0/128163281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c06c0a0 0x7f954c072fa0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:22.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.918+0000 7f955478f700 1 -- 172.21.15.80:0/128163281 shutdown_connections 2019-11-28T11:45:22.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.918+0000 7f955478f700 1 -- 172.21.15.80:0/128163281 wait complete. 2019-11-28T11:45:22.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.918+0000 7f955478f700 1 -- 172.21.15.80:0/128163281 >> 172.21.15.80:0/128163281 conn(0x7f954c061cf0 msgr2=0x7f954c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:22.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.920+0000 7f955478f700 1 Processor -- start 2019-11-28T11:45:22.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.920+0000 7f955478f700 1 -- start start 2019-11-28T11:45:22.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.921+0000 7f955478f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f954c13f580 0x7f954c114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:22.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.921+0000 7f955478f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f954c114670 0x7f954c11e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:22.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.921+0000 7f955478f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c13fc20 con 0x7f954c11eaf0 2019-11-28T11:45:22.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.921+0000 7f955478f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954c1236b0 con 0x7f954c114670 2019-11-28T11:45:22.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.921+0000 7f955478f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954c123980 con 0x7f954c13f580 2019-11-28T11:45:22.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.921+0000 7f955252b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f954c114670 0x7f954c11e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:22.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.921+0000 7f955252b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f954c114670 0x7f954c11e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40436/0 (socket says 172.21.15.80:40436) 2019-11-28T11:45:22.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.921+0000 7f955252b700 1 -- 172.21.15.80:0/3554306778 learned_addr learned my addr 172.21.15.80:0/3554306778 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:22.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.921+0000 7f9552d2c700 1 --2- 172.21.15.80:0/3554306778 >> v2:172.21.15.174:3300/0 conn(0x7f954c13f580 0x7f954c114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:22.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f955252b700 1 -- 172.21.15.80:0/3554306778 >> v2:172.21.15.174:3300/0 conn(0x7f954c13f580 msgr2=0x7f954c114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:22.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f955252b700 1 --2- 172.21.15.80:0/3554306778 >> v2:172.21.15.174:3300/0 conn(0x7f954c13f580 0x7f954c114130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:22.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f955252b700 1 -- 172.21.15.80:0/3554306778 >> v1:172.21.15.174:6789/0 conn(0x7f954c11eaf0 legacy=0x7f954c112fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:22.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f955252b700 1 -- 172.21.15.80:0/3554306778 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c124010 con 0x7f954c114670 2019-11-28T11:45:22.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f955252b700 1 --2- 172.21.15.80:0/3554306778 >> v2:172.21.15.80:3300/0 conn(0x7f954c114670 0x7f954c11e5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9534010440 tx=0x7f9534010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:22.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f955252b700 1 --2- 172.21.15.80:0/3554306778 >> v2:172.21.15.80:3300/0 conn(0x7f954c114670 0x7f954c11e5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9534010440 tx=0x7f9534010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:22.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f955252b700 1 --2- 172.21.15.80:0/3554306778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c114670 0x7f954c11e5b0 secure :-1 s=READY pgs=1770 cs=0 l=1 rx=0x7f9534010440 tx=0x7f9534010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:22.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f955252b700 1 --2- 172.21.15.80:0/3554306778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c114670 0x7f954c11e5b0 secure :-1 s=THROTTLE_DONE pgs=1770 cs=0 l=1 rx=0x7f9534010440 tx=0x7f9534010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:22.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f955252b700 1 --2- 172.21.15.80:0/3554306778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c114670 0x7f954c11e5b0 secure :-1 s=THROTTLE_DONE pgs=1770 cs=0 l=1 rx=0x7f9534010440 tx=0x7f9534010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:22.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f955252b700 1 --2- 172.21.15.80:0/3554306778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c114670 0x7f954c11e5b0 secure :-1 s=THROTTLE_DONE pgs=1770 cs=0 l=1 rx=0x7f9534010440 tx=0x7f9534010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:22.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f954b7fe700 1 -- 172.21.15.80:0/3554306778 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9534000d50 con 0x7f954c114670 2019-11-28T11:45:22.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f954b7fe700 1 -- 172.21.15.80:0/3554306778 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9534003fe0 con 0x7f954c114670 2019-11-28T11:45:22.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f955478f700 1 -- 172.21.15.80:0/3554306778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954c124010 con 0x7f954c114670 2019-11-28T11:45:22.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f954b7fe700 1 -- 172.21.15.80:0/3554306778 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9534004670 con 0x7f954c114670 2019-11-28T11:45:22.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f955478f700 1 -- 172.21.15.80:0/3554306778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c124010 con 0x7f954c114670 2019-11-28T11:45:22.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f955252b700 1 --2- 172.21.15.80:0/3554306778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c114670 0x7f954c11e5b0 secure :-1 s=THROTTLE_DONE pgs=1770 cs=0 l=1 rx=0x7f9534010440 tx=0x7f9534010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:22.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.922+0000 7f954b7fe700 1 -- 172.21.15.80:0/3554306778 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9534000d30 con 0x7f954c114670 2019-11-28T11:45:22.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.923+0000 7f955252b700 1 --2- 172.21.15.80:0/3554306778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c114670 0x7f954c11e5b0 secure :-1 s=THROTTLE_DONE pgs=1770 cs=0 l=1 rx=0x7f9534010440 tx=0x7f9534010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:22.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.923+0000 7f954b7fe700 1 --2- 172.21.15.80:0/3554306778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9530018730 0x7f953001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:22.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.923+0000 7f954b7fe700 1 -- 172.21.15.80:0/3554306778 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f9534031cf0 con 0x7f954c114670 2019-11-28T11:45:22.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.923+0000 7f9552d2c700 1 --2- 172.21.15.80:0/3554306778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9530018730 0x7f953001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:22.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.923+0000 7f9552d2c700 1 --2- 172.21.15.80:0/3554306778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9530018730 0x7f953001abe0 crc :-1 s=READY pgs=718 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:22.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.930+0000 7f955478f700 1 -- 172.21.15.80:0/3554306778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954c124010 con 0x7f954c114670 2019-11-28T11:45:22.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.934+0000 7f955252b700 1 --2- 172.21.15.80:0/3554306778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c114670 0x7f954c11e5b0 secure :-1 s=THROTTLE_DONE pgs=1770 cs=0 l=1 rx=0x7f9534010440 tx=0x7f9534010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:22.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:22.934+0000 7f954b7fe700 1 -- 172.21.15.80:0/3554306778 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9534000940 con 0x7f954c114670 2019-11-28T11:45:23.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.106+0000 7f955478f700 1 -- 172.21.15.80:0/3554306778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f954c124010 con 0x7f954c114670 2019-11-28T11:45:23.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.106+0000 7f955252b700 1 --2- 172.21.15.80:0/3554306778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c114670 0x7f954c11e5b0 secure :-1 s=THROTTLE_DONE pgs=1770 cs=0 l=1 rx=0x7f9534010440 tx=0x7f9534010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.106+0000 7f954b7fe700 1 -- 172.21.15.80:0/3554306778 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f953401fec0 con 0x7f954c114670 2019-11-28T11:45:23.148 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 102 2019-11-28T11:45:23.148 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:23.149 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":102,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":102,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:01.366373+0000","modified":"2019-11-28T11:45:22.745262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":132,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2019-11-28T11:45:23.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.109+0000 7f955478f700 1 -- 172.21.15.80:0/3554306778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9530018730 msgr2=0x7f953001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:23.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.109+0000 7f955478f700 1 --2- 172.21.15.80:0/3554306778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9530018730 0x7f953001abe0 crc :-1 s=READY pgs=718 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:23.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.109+0000 7f955478f700 1 -- 172.21.15.80:0/3554306778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c114670 msgr2=0x7f954c11e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:23.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.109+0000 7f955478f700 1 --2- 172.21.15.80:0/3554306778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c114670 0x7f954c11e5b0 secure :-1 s=READY pgs=1770 cs=0 l=1 rx=0x7f9534010440 tx=0x7f9534010270).stop 2019-11-28T11:45:23.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.109+0000 7f955478f700 1 -- 172.21.15.80:0/3554306778 shutdown_connections 2019-11-28T11:45:23.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.109+0000 7f955478f700 1 --2- 172.21.15.80:0/3554306778 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9530018730 0x7f953001abe0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:23.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.109+0000 7f955478f700 1 --2- 172.21.15.80:0/3554306778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f954c114670 0x7f954c11e5b0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:23.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.109+0000 7f955478f700 1 --2- 172.21.15.80:0/3554306778 >> v2:172.21.15.174:3300/0 conn(0x7f954c13f580 0x7f954c114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:23.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.109+0000 7f955478f700 1 -- 172.21.15.80:0/3554306778 shutdown_connections 2019-11-28T11:45:23.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.109+0000 7f955478f700 1 -- 172.21.15.80:0/3554306778 wait complete. 2019-11-28T11:45:23.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.109+0000 7f955478f700 1 -- 172.21.15.80:0/3554306778 >> 172.21.15.80:0/3554306778 conn(0x7f954c1426c0 msgr2=0x7f954c110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:23.160 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:45:23.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.242+0000 7f77d13f2700 1 Processor -- start 2019-11-28T11:45:23.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.242+0000 7f77d13f2700 1 -- start start 2019-11-28T11:45:23.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.243+0000 7f77d13f2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f77cc06c0a0 0x7f77cc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:23.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.243+0000 7f77d13f2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc0734e0 0x7f77cc071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:23.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.243+0000 7f77d13f2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77cc06db00 con 0x7f77cc072360 2019-11-28T11:45:23.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.243+0000 7f77d13f2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77cc06fd60 con 0x7f77cc06c0a0 2019-11-28T11:45:23.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.243+0000 7f77d13f2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc070030 con 0x7f77cc0734e0 2019-11-28T11:45:23.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77caffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc0734e0 0x7f77cc071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:23.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77cb7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f77cc06c0a0 0x7f77cc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:23.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77cbfff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f77cc072360 0x7f77cc06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:55304/0 (socket says 172.21.15.80:55304) 2019-11-28T11:45:23.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77caffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc0734e0 0x7f77cc071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:42700/0 (socket says 172.21.15.80:42700) 2019-11-28T11:45:23.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77cbfff700 1 -- 172.21.15.80:0/1003060704 learned_addr learned my addr 172.21.15.80:0/1003060704 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:23.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77cb7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f77cc06c0a0 0x7f77cc072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:55326/0 (socket says 172.21.15.80:55326) 2019-11-28T11:45:23.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77ca7fc700 1 -- 172.21.15.80:0/1003060704 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002339781 0 0) 0x7f77c4001480 con 0x7f77cc072360 2019-11-28T11:45:23.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77caffd700 1 -- 172.21.15.80:0/1003060704 >> v2:172.21.15.174:3300/0 conn(0x7f77cc06c0a0 msgr2=0x7f77cc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:23.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77caffd700 1 --2- 172.21.15.80:0/1003060704 >> v2:172.21.15.174:3300/0 conn(0x7f77cc06c0a0 0x7f77cc072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:23.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77caffd700 1 -- 172.21.15.80:0/1003060704 >> v1:172.21.15.174:6789/0 conn(0x7f77cc072360 legacy=0x7f77cc06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:23.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77caffd700 1 -- 172.21.15.80:0/1003060704 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc0706c0 con 0x7f77cc0734e0 2019-11-28T11:45:23.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77cb7fe700 1 --2- 172.21.15.80:0/1003060704 >> v2:172.21.15.174:3300/0 conn(0x7f77cc06c0a0 0x7f77cc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:23.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77caffd700 1 --2- 172.21.15.80:0/1003060704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc0734e0 0x7f77cc071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f77b400af50 tx=0x7f77b400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77caffd700 1 --2- 172.21.15.80:0/1003060704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc0734e0 0x7f77cc071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f77b400af50 tx=0x7f77b400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77caffd700 1 --2- 172.21.15.80:0/1003060704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc0734e0 0x7f77cc071e20 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7f77b400af50 tx=0x7f77b400b760).ready entity=mon.2 client_cookie=960d9bab569a2789 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:23.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77caffd700 1 --2- 172.21.15.80:0/1003060704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc0734e0 0x7f77cc071e20 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f77b400af50 tx=0x7f77b400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77ca7fc700 1 -- 172.21.15.80:0/1003060704 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77b4007210 con 0x7f77cc0734e0 2019-11-28T11:45:23.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77caffd700 1 --2- 172.21.15.80:0/1003060704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc0734e0 0x7f77cc071e20 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f77b400af50 tx=0x7f77b400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77caffd700 1 --2- 172.21.15.80:0/1003060704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc0734e0 0x7f77cc071e20 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f77b400af50 tx=0x7f77b400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77ca7fc700 1 -- 172.21.15.80:0/1003060704 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b40099b0 con 0x7f77cc0734e0 2019-11-28T11:45:23.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77ca7fc700 1 -- 172.21.15.80:0/1003060704 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77b400a080 con 0x7f77cc0734e0 2019-11-28T11:45:23.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77d13f2700 1 -- 172.21.15.80:0/1003060704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc0734e0 msgr2=0x7f77cc071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:23.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.244+0000 7f77d13f2700 1 --2- 172.21.15.80:0/1003060704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc0734e0 0x7f77cc071e20 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7f77b400af50 tx=0x7f77b400b760).stop 2019-11-28T11:45:23.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.245+0000 7f77d13f2700 1 -- 172.21.15.80:0/1003060704 shutdown_connections 2019-11-28T11:45:23.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.245+0000 7f77d13f2700 1 --2- 172.21.15.80:0/1003060704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc0734e0 0x7f77cc071e20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:23.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.245+0000 7f77d13f2700 1 --2- 172.21.15.80:0/1003060704 >> v2:172.21.15.174:3300/0 conn(0x7f77cc06c0a0 0x7f77cc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:23.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.245+0000 7f77d13f2700 1 -- 172.21.15.80:0/1003060704 shutdown_connections 2019-11-28T11:45:23.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.245+0000 7f77d13f2700 1 -- 172.21.15.80:0/1003060704 wait complete. 2019-11-28T11:45:23.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.245+0000 7f77d13f2700 1 -- 172.21.15.80:0/1003060704 >> 172.21.15.80:0/1003060704 conn(0x7f77cc061cf0 msgr2=0x7f77cc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:23.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.247+0000 7f77d13f2700 1 Processor -- start 2019-11-28T11:45:23.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.248+0000 7f77d13f2700 1 -- start start 2019-11-28T11:45:23.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.248+0000 7f77d13f2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc13eb40 0x7f77cc10afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:23.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.248+0000 7f77d13f2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f77cc1631f0 0x7f77cc105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:23.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77d13f2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77cc13f1e0 con 0x7f77cc10b500 2019-11-28T11:45:23.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77d13f2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77cc1234c0 con 0x7f77cc1631f0 2019-11-28T11:45:23.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77d13f2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc13d6a0 con 0x7f77cc13eb40 2019-11-28T11:45:23.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77caffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f77cc10b500 0x7f77cc1629f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39764/0 (socket says 172.21.15.80:39764) 2019-11-28T11:45:23.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77caffd700 1 -- 172.21.15.80:0/344200599 learned_addr learned my addr 172.21.15.80:0/344200599 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:23.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77cb7fe700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc13eb40 0x7f77cc10afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:23.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77cbfff700 1 --2- 172.21.15.80:0/344200599 >> v2:172.21.15.174:3300/0 conn(0x7f77cc1631f0 0x7f77cc105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:23.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77c3fff700 1 -- 172.21.15.80:0/344200599 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857065298 0 0) 0x7f77b400abb0 con 0x7f77cc10b500 2019-11-28T11:45:23.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77c3fff700 1 -- 172.21.15.80:0/344200599 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77b0002e80 con 0x7f77cc10b500 2019-11-28T11:45:23.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77cb7fe700 1 -- 172.21.15.80:0/344200599 >> v2:172.21.15.174:3300/0 conn(0x7f77cc1631f0 msgr2=0x7f77cc105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:23.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77cb7fe700 1 --2- 172.21.15.80:0/344200599 >> v2:172.21.15.174:3300/0 conn(0x7f77cc1631f0 0x7f77cc105210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:23.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77cb7fe700 1 -- 172.21.15.80:0/344200599 >> v1:172.21.15.80:6789/0 conn(0x7f77cc10b500 legacy=0x7f77cc1629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:23.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77cb7fe700 1 -- 172.21.15.80:0/344200599 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc108700 con 0x7f77cc13eb40 2019-11-28T11:45:23.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77cbfff700 1 --2- 172.21.15.80:0/344200599 >> v2:172.21.15.174:3300/0 conn(0x7f77cc1631f0 0x7f77cc105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:23.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77cb7fe700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc13eb40 0x7f77cc10afc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f77bc0103a0 tx=0x7f77bc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77cb7fe700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc13eb40 0x7f77cc10afc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f77bc0103a0 tx=0x7f77bc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77cb7fe700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc13eb40 0x7f77cc10afc0 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7f77bc0103a0 tx=0x7f77bc010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:23.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77cb7fe700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc13eb40 0x7f77cc10afc0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f77bc0103a0 tx=0x7f77bc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77c3fff700 1 -- 172.21.15.80:0/344200599 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77bc000940 con 0x7f77cc13eb40 2019-11-28T11:45:23.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77cb7fe700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc13eb40 0x7f77cc10afc0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f77bc0103a0 tx=0x7f77bc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77d13f2700 1 -- 172.21.15.80:0/344200599 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77cc108a80 con 0x7f77cc13eb40 2019-11-28T11:45:23.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77c3fff700 1 -- 172.21.15.80:0/344200599 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc000940 con 0x7f77cc13eb40 2019-11-28T11:45:23.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77cb7fe700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc13eb40 0x7f77cc10afc0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f77bc0103a0 tx=0x7f77bc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77c3fff700 1 -- 172.21.15.80:0/344200599 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77bc00e1e0 con 0x7f77cc13eb40 2019-11-28T11:45:23.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.249+0000 7f77d13f2700 1 -- 172.21.15.80:0/344200599 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77cc108700 con 0x7f77cc13eb40 2019-11-28T11:45:23.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.250+0000 7f77cb7fe700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc13eb40 0x7f77cc10afc0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f77bc0103a0 tx=0x7f77bc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.250+0000 7f77c3fff700 1 -- 172.21.15.80:0/344200599 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f77bc00da60 con 0x7f77cc13eb40 2019-11-28T11:45:23.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.250+0000 7f77cb7fe700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc13eb40 0x7f77cc10afc0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f77bc0103a0 tx=0x7f77bc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.250+0000 7f77c3fff700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f77b0018770 0x7f77b001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:23.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.250+0000 7f77c3fff700 1 -- 172.21.15.80:0/344200599 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f77bc031a10 con 0x7f77cc13eb40 2019-11-28T11:45:23.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.250+0000 7f77caffd700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f77b0018770 0x7f77b001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:23.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.251+0000 7f77caffd700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f77b0018770 0x7f77b001abe0 crc :-1 s=READY pgs=719 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:23.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.258+0000 7f77d13f2700 1 -- 172.21.15.80:0/344200599 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77cc108a80 con 0x7f77cc13eb40 2019-11-28T11:45:23.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.262+0000 7f77cb7fe700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc13eb40 0x7f77cc10afc0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f77bc0103a0 tx=0x7f77bc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.262+0000 7f77c3fff700 1 -- 172.21.15.80:0/344200599 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f77bc00e6f0 con 0x7f77cc13eb40 2019-11-28T11:45:23.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.436+0000 7f77d13f2700 1 -- 172.21.15.80:0/344200599 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f77cc108700 con 0x7f77cc13eb40 2019-11-28T11:45:23.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.751+0000 7f77cb7fe700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc13eb40 0x7f77cc10afc0 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f77bc0103a0 tx=0x7f77bc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.751+0000 7f77c3fff700 1 -- 172.21.15.80:0/344200599 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v103) v1 ==== 104+0+0 (secure 0 0 0) 0x7f77bc017410 con 0x7f77cc13eb40 2019-11-28T11:45:23.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.802+0000 7f77d13f2700 1 -- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f77b0018770 msgr2=0x7f77b001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.802+0000 7f77d13f2700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f77b0018770 0x7f77b001abe0 crc :-1 s=READY pgs=719 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.802+0000 7f77d13f2700 1 -- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc13eb40 msgr2=0x7f77cc10afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.802+0000 7f77d13f2700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc13eb40 0x7f77cc10afc0 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7f77bc0103a0 tx=0x7f77bc010740).stop 2019-11-28T11:45:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.802+0000 7f77d13f2700 1 -- 172.21.15.80:0/344200599 shutdown_connections 2019-11-28T11:45:23.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.802+0000 7f77d13f2700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f77b0018770 0x7f77b001abe0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:23.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.802+0000 7f77d13f2700 1 --2- 172.21.15.80:0/344200599 >> v2:172.21.15.174:3300/0 conn(0x7f77cc1631f0 0x7f77cc105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:23.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.802+0000 7f77d13f2700 1 --2- 172.21.15.80:0/344200599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77cc13eb40 0x7f77cc10afc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:23.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.803+0000 7f77d13f2700 1 -- 172.21.15.80:0/344200599 shutdown_connections 2019-11-28T11:45:23.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.803+0000 7f77d13f2700 1 -- 172.21.15.80:0/344200599 wait complete. 2019-11-28T11:45:23.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.803+0000 7f77d13f2700 1 -- 172.21.15.80:0/344200599 >> 172.21.15.80:0/344200599 conn(0x7f77cc11bfc0 msgr2=0x7f77cc141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:23.853 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:45:23.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.936+0000 7f6f0b162700 1 Processor -- start 2019-11-28T11:45:23.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.936+0000 7f6f0b162700 1 -- start start 2019-11-28T11:45:23.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.937+0000 7f6f0b162700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f0415ed10 0x7f6f0415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:23.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.937+0000 7f6f0b162700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f040734b0 0x7f6f040726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:23.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.937+0000 7f6f0b162700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0406db60 con 0x7f6f04073020 2019-11-28T11:45:23.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.937+0000 7f6f0b162700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f0406f3d0 con 0x7f6f040734b0 2019-11-28T11:45:23.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.937+0000 7f6f0b162700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0406fe00 con 0x7f6f0415ed10 2019-11-28T11:45:23.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.937+0000 7f6f09f00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f040734b0 0x7f6f040726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:23.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.937+0000 7f6f09f00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f040734b0 0x7f6f040726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40456/0 (socket says 172.21.15.80:40456) 2019-11-28T11:45:23.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f09f00700 1 -- 172.21.15.80:0/2529199803 learned_addr learned my addr 172.21.15.80:0/2529199803 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:23.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f096ff700 1 --2- 172.21.15.80:0/2529199803 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f0415ed10 0x7f6f0415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:23.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f09f00700 1 -- 172.21.15.80:0/2529199803 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f0415ed10 msgr2=0x7f6f0415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:23.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f09f00700 1 --2- 172.21.15.80:0/2529199803 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f0415ed10 0x7f6f0415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:23.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f09f00700 1 -- 172.21.15.80:0/2529199803 >> v1:172.21.15.174:6789/0 conn(0x7f6f04073020 legacy=0x7f6f04071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:23.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f09f00700 1 -- 172.21.15.80:0/2529199803 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f04070760 con 0x7f6f040734b0 2019-11-28T11:45:23.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f09f00700 1 --2- 172.21.15.80:0/2529199803 >> v2:172.21.15.80:3300/0 conn(0x7f6f040734b0 0x7f6f040726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6efc00f6b0 tx=0x7f6efc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f09f00700 1 --2- 172.21.15.80:0/2529199803 >> v2:172.21.15.80:3300/0 conn(0x7f6f040734b0 0x7f6f040726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6efc00f6b0 tx=0x7f6efc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f09f00700 1 --2- 172.21.15.80:0/2529199803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f040734b0 0x7f6f040726a0 secure :-1 s=READY pgs=1772 cs=0 l=1 rx=0x7f6efc00f6b0 tx=0x7f6efc00fa50).ready entity=mon.0 client_cookie=5b2f76fca59d4044 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f09f00700 1 --2- 172.21.15.80:0/2529199803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f040734b0 0x7f6f040726a0 secure :-1 s=THROTTLE_DONE pgs=1772 cs=0 l=1 rx=0x7f6efc00f6b0 tx=0x7f6efc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f09f00700 1 --2- 172.21.15.80:0/2529199803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f040734b0 0x7f6f040726a0 secure :-1 s=THROTTLE_DONE pgs=1772 cs=0 l=1 rx=0x7f6efc00f6b0 tx=0x7f6efc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f03fff700 1 -- 172.21.15.80:0/2529199803 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6efc000a70 con 0x7f6f040734b0 2019-11-28T11:45:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f09f00700 1 --2- 172.21.15.80:0/2529199803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f040734b0 0x7f6f040726a0 secure :-1 s=THROTTLE_DONE pgs=1772 cs=0 l=1 rx=0x7f6efc00f6b0 tx=0x7f6efc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f03fff700 1 -- 172.21.15.80:0/2529199803 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6efc0010e0 con 0x7f6f040734b0 2019-11-28T11:45:23.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f03fff700 1 -- 172.21.15.80:0/2529199803 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6efc0017b0 con 0x7f6f040734b0 2019-11-28T11:45:23.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f0b162700 1 -- 172.21.15.80:0/2529199803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f040734b0 msgr2=0x7f6f040726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:23.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.938+0000 7f6f0b162700 1 --2- 172.21.15.80:0/2529199803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f040734b0 0x7f6f040726a0 secure :-1 s=READY pgs=1772 cs=0 l=1 rx=0x7f6efc00f6b0 tx=0x7f6efc00fa50).stop 2019-11-28T11:45:23.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.939+0000 7f6f0b162700 1 -- 172.21.15.80:0/2529199803 shutdown_connections 2019-11-28T11:45:23.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.939+0000 7f6f0b162700 1 --2- 172.21.15.80:0/2529199803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f040734b0 0x7f6f040726a0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:23.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.939+0000 7f6f0b162700 1 --2- 172.21.15.80:0/2529199803 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f0415ed10 0x7f6f0415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:23.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.939+0000 7f6f0b162700 1 -- 172.21.15.80:0/2529199803 shutdown_connections 2019-11-28T11:45:23.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.939+0000 7f6f0b162700 1 -- 172.21.15.80:0/2529199803 wait complete. 2019-11-28T11:45:23.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.939+0000 7f6f0b162700 1 -- 172.21.15.80:0/2529199803 >> 172.21.15.80:0/2529199803 conn(0x7f6f04061d20 msgr2=0x7f6f040641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:23.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.941+0000 7f6f0b162700 1 Processor -- start 2019-11-28T11:45:23.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.942+0000 7f6f0b162700 1 -- start start 2019-11-28T11:45:23.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f0b162700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f0410ed60 0x7f6f0410f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:23.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f0b162700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f0410f730 0x7f6f04167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:23.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f0b162700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0410c250 con 0x7f6f0410e970 2019-11-28T11:45:23.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f0b162700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f0410e430 con 0x7f6f0410f730 2019-11-28T11:45:23.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f0b162700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f04105860 con 0x7f6f0410ed60 2019-11-28T11:45:23.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f09f00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f0410f730 0x7f6f04167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:23.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f09f00700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f0410f730 0x7f6f04167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40464/0 (socket says 172.21.15.80:40464) 2019-11-28T11:45:23.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f09f00700 1 -- 172.21.15.80:0/3286120121 learned_addr learned my addr 172.21.15.80:0/3286120121 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:23.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f08efe700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f0410ed60 0x7f6f0410f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:23.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f01ffb700 1 -- 172.21.15.80:0/3286120121 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216735645 0 0) 0x7f6ef4009b10 con 0x7f6f0410e970 2019-11-28T11:45:23.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f09f00700 1 -- 172.21.15.80:0/3286120121 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f0410ed60 msgr2=0x7f6f0410f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:23.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f09f00700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f0410ed60 0x7f6f0410f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:23.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f09f00700 1 -- 172.21.15.80:0/3286120121 >> v1:172.21.15.174:6789/0 conn(0x7f6f0410e970 legacy=0x7f6f041087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f09f00700 1 -- 172.21.15.80:0/3286120121 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f04105ef0 con 0x7f6f0410f730 2019-11-28T11:45:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f09f00700 1 --2- 172.21.15.80:0/3286120121 >> v2:172.21.15.80:3300/0 conn(0x7f6f0410f730 0x7f6f04167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6efc010450 tx=0x7f6efc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f09f00700 1 --2- 172.21.15.80:0/3286120121 >> v2:172.21.15.80:3300/0 conn(0x7f6f0410f730 0x7f6f04167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6efc010450 tx=0x7f6efc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f09f00700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f0410f730 0x7f6f04167d70 secure :-1 s=READY pgs=1773 cs=0 l=1 rx=0x7f6efc010450 tx=0x7f6efc0102d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f09f00700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f0410f730 0x7f6f04167d70 secure :-1 s=THROTTLE_DONE pgs=1773 cs=0 l=1 rx=0x7f6efc010450 tx=0x7f6efc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f01ffb700 1 -- 172.21.15.80:0/3286120121 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6efc001590 con 0x7f6f0410f730 2019-11-28T11:45:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f09f00700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f0410f730 0x7f6f04167d70 secure :-1 s=THROTTLE_DONE pgs=1773 cs=0 l=1 rx=0x7f6efc010450 tx=0x7f6efc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f09f00700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f0410f730 0x7f6f04167d70 secure :-1 s=THROTTLE_DONE pgs=1773 cs=0 l=1 rx=0x7f6efc010450 tx=0x7f6efc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f01ffb700 1 -- 172.21.15.80:0/3286120121 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6efc0011b0 con 0x7f6f0410f730 2019-11-28T11:45:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f0b162700 1 -- 172.21.15.80:0/3286120121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f04106270 con 0x7f6f0410f730 2019-11-28T11:45:23.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f01ffb700 1 -- 172.21.15.80:0/3286120121 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6efc001b70 con 0x7f6f0410f730 2019-11-28T11:45:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.943+0000 7f6f0b162700 1 -- 172.21.15.80:0/3286120121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f04105ef0 con 0x7f6f0410f730 2019-11-28T11:45:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.944+0000 7f6f09f00700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f0410f730 0x7f6f04167d70 secure :-1 s=THROTTLE_DONE pgs=1773 cs=0 l=1 rx=0x7f6efc010450 tx=0x7f6efc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.944+0000 7f6f01ffb700 1 -- 172.21.15.80:0/3286120121 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6efc0013a0 con 0x7f6f0410f730 2019-11-28T11:45:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.944+0000 7f6f09f00700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f0410f730 0x7f6f04167d70 secure :-1 s=THROTTLE_DONE pgs=1773 cs=0 l=1 rx=0x7f6efc010450 tx=0x7f6efc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.944+0000 7f6f01ffb700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ee8018730 0x7f6ee801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.944+0000 7f6f01ffb700 1 -- 172.21.15.80:0/3286120121 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f6efc031ac0 con 0x7f6f0410f730 2019-11-28T11:45:23.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.944+0000 7f6f096ff700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ee8018730 0x7f6ee801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:23.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.944+0000 7f6f096ff700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ee8018730 0x7f6ee801abc0 crc :-1 s=READY pgs=720 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:23.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.952+0000 7f6f0b162700 1 -- 172.21.15.80:0/3286120121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f04106270 con 0x7f6f0410f730 2019-11-28T11:45:23.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.955+0000 7f6f09f00700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f0410f730 0x7f6f04167d70 secure :-1 s=THROTTLE_DONE pgs=1773 cs=0 l=1 rx=0x7f6efc010450 tx=0x7f6efc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:23.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:23.955+0000 7f6f01ffb700 1 -- 172.21.15.80:0/3286120121 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6efc000eb0 con 0x7f6f0410f730 2019-11-28T11:45:24.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.122+0000 7f6f0b162700 1 -- 172.21.15.80:0/3286120121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6f04105ef0 con 0x7f6f0410f730 2019-11-28T11:45:24.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.757+0000 7f6f09f00700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f0410f730 0x7f6f04167d70 secure :-1 s=THROTTLE_DONE pgs=1773 cs=0 l=1 rx=0x7f6efc010450 tx=0x7f6efc0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:24.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.758+0000 7f6f01ffb700 1 -- 172.21.15.80:0/3286120121 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v135) v1 ==== 185+0+0 (secure 0 0 0) 0x7f6efc0010c0 con 0x7f6f0410f730 2019-11-28T11:45:24.827 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:45:24.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.789+0000 7f6f0b162700 1 -- 172.21.15.80:0/3286120121 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ee8018730 msgr2=0x7f6ee801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:24.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.789+0000 7f6f0b162700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ee8018730 0x7f6ee801abc0 crc :-1 s=READY pgs=720 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:24.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.789+0000 7f6f0b162700 1 -- 172.21.15.80:0/3286120121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f0410f730 msgr2=0x7f6f04167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:24.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.789+0000 7f6f0b162700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f0410f730 0x7f6f04167d70 secure :-1 s=READY pgs=1773 cs=0 l=1 rx=0x7f6efc010450 tx=0x7f6efc0102d0).stop 2019-11-28T11:45:24.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.789+0000 7f6f0b162700 1 -- 172.21.15.80:0/3286120121 shutdown_connections 2019-11-28T11:45:24.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.789+0000 7f6f0b162700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f0410f730 0x7f6f04167d70 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:24.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.789+0000 7f6f0b162700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f0410ed60 0x7f6f0410f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:24.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.789+0000 7f6f0b162700 1 --2- 172.21.15.80:0/3286120121 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ee8018730 0x7f6ee801abc0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:24.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.789+0000 7f6f0b162700 1 -- 172.21.15.80:0/3286120121 shutdown_connections 2019-11-28T11:45:24.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.789+0000 7f6f0b162700 1 -- 172.21.15.80:0/3286120121 wait complete. 2019-11-28T11:45:24.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.789+0000 7f6f0b162700 1 -- 172.21.15.80:0/3286120121 >> 172.21.15.80:0/3286120121 conn(0x7f6f0415e2d0 msgr2=0x7f6f04147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:24.840 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:45:24.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.923+0000 7ffb271b8700 1 Processor -- start 2019-11-28T11:45:24.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.923+0000 7ffb271b8700 1 -- start start 2019-11-28T11:45:24.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb271b8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffb2015ed10 0x7ffb2015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:24.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb271b8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffb20073020 0x7ffb20071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:24.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb271b8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2006db60 con 0x7ffb200734b0 2019-11-28T11:45:24.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb271b8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2006fe00 con 0x7ffb2015ed10 2019-11-28T11:45:24.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb271b8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb200700d0 con 0x7ffb20073020 2019-11-28T11:45:24.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb25755700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffb2015ed10 0x7ffb2015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:24.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb25755700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffb2015ed10 0x7ffb2015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40468/0 (socket says 172.21.15.80:40468) 2019-11-28T11:45:24.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb25755700 1 -- 172.21.15.80:0/4080300195 learned_addr learned my addr 172.21.15.80:0/4080300195 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:24.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb24f54700 1 --2- 172.21.15.80:0/4080300195 >> v2:172.21.15.174:3300/0 conn(0x7ffb20073020 0x7ffb20071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:24.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb25755700 1 -- 172.21.15.80:0/4080300195 >> v2:172.21.15.174:3300/0 conn(0x7ffb20073020 msgr2=0x7ffb20071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:24.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb25755700 1 --2- 172.21.15.80:0/4080300195 >> v2:172.21.15.174:3300/0 conn(0x7ffb20073020 0x7ffb20071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:24.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb25755700 1 -- 172.21.15.80:0/4080300195 >> v1:172.21.15.174:6789/0 conn(0x7ffb200734b0 legacy=0x7ffb200723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:24.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb25755700 1 -- 172.21.15.80:0/4080300195 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb20070760 con 0x7ffb2015ed10 2019-11-28T11:45:24.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb25755700 1 --2- 172.21.15.80:0/4080300195 >> v2:172.21.15.80:3300/0 conn(0x7ffb2015ed10 0x7ffb2015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffb0800fac0 tx=0x7ffb0800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:24.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb25755700 1 --2- 172.21.15.80:0/4080300195 >> v2:172.21.15.80:3300/0 conn(0x7ffb2015ed10 0x7ffb2015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffb0800fac0 tx=0x7ffb0800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:24.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb25755700 1 --2- 172.21.15.80:0/4080300195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb2015ed10 0x7ffb2015f100 secure :-1 s=READY pgs=1774 cs=0 l=1 rx=0x7ffb0800fac0 tx=0x7ffb0800f8f0).ready entity=mon.0 client_cookie=485829f606f653ea server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:24.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb25755700 1 --2- 172.21.15.80:0/4080300195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb2015ed10 0x7ffb2015f100 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7ffb0800fac0 tx=0x7ffb0800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:24.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb25755700 1 --2- 172.21.15.80:0/4080300195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb2015ed10 0x7ffb2015f100 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7ffb0800fac0 tx=0x7ffb0800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:24.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb1ffff700 1 -- 172.21.15.80:0/4080300195 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb08000ce0 con 0x7ffb2015ed10 2019-11-28T11:45:24.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.924+0000 7ffb25755700 1 --2- 172.21.15.80:0/4080300195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb2015ed10 0x7ffb2015f100 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7ffb0800fac0 tx=0x7ffb0800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:24.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.925+0000 7ffb1ffff700 1 -- 172.21.15.80:0/4080300195 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb08001010 con 0x7ffb2015ed10 2019-11-28T11:45:24.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.925+0000 7ffb1ffff700 1 -- 172.21.15.80:0/4080300195 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb08001720 con 0x7ffb2015ed10 2019-11-28T11:45:24.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.925+0000 7ffb271b8700 1 -- 172.21.15.80:0/4080300195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb2015ed10 msgr2=0x7ffb2015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:24.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.925+0000 7ffb271b8700 1 --2- 172.21.15.80:0/4080300195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb2015ed10 0x7ffb2015f100 secure :-1 s=READY pgs=1774 cs=0 l=1 rx=0x7ffb0800fac0 tx=0x7ffb0800f8f0).stop 2019-11-28T11:45:24.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.925+0000 7ffb271b8700 1 -- 172.21.15.80:0/4080300195 shutdown_connections 2019-11-28T11:45:24.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.925+0000 7ffb271b8700 1 --2- 172.21.15.80:0/4080300195 >> v2:172.21.15.174:3300/0 conn(0x7ffb20073020 0x7ffb20071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.925+0000 7ffb271b8700 1 --2- 172.21.15.80:0/4080300195 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb2015ed10 0x7ffb2015f100 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.925+0000 7ffb271b8700 1 -- 172.21.15.80:0/4080300195 shutdown_connections 2019-11-28T11:45:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.925+0000 7ffb271b8700 1 -- 172.21.15.80:0/4080300195 wait complete. 2019-11-28T11:45:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.925+0000 7ffb271b8700 1 -- 172.21.15.80:0/4080300195 >> 172.21.15.80:0/4080300195 conn(0x7ffb20061d20 msgr2=0x7ffb200641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.928+0000 7ffb271b8700 1 Processor -- start 2019-11-28T11:45:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.928+0000 7ffb271b8700 1 -- start start 2019-11-28T11:45:24.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb271b8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb20148320 0x7ffb2010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:24.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb271b8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffb2010e3d0 0x7ffb20168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:24.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb271b8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb20148e00 con 0x7ffb2010f290 2019-11-28T11:45:24.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb271b8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb20139ff0 con 0x7ffb2010e3d0 2019-11-28T11:45:24.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb271b8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2013aa20 con 0x7ffb20148320 2019-11-28T11:45:24.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb24f54700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ffb2010f290 0x7ffb2010dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39790/0 (socket says 172.21.15.80:39790) 2019-11-28T11:45:24.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb24f54700 1 -- 172.21.15.80:0/346500938 learned_addr learned my addr 172.21.15.80:0/346500938 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:24.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb25755700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb20148320 0x7ffb2010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:24.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb25f56700 1 --2- 172.21.15.80:0/346500938 >> v2:172.21.15.174:3300/0 conn(0x7ffb2010e3d0 0x7ffb20168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:24.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb1dffb700 1 -- 172.21.15.80:0/346500938 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277919231 0 0) 0x7ffb100010b0 con 0x7ffb2010f290 2019-11-28T11:45:24.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb1dffb700 1 -- 172.21.15.80:0/346500938 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb04002e80 con 0x7ffb2010f290 2019-11-28T11:45:24.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb25755700 1 -- 172.21.15.80:0/346500938 >> v2:172.21.15.174:3300/0 conn(0x7ffb2010e3d0 msgr2=0x7ffb20168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:24.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb25755700 1 --2- 172.21.15.80:0/346500938 >> v2:172.21.15.174:3300/0 conn(0x7ffb2010e3d0 0x7ffb20168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:24.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb25755700 1 -- 172.21.15.80:0/346500938 >> v1:172.21.15.80:6789/0 conn(0x7ffb2010f290 legacy=0x7ffb2010dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:24.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb25755700 1 -- 172.21.15.80:0/346500938 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2010c490 con 0x7ffb20148320 2019-11-28T11:45:24.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb25f56700 1 --2- 172.21.15.80:0/346500938 >> v2:172.21.15.174:3300/0 conn(0x7ffb2010e3d0 0x7ffb20168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:24.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb25755700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb20148320 0x7ffb2010ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb080086a0 tx=0x7ffb08010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:24.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb25755700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb20148320 0x7ffb2010ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb080086a0 tx=0x7ffb08010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:24.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.929+0000 7ffb25755700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb20148320 0x7ffb2010ed50 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7ffb080086a0 tx=0x7ffb08010af0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:24.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.930+0000 7ffb25755700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb20148320 0x7ffb2010ed50 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7ffb080086a0 tx=0x7ffb08010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:24.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.930+0000 7ffb1dffb700 1 -- 172.21.15.80:0/346500938 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb08000eb0 con 0x7ffb20148320 2019-11-28T11:45:24.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.930+0000 7ffb25755700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb20148320 0x7ffb2010ed50 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7ffb080086a0 tx=0x7ffb08010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:24.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.930+0000 7ffb25755700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb20148320 0x7ffb2010ed50 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7ffb080086a0 tx=0x7ffb08010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.930+0000 7ffb1dffb700 1 -- 172.21.15.80:0/346500938 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb080080f0 con 0x7ffb20148320 2019-11-28T11:45:25.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.930+0000 7ffb271b8700 1 -- 172.21.15.80:0/346500938 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2010c810 con 0x7ffb20148320 2019-11-28T11:45:25.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.930+0000 7ffb1dffb700 1 -- 172.21.15.80:0/346500938 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb08001490 con 0x7ffb20148320 2019-11-28T11:45:25.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.930+0000 7ffb271b8700 1 -- 172.21.15.80:0/346500938 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2010c490 con 0x7ffb20148320 2019-11-28T11:45:25.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.930+0000 7ffb25755700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb20148320 0x7ffb2010ed50 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7ffb080086a0 tx=0x7ffb08010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.930+0000 7ffb1dffb700 1 -- 172.21.15.80:0/346500938 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ffb08000cc0 con 0x7ffb20148320 2019-11-28T11:45:25.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.930+0000 7ffb25755700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb20148320 0x7ffb2010ed50 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7ffb080086a0 tx=0x7ffb08010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.930+0000 7ffb1dffb700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffb04018770 0x7ffb0401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:25.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.930+0000 7ffb1dffb700 1 -- 172.21.15.80:0/346500938 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5754+0+0 (secure 0 0 0) 0x7ffb08031d40 con 0x7ffb20148320 2019-11-28T11:45:25.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.931+0000 7ffb24f54700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffb04018770 0x7ffb0401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:25.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.931+0000 7ffb24f54700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffb04018770 0x7ffb0401abe0 crc :-1 s=READY pgs=721 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.938+0000 7ffb271b8700 1 -- 172.21.15.80:0/346500938 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2010c810 con 0x7ffb20148320 2019-11-28T11:45:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.942+0000 7ffb25755700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb20148320 0x7ffb2010ed50 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7ffb080086a0 tx=0x7ffb08010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:24.942+0000 7ffb1dffb700 1 -- 172.21.15.80:0/346500938 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ffb08024f50 con 0x7ffb20148320 2019-11-28T11:45:25.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.110+0000 7ffb271b8700 1 -- 172.21.15.80:0/346500938 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffb2010c490 con 0x7ffb20148320 2019-11-28T11:45:25.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.768+0000 7ffb25755700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb20148320 0x7ffb2010ed50 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7ffb080086a0 tx=0x7ffb08010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.768+0000 7ffb1dffb700 1 -- 172.21.15.80:0/346500938 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v136) v1 ==== 173+0+0 (secure 0 0 0) 0x7ffb08000cc0 con 0x7ffb20148320 2019-11-28T11:45:25.815 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:45:25.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.776+0000 7ffb271b8700 1 -- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffb04018770 msgr2=0x7ffb0401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:25.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.776+0000 7ffb271b8700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffb04018770 0x7ffb0401abe0 crc :-1 s=READY pgs=721 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:25.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.776+0000 7ffb271b8700 1 -- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb20148320 msgr2=0x7ffb2010ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:25.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.776+0000 7ffb271b8700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb20148320 0x7ffb2010ed50 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7ffb080086a0 tx=0x7ffb08010af0).stop 2019-11-28T11:45:25.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.777+0000 7ffb271b8700 1 -- 172.21.15.80:0/346500938 shutdown_connections 2019-11-28T11:45:25.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.777+0000 7ffb271b8700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffb04018770 0x7ffb0401abe0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:25.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.777+0000 7ffb271b8700 1 --2- 172.21.15.80:0/346500938 >> v2:172.21.15.174:3300/0 conn(0x7ffb2010e3d0 0x7ffb20168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:25.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.777+0000 7ffb271b8700 1 --2- 172.21.15.80:0/346500938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb20148320 0x7ffb2010ed50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:25.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.777+0000 7ffb271b8700 1 -- 172.21.15.80:0/346500938 shutdown_connections 2019-11-28T11:45:25.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.777+0000 7ffb271b8700 1 -- 172.21.15.80:0/346500938 wait complete. 2019-11-28T11:45:25.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.777+0000 7ffb271b8700 1 -- 172.21.15.80:0/346500938 >> 172.21.15.80:0/346500938 conn(0x7ffb2015e2d0 msgr2=0x7ffb20147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:25.827 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:45:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.913+0000 7f54950ae700 1 Processor -- start 2019-11-28T11:45:25.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.914+0000 7f54950ae700 1 -- start start 2019-11-28T11:45:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.914+0000 7f54950ae700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f549006c490 0x7f549006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.914+0000 7f54950ae700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f549006ce60 0x7f5490164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.914+0000 7f54950ae700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549006db00 con 0x7f549006c0a0 2019-11-28T11:45:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.914+0000 7f54950ae700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549006fd60 con 0x7f549006c490 2019-11-28T11:45:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.914+0000 7f54950ae700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5490070030 con 0x7f549006ce60 2019-11-28T11:45:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f549006c490 0x7f549006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:25.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f549006c490 0x7f549006c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40484/0 (socket says 172.21.15.80:40484) 2019-11-28T11:45:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548ed9d700 1 -- 172.21.15.80:0/126586541 learned_addr learned my addr 172.21.15.80:0/126586541 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f54948ad700 1 --2- 172.21.15.80:0/126586541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f549006ce60 0x7f5490164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548ed9d700 1 -- 172.21.15.80:0/126586541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f549006ce60 msgr2=0x7f5490164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548ed9d700 1 --2- 172.21.15.80:0/126586541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f549006ce60 0x7f5490164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548ed9d700 1 -- 172.21.15.80:0/126586541 >> v1:172.21.15.174:6789/0 conn(0x7f549006c0a0 legacy=0x7f5490072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:25.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548e59c700 1 -- 172.21.15.80:0/126586541 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877976495 0 0) 0x7f5480001400 con 0x7f549006c0a0 2019-11-28T11:45:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548ed9d700 1 -- 172.21.15.80:0/126586541 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54900706c0 con 0x7f549006c490 2019-11-28T11:45:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548ed9d700 1 --2- 172.21.15.80:0/126586541 >> v2:172.21.15.80:3300/0 conn(0x7f549006c490 0x7f549006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f547800f6c0 tx=0x7f547800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548ed9d700 1 --2- 172.21.15.80:0/126586541 >> v2:172.21.15.80:3300/0 conn(0x7f549006c490 0x7f549006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f547800f6c0 tx=0x7f547800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548ed9d700 1 --2- 172.21.15.80:0/126586541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549006c490 0x7f549006c920 secure :-1 s=READY pgs=1776 cs=0 l=1 rx=0x7f547800f6c0 tx=0x7f547800fa60).ready entity=mon.0 client_cookie=22745ab3000c7762 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548ed9d700 1 --2- 172.21.15.80:0/126586541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549006c490 0x7f549006c920 secure :-1 s=THROTTLE_DONE pgs=1776 cs=0 l=1 rx=0x7f547800f6c0 tx=0x7f547800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548e59c700 1 -- 172.21.15.80:0/126586541 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5478000960 con 0x7f549006c490 2019-11-28T11:45:25.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548ed9d700 1 --2- 172.21.15.80:0/126586541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549006c490 0x7f549006c920 secure :-1 s=THROTTLE_DONE pgs=1776 cs=0 l=1 rx=0x7f547800f6c0 tx=0x7f547800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548ed9d700 1 --2- 172.21.15.80:0/126586541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549006c490 0x7f549006c920 secure :-1 s=THROTTLE_DONE pgs=1776 cs=0 l=1 rx=0x7f547800f6c0 tx=0x7f547800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548e59c700 1 -- 172.21.15.80:0/126586541 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5478000c90 con 0x7f549006c490 2019-11-28T11:45:25.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f548e59c700 1 -- 172.21.15.80:0/126586541 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5478007210 con 0x7f549006c490 2019-11-28T11:45:25.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f54950ae700 1 -- 172.21.15.80:0/126586541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549006c490 msgr2=0x7f549006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:25.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.915+0000 7f54950ae700 1 --2- 172.21.15.80:0/126586541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549006c490 0x7f549006c920 secure :-1 s=READY pgs=1776 cs=0 l=1 rx=0x7f547800f6c0 tx=0x7f547800fa60).stop 2019-11-28T11:45:25.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.916+0000 7f54950ae700 1 -- 172.21.15.80:0/126586541 shutdown_connections 2019-11-28T11:45:25.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.916+0000 7f54950ae700 1 --2- 172.21.15.80:0/126586541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f549006ce60 0x7f5490164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:25.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.916+0000 7f54950ae700 1 --2- 172.21.15.80:0/126586541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549006c490 0x7f549006c920 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:25.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.916+0000 7f54950ae700 1 -- 172.21.15.80:0/126586541 shutdown_connections 2019-11-28T11:45:25.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.916+0000 7f54950ae700 1 -- 172.21.15.80:0/126586541 wait complete. 2019-11-28T11:45:25.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.916+0000 7f54950ae700 1 -- 172.21.15.80:0/126586541 >> 172.21.15.80:0/126586541 conn(0x7f5490061cf0 msgr2=0x7f5490064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:25.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.918+0000 7f54950ae700 1 Processor -- start 2019-11-28T11:45:25.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.919+0000 7f54950ae700 1 -- start start 2019-11-28T11:45:25.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.919+0000 7f54950ae700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5490142160 0x7f549010de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:25.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.919+0000 7f54950ae700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f549012e240 0x7f549012e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:25.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.919+0000 7f54950ae700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5490101e80 con 0x7f549010e340 2019-11-28T11:45:25.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.919+0000 7f54950ae700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5490107520 con 0x7f549012e240 2019-11-28T11:45:25.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.919+0000 7f54950ae700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54901077f0 con 0x7f5490142160 2019-11-28T11:45:25.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f54948ad700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f549012e240 0x7f549012e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:25.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f54948ad700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f549012e240 0x7f549012e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40490/0 (socket says 172.21.15.80:40490) 2019-11-28T11:45:25.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f54948ad700 1 -- 172.21.15.80:0/1211670088 learned_addr learned my addr 172.21.15.80:0/1211670088 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:25.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f548f59e700 1 --2- 172.21.15.80:0/1211670088 >> v2:172.21.15.174:3300/0 conn(0x7f5490142160 0x7f549010de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:25.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f54948ad700 1 -- 172.21.15.80:0/1211670088 >> v2:172.21.15.174:3300/0 conn(0x7f5490142160 msgr2=0x7f549010de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:25.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f54948ad700 1 --2- 172.21.15.80:0/1211670088 >> v2:172.21.15.174:3300/0 conn(0x7f5490142160 0x7f549010de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:25.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f54948ad700 1 -- 172.21.15.80:0/1211670088 >> v1:172.21.15.80:6789/0 conn(0x7f549010e340 legacy=0x7f54901284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:25.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f54948ad700 1 -- 172.21.15.80:0/1211670088 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5490107e80 con 0x7f549012e240 2019-11-28T11:45:25.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f5487fff700 1 -- 172.21.15.80:0/1211670088 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410375632 0 0) 0x7f54780078e0 con 0x7f549010e340 2019-11-28T11:45:25.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f54948ad700 1 --2- 172.21.15.80:0/1211670088 >> v2:172.21.15.80:3300/0 conn(0x7f549012e240 0x7f549012e6d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5488010450 tx=0x7f5488010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f54948ad700 1 --2- 172.21.15.80:0/1211670088 >> v2:172.21.15.80:3300/0 conn(0x7f549012e240 0x7f549012e6d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5488010450 tx=0x7f5488010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f54948ad700 1 --2- 172.21.15.80:0/1211670088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549012e240 0x7f549012e6d0 secure :-1 s=READY pgs=1778 cs=0 l=1 rx=0x7f5488010450 tx=0x7f5488010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:25.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f54948ad700 1 --2- 172.21.15.80:0/1211670088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549012e240 0x7f549012e6d0 secure :-1 s=THROTTLE_DONE pgs=1778 cs=0 l=1 rx=0x7f5488010450 tx=0x7f5488010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f54948ad700 1 --2- 172.21.15.80:0/1211670088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549012e240 0x7f549012e6d0 secure :-1 s=THROTTLE_DONE pgs=1778 cs=0 l=1 rx=0x7f5488010450 tx=0x7f5488010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f5487fff700 1 -- 172.21.15.80:0/1211670088 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f548800d9d0 con 0x7f549012e240 2019-11-28T11:45:25.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f54948ad700 1 --2- 172.21.15.80:0/1211670088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549012e240 0x7f549012e6d0 secure :-1 s=THROTTLE_DONE pgs=1778 cs=0 l=1 rx=0x7f5488010450 tx=0x7f5488010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f5487fff700 1 -- 172.21.15.80:0/1211670088 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548800ec90 con 0x7f549012e240 2019-11-28T11:45:25.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f5487fff700 1 -- 172.21.15.80:0/1211670088 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f548800f320 con 0x7f549012e240 2019-11-28T11:45:25.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f54950ae700 1 -- 172.21.15.80:0/1211670088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5490108200 con 0x7f549012e240 2019-11-28T11:45:25.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f54950ae700 1 -- 172.21.15.80:0/1211670088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5490107e80 con 0x7f549012e240 2019-11-28T11:45:25.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.920+0000 7f54948ad700 1 --2- 172.21.15.80:0/1211670088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549012e240 0x7f549012e6d0 secure :-1 s=THROTTLE_DONE pgs=1778 cs=0 l=1 rx=0x7f5488010450 tx=0x7f5488010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.921+0000 7f5487fff700 1 -- 172.21.15.80:0/1211670088 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f548800d9d0 con 0x7f549012e240 2019-11-28T11:45:25.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.921+0000 7f54948ad700 1 --2- 172.21.15.80:0/1211670088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549012e240 0x7f549012e6d0 secure :-1 s=THROTTLE_DONE pgs=1778 cs=0 l=1 rx=0x7f5488010450 tx=0x7f5488010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.921+0000 7f5487fff700 1 --2- 172.21.15.80:0/1211670088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5468018730 0x7f546801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:25.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.921+0000 7f5487fff700 1 -- 172.21.15.80:0/1211670088 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5372+0+0 (secure 0 0 0) 0x7f5488031a90 con 0x7f549012e240 2019-11-28T11:45:25.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.921+0000 7f548f59e700 1 --2- 172.21.15.80:0/1211670088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5468018730 0x7f546801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:25.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.921+0000 7f548f59e700 1 --2- 172.21.15.80:0/1211670088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5468018730 0x7f546801abc0 crc :-1 s=READY pgs=722 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:25.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.929+0000 7f54950ae700 1 -- 172.21.15.80:0/1211670088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5490108200 con 0x7f549012e240 2019-11-28T11:45:25.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.932+0000 7f54948ad700 1 --2- 172.21.15.80:0/1211670088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549012e240 0x7f549012e6d0 secure :-1 s=THROTTLE_DONE pgs=1778 cs=0 l=1 rx=0x7f5488010450 tx=0x7f5488010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:25.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:25.932+0000 7f5487fff700 1 -- 172.21.15.80:0/1211670088 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f548802dff0 con 0x7f549012e240 2019-11-28T11:45:26.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.119+0000 7f54950ae700 1 -- 172.21.15.80:0/1211670088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f5490107e80 con 0x7f549012e240 2019-11-28T11:45:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.773+0000 7f54948ad700 1 --2- 172.21.15.80:0/1211670088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549012e240 0x7f549012e6d0 secure :-1 s=THROTTLE_DONE pgs=1778 cs=0 l=1 rx=0x7f5488010450 tx=0x7f5488010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:26.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.773+0000 7f5487fff700 1 -- 172.21.15.80:0/1211670088 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v137) v1 ==== 97+0+0 (secure 0 0 0) 0x7f548802dff0 con 0x7f549012e240 2019-11-28T11:45:26.824 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:45:26.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.785+0000 7f54950ae700 1 -- 172.21.15.80:0/1211670088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5468018730 msgr2=0x7f546801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:26.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.785+0000 7f54950ae700 1 --2- 172.21.15.80:0/1211670088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5468018730 0x7f546801abc0 crc :-1 s=READY pgs=722 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:26.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.785+0000 7f54950ae700 1 -- 172.21.15.80:0/1211670088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549012e240 msgr2=0x7f549012e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:26.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.785+0000 7f54950ae700 1 --2- 172.21.15.80:0/1211670088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549012e240 0x7f549012e6d0 secure :-1 s=READY pgs=1778 cs=0 l=1 rx=0x7f5488010450 tx=0x7f5488010280).stop 2019-11-28T11:45:26.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.785+0000 7f54950ae700 1 -- 172.21.15.80:0/1211670088 shutdown_connections 2019-11-28T11:45:26.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.785+0000 7f54950ae700 1 --2- 172.21.15.80:0/1211670088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5468018730 0x7f546801abc0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:26.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.785+0000 7f54950ae700 1 --2- 172.21.15.80:0/1211670088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f549012e240 0x7f549012e6d0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:26.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.785+0000 7f54950ae700 1 --2- 172.21.15.80:0/1211670088 >> v2:172.21.15.174:3300/0 conn(0x7f5490142160 0x7f549010de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:26.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.786+0000 7f54950ae700 1 -- 172.21.15.80:0/1211670088 shutdown_connections 2019-11-28T11:45:26.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.786+0000 7f54950ae700 1 -- 172.21.15.80:0/1211670088 wait complete. 2019-11-28T11:45:26.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.786+0000 7f54950ae700 1 -- 172.21.15.80:0/1211670088 >> 172.21.15.80:0/1211670088 conn(0x7f549015e210 msgr2=0x7f549010b140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:26.836 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:45:26.836 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:45:26.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.915+0000 7f83e8cab700 1 Processor -- start 2019-11-28T11:45:26.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.915+0000 7f83e8cab700 1 -- start start 2019-11-28T11:45:26.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.916+0000 7f83e8cab700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83e406c490 0x7f83e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:26.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.916+0000 7f83e8cab700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f83e406ce60 0x7f83e4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:26.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.916+0000 7f83e8cab700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e406db00 con 0x7f83e406c0a0 2019-11-28T11:45:26.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.916+0000 7f83e8cab700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e406fd60 con 0x7f83e406c490 2019-11-28T11:45:26.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.916+0000 7f83e8cab700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e4070030 con 0x7f83e406ce60 2019-11-28T11:45:26.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.916+0000 7f83e259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83e406c490 0x7f83e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:26.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.916+0000 7f83e259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83e406c490 0x7f83e406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40498/0 (socket says 172.21.15.80:40498) 2019-11-28T11:45:26.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.916+0000 7f83e259c700 1 -- 172.21.15.80:0/2431902123 learned_addr learned my addr 172.21.15.80:0/2431902123 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:26.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e359e700 1 --2- 172.21.15.80:0/2431902123 >> v2:172.21.15.174:3300/0 conn(0x7f83e406ce60 0x7f83e4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:26.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e259c700 1 -- 172.21.15.80:0/2431902123 >> v2:172.21.15.174:3300/0 conn(0x7f83e406ce60 msgr2=0x7f83e4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:26.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e259c700 1 --2- 172.21.15.80:0/2431902123 >> v2:172.21.15.174:3300/0 conn(0x7f83e406ce60 0x7f83e4164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:26.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e259c700 1 -- 172.21.15.80:0/2431902123 >> v1:172.21.15.80:6789/0 conn(0x7f83e406c0a0 legacy=0x7f83e4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:26.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e259c700 1 -- 172.21.15.80:0/2431902123 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e40706c0 con 0x7f83e406c490 2019-11-28T11:45:26.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e1d9b700 1 -- 172.21.15.80:0/2431902123 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522410782 0 0) 0x7f83d4001100 con 0x7f83e406c0a0 2019-11-28T11:45:26.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e359e700 1 --2- 172.21.15.80:0/2431902123 >> v2:172.21.15.174:3300/0 conn(0x7f83e406ce60 0x7f83e4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:26.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e259c700 1 --2- 172.21.15.80:0/2431902123 >> v2:172.21.15.80:3300/0 conn(0x7f83e406c490 0x7f83e406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f83cc00f740 tx=0x7f83cc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:26.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e259c700 1 --2- 172.21.15.80:0/2431902123 >> v2:172.21.15.80:3300/0 conn(0x7f83e406c490 0x7f83e406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f83cc00f740 tx=0x7f83cc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:26.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e259c700 1 --2- 172.21.15.80:0/2431902123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e406c490 0x7f83e406c920 secure :-1 s=READY pgs=1780 cs=0 l=1 rx=0x7f83cc00f740 tx=0x7f83cc00fae0).ready entity=mon.0 client_cookie=f49d84e9d08ff6b1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:26.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e259c700 1 --2- 172.21.15.80:0/2431902123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e406c490 0x7f83e406c920 secure :-1 s=THROTTLE_DONE pgs=1780 cs=0 l=1 rx=0x7f83cc00f740 tx=0x7f83cc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:26.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e1d9b700 1 -- 172.21.15.80:0/2431902123 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83cc000960 con 0x7f83e406c490 2019-11-28T11:45:26.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e259c700 1 --2- 172.21.15.80:0/2431902123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e406c490 0x7f83e406c920 secure :-1 s=THROTTLE_DONE pgs=1780 cs=0 l=1 rx=0x7f83cc00f740 tx=0x7f83cc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:26.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e259c700 1 --2- 172.21.15.80:0/2431902123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e406c490 0x7f83e406c920 secure :-1 s=THROTTLE_DONE pgs=1780 cs=0 l=1 rx=0x7f83cc00f740 tx=0x7f83cc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:26.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e1d9b700 1 -- 172.21.15.80:0/2431902123 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83cc000c90 con 0x7f83e406c490 2019-11-28T11:45:26.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e1d9b700 1 -- 172.21.15.80:0/2431902123 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83cc0013a0 con 0x7f83e406c490 2019-11-28T11:45:26.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e8cab700 1 -- 172.21.15.80:0/2431902123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e406c490 msgr2=0x7f83e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:26.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.917+0000 7f83e8cab700 1 --2- 172.21.15.80:0/2431902123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e406c490 0x7f83e406c920 secure :-1 s=READY pgs=1780 cs=0 l=1 rx=0x7f83cc00f740 tx=0x7f83cc00fae0).stop 2019-11-28T11:45:26.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.918+0000 7f83e8cab700 1 -- 172.21.15.80:0/2431902123 shutdown_connections 2019-11-28T11:45:26.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.918+0000 7f83e8cab700 1 --2- 172.21.15.80:0/2431902123 >> v2:172.21.15.174:3300/0 conn(0x7f83e406ce60 0x7f83e4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:26.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.918+0000 7f83e8cab700 1 --2- 172.21.15.80:0/2431902123 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e406c490 0x7f83e406c920 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:26.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.918+0000 7f83e8cab700 1 -- 172.21.15.80:0/2431902123 shutdown_connections 2019-11-28T11:45:26.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.918+0000 7f83e8cab700 1 -- 172.21.15.80:0/2431902123 wait complete. 2019-11-28T11:45:26.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.918+0000 7f83e8cab700 1 -- 172.21.15.80:0/2431902123 >> 172.21.15.80:0/2431902123 conn(0x7f83e4061cf0 msgr2=0x7f83e4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:26.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.920+0000 7f83e8cab700 1 Processor -- start 2019-11-28T11:45:26.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.920+0000 7f83e8cab700 1 -- start start 2019-11-28T11:45:26.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.921+0000 7f83e8cab700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83e41281b0 0x7f83e4128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:26.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.921+0000 7f83e8cab700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83e4128b80 0x7f83e4167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:26.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.921+0000 7f83e8cab700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e4139a60 con 0x7f83e413a780 2019-11-28T11:45:26.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.921+0000 7f83e8cab700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e412a260 con 0x7f83e4128b80 2019-11-28T11:45:26.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.921+0000 7f83e8cab700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e412a530 con 0x7f83e41281b0 2019-11-28T11:45:26.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.921+0000 7f83e359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83e4128b80 0x7f83e4167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:26.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.921+0000 7f83e359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83e4128b80 0x7f83e4167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40502/0 (socket says 172.21.15.80:40502) 2019-11-28T11:45:26.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.921+0000 7f83e359e700 1 -- 172.21.15.80:0/4047022661 learned_addr learned my addr 172.21.15.80:0/4047022661 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:26.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.921+0000 7f83e259c700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83e41281b0 0x7f83e4128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:26.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.921+0000 7f83e359e700 1 -- 172.21.15.80:0/4047022661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83e41281b0 msgr2=0x7f83e4128640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:26.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.922+0000 7f83e359e700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83e41281b0 0x7f83e4128640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:26.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.922+0000 7f83e359e700 1 -- 172.21.15.80:0/4047022661 >> v1:172.21.15.174:6789/0 conn(0x7f83e413a780 legacy=0x7f83e412d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:26.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.922+0000 7f83e359e700 1 -- 172.21.15.80:0/4047022661 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e412abc0 con 0x7f83e4128b80 2019-11-28T11:45:26.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.922+0000 7f83e259c700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83e41281b0 0x7f83e4128640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:26.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.922+0000 7f83e359e700 1 --2- 172.21.15.80:0/4047022661 >> v2:172.21.15.80:3300/0 conn(0x7f83e4128b80 0x7f83e4167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f83dc010800 tx=0x7f83dc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:26.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.922+0000 7f83e359e700 1 --2- 172.21.15.80:0/4047022661 >> v2:172.21.15.80:3300/0 conn(0x7f83e4128b80 0x7f83e4167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f83dc010800 tx=0x7f83dc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:26.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.922+0000 7f83e359e700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e4128b80 0x7f83e4167d70 secure :-1 s=READY pgs=1781 cs=0 l=1 rx=0x7f83dc010800 tx=0x7f83dc010ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:26.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.922+0000 7f83e359e700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e4128b80 0x7f83e4167d70 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7f83dc010800 tx=0x7f83dc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:26.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.922+0000 7f83e359e700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e4128b80 0x7f83e4167d70 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7f83dc010800 tx=0x7f83dc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:26.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.922+0000 7f83db7fe700 1 -- 172.21.15.80:0/4047022661 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83dc008800 con 0x7f83e4128b80 2019-11-28T11:45:26.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.922+0000 7f83e359e700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e4128b80 0x7f83e4167d70 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7f83dc010800 tx=0x7f83dc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:26.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.922+0000 7f83db7fe700 1 -- 172.21.15.80:0/4047022661 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc009e00 con 0x7f83e4128b80 2019-11-28T11:45:26.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.922+0000 7f83e8cab700 1 -- 172.21.15.80:0/4047022661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e412af40 con 0x7f83e4128b80 2019-11-28T11:45:26.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.922+0000 7f83db7fe700 1 -- 172.21.15.80:0/4047022661 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83dc00a490 con 0x7f83e4128b80 2019-11-28T11:45:26.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.922+0000 7f83e8cab700 1 -- 172.21.15.80:0/4047022661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e412abc0 con 0x7f83e4128b80 2019-11-28T11:45:26.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.922+0000 7f83e359e700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e4128b80 0x7f83e4167d70 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7f83dc010800 tx=0x7f83dc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:26.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.923+0000 7f83db7fe700 1 -- 172.21.15.80:0/4047022661 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f83dc000df0 con 0x7f83e4128b80 2019-11-28T11:45:26.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.923+0000 7f83e359e700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e4128b80 0x7f83e4167d70 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7f83dc010800 tx=0x7f83dc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:26.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.923+0000 7f83db7fe700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f83c8018730 0x7f83c801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:26.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.923+0000 7f83db7fe700 1 -- 172.21.15.80:0/4047022661 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f83dc031e30 con 0x7f83e4128b80 2019-11-28T11:45:26.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.923+0000 7f83e2d9d700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f83c8018730 0x7f83c801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:26.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.923+0000 7f83e2d9d700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f83c8018730 0x7f83c801abc0 crc :-1 s=READY pgs=723 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:26.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.931+0000 7f83e8cab700 1 -- 172.21.15.80:0/4047022661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e412af40 con 0x7f83e4128b80 2019-11-28T11:45:26.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.934+0000 7f83e359e700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e4128b80 0x7f83e4167d70 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7f83dc010800 tx=0x7f83dc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:26.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:26.934+0000 7f83db7fe700 1 -- 172.21.15.80:0/4047022661 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f83dc009960 con 0x7f83e4128b80 2019-11-28T11:45:27.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.106+0000 7f83e8cab700 1 -- 172.21.15.80:0/4047022661 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f83e412abc0 con 0x7f83e4128b80 2019-11-28T11:45:27.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.107+0000 7f83e359e700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e4128b80 0x7f83e4167d70 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7f83dc010800 tx=0x7f83dc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.107+0000 7f83db7fe700 1 -- 172.21.15.80:0/4047022661 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v47) v1 ==== 80+0+4797 (secure 0 0 0) 0x7f83dc017550 con 0x7f83e4128b80 2019-11-28T11:45:27.148 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:27.148 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:45:27.149 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:45:27.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.149 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:45:27.149 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:45:27.149 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.150 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:45:27.150 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:45:27.150 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:45:27.150 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:45:27.150 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.151 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:45:27.151 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:45:27.151 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.151 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:45:27.151 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:45:27.151 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:45:27.151 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:45:27.152 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.152 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:45:27.152 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:45:27.152 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.153 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:45:27.153 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:45:27.153 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:45:27.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:45:27.153 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.154 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:45:27.154 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:45:27.154 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.154 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:45:27.154 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:45:27.154 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:45:27.154 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.155 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:45:27.155 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:45:27.155 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.155 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:45:27.156 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:45:27.156 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:45:27.156 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.157 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:45:27.157 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:45:27.157 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.157 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:45:27.158 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:45:27.158 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:45:27.158 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.159 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:45:27.159 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:45:27.159 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.160 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:45:27.160 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:45:27.160 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:45:27.160 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.161 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:45:27.161 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:45:27.161 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.161 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:45:27.162 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:45:27.162 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:45:27.162 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.163 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:45:27.163 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:45:27.163 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.163 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:45:27.163 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:45:27.164 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:45:27.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.164 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:45:27.165 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:45:27.165 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.165 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:45:27.165 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:45:27.165 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:45:27.166 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.166 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:45:27.166 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:45:27.167 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.167 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:45:27.167 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:45:27.167 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:45:27.167 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.168 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:45:27.168 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:45:27.168 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.168 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:45:27.169 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:45:27.169 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:45:27.169 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.170 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:45:27.170 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:45:27.170 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.170 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:45:27.170 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:45:27.171 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:45:27.171 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.171 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:45:27.172 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:45:27.172 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.172 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:45:27.172 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:45:27.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:45:27.173 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.173 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:45:27.173 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:45:27.174 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.174 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:45:27.174 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:45:27.174 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:45:27.174 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.175 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:45:27.175 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:45:27.175 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.176 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:45:27.176 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:45:27.176 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:45:27.176 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:45:27.176 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.177 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:45:27.177 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:45:27.177 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.178 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:45:27.178 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:45:27.178 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:45:27.178 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:45:27.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:27.179 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:45:27.179 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:45:27.179 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:45:27.179 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:45:27.180 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:45:27.180 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:45:27.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:27.180 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:45:27.181 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:45:27.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.109+0000 7f83e8cab700 1 -- 172.21.15.80:0/4047022661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f83c8018730 msgr2=0x7f83c801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.109+0000 7f83e8cab700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f83c8018730 0x7f83c801abc0 crc :-1 s=READY pgs=723 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:27.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.109+0000 7f83e8cab700 1 -- 172.21.15.80:0/4047022661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e4128b80 msgr2=0x7f83e4167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.109+0000 7f83e8cab700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e4128b80 0x7f83e4167d70 secure :-1 s=READY pgs=1781 cs=0 l=1 rx=0x7f83dc010800 tx=0x7f83dc010ba0).stop 2019-11-28T11:45:27.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.109+0000 7f83e8cab700 1 -- 172.21.15.80:0/4047022661 shutdown_connections 2019-11-28T11:45:27.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.109+0000 7f83e8cab700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83e4128b80 0x7f83e4167d70 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:27.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.109+0000 7f83e8cab700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83e41281b0 0x7f83e4128640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:27.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.109+0000 7f83e8cab700 1 --2- 172.21.15.80:0/4047022661 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f83c8018730 0x7f83c801abc0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:27.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.110+0000 7f83e8cab700 1 -- 172.21.15.80:0/4047022661 shutdown_connections 2019-11-28T11:45:27.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.110+0000 7f83e8cab700 1 -- 172.21.15.80:0/4047022661 wait complete. 2019-11-28T11:45:27.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.110+0000 7f83e8cab700 1 -- 172.21.15.80:0/4047022661 >> 172.21.15.80:0/4047022661 conn(0x7f83e4127dc0 msgr2=0x7f83e4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:27.187 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:45:27.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.267+0000 7fd61208e700 1 Processor -- start 2019-11-28T11:45:27.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.267+0000 7fd61208e700 1 -- start start 2019-11-28T11:45:27.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd61208e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd60c06c0a0 0x7fd60c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:27.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd61208e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd60c072620 0x7fd60c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:27.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd61208e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c06db00 con 0x7fd60c0734e0 2019-11-28T11:45:27.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd61208e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c06fd60 con 0x7fd60c072620 2019-11-28T11:45:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd61208e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c070030 con 0x7fd60c06c0a0 2019-11-28T11:45:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd610e2c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd60c072620 0x7fd60c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd610e2c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd60c072620 0x7fd60c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40510/0 (socket says 172.21.15.80:40510) 2019-11-28T11:45:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd610e2c700 1 -- 172.21.15.80:0/1520001397 learned_addr learned my addr 172.21.15.80:0/1520001397 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd60bfff700 1 --2- 172.21.15.80:0/1520001397 >> v2:172.21.15.174:3300/0 conn(0x7fd60c06c0a0 0x7fd60c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd610e2c700 1 -- 172.21.15.80:0/1520001397 >> v2:172.21.15.174:3300/0 conn(0x7fd60c06c0a0 msgr2=0x7fd60c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd610e2c700 1 --2- 172.21.15.80:0/1520001397 >> v2:172.21.15.174:3300/0 conn(0x7fd60c06c0a0 0x7fd60c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd610e2c700 1 -- 172.21.15.80:0/1520001397 >> v1:172.21.15.174:6789/0 conn(0x7fd60c0734e0 legacy=0x7fd60c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd610e2c700 1 -- 172.21.15.80:0/1520001397 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c0706c0 con 0x7fd60c072620 2019-11-28T11:45:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd610e2c700 1 --2- 172.21.15.80:0/1520001397 >> v2:172.21.15.80:3300/0 conn(0x7fd60c072620 0x7fd60c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd60400fa30 tx=0x7fd60400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd610e2c700 1 --2- 172.21.15.80:0/1520001397 >> v2:172.21.15.80:3300/0 conn(0x7fd60c072620 0x7fd60c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd60400fa30 tx=0x7fd60400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd610e2c700 1 --2- 172.21.15.80:0/1520001397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd60c072620 0x7fd60c164d70 secure :-1 s=READY pgs=1782 cs=0 l=1 rx=0x7fd60400fa30 tx=0x7fd60400fdd0).ready entity=mon.0 client_cookie=4e7c536ecea34231 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd610e2c700 1 --2- 172.21.15.80:0/1520001397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd60c072620 0x7fd60c164d70 secure :-1 s=THROTTLE_DONE pgs=1782 cs=0 l=1 rx=0x7fd60400fa30 tx=0x7fd60400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd610e2c700 1 --2- 172.21.15.80:0/1520001397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd60c072620 0x7fd60c164d70 secure :-1 s=THROTTLE_DONE pgs=1782 cs=0 l=1 rx=0x7fd60400fa30 tx=0x7fd60400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd60b7fe700 1 -- 172.21.15.80:0/1520001397 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd604000df0 con 0x7fd60c072620 2019-11-28T11:45:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd610e2c700 1 --2- 172.21.15.80:0/1520001397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd60c072620 0x7fd60c164d70 secure :-1 s=THROTTLE_DONE pgs=1782 cs=0 l=1 rx=0x7fd60400fa30 tx=0x7fd60400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd60b7fe700 1 -- 172.21.15.80:0/1520001397 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd604001460 con 0x7fd60c072620 2019-11-28T11:45:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd60b7fe700 1 -- 172.21.15.80:0/1520001397 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd604001b30 con 0x7fd60c072620 2019-11-28T11:45:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd61208e700 1 -- 172.21.15.80:0/1520001397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd60c072620 msgr2=0x7fd60c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.268+0000 7fd61208e700 1 --2- 172.21.15.80:0/1520001397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd60c072620 0x7fd60c164d70 secure :-1 s=READY pgs=1782 cs=0 l=1 rx=0x7fd60400fa30 tx=0x7fd60400fdd0).stop 2019-11-28T11:45:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.269+0000 7fd61208e700 1 -- 172.21.15.80:0/1520001397 shutdown_connections 2019-11-28T11:45:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.269+0000 7fd61208e700 1 --2- 172.21.15.80:0/1520001397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd60c072620 0x7fd60c164d70 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.269+0000 7fd61208e700 1 --2- 172.21.15.80:0/1520001397 >> v2:172.21.15.174:3300/0 conn(0x7fd60c06c0a0 0x7fd60c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.269+0000 7fd61208e700 1 -- 172.21.15.80:0/1520001397 shutdown_connections 2019-11-28T11:45:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.269+0000 7fd61208e700 1 -- 172.21.15.80:0/1520001397 wait complete. 2019-11-28T11:45:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.269+0000 7fd61208e700 1 -- 172.21.15.80:0/1520001397 >> 172.21.15.80:0/1520001397 conn(0x7fd60c061cf0 msgr2=0x7fd60c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:27.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.272+0000 7fd61208e700 1 Processor -- start 2019-11-28T11:45:27.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.272+0000 7fd61208e700 1 -- start start 2019-11-28T11:45:27.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.272+0000 7fd61208e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c104c10 0x7fd60c1050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:27.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.272+0000 7fd61208e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c105a30 con 0x7fd60c1055e0 2019-11-28T11:45:27.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.272+0000 7fd61208e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c13bcd0 con 0x7fd60c104820 2019-11-28T11:45:27.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.272+0000 7fd61208e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c109130 con 0x7fd60c104c10 2019-11-28T11:45:27.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd610e2c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd60c1055e0 0x7fd60c167a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39832/0 (socket says 172.21.15.80:39832) 2019-11-28T11:45:27.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd610e2c700 1 -- 172.21.15.80:0/3829937622 learned_addr learned my addr 172.21.15.80:0/3829937622 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:27.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd603fff700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c104c10 0x7fd60c1050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:27.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd6097fa700 1 -- 172.21.15.80:0/3829937622 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998094938 0 0) 0x7fd604000cc0 con 0x7fd60c1055e0 2019-11-28T11:45:27.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd6097fa700 1 -- 172.21.15.80:0/3829937622 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5f0002e80 con 0x7fd60c1055e0 2019-11-28T11:45:27.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd6097fa700 1 -- 172.21.15.80:0/3829937622 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858778500 0 0) 0x7fd5fc009580 con 0x7fd60c104820 2019-11-28T11:45:27.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd6097fa700 1 -- 172.21.15.80:0/3829937622 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5f00041b0 con 0x7fd60c104820 2019-11-28T11:45:27.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd603fff700 1 -- 172.21.15.80:0/3829937622 >> v1:172.21.15.174:6789/0 conn(0x7fd60c104820 legacy=0x7fd60c10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd603fff700 1 -- 172.21.15.80:0/3829937622 >> v1:172.21.15.80:6789/0 conn(0x7fd60c1055e0 legacy=0x7fd60c167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd603fff700 1 -- 172.21.15.80:0/3829937622 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c109a90 con 0x7fd60c104c10 2019-11-28T11:45:27.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd603fff700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c104c10 0x7fd60c1050a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd5f40103a0 tx=0x7fd5f4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd603fff700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c104c10 0x7fd60c1050a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd5f40103a0 tx=0x7fd5f4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd603fff700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c104c10 0x7fd60c1050a0 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7fd5f40103a0 tx=0x7fd5f4010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:27.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd603fff700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c104c10 0x7fd60c1050a0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7fd5f40103a0 tx=0x7fd5f4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd6097fa700 1 -- 172.21.15.80:0/3829937622 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f4000960 con 0x7fd60c104c10 2019-11-28T11:45:27.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd603fff700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c104c10 0x7fd60c1050a0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7fd5f40103a0 tx=0x7fd5f4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd6097fa700 1 -- 172.21.15.80:0/3829937622 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f400eef0 con 0x7fd60c104c10 2019-11-28T11:45:27.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd603fff700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c104c10 0x7fd60c1050a0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7fd5f40103a0 tx=0x7fd5f4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd61208e700 1 -- 172.21.15.80:0/3829937622 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60c109e10 con 0x7fd60c104c10 2019-11-28T11:45:27.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd6097fa700 1 -- 172.21.15.80:0/3829937622 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f400f0e0 con 0x7fd60c104c10 2019-11-28T11:45:27.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.273+0000 7fd61208e700 1 -- 172.21.15.80:0/3829937622 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c109a90 con 0x7fd60c104c10 2019-11-28T11:45:27.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.274+0000 7fd603fff700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c104c10 0x7fd60c1050a0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7fd5f40103a0 tx=0x7fd5f4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.274+0000 7fd6097fa700 1 -- 172.21.15.80:0/3829937622 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd5f400f2f0 con 0x7fd60c104c10 2019-11-28T11:45:27.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.274+0000 7fd603fff700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c104c10 0x7fd60c1050a0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7fd5f40103a0 tx=0x7fd5f4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.274+0000 7fd6097fa700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd5f0018790 0x7fd5f001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:27.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.274+0000 7fd6097fa700 1 -- 172.21.15.80:0/3829937622 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fd5f4031a50 con 0x7fd60c104c10 2019-11-28T11:45:27.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.274+0000 7fd60bfff700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd5f0018790 0x7fd5f001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:27.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.274+0000 7fd60bfff700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd5f0018790 0x7fd5f001abe0 crc :-1 s=READY pgs=724 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:27.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.282+0000 7fd61208e700 1 -- 172.21.15.80:0/3829937622 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60c109e10 con 0x7fd60c104c10 2019-11-28T11:45:27.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.286+0000 7fd603fff700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c104c10 0x7fd60c1050a0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7fd5f40103a0 tx=0x7fd5f4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.286+0000 7fd6097fa700 1 -- 172.21.15.80:0/3829937622 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd5f400f0e0 con 0x7fd60c104c10 2019-11-28T11:45:27.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.458+0000 7fd61208e700 1 -- 172.21.15.80:0/3829937622 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd60c109a90 con 0x7fd60c104c10 2019-11-28T11:45:27.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.460+0000 7fd603fff700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c104c10 0x7fd60c1050a0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7fd5f40103a0 tx=0x7fd5f4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.460+0000 7fd6097fa700 1 -- 172.21.15.80:0/3829937622 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+12010 (secure 0 0 0) 0x7fd5f400f2f0 con 0x7fd60c104c10 2019-11-28T11:45:27.502 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:27.502 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":137,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:45:26.763302+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:45:27.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.463+0000 7fd61208e700 1 -- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd5f0018790 msgr2=0x7fd5f001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.463+0000 7fd61208e700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd5f0018790 0x7fd5f001abe0 crc :-1 s=READY pgs=724 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:27.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.463+0000 7fd61208e700 1 -- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c104c10 msgr2=0x7fd60c1050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.463+0000 7fd61208e700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c104c10 0x7fd60c1050a0 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7fd5f40103a0 tx=0x7fd5f4010740).stop 2019-11-28T11:45:27.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.463+0000 7fd61208e700 1 -- 172.21.15.80:0/3829937622 shutdown_connections 2019-11-28T11:45:27.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.463+0000 7fd61208e700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c104c10 0x7fd60c1050a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:27.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.463+0000 7fd61208e700 1 --2- 172.21.15.80:0/3829937622 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd5f0018790 0x7fd5f001abe0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:27.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.463+0000 7fd61208e700 1 -- 172.21.15.80:0/3829937622 shutdown_connections 2019-11-28T11:45:27.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.463+0000 7fd61208e700 1 -- 172.21.15.80:0/3829937622 wait complete. 2019-11-28T11:45:27.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.463+0000 7fd61208e700 1 -- 172.21.15.80:0/3829937622 >> 172.21.15.80:0/3829937622 conn(0x7fd60c13d620 msgr2=0x7fd60c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:27.514 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:45:27.515 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:45:27.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.598+0000 7f3dd91ee700 1 Processor -- start 2019-11-28T11:45:27.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.598+0000 7f3dd91ee700 1 -- start start 2019-11-28T11:45:27.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.599+0000 7f3dd91ee700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3dd415f100 0x7f3dd406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:27.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.599+0000 7f3dd91ee700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3dd406c2f0 0x7f3dd406c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:27.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.599+0000 7f3dd91ee700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd406db60 con 0x7f3dd415ed10 2019-11-28T11:45:27.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.599+0000 7f3dd91ee700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd406fe00 con 0x7f3dd415f100 2019-11-28T11:45:27.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.599+0000 7f3dd91ee700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd40700d0 con 0x7f3dd406c2f0 2019-11-28T11:45:27.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.599+0000 7f3dd2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3dd415f100 0x7f3dd406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:27.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.599+0000 7f3dd2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3dd415f100 0x7f3dd406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40524/0 (socket says 172.21.15.80:40524) 2019-11-28T11:45:27.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.599+0000 7f3dd2d9d700 1 -- 172.21.15.80:0/546077789 learned_addr learned my addr 172.21.15.80:0/546077789 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:27.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.599+0000 7f3dd89ed700 1 --2- 172.21.15.80:0/546077789 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3dd406c2f0 0x7f3dd406c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:27.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.600+0000 7f3dd2d9d700 1 -- 172.21.15.80:0/546077789 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3dd406c2f0 msgr2=0x7f3dd406c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:27.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.600+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/546077789 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3dd406c2f0 0x7f3dd406c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:27.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.600+0000 7f3dd2d9d700 1 -- 172.21.15.80:0/546077789 >> v1:172.21.15.80:6789/0 conn(0x7f3dd415ed10 legacy=0x7f3dd4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.600+0000 7f3dd2d9d700 1 -- 172.21.15.80:0/546077789 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd4070760 con 0x7f3dd415f100 2019-11-28T11:45:27.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.600+0000 7f3dd259c700 1 -- 172.21.15.80:0/546077789 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190839572 0 0) 0x7f3dc4001480 con 0x7f3dd415ed10 2019-11-28T11:45:27.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.600+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/546077789 >> v2:172.21.15.80:3300/0 conn(0x7f3dd415f100 0x7f3dd406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3dbc00f6c0 tx=0x7f3dbc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.600+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/546077789 >> v2:172.21.15.80:3300/0 conn(0x7f3dd415f100 0x7f3dd406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3dbc00f6c0 tx=0x7f3dbc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.600+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/546077789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd415f100 0x7f3dd406bdb0 secure :-1 s=READY pgs=1785 cs=0 l=1 rx=0x7f3dbc00f6c0 tx=0x7f3dbc00fa60).ready entity=mon.0 client_cookie=63cfd709b51fb3df server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:27.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.600+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/546077789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd415f100 0x7f3dd406bdb0 secure :-1 s=THROTTLE_DONE pgs=1785 cs=0 l=1 rx=0x7f3dbc00f6c0 tx=0x7f3dbc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.600+0000 7f3dd259c700 1 -- 172.21.15.80:0/546077789 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dbc000960 con 0x7f3dd415f100 2019-11-28T11:45:27.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.600+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/546077789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd415f100 0x7f3dd406bdb0 secure :-1 s=THROTTLE_DONE pgs=1785 cs=0 l=1 rx=0x7f3dbc00f6c0 tx=0x7f3dbc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.600+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/546077789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd415f100 0x7f3dd406bdb0 secure :-1 s=THROTTLE_DONE pgs=1785 cs=0 l=1 rx=0x7f3dbc00f6c0 tx=0x7f3dbc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.600+0000 7f3dd259c700 1 -- 172.21.15.80:0/546077789 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc000c90 con 0x7f3dd415f100 2019-11-28T11:45:27.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.600+0000 7f3dd259c700 1 -- 172.21.15.80:0/546077789 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dbc0013a0 con 0x7f3dd415f100 2019-11-28T11:45:27.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.600+0000 7f3dd91ee700 1 -- 172.21.15.80:0/546077789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd415f100 msgr2=0x7f3dd406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.600+0000 7f3dd91ee700 1 --2- 172.21.15.80:0/546077789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd415f100 0x7f3dd406bdb0 secure :-1 s=READY pgs=1785 cs=0 l=1 rx=0x7f3dbc00f6c0 tx=0x7f3dbc00fa60).stop 2019-11-28T11:45:27.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.601+0000 7f3dd91ee700 1 -- 172.21.15.80:0/546077789 shutdown_connections 2019-11-28T11:45:27.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.601+0000 7f3dd91ee700 1 --2- 172.21.15.80:0/546077789 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3dd406c2f0 0x7f3dd406c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:27.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.601+0000 7f3dd91ee700 1 --2- 172.21.15.80:0/546077789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd415f100 0x7f3dd406bdb0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:27.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.601+0000 7f3dd91ee700 1 -- 172.21.15.80:0/546077789 shutdown_connections 2019-11-28T11:45:27.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.601+0000 7f3dd91ee700 1 -- 172.21.15.80:0/546077789 wait complete. 2019-11-28T11:45:27.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.601+0000 7f3dd91ee700 1 -- 172.21.15.80:0/546077789 >> 172.21.15.80:0/546077789 conn(0x7f3dd4061d20 msgr2=0x7f3dd40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:27.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.603+0000 7f3dd91ee700 1 Processor -- start 2019-11-28T11:45:27.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.603+0000 7f3dd91ee700 1 -- start start 2019-11-28T11:45:27.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.604+0000 7f3dd91ee700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3dd4148320 0x7f3dd410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:27.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.604+0000 7f3dd91ee700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3dd410f290 0x7f3dd410dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:27.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.604+0000 7f3dd91ee700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd4148e00 con 0x7f3dd410e110 2019-11-28T11:45:27.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.604+0000 7f3dd91ee700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd413aa20 con 0x7f3dd410f290 2019-11-28T11:45:27.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.604+0000 7f3dd91ee700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd413acf0 con 0x7f3dd4148320 2019-11-28T11:45:27.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.604+0000 7f3dd2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3dd410f290 0x7f3dd410dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:27.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.604+0000 7f3dd2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3dd410f290 0x7f3dd410dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40528/0 (socket says 172.21.15.80:40528) 2019-11-28T11:45:27.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.604+0000 7f3dd2d9d700 1 -- 172.21.15.80:0/2506681304 learned_addr learned my addr 172.21.15.80:0/2506681304 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:27.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.604+0000 7f3dd359e700 1 --2- 172.21.15.80:0/2506681304 >> v2:172.21.15.174:3300/0 conn(0x7f3dd4148320 0x7f3dd410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:27.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.604+0000 7f3dd2d9d700 1 -- 172.21.15.80:0/2506681304 >> v2:172.21.15.174:3300/0 conn(0x7f3dd4148320 msgr2=0x7f3dd410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.604+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/2506681304 >> v2:172.21.15.174:3300/0 conn(0x7f3dd4148320 0x7f3dd410ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:27.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.604+0000 7f3dd2d9d700 1 -- 172.21.15.80:0/2506681304 >> v1:172.21.15.174:6789/0 conn(0x7f3dd410e110 legacy=0x7f3dd41079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.604+0000 7f3dd2d9d700 1 -- 172.21.15.80:0/2506681304 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd410c490 con 0x7f3dd410f290 2019-11-28T11:45:27.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.604+0000 7f3dd359e700 1 --2- 172.21.15.80:0/2506681304 >> v2:172.21.15.174:3300/0 conn(0x7f3dd4148320 0x7f3dd410ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:27.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.605+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/2506681304 >> v2:172.21.15.80:3300/0 conn(0x7f3dd410f290 0x7f3dd410dbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3dbc010440 tx=0x7f3dbc0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.605+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/2506681304 >> v2:172.21.15.80:3300/0 conn(0x7f3dd410f290 0x7f3dd410dbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3dbc010440 tx=0x7f3dbc0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.605+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/2506681304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd410f290 0x7f3dd410dbd0 secure :-1 s=READY pgs=1786 cs=0 l=1 rx=0x7f3dbc010440 tx=0x7f3dbc0107e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:27.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.605+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/2506681304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd410f290 0x7f3dd410dbd0 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7f3dbc010440 tx=0x7f3dbc0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.605+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/2506681304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd410f290 0x7f3dd410dbd0 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7f3dbc010440 tx=0x7f3dbc0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.605+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/2506681304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd410f290 0x7f3dd410dbd0 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7f3dbc010440 tx=0x7f3dbc0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.605+0000 7f3dcbfff700 1 -- 172.21.15.80:0/2506681304 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dbc000940 con 0x7f3dd410f290 2019-11-28T11:45:27.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.605+0000 7f3dcbfff700 1 -- 172.21.15.80:0/2506681304 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc000f50 con 0x7f3dd410f290 2019-11-28T11:45:27.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.605+0000 7f3dd91ee700 1 -- 172.21.15.80:0/2506681304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd410c810 con 0x7f3dd410f290 2019-11-28T11:45:27.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.605+0000 7f3dcbfff700 1 -- 172.21.15.80:0/2506681304 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dbc0015a0 con 0x7f3dd410f290 2019-11-28T11:45:27.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.605+0000 7f3dd91ee700 1 -- 172.21.15.80:0/2506681304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd410c490 con 0x7f3dd410f290 2019-11-28T11:45:27.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.605+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/2506681304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd410f290 0x7f3dd410dbd0 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7f3dbc010440 tx=0x7f3dbc0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.605+0000 7f3dcbfff700 1 -- 172.21.15.80:0/2506681304 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3dbc001140 con 0x7f3dd410f290 2019-11-28T11:45:27.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.605+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/2506681304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd410f290 0x7f3dd410dbd0 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7f3dbc010440 tx=0x7f3dbc0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.606+0000 7f3dcbfff700 1 --2- 172.21.15.80:0/2506681304 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3dac018730 0x7f3dac01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:27.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.606+0000 7f3dcbfff700 1 -- 172.21.15.80:0/2506681304 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f3dbc031a60 con 0x7f3dd410f290 2019-11-28T11:45:27.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.606+0000 7f3dd359e700 1 --2- 172.21.15.80:0/2506681304 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3dac018730 0x7f3dac01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:27.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.606+0000 7f3dd359e700 1 --2- 172.21.15.80:0/2506681304 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3dac018730 0x7f3dac01abc0 crc :-1 s=READY pgs=725 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:27.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.613+0000 7f3dd91ee700 1 -- 172.21.15.80:0/2506681304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd410c810 con 0x7f3dd410f290 2019-11-28T11:45:27.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.617+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/2506681304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd410f290 0x7f3dd410dbd0 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7f3dbc010440 tx=0x7f3dbc0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.617+0000 7f3dcbfff700 1 -- 172.21.15.80:0/2506681304 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3dbc02dff0 con 0x7f3dd410f290 2019-11-28T11:45:27.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.783+0000 7f3dd91ee700 1 -- 172.21.15.80:0/2506681304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f3dd410c490 con 0x7f3dd410f290 2019-11-28T11:45:27.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.783+0000 7f3dd2d9d700 1 --2- 172.21.15.80:0/2506681304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd410f290 0x7f3dd410dbd0 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7f3dbc010440 tx=0x7f3dbc0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.783+0000 7f3dcbfff700 1 -- 172.21.15.80:0/2506681304 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v137) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3dbc02dff0 con 0x7f3dd410f290 2019-11-28T11:45:27.824 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:45:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.786+0000 7f3dd91ee700 1 -- 172.21.15.80:0/2506681304 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3dac018730 msgr2=0x7f3dac01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.786+0000 7f3dd91ee700 1 --2- 172.21.15.80:0/2506681304 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3dac018730 0x7f3dac01abc0 crc :-1 s=READY pgs=725 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.786+0000 7f3dd91ee700 1 -- 172.21.15.80:0/2506681304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd410f290 msgr2=0x7f3dd410dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.786+0000 7f3dd91ee700 1 --2- 172.21.15.80:0/2506681304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd410f290 0x7f3dd410dbd0 secure :-1 s=READY pgs=1786 cs=0 l=1 rx=0x7f3dbc010440 tx=0x7f3dbc0107e0).stop 2019-11-28T11:45:27.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.786+0000 7f3dd91ee700 1 -- 172.21.15.80:0/2506681304 shutdown_connections 2019-11-28T11:45:27.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.786+0000 7f3dd91ee700 1 --2- 172.21.15.80:0/2506681304 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3dac018730 0x7f3dac01abc0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:27.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.786+0000 7f3dd91ee700 1 --2- 172.21.15.80:0/2506681304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3dd410f290 0x7f3dd410dbd0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:27.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.786+0000 7f3dd91ee700 1 --2- 172.21.15.80:0/2506681304 >> v2:172.21.15.174:3300/0 conn(0x7f3dd4148320 0x7f3dd410ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:27.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.786+0000 7f3dd91ee700 1 -- 172.21.15.80:0/2506681304 shutdown_connections 2019-11-28T11:45:27.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.786+0000 7f3dd91ee700 1 -- 172.21.15.80:0/2506681304 wait complete. 2019-11-28T11:45:27.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.786+0000 7f3dd91ee700 1 -- 172.21.15.80:0/2506681304 >> 172.21.15.80:0/2506681304 conn(0x7f3dd415e2d0 msgr2=0x7f3dd4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:27.837 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:45:27.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.916+0000 7f3af8413700 1 Processor -- start 2019-11-28T11:45:27.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.916+0000 7f3af8413700 1 -- start start 2019-11-28T11:45:27.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.917+0000 7f3af8413700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3af006c0a0 0x7f3af0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:27.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.917+0000 7f3af8413700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3af0072620 0x7f3af0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:27.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.917+0000 7f3af8413700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af006db00 con 0x7f3af00734e0 2019-11-28T11:45:27.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.917+0000 7f3af8413700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af006fd60 con 0x7f3af006c0a0 2019-11-28T11:45:27.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.917+0000 7f3af8413700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af0070030 con 0x7f3af0072620 2019-11-28T11:45:27.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.917+0000 7f3af69b0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3af006c0a0 0x7f3af0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:27.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.917+0000 7f3af61af700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3af00734e0 0x7f3af0071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39854/0 (socket says 172.21.15.80:39854) 2019-11-28T11:45:27.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.917+0000 7f3af61af700 1 -- 172.21.15.80:0/2354267034 learned_addr learned my addr 172.21.15.80:0/2354267034 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:27.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.917+0000 7f3af71b1700 1 --2- 172.21.15.80:0/2354267034 >> v2:172.21.15.174:3300/0 conn(0x7f3af0072620 0x7f3af0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:27.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.918+0000 7f3af69b0700 1 -- 172.21.15.80:0/2354267034 >> v2:172.21.15.174:3300/0 conn(0x7f3af0072620 msgr2=0x7f3af0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:27.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.918+0000 7f3af69b0700 1 --2- 172.21.15.80:0/2354267034 >> v2:172.21.15.174:3300/0 conn(0x7f3af0072620 0x7f3af0164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:27.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.918+0000 7f3af69b0700 1 -- 172.21.15.80:0/2354267034 >> v1:172.21.15.80:6789/0 conn(0x7f3af00734e0 legacy=0x7f3af0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.918+0000 7f3af69b0700 1 -- 172.21.15.80:0/2354267034 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af00706c0 con 0x7f3af006c0a0 2019-11-28T11:45:27.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.918+0000 7f3af59ae700 1 -- 172.21.15.80:0/2354267034 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598291948 0 0) 0x7f3ae00014d0 con 0x7f3af00734e0 2019-11-28T11:45:27.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.918+0000 7f3af69b0700 1 --2- 172.21.15.80:0/2354267034 >> v2:172.21.15.80:3300/0 conn(0x7f3af006c0a0 0x7f3af0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3ad800af50 tx=0x7f3ad800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.918+0000 7f3af69b0700 1 --2- 172.21.15.80:0/2354267034 >> v2:172.21.15.80:3300/0 conn(0x7f3af006c0a0 0x7f3af0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3ad800af50 tx=0x7f3ad800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.918+0000 7f3af69b0700 1 --2- 172.21.15.80:0/2354267034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af006c0a0 0x7f3af0072fa0 secure :-1 s=READY pgs=1788 cs=0 l=1 rx=0x7f3ad800af50 tx=0x7f3ad800b6e0).ready entity=mon.0 client_cookie=c8af9ef4e11eb02a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:27.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.918+0000 7f3af69b0700 1 --2- 172.21.15.80:0/2354267034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af006c0a0 0x7f3af0072fa0 secure :-1 s=THROTTLE_DONE pgs=1788 cs=0 l=1 rx=0x7f3ad800af50 tx=0x7f3ad800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.918+0000 7f3af59ae700 1 -- 172.21.15.80:0/2354267034 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ad8007210 con 0x7f3af006c0a0 2019-11-28T11:45:27.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.918+0000 7f3af69b0700 1 --2- 172.21.15.80:0/2354267034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af006c0a0 0x7f3af0072fa0 secure :-1 s=THROTTLE_DONE pgs=1788 cs=0 l=1 rx=0x7f3ad800af50 tx=0x7f3ad800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.918+0000 7f3af69b0700 1 --2- 172.21.15.80:0/2354267034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af006c0a0 0x7f3af0072fa0 secure :-1 s=THROTTLE_DONE pgs=1788 cs=0 l=1 rx=0x7f3ad800af50 tx=0x7f3ad800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.918+0000 7f3af59ae700 1 -- 172.21.15.80:0/2354267034 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad80099b0 con 0x7f3af006c0a0 2019-11-28T11:45:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.918+0000 7f3af59ae700 1 -- 172.21.15.80:0/2354267034 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ad800a080 con 0x7f3af006c0a0 2019-11-28T11:45:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.918+0000 7f3af8413700 1 -- 172.21.15.80:0/2354267034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af006c0a0 msgr2=0x7f3af0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.918+0000 7f3af8413700 1 --2- 172.21.15.80:0/2354267034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af006c0a0 0x7f3af0072fa0 secure :-1 s=READY pgs=1788 cs=0 l=1 rx=0x7f3ad800af50 tx=0x7f3ad800b6e0).stop 2019-11-28T11:45:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.919+0000 7f3af8413700 1 -- 172.21.15.80:0/2354267034 shutdown_connections 2019-11-28T11:45:27.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.919+0000 7f3af8413700 1 --2- 172.21.15.80:0/2354267034 >> v2:172.21.15.174:3300/0 conn(0x7f3af0072620 0x7f3af0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:27.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.919+0000 7f3af8413700 1 --2- 172.21.15.80:0/2354267034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af006c0a0 0x7f3af0072fa0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:27.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.919+0000 7f3af8413700 1 -- 172.21.15.80:0/2354267034 shutdown_connections 2019-11-28T11:45:27.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.919+0000 7f3af8413700 1 -- 172.21.15.80:0/2354267034 wait complete. 2019-11-28T11:45:27.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.919+0000 7f3af8413700 1 -- 172.21.15.80:0/2354267034 >> 172.21.15.80:0/2354267034 conn(0x7f3af0061cf0 msgr2=0x7f3af0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:27.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.921+0000 7f3af8413700 1 Processor -- start 2019-11-28T11:45:27.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.921+0000 7f3af8413700 1 -- start start 2019-11-28T11:45:27.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.922+0000 7f3af8413700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3af010d6c0 0x7f3af010c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:27.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.922+0000 7f3af8413700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af01066e0 con 0x7f3af013e300 2019-11-28T11:45:27.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.922+0000 7f3af8413700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af010d280 con 0x7f3af010db50 2019-11-28T11:45:27.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.922+0000 7f3af8413700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af010a4a0 con 0x7f3af010d6c0 2019-11-28T11:45:27.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.922+0000 7f3af69b0700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3af013e300 0x7f3af013e6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39856/0 (socket says 172.21.15.80:39856) 2019-11-28T11:45:27.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.922+0000 7f3af69b0700 1 -- 172.21.15.80:0/3155679964 learned_addr learned my addr 172.21.15.80:0/3155679964 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:27.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.922+0000 7f3af61af700 1 --2- 172.21.15.80:0/3155679964 >> v2:172.21.15.174:3300/0 conn(0x7f3af010d6c0 0x7f3af010c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:27.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.922+0000 7f3aef7fe700 1 -- 172.21.15.80:0/3155679964 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747461034 0 0) 0x7f3ad800ac20 con 0x7f3af013e300 2019-11-28T11:45:27.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.922+0000 7f3aef7fe700 1 -- 172.21.15.80:0/3155679964 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ad4002e80 con 0x7f3af013e300 2019-11-28T11:45:27.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.922+0000 7f3aef7fe700 1 -- 172.21.15.80:0/3155679964 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1128177276 0 0) 0x7f3ad8000940 con 0x7f3af013e300 2019-11-28T11:45:27.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.922+0000 7f3af61af700 1 -- 172.21.15.80:0/3155679964 >> v1:172.21.15.174:6789/0 conn(0x7f3af010db50 legacy=0x7f3af010ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.922+0000 7f3af61af700 1 -- 172.21.15.80:0/3155679964 >> v1:172.21.15.80:6789/0 conn(0x7f3af013e300 legacy=0x7f3af013e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:27.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.923+0000 7f3af61af700 1 -- 172.21.15.80:0/3155679964 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af010ae00 con 0x7f3af010d6c0 2019-11-28T11:45:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.923+0000 7f3af61af700 1 --2- 172.21.15.80:0/3155679964 >> v2:172.21.15.174:3300/0 conn(0x7f3af010d6c0 0x7f3af010c540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ae00106f0 tx=0x7f3ae0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.923+0000 7f3af61af700 1 --2- 172.21.15.80:0/3155679964 >> v2:172.21.15.174:3300/0 conn(0x7f3af010d6c0 0x7f3af010c540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ae00106f0 tx=0x7f3ae0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.923+0000 7f3af61af700 1 --2- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af010d6c0 0x7f3af010c540 secure :-1 s=READY pgs=1041 cs=0 l=1 rx=0x7f3ae00106f0 tx=0x7f3ae0010a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.923+0000 7f3af61af700 1 --2- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af010d6c0 0x7f3af010c540 secure :-1 s=THROTTLE_DONE pgs=1041 cs=0 l=1 rx=0x7f3ae00106f0 tx=0x7f3ae0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.923+0000 7f3aef7fe700 1 -- 172.21.15.80:0/3155679964 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ae0001250 con 0x7f3af010d6c0 2019-11-28T11:45:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.923+0000 7f3af61af700 1 --2- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af010d6c0 0x7f3af010c540 secure :-1 s=THROTTLE_DONE pgs=1041 cs=0 l=1 rx=0x7f3ae00106f0 tx=0x7f3ae0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.923+0000 7f3af61af700 1 --2- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af010d6c0 0x7f3af010c540 secure :-1 s=THROTTLE_DONE pgs=1041 cs=0 l=1 rx=0x7f3ae00106f0 tx=0x7f3ae0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.923+0000 7f3aef7fe700 1 -- 172.21.15.80:0/3155679964 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae00045c0 con 0x7f3af010d6c0 2019-11-28T11:45:27.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.923+0000 7f3af8413700 1 -- 172.21.15.80:0/3155679964 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af010b180 con 0x7f3af010d6c0 2019-11-28T11:45:27.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.923+0000 7f3aef7fe700 1 -- 172.21.15.80:0/3155679964 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ae0001580 con 0x7f3af010d6c0 2019-11-28T11:45:27.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.923+0000 7f3af8413700 1 -- 172.21.15.80:0/3155679964 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af010ae00 con 0x7f3af010d6c0 2019-11-28T11:45:27.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.923+0000 7f3af61af700 1 --2- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af010d6c0 0x7f3af010c540 secure :-1 s=THROTTLE_DONE pgs=1041 cs=0 l=1 rx=0x7f3ae00106f0 tx=0x7f3ae0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.923+0000 7f3aef7fe700 1 -- 172.21.15.80:0/3155679964 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3ae00047b0 con 0x7f3af010d6c0 2019-11-28T11:45:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.923+0000 7f3af61af700 1 --2- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af010d6c0 0x7f3af010c540 secure :-1 s=THROTTLE_DONE pgs=1041 cs=0 l=1 rx=0x7f3ae00106f0 tx=0x7f3ae0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.924+0000 7f3aef7fe700 1 --2- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ad4018780 0x7f3ad401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.924+0000 7f3aef7fe700 1 -- 172.21.15.80:0/3155679964 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f3ae0031e00 con 0x7f3af010d6c0 2019-11-28T11:45:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.924+0000 7f3af69b0700 1 --2- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ad4018780 0x7f3ad401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:27.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.924+0000 7f3af69b0700 1 --2- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ad4018780 0x7f3ad401abf0 crc :-1 s=READY pgs=726 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:27.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.931+0000 7f3af8413700 1 -- 172.21.15.80:0/3155679964 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af010b180 con 0x7f3af010d6c0 2019-11-28T11:45:27.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.935+0000 7f3af61af700 1 --2- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af010d6c0 0x7f3af010c540 secure :-1 s=THROTTLE_DONE pgs=1041 cs=0 l=1 rx=0x7f3ae00106f0 tx=0x7f3ae0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:27.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:27.935+0000 7f3aef7fe700 1 -- 172.21.15.80:0/3155679964 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3ae0001010 con 0x7f3af010d6c0 2019-11-28T11:45:28.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.097+0000 7f3af8413700 1 -- 172.21.15.80:0/3155679964 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3af010ae00 con 0x7f3af010d6c0 2019-11-28T11:45:28.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.098+0000 7f3af61af700 1 --2- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af010d6c0 0x7f3af010c540 secure :-1 s=THROTTLE_DONE pgs=1041 cs=0 l=1 rx=0x7f3ae00106f0 tx=0x7f3ae0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.098+0000 7f3aef7fe700 1 -- 172.21.15.80:0/3155679964 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v137) v1 ==== 84+0+64 (secure 0 0 0) 0x7f3ae00047b0 con 0x7f3af010d6c0 2019-11-28T11:45:28.139 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:28.140 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:45:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:45:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:45:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:45:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:45:28.140 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:45:28.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.100+0000 7f3af8413700 1 -- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ad4018780 msgr2=0x7f3ad401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:28.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.101+0000 7f3af8413700 1 --2- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ad4018780 0x7f3ad401abf0 crc :-1 s=READY pgs=726 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:28.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.101+0000 7f3af8413700 1 -- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af010d6c0 msgr2=0x7f3af010c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:28.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.101+0000 7f3af8413700 1 --2- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af010d6c0 0x7f3af010c540 secure :-1 s=READY pgs=1041 cs=0 l=1 rx=0x7f3ae00106f0 tx=0x7f3ae0010a90).stop 2019-11-28T11:45:28.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.101+0000 7f3af8413700 1 -- 172.21.15.80:0/3155679964 shutdown_connections 2019-11-28T11:45:28.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.101+0000 7f3af8413700 1 --2- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ad4018780 0x7f3ad401abf0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:28.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.101+0000 7f3af8413700 1 --2- 172.21.15.80:0/3155679964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af010d6c0 0x7f3af010c540 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:28.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.101+0000 7f3af8413700 1 -- 172.21.15.80:0/3155679964 shutdown_connections 2019-11-28T11:45:28.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.101+0000 7f3af8413700 1 -- 172.21.15.80:0/3155679964 wait complete. 2019-11-28T11:45:28.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.101+0000 7f3af8413700 1 -- 172.21.15.80:0/3155679964 >> 172.21.15.80:0/3155679964 conn(0x7f3af013d620 msgr2=0x7f3af013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:28.151 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:45:28.151 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:45:28.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.235+0000 7fa018b10700 1 Processor -- start 2019-11-28T11:45:28.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.235+0000 7fa018b10700 1 -- start start 2019-11-28T11:45:28.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa018b10700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa01415ed10 0x7fa01415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:28.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa018b10700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa014073020 0x7fa014071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:28.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa018b10700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01406db60 con 0x7fa0140734b0 2019-11-28T11:45:28.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa018b10700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01406f3d0 con 0x7fa014073020 2019-11-28T11:45:28.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa018b10700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01406fe00 con 0x7fa01415ed10 2019-11-28T11:45:28.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa01259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa014073020 0x7fa014071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:28.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa01259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa014073020 0x7fa014071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40552/0 (socket says 172.21.15.80:40552) 2019-11-28T11:45:28.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa01259c700 1 -- 172.21.15.80:0/857265360 learned_addr learned my addr 172.21.15.80:0/857265360 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:28.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa01359e700 1 --1- 172.21.15.80:0/857265360 >> v1:172.21.15.80:6789/0 conn(0x7fa0140734b0 0x7fa0140723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39866/0 (socket says 172.21.15.80:39866) 2019-11-28T11:45:28.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa012d9d700 1 --2- 172.21.15.80:0/857265360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa01415ed10 0x7fa01415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:28.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa01259c700 1 -- 172.21.15.80:0/857265360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa01415ed10 msgr2=0x7fa01415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:28.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa01259c700 1 --2- 172.21.15.80:0/857265360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa01415ed10 0x7fa01415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:28.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa01259c700 1 -- 172.21.15.80:0/857265360 >> v1:172.21.15.80:6789/0 conn(0x7fa0140734b0 legacy=0x7fa0140723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:28.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa01259c700 1 -- 172.21.15.80:0/857265360 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa014070760 con 0x7fa014073020 2019-11-28T11:45:28.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa011d9b700 1 -- 172.21.15.80:0/857265360 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339153405 0 0) 0x7fa0040009b0 con 0x7fa0140734b0 2019-11-28T11:45:28.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa01259c700 1 --2- 172.21.15.80:0/857265360 >> v2:172.21.15.80:3300/0 conn(0x7fa014073020 0x7fa014071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9ffc00f6c0 tx=0x7f9ffc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa01259c700 1 --2- 172.21.15.80:0/857265360 >> v2:172.21.15.80:3300/0 conn(0x7fa014073020 0x7fa014071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9ffc00f6c0 tx=0x7f9ffc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.236+0000 7fa01259c700 1 --2- 172.21.15.80:0/857265360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa014073020 0x7fa014071ea0 secure :-1 s=READY pgs=1791 cs=0 l=1 rx=0x7f9ffc00f6c0 tx=0x7f9ffc00fa60).ready entity=mon.0 client_cookie=22598ff6c28f6749 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:28.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.237+0000 7fa01259c700 1 --2- 172.21.15.80:0/857265360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa014073020 0x7fa014071ea0 secure :-1 s=THROTTLE_DONE pgs=1791 cs=0 l=1 rx=0x7f9ffc00f6c0 tx=0x7f9ffc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.237+0000 7fa011d9b700 1 -- 172.21.15.80:0/857265360 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ffc000960 con 0x7fa014073020 2019-11-28T11:45:28.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.237+0000 7fa01259c700 1 --2- 172.21.15.80:0/857265360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa014073020 0x7fa014071ea0 secure :-1 s=THROTTLE_DONE pgs=1791 cs=0 l=1 rx=0x7f9ffc00f6c0 tx=0x7f9ffc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.237+0000 7fa01259c700 1 --2- 172.21.15.80:0/857265360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa014073020 0x7fa014071ea0 secure :-1 s=THROTTLE_DONE pgs=1791 cs=0 l=1 rx=0x7f9ffc00f6c0 tx=0x7f9ffc00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.237+0000 7fa011d9b700 1 -- 172.21.15.80:0/857265360 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc000c90 con 0x7fa014073020 2019-11-28T11:45:28.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.237+0000 7fa011d9b700 1 -- 172.21.15.80:0/857265360 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ffc0013a0 con 0x7fa014073020 2019-11-28T11:45:28.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.237+0000 7fa018b10700 1 -- 172.21.15.80:0/857265360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa014073020 msgr2=0x7fa014071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:28.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.237+0000 7fa018b10700 1 --2- 172.21.15.80:0/857265360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa014073020 0x7fa014071ea0 secure :-1 s=READY pgs=1791 cs=0 l=1 rx=0x7f9ffc00f6c0 tx=0x7f9ffc00fa60).stop 2019-11-28T11:45:28.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.237+0000 7fa018b10700 1 -- 172.21.15.80:0/857265360 shutdown_connections 2019-11-28T11:45:28.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.237+0000 7fa018b10700 1 --2- 172.21.15.80:0/857265360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa014073020 0x7fa014071ea0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:28.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.237+0000 7fa018b10700 1 --2- 172.21.15.80:0/857265360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa01415ed10 0x7fa01415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:28.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.237+0000 7fa018b10700 1 -- 172.21.15.80:0/857265360 shutdown_connections 2019-11-28T11:45:28.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.237+0000 7fa018b10700 1 -- 172.21.15.80:0/857265360 wait complete. 2019-11-28T11:45:28.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.237+0000 7fa018b10700 1 -- 172.21.15.80:0/857265360 >> 172.21.15.80:0/857265360 conn(0x7fa014061d20 msgr2=0x7fa0140641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:28.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.240+0000 7fa018b10700 1 Processor -- start 2019-11-28T11:45:28.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.240+0000 7fa018b10700 1 -- start start 2019-11-28T11:45:28.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa018b10700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0141079b0 0x7fa014107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:28.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa018b10700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa014108380 0x7fa014168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:28.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa018b10700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0141087d0 con 0x7fa014148320 2019-11-28T11:45:28.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa018b10700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01413aa20 con 0x7fa014108380 2019-11-28T11:45:28.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa018b10700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01413acf0 con 0x7fa0141079b0 2019-11-28T11:45:28.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa012d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa014148320 0x7fa01410ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39870/0 (socket says 172.21.15.80:39870) 2019-11-28T11:45:28.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa012d9d700 1 -- 172.21.15.80:0/3707785063 learned_addr learned my addr 172.21.15.80:0/3707785063 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:28.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa01259c700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0141079b0 0x7fa014107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:28.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa01359e700 1 --2- 172.21.15.80:0/3707785063 >> v2:172.21.15.174:3300/0 conn(0x7fa014108380 0x7fa014168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:28.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa00b7fe700 1 -- 172.21.15.80:0/3707785063 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698663969 0 0) 0x7fa00c001430 con 0x7fa014148320 2019-11-28T11:45:28.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa00b7fe700 1 -- 172.21.15.80:0/3707785063 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fec002e80 con 0x7fa014148320 2019-11-28T11:45:28.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa01359e700 1 -- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0141079b0 msgr2=0x7fa014107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:28.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa01359e700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0141079b0 0x7fa014107e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:28.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa01359e700 1 -- 172.21.15.80:0/3707785063 >> v1:172.21.15.80:6789/0 conn(0x7fa014148320 legacy=0x7fa01410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:28.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa01359e700 1 -- 172.21.15.80:0/3707785063 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01410c490 con 0x7fa014108380 2019-11-28T11:45:28.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa01259c700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0141079b0 0x7fa014107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:28.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa01359e700 1 --2- 172.21.15.80:0/3707785063 >> v2:172.21.15.174:3300/0 conn(0x7fa014108380 0x7fa014168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa004010380 tx=0x7fa004010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa01359e700 1 --2- 172.21.15.80:0/3707785063 >> v2:172.21.15.174:3300/0 conn(0x7fa014108380 0x7fa014168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa004010380 tx=0x7fa004010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.241+0000 7fa01359e700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa014108380 0x7fa014168d80 secure :-1 s=READY pgs=1042 cs=0 l=1 rx=0x7fa004010380 tx=0x7fa004010720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:28.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.242+0000 7fa01359e700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa014108380 0x7fa014168d80 secure :-1 s=THROTTLE_DONE pgs=1042 cs=0 l=1 rx=0x7fa004010380 tx=0x7fa004010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.242+0000 7fa00b7fe700 1 -- 172.21.15.80:0/3707785063 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa004000940 con 0x7fa014108380 2019-11-28T11:45:28.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.242+0000 7fa01359e700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa014108380 0x7fa014168d80 secure :-1 s=THROTTLE_DONE pgs=1042 cs=0 l=1 rx=0x7fa004010380 tx=0x7fa004010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.242+0000 7fa00b7fe700 1 -- 172.21.15.80:0/3707785063 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa004001380 con 0x7fa014108380 2019-11-28T11:45:28.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.242+0000 7fa01359e700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa014108380 0x7fa014168d80 secure :-1 s=THROTTLE_DONE pgs=1042 cs=0 l=1 rx=0x7fa004010380 tx=0x7fa004010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.242+0000 7fa018b10700 1 -- 172.21.15.80:0/3707785063 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01410c810 con 0x7fa014108380 2019-11-28T11:45:28.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.242+0000 7fa00b7fe700 1 -- 172.21.15.80:0/3707785063 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa004001570 con 0x7fa014108380 2019-11-28T11:45:28.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.242+0000 7fa018b10700 1 -- 172.21.15.80:0/3707785063 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01410c490 con 0x7fa014108380 2019-11-28T11:45:28.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.242+0000 7fa01359e700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa014108380 0x7fa014168d80 secure :-1 s=THROTTLE_DONE pgs=1042 cs=0 l=1 rx=0x7fa004010380 tx=0x7fa004010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.242+0000 7fa00b7fe700 1 -- 172.21.15.80:0/3707785063 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa004000ef0 con 0x7fa014108380 2019-11-28T11:45:28.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.242+0000 7fa01359e700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa014108380 0x7fa014168d80 secure :-1 s=THROTTLE_DONE pgs=1042 cs=0 l=1 rx=0x7fa004010380 tx=0x7fa004010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.242+0000 7fa00b7fe700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9fec018770 0x7f9fec01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:28.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.242+0000 7fa00b7fe700 1 -- 172.21.15.80:0/3707785063 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fa004031990 con 0x7fa014108380 2019-11-28T11:45:28.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.242+0000 7fa012d9d700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9fec018770 0x7f9fec01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:28.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.243+0000 7fa012d9d700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9fec018770 0x7f9fec01abe0 crc :-1 s=READY pgs=727 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:28.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.250+0000 7fa018b10700 1 -- 172.21.15.80:0/3707785063 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01410c810 con 0x7fa014108380 2019-11-28T11:45:28.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.254+0000 7fa01359e700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa014108380 0x7fa014168d80 secure :-1 s=THROTTLE_DONE pgs=1042 cs=0 l=1 rx=0x7fa004010380 tx=0x7fa004010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.254+0000 7fa00b7fe700 1 -- 172.21.15.80:0/3707785063 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa004001570 con 0x7fa014108380 2019-11-28T11:45:28.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.423+0000 7fa018b10700 1 -- 172.21.15.80:0/3707785063 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7fa01410c490 con 0x7fa014108380 2019-11-28T11:45:28.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.779+0000 7fa01359e700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa014108380 0x7fa014168d80 secure :-1 s=THROTTLE_DONE pgs=1042 cs=0 l=1 rx=0x7fa004010380 tx=0x7fa004010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.779+0000 7fa00b7fe700 1 -- 172.21.15.80:0/3707785063 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v138) v1 ==== 133+0+0 (secure 0 0 0) 0x7fa004000ef0 con 0x7fa014108380 2019-11-28T11:45:28.827 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:45:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.789+0000 7fa018b10700 1 -- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9fec018770 msgr2=0x7f9fec01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.789+0000 7fa018b10700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9fec018770 0x7f9fec01abe0 crc :-1 s=READY pgs=727 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.789+0000 7fa018b10700 1 -- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa014108380 msgr2=0x7fa014168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.789+0000 7fa018b10700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa014108380 0x7fa014168d80 secure :-1 s=READY pgs=1042 cs=0 l=1 rx=0x7fa004010380 tx=0x7fa004010720).stop 2019-11-28T11:45:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.789+0000 7fa018b10700 1 -- 172.21.15.80:0/3707785063 shutdown_connections 2019-11-28T11:45:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.789+0000 7fa018b10700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9fec018770 0x7f9fec01abe0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.789+0000 7fa018b10700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa014108380 0x7fa014168d80 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.789+0000 7fa018b10700 1 --2- 172.21.15.80:0/3707785063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0141079b0 0x7fa014107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.789+0000 7fa018b10700 1 -- 172.21.15.80:0/3707785063 shutdown_connections 2019-11-28T11:45:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.789+0000 7fa018b10700 1 -- 172.21.15.80:0/3707785063 wait complete. 2019-11-28T11:45:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.789+0000 7fa018b10700 1 -- 172.21.15.80:0/3707785063 >> 172.21.15.80:0/3707785063 conn(0x7fa01415e2d0 msgr2=0x7fa014147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:28.841 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:45:28.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.925+0000 7f4a925cc700 1 Processor -- start 2019-11-28T11:45:28.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.925+0000 7f4a925cc700 1 -- start start 2019-11-28T11:45:28.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.926+0000 7f4a925cc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4a8c15f100 0x7f4a8c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:28.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.926+0000 7f4a925cc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a8c06c2f0 0x7f4a8c06c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:28.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.926+0000 7f4a925cc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a8c06db60 con 0x7f4a8c15ed10 2019-11-28T11:45:28.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.926+0000 7f4a925cc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a8c06fe00 con 0x7f4a8c15f100 2019-11-28T11:45:28.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.926+0000 7f4a925cc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8c0700d0 con 0x7f4a8c06c2f0 2019-11-28T11:45:28.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.926+0000 7f4a8bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4a8c15f100 0x7f4a8c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:28.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.926+0000 7f4a8bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4a8c15f100 0x7f4a8c06bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40564/0 (socket says 172.21.15.80:40564) 2019-11-28T11:45:28.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.926+0000 7f4a8bfff700 1 -- 172.21.15.80:0/510398725 learned_addr learned my addr 172.21.15.80:0/510398725 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:28.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.926+0000 7f4a9136a700 1 --2- 172.21.15.80:0/510398725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a8c06c2f0 0x7f4a8c06c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:28.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.927+0000 7f4a8bfff700 1 -- 172.21.15.80:0/510398725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a8c06c2f0 msgr2=0x7f4a8c06c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:28.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.927+0000 7f4a8bfff700 1 --2- 172.21.15.80:0/510398725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a8c06c2f0 0x7f4a8c06c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:28.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.927+0000 7f4a8bfff700 1 -- 172.21.15.80:0/510398725 >> v1:172.21.15.80:6789/0 conn(0x7f4a8c15ed10 legacy=0x7f4a8c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:28.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.927+0000 7f4a8bfff700 1 -- 172.21.15.80:0/510398725 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8c070760 con 0x7f4a8c15f100 2019-11-28T11:45:28.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.927+0000 7f4a8b7fe700 1 -- 172.21.15.80:0/510398725 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965816126 0 0) 0x7f4a74001100 con 0x7f4a8c15ed10 2019-11-28T11:45:28.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.927+0000 7f4a8bfff700 1 --2- 172.21.15.80:0/510398725 >> v2:172.21.15.80:3300/0 conn(0x7f4a8c15f100 0x7f4a8c06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4a7c00fa40 tx=0x7f4a7c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.927+0000 7f4a8bfff700 1 --2- 172.21.15.80:0/510398725 >> v2:172.21.15.80:3300/0 conn(0x7f4a8c15f100 0x7f4a8c06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4a7c00fa40 tx=0x7f4a7c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.927+0000 7f4a8bfff700 1 --2- 172.21.15.80:0/510398725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a8c15f100 0x7f4a8c06bdb0 secure :-1 s=READY pgs=1794 cs=0 l=1 rx=0x7f4a7c00fa40 tx=0x7f4a7c00fde0).ready entity=mon.0 client_cookie=3269a4cf21e047d8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:28.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.927+0000 7f4a8bfff700 1 --2- 172.21.15.80:0/510398725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a8c15f100 0x7f4a8c06bdb0 secure :-1 s=THROTTLE_DONE pgs=1794 cs=0 l=1 rx=0x7f4a7c00fa40 tx=0x7f4a7c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.927+0000 7f4a8b7fe700 1 -- 172.21.15.80:0/510398725 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a7c000ce0 con 0x7f4a8c15f100 2019-11-28T11:45:28.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.927+0000 7f4a8bfff700 1 --2- 172.21.15.80:0/510398725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a8c15f100 0x7f4a8c06bdb0 secure :-1 s=THROTTLE_DONE pgs=1794 cs=0 l=1 rx=0x7f4a7c00fa40 tx=0x7f4a7c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.927+0000 7f4a8bfff700 1 --2- 172.21.15.80:0/510398725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a8c15f100 0x7f4a8c06bdb0 secure :-1 s=THROTTLE_DONE pgs=1794 cs=0 l=1 rx=0x7f4a7c00fa40 tx=0x7f4a7c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.927+0000 7f4a8b7fe700 1 -- 172.21.15.80:0/510398725 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7c001010 con 0x7f4a8c15f100 2019-11-28T11:45:28.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.927+0000 7f4a8b7fe700 1 -- 172.21.15.80:0/510398725 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a7c000ce0 con 0x7f4a8c15f100 2019-11-28T11:45:28.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.927+0000 7f4a925cc700 1 -- 172.21.15.80:0/510398725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a8c15f100 msgr2=0x7f4a8c06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:28.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.927+0000 7f4a925cc700 1 --2- 172.21.15.80:0/510398725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a8c15f100 0x7f4a8c06bdb0 secure :-1 s=READY pgs=1794 cs=0 l=1 rx=0x7f4a7c00fa40 tx=0x7f4a7c00fde0).stop 2019-11-28T11:45:28.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.928+0000 7f4a925cc700 1 -- 172.21.15.80:0/510398725 shutdown_connections 2019-11-28T11:45:28.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.928+0000 7f4a925cc700 1 --2- 172.21.15.80:0/510398725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a8c06c2f0 0x7f4a8c06c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:28.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.928+0000 7f4a925cc700 1 --2- 172.21.15.80:0/510398725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4a8c15f100 0x7f4a8c06bdb0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:28.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.928+0000 7f4a925cc700 1 -- 172.21.15.80:0/510398725 shutdown_connections 2019-11-28T11:45:28.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.928+0000 7f4a925cc700 1 -- 172.21.15.80:0/510398725 wait complete. 2019-11-28T11:45:28.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.928+0000 7f4a925cc700 1 -- 172.21.15.80:0/510398725 >> 172.21.15.80:0/510398725 conn(0x7f4a8c061d20 msgr2=0x7f4a8c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:28.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.930+0000 7f4a925cc700 1 Processor -- start 2019-11-28T11:45:28.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.930+0000 7f4a925cc700 1 -- start start 2019-11-28T11:45:28.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.931+0000 7f4a925cc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a8c1079b0 0x7f4a8c107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:28.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.931+0000 7f4a925cc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4a8c108380 0x7f4a8c168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:28.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.931+0000 7f4a925cc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a8c1087d0 con 0x7f4a8c148320 2019-11-28T11:45:28.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.931+0000 7f4a925cc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a8c13aa20 con 0x7f4a8c108380 2019-11-28T11:45:28.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.931+0000 7f4a925cc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8c13acf0 con 0x7f4a8c1079b0 2019-11-28T11:45:28.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.931+0000 7f4a9136a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4a8c108380 0x7f4a8c168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:28.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.931+0000 7f4a8bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a8c1079b0 0x7f4a8c107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:28.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.931+0000 7f4a8bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a8c1079b0 0x7f4a8c107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:42830/0 (socket says 172.21.15.80:42830) 2019-11-28T11:45:28.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.931+0000 7f4a9136a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4a8c108380 0x7f4a8c168d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:55458/0 (socket says 172.21.15.80:55458) 2019-11-28T11:45:28.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.931+0000 7f4a8bfff700 1 -- 172.21.15.80:0/352565776 learned_addr learned my addr 172.21.15.80:0/352565776 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:28.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a897fa700 1 -- 172.21.15.80:0/352565776 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507012629 0 0) 0x7f4a74000f40 con 0x7f4a8c148320 2019-11-28T11:45:28.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a897fa700 1 -- 172.21.15.80:0/352565776 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a70002e80 con 0x7f4a8c148320 2019-11-28T11:45:28.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a9136a700 1 -- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a8c1079b0 msgr2=0x7f4a8c107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:28.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a9136a700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a8c1079b0 0x7f4a8c107e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:28.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a9136a700 1 -- 172.21.15.80:0/352565776 >> v1:172.21.15.174:6789/0 conn(0x7f4a8c148320 legacy=0x7f4a8c10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:28.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a9136a700 1 -- 172.21.15.80:0/352565776 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8c10c490 con 0x7f4a8c108380 2019-11-28T11:45:28.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a8bfff700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a8c1079b0 0x7f4a8c107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:28.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a9136a700 1 --2- 172.21.15.80:0/352565776 >> v2:172.21.15.174:3300/0 conn(0x7f4a8c108380 0x7f4a8c168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a840103b0 tx=0x7f4a84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a9136a700 1 --2- 172.21.15.80:0/352565776 >> v2:172.21.15.174:3300/0 conn(0x7f4a8c108380 0x7f4a8c168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a840103b0 tx=0x7f4a84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:28.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a9136a700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a8c108380 0x7f4a8c168d80 secure :-1 s=READY pgs=1044 cs=0 l=1 rx=0x7f4a840103b0 tx=0x7f4a84010750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:28.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a9136a700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a8c108380 0x7f4a8c168d80 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f4a840103b0 tx=0x7f4a84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:29.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a897fa700 1 -- 172.21.15.80:0/352565776 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a8400a6b0 con 0x7f4a8c108380 2019-11-28T11:45:29.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a9136a700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a8c108380 0x7f4a8c168d80 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f4a840103b0 tx=0x7f4a84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:29.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a9136a700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a8c108380 0x7f4a8c168d80 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f4a840103b0 tx=0x7f4a84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:29.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a897fa700 1 -- 172.21.15.80:0/352565776 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a84001060 con 0x7f4a8c108380 2019-11-28T11:45:29.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a925cc700 1 -- 172.21.15.80:0/352565776 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8c10c810 con 0x7f4a8c108380 2019-11-28T11:45:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a897fa700 1 -- 172.21.15.80:0/352565776 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a84001770 con 0x7f4a8c108380 2019-11-28T11:45:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a925cc700 1 -- 172.21.15.80:0/352565776 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a8c10c490 con 0x7f4a8c108380 2019-11-28T11:45:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.932+0000 7f4a9136a700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a8c108380 0x7f4a8c168d80 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f4a840103b0 tx=0x7f4a84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.933+0000 7f4a897fa700 1 -- 172.21.15.80:0/352565776 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4a84001250 con 0x7f4a8c108380 2019-11-28T11:45:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.933+0000 7f4a9136a700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a8c108380 0x7f4a8c168d80 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f4a840103b0 tx=0x7f4a84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.933+0000 7f4a897fa700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4a70018770 0x7f4a7001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.933+0000 7f4a897fa700 1 -- 172.21.15.80:0/352565776 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4a84031980 con 0x7f4a8c108380 2019-11-28T11:45:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.933+0000 7f4a90b69700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4a70018770 0x7f4a7001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.933+0000 7f4a90b69700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4a70018770 0x7f4a7001abe0 crc :-1 s=READY pgs=728 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.940+0000 7f4a925cc700 1 -- 172.21.15.80:0/352565776 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a8c10c810 con 0x7f4a8c108380 2019-11-28T11:45:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.944+0000 7f4a9136a700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a8c108380 0x7f4a8c168d80 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f4a840103b0 tx=0x7f4a84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:28.944+0000 7f4a897fa700 1 -- 172.21.15.80:0/352565776 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4a84000a70 con 0x7f4a8c108380 2019-11-28T11:45:29.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.113+0000 7f4a925cc700 1 -- 172.21.15.80:0/352565776 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f4a8c10c490 con 0x7f4a8c108380 2019-11-28T11:45:29.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.779+0000 7f4a9136a700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a8c108380 0x7f4a8c168d80 secure :-1 s=THROTTLE_DONE pgs=1044 cs=0 l=1 rx=0x7f4a840103b0 tx=0x7f4a84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:29.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.779+0000 7f4a897fa700 1 -- 172.21.15.80:0/352565776 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v139) v1 ==== 125+0+0 (secure 0 0 0) 0x7f4a84001250 con 0x7f4a8c108380 2019-11-28T11:45:29.868 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:45:29.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.830+0000 7f4a925cc700 1 -- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4a70018770 msgr2=0x7f4a7001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:29.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.830+0000 7f4a925cc700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4a70018770 0x7f4a7001abe0 crc :-1 s=READY pgs=728 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:29.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.830+0000 7f4a925cc700 1 -- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a8c108380 msgr2=0x7f4a8c168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:29.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.830+0000 7f4a925cc700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a8c108380 0x7f4a8c168d80 secure :-1 s=READY pgs=1044 cs=0 l=1 rx=0x7f4a840103b0 tx=0x7f4a84010750).stop 2019-11-28T11:45:29.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.830+0000 7f4a925cc700 1 -- 172.21.15.80:0/352565776 shutdown_connections 2019-11-28T11:45:29.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.830+0000 7f4a925cc700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a8c108380 0x7f4a8c168d80 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:29.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.830+0000 7f4a925cc700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a8c1079b0 0x7f4a8c107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:29.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.830+0000 7f4a925cc700 1 --2- 172.21.15.80:0/352565776 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4a70018770 0x7f4a7001abe0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:29.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.830+0000 7f4a925cc700 1 -- 172.21.15.80:0/352565776 shutdown_connections 2019-11-28T11:45:29.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.830+0000 7f4a925cc700 1 -- 172.21.15.80:0/352565776 wait complete. 2019-11-28T11:45:29.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.830+0000 7f4a925cc700 1 -- 172.21.15.80:0/352565776 >> 172.21.15.80:0/352565776 conn(0x7f4a8c15e2d0 msgr2=0x7f4a8c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:29.881 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:45:30.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.964+0000 7fbd1685a700 1 Processor -- start 2019-11-28T11:45:30.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.964+0000 7fbd1685a700 1 -- start start 2019-11-28T11:45:30.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.965+0000 7fbd1685a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbd1015ed10 0x7fbd1015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:30.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.965+0000 7fbd1685a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1006db60 con 0x7fbd100734b0 2019-11-28T11:45:30.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.965+0000 7fbd1685a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1006e060 con 0x7fbd10073020 2019-11-28T11:45:30.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.965+0000 7fbd1685a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1006fe00 con 0x7fbd1015ed10 2019-11-28T11:45:30.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.965+0000 7fbd14df7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbd1015ed10 0x7fbd1015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:30.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.965+0000 7fbd155f8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbd100734b0 0x7fbd100726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39894/0 (socket says 172.21.15.80:39894) 2019-11-28T11:45:30.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.965+0000 7fbd155f8700 1 -- 172.21.15.80:0/2385400365 learned_addr learned my addr 172.21.15.80:0/2385400365 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:30.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.965+0000 7fbd14df7700 1 -- 172.21.15.80:0/2385400365 >> v1:172.21.15.174:6789/0 conn(0x7fbd10073020 legacy=0x7fbd10071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.965+0000 7fbd14df7700 1 -- 172.21.15.80:0/2385400365 >> v1:172.21.15.80:6789/0 conn(0x7fbd100734b0 legacy=0x7fbd100726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.965+0000 7fbd14df7700 1 -- 172.21.15.80:0/2385400365 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd10070760 con 0x7fbd1015ed10 2019-11-28T11:45:30.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.965+0000 7fbd14df7700 1 --2- 172.21.15.80:0/2385400365 >> v2:172.21.15.80:3300/0 conn(0x7fbd1015ed10 0x7fbd1015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbd0000af50 tx=0x7fbd0000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.965+0000 7fbd14df7700 1 --2- 172.21.15.80:0/2385400365 >> v2:172.21.15.80:3300/0 conn(0x7fbd1015ed10 0x7fbd1015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbd0000af50 tx=0x7fbd0000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.965+0000 7fbd14df7700 1 --2- 172.21.15.80:0/2385400365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1015ed10 0x7fbd1015f100 secure :-1 s=READY pgs=1796 cs=0 l=1 rx=0x7fbd0000af50 tx=0x7fbd0000b760).ready entity=mon.0 client_cookie=c297a99e5ba639c3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:30.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.965+0000 7fbd14df7700 1 --2- 172.21.15.80:0/2385400365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1015ed10 0x7fbd1015f100 secure :-1 s=THROTTLE_DONE pgs=1796 cs=0 l=1 rx=0x7fbd0000af50 tx=0x7fbd0000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.965+0000 7fbd0f7fe700 1 -- 172.21.15.80:0/2385400365 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd00000960 con 0x7fbd1015ed10 2019-11-28T11:45:30.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.966+0000 7fbd14df7700 1 --2- 172.21.15.80:0/2385400365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1015ed10 0x7fbd1015f100 secure :-1 s=THROTTLE_DONE pgs=1796 cs=0 l=1 rx=0x7fbd0000af50 tx=0x7fbd0000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.966+0000 7fbd14df7700 1 --2- 172.21.15.80:0/2385400365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1015ed10 0x7fbd1015f100 secure :-1 s=THROTTLE_DONE pgs=1796 cs=0 l=1 rx=0x7fbd0000af50 tx=0x7fbd0000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.966+0000 7fbd0f7fe700 1 -- 172.21.15.80:0/2385400365 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd00009860 con 0x7fbd1015ed10 2019-11-28T11:45:30.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.966+0000 7fbd0f7fe700 1 -- 172.21.15.80:0/2385400365 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd00009f30 con 0x7fbd1015ed10 2019-11-28T11:45:30.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.966+0000 7fbd1685a700 1 -- 172.21.15.80:0/2385400365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1015ed10 msgr2=0x7fbd1015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.966+0000 7fbd1685a700 1 --2- 172.21.15.80:0/2385400365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1015ed10 0x7fbd1015f100 secure :-1 s=READY pgs=1796 cs=0 l=1 rx=0x7fbd0000af50 tx=0x7fbd0000b760).stop 2019-11-28T11:45:30.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.966+0000 7fbd1685a700 1 -- 172.21.15.80:0/2385400365 shutdown_connections 2019-11-28T11:45:30.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.966+0000 7fbd1685a700 1 --2- 172.21.15.80:0/2385400365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd1015ed10 0x7fbd1015f100 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.966+0000 7fbd1685a700 1 -- 172.21.15.80:0/2385400365 shutdown_connections 2019-11-28T11:45:30.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.966+0000 7fbd1685a700 1 -- 172.21.15.80:0/2385400365 wait complete. 2019-11-28T11:45:30.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.966+0000 7fbd1685a700 1 -- 172.21.15.80:0/2385400365 >> 172.21.15.80:0/2385400365 conn(0x7fbd10061d20 msgr2=0x7fbd100641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.969+0000 7fbd1685a700 1 Processor -- start 2019-11-28T11:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.969+0000 7fbd1685a700 1 -- start start 2019-11-28T11:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd1685a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbd10101e80 0x7fbd1007c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd1685a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd1007b450 0x7fbd1007b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:30.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd1685a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd10165990 con 0x7fbd10128430 2019-11-28T11:45:30.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd1685a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd100793b0 con 0x7fbd10101e80 2019-11-28T11:45:30.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd1685a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd10079680 con 0x7fbd1007b450 2019-11-28T11:45:30.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd0ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbd10101e80 0x7fbd1007c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:30.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd0ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbd10101e80 0x7fbd1007c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:55470/0 (socket says 172.21.15.80:55470) 2019-11-28T11:45:30.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd0ffff700 1 -- 172.21.15.80:0/200057213 learned_addr learned my addr 172.21.15.80:0/200057213 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:30.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd155f8700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd1007b450 0x7fbd1007b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:30.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd0ffff700 1 -- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd1007b450 msgr2=0x7fbd1007b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd0ffff700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd1007b450 0x7fbd1007b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd0d7fa700 1 -- 172.21.15.80:0/200057213 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539237993 0 0) 0x7fbd00000940 con 0x7fbd10128430 2019-11-28T11:45:30.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd0ffff700 1 -- 172.21.15.80:0/200057213 >> v1:172.21.15.174:6789/0 conn(0x7fbd10128430 legacy=0x7fbd10165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd0ffff700 1 -- 172.21.15.80:0/200057213 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd10079d10 con 0x7fbd10101e80 2019-11-28T11:45:30.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd155f8700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd1007b450 0x7fbd1007b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:30.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd0ffff700 1 --2- 172.21.15.80:0/200057213 >> v2:172.21.15.174:3300/0 conn(0x7fbd10101e80 0x7fbd1007c5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbcf80103f0 tx=0x7fbcf8010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd0ffff700 1 --2- 172.21.15.80:0/200057213 >> v2:172.21.15.174:3300/0 conn(0x7fbd10101e80 0x7fbd1007c5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbcf80103f0 tx=0x7fbcf8010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.970+0000 7fbd0ffff700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd10101e80 0x7fbd1007c5d0 secure :-1 s=READY pgs=1047 cs=0 l=1 rx=0x7fbcf80103f0 tx=0x7fbcf8010790).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:30.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.971+0000 7fbd0ffff700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd10101e80 0x7fbd1007c5d0 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7fbcf80103f0 tx=0x7fbcf8010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.971+0000 7fbd0d7fa700 1 -- 172.21.15.80:0/200057213 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcf8000960 con 0x7fbd10101e80 2019-11-28T11:45:30.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.971+0000 7fbd0ffff700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd10101e80 0x7fbd1007c5d0 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7fbcf80103f0 tx=0x7fbcf8010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.971+0000 7fbd0ffff700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd10101e80 0x7fbd1007c5d0 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7fbcf80103f0 tx=0x7fbcf8010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.971+0000 7fbd0d7fa700 1 -- 172.21.15.80:0/200057213 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf8000ca0 con 0x7fbd10101e80 2019-11-28T11:45:30.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.971+0000 7fbd0d7fa700 1 -- 172.21.15.80:0/200057213 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcf8001370 con 0x7fbd10101e80 2019-11-28T11:45:30.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.971+0000 7fbd1685a700 1 -- 172.21.15.80:0/200057213 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1007a090 con 0x7fbd10101e80 2019-11-28T11:45:30.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.971+0000 7fbd1685a700 1 -- 172.21.15.80:0/200057213 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd10079d10 con 0x7fbd10101e80 2019-11-28T11:45:30.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.971+0000 7fbd0ffff700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd10101e80 0x7fbd1007c5d0 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7fbcf80103f0 tx=0x7fbcf8010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.971+0000 7fbd0d7fa700 1 -- 172.21.15.80:0/200057213 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbcf8000e90 con 0x7fbd10101e80 2019-11-28T11:45:30.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.971+0000 7fbd0ffff700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd10101e80 0x7fbd1007c5d0 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7fbcf80103f0 tx=0x7fbcf8010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.971+0000 7fbd0d7fa700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbcf4018730 0x7fbcf401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:30.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.971+0000 7fbd0d7fa700 1 -- 172.21.15.80:0/200057213 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5904+0+0 (secure 0 0 0) 0x7fbcf8031a90 con 0x7fbd10101e80 2019-11-28T11:45:30.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.972+0000 7fbd14df7700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbcf4018730 0x7fbcf401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:30.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.972+0000 7fbd14df7700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbcf4018730 0x7fbcf401abc0 crc :-1 s=READY pgs=729 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:30.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.979+0000 7fbd1685a700 1 -- 172.21.15.80:0/200057213 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1007a090 con 0x7fbd10101e80 2019-11-28T11:45:30.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.983+0000 7fbd0ffff700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd10101e80 0x7fbd1007c5d0 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7fbcf80103f0 tx=0x7fbcf8010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:29.983+0000 7fbd0d7fa700 1 -- 172.21.15.80:0/200057213 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbcf80075b0 con 0x7fbd10101e80 2019-11-28T11:45:30.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.149+0000 7fbd1685a700 1 -- 172.21.15.80:0/200057213 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7fbd10079d10 con 0x7fbd10101e80 2019-11-28T11:45:30.192 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:45:30.151+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:45:30.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.155+0000 7fbd0ffff700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd10101e80 0x7fbd1007c5d0 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7fbcf80103f0 tx=0x7fbcf8010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.156+0000 7fbd0d7fa700 1 -- 172.21.15.80:0/200057213 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 22 and data pool 23 v104) v1 ==== 174+0+0 (secure 0 0 0) 0x7fbcf8000fb0 con 0x7fbd10101e80 2019-11-28T11:45:30.198 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 22 and data pool 23 2019-11-28T11:45:30.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.159+0000 7fbd1685a700 1 -- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbcf4018730 msgr2=0x7fbcf401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.159+0000 7fbd1685a700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbcf4018730 0x7fbcf401abc0 crc :-1 s=READY pgs=729 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.159+0000 7fbd1685a700 1 -- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd10101e80 msgr2=0x7fbd1007c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.159+0000 7fbd1685a700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd10101e80 0x7fbd1007c5d0 secure :-1 s=READY pgs=1047 cs=0 l=1 rx=0x7fbcf80103f0 tx=0x7fbcf8010790).stop 2019-11-28T11:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.160+0000 7fbd1685a700 1 -- 172.21.15.80:0/200057213 shutdown_connections 2019-11-28T11:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.160+0000 7fbd1685a700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd1007b450 0x7fbd1007b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.160+0000 7fbd1685a700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd10101e80 0x7fbd1007c5d0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.160+0000 7fbd1685a700 1 --2- 172.21.15.80:0/200057213 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbcf4018730 0x7fbcf401abc0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.160+0000 7fbd1685a700 1 -- 172.21.15.80:0/200057213 shutdown_connections 2019-11-28T11:45:30.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.160+0000 7fbd1685a700 1 -- 172.21.15.80:0/200057213 wait complete. 2019-11-28T11:45:30.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.160+0000 7fbd1685a700 1 -- 172.21.15.80:0/200057213 >> 172.21.15.80:0/200057213 conn(0x7fbd10166440 msgr2=0x7fbd101494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:30.210 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:45:30.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.289+0000 7f48c7a70700 1 Processor -- start 2019-11-28T11:45:30.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.289+0000 7f48c7a70700 1 -- start start 2019-11-28T11:45:30.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.290+0000 7f48c7a70700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f48c006d120 0x7f48c0165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:30.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.290+0000 7f48c7a70700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c006d5a0 con 0x7f48c006c0a0 2019-11-28T11:45:30.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.290+0000 7f48c7a70700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c006db00 con 0x7f48c006c490 2019-11-28T11:45:30.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.290+0000 7f48c7a70700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c006fd60 con 0x7f48c006d120 2019-11-28T11:45:30.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.290+0000 7f48c600d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f48c006c0a0 0x7f48c0072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39906/0 (socket says 172.21.15.80:39906) 2019-11-28T11:45:30.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.290+0000 7f48c600d700 1 -- 172.21.15.80:0/1068736431 learned_addr learned my addr 172.21.15.80:0/1068736431 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:30.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.290+0000 7f48c680e700 1 --2- 172.21.15.80:0/1068736431 >> v2:172.21.15.174:3300/0 conn(0x7f48c006d120 0x7f48c0165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:30.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.290+0000 7f48c500b700 1 -- 172.21.15.80:0/1068736431 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026653947 0 0) 0x7f48b4001150 con 0x7f48c006c0a0 2019-11-28T11:45:30.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.290+0000 7f48c500b700 1 -- 172.21.15.80:0/1068736431 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a8002e80 con 0x7f48c006c0a0 2019-11-28T11:45:30.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.290+0000 7f48c500b700 1 -- 172.21.15.80:0/1068736431 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143595472 0 0) 0x7f48b0001400 con 0x7f48c006c490 2019-11-28T11:45:30.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.290+0000 7f48c500b700 1 -- 172.21.15.80:0/1068736431 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a80030b0 con 0x7f48c006c490 2019-11-28T11:45:30.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.290+0000 7f48c680e700 1 -- 172.21.15.80:0/1068736431 >> v1:172.21.15.174:6789/0 conn(0x7f48c006c490 legacy=0x7f48c006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.290+0000 7f48c680e700 1 -- 172.21.15.80:0/1068736431 >> v1:172.21.15.80:6789/0 conn(0x7f48c006c0a0 legacy=0x7f48c0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.290+0000 7f48c500b700 1 -- 172.21.15.80:0/1068736431 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4161039261 0 0) 0x7f48b4001130 con 0x7f48c006c0a0 2019-11-28T11:45:30.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.291+0000 7f48c680e700 1 -- 172.21.15.80:0/1068736431 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c00706c0 con 0x7f48c006d120 2019-11-28T11:45:30.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.291+0000 7f48c680e700 1 --2- 172.21.15.80:0/1068736431 >> v2:172.21.15.174:3300/0 conn(0x7f48c006d120 0x7f48c0165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f48b800af80 tx=0x7f48b800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.291+0000 7f48c680e700 1 --2- 172.21.15.80:0/1068736431 >> v2:172.21.15.174:3300/0 conn(0x7f48c006d120 0x7f48c0165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f48b800af80 tx=0x7f48b800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.291+0000 7f48c680e700 1 --2- 172.21.15.80:0/1068736431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48c006d120 0x7f48c0165d80 secure :-1 s=READY pgs=1049 cs=0 l=1 rx=0x7f48b800af80 tx=0x7f48b800b790).ready entity=mon.1 client_cookie=c4e76ed0d89e143b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:30.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.291+0000 7f48c680e700 1 --2- 172.21.15.80:0/1068736431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48c006d120 0x7f48c0165d80 secure :-1 s=THROTTLE_DONE pgs=1049 cs=0 l=1 rx=0x7f48b800af80 tx=0x7f48b800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.291+0000 7f48c500b700 1 -- 172.21.15.80:0/1068736431 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48b8007240 con 0x7f48c006d120 2019-11-28T11:45:30.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.291+0000 7f48c680e700 1 --2- 172.21.15.80:0/1068736431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48c006d120 0x7f48c0165d80 secure :-1 s=THROTTLE_DONE pgs=1049 cs=0 l=1 rx=0x7f48b800af80 tx=0x7f48b800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.291+0000 7f48c680e700 1 --2- 172.21.15.80:0/1068736431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48c006d120 0x7f48c0165d80 secure :-1 s=THROTTLE_DONE pgs=1049 cs=0 l=1 rx=0x7f48b800af80 tx=0x7f48b800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.291+0000 7f48c500b700 1 -- 172.21.15.80:0/1068736431 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b8000bb0 con 0x7f48c006d120 2019-11-28T11:45:30.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.291+0000 7f48c500b700 1 -- 172.21.15.80:0/1068736431 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48b8009e60 con 0x7f48c006d120 2019-11-28T11:45:30.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.291+0000 7f48c7a70700 1 -- 172.21.15.80:0/1068736431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48c006d120 msgr2=0x7f48c0165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.291+0000 7f48c7a70700 1 --2- 172.21.15.80:0/1068736431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48c006d120 0x7f48c0165d80 secure :-1 s=READY pgs=1049 cs=0 l=1 rx=0x7f48b800af80 tx=0x7f48b800b790).stop 2019-11-28T11:45:30.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.292+0000 7f48c7a70700 1 -- 172.21.15.80:0/1068736431 shutdown_connections 2019-11-28T11:45:30.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.292+0000 7f48c7a70700 1 --2- 172.21.15.80:0/1068736431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48c006d120 0x7f48c0165d80 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.292+0000 7f48c7a70700 1 -- 172.21.15.80:0/1068736431 shutdown_connections 2019-11-28T11:45:30.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.292+0000 7f48c7a70700 1 -- 172.21.15.80:0/1068736431 wait complete. 2019-11-28T11:45:30.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.292+0000 7f48c7a70700 1 -- 172.21.15.80:0/1068736431 >> 172.21.15.80:0/1068736431 conn(0x7f48c0061cf0 msgr2=0x7f48c0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:30.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.294+0000 7f48c7a70700 1 Processor -- start 2019-11-28T11:45:30.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.294+0000 7f48c7a70700 1 -- start start 2019-11-28T11:45:30.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.295+0000 7f48c7a70700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f48c0142ff0 0x7f48c015a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:30.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.295+0000 7f48c7a70700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f48c015aa10 0x7f48c0127360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:30.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.295+0000 7f48c7a70700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c0102680 con 0x7f48c01278a0 2019-11-28T11:45:30.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.295+0000 7f48c7a70700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c0110350 con 0x7f48c015aa10 2019-11-28T11:45:30.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.295+0000 7f48c7a70700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c0110620 con 0x7f48c0142ff0 2019-11-28T11:45:30.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.295+0000 7f48c580c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f48c015aa10 0x7f48c0127360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:30.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.295+0000 7f48c580c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f48c015aa10 0x7f48c0127360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40598/0 (socket says 172.21.15.80:40598) 2019-11-28T11:45:30.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.295+0000 7f48c680e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f48c01278a0 0x7f48c0159350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39916/0 (socket says 172.21.15.80:39916) 2019-11-28T11:45:30.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.295+0000 7f48c580c700 1 -- 172.21.15.80:0/3302698935 learned_addr learned my addr 172.21.15.80:0/3302698935 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:30.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.295+0000 7f48c600d700 1 --2- 172.21.15.80:0/3302698935 >> v2:172.21.15.174:3300/0 conn(0x7f48c0142ff0 0x7f48c015a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:30.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.295+0000 7f48c580c700 1 -- 172.21.15.80:0/3302698935 >> v2:172.21.15.174:3300/0 conn(0x7f48c0142ff0 msgr2=0x7f48c015a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.295+0000 7f48c580c700 1 --2- 172.21.15.80:0/3302698935 >> v2:172.21.15.174:3300/0 conn(0x7f48c0142ff0 0x7f48c015a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.295+0000 7f48c580c700 1 -- 172.21.15.80:0/3302698935 >> v1:172.21.15.80:6789/0 conn(0x7f48c01278a0 legacy=0x7f48c0159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.295+0000 7f48c580c700 1 -- 172.21.15.80:0/3302698935 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c0110cb0 con 0x7f48c015aa10 2019-11-28T11:45:30.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.295+0000 7f48beffd700 1 -- 172.21.15.80:0/3302698935 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171156147 0 0) 0x7f48b8009990 con 0x7f48c01278a0 2019-11-28T11:45:30.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.295+0000 7f48c580c700 1 --2- 172.21.15.80:0/3302698935 >> v2:172.21.15.80:3300/0 conn(0x7f48c015aa10 0x7f48c0127360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48b0010790 tx=0x7f48b0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.296+0000 7f48c580c700 1 --2- 172.21.15.80:0/3302698935 >> v2:172.21.15.80:3300/0 conn(0x7f48c015aa10 0x7f48c0127360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48b0010790 tx=0x7f48b0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.296+0000 7f48c580c700 1 --2- 172.21.15.80:0/3302698935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c015aa10 0x7f48c0127360 secure :-1 s=READY pgs=1799 cs=0 l=1 rx=0x7f48b0010790 tx=0x7f48b0010610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:30.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.296+0000 7f48c580c700 1 --2- 172.21.15.80:0/3302698935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c015aa10 0x7f48c0127360 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7f48b0010790 tx=0x7f48b0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.296+0000 7f48beffd700 1 -- 172.21.15.80:0/3302698935 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48b0005af0 con 0x7f48c015aa10 2019-11-28T11:45:30.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.296+0000 7f48c580c700 1 --2- 172.21.15.80:0/3302698935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c015aa10 0x7f48c0127360 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7f48b0010790 tx=0x7f48b0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.296+0000 7f48beffd700 1 -- 172.21.15.80:0/3302698935 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b0005710 con 0x7f48c015aa10 2019-11-28T11:45:30.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.296+0000 7f48c580c700 1 --2- 172.21.15.80:0/3302698935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c015aa10 0x7f48c0127360 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7f48b0010790 tx=0x7f48b0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.296+0000 7f48c7a70700 1 -- 172.21.15.80:0/3302698935 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c0111030 con 0x7f48c015aa10 2019-11-28T11:45:30.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.296+0000 7f48beffd700 1 -- 172.21.15.80:0/3302698935 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48b0005ce0 con 0x7f48c015aa10 2019-11-28T11:45:30.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.296+0000 7f48c7a70700 1 -- 172.21.15.80:0/3302698935 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c0110cb0 con 0x7f48c015aa10 2019-11-28T11:45:30.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.296+0000 7f48c580c700 1 --2- 172.21.15.80:0/3302698935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c015aa10 0x7f48c0127360 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7f48b0010790 tx=0x7f48b0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.296+0000 7f48beffd700 1 -- 172.21.15.80:0/3302698935 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f48b0005900 con 0x7f48c015aa10 2019-11-28T11:45:30.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.296+0000 7f48c580c700 1 --2- 172.21.15.80:0/3302698935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c015aa10 0x7f48c0127360 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7f48b0010790 tx=0x7f48b0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.296+0000 7f48beffd700 1 --2- 172.21.15.80:0/3302698935 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f48a0018730 0x7f48a001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:30.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.296+0000 7f48beffd700 1 -- 172.21.15.80:0/3302698935 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f48b0031e30 con 0x7f48c015aa10 2019-11-28T11:45:30.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.297+0000 7f48c600d700 1 --2- 172.21.15.80:0/3302698935 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f48a0018730 0x7f48a001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:30.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.297+0000 7f48c600d700 1 --2- 172.21.15.80:0/3302698935 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f48a0018730 0x7f48a001abc0 crc :-1 s=READY pgs=730 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:30.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.304+0000 7f48c7a70700 1 -- 172.21.15.80:0/3302698935 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c0111030 con 0x7f48c015aa10 2019-11-28T11:45:30.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.308+0000 7f48c580c700 1 --2- 172.21.15.80:0/3302698935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c015aa10 0x7f48c0127360 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7f48b0010790 tx=0x7f48b0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.308+0000 7f48beffd700 1 -- 172.21.15.80:0/3302698935 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f48b0007920 con 0x7f48c015aa10 2019-11-28T11:45:30.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.486+0000 7f48c7a70700 1 -- 172.21.15.80:0/3302698935 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48c0110cb0 con 0x7f48c015aa10 2019-11-28T11:45:30.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.487+0000 7f48c580c700 1 --2- 172.21.15.80:0/3302698935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c015aa10 0x7f48c0127360 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7f48b0010790 tx=0x7f48b0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.487+0000 7f48beffd700 1 -- 172.21.15.80:0/3302698935 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+14884 (secure 0 0 0) 0x7f48b002e290 con 0x7f48c015aa10 2019-11-28T11:45:30.528 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:30.529 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":140,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:45:30.151954+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:45:28.436380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2019-11-28T11:45:29.126890+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:45:30.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.489+0000 7f48c7a70700 1 -- 172.21.15.80:0/3302698935 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f48a0018730 msgr2=0x7f48a001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.489+0000 7f48c7a70700 1 --2- 172.21.15.80:0/3302698935 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f48a0018730 0x7f48a001abc0 crc :-1 s=READY pgs=730 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.489+0000 7f48c7a70700 1 -- 172.21.15.80:0/3302698935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c015aa10 msgr2=0x7f48c0127360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.489+0000 7f48c7a70700 1 --2- 172.21.15.80:0/3302698935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c015aa10 0x7f48c0127360 secure :-1 s=READY pgs=1799 cs=0 l=1 rx=0x7f48b0010790 tx=0x7f48b0010610).stop 2019-11-28T11:45:30.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.489+0000 7f48c7a70700 1 -- 172.21.15.80:0/3302698935 shutdown_connections 2019-11-28T11:45:30.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.489+0000 7f48c7a70700 1 --2- 172.21.15.80:0/3302698935 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f48a0018730 0x7f48a001abc0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.489+0000 7f48c7a70700 1 --2- 172.21.15.80:0/3302698935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c015aa10 0x7f48c0127360 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.489+0000 7f48c7a70700 1 --2- 172.21.15.80:0/3302698935 >> v2:172.21.15.174:3300/0 conn(0x7f48c0142ff0 0x7f48c015a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.489+0000 7f48c7a70700 1 -- 172.21.15.80:0/3302698935 shutdown_connections 2019-11-28T11:45:30.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.490+0000 7f48c7a70700 1 -- 172.21.15.80:0/3302698935 wait complete. 2019-11-28T11:45:30.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.490+0000 7f48c7a70700 1 -- 172.21.15.80:0/3302698935 >> 172.21.15.80:0/3302698935 conn(0x7f48c007c680 msgr2=0x7f48c0112150 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:30.541 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:45:30.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.619+0000 7f412bd40700 1 Processor -- start 2019-11-28T11:45:30.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.619+0000 7f412bd40700 1 -- start start 2019-11-28T11:45:30.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.620+0000 7f412bd40700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f412406c490 0x7f412406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:30.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412bd40700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f412406ce60 0x7f4124164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:30.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412bd40700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412406db00 con 0x7f412406c0a0 2019-11-28T11:45:30.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412bd40700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412406fd60 con 0x7f412406ce60 2019-11-28T11:45:30.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412bd40700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4124070030 con 0x7f412406c490 2019-11-28T11:45:30.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412aade700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f412406ce60 0x7f4124164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:30.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412a2dd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f412406c0a0 0x7f4124072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39920/0 (socket says 172.21.15.80:39920) 2019-11-28T11:45:30.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412a2dd700 1 -- 172.21.15.80:0/3480929721 learned_addr learned my addr 172.21.15.80:0/3480929721 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:30.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f4129adc700 1 --2- 172.21.15.80:0/3480929721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f412406c490 0x7f412406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:30.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412aade700 1 -- 172.21.15.80:0/3480929721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f412406c490 msgr2=0x7f412406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:30.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412aade700 1 --2- 172.21.15.80:0/3480929721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f412406c490 0x7f412406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:30.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412aade700 1 -- 172.21.15.80:0/3480929721 >> v1:172.21.15.80:6789/0 conn(0x7f412406c0a0 legacy=0x7f4124072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f41292db700 1 -- 172.21.15.80:0/3480929721 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079027176 0 0) 0x7f4114001150 con 0x7f412406c0a0 2019-11-28T11:45:30.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412aade700 1 -- 172.21.15.80:0/3480929721 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41240706c0 con 0x7f412406ce60 2019-11-28T11:45:30.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412aade700 1 --2- 172.21.15.80:0/3480929721 >> v2:172.21.15.80:3300/0 conn(0x7f412406ce60 0x7f4124164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f411c00af50 tx=0x7f411c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412aade700 1 --2- 172.21.15.80:0/3480929721 >> v2:172.21.15.80:3300/0 conn(0x7f412406ce60 0x7f4124164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f411c00af50 tx=0x7f411c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412aade700 1 --2- 172.21.15.80:0/3480929721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f412406ce60 0x7f4124164d70 secure :-1 s=READY pgs=1801 cs=0 l=1 rx=0x7f411c00af50 tx=0x7f411c00b6e0).ready entity=mon.0 client_cookie=a7094f2a0c371f5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:30.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412aade700 1 --2- 172.21.15.80:0/3480929721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f412406ce60 0x7f4124164d70 secure :-1 s=THROTTLE_DONE pgs=1801 cs=0 l=1 rx=0x7f411c00af50 tx=0x7f411c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f41292db700 1 -- 172.21.15.80:0/3480929721 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f411c009ba0 con 0x7f412406ce60 2019-11-28T11:45:30.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412aade700 1 --2- 172.21.15.80:0/3480929721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f412406ce60 0x7f4124164d70 secure :-1 s=THROTTLE_DONE pgs=1801 cs=0 l=1 rx=0x7f411c00af50 tx=0x7f411c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412aade700 1 --2- 172.21.15.80:0/3480929721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f412406ce60 0x7f4124164d70 secure :-1 s=THROTTLE_DONE pgs=1801 cs=0 l=1 rx=0x7f411c00af50 tx=0x7f411c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f41292db700 1 -- 172.21.15.80:0/3480929721 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c0097c0 con 0x7f412406ce60 2019-11-28T11:45:30.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f41292db700 1 -- 172.21.15.80:0/3480929721 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f411c00a180 con 0x7f412406ce60 2019-11-28T11:45:30.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412bd40700 1 -- 172.21.15.80:0/3480929721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f412406ce60 msgr2=0x7f4124164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.621+0000 7f412bd40700 1 --2- 172.21.15.80:0/3480929721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f412406ce60 0x7f4124164d70 secure :-1 s=READY pgs=1801 cs=0 l=1 rx=0x7f411c00af50 tx=0x7f411c00b6e0).stop 2019-11-28T11:45:30.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.622+0000 7f412bd40700 1 -- 172.21.15.80:0/3480929721 shutdown_connections 2019-11-28T11:45:30.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.622+0000 7f412bd40700 1 --2- 172.21.15.80:0/3480929721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f412406ce60 0x7f4124164d70 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.622+0000 7f412bd40700 1 --2- 172.21.15.80:0/3480929721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f412406c490 0x7f412406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:30.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.622+0000 7f412bd40700 1 -- 172.21.15.80:0/3480929721 shutdown_connections 2019-11-28T11:45:30.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.622+0000 7f412bd40700 1 -- 172.21.15.80:0/3480929721 wait complete. 2019-11-28T11:45:30.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.622+0000 7f412bd40700 1 -- 172.21.15.80:0/3480929721 >> 172.21.15.80:0/3480929721 conn(0x7f4124061cf0 msgr2=0x7f4124064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:30.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.625+0000 7f412bd40700 1 Processor -- start 2019-11-28T11:45:30.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.625+0000 7f412bd40700 1 -- start start 2019-11-28T11:45:30.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.625+0000 7f412bd40700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4124109e40 0x7f412410a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:30.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.625+0000 7f412bd40700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f412410a810 0x7f4124105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:30.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.625+0000 7f412bd40700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412413f1e0 con 0x7f412413eb40 2019-11-28T11:45:30.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.625+0000 7f412bd40700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41241234c0 con 0x7f4124109e40 2019-11-28T11:45:30.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.625+0000 7f412bd40700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412413e0d0 con 0x7f412410a810 2019-11-28T11:45:30.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f4129adc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4124109e40 0x7f412410a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:30.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f4129adc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4124109e40 0x7f412410a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40612/0 (socket says 172.21.15.80:40612) 2019-11-28T11:45:30.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f4129adc700 1 -- 172.21.15.80:0/2234225423 learned_addr learned my addr 172.21.15.80:0/2234225423 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:30.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f412aade700 1 --2- 172.21.15.80:0/2234225423 >> v2:172.21.15.174:3300/0 conn(0x7f412410a810 0x7f4124105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:30.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f4129adc700 1 -- 172.21.15.80:0/2234225423 >> v2:172.21.15.174:3300/0 conn(0x7f412410a810 msgr2=0x7f4124105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f4129adc700 1 --2- 172.21.15.80:0/2234225423 >> v2:172.21.15.174:3300/0 conn(0x7f412410a810 0x7f4124105210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f4129adc700 1 -- 172.21.15.80:0/2234225423 >> v1:172.21.15.174:6789/0 conn(0x7f412413eb40 legacy=0x7f412410afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f4129adc700 1 -- 172.21.15.80:0/2234225423 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4124108700 con 0x7f4124109e40 2019-11-28T11:45:30.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f4129adc700 1 --2- 172.21.15.80:0/2234225423 >> v2:172.21.15.80:3300/0 conn(0x7f4124109e40 0x7f412410a2d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f410c0107d0 tx=0x7f410c0105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f4129adc700 1 --2- 172.21.15.80:0/2234225423 >> v2:172.21.15.80:3300/0 conn(0x7f4124109e40 0x7f412410a2d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f410c0107d0 tx=0x7f410c0105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f4129adc700 1 --2- 172.21.15.80:0/2234225423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4124109e40 0x7f412410a2d0 secure :-1 s=READY pgs=1802 cs=0 l=1 rx=0x7f410c0107d0 tx=0x7f410c0105d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:30.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f4129adc700 1 --2- 172.21.15.80:0/2234225423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4124109e40 0x7f412410a2d0 secure :-1 s=THROTTLE_DONE pgs=1802 cs=0 l=1 rx=0x7f410c0107d0 tx=0x7f410c0105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f4129adc700 1 --2- 172.21.15.80:0/2234225423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4124109e40 0x7f412410a2d0 secure :-1 s=THROTTLE_DONE pgs=1802 cs=0 l=1 rx=0x7f410c0107d0 tx=0x7f410c0105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f4122ffd700 1 -- 172.21.15.80:0/2234225423 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f410c005af0 con 0x7f4124109e40 2019-11-28T11:45:30.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f4129adc700 1 --2- 172.21.15.80:0/2234225423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4124109e40 0x7f412410a2d0 secure :-1 s=THROTTLE_DONE pgs=1802 cs=0 l=1 rx=0x7f410c0107d0 tx=0x7f410c0105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f4122ffd700 1 -- 172.21.15.80:0/2234225423 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410c005710 con 0x7f4124109e40 2019-11-28T11:45:30.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f412bd40700 1 -- 172.21.15.80:0/2234225423 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4124108a80 con 0x7f4124109e40 2019-11-28T11:45:30.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f4122ffd700 1 -- 172.21.15.80:0/2234225423 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f410c0060d0 con 0x7f4124109e40 2019-11-28T11:45:30.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.626+0000 7f412bd40700 1 -- 172.21.15.80:0/2234225423 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4124108700 con 0x7f4124109e40 2019-11-28T11:45:30.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.627+0000 7f4129adc700 1 --2- 172.21.15.80:0/2234225423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4124109e40 0x7f412410a2d0 secure :-1 s=THROTTLE_DONE pgs=1802 cs=0 l=1 rx=0x7f410c0107d0 tx=0x7f410c0105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.627+0000 7f4122ffd700 1 -- 172.21.15.80:0/2234225423 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f410c005900 con 0x7f4124109e40 2019-11-28T11:45:30.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.627+0000 7f4129adc700 1 --2- 172.21.15.80:0/2234225423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4124109e40 0x7f412410a2d0 secure :-1 s=THROTTLE_DONE pgs=1802 cs=0 l=1 rx=0x7f410c0107d0 tx=0x7f410c0105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.627+0000 7f4122ffd700 1 --2- 172.21.15.80:0/2234225423 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4108018730 0x7f410801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:30.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.627+0000 7f4122ffd700 1 -- 172.21.15.80:0/2234225423 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f410c031db0 con 0x7f4124109e40 2019-11-28T11:45:30.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.627+0000 7f412a2dd700 1 --2- 172.21.15.80:0/2234225423 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4108018730 0x7f410801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:30.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.627+0000 7f412a2dd700 1 --2- 172.21.15.80:0/2234225423 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4108018730 0x7f410801abc0 crc :-1 s=READY pgs=731 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:30.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.635+0000 7f412bd40700 1 -- 172.21.15.80:0/2234225423 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4124108a80 con 0x7f4124109e40 2019-11-28T11:45:30.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.638+0000 7f4129adc700 1 --2- 172.21.15.80:0/2234225423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4124109e40 0x7f412410a2d0 secure :-1 s=THROTTLE_DONE pgs=1802 cs=0 l=1 rx=0x7f410c0107d0 tx=0x7f410c0105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.638+0000 7f4122ffd700 1 -- 172.21.15.80:0/2234225423 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f410c02e210 con 0x7f4124109e40 2019-11-28T11:45:30.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.820+0000 7f412bd40700 1 -- 172.21.15.80:0/2234225423 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4124108700 con 0x7f4124109e40 2019-11-28T11:45:30.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.820+0000 7f4129adc700 1 --2- 172.21.15.80:0/2234225423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4124109e40 0x7f412410a2d0 secure :-1 s=THROTTLE_DONE pgs=1802 cs=0 l=1 rx=0x7f410c0107d0 tx=0x7f410c0105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:30.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.820+0000 7f4122ffd700 1 -- 172.21.15.80:0/2234225423 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+14884 (secure 0 0 0) 0x7f410c02e210 con 0x7f4124109e40 2019-11-28T11:45:30.862 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:30.862 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":140,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:45:30.151954+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:45:28.436380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2019-11-28T11:45:29.126890+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:45:30.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.823+0000 7f412bd40700 1 -- 172.21.15.80:0/2234225423 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4108018730 msgr2=0x7f410801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.823+0000 7f412bd40700 1 --2- 172.21.15.80:0/2234225423 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4108018730 0x7f410801abc0 crc :-1 s=READY pgs=731 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.823+0000 7f412bd40700 1 -- 172.21.15.80:0/2234225423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4124109e40 msgr2=0x7f412410a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:30.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.823+0000 7f412bd40700 1 --2- 172.21.15.80:0/2234225423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4124109e40 0x7f412410a2d0 secure :-1 s=READY pgs=1802 cs=0 l=1 rx=0x7f410c0107d0 tx=0x7f410c0105d0).stop 2019-11-28T11:45:30.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.823+0000 7f412bd40700 1 -- 172.21.15.80:0/2234225423 shutdown_connections 2019-11-28T11:45:30.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.823+0000 7f412bd40700 1 --2- 172.21.15.80:0/2234225423 >> v2:172.21.15.174:3300/0 conn(0x7f412410a810 0x7f4124105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.823+0000 7f412bd40700 1 --2- 172.21.15.80:0/2234225423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4124109e40 0x7f412410a2d0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.823+0000 7f412bd40700 1 --2- 172.21.15.80:0/2234225423 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4108018730 0x7f410801abc0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:30.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.823+0000 7f412bd40700 1 -- 172.21.15.80:0/2234225423 shutdown_connections 2019-11-28T11:45:30.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.823+0000 7f412bd40700 1 -- 172.21.15.80:0/2234225423 wait complete. 2019-11-28T11:45:30.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.823+0000 7f412bd40700 1 -- 172.21.15.80:0/2234225423 >> 172.21.15.80:0/2234225423 conn(0x7f412411bfc0 msgr2=0x7f4124141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:30.874 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:45:31.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.956+0000 7f54df50e700 1 Processor -- start 2019-11-28T11:45:31.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.956+0000 7f54df50e700 1 -- start start 2019-11-28T11:45:31.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.957+0000 7f54df50e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d815ed10 0x7f54d815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:31.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.957+0000 7f54df50e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f54d80734b0 0x7f54d80726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:31.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.957+0000 7f54df50e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d806db60 con 0x7f54d8073020 2019-11-28T11:45:31.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.957+0000 7f54df50e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d806f3d0 con 0x7f54d80734b0 2019-11-28T11:45:31.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.957+0000 7f54df50e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d806fe00 con 0x7f54d815ed10 2019-11-28T11:45:31.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.957+0000 7f54de2ac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f54d80734b0 0x7f54d80726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:31.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.957+0000 7f54dd2aa700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f54d8073020 0x7f54d8071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39934/0 (socket says 172.21.15.80:39934) 2019-11-28T11:45:31.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.957+0000 7f54dd2aa700 1 -- 172.21.15.80:0/2185721501 learned_addr learned my addr 172.21.15.80:0/2185721501 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:31.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.957+0000 7f54ddaab700 1 --2- 172.21.15.80:0/2185721501 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d815ed10 0x7f54d815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:31.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.957+0000 7f54de2ac700 1 -- 172.21.15.80:0/2185721501 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d815ed10 msgr2=0x7f54d815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:31.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.957+0000 7f54de2ac700 1 --2- 172.21.15.80:0/2185721501 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d815ed10 0x7f54d815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:31.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.957+0000 7f54de2ac700 1 -- 172.21.15.80:0/2185721501 >> v1:172.21.15.80:6789/0 conn(0x7f54d8073020 legacy=0x7f54d8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:31.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.957+0000 7f54de2ac700 1 -- 172.21.15.80:0/2185721501 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d8070760 con 0x7f54d80734b0 2019-11-28T11:45:31.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.957+0000 7f54dcaa9700 1 -- 172.21.15.80:0/2185721501 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906407776 0 0) 0x7f54d4001150 con 0x7f54d8073020 2019-11-28T11:45:31.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.957+0000 7f54de2ac700 1 --2- 172.21.15.80:0/2185721501 >> v2:172.21.15.80:3300/0 conn(0x7f54d80734b0 0x7f54d80726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f54cc00af50 tx=0x7f54cc00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.958+0000 7f54de2ac700 1 --2- 172.21.15.80:0/2185721501 >> v2:172.21.15.80:3300/0 conn(0x7f54d80734b0 0x7f54d80726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f54cc00af50 tx=0x7f54cc00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.958+0000 7f54de2ac700 1 --2- 172.21.15.80:0/2185721501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54d80734b0 0x7f54d80726a0 secure :-1 s=READY pgs=1804 cs=0 l=1 rx=0x7f54cc00af50 tx=0x7f54cc00b250).ready entity=mon.0 client_cookie=157cc5f58f5e3128 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:31.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.958+0000 7f54de2ac700 1 --2- 172.21.15.80:0/2185721501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54d80734b0 0x7f54d80726a0 secure :-1 s=THROTTLE_DONE pgs=1804 cs=0 l=1 rx=0x7f54cc00af50 tx=0x7f54cc00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.958+0000 7f54dcaa9700 1 -- 172.21.15.80:0/2185721501 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54cc009ba0 con 0x7f54d80734b0 2019-11-28T11:45:31.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.958+0000 7f54de2ac700 1 --2- 172.21.15.80:0/2185721501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54d80734b0 0x7f54d80726a0 secure :-1 s=THROTTLE_DONE pgs=1804 cs=0 l=1 rx=0x7f54cc00af50 tx=0x7f54cc00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.958+0000 7f54de2ac700 1 --2- 172.21.15.80:0/2185721501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54d80734b0 0x7f54d80726a0 secure :-1 s=THROTTLE_DONE pgs=1804 cs=0 l=1 rx=0x7f54cc00af50 tx=0x7f54cc00b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.958+0000 7f54dcaa9700 1 -- 172.21.15.80:0/2185721501 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc0097c0 con 0x7f54d80734b0 2019-11-28T11:45:31.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.958+0000 7f54dcaa9700 1 -- 172.21.15.80:0/2185721501 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54cc00a180 con 0x7f54d80734b0 2019-11-28T11:45:31.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.958+0000 7f54df50e700 1 -- 172.21.15.80:0/2185721501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54d80734b0 msgr2=0x7f54d80726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:31.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.958+0000 7f54df50e700 1 --2- 172.21.15.80:0/2185721501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54d80734b0 0x7f54d80726a0 secure :-1 s=READY pgs=1804 cs=0 l=1 rx=0x7f54cc00af50 tx=0x7f54cc00b250).stop 2019-11-28T11:45:31.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.958+0000 7f54df50e700 1 -- 172.21.15.80:0/2185721501 shutdown_connections 2019-11-28T11:45:31.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.958+0000 7f54df50e700 1 --2- 172.21.15.80:0/2185721501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54d80734b0 0x7f54d80726a0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:31.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.958+0000 7f54df50e700 1 --2- 172.21.15.80:0/2185721501 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d815ed10 0x7f54d815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:31.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.959+0000 7f54df50e700 1 -- 172.21.15.80:0/2185721501 shutdown_connections 2019-11-28T11:45:31.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.959+0000 7f54df50e700 1 -- 172.21.15.80:0/2185721501 wait complete. 2019-11-28T11:45:31.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.959+0000 7f54df50e700 1 -- 172.21.15.80:0/2185721501 >> 172.21.15.80:0/2185721501 conn(0x7f54d8061d20 msgr2=0x7f54d80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:31.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.961+0000 7f54df50e700 1 Processor -- start 2019-11-28T11:45:31.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.961+0000 7f54df50e700 1 -- start start 2019-11-28T11:45:31.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.962+0000 7f54df50e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f54d8148320 0x7f54d810ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:31.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.962+0000 7f54df50e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d810f290 0x7f54d810dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:31.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.962+0000 7f54df50e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d8148e00 con 0x7f54d810e110 2019-11-28T11:45:31.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.962+0000 7f54df50e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d813aa20 con 0x7f54d8148320 2019-11-28T11:45:31.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.962+0000 7f54df50e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d813acf0 con 0x7f54d810f290 2019-11-28T11:45:31.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.962+0000 7f54dd2aa700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d810f290 0x7f54d810dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:31.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.962+0000 7f54ddaab700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f54d8148320 0x7f54d810ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:31.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.962+0000 7f54ddaab700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f54d8148320 0x7f54d810ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:55508/0 (socket says 172.21.15.80:55508) 2019-11-28T11:45:31.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.962+0000 7f54dd2aa700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d810f290 0x7f54d810dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:42882/0 (socket says 172.21.15.80:42882) 2019-11-28T11:45:31.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.962+0000 7f54ddaab700 1 -- 172.21.15.80:0/1031878783 learned_addr learned my addr 172.21.15.80:0/1031878783 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:31.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.962+0000 7f54dd2aa700 1 -- 172.21.15.80:0/1031878783 >> v2:172.21.15.174:3300/0 conn(0x7f54d8148320 msgr2=0x7f54d810ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:31.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.962+0000 7f54dd2aa700 1 --2- 172.21.15.80:0/1031878783 >> v2:172.21.15.174:3300/0 conn(0x7f54d8148320 0x7f54d810ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:31.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.962+0000 7f54dd2aa700 1 -- 172.21.15.80:0/1031878783 >> v1:172.21.15.174:6789/0 conn(0x7f54d810e110 legacy=0x7f54d81079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:31.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.962+0000 7f54dd2aa700 1 -- 172.21.15.80:0/1031878783 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d810c490 con 0x7f54d810f290 2019-11-28T11:45:31.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.962+0000 7f54dd2aa700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d810f290 0x7f54d810dbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54d4010370 tx=0x7f54d40101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.963+0000 7f54dd2aa700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d810f290 0x7f54d810dbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54d4010370 tx=0x7f54d40101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.963+0000 7f54dd2aa700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d810f290 0x7f54d810dbd0 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7f54d4010370 tx=0x7f54d40101a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:31.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.963+0000 7f54dd2aa700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d810f290 0x7f54d810dbd0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f54d4010370 tx=0x7f54d40101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.963+0000 7f54ca7fc700 1 -- 172.21.15.80:0/1031878783 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d4000ef0 con 0x7f54d810f290 2019-11-28T11:45:31.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.963+0000 7f54dd2aa700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d810f290 0x7f54d810dbd0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f54d4010370 tx=0x7f54d40101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.963+0000 7f54ca7fc700 1 -- 172.21.15.80:0/1031878783 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d4004240 con 0x7f54d810f290 2019-11-28T11:45:31.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.963+0000 7f54dd2aa700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d810f290 0x7f54d810dbd0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f54d4010370 tx=0x7f54d40101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.963+0000 7f54ca7fc700 1 -- 172.21.15.80:0/1031878783 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d4000ed0 con 0x7f54d810f290 2019-11-28T11:45:31.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.963+0000 7f54df50e700 1 -- 172.21.15.80:0/1031878783 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d810c810 con 0x7f54d810f290 2019-11-28T11:45:31.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.963+0000 7f54df50e700 1 -- 172.21.15.80:0/1031878783 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d810c490 con 0x7f54d810f290 2019-11-28T11:45:31.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.963+0000 7f54dd2aa700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d810f290 0x7f54d810dbd0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f54d4010370 tx=0x7f54d40101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.963+0000 7f54ca7fc700 1 -- 172.21.15.80:0/1031878783 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f54d4004430 con 0x7f54d810f290 2019-11-28T11:45:31.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.963+0000 7f54dd2aa700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d810f290 0x7f54d810dbd0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f54d4010370 tx=0x7f54d40101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.963+0000 7f54ca7fc700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f54c0018730 0x7f54c001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:31.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.964+0000 7f54ca7fc700 1 -- 172.21.15.80:0/1031878783 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f54d4031a10 con 0x7f54d810f290 2019-11-28T11:45:31.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.964+0000 7f54ddaab700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f54c0018730 0x7f54c001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:31.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.964+0000 7f54ddaab700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f54c0018730 0x7f54c001abc0 crc :-1 s=READY pgs=732 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:31.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.971+0000 7f54df50e700 1 -- 172.21.15.80:0/1031878783 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d810c810 con 0x7f54d810f290 2019-11-28T11:45:31.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.975+0000 7f54dd2aa700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d810f290 0x7f54d810dbd0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f54d4010370 tx=0x7f54d40101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:30.975+0000 7f54ca7fc700 1 -- 172.21.15.80:0/1031878783 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f54d4000c90 con 0x7f54d810f290 2019-11-28T11:45:31.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.148+0000 7f54df50e700 1 -- 172.21.15.80:0/1031878783 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f54d810c490 con 0x7f54d810f290 2019-11-28T11:45:31.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.789+0000 7f54dd2aa700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d810f290 0x7f54d810dbd0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f54d4010370 tx=0x7f54d40101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.789+0000 7f54ca7fc700 1 -- 172.21.15.80:0/1031878783 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v105) v1 ==== 118+0+0 (secure 0 0 0) 0x7f54d4004410 con 0x7f54d810f290 2019-11-28T11:45:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.816+0000 7f54df50e700 1 -- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f54c0018730 msgr2=0x7f54c001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.816+0000 7f54df50e700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f54c0018730 0x7f54c001abc0 crc :-1 s=READY pgs=732 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.816+0000 7f54df50e700 1 -- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d810f290 msgr2=0x7f54d810dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:31.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.816+0000 7f54df50e700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d810f290 0x7f54d810dbd0 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7f54d4010370 tx=0x7f54d40101a0).stop 2019-11-28T11:45:31.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.816+0000 7f54df50e700 1 -- 172.21.15.80:0/1031878783 shutdown_connections 2019-11-28T11:45:31.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.816+0000 7f54df50e700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f54c0018730 0x7f54c001abc0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:31.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.816+0000 7f54df50e700 1 --2- 172.21.15.80:0/1031878783 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54d810f290 0x7f54d810dbd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:31.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.816+0000 7f54df50e700 1 --2- 172.21.15.80:0/1031878783 >> v2:172.21.15.174:3300/0 conn(0x7f54d8148320 0x7f54d810ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:31.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.816+0000 7f54df50e700 1 -- 172.21.15.80:0/1031878783 shutdown_connections 2019-11-28T11:45:31.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.816+0000 7f54df50e700 1 -- 172.21.15.80:0/1031878783 wait complete. 2019-11-28T11:45:31.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.816+0000 7f54df50e700 1 -- 172.21.15.80:0/1031878783 >> 172.21.15.80:0/1031878783 conn(0x7f54d815e2d0 msgr2=0x7f54d8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:31.867 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:31.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.947+0000 7fbc46316700 1 Processor -- start 2019-11-28T11:45:31.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.947+0000 7fbc46316700 1 -- start start 2019-11-28T11:45:31.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.948+0000 7fbc46316700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc4006c0a0 0x7fbc40072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:31.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.948+0000 7fbc46316700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbc400734e0 0x7fbc40071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:31.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.948+0000 7fbc46316700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc4006db00 con 0x7fbc40072360 2019-11-28T11:45:31.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.948+0000 7fbc46316700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4006f330 con 0x7fbc400734e0 2019-11-28T11:45:31.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.948+0000 7fbc46316700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400706c0 con 0x7fbc4006c0a0 2019-11-28T11:45:31.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.948+0000 7fbc3ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbc400734e0 0x7fbc40071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:31.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.948+0000 7fbc448b3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc4006c0a0 0x7fbc40072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:31.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.948+0000 7fbc450b4700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fbc40072360 0x7fbc4006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:55490/0 (socket says 172.21.15.80:55490) 2019-11-28T11:45:31.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.948+0000 7fbc450b4700 1 -- 172.21.15.80:0/2042818712 learned_addr learned my addr 172.21.15.80:0/2042818712 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:31.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.948+0000 7fbc448b3700 1 -- 172.21.15.80:0/2042818712 >> v2:172.21.15.174:3300/0 conn(0x7fbc400734e0 msgr2=0x7fbc40071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:31.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.948+0000 7fbc448b3700 1 --2- 172.21.15.80:0/2042818712 >> v2:172.21.15.174:3300/0 conn(0x7fbc400734e0 0x7fbc40071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:31.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.948+0000 7fbc448b3700 1 -- 172.21.15.80:0/2042818712 >> v1:172.21.15.174:6789/0 conn(0x7fbc40072360 legacy=0x7fbc4006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:31.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.948+0000 7fbc448b3700 1 -- 172.21.15.80:0/2042818712 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40070a40 con 0x7fbc4006c0a0 2019-11-28T11:45:31.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.948+0000 7fbc3f7fe700 1 -- 172.21.15.80:0/2042818712 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333632651 0 0) 0x7fbc38001100 con 0x7fbc40072360 2019-11-28T11:45:31.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.948+0000 7fbc3ffff700 1 --2- 172.21.15.80:0/2042818712 >> v2:172.21.15.174:3300/0 conn(0x7fbc400734e0 0x7fbc40071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:31.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.949+0000 7fbc448b3700 1 --2- 172.21.15.80:0/2042818712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc4006c0a0 0x7fbc40072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbc2800af50 tx=0x7fbc2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.949+0000 7fbc448b3700 1 --2- 172.21.15.80:0/2042818712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc4006c0a0 0x7fbc40072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbc2800af50 tx=0x7fbc2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.949+0000 7fbc448b3700 1 --2- 172.21.15.80:0/2042818712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc4006c0a0 0x7fbc40072fa0 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7fbc2800af50 tx=0x7fbc2800b760).ready entity=mon.2 client_cookie=73637c9943864f7a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:31.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.949+0000 7fbc448b3700 1 --2- 172.21.15.80:0/2042818712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc4006c0a0 0x7fbc40072fa0 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fbc2800af50 tx=0x7fbc2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.949+0000 7fbc3f7fe700 1 -- 172.21.15.80:0/2042818712 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc28007210 con 0x7fbc4006c0a0 2019-11-28T11:45:31.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.949+0000 7fbc448b3700 1 --2- 172.21.15.80:0/2042818712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc4006c0a0 0x7fbc40072fa0 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fbc2800af50 tx=0x7fbc2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.949+0000 7fbc448b3700 1 --2- 172.21.15.80:0/2042818712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc4006c0a0 0x7fbc40072fa0 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fbc2800af50 tx=0x7fbc2800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.949+0000 7fbc3f7fe700 1 -- 172.21.15.80:0/2042818712 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc280099b0 con 0x7fbc4006c0a0 2019-11-28T11:45:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.949+0000 7fbc3f7fe700 1 -- 172.21.15.80:0/2042818712 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc2800a080 con 0x7fbc4006c0a0 2019-11-28T11:45:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.949+0000 7fbc46316700 1 -- 172.21.15.80:0/2042818712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc4006c0a0 msgr2=0x7fbc40072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.949+0000 7fbc46316700 1 --2- 172.21.15.80:0/2042818712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc4006c0a0 0x7fbc40072fa0 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7fbc2800af50 tx=0x7fbc2800b760).stop 2019-11-28T11:45:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.949+0000 7fbc46316700 1 -- 172.21.15.80:0/2042818712 shutdown_connections 2019-11-28T11:45:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.949+0000 7fbc46316700 1 --2- 172.21.15.80:0/2042818712 >> v2:172.21.15.174:3300/0 conn(0x7fbc400734e0 0x7fbc40071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.949+0000 7fbc46316700 1 --2- 172.21.15.80:0/2042818712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc4006c0a0 0x7fbc40072fa0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:31.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.950+0000 7fbc46316700 1 -- 172.21.15.80:0/2042818712 shutdown_connections 2019-11-28T11:45:31.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.950+0000 7fbc46316700 1 -- 172.21.15.80:0/2042818712 wait complete. 2019-11-28T11:45:31.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.950+0000 7fbc46316700 1 -- 172.21.15.80:0/2042818712 >> 172.21.15.80:0/2042818712 conn(0x7fbc40061cf0 msgr2=0x7fbc40064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:32.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.952+0000 7fbc46316700 1 Processor -- start 2019-11-28T11:45:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.952+0000 7fbc46316700 1 -- start start 2019-11-28T11:45:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.953+0000 7fbc46316700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbc4013e9e0 0x7fbc40108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.953+0000 7fbc46316700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbc40109430 0x7fbc401098b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.953+0000 7fbc46316700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc401066e0 con 0x7fbc4013e5f0 2019-11-28T11:45:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.953+0000 7fbc46316700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4010e060 con 0x7fbc4013e9e0 2019-11-28T11:45:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.953+0000 7fbc46316700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4010e330 con 0x7fbc40109430 2019-11-28T11:45:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.953+0000 7fbc3ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbc4013e9e0 0x7fbc40108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.953+0000 7fbc3ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbc4013e9e0 0x7fbc40108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40634/0 (socket says 172.21.15.80:40634) 2019-11-28T11:45:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.953+0000 7fbc3ffff700 1 -- 172.21.15.80:0/3292459355 learned_addr learned my addr 172.21.15.80:0/3292459355 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.953+0000 7fbc450b4700 1 --2- 172.21.15.80:0/3292459355 >> v2:172.21.15.174:3300/0 conn(0x7fbc40109430 0x7fbc401098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.953+0000 7fbc3d7fa700 1 -- 172.21.15.80:0/3292459355 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725311997 0 0) 0x7fbc2800b250 con 0x7fbc4013e5f0 2019-11-28T11:45:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.953+0000 7fbc3ffff700 1 -- 172.21.15.80:0/3292459355 >> v2:172.21.15.174:3300/0 conn(0x7fbc40109430 msgr2=0x7fbc401098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.953+0000 7fbc3ffff700 1 --2- 172.21.15.80:0/3292459355 >> v2:172.21.15.174:3300/0 conn(0x7fbc40109430 0x7fbc401098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.953+0000 7fbc3ffff700 1 -- 172.21.15.80:0/3292459355 >> v1:172.21.15.174:6789/0 conn(0x7fbc4013e5f0 legacy=0x7fbc4010a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.953+0000 7fbc3ffff700 1 -- 172.21.15.80:0/3292459355 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4010e9c0 con 0x7fbc4013e9e0 2019-11-28T11:45:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.953+0000 7fbc3ffff700 1 --2- 172.21.15.80:0/3292459355 >> v2:172.21.15.80:3300/0 conn(0x7fbc4013e9e0 0x7fbc40108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbc30010790 tx=0x7fbc30010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.953+0000 7fbc3ffff700 1 --2- 172.21.15.80:0/3292459355 >> v2:172.21.15.80:3300/0 conn(0x7fbc4013e9e0 0x7fbc40108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbc30010790 tx=0x7fbc30010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.954+0000 7fbc3ffff700 1 --2- 172.21.15.80:0/3292459355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc4013e9e0 0x7fbc40108ef0 secure :-1 s=READY pgs=1805 cs=0 l=1 rx=0x7fbc30010790 tx=0x7fbc30010610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.954+0000 7fbc3ffff700 1 --2- 172.21.15.80:0/3292459355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc4013e9e0 0x7fbc40108ef0 secure :-1 s=THROTTLE_DONE pgs=1805 cs=0 l=1 rx=0x7fbc30010790 tx=0x7fbc30010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.954+0000 7fbc3d7fa700 1 -- 172.21.15.80:0/3292459355 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc30000cc0 con 0x7fbc4013e9e0 2019-11-28T11:45:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.954+0000 7fbc3ffff700 1 --2- 172.21.15.80:0/3292459355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc4013e9e0 0x7fbc40108ef0 secure :-1 s=THROTTLE_DONE pgs=1805 cs=0 l=1 rx=0x7fbc30010790 tx=0x7fbc30010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.954+0000 7fbc3ffff700 1 --2- 172.21.15.80:0/3292459355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc4013e9e0 0x7fbc40108ef0 secure :-1 s=THROTTLE_DONE pgs=1805 cs=0 l=1 rx=0x7fbc30010790 tx=0x7fbc30010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.954+0000 7fbc3d7fa700 1 -- 172.21.15.80:0/3292459355 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc30009af0 con 0x7fbc4013e9e0 2019-11-28T11:45:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.954+0000 7fbc46316700 1 -- 172.21.15.80:0/3292459355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4010ed40 con 0x7fbc4013e9e0 2019-11-28T11:45:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.954+0000 7fbc3d7fa700 1 -- 172.21.15.80:0/3292459355 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc3000a1c0 con 0x7fbc4013e9e0 2019-11-28T11:45:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.954+0000 7fbc46316700 1 -- 172.21.15.80:0/3292459355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4010e9c0 con 0x7fbc4013e9e0 2019-11-28T11:45:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.955+0000 7fbc3ffff700 1 --2- 172.21.15.80:0/3292459355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc4013e9e0 0x7fbc40108ef0 secure :-1 s=THROTTLE_DONE pgs=1805 cs=0 l=1 rx=0x7fbc30010790 tx=0x7fbc30010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.955+0000 7fbc3d7fa700 1 -- 172.21.15.80:0/3292459355 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbc30009900 con 0x7fbc4013e9e0 2019-11-28T11:45:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.955+0000 7fbc3ffff700 1 --2- 172.21.15.80:0/3292459355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc4013e9e0 0x7fbc40108ef0 secure :-1 s=THROTTLE_DONE pgs=1805 cs=0 l=1 rx=0x7fbc30010790 tx=0x7fbc30010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.955+0000 7fbc3d7fa700 1 --2- 172.21.15.80:0/3292459355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc24018730 0x7fbc2401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:32.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.955+0000 7fbc3d7fa700 1 -- 172.21.15.80:0/3292459355 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fbc30031de0 con 0x7fbc4013e9e0 2019-11-28T11:45:32.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.955+0000 7fbc448b3700 1 --2- 172.21.15.80:0/3292459355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc24018730 0x7fbc2401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:32.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.955+0000 7fbc448b3700 1 --2- 172.21.15.80:0/3292459355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc24018730 0x7fbc2401abc0 crc :-1 s=READY pgs=733 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:32.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.962+0000 7fbc46316700 1 -- 172.21.15.80:0/3292459355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4010ed40 con 0x7fbc4013e9e0 2019-11-28T11:45:32.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.966+0000 7fbc3ffff700 1 --2- 172.21.15.80:0/3292459355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc4013e9e0 0x7fbc40108ef0 secure :-1 s=THROTTLE_DONE pgs=1805 cs=0 l=1 rx=0x7fbc30010790 tx=0x7fbc30010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:31.966+0000 7fbc3d7fa700 1 -- 172.21.15.80:0/3292459355 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbc3000a930 con 0x7fbc4013e9e0 2019-11-28T11:45:32.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.138+0000 7fbc46316700 1 -- 172.21.15.80:0/3292459355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc4010e9c0 con 0x7fbc4013e9e0 2019-11-28T11:45:32.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.138+0000 7fbc3ffff700 1 --2- 172.21.15.80:0/3292459355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc4013e9e0 0x7fbc40108ef0 secure :-1 s=THROTTLE_DONE pgs=1805 cs=0 l=1 rx=0x7fbc30010790 tx=0x7fbc30010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.138+0000 7fbc3d7fa700 1 -- 172.21.15.80:0/3292459355 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+1428 (secure 0 0 0) 0x7fbc30017c00 con 0x7fbc4013e9e0 2019-11-28T11:45:32.179 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 105 2019-11-28T11:45:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:32.179 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":105,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:30.152127+0000","modified":"2019-11-28T11:45:31.784125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2019-11-28T11:45:32.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.140+0000 7fbc46316700 1 -- 172.21.15.80:0/3292459355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc24018730 msgr2=0x7fbc2401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:32.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.140+0000 7fbc46316700 1 --2- 172.21.15.80:0/3292459355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc24018730 0x7fbc2401abc0 crc :-1 s=READY pgs=733 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:32.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.140+0000 7fbc46316700 1 -- 172.21.15.80:0/3292459355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc4013e9e0 msgr2=0x7fbc40108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:32.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.140+0000 7fbc46316700 1 --2- 172.21.15.80:0/3292459355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc4013e9e0 0x7fbc40108ef0 secure :-1 s=READY pgs=1805 cs=0 l=1 rx=0x7fbc30010790 tx=0x7fbc30010610).stop 2019-11-28T11:45:32.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.141+0000 7fbc46316700 1 -- 172.21.15.80:0/3292459355 shutdown_connections 2019-11-28T11:45:32.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.141+0000 7fbc46316700 1 --2- 172.21.15.80:0/3292459355 >> v2:172.21.15.174:3300/0 conn(0x7fbc40109430 0x7fbc401098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:32.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.141+0000 7fbc46316700 1 --2- 172.21.15.80:0/3292459355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbc4013e9e0 0x7fbc40108ef0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:32.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.141+0000 7fbc46316700 1 --2- 172.21.15.80:0/3292459355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbc24018730 0x7fbc2401abc0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:32.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.141+0000 7fbc46316700 1 -- 172.21.15.80:0/3292459355 shutdown_connections 2019-11-28T11:45:32.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.141+0000 7fbc46316700 1 -- 172.21.15.80:0/3292459355 wait complete. 2019-11-28T11:45:32.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.141+0000 7fbc46316700 1 -- 172.21.15.80:0/3292459355 >> 172.21.15.80:0/3292459355 conn(0x7fbc4013d620 msgr2=0x7fbc4013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:32.190 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:45:32.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.271+0000 7f5936741700 1 Processor -- start 2019-11-28T11:45:32.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.271+0000 7f5936741700 1 -- start start 2019-11-28T11:45:32.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.272+0000 7f5936741700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f593006c490 0x7f593006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:32.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.272+0000 7f5936741700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593006db00 con 0x7f593006c0a0 2019-11-28T11:45:32.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.272+0000 7f5936741700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593006e000 con 0x7f593006ce60 2019-11-28T11:45:32.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.272+0000 7f5936741700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593006fd60 con 0x7f593006c490 2019-11-28T11:45:32.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.272+0000 7f5934cde700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f593006c0a0 0x7f5930072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39958/0 (socket says 172.21.15.80:39958) 2019-11-28T11:45:32.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.272+0000 7f5934cde700 1 -- 172.21.15.80:0/2402828817 learned_addr learned my addr 172.21.15.80:0/2402828817 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:32.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.272+0000 7f592ffff700 1 --2- 172.21.15.80:0/2402828817 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f593006c490 0x7f593006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:32.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.272+0000 7f592f7fe700 1 -- 172.21.15.80:0/2402828817 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373947786 0 0) 0x7f5920001150 con 0x7f593006c0a0 2019-11-28T11:45:32.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.272+0000 7f592f7fe700 1 -- 172.21.15.80:0/2402828817 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5918002e80 con 0x7f593006c0a0 2019-11-28T11:45:32.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.272+0000 7f592f7fe700 1 -- 172.21.15.80:0/2402828817 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540019312 0 0) 0x7f5928000d30 con 0x7f593006ce60 2019-11-28T11:45:32.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.272+0000 7f592f7fe700 1 -- 172.21.15.80:0/2402828817 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5918004170 con 0x7f593006ce60 2019-11-28T11:45:32.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.273+0000 7f592ffff700 1 -- 172.21.15.80:0/2402828817 >> v1:172.21.15.174:6789/0 conn(0x7f593006ce60 legacy=0x7f5930164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:32.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.273+0000 7f592ffff700 1 -- 172.21.15.80:0/2402828817 >> v1:172.21.15.80:6789/0 conn(0x7f593006c0a0 legacy=0x7f5930072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:32.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.273+0000 7f592ffff700 1 -- 172.21.15.80:0/2402828817 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59300706c0 con 0x7f593006c490 2019-11-28T11:45:32.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.273+0000 7f592ffff700 1 --2- 172.21.15.80:0/2402828817 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f593006c490 0x7f593006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f592400af50 tx=0x7f592400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.273+0000 7f592ffff700 1 --2- 172.21.15.80:0/2402828817 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f593006c490 0x7f593006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f592400af50 tx=0x7f592400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.273+0000 7f592ffff700 1 --2- 172.21.15.80:0/2402828817 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f593006c490 0x7f593006c920 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7f592400af50 tx=0x7f592400b760).ready entity=mon.2 client_cookie=54d0f2fe70bfd6aa server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:32.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.273+0000 7f592ffff700 1 --2- 172.21.15.80:0/2402828817 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f593006c490 0x7f593006c920 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f592400af50 tx=0x7f592400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.273+0000 7f592f7fe700 1 -- 172.21.15.80:0/2402828817 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5924000960 con 0x7f593006c490 2019-11-28T11:45:32.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.273+0000 7f592ffff700 1 --2- 172.21.15.80:0/2402828817 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f593006c490 0x7f593006c920 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f592400af50 tx=0x7f592400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.273+0000 7f592ffff700 1 --2- 172.21.15.80:0/2402828817 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f593006c490 0x7f593006c920 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f592400af50 tx=0x7f592400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.273+0000 7f592f7fe700 1 -- 172.21.15.80:0/2402828817 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5924009860 con 0x7f593006c490 2019-11-28T11:45:32.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.273+0000 7f592f7fe700 1 -- 172.21.15.80:0/2402828817 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5924009f30 con 0x7f593006c490 2019-11-28T11:45:32.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.273+0000 7f5936741700 1 -- 172.21.15.80:0/2402828817 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f593006c490 msgr2=0x7f593006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:32.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.273+0000 7f5936741700 1 --2- 172.21.15.80:0/2402828817 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f593006c490 0x7f593006c920 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7f592400af50 tx=0x7f592400b760).stop 2019-11-28T11:45:32.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.274+0000 7f5936741700 1 -- 172.21.15.80:0/2402828817 shutdown_connections 2019-11-28T11:45:32.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.274+0000 7f5936741700 1 --2- 172.21.15.80:0/2402828817 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f593006c490 0x7f593006c920 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:32.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.274+0000 7f5936741700 1 -- 172.21.15.80:0/2402828817 shutdown_connections 2019-11-28T11:45:32.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.274+0000 7f5936741700 1 -- 172.21.15.80:0/2402828817 wait complete. 2019-11-28T11:45:32.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.274+0000 7f5936741700 1 -- 172.21.15.80:0/2402828817 >> 172.21.15.80:0/2402828817 conn(0x7f5930061cf0 msgr2=0x7f5930064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:32.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.276+0000 7f5936741700 1 Processor -- start 2019-11-28T11:45:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.276+0000 7f5936741700 1 -- start start 2019-11-28T11:45:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.277+0000 7f5936741700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5930135760 0x7f5930137480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.277+0000 7f5936741700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f593012a150 0x7f593012a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.277+0000 7f5936741700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5930136480 con 0x7f593012ab20 2019-11-28T11:45:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.277+0000 7f5936741700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5930104370 con 0x7f5930135760 2019-11-28T11:45:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.277+0000 7f5936741700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59301346a0 con 0x7f593012a150 2019-11-28T11:45:32.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.277+0000 7f5934cde700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5930135760 0x7f5930137480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.277+0000 7f5934cde700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5930135760 0x7f5930137480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40648/0 (socket says 172.21.15.80:40648) 2019-11-28T11:45:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.277+0000 7f5934cde700 1 -- 172.21.15.80:0/1965298879 learned_addr learned my addr 172.21.15.80:0/1965298879 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.277+0000 7f592ffff700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f593012a150 0x7f593012a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.277+0000 7f5934cde700 1 -- 172.21.15.80:0/1965298879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f593012a150 msgr2=0x7f593012a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.278+0000 7f5934cde700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f593012a150 0x7f593012a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.278+0000 7f5934cde700 1 -- 172.21.15.80:0/1965298879 >> v1:172.21.15.174:6789/0 conn(0x7f593012ab20 legacy=0x7f5930106140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:32.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.278+0000 7f5934cde700 1 -- 172.21.15.80:0/1965298879 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5930104a00 con 0x7f5930135760 2019-11-28T11:45:32.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.278+0000 7f5934cde700 1 --2- 172.21.15.80:0/1965298879 >> v2:172.21.15.80:3300/0 conn(0x7f5930135760 0x7f5930137480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59200125f0 tx=0x7f5920012470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.278+0000 7f5934cde700 1 --2- 172.21.15.80:0/1965298879 >> v2:172.21.15.80:3300/0 conn(0x7f5930135760 0x7f5930137480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59200125f0 tx=0x7f5920012470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.278+0000 7f5934cde700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5930135760 0x7f5930137480 secure :-1 s=READY pgs=1807 cs=0 l=1 rx=0x7f59200125f0 tx=0x7f5920012470).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:32.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.278+0000 7f5934cde700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5930135760 0x7f5930137480 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7f59200125f0 tx=0x7f5920012470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.278+0000 7f592d7fa700 1 -- 172.21.15.80:0/1965298879 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5920000c90 con 0x7f5930135760 2019-11-28T11:45:32.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.278+0000 7f5934cde700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5930135760 0x7f5930137480 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7f59200125f0 tx=0x7f5920012470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.278+0000 7f5934cde700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5930135760 0x7f5930137480 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7f59200125f0 tx=0x7f5920012470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.278+0000 7f592d7fa700 1 -- 172.21.15.80:0/1965298879 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59200010c0 con 0x7f5930135760 2019-11-28T11:45:32.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.278+0000 7f5936741700 1 -- 172.21.15.80:0/1965298879 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5930104d80 con 0x7f5930135760 2019-11-28T11:45:32.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.278+0000 7f592d7fa700 1 -- 172.21.15.80:0/1965298879 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5920001750 con 0x7f5930135760 2019-11-28T11:45:32.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.278+0000 7f5936741700 1 -- 172.21.15.80:0/1965298879 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5930104a00 con 0x7f5930135760 2019-11-28T11:45:32.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.279+0000 7f5934cde700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5930135760 0x7f5930137480 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7f59200125f0 tx=0x7f5920012470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.279+0000 7f592d7fa700 1 -- 172.21.15.80:0/1965298879 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5920000c90 con 0x7f5930135760 2019-11-28T11:45:32.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.279+0000 7f5934cde700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5930135760 0x7f5930137480 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7f59200125f0 tx=0x7f5920012470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.279+0000 7f592d7fa700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5910018730 0x7f591001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:32.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.279+0000 7f592d7fa700 1 -- 172.21.15.80:0/1965298879 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5920033cd0 con 0x7f5930135760 2019-11-28T11:45:32.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.279+0000 7f592ffff700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5910018730 0x7f591001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:32.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.279+0000 7f592ffff700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5910018730 0x7f591001abc0 crc :-1 s=READY pgs=734 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.286+0000 7f5936741700 1 -- 172.21.15.80:0/1965298879 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5930104d80 con 0x7f5930135760 2019-11-28T11:45:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.290+0000 7f5934cde700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5930135760 0x7f5930137480 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7f59200125f0 tx=0x7f5920012470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.290+0000 7f592d7fa700 1 -- 172.21.15.80:0/1965298879 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f592002bf70 con 0x7f5930135760 2019-11-28T11:45:32.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.464+0000 7f5936741700 1 -- 172.21.15.80:0/1965298879 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5930104a00 con 0x7f5930135760 2019-11-28T11:45:32.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.465+0000 7f5934cde700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5930135760 0x7f5930137480 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7f59200125f0 tx=0x7f5920012470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.465+0000 7f592d7fa700 1 -- 172.21.15.80:0/1965298879 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f592002bf70 con 0x7f5930135760 2019-11-28T11:45:32.506 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:32.506 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":141,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:45:31.153550+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:45:28.436380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2019-11-28T11:45:29.126890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:45:32.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.467+0000 7f5936741700 1 -- 172.21.15.80:0/1965298879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5910018730 msgr2=0x7f591001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:32.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.467+0000 7f5936741700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5910018730 0x7f591001abc0 crc :-1 s=READY pgs=734 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:32.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.467+0000 7f5936741700 1 -- 172.21.15.80:0/1965298879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5930135760 msgr2=0x7f5930137480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:32.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.467+0000 7f5936741700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5930135760 0x7f5930137480 secure :-1 s=READY pgs=1807 cs=0 l=1 rx=0x7f59200125f0 tx=0x7f5920012470).stop 2019-11-28T11:45:32.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.467+0000 7f5936741700 1 -- 172.21.15.80:0/1965298879 shutdown_connections 2019-11-28T11:45:32.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.467+0000 7f5936741700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5910018730 0x7f591001abc0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:32.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.467+0000 7f5936741700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f593012a150 0x7f593012a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:32.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.467+0000 7f5936741700 1 --2- 172.21.15.80:0/1965298879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5930135760 0x7f5930137480 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:32.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.467+0000 7f5936741700 1 -- 172.21.15.80:0/1965298879 shutdown_connections 2019-11-28T11:45:32.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.467+0000 7f5936741700 1 -- 172.21.15.80:0/1965298879 wait complete. 2019-11-28T11:45:32.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.467+0000 7f5936741700 1 -- 172.21.15.80:0/1965298879 >> 172.21.15.80:0/1965298879 conn(0x7f593013d930 msgr2=0x7f5930102360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:32.518 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:45:32.519 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:45:32.519 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:45:32.519 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:45:32.520 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:45:32.520 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:45:32.524 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:45:32.524 DEBUG:teuthology.parallel:result is None 2019-11-28T11:45:32.525 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:45:32.525 DEBUG:teuthology.parallel:result is None 2019-11-28T11:45:32.525 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:45:32.526 DEBUG:teuthology.parallel:result is None 2019-11-28T11:45:32.526 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:45:32.609 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:45:32.615 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:45:32.615 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:45:32.616 INFO:tasks.ceph.mds.b.smithi080.stderr:2019-11-28T11:45:32.576+0000 7f86d4c13700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2019-11-28T11:45:32.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.638+0000 7f95ea523700 1 Processor -- start 2019-11-28T11:45:32.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.638+0000 7f95ea523700 1 -- start start 2019-11-28T11:45:32.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.639+0000 7f95ea523700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f95e415f100 0x7f95e406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:32.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.639+0000 7f95ea523700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95e406c2f0 0x7f95e406c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:32.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.639+0000 7f95ea523700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e406db60 con 0x7f95e415ed10 2019-11-28T11:45:32.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.639+0000 7f95ea523700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e406fe00 con 0x7f95e406c2f0 2019-11-28T11:45:32.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.639+0000 7f95ea523700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e40700d0 con 0x7f95e415f100 2019-11-28T11:45:32.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.639+0000 7f95e92c1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95e406c2f0 0x7f95e406c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:32.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.639+0000 7f95e92c1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95e406c2f0 0x7f95e406c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40682/0 (socket says 172.21.15.80:40682) 2019-11-28T11:45:32.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.639+0000 7f95e92c1700 1 -- 172.21.15.80:0/547103929 learned_addr learned my addr 172.21.15.80:0/547103929 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:32.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.639+0000 7f95e3fff700 1 --2- 172.21.15.80:0/547103929 >> v2:172.21.15.174:3300/0 conn(0x7f95e415f100 0x7f95e406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:32.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.639+0000 7f95e92c1700 1 -- 172.21.15.80:0/547103929 >> v2:172.21.15.174:3300/0 conn(0x7f95e415f100 msgr2=0x7f95e406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:32.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.639+0000 7f95e92c1700 1 --2- 172.21.15.80:0/547103929 >> v2:172.21.15.174:3300/0 conn(0x7f95e415f100 0x7f95e406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:32.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.639+0000 7f95e92c1700 1 -- 172.21.15.80:0/547103929 >> v1:172.21.15.174:6789/0 conn(0x7f95e415ed10 legacy=0x7f95e4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:32.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.639+0000 7f95e92c1700 1 -- 172.21.15.80:0/547103929 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e4070760 con 0x7f95e406c2f0 2019-11-28T11:45:32.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.639+0000 7f95e92c1700 1 --2- 172.21.15.80:0/547103929 >> v2:172.21.15.80:3300/0 conn(0x7f95e406c2f0 0x7f95e406c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f95dc00f6b0 tx=0x7f95dc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.639+0000 7f95e92c1700 1 --2- 172.21.15.80:0/547103929 >> v2:172.21.15.80:3300/0 conn(0x7f95e406c2f0 0x7f95e406c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f95dc00f6b0 tx=0x7f95dc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.639+0000 7f95e92c1700 1 --2- 172.21.15.80:0/547103929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e406c2f0 0x7f95e406c770 secure :-1 s=READY pgs=1816 cs=0 l=1 rx=0x7f95dc00f6b0 tx=0x7f95dc00fa50).ready entity=mon.0 client_cookie=f7bb304be5d6aa37 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:32.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.640+0000 7f95e92c1700 1 --2- 172.21.15.80:0/547103929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e406c2f0 0x7f95e406c770 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f95dc00f6b0 tx=0x7f95dc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.640+0000 7f95e92c1700 1 --2- 172.21.15.80:0/547103929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e406c2f0 0x7f95e406c770 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f95dc00f6b0 tx=0x7f95dc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.640+0000 7f95e37fe700 1 -- 172.21.15.80:0/547103929 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95dc000a70 con 0x7f95e406c2f0 2019-11-28T11:45:32.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.640+0000 7f95e92c1700 1 --2- 172.21.15.80:0/547103929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e406c2f0 0x7f95e406c770 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f95dc00f6b0 tx=0x7f95dc00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.640+0000 7f95e37fe700 1 -- 172.21.15.80:0/547103929 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc0010e0 con 0x7f95e406c2f0 2019-11-28T11:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.640+0000 7f95e37fe700 1 -- 172.21.15.80:0/547103929 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95dc0017b0 con 0x7f95e406c2f0 2019-11-28T11:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.640+0000 7f95ea523700 1 -- 172.21.15.80:0/547103929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e406c2f0 msgr2=0x7f95e406c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.640+0000 7f95ea523700 1 --2- 172.21.15.80:0/547103929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e406c2f0 0x7f95e406c770 secure :-1 s=READY pgs=1816 cs=0 l=1 rx=0x7f95dc00f6b0 tx=0x7f95dc00fa50).stop 2019-11-28T11:45:32.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.640+0000 7f95ea523700 1 -- 172.21.15.80:0/547103929 shutdown_connections 2019-11-28T11:45:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.640+0000 7f95ea523700 1 --2- 172.21.15.80:0/547103929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e406c2f0 0x7f95e406c770 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.640+0000 7f95ea523700 1 --2- 172.21.15.80:0/547103929 >> v2:172.21.15.174:3300/0 conn(0x7f95e415f100 0x7f95e406bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.640+0000 7f95ea523700 1 -- 172.21.15.80:0/547103929 shutdown_connections 2019-11-28T11:45:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.640+0000 7f95ea523700 1 -- 172.21.15.80:0/547103929 wait complete. 2019-11-28T11:45:32.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.640+0000 7f95ea523700 1 -- 172.21.15.80:0/547103929 >> 172.21.15.80:0/547103929 conn(0x7f95e4061d40 msgr2=0x7f95e40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:32.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.643+0000 7f95ea523700 1 Processor -- start 2019-11-28T11:45:32.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.643+0000 7f95ea523700 1 -- start start 2019-11-28T11:45:32.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95ea523700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95e415ed10 0x7f95e414d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:32.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95ea523700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e410f890 con 0x7f95e412d320 2019-11-28T11:45:32.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95ea523700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e410fd90 con 0x7f95e410f000 2019-11-28T11:45:32.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95ea523700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e410e7c0 con 0x7f95e415ed10 2019-11-28T11:45:32.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95e92c1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f95e412d320 0x7f95e412d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40004/0 (socket says 172.21.15.80:40004) 2019-11-28T11:45:32.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95e92c1700 1 -- 172.21.15.80:0/186776907 learned_addr learned my addr 172.21.15.80:0/186776907 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:32.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95e3fff700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95e415ed10 0x7f95e414d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:32.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95e17fa700 1 -- 172.21.15.80:0/186776907 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224833102 0 0) 0x7f95dc0079e0 con 0x7f95e412d320 2019-11-28T11:45:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95e17fa700 1 -- 172.21.15.80:0/186776907 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95c8002e80 con 0x7f95e412d320 2019-11-28T11:45:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95e17fa700 1 -- 172.21.15.80:0/186776907 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683456112 0 0) 0x7f95cc001080 con 0x7f95e410f000 2019-11-28T11:45:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95e17fa700 1 -- 172.21.15.80:0/186776907 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95c8002ec0 con 0x7f95e410f000 2019-11-28T11:45:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95e3fff700 1 -- 172.21.15.80:0/186776907 >> v1:172.21.15.174:6789/0 conn(0x7f95e410f000 legacy=0x7f95e414cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95e3fff700 1 -- 172.21.15.80:0/186776907 >> v1:172.21.15.80:6789/0 conn(0x7f95e412d320 legacy=0x7f95e412d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95e3fff700 1 -- 172.21.15.80:0/186776907 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e415f1a0 con 0x7f95e415ed10 2019-11-28T11:45:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95e3fff700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95e415ed10 0x7f95e414d470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f95d40106f0 tx=0x7f95d4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95e3fff700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95e415ed10 0x7f95e414d470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f95d40106f0 tx=0x7f95d4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.644+0000 7f95e3fff700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95e415ed10 0x7f95e414d470 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7f95d40106f0 tx=0x7f95d4010a90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:32.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.645+0000 7f95e3fff700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95e415ed10 0x7f95e414d470 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f95d40106f0 tx=0x7f95d4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.645+0000 7f95e17fa700 1 -- 172.21.15.80:0/186776907 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95d400aa70 con 0x7f95e415ed10 2019-11-28T11:45:32.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.645+0000 7f95e3fff700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95e415ed10 0x7f95e414d470 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f95d40106f0 tx=0x7f95d4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.645+0000 7f95e3fff700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95e415ed10 0x7f95e414d470 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f95d40106f0 tx=0x7f95d4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.645+0000 7f95e17fa700 1 -- 172.21.15.80:0/186776907 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d400bee0 con 0x7f95e415ed10 2019-11-28T11:45:32.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.645+0000 7f95ea523700 1 -- 172.21.15.80:0/186776907 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e415f1a0 con 0x7f95e415ed10 2019-11-28T11:45:32.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.645+0000 7f95e17fa700 1 -- 172.21.15.80:0/186776907 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95d400c740 con 0x7f95e415ed10 2019-11-28T11:45:32.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.645+0000 7f95ea523700 1 -- 172.21.15.80:0/186776907 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e415f1a0 con 0x7f95e415ed10 2019-11-28T11:45:32.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.645+0000 7f95e3fff700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95e415ed10 0x7f95e414d470 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f95d40106f0 tx=0x7f95d4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.645+0000 7f95e17fa700 1 -- 172.21.15.80:0/186776907 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f95d400c0d0 con 0x7f95e415ed10 2019-11-28T11:45:32.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.645+0000 7f95e3fff700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95e415ed10 0x7f95e414d470 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f95d40106f0 tx=0x7f95d4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.645+0000 7f95e17fa700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f95c8018790 0x7f95c801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.645+0000 7f95e17fa700 1 -- 172.21.15.80:0/186776907 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f95d4031e30 con 0x7f95e415ed10 2019-11-28T11:45:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.646+0000 7f95e8ac0700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f95c8018790 0x7f95c801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.646+0000 7f95e8ac0700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f95c8018790 0x7f95c801abe0 crc :-1 s=READY pgs=735 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:32.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.653+0000 7f95ea523700 1 -- 172.21.15.80:0/186776907 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e414b530 con 0x7f95e415ed10 2019-11-28T11:45:32.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.657+0000 7f95e3fff700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95e415ed10 0x7f95e414d470 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f95d40106f0 tx=0x7f95d4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.657+0000 7f95e17fa700 1 -- 172.21.15.80:0/186776907 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f95d400bcd0 con 0x7f95e415ed10 2019-11-28T11:45:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.828+0000 7f95ea523700 1 -- 172.21.15.80:0/186776907 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f95e414b8b0 con 0x7f95e415ed10 2019-11-28T11:45:32.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.831+0000 7f95e3fff700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95e415ed10 0x7f95e414d470 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f95d40106f0 tx=0x7f95d4010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:32.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.831+0000 7f95e17fa700 1 -- 172.21.15.80:0/186776907 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v48) v1 ==== 184+0+0 (secure 0 0 0) 0x7f95d400c470 con 0x7f95e415ed10 2019-11-28T11:45:32.875 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:45:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.837+0000 7f95ea523700 1 -- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f95c8018790 msgr2=0x7f95c801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.837+0000 7f95ea523700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f95c8018790 0x7f95c801abe0 crc :-1 s=READY pgs=735 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.837+0000 7f95ea523700 1 -- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95e415ed10 msgr2=0x7f95e414d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.837+0000 7f95ea523700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95e415ed10 0x7f95e414d470 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7f95d40106f0 tx=0x7f95d4010a90).stop 2019-11-28T11:45:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.837+0000 7f95ea523700 1 -- 172.21.15.80:0/186776907 shutdown_connections 2019-11-28T11:45:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.837+0000 7f95ea523700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95e415ed10 0x7f95e414d470 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.837+0000 7f95ea523700 1 --2- 172.21.15.80:0/186776907 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f95c8018790 0x7f95c801abe0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.837+0000 7f95ea523700 1 -- 172.21.15.80:0/186776907 shutdown_connections 2019-11-28T11:45:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.837+0000 7f95ea523700 1 -- 172.21.15.80:0/186776907 wait complete. 2019-11-28T11:45:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.837+0000 7f95ea523700 1 -- 172.21.15.80:0/186776907 >> 172.21.15.80:0/186776907 conn(0x7f95e414eee0 msgr2=0x7f95e4149850 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:32.888 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:45:33.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.982+0000 7f1b666a5700 1 Processor -- start 2019-11-28T11:45:33.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.982+0000 7f1b666a5700 1 -- start start 2019-11-28T11:45:33.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b666a5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b6015f100 0x7f1b6006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b666a5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1b6006c2f0 0x7f1b6006c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b666a5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6006db60 con 0x7f1b6015ed10 2019-11-28T11:45:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b666a5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6006fe00 con 0x7f1b6006c2f0 2019-11-28T11:45:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b666a5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600700d0 con 0x7f1b6015f100 2019-11-28T11:45:33.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b65443700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1b6006c2f0 0x7f1b6006c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b65443700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1b6006c2f0 0x7f1b6006c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40696/0 (socket says 172.21.15.80:40696) 2019-11-28T11:45:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b65443700 1 -- 172.21.15.80:0/1169515850 learned_addr learned my addr 172.21.15.80:0/1169515850 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b64c42700 1 --1- 172.21.15.80:0/1169515850 >> v1:172.21.15.174:6789/0 conn(0x7f1b6015ed10 0x7f1b60073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:55552/0 (socket says 172.21.15.80:55552) 2019-11-28T11:45:33.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b5ffff700 1 --2- 172.21.15.80:0/1169515850 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b6015f100 0x7f1b6006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b65443700 1 -- 172.21.15.80:0/1169515850 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b6015f100 msgr2=0x7f1b6006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b65443700 1 --2- 172.21.15.80:0/1169515850 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b6015f100 0x7f1b6006bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:33.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b5f7fe700 1 -- 172.21.15.80:0/1169515850 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230916739 0 0) 0x7f1b48001080 con 0x7f1b6015ed10 2019-11-28T11:45:33.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b65443700 1 -- 172.21.15.80:0/1169515850 >> v1:172.21.15.174:6789/0 conn(0x7f1b6015ed10 legacy=0x7f1b60073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b65443700 1 -- 172.21.15.80:0/1169515850 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b60070760 con 0x7f1b6006c2f0 2019-11-28T11:45:33.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b65443700 1 --2- 172.21.15.80:0/1169515850 >> v2:172.21.15.80:3300/0 conn(0x7f1b6006c2f0 0x7f1b6006c790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1b5800fab0 tx=0x7f1b580080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b65443700 1 --2- 172.21.15.80:0/1169515850 >> v2:172.21.15.80:3300/0 conn(0x7f1b6006c2f0 0x7f1b6006c790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1b5800fab0 tx=0x7f1b580080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.983+0000 7f1b65443700 1 --2- 172.21.15.80:0/1169515850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b6006c2f0 0x7f1b6006c790 secure :-1 s=READY pgs=1818 cs=0 l=1 rx=0x7f1b5800fab0 tx=0x7f1b580080d0).ready entity=mon.0 client_cookie=35656592524a0deb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:33.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.984+0000 7f1b65443700 1 --2- 172.21.15.80:0/1169515850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b6006c2f0 0x7f1b6006c790 secure :-1 s=THROTTLE_DONE pgs=1818 cs=0 l=1 rx=0x7f1b5800fab0 tx=0x7f1b580080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.984+0000 7f1b5f7fe700 1 -- 172.21.15.80:0/1169515850 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b58000df0 con 0x7f1b6006c2f0 2019-11-28T11:45:33.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.984+0000 7f1b65443700 1 --2- 172.21.15.80:0/1169515850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b6006c2f0 0x7f1b6006c790 secure :-1 s=THROTTLE_DONE pgs=1818 cs=0 l=1 rx=0x7f1b5800fab0 tx=0x7f1b580080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.984+0000 7f1b65443700 1 --2- 172.21.15.80:0/1169515850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b6006c2f0 0x7f1b6006c790 secure :-1 s=THROTTLE_DONE pgs=1818 cs=0 l=1 rx=0x7f1b5800fab0 tx=0x7f1b580080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.984+0000 7f1b5f7fe700 1 -- 172.21.15.80:0/1169515850 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b58001460 con 0x7f1b6006c2f0 2019-11-28T11:45:33.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.984+0000 7f1b5f7fe700 1 -- 172.21.15.80:0/1169515850 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b58001650 con 0x7f1b6006c2f0 2019-11-28T11:45:33.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.984+0000 7f1b666a5700 1 -- 172.21.15.80:0/1169515850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b6006c2f0 msgr2=0x7f1b6006c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.984+0000 7f1b666a5700 1 --2- 172.21.15.80:0/1169515850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b6006c2f0 0x7f1b6006c790 secure :-1 s=READY pgs=1818 cs=0 l=1 rx=0x7f1b5800fab0 tx=0x7f1b580080d0).stop 2019-11-28T11:45:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.984+0000 7f1b666a5700 1 -- 172.21.15.80:0/1169515850 shutdown_connections 2019-11-28T11:45:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.984+0000 7f1b666a5700 1 --2- 172.21.15.80:0/1169515850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b6006c2f0 0x7f1b6006c790 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.984+0000 7f1b666a5700 1 --2- 172.21.15.80:0/1169515850 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b6015f100 0x7f1b6006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.984+0000 7f1b666a5700 1 -- 172.21.15.80:0/1169515850 shutdown_connections 2019-11-28T11:45:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.984+0000 7f1b666a5700 1 -- 172.21.15.80:0/1169515850 wait complete. 2019-11-28T11:45:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.984+0000 7f1b666a5700 1 -- 172.21.15.80:0/1169515850 >> 172.21.15.80:0/1169515850 conn(0x7f1b60061d40 msgr2=0x7f1b600641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:33.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.987+0000 7f1b666a5700 1 Processor -- start 2019-11-28T11:45:33.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.987+0000 7f1b666a5700 1 -- start start 2019-11-28T11:45:33.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b666a5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b60152750 0x7f1b60135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:33.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b666a5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1b60165d60 0x7f1b60168160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:33.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b666a5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b60109d70 con 0x7f1b60130dc0 2019-11-28T11:45:33.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b666a5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6010a460 con 0x7f1b60165d60 2019-11-28T11:45:33.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b666a5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60132570 con 0x7f1b60152750 2019-11-28T11:45:33.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1b60130dc0 0x7f1b60131250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40016/0 (socket says 172.21.15.80:40016) 2019-11-28T11:45:33.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5ffff700 1 -- 172.21.15.80:0/4023142131 learned_addr learned my addr 172.21.15.80:0/4023142131 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:33.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64854383 0 0) 0x7f1b500010b0 con 0x7f1b60130dc0 2019-11-28T11:45:33.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b44002e80 con 0x7f1b60130dc0 2019-11-28T11:45:33.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b64c42700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b60152750 0x7f1b60135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b65443700 1 --2- 172.21.15.80:0/4023142131 >> v2:172.21.15.174:3300/0 conn(0x7f1b60165d60 0x7f1b60168160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4018137264 0 0) 0x7f1b500012b0 con 0x7f1b60130dc0 2019-11-28T11:45:33.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1b440032e0 con 0x7f1b60130dc0 2019-11-28T11:45:33.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f1b50001880 con 0x7f1b60130dc0 2019-11-28T11:45:33.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b60152750 msgr2=0x7f1b60135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5d7fa700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b60152750 0x7f1b60135790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 >> v2:172.21.15.174:3300/0 conn(0x7f1b60165d60 msgr2=0x7f1b60168160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5d7fa700 1 --2- 172.21.15.80:0/4023142131 >> v2:172.21.15.174:3300/0 conn(0x7f1b60165d60 0x7f1b60168160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 >> v1:172.21.15.80:6789/0 conn(0x7f1b60130dc0 legacy=0x7f1b60131250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5d7fa700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b44003930 0x7f1b44005d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:33.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5d7fa700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b44006270 0x7f1b440086b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:33.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5d7fa700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b44008eb0 0x7f1b4400b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:33.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4400bb90 con 0x7f1b44008eb0 2019-11-28T11:45:33.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4400bdc0 con 0x7f1b44003930 2019-11-28T11:45:33.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4400bff0 con 0x7f1b44006270 2019-11-28T11:45:33.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b65443700 1 --2- 172.21.15.80:0/4023142131 >> v2:172.21.15.174:3300/0 conn(0x7f1b60165d60 0x7f1b60168160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:33.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.988+0000 7f1b64c42700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b44003930 0x7f1b44005d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b65443700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b44008eb0 0x7f1b4400b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b5ffff700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b44006270 0x7f1b440086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b64c42700 1 -- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b44006270 msgr2=0x7f1b440086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b64c42700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b44006270 0x7f1b440086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b64c42700 1 -- 172.21.15.80:0/4023142131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b44008eb0 msgr2=0x7f1b4400b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b64c42700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b44008eb0 0x7f1b4400b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b64c42700 1 -- 172.21.15.80:0/4023142131 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4400c2a0 con 0x7f1b44003930 2019-11-28T11:45:33.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b5ffff700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b44006270 0x7f1b440086b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:33.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b666a5700 1 -- 172.21.15.80:0/4023142131 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b60133250 con 0x7f1b44003930 2019-11-28T11:45:33.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b64c42700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b44003930 0x7f1b44005d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1b48010370 tx=0x7f1b48010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b65443700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b44008eb0 0x7f1b4400b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:33.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b666a5700 1 -- 172.21.15.80:0/4023142131 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b60132ed0 con 0x7f1b44003930 2019-11-28T11:45:33.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b64c42700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b44003930 0x7f1b44005d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1b48010370 tx=0x7f1b48010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b64c42700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b44003930 0x7f1b44005d30 secure :-1 s=READY pgs=1066 cs=0 l=1 rx=0x7f1b48010370 tx=0x7f1b48010710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:33.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b64c42700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b44003930 0x7f1b44005d30 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7f1b48010370 tx=0x7f1b48010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b48000e50 con 0x7f1b44003930 2019-11-28T11:45:33.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b64c42700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b44003930 0x7f1b44005d30 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7f1b48010370 tx=0x7f1b48010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b48001240 con 0x7f1b44003930 2019-11-28T11:45:33.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b64c42700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b44003930 0x7f1b44005d30 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7f1b48010370 tx=0x7f1b48010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b480043b0 con 0x7f1b44003930 2019-11-28T11:45:33.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.989+0000 7f1b64c42700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b44003930 0x7f1b44005d30 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7f1b48010370 tx=0x7f1b48010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.990+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1b480041c0 con 0x7f1b44003930 2019-11-28T11:45:33.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.990+0000 7f1b64c42700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b44003930 0x7f1b44005d30 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7f1b48010370 tx=0x7f1b48010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.990+0000 7f1b5d7fa700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1b44020a90 0x7f1b44022ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:33.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.990+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1b48031990 con 0x7f1b44003930 2019-11-28T11:45:33.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.990+0000 7f1b5ffff700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1b44020a90 0x7f1b44022ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.990+0000 7f1b5ffff700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1b44020a90 0x7f1b44022ee0 crc :-1 s=READY pgs=736 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:33.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:32.997+0000 7f1b666a5700 1 -- 172.21.15.80:0/4023142131 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b38002e60 con 0x7f1b44003930 2019-11-28T11:45:33.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.001+0000 7f1b64c42700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b44003930 0x7f1b44005d30 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7f1b48010370 tx=0x7f1b48010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.001+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1b48000c10 con 0x7f1b44003930 2019-11-28T11:45:33.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.170+0000 7f1b666a5700 1 -- 172.21.15.80:0/4023142131 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1b38001d60 con 0x7f1b44003930 2019-11-28T11:45:33.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.174+0000 7f1b64c42700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b44003930 0x7f1b44005d30 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7f1b48010370 tx=0x7f1b48010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.174+0000 7f1b5d7fa700 1 -- 172.21.15.80:0/4023142131 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v49) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1b4801f7d0 con 0x7f1b44003930 2019-11-28T11:45:33.217 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:45:33.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.179+0000 7f1b666a5700 1 -- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1b44020a90 msgr2=0x7f1b44022ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.179+0000 7f1b666a5700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1b44020a90 0x7f1b44022ee0 crc :-1 s=READY pgs=736 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.179+0000 7f1b666a5700 1 -- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b44003930 msgr2=0x7f1b44005d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.179+0000 7f1b666a5700 1 --2- 172.21.15.80:0/4023142131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b44003930 0x7f1b44005d30 secure :-1 s=READY pgs=1066 cs=0 l=1 rx=0x7f1b48010370 tx=0x7f1b48010710).stop 2019-11-28T11:45:33.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.179+0000 7f1b65443700 1 -- 172.21.15.80:0/4023142131 reap_dead start 2019-11-28T11:45:33.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.179+0000 7f1b65443700 1 -- 172.21.15.80:0/4023142131 reap_dead start 2019-11-28T11:45:33.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.180+0000 7f1b666a5700 1 -- 172.21.15.80:0/4023142131 shutdown_connections 2019-11-28T11:45:33.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.180+0000 7f1b666a5700 1 -- 172.21.15.80:0/4023142131 shutdown_connections 2019-11-28T11:45:33.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.180+0000 7f1b666a5700 1 -- 172.21.15.80:0/4023142131 wait complete. 2019-11-28T11:45:33.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.180+0000 7f1b666a5700 1 -- 172.21.15.80:0/4023142131 >> 172.21.15.80:0/4023142131 conn(0x7f1b601476e0 msgr2=0x7f1b6012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:33.230 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:45:33.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.321+0000 7f5cbfc37700 1 Processor -- start 2019-11-28T11:45:33.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.321+0000 7f5cbfc37700 1 -- start start 2019-11-28T11:45:33.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.322+0000 7f5cbfc37700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5cb815ed10 0x7f5cb815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:33.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.322+0000 7f5cbfc37700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb806db60 con 0x7f5cb80734b0 2019-11-28T11:45:33.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.322+0000 7f5cbfc37700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb806e060 con 0x7f5cb8073020 2019-11-28T11:45:33.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.322+0000 7f5cbfc37700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb806fe00 con 0x7f5cb815ed10 2019-11-28T11:45:33.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.322+0000 7f5cbe9d5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5cb80734b0 0x7f5cb80726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40030/0 (socket says 172.21.15.80:40030) 2019-11-28T11:45:33.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.322+0000 7f5cbe9d5700 1 -- 172.21.15.80:0/1087441741 learned_addr learned my addr 172.21.15.80:0/1087441741 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:33.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.322+0000 7f5cbe1d4700 1 --2- 172.21.15.80:0/1087441741 >> v2:172.21.15.174:3300/0 conn(0x7f5cb815ed10 0x7f5cb815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbd1d2700 1 -- 172.21.15.80:0/1087441741 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502442133 0 0) 0x7f5cb0001150 con 0x7f5cb80734b0 2019-11-28T11:45:33.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbd1d2700 1 -- 172.21.15.80:0/1087441741 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ca4002e80 con 0x7f5cb80734b0 2019-11-28T11:45:33.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbe1d4700 1 -- 172.21.15.80:0/1087441741 >> v1:172.21.15.174:6789/0 conn(0x7f5cb8073020 legacy=0x7f5cb8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbd1d2700 1 -- 172.21.15.80:0/1087441741 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203595459 0 0) 0x7f5ca0001330 con 0x7f5cb8073020 2019-11-28T11:45:33.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbe1d4700 1 -- 172.21.15.80:0/1087441741 >> v1:172.21.15.80:6789/0 conn(0x7f5cb80734b0 legacy=0x7f5cb80726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbe1d4700 1 -- 172.21.15.80:0/1087441741 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb8070760 con 0x7f5cb815ed10 2019-11-28T11:45:33.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbe1d4700 1 --2- 172.21.15.80:0/1087441741 >> v2:172.21.15.174:3300/0 conn(0x7f5cb815ed10 0x7f5cb815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5ca800af50 tx=0x7f5ca800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbe1d4700 1 --2- 172.21.15.80:0/1087441741 >> v2:172.21.15.174:3300/0 conn(0x7f5cb815ed10 0x7f5cb815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5ca800af50 tx=0x7f5ca800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbe1d4700 1 --2- 172.21.15.80:0/1087441741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb815ed10 0x7f5cb815f100 secure :-1 s=READY pgs=1068 cs=0 l=1 rx=0x7f5ca800af50 tx=0x7f5ca800b760).ready entity=mon.1 client_cookie=ccdc4695efce8bfc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:33.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbe1d4700 1 --2- 172.21.15.80:0/1087441741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb815ed10 0x7f5cb815f100 secure :-1 s=THROTTLE_DONE pgs=1068 cs=0 l=1 rx=0x7f5ca800af50 tx=0x7f5ca800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbd1d2700 1 -- 172.21.15.80:0/1087441741 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca8000960 con 0x7f5cb815ed10 2019-11-28T11:45:33.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbe1d4700 1 --2- 172.21.15.80:0/1087441741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb815ed10 0x7f5cb815f100 secure :-1 s=THROTTLE_DONE pgs=1068 cs=0 l=1 rx=0x7f5ca800af50 tx=0x7f5ca800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbe1d4700 1 --2- 172.21.15.80:0/1087441741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb815ed10 0x7f5cb815f100 secure :-1 s=THROTTLE_DONE pgs=1068 cs=0 l=1 rx=0x7f5ca800af50 tx=0x7f5ca800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbd1d2700 1 -- 172.21.15.80:0/1087441741 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca8009860 con 0x7f5cb815ed10 2019-11-28T11:45:33.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbd1d2700 1 -- 172.21.15.80:0/1087441741 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca8009f30 con 0x7f5cb815ed10 2019-11-28T11:45:33.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbfc37700 1 -- 172.21.15.80:0/1087441741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb815ed10 msgr2=0x7f5cb815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.323+0000 7f5cbfc37700 1 --2- 172.21.15.80:0/1087441741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb815ed10 0x7f5cb815f100 secure :-1 s=READY pgs=1068 cs=0 l=1 rx=0x7f5ca800af50 tx=0x7f5ca800b760).stop 2019-11-28T11:45:33.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.324+0000 7f5cbfc37700 1 -- 172.21.15.80:0/1087441741 shutdown_connections 2019-11-28T11:45:33.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.324+0000 7f5cbfc37700 1 --2- 172.21.15.80:0/1087441741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb815ed10 0x7f5cb815f100 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.324+0000 7f5cbfc37700 1 -- 172.21.15.80:0/1087441741 shutdown_connections 2019-11-28T11:45:33.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.324+0000 7f5cbfc37700 1 -- 172.21.15.80:0/1087441741 wait complete. 2019-11-28T11:45:33.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.324+0000 7f5cbfc37700 1 -- 172.21.15.80:0/1087441741 >> 172.21.15.80:0/1087441741 conn(0x7f5cb8061d40 msgr2=0x7f5cb80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:33.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.326+0000 7f5cbfc37700 1 Processor -- start 2019-11-28T11:45:33.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.326+0000 7f5cbfc37700 1 -- start start 2019-11-28T11:45:33.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.327+0000 7f5cbfc37700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cb8148f40 0x7f5cb8109750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:33.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.327+0000 7f5cbfc37700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5cb8108dd0 0x7f5cb8133040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:33.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.327+0000 7f5cbfc37700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb8134510 con 0x7f5cb8109c90 2019-11-28T11:45:33.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.327+0000 7f5cbfc37700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb8130730 con 0x7f5cb8108dd0 2019-11-28T11:45:33.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.327+0000 7f5cbfc37700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8131ac0 con 0x7f5cb8148f40 2019-11-28T11:45:33.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.327+0000 7f5cbd9d3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5cb8109c90 0x7f5cb81085d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40038/0 (socket says 172.21.15.80:40038) 2019-11-28T11:45:33.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.327+0000 7f5cbd9d3700 1 -- 172.21.15.80:0/1214234998 learned_addr learned my addr 172.21.15.80:0/1214234998 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:33.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.327+0000 7f5cbe9d5700 1 --2- 172.21.15.80:0/1214234998 >> v2:172.21.15.174:3300/0 conn(0x7f5cb8108dd0 0x7f5cb8133040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.327+0000 7f5cbe1d4700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cb8148f40 0x7f5cb8109750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cb6ffd700 1 -- 172.21.15.80:0/1214234998 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555836882 0 0) 0x7f5ca0001540 con 0x7f5cb8109c90 2019-11-28T11:45:33.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cb6ffd700 1 -- 172.21.15.80:0/1214234998 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c9c002e80 con 0x7f5cb8109c90 2019-11-28T11:45:33.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cbe9d5700 1 -- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cb8148f40 msgr2=0x7f5cb8109750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cbe9d5700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cb8148f40 0x7f5cb8109750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cbe9d5700 1 -- 172.21.15.80:0/1214234998 >> v1:172.21.15.80:6789/0 conn(0x7f5cb8109c90 legacy=0x7f5cb81085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cbe9d5700 1 -- 172.21.15.80:0/1214234998 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb8131e40 con 0x7f5cb8108dd0 2019-11-28T11:45:33.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cbe1d4700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cb8148f40 0x7f5cb8109750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:33.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cbe9d5700 1 --2- 172.21.15.80:0/1214234998 >> v2:172.21.15.174:3300/0 conn(0x7f5cb8108dd0 0x7f5cb8133040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5cb0010370 tx=0x7f5cb0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cbe9d5700 1 --2- 172.21.15.80:0/1214234998 >> v2:172.21.15.174:3300/0 conn(0x7f5cb8108dd0 0x7f5cb8133040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5cb0010370 tx=0x7f5cb0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cbe9d5700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8108dd0 0x7f5cb8133040 secure :-1 s=READY pgs=1069 cs=0 l=1 rx=0x7f5cb0010370 tx=0x7f5cb0010710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:33.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cbe9d5700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8108dd0 0x7f5cb8133040 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7f5cb0010370 tx=0x7f5cb0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cb6ffd700 1 -- 172.21.15.80:0/1214234998 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cb0000ef0 con 0x7f5cb8108dd0 2019-11-28T11:45:33.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cbe9d5700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8108dd0 0x7f5cb8133040 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7f5cb0010370 tx=0x7f5cb0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cbe9d5700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8108dd0 0x7f5cb8133040 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7f5cb0010370 tx=0x7f5cb0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cb6ffd700 1 -- 172.21.15.80:0/1214234998 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb0004240 con 0x7f5cb8108dd0 2019-11-28T11:45:33.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cb6ffd700 1 -- 172.21.15.80:0/1214234998 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cb00048d0 con 0x7f5cb8108dd0 2019-11-28T11:45:33.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cbfc37700 1 -- 172.21.15.80:0/1214234998 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb8131e40 con 0x7f5cb8108dd0 2019-11-28T11:45:33.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cbfc37700 1 -- 172.21.15.80:0/1214234998 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb8131e40 con 0x7f5cb8108dd0 2019-11-28T11:45:33.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.328+0000 7f5cbe9d5700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8108dd0 0x7f5cb8133040 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7f5cb0010370 tx=0x7f5cb0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.329+0000 7f5cb6ffd700 1 -- 172.21.15.80:0/1214234998 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5cb0000940 con 0x7f5cb8108dd0 2019-11-28T11:45:33.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.329+0000 7f5cbe9d5700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8108dd0 0x7f5cb8133040 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7f5cb0010370 tx=0x7f5cb0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.329+0000 7f5cb6ffd700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c9c018770 0x7f5c9c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:33.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.329+0000 7f5cb6ffd700 1 -- 172.21.15.80:0/1214234998 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5cb00319b0 con 0x7f5cb8108dd0 2019-11-28T11:45:33.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.329+0000 7f5cbe1d4700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c9c018770 0x7f5c9c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.329+0000 7f5cbe1d4700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c9c018770 0x7f5c9c01abe0 crc :-1 s=READY pgs=737 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:33.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.337+0000 7f5cbfc37700 1 -- 172.21.15.80:0/1214234998 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb8131e40 con 0x7f5cb8108dd0 2019-11-28T11:45:33.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.341+0000 7f5cbe9d5700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8108dd0 0x7f5cb8133040 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7f5cb0010370 tx=0x7f5cb0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.341+0000 7f5cb6ffd700 1 -- 172.21.15.80:0/1214234998 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5cb0001200 con 0x7f5cb8108dd0 2019-11-28T11:45:33.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.512+0000 7f5cbfc37700 1 -- 172.21.15.80:0/1214234998 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5cb8131ac0 con 0x7f5cb8108dd0 2019-11-28T11:45:33.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.515+0000 7f5cbe9d5700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8108dd0 0x7f5cb8133040 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7f5cb0010370 tx=0x7f5cb0010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.515+0000 7f5cb6ffd700 1 -- 172.21.15.80:0/1214234998 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v50) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5cb001f7d0 con 0x7f5cb8108dd0 2019-11-28T11:45:33.558 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:45:33.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.521+0000 7f5cbfc37700 1 -- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c9c018770 msgr2=0x7f5c9c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.521+0000 7f5cbfc37700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c9c018770 0x7f5c9c01abe0 crc :-1 s=READY pgs=737 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.521+0000 7f5cbfc37700 1 -- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8108dd0 msgr2=0x7f5cb8133040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.521+0000 7f5cbfc37700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8108dd0 0x7f5cb8133040 secure :-1 s=READY pgs=1069 cs=0 l=1 rx=0x7f5cb0010370 tx=0x7f5cb0010710).stop 2019-11-28T11:45:33.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.521+0000 7f5cbfc37700 1 -- 172.21.15.80:0/1214234998 shutdown_connections 2019-11-28T11:45:33.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.521+0000 7f5cbfc37700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c9c018770 0x7f5c9c01abe0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.521+0000 7f5cbfc37700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8108dd0 0x7f5cb8133040 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.521+0000 7f5cbfc37700 1 --2- 172.21.15.80:0/1214234998 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cb8148f40 0x7f5cb8109750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.521+0000 7f5cbfc37700 1 -- 172.21.15.80:0/1214234998 shutdown_connections 2019-11-28T11:45:33.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.521+0000 7f5cbfc37700 1 -- 172.21.15.80:0/1214234998 wait complete. 2019-11-28T11:45:33.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.521+0000 7f5cbfc37700 1 -- 172.21.15.80:0/1214234998 >> 172.21.15.80:0/1214234998 conn(0x7f5cb814c9f0 msgr2=0x7f5cb807b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:33.572 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:45:33.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.663+0000 7fec96956700 1 Processor -- start 2019-11-28T11:45:33.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.663+0000 7fec96956700 1 -- start start 2019-11-28T11:45:33.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.664+0000 7fec96956700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fec9015ed10 0x7fec9015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:33.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.664+0000 7fec96956700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fec90073020 0x7fec90071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:33.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.664+0000 7fec96956700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9006db60 con 0x7fec900734b0 2019-11-28T11:45:33.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.664+0000 7fec96956700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9006fe00 con 0x7fec9015ed10 2019-11-28T11:45:33.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.664+0000 7fec96956700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec900700d0 con 0x7fec90073020 2019-11-28T11:45:33.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.664+0000 7fec94ef3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fec9015ed10 0x7fec9015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.664+0000 7fec94ef3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fec9015ed10 0x7fec9015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40726/0 (socket says 172.21.15.80:40726) 2019-11-28T11:45:33.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.664+0000 7fec956f4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fec900734b0 0x7fec900723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40042/0 (socket says 172.21.15.80:40042) 2019-11-28T11:45:33.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.664+0000 7fec94ef3700 1 -- 172.21.15.80:0/3894831012 learned_addr learned my addr 172.21.15.80:0/3894831012 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:33.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec8ffff700 1 --2- 172.21.15.80:0/3894831012 >> v2:172.21.15.174:3300/0 conn(0x7fec90073020 0x7fec90071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec94ef3700 1 -- 172.21.15.80:0/3894831012 >> v2:172.21.15.174:3300/0 conn(0x7fec90073020 msgr2=0x7fec90071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:33.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec94ef3700 1 --2- 172.21.15.80:0/3894831012 >> v2:172.21.15.174:3300/0 conn(0x7fec90073020 0x7fec90071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:33.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec94ef3700 1 -- 172.21.15.80:0/3894831012 >> v1:172.21.15.80:6789/0 conn(0x7fec900734b0 legacy=0x7fec900723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec8f7fe700 1 -- 172.21.15.80:0/3894831012 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717995911 0 0) 0x7fec880009b0 con 0x7fec900734b0 2019-11-28T11:45:33.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec94ef3700 1 -- 172.21.15.80:0/3894831012 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec90070760 con 0x7fec9015ed10 2019-11-28T11:45:33.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec94ef3700 1 --2- 172.21.15.80:0/3894831012 >> v2:172.21.15.80:3300/0 conn(0x7fec9015ed10 0x7fec9015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fec8000fa40 tx=0x7fec8000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec94ef3700 1 --2- 172.21.15.80:0/3894831012 >> v2:172.21.15.80:3300/0 conn(0x7fec9015ed10 0x7fec9015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fec8000fa40 tx=0x7fec8000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec94ef3700 1 --2- 172.21.15.80:0/3894831012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec9015ed10 0x7fec9015f100 secure :-1 s=READY pgs=1823 cs=0 l=1 rx=0x7fec8000fa40 tx=0x7fec8000fde0).ready entity=mon.0 client_cookie=94de5e5d529383c6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:33.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec94ef3700 1 --2- 172.21.15.80:0/3894831012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec9015ed10 0x7fec9015f100 secure :-1 s=THROTTLE_DONE pgs=1823 cs=0 l=1 rx=0x7fec8000fa40 tx=0x7fec8000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec8f7fe700 1 -- 172.21.15.80:0/3894831012 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec80000ce0 con 0x7fec9015ed10 2019-11-28T11:45:33.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec94ef3700 1 --2- 172.21.15.80:0/3894831012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec9015ed10 0x7fec9015f100 secure :-1 s=THROTTLE_DONE pgs=1823 cs=0 l=1 rx=0x7fec8000fa40 tx=0x7fec8000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec94ef3700 1 --2- 172.21.15.80:0/3894831012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec9015ed10 0x7fec9015f100 secure :-1 s=THROTTLE_DONE pgs=1823 cs=0 l=1 rx=0x7fec8000fa40 tx=0x7fec8000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec8f7fe700 1 -- 172.21.15.80:0/3894831012 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec80001010 con 0x7fec9015ed10 2019-11-28T11:45:33.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec8f7fe700 1 -- 172.21.15.80:0/3894831012 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec80001720 con 0x7fec9015ed10 2019-11-28T11:45:33.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec96956700 1 -- 172.21.15.80:0/3894831012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec9015ed10 msgr2=0x7fec9015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.665+0000 7fec96956700 1 --2- 172.21.15.80:0/3894831012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec9015ed10 0x7fec9015f100 secure :-1 s=READY pgs=1823 cs=0 l=1 rx=0x7fec8000fa40 tx=0x7fec8000fde0).stop 2019-11-28T11:45:33.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.666+0000 7fec96956700 1 -- 172.21.15.80:0/3894831012 shutdown_connections 2019-11-28T11:45:33.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.666+0000 7fec96956700 1 --2- 172.21.15.80:0/3894831012 >> v2:172.21.15.174:3300/0 conn(0x7fec90073020 0x7fec90071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:33.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.666+0000 7fec96956700 1 --2- 172.21.15.80:0/3894831012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec9015ed10 0x7fec9015f100 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.666+0000 7fec96956700 1 -- 172.21.15.80:0/3894831012 shutdown_connections 2019-11-28T11:45:33.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.666+0000 7fec96956700 1 -- 172.21.15.80:0/3894831012 wait complete. 2019-11-28T11:45:33.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.666+0000 7fec96956700 1 -- 172.21.15.80:0/3894831012 >> 172.21.15.80:0/3894831012 conn(0x7fec90061d40 msgr2=0x7fec900641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:33.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.668+0000 7fec96956700 1 Processor -- start 2019-11-28T11:45:33.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.668+0000 7fec96956700 1 -- start start 2019-11-28T11:45:33.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.669+0000 7fec96956700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fec90152750 0x7fec90135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:33.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.669+0000 7fec96956700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fec90130dc0 0x7fec90131250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:33.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.669+0000 7fec96956700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec90131790 0x7fec90134610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:33.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.669+0000 7fec96956700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec90132570 con 0x7fec90130dc0 2019-11-28T11:45:33.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.669+0000 7fec96956700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec90132840 con 0x7fec90152750 2019-11-28T11:45:33.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.669+0000 7fec96956700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9010a460 con 0x7fec90131790 2019-11-28T11:45:33.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.669+0000 7fec8ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fec90130dc0 0x7fec90131250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.669+0000 7fec8ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fec90130dc0 0x7fec90131250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40730/0 (socket says 172.21.15.80:40730) 2019-11-28T11:45:33.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.669+0000 7fec8ffff700 1 -- 172.21.15.80:0/3640083660 learned_addr learned my addr 172.21.15.80:0/3640083660 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:33.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.669+0000 7fec956f4700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec90131790 0x7fec90134610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.669+0000 7fec94ef3700 1 --2- 172.21.15.80:0/3640083660 >> v2:172.21.15.174:3300/0 conn(0x7fec90152750 0x7fec90135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec8ffff700 1 -- 172.21.15.80:0/3640083660 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec90131790 msgr2=0x7fec90134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec8ffff700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec90131790 0x7fec90134610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec8ffff700 1 -- 172.21.15.80:0/3640083660 >> v2:172.21.15.174:3300/0 conn(0x7fec90152750 msgr2=0x7fec90135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec8ffff700 1 --2- 172.21.15.80:0/3640083660 >> v2:172.21.15.174:3300/0 conn(0x7fec90152750 0x7fec90135790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec8ffff700 1 -- 172.21.15.80:0/3640083660 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec90132ed0 con 0x7fec90130dc0 2019-11-28T11:45:33.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec94ef3700 1 --2- 172.21.15.80:0/3640083660 >> v2:172.21.15.174:3300/0 conn(0x7fec90152750 0x7fec90135790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:33.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec8ffff700 1 --2- 172.21.15.80:0/3640083660 >> v2:172.21.15.80:3300/0 conn(0x7fec90130dc0 0x7fec90131250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec78012590 tx=0x7fec78012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec8ffff700 1 --2- 172.21.15.80:0/3640083660 >> v2:172.21.15.80:3300/0 conn(0x7fec90130dc0 0x7fec90131250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec78012590 tx=0x7fec78012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec8ffff700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec90130dc0 0x7fec90131250 secure :-1 s=READY pgs=1824 cs=0 l=1 rx=0x7fec78012590 tx=0x7fec78012930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:33.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec8ffff700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec90130dc0 0x7fec90131250 secure :-1 s=THROTTLE_DONE pgs=1824 cs=0 l=1 rx=0x7fec78012590 tx=0x7fec78012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec8d7fa700 1 -- 172.21.15.80:0/3640083660 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec78000940 con 0x7fec90130dc0 2019-11-28T11:45:33.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec8ffff700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec90130dc0 0x7fec90131250 secure :-1 s=THROTTLE_DONE pgs=1824 cs=0 l=1 rx=0x7fec78012590 tx=0x7fec78012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec8ffff700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec90130dc0 0x7fec90131250 secure :-1 s=THROTTLE_DONE pgs=1824 cs=0 l=1 rx=0x7fec78012590 tx=0x7fec78012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec8d7fa700 1 -- 172.21.15.80:0/3640083660 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec78000ea0 con 0x7fec90130dc0 2019-11-28T11:45:33.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec96956700 1 -- 172.21.15.80:0/3640083660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec90133250 con 0x7fec90130dc0 2019-11-28T11:45:33.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec8d7fa700 1 -- 172.21.15.80:0/3640083660 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec78001470 con 0x7fec90130dc0 2019-11-28T11:45:33.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec96956700 1 -- 172.21.15.80:0/3640083660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec90132ed0 con 0x7fec90130dc0 2019-11-28T11:45:33.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.670+0000 7fec8ffff700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec90130dc0 0x7fec90131250 secure :-1 s=THROTTLE_DONE pgs=1824 cs=0 l=1 rx=0x7fec78012590 tx=0x7fec78012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.671+0000 7fec8d7fa700 1 -- 172.21.15.80:0/3640083660 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fec78001090 con 0x7fec90130dc0 2019-11-28T11:45:33.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.671+0000 7fec8ffff700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec90130dc0 0x7fec90131250 secure :-1 s=THROTTLE_DONE pgs=1824 cs=0 l=1 rx=0x7fec78012590 tx=0x7fec78012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.671+0000 7fec8d7fa700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fec74018730 0x7fec7401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:33.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.671+0000 7fec8d7fa700 1 -- 172.21.15.80:0/3640083660 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fec78033c00 con 0x7fec90130dc0 2019-11-28T11:45:33.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.671+0000 7fec94ef3700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fec74018730 0x7fec7401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:33.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.671+0000 7fec94ef3700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fec74018730 0x7fec7401abc0 crc :-1 s=READY pgs=738 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:33.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.679+0000 7fec96956700 1 -- 172.21.15.80:0/3640083660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec90133250 con 0x7fec90130dc0 2019-11-28T11:45:33.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.682+0000 7fec8ffff700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec90130dc0 0x7fec90131250 secure :-1 s=THROTTLE_DONE pgs=1824 cs=0 l=1 rx=0x7fec78012590 tx=0x7fec78012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.682+0000 7fec8d7fa700 1 -- 172.21.15.80:0/3640083660 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fec78000c90 con 0x7fec90130dc0 2019-11-28T11:45:33.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.853+0000 7fec96956700 1 -- 172.21.15.80:0/3640083660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fec90132ed0 con 0x7fec90130dc0 2019-11-28T11:45:33.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.855+0000 7fec8ffff700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec90130dc0 0x7fec90131250 secure :-1 s=THROTTLE_DONE pgs=1824 cs=0 l=1 rx=0x7fec78012590 tx=0x7fec78012930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:33.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.855+0000 7fec8d7fa700 1 -- 172.21.15.80:0/3640083660 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v51) v1 ==== 184+0+0 (secure 0 0 0) 0x7fec78019600 con 0x7fec90130dc0 2019-11-28T11:45:33.899 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:45:33.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.858+0000 7fec96956700 1 -- 172.21.15.80:0/3640083660 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fec74018730 msgr2=0x7fec7401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.858+0000 7fec96956700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fec74018730 0x7fec7401abc0 crc :-1 s=READY pgs=738 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.858+0000 7fec96956700 1 -- 172.21.15.80:0/3640083660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec90130dc0 msgr2=0x7fec90131250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:33.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.858+0000 7fec96956700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec90130dc0 0x7fec90131250 secure :-1 s=READY pgs=1824 cs=0 l=1 rx=0x7fec78012590 tx=0x7fec78012930).stop 2019-11-28T11:45:33.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.858+0000 7fec96956700 1 -- 172.21.15.80:0/3640083660 shutdown_connections 2019-11-28T11:45:33.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.858+0000 7fec96956700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fec74018730 0x7fec7401abc0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.858+0000 7fec96956700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec90131790 0x7fec90134610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.858+0000 7fec96956700 1 --2- 172.21.15.80:0/3640083660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec90130dc0 0x7fec90131250 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.858+0000 7fec96956700 1 --2- 172.21.15.80:0/3640083660 >> v2:172.21.15.174:3300/0 conn(0x7fec90152750 0x7fec90135790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:33.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.858+0000 7fec96956700 1 -- 172.21.15.80:0/3640083660 shutdown_connections 2019-11-28T11:45:33.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.858+0000 7fec96956700 1 -- 172.21.15.80:0/3640083660 wait complete. 2019-11-28T11:45:33.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.858+0000 7fec96956700 1 -- 172.21.15.80:0/3640083660 >> 172.21.15.80:0/3640083660 conn(0x7fec901476e0 msgr2=0x7fec9012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:33.908 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:34.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.988+0000 7f674559e700 1 Processor -- start 2019-11-28T11:45:34.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.988+0000 7f674559e700 1 -- start start 2019-11-28T11:45:34.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.989+0000 7f674559e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f674006d120 0x7f6740165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:34.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.989+0000 7f674559e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f674006d5a0 con 0x7f674006c490 2019-11-28T11:45:34.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.989+0000 7f674559e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f674006db00 con 0x7f674006c0a0 2019-11-28T11:45:34.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.989+0000 7f674559e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674006fd60 con 0x7f674006d120 2019-11-28T11:45:34.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.989+0000 7f673ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f674006d120 0x7f6740165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:34.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.989+0000 7f673effd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f674006c490 0x7f674006c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40058/0 (socket says 172.21.15.80:40058) 2019-11-28T11:45:34.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.989+0000 7f673effd700 1 -- 172.21.15.80:0/1504867228 learned_addr learned my addr 172.21.15.80:0/1504867228 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:34.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.989+0000 7f673ffff700 1 -- 172.21.15.80:0/1504867228 >> v1:172.21.15.174:6789/0 conn(0x7f674006c0a0 legacy=0x7f6740072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:34.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.989+0000 7f673ffff700 1 -- 172.21.15.80:0/1504867228 >> v1:172.21.15.80:6789/0 conn(0x7f674006c490 legacy=0x7f674006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:34.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.989+0000 7f673e7fc700 1 -- 172.21.15.80:0/1504867228 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449859308 0 0) 0x7f6730001150 con 0x7f674006c490 2019-11-28T11:45:34.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.989+0000 7f673ffff700 1 -- 172.21.15.80:0/1504867228 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67400706c0 con 0x7f674006d120 2019-11-28T11:45:34.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.990+0000 7f673ffff700 1 --2- 172.21.15.80:0/1504867228 >> v2:172.21.15.80:3300/0 conn(0x7f674006d120 0x7f6740165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f673800b2d0 tx=0x7f673800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:34.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.990+0000 7f673ffff700 1 --2- 172.21.15.80:0/1504867228 >> v2:172.21.15.80:3300/0 conn(0x7f674006d120 0x7f6740165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f673800b2d0 tx=0x7f673800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:34.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.990+0000 7f673ffff700 1 --2- 172.21.15.80:0/1504867228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674006d120 0x7f6740165d80 secure :-1 s=READY pgs=1826 cs=0 l=1 rx=0x7f673800b2d0 tx=0x7f673800bae0).ready entity=mon.0 client_cookie=bf256c65e74c58be server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.990+0000 7f673ffff700 1 --2- 172.21.15.80:0/1504867228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674006d120 0x7f6740165d80 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f673800b2d0 tx=0x7f673800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.990+0000 7f673e7fc700 1 -- 172.21.15.80:0/1504867228 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6738009f20 con 0x7f674006d120 2019-11-28T11:45:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.990+0000 7f673ffff700 1 --2- 172.21.15.80:0/1504867228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674006d120 0x7f6740165d80 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f673800b2d0 tx=0x7f673800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.990+0000 7f673ffff700 1 --2- 172.21.15.80:0/1504867228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674006d120 0x7f6740165d80 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f673800b2d0 tx=0x7f673800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.990+0000 7f673e7fc700 1 -- 172.21.15.80:0/1504867228 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6738000df0 con 0x7f674006d120 2019-11-28T11:45:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.990+0000 7f673e7fc700 1 -- 172.21.15.80:0/1504867228 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f673800a500 con 0x7f674006d120 2019-11-28T11:45:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.990+0000 7f674559e700 1 -- 172.21.15.80:0/1504867228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674006d120 msgr2=0x7f6740165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.990+0000 7f674559e700 1 --2- 172.21.15.80:0/1504867228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674006d120 0x7f6740165d80 secure :-1 s=READY pgs=1826 cs=0 l=1 rx=0x7f673800b2d0 tx=0x7f673800bae0).stop 2019-11-28T11:45:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.990+0000 7f674559e700 1 -- 172.21.15.80:0/1504867228 shutdown_connections 2019-11-28T11:45:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.990+0000 7f674559e700 1 --2- 172.21.15.80:0/1504867228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f674006d120 0x7f6740165d80 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.991+0000 7f674559e700 1 -- 172.21.15.80:0/1504867228 shutdown_connections 2019-11-28T11:45:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.991+0000 7f674559e700 1 -- 172.21.15.80:0/1504867228 wait complete. 2019-11-28T11:45:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.991+0000 7f674559e700 1 -- 172.21.15.80:0/1504867228 >> 172.21.15.80:0/1504867228 conn(0x7f6740061cf0 msgr2=0x7f6740064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.993+0000 7f674559e700 1 Processor -- start 2019-11-28T11:45:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.993+0000 7f674559e700 1 -- start start 2019-11-28T11:45:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.994+0000 7f674559e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6740111db0 0x7f67401238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.994+0000 7f674559e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6740124260 con 0x7f674012cea0 2019-11-28T11:45:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.994+0000 7f674559e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f674012e5d0 con 0x7f6740165a00 2019-11-28T11:45:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.994+0000 7f674559e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6740121040 con 0x7f6740111db0 2019-11-28T11:45:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.994+0000 7f673effd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6740111db0 0x7f67401238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.994+0000 7f673f7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f674012cea0 0x7f67401230e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40060/0 (socket says 172.21.15.80:40060) 2019-11-28T11:45:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.994+0000 7f673effd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6740111db0 0x7f67401238e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40746/0 (socket says 172.21.15.80:40746) 2019-11-28T11:45:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.994+0000 7f673f7fe700 1 -- 172.21.15.80:0/2400099251 learned_addr learned my addr 172.21.15.80:0/2400099251 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:34.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.994+0000 7f673effd700 1 -- 172.21.15.80:0/2400099251 >> v1:172.21.15.174:6789/0 conn(0x7f6740165a00 legacy=0x7f6740167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:34.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.994+0000 7f673effd700 1 -- 172.21.15.80:0/2400099251 >> v1:172.21.15.80:6789/0 conn(0x7f674012cea0 legacy=0x7f67401230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:34.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.994+0000 7f6737fff700 1 -- 172.21.15.80:0/2400099251 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443710414 0 0) 0x7f6728001170 con 0x7f674012cea0 2019-11-28T11:45:34.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.994+0000 7f673effd700 1 -- 172.21.15.80:0/2400099251 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67401219a0 con 0x7f6740111db0 2019-11-28T11:45:34.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.994+0000 7f673effd700 1 --2- 172.21.15.80:0/2400099251 >> v2:172.21.15.80:3300/0 conn(0x7f6740111db0 0x7f67401238e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6730010370 tx=0x7f6730010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:34.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.994+0000 7f673effd700 1 --2- 172.21.15.80:0/2400099251 >> v2:172.21.15.80:3300/0 conn(0x7f6740111db0 0x7f67401238e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6730010370 tx=0x7f6730010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:34.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.994+0000 7f673effd700 1 --2- 172.21.15.80:0/2400099251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6740111db0 0x7f67401238e0 secure :-1 s=READY pgs=1828 cs=0 l=1 rx=0x7f6730010370 tx=0x7f6730010710).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:34.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.995+0000 7f673effd700 1 --2- 172.21.15.80:0/2400099251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6740111db0 0x7f67401238e0 secure :-1 s=THROTTLE_DONE pgs=1828 cs=0 l=1 rx=0x7f6730010370 tx=0x7f6730010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:34.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.995+0000 7f6737fff700 1 -- 172.21.15.80:0/2400099251 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6730000ed0 con 0x7f6740111db0 2019-11-28T11:45:34.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.995+0000 7f673effd700 1 --2- 172.21.15.80:0/2400099251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6740111db0 0x7f67401238e0 secure :-1 s=THROTTLE_DONE pgs=1828 cs=0 l=1 rx=0x7f6730010370 tx=0x7f6730010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:34.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.995+0000 7f673effd700 1 --2- 172.21.15.80:0/2400099251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6740111db0 0x7f67401238e0 secure :-1 s=THROTTLE_DONE pgs=1828 cs=0 l=1 rx=0x7f6730010370 tx=0x7f6730010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:34.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.995+0000 7f6737fff700 1 -- 172.21.15.80:0/2400099251 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6730004430 con 0x7f6740111db0 2019-11-28T11:45:34.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.995+0000 7f6737fff700 1 -- 172.21.15.80:0/2400099251 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6730004b00 con 0x7f6740111db0 2019-11-28T11:45:34.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.995+0000 7f674559e700 1 -- 172.21.15.80:0/2400099251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6740121d20 con 0x7f6740111db0 2019-11-28T11:45:34.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.995+0000 7f674559e700 1 -- 172.21.15.80:0/2400099251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67401219a0 con 0x7f6740111db0 2019-11-28T11:45:34.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.995+0000 7f673effd700 1 --2- 172.21.15.80:0/2400099251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6740111db0 0x7f67401238e0 secure :-1 s=THROTTLE_DONE pgs=1828 cs=0 l=1 rx=0x7f6730010370 tx=0x7f6730010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:34.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.995+0000 7f6737fff700 1 -- 172.21.15.80:0/2400099251 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6730004620 con 0x7f6740111db0 2019-11-28T11:45:34.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.995+0000 7f673effd700 1 --2- 172.21.15.80:0/2400099251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6740111db0 0x7f67401238e0 secure :-1 s=THROTTLE_DONE pgs=1828 cs=0 l=1 rx=0x7f6730010370 tx=0x7f6730010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:34.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.995+0000 7f6737fff700 1 --2- 172.21.15.80:0/2400099251 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f672401a950 0x7f672401cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:34.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.995+0000 7f6737fff700 1 -- 172.21.15.80:0/2400099251 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6730031ab0 con 0x7f6740111db0 2019-11-28T11:45:34.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.996+0000 7f673f7fe700 1 --2- 172.21.15.80:0/2400099251 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f672401a950 0x7f672401cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:34.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:33.996+0000 7f673f7fe700 1 --2- 172.21.15.80:0/2400099251 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f672401a950 0x7f672401cde0 crc :-1 s=READY pgs=739 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:34.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:34.003+0000 7f674559e700 1 -- 172.21.15.80:0/2400099251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6740121d20 con 0x7f6740111db0 2019-11-28T11:45:34.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:34.006+0000 7f673effd700 1 --2- 172.21.15.80:0/2400099251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6740111db0 0x7f67401238e0 secure :-1 s=THROTTLE_DONE pgs=1828 cs=0 l=1 rx=0x7f6730010370 tx=0x7f6730010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:34.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:34.006+0000 7f6737fff700 1 -- 172.21.15.80:0/2400099251 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6730001200 con 0x7f6740111db0 2019-11-28T11:45:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:34.177+0000 7f674559e700 1 -- 172.21.15.80:0/2400099251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67401219a0 con 0x7f6740111db0 2019-11-28T11:45:34.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:34.178+0000 7f673effd700 1 --2- 172.21.15.80:0/2400099251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6740111db0 0x7f67401238e0 secure :-1 s=THROTTLE_DONE pgs=1828 cs=0 l=1 rx=0x7f6730010370 tx=0x7f6730010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:34.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:34.178+0000 7f6737fff700 1 -- 172.21.15.80:0/2400099251 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+1428 (secure 0 0 0) 0x7f673001feb0 con 0x7f6740111db0 2019-11-28T11:45:34.219 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 105 2019-11-28T11:45:34.220 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:34.223 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":105,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:30.152127+0000","modified":"2019-11-28T11:45:31.784125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2019-11-28T11:45:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:34.180+0000 7f674559e700 1 -- 172.21.15.80:0/2400099251 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f672401a950 msgr2=0x7f672401cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:34.180+0000 7f674559e700 1 --2- 172.21.15.80:0/2400099251 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f672401a950 0x7f672401cde0 crc :-1 s=READY pgs=739 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:34.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:34.180+0000 7f674559e700 1 -- 172.21.15.80:0/2400099251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6740111db0 msgr2=0x7f67401238e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:34.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:34.180+0000 7f674559e700 1 --2- 172.21.15.80:0/2400099251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6740111db0 0x7f67401238e0 secure :-1 s=READY pgs=1828 cs=0 l=1 rx=0x7f6730010370 tx=0x7f6730010710).stop 2019-11-28T11:45:34.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:34.180+0000 7f674559e700 1 -- 172.21.15.80:0/2400099251 shutdown_connections 2019-11-28T11:45:34.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:34.180+0000 7f674559e700 1 --2- 172.21.15.80:0/2400099251 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f672401a950 0x7f672401cde0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:34.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:34.180+0000 7f674559e700 1 --2- 172.21.15.80:0/2400099251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6740111db0 0x7f67401238e0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:34.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:34.180+0000 7f674559e700 1 -- 172.21.15.80:0/2400099251 shutdown_connections 2019-11-28T11:45:34.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:34.180+0000 7f674559e700 1 -- 172.21.15.80:0/2400099251 wait complete. 2019-11-28T11:45:34.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:34.180+0000 7f674559e700 1 -- 172.21.15.80:0/2400099251 >> 172.21.15.80:0/2400099251 conn(0x7f67401426c0 msgr2=0x7f6740110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:34.536 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 22, u'failed': [], u'epoch': 105, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [23], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:45:30.152127+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:45:31.784125+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:45:34.537 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:45:35.538 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:35.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.623+0000 7efc6f0af700 1 Processor -- start 2019-11-28T11:45:35.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.623+0000 7efc6f0af700 1 -- start start 2019-11-28T11:45:35.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.624+0000 7efc6f0af700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc6806d120 0x7efc68165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:35.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.624+0000 7efc6f0af700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6806d5a0 con 0x7efc6806c0a0 2019-11-28T11:45:35.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.624+0000 7efc6f0af700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6806db00 con 0x7efc6806c490 2019-11-28T11:45:35.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.624+0000 7efc6f0af700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6806fd60 con 0x7efc6806d120 2019-11-28T11:45:35.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.624+0000 7efc6de4d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc6806d120 0x7efc68165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:35.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.624+0000 7efc6de4d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc6806d120 0x7efc68165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40754/0 (socket says 172.21.15.80:40754) 2019-11-28T11:45:35.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.624+0000 7efc6de4d700 1 -- 172.21.15.80:0/1666090059 learned_addr learned my addr 172.21.15.80:0/1666090059 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:35.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.624+0000 7efc6d64c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efc6806c0a0 0x7efc68072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40068/0 (socket says 172.21.15.80:40068) 2019-11-28T11:45:35.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.625+0000 7efc6de4d700 1 -- 172.21.15.80:0/1666090059 >> v1:172.21.15.174:6789/0 conn(0x7efc6806c490 legacy=0x7efc6806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:35.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.625+0000 7efc6de4d700 1 -- 172.21.15.80:0/1666090059 >> v1:172.21.15.80:6789/0 conn(0x7efc6806c0a0 legacy=0x7efc68072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:35.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.625+0000 7efc6de4d700 1 -- 172.21.15.80:0/1666090059 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc680706c0 con 0x7efc6806d120 2019-11-28T11:45:35.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.625+0000 7efc67fff700 1 -- 172.21.15.80:0/1666090059 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847878111 0 0) 0x7efc50001480 con 0x7efc6806c0a0 2019-11-28T11:45:35.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.625+0000 7efc6de4d700 1 --2- 172.21.15.80:0/1666090059 >> v2:172.21.15.80:3300/0 conn(0x7efc6806d120 0x7efc68165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efc6000f730 tx=0x7efc6000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:35.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.625+0000 7efc6de4d700 1 --2- 172.21.15.80:0/1666090059 >> v2:172.21.15.80:3300/0 conn(0x7efc6806d120 0x7efc68165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efc6000f730 tx=0x7efc6000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:35.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.625+0000 7efc6de4d700 1 --2- 172.21.15.80:0/1666090059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6806d120 0x7efc68165d80 secure :-1 s=READY pgs=1830 cs=0 l=1 rx=0x7efc6000f730 tx=0x7efc6000fad0).ready entity=mon.0 client_cookie=eb18a9bd14008aeb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:35.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.625+0000 7efc6de4d700 1 --2- 172.21.15.80:0/1666090059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6806d120 0x7efc68165d80 secure :-1 s=THROTTLE_DONE pgs=1830 cs=0 l=1 rx=0x7efc6000f730 tx=0x7efc6000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:35.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.625+0000 7efc67fff700 1 -- 172.21.15.80:0/1666090059 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc60000a70 con 0x7efc6806d120 2019-11-28T11:45:35.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.625+0000 7efc6de4d700 1 --2- 172.21.15.80:0/1666090059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6806d120 0x7efc68165d80 secure :-1 s=THROTTLE_DONE pgs=1830 cs=0 l=1 rx=0x7efc6000f730 tx=0x7efc6000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:35.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.625+0000 7efc67fff700 1 -- 172.21.15.80:0/1666090059 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc600010e0 con 0x7efc6806d120 2019-11-28T11:45:35.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.625+0000 7efc6de4d700 1 --2- 172.21.15.80:0/1666090059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6806d120 0x7efc68165d80 secure :-1 s=THROTTLE_DONE pgs=1830 cs=0 l=1 rx=0x7efc6000f730 tx=0x7efc6000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:35.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.625+0000 7efc67fff700 1 -- 172.21.15.80:0/1666090059 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc600012d0 con 0x7efc6806d120 2019-11-28T11:45:35.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.625+0000 7efc6f0af700 1 -- 172.21.15.80:0/1666090059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6806d120 msgr2=0x7efc68165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:35.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.625+0000 7efc6f0af700 1 --2- 172.21.15.80:0/1666090059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6806d120 0x7efc68165d80 secure :-1 s=READY pgs=1830 cs=0 l=1 rx=0x7efc6000f730 tx=0x7efc6000fad0).stop 2019-11-28T11:45:35.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.626+0000 7efc6f0af700 1 -- 172.21.15.80:0/1666090059 shutdown_connections 2019-11-28T11:45:35.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.626+0000 7efc6f0af700 1 --2- 172.21.15.80:0/1666090059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc6806d120 0x7efc68165d80 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:35.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.626+0000 7efc6f0af700 1 -- 172.21.15.80:0/1666090059 shutdown_connections 2019-11-28T11:45:35.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.626+0000 7efc6f0af700 1 -- 172.21.15.80:0/1666090059 wait complete. 2019-11-28T11:45:35.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.626+0000 7efc6f0af700 1 -- 172.21.15.80:0/1666090059 >> 172.21.15.80:0/1666090059 conn(0x7efc68061cf0 msgr2=0x7efc68064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:35.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.628+0000 7efc6f0af700 1 Processor -- start 2019-11-28T11:45:35.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.628+0000 7efc6f0af700 1 -- start start 2019-11-28T11:45:35.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.629+0000 7efc6f0af700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc68111db0 0x7efc681238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:35.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.629+0000 7efc6f0af700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efc68165a00 0x7efc68167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:35.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.629+0000 7efc6f0af700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc68124260 con 0x7efc6812cea0 2019-11-28T11:45:35.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.629+0000 7efc6f0af700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc68121040 con 0x7efc68111db0 2019-11-28T11:45:35.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.629+0000 7efc6f0af700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc68121310 con 0x7efc68165a00 2019-11-28T11:45:35.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.629+0000 7efc6ce4b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc68111db0 0x7efc681238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:35.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.629+0000 7efc6d64c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efc6812cea0 0x7efc681230e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40074/0 (socket says 172.21.15.80:40074) 2019-11-28T11:45:35.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.629+0000 7efc6d64c700 1 -- 172.21.15.80:0/2798181902 learned_addr learned my addr 172.21.15.80:0/2798181902 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:35.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc65ffb700 1 -- 172.21.15.80:0/2798181902 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075267336 0 0) 0x7efc500014d0 con 0x7efc6812cea0 2019-11-28T11:45:35.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc65ffb700 1 -- 172.21.15.80:0/2798181902 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc4c002e80 con 0x7efc6812cea0 2019-11-28T11:45:35.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc6de4d700 1 --2- 172.21.15.80:0/2798181902 >> v2:172.21.15.174:3300/0 conn(0x7efc68165a00 0x7efc68167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:35.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc6ce4b700 1 -- 172.21.15.80:0/2798181902 >> v2:172.21.15.174:3300/0 conn(0x7efc68165a00 msgr2=0x7efc68167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:35.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc6ce4b700 1 --2- 172.21.15.80:0/2798181902 >> v2:172.21.15.174:3300/0 conn(0x7efc68165a00 0x7efc68167e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:35.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc6ce4b700 1 -- 172.21.15.80:0/2798181902 >> v1:172.21.15.80:6789/0 conn(0x7efc6812cea0 legacy=0x7efc681230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:35.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc6ce4b700 1 -- 172.21.15.80:0/2798181902 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc681219a0 con 0x7efc68111db0 2019-11-28T11:45:35.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc6ce4b700 1 --2- 172.21.15.80:0/2798181902 >> v2:172.21.15.80:3300/0 conn(0x7efc68111db0 0x7efc681238e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc580103a0 tx=0x7efc5800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:35.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc6ce4b700 1 --2- 172.21.15.80:0/2798181902 >> v2:172.21.15.80:3300/0 conn(0x7efc68111db0 0x7efc681238e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc580103a0 tx=0x7efc5800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:35.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc6ce4b700 1 --2- 172.21.15.80:0/2798181902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc68111db0 0x7efc681238e0 secure :-1 s=READY pgs=1832 cs=0 l=1 rx=0x7efc580103a0 tx=0x7efc5800b2e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:35.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc6ce4b700 1 --2- 172.21.15.80:0/2798181902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc68111db0 0x7efc681238e0 secure :-1 s=THROTTLE_DONE pgs=1832 cs=0 l=1 rx=0x7efc580103a0 tx=0x7efc5800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:35.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc65ffb700 1 -- 172.21.15.80:0/2798181902 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc58009790 con 0x7efc68111db0 2019-11-28T11:45:35.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc6ce4b700 1 --2- 172.21.15.80:0/2798181902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc68111db0 0x7efc681238e0 secure :-1 s=THROTTLE_DONE pgs=1832 cs=0 l=1 rx=0x7efc580103a0 tx=0x7efc5800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:35.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc6ce4b700 1 --2- 172.21.15.80:0/2798181902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc68111db0 0x7efc681238e0 secure :-1 s=THROTTLE_DONE pgs=1832 cs=0 l=1 rx=0x7efc580103a0 tx=0x7efc5800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:35.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc65ffb700 1 -- 172.21.15.80:0/2798181902 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5800a6b0 con 0x7efc68111db0 2019-11-28T11:45:35.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc6f0af700 1 -- 172.21.15.80:0/2798181902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc68121d20 con 0x7efc68111db0 2019-11-28T11:45:35.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc65ffb700 1 -- 172.21.15.80:0/2798181902 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc58009e10 con 0x7efc68111db0 2019-11-28T11:45:35.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.630+0000 7efc6f0af700 1 -- 172.21.15.80:0/2798181902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc681219a0 con 0x7efc68111db0 2019-11-28T11:45:35.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.631+0000 7efc6ce4b700 1 --2- 172.21.15.80:0/2798181902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc68111db0 0x7efc681238e0 secure :-1 s=THROTTLE_DONE pgs=1832 cs=0 l=1 rx=0x7efc580103a0 tx=0x7efc5800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:35.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.631+0000 7efc65ffb700 1 -- 172.21.15.80:0/2798181902 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efc58009790 con 0x7efc68111db0 2019-11-28T11:45:35.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.631+0000 7efc6ce4b700 1 --2- 172.21.15.80:0/2798181902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc68111db0 0x7efc681238e0 secure :-1 s=THROTTLE_DONE pgs=1832 cs=0 l=1 rx=0x7efc580103a0 tx=0x7efc5800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:35.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.631+0000 7efc65ffb700 1 --2- 172.21.15.80:0/2798181902 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc4c018770 0x7efc4c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:35.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.631+0000 7efc65ffb700 1 -- 172.21.15.80:0/2798181902 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7efc58031a20 con 0x7efc68111db0 2019-11-28T11:45:35.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.631+0000 7efc6d64c700 1 --2- 172.21.15.80:0/2798181902 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc4c018770 0x7efc4c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:35.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.632+0000 7efc6d64c700 1 --2- 172.21.15.80:0/2798181902 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc4c018770 0x7efc4c01abe0 crc :-1 s=READY pgs=740 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:35.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.639+0000 7efc6f0af700 1 -- 172.21.15.80:0/2798181902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc68121d20 con 0x7efc68111db0 2019-11-28T11:45:35.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.642+0000 7efc6ce4b700 1 --2- 172.21.15.80:0/2798181902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc68111db0 0x7efc681238e0 secure :-1 s=THROTTLE_DONE pgs=1832 cs=0 l=1 rx=0x7efc580103a0 tx=0x7efc5800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:35.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.642+0000 7efc65ffb700 1 -- 172.21.15.80:0/2798181902 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efc58009580 con 0x7efc68111db0 2019-11-28T11:45:35.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.813+0000 7efc6f0af700 1 -- 172.21.15.80:0/2798181902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc681219a0 con 0x7efc68111db0 2019-11-28T11:45:35.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.813+0000 7efc6ce4b700 1 --2- 172.21.15.80:0/2798181902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc68111db0 0x7efc681238e0 secure :-1 s=THROTTLE_DONE pgs=1832 cs=0 l=1 rx=0x7efc580103a0 tx=0x7efc5800b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:35.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.813+0000 7efc65ffb700 1 -- 172.21.15.80:0/2798181902 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+1428 (secure 0 0 0) 0x7efc5800a160 con 0x7efc68111db0 2019-11-28T11:45:35.874 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 105 2019-11-28T11:45:35.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.816+0000 7efc6f0af700 1 -- 172.21.15.80:0/2798181902 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc4c018770 msgr2=0x7efc4c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:35.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.816+0000 7efc6f0af700 1 --2- 172.21.15.80:0/2798181902 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc4c018770 0x7efc4c01abe0 crc :-1 s=READY pgs=740 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:35.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.816+0000 7efc6f0af700 1 -- 172.21.15.80:0/2798181902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc68111db0 msgr2=0x7efc681238e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:35.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.816+0000 7efc6f0af700 1 --2- 172.21.15.80:0/2798181902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc68111db0 0x7efc681238e0 secure :-1 s=READY pgs=1832 cs=0 l=1 rx=0x7efc580103a0 tx=0x7efc5800b2e0).stop 2019-11-28T11:45:35.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.816+0000 7efc6f0af700 1 -- 172.21.15.80:0/2798181902 shutdown_connections 2019-11-28T11:45:35.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.816+0000 7efc6f0af700 1 --2- 172.21.15.80:0/2798181902 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc4c018770 0x7efc4c01abe0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:35.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.816+0000 7efc6f0af700 1 --2- 172.21.15.80:0/2798181902 >> v2:172.21.15.174:3300/0 conn(0x7efc68165a00 0x7efc68167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:35.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.816+0000 7efc6f0af700 1 --2- 172.21.15.80:0/2798181902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc68111db0 0x7efc681238e0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:35.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.816+0000 7efc6f0af700 1 -- 172.21.15.80:0/2798181902 shutdown_connections 2019-11-28T11:45:35.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.816+0000 7efc6f0af700 1 -- 172.21.15.80:0/2798181902 wait complete. 2019-11-28T11:45:35.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:35.816+0000 7efc6f0af700 1 -- 172.21.15.80:0/2798181902 >> 172.21.15.80:0/2798181902 conn(0x7efc681426c0 msgr2=0x7efc68110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:35.876 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:35.876 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":105,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:30.152127+0000","modified":"2019-11-28T11:45:31.784125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2019-11-28T11:45:36.180 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 22, u'failed': [], u'epoch': 105, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [23], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:45:30.152127+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:45:31.784125+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:45:36.180 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:45:37.182 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:37.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.261+0000 7fa41851a700 1 Processor -- start 2019-11-28T11:45:37.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.261+0000 7fa41851a700 1 -- start start 2019-11-28T11:45:37.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.262+0000 7fa41851a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa41006c490 0x7fa41006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:37.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.262+0000 7fa41851a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41006db00 con 0x7fa41006c0a0 2019-11-28T11:45:37.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.262+0000 7fa41851a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41006e000 con 0x7fa41006ce60 2019-11-28T11:45:37.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.262+0000 7fa41851a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41006fd60 con 0x7fa41006c490 2019-11-28T11:45:37.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.262+0000 7fa416ab7700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa41006c0a0 0x7fa410072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40096/0 (socket says 172.21.15.80:40096) 2019-11-28T11:45:37.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.262+0000 7fa416ab7700 1 -- 172.21.15.80:0/3215215097 learned_addr learned my addr 172.21.15.80:0/3215215097 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:37.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa415ab5700 1 -- 172.21.15.80:0/3215215097 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720167346 0 0) 0x7fa3f8001150 con 0x7fa41006c0a0 2019-11-28T11:45:37.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa4162b6700 1 --2- 172.21.15.80:0/3215215097 >> v2:172.21.15.174:3300/0 conn(0x7fa41006c490 0x7fa41006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa415ab5700 1 -- 172.21.15.80:0/3215215097 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3fc002e80 con 0x7fa41006c0a0 2019-11-28T11:45:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa415ab5700 1 -- 172.21.15.80:0/3215215097 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1460964723 0 0) 0x7fa3f8001130 con 0x7fa41006c0a0 2019-11-28T11:45:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa415ab5700 1 -- 172.21.15.80:0/3215215097 >> v2:172.21.15.174:3300/0 conn(0x7fa41006c490 msgr2=0x7fa41006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa415ab5700 1 --2- 172.21.15.80:0/3215215097 >> v2:172.21.15.174:3300/0 conn(0x7fa41006c490 0x7fa41006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa415ab5700 1 -- 172.21.15.80:0/3215215097 >> v1:172.21.15.174:6789/0 conn(0x7fa41006ce60 legacy=0x7fa410164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa415ab5700 1 -- 172.21.15.80:0/3215215097 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4100706c0 con 0x7fa41006c0a0 2019-11-28T11:45:37.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa415ab5700 1 -- 172.21.15.80:0/3215215097 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fa3f8001660 con 0x7fa41006c0a0 2019-11-28T11:45:37.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa415ab5700 1 -- 172.21.15.80:0/3215215097 >> v1:172.21.15.80:6789/0 conn(0x7fa41006c0a0 legacy=0x7fa410072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:37.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa415ab5700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc003ab0 0x7fa3fc005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:37.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa415ab5700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3fc006670 0x7fa3fc008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:37.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa415ab5700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3fc0093a0 0x7fa3fc00b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:37.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa415ab5700 1 -- 172.21.15.80:0/3215215097 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc00c020 con 0x7fa3fc003ab0 2019-11-28T11:45:37.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa415ab5700 1 -- 172.21.15.80:0/3215215097 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc050220 con 0x7fa3fc006670 2019-11-28T11:45:37.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa416ab7700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc003ab0 0x7fa3fc005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:37.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa415ab5700 1 -- 172.21.15.80:0/3215215097 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc050450 con 0x7fa3fc0093a0 2019-11-28T11:45:37.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa4162b6700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3fc006670 0x7fa3fc008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:37.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa4172b8700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3fc0093a0 0x7fa3fc00b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:37.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa416ab7700 1 -- 172.21.15.80:0/3215215097 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3fc0093a0 msgr2=0x7fa3fc00b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:37.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa416ab7700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3fc0093a0 0x7fa3fc00b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:37.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa416ab7700 1 -- 172.21.15.80:0/3215215097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3fc006670 msgr2=0x7fa3fc008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa416ab7700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3fc006670 0x7fa3fc008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa416ab7700 1 -- 172.21.15.80:0/3215215097 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc050700 con 0x7fa3fc003ab0 2019-11-28T11:45:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa4172b8700 1 -- 172.21.15.80:0/3215215097 reap_dead start 2019-11-28T11:45:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa4162b6700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3fc006670 0x7fa3fc008b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.263+0000 7fa416ab7700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc003ab0 0x7fa3fc005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa3f800f890 tx=0x7fa3f800fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.264+0000 7fa416ab7700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc003ab0 0x7fa3fc005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa3f800f890 tx=0x7fa3f800fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:37.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.264+0000 7fa416ab7700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc003ab0 0x7fa3fc005f10 secure :-1 s=READY pgs=1834 cs=0 l=1 rx=0x7fa3f800f890 tx=0x7fa3f800fc30).ready entity=mon.0 client_cookie=f74e208df741e2db server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:37.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.264+0000 7fa416ab7700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc003ab0 0x7fa3fc005f10 secure :-1 s=THROTTLE_DONE pgs=1834 cs=0 l=1 rx=0x7fa3f800f890 tx=0x7fa3f800fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:37.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.264+0000 7fa415ab5700 1 -- 172.21.15.80:0/3215215097 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3f8001130 con 0x7fa3fc003ab0 2019-11-28T11:45:37.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.264+0000 7fa416ab7700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc003ab0 0x7fa3fc005f10 secure :-1 s=THROTTLE_DONE pgs=1834 cs=0 l=1 rx=0x7fa3f800f890 tx=0x7fa3f800fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:37.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.264+0000 7fa416ab7700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc003ab0 0x7fa3fc005f10 secure :-1 s=THROTTLE_DONE pgs=1834 cs=0 l=1 rx=0x7fa3f800f890 tx=0x7fa3f800fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:37.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.264+0000 7fa415ab5700 1 -- 172.21.15.80:0/3215215097 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f8004240 con 0x7fa3fc003ab0 2019-11-28T11:45:37.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.264+0000 7fa415ab5700 1 -- 172.21.15.80:0/3215215097 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3f8004990 con 0x7fa3fc003ab0 2019-11-28T11:45:37.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.264+0000 7fa41851a700 1 -- 172.21.15.80:0/3215215097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc003ab0 msgr2=0x7fa3fc005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:37.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.264+0000 7fa41851a700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc003ab0 0x7fa3fc005f10 secure :-1 s=READY pgs=1834 cs=0 l=1 rx=0x7fa3f800f890 tx=0x7fa3f800fc30).stop 2019-11-28T11:45:37.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.264+0000 7fa41851a700 1 -- 172.21.15.80:0/3215215097 shutdown_connections 2019-11-28T11:45:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.264+0000 7fa41851a700 1 --2- 172.21.15.80:0/3215215097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3fc003ab0 0x7fa3fc005f10 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.264+0000 7fa41851a700 1 -- 172.21.15.80:0/3215215097 shutdown_connections 2019-11-28T11:45:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.264+0000 7fa41851a700 1 -- 172.21.15.80:0/3215215097 wait complete. 2019-11-28T11:45:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.264+0000 7fa41851a700 1 -- 172.21.15.80:0/3215215097 >> 172.21.15.80:0/3215215097 conn(0x7fa410061cf0 msgr2=0x7fa410064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.267+0000 7fa41851a700 1 Processor -- start 2019-11-28T11:45:37.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.267+0000 7fa41851a700 1 -- start start 2019-11-28T11:45:37.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa41851a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa410152250 0x7fa410169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa41851a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa410079230 con 0x7fa4100750f0 2019-11-28T11:45:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa41851a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa410079890 con 0x7fa410074d00 2019-11-28T11:45:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa41851a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41007ab30 con 0x7fa410152250 2019-11-28T11:45:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa4162b6700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa4100750f0 0x7fa410151a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40110/0 (socket says 172.21.15.80:40110) 2019-11-28T11:45:37.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa4162b6700 1 -- 172.21.15.80:0/4211086968 learned_addr learned my addr 172.21.15.80:0/4211086968 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa4172b8700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa410152250 0x7fa410169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983373018 0 0) 0x7fa4000099a0 con 0x7fa4100750f0 2019-11-28T11:45:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3f4002e80 con 0x7fa4100750f0 2019-11-28T11:45:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1600706988 0 0) 0x7fa400000940 con 0x7fa4100750f0 2019-11-28T11:45:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa3f40032e0 con 0x7fa4100750f0 2019-11-28T11:45:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fa400009eb0 con 0x7fa4100750f0 2019-11-28T11:45:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa410152250 msgr2=0x7fa410169d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa40f7fe700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa410152250 0x7fa410169d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 >> v1:172.21.15.174:6789/0 conn(0x7fa410074d00 legacy=0x7fa410152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 >> v1:172.21.15.80:6789/0 conn(0x7fa4100750f0 legacy=0x7fa410151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:37.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa40f7fe700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3f4003400 0x7fa3f4003830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa40f7fe700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3f4003d70 0x7fa3f40041e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa40f7fe700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f40048a0 0x7fa3f4004d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f400bbf0 con 0x7fa3f40048a0 2019-11-28T11:45:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f400bde0 con 0x7fa3f4003400 2019-11-28T11:45:37.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f400c010 con 0x7fa3f4003d70 2019-11-28T11:45:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.268+0000 7fa4172b8700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f40048a0 0x7fa3f4004d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa416ab7700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3f4003400 0x7fa3f4003830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa4162b6700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3f4003d70 0x7fa3f40041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa4172b8700 1 -- 172.21.15.80:0/4211086968 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3f4003d70 msgr2=0x7fa3f40041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa4172b8700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3f4003d70 0x7fa3f40041e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa4172b8700 1 -- 172.21.15.80:0/4211086968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3f4003400 msgr2=0x7fa3f4003830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:37.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa4172b8700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3f4003400 0x7fa3f4003830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:37.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa4172b8700 1 -- 172.21.15.80:0/4211086968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f400c2c0 con 0x7fa3f40048a0 2019-11-28T11:45:37.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa41851a700 1 -- 172.21.15.80:0/4211086968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41007b810 con 0x7fa3f40048a0 2019-11-28T11:45:37.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa4172b8700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f40048a0 0x7fa3f4004d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4080106c0 tx=0x7fa408010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:37.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa41851a700 1 -- 172.21.15.80:0/4211086968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41007b490 con 0x7fa3f40048a0 2019-11-28T11:45:37.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa4172b8700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f40048a0 0x7fa3f4004d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4080106c0 tx=0x7fa408010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:37.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa4172b8700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f40048a0 0x7fa3f4004d60 secure :-1 s=READY pgs=1836 cs=0 l=1 rx=0x7fa4080106c0 tx=0x7fa408010570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:37.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa4172b8700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f40048a0 0x7fa3f4004d60 secure :-1 s=THROTTLE_DONE pgs=1836 cs=0 l=1 rx=0x7fa4080106c0 tx=0x7fa408010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:37.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa408009da0 con 0x7fa3f40048a0 2019-11-28T11:45:37.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa4172b8700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f40048a0 0x7fa3f4004d60 secure :-1 s=THROTTLE_DONE pgs=1836 cs=0 l=1 rx=0x7fa4080106c0 tx=0x7fa408010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:37.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa4172b8700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f40048a0 0x7fa3f4004d60 secure :-1 s=THROTTLE_DONE pgs=1836 cs=0 l=1 rx=0x7fa4080106c0 tx=0x7fa408010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:37.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa408009fa0 con 0x7fa3f40048a0 2019-11-28T11:45:37.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa40800a190 con 0x7fa3f40048a0 2019-11-28T11:45:37.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.269+0000 7fa4172b8700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f40048a0 0x7fa3f4004d60 secure :-1 s=THROTTLE_DONE pgs=1836 cs=0 l=1 rx=0x7fa4080106c0 tx=0x7fa408010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:37.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.270+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa408009bb0 con 0x7fa3f40048a0 2019-11-28T11:45:37.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.270+0000 7fa4172b8700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f40048a0 0x7fa3f4004d60 secure :-1 s=THROTTLE_DONE pgs=1836 cs=0 l=1 rx=0x7fa4080106c0 tx=0x7fa408010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:37.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.270+0000 7fa40f7fe700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa3f4020bd0 0x7fa3f4023000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:37.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.270+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa408031f80 con 0x7fa3f40048a0 2019-11-28T11:45:37.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.270+0000 7fa416ab7700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa3f4020bd0 0x7fa3f4023000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:37.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.270+0000 7fa416ab7700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa3f4020bd0 0x7fa3f4023000 crc :-1 s=READY pgs=744 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:37.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.276+0000 7fa41851a700 1 -- 172.21.15.80:0/4211086968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41007b810 con 0x7fa3f40048a0 2019-11-28T11:45:37.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.280+0000 7fa4172b8700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f40048a0 0x7fa3f4004d60 secure :-1 s=THROTTLE_DONE pgs=1836 cs=0 l=1 rx=0x7fa4080106c0 tx=0x7fa408010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:37.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.280+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa4080098b0 con 0x7fa3f40048a0 2019-11-28T11:45:37.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.451+0000 7fa41851a700 1 -- 172.21.15.80:0/4211086968 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa41007b490 con 0x7fa3f40048a0 2019-11-28T11:45:37.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.452+0000 7fa4172b8700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f40048a0 0x7fa3f4004d60 secure :-1 s=THROTTLE_DONE pgs=1836 cs=0 l=1 rx=0x7fa4080106c0 tx=0x7fa408010570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:37.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.452+0000 7fa40f7fe700 1 -- 172.21.15.80:0/4211086968 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+2457 (secure 0 0 0) 0x7fa408009ac0 con 0x7fa3f40048a0 2019-11-28T11:45:37.493 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 106 2019-11-28T11:45:37.505 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:37.505 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":106,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/3312817459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3312817459},{"type":"v1","addr":"172.21.15.174:6835","nonce":3312817459}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":106},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3089980665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3089980665},{"type":"v1","addr":"172.21.15.80:6834","nonce":3089980665}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":106}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:30.152127+0000","modified":"2019-11-28T11:45:36.699834+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8752},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8752":{"gid":8752,"name":"b","rank":0,"incarnation":106,"state":"up:creating","state_seq":2,"addr":"172.21.15.80:6835/1912693207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1912693207},{"type":"v1","addr":"172.21.15.80:6835","nonce":1912693207}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2019-11-28T11:45:37.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.454+0000 7fa41851a700 1 -- 172.21.15.80:0/4211086968 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa3f4020bd0 msgr2=0x7fa3f4023000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:37.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.454+0000 7fa41851a700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa3f4020bd0 0x7fa3f4023000 crc :-1 s=READY pgs=744 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:37.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.454+0000 7fa41851a700 1 -- 172.21.15.80:0/4211086968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f40048a0 msgr2=0x7fa3f4004d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:37.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.454+0000 7fa41851a700 1 --2- 172.21.15.80:0/4211086968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3f40048a0 0x7fa3f4004d60 secure :-1 s=READY pgs=1836 cs=0 l=1 rx=0x7fa4080106c0 tx=0x7fa408010570).stop 2019-11-28T11:45:37.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.454+0000 7fa4172b8700 1 -- 172.21.15.80:0/4211086968 reap_dead start 2019-11-28T11:45:37.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.454+0000 7fa4172b8700 1 -- 172.21.15.80:0/4211086968 reap_dead start 2019-11-28T11:45:37.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.454+0000 7fa41851a700 1 -- 172.21.15.80:0/4211086968 shutdown_connections 2019-11-28T11:45:37.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.454+0000 7fa41851a700 1 -- 172.21.15.80:0/4211086968 shutdown_connections 2019-11-28T11:45:37.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.454+0000 7fa41851a700 1 -- 172.21.15.80:0/4211086968 wait complete. 2019-11-28T11:45:37.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:37.454+0000 7fa41851a700 1 -- 172.21.15.80:0/4211086968 >> 172.21.15.80:0/4211086968 conn(0x7fa41013fa50 msgr2=0x7fa41007c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:37.811 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8752}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 22, u'failed': [], u'epoch': 106, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [23], u'info': {u'gid_8752': {u'export_targets': [], u'name': u'b', u'incarnation': 106, u'state_seq': 2, u'state': u'up:creating', u'gid': 8752, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1912693207, u'type': u'v2', u'addr': u'172.21.15.80:6833'}, {u'nonce': 1912693207, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/1912693207'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:45:30.152127+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:45:36.699834+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:45:37.811 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8752:up:creating 2019-11-28T11:45:38.824 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:38.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.908+0000 7fb4ab22e700 1 Processor -- start 2019-11-28T11:45:38.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.908+0000 7fb4ab22e700 1 -- start start 2019-11-28T11:45:38.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.909+0000 7fb4ab22e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb4a406c0a0 0x7fb4a4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:38.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.909+0000 7fb4ab22e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb4a40734e0 0x7fb4a4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:38.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.909+0000 7fb4ab22e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4a4072360 0x7fb4a4072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:38.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.909+0000 7fb4ab22e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a406fd60 con 0x7fb4a40734e0 2019-11-28T11:45:38.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.909+0000 7fb4ab22e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a4070030 con 0x7fb4a406c0a0 2019-11-28T11:45:38.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.909+0000 7fb4ab22e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a406f330 con 0x7fb4a4072360 2019-11-28T11:45:38.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.909+0000 7fb4a8fca700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb4a40734e0 0x7fb4a4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:38.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.909+0000 7fb4a8fca700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb4a40734e0 0x7fb4a4071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40810/0 (socket says 172.21.15.80:40810) 2019-11-28T11:45:38.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.909+0000 7fb4a8fca700 1 -- 172.21.15.80:0/2421973069 learned_addr learned my addr 172.21.15.80:0/2421973069 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:38.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.909+0000 7fb4a9fcc700 1 --2- 172.21.15.80:0/2421973069 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4a4072360 0x7fb4a4072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:38.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.909+0000 7fb4a97cb700 1 --2- 172.21.15.80:0/2421973069 >> v2:172.21.15.174:3300/0 conn(0x7fb4a406c0a0 0x7fb4a4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:38.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.910+0000 7fb4a8fca700 1 -- 172.21.15.80:0/2421973069 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4a4072360 msgr2=0x7fb4a4072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:38.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.910+0000 7fb4a8fca700 1 --2- 172.21.15.80:0/2421973069 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4a4072360 0x7fb4a4072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:38.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.910+0000 7fb4a8fca700 1 -- 172.21.15.80:0/2421973069 >> v2:172.21.15.174:3300/0 conn(0x7fb4a406c0a0 msgr2=0x7fb4a4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:38.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.910+0000 7fb4a8fca700 1 --2- 172.21.15.80:0/2421973069 >> v2:172.21.15.174:3300/0 conn(0x7fb4a406c0a0 0x7fb4a4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:38.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.910+0000 7fb4a8fca700 1 -- 172.21.15.80:0/2421973069 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a40706c0 con 0x7fb4a40734e0 2019-11-28T11:45:38.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.910+0000 7fb4a8fca700 1 --2- 172.21.15.80:0/2421973069 >> v2:172.21.15.80:3300/0 conn(0x7fb4a40734e0 0x7fb4a4071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb49400fa40 tx=0x7fb49400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:38.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.910+0000 7fb4a8fca700 1 --2- 172.21.15.80:0/2421973069 >> v2:172.21.15.80:3300/0 conn(0x7fb4a40734e0 0x7fb4a4071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb49400fa40 tx=0x7fb49400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:38.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.910+0000 7fb4a8fca700 1 --2- 172.21.15.80:0/2421973069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a40734e0 0x7fb4a4071e20 secure :-1 s=READY pgs=1837 cs=0 l=1 rx=0x7fb49400fa40 tx=0x7fb49400f8f0).ready entity=mon.0 client_cookie=e1a0d17a83b1f67c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:38.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.910+0000 7fb4a8fca700 1 --2- 172.21.15.80:0/2421973069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a40734e0 0x7fb4a4071e20 secure :-1 s=THROTTLE_DONE pgs=1837 cs=0 l=1 rx=0x7fb49400fa40 tx=0x7fb49400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.910+0000 7fb49bfff700 1 -- 172.21.15.80:0/2421973069 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb494000ce0 con 0x7fb4a40734e0 2019-11-28T11:45:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.910+0000 7fb4a8fca700 1 --2- 172.21.15.80:0/2421973069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a40734e0 0x7fb4a4071e20 secure :-1 s=THROTTLE_DONE pgs=1837 cs=0 l=1 rx=0x7fb49400fa40 tx=0x7fb49400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.910+0000 7fb4a8fca700 1 --2- 172.21.15.80:0/2421973069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a40734e0 0x7fb4a4071e20 secure :-1 s=THROTTLE_DONE pgs=1837 cs=0 l=1 rx=0x7fb49400fa40 tx=0x7fb49400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.910+0000 7fb49bfff700 1 -- 172.21.15.80:0/2421973069 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb494001010 con 0x7fb4a40734e0 2019-11-28T11:45:38.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.910+0000 7fb49bfff700 1 -- 172.21.15.80:0/2421973069 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb494001720 con 0x7fb4a40734e0 2019-11-28T11:45:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.910+0000 7fb4ab22e700 1 -- 172.21.15.80:0/2421973069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a40734e0 msgr2=0x7fb4a4071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.910+0000 7fb4ab22e700 1 --2- 172.21.15.80:0/2421973069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a40734e0 0x7fb4a4071e20 secure :-1 s=READY pgs=1837 cs=0 l=1 rx=0x7fb49400fa40 tx=0x7fb49400f8f0).stop 2019-11-28T11:45:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.911+0000 7fb4ab22e700 1 -- 172.21.15.80:0/2421973069 shutdown_connections 2019-11-28T11:45:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.911+0000 7fb4ab22e700 1 --2- 172.21.15.80:0/2421973069 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4a4072360 0x7fb4a4072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:38.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.911+0000 7fb4ab22e700 1 --2- 172.21.15.80:0/2421973069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a40734e0 0x7fb4a4071e20 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.911+0000 7fb4ab22e700 1 --2- 172.21.15.80:0/2421973069 >> v2:172.21.15.174:3300/0 conn(0x7fb4a406c0a0 0x7fb4a4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.911+0000 7fb4ab22e700 1 -- 172.21.15.80:0/2421973069 shutdown_connections 2019-11-28T11:45:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.911+0000 7fb4ab22e700 1 -- 172.21.15.80:0/2421973069 wait complete. 2019-11-28T11:45:38.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.911+0000 7fb4ab22e700 1 -- 172.21.15.80:0/2421973069 >> 172.21.15.80:0/2421973069 conn(0x7fb4a4061cf0 msgr2=0x7fb4a4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:38.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.913+0000 7fb4ab22e700 1 Processor -- start 2019-11-28T11:45:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.913+0000 7fb4ab22e700 1 -- start start 2019-11-28T11:45:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.914+0000 7fb4ab22e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb4a415fdf0 0x7fb4a412b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.914+0000 7fb4ab22e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4a412a3c0 0x7fb4a412a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.914+0000 7fb4ab22e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a413eb20 con 0x7fb4a412b8a0 2019-11-28T11:45:38.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.914+0000 7fb4ab22e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a4108820 con 0x7fb4a415fdf0 2019-11-28T11:45:38.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.914+0000 7fb4ab22e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a4108af0 con 0x7fb4a412a3c0 2019-11-28T11:45:38.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.914+0000 7fb4a97cb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb4a415fdf0 0x7fb4a412b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:38.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.914+0000 7fb4a97cb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb4a415fdf0 0x7fb4a412b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40812/0 (socket says 172.21.15.80:40812) 2019-11-28T11:45:38.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.914+0000 7fb4a8fca700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb4a412b8a0 0x7fb4a413e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40128/0 (socket says 172.21.15.80:40128) 2019-11-28T11:45:38.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.914+0000 7fb4a97cb700 1 -- 172.21.15.80:0/1322434412 learned_addr learned my addr 172.21.15.80:0/1322434412 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:38.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb4a9fcc700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4a412a3c0 0x7fb4a412a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:38.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb4a97cb700 1 -- 172.21.15.80:0/1322434412 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4a412a3c0 msgr2=0x7fb4a412a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:38.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb4a97cb700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4a412a3c0 0x7fb4a412a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:38.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb4a97cb700 1 -- 172.21.15.80:0/1322434412 >> v1:172.21.15.80:6789/0 conn(0x7fb4a412b8a0 legacy=0x7fb4a413e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:38.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb4a97cb700 1 -- 172.21.15.80:0/1322434412 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a410a8c0 con 0x7fb4a415fdf0 2019-11-28T11:45:38.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb499ffb700 1 -- 172.21.15.80:0/1322434412 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244249971 0 0) 0x7fb494007900 con 0x7fb4a412b8a0 2019-11-28T11:45:38.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb4a9fcc700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4a412a3c0 0x7fb4a412a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:38.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb4a97cb700 1 --2- 172.21.15.80:0/1322434412 >> v2:172.21.15.80:3300/0 conn(0x7fb4a415fdf0 0x7fb4a412b360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb49c010450 tx=0x7fb49c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:38.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb4a97cb700 1 --2- 172.21.15.80:0/1322434412 >> v2:172.21.15.80:3300/0 conn(0x7fb4a415fdf0 0x7fb4a412b360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb49c010450 tx=0x7fb49c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:38.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb4a97cb700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a415fdf0 0x7fb4a412b360 secure :-1 s=READY pgs=1839 cs=0 l=1 rx=0x7fb49c010450 tx=0x7fb49c0107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb4a97cb700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a415fdf0 0x7fb4a412b360 secure :-1 s=THROTTLE_DONE pgs=1839 cs=0 l=1 rx=0x7fb49c010450 tx=0x7fb49c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb499ffb700 1 -- 172.21.15.80:0/1322434412 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb49c000940 con 0x7fb4a415fdf0 2019-11-28T11:45:38.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb4a97cb700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a415fdf0 0x7fb4a412b360 secure :-1 s=THROTTLE_DONE pgs=1839 cs=0 l=1 rx=0x7fb49c010450 tx=0x7fb49c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb4ab22e700 1 -- 172.21.15.80:0/1322434412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a410a8c0 con 0x7fb4a415fdf0 2019-11-28T11:45:38.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb499ffb700 1 -- 172.21.15.80:0/1322434412 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c000940 con 0x7fb4a415fdf0 2019-11-28T11:45:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb4a97cb700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a415fdf0 0x7fb4a412b360 secure :-1 s=THROTTLE_DONE pgs=1839 cs=0 l=1 rx=0x7fb49c010450 tx=0x7fb49c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:38.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb499ffb700 1 -- 172.21.15.80:0/1322434412 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb49c001070 con 0x7fb4a415fdf0 2019-11-28T11:45:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb4ab22e700 1 -- 172.21.15.80:0/1322434412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a410a8c0 con 0x7fb4a415fdf0 2019-11-28T11:45:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.915+0000 7fb4a97cb700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a415fdf0 0x7fb4a412b360 secure :-1 s=THROTTLE_DONE pgs=1839 cs=0 l=1 rx=0x7fb49c010450 tx=0x7fb49c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.916+0000 7fb499ffb700 1 -- 172.21.15.80:0/1322434412 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb49c000c90 con 0x7fb4a415fdf0 2019-11-28T11:45:38.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.916+0000 7fb4a97cb700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a415fdf0 0x7fb4a412b360 secure :-1 s=THROTTLE_DONE pgs=1839 cs=0 l=1 rx=0x7fb49c010450 tx=0x7fb49c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:38.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.916+0000 7fb499ffb700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb484018730 0x7fb48401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:38.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.916+0000 7fb499ffb700 1 -- 172.21.15.80:0/1322434412 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb49c031d00 con 0x7fb4a415fdf0 2019-11-28T11:45:38.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.916+0000 7fb4a8fca700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb484018730 0x7fb48401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:38.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.916+0000 7fb4a8fca700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb484018730 0x7fb48401abc0 crc :-1 s=READY pgs=745 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:38.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.923+0000 7fb4ab22e700 1 -- 172.21.15.80:0/1322434412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a4109180 con 0x7fb4a415fdf0 2019-11-28T11:45:38.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.927+0000 7fb4a97cb700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a415fdf0 0x7fb4a412b360 secure :-1 s=THROTTLE_DONE pgs=1839 cs=0 l=1 rx=0x7fb49c010450 tx=0x7fb49c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:38.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:38.927+0000 7fb499ffb700 1 -- 172.21.15.80:0/1322434412 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb49c0092e0 con 0x7fb4a415fdf0 2019-11-28T11:45:39.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.098+0000 7fb4ab22e700 1 -- 172.21.15.80:0/1322434412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4a4109500 con 0x7fb4a415fdf0 2019-11-28T11:45:39.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.099+0000 7fb4a97cb700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a415fdf0 0x7fb4a412b360 secure :-1 s=THROTTLE_DONE pgs=1839 cs=0 l=1 rx=0x7fb49c010450 tx=0x7fb49c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:39.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.099+0000 7fb499ffb700 1 -- 172.21.15.80:0/1322434412 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+2455 (secure 0 0 0) 0x7fb49c000c90 con 0x7fb4a415fdf0 2019-11-28T11:45:39.144 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 107 2019-11-28T11:45:39.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.101+0000 7fb4ab22e700 1 -- 172.21.15.80:0/1322434412 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb484018730 msgr2=0x7fb48401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:39.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.101+0000 7fb4ab22e700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb484018730 0x7fb48401abc0 crc :-1 s=READY pgs=745 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:39.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.101+0000 7fb4ab22e700 1 -- 172.21.15.80:0/1322434412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a415fdf0 msgr2=0x7fb4a412b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:39.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.101+0000 7fb4ab22e700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a415fdf0 0x7fb4a412b360 secure :-1 s=READY pgs=1839 cs=0 l=1 rx=0x7fb49c010450 tx=0x7fb49c0107f0).stop 2019-11-28T11:45:39.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.101+0000 7fb4ab22e700 1 -- 172.21.15.80:0/1322434412 shutdown_connections 2019-11-28T11:45:39.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.101+0000 7fb4ab22e700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb484018730 0x7fb48401abc0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:39.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.101+0000 7fb4ab22e700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb4a412a3c0 0x7fb4a412a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:39.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.101+0000 7fb4ab22e700 1 --2- 172.21.15.80:0/1322434412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4a415fdf0 0x7fb4a412b360 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:39.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.101+0000 7fb4ab22e700 1 -- 172.21.15.80:0/1322434412 shutdown_connections 2019-11-28T11:45:39.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.101+0000 7fb4ab22e700 1 -- 172.21.15.80:0/1322434412 wait complete. 2019-11-28T11:45:39.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.101+0000 7fb4ab22e700 1 -- 172.21.15.80:0/1322434412 >> 172.21.15.80:0/1322434412 conn(0x7fb4a4127dc0 msgr2=0x7fb4a4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:39.148 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":107,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/3312817459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3312817459},{"type":"v1","addr":"172.21.15.174:6835","nonce":3312817459}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":106},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3089980665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3089980665},{"type":"v1","addr":"172.21.15.80:6834","nonce":3089980665}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":106}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:30.152127+0000","modified":"2019-11-28T11:45:37.708419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8752},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8752":{"gid":8752,"name":"b","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6835/1912693207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1912693207},{"type":"v1","addr":"172.21.15.80:6835","nonce":1912693207}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2019-11-28T11:45:39.460 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8752}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 22, u'failed': [], u'epoch': 107, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [23], u'info': {u'gid_8752': {u'export_targets': [], u'name': u'b', u'incarnation': 106, u'state_seq': 3, u'state': u'up:active', u'gid': 8752, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1912693207, u'type': u'v2', u'addr': u'172.21.15.80:6833'}, {u'nonce': 1912693207, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/1912693207'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:45:30.152127+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:45:37.708419+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:45:39.460 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:45:39.461 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-11-28T11:45:39.602 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:45:39.602 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:45:39.602 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T11:45:39.602 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 8752, 2019-11-28T11:45:39.602 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2019-11-28T11:45:39.602 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2019-11-28T11:45:39.603 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 2.8501534089999998, 2019-11-28T11:45:39.603 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 107, 2019-11-28T11:45:39.603 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 141, 2019-11-28T11:45:39.603 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 141, 2019-11-28T11:45:39.603 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 6.9767355240000004 2019-11-28T11:45:39.603 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:45:39.604 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8752, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.8501534089999998, "mdsmap_epoch": 107, "osdmap_epoch": 141, "osdmap_epoch_barrier": 141, "uptime": 6.9767355240000004 } 2019-11-28T11:45:39.604 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:45:39.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.713+0000 7f1ab35d2700 1 Processor -- start 2019-11-28T11:45:39.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.713+0000 7f1ab35d2700 1 -- start start 2019-11-28T11:45:39.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab35d2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aac06c0a0 0x7f1aac072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:39.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab35d2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1aac072620 0x7f1aac164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:39.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab35d2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aac06db00 con 0x7f1aac0734e0 2019-11-28T11:45:39.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab35d2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aac06f330 con 0x7f1aac072620 2019-11-28T11:45:39.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab35d2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0706c0 con 0x7f1aac06c0a0 2019-11-28T11:45:39.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab2370700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1aac072620 0x7f1aac164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:39.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab2370700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1aac072620 0x7f1aac164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40822/0 (socket says 172.21.15.80:40822) 2019-11-28T11:45:39.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab2370700 1 -- 172.21.15.80:0/3272602533 learned_addr learned my addr 172.21.15.80:0/3272602533 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:39.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab1b6f700 1 --2- 172.21.15.80:0/3272602533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aac06c0a0 0x7f1aac072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:39.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab2370700 1 -- 172.21.15.80:0/3272602533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aac06c0a0 msgr2=0x7f1aac072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:39.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab2370700 1 --2- 172.21.15.80:0/3272602533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aac06c0a0 0x7f1aac072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:39.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab2370700 1 -- 172.21.15.80:0/3272602533 >> v1:172.21.15.174:6789/0 conn(0x7f1aac0734e0 legacy=0x7f1aac071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:39.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab2370700 1 -- 172.21.15.80:0/3272602533 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac070a40 con 0x7f1aac072620 2019-11-28T11:45:39.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab1b6f700 1 --2- 172.21.15.80:0/3272602533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aac06c0a0 0x7f1aac072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:45:39.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab2370700 1 --2- 172.21.15.80:0/3272602533 >> v2:172.21.15.80:3300/0 conn(0x7f1aac072620 0x7f1aac164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1aa400f730 tx=0x7f1aa400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:39.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab2370700 1 --2- 172.21.15.80:0/3272602533 >> v2:172.21.15.80:3300/0 conn(0x7f1aac072620 0x7f1aac164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1aa400f730 tx=0x7f1aa400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:39.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.714+0000 7f1ab2370700 1 --2- 172.21.15.80:0/3272602533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac072620 0x7f1aac164d70 secure :-1 s=READY pgs=1840 cs=0 l=1 rx=0x7f1aa400f730 tx=0x7f1aa400fad0).ready entity=mon.0 client_cookie=2b93b57a2e909343 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:39.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.715+0000 7f1ab2370700 1 --2- 172.21.15.80:0/3272602533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac072620 0x7f1aac164d70 secure :-1 s=THROTTLE_DONE pgs=1840 cs=0 l=1 rx=0x7f1aa400f730 tx=0x7f1aa400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:39.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.715+0000 7f1ab2370700 1 --2- 172.21.15.80:0/3272602533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac072620 0x7f1aac164d70 secure :-1 s=THROTTLE_DONE pgs=1840 cs=0 l=1 rx=0x7f1aa400f730 tx=0x7f1aa400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:39.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.715+0000 7f1ab0b6d700 1 -- 172.21.15.80:0/3272602533 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aa4000b90 con 0x7f1aac072620 2019-11-28T11:45:39.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.715+0000 7f1ab2370700 1 --2- 172.21.15.80:0/3272602533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac072620 0x7f1aac164d70 secure :-1 s=THROTTLE_DONE pgs=1840 cs=0 l=1 rx=0x7f1aa400f730 tx=0x7f1aa400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:39.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.715+0000 7f1ab0b6d700 1 -- 172.21.15.80:0/3272602533 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa40010e0 con 0x7f1aac072620 2019-11-28T11:45:39.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.715+0000 7f1ab0b6d700 1 -- 172.21.15.80:0/3272602533 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aa4001830 con 0x7f1aac072620 2019-11-28T11:45:39.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.715+0000 7f1ab35d2700 1 -- 172.21.15.80:0/3272602533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac072620 msgr2=0x7f1aac164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:39.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.715+0000 7f1ab35d2700 1 --2- 172.21.15.80:0/3272602533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac072620 0x7f1aac164d70 secure :-1 s=READY pgs=1840 cs=0 l=1 rx=0x7f1aa400f730 tx=0x7f1aa400fad0).stop 2019-11-28T11:45:39.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.715+0000 7f1ab35d2700 1 -- 172.21.15.80:0/3272602533 shutdown_connections 2019-11-28T11:45:39.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.715+0000 7f1ab35d2700 1 --2- 172.21.15.80:0/3272602533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac072620 0x7f1aac164d70 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:39.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.715+0000 7f1ab35d2700 1 --2- 172.21.15.80:0/3272602533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aac06c0a0 0x7f1aac072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:39.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.716+0000 7f1ab35d2700 1 -- 172.21.15.80:0/3272602533 shutdown_connections 2019-11-28T11:45:39.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.716+0000 7f1ab35d2700 1 -- 172.21.15.80:0/3272602533 wait complete. 2019-11-28T11:45:39.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.716+0000 7f1ab35d2700 1 -- 172.21.15.80:0/3272602533 >> 172.21.15.80:0/3272602533 conn(0x7f1aac061cf0 msgr2=0x7f1aac064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:39.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.718+0000 7f1ab35d2700 1 Processor -- start 2019-11-28T11:45:39.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.718+0000 7f1ab35d2700 1 -- start start 2019-11-28T11:45:39.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab35d2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1aac13e5f0 0x7f1aac13e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:39.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab35d2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aac10a4e0 0x7f1aac10c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:39.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab35d2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aac1066e0 con 0x7f1aac10a070 2019-11-28T11:45:39.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab35d2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aac10e060 con 0x7f1aac13e5f0 2019-11-28T11:45:39.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab35d2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac10e330 con 0x7f1aac10a4e0 2019-11-28T11:45:39.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab1b6f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1aac13e5f0 0x7f1aac13e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:39.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab136e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1aac10a070 0x7f1aac10bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40144/0 (socket says 172.21.15.80:40144) 2019-11-28T11:45:39.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab1b6f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1aac13e5f0 0x7f1aac13e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40826/0 (socket says 172.21.15.80:40826) 2019-11-28T11:45:39.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab136e700 1 -- 172.21.15.80:0/160008169 learned_addr learned my addr 172.21.15.80:0/160008169 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:39.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab1b6f700 1 -- 172.21.15.80:0/160008169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aac10a4e0 msgr2=0x7f1aac10c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:39.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab1b6f700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aac10a4e0 0x7f1aac10c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:39.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab1b6f700 1 -- 172.21.15.80:0/160008169 >> v1:172.21.15.80:6789/0 conn(0x7f1aac10a070 legacy=0x7f1aac10bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:39.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1aaa7fc700 1 -- 172.21.15.80:0/160008169 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999304309 0 0) 0x7f1a9c001150 con 0x7f1aac10a070 2019-11-28T11:45:39.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab1b6f700 1 -- 172.21.15.80:0/160008169 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac10e9c0 con 0x7f1aac13e5f0 2019-11-28T11:45:39.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab1b6f700 1 --2- 172.21.15.80:0/160008169 >> v2:172.21.15.80:3300/0 conn(0x7f1aac13e5f0 0x7f1aac13e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1a94010700 tx=0x7f1a9400b150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:39.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab1b6f700 1 --2- 172.21.15.80:0/160008169 >> v2:172.21.15.80:3300/0 conn(0x7f1aac13e5f0 0x7f1aac13e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1a94010700 tx=0x7f1a9400b150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:39.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab1b6f700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac13e5f0 0x7f1aac13e9e0 secure :-1 s=READY pgs=1842 cs=0 l=1 rx=0x7f1a94010700 tx=0x7f1a9400b150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:39.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab1b6f700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac13e5f0 0x7f1aac13e9e0 secure :-1 s=THROTTLE_DONE pgs=1842 cs=0 l=1 rx=0x7f1a94010700 tx=0x7f1a9400b150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:39.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1aaa7fc700 1 -- 172.21.15.80:0/160008169 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a94001410 con 0x7f1aac13e5f0 2019-11-28T11:45:39.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab1b6f700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac13e5f0 0x7f1aac13e9e0 secure :-1 s=THROTTLE_DONE pgs=1842 cs=0 l=1 rx=0x7f1a94010700 tx=0x7f1a9400b150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:39.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab1b6f700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac13e5f0 0x7f1aac13e9e0 secure :-1 s=THROTTLE_DONE pgs=1842 cs=0 l=1 rx=0x7f1a94010700 tx=0x7f1a9400b150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:39.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1aaa7fc700 1 -- 172.21.15.80:0/160008169 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a94000cc0 con 0x7f1aac13e5f0 2019-11-28T11:45:39.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1aaa7fc700 1 -- 172.21.15.80:0/160008169 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a940019f0 con 0x7f1aac13e5f0 2019-11-28T11:45:39.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.719+0000 7f1ab35d2700 1 -- 172.21.15.80:0/160008169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aac10ed40 con 0x7f1aac13e5f0 2019-11-28T11:45:39.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.720+0000 7f1ab35d2700 1 -- 172.21.15.80:0/160008169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aac10e9c0 con 0x7f1aac13e5f0 2019-11-28T11:45:39.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.720+0000 7f1ab1b6f700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac13e5f0 0x7f1aac13e9e0 secure :-1 s=THROTTLE_DONE pgs=1842 cs=0 l=1 rx=0x7f1a94010700 tx=0x7f1a9400b150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:39.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.720+0000 7f1aaa7fc700 1 -- 172.21.15.80:0/160008169 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1a94001220 con 0x7f1aac13e5f0 2019-11-28T11:45:39.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.720+0000 7f1ab1b6f700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac13e5f0 0x7f1aac13e9e0 secure :-1 s=THROTTLE_DONE pgs=1842 cs=0 l=1 rx=0x7f1a94010700 tx=0x7f1a9400b150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:39.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.720+0000 7f1aaa7fc700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1a90018730 0x7f1a9001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:39.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.721+0000 7f1aaa7fc700 1 -- 172.21.15.80:0/160008169 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1a94031cd0 con 0x7f1aac13e5f0 2019-11-28T11:45:39.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.721+0000 7f1ab136e700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1a90018730 0x7f1a9001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:39.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.721+0000 7f1ab136e700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1a90018730 0x7f1a9001abc0 crc :-1 s=READY pgs=746 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:39.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.728+0000 7f1ab35d2700 1 -- 172.21.15.80:0/160008169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aac10ed40 con 0x7f1aac13e5f0 2019-11-28T11:45:39.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.731+0000 7f1ab1b6f700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac13e5f0 0x7f1aac13e9e0 secure :-1 s=THROTTLE_DONE pgs=1842 cs=0 l=1 rx=0x7f1a94010700 tx=0x7f1a9400b150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:39.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.732+0000 7f1aaa7fc700 1 -- 172.21.15.80:0/160008169 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1a94001010 con 0x7f1aac13e5f0 2019-11-28T11:45:39.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.908+0000 7f1ab35d2700 1 -- 172.21.15.80:0/160008169 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1aac10e9c0 con 0x7f1aac13e5f0 2019-11-28T11:45:39.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.908+0000 7f1ab1b6f700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac13e5f0 0x7f1aac13e9e0 secure :-1 s=THROTTLE_DONE pgs=1842 cs=0 l=1 rx=0x7f1a94010700 tx=0x7f1a9400b150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:39.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.909+0000 7f1aaa7fc700 1 -- 172.21.15.80:0/160008169 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f1a94001220 con 0x7f1aac13e5f0 2019-11-28T11:45:39.950 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:39.950 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":141,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:45:31.153550+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:45:28.436380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2019-11-28T11:45:29.126890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:45:39.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.911+0000 7f1ab35d2700 1 -- 172.21.15.80:0/160008169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1a90018730 msgr2=0x7f1a9001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:39.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.911+0000 7f1ab35d2700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1a90018730 0x7f1a9001abc0 crc :-1 s=READY pgs=746 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:39.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.911+0000 7f1ab35d2700 1 -- 172.21.15.80:0/160008169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac13e5f0 msgr2=0x7f1aac13e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:39.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.911+0000 7f1ab35d2700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac13e5f0 0x7f1aac13e9e0 secure :-1 s=READY pgs=1842 cs=0 l=1 rx=0x7f1a94010700 tx=0x7f1a9400b150).stop 2019-11-28T11:45:39.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.911+0000 7f1ab35d2700 1 -- 172.21.15.80:0/160008169 shutdown_connections 2019-11-28T11:45:39.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.911+0000 7f1ab35d2700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1a90018730 0x7f1a9001abc0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:39.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.911+0000 7f1ab35d2700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aac10a4e0 0x7f1aac10c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:39.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.911+0000 7f1ab35d2700 1 --2- 172.21.15.80:0/160008169 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1aac13e5f0 0x7f1aac13e9e0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:39.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.911+0000 7f1ab35d2700 1 -- 172.21.15.80:0/160008169 shutdown_connections 2019-11-28T11:45:39.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.911+0000 7f1ab35d2700 1 -- 172.21.15.80:0/160008169 wait complete. 2019-11-28T11:45:39.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:39.911+0000 7f1ab35d2700 1 -- 172.21.15.80:0/160008169 >> 172.21.15.80:0/160008169 conn(0x7f1aac13d620 msgr2=0x7f1aac13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:39.962 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:45:28.436380+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 22, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'140', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:45:29.126890+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 23, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'141', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:45:39.963 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:45:40.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.045+0000 7f8429bd4700 1 Processor -- start 2019-11-28T11:45:40.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.045+0000 7f8429bd4700 1 -- start start 2019-11-28T11:45:40.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.046+0000 7f8429bd4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f842415ed10 0x7f842415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:40.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.046+0000 7f8429bd4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842406db60 con 0x7f8424073020 2019-11-28T11:45:40.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.046+0000 7f8429bd4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842406e060 con 0x7f84240734b0 2019-11-28T11:45:40.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.046+0000 7f8429bd4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842406f3d0 con 0x7f842415ed10 2019-11-28T11:45:40.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.046+0000 7f841bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8424073020 0x7f8424071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40150/0 (socket says 172.21.15.80:40150) 2019-11-28T11:45:40.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.046+0000 7f841bfff700 1 -- 172.21.15.80:0/4230917300 learned_addr learned my addr 172.21.15.80:0/4230917300 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:40.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.046+0000 7f84237fe700 1 -- 172.21.15.80:0/4230917300 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895862654 0 0) 0x7f840c001150 con 0x7f8424073020 2019-11-28T11:45:40.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.046+0000 7f8423fff700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f842415ed10 0x7f842415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.046+0000 7f84237fe700 1 -- 172.21.15.80:0/4230917300 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8410002e80 con 0x7f8424073020 2019-11-28T11:45:40.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f84237fe700 1 -- 172.21.15.80:0/4230917300 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3967118356 0 0) 0x7f840c001130 con 0x7f8424073020 2019-11-28T11:45:40.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f84237fe700 1 -- 172.21.15.80:0/4230917300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f842415ed10 msgr2=0x7f842415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:40.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f84237fe700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f842415ed10 0x7f842415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:40.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f84237fe700 1 -- 172.21.15.80:0/4230917300 >> v1:172.21.15.174:6789/0 conn(0x7f84240734b0 legacy=0x7f84240726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f84237fe700 1 -- 172.21.15.80:0/4230917300 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424070760 con 0x7f8424073020 2019-11-28T11:45:40.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f84237fe700 1 -- 172.21.15.80:0/4230917300 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f840c001660 con 0x7f8424073020 2019-11-28T11:45:40.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f84237fe700 1 -- 172.21.15.80:0/4230917300 >> v1:172.21.15.80:6789/0 conn(0x7f8424073020 legacy=0x7f8424071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f84237fe700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8410003ab0 0x7f8410005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:40.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f84237fe700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8410006640 0x7f8410008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:40.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f84237fe700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8410009310 0x7f841000b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:40.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f84237fe700 1 -- 172.21.15.80:0/4230917300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841000bff0 con 0x7f8410009310 2019-11-28T11:45:40.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f84237fe700 1 -- 172.21.15.80:0/4230917300 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84100501f0 con 0x7f8410006640 2019-11-28T11:45:40.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f84237fe700 1 -- 172.21.15.80:0/4230917300 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8410050420 con 0x7f8410003ab0 2019-11-28T11:45:40.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f8428972700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8410009310 0x7f841000b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f8423fff700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8410003ab0 0x7f8410005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f841bfff700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8410006640 0x7f8410008b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f8428972700 1 -- 172.21.15.80:0/4230917300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8410003ab0 msgr2=0x7f8410005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:40.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f8428972700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8410003ab0 0x7f8410005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:40.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f8428972700 1 -- 172.21.15.80:0/4230917300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8410006640 msgr2=0x7f8410008b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:40.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f8428972700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8410006640 0x7f8410008b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:40.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f8428972700 1 -- 172.21.15.80:0/4230917300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84100506d0 con 0x7f8410009310 2019-11-28T11:45:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f8428972700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8410009310 0x7f841000b7e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f841c00b2d0 tx=0x7f841c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f8428972700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8410009310 0x7f841000b7e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f841c00b2d0 tx=0x7f841c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f8428972700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8410009310 0x7f841000b7e0 secure :-1 s=READY pgs=1844 cs=0 l=1 rx=0x7f841c00b2d0 tx=0x7f841c00b5d0).ready entity=mon.0 client_cookie=7740a8528ed4a1ea server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f8428972700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8410009310 0x7f841000b7e0 secure :-1 s=THROTTLE_DONE pgs=1844 cs=0 l=1 rx=0x7f841c00b2d0 tx=0x7f841c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f84237fe700 1 -- 172.21.15.80:0/4230917300 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f841c009f20 con 0x7f8410009310 2019-11-28T11:45:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f8428972700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8410009310 0x7f841000b7e0 secure :-1 s=THROTTLE_DONE pgs=1844 cs=0 l=1 rx=0x7f841c00b2d0 tx=0x7f841c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f8428972700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8410009310 0x7f841000b7e0 secure :-1 s=THROTTLE_DONE pgs=1844 cs=0 l=1 rx=0x7f841c00b2d0 tx=0x7f841c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f84237fe700 1 -- 172.21.15.80:0/4230917300 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841c009b40 con 0x7f8410009310 2019-11-28T11:45:40.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f84237fe700 1 -- 172.21.15.80:0/4230917300 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f841c00a690 con 0x7f8410009310 2019-11-28T11:45:40.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f8429bd4700 1 -- 172.21.15.80:0/4230917300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8410009310 msgr2=0x7f841000b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f8429bd4700 1 --2- 172.21.15.80:0/4230917300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8410009310 0x7f841000b7e0 secure :-1 s=READY pgs=1844 cs=0 l=1 rx=0x7f841c00b2d0 tx=0x7f841c00b5d0).stop 2019-11-28T11:45:40.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.047+0000 7f8428972700 1 -- 172.21.15.80:0/4230917300 reap_dead start 2019-11-28T11:45:40.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.048+0000 7f8429bd4700 1 -- 172.21.15.80:0/4230917300 shutdown_connections 2019-11-28T11:45:40.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.048+0000 7f8429bd4700 1 -- 172.21.15.80:0/4230917300 shutdown_connections 2019-11-28T11:45:40.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.048+0000 7f8429bd4700 1 -- 172.21.15.80:0/4230917300 wait complete. 2019-11-28T11:45:40.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.048+0000 7f8429bd4700 1 -- 172.21.15.80:0/4230917300 >> 172.21.15.80:0/4230917300 conn(0x7f8424061d20 msgr2=0x7f84240641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:40.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.051+0000 7f8429bd4700 1 Processor -- start 2019-11-28T11:45:40.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.051+0000 7f8429bd4700 1 -- start start 2019-11-28T11:45:40.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.051+0000 7f8429bd4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f842412c2a0 0x7f842412c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:40.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.051+0000 7f8429bd4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f84241510e0 0x7f8424151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:40.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.051+0000 7f8429bd4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842410a310 con 0x7f8424108630 2019-11-28T11:45:40.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.051+0000 7f8429bd4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842412ee80 con 0x7f842412c2a0 2019-11-28T11:45:40.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.051+0000 7f8429bd4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84241329f0 con 0x7f84241510e0 2019-11-28T11:45:40.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f841bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f842412c2a0 0x7f842412c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f841bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f842412c2a0 0x7f842412c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40848/0 (socket says 172.21.15.80:40848) 2019-11-28T11:45:40.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f841bfff700 1 -- 172.21.15.80:0/1674853366 learned_addr learned my addr 172.21.15.80:0/1674853366 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:40.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f8428972700 1 --2- 172.21.15.80:0/1674853366 >> v2:172.21.15.174:3300/0 conn(0x7f84241510e0 0x7f8424151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f841bfff700 1 -- 172.21.15.80:0/1674853366 >> v2:172.21.15.174:3300/0 conn(0x7f84241510e0 msgr2=0x7f8424151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f841bfff700 1 --2- 172.21.15.80:0/1674853366 >> v2:172.21.15.174:3300/0 conn(0x7f84241510e0 0x7f8424151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f841bfff700 1 -- 172.21.15.80:0/1674853366 >> v1:172.21.15.174:6789/0 conn(0x7f8424108630 legacy=0x7f8424152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f841bfff700 1 -- 172.21.15.80:0/1674853366 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424133350 con 0x7f842412c2a0 2019-11-28T11:45:40.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f841bfff700 1 --2- 172.21.15.80:0/1674853366 >> v2:172.21.15.80:3300/0 conn(0x7f842412c2a0 0x7f842412c730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f840c010430 tx=0x7f840c0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f841bfff700 1 --2- 172.21.15.80:0/1674853366 >> v2:172.21.15.80:3300/0 conn(0x7f842412c2a0 0x7f842412c730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f840c010430 tx=0x7f840c0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f841bfff700 1 --2- 172.21.15.80:0/1674853366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f842412c2a0 0x7f842412c730 secure :-1 s=READY pgs=1845 cs=0 l=1 rx=0x7f840c010430 tx=0x7f840c0102e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:40.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f841bfff700 1 --2- 172.21.15.80:0/1674853366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f842412c2a0 0x7f842412c730 secure :-1 s=THROTTLE_DONE pgs=1845 cs=0 l=1 rx=0x7f840c010430 tx=0x7f840c0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f841bfff700 1 --2- 172.21.15.80:0/1674853366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f842412c2a0 0x7f842412c730 secure :-1 s=THROTTLE_DONE pgs=1845 cs=0 l=1 rx=0x7f840c010430 tx=0x7f840c0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f84217fa700 1 -- 172.21.15.80:0/1674853366 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f840c000d40 con 0x7f842412c2a0 2019-11-28T11:45:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f841bfff700 1 --2- 172.21.15.80:0/1674853366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f842412c2a0 0x7f842412c730 secure :-1 s=THROTTLE_DONE pgs=1845 cs=0 l=1 rx=0x7f840c010430 tx=0x7f840c0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f84217fa700 1 -- 172.21.15.80:0/1674853366 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840c0013a0 con 0x7f842412c2a0 2019-11-28T11:45:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f8429bd4700 1 -- 172.21.15.80:0/1674853366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84241336d0 con 0x7f842412c2a0 2019-11-28T11:45:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f84217fa700 1 -- 172.21.15.80:0/1674853366 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f840c004830 con 0x7f842412c2a0 2019-11-28T11:45:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.052+0000 7f8429bd4700 1 -- 172.21.15.80:0/1674853366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8424133350 con 0x7f842412c2a0 2019-11-28T11:45:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.053+0000 7f841bfff700 1 --2- 172.21.15.80:0/1674853366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f842412c2a0 0x7f842412c730 secure :-1 s=THROTTLE_DONE pgs=1845 cs=0 l=1 rx=0x7f840c010430 tx=0x7f840c0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.053+0000 7f84217fa700 1 -- 172.21.15.80:0/1674853366 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f840c001b40 con 0x7f842412c2a0 2019-11-28T11:45:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.053+0000 7f841bfff700 1 --2- 172.21.15.80:0/1674853366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f842412c2a0 0x7f842412c730 secure :-1 s=THROTTLE_DONE pgs=1845 cs=0 l=1 rx=0x7f840c010430 tx=0x7f840c0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.053+0000 7f84217fa700 1 --2- 172.21.15.80:0/1674853366 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8408018730 0x7f840801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.053+0000 7f84217fa700 1 -- 172.21.15.80:0/1674853366 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f840c031a30 con 0x7f842412c2a0 2019-11-28T11:45:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.053+0000 7f8423fff700 1 --2- 172.21.15.80:0/1674853366 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8408018730 0x7f840801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.053+0000 7f8423fff700 1 --2- 172.21.15.80:0/1674853366 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8408018730 0x7f840801abc0 crc :-1 s=READY pgs=747 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:40.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.060+0000 7f8429bd4700 1 -- 172.21.15.80:0/1674853366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84241336d0 con 0x7f842412c2a0 2019-11-28T11:45:40.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.064+0000 7f841bfff700 1 --2- 172.21.15.80:0/1674853366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f842412c2a0 0x7f842412c730 secure :-1 s=THROTTLE_DONE pgs=1845 cs=0 l=1 rx=0x7f840c010430 tx=0x7f840c0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.064+0000 7f84217fa700 1 -- 172.21.15.80:0/1674853366 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f840c02ef10 con 0x7f842412c2a0 2019-11-28T11:45:40.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.230+0000 7f8429bd4700 1 -- 172.21.15.80:0/1674853366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f8424133350 con 0x7f842412c2a0 2019-11-28T11:45:40.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.231+0000 7f841bfff700 1 --2- 172.21.15.80:0/1674853366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f842412c2a0 0x7f842412c730 secure :-1 s=THROTTLE_DONE pgs=1845 cs=0 l=1 rx=0x7f840c010430 tx=0x7f840c0102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.231+0000 7f84217fa700 1 -- 172.21.15.80:0/1674853366 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v141) v1 ==== 92+0+10 (secure 0 0 0) 0x7f840c02ef10 con 0x7f842412c2a0 2019-11-28T11:45:40.272 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:45:40.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.233+0000 7f8429bd4700 1 -- 172.21.15.80:0/1674853366 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8408018730 msgr2=0x7f840801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.233+0000 7f8429bd4700 1 --2- 172.21.15.80:0/1674853366 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8408018730 0x7f840801abc0 crc :-1 s=READY pgs=747 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.233+0000 7f8429bd4700 1 -- 172.21.15.80:0/1674853366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f842412c2a0 msgr2=0x7f842412c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.233+0000 7f8429bd4700 1 --2- 172.21.15.80:0/1674853366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f842412c2a0 0x7f842412c730 secure :-1 s=READY pgs=1845 cs=0 l=1 rx=0x7f840c010430 tx=0x7f840c0102e0).stop 2019-11-28T11:45:40.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.233+0000 7f8429bd4700 1 -- 172.21.15.80:0/1674853366 shutdown_connections 2019-11-28T11:45:40.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.233+0000 7f8429bd4700 1 --2- 172.21.15.80:0/1674853366 >> v2:172.21.15.174:3300/0 conn(0x7f84241510e0 0x7f8424151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.233+0000 7f8429bd4700 1 --2- 172.21.15.80:0/1674853366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f842412c2a0 0x7f842412c730 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.233+0000 7f8429bd4700 1 --2- 172.21.15.80:0/1674853366 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8408018730 0x7f840801abc0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.233+0000 7f8429bd4700 1 -- 172.21.15.80:0/1674853366 shutdown_connections 2019-11-28T11:45:40.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.233+0000 7f8429bd4700 1 -- 172.21.15.80:0/1674853366 wait complete. 2019-11-28T11:45:40.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.233+0000 7f8429bd4700 1 -- 172.21.15.80:0/1674853366 >> 172.21.15.80:0/1674853366 conn(0x7f842414dbb0 msgr2=0x7f8424142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:40.284 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:45:40.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.366+0000 7f84b1105700 1 Processor -- start 2019-11-28T11:45:40.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.366+0000 7f84b1105700 1 -- start start 2019-11-28T11:45:40.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84b1105700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84ac15ed10 0x7f84ac15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:40.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84b1105700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f84ac073020 0x7f84ac071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:40.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84b1105700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ac06db60 con 0x7f84ac0734b0 2019-11-28T11:45:40.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84b1105700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ac06f3d0 con 0x7f84ac073020 2019-11-28T11:45:40.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84b1105700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac06fe00 con 0x7f84ac15ed10 2019-11-28T11:45:40.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84aad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f84ac073020 0x7f84ac071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84b0904700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f84ac0734b0 0x7f84ac0723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40172/0 (socket says 172.21.15.80:40172) 2019-11-28T11:45:40.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84b0904700 1 -- 172.21.15.80:0/3973796355 learned_addr learned my addr 172.21.15.80:0/3973796355 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:40.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84ab59e700 1 --2- 172.21.15.80:0/3973796355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84ac15ed10 0x7f84ac15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84aad9d700 1 -- 172.21.15.80:0/3973796355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84ac15ed10 msgr2=0x7f84ac15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:40.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3973796355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84ac15ed10 0x7f84ac15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:40.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84aa59c700 1 -- 172.21.15.80:0/3973796355 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719147047 0 0) 0x7f849c0014d0 con 0x7f84ac0734b0 2019-11-28T11:45:40.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84aad9d700 1 -- 172.21.15.80:0/3973796355 >> v1:172.21.15.80:6789/0 conn(0x7f84ac0734b0 legacy=0x7f84ac0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84aad9d700 1 -- 172.21.15.80:0/3973796355 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac070760 con 0x7f84ac073020 2019-11-28T11:45:40.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84ab59e700 1 --2- 172.21.15.80:0/3973796355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84ac15ed10 0x7f84ac15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:45:40.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3973796355 >> v2:172.21.15.80:3300/0 conn(0x7f84ac073020 0x7f84ac071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f84a400af50 tx=0x7f84a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3973796355 >> v2:172.21.15.80:3300/0 conn(0x7f84ac073020 0x7f84ac071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f84a400af50 tx=0x7f84a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3973796355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84ac073020 0x7f84ac071ea0 secure :-1 s=READY pgs=1847 cs=0 l=1 rx=0x7f84a400af50 tx=0x7f84a400b760).ready entity=mon.0 client_cookie=800690e6de0e24fe server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:40.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3973796355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84ac073020 0x7f84ac071ea0 secure :-1 s=THROTTLE_DONE pgs=1847 cs=0 l=1 rx=0x7f84a400af50 tx=0x7f84a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84aa59c700 1 -- 172.21.15.80:0/3973796355 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84a4007210 con 0x7f84ac073020 2019-11-28T11:45:40.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3973796355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84ac073020 0x7f84ac071ea0 secure :-1 s=THROTTLE_DONE pgs=1847 cs=0 l=1 rx=0x7f84a400af50 tx=0x7f84a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3973796355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84ac073020 0x7f84ac071ea0 secure :-1 s=THROTTLE_DONE pgs=1847 cs=0 l=1 rx=0x7f84a400af50 tx=0x7f84a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84aa59c700 1 -- 172.21.15.80:0/3973796355 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a40099b0 con 0x7f84ac073020 2019-11-28T11:45:40.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84aa59c700 1 -- 172.21.15.80:0/3973796355 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84a400a080 con 0x7f84ac073020 2019-11-28T11:45:40.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84b1105700 1 -- 172.21.15.80:0/3973796355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84ac073020 msgr2=0x7f84ac071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.367+0000 7f84b1105700 1 --2- 172.21.15.80:0/3973796355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84ac073020 0x7f84ac071ea0 secure :-1 s=READY pgs=1847 cs=0 l=1 rx=0x7f84a400af50 tx=0x7f84a400b760).stop 2019-11-28T11:45:40.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.368+0000 7f84b1105700 1 -- 172.21.15.80:0/3973796355 shutdown_connections 2019-11-28T11:45:40.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.368+0000 7f84b1105700 1 --2- 172.21.15.80:0/3973796355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84ac073020 0x7f84ac071ea0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.368+0000 7f84b1105700 1 --2- 172.21.15.80:0/3973796355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84ac15ed10 0x7f84ac15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:40.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.368+0000 7f84b1105700 1 -- 172.21.15.80:0/3973796355 shutdown_connections 2019-11-28T11:45:40.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.368+0000 7f84b1105700 1 -- 172.21.15.80:0/3973796355 wait complete. 2019-11-28T11:45:40.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.368+0000 7f84b1105700 1 -- 172.21.15.80:0/3973796355 >> 172.21.15.80:0/3973796355 conn(0x7f84ac061d20 msgr2=0x7f84ac0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:40.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.370+0000 7f84b1105700 1 Processor -- start 2019-11-28T11:45:40.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.371+0000 7f84b1105700 1 -- start start 2019-11-28T11:45:40.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84b1105700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f84ac155060 0x7f84ac1554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84b1105700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84ac155a30 0x7f84ac12d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:40.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84b1105700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ac15cb50 con 0x7f84ac15f800 2019-11-28T11:45:40.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84b1105700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ac102e00 con 0x7f84ac155060 2019-11-28T11:45:40.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84b1105700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac1030d0 con 0x7f84ac155a30 2019-11-28T11:45:40.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84ab59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f84ac15f800 0x7f84ac156170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40176/0 (socket says 172.21.15.80:40176) 2019-11-28T11:45:40.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84ab59e700 1 -- 172.21.15.80:0/3915171516 learned_addr learned my addr 172.21.15.80:0/3915171516 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:40.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637068028 0 0) 0x7f8494000ea0 con 0x7f84ac15f800 2019-11-28T11:45:40.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8490002e80 con 0x7f84ac15f800 2019-11-28T11:45:40.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3915171516 >> v2:172.21.15.174:3300/0 conn(0x7f84ac155060 0x7f84ac1554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84b0904700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84ac155a30 0x7f84ac12d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 55717597 0 0) 0x7f8494000940 con 0x7f84ac15f800 2019-11-28T11:45:40.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f84900032e0 con 0x7f84ac15f800 2019-11-28T11:45:40.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f84940012f0 con 0x7f84ac15f800 2019-11-28T11:45:40.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84ac155a30 msgr2=0x7f84ac12d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84a3fff700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84ac155a30 0x7f84ac12d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 >> v2:172.21.15.174:3300/0 conn(0x7f84ac155060 msgr2=0x7f84ac1554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84a3fff700 1 --2- 172.21.15.80:0/3915171516 >> v2:172.21.15.174:3300/0 conn(0x7f84ac155060 0x7f84ac1554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 >> v1:172.21.15.80:6789/0 conn(0x7f84ac15f800 legacy=0x7f84ac156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84a3fff700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8490003330 0x7f8490003740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:40.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84a3fff700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8490003c80 0x7f8490004100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:40.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84a3fff700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8490004800 0x7f8490004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:40.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849000bb60 con 0x7f8490003c80 2019-11-28T11:45:40.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849000bd50 con 0x7f8490004800 2019-11-28T11:45:40.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849000bf80 con 0x7f8490003330 2019-11-28T11:45:40.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8490003c80 0x7f8490004100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84ab59e700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8490003330 0x7f8490003740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.372+0000 7f84b0904700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8490004800 0x7f8490004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84aad9d700 1 -- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8490003330 msgr2=0x7f8490003740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8490003330 0x7f8490003740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84aad9d700 1 -- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8490004800 msgr2=0x7f8490004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8490004800 0x7f8490004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84aad9d700 1 -- 172.21.15.80:0/3915171516 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849000c230 con 0x7f8490003c80 2019-11-28T11:45:40.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84b0904700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8490004800 0x7f8490004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:40.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84b1105700 1 -- 172.21.15.80:0/3915171516 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ac103ae0 con 0x7f8490003c80 2019-11-28T11:45:40.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8490003c80 0x7f8490004100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f84a40105b0 tx=0x7f84a4010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84b1105700 1 -- 172.21.15.80:0/3915171516 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ac104bc0 con 0x7f8490003c80 2019-11-28T11:45:40.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8490003c80 0x7f8490004100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f84a40105b0 tx=0x7f84a4010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8490003c80 0x7f8490004100 secure :-1 s=READY pgs=1849 cs=0 l=1 rx=0x7f84a40105b0 tx=0x7f84a4010950).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:40.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8490003c80 0x7f8490004100 secure :-1 s=THROTTLE_DONE pgs=1849 cs=0 l=1 rx=0x7f84a40105b0 tx=0x7f84a4010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84a4000940 con 0x7f8490003c80 2019-11-28T11:45:40.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8490003c80 0x7f8490004100 secure :-1 s=THROTTLE_DONE pgs=1849 cs=0 l=1 rx=0x7f84a40105b0 tx=0x7f84a4010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a4000940 con 0x7f8490003c80 2019-11-28T11:45:40.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8490003c80 0x7f8490004100 secure :-1 s=THROTTLE_DONE pgs=1849 cs=0 l=1 rx=0x7f84a40105b0 tx=0x7f84a4010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84a4009b70 con 0x7f8490003c80 2019-11-28T11:45:40.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.373+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8490003c80 0x7f8490004100 secure :-1 s=THROTTLE_DONE pgs=1849 cs=0 l=1 rx=0x7f84a40105b0 tx=0x7f84a4010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.374+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f84a4009790 con 0x7f8490003c80 2019-11-28T11:45:40.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.374+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8490003c80 0x7f8490004100 secure :-1 s=THROTTLE_DONE pgs=1849 cs=0 l=1 rx=0x7f84a40105b0 tx=0x7f84a4010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.374+0000 7f84a3fff700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8490020ae0 0x7f8490022f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:40.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.374+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f84a4031ef0 con 0x7f8490003c80 2019-11-28T11:45:40.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.374+0000 7f84ab59e700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8490020ae0 0x7f8490022f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.374+0000 7f84ab59e700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8490020ae0 0x7f8490022f10 crc :-1 s=READY pgs=748 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:40.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.381+0000 7f84b1105700 1 -- 172.21.15.80:0/3915171516 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8484002e60 con 0x7f8490003c80 2019-11-28T11:45:40.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.384+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8490003c80 0x7f8490004100 secure :-1 s=THROTTLE_DONE pgs=1849 cs=0 l=1 rx=0x7f84a40105b0 tx=0x7f84a4010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.384+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f84a4009580 con 0x7f8490003c80 2019-11-28T11:45:40.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.554+0000 7f84b1105700 1 -- 172.21.15.80:0/3915171516 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f8484001d30 con 0x7f8490003c80 2019-11-28T11:45:40.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.554+0000 7f84aad9d700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8490003c80 0x7f8490004100 secure :-1 s=THROTTLE_DONE pgs=1849 cs=0 l=1 rx=0x7f84a40105b0 tx=0x7f84a4010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.554+0000 7f84a3fff700 1 -- 172.21.15.80:0/3915171516 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v141) v1 ==== 104+0+10 (secure 0 0 0) 0x7f84a4000940 con 0x7f8490003c80 2019-11-28T11:45:40.596 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:45:40.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.557+0000 7f84b1105700 1 -- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8490020ae0 msgr2=0x7f8490022f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.557+0000 7f84b1105700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8490020ae0 0x7f8490022f10 crc :-1 s=READY pgs=748 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.557+0000 7f84b1105700 1 -- 172.21.15.80:0/3915171516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8490003c80 msgr2=0x7f8490004100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.557+0000 7f84b1105700 1 --2- 172.21.15.80:0/3915171516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8490003c80 0x7f8490004100 secure :-1 s=READY pgs=1849 cs=0 l=1 rx=0x7f84a40105b0 tx=0x7f84a4010950).stop 2019-11-28T11:45:40.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.557+0000 7f84b0904700 1 -- 172.21.15.80:0/3915171516 reap_dead start 2019-11-28T11:45:40.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.557+0000 7f84b1105700 1 -- 172.21.15.80:0/3915171516 shutdown_connections 2019-11-28T11:45:40.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.557+0000 7f84b1105700 1 -- 172.21.15.80:0/3915171516 shutdown_connections 2019-11-28T11:45:40.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.557+0000 7f84b1105700 1 -- 172.21.15.80:0/3915171516 wait complete. 2019-11-28T11:45:40.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.557+0000 7f84b1105700 1 -- 172.21.15.80:0/3915171516 >> 172.21.15.80:0/3915171516 conn(0x7f84ac07c4f0 msgr2=0x7f84ac15ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:40.608 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:45:40.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.690+0000 7f7972db0700 1 Processor -- start 2019-11-28T11:45:40.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.691+0000 7f7972db0700 1 -- start start 2019-11-28T11:45:40.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f7972db0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c15f100 0x7f796c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:40.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f7972db0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c06db60 con 0x7f796c15ed10 2019-11-28T11:45:40.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f7972db0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c06e060 con 0x7f796c06c2f0 2019-11-28T11:45:40.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f7972db0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c06fe00 con 0x7f796c15f100 2019-11-28T11:45:40.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f797134d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f796c15ed10 0x7f796c073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40190/0 (socket says 172.21.15.80:40190) 2019-11-28T11:45:40.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f797134d700 1 -- 172.21.15.80:0/4238505616 learned_addr learned my addr 172.21.15.80:0/4238505616 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:40.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f7970b4c700 1 --2- 172.21.15.80:0/4238505616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c15f100 0x7f796c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f796bfff700 1 -- 172.21.15.80:0/4238505616 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574335603 0 0) 0x7f795c001150 con 0x7f796c15ed10 2019-11-28T11:45:40.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f796bfff700 1 -- 172.21.15.80:0/4238505616 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7958002e80 con 0x7f796c15ed10 2019-11-28T11:45:40.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f796bfff700 1 -- 172.21.15.80:0/4238505616 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061997221 0 0) 0x7f79640009b0 con 0x7f796c06c2f0 2019-11-28T11:45:40.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f796bfff700 1 -- 172.21.15.80:0/4238505616 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79580030b0 con 0x7f796c06c2f0 2019-11-28T11:45:40.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f796bfff700 1 -- 172.21.15.80:0/4238505616 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3562669517 0 0) 0x7f795c001130 con 0x7f796c15ed10 2019-11-28T11:45:40.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f7970b4c700 1 -- 172.21.15.80:0/4238505616 >> v1:172.21.15.174:6789/0 conn(0x7f796c06c2f0 legacy=0x7f796c06c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f7970b4c700 1 -- 172.21.15.80:0/4238505616 >> v1:172.21.15.80:6789/0 conn(0x7f796c15ed10 legacy=0x7f796c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f7970b4c700 1 -- 172.21.15.80:0/4238505616 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c070760 con 0x7f796c15f100 2019-11-28T11:45:40.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f7970b4c700 1 --2- 172.21.15.80:0/4238505616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c15f100 0x7f796c06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f795400b2d0 tx=0x7f795400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f7970b4c700 1 --2- 172.21.15.80:0/4238505616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c15f100 0x7f796c06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f795400b2d0 tx=0x7f795400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.692+0000 7f7970b4c700 1 --2- 172.21.15.80:0/4238505616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c15f100 0x7f796c06bdb0 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7f795400b2d0 tx=0x7f795400bae0).ready entity=mon.2 client_cookie=6b86da6196bcbb39 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:40.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.693+0000 7f7970b4c700 1 --2- 172.21.15.80:0/4238505616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c15f100 0x7f796c06bdb0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f795400b2d0 tx=0x7f795400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.693+0000 7f796bfff700 1 -- 172.21.15.80:0/4238505616 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7954000ce0 con 0x7f796c15f100 2019-11-28T11:45:40.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.693+0000 7f7970b4c700 1 --2- 172.21.15.80:0/4238505616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c15f100 0x7f796c06bdb0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f795400b2d0 tx=0x7f795400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.693+0000 7f7970b4c700 1 --2- 172.21.15.80:0/4238505616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c15f100 0x7f796c06bdb0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f795400b2d0 tx=0x7f795400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.693+0000 7f796bfff700 1 -- 172.21.15.80:0/4238505616 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7954009be0 con 0x7f796c15f100 2019-11-28T11:45:40.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.693+0000 7f796bfff700 1 -- 172.21.15.80:0/4238505616 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7954000ce0 con 0x7f796c15f100 2019-11-28T11:45:40.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.693+0000 7f7972db0700 1 -- 172.21.15.80:0/4238505616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c15f100 msgr2=0x7f796c06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.693+0000 7f7972db0700 1 --2- 172.21.15.80:0/4238505616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c15f100 0x7f796c06bdb0 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7f795400b2d0 tx=0x7f795400bae0).stop 2019-11-28T11:45:40.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.693+0000 7f7972db0700 1 -- 172.21.15.80:0/4238505616 shutdown_connections 2019-11-28T11:45:40.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.693+0000 7f7972db0700 1 --2- 172.21.15.80:0/4238505616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c15f100 0x7f796c06bdb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.694+0000 7f7972db0700 1 -- 172.21.15.80:0/4238505616 shutdown_connections 2019-11-28T11:45:40.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.694+0000 7f7972db0700 1 -- 172.21.15.80:0/4238505616 wait complete. 2019-11-28T11:45:40.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.694+0000 7f7972db0700 1 -- 172.21.15.80:0/4238505616 >> 172.21.15.80:0/4238505616 conn(0x7f796c061d20 msgr2=0x7f796c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:40.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.696+0000 7f7972db0700 1 Processor -- start 2019-11-28T11:45:40.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.696+0000 7f7972db0700 1 -- start start 2019-11-28T11:45:40.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.697+0000 7f7972db0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f796c10e970 0x7f796c1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:40.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.697+0000 7f7972db0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c107e30 0x7f796c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:40.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.697+0000 7f7972db0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c10c250 con 0x7f796c108cf0 2019-11-28T11:45:40.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.697+0000 7f7972db0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796c10e430 con 0x7f796c10e970 2019-11-28T11:45:40.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.697+0000 7f7972db0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c105860 con 0x7f796c107e30 2019-11-28T11:45:40.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.697+0000 7f797134d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f796c10e970 0x7f796c1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.697+0000 7f7971b4e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c107e30 0x7f796c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.697+0000 7f797134d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f796c10e970 0x7f796c1087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:55766/0 (socket says 172.21.15.80:55766) 2019-11-28T11:45:40.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.697+0000 7f797134d700 1 -- 172.21.15.80:0/1150780477 learned_addr learned my addr 172.21.15.80:0/1150780477 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:40.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.697+0000 7f7971b4e700 1 -- 172.21.15.80:0/1150780477 >> v2:172.21.15.174:3300/0 conn(0x7f796c10e970 msgr2=0x7f796c1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.697+0000 7f7971b4e700 1 --2- 172.21.15.80:0/1150780477 >> v2:172.21.15.174:3300/0 conn(0x7f796c10e970 0x7f796c1087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.698+0000 7f7971b4e700 1 -- 172.21.15.80:0/1150780477 >> v1:172.21.15.174:6789/0 conn(0x7f796c108cf0 legacy=0x7f796c107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.698+0000 7f7971b4e700 1 -- 172.21.15.80:0/1150780477 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c105ef0 con 0x7f796c107e30 2019-11-28T11:45:40.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.698+0000 7f7971b4e700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c107e30 0x7f796c167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79640103a0 tx=0x7f796400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.698+0000 7f7971b4e700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c107e30 0x7f796c167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79640103a0 tx=0x7f796400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.698+0000 7f7971b4e700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c107e30 0x7f796c167d70 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7f79640103a0 tx=0x7f796400b2e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:40.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.698+0000 7f7971b4e700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c107e30 0x7f796c167d70 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f79640103a0 tx=0x7f796400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.698+0000 7f7969ffb700 1 -- 172.21.15.80:0/1150780477 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7964000a50 con 0x7f796c107e30 2019-11-28T11:45:40.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.698+0000 7f7971b4e700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c107e30 0x7f796c167d70 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f79640103a0 tx=0x7f796400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.698+0000 7f7971b4e700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c107e30 0x7f796c167d70 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f79640103a0 tx=0x7f796400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.698+0000 7f7969ffb700 1 -- 172.21.15.80:0/1150780477 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7964009980 con 0x7f796c107e30 2019-11-28T11:45:40.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.698+0000 7f7972db0700 1 -- 172.21.15.80:0/1150780477 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c106270 con 0x7f796c107e30 2019-11-28T11:45:40.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.698+0000 7f7969ffb700 1 -- 172.21.15.80:0/1150780477 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7964007210 con 0x7f796c107e30 2019-11-28T11:45:40.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.698+0000 7f7972db0700 1 -- 172.21.15.80:0/1150780477 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c105ef0 con 0x7f796c107e30 2019-11-28T11:45:40.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.698+0000 7f7971b4e700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c107e30 0x7f796c167d70 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f79640103a0 tx=0x7f796400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.699+0000 7f7969ffb700 1 -- 172.21.15.80:0/1150780477 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7964000a50 con 0x7f796c107e30 2019-11-28T11:45:40.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.699+0000 7f7971b4e700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c107e30 0x7f796c167d70 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f79640103a0 tx=0x7f796400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.699+0000 7f7969ffb700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7950018730 0x7f795001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:40.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.699+0000 7f7969ffb700 1 -- 172.21.15.80:0/1150780477 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7964031a10 con 0x7f796c107e30 2019-11-28T11:45:40.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.699+0000 7f797134d700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7950018730 0x7f795001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:40.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.699+0000 7f797134d700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7950018730 0x7f795001abc0 crc :-1 s=READY pgs=749 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:40.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.706+0000 7f7972db0700 1 -- 172.21.15.80:0/1150780477 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c106270 con 0x7f796c107e30 2019-11-28T11:45:40.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.710+0000 7f7971b4e700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c107e30 0x7f796c167d70 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f79640103a0 tx=0x7f796400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.710+0000 7f7969ffb700 1 -- 172.21.15.80:0/1150780477 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7964009580 con 0x7f796c107e30 2019-11-28T11:45:40.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.876+0000 7f7972db0700 1 -- 172.21.15.80:0/1150780477 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f796c105ef0 con 0x7f796c107e30 2019-11-28T11:45:40.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.876+0000 7f7971b4e700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c107e30 0x7f796c167d70 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f79640103a0 tx=0x7f796400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:40.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.876+0000 7f7969ffb700 1 -- 172.21.15.80:0/1150780477 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v141) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7964000a50 con 0x7f796c107e30 2019-11-28T11:45:40.918 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:45:40.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.879+0000 7f7972db0700 1 -- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7950018730 msgr2=0x7f795001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.879+0000 7f7972db0700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7950018730 0x7f795001abc0 crc :-1 s=READY pgs=749 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.879+0000 7f7972db0700 1 -- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c107e30 msgr2=0x7f796c167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:40.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.879+0000 7f7972db0700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c107e30 0x7f796c167d70 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7f79640103a0 tx=0x7f796400b2e0).stop 2019-11-28T11:45:40.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.879+0000 7f7972db0700 1 -- 172.21.15.80:0/1150780477 shutdown_connections 2019-11-28T11:45:40.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.879+0000 7f7972db0700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f796c107e30 0x7f796c167d70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.879+0000 7f7972db0700 1 --2- 172.21.15.80:0/1150780477 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7950018730 0x7f795001abc0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.879+0000 7f7972db0700 1 --2- 172.21.15.80:0/1150780477 >> v2:172.21.15.174:3300/0 conn(0x7f796c10e970 0x7f796c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:40.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.879+0000 7f7972db0700 1 -- 172.21.15.80:0/1150780477 shutdown_connections 2019-11-28T11:45:40.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.879+0000 7f7972db0700 1 -- 172.21.15.80:0/1150780477 wait complete. 2019-11-28T11:45:40.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:40.879+0000 7f7972db0700 1 -- 172.21.15.80:0/1150780477 >> 172.21.15.80:0/1150780477 conn(0x7f796c15e2d0 msgr2=0x7f796c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:40.945 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:45:40.945 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:41.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.022+0000 7f59133a2700 1 Processor -- start 2019-11-28T11:45:41.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.022+0000 7f59133a2700 1 -- start start 2019-11-28T11:45:41.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.023+0000 7f59133a2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f590c06c0a0 0x7f590c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:41.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.023+0000 7f59133a2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f590c0734e0 0x7f590c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:41.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.023+0000 7f59133a2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590c06db00 con 0x7f590c072360 2019-11-28T11:45:41.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.023+0000 7f59133a2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590c06fd60 con 0x7f590c06c0a0 2019-11-28T11:45:41.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.023+0000 7f59133a2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c070030 con 0x7f590c0734e0 2019-11-28T11:45:41.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.023+0000 7f5912140700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f590c072360 0x7f590c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40206/0 (socket says 172.21.15.80:40206) 2019-11-28T11:45:41.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.023+0000 7f5912140700 1 -- 172.21.15.80:0/1401742100 learned_addr learned my addr 172.21.15.80:0/1401742100 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:41.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591093d700 1 -- 172.21.15.80:0/1401742100 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280505670 0 0) 0x7f5904001150 con 0x7f590c072360 2019-11-28T11:45:41.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591193f700 1 --2- 172.21.15.80:0/1401742100 >> v2:172.21.15.174:3300/0 conn(0x7f590c06c0a0 0x7f590c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:41.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591113e700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f590c0734e0 0x7f590c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:41.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591093d700 1 -- 172.21.15.80:0/1401742100 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58f8002e80 con 0x7f590c072360 2019-11-28T11:45:41.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591093d700 1 -- 172.21.15.80:0/1401742100 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 293036268 0 0) 0x7f5904001130 con 0x7f590c072360 2019-11-28T11:45:41.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591093d700 1 -- 172.21.15.80:0/1401742100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f590c0734e0 msgr2=0x7f590c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:41.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591093d700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f590c0734e0 0x7f590c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:41.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591093d700 1 -- 172.21.15.80:0/1401742100 >> v2:172.21.15.174:3300/0 conn(0x7f590c06c0a0 msgr2=0x7f590c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:41.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591093d700 1 --2- 172.21.15.80:0/1401742100 >> v2:172.21.15.174:3300/0 conn(0x7f590c06c0a0 0x7f590c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591093d700 1 -- 172.21.15.80:0/1401742100 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c0706c0 con 0x7f590c072360 2019-11-28T11:45:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591093d700 1 -- 172.21.15.80:0/1401742100 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f59040016c0 con 0x7f590c072360 2019-11-28T11:45:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591093d700 1 -- 172.21.15.80:0/1401742100 >> v1:172.21.15.80:6789/0 conn(0x7f590c072360 legacy=0x7f590c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591093d700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80479e0 0x7f58f8049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591093d700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58f804a5c0 0x7f58f804ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591093d700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58f804d2f0 0x7f58f804f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591093d700 1 -- 172.21.15.80:0/1401742100 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f804ff40 con 0x7f58f80479e0 2019-11-28T11:45:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591093d700 1 -- 172.21.15.80:0/1401742100 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f8050130 con 0x7f58f804a5c0 2019-11-28T11:45:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591093d700 1 -- 172.21.15.80:0/1401742100 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f8050360 con 0x7f58f804d2f0 2019-11-28T11:45:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591193f700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80479e0 0x7f58f8049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f5912140700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58f804d2f0 0x7f58f804f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591113e700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58f804a5c0 0x7f58f804ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591193f700 1 -- 172.21.15.80:0/1401742100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58f804d2f0 msgr2=0x7f58f804f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:41.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591193f700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58f804d2f0 0x7f58f804f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:41.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591193f700 1 -- 172.21.15.80:0/1401742100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58f804a5c0 msgr2=0x7f58f804ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:41.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591193f700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58f804a5c0 0x7f58f804ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:41.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591193f700 1 -- 172.21.15.80:0/1401742100 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f8050610 con 0x7f58f80479e0 2019-11-28T11:45:41.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591193f700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80479e0 0x7f58f8049e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f58fc00b6e0 tx=0x7f58fc00b5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:41.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591193f700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80479e0 0x7f58f8049e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f58fc00b6e0 tx=0x7f58fc00b5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:41.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.024+0000 7f591193f700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80479e0 0x7f58f8049e40 secure :-1 s=READY pgs=1852 cs=0 l=1 rx=0x7f58fc00b6e0 tx=0x7f58fc00b5b0).ready entity=mon.0 client_cookie=3aab9f14c8047a8d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:41.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.025+0000 7f591193f700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80479e0 0x7f58f8049e40 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7f58fc00b6e0 tx=0x7f58fc00b5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:41.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.025+0000 7f591093d700 1 -- 172.21.15.80:0/1401742100 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58fc000960 con 0x7f58f80479e0 2019-11-28T11:45:41.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.025+0000 7f591193f700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80479e0 0x7f58f8049e40 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7f58fc00b6e0 tx=0x7f58fc00b5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.025+0000 7f591193f700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80479e0 0x7f58f8049e40 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7f58fc00b6e0 tx=0x7f58fc00b5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.025+0000 7f591093d700 1 -- 172.21.15.80:0/1401742100 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc009980 con 0x7f58f80479e0 2019-11-28T11:45:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.025+0000 7f591093d700 1 -- 172.21.15.80:0/1401742100 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58fc000960 con 0x7f58f80479e0 2019-11-28T11:45:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.025+0000 7f59133a2700 1 -- 172.21.15.80:0/1401742100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80479e0 msgr2=0x7f58f8049e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.025+0000 7f59133a2700 1 --2- 172.21.15.80:0/1401742100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80479e0 0x7f58f8049e40 secure :-1 s=READY pgs=1852 cs=0 l=1 rx=0x7f58fc00b6e0 tx=0x7f58fc00b5b0).stop 2019-11-28T11:45:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.025+0000 7f5912140700 1 -- 172.21.15.80:0/1401742100 reap_dead start 2019-11-28T11:45:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.025+0000 7f59133a2700 1 -- 172.21.15.80:0/1401742100 shutdown_connections 2019-11-28T11:45:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.025+0000 7f59133a2700 1 -- 172.21.15.80:0/1401742100 shutdown_connections 2019-11-28T11:45:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.025+0000 7f59133a2700 1 -- 172.21.15.80:0/1401742100 wait complete. 2019-11-28T11:45:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.025+0000 7f59133a2700 1 -- 172.21.15.80:0/1401742100 >> 172.21.15.80:0/1401742100 conn(0x7f590c061cf0 msgr2=0x7f590c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.028+0000 7f59133a2700 1 Processor -- start 2019-11-28T11:45:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.028+0000 7f59133a2700 1 -- start start 2019-11-28T11:45:41.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f59133a2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f590c1061f0 0x7f590c10f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:41.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f59133a2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f590c13a350 0x7f590c13a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:41.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f59133a2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f590c13ad20 0x7f590c10e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:41.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f59133a2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590c10c300 con 0x7f590c13a350 2019-11-28T11:45:41.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f59133a2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590c10c5d0 con 0x7f590c1061f0 2019-11-28T11:45:41.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f59133a2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c13bf00 con 0x7f590c13ad20 2019-11-28T11:45:41.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f591113e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f590c13a350 0x7f590c13a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:41.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f591113e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f590c13a350 0x7f590c13a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40902/0 (socket says 172.21.15.80:40902) 2019-11-28T11:45:41.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f591113e700 1 -- 172.21.15.80:0/749981106 learned_addr learned my addr 172.21.15.80:0/749981106 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:41.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f591193f700 1 --2- 172.21.15.80:0/749981106 >> v2:172.21.15.174:3300/0 conn(0x7f590c1061f0 0x7f590c10f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:41.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f5912140700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f590c13ad20 0x7f590c10e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:41.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f591113e700 1 -- 172.21.15.80:0/749981106 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f590c13ad20 msgr2=0x7f590c10e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:41.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f591113e700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f590c13ad20 0x7f590c10e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:41.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f591113e700 1 -- 172.21.15.80:0/749981106 >> v2:172.21.15.174:3300/0 conn(0x7f590c1061f0 msgr2=0x7f590c10f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:41.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f591113e700 1 --2- 172.21.15.80:0/749981106 >> v2:172.21.15.174:3300/0 conn(0x7f590c1061f0 0x7f590c10f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:41.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f591113e700 1 -- 172.21.15.80:0/749981106 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c10cc60 con 0x7f590c13a350 2019-11-28T11:45:41.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f5912140700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f590c13ad20 0x7f590c10e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:41.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f591113e700 1 --2- 172.21.15.80:0/749981106 >> v2:172.21.15.80:3300/0 conn(0x7f590c13a350 0x7f590c13a7e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58f40107d0 tx=0x7f58f4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:41.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f591113e700 1 --2- 172.21.15.80:0/749981106 >> v2:172.21.15.80:3300/0 conn(0x7f590c13a350 0x7f590c13a7e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58f40107d0 tx=0x7f58f4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:41.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f591113e700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f590c13a350 0x7f590c13a7e0 secure :-1 s=READY pgs=1853 cs=0 l=1 rx=0x7f58f40107d0 tx=0x7f58f4010680).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:41.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f591113e700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f590c13a350 0x7f590c13a7e0 secure :-1 s=THROTTLE_DONE pgs=1853 cs=0 l=1 rx=0x7f58f40107d0 tx=0x7f58f4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:41.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f590a7fc700 1 -- 172.21.15.80:0/749981106 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58f4000cc0 con 0x7f590c13a350 2019-11-28T11:45:41.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f591113e700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f590c13a350 0x7f590c13a7e0 secure :-1 s=THROTTLE_DONE pgs=1853 cs=0 l=1 rx=0x7f58f40107d0 tx=0x7f58f4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:41.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f591113e700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f590c13a350 0x7f590c13a7e0 secure :-1 s=THROTTLE_DONE pgs=1853 cs=0 l=1 rx=0x7f58f40107d0 tx=0x7f58f4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:41.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f590a7fc700 1 -- 172.21.15.80:0/749981106 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f4001410 con 0x7f590c13a350 2019-11-28T11:45:41.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f590a7fc700 1 -- 172.21.15.80:0/749981106 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58f4001aa0 con 0x7f590c13a350 2019-11-28T11:45:41.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.029+0000 7f59133a2700 1 -- 172.21.15.80:0/749981106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c10cfe0 con 0x7f590c13a350 2019-11-28T11:45:41.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.030+0000 7f59133a2700 1 -- 172.21.15.80:0/749981106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c10cc60 con 0x7f590c13a350 2019-11-28T11:45:41.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.030+0000 7f591113e700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f590c13a350 0x7f590c13a7e0 secure :-1 s=THROTTLE_DONE pgs=1853 cs=0 l=1 rx=0x7f58f40107d0 tx=0x7f58f4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:41.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.030+0000 7f590a7fc700 1 -- 172.21.15.80:0/749981106 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f58f4001010 con 0x7f590c13a350 2019-11-28T11:45:41.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.030+0000 7f591113e700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f590c13a350 0x7f590c13a7e0 secure :-1 s=THROTTLE_DONE pgs=1853 cs=0 l=1 rx=0x7f58f40107d0 tx=0x7f58f4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:41.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.030+0000 7f590a7fc700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f58f0018730 0x7f58f001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:41.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.030+0000 7f590a7fc700 1 -- 172.21.15.80:0/749981106 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f58f4031ff0 con 0x7f590c13a350 2019-11-28T11:45:41.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.030+0000 7f591193f700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f58f0018730 0x7f58f001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:41.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.031+0000 7f591193f700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f58f0018730 0x7f58f001abc0 crc :-1 s=READY pgs=750 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:41.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.038+0000 7f59133a2700 1 -- 172.21.15.80:0/749981106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c10cfe0 con 0x7f590c13a350 2019-11-28T11:45:41.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.041+0000 7f591113e700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f590c13a350 0x7f590c13a7e0 secure :-1 s=THROTTLE_DONE pgs=1853 cs=0 l=1 rx=0x7f58f40107d0 tx=0x7f58f4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:41.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.041+0000 7f590a7fc700 1 -- 172.21.15.80:0/749981106 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f58f4000cc0 con 0x7f590c13a350 2019-11-28T11:45:41.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.212+0000 7f59133a2700 1 -- 172.21.15.80:0/749981106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f590c10cc60 con 0x7f590c13a350 2019-11-28T11:45:41.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.212+0000 7f591113e700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f590c13a350 0x7f590c13a7e0 secure :-1 s=THROTTLE_DONE pgs=1853 cs=0 l=1 rx=0x7f58f40107d0 tx=0x7f58f4010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:41.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.212+0000 7f590a7fc700 1 -- 172.21.15.80:0/749981106 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+2455 (secure 0 0 0) 0x7f58f4001010 con 0x7f590c13a350 2019-11-28T11:45:41.254 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 107 2019-11-28T11:45:41.254 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:41.255 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":107,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/3312817459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3312817459},{"type":"v1","addr":"172.21.15.174:6835","nonce":3312817459}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":106},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3089980665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3089980665},{"type":"v1","addr":"172.21.15.80:6834","nonce":3089980665}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":106}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:30.152127+0000","modified":"2019-11-28T11:45:37.708419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8752},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8752":{"gid":8752,"name":"b","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6835/1912693207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1912693207},{"type":"v1","addr":"172.21.15.80:6835","nonce":1912693207}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2019-11-28T11:45:41.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.215+0000 7f59133a2700 1 -- 172.21.15.80:0/749981106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f58f0018730 msgr2=0x7f58f001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:41.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.215+0000 7f59133a2700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f58f0018730 0x7f58f001abc0 crc :-1 s=READY pgs=750 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:41.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.215+0000 7f59133a2700 1 -- 172.21.15.80:0/749981106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f590c13a350 msgr2=0x7f590c13a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:41.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.215+0000 7f59133a2700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f590c13a350 0x7f590c13a7e0 secure :-1 s=READY pgs=1853 cs=0 l=1 rx=0x7f58f40107d0 tx=0x7f58f4010680).stop 2019-11-28T11:45:41.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.215+0000 7f59133a2700 1 -- 172.21.15.80:0/749981106 shutdown_connections 2019-11-28T11:45:41.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.215+0000 7f59133a2700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f58f0018730 0x7f58f001abc0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:41.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.215+0000 7f59133a2700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f590c13ad20 0x7f590c10e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:41.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.215+0000 7f59133a2700 1 --2- 172.21.15.80:0/749981106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f590c13a350 0x7f590c13a7e0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:41.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.215+0000 7f59133a2700 1 --2- 172.21.15.80:0/749981106 >> v2:172.21.15.174:3300/0 conn(0x7f590c1061f0 0x7f590c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:41.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.215+0000 7f59133a2700 1 -- 172.21.15.80:0/749981106 shutdown_connections 2019-11-28T11:45:41.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.215+0000 7f59133a2700 1 -- 172.21.15.80:0/749981106 wait complete. 2019-11-28T11:45:41.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:41.215+0000 7f59133a2700 1 -- 172.21.15.80:0/749981106 >> 172.21.15.80:0/749981106 conn(0x7f590c142090 msgr2=0x7f590c10ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:41.571 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8752}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 22, u'failed': [], u'epoch': 107, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [23], u'info': {u'gid_8752': {u'export_targets': [], u'name': u'b', u'incarnation': 106, u'state_seq': 3, u'state': u'up:active', u'gid': 8752, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1912693207, u'type': u'v2', u'addr': u'172.21.15.80:6833'}, {u'nonce': 1912693207, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/1912693207'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:45:30.152127+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:45:37.708419+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:45:41.572 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:45:41.572 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-11-28T11:45:41.697 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:45:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:45:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T11:45:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 8752, 2019-11-28T11:45:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2019-11-28T11:45:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2019-11-28T11:45:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 4.9538378940000003, 2019-11-28T11:45:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 107, 2019-11-28T11:45:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 141, 2019-11-28T11:45:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 141, 2019-11-28T11:45:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 9.0804183950000006 2019-11-28T11:45:41.699 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:45:41.717 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8752, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.9538378940000003, "mdsmap_epoch": 107, "osdmap_epoch": 141, "osdmap_epoch_barrier": 141, "uptime": 9.0804183950000006 } 2019-11-28T11:45:41.718 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:45:41.718 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:45:41.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:45:41.718 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:45:41.788 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:45:41.788 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:45:41.909 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:45:41.909 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:45:41.910 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:45:41.910 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:45:41.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:45:41.910 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:45:41.989 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:45:42.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.072+0000 7fe9a9030700 1 Processor -- start 2019-11-28T11:45:42.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.072+0000 7fe9a9030700 1 -- start start 2019-11-28T11:45:42.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a9030700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9a406c0a0 0x7fe9a4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:42.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a9030700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9a40734e0 0x7fe9a4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:42.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a9030700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe9a4072360 0x7fe9a4072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:42.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a9030700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a406fd60 con 0x7fe9a406c0a0 2019-11-28T11:45:42.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a9030700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a4070030 con 0x7fe9a4072360 2019-11-28T11:45:42.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a9030700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a406f330 con 0x7fe9a40734e0 2019-11-28T11:45:42.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9a406c0a0 0x7fe9a4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9a406c0a0 0x7fe9a4072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40908/0 (socket says 172.21.15.80:40908) 2019-11-28T11:45:42.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a359e700 1 -- 172.21.15.80:0/1816808672 learned_addr learned my addr 172.21.15.80:0/1816808672 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:42.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a2d9d700 1 --2- 172.21.15.80:0/1816808672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9a40734e0 0x7fe9a4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a882f700 1 --2- 172.21.15.80:0/1816808672 >> v2:172.21.15.174:3300/0 conn(0x7fe9a4072360 0x7fe9a4072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a359e700 1 -- 172.21.15.80:0/1816808672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9a40734e0 msgr2=0x7fe9a4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:42.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a359e700 1 --2- 172.21.15.80:0/1816808672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9a40734e0 0x7fe9a4071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:42.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a359e700 1 -- 172.21.15.80:0/1816808672 >> v2:172.21.15.174:3300/0 conn(0x7fe9a4072360 msgr2=0x7fe9a4072800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:42.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a359e700 1 --2- 172.21.15.80:0/1816808672 >> v2:172.21.15.174:3300/0 conn(0x7fe9a4072360 0x7fe9a4072800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:42.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a359e700 1 -- 172.21.15.80:0/1816808672 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a40706c0 con 0x7fe9a406c0a0 2019-11-28T11:45:42.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a882f700 1 --2- 172.21.15.80:0/1816808672 >> v2:172.21.15.174:3300/0 conn(0x7fe9a4072360 0x7fe9a4072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:42.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a359e700 1 --2- 172.21.15.80:0/1816808672 >> v2:172.21.15.80:3300/0 conn(0x7fe9a406c0a0 0x7fe9a4072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe99400f740 tx=0x7fe99400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a359e700 1 --2- 172.21.15.80:0/1816808672 >> v2:172.21.15.80:3300/0 conn(0x7fe9a406c0a0 0x7fe9a4072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe99400f740 tx=0x7fe99400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a359e700 1 --2- 172.21.15.80:0/1816808672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a406c0a0 0x7fe9a4072fa0 secure :-1 s=READY pgs=1854 cs=0 l=1 rx=0x7fe99400f740 tx=0x7fe99400f570).ready entity=mon.0 client_cookie=ec65ff5c872efeb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:42.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a359e700 1 --2- 172.21.15.80:0/1816808672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a406c0a0 0x7fe9a4072fa0 secure :-1 s=THROTTLE_DONE pgs=1854 cs=0 l=1 rx=0x7fe99400f740 tx=0x7fe99400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a359e700 1 --2- 172.21.15.80:0/1816808672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a406c0a0 0x7fe9a4072fa0 secure :-1 s=THROTTLE_DONE pgs=1854 cs=0 l=1 rx=0x7fe99400f740 tx=0x7fe99400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a259c700 1 -- 172.21.15.80:0/1816808672 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe994000960 con 0x7fe9a406c0a0 2019-11-28T11:45:42.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a359e700 1 --2- 172.21.15.80:0/1816808672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a406c0a0 0x7fe9a4072fa0 secure :-1 s=THROTTLE_DONE pgs=1854 cs=0 l=1 rx=0x7fe99400f740 tx=0x7fe99400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a259c700 1 -- 172.21.15.80:0/1816808672 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe994000c90 con 0x7fe9a406c0a0 2019-11-28T11:45:42.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.073+0000 7fe9a259c700 1 -- 172.21.15.80:0/1816808672 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9940013a0 con 0x7fe9a406c0a0 2019-11-28T11:45:42.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.074+0000 7fe9a9030700 1 -- 172.21.15.80:0/1816808672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a406c0a0 msgr2=0x7fe9a4072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:42.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.074+0000 7fe9a9030700 1 --2- 172.21.15.80:0/1816808672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a406c0a0 0x7fe9a4072fa0 secure :-1 s=READY pgs=1854 cs=0 l=1 rx=0x7fe99400f740 tx=0x7fe99400f570).stop 2019-11-28T11:45:42.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.074+0000 7fe9a9030700 1 -- 172.21.15.80:0/1816808672 shutdown_connections 2019-11-28T11:45:42.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.074+0000 7fe9a9030700 1 --2- 172.21.15.80:0/1816808672 >> v2:172.21.15.174:3300/0 conn(0x7fe9a4072360 0x7fe9a4072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:42.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.074+0000 7fe9a9030700 1 --2- 172.21.15.80:0/1816808672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9a40734e0 0x7fe9a4071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.074+0000 7fe9a9030700 1 --2- 172.21.15.80:0/1816808672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a406c0a0 0x7fe9a4072fa0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.074+0000 7fe9a9030700 1 -- 172.21.15.80:0/1816808672 shutdown_connections 2019-11-28T11:45:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.074+0000 7fe9a9030700 1 -- 172.21.15.80:0/1816808672 wait complete. 2019-11-28T11:45:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.074+0000 7fe9a9030700 1 -- 172.21.15.80:0/1816808672 >> 172.21.15.80:0/1816808672 conn(0x7fe9a4061cf0 msgr2=0x7fe9a4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:42.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.077+0000 7fe9a9030700 1 Processor -- start 2019-11-28T11:45:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.077+0000 7fe9a9030700 1 -- start start 2019-11-28T11:45:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a9030700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9a4109e40 0x7fe9a410a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a9030700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a413f1e0 con 0x7fe9a413eb40 2019-11-28T11:45:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a9030700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a4131a30 con 0x7fe9a410a810 2019-11-28T11:45:42.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a9030700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a41234c0 con 0x7fe9a4109e40 2019-11-28T11:45:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9a4109e40 0x7fe9a410a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9a4109e40 0x7fe9a410a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40916/0 (socket says 172.21.15.80:40916) 2019-11-28T11:45:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a2d9d700 1 -- 172.21.15.80:0/3091643109 learned_addr learned my addr 172.21.15.80:0/3091643109 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a2d9d700 1 -- 172.21.15.80:0/3091643109 >> v1:172.21.15.174:6789/0 conn(0x7fe9a410a810 legacy=0x7fe9a4105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:42.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a2d9d700 1 -- 172.21.15.80:0/3091643109 >> v1:172.21.15.80:6789/0 conn(0x7fe9a413eb40 legacy=0x7fe9a410afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a2d9d700 1 -- 172.21.15.80:0/3091643109 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a4108700 con 0x7fe9a4109e40 2019-11-28T11:45:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a2d9d700 1 --2- 172.21.15.80:0/3091643109 >> v2:172.21.15.80:3300/0 conn(0x7fe9a4109e40 0x7fe9a410a2d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe98c010780 tx=0x7fe98c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a2d9d700 1 --2- 172.21.15.80:0/3091643109 >> v2:172.21.15.80:3300/0 conn(0x7fe9a4109e40 0x7fe9a410a2d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe98c010780 tx=0x7fe98c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a2d9d700 1 --2- 172.21.15.80:0/3091643109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a4109e40 0x7fe9a410a2d0 secure :-1 s=READY pgs=1856 cs=0 l=1 rx=0x7fe98c010780 tx=0x7fe98c010b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a2d9d700 1 --2- 172.21.15.80:0/3091643109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a4109e40 0x7fe9a410a2d0 secure :-1 s=THROTTLE_DONE pgs=1856 cs=0 l=1 rx=0x7fe98c010780 tx=0x7fe98c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe99bfff700 1 -- 172.21.15.80:0/3091643109 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe98c000cc0 con 0x7fe9a4109e40 2019-11-28T11:45:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a2d9d700 1 --2- 172.21.15.80:0/3091643109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a4109e40 0x7fe9a410a2d0 secure :-1 s=THROTTLE_DONE pgs=1856 cs=0 l=1 rx=0x7fe98c010780 tx=0x7fe98c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a2d9d700 1 --2- 172.21.15.80:0/3091643109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a4109e40 0x7fe9a410a2d0 secure :-1 s=THROTTLE_DONE pgs=1856 cs=0 l=1 rx=0x7fe98c010780 tx=0x7fe98c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe99bfff700 1 -- 172.21.15.80:0/3091643109 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98c001410 con 0x7fe9a4109e40 2019-11-28T11:45:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a9030700 1 -- 172.21.15.80:0/3091643109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a4108a80 con 0x7fe9a4109e40 2019-11-28T11:45:42.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe99bfff700 1 -- 172.21.15.80:0/3091643109 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe98c0019e0 con 0x7fe9a4109e40 2019-11-28T11:45:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.078+0000 7fe9a9030700 1 -- 172.21.15.80:0/3091643109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a4108700 con 0x7fe9a4109e40 2019-11-28T11:45:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.079+0000 7fe9a2d9d700 1 --2- 172.21.15.80:0/3091643109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a4109e40 0x7fe9a410a2d0 secure :-1 s=THROTTLE_DONE pgs=1856 cs=0 l=1 rx=0x7fe98c010780 tx=0x7fe98c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.079+0000 7fe99bfff700 1 -- 172.21.15.80:0/3091643109 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe98c001600 con 0x7fe9a4109e40 2019-11-28T11:45:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.079+0000 7fe9a2d9d700 1 --2- 172.21.15.80:0/3091643109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a4109e40 0x7fe9a410a2d0 secure :-1 s=THROTTLE_DONE pgs=1856 cs=0 l=1 rx=0x7fe98c010780 tx=0x7fe98c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.079+0000 7fe99bfff700 1 --2- 172.21.15.80:0/3091643109 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe97c018730 0x7fe97c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.079+0000 7fe99bfff700 1 -- 172.21.15.80:0/3091643109 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe98c031ec0 con 0x7fe9a4109e40 2019-11-28T11:45:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.079+0000 7fe9a359e700 1 --2- 172.21.15.80:0/3091643109 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe97c018730 0x7fe97c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.079+0000 7fe9a359e700 1 --2- 172.21.15.80:0/3091643109 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe97c018730 0x7fe97c01abc0 crc :-1 s=READY pgs=751 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:42.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.087+0000 7fe9a9030700 1 -- 172.21.15.80:0/3091643109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a4108a80 con 0x7fe9a4109e40 2019-11-28T11:45:42.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.090+0000 7fe9a2d9d700 1 --2- 172.21.15.80:0/3091643109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a4109e40 0x7fe9a410a2d0 secure :-1 s=THROTTLE_DONE pgs=1856 cs=0 l=1 rx=0x7fe98c010780 tx=0x7fe98c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.090+0000 7fe99bfff700 1 -- 172.21.15.80:0/3091643109 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe98c02d020 con 0x7fe9a4109e40 2019-11-28T11:45:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.266+0000 7fe9a9030700 1 -- 172.21.15.80:0/3091643109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9a4108700 con 0x7fe9a4109e40 2019-11-28T11:45:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.266+0000 7fe9a2d9d700 1 --2- 172.21.15.80:0/3091643109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a4109e40 0x7fe9a410a2d0 secure :-1 s=THROTTLE_DONE pgs=1856 cs=0 l=1 rx=0x7fe98c010780 tx=0x7fe98c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.267+0000 7fe99bfff700 1 -- 172.21.15.80:0/3091643109 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+14871 (secure 0 0 0) 0x7fe98c02dfd0 con 0x7fe9a4109e40 2019-11-28T11:45:42.308 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:42.308 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":141,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:45:31.153550+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:45:28.436380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2019-11-28T11:45:29.126890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:45:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.269+0000 7fe9a9030700 1 -- 172.21.15.80:0/3091643109 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe97c018730 msgr2=0x7fe97c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.269+0000 7fe9a9030700 1 --2- 172.21.15.80:0/3091643109 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe97c018730 0x7fe97c01abc0 crc :-1 s=READY pgs=751 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.269+0000 7fe9a9030700 1 -- 172.21.15.80:0/3091643109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a4109e40 msgr2=0x7fe9a410a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:42.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.269+0000 7fe9a9030700 1 --2- 172.21.15.80:0/3091643109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a4109e40 0x7fe9a410a2d0 secure :-1 s=READY pgs=1856 cs=0 l=1 rx=0x7fe98c010780 tx=0x7fe98c010b20).stop 2019-11-28T11:45:42.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.269+0000 7fe9a9030700 1 -- 172.21.15.80:0/3091643109 shutdown_connections 2019-11-28T11:45:42.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.269+0000 7fe9a9030700 1 --2- 172.21.15.80:0/3091643109 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe97c018730 0x7fe97c01abc0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.269+0000 7fe9a9030700 1 --2- 172.21.15.80:0/3091643109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9a4109e40 0x7fe9a410a2d0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.269+0000 7fe9a9030700 1 -- 172.21.15.80:0/3091643109 shutdown_connections 2019-11-28T11:45:42.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.269+0000 7fe9a9030700 1 -- 172.21.15.80:0/3091643109 wait complete. 2019-11-28T11:45:42.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.269+0000 7fe9a9030700 1 -- 172.21.15.80:0/3091643109 >> 172.21.15.80:0/3091643109 conn(0x7fe9a411bfc0 msgr2=0x7fe9a4141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:42.320 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:45:28.436380+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 22, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'140', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:45:29.126890+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 23, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'141', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:45:42.321 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:45:42.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.403+0000 7fa59869c700 1 Processor -- start 2019-11-28T11:45:42.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.403+0000 7fa59869c700 1 -- start start 2019-11-28T11:45:42.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.404+0000 7fa59869c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa59015f100 0x7fa59006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:42.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.404+0000 7fa59869c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa59006c2f0 0x7fa59006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:42.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.404+0000 7fa59869c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59006db60 con 0x7fa59015ed10 2019-11-28T11:45:42.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.404+0000 7fa59869c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa59006fe00 con 0x7fa59015f100 2019-11-28T11:45:42.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.404+0000 7fa59869c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5900700d0 con 0x7fa59006c2f0 2019-11-28T11:45:42.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.404+0000 7fa596438700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa59015f100 0x7fa59006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.404+0000 7fa596438700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa59015f100 0x7fa59006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40926/0 (socket says 172.21.15.80:40926) 2019-11-28T11:45:42.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.404+0000 7fa596438700 1 -- 172.21.15.80:0/1697706315 learned_addr learned my addr 172.21.15.80:0/1697706315 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:42.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.404+0000 7fa59743a700 1 --2- 172.21.15.80:0/1697706315 >> v2:172.21.15.174:3300/0 conn(0x7fa59006c2f0 0x7fa59006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.405+0000 7fa596438700 1 -- 172.21.15.80:0/1697706315 >> v2:172.21.15.174:3300/0 conn(0x7fa59006c2f0 msgr2=0x7fa59006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:42.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.405+0000 7fa596438700 1 --2- 172.21.15.80:0/1697706315 >> v2:172.21.15.174:3300/0 conn(0x7fa59006c2f0 0x7fa59006c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:42.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.405+0000 7fa596438700 1 -- 172.21.15.80:0/1697706315 >> v1:172.21.15.174:6789/0 conn(0x7fa59015ed10 legacy=0x7fa590073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:42.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.405+0000 7fa596438700 1 -- 172.21.15.80:0/1697706315 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa590070760 con 0x7fa59015f100 2019-11-28T11:45:42.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.405+0000 7fa596438700 1 --2- 172.21.15.80:0/1697706315 >> v2:172.21.15.80:3300/0 conn(0x7fa59015f100 0x7fa59006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa57800fac0 tx=0x7fa57800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.405+0000 7fa596438700 1 --2- 172.21.15.80:0/1697706315 >> v2:172.21.15.80:3300/0 conn(0x7fa59015f100 0x7fa59006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa57800fac0 tx=0x7fa57800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.405+0000 7fa596438700 1 --2- 172.21.15.80:0/1697706315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59015f100 0x7fa59006bdb0 secure :-1 s=READY pgs=1857 cs=0 l=1 rx=0x7fa57800fac0 tx=0x7fa57800f8f0).ready entity=mon.0 client_cookie=b5be0ee54a928674 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:42.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.405+0000 7fa596438700 1 --2- 172.21.15.80:0/1697706315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59015f100 0x7fa59006bdb0 secure :-1 s=THROTTLE_DONE pgs=1857 cs=0 l=1 rx=0x7fa57800fac0 tx=0x7fa57800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.405+0000 7fa596438700 1 --2- 172.21.15.80:0/1697706315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59015f100 0x7fa59006bdb0 secure :-1 s=THROTTLE_DONE pgs=1857 cs=0 l=1 rx=0x7fa57800fac0 tx=0x7fa57800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.405+0000 7fa595c37700 1 -- 172.21.15.80:0/1697706315 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa578000ce0 con 0x7fa59015f100 2019-11-28T11:45:42.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.405+0000 7fa596438700 1 --2- 172.21.15.80:0/1697706315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59015f100 0x7fa59006bdb0 secure :-1 s=THROTTLE_DONE pgs=1857 cs=0 l=1 rx=0x7fa57800fac0 tx=0x7fa57800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.405+0000 7fa595c37700 1 -- 172.21.15.80:0/1697706315 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa578001010 con 0x7fa59015f100 2019-11-28T11:45:42.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.405+0000 7fa595c37700 1 -- 172.21.15.80:0/1697706315 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa578001720 con 0x7fa59015f100 2019-11-28T11:45:42.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.405+0000 7fa59869c700 1 -- 172.21.15.80:0/1697706315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59015f100 msgr2=0x7fa59006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:42.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.405+0000 7fa59869c700 1 --2- 172.21.15.80:0/1697706315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59015f100 0x7fa59006bdb0 secure :-1 s=READY pgs=1857 cs=0 l=1 rx=0x7fa57800fac0 tx=0x7fa57800f8f0).stop 2019-11-28T11:45:42.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.406+0000 7fa59869c700 1 -- 172.21.15.80:0/1697706315 shutdown_connections 2019-11-28T11:45:42.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.406+0000 7fa59869c700 1 --2- 172.21.15.80:0/1697706315 >> v2:172.21.15.174:3300/0 conn(0x7fa59006c2f0 0x7fa59006c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:42.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.406+0000 7fa59869c700 1 --2- 172.21.15.80:0/1697706315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59015f100 0x7fa59006bdb0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.406+0000 7fa59869c700 1 -- 172.21.15.80:0/1697706315 shutdown_connections 2019-11-28T11:45:42.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.406+0000 7fa59869c700 1 -- 172.21.15.80:0/1697706315 wait complete. 2019-11-28T11:45:42.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.406+0000 7fa59869c700 1 -- 172.21.15.80:0/1697706315 >> 172.21.15.80:0/1697706315 conn(0x7fa590061d20 msgr2=0x7fa5900641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:42.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.408+0000 7fa59869c700 1 Processor -- start 2019-11-28T11:45:42.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.408+0000 7fa59869c700 1 -- start start 2019-11-28T11:45:42.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa59869c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa590148320 0x7fa59010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:42.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa59869c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa59010f290 0x7fa59010dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:42.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa59869c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa59010e110 0x7fa59010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:42.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa59869c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa59013aa20 con 0x7fa59010f290 2019-11-28T11:45:42.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa59869c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa59013acf0 con 0x7fa590148320 2019-11-28T11:45:42.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa59869c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa590139ff0 con 0x7fa59010e110 2019-11-28T11:45:42.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa596438700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa59010f290 0x7fa59010dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa596438700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa59010f290 0x7fa59010dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40928/0 (socket says 172.21.15.80:40928) 2019-11-28T11:45:42.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa596438700 1 -- 172.21.15.80:0/1346272376 learned_addr learned my addr 172.21.15.80:0/1346272376 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:42.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa596c39700 1 --2- 172.21.15.80:0/1346272376 >> v2:172.21.15.174:3300/0 conn(0x7fa590148320 0x7fa59010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa59743a700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa59010e110 0x7fa59010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa596438700 1 -- 172.21.15.80:0/1346272376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa59010e110 msgr2=0x7fa59010e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:42.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa596438700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa59010e110 0x7fa59010e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa596438700 1 -- 172.21.15.80:0/1346272376 >> v2:172.21.15.174:3300/0 conn(0x7fa590148320 msgr2=0x7fa59010ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:42.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa596438700 1 --2- 172.21.15.80:0/1346272376 >> v2:172.21.15.174:3300/0 conn(0x7fa590148320 0x7fa59010ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa596438700 1 -- 172.21.15.80:0/1346272376 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59010c490 con 0x7fa59010f290 2019-11-28T11:45:42.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa59743a700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa59010e110 0x7fa59010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:45:42.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa596438700 1 --2- 172.21.15.80:0/1346272376 >> v2:172.21.15.80:3300/0 conn(0x7fa59010f290 0x7fa59010dbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa57800c770 tx=0x7fa57800c640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa596438700 1 --2- 172.21.15.80:0/1346272376 >> v2:172.21.15.80:3300/0 conn(0x7fa59010f290 0x7fa59010dbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa57800c770 tx=0x7fa57800c640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.409+0000 7fa596438700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59010f290 0x7fa59010dbd0 secure :-1 s=READY pgs=1858 cs=0 l=1 rx=0x7fa57800c770 tx=0x7fa57800c640).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.410+0000 7fa596438700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59010f290 0x7fa59010dbd0 secure :-1 s=THROTTLE_DONE pgs=1858 cs=0 l=1 rx=0x7fa57800c770 tx=0x7fa57800c640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.410+0000 7fa596438700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59010f290 0x7fa59010dbd0 secure :-1 s=THROTTLE_DONE pgs=1858 cs=0 l=1 rx=0x7fa57800c770 tx=0x7fa57800c640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.410+0000 7fa596438700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59010f290 0x7fa59010dbd0 secure :-1 s=THROTTLE_DONE pgs=1858 cs=0 l=1 rx=0x7fa57800c770 tx=0x7fa57800c640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.410+0000 7fa58f7fe700 1 -- 172.21.15.80:0/1346272376 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa578005900 con 0x7fa59010f290 2019-11-28T11:45:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.410+0000 7fa58f7fe700 1 -- 172.21.15.80:0/1346272376 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa578008150 con 0x7fa59010f290 2019-11-28T11:45:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.410+0000 7fa59869c700 1 -- 172.21.15.80:0/1346272376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa59010c810 con 0x7fa59010f290 2019-11-28T11:45:42.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.410+0000 7fa58f7fe700 1 -- 172.21.15.80:0/1346272376 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa578005ee0 con 0x7fa59010f290 2019-11-28T11:45:42.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.410+0000 7fa59869c700 1 -- 172.21.15.80:0/1346272376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59010c490 con 0x7fa59010f290 2019-11-28T11:45:42.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.410+0000 7fa596438700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59010f290 0x7fa59010dbd0 secure :-1 s=THROTTLE_DONE pgs=1858 cs=0 l=1 rx=0x7fa57800c770 tx=0x7fa57800c640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.410+0000 7fa58f7fe700 1 -- 172.21.15.80:0/1346272376 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa578005710 con 0x7fa59010f290 2019-11-28T11:45:42.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.410+0000 7fa596438700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59010f290 0x7fa59010dbd0 secure :-1 s=THROTTLE_DONE pgs=1858 cs=0 l=1 rx=0x7fa57800c770 tx=0x7fa57800c640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.410+0000 7fa58f7fe700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa574018730 0x7fa57401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:42.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.410+0000 7fa58f7fe700 1 -- 172.21.15.80:0/1346272376 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa578031de0 con 0x7fa59010f290 2019-11-28T11:45:42.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.411+0000 7fa596c39700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa574018730 0x7fa57401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.411+0000 7fa596c39700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa574018730 0x7fa57401abc0 crc :-1 s=READY pgs=752 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:42.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.418+0000 7fa59869c700 1 -- 172.21.15.80:0/1346272376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59010c810 con 0x7fa59010f290 2019-11-28T11:45:42.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.422+0000 7fa596438700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59010f290 0x7fa59010dbd0 secure :-1 s=THROTTLE_DONE pgs=1858 cs=0 l=1 rx=0x7fa57800c770 tx=0x7fa57800c640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.422+0000 7fa58f7fe700 1 -- 172.21.15.80:0/1346272376 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa578005500 con 0x7fa59010f290 2019-11-28T11:45:42.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.589+0000 7fa59869c700 1 -- 172.21.15.80:0/1346272376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fa59010c490 con 0x7fa59010f290 2019-11-28T11:45:42.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.590+0000 7fa596438700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59010f290 0x7fa59010dbd0 secure :-1 s=THROTTLE_DONE pgs=1858 cs=0 l=1 rx=0x7fa57800c770 tx=0x7fa57800c640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.590+0000 7fa58f7fe700 1 -- 172.21.15.80:0/1346272376 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v141) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa578005710 con 0x7fa59010f290 2019-11-28T11:45:42.631 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:45:42.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.593+0000 7fa59869c700 1 -- 172.21.15.80:0/1346272376 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa574018730 msgr2=0x7fa57401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:42.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.593+0000 7fa59869c700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa574018730 0x7fa57401abc0 crc :-1 s=READY pgs=752 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.593+0000 7fa59869c700 1 -- 172.21.15.80:0/1346272376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59010f290 msgr2=0x7fa59010dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:42.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.593+0000 7fa59869c700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59010f290 0x7fa59010dbd0 secure :-1 s=READY pgs=1858 cs=0 l=1 rx=0x7fa57800c770 tx=0x7fa57800c640).stop 2019-11-28T11:45:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.593+0000 7fa59869c700 1 -- 172.21.15.80:0/1346272376 shutdown_connections 2019-11-28T11:45:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.593+0000 7fa59869c700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa574018730 0x7fa57401abc0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.593+0000 7fa59869c700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa59010e110 0x7fa59010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.593+0000 7fa59869c700 1 --2- 172.21.15.80:0/1346272376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa59010f290 0x7fa59010dbd0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.593+0000 7fa59869c700 1 --2- 172.21.15.80:0/1346272376 >> v2:172.21.15.174:3300/0 conn(0x7fa590148320 0x7fa59010ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.593+0000 7fa59869c700 1 -- 172.21.15.80:0/1346272376 shutdown_connections 2019-11-28T11:45:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.593+0000 7fa59869c700 1 -- 172.21.15.80:0/1346272376 wait complete. 2019-11-28T11:45:42.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.593+0000 7fa59869c700 1 -- 172.21.15.80:0/1346272376 >> 172.21.15.80:0/1346272376 conn(0x7fa59015e2d0 msgr2=0x7fa590147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:42.644 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:45:42.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.726+0000 7fba201ea700 1 Processor -- start 2019-11-28T11:45:42.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.726+0000 7fba201ea700 1 -- start start 2019-11-28T11:45:42.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.727+0000 7fba201ea700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fba1815ed10 0x7fba1815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:42.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.727+0000 7fba201ea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba18073020 0x7fba18071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:42.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.727+0000 7fba201ea700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba180734b0 0x7fba180723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:42.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.727+0000 7fba201ea700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1806fe00 con 0x7fba18073020 2019-11-28T11:45:42.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.727+0000 7fba201ea700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba180700d0 con 0x7fba1815ed10 2019-11-28T11:45:42.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.727+0000 7fba201ea700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1806f3d0 con 0x7fba180734b0 2019-11-28T11:45:42.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.727+0000 7fba1df86700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba18073020 0x7fba18071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.727+0000 7fba1df86700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba18073020 0x7fba18071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40940/0 (socket says 172.21.15.80:40940) 2019-11-28T11:45:42.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.727+0000 7fba1df86700 1 -- 172.21.15.80:0/809310478 learned_addr learned my addr 172.21.15.80:0/809310478 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:42.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1e787700 1 --2- 172.21.15.80:0/809310478 >> v2:172.21.15.174:3300/0 conn(0x7fba1815ed10 0x7fba1815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1ef88700 1 --2- 172.21.15.80:0/809310478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba180734b0 0x7fba180723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1df86700 1 -- 172.21.15.80:0/809310478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba180734b0 msgr2=0x7fba180723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:42.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1df86700 1 --2- 172.21.15.80:0/809310478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba180734b0 0x7fba180723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:42.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1df86700 1 -- 172.21.15.80:0/809310478 >> v2:172.21.15.174:3300/0 conn(0x7fba1815ed10 msgr2=0x7fba1815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:42.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1df86700 1 --2- 172.21.15.80:0/809310478 >> v2:172.21.15.174:3300/0 conn(0x7fba1815ed10 0x7fba1815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:42.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1df86700 1 -- 172.21.15.80:0/809310478 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba18070760 con 0x7fba18073020 2019-11-28T11:45:42.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1ef88700 1 --2- 172.21.15.80:0/809310478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba180734b0 0x7fba180723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:42.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1df86700 1 --2- 172.21.15.80:0/809310478 >> v2:172.21.15.80:3300/0 conn(0x7fba18073020 0x7fba18071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fba0800f740 tx=0x7fba0800f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1df86700 1 --2- 172.21.15.80:0/809310478 >> v2:172.21.15.80:3300/0 conn(0x7fba18073020 0x7fba18071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fba0800f740 tx=0x7fba0800f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1df86700 1 --2- 172.21.15.80:0/809310478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba18073020 0x7fba18071ea0 secure :-1 s=READY pgs=1859 cs=0 l=1 rx=0x7fba0800f740 tx=0x7fba0800f5f0).ready entity=mon.0 client_cookie=4550bda2da62462b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:42.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1df86700 1 --2- 172.21.15.80:0/809310478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba18073020 0x7fba18071ea0 secure :-1 s=THROTTLE_DONE pgs=1859 cs=0 l=1 rx=0x7fba0800f740 tx=0x7fba0800f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1df86700 1 --2- 172.21.15.80:0/809310478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba18073020 0x7fba18071ea0 secure :-1 s=THROTTLE_DONE pgs=1859 cs=0 l=1 rx=0x7fba0800f740 tx=0x7fba0800f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1d785700 1 -- 172.21.15.80:0/809310478 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba08000960 con 0x7fba18073020 2019-11-28T11:45:42.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1df86700 1 --2- 172.21.15.80:0/809310478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba18073020 0x7fba18071ea0 secure :-1 s=THROTTLE_DONE pgs=1859 cs=0 l=1 rx=0x7fba0800f740 tx=0x7fba0800f5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1d785700 1 -- 172.21.15.80:0/809310478 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba08000c90 con 0x7fba18073020 2019-11-28T11:45:42.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba1d785700 1 -- 172.21.15.80:0/809310478 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba080013a0 con 0x7fba18073020 2019-11-28T11:45:42.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba201ea700 1 -- 172.21.15.80:0/809310478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba18073020 msgr2=0x7fba18071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:42.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.728+0000 7fba201ea700 1 --2- 172.21.15.80:0/809310478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba18073020 0x7fba18071ea0 secure :-1 s=READY pgs=1859 cs=0 l=1 rx=0x7fba0800f740 tx=0x7fba0800f5f0).stop 2019-11-28T11:45:42.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.729+0000 7fba201ea700 1 -- 172.21.15.80:0/809310478 shutdown_connections 2019-11-28T11:45:42.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.729+0000 7fba201ea700 1 --2- 172.21.15.80:0/809310478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba180734b0 0x7fba180723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:42.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.729+0000 7fba201ea700 1 --2- 172.21.15.80:0/809310478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba18073020 0x7fba18071ea0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.729+0000 7fba201ea700 1 --2- 172.21.15.80:0/809310478 >> v2:172.21.15.174:3300/0 conn(0x7fba1815ed10 0x7fba1815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.729+0000 7fba201ea700 1 -- 172.21.15.80:0/809310478 shutdown_connections 2019-11-28T11:45:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.729+0000 7fba201ea700 1 -- 172.21.15.80:0/809310478 wait complete. 2019-11-28T11:45:42.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.729+0000 7fba201ea700 1 -- 172.21.15.80:0/809310478 >> 172.21.15.80:0/809310478 conn(0x7fba18061d20 msgr2=0x7fba180641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:42.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.731+0000 7fba201ea700 1 Processor -- start 2019-11-28T11:45:42.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.731+0000 7fba201ea700 1 -- start start 2019-11-28T11:45:42.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.732+0000 7fba201ea700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba1810e970 0x7fba181087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:42.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.732+0000 7fba201ea700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fba18108cf0 0x7fba18107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:42.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.732+0000 7fba201ea700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1810c250 con 0x7fba18107b70 2019-11-28T11:45:42.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.732+0000 7fba201ea700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1810da00 con 0x7fba18108cf0 2019-11-28T11:45:42.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.732+0000 7fba201ea700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1810e430 con 0x7fba1810e970 2019-11-28T11:45:42.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.732+0000 7fba1ef88700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fba18107b70 0x7fba1810ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40260/0 (socket says 172.21.15.80:40260) 2019-11-28T11:45:42.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.732+0000 7fba1ef88700 1 -- 172.21.15.80:0/1994911659 learned_addr learned my addr 172.21.15.80:0/1994911659 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:42.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.732+0000 7fba1e787700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba1810e970 0x7fba181087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba1df86700 1 --2- 172.21.15.80:0/1994911659 >> v2:172.21.15.174:3300/0 conn(0x7fba18108cf0 0x7fba18107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba16ffd700 1 -- 172.21.15.80:0/1994911659 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657287941 0 0) 0x7fba10009b10 con 0x7fba18107b70 2019-11-28T11:45:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba16ffd700 1 -- 172.21.15.80:0/1994911659 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9fc002e80 con 0x7fba18107b70 2019-11-28T11:45:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba1e787700 1 -- 172.21.15.80:0/1994911659 >> v2:172.21.15.174:3300/0 conn(0x7fba18108cf0 msgr2=0x7fba18107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba1e787700 1 --2- 172.21.15.80:0/1994911659 >> v2:172.21.15.174:3300/0 conn(0x7fba18108cf0 0x7fba18107630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba1e787700 1 -- 172.21.15.80:0/1994911659 >> v1:172.21.15.80:6789/0 conn(0x7fba18107b70 legacy=0x7fba1810ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba16ffd700 1 -- 172.21.15.80:0/1994911659 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 688914224 0 0) 0x7fba10009890 con 0x7fba18107b70 2019-11-28T11:45:42.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba1e787700 1 -- 172.21.15.80:0/1994911659 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba18105ef0 con 0x7fba1810e970 2019-11-28T11:45:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba1df86700 1 --2- 172.21.15.80:0/1994911659 >> v2:172.21.15.174:3300/0 conn(0x7fba18108cf0 0x7fba18107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba1e787700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba1810e970 0x7fba181087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fba00010710 tx=0x7fba00010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba1e787700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba1810e970 0x7fba181087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fba00010710 tx=0x7fba00010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba1e787700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba1810e970 0x7fba181087b0 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7fba00010710 tx=0x7fba00010ab0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba1e787700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba1810e970 0x7fba181087b0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fba00010710 tx=0x7fba00010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba16ffd700 1 -- 172.21.15.80:0/1994911659 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba00000cc0 con 0x7fba1810e970 2019-11-28T11:45:42.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba1e787700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba1810e970 0x7fba181087b0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fba00010710 tx=0x7fba00010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba1e787700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba1810e970 0x7fba181087b0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fba00010710 tx=0x7fba00010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba16ffd700 1 -- 172.21.15.80:0/1994911659 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba00009f50 con 0x7fba1810e970 2019-11-28T11:45:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba201ea700 1 -- 172.21.15.80:0/1994911659 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba18106270 con 0x7fba1810e970 2019-11-28T11:45:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba16ffd700 1 -- 172.21.15.80:0/1994911659 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba0000a140 con 0x7fba1810e970 2019-11-28T11:45:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.733+0000 7fba201ea700 1 -- 172.21.15.80:0/1994911659 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba18105ef0 con 0x7fba1810e970 2019-11-28T11:45:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.734+0000 7fba1e787700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba1810e970 0x7fba181087b0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fba00010710 tx=0x7fba00010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.734+0000 7fba16ffd700 1 -- 172.21.15.80:0/1994911659 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fba00009c10 con 0x7fba1810e970 2019-11-28T11:45:42.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.734+0000 7fba1e787700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba1810e970 0x7fba181087b0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fba00010710 tx=0x7fba00010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.734+0000 7fba16ffd700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb9fc018780 0x7fb9fc01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:42.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.734+0000 7fba16ffd700 1 -- 172.21.15.80:0/1994911659 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fba00031da0 con 0x7fba1810e970 2019-11-28T11:45:42.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.734+0000 7fba1df86700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb9fc018780 0x7fb9fc01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:42.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.735+0000 7fba1df86700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb9fc018780 0x7fb9fc01abf0 crc :-1 s=READY pgs=753 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:42.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.742+0000 7fba201ea700 1 -- 172.21.15.80:0/1994911659 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba18106270 con 0x7fba1810e970 2019-11-28T11:45:42.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.746+0000 7fba1e787700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba1810e970 0x7fba181087b0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fba00010710 tx=0x7fba00010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.746+0000 7fba16ffd700 1 -- 172.21.15.80:0/1994911659 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fba00009970 con 0x7fba1810e970 2019-11-28T11:45:42.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.913+0000 7fba201ea700 1 -- 172.21.15.80:0/1994911659 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fba18105ef0 con 0x7fba1810e970 2019-11-28T11:45:42.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.913+0000 7fba1e787700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba1810e970 0x7fba181087b0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fba00010710 tx=0x7fba00010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:42.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.913+0000 7fba16ffd700 1 -- 172.21.15.80:0/1994911659 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v141) v1 ==== 104+0+10 (secure 0 0 0) 0x7fba00009970 con 0x7fba1810e970 2019-11-28T11:45:42.955 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:45:42.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.916+0000 7fba201ea700 1 -- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb9fc018780 msgr2=0x7fb9fc01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:42.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.916+0000 7fba201ea700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb9fc018780 0x7fb9fc01abf0 crc :-1 s=READY pgs=753 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.916+0000 7fba201ea700 1 -- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba1810e970 msgr2=0x7fba181087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:42.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.916+0000 7fba201ea700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba1810e970 0x7fba181087b0 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7fba00010710 tx=0x7fba00010ab0).stop 2019-11-28T11:45:42.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.916+0000 7fba201ea700 1 -- 172.21.15.80:0/1994911659 shutdown_connections 2019-11-28T11:45:42.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.916+0000 7fba201ea700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb9fc018780 0x7fb9fc01abf0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.916+0000 7fba201ea700 1 --2- 172.21.15.80:0/1994911659 >> v2:172.21.15.174:3300/0 conn(0x7fba18108cf0 0x7fba18107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.916+0000 7fba201ea700 1 --2- 172.21.15.80:0/1994911659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba1810e970 0x7fba181087b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:42.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.916+0000 7fba201ea700 1 -- 172.21.15.80:0/1994911659 shutdown_connections 2019-11-28T11:45:42.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.916+0000 7fba201ea700 1 -- 172.21.15.80:0/1994911659 wait complete. 2019-11-28T11:45:42.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:42.916+0000 7fba201ea700 1 -- 172.21.15.80:0/1994911659 >> 172.21.15.80:0/1994911659 conn(0x7fba1815e2d0 msgr2=0x7fba18147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:42.967 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:45:43.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.048+0000 7f1bcbd58700 1 Processor -- start 2019-11-28T11:45:43.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.048+0000 7f1bcbd58700 1 -- start start 2019-11-28T11:45:43.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.049+0000 7f1bcbd58700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1bc415ed10 0x7f1bc415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:43.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.049+0000 7f1bcbd58700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1bc40734b0 0x7f1bc40726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:43.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.049+0000 7f1bcbd58700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc406db60 con 0x7f1bc4073020 2019-11-28T11:45:43.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.049+0000 7f1bcbd58700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc406fe00 con 0x7f1bc415ed10 2019-11-28T11:45:43.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.049+0000 7f1bcbd58700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40700d0 con 0x7f1bc40734b0 2019-11-28T11:45:43.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bcaaf6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1bc40734b0 0x7f1bc40726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:43.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bca2f5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1bc415ed10 0x7f1bc415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:43.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bc9af4700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f1bc4073020 0x7f1bc4071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:55810/0 (socket says 172.21.15.80:55810) 2019-11-28T11:45:43.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bc9af4700 1 -- 172.21.15.80:0/1013733996 learned_addr learned my addr 172.21.15.80:0/1013733996 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bca2f5700 1 -- 172.21.15.80:0/1013733996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1bc40734b0 msgr2=0x7f1bc40726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/1013733996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1bc40734b0 0x7f1bc40726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bca2f5700 1 -- 172.21.15.80:0/1013733996 >> v1:172.21.15.174:6789/0 conn(0x7f1bc4073020 legacy=0x7f1bc4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bca2f5700 1 -- 172.21.15.80:0/1013733996 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc4070760 con 0x7f1bc415ed10 2019-11-28T11:45:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bc92f3700 1 -- 172.21.15.80:0/1013733996 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987805117 0 0) 0x7f1bbc001480 con 0x7f1bc4073020 2019-11-28T11:45:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bcaaf6700 1 --2- 172.21.15.80:0/1013733996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1bc40734b0 0x7f1bc40726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/1013733996 >> v2:172.21.15.174:3300/0 conn(0x7f1bc415ed10 0x7f1bc415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1bb400af50 tx=0x7f1bb400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/1013733996 >> v2:172.21.15.174:3300/0 conn(0x7f1bc415ed10 0x7f1bc415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1bb400af50 tx=0x7f1bb400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/1013733996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1bc415ed10 0x7f1bc415f100 secure :-1 s=READY pgs=1084 cs=0 l=1 rx=0x7f1bb400af50 tx=0x7f1bb400b760).ready entity=mon.1 client_cookie=7efaa5c57749c615 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/1013733996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1bc415ed10 0x7f1bc415f100 secure :-1 s=THROTTLE_DONE pgs=1084 cs=0 l=1 rx=0x7f1bb400af50 tx=0x7f1bb400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bc92f3700 1 -- 172.21.15.80:0/1013733996 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bb4007210 con 0x7f1bc415ed10 2019-11-28T11:45:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/1013733996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1bc415ed10 0x7f1bc415f100 secure :-1 s=THROTTLE_DONE pgs=1084 cs=0 l=1 rx=0x7f1bb400af50 tx=0x7f1bb400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/1013733996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1bc415ed10 0x7f1bc415f100 secure :-1 s=THROTTLE_DONE pgs=1084 cs=0 l=1 rx=0x7f1bb400af50 tx=0x7f1bb400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bc92f3700 1 -- 172.21.15.80:0/1013733996 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb40099b0 con 0x7f1bc415ed10 2019-11-28T11:45:43.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.050+0000 7f1bc92f3700 1 -- 172.21.15.80:0/1013733996 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bb400a080 con 0x7f1bc415ed10 2019-11-28T11:45:43.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.051+0000 7f1bcbd58700 1 -- 172.21.15.80:0/1013733996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1bc415ed10 msgr2=0x7f1bc415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:43.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.051+0000 7f1bcbd58700 1 --2- 172.21.15.80:0/1013733996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1bc415ed10 0x7f1bc415f100 secure :-1 s=READY pgs=1084 cs=0 l=1 rx=0x7f1bb400af50 tx=0x7f1bb400b760).stop 2019-11-28T11:45:43.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.051+0000 7f1bcbd58700 1 -- 172.21.15.80:0/1013733996 shutdown_connections 2019-11-28T11:45:43.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.051+0000 7f1bcbd58700 1 --2- 172.21.15.80:0/1013733996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1bc40734b0 0x7f1bc40726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:43.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.051+0000 7f1bcbd58700 1 --2- 172.21.15.80:0/1013733996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1bc415ed10 0x7f1bc415f100 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:43.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.051+0000 7f1bcbd58700 1 -- 172.21.15.80:0/1013733996 shutdown_connections 2019-11-28T11:45:43.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.051+0000 7f1bcbd58700 1 -- 172.21.15.80:0/1013733996 wait complete. 2019-11-28T11:45:43.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.051+0000 7f1bcbd58700 1 -- 172.21.15.80:0/1013733996 >> 172.21.15.80:0/1013733996 conn(0x7f1bc4061d20 msgr2=0x7f1bc40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:43.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.054+0000 7f1bcbd58700 1 Processor -- start 2019-11-28T11:45:43.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.054+0000 7f1bcbd58700 1 -- start start 2019-11-28T11:45:43.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bcbd58700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1bc4153db0 0x7f1bc410dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:43.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bcbd58700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1bc410e270 0x7f1bc4148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:43.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bcbd58700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc41057a0 con 0x7f1bc4148570 2019-11-28T11:45:43.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bcbd58700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc4106280 con 0x7f1bc4153db0 2019-11-28T11:45:43.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bcbd58700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc4106550 con 0x7f1bc410e270 2019-11-28T11:45:43.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bca2f5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1bc4153db0 0x7f1bc410dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:43.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bca2f5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1bc4153db0 0x7f1bc410dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40956/0 (socket says 172.21.15.80:40956) 2019-11-28T11:45:43.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bca2f5700 1 -- 172.21.15.80:0/693885423 learned_addr learned my addr 172.21.15.80:0/693885423 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:43.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bc9af4700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1bc410e270 0x7f1bc4148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:43.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bca2f5700 1 -- 172.21.15.80:0/693885423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1bc410e270 msgr2=0x7f1bc4148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:43.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1bc410e270 0x7f1bc4148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:43.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bca2f5700 1 -- 172.21.15.80:0/693885423 >> v1:172.21.15.174:6789/0 conn(0x7f1bc4148570 legacy=0x7f1bc410cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:43.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bc2ffd700 1 -- 172.21.15.80:0/693885423 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675051128 0 0) 0x7f1bac0097c0 con 0x7f1bc4148570 2019-11-28T11:45:43.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bca2f5700 1 -- 172.21.15.80:0/693885423 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc4106be0 con 0x7f1bc4153db0 2019-11-28T11:45:43.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/693885423 >> v2:172.21.15.80:3300/0 conn(0x7f1bc4153db0 0x7f1bc410dd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1bb4010470 tx=0x7f1bb4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/693885423 >> v2:172.21.15.80:3300/0 conn(0x7f1bc4153db0 0x7f1bc410dd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1bb4010470 tx=0x7f1bb4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc4153db0 0x7f1bc410dd30 secure :-1 s=READY pgs=1861 cs=0 l=1 rx=0x7f1bb4010470 tx=0x7f1bb4010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:43.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc4153db0 0x7f1bc410dd30 secure :-1 s=THROTTLE_DONE pgs=1861 cs=0 l=1 rx=0x7f1bb4010470 tx=0x7f1bb4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bc2ffd700 1 -- 172.21.15.80:0/693885423 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bb4000940 con 0x7f1bc4153db0 2019-11-28T11:45:43.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc4153db0 0x7f1bc410dd30 secure :-1 s=THROTTLE_DONE pgs=1861 cs=0 l=1 rx=0x7f1bb4010470 tx=0x7f1bb4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bc2ffd700 1 -- 172.21.15.80:0/693885423 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb400b380 con 0x7f1bc4153db0 2019-11-28T11:45:43.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc4153db0 0x7f1bc410dd30 secure :-1 s=THROTTLE_DONE pgs=1861 cs=0 l=1 rx=0x7f1bb4010470 tx=0x7f1bb4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bcbd58700 1 -- 172.21.15.80:0/693885423 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc4106f60 con 0x7f1bc4153db0 2019-11-28T11:45:43.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bc2ffd700 1 -- 172.21.15.80:0/693885423 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bb4000940 con 0x7f1bc4153db0 2019-11-28T11:45:43.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.055+0000 7f1bcbd58700 1 -- 172.21.15.80:0/693885423 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc4106be0 con 0x7f1bc4153db0 2019-11-28T11:45:43.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.056+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc4153db0 0x7f1bc410dd30 secure :-1 s=THROTTLE_DONE pgs=1861 cs=0 l=1 rx=0x7f1bb4010470 tx=0x7f1bb4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.056+0000 7f1bc2ffd700 1 -- 172.21.15.80:0/693885423 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1bb4009620 con 0x7f1bc4153db0 2019-11-28T11:45:43.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.056+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc4153db0 0x7f1bc410dd30 secure :-1 s=THROTTLE_DONE pgs=1861 cs=0 l=1 rx=0x7f1bb4010470 tx=0x7f1bb4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.056+0000 7f1bc2ffd700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ba8018730 0x7f1ba801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:43.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.056+0000 7f1bc2ffd700 1 -- 172.21.15.80:0/693885423 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1bb4031af0 con 0x7f1bc4153db0 2019-11-28T11:45:43.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.056+0000 7f1bc9af4700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ba8018730 0x7f1ba801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:43.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.056+0000 7f1bc9af4700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ba8018730 0x7f1ba801abc0 crc :-1 s=READY pgs=754 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:43.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.064+0000 7f1bcbd58700 1 -- 172.21.15.80:0/693885423 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc4106f60 con 0x7f1bc4153db0 2019-11-28T11:45:43.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.067+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc4153db0 0x7f1bc410dd30 secure :-1 s=THROTTLE_DONE pgs=1861 cs=0 l=1 rx=0x7f1bb4010470 tx=0x7f1bb4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.067+0000 7f1bc2ffd700 1 -- 172.21.15.80:0/693885423 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1bb4000940 con 0x7f1bc4153db0 2019-11-28T11:45:43.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.235+0000 7f1bcbd58700 1 -- 172.21.15.80:0/693885423 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f1bc4106be0 con 0x7f1bc4153db0 2019-11-28T11:45:43.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.235+0000 7f1bca2f5700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc4153db0 0x7f1bc410dd30 secure :-1 s=THROTTLE_DONE pgs=1861 cs=0 l=1 rx=0x7f1bb4010470 tx=0x7f1bb4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.235+0000 7f1bc2ffd700 1 -- 172.21.15.80:0/693885423 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v141) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1bb4009580 con 0x7f1bc4153db0 2019-11-28T11:45:43.277 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:45:43.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.238+0000 7f1bcbd58700 1 -- 172.21.15.80:0/693885423 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ba8018730 msgr2=0x7f1ba801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:43.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.238+0000 7f1bcbd58700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ba8018730 0x7f1ba801abc0 crc :-1 s=READY pgs=754 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:43.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.238+0000 7f1bcbd58700 1 -- 172.21.15.80:0/693885423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc4153db0 msgr2=0x7f1bc410dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:43.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.238+0000 7f1bcbd58700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc4153db0 0x7f1bc410dd30 secure :-1 s=READY pgs=1861 cs=0 l=1 rx=0x7f1bb4010470 tx=0x7f1bb4010270).stop 2019-11-28T11:45:43.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.238+0000 7f1bcbd58700 1 -- 172.21.15.80:0/693885423 shutdown_connections 2019-11-28T11:45:43.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.238+0000 7f1bcbd58700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ba8018730 0x7f1ba801abc0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:43.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.238+0000 7f1bcbd58700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1bc410e270 0x7f1bc4148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:43.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.238+0000 7f1bcbd58700 1 --2- 172.21.15.80:0/693885423 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bc4153db0 0x7f1bc410dd30 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:43.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.238+0000 7f1bcbd58700 1 -- 172.21.15.80:0/693885423 shutdown_connections 2019-11-28T11:45:43.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.238+0000 7f1bcbd58700 1 -- 172.21.15.80:0/693885423 wait complete. 2019-11-28T11:45:43.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.238+0000 7f1bcbd58700 1 -- 172.21.15.80:0/693885423 >> 172.21.15.80:0/693885423 conn(0x7f1bc415e2d0 msgr2=0x7f1bc4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:43.289 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:45:43.289 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:43.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.367+0000 7fca0a849700 1 Processor -- start 2019-11-28T11:45:43.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.367+0000 7fca0a849700 1 -- start start 2019-11-28T11:45:43.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.368+0000 7fca0a849700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca0406c490 0x7fca0406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:43.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.368+0000 7fca0a849700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0406ce60 0x7fca04164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:43.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.368+0000 7fca0a849700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0406db00 con 0x7fca0406c0a0 2019-11-28T11:45:43.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.368+0000 7fca0a849700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0406fd60 con 0x7fca0406c490 2019-11-28T11:45:43.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.368+0000 7fca0a849700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca04070030 con 0x7fca0406ce60 2019-11-28T11:45:43.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.368+0000 7fca03fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca0406c490 0x7fca0406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:43.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.368+0000 7fca08de6700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fca0406c0a0 0x7fca04072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40280/0 (socket says 172.21.15.80:40280) 2019-11-28T11:45:43.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.368+0000 7fca03fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca0406c490 0x7fca0406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40964/0 (socket says 172.21.15.80:40964) 2019-11-28T11:45:43.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.368+0000 7fca08de6700 1 -- 172.21.15.80:0/752693707 learned_addr learned my addr 172.21.15.80:0/752693707 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:43.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.368+0000 7fca095e7700 1 --2- 172.21.15.80:0/752693707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0406ce60 0x7fca04164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:43.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.369+0000 7fca03fff700 1 -- 172.21.15.80:0/752693707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0406ce60 msgr2=0x7fca04164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:43.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.369+0000 7fca03fff700 1 --2- 172.21.15.80:0/752693707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0406ce60 0x7fca04164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:43.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.369+0000 7fca03fff700 1 -- 172.21.15.80:0/752693707 >> v1:172.21.15.80:6789/0 conn(0x7fca0406c0a0 legacy=0x7fca04072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:43.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.369+0000 7fca037fe700 1 -- 172.21.15.80:0/752693707 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310121077 0 0) 0x7fc9ec001150 con 0x7fca0406c0a0 2019-11-28T11:45:43.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.369+0000 7fca03fff700 1 -- 172.21.15.80:0/752693707 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca040706c0 con 0x7fca0406c490 2019-11-28T11:45:43.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.369+0000 7fca03fff700 1 --2- 172.21.15.80:0/752693707 >> v2:172.21.15.80:3300/0 conn(0x7fca0406c490 0x7fca0406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc9f400b2d0 tx=0x7fc9f400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.369+0000 7fca03fff700 1 --2- 172.21.15.80:0/752693707 >> v2:172.21.15.80:3300/0 conn(0x7fca0406c490 0x7fca0406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc9f400b2d0 tx=0x7fc9f400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.369+0000 7fca03fff700 1 --2- 172.21.15.80:0/752693707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca0406c490 0x7fca0406c920 secure :-1 s=READY pgs=1863 cs=0 l=1 rx=0x7fc9f400b2d0 tx=0x7fc9f400ba60).ready entity=mon.0 client_cookie=c21569978f3c63dd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:43.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.369+0000 7fca03fff700 1 --2- 172.21.15.80:0/752693707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca0406c490 0x7fca0406c920 secure :-1 s=THROTTLE_DONE pgs=1863 cs=0 l=1 rx=0x7fc9f400b2d0 tx=0x7fc9f400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.369+0000 7fca037fe700 1 -- 172.21.15.80:0/752693707 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9f4007590 con 0x7fca0406c490 2019-11-28T11:45:43.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.369+0000 7fca03fff700 1 --2- 172.21.15.80:0/752693707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca0406c490 0x7fca0406c920 secure :-1 s=THROTTLE_DONE pgs=1863 cs=0 l=1 rx=0x7fc9f400b2d0 tx=0x7fc9f400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.369+0000 7fca03fff700 1 --2- 172.21.15.80:0/752693707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca0406c490 0x7fca0406c920 secure :-1 s=THROTTLE_DONE pgs=1863 cs=0 l=1 rx=0x7fc9f400b2d0 tx=0x7fc9f400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.369+0000 7fca037fe700 1 -- 172.21.15.80:0/752693707 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f4009d30 con 0x7fca0406c490 2019-11-28T11:45:43.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.369+0000 7fca037fe700 1 -- 172.21.15.80:0/752693707 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9f400a400 con 0x7fca0406c490 2019-11-28T11:45:43.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.369+0000 7fca0a849700 1 -- 172.21.15.80:0/752693707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca0406c490 msgr2=0x7fca0406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:43.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.369+0000 7fca0a849700 1 --2- 172.21.15.80:0/752693707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca0406c490 0x7fca0406c920 secure :-1 s=READY pgs=1863 cs=0 l=1 rx=0x7fc9f400b2d0 tx=0x7fc9f400ba60).stop 2019-11-28T11:45:43.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.370+0000 7fca0a849700 1 -- 172.21.15.80:0/752693707 shutdown_connections 2019-11-28T11:45:43.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.370+0000 7fca0a849700 1 --2- 172.21.15.80:0/752693707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0406ce60 0x7fca04164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:43.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.370+0000 7fca0a849700 1 --2- 172.21.15.80:0/752693707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca0406c490 0x7fca0406c920 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:43.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.370+0000 7fca0a849700 1 -- 172.21.15.80:0/752693707 shutdown_connections 2019-11-28T11:45:43.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.370+0000 7fca0a849700 1 -- 172.21.15.80:0/752693707 wait complete. 2019-11-28T11:45:43.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.370+0000 7fca0a849700 1 -- 172.21.15.80:0/752693707 >> 172.21.15.80:0/752693707 conn(0x7fca04061cf0 msgr2=0x7fca04064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:43.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.372+0000 7fca0a849700 1 Processor -- start 2019-11-28T11:45:43.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.372+0000 7fca0a849700 1 -- start start 2019-11-28T11:45:43.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.373+0000 7fca0a849700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0415fdf0 0x7fca0412b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:43.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.373+0000 7fca0a849700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fca0412b8a0 0x7fca0413e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:43.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.373+0000 7fca0a849700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca04139e00 con 0x7fca0413e860 2019-11-28T11:45:43.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.373+0000 7fca0a849700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca04107df0 con 0x7fca0412b8a0 2019-11-28T11:45:43.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.373+0000 7fca0a849700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca04107890 con 0x7fca0415fdf0 2019-11-28T11:45:43.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.373+0000 7fca095e7700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fca0413e860 0x7fca0412a3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40284/0 (socket says 172.21.15.80:40284) 2019-11-28T11:45:43.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.373+0000 7fca095e7700 1 -- 172.21.15.80:0/357650680 learned_addr learned my addr 172.21.15.80:0/357650680 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:45:43.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.373+0000 7fca08de6700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0415fdf0 0x7fca0412b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:43.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.373+0000 7fca03fff700 1 --2- 172.21.15.80:0/357650680 >> v2:172.21.15.174:3300/0 conn(0x7fca0412b8a0 0x7fca0413e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:43.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.373+0000 7fca017fa700 1 -- 172.21.15.80:0/357650680 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925243901 0 0) 0x7fc9fc0095b0 con 0x7fca0413e860 2019-11-28T11:45:43.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.373+0000 7fca017fa700 1 -- 172.21.15.80:0/357650680 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9e8002e80 con 0x7fca0413e860 2019-11-28T11:45:43.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca03fff700 1 -- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0415fdf0 msgr2=0x7fca0412b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:43.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca03fff700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0415fdf0 0x7fca0412b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:43.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca03fff700 1 -- 172.21.15.80:0/357650680 >> v1:172.21.15.80:6789/0 conn(0x7fca0413e860 legacy=0x7fca0412a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:43.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca017fa700 1 -- 172.21.15.80:0/357650680 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1387095280 0 0) 0x7fc9fc000ab0 con 0x7fca0413e860 2019-11-28T11:45:43.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca03fff700 1 -- 172.21.15.80:0/357650680 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0410a8c0 con 0x7fca0412b8a0 2019-11-28T11:45:43.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca08de6700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0415fdf0 0x7fca0412b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:45:43.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca03fff700 1 --2- 172.21.15.80:0/357650680 >> v2:172.21.15.174:3300/0 conn(0x7fca0412b8a0 0x7fca0413e320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9f4010720 tx=0x7fc9f4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca03fff700 1 --2- 172.21.15.80:0/357650680 >> v2:172.21.15.174:3300/0 conn(0x7fca0412b8a0 0x7fca0413e320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9f4010720 tx=0x7fc9f4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca03fff700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca0412b8a0 0x7fca0413e320 secure :-1 s=READY pgs=1086 cs=0 l=1 rx=0x7fc9f4010720 tx=0x7fc9f4010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:43.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca03fff700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca0412b8a0 0x7fca0413e320 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7fc9f4010720 tx=0x7fc9f4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca017fa700 1 -- 172.21.15.80:0/357650680 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9f4000d60 con 0x7fca0412b8a0 2019-11-28T11:45:43.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca03fff700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca0412b8a0 0x7fca0413e320 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7fc9f4010720 tx=0x7fc9f4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca03fff700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca0412b8a0 0x7fca0413e320 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7fc9f4010720 tx=0x7fc9f4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca017fa700 1 -- 172.21.15.80:0/357650680 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f4009af0 con 0x7fca0412b8a0 2019-11-28T11:45:43.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca017fa700 1 -- 172.21.15.80:0/357650680 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9f4000d60 con 0x7fca0412b8a0 2019-11-28T11:45:43.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca0a849700 1 -- 172.21.15.80:0/357650680 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0410a8c0 con 0x7fca0412b8a0 2019-11-28T11:45:43.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca0a849700 1 -- 172.21.15.80:0/357650680 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0410a8c0 con 0x7fca0412b8a0 2019-11-28T11:45:43.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.374+0000 7fca03fff700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca0412b8a0 0x7fca0413e320 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7fc9f4010720 tx=0x7fc9f4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.375+0000 7fca017fa700 1 -- 172.21.15.80:0/357650680 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc9f4009ce0 con 0x7fca0412b8a0 2019-11-28T11:45:43.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.375+0000 7fca03fff700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca0412b8a0 0x7fca0413e320 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7fc9f4010720 tx=0x7fc9f4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.375+0000 7fca017fa700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9e8018780 0x7fc9e801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:43.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.375+0000 7fca017fa700 1 -- 172.21.15.80:0/357650680 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc9f4031d90 con 0x7fca0412b8a0 2019-11-28T11:45:43.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.375+0000 7fca08de6700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9e8018780 0x7fc9e801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:43.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.375+0000 7fca08de6700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9e8018780 0x7fc9e801abf0 crc :-1 s=READY pgs=755 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:43.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.383+0000 7fca0a849700 1 -- 172.21.15.80:0/357650680 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca04109180 con 0x7fca0412b8a0 2019-11-28T11:45:43.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.386+0000 7fca03fff700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca0412b8a0 0x7fca0413e320 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7fc9f4010720 tx=0x7fc9f4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.386+0000 7fca017fa700 1 -- 172.21.15.80:0/357650680 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc9f400acd0 con 0x7fca0412b8a0 2019-11-28T11:45:43.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.558+0000 7fca0a849700 1 -- 172.21.15.80:0/357650680 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca04109500 con 0x7fca0412b8a0 2019-11-28T11:45:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.558+0000 7fca03fff700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca0412b8a0 0x7fca0413e320 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7fc9f4010720 tx=0x7fc9f4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.558+0000 7fca017fa700 1 -- 172.21.15.80:0/357650680 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+2455 (secure 0 0 0) 0x7fc9f4009ce0 con 0x7fca0412b8a0 2019-11-28T11:45:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 107 2019-11-28T11:45:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.560+0000 7fca0a849700 1 -- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9e8018780 msgr2=0x7fc9e801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.560+0000 7fca0a849700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9e8018780 0x7fc9e801abf0 crc :-1 s=READY pgs=755 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.560+0000 7fca0a849700 1 -- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca0412b8a0 msgr2=0x7fca0413e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.560+0000 7fca0a849700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca0412b8a0 0x7fca0413e320 secure :-1 s=READY pgs=1086 cs=0 l=1 rx=0x7fc9f4010720 tx=0x7fc9f4010ac0).stop 2019-11-28T11:45:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.561+0000 7fca0a849700 1 -- 172.21.15.80:0/357650680 shutdown_connections 2019-11-28T11:45:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.561+0000 7fca0a849700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9e8018780 0x7fc9e801abf0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.561+0000 7fca0a849700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca0412b8a0 0x7fca0413e320 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.561+0000 7fca0a849700 1 --2- 172.21.15.80:0/357650680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0415fdf0 0x7fca0412b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.561+0000 7fca0a849700 1 -- 172.21.15.80:0/357650680 shutdown_connections 2019-11-28T11:45:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.561+0000 7fca0a849700 1 -- 172.21.15.80:0/357650680 wait complete. 2019-11-28T11:45:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:43.561+0000 7fca0a849700 1 -- 172.21.15.80:0/357650680 >> 172.21.15.80:0/357650680 conn(0x7fca04127dc0 msgr2=0x7fca04141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:43.608 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:43.608 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":107,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/3312817459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3312817459},{"type":"v1","addr":"172.21.15.174:6835","nonce":3312817459}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":106},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3089980665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3089980665},{"type":"v1","addr":"172.21.15.80:6834","nonce":3089980665}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":106}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:30.152127+0000","modified":"2019-11-28T11:45:37.708419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8752},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8752":{"gid":8752,"name":"b","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6835/1912693207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1912693207},{"type":"v1","addr":"172.21.15.80:6835","nonce":1912693207}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2019-11-28T11:45:43.919 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8752}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 22, u'failed': [], u'epoch': 107, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [23], u'info': {u'gid_8752': {u'export_targets': [], u'name': u'b', u'incarnation': 106, u'state_seq': 3, u'state': u'up:active', u'gid': 8752, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1912693207, u'type': u'v2', u'addr': u'172.21.15.80:6833'}, {u'nonce': 1912693207, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/1912693207'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:45:30.152127+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:45:37.708419+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:45:43.919 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:45:43.919 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-11-28T11:45:44.045 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:45:44.045 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:45:44.045 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T11:45:44.045 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 8752, 2019-11-28T11:45:44.046 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2019-11-28T11:45:44.046 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2019-11-28T11:45:44.046 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 7.3018227710000003, 2019-11-28T11:45:44.046 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 107, 2019-11-28T11:45:44.046 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 141, 2019-11-28T11:45:44.046 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 141, 2019-11-28T11:45:44.047 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 11.42840262 2019-11-28T11:45:44.047 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:45:44.051 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8752, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.3018227710000003, "mdsmap_epoch": 107, "osdmap_epoch": 141, "osdmap_epoch_barrier": 141, "uptime": 11.42840262 } 2019-11-28T11:45:44.051 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:45:44.051 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:45:44.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:45:44.052 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:45:44.123 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:45:44.124 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:45:44.248 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:45:44.248 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:45:44.249 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:45:44.249 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:45:44.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:45:44.249 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:45:44.323 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:45:44.444 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:45:44.444 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:45:44.444 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:45:44.450 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:45:44.450 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:45:44.576 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:45:44.577 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:45:44.578 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:45:44.578 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:45:44.578 INFO:teuthology.orchestra.run.smithi076:> rpm -q fuse --qf '%{VERSION}-%{RELEASE}' 2019-11-28T11:45:44.645 INFO:teuthology.orchestra.run.smithi076.stdout:2.9.2-11.el7 2019-11-28T11:45:44.646 INFO:teuthology.packaging:The installed version of fuse is 2.9.2-11.el7 2019-11-28T11:45:44.646 INFO:teuthology.orchestra.run.smithi016:> rpm -q fuse --qf '%{VERSION}-%{RELEASE}' 2019-11-28T11:45:44.675 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:45:44.696 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:45:44.700 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:45:44.704 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:45:44.708 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:45:44.712 INFO:teuthology.orchestra.run.smithi016.stdout:2.9.2-11.el7 2019-11-28T11:45:44.713 INFO:teuthology.packaging:The installed version of fuse is 2.9.2-11.el7 2019-11-28T11:45:44.714 INFO:tasks.cephfs.test_client_recovery:flock locks are available 2019-11-28T11:45:44.714 INFO:tasks.cephfs.mount:lock_background file background_file 2019-11-28T11:45:44.715 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits daemon-helper kill python -c ' 2019-11-28T11:45:44.715 INFO:teuthology.orchestra.run.smithi076:> import time 2019-11-28T11:45:44.715 INFO:teuthology.orchestra.run.smithi076:> import fcntl 2019-11-28T11:45:44.715 INFO:teuthology.orchestra.run.smithi076:> import struct 2019-11-28T11:45:44.715 INFO:teuthology.orchestra.run.smithi076:> f1 = open("/home/ubuntu/cephtest/mnt.0/background_file-1", '"'"'w'"'"') 2019-11-28T11:45:44.715 INFO:teuthology.orchestra.run.smithi076:> fcntl.flock(f1, fcntl.LOCK_EX | fcntl.LOCK_NB) 2019-11-28T11:45:44.716 INFO:teuthology.orchestra.run.smithi076:> f2 = open("/home/ubuntu/cephtest/mnt.0/background_file-2", '"'"'w'"'"') 2019-11-28T11:45:44.716 INFO:teuthology.orchestra.run.smithi076:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2019-11-28T11:45:44.716 INFO:teuthology.orchestra.run.smithi076:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2019-11-28T11:45:44.717 INFO:teuthology.orchestra.run.smithi076:> while True: 2019-11-28T11:45:44.717 INFO:teuthology.orchestra.run.smithi076:> time.sleep(1) 2019-11-28T11:45:44.717 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:45:44.718 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:45:44.756 INFO:teuthology.orchestra.run.smithi016:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file-2 2019-11-28T11:45:44.812 INFO:teuthology.orchestra.run.smithi016.stderr:ls: cannot access /home/ubuntu/cephtest/mnt.1/background_file-2: No such file or directory 2019-11-28T11:45:44.813 DEBUG:teuthology.orchestra.run:got remote process result: 2 2019-11-28T11:45:45.820 INFO:teuthology.orchestra.run.smithi016:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file-2 2019-11-28T11:45:45.891 INFO:teuthology.orchestra.run.smithi016.stdout:/home/ubuntu/cephtest/mnt.1/background_file-2 2019-11-28T11:45:45.893 DEBUG:tasks.cephfs.mount:File background_file-2 became visible from 1 after 1s 2019-11-28T11:45:45.894 INFO:tasks.cephfs.mount:check lock on file background_file 2019-11-28T11:45:45.894 INFO:teuthology.orchestra.run.smithi016:> sudo python -c ' 2019-11-28T11:45:45.894 INFO:teuthology.orchestra.run.smithi016:> import fcntl 2019-11-28T11:45:45.894 INFO:teuthology.orchestra.run.smithi016:> import errno 2019-11-28T11:45:45.894 INFO:teuthology.orchestra.run.smithi016:> import struct 2019-11-28T11:45:45.894 INFO:teuthology.orchestra.run.smithi016:> f1 = open("/home/ubuntu/cephtest/mnt.1/background_file-1", '"'"'r'"'"') 2019-11-28T11:45:45.895 INFO:teuthology.orchestra.run.smithi016:> try: 2019-11-28T11:45:45.895 INFO:teuthology.orchestra.run.smithi016:> fcntl.flock(f1, fcntl.LOCK_EX | fcntl.LOCK_NB) 2019-11-28T11:45:45.895 INFO:teuthology.orchestra.run.smithi016:> except IOError, e: 2019-11-28T11:45:45.895 INFO:teuthology.orchestra.run.smithi016:> if e.errno == errno.EAGAIN: 2019-11-28T11:45:45.895 INFO:teuthology.orchestra.run.smithi016:> pass 2019-11-28T11:45:45.895 INFO:teuthology.orchestra.run.smithi016:> else: 2019-11-28T11:45:45.895 INFO:teuthology.orchestra.run.smithi016:> raise RuntimeError("flock on file /home/ubuntu/cephtest/mnt.1/background_file-1 not found") 2019-11-28T11:45:45.895 INFO:teuthology.orchestra.run.smithi016:> f2 = open("/home/ubuntu/cephtest/mnt.1/background_file-2", '"'"'r'"'"') 2019-11-28T11:45:45.896 INFO:teuthology.orchestra.run.smithi016:> try: 2019-11-28T11:45:45.896 INFO:teuthology.orchestra.run.smithi016:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2019-11-28T11:45:45.896 INFO:teuthology.orchestra.run.smithi016:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2019-11-28T11:45:45.896 INFO:teuthology.orchestra.run.smithi016:> except IOError, e: 2019-11-28T11:45:45.896 INFO:teuthology.orchestra.run.smithi016:> if e.errno == errno.EAGAIN: 2019-11-28T11:45:45.896 INFO:teuthology.orchestra.run.smithi016:> pass 2019-11-28T11:45:45.896 INFO:teuthology.orchestra.run.smithi016:> else: 2019-11-28T11:45:45.897 INFO:teuthology.orchestra.run.smithi016:> raise RuntimeError("posix lock on file /home/ubuntu/cephtest/mnt.1/background_file-2 not found") 2019-11-28T11:45:45.897 INFO:teuthology.orchestra.run.smithi016:> ' 2019-11-28T11:45:45.972 INFO:tasks.cephfs.mount:lock_and_release file background_file 2019-11-28T11:45:45.972 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits daemon-helper kill python -c ' 2019-11-28T11:45:45.972 INFO:teuthology.orchestra.run.smithi016:> import time 2019-11-28T11:45:45.972 INFO:teuthology.orchestra.run.smithi016:> import fcntl 2019-11-28T11:45:45.972 INFO:teuthology.orchestra.run.smithi016:> import struct 2019-11-28T11:45:45.972 INFO:teuthology.orchestra.run.smithi016:> f1 = open("/home/ubuntu/cephtest/mnt.1/background_file-1", '"'"'w'"'"') 2019-11-28T11:45:45.973 INFO:teuthology.orchestra.run.smithi016:> fcntl.flock(f1, fcntl.LOCK_EX) 2019-11-28T11:45:45.973 INFO:teuthology.orchestra.run.smithi016:> f2 = open("/home/ubuntu/cephtest/mnt.1/background_file-2", '"'"'w'"'"') 2019-11-28T11:45:45.973 INFO:teuthology.orchestra.run.smithi016:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2019-11-28T11:45:45.973 INFO:teuthology.orchestra.run.smithi016:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2019-11-28T11:45:45.973 INFO:teuthology.orchestra.run.smithi016:> ' 2019-11-28T11:45:48.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:45:48.180 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:45:48.180 INFO:teuthology.orchestra.run.smithi076:> import glob 2019-11-28T11:45:48.181 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:45:48.181 INFO:teuthology.orchestra.run.smithi076:> import json 2019-11-28T11:45:48.181 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:45:48.181 INFO:teuthology.orchestra.run.smithi076:> def get_id_to_dir(): 2019-11-28T11:45:48.181 INFO:teuthology.orchestra.run.smithi076:> result = {} 2019-11-28T11:45:48.181 INFO:teuthology.orchestra.run.smithi076:> for dir in glob.glob("/sys/kernel/debug/ceph/*"): 2019-11-28T11:45:48.181 INFO:teuthology.orchestra.run.smithi076:> mds_sessions_lines = open(os.path.join(dir, "mds_sessions")).readlines() 2019-11-28T11:45:48.182 INFO:teuthology.orchestra.run.smithi076:> client_id = mds_sessions_lines[1].split()[1].strip('"'"'"'"'"') 2019-11-28T11:45:48.182 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:45:48.182 INFO:teuthology.orchestra.run.smithi076:> result[client_id] = dir 2019-11-28T11:45:48.182 INFO:teuthology.orchestra.run.smithi076:> return result 2019-11-28T11:45:48.182 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:45:48.182 INFO:teuthology.orchestra.run.smithi076:> print(json.dumps(get_id_to_dir())) 2019-11-28T11:45:48.182 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:45:48.252 INFO:teuthology.orchestra.run.smithi076.stdout:{"0": "/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client8845"} 2019-11-28T11:45:48.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:45:48.253 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:45:48.253 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:45:48.253 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:45:48.253 INFO:teuthology.orchestra.run.smithi076:> print(open(os.path.join("/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client8845", "mds_sessions")).read()) 2019-11-28T11:45:48.253 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:45:48.322 INFO:teuthology.orchestra.run.smithi076.stdout:global_id 8845 2019-11-28T11:45:48.322 INFO:teuthology.orchestra.run.smithi076.stdout:name "0" 2019-11-28T11:45:48.322 INFO:teuthology.orchestra.run.smithi076.stdout:mds.0 open 2019-11-28T11:45:48.323 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:45:48.323 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:45:48.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.410+0000 7fd043deb700 1 Processor -- start 2019-11-28T11:45:48.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.410+0000 7fd043deb700 1 -- start start 2019-11-28T11:45:48.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.411+0000 7fd043deb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd03c06c0a0 0x7fd03c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:48.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.411+0000 7fd043deb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd03c0734e0 0x7fd03c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:48.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.411+0000 7fd043deb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd03c072360 0x7fd03c0727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:45:48.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.411+0000 7fd043deb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03c06f330 con 0x7fd03c0734e0 2019-11-28T11:45:48.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.411+0000 7fd043deb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03c0706c0 con 0x7fd03c072360 2019-11-28T11:45:48.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.411+0000 7fd043deb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c070a40 con 0x7fd03c06c0a0 2019-11-28T11:45:48.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.411+0000 7fd041b87700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd03c0734e0 0x7fd03c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:48.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.411+0000 7fd041b87700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd03c0734e0 0x7fd03c071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40980/0 (socket says 172.21.15.80:40980) 2019-11-28T11:45:48.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.411+0000 7fd041b87700 1 -- 172.21.15.80:0/3774876163 learned_addr learned my addr 172.21.15.80:0/3774876163 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:48.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.411+0000 7fd042b89700 1 --2- 172.21.15.80:0/3774876163 >> v2:172.21.15.174:3300/0 conn(0x7fd03c072360 0x7fd03c0727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:48.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.411+0000 7fd042388700 1 --2- 172.21.15.80:0/3774876163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd03c06c0a0 0x7fd03c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:48.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.411+0000 7fd041b87700 1 -- 172.21.15.80:0/3774876163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd03c06c0a0 msgr2=0x7fd03c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:48.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.411+0000 7fd041b87700 1 --2- 172.21.15.80:0/3774876163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd03c06c0a0 0x7fd03c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:48.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.411+0000 7fd041b87700 1 -- 172.21.15.80:0/3774876163 >> v2:172.21.15.174:3300/0 conn(0x7fd03c072360 msgr2=0x7fd03c0727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:45:48.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.411+0000 7fd041b87700 1 --2- 172.21.15.80:0/3774876163 >> v2:172.21.15.174:3300/0 conn(0x7fd03c072360 0x7fd03c0727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:48.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.411+0000 7fd041b87700 1 -- 172.21.15.80:0/3774876163 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c06db00 con 0x7fd03c0734e0 2019-11-28T11:45:48.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.412+0000 7fd041b87700 1 --2- 172.21.15.80:0/3774876163 >> v2:172.21.15.80:3300/0 conn(0x7fd03c0734e0 0x7fd03c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd02c00f6c0 tx=0x7fd02c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:48.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.412+0000 7fd041b87700 1 --2- 172.21.15.80:0/3774876163 >> v2:172.21.15.80:3300/0 conn(0x7fd03c0734e0 0x7fd03c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd02c00f6c0 tx=0x7fd02c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:48.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.412+0000 7fd041b87700 1 --2- 172.21.15.80:0/3774876163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c0734e0 0x7fd03c071e20 secure :-1 s=READY pgs=1865 cs=0 l=1 rx=0x7fd02c00f6c0 tx=0x7fd02c00f570).ready entity=mon.0 client_cookie=4b570b82520e2d74 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:48.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.412+0000 7fd041b87700 1 --2- 172.21.15.80:0/3774876163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c0734e0 0x7fd03c071e20 secure :-1 s=THROTTLE_DONE pgs=1865 cs=0 l=1 rx=0x7fd02c00f6c0 tx=0x7fd02c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:48.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.412+0000 7fd041b87700 1 --2- 172.21.15.80:0/3774876163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c0734e0 0x7fd03c071e20 secure :-1 s=THROTTLE_DONE pgs=1865 cs=0 l=1 rx=0x7fd02c00f6c0 tx=0x7fd02c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:48.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.412+0000 7fd041386700 1 -- 172.21.15.80:0/3774876163 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd02c000960 con 0x7fd03c0734e0 2019-11-28T11:45:48.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.412+0000 7fd041b87700 1 --2- 172.21.15.80:0/3774876163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c0734e0 0x7fd03c071e20 secure :-1 s=THROTTLE_DONE pgs=1865 cs=0 l=1 rx=0x7fd02c00f6c0 tx=0x7fd02c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:48.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.412+0000 7fd041386700 1 -- 172.21.15.80:0/3774876163 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02c000c90 con 0x7fd03c0734e0 2019-11-28T11:45:48.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.412+0000 7fd041386700 1 -- 172.21.15.80:0/3774876163 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd02c0013a0 con 0x7fd03c0734e0 2019-11-28T11:45:48.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.412+0000 7fd043deb700 1 -- 172.21.15.80:0/3774876163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c0734e0 msgr2=0x7fd03c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:48.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.412+0000 7fd043deb700 1 --2- 172.21.15.80:0/3774876163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c0734e0 0x7fd03c071e20 secure :-1 s=READY pgs=1865 cs=0 l=1 rx=0x7fd02c00f6c0 tx=0x7fd02c00f570).stop 2019-11-28T11:45:48.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.413+0000 7fd043deb700 1 -- 172.21.15.80:0/3774876163 shutdown_connections 2019-11-28T11:45:48.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.413+0000 7fd043deb700 1 --2- 172.21.15.80:0/3774876163 >> v2:172.21.15.174:3300/0 conn(0x7fd03c072360 0x7fd03c0727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:48.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.413+0000 7fd043deb700 1 --2- 172.21.15.80:0/3774876163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c0734e0 0x7fd03c071e20 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:48.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.413+0000 7fd043deb700 1 --2- 172.21.15.80:0/3774876163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd03c06c0a0 0x7fd03c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:45:48.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.413+0000 7fd043deb700 1 -- 172.21.15.80:0/3774876163 shutdown_connections 2019-11-28T11:45:48.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.413+0000 7fd043deb700 1 -- 172.21.15.80:0/3774876163 wait complete. 2019-11-28T11:45:48.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.413+0000 7fd043deb700 1 -- 172.21.15.80:0/3774876163 >> 172.21.15.80:0/3774876163 conn(0x7fd03c061cf0 msgr2=0x7fd03c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.415+0000 7fd043deb700 1 Processor -- start 2019-11-28T11:45:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.415+0000 7fd043deb700 1 -- start start 2019-11-28T11:45:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd043deb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd03c13e320 0x7fd03c13e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd043deb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd03c12a3c0 0x7fd03c12a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd043deb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd03c139e00 con 0x7fd03c15fdf0 2019-11-28T11:45:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd043deb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03c108820 con 0x7fd03c12a3c0 2019-11-28T11:45:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd043deb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03c108af0 con 0x7fd03c13e320 2019-11-28T11:45:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd042b89700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd03c12a3c0 0x7fd03c12a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd042b89700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd03c12a3c0 0x7fd03c12a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40986/0 (socket says 172.21.15.80:40986) 2019-11-28T11:45:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd042b89700 1 -- 172.21.15.80:0/741146418 learned_addr learned my addr 172.21.15.80:0/741146418 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:45:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd041b87700 1 --2- 172.21.15.80:0/741146418 >> v2:172.21.15.174:3300/0 conn(0x7fd03c13e320 0x7fd03c13e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:48.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd042b89700 1 -- 172.21.15.80:0/741146418 >> v2:172.21.15.174:3300/0 conn(0x7fd03c13e320 msgr2=0x7fd03c13e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:48.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd042b89700 1 --2- 172.21.15.80:0/741146418 >> v2:172.21.15.174:3300/0 conn(0x7fd03c13e320 0x7fd03c13e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:48.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd042b89700 1 -- 172.21.15.80:0/741146418 >> v1:172.21.15.174:6789/0 conn(0x7fd03c15fdf0 legacy=0x7fd03c12b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:48.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd042b89700 1 -- 172.21.15.80:0/741146418 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c10a8c0 con 0x7fd03c12a3c0 2019-11-28T11:45:48.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd041b87700 1 --2- 172.21.15.80:0/741146418 >> v2:172.21.15.174:3300/0 conn(0x7fd03c13e320 0x7fd03c13e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:45:48.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd042b89700 1 --2- 172.21.15.80:0/741146418 >> v2:172.21.15.80:3300/0 conn(0x7fd03c12a3c0 0x7fd03c12a820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0340107d0 tx=0x7fd034010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:48.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd042b89700 1 --2- 172.21.15.80:0/741146418 >> v2:172.21.15.80:3300/0 conn(0x7fd03c12a3c0 0x7fd03c12a820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0340107d0 tx=0x7fd034010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:48.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.416+0000 7fd042b89700 1 --2- 172.21.15.80:0/741146418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c12a3c0 0x7fd03c12a820 secure :-1 s=READY pgs=1866 cs=0 l=1 rx=0x7fd0340107d0 tx=0x7fd034010b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:48.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.417+0000 7fd042b89700 1 --2- 172.21.15.80:0/741146418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c12a3c0 0x7fd03c12a820 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7fd0340107d0 tx=0x7fd034010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:48.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.417+0000 7fd042b89700 1 --2- 172.21.15.80:0/741146418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c12a3c0 0x7fd03c12a820 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7fd0340107d0 tx=0x7fd034010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:48.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.417+0000 7fd042b89700 1 --2- 172.21.15.80:0/741146418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c12a3c0 0x7fd03c12a820 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7fd0340107d0 tx=0x7fd034010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:48.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.417+0000 7fd032ffd700 1 -- 172.21.15.80:0/741146418 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd034000e90 con 0x7fd03c12a3c0 2019-11-28T11:45:48.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.417+0000 7fd032ffd700 1 -- 172.21.15.80:0/741146418 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03400f2c0 con 0x7fd03c12a3c0 2019-11-28T11:45:48.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.417+0000 7fd043deb700 1 -- 172.21.15.80:0/741146418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd03c10a8c0 con 0x7fd03c12a3c0 2019-11-28T11:45:48.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.417+0000 7fd032ffd700 1 -- 172.21.15.80:0/741146418 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd03400f990 con 0x7fd03c12a3c0 2019-11-28T11:45:48.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.417+0000 7fd043deb700 1 -- 172.21.15.80:0/741146418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03c10a8c0 con 0x7fd03c12a3c0 2019-11-28T11:45:48.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.417+0000 7fd042b89700 1 --2- 172.21.15.80:0/741146418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c12a3c0 0x7fd03c12a820 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7fd0340107d0 tx=0x7fd034010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:48.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.417+0000 7fd032ffd700 1 -- 172.21.15.80:0/741146418 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd034000df0 con 0x7fd03c12a3c0 2019-11-28T11:45:48.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.417+0000 7fd042b89700 1 --2- 172.21.15.80:0/741146418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c12a3c0 0x7fd03c12a820 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7fd0340107d0 tx=0x7fd034010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:48.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.417+0000 7fd032ffd700 1 --2- 172.21.15.80:0/741146418 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd024018730 0x7fd02401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:45:48.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.417+0000 7fd032ffd700 1 -- 172.21.15.80:0/741146418 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd034031e40 con 0x7fd03c12a3c0 2019-11-28T11:45:48.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.418+0000 7fd042388700 1 --2- 172.21.15.80:0/741146418 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd024018730 0x7fd02401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:45:48.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.418+0000 7fd042388700 1 --2- 172.21.15.80:0/741146418 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd024018730 0x7fd02401abc0 crc :-1 s=READY pgs=756 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:45:48.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.425+0000 7fd043deb700 1 -- 172.21.15.80:0/741146418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03c109180 con 0x7fd03c12a3c0 2019-11-28T11:45:48.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.429+0000 7fd042b89700 1 --2- 172.21.15.80:0/741146418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c12a3c0 0x7fd03c12a820 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7fd0340107d0 tx=0x7fd034010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:48.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.429+0000 7fd032ffd700 1 -- 172.21.15.80:0/741146418 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd03400ee00 con 0x7fd03c12a3c0 2019-11-28T11:45:48.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.602+0000 7fd043deb700 1 -- 172.21.15.80:0/741146418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd03c109500 con 0x7fd03c12a3c0 2019-11-28T11:45:48.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.603+0000 7fd042b89700 1 --2- 172.21.15.80:0/741146418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c12a3c0 0x7fd03c12a820 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7fd0340107d0 tx=0x7fd034010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:45:48.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.603+0000 7fd032ffd700 1 -- 172.21.15.80:0/741146418 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+2455 (secure 0 0 0) 0x7fd034000df0 con 0x7fd03c12a3c0 2019-11-28T11:45:48.645 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 107 2019-11-28T11:45:48.645 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:45:48.645 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":107,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/3312817459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3312817459},{"type":"v1","addr":"172.21.15.174:6835","nonce":3312817459}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":106},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3089980665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3089980665},{"type":"v1","addr":"172.21.15.80:6834","nonce":3089980665}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":106}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:30.152127+0000","modified":"2019-11-28T11:45:37.708419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8752},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8752":{"gid":8752,"name":"b","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6835/1912693207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1912693207},{"type":"v1","addr":"172.21.15.80:6835","nonce":1912693207}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2019-11-28T11:45:48.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.605+0000 7fd043deb700 1 -- 172.21.15.80:0/741146418 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd024018730 msgr2=0x7fd02401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:48.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.605+0000 7fd043deb700 1 --2- 172.21.15.80:0/741146418 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd024018730 0x7fd02401abc0 crc :-1 s=READY pgs=756 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:48.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.605+0000 7fd043deb700 1 -- 172.21.15.80:0/741146418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c12a3c0 msgr2=0x7fd03c12a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:45:48.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.605+0000 7fd043deb700 1 --2- 172.21.15.80:0/741146418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c12a3c0 0x7fd03c12a820 secure :-1 s=READY pgs=1866 cs=0 l=1 rx=0x7fd0340107d0 tx=0x7fd034010b70).stop 2019-11-28T11:45:48.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.605+0000 7fd043deb700 1 -- 172.21.15.80:0/741146418 shutdown_connections 2019-11-28T11:45:48.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.605+0000 7fd043deb700 1 --2- 172.21.15.80:0/741146418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd03c12a3c0 0x7fd03c12a820 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:48.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.605+0000 7fd043deb700 1 --2- 172.21.15.80:0/741146418 >> v2:172.21.15.174:3300/0 conn(0x7fd03c13e320 0x7fd03c13e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:48.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.605+0000 7fd043deb700 1 --2- 172.21.15.80:0/741146418 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd024018730 0x7fd02401abc0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:45:48.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.605+0000 7fd043deb700 1 -- 172.21.15.80:0/741146418 shutdown_connections 2019-11-28T11:45:48.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.605+0000 7fd043deb700 1 -- 172.21.15.80:0/741146418 wait complete. 2019-11-28T11:45:48.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:45:48.605+0000 7fd043deb700 1 -- 172.21.15.80:0/741146418 >> 172.21.15.80:0/741146418 conn(0x7fd03c127dc0 msgr2=0x7fd03c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:45:48.656 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok session evict 8845 2019-11-28T11:45:49.394 INFO:tasks.cephfs.filesystem:_json_asok output: 2019-11-28T11:45:49.464 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s 2019-11-28T11:45:49.520 INFO:teuthology.orchestra.console:Performing hard reset of smithi076 2019-11-28T11:45:49.520 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power reset 2019-11-28T11:45:49.572 INFO:teuthology.orchestra.console:Hard reset for smithi076 completed 2019-11-28T11:46:14.826 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:46:14.830 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:46:14.836 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:46:19.674 INFO:teuthology.misc:Re-opening connections... 2019-11-28T11:46:19.675 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:46:19.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:46:19.678 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:46:19.698 DEBUG:tasks.ceph:Missed logrotate, EOFError 2019-11-28T11:46:29.944 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:46:29.945 DEBUG:teuthology.misc:waited 10.2700021267 2019-11-28T11:46:30.945 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:46:30.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:46:30.946 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:46:34.027 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:46:34.027 DEBUG:teuthology.misc:waited 14.3524940014 2019-11-28T11:46:35.028 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:46:35.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:46:35.029 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:46:37.080 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:46:37.081 DEBUG:teuthology.misc:waited 17.4058439732 2019-11-28T11:46:38.081 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:46:38.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:46:38.082 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:46:40.156 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:46:40.157 DEBUG:teuthology.misc:waited 20.4819560051 2019-11-28T11:46:41.158 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:46:41.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:46:41.159 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:46:43.228 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:46:43.229 DEBUG:teuthology.misc:waited 23.5537691116 2019-11-28T11:46:44.230 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:46:44.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:46:44.231 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:46:46.297 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:46:46.298 DEBUG:teuthology.misc:waited 26.6228821278 2019-11-28T11:46:47.299 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:46:47.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:46:47.299 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:46:49.372 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:46:49.373 DEBUG:teuthology.misc:waited 29.6979191303 2019-11-28T11:46:49.699 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:46:49.704 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:46:49.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:46:49.711 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:46:50.374 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:46:50.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:46:50.375 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:46:52.445 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:46:52.448 DEBUG:tasks.ceph:Missed logrotate, node 'smithi076' is offline 2019-11-28T11:46:52.448 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:46:52.449 DEBUG:teuthology.misc:waited 32.774271965 2019-11-28T11:46:53.450 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:46:53.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:46:53.451 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:46:55.516 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:46:55.518 DEBUG:teuthology.misc:waited 35.8429780006 2019-11-28T11:46:56.520 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:46:56.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:46:56.521 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:46:58.584 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:46:58.585 DEBUG:teuthology.misc:waited 38.9098520279 2019-11-28T11:46:59.586 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:46:59.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:46:59.587 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:47:01.656 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:47:01.657 DEBUG:teuthology.misc:waited 41.9817650318 2019-11-28T11:47:02.658 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:47:02.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:47:02.658 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:47:04.732 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:47:04.733 DEBUG:teuthology.misc:waited 45.0579390526 2019-11-28T11:47:05.738 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:47:05.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:47:05.739 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:47:07.800 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:47:07.801 DEBUG:teuthology.misc:waited 48.1258299351 2019-11-28T11:47:08.801 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:47:08.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:47:08.802 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:47:10.876 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:47:10.877 DEBUG:teuthology.misc:waited 51.2018361092 2019-11-28T11:47:11.877 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:47:11.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:47:11.878 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:47:13.944 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:47:13.945 DEBUG:teuthology.misc:waited 54.2698230743 2019-11-28T11:47:14.946 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:47:14.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:47:14.947 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:47:17.020 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:47:17.020 DEBUG:teuthology.misc:waited 57.3453850746 2019-11-28T11:47:18.021 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:47:18.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:47:18.022 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:47:22.449 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:47:22.453 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:47:22.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:47:22.459 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:47:54.151 INFO:teuthology.orchestra.run.smithi076:> true 2019-11-28T11:47:54.635 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:47:54.639 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:47:54.644 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:47:54.648 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:48:18.024 DEBUG:teuthology.orchestra.remote:timed out 2019-11-28T11:48:18.024 DEBUG:teuthology.misc:waited 118.349199057 2019-11-28T11:48:19.025 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:48:19.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:48:19.028 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:48:19.132 INFO:teuthology.orchestra.run.smithi076:> true 2019-11-28T11:48:19.480 DEBUG:teuthology.misc:waited 119.805599928 2019-11-28T11:48:20.481 INFO:teuthology.orchestra.run:Running command with timeout 10 2019-11-28T11:48:20.482 INFO:teuthology.orchestra.run.smithi076:> uptime 2019-11-28T11:48:20.553 INFO:teuthology.orchestra.run.smithi076.stdout: 11:48:20 up 0 min, 0 users, load average: 0.39, 0.11, 0.04 2019-11-28T11:48:20.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:48:20.553 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:48:20.827 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:48:20.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.915+0000 7f64b4654700 1 Processor -- start 2019-11-28T11:48:20.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.915+0000 7f64b4654700 1 -- start start 2019-11-28T11:48:20.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.916+0000 7f64b4654700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f64ac06c0a0 0x7f64ac072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:20.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.916+0000 7f64b4654700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac0734e0 0x7f64ac071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:20.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.916+0000 7f64b4654700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac06db00 con 0x7f64ac072360 2019-11-28T11:48:20.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.916+0000 7f64b4654700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ac06fd60 con 0x7f64ac06c0a0 2019-11-28T11:48:20.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.916+0000 7f64b4654700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac070030 con 0x7f64ac0734e0 2019-11-28T11:48:20.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b2bf1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f64ac06c0a0 0x7f64ac072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:20.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b2bf1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f64ac06c0a0 0x7f64ac072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40992/0 (socket says 172.21.15.80:40992) 2019-11-28T11:48:20.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b2bf1700 1 -- 172.21.15.80:0/267603309 learned_addr learned my addr 172.21.15.80:0/267603309 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:20.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b23f0700 1 --2- 172.21.15.80:0/267603309 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac0734e0 0x7f64ac071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:20.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b2bf1700 1 -- 172.21.15.80:0/267603309 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac0734e0 msgr2=0x7f64ac071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b2bf1700 1 --2- 172.21.15.80:0/267603309 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac0734e0 0x7f64ac071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b2bf1700 1 -- 172.21.15.80:0/267603309 >> v1:172.21.15.174:6789/0 conn(0x7f64ac072360 legacy=0x7f64ac06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b2bf1700 1 -- 172.21.15.80:0/267603309 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac0706c0 con 0x7f64ac06c0a0 2019-11-28T11:48:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b2bf1700 1 --2- 172.21.15.80:0/267603309 >> v2:172.21.15.80:3300/0 conn(0x7f64ac06c0a0 0x7f64ac072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f649c00f6c0 tx=0x7f649c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b2bf1700 1 --2- 172.21.15.80:0/267603309 >> v2:172.21.15.80:3300/0 conn(0x7f64ac06c0a0 0x7f64ac072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f649c00f6c0 tx=0x7f649c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b2bf1700 1 --2- 172.21.15.80:0/267603309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64ac06c0a0 0x7f64ac072fa0 secure :-1 s=READY pgs=1867 cs=0 l=1 rx=0x7f649c00f6c0 tx=0x7f649c00fa60).ready entity=mon.0 client_cookie=4100bbe62a5e4bc2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b2bf1700 1 --2- 172.21.15.80:0/267603309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64ac06c0a0 0x7f64ac072fa0 secure :-1 s=THROTTLE_DONE pgs=1867 cs=0 l=1 rx=0x7f649c00f6c0 tx=0x7f649c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:20.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b1bef700 1 -- 172.21.15.80:0/267603309 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f649c000960 con 0x7f64ac06c0a0 2019-11-28T11:48:20.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b2bf1700 1 --2- 172.21.15.80:0/267603309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64ac06c0a0 0x7f64ac072fa0 secure :-1 s=THROTTLE_DONE pgs=1867 cs=0 l=1 rx=0x7f649c00f6c0 tx=0x7f649c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:20.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b2bf1700 1 --2- 172.21.15.80:0/267603309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64ac06c0a0 0x7f64ac072fa0 secure :-1 s=THROTTLE_DONE pgs=1867 cs=0 l=1 rx=0x7f649c00f6c0 tx=0x7f649c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:20.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b1bef700 1 -- 172.21.15.80:0/267603309 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649c000c90 con 0x7f64ac06c0a0 2019-11-28T11:48:20.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b1bef700 1 -- 172.21.15.80:0/267603309 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f649c0013a0 con 0x7f64ac06c0a0 2019-11-28T11:48:20.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b4654700 1 -- 172.21.15.80:0/267603309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64ac06c0a0 msgr2=0x7f64ac072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:20.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.917+0000 7f64b4654700 1 --2- 172.21.15.80:0/267603309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64ac06c0a0 0x7f64ac072fa0 secure :-1 s=READY pgs=1867 cs=0 l=1 rx=0x7f649c00f6c0 tx=0x7f649c00fa60).stop 2019-11-28T11:48:20.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.918+0000 7f64b4654700 1 -- 172.21.15.80:0/267603309 shutdown_connections 2019-11-28T11:48:20.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.918+0000 7f64b4654700 1 --2- 172.21.15.80:0/267603309 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac0734e0 0x7f64ac071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:20.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.918+0000 7f64b4654700 1 --2- 172.21.15.80:0/267603309 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f64ac06c0a0 0x7f64ac072fa0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:20.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.918+0000 7f64b4654700 1 -- 172.21.15.80:0/267603309 shutdown_connections 2019-11-28T11:48:20.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.918+0000 7f64b4654700 1 -- 172.21.15.80:0/267603309 wait complete. 2019-11-28T11:48:20.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.918+0000 7f64b4654700 1 -- 172.21.15.80:0/267603309 >> 172.21.15.80:0/267603309 conn(0x7f64ac061cf0 msgr2=0x7f64ac064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:20.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.921+0000 7f64b4654700 1 Processor -- start 2019-11-28T11:48:20.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.921+0000 7f64b4654700 1 -- start start 2019-11-28T11:48:20.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.922+0000 7f64b4654700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f64ac159850 0x7f64ac159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:20.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.922+0000 7f64b4654700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac15a220 0x7f64ac12a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:20.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.922+0000 7f64b4654700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac13dd80 con 0x7f64ac143180 2019-11-28T11:48:20.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.922+0000 7f64b4654700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ac15c2e0 con 0x7f64ac159850 2019-11-28T11:48:20.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.922+0000 7f64b4654700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac15c5b0 con 0x7f64ac15a220 2019-11-28T11:48:20.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.922+0000 7f64b2bf1700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f64ac143180 0x7f64ac15a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:55858/0 (socket says 172.21.15.80:55858) 2019-11-28T11:48:20.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.922+0000 7f64b2bf1700 1 -- 172.21.15.80:0/4163815162 learned_addr learned my addr 172.21.15.80:0/4163815162 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:20.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.922+0000 7f64b23f0700 1 --2- 172.21.15.80:0/4163815162 >> v2:172.21.15.174:3300/0 conn(0x7f64ac159850 0x7f64ac159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:20.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.922+0000 7f64b33f2700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac15a220 0x7f64ac12a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:20.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64b33f2700 1 -- 172.21.15.80:0/4163815162 >> v2:172.21.15.174:3300/0 conn(0x7f64ac159850 msgr2=0x7f64ac159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:20.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64b33f2700 1 --2- 172.21.15.80:0/4163815162 >> v2:172.21.15.174:3300/0 conn(0x7f64ac159850 0x7f64ac159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:20.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64b33f2700 1 -- 172.21.15.80:0/4163815162 >> v1:172.21.15.174:6789/0 conn(0x7f64ac143180 legacy=0x7f64ac15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:20.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64ab7fe700 1 -- 172.21.15.80:0/4163815162 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28029417 0 0) 0x7f649c008160 con 0x7f64ac143180 2019-11-28T11:48:20.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64b33f2700 1 -- 172.21.15.80:0/4163815162 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac15cc40 con 0x7f64ac15a220 2019-11-28T11:48:20.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64b23f0700 1 --2- 172.21.15.80:0/4163815162 >> v2:172.21.15.174:3300/0 conn(0x7f64ac159850 0x7f64ac159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:48:20.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64b33f2700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac15a220 0x7f64ac12a9d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f64a4010720 tx=0x7f64a4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:20.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64b33f2700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac15a220 0x7f64ac12a9d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f64a4010720 tx=0x7f64a4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:20.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64b33f2700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac15a220 0x7f64ac12a9d0 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7f64a4010720 tx=0x7f64a4010ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:20.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64b33f2700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac15a220 0x7f64ac12a9d0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f64a4010720 tx=0x7f64a4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:20.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64ab7fe700 1 -- 172.21.15.80:0/4163815162 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a4009f40 con 0x7f64ac15a220 2019-11-28T11:48:20.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64b33f2700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac15a220 0x7f64ac12a9d0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f64a4010720 tx=0x7f64a4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:20.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64b4654700 1 -- 172.21.15.80:0/4163815162 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac15cfc0 con 0x7f64ac15a220 2019-11-28T11:48:20.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64ab7fe700 1 -- 172.21.15.80:0/4163815162 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a4009c00 con 0x7f64ac15a220 2019-11-28T11:48:20.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64b33f2700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac15a220 0x7f64ac12a9d0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f64a4010720 tx=0x7f64a4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:20.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64ab7fe700 1 -- 172.21.15.80:0/4163815162 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a400a3b0 con 0x7f64ac15a220 2019-11-28T11:48:20.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64b4654700 1 -- 172.21.15.80:0/4163815162 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac15cc40 con 0x7f64ac15a220 2019-11-28T11:48:20.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.923+0000 7f64b33f2700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac15a220 0x7f64ac12a9d0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f64a4010720 tx=0x7f64a4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:20.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.924+0000 7f64ab7fe700 1 -- 172.21.15.80:0/4163815162 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f64a4009e90 con 0x7f64ac15a220 2019-11-28T11:48:20.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.924+0000 7f64b33f2700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac15a220 0x7f64ac12a9d0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f64a4010720 tx=0x7f64a4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:20.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.924+0000 7f64ab7fe700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f648c018730 0x7f648c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:20.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.924+0000 7f64ab7fe700 1 -- 172.21.15.80:0/4163815162 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f64a4031d80 con 0x7f64ac15a220 2019-11-28T11:48:20.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.924+0000 7f64b2bf1700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f648c018730 0x7f648c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:20.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.924+0000 7f64b2bf1700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f648c018730 0x7f648c01abc0 crc :-1 s=READY pgs=757 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:20.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.931+0000 7f64b4654700 1 -- 172.21.15.80:0/4163815162 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ac15cfc0 con 0x7f64ac15a220 2019-11-28T11:48:20.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.935+0000 7f64b33f2700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac15a220 0x7f64ac12a9d0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f64a4010720 tx=0x7f64a4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:20.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:20.935+0000 7f64ab7fe700 1 -- 172.21.15.80:0/4163815162 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f64a4009950 con 0x7f64ac15a220 2019-11-28T11:48:21.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.112+0000 7f64b4654700 1 -- 172.21.15.80:0/4163815162 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64ac15cc40 con 0x7f64ac15a220 2019-11-28T11:48:21.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.113+0000 7f64b33f2700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac15a220 0x7f64ac12a9d0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f64a4010720 tx=0x7f64a4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.113+0000 7f64ab7fe700 1 -- 172.21.15.80:0/4163815162 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+14932 (secure 0 0 0) 0x7f64a4009950 con 0x7f64ac15a220 2019-11-28T11:48:21.161 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:21.161 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":142,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:45:49.335097+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:45:28.436380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2019-11-28T11:45:29.126890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.76:0/1490899080":"2019-11-28T12:45:48.743920+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:48:21.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.117+0000 7f64b4654700 1 -- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f648c018730 msgr2=0x7f648c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.117+0000 7f64b4654700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f648c018730 0x7f648c01abc0 crc :-1 s=READY pgs=757 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.117+0000 7f64b4654700 1 -- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac15a220 msgr2=0x7f64ac12a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.117+0000 7f64b4654700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac15a220 0x7f64ac12a9d0 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7f64a4010720 tx=0x7f64a4010ac0).stop 2019-11-28T11:48:21.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.117+0000 7f64b4654700 1 -- 172.21.15.80:0/4163815162 shutdown_connections 2019-11-28T11:48:21.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.117+0000 7f64b4654700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64ac15a220 0x7f64ac12a9d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.117+0000 7f64b4654700 1 --2- 172.21.15.80:0/4163815162 >> v2:172.21.15.174:3300/0 conn(0x7f64ac159850 0x7f64ac159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.117+0000 7f64b4654700 1 --2- 172.21.15.80:0/4163815162 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f648c018730 0x7f648c01abc0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.118+0000 7f64b4654700 1 -- 172.21.15.80:0/4163815162 shutdown_connections 2019-11-28T11:48:21.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.118+0000 7f64b4654700 1 -- 172.21.15.80:0/4163815162 wait complete. 2019-11-28T11:48:21.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.118+0000 7f64b4654700 1 -- 172.21.15.80:0/4163815162 >> 172.21.15.80:0/4163815162 conn(0x7f64ac13d620 msgr2=0x7f64ac140470 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:21.174 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:45:28.436380+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 22, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'140', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:45:29.126890+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 23, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'141', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:48:21.175 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:48:21.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.253+0000 7fc3406e3700 1 Processor -- start 2019-11-28T11:48:21.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.253+0000 7fc3406e3700 1 -- start start 2019-11-28T11:48:21.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.254+0000 7fc3406e3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3381639f0 0x7fc338165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:21.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.254+0000 7fc3406e3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33806db60 con 0x7fc33815ed10 2019-11-28T11:48:21.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.254+0000 7fc3406e3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33806e060 con 0x7fc33815f100 2019-11-28T11:48:21.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.254+0000 7fc3406e3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33806fe00 con 0x7fc3381639f0 2019-11-28T11:48:21.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.254+0000 7fc33ec80700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc33815ed10 0x7fc338073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40322/0 (socket says 172.21.15.80:40322) 2019-11-28T11:48:21.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.254+0000 7fc33ec80700 1 -- 172.21.15.80:0/2902309180 learned_addr learned my addr 172.21.15.80:0/2902309180 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:21.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.254+0000 7fc33f481700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3381639f0 0x7fc338165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.254+0000 7fc33dc7e700 1 -- 172.21.15.80:0/2902309180 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505650249 0 0) 0x7fc3200014d0 con 0x7fc33815ed10 2019-11-28T11:48:21.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.254+0000 7fc33dc7e700 1 -- 172.21.15.80:0/2902309180 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc324002e80 con 0x7fc33815ed10 2019-11-28T11:48:21.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 -- 172.21.15.80:0/2902309180 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734118171 0 0) 0x7fc328001080 con 0x7fc33815f100 2019-11-28T11:48:21.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 -- 172.21.15.80:0/2902309180 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3240030b0 con 0x7fc33815f100 2019-11-28T11:48:21.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 -- 172.21.15.80:0/2902309180 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3313734845 0 0) 0x7fc3200014b0 con 0x7fc33815ed10 2019-11-28T11:48:21.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 -- 172.21.15.80:0/2902309180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3381639f0 msgr2=0x7fc338165df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:21.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3381639f0 0x7fc338165df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:21.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 -- 172.21.15.80:0/2902309180 >> v1:172.21.15.174:6789/0 conn(0x7fc33815f100 legacy=0x7fc33806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 -- 172.21.15.80:0/2902309180 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338070760 con 0x7fc33815ed10 2019-11-28T11:48:21.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 -- 172.21.15.80:0/2902309180 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc320001a40 con 0x7fc33815ed10 2019-11-28T11:48:21.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 -- 172.21.15.80:0/2902309180 >> v1:172.21.15.80:6789/0 conn(0x7fc33815ed10 legacy=0x7fc338073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc324003b80 0x7fc324005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:21.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3240066d0 0x7fc324008b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:21.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33ec80700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc324003b80 0x7fc324005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc32404d3a0 0x7fc32404f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:21.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 -- 172.21.15.80:0/2902309180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32404fff0 con 0x7fc324003b80 2019-11-28T11:48:21.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 -- 172.21.15.80:0/2902309180 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3240501e0 con 0x7fc3240066d0 2019-11-28T11:48:21.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 -- 172.21.15.80:0/2902309180 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc324050410 con 0x7fc32404d3a0 2019-11-28T11:48:21.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33e47f700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3240066d0 0x7fc324008b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33f481700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc32404d3a0 0x7fc32404f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33ec80700 1 -- 172.21.15.80:0/2902309180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc32404d3a0 msgr2=0x7fc32404f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:21.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33ec80700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc32404d3a0 0x7fc32404f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:21.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33ec80700 1 -- 172.21.15.80:0/2902309180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3240066d0 msgr2=0x7fc324008b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:21.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33ec80700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3240066d0 0x7fc324008b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:21.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33ec80700 1 -- 172.21.15.80:0/2902309180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3240506c0 con 0x7fc324003b80 2019-11-28T11:48:21.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33f481700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc32404d3a0 0x7fc32404f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:48:21.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33e47f700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3240066d0 0x7fc324008b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:48:21.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33ec80700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc324003b80 0x7fc324005fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc32000fc90 tx=0x7fc320010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33ec80700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc324003b80 0x7fc324005fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc32000fc90 tx=0x7fc320010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33ec80700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc324003b80 0x7fc324005fe0 secure :-1 s=READY pgs=1869 cs=0 l=1 rx=0x7fc32000fc90 tx=0x7fc320010030).ready entity=mon.0 client_cookie=53b52b0ee7687bcc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:21.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33ec80700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc324003b80 0x7fc324005fe0 secure :-1 s=THROTTLE_DONE pgs=1869 cs=0 l=1 rx=0x7fc32000fc90 tx=0x7fc320010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 -- 172.21.15.80:0/2902309180 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3200014b0 con 0x7fc324003b80 2019-11-28T11:48:21.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33ec80700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc324003b80 0x7fc324005fe0 secure :-1 s=THROTTLE_DONE pgs=1869 cs=0 l=1 rx=0x7fc32000fc90 tx=0x7fc320010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33ec80700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc324003b80 0x7fc324005fe0 secure :-1 s=THROTTLE_DONE pgs=1869 cs=0 l=1 rx=0x7fc32000fc90 tx=0x7fc320010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 -- 172.21.15.80:0/2902309180 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3200047b0 con 0x7fc324003b80 2019-11-28T11:48:21.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33dc7e700 1 -- 172.21.15.80:0/2902309180 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3200049a0 con 0x7fc324003b80 2019-11-28T11:48:21.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc3406e3700 1 -- 172.21.15.80:0/2902309180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc324003b80 msgr2=0x7fc324005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc3406e3700 1 --2- 172.21.15.80:0/2902309180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc324003b80 0x7fc324005fe0 secure :-1 s=READY pgs=1869 cs=0 l=1 rx=0x7fc32000fc90 tx=0x7fc320010030).stop 2019-11-28T11:48:21.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.255+0000 7fc33f481700 1 -- 172.21.15.80:0/2902309180 reap_dead start 2019-11-28T11:48:21.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.256+0000 7fc3406e3700 1 -- 172.21.15.80:0/2902309180 shutdown_connections 2019-11-28T11:48:21.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.256+0000 7fc3406e3700 1 -- 172.21.15.80:0/2902309180 shutdown_connections 2019-11-28T11:48:21.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.256+0000 7fc3406e3700 1 -- 172.21.15.80:0/2902309180 wait complete. 2019-11-28T11:48:21.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.256+0000 7fc3406e3700 1 -- 172.21.15.80:0/2902309180 >> 172.21.15.80:0/2902309180 conn(0x7fc338061d20 msgr2=0x7fc3380641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:21.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.259+0000 7fc3406e3700 1 Processor -- start 2019-11-28T11:48:21.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.259+0000 7fc3406e3700 1 -- start start 2019-11-28T11:48:21.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3406e3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc338166d70 0x7fc338169170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:21.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3406e3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc338133a20 con 0x7fc3381502e0 2019-11-28T11:48:21.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3406e3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc338109fc0 con 0x7fc338108630 2019-11-28T11:48:21.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3406e3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc338131980 con 0x7fc338166d70 2019-11-28T11:48:21.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc33e47f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc3381502e0 0x7fc338150770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40336/0 (socket says 172.21.15.80:40336) 2019-11-28T11:48:21.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc33e47f700 1 -- 172.21.15.80:0/3613012985 learned_addr learned my addr 172.21.15.80:0/3613012985 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:21.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc33f481700 1 --2- 172.21.15.80:0/3613012985 >> v2:172.21.15.174:3300/0 conn(0x7fc338166d70 0x7fc338169170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003724571 0 0) 0x7fc328009620 con 0x7fc3381502e0 2019-11-28T11:48:21.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc31c002e80 con 0x7fc3381502e0 2019-11-28T11:48:21.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 344378420 0 0) 0x7fc328000eb0 con 0x7fc3381502e0 2019-11-28T11:48:21.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc31c0032e0 con 0x7fc3381502e0 2019-11-28T11:48:21.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc328001250 con 0x7fc3381502e0 2019-11-28T11:48:21.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 >> v2:172.21.15.174:3300/0 conn(0x7fc338166d70 msgr2=0x7fc338169170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3377fe700 1 --2- 172.21.15.80:0/3613012985 >> v2:172.21.15.174:3300/0 conn(0x7fc338166d70 0x7fc338169170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 >> v1:172.21.15.174:6789/0 conn(0x7fc338108630 legacy=0x7fc338151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 >> v1:172.21.15.80:6789/0 conn(0x7fc3381502e0 legacy=0x7fc338150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3377fe700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc31c0036f0 0x7fc31c003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:21.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3377fe700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc31c004060 0x7fc31c0044e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:21.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3377fe700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc31c004b40 0x7fc31c00b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:21.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c005270 con 0x7fc31c0036f0 2019-11-28T11:48:21.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c00bf20 con 0x7fc31c004b40 2019-11-28T11:48:21.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c00c0e0 con 0x7fc31c004060 2019-11-28T11:48:21.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc33f481700 1 --2- 172.21.15.80:0/3613012985 >> v2:172.21.15.174:3300/0 conn(0x7fc338166d70 0x7fc338169170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:48:21.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc33ec80700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc31c0036f0 0x7fc31c003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc33e47f700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc31c004060 0x7fc31c0044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.260+0000 7fc33f481700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc31c004b40 0x7fc31c00b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc33ec80700 1 -- 172.21.15.80:0/3613012985 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc31c004060 msgr2=0x7fc31c0044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc33ec80700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc31c004060 0x7fc31c0044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc33ec80700 1 -- 172.21.15.80:0/3613012985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc31c004b40 msgr2=0x7fc31c00b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc33ec80700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc31c004b40 0x7fc31c00b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc33f481700 1 -- 172.21.15.80:0/3613012985 reap_dead start 2019-11-28T11:48:21.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc33ec80700 1 -- 172.21.15.80:0/3613012985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c00c390 con 0x7fc31c0036f0 2019-11-28T11:48:21.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc33e47f700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc31c004060 0x7fc31c0044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:48:21.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc3406e3700 1 -- 172.21.15.80:0/3613012985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc338132660 con 0x7fc31c0036f0 2019-11-28T11:48:21.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc33ec80700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc31c0036f0 0x7fc31c003b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc320010710 tx=0x7fc3200105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc3406e3700 1 -- 172.21.15.80:0/3613012985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3381322e0 con 0x7fc31c0036f0 2019-11-28T11:48:21.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc33ec80700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc31c0036f0 0x7fc31c003b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc320010710 tx=0x7fc3200105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc33ec80700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc31c0036f0 0x7fc31c003b20 secure :-1 s=READY pgs=1871 cs=0 l=1 rx=0x7fc320010710 tx=0x7fc3200105c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:21.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc33ec80700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc31c0036f0 0x7fc31c003b20 secure :-1 s=THROTTLE_DONE pgs=1871 cs=0 l=1 rx=0x7fc320010710 tx=0x7fc3200105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc320002040 con 0x7fc31c0036f0 2019-11-28T11:48:21.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc33ec80700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc31c0036f0 0x7fc31c003b20 secure :-1 s=THROTTLE_DONE pgs=1871 cs=0 l=1 rx=0x7fc320010710 tx=0x7fc3200105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc33ec80700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc31c0036f0 0x7fc31c003b20 secure :-1 s=THROTTLE_DONE pgs=1871 cs=0 l=1 rx=0x7fc320010710 tx=0x7fc3200105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3200045c0 con 0x7fc31c0036f0 2019-11-28T11:48:21.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc320004c90 con 0x7fc31c0036f0 2019-11-28T11:48:21.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc33ec80700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc31c0036f0 0x7fc31c003b20 secure :-1 s=THROTTLE_DONE pgs=1871 cs=0 l=1 rx=0x7fc320010710 tx=0x7fc3200105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc3200047b0 con 0x7fc31c0036f0 2019-11-28T11:48:21.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.261+0000 7fc33ec80700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc31c0036f0 0x7fc31c003b20 secure :-1 s=THROTTLE_DONE pgs=1871 cs=0 l=1 rx=0x7fc320010710 tx=0x7fc3200105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.262+0000 7fc3377fe700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc31c01b490 0x7fc31c01d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:21.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.262+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fc320031eb0 con 0x7fc31c0036f0 2019-11-28T11:48:21.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.262+0000 7fc33e47f700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc31c01b490 0x7fc31c01d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.262+0000 7fc33e47f700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc31c01b490 0x7fc31c01d8e0 crc :-1 s=READY pgs=758 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:21.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.268+0000 7fc3406e3700 1 -- 172.21.15.80:0/3613012985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc338132660 con 0x7fc31c0036f0 2019-11-28T11:48:21.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.272+0000 7fc33ec80700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc31c0036f0 0x7fc31c003b20 secure :-1 s=THROTTLE_DONE pgs=1871 cs=0 l=1 rx=0x7fc320010710 tx=0x7fc3200105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.272+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc320000cc0 con 0x7fc31c0036f0 2019-11-28T11:48:21.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.438+0000 7fc3406e3700 1 -- 172.21.15.80:0/3613012985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fc3381322e0 con 0x7fc31c0036f0 2019-11-28T11:48:21.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.438+0000 7fc33ec80700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc31c0036f0 0x7fc31c003b20 secure :-1 s=THROTTLE_DONE pgs=1871 cs=0 l=1 rx=0x7fc320010710 tx=0x7fc3200105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.438+0000 7fc3377fe700 1 -- 172.21.15.80:0/3613012985 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v142) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc3200045c0 con 0x7fc31c0036f0 2019-11-28T11:48:21.485 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:48:21.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.441+0000 7fc3406e3700 1 -- 172.21.15.80:0/3613012985 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc31c01b490 msgr2=0x7fc31c01d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.441+0000 7fc3406e3700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc31c01b490 0x7fc31c01d8e0 crc :-1 s=READY pgs=758 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.441+0000 7fc3406e3700 1 -- 172.21.15.80:0/3613012985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc31c0036f0 msgr2=0x7fc31c003b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.441+0000 7fc3406e3700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc31c0036f0 0x7fc31c003b20 secure :-1 s=READY pgs=1871 cs=0 l=1 rx=0x7fc320010710 tx=0x7fc3200105c0).stop 2019-11-28T11:48:21.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.441+0000 7fc3406e3700 1 -- 172.21.15.80:0/3613012985 shutdown_connections 2019-11-28T11:48:21.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.441+0000 7fc3406e3700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc31c01b490 0x7fc31c01d8e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.441+0000 7fc3406e3700 1 --2- 172.21.15.80:0/3613012985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc31c0036f0 0x7fc31c003b20 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.441+0000 7fc3406e3700 1 -- 172.21.15.80:0/3613012985 shutdown_connections 2019-11-28T11:48:21.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.441+0000 7fc3406e3700 1 -- 172.21.15.80:0/3613012985 wait complete. 2019-11-28T11:48:21.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.441+0000 7fc3406e3700 1 -- 172.21.15.80:0/3613012985 >> 172.21.15.80:0/3613012985 conn(0x7fc33814dbb0 msgr2=0x7fc338142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:21.497 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:48:21.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.574+0000 7fe2f3cc0700 1 Processor -- start 2019-11-28T11:48:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.574+0000 7fe2f3cc0700 1 -- start start 2019-11-28T11:48:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.575+0000 7fe2f3cc0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2ec15ed10 0x7fe2ec15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:21.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.575+0000 7fe2f3cc0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec073020 0x7fe2ec071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.575+0000 7fe2f3cc0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec06db60 con 0x7fe2ec0734b0 2019-11-28T11:48:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.575+0000 7fe2f3cc0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ec06fe00 con 0x7fe2ec15ed10 2019-11-28T11:48:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.575+0000 7fe2f3cc0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0700d0 con 0x7fe2ec073020 2019-11-28T11:48:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.575+0000 7fe2f225d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2ec15ed10 0x7fe2ec15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.575+0000 7fe2f225d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2ec15ed10 0x7fe2ec15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41032/0 (socket says 172.21.15.80:41032) 2019-11-28T11:48:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.575+0000 7fe2f225d700 1 -- 172.21.15.80:0/840065076 learned_addr learned my addr 172.21.15.80:0/840065076 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:21.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f1a5c700 1 --2- 172.21.15.80:0/840065076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec073020 0x7fe2ec071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f225d700 1 -- 172.21.15.80:0/840065076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec073020 msgr2=0x7fe2ec071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:21.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f225d700 1 --2- 172.21.15.80:0/840065076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec073020 0x7fe2ec071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:21.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f225d700 1 -- 172.21.15.80:0/840065076 >> v1:172.21.15.174:6789/0 conn(0x7fe2ec0734b0 legacy=0x7fe2ec0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f225d700 1 -- 172.21.15.80:0/840065076 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec070760 con 0x7fe2ec15ed10 2019-11-28T11:48:21.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f1a5c700 1 --2- 172.21.15.80:0/840065076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec073020 0x7fe2ec071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:48:21.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f225d700 1 --2- 172.21.15.80:0/840065076 >> v2:172.21.15.80:3300/0 conn(0x7fe2ec15ed10 0x7fe2ec15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe2dc00f740 tx=0x7fe2dc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f225d700 1 --2- 172.21.15.80:0/840065076 >> v2:172.21.15.80:3300/0 conn(0x7fe2ec15ed10 0x7fe2ec15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe2dc00f740 tx=0x7fe2dc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f225d700 1 --2- 172.21.15.80:0/840065076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2ec15ed10 0x7fe2ec15f100 secure :-1 s=READY pgs=1872 cs=0 l=1 rx=0x7fe2dc00f740 tx=0x7fe2dc00fae0).ready entity=mon.0 client_cookie=7f83c338c8fe6485 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f225d700 1 --2- 172.21.15.80:0/840065076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2ec15ed10 0x7fe2ec15f100 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7fe2dc00f740 tx=0x7fe2dc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f225d700 1 --2- 172.21.15.80:0/840065076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2ec15ed10 0x7fe2ec15f100 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7fe2dc00f740 tx=0x7fe2dc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f125b700 1 -- 172.21.15.80:0/840065076 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2dc000960 con 0x7fe2ec15ed10 2019-11-28T11:48:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f225d700 1 --2- 172.21.15.80:0/840065076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2ec15ed10 0x7fe2ec15f100 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7fe2dc00f740 tx=0x7fe2dc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f125b700 1 -- 172.21.15.80:0/840065076 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc000c90 con 0x7fe2ec15ed10 2019-11-28T11:48:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f125b700 1 -- 172.21.15.80:0/840065076 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2dc0013a0 con 0x7fe2ec15ed10 2019-11-28T11:48:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f3cc0700 1 -- 172.21.15.80:0/840065076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2ec15ed10 msgr2=0x7fe2ec15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.576+0000 7fe2f3cc0700 1 --2- 172.21.15.80:0/840065076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2ec15ed10 0x7fe2ec15f100 secure :-1 s=READY pgs=1872 cs=0 l=1 rx=0x7fe2dc00f740 tx=0x7fe2dc00fae0).stop 2019-11-28T11:48:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.577+0000 7fe2f3cc0700 1 -- 172.21.15.80:0/840065076 shutdown_connections 2019-11-28T11:48:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.577+0000 7fe2f3cc0700 1 --2- 172.21.15.80:0/840065076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec073020 0x7fe2ec071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.577+0000 7fe2f3cc0700 1 --2- 172.21.15.80:0/840065076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2ec15ed10 0x7fe2ec15f100 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.577+0000 7fe2f3cc0700 1 -- 172.21.15.80:0/840065076 shutdown_connections 2019-11-28T11:48:21.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.577+0000 7fe2f3cc0700 1 -- 172.21.15.80:0/840065076 wait complete. 2019-11-28T11:48:21.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.577+0000 7fe2f3cc0700 1 -- 172.21.15.80:0/840065076 >> 172.21.15.80:0/840065076 conn(0x7fe2ec061d20 msgr2=0x7fe2ec0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:21.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.579+0000 7fe2f3cc0700 1 Processor -- start 2019-11-28T11:48:21.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.580+0000 7fe2f3cc0700 1 -- start start 2019-11-28T11:48:21.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.580+0000 7fe2f3cc0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec148320 0x7fe2ec10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:21.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.580+0000 7fe2f3cc0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe2ec10e3d0 0x7fe2ec168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:21.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.580+0000 7fe2f3cc0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec148e00 con 0x7fe2ec10f290 2019-11-28T11:48:21.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.580+0000 7fe2f3cc0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ec139ff0 con 0x7fe2ec10e3d0 2019-11-28T11:48:21.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.580+0000 7fe2f3cc0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec13aa20 con 0x7fe2ec148320 2019-11-28T11:48:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2f225d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec148320 0x7fe2ec10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2f225d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec148320 0x7fe2ec10ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:43298/0 (socket says 172.21.15.80:43298) 2019-11-28T11:48:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2f225d700 1 -- 172.21.15.80:0/2984881760 learned_addr learned my addr 172.21.15.80:0/2984881760 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2f2a5e700 1 --2- 172.21.15.80:0/2984881760 >> v2:172.21.15.174:3300/0 conn(0x7fe2ec10e3d0 0x7fe2ec168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2f225d700 1 -- 172.21.15.80:0/2984881760 >> v2:172.21.15.174:3300/0 conn(0x7fe2ec10e3d0 msgr2=0x7fe2ec168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2f225d700 1 --2- 172.21.15.80:0/2984881760 >> v2:172.21.15.174:3300/0 conn(0x7fe2ec10e3d0 0x7fe2ec168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2f225d700 1 -- 172.21.15.80:0/2984881760 >> v1:172.21.15.174:6789/0 conn(0x7fe2ec10f290 legacy=0x7fe2ec10dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2f225d700 1 -- 172.21.15.80:0/2984881760 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec10c490 con 0x7fe2ec148320 2019-11-28T11:48:21.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2f225d700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec148320 0x7fe2ec10ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe2dc010400 tx=0x7fe2dc010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2f225d700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec148320 0x7fe2ec10ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe2dc010400 tx=0x7fe2dc010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2f225d700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec148320 0x7fe2ec10ed50 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7fe2dc010400 tx=0x7fe2dc010280).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:21.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2f225d700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec148320 0x7fe2ec10ed50 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fe2dc010400 tx=0x7fe2dc010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2eaffd700 1 -- 172.21.15.80:0/2984881760 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2dc005560 con 0x7fe2ec148320 2019-11-28T11:48:21.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2f225d700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec148320 0x7fe2ec10ed50 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fe2dc010400 tx=0x7fe2dc010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2f225d700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec148320 0x7fe2ec10ed50 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fe2dc010400 tx=0x7fe2dc010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2eaffd700 1 -- 172.21.15.80:0/2984881760 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc005180 con 0x7fe2ec148320 2019-11-28T11:48:21.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2eaffd700 1 -- 172.21.15.80:0/2984881760 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2dc005b40 con 0x7fe2ec148320 2019-11-28T11:48:21.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2f3cc0700 1 -- 172.21.15.80:0/2984881760 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ec10c810 con 0x7fe2ec148320 2019-11-28T11:48:21.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.581+0000 7fe2f3cc0700 1 -- 172.21.15.80:0/2984881760 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ec10c490 con 0x7fe2ec148320 2019-11-28T11:48:21.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.582+0000 7fe2f225d700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec148320 0x7fe2ec10ed50 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fe2dc010400 tx=0x7fe2dc010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.582+0000 7fe2eaffd700 1 -- 172.21.15.80:0/2984881760 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe2dc005370 con 0x7fe2ec148320 2019-11-28T11:48:21.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.582+0000 7fe2f225d700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec148320 0x7fe2ec10ed50 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fe2dc010400 tx=0x7fe2dc010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.582+0000 7fe2eaffd700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2d0018730 0x7fe2d001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:21.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.582+0000 7fe2eaffd700 1 -- 172.21.15.80:0/2984881760 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fe2dc031ae0 con 0x7fe2ec148320 2019-11-28T11:48:21.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.582+0000 7fe2f1a5c700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2d0018730 0x7fe2d001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.583+0000 7fe2f1a5c700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2d0018730 0x7fe2d001abc0 crc :-1 s=READY pgs=759 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.590+0000 7fe2f3cc0700 1 -- 172.21.15.80:0/2984881760 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ec10c810 con 0x7fe2ec148320 2019-11-28T11:48:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.594+0000 7fe2f225d700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec148320 0x7fe2ec10ed50 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fe2dc010400 tx=0x7fe2dc010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.594+0000 7fe2eaffd700 1 -- 172.21.15.80:0/2984881760 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe2dc007210 con 0x7fe2ec148320 2019-11-28T11:48:21.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.762+0000 7fe2f3cc0700 1 -- 172.21.15.80:0/2984881760 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fe2ec10c490 con 0x7fe2ec148320 2019-11-28T11:48:21.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.762+0000 7fe2f225d700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec148320 0x7fe2ec10ed50 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fe2dc010400 tx=0x7fe2dc010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.763+0000 7fe2eaffd700 1 -- 172.21.15.80:0/2984881760 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v142) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe2dc007210 con 0x7fe2ec148320 2019-11-28T11:48:21.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.765+0000 7fe2f3cc0700 1 -- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2d0018730 msgr2=0x7fe2d001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.765+0000 7fe2f3cc0700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2d0018730 0x7fe2d001abc0 crc :-1 s=READY pgs=759 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.765+0000 7fe2f3cc0700 1 -- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec148320 msgr2=0x7fe2ec10ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.765+0000 7fe2f3cc0700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec148320 0x7fe2ec10ed50 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7fe2dc010400 tx=0x7fe2dc010280).stop 2019-11-28T11:48:21.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.766+0000 7fe2f3cc0700 1 -- 172.21.15.80:0/2984881760 shutdown_connections 2019-11-28T11:48:21.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.766+0000 7fe2f3cc0700 1 --2- 172.21.15.80:0/2984881760 >> v2:172.21.15.174:3300/0 conn(0x7fe2ec10e3d0 0x7fe2ec168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.766+0000 7fe2f3cc0700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe2d0018730 0x7fe2d001abc0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.766+0000 7fe2f3cc0700 1 --2- 172.21.15.80:0/2984881760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2ec148320 0x7fe2ec10ed50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.766+0000 7fe2f3cc0700 1 -- 172.21.15.80:0/2984881760 shutdown_connections 2019-11-28T11:48:21.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.766+0000 7fe2f3cc0700 1 -- 172.21.15.80:0/2984881760 wait complete. 2019-11-28T11:48:21.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.766+0000 7fe2f3cc0700 1 -- 172.21.15.80:0/2984881760 >> 172.21.15.80:0/2984881760 conn(0x7fe2ec15e2d0 msgr2=0x7fe2ec147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:21.819 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:48:21.821 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:48:21.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.899+0000 7f9145926700 1 Processor -- start 2019-11-28T11:48:21.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.899+0000 7f9145926700 1 -- start start 2019-11-28T11:48:21.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f9145926700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f914015ed10 0x7f914015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f9145926700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91400734b0 0x7f91400726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f9145926700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914006db60 con 0x7f9140073020 2019-11-28T11:48:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f9145926700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914006fe00 con 0x7f914015ed10 2019-11-28T11:48:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f9145926700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91400700d0 con 0x7f91400734b0 2019-11-28T11:48:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f913f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f914015ed10 0x7f914015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f913effd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9140073020 0x7f9140071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40366/0 (socket says 172.21.15.80:40366) 2019-11-28T11:48:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f913effd700 1 -- 172.21.15.80:0/1042978856 learned_addr learned my addr 172.21.15.80:0/1042978856 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f913ffff700 1 --2- 172.21.15.80:0/1042978856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91400734b0 0x7f91400726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f913f7fe700 1 -- 172.21.15.80:0/1042978856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91400734b0 msgr2=0x7f91400726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f913f7fe700 1 --2- 172.21.15.80:0/1042978856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91400734b0 0x7f91400726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f913f7fe700 1 -- 172.21.15.80:0/1042978856 >> v1:172.21.15.80:6789/0 conn(0x7f9140073020 legacy=0x7f9140071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f913e7fc700 1 -- 172.21.15.80:0/1042978856 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1241676136 0 0) 0x7f9130001070 con 0x7f9140073020 2019-11-28T11:48:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f913f7fe700 1 -- 172.21.15.80:0/1042978856 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9140070760 con 0x7f914015ed10 2019-11-28T11:48:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f913ffff700 1 --2- 172.21.15.80:0/1042978856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91400734b0 0x7f91400726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:48:21.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f913f7fe700 1 --2- 172.21.15.80:0/1042978856 >> v2:172.21.15.80:3300/0 conn(0x7f914015ed10 0x7f914015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f912800af50 tx=0x7f912800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.900+0000 7f913f7fe700 1 --2- 172.21.15.80:0/1042978856 >> v2:172.21.15.80:3300/0 conn(0x7f914015ed10 0x7f914015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f912800af50 tx=0x7f912800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.901+0000 7f913f7fe700 1 --2- 172.21.15.80:0/1042978856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f914015ed10 0x7f914015f100 secure :-1 s=READY pgs=1874 cs=0 l=1 rx=0x7f912800af50 tx=0x7f912800b760).ready entity=mon.0 client_cookie=9068dfb968cef7cb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:21.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.901+0000 7f913f7fe700 1 --2- 172.21.15.80:0/1042978856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f914015ed10 0x7f914015f100 secure :-1 s=THROTTLE_DONE pgs=1874 cs=0 l=1 rx=0x7f912800af50 tx=0x7f912800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.901+0000 7f913e7fc700 1 -- 172.21.15.80:0/1042978856 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9128007210 con 0x7f914015ed10 2019-11-28T11:48:21.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.901+0000 7f913f7fe700 1 --2- 172.21.15.80:0/1042978856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f914015ed10 0x7f914015f100 secure :-1 s=THROTTLE_DONE pgs=1874 cs=0 l=1 rx=0x7f912800af50 tx=0x7f912800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.901+0000 7f913f7fe700 1 --2- 172.21.15.80:0/1042978856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f914015ed10 0x7f914015f100 secure :-1 s=THROTTLE_DONE pgs=1874 cs=0 l=1 rx=0x7f912800af50 tx=0x7f912800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.901+0000 7f913e7fc700 1 -- 172.21.15.80:0/1042978856 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91280099b0 con 0x7f914015ed10 2019-11-28T11:48:21.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.901+0000 7f913e7fc700 1 -- 172.21.15.80:0/1042978856 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9128007210 con 0x7f914015ed10 2019-11-28T11:48:21.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.901+0000 7f9145926700 1 -- 172.21.15.80:0/1042978856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f914015ed10 msgr2=0x7f914015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.901+0000 7f9145926700 1 --2- 172.21.15.80:0/1042978856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f914015ed10 0x7f914015f100 secure :-1 s=READY pgs=1874 cs=0 l=1 rx=0x7f912800af50 tx=0x7f912800b760).stop 2019-11-28T11:48:21.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.901+0000 7f9145926700 1 -- 172.21.15.80:0/1042978856 shutdown_connections 2019-11-28T11:48:21.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.901+0000 7f9145926700 1 --2- 172.21.15.80:0/1042978856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91400734b0 0x7f91400726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:21.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.901+0000 7f9145926700 1 --2- 172.21.15.80:0/1042978856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f914015ed10 0x7f914015f100 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.901+0000 7f9145926700 1 -- 172.21.15.80:0/1042978856 shutdown_connections 2019-11-28T11:48:21.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.901+0000 7f9145926700 1 -- 172.21.15.80:0/1042978856 wait complete. 2019-11-28T11:48:21.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.901+0000 7f9145926700 1 -- 172.21.15.80:0/1042978856 >> 172.21.15.80:0/1042978856 conn(0x7f9140061d20 msgr2=0x7f91400641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:21.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.904+0000 7f9145926700 1 Processor -- start 2019-11-28T11:48:21.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.904+0000 7f9145926700 1 -- start start 2019-11-28T11:48:21.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f9145926700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91401079b0 0x7f9140107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:21.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f9145926700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9140108380 0x7f9140168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:21.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f9145926700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9140148e00 con 0x7f9140148320 2019-11-28T11:48:21.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f9145926700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914013aa20 con 0x7f91401079b0 2019-11-28T11:48:21.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f9145926700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914013acf0 con 0x7f9140108380 2019-11-28T11:48:21.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f913effd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91401079b0 0x7f9140107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f913f7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9140148320 0x7f914010ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40368/0 (socket says 172.21.15.80:40368) 2019-11-28T11:48:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f913effd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91401079b0 0x7f9140107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41054/0 (socket says 172.21.15.80:41054) 2019-11-28T11:48:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f913f7fe700 1 -- 172.21.15.80:0/4288213957 learned_addr learned my addr 172.21.15.80:0/4288213957 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f913ffff700 1 --2- 172.21.15.80:0/4288213957 >> v2:172.21.15.174:3300/0 conn(0x7f9140108380 0x7f9140168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f913effd700 1 -- 172.21.15.80:0/4288213957 >> v2:172.21.15.174:3300/0 conn(0x7f9140108380 msgr2=0x7f9140168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f913effd700 1 --2- 172.21.15.80:0/4288213957 >> v2:172.21.15.174:3300/0 conn(0x7f9140108380 0x7f9140168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f913effd700 1 -- 172.21.15.80:0/4288213957 >> v1:172.21.15.80:6789/0 conn(0x7f9140148320 legacy=0x7f914010ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f9137fff700 1 -- 172.21.15.80:0/4288213957 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985395332 0 0) 0x7f912800abb0 con 0x7f9140148320 2019-11-28T11:48:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f913effd700 1 -- 172.21.15.80:0/4288213957 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914010c490 con 0x7f91401079b0 2019-11-28T11:48:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f913effd700 1 --2- 172.21.15.80:0/4288213957 >> v2:172.21.15.80:3300/0 conn(0x7f91401079b0 0x7f9140107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f91300103a0 tx=0x7f91300101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f913effd700 1 --2- 172.21.15.80:0/4288213957 >> v2:172.21.15.80:3300/0 conn(0x7f91401079b0 0x7f9140107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f91300103a0 tx=0x7f91300101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.905+0000 7f913effd700 1 --2- 172.21.15.80:0/4288213957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91401079b0 0x7f9140107e40 secure :-1 s=READY pgs=1876 cs=0 l=1 rx=0x7f91300103a0 tx=0x7f91300101d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.906+0000 7f913effd700 1 --2- 172.21.15.80:0/4288213957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91401079b0 0x7f9140107e40 secure :-1 s=THROTTLE_DONE pgs=1876 cs=0 l=1 rx=0x7f91300103a0 tx=0x7f91300101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.906+0000 7f9137fff700 1 -- 172.21.15.80:0/4288213957 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9130001230 con 0x7f91401079b0 2019-11-28T11:48:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.906+0000 7f913effd700 1 --2- 172.21.15.80:0/4288213957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91401079b0 0x7f9140107e40 secure :-1 s=THROTTLE_DONE pgs=1876 cs=0 l=1 rx=0x7f91300103a0 tx=0x7f91300101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.906+0000 7f913effd700 1 --2- 172.21.15.80:0/4288213957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91401079b0 0x7f9140107e40 secure :-1 s=THROTTLE_DONE pgs=1876 cs=0 l=1 rx=0x7f91300103a0 tx=0x7f91300101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.906+0000 7f9137fff700 1 -- 172.21.15.80:0/4288213957 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9130003fe0 con 0x7f91401079b0 2019-11-28T11:48:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.906+0000 7f9145926700 1 -- 172.21.15.80:0/4288213957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914010c810 con 0x7f91401079b0 2019-11-28T11:48:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.906+0000 7f9137fff700 1 -- 172.21.15.80:0/4288213957 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9130004730 con 0x7f91401079b0 2019-11-28T11:48:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.906+0000 7f9145926700 1 -- 172.21.15.80:0/4288213957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9140108820 con 0x7f91401079b0 2019-11-28T11:48:21.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.906+0000 7f913effd700 1 --2- 172.21.15.80:0/4288213957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91401079b0 0x7f9140107e40 secure :-1 s=THROTTLE_DONE pgs=1876 cs=0 l=1 rx=0x7f91300103a0 tx=0x7f91300101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.906+0000 7f9137fff700 1 -- 172.21.15.80:0/4288213957 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9130000dd0 con 0x7f91401079b0 2019-11-28T11:48:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.906+0000 7f913effd700 1 --2- 172.21.15.80:0/4288213957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91401079b0 0x7f9140107e40 secure :-1 s=THROTTLE_DONE pgs=1876 cs=0 l=1 rx=0x7f91300103a0 tx=0x7f91300101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.906+0000 7f9137fff700 1 --2- 172.21.15.80:0/4288213957 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9124018730 0x7f912401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.906+0000 7f9137fff700 1 -- 172.21.15.80:0/4288213957 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f91300319b0 con 0x7f91401079b0 2019-11-28T11:48:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.907+0000 7f913f7fe700 1 --2- 172.21.15.80:0/4288213957 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9124018730 0x7f912401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:21.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.907+0000 7f913f7fe700 1 --2- 172.21.15.80:0/4288213957 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9124018730 0x7f912401abc0 crc :-1 s=READY pgs=760 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.914+0000 7f9145926700 1 -- 172.21.15.80:0/4288213957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914010c490 con 0x7f91401079b0 2019-11-28T11:48:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.917+0000 7f913effd700 1 --2- 172.21.15.80:0/4288213957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91401079b0 0x7f9140107e40 secure :-1 s=THROTTLE_DONE pgs=1876 cs=0 l=1 rx=0x7f91300103a0 tx=0x7f91300101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:21.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:21.917+0000 7f9137fff700 1 -- 172.21.15.80:0/4288213957 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9130000940 con 0x7f91401079b0 2019-11-28T11:48:22.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.085+0000 7f9145926700 1 -- 172.21.15.80:0/4288213957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f914010c810 con 0x7f91401079b0 2019-11-28T11:48:22.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.086+0000 7f913effd700 1 --2- 172.21.15.80:0/4288213957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91401079b0 0x7f9140107e40 secure :-1 s=THROTTLE_DONE pgs=1876 cs=0 l=1 rx=0x7f91300103a0 tx=0x7f91300101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:22.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.086+0000 7f9137fff700 1 -- 172.21.15.80:0/4288213957 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v142) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9130000dd0 con 0x7f91401079b0 2019-11-28T11:48:22.132 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:48:22.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.088+0000 7f9145926700 1 -- 172.21.15.80:0/4288213957 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9124018730 msgr2=0x7f912401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:22.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.088+0000 7f9145926700 1 --2- 172.21.15.80:0/4288213957 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9124018730 0x7f912401abc0 crc :-1 s=READY pgs=760 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:22.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.088+0000 7f9145926700 1 -- 172.21.15.80:0/4288213957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91401079b0 msgr2=0x7f9140107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.088+0000 7f9145926700 1 --2- 172.21.15.80:0/4288213957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91401079b0 0x7f9140107e40 secure :-1 s=READY pgs=1876 cs=0 l=1 rx=0x7f91300103a0 tx=0x7f91300101d0).stop 2019-11-28T11:48:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.088+0000 7f9145926700 1 -- 172.21.15.80:0/4288213957 shutdown_connections 2019-11-28T11:48:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.088+0000 7f9145926700 1 --2- 172.21.15.80:0/4288213957 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9124018730 0x7f912401abc0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.088+0000 7f9145926700 1 --2- 172.21.15.80:0/4288213957 >> v2:172.21.15.174:3300/0 conn(0x7f9140108380 0x7f9140168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.088+0000 7f9145926700 1 --2- 172.21.15.80:0/4288213957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91401079b0 0x7f9140107e40 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.089+0000 7f9145926700 1 -- 172.21.15.80:0/4288213957 shutdown_connections 2019-11-28T11:48:22.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.089+0000 7f9145926700 1 -- 172.21.15.80:0/4288213957 wait complete. 2019-11-28T11:48:22.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.089+0000 7f9145926700 1 -- 172.21.15.80:0/4288213957 >> 172.21.15.80:0/4288213957 conn(0x7f914015e2d0 msgr2=0x7f9140147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:22.144 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:48:22.144 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:48:22.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.217+0000 7f982980a700 1 Processor -- start 2019-11-28T11:48:22.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.217+0000 7f982980a700 1 -- start start 2019-11-28T11:48:22.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.218+0000 7f982980a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f982406d120 0x7f9824165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:22.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.218+0000 7f982980a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982406d5a0 con 0x7f982406c0a0 2019-11-28T11:48:22.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.218+0000 7f982980a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982406db00 con 0x7f982406c490 2019-11-28T11:48:22.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.218+0000 7f982980a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982406fd60 con 0x7f982406d120 2019-11-28T11:48:22.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.218+0000 7f9823fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f982406d120 0x7f9824165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:22.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.218+0000 7f9823fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f982406d120 0x7f9824165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41062/0 (socket says 172.21.15.80:41062) 2019-11-28T11:48:22.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.218+0000 7f9823fff700 1 -- 172.21.15.80:0/4087540516 learned_addr learned my addr 172.21.15.80:0/4087540516 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:22.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.218+0000 7f98237fe700 1 --1- 172.21.15.80:0/4087540516 >> v1:172.21.15.80:6789/0 conn(0x7f982406c0a0 0x7f9824072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40376/0 (socket says 172.21.15.80:40376) 2019-11-28T11:48:22.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.218+0000 7f9823fff700 1 -- 172.21.15.80:0/4087540516 >> v1:172.21.15.174:6789/0 conn(0x7f982406c490 legacy=0x7f982406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:22.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.218+0000 7f9823fff700 1 -- 172.21.15.80:0/4087540516 >> v1:172.21.15.80:6789/0 conn(0x7f982406c0a0 legacy=0x7f9824072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:22.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.218+0000 7f98227fc700 1 -- 172.21.15.80:0/4087540516 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776448412 0 0) 0x7f981c001100 con 0x7f982406c0a0 2019-11-28T11:48:22.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.218+0000 7f9823fff700 1 -- 172.21.15.80:0/4087540516 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240706c0 con 0x7f982406d120 2019-11-28T11:48:22.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.218+0000 7f9823fff700 1 --2- 172.21.15.80:0/4087540516 >> v2:172.21.15.80:3300/0 conn(0x7f982406d120 0x7f9824165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f981400fab0 tx=0x7f981400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:22.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.219+0000 7f9823fff700 1 --2- 172.21.15.80:0/4087540516 >> v2:172.21.15.80:3300/0 conn(0x7f982406d120 0x7f9824165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f981400fab0 tx=0x7f981400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:22.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.219+0000 7f9823fff700 1 --2- 172.21.15.80:0/4087540516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f982406d120 0x7f9824165d80 secure :-1 s=READY pgs=1878 cs=0 l=1 rx=0x7f981400fab0 tx=0x7f981400fe50).ready entity=mon.0 client_cookie=ce2377753c64cac1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:22.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.219+0000 7f9823fff700 1 --2- 172.21.15.80:0/4087540516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f982406d120 0x7f9824165d80 secure :-1 s=THROTTLE_DONE pgs=1878 cs=0 l=1 rx=0x7f981400fab0 tx=0x7f981400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:22.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.219+0000 7f98227fc700 1 -- 172.21.15.80:0/4087540516 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9814000df0 con 0x7f982406d120 2019-11-28T11:48:22.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.219+0000 7f9823fff700 1 --2- 172.21.15.80:0/4087540516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f982406d120 0x7f9824165d80 secure :-1 s=THROTTLE_DONE pgs=1878 cs=0 l=1 rx=0x7f981400fab0 tx=0x7f981400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:22.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.219+0000 7f9823fff700 1 --2- 172.21.15.80:0/4087540516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f982406d120 0x7f9824165d80 secure :-1 s=THROTTLE_DONE pgs=1878 cs=0 l=1 rx=0x7f981400fab0 tx=0x7f981400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:22.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.219+0000 7f98227fc700 1 -- 172.21.15.80:0/4087540516 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814001460 con 0x7f982406d120 2019-11-28T11:48:22.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.219+0000 7f98227fc700 1 -- 172.21.15.80:0/4087540516 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9814001b30 con 0x7f982406d120 2019-11-28T11:48:22.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.219+0000 7f982980a700 1 -- 172.21.15.80:0/4087540516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f982406d120 msgr2=0x7f9824165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:22.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.219+0000 7f982980a700 1 --2- 172.21.15.80:0/4087540516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f982406d120 0x7f9824165d80 secure :-1 s=READY pgs=1878 cs=0 l=1 rx=0x7f981400fab0 tx=0x7f981400fe50).stop 2019-11-28T11:48:22.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.219+0000 7f982980a700 1 -- 172.21.15.80:0/4087540516 shutdown_connections 2019-11-28T11:48:22.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.219+0000 7f982980a700 1 --2- 172.21.15.80:0/4087540516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f982406d120 0x7f9824165d80 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:22.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.219+0000 7f982980a700 1 -- 172.21.15.80:0/4087540516 shutdown_connections 2019-11-28T11:48:22.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.219+0000 7f982980a700 1 -- 172.21.15.80:0/4087540516 wait complete. 2019-11-28T11:48:22.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.219+0000 7f982980a700 1 -- 172.21.15.80:0/4087540516 >> 172.21.15.80:0/4087540516 conn(0x7f9824061cf0 msgr2=0x7f9824064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:22.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.222+0000 7f982980a700 1 Processor -- start 2019-11-28T11:48:22.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.222+0000 7f982980a700 1 -- start start 2019-11-28T11:48:22.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f982980a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9824111db0 0x7f98241238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:22.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f982980a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9824124260 con 0x7f982412cea0 2019-11-28T11:48:22.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f982980a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982412e5d0 con 0x7f9824165a00 2019-11-28T11:48:22.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f982980a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9824121040 con 0x7f9824111db0 2019-11-28T11:48:22.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f98237fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f982412cea0 0x7f98241230e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40382/0 (socket says 172.21.15.80:40382) 2019-11-28T11:48:22.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f98237fe700 1 -- 172.21.15.80:0/2814527301 learned_addr learned my addr 172.21.15.80:0/2814527301 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:22.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f9822ffd700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9824111db0 0x7f98241238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:22.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365070879 0 0) 0x7f981c001150 con 0x7f982412cea0 2019-11-28T11:48:22.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9808002e80 con 0x7f982412cea0 2019-11-28T11:48:22.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 240543163 0 0) 0x7f981c001300 con 0x7f982412cea0 2019-11-28T11:48:22.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f98080032e0 con 0x7f982412cea0 2019-11-28T11:48:22.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f981c001890 con 0x7f982412cea0 2019-11-28T11:48:22.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9824111db0 msgr2=0x7f98241238e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:22.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f981bfff700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9824111db0 0x7f98241238e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:22.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 >> v1:172.21.15.174:6789/0 conn(0x7f9824165a00 legacy=0x7f9824167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:22.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 >> v1:172.21.15.80:6789/0 conn(0x7f982412cea0 legacy=0x7f98241230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:22.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f981bfff700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9808003330 0x7f9808003780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:22.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f981bfff700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9808003cc0 0x7f9808004160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:22.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f981bfff700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98080048c0 0x7f9808004d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:22.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980800bbf0 con 0x7f9808003cc0 2019-11-28T11:48:22.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980800bdf0 con 0x7f98080048c0 2019-11-28T11:48:22.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.223+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980800c020 con 0x7f9808003330 2019-11-28T11:48:22.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f9822ffd700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9808003cc0 0x7f9808004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:22.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f98237fe700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9808003330 0x7f9808003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:22.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f9823fff700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98080048c0 0x7f9808004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:22.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f9822ffd700 1 -- 172.21.15.80:0/2814527301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9808003330 msgr2=0x7f9808003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:22.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f9822ffd700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9808003330 0x7f9808003780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:22.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f9822ffd700 1 -- 172.21.15.80:0/2814527301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98080048c0 msgr2=0x7f9808004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:22.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f9822ffd700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98080048c0 0x7f9808004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:22.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f9822ffd700 1 -- 172.21.15.80:0/2814527301 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980800c2d0 con 0x7f9808003cc0 2019-11-28T11:48:22.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f982980a700 1 -- 172.21.15.80:0/2814527301 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9824121d20 con 0x7f9808003cc0 2019-11-28T11:48:22.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f9822ffd700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9808003cc0 0x7f9808004160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f980c010310 tx=0x7f980c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:22.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f982980a700 1 -- 172.21.15.80:0/2814527301 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98241219a0 con 0x7f9808003cc0 2019-11-28T11:48:22.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f9822ffd700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9808003cc0 0x7f9808004160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f980c010310 tx=0x7f980c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:22.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f9822ffd700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9808003cc0 0x7f9808004160 secure :-1 s=READY pgs=1880 cs=0 l=1 rx=0x7f980c010310 tx=0x7f980c010190).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:22.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f9822ffd700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9808003cc0 0x7f9808004160 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f980c010310 tx=0x7f980c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:22.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f980c000940 con 0x7f9808003cc0 2019-11-28T11:48:22.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f9822ffd700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9808003cc0 0x7f9808004160 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f980c010310 tx=0x7f980c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:22.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c000940 con 0x7f9808003cc0 2019-11-28T11:48:22.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f9822ffd700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9808003cc0 0x7f9808004160 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f980c010310 tx=0x7f980c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:22.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f980c009a00 con 0x7f9808003cc0 2019-11-28T11:48:22.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.224+0000 7f9822ffd700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9808003cc0 0x7f9808004160 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f980c010310 tx=0x7f980c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:22.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.225+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f980c009620 con 0x7f9808003cc0 2019-11-28T11:48:22.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.225+0000 7f9822ffd700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9808003cc0 0x7f9808004160 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f980c010310 tx=0x7f980c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:22.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.225+0000 7f981bfff700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9808020b70 0x7f9808022fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:22.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.225+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f980c031c10 con 0x7f9808003cc0 2019-11-28T11:48:22.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.225+0000 7f98237fe700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9808020b70 0x7f9808022fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:22.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.225+0000 7f98237fe700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9808020b70 0x7f9808022fa0 crc :-1 s=READY pgs=761 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:22.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.232+0000 7f982980a700 1 -- 172.21.15.80:0/2814527301 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97fc002e60 con 0x7f9808003cc0 2019-11-28T11:48:22.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.236+0000 7f9822ffd700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9808003cc0 0x7f9808004160 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f980c010310 tx=0x7f980c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:22.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.236+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f980c00a640 con 0x7f9808003cc0 2019-11-28T11:48:22.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.411+0000 7f982980a700 1 -- 172.21.15.80:0/2814527301 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97fc001d10 con 0x7f9808003cc0 2019-11-28T11:48:22.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.412+0000 7f9822ffd700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9808003cc0 0x7f9808004160 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f980c010310 tx=0x7f980c010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:22.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.412+0000 7f981bfff700 1 -- 172.21.15.80:0/2814527301 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+2455 (secure 0 0 0) 0x7f980c009580 con 0x7f9808003cc0 2019-11-28T11:48:22.460 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 107 2019-11-28T11:48:22.460 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:22.461 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":107,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/3312817459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3312817459},{"type":"v1","addr":"172.21.15.174:6835","nonce":3312817459}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":106},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3089980665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3089980665},{"type":"v1","addr":"172.21.15.80:6834","nonce":3089980665}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":106}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:30.152127+0000","modified":"2019-11-28T11:45:37.708419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8752},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8752":{"gid":8752,"name":"b","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6835/1912693207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1912693207},{"type":"v1","addr":"172.21.15.80:6835","nonce":1912693207}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2019-11-28T11:48:22.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.414+0000 7f982980a700 1 -- 172.21.15.80:0/2814527301 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9808020b70 msgr2=0x7f9808022fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:22.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.414+0000 7f982980a700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9808020b70 0x7f9808022fa0 crc :-1 s=READY pgs=761 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:22.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.414+0000 7f982980a700 1 -- 172.21.15.80:0/2814527301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9808003cc0 msgr2=0x7f9808004160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:22.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.414+0000 7f982980a700 1 --2- 172.21.15.80:0/2814527301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9808003cc0 0x7f9808004160 secure :-1 s=READY pgs=1880 cs=0 l=1 rx=0x7f980c010310 tx=0x7f980c010190).stop 2019-11-28T11:48:22.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.414+0000 7f9823fff700 1 -- 172.21.15.80:0/2814527301 reap_dead start 2019-11-28T11:48:22.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.414+0000 7f982980a700 1 -- 172.21.15.80:0/2814527301 shutdown_connections 2019-11-28T11:48:22.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.415+0000 7f982980a700 1 -- 172.21.15.80:0/2814527301 shutdown_connections 2019-11-28T11:48:22.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.415+0000 7f982980a700 1 -- 172.21.15.80:0/2814527301 wait complete. 2019-11-28T11:48:22.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:22.415+0000 7f982980a700 1 -- 172.21.15.80:0/2814527301 >> 172.21.15.80:0/2814527301 conn(0x7f98241426c0 msgr2=0x7f9824110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:22.772 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8752}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 22, u'failed': [], u'epoch': 107, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [23], u'info': {u'gid_8752': {u'export_targets': [], u'name': u'b', u'incarnation': 106, u'state_seq': 3, u'state': u'up:active', u'gid': 8752, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1912693207, u'type': u'v2', u'addr': u'172.21.15.80:6833'}, {u'nonce': 1912693207, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/1912693207'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:45:30.152127+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:45:37.708419+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:48:22.773 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:48:22.773 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-11-28T11:48:22.897 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:48:22.897 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:48:22.898 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T11:48:22.898 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 8752, 2019-11-28T11:48:22.898 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2019-11-28T11:48:22.898 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2019-11-28T11:48:22.899 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 166.14919921200001, 2019-11-28T11:48:22.899 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 107, 2019-11-28T11:48:22.899 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 142, 2019-11-28T11:48:22.899 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 142, 2019-11-28T11:48:22.899 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 170.27578178900001 2019-11-28T11:48:22.900 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:48:22.903 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8752, "want_state": "up:active", "state": "up:active", "rank_uptime": 166.14919921200001, "mdsmap_epoch": 107, "osdmap_epoch": 142, "osdmap_epoch_barrier": 142, "uptime": 170.27578178900001 } 2019-11-28T11:48:22.903 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:48:22.904 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:48:22.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:48:22.904 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:48:22.973 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:48:22.974 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:48:23.299 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:48:23.299 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:48:23.416 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:48:23.416 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:48:23.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:48:23.417 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:48:23.495 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction' 2019-11-28T11:48:23.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.569+0000 7f9821d4f700 1 Processor -- start 2019-11-28T11:48:23.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.569+0000 7f9821d4f700 1 -- start start 2019-11-28T11:48:23.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.570+0000 7f9821d4f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f981c06c0a0 0x7f981c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:23.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.570+0000 7f9821d4f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f981c072620 0x7f981c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:23.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.570+0000 7f9821d4f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981c06db00 con 0x7f981c0734e0 2019-11-28T11:48:23.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.570+0000 7f9821d4f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981c06fd60 con 0x7f981c06c0a0 2019-11-28T11:48:23.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.570+0000 7f9821d4f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981c070030 con 0x7f981c072620 2019-11-28T11:48:23.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.570+0000 7f981bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f981c06c0a0 0x7f981c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:23.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.570+0000 7f981bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f981c06c0a0 0x7f981c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41080/0 (socket says 172.21.15.80:41080) 2019-11-28T11:48:23.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.570+0000 7f981bfff700 1 -- 172.21.15.80:0/2453714271 learned_addr learned my addr 172.21.15.80:0/2453714271 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:23.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.570+0000 7f9820aed700 1 --2- 172.21.15.80:0/2453714271 >> v2:172.21.15.174:3300/0 conn(0x7f981c072620 0x7f981c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:23.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.571+0000 7f981bfff700 1 -- 172.21.15.80:0/2453714271 >> v2:172.21.15.174:3300/0 conn(0x7f981c072620 msgr2=0x7f981c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:23.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.571+0000 7f981bfff700 1 --2- 172.21.15.80:0/2453714271 >> v2:172.21.15.174:3300/0 conn(0x7f981c072620 0x7f981c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:23.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.571+0000 7f981bfff700 1 -- 172.21.15.80:0/2453714271 >> v1:172.21.15.174:6789/0 conn(0x7f981c0734e0 legacy=0x7f981c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:23.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.571+0000 7f981bfff700 1 -- 172.21.15.80:0/2453714271 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c0706c0 con 0x7f981c06c0a0 2019-11-28T11:48:23.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.571+0000 7f9820aed700 1 --2- 172.21.15.80:0/2453714271 >> v2:172.21.15.174:3300/0 conn(0x7f981c072620 0x7f981c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:48:23.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.571+0000 7f981bfff700 1 --2- 172.21.15.80:0/2453714271 >> v2:172.21.15.80:3300/0 conn(0x7f981c06c0a0 0x7f981c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f980c00fac0 tx=0x7f980c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:23.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.571+0000 7f981bfff700 1 --2- 172.21.15.80:0/2453714271 >> v2:172.21.15.80:3300/0 conn(0x7f981c06c0a0 0x7f981c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f980c00fac0 tx=0x7f980c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:23.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.571+0000 7f981bfff700 1 --2- 172.21.15.80:0/2453714271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c06c0a0 0x7f981c072fa0 secure :-1 s=READY pgs=1882 cs=0 l=1 rx=0x7f980c00fac0 tx=0x7f980c00fe60).ready entity=mon.0 client_cookie=a84e516cba50c8b1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:23.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.571+0000 7f981bfff700 1 --2- 172.21.15.80:0/2453714271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c06c0a0 0x7f981c072fa0 secure :-1 s=THROTTLE_DONE pgs=1882 cs=0 l=1 rx=0x7f980c00fac0 tx=0x7f980c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:23.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.571+0000 7f981bfff700 1 --2- 172.21.15.80:0/2453714271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c06c0a0 0x7f981c072fa0 secure :-1 s=THROTTLE_DONE pgs=1882 cs=0 l=1 rx=0x7f980c00fac0 tx=0x7f980c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:23.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.571+0000 7f981b7fe700 1 -- 172.21.15.80:0/2453714271 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f980c000ce0 con 0x7f981c06c0a0 2019-11-28T11:48:23.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.571+0000 7f981bfff700 1 --2- 172.21.15.80:0/2453714271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c06c0a0 0x7f981c072fa0 secure :-1 s=THROTTLE_DONE pgs=1882 cs=0 l=1 rx=0x7f980c00fac0 tx=0x7f980c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:23.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.571+0000 7f981b7fe700 1 -- 172.21.15.80:0/2453714271 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c001010 con 0x7f981c06c0a0 2019-11-28T11:48:23.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.571+0000 7f981b7fe700 1 -- 172.21.15.80:0/2453714271 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f980c001720 con 0x7f981c06c0a0 2019-11-28T11:48:23.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.571+0000 7f9821d4f700 1 -- 172.21.15.80:0/2453714271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c06c0a0 msgr2=0x7f981c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:23.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.571+0000 7f9821d4f700 1 --2- 172.21.15.80:0/2453714271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c06c0a0 0x7f981c072fa0 secure :-1 s=READY pgs=1882 cs=0 l=1 rx=0x7f980c00fac0 tx=0x7f980c00fe60).stop 2019-11-28T11:48:23.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.572+0000 7f9821d4f700 1 -- 172.21.15.80:0/2453714271 shutdown_connections 2019-11-28T11:48:23.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.572+0000 7f9821d4f700 1 --2- 172.21.15.80:0/2453714271 >> v2:172.21.15.174:3300/0 conn(0x7f981c072620 0x7f981c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:23.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.572+0000 7f9821d4f700 1 --2- 172.21.15.80:0/2453714271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f981c06c0a0 0x7f981c072fa0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:23.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.572+0000 7f9821d4f700 1 -- 172.21.15.80:0/2453714271 shutdown_connections 2019-11-28T11:48:23.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.572+0000 7f9821d4f700 1 -- 172.21.15.80:0/2453714271 wait complete. 2019-11-28T11:48:23.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.572+0000 7f9821d4f700 1 -- 172.21.15.80:0/2453714271 >> 172.21.15.80:0/2453714271 conn(0x7f981c061cf0 msgr2=0x7f981c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:23.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.574+0000 7f9821d4f700 1 Processor -- start 2019-11-28T11:48:23.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.574+0000 7f9821d4f700 1 -- start start 2019-11-28T11:48:23.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.575+0000 7f9821d4f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f981c1096f0 0x7f981c169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:23.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.575+0000 7f9821d4f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981c1066e0 con 0x7f981c13e9e0 2019-11-28T11:48:23.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.575+0000 7f9821d4f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981c10ce40 con 0x7f981c13e5f0 2019-11-28T11:48:23.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.575+0000 7f9821d4f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981c10e060 con 0x7f981c1096f0 2019-11-28T11:48:23.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.575+0000 7f9813fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f981c13e9e0 0x7f981c108ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40404/0 (socket says 172.21.15.80:40404) 2019-11-28T11:48:23.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.575+0000 7f9813fff700 1 -- 172.21.15.80:0/1782656388 learned_addr learned my addr 172.21.15.80:0/1782656388 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:23.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.575+0000 7f9820aed700 1 --2- 172.21.15.80:0/1782656388 >> v2:172.21.15.174:3300/0 conn(0x7f981c1096f0 0x7f981c169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:23.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.575+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171632770 0 0) 0x7f9804001150 con 0x7f981c13e9e0 2019-11-28T11:48:23.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.575+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9800002e80 con 0x7f981c13e9e0 2019-11-28T11:48:23.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.575+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1221807470 0 0) 0x7f98040012c0 con 0x7f981c13e9e0 2019-11-28T11:48:23.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.575+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f98000032e0 con 0x7f981c13e9e0 2019-11-28T11:48:23.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f9804001870 con 0x7f981c13e9e0 2019-11-28T11:48:23.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 >> v2:172.21.15.174:3300/0 conn(0x7f981c1096f0 msgr2=0x7f981c169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:23.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f98197fa700 1 --2- 172.21.15.80:0/1782656388 >> v2:172.21.15.174:3300/0 conn(0x7f981c1096f0 0x7f981c169ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:23.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 >> v1:172.21.15.174:6789/0 conn(0x7f981c13e5f0 legacy=0x7f981c10a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:23.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 >> v1:172.21.15.80:6789/0 conn(0x7f981c13e9e0 legacy=0x7f981c108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:23.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f98197fa700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9800003790 0x7f9800003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:23.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f98197fa700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9800004100 0x7f9800004570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f98197fa700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9800004bc0 0x7f980000b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98000052f0 con 0x7f9800004100 2019-11-28T11:48:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980000be00 con 0x7f9800003790 2019-11-28T11:48:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980000c030 con 0x7f9800004bc0 2019-11-28T11:48:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f9813fff700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9800004100 0x7f9800004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:23.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f981bfff700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9800003790 0x7f9800003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f9820aed700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9800004bc0 0x7f980000b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f9813fff700 1 -- 172.21.15.80:0/1782656388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9800004bc0 msgr2=0x7f980000b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f9813fff700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9800004bc0 0x7f980000b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f9813fff700 1 -- 172.21.15.80:0/1782656388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9800003790 msgr2=0x7f9800003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f9813fff700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9800003790 0x7f9800003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f9813fff700 1 -- 172.21.15.80:0/1782656388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980000c2e0 con 0x7f9800004100 2019-11-28T11:48:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f9820aed700 1 -- 172.21.15.80:0/1782656388 reap_dead start 2019-11-28T11:48:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f9821d4f700 1 -- 172.21.15.80:0/1782656388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981c10ed40 con 0x7f9800004100 2019-11-28T11:48:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f9813fff700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9800004100 0x7f9800004570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9804010430 tx=0x7f98040102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f9821d4f700 1 -- 172.21.15.80:0/1782656388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981c10e9c0 con 0x7f9800004100 2019-11-28T11:48:23.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f9813fff700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9800004100 0x7f9800004570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9804010430 tx=0x7f98040102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:23.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f9813fff700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9800004100 0x7f9800004570 secure :-1 s=READY pgs=1884 cs=0 l=1 rx=0x7f9804010430 tx=0x7f98040102b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:23.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f9813fff700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9800004100 0x7f9800004570 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7f9804010430 tx=0x7f98040102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:23.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9804001a90 con 0x7f9800004100 2019-11-28T11:48:23.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f9813fff700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9800004100 0x7f9800004570 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7f9804010430 tx=0x7f98040102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:23.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f9813fff700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9800004100 0x7f9800004570 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7f9804010430 tx=0x7f98040102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:23.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9804000b10 con 0x7f9800004100 2019-11-28T11:48:23.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.576+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98040045e0 con 0x7f9800004100 2019-11-28T11:48:23.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.577+0000 7f9813fff700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9800004100 0x7f9800004570 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7f9804010430 tx=0x7f98040102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:23.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.577+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9804004200 con 0x7f9800004100 2019-11-28T11:48:23.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.577+0000 7f9813fff700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9800004100 0x7f9800004570 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7f9804010430 tx=0x7f98040102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:23.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.577+0000 7f98197fa700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f980001b510 0x7f980001d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:23.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.577+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f9804031bf0 con 0x7f9800004100 2019-11-28T11:48:23.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.577+0000 7f981bfff700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f980001b510 0x7f980001d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:23.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.577+0000 7f981bfff700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f980001b510 0x7f980001d940 crc :-1 s=READY pgs=762 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:23.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.584+0000 7f9821d4f700 1 -- 172.21.15.80:0/1782656388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f4002e60 con 0x7f9800004100 2019-11-28T11:48:23.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.588+0000 7f9813fff700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9800004100 0x7f9800004570 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7f9804010430 tx=0x7f98040102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:23.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.588+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9804001ca0 con 0x7f9800004100 2019-11-28T11:48:23.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:23.761+0000 7f9821d4f700 1 -- 172.21.15.80:0/1782656388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction"]} v 0) v1 -- 0x7f97f4001d60 con 0x7f9800004100 2019-11-28T11:48:24.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:24.370+0000 7f9813fff700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9800004100 0x7f9800004570 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7f9804010430 tx=0x7f98040102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:24.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:24.370+0000 7f98197fa700 1 -- 172.21.15.80:0/1782656388 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction"]}]=0 v529) v1 ==== 154+0+0 (secure 0 0 0) 0x7f980401f7b0 con 0x7f9800004100 2019-11-28T11:48:24.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:24.379+0000 7f9821d4f700 1 -- 172.21.15.80:0/1782656388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f980001b510 msgr2=0x7f980001d940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:24.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:24.379+0000 7f9821d4f700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f980001b510 0x7f980001d940 crc :-1 s=READY pgs=762 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:24.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:24.379+0000 7f9821d4f700 1 -- 172.21.15.80:0/1782656388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9800004100 msgr2=0x7f9800004570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:24.379+0000 7f9821d4f700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9800004100 0x7f9800004570 secure :-1 s=READY pgs=1884 cs=0 l=1 rx=0x7f9804010430 tx=0x7f98040102b0).stop 2019-11-28T11:48:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:24.379+0000 7f9821d4f700 1 -- 172.21.15.80:0/1782656388 shutdown_connections 2019-11-28T11:48:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:24.379+0000 7f9821d4f700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f980001b510 0x7f980001d940 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:24.379+0000 7f9821d4f700 1 --2- 172.21.15.80:0/1782656388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9800004100 0x7f9800004570 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:24.379+0000 7f9821d4f700 1 -- 172.21.15.80:0/1782656388 shutdown_connections 2019-11-28T11:48:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:24.379+0000 7f9821d4f700 1 -- 172.21.15.80:0/1782656388 wait complete. 2019-11-28T11:48:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:24.379+0000 7f9821d4f700 1 -- 172.21.15.80:0/1782656388 >> 172.21.15.80:0/1782656388 conn(0x7f981c13d620 msgr2=0x7f981c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:24.434 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:48:24.435 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:48:24.502 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:48:24.563 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:48:24.662 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:48:24.719 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:48:24.781 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:48:24.813 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:48:24.818 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:48:24.825 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:48:24.831 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:48:24.836 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:48:24.842 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:48:24.843 INFO:tasks.cephfs.mount:Terminating background process 2019-11-28T11:48:24.844 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T11:48:24.845 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:48:24.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:48:24.847 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T11:48:24.854 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:48:24.995 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:48:24.999 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:48:25.036 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:48:25.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:48:25.036 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:48:25.158 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:48:25.162 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:48:25.202 INFO:tasks.cephfs_test_runner:test_filelock_eviction (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2019-11-28T11:48:25.202 INFO:tasks.cephfs_test_runner:Starting test: test_reconnect_after_blacklisted (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T11:48:25.203 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blacklisted' 2019-11-28T11:48:25.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.277+0000 7f9e139cc700 1 Processor -- start 2019-11-28T11:48:25.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.278+0000 7f9e139cc700 1 -- start start 2019-11-28T11:48:25.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e139cc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c06c0a0 0x7f9e0c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:25.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e139cc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9e0c072620 0x7f9e0c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:25.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e139cc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c06db00 con 0x7f9e0c0734e0 2019-11-28T11:48:25.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e139cc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0c06f330 con 0x7f9e0c072620 2019-11-28T11:48:25.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e139cc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0706c0 con 0x7f9e0c06c0a0 2019-11-28T11:48:25.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e1276a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9e0c072620 0x7f9e0c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:25.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e1276a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9e0c072620 0x7f9e0c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41100/0 (socket says 172.21.15.80:41100) 2019-11-28T11:48:25.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e1276a700 1 -- 172.21.15.80:0/297741453 learned_addr learned my addr 172.21.15.80:0/297741453 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:25.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e11f69700 1 --2- 172.21.15.80:0/297741453 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c06c0a0 0x7f9e0c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:25.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e1276a700 1 -- 172.21.15.80:0/297741453 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c06c0a0 msgr2=0x7f9e0c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:25.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e1276a700 1 --2- 172.21.15.80:0/297741453 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c06c0a0 0x7f9e0c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:25.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e1276a700 1 -- 172.21.15.80:0/297741453 >> v1:172.21.15.174:6789/0 conn(0x7f9e0c0734e0 legacy=0x7f9e0c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:25.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e1276a700 1 -- 172.21.15.80:0/297741453 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c070a40 con 0x7f9e0c072620 2019-11-28T11:48:25.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e1276a700 1 --2- 172.21.15.80:0/297741453 >> v2:172.21.15.80:3300/0 conn(0x7f9e0c072620 0x7f9e0c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9e0400f6b0 tx=0x7f9e0400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:25.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e1276a700 1 --2- 172.21.15.80:0/297741453 >> v2:172.21.15.80:3300/0 conn(0x7f9e0c072620 0x7f9e0c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9e0400f6b0 tx=0x7f9e0400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:25.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e1276a700 1 --2- 172.21.15.80:0/297741453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e0c072620 0x7f9e0c164d70 secure :-1 s=READY pgs=1885 cs=0 l=1 rx=0x7f9e0400f6b0 tx=0x7f9e0400fa50).ready entity=mon.0 client_cookie=aea14f270627272 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:25.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e1276a700 1 --2- 172.21.15.80:0/297741453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e0c072620 0x7f9e0c164d70 secure :-1 s=THROTTLE_DONE pgs=1885 cs=0 l=1 rx=0x7f9e0400f6b0 tx=0x7f9e0400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:25.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e1276a700 1 --2- 172.21.15.80:0/297741453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e0c072620 0x7f9e0c164d70 secure :-1 s=THROTTLE_DONE pgs=1885 cs=0 l=1 rx=0x7f9e0400f6b0 tx=0x7f9e0400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:25.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e10f67700 1 -- 172.21.15.80:0/297741453 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e04000a70 con 0x7f9e0c072620 2019-11-28T11:48:25.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e1276a700 1 --2- 172.21.15.80:0/297741453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e0c072620 0x7f9e0c164d70 secure :-1 s=THROTTLE_DONE pgs=1885 cs=0 l=1 rx=0x7f9e0400f6b0 tx=0x7f9e0400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:25.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e10f67700 1 -- 172.21.15.80:0/297741453 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e040010e0 con 0x7f9e0c072620 2019-11-28T11:48:25.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.279+0000 7f9e10f67700 1 -- 172.21.15.80:0/297741453 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e040017b0 con 0x7f9e0c072620 2019-11-28T11:48:25.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.280+0000 7f9e139cc700 1 -- 172.21.15.80:0/297741453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e0c072620 msgr2=0x7f9e0c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:25.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.280+0000 7f9e139cc700 1 --2- 172.21.15.80:0/297741453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e0c072620 0x7f9e0c164d70 secure :-1 s=READY pgs=1885 cs=0 l=1 rx=0x7f9e0400f6b0 tx=0x7f9e0400fa50).stop 2019-11-28T11:48:25.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.280+0000 7f9e139cc700 1 -- 172.21.15.80:0/297741453 shutdown_connections 2019-11-28T11:48:25.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.280+0000 7f9e139cc700 1 --2- 172.21.15.80:0/297741453 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e0c072620 0x7f9e0c164d70 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:25.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.280+0000 7f9e139cc700 1 --2- 172.21.15.80:0/297741453 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c06c0a0 0x7f9e0c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:25.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.280+0000 7f9e139cc700 1 -- 172.21.15.80:0/297741453 shutdown_connections 2019-11-28T11:48:25.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.280+0000 7f9e139cc700 1 -- 172.21.15.80:0/297741453 wait complete. 2019-11-28T11:48:25.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.280+0000 7f9e139cc700 1 -- 172.21.15.80:0/297741453 >> 172.21.15.80:0/297741453 conn(0x7f9e0c061cf0 msgr2=0x7f9e0c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:25.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.283+0000 7f9e139cc700 1 Processor -- start 2019-11-28T11:48:25.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.283+0000 7f9e139cc700 1 -- start start 2019-11-28T11:48:25.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.283+0000 7f9e139cc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c105fa0 0x7f9e0c106430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:25.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.283+0000 7f9e139cc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c13bd00 con 0x7f9e0c164c20 2019-11-28T11:48:25.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.283+0000 7f9e139cc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c13ef90 con 0x7f9e0c13e8e0 2019-11-28T11:48:25.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.283+0000 7f9e139cc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c10df40 con 0x7f9e0c105fa0 2019-11-28T11:48:25.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9e1276a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9e0c164c20 0x7f9e0c1650c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40424/0 (socket says 172.21.15.80:40424) 2019-11-28T11:48:25.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9e1276a700 1 -- 172.21.15.80:0/4276177698 learned_addr learned my addr 172.21.15.80:0/4276177698 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:25.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9e11768700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c105fa0 0x7f9e0c106430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:25.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9dfe7fc700 1 -- 172.21.15.80:0/4276177698 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682487076 0 0) 0x7f9e040079e0 con 0x7f9e0c164c20 2019-11-28T11:48:25.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9dfe7fc700 1 -- 172.21.15.80:0/4276177698 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df4002e80 con 0x7f9e0c164c20 2019-11-28T11:48:25.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9dfe7fc700 1 -- 172.21.15.80:0/4276177698 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871789338 0 0) 0x7f9e00005720 con 0x7f9e0c13e8e0 2019-11-28T11:48:25.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9dfe7fc700 1 -- 172.21.15.80:0/4276177698 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df40030b0 con 0x7f9e0c13e8e0 2019-11-28T11:48:25.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9dfe7fc700 1 -- 172.21.15.80:0/4276177698 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3330187859 0 0) 0x7f9e04007580 con 0x7f9e0c164c20 2019-11-28T11:48:25.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9dfe7fc700 1 -- 172.21.15.80:0/4276177698 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9df40033c0 con 0x7f9e0c164c20 2019-11-28T11:48:25.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9dfe7fc700 1 -- 172.21.15.80:0/4276177698 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f9e04000b50 con 0x7f9e0c164c20 2019-11-28T11:48:25.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9e11768700 1 -- 172.21.15.80:0/4276177698 >> v1:172.21.15.174:6789/0 conn(0x7f9e0c13e8e0 legacy=0x7f9e0c14fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:25.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9e11768700 1 -- 172.21.15.80:0/4276177698 >> v1:172.21.15.80:6789/0 conn(0x7f9e0c164c20 legacy=0x7f9e0c1650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:25.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9e11768700 1 -- 172.21.15.80:0/4276177698 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c1048d0 con 0x7f9e0c105fa0 2019-11-28T11:48:25.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9e11768700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c105fa0 0x7f9e0c106430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9e08010720 tx=0x7f9e08010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:25.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9e11768700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c105fa0 0x7f9e0c106430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9e08010720 tx=0x7f9e08010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:25.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9e11768700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c105fa0 0x7f9e0c106430 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7f9e08010720 tx=0x7f9e08010ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:25.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9e11768700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c105fa0 0x7f9e0c106430 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f9e08010720 tx=0x7f9e08010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:25.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9dfe7fc700 1 -- 172.21.15.80:0/4276177698 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e08000ce0 con 0x7f9e0c105fa0 2019-11-28T11:48:25.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9e11768700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c105fa0 0x7f9e0c106430 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f9e08010720 tx=0x7f9e08010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:25.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9e11768700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c105fa0 0x7f9e0c106430 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f9e08010720 tx=0x7f9e08010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9dfe7fc700 1 -- 172.21.15.80:0/4276177698 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0800f270 con 0x7f9e0c105fa0 2019-11-28T11:48:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9e139cc700 1 -- 172.21.15.80:0/4276177698 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0c104c50 con 0x7f9e0c105fa0 2019-11-28T11:48:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.284+0000 7f9dfe7fc700 1 -- 172.21.15.80:0/4276177698 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0800f460 con 0x7f9e0c105fa0 2019-11-28T11:48:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.285+0000 7f9e139cc700 1 -- 172.21.15.80:0/4276177698 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c1048d0 con 0x7f9e0c105fa0 2019-11-28T11:48:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.285+0000 7f9e11768700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c105fa0 0x7f9e0c106430 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f9e08010720 tx=0x7f9e08010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:25.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.285+0000 7f9dfe7fc700 1 -- 172.21.15.80:0/4276177698 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9e0800f670 con 0x7f9e0c105fa0 2019-11-28T11:48:25.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.285+0000 7f9e11768700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c105fa0 0x7f9e0c106430 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f9e08010720 tx=0x7f9e08010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:25.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.285+0000 7f9dfe7fc700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9df40187a0 0x7f9df401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:25.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.286+0000 7f9dfe7fc700 1 -- 172.21.15.80:0/4276177698 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f9e08031df0 con 0x7f9e0c105fa0 2019-11-28T11:48:25.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.286+0000 7f9e11f69700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9df40187a0 0x7f9df401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:25.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.286+0000 7f9e11f69700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9df40187a0 0x7f9df401abf0 crc :-1 s=READY pgs=763 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:25.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.293+0000 7f9e139cc700 1 -- 172.21.15.80:0/4276177698 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c104c50 con 0x7f9e0c105fa0 2019-11-28T11:48:25.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.297+0000 7f9e11768700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c105fa0 0x7f9e0c106430 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f9e08010720 tx=0x7f9e08010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:25.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.297+0000 7f9dfe7fc700 1 -- 172.21.15.80:0/4276177698 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9e0800f460 con 0x7f9e0c105fa0 2019-11-28T11:48:25.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:25.469+0000 7f9e139cc700 1 -- 172.21.15.80:0/4276177698 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blacklisted"]} v 0) v1 -- 0x7f9e0c1048d0 con 0x7f9e0c105fa0 2019-11-28T11:48:26.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:26.375+0000 7f9e11768700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c105fa0 0x7f9e0c106430 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f9e08010720 tx=0x7f9e08010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:26.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:26.375+0000 7f9dfe7fc700 1 -- 172.21.15.80:0/4276177698 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blacklisted"]}]=0 v531) v1 ==== 167+0+0 (secure 0 0 0) 0x7f9e08017790 con 0x7f9e0c105fa0 2019-11-28T11:48:26.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:26.387+0000 7f9e139cc700 1 -- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9df40187a0 msgr2=0x7f9df401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:26.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:26.387+0000 7f9e139cc700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9df40187a0 0x7f9df401abf0 crc :-1 s=READY pgs=763 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:26.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:26.387+0000 7f9e139cc700 1 -- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c105fa0 msgr2=0x7f9e0c106430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:26.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:26.387+0000 7f9e139cc700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c105fa0 0x7f9e0c106430 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7f9e08010720 tx=0x7f9e08010ac0).stop 2019-11-28T11:48:26.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:26.387+0000 7f9e139cc700 1 -- 172.21.15.80:0/4276177698 shutdown_connections 2019-11-28T11:48:26.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:26.387+0000 7f9e139cc700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0c105fa0 0x7f9e0c106430 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:26.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:26.387+0000 7f9e139cc700 1 --2- 172.21.15.80:0/4276177698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9df40187a0 0x7f9df401abf0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:26.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:26.387+0000 7f9e139cc700 1 -- 172.21.15.80:0/4276177698 shutdown_connections 2019-11-28T11:48:26.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:26.387+0000 7f9e139cc700 1 -- 172.21.15.80:0/4276177698 wait complete. 2019-11-28T11:48:26.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:26.387+0000 7f9e139cc700 1 -- 172.21.15.80:0/4276177698 >> 172.21.15.80:0/4276177698 conn(0x7f9e0c13d620 msgr2=0x7f9e0c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:26.442 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:48:26.442 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:48:26.508 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:48:26.568 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:48:26.643 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:48:26.699 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:48:26.777 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:48:26.832 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:48:26.833 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:48:26.833 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:48:26.834 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:48:26.834 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:48:26.834 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:48:26.834 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:48:26.840 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:48:26.841 DEBUG:teuthology.parallel:result is None 2019-11-28T11:48:26.842 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:48:26.843 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:48:26.843 DEBUG:teuthology.parallel:result is None 2019-11-28T11:48:26.843 DEBUG:teuthology.parallel:result is None 2019-11-28T11:48:26.843 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:48:26.844 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:48:26.844 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:48:27.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.002+0000 7fcf25707700 1 Processor -- start 2019-11-28T11:48:27.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.002+0000 7fcf25707700 1 -- start start 2019-11-28T11:48:27.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcf25707700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf2006c490 0x7fcf2006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:27.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcf25707700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf2006ce60 0x7fcf20164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:27.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcf25707700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2006db00 con 0x7fcf2006c0a0 2019-11-28T11:48:27.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcf25707700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2006fd60 con 0x7fcf2006c490 2019-11-28T11:48:27.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcf25707700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf20070030 con 0x7fcf2006ce60 2019-11-28T11:48:27.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcf16ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf2006c490 0x7fcf2006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:27.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcf16ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf2006c490 0x7fcf2006c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41120/0 (socket says 172.21.15.80:41120) 2019-11-28T11:48:27.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcf16ffd700 1 -- 172.21.15.80:0/659213592 learned_addr learned my addr 172.21.15.80:0/659213592 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:27.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcf1ffff700 1 --2- 172.21.15.80:0/659213592 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf2006ce60 0x7fcf20164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:27.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcf16ffd700 1 -- 172.21.15.80:0/659213592 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf2006ce60 msgr2=0x7fcf20164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:27.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/659213592 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf2006ce60 0x7fcf20164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:27.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcf1effd700 1 -- 172.21.15.80:0/659213592 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732001644 0 0) 0x7fcf10001080 con 0x7fcf2006c0a0 2019-11-28T11:48:27.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcf16ffd700 1 -- 172.21.15.80:0/659213592 >> v1:172.21.15.174:6789/0 conn(0x7fcf2006c0a0 legacy=0x7fcf20072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcf16ffd700 1 -- 172.21.15.80:0/659213592 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf200706c0 con 0x7fcf2006c490 2019-11-28T11:48:27.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/659213592 >> v2:172.21.15.80:3300/0 conn(0x7fcf2006c490 0x7fcf2006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcf0800f740 tx=0x7fcf0800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/659213592 >> v2:172.21.15.80:3300/0 conn(0x7fcf2006c490 0x7fcf2006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcf0800f740 tx=0x7fcf0800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/659213592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf2006c490 0x7fcf2006c920 secure :-1 s=READY pgs=1890 cs=0 l=1 rx=0x7fcf0800f740 tx=0x7fcf0800fae0).ready entity=mon.0 client_cookie=a586841bae7f3b2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:27.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/659213592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf2006c490 0x7fcf2006c920 secure :-1 s=THROTTLE_DONE pgs=1890 cs=0 l=1 rx=0x7fcf0800f740 tx=0x7fcf0800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcf1effd700 1 -- 172.21.15.80:0/659213592 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf08000940 con 0x7fcf2006c490 2019-11-28T11:48:27.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/659213592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf2006c490 0x7fcf2006c920 secure :-1 s=THROTTLE_DONE pgs=1890 cs=0 l=1 rx=0x7fcf0800f740 tx=0x7fcf0800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/659213592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf2006c490 0x7fcf2006c920 secure :-1 s=THROTTLE_DONE pgs=1890 cs=0 l=1 rx=0x7fcf0800f740 tx=0x7fcf0800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcf1effd700 1 -- 172.21.15.80:0/659213592 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf08000c90 con 0x7fcf2006c490 2019-11-28T11:48:27.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcf1effd700 1 -- 172.21.15.80:0/659213592 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf08001320 con 0x7fcf2006c490 2019-11-28T11:48:27.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcf25707700 1 -- 172.21.15.80:0/659213592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf2006c490 msgr2=0x7fcf2006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcf25707700 1 --2- 172.21.15.80:0/659213592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf2006c490 0x7fcf2006c920 secure :-1 s=READY pgs=1890 cs=0 l=1 rx=0x7fcf0800f740 tx=0x7fcf0800fae0).stop 2019-11-28T11:48:27.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fcf25707700 1 -- 172.21.15.80:0/659213592 shutdown_connections 2019-11-28T11:48:27.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fcf25707700 1 --2- 172.21.15.80:0/659213592 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf2006ce60 0x7fcf20164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:27.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fcf25707700 1 --2- 172.21.15.80:0/659213592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf2006c490 0x7fcf2006c920 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fcf25707700 1 -- 172.21.15.80:0/659213592 shutdown_connections 2019-11-28T11:48:27.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fcf25707700 1 -- 172.21.15.80:0/659213592 wait complete. 2019-11-28T11:48:27.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fcf25707700 1 -- 172.21.15.80:0/659213592 >> 172.21.15.80:0/659213592 conn(0x7fcf20061cf0 msgr2=0x7fcf20064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:27.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.007+0000 7fcf25707700 1 Processor -- start 2019-11-28T11:48:27.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.008+0000 7fcf25707700 1 -- start start 2019-11-28T11:48:27.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf25707700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf2013a850 0x7fcf20118760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:27.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf25707700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf20118ca0 0x7fcf20117650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:27.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf25707700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2013e0c0 con 0x7fcf20117b90 2019-11-28T11:48:27.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf25707700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf20155140 con 0x7fcf2013a850 2019-11-28T11:48:27.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf25707700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2013b550 con 0x7fcf20118ca0 2019-11-28T11:48:27.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf16ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf20118ca0 0x7fcf20117650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:27.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf16ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf20118ca0 0x7fcf20117650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:43402/0 (socket says 172.21.15.80:43402) 2019-11-28T11:48:27.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf16ffd700 1 -- 172.21.15.80:0/3770199585 learned_addr learned my addr 172.21.15.80:0/3770199585 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:27.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf1f7fe700 1 --2- 172.21.15.80:0/3770199585 >> v2:172.21.15.80:3300/0 conn(0x7fcf2013a850 0x7fcf20118760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:27.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf16ffd700 1 -- 172.21.15.80:0/3770199585 >> v2:172.21.15.80:3300/0 conn(0x7fcf2013a850 msgr2=0x7fcf20118760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/3770199585 >> v2:172.21.15.80:3300/0 conn(0x7fcf2013a850 0x7fcf20118760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf16ffd700 1 -- 172.21.15.80:0/3770199585 >> v1:172.21.15.80:6789/0 conn(0x7fcf20117b90 legacy=0x7fcf20153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf16ffd700 1 -- 172.21.15.80:0/3770199585 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf201557d0 con 0x7fcf20118ca0 2019-11-28T11:48:27.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf20118ca0 0x7fcf20117650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcf08010400 tx=0x7fcf080107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf1f7fe700 1 --2- 172.21.15.80:0/3770199585 >> v2:172.21.15.80:3300/0 conn(0x7fcf2013a850 0x7fcf20118760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:48:27.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf20118ca0 0x7fcf20117650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcf08010400 tx=0x7fcf080107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf20118ca0 0x7fcf20117650 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7fcf08010400 tx=0x7fcf080107a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:27.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf20118ca0 0x7fcf20117650 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fcf08010400 tx=0x7fcf080107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf20118ca0 0x7fcf20117650 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fcf08010400 tx=0x7fcf080107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcf1cff9700 1 -- 172.21.15.80:0/3770199585 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf08007210 con 0x7fcf20118ca0 2019-11-28T11:48:27.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf20118ca0 0x7fcf20117650 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fcf08010400 tx=0x7fcf080107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcf1cff9700 1 -- 172.21.15.80:0/3770199585 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf08005370 con 0x7fcf20118ca0 2019-11-28T11:48:27.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcf25707700 1 -- 172.21.15.80:0/3770199585 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf20155b50 con 0x7fcf20118ca0 2019-11-28T11:48:27.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcf1cff9700 1 -- 172.21.15.80:0/3770199585 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf08005a00 con 0x7fcf20118ca0 2019-11-28T11:48:27.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcf25707700 1 -- 172.21.15.80:0/3770199585 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf201557d0 con 0x7fcf20118ca0 2019-11-28T11:48:27.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf20118ca0 0x7fcf20117650 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fcf08010400 tx=0x7fcf080107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcf1cff9700 1 -- 172.21.15.80:0/3770199585 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcf08005560 con 0x7fcf20118ca0 2019-11-28T11:48:27.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf20118ca0 0x7fcf20117650 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fcf08010400 tx=0x7fcf080107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcf1cff9700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf04018730 0x7fcf0401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:27.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcf1cff9700 1 -- 172.21.15.80:0/3770199585 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fcf08031d10 con 0x7fcf20118ca0 2019-11-28T11:48:27.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.011+0000 7fcf1f7fe700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf04018730 0x7fcf0401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:27.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.011+0000 7fcf1f7fe700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf04018730 0x7fcf0401abe0 crc :-1 s=READY pgs=764 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:27.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.017+0000 7fcf25707700 1 -- 172.21.15.80:0/3770199585 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf20155b50 con 0x7fcf20118ca0 2019-11-28T11:48:27.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.002+0000 7fcd8afd2700 1 Processor -- start 2019-11-28T11:48:27.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.002+0000 7fcd8afd2700 1 -- start start 2019-11-28T11:48:27.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcd8afd2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd8406c0a0 0x7fcd84072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:27.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcd8afd2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcd84072620 0x7fcd84164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:27.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcd8afd2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8406db00 con 0x7fcd840734e0 2019-11-28T11:48:27.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcd8afd2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8406fd60 con 0x7fcd8406c0a0 2019-11-28T11:48:27.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcd8afd2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd84070030 con 0x7fcd84072620 2019-11-28T11:48:27.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcd8956f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd8406c0a0 0x7fcd84072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:27.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcd88d6e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcd840734e0 0x7fcd84071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40428/0 (socket says 172.21.15.80:40428) 2019-11-28T11:48:27.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcd88d6e700 1 -- 172.21.15.80:0/3606821168 learned_addr learned my addr 172.21.15.80:0/3606821168 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:27.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fcd89d70700 1 --2- 172.21.15.80:0/3606821168 >> v2:172.21.15.174:3300/0 conn(0x7fcd84072620 0x7fcd84164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:27.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd8956f700 1 -- 172.21.15.80:0/3606821168 >> v2:172.21.15.174:3300/0 conn(0x7fcd84072620 msgr2=0x7fcd84164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:27.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd8956f700 1 --2- 172.21.15.80:0/3606821168 >> v2:172.21.15.174:3300/0 conn(0x7fcd84072620 0x7fcd84164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:27.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd8956f700 1 -- 172.21.15.80:0/3606821168 >> v1:172.21.15.80:6789/0 conn(0x7fcd840734e0 legacy=0x7fcd84071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd7bfff700 1 -- 172.21.15.80:0/3606821168 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293576018 0 0) 0x7fcd74001170 con 0x7fcd840734e0 2019-11-28T11:48:27.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd8956f700 1 -- 172.21.15.80:0/3606821168 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd840706c0 con 0x7fcd8406c0a0 2019-11-28T11:48:27.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd89d70700 1 --2- 172.21.15.80:0/3606821168 >> v2:172.21.15.174:3300/0 conn(0x7fcd84072620 0x7fcd84164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:48:27.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd8956f700 1 --2- 172.21.15.80:0/3606821168 >> v2:172.21.15.80:3300/0 conn(0x7fcd8406c0a0 0x7fcd84072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcd8000af50 tx=0x7fcd8000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd8956f700 1 --2- 172.21.15.80:0/3606821168 >> v2:172.21.15.80:3300/0 conn(0x7fcd8406c0a0 0x7fcd84072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcd8000af50 tx=0x7fcd8000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd8956f700 1 --2- 172.21.15.80:0/3606821168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd8406c0a0 0x7fcd84072fa0 secure :-1 s=READY pgs=1891 cs=0 l=1 rx=0x7fcd8000af50 tx=0x7fcd8000b760).ready entity=mon.0 client_cookie=95f13f134b059b7c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:27.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd8956f700 1 --2- 172.21.15.80:0/3606821168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd8406c0a0 0x7fcd84072fa0 secure :-1 s=THROTTLE_DONE pgs=1891 cs=0 l=1 rx=0x7fcd8000af50 tx=0x7fcd8000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd7bfff700 1 -- 172.21.15.80:0/3606821168 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd80007210 con 0x7fcd8406c0a0 2019-11-28T11:48:27.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd8956f700 1 --2- 172.21.15.80:0/3606821168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd8406c0a0 0x7fcd84072fa0 secure :-1 s=THROTTLE_DONE pgs=1891 cs=0 l=1 rx=0x7fcd8000af50 tx=0x7fcd8000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd8956f700 1 --2- 172.21.15.80:0/3606821168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd8406c0a0 0x7fcd84072fa0 secure :-1 s=THROTTLE_DONE pgs=1891 cs=0 l=1 rx=0x7fcd8000af50 tx=0x7fcd8000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd7bfff700 1 -- 172.21.15.80:0/3606821168 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd800099b0 con 0x7fcd8406c0a0 2019-11-28T11:48:27.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd7bfff700 1 -- 172.21.15.80:0/3606821168 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd8000a080 con 0x7fcd8406c0a0 2019-11-28T11:48:27.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd8afd2700 1 -- 172.21.15.80:0/3606821168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd8406c0a0 msgr2=0x7fcd84072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fcd8afd2700 1 --2- 172.21.15.80:0/3606821168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd8406c0a0 0x7fcd84072fa0 secure :-1 s=READY pgs=1891 cs=0 l=1 rx=0x7fcd8000af50 tx=0x7fcd8000b760).stop 2019-11-28T11:48:27.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fcd8afd2700 1 -- 172.21.15.80:0/3606821168 shutdown_connections 2019-11-28T11:48:27.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fcd8afd2700 1 --2- 172.21.15.80:0/3606821168 >> v2:172.21.15.174:3300/0 conn(0x7fcd84072620 0x7fcd84164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:27.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fcd8afd2700 1 --2- 172.21.15.80:0/3606821168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd8406c0a0 0x7fcd84072fa0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fcd8afd2700 1 -- 172.21.15.80:0/3606821168 shutdown_connections 2019-11-28T11:48:27.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fcd8afd2700 1 -- 172.21.15.80:0/3606821168 wait complete. 2019-11-28T11:48:27.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fcd8afd2700 1 -- 172.21.15.80:0/3606821168 >> 172.21.15.80:0/3606821168 conn(0x7fcd84061cf0 msgr2=0x7fcd84064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:27.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.007+0000 7fcd8afd2700 1 Processor -- start 2019-11-28T11:48:27.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.007+0000 7fcd8afd2700 1 -- start start 2019-11-28T11:48:27.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.008+0000 7fcd8afd2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd8413e8e0 0x7fcd8410ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:27.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd8afd2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcd8410b1c0 0x7fcd84165eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:27.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd8afd2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd84109200 con 0x7fcd841663f0 2019-11-28T11:48:27.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd8afd2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8413ecd0 con 0x7fcd8410b1c0 2019-11-28T11:48:27.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd8afd2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd841044c0 con 0x7fcd8413e8e0 2019-11-28T11:48:27.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd8956f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd8413e8e0 0x7fcd8410ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:27.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd88d6e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcd8410b1c0 0x7fcd84165eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:27.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd8956f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd8413e8e0 0x7fcd8410ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:43392/0 (socket says 172.21.15.80:43392) 2019-11-28T11:48:27.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd88d6e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcd8410b1c0 0x7fcd84165eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:56022/0 (socket says 172.21.15.80:56022) 2019-11-28T11:48:27.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd8956f700 1 -- 172.21.15.80:0/1506810878 learned_addr learned my addr 172.21.15.80:0/1506810878 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:27.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd88d6e700 1 -- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd8413e8e0 msgr2=0x7fcd8410ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd88d6e700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd8413e8e0 0x7fcd8410ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd88d6e700 1 -- 172.21.15.80:0/1506810878 >> v1:172.21.15.80:6789/0 conn(0x7fcd841663f0 legacy=0x7fcd84109b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd79ffb700 1 -- 172.21.15.80:0/1506810878 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633849493 0 0) 0x7fcd7c00ab90 con 0x7fcd841663f0 2019-11-28T11:48:27.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd88d6e700 1 -- 172.21.15.80:0/1506810878 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd84105850 con 0x7fcd8410b1c0 2019-11-28T11:48:27.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd88d6e700 1 --2- 172.21.15.80:0/1506810878 >> v2:172.21.15.174:3300/0 conn(0x7fcd8410b1c0 0x7fcd84165eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd74010380 tx=0x7fcd74010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd88d6e700 1 --2- 172.21.15.80:0/1506810878 >> v2:172.21.15.174:3300/0 conn(0x7fcd8410b1c0 0x7fcd84165eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd74010380 tx=0x7fcd74010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fcd88d6e700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd8410b1c0 0x7fcd84165eb0 secure :-1 s=READY pgs=1102 cs=0 l=1 rx=0x7fcd74010380 tx=0x7fcd74010180).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:27.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcd88d6e700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd8410b1c0 0x7fcd84165eb0 secure :-1 s=THROTTLE_DONE pgs=1102 cs=0 l=1 rx=0x7fcd74010380 tx=0x7fcd74010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcd79ffb700 1 -- 172.21.15.80:0/1506810878 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd74000d40 con 0x7fcd8410b1c0 2019-11-28T11:48:27.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcd88d6e700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd8410b1c0 0x7fcd84165eb0 secure :-1 s=THROTTLE_DONE pgs=1102 cs=0 l=1 rx=0x7fcd74010380 tx=0x7fcd74010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcd88d6e700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd8410b1c0 0x7fcd84165eb0 secure :-1 s=THROTTLE_DONE pgs=1102 cs=0 l=1 rx=0x7fcd74010380 tx=0x7fcd74010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcd79ffb700 1 -- 172.21.15.80:0/1506810878 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd74004240 con 0x7fcd8410b1c0 2019-11-28T11:48:27.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcd79ffb700 1 -- 172.21.15.80:0/1506810878 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd740048d0 con 0x7fcd8410b1c0 2019-11-28T11:48:27.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcd8afd2700 1 -- 172.21.15.80:0/1506810878 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd84105bd0 con 0x7fcd8410b1c0 2019-11-28T11:48:27.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcd8afd2700 1 -- 172.21.15.80:0/1506810878 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd84105850 con 0x7fcd8410b1c0 2019-11-28T11:48:27.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.010+0000 7fcd88d6e700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd8410b1c0 0x7fcd84165eb0 secure :-1 s=THROTTLE_DONE pgs=1102 cs=0 l=1 rx=0x7fcd74010380 tx=0x7fcd74010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.011+0000 7fcd79ffb700 1 -- 172.21.15.80:0/1506810878 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcd74000c90 con 0x7fcd8410b1c0 2019-11-28T11:48:27.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.011+0000 7fcd88d6e700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd8410b1c0 0x7fcd84165eb0 secure :-1 s=THROTTLE_DONE pgs=1102 cs=0 l=1 rx=0x7fcd74010380 tx=0x7fcd74010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.011+0000 7fcd79ffb700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd64018730 0x7fcd6401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:27.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.011+0000 7fcd79ffb700 1 -- 172.21.15.80:0/1506810878 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fcd740319e0 con 0x7fcd8410b1c0 2019-11-28T11:48:27.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.011+0000 7fcd8956f700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd64018730 0x7fcd6401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:27.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.011+0000 7fcd8956f700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd64018730 0x7fcd6401abc0 crc :-1 s=READY pgs=765 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:27.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.017+0000 7fcd8afd2700 1 -- 172.21.15.80:0/1506810878 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd84105bd0 con 0x7fcd8410b1c0 2019-11-28T11:48:27.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.002+0000 7fd77412f700 1 Processor -- start 2019-11-28T11:48:27.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.002+0000 7fd77412f700 1 -- start start 2019-11-28T11:48:27.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fd77412f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd76c06c0a0 0x7fd76c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:27.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fd77412f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd76c0734e0 0x7fd76c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:27.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fd77412f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76c06db00 con 0x7fd76c072360 2019-11-28T11:48:27.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fd77412f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76c06fd60 con 0x7fd76c0734e0 2019-11-28T11:48:27.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fd77412f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76c070030 con 0x7fd76c06c0a0 2019-11-28T11:48:27.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fd771ecb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd76c0734e0 0x7fd76c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:27.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fd772ecd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd76c072360 0x7fd76c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40438/0 (socket says 172.21.15.80:40438) 2019-11-28T11:48:27.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fd772ecd700 1 -- 172.21.15.80:0/561247454 learned_addr learned my addr 172.21.15.80:0/561247454 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:27.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fd7726cc700 1 --2- 172.21.15.80:0/561247454 >> v2:172.21.15.174:3300/0 conn(0x7fd76c06c0a0 0x7fd76c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:27.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fd771ecb700 1 -- 172.21.15.80:0/561247454 >> v2:172.21.15.174:3300/0 conn(0x7fd76c06c0a0 msgr2=0x7fd76c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:27.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fd771ecb700 1 --2- 172.21.15.80:0/561247454 >> v2:172.21.15.174:3300/0 conn(0x7fd76c06c0a0 0x7fd76c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:27.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.003+0000 7fd771ecb700 1 -- 172.21.15.80:0/561247454 >> v1:172.21.15.80:6789/0 conn(0x7fd76c072360 legacy=0x7fd76c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fd771ecb700 1 -- 172.21.15.80:0/561247454 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c0706c0 con 0x7fd76c0734e0 2019-11-28T11:48:27.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fd7726cc700 1 --2- 172.21.15.80:0/561247454 >> v2:172.21.15.174:3300/0 conn(0x7fd76c06c0a0 0x7fd76c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:48:27.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fd771ecb700 1 --2- 172.21.15.80:0/561247454 >> v2:172.21.15.80:3300/0 conn(0x7fd76c0734e0 0x7fd76c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd75c00af50 tx=0x7fd75c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fd771ecb700 1 --2- 172.21.15.80:0/561247454 >> v2:172.21.15.80:3300/0 conn(0x7fd76c0734e0 0x7fd76c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd75c00af50 tx=0x7fd75c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fd771ecb700 1 --2- 172.21.15.80:0/561247454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0734e0 0x7fd76c071e20 secure :-1 s=READY pgs=1889 cs=0 l=1 rx=0x7fd75c00af50 tx=0x7fd75c00b760).ready entity=mon.0 client_cookie=2c3a2400093b18aa server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:27.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fd771ecb700 1 --2- 172.21.15.80:0/561247454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0734e0 0x7fd76c071e20 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7fd75c00af50 tx=0x7fd75c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fd771ecb700 1 --2- 172.21.15.80:0/561247454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0734e0 0x7fd76c071e20 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7fd75c00af50 tx=0x7fd75c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fd771ecb700 1 --2- 172.21.15.80:0/561247454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0734e0 0x7fd76c071e20 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7fd75c00af50 tx=0x7fd75c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fd7716ca700 1 -- 172.21.15.80:0/561247454 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75c007210 con 0x7fd76c0734e0 2019-11-28T11:48:27.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fd7716ca700 1 -- 172.21.15.80:0/561247454 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c0099b0 con 0x7fd76c0734e0 2019-11-28T11:48:27.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fd7716ca700 1 -- 172.21.15.80:0/561247454 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75c00a040 con 0x7fd76c0734e0 2019-11-28T11:48:27.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fd77412f700 1 -- 172.21.15.80:0/561247454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0734e0 msgr2=0x7fd76c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.004+0000 7fd77412f700 1 --2- 172.21.15.80:0/561247454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0734e0 0x7fd76c071e20 secure :-1 s=READY pgs=1889 cs=0 l=1 rx=0x7fd75c00af50 tx=0x7fd75c00b760).stop 2019-11-28T11:48:27.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fd77412f700 1 -- 172.21.15.80:0/561247454 shutdown_connections 2019-11-28T11:48:27.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fd77412f700 1 --2- 172.21.15.80:0/561247454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0734e0 0x7fd76c071e20 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fd77412f700 1 --2- 172.21.15.80:0/561247454 >> v2:172.21.15.174:3300/0 conn(0x7fd76c06c0a0 0x7fd76c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:27.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fd77412f700 1 -- 172.21.15.80:0/561247454 shutdown_connections 2019-11-28T11:48:27.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fd77412f700 1 -- 172.21.15.80:0/561247454 wait complete. 2019-11-28T11:48:27.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.005+0000 7fd77412f700 1 -- 172.21.15.80:0/561247454 >> 172.21.15.80:0/561247454 conn(0x7fd76c061cf0 msgr2=0x7fd76c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:27.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.007+0000 7fd77412f700 1 Processor -- start 2019-11-28T11:48:27.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.007+0000 7fd77412f700 1 -- start start 2019-11-28T11:48:27.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.008+0000 7fd77412f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd76c0741a0 0x7fd76c117630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:27.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.008+0000 7fd77412f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd76c117b70 0x7fd76c1164b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:27.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.008+0000 7fd77412f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd76c1169f0 0x7fd76c116e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:27.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.008+0000 7fd77412f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76c076e40 con 0x7fd76c0741a0 2019-11-28T11:48:27.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.008+0000 7fd77412f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76c077110 con 0x7fd76c117b70 2019-11-28T11:48:27.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.008+0000 7fd77412f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c076410 con 0x7fd76c1169f0 2019-11-28T11:48:27.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.008+0000 7fd7726cc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd76c0741a0 0x7fd76c117630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:27.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.008+0000 7fd7726cc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd76c0741a0 0x7fd76c117630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41126/0 (socket says 172.21.15.80:41126) 2019-11-28T11:48:27.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.008+0000 7fd7726cc700 1 -- 172.21.15.80:0/3768315977 learned_addr learned my addr 172.21.15.80:0/3768315977 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:27.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.008+0000 7fd772ecd700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd76c1169f0 0x7fd76c116e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:27.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd771ecb700 1 --2- 172.21.15.80:0/3768315977 >> v2:172.21.15.174:3300/0 conn(0x7fd76c117b70 0x7fd76c1164b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:27.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd7726cc700 1 -- 172.21.15.80:0/3768315977 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd76c1169f0 msgr2=0x7fd76c116e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd7726cc700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd76c1169f0 0x7fd76c116e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd7726cc700 1 -- 172.21.15.80:0/3768315977 >> v2:172.21.15.174:3300/0 conn(0x7fd76c117b70 msgr2=0x7fd76c1164b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd7726cc700 1 --2- 172.21.15.80:0/3768315977 >> v2:172.21.15.174:3300/0 conn(0x7fd76c117b70 0x7fd76c1164b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd7726cc700 1 -- 172.21.15.80:0/3768315977 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c0777a0 con 0x7fd76c0741a0 2019-11-28T11:48:27.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd7726cc700 1 --2- 172.21.15.80:0/3768315977 >> v2:172.21.15.80:3300/0 conn(0x7fd76c0741a0 0x7fd76c117630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd76800a050 tx=0x7fd76800d2a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd7726cc700 1 --2- 172.21.15.80:0/3768315977 >> v2:172.21.15.80:3300/0 conn(0x7fd76c0741a0 0x7fd76c117630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd76800a050 tx=0x7fd76800d2a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd7726cc700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0741a0 0x7fd76c117630 secure :-1 s=READY pgs=1893 cs=0 l=1 rx=0x7fd76800a050 tx=0x7fd76800d2a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:27.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd7726cc700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0741a0 0x7fd76c117630 secure :-1 s=THROTTLE_DONE pgs=1893 cs=0 l=1 rx=0x7fd76800a050 tx=0x7fd76800d2a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd762ffd700 1 -- 172.21.15.80:0/3768315977 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd768009770 con 0x7fd76c0741a0 2019-11-28T11:48:27.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd7726cc700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0741a0 0x7fd76c117630 secure :-1 s=THROTTLE_DONE pgs=1893 cs=0 l=1 rx=0x7fd76800a050 tx=0x7fd76800d2a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd7726cc700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0741a0 0x7fd76c117630 secure :-1 s=THROTTLE_DONE pgs=1893 cs=0 l=1 rx=0x7fd76800a050 tx=0x7fd76800d2a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd77412f700 1 -- 172.21.15.80:0/3768315977 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76c077b20 con 0x7fd76c0741a0 2019-11-28T11:48:27.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd762ffd700 1 -- 172.21.15.80:0/3768315977 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76800a7d0 con 0x7fd76c0741a0 2019-11-28T11:48:27.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd77412f700 1 -- 172.21.15.80:0/3768315977 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76c0777a0 con 0x7fd76c0741a0 2019-11-28T11:48:27.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.009+0000 7fd762ffd700 1 -- 172.21.15.80:0/3768315977 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7680094b0 con 0x7fd76c0741a0 2019-11-28T11:48:27.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.011+0000 7fd7726cc700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0741a0 0x7fd76c117630 secure :-1 s=THROTTLE_DONE pgs=1893 cs=0 l=1 rx=0x7fd76800a050 tx=0x7fd76800d2a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.011+0000 7fd762ffd700 1 -- 172.21.15.80:0/3768315977 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd76800a9c0 con 0x7fd76c0741a0 2019-11-28T11:48:27.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.011+0000 7fd7726cc700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0741a0 0x7fd76c117630 secure :-1 s=THROTTLE_DONE pgs=1893 cs=0 l=1 rx=0x7fd76800a050 tx=0x7fd76800d2a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.011+0000 7fd762ffd700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd754018730 0x7fd75401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:27.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.011+0000 7fd762ffd700 1 -- 172.21.15.80:0/3768315977 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fd768031c20 con 0x7fd76c0741a0 2019-11-28T11:48:27.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.011+0000 7fd771ecb700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd754018730 0x7fd75401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:27.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.011+0000 7fd771ecb700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd754018730 0x7fd75401abe0 crc :-1 s=READY pgs=766 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:27.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.017+0000 7fd77412f700 1 -- 172.21.15.80:0/3768315977 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76c077b20 con 0x7fd76c0741a0 2019-11-28T11:48:27.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.021+0000 7fd7726cc700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0741a0 0x7fd76c117630 secure :-1 s=THROTTLE_DONE pgs=1893 cs=0 l=1 rx=0x7fd76800a050 tx=0x7fd76800d2a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.021+0000 7fd762ffd700 1 -- 172.21.15.80:0/3768315977 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd76800a5c0 con 0x7fd76c0741a0 2019-11-28T11:48:27.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.021+0000 7fcd88d6e700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd8410b1c0 0x7fcd84165eb0 secure :-1 s=THROTTLE_DONE pgs=1102 cs=0 l=1 rx=0x7fcd74010380 tx=0x7fcd74010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.021+0000 7fcd79ffb700 1 -- 172.21.15.80:0/1506810878 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcd74001220 con 0x7fcd8410b1c0 2019-11-28T11:48:27.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.021+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf20118ca0 0x7fcf20117650 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fcf08010400 tx=0x7fcf080107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.021+0000 7fcf1cff9700 1 -- 172.21.15.80:0/3770199585 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcf080078a0 con 0x7fcf20118ca0 2019-11-28T11:48:27.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.202+0000 7fd77412f700 1 -- 172.21.15.80:0/3768315977 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7fd76c0777a0 con 0x7fd76c0741a0 2019-11-28T11:48:27.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.374+0000 7fcf25707700 1 -- 172.21.15.80:0/3770199585 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7fcf201557d0 con 0x7fcf20118ca0 2019-11-28T11:48:27.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.375+0000 7fcd8afd2700 1 -- 172.21.15.80:0/1506810878 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fcd84105850 con 0x7fcd8410b1c0 2019-11-28T11:48:27.769 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:48:27.724+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:48:27.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.726+0000 7fd7726cc700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0741a0 0x7fd76c117630 secure :-1 s=THROTTLE_DONE pgs=1893 cs=0 l=1 rx=0x7fd76800a050 tx=0x7fd76800d2a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.726+0000 7fd762ffd700 1 -- 172.21.15.80:0/3768315977 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 9360 v108) v1 ==== 95+0+0 (secure 0 0 0) 0x7fd76800a5c0 con 0x7fd76c0741a0 2019-11-28T11:48:27.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.727+0000 7fcf16ffd700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf20118ca0 0x7fcf20117650 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fcf08010400 tx=0x7fcf080107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.727+0000 7fcf1cff9700 1 -- 172.21.15.80:0/3770199585 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 9348 v108) v1 ==== 95+0+0 (secure 0 0 0) 0x7fcf08005370 con 0x7fcf20118ca0 2019-11-28T11:48:27.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.727+0000 7fcd88d6e700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd8410b1c0 0x7fcd84165eb0 secure :-1 s=THROTTLE_DONE pgs=1102 cs=0 l=1 rx=0x7fcd74010380 tx=0x7fcd74010180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:27.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.727+0000 7fcd79ffb700 1 -- 172.21.15.80:0/1506810878 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 8752 v108) v1 ==== 95+0+0 (secure 0 0 0) 0x7fcd74000c90 con 0x7fcd8410b1c0 2019-11-28T11:48:27.783 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 9348 2019-11-28T11:48:27.784 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 8752 2019-11-28T11:48:27.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.741+0000 7fcf25707700 1 -- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf04018730 msgr2=0x7fcf0401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.741+0000 7fcf25707700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf04018730 0x7fcf0401abe0 crc :-1 s=READY pgs=764 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.741+0000 7fcf25707700 1 -- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf20118ca0 msgr2=0x7fcf20117650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.741+0000 7fcf25707700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf20118ca0 0x7fcf20117650 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7fcf08010400 tx=0x7fcf080107a0).stop 2019-11-28T11:48:27.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.741+0000 7fcf25707700 1 -- 172.21.15.80:0/3770199585 shutdown_connections 2019-11-28T11:48:27.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.741+0000 7fcf25707700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf04018730 0x7fcf0401abe0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.741+0000 7fcf25707700 1 --2- 172.21.15.80:0/3770199585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf20118ca0 0x7fcf20117650 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.741+0000 7fcf25707700 1 --2- 172.21.15.80:0/3770199585 >> v2:172.21.15.80:3300/0 conn(0x7fcf2013a850 0x7fcf20118760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.741+0000 7fcf25707700 1 -- 172.21.15.80:0/3770199585 shutdown_connections 2019-11-28T11:48:27.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.741+0000 7fcf25707700 1 -- 172.21.15.80:0/3770199585 wait complete. 2019-11-28T11:48:27.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.741+0000 7fcf25707700 1 -- 172.21.15.80:0/3770199585 >> 172.21.15.80:0/3770199585 conn(0x7fcf2011a910 msgr2=0x7fcf201413c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:27.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.742+0000 7fcd8afd2700 1 -- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd64018730 msgr2=0x7fcd6401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.742+0000 7fcd8afd2700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd64018730 0x7fcd6401abc0 crc :-1 s=READY pgs=765 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.742+0000 7fcd8afd2700 1 -- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd8410b1c0 msgr2=0x7fcd84165eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.742+0000 7fcd8afd2700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd8410b1c0 0x7fcd84165eb0 secure :-1 s=READY pgs=1102 cs=0 l=1 rx=0x7fcd74010380 tx=0x7fcd74010180).stop 2019-11-28T11:48:27.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.742+0000 7fcd8afd2700 1 -- 172.21.15.80:0/1506810878 shutdown_connections 2019-11-28T11:48:27.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.742+0000 7fcd8afd2700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd64018730 0x7fcd6401abc0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.742+0000 7fcd8afd2700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd8410b1c0 0x7fcd84165eb0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.742+0000 7fcd8afd2700 1 --2- 172.21.15.80:0/1506810878 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd8413e8e0 0x7fcd8410ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.742+0000 7fcd8afd2700 1 -- 172.21.15.80:0/1506810878 shutdown_connections 2019-11-28T11:48:27.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.742+0000 7fcd8afd2700 1 -- 172.21.15.80:0/1506810878 wait complete. 2019-11-28T11:48:27.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.742+0000 7fcd8afd2700 1 -- 172.21.15.80:0/1506810878 >> 172.21.15.80:0/1506810878 conn(0x7fcd8413d620 msgr2=0x7fcd8413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:27.801 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:48:27.801 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:48:27.811 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 9360 2019-11-28T11:48:27.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.769+0000 7fd77412f700 1 -- 172.21.15.80:0/3768315977 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd754018730 msgr2=0x7fd75401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.769+0000 7fd77412f700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd754018730 0x7fd75401abe0 crc :-1 s=READY pgs=766 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.769+0000 7fd77412f700 1 -- 172.21.15.80:0/3768315977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0741a0 msgr2=0x7fd76c117630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:27.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.769+0000 7fd77412f700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0741a0 0x7fd76c117630 secure :-1 s=READY pgs=1893 cs=0 l=1 rx=0x7fd76800a050 tx=0x7fd76800d2a0).stop 2019-11-28T11:48:27.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.769+0000 7fd77412f700 1 -- 172.21.15.80:0/3768315977 shutdown_connections 2019-11-28T11:48:27.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.769+0000 7fd77412f700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd754018730 0x7fd75401abe0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.769+0000 7fd77412f700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd76c1169f0 0x7fd76c116e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.769+0000 7fd77412f700 1 --2- 172.21.15.80:0/3768315977 >> v2:172.21.15.174:3300/0 conn(0x7fd76c117b70 0x7fd76c1164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.769+0000 7fd77412f700 1 --2- 172.21.15.80:0/3768315977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76c0741a0 0x7fd76c117630 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:27.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.769+0000 7fd77412f700 1 -- 172.21.15.80:0/3768315977 shutdown_connections 2019-11-28T11:48:27.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.769+0000 7fd77412f700 1 -- 172.21.15.80:0/3768315977 wait complete. 2019-11-28T11:48:27.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.769+0000 7fd77412f700 1 -- 172.21.15.80:0/3768315977 >> 172.21.15.80:0/3768315977 conn(0x7fd76c13d930 msgr2=0x7fd76c07b940 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:27.823 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:48:27.824 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:48:28.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.961+0000 7fba76b41700 1 Processor -- start 2019-11-28T11:48:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.961+0000 7fba76b41700 1 -- start start 2019-11-28T11:48:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.962+0000 7fba76b41700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba7006c490 0x7fba7006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.962+0000 7fba76b41700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fba7006ce60 0x7fba70164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.962+0000 7fba76b41700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7006db00 con 0x7fba7006c0a0 2019-11-28T11:48:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.962+0000 7fba76b41700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7006fd60 con 0x7fba7006c490 2019-11-28T11:48:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.962+0000 7fba76b41700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba70070030 con 0x7fba7006ce60 2019-11-28T11:48:28.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.962+0000 7fba748dd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba7006c490 0x7fba7006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.962+0000 7fba748dd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba7006c490 0x7fba7006c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41154/0 (socket says 172.21.15.80:41154) 2019-11-28T11:48:28.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.962+0000 7fba748dd700 1 -- 172.21.15.80:0/2373531176 learned_addr learned my addr 172.21.15.80:0/2373531176 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:28.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.962+0000 7fba758df700 1 --2- 172.21.15.80:0/2373531176 >> v2:172.21.15.174:3300/0 conn(0x7fba7006ce60 0x7fba70164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.963+0000 7fba748dd700 1 -- 172.21.15.80:0/2373531176 >> v2:172.21.15.174:3300/0 conn(0x7fba7006ce60 msgr2=0x7fba70164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:28.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.963+0000 7fba748dd700 1 --2- 172.21.15.80:0/2373531176 >> v2:172.21.15.174:3300/0 conn(0x7fba7006ce60 0x7fba70164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:28.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.963+0000 7fba748dd700 1 -- 172.21.15.80:0/2373531176 >> v1:172.21.15.174:6789/0 conn(0x7fba7006c0a0 legacy=0x7fba70072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.963+0000 7fba748dd700 1 -- 172.21.15.80:0/2373531176 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba700706c0 con 0x7fba7006c490 2019-11-28T11:48:28.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.963+0000 7fba748dd700 1 --2- 172.21.15.80:0/2373531176 >> v2:172.21.15.80:3300/0 conn(0x7fba7006c490 0x7fba7006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fba6000f6c0 tx=0x7fba6000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.963+0000 7fba748dd700 1 --2- 172.21.15.80:0/2373531176 >> v2:172.21.15.80:3300/0 conn(0x7fba7006c490 0x7fba7006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fba6000f6c0 tx=0x7fba6000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.963+0000 7fba748dd700 1 --2- 172.21.15.80:0/2373531176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7006c490 0x7fba7006c920 secure :-1 s=READY pgs=1895 cs=0 l=1 rx=0x7fba6000f6c0 tx=0x7fba6000fa60).ready entity=mon.0 client_cookie=44b17cc2ae26e4c8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:28.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.963+0000 7fba748dd700 1 --2- 172.21.15.80:0/2373531176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7006c490 0x7fba7006c920 secure :-1 s=THROTTLE_DONE pgs=1895 cs=0 l=1 rx=0x7fba6000f6c0 tx=0x7fba6000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.963+0000 7fba748dd700 1 --2- 172.21.15.80:0/2373531176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7006c490 0x7fba7006c920 secure :-1 s=THROTTLE_DONE pgs=1895 cs=0 l=1 rx=0x7fba6000f6c0 tx=0x7fba6000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.963+0000 7fba6ffff700 1 -- 172.21.15.80:0/2373531176 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba60000960 con 0x7fba7006c490 2019-11-28T11:48:28.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.963+0000 7fba748dd700 1 --2- 172.21.15.80:0/2373531176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7006c490 0x7fba7006c920 secure :-1 s=THROTTLE_DONE pgs=1895 cs=0 l=1 rx=0x7fba6000f6c0 tx=0x7fba6000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.963+0000 7fba6ffff700 1 -- 172.21.15.80:0/2373531176 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba60000c90 con 0x7fba7006c490 2019-11-28T11:48:28.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.963+0000 7fba6ffff700 1 -- 172.21.15.80:0/2373531176 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba600013a0 con 0x7fba7006c490 2019-11-28T11:48:28.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.963+0000 7fba76b41700 1 -- 172.21.15.80:0/2373531176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7006c490 msgr2=0x7fba7006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.963+0000 7fba76b41700 1 --2- 172.21.15.80:0/2373531176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7006c490 0x7fba7006c920 secure :-1 s=READY pgs=1895 cs=0 l=1 rx=0x7fba6000f6c0 tx=0x7fba6000fa60).stop 2019-11-28T11:48:28.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.964+0000 7fba76b41700 1 -- 172.21.15.80:0/2373531176 shutdown_connections 2019-11-28T11:48:28.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.964+0000 7fba76b41700 1 --2- 172.21.15.80:0/2373531176 >> v2:172.21.15.174:3300/0 conn(0x7fba7006ce60 0x7fba70164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:28.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.964+0000 7fba76b41700 1 --2- 172.21.15.80:0/2373531176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7006c490 0x7fba7006c920 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:28.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.964+0000 7fba76b41700 1 -- 172.21.15.80:0/2373531176 shutdown_connections 2019-11-28T11:48:28.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.964+0000 7fba76b41700 1 -- 172.21.15.80:0/2373531176 wait complete. 2019-11-28T11:48:28.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.964+0000 7fba76b41700 1 -- 172.21.15.80:0/2373531176 >> 172.21.15.80:0/2373531176 conn(0x7fba70061cf0 msgr2=0x7fba70064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:28.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.966+0000 7fba76b41700 1 Processor -- start 2019-11-28T11:48:28.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.966+0000 7fba76b41700 1 -- start start 2019-11-28T11:48:28.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.967+0000 7fba76b41700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba7015fdf0 0x7fba7012b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:28.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.967+0000 7fba76b41700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba7012b8a0 0x7fba7013e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:28.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.967+0000 7fba76b41700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba70139e00 con 0x7fba7013e860 2019-11-28T11:48:28.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.967+0000 7fba76b41700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba70108820 con 0x7fba7015fdf0 2019-11-28T11:48:28.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.967+0000 7fba76b41700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba70108af0 con 0x7fba7012b8a0 2019-11-28T11:48:28.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.967+0000 7fba750de700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba7015fdf0 0x7fba7012b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.967+0000 7fba750de700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fba7015fdf0 0x7fba7012b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41156/0 (socket says 172.21.15.80:41156) 2019-11-28T11:48:28.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.967+0000 7fba750de700 1 -- 172.21.15.80:0/1568838057 learned_addr learned my addr 172.21.15.80:0/1568838057 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:28.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba748dd700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba7012b8a0 0x7fba7013e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba750de700 1 -- 172.21.15.80:0/1568838057 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba7012b8a0 msgr2=0x7fba7013e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba750de700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba7012b8a0 0x7fba7013e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:28.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba750de700 1 -- 172.21.15.80:0/1568838057 >> v1:172.21.15.174:6789/0 conn(0x7fba7013e860 legacy=0x7fba7012a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba750de700 1 -- 172.21.15.80:0/1568838057 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7010a8c0 con 0x7fba7015fdf0 2019-11-28T11:48:28.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba6dffb700 1 -- 172.21.15.80:0/1568838057 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959807883 0 0) 0x7fba68001080 con 0x7fba7013e860 2019-11-28T11:48:28.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba750de700 1 --2- 172.21.15.80:0/1568838057 >> v2:172.21.15.80:3300/0 conn(0x7fba7015fdf0 0x7fba7012b360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fba58010790 tx=0x7fba580105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba750de700 1 --2- 172.21.15.80:0/1568838057 >> v2:172.21.15.80:3300/0 conn(0x7fba7015fdf0 0x7fba7012b360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fba58010790 tx=0x7fba580105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba750de700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015fdf0 0x7fba7012b360 secure :-1 s=READY pgs=1896 cs=0 l=1 rx=0x7fba58010790 tx=0x7fba580105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:28.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba750de700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015fdf0 0x7fba7012b360 secure :-1 s=THROTTLE_DONE pgs=1896 cs=0 l=1 rx=0x7fba58010790 tx=0x7fba580105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba6dffb700 1 -- 172.21.15.80:0/1568838057 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba58000ce0 con 0x7fba7015fdf0 2019-11-28T11:48:28.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba750de700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015fdf0 0x7fba7012b360 secure :-1 s=THROTTLE_DONE pgs=1896 cs=0 l=1 rx=0x7fba58010790 tx=0x7fba580105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba6dffb700 1 -- 172.21.15.80:0/1568838057 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba58001420 con 0x7fba7015fdf0 2019-11-28T11:48:28.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba750de700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015fdf0 0x7fba7012b360 secure :-1 s=THROTTLE_DONE pgs=1896 cs=0 l=1 rx=0x7fba58010790 tx=0x7fba580105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba76b41700 1 -- 172.21.15.80:0/1568838057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7010a8c0 con 0x7fba7015fdf0 2019-11-28T11:48:28.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba6dffb700 1 -- 172.21.15.80:0/1568838057 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba58001610 con 0x7fba7015fdf0 2019-11-28T11:48:28.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba76b41700 1 -- 172.21.15.80:0/1568838057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7010a8c0 con 0x7fba7015fdf0 2019-11-28T11:48:28.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.968+0000 7fba750de700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015fdf0 0x7fba7012b360 secure :-1 s=THROTTLE_DONE pgs=1896 cs=0 l=1 rx=0x7fba58010790 tx=0x7fba580105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.969+0000 7fba6dffb700 1 -- 172.21.15.80:0/1568838057 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fba58001610 con 0x7fba7015fdf0 2019-11-28T11:48:28.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.969+0000 7fba750de700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015fdf0 0x7fba7012b360 secure :-1 s=THROTTLE_DONE pgs=1896 cs=0 l=1 rx=0x7fba58010790 tx=0x7fba580105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.969+0000 7fba6dffb700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba54018730 0x7fba5401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:28.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.969+0000 7fba6dffb700 1 -- 172.21.15.80:0/1568838057 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fba58031e60 con 0x7fba7015fdf0 2019-11-28T11:48:28.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.969+0000 7fba748dd700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba54018730 0x7fba5401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.969+0000 7fba748dd700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba54018730 0x7fba5401abc0 crc :-1 s=READY pgs=767 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:28.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.976+0000 7fba76b41700 1 -- 172.21.15.80:0/1568838057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba70109180 con 0x7fba7015fdf0 2019-11-28T11:48:28.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.980+0000 7fba750de700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015fdf0 0x7fba7012b360 secure :-1 s=THROTTLE_DONE pgs=1896 cs=0 l=1 rx=0x7fba58010790 tx=0x7fba580105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:27.980+0000 7fba6dffb700 1 -- 172.21.15.80:0/1568838057 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fba5802df70 con 0x7fba7015fdf0 2019-11-28T11:48:28.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.153+0000 7fba76b41700 1 -- 172.21.15.80:0/1568838057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fba70109500 con 0x7fba7015fdf0 2019-11-28T11:48:28.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.154+0000 7fba750de700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015fdf0 0x7fba7012b360 secure :-1 s=THROTTLE_DONE pgs=1896 cs=0 l=1 rx=0x7fba58010790 tx=0x7fba580105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.154+0000 7fba6dffb700 1 -- 172.21.15.80:0/1568838057 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v145) v1 ==== 81+0+31847 (secure 0 0 0) 0x7fba5802df70 con 0x7fba7015fdf0 2019-11-28T11:48:28.201 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:28.201 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:48:28.202 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 145, 2019-11-28T11:48:28.202 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:48:28.202 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:48:28.202 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:48:27.387299+0000", 2019-11-28T11:48:28.202 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:48:28.202 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:48:28.203 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:48:28.203 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:48:28.203 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:48:28.203 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:48:28.203 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:48:28.203 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:48:28.203 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:48:28.204 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:48:28.204 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:48:28.204 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:48:28.204 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:48:28.204 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:48:28.204 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:48:28.205 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 23, 2019-11-28T11:48:28.205 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:48:28.205 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:48:28.205 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:48:28.205 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:48:28.205 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:48:28.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.206 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:48:28.206 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:48:28.206 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:48:28.206 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:48:28.206 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:48:28.206 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:48:28.206 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:48:28.207 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:48:28.207 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:48:28.207 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:48:28.207 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:48:28.207 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:48:28.207 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:48:28.207 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:48:28.208 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:48:28.208 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:48:28.208 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:48:28.208 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:48:28.208 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:48:28.208 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:48:28.208 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:48:28.209 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:48:28.209 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:48:28.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.209 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:48:28.209 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:48:28.209 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:48:28.209 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:48:28.210 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:48:28.210 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:48:28.210 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:48:28.210 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:48:28.210 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:48:28.210 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:48:28.210 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:48:28.211 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:48:28.211 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:48:28.211 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:48:28.211 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:48:28.211 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:48:28.211 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:48:28.211 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:48:28.211 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:48:28.212 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:48:28.212 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:48:28.212 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:48:28.212 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:48:28.214 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:48:28.214 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:48:28.214 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:48:28.215 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:48:28.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.215 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:48:28.215 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:48:28.215 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:48:28.216 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:48:28.216 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:48:28.216 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:48:28.216 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:48:28.216 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:48:28.216 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:48:28.216 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:48:28.217 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:48:28.217 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:48:28.217 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:48:28.217 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:48:28.217 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.218 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 22, 2019-11-28T11:48:28.218 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:48:28.218 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:45:28.436380+0000", 2019-11-28T11:48:28.218 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:48:28.218 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:48:28.218 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:48:28.218 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:48:28.219 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:48:28.219 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:48:28.219 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:48:28.219 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:48:28.219 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:48:28.219 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:48:28.219 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:48:28.220 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:48:28.220 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:48:28.220 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:48:28.220 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:48:28.221 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:48:28.221 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:48:28.221 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:48:28.221 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:48:28.222 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:48:28.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.222 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "140", 2019-11-28T11:48:28.222 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:48:28.222 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:48:28.222 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:48:28.223 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:48:28.223 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:48:28.223 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:48:28.223 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:48:28.223 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:48:28.223 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:48:28.223 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:48:28.224 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:48:28.224 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:48:28.224 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:48:28.224 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:48:28.224 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:48:28.224 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:48:28.224 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:48:28.225 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:48:28.225 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:48:28.225 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:48:28.225 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:48:28.225 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:48:28.225 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:48:28.225 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:48:28.226 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:48:28.226 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:48:28.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.226 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:48:28.226 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:48:28.226 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:48:28.226 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:48:28.227 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:48:28.227 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:48:28.227 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:48:28.227 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:48:28.227 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:48:28.227 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:48:28.227 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:48:28.228 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:48:28.228 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:48:28.228 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:48:28.228 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:48:28.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.228 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:48:28.228 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:48:28.229 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:48:28.229 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.229 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.229 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 23, 2019-11-28T11:48:28.229 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:48:28.230 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:45:29.126890+0000", 2019-11-28T11:48:28.230 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:48:28.230 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:48:28.230 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:48:28.230 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:48:28.230 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:48:28.231 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:48:28.231 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:48:28.231 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:48:28.231 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:48:28.231 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:48:28.231 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:48:28.231 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:48:28.232 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:48:28.232 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:48:28.232 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:48:28.232 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:48:28.232 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:48:28.232 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:48:28.232 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:48:28.233 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:48:28.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.233 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "141", 2019-11-28T11:48:28.233 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:48:28.233 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:48:28.233 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:48:28.233 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:48:28.234 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:48:28.234 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:48:28.234 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:48:28.234 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:48:28.234 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:48:28.234 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:48:28.234 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:48:28.235 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:48:28.235 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:48:28.235 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:48:28.235 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:48:28.235 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:48:28.235 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:48:28.235 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:48:28.235 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:48:28.236 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:48:28.236 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:48:28.236 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:48:28.236 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:48:28.236 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:48:28.236 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:48:28.236 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:48:28.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.237 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:48:28.237 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:48:28.237 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:48:28.237 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:48:28.237 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:48:28.238 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:48:28.238 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:48:28.238 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:48:28.238 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:48:28.238 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:48:28.238 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:48:28.239 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:48:28.239 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:48:28.239 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:48:28.239 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:48:28.239 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.240 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.240 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.240 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:48:28.241 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:48:28.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.241 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:48:28.241 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:48:28.241 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:48:28.241 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:48:28.241 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:48:28.242 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:48:28.242 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:48:28.242 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:48:28.242 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:48:28.242 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 139, 2019-11-28T11:48:28.242 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:48:28.242 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:48:28.243 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:48:28.243 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.243 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.243 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:48:28.243 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:48:28.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.244 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.244 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:48:28.244 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:48:28.244 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.244 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.245 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:48:28.245 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.245 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.245 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:48:28.245 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:48:28.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.246 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.246 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:48:28.246 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:48:28.246 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.253 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.253 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:48:28.253 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.254 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.254 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:48:28.254 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:48:28.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.254 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.254 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:48:28.255 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:48:28.255 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.255 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.255 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:48:28.255 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.256 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.256 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:48:28.256 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:48:28.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.256 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.256 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:48:28.257 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:48:28.257 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.257 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.257 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:48:28.257 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:48:28.257 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:48:28.258 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:48:28.258 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:48:28.258 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:48:28.258 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:48:28.258 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.259 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:48:28.259 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:48:28.259 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:48:28.259 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:48:28.260 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:48:28.260 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:48:28.261 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:48:28.261 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:48:28.261 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:48:28.261 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 138, 2019-11-28T11:48:28.261 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:48:28.261 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:48:28.261 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:48:28.262 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.262 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.262 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:48:28.263 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:48:28.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.263 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.263 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:48:28.263 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:48:28.263 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.264 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.264 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:48:28.264 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.264 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.264 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:48:28.265 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:48:28.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.265 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.265 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:48:28.265 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:48:28.265 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.266 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.266 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:48:28.266 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.266 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.266 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:48:28.267 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:48:28.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.267 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.267 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:48:28.267 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:48:28.267 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.267 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.268 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:48:28.268 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.268 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.268 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:48:28.269 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:48:28.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.269 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.269 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:48:28.269 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:48:28.270 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.270 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.270 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:48:28.270 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:48:28.270 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:48:28.270 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:48:28.271 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:48:28.271 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:48:28.271 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:48:28.271 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.271 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:48:28.272 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:48:28.272 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:48:28.272 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:48:28.272 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:48:28.272 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:48:28.272 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:48:28.272 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:48:28.273 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:48:28.273 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 139, 2019-11-28T11:48:28.273 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:48:28.273 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:48:28.273 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:48:28.273 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.274 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.274 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:48:28.274 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:48:28.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.274 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.274 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:48:28.275 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:48:28.275 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.275 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.275 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:48:28.275 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.275 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.276 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:48:28.276 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:48:28.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.276 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.276 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:48:28.276 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:48:28.277 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.277 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.277 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:48:28.277 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.277 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.278 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:48:28.278 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:48:28.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.278 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.278 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:48:28.278 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:48:28.279 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.279 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.279 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:48:28.279 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.279 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.280 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:48:28.280 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:48:28.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.280 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.280 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:48:28.280 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:48:28.281 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.281 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.281 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:48:28.281 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:48:28.281 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:48:28.281 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:48:28.282 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:48:28.282 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:48:28.282 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:48:28.282 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.282 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:48:28.283 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:48:28.283 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:48:28.283 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:48:28.283 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:48:28.283 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:48:28.283 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:48:28.283 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:48:28.284 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:48:28.284 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 139, 2019-11-28T11:48:28.284 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:48:28.284 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:48:28.284 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:48:28.284 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.285 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.285 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:48:28.285 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:48:28.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.285 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.286 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:48:28.286 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:48:28.288 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.288 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.288 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:48:28.289 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.289 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.289 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:48:28.289 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:48:28.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.290 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.290 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:48:28.290 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:48:28.290 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.290 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.290 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:48:28.291 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.291 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.291 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:48:28.291 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:48:28.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.292 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.292 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:48:28.292 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:48:28.292 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.292 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.293 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:48:28.293 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.293 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.293 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:48:28.293 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:48:28.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.294 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.294 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:48:28.294 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:48:28.294 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.294 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.295 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:48:28.295 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:48:28.295 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:48:28.295 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:48:28.295 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:48:28.295 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:48:28.296 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:48:28.296 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.296 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:48:28.296 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:48:28.296 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:48:28.297 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:48:28.297 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:48:28.297 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:48:28.297 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:48:28.298 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:48:28.298 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:48:28.298 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 139, 2019-11-28T11:48:28.298 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:48:28.299 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:48:28.299 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:48:28.299 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.299 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.299 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:48:28.300 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:48:28.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.300 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.300 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:48:28.300 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:48:28.300 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.301 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.301 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:48:28.301 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.301 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.301 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:48:28.302 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:48:28.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.302 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.302 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:48:28.302 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:48:28.302 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.303 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.303 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:48:28.303 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.303 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.303 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:48:28.304 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:48:28.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.304 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.304 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:48:28.305 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:48:28.305 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.305 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.305 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:48:28.305 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.306 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.306 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:48:28.306 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:48:28.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.306 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.306 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:48:28.307 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:48:28.307 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.307 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.307 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:48:28.307 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:48:28.307 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:48:28.308 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:48:28.308 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:48:28.308 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:48:28.308 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:48:28.308 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.309 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:48:28.309 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:48:28.309 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:48:28.309 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:48:28.309 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:48:28.310 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:48:28.310 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:48:28.310 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:48:28.310 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:48:28.310 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 139, 2019-11-28T11:48:28.310 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:48:28.310 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:48:28.311 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:48:28.311 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.311 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.311 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:48:28.311 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:48:28.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.312 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.312 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:48:28.312 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:48:28.312 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.312 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.313 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:48:28.313 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.313 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.313 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:48:28.313 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:48:28.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.314 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.314 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:48:28.314 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:48:28.314 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.314 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:48:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:48:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:48:28.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:48:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:48:28.316 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:48:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.317 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:48:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:48:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:48:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:48:28.318 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:48:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:48:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:48:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:48:28.319 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:48:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:48:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:48:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:48:28.320 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:48:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:48:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:48:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:48:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:48:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:48:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:48:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:48:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 138, 2019-11-28T11:48:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:48:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:48:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:48:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.322 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:48:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:48:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:48:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:48:28.323 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.324 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.324 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:48:28.324 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.324 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.324 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:48:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:48:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:48:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:48:28.325 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:48:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.326 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:48:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:48:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:48:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:48:28.327 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:48:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.328 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:48:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:48:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:48:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:48:28.329 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:48:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:48:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:48:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:48:28.330 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:48:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:48:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:48:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:48:28.331 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:48:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:48:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:48:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:48:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:48:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:48:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:48:28.332 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:48:28.333 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 126, 2019-11-28T11:48:28.333 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:48:28.333 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:48:28.333 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:48:28.333 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.333 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.334 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:48:28.334 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:48:28.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.334 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.334 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:48:28.334 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:48:28.335 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.335 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.335 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:48:28.336 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.336 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.336 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:48:28.336 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:48:28.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.337 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.337 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:48:28.337 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:48:28.338 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.340 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.340 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:48:28.340 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.340 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.341 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:48:28.341 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:48:28.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.342 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.342 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:48:28.342 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:48:28.342 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.342 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.342 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:48:28.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:48:28.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.343 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:48:28.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:48:28.343 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:48:28.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.344 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:48:28.344 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:48:28.344 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:48:28.344 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.344 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.344 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:48:28.345 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:48:28.345 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:48:28.345 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:48:28.345 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:48:28.345 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:48:28.345 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:48:28.345 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:28.346 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.346 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:48:28.346 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:48:28.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.346 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:48:28.346 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:48:28.346 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:48:28.347 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:48:28.347 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:48:28.347 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:48:28.347 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:48:28.347 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:48:28.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.348 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:48:28.348 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:48:28.348 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:48:28.348 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:48:28.348 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:48:28.348 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:48:28.348 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:48:28.349 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:48:28.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.349 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:48:28.349 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:48:28.349 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:48:28.349 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:48:28.350 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:48:28.350 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:48:28.350 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:48:28.350 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:48:28.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.350 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:48:28.351 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:48:28.351 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:48:28.351 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:48:28.351 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:48:28.351 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:48:28.351 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:48:28.351 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:48:28.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.352 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:48:28.352 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:48:28.352 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:48:28.352 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:48:28.352 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:48:28.353 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:48:28.353 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:48:28.353 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:48:28.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.353 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:48:28.353 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:48:28.353 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:48:28.354 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:48:28.354 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:48:28.354 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:48:28.354 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:48:28.354 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:48:28.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.355 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:48:28.355 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:48:28.355 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:48:28.355 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:48:28.355 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:48:28.355 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:48:28.355 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:48:28.356 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:48:28.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:28.356 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:48:28.356 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:48:28.356 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:48:28.356 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:48:28.357 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:48:28.357 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:48:28.357 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:48:28.357 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:48:28.357 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.357 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:48:28.357 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:48:28.358 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:48:28.358 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:48:28.358 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:48:28.358 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:48:28.358 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6835/1912693207": "2019-11-29T11:48:27.387271+0000", 2019-11-28T11:48:28.358 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6833/1912693207": "2019-11-29T11:48:27.387271+0000", 2019-11-28T11:48:28.358 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.76:0/1490899080": "2019-11-28T12:45:48.743920+0000" 2019-11-28T11:48:28.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.359 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:48:28.359 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:48:28.359 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:48:28.359 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:48:28.359 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:48:28.359 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:48:28.360 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:48:28.360 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:48:28.360 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:48:28.360 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:48:28.360 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:48:28.360 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:48:28.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.361 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:48:28.361 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:48:28.361 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:48:28.361 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:48:28.361 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:48:28.361 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:48:28.361 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:48:28.362 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:28.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:28.362 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:48:28.362 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:48:28.362 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:48:28.362 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:48:28.362 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:48:28.363 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:48:28.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.158+0000 7fba76b41700 1 -- 172.21.15.80:0/1568838057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba54018730 msgr2=0x7fba5401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.158+0000 7fba76b41700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba54018730 0x7fba5401abc0 crc :-1 s=READY pgs=767 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:28.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.158+0000 7fba76b41700 1 -- 172.21.15.80:0/1568838057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015fdf0 msgr2=0x7fba7012b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.158+0000 7fba76b41700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015fdf0 0x7fba7012b360 secure :-1 s=READY pgs=1896 cs=0 l=1 rx=0x7fba58010790 tx=0x7fba580105f0).stop 2019-11-28T11:48:28.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.158+0000 7fba76b41700 1 -- 172.21.15.80:0/1568838057 shutdown_connections 2019-11-28T11:48:28.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.158+0000 7fba76b41700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fba54018730 0x7fba5401abc0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:28.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.158+0000 7fba76b41700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fba7012b8a0 0x7fba7013e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:28.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.158+0000 7fba76b41700 1 --2- 172.21.15.80:0/1568838057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba7015fdf0 0x7fba7012b360 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:28.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.158+0000 7fba76b41700 1 -- 172.21.15.80:0/1568838057 shutdown_connections 2019-11-28T11:48:28.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.158+0000 7fba76b41700 1 -- 172.21.15.80:0/1568838057 wait complete. 2019-11-28T11:48:28.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.158+0000 7fba76b41700 1 -- 172.21.15.80:0/1568838057 >> 172.21.15.80:0/1568838057 conn(0x7fba70127dc0 msgr2=0x7fba70141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:28.365 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:48:28.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.441+0000 7f3d625e0700 1 Processor -- start 2019-11-28T11:48:28.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.441+0000 7f3d625e0700 1 -- start start 2019-11-28T11:48:28.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.442+0000 7f3d625e0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5c06c0a0 0x7f3d5c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:28.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.442+0000 7f3d625e0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3d5c0734e0 0x7f3d5c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:28.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.442+0000 7f3d625e0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c06db00 con 0x7f3d5c072360 2019-11-28T11:48:28.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.442+0000 7f3d625e0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c06f330 con 0x7f3d5c0734e0 2019-11-28T11:48:28.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.442+0000 7f3d625e0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0706c0 con 0x7f3d5c06c0a0 2019-11-28T11:48:28.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d5bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3d5c0734e0 0x7f3d5c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d6137e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3d5c072360 0x7f3d5c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40484/0 (socket says 172.21.15.80:40484) 2019-11-28T11:48:28.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d6137e700 1 -- 172.21.15.80:0/691132841 learned_addr learned my addr 172.21.15.80:0/691132841 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:28.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d60b7d700 1 --2- 172.21.15.80:0/691132841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5c06c0a0 0x7f3d5c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d5bfff700 1 -- 172.21.15.80:0/691132841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5c06c0a0 msgr2=0x7f3d5c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:28.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d5bfff700 1 --2- 172.21.15.80:0/691132841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5c06c0a0 0x7f3d5c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:28.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d5bfff700 1 -- 172.21.15.80:0/691132841 >> v1:172.21.15.80:6789/0 conn(0x7f3d5c072360 legacy=0x7f3d5c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d5b7fe700 1 -- 172.21.15.80:0/691132841 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862660576 0 0) 0x7f3d54001150 con 0x7f3d5c072360 2019-11-28T11:48:28.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d5bfff700 1 -- 172.21.15.80:0/691132841 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c070a40 con 0x7f3d5c0734e0 2019-11-28T11:48:28.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d5bfff700 1 --2- 172.21.15.80:0/691132841 >> v2:172.21.15.80:3300/0 conn(0x7f3d5c0734e0 0x7f3d5c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3d4c00b2d0 tx=0x7f3d4c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d5bfff700 1 --2- 172.21.15.80:0/691132841 >> v2:172.21.15.80:3300/0 conn(0x7f3d5c0734e0 0x7f3d5c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3d4c00b2d0 tx=0x7f3d4c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d5bfff700 1 --2- 172.21.15.80:0/691132841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c0734e0 0x7f3d5c071e20 secure :-1 s=READY pgs=1898 cs=0 l=1 rx=0x7f3d4c00b2d0 tx=0x7f3d4c00b5d0).ready entity=mon.0 client_cookie=683743f8e7c3c41f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:28.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d5bfff700 1 --2- 172.21.15.80:0/691132841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c0734e0 0x7f3d5c071e20 secure :-1 s=THROTTLE_DONE pgs=1898 cs=0 l=1 rx=0x7f3d4c00b2d0 tx=0x7f3d4c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d5b7fe700 1 -- 172.21.15.80:0/691132841 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d4c007590 con 0x7f3d5c0734e0 2019-11-28T11:48:28.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d5bfff700 1 --2- 172.21.15.80:0/691132841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c0734e0 0x7f3d5c071e20 secure :-1 s=THROTTLE_DONE pgs=1898 cs=0 l=1 rx=0x7f3d4c00b2d0 tx=0x7f3d4c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d5bfff700 1 --2- 172.21.15.80:0/691132841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c0734e0 0x7f3d5c071e20 secure :-1 s=THROTTLE_DONE pgs=1898 cs=0 l=1 rx=0x7f3d4c00b2d0 tx=0x7f3d4c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d5b7fe700 1 -- 172.21.15.80:0/691132841 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c009d30 con 0x7f3d5c0734e0 2019-11-28T11:48:28.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d5b7fe700 1 -- 172.21.15.80:0/691132841 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d4c00a400 con 0x7f3d5c0734e0 2019-11-28T11:48:28.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d625e0700 1 -- 172.21.15.80:0/691132841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c0734e0 msgr2=0x7f3d5c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.443+0000 7f3d625e0700 1 --2- 172.21.15.80:0/691132841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c0734e0 0x7f3d5c071e20 secure :-1 s=READY pgs=1898 cs=0 l=1 rx=0x7f3d4c00b2d0 tx=0x7f3d4c00b5d0).stop 2019-11-28T11:48:28.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.444+0000 7f3d625e0700 1 -- 172.21.15.80:0/691132841 shutdown_connections 2019-11-28T11:48:28.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.444+0000 7f3d625e0700 1 --2- 172.21.15.80:0/691132841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c0734e0 0x7f3d5c071e20 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:28.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.444+0000 7f3d625e0700 1 --2- 172.21.15.80:0/691132841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5c06c0a0 0x7f3d5c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:28.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.444+0000 7f3d625e0700 1 -- 172.21.15.80:0/691132841 shutdown_connections 2019-11-28T11:48:28.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.444+0000 7f3d625e0700 1 -- 172.21.15.80:0/691132841 wait complete. 2019-11-28T11:48:28.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.444+0000 7f3d625e0700 1 -- 172.21.15.80:0/691132841 >> 172.21.15.80:0/691132841 conn(0x7f3d5c061cf0 msgr2=0x7f3d5c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:28.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.446+0000 7f3d625e0700 1 Processor -- start 2019-11-28T11:48:28.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.446+0000 7f3d625e0700 1 -- start start 2019-11-28T11:48:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.447+0000 7f3d625e0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5c15fdf0 0x7f3d5c12b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.447+0000 7f3d625e0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3d5c12a3c0 0x7f3d5c12a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.447+0000 7f3d625e0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c13eb20 con 0x7f3d5c12b8a0 2019-11-28T11:48:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.447+0000 7f3d625e0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c107df0 con 0x7f3d5c12a3c0 2019-11-28T11:48:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.447+0000 7f3d625e0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c107890 con 0x7f3d5c15fdf0 2019-11-28T11:48:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.447+0000 7f3d6137e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3d5c12a3c0 0x7f3d5c12a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d6137e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3d5c12a3c0 0x7f3d5c12a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41174/0 (socket says 172.21.15.80:41174) 2019-11-28T11:48:28.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d6137e700 1 -- 172.21.15.80:0/960613349 learned_addr learned my addr 172.21.15.80:0/960613349 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:28.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d60b7d700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5c15fdf0 0x7f3d5c12b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d6137e700 1 -- 172.21.15.80:0/960613349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5c15fdf0 msgr2=0x7f3d5c12b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d6137e700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5c15fdf0 0x7f3d5c12b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:28.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d6137e700 1 -- 172.21.15.80:0/960613349 >> v1:172.21.15.174:6789/0 conn(0x7f3d5c12b8a0 legacy=0x7f3d5c13e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d6137e700 1 -- 172.21.15.80:0/960613349 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c10a8c0 con 0x7f3d5c12a3c0 2019-11-28T11:48:28.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d60b7d700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5c15fdf0 0x7f3d5c12b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:48:28.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d6137e700 1 --2- 172.21.15.80:0/960613349 >> v2:172.21.15.80:3300/0 conn(0x7f3d5c12a3c0 0x7f3d5c12a820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3d54010410 tx=0x7f3d540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d6137e700 1 --2- 172.21.15.80:0/960613349 >> v2:172.21.15.80:3300/0 conn(0x7f3d5c12a3c0 0x7f3d5c12a820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3d54010410 tx=0x7f3d540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d6137e700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c12a3c0 0x7f3d5c12a820 secure :-1 s=READY pgs=1899 cs=0 l=1 rx=0x7f3d54010410 tx=0x7f3d540107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:28.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d6137e700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c12a3c0 0x7f3d5c12a820 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f3d54010410 tx=0x7f3d540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d6137e700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c12a3c0 0x7f3d5c12a820 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f3d54010410 tx=0x7f3d540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d597fa700 1 -- 172.21.15.80:0/960613349 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d54000940 con 0x7f3d5c12a3c0 2019-11-28T11:48:28.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d6137e700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c12a3c0 0x7f3d5c12a820 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f3d54010410 tx=0x7f3d540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d597fa700 1 -- 172.21.15.80:0/960613349 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d540010e0 con 0x7f3d5c12a3c0 2019-11-28T11:48:28.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d625e0700 1 -- 172.21.15.80:0/960613349 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5c10a8c0 con 0x7f3d5c12a3c0 2019-11-28T11:48:28.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d597fa700 1 -- 172.21.15.80:0/960613349 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d54001770 con 0x7f3d5c12a3c0 2019-11-28T11:48:28.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.448+0000 7f3d625e0700 1 -- 172.21.15.80:0/960613349 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5c10a8c0 con 0x7f3d5c12a3c0 2019-11-28T11:48:28.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.449+0000 7f3d6137e700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c12a3c0 0x7f3d5c12a820 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f3d54010410 tx=0x7f3d540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.449+0000 7f3d6137e700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c12a3c0 0x7f3d5c12a820 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f3d54010410 tx=0x7f3d540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.449+0000 7f3d597fa700 1 -- 172.21.15.80:0/960613349 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3d54000940 con 0x7f3d5c12a3c0 2019-11-28T11:48:28.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.449+0000 7f3d597fa700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d40018730 0x7f3d4001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:28.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.449+0000 7f3d597fa700 1 -- 172.21.15.80:0/960613349 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f3d54031a80 con 0x7f3d5c12a3c0 2019-11-28T11:48:28.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.449+0000 7f3d60b7d700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d40018730 0x7f3d4001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.449+0000 7f3d60b7d700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d40018730 0x7f3d4001abc0 crc :-1 s=READY pgs=768 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:28.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.457+0000 7f3d625e0700 1 -- 172.21.15.80:0/960613349 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5c109180 con 0x7f3d5c12a3c0 2019-11-28T11:48:28.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.460+0000 7f3d6137e700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c12a3c0 0x7f3d5c12a820 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f3d54010410 tx=0x7f3d540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.460+0000 7f3d597fa700 1 -- 172.21.15.80:0/960613349 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3d540075b0 con 0x7f3d5c12a3c0 2019-11-28T11:48:28.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.633+0000 7f3d625e0700 1 -- 172.21.15.80:0/960613349 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d5c109500 con 0x7f3d5c12a3c0 2019-11-28T11:48:28.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.633+0000 7f3d6137e700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c12a3c0 0x7f3d5c12a820 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f3d54010410 tx=0x7f3d540107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.633+0000 7f3d597fa700 1 -- 172.21.15.80:0/960613349 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f3d540018e0 con 0x7f3d5c12a3c0 2019-11-28T11:48:28.679 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 108 2019-11-28T11:48:28.679 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:28.680 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":108,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:30.152127+0000","modified":"2019-11-28T11:48:27.724531+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":145,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2019-11-28T11:48:28.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.635+0000 7f3d625e0700 1 -- 172.21.15.80:0/960613349 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d40018730 msgr2=0x7f3d4001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.635+0000 7f3d625e0700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d40018730 0x7f3d4001abc0 crc :-1 s=READY pgs=768 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:28.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.635+0000 7f3d625e0700 1 -- 172.21.15.80:0/960613349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c12a3c0 msgr2=0x7f3d5c12a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.635+0000 7f3d625e0700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c12a3c0 0x7f3d5c12a820 secure :-1 s=READY pgs=1899 cs=0 l=1 rx=0x7f3d54010410 tx=0x7f3d540107b0).stop 2019-11-28T11:48:28.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.636+0000 7f3d625e0700 1 -- 172.21.15.80:0/960613349 shutdown_connections 2019-11-28T11:48:28.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.636+0000 7f3d625e0700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3d5c12a3c0 0x7f3d5c12a820 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:28.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.636+0000 7f3d625e0700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3d40018730 0x7f3d4001abc0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:28.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.636+0000 7f3d625e0700 1 --2- 172.21.15.80:0/960613349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5c15fdf0 0x7f3d5c12b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:28.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.636+0000 7f3d625e0700 1 -- 172.21.15.80:0/960613349 shutdown_connections 2019-11-28T11:48:28.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.636+0000 7f3d625e0700 1 -- 172.21.15.80:0/960613349 wait complete. 2019-11-28T11:48:28.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.636+0000 7f3d625e0700 1 -- 172.21.15.80:0/960613349 >> 172.21.15.80:0/960613349 conn(0x7f3d5c127dc0 msgr2=0x7f3d5c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:28.695 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:48:28.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.781+0000 7f074bc83700 1 Processor -- start 2019-11-28T11:48:28.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.781+0000 7f074bc83700 1 -- start start 2019-11-28T11:48:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.782+0000 7f074bc83700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f074406c0a0 0x7f0744072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.782+0000 7f074bc83700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074406db00 con 0x7f0744072620 2019-11-28T11:48:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.782+0000 7f074bc83700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074406e000 con 0x7f07440734e0 2019-11-28T11:48:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.782+0000 7f074bc83700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074406fd60 con 0x7f074406c0a0 2019-11-28T11:48:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.782+0000 7f074aa21700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0744072620 0x7f0744164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40496/0 (socket says 172.21.15.80:40496) 2019-11-28T11:48:28.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.782+0000 7f074aa21700 1 -- 172.21.15.80:0/1039574357 learned_addr learned my addr 172.21.15.80:0/1039574357 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.782+0000 7f074a220700 1 --2- 172.21.15.80:0/1039574357 >> v2:172.21.15.174:3300/0 conn(0x7f074406c0a0 0x7f0744072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.782+0000 7f074921e700 1 -- 172.21.15.80:0/1039574357 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725783973 0 0) 0x7f073c001150 con 0x7f0744072620 2019-11-28T11:48:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.782+0000 7f074921e700 1 -- 172.21.15.80:0/1039574357 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0730002e80 con 0x7f0744072620 2019-11-28T11:48:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074921e700 1 -- 172.21.15.80:0/1039574357 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 924385115 0 0) 0x7f073c001130 con 0x7f0744072620 2019-11-28T11:48:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074921e700 1 -- 172.21.15.80:0/1039574357 >> v2:172.21.15.174:3300/0 conn(0x7f074406c0a0 msgr2=0x7f0744072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074921e700 1 --2- 172.21.15.80:0/1039574357 >> v2:172.21.15.174:3300/0 conn(0x7f074406c0a0 0x7f0744072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:28.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074921e700 1 -- 172.21.15.80:0/1039574357 >> v1:172.21.15.174:6789/0 conn(0x7f07440734e0 legacy=0x7f0744071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074921e700 1 -- 172.21.15.80:0/1039574357 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07440706c0 con 0x7f0744072620 2019-11-28T11:48:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074921e700 1 -- 172.21.15.80:0/1039574357 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f073c001660 con 0x7f0744072620 2019-11-28T11:48:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074921e700 1 -- 172.21.15.80:0/1039574357 >> v1:172.21.15.80:6789/0 conn(0x7f0744072620 legacy=0x7f0744164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074921e700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0730003ab0 0x7f0730005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074921e700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0730006690 0x7f0730008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074921e700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07300093a0 0x7f073000b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:28.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074921e700 1 -- 172.21.15.80:0/1039574357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073000c000 con 0x7f0730003ab0 2019-11-28T11:48:28.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074a220700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0730003ab0 0x7f0730005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074921e700 1 -- 172.21.15.80:0/1039574357 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0730050200 con 0x7f0730006690 2019-11-28T11:48:28.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074921e700 1 -- 172.21.15.80:0/1039574357 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0730050430 con 0x7f07300093a0 2019-11-28T11:48:28.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f0749a1f700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0730006690 0x7f0730008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074aa21700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07300093a0 0x7f073000b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074a220700 1 -- 172.21.15.80:0/1039574357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07300093a0 msgr2=0x7f073000b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:28.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074a220700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07300093a0 0x7f073000b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:28.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074a220700 1 -- 172.21.15.80:0/1039574357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0730006690 msgr2=0x7f0730008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:28.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074a220700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0730006690 0x7f0730008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:28.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074a220700 1 -- 172.21.15.80:0/1039574357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07300506e0 con 0x7f0730003ab0 2019-11-28T11:48:28.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074aa21700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07300093a0 0x7f073000b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:48:28.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074aa21700 1 -- 172.21.15.80:0/1039574357 reap_dead start 2019-11-28T11:48:28.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074a220700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0730003ab0 0x7f0730005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f072c00b660 tx=0x7f072c00b9e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074a220700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0730003ab0 0x7f0730005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f072c00b660 tx=0x7f072c00b9e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074a220700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0730003ab0 0x7f0730005f10 secure :-1 s=READY pgs=1901 cs=0 l=1 rx=0x7f072c00b660 tx=0x7f072c00b9e0).ready entity=mon.0 client_cookie=5ecf968e220dd88b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:28.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074a220700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0730003ab0 0x7f0730005f10 secure :-1 s=THROTTLE_DONE pgs=1901 cs=0 l=1 rx=0x7f072c00b660 tx=0x7f072c00b9e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074a220700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0730003ab0 0x7f0730005f10 secure :-1 s=THROTTLE_DONE pgs=1901 cs=0 l=1 rx=0x7f072c00b660 tx=0x7f072c00b9e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074921e700 1 -- 172.21.15.80:0/1039574357 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072c00acd0 con 0x7f0730003ab0 2019-11-28T11:48:28.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074a220700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0730003ab0 0x7f0730005f10 secure :-1 s=THROTTLE_DONE pgs=1901 cs=0 l=1 rx=0x7f072c00b660 tx=0x7f072c00b9e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074921e700 1 -- 172.21.15.80:0/1039574357 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072c009d00 con 0x7f0730003ab0 2019-11-28T11:48:28.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074921e700 1 -- 172.21.15.80:0/1039574357 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072c00a3d0 con 0x7f0730003ab0 2019-11-28T11:48:28.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074bc83700 1 -- 172.21.15.80:0/1039574357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0730003ab0 msgr2=0x7f0730005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.783+0000 7f074bc83700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0730003ab0 0x7f0730005f10 secure :-1 s=READY pgs=1901 cs=0 l=1 rx=0x7f072c00b660 tx=0x7f072c00b9e0).stop 2019-11-28T11:48:28.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.784+0000 7f074bc83700 1 -- 172.21.15.80:0/1039574357 shutdown_connections 2019-11-28T11:48:28.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.784+0000 7f074bc83700 1 --2- 172.21.15.80:0/1039574357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0730003ab0 0x7f0730005f10 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:28.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.784+0000 7f074bc83700 1 -- 172.21.15.80:0/1039574357 shutdown_connections 2019-11-28T11:48:28.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.784+0000 7f074bc83700 1 -- 172.21.15.80:0/1039574357 wait complete. 2019-11-28T11:48:28.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.784+0000 7f074bc83700 1 -- 172.21.15.80:0/1039574357 >> 172.21.15.80:0/1039574357 conn(0x7f0744061cf0 msgr2=0x7f0744064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:28.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.787+0000 7f074bc83700 1 Processor -- start 2019-11-28T11:48:28.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.787+0000 7f074bc83700 1 -- start start 2019-11-28T11:48:28.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.787+0000 7f074bc83700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0744074d00 0x7f07440750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:28.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074bc83700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0744153040 0x7f0744140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:28.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074bc83700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0744079230 con 0x7f0744152bd0 2019-11-28T11:48:28.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074bc83700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0744079e30 con 0x7f0744153040 2019-11-28T11:48:28.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074bc83700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074407a100 con 0x7f0744074d00 2019-11-28T11:48:28.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f0749a1f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0744152bd0 0x7f0744140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40508/0 (socket says 172.21.15.80:40508) 2019-11-28T11:48:28.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f0749a1f700 1 -- 172.21.15.80:0/3029296858 learned_addr learned my addr 172.21.15.80:0/3029296858 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:28.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074a220700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0744074d00 0x7f07440750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074aa21700 1 --2- 172.21.15.80:0/3029296858 >> v2:172.21.15.174:3300/0 conn(0x7f0744153040 0x7f0744140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f0742ffd700 1 -- 172.21.15.80:0/3029296858 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518782136 0 0) 0x7f0734000c80 con 0x7f0744152bd0 2019-11-28T11:48:28.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f0742ffd700 1 -- 172.21.15.80:0/3029296858 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0728002e80 con 0x7f0744152bd0 2019-11-28T11:48:28.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074a220700 1 -- 172.21.15.80:0/3029296858 >> v2:172.21.15.174:3300/0 conn(0x7f0744153040 msgr2=0x7f0744140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074a220700 1 --2- 172.21.15.80:0/3029296858 >> v2:172.21.15.174:3300/0 conn(0x7f0744153040 0x7f0744140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:28.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074a220700 1 -- 172.21.15.80:0/3029296858 >> v1:172.21.15.80:6789/0 conn(0x7f0744152bd0 legacy=0x7f0744140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:28.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074a220700 1 -- 172.21.15.80:0/3029296858 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074407b490 con 0x7f0744074d00 2019-11-28T11:48:28.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074a220700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0744074d00 0x7f07440750f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f072c010710 tx=0x7f072c010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074a220700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0744074d00 0x7f07440750f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f072c010710 tx=0x7f072c010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074a220700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0744074d00 0x7f07440750f0 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7f072c010710 tx=0x7f072c010510).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:28.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074a220700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0744074d00 0x7f07440750f0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f072c010710 tx=0x7f072c010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f0742ffd700 1 -- 172.21.15.80:0/3029296858 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072c000cc0 con 0x7f0744074d00 2019-11-28T11:48:28.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074a220700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0744074d00 0x7f07440750f0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f072c010710 tx=0x7f072c010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074bc83700 1 -- 172.21.15.80:0/3029296858 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074407b810 con 0x7f0744074d00 2019-11-28T11:48:28.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074a220700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0744074d00 0x7f07440750f0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f072c010710 tx=0x7f072c010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f0742ffd700 1 -- 172.21.15.80:0/3029296858 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072c000cc0 con 0x7f0744074d00 2019-11-28T11:48:28.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f0742ffd700 1 -- 172.21.15.80:0/3029296858 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072c009ef0 con 0x7f0744074d00 2019-11-28T11:48:28.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.788+0000 7f074bc83700 1 -- 172.21.15.80:0/3029296858 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074407b490 con 0x7f0744074d00 2019-11-28T11:48:28.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.789+0000 7f074a220700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0744074d00 0x7f07440750f0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f072c010710 tx=0x7f072c010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.789+0000 7f0742ffd700 1 -- 172.21.15.80:0/3029296858 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f072c009900 con 0x7f0744074d00 2019-11-28T11:48:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.789+0000 7f074a220700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0744074d00 0x7f07440750f0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f072c010710 tx=0x7f072c010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.789+0000 7f0742ffd700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0728018770 0x7f072801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.789+0000 7f0742ffd700 1 -- 172.21.15.80:0/3029296858 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f072c031df0 con 0x7f0744074d00 2019-11-28T11:48:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.789+0000 7f0749a1f700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0728018770 0x7f072801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.790+0000 7f0749a1f700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0728018770 0x7f072801abe0 crc :-1 s=READY pgs=769 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:28.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.796+0000 7f074bc83700 1 -- 172.21.15.80:0/3029296858 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074407b810 con 0x7f0744074d00 2019-11-28T11:48:28.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.800+0000 7f074a220700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0744074d00 0x7f07440750f0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f072c010710 tx=0x7f072c010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:28.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.800+0000 7f0742ffd700 1 -- 172.21.15.80:0/3029296858 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f072c00a480 con 0x7f0744074d00 2019-11-28T11:48:29.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:28.966+0000 7f074bc83700 1 -- 172.21.15.80:0/3029296858 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f074407b490 con 0x7f0744074d00 2019-11-28T11:48:29.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.730+0000 7f074a220700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0744074d00 0x7f07440750f0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f072c010710 tx=0x7f072c010510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:29.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.730+0000 7f0742ffd700 1 -- 172.21.15.80:0/3029296858 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v109) v1 ==== 161+0+0 (secure 0 0 0) 0x7f072c009900 con 0x7f0744074d00 2019-11-28T11:48:29.777 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:48:29.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.733+0000 7f074bc83700 1 -- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0728018770 msgr2=0x7f072801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:29.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.733+0000 7f074bc83700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0728018770 0x7f072801abe0 crc :-1 s=READY pgs=769 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:29.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.733+0000 7f074bc83700 1 -- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0744074d00 msgr2=0x7f07440750f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:29.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.733+0000 7f074bc83700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0744074d00 0x7f07440750f0 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7f072c010710 tx=0x7f072c010510).stop 2019-11-28T11:48:29.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.733+0000 7f074bc83700 1 -- 172.21.15.80:0/3029296858 shutdown_connections 2019-11-28T11:48:29.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.733+0000 7f074bc83700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0728018770 0x7f072801abe0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:29.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.733+0000 7f074bc83700 1 --2- 172.21.15.80:0/3029296858 >> v2:172.21.15.174:3300/0 conn(0x7f0744153040 0x7f0744140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:29.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.733+0000 7f074bc83700 1 --2- 172.21.15.80:0/3029296858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0744074d00 0x7f07440750f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:29.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.733+0000 7f074bc83700 1 -- 172.21.15.80:0/3029296858 shutdown_connections 2019-11-28T11:48:29.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.733+0000 7f074bc83700 1 -- 172.21.15.80:0/3029296858 wait complete. 2019-11-28T11:48:29.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.733+0000 7f074bc83700 1 -- 172.21.15.80:0/3029296858 >> 172.21.15.80:0/3029296858 conn(0x7f074413fa50 msgr2=0x7f074407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:29.790 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:48:29.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.865+0000 7f214fb0d700 1 Processor -- start 2019-11-28T11:48:29.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.865+0000 7f214fb0d700 1 -- start start 2019-11-28T11:48:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.866+0000 7f214fb0d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f214806c0a0 0x7f2148072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.866+0000 7f214fb0d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f21480734e0 0x7f2148071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.866+0000 7f214fb0d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214806db00 con 0x7f2148072360 2019-11-28T11:48:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.866+0000 7f214fb0d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214806fd60 con 0x7f214806c0a0 2019-11-28T11:48:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.866+0000 7f214fb0d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2148070030 con 0x7f21480734e0 2019-11-28T11:48:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.866+0000 7f214e0aa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f214806c0a0 0x7f2148072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:29.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.866+0000 7f214e0aa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f214806c0a0 0x7f2148072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41198/0 (socket says 172.21.15.80:41198) 2019-11-28T11:48:29.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.866+0000 7f214e0aa700 1 -- 172.21.15.80:0/3895436574 learned_addr learned my addr 172.21.15.80:0/3895436574 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:29.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.866+0000 7f214d8a9700 1 --2- 172.21.15.80:0/3895436574 >> v2:172.21.15.174:3300/0 conn(0x7f21480734e0 0x7f2148071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:29.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.866+0000 7f214e0aa700 1 -- 172.21.15.80:0/3895436574 >> v2:172.21.15.174:3300/0 conn(0x7f21480734e0 msgr2=0x7f2148071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:29.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.866+0000 7f214e0aa700 1 --2- 172.21.15.80:0/3895436574 >> v2:172.21.15.174:3300/0 conn(0x7f21480734e0 0x7f2148071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:29.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.866+0000 7f214e0aa700 1 -- 172.21.15.80:0/3895436574 >> v1:172.21.15.174:6789/0 conn(0x7f2148072360 legacy=0x7f214806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:29.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.867+0000 7f214e0aa700 1 -- 172.21.15.80:0/3895436574 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21480706c0 con 0x7f214806c0a0 2019-11-28T11:48:29.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.867+0000 7f214e0aa700 1 --2- 172.21.15.80:0/3895436574 >> v2:172.21.15.80:3300/0 conn(0x7f214806c0a0 0x7f2148072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f213800fa40 tx=0x7f213800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:29.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.867+0000 7f214e0aa700 1 --2- 172.21.15.80:0/3895436574 >> v2:172.21.15.80:3300/0 conn(0x7f214806c0a0 0x7f2148072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f213800fa40 tx=0x7f213800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:29.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.867+0000 7f214e0aa700 1 --2- 172.21.15.80:0/3895436574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214806c0a0 0x7f2148072fa0 secure :-1 s=READY pgs=1903 cs=0 l=1 rx=0x7f213800fa40 tx=0x7f213800fde0).ready entity=mon.0 client_cookie=58bb64880a9e08ed server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:29.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.867+0000 7f214e0aa700 1 --2- 172.21.15.80:0/3895436574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214806c0a0 0x7f2148072fa0 secure :-1 s=THROTTLE_DONE pgs=1903 cs=0 l=1 rx=0x7f213800fa40 tx=0x7f213800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:29.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.867+0000 7f214e0aa700 1 --2- 172.21.15.80:0/3895436574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214806c0a0 0x7f2148072fa0 secure :-1 s=THROTTLE_DONE pgs=1903 cs=0 l=1 rx=0x7f213800fa40 tx=0x7f213800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:29.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.867+0000 7f214d0a8700 1 -- 172.21.15.80:0/3895436574 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2138000ce0 con 0x7f214806c0a0 2019-11-28T11:48:29.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.867+0000 7f214e0aa700 1 --2- 172.21.15.80:0/3895436574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214806c0a0 0x7f2148072fa0 secure :-1 s=THROTTLE_DONE pgs=1903 cs=0 l=1 rx=0x7f213800fa40 tx=0x7f213800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:29.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.867+0000 7f214d0a8700 1 -- 172.21.15.80:0/3895436574 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2138001010 con 0x7f214806c0a0 2019-11-28T11:48:29.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.867+0000 7f214d0a8700 1 -- 172.21.15.80:0/3895436574 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2138001720 con 0x7f214806c0a0 2019-11-28T11:48:29.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.867+0000 7f214fb0d700 1 -- 172.21.15.80:0/3895436574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214806c0a0 msgr2=0x7f2148072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:29.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.867+0000 7f214fb0d700 1 --2- 172.21.15.80:0/3895436574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214806c0a0 0x7f2148072fa0 secure :-1 s=READY pgs=1903 cs=0 l=1 rx=0x7f213800fa40 tx=0x7f213800fde0).stop 2019-11-28T11:48:29.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.868+0000 7f214fb0d700 1 -- 172.21.15.80:0/3895436574 shutdown_connections 2019-11-28T11:48:29.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.868+0000 7f214fb0d700 1 --2- 172.21.15.80:0/3895436574 >> v2:172.21.15.174:3300/0 conn(0x7f21480734e0 0x7f2148071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:29.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.868+0000 7f214fb0d700 1 --2- 172.21.15.80:0/3895436574 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214806c0a0 0x7f2148072fa0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:29.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.868+0000 7f214fb0d700 1 -- 172.21.15.80:0/3895436574 shutdown_connections 2019-11-28T11:48:29.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.868+0000 7f214fb0d700 1 -- 172.21.15.80:0/3895436574 wait complete. 2019-11-28T11:48:29.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.868+0000 7f214fb0d700 1 -- 172.21.15.80:0/3895436574 >> 172.21.15.80:0/3895436574 conn(0x7f2148061cf0 msgr2=0x7f2148064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:29.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.870+0000 7f214fb0d700 1 Processor -- start 2019-11-28T11:48:29.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.870+0000 7f214fb0d700 1 -- start start 2019-11-28T11:48:29.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.871+0000 7f214fb0d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2148104820 0x7f214810c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:29.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.871+0000 7f214fb0d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f214810b9d0 0x7f2148167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:29.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.871+0000 7f214fb0d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214813bcd0 con 0x7f214810c890 2019-11-28T11:48:29.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.871+0000 7f214fb0d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2148109130 con 0x7f214810b9d0 2019-11-28T11:48:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.871+0000 7f214fb0d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2148109400 con 0x7f2148104820 2019-11-28T11:48:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.871+0000 7f214e8ab700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f214810b9d0 0x7f2148167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.871+0000 7f214e8ab700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f214810b9d0 0x7f2148167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41206/0 (socket says 172.21.15.80:41206) 2019-11-28T11:48:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.871+0000 7f214e8ab700 1 -- 172.21.15.80:0/2740034208 learned_addr learned my addr 172.21.15.80:0/2740034208 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.871+0000 7f214e0aa700 1 --2- 172.21.15.80:0/2740034208 >> v2:172.21.15.174:3300/0 conn(0x7f2148104820 0x7f214810c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:29.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.871+0000 7f214e8ab700 1 -- 172.21.15.80:0/2740034208 >> v2:172.21.15.174:3300/0 conn(0x7f2148104820 msgr2=0x7f214810c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.871+0000 7f214e8ab700 1 --2- 172.21.15.80:0/2740034208 >> v2:172.21.15.174:3300/0 conn(0x7f2148104820 0x7f214810c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.871+0000 7f214e8ab700 1 -- 172.21.15.80:0/2740034208 >> v1:172.21.15.174:6789/0 conn(0x7f214810c890 legacy=0x7f214810b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.871+0000 7f214e8ab700 1 -- 172.21.15.80:0/2740034208 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2148109a90 con 0x7f214810b9d0 2019-11-28T11:48:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.871+0000 7f214e8ab700 1 --2- 172.21.15.80:0/2740034208 >> v2:172.21.15.80:3300/0 conn(0x7f214810b9d0 0x7f2148167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2140010420 tx=0x7f2140010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.871+0000 7f214e8ab700 1 --2- 172.21.15.80:0/2740034208 >> v2:172.21.15.80:3300/0 conn(0x7f214810b9d0 0x7f2148167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2140010420 tx=0x7f2140010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.871+0000 7f214e8ab700 1 --2- 172.21.15.80:0/2740034208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214810b9d0 0x7f2148167a10 secure :-1 s=READY pgs=1904 cs=0 l=1 rx=0x7f2140010420 tx=0x7f2140010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:29.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.872+0000 7f214e8ab700 1 --2- 172.21.15.80:0/2740034208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214810b9d0 0x7f2148167a10 secure :-1 s=THROTTLE_DONE pgs=1904 cs=0 l=1 rx=0x7f2140010420 tx=0x7f2140010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.872+0000 7f2146ffd700 1 -- 172.21.15.80:0/2740034208 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2140000a70 con 0x7f214810b9d0 2019-11-28T11:48:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.872+0000 7f214e8ab700 1 --2- 172.21.15.80:0/2740034208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214810b9d0 0x7f2148167a10 secure :-1 s=THROTTLE_DONE pgs=1904 cs=0 l=1 rx=0x7f2140010420 tx=0x7f2140010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.872+0000 7f2146ffd700 1 -- 172.21.15.80:0/2740034208 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2140001090 con 0x7f214810b9d0 2019-11-28T11:48:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.872+0000 7f214e8ab700 1 --2- 172.21.15.80:0/2740034208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214810b9d0 0x7f2148167a10 secure :-1 s=THROTTLE_DONE pgs=1904 cs=0 l=1 rx=0x7f2140010420 tx=0x7f2140010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.872+0000 7f2146ffd700 1 -- 172.21.15.80:0/2740034208 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2140001280 con 0x7f214810b9d0 2019-11-28T11:48:29.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.872+0000 7f214fb0d700 1 -- 172.21.15.80:0/2740034208 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2148109e10 con 0x7f214810b9d0 2019-11-28T11:48:29.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.872+0000 7f214fb0d700 1 -- 172.21.15.80:0/2740034208 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2148109a90 con 0x7f214810b9d0 2019-11-28T11:48:29.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.872+0000 7f214e8ab700 1 --2- 172.21.15.80:0/2740034208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214810b9d0 0x7f2148167a10 secure :-1 s=THROTTLE_DONE pgs=1904 cs=0 l=1 rx=0x7f2140010420 tx=0x7f2140010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.872+0000 7f2146ffd700 1 -- 172.21.15.80:0/2740034208 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2140000940 con 0x7f214810b9d0 2019-11-28T11:48:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.872+0000 7f214e8ab700 1 --2- 172.21.15.80:0/2740034208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214810b9d0 0x7f2148167a10 secure :-1 s=THROTTLE_DONE pgs=1904 cs=0 l=1 rx=0x7f2140010420 tx=0x7f2140010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.872+0000 7f2146ffd700 1 --2- 172.21.15.80:0/2740034208 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f212c018730 0x7f212c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.872+0000 7f2146ffd700 1 -- 172.21.15.80:0/2740034208 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f2140031ac0 con 0x7f214810b9d0 2019-11-28T11:48:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.873+0000 7f214e0aa700 1 --2- 172.21.15.80:0/2740034208 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f212c018730 0x7f212c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.873+0000 7f214e0aa700 1 --2- 172.21.15.80:0/2740034208 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f212c018730 0x7f212c01abc0 crc :-1 s=READY pgs=770 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.880+0000 7f214fb0d700 1 -- 172.21.15.80:0/2740034208 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2148109e10 con 0x7f214810b9d0 2019-11-28T11:48:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.884+0000 7f214e8ab700 1 --2- 172.21.15.80:0/2740034208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214810b9d0 0x7f2148167a10 secure :-1 s=THROTTLE_DONE pgs=1904 cs=0 l=1 rx=0x7f2140010420 tx=0x7f2140010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:29.884+0000 7f2146ffd700 1 -- 172.21.15.80:0/2740034208 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f21400075c0 con 0x7f214810b9d0 2019-11-28T11:48:30.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.055+0000 7f214fb0d700 1 -- 172.21.15.80:0/2740034208 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2148109a90 con 0x7f214810b9d0 2019-11-28T11:48:30.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.055+0000 7f214e8ab700 1 --2- 172.21.15.80:0/2740034208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214810b9d0 0x7f2148167a10 secure :-1 s=THROTTLE_DONE pgs=1904 cs=0 l=1 rx=0x7f2140010420 tx=0x7f2140010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.055+0000 7f2146ffd700 1 -- 172.21.15.80:0/2740034208 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f2140001890 con 0x7f214810b9d0 2019-11-28T11:48:30.102 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 109 2019-11-28T11:48:30.102 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:30.102 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":109,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":109,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:45:30.152127+0000","modified":"2019-11-28T11:48:29.729065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":145,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2019-11-28T11:48:30.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.058+0000 7f214fb0d700 1 -- 172.21.15.80:0/2740034208 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f212c018730 msgr2=0x7f212c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:30.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.058+0000 7f214fb0d700 1 --2- 172.21.15.80:0/2740034208 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f212c018730 0x7f212c01abc0 crc :-1 s=READY pgs=770 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:30.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.058+0000 7f214fb0d700 1 -- 172.21.15.80:0/2740034208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214810b9d0 msgr2=0x7f2148167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:30.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.058+0000 7f214fb0d700 1 --2- 172.21.15.80:0/2740034208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214810b9d0 0x7f2148167a10 secure :-1 s=READY pgs=1904 cs=0 l=1 rx=0x7f2140010420 tx=0x7f2140010280).stop 2019-11-28T11:48:30.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.058+0000 7f214fb0d700 1 -- 172.21.15.80:0/2740034208 shutdown_connections 2019-11-28T11:48:30.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.058+0000 7f214fb0d700 1 --2- 172.21.15.80:0/2740034208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f214810b9d0 0x7f2148167a10 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:30.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.058+0000 7f214fb0d700 1 --2- 172.21.15.80:0/2740034208 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f212c018730 0x7f212c01abc0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:30.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.058+0000 7f214fb0d700 1 --2- 172.21.15.80:0/2740034208 >> v2:172.21.15.174:3300/0 conn(0x7f2148104820 0x7f214810c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:30.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.058+0000 7f214fb0d700 1 -- 172.21.15.80:0/2740034208 shutdown_connections 2019-11-28T11:48:30.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.058+0000 7f214fb0d700 1 -- 172.21.15.80:0/2740034208 wait complete. 2019-11-28T11:48:30.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.058+0000 7f214fb0d700 1 -- 172.21.15.80:0/2740034208 >> 172.21.15.80:0/2740034208 conn(0x7f214813d620 msgr2=0x7f214813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:30.114 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:48:30.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.191+0000 7fd53e73d700 1 Processor -- start 2019-11-28T11:48:30.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.191+0000 7fd53e73d700 1 -- start start 2019-11-28T11:48:30.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.192+0000 7fd53e73d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd53806c490 0x7fd53806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:30.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.192+0000 7fd53e73d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53806db00 con 0x7fd53806c0a0 2019-11-28T11:48:30.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.192+0000 7fd53e73d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53806e000 con 0x7fd53806ce60 2019-11-28T11:48:30.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.192+0000 7fd53e73d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53806fd60 con 0x7fd53806c490 2019-11-28T11:48:30.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.192+0000 7fd53ccda700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd53806c0a0 0x7fd538072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40526/0 (socket says 172.21.15.80:40526) 2019-11-28T11:48:30.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.192+0000 7fd53ccda700 1 -- 172.21.15.80:0/2340575798 learned_addr learned my addr 172.21.15.80:0/2340575798 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:30.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.192+0000 7fd537fff700 1 --2- 172.21.15.80:0/2340575798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd53806c490 0x7fd53806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:30.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.192+0000 7fd5377fe700 1 -- 172.21.15.80:0/2340575798 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124287931 0 0) 0x7fd520001150 con 0x7fd53806c0a0 2019-11-28T11:48:30.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.192+0000 7fd5377fe700 1 -- 172.21.15.80:0/2340575798 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd524002e80 con 0x7fd53806c0a0 2019-11-28T11:48:30.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.192+0000 7fd5377fe700 1 -- 172.21.15.80:0/2340575798 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958177515 0 0) 0x7fd530001080 con 0x7fd53806ce60 2019-11-28T11:48:30.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.192+0000 7fd5377fe700 1 -- 172.21.15.80:0/2340575798 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5240030b0 con 0x7fd53806ce60 2019-11-28T11:48:30.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.192+0000 7fd5377fe700 1 -- 172.21.15.80:0/2340575798 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2850761218 0 0) 0x7fd520001130 con 0x7fd53806c0a0 2019-11-28T11:48:30.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.193+0000 7fd537fff700 1 -- 172.21.15.80:0/2340575798 >> v1:172.21.15.174:6789/0 conn(0x7fd53806ce60 legacy=0x7fd538164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:30.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.193+0000 7fd537fff700 1 -- 172.21.15.80:0/2340575798 >> v1:172.21.15.80:6789/0 conn(0x7fd53806c0a0 legacy=0x7fd538072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:30.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.193+0000 7fd537fff700 1 -- 172.21.15.80:0/2340575798 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5380706c0 con 0x7fd53806c490 2019-11-28T11:48:30.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.193+0000 7fd537fff700 1 --2- 172.21.15.80:0/2340575798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd53806c490 0x7fd53806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd52800b2d0 tx=0x7fd52800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.193+0000 7fd537fff700 1 --2- 172.21.15.80:0/2340575798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd53806c490 0x7fd53806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd52800b2d0 tx=0x7fd52800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.193+0000 7fd537fff700 1 --2- 172.21.15.80:0/2340575798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd53806c490 0x7fd53806c920 secure :-1 s=READY pgs=264 cs=0 l=1 rx=0x7fd52800b2d0 tx=0x7fd52800bae0).ready entity=mon.2 client_cookie=7e7c6f7dbd077e69 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:30.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.193+0000 7fd537fff700 1 --2- 172.21.15.80:0/2340575798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd53806c490 0x7fd53806c920 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7fd52800b2d0 tx=0x7fd52800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.193+0000 7fd5377fe700 1 -- 172.21.15.80:0/2340575798 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd528000ce0 con 0x7fd53806c490 2019-11-28T11:48:30.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.193+0000 7fd537fff700 1 --2- 172.21.15.80:0/2340575798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd53806c490 0x7fd53806c920 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7fd52800b2d0 tx=0x7fd52800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.193+0000 7fd5377fe700 1 -- 172.21.15.80:0/2340575798 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd528000ce0 con 0x7fd53806c490 2019-11-28T11:48:30.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.193+0000 7fd537fff700 1 --2- 172.21.15.80:0/2340575798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd53806c490 0x7fd53806c920 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7fd52800b2d0 tx=0x7fd52800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.193+0000 7fd5377fe700 1 -- 172.21.15.80:0/2340575798 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd528009f20 con 0x7fd53806c490 2019-11-28T11:48:30.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.193+0000 7fd53e73d700 1 -- 172.21.15.80:0/2340575798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd53806c490 msgr2=0x7fd53806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:30.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.193+0000 7fd53e73d700 1 --2- 172.21.15.80:0/2340575798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd53806c490 0x7fd53806c920 secure :-1 s=READY pgs=264 cs=0 l=1 rx=0x7fd52800b2d0 tx=0x7fd52800bae0).stop 2019-11-28T11:48:30.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.194+0000 7fd53e73d700 1 -- 172.21.15.80:0/2340575798 shutdown_connections 2019-11-28T11:48:30.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.194+0000 7fd53e73d700 1 --2- 172.21.15.80:0/2340575798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd53806c490 0x7fd53806c920 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:30.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.194+0000 7fd53e73d700 1 -- 172.21.15.80:0/2340575798 shutdown_connections 2019-11-28T11:48:30.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.194+0000 7fd53e73d700 1 -- 172.21.15.80:0/2340575798 wait complete. 2019-11-28T11:48:30.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.194+0000 7fd53e73d700 1 -- 172.21.15.80:0/2340575798 >> 172.21.15.80:0/2340575798 conn(0x7fd538061cf0 msgr2=0x7fd538064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:30.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.196+0000 7fd53e73d700 1 Processor -- start 2019-11-28T11:48:30.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.196+0000 7fd53e73d700 1 -- start start 2019-11-28T11:48:30.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.197+0000 7fd53e73d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd538111db0 0x7fd5381238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:30.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.197+0000 7fd53e73d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd538165a00 0x7fd538167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:30.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.197+0000 7fd53e73d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd538124260 con 0x7fd53812cea0 2019-11-28T11:48:30.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.197+0000 7fd53e73d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd538121040 con 0x7fd538165a00 2019-11-28T11:48:30.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.197+0000 7fd53e73d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd538121310 con 0x7fd538111db0 2019-11-28T11:48:30.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.197+0000 7fd53d4db700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd538165a00 0x7fd538167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:30.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.197+0000 7fd53d4db700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd538165a00 0x7fd538167e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41218/0 (socket says 172.21.15.80:41218) 2019-11-28T11:48:30.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.197+0000 7fd53d4db700 1 -- 172.21.15.80:0/3656887721 learned_addr learned my addr 172.21.15.80:0/3656887721 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:30.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.197+0000 7fd537fff700 1 --2- 172.21.15.80:0/3656887721 >> v2:172.21.15.174:3300/0 conn(0x7fd538111db0 0x7fd5381238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:30.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.198+0000 7fd53d4db700 1 -- 172.21.15.80:0/3656887721 >> v2:172.21.15.174:3300/0 conn(0x7fd538111db0 msgr2=0x7fd5381238e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:30.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.198+0000 7fd53d4db700 1 --2- 172.21.15.80:0/3656887721 >> v2:172.21.15.174:3300/0 conn(0x7fd538111db0 0x7fd5381238e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:30.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.198+0000 7fd53d4db700 1 -- 172.21.15.80:0/3656887721 >> v1:172.21.15.174:6789/0 conn(0x7fd53812cea0 legacy=0x7fd5381230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:30.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.198+0000 7fd53d4db700 1 -- 172.21.15.80:0/3656887721 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5381219a0 con 0x7fd538165a00 2019-11-28T11:48:30.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.198+0000 7fd53d4db700 1 --2- 172.21.15.80:0/3656887721 >> v2:172.21.15.80:3300/0 conn(0x7fd538165a00 0x7fd538167e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd5300103f0 tx=0x7fd530010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.198+0000 7fd53d4db700 1 --2- 172.21.15.80:0/3656887721 >> v2:172.21.15.80:3300/0 conn(0x7fd538165a00 0x7fd538167e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd5300103f0 tx=0x7fd530010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.198+0000 7fd53d4db700 1 --2- 172.21.15.80:0/3656887721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538165a00 0x7fd538167e00 secure :-1 s=READY pgs=1906 cs=0 l=1 rx=0x7fd5300103f0 tx=0x7fd530010250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:30.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.198+0000 7fd53d4db700 1 --2- 172.21.15.80:0/3656887721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538165a00 0x7fd538167e00 secure :-1 s=THROTTLE_DONE pgs=1906 cs=0 l=1 rx=0x7fd5300103f0 tx=0x7fd530010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.198+0000 7fd5357fa700 1 -- 172.21.15.80:0/3656887721 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd530000940 con 0x7fd538165a00 2019-11-28T11:48:30.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.198+0000 7fd53d4db700 1 --2- 172.21.15.80:0/3656887721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538165a00 0x7fd538167e00 secure :-1 s=THROTTLE_DONE pgs=1906 cs=0 l=1 rx=0x7fd5300103f0 tx=0x7fd530010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.198+0000 7fd53d4db700 1 --2- 172.21.15.80:0/3656887721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538165a00 0x7fd538167e00 secure :-1 s=THROTTLE_DONE pgs=1906 cs=0 l=1 rx=0x7fd5300103f0 tx=0x7fd530010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.198+0000 7fd5357fa700 1 -- 172.21.15.80:0/3656887721 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd530005620 con 0x7fd538165a00 2019-11-28T11:48:30.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.198+0000 7fd5357fa700 1 -- 172.21.15.80:0/3656887721 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd530005d70 con 0x7fd538165a00 2019-11-28T11:48:30.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.198+0000 7fd53e73d700 1 -- 172.21.15.80:0/3656887721 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd538121d20 con 0x7fd538165a00 2019-11-28T11:48:30.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.198+0000 7fd53e73d700 1 -- 172.21.15.80:0/3656887721 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5381219a0 con 0x7fd538165a00 2019-11-28T11:48:30.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.198+0000 7fd53d4db700 1 --2- 172.21.15.80:0/3656887721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538165a00 0x7fd538167e00 secure :-1 s=THROTTLE_DONE pgs=1906 cs=0 l=1 rx=0x7fd5300103f0 tx=0x7fd530010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.199+0000 7fd5357fa700 1 -- 172.21.15.80:0/3656887721 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd530005810 con 0x7fd538165a00 2019-11-28T11:48:30.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.199+0000 7fd53d4db700 1 --2- 172.21.15.80:0/3656887721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538165a00 0x7fd538167e00 secure :-1 s=THROTTLE_DONE pgs=1906 cs=0 l=1 rx=0x7fd5300103f0 tx=0x7fd530010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.199+0000 7fd5357fa700 1 --2- 172.21.15.80:0/3656887721 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd51c018730 0x7fd51c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:30.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.199+0000 7fd5357fa700 1 -- 172.21.15.80:0/3656887721 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fd530031ac0 con 0x7fd538165a00 2019-11-28T11:48:30.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.199+0000 7fd53ccda700 1 --2- 172.21.15.80:0/3656887721 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd51c018730 0x7fd51c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:30.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.199+0000 7fd53ccda700 1 --2- 172.21.15.80:0/3656887721 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd51c018730 0x7fd51c01abc0 crc :-1 s=READY pgs=771 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:30.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.206+0000 7fd53e73d700 1 -- 172.21.15.80:0/3656887721 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd538121d20 con 0x7fd538165a00 2019-11-28T11:48:30.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.209+0000 7fd53d4db700 1 --2- 172.21.15.80:0/3656887721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538165a00 0x7fd538167e00 secure :-1 s=THROTTLE_DONE pgs=1906 cs=0 l=1 rx=0x7fd5300103f0 tx=0x7fd530010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.209+0000 7fd5357fa700 1 -- 172.21.15.80:0/3656887721 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd530007590 con 0x7fd538165a00 2019-11-28T11:48:30.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.383+0000 7fd53e73d700 1 -- 172.21.15.80:0/3656887721 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd5381219a0 con 0x7fd538165a00 2019-11-28T11:48:30.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.737+0000 7fd53d4db700 1 --2- 172.21.15.80:0/3656887721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538165a00 0x7fd538167e00 secure :-1 s=THROTTLE_DONE pgs=1906 cs=0 l=1 rx=0x7fd5300103f0 tx=0x7fd530010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.737+0000 7fd5357fa700 1 -- 172.21.15.80:0/3656887721 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v110) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd530017570 con 0x7fd538165a00 2019-11-28T11:48:30.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.749+0000 7fd53e73d700 1 -- 172.21.15.80:0/3656887721 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd51c018730 msgr2=0x7fd51c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:30.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.749+0000 7fd53e73d700 1 --2- 172.21.15.80:0/3656887721 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd51c018730 0x7fd51c01abc0 crc :-1 s=READY pgs=771 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:30.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.749+0000 7fd53e73d700 1 -- 172.21.15.80:0/3656887721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538165a00 msgr2=0x7fd538167e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:30.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.749+0000 7fd53e73d700 1 --2- 172.21.15.80:0/3656887721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538165a00 0x7fd538167e00 secure :-1 s=READY pgs=1906 cs=0 l=1 rx=0x7fd5300103f0 tx=0x7fd530010250).stop 2019-11-28T11:48:30.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.750+0000 7fd53e73d700 1 -- 172.21.15.80:0/3656887721 shutdown_connections 2019-11-28T11:48:30.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.750+0000 7fd53e73d700 1 --2- 172.21.15.80:0/3656887721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd538165a00 0x7fd538167e00 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:30.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.750+0000 7fd53e73d700 1 --2- 172.21.15.80:0/3656887721 >> v2:172.21.15.174:3300/0 conn(0x7fd538111db0 0x7fd5381238e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:30.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.750+0000 7fd53e73d700 1 --2- 172.21.15.80:0/3656887721 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd51c018730 0x7fd51c01abc0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:30.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.750+0000 7fd53e73d700 1 -- 172.21.15.80:0/3656887721 shutdown_connections 2019-11-28T11:48:30.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.750+0000 7fd53e73d700 1 -- 172.21.15.80:0/3656887721 wait complete. 2019-11-28T11:48:30.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.750+0000 7fd53e73d700 1 -- 172.21.15.80:0/3656887721 >> 172.21.15.80:0/3656887721 conn(0x7fd5381426c0 msgr2=0x7fd538110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:30.806 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:48:30.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.883+0000 7f6c727f8700 1 Processor -- start 2019-11-28T11:48:30.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.883+0000 7f6c727f8700 1 -- start start 2019-11-28T11:48:30.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.884+0000 7f6c727f8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c6c1639f0 0x7f6c6c165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:30.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.884+0000 7f6c727f8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6c06db60 con 0x7f6c6c15ed10 2019-11-28T11:48:30.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.884+0000 7f6c727f8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6c06e060 con 0x7f6c6c15f100 2019-11-28T11:48:30.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.884+0000 7f6c727f8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6c06fe00 con 0x7f6c6c1639f0 2019-11-28T11:48:30.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.884+0000 7f6c71596700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c6c1639f0 0x7f6c6c165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:30.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.884+0000 7f6c70d95700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6c6c15ed10 0x7f6c6c073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40540/0 (socket says 172.21.15.80:40540) 2019-11-28T11:48:30.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.884+0000 7f6c70d95700 1 -- 172.21.15.80:0/3631567836 learned_addr learned my addr 172.21.15.80:0/3631567836 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:30.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.884+0000 7f6c71596700 1 -- 172.21.15.80:0/3631567836 >> v1:172.21.15.174:6789/0 conn(0x7f6c6c15f100 legacy=0x7f6c6c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:30.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.884+0000 7f6c71596700 1 -- 172.21.15.80:0/3631567836 >> v1:172.21.15.80:6789/0 conn(0x7f6c6c15ed10 legacy=0x7f6c6c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:30.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.884+0000 7f6c71596700 1 -- 172.21.15.80:0/3631567836 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c070760 con 0x7f6c6c1639f0 2019-11-28T11:48:30.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.884+0000 7f6c6b7fe700 1 -- 172.21.15.80:0/3631567836 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600849409 0 0) 0x7f6c640014d0 con 0x7f6c6c15ed10 2019-11-28T11:48:30.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.884+0000 7f6c71596700 1 --2- 172.21.15.80:0/3631567836 >> v2:172.21.15.80:3300/0 conn(0x7f6c6c1639f0 0x7f6c6c165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6c5400af50 tx=0x7f6c5400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.884+0000 7f6c71596700 1 --2- 172.21.15.80:0/3631567836 >> v2:172.21.15.80:3300/0 conn(0x7f6c6c1639f0 0x7f6c6c165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6c5400af50 tx=0x7f6c5400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.884+0000 7f6c71596700 1 --2- 172.21.15.80:0/3631567836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c1639f0 0x7f6c6c165df0 secure :-1 s=READY pgs=1908 cs=0 l=1 rx=0x7f6c5400af50 tx=0x7f6c5400b760).ready entity=mon.0 client_cookie=8af182363f739fac server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:30.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.885+0000 7f6c71596700 1 --2- 172.21.15.80:0/3631567836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c1639f0 0x7f6c6c165df0 secure :-1 s=THROTTLE_DONE pgs=1908 cs=0 l=1 rx=0x7f6c5400af50 tx=0x7f6c5400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.885+0000 7f6c71596700 1 --2- 172.21.15.80:0/3631567836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c1639f0 0x7f6c6c165df0 secure :-1 s=THROTTLE_DONE pgs=1908 cs=0 l=1 rx=0x7f6c5400af50 tx=0x7f6c5400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.885+0000 7f6c6b7fe700 1 -- 172.21.15.80:0/3631567836 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c54009ba0 con 0x7f6c6c1639f0 2019-11-28T11:48:30.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.885+0000 7f6c71596700 1 --2- 172.21.15.80:0/3631567836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c1639f0 0x7f6c6c165df0 secure :-1 s=THROTTLE_DONE pgs=1908 cs=0 l=1 rx=0x7f6c5400af50 tx=0x7f6c5400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.885+0000 7f6c6b7fe700 1 -- 172.21.15.80:0/3631567836 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c54000a70 con 0x7f6c6c1639f0 2019-11-28T11:48:30.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.885+0000 7f6c6b7fe700 1 -- 172.21.15.80:0/3631567836 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c5400a180 con 0x7f6c6c1639f0 2019-11-28T11:48:30.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.885+0000 7f6c727f8700 1 -- 172.21.15.80:0/3631567836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c1639f0 msgr2=0x7f6c6c165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:30.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.885+0000 7f6c727f8700 1 --2- 172.21.15.80:0/3631567836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c1639f0 0x7f6c6c165df0 secure :-1 s=READY pgs=1908 cs=0 l=1 rx=0x7f6c5400af50 tx=0x7f6c5400b760).stop 2019-11-28T11:48:30.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.885+0000 7f6c727f8700 1 -- 172.21.15.80:0/3631567836 shutdown_connections 2019-11-28T11:48:30.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.885+0000 7f6c727f8700 1 --2- 172.21.15.80:0/3631567836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c1639f0 0x7f6c6c165df0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:30.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.885+0000 7f6c727f8700 1 -- 172.21.15.80:0/3631567836 shutdown_connections 2019-11-28T11:48:30.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.885+0000 7f6c727f8700 1 -- 172.21.15.80:0/3631567836 wait complete. 2019-11-28T11:48:30.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.885+0000 7f6c727f8700 1 -- 172.21.15.80:0/3631567836 >> 172.21.15.80:0/3631567836 conn(0x7f6c6c061d20 msgr2=0x7f6c6c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:30.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.888+0000 7f6c727f8700 1 Processor -- start 2019-11-28T11:48:30.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.888+0000 7f6c727f8700 1 -- start start 2019-11-28T11:48:30.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c727f8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6c6c153db0 0x7f6c6c10dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:30.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c727f8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c6c10e270 0x7f6c6c148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:30.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c727f8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6c1057a0 con 0x7f6c6c148570 2019-11-28T11:48:30.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c727f8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6c106280 con 0x7f6c6c10e270 2019-11-28T11:48:30.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c727f8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6c106550 con 0x7f6c6c153db0 2019-11-28T11:48:30.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c6bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c6c10e270 0x7f6c6c148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:30.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c6bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c6c10e270 0x7f6c6c148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41230/0 (socket says 172.21.15.80:41230) 2019-11-28T11:48:30.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c6bfff700 1 -- 172.21.15.80:0/1083754115 learned_addr learned my addr 172.21.15.80:0/1083754115 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:30.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c70d95700 1 --2- 172.21.15.80:0/1083754115 >> v2:172.21.15.174:3300/0 conn(0x7f6c6c153db0 0x7f6c6c10dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:30.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c6bfff700 1 -- 172.21.15.80:0/1083754115 >> v2:172.21.15.174:3300/0 conn(0x7f6c6c153db0 msgr2=0x7f6c6c10dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:30.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c6bfff700 1 --2- 172.21.15.80:0/1083754115 >> v2:172.21.15.174:3300/0 conn(0x7f6c6c153db0 0x7f6c6c10dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:30.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c6bfff700 1 -- 172.21.15.80:0/1083754115 >> v1:172.21.15.174:6789/0 conn(0x7f6c6c148570 legacy=0x7f6c6c10cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:30.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c697fa700 1 -- 172.21.15.80:0/1083754115 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411498202 0 0) 0x7f6c54000940 con 0x7f6c6c148570 2019-11-28T11:48:30.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c6bfff700 1 -- 172.21.15.80:0/1083754115 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c106be0 con 0x7f6c6c10e270 2019-11-28T11:48:30.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c6bfff700 1 --2- 172.21.15.80:0/1083754115 >> v2:172.21.15.80:3300/0 conn(0x7f6c6c10e270 0x7f6c6c148030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6c5c010390 tx=0x7f6c5c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c6bfff700 1 --2- 172.21.15.80:0/1083754115 >> v2:172.21.15.80:3300/0 conn(0x7f6c6c10e270 0x7f6c6c148030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6c5c010390 tx=0x7f6c5c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c6bfff700 1 --2- 172.21.15.80:0/1083754115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c10e270 0x7f6c6c148030 secure :-1 s=READY pgs=1909 cs=0 l=1 rx=0x7f6c5c010390 tx=0x7f6c5c010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:30.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c6bfff700 1 --2- 172.21.15.80:0/1083754115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c10e270 0x7f6c6c148030 secure :-1 s=THROTTLE_DONE pgs=1909 cs=0 l=1 rx=0x7f6c5c010390 tx=0x7f6c5c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c697fa700 1 -- 172.21.15.80:0/1083754115 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c5c000960 con 0x7f6c6c10e270 2019-11-28T11:48:30.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c6bfff700 1 --2- 172.21.15.80:0/1083754115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c10e270 0x7f6c6c148030 secure :-1 s=THROTTLE_DONE pgs=1909 cs=0 l=1 rx=0x7f6c5c010390 tx=0x7f6c5c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c727f8700 1 -- 172.21.15.80:0/1083754115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6c106f60 con 0x7f6c6c10e270 2019-11-28T11:48:30.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c697fa700 1 -- 172.21.15.80:0/1083754115 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c000960 con 0x7f6c6c10e270 2019-11-28T11:48:30.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c6bfff700 1 --2- 172.21.15.80:0/1083754115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c10e270 0x7f6c6c148030 secure :-1 s=THROTTLE_DONE pgs=1909 cs=0 l=1 rx=0x7f6c5c010390 tx=0x7f6c5c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.889+0000 7f6c697fa700 1 -- 172.21.15.80:0/1083754115 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c5c001290 con 0x7f6c6c10e270 2019-11-28T11:48:30.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.890+0000 7f6c727f8700 1 -- 172.21.15.80:0/1083754115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6c106be0 con 0x7f6c6c10e270 2019-11-28T11:48:30.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.890+0000 7f6c6bfff700 1 --2- 172.21.15.80:0/1083754115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c10e270 0x7f6c6c148030 secure :-1 s=THROTTLE_DONE pgs=1909 cs=0 l=1 rx=0x7f6c5c010390 tx=0x7f6c5c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.890+0000 7f6c697fa700 1 -- 172.21.15.80:0/1083754115 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6c5c000eb0 con 0x7f6c6c10e270 2019-11-28T11:48:30.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.890+0000 7f6c6bfff700 1 --2- 172.21.15.80:0/1083754115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c10e270 0x7f6c6c148030 secure :-1 s=THROTTLE_DONE pgs=1909 cs=0 l=1 rx=0x7f6c5c010390 tx=0x7f6c5c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.890+0000 7f6c697fa700 1 --2- 172.21.15.80:0/1083754115 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c50018730 0x7f6c5001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:30.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.890+0000 7f6c697fa700 1 -- 172.21.15.80:0/1083754115 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f6c5c031b20 con 0x7f6c6c10e270 2019-11-28T11:48:30.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.891+0000 7f6c70d95700 1 --2- 172.21.15.80:0/1083754115 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c50018730 0x7f6c5001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:30.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.891+0000 7f6c70d95700 1 --2- 172.21.15.80:0/1083754115 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c50018730 0x7f6c5001abc0 crc :-1 s=READY pgs=772 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:30.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.898+0000 7f6c727f8700 1 -- 172.21.15.80:0/1083754115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6c106f60 con 0x7f6c6c10e270 2019-11-28T11:48:30.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.901+0000 7f6c6bfff700 1 --2- 172.21.15.80:0/1083754115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c10e270 0x7f6c6c148030 secure :-1 s=THROTTLE_DONE pgs=1909 cs=0 l=1 rx=0x7f6c5c010390 tx=0x7f6c5c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:30.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:30.901+0000 7f6c697fa700 1 -- 172.21.15.80:0/1083754115 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6c5c0075b0 con 0x7f6c6c10e270 2019-11-28T11:48:31.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.071+0000 7f6c727f8700 1 -- 172.21.15.80:0/1083754115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6c6c106be0 con 0x7f6c6c10e270 2019-11-28T11:48:31.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.751+0000 7f6c6bfff700 1 --2- 172.21.15.80:0/1083754115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c10e270 0x7f6c6c148030 secure :-1 s=THROTTLE_DONE pgs=1909 cs=0 l=1 rx=0x7f6c5c010390 tx=0x7f6c5c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:31.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.751+0000 7f6c697fa700 1 -- 172.21.15.80:0/1083754115 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v146) v1 ==== 185+0+0 (secure 0 0 0) 0x7f6c5c000c10 con 0x7f6c6c10e270 2019-11-28T11:48:31.833 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:48:31.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.788+0000 7f6c727f8700 1 -- 172.21.15.80:0/1083754115 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c50018730 msgr2=0x7f6c5001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:31.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.788+0000 7f6c727f8700 1 --2- 172.21.15.80:0/1083754115 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c50018730 0x7f6c5001abc0 crc :-1 s=READY pgs=772 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:31.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.788+0000 7f6c727f8700 1 -- 172.21.15.80:0/1083754115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c10e270 msgr2=0x7f6c6c148030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:31.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.788+0000 7f6c727f8700 1 --2- 172.21.15.80:0/1083754115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c10e270 0x7f6c6c148030 secure :-1 s=READY pgs=1909 cs=0 l=1 rx=0x7f6c5c010390 tx=0x7f6c5c010730).stop 2019-11-28T11:48:31.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.788+0000 7f6c727f8700 1 -- 172.21.15.80:0/1083754115 shutdown_connections 2019-11-28T11:48:31.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.788+0000 7f6c727f8700 1 --2- 172.21.15.80:0/1083754115 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6c50018730 0x7f6c5001abc0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:31.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.788+0000 7f6c727f8700 1 --2- 172.21.15.80:0/1083754115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c6c10e270 0x7f6c6c148030 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:31.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.788+0000 7f6c727f8700 1 --2- 172.21.15.80:0/1083754115 >> v2:172.21.15.174:3300/0 conn(0x7f6c6c153db0 0x7f6c6c10dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:31.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.788+0000 7f6c727f8700 1 -- 172.21.15.80:0/1083754115 shutdown_connections 2019-11-28T11:48:31.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.788+0000 7f6c727f8700 1 -- 172.21.15.80:0/1083754115 wait complete. 2019-11-28T11:48:31.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.788+0000 7f6c727f8700 1 -- 172.21.15.80:0/1083754115 >> 172.21.15.80:0/1083754115 conn(0x7f6c6c15e2d0 msgr2=0x7f6c6c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:31.845 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:48:31.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.934+0000 7fa966730700 1 Processor -- start 2019-11-28T11:48:31.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.935+0000 7fa966730700 1 -- start start 2019-11-28T11:48:31.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.935+0000 7fa966730700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa96015ed10 0x7fa96015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:31.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.935+0000 7fa966730700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9600734b0 0x7fa9600726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:31.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.935+0000 7fa966730700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96006db60 con 0x7fa960073020 2019-11-28T11:48:31.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.935+0000 7fa966730700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96006f3d0 con 0x7fa9600734b0 2019-11-28T11:48:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.935+0000 7fa966730700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96006fe00 con 0x7fa96015ed10 2019-11-28T11:48:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.936+0000 7fa964ccd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa96015ed10 0x7fa96015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.936+0000 7fa9654ce700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9600734b0 0x7fa9600726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.936+0000 7fa9654ce700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9600734b0 0x7fa9600726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:56122/0 (socket says 172.21.15.80:56122) 2019-11-28T11:48:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.936+0000 7fa964ccd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa96015ed10 0x7fa96015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:43496/0 (socket says 172.21.15.80:43496) 2019-11-28T11:48:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.936+0000 7fa9654ce700 1 -- 172.21.15.80:0/3929160520 learned_addr learned my addr 172.21.15.80:0/3929160520 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.936+0000 7fa95ffff700 1 --1- 172.21.15.80:0/3929160520 >> v1:172.21.15.174:6789/0 conn(0x7fa960073020 0x7fa960071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:56096/0 (socket says 172.21.15.80:56096) 2019-11-28T11:48:31.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.936+0000 7fa9654ce700 1 -- 172.21.15.80:0/3929160520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa96015ed10 msgr2=0x7fa96015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:31.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.936+0000 7fa9654ce700 1 --2- 172.21.15.80:0/3929160520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa96015ed10 0x7fa96015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:31.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.936+0000 7fa9654ce700 1 -- 172.21.15.80:0/3929160520 >> v1:172.21.15.174:6789/0 conn(0x7fa960073020 legacy=0x7fa960071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:31.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.936+0000 7fa9654ce700 1 -- 172.21.15.80:0/3929160520 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa960070760 con 0x7fa9600734b0 2019-11-28T11:48:31.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.936+0000 7fa95f7fe700 1 -- 172.21.15.80:0/3929160520 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695360016 0 0) 0x7fa950001400 con 0x7fa960073020 2019-11-28T11:48:31.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.936+0000 7fa964ccd700 1 --2- 172.21.15.80:0/3929160520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa96015ed10 0x7fa96015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:48:31.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.936+0000 7fa9654ce700 1 --2- 172.21.15.80:0/3929160520 >> v2:172.21.15.174:3300/0 conn(0x7fa9600734b0 0x7fa9600726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa95800f760 tx=0x7fa95800fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:31.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.936+0000 7fa9654ce700 1 --2- 172.21.15.80:0/3929160520 >> v2:172.21.15.174:3300/0 conn(0x7fa9600734b0 0x7fa9600726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa95800f760 tx=0x7fa95800fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:31.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.936+0000 7fa9654ce700 1 --2- 172.21.15.80:0/3929160520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9600734b0 0x7fa9600726a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rx=0x7fa95800f760 tx=0x7fa95800fb00).ready entity=mon.1 client_cookie=abdececcb23ce88 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:31.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.937+0000 7fa9654ce700 1 --2- 172.21.15.80:0/3929160520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9600734b0 0x7fa9600726a0 secure :-1 s=THROTTLE_DONE pgs=1114 cs=0 l=1 rx=0x7fa95800f760 tx=0x7fa95800fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:31.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.937+0000 7fa95f7fe700 1 -- 172.21.15.80:0/3929160520 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa958000a70 con 0x7fa9600734b0 2019-11-28T11:48:31.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.937+0000 7fa9654ce700 1 --2- 172.21.15.80:0/3929160520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9600734b0 0x7fa9600726a0 secure :-1 s=THROTTLE_DONE pgs=1114 cs=0 l=1 rx=0x7fa95800f760 tx=0x7fa95800fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:31.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.937+0000 7fa9654ce700 1 --2- 172.21.15.80:0/3929160520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9600734b0 0x7fa9600726a0 secure :-1 s=THROTTLE_DONE pgs=1114 cs=0 l=1 rx=0x7fa95800f760 tx=0x7fa95800fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.937+0000 7fa95f7fe700 1 -- 172.21.15.80:0/3929160520 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa958000e70 con 0x7fa9600734b0 2019-11-28T11:48:32.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.937+0000 7fa95f7fe700 1 -- 172.21.15.80:0/3929160520 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa958001250 con 0x7fa9600734b0 2019-11-28T11:48:32.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.937+0000 7fa966730700 1 -- 172.21.15.80:0/3929160520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9600734b0 msgr2=0x7fa9600726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:32.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.937+0000 7fa966730700 1 --2- 172.21.15.80:0/3929160520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9600734b0 0x7fa9600726a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rx=0x7fa95800f760 tx=0x7fa95800fb00).stop 2019-11-28T11:48:32.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.937+0000 7fa966730700 1 -- 172.21.15.80:0/3929160520 shutdown_connections 2019-11-28T11:48:32.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.937+0000 7fa966730700 1 --2- 172.21.15.80:0/3929160520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9600734b0 0x7fa9600726a0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:32.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.937+0000 7fa966730700 1 --2- 172.21.15.80:0/3929160520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa96015ed10 0x7fa96015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:32.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.937+0000 7fa966730700 1 -- 172.21.15.80:0/3929160520 shutdown_connections 2019-11-28T11:48:32.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.937+0000 7fa966730700 1 -- 172.21.15.80:0/3929160520 wait complete. 2019-11-28T11:48:32.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.937+0000 7fa966730700 1 -- 172.21.15.80:0/3929160520 >> 172.21.15.80:0/3929160520 conn(0x7fa960061d20 msgr2=0x7fa9600641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:32.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.940+0000 7fa966730700 1 Processor -- start 2019-11-28T11:48:32.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.940+0000 7fa966730700 1 -- start start 2019-11-28T11:48:32.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa966730700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa9601079b0 0x7fa960107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:32.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa966730700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa960108380 0x7fa960168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:32.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa966730700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa960148e00 con 0x7fa960148320 2019-11-28T11:48:32.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa966730700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96013aa20 con 0x7fa9601079b0 2019-11-28T11:48:32.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa966730700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96013acf0 con 0x7fa960108380 2019-11-28T11:48:32.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa95ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa9601079b0 0x7fa960107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:32.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa95ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa9601079b0 0x7fa960107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41240/0 (socket says 172.21.15.80:41240) 2019-11-28T11:48:32.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa964ccd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa960148320 0x7fa96010ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40558/0 (socket says 172.21.15.80:40558) 2019-11-28T11:48:32.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa95ffff700 1 -- 172.21.15.80:0/2966463133 learned_addr learned my addr 172.21.15.80:0/2966463133 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa9654ce700 1 --2- 172.21.15.80:0/2966463133 >> v2:172.21.15.174:3300/0 conn(0x7fa960108380 0x7fa960168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa95ffff700 1 -- 172.21.15.80:0/2966463133 >> v2:172.21.15.174:3300/0 conn(0x7fa960108380 msgr2=0x7fa960168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa95ffff700 1 --2- 172.21.15.80:0/2966463133 >> v2:172.21.15.174:3300/0 conn(0x7fa960108380 0x7fa960168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa95ffff700 1 -- 172.21.15.80:0/2966463133 >> v1:172.21.15.80:6789/0 conn(0x7fa960148320 legacy=0x7fa96010ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa95ffff700 1 -- 172.21.15.80:0/2966463133 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96010c490 con 0x7fa9601079b0 2019-11-28T11:48:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa95d7fa700 1 -- 172.21.15.80:0/2966463133 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648615632 0 0) 0x7fa94800dd90 con 0x7fa960148320 2019-11-28T11:48:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa95ffff700 1 --2- 172.21.15.80:0/2966463133 >> v2:172.21.15.80:3300/0 conn(0x7fa9601079b0 0x7fa960107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa9500107c0 tx=0x7fa9500105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa95ffff700 1 --2- 172.21.15.80:0/2966463133 >> v2:172.21.15.80:3300/0 conn(0x7fa9601079b0 0x7fa960107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa9500107c0 tx=0x7fa9500105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa95ffff700 1 --2- 172.21.15.80:0/2966463133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9601079b0 0x7fa960107e40 secure :-1 s=READY pgs=1911 cs=0 l=1 rx=0x7fa9500107c0 tx=0x7fa9500105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa95ffff700 1 --2- 172.21.15.80:0/2966463133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9601079b0 0x7fa960107e40 secure :-1 s=THROTTLE_DONE pgs=1911 cs=0 l=1 rx=0x7fa9500107c0 tx=0x7fa9500105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.941+0000 7fa95d7fa700 1 -- 172.21.15.80:0/2966463133 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa950004540 con 0x7fa9601079b0 2019-11-28T11:48:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.942+0000 7fa95ffff700 1 --2- 172.21.15.80:0/2966463133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9601079b0 0x7fa960107e40 secure :-1 s=THROTTLE_DONE pgs=1911 cs=0 l=1 rx=0x7fa9500107c0 tx=0x7fa9500105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.942+0000 7fa95d7fa700 1 -- 172.21.15.80:0/2966463133 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa950000fe0 con 0x7fa9601079b0 2019-11-28T11:48:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.942+0000 7fa966730700 1 -- 172.21.15.80:0/2966463133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96010c810 con 0x7fa9601079b0 2019-11-28T11:48:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.942+0000 7fa95ffff700 1 --2- 172.21.15.80:0/2966463133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9601079b0 0x7fa960107e40 secure :-1 s=THROTTLE_DONE pgs=1911 cs=0 l=1 rx=0x7fa9500107c0 tx=0x7fa9500105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.942+0000 7fa95d7fa700 1 -- 172.21.15.80:0/2966463133 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa950004730 con 0x7fa9601079b0 2019-11-28T11:48:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.942+0000 7fa966730700 1 -- 172.21.15.80:0/2966463133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa960108820 con 0x7fa9601079b0 2019-11-28T11:48:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.942+0000 7fa95ffff700 1 --2- 172.21.15.80:0/2966463133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9601079b0 0x7fa960107e40 secure :-1 s=THROTTLE_DONE pgs=1911 cs=0 l=1 rx=0x7fa9500107c0 tx=0x7fa9500105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.942+0000 7fa95d7fa700 1 -- 172.21.15.80:0/2966463133 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa950004540 con 0x7fa9601079b0 2019-11-28T11:48:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.942+0000 7fa95ffff700 1 --2- 172.21.15.80:0/2966463133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9601079b0 0x7fa960107e40 secure :-1 s=THROTTLE_DONE pgs=1911 cs=0 l=1 rx=0x7fa9500107c0 tx=0x7fa9500105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.942+0000 7fa95d7fa700 1 --2- 172.21.15.80:0/2966463133 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa944018730 0x7fa94401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.942+0000 7fa95d7fa700 1 -- 172.21.15.80:0/2966463133 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5711+0+0 (secure 0 0 0) 0x7fa950031e50 con 0x7fa9601079b0 2019-11-28T11:48:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.943+0000 7fa964ccd700 1 --2- 172.21.15.80:0/2966463133 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa944018730 0x7fa94401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.943+0000 7fa964ccd700 1 --2- 172.21.15.80:0/2966463133 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa944018730 0x7fa94401abc0 crc :-1 s=READY pgs=773 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.950+0000 7fa966730700 1 -- 172.21.15.80:0/2966463133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa96010c490 con 0x7fa9601079b0 2019-11-28T11:48:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.953+0000 7fa95ffff700 1 --2- 172.21.15.80:0/2966463133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9601079b0 0x7fa960107e40 secure :-1 s=THROTTLE_DONE pgs=1911 cs=0 l=1 rx=0x7fa9500107c0 tx=0x7fa9500105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:31.953+0000 7fa95d7fa700 1 -- 172.21.15.80:0/2966463133 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa950026050 con 0x7fa9601079b0 2019-11-28T11:48:32.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.121+0000 7fa966730700 1 -- 172.21.15.80:0/2966463133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa96010c810 con 0x7fa9601079b0 2019-11-28T11:48:32.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.758+0000 7fa95ffff700 1 --2- 172.21.15.80:0/2966463133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9601079b0 0x7fa960107e40 secure :-1 s=THROTTLE_DONE pgs=1911 cs=0 l=1 rx=0x7fa9500107c0 tx=0x7fa9500105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.758+0000 7fa95d7fa700 1 -- 172.21.15.80:0/2966463133 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v147) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa950026050 con 0x7fa9601079b0 2019-11-28T11:48:32.832 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:48:32.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.788+0000 7fa966730700 1 -- 172.21.15.80:0/2966463133 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa944018730 msgr2=0x7fa94401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:32.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.788+0000 7fa966730700 1 --2- 172.21.15.80:0/2966463133 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa944018730 0x7fa94401abc0 crc :-1 s=READY pgs=773 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:32.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.788+0000 7fa966730700 1 -- 172.21.15.80:0/2966463133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9601079b0 msgr2=0x7fa960107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:32.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.788+0000 7fa966730700 1 --2- 172.21.15.80:0/2966463133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9601079b0 0x7fa960107e40 secure :-1 s=READY pgs=1911 cs=0 l=1 rx=0x7fa9500107c0 tx=0x7fa9500105f0).stop 2019-11-28T11:48:32.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.788+0000 7fa966730700 1 -- 172.21.15.80:0/2966463133 shutdown_connections 2019-11-28T11:48:32.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.788+0000 7fa966730700 1 --2- 172.21.15.80:0/2966463133 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa944018730 0x7fa94401abc0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:32.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.788+0000 7fa966730700 1 --2- 172.21.15.80:0/2966463133 >> v2:172.21.15.174:3300/0 conn(0x7fa960108380 0x7fa960168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:32.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.788+0000 7fa966730700 1 --2- 172.21.15.80:0/2966463133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9601079b0 0x7fa960107e40 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:32.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.788+0000 7fa966730700 1 -- 172.21.15.80:0/2966463133 shutdown_connections 2019-11-28T11:48:32.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.788+0000 7fa966730700 1 -- 172.21.15.80:0/2966463133 wait complete. 2019-11-28T11:48:32.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.788+0000 7fa966730700 1 -- 172.21.15.80:0/2966463133 >> 172.21.15.80:0/2966463133 conn(0x7fa96015e2d0 msgr2=0x7fa960147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:32.844 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:48:32.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.923+0000 7f9bef329700 1 Processor -- start 2019-11-28T11:48:32.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.923+0000 7f9bef329700 1 -- start start 2019-11-28T11:48:32.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.924+0000 7f9bef329700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9be806c0a0 0x7f9be8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:32.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.924+0000 7f9bef329700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9be8072620 0x7f9be8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:32.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.924+0000 7f9bef329700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be806db00 con 0x7f9be80734e0 2019-11-28T11:48:32.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.924+0000 7f9bef329700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be806f330 con 0x7f9be8072620 2019-11-28T11:48:32.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.924+0000 7f9bef329700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be80706c0 con 0x7f9be806c0a0 2019-11-28T11:48:32.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.924+0000 7f9bee0c7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9be8072620 0x7f9be8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:32.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.924+0000 7f9bed0c5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9be80734e0 0x7f9be8071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40568/0 (socket says 172.21.15.80:40568) 2019-11-28T11:48:32.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bed0c5700 1 -- 172.21.15.80:0/2882976221 learned_addr learned my addr 172.21.15.80:0/2882976221 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:32.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bed8c6700 1 --2- 172.21.15.80:0/2882976221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9be806c0a0 0x7f9be8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:32.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bee0c7700 1 -- 172.21.15.80:0/2882976221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9be806c0a0 msgr2=0x7f9be8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:32.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bee0c7700 1 --2- 172.21.15.80:0/2882976221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9be806c0a0 0x7f9be8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:32.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bee0c7700 1 -- 172.21.15.80:0/2882976221 >> v1:172.21.15.80:6789/0 conn(0x7f9be80734e0 legacy=0x7f9be8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:32.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bee0c7700 1 -- 172.21.15.80:0/2882976221 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be8070a40 con 0x7f9be8072620 2019-11-28T11:48:32.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bec8c4700 1 -- 172.21.15.80:0/2882976221 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20624482 0 0) 0x7f9bd00013f0 con 0x7f9be80734e0 2019-11-28T11:48:32.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bee0c7700 1 --2- 172.21.15.80:0/2882976221 >> v2:172.21.15.80:3300/0 conn(0x7f9be8072620 0x7f9be8164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9be000af50 tx=0x7f9be000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bee0c7700 1 --2- 172.21.15.80:0/2882976221 >> v2:172.21.15.80:3300/0 conn(0x7f9be8072620 0x7f9be8164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9be000af50 tx=0x7f9be000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bee0c7700 1 --2- 172.21.15.80:0/2882976221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be8072620 0x7f9be8164d70 secure :-1 s=READY pgs=1913 cs=0 l=1 rx=0x7f9be000af50 tx=0x7f9be000b6e0).ready entity=mon.0 client_cookie=ad85c4081bfd817e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:32.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bee0c7700 1 --2- 172.21.15.80:0/2882976221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be8072620 0x7f9be8164d70 secure :-1 s=THROTTLE_DONE pgs=1913 cs=0 l=1 rx=0x7f9be000af50 tx=0x7f9be000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bec8c4700 1 -- 172.21.15.80:0/2882976221 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9be0009ba0 con 0x7f9be8072620 2019-11-28T11:48:32.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bee0c7700 1 --2- 172.21.15.80:0/2882976221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be8072620 0x7f9be8164d70 secure :-1 s=THROTTLE_DONE pgs=1913 cs=0 l=1 rx=0x7f9be000af50 tx=0x7f9be000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bee0c7700 1 --2- 172.21.15.80:0/2882976221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be8072620 0x7f9be8164d70 secure :-1 s=THROTTLE_DONE pgs=1913 cs=0 l=1 rx=0x7f9be000af50 tx=0x7f9be000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bec8c4700 1 -- 172.21.15.80:0/2882976221 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be00097c0 con 0x7f9be8072620 2019-11-28T11:48:32.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bec8c4700 1 -- 172.21.15.80:0/2882976221 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9be000a180 con 0x7f9be8072620 2019-11-28T11:48:32.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bef329700 1 -- 172.21.15.80:0/2882976221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be8072620 msgr2=0x7f9be8164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:32.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.925+0000 7f9bef329700 1 --2- 172.21.15.80:0/2882976221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be8072620 0x7f9be8164d70 secure :-1 s=READY pgs=1913 cs=0 l=1 rx=0x7f9be000af50 tx=0x7f9be000b6e0).stop 2019-11-28T11:48:32.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.926+0000 7f9bef329700 1 -- 172.21.15.80:0/2882976221 shutdown_connections 2019-11-28T11:48:32.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.926+0000 7f9bef329700 1 --2- 172.21.15.80:0/2882976221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be8072620 0x7f9be8164d70 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:32.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.926+0000 7f9bef329700 1 --2- 172.21.15.80:0/2882976221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9be806c0a0 0x7f9be8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:32.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.926+0000 7f9bef329700 1 -- 172.21.15.80:0/2882976221 shutdown_connections 2019-11-28T11:48:32.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.926+0000 7f9bef329700 1 -- 172.21.15.80:0/2882976221 wait complete. 2019-11-28T11:48:32.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.926+0000 7f9bef329700 1 -- 172.21.15.80:0/2882976221 >> 172.21.15.80:0/2882976221 conn(0x7f9be8061cf0 msgr2=0x7f9be8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:32.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.928+0000 7f9bef329700 1 Processor -- start 2019-11-28T11:48:32.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.928+0000 7f9bef329700 1 -- start start 2019-11-28T11:48:32.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.929+0000 7f9bef329700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9be813e5f0 0x7f9be813e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:32.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.929+0000 7f9bef329700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9be810a070 0x7f9be810bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:32.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.929+0000 7f9bef329700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be81066e0 con 0x7f9be810a4e0 2019-11-28T11:48:32.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.929+0000 7f9bef329700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be810e060 con 0x7f9be810a070 2019-11-28T11:48:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.929+0000 7f9bef329700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be810e330 con 0x7f9be813e5f0 2019-11-28T11:48:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.929+0000 7f9bed0c5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9be810a070 0x7f9be810bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.929+0000 7f9bed0c5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9be810a070 0x7f9be810bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41258/0 (socket says 172.21.15.80:41258) 2019-11-28T11:48:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.929+0000 7f9bed0c5700 1 -- 172.21.15.80:0/405538820 learned_addr learned my addr 172.21.15.80:0/405538820 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:32.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9bed8c6700 1 --2- 172.21.15.80:0/405538820 >> v2:172.21.15.174:3300/0 conn(0x7f9be813e5f0 0x7f9be813e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:32.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9bed0c5700 1 -- 172.21.15.80:0/405538820 >> v2:172.21.15.174:3300/0 conn(0x7f9be813e5f0 msgr2=0x7f9be813e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:32.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9bed0c5700 1 --2- 172.21.15.80:0/405538820 >> v2:172.21.15.174:3300/0 conn(0x7f9be813e5f0 0x7f9be813e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:32.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9bed0c5700 1 -- 172.21.15.80:0/405538820 >> v1:172.21.15.174:6789/0 conn(0x7f9be810a4e0 legacy=0x7f9be810c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:32.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9bed0c5700 1 -- 172.21.15.80:0/405538820 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be810e9c0 con 0x7f9be810a070 2019-11-28T11:48:32.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9bed0c5700 1 --2- 172.21.15.80:0/405538820 >> v2:172.21.15.80:3300/0 conn(0x7f9be810a070 0x7f9be810bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9bd00107c0 tx=0x7f9bd00105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9bed0c5700 1 --2- 172.21.15.80:0/405538820 >> v2:172.21.15.80:3300/0 conn(0x7f9be810a070 0x7f9be810bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9bd00107c0 tx=0x7f9bd00105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9bed0c5700 1 --2- 172.21.15.80:0/405538820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be810a070 0x7f9be810bdb0 secure :-1 s=READY pgs=1914 cs=0 l=1 rx=0x7f9bd00107c0 tx=0x7f9bd00105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:32.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9bed0c5700 1 --2- 172.21.15.80:0/405538820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be810a070 0x7f9be810bdb0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7f9bd00107c0 tx=0x7f9bd00105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9bed0c5700 1 --2- 172.21.15.80:0/405538820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be810a070 0x7f9be810bdb0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7f9bd00107c0 tx=0x7f9bd00105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9bed0c5700 1 --2- 172.21.15.80:0/405538820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be810a070 0x7f9be810bdb0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7f9bd00107c0 tx=0x7f9bd00105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9be67fc700 1 -- 172.21.15.80:0/405538820 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bd00010d0 con 0x7f9be810a070 2019-11-28T11:48:32.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9be67fc700 1 -- 172.21.15.80:0/405538820 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd0004360 con 0x7f9be810a070 2019-11-28T11:48:32.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9bef329700 1 -- 172.21.15.80:0/405538820 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be810ed40 con 0x7f9be810a070 2019-11-28T11:48:32.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9be67fc700 1 -- 172.21.15.80:0/405538820 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bd00049f0 con 0x7f9be810a070 2019-11-28T11:48:32.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9bef329700 1 -- 172.21.15.80:0/405538820 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be810e9c0 con 0x7f9be810a070 2019-11-28T11:48:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.930+0000 7f9bed0c5700 1 --2- 172.21.15.80:0/405538820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be810a070 0x7f9be810bdb0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7f9bd00107c0 tx=0x7f9bd00105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.931+0000 7f9be67fc700 1 -- 172.21.15.80:0/405538820 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9bd00010b0 con 0x7f9be810a070 2019-11-28T11:48:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.931+0000 7f9bed0c5700 1 --2- 172.21.15.80:0/405538820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be810a070 0x7f9be810bdb0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7f9bd00107c0 tx=0x7f9bd00105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.931+0000 7f9be67fc700 1 --2- 172.21.15.80:0/405538820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9bcc018730 0x7f9bcc01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.931+0000 7f9be67fc700 1 -- 172.21.15.80:0/405538820 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5329+0+0 (secure 0 0 0) 0x7f9bd0031f00 con 0x7f9be810a070 2019-11-28T11:48:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.931+0000 7f9bed8c6700 1 --2- 172.21.15.80:0/405538820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9bcc018730 0x7f9bcc01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.931+0000 7f9bed8c6700 1 --2- 172.21.15.80:0/405538820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9bcc018730 0x7f9bcc01abe0 crc :-1 s=READY pgs=774 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:32.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.939+0000 7f9bef329700 1 -- 172.21.15.80:0/405538820 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be810ed40 con 0x7f9be810a070 2019-11-28T11:48:32.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.942+0000 7f9bed0c5700 1 --2- 172.21.15.80:0/405538820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be810a070 0x7f9be810bdb0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7f9bd00107c0 tx=0x7f9bd00105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:32.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:32.942+0000 7f9be67fc700 1 -- 172.21.15.80:0/405538820 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9bd0000cc0 con 0x7f9be810a070 2019-11-28T11:48:33.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.129+0000 7f9bef329700 1 -- 172.21.15.80:0/405538820 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f9be810e9c0 con 0x7f9be810a070 2019-11-28T11:48:33.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.759+0000 7f9bed0c5700 1 --2- 172.21.15.80:0/405538820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be810a070 0x7f9be810bdb0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7f9bd00107c0 tx=0x7f9bd00105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:33.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.759+0000 7f9be67fc700 1 -- 172.21.15.80:0/405538820 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v148) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9bd00010b0 con 0x7f9be810a070 2019-11-28T11:48:33.840 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:48:33.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.796+0000 7f9bef329700 1 -- 172.21.15.80:0/405538820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9bcc018730 msgr2=0x7f9bcc01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:33.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.796+0000 7f9bef329700 1 --2- 172.21.15.80:0/405538820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9bcc018730 0x7f9bcc01abe0 crc :-1 s=READY pgs=774 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:33.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.796+0000 7f9bef329700 1 -- 172.21.15.80:0/405538820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be810a070 msgr2=0x7f9be810bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:33.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.796+0000 7f9bef329700 1 --2- 172.21.15.80:0/405538820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be810a070 0x7f9be810bdb0 secure :-1 s=READY pgs=1914 cs=0 l=1 rx=0x7f9bd00107c0 tx=0x7f9bd00105f0).stop 2019-11-28T11:48:33.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.796+0000 7f9bef329700 1 -- 172.21.15.80:0/405538820 shutdown_connections 2019-11-28T11:48:33.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.796+0000 7f9bef329700 1 --2- 172.21.15.80:0/405538820 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9bcc018730 0x7f9bcc01abe0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:33.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.796+0000 7f9bef329700 1 --2- 172.21.15.80:0/405538820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9be810a070 0x7f9be810bdb0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:33.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.796+0000 7f9bef329700 1 --2- 172.21.15.80:0/405538820 >> v2:172.21.15.174:3300/0 conn(0x7f9be813e5f0 0x7f9be813e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:33.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.796+0000 7f9bef329700 1 -- 172.21.15.80:0/405538820 shutdown_connections 2019-11-28T11:48:33.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.796+0000 7f9bef329700 1 -- 172.21.15.80:0/405538820 wait complete. 2019-11-28T11:48:33.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.796+0000 7f9bef329700 1 -- 172.21.15.80:0/405538820 >> 172.21.15.80:0/405538820 conn(0x7f9be813d620 msgr2=0x7f9be813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:33.852 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:48:33.853 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:48:33.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.925+0000 7f20a50bb700 1 Processor -- start 2019-11-28T11:48:33.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.925+0000 7f20a50bb700 1 -- start start 2019-11-28T11:48:33.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.926+0000 7f20a50bb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20a006d120 0x7f20a0165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.926+0000 7f20a50bb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a006d5a0 con 0x7f20a006c0a0 2019-11-28T11:48:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.926+0000 7f20a50bb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a006db00 con 0x7f20a006c490 2019-11-28T11:48:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.926+0000 7f20a50bb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a006fd60 con 0x7f20a006d120 2019-11-28T11:48:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.926+0000 7f20a48ba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20a006d120 0x7f20a0165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.926+0000 7f209f59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f20a006c0a0 0x7f20a0072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40578/0 (socket says 172.21.15.80:40578) 2019-11-28T11:48:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.926+0000 7f209f59e700 1 -- 172.21.15.80:0/393180170 learned_addr learned my addr 172.21.15.80:0/393180170 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.926+0000 7f20a48ba700 1 -- 172.21.15.80:0/393180170 >> v1:172.21.15.174:6789/0 conn(0x7f20a006c490 legacy=0x7f20a006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:33.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.926+0000 7f20a48ba700 1 -- 172.21.15.80:0/393180170 >> v1:172.21.15.80:6789/0 conn(0x7f20a006c0a0 legacy=0x7f20a0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:33.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.926+0000 7f20a48ba700 1 -- 172.21.15.80:0/393180170 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a00706c0 con 0x7f20a006d120 2019-11-28T11:48:33.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.926+0000 7f209e59c700 1 -- 172.21.15.80:0/393180170 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195960497 0 0) 0x7f2090001150 con 0x7f20a006c0a0 2019-11-28T11:48:33.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.926+0000 7f20a48ba700 1 --2- 172.21.15.80:0/393180170 >> v2:172.21.15.80:3300/0 conn(0x7f20a006d120 0x7f20a0165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f209800b2d0 tx=0x7f209800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:33.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.927+0000 7f20a48ba700 1 --2- 172.21.15.80:0/393180170 >> v2:172.21.15.80:3300/0 conn(0x7f20a006d120 0x7f20a0165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f209800b2d0 tx=0x7f209800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:33.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.927+0000 7f20a48ba700 1 --2- 172.21.15.80:0/393180170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a006d120 0x7f20a0165d80 secure :-1 s=READY pgs=1916 cs=0 l=1 rx=0x7f209800b2d0 tx=0x7f209800bae0).ready entity=mon.0 client_cookie=1601873224a002ad server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:33.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.927+0000 7f20a48ba700 1 --2- 172.21.15.80:0/393180170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a006d120 0x7f20a0165d80 secure :-1 s=THROTTLE_DONE pgs=1916 cs=0 l=1 rx=0x7f209800b2d0 tx=0x7f209800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:33.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.927+0000 7f209e59c700 1 -- 172.21.15.80:0/393180170 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2098009f20 con 0x7f20a006d120 2019-11-28T11:48:33.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.927+0000 7f20a48ba700 1 --2- 172.21.15.80:0/393180170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a006d120 0x7f20a0165d80 secure :-1 s=THROTTLE_DONE pgs=1916 cs=0 l=1 rx=0x7f209800b2d0 tx=0x7f209800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:33.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.927+0000 7f20a48ba700 1 --2- 172.21.15.80:0/393180170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a006d120 0x7f20a0165d80 secure :-1 s=THROTTLE_DONE pgs=1916 cs=0 l=1 rx=0x7f209800b2d0 tx=0x7f209800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:33.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.927+0000 7f209e59c700 1 -- 172.21.15.80:0/393180170 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2098000df0 con 0x7f20a006d120 2019-11-28T11:48:33.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.927+0000 7f209e59c700 1 -- 172.21.15.80:0/393180170 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f209800a500 con 0x7f20a006d120 2019-11-28T11:48:33.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.927+0000 7f20a50bb700 1 -- 172.21.15.80:0/393180170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a006d120 msgr2=0x7f20a0165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:33.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.927+0000 7f20a50bb700 1 --2- 172.21.15.80:0/393180170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a006d120 0x7f20a0165d80 secure :-1 s=READY pgs=1916 cs=0 l=1 rx=0x7f209800b2d0 tx=0x7f209800bae0).stop 2019-11-28T11:48:33.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.927+0000 7f20a50bb700 1 -- 172.21.15.80:0/393180170 shutdown_connections 2019-11-28T11:48:33.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.927+0000 7f20a50bb700 1 --2- 172.21.15.80:0/393180170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20a006d120 0x7f20a0165d80 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:33.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.927+0000 7f20a50bb700 1 -- 172.21.15.80:0/393180170 shutdown_connections 2019-11-28T11:48:33.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.927+0000 7f20a50bb700 1 -- 172.21.15.80:0/393180170 wait complete. 2019-11-28T11:48:33.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.927+0000 7f20a50bb700 1 -- 172.21.15.80:0/393180170 >> 172.21.15.80:0/393180170 conn(0x7f20a0061cf0 msgr2=0x7f20a0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:33.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.930+0000 7f20a50bb700 1 Processor -- start 2019-11-28T11:48:33.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.930+0000 7f20a50bb700 1 -- start start 2019-11-28T11:48:33.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.931+0000 7f20a50bb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a01ac2e0 0x7f20a01ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:33.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.931+0000 7f20a50bb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a007be00 con 0x7f20a0142d00 2019-11-28T11:48:33.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.931+0000 7f20a50bb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a0125780 con 0x7f20a007b970 2019-11-28T11:48:33.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.931+0000 7f20a50bb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a013b3b0 con 0x7f20a01ac2e0 2019-11-28T11:48:33.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.931+0000 7f209f59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f20a0142d00 0x7f20a013e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40584/0 (socket says 172.21.15.80:40584) 2019-11-28T11:48:33.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.931+0000 7f209f59e700 1 -- 172.21.15.80:0/2648062169 learned_addr learned my addr 172.21.15.80:0/2648062169 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:33.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.931+0000 7f20a48ba700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a01ac2e0 0x7f20a01ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:33.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.931+0000 7f2097fff700 1 -- 172.21.15.80:0/2648062169 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334868800 0 0) 0x7f2090001150 con 0x7f20a0142d00 2019-11-28T11:48:33.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.931+0000 7f2097fff700 1 -- 172.21.15.80:0/2648062169 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f207c002e80 con 0x7f20a0142d00 2019-11-28T11:48:33.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.931+0000 7f2097fff700 1 -- 172.21.15.80:0/2648062169 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046992807 0 0) 0x7f208c001080 con 0x7f20a007b970 2019-11-28T11:48:33.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.931+0000 7f2097fff700 1 -- 172.21.15.80:0/2648062169 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f207c0030b0 con 0x7f20a007b970 2019-11-28T11:48:33.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.931+0000 7f2097fff700 1 -- 172.21.15.80:0/2648062169 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2894203938 0 0) 0x7f2090001300 con 0x7f20a0142d00 2019-11-28T11:48:33.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.931+0000 7f20a48ba700 1 -- 172.21.15.80:0/2648062169 >> v1:172.21.15.174:6789/0 conn(0x7f20a007b970 legacy=0x7f20a013ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:33.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.931+0000 7f20a48ba700 1 -- 172.21.15.80:0/2648062169 >> v1:172.21.15.80:6789/0 conn(0x7f20a0142d00 legacy=0x7f20a013e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:33.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.931+0000 7f20a48ba700 1 -- 172.21.15.80:0/2648062169 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a00790b0 con 0x7f20a01ac2e0 2019-11-28T11:48:33.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.931+0000 7f20a48ba700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a01ac2e0 0x7f20a01ae6e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20980106f0 tx=0x7f2098010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:33.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.932+0000 7f20a48ba700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a01ac2e0 0x7f20a01ae6e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20980106f0 tx=0x7f2098010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:33.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.932+0000 7f20a48ba700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a01ac2e0 0x7f20a01ae6e0 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f20980106f0 tx=0x7f2098010a90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:33.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.932+0000 7f20a48ba700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a01ac2e0 0x7f20a01ae6e0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f20980106f0 tx=0x7f2098010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:33.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.932+0000 7f2097fff700 1 -- 172.21.15.80:0/2648062169 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f209800b2d0 con 0x7f20a01ac2e0 2019-11-28T11:48:33.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.932+0000 7f20a48ba700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a01ac2e0 0x7f20a01ae6e0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f20980106f0 tx=0x7f2098010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:33.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.932+0000 7f20a50bb700 1 -- 172.21.15.80:0/2648062169 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a0079430 con 0x7f20a01ac2e0 2019-11-28T11:48:33.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.932+0000 7f2097fff700 1 -- 172.21.15.80:0/2648062169 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209800af30 con 0x7f20a01ac2e0 2019-11-28T11:48:33.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.932+0000 7f20a48ba700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a01ac2e0 0x7f20a01ae6e0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f20980106f0 tx=0x7f2098010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:33.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.932+0000 7f2097fff700 1 -- 172.21.15.80:0/2648062169 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2098009ef0 con 0x7f20a01ac2e0 2019-11-28T11:48:33.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.932+0000 7f20a50bb700 1 -- 172.21.15.80:0/2648062169 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a00790b0 con 0x7f20a01ac2e0 2019-11-28T11:48:33.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.932+0000 7f20a48ba700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a01ac2e0 0x7f20a01ae6e0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f20980106f0 tx=0x7f2098010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:33.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.933+0000 7f2097fff700 1 -- 172.21.15.80:0/2648062169 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f209800a400 con 0x7f20a01ac2e0 2019-11-28T11:48:33.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.933+0000 7f20a48ba700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a01ac2e0 0x7f20a01ae6e0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f20980106f0 tx=0x7f2098010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:33.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.933+0000 7f2097fff700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f207c018750 0x7f207c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:33.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.933+0000 7f2097fff700 1 -- 172.21.15.80:0/2648062169 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f2098031e50 con 0x7f20a01ac2e0 2019-11-28T11:48:33.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.933+0000 7f209f59e700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f207c018750 0x7f207c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:33.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.933+0000 7f209f59e700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f207c018750 0x7f207c01abe0 crc :-1 s=READY pgs=775 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:33.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.940+0000 7f20a50bb700 1 -- 172.21.15.80:0/2648062169 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a0079430 con 0x7f20a01ac2e0 2019-11-28T11:48:33.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.944+0000 7f20a48ba700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a01ac2e0 0x7f20a01ae6e0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f20980106f0 tx=0x7f2098010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:33.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:33.944+0000 7f2097fff700 1 -- 172.21.15.80:0/2648062169 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2098017760 con 0x7f20a01ac2e0 2019-11-28T11:48:34.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.115+0000 7f20a50bb700 1 -- 172.21.15.80:0/2648062169 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f20a00790b0 con 0x7f20a01ac2e0 2019-11-28T11:48:34.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.115+0000 7f20a48ba700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a01ac2e0 0x7f20a01ae6e0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f20980106f0 tx=0x7f2098010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.116+0000 7f2097fff700 1 -- 172.21.15.80:0/2648062169 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v51) v1 ==== 80+0+4797 (secure 0 0 0) 0x7f2098017970 con 0x7f20a01ac2e0 2019-11-28T11:48:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:34.162 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:48:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:48:34.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:48:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:48:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:48:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:48:34.163 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:48:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:48:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.164 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:48:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:48:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:48:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:48:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:48:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:48:34.165 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.166 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:48:34.166 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:48:34.166 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.166 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:48:34.166 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:48:34.167 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:48:34.167 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:48:34.167 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.167 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:48:34.167 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:48:34.168 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.168 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:48:34.168 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:48:34.168 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:48:34.168 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.168 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:48:34.169 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:48:34.169 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.169 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:48:34.169 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:48:34.169 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:48:34.169 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.170 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:48:34.170 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:48:34.170 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.170 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:48:34.170 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:48:34.170 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:48:34.171 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.171 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:48:34.172 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:48:34.172 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.172 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:48:34.172 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:48:34.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:48:34.172 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.173 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:48:34.173 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:48:34.173 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.173 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:48:34.173 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:48:34.174 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:48:34.174 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.174 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:48:34.174 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:48:34.174 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.175 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:48:34.175 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:48:34.175 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:48:34.175 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.176 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:48:34.176 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:48:34.176 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.176 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:48:34.176 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:48:34.177 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:48:34.177 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.177 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:48:34.177 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:48:34.178 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.178 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:48:34.178 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:48:34.178 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:48:34.178 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.179 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:48:34.179 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:48:34.179 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.179 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:48:34.179 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:48:34.179 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:48:34.179 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:48:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:48:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:48:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:48:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:48:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:48:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:48:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:48:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:48:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:48:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.183 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:48:34.183 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:48:34.183 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.183 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:48:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:48:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:48:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:48:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:48:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:48:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:48:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:48:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:48:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:48:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:48:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:48:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:48:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:48:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:48:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:48:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:48:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:48:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:48:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:48:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:48:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:48:34.190 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:48:34.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.118+0000 7f20a50bb700 1 -- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f207c018750 msgr2=0x7f207c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.118+0000 7f20a50bb700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f207c018750 0x7f207c01abe0 crc :-1 s=READY pgs=775 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.118+0000 7f20a50bb700 1 -- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a01ac2e0 msgr2=0x7f20a01ae6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.118+0000 7f20a50bb700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a01ac2e0 0x7f20a01ae6e0 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f20980106f0 tx=0x7f2098010a90).stop 2019-11-28T11:48:34.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.118+0000 7f20a50bb700 1 -- 172.21.15.80:0/2648062169 shutdown_connections 2019-11-28T11:48:34.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.118+0000 7f20a50bb700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f20a01ac2e0 0x7f20a01ae6e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.118+0000 7f20a50bb700 1 --2- 172.21.15.80:0/2648062169 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f207c018750 0x7f207c01abe0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.118+0000 7f20a50bb700 1 -- 172.21.15.80:0/2648062169 shutdown_connections 2019-11-28T11:48:34.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.118+0000 7f20a50bb700 1 -- 172.21.15.80:0/2648062169 wait complete. 2019-11-28T11:48:34.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.118+0000 7f20a50bb700 1 -- 172.21.15.80:0/2648062169 >> 172.21.15.80:0/2648062169 conn(0x7f20a007c680 msgr2=0x7f20a0112150 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:34.194 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:48:34.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.267+0000 7f60347d0700 1 Processor -- start 2019-11-28T11:48:34.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.267+0000 7f60347d0700 1 -- start start 2019-11-28T11:48:34.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.268+0000 7f60347d0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f602c06d120 0x7f602c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:34.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.268+0000 7f60347d0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602c06d5a0 con 0x7f602c06c490 2019-11-28T11:48:34.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.268+0000 7f60347d0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602c06db00 con 0x7f602c06c0a0 2019-11-28T11:48:34.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.268+0000 7f60347d0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602c06fd60 con 0x7f602c06d120 2019-11-28T11:48:34.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.268+0000 7f603356e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f602c06d120 0x7f602c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.268+0000 7f603356e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f602c06d120 0x7f602c165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41278/0 (socket says 172.21.15.80:41278) 2019-11-28T11:48:34.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.268+0000 7f603356e700 1 -- 172.21.15.80:0/464768845 learned_addr learned my addr 172.21.15.80:0/464768845 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:34.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.268+0000 7f603356e700 1 -- 172.21.15.80:0/464768845 >> v1:172.21.15.174:6789/0 conn(0x7f602c06c0a0 legacy=0x7f602c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.268+0000 7f603356e700 1 -- 172.21.15.80:0/464768845 >> v1:172.21.15.80:6789/0 conn(0x7f602c06c490 legacy=0x7f602c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.268+0000 7f603356e700 1 -- 172.21.15.80:0/464768845 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c0706c0 con 0x7f602c06d120 2019-11-28T11:48:34.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.268+0000 7f6031d6b700 1 -- 172.21.15.80:0/464768845 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181298498 0 0) 0x7f601c001100 con 0x7f602c06c490 2019-11-28T11:48:34.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.269+0000 7f603356e700 1 --2- 172.21.15.80:0/464768845 >> v2:172.21.15.80:3300/0 conn(0x7f602c06d120 0x7f602c165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f601400f730 tx=0x7f601400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.269+0000 7f603356e700 1 --2- 172.21.15.80:0/464768845 >> v2:172.21.15.80:3300/0 conn(0x7f602c06d120 0x7f602c165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f601400f730 tx=0x7f601400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.269+0000 7f603356e700 1 --2- 172.21.15.80:0/464768845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c06d120 0x7f602c165d80 secure :-1 s=READY pgs=1919 cs=0 l=1 rx=0x7f601400f730 tx=0x7f601400fad0).ready entity=mon.0 client_cookie=61a5331642e6b2c3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:34.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.269+0000 7f603356e700 1 --2- 172.21.15.80:0/464768845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c06d120 0x7f602c165d80 secure :-1 s=THROTTLE_DONE pgs=1919 cs=0 l=1 rx=0x7f601400f730 tx=0x7f601400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.269+0000 7f6031d6b700 1 -- 172.21.15.80:0/464768845 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6014000a70 con 0x7f602c06d120 2019-11-28T11:48:34.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.269+0000 7f603356e700 1 --2- 172.21.15.80:0/464768845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c06d120 0x7f602c165d80 secure :-1 s=THROTTLE_DONE pgs=1919 cs=0 l=1 rx=0x7f601400f730 tx=0x7f601400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.269+0000 7f6031d6b700 1 -- 172.21.15.80:0/464768845 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60140010e0 con 0x7f602c06d120 2019-11-28T11:48:34.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.269+0000 7f603356e700 1 --2- 172.21.15.80:0/464768845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c06d120 0x7f602c165d80 secure :-1 s=THROTTLE_DONE pgs=1919 cs=0 l=1 rx=0x7f601400f730 tx=0x7f601400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.269+0000 7f6031d6b700 1 -- 172.21.15.80:0/464768845 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60140012d0 con 0x7f602c06d120 2019-11-28T11:48:34.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.269+0000 7f60347d0700 1 -- 172.21.15.80:0/464768845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c06d120 msgr2=0x7f602c165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.269+0000 7f60347d0700 1 --2- 172.21.15.80:0/464768845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c06d120 0x7f602c165d80 secure :-1 s=READY pgs=1919 cs=0 l=1 rx=0x7f601400f730 tx=0x7f601400fad0).stop 2019-11-28T11:48:34.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.270+0000 7f60347d0700 1 -- 172.21.15.80:0/464768845 shutdown_connections 2019-11-28T11:48:34.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.270+0000 7f60347d0700 1 --2- 172.21.15.80:0/464768845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c06d120 0x7f602c165d80 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.270+0000 7f60347d0700 1 -- 172.21.15.80:0/464768845 shutdown_connections 2019-11-28T11:48:34.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.270+0000 7f60347d0700 1 -- 172.21.15.80:0/464768845 wait complete. 2019-11-28T11:48:34.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.270+0000 7f60347d0700 1 -- 172.21.15.80:0/464768845 >> 172.21.15.80:0/464768845 conn(0x7f602c061cf0 msgr2=0x7f602c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:34.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.272+0000 7f60347d0700 1 Processor -- start 2019-11-28T11:48:34.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.272+0000 7f60347d0700 1 -- start start 2019-11-28T11:48:34.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f60347d0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f602c142d00 0x7f602c07b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:34.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f60347d0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f602c12dca0 0x7f602c12e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:34.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f60347d0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602c125780 con 0x7f602c13e280 2019-11-28T11:48:34.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f60347d0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602c13b3b0 con 0x7f602c12dca0 2019-11-28T11:48:34.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f60347d0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602c111140 con 0x7f602c142d00 2019-11-28T11:48:34.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f603256c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f602c13e280 0x7f602c13e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40598/0 (socket says 172.21.15.80:40598) 2019-11-28T11:48:34.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f603256c700 1 -- 172.21.15.80:0/775730837 learned_addr learned my addr 172.21.15.80:0/775730837 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:34.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f603356e700 1 --2- 172.21.15.80:0/775730837 >> v2:172.21.15.80:3300/0 conn(0x7f602c12dca0 0x7f602c12e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f6032d6d700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f602c142d00 0x7f602c07b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f603356e700 1 -- 172.21.15.80:0/775730837 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f602c142d00 msgr2=0x7f602c07b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f603356e700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f602c142d00 0x7f602c07b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f603356e700 1 -- 172.21.15.80:0/775730837 >> v1:172.21.15.80:6789/0 conn(0x7f602c13e280 legacy=0x7f602c13e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f603356e700 1 -- 172.21.15.80:0/775730837 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c0790b0 con 0x7f602c12dca0 2019-11-28T11:48:34.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f602b7fe700 1 -- 172.21.15.80:0/775730837 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059571847 0 0) 0x7f601c000f40 con 0x7f602c13e280 2019-11-28T11:48:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f6032d6d700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f602c142d00 0x7f602c07b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:48:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f603356e700 1 --2- 172.21.15.80:0/775730837 >> v2:172.21.15.80:3300/0 conn(0x7f602c12dca0 0x7f602c12e140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6014010350 tx=0x7f60140106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f603356e700 1 --2- 172.21.15.80:0/775730837 >> v2:172.21.15.80:3300/0 conn(0x7f602c12dca0 0x7f602c12e140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6014010350 tx=0x7f60140106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.273+0000 7f603356e700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c12dca0 0x7f602c12e140 secure :-1 s=READY pgs=1921 cs=0 l=1 rx=0x7f6014010350 tx=0x7f60140106f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:34.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.274+0000 7f603356e700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c12dca0 0x7f602c12e140 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7f6014010350 tx=0x7f60140106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.274+0000 7f602b7fe700 1 -- 172.21.15.80:0/775730837 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60140014a0 con 0x7f602c12dca0 2019-11-28T11:48:34.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.274+0000 7f603356e700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c12dca0 0x7f602c12e140 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7f6014010350 tx=0x7f60140106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.274+0000 7f603356e700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c12dca0 0x7f602c12e140 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7f6014010350 tx=0x7f60140106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.274+0000 7f602b7fe700 1 -- 172.21.15.80:0/775730837 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60140010c0 con 0x7f602c12dca0 2019-11-28T11:48:34.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.274+0000 7f60347d0700 1 -- 172.21.15.80:0/775730837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602c079430 con 0x7f602c12dca0 2019-11-28T11:48:34.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.274+0000 7f602b7fe700 1 -- 172.21.15.80:0/775730837 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6014001a80 con 0x7f602c12dca0 2019-11-28T11:48:34.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.274+0000 7f60347d0700 1 -- 172.21.15.80:0/775730837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602c0790b0 con 0x7f602c12dca0 2019-11-28T11:48:34.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.274+0000 7f603356e700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c12dca0 0x7f602c12e140 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7f6014010350 tx=0x7f60140106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.274+0000 7f602b7fe700 1 -- 172.21.15.80:0/775730837 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f60140012b0 con 0x7f602c12dca0 2019-11-28T11:48:34.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.274+0000 7f603356e700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c12dca0 0x7f602c12e140 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7f6014010350 tx=0x7f60140106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.274+0000 7f602b7fe700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6010018730 0x7f601001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:34.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.274+0000 7f602b7fe700 1 -- 172.21.15.80:0/775730837 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f6014031a00 con 0x7f602c12dca0 2019-11-28T11:48:34.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.275+0000 7f6032d6d700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6010018730 0x7f601001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.275+0000 7f6032d6d700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6010018730 0x7f601001abc0 crc :-1 s=READY pgs=776 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.282+0000 7f60347d0700 1 -- 172.21.15.80:0/775730837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602c079430 con 0x7f602c12dca0 2019-11-28T11:48:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.286+0000 7f603356e700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c12dca0 0x7f602c12e140 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7f6014010350 tx=0x7f60140106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.286+0000 7f602b7fe700 1 -- 172.21.15.80:0/775730837 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6014000eb0 con 0x7f602c12dca0 2019-11-28T11:48:34.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.465+0000 7f60347d0700 1 -- 172.21.15.80:0/775730837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f602c0790b0 con 0x7f602c12dca0 2019-11-28T11:48:34.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.466+0000 7f603356e700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c12dca0 0x7f602c12e140 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7f6014010350 tx=0x7f60140106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.466+0000 7f602b7fe700 1 -- 172.21.15.80:0/775730837 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+12010 (secure 0 0 0) 0x7f6014000eb0 con 0x7f602c12dca0 2019-11-28T11:48:34.513 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:34.513 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":148,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:48:33.755448+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:48:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.468+0000 7f60347d0700 1 -- 172.21.15.80:0/775730837 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6010018730 msgr2=0x7f601001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.468+0000 7f60347d0700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6010018730 0x7f601001abc0 crc :-1 s=READY pgs=776 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.468+0000 7f60347d0700 1 -- 172.21.15.80:0/775730837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c12dca0 msgr2=0x7f602c12e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.468+0000 7f60347d0700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c12dca0 0x7f602c12e140 secure :-1 s=READY pgs=1921 cs=0 l=1 rx=0x7f6014010350 tx=0x7f60140106f0).stop 2019-11-28T11:48:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.468+0000 7f60347d0700 1 -- 172.21.15.80:0/775730837 shutdown_connections 2019-11-28T11:48:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.468+0000 7f60347d0700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6010018730 0x7f601001abc0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.468+0000 7f60347d0700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f602c12dca0 0x7f602c12e140 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.468+0000 7f60347d0700 1 --2- 172.21.15.80:0/775730837 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f602c142d00 0x7f602c07b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.468+0000 7f60347d0700 1 -- 172.21.15.80:0/775730837 shutdown_connections 2019-11-28T11:48:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.468+0000 7f60347d0700 1 -- 172.21.15.80:0/775730837 wait complete. 2019-11-28T11:48:34.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.468+0000 7f60347d0700 1 -- 172.21.15.80:0/775730837 >> 172.21.15.80:0/775730837 conn(0x7f602c07c680 msgr2=0x7f602c112150 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:34.525 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:48:34.525 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:48:34.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.602+0000 7fc1eb5ec700 1 Processor -- start 2019-11-28T11:48:34.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.603+0000 7fc1eb5ec700 1 -- start start 2019-11-28T11:48:34.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.603+0000 7fc1eb5ec700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc1e415ed10 0x7fc1e415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:34.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1eb5ec700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e406db60 con 0x7fc1e4073020 2019-11-28T11:48:34.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1eb5ec700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e406e060 con 0x7fc1e40734b0 2019-11-28T11:48:34.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1eb5ec700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e406fe00 con 0x7fc1e415ed10 2019-11-28T11:48:34.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e9388700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc1e4073020 0x7fc1e4071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40610/0 (socket says 172.21.15.80:40610) 2019-11-28T11:48:34.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e9388700 1 -- 172.21.15.80:0/3240390273 learned_addr learned my addr 172.21.15.80:0/3240390273 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:34.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e9b89700 1 --2- 172.21.15.80:0/3240390273 >> v2:172.21.15.174:3300/0 conn(0x7fc1e415ed10 0x7fc1e415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e8b87700 1 -- 172.21.15.80:0/3240390273 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497830117 0 0) 0x7fc1cc0013f0 con 0x7fc1e4073020 2019-11-28T11:48:34.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e8b87700 1 -- 172.21.15.80:0/3240390273 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d0002e80 con 0x7fc1e4073020 2019-11-28T11:48:34.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e8b87700 1 -- 172.21.15.80:0/3240390273 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3829670533 0 0) 0x7fc1cc0013d0 con 0x7fc1e4073020 2019-11-28T11:48:34.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e8b87700 1 -- 172.21.15.80:0/3240390273 >> v2:172.21.15.174:3300/0 conn(0x7fc1e415ed10 msgr2=0x7fc1e415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:34.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e8b87700 1 --2- 172.21.15.80:0/3240390273 >> v2:172.21.15.174:3300/0 conn(0x7fc1e415ed10 0x7fc1e415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:34.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e8b87700 1 -- 172.21.15.80:0/3240390273 >> v1:172.21.15.174:6789/0 conn(0x7fc1e40734b0 legacy=0x7fc1e40726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e8b87700 1 -- 172.21.15.80:0/3240390273 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e4070760 con 0x7fc1e4073020 2019-11-28T11:48:34.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e8b87700 1 -- 172.21.15.80:0/3240390273 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc1cc001900 con 0x7fc1e4073020 2019-11-28T11:48:34.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e8b87700 1 -- 172.21.15.80:0/3240390273 >> v1:172.21.15.80:6789/0 conn(0x7fc1e4073020 legacy=0x7fc1e4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e8b87700 1 --2- 172.21.15.80:0/3240390273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1d0003ab0 0x7fc1d0005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:34.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e8b87700 1 --2- 172.21.15.80:0/3240390273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1d0006690 0x7fc1d0008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:34.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e8b87700 1 --2- 172.21.15.80:0/3240390273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1d0009380 0x7fc1d000b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:34.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e8b87700 1 -- 172.21.15.80:0/3240390273 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d000c000 con 0x7fc1d0006690 2019-11-28T11:48:34.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e8b87700 1 -- 172.21.15.80:0/3240390273 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0050200 con 0x7fc1d0003ab0 2019-11-28T11:48:34.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e8b87700 1 -- 172.21.15.80:0/3240390273 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0050430 con 0x7fc1d0009380 2019-11-28T11:48:34.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.604+0000 7fc1e9388700 1 --2- 172.21.15.80:0/3240390273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1d0006690 0x7fc1d0008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1e9b89700 1 --2- 172.21.15.80:0/3240390273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1d0003ab0 0x7fc1d0005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1ea38a700 1 --2- 172.21.15.80:0/3240390273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1d0009380 0x7fc1d000b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1e9388700 1 -- 172.21.15.80:0/3240390273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1d0009380 msgr2=0x7fc1d000b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:34.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1e9388700 1 --2- 172.21.15.80:0/3240390273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1d0009380 0x7fc1d000b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:34.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1e9388700 1 -- 172.21.15.80:0/3240390273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1d0003ab0 msgr2=0x7fc1d0005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:34.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1e9388700 1 --2- 172.21.15.80:0/3240390273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1d0003ab0 0x7fc1d0005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:34.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1e9388700 1 -- 172.21.15.80:0/3240390273 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d00506e0 con 0x7fc1d0006690 2019-11-28T11:48:34.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1ea38a700 1 -- 172.21.15.80:0/3240390273 reap_dead start 2019-11-28T11:48:34.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1e9388700 1 --2- 172.21.15.80:0/3240390273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1d0006690 0x7fc1d0008b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc1cc00fc90 tx=0x7fc1cc00fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1e9388700 1 --2- 172.21.15.80:0/3240390273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1d0006690 0x7fc1d0008b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc1cc00fc90 tx=0x7fc1cc00fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1e9388700 1 --2- 172.21.15.80:0/3240390273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1d0006690 0x7fc1d0008b20 secure :-1 s=READY pgs=1923 cs=0 l=1 rx=0x7fc1cc00fc90 tx=0x7fc1cc00fb10).ready entity=mon.0 client_cookie=dc7eed3db01ac096 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:34.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1e9388700 1 --2- 172.21.15.80:0/3240390273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1d0006690 0x7fc1d0008b20 secure :-1 s=THROTTLE_DONE pgs=1923 cs=0 l=1 rx=0x7fc1cc00fc90 tx=0x7fc1cc00fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1e8b87700 1 -- 172.21.15.80:0/3240390273 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1cc0013d0 con 0x7fc1d0006690 2019-11-28T11:48:34.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1e9388700 1 --2- 172.21.15.80:0/3240390273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1d0006690 0x7fc1d0008b20 secure :-1 s=THROTTLE_DONE pgs=1923 cs=0 l=1 rx=0x7fc1cc00fc90 tx=0x7fc1cc00fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1e9388700 1 --2- 172.21.15.80:0/3240390273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1d0006690 0x7fc1d0008b20 secure :-1 s=THROTTLE_DONE pgs=1923 cs=0 l=1 rx=0x7fc1cc00fc90 tx=0x7fc1cc00fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1e8b87700 1 -- 172.21.15.80:0/3240390273 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc004610 con 0x7fc1d0006690 2019-11-28T11:48:34.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1e8b87700 1 -- 172.21.15.80:0/3240390273 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1cc004ce0 con 0x7fc1d0006690 2019-11-28T11:48:34.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1eb5ec700 1 -- 172.21.15.80:0/3240390273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1d0006690 msgr2=0x7fc1d0008b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.605+0000 7fc1eb5ec700 1 --2- 172.21.15.80:0/3240390273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1d0006690 0x7fc1d0008b20 secure :-1 s=READY pgs=1923 cs=0 l=1 rx=0x7fc1cc00fc90 tx=0x7fc1cc00fb10).stop 2019-11-28T11:48:34.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.606+0000 7fc1eb5ec700 1 -- 172.21.15.80:0/3240390273 shutdown_connections 2019-11-28T11:48:34.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.606+0000 7fc1eb5ec700 1 --2- 172.21.15.80:0/3240390273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1d0006690 0x7fc1d0008b20 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.606+0000 7fc1eb5ec700 1 -- 172.21.15.80:0/3240390273 shutdown_connections 2019-11-28T11:48:34.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.606+0000 7fc1eb5ec700 1 -- 172.21.15.80:0/3240390273 wait complete. 2019-11-28T11:48:34.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.606+0000 7fc1eb5ec700 1 -- 172.21.15.80:0/3240390273 >> 172.21.15.80:0/3240390273 conn(0x7fc1e4061d20 msgr2=0x7fc1e40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:34.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.608+0000 7fc1eb5ec700 1 Processor -- start 2019-11-28T11:48:34.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.608+0000 7fc1eb5ec700 1 -- start start 2019-11-28T11:48:34.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.609+0000 7fc1eb5ec700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc1e41502e0 0x7fc1e4150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:34.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.609+0000 7fc1eb5ec700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e4133a20 con 0x7fc1e4150cb0 2019-11-28T11:48:34.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.609+0000 7fc1eb5ec700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e4109fc0 con 0x7fc1e4108630 2019-11-28T11:48:34.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.609+0000 7fc1eb5ec700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e4131980 con 0x7fc1e41502e0 2019-11-28T11:48:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.609+0000 7fc1ea38a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc1e4150cb0 0x7fc1e4167d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40620/0 (socket says 172.21.15.80:40620) 2019-11-28T11:48:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.609+0000 7fc1ea38a700 1 -- 172.21.15.80:0/1624799088 learned_addr learned my addr 172.21.15.80:0/1624799088 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.609+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422975624 0 0) 0x7fc1dc005560 con 0x7fc1e4150cb0 2019-11-28T11:48:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.609+0000 7fc1e9388700 1 --2- 172.21.15.80:0/1624799088 >> v2:172.21.15.174:3300/0 conn(0x7fc1e41502e0 0x7fc1e4150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.609+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1c8002e80 con 0x7fc1e4150cb0 2019-11-28T11:48:34.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2139528561 0 0) 0x7fc1dc005220 con 0x7fc1e4150cb0 2019-11-28T11:48:34.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc1c80032e0 con 0x7fc1e4150cb0 2019-11-28T11:48:34.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc1dc005d80 con 0x7fc1e4150cb0 2019-11-28T11:48:34.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 >> v2:172.21.15.174:3300/0 conn(0x7fc1e41502e0 msgr2=0x7fc1e4150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e27fc700 1 --2- 172.21.15.80:0/1624799088 >> v2:172.21.15.174:3300/0 conn(0x7fc1e41502e0 0x7fc1e4150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 >> v1:172.21.15.174:6789/0 conn(0x7fc1e4108630 legacy=0x7fc1e4151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 >> v1:172.21.15.80:6789/0 conn(0x7fc1e4150cb0 legacy=0x7fc1e4167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e27fc700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1c8003380 0x7fc1c80037b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:34.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e27fc700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c8003cf0 0x7fc1c8004170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:34.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e27fc700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1c8004930 0x7fc1c8004df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:34.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c800bbf0 con 0x7fc1c8003cf0 2019-11-28T11:48:34.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c800be20 con 0x7fc1c8003380 2019-11-28T11:48:34.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c800c050 con 0x7fc1c8004930 2019-11-28T11:48:34.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e9388700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c8003cf0 0x7fc1c8004170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1ea38a700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1c8004930 0x7fc1c8004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e9b89700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1c8003380 0x7fc1c80037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e9388700 1 -- 172.21.15.80:0/1624799088 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1c8004930 msgr2=0x7fc1c8004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e9388700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1c8004930 0x7fc1c8004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e9388700 1 -- 172.21.15.80:0/1624799088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1c8003380 msgr2=0x7fc1c80037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e9388700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1c8003380 0x7fc1c80037b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e9388700 1 -- 172.21.15.80:0/1624799088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c800c300 con 0x7fc1c8003cf0 2019-11-28T11:48:34.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1ea38a700 1 -- 172.21.15.80:0/1624799088 reap_dead start 2019-11-28T11:48:34.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1eb5ec700 1 -- 172.21.15.80:0/1624799088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e4132660 con 0x7fc1c8003cf0 2019-11-28T11:48:34.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e9388700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c8003cf0 0x7fc1c8004170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc1cc010970 tx=0x7fc1cc010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e9388700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c8003cf0 0x7fc1c8004170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc1cc010970 tx=0x7fc1cc010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e9388700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c8003cf0 0x7fc1c8004170 secure :-1 s=READY pgs=1925 cs=0 l=1 rx=0x7fc1cc010970 tx=0x7fc1cc010870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:34.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e9388700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c8003cf0 0x7fc1c8004170 secure :-1 s=THROTTLE_DONE pgs=1925 cs=0 l=1 rx=0x7fc1cc010970 tx=0x7fc1cc010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1cc001d50 con 0x7fc1c8003cf0 2019-11-28T11:48:34.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e9388700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c8003cf0 0x7fc1c8004170 secure :-1 s=THROTTLE_DONE pgs=1925 cs=0 l=1 rx=0x7fc1cc010970 tx=0x7fc1cc010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e9388700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c8003cf0 0x7fc1c8004170 secure :-1 s=THROTTLE_DONE pgs=1925 cs=0 l=1 rx=0x7fc1cc010970 tx=0x7fc1cc010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc001800 con 0x7fc1c8003cf0 2019-11-28T11:48:34.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1eb5ec700 1 -- 172.21.15.80:0/1624799088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e41322e0 con 0x7fc1c8003cf0 2019-11-28T11:48:34.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.610+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1cc004740 con 0x7fc1c8003cf0 2019-11-28T11:48:34.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.611+0000 7fc1e9388700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c8003cf0 0x7fc1c8004170 secure :-1 s=THROTTLE_DONE pgs=1925 cs=0 l=1 rx=0x7fc1cc010970 tx=0x7fc1cc010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.611+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc1cc004360 con 0x7fc1c8003cf0 2019-11-28T11:48:34.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.611+0000 7fc1e9388700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c8003cf0 0x7fc1c8004170 secure :-1 s=THROTTLE_DONE pgs=1925 cs=0 l=1 rx=0x7fc1cc010970 tx=0x7fc1cc010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.611+0000 7fc1e27fc700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc1c801d720 0x7fc1c801fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:34.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.611+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fc1cc031ea0 con 0x7fc1c8003cf0 2019-11-28T11:48:34.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.611+0000 7fc1e9b89700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc1c801d720 0x7fc1c801fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.612+0000 7fc1e9b89700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc1c801d720 0x7fc1c801fb50 crc :-1 s=READY pgs=777 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:34.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.618+0000 7fc1eb5ec700 1 -- 172.21.15.80:0/1624799088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e4132660 con 0x7fc1c8003cf0 2019-11-28T11:48:34.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.621+0000 7fc1e9388700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c8003cf0 0x7fc1c8004170 secure :-1 s=THROTTLE_DONE pgs=1925 cs=0 l=1 rx=0x7fc1cc010970 tx=0x7fc1cc010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.621+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc1cc001800 con 0x7fc1c8003cf0 2019-11-28T11:48:34.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.790+0000 7fc1eb5ec700 1 -- 172.21.15.80:0/1624799088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fc1e41322e0 con 0x7fc1c8003cf0 2019-11-28T11:48:34.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.790+0000 7fc1e9388700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c8003cf0 0x7fc1c8004170 secure :-1 s=THROTTLE_DONE pgs=1925 cs=0 l=1 rx=0x7fc1cc010970 tx=0x7fc1cc010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.790+0000 7fc1e27fc700 1 -- 172.21.15.80:0/1624799088 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v148) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc1cc004360 con 0x7fc1c8003cf0 2019-11-28T11:48:34.837 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:48:34.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.793+0000 7fc1eb5ec700 1 -- 172.21.15.80:0/1624799088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc1c801d720 msgr2=0x7fc1c801fb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.793+0000 7fc1eb5ec700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc1c801d720 0x7fc1c801fb50 crc :-1 s=READY pgs=777 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.793+0000 7fc1eb5ec700 1 -- 172.21.15.80:0/1624799088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c8003cf0 msgr2=0x7fc1c8004170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.793+0000 7fc1eb5ec700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c8003cf0 0x7fc1c8004170 secure :-1 s=READY pgs=1925 cs=0 l=1 rx=0x7fc1cc010970 tx=0x7fc1cc010870).stop 2019-11-28T11:48:34.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.793+0000 7fc1eb5ec700 1 -- 172.21.15.80:0/1624799088 shutdown_connections 2019-11-28T11:48:34.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.793+0000 7fc1eb5ec700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc1c801d720 0x7fc1c801fb50 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.793+0000 7fc1eb5ec700 1 --2- 172.21.15.80:0/1624799088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1c8003cf0 0x7fc1c8004170 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.793+0000 7fc1eb5ec700 1 -- 172.21.15.80:0/1624799088 shutdown_connections 2019-11-28T11:48:34.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.793+0000 7fc1eb5ec700 1 -- 172.21.15.80:0/1624799088 wait complete. 2019-11-28T11:48:34.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.793+0000 7fc1eb5ec700 1 -- 172.21.15.80:0/1624799088 >> 172.21.15.80:0/1624799088 conn(0x7fc1e414dbb0 msgr2=0x7fc1e4142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:34.852 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:48:34.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.926+0000 7fafa90e2700 1 Processor -- start 2019-11-28T11:48:34.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.926+0000 7fafa90e2700 1 -- start start 2019-11-28T11:48:34.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.927+0000 7fafa90e2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fafa406c0a0 0x7fafa4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:34.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.927+0000 7fafa90e2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fafa40734e0 0x7fafa4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:34.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.927+0000 7fafa90e2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa406db00 con 0x7fafa4072360 2019-11-28T11:48:34.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.927+0000 7fafa90e2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa406fd60 con 0x7fafa40734e0 2019-11-28T11:48:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.927+0000 7fafa90e2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa4070030 con 0x7fafa406c0a0 2019-11-28T11:48:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.927+0000 7fafa2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fafa40734e0 0x7fafa4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.927+0000 7fafa2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fafa40734e0 0x7fafa4071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41318/0 (socket says 172.21.15.80:41318) 2019-11-28T11:48:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.927+0000 7fafa2d9d700 1 -- 172.21.15.80:0/216266691 learned_addr learned my addr 172.21.15.80:0/216266691 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:34.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.927+0000 7fafa359e700 1 --2- 172.21.15.80:0/216266691 >> v2:172.21.15.174:3300/0 conn(0x7fafa406c0a0 0x7fafa4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.928+0000 7fafa2d9d700 1 -- 172.21.15.80:0/216266691 >> v2:172.21.15.174:3300/0 conn(0x7fafa406c0a0 msgr2=0x7fafa4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:34.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.928+0000 7fafa2d9d700 1 --2- 172.21.15.80:0/216266691 >> v2:172.21.15.174:3300/0 conn(0x7fafa406c0a0 0x7fafa4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:34.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.928+0000 7fafa2d9d700 1 -- 172.21.15.80:0/216266691 >> v1:172.21.15.174:6789/0 conn(0x7fafa4072360 legacy=0x7fafa406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.928+0000 7fafa2d9d700 1 -- 172.21.15.80:0/216266691 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa40706c0 con 0x7fafa40734e0 2019-11-28T11:48:34.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.928+0000 7fafa2d9d700 1 --2- 172.21.15.80:0/216266691 >> v2:172.21.15.80:3300/0 conn(0x7fafa40734e0 0x7fafa4071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faf8c00fa40 tx=0x7faf8c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.928+0000 7fafa2d9d700 1 --2- 172.21.15.80:0/216266691 >> v2:172.21.15.80:3300/0 conn(0x7fafa40734e0 0x7fafa4071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faf8c00fa40 tx=0x7faf8c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.928+0000 7fafa2d9d700 1 --2- 172.21.15.80:0/216266691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafa40734e0 0x7fafa4071e20 secure :-1 s=READY pgs=1926 cs=0 l=1 rx=0x7faf8c00fa40 tx=0x7faf8c00fde0).ready entity=mon.0 client_cookie=87be20e007ca7788 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.928+0000 7fafa2d9d700 1 --2- 172.21.15.80:0/216266691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafa40734e0 0x7fafa4071e20 secure :-1 s=THROTTLE_DONE pgs=1926 cs=0 l=1 rx=0x7faf8c00fa40 tx=0x7faf8c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.928+0000 7fafa2d9d700 1 --2- 172.21.15.80:0/216266691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafa40734e0 0x7fafa4071e20 secure :-1 s=THROTTLE_DONE pgs=1926 cs=0 l=1 rx=0x7faf8c00fa40 tx=0x7faf8c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.928+0000 7fafa259c700 1 -- 172.21.15.80:0/216266691 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf8c000ce0 con 0x7fafa40734e0 2019-11-28T11:48:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.928+0000 7fafa2d9d700 1 --2- 172.21.15.80:0/216266691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafa40734e0 0x7fafa4071e20 secure :-1 s=THROTTLE_DONE pgs=1926 cs=0 l=1 rx=0x7faf8c00fa40 tx=0x7faf8c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.928+0000 7fafa259c700 1 -- 172.21.15.80:0/216266691 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c001010 con 0x7fafa40734e0 2019-11-28T11:48:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.928+0000 7fafa259c700 1 -- 172.21.15.80:0/216266691 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf8c001720 con 0x7fafa40734e0 2019-11-28T11:48:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.928+0000 7fafa90e2700 1 -- 172.21.15.80:0/216266691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafa40734e0 msgr2=0x7fafa4071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.928+0000 7fafa90e2700 1 --2- 172.21.15.80:0/216266691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafa40734e0 0x7fafa4071e20 secure :-1 s=READY pgs=1926 cs=0 l=1 rx=0x7faf8c00fa40 tx=0x7faf8c00fde0).stop 2019-11-28T11:48:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.929+0000 7fafa90e2700 1 -- 172.21.15.80:0/216266691 shutdown_connections 2019-11-28T11:48:34.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.929+0000 7fafa90e2700 1 --2- 172.21.15.80:0/216266691 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafa40734e0 0x7fafa4071e20 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:34.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.929+0000 7fafa90e2700 1 --2- 172.21.15.80:0/216266691 >> v2:172.21.15.174:3300/0 conn(0x7fafa406c0a0 0x7fafa4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:34.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.929+0000 7fafa90e2700 1 -- 172.21.15.80:0/216266691 shutdown_connections 2019-11-28T11:48:34.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.929+0000 7fafa90e2700 1 -- 172.21.15.80:0/216266691 wait complete. 2019-11-28T11:48:34.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.929+0000 7fafa90e2700 1 -- 172.21.15.80:0/216266691 >> 172.21.15.80:0/216266691 conn(0x7fafa4061cf0 msgr2=0x7fafa4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:34.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.931+0000 7fafa90e2700 1 Processor -- start 2019-11-28T11:48:34.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.931+0000 7fafa90e2700 1 -- start start 2019-11-28T11:48:34.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.932+0000 7fafa90e2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fafa4167c30 0x7fafa416a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:34.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.932+0000 7fafa90e2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa413aba0 con 0x7fafa4114db0 2019-11-28T11:48:34.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.932+0000 7fafa90e2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa413b050 con 0x7fafa41239b0 2019-11-28T11:48:34.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.932+0000 7fafa90e2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa4112d10 con 0x7fafa4167c30 2019-11-28T11:48:34.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.932+0000 7fafa2d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fafa4114db0 0x7fafa4115240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40638/0 (socket says 172.21.15.80:40638) 2019-11-28T11:48:34.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.932+0000 7fafa2d9d700 1 -- 172.21.15.80:0/2624006088 learned_addr learned my addr 172.21.15.80:0/2624006088 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:34.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7fafa88e1700 1 --2- 172.21.15.80:0/2624006088 >> v2:172.21.15.174:3300/0 conn(0x7fafa4167c30 0x7fafa416a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7faf9bfff700 1 -- 172.21.15.80:0/2624006088 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015890780 0 0) 0x7faf8c007e90 con 0x7fafa4114db0 2019-11-28T11:48:34.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7faf9bfff700 1 -- 172.21.15.80:0/2624006088 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf7c002e80 con 0x7fafa4114db0 2019-11-28T11:48:34.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7faf9bfff700 1 -- 172.21.15.80:0/2624006088 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634246971 0 0) 0x7faf94000ef0 con 0x7fafa41239b0 2019-11-28T11:48:34.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7fafa88e1700 1 -- 172.21.15.80:0/2624006088 >> v1:172.21.15.174:6789/0 conn(0x7fafa41239b0 legacy=0x7fafa4116fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7fafa88e1700 1 -- 172.21.15.80:0/2624006088 >> v1:172.21.15.80:6789/0 conn(0x7fafa4114db0 legacy=0x7fafa4115240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:34.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7fafa88e1700 1 -- 172.21.15.80:0/2624006088 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4113670 con 0x7fafa4167c30 2019-11-28T11:48:34.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7fafa88e1700 1 --2- 172.21.15.80:0/2624006088 >> v2:172.21.15.174:3300/0 conn(0x7fafa4167c30 0x7fafa416a030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf9c0103b0 tx=0x7faf9c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7fafa88e1700 1 --2- 172.21.15.80:0/2624006088 >> v2:172.21.15.174:3300/0 conn(0x7fafa4167c30 0x7fafa416a030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf9c0103b0 tx=0x7faf9c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7fafa88e1700 1 --2- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa4167c30 0x7fafa416a030 secure :-1 s=READY pgs=1122 cs=0 l=1 rx=0x7faf9c0103b0 tx=0x7faf9c010750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:34.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7fafa88e1700 1 --2- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa4167c30 0x7fafa416a030 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7faf9c0103b0 tx=0x7faf9c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7faf9bfff700 1 -- 172.21.15.80:0/2624006088 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf9c000940 con 0x7fafa4167c30 2019-11-28T11:48:34.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7fafa88e1700 1 --2- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa4167c30 0x7fafa416a030 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7faf9c0103b0 tx=0x7faf9c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7faf9bfff700 1 -- 172.21.15.80:0/2624006088 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c009590 con 0x7fafa4167c30 2019-11-28T11:48:34.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7fafa88e1700 1 --2- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa4167c30 0x7fafa416a030 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7faf9c0103b0 tx=0x7faf9c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7fafa90e2700 1 -- 172.21.15.80:0/2624006088 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa41139f0 con 0x7fafa4167c30 2019-11-28T11:48:34.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7faf9bfff700 1 -- 172.21.15.80:0/2624006088 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf9c009b60 con 0x7fafa4167c30 2019-11-28T11:48:34.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.933+0000 7fafa90e2700 1 -- 172.21.15.80:0/2624006088 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa4113670 con 0x7fafa4167c30 2019-11-28T11:48:34.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.934+0000 7fafa88e1700 1 --2- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa4167c30 0x7fafa416a030 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7faf9c0103b0 tx=0x7faf9c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.934+0000 7faf9bfff700 1 -- 172.21.15.80:0/2624006088 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7faf9c009a50 con 0x7fafa4167c30 2019-11-28T11:48:34.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.934+0000 7fafa88e1700 1 --2- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa4167c30 0x7fafa416a030 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7faf9c0103b0 tx=0x7faf9c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.934+0000 7faf9bfff700 1 --2- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faf7c018780 0x7faf7c01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:34.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.934+0000 7faf9bfff700 1 -- 172.21.15.80:0/2624006088 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5200+0+0 (secure 0 0 0) 0x7faf9c031a90 con 0x7fafa4167c30 2019-11-28T11:48:34.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.934+0000 7fafa359e700 1 --2- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faf7c018780 0x7faf7c01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:34.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.935+0000 7fafa359e700 1 --2- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faf7c018780 0x7faf7c01abf0 crc :-1 s=READY pgs=778 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:34.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.942+0000 7fafa90e2700 1 -- 172.21.15.80:0/2624006088 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa41139f0 con 0x7fafa4167c30 2019-11-28T11:48:34.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.945+0000 7fafa88e1700 1 --2- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa4167c30 0x7fafa416a030 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7faf9c0103b0 tx=0x7faf9c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:34.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:34.945+0000 7faf9bfff700 1 -- 172.21.15.80:0/2624006088 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7faf9c009820 con 0x7fafa4167c30 2019-11-28T11:48:35.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.108+0000 7fafa90e2700 1 -- 172.21.15.80:0/2624006088 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fafa4113670 con 0x7fafa4167c30 2019-11-28T11:48:35.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.108+0000 7fafa88e1700 1 --2- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa4167c30 0x7fafa416a030 secure :-1 s=THROTTLE_DONE pgs=1122 cs=0 l=1 rx=0x7faf9c0103b0 tx=0x7faf9c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.108+0000 7faf9bfff700 1 -- 172.21.15.80:0/2624006088 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v148) v1 ==== 84+0+64 (secure 0 0 0) 0x7faf9c009a30 con 0x7fafa4167c30 2019-11-28T11:48:35.155 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:35.155 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:48:35.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:48:35.156 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:48:35.156 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:48:35.156 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:48:35.156 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:48:35.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.110+0000 7fafa90e2700 1 -- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faf7c018780 msgr2=0x7faf7c01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:35.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.110+0000 7fafa90e2700 1 --2- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faf7c018780 0x7faf7c01abf0 crc :-1 s=READY pgs=778 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:35.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.110+0000 7fafa90e2700 1 -- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa4167c30 msgr2=0x7fafa416a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:35.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.110+0000 7fafa90e2700 1 --2- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa4167c30 0x7fafa416a030 secure :-1 s=READY pgs=1122 cs=0 l=1 rx=0x7faf9c0103b0 tx=0x7faf9c010750).stop 2019-11-28T11:48:35.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.110+0000 7fafa90e2700 1 -- 172.21.15.80:0/2624006088 shutdown_connections 2019-11-28T11:48:35.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.110+0000 7fafa90e2700 1 --2- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa4167c30 0x7fafa416a030 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:35.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.110+0000 7fafa90e2700 1 --2- 172.21.15.80:0/2624006088 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faf7c018780 0x7faf7c01abf0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:35.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.111+0000 7fafa90e2700 1 -- 172.21.15.80:0/2624006088 shutdown_connections 2019-11-28T11:48:35.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.111+0000 7fafa90e2700 1 -- 172.21.15.80:0/2624006088 wait complete. 2019-11-28T11:48:35.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.111+0000 7fafa90e2700 1 -- 172.21.15.80:0/2624006088 >> 172.21.15.80:0/2624006088 conn(0x7fafa41427c0 msgr2=0x7fafa414fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:35.167 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:48:35.167 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:48:35.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.245+0000 7ff971b41700 1 Processor -- start 2019-11-28T11:48:35.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.245+0000 7ff971b41700 1 -- start start 2019-11-28T11:48:35.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff971b41700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff96c15ed10 0x7ff96c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:35.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff971b41700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c073020 0x7ff96c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:35.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff971b41700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c06db60 con 0x7ff96c0734b0 2019-11-28T11:48:35.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff971b41700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c06fe00 con 0x7ff96c15ed10 2019-11-28T11:48:35.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff971b41700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0700d0 con 0x7ff96c073020 2019-11-28T11:48:35.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff96bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff96c15ed10 0x7ff96c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:35.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff96bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff96c15ed10 0x7ff96c15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41328/0 (socket says 172.21.15.80:41328) 2019-11-28T11:48:35.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff96bfff700 1 -- 172.21.15.80:0/2797375334 learned_addr learned my addr 172.21.15.80:0/2797375334 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:35.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff96bfff700 1 -- 172.21.15.80:0/2797375334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c073020 msgr2=0x7ff96c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:35.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff963fff700 1 --2- 172.21.15.80:0/2797375334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c073020 0x7ff96c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:35.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff96bfff700 1 --2- 172.21.15.80:0/2797375334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c073020 0x7ff96c071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:35.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff96bfff700 1 -- 172.21.15.80:0/2797375334 >> v1:172.21.15.174:6789/0 conn(0x7ff96c0734b0 legacy=0x7ff96c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:35.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff96bfff700 1 -- 172.21.15.80:0/2797375334 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c070760 con 0x7ff96c15ed10 2019-11-28T11:48:35.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff96bfff700 1 --2- 172.21.15.80:0/2797375334 >> v2:172.21.15.80:3300/0 conn(0x7ff96c15ed10 0x7ff96c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff95c00f740 tx=0x7ff95c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff96bfff700 1 --2- 172.21.15.80:0/2797375334 >> v2:172.21.15.80:3300/0 conn(0x7ff96c15ed10 0x7ff96c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff95c00f740 tx=0x7ff95c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff96bfff700 1 --2- 172.21.15.80:0/2797375334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c15ed10 0x7ff96c15f100 secure :-1 s=READY pgs=1928 cs=0 l=1 rx=0x7ff95c00f740 tx=0x7ff95c00f570).ready entity=mon.0 client_cookie=f4df977f332bd6ac server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:35.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff96bfff700 1 --2- 172.21.15.80:0/2797375334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c15ed10 0x7ff96c15f100 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7ff95c00f740 tx=0x7ff95c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff96bfff700 1 --2- 172.21.15.80:0/2797375334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c15ed10 0x7ff96c15f100 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7ff95c00f740 tx=0x7ff95c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff96b7fe700 1 -- 172.21.15.80:0/2797375334 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff95c000960 con 0x7ff96c15ed10 2019-11-28T11:48:35.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff96bfff700 1 --2- 172.21.15.80:0/2797375334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c15ed10 0x7ff96c15f100 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7ff95c00f740 tx=0x7ff95c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff96b7fe700 1 -- 172.21.15.80:0/2797375334 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c000c90 con 0x7ff96c15ed10 2019-11-28T11:48:35.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.246+0000 7ff96b7fe700 1 -- 172.21.15.80:0/2797375334 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff95c0013a0 con 0x7ff96c15ed10 2019-11-28T11:48:35.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.247+0000 7ff971b41700 1 -- 172.21.15.80:0/2797375334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c15ed10 msgr2=0x7ff96c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:35.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.247+0000 7ff971b41700 1 --2- 172.21.15.80:0/2797375334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c15ed10 0x7ff96c15f100 secure :-1 s=READY pgs=1928 cs=0 l=1 rx=0x7ff95c00f740 tx=0x7ff95c00f570).stop 2019-11-28T11:48:35.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.247+0000 7ff971b41700 1 -- 172.21.15.80:0/2797375334 shutdown_connections 2019-11-28T11:48:35.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.247+0000 7ff971b41700 1 --2- 172.21.15.80:0/2797375334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c073020 0x7ff96c071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:35.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.247+0000 7ff971b41700 1 --2- 172.21.15.80:0/2797375334 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c15ed10 0x7ff96c15f100 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:35.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.247+0000 7ff971b41700 1 -- 172.21.15.80:0/2797375334 shutdown_connections 2019-11-28T11:48:35.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.247+0000 7ff971b41700 1 -- 172.21.15.80:0/2797375334 wait complete. 2019-11-28T11:48:35.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.247+0000 7ff971b41700 1 -- 172.21.15.80:0/2797375334 >> 172.21.15.80:0/2797375334 conn(0x7ff96c061d20 msgr2=0x7ff96c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:35.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.250+0000 7ff971b41700 1 Processor -- start 2019-11-28T11:48:35.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.250+0000 7ff971b41700 1 -- start start 2019-11-28T11:48:35.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.250+0000 7ff971b41700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c10e970 0x7ff96c1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:35.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.250+0000 7ff971b41700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff96c108cf0 0x7ff96c107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:35.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.250+0000 7ff971b41700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff96c107b70 0x7ff96c107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:35.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.250+0000 7ff971b41700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c10da00 con 0x7ff96c107b70 2019-11-28T11:48:35.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.250+0000 7ff971b41700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c10e430 con 0x7ff96c108cf0 2019-11-28T11:48:35.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.250+0000 7ff971b41700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c105ef0 con 0x7ff96c10e970 2019-11-28T11:48:35.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9708df700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff96c107b70 0x7ff96c107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:35.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9708df700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff96c107b70 0x7ff96c107ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41336/0 (socket says 172.21.15.80:41336) 2019-11-28T11:48:35.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9708df700 1 -- 172.21.15.80:0/2653967978 learned_addr learned my addr 172.21.15.80:0/2653967978 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:35.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9708df700 1 -- 172.21.15.80:0/2653967978 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c10e970 msgr2=0x7ff96c1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:35.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff963fff700 1 --2- 172.21.15.80:0/2653967978 >> v2:172.21.15.174:3300/0 conn(0x7ff96c108cf0 0x7ff96c107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:35.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9708df700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c10e970 0x7ff96c1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:35.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9708df700 1 -- 172.21.15.80:0/2653967978 >> v2:172.21.15.174:3300/0 conn(0x7ff96c108cf0 msgr2=0x7ff96c107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:35.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9708df700 1 --2- 172.21.15.80:0/2653967978 >> v2:172.21.15.174:3300/0 conn(0x7ff96c108cf0 0x7ff96c107630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:35.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9708df700 1 -- 172.21.15.80:0/2653967978 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c106270 con 0x7ff96c107b70 2019-11-28T11:48:35.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9708df700 1 --2- 172.21.15.80:0/2653967978 >> v2:172.21.15.80:3300/0 conn(0x7ff96c107b70 0x7ff96c107ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff964010720 tx=0x7ff964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9708df700 1 --2- 172.21.15.80:0/2653967978 >> v2:172.21.15.80:3300/0 conn(0x7ff96c107b70 0x7ff96c107ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff964010720 tx=0x7ff964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9708df700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c107b70 0x7ff96c107ff0 secure :-1 s=READY pgs=1929 cs=0 l=1 rx=0x7ff964010720 tx=0x7ff964010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:35.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9708df700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c107b70 0x7ff96c107ff0 secure :-1 s=THROTTLE_DONE pgs=1929 cs=0 l=1 rx=0x7ff964010720 tx=0x7ff964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9708df700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c107b70 0x7ff96c107ff0 secure :-1 s=THROTTLE_DONE pgs=1929 cs=0 l=1 rx=0x7ff964010720 tx=0x7ff964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9708df700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c107b70 0x7ff96c107ff0 secure :-1 s=THROTTLE_DONE pgs=1929 cs=0 l=1 rx=0x7ff964010720 tx=0x7ff964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9697fa700 1 -- 172.21.15.80:0/2653967978 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff964000ce0 con 0x7ff96c107b70 2019-11-28T11:48:35.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9697fa700 1 -- 172.21.15.80:0/2653967978 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff964001410 con 0x7ff96c107b70 2019-11-28T11:48:35.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff9697fa700 1 -- 172.21.15.80:0/2653967978 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff964001b20 con 0x7ff96c107b70 2019-11-28T11:48:35.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff971b41700 1 -- 172.21.15.80:0/2653967978 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c106270 con 0x7ff96c107b70 2019-11-28T11:48:35.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.251+0000 7ff971b41700 1 -- 172.21.15.80:0/2653967978 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c106270 con 0x7ff96c107b70 2019-11-28T11:48:35.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.252+0000 7ff9708df700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c107b70 0x7ff96c107ff0 secure :-1 s=THROTTLE_DONE pgs=1929 cs=0 l=1 rx=0x7ff964010720 tx=0x7ff964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.252+0000 7ff9697fa700 1 -- 172.21.15.80:0/2653967978 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff964000cc0 con 0x7ff96c107b70 2019-11-28T11:48:35.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.252+0000 7ff9708df700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c107b70 0x7ff96c107ff0 secure :-1 s=THROTTLE_DONE pgs=1929 cs=0 l=1 rx=0x7ff964010720 tx=0x7ff964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.252+0000 7ff9697fa700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff950018730 0x7ff95001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:35.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.252+0000 7ff9697fa700 1 -- 172.21.15.80:0/2653967978 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5200+0+0 (secure 0 0 0) 0x7ff964031d70 con 0x7ff96c107b70 2019-11-28T11:48:35.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.252+0000 7ff96bfff700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff950018730 0x7ff95001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:35.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.252+0000 7ff96bfff700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff950018730 0x7ff95001abc0 crc :-1 s=READY pgs=779 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:35.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.260+0000 7ff971b41700 1 -- 172.21.15.80:0/2653967978 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c106270 con 0x7ff96c107b70 2019-11-28T11:48:35.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.263+0000 7ff9708df700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c107b70 0x7ff96c107ff0 secure :-1 s=THROTTLE_DONE pgs=1929 cs=0 l=1 rx=0x7ff964010720 tx=0x7ff964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.263+0000 7ff9697fa700 1 -- 172.21.15.80:0/2653967978 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff964022130 con 0x7ff96c107b70 2019-11-28T11:48:35.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.432+0000 7ff971b41700 1 -- 172.21.15.80:0/2653967978 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7ff96c106270 con 0x7ff96c107b70 2019-11-28T11:48:35.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.774+0000 7ff9708df700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c107b70 0x7ff96c107ff0 secure :-1 s=THROTTLE_DONE pgs=1929 cs=0 l=1 rx=0x7ff964010720 tx=0x7ff964010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.774+0000 7ff9697fa700 1 -- 172.21.15.80:0/2653967978 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v149) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff964022130 con 0x7ff96c107b70 2019-11-28T11:48:35.842 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:48:35.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.798+0000 7ff971b41700 1 -- 172.21.15.80:0/2653967978 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff950018730 msgr2=0x7ff95001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:35.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.798+0000 7ff971b41700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff950018730 0x7ff95001abc0 crc :-1 s=READY pgs=779 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:35.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.798+0000 7ff971b41700 1 -- 172.21.15.80:0/2653967978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c107b70 msgr2=0x7ff96c107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:35.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.798+0000 7ff971b41700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c107b70 0x7ff96c107ff0 secure :-1 s=READY pgs=1929 cs=0 l=1 rx=0x7ff964010720 tx=0x7ff964010600).stop 2019-11-28T11:48:35.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.798+0000 7ff971b41700 1 -- 172.21.15.80:0/2653967978 shutdown_connections 2019-11-28T11:48:35.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.798+0000 7ff971b41700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff950018730 0x7ff95001abc0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:35.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.798+0000 7ff971b41700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c107b70 0x7ff96c107ff0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:35.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.798+0000 7ff971b41700 1 --2- 172.21.15.80:0/2653967978 >> v2:172.21.15.174:3300/0 conn(0x7ff96c108cf0 0x7ff96c107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:35.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.798+0000 7ff971b41700 1 --2- 172.21.15.80:0/2653967978 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c10e970 0x7ff96c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:35.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.798+0000 7ff971b41700 1 -- 172.21.15.80:0/2653967978 shutdown_connections 2019-11-28T11:48:35.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.798+0000 7ff971b41700 1 -- 172.21.15.80:0/2653967978 wait complete. 2019-11-28T11:48:35.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.798+0000 7ff971b41700 1 -- 172.21.15.80:0/2653967978 >> 172.21.15.80:0/2653967978 conn(0x7ff96c15e2d0 msgr2=0x7ff96c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:35.855 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:48:35.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.931+0000 7f43a0940700 1 Processor -- start 2019-11-28T11:48:35.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.931+0000 7f43a0940700 1 -- start start 2019-11-28T11:48:35.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.932+0000 7f43a0940700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f439c15f100 0x7f439c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:35.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.932+0000 7f43a0940700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c06db60 con 0x7f439c15ed10 2019-11-28T11:48:35.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.932+0000 7f43a0940700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c06e060 con 0x7f439c06c2f0 2019-11-28T11:48:35.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.932+0000 7f43a0940700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439c06fe00 con 0x7f439c15f100 2019-11-28T11:48:35.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.932+0000 7f439ad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f439c15ed10 0x7f439c073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40656/0 (socket says 172.21.15.80:40656) 2019-11-28T11:48:35.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.932+0000 7f439ad9d700 1 -- 172.21.15.80:0/2978049154 learned_addr learned my addr 172.21.15.80:0/2978049154 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:35.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.932+0000 7f439a59c700 1 --2- 172.21.15.80:0/2978049154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f439c15f100 0x7f439c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:35.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.932+0000 7f4399d9b700 1 -- 172.21.15.80:0/2978049154 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554639816 0 0) 0x7f438c001150 con 0x7f439c15ed10 2019-11-28T11:48:35.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.932+0000 7f4399d9b700 1 -- 172.21.15.80:0/2978049154 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f437c002e80 con 0x7f439c15ed10 2019-11-28T11:48:35.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.932+0000 7f4399d9b700 1 -- 172.21.15.80:0/2978049154 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158084008 0 0) 0x7f43940009b0 con 0x7f439c06c2f0 2019-11-28T11:48:35.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.932+0000 7f4399d9b700 1 -- 172.21.15.80:0/2978049154 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f437c0030b0 con 0x7f439c06c2f0 2019-11-28T11:48:35.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.933+0000 7f4399d9b700 1 -- 172.21.15.80:0/2978049154 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1554589882 0 0) 0x7f438c001130 con 0x7f439c15ed10 2019-11-28T11:48:35.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.933+0000 7f439a59c700 1 -- 172.21.15.80:0/2978049154 >> v1:172.21.15.174:6789/0 conn(0x7f439c06c2f0 legacy=0x7f439c06c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:35.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.933+0000 7f439a59c700 1 -- 172.21.15.80:0/2978049154 >> v1:172.21.15.80:6789/0 conn(0x7f439c15ed10 legacy=0x7f439c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:35.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.933+0000 7f439a59c700 1 -- 172.21.15.80:0/2978049154 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c070760 con 0x7f439c15f100 2019-11-28T11:48:35.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.933+0000 7f439a59c700 1 --2- 172.21.15.80:0/2978049154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f439c15f100 0x7f439c06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f438400b2d0 tx=0x7f438400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.933+0000 7f439a59c700 1 --2- 172.21.15.80:0/2978049154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f439c15f100 0x7f439c06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f438400b2d0 tx=0x7f438400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.933+0000 7f439a59c700 1 --2- 172.21.15.80:0/2978049154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f439c15f100 0x7f439c06bdb0 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7f438400b2d0 tx=0x7f438400bae0).ready entity=mon.2 client_cookie=998a4e01a7e7fb9e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:35.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.933+0000 7f439a59c700 1 --2- 172.21.15.80:0/2978049154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f439c15f100 0x7f439c06bdb0 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f438400b2d0 tx=0x7f438400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.933+0000 7f4399d9b700 1 -- 172.21.15.80:0/2978049154 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4384000ce0 con 0x7f439c15f100 2019-11-28T11:48:35.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.933+0000 7f439a59c700 1 --2- 172.21.15.80:0/2978049154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f439c15f100 0x7f439c06bdb0 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f438400b2d0 tx=0x7f438400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.933+0000 7f4399d9b700 1 -- 172.21.15.80:0/2978049154 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4384009be0 con 0x7f439c15f100 2019-11-28T11:48:35.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.933+0000 7f439a59c700 1 --2- 172.21.15.80:0/2978049154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f439c15f100 0x7f439c06bdb0 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f438400b2d0 tx=0x7f438400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.933+0000 7f4399d9b700 1 -- 172.21.15.80:0/2978049154 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4384000ce0 con 0x7f439c15f100 2019-11-28T11:48:35.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.933+0000 7f43a0940700 1 -- 172.21.15.80:0/2978049154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f439c15f100 msgr2=0x7f439c06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:35.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.933+0000 7f43a0940700 1 --2- 172.21.15.80:0/2978049154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f439c15f100 0x7f439c06bdb0 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7f438400b2d0 tx=0x7f438400bae0).stop 2019-11-28T11:48:35.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.934+0000 7f43a0940700 1 -- 172.21.15.80:0/2978049154 shutdown_connections 2019-11-28T11:48:35.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.934+0000 7f43a0940700 1 --2- 172.21.15.80:0/2978049154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f439c15f100 0x7f439c06bdb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:35.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.934+0000 7f43a0940700 1 -- 172.21.15.80:0/2978049154 shutdown_connections 2019-11-28T11:48:35.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.934+0000 7f43a0940700 1 -- 172.21.15.80:0/2978049154 wait complete. 2019-11-28T11:48:35.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.934+0000 7f43a0940700 1 -- 172.21.15.80:0/2978049154 >> 172.21.15.80:0/2978049154 conn(0x7f439c061d20 msgr2=0x7f439c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:35.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.936+0000 7f43a0940700 1 Processor -- start 2019-11-28T11:48:35.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.936+0000 7f43a0940700 1 -- start start 2019-11-28T11:48:35.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.937+0000 7f43a0940700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f439c148320 0x7f439c10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:35.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.937+0000 7f43a0940700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f439c10e3d0 0x7f439c168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:35.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.937+0000 7f43a0940700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c148e00 con 0x7f439c10f290 2019-11-28T11:48:35.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.937+0000 7f43a0940700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439c13aa20 con 0x7f439c148320 2019-11-28T11:48:35.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.937+0000 7f43a0940700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439c13acf0 con 0x7f439c10e3d0 2019-11-28T11:48:35.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.937+0000 7f439ad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f439c148320 0x7f439c10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:35.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.937+0000 7f439ad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f439c148320 0x7f439c10ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41346/0 (socket says 172.21.15.80:41346) 2019-11-28T11:48:35.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.937+0000 7f439a59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f439c10f290 0x7f439c10dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40664/0 (socket says 172.21.15.80:40664) 2019-11-28T11:48:35.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.937+0000 7f439ad9d700 1 -- 172.21.15.80:0/2567287450 learned_addr learned my addr 172.21.15.80:0/2567287450 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:35.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.937+0000 7f439b59e700 1 --2- 172.21.15.80:0/2567287450 >> v2:172.21.15.174:3300/0 conn(0x7f439c10e3d0 0x7f439c168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:35.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f439ad9d700 1 -- 172.21.15.80:0/2567287450 >> v2:172.21.15.174:3300/0 conn(0x7f439c10e3d0 msgr2=0x7f439c168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:35.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f439ad9d700 1 --2- 172.21.15.80:0/2567287450 >> v2:172.21.15.174:3300/0 conn(0x7f439c10e3d0 0x7f439c168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:35.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f439ad9d700 1 -- 172.21.15.80:0/2567287450 >> v1:172.21.15.80:6789/0 conn(0x7f439c10f290 legacy=0x7f439c10dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:35.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f439ad9d700 1 -- 172.21.15.80:0/2567287450 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c10c490 con 0x7f439c148320 2019-11-28T11:48:35.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f43937fe700 1 -- 172.21.15.80:0/2567287450 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186510937 0 0) 0x7f438400afa0 con 0x7f439c10f290 2019-11-28T11:48:35.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f439ad9d700 1 --2- 172.21.15.80:0/2567287450 >> v2:172.21.15.80:3300/0 conn(0x7f439c148320 0x7f439c10ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f438c010390 tx=0x7f438c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f439ad9d700 1 --2- 172.21.15.80:0/2567287450 >> v2:172.21.15.80:3300/0 conn(0x7f439c148320 0x7f439c10ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f438c010390 tx=0x7f438c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f439ad9d700 1 --2- 172.21.15.80:0/2567287450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f439c148320 0x7f439c10ed50 secure :-1 s=READY pgs=1932 cs=0 l=1 rx=0x7f438c010390 tx=0x7f438c010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:35.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f439ad9d700 1 --2- 172.21.15.80:0/2567287450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f439c148320 0x7f439c10ed50 secure :-1 s=THROTTLE_DONE pgs=1932 cs=0 l=1 rx=0x7f438c010390 tx=0x7f438c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f43937fe700 1 -- 172.21.15.80:0/2567287450 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f438c000c90 con 0x7f439c148320 2019-11-28T11:48:35.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f439ad9d700 1 --2- 172.21.15.80:0/2567287450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f439c148320 0x7f439c10ed50 secure :-1 s=THROTTLE_DONE pgs=1932 cs=0 l=1 rx=0x7f438c010390 tx=0x7f438c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f43937fe700 1 -- 172.21.15.80:0/2567287450 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438c0010c0 con 0x7f439c148320 2019-11-28T11:48:35.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f439ad9d700 1 --2- 172.21.15.80:0/2567287450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f439c148320 0x7f439c10ed50 secure :-1 s=THROTTLE_DONE pgs=1932 cs=0 l=1 rx=0x7f438c010390 tx=0x7f438c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f43a0940700 1 -- 172.21.15.80:0/2567287450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439c10c810 con 0x7f439c148320 2019-11-28T11:48:35.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f43937fe700 1 -- 172.21.15.80:0/2567287450 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f438c000e90 con 0x7f439c148320 2019-11-28T11:48:35.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f43a0940700 1 -- 172.21.15.80:0/2567287450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c10c490 con 0x7f439c148320 2019-11-28T11:48:35.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.938+0000 7f439ad9d700 1 --2- 172.21.15.80:0/2567287450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f439c148320 0x7f439c10ed50 secure :-1 s=THROTTLE_DONE pgs=1932 cs=0 l=1 rx=0x7f438c010390 tx=0x7f438c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.939+0000 7f43937fe700 1 -- 172.21.15.80:0/2567287450 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f438c000c90 con 0x7f439c148320 2019-11-28T11:48:35.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.939+0000 7f439ad9d700 1 --2- 172.21.15.80:0/2567287450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f439c148320 0x7f439c10ed50 secure :-1 s=THROTTLE_DONE pgs=1932 cs=0 l=1 rx=0x7f438c010390 tx=0x7f438c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.939+0000 7f43937fe700 1 --2- 172.21.15.80:0/2567287450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4374018730 0x7f437401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:35.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.939+0000 7f43937fe700 1 -- 172.21.15.80:0/2567287450 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f438c031a90 con 0x7f439c148320 2019-11-28T11:48:35.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.939+0000 7f439a59c700 1 --2- 172.21.15.80:0/2567287450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4374018730 0x7f437401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:35.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.939+0000 7f439a59c700 1 --2- 172.21.15.80:0/2567287450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4374018730 0x7f437401abc0 crc :-1 s=READY pgs=780 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:35.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.946+0000 7f43a0940700 1 -- 172.21.15.80:0/2567287450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439c10c810 con 0x7f439c148320 2019-11-28T11:48:35.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.950+0000 7f439ad9d700 1 --2- 172.21.15.80:0/2567287450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f439c148320 0x7f439c10ed50 secure :-1 s=THROTTLE_DONE pgs=1932 cs=0 l=1 rx=0x7f438c010390 tx=0x7f438c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:35.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:35.950+0000 7f43937fe700 1 -- 172.21.15.80:0/2567287450 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f438c0075b0 con 0x7f439c148320 2019-11-28T11:48:36.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.120+0000 7f43a0940700 1 -- 172.21.15.80:0/2567287450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f439c10c490 con 0x7f439c148320 2019-11-28T11:48:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.778+0000 7f439ad9d700 1 --2- 172.21.15.80:0/2567287450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f439c148320 0x7f439c10ed50 secure :-1 s=THROTTLE_DONE pgs=1932 cs=0 l=1 rx=0x7f438c010390 tx=0x7f438c010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:36.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.778+0000 7f43937fe700 1 -- 172.21.15.80:0/2567287450 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v150) v1 ==== 125+0+0 (secure 0 0 0) 0x7f438c000c90 con 0x7f439c148320 2019-11-28T11:48:36.830 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:48:36.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.787+0000 7f43a0940700 1 -- 172.21.15.80:0/2567287450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4374018730 msgr2=0x7f437401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:36.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.787+0000 7f43a0940700 1 --2- 172.21.15.80:0/2567287450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4374018730 0x7f437401abc0 crc :-1 s=READY pgs=780 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:36.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.787+0000 7f43a0940700 1 -- 172.21.15.80:0/2567287450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f439c148320 msgr2=0x7f439c10ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:36.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.787+0000 7f43a0940700 1 --2- 172.21.15.80:0/2567287450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f439c148320 0x7f439c10ed50 secure :-1 s=READY pgs=1932 cs=0 l=1 rx=0x7f438c010390 tx=0x7f438c010730).stop 2019-11-28T11:48:36.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.787+0000 7f43a0940700 1 -- 172.21.15.80:0/2567287450 shutdown_connections 2019-11-28T11:48:36.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.787+0000 7f43a0940700 1 --2- 172.21.15.80:0/2567287450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4374018730 0x7f437401abc0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:36.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.787+0000 7f43a0940700 1 --2- 172.21.15.80:0/2567287450 >> v2:172.21.15.174:3300/0 conn(0x7f439c10e3d0 0x7f439c168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:36.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.787+0000 7f43a0940700 1 --2- 172.21.15.80:0/2567287450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f439c148320 0x7f439c10ed50 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:36.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.787+0000 7f43a0940700 1 -- 172.21.15.80:0/2567287450 shutdown_connections 2019-11-28T11:48:36.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.787+0000 7f43a0940700 1 -- 172.21.15.80:0/2567287450 wait complete. 2019-11-28T11:48:36.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.787+0000 7f43a0940700 1 -- 172.21.15.80:0/2567287450 >> 172.21.15.80:0/2567287450 conn(0x7f439c15e2d0 msgr2=0x7f439c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:36.844 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:48:36.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.921+0000 7f93c85c6700 1 Processor -- start 2019-11-28T11:48:36.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.921+0000 7f93c85c6700 1 -- start start 2019-11-28T11:48:36.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.922+0000 7f93c85c6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f93c01639f0 0x7f93c0165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:36.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.922+0000 7f93c85c6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c006db60 con 0x7f93c015ed10 2019-11-28T11:48:36.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.922+0000 7f93c85c6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c006e060 con 0x7f93c015f100 2019-11-28T11:48:36.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.922+0000 7f93c85c6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c006fe00 con 0x7f93c01639f0 2019-11-28T11:48:36.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.922+0000 7f93c6b63700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f93c015ed10 0x7f93c0073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40670/0 (socket says 172.21.15.80:40670) 2019-11-28T11:48:36.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.922+0000 7f93c6b63700 1 -- 172.21.15.80:0/2897185835 learned_addr learned my addr 172.21.15.80:0/2897185835 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:36.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.922+0000 7f93c7364700 1 --2- 172.21.15.80:0/2897185835 >> v2:172.21.15.174:3300/0 conn(0x7f93c01639f0 0x7f93c0165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:36.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.922+0000 7f93c5b61700 1 -- 172.21.15.80:0/2897185835 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177169099 0 0) 0x7f93ac0014d0 con 0x7f93c015ed10 2019-11-28T11:48:36.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.922+0000 7f93c5b61700 1 -- 172.21.15.80:0/2897185835 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93a4002e80 con 0x7f93c015ed10 2019-11-28T11:48:36.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.922+0000 7f93c5b61700 1 -- 172.21.15.80:0/2897185835 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116297505 0 0) 0x7f93b8001080 con 0x7f93c015f100 2019-11-28T11:48:36.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.922+0000 7f93c5b61700 1 -- 172.21.15.80:0/2897185835 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93a40030b0 con 0x7f93c015f100 2019-11-28T11:48:36.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.922+0000 7f93c5b61700 1 -- 172.21.15.80:0/2897185835 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1361275836 0 0) 0x7f93ac0014b0 con 0x7f93c015ed10 2019-11-28T11:48:36.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.922+0000 7f93c7364700 1 -- 172.21.15.80:0/2897185835 >> v1:172.21.15.174:6789/0 conn(0x7f93c015f100 legacy=0x7f93c006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:36.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.922+0000 7f93c7364700 1 -- 172.21.15.80:0/2897185835 >> v1:172.21.15.80:6789/0 conn(0x7f93c015ed10 legacy=0x7f93c0073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:36.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.922+0000 7f93c7364700 1 -- 172.21.15.80:0/2897185835 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c0070760 con 0x7f93c01639f0 2019-11-28T11:48:36.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.923+0000 7f93c7364700 1 --2- 172.21.15.80:0/2897185835 >> v2:172.21.15.174:3300/0 conn(0x7f93c01639f0 0x7f93c0165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f93b000af80 tx=0x7f93b000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:36.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.923+0000 7f93c7364700 1 --2- 172.21.15.80:0/2897185835 >> v2:172.21.15.174:3300/0 conn(0x7f93c01639f0 0x7f93c0165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f93b000af80 tx=0x7f93b000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.923+0000 7f93c7364700 1 --2- 172.21.15.80:0/2897185835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93c01639f0 0x7f93c0165df0 secure :-1 s=READY pgs=1126 cs=0 l=1 rx=0x7f93b000af80 tx=0x7f93b000b790).ready entity=mon.1 client_cookie=1b713a2c5f7ff42a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.923+0000 7f93c7364700 1 --2- 172.21.15.80:0/2897185835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93c01639f0 0x7f93c0165df0 secure :-1 s=THROTTLE_DONE pgs=1126 cs=0 l=1 rx=0x7f93b000af80 tx=0x7f93b000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.923+0000 7f93c5b61700 1 -- 172.21.15.80:0/2897185835 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93b0007240 con 0x7f93c01639f0 2019-11-28T11:48:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.923+0000 7f93c7364700 1 --2- 172.21.15.80:0/2897185835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93c01639f0 0x7f93c0165df0 secure :-1 s=THROTTLE_DONE pgs=1126 cs=0 l=1 rx=0x7f93b000af80 tx=0x7f93b000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.923+0000 7f93c7364700 1 --2- 172.21.15.80:0/2897185835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93c01639f0 0x7f93c0165df0 secure :-1 s=THROTTLE_DONE pgs=1126 cs=0 l=1 rx=0x7f93b000af80 tx=0x7f93b000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.923+0000 7f93c5b61700 1 -- 172.21.15.80:0/2897185835 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b0000bb0 con 0x7f93c01639f0 2019-11-28T11:48:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.923+0000 7f93c5b61700 1 -- 172.21.15.80:0/2897185835 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93b0009bd0 con 0x7f93c01639f0 2019-11-28T11:48:36.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.923+0000 7f93c85c6700 1 -- 172.21.15.80:0/2897185835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93c01639f0 msgr2=0x7f93c0165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:36.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.923+0000 7f93c85c6700 1 --2- 172.21.15.80:0/2897185835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93c01639f0 0x7f93c0165df0 secure :-1 s=READY pgs=1126 cs=0 l=1 rx=0x7f93b000af80 tx=0x7f93b000b790).stop 2019-11-28T11:48:36.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.924+0000 7f93c85c6700 1 -- 172.21.15.80:0/2897185835 shutdown_connections 2019-11-28T11:48:36.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.924+0000 7f93c85c6700 1 --2- 172.21.15.80:0/2897185835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93c01639f0 0x7f93c0165df0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:36.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.924+0000 7f93c85c6700 1 -- 172.21.15.80:0/2897185835 shutdown_connections 2019-11-28T11:48:36.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.924+0000 7f93c85c6700 1 -- 172.21.15.80:0/2897185835 wait complete. 2019-11-28T11:48:36.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.924+0000 7f93c85c6700 1 -- 172.21.15.80:0/2897185835 >> 172.21.15.80:0/2897185835 conn(0x7f93c0061d20 msgr2=0x7f93c00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:36.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.926+0000 7f93c85c6700 1 Processor -- start 2019-11-28T11:48:36.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.926+0000 7f93c85c6700 1 -- start start 2019-11-28T11:48:36.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93c85c6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f93c010ed60 0x7f93c010f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:36.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93c85c6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93c010f730 0x7f93c0167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:36.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93c85c6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c010c250 con 0x7f93c010e970 2019-11-28T11:48:36.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93c85c6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c010e430 con 0x7f93c010f730 2019-11-28T11:48:36.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93c85c6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c0105860 con 0x7f93c010ed60 2019-11-28T11:48:36.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93c6b63700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f93c010e970 0x7f93c01087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40676/0 (socket says 172.21.15.80:40676) 2019-11-28T11:48:36.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93c6b63700 1 -- 172.21.15.80:0/53309401 learned_addr learned my addr 172.21.15.80:0/53309401 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:36.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93c7364700 1 --2- 172.21.15.80:0/53309401 >> v2:172.21.15.80:3300/0 conn(0x7f93c010f730 0x7f93c0167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:36.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93c6362700 1 --2- 172.21.15.80:0/53309401 >> v2:172.21.15.174:3300/0 conn(0x7f93c010ed60 0x7f93c010f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:36.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93bf7fe700 1 -- 172.21.15.80:0/53309401 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081398777 0 0) 0x7f93ac0014f0 con 0x7f93c010e970 2019-11-28T11:48:36.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93bf7fe700 1 -- 172.21.15.80:0/53309401 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f939c002e80 con 0x7f93c010e970 2019-11-28T11:48:36.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93c7364700 1 -- 172.21.15.80:0/53309401 >> v2:172.21.15.174:3300/0 conn(0x7f93c010ed60 msgr2=0x7f93c010f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:36.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93c7364700 1 --2- 172.21.15.80:0/53309401 >> v2:172.21.15.174:3300/0 conn(0x7f93c010ed60 0x7f93c010f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:36.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93c7364700 1 -- 172.21.15.80:0/53309401 >> v1:172.21.15.80:6789/0 conn(0x7f93c010e970 legacy=0x7f93c01087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:36.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93c7364700 1 -- 172.21.15.80:0/53309401 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c0105ef0 con 0x7f93c010f730 2019-11-28T11:48:36.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93c7364700 1 --2- 172.21.15.80:0/53309401 >> v2:172.21.15.80:3300/0 conn(0x7f93c010f730 0x7f93c0167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f93b0010380 tx=0x7f93b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:36.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93c7364700 1 --2- 172.21.15.80:0/53309401 >> v2:172.21.15.80:3300/0 conn(0x7f93c010f730 0x7f93c0167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f93b0010380 tx=0x7f93b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:36.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.927+0000 7f93c7364700 1 --2- 172.21.15.80:0/53309401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93c010f730 0x7f93c0167d70 secure :-1 s=READY pgs=1935 cs=0 l=1 rx=0x7f93b0010380 tx=0x7f93b0010200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:36.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.928+0000 7f93c7364700 1 --2- 172.21.15.80:0/53309401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93c010f730 0x7f93c0167d70 secure :-1 s=THROTTLE_DONE pgs=1935 cs=0 l=1 rx=0x7f93b0010380 tx=0x7f93b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:36.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.928+0000 7f93bf7fe700 1 -- 172.21.15.80:0/53309401 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93b00097c0 con 0x7f93c010f730 2019-11-28T11:48:37.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.928+0000 7f93c7364700 1 --2- 172.21.15.80:0/53309401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93c010f730 0x7f93c0167d70 secure :-1 s=THROTTLE_DONE pgs=1935 cs=0 l=1 rx=0x7f93b0010380 tx=0x7f93b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.928+0000 7f93bf7fe700 1 -- 172.21.15.80:0/53309401 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b00097c0 con 0x7f93c010f730 2019-11-28T11:48:37.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.928+0000 7f93c85c6700 1 -- 172.21.15.80:0/53309401 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c0106270 con 0x7f93c010f730 2019-11-28T11:48:37.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.928+0000 7f93c7364700 1 --2- 172.21.15.80:0/53309401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93c010f730 0x7f93c0167d70 secure :-1 s=THROTTLE_DONE pgs=1935 cs=0 l=1 rx=0x7f93b0010380 tx=0x7f93b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.928+0000 7f93bf7fe700 1 -- 172.21.15.80:0/53309401 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93b0009f30 con 0x7f93c010f730 2019-11-28T11:48:37.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.928+0000 7f93c85c6700 1 -- 172.21.15.80:0/53309401 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c0105ef0 con 0x7f93c010f730 2019-11-28T11:48:37.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.928+0000 7f93c7364700 1 --2- 172.21.15.80:0/53309401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93c010f730 0x7f93c0167d70 secure :-1 s=THROTTLE_DONE pgs=1935 cs=0 l=1 rx=0x7f93b0010380 tx=0x7f93b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.928+0000 7f93bf7fe700 1 -- 172.21.15.80:0/53309401 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f93b0009af0 con 0x7f93c010f730 2019-11-28T11:48:37.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.928+0000 7f93c7364700 1 --2- 172.21.15.80:0/53309401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93c010f730 0x7f93c0167d70 secure :-1 s=THROTTLE_DONE pgs=1935 cs=0 l=1 rx=0x7f93b0010380 tx=0x7f93b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.928+0000 7f93bf7fe700 1 --2- 172.21.15.80:0/53309401 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f939c018770 0x7f939c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:37.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.928+0000 7f93bf7fe700 1 -- 172.21.15.80:0/53309401 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5904+0+0 (secure 0 0 0) 0x7f93b00319e0 con 0x7f93c010f730 2019-11-28T11:48:37.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.929+0000 7f93c6b63700 1 --2- 172.21.15.80:0/53309401 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f939c018770 0x7f939c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:37.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.929+0000 7f93c6b63700 1 --2- 172.21.15.80:0/53309401 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f939c018770 0x7f939c01abe0 crc :-1 s=READY pgs=781 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:37.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.936+0000 7f93c85c6700 1 -- 172.21.15.80:0/53309401 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c0106270 con 0x7f93c010f730 2019-11-28T11:48:37.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.939+0000 7f93c7364700 1 --2- 172.21.15.80:0/53309401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93c010f730 0x7f93c0167d70 secure :-1 s=THROTTLE_DONE pgs=1935 cs=0 l=1 rx=0x7f93b0010380 tx=0x7f93b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:36.939+0000 7f93bf7fe700 1 -- 172.21.15.80:0/53309401 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f93b0025f00 con 0x7f93c010f730 2019-11-28T11:48:37.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.108+0000 7f93c85c6700 1 -- 172.21.15.80:0/53309401 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f93c0105ef0 con 0x7f93c010f730 2019-11-28T11:48:37.156 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:48:37.108+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:48:37.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.111+0000 7f93c7364700 1 --2- 172.21.15.80:0/53309401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93c010f730 0x7f93c0167d70 secure :-1 s=THROTTLE_DONE pgs=1935 cs=0 l=1 rx=0x7f93b0010380 tx=0x7f93b0010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.111+0000 7f93bf7fe700 1 -- 172.21.15.80:0/53309401 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 24 and data pool 25 v111) v1 ==== 174+0+0 (secure 0 0 0) 0x7f93b0025f00 con 0x7f93c010f730 2019-11-28T11:48:37.164 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 24 and data pool 25 2019-11-28T11:48:37.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.117+0000 7f93c85c6700 1 -- 172.21.15.80:0/53309401 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f939c018770 msgr2=0x7f939c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.117+0000 7f93c85c6700 1 --2- 172.21.15.80:0/53309401 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f939c018770 0x7f939c01abe0 crc :-1 s=READY pgs=781 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:37.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.117+0000 7f93c85c6700 1 -- 172.21.15.80:0/53309401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93c010f730 msgr2=0x7f93c0167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.117+0000 7f93c85c6700 1 --2- 172.21.15.80:0/53309401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93c010f730 0x7f93c0167d70 secure :-1 s=READY pgs=1935 cs=0 l=1 rx=0x7f93b0010380 tx=0x7f93b0010200).stop 2019-11-28T11:48:37.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.117+0000 7f93c85c6700 1 -- 172.21.15.80:0/53309401 shutdown_connections 2019-11-28T11:48:37.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.117+0000 7f93c85c6700 1 --2- 172.21.15.80:0/53309401 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f939c018770 0x7f939c01abe0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:37.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.117+0000 7f93c85c6700 1 --2- 172.21.15.80:0/53309401 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93c010f730 0x7f93c0167d70 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:37.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.117+0000 7f93c85c6700 1 --2- 172.21.15.80:0/53309401 >> v2:172.21.15.174:3300/0 conn(0x7f93c010ed60 0x7f93c010f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:37.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.117+0000 7f93c85c6700 1 -- 172.21.15.80:0/53309401 shutdown_connections 2019-11-28T11:48:37.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.117+0000 7f93c85c6700 1 -- 172.21.15.80:0/53309401 wait complete. 2019-11-28T11:48:37.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.117+0000 7f93c85c6700 1 -- 172.21.15.80:0/53309401 >> 172.21.15.80:0/53309401 conn(0x7f93c015e2d0 msgr2=0x7f93c0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:37.173 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:48:37.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.246+0000 7f53b3a01700 1 Processor -- start 2019-11-28T11:48:37.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.246+0000 7f53b3a01700 1 -- start start 2019-11-28T11:48:37.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.247+0000 7f53b3a01700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53ac06c0a0 0x7f53ac072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:37.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.247+0000 7f53b3a01700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f53ac0734e0 0x7f53ac071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:37.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.247+0000 7f53b3a01700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ac06db00 con 0x7f53ac072360 2019-11-28T11:48:37.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.247+0000 7f53b3a01700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ac06f330 con 0x7f53ac0734e0 2019-11-28T11:48:37.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.247+0000 7f53b3a01700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac0706c0 con 0x7f53ac06c0a0 2019-11-28T11:48:37.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.247+0000 7f53b279f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f53ac072360 0x7f53ac06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40686/0 (socket says 172.21.15.80:40686) 2019-11-28T11:48:37.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.247+0000 7f53b279f700 1 -- 172.21.15.80:0/4237958041 learned_addr learned my addr 172.21.15.80:0/4237958041 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:37.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.247+0000 7f53b179d700 1 --2- 172.21.15.80:0/4237958041 >> v2:172.21.15.174:3300/0 conn(0x7f53ac0734e0 0x7f53ac071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:37.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.247+0000 7f53b1f9e700 1 --2- 172.21.15.80:0/4237958041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53ac06c0a0 0x7f53ac072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:37.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b0f9c700 1 -- 172.21.15.80:0/4237958041 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409008274 0 0) 0x7f53a4001150 con 0x7f53ac072360 2019-11-28T11:48:37.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b0f9c700 1 -- 172.21.15.80:0/4237958041 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5398002e80 con 0x7f53ac072360 2019-11-28T11:48:37.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b179d700 1 -- 172.21.15.80:0/4237958041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53ac06c0a0 msgr2=0x7f53ac072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:37.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b179d700 1 --2- 172.21.15.80:0/4237958041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53ac06c0a0 0x7f53ac072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:37.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b179d700 1 -- 172.21.15.80:0/4237958041 >> v1:172.21.15.80:6789/0 conn(0x7f53ac072360 legacy=0x7f53ac06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b179d700 1 -- 172.21.15.80:0/4237958041 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac070a40 con 0x7f53ac0734e0 2019-11-28T11:48:37.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b1f9e700 1 --2- 172.21.15.80:0/4237958041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53ac06c0a0 0x7f53ac072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:48:37.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b179d700 1 --2- 172.21.15.80:0/4237958041 >> v2:172.21.15.174:3300/0 conn(0x7f53ac0734e0 0x7f53ac071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f539400b2d0 tx=0x7f539400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b179d700 1 --2- 172.21.15.80:0/4237958041 >> v2:172.21.15.174:3300/0 conn(0x7f53ac0734e0 0x7f53ac071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f539400b2d0 tx=0x7f539400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b179d700 1 --2- 172.21.15.80:0/4237958041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53ac0734e0 0x7f53ac071e20 secure :-1 s=READY pgs=1127 cs=0 l=1 rx=0x7f539400b2d0 tx=0x7f539400bae0).ready entity=mon.1 client_cookie=39cd02159d549af3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:37.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b179d700 1 --2- 172.21.15.80:0/4237958041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53ac0734e0 0x7f53ac071e20 secure :-1 s=THROTTLE_DONE pgs=1127 cs=0 l=1 rx=0x7f539400b2d0 tx=0x7f539400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b0f9c700 1 -- 172.21.15.80:0/4237958041 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5394007590 con 0x7f53ac0734e0 2019-11-28T11:48:37.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b179d700 1 --2- 172.21.15.80:0/4237958041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53ac0734e0 0x7f53ac071e20 secure :-1 s=THROTTLE_DONE pgs=1127 cs=0 l=1 rx=0x7f539400b2d0 tx=0x7f539400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b0f9c700 1 -- 172.21.15.80:0/4237958041 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5394009d30 con 0x7f53ac0734e0 2019-11-28T11:48:37.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b179d700 1 --2- 172.21.15.80:0/4237958041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53ac0734e0 0x7f53ac071e20 secure :-1 s=THROTTLE_DONE pgs=1127 cs=0 l=1 rx=0x7f539400b2d0 tx=0x7f539400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b0f9c700 1 -- 172.21.15.80:0/4237958041 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5394007590 con 0x7f53ac0734e0 2019-11-28T11:48:37.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b3a01700 1 -- 172.21.15.80:0/4237958041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53ac0734e0 msgr2=0x7f53ac071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.248+0000 7f53b3a01700 1 --2- 172.21.15.80:0/4237958041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53ac0734e0 0x7f53ac071e20 secure :-1 s=READY pgs=1127 cs=0 l=1 rx=0x7f539400b2d0 tx=0x7f539400bae0).stop 2019-11-28T11:48:37.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.249+0000 7f53b3a01700 1 -- 172.21.15.80:0/4237958041 shutdown_connections 2019-11-28T11:48:37.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.249+0000 7f53b3a01700 1 --2- 172.21.15.80:0/4237958041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53ac0734e0 0x7f53ac071e20 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:37.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.249+0000 7f53b3a01700 1 --2- 172.21.15.80:0/4237958041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53ac06c0a0 0x7f53ac072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:37.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.249+0000 7f53b3a01700 1 -- 172.21.15.80:0/4237958041 shutdown_connections 2019-11-28T11:48:37.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.249+0000 7f53b3a01700 1 -- 172.21.15.80:0/4237958041 wait complete. 2019-11-28T11:48:37.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.249+0000 7f53b3a01700 1 -- 172.21.15.80:0/4237958041 >> 172.21.15.80:0/4237958041 conn(0x7f53ac061cf0 msgr2=0x7f53ac064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:37.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.251+0000 7f53b3a01700 1 Processor -- start 2019-11-28T11:48:37.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.251+0000 7f53b3a01700 1 -- start start 2019-11-28T11:48:37.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.252+0000 7f53b3a01700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53ac13e320 0x7f53ac13e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:37.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.252+0000 7f53b3a01700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ac139e00 con 0x7f53ac15fdf0 2019-11-28T11:48:37.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.252+0000 7f53b3a01700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ac13b4e0 con 0x7f53ac12a3c0 2019-11-28T11:48:37.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.252+0000 7f53b3a01700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ac108820 con 0x7f53ac13e320 2019-11-28T11:48:37.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.252+0000 7f53b179d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53ac13e320 0x7f53ac13e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:37.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.252+0000 7f53b1f9e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f53ac15fdf0 0x7f53ac12b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40690/0 (socket says 172.21.15.80:40690) 2019-11-28T11:48:37.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.252+0000 7f53b1f9e700 1 -- 172.21.15.80:0/3824131556 learned_addr learned my addr 172.21.15.80:0/3824131556 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:37.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.253+0000 7f53b179d700 1 -- 172.21.15.80:0/3824131556 >> v1:172.21.15.174:6789/0 conn(0x7f53ac12a3c0 legacy=0x7f53ac12a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.253+0000 7f53b179d700 1 -- 172.21.15.80:0/3824131556 >> v1:172.21.15.80:6789/0 conn(0x7f53ac15fdf0 legacy=0x7f53ac12b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.253+0000 7f53aa7fc700 1 -- 172.21.15.80:0/3824131556 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623272753 0 0) 0x7f539c00dd90 con 0x7f53ac15fdf0 2019-11-28T11:48:37.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.253+0000 7f53b179d700 1 -- 172.21.15.80:0/3824131556 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac10a8c0 con 0x7f53ac13e320 2019-11-28T11:48:37.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.253+0000 7f53b179d700 1 --2- 172.21.15.80:0/3824131556 >> v2:172.21.15.80:3300/0 conn(0x7f53ac13e320 0x7f53ac13e7b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f53940106f0 tx=0x7f5394010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.253+0000 7f53b179d700 1 --2- 172.21.15.80:0/3824131556 >> v2:172.21.15.80:3300/0 conn(0x7f53ac13e320 0x7f53ac13e7b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f53940106f0 tx=0x7f5394010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.253+0000 7f53b179d700 1 --2- 172.21.15.80:0/3824131556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac13e320 0x7f53ac13e7b0 secure :-1 s=READY pgs=1938 cs=0 l=1 rx=0x7f53940106f0 tx=0x7f5394010a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:37.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.253+0000 7f53b179d700 1 --2- 172.21.15.80:0/3824131556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac13e320 0x7f53ac13e7b0 secure :-1 s=THROTTLE_DONE pgs=1938 cs=0 l=1 rx=0x7f53940106f0 tx=0x7f5394010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.253+0000 7f53aa7fc700 1 -- 172.21.15.80:0/3824131556 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5394000cc0 con 0x7f53ac13e320 2019-11-28T11:48:37.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.253+0000 7f53b179d700 1 --2- 172.21.15.80:0/3824131556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac13e320 0x7f53ac13e7b0 secure :-1 s=THROTTLE_DONE pgs=1938 cs=0 l=1 rx=0x7f53940106f0 tx=0x7f5394010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.253+0000 7f53b3a01700 1 -- 172.21.15.80:0/3824131556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ac10a8c0 con 0x7f53ac13e320 2019-11-28T11:48:37.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.253+0000 7f53aa7fc700 1 -- 172.21.15.80:0/3824131556 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5394009900 con 0x7f53ac13e320 2019-11-28T11:48:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.253+0000 7f53b179d700 1 --2- 172.21.15.80:0/3824131556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac13e320 0x7f53ac13e7b0 secure :-1 s=THROTTLE_DONE pgs=1938 cs=0 l=1 rx=0x7f53940106f0 tx=0x7f5394010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.253+0000 7f53aa7fc700 1 -- 172.21.15.80:0/3824131556 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5394009af0 con 0x7f53ac13e320 2019-11-28T11:48:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.253+0000 7f53b3a01700 1 -- 172.21.15.80:0/3824131556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ac10a8c0 con 0x7f53ac13e320 2019-11-28T11:48:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.253+0000 7f53b179d700 1 --2- 172.21.15.80:0/3824131556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac13e320 0x7f53ac13e7b0 secure :-1 s=THROTTLE_DONE pgs=1938 cs=0 l=1 rx=0x7f53940106f0 tx=0x7f5394010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.254+0000 7f53aa7fc700 1 -- 172.21.15.80:0/3824131556 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5394009af0 con 0x7f53ac13e320 2019-11-28T11:48:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.254+0000 7f53b179d700 1 --2- 172.21.15.80:0/3824131556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac13e320 0x7f53ac13e7b0 secure :-1 s=THROTTLE_DONE pgs=1938 cs=0 l=1 rx=0x7f53940106f0 tx=0x7f5394010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.254+0000 7f53aa7fc700 1 --2- 172.21.15.80:0/3824131556 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5390018730 0x7f539001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:37.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.254+0000 7f53aa7fc700 1 -- 172.21.15.80:0/3824131556 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5394031f10 con 0x7f53ac13e320 2019-11-28T11:48:37.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.254+0000 7f53b1f9e700 1 --2- 172.21.15.80:0/3824131556 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5390018730 0x7f539001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:37.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.254+0000 7f53b1f9e700 1 --2- 172.21.15.80:0/3824131556 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5390018730 0x7f539001abe0 crc :-1 s=READY pgs=782 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:37.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.262+0000 7f53b3a01700 1 -- 172.21.15.80:0/3824131556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ac109180 con 0x7f53ac13e320 2019-11-28T11:48:37.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.265+0000 7f53b179d700 1 --2- 172.21.15.80:0/3824131556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac13e320 0x7f53ac13e7b0 secure :-1 s=THROTTLE_DONE pgs=1938 cs=0 l=1 rx=0x7f53940106f0 tx=0x7f5394010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.265+0000 7f53aa7fc700 1 -- 172.21.15.80:0/3824131556 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f539400b750 con 0x7f53ac13e320 2019-11-28T11:48:37.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.441+0000 7f53b3a01700 1 -- 172.21.15.80:0/3824131556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53ac109500 con 0x7f53ac13e320 2019-11-28T11:48:37.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.442+0000 7f53b179d700 1 --2- 172.21.15.80:0/3824131556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac13e320 0x7f53ac13e7b0 secure :-1 s=THROTTLE_DONE pgs=1938 cs=0 l=1 rx=0x7f53940106f0 tx=0x7f5394010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.442+0000 7f53aa7fc700 1 -- 172.21.15.80:0/3824131556 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+14884 (secure 0 0 0) 0x7f5394021480 con 0x7f53ac13e320 2019-11-28T11:48:37.489 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:37.489 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":151,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:48:37.109661+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:48:35.444932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2019-11-28T11:48:36.133221+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:48:37.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.444+0000 7f53b3a01700 1 -- 172.21.15.80:0/3824131556 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5390018730 msgr2=0x7f539001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.444+0000 7f53b3a01700 1 --2- 172.21.15.80:0/3824131556 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5390018730 0x7f539001abe0 crc :-1 s=READY pgs=782 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:37.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.444+0000 7f53b3a01700 1 -- 172.21.15.80:0/3824131556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac13e320 msgr2=0x7f53ac13e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.444+0000 7f53b3a01700 1 --2- 172.21.15.80:0/3824131556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac13e320 0x7f53ac13e7b0 secure :-1 s=READY pgs=1938 cs=0 l=1 rx=0x7f53940106f0 tx=0x7f5394010a90).stop 2019-11-28T11:48:37.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.444+0000 7f53b3a01700 1 -- 172.21.15.80:0/3824131556 shutdown_connections 2019-11-28T11:48:37.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.444+0000 7f53b3a01700 1 --2- 172.21.15.80:0/3824131556 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5390018730 0x7f539001abe0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:37.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.444+0000 7f53b3a01700 1 --2- 172.21.15.80:0/3824131556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53ac13e320 0x7f53ac13e7b0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:37.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.444+0000 7f53b3a01700 1 -- 172.21.15.80:0/3824131556 shutdown_connections 2019-11-28T11:48:37.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.445+0000 7f53b3a01700 1 -- 172.21.15.80:0/3824131556 wait complete. 2019-11-28T11:48:37.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.445+0000 7f53b3a01700 1 -- 172.21.15.80:0/3824131556 >> 172.21.15.80:0/3824131556 conn(0x7f53ac127dc0 msgr2=0x7f53ac141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:37.508 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:48:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.582+0000 7fd4556bb700 1 Processor -- start 2019-11-28T11:48:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.582+0000 7fd4556bb700 1 -- start start 2019-11-28T11:48:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd4556bb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd45006c490 0x7fd45006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:37.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd4556bb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd45006ce60 0x7fd450164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd4556bb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45006db00 con 0x7fd45006c0a0 2019-11-28T11:48:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd4556bb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45006fd60 con 0x7fd45006ce60 2019-11-28T11:48:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd4556bb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd450070030 con 0x7fd45006c490 2019-11-28T11:48:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd45006ce60 0x7fd450164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd45006ce60 0x7fd450164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41386/0 (socket says 172.21.15.80:41386) 2019-11-28T11:48:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44ffff700 1 -- 172.21.15.80:0/3750162370 learned_addr learned my addr 172.21.15.80:0/3750162370 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:37.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44effd700 1 --2- 172.21.15.80:0/3750162370 >> v2:172.21.15.174:3300/0 conn(0x7fd45006c490 0x7fd45006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:37.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44ffff700 1 -- 172.21.15.80:0/3750162370 >> v2:172.21.15.174:3300/0 conn(0x7fd45006c490 msgr2=0x7fd45006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:37.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44ffff700 1 --2- 172.21.15.80:0/3750162370 >> v2:172.21.15.174:3300/0 conn(0x7fd45006c490 0x7fd45006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:37.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44ffff700 1 -- 172.21.15.80:0/3750162370 >> v1:172.21.15.80:6789/0 conn(0x7fd45006c0a0 legacy=0x7fd450072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44ffff700 1 -- 172.21.15.80:0/3750162370 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4500706c0 con 0x7fd45006ce60 2019-11-28T11:48:37.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44e7fc700 1 -- 172.21.15.80:0/3750162370 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030246227 0 0) 0x7fd440001100 con 0x7fd45006c0a0 2019-11-28T11:48:37.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44ffff700 1 --2- 172.21.15.80:0/3750162370 >> v2:172.21.15.80:3300/0 conn(0x7fd45006ce60 0x7fd450164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd44800fa30 tx=0x7fd44800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44ffff700 1 --2- 172.21.15.80:0/3750162370 >> v2:172.21.15.80:3300/0 conn(0x7fd45006ce60 0x7fd450164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd44800fa30 tx=0x7fd44800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44ffff700 1 --2- 172.21.15.80:0/3750162370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45006ce60 0x7fd450164d70 secure :-1 s=READY pgs=1940 cs=0 l=1 rx=0x7fd44800fa30 tx=0x7fd44800fdd0).ready entity=mon.0 client_cookie=cfcd616b2a3b4f92 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:37.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44ffff700 1 --2- 172.21.15.80:0/3750162370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45006ce60 0x7fd450164d70 secure :-1 s=THROTTLE_DONE pgs=1940 cs=0 l=1 rx=0x7fd44800fa30 tx=0x7fd44800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44e7fc700 1 -- 172.21.15.80:0/3750162370 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd448000df0 con 0x7fd45006ce60 2019-11-28T11:48:37.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44ffff700 1 --2- 172.21.15.80:0/3750162370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45006ce60 0x7fd450164d70 secure :-1 s=THROTTLE_DONE pgs=1940 cs=0 l=1 rx=0x7fd44800fa30 tx=0x7fd44800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44e7fc700 1 -- 172.21.15.80:0/3750162370 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd448001460 con 0x7fd45006ce60 2019-11-28T11:48:37.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44ffff700 1 --2- 172.21.15.80:0/3750162370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45006ce60 0x7fd450164d70 secure :-1 s=THROTTLE_DONE pgs=1940 cs=0 l=1 rx=0x7fd44800fa30 tx=0x7fd44800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd44e7fc700 1 -- 172.21.15.80:0/3750162370 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd448001650 con 0x7fd45006ce60 2019-11-28T11:48:37.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd4556bb700 1 -- 172.21.15.80:0/3750162370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45006ce60 msgr2=0x7fd450164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.583+0000 7fd4556bb700 1 --2- 172.21.15.80:0/3750162370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45006ce60 0x7fd450164d70 secure :-1 s=READY pgs=1940 cs=0 l=1 rx=0x7fd44800fa30 tx=0x7fd44800fdd0).stop 2019-11-28T11:48:37.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.584+0000 7fd4556bb700 1 -- 172.21.15.80:0/3750162370 shutdown_connections 2019-11-28T11:48:37.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.584+0000 7fd4556bb700 1 --2- 172.21.15.80:0/3750162370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45006ce60 0x7fd450164d70 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:37.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.584+0000 7fd4556bb700 1 --2- 172.21.15.80:0/3750162370 >> v2:172.21.15.174:3300/0 conn(0x7fd45006c490 0x7fd45006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:37.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.584+0000 7fd4556bb700 1 -- 172.21.15.80:0/3750162370 shutdown_connections 2019-11-28T11:48:37.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.584+0000 7fd4556bb700 1 -- 172.21.15.80:0/3750162370 wait complete. 2019-11-28T11:48:37.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.584+0000 7fd4556bb700 1 -- 172.21.15.80:0/3750162370 >> 172.21.15.80:0/3750162370 conn(0x7fd450061cf0 msgr2=0x7fd450064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:37.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.586+0000 7fd4556bb700 1 Processor -- start 2019-11-28T11:48:37.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.587+0000 7fd4556bb700 1 -- start start 2019-11-28T11:48:37.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd4556bb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd45013e5f0 0x7fd45015b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:37.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd4556bb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd45013e9e0 0x7fd45015a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:37.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd4556bb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd450118370 con 0x7fd45015bb60 2019-11-28T11:48:37.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd4556bb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45010da70 con 0x7fd45013e5f0 2019-11-28T11:48:37.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd4556bb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45010dd40 con 0x7fd45013e9e0 2019-11-28T11:48:37.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd44f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd45013e5f0 0x7fd45015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:37.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd44f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd45013e5f0 0x7fd45015b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41388/0 (socket says 172.21.15.80:41388) 2019-11-28T11:48:37.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd44f7fe700 1 -- 172.21.15.80:0/2391591297 learned_addr learned my addr 172.21.15.80:0/2391591297 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:37.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd44effd700 1 --2- 172.21.15.80:0/2391591297 >> v2:172.21.15.174:3300/0 conn(0x7fd45013e9e0 0x7fd45015a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:37.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd44f7fe700 1 -- 172.21.15.80:0/2391591297 >> v2:172.21.15.174:3300/0 conn(0x7fd45013e9e0 msgr2=0x7fd45015a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd44f7fe700 1 --2- 172.21.15.80:0/2391591297 >> v2:172.21.15.174:3300/0 conn(0x7fd45013e9e0 0x7fd45015a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:37.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd44f7fe700 1 -- 172.21.15.80:0/2391591297 >> v1:172.21.15.174:6789/0 conn(0x7fd45015bb60 legacy=0x7fd450158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd44f7fe700 1 -- 172.21.15.80:0/2391591297 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45010e3d0 con 0x7fd45013e5f0 2019-11-28T11:48:37.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd44f7fe700 1 --2- 172.21.15.80:0/2391591297 >> v2:172.21.15.80:3300/0 conn(0x7fd45013e5f0 0x7fd45015b620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd440010450 tx=0x7fd44000b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd44f7fe700 1 --2- 172.21.15.80:0/2391591297 >> v2:172.21.15.80:3300/0 conn(0x7fd45013e5f0 0x7fd45015b620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd440010450 tx=0x7fd44000b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd44f7fe700 1 --2- 172.21.15.80:0/2391591297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45013e5f0 0x7fd45015b620 secure :-1 s=READY pgs=1941 cs=0 l=1 rx=0x7fd440010450 tx=0x7fd44000b390).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:37.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd44f7fe700 1 --2- 172.21.15.80:0/2391591297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45013e5f0 0x7fd45015b620 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7fd440010450 tx=0x7fd44000b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd44f7fe700 1 --2- 172.21.15.80:0/2391591297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45013e5f0 0x7fd45015b620 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7fd440010450 tx=0x7fd44000b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd447fff700 1 -- 172.21.15.80:0/2391591297 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd440000ce0 con 0x7fd45013e5f0 2019-11-28T11:48:37.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd44f7fe700 1 --2- 172.21.15.80:0/2391591297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45013e5f0 0x7fd45015b620 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7fd440010450 tx=0x7fd44000b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd447fff700 1 -- 172.21.15.80:0/2391591297 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44000ef70 con 0x7fd45013e5f0 2019-11-28T11:48:37.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd4556bb700 1 -- 172.21.15.80:0/2391591297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45010e750 con 0x7fd45013e5f0 2019-11-28T11:48:37.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd447fff700 1 -- 172.21.15.80:0/2391591297 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd44000f600 con 0x7fd45013e5f0 2019-11-28T11:48:37.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.588+0000 7fd4556bb700 1 -- 172.21.15.80:0/2391591297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45010d560 con 0x7fd45013e5f0 2019-11-28T11:48:37.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.589+0000 7fd44f7fe700 1 --2- 172.21.15.80:0/2391591297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45013e5f0 0x7fd45015b620 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7fd440010450 tx=0x7fd44000b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.589+0000 7fd447fff700 1 -- 172.21.15.80:0/2391591297 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd44000f160 con 0x7fd45013e5f0 2019-11-28T11:48:37.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.589+0000 7fd44f7fe700 1 --2- 172.21.15.80:0/2391591297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45013e5f0 0x7fd45015b620 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7fd440010450 tx=0x7fd44000b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.589+0000 7fd447fff700 1 --2- 172.21.15.80:0/2391591297 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd434018730 0x7fd43401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:37.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.589+0000 7fd447fff700 1 -- 172.21.15.80:0/2391591297 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd440031b20 con 0x7fd45013e5f0 2019-11-28T11:48:37.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.589+0000 7fd44effd700 1 --2- 172.21.15.80:0/2391591297 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd434018730 0x7fd43401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:37.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.589+0000 7fd44effd700 1 --2- 172.21.15.80:0/2391591297 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd434018730 0x7fd43401abc0 crc :-1 s=READY pgs=783 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:37.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.597+0000 7fd4556bb700 1 -- 172.21.15.80:0/2391591297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45010e3d0 con 0x7fd45013e5f0 2019-11-28T11:48:37.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.600+0000 7fd44f7fe700 1 --2- 172.21.15.80:0/2391591297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45013e5f0 0x7fd45015b620 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7fd440010450 tx=0x7fd44000b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.600+0000 7fd447fff700 1 -- 172.21.15.80:0/2391591297 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd44000f8a0 con 0x7fd45013e5f0 2019-11-28T11:48:37.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.776+0000 7fd4556bb700 1 -- 172.21.15.80:0/2391591297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd45010e750 con 0x7fd45013e5f0 2019-11-28T11:48:37.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.777+0000 7fd44f7fe700 1 --2- 172.21.15.80:0/2391591297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45013e5f0 0x7fd45015b620 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7fd440010450 tx=0x7fd44000b390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.777+0000 7fd447fff700 1 -- 172.21.15.80:0/2391591297 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+14884 (secure 0 0 0) 0x7fd44000f160 con 0x7fd45013e5f0 2019-11-28T11:48:37.825 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:37.826 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":151,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:48:37.109661+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:48:35.444932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2019-11-28T11:48:36.133221+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:48:37.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.781+0000 7fd4556bb700 1 -- 172.21.15.80:0/2391591297 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd434018730 msgr2=0x7fd43401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.781+0000 7fd4556bb700 1 --2- 172.21.15.80:0/2391591297 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd434018730 0x7fd43401abc0 crc :-1 s=READY pgs=783 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:37.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.781+0000 7fd4556bb700 1 -- 172.21.15.80:0/2391591297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45013e5f0 msgr2=0x7fd45015b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.781+0000 7fd4556bb700 1 --2- 172.21.15.80:0/2391591297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45013e5f0 0x7fd45015b620 secure :-1 s=READY pgs=1941 cs=0 l=1 rx=0x7fd440010450 tx=0x7fd44000b390).stop 2019-11-28T11:48:37.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.781+0000 7fd4556bb700 1 -- 172.21.15.80:0/2391591297 shutdown_connections 2019-11-28T11:48:37.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.781+0000 7fd4556bb700 1 --2- 172.21.15.80:0/2391591297 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd434018730 0x7fd43401abc0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:37.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.781+0000 7fd4556bb700 1 --2- 172.21.15.80:0/2391591297 >> v2:172.21.15.174:3300/0 conn(0x7fd45013e9e0 0x7fd45015a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:37.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.781+0000 7fd4556bb700 1 --2- 172.21.15.80:0/2391591297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45013e5f0 0x7fd45015b620 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:37.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.781+0000 7fd4556bb700 1 -- 172.21.15.80:0/2391591297 shutdown_connections 2019-11-28T11:48:37.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.781+0000 7fd4556bb700 1 -- 172.21.15.80:0/2391591297 wait complete. 2019-11-28T11:48:37.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.781+0000 7fd4556bb700 1 -- 172.21.15.80:0/2391591297 >> 172.21.15.80:0/2391591297 conn(0x7fd45007c6e0 msgr2=0x7fd4501050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:37.838 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:48:37.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.916+0000 7f0dbc4e1700 1 Processor -- start 2019-11-28T11:48:37.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.916+0000 7f0dbc4e1700 1 -- start start 2019-11-28T11:48:37.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.917+0000 7f0dbc4e1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0db415f100 0x7f0db406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:37.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.917+0000 7f0dbc4e1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0db406c2f0 0x7f0db406c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:37.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.917+0000 7f0dbc4e1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db406db60 con 0x7f0db415ed10 2019-11-28T11:48:37.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.917+0000 7f0dbc4e1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db406fe00 con 0x7f0db406c2f0 2019-11-28T11:48:37.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.917+0000 7f0dbc4e1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40700d0 con 0x7f0db415f100 2019-11-28T11:48:37.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.917+0000 7f0dbb27f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0db406c2f0 0x7f0db406c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:37.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.917+0000 7f0dbb27f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0db406c2f0 0x7f0db406c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41400/0 (socket says 172.21.15.80:41400) 2019-11-28T11:48:37.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.917+0000 7f0dbaa7e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0db415ed10 0x7f0db4073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40712/0 (socket says 172.21.15.80:40712) 2019-11-28T11:48:37.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.917+0000 7f0dbb27f700 1 -- 172.21.15.80:0/1247620430 learned_addr learned my addr 172.21.15.80:0/1247620430 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:37.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0dba27d700 1 --2- 172.21.15.80:0/1247620430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0db415f100 0x7f0db406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:37.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0dbb27f700 1 -- 172.21.15.80:0/1247620430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0db415f100 msgr2=0x7f0db406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:37.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0dbb27f700 1 --2- 172.21.15.80:0/1247620430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0db415f100 0x7f0db406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:37.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0dbb27f700 1 -- 172.21.15.80:0/1247620430 >> v1:172.21.15.80:6789/0 conn(0x7f0db415ed10 legacy=0x7f0db4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0dbb27f700 1 -- 172.21.15.80:0/1247620430 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db4070760 con 0x7f0db406c2f0 2019-11-28T11:48:37.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0db9a7c700 1 -- 172.21.15.80:0/1247620430 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071779128 0 0) 0x7f0d9c001480 con 0x7f0db415ed10 2019-11-28T11:48:37.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0dba27d700 1 --2- 172.21.15.80:0/1247620430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0db415f100 0x7f0db406bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:48:37.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0dbb27f700 1 --2- 172.21.15.80:0/1247620430 >> v2:172.21.15.80:3300/0 conn(0x7f0db406c2f0 0x7f0db406c790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0dac00f730 tx=0x7f0dac00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0dbb27f700 1 --2- 172.21.15.80:0/1247620430 >> v2:172.21.15.80:3300/0 conn(0x7f0db406c2f0 0x7f0db406c790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0dac00f730 tx=0x7f0dac00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0dbb27f700 1 --2- 172.21.15.80:0/1247620430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0db406c2f0 0x7f0db406c790 secure :-1 s=READY pgs=1943 cs=0 l=1 rx=0x7f0dac00f730 tx=0x7f0dac00fad0).ready entity=mon.0 client_cookie=dbe24c16dc5d35af server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:37.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0dbb27f700 1 --2- 172.21.15.80:0/1247620430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0db406c2f0 0x7f0db406c790 secure :-1 s=THROTTLE_DONE pgs=1943 cs=0 l=1 rx=0x7f0dac00f730 tx=0x7f0dac00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0db9a7c700 1 -- 172.21.15.80:0/1247620430 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dac000b90 con 0x7f0db406c2f0 2019-11-28T11:48:37.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0dbb27f700 1 --2- 172.21.15.80:0/1247620430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0db406c2f0 0x7f0db406c790 secure :-1 s=THROTTLE_DONE pgs=1943 cs=0 l=1 rx=0x7f0dac00f730 tx=0x7f0dac00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0dbb27f700 1 --2- 172.21.15.80:0/1247620430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0db406c2f0 0x7f0db406c790 secure :-1 s=THROTTLE_DONE pgs=1943 cs=0 l=1 rx=0x7f0dac00f730 tx=0x7f0dac00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0db9a7c700 1 -- 172.21.15.80:0/1247620430 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac0010e0 con 0x7f0db406c2f0 2019-11-28T11:48:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0db9a7c700 1 -- 172.21.15.80:0/1247620430 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dac001830 con 0x7f0db406c2f0 2019-11-28T11:48:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0dbc4e1700 1 -- 172.21.15.80:0/1247620430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0db406c2f0 msgr2=0x7f0db406c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.918+0000 7f0dbc4e1700 1 --2- 172.21.15.80:0/1247620430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0db406c2f0 0x7f0db406c790 secure :-1 s=READY pgs=1943 cs=0 l=1 rx=0x7f0dac00f730 tx=0x7f0dac00fad0).stop 2019-11-28T11:48:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.919+0000 7f0dbc4e1700 1 -- 172.21.15.80:0/1247620430 shutdown_connections 2019-11-28T11:48:37.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.919+0000 7f0dbc4e1700 1 --2- 172.21.15.80:0/1247620430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0db406c2f0 0x7f0db406c790 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.919+0000 7f0dbc4e1700 1 --2- 172.21.15.80:0/1247620430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0db415f100 0x7f0db406bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.919+0000 7f0dbc4e1700 1 -- 172.21.15.80:0/1247620430 shutdown_connections 2019-11-28T11:48:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.919+0000 7f0dbc4e1700 1 -- 172.21.15.80:0/1247620430 wait complete. 2019-11-28T11:48:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.919+0000 7f0dbc4e1700 1 -- 172.21.15.80:0/1247620430 >> 172.21.15.80:0/1247620430 conn(0x7f0db4061d20 msgr2=0x7f0db40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.921+0000 7f0dbc4e1700 1 Processor -- start 2019-11-28T11:48:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.921+0000 7f0dbc4e1700 1 -- start start 2019-11-28T11:48:37.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.922+0000 7f0dbc4e1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0db415faf0 0x7f0db41573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.922+0000 7f0dbc4e1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db4104420 con 0x7f0db41578e0 2019-11-28T11:48:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.922+0000 7f0dbc4e1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db4104a80 con 0x7f0db4148840 2019-11-28T11:48:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.922+0000 7f0dbc4e1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db4111980 con 0x7f0db415faf0 2019-11-28T11:48:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.922+0000 7f0dba27d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0db41578e0 0x7f0db4148040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40720/0 (socket says 172.21.15.80:40720) 2019-11-28T11:48:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.922+0000 7f0dba27d700 1 -- 172.21.15.80:0/3694616631 learned_addr learned my addr 172.21.15.80:0/3694616631 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.922+0000 7f0dbaa7e700 1 --2- 172.21.15.80:0/3694616631 >> v2:172.21.15.174:3300/0 conn(0x7f0db415faf0 0x7f0db41573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:37.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.922+0000 7f0db37fe700 1 -- 172.21.15.80:0/3694616631 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487689361 0 0) 0x7f0da4009c90 con 0x7f0db41578e0 2019-11-28T11:48:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.922+0000 7f0db37fe700 1 -- 172.21.15.80:0/3694616631 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d98002e80 con 0x7f0db41578e0 2019-11-28T11:48:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0db37fe700 1 -- 172.21.15.80:0/3694616631 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1049326150 0 0) 0x7f0da4000d50 con 0x7f0db41578e0 2019-11-28T11:48:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0db37fe700 1 -- 172.21.15.80:0/3694616631 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0d980032e0 con 0x7f0db41578e0 2019-11-28T11:48:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0db37fe700 1 -- 172.21.15.80:0/3694616631 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f0da4001320 con 0x7f0db41578e0 2019-11-28T11:48:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0dbaa7e700 1 -- 172.21.15.80:0/3694616631 >> v1:172.21.15.174:6789/0 conn(0x7f0db4148840 legacy=0x7f0db4156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0dbaa7e700 1 -- 172.21.15.80:0/3694616631 >> v1:172.21.15.80:6789/0 conn(0x7f0db41578e0 legacy=0x7f0db4148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:37.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0dbaa7e700 1 -- 172.21.15.80:0/3694616631 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db41122e0 con 0x7f0db415faf0 2019-11-28T11:48:37.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0dbaa7e700 1 --2- 172.21.15.80:0/3694616631 >> v2:172.21.15.174:3300/0 conn(0x7f0db415faf0 0x7f0db41573a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0d9c0106f0 tx=0x7f0d9c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0dbaa7e700 1 --2- 172.21.15.80:0/3694616631 >> v2:172.21.15.174:3300/0 conn(0x7f0db415faf0 0x7f0db41573a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0d9c0106f0 tx=0x7f0d9c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0dbaa7e700 1 --2- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0db415faf0 0x7f0db41573a0 secure :-1 s=READY pgs=1131 cs=0 l=1 rx=0x7f0d9c0106f0 tx=0x7f0d9c010a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:37.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0dbaa7e700 1 --2- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0db415faf0 0x7f0db41573a0 secure :-1 s=THROTTLE_DONE pgs=1131 cs=0 l=1 rx=0x7f0d9c0106f0 tx=0x7f0d9c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0db37fe700 1 -- 172.21.15.80:0/3694616631 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d9c0045c0 con 0x7f0db415faf0 2019-11-28T11:48:37.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0dbaa7e700 1 --2- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0db415faf0 0x7f0db41573a0 secure :-1 s=THROTTLE_DONE pgs=1131 cs=0 l=1 rx=0x7f0d9c0106f0 tx=0x7f0d9c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0dbc4e1700 1 -- 172.21.15.80:0/3694616631 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db4112660 con 0x7f0db415faf0 2019-11-28T11:48:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0db37fe700 1 -- 172.21.15.80:0/3694616631 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c001010 con 0x7f0db415faf0 2019-11-28T11:48:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0dbaa7e700 1 --2- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0db415faf0 0x7f0db41573a0 secure :-1 s=THROTTLE_DONE pgs=1131 cs=0 l=1 rx=0x7f0d9c0106f0 tx=0x7f0d9c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0db37fe700 1 -- 172.21.15.80:0/3694616631 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d9c0049a0 con 0x7f0db415faf0 2019-11-28T11:48:37.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0dbc4e1700 1 -- 172.21.15.80:0/3694616631 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db41122e0 con 0x7f0db415faf0 2019-11-28T11:48:37.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.923+0000 7f0dbaa7e700 1 --2- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0db415faf0 0x7f0db41573a0 secure :-1 s=THROTTLE_DONE pgs=1131 cs=0 l=1 rx=0x7f0d9c0106f0 tx=0x7f0d9c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.924+0000 7f0db37fe700 1 -- 172.21.15.80:0/3694616631 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0d9c0045c0 con 0x7f0db415faf0 2019-11-28T11:48:37.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.924+0000 7f0dbaa7e700 1 --2- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0db415faf0 0x7f0db41573a0 secure :-1 s=THROTTLE_DONE pgs=1131 cs=0 l=1 rx=0x7f0d9c0106f0 tx=0x7f0d9c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.924+0000 7f0db37fe700 1 --2- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d98018770 0x7f0d9801ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:37.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.924+0000 7f0db37fe700 1 -- 172.21.15.80:0/3694616631 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0d9c031df0 con 0x7f0db415faf0 2019-11-28T11:48:37.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.924+0000 7f0dba27d700 1 --2- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d98018770 0x7f0d9801ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:37.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.924+0000 7f0dba27d700 1 --2- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d98018770 0x7f0d9801ac00 crc :-1 s=READY pgs=784 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:37.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.932+0000 7f0dbc4e1700 1 -- 172.21.15.80:0/3694616631 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db4112660 con 0x7f0db415faf0 2019-11-28T11:48:37.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.936+0000 7f0dbaa7e700 1 --2- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0db415faf0 0x7f0db41573a0 secure :-1 s=THROTTLE_DONE pgs=1131 cs=0 l=1 rx=0x7f0d9c0106f0 tx=0x7f0d9c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:37.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:37.936+0000 7f0db37fe700 1 -- 172.21.15.80:0/3694616631 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0d9c0015a0 con 0x7f0db415faf0 2019-11-28T11:48:38.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.109+0000 7f0dbc4e1700 1 -- 172.21.15.80:0/3694616631 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f0db41122e0 con 0x7f0db415faf0 2019-11-28T11:48:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.781+0000 7f0dbaa7e700 1 --2- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0db415faf0 0x7f0db41573a0 secure :-1 s=THROTTLE_DONE pgs=1131 cs=0 l=1 rx=0x7f0d9c0106f0 tx=0x7f0d9c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:38.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.781+0000 7f0db37fe700 1 -- 172.21.15.80:0/3694616631 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v112) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0d9c0045c0 con 0x7f0db415faf0 2019-11-28T11:48:38.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.826+0000 7f0dbc4e1700 1 -- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d98018770 msgr2=0x7f0d9801ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:38.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.826+0000 7f0dbc4e1700 1 --2- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d98018770 0x7f0d9801ac00 crc :-1 s=READY pgs=784 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:38.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.826+0000 7f0dbc4e1700 1 -- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0db415faf0 msgr2=0x7f0db41573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:38.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.826+0000 7f0dbc4e1700 1 --2- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0db415faf0 0x7f0db41573a0 secure :-1 s=READY pgs=1131 cs=0 l=1 rx=0x7f0d9c0106f0 tx=0x7f0d9c010a90).stop 2019-11-28T11:48:38.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.826+0000 7f0dbc4e1700 1 -- 172.21.15.80:0/3694616631 shutdown_connections 2019-11-28T11:48:38.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.826+0000 7f0dbc4e1700 1 --2- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0d98018770 0x7f0d9801ac00 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:38.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.826+0000 7f0dbc4e1700 1 --2- 172.21.15.80:0/3694616631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0db415faf0 0x7f0db41573a0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:38.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.826+0000 7f0dbc4e1700 1 -- 172.21.15.80:0/3694616631 shutdown_connections 2019-11-28T11:48:38.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.826+0000 7f0dbc4e1700 1 -- 172.21.15.80:0/3694616631 wait complete. 2019-11-28T11:48:38.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.826+0000 7f0dbc4e1700 1 -- 172.21.15.80:0/3694616631 >> 172.21.15.80:0/3694616631 conn(0x7f0db407c4f0 msgr2=0x7f0db415ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:38.882 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:48:39.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.955+0000 7f0177553700 1 Processor -- start 2019-11-28T11:48:39.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.955+0000 7f0177553700 1 -- start start 2019-11-28T11:48:39.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f0177553700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f017006c490 0x7f017006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:39.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f0177553700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017006db00 con 0x7f017006c0a0 2019-11-28T11:48:39.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f0177553700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017006e000 con 0x7f017006ce60 2019-11-28T11:48:39.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f0177553700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017006fd60 con 0x7f017006c490 2019-11-28T11:48:39.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f0175af0700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f017006c0a0 0x7f0170072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40726/0 (socket says 172.21.15.80:40726) 2019-11-28T11:48:39.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f0175af0700 1 -- 172.21.15.80:0/928061667 learned_addr learned my addr 172.21.15.80:0/928061667 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:39.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f01752ef700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f017006c490 0x7f017006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f0174aee700 1 -- 172.21.15.80:0/928061667 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245726655 0 0) 0x7f01580014d0 con 0x7f017006c0a0 2019-11-28T11:48:39.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f0174aee700 1 -- 172.21.15.80:0/928061667 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f015c002e80 con 0x7f017006c0a0 2019-11-28T11:48:39.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f0174aee700 1 -- 172.21.15.80:0/928061667 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777868505 0 0) 0x7f01680009b0 con 0x7f017006ce60 2019-11-28T11:48:39.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f0174aee700 1 -- 172.21.15.80:0/928061667 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f015c0030b0 con 0x7f017006ce60 2019-11-28T11:48:39.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f0174aee700 1 -- 172.21.15.80:0/928061667 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3383159810 0 0) 0x7f01580014b0 con 0x7f017006c0a0 2019-11-28T11:48:39.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f0174aee700 1 -- 172.21.15.80:0/928061667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f017006c490 msgr2=0x7f017006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:39.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f0174aee700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f017006c490 0x7f017006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:39.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f0174aee700 1 -- 172.21.15.80:0/928061667 >> v1:172.21.15.174:6789/0 conn(0x7f017006ce60 legacy=0x7f0170164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f0174aee700 1 -- 172.21.15.80:0/928061667 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01700706c0 con 0x7f017006c0a0 2019-11-28T11:48:39.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f0174aee700 1 -- 172.21.15.80:0/928061667 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f01580019e0 con 0x7f017006c0a0 2019-11-28T11:48:39.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.956+0000 7f01752ef700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f017006c490 0x7f017006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:48:39.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f0174aee700 1 -- 172.21.15.80:0/928061667 >> v1:172.21.15.80:6789/0 conn(0x7f017006c0a0 legacy=0x7f0170072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f0174aee700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f015c003b80 0x7f015c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:39.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f0174aee700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015c006690 0x7f015c008b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:39.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f0174aee700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f015c04d310 0x7f015c04f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:39.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f0174aee700 1 -- 172.21.15.80:0/928061667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c04fff0 con 0x7f015c006690 2019-11-28T11:48:39.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f0174aee700 1 -- 172.21.15.80:0/928061667 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c0501e0 con 0x7f015c04d310 2019-11-28T11:48:39.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f0174aee700 1 -- 172.21.15.80:0/928061667 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c050410 con 0x7f015c003b80 2019-11-28T11:48:39.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f01752ef700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015c006690 0x7f015c008b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f0175af0700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f015c003b80 0x7f015c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f01762f1700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f015c04d310 0x7f015c04f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f01752ef700 1 -- 172.21.15.80:0/928061667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f015c003b80 msgr2=0x7f015c005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:39.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f01752ef700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f015c003b80 0x7f015c005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:39.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f01752ef700 1 -- 172.21.15.80:0/928061667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f015c04d310 msgr2=0x7f015c04f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:39.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f01752ef700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f015c04d310 0x7f015c04f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:39.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f01752ef700 1 -- 172.21.15.80:0/928061667 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c0506c0 con 0x7f015c006690 2019-11-28T11:48:39.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f01762f1700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f015c04d310 0x7f015c04f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:48:39.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f01752ef700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015c006690 0x7f015c008b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0160005b30 tx=0x7f01600062a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f01752ef700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015c006690 0x7f015c008b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0160005b30 tx=0x7f01600062a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f01752ef700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015c006690 0x7f015c008b00 secure :-1 s=READY pgs=1946 cs=0 l=1 rx=0x7f0160005b30 tx=0x7f01600062a0).ready entity=mon.0 client_cookie=5415cf97f78a26c9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:39.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f01752ef700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015c006690 0x7f015c008b00 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f0160005b30 tx=0x7f01600062a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f0174aee700 1 -- 172.21.15.80:0/928061667 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0160000940 con 0x7f015c006690 2019-11-28T11:48:39.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f01752ef700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015c006690 0x7f015c008b00 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f0160005b30 tx=0x7f01600062a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f01752ef700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015c006690 0x7f015c008b00 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f0160005b30 tx=0x7f01600062a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f0174aee700 1 -- 172.21.15.80:0/928061667 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0160009620 con 0x7f015c006690 2019-11-28T11:48:39.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f0174aee700 1 -- 172.21.15.80:0/928061667 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0160000940 con 0x7f015c006690 2019-11-28T11:48:39.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f0177553700 1 -- 172.21.15.80:0/928061667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015c006690 msgr2=0x7f015c008b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f0177553700 1 --2- 172.21.15.80:0/928061667 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015c006690 0x7f015c008b00 secure :-1 s=READY pgs=1946 cs=0 l=1 rx=0x7f0160005b30 tx=0x7f01600062a0).stop 2019-11-28T11:48:39.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.957+0000 7f01762f1700 1 -- 172.21.15.80:0/928061667 reap_dead start 2019-11-28T11:48:39.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.958+0000 7f0177553700 1 -- 172.21.15.80:0/928061667 shutdown_connections 2019-11-28T11:48:39.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.958+0000 7f0177553700 1 -- 172.21.15.80:0/928061667 shutdown_connections 2019-11-28T11:48:39.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.958+0000 7f0177553700 1 -- 172.21.15.80:0/928061667 wait complete. 2019-11-28T11:48:39.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.958+0000 7f0177553700 1 -- 172.21.15.80:0/928061667 >> 172.21.15.80:0/928061667 conn(0x7f0170061cf0 msgr2=0x7f0170064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:39.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.960+0000 7f0177553700 1 Processor -- start 2019-11-28T11:48:39.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.960+0000 7f0177553700 1 -- start start 2019-11-28T11:48:39.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.961+0000 7f0177553700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0170130850 0x7f0170130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:39.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.961+0000 7f0177553700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0170154d70 con 0x7f017013b650 2019-11-28T11:48:39.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.961+0000 7f0177553700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017010de30 con 0x7f0170131220 2019-11-28T11:48:39.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.961+0000 7f0177553700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01701554d0 con 0x7f0170130850 2019-11-28T11:48:39.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.961+0000 7f01752ef700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0170130850 0x7f0170130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.961+0000 7f0175af0700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f017013b650 0x7f01701318e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40738/0 (socket says 172.21.15.80:40738) 2019-11-28T11:48:39.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f0175af0700 1 -- 172.21.15.80:0/3004724743 learned_addr learned my addr 172.21.15.80:0/3004724743 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:39.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f01752ef700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0170130850 0x7f0170130ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41424/0 (socket says 172.21.15.80:41424) 2019-11-28T11:48:39.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f01752ef700 1 -- 172.21.15.80:0/3004724743 >> v1:172.21.15.174:6789/0 conn(0x7f0170131220 legacy=0x7f0170168d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f01752ef700 1 -- 172.21.15.80:0/3004724743 >> v1:172.21.15.80:6789/0 conn(0x7f017013b650 legacy=0x7f01701318e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f01752ef700 1 -- 172.21.15.80:0/3004724743 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0170155e30 con 0x7f0170130850 2019-11-28T11:48:39.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f016e7fc700 1 -- 172.21.15.80:0/3004724743 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811276076 0 0) 0x7f0158001490 con 0x7f017013b650 2019-11-28T11:48:39.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f01752ef700 1 --2- 172.21.15.80:0/3004724743 >> v2:172.21.15.80:3300/0 conn(0x7f0170130850 0x7f0170130ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0160010370 tx=0x7f0160010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f01752ef700 1 --2- 172.21.15.80:0/3004724743 >> v2:172.21.15.80:3300/0 conn(0x7f0170130850 0x7f0170130ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0160010370 tx=0x7f0160010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f01752ef700 1 --2- 172.21.15.80:0/3004724743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0170130850 0x7f0170130ce0 secure :-1 s=READY pgs=1948 cs=0 l=1 rx=0x7f0160010370 tx=0x7f0160010710).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:39.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f01752ef700 1 --2- 172.21.15.80:0/3004724743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0170130850 0x7f0170130ce0 secure :-1 s=THROTTLE_DONE pgs=1948 cs=0 l=1 rx=0x7f0160010370 tx=0x7f0160010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f016e7fc700 1 -- 172.21.15.80:0/3004724743 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0160000940 con 0x7f0170130850 2019-11-28T11:48:39.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f01752ef700 1 --2- 172.21.15.80:0/3004724743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0170130850 0x7f0170130ce0 secure :-1 s=THROTTLE_DONE pgs=1948 cs=0 l=1 rx=0x7f0160010370 tx=0x7f0160010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f01752ef700 1 --2- 172.21.15.80:0/3004724743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0170130850 0x7f0170130ce0 secure :-1 s=THROTTLE_DONE pgs=1948 cs=0 l=1 rx=0x7f0160010370 tx=0x7f0160010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f016e7fc700 1 -- 172.21.15.80:0/3004724743 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0160000c90 con 0x7f0170130850 2019-11-28T11:48:39.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f016e7fc700 1 -- 172.21.15.80:0/3004724743 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01600051a0 con 0x7f0170130850 2019-11-28T11:48:39.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f0177553700 1 -- 172.21.15.80:0/3004724743 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01701561b0 con 0x7f0170130850 2019-11-28T11:48:39.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f0177553700 1 -- 172.21.15.80:0/3004724743 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0170155e30 con 0x7f0170130850 2019-11-28T11:48:39.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.962+0000 7f01752ef700 1 --2- 172.21.15.80:0/3004724743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0170130850 0x7f0170130ce0 secure :-1 s=THROTTLE_DONE pgs=1948 cs=0 l=1 rx=0x7f0160010370 tx=0x7f0160010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.963+0000 7f016e7fc700 1 -- 172.21.15.80:0/3004724743 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0160000e80 con 0x7f0170130850 2019-11-28T11:48:39.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.963+0000 7f01752ef700 1 --2- 172.21.15.80:0/3004724743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0170130850 0x7f0170130ce0 secure :-1 s=THROTTLE_DONE pgs=1948 cs=0 l=1 rx=0x7f0160010370 tx=0x7f0160010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.963+0000 7f016e7fc700 1 --2- 172.21.15.80:0/3004724743 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0154018730 0x7f015401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:39.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.963+0000 7f016e7fc700 1 -- 172.21.15.80:0/3004724743 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0160031a60 con 0x7f0170130850 2019-11-28T11:48:39.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.963+0000 7f0175af0700 1 --2- 172.21.15.80:0/3004724743 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0154018730 0x7f015401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.963+0000 7f0175af0700 1 --2- 172.21.15.80:0/3004724743 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0154018730 0x7f015401abc0 crc :-1 s=READY pgs=785 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:39.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.970+0000 7f0177553700 1 -- 172.21.15.80:0/3004724743 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01701561b0 con 0x7f0170130850 2019-11-28T11:48:39.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.974+0000 7f01752ef700 1 --2- 172.21.15.80:0/3004724743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0170130850 0x7f0170130ce0 secure :-1 s=THROTTLE_DONE pgs=1948 cs=0 l=1 rx=0x7f0160010370 tx=0x7f0160010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:38.974+0000 7f016e7fc700 1 -- 172.21.15.80:0/3004724743 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0160000940 con 0x7f0170130850 2019-11-28T11:48:39.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.147+0000 7f0177553700 1 -- 172.21.15.80:0/3004724743 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0170155e30 con 0x7f0170130850 2019-11-28T11:48:39.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.147+0000 7f01752ef700 1 --2- 172.21.15.80:0/3004724743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0170130850 0x7f0170130ce0 secure :-1 s=THROTTLE_DONE pgs=1948 cs=0 l=1 rx=0x7f0160010370 tx=0x7f0160010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.147+0000 7f016e7fc700 1 -- 172.21.15.80:0/3004724743 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+1428 (secure 0 0 0) 0x7f01600179b0 con 0x7f0170130850 2019-11-28T11:48:39.194 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 112 2019-11-28T11:48:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:39.195 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":112,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:48:37.109829+0000","modified":"2019-11-28T11:48:38.778839+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2019-11-28T11:48:39.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.150+0000 7f0177553700 1 -- 172.21.15.80:0/3004724743 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0154018730 msgr2=0x7f015401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.150+0000 7f0177553700 1 --2- 172.21.15.80:0/3004724743 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0154018730 0x7f015401abc0 crc :-1 s=READY pgs=785 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.150+0000 7f0177553700 1 -- 172.21.15.80:0/3004724743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0170130850 msgr2=0x7f0170130ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.150+0000 7f0177553700 1 --2- 172.21.15.80:0/3004724743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0170130850 0x7f0170130ce0 secure :-1 s=READY pgs=1948 cs=0 l=1 rx=0x7f0160010370 tx=0x7f0160010710).stop 2019-11-28T11:48:39.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.150+0000 7f0177553700 1 -- 172.21.15.80:0/3004724743 shutdown_connections 2019-11-28T11:48:39.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.150+0000 7f0177553700 1 --2- 172.21.15.80:0/3004724743 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0154018730 0x7f015401abc0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.150+0000 7f0177553700 1 --2- 172.21.15.80:0/3004724743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0170130850 0x7f0170130ce0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.150+0000 7f0177553700 1 -- 172.21.15.80:0/3004724743 shutdown_connections 2019-11-28T11:48:39.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.150+0000 7f0177553700 1 -- 172.21.15.80:0/3004724743 wait complete. 2019-11-28T11:48:39.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.150+0000 7f0177553700 1 -- 172.21.15.80:0/3004724743 >> 172.21.15.80:0/3004724743 conn(0x7f0170142fc0 msgr2=0x7f0170157650 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:39.208 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:48:39.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.281+0000 7f5f25bf2700 1 Processor -- start 2019-11-28T11:48:39.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.281+0000 7f5f25bf2700 1 -- start start 2019-11-28T11:48:39.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f25bf2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f2006c0a0 0x7f5f20072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:39.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f25bf2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5f200734e0 0x7f5f20071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:39.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f25bf2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f20072360 0x7f5f20072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:39.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f25bf2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2006fd60 con 0x7f5f2006c0a0 2019-11-28T11:48:39.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f25bf2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f20070030 con 0x7f5f200734e0 2019-11-28T11:48:39.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f25bf2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2006f330 con 0x7f5f20072360 2019-11-28T11:48:39.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f2006c0a0 0x7f5f20072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f2006c0a0 0x7f5f20072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41430/0 (socket says 172.21.15.80:41430) 2019-11-28T11:48:39.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1ffff700 1 -- 172.21.15.80:0/2355282872 learned_addr learned my addr 172.21.15.80:0/2355282872 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:39.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f17fff700 1 --2- 172.21.15.80:0/2355282872 >> v2:172.21.15.174:3300/0 conn(0x7f5f200734e0 0x7f5f20071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f24990700 1 --2- 172.21.15.80:0/2355282872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f20072360 0x7f5f20072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1ffff700 1 -- 172.21.15.80:0/2355282872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f20072360 msgr2=0x7f5f20072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:39.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1ffff700 1 --2- 172.21.15.80:0/2355282872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f20072360 0x7f5f20072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1ffff700 1 -- 172.21.15.80:0/2355282872 >> v2:172.21.15.174:3300/0 conn(0x7f5f200734e0 msgr2=0x7f5f20071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1ffff700 1 --2- 172.21.15.80:0/2355282872 >> v2:172.21.15.174:3300/0 conn(0x7f5f200734e0 0x7f5f20071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1ffff700 1 -- 172.21.15.80:0/2355282872 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f200706c0 con 0x7f5f2006c0a0 2019-11-28T11:48:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1ffff700 1 --2- 172.21.15.80:0/2355282872 >> v2:172.21.15.80:3300/0 conn(0x7f5f2006c0a0 0x7f5f20072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5f1000f6c0 tx=0x7f5f1000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1ffff700 1 --2- 172.21.15.80:0/2355282872 >> v2:172.21.15.80:3300/0 conn(0x7f5f2006c0a0 0x7f5f20072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5f1000f6c0 tx=0x7f5f1000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1ffff700 1 --2- 172.21.15.80:0/2355282872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2006c0a0 0x7f5f20072fa0 secure :-1 s=READY pgs=1949 cs=0 l=1 rx=0x7f5f1000f6c0 tx=0x7f5f1000f570).ready entity=mon.0 client_cookie=78c84fa6eaab3f69 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:39.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1ffff700 1 --2- 172.21.15.80:0/2355282872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2006c0a0 0x7f5f20072fa0 secure :-1 s=THROTTLE_DONE pgs=1949 cs=0 l=1 rx=0x7f5f1000f6c0 tx=0x7f5f1000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1ffff700 1 --2- 172.21.15.80:0/2355282872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2006c0a0 0x7f5f20072fa0 secure :-1 s=THROTTLE_DONE pgs=1949 cs=0 l=1 rx=0x7f5f1000f6c0 tx=0x7f5f1000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1f7fe700 1 -- 172.21.15.80:0/2355282872 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f10000960 con 0x7f5f2006c0a0 2019-11-28T11:48:39.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1ffff700 1 --2- 172.21.15.80:0/2355282872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2006c0a0 0x7f5f20072fa0 secure :-1 s=THROTTLE_DONE pgs=1949 cs=0 l=1 rx=0x7f5f1000f6c0 tx=0x7f5f1000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1f7fe700 1 -- 172.21.15.80:0/2355282872 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f10000c90 con 0x7f5f2006c0a0 2019-11-28T11:48:39.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f1f7fe700 1 -- 172.21.15.80:0/2355282872 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f100013a0 con 0x7f5f2006c0a0 2019-11-28T11:48:39.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f25bf2700 1 -- 172.21.15.80:0/2355282872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2006c0a0 msgr2=0x7f5f20072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.282+0000 7f5f25bf2700 1 --2- 172.21.15.80:0/2355282872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2006c0a0 0x7f5f20072fa0 secure :-1 s=READY pgs=1949 cs=0 l=1 rx=0x7f5f1000f6c0 tx=0x7f5f1000f570).stop 2019-11-28T11:48:39.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.283+0000 7f5f25bf2700 1 -- 172.21.15.80:0/2355282872 shutdown_connections 2019-11-28T11:48:39.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.283+0000 7f5f25bf2700 1 --2- 172.21.15.80:0/2355282872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f20072360 0x7f5f20072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:39.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.283+0000 7f5f25bf2700 1 --2- 172.21.15.80:0/2355282872 >> v2:172.21.15.174:3300/0 conn(0x7f5f200734e0 0x7f5f20071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:39.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.283+0000 7f5f25bf2700 1 --2- 172.21.15.80:0/2355282872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2006c0a0 0x7f5f20072fa0 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.283+0000 7f5f25bf2700 1 -- 172.21.15.80:0/2355282872 shutdown_connections 2019-11-28T11:48:39.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.283+0000 7f5f25bf2700 1 -- 172.21.15.80:0/2355282872 wait complete. 2019-11-28T11:48:39.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.283+0000 7f5f25bf2700 1 -- 172.21.15.80:0/2355282872 >> 172.21.15.80:0/2355282872 conn(0x7f5f20061cf0 msgr2=0x7f5f20064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:39.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.286+0000 7f5f25bf2700 1 Processor -- start 2019-11-28T11:48:39.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.286+0000 7f5f25bf2700 1 -- start start 2019-11-28T11:48:39.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.286+0000 7f5f25bf2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5f2013e5f0 0x7f5f2013e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:39.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.286+0000 7f5f25bf2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f2010a070 0x7f5f2010bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:39.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f25bf2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f201066e0 con 0x7f5f2010a4e0 2019-11-28T11:48:39.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f25bf2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2010e060 con 0x7f5f2010a070 2019-11-28T11:48:39.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f25bf2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2010e330 con 0x7f5f2013e5f0 2019-11-28T11:48:39.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f17fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f2010a070 0x7f5f2010bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f17fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f2010a070 0x7f5f2010bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41436/0 (socket says 172.21.15.80:41436) 2019-11-28T11:48:39.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f17fff700 1 -- 172.21.15.80:0/2198858709 learned_addr learned my addr 172.21.15.80:0/2198858709 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:39.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f1ffff700 1 --2- 172.21.15.80:0/2198858709 >> v2:172.21.15.174:3300/0 conn(0x7f5f2013e5f0 0x7f5f2013e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f17fff700 1 -- 172.21.15.80:0/2198858709 >> v2:172.21.15.174:3300/0 conn(0x7f5f2013e5f0 msgr2=0x7f5f2013e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f17fff700 1 --2- 172.21.15.80:0/2198858709 >> v2:172.21.15.174:3300/0 conn(0x7f5f2013e5f0 0x7f5f2013e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f17fff700 1 -- 172.21.15.80:0/2198858709 >> v1:172.21.15.174:6789/0 conn(0x7f5f2010a4e0 legacy=0x7f5f2010c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f17fff700 1 -- 172.21.15.80:0/2198858709 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2010e9c0 con 0x7f5f2010a070 2019-11-28T11:48:39.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f17fff700 1 --2- 172.21.15.80:0/2198858709 >> v2:172.21.15.80:3300/0 conn(0x7f5f2010a070 0x7f5f2010bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5f08010450 tx=0x7f5f08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f17fff700 1 --2- 172.21.15.80:0/2198858709 >> v2:172.21.15.80:3300/0 conn(0x7f5f2010a070 0x7f5f2010bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5f08010450 tx=0x7f5f08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f17fff700 1 --2- 172.21.15.80:0/2198858709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2010a070 0x7f5f2010bdb0 secure :-1 s=READY pgs=1950 cs=0 l=1 rx=0x7f5f08010450 tx=0x7f5f08010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:39.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f17fff700 1 --2- 172.21.15.80:0/2198858709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2010a070 0x7f5f2010bdb0 secure :-1 s=THROTTLE_DONE pgs=1950 cs=0 l=1 rx=0x7f5f08010450 tx=0x7f5f08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f17fff700 1 --2- 172.21.15.80:0/2198858709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2010a070 0x7f5f2010bdb0 secure :-1 s=THROTTLE_DONE pgs=1950 cs=0 l=1 rx=0x7f5f08010450 tx=0x7f5f08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f17fff700 1 --2- 172.21.15.80:0/2198858709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2010a070 0x7f5f2010bdb0 secure :-1 s=THROTTLE_DONE pgs=1950 cs=0 l=1 rx=0x7f5f08010450 tx=0x7f5f08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f1d7fa700 1 -- 172.21.15.80:0/2198858709 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f08000940 con 0x7f5f2010a070 2019-11-28T11:48:39.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f1d7fa700 1 -- 172.21.15.80:0/2198858709 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f08000e80 con 0x7f5f2010a070 2019-11-28T11:48:39.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f25bf2700 1 -- 172.21.15.80:0/2198858709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2010ed40 con 0x7f5f2010a070 2019-11-28T11:48:39.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f1d7fa700 1 -- 172.21.15.80:0/2198858709 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f08001570 con 0x7f5f2010a070 2019-11-28T11:48:39.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.287+0000 7f5f25bf2700 1 -- 172.21.15.80:0/2198858709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2010e9c0 con 0x7f5f2010a070 2019-11-28T11:48:39.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.288+0000 7f5f17fff700 1 --2- 172.21.15.80:0/2198858709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2010a070 0x7f5f2010bdb0 secure :-1 s=THROTTLE_DONE pgs=1950 cs=0 l=1 rx=0x7f5f08010450 tx=0x7f5f08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.288+0000 7f5f1d7fa700 1 -- 172.21.15.80:0/2198858709 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5f08001070 con 0x7f5f2010a070 2019-11-28T11:48:39.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.288+0000 7f5f17fff700 1 --2- 172.21.15.80:0/2198858709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2010a070 0x7f5f2010bdb0 secure :-1 s=THROTTLE_DONE pgs=1950 cs=0 l=1 rx=0x7f5f08010450 tx=0x7f5f08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.288+0000 7f5f1d7fa700 1 --2- 172.21.15.80:0/2198858709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f04018730 0x7f5f0401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:39.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.288+0000 7f5f1d7fa700 1 -- 172.21.15.80:0/2198858709 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5f08031ad0 con 0x7f5f2010a070 2019-11-28T11:48:39.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.288+0000 7f5f1ffff700 1 --2- 172.21.15.80:0/2198858709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f04018730 0x7f5f0401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.288+0000 7f5f1ffff700 1 --2- 172.21.15.80:0/2198858709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f04018730 0x7f5f0401abc0 crc :-1 s=READY pgs=786 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:39.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.296+0000 7f5f25bf2700 1 -- 172.21.15.80:0/2198858709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2010ed40 con 0x7f5f2010a070 2019-11-28T11:48:39.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.299+0000 7f5f17fff700 1 --2- 172.21.15.80:0/2198858709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2010a070 0x7f5f2010bdb0 secure :-1 s=THROTTLE_DONE pgs=1950 cs=0 l=1 rx=0x7f5f08010450 tx=0x7f5f08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.299+0000 7f5f1d7fa700 1 -- 172.21.15.80:0/2198858709 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5f080092e0 con 0x7f5f2010a070 2019-11-28T11:48:39.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.473+0000 7f5f25bf2700 1 -- 172.21.15.80:0/2198858709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f2010e9c0 con 0x7f5f2010a070 2019-11-28T11:48:39.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.473+0000 7f5f17fff700 1 --2- 172.21.15.80:0/2198858709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2010a070 0x7f5f2010bdb0 secure :-1 s=THROTTLE_DONE pgs=1950 cs=0 l=1 rx=0x7f5f08010450 tx=0x7f5f08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.473+0000 7f5f1d7fa700 1 -- 172.21.15.80:0/2198858709 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f5f080175d0 con 0x7f5f2010a070 2019-11-28T11:48:39.520 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:39.521 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":152,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:48:38.111012+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:48:35.444932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2019-11-28T11:48:36.133221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:48:39.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.475+0000 7f5f25bf2700 1 -- 172.21.15.80:0/2198858709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f04018730 msgr2=0x7f5f0401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.475+0000 7f5f25bf2700 1 --2- 172.21.15.80:0/2198858709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f04018730 0x7f5f0401abc0 crc :-1 s=READY pgs=786 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.475+0000 7f5f25bf2700 1 -- 172.21.15.80:0/2198858709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2010a070 msgr2=0x7f5f2010bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.475+0000 7f5f25bf2700 1 --2- 172.21.15.80:0/2198858709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2010a070 0x7f5f2010bdb0 secure :-1 s=READY pgs=1950 cs=0 l=1 rx=0x7f5f08010450 tx=0x7f5f08010280).stop 2019-11-28T11:48:39.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.475+0000 7f5f25bf2700 1 -- 172.21.15.80:0/2198858709 shutdown_connections 2019-11-28T11:48:39.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.475+0000 7f5f25bf2700 1 --2- 172.21.15.80:0/2198858709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f04018730 0x7f5f0401abc0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.475+0000 7f5f25bf2700 1 --2- 172.21.15.80:0/2198858709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f2010a070 0x7f5f2010bdb0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.475+0000 7f5f25bf2700 1 --2- 172.21.15.80:0/2198858709 >> v2:172.21.15.174:3300/0 conn(0x7f5f2013e5f0 0x7f5f2013e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.475+0000 7f5f25bf2700 1 -- 172.21.15.80:0/2198858709 shutdown_connections 2019-11-28T11:48:39.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.475+0000 7f5f25bf2700 1 -- 172.21.15.80:0/2198858709 wait complete. 2019-11-28T11:48:39.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.475+0000 7f5f25bf2700 1 -- 172.21.15.80:0/2198858709 >> 172.21.15.80:0/2198858709 conn(0x7f5f2013d620 msgr2=0x7f5f2013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:39.533 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:48:39.534 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:48:39.534 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:48:39.535 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:48:39.536 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:48:39.537 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:48:39.542 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:48:39.543 DEBUG:teuthology.parallel:result is None 2019-11-28T11:48:39.544 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:48:39.544 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:48:39.545 DEBUG:teuthology.parallel:result is None 2019-11-28T11:48:39.545 DEBUG:teuthology.parallel:result is None 2019-11-28T11:48:39.545 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:48:39.634 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:48:39.634 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:48:39.634 INFO:tasks.ceph.mds.a.smithi080.stderr:2019-11-28T11:48:39.588+0000 7fc1701ec700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2019-11-28T11:48:39.637 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:48:39.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.635+0000 7ff53b606700 1 Processor -- start 2019-11-28T11:48:39.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.635+0000 7ff53b606700 1 -- start start 2019-11-28T11:48:39.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.636+0000 7ff53b606700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff53415ed10 0x7ff53415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:39.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.636+0000 7ff53b606700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53406db60 con 0x7ff534073020 2019-11-28T11:48:39.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.636+0000 7ff53b606700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53406e060 con 0x7ff5340734b0 2019-11-28T11:48:39.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.636+0000 7ff53b606700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53406fe00 con 0x7ff53415ed10 2019-11-28T11:48:39.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.636+0000 7ff5393a2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff534073020 0x7ff534071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40786/0 (socket says 172.21.15.80:40786) 2019-11-28T11:48:39.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff5393a2700 1 -- 172.21.15.80:0/1468814772 learned_addr learned my addr 172.21.15.80:0/1468814772 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:39.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1468814772 >> v2:172.21.15.174:3300/0 conn(0x7ff53415ed10 0x7ff53415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff538ba1700 1 -- 172.21.15.80:0/1468814772 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279325527 0 0) 0x7ff51c001070 con 0x7ff534073020 2019-11-28T11:48:39.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff538ba1700 1 -- 172.21.15.80:0/1468814772 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff520002e80 con 0x7ff534073020 2019-11-28T11:48:39.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff538ba1700 1 -- 172.21.15.80:0/1468814772 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166853909 0 0) 0x7ff52c000d30 con 0x7ff5340734b0 2019-11-28T11:48:39.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff538ba1700 1 -- 172.21.15.80:0/1468814772 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff520004170 con 0x7ff5340734b0 2019-11-28T11:48:39.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff539ba3700 1 -- 172.21.15.80:0/1468814772 >> v1:172.21.15.174:6789/0 conn(0x7ff5340734b0 legacy=0x7ff5340726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff539ba3700 1 -- 172.21.15.80:0/1468814772 >> v1:172.21.15.80:6789/0 conn(0x7ff534073020 legacy=0x7ff534071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff539ba3700 1 -- 172.21.15.80:0/1468814772 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534070760 con 0x7ff53415ed10 2019-11-28T11:48:39.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1468814772 >> v2:172.21.15.174:3300/0 conn(0x7ff53415ed10 0x7ff53415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff52400af50 tx=0x7ff52400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1468814772 >> v2:172.21.15.174:3300/0 conn(0x7ff53415ed10 0x7ff53415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff52400af50 tx=0x7ff52400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1468814772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff53415ed10 0x7ff53415f100 secure :-1 s=READY pgs=1143 cs=0 l=1 rx=0x7ff52400af50 tx=0x7ff52400b760).ready entity=mon.1 client_cookie=2134013eb5abfcec server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:39.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1468814772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff53415ed10 0x7ff53415f100 secure :-1 s=THROTTLE_DONE pgs=1143 cs=0 l=1 rx=0x7ff52400af50 tx=0x7ff52400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff538ba1700 1 -- 172.21.15.80:0/1468814772 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff524000960 con 0x7ff53415ed10 2019-11-28T11:48:39.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1468814772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff53415ed10 0x7ff53415f100 secure :-1 s=THROTTLE_DONE pgs=1143 cs=0 l=1 rx=0x7ff52400af50 tx=0x7ff52400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1468814772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff53415ed10 0x7ff53415f100 secure :-1 s=THROTTLE_DONE pgs=1143 cs=0 l=1 rx=0x7ff52400af50 tx=0x7ff52400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff538ba1700 1 -- 172.21.15.80:0/1468814772 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff524009860 con 0x7ff53415ed10 2019-11-28T11:48:39.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff538ba1700 1 -- 172.21.15.80:0/1468814772 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff524009f30 con 0x7ff53415ed10 2019-11-28T11:48:39.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff53b606700 1 -- 172.21.15.80:0/1468814772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff53415ed10 msgr2=0x7ff53415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.637+0000 7ff53b606700 1 --2- 172.21.15.80:0/1468814772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff53415ed10 0x7ff53415f100 secure :-1 s=READY pgs=1143 cs=0 l=1 rx=0x7ff52400af50 tx=0x7ff52400b760).stop 2019-11-28T11:48:39.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.638+0000 7ff53b606700 1 -- 172.21.15.80:0/1468814772 shutdown_connections 2019-11-28T11:48:39.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.638+0000 7ff53b606700 1 --2- 172.21.15.80:0/1468814772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff53415ed10 0x7ff53415f100 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.638+0000 7ff53b606700 1 -- 172.21.15.80:0/1468814772 shutdown_connections 2019-11-28T11:48:39.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.638+0000 7ff53b606700 1 -- 172.21.15.80:0/1468814772 wait complete. 2019-11-28T11:48:39.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.638+0000 7ff53b606700 1 -- 172.21.15.80:0/1468814772 >> 172.21.15.80:0/1468814772 conn(0x7ff534061d40 msgr2=0x7ff5340641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:39.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.640+0000 7ff53b606700 1 Processor -- start 2019-11-28T11:48:39.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.641+0000 7ff53b606700 1 -- start start 2019-11-28T11:48:39.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.641+0000 7ff53b606700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff534152750 0x7ff534135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:39.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.641+0000 7ff53b606700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff534130dc0 0x7ff534131250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:39.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.641+0000 7ff53b606700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff534131790 0x7ff534134610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.641+0000 7ff53b606700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff534132570 con 0x7ff534152750 2019-11-28T11:48:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.641+0000 7ff53b606700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff534132840 con 0x7ff534130dc0 2019-11-28T11:48:39.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.641+0000 7ff53b606700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53410a460 con 0x7ff534131790 2019-11-28T11:48:39.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.641+0000 7ff539ba3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff534152750 0x7ff534135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.641+0000 7ff539ba3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff534152750 0x7ff534135790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41472/0 (socket says 172.21.15.80:41472) 2019-11-28T11:48:39.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.641+0000 7ff539ba3700 1 -- 172.21.15.80:0/1568147809 learned_addr learned my addr 172.21.15.80:0/1568147809 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:39.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff53a3a4700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff534131790 0x7ff534134610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff5393a2700 1 --2- 172.21.15.80:0/1568147809 >> v2:172.21.15.174:3300/0 conn(0x7ff534130dc0 0x7ff534131250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff539ba3700 1 -- 172.21.15.80:0/1568147809 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff534131790 msgr2=0x7ff534134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff534131790 0x7ff534134610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff539ba3700 1 -- 172.21.15.80:0/1568147809 >> v2:172.21.15.174:3300/0 conn(0x7ff534130dc0 msgr2=0x7ff534131250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1568147809 >> v2:172.21.15.174:3300/0 conn(0x7ff534130dc0 0x7ff534131250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff539ba3700 1 -- 172.21.15.80:0/1568147809 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534132ed0 con 0x7ff534152750 2019-11-28T11:48:39.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1568147809 >> v2:172.21.15.80:3300/0 conn(0x7ff534152750 0x7ff534135790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff524010420 tx=0x7ff5240102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1568147809 >> v2:172.21.15.80:3300/0 conn(0x7ff534152750 0x7ff534135790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff524010420 tx=0x7ff5240102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=READY pgs=1957 cs=0 l=1 rx=0x7ff524010420 tx=0x7ff5240102d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:39.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=THROTTLE_DONE pgs=1957 cs=0 l=1 rx=0x7ff524010420 tx=0x7ff5240102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff5327fc700 1 -- 172.21.15.80:0/1568147809 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff524000940 con 0x7ff534152750 2019-11-28T11:48:39.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=THROTTLE_DONE pgs=1957 cs=0 l=1 rx=0x7ff524010420 tx=0x7ff5240102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff5327fc700 1 -- 172.21.15.80:0/1568147809 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff524009980 con 0x7ff534152750 2019-11-28T11:48:39.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=THROTTLE_DONE pgs=1957 cs=0 l=1 rx=0x7ff524010420 tx=0x7ff5240102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff53b606700 1 -- 172.21.15.80:0/1568147809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff534133250 con 0x7ff534152750 2019-11-28T11:48:39.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff5327fc700 1 -- 172.21.15.80:0/1568147809 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff524009b70 con 0x7ff534152750 2019-11-28T11:48:39.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff53b606700 1 -- 172.21.15.80:0/1568147809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff534132ed0 con 0x7ff534152750 2019-11-28T11:48:39.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.642+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=THROTTLE_DONE pgs=1957 cs=0 l=1 rx=0x7ff524010420 tx=0x7ff5240102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.643+0000 7ff5327fc700 1 -- 172.21.15.80:0/1568147809 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff524009580 con 0x7ff534152750 2019-11-28T11:48:39.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.643+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=THROTTLE_DONE pgs=1957 cs=0 l=1 rx=0x7ff524010420 tx=0x7ff5240102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.643+0000 7ff5327fc700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff518018730 0x7ff51801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:39.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.643+0000 7ff5327fc700 1 -- 172.21.15.80:0/1568147809 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff524031cb0 con 0x7ff534152750 2019-11-28T11:48:39.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.643+0000 7ff5393a2700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff518018730 0x7ff51801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:39.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.643+0000 7ff5393a2700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff518018730 0x7ff51801abe0 crc :-1 s=READY pgs=787 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:39.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.651+0000 7ff53b606700 1 -- 172.21.15.80:0/1568147809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff534133250 con 0x7ff534152750 2019-11-28T11:48:39.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.654+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=THROTTLE_DONE pgs=1957 cs=0 l=1 rx=0x7ff524010420 tx=0x7ff5240102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.654+0000 7ff5327fc700 1 -- 172.21.15.80:0/1568147809 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff524000940 con 0x7ff534152750 2019-11-28T11:48:39.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.826+0000 7ff53b606700 1 -- 172.21.15.80:0/1568147809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff534132ed0 con 0x7ff534152750 2019-11-28T11:48:39.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.829+0000 7ff539ba3700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=THROTTLE_DONE pgs=1957 cs=0 l=1 rx=0x7ff524010420 tx=0x7ff5240102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:39.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.829+0000 7ff5327fc700 1 -- 172.21.15.80:0/1568147809 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v52) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff524017550 con 0x7ff534152750 2019-11-28T11:48:39.876 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:48:39.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.832+0000 7ff53b606700 1 -- 172.21.15.80:0/1568147809 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff518018730 msgr2=0x7ff51801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.832+0000 7ff53b606700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff518018730 0x7ff51801abe0 crc :-1 s=READY pgs=787 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.832+0000 7ff53b606700 1 -- 172.21.15.80:0/1568147809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534152750 msgr2=0x7ff534135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:39.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.832+0000 7ff53b606700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534152750 0x7ff534135790 secure :-1 s=READY pgs=1957 cs=0 l=1 rx=0x7ff524010420 tx=0x7ff5240102d0).stop 2019-11-28T11:48:39.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.832+0000 7ff53b606700 1 -- 172.21.15.80:0/1568147809 shutdown_connections 2019-11-28T11:48:39.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.832+0000 7ff53b606700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff518018730 0x7ff51801abe0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.832+0000 7ff53b606700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff534131790 0x7ff534134610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.832+0000 7ff53b606700 1 --2- 172.21.15.80:0/1568147809 >> v2:172.21.15.174:3300/0 conn(0x7ff534130dc0 0x7ff534131250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.832+0000 7ff53b606700 1 --2- 172.21.15.80:0/1568147809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff534152750 0x7ff534135790 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:39.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.832+0000 7ff53b606700 1 -- 172.21.15.80:0/1568147809 shutdown_connections 2019-11-28T11:48:39.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.832+0000 7ff53b606700 1 -- 172.21.15.80:0/1568147809 wait complete. 2019-11-28T11:48:39.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.832+0000 7ff53b606700 1 -- 172.21.15.80:0/1568147809 >> 172.21.15.80:0/1568147809 conn(0x7ff5341476e0 msgr2=0x7ff53412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:39.888 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:48:40.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.974+0000 7f3446b53700 1 Processor -- start 2019-11-28T11:48:40.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.974+0000 7f3446b53700 1 -- start start 2019-11-28T11:48:40.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.975+0000 7f3446b53700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f344015ed10 0x7f344015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:40.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.975+0000 7f3446b53700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344006db60 con 0x7f3440073020 2019-11-28T11:48:40.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.975+0000 7f3446b53700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344006e060 con 0x7f34400734b0 2019-11-28T11:48:40.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.975+0000 7f3446b53700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344006fe00 con 0x7f344015ed10 2019-11-28T11:48:40.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.975+0000 7f34450f0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f344015ed10 0x7f344015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:40.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.975+0000 7f34448ef700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3440073020 0x7f3440071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40800/0 (socket says 172.21.15.80:40800) 2019-11-28T11:48:40.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.975+0000 7f34448ef700 1 -- 172.21.15.80:0/2440185300 learned_addr learned my addr 172.21.15.80:0/2440185300 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:40.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.975+0000 7f34450f0700 1 -- 172.21.15.80:0/2440185300 >> v1:172.21.15.174:6789/0 conn(0x7f34400734b0 legacy=0x7f34400726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.976+0000 7f34450f0700 1 -- 172.21.15.80:0/2440185300 >> v1:172.21.15.80:6789/0 conn(0x7f3440073020 legacy=0x7f3440071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.976+0000 7f34450f0700 1 -- 172.21.15.80:0/2440185300 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3440070760 con 0x7f344015ed10 2019-11-28T11:48:40.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.976+0000 7f343ffff700 1 -- 172.21.15.80:0/2440185300 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555368825 0 0) 0x7f34300013f0 con 0x7f3440073020 2019-11-28T11:48:40.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.976+0000 7f34450f0700 1 --2- 172.21.15.80:0/2440185300 >> v2:172.21.15.80:3300/0 conn(0x7f344015ed10 0x7f344015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f342800af50 tx=0x7f342800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.976+0000 7f34450f0700 1 --2- 172.21.15.80:0/2440185300 >> v2:172.21.15.80:3300/0 conn(0x7f344015ed10 0x7f344015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f342800af50 tx=0x7f342800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.976+0000 7f34450f0700 1 --2- 172.21.15.80:0/2440185300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f344015ed10 0x7f344015f100 secure :-1 s=READY pgs=1959 cs=0 l=1 rx=0x7f342800af50 tx=0x7f342800b760).ready entity=mon.0 client_cookie=77b569a26f807382 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.976+0000 7f34450f0700 1 --2- 172.21.15.80:0/2440185300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f344015ed10 0x7f344015f100 secure :-1 s=THROTTLE_DONE pgs=1959 cs=0 l=1 rx=0x7f342800af50 tx=0x7f342800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.976+0000 7f34450f0700 1 --2- 172.21.15.80:0/2440185300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f344015ed10 0x7f344015f100 secure :-1 s=THROTTLE_DONE pgs=1959 cs=0 l=1 rx=0x7f342800af50 tx=0x7f342800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.976+0000 7f343ffff700 1 -- 172.21.15.80:0/2440185300 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3428000960 con 0x7f344015ed10 2019-11-28T11:48:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.976+0000 7f34450f0700 1 --2- 172.21.15.80:0/2440185300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f344015ed10 0x7f344015f100 secure :-1 s=THROTTLE_DONE pgs=1959 cs=0 l=1 rx=0x7f342800af50 tx=0x7f342800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.976+0000 7f343ffff700 1 -- 172.21.15.80:0/2440185300 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3428009860 con 0x7f344015ed10 2019-11-28T11:48:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.976+0000 7f343ffff700 1 -- 172.21.15.80:0/2440185300 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3428009f30 con 0x7f344015ed10 2019-11-28T11:48:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.976+0000 7f3446b53700 1 -- 172.21.15.80:0/2440185300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f344015ed10 msgr2=0x7f344015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.976+0000 7f3446b53700 1 --2- 172.21.15.80:0/2440185300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f344015ed10 0x7f344015f100 secure :-1 s=READY pgs=1959 cs=0 l=1 rx=0x7f342800af50 tx=0x7f342800b760).stop 2019-11-28T11:48:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.977+0000 7f3446b53700 1 -- 172.21.15.80:0/2440185300 shutdown_connections 2019-11-28T11:48:40.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.977+0000 7f3446b53700 1 --2- 172.21.15.80:0/2440185300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f344015ed10 0x7f344015f100 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.977+0000 7f3446b53700 1 -- 172.21.15.80:0/2440185300 shutdown_connections 2019-11-28T11:48:40.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.977+0000 7f3446b53700 1 -- 172.21.15.80:0/2440185300 wait complete. 2019-11-28T11:48:40.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.977+0000 7f3446b53700 1 -- 172.21.15.80:0/2440185300 >> 172.21.15.80:0/2440185300 conn(0x7f3440061d40 msgr2=0x7f34400641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:40.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.979+0000 7f3446b53700 1 Processor -- start 2019-11-28T11:48:40.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.979+0000 7f3446b53700 1 -- start start 2019-11-28T11:48:40.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.980+0000 7f3446b53700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3440115b10 0x7f34401480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:40.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.980+0000 7f3446b53700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3440148610 0x7f3440101e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:40.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.980+0000 7f3446b53700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3440148b90 con 0x7f3440128480 2019-11-28T11:48:40.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.980+0000 7f3446b53700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3440113ab0 con 0x7f3440148610 2019-11-28T11:48:40.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.980+0000 7f3446b53700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3440113d80 con 0x7f3440115b10 2019-11-28T11:48:40.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.980+0000 7f34458f1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3440148610 0x7f3440101e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:40.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.980+0000 7f34458f1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3440148610 0x7f3440101e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41490/0 (socket says 172.21.15.80:41490) 2019-11-28T11:48:40.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.980+0000 7f34458f1700 1 -- 172.21.15.80:0/619445706 learned_addr learned my addr 172.21.15.80:0/619445706 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:40.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.980+0000 7f34448ef700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3440115b10 0x7f34401480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:40.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.980+0000 7f34458f1700 1 -- 172.21.15.80:0/619445706 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3440115b10 msgr2=0x7f34401480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.980+0000 7f34458f1700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3440115b10 0x7f34401480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.980+0000 7f34458f1700 1 -- 172.21.15.80:0/619445706 >> v1:172.21.15.174:6789/0 conn(0x7f3440128480 legacy=0x7f3440102a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.980+0000 7f34458f1700 1 -- 172.21.15.80:0/619445706 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3440114410 con 0x7f3440148610 2019-11-28T11:48:40.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.981+0000 7f34458f1700 1 --2- 172.21.15.80:0/619445706 >> v2:172.21.15.80:3300/0 conn(0x7f3440148610 0x7f3440101e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f34380103a0 tx=0x7f3438010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.981+0000 7f34458f1700 1 --2- 172.21.15.80:0/619445706 >> v2:172.21.15.80:3300/0 conn(0x7f3440148610 0x7f3440101e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f34380103a0 tx=0x7f3438010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.981+0000 7f34458f1700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3440148610 0x7f3440101e80 secure :-1 s=READY pgs=1960 cs=0 l=1 rx=0x7f34380103a0 tx=0x7f3438010740).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:40.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.981+0000 7f34458f1700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3440148610 0x7f3440101e80 secure :-1 s=THROTTLE_DONE pgs=1960 cs=0 l=1 rx=0x7f34380103a0 tx=0x7f3438010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.981+0000 7f34458f1700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3440148610 0x7f3440101e80 secure :-1 s=THROTTLE_DONE pgs=1960 cs=0 l=1 rx=0x7f34380103a0 tx=0x7f3438010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.981+0000 7f343dffb700 1 -- 172.21.15.80:0/619445706 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3438000960 con 0x7f3440148610 2019-11-28T11:48:40.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.981+0000 7f34458f1700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3440148610 0x7f3440101e80 secure :-1 s=THROTTLE_DONE pgs=1960 cs=0 l=1 rx=0x7f34380103a0 tx=0x7f3438010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.981+0000 7f343dffb700 1 -- 172.21.15.80:0/619445706 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3438001090 con 0x7f3440148610 2019-11-28T11:48:40.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.981+0000 7f3446b53700 1 -- 172.21.15.80:0/619445706 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3440114790 con 0x7f3440148610 2019-11-28T11:48:40.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.981+0000 7f343dffb700 1 -- 172.21.15.80:0/619445706 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3438001760 con 0x7f3440148610 2019-11-28T11:48:40.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.981+0000 7f3446b53700 1 -- 172.21.15.80:0/619445706 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3440114410 con 0x7f3440148610 2019-11-28T11:48:40.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.981+0000 7f34458f1700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3440148610 0x7f3440101e80 secure :-1 s=THROTTLE_DONE pgs=1960 cs=0 l=1 rx=0x7f34380103a0 tx=0x7f3438010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.982+0000 7f343dffb700 1 -- 172.21.15.80:0/619445706 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3438001280 con 0x7f3440148610 2019-11-28T11:48:40.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.982+0000 7f34458f1700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3440148610 0x7f3440101e80 secure :-1 s=THROTTLE_DONE pgs=1960 cs=0 l=1 rx=0x7f34380103a0 tx=0x7f3438010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.982+0000 7f343dffb700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3424018730 0x7f342401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:40.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.982+0000 7f343dffb700 1 -- 172.21.15.80:0/619445706 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3438031aa0 con 0x7f3440148610 2019-11-28T11:48:40.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.982+0000 7f34450f0700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3424018730 0x7f342401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:40.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.982+0000 7f34450f0700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3424018730 0x7f342401abc0 crc :-1 s=READY pgs=788 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:40.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.989+0000 7f3446b53700 1 -- 172.21.15.80:0/619445706 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3440114790 con 0x7f3440148610 2019-11-28T11:48:40.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.993+0000 7f34458f1700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3440148610 0x7f3440101e80 secure :-1 s=THROTTLE_DONE pgs=1960 cs=0 l=1 rx=0x7f34380103a0 tx=0x7f3438010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:39.993+0000 7f343dffb700 1 -- 172.21.15.80:0/619445706 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3438007590 con 0x7f3440148610 2019-11-28T11:48:40.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.171+0000 7f3446b53700 1 -- 172.21.15.80:0/619445706 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f3440114410 con 0x7f3440148610 2019-11-28T11:48:40.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.174+0000 7f34458f1700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3440148610 0x7f3440101e80 secure :-1 s=THROTTLE_DONE pgs=1960 cs=0 l=1 rx=0x7f34380103a0 tx=0x7f3438010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.174+0000 7f343dffb700 1 -- 172.21.15.80:0/619445706 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v53) v1 ==== 184+0+0 (secure 0 0 0) 0x7f34380176a0 con 0x7f3440148610 2019-11-28T11:48:40.224 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:48:40.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.180+0000 7f3446b53700 1 -- 172.21.15.80:0/619445706 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3424018730 msgr2=0x7f342401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.180+0000 7f3446b53700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3424018730 0x7f342401abc0 crc :-1 s=READY pgs=788 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.180+0000 7f3446b53700 1 -- 172.21.15.80:0/619445706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3440148610 msgr2=0x7f3440101e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.180+0000 7f3446b53700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3440148610 0x7f3440101e80 secure :-1 s=READY pgs=1960 cs=0 l=1 rx=0x7f34380103a0 tx=0x7f3438010740).stop 2019-11-28T11:48:40.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.180+0000 7f3446b53700 1 -- 172.21.15.80:0/619445706 shutdown_connections 2019-11-28T11:48:40.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.180+0000 7f3446b53700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3440148610 0x7f3440101e80 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.180+0000 7f3446b53700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3440115b10 0x7f34401480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.180+0000 7f3446b53700 1 --2- 172.21.15.80:0/619445706 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3424018730 0x7f342401abc0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.180+0000 7f3446b53700 1 -- 172.21.15.80:0/619445706 shutdown_connections 2019-11-28T11:48:40.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.180+0000 7f3446b53700 1 -- 172.21.15.80:0/619445706 wait complete. 2019-11-28T11:48:40.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.180+0000 7f3446b53700 1 -- 172.21.15.80:0/619445706 >> 172.21.15.80:0/619445706 conn(0x7f3440166610 msgr2=0x7f34401473d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:40.236 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:48:40.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.320+0000 7f41b3d47700 1 Processor -- start 2019-11-28T11:48:40.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.320+0000 7f41b3d47700 1 -- start start 2019-11-28T11:48:40.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.321+0000 7f41b3d47700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f41ac1639f0 0x7f41ac165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:40.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.321+0000 7f41b3d47700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ac06db60 con 0x7f41ac15f100 2019-11-28T11:48:40.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.321+0000 7f41b3d47700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ac06e060 con 0x7f41ac15ed10 2019-11-28T11:48:40.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.321+0000 7f41b3d47700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ac06fe00 con 0x7f41ac1639f0 2019-11-28T11:48:40.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.321+0000 7f41b1ae3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f41ac15f100 0x7f41ac06bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40814/0 (socket says 172.21.15.80:40814) 2019-11-28T11:48:40.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.321+0000 7f41b1ae3700 1 -- 172.21.15.80:0/2438550504 learned_addr learned my addr 172.21.15.80:0/2438550504 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:40.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b2ae5700 1 --2- 172.21.15.80:0/2438550504 >> v2:172.21.15.174:3300/0 conn(0x7f41ac1639f0 0x7f41ac165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:40.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b12e2700 1 -- 172.21.15.80:0/2438550504 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133947579 0 0) 0x7f4194001070 con 0x7f41ac15f100 2019-11-28T11:48:40.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b12e2700 1 -- 172.21.15.80:0/2438550504 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4198002e80 con 0x7f41ac15f100 2019-11-28T11:48:40.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b2ae5700 1 -- 172.21.15.80:0/2438550504 >> v1:172.21.15.174:6789/0 conn(0x7f41ac15ed10 legacy=0x7f41ac073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b2ae5700 1 -- 172.21.15.80:0/2438550504 >> v1:172.21.15.80:6789/0 conn(0x7f41ac15f100 legacy=0x7f41ac06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b12e2700 1 -- 172.21.15.80:0/2438550504 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606000674 0 0) 0x7f419c001400 con 0x7f41ac15ed10 2019-11-28T11:48:40.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b2ae5700 1 -- 172.21.15.80:0/2438550504 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac070760 con 0x7f41ac1639f0 2019-11-28T11:48:40.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b2ae5700 1 --2- 172.21.15.80:0/2438550504 >> v2:172.21.15.174:3300/0 conn(0x7f41ac1639f0 0x7f41ac165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f41a400af80 tx=0x7f41a400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b2ae5700 1 --2- 172.21.15.80:0/2438550504 >> v2:172.21.15.174:3300/0 conn(0x7f41ac1639f0 0x7f41ac165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f41a400af80 tx=0x7f41a400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b2ae5700 1 --2- 172.21.15.80:0/2438550504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41ac1639f0 0x7f41ac165df0 secure :-1 s=READY pgs=1147 cs=0 l=1 rx=0x7f41a400af80 tx=0x7f41a400b790).ready entity=mon.1 client_cookie=137f6a8156556396 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:40.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b2ae5700 1 --2- 172.21.15.80:0/2438550504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41ac1639f0 0x7f41ac165df0 secure :-1 s=THROTTLE_DONE pgs=1147 cs=0 l=1 rx=0x7f41a400af80 tx=0x7f41a400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b12e2700 1 -- 172.21.15.80:0/2438550504 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41a4007240 con 0x7f41ac1639f0 2019-11-28T11:48:40.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b2ae5700 1 --2- 172.21.15.80:0/2438550504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41ac1639f0 0x7f41ac165df0 secure :-1 s=THROTTLE_DONE pgs=1147 cs=0 l=1 rx=0x7f41a400af80 tx=0x7f41a400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b2ae5700 1 --2- 172.21.15.80:0/2438550504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41ac1639f0 0x7f41ac165df0 secure :-1 s=THROTTLE_DONE pgs=1147 cs=0 l=1 rx=0x7f41a400af80 tx=0x7f41a400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b12e2700 1 -- 172.21.15.80:0/2438550504 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a4000bb0 con 0x7f41ac1639f0 2019-11-28T11:48:40.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b12e2700 1 -- 172.21.15.80:0/2438550504 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41a4009e60 con 0x7f41ac1639f0 2019-11-28T11:48:40.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b3d47700 1 -- 172.21.15.80:0/2438550504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41ac1639f0 msgr2=0x7f41ac165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.322+0000 7f41b3d47700 1 --2- 172.21.15.80:0/2438550504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41ac1639f0 0x7f41ac165df0 secure :-1 s=READY pgs=1147 cs=0 l=1 rx=0x7f41a400af80 tx=0x7f41a400b790).stop 2019-11-28T11:48:40.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.323+0000 7f41b3d47700 1 -- 172.21.15.80:0/2438550504 shutdown_connections 2019-11-28T11:48:40.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.323+0000 7f41b3d47700 1 --2- 172.21.15.80:0/2438550504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41ac1639f0 0x7f41ac165df0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.323+0000 7f41b3d47700 1 -- 172.21.15.80:0/2438550504 shutdown_connections 2019-11-28T11:48:40.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.323+0000 7f41b3d47700 1 -- 172.21.15.80:0/2438550504 wait complete. 2019-11-28T11:48:40.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.323+0000 7f41b3d47700 1 -- 172.21.15.80:0/2438550504 >> 172.21.15.80:0/2438550504 conn(0x7f41ac061d40 msgr2=0x7f41ac0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:40.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.325+0000 7f41b3d47700 1 Processor -- start 2019-11-28T11:48:40.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.325+0000 7f41b3d47700 1 -- start start 2019-11-28T11:48:40.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.326+0000 7f41b3d47700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f41ac152750 0x7f41ac135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:40.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.326+0000 7f41b3d47700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41ac130dc0 0x7f41ac131250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:40.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.326+0000 7f41b3d47700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ac109d70 con 0x7f41ac131790 2019-11-28T11:48:40.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.326+0000 7f41b3d47700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ac132570 con 0x7f41ac152750 2019-11-28T11:48:40.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.326+0000 7f41b3d47700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac132840 con 0x7f41ac130dc0 2019-11-28T11:48:40.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b1ae3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41ac130dc0 0x7f41ac131250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:40.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b22e4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f41ac152750 0x7f41ac135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:40.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b1ae3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41ac130dc0 0x7f41ac131250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:43760/0 (socket says 172.21.15.80:43760) 2019-11-28T11:48:40.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b22e4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f41ac152750 0x7f41ac135790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:56390/0 (socket says 172.21.15.80:56390) 2019-11-28T11:48:40.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b1ae3700 1 -- 172.21.15.80:0/4144000989 learned_addr learned my addr 172.21.15.80:0/4144000989 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:40.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b2ae5700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f41ac131790 0x7f41ac134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:56362/0 (socket says 172.21.15.80:56362) 2019-11-28T11:48:40.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b1ae3700 1 -- 172.21.15.80:0/4144000989 >> v2:172.21.15.174:3300/0 conn(0x7f41ac152750 msgr2=0x7f41ac135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b1ae3700 1 --2- 172.21.15.80:0/4144000989 >> v2:172.21.15.174:3300/0 conn(0x7f41ac152750 0x7f41ac135790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b1ae3700 1 -- 172.21.15.80:0/4144000989 >> v1:172.21.15.174:6789/0 conn(0x7f41ac131790 legacy=0x7f41ac134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b1ae3700 1 -- 172.21.15.80:0/4144000989 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac132ed0 con 0x7f41ac130dc0 2019-11-28T11:48:40.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41aaffd700 1 -- 172.21.15.80:0/4144000989 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114429545 0 0) 0x7f41a4009990 con 0x7f41ac131790 2019-11-28T11:48:40.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b22e4700 1 --2- 172.21.15.80:0/4144000989 >> v2:172.21.15.174:3300/0 conn(0x7f41ac152750 0x7f41ac135790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:48:40.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b1ae3700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41ac130dc0 0x7f41ac131250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4194010430 tx=0x7f41940107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b1ae3700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41ac130dc0 0x7f41ac131250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4194010430 tx=0x7f41940107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b1ae3700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41ac130dc0 0x7f41ac131250 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7f4194010430 tx=0x7f41940107d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:40.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b1ae3700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41ac130dc0 0x7f41ac131250 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f4194010430 tx=0x7f41940107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41aaffd700 1 -- 172.21.15.80:0/4144000989 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4194000940 con 0x7f41ac130dc0 2019-11-28T11:48:40.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b1ae3700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41ac130dc0 0x7f41ac131250 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f4194010430 tx=0x7f41940107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b1ae3700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41ac130dc0 0x7f41ac131250 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f4194010430 tx=0x7f41940107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41aaffd700 1 -- 172.21.15.80:0/4144000989 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419400c250 con 0x7f41ac130dc0 2019-11-28T11:48:40.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41aaffd700 1 -- 172.21.15.80:0/4144000989 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f419400c820 con 0x7f41ac130dc0 2019-11-28T11:48:40.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b3d47700 1 -- 172.21.15.80:0/4144000989 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ac133250 con 0x7f41ac130dc0 2019-11-28T11:48:40.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.327+0000 7f41b3d47700 1 -- 172.21.15.80:0/4144000989 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ac132ed0 con 0x7f41ac130dc0 2019-11-28T11:48:40.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.328+0000 7f41b1ae3700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41ac130dc0 0x7f41ac131250 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f4194010430 tx=0x7f41940107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.328+0000 7f41b1ae3700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41ac130dc0 0x7f41ac131250 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f4194010430 tx=0x7f41940107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.328+0000 7f41aaffd700 1 -- 172.21.15.80:0/4144000989 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f419400c440 con 0x7f41ac130dc0 2019-11-28T11:48:40.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.328+0000 7f41aaffd700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4190018730 0x7f419001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:40.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.328+0000 7f41aaffd700 1 -- 172.21.15.80:0/4144000989 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4194031ad0 con 0x7f41ac130dc0 2019-11-28T11:48:40.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.328+0000 7f41b22e4700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4190018730 0x7f419001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:40.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.329+0000 7f41b22e4700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4190018730 0x7f419001abc0 crc :-1 s=READY pgs=790 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:40.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.336+0000 7f41b3d47700 1 -- 172.21.15.80:0/4144000989 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ac133250 con 0x7f41ac130dc0 2019-11-28T11:48:40.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.339+0000 7f41b1ae3700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41ac130dc0 0x7f41ac131250 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f4194010430 tx=0x7f41940107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.339+0000 7f41aaffd700 1 -- 172.21.15.80:0/4144000989 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f41940298a0 con 0x7f41ac130dc0 2019-11-28T11:48:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.509+0000 7f41b3d47700 1 -- 172.21.15.80:0/4144000989 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f41ac132ed0 con 0x7f41ac130dc0 2019-11-28T11:48:40.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.515+0000 7f41b1ae3700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41ac130dc0 0x7f41ac131250 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f4194010430 tx=0x7f41940107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.515+0000 7f41aaffd700 1 -- 172.21.15.80:0/4144000989 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v54) v1 ==== 184+0+0 (secure 0 0 0) 0x7f419400c440 con 0x7f41ac130dc0 2019-11-28T11:48:40.562 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:48:40.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.518+0000 7f41b3d47700 1 -- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4190018730 msgr2=0x7f419001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.518+0000 7f41b3d47700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4190018730 0x7f419001abc0 crc :-1 s=READY pgs=790 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.518+0000 7f41b3d47700 1 -- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41ac130dc0 msgr2=0x7f41ac131250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.518+0000 7f41b3d47700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41ac130dc0 0x7f41ac131250 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7f4194010430 tx=0x7f41940107d0).stop 2019-11-28T11:48:40.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.518+0000 7f41b3d47700 1 -- 172.21.15.80:0/4144000989 shutdown_connections 2019-11-28T11:48:40.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.518+0000 7f41b3d47700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4190018730 0x7f419001abc0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.518+0000 7f41b3d47700 1 --2- 172.21.15.80:0/4144000989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41ac130dc0 0x7f41ac131250 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.518+0000 7f41b3d47700 1 --2- 172.21.15.80:0/4144000989 >> v2:172.21.15.174:3300/0 conn(0x7f41ac152750 0x7f41ac135790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.518+0000 7f41b3d47700 1 -- 172.21.15.80:0/4144000989 shutdown_connections 2019-11-28T11:48:40.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.518+0000 7f41b3d47700 1 -- 172.21.15.80:0/4144000989 wait complete. 2019-11-28T11:48:40.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.518+0000 7f41b3d47700 1 -- 172.21.15.80:0/4144000989 >> 172.21.15.80:0/4144000989 conn(0x7f41ac1476e0 msgr2=0x7f41ac12fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:40.589 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:48:40.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.674+0000 7f492e1f4700 1 Processor -- start 2019-11-28T11:48:40.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.674+0000 7f492e1f4700 1 -- start start 2019-11-28T11:48:40.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.675+0000 7f492e1f4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f492815ed10 0x7f492815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:40.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.675+0000 7f492e1f4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492806db60 con 0x7f49280734b0 2019-11-28T11:48:40.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.675+0000 7f492e1f4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492806e060 con 0x7f4928073020 2019-11-28T11:48:40.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.675+0000 7f492e1f4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492806f3d0 con 0x7f492815ed10 2019-11-28T11:48:40.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.675+0000 7f492cf92700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f49280734b0 0x7f49280726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40828/0 (socket says 172.21.15.80:40828) 2019-11-28T11:48:40.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.675+0000 7f492cf92700 1 -- 172.21.15.80:0/1775077000 learned_addr learned my addr 172.21.15.80:0/1775077000 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:40.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.675+0000 7f4927fff700 1 --2- 172.21.15.80:0/1775077000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f492815ed10 0x7f492815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:40.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.675+0000 7f49277fe700 1 -- 172.21.15.80:0/1775077000 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263132667 0 0) 0x7f49200014d0 con 0x7f49280734b0 2019-11-28T11:48:40.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.675+0000 7f49277fe700 1 -- 172.21.15.80:0/1775077000 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4914002e80 con 0x7f49280734b0 2019-11-28T11:48:40.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.675+0000 7f49277fe700 1 -- 172.21.15.80:0/1775077000 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120503093 0 0) 0x7f4910001080 con 0x7f4928073020 2019-11-28T11:48:40.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.675+0000 7f49277fe700 1 -- 172.21.15.80:0/1775077000 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4914004170 con 0x7f4928073020 2019-11-28T11:48:40.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.675+0000 7f4927fff700 1 -- 172.21.15.80:0/1775077000 >> v1:172.21.15.174:6789/0 conn(0x7f4928073020 legacy=0x7f4928071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.675+0000 7f4927fff700 1 -- 172.21.15.80:0/1775077000 >> v1:172.21.15.80:6789/0 conn(0x7f49280734b0 legacy=0x7f49280726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.675+0000 7f49277fe700 1 -- 172.21.15.80:0/1775077000 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2897050506 0 0) 0x7f49200014b0 con 0x7f49280734b0 2019-11-28T11:48:40.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.675+0000 7f4927fff700 1 -- 172.21.15.80:0/1775077000 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4928070760 con 0x7f492815ed10 2019-11-28T11:48:40.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.676+0000 7f4927fff700 1 --2- 172.21.15.80:0/1775077000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f492815ed10 0x7f492815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f491800af50 tx=0x7f491800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.676+0000 7f4927fff700 1 --2- 172.21.15.80:0/1775077000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f492815ed10 0x7f492815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f491800af50 tx=0x7f491800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.676+0000 7f4927fff700 1 --2- 172.21.15.80:0/1775077000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f492815ed10 0x7f492815f100 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7f491800af50 tx=0x7f491800b760).ready entity=mon.2 client_cookie=152c7b3f61ed763a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:40.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.676+0000 7f4927fff700 1 --2- 172.21.15.80:0/1775077000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f492815ed10 0x7f492815f100 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7f491800af50 tx=0x7f491800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.676+0000 7f49277fe700 1 -- 172.21.15.80:0/1775077000 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4918000960 con 0x7f492815ed10 2019-11-28T11:48:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.676+0000 7f4927fff700 1 --2- 172.21.15.80:0/1775077000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f492815ed10 0x7f492815f100 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7f491800af50 tx=0x7f491800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.676+0000 7f4927fff700 1 --2- 172.21.15.80:0/1775077000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f492815ed10 0x7f492815f100 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7f491800af50 tx=0x7f491800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.676+0000 7f49277fe700 1 -- 172.21.15.80:0/1775077000 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4918009860 con 0x7f492815ed10 2019-11-28T11:48:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.676+0000 7f49277fe700 1 -- 172.21.15.80:0/1775077000 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4918009f30 con 0x7f492815ed10 2019-11-28T11:48:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.676+0000 7f492e1f4700 1 -- 172.21.15.80:0/1775077000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f492815ed10 msgr2=0x7f492815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.676+0000 7f492e1f4700 1 --2- 172.21.15.80:0/1775077000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f492815ed10 0x7f492815f100 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7f491800af50 tx=0x7f491800b760).stop 2019-11-28T11:48:40.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.677+0000 7f492e1f4700 1 -- 172.21.15.80:0/1775077000 shutdown_connections 2019-11-28T11:48:40.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.677+0000 7f492e1f4700 1 --2- 172.21.15.80:0/1775077000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f492815ed10 0x7f492815f100 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.677+0000 7f492e1f4700 1 -- 172.21.15.80:0/1775077000 shutdown_connections 2019-11-28T11:48:40.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.677+0000 7f492e1f4700 1 -- 172.21.15.80:0/1775077000 wait complete. 2019-11-28T11:48:40.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.677+0000 7f492e1f4700 1 -- 172.21.15.80:0/1775077000 >> 172.21.15.80:0/1775077000 conn(0x7f4928061d40 msgr2=0x7f49280641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:40.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.679+0000 7f492e1f4700 1 Processor -- start 2019-11-28T11:48:40.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.679+0000 7f492e1f4700 1 -- start start 2019-11-28T11:48:40.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f492e1f4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49281594b0 0x7f4928159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:40.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f492e1f4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4928159e80 0x7f492816ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:40.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f492e1f4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4928153290 con 0x7f4928152a40 2019-11-28T11:48:40.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f492e1f4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492810a4a0 con 0x7f4928159e80 2019-11-28T11:48:40.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f492e1f4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4928113ca0 con 0x7f49281594b0 2019-11-28T11:48:40.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f4927fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4928152a40 0x7f492815a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40830/0 (socket says 172.21.15.80:40830) 2019-11-28T11:48:40.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f4927fff700 1 -- 172.21.15.80:0/3662630211 learned_addr learned my addr 172.21.15.80:0/3662630211 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:40.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f492cf92700 1 --2- 172.21.15.80:0/3662630211 >> v2:172.21.15.174:3300/0 conn(0x7f4928159e80 0x7f492816ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:40.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f491ffff700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49281594b0 0x7f4928159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:40.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f49257fa700 1 -- 172.21.15.80:0/3662630211 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274625894 0 0) 0x7f491800ac20 con 0x7f4928152a40 2019-11-28T11:48:40.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f49257fa700 1 -- 172.21.15.80:0/3662630211 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f490c002e80 con 0x7f4928152a40 2019-11-28T11:48:40.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f49257fa700 1 -- 172.21.15.80:0/3662630211 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1464408669 0 0) 0x7f491800b450 con 0x7f4928152a40 2019-11-28T11:48:40.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f49257fa700 1 -- 172.21.15.80:0/3662630211 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f490c0032e0 con 0x7f4928152a40 2019-11-28T11:48:40.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f49257fa700 1 -- 172.21.15.80:0/3662630211 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f4918009ba0 con 0x7f4928152a40 2019-11-28T11:48:40.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f491ffff700 1 -- 172.21.15.80:0/3662630211 >> v2:172.21.15.174:3300/0 conn(0x7f4928159e80 msgr2=0x7f492816ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f491ffff700 1 --2- 172.21.15.80:0/3662630211 >> v2:172.21.15.174:3300/0 conn(0x7f4928159e80 0x7f492816ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f491ffff700 1 -- 172.21.15.80:0/3662630211 >> v1:172.21.15.80:6789/0 conn(0x7f4928152a40 legacy=0x7f492815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f491ffff700 1 -- 172.21.15.80:0/3662630211 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492815a300 con 0x7f49281594b0 2019-11-28T11:48:40.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f492cf92700 1 --2- 172.21.15.80:0/3662630211 >> v2:172.21.15.174:3300/0 conn(0x7f4928159e80 0x7f492816ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:48:40.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.680+0000 7f491ffff700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49281594b0 0x7f4928159940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49100103a0 tx=0x7f4910010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.681+0000 7f491ffff700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49281594b0 0x7f4928159940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49100103a0 tx=0x7f4910010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.681+0000 7f491ffff700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49281594b0 0x7f4928159940 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7f49100103a0 tx=0x7f4910010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:40.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.681+0000 7f491ffff700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49281594b0 0x7f4928159940 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f49100103a0 tx=0x7f4910010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.681+0000 7f49257fa700 1 -- 172.21.15.80:0/3662630211 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4910000aa0 con 0x7f49281594b0 2019-11-28T11:48:40.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.681+0000 7f491ffff700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49281594b0 0x7f4928159940 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f49100103a0 tx=0x7f4910010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.681+0000 7f491ffff700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49281594b0 0x7f4928159940 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f49100103a0 tx=0x7f4910010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.681+0000 7f49257fa700 1 -- 172.21.15.80:0/3662630211 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4910009980 con 0x7f49281594b0 2019-11-28T11:48:40.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.681+0000 7f492e1f4700 1 -- 172.21.15.80:0/3662630211 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492815a300 con 0x7f49281594b0 2019-11-28T11:48:40.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.681+0000 7f49257fa700 1 -- 172.21.15.80:0/3662630211 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f491000a090 con 0x7f49281594b0 2019-11-28T11:48:40.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.681+0000 7f492e1f4700 1 -- 172.21.15.80:0/3662630211 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492815a300 con 0x7f49281594b0 2019-11-28T11:48:40.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.681+0000 7f491ffff700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49281594b0 0x7f4928159940 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f49100103a0 tx=0x7f4910010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.681+0000 7f49257fa700 1 -- 172.21.15.80:0/3662630211 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4910000aa0 con 0x7f49281594b0 2019-11-28T11:48:40.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.681+0000 7f491ffff700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49281594b0 0x7f4928159940 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f49100103a0 tx=0x7f4910010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.681+0000 7f49257fa700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f490c018770 0x7f490c01ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:40.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.682+0000 7f49257fa700 1 -- 172.21.15.80:0/3662630211 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4910031a20 con 0x7f49281594b0 2019-11-28T11:48:40.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.682+0000 7f4927fff700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f490c018770 0x7f490c01ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:40.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.682+0000 7f4927fff700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f490c018770 0x7f490c01ac00 crc :-1 s=READY pgs=791 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:40.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.689+0000 7f492e1f4700 1 -- 172.21.15.80:0/3662630211 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4928114330 con 0x7f49281594b0 2019-11-28T11:48:40.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.692+0000 7f491ffff700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49281594b0 0x7f4928159940 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f49100103a0 tx=0x7f4910010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.692+0000 7f49257fa700 1 -- 172.21.15.80:0/3662630211 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4910009580 con 0x7f49281594b0 2019-11-28T11:48:40.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.865+0000 7f492e1f4700 1 -- 172.21.15.80:0/3662630211 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f49281146b0 con 0x7f49281594b0 2019-11-28T11:48:40.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.869+0000 7f491ffff700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49281594b0 0x7f4928159940 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f49100103a0 tx=0x7f4910010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:40.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.869+0000 7f49257fa700 1 -- 172.21.15.80:0/3662630211 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v55) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4910009b70 con 0x7f49281594b0 2019-11-28T11:48:40.922 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:48:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.875+0000 7f492e1f4700 1 -- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f490c018770 msgr2=0x7f490c01ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.875+0000 7f492e1f4700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f490c018770 0x7f490c01ac00 crc :-1 s=READY pgs=791 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.875+0000 7f492e1f4700 1 -- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49281594b0 msgr2=0x7f4928159940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.875+0000 7f492e1f4700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49281594b0 0x7f4928159940 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7f49100103a0 tx=0x7f4910010740).stop 2019-11-28T11:48:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.875+0000 7f492e1f4700 1 -- 172.21.15.80:0/3662630211 shutdown_connections 2019-11-28T11:48:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.875+0000 7f492e1f4700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f490c018770 0x7f490c01ac00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.875+0000 7f492e1f4700 1 --2- 172.21.15.80:0/3662630211 >> v2:172.21.15.174:3300/0 conn(0x7f4928159e80 0x7f492816ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.875+0000 7f492e1f4700 1 --2- 172.21.15.80:0/3662630211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f49281594b0 0x7f4928159940 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:40.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.875+0000 7f492e1f4700 1 -- 172.21.15.80:0/3662630211 shutdown_connections 2019-11-28T11:48:40.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.875+0000 7f492e1f4700 1 -- 172.21.15.80:0/3662630211 wait complete. 2019-11-28T11:48:40.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:40.875+0000 7f492e1f4700 1 -- 172.21.15.80:0/3662630211 >> 172.21.15.80:0/3662630211 conn(0x7f49281476e0 msgr2=0x7f492812fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:40.932 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:48:41.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.012+0000 7ff22a1d2700 1 Processor -- start 2019-11-28T11:48:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.012+0000 7ff22a1d2700 1 -- start start 2019-11-28T11:48:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.013+0000 7ff22a1d2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff22406c0a0 0x7ff224072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.013+0000 7ff22a1d2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2240734e0 0x7ff224071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.013+0000 7ff22a1d2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22406db00 con 0x7ff224072360 2019-11-28T11:48:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.013+0000 7ff22a1d2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22406f330 con 0x7ff2240734e0 2019-11-28T11:48:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.013+0000 7ff22a1d2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240706c0 con 0x7ff22406c0a0 2019-11-28T11:48:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.013+0000 7ff223fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff22406c0a0 0x7ff224072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.013+0000 7ff21bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2240734e0 0x7ff224071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:41.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.013+0000 7ff223fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff22406c0a0 0x7ff224072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:43782/0 (socket says 172.21.15.80:43782) 2019-11-28T11:48:41.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.013+0000 7ff228f70700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff224072360 0x7ff22406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:56386/0 (socket says 172.21.15.80:56386) 2019-11-28T11:48:41.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.013+0000 7ff223fff700 1 -- 172.21.15.80:0/345772096 learned_addr learned my addr 172.21.15.80:0/345772096 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:41.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff2237fe700 1 -- 172.21.15.80:0/345772096 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658229122 0 0) 0x7ff21c001400 con 0x7ff224072360 2019-11-28T11:48:41.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff223fff700 1 -- 172.21.15.80:0/345772096 >> v2:172.21.15.174:3300/0 conn(0x7ff2240734e0 msgr2=0x7ff224071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:41.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff223fff700 1 --2- 172.21.15.80:0/345772096 >> v2:172.21.15.174:3300/0 conn(0x7ff2240734e0 0x7ff224071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:41.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff223fff700 1 -- 172.21.15.80:0/345772096 >> v1:172.21.15.174:6789/0 conn(0x7ff224072360 legacy=0x7ff22406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:41.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff223fff700 1 -- 172.21.15.80:0/345772096 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff224070a40 con 0x7ff22406c0a0 2019-11-28T11:48:41.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff21bfff700 1 --2- 172.21.15.80:0/345772096 >> v2:172.21.15.174:3300/0 conn(0x7ff2240734e0 0x7ff224071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:48:41.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff223fff700 1 --2- 172.21.15.80:0/345772096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff22406c0a0 0x7ff224072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff21400f740 tx=0x7ff21400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff223fff700 1 --2- 172.21.15.80:0/345772096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff22406c0a0 0x7ff224072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff21400f740 tx=0x7ff21400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff223fff700 1 --2- 172.21.15.80:0/345772096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff22406c0a0 0x7ff224072fa0 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7ff21400f740 tx=0x7ff21400fae0).ready entity=mon.2 client_cookie=3af85d672397b635 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff223fff700 1 --2- 172.21.15.80:0/345772096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff22406c0a0 0x7ff224072fa0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7ff21400f740 tx=0x7ff21400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff2237fe700 1 -- 172.21.15.80:0/345772096 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff214000960 con 0x7ff22406c0a0 2019-11-28T11:48:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff223fff700 1 --2- 172.21.15.80:0/345772096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff22406c0a0 0x7ff224072fa0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7ff21400f740 tx=0x7ff21400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff223fff700 1 --2- 172.21.15.80:0/345772096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff22406c0a0 0x7ff224072fa0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7ff21400f740 tx=0x7ff21400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff2237fe700 1 -- 172.21.15.80:0/345772096 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff214000c90 con 0x7ff22406c0a0 2019-11-28T11:48:41.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff2237fe700 1 -- 172.21.15.80:0/345772096 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2140013a0 con 0x7ff22406c0a0 2019-11-28T11:48:41.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff22a1d2700 1 -- 172.21.15.80:0/345772096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff22406c0a0 msgr2=0x7ff224072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:41.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.014+0000 7ff22a1d2700 1 --2- 172.21.15.80:0/345772096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff22406c0a0 0x7ff224072fa0 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7ff21400f740 tx=0x7ff21400fae0).stop 2019-11-28T11:48:41.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.015+0000 7ff22a1d2700 1 -- 172.21.15.80:0/345772096 shutdown_connections 2019-11-28T11:48:41.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.015+0000 7ff22a1d2700 1 --2- 172.21.15.80:0/345772096 >> v2:172.21.15.174:3300/0 conn(0x7ff2240734e0 0x7ff224071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:41.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.015+0000 7ff22a1d2700 1 --2- 172.21.15.80:0/345772096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff22406c0a0 0x7ff224072fa0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:41.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.015+0000 7ff22a1d2700 1 -- 172.21.15.80:0/345772096 shutdown_connections 2019-11-28T11:48:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.015+0000 7ff22a1d2700 1 -- 172.21.15.80:0/345772096 wait complete. 2019-11-28T11:48:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.015+0000 7ff22a1d2700 1 -- 172.21.15.80:0/345772096 >> 172.21.15.80:0/345772096 conn(0x7ff224061cf0 msgr2=0x7ff224064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.017+0000 7ff22a1d2700 1 Processor -- start 2019-11-28T11:48:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.017+0000 7ff22a1d2700 1 -- start start 2019-11-28T11:48:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.018+0000 7ff22a1d2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff22413e8e0 0x7ff22414fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.018+0000 7ff22a1d2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff2241067a0 0x7ff224164c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:41.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.018+0000 7ff22a1d2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22413bd00 con 0x7ff2241500d0 2019-11-28T11:48:41.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.018+0000 7ff22a1d2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22410df40 con 0x7ff2241067a0 2019-11-28T11:48:41.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.018+0000 7ff22a1d2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff224104240 con 0x7ff22413e8e0 2019-11-28T11:48:41.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.018+0000 7ff228f70700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff2241067a0 0x7ff224164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:41.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.018+0000 7ff228f70700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff2241067a0 0x7ff224164c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41528/0 (socket says 172.21.15.80:41528) 2019-11-28T11:48:41.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.018+0000 7ff228f70700 1 -- 172.21.15.80:0/1776759543 learned_addr learned my addr 172.21.15.80:0/1776759543 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:41.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.018+0000 7ff223fff700 1 --2- 172.21.15.80:0/1776759543 >> v2:172.21.15.174:3300/0 conn(0x7ff22413e8e0 0x7ff22414fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:41.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.019+0000 7ff228f70700 1 -- 172.21.15.80:0/1776759543 >> v2:172.21.15.174:3300/0 conn(0x7ff22413e8e0 msgr2=0x7ff22414fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:41.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.019+0000 7ff228f70700 1 --2- 172.21.15.80:0/1776759543 >> v2:172.21.15.174:3300/0 conn(0x7ff22413e8e0 0x7ff22414fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:41.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.019+0000 7ff228f70700 1 -- 172.21.15.80:0/1776759543 >> v1:172.21.15.174:6789/0 conn(0x7ff2241500d0 legacy=0x7ff224105fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:41.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.019+0000 7ff228f70700 1 -- 172.21.15.80:0/1776759543 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2241048d0 con 0x7ff2241067a0 2019-11-28T11:48:41.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.019+0000 7ff228f70700 1 --2- 172.21.15.80:0/1776759543 >> v2:172.21.15.80:3300/0 conn(0x7ff2241067a0 0x7ff224164c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff21c010790 tx=0x7ff21c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.019+0000 7ff228f70700 1 --2- 172.21.15.80:0/1776759543 >> v2:172.21.15.80:3300/0 conn(0x7ff2241067a0 0x7ff224164c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff21c010790 tx=0x7ff21c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.019+0000 7ff228f70700 1 --2- 172.21.15.80:0/1776759543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2241067a0 0x7ff224164c20 secure :-1 s=READY pgs=1964 cs=0 l=1 rx=0x7ff21c010790 tx=0x7ff21c010610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:41.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.019+0000 7ff228f70700 1 --2- 172.21.15.80:0/1776759543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2241067a0 0x7ff224164c20 secure :-1 s=THROTTLE_DONE pgs=1964 cs=0 l=1 rx=0x7ff21c010790 tx=0x7ff21c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.019+0000 7ff2217fa700 1 -- 172.21.15.80:0/1776759543 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff21c000e30 con 0x7ff2241067a0 2019-11-28T11:48:41.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.019+0000 7ff228f70700 1 --2- 172.21.15.80:0/1776759543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2241067a0 0x7ff224164c20 secure :-1 s=THROTTLE_DONE pgs=1964 cs=0 l=1 rx=0x7ff21c010790 tx=0x7ff21c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.019+0000 7ff2217fa700 1 -- 172.21.15.80:0/1776759543 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c004540 con 0x7ff2241067a0 2019-11-28T11:48:41.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.019+0000 7ff228f70700 1 --2- 172.21.15.80:0/1776759543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2241067a0 0x7ff224164c20 secure :-1 s=THROTTLE_DONE pgs=1964 cs=0 l=1 rx=0x7ff21c010790 tx=0x7ff21c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.019+0000 7ff22a1d2700 1 -- 172.21.15.80:0/1776759543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff224104c50 con 0x7ff2241067a0 2019-11-28T11:48:41.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.019+0000 7ff2217fa700 1 -- 172.21.15.80:0/1776759543 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff21c001670 con 0x7ff2241067a0 2019-11-28T11:48:41.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.019+0000 7ff22a1d2700 1 -- 172.21.15.80:0/1776759543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2241048d0 con 0x7ff2241067a0 2019-11-28T11:48:41.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.019+0000 7ff228f70700 1 --2- 172.21.15.80:0/1776759543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2241067a0 0x7ff224164c20 secure :-1 s=THROTTLE_DONE pgs=1964 cs=0 l=1 rx=0x7ff21c010790 tx=0x7ff21c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.020+0000 7ff2217fa700 1 -- 172.21.15.80:0/1776759543 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff21c004730 con 0x7ff2241067a0 2019-11-28T11:48:41.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.020+0000 7ff228f70700 1 --2- 172.21.15.80:0/1776759543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2241067a0 0x7ff224164c20 secure :-1 s=THROTTLE_DONE pgs=1964 cs=0 l=1 rx=0x7ff21c010790 tx=0x7ff21c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.020+0000 7ff2217fa700 1 --2- 172.21.15.80:0/1776759543 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1fc018730 0x7ff1fc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:41.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.020+0000 7ff2217fa700 1 -- 172.21.15.80:0/1776759543 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff21c031e00 con 0x7ff2241067a0 2019-11-28T11:48:41.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.020+0000 7ff223fff700 1 --2- 172.21.15.80:0/1776759543 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1fc018730 0x7ff1fc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:41.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.020+0000 7ff223fff700 1 --2- 172.21.15.80:0/1776759543 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1fc018730 0x7ff1fc01abc0 crc :-1 s=READY pgs=792 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:41.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.028+0000 7ff22a1d2700 1 -- 172.21.15.80:0/1776759543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff224104c50 con 0x7ff2241067a0 2019-11-28T11:48:41.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.031+0000 7ff228f70700 1 --2- 172.21.15.80:0/1776759543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2241067a0 0x7ff224164c20 secure :-1 s=THROTTLE_DONE pgs=1964 cs=0 l=1 rx=0x7ff21c010790 tx=0x7ff21c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.031+0000 7ff2217fa700 1 -- 172.21.15.80:0/1776759543 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff21c0011f0 con 0x7ff2241067a0 2019-11-28T11:48:41.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.204+0000 7ff22a1d2700 1 -- 172.21.15.80:0/1776759543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2241048d0 con 0x7ff2241067a0 2019-11-28T11:48:41.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.205+0000 7ff228f70700 1 --2- 172.21.15.80:0/1776759543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2241067a0 0x7ff224164c20 secure :-1 s=THROTTLE_DONE pgs=1964 cs=0 l=1 rx=0x7ff21c010790 tx=0x7ff21c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.205+0000 7ff2217fa700 1 -- 172.21.15.80:0/1776759543 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+1780 (secure 0 0 0) 0x7ff21c004730 con 0x7ff2241067a0 2019-11-28T11:48:41.257 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 115 2019-11-28T11:48:41.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.208+0000 7ff22a1d2700 1 -- 172.21.15.80:0/1776759543 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1fc018730 msgr2=0x7ff1fc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:41.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.208+0000 7ff22a1d2700 1 --2- 172.21.15.80:0/1776759543 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1fc018730 0x7ff1fc01abc0 crc :-1 s=READY pgs=792 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:41.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.208+0000 7ff22a1d2700 1 -- 172.21.15.80:0/1776759543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2241067a0 msgr2=0x7ff224164c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:41.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.208+0000 7ff22a1d2700 1 --2- 172.21.15.80:0/1776759543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2241067a0 0x7ff224164c20 secure :-1 s=READY pgs=1964 cs=0 l=1 rx=0x7ff21c010790 tx=0x7ff21c010610).stop 2019-11-28T11:48:41.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.208+0000 7ff22a1d2700 1 -- 172.21.15.80:0/1776759543 shutdown_connections 2019-11-28T11:48:41.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.208+0000 7ff22a1d2700 1 --2- 172.21.15.80:0/1776759543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2241067a0 0x7ff224164c20 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:41.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.208+0000 7ff22a1d2700 1 --2- 172.21.15.80:0/1776759543 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1fc018730 0x7ff1fc01abc0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:41.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.208+0000 7ff22a1d2700 1 --2- 172.21.15.80:0/1776759543 >> v2:172.21.15.174:3300/0 conn(0x7ff22413e8e0 0x7ff22414fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:41.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.208+0000 7ff22a1d2700 1 -- 172.21.15.80:0/1776759543 shutdown_connections 2019-11-28T11:48:41.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.208+0000 7ff22a1d2700 1 -- 172.21.15.80:0/1776759543 wait complete. 2019-11-28T11:48:41.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.208+0000 7ff22a1d2700 1 -- 172.21.15.80:0/1776759543 >> 172.21.15.80:0/1776759543 conn(0x7ff22413d620 msgr2=0x7ff22413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:41.261 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":115,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:48:37.109829+0000","modified":"2019-11-28T11:48:41.120965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6785":{"gid":6785,"name":"c","rank":0,"incarnation":114,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/1862798714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1862798714},{"type":"v1","addr":"172.21.15.174:6835","nonce":1862798714}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2019-11-28T11:48:41.566 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6785}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 24, u'failed': [], u'epoch': 115, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [25], u'info': {u'gid_6785': {u'export_targets': [], u'name': u'c', u'incarnation': 114, u'state_seq': 2, u'state': u'up:active', u'gid': 6785, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1862798714, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 1862798714, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/1862798714'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:48:37.109829+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:48:41.120965+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:48:41.567 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:48:41.567 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:48:41.693 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:48:41.693 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:48:41.694 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:48:41.694 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 6785, 2019-11-28T11:48:41.694 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:48:41.694 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:48:41.694 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 1.526537778, 2019-11-28T11:48:41.694 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 115, 2019-11-28T11:48:41.694 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 152, 2019-11-28T11:48:41.695 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 152, 2019-11-28T11:48:41.695 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 2.0556010530000002 2019-11-28T11:48:41.695 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:48:41.699 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 6785, "want_state": "up:active", "state": "up:active", "rank_uptime": 1.526537778, "mdsmap_epoch": 115, "osdmap_epoch": 152, "osdmap_epoch_barrier": 152, "uptime": 2.0556010530000002 } 2019-11-28T11:48:41.700 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:48:41.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.774+0000 7f10c86e9700 1 Processor -- start 2019-11-28T11:48:41.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.774+0000 7f10c86e9700 1 -- start start 2019-11-28T11:48:41.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.775+0000 7f10c86e9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10c006c0a0 0x7f10c0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:41.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.775+0000 7f10c86e9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10c0072620 0x7f10c0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:41.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.775+0000 7f10c86e9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c006db00 con 0x7f10c00734e0 2019-11-28T11:48:41.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.775+0000 7f10c86e9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c006f330 con 0x7f10c0072620 2019-11-28T11:48:41.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.775+0000 7f10c86e9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c00706c0 con 0x7f10c006c0a0 2019-11-28T11:48:41.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.775+0000 7f10c7487700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10c0072620 0x7f10c0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:41.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.775+0000 7f10c7487700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10c0072620 0x7f10c0164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41538/0 (socket says 172.21.15.80:41538) 2019-11-28T11:48:41.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.775+0000 7f10c7487700 1 -- 172.21.15.80:0/4174998207 learned_addr learned my addr 172.21.15.80:0/4174998207 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:41.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.775+0000 7f10c7487700 1 -- 172.21.15.80:0/4174998207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10c006c0a0 msgr2=0x7f10c0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:41.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.775+0000 7f10c7487700 1 --2- 172.21.15.80:0/4174998207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10c006c0a0 0x7f10c0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:41.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.775+0000 7f10c7487700 1 -- 172.21.15.80:0/4174998207 >> v1:172.21.15.174:6789/0 conn(0x7f10c00734e0 legacy=0x7f10c0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:41.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.775+0000 7f10c7487700 1 -- 172.21.15.80:0/4174998207 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c0070a40 con 0x7f10c0072620 2019-11-28T11:48:41.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.776+0000 7f10c7487700 1 --2- 172.21.15.80:0/4174998207 >> v2:172.21.15.80:3300/0 conn(0x7f10c0072620 0x7f10c0164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f10b800f730 tx=0x7f10b8007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.776+0000 7f10c7487700 1 --2- 172.21.15.80:0/4174998207 >> v2:172.21.15.80:3300/0 conn(0x7f10c0072620 0x7f10c0164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f10b800f730 tx=0x7f10b8007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.776+0000 7f10c7487700 1 --2- 172.21.15.80:0/4174998207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c0072620 0x7f10c0164d70 secure :-1 s=READY pgs=1965 cs=0 l=1 rx=0x7f10b800f730 tx=0x7f10b8007d50).ready entity=mon.0 client_cookie=202abb982a59a63b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:41.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.776+0000 7f10c7487700 1 --2- 172.21.15.80:0/4174998207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c0072620 0x7f10c0164d70 secure :-1 s=THROTTLE_DONE pgs=1965 cs=0 l=1 rx=0x7f10b800f730 tx=0x7f10b8007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.776+0000 7f10c7487700 1 --2- 172.21.15.80:0/4174998207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c0072620 0x7f10c0164d70 secure :-1 s=THROTTLE_DONE pgs=1965 cs=0 l=1 rx=0x7f10b800f730 tx=0x7f10b8007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.776+0000 7f10c5c84700 1 -- 172.21.15.80:0/4174998207 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10b8000a70 con 0x7f10c0072620 2019-11-28T11:48:41.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.776+0000 7f10c7487700 1 --2- 172.21.15.80:0/4174998207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c0072620 0x7f10c0164d70 secure :-1 s=THROTTLE_DONE pgs=1965 cs=0 l=1 rx=0x7f10b800f730 tx=0x7f10b8007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.776+0000 7f10c5c84700 1 -- 172.21.15.80:0/4174998207 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b80010e0 con 0x7f10c0072620 2019-11-28T11:48:41.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.776+0000 7f10c5c84700 1 -- 172.21.15.80:0/4174998207 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10b80017b0 con 0x7f10c0072620 2019-11-28T11:48:41.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.776+0000 7f10c86e9700 1 -- 172.21.15.80:0/4174998207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c0072620 msgr2=0x7f10c0164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:41.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.776+0000 7f10c86e9700 1 --2- 172.21.15.80:0/4174998207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c0072620 0x7f10c0164d70 secure :-1 s=READY pgs=1965 cs=0 l=1 rx=0x7f10b800f730 tx=0x7f10b8007d50).stop 2019-11-28T11:48:41.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.777+0000 7f10c86e9700 1 -- 172.21.15.80:0/4174998207 shutdown_connections 2019-11-28T11:48:41.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.777+0000 7f10c86e9700 1 --2- 172.21.15.80:0/4174998207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c0072620 0x7f10c0164d70 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:41.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.777+0000 7f10c86e9700 1 --2- 172.21.15.80:0/4174998207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10c006c0a0 0x7f10c0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:41.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.777+0000 7f10c86e9700 1 -- 172.21.15.80:0/4174998207 shutdown_connections 2019-11-28T11:48:41.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.777+0000 7f10c86e9700 1 -- 172.21.15.80:0/4174998207 wait complete. 2019-11-28T11:48:41.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.777+0000 7f10c86e9700 1 -- 172.21.15.80:0/4174998207 >> 172.21.15.80:0/4174998207 conn(0x7f10c0061cf0 msgr2=0x7f10c0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:41.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.779+0000 7f10c86e9700 1 Processor -- start 2019-11-28T11:48:41.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.779+0000 7f10c86e9700 1 -- start start 2019-11-28T11:48:41.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c86e9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f10c0104c10 0x7f10c01050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:41.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c86e9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10c01055e0 0x7f10c0167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:41.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c86e9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c013bcd0 con 0x7f10c0104820 2019-11-28T11:48:41.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c86e9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c0109130 con 0x7f10c01055e0 2019-11-28T11:48:41.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c86e9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c0109400 con 0x7f10c0104c10 2019-11-28T11:48:41.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c6c86700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f10c0104820 0x7f10c010c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40858/0 (socket says 172.21.15.80:40858) 2019-11-28T11:48:41.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c6c86700 1 -- 172.21.15.80:0/3893561515 learned_addr learned my addr 172.21.15.80:0/3893561515 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c7487700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10c01055e0 0x7f10c0167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c6485700 1 --2- 172.21.15.80:0/3893561515 >> v2:172.21.15.174:3300/0 conn(0x7f10c0104c10 0x7f10c01050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c7487700 1 -- 172.21.15.80:0/3893561515 >> v2:172.21.15.174:3300/0 conn(0x7f10c0104c10 msgr2=0x7f10c01050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c7487700 1 --2- 172.21.15.80:0/3893561515 >> v2:172.21.15.174:3300/0 conn(0x7f10c0104c10 0x7f10c01050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c7487700 1 -- 172.21.15.80:0/3893561515 >> v1:172.21.15.80:6789/0 conn(0x7f10c0104820 legacy=0x7f10c010c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c7487700 1 -- 172.21.15.80:0/3893561515 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c0109a90 con 0x7f10c01055e0 2019-11-28T11:48:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c6485700 1 --2- 172.21.15.80:0/3893561515 >> v2:172.21.15.174:3300/0 conn(0x7f10c0104c10 0x7f10c01050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:48:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10bf7fe700 1 -- 172.21.15.80:0/3893561515 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513131092 0 0) 0x7f10b0001100 con 0x7f10c0104820 2019-11-28T11:48:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c7487700 1 --2- 172.21.15.80:0/3893561515 >> v2:172.21.15.80:3300/0 conn(0x7f10c01055e0 0x7f10c0167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10b8010390 tx=0x7f10b8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c7487700 1 --2- 172.21.15.80:0/3893561515 >> v2:172.21.15.80:3300/0 conn(0x7f10c01055e0 0x7f10c0167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10b8010390 tx=0x7f10b8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.780+0000 7f10c7487700 1 --2- 172.21.15.80:0/3893561515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c01055e0 0x7f10c0167a10 secure :-1 s=READY pgs=1967 cs=0 l=1 rx=0x7f10b8010390 tx=0x7f10b8010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.781+0000 7f10c7487700 1 --2- 172.21.15.80:0/3893561515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c01055e0 0x7f10c0167a10 secure :-1 s=THROTTLE_DONE pgs=1967 cs=0 l=1 rx=0x7f10b8010390 tx=0x7f10b8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.781+0000 7f10bf7fe700 1 -- 172.21.15.80:0/3893561515 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10b8005930 con 0x7f10c01055e0 2019-11-28T11:48:41.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.781+0000 7f10c86e9700 1 -- 172.21.15.80:0/3893561515 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c0109e10 con 0x7f10c01055e0 2019-11-28T11:48:41.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.781+0000 7f10c86e9700 1 -- 172.21.15.80:0/3893561515 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c0109a90 con 0x7f10c01055e0 2019-11-28T11:48:41.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.781+0000 7f10c7487700 1 --2- 172.21.15.80:0/3893561515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c01055e0 0x7f10c0167a10 secure :-1 s=THROTTLE_DONE pgs=1967 cs=0 l=1 rx=0x7f10b8010390 tx=0x7f10b8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.781+0000 7f10bf7fe700 1 -- 172.21.15.80:0/3893561515 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b8005340 con 0x7f10c01055e0 2019-11-28T11:48:41.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.781+0000 7f10c7487700 1 --2- 172.21.15.80:0/3893561515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c01055e0 0x7f10c0167a10 secure :-1 s=THROTTLE_DONE pgs=1967 cs=0 l=1 rx=0x7f10b8010390 tx=0x7f10b8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.781+0000 7f10bf7fe700 1 -- 172.21.15.80:0/3893561515 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10b8005b40 con 0x7f10c01055e0 2019-11-28T11:48:41.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.781+0000 7f10c7487700 1 --2- 172.21.15.80:0/3893561515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c01055e0 0x7f10c0167a10 secure :-1 s=THROTTLE_DONE pgs=1967 cs=0 l=1 rx=0x7f10b8010390 tx=0x7f10b8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.781+0000 7f10bf7fe700 1 -- 172.21.15.80:0/3893561515 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f10b8005530 con 0x7f10c01055e0 2019-11-28T11:48:41.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.781+0000 7f10c7487700 1 --2- 172.21.15.80:0/3893561515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c01055e0 0x7f10c0167a10 secure :-1 s=THROTTLE_DONE pgs=1967 cs=0 l=1 rx=0x7f10b8010390 tx=0x7f10b8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.781+0000 7f10bf7fe700 1 --2- 172.21.15.80:0/3893561515 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10a4018730 0x7f10a401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:41.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.781+0000 7f10bf7fe700 1 -- 172.21.15.80:0/3893561515 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f10b8031c60 con 0x7f10c01055e0 2019-11-28T11:48:41.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.782+0000 7f10c6c86700 1 --2- 172.21.15.80:0/3893561515 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10a4018730 0x7f10a401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:41.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.782+0000 7f10c6c86700 1 --2- 172.21.15.80:0/3893561515 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10a4018730 0x7f10a401abe0 crc :-1 s=READY pgs=793 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:41.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.789+0000 7f10c86e9700 1 -- 172.21.15.80:0/3893561515 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c0109e10 con 0x7f10c01055e0 2019-11-28T11:48:41.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.793+0000 7f10c7487700 1 --2- 172.21.15.80:0/3893561515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c01055e0 0x7f10c0167a10 secure :-1 s=THROTTLE_DONE pgs=1967 cs=0 l=1 rx=0x7f10b8010390 tx=0x7f10b8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:41.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.793+0000 7f10bf7fe700 1 -- 172.21.15.80:0/3893561515 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f10b8005340 con 0x7f10c01055e0 2019-11-28T11:48:42.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.968+0000 7f10c86e9700 1 -- 172.21.15.80:0/3893561515 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10c0109a90 con 0x7f10c01055e0 2019-11-28T11:48:42.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.969+0000 7f10c7487700 1 --2- 172.21.15.80:0/3893561515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c01055e0 0x7f10c0167a10 secure :-1 s=THROTTLE_DONE pgs=1967 cs=0 l=1 rx=0x7f10b8010390 tx=0x7f10b8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.969+0000 7f10bf7fe700 1 -- 172.21.15.80:0/3893561515 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f10b8005550 con 0x7f10c01055e0 2019-11-28T11:48:42.017 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:42.017 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":152,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:48:38.111012+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:48:35.444932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2019-11-28T11:48:36.133221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:48:42.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.971+0000 7f10c86e9700 1 -- 172.21.15.80:0/3893561515 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10a4018730 msgr2=0x7f10a401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.971+0000 7f10c86e9700 1 --2- 172.21.15.80:0/3893561515 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10a4018730 0x7f10a401abe0 crc :-1 s=READY pgs=793 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.971+0000 7f10c86e9700 1 -- 172.21.15.80:0/3893561515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c01055e0 msgr2=0x7f10c0167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.971+0000 7f10c86e9700 1 --2- 172.21.15.80:0/3893561515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c01055e0 0x7f10c0167a10 secure :-1 s=READY pgs=1967 cs=0 l=1 rx=0x7f10b8010390 tx=0x7f10b8010730).stop 2019-11-28T11:48:42.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.971+0000 7f10c86e9700 1 -- 172.21.15.80:0/3893561515 shutdown_connections 2019-11-28T11:48:42.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.971+0000 7f10c86e9700 1 --2- 172.21.15.80:0/3893561515 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10a4018730 0x7f10a401abe0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.971+0000 7f10c86e9700 1 --2- 172.21.15.80:0/3893561515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10c01055e0 0x7f10c0167a10 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.971+0000 7f10c86e9700 1 --2- 172.21.15.80:0/3893561515 >> v2:172.21.15.174:3300/0 conn(0x7f10c0104c10 0x7f10c01050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.971+0000 7f10c86e9700 1 -- 172.21.15.80:0/3893561515 shutdown_connections 2019-11-28T11:48:42.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.971+0000 7f10c86e9700 1 -- 172.21.15.80:0/3893561515 wait complete. 2019-11-28T11:48:42.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:41.971+0000 7f10c86e9700 1 -- 172.21.15.80:0/3893561515 >> 172.21.15.80:0/3893561515 conn(0x7f10c013d620 msgr2=0x7f10c013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:42.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:48:35.444932+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 24, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'151', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:48:36.133221+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 25, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'152', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:48:42.028 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:48:42.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.105+0000 7f8d52e88700 1 Processor -- start 2019-11-28T11:48:42.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.105+0000 7f8d52e88700 1 -- start start 2019-11-28T11:48:42.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.106+0000 7f8d52e88700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8d4c15ed10 0x7f8d4c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:42.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.106+0000 7f8d52e88700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4c06db60 con 0x7f8d4c0734b0 2019-11-28T11:48:42.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.106+0000 7f8d52e88700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4c06e060 con 0x7f8d4c073020 2019-11-28T11:48:42.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.106+0000 7f8d52e88700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4c06fe00 con 0x7f8d4c15ed10 2019-11-28T11:48:42.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d51c26700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8d4c0734b0 0x7f8d4c0726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40868/0 (socket says 172.21.15.80:40868) 2019-11-28T11:48:42.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d51c26700 1 -- 172.21.15.80:0/4160956864 learned_addr learned my addr 172.21.15.80:0/4160956864 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:42.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d51425700 1 --2- 172.21.15.80:0/4160956864 >> v2:172.21.15.174:3300/0 conn(0x7f8d4c15ed10 0x7f8d4c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 -- 172.21.15.80:0/4160956864 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288777159 0 0) 0x7f8d44001150 con 0x7f8d4c0734b0 2019-11-28T11:48:42.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 -- 172.21.15.80:0/4160956864 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d38002e80 con 0x7f8d4c0734b0 2019-11-28T11:48:42.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 -- 172.21.15.80:0/4160956864 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372660773 0 0) 0x7f8d3c001030 con 0x7f8d4c073020 2019-11-28T11:48:42.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 -- 172.21.15.80:0/4160956864 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d380030b0 con 0x7f8d4c073020 2019-11-28T11:48:42.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 -- 172.21.15.80:0/4160956864 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 735136128 0 0) 0x7f8d44001130 con 0x7f8d4c0734b0 2019-11-28T11:48:42.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 -- 172.21.15.80:0/4160956864 >> v2:172.21.15.174:3300/0 conn(0x7f8d4c15ed10 msgr2=0x7f8d4c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:42.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 --2- 172.21.15.80:0/4160956864 >> v2:172.21.15.174:3300/0 conn(0x7f8d4c15ed10 0x7f8d4c15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:42.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 -- 172.21.15.80:0/4160956864 >> v1:172.21.15.174:6789/0 conn(0x7f8d4c073020 legacy=0x7f8d4c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 -- 172.21.15.80:0/4160956864 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c070760 con 0x7f8d4c0734b0 2019-11-28T11:48:42.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 -- 172.21.15.80:0/4160956864 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f8d44001660 con 0x7f8d4c0734b0 2019-11-28T11:48:42.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 -- 172.21.15.80:0/4160956864 >> v1:172.21.15.80:6789/0 conn(0x7f8d4c0734b0 legacy=0x7f8d4c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 --2- 172.21.15.80:0/4160956864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d38003b30 0x7f8d38005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:42.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 --2- 172.21.15.80:0/4160956864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d38006680 0x7f8d38008b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:42.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 --2- 172.21.15.80:0/4160956864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d3804d3c0 0x7f8d3804f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:42.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 -- 172.21.15.80:0/4160956864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d38050040 con 0x7f8d38003b30 2019-11-28T11:48:42.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 -- 172.21.15.80:0/4160956864 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d38050270 con 0x7f8d3804d3c0 2019-11-28T11:48:42.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d4bfff700 1 -- 172.21.15.80:0/4160956864 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380504a0 con 0x7f8d38006680 2019-11-28T11:48:42.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d51425700 1 --2- 172.21.15.80:0/4160956864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d38003b30 0x7f8d38005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d51c26700 1 --2- 172.21.15.80:0/4160956864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d3804d3c0 0x7f8d3804f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.107+0000 7f8d50c24700 1 --2- 172.21.15.80:0/4160956864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d38006680 0x7f8d38008b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d51425700 1 -- 172.21.15.80:0/4160956864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d38006680 msgr2=0x7f8d38008b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:42.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d51425700 1 --2- 172.21.15.80:0/4160956864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d38006680 0x7f8d38008b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:42.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d51425700 1 -- 172.21.15.80:0/4160956864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d3804d3c0 msgr2=0x7f8d3804f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:42.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d51425700 1 --2- 172.21.15.80:0/4160956864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d3804d3c0 0x7f8d3804f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:42.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d51425700 1 -- 172.21.15.80:0/4160956864 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d38050750 con 0x7f8d38003b30 2019-11-28T11:48:42.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d51c26700 1 -- 172.21.15.80:0/4160956864 reap_dead start 2019-11-28T11:48:42.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d51425700 1 --2- 172.21.15.80:0/4160956864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d38003b30 0x7f8d38005f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8d3400ba60 tx=0x7f8d3400ae30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d51425700 1 --2- 172.21.15.80:0/4160956864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d38003b30 0x7f8d38005f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8d3400ba60 tx=0x7f8d3400ae30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d51425700 1 --2- 172.21.15.80:0/4160956864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d38003b30 0x7f8d38005f90 secure :-1 s=READY pgs=1969 cs=0 l=1 rx=0x7f8d3400ba60 tx=0x7f8d3400ae30).ready entity=mon.0 client_cookie=ab5a6acb4ccb7ca2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:42.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d51425700 1 --2- 172.21.15.80:0/4160956864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d38003b30 0x7f8d38005f90 secure :-1 s=THROTTLE_DONE pgs=1969 cs=0 l=1 rx=0x7f8d3400ba60 tx=0x7f8d3400ae30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d51425700 1 --2- 172.21.15.80:0/4160956864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d38003b30 0x7f8d38005f90 secure :-1 s=THROTTLE_DONE pgs=1969 cs=0 l=1 rx=0x7f8d3400ba60 tx=0x7f8d3400ae30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d4bfff700 1 -- 172.21.15.80:0/4160956864 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d34000ce0 con 0x7f8d38003b30 2019-11-28T11:48:42.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d51425700 1 --2- 172.21.15.80:0/4160956864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d38003b30 0x7f8d38005f90 secure :-1 s=THROTTLE_DONE pgs=1969 cs=0 l=1 rx=0x7f8d3400ba60 tx=0x7f8d3400ae30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d4bfff700 1 -- 172.21.15.80:0/4160956864 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d34009af0 con 0x7f8d38003b30 2019-11-28T11:48:42.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d4bfff700 1 -- 172.21.15.80:0/4160956864 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d3400a200 con 0x7f8d38003b30 2019-11-28T11:48:42.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d52e88700 1 -- 172.21.15.80:0/4160956864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d38003b30 msgr2=0x7f8d38005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.108+0000 7f8d52e88700 1 --2- 172.21.15.80:0/4160956864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d38003b30 0x7f8d38005f90 secure :-1 s=READY pgs=1969 cs=0 l=1 rx=0x7f8d3400ba60 tx=0x7f8d3400ae30).stop 2019-11-28T11:48:42.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.109+0000 7f8d52e88700 1 -- 172.21.15.80:0/4160956864 shutdown_connections 2019-11-28T11:48:42.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.109+0000 7f8d52e88700 1 --2- 172.21.15.80:0/4160956864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d38003b30 0x7f8d38005f90 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.109+0000 7f8d52e88700 1 -- 172.21.15.80:0/4160956864 shutdown_connections 2019-11-28T11:48:42.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.109+0000 7f8d52e88700 1 -- 172.21.15.80:0/4160956864 wait complete. 2019-11-28T11:48:42.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.109+0000 7f8d52e88700 1 -- 172.21.15.80:0/4160956864 >> 172.21.15.80:0/4160956864 conn(0x7f8d4c061d20 msgr2=0x7f8d4c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:42.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.111+0000 7f8d52e88700 1 Processor -- start 2019-11-28T11:48:42.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.111+0000 7f8d52e88700 1 -- start start 2019-11-28T11:48:42.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.112+0000 7f8d52e88700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d4c108630 0x7f8d4c151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:42.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.112+0000 7f8d52e88700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8d4c151740 0x7f8d4c1502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:42.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.112+0000 7f8d52e88700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8d4c150820 0x7f8d4c12fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:42.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.112+0000 7f8d52e88700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4c130f50 con 0x7f8d4c151740 2019-11-28T11:48:42.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.112+0000 7f8d52e88700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4c131980 con 0x7f8d4c150820 2019-11-28T11:48:42.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.112+0000 7f8d52e88700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c1322e0 con 0x7f8d4c108630 2019-11-28T11:48:42.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.112+0000 7f8d50c24700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8d4c151740 0x7f8d4c1502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.112+0000 7f8d50c24700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8d4c151740 0x7f8d4c1502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41564/0 (socket says 172.21.15.80:41564) 2019-11-28T11:48:42.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.112+0000 7f8d50c24700 1 -- 172.21.15.80:0/1182611757 learned_addr learned my addr 172.21.15.80:0/1182611757 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:42.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.112+0000 7f8d51425700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d4c108630 0x7f8d4c151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.112+0000 7f8d51c26700 1 --2- 172.21.15.80:0/1182611757 >> v2:172.21.15.174:3300/0 conn(0x7f8d4c150820 0x7f8d4c12fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.112+0000 7f8d50c24700 1 -- 172.21.15.80:0/1182611757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d4c108630 msgr2=0x7f8d4c151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.112+0000 7f8d50c24700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d4c108630 0x7f8d4c151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.112+0000 7f8d50c24700 1 -- 172.21.15.80:0/1182611757 >> v2:172.21.15.174:3300/0 conn(0x7f8d4c150820 msgr2=0x7f8d4c12fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.112+0000 7f8d50c24700 1 --2- 172.21.15.80:0/1182611757 >> v2:172.21.15.174:3300/0 conn(0x7f8d4c150820 0x7f8d4c12fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.112+0000 7f8d50c24700 1 -- 172.21.15.80:0/1182611757 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c132660 con 0x7f8d4c151740 2019-11-28T11:48:42.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.113+0000 7f8d50c24700 1 --2- 172.21.15.80:0/1182611757 >> v2:172.21.15.80:3300/0 conn(0x7f8d4c151740 0x7f8d4c1502e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d3c010440 tx=0x7f8d3c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.113+0000 7f8d50c24700 1 --2- 172.21.15.80:0/1182611757 >> v2:172.21.15.80:3300/0 conn(0x7f8d4c151740 0x7f8d4c1502e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d3c010440 tx=0x7f8d3c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.113+0000 7f8d50c24700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d4c151740 0x7f8d4c1502e0 secure :-1 s=READY pgs=1970 cs=0 l=1 rx=0x7f8d3c010440 tx=0x7f8d3c0102f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:42.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.113+0000 7f8d50c24700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d4c151740 0x7f8d4c1502e0 secure :-1 s=THROTTLE_DONE pgs=1970 cs=0 l=1 rx=0x7f8d3c010440 tx=0x7f8d3c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.113+0000 7f8d50c24700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d4c151740 0x7f8d4c1502e0 secure :-1 s=THROTTLE_DONE pgs=1970 cs=0 l=1 rx=0x7f8d3c010440 tx=0x7f8d3c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.113+0000 7f8d49ffb700 1 -- 172.21.15.80:0/1182611757 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d3c000940 con 0x7f8d4c151740 2019-11-28T11:48:42.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.113+0000 7f8d50c24700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d4c151740 0x7f8d4c1502e0 secure :-1 s=THROTTLE_DONE pgs=1970 cs=0 l=1 rx=0x7f8d3c010440 tx=0x7f8d3c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.113+0000 7f8d49ffb700 1 -- 172.21.15.80:0/1182611757 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c0051c0 con 0x7f8d4c151740 2019-11-28T11:48:42.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.113+0000 7f8d49ffb700 1 -- 172.21.15.80:0/1182611757 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d3c005890 con 0x7f8d4c151740 2019-11-28T11:48:42.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.113+0000 7f8d52e88700 1 -- 172.21.15.80:0/1182611757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4c132660 con 0x7f8d4c151740 2019-11-28T11:48:42.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.113+0000 7f8d52e88700 1 -- 172.21.15.80:0/1182611757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4c132660 con 0x7f8d4c151740 2019-11-28T11:48:42.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.113+0000 7f8d50c24700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d4c151740 0x7f8d4c1502e0 secure :-1 s=THROTTLE_DONE pgs=1970 cs=0 l=1 rx=0x7f8d3c010440 tx=0x7f8d3c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.113+0000 7f8d49ffb700 1 -- 172.21.15.80:0/1182611757 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8d3c0053b0 con 0x7f8d4c151740 2019-11-28T11:48:42.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.113+0000 7f8d50c24700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d4c151740 0x7f8d4c1502e0 secure :-1 s=THROTTLE_DONE pgs=1970 cs=0 l=1 rx=0x7f8d3c010440 tx=0x7f8d3c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.114+0000 7f8d49ffb700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8d30018730 0x7f8d3001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:42.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.114+0000 7f8d49ffb700 1 -- 172.21.15.80:0/1182611757 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8d3c031a90 con 0x7f8d4c151740 2019-11-28T11:48:42.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.114+0000 7f8d51425700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8d30018730 0x7f8d3001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.114+0000 7f8d51425700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8d30018730 0x7f8d3001abc0 crc :-1 s=READY pgs=794 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:42.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.122+0000 7f8d52e88700 1 -- 172.21.15.80:0/1182611757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4c132660 con 0x7f8d4c151740 2019-11-28T11:48:42.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.125+0000 7f8d50c24700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d4c151740 0x7f8d4c1502e0 secure :-1 s=THROTTLE_DONE pgs=1970 cs=0 l=1 rx=0x7f8d3c010440 tx=0x7f8d3c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.125+0000 7f8d49ffb700 1 -- 172.21.15.80:0/1182611757 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8d3c006500 con 0x7f8d4c151740 2019-11-28T11:48:42.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.290+0000 7f8d52e88700 1 -- 172.21.15.80:0/1182611757 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f8d4c132660 con 0x7f8d4c151740 2019-11-28T11:48:42.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.290+0000 7f8d50c24700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d4c151740 0x7f8d4c1502e0 secure :-1 s=THROTTLE_DONE pgs=1970 cs=0 l=1 rx=0x7f8d3c010440 tx=0x7f8d3c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.290+0000 7f8d49ffb700 1 -- 172.21.15.80:0/1182611757 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v152) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8d3c0175c0 con 0x7f8d4c151740 2019-11-28T11:48:42.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.293+0000 7f8d52e88700 1 -- 172.21.15.80:0/1182611757 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8d30018730 msgr2=0x7f8d3001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.293+0000 7f8d52e88700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8d30018730 0x7f8d3001abc0 crc :-1 s=READY pgs=794 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.293+0000 7f8d52e88700 1 -- 172.21.15.80:0/1182611757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d4c151740 msgr2=0x7f8d4c1502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.293+0000 7f8d52e88700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d4c151740 0x7f8d4c1502e0 secure :-1 s=READY pgs=1970 cs=0 l=1 rx=0x7f8d3c010440 tx=0x7f8d3c0102f0).stop 2019-11-28T11:48:42.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.293+0000 7f8d52e88700 1 -- 172.21.15.80:0/1182611757 shutdown_connections 2019-11-28T11:48:42.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.293+0000 7f8d52e88700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8d30018730 0x7f8d3001abc0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.293+0000 7f8d52e88700 1 --2- 172.21.15.80:0/1182611757 >> v2:172.21.15.174:3300/0 conn(0x7f8d4c150820 0x7f8d4c12fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.293+0000 7f8d52e88700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d4c151740 0x7f8d4c1502e0 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.293+0000 7f8d52e88700 1 --2- 172.21.15.80:0/1182611757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8d4c108630 0x7f8d4c151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.293+0000 7f8d52e88700 1 -- 172.21.15.80:0/1182611757 shutdown_connections 2019-11-28T11:48:42.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.293+0000 7f8d52e88700 1 -- 172.21.15.80:0/1182611757 wait complete. 2019-11-28T11:48:42.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.293+0000 7f8d52e88700 1 -- 172.21.15.80:0/1182611757 >> 172.21.15.80:0/1182611757 conn(0x7f8d4c14dbb0 msgr2=0x7f8d4c142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:42.344 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:48:42.349 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:48:42.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.427+0000 7ffa250df700 1 Processor -- start 2019-11-28T11:48:42.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.428+0000 7ffa250df700 1 -- start start 2019-11-28T11:48:42.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa250df700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffa2015ed10 0x7ffa2015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:42.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa250df700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffa200734b0 0x7ffa200726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:42.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa250df700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2006db60 con 0x7ffa20073020 2019-11-28T11:48:42.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa250df700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2006fe00 con 0x7ffa200734b0 2019-11-28T11:48:42.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa250df700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa200700d0 con 0x7ffa2015ed10 2019-11-28T11:48:42.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa248de700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffa200734b0 0x7ffa200726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa248de700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffa200734b0 0x7ffa200726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41574/0 (socket says 172.21.15.80:41574) 2019-11-28T11:48:42.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa1ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ffa20073020 0x7ffa20071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40886/0 (socket says 172.21.15.80:40886) 2019-11-28T11:48:42.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa248de700 1 -- 172.21.15.80:0/3550061846 learned_addr learned my addr 172.21.15.80:0/3550061846 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:42.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa1f59e700 1 --2- 172.21.15.80:0/3550061846 >> v2:172.21.15.174:3300/0 conn(0x7ffa2015ed10 0x7ffa2015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa248de700 1 -- 172.21.15.80:0/3550061846 >> v2:172.21.15.174:3300/0 conn(0x7ffa2015ed10 msgr2=0x7ffa2015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:42.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa248de700 1 --2- 172.21.15.80:0/3550061846 >> v2:172.21.15.174:3300/0 conn(0x7ffa2015ed10 0x7ffa2015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:42.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa248de700 1 -- 172.21.15.80:0/3550061846 >> v1:172.21.15.80:6789/0 conn(0x7ffa20073020 legacy=0x7ffa20071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa1e59c700 1 -- 172.21.15.80:0/3550061846 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3644060346 0 0) 0x7ffa08001100 con 0x7ffa20073020 2019-11-28T11:48:42.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa248de700 1 -- 172.21.15.80:0/3550061846 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa20070760 con 0x7ffa200734b0 2019-11-28T11:48:42.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa248de700 1 --2- 172.21.15.80:0/3550061846 >> v2:172.21.15.80:3300/0 conn(0x7ffa200734b0 0x7ffa200726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffa1000f6b0 tx=0x7ffa1000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa248de700 1 --2- 172.21.15.80:0/3550061846 >> v2:172.21.15.80:3300/0 conn(0x7ffa200734b0 0x7ffa200726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffa1000f6b0 tx=0x7ffa1000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa248de700 1 --2- 172.21.15.80:0/3550061846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa200734b0 0x7ffa200726a0 secure :-1 s=READY pgs=1972 cs=0 l=1 rx=0x7ffa1000f6b0 tx=0x7ffa1000fa50).ready entity=mon.0 client_cookie=1d8f658cec6ae1bb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:42.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa248de700 1 --2- 172.21.15.80:0/3550061846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa200734b0 0x7ffa200726a0 secure :-1 s=THROTTLE_DONE pgs=1972 cs=0 l=1 rx=0x7ffa1000f6b0 tx=0x7ffa1000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa1e59c700 1 -- 172.21.15.80:0/3550061846 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa10000a70 con 0x7ffa200734b0 2019-11-28T11:48:42.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa248de700 1 --2- 172.21.15.80:0/3550061846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa200734b0 0x7ffa200726a0 secure :-1 s=THROTTLE_DONE pgs=1972 cs=0 l=1 rx=0x7ffa1000f6b0 tx=0x7ffa1000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa248de700 1 --2- 172.21.15.80:0/3550061846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa200734b0 0x7ffa200726a0 secure :-1 s=THROTTLE_DONE pgs=1972 cs=0 l=1 rx=0x7ffa1000f6b0 tx=0x7ffa1000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa1e59c700 1 -- 172.21.15.80:0/3550061846 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa100010e0 con 0x7ffa200734b0 2019-11-28T11:48:42.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa1e59c700 1 -- 172.21.15.80:0/3550061846 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa10001350 con 0x7ffa200734b0 2019-11-28T11:48:42.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa250df700 1 -- 172.21.15.80:0/3550061846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa200734b0 msgr2=0x7ffa200726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.429+0000 7ffa250df700 1 --2- 172.21.15.80:0/3550061846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa200734b0 0x7ffa200726a0 secure :-1 s=READY pgs=1972 cs=0 l=1 rx=0x7ffa1000f6b0 tx=0x7ffa1000fa50).stop 2019-11-28T11:48:42.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.430+0000 7ffa250df700 1 -- 172.21.15.80:0/3550061846 shutdown_connections 2019-11-28T11:48:42.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.430+0000 7ffa250df700 1 --2- 172.21.15.80:0/3550061846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa200734b0 0x7ffa200726a0 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.430+0000 7ffa250df700 1 --2- 172.21.15.80:0/3550061846 >> v2:172.21.15.174:3300/0 conn(0x7ffa2015ed10 0x7ffa2015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:42.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.430+0000 7ffa250df700 1 -- 172.21.15.80:0/3550061846 shutdown_connections 2019-11-28T11:48:42.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.430+0000 7ffa250df700 1 -- 172.21.15.80:0/3550061846 wait complete. 2019-11-28T11:48:42.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.430+0000 7ffa250df700 1 -- 172.21.15.80:0/3550061846 >> 172.21.15.80:0/3550061846 conn(0x7ffa20061d20 msgr2=0x7ffa200641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:42.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.432+0000 7ffa250df700 1 Processor -- start 2019-11-28T11:48:42.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.433+0000 7ffa250df700 1 -- start start 2019-11-28T11:48:42.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.433+0000 7ffa250df700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffa2010e970 0x7ffa201087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:42.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.433+0000 7ffa250df700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2010c250 con 0x7ffa20107e30 2019-11-28T11:48:42.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.433+0000 7ffa250df700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2010c6d0 con 0x7ffa20108cf0 2019-11-28T11:48:42.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.433+0000 7ffa250df700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2010e430 con 0x7ffa2010e970 2019-11-28T11:48:42.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.433+0000 7ffa248de700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ffa20107e30 0x7ffa20167d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40894/0 (socket says 172.21.15.80:40894) 2019-11-28T11:48:42.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.433+0000 7ffa248de700 1 -- 172.21.15.80:0/4159038330 learned_addr learned my addr 172.21.15.80:0/4159038330 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:42.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa1f59e700 1 --2- 172.21.15.80:0/4159038330 >> v2:172.21.15.174:3300/0 conn(0x7ffa2010e970 0x7ffa201087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa17fff700 1 -- 172.21.15.80:0/4159038330 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316291806 0 0) 0x7ffa10000b50 con 0x7ffa20107e30 2019-11-28T11:48:42.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa17fff700 1 -- 172.21.15.80:0/4159038330 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa04002e80 con 0x7ffa20107e30 2019-11-28T11:48:42.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa1f59e700 1 -- 172.21.15.80:0/4159038330 >> v1:172.21.15.174:6789/0 conn(0x7ffa20108cf0 legacy=0x7ffa20107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa1f59e700 1 -- 172.21.15.80:0/4159038330 >> v1:172.21.15.80:6789/0 conn(0x7ffa20107e30 legacy=0x7ffa20167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa1f59e700 1 -- 172.21.15.80:0/4159038330 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa20105ef0 con 0x7ffa2010e970 2019-11-28T11:48:42.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa1f59e700 1 --2- 172.21.15.80:0/4159038330 >> v2:172.21.15.174:3300/0 conn(0x7ffa2010e970 0x7ffa201087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa18010730 tx=0x7ffa18010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa1f59e700 1 --2- 172.21.15.80:0/4159038330 >> v2:172.21.15.174:3300/0 conn(0x7ffa2010e970 0x7ffa201087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa18010730 tx=0x7ffa18010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa1f59e700 1 --2- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2010e970 0x7ffa201087b0 secure :-1 s=READY pgs=1155 cs=0 l=1 rx=0x7ffa18010730 tx=0x7ffa18010ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:42.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa1f59e700 1 --2- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2010e970 0x7ffa201087b0 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7ffa18010730 tx=0x7ffa18010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa17fff700 1 -- 172.21.15.80:0/4159038330 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa18000cc0 con 0x7ffa2010e970 2019-11-28T11:48:42.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa1f59e700 1 --2- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2010e970 0x7ffa201087b0 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7ffa18010730 tx=0x7ffa18010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa17fff700 1 -- 172.21.15.80:0/4159038330 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa18005900 con 0x7ffa2010e970 2019-11-28T11:48:42.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa1f59e700 1 --2- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2010e970 0x7ffa201087b0 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7ffa18010730 tx=0x7ffa18010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa250df700 1 -- 172.21.15.80:0/4159038330 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa20106270 con 0x7ffa2010e970 2019-11-28T11:48:42.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa17fff700 1 -- 172.21.15.80:0/4159038330 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa18005af0 con 0x7ffa2010e970 2019-11-28T11:48:42.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.434+0000 7ffa250df700 1 -- 172.21.15.80:0/4159038330 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa20105ef0 con 0x7ffa2010e970 2019-11-28T11:48:42.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.435+0000 7ffa1f59e700 1 --2- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2010e970 0x7ffa201087b0 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7ffa18010730 tx=0x7ffa18010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.435+0000 7ffa17fff700 1 -- 172.21.15.80:0/4159038330 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ffa18005af0 con 0x7ffa2010e970 2019-11-28T11:48:42.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.435+0000 7ffa1f59e700 1 --2- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2010e970 0x7ffa201087b0 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7ffa18010730 tx=0x7ffa18010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.435+0000 7ffa17fff700 1 --2- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffa04018770 0x7ffa0401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:42.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.435+0000 7ffa17fff700 1 -- 172.21.15.80:0/4159038330 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ffa18031de0 con 0x7ffa2010e970 2019-11-28T11:48:42.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.435+0000 7ffa1ed9d700 1 --2- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffa04018770 0x7ffa0401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.435+0000 7ffa1ed9d700 1 --2- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffa04018770 0x7ffa0401abe0 crc :-1 s=READY pgs=795 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:42.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.443+0000 7ffa250df700 1 -- 172.21.15.80:0/4159038330 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa20106270 con 0x7ffa2010e970 2019-11-28T11:48:42.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.447+0000 7ffa1f59e700 1 --2- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2010e970 0x7ffa201087b0 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7ffa18010730 tx=0x7ffa18010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.447+0000 7ffa17fff700 1 -- 172.21.15.80:0/4159038330 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ffa18014bd0 con 0x7ffa2010e970 2019-11-28T11:48:42.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.614+0000 7ffa250df700 1 -- 172.21.15.80:0/4159038330 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7ffa20105ef0 con 0x7ffa2010e970 2019-11-28T11:48:42.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.615+0000 7ffa1f59e700 1 --2- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2010e970 0x7ffa201087b0 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7ffa18010730 tx=0x7ffa18010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.615+0000 7ffa17fff700 1 -- 172.21.15.80:0/4159038330 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v152) v1 ==== 104+0+10 (secure 0 0 0) 0x7ffa18014bd0 con 0x7ffa2010e970 2019-11-28T11:48:42.661 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:48:42.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.617+0000 7ffa250df700 1 -- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffa04018770 msgr2=0x7ffa0401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.617+0000 7ffa250df700 1 --2- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffa04018770 0x7ffa0401abe0 crc :-1 s=READY pgs=795 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.617+0000 7ffa250df700 1 -- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2010e970 msgr2=0x7ffa201087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.617+0000 7ffa250df700 1 --2- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2010e970 0x7ffa201087b0 secure :-1 s=READY pgs=1155 cs=0 l=1 rx=0x7ffa18010730 tx=0x7ffa18010ad0).stop 2019-11-28T11:48:42.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.617+0000 7ffa250df700 1 -- 172.21.15.80:0/4159038330 shutdown_connections 2019-11-28T11:48:42.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.617+0000 7ffa250df700 1 --2- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ffa04018770 0x7ffa0401abe0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.617+0000 7ffa250df700 1 --2- 172.21.15.80:0/4159038330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa2010e970 0x7ffa201087b0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.617+0000 7ffa250df700 1 -- 172.21.15.80:0/4159038330 shutdown_connections 2019-11-28T11:48:42.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.617+0000 7ffa250df700 1 -- 172.21.15.80:0/4159038330 wait complete. 2019-11-28T11:48:42.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.617+0000 7ffa250df700 1 -- 172.21.15.80:0/4159038330 >> 172.21.15.80:0/4159038330 conn(0x7ffa2015e2d0 msgr2=0x7ffa20147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:42.672 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:48:42.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.752+0000 7f8b3aa62700 1 Processor -- start 2019-11-28T11:48:42.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.752+0000 7f8b3aa62700 1 -- start start 2019-11-28T11:48:42.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.753+0000 7f8b3aa62700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b3415ed10 0x7f8b3415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:42.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.753+0000 7f8b3aa62700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8b34073020 0x7f8b34071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:42.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.753+0000 7f8b3aa62700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8b340734b0 0x7f8b340723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:42.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.753+0000 7f8b3aa62700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3406f3d0 con 0x7f8b34073020 2019-11-28T11:48:42.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.753+0000 7f8b3aa62700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3406fe00 con 0x7f8b340734b0 2019-11-28T11:48:42.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.753+0000 7f8b3aa62700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b34070760 con 0x7f8b3415ed10 2019-11-28T11:48:42.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b33fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8b34073020 0x7f8b34071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b33fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8b34073020 0x7f8b34071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41584/0 (socket says 172.21.15.80:41584) 2019-11-28T11:48:42.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b33fff700 1 -- 172.21.15.80:0/1883234083 learned_addr learned my addr 172.21.15.80:0/1883234083 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:42.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b38fff700 1 --2- 172.21.15.80:0/1883234083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b3415ed10 0x7f8b3415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b39800700 1 --2- 172.21.15.80:0/1883234083 >> v2:172.21.15.174:3300/0 conn(0x7f8b340734b0 0x7f8b340723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b33fff700 1 -- 172.21.15.80:0/1883234083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b3415ed10 msgr2=0x7f8b3415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:42.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b33fff700 1 --2- 172.21.15.80:0/1883234083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b3415ed10 0x7f8b3415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:42.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b33fff700 1 -- 172.21.15.80:0/1883234083 >> v2:172.21.15.174:3300/0 conn(0x7f8b340734b0 msgr2=0x7f8b340723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:42.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b33fff700 1 --2- 172.21.15.80:0/1883234083 >> v2:172.21.15.174:3300/0 conn(0x7f8b340734b0 0x7f8b340723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:42.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b33fff700 1 -- 172.21.15.80:0/1883234083 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b34070ae0 con 0x7f8b34073020 2019-11-28T11:48:42.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b38fff700 1 --2- 172.21.15.80:0/1883234083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b3415ed10 0x7f8b3415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:48:42.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b39800700 1 --2- 172.21.15.80:0/1883234083 >> v2:172.21.15.174:3300/0 conn(0x7f8b340734b0 0x7f8b340723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:48:42.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b33fff700 1 --2- 172.21.15.80:0/1883234083 >> v2:172.21.15.80:3300/0 conn(0x7f8b34073020 0x7f8b34071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8b2000f740 tx=0x7f8b2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b33fff700 1 --2- 172.21.15.80:0/1883234083 >> v2:172.21.15.80:3300/0 conn(0x7f8b34073020 0x7f8b34071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8b2000f740 tx=0x7f8b2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b33fff700 1 --2- 172.21.15.80:0/1883234083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b34073020 0x7f8b34071ea0 secure :-1 s=READY pgs=1974 cs=0 l=1 rx=0x7f8b2000f740 tx=0x7f8b2000fae0).ready entity=mon.0 client_cookie=8c46a8eab4df2eb7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:42.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b33fff700 1 --2- 172.21.15.80:0/1883234083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b34073020 0x7f8b34071ea0 secure :-1 s=THROTTLE_DONE pgs=1974 cs=0 l=1 rx=0x7f8b2000f740 tx=0x7f8b2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b33fff700 1 --2- 172.21.15.80:0/1883234083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b34073020 0x7f8b34071ea0 secure :-1 s=THROTTLE_DONE pgs=1974 cs=0 l=1 rx=0x7f8b2000f740 tx=0x7f8b2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b337fe700 1 -- 172.21.15.80:0/1883234083 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b20000960 con 0x7f8b34073020 2019-11-28T11:48:42.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b33fff700 1 --2- 172.21.15.80:0/1883234083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b34073020 0x7f8b34071ea0 secure :-1 s=THROTTLE_DONE pgs=1974 cs=0 l=1 rx=0x7f8b2000f740 tx=0x7f8b2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b337fe700 1 -- 172.21.15.80:0/1883234083 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b20000e80 con 0x7f8b34073020 2019-11-28T11:48:42.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b337fe700 1 -- 172.21.15.80:0/1883234083 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b200015d0 con 0x7f8b34073020 2019-11-28T11:48:42.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b3aa62700 1 -- 172.21.15.80:0/1883234083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b34073020 msgr2=0x7f8b34071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.754+0000 7f8b3aa62700 1 --2- 172.21.15.80:0/1883234083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b34073020 0x7f8b34071ea0 secure :-1 s=READY pgs=1974 cs=0 l=1 rx=0x7f8b2000f740 tx=0x7f8b2000fae0).stop 2019-11-28T11:48:42.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.755+0000 7f8b3aa62700 1 -- 172.21.15.80:0/1883234083 shutdown_connections 2019-11-28T11:48:42.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.755+0000 7f8b3aa62700 1 --2- 172.21.15.80:0/1883234083 >> v2:172.21.15.174:3300/0 conn(0x7f8b340734b0 0x7f8b340723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:42.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.755+0000 7f8b3aa62700 1 --2- 172.21.15.80:0/1883234083 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b34073020 0x7f8b34071ea0 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.755+0000 7f8b3aa62700 1 --2- 172.21.15.80:0/1883234083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b3415ed10 0x7f8b3415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:42.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.755+0000 7f8b3aa62700 1 -- 172.21.15.80:0/1883234083 shutdown_connections 2019-11-28T11:48:42.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.755+0000 7f8b3aa62700 1 -- 172.21.15.80:0/1883234083 wait complete. 2019-11-28T11:48:42.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.755+0000 7f8b3aa62700 1 -- 172.21.15.80:0/1883234083 >> 172.21.15.80:0/1883234083 conn(0x7f8b34061d20 msgr2=0x7f8b340641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:42.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.757+0000 7f8b3aa62700 1 Processor -- start 2019-11-28T11:48:42.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.757+0000 7f8b3aa62700 1 -- start start 2019-11-28T11:48:42.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.758+0000 7f8b3aa62700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8b34148320 0x7f8b3410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:42.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.758+0000 7f8b3aa62700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b3410f290 0x7f8b3410dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:42.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.759+0000 7f8b3aa62700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b34148e00 con 0x7f8b3410e110 2019-11-28T11:48:42.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.759+0000 7f8b3aa62700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3413aa20 con 0x7f8b34148320 2019-11-28T11:48:42.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.759+0000 7f8b3aa62700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3413acf0 con 0x7f8b3410f290 2019-11-28T11:48:42.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.759+0000 7f8b38fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8b34148320 0x7f8b3410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.759+0000 7f8b33fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b3410f290 0x7f8b3410dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.759+0000 7f8b39800700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f8b3410e110 0x7f8b341079b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:56454/0 (socket says 172.21.15.80:56454) 2019-11-28T11:48:42.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.759+0000 7f8b38fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8b34148320 0x7f8b3410ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:56476/0 (socket says 172.21.15.80:56476) 2019-11-28T11:48:42.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.759+0000 7f8b39800700 1 -- 172.21.15.80:0/3264714206 learned_addr learned my addr 172.21.15.80:0/3264714206 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:42.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.759+0000 7f8b38fff700 1 -- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b3410f290 msgr2=0x7f8b3410dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.759+0000 7f8b38fff700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b3410f290 0x7f8b3410dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.759+0000 7f8b38fff700 1 -- 172.21.15.80:0/3264714206 >> v1:172.21.15.174:6789/0 conn(0x7f8b3410e110 legacy=0x7f8b341079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.759+0000 7f8b38fff700 1 -- 172.21.15.80:0/3264714206 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3410c490 con 0x7f8b34148320 2019-11-28T11:48:42.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.759+0000 7f8b317fa700 1 -- 172.21.15.80:0/3264714206 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2832053883 0 0) 0x7f8b2c009e50 con 0x7f8b3410e110 2019-11-28T11:48:42.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.759+0000 7f8b38fff700 1 --2- 172.21.15.80:0/3264714206 >> v2:172.21.15.174:3300/0 conn(0x7f8b34148320 0x7f8b3410ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8b28010350 tx=0x7f8b280101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.759+0000 7f8b38fff700 1 --2- 172.21.15.80:0/3264714206 >> v2:172.21.15.174:3300/0 conn(0x7f8b34148320 0x7f8b3410ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8b28010350 tx=0x7f8b280101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.759+0000 7f8b38fff700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b34148320 0x7f8b3410ed50 secure :-1 s=READY pgs=1157 cs=0 l=1 rx=0x7f8b28010350 tx=0x7f8b280101d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:42.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.760+0000 7f8b38fff700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b34148320 0x7f8b3410ed50 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8b28010350 tx=0x7f8b280101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.760+0000 7f8b317fa700 1 -- 172.21.15.80:0/3264714206 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b28000db0 con 0x7f8b34148320 2019-11-28T11:48:42.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.760+0000 7f8b38fff700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b34148320 0x7f8b3410ed50 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8b28010350 tx=0x7f8b280101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.760+0000 7f8b38fff700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b34148320 0x7f8b3410ed50 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8b28010350 tx=0x7f8b280101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.760+0000 7f8b317fa700 1 -- 172.21.15.80:0/3264714206 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b280097a0 con 0x7f8b34148320 2019-11-28T11:48:42.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.760+0000 7f8b3aa62700 1 -- 172.21.15.80:0/3264714206 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3410c810 con 0x7f8b34148320 2019-11-28T11:48:42.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.760+0000 7f8b317fa700 1 -- 172.21.15.80:0/3264714206 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b28001390 con 0x7f8b34148320 2019-11-28T11:48:42.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.760+0000 7f8b3aa62700 1 -- 172.21.15.80:0/3264714206 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3410c490 con 0x7f8b34148320 2019-11-28T11:48:42.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.760+0000 7f8b38fff700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b34148320 0x7f8b3410ed50 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8b28010350 tx=0x7f8b280101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.760+0000 7f8b317fa700 1 -- 172.21.15.80:0/3264714206 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8b28000bc0 con 0x7f8b34148320 2019-11-28T11:48:42.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.760+0000 7f8b38fff700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b34148320 0x7f8b3410ed50 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8b28010350 tx=0x7f8b280101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.760+0000 7f8b317fa700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b14018730 0x7f8b1401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:42.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.760+0000 7f8b317fa700 1 -- 172.21.15.80:0/3264714206 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8b28031a10 con 0x7f8b34148320 2019-11-28T11:48:42.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.761+0000 7f8b33fff700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b14018730 0x7f8b1401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:42.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.761+0000 7f8b33fff700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b14018730 0x7f8b1401abc0 crc :-1 s=READY pgs=796 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:42.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.767+0000 7f8b3aa62700 1 -- 172.21.15.80:0/3264714206 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3410c810 con 0x7f8b34148320 2019-11-28T11:48:42.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.771+0000 7f8b38fff700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b34148320 0x7f8b3410ed50 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8b28010350 tx=0x7f8b280101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.771+0000 7f8b317fa700 1 -- 172.21.15.80:0/3264714206 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8b28000940 con 0x7f8b34148320 2019-11-28T11:48:42.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.941+0000 7f8b3aa62700 1 -- 172.21.15.80:0/3264714206 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f8b3410c490 con 0x7f8b34148320 2019-11-28T11:48:42.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.942+0000 7f8b38fff700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b34148320 0x7f8b3410ed50 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8b28010350 tx=0x7f8b280101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:42.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.942+0000 7f8b317fa700 1 -- 172.21.15.80:0/3264714206 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v152) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8b28000b50 con 0x7f8b34148320 2019-11-28T11:48:42.988 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:48:42.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.944+0000 7f8b3aa62700 1 -- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b14018730 msgr2=0x7f8b1401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.944+0000 7f8b3aa62700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b14018730 0x7f8b1401abc0 crc :-1 s=READY pgs=796 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.944+0000 7f8b3aa62700 1 -- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b34148320 msgr2=0x7f8b3410ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:42.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.944+0000 7f8b3aa62700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b34148320 0x7f8b3410ed50 secure :-1 s=READY pgs=1157 cs=0 l=1 rx=0x7f8b28010350 tx=0x7f8b280101d0).stop 2019-11-28T11:48:42.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.944+0000 7f8b3aa62700 1 -- 172.21.15.80:0/3264714206 shutdown_connections 2019-11-28T11:48:42.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.944+0000 7f8b3aa62700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b14018730 0x7f8b1401abc0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.944+0000 7f8b3aa62700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8b3410f290 0x7f8b3410dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.944+0000 7f8b3aa62700 1 --2- 172.21.15.80:0/3264714206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b34148320 0x7f8b3410ed50 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:42.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.944+0000 7f8b3aa62700 1 -- 172.21.15.80:0/3264714206 shutdown_connections 2019-11-28T11:48:42.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.944+0000 7f8b3aa62700 1 -- 172.21.15.80:0/3264714206 wait complete. 2019-11-28T11:48:42.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:42.944+0000 7f8b3aa62700 1 -- 172.21.15.80:0/3264714206 >> 172.21.15.80:0/3264714206 conn(0x7f8b3415e2d0 msgr2=0x7f8b34147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:43.000 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:48:43.000 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:48:43.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.074+0000 7fee4cd03700 1 Processor -- start 2019-11-28T11:48:43.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.074+0000 7fee4cd03700 1 -- start start 2019-11-28T11:48:43.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.075+0000 7fee4cd03700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fee4806c0a0 0x7fee48072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:43.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.075+0000 7fee4cd03700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee480734e0 0x7fee48071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:43.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.075+0000 7fee4cd03700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4806db00 con 0x7fee48072360 2019-11-28T11:48:43.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.076+0000 7fee4cd03700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4806fd60 con 0x7fee4806c0a0 2019-11-28T11:48:43.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.076+0000 7fee4cd03700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee48070030 con 0x7fee480734e0 2019-11-28T11:48:43.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.076+0000 7fee4759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fee48072360 0x7fee4806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40916/0 (socket says 172.21.15.80:40916) 2019-11-28T11:48:43.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.076+0000 7fee4759e700 1 -- 172.21.15.80:0/3110502773 learned_addr learned my addr 172.21.15.80:0/3110502773 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:43.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.076+0000 7fee4659c700 1 --2- 172.21.15.80:0/3110502773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee480734e0 0x7fee48071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:43.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.076+0000 7fee46d9d700 1 --2- 172.21.15.80:0/3110502773 >> v2:172.21.15.174:3300/0 conn(0x7fee4806c0a0 0x7fee48072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:43.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.076+0000 7fee45d9b700 1 -- 172.21.15.80:0/3110502773 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424800213 0 0) 0x7fee40001150 con 0x7fee48072360 2019-11-28T11:48:43.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.076+0000 7fee45d9b700 1 -- 172.21.15.80:0/3110502773 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee28002e80 con 0x7fee48072360 2019-11-28T11:48:43.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.076+0000 7fee46d9d700 1 -- 172.21.15.80:0/3110502773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee480734e0 msgr2=0x7fee48071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:43.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.076+0000 7fee46d9d700 1 --2- 172.21.15.80:0/3110502773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee480734e0 0x7fee48071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:43.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.076+0000 7fee46d9d700 1 -- 172.21.15.80:0/3110502773 >> v1:172.21.15.80:6789/0 conn(0x7fee48072360 legacy=0x7fee4806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:43.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.076+0000 7fee46d9d700 1 -- 172.21.15.80:0/3110502773 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee480706c0 con 0x7fee4806c0a0 2019-11-28T11:48:43.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.076+0000 7fee46d9d700 1 --2- 172.21.15.80:0/3110502773 >> v2:172.21.15.174:3300/0 conn(0x7fee4806c0a0 0x7fee48072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fee3000af50 tx=0x7fee3000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:43.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.076+0000 7fee46d9d700 1 --2- 172.21.15.80:0/3110502773 >> v2:172.21.15.174:3300/0 conn(0x7fee4806c0a0 0x7fee48072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fee3000af50 tx=0x7fee3000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:43.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.076+0000 7fee46d9d700 1 --2- 172.21.15.80:0/3110502773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee4806c0a0 0x7fee48072fa0 secure :-1 s=READY pgs=1158 cs=0 l=1 rx=0x7fee3000af50 tx=0x7fee3000b6e0).ready entity=mon.1 client_cookie=4de1b8ee04e29548 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:43.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.077+0000 7fee46d9d700 1 --2- 172.21.15.80:0/3110502773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee4806c0a0 0x7fee48072fa0 secure :-1 s=THROTTLE_DONE pgs=1158 cs=0 l=1 rx=0x7fee3000af50 tx=0x7fee3000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:43.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.077+0000 7fee45d9b700 1 -- 172.21.15.80:0/3110502773 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee30007210 con 0x7fee4806c0a0 2019-11-28T11:48:43.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.077+0000 7fee46d9d700 1 --2- 172.21.15.80:0/3110502773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee4806c0a0 0x7fee48072fa0 secure :-1 s=THROTTLE_DONE pgs=1158 cs=0 l=1 rx=0x7fee3000af50 tx=0x7fee3000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:43.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.077+0000 7fee46d9d700 1 --2- 172.21.15.80:0/3110502773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee4806c0a0 0x7fee48072fa0 secure :-1 s=THROTTLE_DONE pgs=1158 cs=0 l=1 rx=0x7fee3000af50 tx=0x7fee3000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:43.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.077+0000 7fee45d9b700 1 -- 172.21.15.80:0/3110502773 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee300099b0 con 0x7fee4806c0a0 2019-11-28T11:48:43.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.077+0000 7fee45d9b700 1 -- 172.21.15.80:0/3110502773 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee3000a080 con 0x7fee4806c0a0 2019-11-28T11:48:43.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.077+0000 7fee4cd03700 1 -- 172.21.15.80:0/3110502773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee4806c0a0 msgr2=0x7fee48072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:43.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.077+0000 7fee4cd03700 1 --2- 172.21.15.80:0/3110502773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee4806c0a0 0x7fee48072fa0 secure :-1 s=READY pgs=1158 cs=0 l=1 rx=0x7fee3000af50 tx=0x7fee3000b6e0).stop 2019-11-28T11:48:43.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.077+0000 7fee4cd03700 1 -- 172.21.15.80:0/3110502773 shutdown_connections 2019-11-28T11:48:43.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.077+0000 7fee4cd03700 1 --2- 172.21.15.80:0/3110502773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee480734e0 0x7fee48071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:43.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.077+0000 7fee4cd03700 1 --2- 172.21.15.80:0/3110502773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee4806c0a0 0x7fee48072fa0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:43.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.077+0000 7fee4cd03700 1 -- 172.21.15.80:0/3110502773 shutdown_connections 2019-11-28T11:48:43.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.077+0000 7fee4cd03700 1 -- 172.21.15.80:0/3110502773 wait complete. 2019-11-28T11:48:43.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.077+0000 7fee4cd03700 1 -- 172.21.15.80:0/3110502773 >> 172.21.15.80:0/3110502773 conn(0x7fee48061cf0 msgr2=0x7fee48064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:43.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.080+0000 7fee4cd03700 1 Processor -- start 2019-11-28T11:48:43.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.080+0000 7fee4cd03700 1 -- start start 2019-11-28T11:48:43.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee4cd03700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fee4813dc00 0x7fee48109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:43.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee4cd03700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fee481094e0 0x7fee48167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:43.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee4cd03700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee481312c0 con 0x7fee4810a3a0 2019-11-28T11:48:43.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee4cd03700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee48105830 con 0x7fee4813dc00 2019-11-28T11:48:43.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee4cd03700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee48105b00 con 0x7fee481094e0 2019-11-28T11:48:43.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee46d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fee4813dc00 0x7fee48109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:43.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee46d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fee4813dc00 0x7fee48109e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41604/0 (socket says 172.21.15.80:41604) 2019-11-28T11:48:43.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee46d9d700 1 -- 172.21.15.80:0/1389699959 learned_addr learned my addr 172.21.15.80:0/1389699959 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:43.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee4759e700 1 --2- 172.21.15.80:0/1389699959 >> v2:172.21.15.174:3300/0 conn(0x7fee481094e0 0x7fee48167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:43.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee46d9d700 1 -- 172.21.15.80:0/1389699959 >> v2:172.21.15.174:3300/0 conn(0x7fee481094e0 msgr2=0x7fee48167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:43.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee46d9d700 1 --2- 172.21.15.80:0/1389699959 >> v2:172.21.15.174:3300/0 conn(0x7fee481094e0 0x7fee48167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:43.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee46d9d700 1 -- 172.21.15.80:0/1389699959 >> v1:172.21.15.174:6789/0 conn(0x7fee4810a3a0 legacy=0x7fee48108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:43.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee46d9d700 1 -- 172.21.15.80:0/1389699959 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee48106190 con 0x7fee4813dc00 2019-11-28T11:48:43.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee46d9d700 1 --2- 172.21.15.80:0/1389699959 >> v2:172.21.15.80:3300/0 conn(0x7fee4813dc00 0x7fee48109e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee30010420 tx=0x7fee300102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:43.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee46d9d700 1 --2- 172.21.15.80:0/1389699959 >> v2:172.21.15.80:3300/0 conn(0x7fee4813dc00 0x7fee48109e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee30010420 tx=0x7fee300102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:43.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee46d9d700 1 --2- 172.21.15.80:0/1389699959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee4813dc00 0x7fee48109e60 secure :-1 s=READY pgs=1976 cs=0 l=1 rx=0x7fee30010420 tx=0x7fee300102a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:43.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee46d9d700 1 --2- 172.21.15.80:0/1389699959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee4813dc00 0x7fee48109e60 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7fee30010420 tx=0x7fee300102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:43.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee3f7fe700 1 -- 172.21.15.80:0/1389699959 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee30000940 con 0x7fee4813dc00 2019-11-28T11:48:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee46d9d700 1 --2- 172.21.15.80:0/1389699959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee4813dc00 0x7fee48109e60 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7fee30010420 tx=0x7fee300102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee46d9d700 1 --2- 172.21.15.80:0/1389699959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee4813dc00 0x7fee48109e60 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7fee30010420 tx=0x7fee300102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee3f7fe700 1 -- 172.21.15.80:0/1389699959 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee30009770 con 0x7fee4813dc00 2019-11-28T11:48:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee3f7fe700 1 -- 172.21.15.80:0/1389699959 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee30000940 con 0x7fee4813dc00 2019-11-28T11:48:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee4cd03700 1 -- 172.21.15.80:0/1389699959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee48106510 con 0x7fee4813dc00 2019-11-28T11:48:43.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.081+0000 7fee4cd03700 1 -- 172.21.15.80:0/1389699959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee48106190 con 0x7fee4813dc00 2019-11-28T11:48:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.082+0000 7fee46d9d700 1 --2- 172.21.15.80:0/1389699959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee4813dc00 0x7fee48109e60 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7fee30010420 tx=0x7fee300102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.082+0000 7fee3f7fe700 1 -- 172.21.15.80:0/1389699959 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fee30009960 con 0x7fee4813dc00 2019-11-28T11:48:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.082+0000 7fee46d9d700 1 --2- 172.21.15.80:0/1389699959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee4813dc00 0x7fee48109e60 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7fee30010420 tx=0x7fee300102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.082+0000 7fee3f7fe700 1 --2- 172.21.15.80:0/1389699959 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fee20018730 0x7fee2001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.082+0000 7fee3f7fe700 1 -- 172.21.15.80:0/1389699959 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fee30031a80 con 0x7fee4813dc00 2019-11-28T11:48:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.082+0000 7fee4659c700 1 --2- 172.21.15.80:0/1389699959 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fee20018730 0x7fee2001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:43.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.083+0000 7fee4659c700 1 --2- 172.21.15.80:0/1389699959 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fee20018730 0x7fee2001abc0 crc :-1 s=READY pgs=797 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:43.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.090+0000 7fee4cd03700 1 -- 172.21.15.80:0/1389699959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee48106510 con 0x7fee4813dc00 2019-11-28T11:48:43.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.093+0000 7fee46d9d700 1 --2- 172.21.15.80:0/1389699959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee4813dc00 0x7fee48109e60 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7fee30010420 tx=0x7fee300102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:43.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.093+0000 7fee3f7fe700 1 -- 172.21.15.80:0/1389699959 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fee3000af70 con 0x7fee4813dc00 2019-11-28T11:48:43.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.267+0000 7fee4cd03700 1 -- 172.21.15.80:0/1389699959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee48106190 con 0x7fee4813dc00 2019-11-28T11:48:43.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.268+0000 7fee46d9d700 1 --2- 172.21.15.80:0/1389699959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee4813dc00 0x7fee48109e60 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7fee30010420 tx=0x7fee300102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:43.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.268+0000 7fee3f7fe700 1 -- 172.21.15.80:0/1389699959 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+1780 (secure 0 0 0) 0x7fee30009940 con 0x7fee4813dc00 2019-11-28T11:48:43.314 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 115 2019-11-28T11:48:43.314 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:43.315 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":115,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:48:37.109829+0000","modified":"2019-11-28T11:48:41.120965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6785":{"gid":6785,"name":"c","rank":0,"incarnation":114,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/1862798714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1862798714},{"type":"v1","addr":"172.21.15.174:6835","nonce":1862798714}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2019-11-28T11:48:43.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.270+0000 7fee4cd03700 1 -- 172.21.15.80:0/1389699959 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fee20018730 msgr2=0x7fee2001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:43.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.270+0000 7fee4cd03700 1 --2- 172.21.15.80:0/1389699959 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fee20018730 0x7fee2001abc0 crc :-1 s=READY pgs=797 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:43.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.270+0000 7fee4cd03700 1 -- 172.21.15.80:0/1389699959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee4813dc00 msgr2=0x7fee48109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:43.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.270+0000 7fee4cd03700 1 --2- 172.21.15.80:0/1389699959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee4813dc00 0x7fee48109e60 secure :-1 s=READY pgs=1976 cs=0 l=1 rx=0x7fee30010420 tx=0x7fee300102a0).stop 2019-11-28T11:48:43.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.270+0000 7fee4cd03700 1 -- 172.21.15.80:0/1389699959 shutdown_connections 2019-11-28T11:48:43.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.271+0000 7fee4cd03700 1 --2- 172.21.15.80:0/1389699959 >> v2:172.21.15.174:3300/0 conn(0x7fee481094e0 0x7fee48167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:43.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.271+0000 7fee4cd03700 1 --2- 172.21.15.80:0/1389699959 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fee20018730 0x7fee2001abc0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:43.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.271+0000 7fee4cd03700 1 --2- 172.21.15.80:0/1389699959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee4813dc00 0x7fee48109e60 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:43.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.271+0000 7fee4cd03700 1 -- 172.21.15.80:0/1389699959 shutdown_connections 2019-11-28T11:48:43.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.271+0000 7fee4cd03700 1 -- 172.21.15.80:0/1389699959 wait complete. 2019-11-28T11:48:43.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:43.271+0000 7fee4cd03700 1 -- 172.21.15.80:0/1389699959 >> 172.21.15.80:0/1389699959 conn(0x7fee4811bfc0 msgr2=0x7fee48141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:43.631 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6785}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 24, u'failed': [], u'epoch': 115, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [25], u'info': {u'gid_6785': {u'export_targets': [], u'name': u'c', u'incarnation': 114, u'state_seq': 2, u'state': u'up:active', u'gid': 6785, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1862798714, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 1862798714, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/1862798714'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:48:37.109829+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:48:41.120965+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:48:43.631 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:48:43.632 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:48:43.758 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:48:43.759 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:48:43.759 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:48:43.759 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 6785, 2019-11-28T11:48:43.759 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:48:43.759 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:48:43.759 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 3.591796065, 2019-11-28T11:48:43.759 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 115, 2019-11-28T11:48:43.760 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 152, 2019-11-28T11:48:43.760 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 152, 2019-11-28T11:48:43.760 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 4.1208575979999997 2019-11-28T11:48:43.760 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:48:43.764 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 6785, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.591796065, "mdsmap_epoch": 115, "osdmap_epoch": 152, "osdmap_epoch_barrier": 152, "uptime": 4.1208575979999997 } 2019-11-28T11:48:43.764 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:48:43.765 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:48:43.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:48:43.765 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:48:43.835 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:48:43.836 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:48:43.956 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:48:43.956 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:48:43.956 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:48:43.956 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:48:43.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:48:43.957 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:48:44.027 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:48:44.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.101+0000 7f7228258700 1 Processor -- start 2019-11-28T11:48:44.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.101+0000 7f7228258700 1 -- start start 2019-11-28T11:48:44.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f7228258700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f722006c490 0x7f722006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:44.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f7228258700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f722006ce60 0x7f7220164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:44.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f7228258700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f722006db00 con 0x7f722006c0a0 2019-11-28T11:48:44.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f7228258700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f722006fd60 con 0x7f722006ce60 2019-11-28T11:48:44.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f7228258700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7220070030 con 0x7f722006c490 2019-11-28T11:48:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f7226ff6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f722006ce60 0x7f7220164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f72267f5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f722006c0a0 0x7f7220072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40932/0 (socket says 172.21.15.80:40932) 2019-11-28T11:48:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f72267f5700 1 -- 172.21.15.80:0/473186951 learned_addr learned my addr 172.21.15.80:0/473186951 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f7225ff4700 1 --2- 172.21.15.80:0/473186951 >> v2:172.21.15.174:3300/0 conn(0x7f722006c490 0x7f722006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f7226ff6700 1 -- 172.21.15.80:0/473186951 >> v2:172.21.15.174:3300/0 conn(0x7f722006c490 msgr2=0x7f722006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f7226ff6700 1 --2- 172.21.15.80:0/473186951 >> v2:172.21.15.174:3300/0 conn(0x7f722006c490 0x7f722006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:44.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f7226ff6700 1 -- 172.21.15.80:0/473186951 >> v1:172.21.15.80:6789/0 conn(0x7f722006c0a0 legacy=0x7f7220072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f72257f3700 1 -- 172.21.15.80:0/473186951 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932134299 0 0) 0x7f7210001170 con 0x7f722006c0a0 2019-11-28T11:48:44.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f7226ff6700 1 -- 172.21.15.80:0/473186951 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72200706c0 con 0x7f722006ce60 2019-11-28T11:48:44.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f7226ff6700 1 --2- 172.21.15.80:0/473186951 >> v2:172.21.15.80:3300/0 conn(0x7f722006ce60 0x7f7220164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f721800af50 tx=0x7f721800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f7226ff6700 1 --2- 172.21.15.80:0/473186951 >> v2:172.21.15.80:3300/0 conn(0x7f722006ce60 0x7f7220164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f721800af50 tx=0x7f721800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.102+0000 7f7226ff6700 1 --2- 172.21.15.80:0/473186951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f722006ce60 0x7f7220164d70 secure :-1 s=READY pgs=1979 cs=0 l=1 rx=0x7f721800af50 tx=0x7f721800b6e0).ready entity=mon.0 client_cookie=1236b22fc0fe6636 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:44.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.103+0000 7f7226ff6700 1 --2- 172.21.15.80:0/473186951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f722006ce60 0x7f7220164d70 secure :-1 s=THROTTLE_DONE pgs=1979 cs=0 l=1 rx=0x7f721800af50 tx=0x7f721800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.103+0000 7f72257f3700 1 -- 172.21.15.80:0/473186951 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7218009ba0 con 0x7f722006ce60 2019-11-28T11:48:44.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.103+0000 7f7226ff6700 1 --2- 172.21.15.80:0/473186951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f722006ce60 0x7f7220164d70 secure :-1 s=THROTTLE_DONE pgs=1979 cs=0 l=1 rx=0x7f721800af50 tx=0x7f721800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.103+0000 7f7226ff6700 1 --2- 172.21.15.80:0/473186951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f722006ce60 0x7f7220164d70 secure :-1 s=THROTTLE_DONE pgs=1979 cs=0 l=1 rx=0x7f721800af50 tx=0x7f721800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.103+0000 7f72257f3700 1 -- 172.21.15.80:0/473186951 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72180097c0 con 0x7f722006ce60 2019-11-28T11:48:44.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.103+0000 7f72257f3700 1 -- 172.21.15.80:0/473186951 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7218009ba0 con 0x7f722006ce60 2019-11-28T11:48:44.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.103+0000 7f7228258700 1 -- 172.21.15.80:0/473186951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f722006ce60 msgr2=0x7f7220164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.103+0000 7f7228258700 1 --2- 172.21.15.80:0/473186951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f722006ce60 0x7f7220164d70 secure :-1 s=READY pgs=1979 cs=0 l=1 rx=0x7f721800af50 tx=0x7f721800b6e0).stop 2019-11-28T11:48:44.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.103+0000 7f7228258700 1 -- 172.21.15.80:0/473186951 shutdown_connections 2019-11-28T11:48:44.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.103+0000 7f7228258700 1 --2- 172.21.15.80:0/473186951 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f722006ce60 0x7f7220164d70 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:44.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.103+0000 7f7228258700 1 --2- 172.21.15.80:0/473186951 >> v2:172.21.15.174:3300/0 conn(0x7f722006c490 0x7f722006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:44.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.104+0000 7f7228258700 1 -- 172.21.15.80:0/473186951 shutdown_connections 2019-11-28T11:48:44.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.104+0000 7f7228258700 1 -- 172.21.15.80:0/473186951 wait complete. 2019-11-28T11:48:44.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.104+0000 7f7228258700 1 -- 172.21.15.80:0/473186951 >> 172.21.15.80:0/473186951 conn(0x7f7220061cf0 msgr2=0x7f7220064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:44.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.106+0000 7f7228258700 1 Processor -- start 2019-11-28T11:48:44.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.106+0000 7f7228258700 1 -- start start 2019-11-28T11:48:44.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.107+0000 7f7228258700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f722010f210 0x7f7220158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:44.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.107+0000 7f7228258700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f722013edc0 con 0x7f7220158e90 2019-11-28T11:48:44.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.107+0000 7f7228258700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f722007a2f0 con 0x7f722013e5f0 2019-11-28T11:48:44.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.107+0000 7f7228258700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f722007bba0 con 0x7f722010f210 2019-11-28T11:48:44.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.107+0000 7f7226ff6700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7220158e90 0x7f72201ad2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40942/0 (socket says 172.21.15.80:40942) 2019-11-28T11:48:44.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.107+0000 7f7226ff6700 1 -- 172.21.15.80:0/2223093257 learned_addr learned my addr 172.21.15.80:0/2223093257 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:44.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.107+0000 7f7225ff4700 1 --2- 172.21.15.80:0/2223093257 >> v2:172.21.15.174:3300/0 conn(0x7f722010f210 0x7f7220158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:44.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.107+0000 7f7216ffd700 1 -- 172.21.15.80:0/2223093257 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245346972 0 0) 0x7f7218000940 con 0x7f7220158e90 2019-11-28T11:48:44.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.107+0000 7f7216ffd700 1 -- 172.21.15.80:0/2223093257 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7208002e80 con 0x7f7220158e90 2019-11-28T11:48:44.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.107+0000 7f7216ffd700 1 -- 172.21.15.80:0/2223093257 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742485541 0 0) 0x7f7210000d70 con 0x7f722013e5f0 2019-11-28T11:48:44.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.107+0000 7f7216ffd700 1 -- 172.21.15.80:0/2223093257 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72080030b0 con 0x7f722013e5f0 2019-11-28T11:48:44.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.107+0000 7f7225ff4700 1 -- 172.21.15.80:0/2223093257 >> v1:172.21.15.174:6789/0 conn(0x7f722013e5f0 legacy=0x7f7220159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.107+0000 7f7225ff4700 1 -- 172.21.15.80:0/2223093257 >> v1:172.21.15.80:6789/0 conn(0x7f7220158e90 legacy=0x7f72201ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.107+0000 7f7225ff4700 1 -- 172.21.15.80:0/2223093257 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722010dad0 con 0x7f722010f210 2019-11-28T11:48:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.107+0000 7f7225ff4700 1 --2- 172.21.15.80:0/2223093257 >> v2:172.21.15.174:3300/0 conn(0x7f722010f210 0x7f7220158950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f721c010730 tx=0x7f721c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.108+0000 7f7225ff4700 1 --2- 172.21.15.80:0/2223093257 >> v2:172.21.15.174:3300/0 conn(0x7f722010f210 0x7f7220158950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f721c010730 tx=0x7f721c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.108+0000 7f7225ff4700 1 --2- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f722010f210 0x7f7220158950 secure :-1 s=READY pgs=1161 cs=0 l=1 rx=0x7f721c010730 tx=0x7f721c010ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.108+0000 7f7225ff4700 1 --2- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f722010f210 0x7f7220158950 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7f721c010730 tx=0x7f721c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.108+0000 7f7216ffd700 1 -- 172.21.15.80:0/2223093257 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f721c000cc0 con 0x7f722010f210 2019-11-28T11:48:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.108+0000 7f7225ff4700 1 --2- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f722010f210 0x7f7220158950 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7f721c010730 tx=0x7f721c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.108+0000 7f7225ff4700 1 --2- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f722010f210 0x7f7220158950 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7f721c010730 tx=0x7f721c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.108+0000 7f7216ffd700 1 -- 172.21.15.80:0/2223093257 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721c005900 con 0x7f722010f210 2019-11-28T11:48:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.108+0000 7f7216ffd700 1 -- 172.21.15.80:0/2223093257 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f721c005fd0 con 0x7f722010f210 2019-11-28T11:48:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.108+0000 7f7228258700 1 -- 172.21.15.80:0/2223093257 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f722010de50 con 0x7f722010f210 2019-11-28T11:48:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.108+0000 7f7228258700 1 -- 172.21.15.80:0/2223093257 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f722010dad0 con 0x7f722010f210 2019-11-28T11:48:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.108+0000 7f7225ff4700 1 --2- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f722010f210 0x7f7220158950 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7f721c010730 tx=0x7f721c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.108+0000 7f7216ffd700 1 -- 172.21.15.80:0/2223093257 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f721c0055a0 con 0x7f722010f210 2019-11-28T11:48:44.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.108+0000 7f7225ff4700 1 --2- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f722010f210 0x7f7220158950 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7f721c010730 tx=0x7f721c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.109+0000 7f7216ffd700 1 --2- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7208018750 0x7f720801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.109+0000 7f7216ffd700 1 -- 172.21.15.80:0/2223093257 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f721c031e10 con 0x7f722010f210 2019-11-28T11:48:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.109+0000 7f72267f5700 1 --2- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7208018750 0x7f720801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.109+0000 7f72267f5700 1 --2- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7208018750 0x7f720801abe0 crc :-1 s=READY pgs=800 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:44.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.116+0000 7f7228258700 1 -- 172.21.15.80:0/2223093257 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722010de50 con 0x7f722010f210 2019-11-28T11:48:44.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.120+0000 7f7225ff4700 1 --2- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f722010f210 0x7f7220158950 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7f721c010730 tx=0x7f721c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.120+0000 7f7216ffd700 1 -- 172.21.15.80:0/2223093257 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f721c000cc0 con 0x7f722010f210 2019-11-28T11:48:44.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.295+0000 7f7228258700 1 -- 172.21.15.80:0/2223093257 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f722010dad0 con 0x7f722010f210 2019-11-28T11:48:44.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.296+0000 7f7225ff4700 1 --2- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f722010f210 0x7f7220158950 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7f721c010730 tx=0x7f721c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.296+0000 7f7216ffd700 1 -- 172.21.15.80:0/2223093257 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f721c005500 con 0x7f722010f210 2019-11-28T11:48:44.344 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:44.344 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":152,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:48:38.111012+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:48:35.444932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2019-11-28T11:48:36.133221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:48:44.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.301+0000 7f7228258700 1 -- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7208018750 msgr2=0x7f720801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.301+0000 7f7228258700 1 --2- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7208018750 0x7f720801abe0 crc :-1 s=READY pgs=800 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:44.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.301+0000 7f7228258700 1 -- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f722010f210 msgr2=0x7f7220158950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.301+0000 7f7228258700 1 --2- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f722010f210 0x7f7220158950 secure :-1 s=READY pgs=1161 cs=0 l=1 rx=0x7f721c010730 tx=0x7f721c010ad0).stop 2019-11-28T11:48:44.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.301+0000 7f7228258700 1 -- 172.21.15.80:0/2223093257 shutdown_connections 2019-11-28T11:48:44.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.301+0000 7f7228258700 1 --2- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f722010f210 0x7f7220158950 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:44.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.301+0000 7f7228258700 1 --2- 172.21.15.80:0/2223093257 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7208018750 0x7f720801abe0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:44.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.301+0000 7f7228258700 1 -- 172.21.15.80:0/2223093257 shutdown_connections 2019-11-28T11:48:44.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.301+0000 7f7228258700 1 -- 172.21.15.80:0/2223093257 wait complete. 2019-11-28T11:48:44.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.301+0000 7f7228258700 1 -- 172.21.15.80:0/2223093257 >> 172.21.15.80:0/2223093257 conn(0x7f722007c6e0 msgr2=0x7f72201050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:44.357 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:48:35.444932+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 24, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'151', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:48:36.133221+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 25, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'152', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:48:44.357 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:48:44.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.435+0000 7f9a6e3d6700 1 Processor -- start 2019-11-28T11:48:44.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.435+0000 7f9a6e3d6700 1 -- start start 2019-11-28T11:48:44.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.436+0000 7f9a6e3d6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9a6815ed10 0x7f9a6815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:44.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.436+0000 7f9a6e3d6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a680734b0 0x7f9a680726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:44.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.436+0000 7f9a6e3d6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6806db60 con 0x7f9a68073020 2019-11-28T11:48:44.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.436+0000 7f9a6e3d6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6806fe00 con 0x7f9a680734b0 2019-11-28T11:48:44.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.436+0000 7f9a6e3d6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a680700d0 con 0x7f9a6815ed10 2019-11-28T11:48:44.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.436+0000 7f9a6d174700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a680734b0 0x7f9a680726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:44.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.436+0000 7f9a6d174700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a680734b0 0x7f9a680726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41634/0 (socket says 172.21.15.80:41634) 2019-11-28T11:48:44.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.436+0000 7f9a6d174700 1 -- 172.21.15.80:0/630322036 learned_addr learned my addr 172.21.15.80:0/630322036 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:44.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.437+0000 7f9a6c973700 1 --2- 172.21.15.80:0/630322036 >> v2:172.21.15.174:3300/0 conn(0x7f9a6815ed10 0x7f9a6815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:44.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.437+0000 7f9a6d174700 1 -- 172.21.15.80:0/630322036 >> v2:172.21.15.174:3300/0 conn(0x7f9a6815ed10 msgr2=0x7f9a6815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:44.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.437+0000 7f9a6d174700 1 --2- 172.21.15.80:0/630322036 >> v2:172.21.15.174:3300/0 conn(0x7f9a6815ed10 0x7f9a6815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:44.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.437+0000 7f9a6d174700 1 -- 172.21.15.80:0/630322036 >> v1:172.21.15.174:6789/0 conn(0x7f9a68073020 legacy=0x7f9a68071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.437+0000 7f9a6d174700 1 -- 172.21.15.80:0/630322036 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a68070760 con 0x7f9a680734b0 2019-11-28T11:48:44.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.437+0000 7f9a6d174700 1 --2- 172.21.15.80:0/630322036 >> v2:172.21.15.80:3300/0 conn(0x7f9a680734b0 0x7f9a680726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9a6000f6b0 tx=0x7f9a6000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.437+0000 7f9a6d174700 1 --2- 172.21.15.80:0/630322036 >> v2:172.21.15.80:3300/0 conn(0x7f9a680734b0 0x7f9a680726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9a6000f6b0 tx=0x7f9a6000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.437+0000 7f9a6d174700 1 --2- 172.21.15.80:0/630322036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a680734b0 0x7f9a680726a0 secure :-1 s=READY pgs=1981 cs=0 l=1 rx=0x7f9a6000f6b0 tx=0x7f9a6000fa50).ready entity=mon.0 client_cookie=611163f97530fcc9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.437+0000 7f9a6d174700 1 --2- 172.21.15.80:0/630322036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a680734b0 0x7f9a680726a0 secure :-1 s=THROTTLE_DONE pgs=1981 cs=0 l=1 rx=0x7f9a6000f6b0 tx=0x7f9a6000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.437+0000 7f9a6d174700 1 --2- 172.21.15.80:0/630322036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a680734b0 0x7f9a680726a0 secure :-1 s=THROTTLE_DONE pgs=1981 cs=0 l=1 rx=0x7f9a6000f6b0 tx=0x7f9a6000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.437+0000 7f9a677fe700 1 -- 172.21.15.80:0/630322036 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a60000a70 con 0x7f9a680734b0 2019-11-28T11:48:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.437+0000 7f9a6d174700 1 --2- 172.21.15.80:0/630322036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a680734b0 0x7f9a680726a0 secure :-1 s=THROTTLE_DONE pgs=1981 cs=0 l=1 rx=0x7f9a6000f6b0 tx=0x7f9a6000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.437+0000 7f9a677fe700 1 -- 172.21.15.80:0/630322036 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a600010e0 con 0x7f9a680734b0 2019-11-28T11:48:44.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.437+0000 7f9a677fe700 1 -- 172.21.15.80:0/630322036 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a600017b0 con 0x7f9a680734b0 2019-11-28T11:48:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.437+0000 7f9a6e3d6700 1 -- 172.21.15.80:0/630322036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a680734b0 msgr2=0x7f9a680726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.437+0000 7f9a6e3d6700 1 --2- 172.21.15.80:0/630322036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a680734b0 0x7f9a680726a0 secure :-1 s=READY pgs=1981 cs=0 l=1 rx=0x7f9a6000f6b0 tx=0x7f9a6000fa50).stop 2019-11-28T11:48:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.438+0000 7f9a6e3d6700 1 -- 172.21.15.80:0/630322036 shutdown_connections 2019-11-28T11:48:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.438+0000 7f9a6e3d6700 1 --2- 172.21.15.80:0/630322036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a680734b0 0x7f9a680726a0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.438+0000 7f9a6e3d6700 1 --2- 172.21.15.80:0/630322036 >> v2:172.21.15.174:3300/0 conn(0x7f9a6815ed10 0x7f9a6815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:44.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.438+0000 7f9a6e3d6700 1 -- 172.21.15.80:0/630322036 shutdown_connections 2019-11-28T11:48:44.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.438+0000 7f9a6e3d6700 1 -- 172.21.15.80:0/630322036 wait complete. 2019-11-28T11:48:44.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.438+0000 7f9a6e3d6700 1 -- 172.21.15.80:0/630322036 >> 172.21.15.80:0/630322036 conn(0x7f9a68061d20 msgr2=0x7f9a680641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:44.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.440+0000 7f9a6e3d6700 1 Processor -- start 2019-11-28T11:48:44.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.440+0000 7f9a6e3d6700 1 -- start start 2019-11-28T11:48:44.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.441+0000 7f9a6e3d6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a68169da0 0x7f9a6816c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:44.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.441+0000 7f9a6e3d6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a681057a0 con 0x7f9a6810cbb0 2019-11-28T11:48:44.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.441+0000 7f9a6e3d6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a68105c00 con 0x7f9a68153db0 2019-11-28T11:48:44.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.441+0000 7f9a6e3d6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a68106280 con 0x7f9a68169da0 2019-11-28T11:48:44.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.441+0000 7f9a67fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9a6810cbb0 0x7f9a6810d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40954/0 (socket says 172.21.15.80:40954) 2019-11-28T11:48:44.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.441+0000 7f9a67fff700 1 -- 172.21.15.80:0/3885167462 learned_addr learned my addr 172.21.15.80:0/3885167462 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:44.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a6d174700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a68169da0 0x7f9a6816c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:44.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a657fa700 1 -- 172.21.15.80:0/3885167462 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885662146 0 0) 0x7f9a58001490 con 0x7f9a6810cbb0 2019-11-28T11:48:44.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a657fa700 1 -- 172.21.15.80:0/3885167462 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a4c002e80 con 0x7f9a6810cbb0 2019-11-28T11:48:44.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a657fa700 1 -- 172.21.15.80:0/3885167462 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220424713 0 0) 0x7f9a50000c90 con 0x7f9a68153db0 2019-11-28T11:48:44.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a657fa700 1 -- 172.21.15.80:0/3885167462 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a4c0030b0 con 0x7f9a68153db0 2019-11-28T11:48:44.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a6d174700 1 -- 172.21.15.80:0/3885167462 >> v1:172.21.15.174:6789/0 conn(0x7f9a68153db0 legacy=0x7f9a6810dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a6d174700 1 -- 172.21.15.80:0/3885167462 >> v1:172.21.15.80:6789/0 conn(0x7f9a6810cbb0 legacy=0x7f9a6810d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a6d174700 1 -- 172.21.15.80:0/3885167462 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a68106be0 con 0x7f9a68169da0 2019-11-28T11:48:44.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a6d174700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a68169da0 0x7f9a6816c1a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a600103c0 tx=0x7f9a60010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a6d174700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a68169da0 0x7f9a6816c1a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a600103c0 tx=0x7f9a60010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a6d174700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a68169da0 0x7f9a6816c1a0 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f9a600103c0 tx=0x7f9a60010760).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:44.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a6d174700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a68169da0 0x7f9a6816c1a0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f9a600103c0 tx=0x7f9a60010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a657fa700 1 -- 172.21.15.80:0/3885167462 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a600014a0 con 0x7f9a68169da0 2019-11-28T11:48:44.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a6d174700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a68169da0 0x7f9a6816c1a0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f9a600103c0 tx=0x7f9a60010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a6d174700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a68169da0 0x7f9a6816c1a0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f9a600103c0 tx=0x7f9a60010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a657fa700 1 -- 172.21.15.80:0/3885167462 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a600010c0 con 0x7f9a68169da0 2019-11-28T11:48:44.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a657fa700 1 -- 172.21.15.80:0/3885167462 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a60001a80 con 0x7f9a68169da0 2019-11-28T11:48:44.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a6e3d6700 1 -- 172.21.15.80:0/3885167462 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a68106f60 con 0x7f9a68169da0 2019-11-28T11:48:44.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.442+0000 7f9a6e3d6700 1 -- 172.21.15.80:0/3885167462 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a68106be0 con 0x7f9a68169da0 2019-11-28T11:48:44.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.443+0000 7f9a6d174700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a68169da0 0x7f9a6816c1a0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f9a600103c0 tx=0x7f9a60010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.443+0000 7f9a657fa700 1 -- 172.21.15.80:0/3885167462 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9a600012b0 con 0x7f9a68169da0 2019-11-28T11:48:44.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.443+0000 7f9a6d174700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a68169da0 0x7f9a6816c1a0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f9a600103c0 tx=0x7f9a60010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.443+0000 7f9a657fa700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a4c018750 0x7f9a4c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:44.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.443+0000 7f9a657fa700 1 -- 172.21.15.80:0/3885167462 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9a60031ae0 con 0x7f9a68169da0 2019-11-28T11:48:44.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.443+0000 7f9a6c973700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a4c018750 0x7f9a4c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:44.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.443+0000 7f9a6c973700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a4c018750 0x7f9a4c01abe0 crc :-1 s=READY pgs=801 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:44.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.451+0000 7f9a6e3d6700 1 -- 172.21.15.80:0/3885167462 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a68106f60 con 0x7f9a68169da0 2019-11-28T11:48:44.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.455+0000 7f9a6d174700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a68169da0 0x7f9a6816c1a0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f9a600103c0 tx=0x7f9a60010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.455+0000 7f9a657fa700 1 -- 172.21.15.80:0/3885167462 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9a60000eb0 con 0x7f9a68169da0 2019-11-28T11:48:44.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.623+0000 7f9a6e3d6700 1 -- 172.21.15.80:0/3885167462 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f9a68106be0 con 0x7f9a68169da0 2019-11-28T11:48:44.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.624+0000 7f9a6d174700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a68169da0 0x7f9a6816c1a0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f9a600103c0 tx=0x7f9a60010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.624+0000 7f9a657fa700 1 -- 172.21.15.80:0/3885167462 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v152) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9a600011a0 con 0x7f9a68169da0 2019-11-28T11:48:44.670 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:48:44.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.626+0000 7f9a6e3d6700 1 -- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a4c018750 msgr2=0x7f9a4c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.626+0000 7f9a6e3d6700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a4c018750 0x7f9a4c01abe0 crc :-1 s=READY pgs=801 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:44.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.626+0000 7f9a6e3d6700 1 -- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a68169da0 msgr2=0x7f9a6816c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.626+0000 7f9a6e3d6700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a68169da0 0x7f9a6816c1a0 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f9a600103c0 tx=0x7f9a60010760).stop 2019-11-28T11:48:44.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.626+0000 7f9a6e3d6700 1 -- 172.21.15.80:0/3885167462 shutdown_connections 2019-11-28T11:48:44.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.626+0000 7f9a6e3d6700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a68169da0 0x7f9a6816c1a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:44.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.626+0000 7f9a6e3d6700 1 --2- 172.21.15.80:0/3885167462 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a4c018750 0x7f9a4c01abe0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:44.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.627+0000 7f9a6e3d6700 1 -- 172.21.15.80:0/3885167462 shutdown_connections 2019-11-28T11:48:44.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.627+0000 7f9a6e3d6700 1 -- 172.21.15.80:0/3885167462 wait complete. 2019-11-28T11:48:44.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.627+0000 7f9a6e3d6700 1 -- 172.21.15.80:0/3885167462 >> 172.21.15.80:0/3885167462 conn(0x7f9a6815e2d0 msgr2=0x7f9a68147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:44.682 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:48:44.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.759+0000 7f74bcaeb700 1 Processor -- start 2019-11-28T11:48:44.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.760+0000 7f74bcaeb700 1 -- start start 2019-11-28T11:48:44.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74bcaeb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74b815ed10 0x7f74b815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74bcaeb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74b8073020 0x7f74b8071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74bcaeb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b806db60 con 0x7f74b80734b0 2019-11-28T11:48:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74bcaeb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b806fe00 con 0x7f74b815ed10 2019-11-28T11:48:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74bcaeb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b80700d0 con 0x7f74b8073020 2019-11-28T11:48:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b6d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74b815ed10 0x7f74b815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b6d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74b815ed10 0x7f74b815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41644/0 (socket says 172.21.15.80:41644) 2019-11-28T11:48:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b6d9d700 1 -- 172.21.15.80:0/2688859111 learned_addr learned my addr 172.21.15.80:0/2688859111 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:44.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b659c700 1 --2- 172.21.15.80:0/2688859111 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74b8073020 0x7f74b8071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:44.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b6d9d700 1 -- 172.21.15.80:0/2688859111 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74b8073020 msgr2=0x7f74b8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:44.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2688859111 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74b8073020 0x7f74b8071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:44.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b6d9d700 1 -- 172.21.15.80:0/2688859111 >> v1:172.21.15.174:6789/0 conn(0x7f74b80734b0 legacy=0x7f74b80723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b6d9d700 1 -- 172.21.15.80:0/2688859111 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b8070760 con 0x7f74b815ed10 2019-11-28T11:48:44.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2688859111 >> v2:172.21.15.80:3300/0 conn(0x7f74b815ed10 0x7f74b815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f74a000fa40 tx=0x7f74a000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2688859111 >> v2:172.21.15.80:3300/0 conn(0x7f74b815ed10 0x7f74b815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f74a000fa40 tx=0x7f74a000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2688859111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b815ed10 0x7f74b815f100 secure :-1 s=READY pgs=1983 cs=0 l=1 rx=0x7f74a000fa40 tx=0x7f74a000fde0).ready entity=mon.0 client_cookie=a420a28c249f561 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:44.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2688859111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b815ed10 0x7f74b815f100 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7f74a000fa40 tx=0x7f74a000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2688859111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b815ed10 0x7f74b815f100 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7f74a000fa40 tx=0x7f74a000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2688859111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b815ed10 0x7f74b815f100 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7f74a000fa40 tx=0x7f74a000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b5d9b700 1 -- 172.21.15.80:0/2688859111 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74a0000ce0 con 0x7f74b815ed10 2019-11-28T11:48:44.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b5d9b700 1 -- 172.21.15.80:0/2688859111 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a0001010 con 0x7f74b815ed10 2019-11-28T11:48:44.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.761+0000 7f74b5d9b700 1 -- 172.21.15.80:0/2688859111 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74a0001720 con 0x7f74b815ed10 2019-11-28T11:48:44.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.762+0000 7f74bcaeb700 1 -- 172.21.15.80:0/2688859111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b815ed10 msgr2=0x7f74b815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.762+0000 7f74bcaeb700 1 --2- 172.21.15.80:0/2688859111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b815ed10 0x7f74b815f100 secure :-1 s=READY pgs=1983 cs=0 l=1 rx=0x7f74a000fa40 tx=0x7f74a000fde0).stop 2019-11-28T11:48:44.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.762+0000 7f74bcaeb700 1 -- 172.21.15.80:0/2688859111 shutdown_connections 2019-11-28T11:48:44.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.762+0000 7f74bcaeb700 1 --2- 172.21.15.80:0/2688859111 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74b8073020 0x7f74b8071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:44.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.762+0000 7f74bcaeb700 1 --2- 172.21.15.80:0/2688859111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b815ed10 0x7f74b815f100 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:44.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.762+0000 7f74bcaeb700 1 -- 172.21.15.80:0/2688859111 shutdown_connections 2019-11-28T11:48:44.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.762+0000 7f74bcaeb700 1 -- 172.21.15.80:0/2688859111 wait complete. 2019-11-28T11:48:44.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.762+0000 7f74bcaeb700 1 -- 172.21.15.80:0/2688859111 >> 172.21.15.80:0/2688859111 conn(0x7f74b8061d20 msgr2=0x7f74b80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:44.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.765+0000 7f74bcaeb700 1 Processor -- start 2019-11-28T11:48:44.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.765+0000 7f74bcaeb700 1 -- start start 2019-11-28T11:48:44.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.765+0000 7f74bcaeb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74b810e970 0x7f74b81087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:44.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.765+0000 7f74bcaeb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74b8108cf0 0x7f74b8107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:44.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74bcaeb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b810c250 con 0x7f74b8107b70 2019-11-28T11:48:44.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74bcaeb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b810e430 con 0x7f74b810e970 2019-11-28T11:48:44.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74bcaeb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b8105860 con 0x7f74b8108cf0 2019-11-28T11:48:44.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74b6d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74b810e970 0x7f74b81087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:44.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74b6d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74b810e970 0x7f74b81087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41650/0 (socket says 172.21.15.80:41650) 2019-11-28T11:48:44.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74b6d9d700 1 -- 172.21.15.80:0/2991433923 learned_addr learned my addr 172.21.15.80:0/2991433923 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:44.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74b659c700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74b8108cf0 0x7f74b8107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:44.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74b6d9d700 1 -- 172.21.15.80:0/2991433923 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74b8108cf0 msgr2=0x7f74b8107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74b8108cf0 0x7f74b8107630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:44.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74b6d9d700 1 -- 172.21.15.80:0/2991433923 >> v1:172.21.15.80:6789/0 conn(0x7f74b8107b70 legacy=0x7f74b810ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74b6d9d700 1 -- 172.21.15.80:0/2991433923 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b8105ef0 con 0x7f74b810e970 2019-11-28T11:48:44.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74af7fe700 1 -- 172.21.15.80:0/2991433923 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465714411 0 0) 0x7f74b0000b50 con 0x7f74b8107b70 2019-11-28T11:48:44.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2991433923 >> v2:172.21.15.80:3300/0 conn(0x7f74b810e970 0x7f74b81087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f74a00107c0 tx=0x7f74a0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2991433923 >> v2:172.21.15.80:3300/0 conn(0x7f74b810e970 0x7f74b81087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f74a00107c0 tx=0x7f74a0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b810e970 0x7f74b81087b0 secure :-1 s=READY pgs=1985 cs=0 l=1 rx=0x7f74a00107c0 tx=0x7f74a0010670).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:44.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b810e970 0x7f74b81087b0 secure :-1 s=THROTTLE_DONE pgs=1985 cs=0 l=1 rx=0x7f74a00107c0 tx=0x7f74a0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74af7fe700 1 -- 172.21.15.80:0/2991433923 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74a0000cc0 con 0x7f74b810e970 2019-11-28T11:48:44.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b810e970 0x7f74b81087b0 secure :-1 s=THROTTLE_DONE pgs=1985 cs=0 l=1 rx=0x7f74a00107c0 tx=0x7f74a0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b810e970 0x7f74b81087b0 secure :-1 s=THROTTLE_DONE pgs=1985 cs=0 l=1 rx=0x7f74a00107c0 tx=0x7f74a0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74af7fe700 1 -- 172.21.15.80:0/2991433923 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a00012d0 con 0x7f74b810e970 2019-11-28T11:48:44.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74bcaeb700 1 -- 172.21.15.80:0/2991433923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b8106270 con 0x7f74b810e970 2019-11-28T11:48:44.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74af7fe700 1 -- 172.21.15.80:0/2991433923 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74a0001920 con 0x7f74b810e970 2019-11-28T11:48:44.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.766+0000 7f74bcaeb700 1 -- 172.21.15.80:0/2991433923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b8105ef0 con 0x7f74b810e970 2019-11-28T11:48:44.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.767+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b810e970 0x7f74b81087b0 secure :-1 s=THROTTLE_DONE pgs=1985 cs=0 l=1 rx=0x7f74a00107c0 tx=0x7f74a0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.767+0000 7f74af7fe700 1 -- 172.21.15.80:0/2991433923 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f74a00010e0 con 0x7f74b810e970 2019-11-28T11:48:44.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.767+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b810e970 0x7f74b81087b0 secure :-1 s=THROTTLE_DONE pgs=1985 cs=0 l=1 rx=0x7f74a00107c0 tx=0x7f74a0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.767+0000 7f74af7fe700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7490018730 0x7f749001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:44.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.767+0000 7f74af7fe700 1 -- 172.21.15.80:0/2991433923 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f74a0031e20 con 0x7f74b810e970 2019-11-28T11:48:44.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.768+0000 7f74b659c700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7490018730 0x7f749001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:44.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.768+0000 7f74b659c700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7490018730 0x7f749001abc0 crc :-1 s=READY pgs=802 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:44.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.775+0000 7f74bcaeb700 1 -- 172.21.15.80:0/2991433923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b8106270 con 0x7f74b810e970 2019-11-28T11:48:44.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.778+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b810e970 0x7f74b81087b0 secure :-1 s=THROTTLE_DONE pgs=1985 cs=0 l=1 rx=0x7f74a00107c0 tx=0x7f74a0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.778+0000 7f74af7fe700 1 -- 172.21.15.80:0/2991433923 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f74a00175f0 con 0x7f74b810e970 2019-11-28T11:48:44.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.949+0000 7f74bcaeb700 1 -- 172.21.15.80:0/2991433923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f74b8105ef0 con 0x7f74b810e970 2019-11-28T11:48:44.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.949+0000 7f74b6d9d700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b810e970 0x7f74b81087b0 secure :-1 s=THROTTLE_DONE pgs=1985 cs=0 l=1 rx=0x7f74a00107c0 tx=0x7f74a0010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:44.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.949+0000 7f74af7fe700 1 -- 172.21.15.80:0/2991433923 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v152) v1 ==== 104+0+10 (secure 0 0 0) 0x7f74a00175f0 con 0x7f74b810e970 2019-11-28T11:48:44.995 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:48:44.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.952+0000 7f74bcaeb700 1 -- 172.21.15.80:0/2991433923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7490018730 msgr2=0x7f749001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.952+0000 7f74bcaeb700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7490018730 0x7f749001abc0 crc :-1 s=READY pgs=802 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:44.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.952+0000 7f74bcaeb700 1 -- 172.21.15.80:0/2991433923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b810e970 msgr2=0x7f74b81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:44.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.952+0000 7f74bcaeb700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b810e970 0x7f74b81087b0 secure :-1 s=READY pgs=1985 cs=0 l=1 rx=0x7f74a00107c0 tx=0x7f74a0010670).stop 2019-11-28T11:48:44.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.952+0000 7f74bcaeb700 1 -- 172.21.15.80:0/2991433923 shutdown_connections 2019-11-28T11:48:44.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.952+0000 7f74bcaeb700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7490018730 0x7f749001abc0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:44.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.952+0000 7f74bcaeb700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74b8108cf0 0x7f74b8107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:44.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.952+0000 7f74bcaeb700 1 --2- 172.21.15.80:0/2991433923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b810e970 0x7f74b81087b0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:44.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.952+0000 7f74bcaeb700 1 -- 172.21.15.80:0/2991433923 shutdown_connections 2019-11-28T11:48:44.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.952+0000 7f74bcaeb700 1 -- 172.21.15.80:0/2991433923 wait complete. 2019-11-28T11:48:44.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:44.952+0000 7f74bcaeb700 1 -- 172.21.15.80:0/2991433923 >> 172.21.15.80:0/2991433923 conn(0x7f74b815e2d0 msgr2=0x7f74b8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:45.007 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:48:45.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.085+0000 7f2c594f9700 1 Processor -- start 2019-11-28T11:48:45.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.085+0000 7f2c594f9700 1 -- start start 2019-11-28T11:48:45.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c594f9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2c5415f100 0x7f2c5406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:45.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c594f9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c5406c2f0 0x7f2c5406c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:45.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c594f9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5406db60 con 0x7f2c5415ed10 2019-11-28T11:48:45.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c594f9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5406fe00 con 0x7f2c5406c2f0 2019-11-28T11:48:45.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c594f9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c540700d0 con 0x7f2c5415f100 2019-11-28T11:48:45.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c53fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c5406c2f0 0x7f2c5406c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:45.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c53fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c5406c2f0 0x7f2c5406c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41664/0 (socket says 172.21.15.80:41664) 2019-11-28T11:48:45.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c53fff700 1 -- 172.21.15.80:0/3181721432 learned_addr learned my addr 172.21.15.80:0/3181721432 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:45.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c52ffd700 1 --2- 172.21.15.80:0/3181721432 >> v2:172.21.15.174:3300/0 conn(0x7f2c5415f100 0x7f2c5406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:45.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c53fff700 1 -- 172.21.15.80:0/3181721432 >> v2:172.21.15.174:3300/0 conn(0x7f2c5415f100 msgr2=0x7f2c5406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:45.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c53fff700 1 --2- 172.21.15.80:0/3181721432 >> v2:172.21.15.174:3300/0 conn(0x7f2c5415f100 0x7f2c5406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:45.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c53fff700 1 -- 172.21.15.80:0/3181721432 >> v1:172.21.15.174:6789/0 conn(0x7f2c5415ed10 legacy=0x7f2c54073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:45.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c53fff700 1 -- 172.21.15.80:0/3181721432 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c54070760 con 0x7f2c5406c2f0 2019-11-28T11:48:45.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c52ffd700 1 --2- 172.21.15.80:0/3181721432 >> v2:172.21.15.174:3300/0 conn(0x7f2c5415f100 0x7f2c5406bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:48:45.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c53fff700 1 --2- 172.21.15.80:0/3181721432 >> v2:172.21.15.80:3300/0 conn(0x7f2c5406c2f0 0x7f2c5406c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2c4c00f730 tx=0x7f2c4c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c53fff700 1 --2- 172.21.15.80:0/3181721432 >> v2:172.21.15.80:3300/0 conn(0x7f2c5406c2f0 0x7f2c5406c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2c4c00f730 tx=0x7f2c4c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.086+0000 7f2c53fff700 1 --2- 172.21.15.80:0/3181721432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c5406c2f0 0x7f2c5406c770 secure :-1 s=READY pgs=1986 cs=0 l=1 rx=0x7f2c4c00f730 tx=0x7f2c4c00fad0).ready entity=mon.0 client_cookie=5736ce804184d2b4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:45.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.087+0000 7f2c53fff700 1 --2- 172.21.15.80:0/3181721432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c5406c2f0 0x7f2c5406c770 secure :-1 s=THROTTLE_DONE pgs=1986 cs=0 l=1 rx=0x7f2c4c00f730 tx=0x7f2c4c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.087+0000 7f2c53fff700 1 --2- 172.21.15.80:0/3181721432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c5406c2f0 0x7f2c5406c770 secure :-1 s=THROTTLE_DONE pgs=1986 cs=0 l=1 rx=0x7f2c4c00f730 tx=0x7f2c4c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.087+0000 7f2c527fc700 1 -- 172.21.15.80:0/3181721432 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c4c000b90 con 0x7f2c5406c2f0 2019-11-28T11:48:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.087+0000 7f2c53fff700 1 --2- 172.21.15.80:0/3181721432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c5406c2f0 0x7f2c5406c770 secure :-1 s=THROTTLE_DONE pgs=1986 cs=0 l=1 rx=0x7f2c4c00f730 tx=0x7f2c4c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.087+0000 7f2c527fc700 1 -- 172.21.15.80:0/3181721432 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4c0010e0 con 0x7f2c5406c2f0 2019-11-28T11:48:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.087+0000 7f2c527fc700 1 -- 172.21.15.80:0/3181721432 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c4c001830 con 0x7f2c5406c2f0 2019-11-28T11:48:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.087+0000 7f2c594f9700 1 -- 172.21.15.80:0/3181721432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c5406c2f0 msgr2=0x7f2c5406c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.087+0000 7f2c594f9700 1 --2- 172.21.15.80:0/3181721432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c5406c2f0 0x7f2c5406c770 secure :-1 s=READY pgs=1986 cs=0 l=1 rx=0x7f2c4c00f730 tx=0x7f2c4c00fad0).stop 2019-11-28T11:48:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.087+0000 7f2c594f9700 1 -- 172.21.15.80:0/3181721432 shutdown_connections 2019-11-28T11:48:45.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.087+0000 7f2c594f9700 1 --2- 172.21.15.80:0/3181721432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c5406c2f0 0x7f2c5406c770 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:45.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.087+0000 7f2c594f9700 1 --2- 172.21.15.80:0/3181721432 >> v2:172.21.15.174:3300/0 conn(0x7f2c5415f100 0x7f2c5406bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:45.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.087+0000 7f2c594f9700 1 -- 172.21.15.80:0/3181721432 shutdown_connections 2019-11-28T11:48:45.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.087+0000 7f2c594f9700 1 -- 172.21.15.80:0/3181721432 wait complete. 2019-11-28T11:48:45.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.087+0000 7f2c594f9700 1 -- 172.21.15.80:0/3181721432 >> 172.21.15.80:0/3181721432 conn(0x7f2c54061d20 msgr2=0x7f2c540641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.090+0000 7f2c594f9700 1 Processor -- start 2019-11-28T11:48:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.090+0000 7f2c594f9700 1 -- start start 2019-11-28T11:48:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c594f9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c5410ed60 0x7f2c5410f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c594f9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2c5410f730 0x7f2c54167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c594f9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5410c250 con 0x7f2c5410e970 2019-11-28T11:48:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c594f9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5410e430 con 0x7f2c5410f730 2019-11-28T11:48:45.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c594f9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c54105860 con 0x7f2c5410ed60 2019-11-28T11:48:45.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c537fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f2c5410e970 0x7f2c541087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:56528/0 (socket says 172.21.15.80:56528) 2019-11-28T11:48:45.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c537fe700 1 -- 172.21.15.80:0/3892014262 learned_addr learned my addr 172.21.15.80:0/3892014262 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:45.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c52ffd700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c5410ed60 0x7f2c5410f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:45.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c53fff700 1 --2- 172.21.15.80:0/3892014262 >> v2:172.21.15.174:3300/0 conn(0x7f2c5410f730 0x7f2c54167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:45.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c4bfff700 1 -- 172.21.15.80:0/3892014262 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524030060 0 0) 0x7f2c44001480 con 0x7f2c5410e970 2019-11-28T11:48:45.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c4bfff700 1 -- 172.21.15.80:0/3892014262 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c2c002e80 con 0x7f2c5410e970 2019-11-28T11:48:45.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c52ffd700 1 -- 172.21.15.80:0/3892014262 >> v2:172.21.15.174:3300/0 conn(0x7f2c5410f730 msgr2=0x7f2c54167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:45.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c52ffd700 1 --2- 172.21.15.80:0/3892014262 >> v2:172.21.15.174:3300/0 conn(0x7f2c5410f730 0x7f2c54167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:45.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c52ffd700 1 -- 172.21.15.80:0/3892014262 >> v1:172.21.15.174:6789/0 conn(0x7f2c5410e970 legacy=0x7f2c541087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:45.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c52ffd700 1 -- 172.21.15.80:0/3892014262 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c54105ef0 con 0x7f2c5410ed60 2019-11-28T11:48:45.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c52ffd700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c5410ed60 0x7f2c5410f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2c3c010380 tx=0x7f2c3c00add0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.091+0000 7f2c52ffd700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c5410ed60 0x7f2c5410f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2c3c010380 tx=0x7f2c3c00add0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.092+0000 7f2c52ffd700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c5410ed60 0x7f2c5410f1f0 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7f2c3c010380 tx=0x7f2c3c00add0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:45.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.092+0000 7f2c52ffd700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c5410ed60 0x7f2c5410f1f0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f2c3c010380 tx=0x7f2c3c00add0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.092+0000 7f2c4bfff700 1 -- 172.21.15.80:0/3892014262 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c3c000940 con 0x7f2c5410ed60 2019-11-28T11:48:45.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.092+0000 7f2c52ffd700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c5410ed60 0x7f2c5410f1f0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f2c3c010380 tx=0x7f2c3c00add0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.092+0000 7f2c4bfff700 1 -- 172.21.15.80:0/3892014262 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c001170 con 0x7f2c5410ed60 2019-11-28T11:48:45.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.092+0000 7f2c52ffd700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c5410ed60 0x7f2c5410f1f0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f2c3c010380 tx=0x7f2c3c00add0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.092+0000 7f2c594f9700 1 -- 172.21.15.80:0/3892014262 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c54106270 con 0x7f2c5410ed60 2019-11-28T11:48:45.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.092+0000 7f2c4bfff700 1 -- 172.21.15.80:0/3892014262 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c3c000940 con 0x7f2c5410ed60 2019-11-28T11:48:45.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.092+0000 7f2c594f9700 1 -- 172.21.15.80:0/3892014262 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c54105ef0 con 0x7f2c5410ed60 2019-11-28T11:48:45.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.092+0000 7f2c52ffd700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c5410ed60 0x7f2c5410f1f0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f2c3c010380 tx=0x7f2c3c00add0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.092+0000 7f2c4bfff700 1 -- 172.21.15.80:0/3892014262 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2c3c000d70 con 0x7f2c5410ed60 2019-11-28T11:48:45.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.092+0000 7f2c52ffd700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c5410ed60 0x7f2c5410f1f0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f2c3c010380 tx=0x7f2c3c00add0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.092+0000 7f2c4bfff700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c2c018770 0x7f2c2c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:45.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.092+0000 7f2c4bfff700 1 -- 172.21.15.80:0/3892014262 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2c3c0319b0 con 0x7f2c5410ed60 2019-11-28T11:48:45.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.093+0000 7f2c537fe700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c2c018770 0x7f2c2c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:45.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.093+0000 7f2c537fe700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c2c018770 0x7f2c2c01abe0 crc :-1 s=READY pgs=805 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:45.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.100+0000 7f2c594f9700 1 -- 172.21.15.80:0/3892014262 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c54106270 con 0x7f2c5410ed60 2019-11-28T11:48:45.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.104+0000 7f2c52ffd700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c5410ed60 0x7f2c5410f1f0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f2c3c010380 tx=0x7f2c3c00add0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.104+0000 7f2c4bfff700 1 -- 172.21.15.80:0/3892014262 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2c3c000940 con 0x7f2c5410ed60 2019-11-28T11:48:45.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.274+0000 7f2c594f9700 1 -- 172.21.15.80:0/3892014262 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f2c54105ef0 con 0x7f2c5410ed60 2019-11-28T11:48:45.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.275+0000 7f2c52ffd700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c5410ed60 0x7f2c5410f1f0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f2c3c010380 tx=0x7f2c3c00add0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.275+0000 7f2c4bfff700 1 -- 172.21.15.80:0/3892014262 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v152) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2c3c000940 con 0x7f2c5410ed60 2019-11-28T11:48:45.321 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:48:45.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.277+0000 7f2c594f9700 1 -- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c2c018770 msgr2=0x7f2c2c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:45.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.277+0000 7f2c594f9700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c2c018770 0x7f2c2c01abe0 crc :-1 s=READY pgs=805 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:45.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.277+0000 7f2c594f9700 1 -- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c5410ed60 msgr2=0x7f2c5410f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:45.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.277+0000 7f2c594f9700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c5410ed60 0x7f2c5410f1f0 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7f2c3c010380 tx=0x7f2c3c00add0).stop 2019-11-28T11:48:45.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.277+0000 7f2c594f9700 1 -- 172.21.15.80:0/3892014262 shutdown_connections 2019-11-28T11:48:45.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.277+0000 7f2c594f9700 1 --2- 172.21.15.80:0/3892014262 >> v2:172.21.15.174:3300/0 conn(0x7f2c5410f730 0x7f2c54167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:45.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.277+0000 7f2c594f9700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2c5410ed60 0x7f2c5410f1f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:45.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.277+0000 7f2c594f9700 1 --2- 172.21.15.80:0/3892014262 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2c2c018770 0x7f2c2c01abe0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:45.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.277+0000 7f2c594f9700 1 -- 172.21.15.80:0/3892014262 shutdown_connections 2019-11-28T11:48:45.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.278+0000 7f2c594f9700 1 -- 172.21.15.80:0/3892014262 wait complete. 2019-11-28T11:48:45.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.278+0000 7f2c594f9700 1 -- 172.21.15.80:0/3892014262 >> 172.21.15.80:0/3892014262 conn(0x7f2c5415e2d0 msgr2=0x7f2c54147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:45.333 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:48:45.333 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:48:45.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.408+0000 7fdc4d53c700 1 Processor -- start 2019-11-28T11:48:45.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.408+0000 7fdc4d53c700 1 -- start start 2019-11-28T11:48:45.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.409+0000 7fdc4d53c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc4806c0a0 0x7fdc48072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:45.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.409+0000 7fdc4d53c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdc48072620 0x7fdc48164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:45.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.409+0000 7fdc4d53c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4806db00 con 0x7fdc480734e0 2019-11-28T11:48:45.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.409+0000 7fdc4d53c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4806f330 con 0x7fdc48072620 2019-11-28T11:48:45.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.409+0000 7fdc4d53c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc480706c0 con 0x7fdc4806c0a0 2019-11-28T11:48:45.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc46ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdc480734e0 0x7fdc48071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40996/0 (socket says 172.21.15.80:40996) 2019-11-28T11:48:45.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc46ffd700 1 -- 172.21.15.80:0/284418452 learned_addr learned my addr 172.21.15.80:0/284418452 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:45.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc477fe700 1 --2- 172.21.15.80:0/284418452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc4806c0a0 0x7fdc48072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:45.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc47fff700 1 --2- 172.21.15.80:0/284418452 >> v2:172.21.15.174:3300/0 conn(0x7fdc48072620 0x7fdc48164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:45.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc467fc700 1 -- 172.21.15.80:0/284418452 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1292088271 0 0) 0x7fdc30001070 con 0x7fdc480734e0 2019-11-28T11:48:45.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc467fc700 1 -- 172.21.15.80:0/284418452 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc28002e80 con 0x7fdc480734e0 2019-11-28T11:48:45.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc477fe700 1 -- 172.21.15.80:0/284418452 >> v2:172.21.15.174:3300/0 conn(0x7fdc48072620 msgr2=0x7fdc48164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:45.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc477fe700 1 --2- 172.21.15.80:0/284418452 >> v2:172.21.15.174:3300/0 conn(0x7fdc48072620 0x7fdc48164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:45.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc477fe700 1 -- 172.21.15.80:0/284418452 >> v1:172.21.15.80:6789/0 conn(0x7fdc480734e0 legacy=0x7fdc48071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:45.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc477fe700 1 -- 172.21.15.80:0/284418452 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc48070a40 con 0x7fdc4806c0a0 2019-11-28T11:48:45.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc477fe700 1 --2- 172.21.15.80:0/284418452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc4806c0a0 0x7fdc48072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdc3800b2d0 tx=0x7fdc3800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc477fe700 1 --2- 172.21.15.80:0/284418452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc4806c0a0 0x7fdc48072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdc3800b2d0 tx=0x7fdc3800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc477fe700 1 --2- 172.21.15.80:0/284418452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc4806c0a0 0x7fdc48072fa0 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7fdc3800b2d0 tx=0x7fdc3800b5d0).ready entity=mon.2 client_cookie=cbc5d11d2133aae4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:45.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc477fe700 1 --2- 172.21.15.80:0/284418452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc4806c0a0 0x7fdc48072fa0 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fdc3800b2d0 tx=0x7fdc3800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc467fc700 1 -- 172.21.15.80:0/284418452 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc38007590 con 0x7fdc4806c0a0 2019-11-28T11:48:45.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc477fe700 1 --2- 172.21.15.80:0/284418452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc4806c0a0 0x7fdc48072fa0 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fdc3800b2d0 tx=0x7fdc3800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc477fe700 1 --2- 172.21.15.80:0/284418452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc4806c0a0 0x7fdc48072fa0 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fdc3800b2d0 tx=0x7fdc3800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc467fc700 1 -- 172.21.15.80:0/284418452 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc38009d30 con 0x7fdc4806c0a0 2019-11-28T11:48:45.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc467fc700 1 -- 172.21.15.80:0/284418452 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc3800a400 con 0x7fdc4806c0a0 2019-11-28T11:48:45.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc4d53c700 1 -- 172.21.15.80:0/284418452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc4806c0a0 msgr2=0x7fdc48072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:45.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.410+0000 7fdc4d53c700 1 --2- 172.21.15.80:0/284418452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc4806c0a0 0x7fdc48072fa0 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7fdc3800b2d0 tx=0x7fdc3800b5d0).stop 2019-11-28T11:48:45.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.411+0000 7fdc4d53c700 1 -- 172.21.15.80:0/284418452 shutdown_connections 2019-11-28T11:48:45.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.411+0000 7fdc4d53c700 1 --2- 172.21.15.80:0/284418452 >> v2:172.21.15.174:3300/0 conn(0x7fdc48072620 0x7fdc48164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:45.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.411+0000 7fdc4d53c700 1 --2- 172.21.15.80:0/284418452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc4806c0a0 0x7fdc48072fa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:45.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.411+0000 7fdc4d53c700 1 -- 172.21.15.80:0/284418452 shutdown_connections 2019-11-28T11:48:45.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.411+0000 7fdc4d53c700 1 -- 172.21.15.80:0/284418452 wait complete. 2019-11-28T11:48:45.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.411+0000 7fdc4d53c700 1 -- 172.21.15.80:0/284418452 >> 172.21.15.80:0/284418452 conn(0x7fdc48061cf0 msgr2=0x7fdc48064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:45.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.413+0000 7fdc4d53c700 1 Processor -- start 2019-11-28T11:48:45.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.414+0000 7fdc4d53c700 1 -- start start 2019-11-28T11:48:45.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.414+0000 7fdc4d53c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdc4813e5f0 0x7fdc4813e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:45.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.414+0000 7fdc4d53c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc481066e0 con 0x7fdc4810a4e0 2019-11-28T11:48:45.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc4d53c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4810ce40 con 0x7fdc4810a070 2019-11-28T11:48:45.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc4d53c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4810e060 con 0x7fdc4813e5f0 2019-11-28T11:48:45.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc477fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdc4813e5f0 0x7fdc4813e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:45.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc477fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdc4813e5f0 0x7fdc4813e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41682/0 (socket says 172.21.15.80:41682) 2019-11-28T11:48:45.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc477fe700 1 -- 172.21.15.80:0/2756608769 learned_addr learned my addr 172.21.15.80:0/2756608769 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:45.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc477fe700 1 -- 172.21.15.80:0/2756608769 >> v1:172.21.15.174:6789/0 conn(0x7fdc4810a070 legacy=0x7fdc4810bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:45.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc477fe700 1 -- 172.21.15.80:0/2756608769 >> v1:172.21.15.80:6789/0 conn(0x7fdc4810a4e0 legacy=0x7fdc4810c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:45.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc3ffff700 1 -- 172.21.15.80:0/2756608769 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998102029 0 0) 0x7fdc30001030 con 0x7fdc4810a070 2019-11-28T11:48:45.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc477fe700 1 -- 172.21.15.80:0/2756608769 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4810e9c0 con 0x7fdc4813e5f0 2019-11-28T11:48:45.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc477fe700 1 --2- 172.21.15.80:0/2756608769 >> v2:172.21.15.80:3300/0 conn(0x7fdc4813e5f0 0x7fdc4813e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc380107e0 tx=0x7fdc38010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc477fe700 1 --2- 172.21.15.80:0/2756608769 >> v2:172.21.15.80:3300/0 conn(0x7fdc4813e5f0 0x7fdc4813e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc380107e0 tx=0x7fdc38010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc477fe700 1 --2- 172.21.15.80:0/2756608769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc4813e5f0 0x7fdc4813e9e0 secure :-1 s=READY pgs=1989 cs=0 l=1 rx=0x7fdc380107e0 tx=0x7fdc38010b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:45.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc477fe700 1 --2- 172.21.15.80:0/2756608769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc4813e5f0 0x7fdc4813e9e0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7fdc380107e0 tx=0x7fdc38010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc3ffff700 1 -- 172.21.15.80:0/2756608769 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc38000cc0 con 0x7fdc4813e5f0 2019-11-28T11:48:45.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc477fe700 1 --2- 172.21.15.80:0/2756608769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc4813e5f0 0x7fdc4813e9e0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7fdc380107e0 tx=0x7fdc38010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc4d53c700 1 -- 172.21.15.80:0/2756608769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4810ed40 con 0x7fdc4813e5f0 2019-11-28T11:48:45.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc3ffff700 1 -- 172.21.15.80:0/2756608769 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc38000cc0 con 0x7fdc4813e5f0 2019-11-28T11:48:45.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc477fe700 1 --2- 172.21.15.80:0/2756608769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc4813e5f0 0x7fdc4813e9e0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7fdc380107e0 tx=0x7fdc38010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc3ffff700 1 -- 172.21.15.80:0/2756608769 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc38009ce0 con 0x7fdc4813e5f0 2019-11-28T11:48:45.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.415+0000 7fdc4d53c700 1 -- 172.21.15.80:0/2756608769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4810e9c0 con 0x7fdc4813e5f0 2019-11-28T11:48:45.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.416+0000 7fdc477fe700 1 --2- 172.21.15.80:0/2756608769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc4813e5f0 0x7fdc4813e9e0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7fdc380107e0 tx=0x7fdc38010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.416+0000 7fdc3ffff700 1 -- 172.21.15.80:0/2756608769 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fdc38009900 con 0x7fdc4813e5f0 2019-11-28T11:48:45.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.416+0000 7fdc477fe700 1 --2- 172.21.15.80:0/2756608769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc4813e5f0 0x7fdc4813e9e0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7fdc380107e0 tx=0x7fdc38010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.416+0000 7fdc3ffff700 1 --2- 172.21.15.80:0/2756608769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdc20018730 0x7fdc2001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:45.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.416+0000 7fdc3ffff700 1 -- 172.21.15.80:0/2756608769 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fdc38031f40 con 0x7fdc4813e5f0 2019-11-28T11:48:45.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.417+0000 7fdc46ffd700 1 --2- 172.21.15.80:0/2756608769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdc20018730 0x7fdc2001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:45.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.417+0000 7fdc46ffd700 1 --2- 172.21.15.80:0/2756608769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdc20018730 0x7fdc2001abc0 crc :-1 s=READY pgs=806 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:45.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.424+0000 7fdc4d53c700 1 -- 172.21.15.80:0/2756608769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc4810ed40 con 0x7fdc4813e5f0 2019-11-28T11:48:45.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.427+0000 7fdc477fe700 1 --2- 172.21.15.80:0/2756608769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc4813e5f0 0x7fdc4813e9e0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7fdc380107e0 tx=0x7fdc38010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.427+0000 7fdc3ffff700 1 -- 172.21.15.80:0/2756608769 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fdc3800b280 con 0x7fdc4813e5f0 2019-11-28T11:48:45.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.600+0000 7fdc4d53c700 1 -- 172.21.15.80:0/2756608769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc4810e9c0 con 0x7fdc4813e5f0 2019-11-28T11:48:45.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.600+0000 7fdc477fe700 1 --2- 172.21.15.80:0/2756608769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc4813e5f0 0x7fdc4813e9e0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7fdc380107e0 tx=0x7fdc38010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:45.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.600+0000 7fdc3ffff700 1 -- 172.21.15.80:0/2756608769 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+2455 (secure 0 0 0) 0x7fdc38009900 con 0x7fdc4813e5f0 2019-11-28T11:48:45.646 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 116 2019-11-28T11:48:45.646 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:45.647 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":116,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9109,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2247103324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2247103324},{"type":"v1","addr":"172.21.15.80:6834","nonce":2247103324}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":116},{"gid":9765,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3505175822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3505175822},{"type":"v1","addr":"172.21.15.80:6835","nonce":3505175822}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":116}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:48:37.109829+0000","modified":"2019-11-28T11:48:41.120965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6785":{"gid":6785,"name":"c","rank":0,"incarnation":114,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/1862798714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1862798714},{"type":"v1","addr":"172.21.15.174:6835","nonce":1862798714}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2019-11-28T11:48:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.602+0000 7fdc4d53c700 1 -- 172.21.15.80:0/2756608769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdc20018730 msgr2=0x7fdc2001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.602+0000 7fdc4d53c700 1 --2- 172.21.15.80:0/2756608769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdc20018730 0x7fdc2001abc0 crc :-1 s=READY pgs=806 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.602+0000 7fdc4d53c700 1 -- 172.21.15.80:0/2756608769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc4813e5f0 msgr2=0x7fdc4813e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.602+0000 7fdc4d53c700 1 --2- 172.21.15.80:0/2756608769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc4813e5f0 0x7fdc4813e9e0 secure :-1 s=READY pgs=1989 cs=0 l=1 rx=0x7fdc380107e0 tx=0x7fdc38010b80).stop 2019-11-28T11:48:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.602+0000 7fdc4d53c700 1 -- 172.21.15.80:0/2756608769 shutdown_connections 2019-11-28T11:48:45.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.602+0000 7fdc4d53c700 1 --2- 172.21.15.80:0/2756608769 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdc20018730 0x7fdc2001abc0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:45.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.602+0000 7fdc4d53c700 1 --2- 172.21.15.80:0/2756608769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc4813e5f0 0x7fdc4813e9e0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:45.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.603+0000 7fdc4d53c700 1 -- 172.21.15.80:0/2756608769 shutdown_connections 2019-11-28T11:48:45.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.603+0000 7fdc4d53c700 1 -- 172.21.15.80:0/2756608769 wait complete. 2019-11-28T11:48:45.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:45.603+0000 7fdc4d53c700 1 -- 172.21.15.80:0/2756608769 >> 172.21.15.80:0/2756608769 conn(0x7fdc4813d620 msgr2=0x7fdc4813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:45.963 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6785}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 24, u'failed': [], u'epoch': 115, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [25], u'info': {u'gid_6785': {u'export_targets': [], u'name': u'c', u'incarnation': 114, u'state_seq': 2, u'state': u'up:active', u'gid': 6785, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1862798714, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 1862798714, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/1862798714'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:48:37.109829+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:48:41.120965+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:48:45.963 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:48:45.964 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:48:46.089 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:48:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:48:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:48:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 6785, 2019-11-28T11:48:46.089 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:48:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:48:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 5.9221721660000002, 2019-11-28T11:48:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 115, 2019-11-28T11:48:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 152, 2019-11-28T11:48:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 152, 2019-11-28T11:48:46.090 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 6.4512356820000001 2019-11-28T11:48:46.090 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:48:46.094 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 6785, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.9221721660000002, "mdsmap_epoch": 115, "osdmap_epoch": 152, "osdmap_epoch_barrier": 152, "uptime": 6.4512356820000001 } 2019-11-28T11:48:46.095 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:48:46.095 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:48:46.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:48:46.095 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:48:46.168 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:48:46.169 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:48:46.290 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:48:46.290 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:48:46.290 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:48:46.290 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:48:46.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:48:46.291 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:48:46.361 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:48:46.484 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:48:46.484 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:48:46.484 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:48:46.490 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:48:46.490 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:48:46.611 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:48:46.612 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:48:46.612 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:48:46.617 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:48:46.618 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:48:46.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:48:46.618 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T11:48:46.739 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:48:46.743 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:48:46.783 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:48:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.858+0000 7f6396f11700 1 Processor -- start 2019-11-28T11:48:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.858+0000 7f6396f11700 1 -- start start 2019-11-28T11:48:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.859+0000 7f6396f11700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f639006c490 0x7f639006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.859+0000 7f6396f11700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f639006ce60 0x7f6390164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.859+0000 7f6396f11700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639006db00 con 0x7f639006c0a0 2019-11-28T11:48:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.859+0000 7f6396f11700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639006fd60 con 0x7f639006ce60 2019-11-28T11:48:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.859+0000 7f6396f11700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6390070030 con 0x7f639006c490 2019-11-28T11:48:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.859+0000 7f6395caf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f639006ce60 0x7f6390164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.859+0000 7f6394cad700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f639006c490 0x7f639006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.859+0000 7f6395caf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f639006ce60 0x7f6390164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:56578/0 (socket says 172.21.15.80:56578) 2019-11-28T11:48:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.859+0000 7f6395caf700 1 -- 172.21.15.80:0/676151734 learned_addr learned my addr 172.21.15.80:0/676151734 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.860+0000 7f6395caf700 1 -- 172.21.15.80:0/676151734 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f639006c490 msgr2=0x7f639006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.860+0000 7f6395caf700 1 --2- 172.21.15.80:0/676151734 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f639006c490 0x7f639006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.860+0000 7f6395caf700 1 -- 172.21.15.80:0/676151734 >> v1:172.21.15.174:6789/0 conn(0x7f639006c0a0 legacy=0x7f6390072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.860+0000 7f6395caf700 1 -- 172.21.15.80:0/676151734 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63900706c0 con 0x7f639006ce60 2019-11-28T11:48:46.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.860+0000 7f6394cad700 1 --2- 172.21.15.80:0/676151734 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f639006c490 0x7f639006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:48:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.860+0000 7f6395caf700 1 --2- 172.21.15.80:0/676151734 >> v2:172.21.15.174:3300/0 conn(0x7f639006ce60 0x7f6390164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f638800f760 tx=0x7f638800fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.860+0000 7f6395caf700 1 --2- 172.21.15.80:0/676151734 >> v2:172.21.15.174:3300/0 conn(0x7f639006ce60 0x7f6390164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f638800f760 tx=0x7f638800fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.860+0000 7f6395caf700 1 --2- 172.21.15.80:0/676151734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f639006ce60 0x7f6390164d70 secure :-1 s=READY pgs=1169 cs=0 l=1 rx=0x7f638800f760 tx=0x7f638800fb00).ready entity=mon.1 client_cookie=4a4d3872fe38070 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.860+0000 7f6395caf700 1 --2- 172.21.15.80:0/676151734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f639006ce60 0x7f6390164d70 secure :-1 s=THROTTLE_DONE pgs=1169 cs=0 l=1 rx=0x7f638800f760 tx=0x7f638800fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.860+0000 7f6395caf700 1 --2- 172.21.15.80:0/676151734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f639006ce60 0x7f6390164d70 secure :-1 s=THROTTLE_DONE pgs=1169 cs=0 l=1 rx=0x7f638800f760 tx=0x7f638800fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.860+0000 7f638ffff700 1 -- 172.21.15.80:0/676151734 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6388000a70 con 0x7f639006ce60 2019-11-28T11:48:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.860+0000 7f6395caf700 1 --2- 172.21.15.80:0/676151734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f639006ce60 0x7f6390164d70 secure :-1 s=THROTTLE_DONE pgs=1169 cs=0 l=1 rx=0x7f638800f760 tx=0x7f638800fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.860+0000 7f638ffff700 1 -- 172.21.15.80:0/676151734 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6388000e70 con 0x7f639006ce60 2019-11-28T11:48:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.860+0000 7f638ffff700 1 -- 172.21.15.80:0/676151734 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6388001500 con 0x7f639006ce60 2019-11-28T11:48:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.860+0000 7f6396f11700 1 -- 172.21.15.80:0/676151734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f639006ce60 msgr2=0x7f6390164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.860+0000 7f6396f11700 1 --2- 172.21.15.80:0/676151734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f639006ce60 0x7f6390164d70 secure :-1 s=READY pgs=1169 cs=0 l=1 rx=0x7f638800f760 tx=0x7f638800fb00).stop 2019-11-28T11:48:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.861+0000 7f6396f11700 1 -- 172.21.15.80:0/676151734 shutdown_connections 2019-11-28T11:48:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.861+0000 7f6396f11700 1 --2- 172.21.15.80:0/676151734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f639006ce60 0x7f6390164d70 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:46.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.861+0000 7f6396f11700 1 --2- 172.21.15.80:0/676151734 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f639006c490 0x7f639006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:46.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.861+0000 7f6396f11700 1 -- 172.21.15.80:0/676151734 shutdown_connections 2019-11-28T11:48:46.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.861+0000 7f6396f11700 1 -- 172.21.15.80:0/676151734 wait complete. 2019-11-28T11:48:46.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.861+0000 7f6396f11700 1 -- 172.21.15.80:0/676151734 >> 172.21.15.80:0/676151734 conn(0x7f6390061cf0 msgr2=0x7f6390064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:46.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.863+0000 7f6396f11700 1 Processor -- start 2019-11-28T11:48:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.863+0000 7f6396f11700 1 -- start start 2019-11-28T11:48:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.864+0000 7f6396f11700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6390104d10 0x7f639010e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.864+0000 7f6396f11700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f639010e670 0x7f639013e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.864+0000 7f6396f11700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6390135c60 con 0x7f639013e830 2019-11-28T11:48:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.864+0000 7f6396f11700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6390141e60 con 0x7f6390104d10 2019-11-28T11:48:46.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.864+0000 7f6396f11700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6390107cb0 con 0x7f639010e670 2019-11-28T11:48:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f63954ae700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6390104d10 0x7f639010e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f6395caf700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f639013e830 0x7f639010cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41014/0 (socket says 172.21.15.80:41014) 2019-11-28T11:48:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f6395caf700 1 -- 172.21.15.80:0/4292672101 learned_addr learned my addr 172.21.15.80:0/4292672101 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f6394cad700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f639010e670 0x7f639013e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f638dffb700 1 -- 172.21.15.80:0/4292672101 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48269146 0 0) 0x7f6388007950 con 0x7f639013e830 2019-11-28T11:48:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f638dffb700 1 -- 172.21.15.80:0/4292672101 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6370002e80 con 0x7f639013e830 2019-11-28T11:48:46.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f63954ae700 1 -- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f639010e670 msgr2=0x7f639013e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:46.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f63954ae700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f639010e670 0x7f639013e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:46.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f63954ae700 1 -- 172.21.15.80:0/4292672101 >> v1:172.21.15.80:6789/0 conn(0x7f639013e830 legacy=0x7f639010cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:46.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f63954ae700 1 -- 172.21.15.80:0/4292672101 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63901424f0 con 0x7f6390104d10 2019-11-28T11:48:46.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f6394cad700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f639010e670 0x7f639013e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:48:46.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f63954ae700 1 --2- 172.21.15.80:0/4292672101 >> v2:172.21.15.174:3300/0 conn(0x7f6390104d10 0x7f639010e130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6380010720 tx=0x7f6380010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:46.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f63954ae700 1 --2- 172.21.15.80:0/4292672101 >> v2:172.21.15.174:3300/0 conn(0x7f6390104d10 0x7f639010e130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6380010720 tx=0x7f6380010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:46.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f63954ae700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6390104d10 0x7f639010e130 secure :-1 s=READY pgs=1170 cs=0 l=1 rx=0x7f6380010720 tx=0x7f6380010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:46.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f63954ae700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6390104d10 0x7f639010e130 secure :-1 s=THROTTLE_DONE pgs=1170 cs=0 l=1 rx=0x7f6380010720 tx=0x7f6380010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:46.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f638dffb700 1 -- 172.21.15.80:0/4292672101 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6380000ce0 con 0x7f6390104d10 2019-11-28T11:48:46.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f63954ae700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6390104d10 0x7f639010e130 secure :-1 s=THROTTLE_DONE pgs=1170 cs=0 l=1 rx=0x7f6380010720 tx=0x7f6380010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:46.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f63954ae700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6390104d10 0x7f639010e130 secure :-1 s=THROTTLE_DONE pgs=1170 cs=0 l=1 rx=0x7f6380010720 tx=0x7f6380010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:46.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f638dffb700 1 -- 172.21.15.80:0/4292672101 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6380009d00 con 0x7f6390104d10 2019-11-28T11:48:46.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f6396f11700 1 -- 172.21.15.80:0/4292672101 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63901424f0 con 0x7f6390104d10 2019-11-28T11:48:46.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f638dffb700 1 -- 172.21.15.80:0/4292672101 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f638000a410 con 0x7f6390104d10 2019-11-28T11:48:46.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.865+0000 7f6396f11700 1 -- 172.21.15.80:0/4292672101 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63901424f0 con 0x7f6390104d10 2019-11-28T11:48:46.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.866+0000 7f63954ae700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6390104d10 0x7f639010e130 secure :-1 s=THROTTLE_DONE pgs=1170 cs=0 l=1 rx=0x7f6380010720 tx=0x7f6380010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:46.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.866+0000 7f638dffb700 1 -- 172.21.15.80:0/4292672101 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6380009ef0 con 0x7f6390104d10 2019-11-28T11:48:46.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.866+0000 7f63954ae700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6390104d10 0x7f639010e130 secure :-1 s=THROTTLE_DONE pgs=1170 cs=0 l=1 rx=0x7f6380010720 tx=0x7f6380010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:46.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.866+0000 7f638dffb700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6370018770 0x7f637001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:46.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.866+0000 7f638dffb700 1 -- 172.21.15.80:0/4292672101 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6380031df0 con 0x7f6390104d10 2019-11-28T11:48:46.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.866+0000 7f6394cad700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6370018770 0x7f637001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:46.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.866+0000 7f6394cad700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6370018770 0x7f637001abe0 crc :-1 s=READY pgs=807 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:46.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.873+0000 7f6396f11700 1 -- 172.21.15.80:0/4292672101 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63901424f0 con 0x7f6390104d10 2019-11-28T11:48:46.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.877+0000 7f63954ae700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6390104d10 0x7f639010e130 secure :-1 s=THROTTLE_DONE pgs=1170 cs=0 l=1 rx=0x7f6380010720 tx=0x7f6380010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:46.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:46.877+0000 7f638dffb700 1 -- 172.21.15.80:0/4292672101 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f638002cef0 con 0x7f6390104d10 2019-11-28T11:48:47.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.052+0000 7f6396f11700 1 -- 172.21.15.80:0/4292672101 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63901424f0 con 0x7f6390104d10 2019-11-28T11:48:47.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.053+0000 7f63954ae700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6390104d10 0x7f639010e130 secure :-1 s=THROTTLE_DONE pgs=1170 cs=0 l=1 rx=0x7f6380010720 tx=0x7f6380010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.053+0000 7f638dffb700 1 -- 172.21.15.80:0/4292672101 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f638002cef0 con 0x7f6390104d10 2019-11-28T11:48:47.101 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:47.102 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":152,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:48:38.111012+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:48:35.444932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2019-11-28T11:48:36.133221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:48:47.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.057+0000 7f6396f11700 1 -- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6370018770 msgr2=0x7f637001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.057+0000 7f6396f11700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6370018770 0x7f637001abe0 crc :-1 s=READY pgs=807 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.057+0000 7f6396f11700 1 -- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6390104d10 msgr2=0x7f639010e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.057+0000 7f6396f11700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6390104d10 0x7f639010e130 secure :-1 s=READY pgs=1170 cs=0 l=1 rx=0x7f6380010720 tx=0x7f6380010ac0).stop 2019-11-28T11:48:47.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.057+0000 7f6396f11700 1 -- 172.21.15.80:0/4292672101 shutdown_connections 2019-11-28T11:48:47.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.057+0000 7f6396f11700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6370018770 0x7f637001abe0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.057+0000 7f6396f11700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f639010e670 0x7f639013e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.057+0000 7f6396f11700 1 --2- 172.21.15.80:0/4292672101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6390104d10 0x7f639010e130 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.057+0000 7f6396f11700 1 -- 172.21.15.80:0/4292672101 shutdown_connections 2019-11-28T11:48:47.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.057+0000 7f6396f11700 1 -- 172.21.15.80:0/4292672101 wait complete. 2019-11-28T11:48:47.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.057+0000 7f6396f11700 1 -- 172.21.15.80:0/4292672101 >> 172.21.15.80:0/4292672101 conn(0x7f639015e210 msgr2=0x7f639010b140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:47.121 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:48:35.444932+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 24, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'151', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:48:36.133221+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 25, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'152', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:48:47.122 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:48:47.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.205+0000 7fc745c2c700 1 Processor -- start 2019-11-28T11:48:47.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.205+0000 7fc745c2c700 1 -- start start 2019-11-28T11:48:47.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.206+0000 7fc745c2c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc74015f100 0x7fc74006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:47.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.206+0000 7fc745c2c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74006db60 con 0x7fc74006c2f0 2019-11-28T11:48:47.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.206+0000 7fc745c2c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74006e060 con 0x7fc74015ed10 2019-11-28T11:48:47.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.206+0000 7fc745c2c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74006fe00 con 0x7fc74015f100 2019-11-28T11:48:47.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.206+0000 7fc737fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc74015f100 0x7fc74006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:47.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.206+0000 7fc737fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc74015f100 0x7fc74006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41706/0 (socket says 172.21.15.80:41706) 2019-11-28T11:48:47.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.206+0000 7fc737fff700 1 -- 172.21.15.80:0/3998550894 learned_addr learned my addr 172.21.15.80:0/3998550894 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:47.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.207+0000 7fc737fff700 1 -- 172.21.15.80:0/3998550894 >> v1:172.21.15.174:6789/0 conn(0x7fc74015ed10 legacy=0x7fc740073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.207+0000 7fc737fff700 1 -- 172.21.15.80:0/3998550894 >> v1:172.21.15.80:6789/0 conn(0x7fc74006c2f0 legacy=0x7fc74006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.207+0000 7fc73f7fe700 1 -- 172.21.15.80:0/3998550894 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755153425 0 0) 0x7fc738001480 con 0x7fc74006c2f0 2019-11-28T11:48:47.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.207+0000 7fc737fff700 1 -- 172.21.15.80:0/3998550894 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc740070760 con 0x7fc74015f100 2019-11-28T11:48:47.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.207+0000 7fc737fff700 1 --2- 172.21.15.80:0/3998550894 >> v2:172.21.15.80:3300/0 conn(0x7fc74015f100 0x7fc74006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc72800f740 tx=0x7fc72800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.207+0000 7fc737fff700 1 --2- 172.21.15.80:0/3998550894 >> v2:172.21.15.80:3300/0 conn(0x7fc74015f100 0x7fc74006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc72800f740 tx=0x7fc72800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.207+0000 7fc737fff700 1 --2- 172.21.15.80:0/3998550894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74015f100 0x7fc74006bdb0 secure :-1 s=READY pgs=1993 cs=0 l=1 rx=0x7fc72800f740 tx=0x7fc72800fae0).ready entity=mon.0 client_cookie=d17a376417af9644 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:47.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.207+0000 7fc737fff700 1 --2- 172.21.15.80:0/3998550894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74015f100 0x7fc74006bdb0 secure :-1 s=THROTTLE_DONE pgs=1993 cs=0 l=1 rx=0x7fc72800f740 tx=0x7fc72800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.207+0000 7fc73f7fe700 1 -- 172.21.15.80:0/3998550894 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc728000960 con 0x7fc74015f100 2019-11-28T11:48:47.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.207+0000 7fc737fff700 1 --2- 172.21.15.80:0/3998550894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74015f100 0x7fc74006bdb0 secure :-1 s=THROTTLE_DONE pgs=1993 cs=0 l=1 rx=0x7fc72800f740 tx=0x7fc72800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.207+0000 7fc737fff700 1 --2- 172.21.15.80:0/3998550894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74015f100 0x7fc74006bdb0 secure :-1 s=THROTTLE_DONE pgs=1993 cs=0 l=1 rx=0x7fc72800f740 tx=0x7fc72800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.207+0000 7fc73f7fe700 1 -- 172.21.15.80:0/3998550894 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc728000c90 con 0x7fc74015f100 2019-11-28T11:48:47.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.207+0000 7fc73f7fe700 1 -- 172.21.15.80:0/3998550894 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc728000960 con 0x7fc74015f100 2019-11-28T11:48:47.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.207+0000 7fc745c2c700 1 -- 172.21.15.80:0/3998550894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74015f100 msgr2=0x7fc74006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.207+0000 7fc745c2c700 1 --2- 172.21.15.80:0/3998550894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74015f100 0x7fc74006bdb0 secure :-1 s=READY pgs=1993 cs=0 l=1 rx=0x7fc72800f740 tx=0x7fc72800fae0).stop 2019-11-28T11:48:47.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.208+0000 7fc745c2c700 1 -- 172.21.15.80:0/3998550894 shutdown_connections 2019-11-28T11:48:47.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.208+0000 7fc745c2c700 1 --2- 172.21.15.80:0/3998550894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74015f100 0x7fc74006bdb0 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.208+0000 7fc745c2c700 1 -- 172.21.15.80:0/3998550894 shutdown_connections 2019-11-28T11:48:47.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.208+0000 7fc745c2c700 1 -- 172.21.15.80:0/3998550894 wait complete. 2019-11-28T11:48:47.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.208+0000 7fc745c2c700 1 -- 172.21.15.80:0/3998550894 >> 172.21.15.80:0/3998550894 conn(0x7fc740061d20 msgr2=0x7fc7400641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:47.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.210+0000 7fc745c2c700 1 Processor -- start 2019-11-28T11:48:47.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.210+0000 7fc745c2c700 1 -- start start 2019-11-28T11:48:47.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.211+0000 7fc745c2c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc740128430 0x7fc74007c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:47.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.211+0000 7fc745c2c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc74007b450 0x7fc74007b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:47.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.211+0000 7fc745c2c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc740165990 con 0x7fc740101e80 2019-11-28T11:48:47.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.211+0000 7fc745c2c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc740148760 con 0x7fc74007b450 2019-11-28T11:48:47.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.211+0000 7fc745c2c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc740079d10 con 0x7fc740128430 2019-11-28T11:48:47.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.211+0000 7fc737fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc740101e80 0x7fc740165190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41026/0 (socket says 172.21.15.80:41026) 2019-11-28T11:48:47.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.211+0000 7fc737fff700 1 -- 172.21.15.80:0/174346794 learned_addr learned my addr 172.21.15.80:0/174346794 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:47.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.211+0000 7fc7449ca700 1 --2- 172.21.15.80:0/174346794 >> v2:172.21.15.174:3300/0 conn(0x7fc74007b450 0x7fc74007b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:47.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.211+0000 7fc73ffff700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc740128430 0x7fc74007c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:47.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.211+0000 7fc73d7fa700 1 -- 172.21.15.80:0/174346794 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273866346 0 0) 0x7fc728007b10 con 0x7fc740101e80 2019-11-28T11:48:47.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc73d7fa700 1 -- 172.21.15.80:0/174346794 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc724002e80 con 0x7fc740101e80 2019-11-28T11:48:47.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc73d7fa700 1 -- 172.21.15.80:0/174346794 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3205468952 0 0) 0x7fc7280081b0 con 0x7fc740101e80 2019-11-28T11:48:47.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc73d7fa700 1 -- 172.21.15.80:0/174346794 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc7240032e0 con 0x7fc740101e80 2019-11-28T11:48:47.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc73d7fa700 1 -- 172.21.15.80:0/174346794 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc728000940 con 0x7fc740101e80 2019-11-28T11:48:47.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc7449ca700 1 -- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc740128430 msgr2=0x7fc74007c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc7449ca700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc740128430 0x7fc74007c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc7449ca700 1 -- 172.21.15.80:0/174346794 >> v1:172.21.15.80:6789/0 conn(0x7fc740101e80 legacy=0x7fc740165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc7449ca700 1 -- 172.21.15.80:0/174346794 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74007a090 con 0x7fc74007b450 2019-11-28T11:48:47.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc73ffff700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc740128430 0x7fc74007c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:48:47.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc7449ca700 1 --2- 172.21.15.80:0/174346794 >> v2:172.21.15.174:3300/0 conn(0x7fc74007b450 0x7fc74007b8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc738010720 tx=0x7fc738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc7449ca700 1 --2- 172.21.15.80:0/174346794 >> v2:172.21.15.174:3300/0 conn(0x7fc74007b450 0x7fc74007b8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc738010720 tx=0x7fc738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc7449ca700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc74007b450 0x7fc74007b8f0 secure :-1 s=READY pgs=1172 cs=0 l=1 rx=0x7fc738010720 tx=0x7fc738010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:47.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc7449ca700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc74007b450 0x7fc74007b8f0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7fc738010720 tx=0x7fc738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc73d7fa700 1 -- 172.21.15.80:0/174346794 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc738007590 con 0x7fc74007b450 2019-11-28T11:48:47.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc7449ca700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc74007b450 0x7fc74007b8f0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7fc738010720 tx=0x7fc738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc73d7fa700 1 -- 172.21.15.80:0/174346794 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc738009da0 con 0x7fc74007b450 2019-11-28T11:48:47.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc7449ca700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc74007b450 0x7fc74007b8f0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7fc738010720 tx=0x7fc738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc745c2c700 1 -- 172.21.15.80:0/174346794 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74007a090 con 0x7fc74007b450 2019-11-28T11:48:47.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc73d7fa700 1 -- 172.21.15.80:0/174346794 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc738009b10 con 0x7fc74007b450 2019-11-28T11:48:47.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.212+0000 7fc745c2c700 1 -- 172.21.15.80:0/174346794 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74007a090 con 0x7fc74007b450 2019-11-28T11:48:47.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.213+0000 7fc7449ca700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc74007b450 0x7fc74007b8f0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7fc738010720 tx=0x7fc738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.213+0000 7fc73d7fa700 1 -- 172.21.15.80:0/174346794 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc738009f90 con 0x7fc74007b450 2019-11-28T11:48:47.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.213+0000 7fc7449ca700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc74007b450 0x7fc74007b8f0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7fc738010720 tx=0x7fc738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.213+0000 7fc73d7fa700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc724018770 0x7fc72401ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:47.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.213+0000 7fc73d7fa700 1 -- 172.21.15.80:0/174346794 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc738031da0 con 0x7fc74007b450 2019-11-28T11:48:47.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.213+0000 7fc73ffff700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc724018770 0x7fc72401ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:47.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.213+0000 7fc73ffff700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc724018770 0x7fc72401ac00 crc :-1 s=READY pgs=808 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:47.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.220+0000 7fc745c2c700 1 -- 172.21.15.80:0/174346794 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74007a090 con 0x7fc74007b450 2019-11-28T11:48:47.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.224+0000 7fc7449ca700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc74007b450 0x7fc74007b8f0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7fc738010720 tx=0x7fc738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.224+0000 7fc73d7fa700 1 -- 172.21.15.80:0/174346794 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc738009900 con 0x7fc74007b450 2019-11-28T11:48:47.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.390+0000 7fc745c2c700 1 -- 172.21.15.80:0/174346794 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fc74007a090 con 0x7fc74007b450 2019-11-28T11:48:47.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.390+0000 7fc7449ca700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc74007b450 0x7fc74007b8f0 secure :-1 s=THROTTLE_DONE pgs=1172 cs=0 l=1 rx=0x7fc738010720 tx=0x7fc738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.390+0000 7fc73d7fa700 1 -- 172.21.15.80:0/174346794 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v152) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc738009f90 con 0x7fc74007b450 2019-11-28T11:48:47.436 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:48:47.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.392+0000 7fc745c2c700 1 -- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc724018770 msgr2=0x7fc72401ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.392+0000 7fc745c2c700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc724018770 0x7fc72401ac00 crc :-1 s=READY pgs=808 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.392+0000 7fc745c2c700 1 -- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc74007b450 msgr2=0x7fc74007b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.392+0000 7fc745c2c700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc74007b450 0x7fc74007b8f0 secure :-1 s=READY pgs=1172 cs=0 l=1 rx=0x7fc738010720 tx=0x7fc738010ac0).stop 2019-11-28T11:48:47.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.393+0000 7fc745c2c700 1 -- 172.21.15.80:0/174346794 shutdown_connections 2019-11-28T11:48:47.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.393+0000 7fc745c2c700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc724018770 0x7fc72401ac00 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.393+0000 7fc745c2c700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc74007b450 0x7fc74007b8f0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.393+0000 7fc745c2c700 1 --2- 172.21.15.80:0/174346794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc740128430 0x7fc74007c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.393+0000 7fc745c2c700 1 -- 172.21.15.80:0/174346794 shutdown_connections 2019-11-28T11:48:47.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.393+0000 7fc745c2c700 1 -- 172.21.15.80:0/174346794 wait complete. 2019-11-28T11:48:47.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.393+0000 7fc745c2c700 1 -- 172.21.15.80:0/174346794 >> 172.21.15.80:0/174346794 conn(0x7fc740166440 msgr2=0x7fc7401494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:47.448 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:48:47.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.525+0000 7fa4c0088700 1 Processor -- start 2019-11-28T11:48:47.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.525+0000 7fa4c0088700 1 -- start start 2019-11-28T11:48:47.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.526+0000 7fa4c0088700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa4b815ed10 0x7fa4b815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:47.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.526+0000 7fa4c0088700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4b80734b0 0x7fa4b80726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:47.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.526+0000 7fa4c0088700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b806db60 con 0x7fa4b8073020 2019-11-28T11:48:47.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.526+0000 7fa4c0088700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b806fe00 con 0x7fa4b80734b0 2019-11-28T11:48:47.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.526+0000 7fa4c0088700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b80700d0 con 0x7fa4b815ed10 2019-11-28T11:48:47.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.526+0000 7fa4bee26700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4b80734b0 0x7fa4b80726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:47.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4bee26700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4b80734b0 0x7fa4b80726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41718/0 (socket says 172.21.15.80:41718) 2019-11-28T11:48:47.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4bee26700 1 -- 172.21.15.80:0/3655240571 learned_addr learned my addr 172.21.15.80:0/3655240571 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:47.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4be625700 1 --2- 172.21.15.80:0/3655240571 >> v2:172.21.15.174:3300/0 conn(0x7fa4b815ed10 0x7fa4b815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:47.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4bee26700 1 -- 172.21.15.80:0/3655240571 >> v2:172.21.15.174:3300/0 conn(0x7fa4b815ed10 msgr2=0x7fa4b815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:47.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4bee26700 1 --2- 172.21.15.80:0/3655240571 >> v2:172.21.15.174:3300/0 conn(0x7fa4b815ed10 0x7fa4b815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:47.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4bee26700 1 -- 172.21.15.80:0/3655240571 >> v1:172.21.15.174:6789/0 conn(0x7fa4b8073020 legacy=0x7fa4b8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4bee26700 1 -- 172.21.15.80:0/3655240571 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8070760 con 0x7fa4b80734b0 2019-11-28T11:48:47.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4bee26700 1 --2- 172.21.15.80:0/3655240571 >> v2:172.21.15.80:3300/0 conn(0x7fa4b80734b0 0x7fa4b80726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa4b000f6b0 tx=0x7fa4b000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4bee26700 1 --2- 172.21.15.80:0/3655240571 >> v2:172.21.15.80:3300/0 conn(0x7fa4b80734b0 0x7fa4b80726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa4b000f6b0 tx=0x7fa4b000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4bee26700 1 --2- 172.21.15.80:0/3655240571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4b80734b0 0x7fa4b80726a0 secure :-1 s=READY pgs=1995 cs=0 l=1 rx=0x7fa4b000f6b0 tx=0x7fa4b000fa50).ready entity=mon.0 client_cookie=577e0bb7ca6feb88 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:47.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4bee26700 1 --2- 172.21.15.80:0/3655240571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4b80734b0 0x7fa4b80726a0 secure :-1 s=THROTTLE_DONE pgs=1995 cs=0 l=1 rx=0x7fa4b000f6b0 tx=0x7fa4b000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4bee26700 1 --2- 172.21.15.80:0/3655240571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4b80734b0 0x7fa4b80726a0 secure :-1 s=THROTTLE_DONE pgs=1995 cs=0 l=1 rx=0x7fa4b000f6b0 tx=0x7fa4b000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4bd623700 1 -- 172.21.15.80:0/3655240571 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4b0000a70 con 0x7fa4b80734b0 2019-11-28T11:48:47.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4bee26700 1 --2- 172.21.15.80:0/3655240571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4b80734b0 0x7fa4b80726a0 secure :-1 s=THROTTLE_DONE pgs=1995 cs=0 l=1 rx=0x7fa4b000f6b0 tx=0x7fa4b000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4bd623700 1 -- 172.21.15.80:0/3655240571 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b00010e0 con 0x7fa4b80734b0 2019-11-28T11:48:47.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4bd623700 1 -- 172.21.15.80:0/3655240571 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4b00017b0 con 0x7fa4b80734b0 2019-11-28T11:48:47.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4c0088700 1 -- 172.21.15.80:0/3655240571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4b80734b0 msgr2=0x7fa4b80726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.527+0000 7fa4c0088700 1 --2- 172.21.15.80:0/3655240571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4b80734b0 0x7fa4b80726a0 secure :-1 s=READY pgs=1995 cs=0 l=1 rx=0x7fa4b000f6b0 tx=0x7fa4b000fa50).stop 2019-11-28T11:48:47.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.528+0000 7fa4c0088700 1 -- 172.21.15.80:0/3655240571 shutdown_connections 2019-11-28T11:48:47.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.528+0000 7fa4c0088700 1 --2- 172.21.15.80:0/3655240571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4b80734b0 0x7fa4b80726a0 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.528+0000 7fa4c0088700 1 --2- 172.21.15.80:0/3655240571 >> v2:172.21.15.174:3300/0 conn(0x7fa4b815ed10 0x7fa4b815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:47.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.528+0000 7fa4c0088700 1 -- 172.21.15.80:0/3655240571 shutdown_connections 2019-11-28T11:48:47.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.528+0000 7fa4c0088700 1 -- 172.21.15.80:0/3655240571 wait complete. 2019-11-28T11:48:47.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.528+0000 7fa4c0088700 1 -- 172.21.15.80:0/3655240571 >> 172.21.15.80:0/3655240571 conn(0x7fa4b8061d20 msgr2=0x7fa4b80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:47.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.530+0000 7fa4c0088700 1 Processor -- start 2019-11-28T11:48:47.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.531+0000 7fa4c0088700 1 -- start start 2019-11-28T11:48:47.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.531+0000 7fa4c0088700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4b810e970 0x7fa4b81087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:47.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.531+0000 7fa4c0088700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa4b8107e30 0x7fa4b8167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:47.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.531+0000 7fa4c0088700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b810c250 con 0x7fa4b8108cf0 2019-11-28T11:48:47.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.531+0000 7fa4c0088700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b810da00 con 0x7fa4b8107e30 2019-11-28T11:48:47.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.531+0000 7fa4c0088700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b810e430 con 0x7fa4b810e970 2019-11-28T11:48:47.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4bee26700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa4b8107e30 0x7fa4b8167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:47.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4bee26700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa4b8107e30 0x7fa4b8167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:56610/0 (socket says 172.21.15.80:56610) 2019-11-28T11:48:47.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4bee26700 1 -- 172.21.15.80:0/84081899 learned_addr learned my addr 172.21.15.80:0/84081899 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:47.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4be625700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4b810e970 0x7fa4b81087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:47.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4bde24700 1 --1- 172.21.15.80:0/84081899 >> v1:172.21.15.174:6789/0 conn(0x7fa4b8108cf0 0x7fa4b8107630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:56582/0 (socket says 172.21.15.80:56582) 2019-11-28T11:48:47.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4be625700 1 -- 172.21.15.80:0/84081899 >> v2:172.21.15.174:3300/0 conn(0x7fa4b8107e30 msgr2=0x7fa4b8167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4be625700 1 --2- 172.21.15.80:0/84081899 >> v2:172.21.15.174:3300/0 conn(0x7fa4b8107e30 0x7fa4b8167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4be625700 1 -- 172.21.15.80:0/84081899 >> v1:172.21.15.174:6789/0 conn(0x7fa4b8108cf0 legacy=0x7fa4b8107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4be625700 1 -- 172.21.15.80:0/84081899 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8105ef0 con 0x7fa4b810e970 2019-11-28T11:48:47.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4b6ffd700 1 -- 172.21.15.80:0/84081899 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003349866 0 0) 0x7fa4a0001400 con 0x7fa4b8108cf0 2019-11-28T11:48:47.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4bee26700 1 --2- 172.21.15.80:0/84081899 >> v2:172.21.15.174:3300/0 conn(0x7fa4b8107e30 0x7fa4b8167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:48:47.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4be625700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4b810e970 0x7fa4b81087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4a80103b0 tx=0x7fa4a8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4be625700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4b810e970 0x7fa4b81087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4a80103b0 tx=0x7fa4a8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4be625700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4b810e970 0x7fa4b81087b0 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7fa4a80103b0 tx=0x7fa4a8010750).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4be625700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4b810e970 0x7fa4b81087b0 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fa4a80103b0 tx=0x7fa4a8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4b6ffd700 1 -- 172.21.15.80:0/84081899 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a8000940 con 0x7fa4b810e970 2019-11-28T11:48:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4be625700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4b810e970 0x7fa4b81087b0 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fa4a80103b0 tx=0x7fa4a8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4b6ffd700 1 -- 172.21.15.80:0/84081899 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a8005580 con 0x7fa4b810e970 2019-11-28T11:48:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4be625700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4b810e970 0x7fa4b81087b0 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fa4a80103b0 tx=0x7fa4a8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4c0088700 1 -- 172.21.15.80:0/84081899 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b8106270 con 0x7fa4b810e970 2019-11-28T11:48:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.532+0000 7fa4b6ffd700 1 -- 172.21.15.80:0/84081899 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a8005770 con 0x7fa4b810e970 2019-11-28T11:48:47.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.533+0000 7fa4c0088700 1 -- 172.21.15.80:0/84081899 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b8105ef0 con 0x7fa4b810e970 2019-11-28T11:48:47.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.533+0000 7fa4be625700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4b810e970 0x7fa4b81087b0 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fa4a80103b0 tx=0x7fa4a8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.533+0000 7fa4b6ffd700 1 -- 172.21.15.80:0/84081899 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa4a8005770 con 0x7fa4b810e970 2019-11-28T11:48:47.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.533+0000 7fa4be625700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4b810e970 0x7fa4b81087b0 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fa4a80103b0 tx=0x7fa4a8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.533+0000 7fa4b6ffd700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa49c018730 0x7fa49c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:47.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.533+0000 7fa4b6ffd700 1 -- 172.21.15.80:0/84081899 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa4a80319e0 con 0x7fa4b810e970 2019-11-28T11:48:47.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.533+0000 7fa4bde24700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa49c018730 0x7fa49c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:47.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.534+0000 7fa4bde24700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa49c018730 0x7fa49c01abc0 crc :-1 s=READY pgs=809 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:47.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.541+0000 7fa4c0088700 1 -- 172.21.15.80:0/84081899 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b8106270 con 0x7fa4b810e970 2019-11-28T11:48:47.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.545+0000 7fa4be625700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4b810e970 0x7fa4b81087b0 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fa4a80103b0 tx=0x7fa4a8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.545+0000 7fa4b6ffd700 1 -- 172.21.15.80:0/84081899 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa4a8005180 con 0x7fa4b810e970 2019-11-28T11:48:47.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.712+0000 7fa4c0088700 1 -- 172.21.15.80:0/84081899 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fa4b8105ef0 con 0x7fa4b810e970 2019-11-28T11:48:47.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.713+0000 7fa4be625700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4b810e970 0x7fa4b81087b0 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7fa4a80103b0 tx=0x7fa4a8010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.713+0000 7fa4b6ffd700 1 -- 172.21.15.80:0/84081899 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v152) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa4a8005770 con 0x7fa4b810e970 2019-11-28T11:48:47.758 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:48:47.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.715+0000 7fa4c0088700 1 -- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa49c018730 msgr2=0x7fa49c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.715+0000 7fa4c0088700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa49c018730 0x7fa49c01abc0 crc :-1 s=READY pgs=809 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.715+0000 7fa4c0088700 1 -- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4b810e970 msgr2=0x7fa4b81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.715+0000 7fa4c0088700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4b810e970 0x7fa4b81087b0 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7fa4a80103b0 tx=0x7fa4a8010750).stop 2019-11-28T11:48:47.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.715+0000 7fa4c0088700 1 -- 172.21.15.80:0/84081899 shutdown_connections 2019-11-28T11:48:47.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.715+0000 7fa4c0088700 1 --2- 172.21.15.80:0/84081899 >> v2:172.21.15.174:3300/0 conn(0x7fa4b8107e30 0x7fa4b8167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.715+0000 7fa4c0088700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa49c018730 0x7fa49c01abc0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.715+0000 7fa4c0088700 1 --2- 172.21.15.80:0/84081899 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4b810e970 0x7fa4b81087b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.715+0000 7fa4c0088700 1 -- 172.21.15.80:0/84081899 shutdown_connections 2019-11-28T11:48:47.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.715+0000 7fa4c0088700 1 -- 172.21.15.80:0/84081899 wait complete. 2019-11-28T11:48:47.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.715+0000 7fa4c0088700 1 -- 172.21.15.80:0/84081899 >> 172.21.15.80:0/84081899 conn(0x7fa4b815e2d0 msgr2=0x7fa4b8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:47.770 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:48:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.848+0000 7f51fede8700 1 Processor -- start 2019-11-28T11:48:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.848+0000 7f51fede8700 1 -- start start 2019-11-28T11:48:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.849+0000 7f51fede8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f51f815ed10 0x7f51f815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.849+0000 7f51fede8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f80734b0 0x7f51f80726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.849+0000 7f51fede8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f806db60 con 0x7f51f8073020 2019-11-28T11:48:47.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.849+0000 7f51fede8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f806fe00 con 0x7f51f815ed10 2019-11-28T11:48:47.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.849+0000 7f51fede8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f80700d0 con 0x7f51f80734b0 2019-11-28T11:48:47.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.849+0000 7f51fd385700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f51f815ed10 0x7f51f815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:47.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.849+0000 7f51fd385700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f51f815ed10 0x7f51f815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41730/0 (socket says 172.21.15.80:41730) 2019-11-28T11:48:47.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.849+0000 7f51fd385700 1 -- 172.21.15.80:0/458834743 learned_addr learned my addr 172.21.15.80:0/458834743 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:47.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.849+0000 7f51fdb86700 1 --2- 172.21.15.80:0/458834743 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f80734b0 0x7f51f80726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:47.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.849+0000 7f51fd385700 1 -- 172.21.15.80:0/458834743 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f80734b0 msgr2=0x7f51f80726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:48:47.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.849+0000 7f51fd385700 1 --2- 172.21.15.80:0/458834743 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f80734b0 0x7f51f80726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:47.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.849+0000 7f51fd385700 1 -- 172.21.15.80:0/458834743 >> v1:172.21.15.174:6789/0 conn(0x7f51f8073020 legacy=0x7f51f8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.850+0000 7f51fd385700 1 -- 172.21.15.80:0/458834743 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f8070760 con 0x7f51f815ed10 2019-11-28T11:48:47.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.850+0000 7f51fd385700 1 --2- 172.21.15.80:0/458834743 >> v2:172.21.15.80:3300/0 conn(0x7f51f815ed10 0x7f51f815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f51ec00fa40 tx=0x7f51ec00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.850+0000 7f51fd385700 1 --2- 172.21.15.80:0/458834743 >> v2:172.21.15.80:3300/0 conn(0x7f51f815ed10 0x7f51f815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f51ec00fa40 tx=0x7f51ec00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.850+0000 7f51fd385700 1 --2- 172.21.15.80:0/458834743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f815ed10 0x7f51f815f100 secure :-1 s=READY pgs=1996 cs=0 l=1 rx=0x7f51ec00fa40 tx=0x7f51ec00fde0).ready entity=mon.0 client_cookie=e70cfd8cef8430e5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:47.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.850+0000 7f51fd385700 1 --2- 172.21.15.80:0/458834743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f815ed10 0x7f51f815f100 secure :-1 s=THROTTLE_DONE pgs=1996 cs=0 l=1 rx=0x7f51ec00fa40 tx=0x7f51ec00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.850+0000 7f51fd385700 1 --2- 172.21.15.80:0/458834743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f815ed10 0x7f51f815f100 secure :-1 s=THROTTLE_DONE pgs=1996 cs=0 l=1 rx=0x7f51ec00fa40 tx=0x7f51ec00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.850+0000 7f51ebfff700 1 -- 172.21.15.80:0/458834743 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51ec000ce0 con 0x7f51f815ed10 2019-11-28T11:48:47.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.850+0000 7f51fd385700 1 --2- 172.21.15.80:0/458834743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f815ed10 0x7f51f815f100 secure :-1 s=THROTTLE_DONE pgs=1996 cs=0 l=1 rx=0x7f51ec00fa40 tx=0x7f51ec00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.850+0000 7f51ebfff700 1 -- 172.21.15.80:0/458834743 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec001010 con 0x7f51f815ed10 2019-11-28T11:48:47.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.850+0000 7f51ebfff700 1 -- 172.21.15.80:0/458834743 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51ec001720 con 0x7f51f815ed10 2019-11-28T11:48:47.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.850+0000 7f51fede8700 1 -- 172.21.15.80:0/458834743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f815ed10 msgr2=0x7f51f815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.850+0000 7f51fede8700 1 --2- 172.21.15.80:0/458834743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f815ed10 0x7f51f815f100 secure :-1 s=READY pgs=1996 cs=0 l=1 rx=0x7f51ec00fa40 tx=0x7f51ec00fde0).stop 2019-11-28T11:48:47.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.851+0000 7f51fede8700 1 -- 172.21.15.80:0/458834743 shutdown_connections 2019-11-28T11:48:47.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.851+0000 7f51fede8700 1 --2- 172.21.15.80:0/458834743 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f80734b0 0x7f51f80726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:48:47.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.851+0000 7f51fede8700 1 --2- 172.21.15.80:0/458834743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51f815ed10 0x7f51f815f100 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.851+0000 7f51fede8700 1 -- 172.21.15.80:0/458834743 shutdown_connections 2019-11-28T11:48:47.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.851+0000 7f51fede8700 1 -- 172.21.15.80:0/458834743 wait complete. 2019-11-28T11:48:47.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.851+0000 7f51fede8700 1 -- 172.21.15.80:0/458834743 >> 172.21.15.80:0/458834743 conn(0x7f51f8061d20 msgr2=0x7f51f80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:47.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.853+0000 7f51fede8700 1 Processor -- start 2019-11-28T11:48:47.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.853+0000 7f51fede8700 1 -- start start 2019-11-28T11:48:47.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.854+0000 7f51fede8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f51f810ed60 0x7f51f810f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:47.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.854+0000 7f51fede8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f810f730 0x7f51f8167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:47.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.854+0000 7f51fede8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f810c250 con 0x7f51f810e970 2019-11-28T11:48:47.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.854+0000 7f51fede8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f810e430 con 0x7f51f810ed60 2019-11-28T11:48:47.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.854+0000 7f51fede8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f8105860 con 0x7f51f810f730 2019-11-28T11:48:47.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.854+0000 7f51fd385700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f51f810e970 0x7f51f81087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41052/0 (socket says 172.21.15.80:41052) 2019-11-28T11:48:47.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.854+0000 7f51fd385700 1 -- 172.21.15.80:0/2186873582 learned_addr learned my addr 172.21.15.80:0/2186873582 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:47.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.854+0000 7f51fdb86700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f810f730 0x7f51f8167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:47.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.854+0000 7f51fcb84700 1 --2- 172.21.15.80:0/2186873582 >> v2:172.21.15.174:3300/0 conn(0x7f51f810ed60 0x7f51f810f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:47.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.854+0000 7f51e9ffb700 1 -- 172.21.15.80:0/2186873582 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576917368 0 0) 0x7f51ec008120 con 0x7f51f810e970 2019-11-28T11:48:47.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.854+0000 7f51e9ffb700 1 -- 172.21.15.80:0/2186873582 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d8002e80 con 0x7f51f810e970 2019-11-28T11:48:47.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51fdb86700 1 -- 172.21.15.80:0/2186873582 >> v2:172.21.15.174:3300/0 conn(0x7f51f810ed60 msgr2=0x7f51f810f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51fdb86700 1 --2- 172.21.15.80:0/2186873582 >> v2:172.21.15.174:3300/0 conn(0x7f51f810ed60 0x7f51f810f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:47.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51fdb86700 1 -- 172.21.15.80:0/2186873582 >> v1:172.21.15.80:6789/0 conn(0x7f51f810e970 legacy=0x7f51f81087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:47.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51e9ffb700 1 -- 172.21.15.80:0/2186873582 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4034626733 0 0) 0x7f51ec008120 con 0x7f51f810e970 2019-11-28T11:48:47.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51fdb86700 1 -- 172.21.15.80:0/2186873582 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f8105ef0 con 0x7f51f810f730 2019-11-28T11:48:47.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51fdb86700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f810f730 0x7f51f8167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51f0010390 tx=0x7f51f000adb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51fdb86700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f810f730 0x7f51f8167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51f0010390 tx=0x7f51f000adb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51fdb86700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f810f730 0x7f51f8167d70 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7f51f0010390 tx=0x7f51f000adb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:47.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51fdb86700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f810f730 0x7f51f8167d70 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f51f0010390 tx=0x7f51f000adb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51e9ffb700 1 -- 172.21.15.80:0/2186873582 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51f0000b10 con 0x7f51f810f730 2019-11-28T11:48:47.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51fdb86700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f810f730 0x7f51f8167d70 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f51f0010390 tx=0x7f51f000adb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51e9ffb700 1 -- 172.21.15.80:0/2186873582 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f000ef80 con 0x7f51f810f730 2019-11-28T11:48:47.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51fdb86700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f810f730 0x7f51f8167d70 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f51f0010390 tx=0x7f51f000adb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51fede8700 1 -- 172.21.15.80:0/2186873582 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f8106270 con 0x7f51f810f730 2019-11-28T11:48:47.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51e9ffb700 1 -- 172.21.15.80:0/2186873582 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51f000f170 con 0x7f51f810f730 2019-11-28T11:48:47.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51fede8700 1 -- 172.21.15.80:0/2186873582 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f8105ef0 con 0x7f51f810f730 2019-11-28T11:48:47.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.855+0000 7f51fdb86700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f810f730 0x7f51f8167d70 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f51f0010390 tx=0x7f51f000adb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.856+0000 7f51e9ffb700 1 -- 172.21.15.80:0/2186873582 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f51f000eb80 con 0x7f51f810f730 2019-11-28T11:48:47.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.856+0000 7f51fdb86700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f810f730 0x7f51f8167d70 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f51f0010390 tx=0x7f51f000adb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.856+0000 7f51e9ffb700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f51d8018780 0x7f51d801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:47.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.856+0000 7f51e9ffb700 1 -- 172.21.15.80:0/2186873582 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f51f00319e0 con 0x7f51f810f730 2019-11-28T11:48:47.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.856+0000 7f51fd385700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f51d8018780 0x7f51d801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:47.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.856+0000 7f51fd385700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f51d8018780 0x7f51d801abf0 crc :-1 s=READY pgs=810 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:47.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.863+0000 7f51fede8700 1 -- 172.21.15.80:0/2186873582 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f8106270 con 0x7f51f810f730 2019-11-28T11:48:47.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.867+0000 7f51fdb86700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f810f730 0x7f51f8167d70 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f51f0010390 tx=0x7f51f000adb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:47.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:47.868+0000 7f51e9ffb700 1 -- 172.21.15.80:0/2186873582 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f51f0000ad0 con 0x7f51f810f730 2019-11-28T11:48:48.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.031+0000 7f51fede8700 1 -- 172.21.15.80:0/2186873582 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f51f8105ef0 con 0x7f51f810f730 2019-11-28T11:48:48.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.032+0000 7f51fdb86700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f810f730 0x7f51f8167d70 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f51f0010390 tx=0x7f51f000adb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:48.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.032+0000 7f51e9ffb700 1 -- 172.21.15.80:0/2186873582 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v152) v1 ==== 100+0+10 (secure 0 0 0) 0x7f51f0000ad0 con 0x7f51f810f730 2019-11-28T11:48:48.078 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:48:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.034+0000 7f51fede8700 1 -- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f51d8018780 msgr2=0x7f51d801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.034+0000 7f51fede8700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f51d8018780 0x7f51d801abf0 crc :-1 s=READY pgs=810 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.034+0000 7f51fede8700 1 -- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f810f730 msgr2=0x7f51f8167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.034+0000 7f51fede8700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f810f730 0x7f51f8167d70 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7f51f0010390 tx=0x7f51f000adb0).stop 2019-11-28T11:48:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.034+0000 7f51fede8700 1 -- 172.21.15.80:0/2186873582 shutdown_connections 2019-11-28T11:48:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.034+0000 7f51fede8700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f51d8018780 0x7f51d801abf0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.034+0000 7f51fede8700 1 --2- 172.21.15.80:0/2186873582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51f810f730 0x7f51f8167d70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.034+0000 7f51fede8700 1 --2- 172.21.15.80:0/2186873582 >> v2:172.21.15.174:3300/0 conn(0x7f51f810ed60 0x7f51f810f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.034+0000 7f51fede8700 1 -- 172.21.15.80:0/2186873582 shutdown_connections 2019-11-28T11:48:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.034+0000 7f51fede8700 1 -- 172.21.15.80:0/2186873582 wait complete. 2019-11-28T11:48:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.034+0000 7f51fede8700 1 -- 172.21.15.80:0/2186873582 >> 172.21.15.80:0/2186873582 conn(0x7f51f815e2d0 msgr2=0x7f51f8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:48.090 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:48:48.090 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:48:48.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.163+0000 7ff8031dd700 1 Processor -- start 2019-11-28T11:48:48.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.163+0000 7ff8031dd700 1 -- start start 2019-11-28T11:48:48.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.164+0000 7ff8031dd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7fc06c0a0 0x7ff7fc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:48:48.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.164+0000 7ff8031dd700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7fc06db00 con 0x7ff7fc072620 2019-11-28T11:48:48.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.164+0000 7ff8031dd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7fc06e000 con 0x7ff7fc0734e0 2019-11-28T11:48:48.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.164+0000 7ff8031dd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc06f330 con 0x7ff7fc06c0a0 2019-11-28T11:48:48.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.164+0000 7ff801f7b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff7fc072620 0x7ff7fc164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41062/0 (socket says 172.21.15.80:41062) 2019-11-28T11:48:48.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.164+0000 7ff801f7b700 1 -- 172.21.15.80:0/2892447296 learned_addr learned my addr 172.21.15.80:0/2892447296 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:48:48.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff80177a700 1 --2- 172.21.15.80:0/2892447296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7fc06c0a0 0x7ff7fc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:48.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff7fbfff700 1 -- 172.21.15.80:0/2892447296 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547879017 0 0) 0x7ff7f4001150 con 0x7ff7fc072620 2019-11-28T11:48:48.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff7fbfff700 1 -- 172.21.15.80:0/2892447296 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7e8002e80 con 0x7ff7fc072620 2019-11-28T11:48:48.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff7fbfff700 1 -- 172.21.15.80:0/2892447296 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344792498 0 0) 0x7ff7e40013b0 con 0x7ff7fc0734e0 2019-11-28T11:48:48.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff7fbfff700 1 -- 172.21.15.80:0/2892447296 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7e80030b0 con 0x7ff7fc0734e0 2019-11-28T11:48:48.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff7fbfff700 1 -- 172.21.15.80:0/2892447296 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4066814079 0 0) 0x7ff7f4001130 con 0x7ff7fc072620 2019-11-28T11:48:48.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff80177a700 1 -- 172.21.15.80:0/2892447296 >> v1:172.21.15.174:6789/0 conn(0x7ff7fc0734e0 legacy=0x7ff7fc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:48.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff80177a700 1 -- 172.21.15.80:0/2892447296 >> v1:172.21.15.80:6789/0 conn(0x7ff7fc072620 legacy=0x7ff7fc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:48.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff80177a700 1 -- 172.21.15.80:0/2892447296 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc0706c0 con 0x7ff7fc06c0a0 2019-11-28T11:48:48.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff80177a700 1 --2- 172.21.15.80:0/2892447296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7fc06c0a0 0x7ff7fc072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff7ec00af50 tx=0x7ff7ec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:48.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff80177a700 1 --2- 172.21.15.80:0/2892447296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7fc06c0a0 0x7ff7fc072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff7ec00af50 tx=0x7ff7ec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff80177a700 1 --2- 172.21.15.80:0/2892447296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7fc06c0a0 0x7ff7fc072fa0 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7ff7ec00af50 tx=0x7ff7ec00b760).ready entity=mon.2 client_cookie=fea1c128e09da82d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff80177a700 1 --2- 172.21.15.80:0/2892447296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7fc06c0a0 0x7ff7fc072fa0 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7ff7ec00af50 tx=0x7ff7ec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff7fbfff700 1 -- 172.21.15.80:0/2892447296 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7ec000960 con 0x7ff7fc06c0a0 2019-11-28T11:48:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff80177a700 1 --2- 172.21.15.80:0/2892447296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7fc06c0a0 0x7ff7fc072fa0 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7ff7ec00af50 tx=0x7ff7ec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff7fbfff700 1 -- 172.21.15.80:0/2892447296 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec009860 con 0x7ff7fc06c0a0 2019-11-28T11:48:48.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff80177a700 1 --2- 172.21.15.80:0/2892447296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7fc06c0a0 0x7ff7fc072fa0 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7ff7ec00af50 tx=0x7ff7ec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff8031dd700 1 -- 172.21.15.80:0/2892447296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7fc06c0a0 msgr2=0x7ff7fc072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff7fbfff700 1 -- 172.21.15.80:0/2892447296 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7ec007210 con 0x7ff7fc06c0a0 2019-11-28T11:48:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.165+0000 7ff8031dd700 1 --2- 172.21.15.80:0/2892447296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7fc06c0a0 0x7ff7fc072fa0 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7ff7ec00af50 tx=0x7ff7ec00b760).stop 2019-11-28T11:48:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.166+0000 7ff8031dd700 1 -- 172.21.15.80:0/2892447296 shutdown_connections 2019-11-28T11:48:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.166+0000 7ff8031dd700 1 --2- 172.21.15.80:0/2892447296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7fc06c0a0 0x7ff7fc072fa0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.166+0000 7ff8031dd700 1 -- 172.21.15.80:0/2892447296 shutdown_connections 2019-11-28T11:48:48.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.166+0000 7ff8031dd700 1 -- 172.21.15.80:0/2892447296 wait complete. 2019-11-28T11:48:48.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.166+0000 7ff8031dd700 1 -- 172.21.15.80:0/2892447296 >> 172.21.15.80:0/2892447296 conn(0x7ff7fc061cf0 msgr2=0x7ff7fc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:48.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.169+0000 7ff8031dd700 1 Processor -- start 2019-11-28T11:48:48.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.169+0000 7ff8031dd700 1 -- start start 2019-11-28T11:48:48.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff8031dd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7fc13f580 0x7ff7fc114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:48.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff8031dd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff7fc114670 0x7ff7fc11e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:48.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff8031dd700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7fc13fc20 con 0x7ff7fc11eaf0 2019-11-28T11:48:48.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff8031dd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7fc1236b0 con 0x7ff7fc13f580 2019-11-28T11:48:48.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff8031dd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7fc123980 con 0x7ff7fc114670 2019-11-28T11:48:48.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff80177a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7fc13f580 0x7ff7fc114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:48.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff80177a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7fc13f580 0x7ff7fc114130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41750/0 (socket says 172.21.15.80:41750) 2019-11-28T11:48:48.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff80177a700 1 -- 172.21.15.80:0/1582685548 learned_addr learned my addr 172.21.15.80:0/1582685548 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:48:48.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff800f79700 1 --2- 172.21.15.80:0/1582685548 >> v2:172.21.15.174:3300/0 conn(0x7ff7fc114670 0x7ff7fc11e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:48.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff80177a700 1 -- 172.21.15.80:0/1582685548 >> v2:172.21.15.174:3300/0 conn(0x7ff7fc114670 msgr2=0x7ff7fc11e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:48.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff80177a700 1 --2- 172.21.15.80:0/1582685548 >> v2:172.21.15.174:3300/0 conn(0x7ff7fc114670 0x7ff7fc11e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:48.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff80177a700 1 -- 172.21.15.80:0/1582685548 >> v1:172.21.15.80:6789/0 conn(0x7ff7fc11eaf0 legacy=0x7ff7fc112fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:48.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff7f9ffb700 1 -- 172.21.15.80:0/1582685548 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586113057 0 0) 0x7ff7f40009b0 con 0x7ff7fc11eaf0 2019-11-28T11:48:48.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff80177a700 1 -- 172.21.15.80:0/1582685548 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc124010 con 0x7ff7fc13f580 2019-11-28T11:48:48.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff80177a700 1 --2- 172.21.15.80:0/1582685548 >> v2:172.21.15.80:3300/0 conn(0x7ff7fc13f580 0x7ff7fc114130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7ec010410 tx=0x7ff7ec0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:48.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff80177a700 1 --2- 172.21.15.80:0/1582685548 >> v2:172.21.15.80:3300/0 conn(0x7ff7fc13f580 0x7ff7fc114130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7ec010410 tx=0x7ff7ec0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:48.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff80177a700 1 --2- 172.21.15.80:0/1582685548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7fc13f580 0x7ff7fc114130 secure :-1 s=READY pgs=2000 cs=0 l=1 rx=0x7ff7ec010410 tx=0x7ff7ec0107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff80177a700 1 --2- 172.21.15.80:0/1582685548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7fc13f580 0x7ff7fc114130 secure :-1 s=THROTTLE_DONE pgs=2000 cs=0 l=1 rx=0x7ff7ec010410 tx=0x7ff7ec0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff7f9ffb700 1 -- 172.21.15.80:0/1582685548 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7ec000940 con 0x7ff7fc13f580 2019-11-28T11:48:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff80177a700 1 --2- 172.21.15.80:0/1582685548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7fc13f580 0x7ff7fc114130 secure :-1 s=THROTTLE_DONE pgs=2000 cs=0 l=1 rx=0x7ff7ec010410 tx=0x7ff7ec0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff80177a700 1 --2- 172.21.15.80:0/1582685548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7fc13f580 0x7ff7fc114130 secure :-1 s=THROTTLE_DONE pgs=2000 cs=0 l=1 rx=0x7ff7ec010410 tx=0x7ff7ec0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:48.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff7f9ffb700 1 -- 172.21.15.80:0/1582685548 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec009980 con 0x7ff7fc13f580 2019-11-28T11:48:48.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff8031dd700 1 -- 172.21.15.80:0/1582685548 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7fc124010 con 0x7ff7fc13f580 2019-11-28T11:48:48.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff7f9ffb700 1 -- 172.21.15.80:0/1582685548 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7ec00a090 con 0x7ff7fc13f580 2019-11-28T11:48:48.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.170+0000 7ff8031dd700 1 -- 172.21.15.80:0/1582685548 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7fc124010 con 0x7ff7fc13f580 2019-11-28T11:48:48.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.171+0000 7ff80177a700 1 --2- 172.21.15.80:0/1582685548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7fc13f580 0x7ff7fc114130 secure :-1 s=THROTTLE_DONE pgs=2000 cs=0 l=1 rx=0x7ff7ec010410 tx=0x7ff7ec0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:48.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.171+0000 7ff7f9ffb700 1 -- 172.21.15.80:0/1582685548 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff7ec009580 con 0x7ff7fc13f580 2019-11-28T11:48:48.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.171+0000 7ff80177a700 1 --2- 172.21.15.80:0/1582685548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7fc13f580 0x7ff7fc114130 secure :-1 s=THROTTLE_DONE pgs=2000 cs=0 l=1 rx=0x7ff7ec010410 tx=0x7ff7ec0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:48.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.171+0000 7ff7f9ffb700 1 --2- 172.21.15.80:0/1582685548 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7e0018730 0x7ff7e001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:48:48.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.171+0000 7ff7f9ffb700 1 -- 172.21.15.80:0/1582685548 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff7ec031d50 con 0x7ff7fc13f580 2019-11-28T11:48:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.171+0000 7ff800f79700 1 --2- 172.21.15.80:0/1582685548 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7e0018730 0x7ff7e001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:48:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.171+0000 7ff800f79700 1 --2- 172.21.15.80:0/1582685548 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7e0018730 0x7ff7e001abc0 crc :-1 s=READY pgs=811 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:48:48.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.179+0000 7ff8031dd700 1 -- 172.21.15.80:0/1582685548 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7fc124010 con 0x7ff7fc13f580 2019-11-28T11:48:48.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.182+0000 7ff80177a700 1 --2- 172.21.15.80:0/1582685548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7fc13f580 0x7ff7fc114130 secure :-1 s=THROTTLE_DONE pgs=2000 cs=0 l=1 rx=0x7ff7ec010410 tx=0x7ff7ec0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:48.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.182+0000 7ff7f9ffb700 1 -- 172.21.15.80:0/1582685548 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff7ec000940 con 0x7ff7fc13f580 2019-11-28T11:48:48.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.354+0000 7ff8031dd700 1 -- 172.21.15.80:0/1582685548 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7fc124010 con 0x7ff7fc13f580 2019-11-28T11:48:48.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.354+0000 7ff80177a700 1 --2- 172.21.15.80:0/1582685548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7fc13f580 0x7ff7fc114130 secure :-1 s=THROTTLE_DONE pgs=2000 cs=0 l=1 rx=0x7ff7ec010410 tx=0x7ff7ec0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:48:48.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.354+0000 7ff7f9ffb700 1 -- 172.21.15.80:0/1582685548 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+2455 (secure 0 0 0) 0x7ff7ec009f90 con 0x7ff7fc13f580 2019-11-28T11:48:48.401 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 116 2019-11-28T11:48:48.401 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:48:48.401 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":116,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9109,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2247103324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2247103324},{"type":"v1","addr":"172.21.15.80:6834","nonce":2247103324}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":116},{"gid":9765,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3505175822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3505175822},{"type":"v1","addr":"172.21.15.80:6835","nonce":3505175822}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":116}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:48:37.109829+0000","modified":"2019-11-28T11:48:41.120965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6785":{"gid":6785,"name":"c","rank":0,"incarnation":114,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/1862798714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1862798714},{"type":"v1","addr":"172.21.15.174:6835","nonce":1862798714}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2019-11-28T11:48:48.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.357+0000 7ff8031dd700 1 -- 172.21.15.80:0/1582685548 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7e0018730 msgr2=0x7ff7e001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:48.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.357+0000 7ff8031dd700 1 --2- 172.21.15.80:0/1582685548 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7e0018730 0x7ff7e001abc0 crc :-1 s=READY pgs=811 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:48.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.357+0000 7ff8031dd700 1 -- 172.21.15.80:0/1582685548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7fc13f580 msgr2=0x7ff7fc114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:48:48.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.357+0000 7ff8031dd700 1 --2- 172.21.15.80:0/1582685548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7fc13f580 0x7ff7fc114130 secure :-1 s=READY pgs=2000 cs=0 l=1 rx=0x7ff7ec010410 tx=0x7ff7ec0107b0).stop 2019-11-28T11:48:48.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.357+0000 7ff8031dd700 1 -- 172.21.15.80:0/1582685548 shutdown_connections 2019-11-28T11:48:48.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.357+0000 7ff8031dd700 1 --2- 172.21.15.80:0/1582685548 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7e0018730 0x7ff7e001abc0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:48.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.357+0000 7ff8031dd700 1 --2- 172.21.15.80:0/1582685548 >> v2:172.21.15.174:3300/0 conn(0x7ff7fc114670 0x7ff7fc11e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:48.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.357+0000 7ff8031dd700 1 --2- 172.21.15.80:0/1582685548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7fc13f580 0x7ff7fc114130 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:48:48.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.357+0000 7ff8031dd700 1 -- 172.21.15.80:0/1582685548 shutdown_connections 2019-11-28T11:48:48.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.357+0000 7ff8031dd700 1 -- 172.21.15.80:0/1582685548 wait complete. 2019-11-28T11:48:48.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:48:48.357+0000 7ff8031dd700 1 -- 172.21.15.80:0/1582685548 >> 172.21.15.80:0/1582685548 conn(0x7ff7fc1426c0 msgr2=0x7ff7fc110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:48:48.719 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6785}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 24, u'failed': [], u'epoch': 115, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [25], u'info': {u'gid_6785': {u'export_targets': [], u'name': u'c', u'incarnation': 114, u'state_seq': 2, u'state': u'up:active', u'gid': 6785, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1862798714, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 1862798714, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/1862798714'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:48:37.109829+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:48:41.120965+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:48:48.719 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:48:48.719 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:48:48.869 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:48:48.869 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:48:48.869 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:48:48.870 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 6785, 2019-11-28T11:48:48.870 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:48:48.870 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:48:48.870 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 8.7024134760000003, 2019-11-28T11:48:48.870 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 115, 2019-11-28T11:48:48.870 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 152, 2019-11-28T11:48:48.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 152, 2019-11-28T11:48:48.871 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 9.2314733310000001 2019-11-28T11:48:48.871 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:48:48.876 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 6785, "want_state": "up:active", "state": "up:active", "rank_uptime": 8.7024134760000003, "mdsmap_epoch": 115, "osdmap_epoch": 152, "osdmap_epoch_barrier": 152, "uptime": 9.2314733310000001 } 2019-11-28T11:48:48.877 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:48:48.877 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:48:48.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:48:48.877 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:48:48.954 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:48:48.954 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf,recover_session=clean 2019-11-28T11:48:49.044 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-11-28T11:48:49.074 INFO:teuthology.orchestra.run.smithi076.stderr:mount error 22 = Invalid argument 2019-11-28T11:48:49.074 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf,recover_session=clean 2019-11-28T11:48:49.074 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:48:49.075 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "recover_session", passing to kernel. 2019-11-28T11:48:49.075 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf,recover_session=clean 2019-11-28T11:48:49.075 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:48:49.075 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "recover_session", passing to kernel. 2019-11-28T11:48:54.971 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:48:54.976 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:48:54.980 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:48:54.984 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:48:54.988 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:48:54.992 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:49:19.076 INFO:teuthology.misc:Re-opening connections... 2019-11-28T11:49:19.076 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:49:19.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:49:19.078 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:49:19.169 INFO:teuthology.orchestra.run.smithi076:> true 2019-11-28T11:49:19.451 DEBUG:teuthology.misc:waited 0.375240087509 2019-11-28T11:49:20.452 INFO:teuthology.orchestra.run:Running command with timeout 10 2019-11-28T11:49:20.453 INFO:teuthology.orchestra.run.smithi076:> uptime 2019-11-28T11:49:20.534 INFO:teuthology.orchestra.run.smithi076.stdout: 11:49:20 up 1 min, 0 users, load average: 0.22, 0.12, 0.05 2019-11-28T11:49:20.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:49:20.534 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:49:20.607 INFO:tasks.cephfs_test_runner:test_reconnect_after_blacklisted (tasks.cephfs.test_client_recovery.TestClientRecovery) ... skipped 'Not implemented in current kernel' 2019-11-28T11:49:20.607 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blacklisted' 2019-11-28T11:49:20.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.679+0000 7f67d3198700 1 Processor -- start 2019-11-28T11:49:20.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.679+0000 7f67d3198700 1 -- start start 2019-11-28T11:49:20.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d3198700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f67cc06c0a0 0x7f67cc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:20.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d3198700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f67cc0734e0 0x7f67cc071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:20.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d3198700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67cc06db00 con 0x7f67cc072360 2019-11-28T11:49:20.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d3198700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67cc06fd60 con 0x7f67cc0734e0 2019-11-28T11:49:20.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d3198700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67cc070030 con 0x7f67cc06c0a0 2019-11-28T11:49:20.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d0f34700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f67cc0734e0 0x7f67cc071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:20.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d1f36700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f67cc072360 0x7f67cc06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41076/0 (socket says 172.21.15.80:41076) 2019-11-28T11:49:20.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d1f36700 1 -- 172.21.15.80:0/1772196234 learned_addr learned my addr 172.21.15.80:0/1772196234 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:20.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d1735700 1 --2- 172.21.15.80:0/1772196234 >> v2:172.21.15.174:3300/0 conn(0x7f67cc06c0a0 0x7f67cc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:20.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d0f34700 1 -- 172.21.15.80:0/1772196234 >> v2:172.21.15.174:3300/0 conn(0x7f67cc06c0a0 msgr2=0x7f67cc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:20.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d0f34700 1 --2- 172.21.15.80:0/1772196234 >> v2:172.21.15.174:3300/0 conn(0x7f67cc06c0a0 0x7f67cc072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:20.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d0f34700 1 -- 172.21.15.80:0/1772196234 >> v1:172.21.15.80:6789/0 conn(0x7f67cc072360 legacy=0x7f67cc06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:20.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67cbfff700 1 -- 172.21.15.80:0/1772196234 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069237760 0 0) 0x7f67bc001150 con 0x7f67cc072360 2019-11-28T11:49:20.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d0f34700 1 -- 172.21.15.80:0/1772196234 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67cc0706c0 con 0x7f67cc0734e0 2019-11-28T11:49:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d0f34700 1 --2- 172.21.15.80:0/1772196234 >> v2:172.21.15.80:3300/0 conn(0x7f67cc0734e0 0x7f67cc071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f67c400af50 tx=0x7f67c400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d0f34700 1 --2- 172.21.15.80:0/1772196234 >> v2:172.21.15.80:3300/0 conn(0x7f67cc0734e0 0x7f67cc071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f67c400af50 tx=0x7f67c400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d0f34700 1 --2- 172.21.15.80:0/1772196234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67cc0734e0 0x7f67cc071e20 secure :-1 s=READY pgs=2002 cs=0 l=1 rx=0x7f67c400af50 tx=0x7f67c400b6e0).ready entity=mon.0 client_cookie=e9c794453493ece1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d0f34700 1 --2- 172.21.15.80:0/1772196234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67cc0734e0 0x7f67cc071e20 secure :-1 s=THROTTLE_DONE pgs=2002 cs=0 l=1 rx=0x7f67c400af50 tx=0x7f67c400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67cbfff700 1 -- 172.21.15.80:0/1772196234 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67c4007210 con 0x7f67cc0734e0 2019-11-28T11:49:20.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d0f34700 1 --2- 172.21.15.80:0/1772196234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67cc0734e0 0x7f67cc071e20 secure :-1 s=THROTTLE_DONE pgs=2002 cs=0 l=1 rx=0x7f67c400af50 tx=0x7f67c400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.680+0000 7f67d0f34700 1 --2- 172.21.15.80:0/1772196234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67cc0734e0 0x7f67cc071e20 secure :-1 s=THROTTLE_DONE pgs=2002 cs=0 l=1 rx=0x7f67c400af50 tx=0x7f67c400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.681+0000 7f67cbfff700 1 -- 172.21.15.80:0/1772196234 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c40099b0 con 0x7f67cc0734e0 2019-11-28T11:49:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.681+0000 7f67cbfff700 1 -- 172.21.15.80:0/1772196234 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67c400a080 con 0x7f67cc0734e0 2019-11-28T11:49:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.681+0000 7f67d3198700 1 -- 172.21.15.80:0/1772196234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67cc0734e0 msgr2=0x7f67cc071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.681+0000 7f67d3198700 1 --2- 172.21.15.80:0/1772196234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67cc0734e0 0x7f67cc071e20 secure :-1 s=READY pgs=2002 cs=0 l=1 rx=0x7f67c400af50 tx=0x7f67c400b6e0).stop 2019-11-28T11:49:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.681+0000 7f67d3198700 1 -- 172.21.15.80:0/1772196234 shutdown_connections 2019-11-28T11:49:20.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.681+0000 7f67d3198700 1 --2- 172.21.15.80:0/1772196234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67cc0734e0 0x7f67cc071e20 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:20.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.681+0000 7f67d3198700 1 --2- 172.21.15.80:0/1772196234 >> v2:172.21.15.174:3300/0 conn(0x7f67cc06c0a0 0x7f67cc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:20.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.681+0000 7f67d3198700 1 -- 172.21.15.80:0/1772196234 shutdown_connections 2019-11-28T11:49:20.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.681+0000 7f67d3198700 1 -- 172.21.15.80:0/1772196234 wait complete. 2019-11-28T11:49:20.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.681+0000 7f67d3198700 1 -- 172.21.15.80:0/1772196234 >> 172.21.15.80:0/1772196234 conn(0x7f67cc061cf0 msgr2=0x7f67cc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:20.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.684+0000 7f67d3198700 1 Processor -- start 2019-11-28T11:49:20.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.684+0000 7f67d3198700 1 -- start start 2019-11-28T11:49:20.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67d3198700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f67cc13e900 0x7f67cc121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:20.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67d3198700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67cc139df0 con 0x7f67cc121c90 2019-11-28T11:49:20.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67d3198700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67cc13ef30 con 0x7f67cc1211a0 2019-11-28T11:49:20.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67d3198700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67cc128920 con 0x7f67cc13e900 2019-11-28T11:49:20.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67d0f34700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f67cc121c90 0x7f67cc1209a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41082/0 (socket says 172.21.15.80:41082) 2019-11-28T11:49:20.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67d0f34700 1 -- 172.21.15.80:0/3401499433 learned_addr learned my addr 172.21.15.80:0/3401499433 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67d1735700 1 --2- 172.21.15.80:0/3401499433 >> v2:172.21.15.174:3300/0 conn(0x7f67cc13e900 0x7f67cc121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720817596 0 0) 0x7f67c400b020 con 0x7f67cc121c90 2019-11-28T11:49:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67b0002e80 con 0x7f67cc121c90 2019-11-28T11:49:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2698957814 0 0) 0x7f67c40009e0 con 0x7f67cc121c90 2019-11-28T11:49:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f67b00032e0 con 0x7f67cc121c90 2019-11-28T11:49:20.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f67c4009770 con 0x7f67cc121c90 2019-11-28T11:49:20.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 >> v2:172.21.15.174:3300/0 conn(0x7f67cc13e900 msgr2=0x7f67cc121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:20.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67c9ffb700 1 --2- 172.21.15.80:0/3401499433 >> v2:172.21.15.174:3300/0 conn(0x7f67cc13e900 0x7f67cc121750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:20.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 >> v1:172.21.15.174:6789/0 conn(0x7f67cc1211a0 legacy=0x7f67cc13a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:20.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 >> v1:172.21.15.80:6789/0 conn(0x7f67cc121c90 legacy=0x7f67cc1209a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:20.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67c9ffb700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67b00039f0 0x7f67b0005df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:20.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67c9ffb700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67b0006330 0x7f67b0008790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:20.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67c9ffb700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67b0008ff0 0x7f67b000b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:20.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b000bc70 con 0x7f67b0006330 2019-11-28T11:49:20.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b000bea0 con 0x7f67b00039f0 2019-11-28T11:49:20.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b000c0d0 con 0x7f67b0008ff0 2019-11-28T11:49:20.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.685+0000 7f67d1735700 1 --2- 172.21.15.80:0/3401499433 >> v2:172.21.15.174:3300/0 conn(0x7f67cc13e900 0x7f67cc121750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:20.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d0f34700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67b0006330 0x7f67b0008790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:20.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d1f36700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67b0008ff0 0x7f67b000b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:20.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d1735700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67b00039f0 0x7f67b0005df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:20.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d0f34700 1 -- 172.21.15.80:0/3401499433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67b0008ff0 msgr2=0x7f67b000b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:20.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d0f34700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67b0008ff0 0x7f67b000b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:20.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d0f34700 1 -- 172.21.15.80:0/3401499433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67b00039f0 msgr2=0x7f67b0005df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:20.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d0f34700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67b00039f0 0x7f67b0005df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:20.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d1f36700 1 -- 172.21.15.80:0/3401499433 reap_dead start 2019-11-28T11:49:20.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d0f34700 1 -- 172.21.15.80:0/3401499433 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b000c380 con 0x7f67b0006330 2019-11-28T11:49:20.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d3198700 1 -- 172.21.15.80:0/3401499433 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67cc129330 con 0x7f67b0006330 2019-11-28T11:49:20.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d0f34700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67b0006330 0x7f67b0008790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f67c4010400 tx=0x7f67c4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:20.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d3198700 1 -- 172.21.15.80:0/3401499433 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67cc1281b0 con 0x7f67b0006330 2019-11-28T11:49:20.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d0f34700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67b0006330 0x7f67b0008790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f67c4010400 tx=0x7f67c4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:20.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d0f34700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67b0006330 0x7f67b0008790 secure :-1 s=READY pgs=2004 cs=0 l=1 rx=0x7f67c4010400 tx=0x7f67c4010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:20.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d0f34700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67b0006330 0x7f67b0008790 secure :-1 s=THROTTLE_DONE pgs=2004 cs=0 l=1 rx=0x7f67c4010400 tx=0x7f67c4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:20.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67c4009770 con 0x7f67b0006330 2019-11-28T11:49:20.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d0f34700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67b0006330 0x7f67b0008790 secure :-1 s=THROTTLE_DONE pgs=2004 cs=0 l=1 rx=0x7f67c4010400 tx=0x7f67c4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:20.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c4009320 con 0x7f67b0006330 2019-11-28T11:49:20.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67d0f34700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67b0006330 0x7f67b0008790 secure :-1 s=THROTTLE_DONE pgs=2004 cs=0 l=1 rx=0x7f67c4010400 tx=0x7f67c4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:20.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.686+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67c4009960 con 0x7f67b0006330 2019-11-28T11:49:20.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.688+0000 7f67d0f34700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67b0006330 0x7f67b0008790 secure :-1 s=THROTTLE_DONE pgs=2004 cs=0 l=1 rx=0x7f67c4010400 tx=0x7f67c4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:20.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.688+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f67c4009580 con 0x7f67b0006330 2019-11-28T11:49:20.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.688+0000 7f67d0f34700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67b0006330 0x7f67b0008790 secure :-1 s=THROTTLE_DONE pgs=2004 cs=0 l=1 rx=0x7f67c4010400 tx=0x7f67c4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:20.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.688+0000 7f67c9ffb700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67b001b480 0x7f67b001d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:20.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.688+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f67c4031c50 con 0x7f67b0006330 2019-11-28T11:49:20.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.688+0000 7f67d1735700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67b001b480 0x7f67b001d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:20.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.688+0000 7f67d1735700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67b001b480 0x7f67b001d8b0 crc :-1 s=READY pgs=812 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:20.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.694+0000 7f67d3198700 1 -- 172.21.15.80:0/3401499433 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a4002e60 con 0x7f67b0006330 2019-11-28T11:49:20.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.698+0000 7f67d0f34700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67b0006330 0x7f67b0008790 secure :-1 s=THROTTLE_DONE pgs=2004 cs=0 l=1 rx=0x7f67c4010400 tx=0x7f67c4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:20.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.698+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f67c4000940 con 0x7f67b0006330 2019-11-28T11:49:20.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:20.871+0000 7f67d3198700 1 -- 172.21.15.80:0/3401499433 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blacklisted"]} v 0) v1 -- 0x7f67a4001d70 con 0x7f67b0006330 2019-11-28T11:49:21.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:21.374+0000 7f67d0f34700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67b0006330 0x7f67b0008790 secure :-1 s=THROTTLE_DONE pgs=2004 cs=0 l=1 rx=0x7f67c4010400 tx=0x7f67c4010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:21.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:21.374+0000 7f67c9ffb700 1 -- 172.21.15.80:0/3401499433 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blacklisted"]}]=0 v557) v1 ==== 164+0+0 (secure 0 0 0) 0x7f67c4009580 con 0x7f67b0006330 2019-11-28T11:49:21.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:21.387+0000 7f67d3198700 1 -- 172.21.15.80:0/3401499433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67b001b480 msgr2=0x7f67b001d8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:21.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:21.387+0000 7f67d3198700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67b001b480 0x7f67b001d8b0 crc :-1 s=READY pgs=812 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:21.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:21.387+0000 7f67d3198700 1 -- 172.21.15.80:0/3401499433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67b0006330 msgr2=0x7f67b0008790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:21.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:21.387+0000 7f67d3198700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67b0006330 0x7f67b0008790 secure :-1 s=READY pgs=2004 cs=0 l=1 rx=0x7f67c4010400 tx=0x7f67c4010280).stop 2019-11-28T11:49:21.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:21.387+0000 7f67d3198700 1 -- 172.21.15.80:0/3401499433 shutdown_connections 2019-11-28T11:49:21.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:21.387+0000 7f67d3198700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67b001b480 0x7f67b001d8b0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:21.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:21.387+0000 7f67d3198700 1 --2- 172.21.15.80:0/3401499433 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67b0006330 0x7f67b0008790 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:21.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:21.387+0000 7f67d3198700 1 -- 172.21.15.80:0/3401499433 shutdown_connections 2019-11-28T11:49:21.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:21.387+0000 7f67d3198700 1 -- 172.21.15.80:0/3401499433 wait complete. 2019-11-28T11:49:21.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:21.387+0000 7f67d3198700 1 -- 172.21.15.80:0/3401499433 >> 172.21.15.80:0/3401499433 conn(0x7f67cc127dc0 msgr2=0x7f67cc141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:21.445 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:49:21.445 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:49:21.515 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:49:21.582 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:49:21.650 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:49:21.708 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:49:21.771 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:49:21.834 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:49:21.834 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:49:21.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:49:21.836 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:49:21.959 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:49:21.973 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:49:22.014 INFO:tasks.cephfs_test_runner:Starting test: test_reconnect_eviction (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T11:49:22.014 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_eviction' 2019-11-28T11:49:22.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.091+0000 7fa902d1f700 1 Processor -- start 2019-11-28T11:49:22.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.091+0000 7fa902d1f700 1 -- start start 2019-11-28T11:49:22.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.092+0000 7fa902d1f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa8fc06c490 0x7fa8fc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:22.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.092+0000 7fa902d1f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8fc06db00 con 0x7fa8fc06c0a0 2019-11-28T11:49:22.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.092+0000 7fa902d1f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8fc06e000 con 0x7fa8fc06ce60 2019-11-28T11:49:22.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.092+0000 7fa902d1f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8fc06fd60 con 0x7fa8fc06c490 2019-11-28T11:49:22.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.092+0000 7fa9012bc700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa8fc06c0a0 0x7fa8fc072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41094/0 (socket says 172.21.15.80:41094) 2019-11-28T11:49:22.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.092+0000 7fa9012bc700 1 -- 172.21.15.80:0/3005487349 learned_addr learned my addr 172.21.15.80:0/3005487349 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:22.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.092+0000 7fa900abb700 1 --2- 172.21.15.80:0/3005487349 >> v2:172.21.15.174:3300/0 conn(0x7fa8fc06c490 0x7fa8fc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:22.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.092+0000 7fa8fbfff700 1 -- 172.21.15.80:0/3005487349 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697656251 0 0) 0x7fa8e40014d0 con 0x7fa8fc06c0a0 2019-11-28T11:49:22.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.092+0000 7fa8fbfff700 1 -- 172.21.15.80:0/3005487349 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e8002e80 con 0x7fa8fc06c0a0 2019-11-28T11:49:22.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 -- 172.21.15.80:0/3005487349 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175431378 0 0) 0x7fa8f4001080 con 0x7fa8fc06ce60 2019-11-28T11:49:22.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 -- 172.21.15.80:0/3005487349 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e80030b0 con 0x7fa8fc06ce60 2019-11-28T11:49:22.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 -- 172.21.15.80:0/3005487349 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2016297976 0 0) 0x7fa8e40014b0 con 0x7fa8fc06c0a0 2019-11-28T11:49:22.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 -- 172.21.15.80:0/3005487349 >> v2:172.21.15.174:3300/0 conn(0x7fa8fc06c490 msgr2=0x7fa8fc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:22.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 --2- 172.21.15.80:0/3005487349 >> v2:172.21.15.174:3300/0 conn(0x7fa8fc06c490 0x7fa8fc06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:22.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 -- 172.21.15.80:0/3005487349 >> v1:172.21.15.174:6789/0 conn(0x7fa8fc06ce60 legacy=0x7fa8fc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:22.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 -- 172.21.15.80:0/3005487349 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc0706c0 con 0x7fa8fc06c0a0 2019-11-28T11:49:22.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 -- 172.21.15.80:0/3005487349 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fa8e40019e0 con 0x7fa8fc06c0a0 2019-11-28T11:49:22.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 -- 172.21.15.80:0/3005487349 >> v1:172.21.15.80:6789/0 conn(0x7fa8fc06c0a0 legacy=0x7fa8fc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:22.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8e8003b80 0x7fa8e8005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:22.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8e80066d0 0x7fa8e8008b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:22.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8e804d3a0 0x7fa8e804f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:22.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 -- 172.21.15.80:0/3005487349 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e804fff0 con 0x7fa8e8003b80 2019-11-28T11:49:22.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 -- 172.21.15.80:0/3005487349 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e8050220 con 0x7fa8e80066d0 2019-11-28T11:49:22.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 -- 172.21.15.80:0/3005487349 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e8050450 con 0x7fa8e804d3a0 2019-11-28T11:49:22.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8e8003b80 0x7fa8e8005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:22.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa900abb700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8e80066d0 0x7fa8e8008b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:22.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa901abd700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8e804d3a0 0x7fa8e804f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:22.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa9012bc700 1 -- 172.21.15.80:0/3005487349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8e804d3a0 msgr2=0x7fa8e804f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:22.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8e804d3a0 0x7fa8e804f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:22.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa9012bc700 1 -- 172.21.15.80:0/3005487349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8e80066d0 msgr2=0x7fa8e8008b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:22.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8e80066d0 0x7fa8e8008b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:22.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa9012bc700 1 -- 172.21.15.80:0/3005487349 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e8050700 con 0x7fa8e8003b80 2019-11-28T11:49:22.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa901abd700 1 -- 172.21.15.80:0/3005487349 reap_dead start 2019-11-28T11:49:22.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa900abb700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8e80066d0 0x7fa8e8008b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:49:22.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8e8003b80 0x7fa8e8005fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa8e400fc50 tx=0x7fa8e400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:22.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8e8003b80 0x7fa8e8005fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa8e400fc50 tx=0x7fa8e400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:22.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8e8003b80 0x7fa8e8005fe0 secure :-1 s=READY pgs=2006 cs=0 l=1 rx=0x7fa8e400fc50 tx=0x7fa8e400fff0).ready entity=mon.0 client_cookie=fcbef07dc445d3d0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:22.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8e8003b80 0x7fa8e8005fe0 secure :-1 s=THROTTLE_DONE pgs=2006 cs=0 l=1 rx=0x7fa8e400fc50 tx=0x7fa8e400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:22.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 -- 172.21.15.80:0/3005487349 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8e40047b0 con 0x7fa8e8003b80 2019-11-28T11:49:22.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8e8003b80 0x7fa8e8005fe0 secure :-1 s=THROTTLE_DONE pgs=2006 cs=0 l=1 rx=0x7fa8e400fc50 tx=0x7fa8e400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:22.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8e8003b80 0x7fa8e8005fe0 secure :-1 s=THROTTLE_DONE pgs=2006 cs=0 l=1 rx=0x7fa8e400fc50 tx=0x7fa8e400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:22.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 -- 172.21.15.80:0/3005487349 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e40014b0 con 0x7fa8e8003b80 2019-11-28T11:49:22.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa8fbfff700 1 -- 172.21.15.80:0/3005487349 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8e4004d90 con 0x7fa8e8003b80 2019-11-28T11:49:22.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa902d1f700 1 -- 172.21.15.80:0/3005487349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8e8003b80 msgr2=0x7fa8e8005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:22.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.093+0000 7fa902d1f700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8e8003b80 0x7fa8e8005fe0 secure :-1 s=READY pgs=2006 cs=0 l=1 rx=0x7fa8e400fc50 tx=0x7fa8e400fff0).stop 2019-11-28T11:49:22.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.094+0000 7fa902d1f700 1 -- 172.21.15.80:0/3005487349 shutdown_connections 2019-11-28T11:49:22.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.094+0000 7fa902d1f700 1 --2- 172.21.15.80:0/3005487349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8e8003b80 0x7fa8e8005fe0 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:22.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.094+0000 7fa902d1f700 1 -- 172.21.15.80:0/3005487349 shutdown_connections 2019-11-28T11:49:22.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.094+0000 7fa902d1f700 1 -- 172.21.15.80:0/3005487349 wait complete. 2019-11-28T11:49:22.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.094+0000 7fa902d1f700 1 -- 172.21.15.80:0/3005487349 >> 172.21.15.80:0/3005487349 conn(0x7fa8fc061cf0 msgr2=0x7fa8fc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:22.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.097+0000 7fa902d1f700 1 Processor -- start 2019-11-28T11:49:22.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.097+0000 7fa902d1f700 1 -- start start 2019-11-28T11:49:22.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa902d1f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8fc074d00 0x7fa8fc07aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:22.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa902d1f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa8fc150f50 0x7fa8fc07af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:22.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa902d1f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc07bba0 0x7fa8fc07b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:22.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa902d1f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8fc078980 con 0x7fa8fc074d00 2019-11-28T11:49:22.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa902d1f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8fc078c50 con 0x7fa8fc150f50 2019-11-28T11:49:22.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa902d1f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc077f50 con 0x7fa8fc07bba0 2019-11-28T11:49:22.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa9012bc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8fc074d00 0x7fa8fc07aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:22.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa9012bc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8fc074d00 0x7fa8fc07aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41790/0 (socket says 172.21.15.80:41790) 2019-11-28T11:49:22.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa9012bc700 1 -- 172.21.15.80:0/3493907391 learned_addr learned my addr 172.21.15.80:0/3493907391 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:22.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa900abb700 1 --2- 172.21.15.80:0/3493907391 >> v2:172.21.15.174:3300/0 conn(0x7fa8fc150f50 0x7fa8fc07af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:22.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa901abd700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc07bba0 0x7fa8fc07b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:22.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa9012bc700 1 -- 172.21.15.80:0/3493907391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc07bba0 msgr2=0x7fa8fc07b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:22.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc07bba0 0x7fa8fc07b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:22.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa9012bc700 1 -- 172.21.15.80:0/3493907391 >> v2:172.21.15.174:3300/0 conn(0x7fa8fc150f50 msgr2=0x7fa8fc07af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:22.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3493907391 >> v2:172.21.15.174:3300/0 conn(0x7fa8fc150f50 0x7fa8fc07af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:22.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa9012bc700 1 -- 172.21.15.80:0/3493907391 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc0792e0 con 0x7fa8fc074d00 2019-11-28T11:49:22.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa901abd700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc07bba0 0x7fa8fc07b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:49:22.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3493907391 >> v2:172.21.15.80:3300/0 conn(0x7fa8fc074d00 0x7fa8fc07aa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa8e40107a0 tx=0x7fa8e40106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:22.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3493907391 >> v2:172.21.15.80:3300/0 conn(0x7fa8fc074d00 0x7fa8fc07aa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa8e40107a0 tx=0x7fa8e40106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:22.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8fc074d00 0x7fa8fc07aa20 secure :-1 s=READY pgs=2007 cs=0 l=1 rx=0x7fa8e40107a0 tx=0x7fa8e40106a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:22.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8fc074d00 0x7fa8fc07aa20 secure :-1 s=THROTTLE_DONE pgs=2007 cs=0 l=1 rx=0x7fa8e40107a0 tx=0x7fa8e40106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:22.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa8f9ffb700 1 -- 172.21.15.80:0/3493907391 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8e400fb60 con 0x7fa8fc074d00 2019-11-28T11:49:22.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8fc074d00 0x7fa8fc07aa20 secure :-1 s=THROTTLE_DONE pgs=2007 cs=0 l=1 rx=0x7fa8e40107a0 tx=0x7fa8e40106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:22.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8fc074d00 0x7fa8fc07aa20 secure :-1 s=THROTTLE_DONE pgs=2007 cs=0 l=1 rx=0x7fa8e40107a0 tx=0x7fa8e40106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:22.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa8f9ffb700 1 -- 172.21.15.80:0/3493907391 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e40045c0 con 0x7fa8fc074d00 2019-11-28T11:49:22.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa902d1f700 1 -- 172.21.15.80:0/3493907391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8fc079660 con 0x7fa8fc074d00 2019-11-28T11:49:22.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa8f9ffb700 1 -- 172.21.15.80:0/3493907391 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8e4004c50 con 0x7fa8fc074d00 2019-11-28T11:49:22.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.098+0000 7fa902d1f700 1 -- 172.21.15.80:0/3493907391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8fc0792e0 con 0x7fa8fc074d00 2019-11-28T11:49:22.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.099+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8fc074d00 0x7fa8fc07aa20 secure :-1 s=THROTTLE_DONE pgs=2007 cs=0 l=1 rx=0x7fa8e40107a0 tx=0x7fa8e40106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:22.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.099+0000 7fa8f9ffb700 1 -- 172.21.15.80:0/3493907391 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa8e40047b0 con 0x7fa8fc074d00 2019-11-28T11:49:22.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.099+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8fc074d00 0x7fa8fc07aa20 secure :-1 s=THROTTLE_DONE pgs=2007 cs=0 l=1 rx=0x7fa8e40107a0 tx=0x7fa8e40106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:22.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.099+0000 7fa8f9ffb700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8e0018730 0x7fa8e001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:22.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.099+0000 7fa8f9ffb700 1 -- 172.21.15.80:0/3493907391 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa8e4031e80 con 0x7fa8fc074d00 2019-11-28T11:49:22.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.099+0000 7fa900abb700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8e0018730 0x7fa8e001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:22.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.099+0000 7fa900abb700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8e0018730 0x7fa8e001abc0 crc :-1 s=READY pgs=813 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:22.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.106+0000 7fa902d1f700 1 -- 172.21.15.80:0/3493907391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8fc079660 con 0x7fa8fc074d00 2019-11-28T11:49:22.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.109+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8fc074d00 0x7fa8fc07aa20 secure :-1 s=THROTTLE_DONE pgs=2007 cs=0 l=1 rx=0x7fa8e40107a0 tx=0x7fa8e40106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:22.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.110+0000 7fa8f9ffb700 1 -- 172.21.15.80:0/3493907391 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa8e4001ce0 con 0x7fa8fc074d00 2019-11-28T11:49:22.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.283+0000 7fa902d1f700 1 -- 172.21.15.80:0/3493907391 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_eviction"]} v 0) v1 -- 0x7fa8fc0792e0 con 0x7fa8fc074d00 2019-11-28T11:49:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.376+0000 7fa9012bc700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8fc074d00 0x7fa8fc07aa20 secure :-1 s=THROTTLE_DONE pgs=2007 cs=0 l=1 rx=0x7fa8e40107a0 tx=0x7fa8e40106a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.376+0000 7fa8f9ffb700 1 -- 172.21.15.80:0/3493907391 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_eviction"]}]=0 v558) v1 ==== 158+0+0 (secure 0 0 0) 0x7fa8e40047e0 con 0x7fa8fc074d00 2019-11-28T11:49:22.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.399+0000 7fa902d1f700 1 -- 172.21.15.80:0/3493907391 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8e0018730 msgr2=0x7fa8e001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:22.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.399+0000 7fa902d1f700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8e0018730 0x7fa8e001abc0 crc :-1 s=READY pgs=813 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:22.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.399+0000 7fa902d1f700 1 -- 172.21.15.80:0/3493907391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8fc074d00 msgr2=0x7fa8fc07aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:22.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.399+0000 7fa902d1f700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8fc074d00 0x7fa8fc07aa20 secure :-1 s=READY pgs=2007 cs=0 l=1 rx=0x7fa8e40107a0 tx=0x7fa8e40106a0).stop 2019-11-28T11:49:22.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.399+0000 7fa902d1f700 1 -- 172.21.15.80:0/3493907391 shutdown_connections 2019-11-28T11:49:22.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.399+0000 7fa902d1f700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa8e0018730 0x7fa8e001abc0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:22.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.399+0000 7fa902d1f700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8fc07bba0 0x7fa8fc07b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:22.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.399+0000 7fa902d1f700 1 --2- 172.21.15.80:0/3493907391 >> v2:172.21.15.174:3300/0 conn(0x7fa8fc150f50 0x7fa8fc07af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:22.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.399+0000 7fa902d1f700 1 --2- 172.21.15.80:0/3493907391 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8fc074d00 0x7fa8fc07aa20 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:22.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.399+0000 7fa902d1f700 1 -- 172.21.15.80:0/3493907391 shutdown_connections 2019-11-28T11:49:22.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.399+0000 7fa902d1f700 1 -- 172.21.15.80:0/3493907391 wait complete. 2019-11-28T11:49:22.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:22.399+0000 7fa902d1f700 1 -- 172.21.15.80:0/3493907391 >> 172.21.15.80:0/3493907391 conn(0x7fa8fc13fa50 msgr2=0x7fa8fc07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:22.455 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:49:22.456 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:49:22.525 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:49:22.589 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:49:22.659 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:49:22.716 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:49:22.784 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:49:22.842 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:49:22.842 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:49:22.842 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:49:22.843 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:49:22.843 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:49:22.843 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:49:22.843 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:49:22.848 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:49:22.848 DEBUG:teuthology.parallel:result is None 2019-11-28T11:49:22.850 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:49:22.850 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:49:22.850 DEBUG:teuthology.parallel:result is None 2019-11-28T11:49:22.851 DEBUG:teuthology.parallel:result is None 2019-11-28T11:49:22.851 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:49:22.851 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:49:22.852 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:49:23.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.007+0000 7fa03c771700 1 Processor -- start 2019-11-28T11:49:23.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.007+0000 7fa03c771700 1 -- start start 2019-11-28T11:49:23.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa03c771700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03406c490 0x7fa03406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:23.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa03c771700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa03406ce60 0x7fa034164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:23.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa03c771700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03406db00 con 0x7fa03406c0a0 2019-11-28T11:49:23.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa03c771700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03406fd60 con 0x7fa03406ce60 2019-11-28T11:49:23.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa03c771700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa034070030 con 0x7fa03406c490 2019-11-28T11:49:23.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa03ad0e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa03406c0a0 0x7fa034072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41115/0 (socket says 172.21.15.80:41115) 2019-11-28T11:49:23.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa03ad0e700 1 -- 172.21.15.80:0/1330394560 learned_addr learned my addr 172.21.15.80:0/1330394560 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:23.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa03a50d700 1 --2- 172.21.15.80:0/1330394560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03406c490 0x7fa03406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:23.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa03b50f700 1 --2- 172.21.15.80:0/1330394560 >> v2:172.21.15.174:3300/0 conn(0x7fa03406ce60 0x7fa034164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:23.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa039d0c700 1 -- 172.21.15.80:0/1330394560 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044980576 0 0) 0x7fa02c0014f0 con 0x7fa03406c0a0 2019-11-28T11:49:23.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa039d0c700 1 -- 172.21.15.80:0/1330394560 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa01c002e80 con 0x7fa03406c0a0 2019-11-28T11:49:23.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa03a50d700 1 -- 172.21.15.80:0/1330394560 >> v2:172.21.15.174:3300/0 conn(0x7fa03406ce60 msgr2=0x7fa034164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:23.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa03a50d700 1 --2- 172.21.15.80:0/1330394560 >> v2:172.21.15.174:3300/0 conn(0x7fa03406ce60 0x7fa034164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:23.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa03a50d700 1 -- 172.21.15.80:0/1330394560 >> v1:172.21.15.80:6789/0 conn(0x7fa03406c0a0 legacy=0x7fa034072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:23.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa03a50d700 1 -- 172.21.15.80:0/1330394560 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0340706c0 con 0x7fa03406c490 2019-11-28T11:49:23.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa03a50d700 1 --2- 172.21.15.80:0/1330394560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03406c490 0x7fa03406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa02800af50 tx=0x7fa02800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa03a50d700 1 --2- 172.21.15.80:0/1330394560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03406c490 0x7fa03406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa02800af50 tx=0x7fa02800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa03a50d700 1 --2- 172.21.15.80:0/1330394560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03406c490 0x7fa03406c920 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7fa02800af50 tx=0x7fa02800b250).ready entity=mon.2 client_cookie=6d74f1507b4bab4a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:23.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa03a50d700 1 --2- 172.21.15.80:0/1330394560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03406c490 0x7fa03406c920 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7fa02800af50 tx=0x7fa02800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa039d0c700 1 -- 172.21.15.80:0/1330394560 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa028007210 con 0x7fa03406c490 2019-11-28T11:49:23.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa03a50d700 1 --2- 172.21.15.80:0/1330394560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03406c490 0x7fa03406c920 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7fa02800af50 tx=0x7fa02800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa03a50d700 1 --2- 172.21.15.80:0/1330394560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03406c490 0x7fa03406c920 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7fa02800af50 tx=0x7fa02800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa039d0c700 1 -- 172.21.15.80:0/1330394560 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0280099b0 con 0x7fa03406c490 2019-11-28T11:49:23.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa039d0c700 1 -- 172.21.15.80:0/1330394560 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa02800a080 con 0x7fa03406c490 2019-11-28T11:49:23.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa03c771700 1 -- 172.21.15.80:0/1330394560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03406c490 msgr2=0x7fa03406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:23.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa03c771700 1 --2- 172.21.15.80:0/1330394560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03406c490 0x7fa03406c920 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7fa02800af50 tx=0x7fa02800b250).stop 2019-11-28T11:49:23.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7fa03c771700 1 -- 172.21.15.80:0/1330394560 shutdown_connections 2019-11-28T11:49:23.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7fa03c771700 1 --2- 172.21.15.80:0/1330394560 >> v2:172.21.15.174:3300/0 conn(0x7fa03406ce60 0x7fa034164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:23.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7fa03c771700 1 --2- 172.21.15.80:0/1330394560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa03406c490 0x7fa03406c920 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7fa03c771700 1 -- 172.21.15.80:0/1330394560 shutdown_connections 2019-11-28T11:49:23.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7fa03c771700 1 -- 172.21.15.80:0/1330394560 wait complete. 2019-11-28T11:49:23.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7fa03c771700 1 -- 172.21.15.80:0/1330394560 >> 172.21.15.80:0/1330394560 conn(0x7fa034061cf0 msgr2=0x7fa034064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:23.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.013+0000 7fa03c771700 1 Processor -- start 2019-11-28T11:49:23.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.013+0000 7fa03c771700 1 -- start start 2019-11-28T11:49:23.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa03c771700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa034106590 0x7fa03411e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:23.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa03c771700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa034105190 con 0x7fa03411e980 2019-11-28T11:49:23.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa03c771700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa034105690 con 0x7fa0341631f0 2019-11-28T11:49:23.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa03c771700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa034124210 con 0x7fa034106590 2019-11-28T11:49:23.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa03ad0e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa034106590 0x7fa03411e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:23.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa03a50d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa03411e980 0x7fa0341629f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41132/0 (socket says 172.21.15.80:41132) 2019-11-28T11:49:23.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa03a50d700 1 -- 172.21.15.80:0/713931545 learned_addr learned my addr 172.21.15.80:0/713931545 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:23.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0337fe700 1 -- 172.21.15.80:0/713931545 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978632693 0 0) 0x7fa024001080 con 0x7fa0341631f0 2019-11-28T11:49:23.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa03ad0e700 1 -- 172.21.15.80:0/713931545 >> v1:172.21.15.174:6789/0 conn(0x7fa0341631f0 legacy=0x7fa034104100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:23.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa03ad0e700 1 -- 172.21.15.80:0/713931545 >> v1:172.21.15.80:6789/0 conn(0x7fa03411e980 legacy=0x7fa0341629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:23.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa03ad0e700 1 -- 172.21.15.80:0/713931545 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa034124b70 con 0x7fa034106590 2019-11-28T11:49:23.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa03ad0e700 1 --2- 172.21.15.80:0/713931545 >> v2:172.21.15.80:3300/0 conn(0x7fa034106590 0x7fa03411e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa02c010700 tx=0x7fa02c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa03ad0e700 1 --2- 172.21.15.80:0/713931545 >> v2:172.21.15.80:3300/0 conn(0x7fa034106590 0x7fa03411e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa02c010700 tx=0x7fa02c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa03ad0e700 1 --2- 172.21.15.80:0/713931545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa034106590 0x7fa03411e440 secure :-1 s=READY pgs=2012 cs=0 l=1 rx=0x7fa02c010700 tx=0x7fa02c010aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:23.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa03ad0e700 1 --2- 172.21.15.80:0/713931545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa034106590 0x7fa03411e440 secure :-1 s=THROTTLE_DONE pgs=2012 cs=0 l=1 rx=0x7fa02c010700 tx=0x7fa02c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa0337fe700 1 -- 172.21.15.80:0/713931545 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa02c001100 con 0x7fa034106590 2019-11-28T11:49:23.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa03ad0e700 1 --2- 172.21.15.80:0/713931545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa034106590 0x7fa03411e440 secure :-1 s=THROTTLE_DONE pgs=2012 cs=0 l=1 rx=0x7fa02c010700 tx=0x7fa02c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa03ad0e700 1 --2- 172.21.15.80:0/713931545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa034106590 0x7fa03411e440 secure :-1 s=THROTTLE_DONE pgs=2012 cs=0 l=1 rx=0x7fa02c010700 tx=0x7fa02c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa0337fe700 1 -- 172.21.15.80:0/713931545 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c001760 con 0x7fa034106590 2019-11-28T11:49:23.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa0337fe700 1 -- 172.21.15.80:0/713931545 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa02c001e30 con 0x7fa034106590 2019-11-28T11:49:23.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa03c771700 1 -- 172.21.15.80:0/713931545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa034124ef0 con 0x7fa034106590 2019-11-28T11:49:23.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa03c771700 1 -- 172.21.15.80:0/713931545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa034124b70 con 0x7fa034106590 2019-11-28T11:49:23.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa03ad0e700 1 --2- 172.21.15.80:0/713931545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa034106590 0x7fa03411e440 secure :-1 s=THROTTLE_DONE pgs=2012 cs=0 l=1 rx=0x7fa02c010700 tx=0x7fa02c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7fa0337fe700 1 -- 172.21.15.80:0/713931545 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa02c001400 con 0x7fa034106590 2019-11-28T11:49:23.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7fa03ad0e700 1 --2- 172.21.15.80:0/713931545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa034106590 0x7fa03411e440 secure :-1 s=THROTTLE_DONE pgs=2012 cs=0 l=1 rx=0x7fa02c010700 tx=0x7fa02c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7fa0337fe700 1 --2- 172.21.15.80:0/713931545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa014018730 0x7fa01401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:23.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7fa0337fe700 1 -- 172.21.15.80:0/713931545 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa02c0320a0 con 0x7fa034106590 2019-11-28T11:49:23.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7fa03a50d700 1 --2- 172.21.15.80:0/713931545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa014018730 0x7fa01401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:23.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7fa03a50d700 1 --2- 172.21.15.80:0/713931545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa014018730 0x7fa01401abe0 crc :-1 s=READY pgs=815 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:23.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.022+0000 7fa03c771700 1 -- 172.21.15.80:0/713931545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa034124ef0 con 0x7fa034106590 2019-11-28T11:49:23.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.026+0000 7fa03ad0e700 1 --2- 172.21.15.80:0/713931545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa034106590 0x7fa03411e440 secure :-1 s=THROTTLE_DONE pgs=2012 cs=0 l=1 rx=0x7fa02c010700 tx=0x7fa02c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.026+0000 7fa0337fe700 1 -- 172.21.15.80:0/713931545 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa02c001010 con 0x7fa034106590 2019-11-28T11:49:23.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.007+0000 7fa0b2989700 1 Processor -- start 2019-11-28T11:49:23.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.007+0000 7fa0b2989700 1 -- start start 2019-11-28T11:49:23.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa0b2989700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa0ac06c0a0 0x7fa0ac072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:23.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa0b2989700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac072620 0x7fa0ac164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:23.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa0b2989700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ac06db00 con 0x7fa0ac0734e0 2019-11-28T11:49:23.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa0b2989700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ac06fd60 con 0x7fa0ac06c0a0 2019-11-28T11:49:23.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa0b2989700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac070030 con 0x7fa0ac072620 2019-11-28T11:49:23.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa0a3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa0ac0734e0 0x7fa0ac071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41114/0 (socket says 172.21.15.80:41114) 2019-11-28T11:49:23.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa0a3fff700 1 -- 172.21.15.80:0/4269336144 learned_addr learned my addr 172.21.15.80:0/4269336144 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:23.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa0b1727700 1 --2- 172.21.15.80:0/4269336144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac072620 0x7fa0ac164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:23.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/4269336144 >> v2:172.21.15.174:3300/0 conn(0x7fa0ac06c0a0 0x7fa0ac072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:23.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0a37fe700 1 -- 172.21.15.80:0/4269336144 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234409495 0 0) 0x7fa09c001150 con 0x7fa0ac0734e0 2019-11-28T11:49:23.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0a37fe700 1 -- 172.21.15.80:0/4269336144 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa094002e80 con 0x7fa0ac0734e0 2019-11-28T11:49:23.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0b0f26700 1 -- 172.21.15.80:0/4269336144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac072620 msgr2=0x7fa0ac164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:23.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0a37fe700 1 -- 172.21.15.80:0/4269336144 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1903452203 0 0) 0x7fa09c001130 con 0x7fa0ac0734e0 2019-11-28T11:49:23.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/4269336144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac072620 0x7fa0ac164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:23.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0b0f26700 1 -- 172.21.15.80:0/4269336144 >> v1:172.21.15.80:6789/0 conn(0x7fa0ac0734e0 legacy=0x7fa0ac071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:23.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0b0f26700 1 -- 172.21.15.80:0/4269336144 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac0706c0 con 0x7fa0ac06c0a0 2019-11-28T11:49:23.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0b1727700 1 --2- 172.21.15.80:0/4269336144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac072620 0x7fa0ac164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:23.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/4269336144 >> v2:172.21.15.174:3300/0 conn(0x7fa0ac06c0a0 0x7fa0ac072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa0a800af50 tx=0x7fa0a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/4269336144 >> v2:172.21.15.174:3300/0 conn(0x7fa0ac06c0a0 0x7fa0ac072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa0a800af50 tx=0x7fa0a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/4269336144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0ac06c0a0 0x7fa0ac072fa0 secure :-1 s=READY pgs=1179 cs=0 l=1 rx=0x7fa0a800af50 tx=0x7fa0a800b760).ready entity=mon.1 client_cookie=244bb0853936c4a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:23.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/4269336144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0ac06c0a0 0x7fa0ac072fa0 secure :-1 s=THROTTLE_DONE pgs=1179 cs=0 l=1 rx=0x7fa0a800af50 tx=0x7fa0a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0a37fe700 1 -- 172.21.15.80:0/4269336144 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0a8007210 con 0x7fa0ac06c0a0 2019-11-28T11:49:23.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/4269336144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0ac06c0a0 0x7fa0ac072fa0 secure :-1 s=THROTTLE_DONE pgs=1179 cs=0 l=1 rx=0x7fa0a800af50 tx=0x7fa0a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/4269336144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0ac06c0a0 0x7fa0ac072fa0 secure :-1 s=THROTTLE_DONE pgs=1179 cs=0 l=1 rx=0x7fa0a800af50 tx=0x7fa0a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0a37fe700 1 -- 172.21.15.80:0/4269336144 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a80099b0 con 0x7fa0ac06c0a0 2019-11-28T11:49:23.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0a37fe700 1 -- 172.21.15.80:0/4269336144 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0a800a080 con 0x7fa0ac06c0a0 2019-11-28T11:49:23.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0b2989700 1 -- 172.21.15.80:0/4269336144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0ac06c0a0 msgr2=0x7fa0ac072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:23.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7fa0b2989700 1 --2- 172.21.15.80:0/4269336144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0ac06c0a0 0x7fa0ac072fa0 secure :-1 s=READY pgs=1179 cs=0 l=1 rx=0x7fa0a800af50 tx=0x7fa0a800b760).stop 2019-11-28T11:49:23.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7fa0b2989700 1 -- 172.21.15.80:0/4269336144 shutdown_connections 2019-11-28T11:49:23.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7fa0b2989700 1 --2- 172.21.15.80:0/4269336144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac072620 0x7fa0ac164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:23.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7fa0b2989700 1 --2- 172.21.15.80:0/4269336144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0ac06c0a0 0x7fa0ac072fa0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7fa0b2989700 1 -- 172.21.15.80:0/4269336144 shutdown_connections 2019-11-28T11:49:23.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7fa0b2989700 1 -- 172.21.15.80:0/4269336144 wait complete. 2019-11-28T11:49:23.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7fa0b2989700 1 -- 172.21.15.80:0/4269336144 >> 172.21.15.80:0/4269336144 conn(0x7fa0ac061cf0 msgr2=0x7fa0ac064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:23.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.013+0000 7fa0b2989700 1 Processor -- start 2019-11-28T11:49:23.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.013+0000 7fa0b2989700 1 -- start start 2019-11-28T11:49:23.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0b2989700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac15fd90 0x7fa0ac109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:23.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0b2989700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa0ac10a1b0 0x7fa0ac108af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:23.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0b2989700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa0ac109030 0x7fa0ac1094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:23.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0b2989700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ac10f470 con 0x7fa0ac109030 2019-11-28T11:49:23.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0b2989700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ac10fea0 con 0x7fa0ac10a1b0 2019-11-28T11:49:23.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0b2989700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac110800 con 0x7fa0ac15fd90 2019-11-28T11:49:23.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0a3fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa0ac10a1b0 0x7fa0ac108af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:23.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0b0f26700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac15fd90 0x7fa0ac109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:23.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0b1727700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa0ac109030 0x7fa0ac1094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:23.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0b0f26700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac15fd90 0x7fa0ac109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:44082/0 (socket says 172.21.15.80:44082) 2019-11-28T11:49:23.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0a3fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa0ac10a1b0 0x7fa0ac108af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:56708/0 (socket says 172.21.15.80:56708) 2019-11-28T11:49:23.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0b0f26700 1 -- 172.21.15.80:0/3499531263 learned_addr learned my addr 172.21.15.80:0/3499531263 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:23.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0b0f26700 1 -- 172.21.15.80:0/3499531263 >> v2:172.21.15.174:3300/0 conn(0x7fa0ac10a1b0 msgr2=0x7fa0ac108af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:23.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/3499531263 >> v2:172.21.15.174:3300/0 conn(0x7fa0ac10a1b0 0x7fa0ac108af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0b0f26700 1 -- 172.21.15.80:0/3499531263 >> v2:172.21.15.80:3300/0 conn(0x7fa0ac109030 msgr2=0x7fa0ac1094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:23.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/3499531263 >> v2:172.21.15.80:3300/0 conn(0x7fa0ac109030 0x7fa0ac1094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0b0f26700 1 -- 172.21.15.80:0/3499531263 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac110b80 con 0x7fa0ac15fd90 2019-11-28T11:49:23.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0b1727700 1 --2- 172.21.15.80:0/3499531263 >> v2:172.21.15.80:3300/0 conn(0x7fa0ac109030 0x7fa0ac1094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:23.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7fa0a3fff700 1 --2- 172.21.15.80:0/3499531263 >> v2:172.21.15.174:3300/0 conn(0x7fa0ac10a1b0 0x7fa0ac108af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:23.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac15fd90 0x7fa0ac109c70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa0a8054460 tx=0x7fa0a8054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac15fd90 0x7fa0ac109c70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa0a8054460 tx=0x7fa0a8054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac15fd90 0x7fa0ac109c70 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7fa0a8054460 tx=0x7fa0a8054800).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:23.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac15fd90 0x7fa0ac109c70 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7fa0a8054460 tx=0x7fa0a8054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac15fd90 0x7fa0ac109c70 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7fa0a8054460 tx=0x7fa0a8054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac15fd90 0x7fa0ac109c70 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7fa0a8054460 tx=0x7fa0a8054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa0a17fa700 1 -- 172.21.15.80:0/3499531263 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0a800aca0 con 0x7fa0ac15fd90 2019-11-28T11:49:23.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa0a17fa700 1 -- 172.21.15.80:0/3499531263 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a8009770 con 0x7fa0ac15fd90 2019-11-28T11:49:23.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa0b2989700 1 -- 172.21.15.80:0/3499531263 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ac110b80 con 0x7fa0ac15fd90 2019-11-28T11:49:23.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa0a17fa700 1 -- 172.21.15.80:0/3499531263 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0a8009e00 con 0x7fa0ac15fd90 2019-11-28T11:49:23.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa0b2989700 1 -- 172.21.15.80:0/3499531263 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ac110b80 con 0x7fa0ac15fd90 2019-11-28T11:49:23.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac15fd90 0x7fa0ac109c70 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7fa0a8054460 tx=0x7fa0a8054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7fa0a17fa700 1 -- 172.21.15.80:0/3499531263 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa0a8009960 con 0x7fa0ac15fd90 2019-11-28T11:49:23.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac15fd90 0x7fa0ac109c70 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7fa0a8054460 tx=0x7fa0a8054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7fa0a17fa700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa08c018730 0x7fa08c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:23.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7fa0a17fa700 1 -- 172.21.15.80:0/3499531263 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa0a8075cd0 con 0x7fa0ac15fd90 2019-11-28T11:49:23.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7fa0a3fff700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa08c018730 0x7fa08c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:23.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7fa0a3fff700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa08c018730 0x7fa08c01abe0 crc :-1 s=READY pgs=814 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:23.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.022+0000 7fa0b2989700 1 -- 172.21.15.80:0/3499531263 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ac110b80 con 0x7fa0ac15fd90 2019-11-28T11:49:23.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.026+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac15fd90 0x7fa0ac109c70 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7fa0a8054460 tx=0x7fa0a8054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.026+0000 7fa0a17fa700 1 -- 172.21.15.80:0/3499531263 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa0a800af60 con 0x7fa0ac15fd90 2019-11-28T11:49:23.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7f726f10a700 1 Processor -- start 2019-11-28T11:49:23.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.008+0000 7f726f10a700 1 -- start start 2019-11-28T11:49:23.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7f726f10a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f726806c0a0 0x7f7268072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:23.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7f726f10a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7268072620 0x7f7268164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:23.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7f726f10a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726806db00 con 0x7f72680734e0 2019-11-28T11:49:23.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7f726f10a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726806fd60 con 0x7f726806c0a0 2019-11-28T11:49:23.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7f726f10a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7268070030 con 0x7f7268072620 2019-11-28T11:49:23.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7f726cea6700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f72680734e0 0x7f7268071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41126/0 (socket says 172.21.15.80:41126) 2019-11-28T11:49:23.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7f726cea6700 1 -- 172.21.15.80:0/3214726673 learned_addr learned my addr 172.21.15.80:0/3214726673 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:23.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7f726d6a7700 1 --2- 172.21.15.80:0/3214726673 >> v2:172.21.15.174:3300/0 conn(0x7f726806c0a0 0x7f7268072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:23.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.009+0000 7f726dea8700 1 --2- 172.21.15.80:0/3214726673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7268072620 0x7f7268164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:23.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7f726d6a7700 1 -- 172.21.15.80:0/3214726673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7268072620 msgr2=0x7f7268164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:23.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7f726d6a7700 1 --2- 172.21.15.80:0/3214726673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7268072620 0x7f7268164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:23.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7f726d6a7700 1 -- 172.21.15.80:0/3214726673 >> v1:172.21.15.80:6789/0 conn(0x7f72680734e0 legacy=0x7f7268071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:23.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7f726d6a7700 1 -- 172.21.15.80:0/3214726673 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72680706c0 con 0x7f726806c0a0 2019-11-28T11:49:23.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7f726d6a7700 1 --2- 172.21.15.80:0/3214726673 >> v2:172.21.15.174:3300/0 conn(0x7f726806c0a0 0x7f7268072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f726400af50 tx=0x7f726400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7f726d6a7700 1 --2- 172.21.15.80:0/3214726673 >> v2:172.21.15.174:3300/0 conn(0x7f726806c0a0 0x7f7268072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f726400af50 tx=0x7f726400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7f726d6a7700 1 --2- 172.21.15.80:0/3214726673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f726806c0a0 0x7f7268072fa0 secure :-1 s=READY pgs=1180 cs=0 l=1 rx=0x7f726400af50 tx=0x7f726400b250).ready entity=mon.1 client_cookie=12a7f0b954bdeac server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:23.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7f726d6a7700 1 --2- 172.21.15.80:0/3214726673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f726806c0a0 0x7f7268072fa0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f726400af50 tx=0x7f726400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7f726d6a7700 1 --2- 172.21.15.80:0/3214726673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f726806c0a0 0x7f7268072fa0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f726400af50 tx=0x7f726400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7f726d6a7700 1 --2- 172.21.15.80:0/3214726673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f726806c0a0 0x7f7268072fa0 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f726400af50 tx=0x7f726400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7f725ffff700 1 -- 172.21.15.80:0/3214726673 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7264007210 con 0x7f726806c0a0 2019-11-28T11:49:23.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7f725ffff700 1 -- 172.21.15.80:0/3214726673 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72640099b0 con 0x7f726806c0a0 2019-11-28T11:49:23.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7f725ffff700 1 -- 172.21.15.80:0/3214726673 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f726400a080 con 0x7f726806c0a0 2019-11-28T11:49:23.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7f726f10a700 1 -- 172.21.15.80:0/3214726673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f726806c0a0 msgr2=0x7f7268072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:23.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.010+0000 7f726f10a700 1 --2- 172.21.15.80:0/3214726673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f726806c0a0 0x7f7268072fa0 secure :-1 s=READY pgs=1180 cs=0 l=1 rx=0x7f726400af50 tx=0x7f726400b250).stop 2019-11-28T11:49:23.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.011+0000 7f726f10a700 1 -- 172.21.15.80:0/3214726673 shutdown_connections 2019-11-28T11:49:23.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.011+0000 7f726f10a700 1 --2- 172.21.15.80:0/3214726673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7268072620 0x7f7268164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:23.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.011+0000 7f726f10a700 1 --2- 172.21.15.80:0/3214726673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f726806c0a0 0x7f7268072fa0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.011+0000 7f726f10a700 1 -- 172.21.15.80:0/3214726673 shutdown_connections 2019-11-28T11:49:23.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.011+0000 7f726f10a700 1 -- 172.21.15.80:0/3214726673 wait complete. 2019-11-28T11:49:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.011+0000 7f726f10a700 1 -- 172.21.15.80:0/3214726673 >> 172.21.15.80:0/3214726673 conn(0x7f7268061cf0 msgr2=0x7f7268064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7f726f10a700 1 Processor -- start 2019-11-28T11:49:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.014+0000 7f726f10a700 1 -- start start 2019-11-28T11:49:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7f726f10a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f726813e5f0 0x7f726813e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7f726f10a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f726810a070 0x7f726810bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7f726f10a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72681066e0 con 0x7f726810a4e0 2019-11-28T11:49:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7f726f10a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726810e060 con 0x7f726813e5f0 2019-11-28T11:49:23.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7f726f10a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726810e330 con 0x7f726810a070 2019-11-28T11:49:23.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7f726d6a7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f726813e5f0 0x7f726813e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:23.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7f726d6a7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f726813e5f0 0x7f726813e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41826/0 (socket says 172.21.15.80:41826) 2019-11-28T11:49:23.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.015+0000 7f726d6a7700 1 -- 172.21.15.80:0/2611806210 learned_addr learned my addr 172.21.15.80:0/2611806210 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:23.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7f726d6a7700 1 -- 172.21.15.80:0/2611806210 >> v2:172.21.15.174:3300/0 conn(0x7f726810a070 msgr2=0x7f726810bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:23.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7f726d6a7700 1 --2- 172.21.15.80:0/2611806210 >> v2:172.21.15.174:3300/0 conn(0x7f726810a070 0x7f726810bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7f726d6a7700 1 -- 172.21.15.80:0/2611806210 >> v1:172.21.15.80:6789/0 conn(0x7f726810a4e0 legacy=0x7f726810c2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2019-11-28T11:49:23.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7f726d6a7700 1 -- 172.21.15.80:0/2611806210 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726810e9c0 con 0x7f726813e5f0 2019-11-28T11:49:23.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7f726d6a7700 1 --2- 172.21.15.80:0/2611806210 >> v2:172.21.15.80:3300/0 conn(0x7f726813e5f0 0x7f726813e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7264010460 tx=0x7f7264010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7f726d6a7700 1 --2- 172.21.15.80:0/2611806210 >> v2:172.21.15.80:3300/0 conn(0x7f726813e5f0 0x7f726813e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7264010460 tx=0x7f7264010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7f726d6a7700 1 --2- 172.21.15.80:0/2611806210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726813e5f0 0x7f726813e9e0 secure :-1 s=READY pgs=2013 cs=0 l=1 rx=0x7f7264010460 tx=0x7f7264010800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:23.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7f726d6a7700 1 --2- 172.21.15.80:0/2611806210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726813e5f0 0x7f726813e9e0 secure :-1 s=THROTTLE_DONE pgs=2013 cs=0 l=1 rx=0x7f7264010460 tx=0x7f7264010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7f726d6a7700 1 --2- 172.21.15.80:0/2611806210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726813e5f0 0x7f726813e9e0 secure :-1 s=THROTTLE_DONE pgs=2013 cs=0 l=1 rx=0x7f7264010460 tx=0x7f7264010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7f725dffb700 1 -- 172.21.15.80:0/2611806210 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7264000940 con 0x7f726813e5f0 2019-11-28T11:49:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7f726d6a7700 1 --2- 172.21.15.80:0/2611806210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726813e5f0 0x7f726813e9e0 secure :-1 s=THROTTLE_DONE pgs=2013 cs=0 l=1 rx=0x7f7264010460 tx=0x7f7264010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7f725dffb700 1 -- 172.21.15.80:0/2611806210 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7264009770 con 0x7f726813e5f0 2019-11-28T11:49:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7f725dffb700 1 -- 172.21.15.80:0/2611806210 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7264009dc0 con 0x7f726813e5f0 2019-11-28T11:49:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7f726f10a700 1 -- 172.21.15.80:0/2611806210 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726810ed40 con 0x7f726813e5f0 2019-11-28T11:49:23.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.016+0000 7f726f10a700 1 -- 172.21.15.80:0/2611806210 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726810e9c0 con 0x7f726813e5f0 2019-11-28T11:49:23.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.017+0000 7f726d6a7700 1 --2- 172.21.15.80:0/2611806210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726813e5f0 0x7f726813e9e0 secure :-1 s=THROTTLE_DONE pgs=2013 cs=0 l=1 rx=0x7f7264010460 tx=0x7f7264010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.017+0000 7f725dffb700 1 -- 172.21.15.80:0/2611806210 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7264009960 con 0x7f726813e5f0 2019-11-28T11:49:23.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.017+0000 7f726d6a7700 1 --2- 172.21.15.80:0/2611806210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726813e5f0 0x7f726813e9e0 secure :-1 s=THROTTLE_DONE pgs=2013 cs=0 l=1 rx=0x7f7264010460 tx=0x7f7264010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.017+0000 7f725dffb700 1 --2- 172.21.15.80:0/2611806210 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7248018730 0x7f724801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:23.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.017+0000 7f725dffb700 1 -- 172.21.15.80:0/2611806210 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7264031bb0 con 0x7f726813e5f0 2019-11-28T11:49:23.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.017+0000 7f726cea6700 1 --2- 172.21.15.80:0/2611806210 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7248018730 0x7f724801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:23.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.018+0000 7f726cea6700 1 --2- 172.21.15.80:0/2611806210 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7248018730 0x7f724801abc0 crc :-1 s=READY pgs=816 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:23.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.023+0000 7f726f10a700 1 -- 172.21.15.80:0/2611806210 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726810ed40 con 0x7f726813e5f0 2019-11-28T11:49:23.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.029+0000 7f726d6a7700 1 --2- 172.21.15.80:0/2611806210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726813e5f0 0x7f726813e9e0 secure :-1 s=THROTTLE_DONE pgs=2013 cs=0 l=1 rx=0x7f7264010460 tx=0x7f7264010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.029+0000 7f725dffb700 1 -- 172.21.15.80:0/2611806210 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7264000940 con 0x7f726813e5f0 2019-11-28T11:49:23.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.213+0000 7fa0b2989700 1 -- 172.21.15.80:0/3499531263 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7fa0ac110800 con 0x7fa0ac15fd90 2019-11-28T11:49:23.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.214+0000 7f726f10a700 1 -- 172.21.15.80:0/2611806210 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f726810e9c0 con 0x7f726813e5f0 2019-11-28T11:49:23.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.214+0000 7fa03c771700 1 -- 172.21.15.80:0/713931545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fa034124b70 con 0x7fa034106590 2019-11-28T11:49:23.781 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:49:23.734+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:49:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.738+0000 7f726d6a7700 1 --2- 172.21.15.80:0/2611806210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726813e5f0 0x7f726813e9e0 secure :-1 s=THROTTLE_DONE pgs=2013 cs=0 l=1 rx=0x7f7264010460 tx=0x7f7264010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.738+0000 7f725dffb700 1 -- 172.21.15.80:0/2611806210 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6785 v117) v1 ==== 95+0+0 (secure 0 0 0) 0x7f7264009940 con 0x7f726813e5f0 2019-11-28T11:49:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.739+0000 7fa03ad0e700 1 --2- 172.21.15.80:0/713931545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa034106590 0x7fa03411e440 secure :-1 s=THROTTLE_DONE pgs=2012 cs=0 l=1 rx=0x7fa02c010700 tx=0x7fa02c010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.739+0000 7fa0337fe700 1 -- 172.21.15.80:0/713931545 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 9109 v117) v1 ==== 95+0+0 (secure 0 0 0) 0x7fa02c0177d0 con 0x7fa034106590 2019-11-28T11:49:23.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.739+0000 7fa0b0f26700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac15fd90 0x7fa0ac109c70 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7fa0a8054460 tx=0x7fa0a8054800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:23.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.739+0000 7fa0a17fa700 1 -- 172.21.15.80:0/3499531263 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 9765 v117) v1 ==== 95+0+0 (secure 0 0 0) 0x7fa0a8009770 con 0x7fa0ac15fd90 2019-11-28T11:49:23.824 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 9765 2019-11-28T11:49:23.825 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 6785 2019-11-28T11:49:23.825 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 9109 2019-11-28T11:49:23.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.780+0000 7fa0b2989700 1 -- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa08c018730 msgr2=0x7fa08c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:23.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.780+0000 7fa0b2989700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa08c018730 0x7fa08c01abe0 crc :-1 s=READY pgs=814 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.780+0000 7fa0b2989700 1 -- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac15fd90 msgr2=0x7fa0ac109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:23.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.780+0000 7fa0b2989700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac15fd90 0x7fa0ac109c70 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7fa0a8054460 tx=0x7fa0a8054800).stop 2019-11-28T11:49:23.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.781+0000 7fa0b2989700 1 -- 172.21.15.80:0/3499531263 shutdown_connections 2019-11-28T11:49:23.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.781+0000 7fa0b2989700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa08c018730 0x7fa08c01abe0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.781+0000 7fa0b2989700 1 --2- 172.21.15.80:0/3499531263 >> v2:172.21.15.80:3300/0 conn(0x7fa0ac109030 0x7fa0ac1094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.781+0000 7fa0b2989700 1 --2- 172.21.15.80:0/3499531263 >> v2:172.21.15.174:3300/0 conn(0x7fa0ac10a1b0 0x7fa0ac108af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.781+0000 7fa0b2989700 1 --2- 172.21.15.80:0/3499531263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0ac15fd90 0x7fa0ac109c70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.781+0000 7fa0b2989700 1 -- 172.21.15.80:0/3499531263 shutdown_connections 2019-11-28T11:49:23.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.781+0000 7fa0b2989700 1 -- 172.21.15.80:0/3499531263 wait complete. 2019-11-28T11:49:23.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.781+0000 7fa0b2989700 1 -- 172.21.15.80:0/3499531263 >> 172.21.15.80:0/3499531263 conn(0x7fa0ac13d620 msgr2=0x7fa0ac13fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:23.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.781+0000 7fa03c771700 1 -- 172.21.15.80:0/713931545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa014018730 msgr2=0x7fa01401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:23.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.781+0000 7fa03c771700 1 --2- 172.21.15.80:0/713931545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa014018730 0x7fa01401abe0 crc :-1 s=READY pgs=815 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.781+0000 7fa03c771700 1 -- 172.21.15.80:0/713931545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa034106590 msgr2=0x7fa03411e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:23.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.781+0000 7fa03c771700 1 --2- 172.21.15.80:0/713931545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa034106590 0x7fa03411e440 secure :-1 s=READY pgs=2012 cs=0 l=1 rx=0x7fa02c010700 tx=0x7fa02c010aa0).stop 2019-11-28T11:49:23.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7fa03c771700 1 -- 172.21.15.80:0/713931545 shutdown_connections 2019-11-28T11:49:23.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7fa03c771700 1 --2- 172.21.15.80:0/713931545 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa014018730 0x7fa01401abe0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7fa03c771700 1 --2- 172.21.15.80:0/713931545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa034106590 0x7fa03411e440 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7fa03c771700 1 -- 172.21.15.80:0/713931545 shutdown_connections 2019-11-28T11:49:23.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7fa03c771700 1 -- 172.21.15.80:0/713931545 wait complete. 2019-11-28T11:49:23.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7fa03c771700 1 -- 172.21.15.80:0/713931545 >> 172.21.15.80:0/713931545 conn(0x7fa034141a80 msgr2=0x7fa034141e70 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:23.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7f726f10a700 1 -- 172.21.15.80:0/2611806210 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7248018730 msgr2=0x7f724801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:23.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7f726f10a700 1 --2- 172.21.15.80:0/2611806210 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7248018730 0x7f724801abc0 crc :-1 s=READY pgs=816 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7f726f10a700 1 -- 172.21.15.80:0/2611806210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726813e5f0 msgr2=0x7f726813e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:23.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7f726f10a700 1 --2- 172.21.15.80:0/2611806210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726813e5f0 0x7f726813e9e0 secure :-1 s=READY pgs=2013 cs=0 l=1 rx=0x7f7264010460 tx=0x7f7264010800).stop 2019-11-28T11:49:23.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7f726f10a700 1 -- 172.21.15.80:0/2611806210 shutdown_connections 2019-11-28T11:49:23.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7f726f10a700 1 --2- 172.21.15.80:0/2611806210 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7248018730 0x7f724801abc0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7f726f10a700 1 --2- 172.21.15.80:0/2611806210 >> v2:172.21.15.174:3300/0 conn(0x7f726810a070 0x7f726810bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7f726f10a700 1 --2- 172.21.15.80:0/2611806210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f726813e5f0 0x7f726813e9e0 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:23.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7f726f10a700 1 -- 172.21.15.80:0/2611806210 shutdown_connections 2019-11-28T11:49:23.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7f726f10a700 1 -- 172.21.15.80:0/2611806210 wait complete. 2019-11-28T11:49:23.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.782+0000 7f726f10a700 1 -- 172.21.15.80:0/2611806210 >> 172.21.15.80:0/2611806210 conn(0x7f726813d620 msgr2=0x7f726813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:23.863 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:49:23.864 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:49:23.864 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:49:23.865 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:49:24.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.940+0000 7fe07c6e6700 1 Processor -- start 2019-11-28T11:49:24.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.940+0000 7fe07c6e6700 1 -- start start 2019-11-28T11:49:24.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07c6e6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe07406c490 0x7fe07406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:24.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07c6e6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe07406ce60 0x7fe074164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:24.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07c6e6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07406db00 con 0x7fe07406c0a0 2019-11-28T11:49:24.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07c6e6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07406fd60 con 0x7fe07406ce60 2019-11-28T11:49:24.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07c6e6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe074070030 con 0x7fe07406c490 2019-11-28T11:49:24.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07b484700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe07406ce60 0x7fe074164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:24.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07b484700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe07406ce60 0x7fe074164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41836/0 (socket says 172.21.15.80:41836) 2019-11-28T11:49:24.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07b484700 1 -- 172.21.15.80:0/1743009447 learned_addr learned my addr 172.21.15.80:0/1743009447 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:24.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07ac83700 1 --1- 172.21.15.80:0/1743009447 >> v1:172.21.15.80:6789/0 conn(0x7fe07406c0a0 0x7fe074072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41150/0 (socket says 172.21.15.80:41150) 2019-11-28T11:49:24.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07a482700 1 --2- 172.21.15.80:0/1743009447 >> v2:172.21.15.174:3300/0 conn(0x7fe07406c490 0x7fe07406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:24.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07b484700 1 -- 172.21.15.80:0/1743009447 >> v2:172.21.15.174:3300/0 conn(0x7fe07406c490 msgr2=0x7fe07406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:24.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07b484700 1 --2- 172.21.15.80:0/1743009447 >> v2:172.21.15.174:3300/0 conn(0x7fe07406c490 0x7fe07406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:24.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07b484700 1 -- 172.21.15.80:0/1743009447 >> v1:172.21.15.80:6789/0 conn(0x7fe07406c0a0 legacy=0x7fe074072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe079c81700 1 -- 172.21.15.80:0/1743009447 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488316547 0 0) 0x7fe05c001480 con 0x7fe07406c0a0 2019-11-28T11:49:24.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07b484700 1 -- 172.21.15.80:0/1743009447 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0740706c0 con 0x7fe07406ce60 2019-11-28T11:49:24.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07b484700 1 --2- 172.21.15.80:0/1743009447 >> v2:172.21.15.80:3300/0 conn(0x7fe07406ce60 0x7fe074164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe06c00f6b0 tx=0x7fe06c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07b484700 1 --2- 172.21.15.80:0/1743009447 >> v2:172.21.15.80:3300/0 conn(0x7fe07406ce60 0x7fe074164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe06c00f6b0 tx=0x7fe06c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07b484700 1 --2- 172.21.15.80:0/1743009447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07406ce60 0x7fe074164d70 secure :-1 s=READY pgs=2015 cs=0 l=1 rx=0x7fe06c00f6b0 tx=0x7fe06c00fa50).ready entity=mon.0 client_cookie=67717a70f876ea04 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:24.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07b484700 1 --2- 172.21.15.80:0/1743009447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07406ce60 0x7fe074164d70 secure :-1 s=THROTTLE_DONE pgs=2015 cs=0 l=1 rx=0x7fe06c00f6b0 tx=0x7fe06c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe079c81700 1 -- 172.21.15.80:0/1743009447 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe06c000a70 con 0x7fe07406ce60 2019-11-28T11:49:24.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07b484700 1 --2- 172.21.15.80:0/1743009447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07406ce60 0x7fe074164d70 secure :-1 s=THROTTLE_DONE pgs=2015 cs=0 l=1 rx=0x7fe06c00f6b0 tx=0x7fe06c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07b484700 1 --2- 172.21.15.80:0/1743009447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07406ce60 0x7fe074164d70 secure :-1 s=THROTTLE_DONE pgs=2015 cs=0 l=1 rx=0x7fe06c00f6b0 tx=0x7fe06c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe079c81700 1 -- 172.21.15.80:0/1743009447 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c0010e0 con 0x7fe07406ce60 2019-11-28T11:49:24.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe079c81700 1 -- 172.21.15.80:0/1743009447 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe06c0017d0 con 0x7fe07406ce60 2019-11-28T11:49:24.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07c6e6700 1 -- 172.21.15.80:0/1743009447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07406ce60 msgr2=0x7fe074164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.942+0000 7fe07c6e6700 1 --2- 172.21.15.80:0/1743009447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07406ce60 0x7fe074164d70 secure :-1 s=READY pgs=2015 cs=0 l=1 rx=0x7fe06c00f6b0 tx=0x7fe06c00fa50).stop 2019-11-28T11:49:24.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.943+0000 7fe07c6e6700 1 -- 172.21.15.80:0/1743009447 shutdown_connections 2019-11-28T11:49:24.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.943+0000 7fe07c6e6700 1 --2- 172.21.15.80:0/1743009447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07406ce60 0x7fe074164d70 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:24.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.943+0000 7fe07c6e6700 1 --2- 172.21.15.80:0/1743009447 >> v2:172.21.15.174:3300/0 conn(0x7fe07406c490 0x7fe07406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:24.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.943+0000 7fe07c6e6700 1 -- 172.21.15.80:0/1743009447 shutdown_connections 2019-11-28T11:49:24.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.943+0000 7fe07c6e6700 1 -- 172.21.15.80:0/1743009447 wait complete. 2019-11-28T11:49:24.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.943+0000 7fe07c6e6700 1 -- 172.21.15.80:0/1743009447 >> 172.21.15.80:0/1743009447 conn(0x7fe074061cf0 msgr2=0x7fe074064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:24.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.946+0000 7fe07c6e6700 1 Processor -- start 2019-11-28T11:49:24.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.946+0000 7fe07c6e6700 1 -- start start 2019-11-28T11:49:24.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.946+0000 7fe07c6e6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe074109e40 0x7fe07410a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:24.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.946+0000 7fe07c6e6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe07410a810 0x7fe074105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:24.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.946+0000 7fe07c6e6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07413f1e0 con 0x7fe07413eb40 2019-11-28T11:49:24.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.946+0000 7fe07c6e6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0741234c0 con 0x7fe07410a810 2019-11-28T11:49:24.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.946+0000 7fe07c6e6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07413e0d0 con 0x7fe074109e40 2019-11-28T11:49:24.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe07b484700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe07410a810 0x7fe074105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:24.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe07b484700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe07410a810 0x7fe074105210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41842/0 (socket says 172.21.15.80:41842) 2019-11-28T11:49:24.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe07b484700 1 -- 172.21.15.80:0/3856812587 learned_addr learned my addr 172.21.15.80:0/3856812587 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:24.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe07a482700 1 --2- 172.21.15.80:0/3856812587 >> v2:172.21.15.174:3300/0 conn(0x7fe074109e40 0x7fe07410a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:24.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe07b484700 1 -- 172.21.15.80:0/3856812587 >> v2:172.21.15.174:3300/0 conn(0x7fe074109e40 msgr2=0x7fe07410a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe07b484700 1 --2- 172.21.15.80:0/3856812587 >> v2:172.21.15.174:3300/0 conn(0x7fe074109e40 0x7fe07410a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:24.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe07b484700 1 -- 172.21.15.80:0/3856812587 >> v1:172.21.15.174:6789/0 conn(0x7fe07413eb40 legacy=0x7fe07410afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe07b484700 1 -- 172.21.15.80:0/3856812587 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe074108700 con 0x7fe07410a810 2019-11-28T11:49:24.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe07b484700 1 --2- 172.21.15.80:0/3856812587 >> v2:172.21.15.80:3300/0 conn(0x7fe07410a810 0x7fe074105210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe06c010430 tx=0x7fe06c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe07b484700 1 --2- 172.21.15.80:0/3856812587 >> v2:172.21.15.80:3300/0 conn(0x7fe07410a810 0x7fe074105210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe06c010430 tx=0x7fe06c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe07b484700 1 --2- 172.21.15.80:0/3856812587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07410a810 0x7fe074105210 secure :-1 s=READY pgs=2016 cs=0 l=1 rx=0x7fe06c010430 tx=0x7fe06c0102b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe07b484700 1 --2- 172.21.15.80:0/3856812587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07410a810 0x7fe074105210 secure :-1 s=THROTTLE_DONE pgs=2016 cs=0 l=1 rx=0x7fe06c010430 tx=0x7fe06c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe07b484700 1 --2- 172.21.15.80:0/3856812587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07410a810 0x7fe074105210 secure :-1 s=THROTTLE_DONE pgs=2016 cs=0 l=1 rx=0x7fe06c010430 tx=0x7fe06c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe07b484700 1 --2- 172.21.15.80:0/3856812587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07410a810 0x7fe074105210 secure :-1 s=THROTTLE_DONE pgs=2016 cs=0 l=1 rx=0x7fe06c010430 tx=0x7fe06c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe0737fe700 1 -- 172.21.15.80:0/3856812587 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe06c0014a0 con 0x7fe07410a810 2019-11-28T11:49:24.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe0737fe700 1 -- 172.21.15.80:0/3856812587 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c000940 con 0x7fe07410a810 2019-11-28T11:49:24.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe07c6e6700 1 -- 172.21.15.80:0/3856812587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe074108a80 con 0x7fe07410a810 2019-11-28T11:49:24.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe0737fe700 1 -- 172.21.15.80:0/3856812587 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe06c001a80 con 0x7fe07410a810 2019-11-28T11:49:24.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.947+0000 7fe07c6e6700 1 -- 172.21.15.80:0/3856812587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe074108700 con 0x7fe07410a810 2019-11-28T11:49:24.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.948+0000 7fe07b484700 1 --2- 172.21.15.80:0/3856812587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07410a810 0x7fe074105210 secure :-1 s=THROTTLE_DONE pgs=2016 cs=0 l=1 rx=0x7fe06c010430 tx=0x7fe06c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.948+0000 7fe0737fe700 1 -- 172.21.15.80:0/3856812587 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe06c001160 con 0x7fe07410a810 2019-11-28T11:49:24.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.948+0000 7fe07b484700 1 --2- 172.21.15.80:0/3856812587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07410a810 0x7fe074105210 secure :-1 s=THROTTLE_DONE pgs=2016 cs=0 l=1 rx=0x7fe06c010430 tx=0x7fe06c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.948+0000 7fe0737fe700 1 --2- 172.21.15.80:0/3856812587 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe058018730 0x7fe05801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:24.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.948+0000 7fe0737fe700 1 -- 172.21.15.80:0/3856812587 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fe06c031a20 con 0x7fe07410a810 2019-11-28T11:49:24.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.948+0000 7fe07ac83700 1 --2- 172.21.15.80:0/3856812587 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe058018730 0x7fe05801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:24.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.948+0000 7fe07ac83700 1 --2- 172.21.15.80:0/3856812587 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe058018730 0x7fe05801abc0 crc :-1 s=READY pgs=817 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:24.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.956+0000 7fe07c6e6700 1 -- 172.21.15.80:0/3856812587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe074108a80 con 0x7fe07410a810 2019-11-28T11:49:24.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.959+0000 7fe07b484700 1 --2- 172.21.15.80:0/3856812587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07410a810 0x7fe074105210 secure :-1 s=THROTTLE_DONE pgs=2016 cs=0 l=1 rx=0x7fe06c010430 tx=0x7fe06c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:23.959+0000 7fe0737fe700 1 -- 172.21.15.80:0/3856812587 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe06c000eb0 con 0x7fe07410a810 2019-11-28T11:49:24.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.133+0000 7fe07c6e6700 1 -- 172.21.15.80:0/3856812587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe074108700 con 0x7fe07410a810 2019-11-28T11:49:24.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.134+0000 7fe07b484700 1 --2- 172.21.15.80:0/3856812587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07410a810 0x7fe074105210 secure :-1 s=THROTTLE_DONE pgs=2016 cs=0 l=1 rx=0x7fe06c010430 tx=0x7fe06c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.134+0000 7fe0737fe700 1 -- 172.21.15.80:0/3856812587 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v155) v1 ==== 81+0+31777 (secure 0 0 0) 0x7fe06c000eb0 con 0x7fe07410a810 2019-11-28T11:49:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:24.183 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:49:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 155, 2019-11-28T11:49:24.183 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:49:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:49:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:49:23.220952+0000", 2019-11-28T11:49:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:49:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:49:24.184 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:49:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:49:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:49:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:49:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:49:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:49:24.185 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:49:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:49:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:49:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:49:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:49:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:49:24.186 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:49:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 25, 2019-11-28T11:49:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:49:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:49:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:49:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:49:24.187 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:49:24.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:49:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:49:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:49:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:49:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:49:24.189 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:49:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:49:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:49:24.190 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:49:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:49:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:49:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:49:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:49:24.191 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:49:24.192 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:49:24.192 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:49:24.199 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:49:24.199 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:49:24.199 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:49:24.199 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:49:24.199 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:49:24.200 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:49:24.200 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:49:24.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.200 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:49:24.201 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:49:24.201 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:49:24.201 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:49:24.201 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:49:24.201 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:49:24.202 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:49:24.202 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:49:24.202 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:49:24.202 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:49:24.203 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:49:24.203 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:49:24.203 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:49:24.203 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:49:24.203 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:49:24.204 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:49:24.204 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:49:24.204 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:49:24.204 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:49:24.205 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:49:24.205 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:49:24.205 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:49:24.207 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:49:24.207 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:49:24.207 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:49:24.207 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:49:24.208 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:49:24.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.208 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:49:24.208 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:49:24.208 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:49:24.209 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:49:24.209 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:49:24.209 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:49:24.209 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:49:24.210 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:49:24.210 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:49:24.210 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:49:24.210 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:49:24.210 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:49:24.211 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:49:24.211 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:49:24.211 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.212 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 24, 2019-11-28T11:49:24.212 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:49:24.212 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:48:35.444932+0000", 2019-11-28T11:49:24.213 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:49:24.213 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:49:24.213 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:49:24.213 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:49:24.215 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:49:24.215 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:49:24.216 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:49:24.216 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:49:24.216 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:49:24.216 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:49:24.217 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:49:24.217 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:49:24.217 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:49:24.217 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:49:24.218 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:49:24.218 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:49:24.218 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:49:24.218 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:49:24.218 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:49:24.219 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:49:24.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.219 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "151", 2019-11-28T11:49:24.219 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:49:24.220 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:49:24.220 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:49:24.221 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:49:24.221 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:49:24.222 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:49:24.222 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:49:24.222 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:49:24.222 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:49:24.222 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:49:24.223 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:49:24.223 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:49:24.223 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:49:24.223 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:49:24.224 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:49:24.224 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:49:24.224 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:49:24.224 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:49:24.225 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:49:24.225 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:49:24.226 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:49:24.226 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:49:24.226 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:49:24.226 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:49:24.227 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:49:24.227 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:49:24.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.228 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:49:24.228 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:49:24.229 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:49:24.229 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:49:24.229 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:49:24.229 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:49:24.230 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:49:24.230 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:49:24.230 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:49:24.230 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:49:24.231 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:49:24.231 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:49:24.232 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:49:24.232 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:49:24.232 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:49:24.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.233 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:49:24.233 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:49:24.233 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:49:24.233 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.234 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.234 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 25, 2019-11-28T11:49:24.235 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:49:24.235 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:48:36.133221+0000", 2019-11-28T11:49:24.236 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:49:24.236 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:49:24.236 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:49:24.236 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:49:24.236 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:49:24.237 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:49:24.237 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:49:24.237 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:49:24.237 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:49:24.237 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:49:24.238 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:49:24.238 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:49:24.238 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:49:24.238 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:49:24.238 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:49:24.239 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:49:24.239 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:49:24.239 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:49:24.239 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:49:24.239 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:49:24.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.240 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "152", 2019-11-28T11:49:24.240 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:49:24.240 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:49:24.240 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:49:24.241 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:49:24.241 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:49:24.241 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:49:24.241 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:49:24.241 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:49:24.241 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:49:24.242 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:49:24.245 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:49:24.246 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:49:24.246 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:49:24.246 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:49:24.246 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:49:24.246 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:49:24.246 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:49:24.247 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:49:24.247 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:49:24.247 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:49:24.247 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:49:24.247 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:49:24.248 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:49:24.248 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:49:24.248 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:49:24.248 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:49:24.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.248 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:49:24.249 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:49:24.249 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:49:24.249 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:49:24.249 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:49:24.249 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:49:24.249 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:49:24.250 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:49:24.250 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:49:24.250 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:49:24.250 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:49:24.250 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:49:24.250 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:49:24.250 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:49:24.251 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:49:24.251 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.251 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.251 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.251 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:49:24.251 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:49:24.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.252 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:49:24.252 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:49:24.252 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:49:24.252 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:49:24.253 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:49:24.253 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:49:24.253 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:49:24.253 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:49:24.254 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:49:24.254 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 150, 2019-11-28T11:49:24.254 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:49:24.254 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:49:24.254 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:49:24.255 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.255 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.255 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:49:24.255 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:49:24.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.256 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.256 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:49:24.256 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:49:24.256 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.256 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.257 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:49:24.257 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.257 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.257 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:49:24.258 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:49:24.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.258 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.258 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:49:24.258 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:49:24.258 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.259 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.259 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:49:24.259 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.259 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.260 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:49:24.260 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:49:24.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.260 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.260 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:49:24.261 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:49:24.261 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.261 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.261 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:49:24.261 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.264 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.264 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:49:24.264 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:49:24.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.264 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.265 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:49:24.265 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:49:24.265 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.265 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.265 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:49:24.266 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:49:24.266 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:49:24.266 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:49:24.266 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:49:24.266 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:49:24.266 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:49:24.267 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.267 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:49:24.267 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:49:24.267 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:49:24.268 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:49:24.268 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:49:24.268 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:49:24.268 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:49:24.269 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:49:24.269 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:49:24.269 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 149, 2019-11-28T11:49:24.269 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:49:24.269 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:49:24.269 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:49:24.269 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.270 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.270 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:49:24.270 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:49:24.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.271 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.271 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:49:24.271 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:49:24.271 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.271 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.272 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:49:24.272 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.272 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.272 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:49:24.272 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:49:24.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.273 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.273 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:49:24.273 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:49:24.273 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.274 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.275 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:49:24.275 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.275 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.275 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:49:24.276 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:49:24.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.276 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.276 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:49:24.276 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:49:24.277 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.277 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.277 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:49:24.277 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.277 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.278 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:49:24.278 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:49:24.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.278 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.278 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:49:24.279 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:49:24.279 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.279 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.279 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:49:24.279 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:49:24.280 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:49:24.280 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:49:24.280 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:49:24.280 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:49:24.280 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:49:24.281 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.281 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:49:24.281 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:49:24.281 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:49:24.281 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:49:24.282 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:49:24.282 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:49:24.282 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:49:24.282 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:49:24.282 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:49:24.282 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 150, 2019-11-28T11:49:24.283 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:49:24.283 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:49:24.283 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:49:24.283 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.283 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.284 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:49:24.284 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:49:24.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.284 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.284 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:49:24.285 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:49:24.285 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.286 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.286 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:49:24.286 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.286 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.287 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:49:24.287 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:49:24.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.287 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.287 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:49:24.288 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:49:24.288 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.288 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.288 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:49:24.288 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.289 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.289 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:49:24.289 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:49:24.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.290 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.290 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:49:24.290 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:49:24.290 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.290 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.291 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:49:24.291 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.291 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.291 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:49:24.291 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:49:24.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.292 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.292 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:49:24.292 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:49:24.292 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.292 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.293 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:49:24.293 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:49:24.293 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:49:24.293 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:49:24.293 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:49:24.293 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:49:24.294 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:49:24.294 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.294 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:49:24.294 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:49:24.295 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:49:24.295 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:49:24.295 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:49:24.295 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:49:24.296 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:49:24.296 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:49:24.296 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:49:24.296 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 150, 2019-11-28T11:49:24.296 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:49:24.297 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:49:24.297 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:49:24.297 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.297 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.297 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:49:24.298 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:49:24.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.298 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.298 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:49:24.298 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:49:24.298 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.299 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.299 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:49:24.299 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.299 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.300 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:49:24.300 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:49:24.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.300 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.300 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:49:24.300 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:49:24.301 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.301 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.301 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:49:24.301 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.302 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.302 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:49:24.302 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:49:24.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.302 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.302 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:49:24.303 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:49:24.303 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.303 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.303 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:49:24.304 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.304 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.304 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:49:24.304 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:49:24.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.305 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.305 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:49:24.305 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:49:24.305 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.305 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.306 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:49:24.306 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:49:24.307 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:49:24.307 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:49:24.308 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:49:24.308 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:49:24.308 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:49:24.308 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.309 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:49:24.309 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:49:24.309 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:49:24.309 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:49:24.310 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:49:24.310 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:49:24.310 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:49:24.310 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:49:24.310 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:49:24.310 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 139, 2019-11-28T11:49:24.311 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:49:24.311 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:49:24.311 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:49:24.311 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.311 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.312 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:49:24.312 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:49:24.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.312 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.313 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:49:24.313 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:49:24.313 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.313 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.313 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:49:24.314 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.314 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.314 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:49:24.314 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:49:24.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.315 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.315 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:49:24.315 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:49:24.315 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.315 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.316 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:49:24.316 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.316 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.317 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:49:24.317 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:49:24.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.317 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.318 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:49:24.318 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:49:24.318 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.318 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.318 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:49:24.319 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.319 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.319 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:49:24.319 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:49:24.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.320 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.320 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:49:24.320 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:49:24.320 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.320 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.320 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:49:24.321 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:49:24.321 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:49:24.321 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:49:24.321 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:49:24.321 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:49:24.321 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:49:24.322 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.322 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:49:24.322 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:49:24.322 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:49:24.323 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:49:24.323 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:49:24.323 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:49:24.323 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:49:24.323 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:49:24.323 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:49:24.323 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 149, 2019-11-28T11:49:24.324 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:49:24.324 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:49:24.324 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:49:24.324 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.324 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.325 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:49:24.325 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:49:24.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.325 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.325 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:49:24.326 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:49:24.326 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.326 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.326 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:49:24.326 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.330 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.330 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:49:24.330 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:49:24.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.331 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.331 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:49:24.331 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:49:24.331 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.331 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.331 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:49:24.332 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.332 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.332 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:49:24.332 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:49:24.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.333 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.333 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:49:24.333 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:49:24.333 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.334 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.334 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:49:24.334 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.335 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.335 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:49:24.335 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:49:24.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.336 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.336 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:49:24.336 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:49:24.336 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.337 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.337 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:49:24.337 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:49:24.337 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:49:24.337 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:49:24.337 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:49:24.338 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:49:24.338 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:49:24.338 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.338 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:49:24.339 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:49:24.339 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:49:24.339 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:49:24.339 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:49:24.339 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:49:24.339 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:49:24.342 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:49:24.342 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:49:24.342 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 150, 2019-11-28T11:49:24.342 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:49:24.342 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:49:24.342 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:49:24.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.343 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:49:24.343 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:49:24.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.344 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.344 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:49:24.344 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:49:24.344 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.345 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.345 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:49:24.345 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.345 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.346 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:49:24.346 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:49:24.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.346 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.346 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:49:24.346 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:49:24.347 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.347 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.347 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:49:24.347 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.347 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.348 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:49:24.348 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:49:24.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.349 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.350 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:49:24.350 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:49:24.350 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.350 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.350 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:49:24.350 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.351 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.351 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:49:24.351 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:49:24.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.353 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.353 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:49:24.353 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:49:24.353 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.353 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.353 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:49:24.354 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:49:24.354 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:49:24.354 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:49:24.354 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:49:24.354 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:49:24.354 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:49:24.354 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.355 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:49:24.355 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:49:24.355 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:49:24.355 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:49:24.355 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:49:24.356 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:49:24.356 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:49:24.356 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:49:24.356 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:49:24.356 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 150, 2019-11-28T11:49:24.356 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:49:24.356 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:49:24.357 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:49:24.357 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.357 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.357 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:49:24.357 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:49:24.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.358 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.358 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:49:24.358 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:49:24.358 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.358 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.359 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:49:24.359 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.359 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.359 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:49:24.359 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:49:24.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.360 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.360 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:49:24.360 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:49:24.360 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.360 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.360 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:49:24.361 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.361 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.361 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:49:24.361 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:49:24.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.362 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.362 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:49:24.362 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:49:24.362 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.362 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.362 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:49:24.363 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:49:24.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.363 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:49:24.363 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:49:24.363 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:49:24.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.364 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:49:24.364 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:49:24.364 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:49:24.364 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.364 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.364 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:49:24.365 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:49:24.365 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:49:24.365 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:49:24.365 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:49:24.365 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:49:24.365 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:49:24.365 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:24.365 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.366 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:49:24.366 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:49:24.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.366 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:49:24.366 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:49:24.366 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:49:24.366 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:49:24.367 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:49:24.367 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:49:24.367 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:49:24.367 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:49:24.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.367 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:49:24.368 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:49:24.368 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:49:24.368 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:49:24.368 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:49:24.368 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:49:24.368 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:49:24.368 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:49:24.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.369 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:49:24.369 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:49:24.369 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:49:24.369 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:49:24.370 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:49:24.370 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:49:24.370 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:49:24.370 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:49:24.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.371 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:49:24.371 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:49:24.371 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:49:24.372 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:49:24.372 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:49:24.372 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:49:24.372 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:49:24.372 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:49:24.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.373 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:49:24.373 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:49:24.374 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:49:24.374 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:49:24.374 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:49:24.374 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:49:24.374 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:49:24.375 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:49:24.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.375 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:49:24.375 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:49:24.376 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:49:24.376 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:49:24.376 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:49:24.376 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:49:24.377 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:49:24.377 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:49:24.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.377 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:49:24.378 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:49:24.379 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:49:24.379 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:49:24.379 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:49:24.379 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:49:24.379 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:49:24.380 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:49:24.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:24.380 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:49:24.381 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:49:24.381 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:49:24.381 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:49:24.381 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:49:24.381 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:49:24.382 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:49:24.382 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:49:24.382 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.382 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:49:24.382 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:49:24.383 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:49:24.383 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:49:24.383 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:49:24.383 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:49:24.383 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/1862798714": "2019-11-29T11:49:23.217347+0000", 2019-11-28T11:49:24.383 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/1862798714": "2019-11-29T11:49:23.217347+0000" 2019-11-28T11:49:24.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.384 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:49:24.384 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:49:24.384 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:49:24.384 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:49:24.384 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:49:24.384 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:49:24.385 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:49:24.385 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:49:24.385 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:49:24.385 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:49:24.385 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:49:24.385 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:49:24.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.386 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:49:24.386 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:49:24.386 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:49:24.386 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:49:24.386 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:49:24.386 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:49:24.386 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:49:24.387 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:24.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:24.387 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:49:24.387 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:49:24.387 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:49:24.387 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:49:24.387 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:49:24.388 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:49:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.138+0000 7fe07c6e6700 1 -- 172.21.15.80:0/3856812587 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe058018730 msgr2=0x7fe05801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.138+0000 7fe07c6e6700 1 --2- 172.21.15.80:0/3856812587 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe058018730 0x7fe05801abc0 crc :-1 s=READY pgs=817 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:24.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.138+0000 7fe07c6e6700 1 -- 172.21.15.80:0/3856812587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07410a810 msgr2=0x7fe074105210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.138+0000 7fe07c6e6700 1 --2- 172.21.15.80:0/3856812587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07410a810 0x7fe074105210 secure :-1 s=READY pgs=2016 cs=0 l=1 rx=0x7fe06c010430 tx=0x7fe06c0102b0).stop 2019-11-28T11:49:24.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.138+0000 7fe07c6e6700 1 -- 172.21.15.80:0/3856812587 shutdown_connections 2019-11-28T11:49:24.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.138+0000 7fe07c6e6700 1 --2- 172.21.15.80:0/3856812587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe07410a810 0x7fe074105210 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:24.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.138+0000 7fe07c6e6700 1 --2- 172.21.15.80:0/3856812587 >> v2:172.21.15.174:3300/0 conn(0x7fe074109e40 0x7fe07410a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.138+0000 7fe07c6e6700 1 --2- 172.21.15.80:0/3856812587 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe058018730 0x7fe05801abc0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.138+0000 7fe07c6e6700 1 -- 172.21.15.80:0/3856812587 shutdown_connections 2019-11-28T11:49:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.138+0000 7fe07c6e6700 1 -- 172.21.15.80:0/3856812587 wait complete. 2019-11-28T11:49:24.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.138+0000 7fe07c6e6700 1 -- 172.21.15.80:0/3856812587 >> 172.21.15.80:0/3856812587 conn(0x7fe07411bfc0 msgr2=0x7fe074141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:24.394 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:49:24.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.468+0000 7f995b15a700 1 Processor -- start 2019-11-28T11:49:24.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.468+0000 7f995b15a700 1 -- start start 2019-11-28T11:49:24.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.469+0000 7f995b15a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f995406c490 0x7f995406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:24.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.469+0000 7f995b15a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995406db00 con 0x7f995406ce60 2019-11-28T11:49:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.469+0000 7f995b15a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995406e000 con 0x7f995406c0a0 2019-11-28T11:49:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.469+0000 7f995b15a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995406fd60 con 0x7f995406c490 2019-11-28T11:49:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.469+0000 7f9959ef8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f995406ce60 0x7f9954164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41166/0 (socket says 172.21.15.80:41166) 2019-11-28T11:49:24.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.469+0000 7f9959ef8700 1 -- 172.21.15.80:0/4289479522 learned_addr learned my addr 172.21.15.80:0/4289479522 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:24.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.469+0000 7f9958ef6700 1 --2- 172.21.15.80:0/4289479522 >> v2:172.21.15.174:3300/0 conn(0x7f995406c490 0x7f995406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:24.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.469+0000 7f9953fff700 1 -- 172.21.15.80:0/4289479522 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110892424 0 0) 0x7f994c001150 con 0x7f995406ce60 2019-11-28T11:49:24.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.469+0000 7f9953fff700 1 -- 172.21.15.80:0/4289479522 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9940002e80 con 0x7f995406ce60 2019-11-28T11:49:24.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.470+0000 7f9953fff700 1 -- 172.21.15.80:0/4289479522 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142999738 0 0) 0x7f9944001080 con 0x7f995406c0a0 2019-11-28T11:49:24.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.470+0000 7f9953fff700 1 -- 172.21.15.80:0/4289479522 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99400030b0 con 0x7f995406c0a0 2019-11-28T11:49:24.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.470+0000 7f9958ef6700 1 -- 172.21.15.80:0/4289479522 >> v1:172.21.15.174:6789/0 conn(0x7f995406c0a0 legacy=0x7f9954072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.470+0000 7f9958ef6700 1 -- 172.21.15.80:0/4289479522 >> v1:172.21.15.80:6789/0 conn(0x7f995406ce60 legacy=0x7f9954164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.470+0000 7f9958ef6700 1 -- 172.21.15.80:0/4289479522 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99540706c0 con 0x7f995406c490 2019-11-28T11:49:24.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.470+0000 7f9958ef6700 1 --2- 172.21.15.80:0/4289479522 >> v2:172.21.15.174:3300/0 conn(0x7f995406c490 0x7f995406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f993c00b2d0 tx=0x7f993c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.470+0000 7f9958ef6700 1 --2- 172.21.15.80:0/4289479522 >> v2:172.21.15.174:3300/0 conn(0x7f995406c490 0x7f995406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f993c00b2d0 tx=0x7f993c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.470+0000 7f9958ef6700 1 --2- 172.21.15.80:0/4289479522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f995406c490 0x7f995406c920 secure :-1 s=READY pgs=1184 cs=0 l=1 rx=0x7f993c00b2d0 tx=0x7f993c00bae0).ready entity=mon.1 client_cookie=b8ac0e11ecf211d2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:24.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.470+0000 7f9958ef6700 1 --2- 172.21.15.80:0/4289479522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f995406c490 0x7f995406c920 secure :-1 s=THROTTLE_DONE pgs=1184 cs=0 l=1 rx=0x7f993c00b2d0 tx=0x7f993c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.470+0000 7f9953fff700 1 -- 172.21.15.80:0/4289479522 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f993c000ce0 con 0x7f995406c490 2019-11-28T11:49:24.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.470+0000 7f9958ef6700 1 --2- 172.21.15.80:0/4289479522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f995406c490 0x7f995406c920 secure :-1 s=THROTTLE_DONE pgs=1184 cs=0 l=1 rx=0x7f993c00b2d0 tx=0x7f993c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.470+0000 7f9958ef6700 1 --2- 172.21.15.80:0/4289479522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f995406c490 0x7f995406c920 secure :-1 s=THROTTLE_DONE pgs=1184 cs=0 l=1 rx=0x7f993c00b2d0 tx=0x7f993c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.470+0000 7f9953fff700 1 -- 172.21.15.80:0/4289479522 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c009be0 con 0x7f995406c490 2019-11-28T11:49:24.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.470+0000 7f9953fff700 1 -- 172.21.15.80:0/4289479522 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f993c00a2b0 con 0x7f995406c490 2019-11-28T11:49:24.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.470+0000 7f995b15a700 1 -- 172.21.15.80:0/4289479522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f995406c490 msgr2=0x7f995406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.470+0000 7f995b15a700 1 --2- 172.21.15.80:0/4289479522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f995406c490 0x7f995406c920 secure :-1 s=READY pgs=1184 cs=0 l=1 rx=0x7f993c00b2d0 tx=0x7f993c00bae0).stop 2019-11-28T11:49:24.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.471+0000 7f995b15a700 1 -- 172.21.15.80:0/4289479522 shutdown_connections 2019-11-28T11:49:24.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.471+0000 7f995b15a700 1 --2- 172.21.15.80:0/4289479522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f995406c490 0x7f995406c920 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:24.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.471+0000 7f995b15a700 1 -- 172.21.15.80:0/4289479522 shutdown_connections 2019-11-28T11:49:24.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.471+0000 7f995b15a700 1 -- 172.21.15.80:0/4289479522 wait complete. 2019-11-28T11:49:24.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.471+0000 7f995b15a700 1 -- 172.21.15.80:0/4289479522 >> 172.21.15.80:0/4289479522 conn(0x7f9954061cf0 msgr2=0x7f9954064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:24.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.473+0000 7f995b15a700 1 Processor -- start 2019-11-28T11:49:24.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.473+0000 7f995b15a700 1 -- start start 2019-11-28T11:49:24.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.474+0000 7f995b15a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f995412cea0 0x7f9954111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:24.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.474+0000 7f995b15a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f99541230e0 0x7f9954123570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:24.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.474+0000 7f995b15a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9954124260 con 0x7f9954123ab0 2019-11-28T11:49:24.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.474+0000 7f995b15a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9954120610 con 0x7f99541230e0 2019-11-28T11:49:24.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.474+0000 7f995b15a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9954121040 con 0x7f995412cea0 2019-11-28T11:49:24.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.474+0000 7f9959ef8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9954123ab0 0x7f995412d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41174/0 (socket says 172.21.15.80:41174) 2019-11-28T11:49:24.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.474+0000 7f9959ef8700 1 -- 172.21.15.80:0/3457178624 learned_addr learned my addr 172.21.15.80:0/3457178624 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:24.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.474+0000 7f9958ef6700 1 --2- 172.21.15.80:0/3457178624 >> v2:172.21.15.174:3300/0 conn(0x7f99541230e0 0x7f9954123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:24.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.474+0000 7f99596f7700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f995412cea0 0x7f9954111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:24.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f9951ffb700 1 -- 172.21.15.80:0/3457178624 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201488827 0 0) 0x7f994c001150 con 0x7f9954123ab0 2019-11-28T11:49:24.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f9951ffb700 1 -- 172.21.15.80:0/3457178624 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9938002e80 con 0x7f9954123ab0 2019-11-28T11:49:24.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f9958ef6700 1 -- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f995412cea0 msgr2=0x7f9954111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f9958ef6700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f995412cea0 0x7f9954111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:24.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f9958ef6700 1 -- 172.21.15.80:0/3457178624 >> v1:172.21.15.80:6789/0 conn(0x7f9954123ab0 legacy=0x7f995412d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f9958ef6700 1 -- 172.21.15.80:0/3457178624 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99541219a0 con 0x7f99541230e0 2019-11-28T11:49:24.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f99596f7700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f995412cea0 0x7f9954111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:24.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f9958ef6700 1 --2- 172.21.15.80:0/3457178624 >> v2:172.21.15.174:3300/0 conn(0x7f99541230e0 0x7f9954123570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f993c010750 tx=0x7f993c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f9958ef6700 1 --2- 172.21.15.80:0/3457178624 >> v2:172.21.15.174:3300/0 conn(0x7f99541230e0 0x7f9954123570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f993c010750 tx=0x7f993c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f9958ef6700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99541230e0 0x7f9954123570 secure :-1 s=READY pgs=1185 cs=0 l=1 rx=0x7f993c010750 tx=0x7f993c010af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:24.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f9958ef6700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99541230e0 0x7f9954123570 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f993c010750 tx=0x7f993c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f9951ffb700 1 -- 172.21.15.80:0/3457178624 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f993c000cc0 con 0x7f99541230e0 2019-11-28T11:49:24.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f9958ef6700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99541230e0 0x7f9954123570 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f993c010750 tx=0x7f993c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f9951ffb700 1 -- 172.21.15.80:0/3457178624 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c009d00 con 0x7f99541230e0 2019-11-28T11:49:24.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f9958ef6700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99541230e0 0x7f9954123570 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f993c010750 tx=0x7f993c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f995b15a700 1 -- 172.21.15.80:0/3457178624 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9954121d20 con 0x7f99541230e0 2019-11-28T11:49:24.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f9951ffb700 1 -- 172.21.15.80:0/3457178624 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f993c009ef0 con 0x7f99541230e0 2019-11-28T11:49:24.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f995b15a700 1 -- 172.21.15.80:0/3457178624 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99541122f0 con 0x7f99541230e0 2019-11-28T11:49:24.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.475+0000 7f9958ef6700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99541230e0 0x7f9954123570 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f993c010750 tx=0x7f993c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.476+0000 7f9951ffb700 1 -- 172.21.15.80:0/3457178624 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f993c009900 con 0x7f99541230e0 2019-11-28T11:49:24.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.476+0000 7f9958ef6700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99541230e0 0x7f9954123570 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f993c010750 tx=0x7f993c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.476+0000 7f9951ffb700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9938018770 0x7f993801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:24.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.476+0000 7f9951ffb700 1 -- 172.21.15.80:0/3457178624 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f993c031d80 con 0x7f99541230e0 2019-11-28T11:49:24.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.476+0000 7f99596f7700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9938018770 0x7f993801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:24.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.476+0000 7f99596f7700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9938018770 0x7f993801abe0 crc :-1 s=READY pgs=818 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:24.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.483+0000 7f995b15a700 1 -- 172.21.15.80:0/3457178624 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99541219a0 con 0x7f99541230e0 2019-11-28T11:49:24.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.487+0000 7f9958ef6700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99541230e0 0x7f9954123570 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f993c010750 tx=0x7f993c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.487+0000 7f9951ffb700 1 -- 172.21.15.80:0/3457178624 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f993c017790 con 0x7f99541230e0 2019-11-28T11:49:24.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.658+0000 7f995b15a700 1 -- 172.21.15.80:0/3457178624 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9954121d20 con 0x7f99541230e0 2019-11-28T11:49:24.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.658+0000 7f9958ef6700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99541230e0 0x7f9954123570 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7f993c010750 tx=0x7f993c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.658+0000 7f9951ffb700 1 -- 172.21.15.80:0/3457178624 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f993c009900 con 0x7f99541230e0 2019-11-28T11:49:24.706 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 117 2019-11-28T11:49:24.706 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:24.707 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":117,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:48:37.109829+0000","modified":"2019-11-28T11:49:23.735048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":154,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2019-11-28T11:49:24.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.661+0000 7f995b15a700 1 -- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9938018770 msgr2=0x7f993801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.661+0000 7f995b15a700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9938018770 0x7f993801abe0 crc :-1 s=READY pgs=818 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:24.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.661+0000 7f995b15a700 1 -- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99541230e0 msgr2=0x7f9954123570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.661+0000 7f995b15a700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99541230e0 0x7f9954123570 secure :-1 s=READY pgs=1185 cs=0 l=1 rx=0x7f993c010750 tx=0x7f993c010af0).stop 2019-11-28T11:49:24.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.661+0000 7f995b15a700 1 -- 172.21.15.80:0/3457178624 shutdown_connections 2019-11-28T11:49:24.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.661+0000 7f995b15a700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9938018770 0x7f993801abe0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:24.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.661+0000 7f995b15a700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99541230e0 0x7f9954123570 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:24.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.661+0000 7f995b15a700 1 --2- 172.21.15.80:0/3457178624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f995412cea0 0x7f9954111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:24.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.661+0000 7f995b15a700 1 -- 172.21.15.80:0/3457178624 shutdown_connections 2019-11-28T11:49:24.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.661+0000 7f995b15a700 1 -- 172.21.15.80:0/3457178624 wait complete. 2019-11-28T11:49:24.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.661+0000 7f995b15a700 1 -- 172.21.15.80:0/3457178624 >> 172.21.15.80:0/3457178624 conn(0x7f99541426c0 msgr2=0x7f9954110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:24.718 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:49:24.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.797+0000 7f5f4c8cf700 1 Processor -- start 2019-11-28T11:49:24.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.797+0000 7f5f4c8cf700 1 -- start start 2019-11-28T11:49:24.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.798+0000 7f5f4c8cf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f4806d120 0x7f5f48165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:24.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.798+0000 7f5f4c8cf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4806d580 con 0x7f5f4806c490 2019-11-28T11:49:24.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.798+0000 7f5f4c8cf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4806db00 con 0x7f5f4806c0a0 2019-11-28T11:49:24.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.798+0000 7f5f4c8cf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4806fd60 con 0x7f5f4806d120 2019-11-28T11:49:24.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.798+0000 7f5f4659c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5f4806c490 0x7f5f4806c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41178/0 (socket says 172.21.15.80:41178) 2019-11-28T11:49:24.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.798+0000 7f5f4659c700 1 -- 172.21.15.80:0/1240134232 learned_addr learned my addr 172.21.15.80:0/1240134232 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:24.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.798+0000 7f5f4759e700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f4806d120 0x7f5f48165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:24.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.798+0000 7f5f45d9b700 1 -- 172.21.15.80:0/1240134232 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150836141 0 0) 0x7f5f30001150 con 0x7f5f4806c490 2019-11-28T11:49:24.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.798+0000 7f5f45d9b700 1 -- 172.21.15.80:0/1240134232 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f34002e80 con 0x7f5f4806c490 2019-11-28T11:49:24.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.798+0000 7f5f45d9b700 1 -- 172.21.15.80:0/1240134232 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 152318845 0 0) 0x7f5f30001130 con 0x7f5f4806c490 2019-11-28T11:49:24.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.798+0000 7f5f45d9b700 1 -- 172.21.15.80:0/1240134232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f4806d120 msgr2=0x7f5f48165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:24.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.798+0000 7f5f45d9b700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f4806d120 0x7f5f48165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:24.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.798+0000 7f5f45d9b700 1 -- 172.21.15.80:0/1240134232 >> v1:172.21.15.174:6789/0 conn(0x7f5f4806c0a0 legacy=0x7f5f48072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f45d9b700 1 -- 172.21.15.80:0/1240134232 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f480706c0 con 0x7f5f4806c490 2019-11-28T11:49:24.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f45d9b700 1 -- 172.21.15.80:0/1240134232 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f5f300016c0 con 0x7f5f4806c490 2019-11-28T11:49:24.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f45d9b700 1 -- 172.21.15.80:0/1240134232 >> v1:172.21.15.80:6789/0 conn(0x7f5f4806c490 legacy=0x7f5f4806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f45d9b700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f34003ab0 0x7f5f34005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:24.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f45d9b700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f34006690 0x7f5f34008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:24.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f45d9b700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f34009380 0x7f5f3400b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:24.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f45d9b700 1 -- 172.21.15.80:0/1240134232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3400bfd0 con 0x7f5f34003ab0 2019-11-28T11:49:24.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f45d9b700 1 -- 172.21.15.80:0/1240134232 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340501d0 con 0x7f5f34006690 2019-11-28T11:49:24.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f45d9b700 1 -- 172.21.15.80:0/1240134232 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f34050400 con 0x7f5f34009380 2019-11-28T11:49:24.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f34003ab0 0x7f5f34005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:24.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f4659c700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f34006690 0x7f5f34008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:24.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f4759e700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f34009380 0x7f5f3400b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:24.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f46d9d700 1 -- 172.21.15.80:0/1240134232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f34009380 msgr2=0x7f5f3400b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:24.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f34009380 0x7f5f3400b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:24.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f46d9d700 1 -- 172.21.15.80:0/1240134232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f34006690 msgr2=0x7f5f34008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:24.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f34006690 0x7f5f34008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:24.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f46d9d700 1 -- 172.21.15.80:0/1240134232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f340506b0 con 0x7f5f34003ab0 2019-11-28T11:49:24.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f34003ab0 0x7f5f34005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5f3800b2f0 tx=0x7f5f3800b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f34003ab0 0x7f5f34005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5f3800b2f0 tx=0x7f5f3800b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f34003ab0 0x7f5f34005f10 secure :-1 s=READY pgs=2020 cs=0 l=1 rx=0x7f5f3800b2f0 tx=0x7f5f3800b5f0).ready entity=mon.0 client_cookie=b8ae0e117385d02f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:24.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f34003ab0 0x7f5f34005f10 secure :-1 s=THROTTLE_DONE pgs=2020 cs=0 l=1 rx=0x7f5f3800b2f0 tx=0x7f5f3800b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f45d9b700 1 -- 172.21.15.80:0/1240134232 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f38009e70 con 0x7f5f34003ab0 2019-11-28T11:49:24.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f34003ab0 0x7f5f34005f10 secure :-1 s=THROTTLE_DONE pgs=2020 cs=0 l=1 rx=0x7f5f3800b2f0 tx=0x7f5f3800b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f34003ab0 0x7f5f34005f10 secure :-1 s=THROTTLE_DONE pgs=2020 cs=0 l=1 rx=0x7f5f3800b2f0 tx=0x7f5f3800b5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f45d9b700 1 -- 172.21.15.80:0/1240134232 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f380099f0 con 0x7f5f34003ab0 2019-11-28T11:49:24.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f45d9b700 1 -- 172.21.15.80:0/1240134232 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f3800a4f0 con 0x7f5f34003ab0 2019-11-28T11:49:24.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f4c8cf700 1 -- 172.21.15.80:0/1240134232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f34003ab0 msgr2=0x7f5f34005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f4c8cf700 1 --2- 172.21.15.80:0/1240134232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f34003ab0 0x7f5f34005f10 secure :-1 s=READY pgs=2020 cs=0 l=1 rx=0x7f5f3800b2f0 tx=0x7f5f3800b5f0).stop 2019-11-28T11:49:24.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.799+0000 7f5f4759e700 1 -- 172.21.15.80:0/1240134232 reap_dead start 2019-11-28T11:49:24.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.800+0000 7f5f4c8cf700 1 -- 172.21.15.80:0/1240134232 shutdown_connections 2019-11-28T11:49:24.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.800+0000 7f5f4c8cf700 1 -- 172.21.15.80:0/1240134232 shutdown_connections 2019-11-28T11:49:24.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.800+0000 7f5f4c8cf700 1 -- 172.21.15.80:0/1240134232 wait complete. 2019-11-28T11:49:24.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.800+0000 7f5f4c8cf700 1 -- 172.21.15.80:0/1240134232 >> 172.21.15.80:0/1240134232 conn(0x7f5f48061cf0 msgr2=0x7f5f48064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:24.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.803+0000 7f5f4c8cf700 1 Processor -- start 2019-11-28T11:49:24.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.803+0000 7f5f4c8cf700 1 -- start start 2019-11-28T11:49:24.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.803+0000 7f5f4c8cf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f48074d00 0x7f5f4807aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:24.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f4c8cf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5f4807bba0 0x7f5f48167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:24.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f4c8cf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f480754d0 con 0x7f5f48150f50 2019-11-28T11:49:24.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f4c8cf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f48078980 con 0x7f5f48074d00 2019-11-28T11:49:24.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f4c8cf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f48078c50 con 0x7f5f4807bba0 2019-11-28T11:49:24.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f46d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f48074d00 0x7f5f4807aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:24.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f46d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5f48074d00 0x7f5f4807aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41876/0 (socket says 172.21.15.80:41876) 2019-11-28T11:49:24.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f46d9d700 1 -- 172.21.15.80:0/1538927172 learned_addr learned my addr 172.21.15.80:0/1538927172 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:24.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f4759e700 1 --2- 172.21.15.80:0/1538927172 >> v2:172.21.15.174:3300/0 conn(0x7f5f4807bba0 0x7f5f48167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:24.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f46d9d700 1 -- 172.21.15.80:0/1538927172 >> v2:172.21.15.174:3300/0 conn(0x7f5f4807bba0 msgr2=0x7f5f48167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1538927172 >> v2:172.21.15.174:3300/0 conn(0x7f5f4807bba0 0x7f5f48167c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:24.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f46d9d700 1 -- 172.21.15.80:0/1538927172 >> v1:172.21.15.174:6789/0 conn(0x7f5f48150f50 legacy=0x7f5f4807af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:24.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f46d9d700 1 -- 172.21.15.80:0/1538927172 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f480792e0 con 0x7f5f48074d00 2019-11-28T11:49:24.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1538927172 >> v2:172.21.15.80:3300/0 conn(0x7f5f48074d00 0x7f5f4807aa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5f38010770 tx=0x7f5f380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1538927172 >> v2:172.21.15.80:3300/0 conn(0x7f5f48074d00 0x7f5f4807aa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5f38010770 tx=0x7f5f380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1538927172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f48074d00 0x7f5f4807aa20 secure :-1 s=READY pgs=2021 cs=0 l=1 rx=0x7f5f38010770 tx=0x7f5f380105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:24.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1538927172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f48074d00 0x7f5f4807aa20 secure :-1 s=THROTTLE_DONE pgs=2021 cs=0 l=1 rx=0x7f5f38010770 tx=0x7f5f380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1538927172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f48074d00 0x7f5f4807aa20 secure :-1 s=THROTTLE_DONE pgs=2021 cs=0 l=1 rx=0x7f5f38010770 tx=0x7f5f380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f3f7fe700 1 -- 172.21.15.80:0/1538927172 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f38009920 con 0x7f5f48074d00 2019-11-28T11:49:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1538927172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f48074d00 0x7f5f4807aa20 secure :-1 s=THROTTLE_DONE pgs=2021 cs=0 l=1 rx=0x7f5f38010770 tx=0x7f5f380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f3f7fe700 1 -- 172.21.15.80:0/1538927172 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3800a220 con 0x7f5f48074d00 2019-11-28T11:49:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f4c8cf700 1 -- 172.21.15.80:0/1538927172 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f48079660 con 0x7f5f48074d00 2019-11-28T11:49:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f3f7fe700 1 -- 172.21.15.80:0/1538927172 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f3800a8f0 con 0x7f5f48074d00 2019-11-28T11:49:24.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.804+0000 7f5f4c8cf700 1 -- 172.21.15.80:0/1538927172 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f480792e0 con 0x7f5f48074d00 2019-11-28T11:49:24.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.805+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1538927172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f48074d00 0x7f5f4807aa20 secure :-1 s=THROTTLE_DONE pgs=2021 cs=0 l=1 rx=0x7f5f38010770 tx=0x7f5f380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.805+0000 7f5f3f7fe700 1 -- 172.21.15.80:0/1538927172 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5f38009920 con 0x7f5f48074d00 2019-11-28T11:49:24.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.805+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1538927172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f48074d00 0x7f5f4807aa20 secure :-1 s=THROTTLE_DONE pgs=2021 cs=0 l=1 rx=0x7f5f38010770 tx=0x7f5f380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.805+0000 7f5f3f7fe700 1 --2- 172.21.15.80:0/1538927172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f2c018730 0x7f5f2c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:24.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.805+0000 7f5f3f7fe700 1 -- 172.21.15.80:0/1538927172 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f5f38031e40 con 0x7f5f48074d00 2019-11-28T11:49:24.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.805+0000 7f5f4659c700 1 --2- 172.21.15.80:0/1538927172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f2c018730 0x7f5f2c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:24.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.805+0000 7f5f4659c700 1 --2- 172.21.15.80:0/1538927172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f2c018730 0x7f5f2c01abc0 crc :-1 s=READY pgs=819 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:24.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.812+0000 7f5f4c8cf700 1 -- 172.21.15.80:0/1538927172 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f48079660 con 0x7f5f48074d00 2019-11-28T11:49:24.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.816+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1538927172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f48074d00 0x7f5f4807aa20 secure :-1 s=THROTTLE_DONE pgs=2021 cs=0 l=1 rx=0x7f5f38010770 tx=0x7f5f380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:24.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.816+0000 7f5f3f7fe700 1 -- 172.21.15.80:0/1538927172 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5f3802e140 con 0x7f5f48074d00 2019-11-28T11:49:25.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:24.981+0000 7f5f4c8cf700 1 -- 172.21.15.80:0/1538927172 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5f480792e0 con 0x7f5f48074d00 2019-11-28T11:49:25.310 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:49:25.315 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:49:25.320 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:49:25.326 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:49:25.330 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:49:25.337 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:49:25.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.743+0000 7f5f46d9d700 1 --2- 172.21.15.80:0/1538927172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f48074d00 0x7f5f4807aa20 secure :-1 s=THROTTLE_DONE pgs=2021 cs=0 l=1 rx=0x7f5f38010770 tx=0x7f5f380105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:25.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.743+0000 7f5f3f7fe700 1 -- 172.21.15.80:0/1538927172 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v118) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5f38009e20 con 0x7f5f48074d00 2019-11-28T11:49:25.792 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:49:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.748+0000 7f5f4c8cf700 1 -- 172.21.15.80:0/1538927172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f2c018730 msgr2=0x7f5f2c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.748+0000 7f5f4c8cf700 1 --2- 172.21.15.80:0/1538927172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f2c018730 0x7f5f2c01abc0 crc :-1 s=READY pgs=819 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.748+0000 7f5f4c8cf700 1 -- 172.21.15.80:0/1538927172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f48074d00 msgr2=0x7f5f4807aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.748+0000 7f5f4c8cf700 1 --2- 172.21.15.80:0/1538927172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f48074d00 0x7f5f4807aa20 secure :-1 s=READY pgs=2021 cs=0 l=1 rx=0x7f5f38010770 tx=0x7f5f380105f0).stop 2019-11-28T11:49:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.748+0000 7f5f4c8cf700 1 -- 172.21.15.80:0/1538927172 shutdown_connections 2019-11-28T11:49:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.748+0000 7f5f4c8cf700 1 --2- 172.21.15.80:0/1538927172 >> v2:172.21.15.174:3300/0 conn(0x7f5f4807bba0 0x7f5f48167c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.748+0000 7f5f4c8cf700 1 --2- 172.21.15.80:0/1538927172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f2c018730 0x7f5f2c01abc0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.748+0000 7f5f4c8cf700 1 --2- 172.21.15.80:0/1538927172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5f48074d00 0x7f5f4807aa20 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.749+0000 7f5f4c8cf700 1 -- 172.21.15.80:0/1538927172 shutdown_connections 2019-11-28T11:49:25.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.749+0000 7f5f4c8cf700 1 -- 172.21.15.80:0/1538927172 wait complete. 2019-11-28T11:49:25.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.749+0000 7f5f4c8cf700 1 -- 172.21.15.80:0/1538927172 >> 172.21.15.80:0/1538927172 conn(0x7f5f4813fa50 msgr2=0x7f5f4807c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:25.810 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:49:25.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.883+0000 7f9d7998a700 1 Processor -- start 2019-11-28T11:49:25.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.883+0000 7f9d7998a700 1 -- start start 2019-11-28T11:49:25.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.884+0000 7f9d7998a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9d7406c0a0 0x7f9d74072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:25.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.884+0000 7f9d7998a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d740734e0 0x7f9d74071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:25.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.884+0000 7f9d7998a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d74072360 0x7f9d74072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:25.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.884+0000 7f9d7998a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7406fd60 con 0x7f9d74072360 2019-11-28T11:49:25.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.884+0000 7f9d7998a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d74070030 con 0x7f9d7406c0a0 2019-11-28T11:49:25.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.884+0000 7f9d7998a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7406f330 con 0x7f9d740734e0 2019-11-28T11:49:25.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.884+0000 7f9d73fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d74072360 0x7f9d74072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:25.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.884+0000 7f9d73fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d74072360 0x7f9d74072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41884/0 (socket says 172.21.15.80:41884) 2019-11-28T11:49:25.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.884+0000 7f9d73fff700 1 -- 172.21.15.80:0/3525484680 learned_addr learned my addr 172.21.15.80:0/3525484680 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:25.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.884+0000 7f9d737fe700 1 --2- 172.21.15.80:0/3525484680 >> v2:172.21.15.174:3300/0 conn(0x7f9d7406c0a0 0x7f9d74072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:25.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.884+0000 7f9d72ffd700 1 --2- 172.21.15.80:0/3525484680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d740734e0 0x7f9d74071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:25.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d73fff700 1 -- 172.21.15.80:0/3525484680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d740734e0 msgr2=0x7f9d74071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:25.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d73fff700 1 --2- 172.21.15.80:0/3525484680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d740734e0 0x7f9d74071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:25.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d73fff700 1 -- 172.21.15.80:0/3525484680 >> v2:172.21.15.174:3300/0 conn(0x7f9d7406c0a0 msgr2=0x7f9d74072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:25.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d73fff700 1 --2- 172.21.15.80:0/3525484680 >> v2:172.21.15.174:3300/0 conn(0x7f9d7406c0a0 0x7f9d74072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d73fff700 1 -- 172.21.15.80:0/3525484680 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d740706c0 con 0x7f9d74072360 2019-11-28T11:49:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d737fe700 1 --2- 172.21.15.80:0/3525484680 >> v2:172.21.15.174:3300/0 conn(0x7f9d7406c0a0 0x7f9d74072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d73fff700 1 --2- 172.21.15.80:0/3525484680 >> v2:172.21.15.80:3300/0 conn(0x7f9d74072360 0x7f9d74072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9d6c00fa30 tx=0x7f9d6c00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d73fff700 1 --2- 172.21.15.80:0/3525484680 >> v2:172.21.15.80:3300/0 conn(0x7f9d74072360 0x7f9d74072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9d6c00fa30 tx=0x7f9d6c00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d73fff700 1 --2- 172.21.15.80:0/3525484680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d74072360 0x7f9d74072800 secure :-1 s=READY pgs=2022 cs=0 l=1 rx=0x7f9d6c00fa30 tx=0x7f9d6c00fdd0).ready entity=mon.0 client_cookie=1a209251384a5c83 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d73fff700 1 --2- 172.21.15.80:0/3525484680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d74072360 0x7f9d74072800 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7f9d6c00fa30 tx=0x7f9d6c00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:25.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d73fff700 1 --2- 172.21.15.80:0/3525484680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d74072360 0x7f9d74072800 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7f9d6c00fa30 tx=0x7f9d6c00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d727fc700 1 -- 172.21.15.80:0/3525484680 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d6c001460 con 0x7f9d74072360 2019-11-28T11:49:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d73fff700 1 --2- 172.21.15.80:0/3525484680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d74072360 0x7f9d74072800 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7f9d6c00fa30 tx=0x7f9d6c00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d727fc700 1 -- 172.21.15.80:0/3525484680 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c000f10 con 0x7f9d74072360 2019-11-28T11:49:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d727fc700 1 -- 172.21.15.80:0/3525484680 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d6c001a40 con 0x7f9d74072360 2019-11-28T11:49:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d7998a700 1 -- 172.21.15.80:0/3525484680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d74072360 msgr2=0x7f9d74072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:25.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.885+0000 7f9d7998a700 1 --2- 172.21.15.80:0/3525484680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d74072360 0x7f9d74072800 secure :-1 s=READY pgs=2022 cs=0 l=1 rx=0x7f9d6c00fa30 tx=0x7f9d6c00fdd0).stop 2019-11-28T11:49:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.886+0000 7f9d7998a700 1 -- 172.21.15.80:0/3525484680 shutdown_connections 2019-11-28T11:49:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.886+0000 7f9d7998a700 1 --2- 172.21.15.80:0/3525484680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d74072360 0x7f9d74072800 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.886+0000 7f9d7998a700 1 --2- 172.21.15.80:0/3525484680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d740734e0 0x7f9d74071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.886+0000 7f9d7998a700 1 --2- 172.21.15.80:0/3525484680 >> v2:172.21.15.174:3300/0 conn(0x7f9d7406c0a0 0x7f9d74072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.886+0000 7f9d7998a700 1 -- 172.21.15.80:0/3525484680 shutdown_connections 2019-11-28T11:49:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.886+0000 7f9d7998a700 1 -- 172.21.15.80:0/3525484680 wait complete. 2019-11-28T11:49:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.886+0000 7f9d7998a700 1 -- 172.21.15.80:0/3525484680 >> 172.21.15.80:0/3525484680 conn(0x7f9d74061cf0 msgr2=0x7f9d74064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.888+0000 7f9d7998a700 1 Processor -- start 2019-11-28T11:49:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.888+0000 7f9d7998a700 1 -- start start 2019-11-28T11:49:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.889+0000 7f9d7998a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d7413dc00 0x7f9d74109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.889+0000 7f9d7998a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d741312c0 con 0x7f9d741094e0 2019-11-28T11:49:25.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.889+0000 7f9d7998a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d74104010 con 0x7f9d7410a3a0 2019-11-28T11:49:25.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.889+0000 7f9d7998a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d74105830 con 0x7f9d7413dc00 2019-11-28T11:49:25.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.889+0000 7f9d737fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d7413dc00 0x7f9d74109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:25.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.889+0000 7f9d737fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d7413dc00 0x7f9d74109e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41888/0 (socket says 172.21.15.80:41888) 2019-11-28T11:49:25.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.889+0000 7f9d737fe700 1 -- 172.21.15.80:0/410113086 learned_addr learned my addr 172.21.15.80:0/410113086 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:25.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.889+0000 7f9d737fe700 1 -- 172.21.15.80:0/410113086 >> v1:172.21.15.174:6789/0 conn(0x7f9d7410a3a0 legacy=0x7f9d74108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:25.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.890+0000 7f9d737fe700 1 -- 172.21.15.80:0/410113086 >> v1:172.21.15.80:6789/0 conn(0x7f9d741094e0 legacy=0x7f9d74167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:25.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.890+0000 7f9d737fe700 1 -- 172.21.15.80:0/410113086 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d74106190 con 0x7f9d7413dc00 2019-11-28T11:49:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.890+0000 7f9d6bfff700 1 -- 172.21.15.80:0/410113086 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3040297812 0 0) 0x7f9d6c000f10 con 0x7f9d741094e0 2019-11-28T11:49:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.890+0000 7f9d737fe700 1 --2- 172.21.15.80:0/410113086 >> v2:172.21.15.80:3300/0 conn(0x7f9d7413dc00 0x7f9d74109e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9d64010410 tx=0x7f9d640107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:25.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.890+0000 7f9d737fe700 1 --2- 172.21.15.80:0/410113086 >> v2:172.21.15.80:3300/0 conn(0x7f9d7413dc00 0x7f9d74109e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9d64010410 tx=0x7f9d640107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:25.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.890+0000 7f9d737fe700 1 --2- 172.21.15.80:0/410113086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d7413dc00 0x7f9d74109e60 secure :-1 s=READY pgs=2024 cs=0 l=1 rx=0x7f9d64010410 tx=0x7f9d640107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:25.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.890+0000 7f9d737fe700 1 --2- 172.21.15.80:0/410113086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d7413dc00 0x7f9d74109e60 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7f9d64010410 tx=0x7f9d640107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:25.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.890+0000 7f9d6bfff700 1 -- 172.21.15.80:0/410113086 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d64000960 con 0x7f9d7413dc00 2019-11-28T11:49:25.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.890+0000 7f9d737fe700 1 --2- 172.21.15.80:0/410113086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d7413dc00 0x7f9d74109e60 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7f9d64010410 tx=0x7f9d640107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:25.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.890+0000 7f9d737fe700 1 --2- 172.21.15.80:0/410113086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d7413dc00 0x7f9d74109e60 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7f9d64010410 tx=0x7f9d640107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:25.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.890+0000 7f9d6bfff700 1 -- 172.21.15.80:0/410113086 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6400db40 con 0x7f9d7413dc00 2019-11-28T11:49:25.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.890+0000 7f9d7998a700 1 -- 172.21.15.80:0/410113086 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d74106510 con 0x7f9d7413dc00 2019-11-28T11:49:25.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.890+0000 7f9d6bfff700 1 -- 172.21.15.80:0/410113086 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d6400e290 con 0x7f9d7413dc00 2019-11-28T11:49:25.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.890+0000 7f9d7998a700 1 -- 172.21.15.80:0/410113086 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d74106190 con 0x7f9d7413dc00 2019-11-28T11:49:25.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.890+0000 7f9d737fe700 1 --2- 172.21.15.80:0/410113086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d7413dc00 0x7f9d74109e60 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7f9d64010410 tx=0x7f9d640107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:25.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.891+0000 7f9d6bfff700 1 -- 172.21.15.80:0/410113086 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9d64009580 con 0x7f9d7413dc00 2019-11-28T11:49:25.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.891+0000 7f9d737fe700 1 --2- 172.21.15.80:0/410113086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d7413dc00 0x7f9d74109e60 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7f9d64010410 tx=0x7f9d640107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:25.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.891+0000 7f9d6bfff700 1 --2- 172.21.15.80:0/410113086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d4c018730 0x7f9d4c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:25.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.891+0000 7f9d6bfff700 1 -- 172.21.15.80:0/410113086 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f9d64031b40 con 0x7f9d7413dc00 2019-11-28T11:49:25.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.891+0000 7f9d72ffd700 1 --2- 172.21.15.80:0/410113086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d4c018730 0x7f9d4c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:25.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.891+0000 7f9d72ffd700 1 --2- 172.21.15.80:0/410113086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d4c018730 0x7f9d4c01abc0 crc :-1 s=READY pgs=820 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:25.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.898+0000 7f9d7998a700 1 -- 172.21.15.80:0/410113086 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d74106510 con 0x7f9d7413dc00 2019-11-28T11:49:25.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.902+0000 7f9d737fe700 1 --2- 172.21.15.80:0/410113086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d7413dc00 0x7f9d74109e60 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7f9d64010410 tx=0x7f9d640107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:25.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:25.902+0000 7f9d6bfff700 1 -- 172.21.15.80:0/410113086 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9d64026b30 con 0x7f9d7413dc00 2019-11-28T11:49:26.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.073+0000 7f9d7998a700 1 -- 172.21.15.80:0/410113086 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d74106190 con 0x7f9d7413dc00 2019-11-28T11:49:26.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.073+0000 7f9d737fe700 1 --2- 172.21.15.80:0/410113086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d7413dc00 0x7f9d74109e60 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7f9d64010410 tx=0x7f9d640107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.073+0000 7f9d6bfff700 1 -- 172.21.15.80:0/410113086 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f9d64026b30 con 0x7f9d7413dc00 2019-11-28T11:49:26.123 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 118 2019-11-28T11:49:26.123 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:26.123 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":118,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":118,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:48:37.109829+0000","modified":"2019-11-28T11:49:25.741218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":154,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2019-11-28T11:49:26.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.076+0000 7f9d7998a700 1 -- 172.21.15.80:0/410113086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d4c018730 msgr2=0x7f9d4c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:26.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.076+0000 7f9d7998a700 1 --2- 172.21.15.80:0/410113086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d4c018730 0x7f9d4c01abc0 crc :-1 s=READY pgs=820 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:26.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.076+0000 7f9d7998a700 1 -- 172.21.15.80:0/410113086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d7413dc00 msgr2=0x7f9d74109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:26.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.076+0000 7f9d7998a700 1 --2- 172.21.15.80:0/410113086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d7413dc00 0x7f9d74109e60 secure :-1 s=READY pgs=2024 cs=0 l=1 rx=0x7f9d64010410 tx=0x7f9d640107b0).stop 2019-11-28T11:49:26.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.076+0000 7f9d7998a700 1 -- 172.21.15.80:0/410113086 shutdown_connections 2019-11-28T11:49:26.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.076+0000 7f9d7998a700 1 --2- 172.21.15.80:0/410113086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9d4c018730 0x7f9d4c01abc0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:26.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.076+0000 7f9d7998a700 1 --2- 172.21.15.80:0/410113086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d7413dc00 0x7f9d74109e60 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:26.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.076+0000 7f9d7998a700 1 -- 172.21.15.80:0/410113086 shutdown_connections 2019-11-28T11:49:26.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.076+0000 7f9d7998a700 1 -- 172.21.15.80:0/410113086 wait complete. 2019-11-28T11:49:26.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.076+0000 7f9d7998a700 1 -- 172.21.15.80:0/410113086 >> 172.21.15.80:0/410113086 conn(0x7f9d7411bfc0 msgr2=0x7f9d74141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:26.136 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:49:26.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.213+0000 7f6640f49700 1 Processor -- start 2019-11-28T11:49:26.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.213+0000 7f6640f49700 1 -- start start 2019-11-28T11:49:26.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.214+0000 7f6640f49700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f663c06c0a0 0x7f663c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:26.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.214+0000 7f6640f49700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f663c0734e0 0x7f663c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:26.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.214+0000 7f6640f49700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c06db00 con 0x7f663c072360 2019-11-28T11:49:26.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.214+0000 7f6640f49700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c06f330 con 0x7f663c0734e0 2019-11-28T11:49:26.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.214+0000 7f6640f49700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0706c0 con 0x7f663c06c0a0 2019-11-28T11:49:26.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.214+0000 7f663a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f663c0734e0 0x7f663c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:26.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.214+0000 7f663b59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f663c072360 0x7f663c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41212/0 (socket says 172.21.15.80:41212) 2019-11-28T11:49:26.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.214+0000 7f663b59e700 1 -- 172.21.15.80:0/1287934935 learned_addr learned my addr 172.21.15.80:0/1287934935 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:26.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f663ad9d700 1 --2- 172.21.15.80:0/1287934935 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f663c06c0a0 0x7f663c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:26.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f663a59c700 1 -- 172.21.15.80:0/1287934935 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f663c06c0a0 msgr2=0x7f663c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:26.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f663a59c700 1 --2- 172.21.15.80:0/1287934935 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f663c06c0a0 0x7f663c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:26.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f663a59c700 1 -- 172.21.15.80:0/1287934935 >> v1:172.21.15.80:6789/0 conn(0x7f663c072360 legacy=0x7f663c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:26.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f663a59c700 1 -- 172.21.15.80:0/1287934935 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c070a40 con 0x7f663c0734e0 2019-11-28T11:49:26.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f6639d9b700 1 -- 172.21.15.80:0/1287934935 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684495783 0 0) 0x7f6634001150 con 0x7f663c072360 2019-11-28T11:49:26.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f663a59c700 1 --2- 172.21.15.80:0/1287934935 >> v2:172.21.15.80:3300/0 conn(0x7f663c0734e0 0x7f663c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f662400af50 tx=0x7f662400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f663a59c700 1 --2- 172.21.15.80:0/1287934935 >> v2:172.21.15.80:3300/0 conn(0x7f663c0734e0 0x7f663c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f662400af50 tx=0x7f662400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f663a59c700 1 --2- 172.21.15.80:0/1287934935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c0734e0 0x7f663c071e20 secure :-1 s=READY pgs=2026 cs=0 l=1 rx=0x7f662400af50 tx=0x7f662400b6e0).ready entity=mon.0 client_cookie=eedd2a58389e54e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:26.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f663a59c700 1 --2- 172.21.15.80:0/1287934935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c0734e0 0x7f663c071e20 secure :-1 s=THROTTLE_DONE pgs=2026 cs=0 l=1 rx=0x7f662400af50 tx=0x7f662400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f6639d9b700 1 -- 172.21.15.80:0/1287934935 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6624007210 con 0x7f663c0734e0 2019-11-28T11:49:26.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f663a59c700 1 --2- 172.21.15.80:0/1287934935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c0734e0 0x7f663c071e20 secure :-1 s=THROTTLE_DONE pgs=2026 cs=0 l=1 rx=0x7f662400af50 tx=0x7f662400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f663a59c700 1 --2- 172.21.15.80:0/1287934935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c0734e0 0x7f663c071e20 secure :-1 s=THROTTLE_DONE pgs=2026 cs=0 l=1 rx=0x7f662400af50 tx=0x7f662400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f6639d9b700 1 -- 172.21.15.80:0/1287934935 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66240099b0 con 0x7f663c0734e0 2019-11-28T11:49:26.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f6639d9b700 1 -- 172.21.15.80:0/1287934935 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f662400a080 con 0x7f663c0734e0 2019-11-28T11:49:26.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f6640f49700 1 -- 172.21.15.80:0/1287934935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c0734e0 msgr2=0x7f663c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:26.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.215+0000 7f6640f49700 1 --2- 172.21.15.80:0/1287934935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c0734e0 0x7f663c071e20 secure :-1 s=READY pgs=2026 cs=0 l=1 rx=0x7f662400af50 tx=0x7f662400b6e0).stop 2019-11-28T11:49:26.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.216+0000 7f6640f49700 1 -- 172.21.15.80:0/1287934935 shutdown_connections 2019-11-28T11:49:26.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.216+0000 7f6640f49700 1 --2- 172.21.15.80:0/1287934935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c0734e0 0x7f663c071e20 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:26.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.216+0000 7f6640f49700 1 --2- 172.21.15.80:0/1287934935 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f663c06c0a0 0x7f663c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:26.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.216+0000 7f6640f49700 1 -- 172.21.15.80:0/1287934935 shutdown_connections 2019-11-28T11:49:26.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.216+0000 7f6640f49700 1 -- 172.21.15.80:0/1287934935 wait complete. 2019-11-28T11:49:26.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.216+0000 7f6640f49700 1 -- 172.21.15.80:0/1287934935 >> 172.21.15.80:0/1287934935 conn(0x7f663c061cf0 msgr2=0x7f663c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:26.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.218+0000 7f6640f49700 1 Processor -- start 2019-11-28T11:49:26.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.218+0000 7f6640f49700 1 -- start start 2019-11-28T11:49:26.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.219+0000 7f6640f49700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f663c13e320 0x7f663c13e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:26.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.219+0000 7f6640f49700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f663c12a3c0 0x7f663c12a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:26.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.219+0000 7f6640f49700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c139e00 con 0x7f663c15fdf0 2019-11-28T11:49:26.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.219+0000 7f6640f49700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c108820 con 0x7f663c12a3c0 2019-11-28T11:49:26.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.219+0000 7f6640f49700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c108af0 con 0x7f663c13e320 2019-11-28T11:49:26.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.219+0000 7f663ad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f663c15fdf0 0x7f663c12b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41218/0 (socket says 172.21.15.80:41218) 2019-11-28T11:49:26.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.219+0000 7f663ad9d700 1 -- 172.21.15.80:0/474673909 learned_addr learned my addr 172.21.15.80:0/474673909 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:26.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.219+0000 7f663b59e700 1 --2- 172.21.15.80:0/474673909 >> v2:172.21.15.80:3300/0 conn(0x7f663c12a3c0 0x7f663c12a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:26.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f663a59c700 1 --2- 172.21.15.80:0/474673909 >> v2:172.21.15.174:3300/0 conn(0x7f663c13e320 0x7f663c13e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:26.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f663b59e700 1 -- 172.21.15.80:0/474673909 >> v2:172.21.15.174:3300/0 conn(0x7f663c13e320 msgr2=0x7f663c13e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:26.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f663b59e700 1 --2- 172.21.15.80:0/474673909 >> v2:172.21.15.174:3300/0 conn(0x7f663c13e320 0x7f663c13e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:26.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f663b59e700 1 -- 172.21.15.80:0/474673909 >> v1:172.21.15.80:6789/0 conn(0x7f663c15fdf0 legacy=0x7f663c12b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:26.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f663b59e700 1 -- 172.21.15.80:0/474673909 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c10a8c0 con 0x7f663c12a3c0 2019-11-28T11:49:26.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f66337fe700 1 -- 172.21.15.80:0/474673909 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716091421 0 0) 0x7f662c001430 con 0x7f663c15fdf0 2019-11-28T11:49:26.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f663b59e700 1 --2- 172.21.15.80:0/474673909 >> v2:172.21.15.80:3300/0 conn(0x7f663c12a3c0 0x7f663c12a820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f66340103a0 tx=0x7f663400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f663b59e700 1 --2- 172.21.15.80:0/474673909 >> v2:172.21.15.80:3300/0 conn(0x7f663c12a3c0 0x7f663c12a820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f66340103a0 tx=0x7f663400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f663b59e700 1 --2- 172.21.15.80:0/474673909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c12a3c0 0x7f663c12a820 secure :-1 s=READY pgs=2028 cs=0 l=1 rx=0x7f66340103a0 tx=0x7f663400b2e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:26.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f663b59e700 1 --2- 172.21.15.80:0/474673909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c12a3c0 0x7f663c12a820 secure :-1 s=THROTTLE_DONE pgs=2028 cs=0 l=1 rx=0x7f66340103a0 tx=0x7f663400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f66337fe700 1 -- 172.21.15.80:0/474673909 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6634001570 con 0x7f663c12a3c0 2019-11-28T11:49:26.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f663b59e700 1 --2- 172.21.15.80:0/474673909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c12a3c0 0x7f663c12a820 secure :-1 s=THROTTLE_DONE pgs=2028 cs=0 l=1 rx=0x7f66340103a0 tx=0x7f663400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f6640f49700 1 -- 172.21.15.80:0/474673909 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c10a8c0 con 0x7f663c12a3c0 2019-11-28T11:49:26.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f66337fe700 1 -- 172.21.15.80:0/474673909 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66340009e0 con 0x7f663c12a3c0 2019-11-28T11:49:26.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f663b59e700 1 --2- 172.21.15.80:0/474673909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c12a3c0 0x7f663c12a820 secure :-1 s=THROTTLE_DONE pgs=2028 cs=0 l=1 rx=0x7f66340103a0 tx=0x7f663400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f66337fe700 1 -- 172.21.15.80:0/474673909 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6634001610 con 0x7f663c12a3c0 2019-11-28T11:49:26.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f6640f49700 1 -- 172.21.15.80:0/474673909 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c10a8c0 con 0x7f663c12a3c0 2019-11-28T11:49:26.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.220+0000 7f663b59e700 1 --2- 172.21.15.80:0/474673909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c12a3c0 0x7f663c12a820 secure :-1 s=THROTTLE_DONE pgs=2028 cs=0 l=1 rx=0x7f66340103a0 tx=0x7f663400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.221+0000 7f66337fe700 1 -- 172.21.15.80:0/474673909 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6634001190 con 0x7f663c12a3c0 2019-11-28T11:49:26.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.221+0000 7f663b59e700 1 --2- 172.21.15.80:0/474673909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c12a3c0 0x7f663c12a820 secure :-1 s=THROTTLE_DONE pgs=2028 cs=0 l=1 rx=0x7f66340103a0 tx=0x7f663400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.221+0000 7f66337fe700 1 --2- 172.21.15.80:0/474673909 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6614018730 0x7f661401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:26.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.221+0000 7f66337fe700 1 -- 172.21.15.80:0/474673909 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f6634031a20 con 0x7f663c12a3c0 2019-11-28T11:49:26.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.221+0000 7f663ad9d700 1 --2- 172.21.15.80:0/474673909 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6614018730 0x7f661401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:26.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.221+0000 7f663ad9d700 1 --2- 172.21.15.80:0/474673909 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6614018730 0x7f661401abc0 crc :-1 s=READY pgs=821 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:26.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.228+0000 7f6640f49700 1 -- 172.21.15.80:0/474673909 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663c109180 con 0x7f663c12a3c0 2019-11-28T11:49:26.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.232+0000 7f663b59e700 1 --2- 172.21.15.80:0/474673909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c12a3c0 0x7f663c12a820 secure :-1 s=THROTTLE_DONE pgs=2028 cs=0 l=1 rx=0x7f66340103a0 tx=0x7f663400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.232+0000 7f66337fe700 1 -- 172.21.15.80:0/474673909 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6634000f80 con 0x7f663c12a3c0 2019-11-28T11:49:26.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.408+0000 7f6640f49700 1 -- 172.21.15.80:0/474673909 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f663c109500 con 0x7f663c12a3c0 2019-11-28T11:49:26.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.750+0000 7f663b59e700 1 --2- 172.21.15.80:0/474673909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c12a3c0 0x7f663c12a820 secure :-1 s=THROTTLE_DONE pgs=2028 cs=0 l=1 rx=0x7f66340103a0 tx=0x7f663400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.750+0000 7f66337fe700 1 -- 172.21.15.80:0/474673909 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v119) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6634001190 con 0x7f663c12a3c0 2019-11-28T11:49:26.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.774+0000 7f6640f49700 1 -- 172.21.15.80:0/474673909 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6614018730 msgr2=0x7f661401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:26.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.774+0000 7f6640f49700 1 --2- 172.21.15.80:0/474673909 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6614018730 0x7f661401abc0 crc :-1 s=READY pgs=821 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:26.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.774+0000 7f6640f49700 1 -- 172.21.15.80:0/474673909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c12a3c0 msgr2=0x7f663c12a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:26.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.774+0000 7f6640f49700 1 --2- 172.21.15.80:0/474673909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c12a3c0 0x7f663c12a820 secure :-1 s=READY pgs=2028 cs=0 l=1 rx=0x7f66340103a0 tx=0x7f663400b2e0).stop 2019-11-28T11:49:26.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.774+0000 7f6640f49700 1 -- 172.21.15.80:0/474673909 shutdown_connections 2019-11-28T11:49:26.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.774+0000 7f6640f49700 1 --2- 172.21.15.80:0/474673909 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6614018730 0x7f661401abc0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:26.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.774+0000 7f6640f49700 1 --2- 172.21.15.80:0/474673909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f663c12a3c0 0x7f663c12a820 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:26.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.774+0000 7f6640f49700 1 --2- 172.21.15.80:0/474673909 >> v2:172.21.15.174:3300/0 conn(0x7f663c13e320 0x7f663c13e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:26.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.774+0000 7f6640f49700 1 -- 172.21.15.80:0/474673909 shutdown_connections 2019-11-28T11:49:26.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.774+0000 7f6640f49700 1 -- 172.21.15.80:0/474673909 wait complete. 2019-11-28T11:49:26.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.774+0000 7f6640f49700 1 -- 172.21.15.80:0/474673909 >> 172.21.15.80:0/474673909 conn(0x7f663c127dc0 msgr2=0x7f663c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:26.832 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:49:26.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.907+0000 7fec24965700 1 Processor -- start 2019-11-28T11:49:26.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.907+0000 7fec24965700 1 -- start start 2019-11-28T11:49:26.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.908+0000 7fec24965700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fec2015f100 0x7fec2006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:26.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.908+0000 7fec24965700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec2006c2f0 0x7fec2006c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:26.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.908+0000 7fec24965700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2006db60 con 0x7fec2015ed10 2019-11-28T11:49:26.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.908+0000 7fec24965700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2006fe00 con 0x7fec2015f100 2019-11-28T11:49:26.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.908+0000 7fec24965700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec200700d0 con 0x7fec2006c2f0 2019-11-28T11:49:26.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.908+0000 7fec1ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fec2015ed10 0x7fec20073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41226/0 (socket says 172.21.15.80:41226) 2019-11-28T11:49:26.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.908+0000 7fec1ed9d700 1 -- 172.21.15.80:0/2293144181 learned_addr learned my addr 172.21.15.80:0/2293144181 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:26.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.908+0000 7fec1dd9b700 1 -- 172.21.15.80:0/2293144181 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908689225 0 0) 0x7fec10001150 con 0x7fec2015ed10 2019-11-28T11:49:26.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.908+0000 7fec1e59c700 1 --2- 172.21.15.80:0/2293144181 >> v2:172.21.15.174:3300/0 conn(0x7fec2015f100 0x7fec2006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:26.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.908+0000 7fec1f59e700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec2006c2f0 0x7fec2006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:26.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.908+0000 7fec1dd9b700 1 -- 172.21.15.80:0/2293144181 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec00002e80 con 0x7fec2015ed10 2019-11-28T11:49:26.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 -- 172.21.15.80:0/2293144181 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3897638058 0 0) 0x7fec10001130 con 0x7fec2015ed10 2019-11-28T11:49:26.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 -- 172.21.15.80:0/2293144181 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec2006c2f0 msgr2=0x7fec2006c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:26.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec2006c2f0 0x7fec2006c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:26.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 -- 172.21.15.80:0/2293144181 >> v2:172.21.15.174:3300/0 conn(0x7fec2015f100 msgr2=0x7fec2006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:26.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 --2- 172.21.15.80:0/2293144181 >> v2:172.21.15.174:3300/0 conn(0x7fec2015f100 0x7fec2006bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:26.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 -- 172.21.15.80:0/2293144181 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec20070760 con 0x7fec2015ed10 2019-11-28T11:49:26.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 -- 172.21.15.80:0/2293144181 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fec100016c0 con 0x7fec2015ed10 2019-11-28T11:49:26.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 -- 172.21.15.80:0/2293144181 >> v1:172.21.15.80:6789/0 conn(0x7fec2015ed10 legacy=0x7fec20073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:26.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec000479e0 0x7fec00049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:26.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec0004a5f0 0x7fec0004ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:26.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0004d270 0x7fec0004f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:26.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 -- 172.21.15.80:0/2293144181 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0004ff50 con 0x7fec0004d270 2019-11-28T11:49:26.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 -- 172.21.15.80:0/2293144181 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec00050140 con 0x7fec000479e0 2019-11-28T11:49:26.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 -- 172.21.15.80:0/2293144181 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec00050370 con 0x7fec0004a5f0 2019-11-28T11:49:26.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1f59e700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0004d270 0x7fec0004f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:26.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1ed9d700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec000479e0 0x7fec00049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:26.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1e59c700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec0004a5f0 0x7fec0004ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:26.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1f59e700 1 -- 172.21.15.80:0/2293144181 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec0004a5f0 msgr2=0x7fec0004ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:26.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1f59e700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec0004a5f0 0x7fec0004ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:26.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1f59e700 1 -- 172.21.15.80:0/2293144181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec000479e0 msgr2=0x7fec00049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:26.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1f59e700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec000479e0 0x7fec00049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:26.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1f59e700 1 -- 172.21.15.80:0/2293144181 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec00050620 con 0x7fec0004d270 2019-11-28T11:49:26.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1f59e700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0004d270 0x7fec0004f740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fec180029a0 tx=0x7fec180028a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1f59e700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0004d270 0x7fec0004f740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fec180029a0 tx=0x7fec180028a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1f59e700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0004d270 0x7fec0004f740 secure :-1 s=READY pgs=2030 cs=0 l=1 rx=0x7fec180029a0 tx=0x7fec180028a0).ready entity=mon.0 client_cookie=da852597ccbd1693 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:26.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1f59e700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0004d270 0x7fec0004f740 secure :-1 s=THROTTLE_DONE pgs=2030 cs=0 l=1 rx=0x7fec180029a0 tx=0x7fec180028a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 -- 172.21.15.80:0/2293144181 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec18000a70 con 0x7fec0004d270 2019-11-28T11:49:26.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1f59e700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0004d270 0x7fec0004f740 secure :-1 s=THROTTLE_DONE pgs=2030 cs=0 l=1 rx=0x7fec180029a0 tx=0x7fec180028a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1f59e700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0004d270 0x7fec0004f740 secure :-1 s=THROTTLE_DONE pgs=2030 cs=0 l=1 rx=0x7fec180029a0 tx=0x7fec180028a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 -- 172.21.15.80:0/2293144181 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1800ec90 con 0x7fec0004d270 2019-11-28T11:49:26.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1dd9b700 1 -- 172.21.15.80:0/2293144181 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1800f360 con 0x7fec0004d270 2019-11-28T11:49:26.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec24965700 1 -- 172.21.15.80:0/2293144181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0004d270 msgr2=0x7fec0004f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:26.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec24965700 1 --2- 172.21.15.80:0/2293144181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec0004d270 0x7fec0004f740 secure :-1 s=READY pgs=2030 cs=0 l=1 rx=0x7fec180029a0 tx=0x7fec180028a0).stop 2019-11-28T11:49:26.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.909+0000 7fec1f59e700 1 -- 172.21.15.80:0/2293144181 reap_dead start 2019-11-28T11:49:26.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.910+0000 7fec24965700 1 -- 172.21.15.80:0/2293144181 shutdown_connections 2019-11-28T11:49:26.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.910+0000 7fec24965700 1 -- 172.21.15.80:0/2293144181 shutdown_connections 2019-11-28T11:49:26.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.910+0000 7fec24965700 1 -- 172.21.15.80:0/2293144181 wait complete. 2019-11-28T11:49:26.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.910+0000 7fec24965700 1 -- 172.21.15.80:0/2293144181 >> 172.21.15.80:0/2293144181 conn(0x7fec20061d20 msgr2=0x7fec200641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:26.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.913+0000 7fec24965700 1 Processor -- start 2019-11-28T11:49:26.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.913+0000 7fec24965700 1 -- start start 2019-11-28T11:49:26.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec24965700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fec20108630 0x7fec20151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:26.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec24965700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec20151740 0x7fec201502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:26.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec24965700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec20133a20 con 0x7fec20150820 2019-11-28T11:49:26.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec24965700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec20131980 con 0x7fec20108630 2019-11-28T11:49:26.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec24965700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec20131c50 con 0x7fec20151740 2019-11-28T11:49:26.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec1e59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec20151740 0x7fec201502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:26.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec1ed9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fec20108630 0x7fec20151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:26.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec1ed9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fec20108630 0x7fec20151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:56808/0 (socket says 172.21.15.80:56808) 2019-11-28T11:49:26.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec1ed9d700 1 -- 172.21.15.80:0/409178657 learned_addr learned my addr 172.21.15.80:0/409178657 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:26.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec1e59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec20151740 0x7fec201502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:44184/0 (socket says 172.21.15.80:44184) 2019-11-28T11:49:26.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec1e59c700 1 -- 172.21.15.80:0/409178657 >> v2:172.21.15.174:3300/0 conn(0x7fec20108630 msgr2=0x7fec20151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:26.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec1e59c700 1 --2- 172.21.15.80:0/409178657 >> v2:172.21.15.174:3300/0 conn(0x7fec20108630 0x7fec20151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:26.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec1e59c700 1 -- 172.21.15.80:0/409178657 >> v1:172.21.15.174:6789/0 conn(0x7fec20150820 legacy=0x7fec2012fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:26.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec1e59c700 1 -- 172.21.15.80:0/409178657 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec201322e0 con 0x7fec20151740 2019-11-28T11:49:26.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec1e59c700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec20151740 0x7fec201502e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec08010710 tx=0x7fec08010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec1e59c700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec20151740 0x7fec201502e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec08010710 tx=0x7fec08010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec1e59c700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec20151740 0x7fec201502e0 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7fec08010710 tx=0x7fec08010540).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:26.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec1e59c700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec20151740 0x7fec201502e0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fec08010710 tx=0x7fec08010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec177fe700 1 -- 172.21.15.80:0/409178657 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec08005500 con 0x7fec20151740 2019-11-28T11:49:26.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec1e59c700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec20151740 0x7fec201502e0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fec08010710 tx=0x7fec08010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec1e59c700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec20151740 0x7fec201502e0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fec08010710 tx=0x7fec08010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec177fe700 1 -- 172.21.15.80:0/409178657 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec080059c0 con 0x7fec20151740 2019-11-28T11:49:26.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec24965700 1 -- 172.21.15.80:0/409178657 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec20132660 con 0x7fec20151740 2019-11-28T11:49:26.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.914+0000 7fec177fe700 1 -- 172.21.15.80:0/409178657 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec08005500 con 0x7fec20151740 2019-11-28T11:49:26.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.915+0000 7fec24965700 1 -- 172.21.15.80:0/409178657 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec201322e0 con 0x7fec20151740 2019-11-28T11:49:26.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.915+0000 7fec1e59c700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec20151740 0x7fec201502e0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fec08010710 tx=0x7fec08010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.915+0000 7fec177fe700 1 -- 172.21.15.80:0/409178657 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fec08005bb0 con 0x7fec20151740 2019-11-28T11:49:26.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.915+0000 7fec1e59c700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec20151740 0x7fec201502e0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fec08010710 tx=0x7fec08010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.915+0000 7fec177fe700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7febf8018730 0x7febf801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:26.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.915+0000 7fec177fe700 1 -- 172.21.15.80:0/409178657 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fec08031db0 con 0x7fec20151740 2019-11-28T11:49:26.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.915+0000 7fec1ed9d700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7febf8018730 0x7febf801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:26.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.916+0000 7fec1ed9d700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7febf8018730 0x7febf801abc0 crc :-1 s=READY pgs=822 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:26.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.922+0000 7fec24965700 1 -- 172.21.15.80:0/409178657 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec20132660 con 0x7fec20151740 2019-11-28T11:49:26.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.926+0000 7fec1e59c700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec20151740 0x7fec201502e0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fec08010710 tx=0x7fec08010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:26.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:26.927+0000 7fec177fe700 1 -- 172.21.15.80:0/409178657 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fec080057b0 con 0x7fec20151740 2019-11-28T11:49:27.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.097+0000 7fec24965700 1 -- 172.21.15.80:0/409178657 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fec201322e0 con 0x7fec20151740 2019-11-28T11:49:27.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.758+0000 7fec1e59c700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec20151740 0x7fec201502e0 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fec08010710 tx=0x7fec08010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:27.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.758+0000 7fec177fe700 1 -- 172.21.15.80:0/409178657 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v156) v1 ==== 185+0+0 (secure 0 0 0) 0x7fec08005b90 con 0x7fec20151740 2019-11-28T11:49:27.809 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:49:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.764+0000 7fec24965700 1 -- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7febf8018730 msgr2=0x7febf801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:27.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.764+0000 7fec24965700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7febf8018730 0x7febf801abc0 crc :-1 s=READY pgs=822 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.764+0000 7fec24965700 1 -- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec20151740 msgr2=0x7fec201502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.764+0000 7fec24965700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec20151740 0x7fec201502e0 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7fec08010710 tx=0x7fec08010540).stop 2019-11-28T11:49:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.765+0000 7fec24965700 1 -- 172.21.15.80:0/409178657 shutdown_connections 2019-11-28T11:49:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.765+0000 7fec24965700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7febf8018730 0x7febf801abc0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.765+0000 7fec24965700 1 --2- 172.21.15.80:0/409178657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec20151740 0x7fec201502e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.765+0000 7fec24965700 1 --2- 172.21.15.80:0/409178657 >> v2:172.21.15.174:3300/0 conn(0x7fec20108630 0x7fec20151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:27.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.765+0000 7fec24965700 1 -- 172.21.15.80:0/409178657 shutdown_connections 2019-11-28T11:49:27.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.765+0000 7fec24965700 1 -- 172.21.15.80:0/409178657 wait complete. 2019-11-28T11:49:27.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.765+0000 7fec24965700 1 -- 172.21.15.80:0/409178657 >> 172.21.15.80:0/409178657 conn(0x7fec2014dbb0 msgr2=0x7fec20142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:27.825 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:49:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.914+0000 7fcd81045700 1 Processor -- start 2019-11-28T11:49:27.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.914+0000 7fcd81045700 1 -- start start 2019-11-28T11:49:27.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd81045700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd7c15ed10 0x7fcd7c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:27.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd81045700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd7c0734b0 0x7fcd7c0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:27.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd81045700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c06db60 con 0x7fcd7c073020 2019-11-28T11:49:27.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd81045700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c06fe00 con 0x7fcd7c15ed10 2019-11-28T11:49:27.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd81045700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0700d0 con 0x7fcd7c0734b0 2019-11-28T11:49:27.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd7b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd7c15ed10 0x7fcd7c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:27.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd7b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcd7c15ed10 0x7fcd7c15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41930/0 (socket says 172.21.15.80:41930) 2019-11-28T11:49:27.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd7b59e700 1 -- 172.21.15.80:0/3208313206 learned_addr learned my addr 172.21.15.80:0/3208313206 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:27.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd80844700 1 --2- 172.21.15.80:0/3208313206 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd7c0734b0 0x7fcd7c0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:27.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd7b59e700 1 -- 172.21.15.80:0/3208313206 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd7c0734b0 msgr2=0x7fcd7c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:27.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd7b59e700 1 --2- 172.21.15.80:0/3208313206 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd7c0734b0 0x7fcd7c0726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd7b59e700 1 -- 172.21.15.80:0/3208313206 >> v1:172.21.15.174:6789/0 conn(0x7fcd7c073020 legacy=0x7fcd7c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:28.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd7b59e700 1 -- 172.21.15.80:0/3208313206 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c070760 con 0x7fcd7c15ed10 2019-11-28T11:49:28.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd7b59e700 1 --2- 172.21.15.80:0/3208313206 >> v2:172.21.15.80:3300/0 conn(0x7fcd7c15ed10 0x7fcd7c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcd6c00f6c0 tx=0x7fcd6c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:28.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd7b59e700 1 --2- 172.21.15.80:0/3208313206 >> v2:172.21.15.80:3300/0 conn(0x7fcd7c15ed10 0x7fcd7c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcd6c00f6c0 tx=0x7fcd6c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:28.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd7b59e700 1 --2- 172.21.15.80:0/3208313206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd7c15ed10 0x7fcd7c15f100 secure :-1 s=READY pgs=2031 cs=0 l=1 rx=0x7fcd6c00f6c0 tx=0x7fcd6c00fa60).ready entity=mon.0 client_cookie=81e38a26fb7a350d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:28.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.915+0000 7fcd7b59e700 1 --2- 172.21.15.80:0/3208313206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd7c15ed10 0x7fcd7c15f100 secure :-1 s=THROTTLE_DONE pgs=2031 cs=0 l=1 rx=0x7fcd6c00f6c0 tx=0x7fcd6c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:28.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.916+0000 7fcd7b59e700 1 --2- 172.21.15.80:0/3208313206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd7c15ed10 0x7fcd7c15f100 secure :-1 s=THROTTLE_DONE pgs=2031 cs=0 l=1 rx=0x7fcd6c00f6c0 tx=0x7fcd6c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:28.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.916+0000 7fcd7a59c700 1 -- 172.21.15.80:0/3208313206 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd6c000960 con 0x7fcd7c15ed10 2019-11-28T11:49:28.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.916+0000 7fcd7b59e700 1 --2- 172.21.15.80:0/3208313206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd7c15ed10 0x7fcd7c15f100 secure :-1 s=THROTTLE_DONE pgs=2031 cs=0 l=1 rx=0x7fcd6c00f6c0 tx=0x7fcd6c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:28.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.916+0000 7fcd7a59c700 1 -- 172.21.15.80:0/3208313206 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c000c90 con 0x7fcd7c15ed10 2019-11-28T11:49:28.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.916+0000 7fcd7a59c700 1 -- 172.21.15.80:0/3208313206 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd6c0013a0 con 0x7fcd7c15ed10 2019-11-28T11:49:28.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.916+0000 7fcd81045700 1 -- 172.21.15.80:0/3208313206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd7c15ed10 msgr2=0x7fcd7c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:28.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.916+0000 7fcd81045700 1 --2- 172.21.15.80:0/3208313206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd7c15ed10 0x7fcd7c15f100 secure :-1 s=READY pgs=2031 cs=0 l=1 rx=0x7fcd6c00f6c0 tx=0x7fcd6c00fa60).stop 2019-11-28T11:49:28.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.916+0000 7fcd81045700 1 -- 172.21.15.80:0/3208313206 shutdown_connections 2019-11-28T11:49:28.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.916+0000 7fcd81045700 1 --2- 172.21.15.80:0/3208313206 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd7c0734b0 0x7fcd7c0726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:28.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.916+0000 7fcd81045700 1 --2- 172.21.15.80:0/3208313206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcd7c15ed10 0x7fcd7c15f100 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:28.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.916+0000 7fcd81045700 1 -- 172.21.15.80:0/3208313206 shutdown_connections 2019-11-28T11:49:28.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.916+0000 7fcd81045700 1 -- 172.21.15.80:0/3208313206 wait complete. 2019-11-28T11:49:28.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.916+0000 7fcd81045700 1 -- 172.21.15.80:0/3208313206 >> 172.21.15.80:0/3208313206 conn(0x7fcd7c061d20 msgr2=0x7fcd7c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:28.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.919+0000 7fcd81045700 1 Processor -- start 2019-11-28T11:49:28.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.919+0000 7fcd81045700 1 -- start start 2019-11-28T11:49:28.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd81045700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd7c10ed60 0x7fcd7c10f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:28.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd81045700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcd7c10f730 0x7fcd7c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:28.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd81045700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c10c250 con 0x7fcd7c10e970 2019-11-28T11:49:28.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd81045700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c10e430 con 0x7fcd7c10f730 2019-11-28T11:49:28.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd81045700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c105860 con 0x7fcd7c10ed60 2019-11-28T11:49:28.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd7b59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcd7c10e970 0x7fcd7c1087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41250/0 (socket says 172.21.15.80:41250) 2019-11-28T11:49:28.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd7b59e700 1 -- 172.21.15.80:0/1454635491 learned_addr learned my addr 172.21.15.80:0/1454635491 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:28.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd80844700 1 --2- 172.21.15.80:0/1454635491 >> v2:172.21.15.174:3300/0 conn(0x7fcd7c10f730 0x7fcd7c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:28.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd7ad9d700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd7c10ed60 0x7fcd7c10f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:28.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd73fff700 1 -- 172.21.15.80:0/1454635491 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936867422 0 0) 0x7fcd6c007da0 con 0x7fcd7c10e970 2019-11-28T11:49:28.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd73fff700 1 -- 172.21.15.80:0/1454635491 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd60002e80 con 0x7fcd7c10e970 2019-11-28T11:49:28.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd80844700 1 -- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd7c10ed60 msgr2=0x7fcd7c10f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:28.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd80844700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd7c10ed60 0x7fcd7c10f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:28.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd73fff700 1 -- 172.21.15.80:0/1454635491 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4177352685 0 0) 0x7fcd6c007da0 con 0x7fcd7c10e970 2019-11-28T11:49:28.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd80844700 1 -- 172.21.15.80:0/1454635491 >> v1:172.21.15.80:6789/0 conn(0x7fcd7c10e970 legacy=0x7fcd7c1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:28.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd80844700 1 -- 172.21.15.80:0/1454635491 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c105ef0 con 0x7fcd7c10f730 2019-11-28T11:49:28.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd80844700 1 --2- 172.21.15.80:0/1454635491 >> v2:172.21.15.174:3300/0 conn(0x7fcd7c10f730 0x7fcd7c167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd74010390 tx=0x7fcd740093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:28.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd80844700 1 --2- 172.21.15.80:0/1454635491 >> v2:172.21.15.174:3300/0 conn(0x7fcd7c10f730 0x7fcd7c167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd74010390 tx=0x7fcd740093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:28.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd80844700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd7c10f730 0x7fcd7c167d70 secure :-1 s=READY pgs=1191 cs=0 l=1 rx=0x7fcd74010390 tx=0x7fcd740093e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:28.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd80844700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd7c10f730 0x7fcd7c167d70 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7fcd74010390 tx=0x7fcd740093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:28.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.920+0000 7fcd73fff700 1 -- 172.21.15.80:0/1454635491 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd740099b0 con 0x7fcd7c10f730 2019-11-28T11:49:28.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.921+0000 7fcd80844700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd7c10f730 0x7fcd7c167d70 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7fcd74010390 tx=0x7fcd740093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:28.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.921+0000 7fcd80844700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd7c10f730 0x7fcd7c167d70 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7fcd74010390 tx=0x7fcd740093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:28.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.921+0000 7fcd73fff700 1 -- 172.21.15.80:0/1454635491 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd74009bb0 con 0x7fcd7c10f730 2019-11-28T11:49:28.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.921+0000 7fcd81045700 1 -- 172.21.15.80:0/1454635491 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c106270 con 0x7fcd7c10f730 2019-11-28T11:49:28.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.921+0000 7fcd73fff700 1 -- 172.21.15.80:0/1454635491 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd7400eaa0 con 0x7fcd7c10f730 2019-11-28T11:49:28.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.921+0000 7fcd81045700 1 -- 172.21.15.80:0/1454635491 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c105ef0 con 0x7fcd7c10f730 2019-11-28T11:49:28.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.921+0000 7fcd80844700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd7c10f730 0x7fcd7c167d70 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7fcd74010390 tx=0x7fcd740093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:28.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.921+0000 7fcd73fff700 1 -- 172.21.15.80:0/1454635491 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcd74009650 con 0x7fcd7c10f730 2019-11-28T11:49:28.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.921+0000 7fcd80844700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd7c10f730 0x7fcd7c167d70 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7fcd74010390 tx=0x7fcd740093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:28.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.921+0000 7fcd73fff700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd60018780 0x7fcd6001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:28.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.921+0000 7fcd73fff700 1 -- 172.21.15.80:0/1454635491 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5668+0+0 (secure 0 0 0) 0x7fcd74031a20 con 0x7fcd7c10f730 2019-11-28T11:49:28.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.922+0000 7fcd7b59e700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd60018780 0x7fcd6001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:28.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.922+0000 7fcd7b59e700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd60018780 0x7fcd6001abf0 crc :-1 s=READY pgs=823 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:28.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.929+0000 7fcd81045700 1 -- 172.21.15.80:0/1454635491 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c106270 con 0x7fcd7c10f730 2019-11-28T11:49:28.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.933+0000 7fcd80844700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd7c10f730 0x7fcd7c167d70 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7fcd74010390 tx=0x7fcd740093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:28.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:27.933+0000 7fcd73fff700 1 -- 172.21.15.80:0/1454635491 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcd74017320 con 0x7fcd7c10f730 2019-11-28T11:49:28.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.100+0000 7fcd81045700 1 -- 172.21.15.80:0/1454635491 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcd7c105ef0 con 0x7fcd7c10f730 2019-11-28T11:49:28.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.766+0000 7fcd80844700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd7c10f730 0x7fcd7c167d70 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7fcd74010390 tx=0x7fcd740093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:28.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.766+0000 7fcd73fff700 1 -- 172.21.15.80:0/1454635491 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v157) v1 ==== 173+0+0 (secure 0 0 0) 0x7fcd740096d0 con 0x7fcd7c10f730 2019-11-28T11:49:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:49:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.818+0000 7fcd81045700 1 -- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd60018780 msgr2=0x7fcd6001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:28.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.818+0000 7fcd81045700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd60018780 0x7fcd6001abf0 crc :-1 s=READY pgs=823 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:28.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.818+0000 7fcd81045700 1 -- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd7c10f730 msgr2=0x7fcd7c167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:28.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.818+0000 7fcd81045700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd7c10f730 0x7fcd7c167d70 secure :-1 s=READY pgs=1191 cs=0 l=1 rx=0x7fcd74010390 tx=0x7fcd740093e0).stop 2019-11-28T11:49:28.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.818+0000 7fcd81045700 1 -- 172.21.15.80:0/1454635491 shutdown_connections 2019-11-28T11:49:28.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.818+0000 7fcd81045700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcd60018780 0x7fcd6001abf0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:28.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.818+0000 7fcd81045700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd7c10f730 0x7fcd7c167d70 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:28.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.818+0000 7fcd81045700 1 --2- 172.21.15.80:0/1454635491 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd7c10ed60 0x7fcd7c10f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:28.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.818+0000 7fcd81045700 1 -- 172.21.15.80:0/1454635491 shutdown_connections 2019-11-28T11:49:28.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.818+0000 7fcd81045700 1 -- 172.21.15.80:0/1454635491 wait complete. 2019-11-28T11:49:28.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.818+0000 7fcd81045700 1 -- 172.21.15.80:0/1454635491 >> 172.21.15.80:0/1454635491 conn(0x7fcd7c15e2d0 msgr2=0x7fcd7c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:28.877 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:49:29.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.957+0000 7f0f39451700 1 Processor -- start 2019-11-28T11:49:29.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.957+0000 7f0f39451700 1 -- start start 2019-11-28T11:49:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.958+0000 7f0f39451700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0f3406c490 0x7f0f3406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.958+0000 7f0f39451700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f3406ce60 0x7f0f34164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.958+0000 7f0f39451700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3406db00 con 0x7f0f3406c0a0 2019-11-28T11:49:29.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.958+0000 7f0f39451700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3406fd60 con 0x7f0f3406c490 2019-11-28T11:49:29.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.958+0000 7f0f39451700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34070030 con 0x7f0f3406ce60 2019-11-28T11:49:29.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.958+0000 7f0f32ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0f3406c490 0x7f0f3406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:29.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.958+0000 7f0f32ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0f3406c490 0x7f0f3406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:56830/0 (socket says 172.21.15.80:56830) 2019-11-28T11:49:29.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.958+0000 7f0f32ffd700 1 -- 172.21.15.80:0/3295281368 learned_addr learned my addr 172.21.15.80:0/3295281368 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:29.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.959+0000 7f0f327fc700 1 -- 172.21.15.80:0/3295281368 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746429077 0 0) 0x7f0f24001030 con 0x7f0f3406c0a0 2019-11-28T11:49:29.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.959+0000 7f0f327fc700 1 -- 172.21.15.80:0/3295281368 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f20002e80 con 0x7f0f3406c0a0 2019-11-28T11:49:29.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.959+0000 7f0f32ffd700 1 -- 172.21.15.80:0/3295281368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f3406ce60 msgr2=0x7f0f34164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:29.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.959+0000 7f0f32ffd700 1 --2- 172.21.15.80:0/3295281368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f3406ce60 0x7f0f34164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:29.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.959+0000 7f0f32ffd700 1 -- 172.21.15.80:0/3295281368 >> v1:172.21.15.80:6789/0 conn(0x7f0f3406c0a0 legacy=0x7f0f34072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:29.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.959+0000 7f0f32ffd700 1 -- 172.21.15.80:0/3295281368 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f340706c0 con 0x7f0f3406c490 2019-11-28T11:49:29.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.959+0000 7f0f32ffd700 1 --2- 172.21.15.80:0/3295281368 >> v2:172.21.15.174:3300/0 conn(0x7f0f3406c490 0x7f0f3406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0f2c00fac0 tx=0x7f0f2c00f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.959+0000 7f0f32ffd700 1 --2- 172.21.15.80:0/3295281368 >> v2:172.21.15.174:3300/0 conn(0x7f0f3406c490 0x7f0f3406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0f2c00fac0 tx=0x7f0f2c00f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.959+0000 7f0f32ffd700 1 --2- 172.21.15.80:0/3295281368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3406c490 0x7f0f3406c920 secure :-1 s=READY pgs=1192 cs=0 l=1 rx=0x7f0f2c00fac0 tx=0x7f0f2c00f8f0).ready entity=mon.1 client_cookie=953a97ec9eb0547a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:29.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.959+0000 7f0f32ffd700 1 --2- 172.21.15.80:0/3295281368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3406c490 0x7f0f3406c920 secure :-1 s=THROTTLE_DONE pgs=1192 cs=0 l=1 rx=0x7f0f2c00fac0 tx=0x7f0f2c00f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.959+0000 7f0f32ffd700 1 --2- 172.21.15.80:0/3295281368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3406c490 0x7f0f3406c920 secure :-1 s=THROTTLE_DONE pgs=1192 cs=0 l=1 rx=0x7f0f2c00fac0 tx=0x7f0f2c00f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.959+0000 7f0f327fc700 1 -- 172.21.15.80:0/3295281368 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f2c000cc0 con 0x7f0f3406c490 2019-11-28T11:49:29.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.959+0000 7f0f32ffd700 1 --2- 172.21.15.80:0/3295281368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3406c490 0x7f0f3406c920 secure :-1 s=THROTTLE_DONE pgs=1192 cs=0 l=1 rx=0x7f0f2c00fac0 tx=0x7f0f2c00f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.959+0000 7f0f327fc700 1 -- 172.21.15.80:0/3295281368 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c001010 con 0x7f0f3406c490 2019-11-28T11:49:29.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.959+0000 7f0f327fc700 1 -- 172.21.15.80:0/3295281368 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f2c0016e0 con 0x7f0f3406c490 2019-11-28T11:49:29.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.960+0000 7f0f39451700 1 -- 172.21.15.80:0/3295281368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3406c490 msgr2=0x7f0f3406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:29.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.960+0000 7f0f39451700 1 --2- 172.21.15.80:0/3295281368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3406c490 0x7f0f3406c920 secure :-1 s=READY pgs=1192 cs=0 l=1 rx=0x7f0f2c00fac0 tx=0x7f0f2c00f8f0).stop 2019-11-28T11:49:29.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.960+0000 7f0f39451700 1 -- 172.21.15.80:0/3295281368 shutdown_connections 2019-11-28T11:49:29.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.960+0000 7f0f39451700 1 --2- 172.21.15.80:0/3295281368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f3406ce60 0x7f0f34164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:29.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.960+0000 7f0f39451700 1 --2- 172.21.15.80:0/3295281368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3406c490 0x7f0f3406c920 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:29.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.960+0000 7f0f39451700 1 -- 172.21.15.80:0/3295281368 shutdown_connections 2019-11-28T11:49:29.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.960+0000 7f0f39451700 1 -- 172.21.15.80:0/3295281368 wait complete. 2019-11-28T11:49:29.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.960+0000 7f0f39451700 1 -- 172.21.15.80:0/3295281368 >> 172.21.15.80:0/3295281368 conn(0x7f0f34061cf0 msgr2=0x7f0f34064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:29.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.963+0000 7f0f39451700 1 Processor -- start 2019-11-28T11:49:29.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.964+0000 7f0f39451700 1 -- start start 2019-11-28T11:49:29.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.964+0000 7f0f39451700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0f3415a210 0x7f0f34160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:29.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.964+0000 7f0f39451700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3415b8c0 con 0x7f0f34161510 2019-11-28T11:49:29.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.964+0000 7f0f39451700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3415bdc0 con 0x7f0f34160650 2019-11-28T11:49:29.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.964+0000 7f0f39451700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3415e080 con 0x7f0f3415a210 2019-11-28T11:49:29.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f32ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0f34161510 0x7f0f3415fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41266/0 (socket says 172.21.15.80:41266) 2019-11-28T11:49:29.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f32ffd700 1 -- 172.21.15.80:0/3749693892 learned_addr learned my addr 172.21.15.80:0/3749693892 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:29.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f337fe700 1 --2- 172.21.15.80:0/3749693892 >> v2:172.21.15.174:3300/0 conn(0x7f0f3415a210 0x7f0f34160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:29.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f2bfff700 1 -- 172.21.15.80:0/3749693892 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963951033 0 0) 0x7f0f2c007990 con 0x7f0f34161510 2019-11-28T11:49:29.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f2bfff700 1 -- 172.21.15.80:0/3749693892 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f18002e80 con 0x7f0f34161510 2019-11-28T11:49:29.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f337fe700 1 -- 172.21.15.80:0/3749693892 >> v1:172.21.15.174:6789/0 conn(0x7f0f34160650 legacy=0x7f0f341b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:29.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f337fe700 1 -- 172.21.15.80:0/3749693892 >> v1:172.21.15.80:6789/0 conn(0x7f0f34161510 legacy=0x7f0f3415fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:29.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f2bfff700 1 -- 172.21.15.80:0/3749693892 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581437402 0 0) 0x7f0f1c000c50 con 0x7f0f34160650 2019-11-28T11:49:29.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f337fe700 1 -- 172.21.15.80:0/3749693892 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3415e710 con 0x7f0f3415a210 2019-11-28T11:49:29.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f337fe700 1 --2- 172.21.15.80:0/3749693892 >> v2:172.21.15.174:3300/0 conn(0x7f0f3415a210 0x7f0f34160fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f240103a0 tx=0x7f0f24010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f337fe700 1 --2- 172.21.15.80:0/3749693892 >> v2:172.21.15.174:3300/0 conn(0x7f0f3415a210 0x7f0f34160fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f240103a0 tx=0x7f0f24010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f337fe700 1 --2- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3415a210 0x7f0f34160fd0 secure :-1 s=READY pgs=1194 cs=0 l=1 rx=0x7f0f240103a0 tx=0x7f0f24010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:29.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f337fe700 1 --2- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3415a210 0x7f0f34160fd0 secure :-1 s=THROTTLE_DONE pgs=1194 cs=0 l=1 rx=0x7f0f240103a0 tx=0x7f0f24010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f337fe700 1 --2- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3415a210 0x7f0f34160fd0 secure :-1 s=THROTTLE_DONE pgs=1194 cs=0 l=1 rx=0x7f0f240103a0 tx=0x7f0f24010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f2bfff700 1 -- 172.21.15.80:0/3749693892 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f24000940 con 0x7f0f3415a210 2019-11-28T11:49:29.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f337fe700 1 --2- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3415a210 0x7f0f34160fd0 secure :-1 s=THROTTLE_DONE pgs=1194 cs=0 l=1 rx=0x7f0f240103a0 tx=0x7f0f24010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f2bfff700 1 -- 172.21.15.80:0/3749693892 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f24009980 con 0x7f0f3415a210 2019-11-28T11:49:29.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f2bfff700 1 -- 172.21.15.80:0/3749693892 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f2400a090 con 0x7f0f3415a210 2019-11-28T11:49:29.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f39451700 1 -- 172.21.15.80:0/3749693892 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3415ea90 con 0x7f0f3415a210 2019-11-28T11:49:29.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.965+0000 7f0f39451700 1 -- 172.21.15.80:0/3749693892 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3415e710 con 0x7f0f3415a210 2019-11-28T11:49:29.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.966+0000 7f0f337fe700 1 --2- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3415a210 0x7f0f34160fd0 secure :-1 s=THROTTLE_DONE pgs=1194 cs=0 l=1 rx=0x7f0f240103a0 tx=0x7f0f24010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.966+0000 7f0f2bfff700 1 -- 172.21.15.80:0/3749693892 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0f24009b70 con 0x7f0f3415a210 2019-11-28T11:49:29.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.966+0000 7f0f337fe700 1 --2- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3415a210 0x7f0f34160fd0 secure :-1 s=THROTTLE_DONE pgs=1194 cs=0 l=1 rx=0x7f0f240103a0 tx=0x7f0f24010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.966+0000 7f0f2bfff700 1 --2- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f18018780 0x7f0f1801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:29.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.966+0000 7f0f2bfff700 1 -- 172.21.15.80:0/3749693892 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5286+0+0 (secure 0 0 0) 0x7f0f24031ac0 con 0x7f0f3415a210 2019-11-28T11:49:29.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.966+0000 7f0f32ffd700 1 --2- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f18018780 0x7f0f1801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:29.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.967+0000 7f0f32ffd700 1 --2- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f18018780 0x7f0f1801abf0 crc :-1 s=READY pgs=824 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:29.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.972+0000 7f0f39451700 1 -- 172.21.15.80:0/3749693892 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3415ea90 con 0x7f0f3415a210 2019-11-28T11:49:29.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.976+0000 7f0f337fe700 1 --2- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3415a210 0x7f0f34160fd0 secure :-1 s=THROTTLE_DONE pgs=1194 cs=0 l=1 rx=0x7f0f240103a0 tx=0x7f0f24010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:28.976+0000 7f0f2bfff700 1 -- 172.21.15.80:0/3749693892 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0f24009580 con 0x7f0f3415a210 2019-11-28T11:49:29.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.162+0000 7f0f39451700 1 -- 172.21.15.80:0/3749693892 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f0f3415e710 con 0x7f0f3415a210 2019-11-28T11:49:29.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.764+0000 7f0f337fe700 1 --2- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3415a210 0x7f0f34160fd0 secure :-1 s=THROTTLE_DONE pgs=1194 cs=0 l=1 rx=0x7f0f240103a0 tx=0x7f0f24010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.764+0000 7f0f2bfff700 1 -- 172.21.15.80:0/3749693892 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v158) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0f24009b70 con 0x7f0f3415a210 2019-11-28T11:49:29.825 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:49:29.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.779+0000 7f0f39451700 1 -- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f18018780 msgr2=0x7f0f1801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:29.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.779+0000 7f0f39451700 1 --2- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f18018780 0x7f0f1801abf0 crc :-1 s=READY pgs=824 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:29.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.779+0000 7f0f39451700 1 -- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3415a210 msgr2=0x7f0f34160fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:29.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.779+0000 7f0f39451700 1 --2- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3415a210 0x7f0f34160fd0 secure :-1 s=READY pgs=1194 cs=0 l=1 rx=0x7f0f240103a0 tx=0x7f0f24010740).stop 2019-11-28T11:49:29.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.779+0000 7f0f39451700 1 -- 172.21.15.80:0/3749693892 shutdown_connections 2019-11-28T11:49:29.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.779+0000 7f0f39451700 1 --2- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f18018780 0x7f0f1801abf0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:29.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.779+0000 7f0f39451700 1 --2- 172.21.15.80:0/3749693892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f3415a210 0x7f0f34160fd0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:29.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.780+0000 7f0f39451700 1 -- 172.21.15.80:0/3749693892 shutdown_connections 2019-11-28T11:49:29.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.780+0000 7f0f39451700 1 -- 172.21.15.80:0/3749693892 wait complete. 2019-11-28T11:49:29.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.780+0000 7f0f39451700 1 -- 172.21.15.80:0/3749693892 >> 172.21.15.80:0/3749693892 conn(0x7f0f3407ba40 msgr2=0x7f0f34104b10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:29.838 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:49:29.838 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:49:29.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.910+0000 7fab523cd700 1 Processor -- start 2019-11-28T11:49:29.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.911+0000 7fab523cd700 1 -- start start 2019-11-28T11:49:29.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.911+0000 7fab523cd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab4c06c0a0 0x7fab4c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:29.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.911+0000 7fab523cd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fab4c0734e0 0x7fab4c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:29.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.911+0000 7fab523cd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab4c072360 0x7fab4c072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:29.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.911+0000 7fab523cd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c06fd60 con 0x7fab4c06c0a0 2019-11-28T11:49:29.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.911+0000 7fab523cd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c070030 con 0x7fab4c0734e0 2019-11-28T11:49:29.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.911+0000 7fab523cd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c06f330 con 0x7fab4c072360 2019-11-28T11:49:29.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab5096a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab4c06c0a0 0x7fab4c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:29.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab5096a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab4c06c0a0 0x7fab4c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41956/0 (socket says 172.21.15.80:41956) 2019-11-28T11:49:29.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab5096a700 1 -- 172.21.15.80:0/1190649296 learned_addr learned my addr 172.21.15.80:0/1190649296 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:29.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab4bfff700 1 --2- 172.21.15.80:0/1190649296 >> v2:172.21.15.174:3300/0 conn(0x7fab4c0734e0 0x7fab4c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:29.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab5116b700 1 --2- 172.21.15.80:0/1190649296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab4c072360 0x7fab4c072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab5096a700 1 -- 172.21.15.80:0/1190649296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab4c072360 msgr2=0x7fab4c072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab5096a700 1 --2- 172.21.15.80:0/1190649296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab4c072360 0x7fab4c072770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab5096a700 1 -- 172.21.15.80:0/1190649296 >> v2:172.21.15.174:3300/0 conn(0x7fab4c0734e0 msgr2=0x7fab4c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab5096a700 1 --2- 172.21.15.80:0/1190649296 >> v2:172.21.15.174:3300/0 conn(0x7fab4c0734e0 0x7fab4c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab5096a700 1 -- 172.21.15.80:0/1190649296 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c0706c0 con 0x7fab4c06c0a0 2019-11-28T11:49:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab4bfff700 1 --2- 172.21.15.80:0/1190649296 >> v2:172.21.15.174:3300/0 conn(0x7fab4c0734e0 0x7fab4c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:49:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab5096a700 1 --2- 172.21.15.80:0/1190649296 >> v2:172.21.15.80:3300/0 conn(0x7fab4c06c0a0 0x7fab4c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fab3400f740 tx=0x7fab3400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab5096a700 1 --2- 172.21.15.80:0/1190649296 >> v2:172.21.15.80:3300/0 conn(0x7fab4c06c0a0 0x7fab4c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fab3400f740 tx=0x7fab3400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab5096a700 1 --2- 172.21.15.80:0/1190649296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c06c0a0 0x7fab4c072fa0 secure :-1 s=READY pgs=2035 cs=0 l=1 rx=0x7fab3400f740 tx=0x7fab3400f570).ready entity=mon.0 client_cookie=a242559ed902612 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab5096a700 1 --2- 172.21.15.80:0/1190649296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c06c0a0 0x7fab4c072fa0 secure :-1 s=THROTTLE_DONE pgs=2035 cs=0 l=1 rx=0x7fab3400f740 tx=0x7fab3400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab5096a700 1 --2- 172.21.15.80:0/1190649296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c06c0a0 0x7fab4c072fa0 secure :-1 s=THROTTLE_DONE pgs=2035 cs=0 l=1 rx=0x7fab3400f740 tx=0x7fab3400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab4b7fe700 1 -- 172.21.15.80:0/1190649296 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab34000960 con 0x7fab4c06c0a0 2019-11-28T11:49:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab5096a700 1 --2- 172.21.15.80:0/1190649296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c06c0a0 0x7fab4c072fa0 secure :-1 s=THROTTLE_DONE pgs=2035 cs=0 l=1 rx=0x7fab3400f740 tx=0x7fab3400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab4b7fe700 1 -- 172.21.15.80:0/1190649296 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab34000c90 con 0x7fab4c06c0a0 2019-11-28T11:49:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab4b7fe700 1 -- 172.21.15.80:0/1190649296 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab340013a0 con 0x7fab4c06c0a0 2019-11-28T11:49:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab523cd700 1 -- 172.21.15.80:0/1190649296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c06c0a0 msgr2=0x7fab4c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.912+0000 7fab523cd700 1 --2- 172.21.15.80:0/1190649296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c06c0a0 0x7fab4c072fa0 secure :-1 s=READY pgs=2035 cs=0 l=1 rx=0x7fab3400f740 tx=0x7fab3400f570).stop 2019-11-28T11:49:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.913+0000 7fab523cd700 1 -- 172.21.15.80:0/1190649296 shutdown_connections 2019-11-28T11:49:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.913+0000 7fab523cd700 1 --2- 172.21.15.80:0/1190649296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab4c072360 0x7fab4c072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.913+0000 7fab523cd700 1 --2- 172.21.15.80:0/1190649296 >> v2:172.21.15.174:3300/0 conn(0x7fab4c0734e0 0x7fab4c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.913+0000 7fab523cd700 1 --2- 172.21.15.80:0/1190649296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c06c0a0 0x7fab4c072fa0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.913+0000 7fab523cd700 1 -- 172.21.15.80:0/1190649296 shutdown_connections 2019-11-28T11:49:29.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.913+0000 7fab523cd700 1 -- 172.21.15.80:0/1190649296 wait complete. 2019-11-28T11:49:29.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.913+0000 7fab523cd700 1 -- 172.21.15.80:0/1190649296 >> 172.21.15.80:0/1190649296 conn(0x7fab4c061cf0 msgr2=0x7fab4c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:29.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.915+0000 7fab523cd700 1 Processor -- start 2019-11-28T11:49:29.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.915+0000 7fab523cd700 1 -- start start 2019-11-28T11:49:29.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.916+0000 7fab523cd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fab4c13e5f0 0x7fab4c13e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.916+0000 7fab523cd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab4c10a4e0 0x7fab4c10c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.916+0000 7fab523cd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4c1066e0 con 0x7fab4c10a070 2019-11-28T11:49:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.916+0000 7fab523cd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c10e060 con 0x7fab4c10a4e0 2019-11-28T11:49:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.916+0000 7fab523cd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c10e330 con 0x7fab4c13e5f0 2019-11-28T11:49:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab5116b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab4c10a4e0 0x7fab4c10c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab5116b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab4c10a4e0 0x7fab4c10c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41964/0 (socket says 172.21.15.80:41964) 2019-11-28T11:49:29.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab5116b700 1 -- 172.21.15.80:0/2502152567 learned_addr learned my addr 172.21.15.80:0/2502152567 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:29.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab5096a700 1 --2- 172.21.15.80:0/2502152567 >> v2:172.21.15.174:3300/0 conn(0x7fab4c13e5f0 0x7fab4c13e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:29.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab5116b700 1 -- 172.21.15.80:0/2502152567 >> v2:172.21.15.174:3300/0 conn(0x7fab4c13e5f0 msgr2=0x7fab4c13e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:29.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab5116b700 1 --2- 172.21.15.80:0/2502152567 >> v2:172.21.15.174:3300/0 conn(0x7fab4c13e5f0 0x7fab4c13e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:29.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab5116b700 1 -- 172.21.15.80:0/2502152567 >> v1:172.21.15.174:6789/0 conn(0x7fab4c10a070 legacy=0x7fab4c10bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:29.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab5116b700 1 -- 172.21.15.80:0/2502152567 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c10e9c0 con 0x7fab4c10a4e0 2019-11-28T11:49:29.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab5096a700 1 --2- 172.21.15.80:0/2502152567 >> v2:172.21.15.174:3300/0 conn(0x7fab4c13e5f0 0x7fab4c13e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:49:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab5116b700 1 --2- 172.21.15.80:0/2502152567 >> v2:172.21.15.80:3300/0 conn(0x7fab4c10a4e0 0x7fab4c10c5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab44010460 tx=0x7fab44010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab5116b700 1 --2- 172.21.15.80:0/2502152567 >> v2:172.21.15.80:3300/0 conn(0x7fab4c10a4e0 0x7fab4c10c5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab44010460 tx=0x7fab44010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab5116b700 1 --2- 172.21.15.80:0/2502152567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c10a4e0 0x7fab4c10c5b0 secure :-1 s=READY pgs=2036 cs=0 l=1 rx=0x7fab44010460 tx=0x7fab44010800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab5116b700 1 --2- 172.21.15.80:0/2502152567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c10a4e0 0x7fab4c10c5b0 secure :-1 s=THROTTLE_DONE pgs=2036 cs=0 l=1 rx=0x7fab44010460 tx=0x7fab44010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab497fa700 1 -- 172.21.15.80:0/2502152567 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab44007330 con 0x7fab4c10a4e0 2019-11-28T11:49:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab5116b700 1 --2- 172.21.15.80:0/2502152567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c10a4e0 0x7fab4c10c5b0 secure :-1 s=THROTTLE_DONE pgs=2036 cs=0 l=1 rx=0x7fab44010460 tx=0x7fab44010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab5116b700 1 --2- 172.21.15.80:0/2502152567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c10a4e0 0x7fab4c10c5b0 secure :-1 s=THROTTLE_DONE pgs=2036 cs=0 l=1 rx=0x7fab44010460 tx=0x7fab44010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab497fa700 1 -- 172.21.15.80:0/2502152567 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab44001360 con 0x7fab4c10a4e0 2019-11-28T11:49:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab523cd700 1 -- 172.21.15.80:0/2502152567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c10ed40 con 0x7fab4c10a4e0 2019-11-28T11:49:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab497fa700 1 -- 172.21.15.80:0/2502152567 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab440019b0 con 0x7fab4c10a4e0 2019-11-28T11:49:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.917+0000 7fab523cd700 1 -- 172.21.15.80:0/2502152567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4c10e9c0 con 0x7fab4c10a4e0 2019-11-28T11:49:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.918+0000 7fab5116b700 1 --2- 172.21.15.80:0/2502152567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c10a4e0 0x7fab4c10c5b0 secure :-1 s=THROTTLE_DONE pgs=2036 cs=0 l=1 rx=0x7fab44010460 tx=0x7fab44010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.918+0000 7fab497fa700 1 -- 172.21.15.80:0/2502152567 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fab44001080 con 0x7fab4c10a4e0 2019-11-28T11:49:29.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.918+0000 7fab5116b700 1 --2- 172.21.15.80:0/2502152567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c10a4e0 0x7fab4c10c5b0 secure :-1 s=THROTTLE_DONE pgs=2036 cs=0 l=1 rx=0x7fab44010460 tx=0x7fab44010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.918+0000 7fab497fa700 1 --2- 172.21.15.80:0/2502152567 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab30018730 0x7fab3001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:29.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.918+0000 7fab497fa700 1 -- 172.21.15.80:0/2502152567 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fab44031ac0 con 0x7fab4c10a4e0 2019-11-28T11:49:29.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.918+0000 7fab5096a700 1 --2- 172.21.15.80:0/2502152567 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab30018730 0x7fab3001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:29.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.918+0000 7fab5096a700 1 --2- 172.21.15.80:0/2502152567 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab30018730 0x7fab3001abc0 crc :-1 s=READY pgs=825 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:29.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.926+0000 7fab523cd700 1 -- 172.21.15.80:0/2502152567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4c10ed40 con 0x7fab4c10a4e0 2019-11-28T11:49:29.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.929+0000 7fab5116b700 1 --2- 172.21.15.80:0/2502152567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c10a4e0 0x7fab4c10c5b0 secure :-1 s=THROTTLE_DONE pgs=2036 cs=0 l=1 rx=0x7fab44010460 tx=0x7fab44010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:29.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:29.929+0000 7fab497fa700 1 -- 172.21.15.80:0/2502152567 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fab4402e240 con 0x7fab4c10a4e0 2019-11-28T11:49:30.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.100+0000 7fab523cd700 1 -- 172.21.15.80:0/2502152567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fab4c10e9c0 con 0x7fab4c10a4e0 2019-11-28T11:49:30.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.100+0000 7fab5116b700 1 --2- 172.21.15.80:0/2502152567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c10a4e0 0x7fab4c10c5b0 secure :-1 s=THROTTLE_DONE pgs=2036 cs=0 l=1 rx=0x7fab44010460 tx=0x7fab44010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.100+0000 7fab497fa700 1 -- 172.21.15.80:0/2502152567 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v55) v1 ==== 80+0+4797 (secure 0 0 0) 0x7fab4402e240 con 0x7fab4c10a4e0 2019-11-28T11:49:30.149 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:30.149 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:49:30.149 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:49:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:49:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:49:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:49:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:49:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:49:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:49:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:49:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:49:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:49:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:49:30.153 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:49:30.153 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:49:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:49:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:49:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:49:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:49:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:49:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:49:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:49:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:49:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:49:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:49:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:49:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:49:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:49:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:49:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:49:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:49:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:49:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:49:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:49:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:49:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:49:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:49:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:49:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:49:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:49:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:49:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:49:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:49:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:49:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:49:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:49:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:49:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:49:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:49:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:49:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:49:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:49:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:49:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:49:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:49:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:49:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:49:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:49:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:49:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:49:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:49:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:49:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:49:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:49:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:49:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:49:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:49:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:49:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:49:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:49:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:49:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:49:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:49:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:49:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:49:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:49:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:49:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:49:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:49:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:49:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:49:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:49:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:49:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:49:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:49:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:49:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:49:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:49:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:49:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:49:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:49:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:49:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:49:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:49:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:49:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:49:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:49:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:49:30.185 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:49:30.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.186 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:30.186 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:49:30.186 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:49:30.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.102+0000 7fab523cd700 1 -- 172.21.15.80:0/2502152567 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab30018730 msgr2=0x7fab3001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.102+0000 7fab523cd700 1 --2- 172.21.15.80:0/2502152567 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab30018730 0x7fab3001abc0 crc :-1 s=READY pgs=825 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.102+0000 7fab523cd700 1 -- 172.21.15.80:0/2502152567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c10a4e0 msgr2=0x7fab4c10c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.102+0000 7fab523cd700 1 --2- 172.21.15.80:0/2502152567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c10a4e0 0x7fab4c10c5b0 secure :-1 s=READY pgs=2036 cs=0 l=1 rx=0x7fab44010460 tx=0x7fab44010800).stop 2019-11-28T11:49:30.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.103+0000 7fab523cd700 1 -- 172.21.15.80:0/2502152567 shutdown_connections 2019-11-28T11:49:30.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.103+0000 7fab523cd700 1 --2- 172.21.15.80:0/2502152567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab4c10a4e0 0x7fab4c10c5b0 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.103+0000 7fab523cd700 1 --2- 172.21.15.80:0/2502152567 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab30018730 0x7fab3001abc0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.103+0000 7fab523cd700 1 --2- 172.21.15.80:0/2502152567 >> v2:172.21.15.174:3300/0 conn(0x7fab4c13e5f0 0x7fab4c13e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.103+0000 7fab523cd700 1 -- 172.21.15.80:0/2502152567 shutdown_connections 2019-11-28T11:49:30.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.103+0000 7fab523cd700 1 -- 172.21.15.80:0/2502152567 wait complete. 2019-11-28T11:49:30.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.103+0000 7fab523cd700 1 -- 172.21.15.80:0/2502152567 >> 172.21.15.80:0/2502152567 conn(0x7fab4c13d620 msgr2=0x7fab4c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:30.190 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:49:30.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.260+0000 7f9a4220f700 1 Processor -- start 2019-11-28T11:49:30.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.261+0000 7f9a4220f700 1 -- start start 2019-11-28T11:49:30.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.261+0000 7f9a4220f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a3c06c0a0 0x7f9a3c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:30.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.261+0000 7f9a4220f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9a3c0734e0 0x7f9a3c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:30.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.261+0000 7f9a4220f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a3c072360 0x7f9a3c072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:30.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.261+0000 7f9a4220f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3c06fd60 con 0x7f9a3c06c0a0 2019-11-28T11:49:30.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.261+0000 7f9a4220f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3c070030 con 0x7f9a3c0734e0 2019-11-28T11:49:30.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.261+0000 7f9a4220f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c06f330 con 0x7f9a3c072360 2019-11-28T11:49:30.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a3c06c0a0 0x7f9a3c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a3c06c0a0 0x7f9a3c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41968/0 (socket says 172.21.15.80:41968) 2019-11-28T11:49:30.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3bfff700 1 -- 172.21.15.80:0/3949691830 learned_addr learned my addr 172.21.15.80:0/3949691830 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:30.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a40fad700 1 --2- 172.21.15.80:0/3949691830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a3c072360 0x7f9a3c072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a33fff700 1 --2- 172.21.15.80:0/3949691830 >> v2:172.21.15.174:3300/0 conn(0x7f9a3c0734e0 0x7f9a3c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3bfff700 1 -- 172.21.15.80:0/3949691830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a3c072360 msgr2=0x7f9a3c072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:30.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3bfff700 1 --2- 172.21.15.80:0/3949691830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a3c072360 0x7f9a3c072770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:30.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3bfff700 1 -- 172.21.15.80:0/3949691830 >> v2:172.21.15.174:3300/0 conn(0x7f9a3c0734e0 msgr2=0x7f9a3c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:30.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3bfff700 1 --2- 172.21.15.80:0/3949691830 >> v2:172.21.15.174:3300/0 conn(0x7f9a3c0734e0 0x7f9a3c071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3bfff700 1 -- 172.21.15.80:0/3949691830 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c0706c0 con 0x7f9a3c06c0a0 2019-11-28T11:49:30.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3bfff700 1 --2- 172.21.15.80:0/3949691830 >> v2:172.21.15.80:3300/0 conn(0x7f9a3c06c0a0 0x7f9a3c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9a2c00f6c0 tx=0x7f9a2c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3bfff700 1 --2- 172.21.15.80:0/3949691830 >> v2:172.21.15.80:3300/0 conn(0x7f9a3c06c0a0 0x7f9a3c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9a2c00f6c0 tx=0x7f9a2c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3bfff700 1 --2- 172.21.15.80:0/3949691830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c06c0a0 0x7f9a3c072fa0 secure :-1 s=READY pgs=2037 cs=0 l=1 rx=0x7f9a2c00f6c0 tx=0x7f9a2c00f570).ready entity=mon.0 client_cookie=c63510e272fe24c6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:30.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3bfff700 1 --2- 172.21.15.80:0/3949691830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c06c0a0 0x7f9a3c072fa0 secure :-1 s=THROTTLE_DONE pgs=2037 cs=0 l=1 rx=0x7f9a2c00f6c0 tx=0x7f9a2c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3bfff700 1 --2- 172.21.15.80:0/3949691830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c06c0a0 0x7f9a3c072fa0 secure :-1 s=THROTTLE_DONE pgs=2037 cs=0 l=1 rx=0x7f9a2c00f6c0 tx=0x7f9a2c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3b7fe700 1 -- 172.21.15.80:0/3949691830 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a2c000960 con 0x7f9a3c06c0a0 2019-11-28T11:49:30.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3bfff700 1 --2- 172.21.15.80:0/3949691830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c06c0a0 0x7f9a3c072fa0 secure :-1 s=THROTTLE_DONE pgs=2037 cs=0 l=1 rx=0x7f9a2c00f6c0 tx=0x7f9a2c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3b7fe700 1 -- 172.21.15.80:0/3949691830 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c000c90 con 0x7f9a3c06c0a0 2019-11-28T11:49:30.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a3b7fe700 1 -- 172.21.15.80:0/3949691830 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a2c0013a0 con 0x7f9a3c06c0a0 2019-11-28T11:49:30.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a4220f700 1 -- 172.21.15.80:0/3949691830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c06c0a0 msgr2=0x7f9a3c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.262+0000 7f9a4220f700 1 --2- 172.21.15.80:0/3949691830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c06c0a0 0x7f9a3c072fa0 secure :-1 s=READY pgs=2037 cs=0 l=1 rx=0x7f9a2c00f6c0 tx=0x7f9a2c00f570).stop 2019-11-28T11:49:30.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.263+0000 7f9a4220f700 1 -- 172.21.15.80:0/3949691830 shutdown_connections 2019-11-28T11:49:30.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.263+0000 7f9a4220f700 1 --2- 172.21.15.80:0/3949691830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a3c072360 0x7f9a3c072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:30.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.263+0000 7f9a4220f700 1 --2- 172.21.15.80:0/3949691830 >> v2:172.21.15.174:3300/0 conn(0x7f9a3c0734e0 0x7f9a3c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:30.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.263+0000 7f9a4220f700 1 --2- 172.21.15.80:0/3949691830 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c06c0a0 0x7f9a3c072fa0 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.263+0000 7f9a4220f700 1 -- 172.21.15.80:0/3949691830 shutdown_connections 2019-11-28T11:49:30.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.263+0000 7f9a4220f700 1 -- 172.21.15.80:0/3949691830 wait complete. 2019-11-28T11:49:30.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.263+0000 7f9a4220f700 1 -- 172.21.15.80:0/3949691830 >> 172.21.15.80:0/3949691830 conn(0x7f9a3c061cf0 msgr2=0x7f9a3c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:30.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.266+0000 7f9a4220f700 1 Processor -- start 2019-11-28T11:49:30.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.266+0000 7f9a4220f700 1 -- start start 2019-11-28T11:49:30.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.266+0000 7f9a4220f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a3c142120 0x7f9a3c102bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:30.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.266+0000 7f9a4220f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a3c102680 0x7f9a3c12df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:30.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.266+0000 7f9a4220f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3c133aa0 con 0x7f9a3c13a850 2019-11-28T11:49:30.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.266+0000 7f9a4220f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3c137d80 con 0x7f9a3c102680 2019-11-28T11:49:30.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.266+0000 7f9a4220f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c139110 con 0x7f9a3c142120 2019-11-28T11:49:30.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a40fad700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a3c102680 0x7f9a3c12df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a40fad700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a3c102680 0x7f9a3c12df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41976/0 (socket says 172.21.15.80:41976) 2019-11-28T11:49:30.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a40fad700 1 -- 172.21.15.80:0/2510718596 learned_addr learned my addr 172.21.15.80:0/2510718596 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:30.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a3bfff700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a3c142120 0x7f9a3c102bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a40fad700 1 -- 172.21.15.80:0/2510718596 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a3c142120 msgr2=0x7f9a3c102bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a40fad700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a3c142120 0x7f9a3c102bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a40fad700 1 -- 172.21.15.80:0/2510718596 >> v1:172.21.15.174:6789/0 conn(0x7f9a3c13a850 legacy=0x7f9a3c101e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a40fad700 1 -- 172.21.15.80:0/2510718596 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c139490 con 0x7f9a3c102680 2019-11-28T11:49:30.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a40fad700 1 --2- 172.21.15.80:0/2510718596 >> v2:172.21.15.80:3300/0 conn(0x7f9a3c102680 0x7f9a3c12df90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a34010760 tx=0x7f9a34010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a40fad700 1 --2- 172.21.15.80:0/2510718596 >> v2:172.21.15.80:3300/0 conn(0x7f9a3c102680 0x7f9a3c12df90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a34010760 tx=0x7f9a34010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a40fad700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c102680 0x7f9a3c12df90 secure :-1 s=READY pgs=2038 cs=0 l=1 rx=0x7f9a34010760 tx=0x7f9a34010b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:30.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a40fad700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c102680 0x7f9a3c12df90 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7f9a34010760 tx=0x7f9a34010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a40fad700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c102680 0x7f9a3c12df90 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7f9a34010760 tx=0x7f9a34010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a397fa700 1 -- 172.21.15.80:0/2510718596 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a340076b0 con 0x7f9a3c102680 2019-11-28T11:49:30.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a40fad700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c102680 0x7f9a3c12df90 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7f9a34010760 tx=0x7f9a34010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a397fa700 1 -- 172.21.15.80:0/2510718596 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a340015f0 con 0x7f9a3c102680 2019-11-28T11:49:30.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a4220f700 1 -- 172.21.15.80:0/2510718596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3c139490 con 0x7f9a3c102680 2019-11-28T11:49:30.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a397fa700 1 -- 172.21.15.80:0/2510718596 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a34001c80 con 0x7f9a3c102680 2019-11-28T11:49:30.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a4220f700 1 -- 172.21.15.80:0/2510718596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3c139490 con 0x7f9a3c102680 2019-11-28T11:49:30.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.267+0000 7f9a40fad700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c102680 0x7f9a3c12df90 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7f9a34010760 tx=0x7f9a34010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.268+0000 7f9a397fa700 1 -- 172.21.15.80:0/2510718596 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9a340017e0 con 0x7f9a3c102680 2019-11-28T11:49:30.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.268+0000 7f9a40fad700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c102680 0x7f9a3c12df90 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7f9a34010760 tx=0x7f9a34010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.268+0000 7f9a397fa700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a20018730 0x7f9a2001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:30.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.268+0000 7f9a397fa700 1 -- 172.21.15.80:0/2510718596 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f9a34031de0 con 0x7f9a3c102680 2019-11-28T11:49:30.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.268+0000 7f9a3bfff700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a20018730 0x7f9a2001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.269+0000 7f9a3bfff700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a20018730 0x7f9a2001abc0 crc :-1 s=READY pgs=826 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:30.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.276+0000 7f9a4220f700 1 -- 172.21.15.80:0/2510718596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3c139490 con 0x7f9a3c102680 2019-11-28T11:49:30.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.279+0000 7f9a40fad700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c102680 0x7f9a3c12df90 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7f9a34010760 tx=0x7f9a34010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.279+0000 7f9a397fa700 1 -- 172.21.15.80:0/2510718596 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9a340011f0 con 0x7f9a3c102680 2019-11-28T11:49:30.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.455+0000 7f9a4220f700 1 -- 172.21.15.80:0/2510718596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a3c139490 con 0x7f9a3c102680 2019-11-28T11:49:30.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.455+0000 7f9a40fad700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c102680 0x7f9a3c12df90 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7f9a34010760 tx=0x7f9a34010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.455+0000 7f9a397fa700 1 -- 172.21.15.80:0/2510718596 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+12010 (secure 0 0 0) 0x7f9a340017e0 con 0x7f9a3c102680 2019-11-28T11:49:30.504 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:30.504 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":158,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:49:29.761392+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:49:30.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.457+0000 7f9a4220f700 1 -- 172.21.15.80:0/2510718596 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a20018730 msgr2=0x7f9a2001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.457+0000 7f9a4220f700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a20018730 0x7f9a2001abc0 crc :-1 s=READY pgs=826 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.457+0000 7f9a4220f700 1 -- 172.21.15.80:0/2510718596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c102680 msgr2=0x7f9a3c12df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.457+0000 7f9a4220f700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c102680 0x7f9a3c12df90 secure :-1 s=READY pgs=2038 cs=0 l=1 rx=0x7f9a34010760 tx=0x7f9a34010b00).stop 2019-11-28T11:49:30.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.458+0000 7f9a4220f700 1 -- 172.21.15.80:0/2510718596 shutdown_connections 2019-11-28T11:49:30.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.458+0000 7f9a4220f700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a3c102680 0x7f9a3c12df90 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.458+0000 7f9a4220f700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a20018730 0x7f9a2001abc0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.458+0000 7f9a4220f700 1 --2- 172.21.15.80:0/2510718596 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a3c142120 0x7f9a3c102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.458+0000 7f9a4220f700 1 -- 172.21.15.80:0/2510718596 shutdown_connections 2019-11-28T11:49:30.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.458+0000 7f9a4220f700 1 -- 172.21.15.80:0/2510718596 wait complete. 2019-11-28T11:49:30.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.458+0000 7f9a4220f700 1 -- 172.21.15.80:0/2510718596 >> 172.21.15.80:0/2510718596 conn(0x7f9a3c13d930 msgr2=0x7f9a3c1415c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:30.516 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:49:30.517 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:49:30.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.592+0000 7f79b7974700 1 Processor -- start 2019-11-28T11:49:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.592+0000 7f79b7974700 1 -- start start 2019-11-28T11:49:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b7974700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b015ed10 0x7f79b015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b7974700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f79b0073020 0x7f79b0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b7974700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b006db60 con 0x7f79b00734b0 2019-11-28T11:49:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b7974700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b006f3d0 con 0x7f79b0073020 2019-11-28T11:49:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b7974700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b006fe00 con 0x7f79b015ed10 2019-11-28T11:49:30.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b6712700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f79b00734b0 0x7f79b00723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41300/0 (socket says 172.21.15.80:41300) 2019-11-28T11:49:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b6712700 1 -- 172.21.15.80:0/965517159 learned_addr learned my addr 172.21.15.80:0/965517159 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b5710700 1 --2- 172.21.15.80:0/965517159 >> v2:172.21.15.174:3300/0 conn(0x7f79b0073020 0x7f79b0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b5f11700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b015ed10 0x7f79b015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b4f0f700 1 -- 172.21.15.80:0/965517159 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065762138 0 0) 0x7f79a8001100 con 0x7f79b00734b0 2019-11-28T11:49:30.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b4f0f700 1 -- 172.21.15.80:0/965517159 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f799c002e80 con 0x7f79b00734b0 2019-11-28T11:49:30.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b4f0f700 1 -- 172.21.15.80:0/965517159 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1371974979 0 0) 0x7f79a80010e0 con 0x7f79b00734b0 2019-11-28T11:49:30.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b4f0f700 1 -- 172.21.15.80:0/965517159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b015ed10 msgr2=0x7f79b015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:30.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b4f0f700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b015ed10 0x7f79b015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:30.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b4f0f700 1 -- 172.21.15.80:0/965517159 >> v2:172.21.15.174:3300/0 conn(0x7f79b0073020 msgr2=0x7f79b0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:30.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b4f0f700 1 --2- 172.21.15.80:0/965517159 >> v2:172.21.15.174:3300/0 conn(0x7f79b0073020 0x7f79b0071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:30.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b4f0f700 1 -- 172.21.15.80:0/965517159 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b0070760 con 0x7f79b00734b0 2019-11-28T11:49:30.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b4f0f700 1 -- 172.21.15.80:0/965517159 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f79a8001670 con 0x7f79b00734b0 2019-11-28T11:49:30.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.593+0000 7f79b5710700 1 --2- 172.21.15.80:0/965517159 >> v2:172.21.15.174:3300/0 conn(0x7f79b0073020 0x7f79b0071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:30.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b4f0f700 1 -- 172.21.15.80:0/965517159 >> v1:172.21.15.80:6789/0 conn(0x7f79b00734b0 legacy=0x7f79b00723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b4f0f700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f799c0479e0 0x7f799c049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:30.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b4f0f700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f799c04a5f0 0x7f799c04caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:30.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b4f0f700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f799c04d300 0x7f799c04f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:30.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b4f0f700 1 -- 172.21.15.80:0/965517159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c04ff50 con 0x7f799c0479e0 2019-11-28T11:49:30.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b4f0f700 1 -- 172.21.15.80:0/965517159 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c050140 con 0x7f799c04a5f0 2019-11-28T11:49:30.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b4f0f700 1 -- 172.21.15.80:0/965517159 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c050370 con 0x7f799c04d300 2019-11-28T11:49:30.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b5f11700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f799c0479e0 0x7f799c049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b5710700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f799c04a5f0 0x7f799c04caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b6712700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f799c04d300 0x7f799c04f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b5f11700 1 -- 172.21.15.80:0/965517159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f799c04d300 msgr2=0x7f799c04f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:30.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b5f11700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f799c04d300 0x7f799c04f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:30.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b5f11700 1 -- 172.21.15.80:0/965517159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f799c04a5f0 msgr2=0x7f799c04caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:30.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b5f11700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f799c04a5f0 0x7f799c04caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:30.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b5f11700 1 -- 172.21.15.80:0/965517159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c050620 con 0x7f799c0479e0 2019-11-28T11:49:30.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b6712700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f799c04d300 0x7f799c04f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:49:30.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b5f11700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f799c0479e0 0x7f799c049e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f79a000f630 tx=0x7f79a0002bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b5f11700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f799c0479e0 0x7f799c049e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f79a000f630 tx=0x7f79a0002bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b5f11700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f799c0479e0 0x7f799c049e40 secure :-1 s=READY pgs=2040 cs=0 l=1 rx=0x7f79a000f630 tx=0x7f79a0002bf0).ready entity=mon.0 client_cookie=746d4ed016eef7cb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:30.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b5f11700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f799c0479e0 0x7f799c049e40 secure :-1 s=THROTTLE_DONE pgs=2040 cs=0 l=1 rx=0x7f79a000f630 tx=0x7f79a0002bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b5f11700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f799c0479e0 0x7f799c049e40 secure :-1 s=THROTTLE_DONE pgs=2040 cs=0 l=1 rx=0x7f79a000f630 tx=0x7f79a0002bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b4f0f700 1 -- 172.21.15.80:0/965517159 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79a0000960 con 0x7f799c0479e0 2019-11-28T11:49:30.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b5f11700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f799c0479e0 0x7f799c049e40 secure :-1 s=THROTTLE_DONE pgs=2040 cs=0 l=1 rx=0x7f79a000f630 tx=0x7f79a0002bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b4f0f700 1 -- 172.21.15.80:0/965517159 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a0000e80 con 0x7f799c0479e0 2019-11-28T11:49:30.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b4f0f700 1 -- 172.21.15.80:0/965517159 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79a0001510 con 0x7f799c0479e0 2019-11-28T11:49:30.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b7974700 1 -- 172.21.15.80:0/965517159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f799c0479e0 msgr2=0x7f799c049e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b7974700 1 --2- 172.21.15.80:0/965517159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f799c0479e0 0x7f799c049e40 secure :-1 s=READY pgs=2040 cs=0 l=1 rx=0x7f79a000f630 tx=0x7f79a0002bf0).stop 2019-11-28T11:49:30.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.594+0000 7f79b6712700 1 -- 172.21.15.80:0/965517159 reap_dead start 2019-11-28T11:49:30.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.595+0000 7f79b7974700 1 -- 172.21.15.80:0/965517159 shutdown_connections 2019-11-28T11:49:30.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.595+0000 7f79b7974700 1 -- 172.21.15.80:0/965517159 shutdown_connections 2019-11-28T11:49:30.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.595+0000 7f79b7974700 1 -- 172.21.15.80:0/965517159 wait complete. 2019-11-28T11:49:30.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.595+0000 7f79b7974700 1 -- 172.21.15.80:0/965517159 >> 172.21.15.80:0/965517159 conn(0x7f79b0061d20 msgr2=0x7f79b00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:30.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.597+0000 7f79b7974700 1 Processor -- start 2019-11-28T11:49:30.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.597+0000 7f79b7974700 1 -- start start 2019-11-28T11:49:30.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.598+0000 7f79b7974700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b012c2a0 0x7f79b012c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:30.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.598+0000 7f79b7974700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f79b01510e0 0x7f79b0151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:30.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.598+0000 7f79b7974700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b010a310 con 0x7f79b0108630 2019-11-28T11:49:30.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.598+0000 7f79b7974700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b012ee80 con 0x7f79b01510e0 2019-11-28T11:49:30.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.598+0000 7f79b7974700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b01329f0 con 0x7f79b012c2a0 2019-11-28T11:49:30.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.598+0000 7f79b6712700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f79b01510e0 0x7f79b0151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.598+0000 7f79b6712700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f79b01510e0 0x7f79b0151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41996/0 (socket says 172.21.15.80:41996) 2019-11-28T11:49:30.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.598+0000 7f79b6712700 1 -- 172.21.15.80:0/3325382844 learned_addr learned my addr 172.21.15.80:0/3325382844 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:30.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.598+0000 7f79b5710700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b012c2a0 0x7f79b012c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.599+0000 7f79b6712700 1 -- 172.21.15.80:0/3325382844 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b012c2a0 msgr2=0x7f79b012c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.599+0000 7f79b6712700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b012c2a0 0x7f79b012c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.599+0000 7f79b6712700 1 -- 172.21.15.80:0/3325382844 >> v1:172.21.15.174:6789/0 conn(0x7f79b0108630 legacy=0x7f79b0152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.599+0000 7f79b6712700 1 -- 172.21.15.80:0/3325382844 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b0133350 con 0x7f79b01510e0 2019-11-28T11:49:30.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.599+0000 7f79b6712700 1 --2- 172.21.15.80:0/3325382844 >> v2:172.21.15.80:3300/0 conn(0x7f79b01510e0 0x7f79b0151550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79a8010420 tx=0x7f79a80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.599+0000 7f79b6712700 1 --2- 172.21.15.80:0/3325382844 >> v2:172.21.15.80:3300/0 conn(0x7f79b01510e0 0x7f79b0151550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79a8010420 tx=0x7f79a80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.599+0000 7f79b6712700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b01510e0 0x7f79b0151550 secure :-1 s=READY pgs=2041 cs=0 l=1 rx=0x7f79a8010420 tx=0x7f79a80102a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:30.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.599+0000 7f79b6712700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b01510e0 0x7f79b0151550 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f79a8010420 tx=0x7f79a80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.599+0000 7f79b6712700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b01510e0 0x7f79b0151550 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f79a8010420 tx=0x7f79a80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.599+0000 7f79ae7fc700 1 -- 172.21.15.80:0/3325382844 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79a8000b30 con 0x7f79b01510e0 2019-11-28T11:49:30.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.599+0000 7f79b6712700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b01510e0 0x7f79b0151550 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f79a8010420 tx=0x7f79a80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.599+0000 7f79ae7fc700 1 -- 172.21.15.80:0/3325382844 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a8001c80 con 0x7f79b01510e0 2019-11-28T11:49:30.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.599+0000 7f79ae7fc700 1 -- 172.21.15.80:0/3325382844 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79a8004830 con 0x7f79b01510e0 2019-11-28T11:49:30.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.599+0000 7f79b7974700 1 -- 172.21.15.80:0/3325382844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b01336d0 con 0x7f79b01510e0 2019-11-28T11:49:30.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.599+0000 7f79b7974700 1 -- 172.21.15.80:0/3325382844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b0133350 con 0x7f79b01510e0 2019-11-28T11:49:30.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.599+0000 7f79b6712700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b01510e0 0x7f79b0151550 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f79a8010420 tx=0x7f79a80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.600+0000 7f79ae7fc700 1 -- 172.21.15.80:0/3325382844 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f79a8000940 con 0x7f79b01510e0 2019-11-28T11:49:30.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.600+0000 7f79b6712700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b01510e0 0x7f79b0151550 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f79a8010420 tx=0x7f79a80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.600+0000 7f79ae7fc700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7994018730 0x7f799401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:30.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.600+0000 7f79ae7fc700 1 -- 172.21.15.80:0/3325382844 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f79a8031a80 con 0x7f79b01510e0 2019-11-28T11:49:30.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.600+0000 7f79b5f11700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7994018730 0x7f799401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.600+0000 7f79b5f11700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7994018730 0x7f799401abc0 crc :-1 s=READY pgs=827 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:30.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.607+0000 7f79b7974700 1 -- 172.21.15.80:0/3325382844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b01336d0 con 0x7f79b01510e0 2019-11-28T11:49:30.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.610+0000 7f79b6712700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b01510e0 0x7f79b0151550 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f79a8010420 tx=0x7f79a80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.610+0000 7f79ae7fc700 1 -- 172.21.15.80:0/3325382844 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f79a8001c80 con 0x7f79b01510e0 2019-11-28T11:49:30.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.778+0000 7f79b7974700 1 -- 172.21.15.80:0/3325382844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f79b0133350 con 0x7f79b01510e0 2019-11-28T11:49:30.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.778+0000 7f79b6712700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b01510e0 0x7f79b0151550 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f79a8010420 tx=0x7f79a80102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.778+0000 7f79ae7fc700 1 -- 172.21.15.80:0/3325382844 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v158) v1 ==== 92+0+10 (secure 0 0 0) 0x7f79a8000940 con 0x7f79b01510e0 2019-11-28T11:49:30.826 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:49:30.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.781+0000 7f79b7974700 1 -- 172.21.15.80:0/3325382844 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7994018730 msgr2=0x7f799401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.781+0000 7f79b7974700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7994018730 0x7f799401abc0 crc :-1 s=READY pgs=827 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.781+0000 7f79b7974700 1 -- 172.21.15.80:0/3325382844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b01510e0 msgr2=0x7f79b0151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.781+0000 7f79b7974700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b01510e0 0x7f79b0151550 secure :-1 s=READY pgs=2041 cs=0 l=1 rx=0x7f79a8010420 tx=0x7f79a80102a0).stop 2019-11-28T11:49:30.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.781+0000 7f79b7974700 1 -- 172.21.15.80:0/3325382844 shutdown_connections 2019-11-28T11:49:30.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.781+0000 7f79b7974700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f79b01510e0 0x7f79b0151550 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.781+0000 7f79b7974700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79b012c2a0 0x7f79b012c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.781+0000 7f79b7974700 1 --2- 172.21.15.80:0/3325382844 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7994018730 0x7f799401abc0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.781+0000 7f79b7974700 1 -- 172.21.15.80:0/3325382844 shutdown_connections 2019-11-28T11:49:30.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.781+0000 7f79b7974700 1 -- 172.21.15.80:0/3325382844 wait complete. 2019-11-28T11:49:30.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.781+0000 7f79b7974700 1 -- 172.21.15.80:0/3325382844 >> 172.21.15.80:0/3325382844 conn(0x7f79b014dbb0 msgr2=0x7f79b0142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:30.839 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:49:30.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.910+0000 7f4e91dcd700 1 Processor -- start 2019-11-28T11:49:30.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.910+0000 7f4e91dcd700 1 -- start start 2019-11-28T11:49:30.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.911+0000 7f4e91dcd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e8c06c0a0 0x7f4e8c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.911+0000 7f4e91dcd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e8c072620 0x7f4e8c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.911+0000 7f4e91dcd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c06db00 con 0x7f4e8c0734e0 2019-11-28T11:49:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.911+0000 7f4e91dcd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c06f330 con 0x7f4e8c072620 2019-11-28T11:49:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.911+0000 7f4e91dcd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c0706c0 con 0x7f4e8c06c0a0 2019-11-28T11:49:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.911+0000 7f4e90b6b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e8c072620 0x7f4e8c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.911+0000 7f4e90b6b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e8c072620 0x7f4e8c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42004/0 (socket says 172.21.15.80:42004) 2019-11-28T11:49:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.911+0000 7f4e90b6b700 1 -- 172.21.15.80:0/347020077 learned_addr learned my addr 172.21.15.80:0/347020077 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.911+0000 7f4e8bfff700 1 --2- 172.21.15.80:0/347020077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e8c06c0a0 0x7f4e8c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.912+0000 7f4e90b6b700 1 -- 172.21.15.80:0/347020077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e8c06c0a0 msgr2=0x7f4e8c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.912+0000 7f4e90b6b700 1 --2- 172.21.15.80:0/347020077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e8c06c0a0 0x7f4e8c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.912+0000 7f4e90b6b700 1 -- 172.21.15.80:0/347020077 >> v1:172.21.15.174:6789/0 conn(0x7f4e8c0734e0 legacy=0x7f4e8c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.912+0000 7f4e90b6b700 1 -- 172.21.15.80:0/347020077 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c070a40 con 0x7f4e8c072620 2019-11-28T11:49:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.912+0000 7f4e90b6b700 1 --2- 172.21.15.80:0/347020077 >> v2:172.21.15.80:3300/0 conn(0x7f4e8c072620 0x7f4e8c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4e8400fa30 tx=0x7f4e8400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.912+0000 7f4e90b6b700 1 --2- 172.21.15.80:0/347020077 >> v2:172.21.15.80:3300/0 conn(0x7f4e8c072620 0x7f4e8c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4e8400fa30 tx=0x7f4e8400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.912+0000 7f4e90b6b700 1 --2- 172.21.15.80:0/347020077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c072620 0x7f4e8c164d70 secure :-1 s=READY pgs=2042 cs=0 l=1 rx=0x7f4e8400fa30 tx=0x7f4e8400fdd0).ready entity=mon.0 client_cookie=c4653b7892b67c9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.912+0000 7f4e90b6b700 1 --2- 172.21.15.80:0/347020077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c072620 0x7f4e8c164d70 secure :-1 s=THROTTLE_DONE pgs=2042 cs=0 l=1 rx=0x7f4e8400fa30 tx=0x7f4e8400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.912+0000 7f4e8b7fe700 1 -- 172.21.15.80:0/347020077 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e84000df0 con 0x7f4e8c072620 2019-11-28T11:49:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.912+0000 7f4e90b6b700 1 --2- 172.21.15.80:0/347020077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c072620 0x7f4e8c164d70 secure :-1 s=THROTTLE_DONE pgs=2042 cs=0 l=1 rx=0x7f4e8400fa30 tx=0x7f4e8400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.912+0000 7f4e90b6b700 1 --2- 172.21.15.80:0/347020077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c072620 0x7f4e8c164d70 secure :-1 s=THROTTLE_DONE pgs=2042 cs=0 l=1 rx=0x7f4e8400fa30 tx=0x7f4e8400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.912+0000 7f4e8b7fe700 1 -- 172.21.15.80:0/347020077 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e84001460 con 0x7f4e8c072620 2019-11-28T11:49:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.912+0000 7f4e8b7fe700 1 -- 172.21.15.80:0/347020077 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e84001b30 con 0x7f4e8c072620 2019-11-28T11:49:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.912+0000 7f4e91dcd700 1 -- 172.21.15.80:0/347020077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c072620 msgr2=0x7f4e8c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.912+0000 7f4e91dcd700 1 --2- 172.21.15.80:0/347020077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c072620 0x7f4e8c164d70 secure :-1 s=READY pgs=2042 cs=0 l=1 rx=0x7f4e8400fa30 tx=0x7f4e8400fdd0).stop 2019-11-28T11:49:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.913+0000 7f4e91dcd700 1 -- 172.21.15.80:0/347020077 shutdown_connections 2019-11-28T11:49:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.913+0000 7f4e91dcd700 1 --2- 172.21.15.80:0/347020077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c072620 0x7f4e8c164d70 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.913+0000 7f4e91dcd700 1 --2- 172.21.15.80:0/347020077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e8c06c0a0 0x7f4e8c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:30.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.913+0000 7f4e91dcd700 1 -- 172.21.15.80:0/347020077 shutdown_connections 2019-11-28T11:49:30.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.913+0000 7f4e91dcd700 1 -- 172.21.15.80:0/347020077 wait complete. 2019-11-28T11:49:30.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.913+0000 7f4e91dcd700 1 -- 172.21.15.80:0/347020077 >> 172.21.15.80:0/347020077 conn(0x7f4e8c061cf0 msgr2=0x7f4e8c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:30.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.915+0000 7f4e91dcd700 1 Processor -- start 2019-11-28T11:49:30.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.915+0000 7f4e91dcd700 1 -- start start 2019-11-28T11:49:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e91dcd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e8c104820 0x7f4e8c10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e91dcd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e8c10c890 0x7f4e8c10b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e91dcd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c13bcd0 con 0x7f4e8c10b710 2019-11-28T11:49:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e91dcd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c109130 con 0x7f4e8c104820 2019-11-28T11:49:30.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e91dcd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c109400 con 0x7f4e8c10c890 2019-11-28T11:49:30.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e8bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e8c104820 0x7f4e8c10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e8bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e8c104820 0x7f4e8c10c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42006/0 (socket says 172.21.15.80:42006) 2019-11-28T11:49:30.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e8bfff700 1 -- 172.21.15.80:0/669378450 learned_addr learned my addr 172.21.15.80:0/669378450 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:30.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e83fff700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e8c10c890 0x7f4e8c10b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e8bfff700 1 -- 172.21.15.80:0/669378450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e8c10c890 msgr2=0x7f4e8c10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e8bfff700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e8c10c890 0x7f4e8c10b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:30.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e8bfff700 1 -- 172.21.15.80:0/669378450 >> v1:172.21.15.174:6789/0 conn(0x7f4e8c10b710 legacy=0x7f4e8c104c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:30.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e8bfff700 1 -- 172.21.15.80:0/669378450 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c109a90 con 0x7f4e8c104820 2019-11-28T11:49:30.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e8bfff700 1 --2- 172.21.15.80:0/669378450 >> v2:172.21.15.80:3300/0 conn(0x7f4e8c104820 0x7f4e8c10c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4e7c010450 tx=0x7f4e7c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e8bfff700 1 --2- 172.21.15.80:0/669378450 >> v2:172.21.15.80:3300/0 conn(0x7f4e8c104820 0x7f4e8c10c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4e7c010450 tx=0x7f4e7c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e8bfff700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c104820 0x7f4e8c10c350 secure :-1 s=READY pgs=2043 cs=0 l=1 rx=0x7f4e7c010450 tx=0x7f4e7c010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:30.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e8bfff700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c104820 0x7f4e8c10c350 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7f4e7c010450 tx=0x7f4e7c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e897fa700 1 -- 172.21.15.80:0/669378450 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7c000940 con 0x7f4e8c104820 2019-11-28T11:49:30.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.916+0000 7f4e8bfff700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c104820 0x7f4e8c10c350 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7f4e7c010450 tx=0x7f4e7c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.917+0000 7f4e8bfff700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c104820 0x7f4e8c10c350 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7f4e7c010450 tx=0x7f4e7c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.917+0000 7f4e897fa700 1 -- 172.21.15.80:0/669378450 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c000e80 con 0x7f4e8c104820 2019-11-28T11:49:30.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.917+0000 7f4e91dcd700 1 -- 172.21.15.80:0/669378450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8c109e10 con 0x7f4e8c104820 2019-11-28T11:49:30.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.917+0000 7f4e897fa700 1 -- 172.21.15.80:0/669378450 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7c001070 con 0x7f4e8c104820 2019-11-28T11:49:30.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.917+0000 7f4e91dcd700 1 -- 172.21.15.80:0/669378450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c109a90 con 0x7f4e8c104820 2019-11-28T11:49:30.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.917+0000 7f4e8bfff700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c104820 0x7f4e8c10c350 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7f4e7c010450 tx=0x7f4e7c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.917+0000 7f4e897fa700 1 -- 172.21.15.80:0/669378450 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4e7c001070 con 0x7f4e8c104820 2019-11-28T11:49:30.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.917+0000 7f4e8bfff700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c104820 0x7f4e8c10c350 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7f4e7c010450 tx=0x7f4e7c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.917+0000 7f4e897fa700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e70018730 0x7f4e7001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:30.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.917+0000 7f4e897fa700 1 -- 172.21.15.80:0/669378450 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f4e7c031b10 con 0x7f4e8c104820 2019-11-28T11:49:30.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.917+0000 7f4e83fff700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e70018730 0x7f4e7001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:30.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.918+0000 7f4e83fff700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e70018730 0x7f4e7001abc0 crc :-1 s=READY pgs=828 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:30.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.925+0000 7f4e91dcd700 1 -- 172.21.15.80:0/669378450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8c109e10 con 0x7f4e8c104820 2019-11-28T11:49:30.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.929+0000 7f4e8bfff700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c104820 0x7f4e8c10c350 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7f4e7c010450 tx=0x7f4e7c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:30.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:30.929+0000 7f4e897fa700 1 -- 172.21.15.80:0/669378450 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4e7c009250 con 0x7f4e8c104820 2019-11-28T11:49:31.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.094+0000 7f4e91dcd700 1 -- 172.21.15.80:0/669378450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4e8c109a90 con 0x7f4e8c104820 2019-11-28T11:49:31.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.094+0000 7f4e8bfff700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c104820 0x7f4e8c10c350 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7f4e7c010450 tx=0x7f4e7c010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.094+0000 7f4e897fa700 1 -- 172.21.15.80:0/669378450 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v158) v1 ==== 84+0+64 (secure 0 0 0) 0x7f4e7c001050 con 0x7f4e8c104820 2019-11-28T11:49:31.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.097+0000 7f4e91dcd700 1 -- 172.21.15.80:0/669378450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e70018730 msgr2=0x7f4e7001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:31.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.097+0000 7f4e91dcd700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e70018730 0x7f4e7001abc0 crc :-1 s=READY pgs=828 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:31.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.097+0000 7f4e91dcd700 1 -- 172.21.15.80:0/669378450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c104820 msgr2=0x7f4e8c10c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:31.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.097+0000 7f4e91dcd700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c104820 0x7f4e8c10c350 secure :-1 s=READY pgs=2043 cs=0 l=1 rx=0x7f4e7c010450 tx=0x7f4e7c010280).stop 2019-11-28T11:49:31.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.097+0000 7f4e91dcd700 1 -- 172.21.15.80:0/669378450 shutdown_connections 2019-11-28T11:49:31.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.097+0000 7f4e91dcd700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e70018730 0x7f4e7001abc0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:31.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.097+0000 7f4e91dcd700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e8c10c890 0x7f4e8c10b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:31.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.097+0000 7f4e91dcd700 1 --2- 172.21.15.80:0/669378450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c104820 0x7f4e8c10c350 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:31.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.097+0000 7f4e91dcd700 1 -- 172.21.15.80:0/669378450 shutdown_connections 2019-11-28T11:49:31.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.097+0000 7f4e91dcd700 1 -- 172.21.15.80:0/669378450 wait complete. 2019-11-28T11:49:31.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.097+0000 7f4e91dcd700 1 -- 172.21.15.80:0/669378450 >> 172.21.15.80:0/669378450 conn(0x7f4e8c13d620 msgr2=0x7f4e8c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:31.150 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:31.151 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:49:31.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:49:31.151 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:49:31.152 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:49:31.152 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:49:31.152 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:49:31.156 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:49:31.157 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:49:31.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.233+0000 7fcbdd9f5700 1 Processor -- start 2019-11-28T11:49:31.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.233+0000 7fcbdd9f5700 1 -- start start 2019-11-28T11:49:31.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.234+0000 7fcbdd9f5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcbd815f100 0x7fcbd806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:31.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.234+0000 7fcbdd9f5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd806db60 con 0x7fcbd806c2f0 2019-11-28T11:49:31.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.234+0000 7fcbdd9f5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd806e060 con 0x7fcbd815ed10 2019-11-28T11:49:31.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.234+0000 7fcbdd9f5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd806fe00 con 0x7fcbd815f100 2019-11-28T11:49:31.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcbd806c2f0 0x7fcbd806c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41332/0 (socket says 172.21.15.80:41332) 2019-11-28T11:49:31.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd7fff700 1 -- 172.21.15.80:0/1118270473 learned_addr learned my addr 172.21.15.80:0/1118270473 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:31.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/1118270473 >> v2:172.21.15.174:3300/0 conn(0x7fcbd815f100 0x7fcbd806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:31.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd67fc700 1 -- 172.21.15.80:0/1118270473 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884237812 0 0) 0x7fcbd0001150 con 0x7fcbd806c2f0 2019-11-28T11:49:31.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd67fc700 1 -- 172.21.15.80:0/1118270473 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbb8002e80 con 0x7fcbd806c2f0 2019-11-28T11:49:31.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd67fc700 1 -- 172.21.15.80:0/1118270473 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2247894255 0 0) 0x7fcbd0001130 con 0x7fcbd806c2f0 2019-11-28T11:49:31.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd67fc700 1 -- 172.21.15.80:0/1118270473 >> v2:172.21.15.174:3300/0 conn(0x7fcbd815f100 msgr2=0x7fcbd806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:31.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd67fc700 1 --2- 172.21.15.80:0/1118270473 >> v2:172.21.15.174:3300/0 conn(0x7fcbd815f100 0x7fcbd806bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:31.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd67fc700 1 -- 172.21.15.80:0/1118270473 >> v1:172.21.15.174:6789/0 conn(0x7fcbd815ed10 legacy=0x7fcbd8073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:31.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd67fc700 1 -- 172.21.15.80:0/1118270473 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd8070760 con 0x7fcbd806c2f0 2019-11-28T11:49:31.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd67fc700 1 -- 172.21.15.80:0/1118270473 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fcbd0001660 con 0x7fcbd806c2f0 2019-11-28T11:49:31.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd67fc700 1 -- 172.21.15.80:0/1118270473 >> v1:172.21.15.80:6789/0 conn(0x7fcbd806c2f0 legacy=0x7fcbd806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:31.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd67fc700 1 --2- 172.21.15.80:0/1118270473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbb8003ab0 0x7fcbb8005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:31.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd67fc700 1 --2- 172.21.15.80:0/1118270473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbb8006670 0x7fcbb8008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:31.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd67fc700 1 --2- 172.21.15.80:0/1118270473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbb8009380 0x7fcbb800b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:31.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd67fc700 1 -- 172.21.15.80:0/1118270473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb800c000 con 0x7fcbb8006670 2019-11-28T11:49:31.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd67fc700 1 -- 172.21.15.80:0/1118270473 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb8050200 con 0x7fcbb8009380 2019-11-28T11:49:31.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd67fc700 1 -- 172.21.15.80:0/1118270473 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb8050430 con 0x7fcbb8003ab0 2019-11-28T11:49:31.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/1118270473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbb8006670 0x7fcbb8008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:31.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd77fe700 1 --2- 172.21.15.80:0/1118270473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbb8003ab0 0x7fcbb8005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:31.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd7fff700 1 --2- 172.21.15.80:0/1118270473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbb8009380 0x7fcbb800b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:31.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd6ffd700 1 -- 172.21.15.80:0/1118270473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbb8003ab0 msgr2=0x7fcbb8005ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:31.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/1118270473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbb8003ab0 0x7fcbb8005ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:31.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd6ffd700 1 -- 172.21.15.80:0/1118270473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbb8009380 msgr2=0x7fcbb800b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:31.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/1118270473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbb8009380 0x7fcbb800b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:31.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd7fff700 1 -- 172.21.15.80:0/1118270473 reap_dead start 2019-11-28T11:49:31.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.235+0000 7fcbd6ffd700 1 -- 172.21.15.80:0/1118270473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb80506e0 con 0x7fcbb8006670 2019-11-28T11:49:31.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.236+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/1118270473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbb8006670 0x7fcbb8008b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcbc000ab90 tx=0x7fcbc000ae30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.236+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/1118270473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbb8006670 0x7fcbb8008b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcbc000ab90 tx=0x7fcbc000ae30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.236+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/1118270473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbb8006670 0x7fcbb8008b20 secure :-1 s=READY pgs=2045 cs=0 l=1 rx=0x7fcbc000ab90 tx=0x7fcbc000ae30).ready entity=mon.0 client_cookie=7f9a6180e2894c5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:31.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.236+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/1118270473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbb8006670 0x7fcbb8008b20 secure :-1 s=THROTTLE_DONE pgs=2045 cs=0 l=1 rx=0x7fcbc000ab90 tx=0x7fcbc000ae30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.236+0000 7fcbd67fc700 1 -- 172.21.15.80:0/1118270473 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbc0000ce0 con 0x7fcbb8006670 2019-11-28T11:49:31.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.236+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/1118270473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbb8006670 0x7fcbb8008b20 secure :-1 s=THROTTLE_DONE pgs=2045 cs=0 l=1 rx=0x7fcbc000ab90 tx=0x7fcbc000ae30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.236+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/1118270473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbb8006670 0x7fcbb8008b20 secure :-1 s=THROTTLE_DONE pgs=2045 cs=0 l=1 rx=0x7fcbc000ab90 tx=0x7fcbc000ae30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.236+0000 7fcbd67fc700 1 -- 172.21.15.80:0/1118270473 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc0009af0 con 0x7fcbb8006670 2019-11-28T11:49:31.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.236+0000 7fcbd67fc700 1 -- 172.21.15.80:0/1118270473 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbc0000ce0 con 0x7fcbb8006670 2019-11-28T11:49:31.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.236+0000 7fcbdd9f5700 1 -- 172.21.15.80:0/1118270473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbb8006670 msgr2=0x7fcbb8008b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:31.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.236+0000 7fcbdd9f5700 1 --2- 172.21.15.80:0/1118270473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbb8006670 0x7fcbb8008b20 secure :-1 s=READY pgs=2045 cs=0 l=1 rx=0x7fcbc000ab90 tx=0x7fcbc000ae30).stop 2019-11-28T11:49:31.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.236+0000 7fcbdd9f5700 1 -- 172.21.15.80:0/1118270473 shutdown_connections 2019-11-28T11:49:31.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.236+0000 7fcbdd9f5700 1 --2- 172.21.15.80:0/1118270473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbb8006670 0x7fcbb8008b20 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:31.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.236+0000 7fcbdd9f5700 1 -- 172.21.15.80:0/1118270473 shutdown_connections 2019-11-28T11:49:31.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.236+0000 7fcbdd9f5700 1 -- 172.21.15.80:0/1118270473 wait complete. 2019-11-28T11:49:31.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.236+0000 7fcbdd9f5700 1 -- 172.21.15.80:0/1118270473 >> 172.21.15.80:0/1118270473 conn(0x7fcbd8061d20 msgr2=0x7fcbd80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:31.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.239+0000 7fcbdd9f5700 1 Processor -- start 2019-11-28T11:49:31.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.239+0000 7fcbdd9f5700 1 -- start start 2019-11-28T11:49:31.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbdd9f5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbd8108630 0x7fcbd8151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:31.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbdd9f5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcbd8151740 0x7fcbd81502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:31.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbdd9f5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd8133a20 con 0x7fcbd8150820 2019-11-28T11:49:31.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbdd9f5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd8130f50 con 0x7fcbd8151740 2019-11-28T11:49:31.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbdd9f5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd8131980 con 0x7fcbd8108630 2019-11-28T11:49:31.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbd6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcbd8151740 0x7fcbd81502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:31.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbd6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcbd8151740 0x7fcbd81502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42026/0 (socket says 172.21.15.80:42026) 2019-11-28T11:49:31.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbd6ffd700 1 -- 172.21.15.80:0/3213288350 learned_addr learned my addr 172.21.15.80:0/3213288350 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:31.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbd77fe700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbd8108630 0x7fcbd8151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:31.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbd6ffd700 1 -- 172.21.15.80:0/3213288350 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbd8108630 msgr2=0x7fcbd8151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:31.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbd8108630 0x7fcbd8151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:31.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbd6ffd700 1 -- 172.21.15.80:0/3213288350 >> v1:172.21.15.174:6789/0 conn(0x7fcbd8150820 legacy=0x7fcbd812fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:31.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbd6ffd700 1 -- 172.21.15.80:0/3213288350 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd81322e0 con 0x7fcbd8151740 2019-11-28T11:49:31.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbd77fe700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbd8108630 0x7fcbd8151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:49:31.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/3213288350 >> v2:172.21.15.80:3300/0 conn(0x7fcbd8151740 0x7fcbd81502e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcbc0010780 tx=0x7fcbc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/3213288350 >> v2:172.21.15.80:3300/0 conn(0x7fcbd8151740 0x7fcbd81502e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcbc0010780 tx=0x7fcbc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.240+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd8151740 0x7fcbd81502e0 secure :-1 s=READY pgs=2046 cs=0 l=1 rx=0x7fcbc0010780 tx=0x7fcbc0010b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:31.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.241+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd8151740 0x7fcbd81502e0 secure :-1 s=THROTTLE_DONE pgs=2046 cs=0 l=1 rx=0x7fcbc0010780 tx=0x7fcbc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.241+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd8151740 0x7fcbd81502e0 secure :-1 s=THROTTLE_DONE pgs=2046 cs=0 l=1 rx=0x7fcbc0010780 tx=0x7fcbc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.241+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd8151740 0x7fcbd81502e0 secure :-1 s=THROTTLE_DONE pgs=2046 cs=0 l=1 rx=0x7fcbc0010780 tx=0x7fcbc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.241+0000 7fcbcffff700 1 -- 172.21.15.80:0/3213288350 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbc0000cc0 con 0x7fcbd8151740 2019-11-28T11:49:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.241+0000 7fcbcffff700 1 -- 172.21.15.80:0/3213288350 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc0009d00 con 0x7fcbd8151740 2019-11-28T11:49:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.241+0000 7fcbdd9f5700 1 -- 172.21.15.80:0/3213288350 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd8132660 con 0x7fcbd8151740 2019-11-28T11:49:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.241+0000 7fcbcffff700 1 -- 172.21.15.80:0/3213288350 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbc000a3d0 con 0x7fcbd8151740 2019-11-28T11:49:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.241+0000 7fcbdd9f5700 1 -- 172.21.15.80:0/3213288350 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd81322e0 con 0x7fcbd8151740 2019-11-28T11:49:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.241+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd8151740 0x7fcbd81502e0 secure :-1 s=THROTTLE_DONE pgs=2046 cs=0 l=1 rx=0x7fcbc0010780 tx=0x7fcbc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.241+0000 7fcbcffff700 1 -- 172.21.15.80:0/3213288350 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcbc0009ef0 con 0x7fcbd8151740 2019-11-28T11:49:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.241+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd8151740 0x7fcbd81502e0 secure :-1 s=THROTTLE_DONE pgs=2046 cs=0 l=1 rx=0x7fcbc0010780 tx=0x7fcbc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.241+0000 7fcbcffff700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcbb0018730 0x7fcbb001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:31.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.241+0000 7fcbcffff700 1 -- 172.21.15.80:0/3213288350 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fcbc0031e30 con 0x7fcbd8151740 2019-11-28T11:49:31.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.242+0000 7fcbd77fe700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcbb0018730 0x7fcbb001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:31.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.242+0000 7fcbd77fe700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcbb0018730 0x7fcbb001abc0 crc :-1 s=READY pgs=829 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:31.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.249+0000 7fcbdd9f5700 1 -- 172.21.15.80:0/3213288350 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd8132660 con 0x7fcbd8151740 2019-11-28T11:49:31.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.252+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd8151740 0x7fcbd81502e0 secure :-1 s=THROTTLE_DONE pgs=2046 cs=0 l=1 rx=0x7fcbc0010780 tx=0x7fcbc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.252+0000 7fcbcffff700 1 -- 172.21.15.80:0/3213288350 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcbc002afc0 con 0x7fcbd8151740 2019-11-28T11:49:31.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.421+0000 7fcbdd9f5700 1 -- 172.21.15.80:0/3213288350 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7fcbd81322e0 con 0x7fcbd8151740 2019-11-28T11:49:31.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.782+0000 7fcbd6ffd700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd8151740 0x7fcbd81502e0 secure :-1 s=THROTTLE_DONE pgs=2046 cs=0 l=1 rx=0x7fcbc0010780 tx=0x7fcbc0010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.782+0000 7fcbcffff700 1 -- 172.21.15.80:0/3213288350 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v159) v1 ==== 133+0+0 (secure 0 0 0) 0x7fcbc002afc0 con 0x7fcbd8151740 2019-11-28T11:49:31.833 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:49:31.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.787+0000 7fcbdd9f5700 1 -- 172.21.15.80:0/3213288350 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcbb0018730 msgr2=0x7fcbb001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:31.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.787+0000 7fcbdd9f5700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcbb0018730 0x7fcbb001abc0 crc :-1 s=READY pgs=829 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:31.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.787+0000 7fcbdd9f5700 1 -- 172.21.15.80:0/3213288350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd8151740 msgr2=0x7fcbd81502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:31.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.787+0000 7fcbdd9f5700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd8151740 0x7fcbd81502e0 secure :-1 s=READY pgs=2046 cs=0 l=1 rx=0x7fcbc0010780 tx=0x7fcbc0010b20).stop 2019-11-28T11:49:31.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.787+0000 7fcbdd9f5700 1 -- 172.21.15.80:0/3213288350 shutdown_connections 2019-11-28T11:49:31.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.787+0000 7fcbdd9f5700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcbb0018730 0x7fcbb001abc0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:31.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.787+0000 7fcbdd9f5700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbd8151740 0x7fcbd81502e0 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:31.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.787+0000 7fcbdd9f5700 1 --2- 172.21.15.80:0/3213288350 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcbd8108630 0x7fcbd8151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:31.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.787+0000 7fcbdd9f5700 1 -- 172.21.15.80:0/3213288350 shutdown_connections 2019-11-28T11:49:31.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.788+0000 7fcbdd9f5700 1 -- 172.21.15.80:0/3213288350 wait complete. 2019-11-28T11:49:31.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.788+0000 7fcbdd9f5700 1 -- 172.21.15.80:0/3213288350 >> 172.21.15.80:0/3213288350 conn(0x7fcbd814dbb0 msgr2=0x7fcbd8142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:31.847 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:49:31.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.924+0000 7fe3bd16d700 1 Processor -- start 2019-11-28T11:49:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.924+0000 7fe3bd16d700 1 -- start start 2019-11-28T11:49:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.925+0000 7fe3bd16d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3b815ed10 0x7fe3b815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.925+0000 7fe3bd16d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b8073020 0x7fe3b8071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.925+0000 7fe3bd16d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b806db60 con 0x7fe3b80734b0 2019-11-28T11:49:31.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.925+0000 7fe3bd16d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b806fe00 con 0x7fe3b815ed10 2019-11-28T11:49:31.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.925+0000 7fe3bd16d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b80700d0 con 0x7fe3b8073020 2019-11-28T11:49:31.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.925+0000 7fe3b759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3b815ed10 0x7fe3b815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:31.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.925+0000 7fe3b759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3b815ed10 0x7fe3b815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42034/0 (socket says 172.21.15.80:42034) 2019-11-28T11:49:31.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.925+0000 7fe3b759e700 1 -- 172.21.15.80:0/526701455 learned_addr learned my addr 172.21.15.80:0/526701455 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:31.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.925+0000 7fe3b6d9d700 1 --2- 172.21.15.80:0/526701455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b8073020 0x7fe3b8071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:31.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.925+0000 7fe3b759e700 1 -- 172.21.15.80:0/526701455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b8073020 msgr2=0x7fe3b8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:31.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.925+0000 7fe3b759e700 1 --2- 172.21.15.80:0/526701455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b8073020 0x7fe3b8071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:31.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.925+0000 7fe3b759e700 1 -- 172.21.15.80:0/526701455 >> v1:172.21.15.174:6789/0 conn(0x7fe3b80734b0 legacy=0x7fe3b80723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:31.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.926+0000 7fe3b759e700 1 -- 172.21.15.80:0/526701455 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b8070760 con 0x7fe3b815ed10 2019-11-28T11:49:31.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.926+0000 7fe3b759e700 1 --2- 172.21.15.80:0/526701455 >> v2:172.21.15.80:3300/0 conn(0x7fe3b815ed10 0x7fe3b815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe3a800f6c0 tx=0x7fe3a800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.926+0000 7fe3b759e700 1 --2- 172.21.15.80:0/526701455 >> v2:172.21.15.80:3300/0 conn(0x7fe3b815ed10 0x7fe3b815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe3a800f6c0 tx=0x7fe3a800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.926+0000 7fe3b759e700 1 --2- 172.21.15.80:0/526701455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3b815ed10 0x7fe3b815f100 secure :-1 s=READY pgs=2047 cs=0 l=1 rx=0x7fe3a800f6c0 tx=0x7fe3a800fa60).ready entity=mon.0 client_cookie=95bb61352aeadf19 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:31.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.926+0000 7fe3b759e700 1 --2- 172.21.15.80:0/526701455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3b815ed10 0x7fe3b815f100 secure :-1 s=THROTTLE_DONE pgs=2047 cs=0 l=1 rx=0x7fe3a800f6c0 tx=0x7fe3a800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.926+0000 7fe3b759e700 1 --2- 172.21.15.80:0/526701455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3b815ed10 0x7fe3b815f100 secure :-1 s=THROTTLE_DONE pgs=2047 cs=0 l=1 rx=0x7fe3a800f6c0 tx=0x7fe3a800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.926+0000 7fe3b759e700 1 --2- 172.21.15.80:0/526701455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3b815ed10 0x7fe3b815f100 secure :-1 s=THROTTLE_DONE pgs=2047 cs=0 l=1 rx=0x7fe3a800f6c0 tx=0x7fe3a800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:31.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.926+0000 7fe3b659c700 1 -- 172.21.15.80:0/526701455 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3a8000960 con 0x7fe3b815ed10 2019-11-28T11:49:31.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.926+0000 7fe3b659c700 1 -- 172.21.15.80:0/526701455 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a8000c90 con 0x7fe3b815ed10 2019-11-28T11:49:31.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.926+0000 7fe3b659c700 1 -- 172.21.15.80:0/526701455 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3a80012e0 con 0x7fe3b815ed10 2019-11-28T11:49:31.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.926+0000 7fe3bd16d700 1 -- 172.21.15.80:0/526701455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3b815ed10 msgr2=0x7fe3b815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:31.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.926+0000 7fe3bd16d700 1 --2- 172.21.15.80:0/526701455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3b815ed10 0x7fe3b815f100 secure :-1 s=READY pgs=2047 cs=0 l=1 rx=0x7fe3a800f6c0 tx=0x7fe3a800fa60).stop 2019-11-28T11:49:31.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.927+0000 7fe3bd16d700 1 -- 172.21.15.80:0/526701455 shutdown_connections 2019-11-28T11:49:31.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.927+0000 7fe3bd16d700 1 --2- 172.21.15.80:0/526701455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b8073020 0x7fe3b8071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:31.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.927+0000 7fe3bd16d700 1 --2- 172.21.15.80:0/526701455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3b815ed10 0x7fe3b815f100 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:31.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.927+0000 7fe3bd16d700 1 -- 172.21.15.80:0/526701455 shutdown_connections 2019-11-28T11:49:31.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.927+0000 7fe3bd16d700 1 -- 172.21.15.80:0/526701455 wait complete. 2019-11-28T11:49:31.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.927+0000 7fe3bd16d700 1 -- 172.21.15.80:0/526701455 >> 172.21.15.80:0/526701455 conn(0x7fe3b8061d20 msgr2=0x7fe3b80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:31.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.929+0000 7fe3bd16d700 1 Processor -- start 2019-11-28T11:49:31.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.929+0000 7fe3bd16d700 1 -- start start 2019-11-28T11:49:31.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.930+0000 7fe3bd16d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b81079b0 0x7fe3b8107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:31.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.930+0000 7fe3bd16d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe3b8108380 0x7fe3b8168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:31.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.930+0000 7fe3bd16d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b81087d0 con 0x7fe3b8148320 2019-11-28T11:49:31.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.930+0000 7fe3bd16d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b813aa20 con 0x7fe3b8108380 2019-11-28T11:49:31.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.930+0000 7fe3bd16d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b813acf0 con 0x7fe3b81079b0 2019-11-28T11:49:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.930+0000 7fe3b759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe3b8148320 0x7fe3b810ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41356/0 (socket says 172.21.15.80:41356) 2019-11-28T11:49:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.930+0000 7fe3b759e700 1 -- 172.21.15.80:0/2566985725 learned_addr learned my addr 172.21.15.80:0/2566985725 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.930+0000 7fe3b6d9d700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b81079b0 0x7fe3b8107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.930+0000 7fe3bc96c700 1 --2- 172.21.15.80:0/2566985725 >> v2:172.21.15.174:3300/0 conn(0x7fe3b8108380 0x7fe3b8168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:31.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.930+0000 7fe3affff700 1 -- 172.21.15.80:0/2566985725 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974870895 0 0) 0x7fe3a8007b10 con 0x7fe3b8148320 2019-11-28T11:49:31.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.930+0000 7fe3affff700 1 -- 172.21.15.80:0/2566985725 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe390002e80 con 0x7fe3b8148320 2019-11-28T11:49:31.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.931+0000 7fe3b6d9d700 1 -- 172.21.15.80:0/2566985725 >> v2:172.21.15.174:3300/0 conn(0x7fe3b8108380 msgr2=0x7fe3b8168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:31.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.931+0000 7fe3b6d9d700 1 --2- 172.21.15.80:0/2566985725 >> v2:172.21.15.174:3300/0 conn(0x7fe3b8108380 0x7fe3b8168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:31.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.931+0000 7fe3b6d9d700 1 -- 172.21.15.80:0/2566985725 >> v1:172.21.15.80:6789/0 conn(0x7fe3b8148320 legacy=0x7fe3b810ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:31.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.931+0000 7fe3b6d9d700 1 -- 172.21.15.80:0/2566985725 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b810c490 con 0x7fe3b81079b0 2019-11-28T11:49:31.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.931+0000 7fe3b6d9d700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b81079b0 0x7fe3b8107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe3a0010710 tx=0x7fe3a000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:32.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.931+0000 7fe3b6d9d700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b81079b0 0x7fe3b8107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe3a0010710 tx=0x7fe3a000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:32.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.931+0000 7fe3b6d9d700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b81079b0 0x7fe3b8107e40 secure :-1 s=READY pgs=282 cs=0 l=1 rx=0x7fe3a0010710 tx=0x7fe3a000b6e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:32.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.931+0000 7fe3b6d9d700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b81079b0 0x7fe3b8107e40 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7fe3a0010710 tx=0x7fe3a000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:32.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.931+0000 7fe3affff700 1 -- 172.21.15.80:0/2566985725 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3a00099c0 con 0x7fe3b81079b0 2019-11-28T11:49:32.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.931+0000 7fe3b6d9d700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b81079b0 0x7fe3b8107e40 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7fe3a0010710 tx=0x7fe3a000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:32.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.931+0000 7fe3affff700 1 -- 172.21.15.80:0/2566985725 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a0000cc0 con 0x7fe3b81079b0 2019-11-28T11:49:32.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.931+0000 7fe3b6d9d700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b81079b0 0x7fe3b8107e40 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7fe3a0010710 tx=0x7fe3a000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:32.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.931+0000 7fe3bd16d700 1 -- 172.21.15.80:0/2566985725 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b810c810 con 0x7fe3b81079b0 2019-11-28T11:49:32.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.931+0000 7fe3affff700 1 -- 172.21.15.80:0/2566985725 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3a000a1d0 con 0x7fe3b81079b0 2019-11-28T11:49:32.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.931+0000 7fe3bd16d700 1 -- 172.21.15.80:0/2566985725 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b810c490 con 0x7fe3b81079b0 2019-11-28T11:49:32.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.931+0000 7fe3b6d9d700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b81079b0 0x7fe3b8107e40 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7fe3a0010710 tx=0x7fe3a000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:32.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.932+0000 7fe3affff700 1 -- 172.21.15.80:0/2566985725 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe3a0009df0 con 0x7fe3b81079b0 2019-11-28T11:49:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.932+0000 7fe3b6d9d700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b81079b0 0x7fe3b8107e40 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7fe3a0010710 tx=0x7fe3a000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.932+0000 7fe3affff700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe390018770 0x7fe39001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.932+0000 7fe3affff700 1 -- 172.21.15.80:0/2566985725 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe3a0031d60 con 0x7fe3b81079b0 2019-11-28T11:49:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.932+0000 7fe3b759e700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe390018770 0x7fe39001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:32.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.932+0000 7fe3b759e700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe390018770 0x7fe39001abe0 crc :-1 s=READY pgs=830 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.939+0000 7fe3bd16d700 1 -- 172.21.15.80:0/2566985725 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b810c810 con 0x7fe3b81079b0 2019-11-28T11:49:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.944+0000 7fe3b6d9d700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b81079b0 0x7fe3b8107e40 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7fe3a0010710 tx=0x7fe3a000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:31.944+0000 7fe3affff700 1 -- 172.21.15.80:0/2566985725 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe3a0009be0 con 0x7fe3b81079b0 2019-11-28T11:49:32.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.113+0000 7fe3bd16d700 1 -- 172.21.15.80:0/2566985725 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7fe3b810c490 con 0x7fe3b81079b0 2019-11-28T11:49:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.792+0000 7fe3b6d9d700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b81079b0 0x7fe3b8107e40 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7fe3a0010710 tx=0x7fe3a000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.792+0000 7fe3affff700 1 -- 172.21.15.80:0/2566985725 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v160) v1 ==== 125+0+0 (secure 0 0 0) 0x7fe3a0009dd0 con 0x7fe3b81079b0 2019-11-28T11:49:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:49:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.831+0000 7fe3bd16d700 1 -- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe390018770 msgr2=0x7fe39001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.831+0000 7fe3bd16d700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe390018770 0x7fe39001abe0 crc :-1 s=READY pgs=830 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.831+0000 7fe3bd16d700 1 -- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b81079b0 msgr2=0x7fe3b8107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.831+0000 7fe3bd16d700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b81079b0 0x7fe3b8107e40 secure :-1 s=READY pgs=282 cs=0 l=1 rx=0x7fe3a0010710 tx=0x7fe3a000b6e0).stop 2019-11-28T11:49:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.831+0000 7fe3bd16d700 1 -- 172.21.15.80:0/2566985725 shutdown_connections 2019-11-28T11:49:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.831+0000 7fe3bd16d700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe390018770 0x7fe39001abe0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.831+0000 7fe3bd16d700 1 --2- 172.21.15.80:0/2566985725 >> v2:172.21.15.174:3300/0 conn(0x7fe3b8108380 0x7fe3b8168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.831+0000 7fe3bd16d700 1 --2- 172.21.15.80:0/2566985725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3b81079b0 0x7fe3b8107e40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.831+0000 7fe3bd16d700 1 -- 172.21.15.80:0/2566985725 shutdown_connections 2019-11-28T11:49:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.831+0000 7fe3bd16d700 1 -- 172.21.15.80:0/2566985725 wait complete. 2019-11-28T11:49:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.831+0000 7fe3bd16d700 1 -- 172.21.15.80:0/2566985725 >> 172.21.15.80:0/2566985725 conn(0x7fe3b815e2d0 msgr2=0x7fe3b8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:32.891 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:49:33.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.977+0000 7f7943b14700 1 Processor -- start 2019-11-28T11:49:33.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.977+0000 7f7943b14700 1 -- start start 2019-11-28T11:49:33.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.978+0000 7f7943b14700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f793c15ed10 0x7f793c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:33.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.978+0000 7f7943b14700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f793c073020 0x7f793c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:33.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.978+0000 7f7943b14700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c0734b0 0x7f793c0723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:33.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.978+0000 7f7943b14700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f793c06fe00 con 0x7f793c073020 2019-11-28T11:49:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.978+0000 7f7943b14700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f793c0700d0 con 0x7f793c15ed10 2019-11-28T11:49:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.978+0000 7f7943b14700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793c06f3d0 con 0x7f793c0734b0 2019-11-28T11:49:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.978+0000 7f79418b0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f793c073020 0x7f793c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.978+0000 7f79418b0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f793c073020 0x7f793c071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42052/0 (socket says 172.21.15.80:42052) 2019-11-28T11:49:33.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.978+0000 7f79418b0700 1 -- 172.21.15.80:0/3162006713 learned_addr learned my addr 172.21.15.80:0/3162006713 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:33.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79420b1700 1 --2- 172.21.15.80:0/3162006713 >> v2:172.21.15.174:3300/0 conn(0x7f793c15ed10 0x7f793c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:33.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79428b2700 1 --2- 172.21.15.80:0/3162006713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c0734b0 0x7f793c0723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:33.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79418b0700 1 -- 172.21.15.80:0/3162006713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c0734b0 msgr2=0x7f793c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:33.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79418b0700 1 --2- 172.21.15.80:0/3162006713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c0734b0 0x7f793c0723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:33.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79418b0700 1 -- 172.21.15.80:0/3162006713 >> v2:172.21.15.174:3300/0 conn(0x7f793c15ed10 msgr2=0x7f793c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:33.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79418b0700 1 --2- 172.21.15.80:0/3162006713 >> v2:172.21.15.174:3300/0 conn(0x7f793c15ed10 0x7f793c15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:33.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79418b0700 1 -- 172.21.15.80:0/3162006713 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c070760 con 0x7f793c073020 2019-11-28T11:49:33.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79420b1700 1 --2- 172.21.15.80:0/3162006713 >> v2:172.21.15.174:3300/0 conn(0x7f793c15ed10 0x7f793c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:49:33.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79428b2700 1 --2- 172.21.15.80:0/3162006713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c0734b0 0x7f793c0723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:49:33.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79418b0700 1 --2- 172.21.15.80:0/3162006713 >> v2:172.21.15.80:3300/0 conn(0x7f793c073020 0x7f793c071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f792400f740 tx=0x7f792400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79418b0700 1 --2- 172.21.15.80:0/3162006713 >> v2:172.21.15.80:3300/0 conn(0x7f793c073020 0x7f793c071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f792400f740 tx=0x7f792400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79418b0700 1 --2- 172.21.15.80:0/3162006713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f793c073020 0x7f793c071ea0 secure :-1 s=READY pgs=2049 cs=0 l=1 rx=0x7f792400f740 tx=0x7f792400fae0).ready entity=mon.0 client_cookie=b0f5273499eff561 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:33.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79418b0700 1 --2- 172.21.15.80:0/3162006713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f793c073020 0x7f793c071ea0 secure :-1 s=THROTTLE_DONE pgs=2049 cs=0 l=1 rx=0x7f792400f740 tx=0x7f792400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79410af700 1 -- 172.21.15.80:0/3162006713 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7924000960 con 0x7f793c073020 2019-11-28T11:49:33.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79418b0700 1 --2- 172.21.15.80:0/3162006713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f793c073020 0x7f793c071ea0 secure :-1 s=THROTTLE_DONE pgs=2049 cs=0 l=1 rx=0x7f792400f740 tx=0x7f792400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79418b0700 1 --2- 172.21.15.80:0/3162006713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f793c073020 0x7f793c071ea0 secure :-1 s=THROTTLE_DONE pgs=2049 cs=0 l=1 rx=0x7f792400f740 tx=0x7f792400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79410af700 1 -- 172.21.15.80:0/3162006713 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7924000e80 con 0x7f793c073020 2019-11-28T11:49:33.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f79410af700 1 -- 172.21.15.80:0/3162006713 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7924000960 con 0x7f793c073020 2019-11-28T11:49:33.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f7943b14700 1 -- 172.21.15.80:0/3162006713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f793c073020 msgr2=0x7f793c071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:33.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.979+0000 7f7943b14700 1 --2- 172.21.15.80:0/3162006713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f793c073020 0x7f793c071ea0 secure :-1 s=READY pgs=2049 cs=0 l=1 rx=0x7f792400f740 tx=0x7f792400fae0).stop 2019-11-28T11:49:33.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.980+0000 7f7943b14700 1 -- 172.21.15.80:0/3162006713 shutdown_connections 2019-11-28T11:49:33.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.980+0000 7f7943b14700 1 --2- 172.21.15.80:0/3162006713 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c0734b0 0x7f793c0723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:33.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.980+0000 7f7943b14700 1 --2- 172.21.15.80:0/3162006713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f793c073020 0x7f793c071ea0 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:33.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.980+0000 7f7943b14700 1 --2- 172.21.15.80:0/3162006713 >> v2:172.21.15.174:3300/0 conn(0x7f793c15ed10 0x7f793c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:33.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.980+0000 7f7943b14700 1 -- 172.21.15.80:0/3162006713 shutdown_connections 2019-11-28T11:49:33.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.980+0000 7f7943b14700 1 -- 172.21.15.80:0/3162006713 wait complete. 2019-11-28T11:49:33.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.980+0000 7f7943b14700 1 -- 172.21.15.80:0/3162006713 >> 172.21.15.80:0/3162006713 conn(0x7f793c061d20 msgr2=0x7f793c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:33.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.982+0000 7f7943b14700 1 Processor -- start 2019-11-28T11:49:33.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.982+0000 7f7943b14700 1 -- start start 2019-11-28T11:49:33.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.983+0000 7f7943b14700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f793c10ed60 0x7f793c10f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:33.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.983+0000 7f7943b14700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c10f730 0x7f793c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:33.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.983+0000 7f7943b14700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f793c10c250 con 0x7f793c10e970 2019-11-28T11:49:33.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.983+0000 7f7943b14700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f793c10e430 con 0x7f793c10ed60 2019-11-28T11:49:33.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.983+0000 7f7943b14700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793c105860 con 0x7f793c10f730 2019-11-28T11:49:33.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.983+0000 7f79420b1700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f793c10e970 0x7f793c1087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:56914/0 (socket says 172.21.15.80:56914) 2019-11-28T11:49:33.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.983+0000 7f79418b0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f793c10ed60 0x7f793c10f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:33.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f79420b1700 1 -- 172.21.15.80:0/1771981378 learned_addr learned my addr 172.21.15.80:0/1771981378 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:33.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f79428b2700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c10f730 0x7f793c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:33.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f79428b2700 1 -- 172.21.15.80:0/1771981378 >> v2:172.21.15.174:3300/0 conn(0x7f793c10ed60 msgr2=0x7f793c10f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:33.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f79428b2700 1 --2- 172.21.15.80:0/1771981378 >> v2:172.21.15.174:3300/0 conn(0x7f793c10ed60 0x7f793c10f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:33.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f79428b2700 1 -- 172.21.15.80:0/1771981378 >> v1:172.21.15.174:6789/0 conn(0x7f793c10e970 legacy=0x7f793c1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:33.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f79428b2700 1 -- 172.21.15.80:0/1771981378 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c105ef0 con 0x7f793c10f730 2019-11-28T11:49:33.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f79418b0700 1 --2- 172.21.15.80:0/1771981378 >> v2:172.21.15.174:3300/0 conn(0x7f793c10ed60 0x7f793c10f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:33.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f79428b2700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c10f730 0x7f793c167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7934010720 tx=0x7f7934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f79428b2700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c10f730 0x7f793c167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7934010720 tx=0x7f7934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f79428b2700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c10f730 0x7f793c167d70 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7f7934010720 tx=0x7f7934010ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:33.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f79428b2700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c10f730 0x7f793c167d70 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f7934010720 tx=0x7f7934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f793affd700 1 -- 172.21.15.80:0/1771981378 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7934002ea0 con 0x7f793c10f730 2019-11-28T11:49:33.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f79428b2700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c10f730 0x7f793c167d70 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f7934010720 tx=0x7f7934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f79428b2700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c10f730 0x7f793c167d70 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f7934010720 tx=0x7f7934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f793affd700 1 -- 172.21.15.80:0/1771981378 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7934009d60 con 0x7f793c10f730 2019-11-28T11:49:33.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f7943b14700 1 -- 172.21.15.80:0/1771981378 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793c106270 con 0x7f793c10f730 2019-11-28T11:49:33.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f793affd700 1 -- 172.21.15.80:0/1771981378 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f793400a470 con 0x7f793c10f730 2019-11-28T11:49:33.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.984+0000 7f7943b14700 1 -- 172.21.15.80:0/1771981378 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793c105ef0 con 0x7f793c10f730 2019-11-28T11:49:33.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.985+0000 7f79428b2700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c10f730 0x7f793c167d70 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f7934010720 tx=0x7f7934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.985+0000 7f793affd700 1 -- 172.21.15.80:0/1771981378 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7934009a20 con 0x7f793c10f730 2019-11-28T11:49:33.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.985+0000 7f79428b2700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c10f730 0x7f793c167d70 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f7934010720 tx=0x7f7934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.985+0000 7f793affd700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7920018730 0x7f792001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:33.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.985+0000 7f793affd700 1 -- 172.21.15.80:0/1771981378 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5904+0+0 (secure 0 0 0) 0x7f7934031e10 con 0x7f793c10f730 2019-11-28T11:49:33.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.985+0000 7f79420b1700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7920018730 0x7f792001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:33.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.986+0000 7f79420b1700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7920018730 0x7f792001abc0 crc :-1 s=READY pgs=831 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:33.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.993+0000 7f7943b14700 1 -- 172.21.15.80:0/1771981378 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f793c106270 con 0x7f793c10f730 2019-11-28T11:49:33.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.997+0000 7f79428b2700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c10f730 0x7f793c167d70 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f7934010720 tx=0x7f7934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:32.997+0000 7f793affd700 1 -- 172.21.15.80:0/1771981378 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7934009810 con 0x7f793c10f730 2019-11-28T11:49:33.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.163+0000 7f7943b14700 1 -- 172.21.15.80:0/1771981378 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f793c105ef0 con 0x7f793c10f730 2019-11-28T11:49:33.213 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:49:33.164+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:49:33.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.170+0000 7f79428b2700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c10f730 0x7f793c167d70 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f7934010720 tx=0x7f7934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.170+0000 7f793affd700 1 -- 172.21.15.80:0/1771981378 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 26 and data pool 27 v120) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7934009c60 con 0x7f793c10f730 2019-11-28T11:49:33.220 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 26 and data pool 27 2019-11-28T11:49:33.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.174+0000 7f7943b14700 1 -- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7920018730 msgr2=0x7f792001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:33.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.174+0000 7f7943b14700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7920018730 0x7f792001abc0 crc :-1 s=READY pgs=831 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:33.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.174+0000 7f7943b14700 1 -- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c10f730 msgr2=0x7f793c167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:33.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.174+0000 7f7943b14700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c10f730 0x7f793c167d70 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7f7934010720 tx=0x7f7934010ac0).stop 2019-11-28T11:49:33.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.174+0000 7f7943b14700 1 -- 172.21.15.80:0/1771981378 shutdown_connections 2019-11-28T11:49:33.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.174+0000 7f7943b14700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f793c10f730 0x7f793c167d70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:33.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.174+0000 7f7943b14700 1 --2- 172.21.15.80:0/1771981378 >> v2:172.21.15.174:3300/0 conn(0x7f793c10ed60 0x7f793c10f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:33.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.174+0000 7f7943b14700 1 --2- 172.21.15.80:0/1771981378 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7920018730 0x7f792001abc0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:33.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.174+0000 7f7943b14700 1 -- 172.21.15.80:0/1771981378 shutdown_connections 2019-11-28T11:49:33.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.174+0000 7f7943b14700 1 -- 172.21.15.80:0/1771981378 wait complete. 2019-11-28T11:49:33.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.174+0000 7f7943b14700 1 -- 172.21.15.80:0/1771981378 >> 172.21.15.80:0/1771981378 conn(0x7f793c15e2d0 msgr2=0x7f793c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:33.232 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:49:33.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.302+0000 7f3946e7a700 1 Processor -- start 2019-11-28T11:49:33.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.302+0000 7f3946e7a700 1 -- start start 2019-11-28T11:49:33.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f3946e7a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f394006c0a0 0x7f3940072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:33.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f3946e7a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394006db00 con 0x7f39400734e0 2019-11-28T11:49:33.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f3946e7a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394006e000 con 0x7f3940072620 2019-11-28T11:49:33.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f3946e7a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394006fd60 con 0x7f394006c0a0 2019-11-28T11:49:33.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f3945417700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f394006c0a0 0x7f3940072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:33.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f3944c16700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f39400734e0 0x7f3940071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41382/0 (socket says 172.21.15.80:41382) 2019-11-28T11:49:33.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f3944c16700 1 -- 172.21.15.80:0/799991598 learned_addr learned my addr 172.21.15.80:0/799991598 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:33.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f3945417700 1 -- 172.21.15.80:0/799991598 >> v1:172.21.15.174:6789/0 conn(0x7f3940072620 legacy=0x7f3940164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:33.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f3945417700 1 -- 172.21.15.80:0/799991598 >> v1:172.21.15.80:6789/0 conn(0x7f39400734e0 legacy=0x7f3940071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:33.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f3945417700 1 -- 172.21.15.80:0/799991598 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39400706c0 con 0x7f394006c0a0 2019-11-28T11:49:33.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f393ffff700 1 -- 172.21.15.80:0/799991598 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475413643 0 0) 0x7f3930001070 con 0x7f39400734e0 2019-11-28T11:49:33.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f3945417700 1 --2- 172.21.15.80:0/799991598 >> v2:172.21.15.80:3300/0 conn(0x7f394006c0a0 0x7f3940072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f392800af50 tx=0x7f392800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f3945417700 1 --2- 172.21.15.80:0/799991598 >> v2:172.21.15.80:3300/0 conn(0x7f394006c0a0 0x7f3940072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f392800af50 tx=0x7f392800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f3945417700 1 --2- 172.21.15.80:0/799991598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f394006c0a0 0x7f3940072fa0 secure :-1 s=READY pgs=2051 cs=0 l=1 rx=0x7f392800af50 tx=0x7f392800b760).ready entity=mon.0 client_cookie=1f830af62a7db0bb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:33.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f3945417700 1 --2- 172.21.15.80:0/799991598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f394006c0a0 0x7f3940072fa0 secure :-1 s=THROTTLE_DONE pgs=2051 cs=0 l=1 rx=0x7f392800af50 tx=0x7f392800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f393ffff700 1 -- 172.21.15.80:0/799991598 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3928000960 con 0x7f394006c0a0 2019-11-28T11:49:33.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f3945417700 1 --2- 172.21.15.80:0/799991598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f394006c0a0 0x7f3940072fa0 secure :-1 s=THROTTLE_DONE pgs=2051 cs=0 l=1 rx=0x7f392800af50 tx=0x7f392800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.303+0000 7f3945417700 1 --2- 172.21.15.80:0/799991598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f394006c0a0 0x7f3940072fa0 secure :-1 s=THROTTLE_DONE pgs=2051 cs=0 l=1 rx=0x7f392800af50 tx=0x7f392800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.304+0000 7f393ffff700 1 -- 172.21.15.80:0/799991598 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3928009860 con 0x7f394006c0a0 2019-11-28T11:49:33.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.304+0000 7f393ffff700 1 -- 172.21.15.80:0/799991598 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3928009f30 con 0x7f394006c0a0 2019-11-28T11:49:33.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.304+0000 7f3946e7a700 1 -- 172.21.15.80:0/799991598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f394006c0a0 msgr2=0x7f3940072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:33.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.304+0000 7f3946e7a700 1 --2- 172.21.15.80:0/799991598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f394006c0a0 0x7f3940072fa0 secure :-1 s=READY pgs=2051 cs=0 l=1 rx=0x7f392800af50 tx=0x7f392800b760).stop 2019-11-28T11:49:33.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.304+0000 7f3946e7a700 1 -- 172.21.15.80:0/799991598 shutdown_connections 2019-11-28T11:49:33.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.304+0000 7f3946e7a700 1 --2- 172.21.15.80:0/799991598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f394006c0a0 0x7f3940072fa0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:33.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.304+0000 7f3946e7a700 1 -- 172.21.15.80:0/799991598 shutdown_connections 2019-11-28T11:49:33.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.304+0000 7f3946e7a700 1 -- 172.21.15.80:0/799991598 wait complete. 2019-11-28T11:49:33.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.304+0000 7f3946e7a700 1 -- 172.21.15.80:0/799991598 >> 172.21.15.80:0/799991598 conn(0x7f3940061cf0 msgr2=0x7f3940064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:33.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.307+0000 7f3946e7a700 1 Processor -- start 2019-11-28T11:49:33.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.307+0000 7f3946e7a700 1 -- start start 2019-11-28T11:49:33.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f3946e7a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39401346b0 0x7f3940135040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:33.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f3946e7a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3940135580 0x7f3940135a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:33.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f3946e7a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394013f410 con 0x7f39401342c0 2019-11-28T11:49:33.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f3946e7a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3940141670 con 0x7f3940135580 2019-11-28T11:49:33.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f3946e7a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3940141940 con 0x7f39401346b0 2019-11-28T11:49:33.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f3944c16700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39401346b0 0x7f3940135040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:33.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f3944c16700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39401346b0 0x7f3940135040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:44330/0 (socket says 172.21.15.80:44330) 2019-11-28T11:49:33.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f3945c18700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3940135580 0x7f3940135a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:33.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f3944c16700 1 -- 172.21.15.80:0/2052071926 learned_addr learned my addr 172.21.15.80:0/2052071926 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:33.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f393dffb700 1 -- 172.21.15.80:0/2052071926 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997667444 0 0) 0x7f3928000940 con 0x7f39401342c0 2019-11-28T11:49:33.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f393dffb700 1 -- 172.21.15.80:0/2052071926 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3924002e80 con 0x7f39401342c0 2019-11-28T11:49:33.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f3944c16700 1 -- 172.21.15.80:0/2052071926 >> v2:172.21.15.174:3300/0 conn(0x7f3940135580 msgr2=0x7f3940135a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:33.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f3944c16700 1 --2- 172.21.15.80:0/2052071926 >> v2:172.21.15.174:3300/0 conn(0x7f3940135580 0x7f3940135a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:33.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f3944c16700 1 -- 172.21.15.80:0/2052071926 >> v1:172.21.15.174:6789/0 conn(0x7f39401342c0 legacy=0x7f39401361c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:33.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f3944c16700 1 -- 172.21.15.80:0/2052071926 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3940141fd0 con 0x7f39401346b0 2019-11-28T11:49:33.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f3945c18700 1 --2- 172.21.15.80:0/2052071926 >> v2:172.21.15.174:3300/0 conn(0x7f3940135580 0x7f3940135a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:33.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.308+0000 7f3944c16700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39401346b0 0x7f3940135040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3930010440 tx=0x7f39300107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.309+0000 7f3944c16700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39401346b0 0x7f3940135040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3930010440 tx=0x7f39300107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.309+0000 7f3944c16700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39401346b0 0x7f3940135040 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7f3930010440 tx=0x7f39300107e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:33.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.309+0000 7f3944c16700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39401346b0 0x7f3940135040 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f3930010440 tx=0x7f39300107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.309+0000 7f393dffb700 1 -- 172.21.15.80:0/2052071926 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3930000df0 con 0x7f39401346b0 2019-11-28T11:49:33.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.309+0000 7f3944c16700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39401346b0 0x7f3940135040 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f3930010440 tx=0x7f39300107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.309+0000 7f393dffb700 1 -- 172.21.15.80:0/2052071926 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39300041d0 con 0x7f39401346b0 2019-11-28T11:49:33.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.309+0000 7f3944c16700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39401346b0 0x7f3940135040 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f3930010440 tx=0x7f39300107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.309+0000 7f3946e7a700 1 -- 172.21.15.80:0/2052071926 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3940142350 con 0x7f39401346b0 2019-11-28T11:49:33.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.309+0000 7f393dffb700 1 -- 172.21.15.80:0/2052071926 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39300043c0 con 0x7f39401346b0 2019-11-28T11:49:33.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.309+0000 7f3946e7a700 1 -- 172.21.15.80:0/2052071926 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3940141fd0 con 0x7f39401346b0 2019-11-28T11:49:33.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.309+0000 7f3944c16700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39401346b0 0x7f3940135040 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f3930010440 tx=0x7f39300107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.309+0000 7f393dffb700 1 -- 172.21.15.80:0/2052071926 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3930000d10 con 0x7f39401346b0 2019-11-28T11:49:33.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.309+0000 7f3944c16700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39401346b0 0x7f3940135040 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f3930010440 tx=0x7f39300107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.310+0000 7f393dffb700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3924018770 0x7f392401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:33.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.310+0000 7f393dffb700 1 -- 172.21.15.80:0/2052071926 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3930031ad0 con 0x7f39401346b0 2019-11-28T11:49:33.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.310+0000 7f3945417700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3924018770 0x7f392401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:33.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.310+0000 7f3945417700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3924018770 0x7f392401abe0 crc :-1 s=READY pgs=832 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:33.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.317+0000 7f3946e7a700 1 -- 172.21.15.80:0/2052071926 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3940142350 con 0x7f39401346b0 2019-11-28T11:49:33.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.321+0000 7f3944c16700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39401346b0 0x7f3940135040 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f3930010440 tx=0x7f39300107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.321+0000 7f393dffb700 1 -- 172.21.15.80:0/2052071926 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f39300012f0 con 0x7f39401346b0 2019-11-28T11:49:33.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.495+0000 7f3946e7a700 1 -- 172.21.15.80:0/2052071926 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3940141fd0 con 0x7f39401346b0 2019-11-28T11:49:33.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.496+0000 7f3944c16700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39401346b0 0x7f3940135040 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f3930010440 tx=0x7f39300107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.497+0000 7f393dffb700 1 -- 172.21.15.80:0/2052071926 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+14884 (secure 0 0 0) 0x7f3930000cf0 con 0x7f39401346b0 2019-11-28T11:49:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:33.547 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":161,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:49:33.165719+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:49:31.434223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2019-11-28T11:49:32.127254+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:49:33.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.500+0000 7f3946e7a700 1 -- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3924018770 msgr2=0x7f392401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:33.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.500+0000 7f3946e7a700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3924018770 0x7f392401abe0 crc :-1 s=READY pgs=832 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:33.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.500+0000 7f3946e7a700 1 -- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39401346b0 msgr2=0x7f3940135040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:33.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.500+0000 7f3946e7a700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39401346b0 0x7f3940135040 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7f3930010440 tx=0x7f39300107e0).stop 2019-11-28T11:49:33.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.501+0000 7f3946e7a700 1 -- 172.21.15.80:0/2052071926 shutdown_connections 2019-11-28T11:49:33.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.501+0000 7f3946e7a700 1 --2- 172.21.15.80:0/2052071926 >> v2:172.21.15.174:3300/0 conn(0x7f3940135580 0x7f3940135a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:33.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.501+0000 7f3946e7a700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39401346b0 0x7f3940135040 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:33.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.501+0000 7f3946e7a700 1 --2- 172.21.15.80:0/2052071926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3924018770 0x7f392401abe0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:33.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.501+0000 7f3946e7a700 1 -- 172.21.15.80:0/2052071926 shutdown_connections 2019-11-28T11:49:33.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.501+0000 7f3946e7a700 1 -- 172.21.15.80:0/2052071926 wait complete. 2019-11-28T11:49:33.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.501+0000 7f3946e7a700 1 -- 172.21.15.80:0/2052071926 >> 172.21.15.80:0/2052071926 conn(0x7f3940159ae0 msgr2=0x7f394013d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:33.566 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:49:33.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.636+0000 7ff5db985700 1 Processor -- start 2019-11-28T11:49:33.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.636+0000 7ff5db985700 1 -- start start 2019-11-28T11:49:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.637+0000 7ff5db985700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5d406c490 0x7ff5d406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.637+0000 7ff5db985700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5d406ce60 0x7ff5d4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.637+0000 7ff5db985700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d406db00 con 0x7ff5d406c0a0 2019-11-28T11:49:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.637+0000 7ff5db985700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d406fd60 con 0x7ff5d406ce60 2019-11-28T11:49:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.637+0000 7ff5db985700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4070030 con 0x7ff5d406c490 2019-11-28T11:49:33.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5da723700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5d406ce60 0x7ff5d4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:33.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5da723700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5d406ce60 0x7ff5d4164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42078/0 (socket says 172.21.15.80:42078) 2019-11-28T11:49:33.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5da723700 1 -- 172.21.15.80:0/1369627940 learned_addr learned my addr 172.21.15.80:0/1369627940 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:33.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5d9721700 1 --2- 172.21.15.80:0/1369627940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5d406c490 0x7ff5d406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:33.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5da723700 1 -- 172.21.15.80:0/1369627940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5d406c490 msgr2=0x7ff5d406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:33.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5da723700 1 --2- 172.21.15.80:0/1369627940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5d406c490 0x7ff5d406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:33.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5da723700 1 -- 172.21.15.80:0/1369627940 >> v1:172.21.15.174:6789/0 conn(0x7ff5d406c0a0 legacy=0x7ff5d4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:33.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5da723700 1 -- 172.21.15.80:0/1369627940 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d40706c0 con 0x7ff5d406ce60 2019-11-28T11:49:33.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5da723700 1 --2- 172.21.15.80:0/1369627940 >> v2:172.21.15.80:3300/0 conn(0x7ff5d406ce60 0x7ff5d4164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff5cc00fa30 tx=0x7ff5cc00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5da723700 1 --2- 172.21.15.80:0/1369627940 >> v2:172.21.15.80:3300/0 conn(0x7ff5d406ce60 0x7ff5d4164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff5cc00fa30 tx=0x7ff5cc00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5da723700 1 --2- 172.21.15.80:0/1369627940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5d406ce60 0x7ff5d4164d70 secure :-1 s=READY pgs=2052 cs=0 l=1 rx=0x7ff5cc00fa30 tx=0x7ff5cc00fdd0).ready entity=mon.0 client_cookie=972239c7337830bd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:33.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5da723700 1 --2- 172.21.15.80:0/1369627940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5d406ce60 0x7ff5d4164d70 secure :-1 s=THROTTLE_DONE pgs=2052 cs=0 l=1 rx=0x7ff5cc00fa30 tx=0x7ff5cc00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5da723700 1 --2- 172.21.15.80:0/1369627940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5d406ce60 0x7ff5d4164d70 secure :-1 s=THROTTLE_DONE pgs=2052 cs=0 l=1 rx=0x7ff5cc00fa30 tx=0x7ff5cc00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5d8f20700 1 -- 172.21.15.80:0/1369627940 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5cc000df0 con 0x7ff5d406ce60 2019-11-28T11:49:33.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5da723700 1 --2- 172.21.15.80:0/1369627940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5d406ce60 0x7ff5d4164d70 secure :-1 s=THROTTLE_DONE pgs=2052 cs=0 l=1 rx=0x7ff5cc00fa30 tx=0x7ff5cc00fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5d8f20700 1 -- 172.21.15.80:0/1369627940 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc001460 con 0x7ff5d406ce60 2019-11-28T11:49:33.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5d8f20700 1 -- 172.21.15.80:0/1369627940 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5cc001b30 con 0x7ff5d406ce60 2019-11-28T11:49:33.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5db985700 1 -- 172.21.15.80:0/1369627940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5d406ce60 msgr2=0x7ff5d4164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:33.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.638+0000 7ff5db985700 1 --2- 172.21.15.80:0/1369627940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5d406ce60 0x7ff5d4164d70 secure :-1 s=READY pgs=2052 cs=0 l=1 rx=0x7ff5cc00fa30 tx=0x7ff5cc00fdd0).stop 2019-11-28T11:49:33.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.639+0000 7ff5db985700 1 -- 172.21.15.80:0/1369627940 shutdown_connections 2019-11-28T11:49:33.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.639+0000 7ff5db985700 1 --2- 172.21.15.80:0/1369627940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5d406ce60 0x7ff5d4164d70 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:33.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.639+0000 7ff5db985700 1 --2- 172.21.15.80:0/1369627940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5d406c490 0x7ff5d406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:33.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.639+0000 7ff5db985700 1 -- 172.21.15.80:0/1369627940 shutdown_connections 2019-11-28T11:49:33.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.639+0000 7ff5db985700 1 -- 172.21.15.80:0/1369627940 wait complete. 2019-11-28T11:49:33.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.639+0000 7ff5db985700 1 -- 172.21.15.80:0/1369627940 >> 172.21.15.80:0/1369627940 conn(0x7ff5d4061cf0 msgr2=0x7ff5d4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:33.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.642+0000 7ff5db985700 1 Processor -- start 2019-11-28T11:49:33.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.642+0000 7ff5db985700 1 -- start start 2019-11-28T11:49:33.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.642+0000 7ff5db985700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff5d412ea40 0x7ff5d4128980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:33.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.642+0000 7ff5db985700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d4101e80 con 0x7ff5d41284f0 2019-11-28T11:49:33.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.642+0000 7ff5db985700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d41049c0 con 0x7ff5d4142160 2019-11-28T11:49:33.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.642+0000 7ff5db985700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d4107520 con 0x7ff5d412ea40 2019-11-28T11:49:33.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5d9721700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff5d41284f0 0x7ff5d412e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41402/0 (socket says 172.21.15.80:41402) 2019-11-28T11:49:33.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5d9721700 1 -- 172.21.15.80:0/194501338 learned_addr learned my addr 172.21.15.80:0/194501338 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:33.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5da723700 1 --2- 172.21.15.80:0/194501338 >> v2:172.21.15.174:3300/0 conn(0x7ff5d412ea40 0x7ff5d4128980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:33.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5d27fc700 1 -- 172.21.15.80:0/194501338 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985049481 0 0) 0x7ff5c4005770 con 0x7ff5d41284f0 2019-11-28T11:49:33.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5d27fc700 1 -- 172.21.15.80:0/194501338 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5b8002e80 con 0x7ff5d41284f0 2019-11-28T11:49:33.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5da723700 1 -- 172.21.15.80:0/194501338 >> v1:172.21.15.174:6789/0 conn(0x7ff5d4142160 legacy=0x7ff5d410de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:33.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5da723700 1 -- 172.21.15.80:0/194501338 >> v1:172.21.15.80:6789/0 conn(0x7ff5d41284f0 legacy=0x7ff5d412e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:33.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5da723700 1 -- 172.21.15.80:0/194501338 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d4107e80 con 0x7ff5d412ea40 2019-11-28T11:49:33.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5da723700 1 --2- 172.21.15.80:0/194501338 >> v2:172.21.15.174:3300/0 conn(0x7ff5d412ea40 0x7ff5d4128980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5cc010740 tx=0x7ff5cc010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5da723700 1 --2- 172.21.15.80:0/194501338 >> v2:172.21.15.174:3300/0 conn(0x7ff5d412ea40 0x7ff5d4128980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5cc010740 tx=0x7ff5cc010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5da723700 1 --2- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5d412ea40 0x7ff5d4128980 secure :-1 s=READY pgs=1208 cs=0 l=1 rx=0x7ff5cc010740 tx=0x7ff5cc010ae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:33.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5da723700 1 --2- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5d412ea40 0x7ff5d4128980 secure :-1 s=THROTTLE_DONE pgs=1208 cs=0 l=1 rx=0x7ff5cc010740 tx=0x7ff5cc010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5d27fc700 1 -- 172.21.15.80:0/194501338 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5cc001820 con 0x7ff5d412ea40 2019-11-28T11:49:33.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5da723700 1 --2- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5d412ea40 0x7ff5d4128980 secure :-1 s=THROTTLE_DONE pgs=1208 cs=0 l=1 rx=0x7ff5cc010740 tx=0x7ff5cc010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5da723700 1 --2- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5d412ea40 0x7ff5d4128980 secure :-1 s=THROTTLE_DONE pgs=1208 cs=0 l=1 rx=0x7ff5cc010740 tx=0x7ff5cc010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5d27fc700 1 -- 172.21.15.80:0/194501338 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc001440 con 0x7ff5d412ea40 2019-11-28T11:49:33.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5db985700 1 -- 172.21.15.80:0/194501338 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d4108200 con 0x7ff5d412ea40 2019-11-28T11:49:33.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5d27fc700 1 -- 172.21.15.80:0/194501338 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5cc001e00 con 0x7ff5d412ea40 2019-11-28T11:49:33.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.643+0000 7ff5db985700 1 -- 172.21.15.80:0/194501338 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d4107e80 con 0x7ff5d412ea40 2019-11-28T11:49:33.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.644+0000 7ff5da723700 1 --2- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5d412ea40 0x7ff5d4128980 secure :-1 s=THROTTLE_DONE pgs=1208 cs=0 l=1 rx=0x7ff5cc010740 tx=0x7ff5cc010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.644+0000 7ff5d27fc700 1 -- 172.21.15.80:0/194501338 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff5cc001630 con 0x7ff5d412ea40 2019-11-28T11:49:33.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.644+0000 7ff5da723700 1 --2- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5d412ea40 0x7ff5d4128980 secure :-1 s=THROTTLE_DONE pgs=1208 cs=0 l=1 rx=0x7ff5cc010740 tx=0x7ff5cc010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.644+0000 7ff5d27fc700 1 --2- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5b8018770 0x7ff5b801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:33.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.644+0000 7ff5d27fc700 1 -- 172.21.15.80:0/194501338 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff5cc0320b0 con 0x7ff5d412ea40 2019-11-28T11:49:33.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.644+0000 7ff5d9f22700 1 --2- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5b8018770 0x7ff5b801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:33.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.645+0000 7ff5d9f22700 1 --2- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5b8018770 0x7ff5b801abe0 crc :-1 s=READY pgs=833 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:33.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.652+0000 7ff5db985700 1 -- 172.21.15.80:0/194501338 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d4108200 con 0x7ff5d412ea40 2019-11-28T11:49:33.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.656+0000 7ff5da723700 1 --2- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5d412ea40 0x7ff5d4128980 secure :-1 s=THROTTLE_DONE pgs=1208 cs=0 l=1 rx=0x7ff5cc010740 tx=0x7ff5cc010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.656+0000 7ff5d27fc700 1 -- 172.21.15.80:0/194501338 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff5cc001230 con 0x7ff5d412ea40 2019-11-28T11:49:33.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.831+0000 7ff5db985700 1 -- 172.21.15.80:0/194501338 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5d4107e80 con 0x7ff5d412ea40 2019-11-28T11:49:33.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.833+0000 7ff5da723700 1 --2- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5d412ea40 0x7ff5d4128980 secure :-1 s=THROTTLE_DONE pgs=1208 cs=0 l=1 rx=0x7ff5cc010740 tx=0x7ff5cc010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:33.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.833+0000 7ff5d27fc700 1 -- 172.21.15.80:0/194501338 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+14884 (secure 0 0 0) 0x7ff5cc021480 con 0x7ff5d412ea40 2019-11-28T11:49:33.881 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:33.881 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":161,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:49:33.165719+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:49:31.434223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2019-11-28T11:49:32.127254+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:49:33.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.834+0000 7ff5db985700 1 -- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5b8018770 msgr2=0x7ff5b801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:33.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.834+0000 7ff5db985700 1 --2- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5b8018770 0x7ff5b801abe0 crc :-1 s=READY pgs=833 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:33.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.834+0000 7ff5db985700 1 -- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5d412ea40 msgr2=0x7ff5d4128980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:33.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.834+0000 7ff5db985700 1 --2- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5d412ea40 0x7ff5d4128980 secure :-1 s=READY pgs=1208 cs=0 l=1 rx=0x7ff5cc010740 tx=0x7ff5cc010ae0).stop 2019-11-28T11:49:33.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.834+0000 7ff5db985700 1 -- 172.21.15.80:0/194501338 shutdown_connections 2019-11-28T11:49:33.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.834+0000 7ff5db985700 1 --2- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5d412ea40 0x7ff5d4128980 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:33.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.834+0000 7ff5db985700 1 --2- 172.21.15.80:0/194501338 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5b8018770 0x7ff5b801abe0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:33.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.834+0000 7ff5db985700 1 -- 172.21.15.80:0/194501338 shutdown_connections 2019-11-28T11:49:33.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.834+0000 7ff5db985700 1 -- 172.21.15.80:0/194501338 wait complete. 2019-11-28T11:49:33.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.835+0000 7ff5db985700 1 -- 172.21.15.80:0/194501338 >> 172.21.15.80:0/194501338 conn(0x7ff5d415e210 msgr2=0x7ff5d410b140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:33.907 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:49:34.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.982+0000 7fa7d3013700 1 Processor -- start 2019-11-28T11:49:34.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.983+0000 7fa7d3013700 1 -- start start 2019-11-28T11:49:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.983+0000 7fa7d3013700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7cc1639f0 0x7fa7cc165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.983+0000 7fa7d3013700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7cc06db60 con 0x7fa7cc15f100 2019-11-28T11:49:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.983+0000 7fa7d3013700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7cc06e060 con 0x7fa7cc15ed10 2019-11-28T11:49:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.983+0000 7fa7d3013700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc06fe00 con 0x7fa7cc1639f0 2019-11-28T11:49:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7d0daf700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa7cc15f100 0x7fa7cc06bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41410/0 (socket says 172.21.15.80:41410) 2019-11-28T11:49:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7d0daf700 1 -- 172.21.15.80:0/987910944 learned_addr learned my addr 172.21.15.80:0/987910944 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7d1db1700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7cc1639f0 0x7fa7cc165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7cbfff700 1 -- 172.21.15.80:0/987910944 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154347324 0 0) 0x7fa7bc0014d0 con 0x7fa7cc15f100 2019-11-28T11:49:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7cbfff700 1 -- 172.21.15.80:0/987910944 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7b8002e80 con 0x7fa7cc15f100 2019-11-28T11:49:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7cbfff700 1 -- 172.21.15.80:0/987910944 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2308508792 0 0) 0x7fa7bc0014b0 con 0x7fa7cc15f100 2019-11-28T11:49:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7cbfff700 1 -- 172.21.15.80:0/987910944 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7cc1639f0 msgr2=0x7fa7cc165df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7cbfff700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7cc1639f0 0x7fa7cc165df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7cbfff700 1 -- 172.21.15.80:0/987910944 >> v1:172.21.15.174:6789/0 conn(0x7fa7cc15ed10 legacy=0x7fa7cc073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7cbfff700 1 -- 172.21.15.80:0/987910944 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc070760 con 0x7fa7cc15f100 2019-11-28T11:49:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7cbfff700 1 -- 172.21.15.80:0/987910944 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fa7bc0019e0 con 0x7fa7cc15f100 2019-11-28T11:49:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7cbfff700 1 -- 172.21.15.80:0/987910944 >> v1:172.21.15.80:6789/0 conn(0x7fa7cc15f100 legacy=0x7fa7cc06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7cbfff700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7b8003a80 0x7fa7b8005ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7cbfff700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b8006690 0x7fa7b8008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7cbfff700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b80093a0 0x7fa7b800b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7cbfff700 1 -- 172.21.15.80:0/987910944 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b800bff0 con 0x7fa7b8006690 2019-11-28T11:49:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7cbfff700 1 -- 172.21.15.80:0/987910944 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b80501f0 con 0x7fa7b8003a80 2019-11-28T11:49:34.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7cbfff700 1 -- 172.21.15.80:0/987910944 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b8050420 con 0x7fa7b80093a0 2019-11-28T11:49:34.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b8006690 0x7fa7b8008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:34.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7d1db1700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b80093a0 0x7fa7b800b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:34.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.984+0000 7fa7d15b0700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7b8003a80 0x7fa7b8005ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:34.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7d0daf700 1 -- 172.21.15.80:0/987910944 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b80093a0 msgr2=0x7fa7b800b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:34.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7b80093a0 0x7fa7b800b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:34.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7d0daf700 1 -- 172.21.15.80:0/987910944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7b8003a80 msgr2=0x7fa7b8005ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:34.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7b8003a80 0x7fa7b8005ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:34.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7d0daf700 1 -- 172.21.15.80:0/987910944 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b80506d0 con 0x7fa7b8006690 2019-11-28T11:49:34.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b8006690 0x7fa7b8008b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa7bc00fc10 tx=0x7fa7bc002150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:34.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b8006690 0x7fa7b8008b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa7bc00fc10 tx=0x7fa7bc002150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:34.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b8006690 0x7fa7b8008b40 secure :-1 s=READY pgs=2055 cs=0 l=1 rx=0x7fa7bc00fc10 tx=0x7fa7bc002150).ready entity=mon.0 client_cookie=76aec059baf36a00 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:34.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b8006690 0x7fa7b8008b40 secure :-1 s=THROTTLE_DONE pgs=2055 cs=0 l=1 rx=0x7fa7bc00fc10 tx=0x7fa7bc002150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:34.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7cbfff700 1 -- 172.21.15.80:0/987910944 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7bc0014b0 con 0x7fa7b8006690 2019-11-28T11:49:34.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b8006690 0x7fa7b8008b40 secure :-1 s=THROTTLE_DONE pgs=2055 cs=0 l=1 rx=0x7fa7bc00fc10 tx=0x7fa7bc002150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:34.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7cbfff700 1 -- 172.21.15.80:0/987910944 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc001010 con 0x7fa7b8006690 2019-11-28T11:49:34.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b8006690 0x7fa7b8008b40 secure :-1 s=THROTTLE_DONE pgs=2055 cs=0 l=1 rx=0x7fa7bc00fc10 tx=0x7fa7bc002150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:34.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7cbfff700 1 -- 172.21.15.80:0/987910944 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7bc0014b0 con 0x7fa7b8006690 2019-11-28T11:49:34.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7d3013700 1 -- 172.21.15.80:0/987910944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b8006690 msgr2=0x7fa7b8008b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:34.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7d3013700 1 --2- 172.21.15.80:0/987910944 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7b8006690 0x7fa7b8008b40 secure :-1 s=READY pgs=2055 cs=0 l=1 rx=0x7fa7bc00fc10 tx=0x7fa7bc002150).stop 2019-11-28T11:49:34.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.985+0000 7fa7d1db1700 1 -- 172.21.15.80:0/987910944 reap_dead start 2019-11-28T11:49:34.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.986+0000 7fa7d3013700 1 -- 172.21.15.80:0/987910944 shutdown_connections 2019-11-28T11:49:34.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.986+0000 7fa7d3013700 1 -- 172.21.15.80:0/987910944 shutdown_connections 2019-11-28T11:49:34.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.986+0000 7fa7d3013700 1 -- 172.21.15.80:0/987910944 wait complete. 2019-11-28T11:49:34.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.986+0000 7fa7d3013700 1 -- 172.21.15.80:0/987910944 >> 172.21.15.80:0/987910944 conn(0x7fa7cc061d20 msgr2=0x7fa7cc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:34.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.988+0000 7fa7d3013700 1 Processor -- start 2019-11-28T11:49:34.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.988+0000 7fa7d3013700 1 -- start start 2019-11-28T11:49:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.989+0000 7fa7d3013700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa7cc131490 0x7fa7cc131920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.989+0000 7fa7d3013700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7cc131e60 0x7fa7cc16ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.989+0000 7fa7d3013700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7cc15ddb0 con 0x7fa7cc108920 2019-11-28T11:49:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.989+0000 7fa7d3013700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7cc11ec40 con 0x7fa7cc131490 2019-11-28T11:49:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.989+0000 7fa7d3013700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc1197e0 con 0x7fa7cc131e60 2019-11-28T11:49:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.989+0000 7fa7d15b0700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa7cc108920 0x7fa7cc132610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41418/0 (socket says 172.21.15.80:41418) 2019-11-28T11:49:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.989+0000 7fa7d15b0700 1 -- 172.21.15.80:0/3500202473 learned_addr learned my addr 172.21.15.80:0/3500202473 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.989+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/3500202473 >> v2:172.21.15.174:3300/0 conn(0x7fa7cc131490 0x7fa7cc131920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.989+0000 7fa7d1db1700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7cc131e60 0x7fa7cc16ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.989+0000 7fa7c9ffb700 1 -- 172.21.15.80:0/3500202473 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109902626 0 0) 0x7fa7b400e0c0 con 0x7fa7cc108920 2019-11-28T11:49:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7c9ffb700 1 -- 172.21.15.80:0/3500202473 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7b0002e80 con 0x7fa7cc108920 2019-11-28T11:49:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7d0daf700 1 -- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7cc131e60 msgr2=0x7fa7cc16ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7cc131e60 0x7fa7cc16ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7d0daf700 1 -- 172.21.15.80:0/3500202473 >> v1:172.21.15.80:6789/0 conn(0x7fa7cc108920 legacy=0x7fa7cc132610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7d0daf700 1 -- 172.21.15.80:0/3500202473 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc1300d0 con 0x7fa7cc131490 2019-11-28T11:49:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7d1db1700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7cc131e60 0x7fa7cc16ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/3500202473 >> v2:172.21.15.174:3300/0 conn(0x7fa7cc131490 0x7fa7cc131920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7bc010730 tx=0x7fa7bc010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/3500202473 >> v2:172.21.15.174:3300/0 conn(0x7fa7cc131490 0x7fa7cc131920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7bc010730 tx=0x7fa7bc010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7cc131490 0x7fa7cc131920 secure :-1 s=READY pgs=1210 cs=0 l=1 rx=0x7fa7bc010730 tx=0x7fa7bc010ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7cc131490 0x7fa7cc131920 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7fa7bc010730 tx=0x7fa7bc010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7c9ffb700 1 -- 172.21.15.80:0/3500202473 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7bc001010 con 0x7fa7cc131490 2019-11-28T11:49:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7cc131490 0x7fa7cc131920 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7fa7bc010730 tx=0x7fa7bc010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7c9ffb700 1 -- 172.21.15.80:0/3500202473 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc0047b0 con 0x7fa7cc131490 2019-11-28T11:49:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7cc131490 0x7fa7cc131920 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7fa7bc010730 tx=0x7fa7bc010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:34.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7d3013700 1 -- 172.21.15.80:0/3500202473 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7cc11e510 con 0x7fa7cc131490 2019-11-28T11:49:34.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7c9ffb700 1 -- 172.21.15.80:0/3500202473 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7bc0049a0 con 0x7fa7cc131490 2019-11-28T11:49:34.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7d3013700 1 -- 172.21.15.80:0/3500202473 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7cc1300d0 con 0x7fa7cc131490 2019-11-28T11:49:34.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.990+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7cc131490 0x7fa7cc131920 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7fa7bc010730 tx=0x7fa7bc010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:34.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.991+0000 7fa7c9ffb700 1 -- 172.21.15.80:0/3500202473 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa7bc0049a0 con 0x7fa7cc131490 2019-11-28T11:49:34.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.991+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7cc131490 0x7fa7cc131920 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7fa7bc010730 tx=0x7fa7bc010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:34.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.991+0000 7fa7c9ffb700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7b0018770 0x7fa7b001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:34.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.991+0000 7fa7c9ffb700 1 -- 172.21.15.80:0/3500202473 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa7bc031d70 con 0x7fa7cc131490 2019-11-28T11:49:34.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.991+0000 7fa7d15b0700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7b0018770 0x7fa7b001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:34.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.991+0000 7fa7d15b0700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7b0018770 0x7fa7b001abe0 crc :-1 s=READY pgs=834 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:34.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:33.998+0000 7fa7d3013700 1 -- 172.21.15.80:0/3500202473 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7cc11e510 con 0x7fa7cc131490 2019-11-28T11:49:34.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:34.001+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7cc131490 0x7fa7cc131920 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7fa7bc010730 tx=0x7fa7bc010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:34.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:34.001+0000 7fa7c9ffb700 1 -- 172.21.15.80:0/3500202473 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa7bc000cc0 con 0x7fa7cc131490 2019-11-28T11:49:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:34.174+0000 7fa7d3013700 1 -- 172.21.15.80:0/3500202473 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7fa7cc1300d0 con 0x7fa7cc131490 2019-11-28T11:49:35.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.176+0000 7fa7d0daf700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7cc131490 0x7fa7cc131920 secure :-1 s=THROTTLE_DONE pgs=1210 cs=0 l=1 rx=0x7fa7bc010730 tx=0x7fa7bc010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.176+0000 7fa7c9ffb700 1 -- 172.21.15.80:0/3500202473 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v121) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa7bc0049a0 con 0x7fa7cc131490 2019-11-28T11:49:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.192+0000 7fa7d3013700 1 -- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7b0018770 msgr2=0x7fa7b001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.192+0000 7fa7d3013700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7b0018770 0x7fa7b001abe0 crc :-1 s=READY pgs=834 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.192+0000 7fa7d3013700 1 -- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7cc131490 msgr2=0x7fa7cc131920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.192+0000 7fa7d3013700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7cc131490 0x7fa7cc131920 secure :-1 s=READY pgs=1210 cs=0 l=1 rx=0x7fa7bc010730 tx=0x7fa7bc010ad0).stop 2019-11-28T11:49:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.193+0000 7fa7d3013700 1 -- 172.21.15.80:0/3500202473 shutdown_connections 2019-11-28T11:49:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.193+0000 7fa7d3013700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7b0018770 0x7fa7b001abe0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.193+0000 7fa7d3013700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7cc131e60 0x7fa7cc16ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.193+0000 7fa7d3013700 1 --2- 172.21.15.80:0/3500202473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7cc131490 0x7fa7cc131920 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.193+0000 7fa7d3013700 1 -- 172.21.15.80:0/3500202473 shutdown_connections 2019-11-28T11:49:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.193+0000 7fa7d3013700 1 -- 172.21.15.80:0/3500202473 wait complete. 2019-11-28T11:49:35.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.193+0000 7fa7d3013700 1 -- 172.21.15.80:0/3500202473 >> 172.21.15.80:0/3500202473 conn(0x7fa7cc14dbb0 msgr2=0x7fa7cc142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:35.251 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:49:35.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.324+0000 7faad1df2700 1 Processor -- start 2019-11-28T11:49:35.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.324+0000 7faad1df2700 1 -- start start 2019-11-28T11:49:35.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.325+0000 7faad1df2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faacc06c0a0 0x7faacc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:35.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.325+0000 7faad1df2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc0734e0 0x7faacc071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:35.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.325+0000 7faad1df2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc06db00 con 0x7faacc072360 2019-11-28T11:49:35.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.325+0000 7faad1df2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faacc06fd60 con 0x7faacc06c0a0 2019-11-28T11:49:35.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.325+0000 7faad1df2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faacc070030 con 0x7faacc0734e0 2019-11-28T11:49:35.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faacbfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faacc06c0a0 0x7faacc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:35.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faac3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc0734e0 0x7faacc071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:35.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faacbfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faacc06c0a0 0x7faacc072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:56996/0 (socket says 172.21.15.80:56996) 2019-11-28T11:49:35.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faacbfff700 1 -- 172.21.15.80:0/1584228695 learned_addr learned my addr 172.21.15.80:0/1584228695 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:35.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faad0b90700 1 --1- 172.21.15.80:0/1584228695 >> v1:172.21.15.174:6789/0 conn(0x7faacc072360 0x7faacc06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:56974/0 (socket says 172.21.15.80:56974) 2019-11-28T11:49:35.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faac3fff700 1 -- 172.21.15.80:0/1584228695 >> v2:172.21.15.174:3300/0 conn(0x7faacc06c0a0 msgr2=0x7faacc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:35.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faac3fff700 1 --2- 172.21.15.80:0/1584228695 >> v2:172.21.15.174:3300/0 conn(0x7faacc06c0a0 0x7faacc072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:35.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faac3fff700 1 -- 172.21.15.80:0/1584228695 >> v1:172.21.15.174:6789/0 conn(0x7faacc072360 legacy=0x7faacc06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:35.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faac3fff700 1 -- 172.21.15.80:0/1584228695 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc0706c0 con 0x7faacc0734e0 2019-11-28T11:49:35.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faacb7fe700 1 -- 172.21.15.80:0/1584228695 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911290687 0 0) 0x7faac4001400 con 0x7faacc072360 2019-11-28T11:49:35.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faacbfff700 1 --2- 172.21.15.80:0/1584228695 >> v2:172.21.15.174:3300/0 conn(0x7faacc06c0a0 0x7faacc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:35.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faac3fff700 1 --2- 172.21.15.80:0/1584228695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc0734e0 0x7faacc071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faab400af50 tx=0x7faab400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faac3fff700 1 --2- 172.21.15.80:0/1584228695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc0734e0 0x7faacc071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faab400af50 tx=0x7faab400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faac3fff700 1 --2- 172.21.15.80:0/1584228695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc0734e0 0x7faacc071e20 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7faab400af50 tx=0x7faab400b760).ready entity=mon.2 client_cookie=464ae7e326517f51 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:35.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faac3fff700 1 --2- 172.21.15.80:0/1584228695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc0734e0 0x7faacc071e20 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7faab400af50 tx=0x7faab400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faacb7fe700 1 -- 172.21.15.80:0/1584228695 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faab4007210 con 0x7faacc0734e0 2019-11-28T11:49:35.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faac3fff700 1 --2- 172.21.15.80:0/1584228695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc0734e0 0x7faacc071e20 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7faab400af50 tx=0x7faab400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faac3fff700 1 --2- 172.21.15.80:0/1584228695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc0734e0 0x7faacc071e20 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7faab400af50 tx=0x7faab400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faacb7fe700 1 -- 172.21.15.80:0/1584228695 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab40099b0 con 0x7faacc0734e0 2019-11-28T11:49:35.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faacb7fe700 1 -- 172.21.15.80:0/1584228695 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faab400a080 con 0x7faacc0734e0 2019-11-28T11:49:35.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faad1df2700 1 -- 172.21.15.80:0/1584228695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc0734e0 msgr2=0x7faacc071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:35.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.326+0000 7faad1df2700 1 --2- 172.21.15.80:0/1584228695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc0734e0 0x7faacc071e20 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7faab400af50 tx=0x7faab400b760).stop 2019-11-28T11:49:35.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.327+0000 7faad1df2700 1 -- 172.21.15.80:0/1584228695 shutdown_connections 2019-11-28T11:49:35.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.327+0000 7faad1df2700 1 --2- 172.21.15.80:0/1584228695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc0734e0 0x7faacc071e20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:35.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.327+0000 7faad1df2700 1 --2- 172.21.15.80:0/1584228695 >> v2:172.21.15.174:3300/0 conn(0x7faacc06c0a0 0x7faacc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:35.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.327+0000 7faad1df2700 1 -- 172.21.15.80:0/1584228695 shutdown_connections 2019-11-28T11:49:35.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.327+0000 7faad1df2700 1 -- 172.21.15.80:0/1584228695 wait complete. 2019-11-28T11:49:35.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.327+0000 7faad1df2700 1 -- 172.21.15.80:0/1584228695 >> 172.21.15.80:0/1584228695 conn(0x7faacc061cf0 msgr2=0x7faacc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:35.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.330+0000 7faad1df2700 1 Processor -- start 2019-11-28T11:49:35.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.330+0000 7faad1df2700 1 -- start start 2019-11-28T11:49:35.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.330+0000 7faad1df2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc109e40 0x7faacc10a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:35.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.330+0000 7faad1df2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc13f1e0 con 0x7faacc13eb40 2019-11-28T11:49:35.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.330+0000 7faad1df2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc131a30 con 0x7faacc10a810 2019-11-28T11:49:35.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.330+0000 7faad1df2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faacc1234c0 con 0x7faacc109e40 2019-11-28T11:49:35.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faacbfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faacc13eb40 0x7faacc10afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41432/0 (socket says 172.21.15.80:41432) 2019-11-28T11:49:35.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faacbfff700 1 -- 172.21.15.80:0/1034668433 learned_addr learned my addr 172.21.15.80:0/1034668433 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:35.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac3fff700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc109e40 0x7faacc10a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:35.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac97fa700 1 -- 172.21.15.80:0/1034668433 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172379984 0 0) 0x7faabc0079a0 con 0x7faacc13eb40 2019-11-28T11:49:35.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac97fa700 1 -- 172.21.15.80:0/1034668433 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab0002e80 con 0x7faacc13eb40 2019-11-28T11:49:35.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac97fa700 1 -- 172.21.15.80:0/1034668433 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575206765 0 0) 0x7faac4001400 con 0x7faacc10a810 2019-11-28T11:49:35.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac97fa700 1 -- 172.21.15.80:0/1034668433 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab00030b0 con 0x7faacc10a810 2019-11-28T11:49:35.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac3fff700 1 -- 172.21.15.80:0/1034668433 >> v1:172.21.15.174:6789/0 conn(0x7faacc10a810 legacy=0x7faacc105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:35.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac3fff700 1 -- 172.21.15.80:0/1034668433 >> v1:172.21.15.80:6789/0 conn(0x7faacc13eb40 legacy=0x7faacc10afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:35.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac3fff700 1 -- 172.21.15.80:0/1034668433 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc108700 con 0x7faacc109e40 2019-11-28T11:49:35.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac3fff700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc109e40 0x7faacc10a2d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faab4010390 tx=0x7faab4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac3fff700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc109e40 0x7faacc10a2d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faab4010390 tx=0x7faab4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac3fff700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc109e40 0x7faacc10a2d0 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7faab4010390 tx=0x7faab4010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:35.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac3fff700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc109e40 0x7faacc10a2d0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7faab4010390 tx=0x7faab4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac97fa700 1 -- 172.21.15.80:0/1034668433 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faab400afb0 con 0x7faacc109e40 2019-11-28T11:49:35.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac3fff700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc109e40 0x7faacc10a2d0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7faab4010390 tx=0x7faab4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac3fff700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc109e40 0x7faacc10a2d0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7faab4010390 tx=0x7faab4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac97fa700 1 -- 172.21.15.80:0/1034668433 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab400b1b0 con 0x7faacc109e40 2019-11-28T11:49:35.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faad1df2700 1 -- 172.21.15.80:0/1034668433 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faacc108a80 con 0x7faacc109e40 2019-11-28T11:49:35.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faac97fa700 1 -- 172.21.15.80:0/1034668433 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faab4009d60 con 0x7faacc109e40 2019-11-28T11:49:35.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.331+0000 7faad1df2700 1 -- 172.21.15.80:0/1034668433 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faacc108700 con 0x7faacc109e40 2019-11-28T11:49:35.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.332+0000 7faac3fff700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc109e40 0x7faacc10a2d0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7faab4010390 tx=0x7faab4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.332+0000 7faac97fa700 1 -- 172.21.15.80:0/1034668433 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7faab4009790 con 0x7faacc109e40 2019-11-28T11:49:35.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.332+0000 7faac3fff700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc109e40 0x7faacc10a2d0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7faab4010390 tx=0x7faab4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.332+0000 7faac97fa700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faab0018750 0x7faab001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:35.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.332+0000 7faac97fa700 1 -- 172.21.15.80:0/1034668433 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7faab4031a80 con 0x7faacc109e40 2019-11-28T11:49:35.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.332+0000 7faacbfff700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faab0018750 0x7faab001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:35.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.332+0000 7faacbfff700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faab0018750 0x7faab001abe0 crc :-1 s=READY pgs=835 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:35.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.339+0000 7faad1df2700 1 -- 172.21.15.80:0/1034668433 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faacc108a80 con 0x7faacc109e40 2019-11-28T11:49:35.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.343+0000 7faac3fff700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc109e40 0x7faacc10a2d0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7faab4010390 tx=0x7faab4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.343+0000 7faac97fa700 1 -- 172.21.15.80:0/1034668433 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7faab4009580 con 0x7faacc109e40 2019-11-28T11:49:35.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.514+0000 7faad1df2700 1 -- 172.21.15.80:0/1034668433 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faacc108700 con 0x7faacc109e40 2019-11-28T11:49:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.514+0000 7faac3fff700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc109e40 0x7faacc10a2d0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7faab4010390 tx=0x7faab4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.515+0000 7faac97fa700 1 -- 172.21.15.80:0/1034668433 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+1428 (secure 0 0 0) 0x7faab4017a40 con 0x7faacc109e40 2019-11-28T11:49:35.563 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 121 2019-11-28T11:49:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:35.563 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":121,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:49:35.168586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:49:35.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.517+0000 7faad1df2700 1 -- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faab0018750 msgr2=0x7faab001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:35.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.517+0000 7faad1df2700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faab0018750 0x7faab001abe0 crc :-1 s=READY pgs=835 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:35.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.517+0000 7faad1df2700 1 -- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc109e40 msgr2=0x7faacc10a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:35.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.517+0000 7faad1df2700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc109e40 0x7faacc10a2d0 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7faab4010390 tx=0x7faab4010730).stop 2019-11-28T11:49:35.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.517+0000 7faad1df2700 1 -- 172.21.15.80:0/1034668433 shutdown_connections 2019-11-28T11:49:35.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.517+0000 7faad1df2700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faab0018750 0x7faab001abe0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:35.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.517+0000 7faad1df2700 1 --2- 172.21.15.80:0/1034668433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faacc109e40 0x7faacc10a2d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:35.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.517+0000 7faad1df2700 1 -- 172.21.15.80:0/1034668433 shutdown_connections 2019-11-28T11:49:35.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.517+0000 7faad1df2700 1 -- 172.21.15.80:0/1034668433 wait complete. 2019-11-28T11:49:35.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.517+0000 7faad1df2700 1 -- 172.21.15.80:0/1034668433 >> 172.21.15.80:0/1034668433 conn(0x7faacc11bfc0 msgr2=0x7faacc141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:35.576 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:49:35.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.646+0000 7ff7cd5a6700 1 Processor -- start 2019-11-28T11:49:35.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.646+0000 7ff7cd5a6700 1 -- start start 2019-11-28T11:49:35.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.647+0000 7ff7cd5a6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7c806c0a0 0x7ff7c8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:35.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.647+0000 7ff7cd5a6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff7c80734e0 0x7ff7c8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:35.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.647+0000 7ff7cd5a6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7c8072360 0x7ff7c80727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:35.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.647+0000 7ff7cd5a6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c806f330 con 0x7ff7c8072360 2019-11-28T11:49:35.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.647+0000 7ff7cd5a6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c80706c0 con 0x7ff7c80734e0 2019-11-28T11:49:35.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.647+0000 7ff7cd5a6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8070a40 con 0x7ff7c806c0a0 2019-11-28T11:49:35.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.647+0000 7ff7c7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7c8072360 0x7ff7c80727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:35.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.647+0000 7ff7c7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7c8072360 0x7ff7c80727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42126/0 (socket says 172.21.15.80:42126) 2019-11-28T11:49:35.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.647+0000 7ff7c7fff700 1 -- 172.21.15.80:0/532083579 learned_addr learned my addr 172.21.15.80:0/532083579 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:35.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c6ffd700 1 --2- 172.21.15.80:0/532083579 >> v2:172.21.15.174:3300/0 conn(0x7ff7c80734e0 0x7ff7c8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:35.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c77fe700 1 --2- 172.21.15.80:0/532083579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7c806c0a0 0x7ff7c8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:35.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c7fff700 1 -- 172.21.15.80:0/532083579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7c806c0a0 msgr2=0x7ff7c8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:35.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/532083579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7c806c0a0 0x7ff7c8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:35.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c7fff700 1 -- 172.21.15.80:0/532083579 >> v2:172.21.15.174:3300/0 conn(0x7ff7c80734e0 msgr2=0x7ff7c8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:35.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/532083579 >> v2:172.21.15.174:3300/0 conn(0x7ff7c80734e0 0x7ff7c8071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:35.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c7fff700 1 -- 172.21.15.80:0/532083579 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c806db00 con 0x7ff7c8072360 2019-11-28T11:49:35.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c6ffd700 1 --2- 172.21.15.80:0/532083579 >> v2:172.21.15.174:3300/0 conn(0x7ff7c80734e0 0x7ff7c8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:49:35.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/532083579 >> v2:172.21.15.80:3300/0 conn(0x7ff7c8072360 0x7ff7c80727e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff7c000f6b0 tx=0x7ff7c000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/532083579 >> v2:172.21.15.80:3300/0 conn(0x7ff7c8072360 0x7ff7c80727e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff7c000f6b0 tx=0x7ff7c000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/532083579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8072360 0x7ff7c80727e0 secure :-1 s=READY pgs=2058 cs=0 l=1 rx=0x7ff7c000f6b0 tx=0x7ff7c000fa50).ready entity=mon.0 client_cookie=a53039b96d7d52c1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:35.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/532083579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8072360 0x7ff7c80727e0 secure :-1 s=THROTTLE_DONE pgs=2058 cs=0 l=1 rx=0x7ff7c000f6b0 tx=0x7ff7c000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c67fc700 1 -- 172.21.15.80:0/532083579 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7c00010e0 con 0x7ff7c8072360 2019-11-28T11:49:35.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/532083579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8072360 0x7ff7c80727e0 secure :-1 s=THROTTLE_DONE pgs=2058 cs=0 l=1 rx=0x7ff7c000f6b0 tx=0x7ff7c000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/532083579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8072360 0x7ff7c80727e0 secure :-1 s=THROTTLE_DONE pgs=2058 cs=0 l=1 rx=0x7ff7c000f6b0 tx=0x7ff7c000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c67fc700 1 -- 172.21.15.80:0/532083579 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c0000b90 con 0x7ff7c8072360 2019-11-28T11:49:35.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7c67fc700 1 -- 172.21.15.80:0/532083579 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7c00016c0 con 0x7ff7c8072360 2019-11-28T11:49:35.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7cd5a6700 1 -- 172.21.15.80:0/532083579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8072360 msgr2=0x7ff7c80727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:35.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.648+0000 7ff7cd5a6700 1 --2- 172.21.15.80:0/532083579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8072360 0x7ff7c80727e0 secure :-1 s=READY pgs=2058 cs=0 l=1 rx=0x7ff7c000f6b0 tx=0x7ff7c000fa50).stop 2019-11-28T11:49:35.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.649+0000 7ff7cd5a6700 1 -- 172.21.15.80:0/532083579 shutdown_connections 2019-11-28T11:49:35.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.649+0000 7ff7cd5a6700 1 --2- 172.21.15.80:0/532083579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8072360 0x7ff7c80727e0 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:35.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.649+0000 7ff7cd5a6700 1 --2- 172.21.15.80:0/532083579 >> v2:172.21.15.174:3300/0 conn(0x7ff7c80734e0 0x7ff7c8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:35.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.649+0000 7ff7cd5a6700 1 --2- 172.21.15.80:0/532083579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7c806c0a0 0x7ff7c8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:35.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.649+0000 7ff7cd5a6700 1 -- 172.21.15.80:0/532083579 shutdown_connections 2019-11-28T11:49:35.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.649+0000 7ff7cd5a6700 1 -- 172.21.15.80:0/532083579 wait complete. 2019-11-28T11:49:35.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.649+0000 7ff7cd5a6700 1 -- 172.21.15.80:0/532083579 >> 172.21.15.80:0/532083579 conn(0x7ff7c8061cf0 msgr2=0x7ff7c8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:35.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.651+0000 7ff7cd5a6700 1 Processor -- start 2019-11-28T11:49:35.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.651+0000 7ff7cd5a6700 1 -- start start 2019-11-28T11:49:35.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.652+0000 7ff7cd5a6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7c813e9e0 0x7ff7c8108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:35.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.652+0000 7ff7cd5a6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7c8109430 0x7ff7c81098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:35.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.652+0000 7ff7cd5a6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c81066e0 con 0x7ff7c813e5f0 2019-11-28T11:49:35.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.652+0000 7ff7cd5a6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c810e060 con 0x7ff7c8109430 2019-11-28T11:49:35.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.652+0000 7ff7cd5a6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c810e330 con 0x7ff7c813e9e0 2019-11-28T11:49:35.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.652+0000 7ff7c7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7c8109430 0x7ff7c81098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:35.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.652+0000 7ff7c7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff7c8109430 0x7ff7c81098a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42134/0 (socket says 172.21.15.80:42134) 2019-11-28T11:49:35.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.652+0000 7ff7c7fff700 1 -- 172.21.15.80:0/739880097 learned_addr learned my addr 172.21.15.80:0/739880097 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:35.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.652+0000 7ff7c6ffd700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7c813e9e0 0x7ff7c8108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:35.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.652+0000 7ff7c7fff700 1 -- 172.21.15.80:0/739880097 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7c813e9e0 msgr2=0x7ff7c8108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:35.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.652+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7c813e9e0 0x7ff7c8108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:35.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.652+0000 7ff7c7fff700 1 -- 172.21.15.80:0/739880097 >> v1:172.21.15.174:6789/0 conn(0x7ff7c813e5f0 legacy=0x7ff7c810a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:35.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7c7fff700 1 -- 172.21.15.80:0/739880097 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c810e9c0 con 0x7ff7c8109430 2019-11-28T11:49:35.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7c6ffd700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7c813e9e0 0x7ff7c8108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:49:35.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/739880097 >> v2:172.21.15.80:3300/0 conn(0x7ff7c8109430 0x7ff7c81098a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7c0010450 tx=0x7ff7c00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/739880097 >> v2:172.21.15.80:3300/0 conn(0x7ff7c8109430 0x7ff7c81098a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7c0010450 tx=0x7ff7c00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8109430 0x7ff7c81098a0 secure :-1 s=READY pgs=2059 cs=0 l=1 rx=0x7ff7c0010450 tx=0x7ff7c00107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:35.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8109430 0x7ff7c81098a0 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7ff7c0010450 tx=0x7ff7c00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7bffff700 1 -- 172.21.15.80:0/739880097 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7c00010a0 con 0x7ff7c8109430 2019-11-28T11:49:35.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8109430 0x7ff7c81098a0 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7ff7c0010450 tx=0x7ff7c00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8109430 0x7ff7c81098a0 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7ff7c0010450 tx=0x7ff7c00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7bffff700 1 -- 172.21.15.80:0/739880097 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c0008180 con 0x7ff7c8109430 2019-11-28T11:49:35.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7bffff700 1 -- 172.21.15.80:0/739880097 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7c0000eb0 con 0x7ff7c8109430 2019-11-28T11:49:35.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7cd5a6700 1 -- 172.21.15.80:0/739880097 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c810ed40 con 0x7ff7c8109430 2019-11-28T11:49:35.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7cd5a6700 1 -- 172.21.15.80:0/739880097 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c810e9c0 con 0x7ff7c8109430 2019-11-28T11:49:35.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8109430 0x7ff7c81098a0 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7ff7c0010450 tx=0x7ff7c00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7bffff700 1 -- 172.21.15.80:0/739880097 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff7c0000990 con 0x7ff7c8109430 2019-11-28T11:49:35.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8109430 0x7ff7c81098a0 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7ff7c0010450 tx=0x7ff7c00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.653+0000 7ff7bffff700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7a0018730 0x7ff7a001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:35.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.654+0000 7ff7bffff700 1 -- 172.21.15.80:0/739880097 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff7c0031b10 con 0x7ff7c8109430 2019-11-28T11:49:35.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.654+0000 7ff7c77fe700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7a0018730 0x7ff7a001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:35.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.654+0000 7ff7c77fe700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7a0018730 0x7ff7a001abc0 crc :-1 s=READY pgs=836 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:35.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.662+0000 7ff7cd5a6700 1 -- 172.21.15.80:0/739880097 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c810ed40 con 0x7ff7c8109430 2019-11-28T11:49:35.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.665+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8109430 0x7ff7c81098a0 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7ff7c0010450 tx=0x7ff7c00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.665+0000 7ff7bffff700 1 -- 172.21.15.80:0/739880097 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff7c0017480 con 0x7ff7c8109430 2019-11-28T11:49:35.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.841+0000 7ff7cd5a6700 1 -- 172.21.15.80:0/739880097 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7c810e9c0 con 0x7ff7c8109430 2019-11-28T11:49:35.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.842+0000 7ff7c7fff700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8109430 0x7ff7c81098a0 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7ff7c0010450 tx=0x7ff7c00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:35.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.842+0000 7ff7bffff700 1 -- 172.21.15.80:0/739880097 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+14871 (secure 0 0 0) 0x7ff7c00214c0 con 0x7ff7c8109430 2019-11-28T11:49:35.893 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:35.893 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":162,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:49:34.167112+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:49:31.434223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2019-11-28T11:49:32.127254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:49:35.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.844+0000 7ff7cd5a6700 1 -- 172.21.15.80:0/739880097 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7a0018730 msgr2=0x7ff7a001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.844+0000 7ff7cd5a6700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7a0018730 0x7ff7a001abc0 crc :-1 s=READY pgs=836 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.844+0000 7ff7cd5a6700 1 -- 172.21.15.80:0/739880097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8109430 msgr2=0x7ff7c81098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.844+0000 7ff7cd5a6700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8109430 0x7ff7c81098a0 secure :-1 s=READY pgs=2059 cs=0 l=1 rx=0x7ff7c0010450 tx=0x7ff7c00107f0).stop 2019-11-28T11:49:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.844+0000 7ff7cd5a6700 1 -- 172.21.15.80:0/739880097 shutdown_connections 2019-11-28T11:49:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.844+0000 7ff7cd5a6700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7c8109430 0x7ff7c81098a0 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.844+0000 7ff7cd5a6700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7c813e9e0 0x7ff7c8108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:35.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.844+0000 7ff7cd5a6700 1 --2- 172.21.15.80:0/739880097 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff7a0018730 0x7ff7a001abc0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:35.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.844+0000 7ff7cd5a6700 1 -- 172.21.15.80:0/739880097 shutdown_connections 2019-11-28T11:49:35.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.844+0000 7ff7cd5a6700 1 -- 172.21.15.80:0/739880097 wait complete. 2019-11-28T11:49:35.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:35.844+0000 7ff7cd5a6700 1 -- 172.21.15.80:0/739880097 >> 172.21.15.80:0/739880097 conn(0x7ff7c813d620 msgr2=0x7ff7c813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:35.903 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:49:35.904 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:49:35.904 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:49:35.904 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:49:35.905 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:49:35.905 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:49:35.909 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:49:35.910 DEBUG:teuthology.parallel:result is None 2019-11-28T11:49:35.910 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:49:35.910 DEBUG:teuthology.parallel:result is None 2019-11-28T11:49:35.911 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:49:35.911 DEBUG:teuthology.parallel:result is None 2019-11-28T11:49:35.911 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:49:35.994 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:49:36.003 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:49:36.003 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:49:36.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.001+0000 7fbdd9e3c700 1 Processor -- start 2019-11-28T11:49:36.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.001+0000 7fbdd9e3c700 1 -- start start 2019-11-28T11:49:36.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdd9e3c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbdd415ed10 0x7fbdd415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:36.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdd9e3c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd4073020 0x7fbdd4071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:36.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdd9e3c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd406db60 con 0x7fbdd40734b0 2019-11-28T11:49:36.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdd9e3c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd406fe00 con 0x7fbdd415ed10 2019-11-28T11:49:36.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdd9e3c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40700d0 con 0x7fbdd4073020 2019-11-28T11:49:36.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdd3fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbdd415ed10 0x7fbdd415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:36.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdcbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd4073020 0x7fbdd4071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:36.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdcbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd4073020 0x7fbdd4071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:44422/0 (socket says 172.21.15.80:44422) 2019-11-28T11:49:36.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdd3fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbdd415ed10 0x7fbdd415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:57048/0 (socket says 172.21.15.80:57048) 2019-11-28T11:49:36.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdd8bda700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fbdd40734b0 0x7fbdd40723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:57024/0 (socket says 172.21.15.80:57024) 2019-11-28T11:49:36.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdcbfff700 1 -- 172.21.15.80:0/957822094 learned_addr learned my addr 172.21.15.80:0/957822094 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:36.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdd3fff700 1 -- 172.21.15.80:0/957822094 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd4073020 msgr2=0x7fbdd4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:36.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/957822094 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd4073020 0x7fbdd4071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:36.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdd3fff700 1 -- 172.21.15.80:0/957822094 >> v1:172.21.15.174:6789/0 conn(0x7fbdd40734b0 legacy=0x7fbdd40723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdd37fe700 1 -- 172.21.15.80:0/957822094 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806794150 0 0) 0x7fbdcc001400 con 0x7fbdd40734b0 2019-11-28T11:49:36.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdd3fff700 1 -- 172.21.15.80:0/957822094 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd4070760 con 0x7fbdd415ed10 2019-11-28T11:49:36.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.002+0000 7fbdcbfff700 1 --2- 172.21.15.80:0/957822094 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd4073020 0x7fbdd4071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:36.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.003+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/957822094 >> v2:172.21.15.174:3300/0 conn(0x7fbdd415ed10 0x7fbdd415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbdc400af50 tx=0x7fbdc400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.003+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/957822094 >> v2:172.21.15.174:3300/0 conn(0x7fbdd415ed10 0x7fbdd415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbdc400af50 tx=0x7fbdc400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.003+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/957822094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdd415ed10 0x7fbdd415f100 secure :-1 s=READY pgs=1222 cs=0 l=1 rx=0x7fbdc400af50 tx=0x7fbdc400b760).ready entity=mon.1 client_cookie=7797e4cb4bfe083e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:36.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.003+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/957822094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdd415ed10 0x7fbdd415f100 secure :-1 s=THROTTLE_DONE pgs=1222 cs=0 l=1 rx=0x7fbdc400af50 tx=0x7fbdc400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.003+0000 7fbdd37fe700 1 -- 172.21.15.80:0/957822094 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdc4007210 con 0x7fbdd415ed10 2019-11-28T11:49:36.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.003+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/957822094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdd415ed10 0x7fbdd415f100 secure :-1 s=THROTTLE_DONE pgs=1222 cs=0 l=1 rx=0x7fbdc400af50 tx=0x7fbdc400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.003+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/957822094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdd415ed10 0x7fbdd415f100 secure :-1 s=THROTTLE_DONE pgs=1222 cs=0 l=1 rx=0x7fbdc400af50 tx=0x7fbdc400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.003+0000 7fbdd37fe700 1 -- 172.21.15.80:0/957822094 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc40099b0 con 0x7fbdd415ed10 2019-11-28T11:49:36.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.003+0000 7fbdd37fe700 1 -- 172.21.15.80:0/957822094 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdc4009ba0 con 0x7fbdd415ed10 2019-11-28T11:49:36.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.003+0000 7fbdd9e3c700 1 -- 172.21.15.80:0/957822094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdd415ed10 msgr2=0x7fbdd415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.003+0000 7fbdd9e3c700 1 --2- 172.21.15.80:0/957822094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdd415ed10 0x7fbdd415f100 secure :-1 s=READY pgs=1222 cs=0 l=1 rx=0x7fbdc400af50 tx=0x7fbdc400b760).stop 2019-11-28T11:49:36.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.004+0000 7fbdd9e3c700 1 -- 172.21.15.80:0/957822094 shutdown_connections 2019-11-28T11:49:36.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.004+0000 7fbdd9e3c700 1 --2- 172.21.15.80:0/957822094 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd4073020 0x7fbdd4071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:36.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.004+0000 7fbdd9e3c700 1 --2- 172.21.15.80:0/957822094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdd415ed10 0x7fbdd415f100 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:36.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.004+0000 7fbdd9e3c700 1 -- 172.21.15.80:0/957822094 shutdown_connections 2019-11-28T11:49:36.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.004+0000 7fbdd9e3c700 1 -- 172.21.15.80:0/957822094 wait complete. 2019-11-28T11:49:36.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.004+0000 7fbdd9e3c700 1 -- 172.21.15.80:0/957822094 >> 172.21.15.80:0/957822094 conn(0x7fbdd4061d40 msgr2=0x7fbdd40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:36.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.006+0000 7fbdd9e3c700 1 Processor -- start 2019-11-28T11:49:36.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.006+0000 7fbdd9e3c700 1 -- start start 2019-11-28T11:49:36.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.007+0000 7fbdd9e3c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbdd4152750 0x7fbdd4135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:36.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.007+0000 7fbdd9e3c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd4109d70 con 0x7fbdd4130dc0 2019-11-28T11:49:36.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.007+0000 7fbdd9e3c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd41308e0 con 0x7fbdd4165d60 2019-11-28T11:49:36.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.007+0000 7fbdd9e3c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd4132570 con 0x7fbdd4152750 2019-11-28T11:49:36.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.007+0000 7fbdd3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbdd4152750 0x7fbdd4135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:36.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.007+0000 7fbdd3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbdd4152750 0x7fbdd4135790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42166/0 (socket says 172.21.15.80:42166) 2019-11-28T11:49:36.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.007+0000 7fbdd3fff700 1 -- 172.21.15.80:0/3025287936 learned_addr learned my addr 172.21.15.80:0/3025287936 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:36.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.008+0000 7fbdd3fff700 1 -- 172.21.15.80:0/3025287936 >> v1:172.21.15.174:6789/0 conn(0x7fbdd4165d60 legacy=0x7fbdd4168160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.007+0000 7fbdd17fa700 1 -- 172.21.15.80:0/3025287936 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669238970 0 0) 0x7fbdcc0011f0 con 0x7fbdd4165d60 2019-11-28T11:49:36.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.008+0000 7fbdd3fff700 1 -- 172.21.15.80:0/3025287936 >> v1:172.21.15.80:6789/0 conn(0x7fbdd4130dc0 legacy=0x7fbdd4131250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.008+0000 7fbdd3fff700 1 -- 172.21.15.80:0/3025287936 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd4132ed0 con 0x7fbdd4152750 2019-11-28T11:49:36.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.008+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/3025287936 >> v2:172.21.15.80:3300/0 conn(0x7fbdd4152750 0x7fbdd4135790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbdc4009490 tx=0x7fbdc4054820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.008+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/3025287936 >> v2:172.21.15.80:3300/0 conn(0x7fbdd4152750 0x7fbdd4135790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbdc4009490 tx=0x7fbdc4054820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.008+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/3025287936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd4152750 0x7fbdd4135790 secure :-1 s=READY pgs=2067 cs=0 l=1 rx=0x7fbdc4009490 tx=0x7fbdc4054820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:36.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.008+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/3025287936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd4152750 0x7fbdd4135790 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7fbdc4009490 tx=0x7fbdc4054820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.008+0000 7fbdd17fa700 1 -- 172.21.15.80:0/3025287936 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdc400ac00 con 0x7fbdd4152750 2019-11-28T11:49:36.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.008+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/3025287936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd4152750 0x7fbdd4135790 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7fbdc4009490 tx=0x7fbdc4054820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.008+0000 7fbdd9e3c700 1 -- 172.21.15.80:0/3025287936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd4133250 con 0x7fbdd4152750 2019-11-28T11:49:36.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.008+0000 7fbdd17fa700 1 -- 172.21.15.80:0/3025287936 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc400ac00 con 0x7fbdd4152750 2019-11-28T11:49:36.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.008+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/3025287936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd4152750 0x7fbdd4135790 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7fbdc4009490 tx=0x7fbdc4054820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.008+0000 7fbdd17fa700 1 -- 172.21.15.80:0/3025287936 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdc4009b70 con 0x7fbdd4152750 2019-11-28T11:49:36.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.008+0000 7fbdd9e3c700 1 -- 172.21.15.80:0/3025287936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd4132ed0 con 0x7fbdd4152750 2019-11-28T11:49:36.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.008+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/3025287936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd4152750 0x7fbdd4135790 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7fbdc4009490 tx=0x7fbdc4054820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.009+0000 7fbdd17fa700 1 -- 172.21.15.80:0/3025287936 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbdc4009580 con 0x7fbdd4152750 2019-11-28T11:49:36.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.009+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/3025287936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd4152750 0x7fbdd4135790 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7fbdc4009490 tx=0x7fbdc4054820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.009+0000 7fbdd17fa700 1 --2- 172.21.15.80:0/3025287936 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdb8018730 0x7fbdb801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:36.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.009+0000 7fbdd17fa700 1 -- 172.21.15.80:0/3025287936 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fbdc4075b90 con 0x7fbdd4152750 2019-11-28T11:49:36.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.009+0000 7fbdcbfff700 1 --2- 172.21.15.80:0/3025287936 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdb8018730 0x7fbdb801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:36.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.009+0000 7fbdcbfff700 1 --2- 172.21.15.80:0/3025287936 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdb8018730 0x7fbdb801abc0 crc :-1 s=READY pgs=837 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:36.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.016+0000 7fbdd9e3c700 1 -- 172.21.15.80:0/3025287936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd4133250 con 0x7fbdd4152750 2019-11-28T11:49:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.019+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/3025287936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd4152750 0x7fbdd4135790 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7fbdc4009490 tx=0x7fbdc4054820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.019+0000 7fbdd17fa700 1 -- 172.21.15.80:0/3025287936 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbdc400a100 con 0x7fbdd4152750 2019-11-28T11:49:36.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.192+0000 7fbdd9e3c700 1 -- 172.21.15.80:0/3025287936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fbdd4132ed0 con 0x7fbdd4152750 2019-11-28T11:49:36.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.195+0000 7fbdd3fff700 1 --2- 172.21.15.80:0/3025287936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd4152750 0x7fbdd4135790 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7fbdc4009490 tx=0x7fbdc4054820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.195+0000 7fbdd17fa700 1 -- 172.21.15.80:0/3025287936 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v56) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbdc40096b0 con 0x7fbdd4152750 2019-11-28T11:49:36.248 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:49:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.202+0000 7fbdd9e3c700 1 -- 172.21.15.80:0/3025287936 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdb8018730 msgr2=0x7fbdb801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.202+0000 7fbdd9e3c700 1 --2- 172.21.15.80:0/3025287936 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdb8018730 0x7fbdb801abc0 crc :-1 s=READY pgs=837 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.202+0000 7fbdd9e3c700 1 -- 172.21.15.80:0/3025287936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd4152750 msgr2=0x7fbdd4135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.202+0000 7fbdd9e3c700 1 --2- 172.21.15.80:0/3025287936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd4152750 0x7fbdd4135790 secure :-1 s=READY pgs=2067 cs=0 l=1 rx=0x7fbdc4009490 tx=0x7fbdc4054820).stop 2019-11-28T11:49:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.202+0000 7fbdd9e3c700 1 -- 172.21.15.80:0/3025287936 shutdown_connections 2019-11-28T11:49:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.202+0000 7fbdd9e3c700 1 --2- 172.21.15.80:0/3025287936 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdb8018730 0x7fbdb801abc0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.202+0000 7fbdd9e3c700 1 --2- 172.21.15.80:0/3025287936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd4152750 0x7fbdd4135790 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.202+0000 7fbdd9e3c700 1 -- 172.21.15.80:0/3025287936 shutdown_connections 2019-11-28T11:49:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.202+0000 7fbdd9e3c700 1 -- 172.21.15.80:0/3025287936 wait complete. 2019-11-28T11:49:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.202+0000 7fbdd9e3c700 1 -- 172.21.15.80:0/3025287936 >> 172.21.15.80:0/3025287936 conn(0x7fbdd41476e0 msgr2=0x7fbdd412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:36.260 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:49:36.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.343+0000 7efbe5aa1700 1 Processor -- start 2019-11-28T11:49:36.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.343+0000 7efbe5aa1700 1 -- start start 2019-11-28T11:49:36.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbe5aa1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efbe015ed10 0x7efbe015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:36.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbe5aa1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe0073020 0x7efbe0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:36.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbe5aa1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbe006db60 con 0x7efbe00734b0 2019-11-28T11:49:36.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbe5aa1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbe006fe00 con 0x7efbe015ed10 2019-11-28T11:49:36.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbe5aa1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbe00700d0 con 0x7efbe0073020 2019-11-28T11:49:36.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbe483f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efbe00734b0 0x7efbe00723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41494/0 (socket says 172.21.15.80:41494) 2019-11-28T11:49:36.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbe483f700 1 -- 172.21.15.80:0/1471675123 learned_addr learned my addr 172.21.15.80:0/1471675123 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:36.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbdffff700 1 --2- 172.21.15.80:0/1471675123 >> v2:172.21.15.174:3300/0 conn(0x7efbe015ed10 0x7efbe015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:36.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbd7fff700 1 --2- 172.21.15.80:0/1471675123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe0073020 0x7efbe0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:36.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbdf7fe700 1 -- 172.21.15.80:0/1471675123 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3896029847 0 0) 0x7efbd80014d0 con 0x7efbe00734b0 2019-11-28T11:49:36.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbdf7fe700 1 -- 172.21.15.80:0/1471675123 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbcc002e80 con 0x7efbe00734b0 2019-11-28T11:49:36.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbdf7fe700 1 -- 172.21.15.80:0/1471675123 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 59959190 0 0) 0x7efbd80014b0 con 0x7efbe00734b0 2019-11-28T11:49:36.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbdffff700 1 -- 172.21.15.80:0/1471675123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe0073020 msgr2=0x7efbe0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:36.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbdffff700 1 --2- 172.21.15.80:0/1471675123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe0073020 0x7efbe0071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:36.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbdffff700 1 -- 172.21.15.80:0/1471675123 >> v1:172.21.15.80:6789/0 conn(0x7efbe00734b0 legacy=0x7efbe00723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbdffff700 1 -- 172.21.15.80:0/1471675123 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe0070760 con 0x7efbe015ed10 2019-11-28T11:49:36.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbd7fff700 1 --2- 172.21.15.80:0/1471675123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe0073020 0x7efbe0071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:36.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbdffff700 1 --2- 172.21.15.80:0/1471675123 >> v2:172.21.15.174:3300/0 conn(0x7efbe015ed10 0x7efbe015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efbd000af50 tx=0x7efbd000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbdffff700 1 --2- 172.21.15.80:0/1471675123 >> v2:172.21.15.174:3300/0 conn(0x7efbe015ed10 0x7efbe015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efbd000af50 tx=0x7efbd000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.344+0000 7efbdffff700 1 --2- 172.21.15.80:0/1471675123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efbe015ed10 0x7efbe015f100 secure :-1 s=READY pgs=1224 cs=0 l=1 rx=0x7efbd000af50 tx=0x7efbd000b760).ready entity=mon.1 client_cookie=6fcce347a9890417 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:36.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.345+0000 7efbdffff700 1 --2- 172.21.15.80:0/1471675123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efbe015ed10 0x7efbe015f100 secure :-1 s=THROTTLE_DONE pgs=1224 cs=0 l=1 rx=0x7efbd000af50 tx=0x7efbd000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.345+0000 7efbdffff700 1 --2- 172.21.15.80:0/1471675123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efbe015ed10 0x7efbe015f100 secure :-1 s=THROTTLE_DONE pgs=1224 cs=0 l=1 rx=0x7efbd000af50 tx=0x7efbd000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.345+0000 7efbdf7fe700 1 -- 172.21.15.80:0/1471675123 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbd0007210 con 0x7efbe015ed10 2019-11-28T11:49:36.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.345+0000 7efbdffff700 1 --2- 172.21.15.80:0/1471675123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efbe015ed10 0x7efbe015f100 secure :-1 s=THROTTLE_DONE pgs=1224 cs=0 l=1 rx=0x7efbd000af50 tx=0x7efbd000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.345+0000 7efbdf7fe700 1 -- 172.21.15.80:0/1471675123 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbd00099b0 con 0x7efbe015ed10 2019-11-28T11:49:36.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.345+0000 7efbdf7fe700 1 -- 172.21.15.80:0/1471675123 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbd000a080 con 0x7efbe015ed10 2019-11-28T11:49:36.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.345+0000 7efbe5aa1700 1 -- 172.21.15.80:0/1471675123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efbe015ed10 msgr2=0x7efbe015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.345+0000 7efbe5aa1700 1 --2- 172.21.15.80:0/1471675123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efbe015ed10 0x7efbe015f100 secure :-1 s=READY pgs=1224 cs=0 l=1 rx=0x7efbd000af50 tx=0x7efbd000b760).stop 2019-11-28T11:49:36.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.345+0000 7efbe5aa1700 1 -- 172.21.15.80:0/1471675123 shutdown_connections 2019-11-28T11:49:36.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.345+0000 7efbe5aa1700 1 --2- 172.21.15.80:0/1471675123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe0073020 0x7efbe0071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:36.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.345+0000 7efbe5aa1700 1 --2- 172.21.15.80:0/1471675123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efbe015ed10 0x7efbe015f100 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:36.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.345+0000 7efbe5aa1700 1 -- 172.21.15.80:0/1471675123 shutdown_connections 2019-11-28T11:49:36.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.345+0000 7efbe5aa1700 1 -- 172.21.15.80:0/1471675123 wait complete. 2019-11-28T11:49:36.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.345+0000 7efbe5aa1700 1 -- 172.21.15.80:0/1471675123 >> 172.21.15.80:0/1471675123 conn(0x7efbe0061d40 msgr2=0x7efbe00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:36.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.348+0000 7efbe5aa1700 1 Processor -- start 2019-11-28T11:49:36.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.348+0000 7efbe5aa1700 1 -- start start 2019-11-28T11:49:36.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbe5aa1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe012e1a0 0x7efbe012e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:36.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbe5aa1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbe0130b20 con 0x7efbe0114f60 2019-11-28T11:49:36.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbe5aa1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbe0130620 con 0x7efbe012eb70 2019-11-28T11:49:36.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbe5aa1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbe0148b60 con 0x7efbe012e1a0 2019-11-28T11:49:36.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbdffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efbe0114f60 0x7efbe0106b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41496/0 (socket says 172.21.15.80:41496) 2019-11-28T11:49:36.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbdffff700 1 -- 172.21.15.80:0/2034092702 learned_addr learned my addr 172.21.15.80:0/2034092702 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:36.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbd7fff700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe012e1a0 0x7efbe012e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:36.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbdd7fa700 1 -- 172.21.15.80:0/2034092702 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265674415 0 0) 0x7efbd000abb0 con 0x7efbe0114f60 2019-11-28T11:49:36.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbdd7fa700 1 -- 172.21.15.80:0/2034092702 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbc4002e80 con 0x7efbe0114f60 2019-11-28T11:49:36.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbdd7fa700 1 -- 172.21.15.80:0/2034092702 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604623212 0 0) 0x7efbd8001480 con 0x7efbe012eb70 2019-11-28T11:49:36.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbdd7fa700 1 -- 172.21.15.80:0/2034092702 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbc40030b0 con 0x7efbe012eb70 2019-11-28T11:49:36.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbdd7fa700 1 -- 172.21.15.80:0/2034092702 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 694561867 0 0) 0x7efbd0000940 con 0x7efbe0114f60 2019-11-28T11:49:36.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbd7fff700 1 -- 172.21.15.80:0/2034092702 >> v1:172.21.15.174:6789/0 conn(0x7efbe012eb70 legacy=0x7efbe0105a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbd7fff700 1 -- 172.21.15.80:0/2034092702 >> v1:172.21.15.80:6789/0 conn(0x7efbe0114f60 legacy=0x7efbe0106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbd7fff700 1 -- 172.21.15.80:0/2034092702 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe0104390 con 0x7efbe012e1a0 2019-11-28T11:49:36.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbd7fff700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe012e1a0 0x7efbe012e630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efbc80103a0 tx=0x7efbc8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbd7fff700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe012e1a0 0x7efbe012e630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efbc80103a0 tx=0x7efbc8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbd7fff700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe012e1a0 0x7efbe012e630 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7efbc80103a0 tx=0x7efbc8010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:36.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbd7fff700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe012e1a0 0x7efbe012e630 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7efbc80103a0 tx=0x7efbc8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.349+0000 7efbdd7fa700 1 -- 172.21.15.80:0/2034092702 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbc8000940 con 0x7efbe012e1a0 2019-11-28T11:49:36.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.350+0000 7efbd7fff700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe012e1a0 0x7efbe012e630 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7efbc80103a0 tx=0x7efbc8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.350+0000 7efbd7fff700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe012e1a0 0x7efbe012e630 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7efbc80103a0 tx=0x7efbc8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.350+0000 7efbdd7fa700 1 -- 172.21.15.80:0/2034092702 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbc800dff0 con 0x7efbe012e1a0 2019-11-28T11:49:36.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.350+0000 7efbdd7fa700 1 -- 172.21.15.80:0/2034092702 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbc800e6c0 con 0x7efbe012e1a0 2019-11-28T11:49:36.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.350+0000 7efbe5aa1700 1 -- 172.21.15.80:0/2034092702 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbe0104710 con 0x7efbe012e1a0 2019-11-28T11:49:36.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.350+0000 7efbe5aa1700 1 -- 172.21.15.80:0/2034092702 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbe0104390 con 0x7efbe012e1a0 2019-11-28T11:49:36.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.350+0000 7efbd7fff700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe012e1a0 0x7efbe012e630 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7efbc80103a0 tx=0x7efbc8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.350+0000 7efbdd7fa700 1 -- 172.21.15.80:0/2034092702 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efbc800da60 con 0x7efbe012e1a0 2019-11-28T11:49:36.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.350+0000 7efbd7fff700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe012e1a0 0x7efbe012e630 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7efbc80103a0 tx=0x7efbc8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.350+0000 7efbdd7fa700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbc4018750 0x7efbc401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:36.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.350+0000 7efbdd7fa700 1 -- 172.21.15.80:0/2034092702 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7efbc8031a50 con 0x7efbe012e1a0 2019-11-28T11:49:36.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.351+0000 7efbdffff700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbc4018750 0x7efbc401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:36.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.351+0000 7efbdffff700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbc4018750 0x7efbc401abe0 crc :-1 s=READY pgs=839 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:36.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.358+0000 7efbe5aa1700 1 -- 172.21.15.80:0/2034092702 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbe0104710 con 0x7efbe012e1a0 2019-11-28T11:49:36.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.361+0000 7efbd7fff700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe012e1a0 0x7efbe012e630 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7efbc80103a0 tx=0x7efbc8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.361+0000 7efbdd7fa700 1 -- 172.21.15.80:0/2034092702 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efbc8015fb0 con 0x7efbe012e1a0 2019-11-28T11:49:36.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.531+0000 7efbe5aa1700 1 -- 172.21.15.80:0/2034092702 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7efbe0104390 con 0x7efbe012e1a0 2019-11-28T11:49:36.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.535+0000 7efbd7fff700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe012e1a0 0x7efbe012e630 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7efbc80103a0 tx=0x7efbc8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.535+0000 7efbdd7fa700 1 -- 172.21.15.80:0/2034092702 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v57) v1 ==== 184+0+0 (secure 0 0 0) 0x7efbc8015fb0 con 0x7efbe012e1a0 2019-11-28T11:49:36.586 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:49:36.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.541+0000 7efbe5aa1700 1 -- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbc4018750 msgr2=0x7efbc401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.541+0000 7efbe5aa1700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbc4018750 0x7efbc401abe0 crc :-1 s=READY pgs=839 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:36.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.541+0000 7efbe5aa1700 1 -- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe012e1a0 msgr2=0x7efbe012e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.541+0000 7efbe5aa1700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe012e1a0 0x7efbe012e630 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7efbc80103a0 tx=0x7efbc8010740).stop 2019-11-28T11:49:36.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.541+0000 7efbe5aa1700 1 -- 172.21.15.80:0/2034092702 shutdown_connections 2019-11-28T11:49:36.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.541+0000 7efbe5aa1700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efbc4018750 0x7efbc401abe0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:36.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.541+0000 7efbe5aa1700 1 --2- 172.21.15.80:0/2034092702 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efbe012e1a0 0x7efbe012e630 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:36.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.541+0000 7efbe5aa1700 1 -- 172.21.15.80:0/2034092702 shutdown_connections 2019-11-28T11:49:36.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.541+0000 7efbe5aa1700 1 -- 172.21.15.80:0/2034092702 wait complete. 2019-11-28T11:49:36.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.541+0000 7efbe5aa1700 1 -- 172.21.15.80:0/2034092702 >> 172.21.15.80:0/2034092702 conn(0x7efbe01476e0 msgr2=0x7efbe012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:36.605 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:49:36.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.689+0000 7f5b78c93700 1 Processor -- start 2019-11-28T11:49:36.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.689+0000 7f5b78c93700 1 -- start start 2019-11-28T11:49:36.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.690+0000 7f5b78c93700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5b7415ed10 0x7f5b7415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:36.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.690+0000 7f5b78c93700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5b740734b0 0x7f5b740726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:36.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.690+0000 7f5b78c93700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7406db60 con 0x7f5b74073020 2019-11-28T11:49:36.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.690+0000 7f5b78c93700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7406fe00 con 0x7f5b740734b0 2019-11-28T11:49:36.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.690+0000 7f5b78c93700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b740700d0 con 0x7f5b7415ed10 2019-11-28T11:49:36.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b7359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5b740734b0 0x7f5b740726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:36.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b7359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5b740734b0 0x7f5b740726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42190/0 (socket says 172.21.15.80:42190) 2019-11-28T11:49:36.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b7359e700 1 -- 172.21.15.80:0/2125093187 learned_addr learned my addr 172.21.15.80:0/2125093187 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:36.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b72d9d700 1 --2- 172.21.15.80:0/2125093187 >> v2:172.21.15.174:3300/0 conn(0x7f5b7415ed10 0x7f5b7415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:36.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b7359e700 1 -- 172.21.15.80:0/2125093187 >> v2:172.21.15.174:3300/0 conn(0x7f5b7415ed10 msgr2=0x7f5b7415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:36.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b7359e700 1 --2- 172.21.15.80:0/2125093187 >> v2:172.21.15.174:3300/0 conn(0x7f5b7415ed10 0x7f5b7415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:36.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b7359e700 1 -- 172.21.15.80:0/2125093187 >> v1:172.21.15.174:6789/0 conn(0x7f5b74073020 legacy=0x7f5b74071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b7359e700 1 -- 172.21.15.80:0/2125093187 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b74070760 con 0x7f5b740734b0 2019-11-28T11:49:36.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b7359e700 1 --2- 172.21.15.80:0/2125093187 >> v2:172.21.15.80:3300/0 conn(0x7f5b740734b0 0x7f5b740726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5b6c00f730 tx=0x7f5b6c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b7359e700 1 --2- 172.21.15.80:0/2125093187 >> v2:172.21.15.80:3300/0 conn(0x7f5b740734b0 0x7f5b740726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5b6c00f730 tx=0x7f5b6c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b7359e700 1 --2- 172.21.15.80:0/2125093187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b740734b0 0x7f5b740726a0 secure :-1 s=READY pgs=2070 cs=0 l=1 rx=0x7f5b6c00f730 tx=0x7f5b6c007d50).ready entity=mon.0 client_cookie=d7c8cad91fdb1b8e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:36.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b7359e700 1 --2- 172.21.15.80:0/2125093187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b740734b0 0x7f5b740726a0 secure :-1 s=THROTTLE_DONE pgs=2070 cs=0 l=1 rx=0x7f5b6c00f730 tx=0x7f5b6c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b7359e700 1 --2- 172.21.15.80:0/2125093187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b740734b0 0x7f5b740726a0 secure :-1 s=THROTTLE_DONE pgs=2070 cs=0 l=1 rx=0x7f5b6c00f730 tx=0x7f5b6c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b71d9b700 1 -- 172.21.15.80:0/2125093187 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b6c000a70 con 0x7f5b740734b0 2019-11-28T11:49:36.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b7359e700 1 --2- 172.21.15.80:0/2125093187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b740734b0 0x7f5b740726a0 secure :-1 s=THROTTLE_DONE pgs=2070 cs=0 l=1 rx=0x7f5b6c00f730 tx=0x7f5b6c007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b71d9b700 1 -- 172.21.15.80:0/2125093187 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0010e0 con 0x7f5b740734b0 2019-11-28T11:49:36.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b71d9b700 1 -- 172.21.15.80:0/2125093187 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b6c0017b0 con 0x7f5b740734b0 2019-11-28T11:49:36.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b78c93700 1 -- 172.21.15.80:0/2125093187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b740734b0 msgr2=0x7f5b740726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.691+0000 7f5b78c93700 1 --2- 172.21.15.80:0/2125093187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b740734b0 0x7f5b740726a0 secure :-1 s=READY pgs=2070 cs=0 l=1 rx=0x7f5b6c00f730 tx=0x7f5b6c007d50).stop 2019-11-28T11:49:36.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.692+0000 7f5b78c93700 1 -- 172.21.15.80:0/2125093187 shutdown_connections 2019-11-28T11:49:36.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.692+0000 7f5b78c93700 1 --2- 172.21.15.80:0/2125093187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b740734b0 0x7f5b740726a0 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:36.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.692+0000 7f5b78c93700 1 --2- 172.21.15.80:0/2125093187 >> v2:172.21.15.174:3300/0 conn(0x7f5b7415ed10 0x7f5b7415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:36.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.692+0000 7f5b78c93700 1 -- 172.21.15.80:0/2125093187 shutdown_connections 2019-11-28T11:49:36.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.692+0000 7f5b78c93700 1 -- 172.21.15.80:0/2125093187 wait complete. 2019-11-28T11:49:36.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.692+0000 7f5b78c93700 1 -- 172.21.15.80:0/2125093187 >> 172.21.15.80:0/2125093187 conn(0x7f5b74061d40 msgr2=0x7f5b740641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:36.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.695+0000 7f5b78c93700 1 Processor -- start 2019-11-28T11:49:36.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.695+0000 7f5b78c93700 1 -- start start 2019-11-28T11:49:36.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.695+0000 7f5b78c93700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5b7412e1a0 0x7f5b7412e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:36.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.695+0000 7f5b78c93700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b74130b20 con 0x7f5b7412eb70 2019-11-28T11:49:36.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.695+0000 7f5b78c93700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b74130620 con 0x7f5b74114f60 2019-11-28T11:49:36.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.695+0000 7f5b78c93700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b74148b60 con 0x7f5b7412e1a0 2019-11-28T11:49:36.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b7359e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5b7412eb70 0x7f5b74105a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41514/0 (socket says 172.21.15.80:41514) 2019-11-28T11:49:36.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b7359e700 1 -- 172.21.15.80:0/1983255189 learned_addr learned my addr 172.21.15.80:0/1983255189 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:36.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b7259c700 1 --2- 172.21.15.80:0/1983255189 >> v2:172.21.15.174:3300/0 conn(0x7f5b7412e1a0 0x7f5b7412e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:36.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b6b7fe700 1 -- 172.21.15.80:0/1983255189 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286703858 0 0) 0x7f5b6c000940 con 0x7f5b7412eb70 2019-11-28T11:49:36.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b6b7fe700 1 -- 172.21.15.80:0/1983255189 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b4c002e80 con 0x7f5b7412eb70 2019-11-28T11:49:36.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b6b7fe700 1 -- 172.21.15.80:0/1983255189 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120526925 0 0) 0x7f5b5c0012b0 con 0x7f5b74114f60 2019-11-28T11:49:36.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b7259c700 1 -- 172.21.15.80:0/1983255189 >> v1:172.21.15.174:6789/0 conn(0x7f5b74114f60 legacy=0x7f5b74106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b7259c700 1 -- 172.21.15.80:0/1983255189 >> v1:172.21.15.80:6789/0 conn(0x7f5b7412eb70 legacy=0x7f5b74105a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b7259c700 1 -- 172.21.15.80:0/1983255189 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b74104390 con 0x7f5b7412e1a0 2019-11-28T11:49:36.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b7259c700 1 --2- 172.21.15.80:0/1983255189 >> v2:172.21.15.174:3300/0 conn(0x7f5b7412e1a0 0x7f5b7412e630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5b640103a0 tx=0x7f5b64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b7259c700 1 --2- 172.21.15.80:0/1983255189 >> v2:172.21.15.174:3300/0 conn(0x7f5b7412e1a0 0x7f5b7412e630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5b640103a0 tx=0x7f5b64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b7259c700 1 --2- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b7412e1a0 0x7f5b7412e630 secure :-1 s=READY pgs=1228 cs=0 l=1 rx=0x7f5b640103a0 tx=0x7f5b64010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:36.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b7259c700 1 --2- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b7412e1a0 0x7f5b7412e630 secure :-1 s=THROTTLE_DONE pgs=1228 cs=0 l=1 rx=0x7f5b640103a0 tx=0x7f5b64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b6b7fe700 1 -- 172.21.15.80:0/1983255189 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b640099d0 con 0x7f5b7412e1a0 2019-11-28T11:49:36.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b7259c700 1 --2- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b7412e1a0 0x7f5b7412e630 secure :-1 s=THROTTLE_DONE pgs=1228 cs=0 l=1 rx=0x7f5b640103a0 tx=0x7f5b64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b7259c700 1 --2- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b7412e1a0 0x7f5b7412e630 secure :-1 s=THROTTLE_DONE pgs=1228 cs=0 l=1 rx=0x7f5b640103a0 tx=0x7f5b64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b6b7fe700 1 -- 172.21.15.80:0/1983255189 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b64009bd0 con 0x7f5b7412e1a0 2019-11-28T11:49:36.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b78c93700 1 -- 172.21.15.80:0/1983255189 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b74104710 con 0x7f5b7412e1a0 2019-11-28T11:49:36.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b6b7fe700 1 -- 172.21.15.80:0/1983255189 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b6400a2a0 con 0x7f5b7412e1a0 2019-11-28T11:49:36.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.696+0000 7f5b78c93700 1 -- 172.21.15.80:0/1983255189 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b74104390 con 0x7f5b7412e1a0 2019-11-28T11:49:36.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.697+0000 7f5b7259c700 1 --2- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b7412e1a0 0x7f5b7412e630 secure :-1 s=THROTTLE_DONE pgs=1228 cs=0 l=1 rx=0x7f5b640103a0 tx=0x7f5b64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.697+0000 7f5b7259c700 1 --2- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b7412e1a0 0x7f5b7412e630 secure :-1 s=THROTTLE_DONE pgs=1228 cs=0 l=1 rx=0x7f5b640103a0 tx=0x7f5b64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.697+0000 7f5b6b7fe700 1 -- 172.21.15.80:0/1983255189 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5b64009880 con 0x7f5b7412e1a0 2019-11-28T11:49:36.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.697+0000 7f5b6b7fe700 1 --2- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5b4c018780 0x7f5b4c01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:36.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.697+0000 7f5b6b7fe700 1 -- 172.21.15.80:0/1983255189 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5b64031d50 con 0x7f5b7412e1a0 2019-11-28T11:49:36.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.697+0000 7f5b72d9d700 1 --2- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5b4c018780 0x7f5b4c01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:36.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.697+0000 7f5b72d9d700 1 --2- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5b4c018780 0x7f5b4c01abf0 crc :-1 s=READY pgs=840 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:36.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.705+0000 7f5b78c93700 1 -- 172.21.15.80:0/1983255189 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b74104710 con 0x7f5b7412e1a0 2019-11-28T11:49:36.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.709+0000 7f5b7259c700 1 --2- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b7412e1a0 0x7f5b7412e630 secure :-1 s=THROTTLE_DONE pgs=1228 cs=0 l=1 rx=0x7f5b640103a0 tx=0x7f5b64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.709+0000 7f5b6b7fe700 1 -- 172.21.15.80:0/1983255189 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5b640095d0 con 0x7f5b7412e1a0 2019-11-28T11:49:36.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.881+0000 7f5b78c93700 1 -- 172.21.15.80:0/1983255189 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5b74104390 con 0x7f5b7412e1a0 2019-11-28T11:49:36.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.884+0000 7f5b7259c700 1 --2- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b7412e1a0 0x7f5b7412e630 secure :-1 s=THROTTLE_DONE pgs=1228 cs=0 l=1 rx=0x7f5b640103a0 tx=0x7f5b64010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:36.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.884+0000 7f5b6b7fe700 1 -- 172.21.15.80:0/1983255189 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v58) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5b640175a0 con 0x7f5b7412e1a0 2019-11-28T11:49:36.938 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:49:36.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.890+0000 7f5b78c93700 1 -- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5b4c018780 msgr2=0x7f5b4c01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.890+0000 7f5b78c93700 1 --2- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5b4c018780 0x7f5b4c01abf0 crc :-1 s=READY pgs=840 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:36.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.890+0000 7f5b78c93700 1 -- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b7412e1a0 msgr2=0x7f5b7412e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:36.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.890+0000 7f5b78c93700 1 --2- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b7412e1a0 0x7f5b7412e630 secure :-1 s=READY pgs=1228 cs=0 l=1 rx=0x7f5b640103a0 tx=0x7f5b64010740).stop 2019-11-28T11:49:36.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.890+0000 7f5b78c93700 1 -- 172.21.15.80:0/1983255189 shutdown_connections 2019-11-28T11:49:36.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.890+0000 7f5b78c93700 1 --2- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b7412e1a0 0x7f5b7412e630 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:36.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.890+0000 7f5b78c93700 1 --2- 172.21.15.80:0/1983255189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5b4c018780 0x7f5b4c01abf0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:36.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.890+0000 7f5b78c93700 1 -- 172.21.15.80:0/1983255189 shutdown_connections 2019-11-28T11:49:36.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.890+0000 7f5b78c93700 1 -- 172.21.15.80:0/1983255189 wait complete. 2019-11-28T11:49:36.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:36.890+0000 7f5b78c93700 1 -- 172.21.15.80:0/1983255189 >> 172.21.15.80:0/1983255189 conn(0x7f5b741476e0 msgr2=0x7f5b7412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:36.948 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:49:37.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.031+0000 7f73fc6cf700 1 Processor -- start 2019-11-28T11:49:37.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.031+0000 7f73fc6cf700 1 -- start start 2019-11-28T11:49:37.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.032+0000 7f73fc6cf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f73f415f100 0x7f73f406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:37.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.032+0000 7f73fc6cf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f406db60 con 0x7f73f415ed10 2019-11-28T11:49:37.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.032+0000 7f73fc6cf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f406e060 con 0x7f73f406c2f0 2019-11-28T11:49:37.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.032+0000 7f73fc6cf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f406fe00 con 0x7f73f415f100 2019-11-28T11:49:37.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73fac6c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f73f415ed10 0x7f73f4073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41518/0 (socket says 172.21.15.80:41518) 2019-11-28T11:49:37.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73fac6c700 1 -- 172.21.15.80:0/1356298282 learned_addr learned my addr 172.21.15.80:0/1356298282 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:37.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73fa46b700 1 --2- 172.21.15.80:0/1356298282 >> v2:172.21.15.174:3300/0 conn(0x7f73f415f100 0x7f73f406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:37.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73f9c6a700 1 -- 172.21.15.80:0/1356298282 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100664520 0 0) 0x7f73dc0014d0 con 0x7f73f415ed10 2019-11-28T11:49:37.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73f9c6a700 1 -- 172.21.15.80:0/1356298282 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73e0002e80 con 0x7f73f415ed10 2019-11-28T11:49:37.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73fa46b700 1 -- 172.21.15.80:0/1356298282 >> v1:172.21.15.174:6789/0 conn(0x7f73f406c2f0 legacy=0x7f73f406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:37.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73f9c6a700 1 -- 172.21.15.80:0/1356298282 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161227501 0 0) 0x7f73ec0009b0 con 0x7f73f406c2f0 2019-11-28T11:49:37.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73fa46b700 1 -- 172.21.15.80:0/1356298282 >> v1:172.21.15.80:6789/0 conn(0x7f73f415ed10 legacy=0x7f73f4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:37.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73fa46b700 1 -- 172.21.15.80:0/1356298282 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f4070760 con 0x7f73f415f100 2019-11-28T11:49:37.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73fa46b700 1 --2- 172.21.15.80:0/1356298282 >> v2:172.21.15.174:3300/0 conn(0x7f73f415f100 0x7f73f406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f73e400af50 tx=0x7f73e400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73fa46b700 1 --2- 172.21.15.80:0/1356298282 >> v2:172.21.15.174:3300/0 conn(0x7f73f415f100 0x7f73f406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f73e400af50 tx=0x7f73e400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73fa46b700 1 --2- 172.21.15.80:0/1356298282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f415f100 0x7f73f406bdb0 secure :-1 s=READY pgs=1230 cs=0 l=1 rx=0x7f73e400af50 tx=0x7f73e400b760).ready entity=mon.1 client_cookie=8f6d62ba6f265813 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:37.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73fa46b700 1 --2- 172.21.15.80:0/1356298282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f415f100 0x7f73f406bdb0 secure :-1 s=THROTTLE_DONE pgs=1230 cs=0 l=1 rx=0x7f73e400af50 tx=0x7f73e400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73f9c6a700 1 -- 172.21.15.80:0/1356298282 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73e4000960 con 0x7f73f415f100 2019-11-28T11:49:37.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73fa46b700 1 --2- 172.21.15.80:0/1356298282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f415f100 0x7f73f406bdb0 secure :-1 s=THROTTLE_DONE pgs=1230 cs=0 l=1 rx=0x7f73e400af50 tx=0x7f73e400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73fa46b700 1 --2- 172.21.15.80:0/1356298282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f415f100 0x7f73f406bdb0 secure :-1 s=THROTTLE_DONE pgs=1230 cs=0 l=1 rx=0x7f73e400af50 tx=0x7f73e400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73f9c6a700 1 -- 172.21.15.80:0/1356298282 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e4009860 con 0x7f73f415f100 2019-11-28T11:49:37.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73f9c6a700 1 -- 172.21.15.80:0/1356298282 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73e4009f30 con 0x7f73f415f100 2019-11-28T11:49:37.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73fc6cf700 1 -- 172.21.15.80:0/1356298282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f415f100 msgr2=0x7f73f406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:37.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.033+0000 7f73fc6cf700 1 --2- 172.21.15.80:0/1356298282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f415f100 0x7f73f406bdb0 secure :-1 s=READY pgs=1230 cs=0 l=1 rx=0x7f73e400af50 tx=0x7f73e400b760).stop 2019-11-28T11:49:37.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.034+0000 7f73fc6cf700 1 -- 172.21.15.80:0/1356298282 shutdown_connections 2019-11-28T11:49:37.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.034+0000 7f73fc6cf700 1 --2- 172.21.15.80:0/1356298282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f415f100 0x7f73f406bdb0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:37.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.034+0000 7f73fc6cf700 1 -- 172.21.15.80:0/1356298282 shutdown_connections 2019-11-28T11:49:37.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.034+0000 7f73fc6cf700 1 -- 172.21.15.80:0/1356298282 wait complete. 2019-11-28T11:49:37.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.034+0000 7f73fc6cf700 1 -- 172.21.15.80:0/1356298282 >> 172.21.15.80:0/1356298282 conn(0x7f73f4061d40 msgr2=0x7f73f40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:37.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.037+0000 7f73fc6cf700 1 Processor -- start 2019-11-28T11:49:37.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.037+0000 7f73fc6cf700 1 -- start start 2019-11-28T11:49:37.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.037+0000 7f73fc6cf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4152750 0x7f73f4135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:37.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.037+0000 7f73fc6cf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f4109d70 con 0x7f73f4165d60 2019-11-28T11:49:37.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.037+0000 7f73fc6cf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f41308e0 con 0x7f73f4130dc0 2019-11-28T11:49:37.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.037+0000 7f73fc6cf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f410a460 con 0x7f73f4152750 2019-11-28T11:49:37.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73fb46d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f73f4165d60 0x7f73f4168160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41526/0 (socket says 172.21.15.80:41526) 2019-11-28T11:49:37.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73fb46d700 1 -- 172.21.15.80:0/3880775283 learned_addr learned my addr 172.21.15.80:0/3880775283 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:37.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73fac6c700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4152750 0x7f73f4135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:37.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73f37fe700 1 -- 172.21.15.80:0/3880775283 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059557198 0 0) 0x7f73ec001240 con 0x7f73f4165d60 2019-11-28T11:49:37.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73f37fe700 1 -- 172.21.15.80:0/3880775283 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73d8002e80 con 0x7f73f4165d60 2019-11-28T11:49:37.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73f37fe700 1 -- 172.21.15.80:0/3880775283 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991763561 0 0) 0x7f73e400b3d0 con 0x7f73f4130dc0 2019-11-28T11:49:37.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73f37fe700 1 -- 172.21.15.80:0/3880775283 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73d80030b0 con 0x7f73f4130dc0 2019-11-28T11:49:37.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73fac6c700 1 -- 172.21.15.80:0/3880775283 >> v1:172.21.15.174:6789/0 conn(0x7f73f4130dc0 legacy=0x7f73f4131250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:37.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73fac6c700 1 -- 172.21.15.80:0/3880775283 >> v1:172.21.15.80:6789/0 conn(0x7f73f4165d60 legacy=0x7f73f4168160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:37.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73fac6c700 1 -- 172.21.15.80:0/3880775283 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f4132ed0 con 0x7f73f4152750 2019-11-28T11:49:37.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73fac6c700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4152750 0x7f73f4135790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73dc010700 tx=0x7f73dc010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73fac6c700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4152750 0x7f73f4135790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73dc010700 tx=0x7f73dc010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73fac6c700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4152750 0x7f73f4135790 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7f73dc010700 tx=0x7f73dc010aa0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:37.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73fac6c700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4152750 0x7f73f4135790 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f73dc010700 tx=0x7f73dc010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73f37fe700 1 -- 172.21.15.80:0/3880775283 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73dc001100 con 0x7f73f4152750 2019-11-28T11:49:37.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73fac6c700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4152750 0x7f73f4135790 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f73dc010700 tx=0x7f73dc010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73f37fe700 1 -- 172.21.15.80:0/3880775283 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc001700 con 0x7f73f4152750 2019-11-28T11:49:37.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73fac6c700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4152750 0x7f73f4135790 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f73dc010700 tx=0x7f73dc010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73f37fe700 1 -- 172.21.15.80:0/3880775283 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73dc0010b0 con 0x7f73f4152750 2019-11-28T11:49:37.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73fc6cf700 1 -- 172.21.15.80:0/3880775283 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f4133250 con 0x7f73f4152750 2019-11-28T11:49:37.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.038+0000 7f73fc6cf700 1 -- 172.21.15.80:0/3880775283 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f4132ed0 con 0x7f73f4152750 2019-11-28T11:49:37.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.039+0000 7f73fac6c700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4152750 0x7f73f4135790 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f73dc010700 tx=0x7f73dc010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.039+0000 7f73fac6c700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4152750 0x7f73f4135790 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f73dc010700 tx=0x7f73dc010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.039+0000 7f73f37fe700 1 -- 172.21.15.80:0/3880775283 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f73dc001010 con 0x7f73f4152750 2019-11-28T11:49:37.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.039+0000 7f73f37fe700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f73d8018750 0x7f73d801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:37.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.039+0000 7f73f37fe700 1 -- 172.21.15.80:0/3880775283 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f73dc031e30 con 0x7f73f4152750 2019-11-28T11:49:37.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.039+0000 7f73fa46b700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f73d8018750 0x7f73d801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:37.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.040+0000 7f73fa46b700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f73d8018750 0x7f73d801abe0 crc :-1 s=READY pgs=841 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:37.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.047+0000 7f73fc6cf700 1 -- 172.21.15.80:0/3880775283 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f4133250 con 0x7f73f4152750 2019-11-28T11:49:37.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.051+0000 7f73fac6c700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4152750 0x7f73f4135790 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f73dc010700 tx=0x7f73dc010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.051+0000 7f73f37fe700 1 -- 172.21.15.80:0/3880775283 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f73dc001220 con 0x7f73f4152750 2019-11-28T11:49:37.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.222+0000 7f73fc6cf700 1 -- 172.21.15.80:0/3880775283 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f73f4132ed0 con 0x7f73f4152750 2019-11-28T11:49:37.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.230+0000 7f73fac6c700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4152750 0x7f73f4135790 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f73dc010700 tx=0x7f73dc010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.230+0000 7f73f37fe700 1 -- 172.21.15.80:0/3880775283 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v59) v1 ==== 184+0+0 (secure 0 0 0) 0x7f73dc0018f0 con 0x7f73f4152750 2019-11-28T11:49:37.286 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:49:37.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.240+0000 7f73fc6cf700 1 -- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f73d8018750 msgr2=0x7f73d801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:37.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.240+0000 7f73fc6cf700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f73d8018750 0x7f73d801abe0 crc :-1 s=READY pgs=841 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:37.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.240+0000 7f73fc6cf700 1 -- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4152750 msgr2=0x7f73f4135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:37.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.240+0000 7f73fc6cf700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4152750 0x7f73f4135790 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7f73dc010700 tx=0x7f73dc010aa0).stop 2019-11-28T11:49:37.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.240+0000 7f73fc6cf700 1 -- 172.21.15.80:0/3880775283 shutdown_connections 2019-11-28T11:49:37.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.240+0000 7f73fc6cf700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f73d8018750 0x7f73d801abe0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:37.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.240+0000 7f73fc6cf700 1 --2- 172.21.15.80:0/3880775283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4152750 0x7f73f4135790 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:37.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.240+0000 7f73fc6cf700 1 -- 172.21.15.80:0/3880775283 shutdown_connections 2019-11-28T11:49:37.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.240+0000 7f73fc6cf700 1 -- 172.21.15.80:0/3880775283 wait complete. 2019-11-28T11:49:37.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.240+0000 7f73fc6cf700 1 -- 172.21.15.80:0/3880775283 >> 172.21.15.80:0/3880775283 conn(0x7f73f41476e0 msgr2=0x7f73f412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:37.298 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:49:37.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.369+0000 7f5ce438d700 1 Processor -- start 2019-11-28T11:49:37.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.369+0000 7f5ce438d700 1 -- start start 2019-11-28T11:49:37.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.370+0000 7f5ce438d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cdc06c0a0 0x7f5cdc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:37.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.370+0000 7f5ce438d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5cdc0734e0 0x7f5cdc071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:37.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.370+0000 7f5ce438d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5cdc072360 0x7f5cdc0727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:37.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.370+0000 7f5ce438d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc06f330 con 0x7f5cdc0734e0 2019-11-28T11:49:37.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.370+0000 7f5ce438d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc0706c0 con 0x7f5cdc072360 2019-11-28T11:49:37.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.370+0000 7f5ce438d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc070a40 con 0x7f5cdc06c0a0 2019-11-28T11:49:37.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.370+0000 7f5ce2129700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5cdc0734e0 0x7f5cdc071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:37.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.370+0000 7f5ce2129700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5cdc0734e0 0x7f5cdc071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42220/0 (socket says 172.21.15.80:42220) 2019-11-28T11:49:37.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.370+0000 7f5ce2129700 1 -- 172.21.15.80:0/4097439975 learned_addr learned my addr 172.21.15.80:0/4097439975 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:37.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.370+0000 7f5ce312b700 1 --2- 172.21.15.80:0/4097439975 >> v2:172.21.15.174:3300/0 conn(0x7f5cdc072360 0x7f5cdc0727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:37.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.370+0000 7f5ce292a700 1 --2- 172.21.15.80:0/4097439975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cdc06c0a0 0x7f5cdc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.371+0000 7f5ce2129700 1 -- 172.21.15.80:0/4097439975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cdc06c0a0 msgr2=0x7f5cdc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.371+0000 7f5ce2129700 1 --2- 172.21.15.80:0/4097439975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cdc06c0a0 0x7f5cdc072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.371+0000 7f5ce2129700 1 -- 172.21.15.80:0/4097439975 >> v2:172.21.15.174:3300/0 conn(0x7f5cdc072360 msgr2=0x7f5cdc0727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.371+0000 7f5ce2129700 1 --2- 172.21.15.80:0/4097439975 >> v2:172.21.15.174:3300/0 conn(0x7f5cdc072360 0x7f5cdc0727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.371+0000 7f5ce2129700 1 -- 172.21.15.80:0/4097439975 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc06db00 con 0x7f5cdc0734e0 2019-11-28T11:49:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.371+0000 7f5ce2129700 1 --2- 172.21.15.80:0/4097439975 >> v2:172.21.15.80:3300/0 conn(0x7f5cdc0734e0 0x7f5cdc071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5cc400fa40 tx=0x7f5cc400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.371+0000 7f5ce2129700 1 --2- 172.21.15.80:0/4097439975 >> v2:172.21.15.80:3300/0 conn(0x7f5cdc0734e0 0x7f5cdc071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5cc400fa40 tx=0x7f5cc400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.371+0000 7f5ce2129700 1 --2- 172.21.15.80:0/4097439975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc0734e0 0x7f5cdc071e20 secure :-1 s=READY pgs=2074 cs=0 l=1 rx=0x7f5cc400fa40 tx=0x7f5cc400f8f0).ready entity=mon.0 client_cookie=11dbb20c959e3115 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.371+0000 7f5ce2129700 1 --2- 172.21.15.80:0/4097439975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc0734e0 0x7f5cdc071e20 secure :-1 s=THROTTLE_DONE pgs=2074 cs=0 l=1 rx=0x7f5cc400fa40 tx=0x7f5cc400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.371+0000 7f5ce2129700 1 --2- 172.21.15.80:0/4097439975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc0734e0 0x7f5cdc071e20 secure :-1 s=THROTTLE_DONE pgs=2074 cs=0 l=1 rx=0x7f5cc400fa40 tx=0x7f5cc400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.371+0000 7f5ce2129700 1 --2- 172.21.15.80:0/4097439975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc0734e0 0x7f5cdc071e20 secure :-1 s=THROTTLE_DONE pgs=2074 cs=0 l=1 rx=0x7f5cc400fa40 tx=0x7f5cc400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.371+0000 7f5ce1928700 1 -- 172.21.15.80:0/4097439975 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc4000ce0 con 0x7f5cdc0734e0 2019-11-28T11:49:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.371+0000 7f5ce1928700 1 -- 172.21.15.80:0/4097439975 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc4001010 con 0x7f5cdc0734e0 2019-11-28T11:49:37.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.371+0000 7f5ce1928700 1 -- 172.21.15.80:0/4097439975 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc4001720 con 0x7f5cdc0734e0 2019-11-28T11:49:37.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.371+0000 7f5ce438d700 1 -- 172.21.15.80:0/4097439975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc0734e0 msgr2=0x7f5cdc071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:37.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.371+0000 7f5ce438d700 1 --2- 172.21.15.80:0/4097439975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc0734e0 0x7f5cdc071e20 secure :-1 s=READY pgs=2074 cs=0 l=1 rx=0x7f5cc400fa40 tx=0x7f5cc400f8f0).stop 2019-11-28T11:49:37.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.372+0000 7f5ce438d700 1 -- 172.21.15.80:0/4097439975 shutdown_connections 2019-11-28T11:49:37.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.372+0000 7f5ce438d700 1 --2- 172.21.15.80:0/4097439975 >> v2:172.21.15.174:3300/0 conn(0x7f5cdc072360 0x7f5cdc0727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:37.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.372+0000 7f5ce438d700 1 --2- 172.21.15.80:0/4097439975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc0734e0 0x7f5cdc071e20 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:37.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.372+0000 7f5ce438d700 1 --2- 172.21.15.80:0/4097439975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5cdc06c0a0 0x7f5cdc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:37.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.372+0000 7f5ce438d700 1 -- 172.21.15.80:0/4097439975 shutdown_connections 2019-11-28T11:49:37.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.372+0000 7f5ce438d700 1 -- 172.21.15.80:0/4097439975 wait complete. 2019-11-28T11:49:37.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.372+0000 7f5ce438d700 1 -- 172.21.15.80:0/4097439975 >> 172.21.15.80:0/4097439975 conn(0x7f5cdc061cf0 msgr2=0x7f5cdc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:37.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.374+0000 7f5ce438d700 1 Processor -- start 2019-11-28T11:49:37.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.374+0000 7f5ce438d700 1 -- start start 2019-11-28T11:49:37.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.375+0000 7f5ce438d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5cdc13e7b0 0x7f5cdc12abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:37.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.375+0000 7f5ce438d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc139e00 con 0x7f5cdc13e320 2019-11-28T11:49:37.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.375+0000 7f5ce438d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc13b4e0 con 0x7f5cdc15fdf0 2019-11-28T11:49:37.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.375+0000 7f5ce438d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc108820 con 0x7f5cdc13e7b0 2019-11-28T11:49:37.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.375+0000 7f5ce312b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5cdc13e7b0 0x7f5cdc12abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:37.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.375+0000 7f5ce2129700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5cdc13e320 0x7f5cdc12a3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41540/0 (socket says 172.21.15.80:41540) 2019-11-28T11:49:37.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.375+0000 7f5ce2129700 1 -- 172.21.15.80:0/3670933675 learned_addr learned my addr 172.21.15.80:0/3670933675 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.375+0000 7f5ce312b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5cdc13e7b0 0x7f5cdc12abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42224/0 (socket says 172.21.15.80:42224) 2019-11-28T11:49:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.375+0000 7f5cdb7fe700 1 -- 172.21.15.80:0/3670933675 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709469265 0 0) 0x7f5ccc009790 con 0x7f5cdc15fdf0 2019-11-28T11:49:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.375+0000 7f5ce312b700 1 -- 172.21.15.80:0/3670933675 >> v1:172.21.15.174:6789/0 conn(0x7f5cdc15fdf0 legacy=0x7f5cdc12b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.375+0000 7f5ce312b700 1 -- 172.21.15.80:0/3670933675 >> v1:172.21.15.80:6789/0 conn(0x7f5cdc13e320 legacy=0x7f5cdc12a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.375+0000 7f5ce312b700 1 -- 172.21.15.80:0/3670933675 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc10a8c0 con 0x7f5cdc13e7b0 2019-11-28T11:49:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.375+0000 7f5ce312b700 1 --2- 172.21.15.80:0/3670933675 >> v2:172.21.15.80:3300/0 conn(0x7f5cdc13e7b0 0x7f5cdc12abc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5cd400ea40 tx=0x7f5cd40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.376+0000 7f5ce312b700 1 --2- 172.21.15.80:0/3670933675 >> v2:172.21.15.80:3300/0 conn(0x7f5cdc13e7b0 0x7f5cdc12abc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5cd400ea40 tx=0x7f5cd40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.376+0000 7f5ce312b700 1 --2- 172.21.15.80:0/3670933675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc13e7b0 0x7f5cdc12abc0 secure :-1 s=READY pgs=2076 cs=0 l=1 rx=0x7f5cd400ea40 tx=0x7f5cd40106f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.376+0000 7f5ce312b700 1 --2- 172.21.15.80:0/3670933675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc13e7b0 0x7f5cdc12abc0 secure :-1 s=THROTTLE_DONE pgs=2076 cs=0 l=1 rx=0x7f5cd400ea40 tx=0x7f5cd40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.376+0000 7f5cdb7fe700 1 -- 172.21.15.80:0/3670933675 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cd400ee80 con 0x7f5cdc13e7b0 2019-11-28T11:49:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.376+0000 7f5ce312b700 1 --2- 172.21.15.80:0/3670933675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc13e7b0 0x7f5cdc12abc0 secure :-1 s=THROTTLE_DONE pgs=2076 cs=0 l=1 rx=0x7f5cd400ea40 tx=0x7f5cd40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.376+0000 7f5ce438d700 1 -- 172.21.15.80:0/3670933675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc10a8c0 con 0x7f5cdc13e7b0 2019-11-28T11:49:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.376+0000 7f5cdb7fe700 1 -- 172.21.15.80:0/3670933675 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd400ebe0 con 0x7f5cdc13e7b0 2019-11-28T11:49:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.376+0000 7f5ce312b700 1 --2- 172.21.15.80:0/3670933675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc13e7b0 0x7f5cdc12abc0 secure :-1 s=THROTTLE_DONE pgs=2076 cs=0 l=1 rx=0x7f5cd400ea40 tx=0x7f5cd40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.376+0000 7f5cdb7fe700 1 -- 172.21.15.80:0/3670933675 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cd400edd0 con 0x7f5cdc13e7b0 2019-11-28T11:49:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.376+0000 7f5ce438d700 1 -- 172.21.15.80:0/3670933675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc10a8c0 con 0x7f5cdc13e7b0 2019-11-28T11:49:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.376+0000 7f5ce312b700 1 --2- 172.21.15.80:0/3670933675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc13e7b0 0x7f5cdc12abc0 secure :-1 s=THROTTLE_DONE pgs=2076 cs=0 l=1 rx=0x7f5cd400ea40 tx=0x7f5cd40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.376+0000 7f5cdb7fe700 1 -- 172.21.15.80:0/3670933675 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5cd400ee70 con 0x7f5cdc13e7b0 2019-11-28T11:49:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.376+0000 7f5ce312b700 1 --2- 172.21.15.80:0/3670933675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc13e7b0 0x7f5cdc12abc0 secure :-1 s=THROTTLE_DONE pgs=2076 cs=0 l=1 rx=0x7f5cd400ea40 tx=0x7f5cd40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.376+0000 7f5cdb7fe700 1 --2- 172.21.15.80:0/3670933675 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5cc0018730 0x7f5cc001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:37.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.376+0000 7f5cdb7fe700 1 -- 172.21.15.80:0/3670933675 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5cd400ebe0 con 0x7f5cdc13e7b0 2019-11-28T11:49:37.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.377+0000 7f5ce292a700 1 --2- 172.21.15.80:0/3670933675 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5cc0018730 0x7f5cc001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:37.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.377+0000 7f5ce292a700 1 --2- 172.21.15.80:0/3670933675 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5cc0018730 0x7f5cc001abc0 crc :-1 s=READY pgs=843 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:37.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.384+0000 7f5ce438d700 1 -- 172.21.15.80:0/3670933675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cdc109180 con 0x7f5cdc13e7b0 2019-11-28T11:49:37.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.388+0000 7f5ce312b700 1 --2- 172.21.15.80:0/3670933675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc13e7b0 0x7f5cdc12abc0 secure :-1 s=THROTTLE_DONE pgs=2076 cs=0 l=1 rx=0x7f5cd400ea40 tx=0x7f5cd40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.388+0000 7f5cdb7fe700 1 -- 172.21.15.80:0/3670933675 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5cd4000a70 con 0x7f5cdc13e7b0 2019-11-28T11:49:37.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.560+0000 7f5ce438d700 1 -- 172.21.15.80:0/3670933675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cdc109500 con 0x7f5cdc13e7b0 2019-11-28T11:49:37.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.560+0000 7f5ce312b700 1 --2- 172.21.15.80:0/3670933675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc13e7b0 0x7f5cdc12abc0 secure :-1 s=THROTTLE_DONE pgs=2076 cs=0 l=1 rx=0x7f5cd400ea40 tx=0x7f5cd40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:37.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.560+0000 7f5cdb7fe700 1 -- 172.21.15.80:0/3670933675 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) v1 ==== 95+0+1780 (secure 0 0 0) 0x7f5cd400ebe0 con 0x7f5cdc13e7b0 2019-11-28T11:49:37.612 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 124 2019-11-28T11:49:37.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.563+0000 7f5ce438d700 1 -- 172.21.15.80:0/3670933675 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5cc0018730 msgr2=0x7f5cc001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:37.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.563+0000 7f5ce438d700 1 --2- 172.21.15.80:0/3670933675 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5cc0018730 0x7f5cc001abc0 crc :-1 s=READY pgs=843 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.563+0000 7f5ce438d700 1 -- 172.21.15.80:0/3670933675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc13e7b0 msgr2=0x7f5cdc12abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.563+0000 7f5ce438d700 1 --2- 172.21.15.80:0/3670933675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc13e7b0 0x7f5cdc12abc0 secure :-1 s=READY pgs=2076 cs=0 l=1 rx=0x7f5cd400ea40 tx=0x7f5cd40106f0).stop 2019-11-28T11:49:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.563+0000 7f5ce438d700 1 -- 172.21.15.80:0/3670933675 shutdown_connections 2019-11-28T11:49:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.563+0000 7f5ce438d700 1 --2- 172.21.15.80:0/3670933675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cdc13e7b0 0x7f5cdc12abc0 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.563+0000 7f5ce438d700 1 --2- 172.21.15.80:0/3670933675 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5cc0018730 0x7f5cc001abc0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.563+0000 7f5ce438d700 1 -- 172.21.15.80:0/3670933675 shutdown_connections 2019-11-28T11:49:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.563+0000 7f5ce438d700 1 -- 172.21.15.80:0/3670933675 wait complete. 2019-11-28T11:49:37.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:37.563+0000 7f5ce438d700 1 -- 172.21.15.80:0/3670933675 >> 172.21.15.80:0/3670933675 conn(0x7f5cdc127dc0 msgr2=0x7f5cdc141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:37.614 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:37.614 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":124,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:49:37.195766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9442":{"gid":9442,"name":"c","rank":0,"incarnation":123,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/1260063619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1260063619},{"type":"v1","addr":"172.21.15.174:6835","nonce":1260063619}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:49:37.924 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 9442}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 26, u'failed': [], u'epoch': 124, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [27], u'info': {u'gid_9442': {u'export_targets': [], u'name': u'c', u'incarnation': 123, u'state_seq': 2, u'state': u'up:active', u'gid': 9442, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1260063619, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 1260063619, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/1260063619'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:49:33.165935+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:49:37.195766+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:49:37.925 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:49:37.925 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:49:38.051 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:49:38.052 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:49:38.052 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:49:38.052 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 9442, 2019-11-28T11:49:38.052 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:49:38.052 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:49:38.052 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 1.811340967, 2019-11-28T11:49:38.053 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 124, 2019-11-28T11:49:38.053 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 162, 2019-11-28T11:49:38.053 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 162, 2019-11-28T11:49:38.053 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 2.0568846650000001 2019-11-28T11:49:38.053 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:49:38.057 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 9442, "want_state": "up:active", "state": "up:active", "rank_uptime": 1.811340967, "mdsmap_epoch": 124, "osdmap_epoch": 162, "osdmap_epoch_barrier": 162, "uptime": 2.0568846650000001 } 2019-11-28T11:49:38.058 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:49:38.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.130+0000 7f99a761e700 1 Processor -- start 2019-11-28T11:49:38.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.130+0000 7f99a761e700 1 -- start start 2019-11-28T11:49:38.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.131+0000 7f99a761e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f99a006c0a0 0x7f99a0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:38.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.131+0000 7f99a761e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99a00734e0 0x7f99a0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:38.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.131+0000 7f99a761e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a006db00 con 0x7f99a0072360 2019-11-28T11:49:38.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.131+0000 7f99a761e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a006fd60 con 0x7f99a00734e0 2019-11-28T11:49:38.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.131+0000 7f99a761e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a0070030 con 0x7f99a006c0a0 2019-11-28T11:49:38.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a53ba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99a00734e0 0x7f99a0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:38.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a53ba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99a00734e0 0x7f99a0071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42234/0 (socket says 172.21.15.80:42234) 2019-11-28T11:49:38.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a63bc700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f99a0072360 0x7f99a006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41548/0 (socket says 172.21.15.80:41548) 2019-11-28T11:49:38.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a53ba700 1 -- 172.21.15.80:0/906710889 learned_addr learned my addr 172.21.15.80:0/906710889 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:38.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a5bbb700 1 --2- 172.21.15.80:0/906710889 >> v2:172.21.15.174:3300/0 conn(0x7f99a006c0a0 0x7f99a0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:38.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a53ba700 1 -- 172.21.15.80:0/906710889 >> v2:172.21.15.174:3300/0 conn(0x7f99a006c0a0 msgr2=0x7f99a0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:38.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a53ba700 1 --2- 172.21.15.80:0/906710889 >> v2:172.21.15.174:3300/0 conn(0x7f99a006c0a0 0x7f99a0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:38.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a53ba700 1 -- 172.21.15.80:0/906710889 >> v1:172.21.15.80:6789/0 conn(0x7f99a0072360 legacy=0x7f99a006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:38.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a4bb9700 1 -- 172.21.15.80:0/906710889 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107285159 0 0) 0x7f9998000d30 con 0x7f99a0072360 2019-11-28T11:49:38.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a53ba700 1 -- 172.21.15.80:0/906710889 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a00706c0 con 0x7f99a00734e0 2019-11-28T11:49:38.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a53ba700 1 --2- 172.21.15.80:0/906710889 >> v2:172.21.15.80:3300/0 conn(0x7f99a00734e0 0x7f99a0071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f998800f6c0 tx=0x7f998800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a53ba700 1 --2- 172.21.15.80:0/906710889 >> v2:172.21.15.80:3300/0 conn(0x7f99a00734e0 0x7f99a0071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f998800f6c0 tx=0x7f998800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a53ba700 1 --2- 172.21.15.80:0/906710889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a00734e0 0x7f99a0071e20 secure :-1 s=READY pgs=2078 cs=0 l=1 rx=0x7f998800f6c0 tx=0x7f998800fa60).ready entity=mon.0 client_cookie=48319e1e42425f6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a53ba700 1 --2- 172.21.15.80:0/906710889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a00734e0 0x7f99a0071e20 secure :-1 s=THROTTLE_DONE pgs=2078 cs=0 l=1 rx=0x7f998800f6c0 tx=0x7f998800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a4bb9700 1 -- 172.21.15.80:0/906710889 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9988000960 con 0x7f99a00734e0 2019-11-28T11:49:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a53ba700 1 --2- 172.21.15.80:0/906710889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a00734e0 0x7f99a0071e20 secure :-1 s=THROTTLE_DONE pgs=2078 cs=0 l=1 rx=0x7f998800f6c0 tx=0x7f998800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a53ba700 1 --2- 172.21.15.80:0/906710889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a00734e0 0x7f99a0071e20 secure :-1 s=THROTTLE_DONE pgs=2078 cs=0 l=1 rx=0x7f998800f6c0 tx=0x7f998800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a4bb9700 1 -- 172.21.15.80:0/906710889 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9988000c90 con 0x7f99a00734e0 2019-11-28T11:49:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a4bb9700 1 -- 172.21.15.80:0/906710889 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99880013a0 con 0x7f99a00734e0 2019-11-28T11:49:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a761e700 1 -- 172.21.15.80:0/906710889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a00734e0 msgr2=0x7f99a0071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.132+0000 7f99a761e700 1 --2- 172.21.15.80:0/906710889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a00734e0 0x7f99a0071e20 secure :-1 s=READY pgs=2078 cs=0 l=1 rx=0x7f998800f6c0 tx=0x7f998800fa60).stop 2019-11-28T11:49:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.133+0000 7f99a761e700 1 -- 172.21.15.80:0/906710889 shutdown_connections 2019-11-28T11:49:38.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.133+0000 7f99a761e700 1 --2- 172.21.15.80:0/906710889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a00734e0 0x7f99a0071e20 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:38.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.133+0000 7f99a761e700 1 --2- 172.21.15.80:0/906710889 >> v2:172.21.15.174:3300/0 conn(0x7f99a006c0a0 0x7f99a0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:38.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.133+0000 7f99a761e700 1 -- 172.21.15.80:0/906710889 shutdown_connections 2019-11-28T11:49:38.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.133+0000 7f99a761e700 1 -- 172.21.15.80:0/906710889 wait complete. 2019-11-28T11:49:38.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.133+0000 7f99a761e700 1 -- 172.21.15.80:0/906710889 >> 172.21.15.80:0/906710889 conn(0x7f99a0061cf0 msgr2=0x7f99a0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:38.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.135+0000 7f99a761e700 1 Processor -- start 2019-11-28T11:49:38.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.136+0000 7f99a761e700 1 -- start start 2019-11-28T11:49:38.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.136+0000 7f99a761e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99a0128e40 0x7f99a0168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:38.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.136+0000 7f99a761e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a0139a60 con 0x7f99a013a780 2019-11-28T11:49:38.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.136+0000 7f99a761e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a013b060 con 0x7f99a01281b0 2019-11-28T11:49:38.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.136+0000 7f99a761e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a012a260 con 0x7f99a0128e40 2019-11-28T11:49:38.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.136+0000 7f99a63bc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f99a0128e40 0x7f99a0168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:38.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.136+0000 7f99a5bbb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f99a013a780 0x7f99a012d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41552/0 (socket says 172.21.15.80:41552) 2019-11-28T11:49:38.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.136+0000 7f99a5bbb700 1 -- 172.21.15.80:0/2721846605 learned_addr learned my addr 172.21.15.80:0/2721846605 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:38.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.137+0000 7f99a63bc700 1 -- 172.21.15.80:0/2721846605 >> v1:172.21.15.174:6789/0 conn(0x7f99a01281b0 legacy=0x7f99a0128640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:38.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.137+0000 7f99a63bc700 1 -- 172.21.15.80:0/2721846605 >> v1:172.21.15.80:6789/0 conn(0x7f99a013a780 legacy=0x7f99a012d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:38.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.137+0000 7f999e7fc700 1 -- 172.21.15.80:0/2721846605 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220935024 0 0) 0x7f9990009580 con 0x7f99a013a780 2019-11-28T11:49:38.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.137+0000 7f99a63bc700 1 -- 172.21.15.80:0/2721846605 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a012abc0 con 0x7f99a0128e40 2019-11-28T11:49:38.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.137+0000 7f99a63bc700 1 --2- 172.21.15.80:0/2721846605 >> v2:172.21.15.80:3300/0 conn(0x7f99a0128e40 0x7f99a0168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9998010700 tx=0x7f9998010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.137+0000 7f99a63bc700 1 --2- 172.21.15.80:0/2721846605 >> v2:172.21.15.80:3300/0 conn(0x7f99a0128e40 0x7f99a0168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9998010700 tx=0x7f9998010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.137+0000 7f99a63bc700 1 --2- 172.21.15.80:0/2721846605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a0128e40 0x7f99a0168d80 secure :-1 s=READY pgs=2080 cs=0 l=1 rx=0x7f9998010700 tx=0x7f9998010aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:38.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.137+0000 7f99a63bc700 1 --2- 172.21.15.80:0/2721846605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a0128e40 0x7f99a0168d80 secure :-1 s=THROTTLE_DONE pgs=2080 cs=0 l=1 rx=0x7f9998010700 tx=0x7f9998010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.137+0000 7f999e7fc700 1 -- 172.21.15.80:0/2721846605 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9998000cc0 con 0x7f99a0128e40 2019-11-28T11:49:38.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.137+0000 7f99a63bc700 1 --2- 172.21.15.80:0/2721846605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a0128e40 0x7f99a0168d80 secure :-1 s=THROTTLE_DONE pgs=2080 cs=0 l=1 rx=0x7f9998010700 tx=0x7f9998010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.137+0000 7f99a63bc700 1 --2- 172.21.15.80:0/2721846605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a0128e40 0x7f99a0168d80 secure :-1 s=THROTTLE_DONE pgs=2080 cs=0 l=1 rx=0x7f9998010700 tx=0x7f9998010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.137+0000 7f999e7fc700 1 -- 172.21.15.80:0/2721846605 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9998001700 con 0x7f99a0128e40 2019-11-28T11:49:38.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.137+0000 7f99a761e700 1 -- 172.21.15.80:0/2721846605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a012af40 con 0x7f99a0128e40 2019-11-28T11:49:38.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.137+0000 7f999e7fc700 1 -- 172.21.15.80:0/2721846605 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9998000cc0 con 0x7f99a0128e40 2019-11-28T11:49:38.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.137+0000 7f99a761e700 1 -- 172.21.15.80:0/2721846605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a012abc0 con 0x7f99a0128e40 2019-11-28T11:49:38.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.137+0000 7f99a63bc700 1 --2- 172.21.15.80:0/2721846605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a0128e40 0x7f99a0168d80 secure :-1 s=THROTTLE_DONE pgs=2080 cs=0 l=1 rx=0x7f9998010700 tx=0x7f9998010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.138+0000 7f999e7fc700 1 -- 172.21.15.80:0/2721846605 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9998001be0 con 0x7f99a0128e40 2019-11-28T11:49:38.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.138+0000 7f999e7fc700 1 --2- 172.21.15.80:0/2721846605 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f998401cb60 0x7f998401eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:38.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.138+0000 7f99a63bc700 1 --2- 172.21.15.80:0/2721846605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a0128e40 0x7f99a0168d80 secure :-1 s=THROTTLE_DONE pgs=2080 cs=0 l=1 rx=0x7f9998010700 tx=0x7f9998010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.138+0000 7f999e7fc700 1 -- 172.21.15.80:0/2721846605 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9998032260 con 0x7f99a0128e40 2019-11-28T11:49:38.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.138+0000 7f99a5bbb700 1 --2- 172.21.15.80:0/2721846605 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f998401cb60 0x7f998401eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:38.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.138+0000 7f99a5bbb700 1 --2- 172.21.15.80:0/2721846605 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f998401cb60 0x7f998401eff0 crc :-1 s=READY pgs=844 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:38.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.146+0000 7f99a761e700 1 -- 172.21.15.80:0/2721846605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a012af40 con 0x7f99a0128e40 2019-11-28T11:49:38.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.149+0000 7f99a63bc700 1 --2- 172.21.15.80:0/2721846605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a0128e40 0x7f99a0168d80 secure :-1 s=THROTTLE_DONE pgs=2080 cs=0 l=1 rx=0x7f9998010700 tx=0x7f9998010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.149+0000 7f999e7fc700 1 -- 172.21.15.80:0/2721846605 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9998001700 con 0x7f99a0128e40 2019-11-28T11:49:38.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.326+0000 7f99a761e700 1 -- 172.21.15.80:0/2721846605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99a012abc0 con 0x7f99a0128e40 2019-11-28T11:49:38.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.327+0000 7f99a63bc700 1 --2- 172.21.15.80:0/2721846605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a0128e40 0x7f99a0168d80 secure :-1 s=THROTTLE_DONE pgs=2080 cs=0 l=1 rx=0x7f9998010700 tx=0x7f9998010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.327+0000 7f999e7fc700 1 -- 172.21.15.80:0/2721846605 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f9998001700 con 0x7f99a0128e40 2019-11-28T11:49:38.376 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:38.376 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":162,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:49:34.167112+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:49:31.434223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2019-11-28T11:49:32.127254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:49:38.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.329+0000 7f99a761e700 1 -- 172.21.15.80:0/2721846605 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f998401cb60 msgr2=0x7f998401eff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:38.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.329+0000 7f99a761e700 1 --2- 172.21.15.80:0/2721846605 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f998401cb60 0x7f998401eff0 crc :-1 s=READY pgs=844 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:38.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.329+0000 7f99a761e700 1 -- 172.21.15.80:0/2721846605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a0128e40 msgr2=0x7f99a0168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:38.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.329+0000 7f99a761e700 1 --2- 172.21.15.80:0/2721846605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a0128e40 0x7f99a0168d80 secure :-1 s=READY pgs=2080 cs=0 l=1 rx=0x7f9998010700 tx=0x7f9998010aa0).stop 2019-11-28T11:49:38.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.329+0000 7f99a761e700 1 -- 172.21.15.80:0/2721846605 shutdown_connections 2019-11-28T11:49:38.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.329+0000 7f99a761e700 1 --2- 172.21.15.80:0/2721846605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f99a0128e40 0x7f99a0168d80 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:38.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.329+0000 7f99a761e700 1 --2- 172.21.15.80:0/2721846605 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f998401cb60 0x7f998401eff0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:38.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.329+0000 7f99a761e700 1 -- 172.21.15.80:0/2721846605 shutdown_connections 2019-11-28T11:49:38.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.329+0000 7f99a761e700 1 -- 172.21.15.80:0/2721846605 wait complete. 2019-11-28T11:49:38.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.329+0000 7f99a761e700 1 -- 172.21.15.80:0/2721846605 >> 172.21.15.80:0/2721846605 conn(0x7f99a0127dc0 msgr2=0x7f99a0141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:38.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:49:31.434223+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 26, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'161', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:49:32.127254+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 27, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'162', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:49:38.388 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:49:38.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.464+0000 7fc74c670700 1 Processor -- start 2019-11-28T11:49:38.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.464+0000 7fc74c670700 1 -- start start 2019-11-28T11:49:38.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.465+0000 7fc74c670700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc74415f100 0x7fc74406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:38.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.465+0000 7fc74c670700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74406db60 con 0x7fc74406c2f0 2019-11-28T11:49:38.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.465+0000 7fc74c670700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74406e060 con 0x7fc74415ed10 2019-11-28T11:49:38.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.465+0000 7fc74c670700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74406fe00 con 0x7fc74415f100 2019-11-28T11:49:38.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.465+0000 7fc74b40e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc74406c2f0 0x7fc74406c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41562/0 (socket says 172.21.15.80:41562) 2019-11-28T11:49:38.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.465+0000 7fc74b40e700 1 -- 172.21.15.80:0/3915918590 learned_addr learned my addr 172.21.15.80:0/3915918590 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:38.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.465+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3915918590 >> v2:172.21.15.174:3300/0 conn(0x7fc74415f100 0x7fc74406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:38.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.465+0000 7fc749c0b700 1 -- 172.21.15.80:0/3915918590 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313287342 0 0) 0x7fc73c0014d0 con 0x7fc74406c2f0 2019-11-28T11:49:38.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.465+0000 7fc749c0b700 1 -- 172.21.15.80:0/3915918590 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc730002e80 con 0x7fc74406c2f0 2019-11-28T11:49:38.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.465+0000 7fc749c0b700 1 -- 172.21.15.80:0/3915918590 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1773342803 0 0) 0x7fc73c0014b0 con 0x7fc74406c2f0 2019-11-28T11:49:38.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.465+0000 7fc749c0b700 1 -- 172.21.15.80:0/3915918590 >> v2:172.21.15.174:3300/0 conn(0x7fc74415f100 msgr2=0x7fc74406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:38.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.465+0000 7fc749c0b700 1 --2- 172.21.15.80:0/3915918590 >> v2:172.21.15.174:3300/0 conn(0x7fc74415f100 0x7fc74406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:38.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.465+0000 7fc749c0b700 1 -- 172.21.15.80:0/3915918590 >> v1:172.21.15.174:6789/0 conn(0x7fc74415ed10 legacy=0x7fc744073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:38.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.465+0000 7fc749c0b700 1 -- 172.21.15.80:0/3915918590 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744070760 con 0x7fc74406c2f0 2019-11-28T11:49:38.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.465+0000 7fc749c0b700 1 -- 172.21.15.80:0/3915918590 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc73c001a40 con 0x7fc74406c2f0 2019-11-28T11:49:38.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc749c0b700 1 -- 172.21.15.80:0/3915918590 >> v1:172.21.15.80:6789/0 conn(0x7fc74406c2f0 legacy=0x7fc74406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:38.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc749c0b700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc730003b20 0x7fc730005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:38.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc749c0b700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc730006730 0x7fc730008be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:38.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc749c0b700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc730009440 0x7fc73000b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:38.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc749c0b700 1 -- 172.21.15.80:0/3915918590 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73000c0c0 con 0x7fc730006730 2019-11-28T11:49:38.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc749c0b700 1 -- 172.21.15.80:0/3915918590 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7300502c0 con 0x7fc730003b20 2019-11-28T11:49:38.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc749c0b700 1 -- 172.21.15.80:0/3915918590 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7300504f0 con 0x7fc730009440 2019-11-28T11:49:38.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3915918590 >> v2:172.21.15.174:3300/0 conn(0x7fc74415f100 0x7fc74406bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:38.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74ac0d700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc730003b20 0x7fc730005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:38.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74b40e700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc730009440 0x7fc73000b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:38.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc730006730 0x7fc730008be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:38.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74a40c700 1 -- 172.21.15.80:0/3915918590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc730009440 msgr2=0x7fc73000b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:38.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc730009440 0x7fc73000b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:38.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74a40c700 1 -- 172.21.15.80:0/3915918590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc730003b20 msgr2=0x7fc730005f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:38.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc730003b20 0x7fc730005f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:38.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74a40c700 1 -- 172.21.15.80:0/3915918590 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7300507a0 con 0x7fc730006730 2019-11-28T11:49:38.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74b40e700 1 -- 172.21.15.80:0/3915918590 reap_dead start 2019-11-28T11:49:38.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74ac0d700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc730003b20 0x7fc730005f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:38.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc730006730 0x7fc730008be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc72c00d4e0 tx=0x7fc72c00ad70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc730006730 0x7fc730008be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc72c00d4e0 tx=0x7fc72c00ad70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc730006730 0x7fc730008be0 secure :-1 s=READY pgs=2082 cs=0 l=1 rx=0x7fc72c00d4e0 tx=0x7fc72c00ad70).ready entity=mon.0 client_cookie=9337d5e1a0989a3c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:38.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc730006730 0x7fc730008be0 secure :-1 s=THROTTLE_DONE pgs=2082 cs=0 l=1 rx=0x7fc72c00d4e0 tx=0x7fc72c00ad70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc749c0b700 1 -- 172.21.15.80:0/3915918590 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc72c00ab60 con 0x7fc730006730 2019-11-28T11:49:38.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc730006730 0x7fc730008be0 secure :-1 s=THROTTLE_DONE pgs=2082 cs=0 l=1 rx=0x7fc72c00d4e0 tx=0x7fc72c00ad70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc730006730 0x7fc730008be0 secure :-1 s=THROTTLE_DONE pgs=2082 cs=0 l=1 rx=0x7fc72c00d4e0 tx=0x7fc72c00ad70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc749c0b700 1 -- 172.21.15.80:0/3915918590 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c009580 con 0x7fc730006730 2019-11-28T11:49:38.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc749c0b700 1 -- 172.21.15.80:0/3915918590 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc72c009c50 con 0x7fc730006730 2019-11-28T11:49:38.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74c670700 1 -- 172.21.15.80:0/3915918590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc730006730 msgr2=0x7fc730008be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:38.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.466+0000 7fc74c670700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc730006730 0x7fc730008be0 secure :-1 s=READY pgs=2082 cs=0 l=1 rx=0x7fc72c00d4e0 tx=0x7fc72c00ad70).stop 2019-11-28T11:49:38.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.467+0000 7fc74c670700 1 -- 172.21.15.80:0/3915918590 shutdown_connections 2019-11-28T11:49:38.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.467+0000 7fc74c670700 1 --2- 172.21.15.80:0/3915918590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc730006730 0x7fc730008be0 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:38.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.467+0000 7fc74c670700 1 -- 172.21.15.80:0/3915918590 shutdown_connections 2019-11-28T11:49:38.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.467+0000 7fc74c670700 1 -- 172.21.15.80:0/3915918590 wait complete. 2019-11-28T11:49:38.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.467+0000 7fc74c670700 1 -- 172.21.15.80:0/3915918590 >> 172.21.15.80:0/3915918590 conn(0x7fc744061d20 msgr2=0x7fc7440641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:38.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.469+0000 7fc74c670700 1 Processor -- start 2019-11-28T11:49:38.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.470+0000 7fc74c670700 1 -- start start 2019-11-28T11:49:38.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.470+0000 7fc74c670700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc74412c2a0 0x7fc74412c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:38.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.470+0000 7fc74c670700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74410a310 con 0x7fc7441510e0 2019-11-28T11:49:38.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.470+0000 7fc74c670700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc744109e50 con 0x7fc744108630 2019-11-28T11:49:38.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.470+0000 7fc74c670700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74412ee80 con 0x7fc74412c2a0 2019-11-28T11:49:38.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.470+0000 7fc74a40c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc74412c2a0 0x7fc74412c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:38.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.470+0000 7fc74a40c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc74412c2a0 0x7fc74412c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42258/0 (socket says 172.21.15.80:42258) 2019-11-28T11:49:38.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.471+0000 7fc74a40c700 1 -- 172.21.15.80:0/3478181030 learned_addr learned my addr 172.21.15.80:0/3478181030 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:38.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.471+0000 7fc74a40c700 1 -- 172.21.15.80:0/3478181030 >> v1:172.21.15.174:6789/0 conn(0x7fc744108630 legacy=0x7fc744152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:38.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.471+0000 7fc74a40c700 1 -- 172.21.15.80:0/3478181030 >> v1:172.21.15.80:6789/0 conn(0x7fc7441510e0 legacy=0x7fc744151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:38.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.471+0000 7fc74a40c700 1 -- 172.21.15.80:0/3478181030 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744133350 con 0x7fc74412c2a0 2019-11-28T11:49:38.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.471+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3478181030 >> v2:172.21.15.80:3300/0 conn(0x7fc74412c2a0 0x7fc74412c730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc72c010450 tx=0x7fc72c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.471+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3478181030 >> v2:172.21.15.80:3300/0 conn(0x7fc74412c2a0 0x7fc74412c730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc72c010450 tx=0x7fc72c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.471+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3478181030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74412c2a0 0x7fc74412c730 secure :-1 s=READY pgs=2084 cs=0 l=1 rx=0x7fc72c010450 tx=0x7fc72c0107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:38.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.471+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3478181030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74412c2a0 0x7fc74412c730 secure :-1 s=THROTTLE_DONE pgs=2084 cs=0 l=1 rx=0x7fc72c010450 tx=0x7fc72c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.471+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3478181030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74412c2a0 0x7fc74412c730 secure :-1 s=THROTTLE_DONE pgs=2084 cs=0 l=1 rx=0x7fc72c010450 tx=0x7fc72c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.471+0000 7fc7437fe700 1 -- 172.21.15.80:0/3478181030 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc72c00d460 con 0x7fc74412c2a0 2019-11-28T11:49:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.471+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3478181030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74412c2a0 0x7fc74412c730 secure :-1 s=THROTTLE_DONE pgs=2084 cs=0 l=1 rx=0x7fc72c010450 tx=0x7fc72c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.471+0000 7fc7437fe700 1 -- 172.21.15.80:0/3478181030 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c00d9d0 con 0x7fc74412c2a0 2019-11-28T11:49:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.471+0000 7fc74c670700 1 -- 172.21.15.80:0/3478181030 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7441336d0 con 0x7fc74412c2a0 2019-11-28T11:49:38.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.471+0000 7fc7437fe700 1 -- 172.21.15.80:0/3478181030 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc72c00e0a0 con 0x7fc74412c2a0 2019-11-28T11:49:38.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.471+0000 7fc74c670700 1 -- 172.21.15.80:0/3478181030 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc744133350 con 0x7fc74412c2a0 2019-11-28T11:49:38.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.471+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3478181030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74412c2a0 0x7fc74412c730 secure :-1 s=THROTTLE_DONE pgs=2084 cs=0 l=1 rx=0x7fc72c010450 tx=0x7fc72c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.472+0000 7fc7437fe700 1 -- 172.21.15.80:0/3478181030 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc72c00dbc0 con 0x7fc74412c2a0 2019-11-28T11:49:38.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.472+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3478181030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74412c2a0 0x7fc74412c730 secure :-1 s=THROTTLE_DONE pgs=2084 cs=0 l=1 rx=0x7fc72c010450 tx=0x7fc72c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.472+0000 7fc7437fe700 1 --2- 172.21.15.80:0/3478181030 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc728018730 0x7fc72801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:38.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.472+0000 7fc7437fe700 1 -- 172.21.15.80:0/3478181030 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc72c031b20 con 0x7fc74412c2a0 2019-11-28T11:49:38.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.472+0000 7fc74ac0d700 1 --2- 172.21.15.80:0/3478181030 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc728018730 0x7fc72801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:38.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.472+0000 7fc74ac0d700 1 --2- 172.21.15.80:0/3478181030 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc728018730 0x7fc72801abc0 crc :-1 s=READY pgs=845 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:38.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.479+0000 7fc74c670700 1 -- 172.21.15.80:0/3478181030 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7441336d0 con 0x7fc74412c2a0 2019-11-28T11:49:38.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.483+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3478181030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74412c2a0 0x7fc74412c730 secure :-1 s=THROTTLE_DONE pgs=2084 cs=0 l=1 rx=0x7fc72c010450 tx=0x7fc72c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.483+0000 7fc7437fe700 1 -- 172.21.15.80:0/3478181030 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc72c00d6d0 con 0x7fc74412c2a0 2019-11-28T11:49:38.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.650+0000 7fc74c670700 1 -- 172.21.15.80:0/3478181030 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fc744133350 con 0x7fc74412c2a0 2019-11-28T11:49:38.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.650+0000 7fc74a40c700 1 --2- 172.21.15.80:0/3478181030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74412c2a0 0x7fc74412c730 secure :-1 s=THROTTLE_DONE pgs=2084 cs=0 l=1 rx=0x7fc72c010450 tx=0x7fc72c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.650+0000 7fc7437fe700 1 -- 172.21.15.80:0/3478181030 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v162) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc72c00dbc0 con 0x7fc74412c2a0 2019-11-28T11:49:38.699 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:49:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.653+0000 7fc74c670700 1 -- 172.21.15.80:0/3478181030 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc728018730 msgr2=0x7fc72801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.653+0000 7fc74c670700 1 --2- 172.21.15.80:0/3478181030 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc728018730 0x7fc72801abc0 crc :-1 s=READY pgs=845 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.653+0000 7fc74c670700 1 -- 172.21.15.80:0/3478181030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74412c2a0 msgr2=0x7fc74412c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.653+0000 7fc74c670700 1 --2- 172.21.15.80:0/3478181030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74412c2a0 0x7fc74412c730 secure :-1 s=READY pgs=2084 cs=0 l=1 rx=0x7fc72c010450 tx=0x7fc72c0107f0).stop 2019-11-28T11:49:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.653+0000 7fc74c670700 1 -- 172.21.15.80:0/3478181030 shutdown_connections 2019-11-28T11:49:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.653+0000 7fc74c670700 1 --2- 172.21.15.80:0/3478181030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc74412c2a0 0x7fc74412c730 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.653+0000 7fc74c670700 1 --2- 172.21.15.80:0/3478181030 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc728018730 0x7fc72801abc0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.653+0000 7fc74c670700 1 -- 172.21.15.80:0/3478181030 shutdown_connections 2019-11-28T11:49:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.653+0000 7fc74c670700 1 -- 172.21.15.80:0/3478181030 wait complete. 2019-11-28T11:49:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.653+0000 7fc74c670700 1 -- 172.21.15.80:0/3478181030 >> 172.21.15.80:0/3478181030 conn(0x7fc74414dbb0 msgr2=0x7fc744142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:38.710 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:49:38.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.784+0000 7fb84d907700 1 Processor -- start 2019-11-28T11:49:38.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.785+0000 7fb84d907700 1 -- start start 2019-11-28T11:49:38.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.785+0000 7fb84d907700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb84815ed10 0x7fb84815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:38.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.785+0000 7fb84d907700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb848073020 0x7fb848071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:38.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.785+0000 7fb84d907700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb8480734b0 0x7fb8480723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:38.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.785+0000 7fb84d907700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84806f3d0 con 0x7fb848073020 2019-11-28T11:49:38.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.785+0000 7fb84d907700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84806fe00 con 0x7fb8480734b0 2019-11-28T11:49:38.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.785+0000 7fb84d907700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb848070760 con 0x7fb84815ed10 2019-11-28T11:49:38.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb846ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb848073020 0x7fb848071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:38.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb846ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb848073020 0x7fb848071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42268/0 (socket says 172.21.15.80:42268) 2019-11-28T11:49:38.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb846ffd700 1 -- 172.21.15.80:0/1807048313 learned_addr learned my addr 172.21.15.80:0/1807048313 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb8477fe700 1 --2- 172.21.15.80:0/1807048313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb84815ed10 0x7fb84815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb847fff700 1 --2- 172.21.15.80:0/1807048313 >> v2:172.21.15.174:3300/0 conn(0x7fb8480734b0 0x7fb8480723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb846ffd700 1 -- 172.21.15.80:0/1807048313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb84815ed10 msgr2=0x7fb84815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:38.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb846ffd700 1 --2- 172.21.15.80:0/1807048313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb84815ed10 0x7fb84815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:38.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb846ffd700 1 -- 172.21.15.80:0/1807048313 >> v2:172.21.15.174:3300/0 conn(0x7fb8480734b0 msgr2=0x7fb8480723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:38.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb846ffd700 1 --2- 172.21.15.80:0/1807048313 >> v2:172.21.15.174:3300/0 conn(0x7fb8480734b0 0x7fb8480723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:38.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb846ffd700 1 -- 172.21.15.80:0/1807048313 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848070ae0 con 0x7fb848073020 2019-11-28T11:49:38.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb847fff700 1 --2- 172.21.15.80:0/1807048313 >> v2:172.21.15.174:3300/0 conn(0x7fb8480734b0 0x7fb8480723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:38.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb846ffd700 1 --2- 172.21.15.80:0/1807048313 >> v2:172.21.15.80:3300/0 conn(0x7fb848073020 0x7fb848071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb83000fac0 tx=0x7fb83000f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb846ffd700 1 --2- 172.21.15.80:0/1807048313 >> v2:172.21.15.80:3300/0 conn(0x7fb848073020 0x7fb848071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb83000fac0 tx=0x7fb83000f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb846ffd700 1 --2- 172.21.15.80:0/1807048313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb848073020 0x7fb848071ea0 secure :-1 s=READY pgs=2085 cs=0 l=1 rx=0x7fb83000fac0 tx=0x7fb83000f970).ready entity=mon.0 client_cookie=4740490d7df85616 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:38.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb846ffd700 1 --2- 172.21.15.80:0/1807048313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb848073020 0x7fb848071ea0 secure :-1 s=THROTTLE_DONE pgs=2085 cs=0 l=1 rx=0x7fb83000fac0 tx=0x7fb83000f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb846ffd700 1 --2- 172.21.15.80:0/1807048313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb848073020 0x7fb848071ea0 secure :-1 s=THROTTLE_DONE pgs=2085 cs=0 l=1 rx=0x7fb83000fac0 tx=0x7fb83000f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb8467fc700 1 -- 172.21.15.80:0/1807048313 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb830000ce0 con 0x7fb848073020 2019-11-28T11:49:38.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb846ffd700 1 --2- 172.21.15.80:0/1807048313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb848073020 0x7fb848071ea0 secure :-1 s=THROTTLE_DONE pgs=2085 cs=0 l=1 rx=0x7fb83000fac0 tx=0x7fb83000f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb8467fc700 1 -- 172.21.15.80:0/1807048313 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb830001010 con 0x7fb848073020 2019-11-28T11:49:38.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb8467fc700 1 -- 172.21.15.80:0/1807048313 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb830001720 con 0x7fb848073020 2019-11-28T11:49:38.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb84d907700 1 -- 172.21.15.80:0/1807048313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb848073020 msgr2=0x7fb848071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:38.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.786+0000 7fb84d907700 1 --2- 172.21.15.80:0/1807048313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb848073020 0x7fb848071ea0 secure :-1 s=READY pgs=2085 cs=0 l=1 rx=0x7fb83000fac0 tx=0x7fb83000f970).stop 2019-11-28T11:49:38.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.787+0000 7fb84d907700 1 -- 172.21.15.80:0/1807048313 shutdown_connections 2019-11-28T11:49:38.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.787+0000 7fb84d907700 1 --2- 172.21.15.80:0/1807048313 >> v2:172.21.15.174:3300/0 conn(0x7fb8480734b0 0x7fb8480723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:38.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.787+0000 7fb84d907700 1 --2- 172.21.15.80:0/1807048313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb848073020 0x7fb848071ea0 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:38.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.787+0000 7fb84d907700 1 --2- 172.21.15.80:0/1807048313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb84815ed10 0x7fb84815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:38.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.787+0000 7fb84d907700 1 -- 172.21.15.80:0/1807048313 shutdown_connections 2019-11-28T11:49:38.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.787+0000 7fb84d907700 1 -- 172.21.15.80:0/1807048313 wait complete. 2019-11-28T11:49:38.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.787+0000 7fb84d907700 1 -- 172.21.15.80:0/1807048313 >> 172.21.15.80:0/1807048313 conn(0x7fb848061d20 msgr2=0x7fb8480641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:38.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.789+0000 7fb84d907700 1 Processor -- start 2019-11-28T11:49:38.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.790+0000 7fb84d907700 1 -- start start 2019-11-28T11:49:38.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb84d907700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb848105860 0x7fb848105cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:38.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb84d907700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84810f740 con 0x7fb848106230 2019-11-28T11:49:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb84d907700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8481539d0 con 0x7fb84810ffa0 2019-11-28T11:49:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb84d907700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84810d980 con 0x7fb848105860 2019-11-28T11:49:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb847fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb848106230 0x7fb84816ada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41590/0 (socket says 172.21.15.80:41590) 2019-11-28T11:49:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb847fff700 1 -- 172.21.15.80:0/3172088896 learned_addr learned my addr 172.21.15.80:0/3172088896 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb846ffd700 1 --2- 172.21.15.80:0/3172088896 >> v2:172.21.15.174:3300/0 conn(0x7fb848105860 0x7fb848105cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb83ffff700 1 -- 172.21.15.80:0/3172088896 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192995994 0 0) 0x7fb840009850 con 0x7fb848106230 2019-11-28T11:49:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb83ffff700 1 -- 172.21.15.80:0/3172088896 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb820002e80 con 0x7fb848106230 2019-11-28T11:49:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb83ffff700 1 -- 172.21.15.80:0/3172088896 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1507998785 0 0) 0x7fb840001280 con 0x7fb848106230 2019-11-28T11:49:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb846ffd700 1 -- 172.21.15.80:0/3172088896 >> v1:172.21.15.174:6789/0 conn(0x7fb84810ffa0 legacy=0x7fb8481069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb846ffd700 1 -- 172.21.15.80:0/3172088896 >> v1:172.21.15.80:6789/0 conn(0x7fb848106230 legacy=0x7fb84816ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb846ffd700 1 -- 172.21.15.80:0/3172088896 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84810e2e0 con 0x7fb848105860 2019-11-28T11:49:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb846ffd700 1 --2- 172.21.15.80:0/3172088896 >> v2:172.21.15.174:3300/0 conn(0x7fb848105860 0x7fb848105cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb830054770 tx=0x7fb830054b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb846ffd700 1 --2- 172.21.15.80:0/3172088896 >> v2:172.21.15.174:3300/0 conn(0x7fb848105860 0x7fb848105cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb830054770 tx=0x7fb830054b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb846ffd700 1 --2- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb848105860 0x7fb848105cf0 secure :-1 s=READY pgs=1237 cs=0 l=1 rx=0x7fb830054770 tx=0x7fb830054b10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:38.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb846ffd700 1 --2- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb848105860 0x7fb848105cf0 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fb830054770 tx=0x7fb830054b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb83ffff700 1 -- 172.21.15.80:0/3172088896 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb830007ff0 con 0x7fb848105860 2019-11-28T11:49:38.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb846ffd700 1 --2- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb848105860 0x7fb848105cf0 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fb830054770 tx=0x7fb830054b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb846ffd700 1 --2- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb848105860 0x7fb848105cf0 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fb830054770 tx=0x7fb830054b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.791+0000 7fb83ffff700 1 -- 172.21.15.80:0/3172088896 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb830005710 con 0x7fb848105860 2019-11-28T11:49:38.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.792+0000 7fb83ffff700 1 -- 172.21.15.80:0/3172088896 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb830005e20 con 0x7fb848105860 2019-11-28T11:49:38.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.792+0000 7fb84d907700 1 -- 172.21.15.80:0/3172088896 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84810e660 con 0x7fb848105860 2019-11-28T11:49:38.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.792+0000 7fb84d907700 1 -- 172.21.15.80:0/3172088896 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84810e2e0 con 0x7fb848105860 2019-11-28T11:49:38.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.792+0000 7fb846ffd700 1 --2- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb848105860 0x7fb848105cf0 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fb830054770 tx=0x7fb830054b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.792+0000 7fb83ffff700 1 -- 172.21.15.80:0/3172088896 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb830007ff0 con 0x7fb848105860 2019-11-28T11:49:38.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.792+0000 7fb846ffd700 1 --2- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb848105860 0x7fb848105cf0 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fb830054770 tx=0x7fb830054b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.792+0000 7fb83ffff700 1 --2- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb820018780 0x7fb82001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:38.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.792+0000 7fb83ffff700 1 -- 172.21.15.80:0/3172088896 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb830075e70 con 0x7fb848105860 2019-11-28T11:49:38.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.793+0000 7fb8477fe700 1 --2- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb820018780 0x7fb82001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:38.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.793+0000 7fb8477fe700 1 --2- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb820018780 0x7fb82001abf0 crc :-1 s=READY pgs=846 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:38.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.800+0000 7fb84d907700 1 -- 172.21.15.80:0/3172088896 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84810e660 con 0x7fb848105860 2019-11-28T11:49:38.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.804+0000 7fb846ffd700 1 --2- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb848105860 0x7fb848105cf0 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fb830054770 tx=0x7fb830054b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:38.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.804+0000 7fb83ffff700 1 -- 172.21.15.80:0/3172088896 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb830005500 con 0x7fb848105860 2019-11-28T11:49:39.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.967+0000 7fb84d907700 1 -- 172.21.15.80:0/3172088896 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fb84810e2e0 con 0x7fb848105860 2019-11-28T11:49:39.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.969+0000 7fb846ffd700 1 --2- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb848105860 0x7fb848105cf0 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fb830054770 tx=0x7fb830054b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.969+0000 7fb83ffff700 1 -- 172.21.15.80:0/3172088896 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v162) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb830007ff0 con 0x7fb848105860 2019-11-28T11:49:39.016 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:49:39.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.970+0000 7fb84d907700 1 -- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb820018780 msgr2=0x7fb82001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.970+0000 7fb84d907700 1 --2- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb820018780 0x7fb82001abf0 crc :-1 s=READY pgs=846 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:39.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.970+0000 7fb84d907700 1 -- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb848105860 msgr2=0x7fb848105cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.970+0000 7fb84d907700 1 --2- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb848105860 0x7fb848105cf0 secure :-1 s=READY pgs=1237 cs=0 l=1 rx=0x7fb830054770 tx=0x7fb830054b10).stop 2019-11-28T11:49:39.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.970+0000 7fb84d907700 1 -- 172.21.15.80:0/3172088896 shutdown_connections 2019-11-28T11:49:39.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.970+0000 7fb84d907700 1 --2- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb848105860 0x7fb848105cf0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:39.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.970+0000 7fb84d907700 1 --2- 172.21.15.80:0/3172088896 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb820018780 0x7fb82001abf0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:39.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.971+0000 7fb84d907700 1 -- 172.21.15.80:0/3172088896 shutdown_connections 2019-11-28T11:49:39.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.971+0000 7fb84d907700 1 -- 172.21.15.80:0/3172088896 wait complete. 2019-11-28T11:49:39.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:38.971+0000 7fb84d907700 1 -- 172.21.15.80:0/3172088896 >> 172.21.15.80:0/3172088896 conn(0x7fb84815e2d0 msgr2=0x7fb848147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:39.029 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:49:39.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.104+0000 7f3b25777700 1 Processor -- start 2019-11-28T11:49:39.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.104+0000 7f3b25777700 1 -- start start 2019-11-28T11:49:39.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.105+0000 7f3b25777700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3b2015f100 0x7f3b2006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:39.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.105+0000 7f3b25777700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b2006c2f0 0x7f3b2006c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:39.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.105+0000 7f3b25777700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2006db60 con 0x7f3b2015ed10 2019-11-28T11:49:39.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.105+0000 7f3b25777700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2006fe00 con 0x7f3b2015f100 2019-11-28T11:49:39.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.105+0000 7f3b25777700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b200700d0 con 0x7f3b2006c2f0 2019-11-28T11:49:39.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.105+0000 7f3b1ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b2006c2f0 0x7f3b2006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:39.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.105+0000 7f3b1effd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3b2015f100 0x7f3b2006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:39.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.105+0000 7f3b1ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b2006c2f0 0x7f3b2006c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:44540/0 (socket says 172.21.15.80:44540) 2019-11-28T11:49:39.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.105+0000 7f3b1ffff700 1 -- 172.21.15.80:0/3537297341 learned_addr learned my addr 172.21.15.80:0/3537297341 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:39.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.105+0000 7f3b1f7fe700 1 --1- 172.21.15.80:0/3537297341 >> v1:172.21.15.174:6789/0 conn(0x7f3b2015ed10 0x7f3b20073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:57138/0 (socket says 172.21.15.80:57138) 2019-11-28T11:49:39.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b1effd700 1 -- 172.21.15.80:0/3537297341 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b2006c2f0 msgr2=0x7f3b2006c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:39.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b1effd700 1 --2- 172.21.15.80:0/3537297341 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b2006c2f0 0x7f3b2006c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b1effd700 1 -- 172.21.15.80:0/3537297341 >> v1:172.21.15.174:6789/0 conn(0x7f3b2015ed10 legacy=0x7f3b20073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b1e7fc700 1 -- 172.21.15.80:0/3537297341 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082188126 0 0) 0x7f3b10001080 con 0x7f3b2015ed10 2019-11-28T11:49:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b1effd700 1 -- 172.21.15.80:0/3537297341 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b20070760 con 0x7f3b2015f100 2019-11-28T11:49:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b1ffff700 1 --2- 172.21.15.80:0/3537297341 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b2006c2f0 0x7f3b2006c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b1effd700 1 --2- 172.21.15.80:0/3537297341 >> v2:172.21.15.174:3300/0 conn(0x7f3b2015f100 0x7f3b2006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b0800b2d0 tx=0x7f3b0800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b1effd700 1 --2- 172.21.15.80:0/3537297341 >> v2:172.21.15.174:3300/0 conn(0x7f3b2015f100 0x7f3b2006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b0800b2d0 tx=0x7f3b0800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b1effd700 1 --2- 172.21.15.80:0/3537297341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b2015f100 0x7f3b2006bdb0 secure :-1 s=READY pgs=1239 cs=0 l=1 rx=0x7f3b0800b2d0 tx=0x7f3b0800bae0).ready entity=mon.1 client_cookie=89cff0bbbe4de19a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:39.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b1effd700 1 --2- 172.21.15.80:0/3537297341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b2015f100 0x7f3b2006bdb0 secure :-1 s=THROTTLE_DONE pgs=1239 cs=0 l=1 rx=0x7f3b0800b2d0 tx=0x7f3b0800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b1effd700 1 --2- 172.21.15.80:0/3537297341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b2015f100 0x7f3b2006bdb0 secure :-1 s=THROTTLE_DONE pgs=1239 cs=0 l=1 rx=0x7f3b0800b2d0 tx=0x7f3b0800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b1e7fc700 1 -- 172.21.15.80:0/3537297341 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b08007590 con 0x7f3b2015f100 2019-11-28T11:49:39.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b1effd700 1 --2- 172.21.15.80:0/3537297341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b2015f100 0x7f3b2006bdb0 secure :-1 s=THROTTLE_DONE pgs=1239 cs=0 l=1 rx=0x7f3b0800b2d0 tx=0x7f3b0800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b1e7fc700 1 -- 172.21.15.80:0/3537297341 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b08009d30 con 0x7f3b2015f100 2019-11-28T11:49:39.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b1e7fc700 1 -- 172.21.15.80:0/3537297341 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b0800a400 con 0x7f3b2015f100 2019-11-28T11:49:39.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b25777700 1 -- 172.21.15.80:0/3537297341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b2015f100 msgr2=0x7f3b2006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.106+0000 7f3b25777700 1 --2- 172.21.15.80:0/3537297341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b2015f100 0x7f3b2006bdb0 secure :-1 s=READY pgs=1239 cs=0 l=1 rx=0x7f3b0800b2d0 tx=0x7f3b0800bae0).stop 2019-11-28T11:49:39.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.107+0000 7f3b25777700 1 -- 172.21.15.80:0/3537297341 shutdown_connections 2019-11-28T11:49:39.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.107+0000 7f3b25777700 1 --2- 172.21.15.80:0/3537297341 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b2006c2f0 0x7f3b2006c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:39.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.107+0000 7f3b25777700 1 --2- 172.21.15.80:0/3537297341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b2015f100 0x7f3b2006bdb0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:39.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.107+0000 7f3b25777700 1 -- 172.21.15.80:0/3537297341 shutdown_connections 2019-11-28T11:49:39.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.107+0000 7f3b25777700 1 -- 172.21.15.80:0/3537297341 wait complete. 2019-11-28T11:49:39.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.107+0000 7f3b25777700 1 -- 172.21.15.80:0/3537297341 >> 172.21.15.80:0/3537297341 conn(0x7f3b20061d20 msgr2=0x7f3b200641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:39.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.109+0000 7f3b25777700 1 Processor -- start 2019-11-28T11:49:39.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.109+0000 7f3b25777700 1 -- start start 2019-11-28T11:49:39.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.110+0000 7f3b25777700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3b2010ed60 0x7f3b2010f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:39.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.110+0000 7f3b25777700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2010c250 con 0x7f3b2010f730 2019-11-28T11:49:39.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.110+0000 7f3b25777700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2010c6d0 con 0x7f3b2010e970 2019-11-28T11:49:39.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.110+0000 7f3b25777700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2010e430 con 0x7f3b2010ed60 2019-11-28T11:49:39.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.110+0000 7f3b1ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3b2010f730 0x7f3b20167d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41604/0 (socket says 172.21.15.80:41604) 2019-11-28T11:49:39.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.110+0000 7f3b1ffff700 1 -- 172.21.15.80:0/1625005312 learned_addr learned my addr 172.21.15.80:0/1625005312 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:39.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b1effd700 1 --2- 172.21.15.80:0/1625005312 >> v2:172.21.15.174:3300/0 conn(0x7f3b2010ed60 0x7f3b2010f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:39.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434452711 0 0) 0x7f3b180078b0 con 0x7f3b2010f730 2019-11-28T11:49:39.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af8002e80 con 0x7f3b2010f730 2019-11-28T11:49:39.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4137736349 0 0) 0x7f3b18001280 con 0x7f3b2010f730 2019-11-28T11:49:39.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3af80032e0 con 0x7f3b2010f730 2019-11-28T11:49:39.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f3b18001830 con 0x7f3b2010f730 2019-11-28T11:49:39.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 >> v2:172.21.15.174:3300/0 conn(0x7f3b2010ed60 msgr2=0x7f3b2010f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b17fff700 1 --2- 172.21.15.80:0/1625005312 >> v2:172.21.15.174:3300/0 conn(0x7f3b2010ed60 0x7f3b2010f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:39.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 >> v1:172.21.15.174:6789/0 conn(0x7f3b2010e970 legacy=0x7f3b201087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 >> v1:172.21.15.80:6789/0 conn(0x7f3b2010f730 legacy=0x7f3b20167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b17fff700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af80033b0 0x7f3af8003800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:39.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b17fff700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3af8003d40 0x7f3af8004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:39.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b17fff700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af8004a60 0x7f3af8004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:39.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af800bcb0 con 0x7f3af80033b0 2019-11-28T11:49:39.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af800bee0 con 0x7f3af8004a60 2019-11-28T11:49:39.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af800c110 con 0x7f3af8003d40 2019-11-28T11:49:39.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b1effd700 1 --2- 172.21.15.80:0/1625005312 >> v2:172.21.15.174:3300/0 conn(0x7f3b2010ed60 0x7f3b2010f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:39.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b1f7fe700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af80033b0 0x7f3af8003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:39.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b1ffff700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af8004a60 0x7f3af8004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:39.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b1effd700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3af8003d40 0x7f3af8004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:39.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b1f7fe700 1 -- 172.21.15.80:0/1625005312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3af8003d40 msgr2=0x7f3af8004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b1f7fe700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3af8003d40 0x7f3af8004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:39.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b1f7fe700 1 -- 172.21.15.80:0/1625005312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af8004a60 msgr2=0x7f3af8004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b1f7fe700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af8004a60 0x7f3af8004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:39.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b1ffff700 1 -- 172.21.15.80:0/1625005312 reap_dead start 2019-11-28T11:49:39.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.111+0000 7f3b1f7fe700 1 -- 172.21.15.80:0/1625005312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af800c3c0 con 0x7f3af80033b0 2019-11-28T11:49:39.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.112+0000 7f3b25777700 1 -- 172.21.15.80:0/1625005312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b20106270 con 0x7f3af80033b0 2019-11-28T11:49:39.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.112+0000 7f3b1f7fe700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af80033b0 0x7f3af8003800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b10010300 tx=0x7f3b100101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.112+0000 7f3b25777700 1 -- 172.21.15.80:0/1625005312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b20105ef0 con 0x7f3af80033b0 2019-11-28T11:49:39.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.112+0000 7f3b1f7fe700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af80033b0 0x7f3af8003800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b10010300 tx=0x7f3b100101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.112+0000 7f3b1f7fe700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af80033b0 0x7f3af8003800 secure :-1 s=READY pgs=2088 cs=0 l=1 rx=0x7f3b10010300 tx=0x7f3b100101e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:39.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.112+0000 7f3b1f7fe700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af80033b0 0x7f3af8003800 secure :-1 s=THROTTLE_DONE pgs=2088 cs=0 l=1 rx=0x7f3b10010300 tx=0x7f3b100101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.112+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b10000eb0 con 0x7f3af80033b0 2019-11-28T11:49:39.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.112+0000 7f3b1f7fe700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af80033b0 0x7f3af8003800 secure :-1 s=THROTTLE_DONE pgs=2088 cs=0 l=1 rx=0x7f3b10010300 tx=0x7f3b100101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.112+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b10000c50 con 0x7f3af80033b0 2019-11-28T11:49:39.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.112+0000 7f3b1f7fe700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af80033b0 0x7f3af8003800 secure :-1 s=THROTTLE_DONE pgs=2088 cs=0 l=1 rx=0x7f3b10010300 tx=0x7f3b100101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.112+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b100043b0 con 0x7f3af80033b0 2019-11-28T11:49:39.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.112+0000 7f3b1f7fe700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af80033b0 0x7f3af8003800 secure :-1 s=THROTTLE_DONE pgs=2088 cs=0 l=1 rx=0x7f3b10010300 tx=0x7f3b100101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.112+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3b100041c0 con 0x7f3af80033b0 2019-11-28T11:49:39.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.112+0000 7f3b1f7fe700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af80033b0 0x7f3af8003800 secure :-1 s=THROTTLE_DONE pgs=2088 cs=0 l=1 rx=0x7f3b10010300 tx=0x7f3b100101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.112+0000 7f3b17fff700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3af801b520 0x7f3af801d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:39.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.112+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3b10031b20 con 0x7f3af80033b0 2019-11-28T11:49:39.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.113+0000 7f3b1effd700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3af801b520 0x7f3af801d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:39.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.113+0000 7f3b1effd700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3af801b520 0x7f3af801d950 crc :-1 s=READY pgs=847 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:39.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.120+0000 7f3b25777700 1 -- 172.21.15.80:0/1625005312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3afc002e60 con 0x7f3af80033b0 2019-11-28T11:49:39.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.123+0000 7f3b1f7fe700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af80033b0 0x7f3af8003800 secure :-1 s=THROTTLE_DONE pgs=2088 cs=0 l=1 rx=0x7f3b10010300 tx=0x7f3b100101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.123+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3b10001210 con 0x7f3af80033b0 2019-11-28T11:49:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.290+0000 7f3b25777700 1 -- 172.21.15.80:0/1625005312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f3afc001d30 con 0x7f3af80033b0 2019-11-28T11:49:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.290+0000 7f3b1f7fe700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af80033b0 0x7f3af8003800 secure :-1 s=THROTTLE_DONE pgs=2088 cs=0 l=1 rx=0x7f3b10010300 tx=0x7f3b100101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.290+0000 7f3b17fff700 1 -- 172.21.15.80:0/1625005312 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v162) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3b10000c10 con 0x7f3af80033b0 2019-11-28T11:49:39.339 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:49:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.292+0000 7f3b25777700 1 -- 172.21.15.80:0/1625005312 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3af801b520 msgr2=0x7f3af801d950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.292+0000 7f3b25777700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3af801b520 0x7f3af801d950 crc :-1 s=READY pgs=847 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.292+0000 7f3b25777700 1 -- 172.21.15.80:0/1625005312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af80033b0 msgr2=0x7f3af8003800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.292+0000 7f3b25777700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af80033b0 0x7f3af8003800 secure :-1 s=READY pgs=2088 cs=0 l=1 rx=0x7f3b10010300 tx=0x7f3b100101e0).stop 2019-11-28T11:49:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.293+0000 7f3b25777700 1 -- 172.21.15.80:0/1625005312 shutdown_connections 2019-11-28T11:49:39.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.293+0000 7f3b25777700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3af801b520 0x7f3af801d950 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:39.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.293+0000 7f3b25777700 1 --2- 172.21.15.80:0/1625005312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3af80033b0 0x7f3af8003800 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:39.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.293+0000 7f3b25777700 1 -- 172.21.15.80:0/1625005312 shutdown_connections 2019-11-28T11:49:39.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.293+0000 7f3b25777700 1 -- 172.21.15.80:0/1625005312 wait complete. 2019-11-28T11:49:39.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.293+0000 7f3b25777700 1 -- 172.21.15.80:0/1625005312 >> 172.21.15.80:0/1625005312 conn(0x7f3b2015e2d0 msgr2=0x7f3b20147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:39.350 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:49:39.351 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:49:39.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.422+0000 7f5150c51700 1 Processor -- start 2019-11-28T11:49:39.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.422+0000 7f5150c51700 1 -- start start 2019-11-28T11:49:39.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f5150c51700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f514c06c0a0 0x7f514c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:39.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f5150c51700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f514c0734e0 0x7f514c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:39.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f5150c51700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c06db00 con 0x7f514c072360 2019-11-28T11:49:39.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f5150c51700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514c06f330 con 0x7f514c0734e0 2019-11-28T11:49:39.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f5150c51700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0706c0 con 0x7f514c06c0a0 2019-11-28T11:49:39.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f514a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f514c0734e0 0x7f514c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:39.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f514a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f514c0734e0 0x7f514c071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42302/0 (socket says 172.21.15.80:42302) 2019-11-28T11:49:39.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f514ad9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f514c06c0a0 0x7f514c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:39.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f514a59c700 1 -- 172.21.15.80:0/4214479030 learned_addr learned my addr 172.21.15.80:0/4214479030 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:39.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f514a59c700 1 -- 172.21.15.80:0/4214479030 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f514c06c0a0 msgr2=0x7f514c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:39.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f514a59c700 1 --2- 172.21.15.80:0/4214479030 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f514c06c0a0 0x7f514c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:39.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f514a59c700 1 -- 172.21.15.80:0/4214479030 >> v1:172.21.15.174:6789/0 conn(0x7f514c072360 legacy=0x7f514c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f5149d9b700 1 -- 172.21.15.80:0/4214479030 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076389792 0 0) 0x7f51340009b0 con 0x7f514c072360 2019-11-28T11:49:39.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f514a59c700 1 -- 172.21.15.80:0/4214479030 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c070a40 con 0x7f514c0734e0 2019-11-28T11:49:39.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f514a59c700 1 --2- 172.21.15.80:0/4214479030 >> v2:172.21.15.80:3300/0 conn(0x7f514c0734e0 0x7f514c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f514400fa40 tx=0x7f514400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f514a59c700 1 --2- 172.21.15.80:0/4214479030 >> v2:172.21.15.80:3300/0 conn(0x7f514c0734e0 0x7f514c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f514400fa40 tx=0x7f514400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f514a59c700 1 --2- 172.21.15.80:0/4214479030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c0734e0 0x7f514c071e20 secure :-1 s=READY pgs=2089 cs=0 l=1 rx=0x7f514400fa40 tx=0x7f514400fde0).ready entity=mon.0 client_cookie=3690f03970d39864 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:39.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.423+0000 7f514a59c700 1 --2- 172.21.15.80:0/4214479030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c0734e0 0x7f514c071e20 secure :-1 s=THROTTLE_DONE pgs=2089 cs=0 l=1 rx=0x7f514400fa40 tx=0x7f514400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.424+0000 7f5149d9b700 1 -- 172.21.15.80:0/4214479030 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5144000ce0 con 0x7f514c0734e0 2019-11-28T11:49:39.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.424+0000 7f514a59c700 1 --2- 172.21.15.80:0/4214479030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c0734e0 0x7f514c071e20 secure :-1 s=THROTTLE_DONE pgs=2089 cs=0 l=1 rx=0x7f514400fa40 tx=0x7f514400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.424+0000 7f514a59c700 1 --2- 172.21.15.80:0/4214479030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c0734e0 0x7f514c071e20 secure :-1 s=THROTTLE_DONE pgs=2089 cs=0 l=1 rx=0x7f514400fa40 tx=0x7f514400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.424+0000 7f5149d9b700 1 -- 172.21.15.80:0/4214479030 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5144001010 con 0x7f514c0734e0 2019-11-28T11:49:39.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.424+0000 7f5149d9b700 1 -- 172.21.15.80:0/4214479030 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5144001720 con 0x7f514c0734e0 2019-11-28T11:49:39.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.424+0000 7f5150c51700 1 -- 172.21.15.80:0/4214479030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c0734e0 msgr2=0x7f514c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.424+0000 7f5150c51700 1 --2- 172.21.15.80:0/4214479030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c0734e0 0x7f514c071e20 secure :-1 s=READY pgs=2089 cs=0 l=1 rx=0x7f514400fa40 tx=0x7f514400fde0).stop 2019-11-28T11:49:39.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.424+0000 7f5150c51700 1 -- 172.21.15.80:0/4214479030 shutdown_connections 2019-11-28T11:49:39.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.424+0000 7f5150c51700 1 --2- 172.21.15.80:0/4214479030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c0734e0 0x7f514c071e20 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:39.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.424+0000 7f5150c51700 1 --2- 172.21.15.80:0/4214479030 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f514c06c0a0 0x7f514c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:39.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.424+0000 7f5150c51700 1 -- 172.21.15.80:0/4214479030 shutdown_connections 2019-11-28T11:49:39.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.424+0000 7f5150c51700 1 -- 172.21.15.80:0/4214479030 wait complete. 2019-11-28T11:49:39.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.424+0000 7f5150c51700 1 -- 172.21.15.80:0/4214479030 >> 172.21.15.80:0/4214479030 conn(0x7f514c061cf0 msgr2=0x7f514c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:39.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.427+0000 7f5150c51700 1 Processor -- start 2019-11-28T11:49:39.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.427+0000 7f5150c51700 1 -- start start 2019-11-28T11:49:39.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f5150c51700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f514c1281b0 0x7f514c128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:39.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f5150c51700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f514c128b80 0x7f514c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:39.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f5150c51700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c139a60 con 0x7f514c13a780 2019-11-28T11:49:39.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f5150c51700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514c12a260 con 0x7f514c128b80 2019-11-28T11:49:39.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f5150c51700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c12a530 con 0x7f514c1281b0 2019-11-28T11:49:39.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f514b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f514c128b80 0x7f514c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:39.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f514b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f514c128b80 0x7f514c167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42308/0 (socket says 172.21.15.80:42308) 2019-11-28T11:49:39.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f514b59e700 1 -- 172.21.15.80:0/553354897 learned_addr learned my addr 172.21.15.80:0/553354897 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:39.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f514a59c700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f514c1281b0 0x7f514c128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:39.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f514b59e700 1 -- 172.21.15.80:0/553354897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f514c1281b0 msgr2=0x7f514c128640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f514b59e700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f514c1281b0 0x7f514c128640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:39.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f514b59e700 1 -- 172.21.15.80:0/553354897 >> v1:172.21.15.174:6789/0 conn(0x7f514c13a780 legacy=0x7f514c12d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f514b59e700 1 -- 172.21.15.80:0/553354897 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c12abc0 con 0x7f514c128b80 2019-11-28T11:49:39.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f51437fe700 1 -- 172.21.15.80:0/553354897 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732695533 0 0) 0x7f513c000ea0 con 0x7f514c13a780 2019-11-28T11:49:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f514b59e700 1 --2- 172.21.15.80:0/553354897 >> v2:172.21.15.80:3300/0 conn(0x7f514c128b80 0x7f514c167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5134010410 tx=0x7f5134010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f514b59e700 1 --2- 172.21.15.80:0/553354897 >> v2:172.21.15.80:3300/0 conn(0x7f514c128b80 0x7f514c167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5134010410 tx=0x7f5134010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f514b59e700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c128b80 0x7f514c167d70 secure :-1 s=READY pgs=2090 cs=0 l=1 rx=0x7f5134010410 tx=0x7f5134010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f514b59e700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c128b80 0x7f514c167d70 secure :-1 s=THROTTLE_DONE pgs=2090 cs=0 l=1 rx=0x7f5134010410 tx=0x7f5134010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f51437fe700 1 -- 172.21.15.80:0/553354897 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5134005770 con 0x7f514c128b80 2019-11-28T11:49:39.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f514b59e700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c128b80 0x7f514c167d70 secure :-1 s=THROTTLE_DONE pgs=2090 cs=0 l=1 rx=0x7f5134010410 tx=0x7f5134010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f514b59e700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c128b80 0x7f514c167d70 secure :-1 s=THROTTLE_DONE pgs=2090 cs=0 l=1 rx=0x7f5134010410 tx=0x7f5134010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f51437fe700 1 -- 172.21.15.80:0/553354897 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5134005390 con 0x7f514c128b80 2019-11-28T11:49:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f51437fe700 1 -- 172.21.15.80:0/553354897 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5134005d50 con 0x7f514c128b80 2019-11-28T11:49:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f5150c51700 1 -- 172.21.15.80:0/553354897 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c12af40 con 0x7f514c128b80 2019-11-28T11:49:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.428+0000 7f5150c51700 1 -- 172.21.15.80:0/553354897 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c12abc0 con 0x7f514c128b80 2019-11-28T11:49:39.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.429+0000 7f514b59e700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c128b80 0x7f514c167d70 secure :-1 s=THROTTLE_DONE pgs=2090 cs=0 l=1 rx=0x7f5134010410 tx=0x7f5134010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.429+0000 7f51437fe700 1 -- 172.21.15.80:0/553354897 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5134005580 con 0x7f514c128b80 2019-11-28T11:49:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.429+0000 7f514b59e700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c128b80 0x7f514c167d70 secure :-1 s=THROTTLE_DONE pgs=2090 cs=0 l=1 rx=0x7f5134010410 tx=0x7f5134010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.429+0000 7f51437fe700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5130018730 0x7f513001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.429+0000 7f51437fe700 1 -- 172.21.15.80:0/553354897 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5134031b10 con 0x7f514c128b80 2019-11-28T11:49:39.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.429+0000 7f514ad9d700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5130018730 0x7f513001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:39.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.429+0000 7f514ad9d700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5130018730 0x7f513001abc0 crc :-1 s=READY pgs=848 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.437+0000 7f5150c51700 1 -- 172.21.15.80:0/553354897 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c12af40 con 0x7f514c128b80 2019-11-28T11:49:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.441+0000 7f514b59e700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c128b80 0x7f514c167d70 secure :-1 s=THROTTLE_DONE pgs=2090 cs=0 l=1 rx=0x7f5134010410 tx=0x7f5134010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.441+0000 7f51437fe700 1 -- 172.21.15.80:0/553354897 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f51340075a0 con 0x7f514c128b80 2019-11-28T11:49:39.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.613+0000 7f5150c51700 1 -- 172.21.15.80:0/553354897 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f514c12abc0 con 0x7f514c128b80 2019-11-28T11:49:39.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.614+0000 7f514b59e700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c128b80 0x7f514c167d70 secure :-1 s=THROTTLE_DONE pgs=2090 cs=0 l=1 rx=0x7f5134010410 tx=0x7f5134010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:39.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.614+0000 7f51437fe700 1 -- 172.21.15.80:0/553354897 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) v1 ==== 95+0+1780 (secure 0 0 0) 0x7f5134005390 con 0x7f514c128b80 2019-11-28T11:49:39.663 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 124 2019-11-28T11:49:39.663 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:39.663 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":124,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:49:37.195766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9442":{"gid":9442,"name":"c","rank":0,"incarnation":123,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/1260063619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1260063619},{"type":"v1","addr":"172.21.15.174:6835","nonce":1260063619}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:49:39.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.616+0000 7f5150c51700 1 -- 172.21.15.80:0/553354897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5130018730 msgr2=0x7f513001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.616+0000 7f5150c51700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5130018730 0x7f513001abc0 crc :-1 s=READY pgs=848 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:39.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.616+0000 7f5150c51700 1 -- 172.21.15.80:0/553354897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c128b80 msgr2=0x7f514c167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:39.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.616+0000 7f5150c51700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c128b80 0x7f514c167d70 secure :-1 s=READY pgs=2090 cs=0 l=1 rx=0x7f5134010410 tx=0x7f5134010290).stop 2019-11-28T11:49:39.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.616+0000 7f5150c51700 1 -- 172.21.15.80:0/553354897 shutdown_connections 2019-11-28T11:49:39.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.616+0000 7f5150c51700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514c128b80 0x7f514c167d70 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:39.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.616+0000 7f5150c51700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f514c1281b0 0x7f514c128640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:39.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.616+0000 7f5150c51700 1 --2- 172.21.15.80:0/553354897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5130018730 0x7f513001abc0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:39.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.617+0000 7f5150c51700 1 -- 172.21.15.80:0/553354897 shutdown_connections 2019-11-28T11:49:39.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.617+0000 7f5150c51700 1 -- 172.21.15.80:0/553354897 wait complete. 2019-11-28T11:49:39.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:39.617+0000 7f5150c51700 1 -- 172.21.15.80:0/553354897 >> 172.21.15.80:0/553354897 conn(0x7f514c127dc0 msgr2=0x7f514c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:39.979 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 9442}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 26, u'failed': [], u'epoch': 124, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [27], u'info': {u'gid_9442': {u'export_targets': [], u'name': u'c', u'incarnation': 123, u'state_seq': 2, u'state': u'up:active', u'gid': 9442, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1260063619, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 1260063619, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/1260063619'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:49:33.165935+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:49:37.195766+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:49:39.979 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:49:39.979 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:49:40.110 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:49:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:49:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:49:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 9442, 2019-11-28T11:49:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:49:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:49:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 3.869813937, 2019-11-28T11:49:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 124, 2019-11-28T11:49:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 162, 2019-11-28T11:49:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 162, 2019-11-28T11:49:40.112 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 4.1153568549999999 2019-11-28T11:49:40.112 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:49:40.116 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 9442, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.869813937, "mdsmap_epoch": 124, "osdmap_epoch": 162, "osdmap_epoch_barrier": 162, "uptime": 4.1153568549999999 } 2019-11-28T11:49:40.116 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:49:40.116 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:49:40.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:49:40.116 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:49:40.186 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:49:40.187 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:49:40.344 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:49:40.344 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:49:40.345 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:49:40.345 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:49:40.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:49:40.345 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:49:40.415 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:49:40.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.488+0000 7f484a36b700 1 Processor -- start 2019-11-28T11:49:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.488+0000 7f484a36b700 1 -- start start 2019-11-28T11:49:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.489+0000 7f484a36b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f484406c490 0x7f484406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.489+0000 7f484a36b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f484406ce60 0x7f4844164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.489+0000 7f484a36b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484406db00 con 0x7f484406c0a0 2019-11-28T11:49:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.489+0000 7f484a36b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484406fd60 con 0x7f484406ce60 2019-11-28T11:49:40.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.489+0000 7f484a36b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4844070030 con 0x7f484406c490 2019-11-28T11:49:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.489+0000 7f4849109700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f484406ce60 0x7f4844164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.489+0000 7f4843fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f484406c490 0x7f484406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.489+0000 7f4849109700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f484406ce60 0x7f4844164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:57206/0 (socket says 172.21.15.80:57206) 2019-11-28T11:49:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.489+0000 7f4843fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f484406c490 0x7f484406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:44578/0 (socket says 172.21.15.80:44578) 2019-11-28T11:49:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.489+0000 7f4849109700 1 -- 172.21.15.80:0/3550309307 learned_addr learned my addr 172.21.15.80:0/3550309307 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.489+0000 7f4848908700 1 --1- 172.21.15.80:0/3550309307 >> v1:172.21.15.174:6789/0 conn(0x7f484406c0a0 0x7f4844072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:57176/0 (socket says 172.21.15.80:57176) 2019-11-28T11:49:40.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.489+0000 7f4843fff700 1 -- 172.21.15.80:0/3550309307 >> v2:172.21.15.174:3300/0 conn(0x7f484406ce60 msgr2=0x7f4844164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:40.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.489+0000 7f4843fff700 1 --2- 172.21.15.80:0/3550309307 >> v2:172.21.15.174:3300/0 conn(0x7f484406ce60 0x7f4844164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:40.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.489+0000 7f4843fff700 1 -- 172.21.15.80:0/3550309307 >> v1:172.21.15.174:6789/0 conn(0x7f484406c0a0 legacy=0x7f4844072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:40.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.490+0000 7f4843fff700 1 -- 172.21.15.80:0/3550309307 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48440706c0 con 0x7f484406c490 2019-11-28T11:49:40.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.490+0000 7f48437fe700 1 -- 172.21.15.80:0/3550309307 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992057209 0 0) 0x7f482c001080 con 0x7f484406c0a0 2019-11-28T11:49:40.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.490+0000 7f4849109700 1 --2- 172.21.15.80:0/3550309307 >> v2:172.21.15.174:3300/0 conn(0x7f484406ce60 0x7f4844164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:40.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.490+0000 7f4843fff700 1 --2- 172.21.15.80:0/3550309307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f484406c490 0x7f484406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f483400af50 tx=0x7f483400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.490+0000 7f4843fff700 1 --2- 172.21.15.80:0/3550309307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f484406c490 0x7f484406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f483400af50 tx=0x7f483400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.490+0000 7f4843fff700 1 --2- 172.21.15.80:0/3550309307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f484406c490 0x7f484406c920 secure :-1 s=READY pgs=292 cs=0 l=1 rx=0x7f483400af50 tx=0x7f483400b760).ready entity=mon.2 client_cookie=aea101aede6c5a7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:40.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.490+0000 7f4843fff700 1 --2- 172.21.15.80:0/3550309307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f484406c490 0x7f484406c920 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f483400af50 tx=0x7f483400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.490+0000 7f48437fe700 1 -- 172.21.15.80:0/3550309307 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4834007210 con 0x7f484406c490 2019-11-28T11:49:40.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.490+0000 7f4843fff700 1 --2- 172.21.15.80:0/3550309307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f484406c490 0x7f484406c920 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f483400af50 tx=0x7f483400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.490+0000 7f4843fff700 1 --2- 172.21.15.80:0/3550309307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f484406c490 0x7f484406c920 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f483400af50 tx=0x7f483400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.490+0000 7f48437fe700 1 -- 172.21.15.80:0/3550309307 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48340099b0 con 0x7f484406c490 2019-11-28T11:49:40.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.490+0000 7f48437fe700 1 -- 172.21.15.80:0/3550309307 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f483400a080 con 0x7f484406c490 2019-11-28T11:49:40.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.490+0000 7f484a36b700 1 -- 172.21.15.80:0/3550309307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f484406c490 msgr2=0x7f484406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:40.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.490+0000 7f484a36b700 1 --2- 172.21.15.80:0/3550309307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f484406c490 0x7f484406c920 secure :-1 s=READY pgs=292 cs=0 l=1 rx=0x7f483400af50 tx=0x7f483400b760).stop 2019-11-28T11:49:40.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.491+0000 7f484a36b700 1 -- 172.21.15.80:0/3550309307 shutdown_connections 2019-11-28T11:49:40.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.491+0000 7f484a36b700 1 --2- 172.21.15.80:0/3550309307 >> v2:172.21.15.174:3300/0 conn(0x7f484406ce60 0x7f4844164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:40.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.491+0000 7f484a36b700 1 --2- 172.21.15.80:0/3550309307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f484406c490 0x7f484406c920 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:40.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.491+0000 7f484a36b700 1 -- 172.21.15.80:0/3550309307 shutdown_connections 2019-11-28T11:49:40.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.491+0000 7f484a36b700 1 -- 172.21.15.80:0/3550309307 wait complete. 2019-11-28T11:49:40.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.491+0000 7f484a36b700 1 -- 172.21.15.80:0/3550309307 >> 172.21.15.80:0/3550309307 conn(0x7f4844061cf0 msgr2=0x7f4844064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:40.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.493+0000 7f484a36b700 1 Processor -- start 2019-11-28T11:49:40.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.493+0000 7f484a36b700 1 -- start start 2019-11-28T11:49:40.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.494+0000 7f484a36b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4844109e40 0x7f484410a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:40.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.494+0000 7f484a36b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484413f1e0 con 0x7f484413eb40 2019-11-28T11:49:40.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.494+0000 7f484a36b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4844131a30 con 0x7f484410a810 2019-11-28T11:49:40.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.494+0000 7f484a36b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48441234c0 con 0x7f4844109e40 2019-11-28T11:49:40.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.494+0000 7f4848908700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f484413eb40 0x7f484410afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41638/0 (socket says 172.21.15.80:41638) 2019-11-28T11:49:40.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.494+0000 7f4848908700 1 -- 172.21.15.80:0/4133534897 learned_addr learned my addr 172.21.15.80:0/4133534897 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:40.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.494+0000 7f4843fff700 1 --2- 172.21.15.80:0/4133534897 >> v2:172.21.15.174:3300/0 conn(0x7f4844109e40 0x7f484410a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:40.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.494+0000 7f48417fa700 1 -- 172.21.15.80:0/4133534897 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205503654 0 0) 0x7f482c000cf0 con 0x7f484413eb40 2019-11-28T11:49:40.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.494+0000 7f48417fa700 1 -- 172.21.15.80:0/4133534897 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4828002e80 con 0x7f484413eb40 2019-11-28T11:49:40.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.494+0000 7f4843fff700 1 -- 172.21.15.80:0/4133534897 >> v1:172.21.15.174:6789/0 conn(0x7f484410a810 legacy=0x7f4844105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:40.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.494+0000 7f4843fff700 1 -- 172.21.15.80:0/4133534897 >> v1:172.21.15.80:6789/0 conn(0x7f484413eb40 legacy=0x7f484410afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:40.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.494+0000 7f48417fa700 1 -- 172.21.15.80:0/4133534897 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328044153 0 0) 0x7f483c007ba0 con 0x7f484410a810 2019-11-28T11:49:40.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.494+0000 7f4843fff700 1 -- 172.21.15.80:0/4133534897 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4844108700 con 0x7f4844109e40 2019-11-28T11:49:40.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.495+0000 7f4843fff700 1 --2- 172.21.15.80:0/4133534897 >> v2:172.21.15.174:3300/0 conn(0x7f4844109e40 0x7f484410a2d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4834010370 tx=0x7f4834010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.495+0000 7f4843fff700 1 --2- 172.21.15.80:0/4133534897 >> v2:172.21.15.174:3300/0 conn(0x7f4844109e40 0x7f484410a2d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4834010370 tx=0x7f4834010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.495+0000 7f4843fff700 1 --2- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4844109e40 0x7f484410a2d0 secure :-1 s=READY pgs=1245 cs=0 l=1 rx=0x7f4834010370 tx=0x7f4834010710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:40.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.495+0000 7f4843fff700 1 --2- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4844109e40 0x7f484410a2d0 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7f4834010370 tx=0x7f4834010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.495+0000 7f48417fa700 1 -- 172.21.15.80:0/4133534897 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4834000940 con 0x7f4844109e40 2019-11-28T11:49:40.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.495+0000 7f4843fff700 1 --2- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4844109e40 0x7f484410a2d0 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7f4834010370 tx=0x7f4834010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.495+0000 7f4843fff700 1 --2- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4844109e40 0x7f484410a2d0 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7f4834010370 tx=0x7f4834010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.495+0000 7f484a36b700 1 -- 172.21.15.80:0/4133534897 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4844108a80 con 0x7f4844109e40 2019-11-28T11:49:40.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.495+0000 7f48417fa700 1 -- 172.21.15.80:0/4133534897 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4834009580 con 0x7f4844109e40 2019-11-28T11:49:40.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.495+0000 7f48417fa700 1 -- 172.21.15.80:0/4133534897 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4834009b50 con 0x7f4844109e40 2019-11-28T11:49:40.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.495+0000 7f484a36b700 1 -- 172.21.15.80:0/4133534897 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4844108700 con 0x7f4844109e40 2019-11-28T11:49:40.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.495+0000 7f4843fff700 1 --2- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4844109e40 0x7f484410a2d0 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7f4834010370 tx=0x7f4834010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.495+0000 7f48417fa700 1 -- 172.21.15.80:0/4133534897 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4834009770 con 0x7f4844109e40 2019-11-28T11:49:40.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.495+0000 7f4843fff700 1 --2- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4844109e40 0x7f484410a2d0 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7f4834010370 tx=0x7f4834010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.496+0000 7f48417fa700 1 --2- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4828018780 0x7f482801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:40.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.496+0000 7f48417fa700 1 -- 172.21.15.80:0/4133534897 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4834031a50 con 0x7f4844109e40 2019-11-28T11:49:40.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.496+0000 7f4848908700 1 --2- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4828018780 0x7f482801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:40.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.496+0000 7f4848908700 1 --2- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4828018780 0x7f482801abf0 crc :-1 s=READY pgs=851 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:40.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.503+0000 7f484a36b700 1 -- 172.21.15.80:0/4133534897 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4844108a80 con 0x7f4844109e40 2019-11-28T11:49:40.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.507+0000 7f4843fff700 1 --2- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4844109e40 0x7f484410a2d0 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7f4834010370 tx=0x7f4834010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.507+0000 7f48417fa700 1 -- 172.21.15.80:0/4133534897 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f483400b3d0 con 0x7f4844109e40 2019-11-28T11:49:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.683+0000 7f484a36b700 1 -- 172.21.15.80:0/4133534897 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4844108700 con 0x7f4844109e40 2019-11-28T11:49:40.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.685+0000 7f4843fff700 1 --2- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4844109e40 0x7f484410a2d0 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7f4834010370 tx=0x7f4834010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.685+0000 7f48417fa700 1 -- 172.21.15.80:0/4133534897 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f4834009770 con 0x7f4844109e40 2019-11-28T11:49:40.734 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:40.734 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":162,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:49:34.167112+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:49:31.434223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2019-11-28T11:49:32.127254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:49:40.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.688+0000 7f484a36b700 1 -- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4828018780 msgr2=0x7f482801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:40.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.688+0000 7f484a36b700 1 --2- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4828018780 0x7f482801abf0 crc :-1 s=READY pgs=851 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:40.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.688+0000 7f484a36b700 1 -- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4844109e40 msgr2=0x7f484410a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:40.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.688+0000 7f484a36b700 1 --2- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4844109e40 0x7f484410a2d0 secure :-1 s=READY pgs=1245 cs=0 l=1 rx=0x7f4834010370 tx=0x7f4834010710).stop 2019-11-28T11:49:40.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.689+0000 7f484a36b700 1 -- 172.21.15.80:0/4133534897 shutdown_connections 2019-11-28T11:49:40.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.689+0000 7f484a36b700 1 --2- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4828018780 0x7f482801abf0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:40.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.689+0000 7f484a36b700 1 --2- 172.21.15.80:0/4133534897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4844109e40 0x7f484410a2d0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:40.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.689+0000 7f484a36b700 1 -- 172.21.15.80:0/4133534897 shutdown_connections 2019-11-28T11:49:40.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.689+0000 7f484a36b700 1 -- 172.21.15.80:0/4133534897 wait complete. 2019-11-28T11:49:40.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.689+0000 7f484a36b700 1 -- 172.21.15.80:0/4133534897 >> 172.21.15.80:0/4133534897 conn(0x7f484411bfc0 msgr2=0x7f4844141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:40.746 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:49:31.434223+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 26, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'161', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:49:32.127254+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 27, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'162', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:49:40.747 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:49:40.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.822+0000 7efe104cf700 1 Processor -- start 2019-11-28T11:49:40.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.822+0000 7efe104cf700 1 -- start start 2019-11-28T11:49:40.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.823+0000 7efe104cf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe0815f100 0x7efe0806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:40.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.823+0000 7efe104cf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe0806c2f0 0x7efe0806c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:40.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.823+0000 7efe104cf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0806db60 con 0x7efe0815ed10 2019-11-28T11:49:40.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.823+0000 7efe104cf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0806fe00 con 0x7efe0806c2f0 2019-11-28T11:49:40.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.823+0000 7efe104cf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe080700d0 con 0x7efe0815f100 2019-11-28T11:49:40.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.823+0000 7efe0f26d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe0806c2f0 0x7efe0806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:40.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.823+0000 7efe0f26d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe0806c2f0 0x7efe0806c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42332/0 (socket says 172.21.15.80:42332) 2019-11-28T11:49:40.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.823+0000 7efe0f26d700 1 -- 172.21.15.80:0/3248134825 learned_addr learned my addr 172.21.15.80:0/3248134825 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:40.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.823+0000 7efe0e26b700 1 --2- 172.21.15.80:0/3248134825 >> v2:172.21.15.174:3300/0 conn(0x7efe0815f100 0x7efe0806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:40.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.823+0000 7efe0f26d700 1 -- 172.21.15.80:0/3248134825 >> v2:172.21.15.174:3300/0 conn(0x7efe0815f100 msgr2=0x7efe0806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:40.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.823+0000 7efe0f26d700 1 --2- 172.21.15.80:0/3248134825 >> v2:172.21.15.174:3300/0 conn(0x7efe0815f100 0x7efe0806bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:40.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.823+0000 7efe0f26d700 1 -- 172.21.15.80:0/3248134825 >> v1:172.21.15.174:6789/0 conn(0x7efe0815ed10 legacy=0x7efe08073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:40.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.823+0000 7efe0f26d700 1 -- 172.21.15.80:0/3248134825 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe08070760 con 0x7efe0806c2f0 2019-11-28T11:49:40.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.823+0000 7efe0f26d700 1 --2- 172.21.15.80:0/3248134825 >> v2:172.21.15.80:3300/0 conn(0x7efe0806c2f0 0x7efe0806c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efe0000fa30 tx=0x7efe0000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.824+0000 7efe0f26d700 1 --2- 172.21.15.80:0/3248134825 >> v2:172.21.15.80:3300/0 conn(0x7efe0806c2f0 0x7efe0806c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efe0000fa30 tx=0x7efe0000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.824+0000 7efe0f26d700 1 --2- 172.21.15.80:0/3248134825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe0806c2f0 0x7efe0806c770 secure :-1 s=READY pgs=2092 cs=0 l=1 rx=0x7efe0000fa30 tx=0x7efe0000fdd0).ready entity=mon.0 client_cookie=793365ced5f61f67 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:40.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.824+0000 7efe0f26d700 1 --2- 172.21.15.80:0/3248134825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe0806c2f0 0x7efe0806c770 secure :-1 s=THROTTLE_DONE pgs=2092 cs=0 l=1 rx=0x7efe0000fa30 tx=0x7efe0000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.824+0000 7efe0da6a700 1 -- 172.21.15.80:0/3248134825 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe00000df0 con 0x7efe0806c2f0 2019-11-28T11:49:40.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.824+0000 7efe0f26d700 1 --2- 172.21.15.80:0/3248134825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe0806c2f0 0x7efe0806c770 secure :-1 s=THROTTLE_DONE pgs=2092 cs=0 l=1 rx=0x7efe0000fa30 tx=0x7efe0000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.824+0000 7efe0f26d700 1 --2- 172.21.15.80:0/3248134825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe0806c2f0 0x7efe0806c770 secure :-1 s=THROTTLE_DONE pgs=2092 cs=0 l=1 rx=0x7efe0000fa30 tx=0x7efe0000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.824+0000 7efe0da6a700 1 -- 172.21.15.80:0/3248134825 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe00001460 con 0x7efe0806c2f0 2019-11-28T11:49:40.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.824+0000 7efe0da6a700 1 -- 172.21.15.80:0/3248134825 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe00001b30 con 0x7efe0806c2f0 2019-11-28T11:49:40.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.824+0000 7efe104cf700 1 -- 172.21.15.80:0/3248134825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe0806c2f0 msgr2=0x7efe0806c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:40.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.824+0000 7efe104cf700 1 --2- 172.21.15.80:0/3248134825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe0806c2f0 0x7efe0806c770 secure :-1 s=READY pgs=2092 cs=0 l=1 rx=0x7efe0000fa30 tx=0x7efe0000fdd0).stop 2019-11-28T11:49:40.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.825+0000 7efe104cf700 1 -- 172.21.15.80:0/3248134825 shutdown_connections 2019-11-28T11:49:40.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.825+0000 7efe104cf700 1 --2- 172.21.15.80:0/3248134825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe0806c2f0 0x7efe0806c770 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:40.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.825+0000 7efe104cf700 1 --2- 172.21.15.80:0/3248134825 >> v2:172.21.15.174:3300/0 conn(0x7efe0815f100 0x7efe0806bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:40.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.825+0000 7efe104cf700 1 -- 172.21.15.80:0/3248134825 shutdown_connections 2019-11-28T11:49:40.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.825+0000 7efe104cf700 1 -- 172.21.15.80:0/3248134825 wait complete. 2019-11-28T11:49:40.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.825+0000 7efe104cf700 1 -- 172.21.15.80:0/3248134825 >> 172.21.15.80:0/3248134825 conn(0x7efe08061d20 msgr2=0x7efe080641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:40.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.827+0000 7efe104cf700 1 Processor -- start 2019-11-28T11:49:40.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.827+0000 7efe104cf700 1 -- start start 2019-11-28T11:49:40.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.828+0000 7efe104cf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe081051a0 0x7efe08105630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:40.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.828+0000 7efe104cf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe08102b00 con 0x7efe08102460 2019-11-28T11:49:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.828+0000 7efe104cf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe08147850 con 0x7efe08105b70 2019-11-28T11:49:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.828+0000 7efe104cf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe08112800 con 0x7efe081051a0 2019-11-28T11:49:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.828+0000 7efe0ea6c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efe08102460 0x7efe08115710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41652/0 (socket says 172.21.15.80:41652) 2019-11-28T11:49:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.828+0000 7efe0ea6c700 1 -- 172.21.15.80:0/3148213531 learned_addr learned my addr 172.21.15.80:0/3148213531 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.828+0000 7efe0e26b700 1 --2- 172.21.15.80:0/3148213531 >> v2:172.21.15.174:3300/0 conn(0x7efe081051a0 0x7efe08105630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.828+0000 7efdfb7fe700 1 -- 172.21.15.80:0/3148213531 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353660686 0 0) 0x7efdfc001150 con 0x7efe08102460 2019-11-28T11:49:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.828+0000 7efdfb7fe700 1 -- 172.21.15.80:0/3148213531 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf0002e80 con 0x7efe08102460 2019-11-28T11:49:40.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.828+0000 7efe0e26b700 1 -- 172.21.15.80:0/3148213531 >> v1:172.21.15.174:6789/0 conn(0x7efe08105b70 legacy=0x7efe08168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:40.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.828+0000 7efe0e26b700 1 -- 172.21.15.80:0/3148213531 >> v1:172.21.15.80:6789/0 conn(0x7efe08102460 legacy=0x7efe08115710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:40.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.828+0000 7efdfb7fe700 1 -- 172.21.15.80:0/3148213531 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116060333 0 0) 0x7efe00007d60 con 0x7efe08105b70 2019-11-28T11:49:40.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.828+0000 7efe0e26b700 1 -- 172.21.15.80:0/3148213531 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe08112e90 con 0x7efe081051a0 2019-11-28T11:49:40.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.828+0000 7efe0e26b700 1 --2- 172.21.15.80:0/3148213531 >> v2:172.21.15.174:3300/0 conn(0x7efe081051a0 0x7efe08105630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe04010390 tx=0x7efe04010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.828+0000 7efe0e26b700 1 --2- 172.21.15.80:0/3148213531 >> v2:172.21.15.174:3300/0 conn(0x7efe081051a0 0x7efe08105630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe04010390 tx=0x7efe04010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.828+0000 7efe0e26b700 1 --2- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe081051a0 0x7efe08105630 secure :-1 s=READY pgs=1248 cs=0 l=1 rx=0x7efe04010390 tx=0x7efe04010730).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.829+0000 7efe0e26b700 1 --2- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe081051a0 0x7efe08105630 secure :-1 s=THROTTLE_DONE pgs=1248 cs=0 l=1 rx=0x7efe04010390 tx=0x7efe04010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.829+0000 7efdfb7fe700 1 -- 172.21.15.80:0/3148213531 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe04009640 con 0x7efe081051a0 2019-11-28T11:49:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.829+0000 7efe0e26b700 1 --2- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe081051a0 0x7efe08105630 secure :-1 s=THROTTLE_DONE pgs=1248 cs=0 l=1 rx=0x7efe04010390 tx=0x7efe04010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.829+0000 7efe0e26b700 1 --2- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe081051a0 0x7efe08105630 secure :-1 s=THROTTLE_DONE pgs=1248 cs=0 l=1 rx=0x7efe04010390 tx=0x7efe04010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.829+0000 7efdfb7fe700 1 -- 172.21.15.80:0/3148213531 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe04000940 con 0x7efe081051a0 2019-11-28T11:49:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.829+0000 7efe104cf700 1 -- 172.21.15.80:0/3148213531 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe08113210 con 0x7efe081051a0 2019-11-28T11:49:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.829+0000 7efdfb7fe700 1 -- 172.21.15.80:0/3148213531 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe0400a0e0 con 0x7efe081051a0 2019-11-28T11:49:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.829+0000 7efe104cf700 1 -- 172.21.15.80:0/3148213531 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe08112e90 con 0x7efe081051a0 2019-11-28T11:49:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.829+0000 7efe0e26b700 1 --2- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe081051a0 0x7efe08105630 secure :-1 s=THROTTLE_DONE pgs=1248 cs=0 l=1 rx=0x7efe04010390 tx=0x7efe04010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.829+0000 7efdfb7fe700 1 -- 172.21.15.80:0/3148213531 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efe04009a70 con 0x7efe081051a0 2019-11-28T11:49:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.829+0000 7efe0e26b700 1 --2- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe081051a0 0x7efe08105630 secure :-1 s=THROTTLE_DONE pgs=1248 cs=0 l=1 rx=0x7efe04010390 tx=0x7efe04010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.829+0000 7efdfb7fe700 1 --2- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efdf0018780 0x7efdf001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:40.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.829+0000 7efdfb7fe700 1 -- 172.21.15.80:0/3148213531 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7efe04031aa0 con 0x7efe081051a0 2019-11-28T11:49:40.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.830+0000 7efe0ea6c700 1 --2- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efdf0018780 0x7efdf001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:40.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.830+0000 7efe0ea6c700 1 --2- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efdf0018780 0x7efdf001abf0 crc :-1 s=READY pgs=852 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:40.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.837+0000 7efe104cf700 1 -- 172.21.15.80:0/3148213531 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe08113210 con 0x7efe081051a0 2019-11-28T11:49:40.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.841+0000 7efe0e26b700 1 --2- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe081051a0 0x7efe08105630 secure :-1 s=THROTTLE_DONE pgs=1248 cs=0 l=1 rx=0x7efe04010390 tx=0x7efe04010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:40.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:40.841+0000 7efdfb7fe700 1 -- 172.21.15.80:0/3148213531 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efe04009860 con 0x7efe081051a0 2019-11-28T11:49:41.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.009+0000 7efe104cf700 1 -- 172.21.15.80:0/3148213531 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7efe08112e90 con 0x7efe081051a0 2019-11-28T11:49:41.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.009+0000 7efe0e26b700 1 --2- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe081051a0 0x7efe08105630 secure :-1 s=THROTTLE_DONE pgs=1248 cs=0 l=1 rx=0x7efe04010390 tx=0x7efe04010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.009+0000 7efdfb7fe700 1 -- 172.21.15.80:0/3148213531 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v162) v1 ==== 92+0+10 (secure 0 0 0) 0x7efe04009a70 con 0x7efe081051a0 2019-11-28T11:49:41.057 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:49:41.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.012+0000 7efe104cf700 1 -- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efdf0018780 msgr2=0x7efdf001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.012+0000 7efe104cf700 1 --2- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efdf0018780 0x7efdf001abf0 crc :-1 s=READY pgs=852 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:41.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.012+0000 7efe104cf700 1 -- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe081051a0 msgr2=0x7efe08105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.012+0000 7efe104cf700 1 --2- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe081051a0 0x7efe08105630 secure :-1 s=READY pgs=1248 cs=0 l=1 rx=0x7efe04010390 tx=0x7efe04010730).stop 2019-11-28T11:49:41.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.012+0000 7efe104cf700 1 -- 172.21.15.80:0/3148213531 shutdown_connections 2019-11-28T11:49:41.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.012+0000 7efe104cf700 1 --2- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efdf0018780 0x7efdf001abf0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:41.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.012+0000 7efe104cf700 1 --2- 172.21.15.80:0/3148213531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe081051a0 0x7efe08105630 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:41.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.012+0000 7efe104cf700 1 -- 172.21.15.80:0/3148213531 shutdown_connections 2019-11-28T11:49:41.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.012+0000 7efe104cf700 1 -- 172.21.15.80:0/3148213531 wait complete. 2019-11-28T11:49:41.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.012+0000 7efe104cf700 1 -- 172.21.15.80:0/3148213531 >> 172.21.15.80:0/3148213531 conn(0x7efe0814c4a0 msgr2=0x7efe08152400 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:41.070 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:49:41.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.146+0000 7fb580930700 1 Processor -- start 2019-11-28T11:49:41.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.146+0000 7fb580930700 1 -- start start 2019-11-28T11:49:41.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.147+0000 7fb580930700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb57c15f100 0x7fb57c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:41.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.147+0000 7fb580930700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb57c06c2f0 0x7fb57c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:41.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.147+0000 7fb580930700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c06db60 con 0x7fb57c15ed10 2019-11-28T11:49:41.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.147+0000 7fb580930700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c06fe00 con 0x7fb57c06c2f0 2019-11-28T11:49:41.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.147+0000 7fb580930700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c0700d0 con 0x7fb57c15f100 2019-11-28T11:49:41.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb57b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb57c06c2f0 0x7fb57c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:41.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb57b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb57c06c2f0 0x7fb57c06c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42346/0 (socket says 172.21.15.80:42346) 2019-11-28T11:49:41.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb57b59e700 1 -- 172.21.15.80:0/1223576681 learned_addr learned my addr 172.21.15.80:0/1223576681 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:41.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb57ad9d700 1 --1- 172.21.15.80:0/1223576681 >> v1:172.21.15.80:6789/0 conn(0x7fb57c15ed10 0x7fb57c073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41660/0 (socket says 172.21.15.80:41660) 2019-11-28T11:49:41.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb57a59c700 1 --2- 172.21.15.80:0/1223576681 >> v2:172.21.15.174:3300/0 conn(0x7fb57c15f100 0x7fb57c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:41.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb57b59e700 1 -- 172.21.15.80:0/1223576681 >> v2:172.21.15.174:3300/0 conn(0x7fb57c15f100 msgr2=0x7fb57c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:41.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb57b59e700 1 --2- 172.21.15.80:0/1223576681 >> v2:172.21.15.174:3300/0 conn(0x7fb57c15f100 0x7fb57c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:41.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb57b59e700 1 -- 172.21.15.80:0/1223576681 >> v1:172.21.15.80:6789/0 conn(0x7fb57c15ed10 legacy=0x7fb57c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb579d9b700 1 -- 172.21.15.80:0/1223576681 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757190690 0 0) 0x7fb564001480 con 0x7fb57c15ed10 2019-11-28T11:49:41.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb57b59e700 1 -- 172.21.15.80:0/1223576681 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c070760 con 0x7fb57c06c2f0 2019-11-28T11:49:41.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb57a59c700 1 --2- 172.21.15.80:0/1223576681 >> v2:172.21.15.174:3300/0 conn(0x7fb57c15f100 0x7fb57c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:49:41.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb57b59e700 1 --2- 172.21.15.80:0/1223576681 >> v2:172.21.15.80:3300/0 conn(0x7fb57c06c2f0 0x7fb57c06c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb57400f730 tx=0x7fb57400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb57b59e700 1 --2- 172.21.15.80:0/1223576681 >> v2:172.21.15.80:3300/0 conn(0x7fb57c06c2f0 0x7fb57c06c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb57400f730 tx=0x7fb57400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb57b59e700 1 --2- 172.21.15.80:0/1223576681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c06c2f0 0x7fb57c06c770 secure :-1 s=READY pgs=2095 cs=0 l=1 rx=0x7fb57400f730 tx=0x7fb57400fad0).ready entity=mon.0 client_cookie=f92d7a2c4cade818 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:41.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb57b59e700 1 --2- 172.21.15.80:0/1223576681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c06c2f0 0x7fb57c06c770 secure :-1 s=THROTTLE_DONE pgs=2095 cs=0 l=1 rx=0x7fb57400f730 tx=0x7fb57400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb579d9b700 1 -- 172.21.15.80:0/1223576681 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb574000b90 con 0x7fb57c06c2f0 2019-11-28T11:49:41.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb57b59e700 1 --2- 172.21.15.80:0/1223576681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c06c2f0 0x7fb57c06c770 secure :-1 s=THROTTLE_DONE pgs=2095 cs=0 l=1 rx=0x7fb57400f730 tx=0x7fb57400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb57b59e700 1 --2- 172.21.15.80:0/1223576681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c06c2f0 0x7fb57c06c770 secure :-1 s=THROTTLE_DONE pgs=2095 cs=0 l=1 rx=0x7fb57400f730 tx=0x7fb57400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb579d9b700 1 -- 172.21.15.80:0/1223576681 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5740010e0 con 0x7fb57c06c2f0 2019-11-28T11:49:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb579d9b700 1 -- 172.21.15.80:0/1223576681 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb574001830 con 0x7fb57c06c2f0 2019-11-28T11:49:41.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb580930700 1 -- 172.21.15.80:0/1223576681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c06c2f0 msgr2=0x7fb57c06c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.148+0000 7fb580930700 1 --2- 172.21.15.80:0/1223576681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c06c2f0 0x7fb57c06c770 secure :-1 s=READY pgs=2095 cs=0 l=1 rx=0x7fb57400f730 tx=0x7fb57400fad0).stop 2019-11-28T11:49:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.149+0000 7fb580930700 1 -- 172.21.15.80:0/1223576681 shutdown_connections 2019-11-28T11:49:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.149+0000 7fb580930700 1 --2- 172.21.15.80:0/1223576681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c06c2f0 0x7fb57c06c770 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.149+0000 7fb580930700 1 --2- 172.21.15.80:0/1223576681 >> v2:172.21.15.174:3300/0 conn(0x7fb57c15f100 0x7fb57c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:41.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.149+0000 7fb580930700 1 -- 172.21.15.80:0/1223576681 shutdown_connections 2019-11-28T11:49:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.149+0000 7fb580930700 1 -- 172.21.15.80:0/1223576681 wait complete. 2019-11-28T11:49:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.149+0000 7fb580930700 1 -- 172.21.15.80:0/1223576681 >> 172.21.15.80:0/1223576681 conn(0x7fb57c061d20 msgr2=0x7fb57c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.151+0000 7fb580930700 1 Processor -- start 2019-11-28T11:49:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.151+0000 7fb580930700 1 -- start start 2019-11-28T11:49:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.152+0000 7fb580930700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb57c148320 0x7fb57c10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:41.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.152+0000 7fb580930700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb57c10f290 0x7fb57c10dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.152+0000 7fb580930700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c148e00 con 0x7fb57c10e110 2019-11-28T11:49:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.152+0000 7fb580930700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c13aa20 con 0x7fb57c148320 2019-11-28T11:49:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.152+0000 7fb580930700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c13acf0 con 0x7fb57c10f290 2019-11-28T11:49:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.152+0000 7fb57ad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb57c148320 0x7fb57c10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.152+0000 7fb57b59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb57c10e110 0x7fb57c1079b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41668/0 (socket says 172.21.15.80:41668) 2019-11-28T11:49:41.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.152+0000 7fb57b59e700 1 -- 172.21.15.80:0/3792721867 learned_addr learned my addr 172.21.15.80:0/3792721867 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.152+0000 7fb57ad9d700 1 --2- 172.21.15.80:0/3792721867 >> v2:172.21.15.80:3300/0 conn(0x7fb57c148320 0x7fb57c10ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42350/0 (socket says 172.21.15.80:42350) 2019-11-28T11:49:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb57a59c700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb57c10f290 0x7fb57c10dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb57ad9d700 1 -- 172.21.15.80:0/3792721867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb57c10f290 msgr2=0x7fb57c10dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb57ad9d700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb57c10f290 0x7fb57c10dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb57ad9d700 1 -- 172.21.15.80:0/3792721867 >> v1:172.21.15.80:6789/0 conn(0x7fb57c10e110 legacy=0x7fb57c1079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb57ad9d700 1 -- 172.21.15.80:0/3792721867 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c10c490 con 0x7fb57c148320 2019-11-28T11:49:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb57a59c700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb57c10f290 0x7fb57c10dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:49:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb5737fe700 1 -- 172.21.15.80:0/3792721867 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964722650 0 0) 0x7fb574007580 con 0x7fb57c10e110 2019-11-28T11:49:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb57ad9d700 1 --2- 172.21.15.80:0/3792721867 >> v2:172.21.15.80:3300/0 conn(0x7fb57c148320 0x7fb57c10ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb5640106f0 tx=0x7fb564010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb57ad9d700 1 --2- 172.21.15.80:0/3792721867 >> v2:172.21.15.80:3300/0 conn(0x7fb57c148320 0x7fb57c10ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb5640106f0 tx=0x7fb564010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb57ad9d700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c148320 0x7fb57c10ed50 secure :-1 s=READY pgs=2097 cs=0 l=1 rx=0x7fb5640106f0 tx=0x7fb564010a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:41.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb57ad9d700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c148320 0x7fb57c10ed50 secure :-1 s=THROTTLE_DONE pgs=2097 cs=0 l=1 rx=0x7fb5640106f0 tx=0x7fb564010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb5737fe700 1 -- 172.21.15.80:0/3792721867 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5640045c0 con 0x7fb57c148320 2019-11-28T11:49:41.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb57ad9d700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c148320 0x7fb57c10ed50 secure :-1 s=THROTTLE_DONE pgs=2097 cs=0 l=1 rx=0x7fb5640106f0 tx=0x7fb564010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb57ad9d700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c148320 0x7fb57c10ed50 secure :-1 s=THROTTLE_DONE pgs=2097 cs=0 l=1 rx=0x7fb5640106f0 tx=0x7fb564010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb5737fe700 1 -- 172.21.15.80:0/3792721867 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb564001010 con 0x7fb57c148320 2019-11-28T11:49:41.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb5737fe700 1 -- 172.21.15.80:0/3792721867 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb564004ba0 con 0x7fb57c148320 2019-11-28T11:49:41.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb580930700 1 -- 172.21.15.80:0/3792721867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c10c810 con 0x7fb57c148320 2019-11-28T11:49:41.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb580930700 1 -- 172.21.15.80:0/3792721867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c10c490 con 0x7fb57c148320 2019-11-28T11:49:41.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.153+0000 7fb57ad9d700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c148320 0x7fb57c10ed50 secure :-1 s=THROTTLE_DONE pgs=2097 cs=0 l=1 rx=0x7fb5640106f0 tx=0x7fb564010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.154+0000 7fb5737fe700 1 -- 172.21.15.80:0/3792721867 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb5640045c0 con 0x7fb57c148320 2019-11-28T11:49:41.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.154+0000 7fb57ad9d700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c148320 0x7fb57c10ed50 secure :-1 s=THROTTLE_DONE pgs=2097 cs=0 l=1 rx=0x7fb5640106f0 tx=0x7fb564010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.154+0000 7fb5737fe700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb554018730 0x7fb55401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:41.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.154+0000 7fb5737fe700 1 -- 172.21.15.80:0/3792721867 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb564031da0 con 0x7fb57c148320 2019-11-28T11:49:41.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.154+0000 7fb57a59c700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb554018730 0x7fb55401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:41.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.154+0000 7fb57a59c700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb554018730 0x7fb55401abc0 crc :-1 s=READY pgs=853 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.162+0000 7fb580930700 1 -- 172.21.15.80:0/3792721867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57c10c810 con 0x7fb57c148320 2019-11-28T11:49:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.165+0000 7fb57ad9d700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c148320 0x7fb57c10ed50 secure :-1 s=THROTTLE_DONE pgs=2097 cs=0 l=1 rx=0x7fb5640106f0 tx=0x7fb564010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.165+0000 7fb5737fe700 1 -- 172.21.15.80:0/3792721867 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb56402ae00 con 0x7fb57c148320 2019-11-28T11:49:41.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.335+0000 7fb580930700 1 -- 172.21.15.80:0/3792721867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fb57c10c490 con 0x7fb57c148320 2019-11-28T11:49:41.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.335+0000 7fb57ad9d700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c148320 0x7fb57c10ed50 secure :-1 s=THROTTLE_DONE pgs=2097 cs=0 l=1 rx=0x7fb5640106f0 tx=0x7fb564010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.335+0000 7fb5737fe700 1 -- 172.21.15.80:0/3792721867 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v162) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb56402ae00 con 0x7fb57c148320 2019-11-28T11:49:41.384 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:49:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.338+0000 7fb580930700 1 -- 172.21.15.80:0/3792721867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb554018730 msgr2=0x7fb55401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.338+0000 7fb580930700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb554018730 0x7fb55401abc0 crc :-1 s=READY pgs=853 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.338+0000 7fb580930700 1 -- 172.21.15.80:0/3792721867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c148320 msgr2=0x7fb57c10ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.338+0000 7fb580930700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c148320 0x7fb57c10ed50 secure :-1 s=READY pgs=2097 cs=0 l=1 rx=0x7fb5640106f0 tx=0x7fb564010a90).stop 2019-11-28T11:49:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.338+0000 7fb580930700 1 -- 172.21.15.80:0/3792721867 shutdown_connections 2019-11-28T11:49:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.338+0000 7fb580930700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb554018730 0x7fb55401abc0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.338+0000 7fb580930700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb57c10f290 0x7fb57c10dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.338+0000 7fb580930700 1 --2- 172.21.15.80:0/3792721867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb57c148320 0x7fb57c10ed50 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.338+0000 7fb580930700 1 -- 172.21.15.80:0/3792721867 shutdown_connections 2019-11-28T11:49:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.338+0000 7fb580930700 1 -- 172.21.15.80:0/3792721867 wait complete. 2019-11-28T11:49:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.338+0000 7fb580930700 1 -- 172.21.15.80:0/3792721867 >> 172.21.15.80:0/3792721867 conn(0x7fb57c15e2d0 msgr2=0x7fb57c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:41.395 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:49:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.471+0000 7f7dbe24d700 1 Processor -- start 2019-11-28T11:49:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.471+0000 7f7dbe24d700 1 -- start start 2019-11-28T11:49:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.472+0000 7f7dbe24d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7db815ed10 0x7f7db815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.472+0000 7f7dbe24d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7db8073020 0x7f7db8071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.472+0000 7f7dbe24d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db806db60 con 0x7f7db80734b0 2019-11-28T11:49:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.472+0000 7f7dbe24d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db806fe00 con 0x7f7db815ed10 2019-11-28T11:49:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.472+0000 7f7dbe24d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db80700d0 con 0x7f7db8073020 2019-11-28T11:49:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.472+0000 7f7db7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7db815ed10 0x7f7db815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.472+0000 7f7db7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7db815ed10 0x7f7db815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42362/0 (socket says 172.21.15.80:42362) 2019-11-28T11:49:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.472+0000 7f7db7fff700 1 -- 172.21.15.80:0/1476804073 learned_addr learned my addr 172.21.15.80:0/1476804073 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7daffff700 1 --2- 172.21.15.80:0/1476804073 >> v2:172.21.15.174:3300/0 conn(0x7f7db8073020 0x7f7db8071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7db7fff700 1 -- 172.21.15.80:0/1476804073 >> v2:172.21.15.174:3300/0 conn(0x7f7db8073020 msgr2=0x7f7db8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7db7fff700 1 --2- 172.21.15.80:0/1476804073 >> v2:172.21.15.174:3300/0 conn(0x7f7db8073020 0x7f7db8071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7db7fff700 1 -- 172.21.15.80:0/1476804073 >> v1:172.21.15.80:6789/0 conn(0x7f7db80734b0 legacy=0x7f7db80723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7db7fff700 1 -- 172.21.15.80:0/1476804073 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db8070760 con 0x7f7db815ed10 2019-11-28T11:49:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7daffff700 1 --2- 172.21.15.80:0/1476804073 >> v2:172.21.15.174:3300/0 conn(0x7f7db8073020 0x7f7db8071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:49:41.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7db7fff700 1 --2- 172.21.15.80:0/1476804073 >> v2:172.21.15.80:3300/0 conn(0x7f7db815ed10 0x7f7db815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7da800f740 tx=0x7f7da800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7db7fff700 1 --2- 172.21.15.80:0/1476804073 >> v2:172.21.15.80:3300/0 conn(0x7f7db815ed10 0x7f7db815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7da800f740 tx=0x7f7da800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7db7fff700 1 --2- 172.21.15.80:0/1476804073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db815ed10 0x7f7db815f100 secure :-1 s=READY pgs=2099 cs=0 l=1 rx=0x7f7da800f740 tx=0x7f7da800fae0).ready entity=mon.0 client_cookie=13dac3f62f83dd20 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7db7fff700 1 --2- 172.21.15.80:0/1476804073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db815ed10 0x7f7db815f100 secure :-1 s=THROTTLE_DONE pgs=2099 cs=0 l=1 rx=0x7f7da800f740 tx=0x7f7da800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7db7fff700 1 --2- 172.21.15.80:0/1476804073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db815ed10 0x7f7db815f100 secure :-1 s=THROTTLE_DONE pgs=2099 cs=0 l=1 rx=0x7f7da800f740 tx=0x7f7da800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7db77fe700 1 -- 172.21.15.80:0/1476804073 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7da8000960 con 0x7f7db815ed10 2019-11-28T11:49:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7db7fff700 1 --2- 172.21.15.80:0/1476804073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db815ed10 0x7f7db815f100 secure :-1 s=THROTTLE_DONE pgs=2099 cs=0 l=1 rx=0x7f7da800f740 tx=0x7f7da800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7db77fe700 1 -- 172.21.15.80:0/1476804073 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da8000c90 con 0x7f7db815ed10 2019-11-28T11:49:41.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7db77fe700 1 -- 172.21.15.80:0/1476804073 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7da80013a0 con 0x7f7db815ed10 2019-11-28T11:49:41.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7dbe24d700 1 -- 172.21.15.80:0/1476804073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db815ed10 msgr2=0x7f7db815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.473+0000 7f7dbe24d700 1 --2- 172.21.15.80:0/1476804073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db815ed10 0x7f7db815f100 secure :-1 s=READY pgs=2099 cs=0 l=1 rx=0x7f7da800f740 tx=0x7f7da800fae0).stop 2019-11-28T11:49:41.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.474+0000 7f7dbe24d700 1 -- 172.21.15.80:0/1476804073 shutdown_connections 2019-11-28T11:49:41.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.474+0000 7f7dbe24d700 1 --2- 172.21.15.80:0/1476804073 >> v2:172.21.15.174:3300/0 conn(0x7f7db8073020 0x7f7db8071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:41.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.474+0000 7f7dbe24d700 1 --2- 172.21.15.80:0/1476804073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db815ed10 0x7f7db815f100 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:41.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.474+0000 7f7dbe24d700 1 -- 172.21.15.80:0/1476804073 shutdown_connections 2019-11-28T11:49:41.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.474+0000 7f7dbe24d700 1 -- 172.21.15.80:0/1476804073 wait complete. 2019-11-28T11:49:41.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.474+0000 7f7dbe24d700 1 -- 172.21.15.80:0/1476804073 >> 172.21.15.80:0/1476804073 conn(0x7f7db8061d20 msgr2=0x7f7db80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:41.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.476+0000 7f7dbe24d700 1 Processor -- start 2019-11-28T11:49:41.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.476+0000 7f7dbe24d700 1 -- start start 2019-11-28T11:49:41.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.477+0000 7f7dbe24d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7db810ed60 0x7f7db810f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:41.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.477+0000 7f7dbe24d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7db810f730 0x7f7db8167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:41.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.477+0000 7f7dbe24d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db810c250 con 0x7f7db810e970 2019-11-28T11:49:41.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.477+0000 7f7dbe24d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db810e430 con 0x7f7db810f730 2019-11-28T11:49:41.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.477+0000 7f7dbe24d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db8105860 con 0x7f7db810ed60 2019-11-28T11:49:41.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.477+0000 7f7db7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7db810e970 0x7f7db81087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41684/0 (socket says 172.21.15.80:41684) 2019-11-28T11:49:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.477+0000 7f7db7fff700 1 -- 172.21.15.80:0/1530099635 learned_addr learned my addr 172.21.15.80:0/1530099635 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.477+0000 7f7dbcfeb700 1 --2- 172.21.15.80:0/1530099635 >> v2:172.21.15.80:3300/0 conn(0x7f7db810f730 0x7f7db8167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.477+0000 7f7daffff700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7db810ed60 0x7f7db810f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:41.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.477+0000 7f7dbcfeb700 1 -- 172.21.15.80:0/1530099635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7db810ed60 msgr2=0x7f7db810f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.477+0000 7f7dbcfeb700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7db810ed60 0x7f7db810f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:41.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7dbcfeb700 1 -- 172.21.15.80:0/1530099635 >> v1:172.21.15.80:6789/0 conn(0x7f7db810e970 legacy=0x7f7db81087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7dbcfeb700 1 -- 172.21.15.80:0/1530099635 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db8105ef0 con 0x7f7db810f730 2019-11-28T11:49:41.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7db57fa700 1 -- 172.21.15.80:0/1530099635 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987163900 0 0) 0x7f7da8007b10 con 0x7f7db810e970 2019-11-28T11:49:41.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7dbcfeb700 1 --2- 172.21.15.80:0/1530099635 >> v2:172.21.15.80:3300/0 conn(0x7f7db810f730 0x7f7db8167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7db0010730 tx=0x7f7db0010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7dbcfeb700 1 --2- 172.21.15.80:0/1530099635 >> v2:172.21.15.80:3300/0 conn(0x7f7db810f730 0x7f7db8167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7db0010730 tx=0x7f7db0010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7dbcfeb700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db810f730 0x7f7db8167d70 secure :-1 s=READY pgs=2101 cs=0 l=1 rx=0x7f7db0010730 tx=0x7f7db0010560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:41.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7dbcfeb700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db810f730 0x7f7db8167d70 secure :-1 s=THROTTLE_DONE pgs=2101 cs=0 l=1 rx=0x7f7db0010730 tx=0x7f7db0010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7db57fa700 1 -- 172.21.15.80:0/1530099635 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7db000f5d0 con 0x7f7db810f730 2019-11-28T11:49:41.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7dbcfeb700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db810f730 0x7f7db8167d70 secure :-1 s=THROTTLE_DONE pgs=2101 cs=0 l=1 rx=0x7f7db0010730 tx=0x7f7db0010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7db57fa700 1 -- 172.21.15.80:0/1530099635 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db000f290 con 0x7f7db810f730 2019-11-28T11:49:41.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7dbe24d700 1 -- 172.21.15.80:0/1530099635 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db8106270 con 0x7f7db810f730 2019-11-28T11:49:41.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7dbcfeb700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db810f730 0x7f7db8167d70 secure :-1 s=THROTTLE_DONE pgs=2101 cs=0 l=1 rx=0x7f7db0010730 tx=0x7f7db0010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7db57fa700 1 -- 172.21.15.80:0/1530099635 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7db000fa00 con 0x7f7db810f730 2019-11-28T11:49:41.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7dbe24d700 1 -- 172.21.15.80:0/1530099635 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db8105ef0 con 0x7f7db810f730 2019-11-28T11:49:41.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7dbcfeb700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db810f730 0x7f7db8167d70 secure :-1 s=THROTTLE_DONE pgs=2101 cs=0 l=1 rx=0x7f7db0010730 tx=0x7f7db0010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7db57fa700 1 -- 172.21.15.80:0/1530099635 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7db000f8a0 con 0x7f7db810f730 2019-11-28T11:49:41.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.478+0000 7f7dbcfeb700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db810f730 0x7f7db8167d70 secure :-1 s=THROTTLE_DONE pgs=2101 cs=0 l=1 rx=0x7f7db0010730 tx=0x7f7db0010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.479+0000 7f7db57fa700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d9c018730 0x7f7d9c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:41.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.479+0000 7f7db57fa700 1 -- 172.21.15.80:0/1530099635 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7db0032050 con 0x7f7db810f730 2019-11-28T11:49:41.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.479+0000 7f7db7fff700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d9c018730 0x7f7d9c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:41.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.479+0000 7f7db7fff700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d9c018730 0x7f7d9c01abc0 crc :-1 s=READY pgs=856 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:41.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.486+0000 7f7dbe24d700 1 -- 172.21.15.80:0/1530099635 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db8106270 con 0x7f7db810f730 2019-11-28T11:49:41.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.490+0000 7f7dbcfeb700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db810f730 0x7f7db8167d70 secure :-1 s=THROTTLE_DONE pgs=2101 cs=0 l=1 rx=0x7f7db0010730 tx=0x7f7db0010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.490+0000 7f7db57fa700 1 -- 172.21.15.80:0/1530099635 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7db000f690 con 0x7f7db810f730 2019-11-28T11:49:41.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.657+0000 7f7dbe24d700 1 -- 172.21.15.80:0/1530099635 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f7db8105ef0 con 0x7f7db810f730 2019-11-28T11:49:41.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.657+0000 7f7dbcfeb700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db810f730 0x7f7db8167d70 secure :-1 s=THROTTLE_DONE pgs=2101 cs=0 l=1 rx=0x7f7db0010730 tx=0x7f7db0010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.657+0000 7f7db57fa700 1 -- 172.21.15.80:0/1530099635 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v162) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7db000f270 con 0x7f7db810f730 2019-11-28T11:49:41.705 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:49:41.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.659+0000 7f7dbe24d700 1 -- 172.21.15.80:0/1530099635 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d9c018730 msgr2=0x7f7d9c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.659+0000 7f7dbe24d700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d9c018730 0x7f7d9c01abc0 crc :-1 s=READY pgs=856 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:41.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.659+0000 7f7dbe24d700 1 -- 172.21.15.80:0/1530099635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db810f730 msgr2=0x7f7db8167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.659+0000 7f7dbe24d700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db810f730 0x7f7db8167d70 secure :-1 s=READY pgs=2101 cs=0 l=1 rx=0x7f7db0010730 tx=0x7f7db0010560).stop 2019-11-28T11:49:41.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.659+0000 7f7dbe24d700 1 -- 172.21.15.80:0/1530099635 shutdown_connections 2019-11-28T11:49:41.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.659+0000 7f7dbe24d700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d9c018730 0x7f7d9c01abc0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:41.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.659+0000 7f7dbe24d700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db810f730 0x7f7db8167d70 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:41.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.659+0000 7f7dbe24d700 1 --2- 172.21.15.80:0/1530099635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7db810ed60 0x7f7db810f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:41.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.660+0000 7f7dbe24d700 1 -- 172.21.15.80:0/1530099635 shutdown_connections 2019-11-28T11:49:41.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.660+0000 7f7dbe24d700 1 -- 172.21.15.80:0/1530099635 wait complete. 2019-11-28T11:49:41.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.660+0000 7f7dbe24d700 1 -- 172.21.15.80:0/1530099635 >> 172.21.15.80:0/1530099635 conn(0x7f7db815e2d0 msgr2=0x7f7db8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:41.717 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:49:41.717 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:49:41.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.789+0000 7f596fbef700 1 Processor -- start 2019-11-28T11:49:41.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.789+0000 7f596fbef700 1 -- start start 2019-11-28T11:49:41.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.790+0000 7f596fbef700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f596806c490 0x7f596806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:41.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.790+0000 7f596fbef700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596806db00 con 0x7f596806ce60 2019-11-28T11:49:41.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.790+0000 7f596fbef700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596806e000 con 0x7f596806c0a0 2019-11-28T11:49:41.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.790+0000 7f596fbef700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596806fd60 con 0x7f596806c490 2019-11-28T11:49:41.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596e98d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f596806ce60 0x7f5968164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41694/0 (socket says 172.21.15.80:41694) 2019-11-28T11:49:41.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596e98d700 1 -- 172.21.15.80:0/308213048 learned_addr learned my addr 172.21.15.80:0/308213048 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:41.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d98b700 1 --2- 172.21.15.80:0/308213048 >> v2:172.21.15.174:3300/0 conn(0x7f596806c490 0x7f596806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:41.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d18a700 1 -- 172.21.15.80:0/308213048 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317401724 0 0) 0x7f5960001150 con 0x7f596806ce60 2019-11-28T11:49:41.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d18a700 1 -- 172.21.15.80:0/308213048 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5954002e80 con 0x7f596806ce60 2019-11-28T11:49:41.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d18a700 1 -- 172.21.15.80:0/308213048 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473560113 0 0) 0x7f5958001080 con 0x7f596806c0a0 2019-11-28T11:49:41.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d18a700 1 -- 172.21.15.80:0/308213048 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59540030b0 con 0x7f596806c0a0 2019-11-28T11:49:41.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d98b700 1 -- 172.21.15.80:0/308213048 >> v1:172.21.15.174:6789/0 conn(0x7f596806c0a0 legacy=0x7f5968072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d98b700 1 -- 172.21.15.80:0/308213048 >> v1:172.21.15.80:6789/0 conn(0x7f596806ce60 legacy=0x7f5968164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d98b700 1 -- 172.21.15.80:0/308213048 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59680706c0 con 0x7f596806c490 2019-11-28T11:49:41.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d98b700 1 --2- 172.21.15.80:0/308213048 >> v2:172.21.15.174:3300/0 conn(0x7f596806c490 0x7f596806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f595000b2d0 tx=0x7f595000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d98b700 1 --2- 172.21.15.80:0/308213048 >> v2:172.21.15.174:3300/0 conn(0x7f596806c490 0x7f596806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f595000b2d0 tx=0x7f595000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d98b700 1 --2- 172.21.15.80:0/308213048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f596806c490 0x7f596806c920 secure :-1 s=READY pgs=1250 cs=0 l=1 rx=0x7f595000b2d0 tx=0x7f595000bae0).ready entity=mon.1 client_cookie=7aeee004c5b116ca server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:41.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d98b700 1 --2- 172.21.15.80:0/308213048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f596806c490 0x7f596806c920 secure :-1 s=THROTTLE_DONE pgs=1250 cs=0 l=1 rx=0x7f595000b2d0 tx=0x7f595000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d98b700 1 --2- 172.21.15.80:0/308213048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f596806c490 0x7f596806c920 secure :-1 s=THROTTLE_DONE pgs=1250 cs=0 l=1 rx=0x7f595000b2d0 tx=0x7f595000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d18a700 1 -- 172.21.15.80:0/308213048 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5950000ce0 con 0x7f596806c490 2019-11-28T11:49:41.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d98b700 1 --2- 172.21.15.80:0/308213048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f596806c490 0x7f596806c920 secure :-1 s=THROTTLE_DONE pgs=1250 cs=0 l=1 rx=0x7f595000b2d0 tx=0x7f595000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d18a700 1 -- 172.21.15.80:0/308213048 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5950009be0 con 0x7f596806c490 2019-11-28T11:49:41.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596d18a700 1 -- 172.21.15.80:0/308213048 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f595000a2b0 con 0x7f596806c490 2019-11-28T11:49:41.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596fbef700 1 -- 172.21.15.80:0/308213048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f596806c490 msgr2=0x7f596806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.791+0000 7f596fbef700 1 --2- 172.21.15.80:0/308213048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f596806c490 0x7f596806c920 secure :-1 s=READY pgs=1250 cs=0 l=1 rx=0x7f595000b2d0 tx=0x7f595000bae0).stop 2019-11-28T11:49:41.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.792+0000 7f596fbef700 1 -- 172.21.15.80:0/308213048 shutdown_connections 2019-11-28T11:49:41.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.792+0000 7f596fbef700 1 --2- 172.21.15.80:0/308213048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f596806c490 0x7f596806c920 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:41.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.792+0000 7f596fbef700 1 -- 172.21.15.80:0/308213048 shutdown_connections 2019-11-28T11:49:41.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.792+0000 7f596fbef700 1 -- 172.21.15.80:0/308213048 wait complete. 2019-11-28T11:49:41.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.792+0000 7f596fbef700 1 -- 172.21.15.80:0/308213048 >> 172.21.15.80:0/308213048 conn(0x7f5968061cf0 msgr2=0x7f5968064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.795+0000 7f596fbef700 1 Processor -- start 2019-11-28T11:49:41.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.795+0000 7f596fbef700 1 -- start start 2019-11-28T11:49:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.795+0000 7f596fbef700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5968135760 0x7f5968137480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.795+0000 7f596fbef700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5968136480 con 0x7f59681330b0 2019-11-28T11:49:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f596fbef700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59681033c0 con 0x7f596812a150 2019-11-28T11:49:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f596fbef700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5968104370 con 0x7f5968135760 2019-11-28T11:49:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f596e18c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5968135760 0x7f5968137480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f596e98d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f59681330b0 0x7f5968133550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41702/0 (socket says 172.21.15.80:41702) 2019-11-28T11:49:41.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f596e98d700 1 -- 172.21.15.80:0/4091216867 learned_addr learned my addr 172.21.15.80:0/4091216867 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:41.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f596e18c700 1 -- 172.21.15.80:0/4091216867 >> v1:172.21.15.174:6789/0 conn(0x7f596812a150 legacy=0x7f596812a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f596e18c700 1 -- 172.21.15.80:0/4091216867 >> v1:172.21.15.80:6789/0 conn(0x7f59681330b0 legacy=0x7f5968133550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:41.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f596e18c700 1 -- 172.21.15.80:0/4091216867 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5968104a00 con 0x7f5968135760 2019-11-28T11:49:41.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f5966ffd700 1 -- 172.21.15.80:0/4091216867 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2867570022 0 0) 0x7f5960001150 con 0x7f59681330b0 2019-11-28T11:49:41.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f596e18c700 1 --2- 172.21.15.80:0/4091216867 >> v2:172.21.15.80:3300/0 conn(0x7f5968135760 0x7f5968137480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59580103c0 tx=0x7f5958010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f596e18c700 1 --2- 172.21.15.80:0/4091216867 >> v2:172.21.15.80:3300/0 conn(0x7f5968135760 0x7f5968137480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59580103c0 tx=0x7f5958010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f596e18c700 1 --2- 172.21.15.80:0/4091216867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5968135760 0x7f5968137480 secure :-1 s=READY pgs=2104 cs=0 l=1 rx=0x7f59580103c0 tx=0x7f5958010760).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:41.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f596e18c700 1 --2- 172.21.15.80:0/4091216867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5968135760 0x7f5968137480 secure :-1 s=THROTTLE_DONE pgs=2104 cs=0 l=1 rx=0x7f59580103c0 tx=0x7f5958010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f5966ffd700 1 -- 172.21.15.80:0/4091216867 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5958000aa0 con 0x7f5968135760 2019-11-28T11:49:41.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f596e18c700 1 --2- 172.21.15.80:0/4091216867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5968135760 0x7f5968137480 secure :-1 s=THROTTLE_DONE pgs=2104 cs=0 l=1 rx=0x7f59580103c0 tx=0x7f5958010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f596fbef700 1 -- 172.21.15.80:0/4091216867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5968104d80 con 0x7f5968135760 2019-11-28T11:49:41.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f596e18c700 1 --2- 172.21.15.80:0/4091216867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5968135760 0x7f5968137480 secure :-1 s=THROTTLE_DONE pgs=2104 cs=0 l=1 rx=0x7f59580103c0 tx=0x7f5958010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f5966ffd700 1 -- 172.21.15.80:0/4091216867 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5958000aa0 con 0x7f5968135760 2019-11-28T11:49:41.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f5966ffd700 1 -- 172.21.15.80:0/4091216867 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f595800f1c0 con 0x7f5968135760 2019-11-28T11:49:41.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.796+0000 7f596fbef700 1 -- 172.21.15.80:0/4091216867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5968104a00 con 0x7f5968135760 2019-11-28T11:49:41.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.797+0000 7f596e18c700 1 --2- 172.21.15.80:0/4091216867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5968135760 0x7f5968137480 secure :-1 s=THROTTLE_DONE pgs=2104 cs=0 l=1 rx=0x7f59580103c0 tx=0x7f5958010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.797+0000 7f5966ffd700 1 -- 172.21.15.80:0/4091216867 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f595800ea70 con 0x7f5968135760 2019-11-28T11:49:41.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.797+0000 7f596e18c700 1 --2- 172.21.15.80:0/4091216867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5968135760 0x7f5968137480 secure :-1 s=THROTTLE_DONE pgs=2104 cs=0 l=1 rx=0x7f59580103c0 tx=0x7f5958010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.797+0000 7f5966ffd700 1 --2- 172.21.15.80:0/4091216867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f594c018730 0x7f594c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:41.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.797+0000 7f5966ffd700 1 -- 172.21.15.80:0/4091216867 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5958031b20 con 0x7f5968135760 2019-11-28T11:49:41.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.797+0000 7f596d98b700 1 --2- 172.21.15.80:0/4091216867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f594c018730 0x7f594c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:41.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.797+0000 7f596d98b700 1 --2- 172.21.15.80:0/4091216867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f594c018730 0x7f594c01abc0 crc :-1 s=READY pgs=857 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:41.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.805+0000 7f596fbef700 1 -- 172.21.15.80:0/4091216867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5968104d80 con 0x7f5968135760 2019-11-28T11:49:41.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.808+0000 7f596e18c700 1 --2- 172.21.15.80:0/4091216867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5968135760 0x7f5968137480 secure :-1 s=THROTTLE_DONE pgs=2104 cs=0 l=1 rx=0x7f59580103c0 tx=0x7f5958010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:41.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.808+0000 7f5966ffd700 1 -- 172.21.15.80:0/4091216867 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f595800f710 con 0x7f5968135760 2019-11-28T11:49:42.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.980+0000 7f596fbef700 1 -- 172.21.15.80:0/4091216867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5968104a00 con 0x7f5968135760 2019-11-28T11:49:42.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.981+0000 7f596e18c700 1 --2- 172.21.15.80:0/4091216867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5968135760 0x7f5968137480 secure :-1 s=THROTTLE_DONE pgs=2104 cs=0 l=1 rx=0x7f59580103c0 tx=0x7f5958010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:42.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.981+0000 7f5966ffd700 1 -- 172.21.15.80:0/4091216867 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f595800ea50 con 0x7f5968135760 2019-11-28T11:49:42.029 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 125 2019-11-28T11:49:42.030 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:42.030 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":125,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/4187724019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":4187724019},{"type":"v1","addr":"172.21.15.80:6834","nonce":4187724019}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":125},{"gid":10086,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/4135317651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":4135317651},{"type":"v1","addr":"172.21.15.80:6835","nonce":4135317651}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":125}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:49:37.195766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9442":{"gid":9442,"name":"c","rank":0,"incarnation":123,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/1260063619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1260063619},{"type":"v1","addr":"172.21.15.174:6835","nonce":1260063619}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:49:42.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.983+0000 7f596fbef700 1 -- 172.21.15.80:0/4091216867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f594c018730 msgr2=0x7f594c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:42.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.983+0000 7f596fbef700 1 --2- 172.21.15.80:0/4091216867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f594c018730 0x7f594c01abc0 crc :-1 s=READY pgs=857 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:42.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.983+0000 7f596fbef700 1 -- 172.21.15.80:0/4091216867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5968135760 msgr2=0x7f5968137480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:42.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.983+0000 7f596fbef700 1 --2- 172.21.15.80:0/4091216867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5968135760 0x7f5968137480 secure :-1 s=READY pgs=2104 cs=0 l=1 rx=0x7f59580103c0 tx=0x7f5958010760).stop 2019-11-28T11:49:42.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.983+0000 7f596fbef700 1 -- 172.21.15.80:0/4091216867 shutdown_connections 2019-11-28T11:49:42.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.983+0000 7f596fbef700 1 --2- 172.21.15.80:0/4091216867 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f594c018730 0x7f594c01abc0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:42.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.983+0000 7f596fbef700 1 --2- 172.21.15.80:0/4091216867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5968135760 0x7f5968137480 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:42.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.983+0000 7f596fbef700 1 -- 172.21.15.80:0/4091216867 shutdown_connections 2019-11-28T11:49:42.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.983+0000 7f596fbef700 1 -- 172.21.15.80:0/4091216867 wait complete. 2019-11-28T11:49:42.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:41.983+0000 7f596fbef700 1 -- 172.21.15.80:0/4091216867 >> 172.21.15.80:0/4091216867 conn(0x7f596813d930 msgr2=0x7f5968102360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:42.343 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 9442}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 26, u'failed': [], u'epoch': 124, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [27], u'info': {u'gid_9442': {u'export_targets': [], u'name': u'c', u'incarnation': 123, u'state_seq': 2, u'state': u'up:active', u'gid': 9442, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1260063619, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 1260063619, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/1260063619'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:49:33.165935+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:49:37.195766+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:49:42.343 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:49:42.344 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:49:42.469 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:49:42.470 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:49:42.470 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:49:42.470 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 9442, 2019-11-28T11:49:42.470 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:49:42.470 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:49:42.470 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 6.2291669780000003, 2019-11-28T11:49:42.470 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 124, 2019-11-28T11:49:42.471 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 162, 2019-11-28T11:49:42.471 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 162, 2019-11-28T11:49:42.471 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 6.4747101499999999 2019-11-28T11:49:42.471 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:49:42.475 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 9442, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.2291669780000003, "mdsmap_epoch": 124, "osdmap_epoch": 162, "osdmap_epoch_barrier": 162, "uptime": 6.4747101499999999 } 2019-11-28T11:49:42.475 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:49:42.475 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:49:42.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:49:42.476 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:49:42.547 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:49:42.548 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:49:42.669 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:49:42.669 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:49:42.669 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:49:42.669 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:49:42.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:49:42.670 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:49:42.759 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:49:42.880 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:49:42.881 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:49:42.881 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:49:42.886 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:49:42.886 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:49:43.007 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:49:43.008 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:49:43.008 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:49:43.013 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:49:43.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:49:43.014 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:49:43.014 INFO:teuthology.orchestra.run.smithi076:> import glob 2019-11-28T11:49:43.014 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:49:43.014 INFO:teuthology.orchestra.run.smithi076:> import json 2019-11-28T11:49:43.014 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:49:43.014 INFO:teuthology.orchestra.run.smithi076:> def get_id_to_dir(): 2019-11-28T11:49:43.015 INFO:teuthology.orchestra.run.smithi076:> result = {} 2019-11-28T11:49:43.015 INFO:teuthology.orchestra.run.smithi076:> for dir in glob.glob("/sys/kernel/debug/ceph/*"): 2019-11-28T11:49:43.015 INFO:teuthology.orchestra.run.smithi076:> mds_sessions_lines = open(os.path.join(dir, "mds_sessions")).readlines() 2019-11-28T11:49:43.015 INFO:teuthology.orchestra.run.smithi076:> client_id = mds_sessions_lines[1].split()[1].strip('"'"'"'"'"') 2019-11-28T11:49:43.015 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:49:43.015 INFO:teuthology.orchestra.run.smithi076:> result[client_id] = dir 2019-11-28T11:49:43.015 INFO:teuthology.orchestra.run.smithi076:> return result 2019-11-28T11:49:43.015 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:49:43.016 INFO:teuthology.orchestra.run.smithi076:> print(json.dumps(get_id_to_dir())) 2019-11-28T11:49:43.016 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:49:43.093 INFO:teuthology.orchestra.run.smithi076.stdout:{"0": "/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client6989"} 2019-11-28T11:49:43.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:49:43.094 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:49:43.094 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:49:43.094 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:49:43.094 INFO:teuthology.orchestra.run.smithi076:> print(open(os.path.join("/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client6989", "mds_sessions")).read()) 2019-11-28T11:49:43.095 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:49:43.174 INFO:teuthology.orchestra.run.smithi076.stdout:global_id 6989 2019-11-28T11:49:43.175 INFO:teuthology.orchestra.run.smithi076.stdout:name "0" 2019-11-28T11:49:43.175 INFO:teuthology.orchestra.run.smithi076.stdout:mds.0 open 2019-11-28T11:49:43.175 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:49:43.176 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:49:43.176 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:49:43.177 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:49:43.177 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:49:43.177 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:49:43.178 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:49:43.182 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:49:43.182 DEBUG:teuthology.parallel:result is None 2019-11-28T11:49:43.185 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:49:43.185 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:49:43.185 DEBUG:teuthology.parallel:result is None 2019-11-28T11:49:43.186 DEBUG:teuthology.parallel:result is None 2019-11-28T11:49:43.186 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:49:43.187 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:49:43.188 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:49:43.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.342+0000 7f0b1389e700 1 Processor -- start 2019-11-28T11:49:43.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.342+0000 7f0b1389e700 1 -- start start 2019-11-28T11:49:43.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7f0b1389e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0b0c06c490 0x7f0b0c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:43.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7f0b1389e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b0c06db00 con 0x7f0b0c06c0a0 2019-11-28T11:49:43.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7f0b1389e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b0c06e000 con 0x7f0b0c06ce60 2019-11-28T11:49:43.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7f0b1389e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b0c06fd60 con 0x7f0b0c06c490 2019-11-28T11:49:43.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7f0b1163a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0b0c06c490 0x7f0b0c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7f0b11e3b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0b0c06c0a0 0x7f0b0c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41706/0 (socket says 172.21.15.80:41706) 2019-11-28T11:49:43.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7f0b1163a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0b0c06c490 0x7f0b0c06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42390/0 (socket says 172.21.15.80:42390) 2019-11-28T11:49:43.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7f0b11e3b700 1 -- 172.21.15.80:0/4037928434 learned_addr learned my addr 172.21.15.80:0/4037928434 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:43.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7f0b1163a700 1 -- 172.21.15.80:0/4037928434 >> v1:172.21.15.174:6789/0 conn(0x7f0b0c06ce60 legacy=0x7f0b0c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7f0b1163a700 1 -- 172.21.15.80:0/4037928434 >> v1:172.21.15.80:6789/0 conn(0x7f0b0c06c0a0 legacy=0x7f0b0c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7f0b10e39700 1 -- 172.21.15.80:0/4037928434 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079572324 0 0) 0x7f0b08001150 con 0x7f0b0c06c0a0 2019-11-28T11:49:43.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7f0b1163a700 1 -- 172.21.15.80:0/4037928434 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0c0706c0 con 0x7f0b0c06c490 2019-11-28T11:49:43.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7f0b1163a700 1 --2- 172.21.15.80:0/4037928434 >> v2:172.21.15.80:3300/0 conn(0x7f0b0c06c490 0x7f0b0c06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0afc00af50 tx=0x7f0afc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7f0b1163a700 1 --2- 172.21.15.80:0/4037928434 >> v2:172.21.15.80:3300/0 conn(0x7f0b0c06c490 0x7f0b0c06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0afc00af50 tx=0x7f0afc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7f0b1163a700 1 --2- 172.21.15.80:0/4037928434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b0c06c490 0x7f0b0c06c920 secure :-1 s=READY pgs=2107 cs=0 l=1 rx=0x7f0afc00af50 tx=0x7f0afc00b760).ready entity=mon.0 client_cookie=bfba3e3839afb7b0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:43.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7f0b1163a700 1 --2- 172.21.15.80:0/4037928434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b0c06c490 0x7f0b0c06c920 secure :-1 s=THROTTLE_DONE pgs=2107 cs=0 l=1 rx=0x7f0afc00af50 tx=0x7f0afc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7f0b10e39700 1 -- 172.21.15.80:0/4037928434 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0afc000960 con 0x7f0b0c06c490 2019-11-28T11:49:43.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7f0b1163a700 1 --2- 172.21.15.80:0/4037928434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b0c06c490 0x7f0b0c06c920 secure :-1 s=THROTTLE_DONE pgs=2107 cs=0 l=1 rx=0x7f0afc00af50 tx=0x7f0afc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7f0b1163a700 1 --2- 172.21.15.80:0/4037928434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b0c06c490 0x7f0b0c06c920 secure :-1 s=THROTTLE_DONE pgs=2107 cs=0 l=1 rx=0x7f0afc00af50 tx=0x7f0afc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7f0b10e39700 1 -- 172.21.15.80:0/4037928434 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0afc009860 con 0x7f0b0c06c490 2019-11-28T11:49:43.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7f0b10e39700 1 -- 172.21.15.80:0/4037928434 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0afc009f30 con 0x7f0b0c06c490 2019-11-28T11:49:43.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7f0b1389e700 1 -- 172.21.15.80:0/4037928434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b0c06c490 msgr2=0x7f0b0c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7f0b1389e700 1 --2- 172.21.15.80:0/4037928434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b0c06c490 0x7f0b0c06c920 secure :-1 s=READY pgs=2107 cs=0 l=1 rx=0x7f0afc00af50 tx=0x7f0afc00b760).stop 2019-11-28T11:49:43.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7f0b1389e700 1 -- 172.21.15.80:0/4037928434 shutdown_connections 2019-11-28T11:49:43.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7f0b1389e700 1 --2- 172.21.15.80:0/4037928434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b0c06c490 0x7f0b0c06c920 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:43.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7f0b1389e700 1 -- 172.21.15.80:0/4037928434 shutdown_connections 2019-11-28T11:49:43.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7f0b1389e700 1 -- 172.21.15.80:0/4037928434 wait complete. 2019-11-28T11:49:43.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7f0b1389e700 1 -- 172.21.15.80:0/4037928434 >> 172.21.15.80:0/4037928434 conn(0x7f0b0c061cf0 msgr2=0x7f0b0c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.348+0000 7f0b1389e700 1 Processor -- start 2019-11-28T11:49:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.348+0000 7f0b1389e700 1 -- start start 2019-11-28T11:49:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7f0b1389e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b0c167a20 0x7f0b0c169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7f0b1389e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b0c115990 con 0x7f0b0c111c70 2019-11-28T11:49:43.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7f0b1389e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b0c13ea40 con 0x7f0b0c10a070 2019-11-28T11:49:43.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7f0b1389e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0c117200 con 0x7f0b0c167a20 2019-11-28T11:49:43.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7f0b11e3b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0b0c111c70 0x7f0b0c10b1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41726/0 (socket says 172.21.15.80:41726) 2019-11-28T11:49:43.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7f0b11e3b700 1 -- 172.21.15.80:0/2327482955 learned_addr learned my addr 172.21.15.80:0/2327482955 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:43.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7f0b1263c700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b0c167a20 0x7f0b0c169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133344604 0 0) 0x7f0b08001280 con 0x7f0b0c111c70 2019-11-28T11:49:43.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0af4002e80 con 0x7f0b0c111c70 2019-11-28T11:49:43.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3871478507 0 0) 0x7f0b080012b0 con 0x7f0b0c111c70 2019-11-28T11:49:43.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0af40032e0 con 0x7f0b0c111c70 2019-11-28T11:49:43.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f0b08001860 con 0x7f0b0c111c70 2019-11-28T11:49:43.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b0c167a20 msgr2=0x7f0b0c169e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7f0b027fc700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b0c167a20 0x7f0b0c169e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:43.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 >> v1:172.21.15.174:6789/0 conn(0x7f0b0c10a070 legacy=0x7f0b0c10a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 >> v1:172.21.15.80:6789/0 conn(0x7f0b0c111c70 legacy=0x7f0b0c10b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.457 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b027fc700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0af40033b0 0x7f0af4003800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:43.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b027fc700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0af4003d40 0x7f0af40041b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:43.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b027fc700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0af4004960 0x7f0af4004e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:43.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af400bc80 con 0x7f0af4004960 2019-11-28T11:49:43.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af400beb0 con 0x7f0af40033b0 2019-11-28T11:49:43.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af400c0e0 con 0x7f0af4003d40 2019-11-28T11:49:43.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b1263c700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b0c167a20 0x7f0b0c169e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:43.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b11e3b700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0af40033b0 0x7f0af4003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b1263c700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0af4004960 0x7f0af4004e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b1163a700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0af4003d40 0x7f0af40041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b1263c700 1 -- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0af4003d40 msgr2=0x7f0af40041b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b1263c700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0af4003d40 0x7f0af40041b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:43.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b1263c700 1 -- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0af40033b0 msgr2=0x7f0af4003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b1263c700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0af40033b0 0x7f0af4003800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:43.459 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b1263c700 1 -- 172.21.15.80:0/2327482955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af400c390 con 0x7f0af4004960 2019-11-28T11:49:43.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b1389e700 1 -- 172.21.15.80:0/2327482955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b0c108d20 con 0x7f0af4004960 2019-11-28T11:49:43.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b1263c700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0af4004960 0x7f0af4004e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0b04010740 tx=0x7f0b0400c110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b11e3b700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0af40033b0 0x7f0af4003800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:43.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b1263c700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0af4004960 0x7f0af4004e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0b04010740 tx=0x7f0b0400c110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7f0b1263c700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0af4004960 0x7f0af4004e20 secure :-1 s=READY pgs=2113 cs=0 l=1 rx=0x7f0b04010740 tx=0x7f0b0400c110).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:43.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7f0b1389e700 1 -- 172.21.15.80:0/2327482955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b0c1089a0 con 0x7f0af4004960 2019-11-28T11:49:43.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7f0b1263c700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0af4004960 0x7f0af4004e20 secure :-1 s=THROTTLE_DONE pgs=2113 cs=0 l=1 rx=0x7f0b04010740 tx=0x7f0b0400c110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7f0b1263c700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0af4004960 0x7f0af4004e20 secure :-1 s=THROTTLE_DONE pgs=2113 cs=0 l=1 rx=0x7f0b04010740 tx=0x7f0b0400c110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7f0b1263c700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0af4004960 0x7f0af4004e20 secure :-1 s=THROTTLE_DONE pgs=2113 cs=0 l=1 rx=0x7f0b04010740 tx=0x7f0b0400c110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b0400b070 con 0x7f0af4004960 2019-11-28T11:49:43.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b04009b00 con 0x7f0af4004960 2019-11-28T11:49:43.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b0400a230 con 0x7f0af4004960 2019-11-28T11:49:43.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7f0b1263c700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0af4004960 0x7f0af4004e20 secure :-1 s=THROTTLE_DONE pgs=2113 cs=0 l=1 rx=0x7f0b04010740 tx=0x7f0b0400c110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0b04009fc0 con 0x7f0af4004960 2019-11-28T11:49:43.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7f0b1263c700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0af4004960 0x7f0af4004e20 secure :-1 s=THROTTLE_DONE pgs=2113 cs=0 l=1 rx=0x7f0b04010740 tx=0x7f0b0400c110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7f0b027fc700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0af4020be0 0x7f0af4023010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:43.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0b04031f90 con 0x7f0af4004960 2019-11-28T11:49:43.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7f0b11e3b700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0af4020be0 0x7f0af4023010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.353+0000 7f0b11e3b700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0af4020be0 0x7f0af4023010 crc :-1 s=READY pgs=859 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:43.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.357+0000 7f0b1389e700 1 -- 172.21.15.80:0/2327482955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae8002e60 con 0x7f0af4004960 2019-11-28T11:49:43.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.361+0000 7f0b1263c700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0af4004960 0x7f0af4004e20 secure :-1 s=THROTTLE_DONE pgs=2113 cs=0 l=1 rx=0x7f0b04010740 tx=0x7f0b0400c110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.361+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0b0400a330 con 0x7f0af4004960 2019-11-28T11:49:43.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.342+0000 7feb442e9700 1 Processor -- start 2019-11-28T11:49:43.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.342+0000 7feb442e9700 1 -- start start 2019-11-28T11:49:43.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7feb442e9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7feb3c06c490 0x7feb3c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:43.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7feb442e9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb3c06ce60 0x7feb3c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:43.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7feb442e9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3c06db00 con 0x7feb3c06c0a0 2019-11-28T11:49:43.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7feb442e9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c06fd60 con 0x7feb3c06ce60 2019-11-28T11:49:43.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7feb442e9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c070030 con 0x7feb3c06c490 2019-11-28T11:49:43.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7feb43087700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb3c06ce60 0x7feb3c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7feb43087700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb3c06ce60 0x7feb3c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42396/0 (socket says 172.21.15.80:42396) 2019-11-28T11:49:43.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7feb43087700 1 -- 172.21.15.80:0/2795720740 learned_addr learned my addr 172.21.15.80:0/2795720740 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:43.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7feb42085700 1 --2- 172.21.15.80:0/2795720740 >> v2:172.21.15.174:3300/0 conn(0x7feb3c06c490 0x7feb3c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb43087700 1 -- 172.21.15.80:0/2795720740 >> v2:172.21.15.174:3300/0 conn(0x7feb3c06c490 msgr2=0x7feb3c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:43.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb43087700 1 --2- 172.21.15.80:0/2795720740 >> v2:172.21.15.174:3300/0 conn(0x7feb3c06c490 0x7feb3c06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:43.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb43087700 1 -- 172.21.15.80:0/2795720740 >> v1:172.21.15.174:6789/0 conn(0x7feb3c06c0a0 legacy=0x7feb3c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb41884700 1 -- 172.21.15.80:0/2795720740 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802965858 0 0) 0x7feb2c001080 con 0x7feb3c06c0a0 2019-11-28T11:49:43.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb43087700 1 -- 172.21.15.80:0/2795720740 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c0706c0 con 0x7feb3c06ce60 2019-11-28T11:49:43.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb43087700 1 --2- 172.21.15.80:0/2795720740 >> v2:172.21.15.80:3300/0 conn(0x7feb3c06ce60 0x7feb3c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feb3400fab0 tx=0x7feb3400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb42085700 1 --2- 172.21.15.80:0/2795720740 >> v2:172.21.15.174:3300/0 conn(0x7feb3c06c490 0x7feb3c06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb43087700 1 --2- 172.21.15.80:0/2795720740 >> v2:172.21.15.80:3300/0 conn(0x7feb3c06ce60 0x7feb3c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feb3400fab0 tx=0x7feb3400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb43087700 1 --2- 172.21.15.80:0/2795720740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3c06ce60 0x7feb3c164d70 secure :-1 s=READY pgs=2109 cs=0 l=1 rx=0x7feb3400fab0 tx=0x7feb3400fe50).ready entity=mon.0 client_cookie=569ded6bda2644aa server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb43087700 1 --2- 172.21.15.80:0/2795720740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3c06ce60 0x7feb3c164d70 secure :-1 s=THROTTLE_DONE pgs=2109 cs=0 l=1 rx=0x7feb3400fab0 tx=0x7feb3400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb43087700 1 --2- 172.21.15.80:0/2795720740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3c06ce60 0x7feb3c164d70 secure :-1 s=THROTTLE_DONE pgs=2109 cs=0 l=1 rx=0x7feb3400fab0 tx=0x7feb3400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb43087700 1 --2- 172.21.15.80:0/2795720740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3c06ce60 0x7feb3c164d70 secure :-1 s=THROTTLE_DONE pgs=2109 cs=0 l=1 rx=0x7feb3400fab0 tx=0x7feb3400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb41884700 1 -- 172.21.15.80:0/2795720740 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb34000df0 con 0x7feb3c06ce60 2019-11-28T11:49:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb41884700 1 -- 172.21.15.80:0/2795720740 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb34001460 con 0x7feb3c06ce60 2019-11-28T11:49:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb41884700 1 -- 172.21.15.80:0/2795720740 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb34001b10 con 0x7feb3c06ce60 2019-11-28T11:49:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb442e9700 1 -- 172.21.15.80:0/2795720740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3c06ce60 msgr2=0x7feb3c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7feb442e9700 1 --2- 172.21.15.80:0/2795720740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3c06ce60 0x7feb3c164d70 secure :-1 s=READY pgs=2109 cs=0 l=1 rx=0x7feb3400fab0 tx=0x7feb3400fe50).stop 2019-11-28T11:49:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7feb442e9700 1 -- 172.21.15.80:0/2795720740 shutdown_connections 2019-11-28T11:49:43.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7feb442e9700 1 --2- 172.21.15.80:0/2795720740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb3c06ce60 0x7feb3c164d70 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:43.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7feb442e9700 1 --2- 172.21.15.80:0/2795720740 >> v2:172.21.15.174:3300/0 conn(0x7feb3c06c490 0x7feb3c06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:43.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7feb442e9700 1 -- 172.21.15.80:0/2795720740 shutdown_connections 2019-11-28T11:49:43.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7feb442e9700 1 -- 172.21.15.80:0/2795720740 wait complete. 2019-11-28T11:49:43.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7feb442e9700 1 -- 172.21.15.80:0/2795720740 >> 172.21.15.80:0/2795720740 conn(0x7feb3c061cf0 msgr2=0x7feb3c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:43.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.348+0000 7feb442e9700 1 Processor -- start 2019-11-28T11:49:43.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.348+0000 7feb442e9700 1 -- start start 2019-11-28T11:49:43.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7feb442e9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7feb3c162fd0 0x7feb3c1633c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:43.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7feb442e9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3c131340 con 0x7feb3c114ce0 2019-11-28T11:49:43.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7feb442e9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3c131840 con 0x7feb3c115170 2019-11-28T11:49:43.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7feb442e9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c1234c0 con 0x7feb3c162fd0 2019-11-28T11:49:43.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7feb42085700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7feb3c114ce0 0x7feb3c113b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41722/0 (socket says 172.21.15.80:41722) 2019-11-28T11:49:43.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7feb42085700 1 -- 172.21.15.80:0/2536085615 learned_addr learned my addr 172.21.15.80:0/2536085615 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:43.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7feb42886700 1 --2- 172.21.15.80:0/2536085615 >> v2:172.21.15.174:3300/0 conn(0x7feb3c162fd0 0x7feb3c1633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7feb3b7fe700 1 -- 172.21.15.80:0/2536085615 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426338739 0 0) 0x7feb3000dd90 con 0x7feb3c114ce0 2019-11-28T11:49:43.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7feb3b7fe700 1 -- 172.21.15.80:0/2536085615 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb1c002e80 con 0x7feb3c114ce0 2019-11-28T11:49:43.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7feb3b7fe700 1 -- 172.21.15.80:0/2536085615 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877740896 0 0) 0x7feb34007900 con 0x7feb3c115170 2019-11-28T11:49:43.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7feb3b7fe700 1 -- 172.21.15.80:0/2536085615 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb1c004170 con 0x7feb3c115170 2019-11-28T11:49:43.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7feb42886700 1 -- 172.21.15.80:0/2536085615 >> v1:172.21.15.174:6789/0 conn(0x7feb3c115170 legacy=0x7feb3c106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7feb42886700 1 -- 172.21.15.80:0/2536085615 >> v1:172.21.15.80:6789/0 conn(0x7feb3c114ce0 legacy=0x7feb3c113b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7feb42886700 1 -- 172.21.15.80:0/2536085615 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c1123c0 con 0x7feb3c162fd0 2019-11-28T11:49:43.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7feb42886700 1 --2- 172.21.15.80:0/2536085615 >> v2:172.21.15.174:3300/0 conn(0x7feb3c162fd0 0x7feb3c1633c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb2c0103a0 tx=0x7feb2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7feb42886700 1 --2- 172.21.15.80:0/2536085615 >> v2:172.21.15.174:3300/0 conn(0x7feb3c162fd0 0x7feb3c1633c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb2c0103a0 tx=0x7feb2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7feb42886700 1 --2- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb3c162fd0 0x7feb3c1633c0 secure :-1 s=READY pgs=1255 cs=0 l=1 rx=0x7feb2c0103a0 tx=0x7feb2c010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:43.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7feb42886700 1 --2- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb3c162fd0 0x7feb3c1633c0 secure :-1 s=THROTTLE_DONE pgs=1255 cs=0 l=1 rx=0x7feb2c0103a0 tx=0x7feb2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7feb3b7fe700 1 -- 172.21.15.80:0/2536085615 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb2c009960 con 0x7feb3c162fd0 2019-11-28T11:49:43.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7feb42886700 1 --2- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb3c162fd0 0x7feb3c1633c0 secure :-1 s=THROTTLE_DONE pgs=1255 cs=0 l=1 rx=0x7feb2c0103a0 tx=0x7feb2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7feb3b7fe700 1 -- 172.21.15.80:0/2536085615 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2c000a70 con 0x7feb3c162fd0 2019-11-28T11:49:43.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7feb442e9700 1 -- 172.21.15.80:0/2536085615 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb3c112740 con 0x7feb3c162fd0 2019-11-28T11:49:43.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7feb42886700 1 --2- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb3c162fd0 0x7feb3c1633c0 secure :-1 s=THROTTLE_DONE pgs=1255 cs=0 l=1 rx=0x7feb2c0103a0 tx=0x7feb2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7feb3b7fe700 1 -- 172.21.15.80:0/2536085615 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb2c009b20 con 0x7feb3c162fd0 2019-11-28T11:49:43.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7feb442e9700 1 -- 172.21.15.80:0/2536085615 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3c1123c0 con 0x7feb3c162fd0 2019-11-28T11:49:43.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7feb42886700 1 --2- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb3c162fd0 0x7feb3c1633c0 secure :-1 s=THROTTLE_DONE pgs=1255 cs=0 l=1 rx=0x7feb2c0103a0 tx=0x7feb2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7feb3b7fe700 1 -- 172.21.15.80:0/2536085615 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7feb2c009a20 con 0x7feb3c162fd0 2019-11-28T11:49:43.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7feb42886700 1 --2- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb3c162fd0 0x7feb3c1633c0 secure :-1 s=THROTTLE_DONE pgs=1255 cs=0 l=1 rx=0x7feb2c0103a0 tx=0x7feb2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7feb3b7fe700 1 --2- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb1c018770 0x7feb1c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:43.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7feb3b7fe700 1 -- 172.21.15.80:0/2536085615 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7feb2c031a90 con 0x7feb3c162fd0 2019-11-28T11:49:43.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7feb42085700 1 --2- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb1c018770 0x7feb1c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7feb42085700 1 --2- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb1c018770 0x7feb1c01abe0 crc :-1 s=READY pgs=858 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:43.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.357+0000 7feb442e9700 1 -- 172.21.15.80:0/2536085615 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3c112740 con 0x7feb3c162fd0 2019-11-28T11:49:43.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.361+0000 7feb42886700 1 --2- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb3c162fd0 0x7feb3c1633c0 secure :-1 s=THROTTLE_DONE pgs=1255 cs=0 l=1 rx=0x7feb2c0103a0 tx=0x7feb2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.361+0000 7feb3b7fe700 1 -- 172.21.15.80:0/2536085615 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7feb2c009810 con 0x7feb3c162fd0 2019-11-28T11:49:43.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.342+0000 7fa99fde7700 1 Processor -- start 2019-11-28T11:49:43.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.342+0000 7fa99fde7700 1 -- start start 2019-11-28T11:49:43.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7fa99fde7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa99806c0a0 0x7fa998072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:43.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7fa99fde7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa998072620 0x7fa998164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:43.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7fa99fde7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99806db00 con 0x7fa9980734e0 2019-11-28T11:49:43.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7fa99fde7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99806fd60 con 0x7fa99806c0a0 2019-11-28T11:49:43.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7fa99fde7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa998070030 con 0x7fa998072620 2019-11-28T11:49:43.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7fa99e384700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa99806c0a0 0x7fa998072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7fa99db83700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa9980734e0 0x7fa998071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41714/0 (socket says 172.21.15.80:41714) 2019-11-28T11:49:43.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7fa99db83700 1 -- 172.21.15.80:0/1504025484 learned_addr learned my addr 172.21.15.80:0/1504025484 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:43.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.343+0000 7fa99eb85700 1 --2- 172.21.15.80:0/1504025484 >> v2:172.21.15.174:3300/0 conn(0x7fa998072620 0x7fa998164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7fa99e384700 1 -- 172.21.15.80:0/1504025484 >> v2:172.21.15.174:3300/0 conn(0x7fa998072620 msgr2=0x7fa998164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:43.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7fa99e384700 1 --2- 172.21.15.80:0/1504025484 >> v2:172.21.15.174:3300/0 conn(0x7fa998072620 0x7fa998164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:43.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7fa99e384700 1 -- 172.21.15.80:0/1504025484 >> v1:172.21.15.80:6789/0 conn(0x7fa9980734e0 legacy=0x7fa998071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7fa99e384700 1 -- 172.21.15.80:0/1504025484 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9980706c0 con 0x7fa99806c0a0 2019-11-28T11:49:43.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7fa99d382700 1 -- 172.21.15.80:0/1504025484 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771121982 0 0) 0x7fa988001170 con 0x7fa9980734e0 2019-11-28T11:49:43.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7fa99e384700 1 --2- 172.21.15.80:0/1504025484 >> v2:172.21.15.80:3300/0 conn(0x7fa99806c0a0 0x7fa998072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa99400af50 tx=0x7fa99400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7fa99e384700 1 --2- 172.21.15.80:0/1504025484 >> v2:172.21.15.80:3300/0 conn(0x7fa99806c0a0 0x7fa998072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa99400af50 tx=0x7fa99400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7fa99e384700 1 --2- 172.21.15.80:0/1504025484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa99806c0a0 0x7fa998072fa0 secure :-1 s=READY pgs=2108 cs=0 l=1 rx=0x7fa99400af50 tx=0x7fa99400b6e0).ready entity=mon.0 client_cookie=d596bc3edfea12ca server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:43.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7fa99e384700 1 --2- 172.21.15.80:0/1504025484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa99806c0a0 0x7fa998072fa0 secure :-1 s=THROTTLE_DONE pgs=2108 cs=0 l=1 rx=0x7fa99400af50 tx=0x7fa99400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7fa99d382700 1 -- 172.21.15.80:0/1504025484 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa994007210 con 0x7fa99806c0a0 2019-11-28T11:49:43.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7fa99e384700 1 --2- 172.21.15.80:0/1504025484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa99806c0a0 0x7fa998072fa0 secure :-1 s=THROTTLE_DONE pgs=2108 cs=0 l=1 rx=0x7fa99400af50 tx=0x7fa99400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7fa99e384700 1 --2- 172.21.15.80:0/1504025484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa99806c0a0 0x7fa998072fa0 secure :-1 s=THROTTLE_DONE pgs=2108 cs=0 l=1 rx=0x7fa99400af50 tx=0x7fa99400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7fa99d382700 1 -- 172.21.15.80:0/1504025484 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9940099b0 con 0x7fa99806c0a0 2019-11-28T11:49:43.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7fa99d382700 1 -- 172.21.15.80:0/1504025484 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa994007210 con 0x7fa99806c0a0 2019-11-28T11:49:43.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7fa99fde7700 1 -- 172.21.15.80:0/1504025484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa99806c0a0 msgr2=0x7fa998072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.344+0000 7fa99fde7700 1 --2- 172.21.15.80:0/1504025484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa99806c0a0 0x7fa998072fa0 secure :-1 s=READY pgs=2108 cs=0 l=1 rx=0x7fa99400af50 tx=0x7fa99400b6e0).stop 2019-11-28T11:49:43.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7fa99fde7700 1 -- 172.21.15.80:0/1504025484 shutdown_connections 2019-11-28T11:49:43.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7fa99fde7700 1 --2- 172.21.15.80:0/1504025484 >> v2:172.21.15.174:3300/0 conn(0x7fa998072620 0x7fa998164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:43.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7fa99fde7700 1 --2- 172.21.15.80:0/1504025484 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa99806c0a0 0x7fa998072fa0 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:43.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7fa99fde7700 1 -- 172.21.15.80:0/1504025484 shutdown_connections 2019-11-28T11:49:43.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7fa99fde7700 1 -- 172.21.15.80:0/1504025484 wait complete. 2019-11-28T11:49:43.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.345+0000 7fa99fde7700 1 -- 172.21.15.80:0/1504025484 >> 172.21.15.80:0/1504025484 conn(0x7fa998061cf0 msgr2=0x7fa998064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:43.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7fa99fde7700 1 Processor -- start 2019-11-28T11:49:43.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.349+0000 7fa99fde7700 1 -- start start 2019-11-28T11:49:43.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7fa99fde7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9981096f0 0x7fa998169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:43.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7fa99fde7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9981066e0 con 0x7fa99813e9e0 2019-11-28T11:49:43.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7fa99fde7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99810ce40 con 0x7fa99813e5f0 2019-11-28T11:49:43.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7fa99fde7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99810e060 con 0x7fa9981096f0 2019-11-28T11:49:43.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7fa99e384700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa99813e5f0 0x7fa99810a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:57276/0 (socket says 172.21.15.80:57276) 2019-11-28T11:49:43.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7fa99e384700 1 -- 172.21.15.80:0/2444101686 learned_addr learned my addr 172.21.15.80:0/2444101686 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:43.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7fa99db83700 1 --1- 172.21.15.80:0/2444101686 >> v1:172.21.15.80:6789/0 conn(0x7fa99813e9e0 0x7fa998108ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41734/0 (socket says 172.21.15.80:41734) 2019-11-28T11:49:43.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.350+0000 7fa99eb85700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9981096f0 0x7fa998169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570112591 0 0) 0x7fa994009580 con 0x7fa99813e5f0 2019-11-28T11:49:43.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa980002e80 con 0x7fa99813e5f0 2019-11-28T11:49:43.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974530523 0 0) 0x7fa988001170 con 0x7fa99813e9e0 2019-11-28T11:49:43.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa980004170 con 0x7fa99813e9e0 2019-11-28T11:49:43.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 255923533 0 0) 0x7fa994009990 con 0x7fa99813e5f0 2019-11-28T11:49:43.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 --> v1:172.21.15.174:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa9800046e0 con 0x7fa99813e5f0 2019-11-28T11:49:43.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fa994009f60 con 0x7fa99813e5f0 2019-11-28T11:49:43.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9981096f0 msgr2=0x7fa998169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9981096f0 0x7fa998169ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:43.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 >> v1:172.21.15.174:6789/0 conn(0x7fa99813e5f0 legacy=0x7fa99810a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 >> v1:172.21.15.80:6789/0 conn(0x7fa99813e9e0 legacy=0x7fa998108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa980005ed0 0x7fa980002e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:43.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa980003350 0x7fa9800037e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:43.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9800046e0 0x7fa980004b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:43.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9800050c0 con 0x7fa9800046e0 2019-11-28T11:49:43.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9800052f0 con 0x7fa980003350 2019-11-28T11:49:43.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa980005520 con 0x7fa980005ed0 2019-11-28T11:49:43.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa99eb85700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9981096f0 0x7fa998169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:43.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa99e384700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa980005ed0 0x7fa980002e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa99db83700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa980003350 0x7fa9800037e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.351+0000 7fa99eb85700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9800046e0 0x7fa980004b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7fa99db83700 1 -- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa980005ed0 msgr2=0x7fa980002e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7fa99db83700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa980005ed0 0x7fa980002e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:43.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7fa99db83700 1 -- 172.21.15.80:0/2444101686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9800046e0 msgr2=0x7fa980004b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:43.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7fa99db83700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9800046e0 0x7fa980004b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:43.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7fa99db83700 1 -- 172.21.15.80:0/2444101686 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98000c5f0 con 0x7fa980003350 2019-11-28T11:49:43.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7fa99eb85700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9800046e0 0x7fa980004b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:43.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7fa99fde7700 1 -- 172.21.15.80:0/2444101686 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99810ed40 con 0x7fa980003350 2019-11-28T11:49:43.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7fa99e384700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa980005ed0 0x7fa980002e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:49:43.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7fa99db83700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa980003350 0x7fa9800037e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa988010390 tx=0x7fa988010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7fa99fde7700 1 -- 172.21.15.80:0/2444101686 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99810e9c0 con 0x7fa980003350 2019-11-28T11:49:43.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7fa99db83700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa980003350 0x7fa9800037e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa988010390 tx=0x7fa988010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7fa99db83700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa980003350 0x7fa9800037e0 secure :-1 s=READY pgs=1257 cs=0 l=1 rx=0x7fa988010390 tx=0x7fa988010730).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:43.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7fa99db83700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa980003350 0x7fa9800037e0 secure :-1 s=THROTTLE_DONE pgs=1257 cs=0 l=1 rx=0x7fa988010390 tx=0x7fa988010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7fa99db83700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa980003350 0x7fa9800037e0 secure :-1 s=THROTTLE_DONE pgs=1257 cs=0 l=1 rx=0x7fa988010390 tx=0x7fa988010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7fa99db83700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa980003350 0x7fa9800037e0 secure :-1 s=THROTTLE_DONE pgs=1257 cs=0 l=1 rx=0x7fa988010390 tx=0x7fa988010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.352+0000 7fa99db83700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa980003350 0x7fa9800037e0 secure :-1 s=THROTTLE_DONE pgs=1257 cs=0 l=1 rx=0x7fa988010390 tx=0x7fa988010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.353+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa988000c90 con 0x7fa980003350 2019-11-28T11:49:43.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.353+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa988004240 con 0x7fa980003350 2019-11-28T11:49:43.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.353+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9880048d0 con 0x7fa980003350 2019-11-28T11:49:43.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.353+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa988004b90 con 0x7fa980003350 2019-11-28T11:49:43.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.353+0000 7fa99db83700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa980003350 0x7fa9800037e0 secure :-1 s=THROTTLE_DONE pgs=1257 cs=0 l=1 rx=0x7fa988010390 tx=0x7fa988010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.353+0000 7fa98effd700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa980020b90 0x7fa980022fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:43.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.353+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa988031be0 con 0x7fa980003350 2019-11-28T11:49:43.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.353+0000 7fa99e384700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa980020b90 0x7fa980022fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:43.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.353+0000 7fa99e384700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa980020b90 0x7fa980022fe0 crc :-1 s=READY pgs=860 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:43.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.357+0000 7fa99fde7700 1 -- 172.21.15.80:0/2444101686 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa974002e60 con 0x7fa980003350 2019-11-28T11:49:43.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.364+0000 7fa99db83700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa980003350 0x7fa9800037e0 secure :-1 s=THROTTLE_DONE pgs=1257 cs=0 l=1 rx=0x7fa988010390 tx=0x7fa988010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:43.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.364+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa98800eaf0 con 0x7fa980003350 2019-11-28T11:49:43.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.548+0000 7f0b1389e700 1 -- 172.21.15.80:0/2327482955 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f0ae8001d10 con 0x7f0af4004960 2019-11-28T11:49:43.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.549+0000 7feb442e9700 1 -- 172.21.15.80:0/2536085615 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7feb3c1123c0 con 0x7feb3c162fd0 2019-11-28T11:49:43.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:43.549+0000 7fa99fde7700 1 -- 172.21.15.80:0/2444101686 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fa974001d10 con 0x7fa980003350 2019-11-28T11:49:44.275 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:49:44.228+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:49:44.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.238+0000 7f0b1263c700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0af4004960 0x7f0af4004e20 secure :-1 s=THROTTLE_DONE pgs=2113 cs=0 l=1 rx=0x7f0b04010740 tx=0x7f0b0400c110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:44.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.238+0000 7f0b027fc700 1 -- 172.21.15.80:0/2327482955 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 9442 v126) v1 ==== 95+0+0 (secure 0 0 0) 0x7f0b0400a330 con 0x7f0af4004960 2019-11-28T11:49:44.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.239+0000 7feb42886700 1 --2- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb3c162fd0 0x7feb3c1633c0 secure :-1 s=THROTTLE_DONE pgs=1255 cs=0 l=1 rx=0x7feb2c0103a0 tx=0x7feb2c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:44.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.239+0000 7feb3b7fe700 1 -- 172.21.15.80:0/2536085615 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 10086 v126) v1 ==== 96+0+0 (secure 0 0 0) 0x7feb2c009a20 con 0x7feb3c162fd0 2019-11-28T11:49:44.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.239+0000 7fa99db83700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa980003350 0x7fa9800037e0 secure :-1 s=THROTTLE_DONE pgs=1257 cs=0 l=1 rx=0x7fa988010390 tx=0x7fa988010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:44.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.239+0000 7fa98effd700 1 -- 172.21.15.80:0/2444101686 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 9448 v126) v1 ==== 95+0+0 (secure 0 0 0) 0x7fa98801be70 con 0x7fa980003350 2019-11-28T11:49:44.311 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 9442 2019-11-28T11:49:44.311 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 10086 2019-11-28T11:49:44.311 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 9448 2019-11-28T11:49:44.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.266+0000 7f0b1389e700 1 -- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0af4020be0 msgr2=0x7f0af4023010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:44.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.266+0000 7f0b1389e700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0af4020be0 0x7f0af4023010 crc :-1 s=READY pgs=859 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:44.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.266+0000 7f0b1389e700 1 -- 172.21.15.80:0/2327482955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0af4004960 msgr2=0x7f0af4004e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:44.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.266+0000 7f0b1389e700 1 --2- 172.21.15.80:0/2327482955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0af4004960 0x7f0af4004e20 secure :-1 s=READY pgs=2113 cs=0 l=1 rx=0x7f0b04010740 tx=0x7f0b0400c110).stop 2019-11-28T11:49:44.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.266+0000 7f0b1263c700 1 -- 172.21.15.80:0/2327482955 reap_dead start 2019-11-28T11:49:44.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.266+0000 7f0b1263c700 1 -- 172.21.15.80:0/2327482955 reap_dead start 2019-11-28T11:49:44.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7f0b1389e700 1 -- 172.21.15.80:0/2327482955 shutdown_connections 2019-11-28T11:49:44.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7f0b1389e700 1 -- 172.21.15.80:0/2327482955 shutdown_connections 2019-11-28T11:49:44.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7f0b1389e700 1 -- 172.21.15.80:0/2327482955 wait complete. 2019-11-28T11:49:44.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7f0b1389e700 1 -- 172.21.15.80:0/2327482955 >> 172.21.15.80:0/2327482955 conn(0x7f0b0c13f2b0 msgr2=0x7f0b0c140b60 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:44.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.266+0000 7feb442e9700 1 -- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb1c018770 msgr2=0x7feb1c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:44.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.266+0000 7feb442e9700 1 --2- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb1c018770 0x7feb1c01abe0 crc :-1 s=READY pgs=858 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.266+0000 7feb442e9700 1 -- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb3c162fd0 msgr2=0x7feb3c1633c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.266+0000 7feb442e9700 1 --2- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb3c162fd0 0x7feb3c1633c0 secure :-1 s=READY pgs=1255 cs=0 l=1 rx=0x7feb2c0103a0 tx=0x7feb2c010740).stop 2019-11-28T11:49:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7feb442e9700 1 -- 172.21.15.80:0/2536085615 shutdown_connections 2019-11-28T11:49:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7feb442e9700 1 --2- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb1c018770 0x7feb1c01abe0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7feb442e9700 1 --2- 172.21.15.80:0/2536085615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb3c162fd0 0x7feb3c1633c0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7feb442e9700 1 -- 172.21.15.80:0/2536085615 shutdown_connections 2019-11-28T11:49:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7feb442e9700 1 -- 172.21.15.80:0/2536085615 wait complete. 2019-11-28T11:49:44.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7feb442e9700 1 -- 172.21.15.80:0/2536085615 >> 172.21.15.80:0/2536085615 conn(0x7feb3c11bfc0 msgr2=0x7feb3c141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:44.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7fa99fde7700 1 -- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa980020b90 msgr2=0x7fa980022fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:44.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7fa99fde7700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa980020b90 0x7fa980022fe0 crc :-1 s=READY pgs=860 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7fa99fde7700 1 -- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa980003350 msgr2=0x7fa9800037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:44.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7fa99fde7700 1 --2- 172.21.15.80:0/2444101686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa980003350 0x7fa9800037e0 secure :-1 s=READY pgs=1257 cs=0 l=1 rx=0x7fa988010390 tx=0x7fa988010730).stop 2019-11-28T11:49:44.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7fa99eb85700 1 -- 172.21.15.80:0/2444101686 reap_dead start 2019-11-28T11:49:44.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7fa99fde7700 1 -- 172.21.15.80:0/2444101686 shutdown_connections 2019-11-28T11:49:44.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7fa99fde7700 1 -- 172.21.15.80:0/2444101686 shutdown_connections 2019-11-28T11:49:44.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7fa99fde7700 1 -- 172.21.15.80:0/2444101686 wait complete. 2019-11-28T11:49:44.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:44.267+0000 7fa99fde7700 1 -- 172.21.15.80:0/2444101686 >> 172.21.15.80:0/2444101686 conn(0x7fa99813d620 msgr2=0x7fa99813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:44.330 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:49:44.330 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:49:44.330 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:49:44.390 INFO:teuthology.orchestra.console:Performing hard reset of smithi076 2019-11-28T11:49:44.391 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power reset 2019-11-28T11:49:44.443 INFO:teuthology.orchestra.console:Hard reset for smithi076 completed 2019-11-28T11:49:49.559 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:49:49.559 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:49:49.560 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:49:49.560 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:49:49.561 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:49:49.561 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:49:49.565 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:49:49.566 DEBUG:teuthology.parallel:result is None 2019-11-28T11:49:49.567 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:49:49.567 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:49:49.567 DEBUG:teuthology.parallel:result is None 2019-11-28T11:49:49.567 DEBUG:teuthology.parallel:result is None 2019-11-28T11:49:49.568 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:49:49.650 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:49:49.663 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:49:49.663 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:49:49.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.650+0000 7fca25edb700 1 Processor -- start 2019-11-28T11:49:49.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.650+0000 7fca25edb700 1 -- start start 2019-11-28T11:49:49.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.651+0000 7fca25edb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca2006c490 0x7fca2006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:49.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.651+0000 7fca25edb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca2006ce60 0x7fca20164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:49.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.651+0000 7fca25edb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2006db00 con 0x7fca2006c0a0 2019-11-28T11:49:49.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.651+0000 7fca25edb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2006fd60 con 0x7fca2006c490 2019-11-28T11:49:49.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.651+0000 7fca25edb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca20070030 con 0x7fca2006ce60 2019-11-28T11:49:49.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.651+0000 7fca17fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca2006c490 0x7fca2006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:49.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.651+0000 7fca17fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca2006c490 0x7fca2006c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42466/0 (socket says 172.21.15.80:42466) 2019-11-28T11:49:49.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.651+0000 7fca17fff700 1 -- 172.21.15.80:0/3104467359 learned_addr learned my addr 172.21.15.80:0/3104467359 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:49.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.651+0000 7fca1ffff700 1 --1- 172.21.15.80:0/3104467359 >> v1:172.21.15.80:6789/0 conn(0x7fca2006c0a0 0x7fca20072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41780/0 (socket says 172.21.15.80:41780) 2019-11-28T11:49:49.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.651+0000 7fca24c79700 1 --2- 172.21.15.80:0/3104467359 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca2006ce60 0x7fca20164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:49.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.652+0000 7fca17fff700 1 -- 172.21.15.80:0/3104467359 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca2006ce60 msgr2=0x7fca20164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:49.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.652+0000 7fca17fff700 1 --2- 172.21.15.80:0/3104467359 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca2006ce60 0x7fca20164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:49.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.652+0000 7fca17fff700 1 -- 172.21.15.80:0/3104467359 >> v1:172.21.15.80:6789/0 conn(0x7fca2006c0a0 legacy=0x7fca20072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:49.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.652+0000 7fca1f7fe700 1 -- 172.21.15.80:0/3104467359 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042203252 0 0) 0x7fca10001100 con 0x7fca2006c0a0 2019-11-28T11:49:49.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.652+0000 7fca17fff700 1 -- 172.21.15.80:0/3104467359 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca200706c0 con 0x7fca2006c490 2019-11-28T11:49:49.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.652+0000 7fca17fff700 1 --2- 172.21.15.80:0/3104467359 >> v2:172.21.15.80:3300/0 conn(0x7fca2006c490 0x7fca2006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fca0800f6c0 tx=0x7fca0800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:49.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.652+0000 7fca17fff700 1 --2- 172.21.15.80:0/3104467359 >> v2:172.21.15.80:3300/0 conn(0x7fca2006c490 0x7fca2006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fca0800f6c0 tx=0x7fca0800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:49.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.652+0000 7fca17fff700 1 --2- 172.21.15.80:0/3104467359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2006c490 0x7fca2006c920 secure :-1 s=READY pgs=2119 cs=0 l=1 rx=0x7fca0800f6c0 tx=0x7fca0800fa60).ready entity=mon.0 client_cookie=bc39db8e0415ef4f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:49.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.652+0000 7fca17fff700 1 --2- 172.21.15.80:0/3104467359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2006c490 0x7fca2006c920 secure :-1 s=THROTTLE_DONE pgs=2119 cs=0 l=1 rx=0x7fca0800f6c0 tx=0x7fca0800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:49.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.652+0000 7fca1f7fe700 1 -- 172.21.15.80:0/3104467359 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca08000960 con 0x7fca2006c490 2019-11-28T11:49:49.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.652+0000 7fca17fff700 1 --2- 172.21.15.80:0/3104467359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2006c490 0x7fca2006c920 secure :-1 s=THROTTLE_DONE pgs=2119 cs=0 l=1 rx=0x7fca0800f6c0 tx=0x7fca0800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:49.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.652+0000 7fca17fff700 1 --2- 172.21.15.80:0/3104467359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2006c490 0x7fca2006c920 secure :-1 s=THROTTLE_DONE pgs=2119 cs=0 l=1 rx=0x7fca0800f6c0 tx=0x7fca0800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:49.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.652+0000 7fca1f7fe700 1 -- 172.21.15.80:0/3104467359 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca08000c90 con 0x7fca2006c490 2019-11-28T11:49:49.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.652+0000 7fca1f7fe700 1 -- 172.21.15.80:0/3104467359 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca080013a0 con 0x7fca2006c490 2019-11-28T11:49:49.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.652+0000 7fca25edb700 1 -- 172.21.15.80:0/3104467359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2006c490 msgr2=0x7fca2006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:49.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.652+0000 7fca25edb700 1 --2- 172.21.15.80:0/3104467359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2006c490 0x7fca2006c920 secure :-1 s=READY pgs=2119 cs=0 l=1 rx=0x7fca0800f6c0 tx=0x7fca0800fa60).stop 2019-11-28T11:49:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.653+0000 7fca25edb700 1 -- 172.21.15.80:0/3104467359 shutdown_connections 2019-11-28T11:49:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.653+0000 7fca25edb700 1 --2- 172.21.15.80:0/3104467359 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca2006ce60 0x7fca20164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.653+0000 7fca25edb700 1 --2- 172.21.15.80:0/3104467359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2006c490 0x7fca2006c920 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.653+0000 7fca25edb700 1 -- 172.21.15.80:0/3104467359 shutdown_connections 2019-11-28T11:49:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.653+0000 7fca25edb700 1 -- 172.21.15.80:0/3104467359 wait complete. 2019-11-28T11:49:49.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.653+0000 7fca25edb700 1 -- 172.21.15.80:0/3104467359 >> 172.21.15.80:0/3104467359 conn(0x7fca20061cf0 msgr2=0x7fca20064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:49.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.655+0000 7fca25edb700 1 Processor -- start 2019-11-28T11:49:49.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.655+0000 7fca25edb700 1 -- start start 2019-11-28T11:49:49.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.656+0000 7fca25edb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca2015fdf0 0x7fca2012b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:49.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.656+0000 7fca25edb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca2012b8a0 0x7fca2013e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:49.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.656+0000 7fca25edb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca20139e00 con 0x7fca2013e860 2019-11-28T11:49:49.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.656+0000 7fca25edb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca20107df0 con 0x7fca2012b8a0 2019-11-28T11:49:49.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.656+0000 7fca25edb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca20107890 con 0x7fca2015fdf0 2019-11-28T11:49:49.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.656+0000 7fca17fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fca2012b8a0 0x7fca2013e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:49.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.656+0000 7fca24c79700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fca2013e860 0x7fca2012a3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41790/0 (socket says 172.21.15.80:41790) 2019-11-28T11:49:49.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.656+0000 7fca24c79700 1 -- 172.21.15.80:0/3665924362 learned_addr learned my addr 172.21.15.80:0/3665924362 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:49.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.656+0000 7fca1ffff700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca2015fdf0 0x7fca2012b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:49.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.656+0000 7fca17fff700 1 -- 172.21.15.80:0/3665924362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca2015fdf0 msgr2=0x7fca2012b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:49.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.656+0000 7fca17fff700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca2015fdf0 0x7fca2012b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:49.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.656+0000 7fca17fff700 1 -- 172.21.15.80:0/3665924362 >> v1:172.21.15.80:6789/0 conn(0x7fca2013e860 legacy=0x7fca2012a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:49.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.656+0000 7fca1d7fa700 1 -- 172.21.15.80:0/3665924362 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549703164 0 0) 0x7fca18002500 con 0x7fca2013e860 2019-11-28T11:49:49.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.656+0000 7fca17fff700 1 -- 172.21.15.80:0/3665924362 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2010a8c0 con 0x7fca2012b8a0 2019-11-28T11:49:49.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.656+0000 7fca17fff700 1 --2- 172.21.15.80:0/3665924362 >> v2:172.21.15.80:3300/0 conn(0x7fca2012b8a0 0x7fca2013e320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca08010320 tx=0x7fca080106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:49.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.657+0000 7fca17fff700 1 --2- 172.21.15.80:0/3665924362 >> v2:172.21.15.80:3300/0 conn(0x7fca2012b8a0 0x7fca2013e320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca08010320 tx=0x7fca080106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:49.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.657+0000 7fca17fff700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2012b8a0 0x7fca2013e320 secure :-1 s=READY pgs=2121 cs=0 l=1 rx=0x7fca08010320 tx=0x7fca080106c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:49.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.657+0000 7fca17fff700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2012b8a0 0x7fca2013e320 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7fca08010320 tx=0x7fca080106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:49.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.657+0000 7fca1d7fa700 1 -- 172.21.15.80:0/3665924362 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca080078e0 con 0x7fca2012b8a0 2019-11-28T11:49:49.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.657+0000 7fca17fff700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2012b8a0 0x7fca2013e320 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7fca08010320 tx=0x7fca080106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:49.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.657+0000 7fca17fff700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2012b8a0 0x7fca2013e320 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7fca08010320 tx=0x7fca080106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:49.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.657+0000 7fca1d7fa700 1 -- 172.21.15.80:0/3665924362 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca08001050 con 0x7fca2012b8a0 2019-11-28T11:49:49.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.657+0000 7fca25edb700 1 -- 172.21.15.80:0/3665924362 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2010a8c0 con 0x7fca2012b8a0 2019-11-28T11:49:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.657+0000 7fca1d7fa700 1 -- 172.21.15.80:0/3665924362 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca080016a0 con 0x7fca2012b8a0 2019-11-28T11:49:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.657+0000 7fca25edb700 1 -- 172.21.15.80:0/3665924362 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2010a8c0 con 0x7fca2012b8a0 2019-11-28T11:49:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.657+0000 7fca17fff700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2012b8a0 0x7fca2013e320 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7fca08010320 tx=0x7fca080106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.657+0000 7fca1d7fa700 1 -- 172.21.15.80:0/3665924362 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fca08007810 con 0x7fca2012b8a0 2019-11-28T11:49:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.657+0000 7fca17fff700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2012b8a0 0x7fca2013e320 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7fca08010320 tx=0x7fca080106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:49.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.657+0000 7fca1d7fa700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca04018730 0x7fca0401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:49.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.657+0000 7fca1d7fa700 1 -- 172.21.15.80:0/3665924362 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fca080319f0 con 0x7fca2012b8a0 2019-11-28T11:49:49.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.658+0000 7fca1ffff700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca04018730 0x7fca0401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:49.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.658+0000 7fca1ffff700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca04018730 0x7fca0401abc0 crc :-1 s=READY pgs=861 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:49.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.665+0000 7fca25edb700 1 -- 172.21.15.80:0/3665924362 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca20109180 con 0x7fca2012b8a0 2019-11-28T11:49:49.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.669+0000 7fca17fff700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2012b8a0 0x7fca2013e320 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7fca08010320 tx=0x7fca080106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:49.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.669+0000 7fca1d7fa700 1 -- 172.21.15.80:0/3665924362 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fca0802cf70 con 0x7fca2012b8a0 2019-11-28T11:49:49.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.840+0000 7fca25edb700 1 -- 172.21.15.80:0/3665924362 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca20109500 con 0x7fca2012b8a0 2019-11-28T11:49:49.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.840+0000 7fca17fff700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2012b8a0 0x7fca2013e320 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7fca08010320 tx=0x7fca080106c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:49.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.840+0000 7fca1d7fa700 1 -- 172.21.15.80:0/3665924362 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+1432 (secure 0 0 0) 0x7fca0802cf70 con 0x7fca2012b8a0 2019-11-28T11:49:49.890 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 126 2019-11-28T11:49:49.891 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:49.891 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":126,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":126,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:49:44.228881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:49:49.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.843+0000 7fca25edb700 1 -- 172.21.15.80:0/3665924362 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca04018730 msgr2=0x7fca0401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:49.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.843+0000 7fca25edb700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca04018730 0x7fca0401abc0 crc :-1 s=READY pgs=861 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:49.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.843+0000 7fca25edb700 1 -- 172.21.15.80:0/3665924362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2012b8a0 msgr2=0x7fca2013e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:49.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.843+0000 7fca25edb700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2012b8a0 0x7fca2013e320 secure :-1 s=READY pgs=2121 cs=0 l=1 rx=0x7fca08010320 tx=0x7fca080106c0).stop 2019-11-28T11:49:49.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.843+0000 7fca25edb700 1 -- 172.21.15.80:0/3665924362 shutdown_connections 2019-11-28T11:49:49.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.843+0000 7fca25edb700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fca04018730 0x7fca0401abc0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:49.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.843+0000 7fca25edb700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca2012b8a0 0x7fca2013e320 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:49.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.843+0000 7fca25edb700 1 --2- 172.21.15.80:0/3665924362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca2015fdf0 0x7fca2012b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:49.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.843+0000 7fca25edb700 1 -- 172.21.15.80:0/3665924362 shutdown_connections 2019-11-28T11:49:49.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.843+0000 7fca25edb700 1 -- 172.21.15.80:0/3665924362 wait complete. 2019-11-28T11:49:49.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:49.843+0000 7fca25edb700 1 -- 172.21.15.80:0/3665924362 >> 172.21.15.80:0/3665924362 conn(0x7fca20127dc0 msgr2=0x7fca20141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:49.901 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T11:49:50.902 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:49:51.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.981+0000 7fdfc689c700 1 Processor -- start 2019-11-28T11:49:51.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.981+0000 7fdfc689c700 1 -- start start 2019-11-28T11:49:51.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.982+0000 7fdfc689c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdfc006c0a0 0x7fdfc0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:51.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.982+0000 7fdfc689c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdfc00734e0 0x7fdfc0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:51.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.982+0000 7fdfc689c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc006db00 con 0x7fdfc0072360 2019-11-28T11:49:51.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.982+0000 7fdfc689c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc006fd60 con 0x7fdfc006c0a0 2019-11-28T11:49:51.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.982+0000 7fdfc689c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0070030 con 0x7fdfc00734e0 2019-11-28T11:49:51.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.982+0000 7fdfc4e39700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdfc006c0a0 0x7fdfc0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:51.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.982+0000 7fdfc4e39700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdfc006c0a0 0x7fdfc0072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42478/0 (socket says 172.21.15.80:42478) 2019-11-28T11:49:51.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.982+0000 7fdfc4e39700 1 -- 172.21.15.80:0/3930083168 learned_addr learned my addr 172.21.15.80:0/3930083168 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:51.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.982+0000 7fdfbffff700 1 --2- 172.21.15.80:0/3930083168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdfc00734e0 0x7fdfc0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:51.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.983+0000 7fdfc4e39700 1 -- 172.21.15.80:0/3930083168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdfc00734e0 msgr2=0x7fdfc0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:51.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.983+0000 7fdfc4e39700 1 --2- 172.21.15.80:0/3930083168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdfc00734e0 0x7fdfc0071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:51.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.983+0000 7fdfc4e39700 1 -- 172.21.15.80:0/3930083168 >> v1:172.21.15.174:6789/0 conn(0x7fdfc0072360 legacy=0x7fdfc006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:51.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.983+0000 7fdfc4e39700 1 -- 172.21.15.80:0/3930083168 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc00706c0 con 0x7fdfc006c0a0 2019-11-28T11:49:51.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.983+0000 7fdfc4e39700 1 --2- 172.21.15.80:0/3930083168 >> v2:172.21.15.80:3300/0 conn(0x7fdfc006c0a0 0x7fdfc0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdfa800f6c0 tx=0x7fdfa800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:51.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.983+0000 7fdfc4e39700 1 --2- 172.21.15.80:0/3930083168 >> v2:172.21.15.80:3300/0 conn(0x7fdfc006c0a0 0x7fdfc0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdfa800f6c0 tx=0x7fdfa800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:51.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.983+0000 7fdfc4e39700 1 --2- 172.21.15.80:0/3930083168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc006c0a0 0x7fdfc0072fa0 secure :-1 s=READY pgs=2122 cs=0 l=1 rx=0x7fdfa800f6c0 tx=0x7fdfa800fa60).ready entity=mon.0 client_cookie=616705d2dfc41280 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:51.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.983+0000 7fdfc4e39700 1 --2- 172.21.15.80:0/3930083168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc006c0a0 0x7fdfc0072fa0 secure :-1 s=THROTTLE_DONE pgs=2122 cs=0 l=1 rx=0x7fdfa800f6c0 tx=0x7fdfa800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:51.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.983+0000 7fdfc4e39700 1 --2- 172.21.15.80:0/3930083168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc006c0a0 0x7fdfc0072fa0 secure :-1 s=THROTTLE_DONE pgs=2122 cs=0 l=1 rx=0x7fdfa800f6c0 tx=0x7fdfa800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:51.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.983+0000 7fdfc4e39700 1 --2- 172.21.15.80:0/3930083168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc006c0a0 0x7fdfc0072fa0 secure :-1 s=THROTTLE_DONE pgs=2122 cs=0 l=1 rx=0x7fdfa800f6c0 tx=0x7fdfa800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:51.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.983+0000 7fdfbf7fe700 1 -- 172.21.15.80:0/3930083168 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa8000960 con 0x7fdfc006c0a0 2019-11-28T11:49:51.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.983+0000 7fdfbf7fe700 1 -- 172.21.15.80:0/3930083168 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa8000c90 con 0x7fdfc006c0a0 2019-11-28T11:49:51.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.983+0000 7fdfbf7fe700 1 -- 172.21.15.80:0/3930083168 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa80013a0 con 0x7fdfc006c0a0 2019-11-28T11:49:51.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.983+0000 7fdfc689c700 1 -- 172.21.15.80:0/3930083168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc006c0a0 msgr2=0x7fdfc0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:51.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.983+0000 7fdfc689c700 1 --2- 172.21.15.80:0/3930083168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc006c0a0 0x7fdfc0072fa0 secure :-1 s=READY pgs=2122 cs=0 l=1 rx=0x7fdfa800f6c0 tx=0x7fdfa800fa60).stop 2019-11-28T11:49:51.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.984+0000 7fdfc689c700 1 -- 172.21.15.80:0/3930083168 shutdown_connections 2019-11-28T11:49:51.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.984+0000 7fdfc689c700 1 --2- 172.21.15.80:0/3930083168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdfc00734e0 0x7fdfc0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:51.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.984+0000 7fdfc689c700 1 --2- 172.21.15.80:0/3930083168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc006c0a0 0x7fdfc0072fa0 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:51.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.984+0000 7fdfc689c700 1 -- 172.21.15.80:0/3930083168 shutdown_connections 2019-11-28T11:49:51.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.984+0000 7fdfc689c700 1 -- 172.21.15.80:0/3930083168 wait complete. 2019-11-28T11:49:51.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.984+0000 7fdfc689c700 1 -- 172.21.15.80:0/3930083168 >> 172.21.15.80:0/3930083168 conn(0x7fdfc0061cf0 msgr2=0x7fdfc0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:51.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.986+0000 7fdfc689c700 1 Processor -- start 2019-11-28T11:49:51.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.986+0000 7fdfc689c700 1 -- start start 2019-11-28T11:49:51.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.987+0000 7fdfc689c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdfc0103000 0x7fdfc0103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:51.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.987+0000 7fdfc689c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdfc01039d0 0x7fdfc0167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:51.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.987+0000 7fdfc689c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc01312c0 con 0x7fdfc013dc00 2019-11-28T11:49:51.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.987+0000 7fdfc689c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc0105830 con 0x7fdfc0103000 2019-11-28T11:49:51.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.987+0000 7fdfc689c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc0105b00 con 0x7fdfc01039d0 2019-11-28T11:49:51.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.987+0000 7fdfbffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdfc0103000 0x7fdfc0103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:51.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.987+0000 7fdfbffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdfc0103000 0x7fdfc0103490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42484/0 (socket says 172.21.15.80:42484) 2019-11-28T11:49:51.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.987+0000 7fdfbffff700 1 -- 172.21.15.80:0/2883325438 learned_addr learned my addr 172.21.15.80:0/2883325438 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:51.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.987+0000 7fdfc563a700 1 --2- 172.21.15.80:0/2883325438 >> v2:172.21.15.174:3300/0 conn(0x7fdfc01039d0 0x7fdfc0167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:51.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.987+0000 7fdfbffff700 1 -- 172.21.15.80:0/2883325438 >> v2:172.21.15.174:3300/0 conn(0x7fdfc01039d0 msgr2=0x7fdfc0167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:51.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.987+0000 7fdfbffff700 1 --2- 172.21.15.80:0/2883325438 >> v2:172.21.15.174:3300/0 conn(0x7fdfc01039d0 0x7fdfc0167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:51.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.987+0000 7fdfbd7fa700 1 -- 172.21.15.80:0/2883325438 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450579072 0 0) 0x7fdfa80075d0 con 0x7fdfc013dc00 2019-11-28T11:49:51.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.987+0000 7fdfbffff700 1 -- 172.21.15.80:0/2883325438 >> v1:172.21.15.174:6789/0 conn(0x7fdfc013dc00 legacy=0x7fdfc0109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:51.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.987+0000 7fdfbffff700 1 -- 172.21.15.80:0/2883325438 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc0106190 con 0x7fdfc0103000 2019-11-28T11:49:51.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.988+0000 7fdfbffff700 1 --2- 172.21.15.80:0/2883325438 >> v2:172.21.15.80:3300/0 conn(0x7fdfc0103000 0x7fdfc0103490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdfb0010450 tx=0x7fdfb0010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:51.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.988+0000 7fdfbffff700 1 --2- 172.21.15.80:0/2883325438 >> v2:172.21.15.80:3300/0 conn(0x7fdfc0103000 0x7fdfc0103490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdfb0010450 tx=0x7fdfb0010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:51.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.988+0000 7fdfbffff700 1 --2- 172.21.15.80:0/2883325438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc0103000 0x7fdfc0103490 secure :-1 s=READY pgs=2123 cs=0 l=1 rx=0x7fdfb0010450 tx=0x7fdfb0010250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:51.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.988+0000 7fdfbffff700 1 --2- 172.21.15.80:0/2883325438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc0103000 0x7fdfc0103490 secure :-1 s=THROTTLE_DONE pgs=2123 cs=0 l=1 rx=0x7fdfb0010450 tx=0x7fdfb0010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:51.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.988+0000 7fdfbd7fa700 1 -- 172.21.15.80:0/2883325438 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb0005770 con 0x7fdfc0103000 2019-11-28T11:49:51.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.988+0000 7fdfbffff700 1 --2- 172.21.15.80:0/2883325438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc0103000 0x7fdfc0103490 secure :-1 s=THROTTLE_DONE pgs=2123 cs=0 l=1 rx=0x7fdfb0010450 tx=0x7fdfb0010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:51.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.988+0000 7fdfbd7fa700 1 -- 172.21.15.80:0/2883325438 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb0005390 con 0x7fdfc0103000 2019-11-28T11:49:51.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.988+0000 7fdfbffff700 1 --2- 172.21.15.80:0/2883325438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc0103000 0x7fdfc0103490 secure :-1 s=THROTTLE_DONE pgs=2123 cs=0 l=1 rx=0x7fdfb0010450 tx=0x7fdfb0010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:51.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.988+0000 7fdfc689c700 1 -- 172.21.15.80:0/2883325438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc0106510 con 0x7fdfc0103000 2019-11-28T11:49:51.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.988+0000 7fdfbd7fa700 1 -- 172.21.15.80:0/2883325438 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb0005960 con 0x7fdfc0103000 2019-11-28T11:49:51.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.988+0000 7fdfc689c700 1 -- 172.21.15.80:0/2883325438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc0106190 con 0x7fdfc0103000 2019-11-28T11:49:51.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.988+0000 7fdfbffff700 1 --2- 172.21.15.80:0/2883325438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc0103000 0x7fdfc0103490 secure :-1 s=THROTTLE_DONE pgs=2123 cs=0 l=1 rx=0x7fdfb0010450 tx=0x7fdfb0010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:51.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.989+0000 7fdfbd7fa700 1 -- 172.21.15.80:0/2883325438 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fdfb0005580 con 0x7fdfc0103000 2019-11-28T11:49:51.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.989+0000 7fdfbffff700 1 --2- 172.21.15.80:0/2883325438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc0103000 0x7fdfc0103490 secure :-1 s=THROTTLE_DONE pgs=2123 cs=0 l=1 rx=0x7fdfb0010450 tx=0x7fdfb0010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:51.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.989+0000 7fdfbd7fa700 1 --2- 172.21.15.80:0/2883325438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdfa4018730 0x7fdfa401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:51.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.989+0000 7fdfbd7fa700 1 -- 172.21.15.80:0/2883325438 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fdfb0031cb0 con 0x7fdfc0103000 2019-11-28T11:49:51.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.989+0000 7fdfc4e39700 1 --2- 172.21.15.80:0/2883325438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdfa4018730 0x7fdfa401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:51.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.989+0000 7fdfc4e39700 1 --2- 172.21.15.80:0/2883325438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdfa4018730 0x7fdfa401abc0 crc :-1 s=READY pgs=862 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:51.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:50.997+0000 7fdfc689c700 1 -- 172.21.15.80:0/2883325438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc0106510 con 0x7fdfc0103000 2019-11-28T11:49:51.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:51.000+0000 7fdfbffff700 1 --2- 172.21.15.80:0/2883325438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc0103000 0x7fdfc0103490 secure :-1 s=THROTTLE_DONE pgs=2123 cs=0 l=1 rx=0x7fdfb0010450 tx=0x7fdfb0010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:51.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:51.000+0000 7fdfbd7fa700 1 -- 172.21.15.80:0/2883325438 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fdfb0005180 con 0x7fdfc0103000 2019-11-28T11:49:51.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:51.175+0000 7fdfc689c700 1 -- 172.21.15.80:0/2883325438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfc0106190 con 0x7fdfc0103000 2019-11-28T11:49:51.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:51.175+0000 7fdfbffff700 1 --2- 172.21.15.80:0/2883325438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc0103000 0x7fdfc0103490 secure :-1 s=THROTTLE_DONE pgs=2123 cs=0 l=1 rx=0x7fdfb0010450 tx=0x7fdfb0010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:51.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:51.175+0000 7fdfbd7fa700 1 -- 172.21.15.80:0/2883325438 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+1432 (secure 0 0 0) 0x7fdfb0017bb0 con 0x7fdfc0103000 2019-11-28T11:49:51.225 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 126 2019-11-28T11:49:51.225 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:51.225 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":126,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":126,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:49:44.228881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:49:51.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:51.177+0000 7fdfc689c700 1 -- 172.21.15.80:0/2883325438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdfa4018730 msgr2=0x7fdfa401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:51.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:51.177+0000 7fdfc689c700 1 --2- 172.21.15.80:0/2883325438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdfa4018730 0x7fdfa401abc0 crc :-1 s=READY pgs=862 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:51.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:51.177+0000 7fdfc689c700 1 -- 172.21.15.80:0/2883325438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc0103000 msgr2=0x7fdfc0103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:51.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:51.177+0000 7fdfc689c700 1 --2- 172.21.15.80:0/2883325438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc0103000 0x7fdfc0103490 secure :-1 s=READY pgs=2123 cs=0 l=1 rx=0x7fdfb0010450 tx=0x7fdfb0010250).stop 2019-11-28T11:49:51.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:51.178+0000 7fdfc689c700 1 -- 172.21.15.80:0/2883325438 shutdown_connections 2019-11-28T11:49:51.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:51.178+0000 7fdfc689c700 1 --2- 172.21.15.80:0/2883325438 >> v2:172.21.15.174:3300/0 conn(0x7fdfc01039d0 0x7fdfc0167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:51.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:51.178+0000 7fdfc689c700 1 --2- 172.21.15.80:0/2883325438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdfc0103000 0x7fdfc0103490 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:51.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:51.178+0000 7fdfc689c700 1 --2- 172.21.15.80:0/2883325438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdfa4018730 0x7fdfa401abc0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:51.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:51.178+0000 7fdfc689c700 1 -- 172.21.15.80:0/2883325438 shutdown_connections 2019-11-28T11:49:51.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:51.178+0000 7fdfc689c700 1 -- 172.21.15.80:0/2883325438 wait complete. 2019-11-28T11:49:51.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:51.178+0000 7fdfc689c700 1 -- 172.21.15.80:0/2883325438 >> 172.21.15.80:0/2883325438 conn(0x7fdfc011bfc0 msgr2=0x7fdfc0141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:51.236 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T11:49:52.239 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:49:52.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.310+0000 7f57966d8700 1 Processor -- start 2019-11-28T11:49:52.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.310+0000 7f57966d8700 1 -- start start 2019-11-28T11:49:52.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.311+0000 7f57966d8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579006c490 0x7f579006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:52.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.311+0000 7f57966d8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f579006ce60 0x7f5790164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:52.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.311+0000 7f57966d8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579006db00 con 0x7f579006c0a0 2019-11-28T11:49:52.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.311+0000 7f57966d8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579006fd60 con 0x7f579006ce60 2019-11-28T11:49:52.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.311+0000 7f57966d8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5790070030 con 0x7f579006c490 2019-11-28T11:49:52.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.311+0000 7f5795476700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f579006ce60 0x7f5790164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:52.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.311+0000 7f5795476700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f579006ce60 0x7f5790164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42492/0 (socket says 172.21.15.80:42492) 2019-11-28T11:49:52.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.311+0000 7f5795476700 1 -- 172.21.15.80:0/1289406978 learned_addr learned my addr 172.21.15.80:0/1289406978 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:52.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.311+0000 7f578ffff700 1 --2- 172.21.15.80:0/1289406978 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579006c490 0x7f579006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:52.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.311+0000 7f5795476700 1 -- 172.21.15.80:0/1289406978 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579006c490 msgr2=0x7f579006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:52.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.312+0000 7f5795476700 1 --2- 172.21.15.80:0/1289406978 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579006c490 0x7f579006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:52.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.312+0000 7f5795476700 1 -- 172.21.15.80:0/1289406978 >> v1:172.21.15.174:6789/0 conn(0x7f579006c0a0 legacy=0x7f5790072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:52.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.312+0000 7f5795476700 1 -- 172.21.15.80:0/1289406978 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57900706c0 con 0x7f579006ce60 2019-11-28T11:49:52.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.312+0000 7f578ffff700 1 --2- 172.21.15.80:0/1289406978 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579006c490 0x7f579006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:49:52.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.312+0000 7f5795476700 1 --2- 172.21.15.80:0/1289406978 >> v2:172.21.15.80:3300/0 conn(0x7f579006ce60 0x7f5790164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f578800fab0 tx=0x7f578800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:52.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.312+0000 7f5795476700 1 --2- 172.21.15.80:0/1289406978 >> v2:172.21.15.80:3300/0 conn(0x7f579006ce60 0x7f5790164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f578800fab0 tx=0x7f578800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:52.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.312+0000 7f5795476700 1 --2- 172.21.15.80:0/1289406978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579006ce60 0x7f5790164d70 secure :-1 s=READY pgs=2124 cs=0 l=1 rx=0x7f578800fab0 tx=0x7f578800fe50).ready entity=mon.0 client_cookie=a946b8001e9bead3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:52.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.312+0000 7f5795476700 1 --2- 172.21.15.80:0/1289406978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579006ce60 0x7f5790164d70 secure :-1 s=THROTTLE_DONE pgs=2124 cs=0 l=1 rx=0x7f578800fab0 tx=0x7f578800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:52.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.312+0000 7f5795476700 1 --2- 172.21.15.80:0/1289406978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579006ce60 0x7f5790164d70 secure :-1 s=THROTTLE_DONE pgs=2124 cs=0 l=1 rx=0x7f578800fab0 tx=0x7f578800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:52.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.312+0000 7f5795476700 1 --2- 172.21.15.80:0/1289406978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579006ce60 0x7f5790164d70 secure :-1 s=THROTTLE_DONE pgs=2124 cs=0 l=1 rx=0x7f578800fab0 tx=0x7f578800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:52.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.312+0000 7f578f7fe700 1 -- 172.21.15.80:0/1289406978 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5788000f10 con 0x7f579006ce60 2019-11-28T11:49:52.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.312+0000 7f578f7fe700 1 -- 172.21.15.80:0/1289406978 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5788001460 con 0x7f579006ce60 2019-11-28T11:49:52.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.312+0000 7f578f7fe700 1 -- 172.21.15.80:0/1289406978 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5788001bb0 con 0x7f579006ce60 2019-11-28T11:49:52.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.312+0000 7f57966d8700 1 -- 172.21.15.80:0/1289406978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579006ce60 msgr2=0x7f5790164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:52.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.312+0000 7f57966d8700 1 --2- 172.21.15.80:0/1289406978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579006ce60 0x7f5790164d70 secure :-1 s=READY pgs=2124 cs=0 l=1 rx=0x7f578800fab0 tx=0x7f578800fe50).stop 2019-11-28T11:49:52.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.313+0000 7f57966d8700 1 -- 172.21.15.80:0/1289406978 shutdown_connections 2019-11-28T11:49:52.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.313+0000 7f57966d8700 1 --2- 172.21.15.80:0/1289406978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579006ce60 0x7f5790164d70 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:52.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.313+0000 7f57966d8700 1 --2- 172.21.15.80:0/1289406978 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f579006c490 0x7f579006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:52.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.313+0000 7f57966d8700 1 -- 172.21.15.80:0/1289406978 shutdown_connections 2019-11-28T11:49:52.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.313+0000 7f57966d8700 1 -- 172.21.15.80:0/1289406978 wait complete. 2019-11-28T11:49:52.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.313+0000 7f57966d8700 1 -- 172.21.15.80:0/1289406978 >> 172.21.15.80:0/1289406978 conn(0x7f5790061cf0 msgr2=0x7f5790064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:52.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.315+0000 7f57966d8700 1 Processor -- start 2019-11-28T11:49:52.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.315+0000 7f57966d8700 1 -- start start 2019-11-28T11:49:52.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.316+0000 7f57966d8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f579013e320 0x7f579013e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:52.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.316+0000 7f57966d8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f579012a3c0 0x7f579012a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:52.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.316+0000 7f57966d8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5790139e00 con 0x7f579015fdf0 2019-11-28T11:49:52.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.316+0000 7f57966d8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5790108820 con 0x7f579013e320 2019-11-28T11:49:52.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.316+0000 7f57966d8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5790108af0 con 0x7f579012a3c0 2019-11-28T11:49:52.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.316+0000 7f5794c75700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f579015fdf0 0x7f579012b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41812/0 (socket says 172.21.15.80:41812) 2019-11-28T11:49:52.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.316+0000 7f5794c75700 1 -- 172.21.15.80:0/2639998144 learned_addr learned my addr 172.21.15.80:0/2639998144 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:52.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.316+0000 7f578ffff700 1 --2- 172.21.15.80:0/2639998144 >> v2:172.21.15.80:3300/0 conn(0x7f579013e320 0x7f579013e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:52.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.316+0000 7f5795476700 1 --2- 172.21.15.80:0/2639998144 >> v2:172.21.15.174:3300/0 conn(0x7f579012a3c0 0x7f579012a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:52.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.316+0000 7f578ffff700 1 -- 172.21.15.80:0/2639998144 >> v2:172.21.15.174:3300/0 conn(0x7f579012a3c0 msgr2=0x7f579012a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:52.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.316+0000 7f578ffff700 1 --2- 172.21.15.80:0/2639998144 >> v2:172.21.15.174:3300/0 conn(0x7f579012a3c0 0x7f579012a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:52.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.316+0000 7f578ffff700 1 -- 172.21.15.80:0/2639998144 >> v1:172.21.15.80:6789/0 conn(0x7f579015fdf0 legacy=0x7f579012b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:52.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.316+0000 7f578ffff700 1 -- 172.21.15.80:0/2639998144 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579010a8c0 con 0x7f579013e320 2019-11-28T11:49:52.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.316+0000 7f578d7fa700 1 -- 172.21.15.80:0/2639998144 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853352297 0 0) 0x7f5780001150 con 0x7f579015fdf0 2019-11-28T11:49:52.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.316+0000 7f578ffff700 1 --2- 172.21.15.80:0/2639998144 >> v2:172.21.15.80:3300/0 conn(0x7f579013e320 0x7f579013e7b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5784010310 tx=0x7f57840106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:52.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.317+0000 7f578ffff700 1 --2- 172.21.15.80:0/2639998144 >> v2:172.21.15.80:3300/0 conn(0x7f579013e320 0x7f579013e7b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5784010310 tx=0x7f57840106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:52.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.317+0000 7f578ffff700 1 --2- 172.21.15.80:0/2639998144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579013e320 0x7f579013e7b0 secure :-1 s=READY pgs=2126 cs=0 l=1 rx=0x7f5784010310 tx=0x7f57840106b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:52.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.317+0000 7f578ffff700 1 --2- 172.21.15.80:0/2639998144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579013e320 0x7f579013e7b0 secure :-1 s=THROTTLE_DONE pgs=2126 cs=0 l=1 rx=0x7f5784010310 tx=0x7f57840106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:52.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.317+0000 7f578d7fa700 1 -- 172.21.15.80:0/2639998144 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5784000bc0 con 0x7f579013e320 2019-11-28T11:49:52.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.317+0000 7f578ffff700 1 --2- 172.21.15.80:0/2639998144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579013e320 0x7f579013e7b0 secure :-1 s=THROTTLE_DONE pgs=2126 cs=0 l=1 rx=0x7f5784010310 tx=0x7f57840106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:52.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.317+0000 7f578ffff700 1 --2- 172.21.15.80:0/2639998144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579013e320 0x7f579013e7b0 secure :-1 s=THROTTLE_DONE pgs=2126 cs=0 l=1 rx=0x7f5784010310 tx=0x7f57840106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:52.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.317+0000 7f578d7fa700 1 -- 172.21.15.80:0/2639998144 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5784009590 con 0x7f579013e320 2019-11-28T11:49:52.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.317+0000 7f57966d8700 1 -- 172.21.15.80:0/2639998144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579010a8c0 con 0x7f579013e320 2019-11-28T11:49:52.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.317+0000 7f578d7fa700 1 -- 172.21.15.80:0/2639998144 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57840011a0 con 0x7f579013e320 2019-11-28T11:49:52.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.317+0000 7f57966d8700 1 -- 172.21.15.80:0/2639998144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579010a8c0 con 0x7f579013e320 2019-11-28T11:49:52.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.317+0000 7f578ffff700 1 --2- 172.21.15.80:0/2639998144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579013e320 0x7f579013e7b0 secure :-1 s=THROTTLE_DONE pgs=2126 cs=0 l=1 rx=0x7f5784010310 tx=0x7f57840106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:52.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.317+0000 7f578d7fa700 1 -- 172.21.15.80:0/2639998144 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5784000bc0 con 0x7f579013e320 2019-11-28T11:49:52.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.318+0000 7f578ffff700 1 --2- 172.21.15.80:0/2639998144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579013e320 0x7f579013e7b0 secure :-1 s=THROTTLE_DONE pgs=2126 cs=0 l=1 rx=0x7f5784010310 tx=0x7f57840106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:52.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.318+0000 7f578d7fa700 1 --2- 172.21.15.80:0/2639998144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5770018730 0x7f577001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:52.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.318+0000 7f578d7fa700 1 -- 172.21.15.80:0/2639998144 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f5784031960 con 0x7f579013e320 2019-11-28T11:49:52.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.318+0000 7f5794c75700 1 --2- 172.21.15.80:0/2639998144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5770018730 0x7f577001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:52.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.318+0000 7f5794c75700 1 --2- 172.21.15.80:0/2639998144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5770018730 0x7f577001abc0 crc :-1 s=READY pgs=863 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:52.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.325+0000 7f57966d8700 1 -- 172.21.15.80:0/2639998144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5790109180 con 0x7f579013e320 2019-11-28T11:49:52.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.329+0000 7f578ffff700 1 --2- 172.21.15.80:0/2639998144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579013e320 0x7f579013e7b0 secure :-1 s=THROTTLE_DONE pgs=2126 cs=0 l=1 rx=0x7f5784010310 tx=0x7f57840106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:52.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.329+0000 7f578d7fa700 1 -- 172.21.15.80:0/2639998144 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5784025a50 con 0x7f579013e320 2019-11-28T11:49:52.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.500+0000 7f57966d8700 1 -- 172.21.15.80:0/2639998144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5790109500 con 0x7f579013e320 2019-11-28T11:49:52.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.500+0000 7f578ffff700 1 --2- 172.21.15.80:0/2639998144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579013e320 0x7f579013e7b0 secure :-1 s=THROTTLE_DONE pgs=2126 cs=0 l=1 rx=0x7f5784010310 tx=0x7f57840106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:52.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.501+0000 7f578d7fa700 1 -- 172.21.15.80:0/2639998144 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f5784025a50 con 0x7f579013e320 2019-11-28T11:49:52.550 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 126 2019-11-28T11:49:52.550 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:52.551 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":126,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":126,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:49:44.228881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:49:52.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.503+0000 7f57966d8700 1 -- 172.21.15.80:0/2639998144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5770018730 msgr2=0x7f577001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:52.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.503+0000 7f57966d8700 1 --2- 172.21.15.80:0/2639998144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5770018730 0x7f577001abc0 crc :-1 s=READY pgs=863 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:52.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.503+0000 7f57966d8700 1 -- 172.21.15.80:0/2639998144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579013e320 msgr2=0x7f579013e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:52.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.503+0000 7f57966d8700 1 --2- 172.21.15.80:0/2639998144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579013e320 0x7f579013e7b0 secure :-1 s=READY pgs=2126 cs=0 l=1 rx=0x7f5784010310 tx=0x7f57840106b0).stop 2019-11-28T11:49:52.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.503+0000 7f57966d8700 1 -- 172.21.15.80:0/2639998144 shutdown_connections 2019-11-28T11:49:52.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.503+0000 7f57966d8700 1 --2- 172.21.15.80:0/2639998144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5770018730 0x7f577001abc0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:52.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.503+0000 7f57966d8700 1 --2- 172.21.15.80:0/2639998144 >> v2:172.21.15.174:3300/0 conn(0x7f579012a3c0 0x7f579012a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:52.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.503+0000 7f57966d8700 1 --2- 172.21.15.80:0/2639998144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579013e320 0x7f579013e7b0 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:52.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.503+0000 7f57966d8700 1 -- 172.21.15.80:0/2639998144 shutdown_connections 2019-11-28T11:49:52.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.503+0000 7f57966d8700 1 -- 172.21.15.80:0/2639998144 wait complete. 2019-11-28T11:49:52.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:52.503+0000 7f57966d8700 1 -- 172.21.15.80:0/2639998144 >> 172.21.15.80:0/2639998144 conn(0x7f5790127dc0 msgr2=0x7f5790141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:52.562 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T11:49:53.562 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:49:53.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.634+0000 7fee2eec9700 1 Processor -- start 2019-11-28T11:49:53.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.634+0000 7fee2eec9700 1 -- start start 2019-11-28T11:49:53.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.635+0000 7fee2eec9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fee2806c0a0 0x7fee28072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:53.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.635+0000 7fee2eec9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fee28072620 0x7fee28164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:53.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.635+0000 7fee2eec9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2806db00 con 0x7fee280734e0 2019-11-28T11:49:53.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.635+0000 7fee2eec9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2806fd60 con 0x7fee2806c0a0 2019-11-28T11:49:53.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.635+0000 7fee2eec9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee28070030 con 0x7fee28072620 2019-11-28T11:49:53.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.635+0000 7fee2d466700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fee2806c0a0 0x7fee28072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:53.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.635+0000 7fee2d466700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fee2806c0a0 0x7fee28072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42504/0 (socket says 172.21.15.80:42504) 2019-11-28T11:49:53.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee2d466700 1 -- 172.21.15.80:0/384175559 learned_addr learned my addr 172.21.15.80:0/384175559 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:53.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee2dc67700 1 --2- 172.21.15.80:0/384175559 >> v2:172.21.15.174:3300/0 conn(0x7fee28072620 0x7fee28164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:53.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee2d466700 1 -- 172.21.15.80:0/384175559 >> v2:172.21.15.174:3300/0 conn(0x7fee28072620 msgr2=0x7fee28164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:53.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee2d466700 1 --2- 172.21.15.80:0/384175559 >> v2:172.21.15.174:3300/0 conn(0x7fee28072620 0x7fee28164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:53.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee2d466700 1 -- 172.21.15.80:0/384175559 >> v1:172.21.15.174:6789/0 conn(0x7fee280734e0 legacy=0x7fee28071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:53.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee2d466700 1 -- 172.21.15.80:0/384175559 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee280706c0 con 0x7fee2806c0a0 2019-11-28T11:49:53.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee2d466700 1 --2- 172.21.15.80:0/384175559 >> v2:172.21.15.80:3300/0 conn(0x7fee2806c0a0 0x7fee28072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fee1000fa40 tx=0x7fee1000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:53.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee2d466700 1 --2- 172.21.15.80:0/384175559 >> v2:172.21.15.80:3300/0 conn(0x7fee2806c0a0 0x7fee28072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fee1000fa40 tx=0x7fee1000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:53.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee2d466700 1 --2- 172.21.15.80:0/384175559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee2806c0a0 0x7fee28072fa0 secure :-1 s=READY pgs=2127 cs=0 l=1 rx=0x7fee1000fa40 tx=0x7fee1000fde0).ready entity=mon.0 client_cookie=d049cd227951599d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:53.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee2d466700 1 --2- 172.21.15.80:0/384175559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee2806c0a0 0x7fee28072fa0 secure :-1 s=THROTTLE_DONE pgs=2127 cs=0 l=1 rx=0x7fee1000fa40 tx=0x7fee1000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:53.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee2d466700 1 --2- 172.21.15.80:0/384175559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee2806c0a0 0x7fee28072fa0 secure :-1 s=THROTTLE_DONE pgs=2127 cs=0 l=1 rx=0x7fee1000fa40 tx=0x7fee1000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:53.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee27fff700 1 -- 172.21.15.80:0/384175559 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee10000ce0 con 0x7fee2806c0a0 2019-11-28T11:49:53.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee2d466700 1 --2- 172.21.15.80:0/384175559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee2806c0a0 0x7fee28072fa0 secure :-1 s=THROTTLE_DONE pgs=2127 cs=0 l=1 rx=0x7fee1000fa40 tx=0x7fee1000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:53.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee27fff700 1 -- 172.21.15.80:0/384175559 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee10001010 con 0x7fee2806c0a0 2019-11-28T11:49:53.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee27fff700 1 -- 172.21.15.80:0/384175559 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee10001720 con 0x7fee2806c0a0 2019-11-28T11:49:53.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee2eec9700 1 -- 172.21.15.80:0/384175559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee2806c0a0 msgr2=0x7fee28072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:53.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.636+0000 7fee2eec9700 1 --2- 172.21.15.80:0/384175559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee2806c0a0 0x7fee28072fa0 secure :-1 s=READY pgs=2127 cs=0 l=1 rx=0x7fee1000fa40 tx=0x7fee1000fde0).stop 2019-11-28T11:49:53.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.637+0000 7fee2eec9700 1 -- 172.21.15.80:0/384175559 shutdown_connections 2019-11-28T11:49:53.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.637+0000 7fee2eec9700 1 --2- 172.21.15.80:0/384175559 >> v2:172.21.15.174:3300/0 conn(0x7fee28072620 0x7fee28164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:53.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.637+0000 7fee2eec9700 1 --2- 172.21.15.80:0/384175559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee2806c0a0 0x7fee28072fa0 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:53.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.637+0000 7fee2eec9700 1 -- 172.21.15.80:0/384175559 shutdown_connections 2019-11-28T11:49:53.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.637+0000 7fee2eec9700 1 -- 172.21.15.80:0/384175559 wait complete. 2019-11-28T11:49:53.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.637+0000 7fee2eec9700 1 -- 172.21.15.80:0/384175559 >> 172.21.15.80:0/384175559 conn(0x7fee28061cf0 msgr2=0x7fee28064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:53.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.639+0000 7fee2eec9700 1 Processor -- start 2019-11-28T11:49:53.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.639+0000 7fee2eec9700 1 -- start start 2019-11-28T11:49:53.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.640+0000 7fee2eec9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fee2813e9e0 0x7fee28108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:53.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.640+0000 7fee2eec9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee28109430 0x7fee281098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:53.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.640+0000 7fee2eec9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee281066e0 con 0x7fee2813e5f0 2019-11-28T11:49:53.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.640+0000 7fee2eec9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2810e060 con 0x7fee2813e9e0 2019-11-28T11:49:53.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.640+0000 7fee2eec9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2810e330 con 0x7fee28109430 2019-11-28T11:49:53.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee2d466700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fee2813e5f0 0x7fee2810a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41826/0 (socket says 172.21.15.80:41826) 2019-11-28T11:49:53.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee2d466700 1 -- 172.21.15.80:0/2705024922 learned_addr learned my addr 172.21.15.80:0/2705024922 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:53.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee2dc67700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee28109430 0x7fee281098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:53.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee2cc65700 1 --2- 172.21.15.80:0/2705024922 >> v2:172.21.15.174:3300/0 conn(0x7fee2813e9e0 0x7fee28108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:53.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee25ffb700 1 -- 172.21.15.80:0/2705024922 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634495556 0 0) 0x7fee10008190 con 0x7fee2813e5f0 2019-11-28T11:49:53.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee25ffb700 1 -- 172.21.15.80:0/2705024922 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee0c002e80 con 0x7fee2813e5f0 2019-11-28T11:49:53.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee2cc65700 1 -- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee28109430 msgr2=0x7fee281098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:53.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee2cc65700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee28109430 0x7fee281098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:53.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee2cc65700 1 -- 172.21.15.80:0/2705024922 >> v1:172.21.15.80:6789/0 conn(0x7fee2813e5f0 legacy=0x7fee2810a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:53.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee2cc65700 1 -- 172.21.15.80:0/2705024922 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2810e9c0 con 0x7fee2813e9e0 2019-11-28T11:49:53.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee2cc65700 1 --2- 172.21.15.80:0/2705024922 >> v2:172.21.15.174:3300/0 conn(0x7fee2813e9e0 0x7fee28108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee180103b0 tx=0x7fee180101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:53.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee2cc65700 1 --2- 172.21.15.80:0/2705024922 >> v2:172.21.15.174:3300/0 conn(0x7fee2813e9e0 0x7fee28108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee180103b0 tx=0x7fee180101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:53.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee2cc65700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee2813e9e0 0x7fee28108ef0 secure :-1 s=READY pgs=1268 cs=0 l=1 rx=0x7fee180103b0 tx=0x7fee180101e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:53.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee2cc65700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee2813e9e0 0x7fee28108ef0 secure :-1 s=THROTTLE_DONE pgs=1268 cs=0 l=1 rx=0x7fee180103b0 tx=0x7fee180101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:53.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee25ffb700 1 -- 172.21.15.80:0/2705024922 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee1800eff0 con 0x7fee2813e9e0 2019-11-28T11:49:53.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee2cc65700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee2813e9e0 0x7fee28108ef0 secure :-1 s=THROTTLE_DONE pgs=1268 cs=0 l=1 rx=0x7fee180103b0 tx=0x7fee180101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:53.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee2cc65700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee2813e9e0 0x7fee28108ef0 secure :-1 s=THROTTLE_DONE pgs=1268 cs=0 l=1 rx=0x7fee180103b0 tx=0x7fee180101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:53.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee25ffb700 1 -- 172.21.15.80:0/2705024922 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1800ec10 con 0x7fee2813e9e0 2019-11-28T11:49:53.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee25ffb700 1 -- 172.21.15.80:0/2705024922 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee1800f770 con 0x7fee2813e9e0 2019-11-28T11:49:53.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee2eec9700 1 -- 172.21.15.80:0/2705024922 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2810ed40 con 0x7fee2813e9e0 2019-11-28T11:49:53.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.641+0000 7fee2eec9700 1 -- 172.21.15.80:0/2705024922 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2810e9c0 con 0x7fee2813e9e0 2019-11-28T11:49:53.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.642+0000 7fee2cc65700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee2813e9e0 0x7fee28108ef0 secure :-1 s=THROTTLE_DONE pgs=1268 cs=0 l=1 rx=0x7fee180103b0 tx=0x7fee180101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:53.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.642+0000 7fee25ffb700 1 -- 172.21.15.80:0/2705024922 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fee1800f220 con 0x7fee2813e9e0 2019-11-28T11:49:53.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.642+0000 7fee2cc65700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee2813e9e0 0x7fee28108ef0 secure :-1 s=THROTTLE_DONE pgs=1268 cs=0 l=1 rx=0x7fee180103b0 tx=0x7fee180101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:53.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.642+0000 7fee25ffb700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fee0c018770 0x7fee0c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:53.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.642+0000 7fee25ffb700 1 -- 172.21.15.80:0/2705024922 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fee18031a10 con 0x7fee2813e9e0 2019-11-28T11:49:53.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.642+0000 7fee2d466700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fee0c018770 0x7fee0c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:53.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.642+0000 7fee2d466700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fee0c018770 0x7fee0c01abe0 crc :-1 s=READY pgs=864 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:53.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.650+0000 7fee2eec9700 1 -- 172.21.15.80:0/2705024922 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2810ed40 con 0x7fee2813e9e0 2019-11-28T11:49:53.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.654+0000 7fee2cc65700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee2813e9e0 0x7fee28108ef0 secure :-1 s=THROTTLE_DONE pgs=1268 cs=0 l=1 rx=0x7fee180103b0 tx=0x7fee180101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:53.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.654+0000 7fee25ffb700 1 -- 172.21.15.80:0/2705024922 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fee1800eff0 con 0x7fee2813e9e0 2019-11-28T11:49:53.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.827+0000 7fee2eec9700 1 -- 172.21.15.80:0/2705024922 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee2810e9c0 con 0x7fee2813e9e0 2019-11-28T11:49:53.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.827+0000 7fee2cc65700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee2813e9e0 0x7fee28108ef0 secure :-1 s=THROTTLE_DONE pgs=1268 cs=0 l=1 rx=0x7fee180103b0 tx=0x7fee180101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:53.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.827+0000 7fee25ffb700 1 -- 172.21.15.80:0/2705024922 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+1432 (secure 0 0 0) 0x7fee18009bc0 con 0x7fee2813e9e0 2019-11-28T11:49:53.877 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 126 2019-11-28T11:49:53.877 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:53.877 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":126,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":126,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:49:44.228881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:49:53.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.829+0000 7fee2eec9700 1 -- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fee0c018770 msgr2=0x7fee0c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:53.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.829+0000 7fee2eec9700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fee0c018770 0x7fee0c01abe0 crc :-1 s=READY pgs=864 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:53.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.830+0000 7fee2eec9700 1 -- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee2813e9e0 msgr2=0x7fee28108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:53.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.830+0000 7fee2eec9700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee2813e9e0 0x7fee28108ef0 secure :-1 s=READY pgs=1268 cs=0 l=1 rx=0x7fee180103b0 tx=0x7fee180101e0).stop 2019-11-28T11:49:53.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.830+0000 7fee2eec9700 1 -- 172.21.15.80:0/2705024922 shutdown_connections 2019-11-28T11:49:53.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.830+0000 7fee2eec9700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fee0c018770 0x7fee0c01abe0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:53.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.830+0000 7fee2eec9700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee28109430 0x7fee281098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:53.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.830+0000 7fee2eec9700 1 --2- 172.21.15.80:0/2705024922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee2813e9e0 0x7fee28108ef0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:53.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.830+0000 7fee2eec9700 1 -- 172.21.15.80:0/2705024922 shutdown_connections 2019-11-28T11:49:53.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.830+0000 7fee2eec9700 1 -- 172.21.15.80:0/2705024922 wait complete. 2019-11-28T11:49:53.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:53.830+0000 7fee2eec9700 1 -- 172.21.15.80:0/2705024922 >> 172.21.15.80:0/2705024922 conn(0x7fee2813d620 msgr2=0x7fee2813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:53.888 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T11:49:54.889 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:49:55.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.961+0000 7f9a46bb4700 1 Processor -- start 2019-11-28T11:49:55.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.961+0000 7f9a46bb4700 1 -- start start 2019-11-28T11:49:55.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.962+0000 7f9a46bb4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9a4006c490 0x7f9a4006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:55.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.962+0000 7f9a46bb4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4006db00 con 0x7f9a4006ce60 2019-11-28T11:49:55.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.962+0000 7f9a46bb4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4006e000 con 0x7f9a4006c0a0 2019-11-28T11:49:55.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.962+0000 7f9a46bb4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4006fd60 con 0x7f9a4006c490 2019-11-28T11:49:55.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.962+0000 7f9a45952700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9a4006ce60 0x7f9a40164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41844/0 (socket says 172.21.15.80:41844) 2019-11-28T11:49:55.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.962+0000 7f9a45952700 1 -- 172.21.15.80:0/3610946845 learned_addr learned my addr 172.21.15.80:0/3610946845 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:55.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.962+0000 7f9a44950700 1 --2- 172.21.15.80:0/3610946845 >> v2:172.21.15.174:3300/0 conn(0x7f9a4006c490 0x7f9a4006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:55.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.962+0000 7f9a3ffff700 1 -- 172.21.15.80:0/3610946845 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868828723 0 0) 0x7f9a38001150 con 0x7f9a4006ce60 2019-11-28T11:49:55.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.962+0000 7f9a3ffff700 1 -- 172.21.15.80:0/3610946845 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a2c002e80 con 0x7f9a4006ce60 2019-11-28T11:49:55.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a3ffff700 1 -- 172.21.15.80:0/3610946845 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1527231569 0 0) 0x7f9a38001130 con 0x7f9a4006ce60 2019-11-28T11:49:55.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a3ffff700 1 -- 172.21.15.80:0/3610946845 >> v2:172.21.15.174:3300/0 conn(0x7f9a4006c490 msgr2=0x7f9a4006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:55.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a3ffff700 1 --2- 172.21.15.80:0/3610946845 >> v2:172.21.15.174:3300/0 conn(0x7f9a4006c490 0x7f9a4006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:55.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a3ffff700 1 -- 172.21.15.80:0/3610946845 >> v1:172.21.15.174:6789/0 conn(0x7f9a4006c0a0 legacy=0x7f9a40072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a3ffff700 1 -- 172.21.15.80:0/3610946845 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a400706c0 con 0x7f9a4006ce60 2019-11-28T11:49:55.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a3ffff700 1 -- 172.21.15.80:0/3610946845 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f9a380016c0 con 0x7f9a4006ce60 2019-11-28T11:49:55.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a3ffff700 1 -- 172.21.15.80:0/3610946845 >> v1:172.21.15.80:6789/0 conn(0x7f9a4006ce60 legacy=0x7f9a40164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a3ffff700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a2c003ab0 0x7f9a2c005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:55.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a3ffff700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c006690 0x7f9a2c008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:55.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a3ffff700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a2c009380 0x7f9a2c00b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:55.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a3ffff700 1 -- 172.21.15.80:0/3610946845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c00c000 con 0x7f9a2c006690 2019-11-28T11:49:55.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a3ffff700 1 -- 172.21.15.80:0/3610946845 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c050200 con 0x7f9a2c003ab0 2019-11-28T11:49:55.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a3ffff700 1 -- 172.21.15.80:0/3610946845 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c050430 con 0x7f9a2c009380 2019-11-28T11:49:55.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a44950700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c006690 0x7f9a2c008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:55.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a45151700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a2c003ab0 0x7f9a2c005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:55.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a45952700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a2c009380 0x7f9a2c00b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:55.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a44950700 1 -- 172.21.15.80:0/3610946845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a2c009380 msgr2=0x7f9a2c00b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:55.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a44950700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a2c009380 0x7f9a2c00b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:55.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a44950700 1 -- 172.21.15.80:0/3610946845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a2c003ab0 msgr2=0x7f9a2c005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:55.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a44950700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a2c003ab0 0x7f9a2c005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:55.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a44950700 1 -- 172.21.15.80:0/3610946845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c0506e0 con 0x7f9a2c006690 2019-11-28T11:49:55.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a45952700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9a2c009380 0x7f9a2c00b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:49:55.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a45952700 1 -- 172.21.15.80:0/3610946845 reap_dead start 2019-11-28T11:49:55.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a44950700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c006690 0x7f9a2c008b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9a2800ba60 tx=0x7f9a2800b930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a44950700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c006690 0x7f9a2c008b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9a2800ba60 tx=0x7f9a2800b930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a44950700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c006690 0x7f9a2c008b20 secure :-1 s=READY pgs=2130 cs=0 l=1 rx=0x7f9a2800ba60 tx=0x7f9a2800b930).ready entity=mon.0 client_cookie=5510b0aca13cb537 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:55.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a44950700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c006690 0x7f9a2c008b20 secure :-1 s=THROTTLE_DONE pgs=2130 cs=0 l=1 rx=0x7f9a2800ba60 tx=0x7f9a2800b930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a3ffff700 1 -- 172.21.15.80:0/3610946845 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a28000ce0 con 0x7f9a2c006690 2019-11-28T11:49:55.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a44950700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c006690 0x7f9a2c008b20 secure :-1 s=THROTTLE_DONE pgs=2130 cs=0 l=1 rx=0x7f9a2800ba60 tx=0x7f9a2800b930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a44950700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c006690 0x7f9a2c008b20 secure :-1 s=THROTTLE_DONE pgs=2130 cs=0 l=1 rx=0x7f9a2800ba60 tx=0x7f9a2800b930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a3ffff700 1 -- 172.21.15.80:0/3610946845 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a28009af0 con 0x7f9a2c006690 2019-11-28T11:49:55.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a3ffff700 1 -- 172.21.15.80:0/3610946845 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a2800a180 con 0x7f9a2c006690 2019-11-28T11:49:55.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a46bb4700 1 -- 172.21.15.80:0/3610946845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c006690 msgr2=0x7f9a2c008b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.963+0000 7f9a46bb4700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c006690 0x7f9a2c008b20 secure :-1 s=READY pgs=2130 cs=0 l=1 rx=0x7f9a2800ba60 tx=0x7f9a2800b930).stop 2019-11-28T11:49:55.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.964+0000 7f9a46bb4700 1 -- 172.21.15.80:0/3610946845 shutdown_connections 2019-11-28T11:49:55.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.964+0000 7f9a46bb4700 1 --2- 172.21.15.80:0/3610946845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a2c006690 0x7f9a2c008b20 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:55.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.964+0000 7f9a46bb4700 1 -- 172.21.15.80:0/3610946845 shutdown_connections 2019-11-28T11:49:55.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.964+0000 7f9a46bb4700 1 -- 172.21.15.80:0/3610946845 wait complete. 2019-11-28T11:49:55.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.964+0000 7f9a46bb4700 1 -- 172.21.15.80:0/3610946845 >> 172.21.15.80:0/3610946845 conn(0x7f9a40061cf0 msgr2=0x7f9a40064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:55.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.967+0000 7f9a46bb4700 1 Processor -- start 2019-11-28T11:49:55.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.967+0000 7f9a46bb4700 1 -- start start 2019-11-28T11:49:55.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a46bb4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a40074d00 0x7f9a4007aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:55.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a46bb4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a400754d0 con 0x7f9a40150f50 2019-11-28T11:49:55.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a46bb4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4012eb20 con 0x7f9a4007bba0 2019-11-28T11:49:55.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a46bb4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a40078980 con 0x7f9a40074d00 2019-11-28T11:49:55.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a45151700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a40074d00 0x7f9a4007aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:55.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a44950700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9a40150f50 0x7f9a4007af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41856/0 (socket says 172.21.15.80:41856) 2019-11-28T11:49:55.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a45151700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9a40074d00 0x7f9a4007aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42538/0 (socket says 172.21.15.80:42538) 2019-11-28T11:49:55.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a44950700 1 -- 172.21.15.80:0/2529950156 learned_addr learned my addr 172.21.15.80:0/2529950156 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:55.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a45151700 1 -- 172.21.15.80:0/2529950156 >> v1:172.21.15.174:6789/0 conn(0x7f9a4007bba0 legacy=0x7f9a40167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a45151700 1 -- 172.21.15.80:0/2529950156 >> v1:172.21.15.80:6789/0 conn(0x7f9a40150f50 legacy=0x7f9a4007af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a45151700 1 -- 172.21.15.80:0/2529950156 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a400792e0 con 0x7f9a40074d00 2019-11-28T11:49:55.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2529950156 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753413795 0 0) 0x7f9a2800ad80 con 0x7f9a40150f50 2019-11-28T11:49:55.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a45151700 1 --2- 172.21.15.80:0/2529950156 >> v2:172.21.15.80:3300/0 conn(0x7f9a40074d00 0x7f9a4007aa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a30012510 tx=0x7f9a300128b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a45151700 1 --2- 172.21.15.80:0/2529950156 >> v2:172.21.15.80:3300/0 conn(0x7f9a40074d00 0x7f9a4007aa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a30012510 tx=0x7f9a300128b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a45151700 1 --2- 172.21.15.80:0/2529950156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a40074d00 0x7f9a4007aa20 secure :-1 s=READY pgs=2132 cs=0 l=1 rx=0x7f9a30012510 tx=0x7f9a300128b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:55.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a45151700 1 --2- 172.21.15.80:0/2529950156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a40074d00 0x7f9a4007aa20 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7f9a30012510 tx=0x7f9a300128b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2529950156 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a30001370 con 0x7f9a40074d00 2019-11-28T11:49:55.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a45151700 1 --2- 172.21.15.80:0/2529950156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a40074d00 0x7f9a4007aa20 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7f9a30012510 tx=0x7f9a300128b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a45151700 1 --2- 172.21.15.80:0/2529950156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a40074d00 0x7f9a4007aa20 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7f9a30012510 tx=0x7f9a300128b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2529950156 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a30000f90 con 0x7f9a40074d00 2019-11-28T11:49:55.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a46bb4700 1 -- 172.21.15.80:0/2529950156 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a40079660 con 0x7f9a40074d00 2019-11-28T11:49:55.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2529950156 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a30001af0 con 0x7f9a40074d00 2019-11-28T11:49:55.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.968+0000 7f9a46bb4700 1 -- 172.21.15.80:0/2529950156 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a400792e0 con 0x7f9a40074d00 2019-11-28T11:49:55.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.969+0000 7f9a45151700 1 --2- 172.21.15.80:0/2529950156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a40074d00 0x7f9a4007aa20 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7f9a30012510 tx=0x7f9a300128b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.969+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2529950156 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9a30001180 con 0x7f9a40074d00 2019-11-28T11:49:55.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.969+0000 7f9a45151700 1 --2- 172.21.15.80:0/2529950156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a40074d00 0x7f9a4007aa20 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7f9a30012510 tx=0x7f9a300128b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.969+0000 7f9a3dffb700 1 --2- 172.21.15.80:0/2529950156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a24018730 0x7f9a2401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:55.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.969+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2529950156 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f9a30033cd0 con 0x7f9a40074d00 2019-11-28T11:49:55.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.969+0000 7f9a44950700 1 --2- 172.21.15.80:0/2529950156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a24018730 0x7f9a2401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:55.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.969+0000 7f9a44950700 1 --2- 172.21.15.80:0/2529950156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a24018730 0x7f9a2401abc0 crc :-1 s=READY pgs=871 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:55.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.977+0000 7f9a46bb4700 1 -- 172.21.15.80:0/2529950156 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a40079660 con 0x7f9a40074d00 2019-11-28T11:49:55.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.980+0000 7f9a45151700 1 --2- 172.21.15.80:0/2529950156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a40074d00 0x7f9a4007aa20 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7f9a30012510 tx=0x7f9a300128b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:54.980+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2529950156 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9a30000ce0 con 0x7f9a40074d00 2019-11-28T11:49:55.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.150+0000 7f9a46bb4700 1 -- 172.21.15.80:0/2529950156 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a400792e0 con 0x7f9a40074d00 2019-11-28T11:49:55.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.150+0000 7f9a45151700 1 --2- 172.21.15.80:0/2529950156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a40074d00 0x7f9a4007aa20 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7f9a30012510 tx=0x7f9a300128b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.150+0000 7f9a3dffb700 1 -- 172.21.15.80:0/2529950156 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) v1 ==== 95+0+2460 (secure 0 0 0) 0x7f9a30001180 con 0x7f9a40074d00 2019-11-28T11:49:55.199 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:55.200 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":129,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7019,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1144103346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1144103346},{"type":"v1","addr":"172.21.15.80:6834","nonce":1144103346}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":127},{"gid":9613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3914187264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3914187264},{"type":"v1","addr":"172.21.15.80:6835","nonce":3914187264}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":127}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:49:54.911538+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7016":{"gid":7016,"name":"c","rank":0,"incarnation":128,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/2828740513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2828740513},{"type":"v1","addr":"172.21.15.174:6835","nonce":2828740513}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:49:55.200 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 129 2019-11-28T11:49:55.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.152+0000 7f9a46bb4700 1 -- 172.21.15.80:0/2529950156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a24018730 msgr2=0x7f9a2401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.152+0000 7f9a46bb4700 1 --2- 172.21.15.80:0/2529950156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a24018730 0x7f9a2401abc0 crc :-1 s=READY pgs=871 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:55.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.153+0000 7f9a46bb4700 1 -- 172.21.15.80:0/2529950156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a40074d00 msgr2=0x7f9a4007aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.153+0000 7f9a46bb4700 1 --2- 172.21.15.80:0/2529950156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a40074d00 0x7f9a4007aa20 secure :-1 s=READY pgs=2132 cs=0 l=1 rx=0x7f9a30012510 tx=0x7f9a300128b0).stop 2019-11-28T11:49:55.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.153+0000 7f9a46bb4700 1 -- 172.21.15.80:0/2529950156 shutdown_connections 2019-11-28T11:49:55.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.153+0000 7f9a46bb4700 1 --2- 172.21.15.80:0/2529950156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9a24018730 0x7f9a2401abc0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:55.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.153+0000 7f9a46bb4700 1 --2- 172.21.15.80:0/2529950156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9a40074d00 0x7f9a4007aa20 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:55.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.153+0000 7f9a46bb4700 1 -- 172.21.15.80:0/2529950156 shutdown_connections 2019-11-28T11:49:55.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.153+0000 7f9a46bb4700 1 -- 172.21.15.80:0/2529950156 wait complete. 2019-11-28T11:49:55.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.153+0000 7f9a46bb4700 1 -- 172.21.15.80:0/2529950156 >> 172.21.15.80:0/2529950156 conn(0x7f9a4013fa50 msgr2=0x7f9a4007c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:55.212 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to up:reconnect 2019-11-28T11:49:55.212 INFO:tasks.cephfs.filesystem:reached state 'up:reconnect' in 5.6446249485s 2019-11-28T11:49:55.212 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:49:55.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.282+0000 7f60b0527700 1 Processor -- start 2019-11-28T11:49:55.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.282+0000 7f60b0527700 1 -- start start 2019-11-28T11:49:55.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.283+0000 7f60b0527700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f60a806d120 0x7f60a8165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:55.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.283+0000 7f60b0527700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a806d5a0 con 0x7f60a806c490 2019-11-28T11:49:55.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.283+0000 7f60b0527700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a806db00 con 0x7f60a806c0a0 2019-11-28T11:49:55.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.283+0000 7f60b0527700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a806fd60 con 0x7f60a806d120 2019-11-28T11:49:55.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60af2c5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f60a806d120 0x7f60a8165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:55.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60ae2c3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f60a806c490 0x7f60a806c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41864/0 (socket says 172.21.15.80:41864) 2019-11-28T11:49:55.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60af2c5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f60a806d120 0x7f60a8165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42548/0 (socket says 172.21.15.80:42548) 2019-11-28T11:49:55.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60ae2c3700 1 -- 172.21.15.80:0/19472395 learned_addr learned my addr 172.21.15.80:0/19472395 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:55.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60af2c5700 1 -- 172.21.15.80:0/19472395 >> v1:172.21.15.174:6789/0 conn(0x7f60a806c0a0 legacy=0x7f60a8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:55.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60af2c5700 1 -- 172.21.15.80:0/19472395 >> v1:172.21.15.80:6789/0 conn(0x7f60a806c490 legacy=0x7f60a806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60af2c5700 1 -- 172.21.15.80:0/19472395 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a80706c0 con 0x7f60a806d120 2019-11-28T11:49:55.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60adac2700 1 -- 172.21.15.80:0/19472395 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334712323 0 0) 0x7f609c001150 con 0x7f60a806c490 2019-11-28T11:49:55.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60af2c5700 1 --2- 172.21.15.80:0/19472395 >> v2:172.21.15.80:3300/0 conn(0x7f60a806d120 0x7f60a8165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f60a000b2d0 tx=0x7f60a000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60af2c5700 1 --2- 172.21.15.80:0/19472395 >> v2:172.21.15.80:3300/0 conn(0x7f60a806d120 0x7f60a8165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f60a000b2d0 tx=0x7f60a000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60af2c5700 1 --2- 172.21.15.80:0/19472395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60a806d120 0x7f60a8165d80 secure :-1 s=READY pgs=2134 cs=0 l=1 rx=0x7f60a000b2d0 tx=0x7f60a000bae0).ready entity=mon.0 client_cookie=2288e06c86690b96 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:55.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60af2c5700 1 --2- 172.21.15.80:0/19472395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60a806d120 0x7f60a8165d80 secure :-1 s=THROTTLE_DONE pgs=2134 cs=0 l=1 rx=0x7f60a000b2d0 tx=0x7f60a000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60adac2700 1 -- 172.21.15.80:0/19472395 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60a0009f20 con 0x7f60a806d120 2019-11-28T11:49:55.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60af2c5700 1 --2- 172.21.15.80:0/19472395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60a806d120 0x7f60a8165d80 secure :-1 s=THROTTLE_DONE pgs=2134 cs=0 l=1 rx=0x7f60a000b2d0 tx=0x7f60a000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60af2c5700 1 --2- 172.21.15.80:0/19472395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60a806d120 0x7f60a8165d80 secure :-1 s=THROTTLE_DONE pgs=2134 cs=0 l=1 rx=0x7f60a000b2d0 tx=0x7f60a000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60adac2700 1 -- 172.21.15.80:0/19472395 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a0000df0 con 0x7f60a806d120 2019-11-28T11:49:55.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60adac2700 1 -- 172.21.15.80:0/19472395 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60a000a500 con 0x7f60a806d120 2019-11-28T11:49:55.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60b0527700 1 -- 172.21.15.80:0/19472395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60a806d120 msgr2=0x7f60a8165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.284+0000 7f60b0527700 1 --2- 172.21.15.80:0/19472395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60a806d120 0x7f60a8165d80 secure :-1 s=READY pgs=2134 cs=0 l=1 rx=0x7f60a000b2d0 tx=0x7f60a000bae0).stop 2019-11-28T11:49:55.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.285+0000 7f60b0527700 1 -- 172.21.15.80:0/19472395 shutdown_connections 2019-11-28T11:49:55.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.285+0000 7f60b0527700 1 --2- 172.21.15.80:0/19472395 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f60a806d120 0x7f60a8165d80 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:55.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.285+0000 7f60b0527700 1 -- 172.21.15.80:0/19472395 shutdown_connections 2019-11-28T11:49:55.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.285+0000 7f60b0527700 1 -- 172.21.15.80:0/19472395 wait complete. 2019-11-28T11:49:55.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.285+0000 7f60b0527700 1 -- 172.21.15.80:0/19472395 >> 172.21.15.80:0/19472395 conn(0x7f60a8061cf0 msgr2=0x7f60a8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:55.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.287+0000 7f60b0527700 1 Processor -- start 2019-11-28T11:49:55.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.288+0000 7f60b0527700 1 -- start start 2019-11-28T11:49:55.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.288+0000 7f60b0527700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f60a813f580 0x7f60a8115730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:55.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.288+0000 7f60b0527700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60a8122660 0x7f60a8168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:55.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.288+0000 7f60b0527700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a813fc50 con 0x7f60a8115c70 2019-11-28T11:49:55.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.288+0000 7f60b0527700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a8112550 con 0x7f60a813f580 2019-11-28T11:49:55.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.288+0000 7f60b0527700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a8112820 con 0x7f60a8122660 2019-11-28T11:49:55.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.288+0000 7f60ae2c3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f60a8115c70 0x7f60a8121e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41872/0 (socket says 172.21.15.80:41872) 2019-11-28T11:49:55.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.288+0000 7f60ae2c3700 1 -- 172.21.15.80:0/1020086450 learned_addr learned my addr 172.21.15.80:0/1020086450 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:55.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60af2c5700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60a8122660 0x7f60a8168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:55.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60aeac4700 1 --2- 172.21.15.80:0/1020086450 >> v2:172.21.15.174:3300/0 conn(0x7f60a813f580 0x7f60a8115730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:55.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60a77fe700 1 -- 172.21.15.80:0/1020086450 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580766897 0 0) 0x7f609c000f40 con 0x7f60a8115c70 2019-11-28T11:49:55.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60a77fe700 1 -- 172.21.15.80:0/1020086450 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6088002e80 con 0x7f60a8115c70 2019-11-28T11:49:55.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60af2c5700 1 -- 172.21.15.80:0/1020086450 >> v2:172.21.15.174:3300/0 conn(0x7f60a813f580 msgr2=0x7f60a8115730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60af2c5700 1 --2- 172.21.15.80:0/1020086450 >> v2:172.21.15.174:3300/0 conn(0x7f60a813f580 0x7f60a8115730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:55.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60af2c5700 1 -- 172.21.15.80:0/1020086450 >> v1:172.21.15.80:6789/0 conn(0x7f60a8115c70 legacy=0x7f60a8121e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60a77fe700 1 -- 172.21.15.80:0/1020086450 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4122941057 0 0) 0x7f609c000c90 con 0x7f60a8115c70 2019-11-28T11:49:55.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60af2c5700 1 -- 172.21.15.80:0/1020086450 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a8112eb0 con 0x7f60a8122660 2019-11-28T11:49:55.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60af2c5700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60a8122660 0x7f60a8168a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f60a0010680 tx=0x7f60a0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60af2c5700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60a8122660 0x7f60a8168a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f60a0010680 tx=0x7f60a0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60af2c5700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60a8122660 0x7f60a8168a20 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7f60a0010680 tx=0x7f60a0010a20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:55.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60af2c5700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60a8122660 0x7f60a8168a20 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7f60a0010680 tx=0x7f60a0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60a77fe700 1 -- 172.21.15.80:0/1020086450 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60a000b2a0 con 0x7f60a8122660 2019-11-28T11:49:55.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60af2c5700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60a8122660 0x7f60a8168a20 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7f60a0010680 tx=0x7f60a0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60a77fe700 1 -- 172.21.15.80:0/1020086450 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a000b2a0 con 0x7f60a8122660 2019-11-28T11:49:55.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60af2c5700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60a8122660 0x7f60a8168a20 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7f60a0010680 tx=0x7f60a0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60b0527700 1 -- 172.21.15.80:0/1020086450 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a8113230 con 0x7f60a8122660 2019-11-28T11:49:55.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60a77fe700 1 -- 172.21.15.80:0/1020086450 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60a0009ce0 con 0x7f60a8122660 2019-11-28T11:49:55.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.289+0000 7f60b0527700 1 -- 172.21.15.80:0/1020086450 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a8112eb0 con 0x7f60a8122660 2019-11-28T11:49:55.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.290+0000 7f60af2c5700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60a8122660 0x7f60a8168a20 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7f60a0010680 tx=0x7f60a0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.290+0000 7f60a77fe700 1 -- 172.21.15.80:0/1020086450 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f60a0009900 con 0x7f60a8122660 2019-11-28T11:49:55.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.290+0000 7f60af2c5700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60a8122660 0x7f60a8168a20 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7f60a0010680 tx=0x7f60a0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.290+0000 7f60a77fe700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6088018780 0x7f608801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:55.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.290+0000 7f60a77fe700 1 -- 172.21.15.80:0/1020086450 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f60a0031da0 con 0x7f60a8122660 2019-11-28T11:49:55.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.290+0000 7f60aeac4700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6088018780 0x7f608801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:55.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.290+0000 7f60aeac4700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6088018780 0x7f608801abf0 crc :-1 s=READY pgs=872 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:55.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.298+0000 7f60b0527700 1 -- 172.21.15.80:0/1020086450 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a8113230 con 0x7f60a8122660 2019-11-28T11:49:55.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.302+0000 7f60af2c5700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60a8122660 0x7f60a8168a20 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7f60a0010680 tx=0x7f60a0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.302+0000 7f60a77fe700 1 -- 172.21.15.80:0/1020086450 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f60a0023f30 con 0x7f60a8122660 2019-11-28T11:49:55.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.473+0000 7f60b0527700 1 -- 172.21.15.80:0/1020086450 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60a8112eb0 con 0x7f60a8122660 2019-11-28T11:49:55.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.473+0000 7f60af2c5700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60a8122660 0x7f60a8168a20 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7f60a0010680 tx=0x7f60a0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.473+0000 7f60a77fe700 1 -- 172.21.15.80:0/1020086450 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) v1 ==== 95+0+2460 (secure 0 0 0) 0x7f60a0023f30 con 0x7f60a8122660 2019-11-28T11:49:55.522 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 129 2019-11-28T11:49:55.523 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:55.523 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":129,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7019,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1144103346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1144103346},{"type":"v1","addr":"172.21.15.80:6834","nonce":1144103346}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":127},{"gid":9613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3914187264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3914187264},{"type":"v1","addr":"172.21.15.80:6835","nonce":3914187264}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":127}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:49:54.911538+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7016":{"gid":7016,"name":"c","rank":0,"incarnation":128,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/2828740513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2828740513},{"type":"v1","addr":"172.21.15.174:6835","nonce":2828740513}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:49:55.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.475+0000 7f60b0527700 1 -- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6088018780 msgr2=0x7f608801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.475+0000 7f60b0527700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6088018780 0x7f608801abf0 crc :-1 s=READY pgs=872 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:55.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.475+0000 7f60b0527700 1 -- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60a8122660 msgr2=0x7f60a8168a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.475+0000 7f60b0527700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60a8122660 0x7f60a8168a20 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7f60a0010680 tx=0x7f60a0010a20).stop 2019-11-28T11:49:55.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.476+0000 7f60b0527700 1 -- 172.21.15.80:0/1020086450 shutdown_connections 2019-11-28T11:49:55.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.476+0000 7f60b0527700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6088018780 0x7f608801abf0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:55.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.476+0000 7f60b0527700 1 --2- 172.21.15.80:0/1020086450 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60a8122660 0x7f60a8168a20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:55.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.476+0000 7f60b0527700 1 --2- 172.21.15.80:0/1020086450 >> v2:172.21.15.174:3300/0 conn(0x7f60a813f580 0x7f60a8115730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:55.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.476+0000 7f60b0527700 1 -- 172.21.15.80:0/1020086450 shutdown_connections 2019-11-28T11:49:55.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.476+0000 7f60b0527700 1 -- 172.21.15.80:0/1020086450 wait complete. 2019-11-28T11:49:55.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.476+0000 7f60b0527700 1 -- 172.21.15.80:0/1020086450 >> 172.21.15.80:0/1020086450 conn(0x7f60a81426c0 msgr2=0x7f60a8110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:55.535 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session ls 2019-11-28T11:49:55.633 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:49:55.638 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:49:55.642 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:49:55.664 INFO:teuthology.orchestra.run.smithi174.stdout:[ 2019-11-28T11:49:55.664 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:49:55.664 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 6998, 2019-11-28T11:49:55.665 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:49:55.665 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:49:55.665 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:49:55.665 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 6998 2019-11-28T11:49:55.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:55.666 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:49:55.666 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:49:55.666 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.16:0", 2019-11-28T11:49:55.666 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 1552752389 2019-11-28T11:49:55.667 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:49:55.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:55.667 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:49:55.667 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:49:55.667 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 1, 2019-11-28T11:49:55.667 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 0, 2019-11-28T11:49:55.667 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 1.6979758629999999, 2019-11-28T11:49:55.668 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:49:55.668 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 0, 2019-11-28T11:49:55.668 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:49:55.668 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:49:55.668 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:49:55.668 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:49:55.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:55.669 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:49:55.669 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:49:55.669 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:49:55.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:55.669 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:49:55.669 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:49:55.669 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:49:55.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:55.670 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:49:55.670 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:49:55.670 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:49:55.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:55.675 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:49:55.675 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0.9984047474579224, 2019-11-28T11:49:55.675 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:49:55.675 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:55.675 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.6998 v1:172.21.15.16:0/1552752389", 2019-11-28T11:49:55.675 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [], 2019-11-28T11:49:55.675 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T11:49:55.677 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:49:55.677 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:49:55.678 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:49:55.678 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "1", 2019-11-28T11:49:55.678 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi016", 2019-11-28T11:49:55.678 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:49:55.678 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:49:55.679 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:49:55.679 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:55.679 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:49:55.679 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 6989, 2019-11-28T11:49:55.679 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:49:55.679 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:49:55.679 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:49:55.680 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 6989 2019-11-28T11:49:55.680 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:55.680 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:49:55.680 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:49:55.680 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.76:0", 2019-11-28T11:49:55.680 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 1856018806 2019-11-28T11:49:55.681 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:49:55.681 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:55.681 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:49:55.681 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:49:55.681 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 0, 2019-11-28T11:49:55.682 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 0, 2019-11-28T11:49:55.682 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 1.6979758629999999, 2019-11-28T11:49:55.682 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:49:55.682 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 1, 2019-11-28T11:49:55.682 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": true, 2019-11-28T11:49:55.684 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:49:55.685 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:49:55.685 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:49:55.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:55.686 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:49:55.686 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:49:55.686 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:49:55.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:55.688 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:49:55.688 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:49:55.688 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:49:55.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:55.689 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:49:55.690 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:49:55.690 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:49:55.690 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:55.690 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:49:55.691 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:49:55.691 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:49:55.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:55.691 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.6989 v1:172.21.15.76:0/1856018806", 2019-11-28T11:49:55.691 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [ 2019-11-28T11:49:55.691 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:49:55.691 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 2, 2019-11-28T11:49:55.692 INFO:teuthology.orchestra.run.smithi174.stdout: "created_ino": "0x0" 2019-11-28T11:49:55.692 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:49:55.692 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2019-11-28T11:49:55.692 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T11:49:55.692 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:49:55.692 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:49:55.692 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:49:55.693 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "0", 2019-11-28T11:49:55.693 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi076.front.sepia.ceph.com", 2019-11-28T11:49:55.693 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:49:55.693 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:49:55.693 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:49:55.694 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:49:55.694 INFO:teuthology.orchestra.run.smithi174.stdout:] 2019-11-28T11:49:55.695 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 6998, "entity": { "name": { "type": "client", "num": 6998 }, "addr": { "type": "v1", "addr": "172.21.15.16:0", "nonce": 1552752389 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 1.6979758629999999, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.9984047474579224, "halflife": 300 }, "inst": "client.6998 v1:172.21.15.16:0/1552752389", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "1", "hostname": "smithi016", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } }, { "id": 6989, "entity": { "name": { "type": "client", "num": 6989 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 1856018806 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 1.6979758629999999, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": true, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "inst": "client.6989 v1:172.21.15.76:0/1856018806", "completed_requests": [ { "tid": 2, "created_ino": "0x0" } ], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076.front.sepia.ceph.com", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:49:55.695 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:49:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.768+0000 7ff5bc3c1700 1 Processor -- start 2019-11-28T11:49:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.768+0000 7ff5bc3c1700 1 -- start start 2019-11-28T11:49:55.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.769+0000 7ff5bc3c1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff5b406c490 0x7ff5b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.769+0000 7ff5bc3c1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5b406ce60 0x7ff5b4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.769+0000 7ff5bc3c1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b406db00 con 0x7ff5b406c0a0 2019-11-28T11:49:55.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.769+0000 7ff5bc3c1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b406fd60 con 0x7ff5b406ce60 2019-11-28T11:49:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.769+0000 7ff5bc3c1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b4070030 con 0x7ff5b406c490 2019-11-28T11:49:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.769+0000 7ff5bb15f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5b406ce60 0x7ff5b4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.769+0000 7ff5bb15f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5b406ce60 0x7ff5b4164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42562/0 (socket says 172.21.15.80:42562) 2019-11-28T11:49:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.769+0000 7ff5bb15f700 1 -- 172.21.15.80:0/2910188452 learned_addr learned my addr 172.21.15.80:0/2910188452 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5ba15d700 1 --2- 172.21.15.80:0/2910188452 >> v2:172.21.15.174:3300/0 conn(0x7ff5b406c490 0x7ff5b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:55.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5bb15f700 1 -- 172.21.15.80:0/2910188452 >> v2:172.21.15.174:3300/0 conn(0x7ff5b406c490 msgr2=0x7ff5b406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:55.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5bb15f700 1 --2- 172.21.15.80:0/2910188452 >> v2:172.21.15.174:3300/0 conn(0x7ff5b406c490 0x7ff5b406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5bb15f700 1 -- 172.21.15.80:0/2910188452 >> v1:172.21.15.80:6789/0 conn(0x7ff5b406c0a0 legacy=0x7ff5b4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5b995c700 1 -- 172.21.15.80:0/2910188452 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150513845 0 0) 0x7ff5a4001100 con 0x7ff5b406c0a0 2019-11-28T11:49:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5bb15f700 1 -- 172.21.15.80:0/2910188452 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b40706c0 con 0x7ff5b406ce60 2019-11-28T11:49:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5bb15f700 1 --2- 172.21.15.80:0/2910188452 >> v2:172.21.15.80:3300/0 conn(0x7ff5b406ce60 0x7ff5b4164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff5ac00f6b0 tx=0x7ff5ac00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5bb15f700 1 --2- 172.21.15.80:0/2910188452 >> v2:172.21.15.80:3300/0 conn(0x7ff5b406ce60 0x7ff5b4164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff5ac00f6b0 tx=0x7ff5ac00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5bb15f700 1 --2- 172.21.15.80:0/2910188452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b406ce60 0x7ff5b4164d70 secure :-1 s=READY pgs=2137 cs=0 l=1 rx=0x7ff5ac00f6b0 tx=0x7ff5ac00fa50).ready entity=mon.0 client_cookie=1da098623e66d404 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5bb15f700 1 --2- 172.21.15.80:0/2910188452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b406ce60 0x7ff5b4164d70 secure :-1 s=THROTTLE_DONE pgs=2137 cs=0 l=1 rx=0x7ff5ac00f6b0 tx=0x7ff5ac00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5b995c700 1 -- 172.21.15.80:0/2910188452 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5ac000a70 con 0x7ff5b406ce60 2019-11-28T11:49:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5bb15f700 1 --2- 172.21.15.80:0/2910188452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b406ce60 0x7ff5b4164d70 secure :-1 s=THROTTLE_DONE pgs=2137 cs=0 l=1 rx=0x7ff5ac00f6b0 tx=0x7ff5ac00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5bb15f700 1 --2- 172.21.15.80:0/2910188452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b406ce60 0x7ff5b4164d70 secure :-1 s=THROTTLE_DONE pgs=2137 cs=0 l=1 rx=0x7ff5ac00f6b0 tx=0x7ff5ac00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5b995c700 1 -- 172.21.15.80:0/2910188452 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac0010e0 con 0x7ff5b406ce60 2019-11-28T11:49:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5b995c700 1 -- 172.21.15.80:0/2910188452 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5ac0017d0 con 0x7ff5b406ce60 2019-11-28T11:49:55.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5bc3c1700 1 -- 172.21.15.80:0/2910188452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b406ce60 msgr2=0x7ff5b4164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.770+0000 7ff5bc3c1700 1 --2- 172.21.15.80:0/2910188452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b406ce60 0x7ff5b4164d70 secure :-1 s=READY pgs=2137 cs=0 l=1 rx=0x7ff5ac00f6b0 tx=0x7ff5ac00fa50).stop 2019-11-28T11:49:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.771+0000 7ff5bc3c1700 1 -- 172.21.15.80:0/2910188452 shutdown_connections 2019-11-28T11:49:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.771+0000 7ff5bc3c1700 1 --2- 172.21.15.80:0/2910188452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b406ce60 0x7ff5b4164d70 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.771+0000 7ff5bc3c1700 1 --2- 172.21.15.80:0/2910188452 >> v2:172.21.15.174:3300/0 conn(0x7ff5b406c490 0x7ff5b406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.771+0000 7ff5bc3c1700 1 -- 172.21.15.80:0/2910188452 shutdown_connections 2019-11-28T11:49:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.771+0000 7ff5bc3c1700 1 -- 172.21.15.80:0/2910188452 wait complete. 2019-11-28T11:49:55.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.771+0000 7ff5bc3c1700 1 -- 172.21.15.80:0/2910188452 >> 172.21.15.80:0/2910188452 conn(0x7ff5b4061cf0 msgr2=0x7ff5b4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.773+0000 7ff5bc3c1700 1 Processor -- start 2019-11-28T11:49:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.773+0000 7ff5bc3c1700 1 -- start start 2019-11-28T11:49:55.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.774+0000 7ff5bc3c1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5b413dc00 0x7ff5b4109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.774+0000 7ff5bc3c1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b41312c0 con 0x7ff5b41094e0 2019-11-28T11:49:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.774+0000 7ff5bc3c1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b4104010 con 0x7ff5b410a3a0 2019-11-28T11:49:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.774+0000 7ff5bc3c1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b4105830 con 0x7ff5b413dc00 2019-11-28T11:49:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.774+0000 7ff5ba95e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5b413dc00 0x7ff5b4109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.774+0000 7ff5bb15f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff5b41094e0 0x7ff5b4167a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41886/0 (socket says 172.21.15.80:41886) 2019-11-28T11:49:55.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.774+0000 7ff5bb15f700 1 -- 172.21.15.80:0/1358257075 learned_addr learned my addr 172.21.15.80:0/1358257075 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.774+0000 7ff5ba95e700 1 --2- 172.21.15.80:0/1358257075 >> v2:172.21.15.80:3300/0 conn(0x7ff5b413dc00 0x7ff5b4109e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42568/0 (socket says 172.21.15.80:42568) 2019-11-28T11:49:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.775+0000 7ff5ba95e700 1 -- 172.21.15.80:0/1358257075 >> v1:172.21.15.174:6789/0 conn(0x7ff5b410a3a0 legacy=0x7ff5b4108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.775+0000 7ff5ba95e700 1 -- 172.21.15.80:0/1358257075 >> v1:172.21.15.80:6789/0 conn(0x7ff5b41094e0 legacy=0x7ff5b4167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.775+0000 7ff5b37fe700 1 -- 172.21.15.80:0/1358257075 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379536041 0 0) 0x7ff5ac000b50 con 0x7ff5b41094e0 2019-11-28T11:49:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.775+0000 7ff5ba95e700 1 -- 172.21.15.80:0/1358257075 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b4106190 con 0x7ff5b413dc00 2019-11-28T11:49:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.775+0000 7ff5ba95e700 1 --2- 172.21.15.80:0/1358257075 >> v2:172.21.15.80:3300/0 conn(0x7ff5b413dc00 0x7ff5b4109e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5a4010350 tx=0x7ff5a40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.775+0000 7ff5ba95e700 1 --2- 172.21.15.80:0/1358257075 >> v2:172.21.15.80:3300/0 conn(0x7ff5b413dc00 0x7ff5b4109e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5a4010350 tx=0x7ff5a40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.775+0000 7ff5ba95e700 1 --2- 172.21.15.80:0/1358257075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b413dc00 0x7ff5b4109e60 secure :-1 s=READY pgs=2139 cs=0 l=1 rx=0x7ff5a4010350 tx=0x7ff5a40106f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:55.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.775+0000 7ff5ba95e700 1 --2- 172.21.15.80:0/1358257075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b413dc00 0x7ff5b4109e60 secure :-1 s=THROTTLE_DONE pgs=2139 cs=0 l=1 rx=0x7ff5a4010350 tx=0x7ff5a40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.775+0000 7ff5b37fe700 1 -- 172.21.15.80:0/1358257075 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5a4000ce0 con 0x7ff5b413dc00 2019-11-28T11:49:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.775+0000 7ff5ba95e700 1 --2- 172.21.15.80:0/1358257075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b413dc00 0x7ff5b4109e60 secure :-1 s=THROTTLE_DONE pgs=2139 cs=0 l=1 rx=0x7ff5a4010350 tx=0x7ff5a40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.775+0000 7ff5ba95e700 1 --2- 172.21.15.80:0/1358257075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b413dc00 0x7ff5b4109e60 secure :-1 s=THROTTLE_DONE pgs=2139 cs=0 l=1 rx=0x7ff5a4010350 tx=0x7ff5a40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.775+0000 7ff5b37fe700 1 -- 172.21.15.80:0/1358257075 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a400dd80 con 0x7ff5b413dc00 2019-11-28T11:49:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.775+0000 7ff5b37fe700 1 -- 172.21.15.80:0/1358257075 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5a400e410 con 0x7ff5b413dc00 2019-11-28T11:49:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.775+0000 7ff5bc3c1700 1 -- 172.21.15.80:0/1358257075 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b4106510 con 0x7ff5b413dc00 2019-11-28T11:49:55.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.775+0000 7ff5bc3c1700 1 -- 172.21.15.80:0/1358257075 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b4106190 con 0x7ff5b413dc00 2019-11-28T11:49:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.775+0000 7ff5ba95e700 1 --2- 172.21.15.80:0/1358257075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b413dc00 0x7ff5b4109e60 secure :-1 s=THROTTLE_DONE pgs=2139 cs=0 l=1 rx=0x7ff5a4010350 tx=0x7ff5a40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.776+0000 7ff5b37fe700 1 -- 172.21.15.80:0/1358257075 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff5a400d980 con 0x7ff5b413dc00 2019-11-28T11:49:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.776+0000 7ff5ba95e700 1 --2- 172.21.15.80:0/1358257075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b413dc00 0x7ff5b4109e60 secure :-1 s=THROTTLE_DONE pgs=2139 cs=0 l=1 rx=0x7ff5a4010350 tx=0x7ff5a40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.776+0000 7ff5b37fe700 1 --2- 172.21.15.80:0/1358257075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff59801a950 0x7ff59801cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.776+0000 7ff5b37fe700 1 -- 172.21.15.80:0/1358257075 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6106+0+0 (secure 0 0 0) 0x7ff5a4031a20 con 0x7ff5b413dc00 2019-11-28T11:49:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.776+0000 7ff5ba15d700 1 --2- 172.21.15.80:0/1358257075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff59801a950 0x7ff59801cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:55.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.776+0000 7ff5ba15d700 1 --2- 172.21.15.80:0/1358257075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff59801a950 0x7ff59801cde0 crc :-1 s=READY pgs=873 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.784+0000 7ff5bc3c1700 1 -- 172.21.15.80:0/1358257075 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b4106510 con 0x7ff5b413dc00 2019-11-28T11:49:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.787+0000 7ff5ba95e700 1 --2- 172.21.15.80:0/1358257075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b413dc00 0x7ff5b4109e60 secure :-1 s=THROTTLE_DONE pgs=2139 cs=0 l=1 rx=0x7ff5a4010350 tx=0x7ff5a40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:55.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.787+0000 7ff5b37fe700 1 -- 172.21.15.80:0/1358257075 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff5a4017550 con 0x7ff5b413dc00 2019-11-28T11:49:56.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.959+0000 7ff5bc3c1700 1 -- 172.21.15.80:0/1358257075 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5b4106190 con 0x7ff5b413dc00 2019-11-28T11:49:56.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.959+0000 7ff5ba95e700 1 --2- 172.21.15.80:0/1358257075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b413dc00 0x7ff5b4109e60 secure :-1 s=THROTTLE_DONE pgs=2139 cs=0 l=1 rx=0x7ff5a4010350 tx=0x7ff5a40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:56.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.959+0000 7ff5b37fe700 1 -- 172.21.15.80:0/1358257075 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) v1 ==== 95+0+2460 (secure 0 0 0) 0x7ff5a400d980 con 0x7ff5b413dc00 2019-11-28T11:49:56.010 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 129 2019-11-28T11:49:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:56.010 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":129,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7019,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1144103346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1144103346},{"type":"v1","addr":"172.21.15.80:6834","nonce":1144103346}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":127},{"gid":9613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3914187264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3914187264},{"type":"v1","addr":"172.21.15.80:6835","nonce":3914187264}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":127}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:49:54.911538+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7016":{"gid":7016,"name":"c","rank":0,"incarnation":128,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/2828740513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2828740513},{"type":"v1","addr":"172.21.15.174:6835","nonce":2828740513}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:49:56.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.962+0000 7ff5bc3c1700 1 -- 172.21.15.80:0/1358257075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff59801a950 msgr2=0x7ff59801cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:56.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.962+0000 7ff5bc3c1700 1 --2- 172.21.15.80:0/1358257075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff59801a950 0x7ff59801cde0 crc :-1 s=READY pgs=873 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.962+0000 7ff5bc3c1700 1 -- 172.21.15.80:0/1358257075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b413dc00 msgr2=0x7ff5b4109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.962+0000 7ff5bc3c1700 1 --2- 172.21.15.80:0/1358257075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b413dc00 0x7ff5b4109e60 secure :-1 s=READY pgs=2139 cs=0 l=1 rx=0x7ff5a4010350 tx=0x7ff5a40106f0).stop 2019-11-28T11:49:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.962+0000 7ff5bc3c1700 1 -- 172.21.15.80:0/1358257075 shutdown_connections 2019-11-28T11:49:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.962+0000 7ff5bc3c1700 1 --2- 172.21.15.80:0/1358257075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff59801a950 0x7ff59801cde0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.962+0000 7ff5bc3c1700 1 --2- 172.21.15.80:0/1358257075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5b413dc00 0x7ff5b4109e60 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.962+0000 7ff5bc3c1700 1 -- 172.21.15.80:0/1358257075 shutdown_connections 2019-11-28T11:49:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.962+0000 7ff5bc3c1700 1 -- 172.21.15.80:0/1358257075 wait complete. 2019-11-28T11:49:56.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:55.962+0000 7ff5bc3c1700 1 -- 172.21.15.80:0/1358257075 >> 172.21.15.80:0/1358257075 conn(0x7ff5b411bfc0 msgr2=0x7ff5b4141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:56.021 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session evict 6989 2019-11-28T11:49:56.981 INFO:tasks.cephfs.filesystem:_json_asok output: 2019-11-28T11:49:56.981 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:49:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.053+0000 7faff5a04700 1 Processor -- start 2019-11-28T11:49:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.053+0000 7faff5a04700 1 -- start start 2019-11-28T11:49:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.054+0000 7faff5a04700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff006c490 0x7faff006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.054+0000 7faff5a04700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff006db00 con 0x7faff006ce60 2019-11-28T11:49:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.054+0000 7faff5a04700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff006e000 con 0x7faff006c0a0 2019-11-28T11:49:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.054+0000 7faff5a04700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff006fd60 con 0x7faff006c490 2019-11-28T11:49:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.054+0000 7fafeffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faff006ce60 0x7faff0164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41892/0 (socket says 172.21.15.80:41892) 2019-11-28T11:49:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.054+0000 7fafeffff700 1 -- 172.21.15.80:0/339640146 learned_addr learned my addr 172.21.15.80:0/339640146 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafeeffd700 1 --2- 172.21.15.80:0/339640146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff006c490 0x7faff006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafee7fc700 1 -- 172.21.15.80:0/339640146 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124759003 0 0) 0x7fafe80014d0 con 0x7faff006ce60 2019-11-28T11:49:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafee7fc700 1 -- 172.21.15.80:0/339640146 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafdc002e80 con 0x7faff006ce60 2019-11-28T11:49:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafee7fc700 1 -- 172.21.15.80:0/339640146 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369721093 0 0) 0x7fafd8001080 con 0x7faff006c0a0 2019-11-28T11:49:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafee7fc700 1 -- 172.21.15.80:0/339640146 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafdc0030b0 con 0x7faff006c0a0 2019-11-28T11:49:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafeeffd700 1 -- 172.21.15.80:0/339640146 >> v1:172.21.15.174:6789/0 conn(0x7faff006c0a0 legacy=0x7faff0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:57.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafeeffd700 1 -- 172.21.15.80:0/339640146 >> v1:172.21.15.80:6789/0 conn(0x7faff006ce60 legacy=0x7faff0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:57.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafee7fc700 1 -- 172.21.15.80:0/339640146 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 589522138 0 0) 0x7fafe80014b0 con 0x7faff006ce60 2019-11-28T11:49:57.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafeeffd700 1 -- 172.21.15.80:0/339640146 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff00706c0 con 0x7faff006c490 2019-11-28T11:49:57.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafeeffd700 1 --2- 172.21.15.80:0/339640146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff006c490 0x7faff006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fafe000af50 tx=0x7fafe000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafeeffd700 1 --2- 172.21.15.80:0/339640146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff006c490 0x7faff006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fafe000af50 tx=0x7fafe000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafeeffd700 1 --2- 172.21.15.80:0/339640146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff006c490 0x7faff006c920 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7fafe000af50 tx=0x7fafe000b760).ready entity=mon.2 client_cookie=483234b60f7daf43 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:57.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafeeffd700 1 --2- 172.21.15.80:0/339640146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff006c490 0x7faff006c920 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7fafe000af50 tx=0x7fafe000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafee7fc700 1 -- 172.21.15.80:0/339640146 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafe0000960 con 0x7faff006c490 2019-11-28T11:49:57.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafeeffd700 1 --2- 172.21.15.80:0/339640146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff006c490 0x7faff006c920 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7fafe000af50 tx=0x7fafe000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafee7fc700 1 -- 172.21.15.80:0/339640146 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe0007210 con 0x7faff006c490 2019-11-28T11:49:57.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafeeffd700 1 --2- 172.21.15.80:0/339640146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff006c490 0x7faff006c920 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7fafe000af50 tx=0x7fafe000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7fafee7fc700 1 -- 172.21.15.80:0/339640146 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafe0009ba0 con 0x7faff006c490 2019-11-28T11:49:57.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7faff5a04700 1 -- 172.21.15.80:0/339640146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff006c490 msgr2=0x7faff006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:57.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.055+0000 7faff5a04700 1 --2- 172.21.15.80:0/339640146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff006c490 0x7faff006c920 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7fafe000af50 tx=0x7fafe000b760).stop 2019-11-28T11:49:57.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.056+0000 7faff5a04700 1 -- 172.21.15.80:0/339640146 shutdown_connections 2019-11-28T11:49:57.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.056+0000 7faff5a04700 1 --2- 172.21.15.80:0/339640146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff006c490 0x7faff006c920 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:57.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.056+0000 7faff5a04700 1 -- 172.21.15.80:0/339640146 shutdown_connections 2019-11-28T11:49:57.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.056+0000 7faff5a04700 1 -- 172.21.15.80:0/339640146 wait complete. 2019-11-28T11:49:57.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.056+0000 7faff5a04700 1 -- 172.21.15.80:0/339640146 >> 172.21.15.80:0/339640146 conn(0x7faff0061cf0 msgr2=0x7faff0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:57.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.058+0000 7faff5a04700 1 Processor -- start 2019-11-28T11:49:57.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.059+0000 7faff5a04700 1 -- start start 2019-11-28T11:49:57.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.059+0000 7faff5a04700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff0169c50 0x7faff016c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:57.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.059+0000 7faff5a04700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff0116b90 con 0x7faff0164a10 2019-11-28T11:49:57.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.059+0000 7faff5a04700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff0154b40 con 0x7faff01167a0 2019-11-28T11:49:57.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.059+0000 7faff5a04700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff01563f0 con 0x7faff0169c50 2019-11-28T11:49:57.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.059+0000 7fafeeffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faff0164a10 0x7faff0164ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41898/0 (socket says 172.21.15.80:41898) 2019-11-28T11:49:57.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.059+0000 7fafeeffd700 1 -- 172.21.15.80:0/270215586 learned_addr learned my addr 172.21.15.80:0/270215586 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:57.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafeffff700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff0169c50 0x7faff016c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:57.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafe7fff700 1 -- 172.21.15.80:0/270215586 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232565732 0 0) 0x7fafe000ac20 con 0x7faff0164a10 2019-11-28T11:49:57.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafe7fff700 1 -- 172.21.15.80:0/270215586 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafd4002e80 con 0x7faff0164a10 2019-11-28T11:49:57.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafe7fff700 1 -- 172.21.15.80:0/270215586 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317026201 0 0) 0x7fafd8001030 con 0x7faff01167a0 2019-11-28T11:49:57.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafe7fff700 1 -- 172.21.15.80:0/270215586 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafd4002e80 con 0x7faff01167a0 2019-11-28T11:49:57.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafeffff700 1 -- 172.21.15.80:0/270215586 >> v1:172.21.15.174:6789/0 conn(0x7faff01167a0 legacy=0x7faff0121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:57.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafeffff700 1 -- 172.21.15.80:0/270215586 >> v1:172.21.15.80:6789/0 conn(0x7faff0164a10 legacy=0x7faff0164ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:57.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafeffff700 1 -- 172.21.15.80:0/270215586 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff0156d50 con 0x7faff0169c50 2019-11-28T11:49:57.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafeffff700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff0169c50 0x7faff016c050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fafe80106f0 tx=0x7fafe8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafeffff700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff0169c50 0x7faff016c050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fafe80106f0 tx=0x7fafe8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafeffff700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff0169c50 0x7faff016c050 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7fafe80106f0 tx=0x7fafe8010a90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:57.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafeffff700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff0169c50 0x7faff016c050 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7fafe80106f0 tx=0x7fafe8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafe7fff700 1 -- 172.21.15.80:0/270215586 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafe8001270 con 0x7faff0169c50 2019-11-28T11:49:57.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafeffff700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff0169c50 0x7faff016c050 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7fafe80106f0 tx=0x7fafe8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafeffff700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff0169c50 0x7faff016c050 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7fafe80106f0 tx=0x7fafe8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafe7fff700 1 -- 172.21.15.80:0/270215586 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe80047b0 con 0x7faff0169c50 2019-11-28T11:49:57.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7fafe7fff700 1 -- 172.21.15.80:0/270215586 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafe8004e80 con 0x7faff0169c50 2019-11-28T11:49:57.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7faff5a04700 1 -- 172.21.15.80:0/270215586 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff01570d0 con 0x7faff0169c50 2019-11-28T11:49:57.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.060+0000 7faff5a04700 1 -- 172.21.15.80:0/270215586 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff0156d50 con 0x7faff0169c50 2019-11-28T11:49:57.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.061+0000 7fafeffff700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff0169c50 0x7faff016c050 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7fafe80106f0 tx=0x7fafe8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.061+0000 7fafe7fff700 1 -- 172.21.15.80:0/270215586 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fafe80049a0 con 0x7faff0169c50 2019-11-28T11:49:57.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.061+0000 7fafeffff700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff0169c50 0x7faff016c050 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7fafe80106f0 tx=0x7fafe8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.061+0000 7fafe7fff700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fafd4018750 0x7fafd401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:57.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.061+0000 7fafe7fff700 1 -- 172.21.15.80:0/270215586 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fafe8031e10 con 0x7faff0169c50 2019-11-28T11:49:57.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.061+0000 7fafef7fe700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fafd4018750 0x7fafd401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:57.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.061+0000 7fafef7fe700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fafd4018750 0x7fafd401abe0 crc :-1 s=READY pgs=874 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:57.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.069+0000 7faff5a04700 1 -- 172.21.15.80:0/270215586 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff01570d0 con 0x7faff0169c50 2019-11-28T11:49:57.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.073+0000 7fafeffff700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff0169c50 0x7faff016c050 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7fafe80106f0 tx=0x7fafe8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.073+0000 7fafe7fff700 1 -- 172.21.15.80:0/270215586 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fafe8000cc0 con 0x7faff0169c50 2019-11-28T11:49:57.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.245+0000 7faff5a04700 1 -- 172.21.15.80:0/270215586 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faff0156d50 con 0x7faff0169c50 2019-11-28T11:49:57.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.245+0000 7fafeffff700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff0169c50 0x7faff016c050 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7fafe80106f0 tx=0x7fafe8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.245+0000 7fafe7fff700 1 -- 172.21.15.80:0/270215586 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) v1 ==== 95+0+2460 (secure 0 0 0) 0x7fafe8004980 con 0x7faff0169c50 2019-11-28T11:49:57.296 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 129 2019-11-28T11:49:57.296 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:57.296 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":129,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7019,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1144103346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1144103346},{"type":"v1","addr":"172.21.15.80:6834","nonce":1144103346}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":127},{"gid":9613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3914187264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3914187264},{"type":"v1","addr":"172.21.15.80:6835","nonce":3914187264}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":127}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:49:54.911538+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7016":{"gid":7016,"name":"c","rank":0,"incarnation":128,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/2828740513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2828740513},{"type":"v1","addr":"172.21.15.174:6835","nonce":2828740513}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:49:57.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.248+0000 7faff5a04700 1 -- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fafd4018750 msgr2=0x7fafd401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:57.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.248+0000 7faff5a04700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fafd4018750 0x7fafd401abe0 crc :-1 s=READY pgs=874 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:57.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.248+0000 7faff5a04700 1 -- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff0169c50 msgr2=0x7faff016c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:57.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.248+0000 7faff5a04700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff0169c50 0x7faff016c050 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7fafe80106f0 tx=0x7fafe8010a90).stop 2019-11-28T11:49:57.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.248+0000 7faff5a04700 1 -- 172.21.15.80:0/270215586 shutdown_connections 2019-11-28T11:49:57.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.248+0000 7faff5a04700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faff0169c50 0x7faff016c050 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:57.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.248+0000 7faff5a04700 1 --2- 172.21.15.80:0/270215586 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fafd4018750 0x7fafd401abe0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:57.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.248+0000 7faff5a04700 1 -- 172.21.15.80:0/270215586 shutdown_connections 2019-11-28T11:49:57.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.248+0000 7faff5a04700 1 -- 172.21.15.80:0/270215586 wait complete. 2019-11-28T11:49:57.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.248+0000 7faff5a04700 1 -- 172.21.15.80:0/270215586 >> 172.21.15.80:0/270215586 conn(0x7faff01426c0 msgr2=0x7faff0110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:57.307 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session ls 2019-11-28T11:49:57.433 INFO:teuthology.orchestra.run.smithi174.stdout:[ 2019-11-28T11:49:57.434 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:49:57.434 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 6998, 2019-11-28T11:49:57.434 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:49:57.434 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:49:57.435 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:49:57.435 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 6998 2019-11-28T11:49:57.435 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:57.435 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:49:57.436 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:49:57.436 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.16:0", 2019-11-28T11:49:57.436 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 1552752389 2019-11-28T11:49:57.436 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:49:57.437 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:57.437 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:49:57.437 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:49:57.437 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 1, 2019-11-28T11:49:57.438 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 0, 2019-11-28T11:49:57.443 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 3.4679507009999999, 2019-11-28T11:49:57.444 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:49:57.445 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 0, 2019-11-28T11:49:57.445 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:49:57.445 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:49:57.445 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:49:57.446 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:49:57.446 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:57.446 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:49:57.446 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:49:57.447 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:49:57.447 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:57.447 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:49:57.447 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:49:57.448 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:49:57.448 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:57.448 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:49:57.451 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:49:57.451 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:49:57.451 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:57.451 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:49:57.451 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0.99433009836906805, 2019-11-28T11:49:57.451 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:49:57.452 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:49:57.452 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.6998 v1:172.21.15.16:0/1552752389", 2019-11-28T11:49:57.452 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [], 2019-11-28T11:49:57.452 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T11:49:57.452 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:49:57.452 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:49:57.452 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:49:57.453 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "1", 2019-11-28T11:49:57.453 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi016", 2019-11-28T11:49:57.453 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:49:57.453 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:49:57.453 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:49:57.453 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:49:57.454 INFO:teuthology.orchestra.run.smithi174.stdout:] 2019-11-28T11:49:57.455 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 6998, "entity": { "name": { "type": "client", "num": 6998 }, "addr": { "type": "v1", "addr": "172.21.15.16:0", "nonce": 1552752389 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 3.4679507009999999, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.99433009836906805, "halflife": 300 }, "inst": "client.6998 v1:172.21.15.16:0/1552752389", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "1", "hostname": "smithi016", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:49:57.455 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:49:57.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.525+0000 7fa73bd54700 1 Processor -- start 2019-11-28T11:49:57.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.525+0000 7fa73bd54700 1 -- start start 2019-11-28T11:49:57.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.526+0000 7fa73bd54700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa73406c0a0 0x7fa734072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:57.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.526+0000 7fa73bd54700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73406db00 con 0x7fa7340734e0 2019-11-28T11:49:57.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.526+0000 7fa73bd54700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73406e000 con 0x7fa734072620 2019-11-28T11:49:57.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.526+0000 7fa73bd54700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73406f330 con 0x7fa73406c0a0 2019-11-28T11:49:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa739af0700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa7340734e0 0x7fa734071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41908/0 (socket says 172.21.15.80:41908) 2019-11-28T11:49:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa739af0700 1 -- 172.21.15.80:0/420777962 learned_addr learned my addr 172.21.15.80:0/420777962 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa73a2f1700 1 --2- 172.21.15.80:0/420777962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa73406c0a0 0x7fa734072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa7392ef700 1 -- 172.21.15.80:0/420777962 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654623437 0 0) 0x7fa724001070 con 0x7fa7340734e0 2019-11-28T11:49:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa7392ef700 1 -- 172.21.15.80:0/420777962 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa720002e80 con 0x7fa7340734e0 2019-11-28T11:49:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa7392ef700 1 -- 172.21.15.80:0/420777962 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112048125 0 0) 0x7fa72c0009b0 con 0x7fa734072620 2019-11-28T11:49:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa7392ef700 1 -- 172.21.15.80:0/420777962 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7200030b0 con 0x7fa734072620 2019-11-28T11:49:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa73a2f1700 1 -- 172.21.15.80:0/420777962 >> v1:172.21.15.174:6789/0 conn(0x7fa734072620 legacy=0x7fa734164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa73a2f1700 1 -- 172.21.15.80:0/420777962 >> v1:172.21.15.80:6789/0 conn(0x7fa7340734e0 legacy=0x7fa734071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa73a2f1700 1 -- 172.21.15.80:0/420777962 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7340706c0 con 0x7fa73406c0a0 2019-11-28T11:49:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa73a2f1700 1 --2- 172.21.15.80:0/420777962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa73406c0a0 0x7fa734072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa71c00b2d0 tx=0x7fa71c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa73a2f1700 1 --2- 172.21.15.80:0/420777962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa73406c0a0 0x7fa734072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa71c00b2d0 tx=0x7fa71c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa73a2f1700 1 --2- 172.21.15.80:0/420777962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa73406c0a0 0x7fa734072fa0 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7fa71c00b2d0 tx=0x7fa71c00bae0).ready entity=mon.2 client_cookie=11227af698e401fb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa73a2f1700 1 --2- 172.21.15.80:0/420777962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa73406c0a0 0x7fa734072fa0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7fa71c00b2d0 tx=0x7fa71c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa7392ef700 1 -- 172.21.15.80:0/420777962 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa71c000ce0 con 0x7fa73406c0a0 2019-11-28T11:49:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa73a2f1700 1 --2- 172.21.15.80:0/420777962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa73406c0a0 0x7fa734072fa0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7fa71c00b2d0 tx=0x7fa71c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa73a2f1700 1 --2- 172.21.15.80:0/420777962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa73406c0a0 0x7fa734072fa0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7fa71c00b2d0 tx=0x7fa71c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa7392ef700 1 -- 172.21.15.80:0/420777962 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71c009be0 con 0x7fa73406c0a0 2019-11-28T11:49:57.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa7392ef700 1 -- 172.21.15.80:0/420777962 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa71c000ce0 con 0x7fa73406c0a0 2019-11-28T11:49:57.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa73bd54700 1 -- 172.21.15.80:0/420777962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa73406c0a0 msgr2=0x7fa734072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:57.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.527+0000 7fa73bd54700 1 --2- 172.21.15.80:0/420777962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa73406c0a0 0x7fa734072fa0 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7fa71c00b2d0 tx=0x7fa71c00bae0).stop 2019-11-28T11:49:57.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.528+0000 7fa73bd54700 1 -- 172.21.15.80:0/420777962 shutdown_connections 2019-11-28T11:49:57.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.528+0000 7fa73bd54700 1 --2- 172.21.15.80:0/420777962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa73406c0a0 0x7fa734072fa0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:57.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.528+0000 7fa73bd54700 1 -- 172.21.15.80:0/420777962 shutdown_connections 2019-11-28T11:49:57.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.528+0000 7fa73bd54700 1 -- 172.21.15.80:0/420777962 wait complete. 2019-11-28T11:49:57.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.528+0000 7fa73bd54700 1 -- 172.21.15.80:0/420777962 >> 172.21.15.80:0/420777962 conn(0x7fa734061cf0 msgr2=0x7fa734064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:57.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.531+0000 7fa73bd54700 1 Processor -- start 2019-11-28T11:49:57.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.531+0000 7fa73bd54700 1 -- start start 2019-11-28T11:49:57.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.531+0000 7fa73bd54700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7341342c0 0x7fa7341346b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:57.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.531+0000 7fa73bd54700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa7341361c0 0x7fa73415c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:57.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.531+0000 7fa73bd54700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa734136650 0x7fa73415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:57.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.531+0000 7fa73bd54700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa734140970 con 0x7fa734136650 2019-11-28T11:49:57.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.531+0000 7fa73bd54700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa734140c40 con 0x7fa7341361c0 2019-11-28T11:49:57.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.531+0000 7fa73bd54700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa734140f10 con 0x7fa7341342c0 2019-11-28T11:49:57.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73aaf2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa734136650 0x7fa73415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:57.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73aaf2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa734136650 0x7fa73415cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42598/0 (socket says 172.21.15.80:42598) 2019-11-28T11:49:57.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73aaf2700 1 -- 172.21.15.80:0/34247040 learned_addr learned my addr 172.21.15.80:0/34247040 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:57.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73a2f1700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7341342c0 0x7fa7341346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:57.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa739af0700 1 --2- 172.21.15.80:0/34247040 >> v2:172.21.15.174:3300/0 conn(0x7fa7341361c0 0x7fa73415c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:57.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73aaf2700 1 -- 172.21.15.80:0/34247040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7341342c0 msgr2=0x7fa7341346b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:57.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73aaf2700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7341342c0 0x7fa7341346b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:57.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73aaf2700 1 -- 172.21.15.80:0/34247040 >> v2:172.21.15.174:3300/0 conn(0x7fa7341361c0 msgr2=0x7fa73415c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:57.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73aaf2700 1 --2- 172.21.15.80:0/34247040 >> v2:172.21.15.174:3300/0 conn(0x7fa7341361c0 0x7fa73415c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:57.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73aaf2700 1 -- 172.21.15.80:0/34247040 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa734141fd0 con 0x7fa734136650 2019-11-28T11:49:57.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73aaf2700 1 --2- 172.21.15.80:0/34247040 >> v2:172.21.15.80:3300/0 conn(0x7fa734136650 0x7fa73415cee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa72c010410 tx=0x7fa72c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73aaf2700 1 --2- 172.21.15.80:0/34247040 >> v2:172.21.15.80:3300/0 conn(0x7fa734136650 0x7fa73415cee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa72c010410 tx=0x7fa72c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73aaf2700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa734136650 0x7fa73415cee0 secure :-1 s=READY pgs=2143 cs=0 l=1 rx=0x7fa72c010410 tx=0x7fa72c010310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:57.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73aaf2700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa734136650 0x7fa73415cee0 secure :-1 s=THROTTLE_DONE pgs=2143 cs=0 l=1 rx=0x7fa72c010410 tx=0x7fa72c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73aaf2700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa734136650 0x7fa73415cee0 secure :-1 s=THROTTLE_DONE pgs=2143 cs=0 l=1 rx=0x7fa72c010410 tx=0x7fa72c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73aaf2700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa734136650 0x7fa73415cee0 secure :-1 s=THROTTLE_DONE pgs=2143 cs=0 l=1 rx=0x7fa72c010410 tx=0x7fa72c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa732ffd700 1 -- 172.21.15.80:0/34247040 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa72c005770 con 0x7fa734136650 2019-11-28T11:49:57.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa732ffd700 1 -- 172.21.15.80:0/34247040 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c005390 con 0x7fa734136650 2019-11-28T11:49:57.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa732ffd700 1 -- 172.21.15.80:0/34247040 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa72c0075d0 con 0x7fa734136650 2019-11-28T11:49:57.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73bd54700 1 -- 172.21.15.80:0/34247040 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa734142350 con 0x7fa734136650 2019-11-28T11:49:57.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.532+0000 7fa73bd54700 1 -- 172.21.15.80:0/34247040 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa734141fd0 con 0x7fa734136650 2019-11-28T11:49:57.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.533+0000 7fa73aaf2700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa734136650 0x7fa73415cee0 secure :-1 s=THROTTLE_DONE pgs=2143 cs=0 l=1 rx=0x7fa72c010410 tx=0x7fa72c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.533+0000 7fa732ffd700 1 -- 172.21.15.80:0/34247040 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa72c005580 con 0x7fa734136650 2019-11-28T11:49:57.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.533+0000 7fa73aaf2700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa734136650 0x7fa73415cee0 secure :-1 s=THROTTLE_DONE pgs=2143 cs=0 l=1 rx=0x7fa72c010410 tx=0x7fa72c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.533+0000 7fa732ffd700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa718018730 0x7fa71801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.533+0000 7fa732ffd700 1 -- 172.21.15.80:0/34247040 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fa72c0319d0 con 0x7fa734136650 2019-11-28T11:49:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.533+0000 7fa73a2f1700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa718018730 0x7fa71801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.533+0000 7fa73a2f1700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa718018730 0x7fa71801abc0 crc :-1 s=READY pgs=875 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:57.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.541+0000 7fa73bd54700 1 -- 172.21.15.80:0/34247040 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa734142350 con 0x7fa734136650 2019-11-28T11:49:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.544+0000 7fa73aaf2700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa734136650 0x7fa73415cee0 secure :-1 s=THROTTLE_DONE pgs=2143 cs=0 l=1 rx=0x7fa72c010410 tx=0x7fa72c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.544+0000 7fa732ffd700 1 -- 172.21.15.80:0/34247040 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa72c000940 con 0x7fa734136650 2019-11-28T11:49:57.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.716+0000 7fa73bd54700 1 -- 172.21.15.80:0/34247040 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa734141fd0 con 0x7fa734136650 2019-11-28T11:49:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.716+0000 7fa73aaf2700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa734136650 0x7fa73415cee0 secure :-1 s=THROTTLE_DONE pgs=2143 cs=0 l=1 rx=0x7fa72c010410 tx=0x7fa72c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:57.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.716+0000 7fa732ffd700 1 -- 172.21.15.80:0/34247040 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) v1 ==== 95+0+2460 (secure 0 0 0) 0x7fa72c005580 con 0x7fa734136650 2019-11-28T11:49:57.773 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 129 2019-11-28T11:49:57.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.719+0000 7fa73bd54700 1 -- 172.21.15.80:0/34247040 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa718018730 msgr2=0x7fa71801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:57.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.719+0000 7fa73bd54700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa718018730 0x7fa71801abc0 crc :-1 s=READY pgs=875 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:57.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.719+0000 7fa73bd54700 1 -- 172.21.15.80:0/34247040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa734136650 msgr2=0x7fa73415cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:57.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.719+0000 7fa73bd54700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa734136650 0x7fa73415cee0 secure :-1 s=READY pgs=2143 cs=0 l=1 rx=0x7fa72c010410 tx=0x7fa72c010310).stop 2019-11-28T11:49:57.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.719+0000 7fa73bd54700 1 -- 172.21.15.80:0/34247040 shutdown_connections 2019-11-28T11:49:57.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.719+0000 7fa73bd54700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa718018730 0x7fa71801abc0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:57.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.719+0000 7fa73bd54700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa734136650 0x7fa73415cee0 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:57.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.719+0000 7fa73bd54700 1 --2- 172.21.15.80:0/34247040 >> v2:172.21.15.174:3300/0 conn(0x7fa7341361c0 0x7fa73415c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:57.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.719+0000 7fa73bd54700 1 --2- 172.21.15.80:0/34247040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7341342c0 0x7fa7341346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.719+0000 7fa73bd54700 1 -- 172.21.15.80:0/34247040 shutdown_connections 2019-11-28T11:49:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.719+0000 7fa73bd54700 1 -- 172.21.15.80:0/34247040 wait complete. 2019-11-28T11:49:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:57.719+0000 7fa73bd54700 1 -- 172.21.15.80:0/34247040 >> 172.21.15.80:0/34247040 conn(0x7fa734159ae0 msgr2=0x7fa73413d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:57.775 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":129,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7019,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1144103346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1144103346},{"type":"v1","addr":"172.21.15.80:6834","nonce":1144103346}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":127},{"gid":9613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3914187264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3914187264},{"type":"v1","addr":"172.21.15.80:6835","nonce":3914187264}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":127}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:49:54.911538+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7016":{"gid":7016,"name":"c","rank":0,"incarnation":128,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/2828740513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2828740513},{"type":"v1","addr":"172.21.15.174:6835","nonce":2828740513}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:49:57.777 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:49:58.778 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:49:58.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.852+0000 7fc4df010700 1 Processor -- start 2019-11-28T11:49:58.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.853+0000 7fc4df010700 1 -- start start 2019-11-28T11:49:58.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.853+0000 7fc4df010700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc4d806c0a0 0x7fc4d8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:58.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4df010700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d806db00 con 0x7fc4d8072620 2019-11-28T11:49:58.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4df010700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d806e000 con 0x7fc4d80734e0 2019-11-28T11:49:58.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4df010700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d806fd60 con 0x7fc4d806c0a0 2019-11-28T11:49:58.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4dddae700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc4d8072620 0x7fc4d8164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41920/0 (socket says 172.21.15.80:41920) 2019-11-28T11:49:58.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4dddae700 1 -- 172.21.15.80:0/101334500 learned_addr learned my addr 172.21.15.80:0/101334500 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:49:58.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4d7fff700 1 -- 172.21.15.80:0/101334500 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052212962 0 0) 0x7fc4d0001150 con 0x7fc4d8072620 2019-11-28T11:49:58.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4dd5ad700 1 --2- 172.21.15.80:0/101334500 >> v2:172.21.15.174:3300/0 conn(0x7fc4d806c0a0 0x7fc4d8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:58.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4d7fff700 1 -- 172.21.15.80:0/101334500 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4c4002e80 con 0x7fc4d8072620 2019-11-28T11:49:58.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4d7fff700 1 -- 172.21.15.80:0/101334500 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3397267714 0 0) 0x7fc4d0001130 con 0x7fc4d8072620 2019-11-28T11:49:58.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4d7fff700 1 -- 172.21.15.80:0/101334500 >> v2:172.21.15.174:3300/0 conn(0x7fc4d806c0a0 msgr2=0x7fc4d8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:58.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4d7fff700 1 --2- 172.21.15.80:0/101334500 >> v2:172.21.15.174:3300/0 conn(0x7fc4d806c0a0 0x7fc4d8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:58.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4d7fff700 1 -- 172.21.15.80:0/101334500 >> v1:172.21.15.174:6789/0 conn(0x7fc4d80734e0 legacy=0x7fc4d8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:58.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4d7fff700 1 -- 172.21.15.80:0/101334500 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d80706c0 con 0x7fc4d8072620 2019-11-28T11:49:58.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4d7fff700 1 -- 172.21.15.80:0/101334500 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc4d00016c0 con 0x7fc4d8072620 2019-11-28T11:49:58.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4d7fff700 1 -- 172.21.15.80:0/101334500 >> v1:172.21.15.80:6789/0 conn(0x7fc4d8072620 legacy=0x7fc4d8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:58.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4d7fff700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4c4003ab0 0x7fc4c4005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4d7fff700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4c4006690 0x7fc4c4008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4d7fff700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4c4009380 0x7fc4c400b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:49:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4d7fff700 1 -- 172.21.15.80:0/101334500 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c400c000 con 0x7fc4c4003ab0 2019-11-28T11:49:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4d7fff700 1 -- 172.21.15.80:0/101334500 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c4050200 con 0x7fc4c4006690 2019-11-28T11:49:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4d7fff700 1 -- 172.21.15.80:0/101334500 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c4050430 con 0x7fc4c4009380 2019-11-28T11:49:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.854+0000 7fc4dd5ad700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4c4003ab0 0x7fc4c4005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:58.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4dcdac700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4c4006690 0x7fc4c4008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:58.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4dddae700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4c4009380 0x7fc4c400b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:58.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4dd5ad700 1 -- 172.21.15.80:0/101334500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4c4009380 msgr2=0x7fc4c400b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:58.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4dd5ad700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4c4009380 0x7fc4c400b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:58.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4dd5ad700 1 -- 172.21.15.80:0/101334500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4c4006690 msgr2=0x7fc4c4008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:49:58.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4dd5ad700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4c4006690 0x7fc4c4008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:49:58.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4dd5ad700 1 -- 172.21.15.80:0/101334500 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c40506e0 con 0x7fc4c4003ab0 2019-11-28T11:49:58.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4dcdac700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4c4006690 0x7fc4c4008b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:49:58.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4dddae700 1 -- 172.21.15.80:0/101334500 reap_dead start 2019-11-28T11:49:58.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4dd5ad700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4c4003ab0 0x7fc4c4005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc4c800b230 tx=0x7fc4c800b990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:58.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4dd5ad700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4c4003ab0 0x7fc4c4005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc4c800b230 tx=0x7fc4c800b990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:58.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4dd5ad700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4c4003ab0 0x7fc4c4005f10 secure :-1 s=READY pgs=2145 cs=0 l=1 rx=0x7fc4c800b230 tx=0x7fc4c800b990).ready entity=mon.0 client_cookie=cf8e1cd0b7d66b28 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:58.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4dd5ad700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4c4003ab0 0x7fc4c4005f10 secure :-1 s=THROTTLE_DONE pgs=2145 cs=0 l=1 rx=0x7fc4c800b230 tx=0x7fc4c800b990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:58.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4d7fff700 1 -- 172.21.15.80:0/101334500 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4c8000960 con 0x7fc4c4003ab0 2019-11-28T11:49:58.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4dd5ad700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4c4003ab0 0x7fc4c4005f10 secure :-1 s=THROTTLE_DONE pgs=2145 cs=0 l=1 rx=0x7fc4c800b230 tx=0x7fc4c800b990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:58.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4d7fff700 1 -- 172.21.15.80:0/101334500 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c800a8a0 con 0x7fc4c4003ab0 2019-11-28T11:49:58.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4dd5ad700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4c4003ab0 0x7fc4c4005f10 secure :-1 s=THROTTLE_DONE pgs=2145 cs=0 l=1 rx=0x7fc4c800b230 tx=0x7fc4c800b990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:58.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4d7fff700 1 -- 172.21.15.80:0/101334500 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4c8000960 con 0x7fc4c4003ab0 2019-11-28T11:49:58.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4df010700 1 -- 172.21.15.80:0/101334500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4c4003ab0 msgr2=0x7fc4c4005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:58.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.855+0000 7fc4df010700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4c4003ab0 0x7fc4c4005f10 secure :-1 s=READY pgs=2145 cs=0 l=1 rx=0x7fc4c800b230 tx=0x7fc4c800b990).stop 2019-11-28T11:49:58.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.856+0000 7fc4df010700 1 -- 172.21.15.80:0/101334500 shutdown_connections 2019-11-28T11:49:58.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.856+0000 7fc4df010700 1 --2- 172.21.15.80:0/101334500 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4c4003ab0 0x7fc4c4005f10 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:58.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.856+0000 7fc4df010700 1 -- 172.21.15.80:0/101334500 shutdown_connections 2019-11-28T11:49:58.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.856+0000 7fc4df010700 1 -- 172.21.15.80:0/101334500 wait complete. 2019-11-28T11:49:58.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.856+0000 7fc4df010700 1 -- 172.21.15.80:0/101334500 >> 172.21.15.80:0/101334500 conn(0x7fc4d8061cf0 msgr2=0x7fc4d8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:58.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.858+0000 7fc4df010700 1 Processor -- start 2019-11-28T11:49:58.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.858+0000 7fc4df010700 1 -- start start 2019-11-28T11:49:58.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.859+0000 7fc4df010700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc4d8074d00 0x7fc4d807aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:58.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.859+0000 7fc4df010700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc4d8150f50 0x7fc4d807af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:58.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.859+0000 7fc4df010700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d80754d0 con 0x7fc4d807bba0 2019-11-28T11:49:58.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.859+0000 7fc4df010700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d8078980 con 0x7fc4d8150f50 2019-11-28T11:49:58.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.859+0000 7fc4df010700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d8078c50 con 0x7fc4d8074d00 2019-11-28T11:49:58.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.859+0000 7fc4dcdac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc4d8150f50 0x7fc4d807af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:58.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.859+0000 7fc4dcdac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc4d8150f50 0x7fc4d807af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42616/0 (socket says 172.21.15.80:42616) 2019-11-28T11:49:58.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.859+0000 7fc4dcdac700 1 -- 172.21.15.80:0/1549462489 learned_addr learned my addr 172.21.15.80:0/1549462489 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:49:58.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.859+0000 7fc4dd5ad700 1 --2- 172.21.15.80:0/1549462489 >> v2:172.21.15.174:3300/0 conn(0x7fc4d8074d00 0x7fc4d807aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:58.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.860+0000 7fc4dcdac700 1 -- 172.21.15.80:0/1549462489 >> v2:172.21.15.174:3300/0 conn(0x7fc4d8074d00 msgr2=0x7fc4d807aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:58.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.860+0000 7fc4dcdac700 1 --2- 172.21.15.80:0/1549462489 >> v2:172.21.15.174:3300/0 conn(0x7fc4d8074d00 0x7fc4d807aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:58.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.860+0000 7fc4dcdac700 1 -- 172.21.15.80:0/1549462489 >> v1:172.21.15.174:6789/0 conn(0x7fc4d807bba0 legacy=0x7fc4d8076d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:58.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.860+0000 7fc4dcdac700 1 -- 172.21.15.80:0/1549462489 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d80792e0 con 0x7fc4d8150f50 2019-11-28T11:49:58.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.860+0000 7fc4dcdac700 1 --2- 172.21.15.80:0/1549462489 >> v2:172.21.15.80:3300/0 conn(0x7fc4d8150f50 0x7fc4d807af60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc4c00107e0 tx=0x7fc4c0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:58.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.860+0000 7fc4dcdac700 1 --2- 172.21.15.80:0/1549462489 >> v2:172.21.15.80:3300/0 conn(0x7fc4d8150f50 0x7fc4d807af60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc4c00107e0 tx=0x7fc4c0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:58.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.860+0000 7fc4dcdac700 1 --2- 172.21.15.80:0/1549462489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4d8150f50 0x7fc4d807af60 secure :-1 s=READY pgs=2146 cs=0 l=1 rx=0x7fc4c00107e0 tx=0x7fc4c0010610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:58.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.860+0000 7fc4dcdac700 1 --2- 172.21.15.80:0/1549462489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4d8150f50 0x7fc4d807af60 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fc4c00107e0 tx=0x7fc4c0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:58.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.860+0000 7fc4dcdac700 1 --2- 172.21.15.80:0/1549462489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4d8150f50 0x7fc4d807af60 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fc4c00107e0 tx=0x7fc4c0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:58.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.860+0000 7fc4d5ffb700 1 -- 172.21.15.80:0/1549462489 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4c0000e40 con 0x7fc4d8150f50 2019-11-28T11:49:58.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.860+0000 7fc4dcdac700 1 --2- 172.21.15.80:0/1549462489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4d8150f50 0x7fc4d807af60 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fc4c00107e0 tx=0x7fc4c0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:58.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.860+0000 7fc4d5ffb700 1 -- 172.21.15.80:0/1549462489 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c00015a0 con 0x7fc4d8150f50 2019-11-28T11:49:58.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.860+0000 7fc4d5ffb700 1 -- 172.21.15.80:0/1549462489 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4c0001bb0 con 0x7fc4d8150f50 2019-11-28T11:49:58.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.860+0000 7fc4df010700 1 -- 172.21.15.80:0/1549462489 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d8079660 con 0x7fc4d8150f50 2019-11-28T11:49:58.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.860+0000 7fc4df010700 1 -- 172.21.15.80:0/1549462489 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d80792e0 con 0x7fc4d8150f50 2019-11-28T11:49:58.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.860+0000 7fc4dcdac700 1 --2- 172.21.15.80:0/1549462489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4d8150f50 0x7fc4d807af60 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fc4c00107e0 tx=0x7fc4c0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:58.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.861+0000 7fc4d5ffb700 1 -- 172.21.15.80:0/1549462489 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc4c0001790 con 0x7fc4d8150f50 2019-11-28T11:49:58.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.861+0000 7fc4dcdac700 1 --2- 172.21.15.80:0/1549462489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4d8150f50 0x7fc4d807af60 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fc4c00107e0 tx=0x7fc4c0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:58.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.861+0000 7fc4d5ffb700 1 --2- 172.21.15.80:0/1549462489 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4bc01a960 0x7fc4bc01cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:49:58.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.861+0000 7fc4d5ffb700 1 -- 172.21.15.80:0/1549462489 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fc4c0031ef0 con 0x7fc4d8150f50 2019-11-28T11:49:58.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.861+0000 7fc4dd5ad700 1 --2- 172.21.15.80:0/1549462489 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4bc01a960 0x7fc4bc01cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:49:58.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.861+0000 7fc4dd5ad700 1 --2- 172.21.15.80:0/1549462489 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4bc01a960 0x7fc4bc01cdf0 crc :-1 s=READY pgs=876 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:49:58.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.868+0000 7fc4df010700 1 -- 172.21.15.80:0/1549462489 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d8079660 con 0x7fc4d8150f50 2019-11-28T11:49:58.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.871+0000 7fc4dcdac700 1 --2- 172.21.15.80:0/1549462489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4d8150f50 0x7fc4d807af60 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fc4c00107e0 tx=0x7fc4c0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:58.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:58.871+0000 7fc4d5ffb700 1 -- 172.21.15.80:0/1549462489 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc4c0001120 con 0x7fc4d8150f50 2019-11-28T11:49:59.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:59.045+0000 7fc4df010700 1 -- 172.21.15.80:0/1549462489 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4d80792e0 con 0x7fc4d8150f50 2019-11-28T11:49:59.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:59.045+0000 7fc4dcdac700 1 --2- 172.21.15.80:0/1549462489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4d8150f50 0x7fc4d807af60 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fc4c00107e0 tx=0x7fc4c0010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:49:59.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:59.045+0000 7fc4d5ffb700 1 -- 172.21.15.80:0/1549462489 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 131 v131) v1 ==== 95+0+2457 (secure 0 0 0) 0x7fc4c00015a0 con 0x7fc4d8150f50 2019-11-28T11:49:59.094 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 131 2019-11-28T11:49:59.094 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:49:59.094 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":131,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7019,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1144103346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1144103346},{"type":"v1","addr":"172.21.15.80:6834","nonce":1144103346}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":127},{"gid":9613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3914187264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3914187264},{"type":"v1","addr":"172.21.15.80:6835","nonce":3914187264}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":127}],"filesystems":[{"mdsmap":{"epoch":131,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:49:58.925387+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7016":{"gid":7016,"name":"c","rank":0,"incarnation":128,"state":"up:active","state_seq":5,"addr":"172.21.15.174:6835/2828740513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2828740513},{"type":"v1","addr":"172.21.15.174:6835","nonce":2828740513}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:49:59.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:59.048+0000 7fc4df010700 1 -- 172.21.15.80:0/1549462489 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4bc01a960 msgr2=0x7fc4bc01cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:59.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:59.048+0000 7fc4df010700 1 --2- 172.21.15.80:0/1549462489 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4bc01a960 0x7fc4bc01cdf0 crc :-1 s=READY pgs=876 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:59.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:59.048+0000 7fc4df010700 1 -- 172.21.15.80:0/1549462489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4d8150f50 msgr2=0x7fc4d807af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:49:59.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:59.048+0000 7fc4df010700 1 --2- 172.21.15.80:0/1549462489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4d8150f50 0x7fc4d807af60 secure :-1 s=READY pgs=2146 cs=0 l=1 rx=0x7fc4c00107e0 tx=0x7fc4c0010610).stop 2019-11-28T11:49:59.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:59.048+0000 7fc4df010700 1 -- 172.21.15.80:0/1549462489 shutdown_connections 2019-11-28T11:49:59.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:59.048+0000 7fc4df010700 1 --2- 172.21.15.80:0/1549462489 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc4bc01a960 0x7fc4bc01cdf0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:59.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:59.048+0000 7fc4df010700 1 --2- 172.21.15.80:0/1549462489 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc4d8150f50 0x7fc4d807af60 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:59.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:59.048+0000 7fc4df010700 1 --2- 172.21.15.80:0/1549462489 >> v2:172.21.15.174:3300/0 conn(0x7fc4d8074d00 0x7fc4d807aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:49:59.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:59.048+0000 7fc4df010700 1 -- 172.21.15.80:0/1549462489 shutdown_connections 2019-11-28T11:49:59.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:59.048+0000 7fc4df010700 1 -- 172.21.15.80:0/1549462489 wait complete. 2019-11-28T11:49:59.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:49:59.048+0000 7fc4df010700 1 -- 172.21.15.80:0/1549462489 >> 172.21.15.80:0/1549462489 conn(0x7fc4d813fa50 msgr2=0x7fc4d807c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:49:59.106 INFO:tasks.cephfs.filesystem:mapped states [u'up:active'] to up:active 2019-11-28T11:49:59.106 INFO:tasks.cephfs.filesystem:reached state 'up:active' in 1.6513800621s 2019-11-28T11:50:29.107 INFO:teuthology.misc:Re-opening connections... 2019-11-28T11:50:29.107 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:50:29.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:50:29.110 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:50:29.149 DEBUG:tasks.ceph:Missed logrotate, EOFError 2019-11-28T11:50:35.224 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:50:35.225 DEBUG:teuthology.misc:waited 6.11732196808 2019-11-28T11:50:36.226 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:50:36.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:50:36.226 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:50:38.300 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:50:38.301 DEBUG:teuthology.misc:waited 9.19318413734 2019-11-28T11:50:39.302 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:50:39.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:50:39.302 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:50:41.368 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:50:41.369 DEBUG:teuthology.misc:waited 12.2612090111 2019-11-28T11:50:42.369 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:50:42.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:50:42.370 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:50:44.440 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:50:44.441 DEBUG:teuthology.misc:waited 15.333343029 2019-11-28T11:50:45.444 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:50:45.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:50:45.445 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:50:47.512 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:50:47.513 DEBUG:teuthology.misc:waited 18.4052381516 2019-11-28T11:50:48.516 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:50:48.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:50:48.517 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:50:50.588 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:50:50.589 DEBUG:teuthology.misc:waited 21.4811861515 2019-11-28T11:50:51.590 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:50:51.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:50:51.590 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:50:53.656 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:50:53.657 DEBUG:teuthology.misc:waited 24.5491931438 2019-11-28T11:50:54.657 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:50:54.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:50:54.658 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:50:56.728 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:50:56.729 DEBUG:teuthology.misc:waited 27.6212511063 2019-11-28T11:50:57.730 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:50:57.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:50:57.731 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:50:59.152 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:50:59.169 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:50:59.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:50:59.181 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:50:59.804 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:50:59.805 DEBUG:tasks.ceph:Missed logrotate, node 'smithi076' is offline 2019-11-28T11:50:59.805 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:50:59.805 DEBUG:teuthology.misc:waited 30.6978991032 2019-11-28T11:51:00.806 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:51:00.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:51:00.807 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:51:02.872 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:51:02.873 DEBUG:teuthology.misc:waited 33.7652339935 2019-11-28T11:51:03.873 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:51:03.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:51:03.874 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:51:05.944 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:51:05.945 DEBUG:teuthology.misc:waited 36.8371839523 2019-11-28T11:51:06.945 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:51:06.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:51:06.946 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:51:09.016 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:51:09.017 DEBUG:teuthology.misc:waited 39.9092040062 2019-11-28T11:51:10.017 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:51:10.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:51:10.018 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:51:12.092 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:51:12.093 DEBUG:teuthology.misc:waited 42.9851281643 2019-11-28T11:51:13.094 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:51:13.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:51:13.094 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:51:29.806 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:51:29.810 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:51:29.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:51:29.814 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:51:45.081 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T11:51:45.082 DEBUG:tasks.ceph:Missed logrotate, node 'smithi076' is offline 2019-11-28T11:52:13.096 DEBUG:teuthology.orchestra.remote:timed out 2019-11-28T11:52:13.096 DEBUG:teuthology.misc:waited 103.988484144 2019-11-28T11:52:14.097 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:52:14.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:52:14.098 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:52:14.185 INFO:teuthology.orchestra.run.smithi076:> true 2019-11-28T11:52:14.501 DEBUG:teuthology.misc:waited 105.393182993 2019-11-28T11:52:15.088 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:52:15.094 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:52:15.099 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:52:15.103 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:52:15.107 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:52:15.114 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:52:15.501 INFO:teuthology.orchestra.run:Running command with timeout 10 2019-11-28T11:52:15.501 INFO:teuthology.orchestra.run.smithi076:> uptime 2019-11-28T11:52:15.572 INFO:teuthology.orchestra.run.smithi076.stdout: 11:52:15 up 0 min, 0 users, load average: 1.06, 0.35, 0.13 2019-11-28T11:52:15.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:52:15.573 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:52:15.719 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:52:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.791+0000 7f7593aa6700 1 Processor -- start 2019-11-28T11:52:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.791+0000 7f7593aa6700 1 -- start start 2019-11-28T11:52:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7593aa6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f758c06c0a0 0x7f758c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7593aa6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f758c0734e0 0x7f758c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:15.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7593aa6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c072360 0x7f758c072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:15.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7593aa6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f758c06fd60 con 0x7f758c06c0a0 2019-11-28T11:52:15.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7593aa6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f758c070030 con 0x7f758c0734e0 2019-11-28T11:52:15.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7593aa6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758c06f330 con 0x7f758c072360 2019-11-28T11:52:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7592043700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f758c06c0a0 0x7f758c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7592043700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f758c06c0a0 0x7f758c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42622/0 (socket says 172.21.15.80:42622) 2019-11-28T11:52:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7592043700 1 -- 172.21.15.80:0/2221988100 learned_addr learned my addr 172.21.15.80:0/2221988100 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7592844700 1 --2- 172.21.15.80:0/2221988100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c072360 0x7f758c072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7591842700 1 --2- 172.21.15.80:0/2221988100 >> v2:172.21.15.174:3300/0 conn(0x7f758c0734e0 0x7f758c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7592043700 1 -- 172.21.15.80:0/2221988100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c072360 msgr2=0x7f758c072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7592043700 1 --2- 172.21.15.80:0/2221988100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c072360 0x7f758c072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:15.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7592043700 1 -- 172.21.15.80:0/2221988100 >> v2:172.21.15.174:3300/0 conn(0x7f758c0734e0 msgr2=0x7f758c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:15.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7592043700 1 --2- 172.21.15.80:0/2221988100 >> v2:172.21.15.174:3300/0 conn(0x7f758c0734e0 0x7f758c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:15.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7592043700 1 -- 172.21.15.80:0/2221988100 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c0706c0 con 0x7f758c06c0a0 2019-11-28T11:52:15.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7591842700 1 --2- 172.21.15.80:0/2221988100 >> v2:172.21.15.174:3300/0 conn(0x7f758c0734e0 0x7f758c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:52:15.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7592043700 1 --2- 172.21.15.80:0/2221988100 >> v2:172.21.15.80:3300/0 conn(0x7f758c06c0a0 0x7f758c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f758400fa40 tx=0x7f758400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:15.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7592043700 1 --2- 172.21.15.80:0/2221988100 >> v2:172.21.15.80:3300/0 conn(0x7f758c06c0a0 0x7f758c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f758400fa40 tx=0x7f758400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:15.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7592043700 1 --2- 172.21.15.80:0/2221988100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f758c06c0a0 0x7f758c072fa0 secure :-1 s=READY pgs=2147 cs=0 l=1 rx=0x7f758400fa40 tx=0x7f758400fde0).ready entity=mon.0 client_cookie=edc253ea2b20c5a8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:15.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7592043700 1 --2- 172.21.15.80:0/2221988100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f758c06c0a0 0x7f758c072fa0 secure :-1 s=THROTTLE_DONE pgs=2147 cs=0 l=1 rx=0x7f758400fa40 tx=0x7f758400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:15.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7592043700 1 --2- 172.21.15.80:0/2221988100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f758c06c0a0 0x7f758c072fa0 secure :-1 s=THROTTLE_DONE pgs=2147 cs=0 l=1 rx=0x7f758400fa40 tx=0x7f758400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:15.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7592043700 1 --2- 172.21.15.80:0/2221988100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f758c06c0a0 0x7f758c072fa0 secure :-1 s=THROTTLE_DONE pgs=2147 cs=0 l=1 rx=0x7f758400fa40 tx=0x7f758400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:15.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7591041700 1 -- 172.21.15.80:0/2221988100 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7584000ce0 con 0x7f758c06c0a0 2019-11-28T11:52:15.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7591041700 1 -- 172.21.15.80:0/2221988100 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7584001010 con 0x7f758c06c0a0 2019-11-28T11:52:15.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7591041700 1 -- 172.21.15.80:0/2221988100 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75840017c0 con 0x7f758c06c0a0 2019-11-28T11:52:15.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7593aa6700 1 -- 172.21.15.80:0/2221988100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f758c06c0a0 msgr2=0x7f758c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:15.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.793+0000 7f7593aa6700 1 --2- 172.21.15.80:0/2221988100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f758c06c0a0 0x7f758c072fa0 secure :-1 s=READY pgs=2147 cs=0 l=1 rx=0x7f758400fa40 tx=0x7f758400fde0).stop 2019-11-28T11:52:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.794+0000 7f7593aa6700 1 -- 172.21.15.80:0/2221988100 shutdown_connections 2019-11-28T11:52:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.794+0000 7f7593aa6700 1 --2- 172.21.15.80:0/2221988100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c072360 0x7f758c072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.794+0000 7f7593aa6700 1 --2- 172.21.15.80:0/2221988100 >> v2:172.21.15.174:3300/0 conn(0x7f758c0734e0 0x7f758c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.794+0000 7f7593aa6700 1 --2- 172.21.15.80:0/2221988100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f758c06c0a0 0x7f758c072fa0 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.794+0000 7f7593aa6700 1 -- 172.21.15.80:0/2221988100 shutdown_connections 2019-11-28T11:52:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.794+0000 7f7593aa6700 1 -- 172.21.15.80:0/2221988100 wait complete. 2019-11-28T11:52:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.794+0000 7f7593aa6700 1 -- 172.21.15.80:0/2221988100 >> 172.21.15.80:0/2221988100 conn(0x7f758c061cf0 msgr2=0x7f758c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:15.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.797+0000 7f7593aa6700 1 Processor -- start 2019-11-28T11:52:15.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.797+0000 7f7593aa6700 1 -- start start 2019-11-28T11:52:15.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.797+0000 7f7593aa6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c13e5f0 0x7f758c13e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:15.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7593aa6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f758c10a070 0x7f758c10bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:15.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7593aa6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f758c1066e0 con 0x7f758c10a4e0 2019-11-28T11:52:15.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7593aa6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f758c10d630 con 0x7f758c10a070 2019-11-28T11:52:15.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7593aa6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758c10e060 con 0x7f758c13e5f0 2019-11-28T11:52:15.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7592844700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f758c10a4e0 0x7f758c10c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41948/0 (socket says 172.21.15.80:41948) 2019-11-28T11:52:15.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7592844700 1 -- 172.21.15.80:0/1937827325 learned_addr learned my addr 172.21.15.80:0/1937827325 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:15.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7592043700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c13e5f0 0x7f758c13e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:15.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7591842700 1 --2- 172.21.15.80:0/1937827325 >> v2:172.21.15.174:3300/0 conn(0x7f758c10a070 0x7f758c10bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:15.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f758affd700 1 -- 172.21.15.80:0/1937827325 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271613898 0 0) 0x7f75740058d0 con 0x7f758c10a4e0 2019-11-28T11:52:15.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f758affd700 1 -- 172.21.15.80:0/1937827325 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7570002e80 con 0x7f758c10a4e0 2019-11-28T11:52:15.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7592043700 1 -- 172.21.15.80:0/1937827325 >> v2:172.21.15.174:3300/0 conn(0x7f758c10a070 msgr2=0x7f758c10bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:15.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7592043700 1 --2- 172.21.15.80:0/1937827325 >> v2:172.21.15.174:3300/0 conn(0x7f758c10a070 0x7f758c10bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:15.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7592043700 1 -- 172.21.15.80:0/1937827325 >> v1:172.21.15.80:6789/0 conn(0x7f758c10a4e0 legacy=0x7f758c10c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:15.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7592043700 1 -- 172.21.15.80:0/1937827325 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c10e9c0 con 0x7f758c13e5f0 2019-11-28T11:52:15.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7592043700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c13e5f0 0x7f758c13e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7584010720 tx=0x7f7584010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:15.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7592043700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c13e5f0 0x7f758c13e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7584010720 tx=0x7f7584010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:15.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7592043700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c13e5f0 0x7f758c13e9e0 secure :-1 s=READY pgs=300 cs=0 l=1 rx=0x7f7584010720 tx=0x7f7584010550).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:15.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7592043700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c13e5f0 0x7f758c13e9e0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f7584010720 tx=0x7f7584010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:15.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f758affd700 1 -- 172.21.15.80:0/1937827325 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7584000cc0 con 0x7f758c13e5f0 2019-11-28T11:52:15.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7592043700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c13e5f0 0x7f758c13e9e0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f7584010720 tx=0x7f7584010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:15.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f758affd700 1 -- 172.21.15.80:0/1937827325 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7584000cc0 con 0x7f758c13e5f0 2019-11-28T11:52:15.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7593aa6700 1 -- 172.21.15.80:0/1937827325 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758c10ed40 con 0x7f758c13e5f0 2019-11-28T11:52:15.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7592043700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c13e5f0 0x7f758c13e9e0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f7584010720 tx=0x7f7584010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:15.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f758affd700 1 -- 172.21.15.80:0/1937827325 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75840015c0 con 0x7f758c13e5f0 2019-11-28T11:52:15.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.798+0000 7f7593aa6700 1 -- 172.21.15.80:0/1937827325 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758c10e9c0 con 0x7f758c13e5f0 2019-11-28T11:52:15.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.799+0000 7f7592043700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c13e5f0 0x7f758c13e9e0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f7584010720 tx=0x7f7584010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:15.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.799+0000 7f758affd700 1 -- 172.21.15.80:0/1937827325 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f75840011e0 con 0x7f758c13e5f0 2019-11-28T11:52:15.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.799+0000 7f7592043700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c13e5f0 0x7f758c13e9e0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f7584010720 tx=0x7f7584010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:15.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.799+0000 7f758affd700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7570018770 0x7f757001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:15.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.799+0000 7f758affd700 1 -- 172.21.15.80:0/1937827325 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f7584031d90 con 0x7f758c13e5f0 2019-11-28T11:52:15.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.799+0000 7f7591842700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7570018770 0x7f757001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:15.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.800+0000 7f7591842700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7570018770 0x7f757001abe0 crc :-1 s=READY pgs=877 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:15.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.807+0000 7f7593aa6700 1 -- 172.21.15.80:0/1937827325 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758c10ed40 con 0x7f758c13e5f0 2019-11-28T11:52:15.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.811+0000 7f7592043700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c13e5f0 0x7f758c13e9e0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f7584010720 tx=0x7f7584010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:15.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.811+0000 7f758affd700 1 -- 172.21.15.80:0/1937827325 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7584022420 con 0x7f758c13e5f0 2019-11-28T11:52:16.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.986+0000 7f7593aa6700 1 -- 172.21.15.80:0/1937827325 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f758c10e9c0 con 0x7f758c13e5f0 2019-11-28T11:52:16.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.987+0000 7f7592043700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c13e5f0 0x7f758c13e9e0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f7584010720 tx=0x7f7584010550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.987+0000 7f758affd700 1 -- 172.21.15.80:0/1937827325 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+15064 (secure 0 0 0) 0x7f7584022420 con 0x7f758c13e5f0 2019-11-28T11:52:16.041 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:16.041 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":166,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:49:56.920298+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:49:31.434223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2019-11-28T11:49:32.127254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.76:0/1856018806":"2019-11-28T12:49:56.100589+0000","172.21.15.174:6835/1260063619":"2019-11-29T11:49:43.549456+0000","172.21.15.174:6834/1260063619":"2019-11-29T11:49:43.549456+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:52:16.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.991+0000 7f7593aa6700 1 -- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7570018770 msgr2=0x7f757001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.991+0000 7f7593aa6700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7570018770 0x7f757001abe0 crc :-1 s=READY pgs=877 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.991+0000 7f7593aa6700 1 -- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c13e5f0 msgr2=0x7f758c13e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.991+0000 7f7593aa6700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c13e5f0 0x7f758c13e9e0 secure :-1 s=READY pgs=300 cs=0 l=1 rx=0x7f7584010720 tx=0x7f7584010550).stop 2019-11-28T11:52:16.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.991+0000 7f7593aa6700 1 -- 172.21.15.80:0/1937827325 shutdown_connections 2019-11-28T11:52:16.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.991+0000 7f7593aa6700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7570018770 0x7f757001abe0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.991+0000 7f7593aa6700 1 --2- 172.21.15.80:0/1937827325 >> v2:172.21.15.174:3300/0 conn(0x7f758c10a070 0x7f758c10bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.991+0000 7f7593aa6700 1 --2- 172.21.15.80:0/1937827325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f758c13e5f0 0x7f758c13e9e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.991+0000 7f7593aa6700 1 -- 172.21.15.80:0/1937827325 shutdown_connections 2019-11-28T11:52:16.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.991+0000 7f7593aa6700 1 -- 172.21.15.80:0/1937827325 wait complete. 2019-11-28T11:52:16.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:15.991+0000 7f7593aa6700 1 -- 172.21.15.80:0/1937827325 >> 172.21.15.80:0/1937827325 conn(0x7f758c13d620 msgr2=0x7f758c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:16.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:49:31.434223+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 26, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'161', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:49:32.127254+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 27, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'162', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:52:16.055 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:52:16.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.126+0000 7f3c74768700 1 Processor -- start 2019-11-28T11:52:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.126+0000 7f3c74768700 1 -- start start 2019-11-28T11:52:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.127+0000 7f3c74768700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c6c15ed10 0x7f3c6c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.127+0000 7f3c74768700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3c6c073020 0x7f3c6c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.127+0000 7f3c74768700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6c06db60 con 0x7f3c6c0734b0 2019-11-28T11:52:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.127+0000 7f3c74768700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6c06f3d0 con 0x7f3c6c073020 2019-11-28T11:52:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.127+0000 7f3c74768700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c06fe00 con 0x7f3c6c15ed10 2019-11-28T11:52:16.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.127+0000 7f3c72504700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3c6c073020 0x7f3c6c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c72504700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3c6c073020 0x7f3c6c071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42640/0 (socket says 172.21.15.80:42640) 2019-11-28T11:52:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c73506700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3c6c0734b0 0x7f3c6c0723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41954/0 (socket says 172.21.15.80:41954) 2019-11-28T11:52:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c72504700 1 -- 172.21.15.80:0/2395405985 learned_addr learned my addr 172.21.15.80:0/2395405985 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c72d05700 1 --2- 172.21.15.80:0/2395405985 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c6c15ed10 0x7f3c6c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c72504700 1 -- 172.21.15.80:0/2395405985 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c6c15ed10 msgr2=0x7f3c6c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:16.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c72504700 1 --2- 172.21.15.80:0/2395405985 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c6c15ed10 0x7f3c6c15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c72504700 1 -- 172.21.15.80:0/2395405985 >> v1:172.21.15.80:6789/0 conn(0x7f3c6c0734b0 legacy=0x7f3c6c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c72504700 1 -- 172.21.15.80:0/2395405985 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c070760 con 0x7f3c6c073020 2019-11-28T11:52:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c71d03700 1 -- 172.21.15.80:0/2395405985 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200319027 0 0) 0x7f3c64000d30 con 0x7f3c6c0734b0 2019-11-28T11:52:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c72504700 1 --2- 172.21.15.80:0/2395405985 >> v2:172.21.15.80:3300/0 conn(0x7f3c6c073020 0x7f3c6c071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3c6000f6c0 tx=0x7f3c6000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c72504700 1 --2- 172.21.15.80:0/2395405985 >> v2:172.21.15.80:3300/0 conn(0x7f3c6c073020 0x7f3c6c071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3c6000f6c0 tx=0x7f3c6000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c72504700 1 --2- 172.21.15.80:0/2395405985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c073020 0x7f3c6c071ea0 secure :-1 s=READY pgs=2150 cs=0 l=1 rx=0x7f3c6000f6c0 tx=0x7f3c6000fa60).ready entity=mon.0 client_cookie=482d292af9203810 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c72504700 1 --2- 172.21.15.80:0/2395405985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c073020 0x7f3c6c071ea0 secure :-1 s=THROTTLE_DONE pgs=2150 cs=0 l=1 rx=0x7f3c6000f6c0 tx=0x7f3c6000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c72504700 1 --2- 172.21.15.80:0/2395405985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c073020 0x7f3c6c071ea0 secure :-1 s=THROTTLE_DONE pgs=2150 cs=0 l=1 rx=0x7f3c6000f6c0 tx=0x7f3c6000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c71d03700 1 -- 172.21.15.80:0/2395405985 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c60000960 con 0x7f3c6c073020 2019-11-28T11:52:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c72504700 1 --2- 172.21.15.80:0/2395405985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c073020 0x7f3c6c071ea0 secure :-1 s=THROTTLE_DONE pgs=2150 cs=0 l=1 rx=0x7f3c6000f6c0 tx=0x7f3c6000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c71d03700 1 -- 172.21.15.80:0/2395405985 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c60000c90 con 0x7f3c6c073020 2019-11-28T11:52:16.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c71d03700 1 -- 172.21.15.80:0/2395405985 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c600013a0 con 0x7f3c6c073020 2019-11-28T11:52:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c74768700 1 -- 172.21.15.80:0/2395405985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c073020 msgr2=0x7f3c6c071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.128+0000 7f3c74768700 1 --2- 172.21.15.80:0/2395405985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c073020 0x7f3c6c071ea0 secure :-1 s=READY pgs=2150 cs=0 l=1 rx=0x7f3c6000f6c0 tx=0x7f3c6000fa60).stop 2019-11-28T11:52:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.129+0000 7f3c74768700 1 -- 172.21.15.80:0/2395405985 shutdown_connections 2019-11-28T11:52:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.129+0000 7f3c74768700 1 --2- 172.21.15.80:0/2395405985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c073020 0x7f3c6c071ea0 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.129+0000 7f3c74768700 1 --2- 172.21.15.80:0/2395405985 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3c6c15ed10 0x7f3c6c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.129+0000 7f3c74768700 1 -- 172.21.15.80:0/2395405985 shutdown_connections 2019-11-28T11:52:16.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.129+0000 7f3c74768700 1 -- 172.21.15.80:0/2395405985 wait complete. 2019-11-28T11:52:16.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.129+0000 7f3c74768700 1 -- 172.21.15.80:0/2395405985 >> 172.21.15.80:0/2395405985 conn(0x7f3c6c061d20 msgr2=0x7f3c6c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:16.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.131+0000 7f3c74768700 1 Processor -- start 2019-11-28T11:52:16.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.131+0000 7f3c74768700 1 -- start start 2019-11-28T11:52:16.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.132+0000 7f3c74768700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3c6c1079b0 0x7f3c6c107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:16.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.132+0000 7f3c74768700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3c6c108380 0x7f3c6c168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:16.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.132+0000 7f3c74768700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6c148e00 con 0x7f3c6c148320 2019-11-28T11:52:16.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.132+0000 7f3c74768700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6c13aa20 con 0x7f3c6c108380 2019-11-28T11:52:16.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.132+0000 7f3c74768700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6c13acf0 con 0x7f3c6c1079b0 2019-11-28T11:52:16.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.132+0000 7f3c72d05700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3c6c148320 0x7f3c6c10ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41958/0 (socket says 172.21.15.80:41958) 2019-11-28T11:52:16.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.132+0000 7f3c72d05700 1 -- 172.21.15.80:0/1610088964 learned_addr learned my addr 172.21.15.80:0/1610088964 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:16.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.132+0000 7f3c73506700 1 --2- 172.21.15.80:0/1610088964 >> v2:172.21.15.80:3300/0 conn(0x7f3c6c108380 0x7f3c6c168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:16.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.132+0000 7f3c72504700 1 --2- 172.21.15.80:0/1610088964 >> v2:172.21.15.174:3300/0 conn(0x7f3c6c1079b0 0x7f3c6c107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:16.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.132+0000 7f3c6b7fe700 1 -- 172.21.15.80:0/1610088964 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009571102 0 0) 0x7f3c5c001fe0 con 0x7f3c6c148320 2019-11-28T11:52:16.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c6b7fe700 1 -- 172.21.15.80:0/1610088964 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c4c002e80 con 0x7f3c6c148320 2019-11-28T11:52:16.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c73506700 1 -- 172.21.15.80:0/1610088964 >> v2:172.21.15.174:3300/0 conn(0x7f3c6c1079b0 msgr2=0x7f3c6c107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c73506700 1 --2- 172.21.15.80:0/1610088964 >> v2:172.21.15.174:3300/0 conn(0x7f3c6c1079b0 0x7f3c6c107e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c73506700 1 -- 172.21.15.80:0/1610088964 >> v1:172.21.15.80:6789/0 conn(0x7f3c6c148320 legacy=0x7f3c6c10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c73506700 1 -- 172.21.15.80:0/1610088964 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c10c490 con 0x7f3c6c108380 2019-11-28T11:52:16.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c73506700 1 --2- 172.21.15.80:0/1610088964 >> v2:172.21.15.80:3300/0 conn(0x7f3c6c108380 0x7f3c6c168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c64010720 tx=0x7f3c6400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c73506700 1 --2- 172.21.15.80:0/1610088964 >> v2:172.21.15.80:3300/0 conn(0x7f3c6c108380 0x7f3c6c168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c64010720 tx=0x7f3c6400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c73506700 1 --2- 172.21.15.80:0/1610088964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c108380 0x7f3c6c168d80 secure :-1 s=READY pgs=2152 cs=0 l=1 rx=0x7f3c64010720 tx=0x7f3c6400b660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:16.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c73506700 1 --2- 172.21.15.80:0/1610088964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c108380 0x7f3c6c168d80 secure :-1 s=THROTTLE_DONE pgs=2152 cs=0 l=1 rx=0x7f3c64010720 tx=0x7f3c6400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c6b7fe700 1 -- 172.21.15.80:0/1610088964 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c64000cc0 con 0x7f3c6c108380 2019-11-28T11:52:16.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c73506700 1 --2- 172.21.15.80:0/1610088964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c108380 0x7f3c6c168d80 secure :-1 s=THROTTLE_DONE pgs=2152 cs=0 l=1 rx=0x7f3c64010720 tx=0x7f3c6400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c73506700 1 --2- 172.21.15.80:0/1610088964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c108380 0x7f3c6c168d80 secure :-1 s=THROTTLE_DONE pgs=2152 cs=0 l=1 rx=0x7f3c64010720 tx=0x7f3c6400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c6b7fe700 1 -- 172.21.15.80:0/1610088964 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c640017f0 con 0x7f3c6c108380 2019-11-28T11:52:16.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c6b7fe700 1 -- 172.21.15.80:0/1610088964 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c64001f00 con 0x7f3c6c108380 2019-11-28T11:52:16.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c74768700 1 -- 172.21.15.80:0/1610088964 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c6c10c810 con 0x7f3c6c108380 2019-11-28T11:52:16.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c74768700 1 -- 172.21.15.80:0/1610088964 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6c108820 con 0x7f3c6c108380 2019-11-28T11:52:16.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.133+0000 7f3c73506700 1 --2- 172.21.15.80:0/1610088964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c108380 0x7f3c6c168d80 secure :-1 s=THROTTLE_DONE pgs=2152 cs=0 l=1 rx=0x7f3c64010720 tx=0x7f3c6400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.134+0000 7f3c6b7fe700 1 -- 172.21.15.80:0/1610088964 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3c640019e0 con 0x7f3c6c108380 2019-11-28T11:52:16.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.134+0000 7f3c73506700 1 --2- 172.21.15.80:0/1610088964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c108380 0x7f3c6c168d80 secure :-1 s=THROTTLE_DONE pgs=2152 cs=0 l=1 rx=0x7f3c64010720 tx=0x7f3c6400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.134+0000 7f3c6b7fe700 1 --2- 172.21.15.80:0/1610088964 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3c4c018770 0x7f3c4c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:16.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.134+0000 7f3c6b7fe700 1 -- 172.21.15.80:0/1610088964 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f3c64031d70 con 0x7f3c6c108380 2019-11-28T11:52:16.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.134+0000 7f3c72d05700 1 --2- 172.21.15.80:0/1610088964 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3c4c018770 0x7f3c4c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:16.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.134+0000 7f3c72d05700 1 --2- 172.21.15.80:0/1610088964 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3c4c018770 0x7f3c4c01abe0 crc :-1 s=READY pgs=878 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:16.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.142+0000 7f3c74768700 1 -- 172.21.15.80:0/1610088964 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6c10c490 con 0x7f3c6c108380 2019-11-28T11:52:16.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.145+0000 7f3c73506700 1 --2- 172.21.15.80:0/1610088964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c108380 0x7f3c6c168d80 secure :-1 s=THROTTLE_DONE pgs=2152 cs=0 l=1 rx=0x7f3c64010720 tx=0x7f3c6400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.145+0000 7f3c6b7fe700 1 -- 172.21.15.80:0/1610088964 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3c64001270 con 0x7f3c6c108380 2019-11-28T11:52:16.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.310+0000 7f3c74768700 1 -- 172.21.15.80:0/1610088964 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f3c6c10c810 con 0x7f3c6c108380 2019-11-28T11:52:16.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.310+0000 7f3c73506700 1 --2- 172.21.15.80:0/1610088964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c108380 0x7f3c6c168d80 secure :-1 s=THROTTLE_DONE pgs=2152 cs=0 l=1 rx=0x7f3c64010720 tx=0x7f3c6400b660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.310+0000 7f3c6b7fe700 1 -- 172.21.15.80:0/1610088964 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v166) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3c640019e0 con 0x7f3c6c108380 2019-11-28T11:52:16.362 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:52:16.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.312+0000 7f3c74768700 1 -- 172.21.15.80:0/1610088964 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3c4c018770 msgr2=0x7f3c4c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.312+0000 7f3c74768700 1 --2- 172.21.15.80:0/1610088964 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3c4c018770 0x7f3c4c01abe0 crc :-1 s=READY pgs=878 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.312+0000 7f3c74768700 1 -- 172.21.15.80:0/1610088964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c108380 msgr2=0x7f3c6c168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.312+0000 7f3c74768700 1 --2- 172.21.15.80:0/1610088964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c108380 0x7f3c6c168d80 secure :-1 s=READY pgs=2152 cs=0 l=1 rx=0x7f3c64010720 tx=0x7f3c6400b660).stop 2019-11-28T11:52:16.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.313+0000 7f3c74768700 1 -- 172.21.15.80:0/1610088964 shutdown_connections 2019-11-28T11:52:16.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.313+0000 7f3c74768700 1 --2- 172.21.15.80:0/1610088964 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3c4c018770 0x7f3c4c01abe0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.313+0000 7f3c74768700 1 --2- 172.21.15.80:0/1610088964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c6c108380 0x7f3c6c168d80 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.313+0000 7f3c74768700 1 --2- 172.21.15.80:0/1610088964 >> v2:172.21.15.174:3300/0 conn(0x7f3c6c1079b0 0x7f3c6c107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.313+0000 7f3c74768700 1 -- 172.21.15.80:0/1610088964 shutdown_connections 2019-11-28T11:52:16.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.313+0000 7f3c74768700 1 -- 172.21.15.80:0/1610088964 wait complete. 2019-11-28T11:52:16.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.313+0000 7f3c74768700 1 -- 172.21.15.80:0/1610088964 >> 172.21.15.80:0/1610088964 conn(0x7f3c6c15e2d0 msgr2=0x7f3c6c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:16.374 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:52:16.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.444+0000 7f99b7318700 1 Processor -- start 2019-11-28T11:52:16.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.444+0000 7f99b7318700 1 -- start start 2019-11-28T11:52:16.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.445+0000 7f99b7318700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f99b015ed10 0x7f99b015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:16.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.445+0000 7f99b7318700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0073020 0x7f99b0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:16.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.445+0000 7f99b7318700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b006db60 con 0x7f99b00734b0 2019-11-28T11:52:16.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.445+0000 7f99b7318700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b006fe00 con 0x7f99b015ed10 2019-11-28T11:52:16.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.445+0000 7f99b7318700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b00700d0 con 0x7f99b0073020 2019-11-28T11:52:16.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.445+0000 7f99b60b6700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f99b00734b0 0x7f99b00723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41966/0 (socket says 172.21.15.80:41966) 2019-11-28T11:52:16.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.445+0000 7f99b60b6700 1 -- 172.21.15.80:0/2542264317 learned_addr learned my addr 172.21.15.80:0/2542264317 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:16.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b50b4700 1 --2- 172.21.15.80:0/2542264317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0073020 0x7f99b0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:16.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b58b5700 1 --2- 172.21.15.80:0/2542264317 >> v2:172.21.15.174:3300/0 conn(0x7f99b015ed10 0x7f99b015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:16.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b48b3700 1 -- 172.21.15.80:0/2542264317 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19965746 0 0) 0x7f99a0001150 con 0x7f99b00734b0 2019-11-28T11:52:16.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b48b3700 1 -- 172.21.15.80:0/2542264317 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9998002e80 con 0x7f99b00734b0 2019-11-28T11:52:16.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b50b4700 1 -- 172.21.15.80:0/2542264317 >> v2:172.21.15.174:3300/0 conn(0x7f99b015ed10 msgr2=0x7f99b015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:16.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b50b4700 1 --2- 172.21.15.80:0/2542264317 >> v2:172.21.15.174:3300/0 conn(0x7f99b015ed10 0x7f99b015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:16.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b50b4700 1 -- 172.21.15.80:0/2542264317 >> v1:172.21.15.80:6789/0 conn(0x7f99b00734b0 legacy=0x7f99b00723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b50b4700 1 -- 172.21.15.80:0/2542264317 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b0070760 con 0x7f99b0073020 2019-11-28T11:52:16.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b58b5700 1 --2- 172.21.15.80:0/2542264317 >> v2:172.21.15.174:3300/0 conn(0x7f99b015ed10 0x7f99b015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:16.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b50b4700 1 --2- 172.21.15.80:0/2542264317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0073020 0x7f99b0071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f99a400af50 tx=0x7f99a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b50b4700 1 --2- 172.21.15.80:0/2542264317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0073020 0x7f99b0071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f99a400af50 tx=0x7f99a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b50b4700 1 --2- 172.21.15.80:0/2542264317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0073020 0x7f99b0071ea0 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7f99a400af50 tx=0x7f99a400b760).ready entity=mon.2 client_cookie=da0994f06dff8f29 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:16.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b50b4700 1 --2- 172.21.15.80:0/2542264317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0073020 0x7f99b0071ea0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f99a400af50 tx=0x7f99a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b48b3700 1 -- 172.21.15.80:0/2542264317 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99a4007210 con 0x7f99b0073020 2019-11-28T11:52:16.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b50b4700 1 --2- 172.21.15.80:0/2542264317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0073020 0x7f99b0071ea0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f99a400af50 tx=0x7f99a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b50b4700 1 --2- 172.21.15.80:0/2542264317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0073020 0x7f99b0071ea0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f99a400af50 tx=0x7f99a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b48b3700 1 -- 172.21.15.80:0/2542264317 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a40099b0 con 0x7f99b0073020 2019-11-28T11:52:16.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b48b3700 1 -- 172.21.15.80:0/2542264317 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99a4009ba0 con 0x7f99b0073020 2019-11-28T11:52:16.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b7318700 1 -- 172.21.15.80:0/2542264317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0073020 msgr2=0x7f99b0071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.446+0000 7f99b7318700 1 --2- 172.21.15.80:0/2542264317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0073020 0x7f99b0071ea0 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7f99a400af50 tx=0x7f99a400b760).stop 2019-11-28T11:52:16.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.447+0000 7f99b7318700 1 -- 172.21.15.80:0/2542264317 shutdown_connections 2019-11-28T11:52:16.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.447+0000 7f99b7318700 1 --2- 172.21.15.80:0/2542264317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0073020 0x7f99b0071ea0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.447+0000 7f99b7318700 1 --2- 172.21.15.80:0/2542264317 >> v2:172.21.15.174:3300/0 conn(0x7f99b015ed10 0x7f99b015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:16.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.447+0000 7f99b7318700 1 -- 172.21.15.80:0/2542264317 shutdown_connections 2019-11-28T11:52:16.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.447+0000 7f99b7318700 1 -- 172.21.15.80:0/2542264317 wait complete. 2019-11-28T11:52:16.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.447+0000 7f99b7318700 1 -- 172.21.15.80:0/2542264317 >> 172.21.15.80:0/2542264317 conn(0x7f99b0061d20 msgr2=0x7f99b00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:16.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.450+0000 7f99b7318700 1 Processor -- start 2019-11-28T11:52:16.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.450+0000 7f99b7318700 1 -- start start 2019-11-28T11:52:16.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.450+0000 7f99b7318700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0148320 0x7f99b010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:16.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.450+0000 7f99b7318700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f99b010e3d0 0x7f99b0168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:16.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.450+0000 7f99b7318700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b0148e00 con 0x7f99b010f290 2019-11-28T11:52:16.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.450+0000 7f99b7318700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b0139ff0 con 0x7f99b010e3d0 2019-11-28T11:52:16.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.450+0000 7f99b7318700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b013aa20 con 0x7f99b0148320 2019-11-28T11:52:16.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99b58b5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0148320 0x7f99b010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:16.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99b58b5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0148320 0x7f99b010ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:44914/0 (socket says 172.21.15.80:44914) 2019-11-28T11:52:16.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99b58b5700 1 -- 172.21.15.80:0/3952466095 learned_addr learned my addr 172.21.15.80:0/3952466095 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:16.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99b60b6700 1 --2- 172.21.15.80:0/3952466095 >> v2:172.21.15.174:3300/0 conn(0x7f99b010e3d0 0x7f99b0168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:16.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99b58b5700 1 -- 172.21.15.80:0/3952466095 >> v2:172.21.15.174:3300/0 conn(0x7f99b010e3d0 msgr2=0x7f99b0168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99b58b5700 1 --2- 172.21.15.80:0/3952466095 >> v2:172.21.15.174:3300/0 conn(0x7f99b010e3d0 0x7f99b0168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99b58b5700 1 -- 172.21.15.80:0/3952466095 >> v1:172.21.15.174:6789/0 conn(0x7f99b010f290 legacy=0x7f99b010dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99b58b5700 1 -- 172.21.15.80:0/3952466095 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b010c490 con 0x7f99b0148320 2019-11-28T11:52:16.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99b58b5700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0148320 0x7f99b010ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f99a80107b0 tx=0x7f99a8010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99b58b5700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0148320 0x7f99b010ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f99a80107b0 tx=0x7f99a8010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99b58b5700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0148320 0x7f99b010ed50 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7f99a80107b0 tx=0x7f99a8010630).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:16.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99b58b5700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0148320 0x7f99b010ed50 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f99a80107b0 tx=0x7f99a8010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99b58b5700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0148320 0x7f99b010ed50 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f99a80107b0 tx=0x7f99a8010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99ae7fc700 1 -- 172.21.15.80:0/3952466095 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99a8007890 con 0x7f99b0148320 2019-11-28T11:52:16.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99b58b5700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0148320 0x7f99b010ed50 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f99a80107b0 tx=0x7f99a8010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99ae7fc700 1 -- 172.21.15.80:0/3952466095 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a800f150 con 0x7f99b0148320 2019-11-28T11:52:16.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99ae7fc700 1 -- 172.21.15.80:0/3952466095 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99a800f860 con 0x7f99b0148320 2019-11-28T11:52:16.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.451+0000 7f99b7318700 1 -- 172.21.15.80:0/3952466095 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b010c810 con 0x7f99b0148320 2019-11-28T11:52:16.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.452+0000 7f99b7318700 1 -- 172.21.15.80:0/3952466095 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b010c490 con 0x7f99b0148320 2019-11-28T11:52:16.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.452+0000 7f99b58b5700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0148320 0x7f99b010ed50 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f99a80107b0 tx=0x7f99a8010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.452+0000 7f99ae7fc700 1 -- 172.21.15.80:0/3952466095 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f99a800ed30 con 0x7f99b0148320 2019-11-28T11:52:16.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.452+0000 7f99b58b5700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0148320 0x7f99b010ed50 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f99a80107b0 tx=0x7f99a8010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.452+0000 7f99ae7fc700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9990018730 0x7f999001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:16.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.452+0000 7f99ae7fc700 1 -- 172.21.15.80:0/3952466095 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f99a8031e30 con 0x7f99b0148320 2019-11-28T11:52:16.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.452+0000 7f99b50b4700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9990018730 0x7f999001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:16.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.453+0000 7f99b50b4700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9990018730 0x7f999001abc0 crc :-1 s=READY pgs=879 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:16.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.460+0000 7f99b7318700 1 -- 172.21.15.80:0/3952466095 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b010c810 con 0x7f99b0148320 2019-11-28T11:52:16.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.464+0000 7f99b58b5700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0148320 0x7f99b010ed50 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f99a80107b0 tx=0x7f99a8010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.464+0000 7f99ae7fc700 1 -- 172.21.15.80:0/3952466095 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f99a80232c0 con 0x7f99b0148320 2019-11-28T11:52:16.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.631+0000 7f99b7318700 1 -- 172.21.15.80:0/3952466095 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f99b010c490 con 0x7f99b0148320 2019-11-28T11:52:16.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.632+0000 7f99b58b5700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0148320 0x7f99b010ed50 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f99a80107b0 tx=0x7f99a8010630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.632+0000 7f99ae7fc700 1 -- 172.21.15.80:0/3952466095 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v166) v1 ==== 104+0+10 (secure 0 0 0) 0x7f99a80232c0 con 0x7f99b0148320 2019-11-28T11:52:16.684 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:52:16.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.634+0000 7f99b7318700 1 -- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9990018730 msgr2=0x7f999001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.634+0000 7f99b7318700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9990018730 0x7f999001abc0 crc :-1 s=READY pgs=879 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.634+0000 7f99b7318700 1 -- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0148320 msgr2=0x7f99b010ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.634+0000 7f99b7318700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0148320 0x7f99b010ed50 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7f99a80107b0 tx=0x7f99a8010630).stop 2019-11-28T11:52:16.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.634+0000 7f99b7318700 1 -- 172.21.15.80:0/3952466095 shutdown_connections 2019-11-28T11:52:16.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.634+0000 7f99b7318700 1 --2- 172.21.15.80:0/3952466095 >> v2:172.21.15.174:3300/0 conn(0x7f99b010e3d0 0x7f99b0168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.634+0000 7f99b7318700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9990018730 0x7f999001abc0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.634+0000 7f99b7318700 1 --2- 172.21.15.80:0/3952466095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99b0148320 0x7f99b010ed50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.634+0000 7f99b7318700 1 -- 172.21.15.80:0/3952466095 shutdown_connections 2019-11-28T11:52:16.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.634+0000 7f99b7318700 1 -- 172.21.15.80:0/3952466095 wait complete. 2019-11-28T11:52:16.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.634+0000 7f99b7318700 1 -- 172.21.15.80:0/3952466095 >> 172.21.15.80:0/3952466095 conn(0x7f99b015e2d0 msgr2=0x7f99b0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:16.696 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:52:16.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.767+0000 7f2a3c4a7700 1 Processor -- start 2019-11-28T11:52:16.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.767+0000 7f2a3c4a7700 1 -- start start 2019-11-28T11:52:16.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.768+0000 7f2a3c4a7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2a3415f100 0x7f2a3406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:16.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.768+0000 7f2a3c4a7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2a3406c2f0 0x7f2a3406c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:16.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.768+0000 7f2a3c4a7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3406db60 con 0x7f2a3415ed10 2019-11-28T11:52:16.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.768+0000 7f2a3c4a7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3406fe00 con 0x7f2a3415f100 2019-11-28T11:52:16.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.768+0000 7f2a3c4a7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a340700d0 con 0x7f2a3406c2f0 2019-11-28T11:52:16.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.768+0000 7f2a3a243700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2a3415f100 0x7f2a3406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:16.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.768+0000 7f2a3a243700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2a3415f100 0x7f2a3406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42666/0 (socket says 172.21.15.80:42666) 2019-11-28T11:52:16.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.768+0000 7f2a3a243700 1 -- 172.21.15.80:0/1925368455 learned_addr learned my addr 172.21.15.80:0/1925368455 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:16.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.769+0000 7f2a3b245700 1 --2- 172.21.15.80:0/1925368455 >> v2:172.21.15.174:3300/0 conn(0x7f2a3406c2f0 0x7f2a3406c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:16.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.769+0000 7f2a3a243700 1 -- 172.21.15.80:0/1925368455 >> v2:172.21.15.174:3300/0 conn(0x7f2a3406c2f0 msgr2=0x7f2a3406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:16.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.769+0000 7f2a3a243700 1 --2- 172.21.15.80:0/1925368455 >> v2:172.21.15.174:3300/0 conn(0x7f2a3406c2f0 0x7f2a3406c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:16.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.769+0000 7f2a3a243700 1 -- 172.21.15.80:0/1925368455 >> v1:172.21.15.174:6789/0 conn(0x7f2a3415ed10 legacy=0x7f2a34073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.769+0000 7f2a3a243700 1 -- 172.21.15.80:0/1925368455 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a34070760 con 0x7f2a3415f100 2019-11-28T11:52:16.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.769+0000 7f2a3a243700 1 --2- 172.21.15.80:0/1925368455 >> v2:172.21.15.80:3300/0 conn(0x7f2a3415f100 0x7f2a3406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2a2400fac0 tx=0x7f2a2400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.769+0000 7f2a3a243700 1 --2- 172.21.15.80:0/1925368455 >> v2:172.21.15.80:3300/0 conn(0x7f2a3415f100 0x7f2a3406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2a2400fac0 tx=0x7f2a2400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.769+0000 7f2a3a243700 1 --2- 172.21.15.80:0/1925368455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a3415f100 0x7f2a3406bdb0 secure :-1 s=READY pgs=2154 cs=0 l=1 rx=0x7f2a2400fac0 tx=0x7f2a2400f8f0).ready entity=mon.0 client_cookie=f6a8561870bb3bba server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:16.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.769+0000 7f2a3a243700 1 --2- 172.21.15.80:0/1925368455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a3415f100 0x7f2a3406bdb0 secure :-1 s=THROTTLE_DONE pgs=2154 cs=0 l=1 rx=0x7f2a2400fac0 tx=0x7f2a2400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.769+0000 7f2a3a243700 1 --2- 172.21.15.80:0/1925368455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a3415f100 0x7f2a3406bdb0 secure :-1 s=THROTTLE_DONE pgs=2154 cs=0 l=1 rx=0x7f2a2400fac0 tx=0x7f2a2400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.769+0000 7f2a3a243700 1 --2- 172.21.15.80:0/1925368455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a3415f100 0x7f2a3406bdb0 secure :-1 s=THROTTLE_DONE pgs=2154 cs=0 l=1 rx=0x7f2a2400fac0 tx=0x7f2a2400f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.769+0000 7f2a39a42700 1 -- 172.21.15.80:0/1925368455 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a24000ce0 con 0x7f2a3415f100 2019-11-28T11:52:16.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.769+0000 7f2a39a42700 1 -- 172.21.15.80:0/1925368455 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a24001010 con 0x7f2a3415f100 2019-11-28T11:52:16.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.769+0000 7f2a39a42700 1 -- 172.21.15.80:0/1925368455 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a24001720 con 0x7f2a3415f100 2019-11-28T11:52:16.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.769+0000 7f2a3c4a7700 1 -- 172.21.15.80:0/1925368455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a3415f100 msgr2=0x7f2a3406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.769+0000 7f2a3c4a7700 1 --2- 172.21.15.80:0/1925368455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a3415f100 0x7f2a3406bdb0 secure :-1 s=READY pgs=2154 cs=0 l=1 rx=0x7f2a2400fac0 tx=0x7f2a2400f8f0).stop 2019-11-28T11:52:16.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.770+0000 7f2a3c4a7700 1 -- 172.21.15.80:0/1925368455 shutdown_connections 2019-11-28T11:52:16.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.770+0000 7f2a3c4a7700 1 --2- 172.21.15.80:0/1925368455 >> v2:172.21.15.174:3300/0 conn(0x7f2a3406c2f0 0x7f2a3406c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:16.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.770+0000 7f2a3c4a7700 1 --2- 172.21.15.80:0/1925368455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a3415f100 0x7f2a3406bdb0 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.770+0000 7f2a3c4a7700 1 -- 172.21.15.80:0/1925368455 shutdown_connections 2019-11-28T11:52:16.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.770+0000 7f2a3c4a7700 1 -- 172.21.15.80:0/1925368455 wait complete. 2019-11-28T11:52:16.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.770+0000 7f2a3c4a7700 1 -- 172.21.15.80:0/1925368455 >> 172.21.15.80:0/1925368455 conn(0x7f2a34061d20 msgr2=0x7f2a340641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:16.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.772+0000 7f2a3c4a7700 1 Processor -- start 2019-11-28T11:52:16.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.772+0000 7f2a3c4a7700 1 -- start start 2019-11-28T11:52:16.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.773+0000 7f2a3c4a7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2a3410e970 0x7f2a341087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:16.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.773+0000 7f2a3c4a7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a34108cf0 0x7f2a34107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:16.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.773+0000 7f2a3c4a7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3410c250 con 0x7f2a34107b70 2019-11-28T11:52:16.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.773+0000 7f2a3c4a7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3410e430 con 0x7f2a3410e970 2019-11-28T11:52:16.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.773+0000 7f2a3c4a7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a34105860 con 0x7f2a34108cf0 2019-11-28T11:52:16.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.773+0000 7f2a3a243700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a34108cf0 0x7f2a34107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:16.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.773+0000 7f2a3a243700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a34108cf0 0x7f2a34107630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:44930/0 (socket says 172.21.15.80:44930) 2019-11-28T11:52:16.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.773+0000 7f2a3a243700 1 -- 172.21.15.80:0/490431830 learned_addr learned my addr 172.21.15.80:0/490431830 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:16.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.773+0000 7f2a3aa44700 1 --2- 172.21.15.80:0/490431830 >> v2:172.21.15.174:3300/0 conn(0x7f2a3410e970 0x7f2a341087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:16.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a3a243700 1 -- 172.21.15.80:0/490431830 >> v2:172.21.15.174:3300/0 conn(0x7f2a3410e970 msgr2=0x7f2a341087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a3a243700 1 --2- 172.21.15.80:0/490431830 >> v2:172.21.15.174:3300/0 conn(0x7f2a3410e970 0x7f2a341087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:16.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a337fe700 1 -- 172.21.15.80:0/490431830 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337398141 0 0) 0x7f2a2c001080 con 0x7f2a34107b70 2019-11-28T11:52:16.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a3a243700 1 -- 172.21.15.80:0/490431830 >> v1:172.21.15.174:6789/0 conn(0x7f2a34107b70 legacy=0x7f2a3410ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:16.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a3a243700 1 -- 172.21.15.80:0/490431830 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a34105ef0 con 0x7f2a34108cf0 2019-11-28T11:52:16.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a3a243700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a34108cf0 0x7f2a34107630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2a24008010 tx=0x7f2a2400c690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a3a243700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a34108cf0 0x7f2a34107630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2a24008010 tx=0x7f2a2400c690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a3a243700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a34108cf0 0x7f2a34107630 secure :-1 s=READY pgs=303 cs=0 l=1 rx=0x7f2a24008010 tx=0x7f2a2400c690).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:16.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a3a243700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a34108cf0 0x7f2a34107630 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f2a24008010 tx=0x7f2a2400c690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a337fe700 1 -- 172.21.15.80:0/490431830 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a24008050 con 0x7f2a34108cf0 2019-11-28T11:52:16.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a3a243700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a34108cf0 0x7f2a34107630 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f2a24008010 tx=0x7f2a2400c690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a3a243700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a34108cf0 0x7f2a34107630 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f2a24008010 tx=0x7f2a2400c690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a337fe700 1 -- 172.21.15.80:0/490431830 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a240056f0 con 0x7f2a34108cf0 2019-11-28T11:52:16.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a3c4a7700 1 -- 172.21.15.80:0/490431830 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a34106270 con 0x7f2a34108cf0 2019-11-28T11:52:16.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a337fe700 1 -- 172.21.15.80:0/490431830 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a24005d40 con 0x7f2a34108cf0 2019-11-28T11:52:16.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a3c4a7700 1 -- 172.21.15.80:0/490431830 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a34105ef0 con 0x7f2a34108cf0 2019-11-28T11:52:16.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.774+0000 7f2a3a243700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a34108cf0 0x7f2a34107630 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f2a24008010 tx=0x7f2a2400c690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.775+0000 7f2a337fe700 1 -- 172.21.15.80:0/490431830 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2a240058e0 con 0x7f2a34108cf0 2019-11-28T11:52:16.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.775+0000 7f2a3a243700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a34108cf0 0x7f2a34107630 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f2a24008010 tx=0x7f2a2400c690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.775+0000 7f2a337fe700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a14018730 0x7f2a1401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:16.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.775+0000 7f2a337fe700 1 -- 172.21.15.80:0/490431830 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f2a24031dc0 con 0x7f2a34108cf0 2019-11-28T11:52:16.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.775+0000 7f2a3aa44700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a14018730 0x7f2a1401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:16.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.775+0000 7f2a3aa44700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a14018730 0x7f2a1401abc0 crc :-1 s=READY pgs=880 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:16.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.782+0000 7f2a3c4a7700 1 -- 172.21.15.80:0/490431830 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a34106270 con 0x7f2a34108cf0 2019-11-28T11:52:16.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.786+0000 7f2a3a243700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a34108cf0 0x7f2a34107630 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f2a24008010 tx=0x7f2a2400c690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:16.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.786+0000 7f2a337fe700 1 -- 172.21.15.80:0/490431830 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2a240221b0 con 0x7f2a34108cf0 2019-11-28T11:52:17.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.952+0000 7f2a3c4a7700 1 -- 172.21.15.80:0/490431830 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f2a34105ef0 con 0x7f2a34108cf0 2019-11-28T11:52:17.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.952+0000 7f2a3a243700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a34108cf0 0x7f2a34107630 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f2a24008010 tx=0x7f2a2400c690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:17.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.952+0000 7f2a337fe700 1 -- 172.21.15.80:0/490431830 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v166) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2a240221b0 con 0x7f2a34108cf0 2019-11-28T11:52:17.005 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:52:17.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.955+0000 7f2a3c4a7700 1 -- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a14018730 msgr2=0x7f2a1401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:17.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.955+0000 7f2a3c4a7700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a14018730 0x7f2a1401abc0 crc :-1 s=READY pgs=880 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:17.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.955+0000 7f2a3c4a7700 1 -- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a34108cf0 msgr2=0x7f2a34107630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:17.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.955+0000 7f2a3c4a7700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a34108cf0 0x7f2a34107630 secure :-1 s=READY pgs=303 cs=0 l=1 rx=0x7f2a24008010 tx=0x7f2a2400c690).stop 2019-11-28T11:52:17.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.955+0000 7f2a3c4a7700 1 -- 172.21.15.80:0/490431830 shutdown_connections 2019-11-28T11:52:17.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.955+0000 7f2a3c4a7700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a14018730 0x7f2a1401abc0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:17.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.955+0000 7f2a3c4a7700 1 --2- 172.21.15.80:0/490431830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a34108cf0 0x7f2a34107630 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:17.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.955+0000 7f2a3c4a7700 1 --2- 172.21.15.80:0/490431830 >> v2:172.21.15.174:3300/0 conn(0x7f2a3410e970 0x7f2a341087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:17.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.955+0000 7f2a3c4a7700 1 -- 172.21.15.80:0/490431830 shutdown_connections 2019-11-28T11:52:17.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.955+0000 7f2a3c4a7700 1 -- 172.21.15.80:0/490431830 wait complete. 2019-11-28T11:52:17.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:16.955+0000 7f2a3c4a7700 1 -- 172.21.15.80:0/490431830 >> 172.21.15.80:0/490431830 conn(0x7f2a3415e2d0 msgr2=0x7f2a34147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:17.016 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:52:17.017 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:17.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.085+0000 7fa7c35ce700 1 Processor -- start 2019-11-28T11:52:17.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.085+0000 7fa7c35ce700 1 -- start start 2019-11-28T11:52:17.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.086+0000 7fa7c35ce700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7bc06c0a0 0x7fa7bc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:17.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.086+0000 7fa7c35ce700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa7bc0734e0 0x7fa7bc071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:17.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.086+0000 7fa7c35ce700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc06db00 con 0x7fa7bc072360 2019-11-28T11:52:17.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.086+0000 7fa7c35ce700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7bc06f330 con 0x7fa7bc0734e0 2019-11-28T11:52:17.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.086+0000 7fa7c35ce700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0706c0 con 0x7fa7bc06c0a0 2019-11-28T11:52:17.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.086+0000 7fa7c236c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa7bc072360 0x7fa7bc06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41994/0 (socket says 172.21.15.80:41994) 2019-11-28T11:52:17.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.086+0000 7fa7c236c700 1 -- 172.21.15.80:0/185507245 learned_addr learned my addr 172.21.15.80:0/185507245 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:17.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.086+0000 7fa7c136a700 1 --2- 172.21.15.80:0/185507245 >> v2:172.21.15.174:3300/0 conn(0x7fa7bc0734e0 0x7fa7bc071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:17.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.086+0000 7fa7c1b6b700 1 --2- 172.21.15.80:0/185507245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7bc06c0a0 0x7fa7bc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:17.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c0b69700 1 -- 172.21.15.80:0/185507245 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176540683 0 0) 0x7fa7b4001150 con 0x7fa7bc072360 2019-11-28T11:52:17.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c0b69700 1 -- 172.21.15.80:0/185507245 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7a8002e80 con 0x7fa7bc072360 2019-11-28T11:52:17.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c1b6b700 1 -- 172.21.15.80:0/185507245 >> v2:172.21.15.174:3300/0 conn(0x7fa7bc0734e0 msgr2=0x7fa7bc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:17.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c1b6b700 1 --2- 172.21.15.80:0/185507245 >> v2:172.21.15.174:3300/0 conn(0x7fa7bc0734e0 0x7fa7bc071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:17.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c1b6b700 1 -- 172.21.15.80:0/185507245 >> v1:172.21.15.80:6789/0 conn(0x7fa7bc072360 legacy=0x7fa7bc06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:17.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c1b6b700 1 -- 172.21.15.80:0/185507245 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc070a40 con 0x7fa7bc06c0a0 2019-11-28T11:52:17.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c136a700 1 --2- 172.21.15.80:0/185507245 >> v2:172.21.15.174:3300/0 conn(0x7fa7bc0734e0 0x7fa7bc071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:17.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c1b6b700 1 --2- 172.21.15.80:0/185507245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7bc06c0a0 0x7fa7bc072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa7a400b2d0 tx=0x7fa7a400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:17.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c1b6b700 1 --2- 172.21.15.80:0/185507245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7bc06c0a0 0x7fa7bc072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa7a400b2d0 tx=0x7fa7a400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:17.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c1b6b700 1 --2- 172.21.15.80:0/185507245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7bc06c0a0 0x7fa7bc072fa0 secure :-1 s=READY pgs=304 cs=0 l=1 rx=0x7fa7a400b2d0 tx=0x7fa7a400bae0).ready entity=mon.2 client_cookie=7e6ad6f836e51740 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:17.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c1b6b700 1 --2- 172.21.15.80:0/185507245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7bc06c0a0 0x7fa7bc072fa0 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fa7a400b2d0 tx=0x7fa7a400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:17.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c0b69700 1 -- 172.21.15.80:0/185507245 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7a4007590 con 0x7fa7bc06c0a0 2019-11-28T11:52:17.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c1b6b700 1 --2- 172.21.15.80:0/185507245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7bc06c0a0 0x7fa7bc072fa0 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fa7a400b2d0 tx=0x7fa7a400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:17.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c0b69700 1 -- 172.21.15.80:0/185507245 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a4009d30 con 0x7fa7bc06c0a0 2019-11-28T11:52:17.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c1b6b700 1 --2- 172.21.15.80:0/185507245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7bc06c0a0 0x7fa7bc072fa0 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fa7a400b2d0 tx=0x7fa7a400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:17.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c0b69700 1 -- 172.21.15.80:0/185507245 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7a4000ce0 con 0x7fa7bc06c0a0 2019-11-28T11:52:17.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c35ce700 1 -- 172.21.15.80:0/185507245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7bc06c0a0 msgr2=0x7fa7bc072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:17.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.087+0000 7fa7c35ce700 1 --2- 172.21.15.80:0/185507245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7bc06c0a0 0x7fa7bc072fa0 secure :-1 s=READY pgs=304 cs=0 l=1 rx=0x7fa7a400b2d0 tx=0x7fa7a400bae0).stop 2019-11-28T11:52:17.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.088+0000 7fa7c35ce700 1 -- 172.21.15.80:0/185507245 shutdown_connections 2019-11-28T11:52:17.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.088+0000 7fa7c35ce700 1 --2- 172.21.15.80:0/185507245 >> v2:172.21.15.174:3300/0 conn(0x7fa7bc0734e0 0x7fa7bc071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:17.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.088+0000 7fa7c35ce700 1 --2- 172.21.15.80:0/185507245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7bc06c0a0 0x7fa7bc072fa0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:17.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.088+0000 7fa7c35ce700 1 -- 172.21.15.80:0/185507245 shutdown_connections 2019-11-28T11:52:17.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.088+0000 7fa7c35ce700 1 -- 172.21.15.80:0/185507245 wait complete. 2019-11-28T11:52:17.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.088+0000 7fa7c35ce700 1 -- 172.21.15.80:0/185507245 >> 172.21.15.80:0/185507245 conn(0x7fa7bc061cf0 msgr2=0x7fa7bc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:17.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.090+0000 7fa7c35ce700 1 Processor -- start 2019-11-28T11:52:17.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.090+0000 7fa7c35ce700 1 -- start start 2019-11-28T11:52:17.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.091+0000 7fa7c35ce700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7bc104c10 0x7fa7bc1050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:17.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.091+0000 7fa7c35ce700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa7bc1055e0 0x7fa7bc167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:17.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.091+0000 7fa7c35ce700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc105a30 con 0x7fa7bc104820 2019-11-28T11:52:17.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.091+0000 7fa7c35ce700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7bc109130 con 0x7fa7bc1055e0 2019-11-28T11:52:17.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.091+0000 7fa7c35ce700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc109400 con 0x7fa7bc104c10 2019-11-28T11:52:17.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.091+0000 7fa7c236c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa7bc1055e0 0x7fa7bc167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:17.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.091+0000 7fa7c236c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa7bc1055e0 0x7fa7bc167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42686/0 (socket says 172.21.15.80:42686) 2019-11-28T11:52:17.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.091+0000 7fa7c236c700 1 -- 172.21.15.80:0/2397724172 learned_addr learned my addr 172.21.15.80:0/2397724172 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:17.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.091+0000 7fa7c136a700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7bc104c10 0x7fa7bc1050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:17.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.092+0000 7fa7c236c700 1 -- 172.21.15.80:0/2397724172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7bc104c10 msgr2=0x7fa7bc1050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:17.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.092+0000 7fa7c236c700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7bc104c10 0x7fa7bc1050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:17.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.092+0000 7fa7c236c700 1 -- 172.21.15.80:0/2397724172 >> v1:172.21.15.80:6789/0 conn(0x7fa7bc104820 legacy=0x7fa7bc10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:17.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.092+0000 7fa7c236c700 1 -- 172.21.15.80:0/2397724172 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc109a90 con 0x7fa7bc1055e0 2019-11-28T11:52:17.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.092+0000 7fa7c236c700 1 --2- 172.21.15.80:0/2397724172 >> v2:172.21.15.80:3300/0 conn(0x7fa7bc1055e0 0x7fa7bc167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7b4010430 tx=0x7fa7b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:17.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.092+0000 7fa7c236c700 1 --2- 172.21.15.80:0/2397724172 >> v2:172.21.15.80:3300/0 conn(0x7fa7bc1055e0 0x7fa7bc167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7b4010430 tx=0x7fa7b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:17.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.092+0000 7fa7c236c700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7bc1055e0 0x7fa7bc167a10 secure :-1 s=READY pgs=2157 cs=0 l=1 rx=0x7fa7b4010430 tx=0x7fa7b4010260).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:17.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.092+0000 7fa7c236c700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7bc1055e0 0x7fa7bc167a10 secure :-1 s=THROTTLE_DONE pgs=2157 cs=0 l=1 rx=0x7fa7b4010430 tx=0x7fa7b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:17.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.092+0000 7fa7ba7fc700 1 -- 172.21.15.80:0/2397724172 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7b4000940 con 0x7fa7bc1055e0 2019-11-28T11:52:17.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.092+0000 7fa7c236c700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7bc1055e0 0x7fa7bc167a10 secure :-1 s=THROTTLE_DONE pgs=2157 cs=0 l=1 rx=0x7fa7b4010430 tx=0x7fa7b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:17.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.092+0000 7fa7c236c700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7bc1055e0 0x7fa7bc167a10 secure :-1 s=THROTTLE_DONE pgs=2157 cs=0 l=1 rx=0x7fa7b4010430 tx=0x7fa7b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:17.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.092+0000 7fa7ba7fc700 1 -- 172.21.15.80:0/2397724172 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b4004240 con 0x7fa7bc1055e0 2019-11-28T11:52:17.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.092+0000 7fa7c35ce700 1 -- 172.21.15.80:0/2397724172 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7bc109e10 con 0x7fa7bc1055e0 2019-11-28T11:52:17.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.092+0000 7fa7ba7fc700 1 -- 172.21.15.80:0/2397724172 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7b40048d0 con 0x7fa7bc1055e0 2019-11-28T11:52:17.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.092+0000 7fa7c35ce700 1 -- 172.21.15.80:0/2397724172 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7bc109a90 con 0x7fa7bc1055e0 2019-11-28T11:52:17.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.092+0000 7fa7c236c700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7bc1055e0 0x7fa7bc167a10 secure :-1 s=THROTTLE_DONE pgs=2157 cs=0 l=1 rx=0x7fa7b4010430 tx=0x7fa7b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:17.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.093+0000 7fa7ba7fc700 1 -- 172.21.15.80:0/2397724172 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa7b4004430 con 0x7fa7bc1055e0 2019-11-28T11:52:17.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.093+0000 7fa7c236c700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7bc1055e0 0x7fa7bc167a10 secure :-1 s=THROTTLE_DONE pgs=2157 cs=0 l=1 rx=0x7fa7b4010430 tx=0x7fa7b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:17.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.093+0000 7fa7ba7fc700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7a0018730 0x7fa7a001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:17.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.093+0000 7fa7ba7fc700 1 -- 172.21.15.80:0/2397724172 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fa7b4031d20 con 0x7fa7bc1055e0 2019-11-28T11:52:17.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.093+0000 7fa7c1b6b700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7a0018730 0x7fa7a001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:17.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.093+0000 7fa7c1b6b700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7a0018730 0x7fa7a001abe0 crc :-1 s=READY pgs=881 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:17.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.100+0000 7fa7c35ce700 1 -- 172.21.15.80:0/2397724172 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7bc109e10 con 0x7fa7bc1055e0 2019-11-28T11:52:17.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.104+0000 7fa7c236c700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7bc1055e0 0x7fa7bc167a10 secure :-1 s=THROTTLE_DONE pgs=2157 cs=0 l=1 rx=0x7fa7b4010430 tx=0x7fa7b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:17.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.104+0000 7fa7ba7fc700 1 -- 172.21.15.80:0/2397724172 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa7b40012e0 con 0x7fa7bc1055e0 2019-11-28T11:52:17.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.275+0000 7fa7c35ce700 1 -- 172.21.15.80:0/2397724172 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7bc109a90 con 0x7fa7bc1055e0 2019-11-28T11:52:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.276+0000 7fa7c236c700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7bc1055e0 0x7fa7bc167a10 secure :-1 s=THROTTLE_DONE pgs=2157 cs=0 l=1 rx=0x7fa7b4010430 tx=0x7fa7b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:17.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.276+0000 7fa7ba7fc700 1 -- 172.21.15.80:0/2397724172 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 131 v131) v1 ==== 95+0+2457 (secure 0 0 0) 0x7fa7b4004240 con 0x7fa7bc1055e0 2019-11-28T11:52:17.329 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 131 2019-11-28T11:52:17.329 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:17.329 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":131,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7019,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/1144103346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1144103346},{"type":"v1","addr":"172.21.15.80:6834","nonce":1144103346}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":127},{"gid":9613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3914187264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3914187264},{"type":"v1","addr":"172.21.15.80:6835","nonce":3914187264}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":127}],"filesystems":[{"mdsmap":{"epoch":131,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:49:58.925387+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7016":{"gid":7016,"name":"c","rank":0,"incarnation":128,"state":"up:active","state_seq":5,"addr":"172.21.15.174:6835/2828740513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2828740513},{"type":"v1","addr":"172.21.15.174:6835","nonce":2828740513}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:52:17.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.278+0000 7fa7c35ce700 1 -- 172.21.15.80:0/2397724172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7a0018730 msgr2=0x7fa7a001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.278+0000 7fa7c35ce700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7a0018730 0x7fa7a001abe0 crc :-1 s=READY pgs=881 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.278+0000 7fa7c35ce700 1 -- 172.21.15.80:0/2397724172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7bc1055e0 msgr2=0x7fa7bc167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.278+0000 7fa7c35ce700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7bc1055e0 0x7fa7bc167a10 secure :-1 s=READY pgs=2157 cs=0 l=1 rx=0x7fa7b4010430 tx=0x7fa7b4010260).stop 2019-11-28T11:52:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.278+0000 7fa7c35ce700 1 -- 172.21.15.80:0/2397724172 shutdown_connections 2019-11-28T11:52:17.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.278+0000 7fa7c35ce700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa7a0018730 0x7fa7a001abe0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.278+0000 7fa7c35ce700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7bc1055e0 0x7fa7bc167a10 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.278+0000 7fa7c35ce700 1 --2- 172.21.15.80:0/2397724172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7bc104c10 0x7fa7bc1050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.278+0000 7fa7c35ce700 1 -- 172.21.15.80:0/2397724172 shutdown_connections 2019-11-28T11:52:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.278+0000 7fa7c35ce700 1 -- 172.21.15.80:0/2397724172 wait complete. 2019-11-28T11:52:17.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:17.278+0000 7fa7c35ce700 1 -- 172.21.15.80:0/2397724172 >> 172.21.15.80:0/2397724172 conn(0x7fa7bc13d620 msgr2=0x7fa7bc13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:17.643 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7016}, u'last_failure_osd_epoch': 163, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 26, u'failed': [], u'epoch': 131, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [27], u'info': {u'gid_7016': {u'export_targets': [], u'name': u'c', u'incarnation': 128, u'state_seq': 5, u'state': u'up:active', u'gid': 7016, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2828740513, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2828740513, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2828740513'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:49:33.165935+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:49:58.925387+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:52:17.644 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:52:17.644 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:52:17.772 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:52:17.773 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:52:17.773 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:52:17.773 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 7016, 2019-11-28T11:52:17.773 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:52:17.773 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:52:17.773 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 143.806528891, 2019-11-28T11:52:17.774 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 131, 2019-11-28T11:52:17.774 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 166, 2019-11-28T11:52:17.774 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 166, 2019-11-28T11:52:17.774 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 148.116141027 2019-11-28T11:52:17.774 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:52:17.778 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7016, "want_state": "up:active", "state": "up:active", "rank_uptime": 143.806528891, "mdsmap_epoch": 131, "osdmap_epoch": 166, "osdmap_epoch_barrier": 166, "uptime": 148.116141027 } 2019-11-28T11:52:17.779 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:52:17.779 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:52:17.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:52:17.779 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:52:17.866 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:52:17.867 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:52:17.988 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:52:17.988 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:52:18.053 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:52:18.054 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:52:18.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:52:18.089 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:52:18.159 DEBUG:tasks.cephfs.mount:Creating test file 2019-11-28 11:52:18.159333 0 2019-11-28T11:52:18.159 INFO:teuthology.orchestra.run.smithi076:> sudo touch '/home/ubuntu/cephtest/mnt.0/2019-11-28 11:52:18.159333 0' 2019-11-28T11:52:18.217 DEBUG:tasks.cephfs.mount:Deleting test file 2019-11-28 11:52:18.159333 0 2019-11-28T11:52:18.218 INFO:teuthology.orchestra.run.smithi076:> sudo rm -f '/home/ubuntu/cephtest/mnt.0/2019-11-28 11:52:18.159333 0' 2019-11-28T11:52:18.273 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_eviction' 2019-11-28T11:52:18.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.339+0000 7f8a3e25e700 1 Processor -- start 2019-11-28T11:52:18.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.339+0000 7f8a3e25e700 1 -- start start 2019-11-28T11:52:18.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a3e25e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a3806c490 0x7f8a3806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:18.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a3e25e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806ce60 0x7f8a38164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:18.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a3e25e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3806db00 con 0x7f8a3806c0a0 2019-11-28T11:52:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a3e25e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3806fd60 con 0x7f8a3806c490 2019-11-28T11:52:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a3e25e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a38070030 con 0x7f8a3806ce60 2019-11-28T11:52:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a2ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a3806c490 0x7f8a3806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a2ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a3806c490 0x7f8a3806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42692/0 (socket says 172.21.15.80:42692) 2019-11-28T11:52:18.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a2ffff700 1 -- 172.21.15.80:0/1379462200 learned_addr learned my addr 172.21.15.80:0/1379462200 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:18.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a3cffc700 1 --2- 172.21.15.80:0/1379462200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806ce60 0x7f8a38164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:18.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a2ffff700 1 -- 172.21.15.80:0/1379462200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806ce60 msgr2=0x7f8a38164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:18.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1379462200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806ce60 0x7f8a38164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:18.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a2ffff700 1 -- 172.21.15.80:0/1379462200 >> v1:172.21.15.174:6789/0 conn(0x7f8a3806c0a0 legacy=0x7f8a38072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:18.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a2ffff700 1 -- 172.21.15.80:0/1379462200 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a380706c0 con 0x7f8a3806c490 2019-11-28T11:52:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a3cffc700 1 --2- 172.21.15.80:0/1379462200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806ce60 0x7f8a38164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:52:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1379462200 >> v2:172.21.15.80:3300/0 conn(0x7f8a3806c490 0x7f8a3806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8a2000f740 tx=0x7f8a2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1379462200 >> v2:172.21.15.80:3300/0 conn(0x7f8a3806c490 0x7f8a3806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8a2000f740 tx=0x7f8a2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1379462200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3806c490 0x7f8a3806c920 secure :-1 s=READY pgs=2158 cs=0 l=1 rx=0x7f8a2000f740 tx=0x7f8a2000fae0).ready entity=mon.0 client_cookie=b23e40cde12ae992 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:18.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1379462200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3806c490 0x7f8a3806c920 secure :-1 s=THROTTLE_DONE pgs=2158 cs=0 l=1 rx=0x7f8a2000f740 tx=0x7f8a2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:18.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1379462200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3806c490 0x7f8a3806c920 secure :-1 s=THROTTLE_DONE pgs=2158 cs=0 l=1 rx=0x7f8a2000f740 tx=0x7f8a2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:18.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a377fe700 1 -- 172.21.15.80:0/1379462200 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a20000960 con 0x7f8a3806c490 2019-11-28T11:52:18.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1379462200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3806c490 0x7f8a3806c920 secure :-1 s=THROTTLE_DONE pgs=2158 cs=0 l=1 rx=0x7f8a2000f740 tx=0x7f8a2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:18.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a377fe700 1 -- 172.21.15.80:0/1379462200 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a20000c90 con 0x7f8a3806c490 2019-11-28T11:52:18.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a377fe700 1 -- 172.21.15.80:0/1379462200 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a200013a0 con 0x7f8a3806c490 2019-11-28T11:52:18.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a3e25e700 1 -- 172.21.15.80:0/1379462200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3806c490 msgr2=0x7f8a3806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:18.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.340+0000 7f8a3e25e700 1 --2- 172.21.15.80:0/1379462200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3806c490 0x7f8a3806c920 secure :-1 s=READY pgs=2158 cs=0 l=1 rx=0x7f8a2000f740 tx=0x7f8a2000fae0).stop 2019-11-28T11:52:18.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.341+0000 7f8a3e25e700 1 -- 172.21.15.80:0/1379462200 shutdown_connections 2019-11-28T11:52:18.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.341+0000 7f8a3e25e700 1 --2- 172.21.15.80:0/1379462200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a3806ce60 0x7f8a38164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:18.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.341+0000 7f8a3e25e700 1 --2- 172.21.15.80:0/1379462200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3806c490 0x7f8a3806c920 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:18.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.341+0000 7f8a3e25e700 1 -- 172.21.15.80:0/1379462200 shutdown_connections 2019-11-28T11:52:18.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.341+0000 7f8a3e25e700 1 -- 172.21.15.80:0/1379462200 wait complete. 2019-11-28T11:52:18.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.341+0000 7f8a3e25e700 1 -- 172.21.15.80:0/1379462200 >> 172.21.15.80:0/1379462200 conn(0x7f8a38061cf0 msgr2=0x7f8a38064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.344+0000 7f8a3e25e700 1 Processor -- start 2019-11-28T11:52:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.344+0000 7f8a3e25e700 1 -- start start 2019-11-28T11:52:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a3e25e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8a38104d10 0x7f8a3810e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a3e25e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a3810e670 0x7f8a3813e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a3e25e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a38135c60 con 0x7f8a3813e830 2019-11-28T11:52:18.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a3e25e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a38141e60 con 0x7f8a3810e670 2019-11-28T11:52:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a3e25e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a38107cb0 con 0x7f8a38104d10 2019-11-28T11:52:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a2ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a3810e670 0x7f8a3813e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a2ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a3810e670 0x7f8a3813e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42698/0 (socket says 172.21.15.80:42698) 2019-11-28T11:52:18.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a2ffff700 1 -- 172.21.15.80:0/1139919000 learned_addr learned my addr 172.21.15.80:0/1139919000 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:18.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a37fff700 1 --2- 172.21.15.80:0/1139919000 >> v2:172.21.15.174:3300/0 conn(0x7f8a38104d10 0x7f8a3810e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:18.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a2ffff700 1 -- 172.21.15.80:0/1139919000 >> v2:172.21.15.174:3300/0 conn(0x7f8a38104d10 msgr2=0x7f8a3810e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:18.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1139919000 >> v2:172.21.15.174:3300/0 conn(0x7f8a38104d10 0x7f8a3810e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:18.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a2ffff700 1 -- 172.21.15.80:0/1139919000 >> v1:172.21.15.174:6789/0 conn(0x7f8a3813e830 legacy=0x7f8a3810cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a2ffff700 1 -- 172.21.15.80:0/1139919000 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a381424f0 con 0x7f8a3810e670 2019-11-28T11:52:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1139919000 >> v2:172.21.15.80:3300/0 conn(0x7f8a3810e670 0x7f8a3813e2f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a20010460 tx=0x7f8a20010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1139919000 >> v2:172.21.15.80:3300/0 conn(0x7f8a3810e670 0x7f8a3813e2f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a20010460 tx=0x7f8a20010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1139919000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3810e670 0x7f8a3813e2f0 secure :-1 s=READY pgs=2159 cs=0 l=1 rx=0x7f8a20010460 tx=0x7f8a20010310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1139919000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3810e670 0x7f8a3813e2f0 secure :-1 s=THROTTLE_DONE pgs=2159 cs=0 l=1 rx=0x7f8a20010460 tx=0x7f8a20010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:18.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a357fa700 1 -- 172.21.15.80:0/1139919000 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a20000940 con 0x7f8a3810e670 2019-11-28T11:52:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1139919000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3810e670 0x7f8a3813e2f0 secure :-1 s=THROTTLE_DONE pgs=2159 cs=0 l=1 rx=0x7f8a20010460 tx=0x7f8a20010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1139919000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3810e670 0x7f8a3813e2f0 secure :-1 s=THROTTLE_DONE pgs=2159 cs=0 l=1 rx=0x7f8a20010460 tx=0x7f8a20010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a357fa700 1 -- 172.21.15.80:0/1139919000 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a20000f50 con 0x7f8a3810e670 2019-11-28T11:52:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a3e25e700 1 -- 172.21.15.80:0/1139919000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a381424f0 con 0x7f8a3810e670 2019-11-28T11:52:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a357fa700 1 -- 172.21.15.80:0/1139919000 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a20001620 con 0x7f8a3810e670 2019-11-28T11:52:18.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.345+0000 7f8a3e25e700 1 -- 172.21.15.80:0/1139919000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a381424f0 con 0x7f8a3810e670 2019-11-28T11:52:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.346+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1139919000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3810e670 0x7f8a3813e2f0 secure :-1 s=THROTTLE_DONE pgs=2159 cs=0 l=1 rx=0x7f8a20010460 tx=0x7f8a20010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.346+0000 7f8a357fa700 1 -- 172.21.15.80:0/1139919000 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8a20001140 con 0x7f8a3810e670 2019-11-28T11:52:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.346+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1139919000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3810e670 0x7f8a3813e2f0 secure :-1 s=THROTTLE_DONE pgs=2159 cs=0 l=1 rx=0x7f8a20010460 tx=0x7f8a20010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.346+0000 7f8a357fa700 1 --2- 172.21.15.80:0/1139919000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a1c018730 0x7f8a1c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.346+0000 7f8a357fa700 1 -- 172.21.15.80:0/1139919000 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f8a20031ab0 con 0x7f8a3810e670 2019-11-28T11:52:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.346+0000 7f8a37fff700 1 --2- 172.21.15.80:0/1139919000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a1c018730 0x7f8a1c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:18.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.346+0000 7f8a37fff700 1 --2- 172.21.15.80:0/1139919000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a1c018730 0x7f8a1c01abc0 crc :-1 s=READY pgs=882 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.354+0000 7f8a3e25e700 1 -- 172.21.15.80:0/1139919000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a381424f0 con 0x7f8a3810e670 2019-11-28T11:52:18.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.357+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1139919000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3810e670 0x7f8a3813e2f0 secure :-1 s=THROTTLE_DONE pgs=2159 cs=0 l=1 rx=0x7f8a20010460 tx=0x7f8a20010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:18.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.357+0000 7f8a357fa700 1 -- 172.21.15.80:0/1139919000 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8a20000b50 con 0x7f8a3810e670 2019-11-28T11:52:18.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:18.530+0000 7f8a3e25e700 1 -- 172.21.15.80:0/1139919000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_eviction"]} v 0) v1 -- 0x7f8a381424f0 con 0x7f8a3810e670 2019-11-28T11:52:19.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.051+0000 7f8a2ffff700 1 --2- 172.21.15.80:0/1139919000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3810e670 0x7f8a3813e2f0 secure :-1 s=THROTTLE_DONE pgs=2159 cs=0 l=1 rx=0x7f8a20010460 tx=0x7f8a20010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:19.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.051+0000 7f8a357fa700 1 -- 172.21.15.80:0/1139919000 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_eviction"]}]=0 v606) v1 ==== 155+0+0 (secure 0 0 0) 0x7f8a20017450 con 0x7f8a3810e670 2019-11-28T11:52:19.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.097+0000 7f8a3e25e700 1 -- 172.21.15.80:0/1139919000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a1c018730 msgr2=0x7f8a1c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:19.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.097+0000 7f8a3e25e700 1 --2- 172.21.15.80:0/1139919000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a1c018730 0x7f8a1c01abc0 crc :-1 s=READY pgs=882 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:19.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.097+0000 7f8a3e25e700 1 -- 172.21.15.80:0/1139919000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3810e670 msgr2=0x7f8a3813e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:19.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.097+0000 7f8a3e25e700 1 --2- 172.21.15.80:0/1139919000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3810e670 0x7f8a3813e2f0 secure :-1 s=READY pgs=2159 cs=0 l=1 rx=0x7f8a20010460 tx=0x7f8a20010310).stop 2019-11-28T11:52:19.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.097+0000 7f8a3e25e700 1 -- 172.21.15.80:0/1139919000 shutdown_connections 2019-11-28T11:52:19.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.097+0000 7f8a3e25e700 1 --2- 172.21.15.80:0/1139919000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a1c018730 0x7f8a1c01abc0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:19.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.097+0000 7f8a3e25e700 1 --2- 172.21.15.80:0/1139919000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a3810e670 0x7f8a3813e2f0 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:19.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.097+0000 7f8a3e25e700 1 --2- 172.21.15.80:0/1139919000 >> v2:172.21.15.174:3300/0 conn(0x7f8a38104d10 0x7f8a3810e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:19.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.097+0000 7f8a3e25e700 1 -- 172.21.15.80:0/1139919000 shutdown_connections 2019-11-28T11:52:19.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.097+0000 7f8a3e25e700 1 -- 172.21.15.80:0/1139919000 wait complete. 2019-11-28T11:52:19.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.097+0000 7f8a3e25e700 1 -- 172.21.15.80:0/1139919000 >> 172.21.15.80:0/1139919000 conn(0x7f8a3815e210 msgr2=0x7f8a3810b140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:19.160 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:52:19.160 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:52:19.226 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:52:19.287 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:52:19.349 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:52:19.405 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:52:19.469 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:52:19.527 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:52:19.528 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:52:19.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:52:19.528 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T11:52:19.605 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:52:19.609 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:52:19.647 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:52:19.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:52:19.648 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:52:19.773 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:52:19.778 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:52:19.820 INFO:tasks.cephfs_test_runner:test_reconnect_eviction (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2019-11-28T11:52:19.820 INFO:tasks.cephfs_test_runner:Starting test: test_reconnect_timeout (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T11:52:19.820 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_timeout' 2019-11-28T11:52:19.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.888+0000 7f4628536700 1 Processor -- start 2019-11-28T11:52:19.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.888+0000 7f4628536700 1 -- start start 2019-11-28T11:52:19.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.889+0000 7f4628536700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f462006c0a0 0x7f4620072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:19.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.889+0000 7f4628536700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4620072620 0x7f4620164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:19.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.889+0000 7f4628536700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462006db00 con 0x7f46200734e0 2019-11-28T11:52:19.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.889+0000 7f4628536700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462006fd60 con 0x7f462006c0a0 2019-11-28T11:52:19.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.889+0000 7f4628536700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4620070030 con 0x7f4620072620 2019-11-28T11:52:19.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.889+0000 7f4626ad3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f462006c0a0 0x7f4620072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:19.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.889+0000 7f4626ad3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f462006c0a0 0x7f4620072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42704/0 (socket says 172.21.15.80:42704) 2019-11-28T11:52:19.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.889+0000 7f4626ad3700 1 -- 172.21.15.80:0/2292382720 learned_addr learned my addr 172.21.15.80:0/2292382720 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:19.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.889+0000 7f46262d2700 1 --1- 172.21.15.80:0/2292382720 >> v1:172.21.15.80:6789/0 conn(0x7f46200734e0 0x7f4620071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42024/0 (socket says 172.21.15.80:42024) 2019-11-28T11:52:19.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f46272d4700 1 --2- 172.21.15.80:0/2292382720 >> v2:172.21.15.174:3300/0 conn(0x7f4620072620 0x7f4620164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:19.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f4626ad3700 1 -- 172.21.15.80:0/2292382720 >> v2:172.21.15.174:3300/0 conn(0x7f4620072620 msgr2=0x7f4620164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:19.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f4626ad3700 1 --2- 172.21.15.80:0/2292382720 >> v2:172.21.15.174:3300/0 conn(0x7f4620072620 0x7f4620164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:19.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f4626ad3700 1 -- 172.21.15.80:0/2292382720 >> v1:172.21.15.80:6789/0 conn(0x7f46200734e0 legacy=0x7f4620071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:19.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f4625ad1700 1 -- 172.21.15.80:0/2292382720 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956061575 0 0) 0x7f4610001070 con 0x7f46200734e0 2019-11-28T11:52:19.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f4626ad3700 1 -- 172.21.15.80:0/2292382720 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46200706c0 con 0x7f462006c0a0 2019-11-28T11:52:19.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f46272d4700 1 --2- 172.21.15.80:0/2292382720 >> v2:172.21.15.174:3300/0 conn(0x7f4620072620 0x7f4620164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:52:19.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f4626ad3700 1 --2- 172.21.15.80:0/2292382720 >> v2:172.21.15.80:3300/0 conn(0x7f462006c0a0 0x7f4620072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f461800f740 tx=0x7f461800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:19.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f4626ad3700 1 --2- 172.21.15.80:0/2292382720 >> v2:172.21.15.80:3300/0 conn(0x7f462006c0a0 0x7f4620072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f461800f740 tx=0x7f461800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:19.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f4626ad3700 1 --2- 172.21.15.80:0/2292382720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f462006c0a0 0x7f4620072fa0 secure :-1 s=READY pgs=2161 cs=0 l=1 rx=0x7f461800f740 tx=0x7f461800fae0).ready entity=mon.0 client_cookie=7fec4aae6486ad67 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:19.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f4626ad3700 1 --2- 172.21.15.80:0/2292382720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f462006c0a0 0x7f4620072fa0 secure :-1 s=THROTTLE_DONE pgs=2161 cs=0 l=1 rx=0x7f461800f740 tx=0x7f461800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:19.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f4625ad1700 1 -- 172.21.15.80:0/2292382720 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4618000960 con 0x7f462006c0a0 2019-11-28T11:52:19.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f4626ad3700 1 --2- 172.21.15.80:0/2292382720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f462006c0a0 0x7f4620072fa0 secure :-1 s=THROTTLE_DONE pgs=2161 cs=0 l=1 rx=0x7f461800f740 tx=0x7f461800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:19.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f4626ad3700 1 --2- 172.21.15.80:0/2292382720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f462006c0a0 0x7f4620072fa0 secure :-1 s=THROTTLE_DONE pgs=2161 cs=0 l=1 rx=0x7f461800f740 tx=0x7f461800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:19.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f4625ad1700 1 -- 172.21.15.80:0/2292382720 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4618000c90 con 0x7f462006c0a0 2019-11-28T11:52:19.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f4625ad1700 1 -- 172.21.15.80:0/2292382720 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46180013a0 con 0x7f462006c0a0 2019-11-28T11:52:19.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f4628536700 1 -- 172.21.15.80:0/2292382720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f462006c0a0 msgr2=0x7f4620072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:19.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.890+0000 7f4628536700 1 --2- 172.21.15.80:0/2292382720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f462006c0a0 0x7f4620072fa0 secure :-1 s=READY pgs=2161 cs=0 l=1 rx=0x7f461800f740 tx=0x7f461800fae0).stop 2019-11-28T11:52:19.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.891+0000 7f4628536700 1 -- 172.21.15.80:0/2292382720 shutdown_connections 2019-11-28T11:52:19.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.891+0000 7f4628536700 1 --2- 172.21.15.80:0/2292382720 >> v2:172.21.15.174:3300/0 conn(0x7f4620072620 0x7f4620164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:19.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.891+0000 7f4628536700 1 --2- 172.21.15.80:0/2292382720 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f462006c0a0 0x7f4620072fa0 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:19.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.891+0000 7f4628536700 1 -- 172.21.15.80:0/2292382720 shutdown_connections 2019-11-28T11:52:19.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.891+0000 7f4628536700 1 -- 172.21.15.80:0/2292382720 wait complete. 2019-11-28T11:52:19.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.891+0000 7f4628536700 1 -- 172.21.15.80:0/2292382720 >> 172.21.15.80:0/2292382720 conn(0x7f4620061cf0 msgr2=0x7f4620064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:19.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.893+0000 7f4628536700 1 Processor -- start 2019-11-28T11:52:19.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.893+0000 7f4628536700 1 -- start start 2019-11-28T11:52:19.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.894+0000 7f4628536700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46201293f0 0x7f4620129880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:19.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.894+0000 7f4628536700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462013f190 con 0x7f462013e8e0 2019-11-28T11:52:19.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.894+0000 7f4628536700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46201425f0 con 0x7f462007a340 2019-11-28T11:52:19.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.894+0000 7f4628536700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4620142d50 con 0x7f46201293f0 2019-11-28T11:52:19.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.894+0000 7f4626ad3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f462013e8e0 0x7f462007b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42026/0 (socket says 172.21.15.80:42026) 2019-11-28T11:52:19.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.894+0000 7f4626ad3700 1 -- 172.21.15.80:0/3163481084 learned_addr learned my addr 172.21.15.80:0/3163481084 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:19.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.894+0000 7f46262d2700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46201293f0 0x7f4620129880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:19.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.894+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529470270 0 0) 0x7f4618007e10 con 0x7f462013e8e0 2019-11-28T11:52:19.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.894+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4604002e80 con 0x7f462013e8e0 2019-11-28T11:52:19.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2844974973 0 0) 0x7f46180079e0 con 0x7f462013e8e0 2019-11-28T11:52:19.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f46040032e0 con 0x7f462013e8e0 2019-11-28T11:52:19.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f4618000940 con 0x7f462013e8e0 2019-11-28T11:52:19.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46201293f0 msgr2=0x7f4620129880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:19.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f461f7fe700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46201293f0 0x7f4620129880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:19.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 >> v1:172.21.15.174:6789/0 conn(0x7f462007a340 legacy=0x7f462007a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:19.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 >> v1:172.21.15.80:6789/0 conn(0x7f462013e8e0 legacy=0x7f462007b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:19.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f461f7fe700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4604003330 0x7f4604003760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:19.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f461f7fe700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4604003ca0 0x7f4604004120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:19.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f461f7fe700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4604004930 0x7f4604004dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:19.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460400bbf0 con 0x7f4604003ca0 2019-11-28T11:52:19.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460400bde0 con 0x7f4604003330 2019-11-28T11:52:19.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460400c010 con 0x7f4604004930 2019-11-28T11:52:19.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f46262d2700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4604003ca0 0x7f4604004120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:19.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f46272d4700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4604004930 0x7f4604004dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:19.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f4626ad3700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4604003330 0x7f4604003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:19.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f46262d2700 1 -- 172.21.15.80:0/3163481084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4604004930 msgr2=0x7f4604004dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:19.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f46262d2700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4604004930 0x7f4604004dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:19.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f46262d2700 1 -- 172.21.15.80:0/3163481084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4604003330 msgr2=0x7f4604003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:19.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f46262d2700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4604003330 0x7f4604003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:19.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f46262d2700 1 -- 172.21.15.80:0/3163481084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460400c2c0 con 0x7f4604003ca0 2019-11-28T11:52:19.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f4628536700 1 -- 172.21.15.80:0/3163481084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4620078f80 con 0x7f4604003ca0 2019-11-28T11:52:19.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f46262d2700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4604003ca0 0x7f4604004120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46100103a0 tx=0x7f4610010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:19.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f4628536700 1 -- 172.21.15.80:0/3163481084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4620078c00 con 0x7f4604003ca0 2019-11-28T11:52:19.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f46262d2700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4604003ca0 0x7f4604004120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46100103a0 tx=0x7f4610010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:19.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f46262d2700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4604003ca0 0x7f4604004120 secure :-1 s=READY pgs=2163 cs=0 l=1 rx=0x7f46100103a0 tx=0x7f4610010250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:19.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f46262d2700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4604003ca0 0x7f4604004120 secure :-1 s=THROTTLE_DONE pgs=2163 cs=0 l=1 rx=0x7f46100103a0 tx=0x7f4610010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:19.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4610000d50 con 0x7f4604003ca0 2019-11-28T11:52:19.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.895+0000 7f46262d2700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4604003ca0 0x7f4604004120 secure :-1 s=THROTTLE_DONE pgs=2163 cs=0 l=1 rx=0x7f46100103a0 tx=0x7f4610010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:19.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.896+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46100012b0 con 0x7f4604003ca0 2019-11-28T11:52:19.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.896+0000 7f46262d2700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4604003ca0 0x7f4604004120 secure :-1 s=THROTTLE_DONE pgs=2163 cs=0 l=1 rx=0x7f46100103a0 tx=0x7f4610010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:19.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.896+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4610000940 con 0x7f4604003ca0 2019-11-28T11:52:19.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.896+0000 7f46262d2700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4604003ca0 0x7f4604004120 secure :-1 s=THROTTLE_DONE pgs=2163 cs=0 l=1 rx=0x7f46100103a0 tx=0x7f4610010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:19.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.896+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4610000c90 con 0x7f4604003ca0 2019-11-28T11:52:19.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.896+0000 7f46262d2700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4604003ca0 0x7f4604004120 secure :-1 s=THROTTLE_DONE pgs=2163 cs=0 l=1 rx=0x7f46100103a0 tx=0x7f4610010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:19.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.896+0000 7f461f7fe700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4604020bf0 0x7f4604023020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:19.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.896+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f4610031b60 con 0x7f4604003ca0 2019-11-28T11:52:19.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.896+0000 7f4626ad3700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4604020bf0 0x7f4604023020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:19.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.897+0000 7f4626ad3700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4604020bf0 0x7f4604023020 crc :-1 s=READY pgs=883 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:19.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.903+0000 7f4628536700 1 -- 172.21.15.80:0/3163481084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4620078f80 con 0x7f4604003ca0 2019-11-28T11:52:19.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.907+0000 7f46262d2700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4604003ca0 0x7f4604004120 secure :-1 s=THROTTLE_DONE pgs=2163 cs=0 l=1 rx=0x7f46100103a0 tx=0x7f4610010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:19.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:19.907+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f461001f720 con 0x7f4604003ca0 2019-11-28T11:52:20.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:20.083+0000 7f4628536700 1 -- 172.21.15.80:0/3163481084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_timeout"]} v 0) v1 -- 0x7f4620078c00 con 0x7f4604003ca0 2019-11-28T11:52:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.059+0000 7f46262d2700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4604003ca0 0x7f4604004120 secure :-1 s=THROTTLE_DONE pgs=2163 cs=0 l=1 rx=0x7f46100103a0 tx=0x7f4610010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.059+0000 7f461f7fe700 1 -- 172.21.15.80:0/3163481084 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_timeout"]}]=0 v608) v1 ==== 157+0+0 (secure 0 0 0) 0x7f4610000c90 con 0x7f4604003ca0 2019-11-28T11:52:21.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.101+0000 7f4628536700 1 -- 172.21.15.80:0/3163481084 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4604020bf0 msgr2=0x7f4604023020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:21.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.101+0000 7f4628536700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4604020bf0 0x7f4604023020 crc :-1 s=READY pgs=883 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:21.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.101+0000 7f4628536700 1 -- 172.21.15.80:0/3163481084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4604003ca0 msgr2=0x7f4604004120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:21.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.101+0000 7f4628536700 1 --2- 172.21.15.80:0/3163481084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4604003ca0 0x7f4604004120 secure :-1 s=READY pgs=2163 cs=0 l=1 rx=0x7f46100103a0 tx=0x7f4610010250).stop 2019-11-28T11:52:21.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.101+0000 7f46272d4700 1 -- 172.21.15.80:0/3163481084 reap_dead start 2019-11-28T11:52:21.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.101+0000 7f46272d4700 1 -- 172.21.15.80:0/3163481084 reap_dead start 2019-11-28T11:52:21.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.101+0000 7f4628536700 1 -- 172.21.15.80:0/3163481084 shutdown_connections 2019-11-28T11:52:21.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.101+0000 7f4628536700 1 -- 172.21.15.80:0/3163481084 shutdown_connections 2019-11-28T11:52:21.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.101+0000 7f4628536700 1 -- 172.21.15.80:0/3163481084 wait complete. 2019-11-28T11:52:21.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.101+0000 7f4628536700 1 -- 172.21.15.80:0/3163481084 >> 172.21.15.80:0/3163481084 conn(0x7f462013b860 msgr2=0x7f46201050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:21.163 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:52:21.163 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:52:21.230 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:52:21.292 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:52:21.369 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:52:21.425 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:52:21.485 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:52:21.547 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:52:21.548 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:52:21.548 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:52:21.548 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:52:21.548 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:52:21.549 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:52:21.549 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:52:21.554 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:52:21.554 DEBUG:teuthology.parallel:result is None 2019-11-28T11:52:21.555 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:52:21.555 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:52:21.556 DEBUG:teuthology.parallel:result is None 2019-11-28T11:52:21.556 DEBUG:teuthology.parallel:result is None 2019-11-28T11:52:21.556 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:52:21.557 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:52:21.557 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:52:21.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.704+0000 7f0d1845d700 1 Processor -- start 2019-11-28T11:52:21.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.704+0000 7f0d1845d700 1 -- start start 2019-11-28T11:52:21.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.705+0000 7f0d1845d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d1006c490 0x7f0d1006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:21.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.705+0000 7f0d1845d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1006db00 con 0x7f0d1006c0a0 2019-11-28T11:52:21.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.705+0000 7f0d1845d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1006e000 con 0x7f0d1006ce60 2019-11-28T11:52:21.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.705+0000 7f0d1845d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1006fd60 con 0x7f0d1006c490 2019-11-28T11:52:21.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.705+0000 7f0d169fa700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0d1006c0a0 0x7f0d10072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42040/0 (socket says 172.21.15.80:42040) 2019-11-28T11:52:21.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.705+0000 7f0d169fa700 1 -- 172.21.15.80:0/3342709474 learned_addr learned my addr 172.21.15.80:0/3342709474 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:21.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.705+0000 7f0d161f9700 1 --2- 172.21.15.80:0/3342709474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d1006c490 0x7f0d1006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:21.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.705+0000 7f0d159f8700 1 -- 172.21.15.80:0/3342709474 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743046056 0 0) 0x7f0d0c0014d0 con 0x7f0d1006c0a0 2019-11-28T11:52:21.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f0d159f8700 1 -- 172.21.15.80:0/3342709474 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cfc002e80 con 0x7f0d1006c0a0 2019-11-28T11:52:21.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f0d159f8700 1 -- 172.21.15.80:0/3342709474 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261450668 0 0) 0x7f0d080009b0 con 0x7f0d1006ce60 2019-11-28T11:52:21.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f0d159f8700 1 -- 172.21.15.80:0/3342709474 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cfc0030b0 con 0x7f0d1006ce60 2019-11-28T11:52:21.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f0d161f9700 1 -- 172.21.15.80:0/3342709474 >> v1:172.21.15.174:6789/0 conn(0x7f0d1006ce60 legacy=0x7f0d10164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:21.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f0d161f9700 1 -- 172.21.15.80:0/3342709474 >> v1:172.21.15.80:6789/0 conn(0x7f0d1006c0a0 legacy=0x7f0d10072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:21.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f0d161f9700 1 -- 172.21.15.80:0/3342709474 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d100706c0 con 0x7f0d1006c490 2019-11-28T11:52:21.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f0d161f9700 1 --2- 172.21.15.80:0/3342709474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d1006c490 0x7f0d1006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0d0000af50 tx=0x7f0d0000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f0d161f9700 1 --2- 172.21.15.80:0/3342709474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d1006c490 0x7f0d1006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0d0000af50 tx=0x7f0d0000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f0d161f9700 1 --2- 172.21.15.80:0/3342709474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d1006c490 0x7f0d1006c920 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7f0d0000af50 tx=0x7f0d0000b760).ready entity=mon.2 client_cookie=54bdd4c5a2c230d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:21.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f0d161f9700 1 --2- 172.21.15.80:0/3342709474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d1006c490 0x7f0d1006c920 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7f0d0000af50 tx=0x7f0d0000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f0d161f9700 1 --2- 172.21.15.80:0/3342709474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d1006c490 0x7f0d1006c920 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7f0d0000af50 tx=0x7f0d0000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f0d161f9700 1 --2- 172.21.15.80:0/3342709474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d1006c490 0x7f0d1006c920 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7f0d0000af50 tx=0x7f0d0000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f0d159f8700 1 -- 172.21.15.80:0/3342709474 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d00000960 con 0x7f0d1006c490 2019-11-28T11:52:21.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f0d159f8700 1 -- 172.21.15.80:0/3342709474 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d000098e0 con 0x7f0d1006c490 2019-11-28T11:52:21.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f0d159f8700 1 -- 172.21.15.80:0/3342709474 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d00009f30 con 0x7f0d1006c490 2019-11-28T11:52:21.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f0d1845d700 1 -- 172.21.15.80:0/3342709474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d1006c490 msgr2=0x7f0d1006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:21.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f0d1845d700 1 --2- 172.21.15.80:0/3342709474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d1006c490 0x7f0d1006c920 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7f0d0000af50 tx=0x7f0d0000b760).stop 2019-11-28T11:52:21.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f0d1845d700 1 -- 172.21.15.80:0/3342709474 shutdown_connections 2019-11-28T11:52:21.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f0d1845d700 1 --2- 172.21.15.80:0/3342709474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d1006c490 0x7f0d1006c920 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:21.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f0d1845d700 1 -- 172.21.15.80:0/3342709474 shutdown_connections 2019-11-28T11:52:21.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.708+0000 7f0d1845d700 1 -- 172.21.15.80:0/3342709474 wait complete. 2019-11-28T11:52:21.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.708+0000 7f0d1845d700 1 -- 172.21.15.80:0/3342709474 >> 172.21.15.80:0/3342709474 conn(0x7f0d10061cf0 msgr2=0x7f0d10064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:21.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.710+0000 7f0d1845d700 1 Processor -- start 2019-11-28T11:52:21.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.710+0000 7f0d1845d700 1 -- start start 2019-11-28T11:52:21.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.711+0000 7f0d1845d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0d1012cea0 0x7f0d10111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:21.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.711+0000 7f0d1845d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0d10165a00 0x7f0d10167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:21.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.711+0000 7f0d1845d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d10124260 con 0x7f0d101230e0 2019-11-28T11:52:21.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.711+0000 7f0d1845d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d10121040 con 0x7f0d10165a00 2019-11-28T11:52:21.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.711+0000 7f0d1845d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d10121310 con 0x7f0d1012cea0 2019-11-28T11:52:21.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.711+0000 7f0d169fa700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0d1012cea0 0x7f0d10111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:21.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.711+0000 7f0d169fa700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0d1012cea0 0x7f0d10111db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:57628/0 (socket says 172.21.15.80:57628) 2019-11-28T11:52:21.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.711+0000 7f0d169fa700 1 -- 172.21.15.80:0/3853662634 learned_addr learned my addr 172.21.15.80:0/3853662634 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:21.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f0d169fa700 1 -- 172.21.15.80:0/3853662634 >> v2:172.21.15.80:3300/0 conn(0x7f0d10165a00 msgr2=0x7f0d10167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:21.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f0d169fa700 1 --2- 172.21.15.80:0/3853662634 >> v2:172.21.15.80:3300/0 conn(0x7f0d10165a00 0x7f0d10167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:21.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f0d169fa700 1 -- 172.21.15.80:0/3853662634 >> v1:172.21.15.80:6789/0 conn(0x7f0d101230e0 legacy=0x7f0d10123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:21.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f0d169fa700 1 -- 172.21.15.80:0/3853662634 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d101219a0 con 0x7f0d1012cea0 2019-11-28T11:52:21.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f0d169fa700 1 --2- 172.21.15.80:0/3853662634 >> v2:172.21.15.174:3300/0 conn(0x7f0d1012cea0 0x7f0d10111db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0d0c010760 tx=0x7f0d0c0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f0d169fa700 1 --2- 172.21.15.80:0/3853662634 >> v2:172.21.15.174:3300/0 conn(0x7f0d1012cea0 0x7f0d10111db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0d0c010760 tx=0x7f0d0c0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f0d169fa700 1 --2- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d1012cea0 0x7f0d10111db0 secure :-1 s=READY pgs=1286 cs=0 l=1 rx=0x7f0d0c010760 tx=0x7f0d0c0105e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:21.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f0d169fa700 1 --2- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d1012cea0 0x7f0d10111db0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7f0d0c010760 tx=0x7f0d0c0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f0d169fa700 1 --2- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d1012cea0 0x7f0d10111db0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7f0d0c010760 tx=0x7f0d0c0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f0d077fe700 1 -- 172.21.15.80:0/3853662634 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d0c001010 con 0x7f0d1012cea0 2019-11-28T11:52:21.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f0d169fa700 1 --2- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d1012cea0 0x7f0d10111db0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7f0d0c010760 tx=0x7f0d0c0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f0d077fe700 1 -- 172.21.15.80:0/3853662634 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c001440 con 0x7f0d1012cea0 2019-11-28T11:52:21.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f0d077fe700 1 -- 172.21.15.80:0/3853662634 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d0c001ad0 con 0x7f0d1012cea0 2019-11-28T11:52:21.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f0d1845d700 1 -- 172.21.15.80:0/3853662634 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d10121d20 con 0x7f0d1012cea0 2019-11-28T11:52:21.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f0d1845d700 1 -- 172.21.15.80:0/3853662634 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d101122f0 con 0x7f0d1012cea0 2019-11-28T11:52:21.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f0d169fa700 1 --2- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d1012cea0 0x7f0d10111db0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7f0d0c010760 tx=0x7f0d0c0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f0d077fe700 1 -- 172.21.15.80:0/3853662634 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0d0c001010 con 0x7f0d1012cea0 2019-11-28T11:52:21.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f0d169fa700 1 --2- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d1012cea0 0x7f0d10111db0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7f0d0c010760 tx=0x7f0d0c0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f0d077fe700 1 --2- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0cf8018730 0x7f0cf801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:21.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f0d077fe700 1 -- 172.21.15.80:0/3853662634 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f0d0c031f00 con 0x7f0d1012cea0 2019-11-28T11:52:21.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f0d161f9700 1 --2- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0cf8018730 0x7f0cf801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:21.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f0d161f9700 1 --2- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0cf8018730 0x7f0cf801abc0 crc :-1 s=READY pgs=884 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:21.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.704+0000 7f5554342700 1 Processor -- start 2019-11-28T11:52:21.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.704+0000 7f5554342700 1 -- start start 2019-11-28T11:52:21.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.705+0000 7f5554342700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f554c06c0a0 0x7f554c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:21.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.705+0000 7f5554342700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c06db00 con 0x7f554c072620 2019-11-28T11:52:21.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.705+0000 7f5554342700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c05daa0 con 0x7f554c0734e0 2019-11-28T11:52:21.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.705+0000 7f5554342700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c06f330 con 0x7f554c06c0a0 2019-11-28T11:52:21.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.705+0000 7f55530e0700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f554c072620 0x7f554c164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42048/0 (socket says 172.21.15.80:42048) 2019-11-28T11:52:21.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.705+0000 7f55530e0700 1 -- 172.21.15.80:0/1390443079 learned_addr learned my addr 172.21.15.80:0/1390443079 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:21.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.705+0000 7f55528df700 1 --2- 172.21.15.80:0/1390443079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f554c06c0a0 0x7f554c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:21.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f55518dd700 1 -- 172.21.15.80:0/1390443079 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285737650 0 0) 0x7f553c001080 con 0x7f554c0734e0 2019-11-28T11:52:21.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f55518dd700 1 -- 172.21.15.80:0/1390443079 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5538002e80 con 0x7f554c0734e0 2019-11-28T11:52:21.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f55518dd700 1 -- 172.21.15.80:0/1390443079 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882583314 0 0) 0x7f55440014d0 con 0x7f554c072620 2019-11-28T11:52:21.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f55518dd700 1 -- 172.21.15.80:0/1390443079 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5538004170 con 0x7f554c072620 2019-11-28T11:52:21.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f55528df700 1 -- 172.21.15.80:0/1390443079 >> v1:172.21.15.174:6789/0 conn(0x7f554c0734e0 legacy=0x7f554c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:21.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f55528df700 1 -- 172.21.15.80:0/1390443079 >> v1:172.21.15.80:6789/0 conn(0x7f554c072620 legacy=0x7f554c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:21.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f55528df700 1 -- 172.21.15.80:0/1390443079 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0706c0 con 0x7f554c06c0a0 2019-11-28T11:52:21.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f55528df700 1 --2- 172.21.15.80:0/1390443079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f554c06c0a0 0x7f554c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f554800af50 tx=0x7f554800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f55528df700 1 --2- 172.21.15.80:0/1390443079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f554c06c0a0 0x7f554c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f554800af50 tx=0x7f554800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f55528df700 1 --2- 172.21.15.80:0/1390443079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f554c06c0a0 0x7f554c072fa0 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7f554800af50 tx=0x7f554800b760).ready entity=mon.2 client_cookie=1c7263edc2340ba1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:21.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f55528df700 1 --2- 172.21.15.80:0/1390443079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f554c06c0a0 0x7f554c072fa0 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f554800af50 tx=0x7f554800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f55518dd700 1 -- 172.21.15.80:0/1390443079 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5548007210 con 0x7f554c06c0a0 2019-11-28T11:52:21.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f55528df700 1 --2- 172.21.15.80:0/1390443079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f554c06c0a0 0x7f554c072fa0 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f554800af50 tx=0x7f554800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f55518dd700 1 -- 172.21.15.80:0/1390443079 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55480099b0 con 0x7f554c06c0a0 2019-11-28T11:52:21.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f55528df700 1 --2- 172.21.15.80:0/1390443079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f554c06c0a0 0x7f554c072fa0 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7f554800af50 tx=0x7f554800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f55518dd700 1 -- 172.21.15.80:0/1390443079 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5548007210 con 0x7f554c06c0a0 2019-11-28T11:52:21.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f5554342700 1 -- 172.21.15.80:0/1390443079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f554c06c0a0 msgr2=0x7f554c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:21.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f5554342700 1 --2- 172.21.15.80:0/1390443079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f554c06c0a0 0x7f554c072fa0 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7f554800af50 tx=0x7f554800b760).stop 2019-11-28T11:52:21.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f5554342700 1 -- 172.21.15.80:0/1390443079 shutdown_connections 2019-11-28T11:52:21.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f5554342700 1 --2- 172.21.15.80:0/1390443079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f554c06c0a0 0x7f554c072fa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:21.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f5554342700 1 -- 172.21.15.80:0/1390443079 shutdown_connections 2019-11-28T11:52:21.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f5554342700 1 -- 172.21.15.80:0/1390443079 wait complete. 2019-11-28T11:52:21.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f5554342700 1 -- 172.21.15.80:0/1390443079 >> 172.21.15.80:0/1390443079 conn(0x7f554c061cf0 msgr2=0x7f554c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:21.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.711+0000 7f5554342700 1 Processor -- start 2019-11-28T11:52:21.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.711+0000 7f5554342700 1 -- start start 2019-11-28T11:52:21.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f5554342700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f554c1342c0 0x7f554c1346b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:21.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f5554342700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f554c136650 0x7f554c15d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:21.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f5554342700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c12ed00 con 0x7f554c1361c0 2019-11-28T11:52:21.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f5554342700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c141670 con 0x7f554c1342c0 2019-11-28T11:52:21.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f5554342700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c141940 con 0x7f554c136650 2019-11-28T11:52:21.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f55520de700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f554c1361c0 0x7f554c15c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:57614/0 (socket says 172.21.15.80:57614) 2019-11-28T11:52:21.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f55520de700 1 -- 172.21.15.80:0/3033131219 learned_addr learned my addr 172.21.15.80:0/3033131219 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:21.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f55530e0700 1 --2- 172.21.15.80:0/3033131219 >> v2:172.21.15.174:3300/0 conn(0x7f554c136650 0x7f554c15d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:21.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f55528df700 1 --2- 172.21.15.80:0/3033131219 >> v2:172.21.15.80:3300/0 conn(0x7f554c1342c0 0x7f554c1346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:21.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f55528df700 1 -- 172.21.15.80:0/3033131219 >> v2:172.21.15.174:3300/0 conn(0x7f554c136650 msgr2=0x7f554c15d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:21.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f55528df700 1 --2- 172.21.15.80:0/3033131219 >> v2:172.21.15.174:3300/0 conn(0x7f554c136650 0x7f554c15d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:21.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f55528df700 1 -- 172.21.15.80:0/3033131219 >> v1:172.21.15.174:6789/0 conn(0x7f554c1361c0 legacy=0x7f554c15c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:21.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f55528df700 1 -- 172.21.15.80:0/3033131219 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c141fd0 con 0x7f554c1342c0 2019-11-28T11:52:21.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f55528df700 1 --2- 172.21.15.80:0/3033131219 >> v2:172.21.15.80:3300/0 conn(0x7f554c1342c0 0x7f554c1346b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f55480103a0 tx=0x7f55480101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f55528df700 1 --2- 172.21.15.80:0/3033131219 >> v2:172.21.15.80:3300/0 conn(0x7f554c1342c0 0x7f554c1346b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f55480103a0 tx=0x7f55480101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f55528df700 1 --2- 172.21.15.80:0/3033131219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c1342c0 0x7f554c1346b0 secure :-1 s=READY pgs=2168 cs=0 l=1 rx=0x7f55480103a0 tx=0x7f55480101d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:21.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f55528df700 1 --2- 172.21.15.80:0/3033131219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c1342c0 0x7f554c1346b0 secure :-1 s=THROTTLE_DONE pgs=2168 cs=0 l=1 rx=0x7f55480103a0 tx=0x7f55480101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f55528df700 1 --2- 172.21.15.80:0/3033131219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c1342c0 0x7f554c1346b0 secure :-1 s=THROTTLE_DONE pgs=2168 cs=0 l=1 rx=0x7f55480103a0 tx=0x7f55480101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f55437fe700 1 -- 172.21.15.80:0/3033131219 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f554800b360 con 0x7f554c1342c0 2019-11-28T11:52:21.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f55528df700 1 --2- 172.21.15.80:0/3033131219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c1342c0 0x7f554c1346b0 secure :-1 s=THROTTLE_DONE pgs=2168 cs=0 l=1 rx=0x7f55480103a0 tx=0x7f55480101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f55437fe700 1 -- 172.21.15.80:0/3033131219 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5548000940 con 0x7f554c1342c0 2019-11-28T11:52:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f55437fe700 1 -- 172.21.15.80:0/3033131219 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5548009d60 con 0x7f554c1342c0 2019-11-28T11:52:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f5554342700 1 -- 172.21.15.80:0/3033131219 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c142350 con 0x7f554c1342c0 2019-11-28T11:52:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f5554342700 1 -- 172.21.15.80:0/3033131219 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c141fd0 con 0x7f554c1342c0 2019-11-28T11:52:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f55528df700 1 --2- 172.21.15.80:0/3033131219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c1342c0 0x7f554c1346b0 secure :-1 s=THROTTLE_DONE pgs=2168 cs=0 l=1 rx=0x7f55480103a0 tx=0x7f55480101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f55437fe700 1 -- 172.21.15.80:0/3033131219 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5548009790 con 0x7f554c1342c0 2019-11-28T11:52:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f55528df700 1 --2- 172.21.15.80:0/3033131219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c1342c0 0x7f554c1346b0 secure :-1 s=THROTTLE_DONE pgs=2168 cs=0 l=1 rx=0x7f55480103a0 tx=0x7f55480101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.715+0000 7f55437fe700 1 --2- 172.21.15.80:0/3033131219 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5534018730 0x7f553401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.715+0000 7f55437fe700 1 -- 172.21.15.80:0/3033131219 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f55480319f0 con 0x7f554c1342c0 2019-11-28T11:52:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.715+0000 7f55520de700 1 --2- 172.21.15.80:0/3033131219 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5534018730 0x7f553401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.715+0000 7f55520de700 1 --2- 172.21.15.80:0/3033131219 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5534018730 0x7f553401abc0 crc :-1 s=READY pgs=886 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.704+0000 7f319d52b700 1 Processor -- start 2019-11-28T11:52:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.704+0000 7f319d52b700 1 -- start start 2019-11-28T11:52:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f319d52b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f319806c0a0 0x7f3198072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f319d52b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3198072620 0x7f3198164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f319d52b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319806db00 con 0x7f31980734e0 2019-11-28T11:52:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f319d52b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319806fd60 con 0x7f319806c0a0 2019-11-28T11:52:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f319d52b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3198070030 con 0x7f3198072620 2019-11-28T11:52:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f31977fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f319806c0a0 0x7f3198072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f31977fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f319806c0a0 0x7f3198072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42736/0 (socket says 172.21.15.80:42736) 2019-11-28T11:52:21.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f31977fe700 1 -- 172.21.15.80:0/827355767 learned_addr learned my addr 172.21.15.80:0/827355767 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f3197fff700 1 --2- 172.21.15.80:0/827355767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3198072620 0x7f3198164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f31977fe700 1 -- 172.21.15.80:0/827355767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3198072620 msgr2=0x7f3198164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f31977fe700 1 --2- 172.21.15.80:0/827355767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3198072620 0x7f3198164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f31977fe700 1 -- 172.21.15.80:0/827355767 >> v1:172.21.15.80:6789/0 conn(0x7f31980734e0 legacy=0x7f3198071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f31977fe700 1 -- 172.21.15.80:0/827355767 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31980706c0 con 0x7f319806c0a0 2019-11-28T11:52:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f31977fe700 1 --2- 172.21.15.80:0/827355767 >> v2:172.21.15.80:3300/0 conn(0x7f319806c0a0 0x7f3198072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f318800f6c0 tx=0x7f318800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f31977fe700 1 --2- 172.21.15.80:0/827355767 >> v2:172.21.15.80:3300/0 conn(0x7f319806c0a0 0x7f3198072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f318800f6c0 tx=0x7f318800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f31977fe700 1 --2- 172.21.15.80:0/827355767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f319806c0a0 0x7f3198072fa0 secure :-1 s=READY pgs=2167 cs=0 l=1 rx=0x7f318800f6c0 tx=0x7f318800fa60).ready entity=mon.0 client_cookie=1ebfba007f9a66d6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:21.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f31977fe700 1 --2- 172.21.15.80:0/827355767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f319806c0a0 0x7f3198072fa0 secure :-1 s=THROTTLE_DONE pgs=2167 cs=0 l=1 rx=0x7f318800f6c0 tx=0x7f318800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f31977fe700 1 --2- 172.21.15.80:0/827355767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f319806c0a0 0x7f3198072fa0 secure :-1 s=THROTTLE_DONE pgs=2167 cs=0 l=1 rx=0x7f318800f6c0 tx=0x7f318800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f31977fe700 1 --2- 172.21.15.80:0/827355767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f319806c0a0 0x7f3198072fa0 secure :-1 s=THROTTLE_DONE pgs=2167 cs=0 l=1 rx=0x7f318800f6c0 tx=0x7f318800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f3196ffd700 1 -- 172.21.15.80:0/827355767 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3188000960 con 0x7f319806c0a0 2019-11-28T11:52:21.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.706+0000 7f3196ffd700 1 -- 172.21.15.80:0/827355767 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3188000c90 con 0x7f319806c0a0 2019-11-28T11:52:21.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f3196ffd700 1 -- 172.21.15.80:0/827355767 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31880013a0 con 0x7f319806c0a0 2019-11-28T11:52:21.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f319d52b700 1 -- 172.21.15.80:0/827355767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f319806c0a0 msgr2=0x7f3198072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:21.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f319d52b700 1 --2- 172.21.15.80:0/827355767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f319806c0a0 0x7f3198072fa0 secure :-1 s=READY pgs=2167 cs=0 l=1 rx=0x7f318800f6c0 tx=0x7f318800fa60).stop 2019-11-28T11:52:21.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f319d52b700 1 -- 172.21.15.80:0/827355767 shutdown_connections 2019-11-28T11:52:21.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f319d52b700 1 --2- 172.21.15.80:0/827355767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3198072620 0x7f3198164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:21.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f319d52b700 1 --2- 172.21.15.80:0/827355767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f319806c0a0 0x7f3198072fa0 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:21.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f319d52b700 1 -- 172.21.15.80:0/827355767 shutdown_connections 2019-11-28T11:52:21.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f319d52b700 1 -- 172.21.15.80:0/827355767 wait complete. 2019-11-28T11:52:21.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.707+0000 7f319d52b700 1 -- 172.21.15.80:0/827355767 >> 172.21.15.80:0/827355767 conn(0x7f3198061cf0 msgr2=0x7f3198064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:21.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.711+0000 7f319d52b700 1 Processor -- start 2019-11-28T11:52:21.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.711+0000 7f319d52b700 1 -- start start 2019-11-28T11:52:21.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f319d52b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3198112e10 0x7f3198123160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:21.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f319d52b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31981236a0 0x7f31981330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:21.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f319d52b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319813ba50 con 0x7f31981335f0 2019-11-28T11:52:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f319d52b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31981353e0 con 0x7f3198112e10 2019-11-28T11:52:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.712+0000 7f319d52b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31981356b0 con 0x7f31981236a0 2019-11-28T11:52:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f31977fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3198112e10 0x7f3198123160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f31977fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3198112e10 0x7f3198123160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:57634/0 (socket says 172.21.15.80:57634) 2019-11-28T11:52:21.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f318effd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31981236a0 0x7f31981330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:21.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f31977fe700 1 -- 172.21.15.80:0/821934761 learned_addr learned my addr 172.21.15.80:0/821934761 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:21.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f318effd700 1 -- 172.21.15.80:0/821934761 >> v2:172.21.15.174:3300/0 conn(0x7f3198112e10 msgr2=0x7f3198123160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:21.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f318effd700 1 --2- 172.21.15.80:0/821934761 >> v2:172.21.15.174:3300/0 conn(0x7f3198112e10 0x7f3198123160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:21.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f318effd700 1 -- 172.21.15.80:0/821934761 >> v1:172.21.15.80:6789/0 conn(0x7f31981335f0 legacy=0x7f3198121fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:21.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f318effd700 1 -- 172.21.15.80:0/821934761 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3198135d40 con 0x7f31981236a0 2019-11-28T11:52:21.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f318effd700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31981236a0 0x7f31981330b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f31800103b0 tx=0x7f3180010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f318effd700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31981236a0 0x7f31981330b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f31800103b0 tx=0x7f3180010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f318effd700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31981236a0 0x7f31981330b0 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f31800103b0 tx=0x7f3180010750).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:21.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f318effd700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31981236a0 0x7f31981330b0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f31800103b0 tx=0x7f3180010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f318effd700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31981236a0 0x7f31981330b0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f31800103b0 tx=0x7f3180010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f3194ff9700 1 -- 172.21.15.80:0/821934761 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f318000eff0 con 0x7f31981236a0 2019-11-28T11:52:21.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.713+0000 7f318effd700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31981236a0 0x7f31981330b0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f31800103b0 tx=0x7f3180010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f3194ff9700 1 -- 172.21.15.80:0/821934761 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318000ec10 con 0x7f31981236a0 2019-11-28T11:52:21.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f319d52b700 1 -- 172.21.15.80:0/821934761 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31981360c0 con 0x7f31981236a0 2019-11-28T11:52:21.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f3194ff9700 1 -- 172.21.15.80:0/821934761 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f318000f5d0 con 0x7f31981236a0 2019-11-28T11:52:21.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f319d52b700 1 -- 172.21.15.80:0/821934761 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3198135d40 con 0x7f31981236a0 2019-11-28T11:52:21.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f318effd700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31981236a0 0x7f31981330b0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f31800103b0 tx=0x7f3180010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f3194ff9700 1 -- 172.21.15.80:0/821934761 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f318000ee00 con 0x7f31981236a0 2019-11-28T11:52:21.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f318effd700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31981236a0 0x7f31981330b0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f31800103b0 tx=0x7f3180010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f3194ff9700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f317c018730 0x7f317c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:21.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.714+0000 7f3194ff9700 1 -- 172.21.15.80:0/821934761 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f3180031cb0 con 0x7f31981236a0 2019-11-28T11:52:21.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.715+0000 7f31977fe700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f317c018730 0x7f317c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:21.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.715+0000 7f31977fe700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f317c018730 0x7f317c01abe0 crc :-1 s=READY pgs=885 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:21.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.720+0000 7f319d52b700 1 -- 172.21.15.80:0/821934761 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31981360c0 con 0x7f31981236a0 2019-11-28T11:52:21.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.724+0000 7f318effd700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31981236a0 0x7f31981330b0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f31800103b0 tx=0x7f3180010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.724+0000 7f3194ff9700 1 -- 172.21.15.80:0/821934761 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f318000e8d0 con 0x7f31981236a0 2019-11-28T11:52:21.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.720+0000 7f0d1845d700 1 -- 172.21.15.80:0/3853662634 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d101219a0 con 0x7f0d1012cea0 2019-11-28T11:52:21.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.724+0000 7f0d169fa700 1 --2- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d1012cea0 0x7f0d10111db0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7f0d0c010760 tx=0x7f0d0c0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.724+0000 7f0d077fe700 1 -- 172.21.15.80:0/3853662634 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0d0c007950 con 0x7f0d1012cea0 2019-11-28T11:52:21.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.720+0000 7f5554342700 1 -- 172.21.15.80:0/3033131219 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c142350 con 0x7f554c1342c0 2019-11-28T11:52:21.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.724+0000 7f55528df700 1 --2- 172.21.15.80:0/3033131219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c1342c0 0x7f554c1346b0 secure :-1 s=THROTTLE_DONE pgs=2168 cs=0 l=1 rx=0x7f55480103a0 tx=0x7f55480101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:21.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.724+0000 7f55437fe700 1 -- 172.21.15.80:0/3033131219 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5548009580 con 0x7f554c1342c0 2019-11-28T11:52:21.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:21.906+0000 7f319d52b700 1 -- 172.21.15.80:0/821934761 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f3198135d40 con 0x7f31981236a0 2019-11-28T11:52:22.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.070+0000 7f5554342700 1 -- 172.21.15.80:0/3033131219 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f554c141fd0 con 0x7f554c1342c0 2019-11-28T11:52:22.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.070+0000 7f0d1845d700 1 -- 172.21.15.80:0/3853662634 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f0d10121d20 con 0x7f0d1012cea0 2019-11-28T11:52:22.810 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:52:22.757+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:52:22.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.759+0000 7f55528df700 1 --2- 172.21.15.80:0/3033131219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c1342c0 0x7f554c1346b0 secure :-1 s=THROTTLE_DONE pgs=2168 cs=0 l=1 rx=0x7f55480103a0 tx=0x7f55480101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:22.812 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.759+0000 7f55437fe700 1 -- 172.21.15.80:0/3033131219 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 9613 v132) v1 ==== 95+0+0 (secure 0 0 0) 0x7f5548009790 con 0x7f554c1342c0 2019-11-28T11:52:22.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.760+0000 7f0d169fa700 1 --2- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d1012cea0 0x7f0d10111db0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7f0d0c010760 tx=0x7f0d0c0105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:22.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.760+0000 7f0d077fe700 1 -- 172.21.15.80:0/3853662634 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7016 v132) v1 ==== 95+0+0 (secure 0 0 0) 0x7f0d0c001010 con 0x7f0d1012cea0 2019-11-28T11:52:22.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.762+0000 7f318effd700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31981236a0 0x7f31981330b0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f31800103b0 tx=0x7f3180010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:22.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.762+0000 7f3194ff9700 1 -- 172.21.15.80:0/821934761 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7019 v132) v1 ==== 95+0+0 (secure 0 0 0) 0x7f318000eae0 con 0x7f31981236a0 2019-11-28T11:52:22.824 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 7019 2019-11-28T11:52:22.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.773+0000 7f319d52b700 1 -- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f317c018730 msgr2=0x7f317c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:22.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.773+0000 7f319d52b700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f317c018730 0x7f317c01abe0 crc :-1 s=READY pgs=885 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:22.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.773+0000 7f319d52b700 1 -- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31981236a0 msgr2=0x7f31981330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:22.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.773+0000 7f319d52b700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31981236a0 0x7f31981330b0 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f31800103b0 tx=0x7f3180010750).stop 2019-11-28T11:52:22.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.773+0000 7f319d52b700 1 -- 172.21.15.80:0/821934761 shutdown_connections 2019-11-28T11:52:22.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.773+0000 7f319d52b700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f317c018730 0x7f317c01abe0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.773+0000 7f319d52b700 1 --2- 172.21.15.80:0/821934761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31981236a0 0x7f31981330b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.773+0000 7f319d52b700 1 --2- 172.21.15.80:0/821934761 >> v2:172.21.15.174:3300/0 conn(0x7f3198112e10 0x7f3198123160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.774+0000 7f319d52b700 1 -- 172.21.15.80:0/821934761 shutdown_connections 2019-11-28T11:52:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.774+0000 7f319d52b700 1 -- 172.21.15.80:0/821934761 wait complete. 2019-11-28T11:52:22.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.774+0000 7f319d52b700 1 -- 172.21.15.80:0/821934761 >> 172.21.15.80:0/821934761 conn(0x7f31981141b0 msgr2=0x7f3198110980 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:22.836 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:52:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 7016 2019-11-28T11:52:22.838 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 9613 2019-11-28T11:52:22.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f5554342700 1 -- 172.21.15.80:0/3033131219 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5534018730 msgr2=0x7f553401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:22.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f5554342700 1 --2- 172.21.15.80:0/3033131219 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5534018730 0x7f553401abc0 crc :-1 s=READY pgs=886 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:22.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f5554342700 1 -- 172.21.15.80:0/3033131219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c1342c0 msgr2=0x7f554c1346b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:22.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f5554342700 1 --2- 172.21.15.80:0/3033131219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c1342c0 0x7f554c1346b0 secure :-1 s=READY pgs=2168 cs=0 l=1 rx=0x7f55480103a0 tx=0x7f55480101d0).stop 2019-11-28T11:52:22.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f5554342700 1 -- 172.21.15.80:0/3033131219 shutdown_connections 2019-11-28T11:52:22.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f5554342700 1 --2- 172.21.15.80:0/3033131219 >> v2:172.21.15.174:3300/0 conn(0x7f554c136650 0x7f554c15d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:22.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f5554342700 1 --2- 172.21.15.80:0/3033131219 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5534018730 0x7f553401abc0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:22.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f5554342700 1 --2- 172.21.15.80:0/3033131219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f554c1342c0 0x7f554c1346b0 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:22.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f5554342700 1 -- 172.21.15.80:0/3033131219 shutdown_connections 2019-11-28T11:52:22.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f5554342700 1 -- 172.21.15.80:0/3033131219 wait complete. 2019-11-28T11:52:22.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f5554342700 1 -- 172.21.15.80:0/3033131219 >> 172.21.15.80:0/3033131219 conn(0x7f554c159ae0 msgr2=0x7f554c13d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:22.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f0d1845d700 1 -- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0cf8018730 msgr2=0x7f0cf801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:22.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f0d1845d700 1 --2- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0cf8018730 0x7f0cf801abc0 crc :-1 s=READY pgs=884 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:22.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f0d1845d700 1 -- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d1012cea0 msgr2=0x7f0d10111db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:22.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f0d1845d700 1 --2- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d1012cea0 0x7f0d10111db0 secure :-1 s=READY pgs=1286 cs=0 l=1 rx=0x7f0d0c010760 tx=0x7f0d0c0105e0).stop 2019-11-28T11:52:22.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f0d1845d700 1 -- 172.21.15.80:0/3853662634 shutdown_connections 2019-11-28T11:52:22.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f0d1845d700 1 --2- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0cf8018730 0x7f0cf801abc0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:22.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f0d1845d700 1 --2- 172.21.15.80:0/3853662634 >> v2:172.21.15.80:3300/0 conn(0x7f0d10165a00 0x7f0d10167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:22.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f0d1845d700 1 --2- 172.21.15.80:0/3853662634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d1012cea0 0x7f0d10111db0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:22.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f0d1845d700 1 -- 172.21.15.80:0/3853662634 shutdown_connections 2019-11-28T11:52:22.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f0d1845d700 1 -- 172.21.15.80:0/3853662634 wait complete. 2019-11-28T11:52:22.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.788+0000 7f0d1845d700 1 -- 172.21.15.80:0/3853662634 >> 172.21.15.80:0/3853662634 conn(0x7f0d101426c0 msgr2=0x7f0d10110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:22.853 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:52:22.853 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:52:22.853 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:52:23.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.984+0000 7ff9712b3700 1 Processor -- start 2019-11-28T11:52:23.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.984+0000 7ff9712b3700 1 -- start start 2019-11-28T11:52:23.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.985+0000 7ff9712b3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff96c06c0a0 0x7ff96c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:23.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.985+0000 7ff9712b3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c072620 0x7ff96c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:23.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.985+0000 7ff9712b3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c06db00 con 0x7ff96c0734e0 2019-11-28T11:52:23.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.985+0000 7ff9712b3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c06fd60 con 0x7ff96c06c0a0 2019-11-28T11:52:23.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.985+0000 7ff9712b3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c070030 con 0x7ff96c072620 2019-11-28T11:52:23.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.985+0000 7ff96b7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff96c06c0a0 0x7ff96c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:23.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.985+0000 7ff96b7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff96c06c0a0 0x7ff96c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42766/0 (socket says 172.21.15.80:42766) 2019-11-28T11:52:23.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.985+0000 7ff96b7fe700 1 -- 172.21.15.80:0/3182600115 learned_addr learned my addr 172.21.15.80:0/3182600115 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:23.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.985+0000 7ff96bfff700 1 --2- 172.21.15.80:0/3182600115 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c072620 0x7ff96c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:23.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.985+0000 7ff96b7fe700 1 -- 172.21.15.80:0/3182600115 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c072620 msgr2=0x7ff96c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:23.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.985+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3182600115 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c072620 0x7ff96c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:23.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.985+0000 7ff96b7fe700 1 -- 172.21.15.80:0/3182600115 >> v1:172.21.15.174:6789/0 conn(0x7ff96c0734e0 legacy=0x7ff96c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:23.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.985+0000 7ff96b7fe700 1 -- 172.21.15.80:0/3182600115 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c0706c0 con 0x7ff96c06c0a0 2019-11-28T11:52:23.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.985+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3182600115 >> v2:172.21.15.80:3300/0 conn(0x7ff96c06c0a0 0x7ff96c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff95c00f6c0 tx=0x7ff95c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.986+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3182600115 >> v2:172.21.15.80:3300/0 conn(0x7ff96c06c0a0 0x7ff96c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff95c00f6c0 tx=0x7ff95c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.986+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3182600115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c06c0a0 0x7ff96c072fa0 secure :-1 s=READY pgs=2169 cs=0 l=1 rx=0x7ff95c00f6c0 tx=0x7ff95c00fa60).ready entity=mon.0 client_cookie=886caa400a8a4dfb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:23.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.986+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3182600115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c06c0a0 0x7ff96c072fa0 secure :-1 s=THROTTLE_DONE pgs=2169 cs=0 l=1 rx=0x7ff95c00f6c0 tx=0x7ff95c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.986+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3182600115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c06c0a0 0x7ff96c072fa0 secure :-1 s=THROTTLE_DONE pgs=2169 cs=0 l=1 rx=0x7ff95c00f6c0 tx=0x7ff95c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.986+0000 7ff96a7fc700 1 -- 172.21.15.80:0/3182600115 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff95c000960 con 0x7ff96c06c0a0 2019-11-28T11:52:23.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.986+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3182600115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c06c0a0 0x7ff96c072fa0 secure :-1 s=THROTTLE_DONE pgs=2169 cs=0 l=1 rx=0x7ff95c00f6c0 tx=0x7ff95c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.986+0000 7ff96a7fc700 1 -- 172.21.15.80:0/3182600115 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c000c90 con 0x7ff96c06c0a0 2019-11-28T11:52:23.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.986+0000 7ff96a7fc700 1 -- 172.21.15.80:0/3182600115 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff95c0013a0 con 0x7ff96c06c0a0 2019-11-28T11:52:23.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.986+0000 7ff9712b3700 1 -- 172.21.15.80:0/3182600115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c06c0a0 msgr2=0x7ff96c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:23.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.986+0000 7ff9712b3700 1 --2- 172.21.15.80:0/3182600115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c06c0a0 0x7ff96c072fa0 secure :-1 s=READY pgs=2169 cs=0 l=1 rx=0x7ff95c00f6c0 tx=0x7ff95c00fa60).stop 2019-11-28T11:52:23.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.986+0000 7ff9712b3700 1 -- 172.21.15.80:0/3182600115 shutdown_connections 2019-11-28T11:52:23.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.986+0000 7ff9712b3700 1 --2- 172.21.15.80:0/3182600115 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c072620 0x7ff96c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:23.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.986+0000 7ff9712b3700 1 --2- 172.21.15.80:0/3182600115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff96c06c0a0 0x7ff96c072fa0 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:23.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.986+0000 7ff9712b3700 1 -- 172.21.15.80:0/3182600115 shutdown_connections 2019-11-28T11:52:23.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.986+0000 7ff9712b3700 1 -- 172.21.15.80:0/3182600115 wait complete. 2019-11-28T11:52:23.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.986+0000 7ff9712b3700 1 -- 172.21.15.80:0/3182600115 >> 172.21.15.80:0/3182600115 conn(0x7ff96c061cf0 msgr2=0x7ff96c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:23.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.989+0000 7ff9712b3700 1 Processor -- start 2019-11-28T11:52:23.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.989+0000 7ff9712b3700 1 -- start start 2019-11-28T11:52:23.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.990+0000 7ff9712b3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c13e5f0 0x7ff96c13e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:23.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.990+0000 7ff9712b3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff96c10a4e0 0x7ff96c10c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:23.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.990+0000 7ff9712b3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c1066e0 con 0x7ff96c10a070 2019-11-28T11:52:23.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.990+0000 7ff9712b3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c10d630 con 0x7ff96c10a4e0 2019-11-28T11:52:23.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.990+0000 7ff9712b3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c10e060 con 0x7ff96c13e5f0 2019-11-28T11:52:23.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.990+0000 7ff96b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c13e5f0 0x7ff96c13e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:23.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.990+0000 7ff96b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c13e5f0 0x7ff96c13e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:45032/0 (socket says 172.21.15.80:45032) 2019-11-28T11:52:23.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.990+0000 7ff96bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff96c10a4e0 0x7ff96c10c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:23.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.990+0000 7ff96b7fe700 1 -- 172.21.15.80:0/3868292699 learned_addr learned my addr 172.21.15.80:0/3868292699 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:23.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.990+0000 7ff96b7fe700 1 -- 172.21.15.80:0/3868292699 >> v2:172.21.15.174:3300/0 conn(0x7ff96c10a4e0 msgr2=0x7ff96c10c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:23.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.990+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3868292699 >> v2:172.21.15.174:3300/0 conn(0x7ff96c10a4e0 0x7ff96c10c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:23.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.990+0000 7ff96b7fe700 1 -- 172.21.15.80:0/3868292699 >> v1:172.21.15.174:6789/0 conn(0x7ff96c10a070 legacy=0x7ff96c10bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.990+0000 7ff96b7fe700 1 -- 172.21.15.80:0/3868292699 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c10e9c0 con 0x7ff96c13e5f0 2019-11-28T11:52:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.991+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c13e5f0 0x7ff96c13e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff95c010440 tx=0x7ff95c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.991+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c13e5f0 0x7ff96c13e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff95c010440 tx=0x7ff95c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.991+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c13e5f0 0x7ff96c13e9e0 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7ff95c010440 tx=0x7ff95c010270).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.991+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c13e5f0 0x7ff96c13e9e0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7ff95c010440 tx=0x7ff95c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.991+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c13e5f0 0x7ff96c13e9e0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7ff95c010440 tx=0x7ff95c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.991+0000 7ff963fff700 1 -- 172.21.15.80:0/3868292699 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff95c005560 con 0x7ff96c13e5f0 2019-11-28T11:52:23.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.991+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c13e5f0 0x7ff96c13e9e0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7ff95c010440 tx=0x7ff95c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.991+0000 7ff963fff700 1 -- 172.21.15.80:0/3868292699 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c005180 con 0x7ff96c13e5f0 2019-11-28T11:52:23.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.991+0000 7ff9712b3700 1 -- 172.21.15.80:0/3868292699 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c10ed40 con 0x7ff96c13e5f0 2019-11-28T11:52:23.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.991+0000 7ff963fff700 1 -- 172.21.15.80:0/3868292699 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff95c005b40 con 0x7ff96c13e5f0 2019-11-28T11:52:23.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.991+0000 7ff9712b3700 1 -- 172.21.15.80:0/3868292699 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c10e9c0 con 0x7ff96c13e5f0 2019-11-28T11:52:23.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.991+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c13e5f0 0x7ff96c13e9e0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7ff95c010440 tx=0x7ff95c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.992+0000 7ff963fff700 1 -- 172.21.15.80:0/3868292699 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff95c005370 con 0x7ff96c13e5f0 2019-11-28T11:52:23.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.992+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c13e5f0 0x7ff96c13e9e0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7ff95c010440 tx=0x7ff95c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.992+0000 7ff963fff700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff944018730 0x7ff94401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:23.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.992+0000 7ff963fff700 1 -- 172.21.15.80:0/3868292699 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6235+0+0 (secure 0 0 0) 0x7ff95c031a70 con 0x7ff96c13e5f0 2019-11-28T11:52:23.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.992+0000 7ff96affd700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff944018730 0x7ff94401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:23.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.992+0000 7ff96affd700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff944018730 0x7ff94401abc0 crc :-1 s=READY pgs=887 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:23.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:22.999+0000 7ff9712b3700 1 -- 172.21.15.80:0/3868292699 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c10ed40 con 0x7ff96c13e5f0 2019-11-28T11:52:23.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.003+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c13e5f0 0x7ff96c13e9e0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7ff95c010440 tx=0x7ff95c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.003+0000 7ff963fff700 1 -- 172.21.15.80:0/3868292699 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff95c007250 con 0x7ff96c13e5f0 2019-11-28T11:52:23.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.178+0000 7ff9712b3700 1 -- 172.21.15.80:0/3868292699 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff96c10e9c0 con 0x7ff96c13e5f0 2019-11-28T11:52:23.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.180+0000 7ff96b7fe700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c13e5f0 0x7ff96c13e9e0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7ff95c010440 tx=0x7ff95c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.180+0000 7ff963fff700 1 -- 172.21.15.80:0/3868292699 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v169) v1 ==== 81+0+32001 (secure 0 0 0) 0x7ff95c005370 con 0x7ff96c13e5f0 2019-11-28T11:52:23.235 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:23.235 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:52:23.235 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 169, 2019-11-28T11:52:23.235 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:52:23.235 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:52:23.236 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:52:22.077202+0000", 2019-11-28T11:52:23.236 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:52:23.236 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:52:23.236 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:52:23.236 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:52:23.236 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:52:23.236 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:52:23.253 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:52:23.253 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:52:23.253 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:52:23.253 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:52:23.254 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:52:23.254 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:52:23.254 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:52:23.254 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:52:23.254 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:52:23.254 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 27, 2019-11-28T11:52:23.254 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:52:23.255 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:52:23.255 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:52:23.255 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:52:23.255 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:52:23.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.255 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:52:23.255 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:52:23.256 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:52:23.256 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:52:23.256 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:52:23.256 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:52:23.256 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:52:23.256 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:52:23.257 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:52:23.257 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:52:23.257 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:52:23.257 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:52:23.257 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:52:23.257 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:52:23.257 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:52:23.257 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:52:23.258 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:52:23.258 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:52:23.258 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:52:23.258 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:52:23.258 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:52:23.258 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:52:23.258 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:52:23.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.259 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:52:23.259 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:52:23.259 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:52:23.259 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:52:23.259 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:52:23.259 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:52:23.260 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:52:23.260 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:52:23.260 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:52:23.260 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:52:23.268 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:52:23.268 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:52:23.268 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:52:23.268 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:52:23.268 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:52:23.268 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:52:23.269 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:52:23.269 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:52:23.269 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:52:23.269 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:52:23.269 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:52:23.269 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:52:23.269 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:52:23.270 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:52:23.270 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:52:23.270 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:52:23.270 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:52:23.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.270 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:52:23.270 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:52:23.271 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:52:23.271 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:52:23.271 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:52:23.271 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:52:23.271 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:52:23.271 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:52:23.271 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:52:23.271 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:52:23.272 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:52:23.272 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:52:23.272 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:52:23.272 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:52:23.272 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.273 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 26, 2019-11-28T11:52:23.273 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:52:23.273 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:49:31.434223+0000", 2019-11-28T11:52:23.273 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:52:23.273 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:52:23.273 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:52:23.273 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:52:23.274 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:52:23.274 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:52:23.274 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:52:23.274 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:52:23.274 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:52:23.274 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:52:23.274 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:52:23.275 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:52:23.275 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:52:23.275 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:52:23.275 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:52:23.275 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:52:23.275 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:52:23.275 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:52:23.276 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:52:23.276 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:52:23.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.276 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "161", 2019-11-28T11:52:23.276 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:52:23.276 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:52:23.276 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:52:23.277 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:52:23.277 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:52:23.277 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:52:23.277 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:52:23.277 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:52:23.277 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:52:23.277 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:52:23.277 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:52:23.278 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:52:23.278 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:52:23.278 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:52:23.278 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:52:23.278 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:52:23.278 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:52:23.278 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:52:23.286 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:52:23.286 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:52:23.287 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:52:23.287 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:52:23.287 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:52:23.287 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:52:23.287 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:52:23.287 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:52:23.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.288 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:52:23.288 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:52:23.288 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:52:23.288 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:52:23.288 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:52:23.288 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:52:23.288 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:52:23.289 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:52:23.289 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:52:23.289 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:52:23.289 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:52:23.289 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:52:23.289 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:52:23.289 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:52:23.290 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:52:23.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.294 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:52:23.294 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:52:23.294 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:52:23.294 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.294 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.295 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 27, 2019-11-28T11:52:23.295 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:52:23.295 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:49:32.127254+0000", 2019-11-28T11:52:23.295 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:52:23.295 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:52:23.296 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:52:23.296 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:52:23.296 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:52:23.296 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:52:23.296 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:52:23.296 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:52:23.296 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:52:23.297 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:52:23.297 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:52:23.297 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:52:23.297 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:52:23.297 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:52:23.297 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:52:23.297 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:52:23.297 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:52:23.298 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:52:23.298 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:52:23.298 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:52:23.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.298 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "162", 2019-11-28T11:52:23.298 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:52:23.299 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:52:23.299 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:52:23.299 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:52:23.299 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:52:23.299 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:52:23.299 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:52:23.300 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:52:23.300 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:52:23.300 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:52:23.300 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:52:23.300 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:52:23.300 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:52:23.300 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:52:23.300 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:52:23.301 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:52:23.301 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:52:23.301 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:52:23.301 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:52:23.301 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:52:23.301 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:52:23.301 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:52:23.302 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:52:23.302 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:52:23.302 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:52:23.302 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:52:23.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.302 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:52:23.302 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:52:23.303 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:52:23.303 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:52:23.303 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:52:23.303 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:52:23.303 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:52:23.303 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:52:23.303 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:52:23.304 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:52:23.304 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:52:23.304 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:52:23.305 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:52:23.305 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:52:23.305 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:52:23.305 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.305 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.305 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.306 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:52:23.306 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:52:23.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.306 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:52:23.306 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:52:23.306 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:52:23.306 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:52:23.307 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:52:23.307 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:52:23.307 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:52:23.307 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:52:23.307 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:52:23.307 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 160, 2019-11-28T11:52:23.307 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:52:23.307 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:52:23.308 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:52:23.308 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.308 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.308 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:52:23.308 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:52:23.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.309 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.309 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:52:23.309 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:52:23.309 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.309 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.310 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:52:23.310 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.310 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.310 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:52:23.310 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:52:23.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.311 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.311 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:52:23.311 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:52:23.311 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.311 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.312 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:52:23.312 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.312 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.312 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:52:23.312 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:52:23.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.313 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.313 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:52:23.313 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:52:23.313 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.313 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.313 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:52:23.314 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.314 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.314 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:52:23.314 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:52:23.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.315 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.315 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:52:23.315 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:52:23.315 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.315 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.315 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:52:23.316 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:52:23.316 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:52:23.316 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:52:23.316 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:52:23.316 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:52:23.316 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:52:23.317 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.317 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:52:23.317 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:52:23.318 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:52:23.318 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:52:23.318 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:52:23.318 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:52:23.318 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:52:23.319 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:52:23.319 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:52:23.319 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 159, 2019-11-28T11:52:23.319 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:52:23.319 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:52:23.320 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:52:23.320 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.320 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.320 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:52:23.321 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:52:23.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.321 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.321 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:52:23.322 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:52:23.322 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.322 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.322 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:52:23.323 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.323 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.323 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:52:23.323 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:52:23.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.324 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.324 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:52:23.324 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:52:23.325 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.325 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.325 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:52:23.326 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.327 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.327 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:52:23.327 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:52:23.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.328 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.328 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:52:23.328 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:52:23.328 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.328 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.329 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:52:23.329 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.329 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.330 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:52:23.330 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:52:23.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.330 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.331 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:52:23.331 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:52:23.331 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.331 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.332 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:52:23.332 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:52:23.332 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:52:23.332 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:52:23.332 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:52:23.333 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:52:23.333 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:52:23.333 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.334 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:52:23.334 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:52:23.334 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:52:23.334 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:52:23.334 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:52:23.335 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:52:23.335 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:52:23.335 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:52:23.335 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:52:23.336 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 160, 2019-11-28T11:52:23.336 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:52:23.336 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:52:23.336 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:52:23.336 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.337 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.337 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:52:23.337 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:52:23.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.338 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.338 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:52:23.338 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:52:23.338 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.339 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.339 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:52:23.339 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.340 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.340 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:52:23.340 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:52:23.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.341 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.341 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:52:23.341 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:52:23.341 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.342 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.342 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:52:23.342 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.342 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:52:23.343 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:52:23.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.343 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.344 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:52:23.344 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:52:23.344 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.344 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.345 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:52:23.345 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.345 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.346 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:52:23.346 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:52:23.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.346 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.347 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:52:23.347 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:52:23.347 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.347 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.348 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:52:23.348 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:52:23.348 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:52:23.348 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:52:23.348 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:52:23.349 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:52:23.349 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:52:23.349 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.350 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:52:23.350 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:52:23.350 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:52:23.350 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:52:23.350 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:52:23.351 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:52:23.351 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:52:23.351 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:52:23.351 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:52:23.351 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 150, 2019-11-28T11:52:23.351 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:52:23.352 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:52:23.352 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:52:23.352 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.352 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.353 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:52:23.353 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:52:23.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.354 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.354 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:52:23.354 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:52:23.354 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.354 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.355 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:52:23.355 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.355 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.356 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:52:23.356 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:52:23.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.356 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.357 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:52:23.357 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:52:23.357 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.357 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.358 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:52:23.358 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.358 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.358 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:52:23.359 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:52:23.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.359 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.359 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:52:23.360 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:52:23.360 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.360 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.360 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:52:23.361 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.361 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.361 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:52:23.361 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:52:23.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.362 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.362 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:52:23.362 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:52:23.362 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.362 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.362 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:52:23.363 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:52:23.363 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:52:23.363 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:52:23.363 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:52:23.363 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:52:23.363 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:52:23.363 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.364 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:52:23.364 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:52:23.364 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:52:23.364 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:52:23.364 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:52:23.364 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:52:23.365 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:52:23.365 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:52:23.365 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:52:23.365 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 160, 2019-11-28T11:52:23.365 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:52:23.365 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:52:23.365 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:52:23.366 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.366 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.366 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:52:23.366 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:52:23.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.367 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.367 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:52:23.367 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:52:23.367 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.367 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.367 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:52:23.367 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.368 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.368 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:52:23.368 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:52:23.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.368 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.369 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:52:23.369 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:52:23.369 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.369 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.369 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:52:23.369 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.370 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.370 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:52:23.370 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:52:23.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.370 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.371 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:52:23.371 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:52:23.371 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.371 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.371 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:52:23.371 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.372 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.372 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:52:23.372 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:52:23.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.372 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.372 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:52:23.373 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:52:23.373 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.373 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.373 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:52:23.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:52:23.373 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:52:23.374 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:52:23.374 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:52:23.374 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:52:23.374 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:52:23.374 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.375 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:52:23.375 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:52:23.375 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:52:23.375 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:52:23.375 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:52:23.375 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:52:23.375 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:52:23.375 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:52:23.376 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:52:23.376 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 160, 2019-11-28T11:52:23.376 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:52:23.376 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:52:23.376 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:52:23.376 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.377 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.377 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:52:23.377 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:52:23.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.377 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.377 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:52:23.378 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:52:23.378 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.378 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.378 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:52:23.378 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.378 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.379 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:52:23.379 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:52:23.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.379 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.379 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:52:23.379 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:52:23.380 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.380 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.380 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:52:23.380 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.380 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.381 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:52:23.381 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:52:23.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.381 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.381 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:52:23.381 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:52:23.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.382 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.382 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:52:23.382 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.382 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.382 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:52:23.383 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:52:23.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.383 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.383 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:52:23.383 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:52:23.383 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.384 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.384 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:52:23.384 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:52:23.384 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:52:23.384 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:52:23.384 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:52:23.384 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:52:23.385 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:52:23.385 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.385 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:52:23.385 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:52:23.385 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:52:23.386 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:52:23.386 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:52:23.386 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:52:23.386 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:52:23.386 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:52:23.386 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:52:23.386 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 160, 2019-11-28T11:52:23.387 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:52:23.387 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:52:23.387 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:52:23.387 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.387 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.387 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:52:23.387 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:52:23.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.388 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.388 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:52:23.388 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:52:23.388 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.388 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.389 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:52:23.389 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.389 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.389 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:52:23.389 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:52:23.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.390 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.390 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:52:23.390 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:52:23.390 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.390 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.391 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:52:23.391 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.391 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.391 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:52:23.391 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:52:23.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.392 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.392 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:52:23.392 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:52:23.392 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.392 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.393 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:52:23.393 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.393 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.393 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:52:23.393 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:52:23.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.394 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.394 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:52:23.394 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:52:23.394 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.394 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.394 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:52:23.395 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:52:23.395 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:52:23.395 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:52:23.395 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:52:23.395 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:52:23.395 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:52:23.395 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.396 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:52:23.396 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:52:23.396 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:52:23.396 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:52:23.396 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:52:23.397 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:52:23.397 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:52:23.397 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:52:23.397 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:52:23.397 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 159, 2019-11-28T11:52:23.397 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:52:23.397 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:52:23.397 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:52:23.398 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.398 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.398 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:52:23.398 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:52:23.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.399 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.399 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:52:23.399 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:52:23.399 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.399 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.399 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:52:23.400 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.400 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.400 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:52:23.400 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:52:23.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.401 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.401 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:52:23.401 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:52:23.401 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.401 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.401 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:52:23.401 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.402 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.402 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:52:23.402 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:52:23.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.402 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.403 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:52:23.403 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:52:23.403 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.403 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.403 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:52:23.403 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:52:23.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.404 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:52:23.404 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:52:23.404 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:52:23.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.404 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:23.404 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:52:23.405 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:52:23.405 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.405 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.405 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:52:23.405 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:52:23.405 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:52:23.406 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:52:23.406 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:52:23.406 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:52:23.406 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:52:23.406 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:23.406 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.406 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:52:23.407 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:52:23.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.407 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:52:23.407 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:52:23.407 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:52:23.407 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:52:23.407 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:52:23.407 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:52:23.408 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:52:23.408 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:52:23.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.408 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:52:23.408 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:52:23.408 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:52:23.409 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:52:23.409 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:52:23.409 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:52:23.409 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:52:23.409 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:52:23.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.410 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:52:23.410 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:52:23.410 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:52:23.410 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:52:23.410 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:52:23.410 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:52:23.410 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:52:23.411 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:52:23.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.411 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:52:23.411 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:52:23.411 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:52:23.411 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:52:23.411 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:52:23.412 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:52:23.412 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:52:23.412 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:52:23.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.412 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:52:23.412 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:52:23.413 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:52:23.413 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:52:23.413 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:52:23.413 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:52:23.413 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:52:23.413 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:52:23.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.414 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:52:23.414 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:52:23.414 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:52:23.414 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:52:23.414 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:52:23.414 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:52:23.415 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:52:23.415 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:52:23.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.415 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:52:23.415 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:52:23.415 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:52:23.415 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:52:23.416 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:52:23.416 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:52:23.416 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:52:23.416 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:52:23.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:23.416 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:52:23.417 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:52:23.417 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:52:23.417 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:52:23.417 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:52:23.417 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:52:23.417 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:52:23.417 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:52:23.418 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.418 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:52:23.418 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:52:23.418 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:52:23.418 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:52:23.419 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:52:23.419 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:52:23.419 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/2828740513": "2019-11-29T11:52:22.077183+0000", 2019-11-28T11:52:23.419 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/2828740513": "2019-11-29T11:52:22.077183+0000", 2019-11-28T11:52:23.419 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.76:0/1856018806": "2019-11-28T12:49:56.100589+0000", 2019-11-28T11:52:23.419 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/1260063619": "2019-11-29T11:49:43.549456+0000", 2019-11-28T11:52:23.419 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/1260063619": "2019-11-29T11:49:43.549456+0000" 2019-11-28T11:52:23.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.420 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:52:23.420 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:52:23.420 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:52:23.420 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:52:23.420 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:52:23.420 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:52:23.420 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:52:23.421 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:52:23.421 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:52:23.421 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:52:23.421 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:52:23.421 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:52:23.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.421 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:52:23.422 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:52:23.422 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:52:23.422 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:52:23.422 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:52:23.422 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:52:23.422 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:52:23.422 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:23.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:23.423 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:52:23.423 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:52:23.423 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:52:23.423 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:52:23.423 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:52:23.423 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:52:23.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.184+0000 7ff9712b3700 1 -- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff944018730 msgr2=0x7ff94401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:23.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.184+0000 7ff9712b3700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff944018730 0x7ff94401abc0 crc :-1 s=READY pgs=887 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:23.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.184+0000 7ff9712b3700 1 -- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c13e5f0 msgr2=0x7ff96c13e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:23.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.184+0000 7ff9712b3700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c13e5f0 0x7ff96c13e9e0 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7ff95c010440 tx=0x7ff95c010270).stop 2019-11-28T11:52:23.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.184+0000 7ff9712b3700 1 -- 172.21.15.80:0/3868292699 shutdown_connections 2019-11-28T11:52:23.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.184+0000 7ff9712b3700 1 --2- 172.21.15.80:0/3868292699 >> v2:172.21.15.174:3300/0 conn(0x7ff96c10a4e0 0x7ff96c10c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:23.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.184+0000 7ff9712b3700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff944018730 0x7ff94401abc0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:23.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.184+0000 7ff9712b3700 1 --2- 172.21.15.80:0/3868292699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff96c13e5f0 0x7ff96c13e9e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:23.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.184+0000 7ff9712b3700 1 -- 172.21.15.80:0/3868292699 shutdown_connections 2019-11-28T11:52:23.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.184+0000 7ff9712b3700 1 -- 172.21.15.80:0/3868292699 wait complete. 2019-11-28T11:52:23.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.184+0000 7ff9712b3700 1 -- 172.21.15.80:0/3868292699 >> 172.21.15.80:0/3868292699 conn(0x7ff96c13d620 msgr2=0x7ff96c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:23.428 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:23.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.493+0000 7fb6ada4f700 1 Processor -- start 2019-11-28T11:52:23.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.493+0000 7fb6ada4f700 1 -- start start 2019-11-28T11:52:23.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.494+0000 7fb6ada4f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb6a806c0a0 0x7fb6a8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:23.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.494+0000 7fb6ada4f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb6a8072620 0x7fb6a8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:23.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.494+0000 7fb6ada4f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a806db00 con 0x7fb6a80734e0 2019-11-28T11:52:23.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.494+0000 7fb6ada4f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a806fd60 con 0x7fb6a806c0a0 2019-11-28T11:52:23.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.494+0000 7fb6ada4f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a8070030 con 0x7fb6a8072620 2019-11-28T11:52:23.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb6a806c0a0 0x7fb6a8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:23.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a6ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb6a80734e0 0x7fb6a8071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42100/0 (socket says 172.21.15.80:42100) 2019-11-28T11:52:23.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a6ffd700 1 -- 172.21.15.80:0/490017814 learned_addr learned my addr 172.21.15.80:0/490017814 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:23.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a7fff700 1 --2- 172.21.15.80:0/490017814 >> v2:172.21.15.174:3300/0 conn(0x7fb6a8072620 0x7fb6a8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:23.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a77fe700 1 -- 172.21.15.80:0/490017814 >> v2:172.21.15.174:3300/0 conn(0x7fb6a8072620 msgr2=0x7fb6a8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:23.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a77fe700 1 --2- 172.21.15.80:0/490017814 >> v2:172.21.15.174:3300/0 conn(0x7fb6a8072620 0x7fb6a8164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:23.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a77fe700 1 -- 172.21.15.80:0/490017814 >> v1:172.21.15.80:6789/0 conn(0x7fb6a80734e0 legacy=0x7fb6a8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:23.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a67fc700 1 -- 172.21.15.80:0/490017814 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011962734 0 0) 0x7fb690001070 con 0x7fb6a80734e0 2019-11-28T11:52:23.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a77fe700 1 -- 172.21.15.80:0/490017814 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a80706c0 con 0x7fb6a806c0a0 2019-11-28T11:52:23.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a7fff700 1 --2- 172.21.15.80:0/490017814 >> v2:172.21.15.174:3300/0 conn(0x7fb6a8072620 0x7fb6a8164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:52:23.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a77fe700 1 --2- 172.21.15.80:0/490017814 >> v2:172.21.15.80:3300/0 conn(0x7fb6a806c0a0 0x7fb6a8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb69800af50 tx=0x7fb69800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a77fe700 1 --2- 172.21.15.80:0/490017814 >> v2:172.21.15.80:3300/0 conn(0x7fb6a806c0a0 0x7fb6a8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb69800af50 tx=0x7fb69800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a77fe700 1 --2- 172.21.15.80:0/490017814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a806c0a0 0x7fb6a8072fa0 secure :-1 s=READY pgs=2171 cs=0 l=1 rx=0x7fb69800af50 tx=0x7fb69800b760).ready entity=mon.0 client_cookie=25266e0d676d2029 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:23.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a77fe700 1 --2- 172.21.15.80:0/490017814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a806c0a0 0x7fb6a8072fa0 secure :-1 s=THROTTLE_DONE pgs=2171 cs=0 l=1 rx=0x7fb69800af50 tx=0x7fb69800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a67fc700 1 -- 172.21.15.80:0/490017814 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb698007210 con 0x7fb6a806c0a0 2019-11-28T11:52:23.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a77fe700 1 --2- 172.21.15.80:0/490017814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a806c0a0 0x7fb6a8072fa0 secure :-1 s=THROTTLE_DONE pgs=2171 cs=0 l=1 rx=0x7fb69800af50 tx=0x7fb69800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a77fe700 1 --2- 172.21.15.80:0/490017814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a806c0a0 0x7fb6a8072fa0 secure :-1 s=THROTTLE_DONE pgs=2171 cs=0 l=1 rx=0x7fb69800af50 tx=0x7fb69800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a67fc700 1 -- 172.21.15.80:0/490017814 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6980099b0 con 0x7fb6a806c0a0 2019-11-28T11:52:23.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6a67fc700 1 -- 172.21.15.80:0/490017814 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb698009ba0 con 0x7fb6a806c0a0 2019-11-28T11:52:23.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6ada4f700 1 -- 172.21.15.80:0/490017814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a806c0a0 msgr2=0x7fb6a8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:23.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.495+0000 7fb6ada4f700 1 --2- 172.21.15.80:0/490017814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a806c0a0 0x7fb6a8072fa0 secure :-1 s=READY pgs=2171 cs=0 l=1 rx=0x7fb69800af50 tx=0x7fb69800b760).stop 2019-11-28T11:52:23.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.496+0000 7fb6ada4f700 1 -- 172.21.15.80:0/490017814 shutdown_connections 2019-11-28T11:52:23.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.496+0000 7fb6ada4f700 1 --2- 172.21.15.80:0/490017814 >> v2:172.21.15.174:3300/0 conn(0x7fb6a8072620 0x7fb6a8164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:23.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.496+0000 7fb6ada4f700 1 --2- 172.21.15.80:0/490017814 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a806c0a0 0x7fb6a8072fa0 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:23.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.496+0000 7fb6ada4f700 1 -- 172.21.15.80:0/490017814 shutdown_connections 2019-11-28T11:52:23.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.496+0000 7fb6ada4f700 1 -- 172.21.15.80:0/490017814 wait complete. 2019-11-28T11:52:23.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.496+0000 7fb6ada4f700 1 -- 172.21.15.80:0/490017814 >> 172.21.15.80:0/490017814 conn(0x7fb6a8061cf0 msgr2=0x7fb6a8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:23.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.498+0000 7fb6ada4f700 1 Processor -- start 2019-11-28T11:52:23.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.499+0000 7fb6ada4f700 1 -- start start 2019-11-28T11:52:23.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6ada4f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb6a81293f0 0x7fb6a8129880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:23.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6ada4f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb6a807a340 0x7fb6a807a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:23.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6ada4f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a813f190 con 0x7fb6a813e8e0 2019-11-28T11:52:23.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6ada4f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a8142d50 con 0x7fb6a81293f0 2019-11-28T11:52:23.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6ada4f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a8143020 con 0x7fb6a807a340 2019-11-28T11:52:23.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6a6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb6a81293f0 0x7fb6a8129880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:23.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6a6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb6a81293f0 0x7fb6a8129880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42788/0 (socket says 172.21.15.80:42788) 2019-11-28T11:52:23.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6a6ffd700 1 -- 172.21.15.80:0/3019161598 learned_addr learned my addr 172.21.15.80:0/3019161598 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:23.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6a7fff700 1 --2- 172.21.15.80:0/3019161598 >> v2:172.21.15.174:3300/0 conn(0x7fb6a807a340 0x7fb6a807a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:23.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6a6ffd700 1 -- 172.21.15.80:0/3019161598 >> v2:172.21.15.174:3300/0 conn(0x7fb6a807a340 msgr2=0x7fb6a807a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:23.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6a6ffd700 1 --2- 172.21.15.80:0/3019161598 >> v2:172.21.15.174:3300/0 conn(0x7fb6a807a340 0x7fb6a807a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:23.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6a6ffd700 1 -- 172.21.15.80:0/3019161598 >> v1:172.21.15.174:6789/0 conn(0x7fb6a813e8e0 legacy=0x7fb6a807b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:23.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6a6ffd700 1 -- 172.21.15.80:0/3019161598 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a8078c00 con 0x7fb6a81293f0 2019-11-28T11:52:23.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6a6ffd700 1 --2- 172.21.15.80:0/3019161598 >> v2:172.21.15.80:3300/0 conn(0x7fb6a81293f0 0x7fb6a8129880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb690010440 tx=0x7fb690010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6a6ffd700 1 --2- 172.21.15.80:0/3019161598 >> v2:172.21.15.80:3300/0 conn(0x7fb6a81293f0 0x7fb6a8129880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb690010440 tx=0x7fb690010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6a6ffd700 1 --2- 172.21.15.80:0/3019161598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a81293f0 0x7fb6a8129880 secure :-1 s=READY pgs=2172 cs=0 l=1 rx=0x7fb690010440 tx=0x7fb690010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:23.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6a6ffd700 1 --2- 172.21.15.80:0/3019161598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a81293f0 0x7fb6a8129880 secure :-1 s=THROTTLE_DONE pgs=2172 cs=0 l=1 rx=0x7fb690010440 tx=0x7fb690010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb69ffff700 1 -- 172.21.15.80:0/3019161598 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb690000d50 con 0x7fb6a81293f0 2019-11-28T11:52:23.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6a6ffd700 1 --2- 172.21.15.80:0/3019161598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a81293f0 0x7fb6a8129880 secure :-1 s=THROTTLE_DONE pgs=2172 cs=0 l=1 rx=0x7fb690010440 tx=0x7fb690010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6a6ffd700 1 --2- 172.21.15.80:0/3019161598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a81293f0 0x7fb6a8129880 secure :-1 s=THROTTLE_DONE pgs=2172 cs=0 l=1 rx=0x7fb690010440 tx=0x7fb690010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb69ffff700 1 -- 172.21.15.80:0/3019161598 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb690003fe0 con 0x7fb6a81293f0 2019-11-28T11:52:23.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6ada4f700 1 -- 172.21.15.80:0/3019161598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a8078f80 con 0x7fb6a81293f0 2019-11-28T11:52:23.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb69ffff700 1 -- 172.21.15.80:0/3019161598 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb690004670 con 0x7fb6a81293f0 2019-11-28T11:52:23.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.500+0000 7fb6ada4f700 1 -- 172.21.15.80:0/3019161598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a8078c00 con 0x7fb6a81293f0 2019-11-28T11:52:23.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.501+0000 7fb6a6ffd700 1 --2- 172.21.15.80:0/3019161598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a81293f0 0x7fb6a8129880 secure :-1 s=THROTTLE_DONE pgs=2172 cs=0 l=1 rx=0x7fb690010440 tx=0x7fb690010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.501+0000 7fb69ffff700 1 -- 172.21.15.80:0/3019161598 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb690000d30 con 0x7fb6a81293f0 2019-11-28T11:52:23.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.501+0000 7fb6a6ffd700 1 --2- 172.21.15.80:0/3019161598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a81293f0 0x7fb6a8129880 secure :-1 s=THROTTLE_DONE pgs=2172 cs=0 l=1 rx=0x7fb690010440 tx=0x7fb690010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.501+0000 7fb69ffff700 1 --2- 172.21.15.80:0/3019161598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb68c018730 0x7fb68c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:23.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.501+0000 7fb69ffff700 1 -- 172.21.15.80:0/3019161598 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fb690031ad0 con 0x7fb6a81293f0 2019-11-28T11:52:23.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.501+0000 7fb6a77fe700 1 --2- 172.21.15.80:0/3019161598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb68c018730 0x7fb68c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:23.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.502+0000 7fb6a77fe700 1 --2- 172.21.15.80:0/3019161598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb68c018730 0x7fb68c01abc0 crc :-1 s=READY pgs=888 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:23.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.509+0000 7fb6ada4f700 1 -- 172.21.15.80:0/3019161598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a8078f80 con 0x7fb6a81293f0 2019-11-28T11:52:23.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.512+0000 7fb6a6ffd700 1 --2- 172.21.15.80:0/3019161598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a81293f0 0x7fb6a8129880 secure :-1 s=THROTTLE_DONE pgs=2172 cs=0 l=1 rx=0x7fb690010440 tx=0x7fb690010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.512+0000 7fb69ffff700 1 -- 172.21.15.80:0/3019161598 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb690000940 con 0x7fb6a81293f0 2019-11-28T11:52:23.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.683+0000 7fb6ada4f700 1 -- 172.21.15.80:0/3019161598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6a8078c00 con 0x7fb6a81293f0 2019-11-28T11:52:23.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.684+0000 7fb6a6ffd700 1 --2- 172.21.15.80:0/3019161598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a81293f0 0x7fb6a8129880 secure :-1 s=THROTTLE_DONE pgs=2172 cs=0 l=1 rx=0x7fb690010440 tx=0x7fb690010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.684+0000 7fb69ffff700 1 -- 172.21.15.80:0/3019161598 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 132 v132) v1 ==== 95+0+1432 (secure 0 0 0) 0x7fb69001fec0 con 0x7fb6a81293f0 2019-11-28T11:52:23.737 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 132 2019-11-28T11:52:23.738 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:23.738 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":132,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":132,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:52:22.758716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":169,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:52:23.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.686+0000 7fb6ada4f700 1 -- 172.21.15.80:0/3019161598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb68c018730 msgr2=0x7fb68c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:23.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.686+0000 7fb6ada4f700 1 --2- 172.21.15.80:0/3019161598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb68c018730 0x7fb68c01abc0 crc :-1 s=READY pgs=888 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:23.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.686+0000 7fb6ada4f700 1 -- 172.21.15.80:0/3019161598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a81293f0 msgr2=0x7fb6a8129880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:23.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.686+0000 7fb6ada4f700 1 --2- 172.21.15.80:0/3019161598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a81293f0 0x7fb6a8129880 secure :-1 s=READY pgs=2172 cs=0 l=1 rx=0x7fb690010440 tx=0x7fb690010270).stop 2019-11-28T11:52:23.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.686+0000 7fb6ada4f700 1 -- 172.21.15.80:0/3019161598 shutdown_connections 2019-11-28T11:52:23.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.686+0000 7fb6ada4f700 1 --2- 172.21.15.80:0/3019161598 >> v2:172.21.15.174:3300/0 conn(0x7fb6a807a340 0x7fb6a807a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:23.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.686+0000 7fb6ada4f700 1 --2- 172.21.15.80:0/3019161598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6a81293f0 0x7fb6a8129880 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:23.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.686+0000 7fb6ada4f700 1 --2- 172.21.15.80:0/3019161598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb68c018730 0x7fb68c01abc0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:23.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.686+0000 7fb6ada4f700 1 -- 172.21.15.80:0/3019161598 shutdown_connections 2019-11-28T11:52:23.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.686+0000 7fb6ada4f700 1 -- 172.21.15.80:0/3019161598 wait complete. 2019-11-28T11:52:23.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.686+0000 7fb6ada4f700 1 -- 172.21.15.80:0/3019161598 >> 172.21.15.80:0/3019161598 conn(0x7fb6a813b860 msgr2=0x7fb6a81050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:23.749 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:52:23.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.819+0000 7ff5a917d700 1 Processor -- start 2019-11-28T11:52:23.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.819+0000 7ff5a917d700 1 -- start start 2019-11-28T11:52:23.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a917d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff5a406c0a0 0x7ff5a4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:23.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a917d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5a40734e0 0x7ff5a4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:23.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a917d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a406db00 con 0x7ff5a4072360 2019-11-28T11:52:23.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a917d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a406fd60 con 0x7ff5a406c0a0 2019-11-28T11:52:23.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a917d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4070030 con 0x7ff5a40734e0 2019-11-28T11:52:23.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a897c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff5a4072360 0x7ff5a406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42112/0 (socket says 172.21.15.80:42112) 2019-11-28T11:52:23.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a897c700 1 -- 172.21.15.80:0/96935216 learned_addr learned my addr 172.21.15.80:0/96935216 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:23.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a359e700 1 --2- 172.21.15.80:0/96935216 >> v2:172.21.15.174:3300/0 conn(0x7ff5a406c0a0 0x7ff5a4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:23.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a2d9d700 1 --2- 172.21.15.80:0/96935216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5a40734e0 0x7ff5a4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:23.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a259c700 1 -- 172.21.15.80:0/96935216 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130022186 0 0) 0x7ff59c001150 con 0x7ff5a4072360 2019-11-28T11:52:23.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a259c700 1 -- 172.21.15.80:0/96935216 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff584002e80 con 0x7ff5a4072360 2019-11-28T11:52:23.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a359e700 1 -- 172.21.15.80:0/96935216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5a40734e0 msgr2=0x7ff5a4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:23.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a259c700 1 -- 172.21.15.80:0/96935216 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 82757818 0 0) 0x7ff59c001130 con 0x7ff5a4072360 2019-11-28T11:52:23.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a359e700 1 --2- 172.21.15.80:0/96935216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5a40734e0 0x7ff5a4071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:23.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a359e700 1 -- 172.21.15.80:0/96935216 >> v1:172.21.15.80:6789/0 conn(0x7ff5a4072360 legacy=0x7ff5a406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:23.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a359e700 1 -- 172.21.15.80:0/96935216 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a40706c0 con 0x7ff5a406c0a0 2019-11-28T11:52:23.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a2d9d700 1 --2- 172.21.15.80:0/96935216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5a40734e0 0x7ff5a4071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:23.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.820+0000 7ff5a359e700 1 --2- 172.21.15.80:0/96935216 >> v2:172.21.15.174:3300/0 conn(0x7ff5a406c0a0 0x7ff5a4072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff58c00b2d0 tx=0x7ff58c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.821+0000 7ff5a359e700 1 --2- 172.21.15.80:0/96935216 >> v2:172.21.15.174:3300/0 conn(0x7ff5a406c0a0 0x7ff5a4072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff58c00b2d0 tx=0x7ff58c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.821+0000 7ff5a359e700 1 --2- 172.21.15.80:0/96935216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5a406c0a0 0x7ff5a4072fa0 secure :-1 s=READY pgs=1291 cs=0 l=1 rx=0x7ff58c00b2d0 tx=0x7ff58c00bae0).ready entity=mon.1 client_cookie=d1b714344e461c48 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:23.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.821+0000 7ff5a359e700 1 --2- 172.21.15.80:0/96935216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5a406c0a0 0x7ff5a4072fa0 secure :-1 s=THROTTLE_DONE pgs=1291 cs=0 l=1 rx=0x7ff58c00b2d0 tx=0x7ff58c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.821+0000 7ff5a259c700 1 -- 172.21.15.80:0/96935216 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff58c007590 con 0x7ff5a406c0a0 2019-11-28T11:52:23.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.821+0000 7ff5a359e700 1 --2- 172.21.15.80:0/96935216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5a406c0a0 0x7ff5a4072fa0 secure :-1 s=THROTTLE_DONE pgs=1291 cs=0 l=1 rx=0x7ff58c00b2d0 tx=0x7ff58c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.821+0000 7ff5a359e700 1 --2- 172.21.15.80:0/96935216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5a406c0a0 0x7ff5a4072fa0 secure :-1 s=THROTTLE_DONE pgs=1291 cs=0 l=1 rx=0x7ff58c00b2d0 tx=0x7ff58c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.821+0000 7ff5a259c700 1 -- 172.21.15.80:0/96935216 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c009d30 con 0x7ff5a406c0a0 2019-11-28T11:52:23.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.821+0000 7ff5a259c700 1 -- 172.21.15.80:0/96935216 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff58c00a400 con 0x7ff5a406c0a0 2019-11-28T11:52:23.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.821+0000 7ff5a917d700 1 -- 172.21.15.80:0/96935216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5a406c0a0 msgr2=0x7ff5a4072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:23.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.821+0000 7ff5a917d700 1 --2- 172.21.15.80:0/96935216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5a406c0a0 0x7ff5a4072fa0 secure :-1 s=READY pgs=1291 cs=0 l=1 rx=0x7ff58c00b2d0 tx=0x7ff58c00bae0).stop 2019-11-28T11:52:23.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.821+0000 7ff5a917d700 1 -- 172.21.15.80:0/96935216 shutdown_connections 2019-11-28T11:52:23.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.821+0000 7ff5a917d700 1 --2- 172.21.15.80:0/96935216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5a40734e0 0x7ff5a4071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:23.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.821+0000 7ff5a917d700 1 --2- 172.21.15.80:0/96935216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5a406c0a0 0x7ff5a4072fa0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:23.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.821+0000 7ff5a917d700 1 -- 172.21.15.80:0/96935216 shutdown_connections 2019-11-28T11:52:23.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.821+0000 7ff5a917d700 1 -- 172.21.15.80:0/96935216 wait complete. 2019-11-28T11:52:23.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.821+0000 7ff5a917d700 1 -- 172.21.15.80:0/96935216 >> 172.21.15.80:0/96935216 conn(0x7ff5a4061cf0 msgr2=0x7ff5a4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:23.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.824+0000 7ff5a917d700 1 Processor -- start 2019-11-28T11:52:23.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.824+0000 7ff5a917d700 1 -- start start 2019-11-28T11:52:23.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.825+0000 7ff5a917d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5a4103000 0x7ff5a4103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:23.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.825+0000 7ff5a917d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5a41039d0 0x7ff5a4167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:23.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.825+0000 7ff5a917d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a41312c0 con 0x7ff5a413dc00 2019-11-28T11:52:23.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.825+0000 7ff5a917d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a4105830 con 0x7ff5a41039d0 2019-11-28T11:52:23.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.825+0000 7ff5a917d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4105b00 con 0x7ff5a4103000 2019-11-28T11:52:23.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.825+0000 7ff5a897c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5a41039d0 0x7ff5a4167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:23.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.825+0000 7ff5a359e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff5a413dc00 0x7ff5a4109e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42114/0 (socket says 172.21.15.80:42114) 2019-11-28T11:52:23.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.825+0000 7ff5a359e700 1 -- 172.21.15.80:0/4098686287 learned_addr learned my addr 172.21.15.80:0/4098686287 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:23.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.825+0000 7ff5a2d9d700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5a4103000 0x7ff5a4103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:23.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.825+0000 7ff5a897c700 1 -- 172.21.15.80:0/4098686287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5a4103000 msgr2=0x7ff5a4103490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:23.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.825+0000 7ff5a897c700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5a4103000 0x7ff5a4103490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:23.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.825+0000 7ff5a897c700 1 -- 172.21.15.80:0/4098686287 >> v1:172.21.15.80:6789/0 conn(0x7ff5a413dc00 legacy=0x7ff5a4109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:23.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.825+0000 7ff5a897c700 1 -- 172.21.15.80:0/4098686287 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a4106190 con 0x7ff5a41039d0 2019-11-28T11:52:23.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.825+0000 7ff59bfff700 1 -- 172.21.15.80:0/4098686287 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100131569 0 0) 0x7ff58c00b7e0 con 0x7ff5a413dc00 2019-11-28T11:52:23.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.825+0000 7ff5a897c700 1 --2- 172.21.15.80:0/4098686287 >> v2:172.21.15.80:3300/0 conn(0x7ff5a41039d0 0x7ff5a4167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff59c010390 tx=0x7ff59c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.826+0000 7ff5a897c700 1 --2- 172.21.15.80:0/4098686287 >> v2:172.21.15.80:3300/0 conn(0x7ff5a41039d0 0x7ff5a4167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff59c010390 tx=0x7ff59c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.826+0000 7ff5a897c700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5a41039d0 0x7ff5a4167a10 secure :-1 s=READY pgs=2175 cs=0 l=1 rx=0x7ff59c010390 tx=0x7ff59c0101c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:23.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.826+0000 7ff5a897c700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5a41039d0 0x7ff5a4167a10 secure :-1 s=THROTTLE_DONE pgs=2175 cs=0 l=1 rx=0x7ff59c010390 tx=0x7ff59c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.826+0000 7ff59bfff700 1 -- 172.21.15.80:0/4098686287 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff59c000ef0 con 0x7ff5a41039d0 2019-11-28T11:52:23.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.826+0000 7ff5a897c700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5a41039d0 0x7ff5a4167a10 secure :-1 s=THROTTLE_DONE pgs=2175 cs=0 l=1 rx=0x7ff59c010390 tx=0x7ff59c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.826+0000 7ff5a917d700 1 -- 172.21.15.80:0/4098686287 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a4106510 con 0x7ff5a41039d0 2019-11-28T11:52:23.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.826+0000 7ff5a897c700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5a41039d0 0x7ff5a4167a10 secure :-1 s=THROTTLE_DONE pgs=2175 cs=0 l=1 rx=0x7ff59c010390 tx=0x7ff59c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.826+0000 7ff59bfff700 1 -- 172.21.15.80:0/4098686287 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c000ef0 con 0x7ff5a41039d0 2019-11-28T11:52:23.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.826+0000 7ff59bfff700 1 -- 172.21.15.80:0/4098686287 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff59c004430 con 0x7ff5a41039d0 2019-11-28T11:52:23.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.826+0000 7ff5a917d700 1 -- 172.21.15.80:0/4098686287 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a4106190 con 0x7ff5a41039d0 2019-11-28T11:52:23.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.826+0000 7ff5a897c700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5a41039d0 0x7ff5a4167a10 secure :-1 s=THROTTLE_DONE pgs=2175 cs=0 l=1 rx=0x7ff59c010390 tx=0x7ff59c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.827+0000 7ff59bfff700 1 -- 172.21.15.80:0/4098686287 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff59c004240 con 0x7ff5a41039d0 2019-11-28T11:52:23.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.827+0000 7ff5a897c700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5a41039d0 0x7ff5a4167a10 secure :-1 s=THROTTLE_DONE pgs=2175 cs=0 l=1 rx=0x7ff59c010390 tx=0x7ff59c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.827+0000 7ff59bfff700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff57c018730 0x7ff57c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:23.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.827+0000 7ff59bfff700 1 -- 172.21.15.80:0/4098686287 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6235+0+0 (secure 0 0 0) 0x7ff59c0319f0 con 0x7ff5a41039d0 2019-11-28T11:52:23.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.827+0000 7ff5a359e700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff57c018730 0x7ff57c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:23.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.827+0000 7ff5a359e700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff57c018730 0x7ff57c01abc0 crc :-1 s=READY pgs=889 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:23.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.834+0000 7ff5a917d700 1 -- 172.21.15.80:0/4098686287 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a4106510 con 0x7ff5a41039d0 2019-11-28T11:52:23.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.837+0000 7ff5a897c700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5a41039d0 0x7ff5a4167a10 secure :-1 s=THROTTLE_DONE pgs=2175 cs=0 l=1 rx=0x7ff59c010390 tx=0x7ff59c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:23.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:23.837+0000 7ff59bfff700 1 -- 172.21.15.80:0/4098686287 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff59c000940 con 0x7ff5a41039d0 2019-11-28T11:52:24.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.002+0000 7ff5a917d700 1 -- 172.21.15.80:0/4098686287 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff5a4106190 con 0x7ff5a41039d0 2019-11-28T11:52:24.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.081+0000 7ff5a897c700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5a41039d0 0x7ff5a4167a10 secure :-1 s=THROTTLE_DONE pgs=2175 cs=0 l=1 rx=0x7ff59c010390 tx=0x7ff59c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.081+0000 7ff59bfff700 1 -- 172.21.15.80:0/4098686287 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v133) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff59c01f5b0 con 0x7ff5a41039d0 2019-11-28T11:52:24.169 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:52:24.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.118+0000 7ff5a917d700 1 -- 172.21.15.80:0/4098686287 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff57c018730 msgr2=0x7ff57c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:24.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.118+0000 7ff5a917d700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff57c018730 0x7ff57c01abc0 crc :-1 s=READY pgs=889 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:24.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.118+0000 7ff5a917d700 1 -- 172.21.15.80:0/4098686287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5a41039d0 msgr2=0x7ff5a4167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:24.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.118+0000 7ff5a917d700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5a41039d0 0x7ff5a4167a10 secure :-1 s=READY pgs=2175 cs=0 l=1 rx=0x7ff59c010390 tx=0x7ff59c0101c0).stop 2019-11-28T11:52:24.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.118+0000 7ff5a917d700 1 -- 172.21.15.80:0/4098686287 shutdown_connections 2019-11-28T11:52:24.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.118+0000 7ff5a917d700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff57c018730 0x7ff57c01abc0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:24.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.118+0000 7ff5a917d700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5a41039d0 0x7ff5a4167a10 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:24.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.118+0000 7ff5a917d700 1 --2- 172.21.15.80:0/4098686287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5a4103000 0x7ff5a4103490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:24.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.118+0000 7ff5a917d700 1 -- 172.21.15.80:0/4098686287 shutdown_connections 2019-11-28T11:52:24.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.118+0000 7ff5a917d700 1 -- 172.21.15.80:0/4098686287 wait complete. 2019-11-28T11:52:24.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.118+0000 7ff5a917d700 1 -- 172.21.15.80:0/4098686287 >> 172.21.15.80:0/4098686287 conn(0x7ff5a411bfc0 msgr2=0x7ff5a4141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:24.181 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:24.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.247+0000 7f0c12156700 1 Processor -- start 2019-11-28T11:52:24.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.247+0000 7f0c12156700 1 -- start start 2019-11-28T11:52:24.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.248+0000 7f0c12156700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0c0c06c490 0x7f0c0c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:24.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.248+0000 7f0c12156700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c0c06ce60 0x7f0c0c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:24.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.248+0000 7f0c12156700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c0c06db00 con 0x7f0c0c06c0a0 2019-11-28T11:52:24.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.248+0000 7f0c12156700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0c06fd60 con 0x7f0c0c06c490 2019-11-28T11:52:24.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.248+0000 7f0c12156700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c070030 con 0x7f0c0c06ce60 2019-11-28T11:52:24.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.248+0000 7f0c03fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0c0c06c490 0x7f0c0c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:24.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.248+0000 7f0c10ef4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c0c06ce60 0x7f0c0c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:24.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.248+0000 7f0c0bfff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f0c0c06c0a0 0x7f0c0c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:57666/0 (socket says 172.21.15.80:57666) 2019-11-28T11:52:24.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.248+0000 7f0c03fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0c0c06c490 0x7f0c0c06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:57692/0 (socket says 172.21.15.80:57692) 2019-11-28T11:52:24.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.248+0000 7f0c10ef4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c0c06ce60 0x7f0c0c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:45070/0 (socket says 172.21.15.80:45070) 2019-11-28T11:52:24.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.248+0000 7f0c0bfff700 1 -- 172.21.15.80:0/3640710273 learned_addr learned my addr 172.21.15.80:0/3640710273 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:24.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c0b7fe700 1 -- 172.21.15.80:0/3640710273 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544411609 0 0) 0x7f0bfc001100 con 0x7f0c0c06c0a0 2019-11-28T11:52:24.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c0b7fe700 1 -- 172.21.15.80:0/3640710273 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bec002e80 con 0x7f0c0c06c0a0 2019-11-28T11:52:24.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c03fff700 1 -- 172.21.15.80:0/3640710273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c0c06ce60 msgr2=0x7f0c0c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:24.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c03fff700 1 --2- 172.21.15.80:0/3640710273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c0c06ce60 0x7f0c0c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:24.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c03fff700 1 -- 172.21.15.80:0/3640710273 >> v1:172.21.15.174:6789/0 conn(0x7f0c0c06c0a0 legacy=0x7f0c0c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:24.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c03fff700 1 -- 172.21.15.80:0/3640710273 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c0706c0 con 0x7f0c0c06c490 2019-11-28T11:52:24.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c10ef4700 1 --2- 172.21.15.80:0/3640710273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c0c06ce60 0x7f0c0c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:24.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c03fff700 1 --2- 172.21.15.80:0/3640710273 >> v2:172.21.15.174:3300/0 conn(0x7f0c0c06c490 0x7f0c0c06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0bf400af50 tx=0x7f0bf400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c03fff700 1 --2- 172.21.15.80:0/3640710273 >> v2:172.21.15.174:3300/0 conn(0x7f0c0c06c490 0x7f0c0c06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0bf400af50 tx=0x7f0bf400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c03fff700 1 --2- 172.21.15.80:0/3640710273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c06c490 0x7f0c0c06c920 secure :-1 s=READY pgs=1293 cs=0 l=1 rx=0x7f0bf400af50 tx=0x7f0bf400b760).ready entity=mon.1 client_cookie=1068e2c4ea5cae6e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:24.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c03fff700 1 --2- 172.21.15.80:0/3640710273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c06c490 0x7f0c0c06c920 secure :-1 s=THROTTLE_DONE pgs=1293 cs=0 l=1 rx=0x7f0bf400af50 tx=0x7f0bf400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c0b7fe700 1 -- 172.21.15.80:0/3640710273 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bf4007210 con 0x7f0c0c06c490 2019-11-28T11:52:24.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c03fff700 1 --2- 172.21.15.80:0/3640710273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c06c490 0x7f0c0c06c920 secure :-1 s=THROTTLE_DONE pgs=1293 cs=0 l=1 rx=0x7f0bf400af50 tx=0x7f0bf400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c03fff700 1 --2- 172.21.15.80:0/3640710273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c06c490 0x7f0c0c06c920 secure :-1 s=THROTTLE_DONE pgs=1293 cs=0 l=1 rx=0x7f0bf400af50 tx=0x7f0bf400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c0b7fe700 1 -- 172.21.15.80:0/3640710273 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf40099b0 con 0x7f0c0c06c490 2019-11-28T11:52:24.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c0b7fe700 1 -- 172.21.15.80:0/3640710273 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bf400a080 con 0x7f0c0c06c490 2019-11-28T11:52:24.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c12156700 1 -- 172.21.15.80:0/3640710273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c06c490 msgr2=0x7f0c0c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:24.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.249+0000 7f0c12156700 1 --2- 172.21.15.80:0/3640710273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c06c490 0x7f0c0c06c920 secure :-1 s=READY pgs=1293 cs=0 l=1 rx=0x7f0bf400af50 tx=0x7f0bf400b760).stop 2019-11-28T11:52:24.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.250+0000 7f0c12156700 1 -- 172.21.15.80:0/3640710273 shutdown_connections 2019-11-28T11:52:24.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.250+0000 7f0c12156700 1 --2- 172.21.15.80:0/3640710273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c0c06ce60 0x7f0c0c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:24.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.250+0000 7f0c12156700 1 --2- 172.21.15.80:0/3640710273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c06c490 0x7f0c0c06c920 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:24.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.250+0000 7f0c12156700 1 -- 172.21.15.80:0/3640710273 shutdown_connections 2019-11-28T11:52:24.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.250+0000 7f0c12156700 1 -- 172.21.15.80:0/3640710273 wait complete. 2019-11-28T11:52:24.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.250+0000 7f0c12156700 1 -- 172.21.15.80:0/3640710273 >> 172.21.15.80:0/3640710273 conn(0x7f0c0c061cf0 msgr2=0x7f0c0c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:24.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.252+0000 7f0c12156700 1 Processor -- start 2019-11-28T11:52:24.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.252+0000 7f0c12156700 1 -- start start 2019-11-28T11:52:24.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.253+0000 7f0c12156700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0c0c13b3c0 0x7f0c0c169ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:24.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.253+0000 7f0c12156700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c0c13bb50 con 0x7f0c0c12e7c0 2019-11-28T11:52:24.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.253+0000 7f0c12156700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c0c13c000 con 0x7f0c0c13a730 2019-11-28T11:52:24.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.253+0000 7f0c12156700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0c1425f0 con 0x7f0c0c13b3c0 2019-11-28T11:52:24.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.253+0000 7f0c0bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0c0c12e7c0 0x7f0c0c122c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42128/0 (socket says 172.21.15.80:42128) 2019-11-28T11:52:24.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.253+0000 7f0c0bfff700 1 -- 172.21.15.80:0/2872735561 learned_addr learned my addr 172.21.15.80:0/2872735561 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:24.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.253+0000 7f0c10ef4700 1 --2- 172.21.15.80:0/2872735561 >> v2:172.21.15.174:3300/0 conn(0x7f0c0c13b3c0 0x7f0c0c169ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:24.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c097fa700 1 -- 172.21.15.80:0/2872735561 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240125107 0 0) 0x7f0bfc000cd0 con 0x7f0c0c12e7c0 2019-11-28T11:52:24.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c097fa700 1 -- 172.21.15.80:0/2872735561 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0be4002e80 con 0x7f0c0c12e7c0 2019-11-28T11:52:24.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c097fa700 1 -- 172.21.15.80:0/2872735561 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582483223 0 0) 0x7f0bf400adc0 con 0x7f0c0c13a730 2019-11-28T11:52:24.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c097fa700 1 -- 172.21.15.80:0/2872735561 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0be40030b0 con 0x7f0c0c13a730 2019-11-28T11:52:24.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c10ef4700 1 -- 172.21.15.80:0/2872735561 >> v1:172.21.15.174:6789/0 conn(0x7f0c0c13a730 legacy=0x7f0c0c13abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:24.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c10ef4700 1 -- 172.21.15.80:0/2872735561 >> v1:172.21.15.80:6789/0 conn(0x7f0c0c12e7c0 legacy=0x7f0c0c122c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:24.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c097fa700 1 -- 172.21.15.80:0/2872735561 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3091692295 0 0) 0x7f0bfc001260 con 0x7f0c0c12e7c0 2019-11-28T11:52:24.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c10ef4700 1 -- 172.21.15.80:0/2872735561 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c120370 con 0x7f0c0c13b3c0 2019-11-28T11:52:24.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c10ef4700 1 --2- 172.21.15.80:0/2872735561 >> v2:172.21.15.174:3300/0 conn(0x7f0c0c13b3c0 0x7f0c0c169ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c04010720 tx=0x7f0c04010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c10ef4700 1 --2- 172.21.15.80:0/2872735561 >> v2:172.21.15.174:3300/0 conn(0x7f0c0c13b3c0 0x7f0c0c169ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c04010720 tx=0x7f0c04010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c10ef4700 1 --2- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c13b3c0 0x7f0c0c169ea0 secure :-1 s=READY pgs=1295 cs=0 l=1 rx=0x7f0c04010720 tx=0x7f0c04010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:24.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c10ef4700 1 --2- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c13b3c0 0x7f0c0c169ea0 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x7f0c04010720 tx=0x7f0c04010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c097fa700 1 -- 172.21.15.80:0/2872735561 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c0400af10 con 0x7f0c0c13b3c0 2019-11-28T11:52:24.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c10ef4700 1 --2- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c13b3c0 0x7f0c0c169ea0 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x7f0c04010720 tx=0x7f0c04010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c10ef4700 1 --2- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c13b3c0 0x7f0c0c169ea0 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x7f0c04010720 tx=0x7f0c04010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c097fa700 1 -- 172.21.15.80:0/2872735561 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c04009930 con 0x7f0c0c13b3c0 2019-11-28T11:52:24.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c097fa700 1 -- 172.21.15.80:0/2872735561 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c0400a080 con 0x7f0c0c13b3c0 2019-11-28T11:52:24.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c12156700 1 -- 172.21.15.80:0/2872735561 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0c1206f0 con 0x7f0c0c13b3c0 2019-11-28T11:52:24.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.254+0000 7f0c12156700 1 -- 172.21.15.80:0/2872735561 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0c120370 con 0x7f0c0c13b3c0 2019-11-28T11:52:24.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.255+0000 7f0c10ef4700 1 --2- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c13b3c0 0x7f0c0c169ea0 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x7f0c04010720 tx=0x7f0c04010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.255+0000 7f0c097fa700 1 -- 172.21.15.80:0/2872735561 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0c04009b20 con 0x7f0c0c13b3c0 2019-11-28T11:52:24.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.255+0000 7f0c10ef4700 1 --2- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c13b3c0 0x7f0c0c169ea0 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x7f0c04010720 tx=0x7f0c04010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.255+0000 7f0c097fa700 1 --2- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0be4018750 0x7f0be401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:24.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.255+0000 7f0c097fa700 1 -- 172.21.15.80:0/2872735561 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f0c04031e10 con 0x7f0c0c13b3c0 2019-11-28T11:52:24.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.255+0000 7f0c0bfff700 1 --2- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0be4018750 0x7f0be401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:24.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.255+0000 7f0c0bfff700 1 --2- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0be4018750 0x7f0be401abe0 crc :-1 s=READY pgs=890 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:24.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.262+0000 7f0c12156700 1 -- 172.21.15.80:0/2872735561 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0c1206f0 con 0x7f0c0c13b3c0 2019-11-28T11:52:24.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.266+0000 7f0c10ef4700 1 --2- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c13b3c0 0x7f0c0c169ea0 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x7f0c04010720 tx=0x7f0c04010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.266+0000 7f0c097fa700 1 -- 172.21.15.80:0/2872735561 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0c04022230 con 0x7f0c0c13b3c0 2019-11-28T11:52:24.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.438+0000 7f0c12156700 1 -- 172.21.15.80:0/2872735561 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c0c120370 con 0x7f0c0c13b3c0 2019-11-28T11:52:24.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.438+0000 7f0c10ef4700 1 --2- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c13b3c0 0x7f0c0c169ea0 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x7f0c04010720 tx=0x7f0c04010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.438+0000 7f0c097fa700 1 -- 172.21.15.80:0/2872735561 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 133 v133) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f0c04022230 con 0x7f0c0c13b3c0 2019-11-28T11:52:24.492 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 133 2019-11-28T11:52:24.492 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:24.493 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":133,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":133,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:49:33.165935+0000","modified":"2019-11-28T11:52:24.080351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":169,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2019-11-28T11:52:24.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.440+0000 7f0c12156700 1 -- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0be4018750 msgr2=0x7f0be401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:24.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.440+0000 7f0c12156700 1 --2- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0be4018750 0x7f0be401abe0 crc :-1 s=READY pgs=890 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:24.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.440+0000 7f0c12156700 1 -- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c13b3c0 msgr2=0x7f0c0c169ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:24.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.440+0000 7f0c12156700 1 --2- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c13b3c0 0x7f0c0c169ea0 secure :-1 s=READY pgs=1295 cs=0 l=1 rx=0x7f0c04010720 tx=0x7f0c04010ac0).stop 2019-11-28T11:52:24.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.440+0000 7f0c12156700 1 -- 172.21.15.80:0/2872735561 shutdown_connections 2019-11-28T11:52:24.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.440+0000 7f0c12156700 1 --2- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c13b3c0 0x7f0c0c169ea0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:24.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.440+0000 7f0c12156700 1 --2- 172.21.15.80:0/2872735561 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0be4018750 0x7f0be401abe0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:24.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.441+0000 7f0c12156700 1 -- 172.21.15.80:0/2872735561 shutdown_connections 2019-11-28T11:52:24.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.441+0000 7f0c12156700 1 -- 172.21.15.80:0/2872735561 wait complete. 2019-11-28T11:52:24.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.441+0000 7f0c12156700 1 -- 172.21.15.80:0/2872735561 >> 172.21.15.80:0/2872735561 conn(0x7f0c0c105b00 msgr2=0x7f0c0c13e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:24.504 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:52:24.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.574+0000 7efcacb1b700 1 Processor -- start 2019-11-28T11:52:24.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.574+0000 7efcacb1b700 1 -- start start 2019-11-28T11:52:24.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.575+0000 7efcacb1b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efca806c0a0 0x7efca8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:24.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.575+0000 7efcacb1b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efca8072620 0x7efca8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:24.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.575+0000 7efcacb1b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca806db00 con 0x7efca80734e0 2019-11-28T11:52:24.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.575+0000 7efcacb1b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca806fd60 con 0x7efca8072620 2019-11-28T11:52:24.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.575+0000 7efcacb1b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca8070030 con 0x7efca806c0a0 2019-11-28T11:52:24.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.575+0000 7efca759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efca8072620 0x7efca8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:24.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.575+0000 7efca759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efca8072620 0x7efca8164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42822/0 (socket says 172.21.15.80:42822) 2019-11-28T11:52:24.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.575+0000 7efca759e700 1 -- 172.21.15.80:0/299857411 learned_addr learned my addr 172.21.15.80:0/299857411 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:24.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.575+0000 7efca6d9d700 1 --2- 172.21.15.80:0/299857411 >> v2:172.21.15.174:3300/0 conn(0x7efca806c0a0 0x7efca8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:24.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.575+0000 7efca759e700 1 -- 172.21.15.80:0/299857411 >> v2:172.21.15.174:3300/0 conn(0x7efca806c0a0 msgr2=0x7efca8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:24.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.575+0000 7efca759e700 1 --2- 172.21.15.80:0/299857411 >> v2:172.21.15.174:3300/0 conn(0x7efca806c0a0 0x7efca8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:24.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.575+0000 7efca759e700 1 -- 172.21.15.80:0/299857411 >> v1:172.21.15.174:6789/0 conn(0x7efca80734e0 legacy=0x7efca8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:24.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.575+0000 7efca759e700 1 -- 172.21.15.80:0/299857411 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80706c0 con 0x7efca8072620 2019-11-28T11:52:24.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.575+0000 7efca759e700 1 --2- 172.21.15.80:0/299857411 >> v2:172.21.15.80:3300/0 conn(0x7efca8072620 0x7efca8164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efca000f6b0 tx=0x7efca000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.575+0000 7efca759e700 1 --2- 172.21.15.80:0/299857411 >> v2:172.21.15.80:3300/0 conn(0x7efca8072620 0x7efca8164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efca000f6b0 tx=0x7efca000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.575+0000 7efca759e700 1 --2- 172.21.15.80:0/299857411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca8072620 0x7efca8164d70 secure :-1 s=READY pgs=2177 cs=0 l=1 rx=0x7efca000f6b0 tx=0x7efca000fa50).ready entity=mon.0 client_cookie=6edf6a14dfdf230b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:24.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.576+0000 7efca759e700 1 --2- 172.21.15.80:0/299857411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca8072620 0x7efca8164d70 secure :-1 s=THROTTLE_DONE pgs=2177 cs=0 l=1 rx=0x7efca000f6b0 tx=0x7efca000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.576+0000 7efca759e700 1 --2- 172.21.15.80:0/299857411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca8072620 0x7efca8164d70 secure :-1 s=THROTTLE_DONE pgs=2177 cs=0 l=1 rx=0x7efca000f6b0 tx=0x7efca000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.576+0000 7efca5d9b700 1 -- 172.21.15.80:0/299857411 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efca0000a70 con 0x7efca8072620 2019-11-28T11:52:24.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.576+0000 7efca759e700 1 --2- 172.21.15.80:0/299857411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca8072620 0x7efca8164d70 secure :-1 s=THROTTLE_DONE pgs=2177 cs=0 l=1 rx=0x7efca000f6b0 tx=0x7efca000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.576+0000 7efca5d9b700 1 -- 172.21.15.80:0/299857411 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca00010e0 con 0x7efca8072620 2019-11-28T11:52:24.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.576+0000 7efca5d9b700 1 -- 172.21.15.80:0/299857411 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efca00017b0 con 0x7efca8072620 2019-11-28T11:52:24.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.576+0000 7efcacb1b700 1 -- 172.21.15.80:0/299857411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca8072620 msgr2=0x7efca8164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:24.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.576+0000 7efcacb1b700 1 --2- 172.21.15.80:0/299857411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca8072620 0x7efca8164d70 secure :-1 s=READY pgs=2177 cs=0 l=1 rx=0x7efca000f6b0 tx=0x7efca000fa50).stop 2019-11-28T11:52:24.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.576+0000 7efcacb1b700 1 -- 172.21.15.80:0/299857411 shutdown_connections 2019-11-28T11:52:24.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.576+0000 7efcacb1b700 1 --2- 172.21.15.80:0/299857411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca8072620 0x7efca8164d70 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:24.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.576+0000 7efcacb1b700 1 --2- 172.21.15.80:0/299857411 >> v2:172.21.15.174:3300/0 conn(0x7efca806c0a0 0x7efca8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:24.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.576+0000 7efcacb1b700 1 -- 172.21.15.80:0/299857411 shutdown_connections 2019-11-28T11:52:24.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.576+0000 7efcacb1b700 1 -- 172.21.15.80:0/299857411 wait complete. 2019-11-28T11:52:24.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.576+0000 7efcacb1b700 1 -- 172.21.15.80:0/299857411 >> 172.21.15.80:0/299857411 conn(0x7efca8061cf0 msgr2=0x7efca8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:24.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.579+0000 7efcacb1b700 1 Processor -- start 2019-11-28T11:52:24.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.579+0000 7efcacb1b700 1 -- start start 2019-11-28T11:52:24.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efcacb1b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efca8104820 0x7efca810c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:24.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efcacb1b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efca810c890 0x7efca810b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:24.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efcacb1b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efca810b710 0x7efca810bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:24.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efcacb1b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca8108700 con 0x7efca810b710 2019-11-28T11:52:24.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efcacb1b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca81081f0 con 0x7efca810c890 2019-11-28T11:52:24.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efcacb1b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca8109130 con 0x7efca8104820 2019-11-28T11:52:24.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efca759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efca810b710 0x7efca810bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:24.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efca759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efca810b710 0x7efca810bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42830/0 (socket says 172.21.15.80:42830) 2019-11-28T11:52:24.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efca759e700 1 -- 172.21.15.80:0/1827026697 learned_addr learned my addr 172.21.15.80:0/1827026697 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:24.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efca6d9d700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efca8104820 0x7efca810c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:24.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efca659c700 1 --2- 172.21.15.80:0/1827026697 >> v2:172.21.15.174:3300/0 conn(0x7efca810c890 0x7efca810b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:24.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efca759e700 1 -- 172.21.15.80:0/1827026697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efca8104820 msgr2=0x7efca810c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:24.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efca759e700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efca8104820 0x7efca810c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:24.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efca759e700 1 -- 172.21.15.80:0/1827026697 >> v2:172.21.15.174:3300/0 conn(0x7efca810c890 msgr2=0x7efca810b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:24.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efca759e700 1 --2- 172.21.15.80:0/1827026697 >> v2:172.21.15.174:3300/0 conn(0x7efca810c890 0x7efca810b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:24.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efca759e700 1 -- 172.21.15.80:0/1827026697 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca8109a90 con 0x7efca810b710 2019-11-28T11:52:24.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efca759e700 1 --2- 172.21.15.80:0/1827026697 >> v2:172.21.15.80:3300/0 conn(0x7efca810b710 0x7efca810bb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efca00103e0 tx=0x7efca0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efca759e700 1 --2- 172.21.15.80:0/1827026697 >> v2:172.21.15.80:3300/0 conn(0x7efca810b710 0x7efca810bb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efca00103e0 tx=0x7efca0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efca759e700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810b710 0x7efca810bb70 secure :-1 s=READY pgs=2178 cs=0 l=1 rx=0x7efca00103e0 tx=0x7efca0010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:24.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efca759e700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810b710 0x7efca810bb70 secure :-1 s=THROTTLE_DONE pgs=2178 cs=0 l=1 rx=0x7efca00103e0 tx=0x7efca0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efca759e700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810b710 0x7efca810bb70 secure :-1 s=THROTTLE_DONE pgs=2178 cs=0 l=1 rx=0x7efca00103e0 tx=0x7efca0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efc9f7fe700 1 -- 172.21.15.80:0/1827026697 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efca0005930 con 0x7efca810b710 2019-11-28T11:52:24.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efca759e700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810b710 0x7efca810bb70 secure :-1 s=THROTTLE_DONE pgs=2178 cs=0 l=1 rx=0x7efca00103e0 tx=0x7efca0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efc9f7fe700 1 -- 172.21.15.80:0/1827026697 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca0005550 con 0x7efca810b710 2019-11-28T11:52:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efcacb1b700 1 -- 172.21.15.80:0/1827026697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca8109e10 con 0x7efca810b710 2019-11-28T11:52:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efc9f7fe700 1 -- 172.21.15.80:0/1827026697 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efca0005f10 con 0x7efca810b710 2019-11-28T11:52:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.580+0000 7efcacb1b700 1 -- 172.21.15.80:0/1827026697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca8109a90 con 0x7efca810b710 2019-11-28T11:52:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.581+0000 7efca759e700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810b710 0x7efca810bb70 secure :-1 s=THROTTLE_DONE pgs=2178 cs=0 l=1 rx=0x7efca00103e0 tx=0x7efca0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.581+0000 7efc9f7fe700 1 -- 172.21.15.80:0/1827026697 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efca0005550 con 0x7efca810b710 2019-11-28T11:52:24.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.581+0000 7efca759e700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810b710 0x7efca810bb70 secure :-1 s=THROTTLE_DONE pgs=2178 cs=0 l=1 rx=0x7efca00103e0 tx=0x7efca0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.581+0000 7efc9f7fe700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc80018730 0x7efc8001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:24.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.581+0000 7efc9f7fe700 1 -- 172.21.15.80:0/1827026697 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6235+0+0 (secure 0 0 0) 0x7efca0031990 con 0x7efca810b710 2019-11-28T11:52:24.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.582+0000 7efca6d9d700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc80018730 0x7efc8001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:24.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.582+0000 7efca6d9d700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc80018730 0x7efc8001abc0 crc :-1 s=READY pgs=891 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:24.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.589+0000 7efcacb1b700 1 -- 172.21.15.80:0/1827026697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca8109e10 con 0x7efca810b710 2019-11-28T11:52:24.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.593+0000 7efca759e700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810b710 0x7efca810bb70 secure :-1 s=THROTTLE_DONE pgs=2178 cs=0 l=1 rx=0x7efca00103e0 tx=0x7efca0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:24.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.593+0000 7efc9f7fe700 1 -- 172.21.15.80:0/1827026697 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efca0005340 con 0x7efca810b710 2019-11-28T11:52:24.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:24.767+0000 7efcacb1b700 1 -- 172.21.15.80:0/1827026697 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efca8109a90 con 0x7efca810b710 2019-11-28T11:52:25.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.091+0000 7efca759e700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810b710 0x7efca810bb70 secure :-1 s=THROTTLE_DONE pgs=2178 cs=0 l=1 rx=0x7efca00103e0 tx=0x7efca0010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:25.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.091+0000 7efc9f7fe700 1 -- 172.21.15.80:0/1827026697 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v134) v1 ==== 104+0+0 (secure 0 0 0) 0x7efca0005550 con 0x7efca810b710 2019-11-28T11:52:25.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.134+0000 7efcacb1b700 1 -- 172.21.15.80:0/1827026697 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc80018730 msgr2=0x7efc8001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:25.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.134+0000 7efcacb1b700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc80018730 0x7efc8001abc0 crc :-1 s=READY pgs=891 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:25.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.134+0000 7efcacb1b700 1 -- 172.21.15.80:0/1827026697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810b710 msgr2=0x7efca810bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:25.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.134+0000 7efcacb1b700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810b710 0x7efca810bb70 secure :-1 s=READY pgs=2178 cs=0 l=1 rx=0x7efca00103e0 tx=0x7efca0010290).stop 2019-11-28T11:52:25.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.134+0000 7efcacb1b700 1 -- 172.21.15.80:0/1827026697 shutdown_connections 2019-11-28T11:52:25.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.134+0000 7efcacb1b700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc80018730 0x7efc8001abc0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:25.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.134+0000 7efcacb1b700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efca810b710 0x7efca810bb70 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:25.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.134+0000 7efcacb1b700 1 --2- 172.21.15.80:0/1827026697 >> v2:172.21.15.174:3300/0 conn(0x7efca810c890 0x7efca810b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:25.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.134+0000 7efcacb1b700 1 --2- 172.21.15.80:0/1827026697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efca8104820 0x7efca810c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:25.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.134+0000 7efcacb1b700 1 -- 172.21.15.80:0/1827026697 shutdown_connections 2019-11-28T11:52:25.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.134+0000 7efcacb1b700 1 -- 172.21.15.80:0/1827026697 wait complete. 2019-11-28T11:52:25.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.134+0000 7efcacb1b700 1 -- 172.21.15.80:0/1827026697 >> 172.21.15.80:0/1827026697 conn(0x7efca813d620 msgr2=0x7efca813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:25.197 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:52:25.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.268+0000 7ff91c02e700 1 Processor -- start 2019-11-28T11:52:25.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.268+0000 7ff91c02e700 1 -- start start 2019-11-28T11:52:25.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.269+0000 7ff91c02e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff91415f100 0x7ff91406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:25.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.269+0000 7ff91c02e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff91406c2f0 0x7ff91406c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:25.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.269+0000 7ff91c02e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91406db60 con 0x7ff91415ed10 2019-11-28T11:52:25.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.269+0000 7ff91c02e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91406fe00 con 0x7ff91415f100 2019-11-28T11:52:25.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.269+0000 7ff91c02e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9140700d0 con 0x7ff91406c2f0 2019-11-28T11:52:25.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.269+0000 7ff919dca700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff91415f100 0x7ff91406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:25.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.269+0000 7ff91a5cb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff91415ed10 0x7ff914073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42150/0 (socket says 172.21.15.80:42150) 2019-11-28T11:52:25.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.269+0000 7ff91a5cb700 1 -- 172.21.15.80:0/1979145486 learned_addr learned my addr 172.21.15.80:0/1979145486 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:25.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.269+0000 7ff91adcc700 1 --2- 172.21.15.80:0/1979145486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff91406c2f0 0x7ff91406c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:25.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.269+0000 7ff9195c9700 1 -- 172.21.15.80:0/1979145486 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770046019 0 0) 0x7ff8fc001150 con 0x7ff91415ed10 2019-11-28T11:52:25.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.269+0000 7ff9195c9700 1 -- 172.21.15.80:0/1979145486 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff900002e80 con 0x7ff91415ed10 2019-11-28T11:52:25.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.269+0000 7ff919dca700 1 -- 172.21.15.80:0/1979145486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff91406c2f0 msgr2=0x7ff91406c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:25.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.269+0000 7ff919dca700 1 --2- 172.21.15.80:0/1979145486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff91406c2f0 0x7ff91406c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:25.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.269+0000 7ff919dca700 1 -- 172.21.15.80:0/1979145486 >> v1:172.21.15.80:6789/0 conn(0x7ff91415ed10 legacy=0x7ff914073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:25.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.269+0000 7ff919dca700 1 -- 172.21.15.80:0/1979145486 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff914070760 con 0x7ff91415f100 2019-11-28T11:52:25.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.269+0000 7ff91adcc700 1 --2- 172.21.15.80:0/1979145486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff91406c2f0 0x7ff91406c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:52:25.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.270+0000 7ff919dca700 1 --2- 172.21.15.80:0/1979145486 >> v2:172.21.15.80:3300/0 conn(0x7ff91415f100 0x7ff91406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff90400af50 tx=0x7ff90400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:25.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.270+0000 7ff919dca700 1 --2- 172.21.15.80:0/1979145486 >> v2:172.21.15.80:3300/0 conn(0x7ff91415f100 0x7ff91406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff90400af50 tx=0x7ff90400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:25.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.270+0000 7ff919dca700 1 --2- 172.21.15.80:0/1979145486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff91415f100 0x7ff91406bdb0 secure :-1 s=READY pgs=2180 cs=0 l=1 rx=0x7ff90400af50 tx=0x7ff90400b760).ready entity=mon.0 client_cookie=6646a38036177427 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:25.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.270+0000 7ff919dca700 1 --2- 172.21.15.80:0/1979145486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff91415f100 0x7ff91406bdb0 secure :-1 s=THROTTLE_DONE pgs=2180 cs=0 l=1 rx=0x7ff90400af50 tx=0x7ff90400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:25.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.270+0000 7ff9195c9700 1 -- 172.21.15.80:0/1979145486 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff904007210 con 0x7ff91415f100 2019-11-28T11:52:25.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.270+0000 7ff919dca700 1 --2- 172.21.15.80:0/1979145486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff91415f100 0x7ff91406bdb0 secure :-1 s=THROTTLE_DONE pgs=2180 cs=0 l=1 rx=0x7ff90400af50 tx=0x7ff90400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:25.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.270+0000 7ff919dca700 1 --2- 172.21.15.80:0/1979145486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff91415f100 0x7ff91406bdb0 secure :-1 s=THROTTLE_DONE pgs=2180 cs=0 l=1 rx=0x7ff90400af50 tx=0x7ff90400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:25.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.270+0000 7ff9195c9700 1 -- 172.21.15.80:0/1979145486 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9040099b0 con 0x7ff91415f100 2019-11-28T11:52:25.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.270+0000 7ff9195c9700 1 -- 172.21.15.80:0/1979145486 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff90400a080 con 0x7ff91415f100 2019-11-28T11:52:25.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.270+0000 7ff91c02e700 1 -- 172.21.15.80:0/1979145486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff91415f100 msgr2=0x7ff91406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:25.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.270+0000 7ff91c02e700 1 --2- 172.21.15.80:0/1979145486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff91415f100 0x7ff91406bdb0 secure :-1 s=READY pgs=2180 cs=0 l=1 rx=0x7ff90400af50 tx=0x7ff90400b760).stop 2019-11-28T11:52:25.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.271+0000 7ff91c02e700 1 -- 172.21.15.80:0/1979145486 shutdown_connections 2019-11-28T11:52:25.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.271+0000 7ff91c02e700 1 --2- 172.21.15.80:0/1979145486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff91406c2f0 0x7ff91406c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:25.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.271+0000 7ff91c02e700 1 --2- 172.21.15.80:0/1979145486 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff91415f100 0x7ff91406bdb0 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:25.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.271+0000 7ff91c02e700 1 -- 172.21.15.80:0/1979145486 shutdown_connections 2019-11-28T11:52:25.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.271+0000 7ff91c02e700 1 -- 172.21.15.80:0/1979145486 wait complete. 2019-11-28T11:52:25.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.271+0000 7ff91c02e700 1 -- 172.21.15.80:0/1979145486 >> 172.21.15.80:0/1979145486 conn(0x7ff914061d20 msgr2=0x7ff9140641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:25.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.273+0000 7ff91c02e700 1 Processor -- start 2019-11-28T11:52:25.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.273+0000 7ff91c02e700 1 -- start start 2019-11-28T11:52:25.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.274+0000 7ff91c02e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff91410ed60 0x7ff91410f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:25.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.274+0000 7ff91c02e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff91410f730 0x7ff914167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:25.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.274+0000 7ff91c02e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91410c250 con 0x7ff91410e970 2019-11-28T11:52:25.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.274+0000 7ff91c02e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91410e430 con 0x7ff91410f730 2019-11-28T11:52:25.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.274+0000 7ff91c02e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff914105860 con 0x7ff91410ed60 2019-11-28T11:52:25.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.274+0000 7ff91a5cb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff91410e970 0x7ff9141087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42156/0 (socket says 172.21.15.80:42156) 2019-11-28T11:52:25.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.274+0000 7ff91a5cb700 1 -- 172.21.15.80:0/2475072455 learned_addr learned my addr 172.21.15.80:0/2475072455 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:25.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.274+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470163147 0 0) 0x7ff8fc000940 con 0x7ff91410e970 2019-11-28T11:52:25.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.274+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8f8002e80 con 0x7ff91410e970 2019-11-28T11:52:25.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.274+0000 7ff919dca700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff91410ed60 0x7ff91410f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:25.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.274+0000 7ff91adcc700 1 --2- 172.21.15.80:0/2475072455 >> v2:172.21.15.174:3300/0 conn(0x7ff91410f730 0x7ff914167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:25.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1351473390 0 0) 0x7ff8fc001230 con 0x7ff91410e970 2019-11-28T11:52:25.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff8f80032e0 con 0x7ff91410e970 2019-11-28T11:52:25.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff8fc0017c0 con 0x7ff91410e970 2019-11-28T11:52:25.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff91410ed60 msgr2=0x7ff91410f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:25.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff91410ed60 0x7ff91410f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:25.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 >> v2:172.21.15.174:3300/0 conn(0x7ff91410f730 msgr2=0x7ff914167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:25.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 --2- 172.21.15.80:0/2475072455 >> v2:172.21.15.174:3300/0 conn(0x7ff91410f730 0x7ff914167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:25.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 >> v1:172.21.15.80:6789/0 conn(0x7ff91410e970 legacy=0x7ff9141087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:25.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8f8003370 0x7ff8f8003780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:25.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f8003cc0 0x7ff8f8004160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:25.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8f8004800 0x7ff8f8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:25.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f800dd70 con 0x7ff8f8003cc0 2019-11-28T11:52:25.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f800df30 con 0x7ff8f8004800 2019-11-28T11:52:25.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f800e130 con 0x7ff8f8003370 2019-11-28T11:52:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff919dca700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f8003cc0 0x7ff8f8004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff91adcc700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8f8004800 0x7ff8f8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff91a5cb700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8f8003370 0x7ff8f8003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff919dca700 1 -- 172.21.15.80:0/2475072455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8f8003370 msgr2=0x7ff8f8003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff919dca700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8f8003370 0x7ff8f8003780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:25.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff919dca700 1 -- 172.21.15.80:0/2475072455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8f8004800 msgr2=0x7ff8f8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:25.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff919dca700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8f8004800 0x7ff8f8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:25.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff919dca700 1 -- 172.21.15.80:0/2475072455 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f800e3e0 con 0x7ff8f8003cc0 2019-11-28T11:52:25.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff91c02e700 1 -- 172.21.15.80:0/2475072455 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff914106270 con 0x7ff8f8003cc0 2019-11-28T11:52:25.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff919dca700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f8003cc0 0x7ff8f8004160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff904010350 tx=0x7ff904010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:25.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff91c02e700 1 -- 172.21.15.80:0/2475072455 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff914105ef0 con 0x7ff8f8003cc0 2019-11-28T11:52:25.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff919dca700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f8003cc0 0x7ff8f8004160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff904010350 tx=0x7ff904010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:25.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff919dca700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f8003cc0 0x7ff8f8004160 secure :-1 s=READY pgs=2182 cs=0 l=1 rx=0x7ff904010350 tx=0x7ff904010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:25.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff919dca700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f8003cc0 0x7ff8f8004160 secure :-1 s=THROTTLE_DONE pgs=2182 cs=0 l=1 rx=0x7ff904010350 tx=0x7ff904010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:25.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff904000940 con 0x7ff8f8003cc0 2019-11-28T11:52:25.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff919dca700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f8003cc0 0x7ff8f8004160 secure :-1 s=THROTTLE_DONE pgs=2182 cs=0 l=1 rx=0x7ff904010350 tx=0x7ff904010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:25.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff919dca700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f8003cc0 0x7ff8f8004160 secure :-1 s=THROTTLE_DONE pgs=2182 cs=0 l=1 rx=0x7ff904010350 tx=0x7ff904010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:25.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff904009770 con 0x7ff8f8003cc0 2019-11-28T11:52:25.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.275+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff904009d80 con 0x7ff8f8003cc0 2019-11-28T11:52:25.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.276+0000 7ff919dca700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f8003cc0 0x7ff8f8004160 secure :-1 s=THROTTLE_DONE pgs=2182 cs=0 l=1 rx=0x7ff904010350 tx=0x7ff904010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:25.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.276+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff904009960 con 0x7ff8f8003cc0 2019-11-28T11:52:25.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.276+0000 7ff919dca700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f8003cc0 0x7ff8f8004160 secure :-1 s=THROTTLE_DONE pgs=2182 cs=0 l=1 rx=0x7ff904010350 tx=0x7ff904010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:25.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.276+0000 7ff912ffd700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8f8022d00 0x7ff8f8025130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:25.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.276+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6235+0+0 (secure 0 0 0) 0x7ff904031bb0 con 0x7ff8f8003cc0 2019-11-28T11:52:25.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.276+0000 7ff91a5cb700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8f8022d00 0x7ff8f8025130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:25.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.276+0000 7ff91a5cb700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8f8022d00 0x7ff8f8025130 crc :-1 s=READY pgs=892 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:25.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.283+0000 7ff91c02e700 1 -- 172.21.15.80:0/2475072455 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff914106270 con 0x7ff8f8003cc0 2019-11-28T11:52:25.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.287+0000 7ff919dca700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f8003cc0 0x7ff8f8004160 secure :-1 s=THROTTLE_DONE pgs=2182 cs=0 l=1 rx=0x7ff904010350 tx=0x7ff904010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:25.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.287+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff90400b3d0 con 0x7ff8f8003cc0 2019-11-28T11:52:25.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:25.453+0000 7ff91c02e700 1 -- 172.21.15.80:0/2475072455 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff914105ef0 con 0x7ff8f8003cc0 2019-11-28T11:52:26.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.095+0000 7ff919dca700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f8003cc0 0x7ff8f8004160 secure :-1 s=THROTTLE_DONE pgs=2182 cs=0 l=1 rx=0x7ff904010350 tx=0x7ff904010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:26.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.095+0000 7ff912ffd700 1 -- 172.21.15.80:0/2475072455 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v170) v1 ==== 185+0+0 (secure 0 0 0) 0x7ff9040099d0 con 0x7ff8f8003cc0 2019-11-28T11:52:26.171 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:52:26.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.120+0000 7ff91c02e700 1 -- 172.21.15.80:0/2475072455 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8f8022d00 msgr2=0x7ff8f8025130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:26.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.120+0000 7ff91c02e700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff8f8022d00 0x7ff8f8025130 crc :-1 s=READY pgs=892 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:26.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.120+0000 7ff91c02e700 1 -- 172.21.15.80:0/2475072455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f8003cc0 msgr2=0x7ff8f8004160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:26.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.120+0000 7ff91c02e700 1 --2- 172.21.15.80:0/2475072455 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8f8003cc0 0x7ff8f8004160 secure :-1 s=READY pgs=2182 cs=0 l=1 rx=0x7ff904010350 tx=0x7ff904010280).stop 2019-11-28T11:52:26.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.120+0000 7ff91adcc700 1 -- 172.21.15.80:0/2475072455 reap_dead start 2019-11-28T11:52:26.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.120+0000 7ff91c02e700 1 -- 172.21.15.80:0/2475072455 shutdown_connections 2019-11-28T11:52:26.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.120+0000 7ff91c02e700 1 -- 172.21.15.80:0/2475072455 shutdown_connections 2019-11-28T11:52:26.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.120+0000 7ff91c02e700 1 -- 172.21.15.80:0/2475072455 wait complete. 2019-11-28T11:52:26.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.120+0000 7ff91c02e700 1 -- 172.21.15.80:0/2475072455 >> 172.21.15.80:0/2475072455 conn(0x7ff91415e2d0 msgr2=0x7ff914147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:26.183 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:52:26.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.253+0000 7f80ba80e700 1 Processor -- start 2019-11-28T11:52:26.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.253+0000 7f80ba80e700 1 -- start start 2019-11-28T11:52:26.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.254+0000 7f80ba80e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b415f100 0x7f80b406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:26.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.254+0000 7f80ba80e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b406db60 con 0x7f80b406c2f0 2019-11-28T11:52:26.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.254+0000 7f80ba80e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b406e060 con 0x7f80b415ed10 2019-11-28T11:52:26.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.254+0000 7f80ba80e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b406fe00 con 0x7f80b415f100 2019-11-28T11:52:26.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.254+0000 7f80b95ac700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f80b406c2f0 0x7f80b406c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42172/0 (socket says 172.21.15.80:42172) 2019-11-28T11:52:26.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.254+0000 7f80b95ac700 1 -- 172.21.15.80:0/1261947375 learned_addr learned my addr 172.21.15.80:0/1261947375 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:26.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.254+0000 7f80b3fff700 1 --2- 172.21.15.80:0/1261947375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b415f100 0x7f80b406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:26.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.254+0000 7f80b37fe700 1 -- 172.21.15.80:0/1261947375 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197542747 0 0) 0x7f80ac001150 con 0x7f80b406c2f0 2019-11-28T11:52:26.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.254+0000 7f80b37fe700 1 -- 172.21.15.80:0/1261947375 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a0002e80 con 0x7f80b406c2f0 2019-11-28T11:52:26.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.254+0000 7f80b37fe700 1 -- 172.21.15.80:0/1261947375 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819565921 0 0) 0x7f80a4001400 con 0x7f80b415ed10 2019-11-28T11:52:26.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.254+0000 7f80b37fe700 1 -- 172.21.15.80:0/1261947375 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a00030b0 con 0x7f80b415ed10 2019-11-28T11:52:26.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.254+0000 7f80b37fe700 1 -- 172.21.15.80:0/1261947375 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1423609243 0 0) 0x7f80ac001130 con 0x7f80b406c2f0 2019-11-28T11:52:26.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.254+0000 7f80b3fff700 1 -- 172.21.15.80:0/1261947375 >> v1:172.21.15.174:6789/0 conn(0x7f80b415ed10 legacy=0x7f80b4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:26.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.254+0000 7f80b3fff700 1 -- 172.21.15.80:0/1261947375 >> v1:172.21.15.80:6789/0 conn(0x7f80b406c2f0 legacy=0x7f80b406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:26.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.254+0000 7f80b3fff700 1 -- 172.21.15.80:0/1261947375 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b4070760 con 0x7f80b415f100 2019-11-28T11:52:26.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.254+0000 7f80b3fff700 1 --2- 172.21.15.80:0/1261947375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b415f100 0x7f80b406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f809c00af50 tx=0x7f809c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.255+0000 7f80b3fff700 1 --2- 172.21.15.80:0/1261947375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b415f100 0x7f80b406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f809c00af50 tx=0x7f809c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.255+0000 7f80b3fff700 1 --2- 172.21.15.80:0/1261947375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b415f100 0x7f80b406bdb0 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7f809c00af50 tx=0x7f809c00b760).ready entity=mon.2 client_cookie=615ef6f93dd67b19 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.255+0000 7f80b3fff700 1 --2- 172.21.15.80:0/1261947375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b415f100 0x7f80b406bdb0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f809c00af50 tx=0x7f809c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.255+0000 7f80b37fe700 1 -- 172.21.15.80:0/1261947375 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f809c000960 con 0x7f80b415f100 2019-11-28T11:52:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.255+0000 7f80b3fff700 1 --2- 172.21.15.80:0/1261947375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b415f100 0x7f80b406bdb0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f809c00af50 tx=0x7f809c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:26.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.255+0000 7f80b3fff700 1 --2- 172.21.15.80:0/1261947375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b415f100 0x7f80b406bdb0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f809c00af50 tx=0x7f809c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:26.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.255+0000 7f80b37fe700 1 -- 172.21.15.80:0/1261947375 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c009860 con 0x7f80b415f100 2019-11-28T11:52:26.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.255+0000 7f80b37fe700 1 -- 172.21.15.80:0/1261947375 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f809c009f30 con 0x7f80b415f100 2019-11-28T11:52:26.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.255+0000 7f80ba80e700 1 -- 172.21.15.80:0/1261947375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b415f100 msgr2=0x7f80b406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:26.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.255+0000 7f80ba80e700 1 --2- 172.21.15.80:0/1261947375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b415f100 0x7f80b406bdb0 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7f809c00af50 tx=0x7f809c00b760).stop 2019-11-28T11:52:26.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.255+0000 7f80ba80e700 1 -- 172.21.15.80:0/1261947375 shutdown_connections 2019-11-28T11:52:26.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.255+0000 7f80ba80e700 1 --2- 172.21.15.80:0/1261947375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b415f100 0x7f80b406bdb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:26.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.255+0000 7f80ba80e700 1 -- 172.21.15.80:0/1261947375 shutdown_connections 2019-11-28T11:52:26.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.255+0000 7f80ba80e700 1 -- 172.21.15.80:0/1261947375 wait complete. 2019-11-28T11:52:26.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.255+0000 7f80ba80e700 1 -- 172.21.15.80:0/1261947375 >> 172.21.15.80:0/1261947375 conn(0x7f80b4061d20 msgr2=0x7f80b40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:26.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.258+0000 7f80ba80e700 1 Processor -- start 2019-11-28T11:52:26.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.258+0000 7f80ba80e700 1 -- start start 2019-11-28T11:52:26.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.259+0000 7f80ba80e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4167d80 0x7f80b416a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:26.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.259+0000 7f80ba80e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b4148e00 con 0x7f80b4148320 2019-11-28T11:52:26.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.259+0000 7f80ba80e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b4108b10 con 0x7f80b41079b0 2019-11-28T11:52:26.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.259+0000 7f80ba80e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b413aa20 con 0x7f80b4167d80 2019-11-28T11:52:26.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.259+0000 7f80b8dab700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f80b4148320 0x7f80b410ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42174/0 (socket says 172.21.15.80:42174) 2019-11-28T11:52:26.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.259+0000 7f80b8dab700 1 -- 172.21.15.80:0/3416247405 learned_addr learned my addr 172.21.15.80:0/3416247405 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:26.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.259+0000 7f80b95ac700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4167d80 0x7f80b416a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:26.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.259+0000 7f80b17fa700 1 -- 172.21.15.80:0/3416247405 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641981517 0 0) 0x7f80a40015c0 con 0x7f80b4148320 2019-11-28T11:52:26.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.259+0000 7f80b17fa700 1 -- 172.21.15.80:0/3416247405 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8098002e80 con 0x7f80b4148320 2019-11-28T11:52:26.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.259+0000 7f80b17fa700 1 -- 172.21.15.80:0/3416247405 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428407957 0 0) 0x7f809c000940 con 0x7f80b41079b0 2019-11-28T11:52:26.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.259+0000 7f80b17fa700 1 -- 172.21.15.80:0/3416247405 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80980030b0 con 0x7f80b41079b0 2019-11-28T11:52:26.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.259+0000 7f80b95ac700 1 -- 172.21.15.80:0/3416247405 >> v1:172.21.15.174:6789/0 conn(0x7f80b41079b0 legacy=0x7f80b4107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:26.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.259+0000 7f80b95ac700 1 -- 172.21.15.80:0/3416247405 >> v1:172.21.15.80:6789/0 conn(0x7f80b4148320 legacy=0x7f80b410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:26.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.259+0000 7f80b17fa700 1 -- 172.21.15.80:0/3416247405 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3998184405 0 0) 0x7f80a40017c0 con 0x7f80b4148320 2019-11-28T11:52:26.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.259+0000 7f80b95ac700 1 -- 172.21.15.80:0/3416247405 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b410c490 con 0x7f80b4167d80 2019-11-28T11:52:26.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.259+0000 7f80b95ac700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4167d80 0x7f80b416a180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80ac010370 tx=0x7f80ac010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:26.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.260+0000 7f80b95ac700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4167d80 0x7f80b416a180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80ac010370 tx=0x7f80ac010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:26.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.260+0000 7f80b95ac700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4167d80 0x7f80b416a180 secure :-1 s=READY pgs=311 cs=0 l=1 rx=0x7f80ac010370 tx=0x7f80ac010710).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:26.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.260+0000 7f80b95ac700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4167d80 0x7f80b416a180 secure :-1 s=THROTTLE_DONE pgs=311 cs=0 l=1 rx=0x7f80ac010370 tx=0x7f80ac010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:26.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.260+0000 7f80b17fa700 1 -- 172.21.15.80:0/3416247405 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80ac000ef0 con 0x7f80b4167d80 2019-11-28T11:52:26.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.260+0000 7f80b95ac700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4167d80 0x7f80b416a180 secure :-1 s=THROTTLE_DONE pgs=311 cs=0 l=1 rx=0x7f80ac010370 tx=0x7f80ac010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:26.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.260+0000 7f80b17fa700 1 -- 172.21.15.80:0/3416247405 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac004430 con 0x7f80b4167d80 2019-11-28T11:52:26.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.260+0000 7f80b95ac700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4167d80 0x7f80b416a180 secure :-1 s=THROTTLE_DONE pgs=311 cs=0 l=1 rx=0x7f80ac010370 tx=0x7f80ac010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:26.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.260+0000 7f80ba80e700 1 -- 172.21.15.80:0/3416247405 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b410c810 con 0x7f80b4167d80 2019-11-28T11:52:26.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.260+0000 7f80b17fa700 1 -- 172.21.15.80:0/3416247405 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80ac004620 con 0x7f80b4167d80 2019-11-28T11:52:26.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.260+0000 7f80ba80e700 1 -- 172.21.15.80:0/3416247405 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b410c490 con 0x7f80b4167d80 2019-11-28T11:52:26.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.260+0000 7f80b95ac700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4167d80 0x7f80b416a180 secure :-1 s=THROTTLE_DONE pgs=311 cs=0 l=1 rx=0x7f80ac010370 tx=0x7f80ac010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:26.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.260+0000 7f80b17fa700 1 -- 172.21.15.80:0/3416247405 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f80ac004620 con 0x7f80b4167d80 2019-11-28T11:52:26.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.260+0000 7f80b95ac700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4167d80 0x7f80b416a180 secure :-1 s=THROTTLE_DONE pgs=311 cs=0 l=1 rx=0x7f80ac010370 tx=0x7f80ac010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:26.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.261+0000 7f80b17fa700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8098018750 0x7f809801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:26.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.261+0000 7f80b17fa700 1 -- 172.21.15.80:0/3416247405 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5797+0+0 (secure 0 0 0) 0x7f80ac031a80 con 0x7f80b4167d80 2019-11-28T11:52:26.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.261+0000 7f80b8dab700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8098018750 0x7f809801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:26.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.261+0000 7f80b8dab700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8098018750 0x7f809801abe0 crc :-1 s=READY pgs=893 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:26.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.268+0000 7f80ba80e700 1 -- 172.21.15.80:0/3416247405 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b410c810 con 0x7f80b4167d80 2019-11-28T11:52:26.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.272+0000 7f80b95ac700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4167d80 0x7f80b416a180 secure :-1 s=THROTTLE_DONE pgs=311 cs=0 l=1 rx=0x7f80ac010370 tx=0x7f80ac010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:26.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.272+0000 7f80b17fa700 1 -- 172.21.15.80:0/3416247405 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f80ac000940 con 0x7f80b4167d80 2019-11-28T11:52:26.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:26.439+0000 7f80ba80e700 1 -- 172.21.15.80:0/3416247405 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f80b410c490 con 0x7f80b4167d80 2019-11-28T11:52:27.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.100+0000 7f80b95ac700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4167d80 0x7f80b416a180 secure :-1 s=THROTTLE_DONE pgs=311 cs=0 l=1 rx=0x7f80ac010370 tx=0x7f80ac010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:27.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.100+0000 7f80b17fa700 1 -- 172.21.15.80:0/3416247405 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v171) v1 ==== 173+0+0 (secure 0 0 0) 0x7f80ac01f8a0 con 0x7f80b4167d80 2019-11-28T11:52:27.157 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:52:27.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.106+0000 7f80ba80e700 1 -- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8098018750 msgr2=0x7f809801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:27.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.106+0000 7f80ba80e700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8098018750 0x7f809801abe0 crc :-1 s=READY pgs=893 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:27.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.106+0000 7f80ba80e700 1 -- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4167d80 msgr2=0x7f80b416a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:27.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.106+0000 7f80ba80e700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4167d80 0x7f80b416a180 secure :-1 s=READY pgs=311 cs=0 l=1 rx=0x7f80ac010370 tx=0x7f80ac010710).stop 2019-11-28T11:52:27.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.107+0000 7f80ba80e700 1 -- 172.21.15.80:0/3416247405 shutdown_connections 2019-11-28T11:52:27.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.107+0000 7f80ba80e700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4167d80 0x7f80b416a180 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:27.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.107+0000 7f80ba80e700 1 --2- 172.21.15.80:0/3416247405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8098018750 0x7f809801abe0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:27.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.107+0000 7f80ba80e700 1 -- 172.21.15.80:0/3416247405 shutdown_connections 2019-11-28T11:52:27.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.107+0000 7f80ba80e700 1 -- 172.21.15.80:0/3416247405 wait complete. 2019-11-28T11:52:27.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.107+0000 7f80ba80e700 1 -- 172.21.15.80:0/3416247405 >> 172.21.15.80:0/3416247405 conn(0x7f80b415e2d0 msgr2=0x7f80b4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:27.172 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:52:27.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.243+0000 7f17232fc700 1 Processor -- start 2019-11-28T11:52:27.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.243+0000 7f17232fc700 1 -- start start 2019-11-28T11:52:27.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.244+0000 7f17232fc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f171c06c0a0 0x7f171c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.244+0000 7f17232fc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f171c06db00 con 0x7f171c0734e0 2019-11-28T11:52:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.244+0000 7f17232fc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f171c06e000 con 0x7f171c072620 2019-11-28T11:52:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.244+0000 7f17232fc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f171c06fd60 con 0x7f171c06c0a0 2019-11-28T11:52:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.244+0000 7f1721098700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f171c0734e0 0x7f171c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42186/0 (socket says 172.21.15.80:42186) 2019-11-28T11:52:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.244+0000 7f1721098700 1 -- 172.21.15.80:0/2813299607 learned_addr learned my addr 172.21.15.80:0/2813299607 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1721899700 1 --2- 172.21.15.80:0/2813299607 >> v2:172.21.15.174:3300/0 conn(0x7f171c06c0a0 0x7f171c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1720897700 1 -- 172.21.15.80:0/2813299607 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117925102 0 0) 0x7f1710001070 con 0x7f171c0734e0 2019-11-28T11:52:27.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1720897700 1 -- 172.21.15.80:0/2813299607 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1704002e80 con 0x7f171c0734e0 2019-11-28T11:52:27.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1720897700 1 -- 172.21.15.80:0/2813299607 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2710577111 0 0) 0x7f1710001050 con 0x7f171c0734e0 2019-11-28T11:52:27.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1720897700 1 -- 172.21.15.80:0/2813299607 >> v2:172.21.15.174:3300/0 conn(0x7f171c06c0a0 msgr2=0x7f171c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:27.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1720897700 1 --2- 172.21.15.80:0/2813299607 >> v2:172.21.15.174:3300/0 conn(0x7f171c06c0a0 0x7f171c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:27.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1720897700 1 -- 172.21.15.80:0/2813299607 >> v1:172.21.15.174:6789/0 conn(0x7f171c072620 legacy=0x7f171c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:27.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1720897700 1 -- 172.21.15.80:0/2813299607 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c0706c0 con 0x7f171c0734e0 2019-11-28T11:52:27.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1720897700 1 -- 172.21.15.80:0/2813299607 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f1710001580 con 0x7f171c0734e0 2019-11-28T11:52:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1720897700 1 -- 172.21.15.80:0/2813299607 >> v1:172.21.15.80:6789/0 conn(0x7f171c0734e0 legacy=0x7f171c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1720897700 1 --2- 172.21.15.80:0/2813299607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1704003ab0 0x7f1704005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1720897700 1 --2- 172.21.15.80:0/2813299607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1704006690 0x7f1704008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1720897700 1 --2- 172.21.15.80:0/2813299607 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1704009380 0x7f170400b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1720897700 1 -- 172.21.15.80:0/2813299607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170400c000 con 0x7f1704006690 2019-11-28T11:52:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1720897700 1 -- 172.21.15.80:0/2813299607 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1704050200 con 0x7f1704003ab0 2019-11-28T11:52:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1720897700 1 -- 172.21.15.80:0/2813299607 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1704050430 con 0x7f1704009380 2019-11-28T11:52:27.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1721098700 1 --2- 172.21.15.80:0/2813299607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1704006690 0x7f1704008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:27.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1721899700 1 --2- 172.21.15.80:0/2813299607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1704003ab0 0x7f1704005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:27.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f172209a700 1 --2- 172.21.15.80:0/2813299607 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1704009380 0x7f170400b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:27.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1721098700 1 -- 172.21.15.80:0/2813299607 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1704009380 msgr2=0x7f170400b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:27.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1721098700 1 --2- 172.21.15.80:0/2813299607 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1704009380 0x7f170400b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:27.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1721098700 1 -- 172.21.15.80:0/2813299607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1704003ab0 msgr2=0x7f1704005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1721098700 1 --2- 172.21.15.80:0/2813299607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1704003ab0 0x7f1704005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f172209a700 1 -- 172.21.15.80:0/2813299607 reap_dead start 2019-11-28T11:52:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1721098700 1 -- 172.21.15.80:0/2813299607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17040506e0 con 0x7f1704006690 2019-11-28T11:52:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.245+0000 7f1721098700 1 --2- 172.21.15.80:0/2813299607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1704006690 0x7f1704008b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f171000f890 tx=0x7f171000f710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.246+0000 7f1721098700 1 --2- 172.21.15.80:0/2813299607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1704006690 0x7f1704008b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f171000f890 tx=0x7f171000f710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.246+0000 7f1721098700 1 --2- 172.21.15.80:0/2813299607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1704006690 0x7f1704008b20 secure :-1 s=READY pgs=2186 cs=0 l=1 rx=0x7f171000f890 tx=0x7f171000f710).ready entity=mon.0 client_cookie=d4cb72599e570a2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.246+0000 7f1721098700 1 --2- 172.21.15.80:0/2813299607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1704006690 0x7f1704008b20 secure :-1 s=THROTTLE_DONE pgs=2186 cs=0 l=1 rx=0x7f171000f890 tx=0x7f171000f710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:27.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.246+0000 7f1721098700 1 --2- 172.21.15.80:0/2813299607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1704006690 0x7f1704008b20 secure :-1 s=THROTTLE_DONE pgs=2186 cs=0 l=1 rx=0x7f171000f890 tx=0x7f171000f710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:27.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.246+0000 7f1720897700 1 -- 172.21.15.80:0/2813299607 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1710001050 con 0x7f1704006690 2019-11-28T11:52:27.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.246+0000 7f1721098700 1 --2- 172.21.15.80:0/2813299607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1704006690 0x7f1704008b20 secure :-1 s=THROTTLE_DONE pgs=2186 cs=0 l=1 rx=0x7f171000f890 tx=0x7f171000f710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:27.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.246+0000 7f1720897700 1 -- 172.21.15.80:0/2813299607 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1710004290 con 0x7f1704006690 2019-11-28T11:52:27.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.246+0000 7f1720897700 1 -- 172.21.15.80:0/2813299607 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1710004960 con 0x7f1704006690 2019-11-28T11:52:27.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.246+0000 7f17232fc700 1 -- 172.21.15.80:0/2813299607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1704006690 msgr2=0x7f1704008b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:27.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.246+0000 7f17232fc700 1 --2- 172.21.15.80:0/2813299607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1704006690 0x7f1704008b20 secure :-1 s=READY pgs=2186 cs=0 l=1 rx=0x7f171000f890 tx=0x7f171000f710).stop 2019-11-28T11:52:27.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.246+0000 7f17232fc700 1 -- 172.21.15.80:0/2813299607 shutdown_connections 2019-11-28T11:52:27.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.246+0000 7f17232fc700 1 --2- 172.21.15.80:0/2813299607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1704006690 0x7f1704008b20 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:27.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.246+0000 7f17232fc700 1 -- 172.21.15.80:0/2813299607 shutdown_connections 2019-11-28T11:52:27.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.247+0000 7f17232fc700 1 -- 172.21.15.80:0/2813299607 wait complete. 2019-11-28T11:52:27.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.247+0000 7f17232fc700 1 -- 172.21.15.80:0/2813299607 >> 172.21.15.80:0/2813299607 conn(0x7f171c061cf0 msgr2=0x7f171c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:27.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.249+0000 7f17232fc700 1 Processor -- start 2019-11-28T11:52:27.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.249+0000 7f17232fc700 1 -- start start 2019-11-28T11:52:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f17232fc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f171c077040 0x7f171c1574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f17232fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f171c157a00 0x7f171c074a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f17232fc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f171c140820 con 0x7f171c074f50 2019-11-28T11:52:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f17232fc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f171c137110 con 0x7f171c077040 2019-11-28T11:52:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f17232fc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171c1373e0 con 0x7f171c157a00 2019-11-28T11:52:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f1721098700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f171c157a00 0x7f171c074a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f1721899700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f171c077040 0x7f171c1574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f1721899700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f171c077040 0x7f171c1574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:57764/0 (socket says 172.21.15.80:57764) 2019-11-28T11:52:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f172209a700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f171c074f50 0x7f171c156340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:57740/0 (socket says 172.21.15.80:57740) 2019-11-28T11:52:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f1721098700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f171c157a00 0x7f171c074a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:45142/0 (socket says 172.21.15.80:45142) 2019-11-28T11:52:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f1721899700 1 -- 172.21.15.80:0/3150755189 learned_addr learned my addr 172.21.15.80:0/3150755189 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f1721899700 1 -- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f171c157a00 msgr2=0x7f171c074a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f1721899700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f171c157a00 0x7f171c074a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f1721899700 1 -- 172.21.15.80:0/3150755189 >> v1:172.21.15.174:6789/0 conn(0x7f171c074f50 legacy=0x7f171c156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f1721899700 1 -- 172.21.15.80:0/3150755189 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c137a70 con 0x7f171c077040 2019-11-28T11:52:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f1721098700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f171c157a00 0x7f171c074a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f1721899700 1 --2- 172.21.15.80:0/3150755189 >> v2:172.21.15.174:3300/0 conn(0x7f171c077040 0x7f171c1574c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f170c0107d0 tx=0x7f170c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f1721899700 1 --2- 172.21.15.80:0/3150755189 >> v2:172.21.15.174:3300/0 conn(0x7f171c077040 0x7f171c1574c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f170c0107d0 tx=0x7f170c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f1721899700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f171c077040 0x7f171c1574c0 secure :-1 s=READY pgs=1301 cs=0 l=1 rx=0x7f170c0107d0 tx=0x7f170c010b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.250+0000 7f1721899700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f171c077040 0x7f171c1574c0 secure :-1 s=THROTTLE_DONE pgs=1301 cs=0 l=1 rx=0x7f170c0107d0 tx=0x7f170c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.251+0000 7f1721899700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f171c077040 0x7f171c1574c0 secure :-1 s=THROTTLE_DONE pgs=1301 cs=0 l=1 rx=0x7f170c0107d0 tx=0x7f170c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.251+0000 7f1721899700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f171c077040 0x7f171c1574c0 secure :-1 s=THROTTLE_DONE pgs=1301 cs=0 l=1 rx=0x7f170c0107d0 tx=0x7f170c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:27.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.251+0000 7f171a7fc700 1 -- 172.21.15.80:0/3150755189 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f170c000cc0 con 0x7f171c077040 2019-11-28T11:52:27.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.251+0000 7f171a7fc700 1 -- 172.21.15.80:0/3150755189 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170c006950 con 0x7f171c077040 2019-11-28T11:52:27.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.251+0000 7f17232fc700 1 -- 172.21.15.80:0/3150755189 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f171c137df0 con 0x7f171c077040 2019-11-28T11:52:27.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.251+0000 7f171a7fc700 1 -- 172.21.15.80:0/3150755189 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f170c006fa0 con 0x7f171c077040 2019-11-28T11:52:27.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.251+0000 7f17232fc700 1 -- 172.21.15.80:0/3150755189 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f171c137a70 con 0x7f171c077040 2019-11-28T11:52:27.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.251+0000 7f1721899700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f171c077040 0x7f171c1574c0 secure :-1 s=THROTTLE_DONE pgs=1301 cs=0 l=1 rx=0x7f170c0107d0 tx=0x7f170c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:27.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.251+0000 7f171a7fc700 1 -- 172.21.15.80:0/3150755189 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f170c001010 con 0x7f171c077040 2019-11-28T11:52:27.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.251+0000 7f1721899700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f171c077040 0x7f171c1574c0 secure :-1 s=THROTTLE_DONE pgs=1301 cs=0 l=1 rx=0x7f170c0107d0 tx=0x7f170c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:27.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.251+0000 7f171a7fc700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16fc018730 0x7f16fc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:27.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.251+0000 7f171a7fc700 1 -- 172.21.15.80:0/3150755189 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f170c0320b0 con 0x7f171c077040 2019-11-28T11:52:27.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.251+0000 7f1721098700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16fc018730 0x7f16fc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:27.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.252+0000 7f1721098700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16fc018730 0x7f16fc01abc0 crc :-1 s=READY pgs=894 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:27.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.258+0000 7f17232fc700 1 -- 172.21.15.80:0/3150755189 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f171c137df0 con 0x7f171c077040 2019-11-28T11:52:27.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.262+0000 7f1721899700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f171c077040 0x7f171c1574c0 secure :-1 s=THROTTLE_DONE pgs=1301 cs=0 l=1 rx=0x7f170c0107d0 tx=0x7f170c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:27.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.262+0000 7f171a7fc700 1 -- 172.21.15.80:0/3150755189 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f170c005800 con 0x7f171c077040 2019-11-28T11:52:27.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:27.449+0000 7f17232fc700 1 -- 172.21.15.80:0/3150755189 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f171c137a70 con 0x7f171c077040 2019-11-28T11:52:28.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.101+0000 7f1721899700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f171c077040 0x7f171c1574c0 secure :-1 s=THROTTLE_DONE pgs=1301 cs=0 l=1 rx=0x7f170c0107d0 tx=0x7f170c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.101+0000 7f171a7fc700 1 -- 172.21.15.80:0/3150755189 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v172) v1 ==== 97+0+0 (secure 0 0 0) 0x7f170c001010 con 0x7f171c077040 2019-11-28T11:52:28.166 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:52:28.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.116+0000 7f17232fc700 1 -- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16fc018730 msgr2=0x7f16fc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.116+0000 7f17232fc700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16fc018730 0x7f16fc01abc0 crc :-1 s=READY pgs=894 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.116+0000 7f17232fc700 1 -- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f171c077040 msgr2=0x7f171c1574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.116+0000 7f17232fc700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f171c077040 0x7f171c1574c0 secure :-1 s=READY pgs=1301 cs=0 l=1 rx=0x7f170c0107d0 tx=0x7f170c010b70).stop 2019-11-28T11:52:28.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.116+0000 7f17232fc700 1 -- 172.21.15.80:0/3150755189 shutdown_connections 2019-11-28T11:52:28.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.116+0000 7f17232fc700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16fc018730 0x7f16fc01abc0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.116+0000 7f17232fc700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f171c157a00 0x7f171c074a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.116+0000 7f17232fc700 1 --2- 172.21.15.80:0/3150755189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f171c077040 0x7f171c1574c0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.116+0000 7f17232fc700 1 -- 172.21.15.80:0/3150755189 shutdown_connections 2019-11-28T11:52:28.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.116+0000 7f17232fc700 1 -- 172.21.15.80:0/3150755189 wait complete. 2019-11-28T11:52:28.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.116+0000 7f17232fc700 1 -- 172.21.15.80:0/3150755189 >> 172.21.15.80:0/3150755189 conn(0x7f171c13fa50 msgr2=0x7f171c07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:28.180 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:52:28.180 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:52:28.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.248+0000 7f111bc01700 1 Processor -- start 2019-11-28T11:52:28.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.248+0000 7f111bc01700 1 -- start start 2019-11-28T11:52:28.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.249+0000 7f111bc01700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f111406c0a0 0x7f1114072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:28.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.249+0000 7f111bc01700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1114072620 0x7f1114164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:28.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.249+0000 7f111bc01700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f111406db00 con 0x7f11140734e0 2019-11-28T11:52:28.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.249+0000 7f111bc01700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111406fd60 con 0x7f1114072620 2019-11-28T11:52:28.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.249+0000 7f111bc01700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1114070030 con 0x7f111406c0a0 2019-11-28T11:52:28.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.249+0000 7f111a99f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1114072620 0x7f1114164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:28.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.249+0000 7f111999d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f11140734e0 0x7f1114071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42206/0 (socket says 172.21.15.80:42206) 2019-11-28T11:52:28.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.249+0000 7f111999d700 1 -- 172.21.15.80:0/2380297627 learned_addr learned my addr 172.21.15.80:0/2380297627 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:28.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.249+0000 7f111a19e700 1 --2- 172.21.15.80:0/2380297627 >> v2:172.21.15.174:3300/0 conn(0x7f111406c0a0 0x7f1114072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:28.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.249+0000 7f111a99f700 1 -- 172.21.15.80:0/2380297627 >> v2:172.21.15.174:3300/0 conn(0x7f111406c0a0 msgr2=0x7f1114072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:28.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.249+0000 7f111a99f700 1 --2- 172.21.15.80:0/2380297627 >> v2:172.21.15.174:3300/0 conn(0x7f111406c0a0 0x7f1114072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:28.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.249+0000 7f111a99f700 1 -- 172.21.15.80:0/2380297627 >> v1:172.21.15.80:6789/0 conn(0x7f11140734e0 legacy=0x7f1114071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.249+0000 7f111a99f700 1 -- 172.21.15.80:0/2380297627 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11140706c0 con 0x7f1114072620 2019-11-28T11:52:28.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.249+0000 7f111919c700 1 -- 172.21.15.80:0/2380297627 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348352582 0 0) 0x7f1104001070 con 0x7f11140734e0 2019-11-28T11:52:28.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.249+0000 7f111a19e700 1 --2- 172.21.15.80:0/2380297627 >> v2:172.21.15.174:3300/0 conn(0x7f111406c0a0 0x7f1114072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:52:28.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.250+0000 7f111a99f700 1 --2- 172.21.15.80:0/2380297627 >> v2:172.21.15.80:3300/0 conn(0x7f1114072620 0x7f1114164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f110c00af50 tx=0x7f110c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.250+0000 7f111a99f700 1 --2- 172.21.15.80:0/2380297627 >> v2:172.21.15.80:3300/0 conn(0x7f1114072620 0x7f1114164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f110c00af50 tx=0x7f110c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.250+0000 7f111a99f700 1 --2- 172.21.15.80:0/2380297627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1114072620 0x7f1114164d70 secure :-1 s=READY pgs=2188 cs=0 l=1 rx=0x7f110c00af50 tx=0x7f110c00b760).ready entity=mon.0 client_cookie=7f5b42dc839a35c4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:28.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.250+0000 7f111a99f700 1 --2- 172.21.15.80:0/2380297627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1114072620 0x7f1114164d70 secure :-1 s=THROTTLE_DONE pgs=2188 cs=0 l=1 rx=0x7f110c00af50 tx=0x7f110c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.250+0000 7f111919c700 1 -- 172.21.15.80:0/2380297627 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f110c009ba0 con 0x7f1114072620 2019-11-28T11:52:28.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.250+0000 7f111a99f700 1 --2- 172.21.15.80:0/2380297627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1114072620 0x7f1114164d70 secure :-1 s=THROTTLE_DONE pgs=2188 cs=0 l=1 rx=0x7f110c00af50 tx=0x7f110c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.250+0000 7f111a99f700 1 --2- 172.21.15.80:0/2380297627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1114072620 0x7f1114164d70 secure :-1 s=THROTTLE_DONE pgs=2188 cs=0 l=1 rx=0x7f110c00af50 tx=0x7f110c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.250+0000 7f111919c700 1 -- 172.21.15.80:0/2380297627 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c0097c0 con 0x7f1114072620 2019-11-28T11:52:28.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.250+0000 7f111919c700 1 -- 172.21.15.80:0/2380297627 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f110c000bc0 con 0x7f1114072620 2019-11-28T11:52:28.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.250+0000 7f111bc01700 1 -- 172.21.15.80:0/2380297627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1114072620 msgr2=0x7f1114164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.250+0000 7f111bc01700 1 --2- 172.21.15.80:0/2380297627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1114072620 0x7f1114164d70 secure :-1 s=READY pgs=2188 cs=0 l=1 rx=0x7f110c00af50 tx=0x7f110c00b760).stop 2019-11-28T11:52:28.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.251+0000 7f111bc01700 1 -- 172.21.15.80:0/2380297627 shutdown_connections 2019-11-28T11:52:28.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.251+0000 7f111bc01700 1 --2- 172.21.15.80:0/2380297627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1114072620 0x7f1114164d70 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.251+0000 7f111bc01700 1 --2- 172.21.15.80:0/2380297627 >> v2:172.21.15.174:3300/0 conn(0x7f111406c0a0 0x7f1114072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:28.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.251+0000 7f111bc01700 1 -- 172.21.15.80:0/2380297627 shutdown_connections 2019-11-28T11:52:28.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.251+0000 7f111bc01700 1 -- 172.21.15.80:0/2380297627 wait complete. 2019-11-28T11:52:28.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.251+0000 7f111bc01700 1 -- 172.21.15.80:0/2380297627 >> 172.21.15.80:0/2380297627 conn(0x7f1114061cf0 msgr2=0x7f1114064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:28.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.253+0000 7f111bc01700 1 Processor -- start 2019-11-28T11:52:28.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.253+0000 7f111bc01700 1 -- start start 2019-11-28T11:52:28.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111bc01700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f111413e5f0 0x7f111413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:28.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111bc01700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f111410a070 0x7f111410bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:28.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111bc01700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f111410a4e0 0x7f111410c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:28.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111bc01700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111410e060 con 0x7f111413e5f0 2019-11-28T11:52:28.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111bc01700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111410e330 con 0x7f111410a4e0 2019-11-28T11:52:28.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111bc01700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111410d630 con 0x7f111410a070 2019-11-28T11:52:28.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111a19e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f111413e5f0 0x7f111413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:28.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111a19e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f111413e5f0 0x7f111413e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42892/0 (socket says 172.21.15.80:42892) 2019-11-28T11:52:28.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111a19e700 1 -- 172.21.15.80:0/220314766 learned_addr learned my addr 172.21.15.80:0/220314766 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:28.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111999d700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f111410a070 0x7f111410bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:28.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111a99f700 1 --2- 172.21.15.80:0/220314766 >> v2:172.21.15.174:3300/0 conn(0x7f111410a4e0 0x7f111410c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:28.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111a19e700 1 -- 172.21.15.80:0/220314766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f111410a070 msgr2=0x7f111410bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111a19e700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f111410a070 0x7f111410bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111a19e700 1 -- 172.21.15.80:0/220314766 >> v2:172.21.15.174:3300/0 conn(0x7f111410a4e0 msgr2=0x7f111410c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111a19e700 1 --2- 172.21.15.80:0/220314766 >> v2:172.21.15.174:3300/0 conn(0x7f111410a4e0 0x7f111410c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111a19e700 1 -- 172.21.15.80:0/220314766 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111410e9c0 con 0x7f111413e5f0 2019-11-28T11:52:28.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111999d700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f111410a070 0x7f111410bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:52:28.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111a99f700 1 --2- 172.21.15.80:0/220314766 >> v2:172.21.15.174:3300/0 conn(0x7f111410a4e0 0x7f111410c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:52:28.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111a19e700 1 --2- 172.21.15.80:0/220314766 >> v2:172.21.15.80:3300/0 conn(0x7f111413e5f0 0x7f111413e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f11100107b0 tx=0x7f1110010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111a19e700 1 --2- 172.21.15.80:0/220314766 >> v2:172.21.15.80:3300/0 conn(0x7f111413e5f0 0x7f111413e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f11100107b0 tx=0x7f1110010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.254+0000 7f111a19e700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f111413e5f0 0x7f111413e9e0 secure :-1 s=READY pgs=2189 cs=0 l=1 rx=0x7f11100107b0 tx=0x7f1110010b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:28.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.255+0000 7f111a19e700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f111413e5f0 0x7f111413e9e0 secure :-1 s=THROTTLE_DONE pgs=2189 cs=0 l=1 rx=0x7f11100107b0 tx=0x7f1110010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.255+0000 7f111a19e700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f111413e5f0 0x7f111413e9e0 secure :-1 s=THROTTLE_DONE pgs=2189 cs=0 l=1 rx=0x7f11100107b0 tx=0x7f1110010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.255+0000 7f110affd700 1 -- 172.21.15.80:0/220314766 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1110009a40 con 0x7f111413e5f0 2019-11-28T11:52:28.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.255+0000 7f111a19e700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f111413e5f0 0x7f111413e9e0 secure :-1 s=THROTTLE_DONE pgs=2189 cs=0 l=1 rx=0x7f11100107b0 tx=0x7f1110010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.255+0000 7f110affd700 1 -- 172.21.15.80:0/220314766 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1110000f20 con 0x7f111413e5f0 2019-11-28T11:52:28.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.255+0000 7f111bc01700 1 -- 172.21.15.80:0/220314766 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111410ed40 con 0x7f111413e5f0 2019-11-28T11:52:28.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.255+0000 7f110affd700 1 -- 172.21.15.80:0/220314766 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1110001570 con 0x7f111413e5f0 2019-11-28T11:52:28.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.255+0000 7f111bc01700 1 -- 172.21.15.80:0/220314766 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111410e9c0 con 0x7f111413e5f0 2019-11-28T11:52:28.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.255+0000 7f111a19e700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f111413e5f0 0x7f111413e9e0 secure :-1 s=THROTTLE_DONE pgs=2189 cs=0 l=1 rx=0x7f11100107b0 tx=0x7f1110010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.255+0000 7f110affd700 1 -- 172.21.15.80:0/220314766 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1110009a40 con 0x7f111413e5f0 2019-11-28T11:52:28.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.255+0000 7f111a19e700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f111413e5f0 0x7f111413e9e0 secure :-1 s=THROTTLE_DONE pgs=2189 cs=0 l=1 rx=0x7f11100107b0 tx=0x7f1110010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.255+0000 7f110affd700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10fc018730 0x7f10fc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.255+0000 7f110affd700 1 -- 172.21.15.80:0/220314766 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f1110031d90 con 0x7f111413e5f0 2019-11-28T11:52:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.256+0000 7f111999d700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10fc018730 0x7f10fc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.256+0000 7f111999d700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10fc018730 0x7f10fc01abc0 crc :-1 s=READY pgs=895 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.263+0000 7f111bc01700 1 -- 172.21.15.80:0/220314766 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111410ed40 con 0x7f111413e5f0 2019-11-28T11:52:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.267+0000 7f111a19e700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f111413e5f0 0x7f111413e9e0 secure :-1 s=THROTTLE_DONE pgs=2189 cs=0 l=1 rx=0x7f11100107b0 tx=0x7f1110010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.267+0000 7f110affd700 1 -- 172.21.15.80:0/220314766 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1110030d10 con 0x7f111413e5f0 2019-11-28T11:52:28.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.437+0000 7f111bc01700 1 -- 172.21.15.80:0/220314766 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f111410e9c0 con 0x7f111413e5f0 2019-11-28T11:52:28.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.437+0000 7f111a19e700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f111413e5f0 0x7f111413e9e0 secure :-1 s=THROTTLE_DONE pgs=2189 cs=0 l=1 rx=0x7f11100107b0 tx=0x7f1110010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.437+0000 7f110affd700 1 -- 172.21.15.80:0/220314766 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v59) v1 ==== 80+0+4797 (secure 0 0 0) 0x7f1110030d10 con 0x7f111413e5f0 2019-11-28T11:52:28.491 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:28.491 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:52:28.491 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:52:28.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.492 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:52:28.492 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:52:28.492 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.492 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:52:28.492 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:52:28.493 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:52:28.493 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:52:28.493 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.493 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:52:28.493 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:52:28.494 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.494 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:52:28.494 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:52:28.494 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:52:28.494 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:52:28.494 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.495 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:52:28.495 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:52:28.495 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.495 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:52:28.495 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:52:28.495 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:52:28.495 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:52:28.496 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.496 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:52:28.496 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:52:28.496 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.497 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:52:28.497 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:52:28.497 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:52:28.497 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.497 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:52:28.497 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:52:28.498 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.498 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:52:28.498 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:52:28.498 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:52:28.498 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.499 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:52:28.499 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:52:28.499 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.499 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:52:28.499 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:52:28.499 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:52:28.499 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.500 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:52:28.500 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:52:28.500 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.500 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:52:28.501 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:52:28.501 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:52:28.501 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.501 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:52:28.501 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:52:28.502 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.502 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:52:28.502 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:52:28.502 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:52:28.502 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.503 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:52:28.503 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:52:28.503 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.503 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:52:28.504 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:52:28.504 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:52:28.504 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.505 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:52:28.505 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:52:28.505 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.505 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:52:28.505 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:52:28.506 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:52:28.506 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.506 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:52:28.506 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:52:28.507 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.507 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:52:28.507 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:52:28.507 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:52:28.507 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.508 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:52:28.508 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:52:28.508 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.508 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:52:28.508 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:52:28.509 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:52:28.509 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.509 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:52:28.510 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:52:28.510 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.510 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:52:28.510 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:52:28.511 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:52:28.511 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.511 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:52:28.512 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:52:28.512 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.512 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:52:28.512 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:52:28.512 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:52:28.512 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.513 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:52:28.513 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:52:28.514 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.514 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:52:28.514 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:52:28.514 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:52:28.514 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.515 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:52:28.515 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:52:28.515 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.515 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:52:28.515 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:52:28.515 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:52:28.515 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:52:28.516 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.516 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:52:28.516 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:52:28.516 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.517 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:52:28.517 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:52:28.517 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:52:28.517 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:28.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:28.517 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:52:28.518 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:52:28.518 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:52:28.518 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:52:28.518 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:52:28.518 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:52:28.518 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.518 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:28.518 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:52:28.519 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:52:28.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.440+0000 7f111bc01700 1 -- 172.21.15.80:0/220314766 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10fc018730 msgr2=0x7f10fc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.440+0000 7f111bc01700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10fc018730 0x7f10fc01abc0 crc :-1 s=READY pgs=895 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.440+0000 7f111bc01700 1 -- 172.21.15.80:0/220314766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f111413e5f0 msgr2=0x7f111413e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.440+0000 7f111bc01700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f111413e5f0 0x7f111413e9e0 secure :-1 s=READY pgs=2189 cs=0 l=1 rx=0x7f11100107b0 tx=0x7f1110010b50).stop 2019-11-28T11:52:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.440+0000 7f111bc01700 1 -- 172.21.15.80:0/220314766 shutdown_connections 2019-11-28T11:52:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.440+0000 7f111bc01700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10fc018730 0x7f10fc01abc0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.440+0000 7f111bc01700 1 --2- 172.21.15.80:0/220314766 >> v2:172.21.15.174:3300/0 conn(0x7f111410a4e0 0x7f111410c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.440+0000 7f111bc01700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f111410a070 0x7f111410bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.440+0000 7f111bc01700 1 --2- 172.21.15.80:0/220314766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f111413e5f0 0x7f111413e9e0 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.440+0000 7f111bc01700 1 -- 172.21.15.80:0/220314766 shutdown_connections 2019-11-28T11:52:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.440+0000 7f111bc01700 1 -- 172.21.15.80:0/220314766 wait complete. 2019-11-28T11:52:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.440+0000 7f111bc01700 1 -- 172.21.15.80:0/220314766 >> 172.21.15.80:0/220314766 conn(0x7f111413d620 msgr2=0x7f111413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:28.522 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:52:28.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.590+0000 7f474b0e0700 1 Processor -- start 2019-11-28T11:52:28.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.590+0000 7f474b0e0700 1 -- start start 2019-11-28T11:52:28.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.591+0000 7f474b0e0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f474406c0a0 0x7f4744072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:28.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.591+0000 7f474b0e0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47440734e0 0x7f4744071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:28.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.591+0000 7f474b0e0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474406db00 con 0x7f4744072360 2019-11-28T11:52:28.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.591+0000 7f474b0e0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f474406fd60 con 0x7f47440734e0 2019-11-28T11:52:28.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.591+0000 7f474b0e0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4744070030 con 0x7f474406c0a0 2019-11-28T11:52:28.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.591+0000 7f4748e7c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47440734e0 0x7f4744071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:28.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.591+0000 7f4749e7e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4744072360 0x7f474406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42218/0 (socket says 172.21.15.80:42218) 2019-11-28T11:52:28.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.591+0000 7f4749e7e700 1 -- 172.21.15.80:0/782220294 learned_addr learned my addr 172.21.15.80:0/782220294 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:28.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.591+0000 7f474967d700 1 --2- 172.21.15.80:0/782220294 >> v2:172.21.15.174:3300/0 conn(0x7f474406c0a0 0x7f4744072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:28.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.591+0000 7f4748e7c700 1 -- 172.21.15.80:0/782220294 >> v2:172.21.15.174:3300/0 conn(0x7f474406c0a0 msgr2=0x7f4744072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:28.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.591+0000 7f4748e7c700 1 --2- 172.21.15.80:0/782220294 >> v2:172.21.15.174:3300/0 conn(0x7f474406c0a0 0x7f4744072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:28.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.591+0000 7f4748e7c700 1 -- 172.21.15.80:0/782220294 >> v1:172.21.15.80:6789/0 conn(0x7f4744072360 legacy=0x7f474406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.591+0000 7f4743fff700 1 -- 172.21.15.80:0/782220294 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55937263 0 0) 0x7f473c001150 con 0x7f4744072360 2019-11-28T11:52:28.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.592+0000 7f4748e7c700 1 -- 172.21.15.80:0/782220294 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47440706c0 con 0x7f47440734e0 2019-11-28T11:52:28.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.592+0000 7f474967d700 1 --2- 172.21.15.80:0/782220294 >> v2:172.21.15.174:3300/0 conn(0x7f474406c0a0 0x7f4744072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:52:28.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.592+0000 7f4748e7c700 1 --2- 172.21.15.80:0/782220294 >> v2:172.21.15.80:3300/0 conn(0x7f47440734e0 0x7f4744071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f472c00b2d0 tx=0x7f472c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.592+0000 7f4748e7c700 1 --2- 172.21.15.80:0/782220294 >> v2:172.21.15.80:3300/0 conn(0x7f47440734e0 0x7f4744071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f472c00b2d0 tx=0x7f472c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.592+0000 7f4748e7c700 1 --2- 172.21.15.80:0/782220294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47440734e0 0x7f4744071e20 secure :-1 s=READY pgs=2191 cs=0 l=1 rx=0x7f472c00b2d0 tx=0x7f472c00bae0).ready entity=mon.0 client_cookie=29492b0f60300ea1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:28.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.592+0000 7f4748e7c700 1 --2- 172.21.15.80:0/782220294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47440734e0 0x7f4744071e20 secure :-1 s=THROTTLE_DONE pgs=2191 cs=0 l=1 rx=0x7f472c00b2d0 tx=0x7f472c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.592+0000 7f4743fff700 1 -- 172.21.15.80:0/782220294 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f472c007590 con 0x7f47440734e0 2019-11-28T11:52:28.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.592+0000 7f4748e7c700 1 --2- 172.21.15.80:0/782220294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47440734e0 0x7f4744071e20 secure :-1 s=THROTTLE_DONE pgs=2191 cs=0 l=1 rx=0x7f472c00b2d0 tx=0x7f472c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.592+0000 7f4748e7c700 1 --2- 172.21.15.80:0/782220294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47440734e0 0x7f4744071e20 secure :-1 s=THROTTLE_DONE pgs=2191 cs=0 l=1 rx=0x7f472c00b2d0 tx=0x7f472c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.592+0000 7f4743fff700 1 -- 172.21.15.80:0/782220294 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c009d30 con 0x7f47440734e0 2019-11-28T11:52:28.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.592+0000 7f4743fff700 1 -- 172.21.15.80:0/782220294 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f472c00a400 con 0x7f47440734e0 2019-11-28T11:52:28.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.592+0000 7f474b0e0700 1 -- 172.21.15.80:0/782220294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47440734e0 msgr2=0x7f4744071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.592+0000 7f474b0e0700 1 --2- 172.21.15.80:0/782220294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47440734e0 0x7f4744071e20 secure :-1 s=READY pgs=2191 cs=0 l=1 rx=0x7f472c00b2d0 tx=0x7f472c00bae0).stop 2019-11-28T11:52:28.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.593+0000 7f474b0e0700 1 -- 172.21.15.80:0/782220294 shutdown_connections 2019-11-28T11:52:28.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.593+0000 7f474b0e0700 1 --2- 172.21.15.80:0/782220294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47440734e0 0x7f4744071e20 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.593+0000 7f474b0e0700 1 --2- 172.21.15.80:0/782220294 >> v2:172.21.15.174:3300/0 conn(0x7f474406c0a0 0x7f4744072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:28.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.593+0000 7f474b0e0700 1 -- 172.21.15.80:0/782220294 shutdown_connections 2019-11-28T11:52:28.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.593+0000 7f474b0e0700 1 -- 172.21.15.80:0/782220294 wait complete. 2019-11-28T11:52:28.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.593+0000 7f474b0e0700 1 -- 172.21.15.80:0/782220294 >> 172.21.15.80:0/782220294 conn(0x7f4744061cf0 msgr2=0x7f4744064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:28.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.595+0000 7f474b0e0700 1 Processor -- start 2019-11-28T11:52:28.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.595+0000 7f474b0e0700 1 -- start start 2019-11-28T11:52:28.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.596+0000 7f474b0e0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f474413a780 0x7f474412d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:28.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.596+0000 7f474b0e0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f474412d9c0 0x7f474412c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:28.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.596+0000 7f474b0e0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4744139a60 con 0x7f474412c840 2019-11-28T11:52:28.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.596+0000 7f474b0e0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f474412a260 con 0x7f474413a780 2019-11-28T11:52:28.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.596+0000 7f474b0e0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474412a530 con 0x7f474412d9c0 2019-11-28T11:52:28.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.596+0000 7f4748e7c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f474412d9c0 0x7f474412c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:28.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.596+0000 7f474967d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f474413a780 0x7f474412d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:28.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.596+0000 7f4748e7c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f474412d9c0 0x7f474412c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:45168/0 (socket says 172.21.15.80:45168) 2019-11-28T11:52:28.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.596+0000 7f4748e7c700 1 -- 172.21.15.80:0/1068023099 learned_addr learned my addr 172.21.15.80:0/1068023099 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:28.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f474967d700 1 -- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f474412d9c0 msgr2=0x7f474412c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f474967d700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f474412d9c0 0x7f474412c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f4741ffb700 1 -- 172.21.15.80:0/1068023099 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898022252 0 0) 0x7f473c000f40 con 0x7f474412c840 2019-11-28T11:52:28.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f474967d700 1 -- 172.21.15.80:0/1068023099 >> v1:172.21.15.174:6789/0 conn(0x7f474412c840 legacy=0x7f47441281b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f474967d700 1 -- 172.21.15.80:0/1068023099 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474412abc0 con 0x7f474413a780 2019-11-28T11:52:28.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f4748e7c700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f474412d9c0 0x7f474412c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:28.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f474967d700 1 --2- 172.21.15.80:0/1068023099 >> v2:172.21.15.174:3300/0 conn(0x7f474413a780 0x7f474412d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4734010350 tx=0x7f47340106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f474967d700 1 --2- 172.21.15.80:0/1068023099 >> v2:172.21.15.174:3300/0 conn(0x7f474413a780 0x7f474412d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4734010350 tx=0x7f47340106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f474967d700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474413a780 0x7f474412d480 secure :-1 s=READY pgs=1303 cs=0 l=1 rx=0x7f4734010350 tx=0x7f47340106f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:28.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f474967d700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474413a780 0x7f474412d480 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7f4734010350 tx=0x7f47340106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f4741ffb700 1 -- 172.21.15.80:0/1068023099 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47340097a0 con 0x7f474413a780 2019-11-28T11:52:28.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f474967d700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474413a780 0x7f474412d480 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7f4734010350 tx=0x7f47340106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f474b0e0700 1 -- 172.21.15.80:0/1068023099 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474412af40 con 0x7f474413a780 2019-11-28T11:52:28.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f4741ffb700 1 -- 172.21.15.80:0/1068023099 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47340097a0 con 0x7f474413a780 2019-11-28T11:52:28.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f474967d700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474413a780 0x7f474412d480 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7f4734010350 tx=0x7f47340106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f4741ffb700 1 -- 172.21.15.80:0/1068023099 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4734000db0 con 0x7f474413a780 2019-11-28T11:52:28.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f474b0e0700 1 -- 172.21.15.80:0/1068023099 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474412abc0 con 0x7f474413a780 2019-11-28T11:52:28.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.597+0000 7f474967d700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474413a780 0x7f474412d480 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7f4734010350 tx=0x7f47340106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.598+0000 7f4741ffb700 1 -- 172.21.15.80:0/1068023099 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4734000bc0 con 0x7f474413a780 2019-11-28T11:52:28.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.598+0000 7f474967d700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474413a780 0x7f474412d480 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7f4734010350 tx=0x7f47340106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.598+0000 7f4741ffb700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4728018730 0x7f472801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:28.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.598+0000 7f4741ffb700 1 -- 172.21.15.80:0/1068023099 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f47340319f0 con 0x7f474413a780 2019-11-28T11:52:28.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.598+0000 7f4748e7c700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4728018730 0x7f472801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:28.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.598+0000 7f4748e7c700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4728018730 0x7f472801abc0 crc :-1 s=READY pgs=896 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:28.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.605+0000 7f474b0e0700 1 -- 172.21.15.80:0/1068023099 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f474412af40 con 0x7f474413a780 2019-11-28T11:52:28.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.609+0000 7f474967d700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474413a780 0x7f474412d480 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7f4734010350 tx=0x7f47340106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.609+0000 7f4741ffb700 1 -- 172.21.15.80:0/1068023099 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f47340009b0 con 0x7f474413a780 2019-11-28T11:52:28.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.785+0000 7f474b0e0700 1 -- 172.21.15.80:0/1068023099 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f474412abc0 con 0x7f474413a780 2019-11-28T11:52:28.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.785+0000 7f474967d700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474413a780 0x7f474412d480 secure :-1 s=THROTTLE_DONE pgs=1303 cs=0 l=1 rx=0x7f4734010350 tx=0x7f47340106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.785+0000 7f4741ffb700 1 -- 172.21.15.80:0/1068023099 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+12010 (secure 0 0 0) 0x7f4734000bc0 con 0x7f474413a780 2019-11-28T11:52:28.840 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:28.840 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":172,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:52:28.097981+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:52:28.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.787+0000 7f474b0e0700 1 -- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4728018730 msgr2=0x7f472801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.787+0000 7f474b0e0700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4728018730 0x7f472801abc0 crc :-1 s=READY pgs=896 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.787+0000 7f474b0e0700 1 -- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474413a780 msgr2=0x7f474412d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.787+0000 7f474b0e0700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474413a780 0x7f474412d480 secure :-1 s=READY pgs=1303 cs=0 l=1 rx=0x7f4734010350 tx=0x7f47340106f0).stop 2019-11-28T11:52:28.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.788+0000 7f474b0e0700 1 -- 172.21.15.80:0/1068023099 shutdown_connections 2019-11-28T11:52:28.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.788+0000 7f474b0e0700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4728018730 0x7f472801abc0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.788+0000 7f474b0e0700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f474412d9c0 0x7f474412c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.788+0000 7f474b0e0700 1 --2- 172.21.15.80:0/1068023099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474413a780 0x7f474412d480 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.788+0000 7f474b0e0700 1 -- 172.21.15.80:0/1068023099 shutdown_connections 2019-11-28T11:52:28.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.788+0000 7f474b0e0700 1 -- 172.21.15.80:0/1068023099 wait complete. 2019-11-28T11:52:28.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.788+0000 7f474b0e0700 1 -- 172.21.15.80:0/1068023099 >> 172.21.15.80:0/1068023099 conn(0x7f4744127dc0 msgr2=0x7f4744141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:28.852 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:52:28.852 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:52:28.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.922+0000 7fa840ae4700 1 Processor -- start 2019-11-28T11:52:28.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.922+0000 7fa840ae4700 1 -- start start 2019-11-28T11:52:28.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa840ae4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa83c15ed10 0x7fa83c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:28.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa840ae4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa83c073020 0x7fa83c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:28.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa840ae4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83c06db60 con 0x7fa83c0734b0 2019-11-28T11:52:28.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa840ae4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c06f3d0 con 0x7fa83c073020 2019-11-28T11:52:28.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa840ae4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c06fe00 con 0x7fa83c15ed10 2019-11-28T11:52:28.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa83a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa83c073020 0x7fa83c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:28.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa83a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa83c073020 0x7fa83c071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42918/0 (socket says 172.21.15.80:42918) 2019-11-28T11:52:28.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa83a59c700 1 -- 172.21.15.80:0/1230297715 learned_addr learned my addr 172.21.15.80:0/1230297715 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:28.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa83ad9d700 1 --2- 172.21.15.80:0/1230297715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa83c15ed10 0x7fa83c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:28.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa83a59c700 1 -- 172.21.15.80:0/1230297715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa83c15ed10 msgr2=0x7fa83c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:28.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa83a59c700 1 --2- 172.21.15.80:0/1230297715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa83c15ed10 0x7fa83c15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:28.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa83a59c700 1 -- 172.21.15.80:0/1230297715 >> v1:172.21.15.174:6789/0 conn(0x7fa83c0734b0 legacy=0x7fa83c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa83a59c700 1 -- 172.21.15.80:0/1230297715 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c070760 con 0x7fa83c073020 2019-11-28T11:52:28.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa83a59c700 1 --2- 172.21.15.80:0/1230297715 >> v2:172.21.15.80:3300/0 conn(0x7fa83c073020 0x7fa83c071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa83400f6c0 tx=0x7fa83400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa83a59c700 1 --2- 172.21.15.80:0/1230297715 >> v2:172.21.15.80:3300/0 conn(0x7fa83c073020 0x7fa83c071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa83400f6c0 tx=0x7fa83400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa83a59c700 1 --2- 172.21.15.80:0/1230297715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa83c073020 0x7fa83c071ea0 secure :-1 s=READY pgs=2192 cs=0 l=1 rx=0x7fa83400f6c0 tx=0x7fa83400fa60).ready entity=mon.0 client_cookie=aa31d671b326cd13 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:28.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa83a59c700 1 --2- 172.21.15.80:0/1230297715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa83c073020 0x7fa83c071ea0 secure :-1 s=THROTTLE_DONE pgs=2192 cs=0 l=1 rx=0x7fa83400f6c0 tx=0x7fa83400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa83a59c700 1 --2- 172.21.15.80:0/1230297715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa83c073020 0x7fa83c071ea0 secure :-1 s=THROTTLE_DONE pgs=2192 cs=0 l=1 rx=0x7fa83400f6c0 tx=0x7fa83400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa83a59c700 1 --2- 172.21.15.80:0/1230297715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa83c073020 0x7fa83c071ea0 secure :-1 s=THROTTLE_DONE pgs=2192 cs=0 l=1 rx=0x7fa83400f6c0 tx=0x7fa83400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.923+0000 7fa839d9b700 1 -- 172.21.15.80:0/1230297715 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa834000960 con 0x7fa83c073020 2019-11-28T11:52:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.924+0000 7fa839d9b700 1 -- 172.21.15.80:0/1230297715 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa834000c90 con 0x7fa83c073020 2019-11-28T11:52:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.924+0000 7fa839d9b700 1 -- 172.21.15.80:0/1230297715 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8340013a0 con 0x7fa83c073020 2019-11-28T11:52:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.924+0000 7fa840ae4700 1 -- 172.21.15.80:0/1230297715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa83c073020 msgr2=0x7fa83c071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.924+0000 7fa840ae4700 1 --2- 172.21.15.80:0/1230297715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa83c073020 0x7fa83c071ea0 secure :-1 s=READY pgs=2192 cs=0 l=1 rx=0x7fa83400f6c0 tx=0x7fa83400fa60).stop 2019-11-28T11:52:28.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.924+0000 7fa840ae4700 1 -- 172.21.15.80:0/1230297715 shutdown_connections 2019-11-28T11:52:28.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.924+0000 7fa840ae4700 1 --2- 172.21.15.80:0/1230297715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa83c073020 0x7fa83c071ea0 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.924+0000 7fa840ae4700 1 --2- 172.21.15.80:0/1230297715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa83c15ed10 0x7fa83c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:28.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.924+0000 7fa840ae4700 1 -- 172.21.15.80:0/1230297715 shutdown_connections 2019-11-28T11:52:28.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.924+0000 7fa840ae4700 1 -- 172.21.15.80:0/1230297715 wait complete. 2019-11-28T11:52:28.989 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.924+0000 7fa840ae4700 1 -- 172.21.15.80:0/1230297715 >> 172.21.15.80:0/1230297715 conn(0x7fa83c061d20 msgr2=0x7fa83c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:28.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.927+0000 7fa840ae4700 1 Processor -- start 2019-11-28T11:52:28.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.927+0000 7fa840ae4700 1 -- start start 2019-11-28T11:52:28.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa840ae4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa83c10ed60 0x7fa83c10f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:28.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa840ae4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa83c10f730 0x7fa83c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:28.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa840ae4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83c10c250 con 0x7fa83c10e970 2019-11-28T11:52:28.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa840ae4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c10e430 con 0x7fa83c10ed60 2019-11-28T11:52:28.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa840ae4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c105860 con 0x7fa83c10f730 2019-11-28T11:52:28.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa83ad9d700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa83c10e970 0x7fa83c1087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:57780/0 (socket says 172.21.15.80:57780) 2019-11-28T11:52:28.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa83ad9d700 1 -- 172.21.15.80:0/3875684496 learned_addr learned my addr 172.21.15.80:0/3875684496 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:28.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa83b59e700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa83c10f730 0x7fa83c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:28.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa83a59c700 1 --2- 172.21.15.80:0/3875684496 >> v2:172.21.15.174:3300/0 conn(0x7fa83c10ed60 0x7fa83c10f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:28.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa8337fe700 1 -- 172.21.15.80:0/3875684496 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236926062 0 0) 0x7fa8240099c0 con 0x7fa83c10e970 2019-11-28T11:52:28.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa8337fe700 1 -- 172.21.15.80:0/3875684496 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa814002e80 con 0x7fa83c10e970 2019-11-28T11:52:28.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa83a59c700 1 -- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa83c10f730 msgr2=0x7fa83c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa83a59c700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa83c10f730 0x7fa83c167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:28.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa83a59c700 1 -- 172.21.15.80:0/3875684496 >> v1:172.21.15.174:6789/0 conn(0x7fa83c10e970 legacy=0x7fa83c1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:28.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa83a59c700 1 -- 172.21.15.80:0/3875684496 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c105ef0 con 0x7fa83c10ed60 2019-11-28T11:52:28.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa83a59c700 1 --2- 172.21.15.80:0/3875684496 >> v2:172.21.15.174:3300/0 conn(0x7fa83c10ed60 0x7fa83c10f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa834010390 tx=0x7fa834010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa83a59c700 1 --2- 172.21.15.80:0/3875684496 >> v2:172.21.15.174:3300/0 conn(0x7fa83c10ed60 0x7fa83c10f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa834010390 tx=0x7fa834010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa83a59c700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83c10ed60 0x7fa83c10f1f0 secure :-1 s=READY pgs=1306 cs=0 l=1 rx=0x7fa834010390 tx=0x7fa834010190).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:28.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa83a59c700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83c10ed60 0x7fa83c10f1f0 secure :-1 s=THROTTLE_DONE pgs=1306 cs=0 l=1 rx=0x7fa834010390 tx=0x7fa834010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa8337fe700 1 -- 172.21.15.80:0/3875684496 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa834000940 con 0x7fa83c10ed60 2019-11-28T11:52:28.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa83a59c700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83c10ed60 0x7fa83c10f1f0 secure :-1 s=THROTTLE_DONE pgs=1306 cs=0 l=1 rx=0x7fa834010390 tx=0x7fa834010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa83a59c700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83c10ed60 0x7fa83c10f1f0 secure :-1 s=THROTTLE_DONE pgs=1306 cs=0 l=1 rx=0x7fa834010390 tx=0x7fa834010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa8337fe700 1 -- 172.21.15.80:0/3875684496 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa834000f50 con 0x7fa83c10ed60 2019-11-28T11:52:28.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa840ae4700 1 -- 172.21.15.80:0/3875684496 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83c106270 con 0x7fa83c10ed60 2019-11-28T11:52:28.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa8337fe700 1 -- 172.21.15.80:0/3875684496 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8340015e0 con 0x7fa83c10ed60 2019-11-28T11:52:28.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.928+0000 7fa840ae4700 1 -- 172.21.15.80:0/3875684496 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83c105ef0 con 0x7fa83c10ed60 2019-11-28T11:52:28.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.929+0000 7fa83a59c700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83c10ed60 0x7fa83c10f1f0 secure :-1 s=THROTTLE_DONE pgs=1306 cs=0 l=1 rx=0x7fa834010390 tx=0x7fa834010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.929+0000 7fa8337fe700 1 -- 172.21.15.80:0/3875684496 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa834001140 con 0x7fa83c10ed60 2019-11-28T11:52:28.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.929+0000 7fa83a59c700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83c10ed60 0x7fa83c10f1f0 secure :-1 s=THROTTLE_DONE pgs=1306 cs=0 l=1 rx=0x7fa834010390 tx=0x7fa834010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:28.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.929+0000 7fa8337fe700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa814018770 0x7fa81401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:28.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.929+0000 7fa8337fe700 1 -- 172.21.15.80:0/3875684496 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fa8340319b0 con 0x7fa83c10ed60 2019-11-28T11:52:28.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.929+0000 7fa83ad9d700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa814018770 0x7fa81401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:28.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.930+0000 7fa83ad9d700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa814018770 0x7fa81401abe0 crc :-1 s=READY pgs=897 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:28.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.937+0000 7fa840ae4700 1 -- 172.21.15.80:0/3875684496 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83c106270 con 0x7fa83c10ed60 2019-11-28T11:52:29.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.941+0000 7fa83a59c700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83c10ed60 0x7fa83c10f1f0 secure :-1 s=THROTTLE_DONE pgs=1306 cs=0 l=1 rx=0x7fa834010390 tx=0x7fa834010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:28.941+0000 7fa8337fe700 1 -- 172.21.15.80:0/3875684496 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa834000b50 con 0x7fa83c10ed60 2019-11-28T11:52:29.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.108+0000 7fa840ae4700 1 -- 172.21.15.80:0/3875684496 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fa83c105ef0 con 0x7fa83c10ed60 2019-11-28T11:52:29.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.112+0000 7fa83a59c700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83c10ed60 0x7fa83c10f1f0 secure :-1 s=THROTTLE_DONE pgs=1306 cs=0 l=1 rx=0x7fa834010390 tx=0x7fa834010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.112+0000 7fa8337fe700 1 -- 172.21.15.80:0/3875684496 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v172) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa834017510 con 0x7fa83c10ed60 2019-11-28T11:52:29.168 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:52:29.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.117+0000 7fa840ae4700 1 -- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa814018770 msgr2=0x7fa81401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:29.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.117+0000 7fa840ae4700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa814018770 0x7fa81401abe0 crc :-1 s=READY pgs=897 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:29.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.117+0000 7fa840ae4700 1 -- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83c10ed60 msgr2=0x7fa83c10f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:29.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.117+0000 7fa840ae4700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83c10ed60 0x7fa83c10f1f0 secure :-1 s=READY pgs=1306 cs=0 l=1 rx=0x7fa834010390 tx=0x7fa834010190).stop 2019-11-28T11:52:29.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.118+0000 7fa840ae4700 1 -- 172.21.15.80:0/3875684496 shutdown_connections 2019-11-28T11:52:29.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.118+0000 7fa840ae4700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa83c10f730 0x7fa83c167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:29.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.118+0000 7fa840ae4700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa83c10ed60 0x7fa83c10f1f0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:29.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.118+0000 7fa840ae4700 1 --2- 172.21.15.80:0/3875684496 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa814018770 0x7fa81401abe0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:29.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.118+0000 7fa840ae4700 1 -- 172.21.15.80:0/3875684496 shutdown_connections 2019-11-28T11:52:29.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.118+0000 7fa840ae4700 1 -- 172.21.15.80:0/3875684496 wait complete. 2019-11-28T11:52:29.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.118+0000 7fa840ae4700 1 -- 172.21.15.80:0/3875684496 >> 172.21.15.80:0/3875684496 conn(0x7fa83c15e2d0 msgr2=0x7fa83c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:29.181 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:52:29.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.246+0000 7f98ba7c5700 1 Processor -- start 2019-11-28T11:52:29.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.246+0000 7f98ba7c5700 1 -- start start 2019-11-28T11:52:29.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98ba7c5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98b406c490 0x7f98b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:29.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98ba7c5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b406ce60 0x7f98b4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:29.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98ba7c5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b406db00 con 0x7f98b406c0a0 2019-11-28T11:52:29.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98ba7c5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b406fd60 con 0x7f98b406c490 2019-11-28T11:52:29.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98ba7c5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b4070030 con 0x7f98b406ce60 2019-11-28T11:52:29.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98b3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98b406c490 0x7f98b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:29.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98b8d62700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f98b406c0a0 0x7f98b4072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42244/0 (socket says 172.21.15.80:42244) 2019-11-28T11:52:29.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98b8d62700 1 -- 172.21.15.80:0/642228864 learned_addr learned my addr 172.21.15.80:0/642228864 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:29.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98b9563700 1 --2- 172.21.15.80:0/642228864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b406ce60 0x7f98b4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:29.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98b3fff700 1 -- 172.21.15.80:0/642228864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b406ce60 msgr2=0x7f98b4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:29.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98b3fff700 1 --2- 172.21.15.80:0/642228864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b406ce60 0x7f98b4164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:29.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98b3fff700 1 -- 172.21.15.80:0/642228864 >> v1:172.21.15.80:6789/0 conn(0x7f98b406c0a0 legacy=0x7f98b4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:29.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98b37fe700 1 -- 172.21.15.80:0/642228864 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862742040 0 0) 0x7f989c001150 con 0x7f98b406c0a0 2019-11-28T11:52:29.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98b3fff700 1 -- 172.21.15.80:0/642228864 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b40706c0 con 0x7f98b406c490 2019-11-28T11:52:29.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98b3fff700 1 --2- 172.21.15.80:0/642228864 >> v2:172.21.15.80:3300/0 conn(0x7f98b406c490 0x7f98b406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f98a400b2d0 tx=0x7f98a400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98b3fff700 1 --2- 172.21.15.80:0/642228864 >> v2:172.21.15.80:3300/0 conn(0x7f98b406c490 0x7f98b406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f98a400b2d0 tx=0x7f98a400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98b3fff700 1 --2- 172.21.15.80:0/642228864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b406c490 0x7f98b406c920 secure :-1 s=READY pgs=2194 cs=0 l=1 rx=0x7f98a400b2d0 tx=0x7f98a400ba60).ready entity=mon.0 client_cookie=821fe8a471477c6c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:29.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98b3fff700 1 --2- 172.21.15.80:0/642228864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b406c490 0x7f98b406c920 secure :-1 s=THROTTLE_DONE pgs=2194 cs=0 l=1 rx=0x7f98a400b2d0 tx=0x7f98a400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.247+0000 7f98b37fe700 1 -- 172.21.15.80:0/642228864 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98a4007590 con 0x7f98b406c490 2019-11-28T11:52:29.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.248+0000 7f98b3fff700 1 --2- 172.21.15.80:0/642228864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b406c490 0x7f98b406c920 secure :-1 s=THROTTLE_DONE pgs=2194 cs=0 l=1 rx=0x7f98a400b2d0 tx=0x7f98a400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.248+0000 7f98b3fff700 1 --2- 172.21.15.80:0/642228864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b406c490 0x7f98b406c920 secure :-1 s=THROTTLE_DONE pgs=2194 cs=0 l=1 rx=0x7f98a400b2d0 tx=0x7f98a400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.248+0000 7f98b37fe700 1 -- 172.21.15.80:0/642228864 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a4009d30 con 0x7f98b406c490 2019-11-28T11:52:29.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.248+0000 7f98b37fe700 1 -- 172.21.15.80:0/642228864 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98a4009f20 con 0x7f98b406c490 2019-11-28T11:52:29.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.248+0000 7f98ba7c5700 1 -- 172.21.15.80:0/642228864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b406c490 msgr2=0x7f98b406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:29.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.248+0000 7f98ba7c5700 1 --2- 172.21.15.80:0/642228864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b406c490 0x7f98b406c920 secure :-1 s=READY pgs=2194 cs=0 l=1 rx=0x7f98a400b2d0 tx=0x7f98a400ba60).stop 2019-11-28T11:52:29.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.248+0000 7f98ba7c5700 1 -- 172.21.15.80:0/642228864 shutdown_connections 2019-11-28T11:52:29.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.248+0000 7f98ba7c5700 1 --2- 172.21.15.80:0/642228864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b406ce60 0x7f98b4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:29.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.248+0000 7f98ba7c5700 1 --2- 172.21.15.80:0/642228864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b406c490 0x7f98b406c920 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:29.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.248+0000 7f98ba7c5700 1 -- 172.21.15.80:0/642228864 shutdown_connections 2019-11-28T11:52:29.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.248+0000 7f98ba7c5700 1 -- 172.21.15.80:0/642228864 wait complete. 2019-11-28T11:52:29.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.248+0000 7f98ba7c5700 1 -- 172.21.15.80:0/642228864 >> 172.21.15.80:0/642228864 conn(0x7f98b4061cf0 msgr2=0x7f98b4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:29.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.251+0000 7f98ba7c5700 1 Processor -- start 2019-11-28T11:52:29.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.251+0000 7f98ba7c5700 1 -- start start 2019-11-28T11:52:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98ba7c5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f98b413e900 0x7f98b4121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:29.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98ba7c5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b4139df0 con 0x7f98b4121c90 2019-11-28T11:52:29.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98ba7c5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b413ef30 con 0x7f98b41211a0 2019-11-28T11:52:29.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98ba7c5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b4128920 con 0x7f98b413e900 2019-11-28T11:52:29.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98b3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f98b4121c90 0x7f98b41209a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42250/0 (socket says 172.21.15.80:42250) 2019-11-28T11:52:29.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98b3fff700 1 -- 172.21.15.80:0/2040248747 learned_addr learned my addr 172.21.15.80:0/2040248747 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:29.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98b8d62700 1 --2- 172.21.15.80:0/2040248747 >> v2:172.21.15.174:3300/0 conn(0x7f98b413e900 0x7f98b4121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98b17fa700 1 -- 172.21.15.80:0/2040248747 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813406740 0 0) 0x7f98a4009ba0 con 0x7f98b4121c90 2019-11-28T11:52:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98b17fa700 1 -- 172.21.15.80:0/2040248747 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9898002e80 con 0x7f98b4121c90 2019-11-28T11:52:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98b17fa700 1 -- 172.21.15.80:0/2040248747 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3518329012 0 0) 0x7f98a4009d10 con 0x7f98b4121c90 2019-11-28T11:52:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98b8d62700 1 -- 172.21.15.80:0/2040248747 >> v1:172.21.15.174:6789/0 conn(0x7f98b41211a0 legacy=0x7f98b413a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98b8d62700 1 -- 172.21.15.80:0/2040248747 >> v1:172.21.15.80:6789/0 conn(0x7f98b4121c90 legacy=0x7f98b41209a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98b8d62700 1 -- 172.21.15.80:0/2040248747 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b4128fb0 con 0x7f98b413e900 2019-11-28T11:52:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98b8d62700 1 --2- 172.21.15.80:0/2040248747 >> v2:172.21.15.174:3300/0 conn(0x7f98b413e900 0x7f98b4121750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f989c010370 tx=0x7f989c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98b8d62700 1 --2- 172.21.15.80:0/2040248747 >> v2:172.21.15.174:3300/0 conn(0x7f98b413e900 0x7f98b4121750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f989c010370 tx=0x7f989c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98b8d62700 1 --2- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b413e900 0x7f98b4121750 secure :-1 s=READY pgs=1308 cs=0 l=1 rx=0x7f989c010370 tx=0x7f989c010710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:29.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98b8d62700 1 --2- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b413e900 0x7f98b4121750 secure :-1 s=THROTTLE_DONE pgs=1308 cs=0 l=1 rx=0x7f989c010370 tx=0x7f989c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98b8d62700 1 --2- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b413e900 0x7f98b4121750 secure :-1 s=THROTTLE_DONE pgs=1308 cs=0 l=1 rx=0x7f989c010370 tx=0x7f989c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98b17fa700 1 -- 172.21.15.80:0/2040248747 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f989c000ef0 con 0x7f98b413e900 2019-11-28T11:52:29.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.252+0000 7f98b8d62700 1 --2- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b413e900 0x7f98b4121750 secure :-1 s=THROTTLE_DONE pgs=1308 cs=0 l=1 rx=0x7f989c010370 tx=0x7f989c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.253+0000 7f98b17fa700 1 -- 172.21.15.80:0/2040248747 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c004240 con 0x7f98b413e900 2019-11-28T11:52:29.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.253+0000 7f98ba7c5700 1 -- 172.21.15.80:0/2040248747 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b4129330 con 0x7f98b413e900 2019-11-28T11:52:29.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.253+0000 7f98b17fa700 1 -- 172.21.15.80:0/2040248747 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f989c004910 con 0x7f98b413e900 2019-11-28T11:52:29.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.253+0000 7f98ba7c5700 1 -- 172.21.15.80:0/2040248747 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b41281b0 con 0x7f98b413e900 2019-11-28T11:52:29.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.253+0000 7f98b8d62700 1 --2- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b413e900 0x7f98b4121750 secure :-1 s=THROTTLE_DONE pgs=1308 cs=0 l=1 rx=0x7f989c010370 tx=0x7f989c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.253+0000 7f98b17fa700 1 -- 172.21.15.80:0/2040248747 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f989c004430 con 0x7f98b413e900 2019-11-28T11:52:29.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.253+0000 7f98b8d62700 1 --2- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b413e900 0x7f98b4121750 secure :-1 s=THROTTLE_DONE pgs=1308 cs=0 l=1 rx=0x7f989c010370 tx=0x7f989c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.253+0000 7f98b17fa700 1 --2- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9898018780 0x7f989801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:29.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.253+0000 7f98b17fa700 1 -- 172.21.15.80:0/2040248747 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f989c031a60 con 0x7f98b413e900 2019-11-28T11:52:29.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.253+0000 7f98b3fff700 1 --2- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9898018780 0x7f989801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:29.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.254+0000 7f98b3fff700 1 --2- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9898018780 0x7f989801abf0 crc :-1 s=READY pgs=898 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:29.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.261+0000 7f98ba7c5700 1 -- 172.21.15.80:0/2040248747 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b4128fb0 con 0x7f98b413e900 2019-11-28T11:52:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.265+0000 7f98b8d62700 1 --2- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b413e900 0x7f98b4121750 secure :-1 s=THROTTLE_DONE pgs=1308 cs=0 l=1 rx=0x7f989c010370 tx=0x7f989c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.265+0000 7f98b17fa700 1 -- 172.21.15.80:0/2040248747 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f989c02cfe0 con 0x7f98b413e900 2019-11-28T11:52:29.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.429+0000 7f98ba7c5700 1 -- 172.21.15.80:0/2040248747 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f98b4129330 con 0x7f98b413e900 2019-11-28T11:52:29.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.429+0000 7f98b8d62700 1 --2- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b413e900 0x7f98b4121750 secure :-1 s=THROTTLE_DONE pgs=1308 cs=0 l=1 rx=0x7f989c010370 tx=0x7f989c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.429+0000 7f98b17fa700 1 -- 172.21.15.80:0/2040248747 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v172) v1 ==== 84+0+64 (secure 0 0 0) 0x7f989c02cfe0 con 0x7f98b413e900 2019-11-28T11:52:29.483 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:29.483 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:52:29.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:29.484 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:52:29.484 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:52:29.484 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:29.484 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:52:29.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.432+0000 7f98ba7c5700 1 -- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9898018780 msgr2=0x7f989801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:29.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.432+0000 7f98ba7c5700 1 --2- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9898018780 0x7f989801abf0 crc :-1 s=READY pgs=898 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:29.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.432+0000 7f98ba7c5700 1 -- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b413e900 msgr2=0x7f98b4121750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.432+0000 7f98ba7c5700 1 --2- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b413e900 0x7f98b4121750 secure :-1 s=READY pgs=1308 cs=0 l=1 rx=0x7f989c010370 tx=0x7f989c010710).stop 2019-11-28T11:52:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.432+0000 7f98ba7c5700 1 -- 172.21.15.80:0/2040248747 shutdown_connections 2019-11-28T11:52:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.432+0000 7f98ba7c5700 1 --2- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9898018780 0x7f989801abf0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.432+0000 7f98ba7c5700 1 --2- 172.21.15.80:0/2040248747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b413e900 0x7f98b4121750 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.432+0000 7f98ba7c5700 1 -- 172.21.15.80:0/2040248747 shutdown_connections 2019-11-28T11:52:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.432+0000 7f98ba7c5700 1 -- 172.21.15.80:0/2040248747 wait complete. 2019-11-28T11:52:29.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.432+0000 7f98ba7c5700 1 -- 172.21.15.80:0/2040248747 >> 172.21.15.80:0/2040248747 conn(0x7f98b4127dc0 msgr2=0x7f98b4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:29.495 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:52:29.495 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:52:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.565+0000 7fe814028700 1 Processor -- start 2019-11-28T11:52:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.565+0000 7fe814028700 1 -- start start 2019-11-28T11:52:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.566+0000 7fe814028700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe80c15ed10 0x7fe80c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.566+0000 7fe814028700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe80c0734b0 0x7fe80c0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:29.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.566+0000 7fe814028700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c06db60 con 0x7fe80c073020 2019-11-28T11:52:29.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.566+0000 7fe814028700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c06fe00 con 0x7fe80c15ed10 2019-11-28T11:52:29.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.566+0000 7fe814028700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0700d0 con 0x7fe80c0734b0 2019-11-28T11:52:29.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.566+0000 7fe812dc6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe80c0734b0 0x7fe80c0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:29.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.566+0000 7fe8125c5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe80c15ed10 0x7fe80c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:29.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.566+0000 7fe811dc4700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe80c073020 0x7fe80c071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:57804/0 (socket says 172.21.15.80:57804) 2019-11-28T11:52:29.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.566+0000 7fe8125c5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe80c15ed10 0x7fe80c15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:57826/0 (socket says 172.21.15.80:57826) 2019-11-28T11:52:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.566+0000 7fe812dc6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe80c0734b0 0x7fe80c0726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:45202/0 (socket says 172.21.15.80:45202) 2019-11-28T11:52:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.566+0000 7fe811dc4700 1 -- 172.21.15.80:0/917686585 learned_addr learned my addr 172.21.15.80:0/917686585 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe8125c5700 1 -- 172.21.15.80:0/917686585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe80c0734b0 msgr2=0x7fe80c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe8125c5700 1 --2- 172.21.15.80:0/917686585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe80c0734b0 0x7fe80c0726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe8125c5700 1 -- 172.21.15.80:0/917686585 >> v1:172.21.15.174:6789/0 conn(0x7fe80c073020 legacy=0x7fe80c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe8115c3700 1 -- 172.21.15.80:0/917686585 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776642834 0 0) 0x7fe7f4001070 con 0x7fe80c073020 2019-11-28T11:52:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe8125c5700 1 -- 172.21.15.80:0/917686585 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c070760 con 0x7fe80c15ed10 2019-11-28T11:52:29.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe812dc6700 1 --2- 172.21.15.80:0/917686585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe80c0734b0 0x7fe80c0726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:29.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe8125c5700 1 --2- 172.21.15.80:0/917686585 >> v2:172.21.15.174:3300/0 conn(0x7fe80c15ed10 0x7fe80c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe7fc00af50 tx=0x7fe7fc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe8125c5700 1 --2- 172.21.15.80:0/917686585 >> v2:172.21.15.174:3300/0 conn(0x7fe80c15ed10 0x7fe80c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe7fc00af50 tx=0x7fe7fc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe8125c5700 1 --2- 172.21.15.80:0/917686585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c15ed10 0x7fe80c15f100 secure :-1 s=READY pgs=1310 cs=0 l=1 rx=0x7fe7fc00af50 tx=0x7fe7fc00b760).ready entity=mon.1 client_cookie=93db142ed8aa45cb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:29.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe8125c5700 1 --2- 172.21.15.80:0/917686585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c15ed10 0x7fe80c15f100 secure :-1 s=THROTTLE_DONE pgs=1310 cs=0 l=1 rx=0x7fe7fc00af50 tx=0x7fe7fc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe8115c3700 1 -- 172.21.15.80:0/917686585 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7fc007210 con 0x7fe80c15ed10 2019-11-28T11:52:29.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe8125c5700 1 --2- 172.21.15.80:0/917686585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c15ed10 0x7fe80c15f100 secure :-1 s=THROTTLE_DONE pgs=1310 cs=0 l=1 rx=0x7fe7fc00af50 tx=0x7fe7fc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe8125c5700 1 --2- 172.21.15.80:0/917686585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c15ed10 0x7fe80c15f100 secure :-1 s=THROTTLE_DONE pgs=1310 cs=0 l=1 rx=0x7fe7fc00af50 tx=0x7fe7fc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe8115c3700 1 -- 172.21.15.80:0/917686585 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc0099b0 con 0x7fe80c15ed10 2019-11-28T11:52:29.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe8115c3700 1 -- 172.21.15.80:0/917686585 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7fc00a080 con 0x7fe80c15ed10 2019-11-28T11:52:29.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe814028700 1 -- 172.21.15.80:0/917686585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c15ed10 msgr2=0x7fe80c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:29.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.567+0000 7fe814028700 1 --2- 172.21.15.80:0/917686585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c15ed10 0x7fe80c15f100 secure :-1 s=READY pgs=1310 cs=0 l=1 rx=0x7fe7fc00af50 tx=0x7fe7fc00b760).stop 2019-11-28T11:52:29.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.568+0000 7fe814028700 1 -- 172.21.15.80:0/917686585 shutdown_connections 2019-11-28T11:52:29.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.568+0000 7fe814028700 1 --2- 172.21.15.80:0/917686585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe80c0734b0 0x7fe80c0726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:29.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.568+0000 7fe814028700 1 --2- 172.21.15.80:0/917686585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c15ed10 0x7fe80c15f100 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:29.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.568+0000 7fe814028700 1 -- 172.21.15.80:0/917686585 shutdown_connections 2019-11-28T11:52:29.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.568+0000 7fe814028700 1 -- 172.21.15.80:0/917686585 wait complete. 2019-11-28T11:52:29.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.568+0000 7fe814028700 1 -- 172.21.15.80:0/917686585 >> 172.21.15.80:0/917686585 conn(0x7fe80c061d20 msgr2=0x7fe80c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.570+0000 7fe814028700 1 Processor -- start 2019-11-28T11:52:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.570+0000 7fe814028700 1 -- start start 2019-11-28T11:52:29.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.571+0000 7fe814028700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe80c1079b0 0x7fe80c107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:29.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.571+0000 7fe814028700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe80c108380 0x7fe80c168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:29.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.571+0000 7fe814028700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c1087d0 con 0x7fe80c148320 2019-11-28T11:52:29.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.571+0000 7fe814028700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c13aa20 con 0x7fe80c108380 2019-11-28T11:52:29.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.571+0000 7fe814028700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c13acf0 con 0x7fe80c1079b0 2019-11-28T11:52:29.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.571+0000 7fe8125c5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe80c148320 0x7fe80c10ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42262/0 (socket says 172.21.15.80:42262) 2019-11-28T11:52:29.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.571+0000 7fe8125c5700 1 -- 172.21.15.80:0/2479291855 learned_addr learned my addr 172.21.15.80:0/2479291855 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:29.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.571+0000 7fe812dc6700 1 --2- 172.21.15.80:0/2479291855 >> v2:172.21.15.174:3300/0 conn(0x7fe80c108380 0x7fe80c168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:29.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.571+0000 7fe811dc4700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe80c1079b0 0x7fe80c107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:29.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.571+0000 7fe80affd700 1 -- 172.21.15.80:0/2479291855 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854560244 0 0) 0x7fe7fc00abb0 con 0x7fe80c148320 2019-11-28T11:52:29.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.571+0000 7fe80affd700 1 -- 172.21.15.80:0/2479291855 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7f0002e80 con 0x7fe80c148320 2019-11-28T11:52:29.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe812dc6700 1 -- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe80c1079b0 msgr2=0x7fe80c107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:29.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe812dc6700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe80c1079b0 0x7fe80c107e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:29.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe812dc6700 1 -- 172.21.15.80:0/2479291855 >> v1:172.21.15.80:6789/0 conn(0x7fe80c148320 legacy=0x7fe80c10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:29.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe812dc6700 1 -- 172.21.15.80:0/2479291855 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c10c490 con 0x7fe80c108380 2019-11-28T11:52:29.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe811dc4700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe80c1079b0 0x7fe80c107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:29.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe812dc6700 1 --2- 172.21.15.80:0/2479291855 >> v2:172.21.15.174:3300/0 conn(0x7fe80c108380 0x7fe80c168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe804010720 tx=0x7fe804010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe812dc6700 1 --2- 172.21.15.80:0/2479291855 >> v2:172.21.15.174:3300/0 conn(0x7fe80c108380 0x7fe80c168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe804010720 tx=0x7fe804010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe812dc6700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c108380 0x7fe80c168d80 secure :-1 s=READY pgs=1311 cs=0 l=1 rx=0x7fe804010720 tx=0x7fe804010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:29.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe812dc6700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c108380 0x7fe80c168d80 secure :-1 s=THROTTLE_DONE pgs=1311 cs=0 l=1 rx=0x7fe804010720 tx=0x7fe804010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe80affd700 1 -- 172.21.15.80:0/2479291855 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe80400a9f0 con 0x7fe80c108380 2019-11-28T11:52:29.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe812dc6700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c108380 0x7fe80c168d80 secure :-1 s=THROTTLE_DONE pgs=1311 cs=0 l=1 rx=0x7fe804010720 tx=0x7fe804010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe80affd700 1 -- 172.21.15.80:0/2479291855 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe804009930 con 0x7fe80c108380 2019-11-28T11:52:29.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe812dc6700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c108380 0x7fe80c168d80 secure :-1 s=THROTTLE_DONE pgs=1311 cs=0 l=1 rx=0x7fe804010720 tx=0x7fe804010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe814028700 1 -- 172.21.15.80:0/2479291855 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c10c810 con 0x7fe80c108380 2019-11-28T11:52:29.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe80affd700 1 -- 172.21.15.80:0/2479291855 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe80400a9f0 con 0x7fe80c108380 2019-11-28T11:52:29.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe814028700 1 -- 172.21.15.80:0/2479291855 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c10c490 con 0x7fe80c108380 2019-11-28T11:52:29.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.572+0000 7fe812dc6700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c108380 0x7fe80c168d80 secure :-1 s=THROTTLE_DONE pgs=1311 cs=0 l=1 rx=0x7fe804010720 tx=0x7fe804010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.573+0000 7fe80affd700 1 -- 172.21.15.80:0/2479291855 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe804009b20 con 0x7fe80c108380 2019-11-28T11:52:29.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.573+0000 7fe812dc6700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c108380 0x7fe80c168d80 secure :-1 s=THROTTLE_DONE pgs=1311 cs=0 l=1 rx=0x7fe804010720 tx=0x7fe804010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.573+0000 7fe80affd700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe7f0018770 0x7fe7f001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:29.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.573+0000 7fe80affd700 1 -- 172.21.15.80:0/2479291855 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fe804031d40 con 0x7fe80c108380 2019-11-28T11:52:29.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.573+0000 7fe8125c5700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe7f0018770 0x7fe7f001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:29.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.573+0000 7fe8125c5700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe7f0018770 0x7fe7f001abe0 crc :-1 s=READY pgs=899 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:29.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.580+0000 7fe814028700 1 -- 172.21.15.80:0/2479291855 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c10c810 con 0x7fe80c108380 2019-11-28T11:52:29.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.584+0000 7fe812dc6700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c108380 0x7fe80c168d80 secure :-1 s=THROTTLE_DONE pgs=1311 cs=0 l=1 rx=0x7fe804010720 tx=0x7fe804010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:29.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.584+0000 7fe80affd700 1 -- 172.21.15.80:0/2479291855 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe80402b3b0 con 0x7fe80c108380 2019-11-28T11:52:29.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:29.754+0000 7fe814028700 1 -- 172.21.15.80:0/2479291855 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7fe80c10c490 con 0x7fe80c108380 2019-11-28T11:52:30.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.120+0000 7fe812dc6700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c108380 0x7fe80c168d80 secure :-1 s=THROTTLE_DONE pgs=1311 cs=0 l=1 rx=0x7fe804010720 tx=0x7fe804010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:30.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.120+0000 7fe80affd700 1 -- 172.21.15.80:0/2479291855 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v173) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe80402b3b0 con 0x7fe80c108380 2019-11-28T11:52:30.221 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:52:30.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.171+0000 7fe814028700 1 -- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe7f0018770 msgr2=0x7fe7f001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:30.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.171+0000 7fe814028700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe7f0018770 0x7fe7f001abe0 crc :-1 s=READY pgs=899 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:30.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.171+0000 7fe814028700 1 -- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c108380 msgr2=0x7fe80c168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:30.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.171+0000 7fe814028700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c108380 0x7fe80c168d80 secure :-1 s=READY pgs=1311 cs=0 l=1 rx=0x7fe804010720 tx=0x7fe804010ac0).stop 2019-11-28T11:52:30.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.171+0000 7fe814028700 1 -- 172.21.15.80:0/2479291855 shutdown_connections 2019-11-28T11:52:30.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.171+0000 7fe814028700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe7f0018770 0x7fe7f001abe0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:30.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.171+0000 7fe814028700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe80c108380 0x7fe80c168d80 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:30.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.171+0000 7fe814028700 1 --2- 172.21.15.80:0/2479291855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe80c1079b0 0x7fe80c107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:30.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.171+0000 7fe814028700 1 -- 172.21.15.80:0/2479291855 shutdown_connections 2019-11-28T11:52:30.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.171+0000 7fe814028700 1 -- 172.21.15.80:0/2479291855 wait complete. 2019-11-28T11:52:30.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.171+0000 7fe814028700 1 -- 172.21.15.80:0/2479291855 >> 172.21.15.80:0/2479291855 conn(0x7fe80c15e2d0 msgr2=0x7fe80c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:30.234 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:52:30.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.303+0000 7febb493c700 1 Processor -- start 2019-11-28T11:52:30.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.303+0000 7febb493c700 1 -- start start 2019-11-28T11:52:30.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.304+0000 7febb493c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7febb015f100 0x7febb006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:30.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.304+0000 7febb493c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7febb006c2f0 0x7febb006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:30.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febb493c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb006db60 con 0x7febb015ed10 2019-11-28T11:52:30.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febb493c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb006fe00 con 0x7febb015f100 2019-11-28T11:52:30.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febb493c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb00700d0 con 0x7febb006c2f0 2019-11-28T11:52:30.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febae59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7febb015f100 0x7febb006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:30.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febae59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7febb015f100 0x7febb006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42958/0 (socket says 172.21.15.80:42958) 2019-11-28T11:52:30.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febae59c700 1 -- 172.21.15.80:0/1949586291 learned_addr learned my addr 172.21.15.80:0/1949586291 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:30.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febaf59e700 1 --2- 172.21.15.80:0/1949586291 >> v2:172.21.15.174:3300/0 conn(0x7febb006c2f0 0x7febb006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:30.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febae59c700 1 -- 172.21.15.80:0/1949586291 >> v2:172.21.15.174:3300/0 conn(0x7febb006c2f0 msgr2=0x7febb006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:30.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febae59c700 1 --2- 172.21.15.80:0/1949586291 >> v2:172.21.15.174:3300/0 conn(0x7febb006c2f0 0x7febb006c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:30.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febae59c700 1 -- 172.21.15.80:0/1949586291 >> v1:172.21.15.174:6789/0 conn(0x7febb015ed10 legacy=0x7febb0073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:30.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febae59c700 1 -- 172.21.15.80:0/1949586291 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb0070760 con 0x7febb015f100 2019-11-28T11:52:30.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febadd9b700 1 -- 172.21.15.80:0/1949586291 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634941540 0 0) 0x7feba0001080 con 0x7febb015ed10 2019-11-28T11:52:30.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febae59c700 1 --2- 172.21.15.80:0/1949586291 >> v2:172.21.15.80:3300/0 conn(0x7febb015f100 0x7febb006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feb9800fa40 tx=0x7feb9800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:30.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febae59c700 1 --2- 172.21.15.80:0/1949586291 >> v2:172.21.15.80:3300/0 conn(0x7febb015f100 0x7febb006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feb9800fa40 tx=0x7feb9800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:30.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febae59c700 1 --2- 172.21.15.80:0/1949586291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb015f100 0x7febb006bdb0 secure :-1 s=READY pgs=2197 cs=0 l=1 rx=0x7feb9800fa40 tx=0x7feb9800fde0).ready entity=mon.0 client_cookie=748f47f3833e26b1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:30.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febae59c700 1 --2- 172.21.15.80:0/1949586291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb015f100 0x7febb006bdb0 secure :-1 s=THROTTLE_DONE pgs=2197 cs=0 l=1 rx=0x7feb9800fa40 tx=0x7feb9800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:30.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febae59c700 1 --2- 172.21.15.80:0/1949586291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb015f100 0x7febb006bdb0 secure :-1 s=THROTTLE_DONE pgs=2197 cs=0 l=1 rx=0x7feb9800fa40 tx=0x7feb9800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:30.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febae59c700 1 --2- 172.21.15.80:0/1949586291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb015f100 0x7febb006bdb0 secure :-1 s=THROTTLE_DONE pgs=2197 cs=0 l=1 rx=0x7feb9800fa40 tx=0x7feb9800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:30.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.305+0000 7febadd9b700 1 -- 172.21.15.80:0/1949586291 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb98000ce0 con 0x7febb015f100 2019-11-28T11:52:30.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.306+0000 7febadd9b700 1 -- 172.21.15.80:0/1949586291 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb98001010 con 0x7febb015f100 2019-11-28T11:52:30.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.306+0000 7febadd9b700 1 -- 172.21.15.80:0/1949586291 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb980016a0 con 0x7febb015f100 2019-11-28T11:52:30.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.306+0000 7febb493c700 1 -- 172.21.15.80:0/1949586291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb015f100 msgr2=0x7febb006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:30.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.306+0000 7febb493c700 1 --2- 172.21.15.80:0/1949586291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb015f100 0x7febb006bdb0 secure :-1 s=READY pgs=2197 cs=0 l=1 rx=0x7feb9800fa40 tx=0x7feb9800fde0).stop 2019-11-28T11:52:30.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.306+0000 7febb493c700 1 -- 172.21.15.80:0/1949586291 shutdown_connections 2019-11-28T11:52:30.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.306+0000 7febb493c700 1 --2- 172.21.15.80:0/1949586291 >> v2:172.21.15.174:3300/0 conn(0x7febb006c2f0 0x7febb006c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:30.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.306+0000 7febb493c700 1 --2- 172.21.15.80:0/1949586291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb015f100 0x7febb006bdb0 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:30.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.306+0000 7febb493c700 1 -- 172.21.15.80:0/1949586291 shutdown_connections 2019-11-28T11:52:30.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.306+0000 7febb493c700 1 -- 172.21.15.80:0/1949586291 wait complete. 2019-11-28T11:52:30.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.306+0000 7febb493c700 1 -- 172.21.15.80:0/1949586291 >> 172.21.15.80:0/1949586291 conn(0x7febb0061d20 msgr2=0x7febb00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:30.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.309+0000 7febb493c700 1 Processor -- start 2019-11-28T11:52:30.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.309+0000 7febb493c700 1 -- start start 2019-11-28T11:52:30.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.309+0000 7febb493c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7febb0148320 0x7febb010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:30.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febb493c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7febb010e3d0 0x7febb0168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:30.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febb493c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb0148e00 con 0x7febb010f290 2019-11-28T11:52:30.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febb493c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb013aa20 con 0x7febb010e3d0 2019-11-28T11:52:30.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febb493c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb013acf0 con 0x7febb0148320 2019-11-28T11:52:30.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febaf59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7febb010e3d0 0x7febb0168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:30.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febaf59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7febb010e3d0 0x7febb0168d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42964/0 (socket says 172.21.15.80:42964) 2019-11-28T11:52:30.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febaf59e700 1 -- 172.21.15.80:0/577324258 learned_addr learned my addr 172.21.15.80:0/577324258 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:30.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febaed9d700 1 --2- 172.21.15.80:0/577324258 >> v2:172.21.15.174:3300/0 conn(0x7febb0148320 0x7febb010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:30.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febaf59e700 1 -- 172.21.15.80:0/577324258 >> v2:172.21.15.174:3300/0 conn(0x7febb0148320 msgr2=0x7febb010ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:30.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febaf59e700 1 --2- 172.21.15.80:0/577324258 >> v2:172.21.15.174:3300/0 conn(0x7febb0148320 0x7febb010ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:30.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febaf59e700 1 -- 172.21.15.80:0/577324258 >> v1:172.21.15.174:6789/0 conn(0x7febb010f290 legacy=0x7febb010dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:30.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febaf59e700 1 -- 172.21.15.80:0/577324258 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb010c490 con 0x7febb010e3d0 2019-11-28T11:52:30.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febaf59e700 1 --2- 172.21.15.80:0/577324258 >> v2:172.21.15.80:3300/0 conn(0x7febb010e3d0 0x7febb0168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feba8010440 tx=0x7feba8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:30.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febaf59e700 1 --2- 172.21.15.80:0/577324258 >> v2:172.21.15.80:3300/0 conn(0x7febb010e3d0 0x7febb0168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feba8010440 tx=0x7feba8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:30.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febaf59e700 1 --2- 172.21.15.80:0/577324258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb010e3d0 0x7febb0168d80 secure :-1 s=READY pgs=2198 cs=0 l=1 rx=0x7feba8010440 tx=0x7feba8006f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:30.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febaf59e700 1 --2- 172.21.15.80:0/577324258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb010e3d0 0x7febb0168d80 secure :-1 s=THROTTLE_DONE pgs=2198 cs=0 l=1 rx=0x7feba8010440 tx=0x7feba8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:30.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febaf59e700 1 --2- 172.21.15.80:0/577324258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb010e3d0 0x7febb0168d80 secure :-1 s=THROTTLE_DONE pgs=2198 cs=0 l=1 rx=0x7feba8010440 tx=0x7feba8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:30.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7feba77fe700 1 -- 172.21.15.80:0/577324258 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feba8000a70 con 0x7febb010e3d0 2019-11-28T11:52:30.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febaf59e700 1 --2- 172.21.15.80:0/577324258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb010e3d0 0x7febb0168d80 secure :-1 s=THROTTLE_DONE pgs=2198 cs=0 l=1 rx=0x7feba8010440 tx=0x7feba8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:30.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7feba77fe700 1 -- 172.21.15.80:0/577324258 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba800ecb0 con 0x7febb010e3d0 2019-11-28T11:52:30.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febb493c700 1 -- 172.21.15.80:0/577324258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb010c810 con 0x7febb010e3d0 2019-11-28T11:52:30.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7feba77fe700 1 -- 172.21.15.80:0/577324258 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feba800f380 con 0x7febb010e3d0 2019-11-28T11:52:30.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.310+0000 7febb493c700 1 -- 172.21.15.80:0/577324258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb010c490 con 0x7febb010e3d0 2019-11-28T11:52:30.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.311+0000 7febaf59e700 1 --2- 172.21.15.80:0/577324258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb010e3d0 0x7febb0168d80 secure :-1 s=THROTTLE_DONE pgs=2198 cs=0 l=1 rx=0x7feba8010440 tx=0x7feba8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:30.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.311+0000 7feba77fe700 1 -- 172.21.15.80:0/577324258 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7feba8000a70 con 0x7febb010e3d0 2019-11-28T11:52:30.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.311+0000 7febaf59e700 1 --2- 172.21.15.80:0/577324258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb010e3d0 0x7febb0168d80 secure :-1 s=THROTTLE_DONE pgs=2198 cs=0 l=1 rx=0x7feba8010440 tx=0x7feba8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:30.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.311+0000 7feba77fe700 1 --2- 172.21.15.80:0/577324258 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb88018730 0x7feb8801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:30.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.311+0000 7feba77fe700 1 -- 172.21.15.80:0/577324258 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5554+0+0 (secure 0 0 0) 0x7feba8031a70 con 0x7febb010e3d0 2019-11-28T11:52:30.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.311+0000 7febaed9d700 1 --2- 172.21.15.80:0/577324258 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb88018730 0x7feb8801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:30.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.312+0000 7febaed9d700 1 --2- 172.21.15.80:0/577324258 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb88018730 0x7feb8801abc0 crc :-1 s=READY pgs=900 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:30.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.319+0000 7febb493c700 1 -- 172.21.15.80:0/577324258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb010c810 con 0x7febb010e3d0 2019-11-28T11:52:30.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.322+0000 7febaf59e700 1 --2- 172.21.15.80:0/577324258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb010e3d0 0x7febb0168d80 secure :-1 s=THROTTLE_DONE pgs=2198 cs=0 l=1 rx=0x7feba8010440 tx=0x7feba8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:30.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.322+0000 7feba77fe700 1 -- 172.21.15.80:0/577324258 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7feba800d0a0 con 0x7febb010e3d0 2019-11-28T11:52:30.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:30.493+0000 7febb493c700 1 -- 172.21.15.80:0/577324258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7febb010c490 con 0x7febb010e3d0 2019-11-28T11:52:31.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.122+0000 7febaf59e700 1 --2- 172.21.15.80:0/577324258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb010e3d0 0x7febb0168d80 secure :-1 s=THROTTLE_DONE pgs=2198 cs=0 l=1 rx=0x7feba8010440 tx=0x7feba8006f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.122+0000 7feba77fe700 1 -- 172.21.15.80:0/577324258 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v174) v1 ==== 125+0+0 (secure 0 0 0) 0x7feba800d0a0 con 0x7febb010e3d0 2019-11-28T11:52:31.213 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:52:31.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.160+0000 7febb493c700 1 -- 172.21.15.80:0/577324258 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb88018730 msgr2=0x7feb8801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:31.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.160+0000 7febb493c700 1 --2- 172.21.15.80:0/577324258 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb88018730 0x7feb8801abc0 crc :-1 s=READY pgs=900 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:31.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.160+0000 7febb493c700 1 -- 172.21.15.80:0/577324258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb010e3d0 msgr2=0x7febb0168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:31.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.160+0000 7febb493c700 1 --2- 172.21.15.80:0/577324258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb010e3d0 0x7febb0168d80 secure :-1 s=READY pgs=2198 cs=0 l=1 rx=0x7feba8010440 tx=0x7feba8006f90).stop 2019-11-28T11:52:31.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.160+0000 7febb493c700 1 -- 172.21.15.80:0/577324258 shutdown_connections 2019-11-28T11:52:31.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.160+0000 7febb493c700 1 --2- 172.21.15.80:0/577324258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7febb010e3d0 0x7febb0168d80 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:31.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.160+0000 7febb493c700 1 --2- 172.21.15.80:0/577324258 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feb88018730 0x7feb8801abc0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:31.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.160+0000 7febb493c700 1 --2- 172.21.15.80:0/577324258 >> v2:172.21.15.174:3300/0 conn(0x7febb0148320 0x7febb010ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:31.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.160+0000 7febb493c700 1 -- 172.21.15.80:0/577324258 shutdown_connections 2019-11-28T11:52:31.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.160+0000 7febb493c700 1 -- 172.21.15.80:0/577324258 wait complete. 2019-11-28T11:52:31.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.160+0000 7febb493c700 1 -- 172.21.15.80:0/577324258 >> 172.21.15.80:0/577324258 conn(0x7febb015e2d0 msgr2=0x7febb0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:31.223 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:52:31.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.295+0000 7f765d838700 1 Processor -- start 2019-11-28T11:52:31.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.295+0000 7f765d838700 1 -- start start 2019-11-28T11:52:31.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f765d838700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f765815f100 0x7f765806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:31.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f765d838700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f765806c2f0 0x7f765806c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:31.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f765d838700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765806db60 con 0x7f765815ed10 2019-11-28T11:52:31.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f765d838700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765806fe00 con 0x7f765806c2f0 2019-11-28T11:52:31.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f765d838700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76580700d0 con 0x7f765815f100 2019-11-28T11:52:31.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f7657fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f765806c2f0 0x7f765806c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:31.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f7657fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f765806c2f0 0x7f765806c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42970/0 (socket says 172.21.15.80:42970) 2019-11-28T11:52:31.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f7657fff700 1 -- 172.21.15.80:0/1250863380 learned_addr learned my addr 172.21.15.80:0/1250863380 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:31.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f7656ffd700 1 --2- 172.21.15.80:0/1250863380 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f765815f100 0x7f765806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:31.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f7657fff700 1 -- 172.21.15.80:0/1250863380 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f765815f100 msgr2=0x7f765806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:31.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f7657fff700 1 --2- 172.21.15.80:0/1250863380 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f765815f100 0x7f765806bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:31.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f7657fff700 1 -- 172.21.15.80:0/1250863380 >> v1:172.21.15.174:6789/0 conn(0x7f765815ed10 legacy=0x7f7658073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:31.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f7657fff700 1 -- 172.21.15.80:0/1250863380 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7658070760 con 0x7f765806c2f0 2019-11-28T11:52:31.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f7657fff700 1 --2- 172.21.15.80:0/1250863380 >> v2:172.21.15.80:3300/0 conn(0x7f765806c2f0 0x7f765806c790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f765000f6b0 tx=0x7f765000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f7657fff700 1 --2- 172.21.15.80:0/1250863380 >> v2:172.21.15.80:3300/0 conn(0x7f765806c2f0 0x7f765806c790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f765000f6b0 tx=0x7f765000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f7657fff700 1 --2- 172.21.15.80:0/1250863380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f765806c2f0 0x7f765806c790 secure :-1 s=READY pgs=2199 cs=0 l=1 rx=0x7f765000f6b0 tx=0x7f765000fa50).ready entity=mon.0 client_cookie=7e0cca36fb2e6270 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:31.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f7657fff700 1 --2- 172.21.15.80:0/1250863380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f765806c2f0 0x7f765806c790 secure :-1 s=THROTTLE_DONE pgs=2199 cs=0 l=1 rx=0x7f765000f6b0 tx=0x7f765000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f7657fff700 1 --2- 172.21.15.80:0/1250863380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f765806c2f0 0x7f765806c790 secure :-1 s=THROTTLE_DONE pgs=2199 cs=0 l=1 rx=0x7f765000f6b0 tx=0x7f765000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f76567fc700 1 -- 172.21.15.80:0/1250863380 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7650000a70 con 0x7f765806c2f0 2019-11-28T11:52:31.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f7657fff700 1 --2- 172.21.15.80:0/1250863380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f765806c2f0 0x7f765806c790 secure :-1 s=THROTTLE_DONE pgs=2199 cs=0 l=1 rx=0x7f765000f6b0 tx=0x7f765000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.296+0000 7f76567fc700 1 -- 172.21.15.80:0/1250863380 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76500010e0 con 0x7f765806c2f0 2019-11-28T11:52:31.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.297+0000 7f76567fc700 1 -- 172.21.15.80:0/1250863380 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76500017b0 con 0x7f765806c2f0 2019-11-28T11:52:31.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.297+0000 7f765d838700 1 -- 172.21.15.80:0/1250863380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f765806c2f0 msgr2=0x7f765806c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:31.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.297+0000 7f765d838700 1 --2- 172.21.15.80:0/1250863380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f765806c2f0 0x7f765806c790 secure :-1 s=READY pgs=2199 cs=0 l=1 rx=0x7f765000f6b0 tx=0x7f765000fa50).stop 2019-11-28T11:52:31.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.297+0000 7f765d838700 1 -- 172.21.15.80:0/1250863380 shutdown_connections 2019-11-28T11:52:31.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.297+0000 7f765d838700 1 --2- 172.21.15.80:0/1250863380 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f765806c2f0 0x7f765806c790 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:31.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.297+0000 7f765d838700 1 --2- 172.21.15.80:0/1250863380 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f765815f100 0x7f765806bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:31.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.297+0000 7f765d838700 1 -- 172.21.15.80:0/1250863380 shutdown_connections 2019-11-28T11:52:31.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.297+0000 7f765d838700 1 -- 172.21.15.80:0/1250863380 wait complete. 2019-11-28T11:52:31.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.297+0000 7f765d838700 1 -- 172.21.15.80:0/1250863380 >> 172.21.15.80:0/1250863380 conn(0x7f7658061d20 msgr2=0x7f76580641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:31.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.300+0000 7f765d838700 1 Processor -- start 2019-11-28T11:52:31.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.300+0000 7f765d838700 1 -- start start 2019-11-28T11:52:31.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f765d838700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7658148320 0x7f765810ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:31.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f765d838700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7658148e00 con 0x7f765810e3d0 2019-11-28T11:52:31.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f765d838700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7658108b10 con 0x7f765810f290 2019-11-28T11:52:31.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f765d838700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765813aa20 con 0x7f7658148320 2019-11-28T11:52:31.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f76577fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7658148320 0x7f765810ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:31.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f76577fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7658148320 0x7f765810ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42974/0 (socket says 172.21.15.80:42974) 2019-11-28T11:52:31.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f7657fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f765810e3d0 0x7f7658168d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42294/0 (socket says 172.21.15.80:42294) 2019-11-28T11:52:31.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f76577fe700 1 -- 172.21.15.80:0/3245412495 learned_addr learned my addr 172.21.15.80:0/3245412495 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:31.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f764ffff700 1 -- 172.21.15.80:0/3245412495 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177834447 0 0) 0x7f7640009900 con 0x7f765810f290 2019-11-28T11:52:31.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f76577fe700 1 -- 172.21.15.80:0/3245412495 >> v1:172.21.15.174:6789/0 conn(0x7f765810f290 legacy=0x7f765810dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:31.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f76577fe700 1 -- 172.21.15.80:0/3245412495 >> v1:172.21.15.80:6789/0 conn(0x7f765810e3d0 legacy=0x7f7658168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:31.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f76577fe700 1 -- 172.21.15.80:0/3245412495 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765810c490 con 0x7f7658148320 2019-11-28T11:52:31.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f76577fe700 1 --2- 172.21.15.80:0/3245412495 >> v2:172.21.15.80:3300/0 conn(0x7f7658148320 0x7f765810ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7648010410 tx=0x7f76480107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f76577fe700 1 --2- 172.21.15.80:0/3245412495 >> v2:172.21.15.80:3300/0 conn(0x7f7658148320 0x7f765810ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7648010410 tx=0x7f76480107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f76577fe700 1 --2- 172.21.15.80:0/3245412495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7658148320 0x7f765810ed50 secure :-1 s=READY pgs=2201 cs=0 l=1 rx=0x7f7648010410 tx=0x7f76480107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:31.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f76577fe700 1 --2- 172.21.15.80:0/3245412495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7658148320 0x7f765810ed50 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f7648010410 tx=0x7f76480107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f764ffff700 1 -- 172.21.15.80:0/3245412495 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7648000960 con 0x7f7658148320 2019-11-28T11:52:31.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f76577fe700 1 --2- 172.21.15.80:0/3245412495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7658148320 0x7f765810ed50 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f7648010410 tx=0x7f76480107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f76577fe700 1 --2- 172.21.15.80:0/3245412495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7658148320 0x7f765810ed50 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f7648010410 tx=0x7f76480107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f764ffff700 1 -- 172.21.15.80:0/3245412495 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76480010a0 con 0x7f7658148320 2019-11-28T11:52:31.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f765d838700 1 -- 172.21.15.80:0/3245412495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765810c810 con 0x7f7658148320 2019-11-28T11:52:31.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f764ffff700 1 -- 172.21.15.80:0/3245412495 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76480017f0 con 0x7f7658148320 2019-11-28T11:52:31.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.301+0000 7f765d838700 1 -- 172.21.15.80:0/3245412495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765810c490 con 0x7f7658148320 2019-11-28T11:52:31.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.302+0000 7f76577fe700 1 --2- 172.21.15.80:0/3245412495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7658148320 0x7f765810ed50 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f7648010410 tx=0x7f76480107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.302+0000 7f764ffff700 1 -- 172.21.15.80:0/3245412495 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7648001290 con 0x7f7658148320 2019-11-28T11:52:31.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.302+0000 7f76577fe700 1 --2- 172.21.15.80:0/3245412495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7658148320 0x7f765810ed50 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f7648010410 tx=0x7f76480107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.302+0000 7f764ffff700 1 --2- 172.21.15.80:0/3245412495 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7630018730 0x7f763001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:31.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.302+0000 7f764ffff700 1 -- 172.21.15.80:0/3245412495 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5904+0+0 (secure 0 0 0) 0x7f7648031b60 con 0x7f7658148320 2019-11-28T11:52:31.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.302+0000 7f7656ffd700 1 --2- 172.21.15.80:0/3245412495 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7630018730 0x7f763001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:31.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.303+0000 7f7656ffd700 1 --2- 172.21.15.80:0/3245412495 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7630018730 0x7f763001abc0 crc :-1 s=READY pgs=901 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:31.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.310+0000 7f765d838700 1 -- 172.21.15.80:0/3245412495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765810c810 con 0x7f7658148320 2019-11-28T11:52:31.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.313+0000 7f76577fe700 1 --2- 172.21.15.80:0/3245412495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7658148320 0x7f765810ed50 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f7648010410 tx=0x7f76480107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.313+0000 7f764ffff700 1 -- 172.21.15.80:0/3245412495 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f76480075b0 con 0x7f7658148320 2019-11-28T11:52:31.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.481+0000 7f765d838700 1 -- 172.21.15.80:0/3245412495 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f765810c490 con 0x7f7658148320 2019-11-28T11:52:31.534 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:52:31.482+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:52:31.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.485+0000 7f76577fe700 1 --2- 172.21.15.80:0/3245412495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7658148320 0x7f765810ed50 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f7648010410 tx=0x7f76480107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.485+0000 7f764ffff700 1 -- 172.21.15.80:0/3245412495 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 28 and data pool 29 v135) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7648017610 con 0x7f7658148320 2019-11-28T11:52:31.540 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 28 and data pool 29 2019-11-28T11:52:31.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.490+0000 7f765d838700 1 -- 172.21.15.80:0/3245412495 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7630018730 msgr2=0x7f763001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:31.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.490+0000 7f765d838700 1 --2- 172.21.15.80:0/3245412495 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7630018730 0x7f763001abc0 crc :-1 s=READY pgs=901 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:31.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.490+0000 7f765d838700 1 -- 172.21.15.80:0/3245412495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7658148320 msgr2=0x7f765810ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:31.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.490+0000 7f765d838700 1 --2- 172.21.15.80:0/3245412495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7658148320 0x7f765810ed50 secure :-1 s=READY pgs=2201 cs=0 l=1 rx=0x7f7648010410 tx=0x7f76480107b0).stop 2019-11-28T11:52:31.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.490+0000 7f765d838700 1 -- 172.21.15.80:0/3245412495 shutdown_connections 2019-11-28T11:52:31.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.490+0000 7f765d838700 1 --2- 172.21.15.80:0/3245412495 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7630018730 0x7f763001abc0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:31.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.490+0000 7f765d838700 1 --2- 172.21.15.80:0/3245412495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7658148320 0x7f765810ed50 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:31.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.491+0000 7f765d838700 1 -- 172.21.15.80:0/3245412495 shutdown_connections 2019-11-28T11:52:31.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.491+0000 7f765d838700 1 -- 172.21.15.80:0/3245412495 wait complete. 2019-11-28T11:52:31.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.491+0000 7f765d838700 1 -- 172.21.15.80:0/3245412495 >> 172.21.15.80:0/3245412495 conn(0x7f765815e2d0 msgr2=0x7f7658147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:31.553 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:52:31.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.619+0000 7f12f4fcc700 1 Processor -- start 2019-11-28T11:52:31.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.619+0000 7f12f4fcc700 1 -- start start 2019-11-28T11:52:31.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.620+0000 7f12f4fcc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f12f006c0a0 0x7f12f0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:31.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.620+0000 7f12f4fcc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f00734e0 0x7f12f0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:31.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.620+0000 7f12f4fcc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f006db00 con 0x7f12f0072360 2019-11-28T11:52:31.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.620+0000 7f12f4fcc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f006fd60 con 0x7f12f006c0a0 2019-11-28T11:52:31.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.620+0000 7f12f4fcc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f0070030 con 0x7f12f00734e0 2019-11-28T11:52:31.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.620+0000 7f12eed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f12f006c0a0 0x7f12f0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:31.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12eed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f12f006c0a0 0x7f12f0072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42982/0 (socket says 172.21.15.80:42982) 2019-11-28T11:52:31.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12ef59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f12f0072360 0x7f12f006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42300/0 (socket says 172.21.15.80:42300) 2019-11-28T11:52:31.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12eed9d700 1 -- 172.21.15.80:0/4095070778 learned_addr learned my addr 172.21.15.80:0/4095070778 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:31.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12ee59c700 1 --2- 172.21.15.80:0/4095070778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f00734e0 0x7f12f0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:31.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12eed9d700 1 -- 172.21.15.80:0/4095070778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f00734e0 msgr2=0x7f12f0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:31.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12eed9d700 1 --2- 172.21.15.80:0/4095070778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f00734e0 0x7f12f0071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:31.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12eed9d700 1 -- 172.21.15.80:0/4095070778 >> v1:172.21.15.80:6789/0 conn(0x7f12f0072360 legacy=0x7f12f006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:31.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12eed9d700 1 -- 172.21.15.80:0/4095070778 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f00706c0 con 0x7f12f006c0a0 2019-11-28T11:52:31.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12edd9b700 1 -- 172.21.15.80:0/4095070778 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741594721 0 0) 0x7f12e80009b0 con 0x7f12f0072360 2019-11-28T11:52:31.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12ee59c700 1 --2- 172.21.15.80:0/4095070778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f00734e0 0x7f12f0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:52:31.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12eed9d700 1 --2- 172.21.15.80:0/4095070778 >> v2:172.21.15.80:3300/0 conn(0x7f12f006c0a0 0x7f12f0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f12d800fac0 tx=0x7f12d800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12eed9d700 1 --2- 172.21.15.80:0/4095070778 >> v2:172.21.15.80:3300/0 conn(0x7f12f006c0a0 0x7f12f0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f12d800fac0 tx=0x7f12d800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12eed9d700 1 --2- 172.21.15.80:0/4095070778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f006c0a0 0x7f12f0072fa0 secure :-1 s=READY pgs=2203 cs=0 l=1 rx=0x7f12d800fac0 tx=0x7f12d800fe60).ready entity=mon.0 client_cookie=b59e91c6a4717e5d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:31.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12eed9d700 1 --2- 172.21.15.80:0/4095070778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f006c0a0 0x7f12f0072fa0 secure :-1 s=THROTTLE_DONE pgs=2203 cs=0 l=1 rx=0x7f12d800fac0 tx=0x7f12d800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12edd9b700 1 -- 172.21.15.80:0/4095070778 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12d8000ce0 con 0x7f12f006c0a0 2019-11-28T11:52:31.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12eed9d700 1 --2- 172.21.15.80:0/4095070778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f006c0a0 0x7f12f0072fa0 secure :-1 s=THROTTLE_DONE pgs=2203 cs=0 l=1 rx=0x7f12d800fac0 tx=0x7f12d800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12eed9d700 1 --2- 172.21.15.80:0/4095070778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f006c0a0 0x7f12f0072fa0 secure :-1 s=THROTTLE_DONE pgs=2203 cs=0 l=1 rx=0x7f12d800fac0 tx=0x7f12d800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12edd9b700 1 -- 172.21.15.80:0/4095070778 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d8001010 con 0x7f12f006c0a0 2019-11-28T11:52:31.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12edd9b700 1 -- 172.21.15.80:0/4095070778 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12d8001720 con 0x7f12f006c0a0 2019-11-28T11:52:31.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12f4fcc700 1 -- 172.21.15.80:0/4095070778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f006c0a0 msgr2=0x7f12f0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:31.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.621+0000 7f12f4fcc700 1 --2- 172.21.15.80:0/4095070778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f006c0a0 0x7f12f0072fa0 secure :-1 s=READY pgs=2203 cs=0 l=1 rx=0x7f12d800fac0 tx=0x7f12d800fe60).stop 2019-11-28T11:52:31.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.622+0000 7f12f4fcc700 1 -- 172.21.15.80:0/4095070778 shutdown_connections 2019-11-28T11:52:31.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.622+0000 7f12f4fcc700 1 --2- 172.21.15.80:0/4095070778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f00734e0 0x7f12f0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:31.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.622+0000 7f12f4fcc700 1 --2- 172.21.15.80:0/4095070778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f006c0a0 0x7f12f0072fa0 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:31.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.622+0000 7f12f4fcc700 1 -- 172.21.15.80:0/4095070778 shutdown_connections 2019-11-28T11:52:31.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.622+0000 7f12f4fcc700 1 -- 172.21.15.80:0/4095070778 wait complete. 2019-11-28T11:52:31.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.622+0000 7f12f4fcc700 1 -- 172.21.15.80:0/4095070778 >> 172.21.15.80:0/4095070778 conn(0x7f12f0061cf0 msgr2=0x7f12f0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:31.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.624+0000 7f12f4fcc700 1 Processor -- start 2019-11-28T11:52:31.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.624+0000 7f12f4fcc700 1 -- start start 2019-11-28T11:52:31.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.625+0000 7f12f4fcc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f12f013eb40 0x7f12f010afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:31.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.625+0000 7f12f4fcc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f12f010b500 0x7f12f01629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:31.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.625+0000 7f12f4fcc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f013f1e0 con 0x7f12f0162f30 2019-11-28T11:52:31.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.625+0000 7f12f4fcc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f01234c0 con 0x7f12f013eb40 2019-11-28T11:52:31.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.625+0000 7f12f4fcc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f013e0d0 con 0x7f12f010b500 2019-11-28T11:52:31.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.625+0000 7f12eed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f12f013eb40 0x7f12f010afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:31.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.625+0000 7f12eed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f12f013eb40 0x7f12f010afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42988/0 (socket says 172.21.15.80:42988) 2019-11-28T11:52:31.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.625+0000 7f12eed9d700 1 -- 172.21.15.80:0/2862419901 learned_addr learned my addr 172.21.15.80:0/2862419901 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:31.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12ee59c700 1 --2- 172.21.15.80:0/2862419901 >> v2:172.21.15.174:3300/0 conn(0x7f12f010b500 0x7f12f01629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:31.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12eed9d700 1 -- 172.21.15.80:0/2862419901 >> v2:172.21.15.174:3300/0 conn(0x7f12f010b500 msgr2=0x7f12f01629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:31.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12eed9d700 1 --2- 172.21.15.80:0/2862419901 >> v2:172.21.15.174:3300/0 conn(0x7f12f010b500 0x7f12f01629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:31.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12eed9d700 1 -- 172.21.15.80:0/2862419901 >> v1:172.21.15.80:6789/0 conn(0x7f12f0162f30 legacy=0x7f12f0109e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:31.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12eed9d700 1 -- 172.21.15.80:0/2862419901 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f0108700 con 0x7f12f013eb40 2019-11-28T11:52:31.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12eed9d700 1 --2- 172.21.15.80:0/2862419901 >> v2:172.21.15.80:3300/0 conn(0x7f12f013eb40 0x7f12f010afc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f12d8010730 tx=0x7f12d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12eed9d700 1 --2- 172.21.15.80:0/2862419901 >> v2:172.21.15.80:3300/0 conn(0x7f12f013eb40 0x7f12f010afc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f12d8010730 tx=0x7f12d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12eed9d700 1 --2- 172.21.15.80:0/2862419901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f013eb40 0x7f12f010afc0 secure :-1 s=READY pgs=2205 cs=0 l=1 rx=0x7f12d8010730 tx=0x7f12d8010ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:31.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12eed9d700 1 --2- 172.21.15.80:0/2862419901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f013eb40 0x7f12f010afc0 secure :-1 s=THROTTLE_DONE pgs=2205 cs=0 l=1 rx=0x7f12d8010730 tx=0x7f12d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12eed9d700 1 --2- 172.21.15.80:0/2862419901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f013eb40 0x7f12f010afc0 secure :-1 s=THROTTLE_DONE pgs=2205 cs=0 l=1 rx=0x7f12d8010730 tx=0x7f12d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12eed9d700 1 --2- 172.21.15.80:0/2862419901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f013eb40 0x7f12f010afc0 secure :-1 s=THROTTLE_DONE pgs=2205 cs=0 l=1 rx=0x7f12d8010730 tx=0x7f12d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12e77fe700 1 -- 172.21.15.80:0/2862419901 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12d8007620 con 0x7f12f013eb40 2019-11-28T11:52:31.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12e77fe700 1 -- 172.21.15.80:0/2862419901 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d80056f0 con 0x7f12f013eb40 2019-11-28T11:52:31.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12f4fcc700 1 -- 172.21.15.80:0/2862419901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f0108a80 con 0x7f12f013eb40 2019-11-28T11:52:31.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12e77fe700 1 -- 172.21.15.80:0/2862419901 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12d8005e60 con 0x7f12f013eb40 2019-11-28T11:52:31.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12f4fcc700 1 -- 172.21.15.80:0/2862419901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f0108700 con 0x7f12f013eb40 2019-11-28T11:52:31.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.626+0000 7f12eed9d700 1 --2- 172.21.15.80:0/2862419901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f013eb40 0x7f12f010afc0 secure :-1 s=THROTTLE_DONE pgs=2205 cs=0 l=1 rx=0x7f12d8010730 tx=0x7f12d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.627+0000 7f12e77fe700 1 -- 172.21.15.80:0/2862419901 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f12d80058e0 con 0x7f12f013eb40 2019-11-28T11:52:31.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.627+0000 7f12eed9d700 1 --2- 172.21.15.80:0/2862419901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f013eb40 0x7f12f010afc0 secure :-1 s=THROTTLE_DONE pgs=2205 cs=0 l=1 rx=0x7f12d8010730 tx=0x7f12d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.627+0000 7f12e77fe700 1 --2- 172.21.15.80:0/2862419901 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f12c8018730 0x7f12c801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:31.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.627+0000 7f12e77fe700 1 -- 172.21.15.80:0/2862419901 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f12d8031e20 con 0x7f12f013eb40 2019-11-28T11:52:31.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.627+0000 7f12ee59c700 1 --2- 172.21.15.80:0/2862419901 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f12c8018730 0x7f12c801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:31.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.627+0000 7f12ee59c700 1 --2- 172.21.15.80:0/2862419901 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f12c8018730 0x7f12c801abc0 crc :-1 s=READY pgs=902 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:31.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.635+0000 7f12f4fcc700 1 -- 172.21.15.80:0/2862419901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f0108a80 con 0x7f12f013eb40 2019-11-28T11:52:31.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.638+0000 7f12eed9d700 1 --2- 172.21.15.80:0/2862419901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f013eb40 0x7f12f010afc0 secure :-1 s=THROTTLE_DONE pgs=2205 cs=0 l=1 rx=0x7f12d8010730 tx=0x7f12d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.638+0000 7f12e77fe700 1 -- 172.21.15.80:0/2862419901 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f12d8008180 con 0x7f12f013eb40 2019-11-28T11:52:31.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.816+0000 7f12f4fcc700 1 -- 172.21.15.80:0/2862419901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12f0108700 con 0x7f12f013eb40 2019-11-28T11:52:31.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.816+0000 7f12eed9d700 1 --2- 172.21.15.80:0/2862419901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f013eb40 0x7f12f010afc0 secure :-1 s=THROTTLE_DONE pgs=2205 cs=0 l=1 rx=0x7f12d8010730 tx=0x7f12d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:31.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.816+0000 7f12e77fe700 1 -- 172.21.15.80:0/2862419901 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+14884 (secure 0 0 0) 0x7f12d80058e0 con 0x7f12f013eb40 2019-11-28T11:52:31.869 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:31.870 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":175,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:52:31.482172+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:52:29.768232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2019-11-28T11:52:30.506393+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:52:31.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.819+0000 7f12f4fcc700 1 -- 172.21.15.80:0/2862419901 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f12c8018730 msgr2=0x7f12c801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:31.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.819+0000 7f12f4fcc700 1 --2- 172.21.15.80:0/2862419901 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f12c8018730 0x7f12c801abc0 crc :-1 s=READY pgs=902 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:31.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.819+0000 7f12f4fcc700 1 -- 172.21.15.80:0/2862419901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f013eb40 msgr2=0x7f12f010afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:31.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.819+0000 7f12f4fcc700 1 --2- 172.21.15.80:0/2862419901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f013eb40 0x7f12f010afc0 secure :-1 s=READY pgs=2205 cs=0 l=1 rx=0x7f12d8010730 tx=0x7f12d8010ad0).stop 2019-11-28T11:52:31.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.819+0000 7f12f4fcc700 1 -- 172.21.15.80:0/2862419901 shutdown_connections 2019-11-28T11:52:31.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.819+0000 7f12f4fcc700 1 --2- 172.21.15.80:0/2862419901 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f12c8018730 0x7f12c801abc0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:31.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.819+0000 7f12f4fcc700 1 --2- 172.21.15.80:0/2862419901 >> v2:172.21.15.174:3300/0 conn(0x7f12f010b500 0x7f12f01629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:31.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.819+0000 7f12f4fcc700 1 --2- 172.21.15.80:0/2862419901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f013eb40 0x7f12f010afc0 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:31.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.819+0000 7f12f4fcc700 1 -- 172.21.15.80:0/2862419901 shutdown_connections 2019-11-28T11:52:31.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.819+0000 7f12f4fcc700 1 -- 172.21.15.80:0/2862419901 wait complete. 2019-11-28T11:52:31.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.819+0000 7f12f4fcc700 1 -- 172.21.15.80:0/2862419901 >> 172.21.15.80:0/2862419901 conn(0x7f12f011bfc0 msgr2=0x7f12f0141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:31.882 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:52:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.948+0000 7f013e556700 1 Processor -- start 2019-11-28T11:52:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.948+0000 7f013e556700 1 -- start start 2019-11-28T11:52:32.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013e556700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f013806c0a0 0x7f0138072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013e556700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0138072620 0x7f0138164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013e556700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013806db00 con 0x7f01380734e0 2019-11-28T11:52:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013e556700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f013806fd60 con 0x7f0138072620 2019-11-28T11:52:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013e556700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0138070030 con 0x7f013806c0a0 2019-11-28T11:52:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013d2f4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0138072620 0x7f0138164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:32.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f0137fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f01380734e0 0x7f0138071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42312/0 (socket says 172.21.15.80:42312) 2019-11-28T11:52:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f0137fff700 1 -- 172.21.15.80:0/4107483571 learned_addr learned my addr 172.21.15.80:0/4107483571 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013caf3700 1 --2- 172.21.15.80:0/4107483571 >> v2:172.21.15.174:3300/0 conn(0x7f013806c0a0 0x7f0138072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013d2f4700 1 -- 172.21.15.80:0/4107483571 >> v2:172.21.15.174:3300/0 conn(0x7f013806c0a0 msgr2=0x7f0138072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013d2f4700 1 --2- 172.21.15.80:0/4107483571 >> v2:172.21.15.174:3300/0 conn(0x7f013806c0a0 0x7f0138072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013d2f4700 1 -- 172.21.15.80:0/4107483571 >> v1:172.21.15.80:6789/0 conn(0x7f01380734e0 legacy=0x7f0138071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:32.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013d2f4700 1 -- 172.21.15.80:0/4107483571 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01380706c0 con 0x7f0138072620 2019-11-28T11:52:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f01377fe700 1 -- 172.21.15.80:0/4107483571 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400482003 0 0) 0x7f01280014d0 con 0x7f01380734e0 2019-11-28T11:52:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013d2f4700 1 --2- 172.21.15.80:0/4107483571 >> v2:172.21.15.80:3300/0 conn(0x7f0138072620 0x7f0138164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f013000af50 tx=0x7f013000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013d2f4700 1 --2- 172.21.15.80:0/4107483571 >> v2:172.21.15.80:3300/0 conn(0x7f0138072620 0x7f0138164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f013000af50 tx=0x7f013000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013d2f4700 1 --2- 172.21.15.80:0/4107483571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138072620 0x7f0138164d70 secure :-1 s=READY pgs=2207 cs=0 l=1 rx=0x7f013000af50 tx=0x7f013000b6e0).ready entity=mon.0 client_cookie=a0b184514a08646f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013d2f4700 1 --2- 172.21.15.80:0/4107483571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138072620 0x7f0138164d70 secure :-1 s=THROTTLE_DONE pgs=2207 cs=0 l=1 rx=0x7f013000af50 tx=0x7f013000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f01377fe700 1 -- 172.21.15.80:0/4107483571 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0130009ba0 con 0x7f0138072620 2019-11-28T11:52:32.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013d2f4700 1 --2- 172.21.15.80:0/4107483571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138072620 0x7f0138164d70 secure :-1 s=THROTTLE_DONE pgs=2207 cs=0 l=1 rx=0x7f013000af50 tx=0x7f013000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.949+0000 7f013d2f4700 1 --2- 172.21.15.80:0/4107483571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138072620 0x7f0138164d70 secure :-1 s=THROTTLE_DONE pgs=2207 cs=0 l=1 rx=0x7f013000af50 tx=0x7f013000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.950+0000 7f01377fe700 1 -- 172.21.15.80:0/4107483571 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01300097c0 con 0x7f0138072620 2019-11-28T11:52:32.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.950+0000 7f01377fe700 1 -- 172.21.15.80:0/4107483571 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f013000a180 con 0x7f0138072620 2019-11-28T11:52:32.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.950+0000 7f013e556700 1 -- 172.21.15.80:0/4107483571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138072620 msgr2=0x7f0138164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:32.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.950+0000 7f013e556700 1 --2- 172.21.15.80:0/4107483571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138072620 0x7f0138164d70 secure :-1 s=READY pgs=2207 cs=0 l=1 rx=0x7f013000af50 tx=0x7f013000b6e0).stop 2019-11-28T11:52:32.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.950+0000 7f013e556700 1 -- 172.21.15.80:0/4107483571 shutdown_connections 2019-11-28T11:52:32.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.950+0000 7f013e556700 1 --2- 172.21.15.80:0/4107483571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138072620 0x7f0138164d70 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:32.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.950+0000 7f013e556700 1 --2- 172.21.15.80:0/4107483571 >> v2:172.21.15.174:3300/0 conn(0x7f013806c0a0 0x7f0138072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:32.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.950+0000 7f013e556700 1 -- 172.21.15.80:0/4107483571 shutdown_connections 2019-11-28T11:52:32.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.950+0000 7f013e556700 1 -- 172.21.15.80:0/4107483571 wait complete. 2019-11-28T11:52:32.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.950+0000 7f013e556700 1 -- 172.21.15.80:0/4107483571 >> 172.21.15.80:0/4107483571 conn(0x7f0138061cf0 msgr2=0x7f0138064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:32.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.953+0000 7f013e556700 1 Processor -- start 2019-11-28T11:52:32.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.953+0000 7f013e556700 1 -- start start 2019-11-28T11:52:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013e556700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0138104820 0x7f013810c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013e556700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f013810c890 0x7f013810b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013e556700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013813bcd0 con 0x7f013810b710 2019-11-28T11:52:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013e556700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0138109130 con 0x7f0138104820 2019-11-28T11:52:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013e556700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0138109400 con 0x7f013810c890 2019-11-28T11:52:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013caf3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0138104820 0x7f013810c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:32.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013caf3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0138104820 0x7f013810c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43000/0 (socket says 172.21.15.80:43000) 2019-11-28T11:52:32.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013caf3700 1 -- 172.21.15.80:0/2379779038 learned_addr learned my addr 172.21.15.80:0/2379779038 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:32.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f0137fff700 1 --2- 172.21.15.80:0/2379779038 >> v2:172.21.15.174:3300/0 conn(0x7f013810c890 0x7f013810b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:32.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013caf3700 1 -- 172.21.15.80:0/2379779038 >> v2:172.21.15.174:3300/0 conn(0x7f013810c890 msgr2=0x7f013810b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:32.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013caf3700 1 --2- 172.21.15.80:0/2379779038 >> v2:172.21.15.174:3300/0 conn(0x7f013810c890 0x7f013810b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:32.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013caf3700 1 -- 172.21.15.80:0/2379779038 >> v1:172.21.15.80:6789/0 conn(0x7f013810b710 legacy=0x7f0138104c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:32.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013caf3700 1 -- 172.21.15.80:0/2379779038 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0138109a90 con 0x7f0138104820 2019-11-28T11:52:32.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013caf3700 1 --2- 172.21.15.80:0/2379779038 >> v2:172.21.15.80:3300/0 conn(0x7f0138104820 0x7f013810c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0120010450 tx=0x7f0120010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013caf3700 1 --2- 172.21.15.80:0/2379779038 >> v2:172.21.15.80:3300/0 conn(0x7f0138104820 0x7f013810c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0120010450 tx=0x7f0120010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013caf3700 1 --2- 172.21.15.80:0/2379779038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138104820 0x7f013810c350 secure :-1 s=READY pgs=2209 cs=0 l=1 rx=0x7f0120010450 tx=0x7f0120010250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:32.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013caf3700 1 --2- 172.21.15.80:0/2379779038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138104820 0x7f013810c350 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7f0120010450 tx=0x7f0120010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f01357fa700 1 -- 172.21.15.80:0/2379779038 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0120005770 con 0x7f0138104820 2019-11-28T11:52:32.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013caf3700 1 --2- 172.21.15.80:0/2379779038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138104820 0x7f013810c350 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7f0120010450 tx=0x7f0120010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013e556700 1 -- 172.21.15.80:0/2379779038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0138109e10 con 0x7f0138104820 2019-11-28T11:52:32.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f01357fa700 1 -- 172.21.15.80:0/2379779038 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0120005390 con 0x7f0138104820 2019-11-28T11:52:32.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013caf3700 1 --2- 172.21.15.80:0/2379779038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138104820 0x7f013810c350 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7f0120010450 tx=0x7f0120010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f01357fa700 1 -- 172.21.15.80:0/2379779038 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0120005580 con 0x7f0138104820 2019-11-28T11:52:32.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.954+0000 7f013e556700 1 -- 172.21.15.80:0/2379779038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0138109a90 con 0x7f0138104820 2019-11-28T11:52:32.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.955+0000 7f013caf3700 1 --2- 172.21.15.80:0/2379779038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138104820 0x7f013810c350 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7f0120010450 tx=0x7f0120010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.955+0000 7f01357fa700 1 -- 172.21.15.80:0/2379779038 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0120005580 con 0x7f0138104820 2019-11-28T11:52:32.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.955+0000 7f013caf3700 1 --2- 172.21.15.80:0/2379779038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138104820 0x7f013810c350 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7f0120010450 tx=0x7f0120010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.955+0000 7f01357fa700 1 --2- 172.21.15.80:0/2379779038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f011c018730 0x7f011c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:32.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.955+0000 7f01357fa700 1 -- 172.21.15.80:0/2379779038 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0120031b00 con 0x7f0138104820 2019-11-28T11:52:32.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.955+0000 7f0137fff700 1 --2- 172.21.15.80:0/2379779038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f011c018730 0x7f011c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:32.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.955+0000 7f0137fff700 1 --2- 172.21.15.80:0/2379779038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f011c018730 0x7f011c01abc0 crc :-1 s=READY pgs=903 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:32.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.963+0000 7f013e556700 1 -- 172.21.15.80:0/2379779038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0138109e10 con 0x7f0138104820 2019-11-28T11:52:32.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.966+0000 7f013caf3700 1 --2- 172.21.15.80:0/2379779038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138104820 0x7f013810c350 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7f0120010450 tx=0x7f0120010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:31.966+0000 7f01357fa700 1 -- 172.21.15.80:0/2379779038 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0120005180 con 0x7f0138104820 2019-11-28T11:52:32.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.142+0000 7f013e556700 1 -- 172.21.15.80:0/2379779038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0138109a90 con 0x7f0138104820 2019-11-28T11:52:32.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.143+0000 7f013caf3700 1 --2- 172.21.15.80:0/2379779038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138104820 0x7f013810c350 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7f0120010450 tx=0x7f0120010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.143+0000 7f01357fa700 1 -- 172.21.15.80:0/2379779038 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+14884 (secure 0 0 0) 0x7f0120017470 con 0x7f0138104820 2019-11-28T11:52:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:32.196 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":175,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:52:31.482172+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:52:29.768232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2019-11-28T11:52:30.506393+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:52:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.145+0000 7f013e556700 1 -- 172.21.15.80:0/2379779038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f011c018730 msgr2=0x7f011c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.145+0000 7f013e556700 1 --2- 172.21.15.80:0/2379779038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f011c018730 0x7f011c01abc0 crc :-1 s=READY pgs=903 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.145+0000 7f013e556700 1 -- 172.21.15.80:0/2379779038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138104820 msgr2=0x7f013810c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.145+0000 7f013e556700 1 --2- 172.21.15.80:0/2379779038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138104820 0x7f013810c350 secure :-1 s=READY pgs=2209 cs=0 l=1 rx=0x7f0120010450 tx=0x7f0120010250).stop 2019-11-28T11:52:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.145+0000 7f013e556700 1 -- 172.21.15.80:0/2379779038 shutdown_connections 2019-11-28T11:52:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.145+0000 7f013e556700 1 --2- 172.21.15.80:0/2379779038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f011c018730 0x7f011c01abc0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.145+0000 7f013e556700 1 --2- 172.21.15.80:0/2379779038 >> v2:172.21.15.174:3300/0 conn(0x7f013810c890 0x7f013810b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.145+0000 7f013e556700 1 --2- 172.21.15.80:0/2379779038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0138104820 0x7f013810c350 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.145+0000 7f013e556700 1 -- 172.21.15.80:0/2379779038 shutdown_connections 2019-11-28T11:52:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.145+0000 7f013e556700 1 -- 172.21.15.80:0/2379779038 wait complete. 2019-11-28T11:52:32.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.145+0000 7f013e556700 1 -- 172.21.15.80:0/2379779038 >> 172.21.15.80:0/2379779038 conn(0x7f013813d620 msgr2=0x7f013813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:32.208 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:52:32.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.279+0000 7fc62bbfc700 1 Processor -- start 2019-11-28T11:52:32.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.279+0000 7fc62bbfc700 1 -- start start 2019-11-28T11:52:32.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.280+0000 7fc62bbfc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc62415ed10 0x7fc62415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:32.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.280+0000 7fc62bbfc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc6240734b0 0x7fc6240726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:32.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.280+0000 7fc62bbfc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62406db60 con 0x7fc624073020 2019-11-28T11:52:32.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.280+0000 7fc62bbfc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc62406f3d0 con 0x7fc6240734b0 2019-11-28T11:52:32.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.280+0000 7fc62bbfc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62406fe00 con 0x7fc62415ed10 2019-11-28T11:52:32.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.280+0000 7fc62a99a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc6240734b0 0x7fc6240726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:32.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.280+0000 7fc62a199700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc62415ed10 0x7fc62415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:32.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.280+0000 7fc62a99a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc6240734b0 0x7fc6240726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:57896/0 (socket says 172.21.15.80:57896) 2019-11-28T11:52:32.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.280+0000 7fc62a199700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc62415ed10 0x7fc62415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:45268/0 (socket says 172.21.15.80:45268) 2019-11-28T11:52:32.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.280+0000 7fc629998700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc624073020 0x7fc624071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:57872/0 (socket says 172.21.15.80:57872) 2019-11-28T11:52:32.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.280+0000 7fc62a99a700 1 -- 172.21.15.80:0/58681873 learned_addr learned my addr 172.21.15.80:0/58681873 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:32.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.281+0000 7fc62a99a700 1 -- 172.21.15.80:0/58681873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc62415ed10 msgr2=0x7fc62415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:32.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.281+0000 7fc62a99a700 1 --2- 172.21.15.80:0/58681873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc62415ed10 0x7fc62415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:32.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.281+0000 7fc62a99a700 1 -- 172.21.15.80:0/58681873 >> v1:172.21.15.174:6789/0 conn(0x7fc624073020 legacy=0x7fc624071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:32.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.281+0000 7fc62a99a700 1 -- 172.21.15.80:0/58681873 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc624070760 con 0x7fc6240734b0 2019-11-28T11:52:32.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.281+0000 7fc62a199700 1 --2- 172.21.15.80:0/58681873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc62415ed10 0x7fc62415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:32.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.281+0000 7fc62a99a700 1 --2- 172.21.15.80:0/58681873 >> v2:172.21.15.174:3300/0 conn(0x7fc6240734b0 0x7fc6240726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc61c00f760 tx=0x7fc61c00fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.281+0000 7fc62a99a700 1 --2- 172.21.15.80:0/58681873 >> v2:172.21.15.174:3300/0 conn(0x7fc6240734b0 0x7fc6240726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc61c00f760 tx=0x7fc61c00fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.281+0000 7fc62a99a700 1 --2- 172.21.15.80:0/58681873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6240734b0 0x7fc6240726a0 secure :-1 s=READY pgs=1317 cs=0 l=1 rx=0x7fc61c00f760 tx=0x7fc61c00fb00).ready entity=mon.1 client_cookie=f2ab32f14092195d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:32.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.281+0000 7fc62a99a700 1 --2- 172.21.15.80:0/58681873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6240734b0 0x7fc6240726a0 secure :-1 s=THROTTLE_DONE pgs=1317 cs=0 l=1 rx=0x7fc61c00f760 tx=0x7fc61c00fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.281+0000 7fc62a99a700 1 --2- 172.21.15.80:0/58681873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6240734b0 0x7fc6240726a0 secure :-1 s=THROTTLE_DONE pgs=1317 cs=0 l=1 rx=0x7fc61c00f760 tx=0x7fc61c00fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.281+0000 7fc629197700 1 -- 172.21.15.80:0/58681873 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc61c000a70 con 0x7fc6240734b0 2019-11-28T11:52:32.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.281+0000 7fc62a99a700 1 --2- 172.21.15.80:0/58681873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6240734b0 0x7fc6240726a0 secure :-1 s=THROTTLE_DONE pgs=1317 cs=0 l=1 rx=0x7fc61c00f760 tx=0x7fc61c00fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.281+0000 7fc629197700 1 -- 172.21.15.80:0/58681873 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c000e70 con 0x7fc6240734b0 2019-11-28T11:52:32.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.281+0000 7fc629197700 1 -- 172.21.15.80:0/58681873 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc61c001500 con 0x7fc6240734b0 2019-11-28T11:52:32.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.281+0000 7fc62bbfc700 1 -- 172.21.15.80:0/58681873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6240734b0 msgr2=0x7fc6240726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:32.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.281+0000 7fc62bbfc700 1 --2- 172.21.15.80:0/58681873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6240734b0 0x7fc6240726a0 secure :-1 s=READY pgs=1317 cs=0 l=1 rx=0x7fc61c00f760 tx=0x7fc61c00fb00).stop 2019-11-28T11:52:32.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.282+0000 7fc62bbfc700 1 -- 172.21.15.80:0/58681873 shutdown_connections 2019-11-28T11:52:32.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.282+0000 7fc62bbfc700 1 --2- 172.21.15.80:0/58681873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6240734b0 0x7fc6240726a0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:32.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.282+0000 7fc62bbfc700 1 --2- 172.21.15.80:0/58681873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc62415ed10 0x7fc62415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:32.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.282+0000 7fc62bbfc700 1 -- 172.21.15.80:0/58681873 shutdown_connections 2019-11-28T11:52:32.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.282+0000 7fc62bbfc700 1 -- 172.21.15.80:0/58681873 wait complete. 2019-11-28T11:52:32.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.282+0000 7fc62bbfc700 1 -- 172.21.15.80:0/58681873 >> 172.21.15.80:0/58681873 conn(0x7fc624061d20 msgr2=0x7fc6240641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:32.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.284+0000 7fc62bbfc700 1 Processor -- start 2019-11-28T11:52:32.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.284+0000 7fc62bbfc700 1 -- start start 2019-11-28T11:52:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.285+0000 7fc62bbfc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc624153db0 0x7fc62410dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.285+0000 7fc62bbfc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc62410e270 0x7fc624148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.285+0000 7fc62bbfc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6241057a0 con 0x7fc624148570 2019-11-28T11:52:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.285+0000 7fc62bbfc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6241085b0 con 0x7fc62410e270 2019-11-28T11:52:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.285+0000 7fc62bbfc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc624108880 con 0x7fc624153db0 2019-11-28T11:52:32.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.285+0000 7fc629998700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc62410e270 0x7fc624148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.285+0000 7fc62a199700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc624153db0 0x7fc62410dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.285+0000 7fc629998700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc62410e270 0x7fc624148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43016/0 (socket says 172.21.15.80:43016) 2019-11-28T11:52:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.285+0000 7fc62a99a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc624148570 0x7fc62410cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42334/0 (socket says 172.21.15.80:42334) 2019-11-28T11:52:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.285+0000 7fc629998700 1 -- 172.21.15.80:0/1668909221 learned_addr learned my addr 172.21.15.80:0/1668909221 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc62a199700 1 -- 172.21.15.80:0/1668909221 >> v2:172.21.15.80:3300/0 conn(0x7fc62410e270 msgr2=0x7fc624148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc62a199700 1 --2- 172.21.15.80:0/1668909221 >> v2:172.21.15.80:3300/0 conn(0x7fc62410e270 0x7fc624148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:32.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc62a199700 1 -- 172.21.15.80:0/1668909221 >> v1:172.21.15.80:6789/0 conn(0x7fc624148570 legacy=0x7fc62410cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc62a199700 1 -- 172.21.15.80:0/1668909221 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc624106be0 con 0x7fc624153db0 2019-11-28T11:52:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc629998700 1 --2- 172.21.15.80:0/1668909221 >> v2:172.21.15.80:3300/0 conn(0x7fc62410e270 0x7fc624148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc62a199700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc624153db0 0x7fc62410dd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc60c010720 tx=0x7fc60c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc62a199700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc624153db0 0x7fc62410dd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc60c010720 tx=0x7fc60c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc62a199700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc624153db0 0x7fc62410dd30 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7fc60c010720 tx=0x7fc60c010ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc62a199700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc624153db0 0x7fc62410dd30 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7fc60c010720 tx=0x7fc60c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc62a199700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc624153db0 0x7fc62410dd30 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7fc60c010720 tx=0x7fc60c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc622ffd700 1 -- 172.21.15.80:0/1668909221 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc60c000cc0 con 0x7fc624153db0 2019-11-28T11:52:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc62a199700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc624153db0 0x7fc62410dd30 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7fc60c010720 tx=0x7fc60c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc622ffd700 1 -- 172.21.15.80:0/1668909221 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c00e370 con 0x7fc624153db0 2019-11-28T11:52:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc622ffd700 1 -- 172.21.15.80:0/1668909221 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc60c00ea00 con 0x7fc624153db0 2019-11-28T11:52:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc62bbfc700 1 -- 172.21.15.80:0/1668909221 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc624106f60 con 0x7fc624153db0 2019-11-28T11:52:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc62bbfc700 1 -- 172.21.15.80:0/1668909221 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc624106be0 con 0x7fc624153db0 2019-11-28T11:52:32.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.286+0000 7fc62a199700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc624153db0 0x7fc62410dd30 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7fc60c010720 tx=0x7fc60c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.287+0000 7fc622ffd700 1 -- 172.21.15.80:0/1668909221 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc60c00de80 con 0x7fc624153db0 2019-11-28T11:52:32.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.287+0000 7fc62a199700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc624153db0 0x7fc62410dd30 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7fc60c010720 tx=0x7fc60c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.287+0000 7fc622ffd700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc608018730 0x7fc60801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:32.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.287+0000 7fc622ffd700 1 -- 172.21.15.80:0/1668909221 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc60c031dd0 con 0x7fc624153db0 2019-11-28T11:52:32.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.287+0000 7fc629998700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc608018730 0x7fc60801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:32.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.287+0000 7fc629998700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc608018730 0x7fc60801abc0 crc :-1 s=READY pgs=904 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:32.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.294+0000 7fc62bbfc700 1 -- 172.21.15.80:0/1668909221 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc624106f60 con 0x7fc624153db0 2019-11-28T11:52:32.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.298+0000 7fc62a199700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc624153db0 0x7fc62410dd30 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7fc60c010720 tx=0x7fc60c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:32.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.298+0000 7fc622ffd700 1 -- 172.21.15.80:0/1668909221 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc60c000cc0 con 0x7fc624153db0 2019-11-28T11:52:32.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:32.471+0000 7fc62bbfc700 1 -- 172.21.15.80:0/1668909221 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7fc624106be0 con 0x7fc624153db0 2019-11-28T11:52:33.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.127+0000 7fc62a199700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc624153db0 0x7fc62410dd30 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7fc60c010720 tx=0x7fc60c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.127+0000 7fc622ffd700 1 -- 172.21.15.80:0/1668909221 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v136) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc60c00dd70 con 0x7fc624153db0 2019-11-28T11:52:33.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.139+0000 7fc62bbfc700 1 -- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc608018730 msgr2=0x7fc60801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.139+0000 7fc62bbfc700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc608018730 0x7fc60801abc0 crc :-1 s=READY pgs=904 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.139+0000 7fc62bbfc700 1 -- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc624153db0 msgr2=0x7fc62410dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.139+0000 7fc62bbfc700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc624153db0 0x7fc62410dd30 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7fc60c010720 tx=0x7fc60c010ac0).stop 2019-11-28T11:52:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.139+0000 7fc62bbfc700 1 -- 172.21.15.80:0/1668909221 shutdown_connections 2019-11-28T11:52:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.139+0000 7fc62bbfc700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc608018730 0x7fc60801abc0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.139+0000 7fc62bbfc700 1 --2- 172.21.15.80:0/1668909221 >> v2:172.21.15.80:3300/0 conn(0x7fc62410e270 0x7fc624148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:33.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.139+0000 7fc62bbfc700 1 --2- 172.21.15.80:0/1668909221 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc624153db0 0x7fc62410dd30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:33.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.139+0000 7fc62bbfc700 1 -- 172.21.15.80:0/1668909221 shutdown_connections 2019-11-28T11:52:33.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.139+0000 7fc62bbfc700 1 -- 172.21.15.80:0/1668909221 wait complete. 2019-11-28T11:52:33.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.139+0000 7fc62bbfc700 1 -- 172.21.15.80:0/1668909221 >> 172.21.15.80:0/1668909221 conn(0x7fc62415e2d0 msgr2=0x7fc624147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:33.201 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:33.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.269+0000 7f54eaec1700 1 Processor -- start 2019-11-28T11:52:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.269+0000 7f54eaec1700 1 -- start start 2019-11-28T11:52:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.270+0000 7f54eaec1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54e406d120 0x7f54e4165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.270+0000 7f54eaec1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e406d580 con 0x7f54e406c0a0 2019-11-28T11:52:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.270+0000 7f54eaec1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e406db00 con 0x7f54e406c490 2019-11-28T11:52:33.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.270+0000 7f54eaec1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e406fd60 con 0x7f54e406d120 2019-11-28T11:52:33.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.270+0000 7f54e945e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f54e406c0a0 0x7f54e4072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42338/0 (socket says 172.21.15.80:42338) 2019-11-28T11:52:33.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.270+0000 7f54e945e700 1 -- 172.21.15.80:0/1831897862 learned_addr learned my addr 172.21.15.80:0/1831897862 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:33.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.270+0000 7f54e9c5f700 1 --2- 172.21.15.80:0/1831897862 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54e406d120 0x7f54e4165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:33.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e3fff700 1 -- 172.21.15.80:0/1831897862 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464710580 0 0) 0x7f54cc0014d0 con 0x7f54e406c0a0 2019-11-28T11:52:33.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e3fff700 1 -- 172.21.15.80:0/1831897862 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54d0002e80 con 0x7f54e406c0a0 2019-11-28T11:52:33.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e3fff700 1 -- 172.21.15.80:0/1831897862 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976533159 0 0) 0x7f54d4001080 con 0x7f54e406c490 2019-11-28T11:52:33.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e3fff700 1 -- 172.21.15.80:0/1831897862 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54d0004170 con 0x7f54e406c490 2019-11-28T11:52:33.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e9c5f700 1 -- 172.21.15.80:0/1831897862 >> v1:172.21.15.174:6789/0 conn(0x7f54e406c490 legacy=0x7f54e406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:33.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e9c5f700 1 -- 172.21.15.80:0/1831897862 >> v1:172.21.15.80:6789/0 conn(0x7f54e406c0a0 legacy=0x7f54e4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:33.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e3fff700 1 -- 172.21.15.80:0/1831897862 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 933074495 0 0) 0x7f54cc0014b0 con 0x7f54e406c0a0 2019-11-28T11:52:33.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e9c5f700 1 -- 172.21.15.80:0/1831897862 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e40706c0 con 0x7f54e406d120 2019-11-28T11:52:33.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e9c5f700 1 --2- 172.21.15.80:0/1831897862 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54e406d120 0x7f54e4165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f54dc00af80 tx=0x7f54dc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e9c5f700 1 --2- 172.21.15.80:0/1831897862 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54e406d120 0x7f54e4165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f54dc00af80 tx=0x7f54dc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e9c5f700 1 --2- 172.21.15.80:0/1831897862 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54e406d120 0x7f54e4165d80 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7f54dc00af80 tx=0x7f54dc00b790).ready entity=mon.2 client_cookie=5b17b4c0765a252e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e9c5f700 1 --2- 172.21.15.80:0/1831897862 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54e406d120 0x7f54e4165d80 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7f54dc00af80 tx=0x7f54dc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e3fff700 1 -- 172.21.15.80:0/1831897862 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54dc007240 con 0x7f54e406d120 2019-11-28T11:52:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e9c5f700 1 --2- 172.21.15.80:0/1831897862 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54e406d120 0x7f54e4165d80 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7f54dc00af80 tx=0x7f54dc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e9c5f700 1 --2- 172.21.15.80:0/1831897862 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54e406d120 0x7f54e4165d80 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7f54dc00af80 tx=0x7f54dc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e3fff700 1 -- 172.21.15.80:0/1831897862 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc000bb0 con 0x7f54e406d120 2019-11-28T11:52:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54e3fff700 1 -- 172.21.15.80:0/1831897862 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54dc009e60 con 0x7f54e406d120 2019-11-28T11:52:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54eaec1700 1 -- 172.21.15.80:0/1831897862 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54e406d120 msgr2=0x7f54e4165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.271+0000 7f54eaec1700 1 --2- 172.21.15.80:0/1831897862 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54e406d120 0x7f54e4165d80 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7f54dc00af80 tx=0x7f54dc00b790).stop 2019-11-28T11:52:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.272+0000 7f54eaec1700 1 -- 172.21.15.80:0/1831897862 shutdown_connections 2019-11-28T11:52:33.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.272+0000 7f54eaec1700 1 --2- 172.21.15.80:0/1831897862 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54e406d120 0x7f54e4165d80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:33.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.272+0000 7f54eaec1700 1 -- 172.21.15.80:0/1831897862 shutdown_connections 2019-11-28T11:52:33.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.272+0000 7f54eaec1700 1 -- 172.21.15.80:0/1831897862 wait complete. 2019-11-28T11:52:33.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.272+0000 7f54eaec1700 1 -- 172.21.15.80:0/1831897862 >> 172.21.15.80:0/1831897862 conn(0x7f54e4061cf0 msgr2=0x7f54e4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:33.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.275+0000 7f54eaec1700 1 Processor -- start 2019-11-28T11:52:33.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.275+0000 7f54eaec1700 1 -- start start 2019-11-28T11:52:33.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54eaec1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f54e412cea0 0x7f54e4111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:33.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54eaec1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54e41230e0 0x7f54e4123570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:33.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54eaec1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e4124260 con 0x7f54e4123ab0 2019-11-28T11:52:33.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54eaec1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e4121040 con 0x7f54e412cea0 2019-11-28T11:52:33.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54eaec1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e4121310 con 0x7f54e41230e0 2019-11-28T11:52:33.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e945e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f54e412cea0 0x7f54e4111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e945e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f54e412cea0 0x7f54e4111db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43028/0 (socket says 172.21.15.80:43028) 2019-11-28T11:52:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e945e700 1 -- 172.21.15.80:0/4103460476 learned_addr learned my addr 172.21.15.80:0/4103460476 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e8c5d700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54e41230e0 0x7f54e4123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:33.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e945e700 1 -- 172.21.15.80:0/4103460476 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54e41230e0 msgr2=0x7f54e4123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:33.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e945e700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54e41230e0 0x7f54e4123570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:33.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e945e700 1 -- 172.21.15.80:0/4103460476 >> v1:172.21.15.174:6789/0 conn(0x7f54e4123ab0 legacy=0x7f54e412d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:33.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e945e700 1 -- 172.21.15.80:0/4103460476 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e41219a0 con 0x7f54e412cea0 2019-11-28T11:52:33.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e1ffb700 1 -- 172.21.15.80:0/4103460476 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2778670196 0 0) 0x7f54dc009990 con 0x7f54e4123ab0 2019-11-28T11:52:33.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e945e700 1 --2- 172.21.15.80:0/4103460476 >> v2:172.21.15.80:3300/0 conn(0x7f54e412cea0 0x7f54e4111db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54cc010790 tx=0x7f54cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e945e700 1 --2- 172.21.15.80:0/4103460476 >> v2:172.21.15.80:3300/0 conn(0x7f54e412cea0 0x7f54e4111db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54cc010790 tx=0x7f54cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e945e700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54e412cea0 0x7f54e4111db0 secure :-1 s=READY pgs=2212 cs=0 l=1 rx=0x7f54cc010790 tx=0x7f54cc0105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:33.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e945e700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54e412cea0 0x7f54e4111db0 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7f54cc010790 tx=0x7f54cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e1ffb700 1 -- 172.21.15.80:0/4103460476 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54cc001010 con 0x7f54e412cea0 2019-11-28T11:52:33.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e945e700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54e412cea0 0x7f54e4111db0 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7f54cc010790 tx=0x7f54cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54eaec1700 1 -- 172.21.15.80:0/4103460476 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e4121d20 con 0x7f54e412cea0 2019-11-28T11:52:33.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e1ffb700 1 -- 172.21.15.80:0/4103460476 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc001010 con 0x7f54e412cea0 2019-11-28T11:52:33.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e945e700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54e412cea0 0x7f54e4111db0 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7f54cc010790 tx=0x7f54cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54e1ffb700 1 -- 172.21.15.80:0/4103460476 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54cc001200 con 0x7f54e412cea0 2019-11-28T11:52:33.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.276+0000 7f54eaec1700 1 -- 172.21.15.80:0/4103460476 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e41122f0 con 0x7f54e412cea0 2019-11-28T11:52:33.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.277+0000 7f54e945e700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54e412cea0 0x7f54e4111db0 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7f54cc010790 tx=0x7f54cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.277+0000 7f54e1ffb700 1 -- 172.21.15.80:0/4103460476 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f54cc001010 con 0x7f54e412cea0 2019-11-28T11:52:33.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.277+0000 7f54e945e700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54e412cea0 0x7f54e4111db0 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7f54cc010790 tx=0x7f54cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.277+0000 7f54e1ffb700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f54c8018730 0x7f54c801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:33.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.277+0000 7f54e1ffb700 1 -- 172.21.15.80:0/4103460476 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f54cc031e10 con 0x7f54e412cea0 2019-11-28T11:52:33.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.278+0000 7f54e8c5d700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f54c8018730 0x7f54c801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:33.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.278+0000 7f54e8c5d700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f54c8018730 0x7f54c801abc0 crc :-1 s=READY pgs=905 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:33.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.284+0000 7f54eaec1700 1 -- 172.21.15.80:0/4103460476 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e41219a0 con 0x7f54e412cea0 2019-11-28T11:52:33.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.288+0000 7f54e945e700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54e412cea0 0x7f54e4111db0 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7f54cc010790 tx=0x7f54cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.288+0000 7f54e1ffb700 1 -- 172.21.15.80:0/4103460476 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f54cc007930 con 0x7f54e412cea0 2019-11-28T11:52:33.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.462+0000 7f54eaec1700 1 -- 172.21.15.80:0/4103460476 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54e4121d20 con 0x7f54e412cea0 2019-11-28T11:52:33.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.462+0000 7f54e945e700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54e412cea0 0x7f54e4111db0 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7f54cc010790 tx=0x7f54cc0105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.462+0000 7f54e1ffb700 1 -- 172.21.15.80:0/4103460476 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) v1 ==== 95+0+1428 (secure 0 0 0) 0x7f54cc001010 con 0x7f54e412cea0 2019-11-28T11:52:33.515 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 136 2019-11-28T11:52:33.516 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:33.516 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":136,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:33.122978+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:33.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.464+0000 7f54eaec1700 1 -- 172.21.15.80:0/4103460476 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f54c8018730 msgr2=0x7f54c801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:33.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.464+0000 7f54eaec1700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f54c8018730 0x7f54c801abc0 crc :-1 s=READY pgs=905 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:33.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.464+0000 7f54eaec1700 1 -- 172.21.15.80:0/4103460476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54e412cea0 msgr2=0x7f54e4111db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:33.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.464+0000 7f54eaec1700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54e412cea0 0x7f54e4111db0 secure :-1 s=READY pgs=2212 cs=0 l=1 rx=0x7f54cc010790 tx=0x7f54cc0105f0).stop 2019-11-28T11:52:33.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.465+0000 7f54eaec1700 1 -- 172.21.15.80:0/4103460476 shutdown_connections 2019-11-28T11:52:33.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.465+0000 7f54eaec1700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f54c8018730 0x7f54c801abc0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:33.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.465+0000 7f54eaec1700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54e41230e0 0x7f54e4123570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:33.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.465+0000 7f54eaec1700 1 --2- 172.21.15.80:0/4103460476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54e412cea0 0x7f54e4111db0 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:33.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.465+0000 7f54eaec1700 1 -- 172.21.15.80:0/4103460476 shutdown_connections 2019-11-28T11:52:33.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.465+0000 7f54eaec1700 1 -- 172.21.15.80:0/4103460476 wait complete. 2019-11-28T11:52:33.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.465+0000 7f54eaec1700 1 -- 172.21.15.80:0/4103460476 >> 172.21.15.80:0/4103460476 conn(0x7f54e41426c0 msgr2=0x7f54e4110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:33.527 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:52:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.594+0000 7f316af0e700 1 Processor -- start 2019-11-28T11:52:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.594+0000 7f316af0e700 1 -- start start 2019-11-28T11:52:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.595+0000 7f316af0e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f316406c490 0x7f316406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.595+0000 7f316af0e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316406db00 con 0x7f316406ce60 2019-11-28T11:52:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.595+0000 7f316af0e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316406e000 con 0x7f316406c0a0 2019-11-28T11:52:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.595+0000 7f316af0e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316406fd60 con 0x7f316406c490 2019-11-28T11:52:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.595+0000 7f3169cac700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f316406ce60 0x7f3164164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42354/0 (socket says 172.21.15.80:42354) 2019-11-28T11:52:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.595+0000 7f3169cac700 1 -- 172.21.15.80:0/610118091 learned_addr learned my addr 172.21.15.80:0/610118091 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3168caa700 1 --2- 172.21.15.80:0/610118091 >> v2:172.21.15.174:3300/0 conn(0x7f316406c490 0x7f316406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3163fff700 1 -- 172.21.15.80:0/610118091 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115687382 0 0) 0x7f315c0014d0 con 0x7f316406ce60 2019-11-28T11:52:33.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3163fff700 1 -- 172.21.15.80:0/610118091 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3150002e80 con 0x7f316406ce60 2019-11-28T11:52:33.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3163fff700 1 -- 172.21.15.80:0/610118091 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3320246186 0 0) 0x7f315c0014b0 con 0x7f316406ce60 2019-11-28T11:52:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3163fff700 1 -- 172.21.15.80:0/610118091 >> v2:172.21.15.174:3300/0 conn(0x7f316406c490 msgr2=0x7f316406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3163fff700 1 --2- 172.21.15.80:0/610118091 >> v2:172.21.15.174:3300/0 conn(0x7f316406c490 0x7f316406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3163fff700 1 -- 172.21.15.80:0/610118091 >> v1:172.21.15.174:6789/0 conn(0x7f316406c0a0 legacy=0x7f3164072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3163fff700 1 -- 172.21.15.80:0/610118091 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31640706c0 con 0x7f316406ce60 2019-11-28T11:52:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3163fff700 1 -- 172.21.15.80:0/610118091 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f315c0019e0 con 0x7f316406ce60 2019-11-28T11:52:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3163fff700 1 -- 172.21.15.80:0/610118091 >> v1:172.21.15.80:6789/0 conn(0x7f316406ce60 legacy=0x7f3164164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3163fff700 1 --2- 172.21.15.80:0/610118091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3150003b20 0x7f3150005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:33.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3163fff700 1 --2- 172.21.15.80:0/610118091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3150006730 0x7f3150008be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:33.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3163fff700 1 --2- 172.21.15.80:0/610118091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3150009440 0x7f315000b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:33.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3163fff700 1 -- 172.21.15.80:0/610118091 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315000c0c0 con 0x7f3150006730 2019-11-28T11:52:33.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3163fff700 1 -- 172.21.15.80:0/610118091 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31500502c0 con 0x7f3150003b20 2019-11-28T11:52:33.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3163fff700 1 -- 172.21.15.80:0/610118091 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31500504f0 con 0x7f3150009440 2019-11-28T11:52:33.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3168caa700 1 --2- 172.21.15.80:0/610118091 >> v2:172.21.15.174:3300/0 conn(0x7f316406c490 0x7f316406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:33.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3169cac700 1 --2- 172.21.15.80:0/610118091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3150009440 0x7f315000b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:33.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3168caa700 1 --2- 172.21.15.80:0/610118091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3150006730 0x7f3150008be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:33.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f31694ab700 1 --2- 172.21.15.80:0/610118091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3150003b20 0x7f3150005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:33.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3168caa700 1 -- 172.21.15.80:0/610118091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3150009440 msgr2=0x7f315000b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:33.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3168caa700 1 --2- 172.21.15.80:0/610118091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3150009440 0x7f315000b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:33.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3168caa700 1 -- 172.21.15.80:0/610118091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3150003b20 msgr2=0x7f3150005f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:33.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.596+0000 7f3168caa700 1 --2- 172.21.15.80:0/610118091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3150003b20 0x7f3150005f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:33.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.597+0000 7f3168caa700 1 -- 172.21.15.80:0/610118091 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31500507a0 con 0x7f3150006730 2019-11-28T11:52:33.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.597+0000 7f3169cac700 1 -- 172.21.15.80:0/610118091 reap_dead start 2019-11-28T11:52:33.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.597+0000 7f3168caa700 1 --2- 172.21.15.80:0/610118091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3150006730 0x7f3150008be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f314c00d4e0 tx=0x7f314c00ad70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.597+0000 7f3168caa700 1 --2- 172.21.15.80:0/610118091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3150006730 0x7f3150008be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f314c00d4e0 tx=0x7f314c00ad70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.597+0000 7f3168caa700 1 --2- 172.21.15.80:0/610118091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3150006730 0x7f3150008be0 secure :-1 s=READY pgs=2214 cs=0 l=1 rx=0x7f314c00d4e0 tx=0x7f314c00ad70).ready entity=mon.0 client_cookie=ceddedefdcebfc0f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:33.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.597+0000 7f3168caa700 1 --2- 172.21.15.80:0/610118091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3150006730 0x7f3150008be0 secure :-1 s=THROTTLE_DONE pgs=2214 cs=0 l=1 rx=0x7f314c00d4e0 tx=0x7f314c00ad70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.597+0000 7f3163fff700 1 -- 172.21.15.80:0/610118091 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f314c00ab60 con 0x7f3150006730 2019-11-28T11:52:33.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.597+0000 7f3168caa700 1 --2- 172.21.15.80:0/610118091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3150006730 0x7f3150008be0 secure :-1 s=THROTTLE_DONE pgs=2214 cs=0 l=1 rx=0x7f314c00d4e0 tx=0x7f314c00ad70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.597+0000 7f3168caa700 1 --2- 172.21.15.80:0/610118091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3150006730 0x7f3150008be0 secure :-1 s=THROTTLE_DONE pgs=2214 cs=0 l=1 rx=0x7f314c00d4e0 tx=0x7f314c00ad70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.597+0000 7f3163fff700 1 -- 172.21.15.80:0/610118091 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c009580 con 0x7f3150006730 2019-11-28T11:52:33.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.597+0000 7f3163fff700 1 -- 172.21.15.80:0/610118091 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f314c009c50 con 0x7f3150006730 2019-11-28T11:52:33.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.597+0000 7f316af0e700 1 -- 172.21.15.80:0/610118091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3150006730 msgr2=0x7f3150008be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:33.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.597+0000 7f316af0e700 1 --2- 172.21.15.80:0/610118091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3150006730 0x7f3150008be0 secure :-1 s=READY pgs=2214 cs=0 l=1 rx=0x7f314c00d4e0 tx=0x7f314c00ad70).stop 2019-11-28T11:52:33.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.597+0000 7f316af0e700 1 -- 172.21.15.80:0/610118091 shutdown_connections 2019-11-28T11:52:33.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.597+0000 7f316af0e700 1 --2- 172.21.15.80:0/610118091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3150006730 0x7f3150008be0 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:33.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.598+0000 7f316af0e700 1 -- 172.21.15.80:0/610118091 shutdown_connections 2019-11-28T11:52:33.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.598+0000 7f316af0e700 1 -- 172.21.15.80:0/610118091 wait complete. 2019-11-28T11:52:33.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.598+0000 7f316af0e700 1 -- 172.21.15.80:0/610118091 >> 172.21.15.80:0/610118091 conn(0x7f3164061cf0 msgr2=0x7f3164064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:33.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.600+0000 7f316af0e700 1 Processor -- start 2019-11-28T11:52:33.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.600+0000 7f316af0e700 1 -- start start 2019-11-28T11:52:33.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.601+0000 7f316af0e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3164074d00 0x7f31640750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:33.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.601+0000 7f316af0e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3164153040 0x7f3164140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:33.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.601+0000 7f316af0e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3164079230 con 0x7f3164152bd0 2019-11-28T11:52:33.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.601+0000 7f316af0e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3164079e30 con 0x7f3164153040 2019-11-28T11:52:33.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.601+0000 7f316af0e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316407a100 con 0x7f3164074d00 2019-11-28T11:52:33.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.601+0000 7f3169cac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3164153040 0x7f3164140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:33.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.601+0000 7f3169cac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3164153040 0x7f3164140c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43052/0 (socket says 172.21.15.80:43052) 2019-11-28T11:52:33.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.601+0000 7f3169cac700 1 -- 172.21.15.80:0/367263480 learned_addr learned my addr 172.21.15.80:0/367263480 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:33.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.601+0000 7f3168caa700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3164152bd0 0x7f3164140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42366/0 (socket says 172.21.15.80:42366) 2019-11-28T11:52:33.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.601+0000 7f31694ab700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3164074d00 0x7f31640750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:33.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.601+0000 7f3169cac700 1 -- 172.21.15.80:0/367263480 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3164074d00 msgr2=0x7f31640750f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:33.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.601+0000 7f3169cac700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3164074d00 0x7f31640750f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:33.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.601+0000 7f3169cac700 1 -- 172.21.15.80:0/367263480 >> v1:172.21.15.80:6789/0 conn(0x7f3164152bd0 legacy=0x7f3164140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:33.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.601+0000 7f3169cac700 1 -- 172.21.15.80:0/367263480 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316407b490 con 0x7f3164153040 2019-11-28T11:52:33.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.601+0000 7f3161ffb700 1 -- 172.21.15.80:0/367263480 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843767742 0 0) 0x7f314c00d200 con 0x7f3164152bd0 2019-11-28T11:52:33.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.601+0000 7f3169cac700 1 --2- 172.21.15.80:0/367263480 >> v2:172.21.15.80:3300/0 conn(0x7f3164153040 0x7f3164140c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f315c0107e0 tx=0x7f315c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.602+0000 7f3169cac700 1 --2- 172.21.15.80:0/367263480 >> v2:172.21.15.80:3300/0 conn(0x7f3164153040 0x7f3164140c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f315c0107e0 tx=0x7f315c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.602+0000 7f3169cac700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164153040 0x7f3164140c40 secure :-1 s=READY pgs=2216 cs=0 l=1 rx=0x7f315c0107e0 tx=0x7f315c010610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:33.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.602+0000 7f3169cac700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164153040 0x7f3164140c40 secure :-1 s=THROTTLE_DONE pgs=2216 cs=0 l=1 rx=0x7f315c0107e0 tx=0x7f315c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.602+0000 7f3169cac700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164153040 0x7f3164140c40 secure :-1 s=THROTTLE_DONE pgs=2216 cs=0 l=1 rx=0x7f315c0107e0 tx=0x7f315c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.602+0000 7f3161ffb700 1 -- 172.21.15.80:0/367263480 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f315c0045c0 con 0x7f3164153040 2019-11-28T11:52:33.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.602+0000 7f3169cac700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164153040 0x7f3164140c40 secure :-1 s=THROTTLE_DONE pgs=2216 cs=0 l=1 rx=0x7f315c0107e0 tx=0x7f315c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.602+0000 7f3161ffb700 1 -- 172.21.15.80:0/367263480 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c001e10 con 0x7f3164153040 2019-11-28T11:52:33.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.602+0000 7f316af0e700 1 -- 172.21.15.80:0/367263480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316407b810 con 0x7f3164153040 2019-11-28T11:52:33.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.602+0000 7f3161ffb700 1 -- 172.21.15.80:0/367263480 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f315c004ba0 con 0x7f3164153040 2019-11-28T11:52:33.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.602+0000 7f316af0e700 1 -- 172.21.15.80:0/367263480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316407b490 con 0x7f3164153040 2019-11-28T11:52:33.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.602+0000 7f3169cac700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164153040 0x7f3164140c40 secure :-1 s=THROTTLE_DONE pgs=2216 cs=0 l=1 rx=0x7f315c0107e0 tx=0x7f315c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.602+0000 7f3161ffb700 1 -- 172.21.15.80:0/367263480 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f315c0045c0 con 0x7f3164153040 2019-11-28T11:52:33.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.602+0000 7f3169cac700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164153040 0x7f3164140c40 secure :-1 s=THROTTLE_DONE pgs=2216 cs=0 l=1 rx=0x7f315c0107e0 tx=0x7f315c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.602+0000 7f3161ffb700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3148018730 0x7f314801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:33.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.602+0000 7f3161ffb700 1 -- 172.21.15.80:0/367263480 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f315c031e50 con 0x7f3164153040 2019-11-28T11:52:33.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.603+0000 7f31694ab700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3148018730 0x7f314801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:33.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.603+0000 7f31694ab700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3148018730 0x7f314801abc0 crc :-1 s=READY pgs=906 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:33.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.610+0000 7f316af0e700 1 -- 172.21.15.80:0/367263480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316407b810 con 0x7f3164153040 2019-11-28T11:52:33.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.613+0000 7f3169cac700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164153040 0x7f3164140c40 secure :-1 s=THROTTLE_DONE pgs=2216 cs=0 l=1 rx=0x7f315c0107e0 tx=0x7f315c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.613+0000 7f3161ffb700 1 -- 172.21.15.80:0/367263480 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f315c002000 con 0x7f3164153040 2019-11-28T11:52:33.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.789+0000 7f316af0e700 1 -- 172.21.15.80:0/367263480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f316407b490 con 0x7f3164153040 2019-11-28T11:52:33.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.789+0000 7f3169cac700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164153040 0x7f3164140c40 secure :-1 s=THROTTLE_DONE pgs=2216 cs=0 l=1 rx=0x7f315c0107e0 tx=0x7f315c010610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:33.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.789+0000 7f3161ffb700 1 -- 172.21.15.80:0/367263480 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f315c0045c0 con 0x7f3164153040 2019-11-28T11:52:33.842 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:33.843 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":176,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:52:32.483537+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:52:29.768232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2019-11-28T11:52:30.506393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:52:33.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.791+0000 7f316af0e700 1 -- 172.21.15.80:0/367263480 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3148018730 msgr2=0x7f314801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:33.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.791+0000 7f316af0e700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3148018730 0x7f314801abc0 crc :-1 s=READY pgs=906 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:33.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.791+0000 7f316af0e700 1 -- 172.21.15.80:0/367263480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164153040 msgr2=0x7f3164140c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:33.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.791+0000 7f316af0e700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164153040 0x7f3164140c40 secure :-1 s=READY pgs=2216 cs=0 l=1 rx=0x7f315c0107e0 tx=0x7f315c010610).stop 2019-11-28T11:52:33.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.792+0000 7f316af0e700 1 -- 172.21.15.80:0/367263480 shutdown_connections 2019-11-28T11:52:33.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.792+0000 7f316af0e700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3148018730 0x7f314801abc0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:33.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.792+0000 7f316af0e700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164153040 0x7f3164140c40 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:33.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.792+0000 7f316af0e700 1 --2- 172.21.15.80:0/367263480 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3164074d00 0x7f31640750f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:33.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.792+0000 7f316af0e700 1 -- 172.21.15.80:0/367263480 shutdown_connections 2019-11-28T11:52:33.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.792+0000 7f316af0e700 1 -- 172.21.15.80:0/367263480 wait complete. 2019-11-28T11:52:33.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.792+0000 7f316af0e700 1 -- 172.21.15.80:0/367263480 >> 172.21.15.80:0/367263480 conn(0x7f316413fa50 msgr2=0x7f316407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:33.856 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:52:33.856 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:52:33.857 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:52:33.857 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:52:33.858 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:52:33.858 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:52:33.862 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:52:33.862 DEBUG:teuthology.parallel:result is None 2019-11-28T11:52:33.863 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:52:33.864 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:52:33.864 DEBUG:teuthology.parallel:result is None 2019-11-28T11:52:33.864 DEBUG:teuthology.parallel:result is None 2019-11-28T11:52:33.864 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:52:33.950 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:52:33.953 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:52:33.954 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:52:34.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.948+0000 7fc69c145700 1 Processor -- start 2019-11-28T11:52:34.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.948+0000 7fc69c145700 1 -- start start 2019-11-28T11:52:34.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.949+0000 7fc69c145700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc69415ed10 0x7fc69415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:34.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.949+0000 7fc69c145700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69406db60 con 0x7fc6940734b0 2019-11-28T11:52:34.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.949+0000 7fc69c145700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69406e060 con 0x7fc694073020 2019-11-28T11:52:34.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.949+0000 7fc69c145700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69406fe00 con 0x7fc69415ed10 2019-11-28T11:52:34.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.949+0000 7fc69aee3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc6940734b0 0x7fc6940726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42396/0 (socket says 172.21.15.80:42396) 2019-11-28T11:52:34.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.949+0000 7fc69aee3700 1 -- 172.21.15.80:0/1468976529 learned_addr learned my addr 172.21.15.80:0/1468976529 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:34.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.949+0000 7fc69a6e2700 1 --2- 172.21.15.80:0/1468976529 >> v2:172.21.15.174:3300/0 conn(0x7fc69415ed10 0x7fc69415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.949+0000 7fc6996e0700 1 -- 172.21.15.80:0/1468976529 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157587185 0 0) 0x7fc68c001150 con 0x7fc6940734b0 2019-11-28T11:52:34.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.949+0000 7fc6996e0700 1 -- 172.21.15.80:0/1468976529 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc680002e80 con 0x7fc6940734b0 2019-11-28T11:52:34.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc6996e0700 1 -- 172.21.15.80:0/1468976529 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1911704995 0 0) 0x7fc68c001130 con 0x7fc6940734b0 2019-11-28T11:52:34.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc6996e0700 1 -- 172.21.15.80:0/1468976529 >> v2:172.21.15.174:3300/0 conn(0x7fc69415ed10 msgr2=0x7fc69415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:34.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc6996e0700 1 --2- 172.21.15.80:0/1468976529 >> v2:172.21.15.174:3300/0 conn(0x7fc69415ed10 0x7fc69415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:34.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc6996e0700 1 -- 172.21.15.80:0/1468976529 >> v1:172.21.15.174:6789/0 conn(0x7fc694073020 legacy=0x7fc694071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc6996e0700 1 -- 172.21.15.80:0/1468976529 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc694070760 con 0x7fc6940734b0 2019-11-28T11:52:34.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc6996e0700 1 -- 172.21.15.80:0/1468976529 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc68c001660 con 0x7fc6940734b0 2019-11-28T11:52:34.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc6996e0700 1 -- 172.21.15.80:0/1468976529 >> v1:172.21.15.80:6789/0 conn(0x7fc6940734b0 legacy=0x7fc6940726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc6996e0700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc680003b20 0x7fc680005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:34.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc6996e0700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc680006730 0x7fc680008be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:34.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc6996e0700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc680009440 0x7fc68000b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:34.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc6996e0700 1 -- 172.21.15.80:0/1468976529 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68000c0c0 con 0x7fc680006730 2019-11-28T11:52:34.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc6996e0700 1 -- 172.21.15.80:0/1468976529 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800502c0 con 0x7fc680009440 2019-11-28T11:52:34.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc6996e0700 1 -- 172.21.15.80:0/1468976529 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800504f0 con 0x7fc680003b20 2019-11-28T11:52:34.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc69a6e2700 1 --2- 172.21.15.80:0/1468976529 >> v2:172.21.15.174:3300/0 conn(0x7fc69415ed10 0x7fc69415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:34.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc699ee1700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc680006730 0x7fc680008be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc69aee3700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc680009440 0x7fc68000b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc69a6e2700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc680003b20 0x7fc680005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc699ee1700 1 -- 172.21.15.80:0/1468976529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc680003b20 msgr2=0x7fc680005f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:34.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc699ee1700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc680003b20 0x7fc680005f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:34.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc699ee1700 1 -- 172.21.15.80:0/1468976529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc680009440 msgr2=0x7fc68000b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:34.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc699ee1700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc680009440 0x7fc68000b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:34.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc69aee3700 1 -- 172.21.15.80:0/1468976529 reap_dead start 2019-11-28T11:52:34.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc699ee1700 1 -- 172.21.15.80:0/1468976529 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800507a0 con 0x7fc680006730 2019-11-28T11:52:34.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc69a6e2700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc680003b20 0x7fc680005f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:52:34.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc699ee1700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc680006730 0x7fc680008be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc67c00b2e0 tx=0x7fc67c00b5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc699ee1700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc680006730 0x7fc680008be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc67c00b2e0 tx=0x7fc67c00b5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc699ee1700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc680006730 0x7fc680008be0 secure :-1 s=READY pgs=2222 cs=0 l=1 rx=0x7fc67c00b2e0 tx=0x7fc67c00b5e0).ready entity=mon.0 client_cookie=8e9fd9f806c14787 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:34.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc699ee1700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc680006730 0x7fc680008be0 secure :-1 s=THROTTLE_DONE pgs=2222 cs=0 l=1 rx=0x7fc67c00b2e0 tx=0x7fc67c00b5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc6996e0700 1 -- 172.21.15.80:0/1468976529 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc67c009f00 con 0x7fc680006730 2019-11-28T11:52:34.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc699ee1700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc680006730 0x7fc680008be0 secure :-1 s=THROTTLE_DONE pgs=2222 cs=0 l=1 rx=0x7fc67c00b2e0 tx=0x7fc67c00b5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc699ee1700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc680006730 0x7fc680008be0 secure :-1 s=THROTTLE_DONE pgs=2222 cs=0 l=1 rx=0x7fc67c00b2e0 tx=0x7fc67c00b5e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc6996e0700 1 -- 172.21.15.80:0/1468976529 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c009b20 con 0x7fc680006730 2019-11-28T11:52:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc6996e0700 1 -- 172.21.15.80:0/1468976529 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc67c00a4e0 con 0x7fc680006730 2019-11-28T11:52:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc69c145700 1 -- 172.21.15.80:0/1468976529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc680006730 msgr2=0x7fc680008be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.950+0000 7fc69c145700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc680006730 0x7fc680008be0 secure :-1 s=READY pgs=2222 cs=0 l=1 rx=0x7fc67c00b2e0 tx=0x7fc67c00b5e0).stop 2019-11-28T11:52:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.951+0000 7fc69c145700 1 -- 172.21.15.80:0/1468976529 shutdown_connections 2019-11-28T11:52:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.951+0000 7fc69c145700 1 --2- 172.21.15.80:0/1468976529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc680006730 0x7fc680008be0 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.951+0000 7fc69c145700 1 -- 172.21.15.80:0/1468976529 shutdown_connections 2019-11-28T11:52:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.951+0000 7fc69c145700 1 -- 172.21.15.80:0/1468976529 wait complete. 2019-11-28T11:52:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.951+0000 7fc69c145700 1 -- 172.21.15.80:0/1468976529 >> 172.21.15.80:0/1468976529 conn(0x7fc694061d40 msgr2=0x7fc6940641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.954+0000 7fc69c145700 1 Processor -- start 2019-11-28T11:52:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.954+0000 7fc69c145700 1 -- start start 2019-11-28T11:52:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.954+0000 7fc69c145700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc69414b3d0 0x7fc694138eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.954+0000 7fc69c145700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc6941393f0 0x7fc69412e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:34.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.954+0000 7fc69c145700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc69412e6c0 0x7fc69412eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:34.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc69c145700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69410b6e0 con 0x7fc6941393f0 2019-11-28T11:52:34.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc69c145700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69410b9b0 con 0x7fc69414b3d0 2019-11-28T11:52:34.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc69c145700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69410acb0 con 0x7fc69412e6c0 2019-11-28T11:52:34.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc699ee1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc6941393f0 0x7fc69412e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc699ee1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc6941393f0 0x7fc69412e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43092/0 (socket says 172.21.15.80:43092) 2019-11-28T11:52:34.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc699ee1700 1 -- 172.21.15.80:0/964814212 learned_addr learned my addr 172.21.15.80:0/964814212 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:34.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc69a6e2700 1 --2- 172.21.15.80:0/964814212 >> v2:172.21.15.174:3300/0 conn(0x7fc69414b3d0 0x7fc694138eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc69aee3700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc69412e6c0 0x7fc69412eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc699ee1700 1 -- 172.21.15.80:0/964814212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc69412e6c0 msgr2=0x7fc69412eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc699ee1700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc69412e6c0 0x7fc69412eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc699ee1700 1 -- 172.21.15.80:0/964814212 >> v2:172.21.15.174:3300/0 conn(0x7fc69414b3d0 msgr2=0x7fc694138eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc699ee1700 1 --2- 172.21.15.80:0/964814212 >> v2:172.21.15.174:3300/0 conn(0x7fc69414b3d0 0x7fc694138eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc699ee1700 1 -- 172.21.15.80:0/964814212 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69410c040 con 0x7fc6941393f0 2019-11-28T11:52:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc699ee1700 1 --2- 172.21.15.80:0/964814212 >> v2:172.21.15.80:3300/0 conn(0x7fc6941393f0 0x7fc69412e180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc67c010750 tx=0x7fc67c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc699ee1700 1 --2- 172.21.15.80:0/964814212 >> v2:172.21.15.80:3300/0 conn(0x7fc6941393f0 0x7fc69412e180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc67c010750 tx=0x7fc67c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc699ee1700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6941393f0 0x7fc69412e180 secure :-1 s=READY pgs=2223 cs=0 l=1 rx=0x7fc67c010750 tx=0x7fc67c010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc699ee1700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6941393f0 0x7fc69412e180 secure :-1 s=THROTTLE_DONE pgs=2223 cs=0 l=1 rx=0x7fc67c010750 tx=0x7fc67c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc699ee1700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6941393f0 0x7fc69412e180 secure :-1 s=THROTTLE_DONE pgs=2223 cs=0 l=1 rx=0x7fc67c010750 tx=0x7fc67c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc692ffd700 1 -- 172.21.15.80:0/964814212 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc67c000cc0 con 0x7fc6941393f0 2019-11-28T11:52:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc699ee1700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6941393f0 0x7fc69412e180 secure :-1 s=THROTTLE_DONE pgs=2223 cs=0 l=1 rx=0x7fc67c010750 tx=0x7fc67c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc692ffd700 1 -- 172.21.15.80:0/964814212 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c009d10 con 0x7fc6941393f0 2019-11-28T11:52:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc69c145700 1 -- 172.21.15.80:0/964814212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69410c3c0 con 0x7fc6941393f0 2019-11-28T11:52:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc692ffd700 1 -- 172.21.15.80:0/964814212 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc67c00a360 con 0x7fc6941393f0 2019-11-28T11:52:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.955+0000 7fc69c145700 1 -- 172.21.15.80:0/964814212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69410c040 con 0x7fc6941393f0 2019-11-28T11:52:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.956+0000 7fc699ee1700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6941393f0 0x7fc69412e180 secure :-1 s=THROTTLE_DONE pgs=2223 cs=0 l=1 rx=0x7fc67c010750 tx=0x7fc67c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.956+0000 7fc692ffd700 1 -- 172.21.15.80:0/964814212 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc67c009910 con 0x7fc6941393f0 2019-11-28T11:52:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.956+0000 7fc699ee1700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6941393f0 0x7fc69412e180 secure :-1 s=THROTTLE_DONE pgs=2223 cs=0 l=1 rx=0x7fc67c010750 tx=0x7fc67c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.956+0000 7fc692ffd700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc678018730 0x7fc67801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.956+0000 7fc692ffd700 1 -- 172.21.15.80:0/964814212 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc67c031dd0 con 0x7fc6941393f0 2019-11-28T11:52:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.956+0000 7fc69a6e2700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc678018730 0x7fc67801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.956+0000 7fc69a6e2700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc678018730 0x7fc67801abc0 crc :-1 s=READY pgs=907 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.963+0000 7fc69c145700 1 -- 172.21.15.80:0/964814212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69410c3c0 con 0x7fc6941393f0 2019-11-28T11:52:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.967+0000 7fc699ee1700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6941393f0 0x7fc69412e180 secure :-1 s=THROTTLE_DONE pgs=2223 cs=0 l=1 rx=0x7fc67c010750 tx=0x7fc67c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:33.967+0000 7fc692ffd700 1 -- 172.21.15.80:0/964814212 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc67c00a560 con 0x7fc6941393f0 2019-11-28T11:52:34.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.142+0000 7fc69c145700 1 -- 172.21.15.80:0/964814212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc69410c040 con 0x7fc6941393f0 2019-11-28T11:52:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.149+0000 7fc699ee1700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6941393f0 0x7fc69412e180 secure :-1 s=THROTTLE_DONE pgs=2223 cs=0 l=1 rx=0x7fc67c010750 tx=0x7fc67c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.149+0000 7fc692ffd700 1 -- 172.21.15.80:0/964814212 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v60) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc67c001090 con 0x7fc6941393f0 2019-11-28T11:52:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:52:34.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.152+0000 7fc69c145700 1 -- 172.21.15.80:0/964814212 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc678018730 msgr2=0x7fc67801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.152+0000 7fc69c145700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc678018730 0x7fc67801abc0 crc :-1 s=READY pgs=907 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.152+0000 7fc69c145700 1 -- 172.21.15.80:0/964814212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6941393f0 msgr2=0x7fc69412e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.152+0000 7fc69c145700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6941393f0 0x7fc69412e180 secure :-1 s=READY pgs=2223 cs=0 l=1 rx=0x7fc67c010750 tx=0x7fc67c010600).stop 2019-11-28T11:52:34.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.152+0000 7fc69c145700 1 -- 172.21.15.80:0/964814212 shutdown_connections 2019-11-28T11:52:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.152+0000 7fc69c145700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc678018730 0x7fc67801abc0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.152+0000 7fc69c145700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc69412e6c0 0x7fc69412eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.152+0000 7fc69c145700 1 --2- 172.21.15.80:0/964814212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6941393f0 0x7fc69412e180 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.152+0000 7fc69c145700 1 --2- 172.21.15.80:0/964814212 >> v2:172.21.15.174:3300/0 conn(0x7fc69414b3d0 0x7fc694138eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.152+0000 7fc69c145700 1 -- 172.21.15.80:0/964814212 shutdown_connections 2019-11-28T11:52:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.152+0000 7fc69c145700 1 -- 172.21.15.80:0/964814212 wait complete. 2019-11-28T11:52:34.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.152+0000 7fc69c145700 1 -- 172.21.15.80:0/964814212 >> 172.21.15.80:0/964814212 conn(0x7fc69407c450 msgr2=0x7fc694118c60 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:34.214 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:52:34.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.294+0000 7fbdea121700 1 Processor -- start 2019-11-28T11:52:34.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.294+0000 7fbdea121700 1 -- start start 2019-11-28T11:52:34.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.295+0000 7fbdea121700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde415f100 0x7fbde406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:34.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.295+0000 7fbdea121700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde406db60 con 0x7fbde415ed10 2019-11-28T11:52:34.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.295+0000 7fbdea121700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde406e060 con 0x7fbde406c2f0 2019-11-28T11:52:34.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.295+0000 7fbdea121700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde406fe00 con 0x7fbde415f100 2019-11-28T11:52:34.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.295+0000 7fbde3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbde415ed10 0x7fbde4073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42416/0 (socket says 172.21.15.80:42416) 2019-11-28T11:52:34.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.295+0000 7fbde3fff700 1 -- 172.21.15.80:0/1094089766 learned_addr learned my addr 172.21.15.80:0/1094089766 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:34.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.295+0000 7fbddbfff700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde415f100 0x7fbde406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.295+0000 7fbde37fe700 1 -- 172.21.15.80:0/1094089766 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260218877 0 0) 0x7fbdd4001150 con 0x7fbde415ed10 2019-11-28T11:52:34.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde37fe700 1 -- 172.21.15.80:0/1094089766 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdd0002e80 con 0x7fbde415ed10 2019-11-28T11:52:34.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde37fe700 1 -- 172.21.15.80:0/1094089766 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3709000145 0 0) 0x7fbdd4001130 con 0x7fbde415ed10 2019-11-28T11:52:34.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde37fe700 1 -- 172.21.15.80:0/1094089766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde415f100 msgr2=0x7fbde406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:34.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde37fe700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde415f100 0x7fbde406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:34.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde37fe700 1 -- 172.21.15.80:0/1094089766 >> v1:172.21.15.174:6789/0 conn(0x7fbde406c2f0 legacy=0x7fbde406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde37fe700 1 -- 172.21.15.80:0/1094089766 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde4070760 con 0x7fbde415ed10 2019-11-28T11:52:34.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde37fe700 1 -- 172.21.15.80:0/1094089766 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fbdd4001660 con 0x7fbde415ed10 2019-11-28T11:52:34.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde37fe700 1 -- 172.21.15.80:0/1094089766 >> v1:172.21.15.80:6789/0 conn(0x7fbde415ed10 legacy=0x7fbde4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde37fe700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd0003ab0 0x7fbdd0005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:34.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde37fe700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdd0006690 0x7fbdd0008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:34.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde37fe700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd0009380 0x7fbdd000b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:34.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde37fe700 1 -- 172.21.15.80:0/1094089766 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd000bfd0 con 0x7fbdd0003ab0 2019-11-28T11:52:34.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde3fff700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd0003ab0 0x7fbdd0005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde37fe700 1 -- 172.21.15.80:0/1094089766 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd00501d0 con 0x7fbdd0006690 2019-11-28T11:52:34.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde37fe700 1 -- 172.21.15.80:0/1094089766 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0050400 con 0x7fbdd0009380 2019-11-28T11:52:34.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbddbfff700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdd0006690 0x7fbdd0008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde8ebf700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd0009380 0x7fbdd000b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde3fff700 1 -- 172.21.15.80:0/1094089766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd0009380 msgr2=0x7fbdd000b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:34.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde3fff700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd0009380 0x7fbdd000b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:34.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde3fff700 1 -- 172.21.15.80:0/1094089766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdd0006690 msgr2=0x7fbdd0008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:34.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde3fff700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdd0006690 0x7fbdd0008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde3fff700 1 -- 172.21.15.80:0/1094089766 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd00506b0 con 0x7fbdd0003ab0 2019-11-28T11:52:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde8ebf700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd0009380 0x7fbdd000b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:52:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde3fff700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd0003ab0 0x7fbdd0005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbdd400f910 tx=0x7fbdd400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde3fff700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd0003ab0 0x7fbdd0005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbdd400f910 tx=0x7fbdd400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde3fff700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd0003ab0 0x7fbdd0005f10 secure :-1 s=READY pgs=2225 cs=0 l=1 rx=0x7fbdd400f910 tx=0x7fbdd400f790).ready entity=mon.0 client_cookie=d7998f3be6b288fc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.296+0000 7fbde3fff700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd0003ab0 0x7fbdd0005f10 secure :-1 s=THROTTLE_DONE pgs=2225 cs=0 l=1 rx=0x7fbdd400f910 tx=0x7fbdd400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.297+0000 7fbde37fe700 1 -- 172.21.15.80:0/1094089766 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdd4004240 con 0x7fbdd0003ab0 2019-11-28T11:52:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.297+0000 7fbde3fff700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd0003ab0 0x7fbdd0005f10 secure :-1 s=THROTTLE_DONE pgs=2225 cs=0 l=1 rx=0x7fbdd400f910 tx=0x7fbdd400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.297+0000 7fbde37fe700 1 -- 172.21.15.80:0/1094089766 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd4001130 con 0x7fbdd0003ab0 2019-11-28T11:52:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.297+0000 7fbde3fff700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd0003ab0 0x7fbdd0005f10 secure :-1 s=THROTTLE_DONE pgs=2225 cs=0 l=1 rx=0x7fbdd400f910 tx=0x7fbdd400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.297+0000 7fbde37fe700 1 -- 172.21.15.80:0/1094089766 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdd4004430 con 0x7fbdd0003ab0 2019-11-28T11:52:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.297+0000 7fbdea121700 1 -- 172.21.15.80:0/1094089766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd0003ab0 msgr2=0x7fbdd0005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.297+0000 7fbdea121700 1 --2- 172.21.15.80:0/1094089766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdd0003ab0 0x7fbdd0005f10 secure :-1 s=READY pgs=2225 cs=0 l=1 rx=0x7fbdd400f910 tx=0x7fbdd400f790).stop 2019-11-28T11:52:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.297+0000 7fbde8ebf700 1 -- 172.21.15.80:0/1094089766 reap_dead start 2019-11-28T11:52:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.297+0000 7fbdea121700 1 -- 172.21.15.80:0/1094089766 shutdown_connections 2019-11-28T11:52:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.297+0000 7fbdea121700 1 -- 172.21.15.80:0/1094089766 shutdown_connections 2019-11-28T11:52:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.297+0000 7fbdea121700 1 -- 172.21.15.80:0/1094089766 wait complete. 2019-11-28T11:52:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.297+0000 7fbdea121700 1 -- 172.21.15.80:0/1094089766 >> 172.21.15.80:0/1094089766 conn(0x7fbde4061d40 msgr2=0x7fbde40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.300+0000 7fbdea121700 1 Processor -- start 2019-11-28T11:52:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.300+0000 7fbdea121700 1 -- start start 2019-11-28T11:52:34.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbdea121700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde4137480 0x7fbde4152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:34.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbdea121700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbde4153120 0x7fbde410bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:34.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbdea121700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde413bdf0 con 0x7fbde412e3d0 2019-11-28T11:52:34.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbdea121700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde4109ce0 con 0x7fbde4153120 2019-11-28T11:52:34.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbdea121700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde4109fb0 con 0x7fbde4137480 2019-11-28T11:52:34.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbde8ebf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbde4153120 0x7fbde410bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbddbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde4137480 0x7fbde4152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbde3fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fbde412e3d0 0x7fbde412e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:57972/0 (socket says 172.21.15.80:57972) 2019-11-28T11:52:34.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbde3fff700 1 -- 172.21.15.80:0/747905446 learned_addr learned my addr 172.21.15.80:0/747905446 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:34.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbddbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde4137480 0x7fbde4152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:45374/0 (socket says 172.21.15.80:45374) 2019-11-28T11:52:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbddbfff700 1 -- 172.21.15.80:0/747905446 >> v2:172.21.15.174:3300/0 conn(0x7fbde4153120 msgr2=0x7fbde410bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbddbfff700 1 --2- 172.21.15.80:0/747905446 >> v2:172.21.15.174:3300/0 conn(0x7fbde4153120 0x7fbde410bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbddbfff700 1 -- 172.21.15.80:0/747905446 >> v1:172.21.15.174:6789/0 conn(0x7fbde412e3d0 legacy=0x7fbde412e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbddbfff700 1 -- 172.21.15.80:0/747905446 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde410a640 con 0x7fbde4137480 2019-11-28T11:52:34.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbde17fa700 1 -- 172.21.15.80:0/747905446 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134014086 0 0) 0x7fbdd4001660 con 0x7fbde412e3d0 2019-11-28T11:52:34.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbde8ebf700 1 --2- 172.21.15.80:0/747905446 >> v2:172.21.15.174:3300/0 conn(0x7fbde4153120 0x7fbde410bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:34.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbddbfff700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde4137480 0x7fbde4152be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbdcc0103a0 tx=0x7fbdcc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbddbfff700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde4137480 0x7fbde4152be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbdcc0103a0 tx=0x7fbdcc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbddbfff700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde4137480 0x7fbde4152be0 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7fbdcc0103a0 tx=0x7fbdcc010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:34.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbddbfff700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde4137480 0x7fbde4152be0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7fbdcc0103a0 tx=0x7fbdcc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbde17fa700 1 -- 172.21.15.80:0/747905446 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdcc009640 con 0x7fbde4137480 2019-11-28T11:52:34.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbddbfff700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde4137480 0x7fbde4152be0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7fbdcc0103a0 tx=0x7fbdcc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbddbfff700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde4137480 0x7fbde4152be0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7fbdcc0103a0 tx=0x7fbdcc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbde17fa700 1 -- 172.21.15.80:0/747905446 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc000940 con 0x7fbde4137480 2019-11-28T11:52:34.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbdea121700 1 -- 172.21.15.80:0/747905446 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde410a9c0 con 0x7fbde4137480 2019-11-28T11:52:34.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbde17fa700 1 -- 172.21.15.80:0/747905446 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdcc009e50 con 0x7fbde4137480 2019-11-28T11:52:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.301+0000 7fbdea121700 1 -- 172.21.15.80:0/747905446 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde410a640 con 0x7fbde4137480 2019-11-28T11:52:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.302+0000 7fbddbfff700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde4137480 0x7fbde4152be0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7fbdcc0103a0 tx=0x7fbdcc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.302+0000 7fbde17fa700 1 -- 172.21.15.80:0/747905446 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbdcc009a70 con 0x7fbde4137480 2019-11-28T11:52:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.302+0000 7fbddbfff700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde4137480 0x7fbde4152be0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7fbdcc0103a0 tx=0x7fbdcc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.302+0000 7fbde17fa700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdc8018730 0x7fbdc801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.302+0000 7fbde17fa700 1 -- 172.21.15.80:0/747905446 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fbdcc031a20 con 0x7fbde4137480 2019-11-28T11:52:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.302+0000 7fbde3fff700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdc8018730 0x7fbdc801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.303+0000 7fbde3fff700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdc8018730 0x7fbdc801abc0 crc :-1 s=READY pgs=910 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:34.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.309+0000 7fbdea121700 1 -- 172.21.15.80:0/747905446 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde410a9c0 con 0x7fbde4137480 2019-11-28T11:52:34.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.313+0000 7fbddbfff700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde4137480 0x7fbde4152be0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7fbdcc0103a0 tx=0x7fbdcc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.313+0000 7fbde17fa700 1 -- 172.21.15.80:0/747905446 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbdcc009840 con 0x7fbde4137480 2019-11-28T11:52:34.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.484+0000 7fbdea121700 1 -- 172.21.15.80:0/747905446 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fbde410a640 con 0x7fbde4137480 2019-11-28T11:52:34.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.490+0000 7fbddbfff700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde4137480 0x7fbde4152be0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7fbdcc0103a0 tx=0x7fbdcc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.490+0000 7fbde17fa700 1 -- 172.21.15.80:0/747905446 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v61) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbdcc009ba0 con 0x7fbde4137480 2019-11-28T11:52:34.543 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:52:34.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.493+0000 7fbdea121700 1 -- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdc8018730 msgr2=0x7fbdc801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.493+0000 7fbdea121700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdc8018730 0x7fbdc801abc0 crc :-1 s=READY pgs=910 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.493+0000 7fbdea121700 1 -- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde4137480 msgr2=0x7fbde4152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.493+0000 7fbdea121700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde4137480 0x7fbde4152be0 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7fbdcc0103a0 tx=0x7fbdcc010740).stop 2019-11-28T11:52:34.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.493+0000 7fbdea121700 1 -- 172.21.15.80:0/747905446 shutdown_connections 2019-11-28T11:52:34.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.493+0000 7fbdea121700 1 --2- 172.21.15.80:0/747905446 >> v2:172.21.15.174:3300/0 conn(0x7fbde4153120 0x7fbde410bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.493+0000 7fbdea121700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbde4137480 0x7fbde4152be0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.493+0000 7fbdea121700 1 --2- 172.21.15.80:0/747905446 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdc8018730 0x7fbdc801abc0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.494+0000 7fbdea121700 1 -- 172.21.15.80:0/747905446 shutdown_connections 2019-11-28T11:52:34.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.494+0000 7fbdea121700 1 -- 172.21.15.80:0/747905446 wait complete. 2019-11-28T11:52:34.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.494+0000 7fbdea121700 1 -- 172.21.15.80:0/747905446 >> 172.21.15.80:0/747905446 conn(0x7fbde407c450 msgr2=0x7fbde4118c60 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:34.556 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:52:34.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.633+0000 7fb6f888c700 1 Processor -- start 2019-11-28T11:52:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.633+0000 7fb6f888c700 1 -- start start 2019-11-28T11:52:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.634+0000 7fb6f888c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41639f0 0x7fb6f4165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.634+0000 7fb6f888c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f406db60 con 0x7fb6f415f100 2019-11-28T11:52:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.634+0000 7fb6f888c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f406e060 con 0x7fb6f415ed10 2019-11-28T11:52:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.634+0000 7fb6f888c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f406fe00 con 0x7fb6f41639f0 2019-11-28T11:52:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb6f415f100 0x7fb6f406bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42440/0 (socket says 172.21.15.80:42440) 2019-11-28T11:52:34.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f259c700 1 -- 172.21.15.80:0/547837845 learned_addr learned my addr 172.21.15.80:0/547837845 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:34.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f359e700 1 --2- 172.21.15.80:0/547837845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41639f0 0x7fb6f4165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f1d9b700 1 -- 172.21.15.80:0/547837845 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951644534 0 0) 0x7fb6e4001150 con 0x7fb6f415f100 2019-11-28T11:52:34.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f1d9b700 1 -- 172.21.15.80:0/547837845 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6d4002e80 con 0x7fb6f415f100 2019-11-28T11:52:34.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f1d9b700 1 -- 172.21.15.80:0/547837845 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979917266 0 0) 0x7fb6dc001400 con 0x7fb6f415ed10 2019-11-28T11:52:34.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f1d9b700 1 -- 172.21.15.80:0/547837845 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6d40030b0 con 0x7fb6f415ed10 2019-11-28T11:52:34.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f1d9b700 1 -- 172.21.15.80:0/547837845 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1697084770 0 0) 0x7fb6e4001130 con 0x7fb6f415f100 2019-11-28T11:52:34.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f359e700 1 -- 172.21.15.80:0/547837845 >> v1:172.21.15.174:6789/0 conn(0x7fb6f415ed10 legacy=0x7fb6f4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f359e700 1 -- 172.21.15.80:0/547837845 >> v1:172.21.15.80:6789/0 conn(0x7fb6f415f100 legacy=0x7fb6f406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f359e700 1 -- 172.21.15.80:0/547837845 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f4070760 con 0x7fb6f41639f0 2019-11-28T11:52:34.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f359e700 1 --2- 172.21.15.80:0/547837845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41639f0 0x7fb6f4165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb6ec00af80 tx=0x7fb6ec00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f359e700 1 --2- 172.21.15.80:0/547837845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41639f0 0x7fb6f4165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb6ec00af80 tx=0x7fb6ec00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f359e700 1 --2- 172.21.15.80:0/547837845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41639f0 0x7fb6f4165df0 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7fb6ec00af80 tx=0x7fb6ec00b790).ready entity=mon.2 client_cookie=182f858acf1315a4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:34.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f359e700 1 --2- 172.21.15.80:0/547837845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41639f0 0x7fb6f4165df0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7fb6ec00af80 tx=0x7fb6ec00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f1d9b700 1 -- 172.21.15.80:0/547837845 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6ec007240 con 0x7fb6f41639f0 2019-11-28T11:52:34.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f359e700 1 --2- 172.21.15.80:0/547837845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41639f0 0x7fb6f4165df0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7fb6ec00af80 tx=0x7fb6ec00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.635+0000 7fb6f359e700 1 --2- 172.21.15.80:0/547837845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41639f0 0x7fb6f4165df0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7fb6ec00af80 tx=0x7fb6ec00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.636+0000 7fb6f1d9b700 1 -- 172.21.15.80:0/547837845 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec000bb0 con 0x7fb6f41639f0 2019-11-28T11:52:34.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.636+0000 7fb6f1d9b700 1 -- 172.21.15.80:0/547837845 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6ec009e60 con 0x7fb6f41639f0 2019-11-28T11:52:34.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.636+0000 7fb6f888c700 1 -- 172.21.15.80:0/547837845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41639f0 msgr2=0x7fb6f4165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.636+0000 7fb6f888c700 1 --2- 172.21.15.80:0/547837845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41639f0 0x7fb6f4165df0 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7fb6ec00af80 tx=0x7fb6ec00b790).stop 2019-11-28T11:52:34.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.636+0000 7fb6f888c700 1 -- 172.21.15.80:0/547837845 shutdown_connections 2019-11-28T11:52:34.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.636+0000 7fb6f888c700 1 --2- 172.21.15.80:0/547837845 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41639f0 0x7fb6f4165df0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.636+0000 7fb6f888c700 1 -- 172.21.15.80:0/547837845 shutdown_connections 2019-11-28T11:52:34.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.636+0000 7fb6f888c700 1 -- 172.21.15.80:0/547837845 wait complete. 2019-11-28T11:52:34.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.636+0000 7fb6f888c700 1 -- 172.21.15.80:0/547837845 >> 172.21.15.80:0/547837845 conn(0x7fb6f4061d40 msgr2=0x7fb6f40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:34.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.639+0000 7fb6f888c700 1 Processor -- start 2019-11-28T11:52:34.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.639+0000 7fb6f888c700 1 -- start start 2019-11-28T11:52:34.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6f888c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41047a0 0x7fb6f4104be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:34.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6f888c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f4107c20 con 0x7fb6f412c340 2019-11-28T11:52:34.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6f888c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f415de30 con 0x7fb6f4152750 2019-11-28T11:52:34.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6f888c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f4106880 con 0x7fb6f41047a0 2019-11-28T11:52:34.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6f259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb6f412c340 0x7fb6f412c7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42444/0 (socket says 172.21.15.80:42444) 2019-11-28T11:52:34.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6f259c700 1 -- 172.21.15.80:0/3920885212 learned_addr learned my addr 172.21.15.80:0/3920885212 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:34.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6f359e700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41047a0 0x7fb6f4104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6eb7fe700 1 -- 172.21.15.80:0/3920885212 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582307765 0 0) 0x7fb6e4001150 con 0x7fb6f412c340 2019-11-28T11:52:34.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6eb7fe700 1 -- 172.21.15.80:0/3920885212 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6cc002e80 con 0x7fb6f412c340 2019-11-28T11:52:34.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6eb7fe700 1 -- 172.21.15.80:0/3920885212 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462853210 0 0) 0x7fb6dc0013b0 con 0x7fb6f4152750 2019-11-28T11:52:34.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6eb7fe700 1 -- 172.21.15.80:0/3920885212 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6cc0030b0 con 0x7fb6f4152750 2019-11-28T11:52:34.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6eb7fe700 1 -- 172.21.15.80:0/3920885212 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1540448207 0 0) 0x7fb6e4001350 con 0x7fb6f412c340 2019-11-28T11:52:34.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6f359e700 1 -- 172.21.15.80:0/3920885212 >> v1:172.21.15.174:6789/0 conn(0x7fb6f4152750 legacy=0x7fb6f41058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6f359e700 1 -- 172.21.15.80:0/3920885212 >> v1:172.21.15.80:6789/0 conn(0x7fb6f412c340 legacy=0x7fb6f412c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6f359e700 1 -- 172.21.15.80:0/3920885212 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f4106f10 con 0x7fb6f41047a0 2019-11-28T11:52:34.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6f359e700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41047a0 0x7fb6f4104be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb6ec0103c0 tx=0x7fb6ec010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6f359e700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41047a0 0x7fb6f4104be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb6ec0103c0 tx=0x7fb6ec010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.640+0000 7fb6f359e700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41047a0 0x7fb6f4104be0 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7fb6ec0103c0 tx=0x7fb6ec010760).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.641+0000 7fb6f359e700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41047a0 0x7fb6f4104be0 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7fb6ec0103c0 tx=0x7fb6ec010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.641+0000 7fb6eb7fe700 1 -- 172.21.15.80:0/3920885212 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6ec0099b0 con 0x7fb6f41047a0 2019-11-28T11:52:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.641+0000 7fb6f359e700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41047a0 0x7fb6f4104be0 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7fb6ec0103c0 tx=0x7fb6ec010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.641+0000 7fb6f359e700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41047a0 0x7fb6f4104be0 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7fb6ec0103c0 tx=0x7fb6ec010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.641+0000 7fb6eb7fe700 1 -- 172.21.15.80:0/3920885212 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec009bb0 con 0x7fb6f41047a0 2019-11-28T11:52:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.641+0000 7fb6eb7fe700 1 -- 172.21.15.80:0/3920885212 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6ec00a2c0 con 0x7fb6f41047a0 2019-11-28T11:52:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.641+0000 7fb6f888c700 1 -- 172.21.15.80:0/3920885212 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f4107290 con 0x7fb6f41047a0 2019-11-28T11:52:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.641+0000 7fb6f888c700 1 -- 172.21.15.80:0/3920885212 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f4106f10 con 0x7fb6f41047a0 2019-11-28T11:52:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.641+0000 7fb6f359e700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41047a0 0x7fb6f4104be0 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7fb6ec0103c0 tx=0x7fb6ec010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.641+0000 7fb6eb7fe700 1 -- 172.21.15.80:0/3920885212 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb6ec0097c0 con 0x7fb6f41047a0 2019-11-28T11:52:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.641+0000 7fb6f359e700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41047a0 0x7fb6f4104be0 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7fb6ec0103c0 tx=0x7fb6ec010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.641+0000 7fb6eb7fe700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb6cc018750 0x7fb6cc01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.641+0000 7fb6eb7fe700 1 -- 172.21.15.80:0/3920885212 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb6ec031a70 con 0x7fb6f41047a0 2019-11-28T11:52:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.642+0000 7fb6f2d9d700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb6cc018750 0x7fb6cc01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.642+0000 7fb6f2d9d700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb6cc018750 0x7fb6cc01abe0 crc :-1 s=READY pgs=911 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.649+0000 7fb6f888c700 1 -- 172.21.15.80:0/3920885212 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f4107290 con 0x7fb6f41047a0 2019-11-28T11:52:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.653+0000 7fb6f359e700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41047a0 0x7fb6f4104be0 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7fb6ec0103c0 tx=0x7fb6ec010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.653+0000 7fb6eb7fe700 1 -- 172.21.15.80:0/3920885212 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb6ec0095b0 con 0x7fb6f41047a0 2019-11-28T11:52:34.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.825+0000 7fb6f888c700 1 -- 172.21.15.80:0/3920885212 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fb6f4106f10 con 0x7fb6f41047a0 2019-11-28T11:52:34.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.831+0000 7fb6f359e700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41047a0 0x7fb6f4104be0 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7fb6ec0103c0 tx=0x7fb6ec010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:34.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.831+0000 7fb6eb7fe700 1 -- 172.21.15.80:0/3920885212 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v62) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb6ec0098f0 con 0x7fb6f41047a0 2019-11-28T11:52:34.884 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:52:34.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.834+0000 7fb6f888c700 1 -- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb6cc018750 msgr2=0x7fb6cc01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.834+0000 7fb6f888c700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb6cc018750 0x7fb6cc01abe0 crc :-1 s=READY pgs=911 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.834+0000 7fb6f888c700 1 -- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41047a0 msgr2=0x7fb6f4104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:34.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.834+0000 7fb6f888c700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41047a0 0x7fb6f4104be0 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7fb6ec0103c0 tx=0x7fb6ec010760).stop 2019-11-28T11:52:34.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.834+0000 7fb6f888c700 1 -- 172.21.15.80:0/3920885212 shutdown_connections 2019-11-28T11:52:34.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.834+0000 7fb6f888c700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb6f41047a0 0x7fb6f4104be0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.834+0000 7fb6f888c700 1 --2- 172.21.15.80:0/3920885212 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb6cc018750 0x7fb6cc01abe0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:34.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.834+0000 7fb6f888c700 1 -- 172.21.15.80:0/3920885212 shutdown_connections 2019-11-28T11:52:34.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.834+0000 7fb6f888c700 1 -- 172.21.15.80:0/3920885212 wait complete. 2019-11-28T11:52:34.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.834+0000 7fb6f888c700 1 -- 172.21.15.80:0/3920885212 >> 172.21.15.80:0/3920885212 conn(0x7fb6f41476e0 msgr2=0x7fb6f412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:34.896 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:52:35.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.977+0000 7f6d3e091700 1 Processor -- start 2019-11-28T11:52:35.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.977+0000 7f6d3e091700 1 -- start start 2019-11-28T11:52:35.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.978+0000 7f6d3e091700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d3815f100 0x7f6d3806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:35.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.978+0000 7f6d3e091700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3806db60 con 0x7f6d3815ed10 2019-11-28T11:52:35.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.978+0000 7f6d3e091700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3806e060 con 0x7f6d3806c2f0 2019-11-28T11:52:35.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.978+0000 7f6d3e091700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3806fe00 con 0x7f6d3815f100 2019-11-28T11:52:35.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.978+0000 7f6d2ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d3815f100 0x7f6d3806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:35.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.978+0000 7f6d2ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d3815f100 0x7f6d3806bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43136/0 (socket says 172.21.15.80:43136) 2019-11-28T11:52:35.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.978+0000 7f6d2ffff700 1 -- 172.21.15.80:0/2997334027 learned_addr learned my addr 172.21.15.80:0/2997334027 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:35.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.978+0000 7f6d2ffff700 1 -- 172.21.15.80:0/2997334027 >> v1:172.21.15.174:6789/0 conn(0x7f6d3806c2f0 legacy=0x7f6d3806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:35.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.978+0000 7f6d2ffff700 1 -- 172.21.15.80:0/2997334027 >> v1:172.21.15.80:6789/0 conn(0x7f6d3815ed10 legacy=0x7f6d38073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:35.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.978+0000 7f6d377fe700 1 -- 172.21.15.80:0/2997334027 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692236471 0 0) 0x7f6d28001100 con 0x7f6d3815ed10 2019-11-28T11:52:35.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.978+0000 7f6d2ffff700 1 -- 172.21.15.80:0/2997334027 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d38070760 con 0x7f6d3815f100 2019-11-28T11:52:35.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.979+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/2997334027 >> v2:172.21.15.80:3300/0 conn(0x7f6d3815f100 0x7f6d3806bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6d2000f740 tx=0x7f6d2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.979+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/2997334027 >> v2:172.21.15.80:3300/0 conn(0x7f6d3815f100 0x7f6d3806bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6d2000f740 tx=0x7f6d2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.979+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/2997334027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d3815f100 0x7f6d3806bdb0 secure :-1 s=READY pgs=2229 cs=0 l=1 rx=0x7f6d2000f740 tx=0x7f6d2000fae0).ready entity=mon.0 client_cookie=a339e52fcf0642d9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:35.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.979+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/2997334027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d3815f100 0x7f6d3806bdb0 secure :-1 s=THROTTLE_DONE pgs=2229 cs=0 l=1 rx=0x7f6d2000f740 tx=0x7f6d2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.979+0000 7f6d377fe700 1 -- 172.21.15.80:0/2997334027 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d20000960 con 0x7f6d3815f100 2019-11-28T11:52:35.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.979+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/2997334027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d3815f100 0x7f6d3806bdb0 secure :-1 s=THROTTLE_DONE pgs=2229 cs=0 l=1 rx=0x7f6d2000f740 tx=0x7f6d2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.979+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/2997334027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d3815f100 0x7f6d3806bdb0 secure :-1 s=THROTTLE_DONE pgs=2229 cs=0 l=1 rx=0x7f6d2000f740 tx=0x7f6d2000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.979+0000 7f6d377fe700 1 -- 172.21.15.80:0/2997334027 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d20000c90 con 0x7f6d3815f100 2019-11-28T11:52:35.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.979+0000 7f6d377fe700 1 -- 172.21.15.80:0/2997334027 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d20001360 con 0x7f6d3815f100 2019-11-28T11:52:35.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.979+0000 7f6d3e091700 1 -- 172.21.15.80:0/2997334027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d3815f100 msgr2=0x7f6d3806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:35.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.979+0000 7f6d3e091700 1 --2- 172.21.15.80:0/2997334027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d3815f100 0x7f6d3806bdb0 secure :-1 s=READY pgs=2229 cs=0 l=1 rx=0x7f6d2000f740 tx=0x7f6d2000fae0).stop 2019-11-28T11:52:35.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.979+0000 7f6d3e091700 1 -- 172.21.15.80:0/2997334027 shutdown_connections 2019-11-28T11:52:35.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.979+0000 7f6d3e091700 1 --2- 172.21.15.80:0/2997334027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d3815f100 0x7f6d3806bdb0 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:35.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.979+0000 7f6d3e091700 1 -- 172.21.15.80:0/2997334027 shutdown_connections 2019-11-28T11:52:35.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.979+0000 7f6d3e091700 1 -- 172.21.15.80:0/2997334027 wait complete. 2019-11-28T11:52:35.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.979+0000 7f6d3e091700 1 -- 172.21.15.80:0/2997334027 >> 172.21.15.80:0/2997334027 conn(0x7f6d38061d40 msgr2=0x7f6d380641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:35.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.982+0000 7f6d3e091700 1 Processor -- start 2019-11-28T11:52:35.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.982+0000 7f6d3e091700 1 -- start start 2019-11-28T11:52:35.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d3e091700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6d381273e0 0x7f6d38101e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:35.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d3e091700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d38114970 0x7f6d38114e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:35.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d3e091700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d38115830 con 0x7f6d3812ea60 2019-11-28T11:52:35.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d3e091700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d38137f90 con 0x7f6d38114970 2019-11-28T11:52:35.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d3e091700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d38113e00 con 0x7f6d381273e0 2019-11-28T11:52:35.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d2ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d38114970 0x7f6d38114e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:35.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d2ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d38114970 0x7f6d38114e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43142/0 (socket says 172.21.15.80:43142) 2019-11-28T11:52:35.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d2ffff700 1 -- 172.21.15.80:0/1902268681 learned_addr learned my addr 172.21.15.80:0/1902268681 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:35.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d37fff700 1 --2- 172.21.15.80:0/1902268681 >> v2:172.21.15.174:3300/0 conn(0x7f6d381273e0 0x7f6d38101e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:35.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d2ffff700 1 -- 172.21.15.80:0/1902268681 >> v2:172.21.15.174:3300/0 conn(0x7f6d381273e0 msgr2=0x7f6d38101e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:35.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/1902268681 >> v2:172.21.15.174:3300/0 conn(0x7f6d381273e0 0x7f6d38101e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:35.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d2ffff700 1 -- 172.21.15.80:0/1902268681 >> v1:172.21.15.174:6789/0 conn(0x7f6d3812ea60 legacy=0x7f6d38111e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:35.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d2ffff700 1 -- 172.21.15.80:0/1902268681 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d38138620 con 0x7f6d38114970 2019-11-28T11:52:35.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/1902268681 >> v2:172.21.15.80:3300/0 conn(0x7f6d38114970 0x7f6d38114e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d20010480 tx=0x7f6d20010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/1902268681 >> v2:172.21.15.80:3300/0 conn(0x7f6d38114970 0x7f6d38114e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d20010480 tx=0x7f6d20010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/1902268681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d38114970 0x7f6d38114e00 secure :-1 s=READY pgs=2230 cs=0 l=1 rx=0x7f6d20010480 tx=0x7f6d20010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/1902268681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d38114970 0x7f6d38114e00 secure :-1 s=THROTTLE_DONE pgs=2230 cs=0 l=1 rx=0x7f6d20010480 tx=0x7f6d20010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d357fa700 1 -- 172.21.15.80:0/1902268681 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d20000940 con 0x7f6d38114970 2019-11-28T11:52:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/1902268681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d38114970 0x7f6d38114e00 secure :-1 s=THROTTLE_DONE pgs=2230 cs=0 l=1 rx=0x7f6d20010480 tx=0x7f6d20010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d357fa700 1 -- 172.21.15.80:0/1902268681 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d20000f50 con 0x7f6d38114970 2019-11-28T11:52:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/1902268681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d38114970 0x7f6d38114e00 secure :-1 s=THROTTLE_DONE pgs=2230 cs=0 l=1 rx=0x7f6d20010480 tx=0x7f6d20010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d357fa700 1 -- 172.21.15.80:0/1902268681 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d20000940 con 0x7f6d38114970 2019-11-28T11:52:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d3e091700 1 -- 172.21.15.80:0/1902268681 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d381389a0 con 0x7f6d38114970 2019-11-28T11:52:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.983+0000 7f6d3e091700 1 -- 172.21.15.80:0/1902268681 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d38138620 con 0x7f6d38114970 2019-11-28T11:52:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.984+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/1902268681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d38114970 0x7f6d38114e00 secure :-1 s=THROTTLE_DONE pgs=2230 cs=0 l=1 rx=0x7f6d20010480 tx=0x7f6d20010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.984+0000 7f6d357fa700 1 -- 172.21.15.80:0/1902268681 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6d20007740 con 0x7f6d38114970 2019-11-28T11:52:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.984+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/1902268681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d38114970 0x7f6d38114e00 secure :-1 s=THROTTLE_DONE pgs=2230 cs=0 l=1 rx=0x7f6d20010480 tx=0x7f6d20010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.984+0000 7f6d357fa700 1 --2- 172.21.15.80:0/1902268681 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d1c018730 0x7f6d1c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:35.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.984+0000 7f6d357fa700 1 -- 172.21.15.80:0/1902268681 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6d20031ab0 con 0x7f6d38114970 2019-11-28T11:52:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.984+0000 7f6d37fff700 1 --2- 172.21.15.80:0/1902268681 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d1c018730 0x7f6d1c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.985+0000 7f6d37fff700 1 --2- 172.21.15.80:0/1902268681 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d1c018730 0x7f6d1c01abc0 crc :-1 s=READY pgs=912 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:35.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.992+0000 7f6d3e091700 1 -- 172.21.15.80:0/1902268681 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d381389a0 con 0x7f6d38114970 2019-11-28T11:52:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.995+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/1902268681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d38114970 0x7f6d38114e00 secure :-1 s=THROTTLE_DONE pgs=2230 cs=0 l=1 rx=0x7f6d20010480 tx=0x7f6d20010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:34.995+0000 7f6d357fa700 1 -- 172.21.15.80:0/1902268681 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6d20000940 con 0x7f6d38114970 2019-11-28T11:52:35.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.167+0000 7f6d3e091700 1 -- 172.21.15.80:0/1902268681 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6d38138620 con 0x7f6d38114970 2019-11-28T11:52:35.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.172+0000 7f6d2ffff700 1 --2- 172.21.15.80:0/1902268681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d38114970 0x7f6d38114e00 secure :-1 s=THROTTLE_DONE pgs=2230 cs=0 l=1 rx=0x7f6d20010480 tx=0x7f6d20010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.172+0000 7f6d357fa700 1 -- 172.21.15.80:0/1902268681 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v63) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6d20017430 con 0x7f6d38114970 2019-11-28T11:52:35.226 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:52:35.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.176+0000 7f6d3e091700 1 -- 172.21.15.80:0/1902268681 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d1c018730 msgr2=0x7f6d1c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:35.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.176+0000 7f6d3e091700 1 --2- 172.21.15.80:0/1902268681 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d1c018730 0x7f6d1c01abc0 crc :-1 s=READY pgs=912 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:35.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.176+0000 7f6d3e091700 1 -- 172.21.15.80:0/1902268681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d38114970 msgr2=0x7f6d38114e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:35.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.176+0000 7f6d3e091700 1 --2- 172.21.15.80:0/1902268681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d38114970 0x7f6d38114e00 secure :-1 s=READY pgs=2230 cs=0 l=1 rx=0x7f6d20010480 tx=0x7f6d20010280).stop 2019-11-28T11:52:35.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.176+0000 7f6d3e091700 1 -- 172.21.15.80:0/1902268681 shutdown_connections 2019-11-28T11:52:35.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.176+0000 7f6d3e091700 1 --2- 172.21.15.80:0/1902268681 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d1c018730 0x7f6d1c01abc0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:35.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.176+0000 7f6d3e091700 1 --2- 172.21.15.80:0/1902268681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d38114970 0x7f6d38114e00 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:35.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.176+0000 7f6d3e091700 1 --2- 172.21.15.80:0/1902268681 >> v2:172.21.15.174:3300/0 conn(0x7f6d381273e0 0x7f6d38101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:35.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.176+0000 7f6d3e091700 1 -- 172.21.15.80:0/1902268681 shutdown_connections 2019-11-28T11:52:35.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.176+0000 7f6d3e091700 1 -- 172.21.15.80:0/1902268681 wait complete. 2019-11-28T11:52:35.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.177+0000 7f6d3e091700 1 -- 172.21.15.80:0/1902268681 >> 172.21.15.80:0/1902268681 conn(0x7f6d38166610 msgr2=0x7f6d381473d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:35.239 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:35.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.306+0000 7f62d5b0b700 1 Processor -- start 2019-11-28T11:52:35.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.306+0000 7f62d5b0b700 1 -- start start 2019-11-28T11:52:35.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62d5b0b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d006d120 0x7f62d0165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:35.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62d5b0b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d006d580 con 0x7f62d006c490 2019-11-28T11:52:35.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62d5b0b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d006db00 con 0x7f62d006c0a0 2019-11-28T11:52:35.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62d5b0b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d006fd60 con 0x7f62d006d120 2019-11-28T11:52:35.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62c7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f62d006c490 0x7f62d006c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42466/0 (socket says 172.21.15.80:42466) 2019-11-28T11:52:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62c7fff700 1 -- 172.21.15.80:0/2724927099 learned_addr learned my addr 172.21.15.80:0/2724927099 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62d48a9700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d006d120 0x7f62d0165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62cf7fe700 1 -- 172.21.15.80:0/2724927099 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874863487 0 0) 0x7f62b8001150 con 0x7f62d006c490 2019-11-28T11:52:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62cf7fe700 1 -- 172.21.15.80:0/2724927099 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62bc002e80 con 0x7f62d006c490 2019-11-28T11:52:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62cf7fe700 1 -- 172.21.15.80:0/2724927099 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4264078507 0 0) 0x7f62b8001130 con 0x7f62d006c490 2019-11-28T11:52:35.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62cf7fe700 1 -- 172.21.15.80:0/2724927099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d006d120 msgr2=0x7f62d0165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62cf7fe700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d006d120 0x7f62d0165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62cf7fe700 1 -- 172.21.15.80:0/2724927099 >> v1:172.21.15.174:6789/0 conn(0x7f62d006c0a0 legacy=0x7f62d0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62cf7fe700 1 -- 172.21.15.80:0/2724927099 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d00706c0 con 0x7f62d006c490 2019-11-28T11:52:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62cf7fe700 1 -- 172.21.15.80:0/2724927099 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f62b8001660 con 0x7f62d006c490 2019-11-28T11:52:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62cf7fe700 1 -- 172.21.15.80:0/2724927099 >> v1:172.21.15.80:6789/0 conn(0x7f62d006c490 legacy=0x7f62d006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62cf7fe700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62bc003ab0 0x7f62bc005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:35.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62cf7fe700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62bc006690 0x7f62bc008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:35.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62cf7fe700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62bc009380 0x7f62bc00b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:35.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62cf7fe700 1 -- 172.21.15.80:0/2724927099 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc00bfd0 con 0x7f62bc006690 2019-11-28T11:52:35.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62cf7fe700 1 -- 172.21.15.80:0/2724927099 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0501d0 con 0x7f62bc003ab0 2019-11-28T11:52:35.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62cf7fe700 1 -- 172.21.15.80:0/2724927099 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc050400 con 0x7f62bc009380 2019-11-28T11:52:35.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62c7fff700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62bc006690 0x7f62bc008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:35.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62d48a9700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62bc009380 0x7f62bc00b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:35.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.307+0000 7f62cffff700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62bc003ab0 0x7f62bc005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:35.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62c7fff700 1 -- 172.21.15.80:0/2724927099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62bc009380 msgr2=0x7f62bc00b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:35.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62c7fff700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62bc009380 0x7f62bc00b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:35.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62c7fff700 1 -- 172.21.15.80:0/2724927099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62bc003ab0 msgr2=0x7f62bc005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:35.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62c7fff700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62bc003ab0 0x7f62bc005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:35.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62c7fff700 1 -- 172.21.15.80:0/2724927099 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc0506b0 con 0x7f62bc006690 2019-11-28T11:52:35.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62cffff700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62bc003ab0 0x7f62bc005f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:52:35.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62c7fff700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62bc006690 0x7f62bc008b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f62b800f8e0 tx=0x7f62b800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62c7fff700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62bc006690 0x7f62bc008b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f62b800f8e0 tx=0x7f62b800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62c7fff700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62bc006690 0x7f62bc008b20 secure :-1 s=READY pgs=2232 cs=0 l=1 rx=0x7f62b800f8e0 tx=0x7f62b800f790).ready entity=mon.0 client_cookie=e9a38504b6598297 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:35.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62c7fff700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62bc006690 0x7f62bc008b20 secure :-1 s=THROTTLE_DONE pgs=2232 cs=0 l=1 rx=0x7f62b800f8e0 tx=0x7f62b800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62cf7fe700 1 -- 172.21.15.80:0/2724927099 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62b8001130 con 0x7f62bc006690 2019-11-28T11:52:35.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62c7fff700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62bc006690 0x7f62bc008b20 secure :-1 s=THROTTLE_DONE pgs=2232 cs=0 l=1 rx=0x7f62b800f8e0 tx=0x7f62b800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62c7fff700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62bc006690 0x7f62bc008b20 secure :-1 s=THROTTLE_DONE pgs=2232 cs=0 l=1 rx=0x7f62b800f8e0 tx=0x7f62b800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62cf7fe700 1 -- 172.21.15.80:0/2724927099 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b8004430 con 0x7f62bc006690 2019-11-28T11:52:35.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62cf7fe700 1 -- 172.21.15.80:0/2724927099 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62b8004620 con 0x7f62bc006690 2019-11-28T11:52:35.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62d5b0b700 1 -- 172.21.15.80:0/2724927099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62bc006690 msgr2=0x7f62bc008b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:35.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62d5b0b700 1 --2- 172.21.15.80:0/2724927099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62bc006690 0x7f62bc008b20 secure :-1 s=READY pgs=2232 cs=0 l=1 rx=0x7f62b800f8e0 tx=0x7f62b800f790).stop 2019-11-28T11:52:35.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.308+0000 7f62d48a9700 1 -- 172.21.15.80:0/2724927099 reap_dead start 2019-11-28T11:52:35.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.309+0000 7f62d5b0b700 1 -- 172.21.15.80:0/2724927099 shutdown_connections 2019-11-28T11:52:35.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.309+0000 7f62d5b0b700 1 -- 172.21.15.80:0/2724927099 shutdown_connections 2019-11-28T11:52:35.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.309+0000 7f62d5b0b700 1 -- 172.21.15.80:0/2724927099 wait complete. 2019-11-28T11:52:35.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.309+0000 7f62d5b0b700 1 -- 172.21.15.80:0/2724927099 >> 172.21.15.80:0/2724927099 conn(0x7f62d0061cf0 msgr2=0x7f62d0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:35.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.311+0000 7f62d5b0b700 1 Processor -- start 2019-11-28T11:52:35.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.311+0000 7f62d5b0b700 1 -- start start 2019-11-28T11:52:35.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.312+0000 7f62d5b0b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f62d0074d00 0x7f62d007aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:35.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.312+0000 7f62d5b0b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d007bba0 0x7f62d0167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:35.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.312+0000 7f62d5b0b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d00754d0 con 0x7f62d0150f50 2019-11-28T11:52:35.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.312+0000 7f62d5b0b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d0078980 con 0x7f62d0074d00 2019-11-28T11:52:35.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.312+0000 7f62d5b0b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d0078c50 con 0x7f62d007bba0 2019-11-28T11:52:35.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.312+0000 7f62cffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f62d0074d00 0x7f62d007aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:35.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.312+0000 7f62c7fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f62d0150f50 0x7f62d007af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58024/0 (socket says 172.21.15.80:58024) 2019-11-28T11:52:35.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.312+0000 7f62c7fff700 1 -- 172.21.15.80:0/1486655657 learned_addr learned my addr 172.21.15.80:0/1486655657 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:35.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.312+0000 7f62d48a9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d007bba0 0x7f62d0167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:35.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.312+0000 7f62cffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f62d0074d00 0x7f62d007aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:58048/0 (socket says 172.21.15.80:58048) 2019-11-28T11:52:35.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.312+0000 7f62cd7fa700 1 -- 172.21.15.80:0/1486655657 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186839723 0 0) 0x7f62b8000f90 con 0x7f62d0150f50 2019-11-28T11:52:35.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.312+0000 7f62cd7fa700 1 -- 172.21.15.80:0/1486655657 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62b4002e80 con 0x7f62d0150f50 2019-11-28T11:52:35.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.313+0000 7f62d48a9700 1 -- 172.21.15.80:0/1486655657 >> v2:172.21.15.174:3300/0 conn(0x7f62d0074d00 msgr2=0x7f62d007aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:35.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.313+0000 7f62d48a9700 1 --2- 172.21.15.80:0/1486655657 >> v2:172.21.15.174:3300/0 conn(0x7f62d0074d00 0x7f62d007aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:35.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.313+0000 7f62d48a9700 1 -- 172.21.15.80:0/1486655657 >> v1:172.21.15.174:6789/0 conn(0x7f62d0150f50 legacy=0x7f62d007af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:35.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.313+0000 7f62d48a9700 1 -- 172.21.15.80:0/1486655657 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d00792e0 con 0x7f62d007bba0 2019-11-28T11:52:35.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.313+0000 7f62d48a9700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d007bba0 0x7f62d0167c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f62c8010710 tx=0x7f62c800b130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.313+0000 7f62d48a9700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d007bba0 0x7f62d0167c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f62c8010710 tx=0x7f62c800b130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.313+0000 7f62d48a9700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d007bba0 0x7f62d0167c20 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7f62c8010710 tx=0x7f62c800b130).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:35.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.313+0000 7f62d48a9700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d007bba0 0x7f62d0167c20 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f62c8010710 tx=0x7f62c800b130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.313+0000 7f62cd7fa700 1 -- 172.21.15.80:0/1486655657 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62c8000e90 con 0x7f62d007bba0 2019-11-28T11:52:35.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.313+0000 7f62d48a9700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d007bba0 0x7f62d0167c20 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f62c8010710 tx=0x7f62c800b130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.313+0000 7f62d48a9700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d007bba0 0x7f62d0167c20 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f62c8010710 tx=0x7f62c800b130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.313+0000 7f62cd7fa700 1 -- 172.21.15.80:0/1486655657 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c800f300 con 0x7f62d007bba0 2019-11-28T11:52:35.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.313+0000 7f62d5b0b700 1 -- 172.21.15.80:0/1486655657 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d0079660 con 0x7f62d007bba0 2019-11-28T11:52:35.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.313+0000 7f62cd7fa700 1 -- 172.21.15.80:0/1486655657 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62c800fa10 con 0x7f62d007bba0 2019-11-28T11:52:35.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.313+0000 7f62d5b0b700 1 -- 172.21.15.80:0/1486655657 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d00792e0 con 0x7f62d007bba0 2019-11-28T11:52:35.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.313+0000 7f62d48a9700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d007bba0 0x7f62d0167c20 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f62c8010710 tx=0x7f62c800b130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.314+0000 7f62cd7fa700 1 -- 172.21.15.80:0/1486655657 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f62c8000e70 con 0x7f62d007bba0 2019-11-28T11:52:35.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.314+0000 7f62d48a9700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d007bba0 0x7f62d0167c20 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f62c8010710 tx=0x7f62c800b130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.314+0000 7f62cd7fa700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f62b4018770 0x7f62b401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:35.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.314+0000 7f62cd7fa700 1 -- 172.21.15.80:0/1486655657 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f62c8031d60 con 0x7f62d007bba0 2019-11-28T11:52:35.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.314+0000 7f62cffff700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f62b4018770 0x7f62b401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:35.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.314+0000 7f62cffff700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f62b4018770 0x7f62b401abe0 crc :-1 s=READY pgs=915 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:35.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.321+0000 7f62d5b0b700 1 -- 172.21.15.80:0/1486655657 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d0079660 con 0x7f62d007bba0 2019-11-28T11:52:35.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.325+0000 7f62d48a9700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d007bba0 0x7f62d0167c20 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f62c8010710 tx=0x7f62c800b130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.325+0000 7f62cd7fa700 1 -- 172.21.15.80:0/1486655657 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f62c800eeb0 con 0x7f62d007bba0 2019-11-28T11:52:35.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.495+0000 7f62d5b0b700 1 -- 172.21.15.80:0/1486655657 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62d00792e0 con 0x7f62d007bba0 2019-11-28T11:52:35.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.496+0000 7f62d48a9700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d007bba0 0x7f62d0167c20 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f62c8010710 tx=0x7f62c800b130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:35.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.496+0000 7f62cd7fa700 1 -- 172.21.15.80:0/1486655657 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 139 v139) v1 ==== 95+0+2114 (secure 0 0 0) 0x7f62c8000e50 con 0x7f62d007bba0 2019-11-28T11:52:35.549 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 139 2019-11-28T11:52:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:35.549 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":139,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6834/632195489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":632195489},{"type":"v1","addr":"172.21.15.80:6834","nonce":632195489}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":137}],"filesystems":[{"mdsmap":{"epoch":139,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:35.148974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7181":{"gid":7181,"name":"c","rank":0,"incarnation":138,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/3265178535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3265178535},{"type":"v1","addr":"172.21.15.174:6835","nonce":3265178535}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:35.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.498+0000 7f62d5b0b700 1 -- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f62b4018770 msgr2=0x7f62b401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:35.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.498+0000 7f62d5b0b700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f62b4018770 0x7f62b401abe0 crc :-1 s=READY pgs=915 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:35.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.498+0000 7f62d5b0b700 1 -- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d007bba0 msgr2=0x7f62d0167c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:35.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.498+0000 7f62d5b0b700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d007bba0 0x7f62d0167c20 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7f62c8010710 tx=0x7f62c800b130).stop 2019-11-28T11:52:35.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.498+0000 7f62d5b0b700 1 -- 172.21.15.80:0/1486655657 shutdown_connections 2019-11-28T11:52:35.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.498+0000 7f62d5b0b700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62d007bba0 0x7f62d0167c20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:35.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.498+0000 7f62d5b0b700 1 --2- 172.21.15.80:0/1486655657 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f62b4018770 0x7f62b401abe0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.498+0000 7f62d5b0b700 1 --2- 172.21.15.80:0/1486655657 >> v2:172.21.15.174:3300/0 conn(0x7f62d0074d00 0x7f62d007aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.498+0000 7f62d5b0b700 1 -- 172.21.15.80:0/1486655657 shutdown_connections 2019-11-28T11:52:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.498+0000 7f62d5b0b700 1 -- 172.21.15.80:0/1486655657 wait complete. 2019-11-28T11:52:35.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:35.498+0000 7f62d5b0b700 1 -- 172.21.15.80:0/1486655657 >> 172.21.15.80:0/1486655657 conn(0x7f62d013fa50 msgr2=0x7f62d007c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:35.862 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7181}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 28, u'failed': [], u'epoch': 139, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [29], u'info': {u'gid_7181': {u'export_targets': [], u'name': u'c', u'incarnation': 138, u'state_seq': 2, u'state': u'up:active', u'gid': 7181, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3265178535, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 3265178535, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/3265178535'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:52:31.482361+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:52:35.148974+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:52:35.862 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:52:35.863 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:52:35.998 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:52:35.998 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:52:35.998 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:52:35.999 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 7181, 2019-11-28T11:52:35.999 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:52:35.999 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:52:35.999 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 1.8075822319999999, 2019-11-28T11:52:35.999 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 139, 2019-11-28T11:52:35.999 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 176, 2019-11-28T11:52:35.999 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 176, 2019-11-28T11:52:36.000 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 2.046711733 2019-11-28T11:52:36.000 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:52:36.004 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7181, "want_state": "up:active", "state": "up:active", "rank_uptime": 1.8075822319999999, "mdsmap_epoch": 139, "osdmap_epoch": 176, "osdmap_epoch_barrier": 176, "uptime": 2.046711733 } 2019-11-28T11:52:36.004 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:52:36.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.072+0000 7f5b88622700 1 Processor -- start 2019-11-28T11:52:36.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.072+0000 7f5b88622700 1 -- start start 2019-11-28T11:52:36.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.073+0000 7f5b88622700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b8006d120 0x7f5b80165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:36.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.073+0000 7f5b88622700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8006d580 con 0x7f5b8006c0a0 2019-11-28T11:52:36.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.073+0000 7f5b88622700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8006db00 con 0x7f5b8006c490 2019-11-28T11:52:36.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.073+0000 7f5b88622700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8006fd60 con 0x7f5b8006d120 2019-11-28T11:52:36.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.073+0000 7f5b86bbf700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5b8006c0a0 0x7f5b80072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42486/0 (socket says 172.21.15.80:42486) 2019-11-28T11:52:36.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.073+0000 7f5b86bbf700 1 -- 172.21.15.80:0/1207636375 learned_addr learned my addr 172.21.15.80:0/1207636375 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:36.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.073+0000 7f5b873c0700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b8006d120 0x7f5b80165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.073+0000 7f5b85bbd700 1 -- 172.21.15.80:0/1207636375 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123083219 0 0) 0x7f5b780014d0 con 0x7f5b8006c0a0 2019-11-28T11:52:36.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.073+0000 7f5b85bbd700 1 -- 172.21.15.80:0/1207636375 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b68002e80 con 0x7f5b8006c0a0 2019-11-28T11:52:36.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b85bbd700 1 -- 172.21.15.80:0/1207636375 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3138478904 0 0) 0x7f5b780014b0 con 0x7f5b8006c0a0 2019-11-28T11:52:36.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b85bbd700 1 -- 172.21.15.80:0/1207636375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b8006d120 msgr2=0x7f5b80165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:36.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b85bbd700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b8006d120 0x7f5b80165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:36.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b85bbd700 1 -- 172.21.15.80:0/1207636375 >> v1:172.21.15.174:6789/0 conn(0x7f5b8006c490 legacy=0x7f5b8006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b85bbd700 1 -- 172.21.15.80:0/1207636375 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b800706c0 con 0x7f5b8006c0a0 2019-11-28T11:52:36.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b85bbd700 1 -- 172.21.15.80:0/1207636375 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f5b78001a40 con 0x7f5b8006c0a0 2019-11-28T11:52:36.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b85bbd700 1 -- 172.21.15.80:0/1207636375 >> v1:172.21.15.80:6789/0 conn(0x7f5b8006c0a0 legacy=0x7f5b80072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b85bbd700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b68003ab0 0x7f5b68005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:36.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b85bbd700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b68006670 0x7f5b68008b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:36.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b85bbd700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b68009300 0x7f5b6800b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:36.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b85bbd700 1 -- 172.21.15.80:0/1207636375 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6800bfe0 con 0x7f5b68009300 2019-11-28T11:52:36.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b873c0700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b68009300 0x7f5b6800b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b85bbd700 1 -- 172.21.15.80:0/1207636375 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680501e0 con 0x7f5b68006670 2019-11-28T11:52:36.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b85bbd700 1 -- 172.21.15.80:0/1207636375 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b68050410 con 0x7f5b68003ab0 2019-11-28T11:52:36.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b86bbf700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b68003ab0 0x7f5b68005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b863be700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b68006670 0x7f5b68008b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b873c0700 1 -- 172.21.15.80:0/1207636375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b68003ab0 msgr2=0x7f5b68005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:36.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b873c0700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b68003ab0 0x7f5b68005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:36.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b873c0700 1 -- 172.21.15.80:0/1207636375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b68006670 msgr2=0x7f5b68008b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:36.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b873c0700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b68006670 0x7f5b68008b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:36.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b873c0700 1 -- 172.21.15.80:0/1207636375 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680506c0 con 0x7f5b68009300 2019-11-28T11:52:36.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b873c0700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b68009300 0x7f5b6800b7d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5b70002a20 tx=0x7f5b70002920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b873c0700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b68009300 0x7f5b6800b7d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5b70002a20 tx=0x7f5b70002920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b873c0700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b68009300 0x7f5b6800b7d0 secure :-1 s=READY pgs=2234 cs=0 l=1 rx=0x7f5b70002a20 tx=0x7f5b70002920).ready entity=mon.0 client_cookie=ffa4b4322dd5c676 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:36.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b873c0700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b68009300 0x7f5b6800b7d0 secure :-1 s=THROTTLE_DONE pgs=2234 cs=0 l=1 rx=0x7f5b70002a20 tx=0x7f5b70002920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b873c0700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b68009300 0x7f5b6800b7d0 secure :-1 s=THROTTLE_DONE pgs=2234 cs=0 l=1 rx=0x7f5b70002a20 tx=0x7f5b70002920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b85bbd700 1 -- 172.21.15.80:0/1207636375 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b70000a70 con 0x7f5b68009300 2019-11-28T11:52:36.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b873c0700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b68009300 0x7f5b6800b7d0 secure :-1 s=THROTTLE_DONE pgs=2234 cs=0 l=1 rx=0x7f5b70002a20 tx=0x7f5b70002920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b85bbd700 1 -- 172.21.15.80:0/1207636375 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7000ec90 con 0x7f5b68009300 2019-11-28T11:52:36.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b85bbd700 1 -- 172.21.15.80:0/1207636375 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b7000f320 con 0x7f5b68009300 2019-11-28T11:52:36.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b88622700 1 -- 172.21.15.80:0/1207636375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b68009300 msgr2=0x7f5b6800b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b88622700 1 --2- 172.21.15.80:0/1207636375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b68009300 0x7f5b6800b7d0 secure :-1 s=READY pgs=2234 cs=0 l=1 rx=0x7f5b70002a20 tx=0x7f5b70002920).stop 2019-11-28T11:52:36.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.074+0000 7f5b873c0700 1 -- 172.21.15.80:0/1207636375 reap_dead start 2019-11-28T11:52:36.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.075+0000 7f5b88622700 1 -- 172.21.15.80:0/1207636375 shutdown_connections 2019-11-28T11:52:36.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.075+0000 7f5b88622700 1 -- 172.21.15.80:0/1207636375 shutdown_connections 2019-11-28T11:52:36.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.075+0000 7f5b88622700 1 -- 172.21.15.80:0/1207636375 wait complete. 2019-11-28T11:52:36.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.075+0000 7f5b88622700 1 -- 172.21.15.80:0/1207636375 >> 172.21.15.80:0/1207636375 conn(0x7f5b80061cf0 msgr2=0x7f5b80064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:36.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.078+0000 7f5b88622700 1 Processor -- start 2019-11-28T11:52:36.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.078+0000 7f5b88622700 1 -- start start 2019-11-28T11:52:36.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.078+0000 7f5b88622700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b80074d00 0x7f5b8007aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:36.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.078+0000 7f5b88622700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5b8007bba0 0x7f5b80167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:36.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.078+0000 7f5b88622700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b800754d0 con 0x7f5b80150f50 2019-11-28T11:52:36.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.078+0000 7f5b88622700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b80077f50 con 0x7f5b8007bba0 2019-11-28T11:52:36.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b88622700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b80078980 con 0x7f5b80074d00 2019-11-28T11:52:36.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b873c0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5b8007bba0 0x7f5b80167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b873c0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5b8007bba0 0x7f5b80167c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43186/0 (socket says 172.21.15.80:43186) 2019-11-28T11:52:36.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b863be700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5b80150f50 0x7f5b8007af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42500/0 (socket says 172.21.15.80:42500) 2019-11-28T11:52:36.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b873c0700 1 -- 172.21.15.80:0/3106886586 learned_addr learned my addr 172.21.15.80:0/3106886586 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:36.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b86bbf700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b80074d00 0x7f5b8007aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b873c0700 1 -- 172.21.15.80:0/3106886586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b80074d00 msgr2=0x7f5b8007aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b873c0700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b80074d00 0x7f5b8007aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b873c0700 1 -- 172.21.15.80:0/3106886586 >> v1:172.21.15.80:6789/0 conn(0x7f5b80150f50 legacy=0x7f5b8007af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b873c0700 1 -- 172.21.15.80:0/3106886586 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b800792e0 con 0x7f5b8007bba0 2019-11-28T11:52:36.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b7f7fe700 1 -- 172.21.15.80:0/3106886586 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907618402 0 0) 0x7f5b7400dff0 con 0x7f5b80150f50 2019-11-28T11:52:36.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b873c0700 1 --2- 172.21.15.80:0/3106886586 >> v2:172.21.15.80:3300/0 conn(0x7f5b8007bba0 0x7f5b80167c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5b70010460 tx=0x7f5b70010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b873c0700 1 --2- 172.21.15.80:0/3106886586 >> v2:172.21.15.80:3300/0 conn(0x7f5b8007bba0 0x7f5b80167c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5b70010460 tx=0x7f5b70010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b873c0700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8007bba0 0x7f5b80167c20 secure :-1 s=READY pgs=2236 cs=0 l=1 rx=0x7f5b70010460 tx=0x7f5b70010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:36.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b873c0700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8007bba0 0x7f5b80167c20 secure :-1 s=THROTTLE_DONE pgs=2236 cs=0 l=1 rx=0x7f5b70010460 tx=0x7f5b70010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b7f7fe700 1 -- 172.21.15.80:0/3106886586 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b700025c0 con 0x7f5b8007bba0 2019-11-28T11:52:36.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b873c0700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8007bba0 0x7f5b80167c20 secure :-1 s=THROTTLE_DONE pgs=2236 cs=0 l=1 rx=0x7f5b70010460 tx=0x7f5b70010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b873c0700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8007bba0 0x7f5b80167c20 secure :-1 s=THROTTLE_DONE pgs=2236 cs=0 l=1 rx=0x7f5b70010460 tx=0x7f5b70010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b7f7fe700 1 -- 172.21.15.80:0/3106886586 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b70000c60 con 0x7f5b8007bba0 2019-11-28T11:52:36.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b7f7fe700 1 -- 172.21.15.80:0/3106886586 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b70001330 con 0x7f5b8007bba0 2019-11-28T11:52:36.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b88622700 1 -- 172.21.15.80:0/3106886586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b80079660 con 0x7f5b8007bba0 2019-11-28T11:52:36.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.079+0000 7f5b88622700 1 -- 172.21.15.80:0/3106886586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b800792e0 con 0x7f5b8007bba0 2019-11-28T11:52:36.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.080+0000 7f5b873c0700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8007bba0 0x7f5b80167c20 secure :-1 s=THROTTLE_DONE pgs=2236 cs=0 l=1 rx=0x7f5b70010460 tx=0x7f5b70010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.080+0000 7f5b7f7fe700 1 -- 172.21.15.80:0/3106886586 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5b700025c0 con 0x7f5b8007bba0 2019-11-28T11:52:36.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.080+0000 7f5b873c0700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8007bba0 0x7f5b80167c20 secure :-1 s=THROTTLE_DONE pgs=2236 cs=0 l=1 rx=0x7f5b70010460 tx=0x7f5b70010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.080+0000 7f5b7f7fe700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5b60018730 0x7f5b6001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:36.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.080+0000 7f5b7f7fe700 1 -- 172.21.15.80:0/3106886586 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5b70031ab0 con 0x7f5b8007bba0 2019-11-28T11:52:36.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.080+0000 7f5b86bbf700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5b60018730 0x7f5b6001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.081+0000 7f5b86bbf700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5b60018730 0x7f5b6001abc0 crc :-1 s=READY pgs=916 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:36.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.087+0000 7f5b88622700 1 -- 172.21.15.80:0/3106886586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b80079660 con 0x7f5b8007bba0 2019-11-28T11:52:36.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.091+0000 7f5b873c0700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8007bba0 0x7f5b80167c20 secure :-1 s=THROTTLE_DONE pgs=2236 cs=0 l=1 rx=0x7f5b70010460 tx=0x7f5b70010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.091+0000 7f5b7f7fe700 1 -- 172.21.15.80:0/3106886586 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5b700027d0 con 0x7f5b8007bba0 2019-11-28T11:52:36.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.267+0000 7f5b88622700 1 -- 172.21.15.80:0/3106886586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b800792e0 con 0x7f5b8007bba0 2019-11-28T11:52:36.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.267+0000 7f5b873c0700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8007bba0 0x7f5b80167c20 secure :-1 s=THROTTLE_DONE pgs=2236 cs=0 l=1 rx=0x7f5b70010460 tx=0x7f5b70010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.268+0000 7f5b7f7fe700 1 -- 172.21.15.80:0/3106886586 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f5b700025c0 con 0x7f5b8007bba0 2019-11-28T11:52:36.320 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:36.321 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":176,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:52:32.483537+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:52:29.768232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2019-11-28T11:52:30.506393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:52:36.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.270+0000 7f5b88622700 1 -- 172.21.15.80:0/3106886586 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5b60018730 msgr2=0x7f5b6001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.270+0000 7f5b88622700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5b60018730 0x7f5b6001abc0 crc :-1 s=READY pgs=916 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.270+0000 7f5b88622700 1 -- 172.21.15.80:0/3106886586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8007bba0 msgr2=0x7f5b80167c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.270+0000 7f5b88622700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8007bba0 0x7f5b80167c20 secure :-1 s=READY pgs=2236 cs=0 l=1 rx=0x7f5b70010460 tx=0x7f5b70010290).stop 2019-11-28T11:52:36.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.270+0000 7f5b88622700 1 -- 172.21.15.80:0/3106886586 shutdown_connections 2019-11-28T11:52:36.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.270+0000 7f5b88622700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5b60018730 0x7f5b6001abc0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.270+0000 7f5b88622700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8007bba0 0x7f5b80167c20 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.270+0000 7f5b88622700 1 --2- 172.21.15.80:0/3106886586 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b80074d00 0x7f5b8007aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.270+0000 7f5b88622700 1 -- 172.21.15.80:0/3106886586 shutdown_connections 2019-11-28T11:52:36.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.270+0000 7f5b88622700 1 -- 172.21.15.80:0/3106886586 wait complete. 2019-11-28T11:52:36.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.270+0000 7f5b88622700 1 -- 172.21.15.80:0/3106886586 >> 172.21.15.80:0/3106886586 conn(0x7f5b8013fa50 msgr2=0x7f5b8007c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:36.332 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:52:29.768232+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 28, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'175', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:52:30.506393+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 29, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'176', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:52:36.333 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:52:36.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.403+0000 7f7e8f81f700 1 Processor -- start 2019-11-28T11:52:36.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.404+0000 7f7e8f81f700 1 -- start start 2019-11-28T11:52:36.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8f81f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e8815ed10 0x7f7e8815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:36.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8f81f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7e88073020 0x7f7e88071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:36.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8f81f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8806db60 con 0x7f7e880734b0 2019-11-28T11:52:36.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8f81f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8806fe00 con 0x7f7e8815ed10 2019-11-28T11:52:36.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8f81f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e880700d0 con 0x7f7e88073020 2019-11-28T11:52:36.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8ddbc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e8815ed10 0x7f7e8815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8ddbc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e8815ed10 0x7f7e8815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43190/0 (socket says 172.21.15.80:43190) 2019-11-28T11:52:36.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8ddbc700 1 -- 172.21.15.80:0/3477519912 learned_addr learned my addr 172.21.15.80:0/3477519912 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8d5bb700 1 --2- 172.21.15.80:0/3477519912 >> v2:172.21.15.174:3300/0 conn(0x7f7e88073020 0x7f7e88071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8ddbc700 1 -- 172.21.15.80:0/3477519912 >> v2:172.21.15.174:3300/0 conn(0x7f7e88073020 msgr2=0x7f7e88071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8ddbc700 1 --2- 172.21.15.80:0/3477519912 >> v2:172.21.15.174:3300/0 conn(0x7f7e88073020 0x7f7e88071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8ddbc700 1 -- 172.21.15.80:0/3477519912 >> v1:172.21.15.80:6789/0 conn(0x7f7e880734b0 legacy=0x7f7e880723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8ddbc700 1 -- 172.21.15.80:0/3477519912 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e88070760 con 0x7f7e8815ed10 2019-11-28T11:52:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8cdba700 1 -- 172.21.15.80:0/3477519912 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014853010 0 0) 0x7f7e80000a40 con 0x7f7e880734b0 2019-11-28T11:52:36.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8d5bb700 1 --2- 172.21.15.80:0/3477519912 >> v2:172.21.15.174:3300/0 conn(0x7f7e88073020 0x7f7e88071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:36.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8ddbc700 1 --2- 172.21.15.80:0/3477519912 >> v2:172.21.15.80:3300/0 conn(0x7f7e8815ed10 0x7f7e8815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7e7800fac0 tx=0x7f7e7800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8ddbc700 1 --2- 172.21.15.80:0/3477519912 >> v2:172.21.15.80:3300/0 conn(0x7f7e8815ed10 0x7f7e8815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7e7800fac0 tx=0x7f7e7800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8ddbc700 1 --2- 172.21.15.80:0/3477519912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8815ed10 0x7f7e8815f100 secure :-1 s=READY pgs=2238 cs=0 l=1 rx=0x7f7e7800fac0 tx=0x7f7e7800fe60).ready entity=mon.0 client_cookie=d11b08efc766cc5b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:36.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8ddbc700 1 --2- 172.21.15.80:0/3477519912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8815ed10 0x7f7e8815f100 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f7e7800fac0 tx=0x7f7e7800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8cdba700 1 -- 172.21.15.80:0/3477519912 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e78000ce0 con 0x7f7e8815ed10 2019-11-28T11:52:36.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.405+0000 7f7e8ddbc700 1 --2- 172.21.15.80:0/3477519912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8815ed10 0x7f7e8815f100 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f7e7800fac0 tx=0x7f7e7800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.406+0000 7f7e8ddbc700 1 --2- 172.21.15.80:0/3477519912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8815ed10 0x7f7e8815f100 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f7e7800fac0 tx=0x7f7e7800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.406+0000 7f7e8cdba700 1 -- 172.21.15.80:0/3477519912 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e78001010 con 0x7f7e8815ed10 2019-11-28T11:52:36.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.406+0000 7f7e8cdba700 1 -- 172.21.15.80:0/3477519912 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e78007590 con 0x7f7e8815ed10 2019-11-28T11:52:36.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.406+0000 7f7e8f81f700 1 -- 172.21.15.80:0/3477519912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8815ed10 msgr2=0x7f7e8815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.406+0000 7f7e8f81f700 1 --2- 172.21.15.80:0/3477519912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8815ed10 0x7f7e8815f100 secure :-1 s=READY pgs=2238 cs=0 l=1 rx=0x7f7e7800fac0 tx=0x7f7e7800fe60).stop 2019-11-28T11:52:36.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.406+0000 7f7e8f81f700 1 -- 172.21.15.80:0/3477519912 shutdown_connections 2019-11-28T11:52:36.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.406+0000 7f7e8f81f700 1 --2- 172.21.15.80:0/3477519912 >> v2:172.21.15.174:3300/0 conn(0x7f7e88073020 0x7f7e88071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:36.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.406+0000 7f7e8f81f700 1 --2- 172.21.15.80:0/3477519912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8815ed10 0x7f7e8815f100 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.406+0000 7f7e8f81f700 1 -- 172.21.15.80:0/3477519912 shutdown_connections 2019-11-28T11:52:36.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.406+0000 7f7e8f81f700 1 -- 172.21.15.80:0/3477519912 wait complete. 2019-11-28T11:52:36.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.406+0000 7f7e8f81f700 1 -- 172.21.15.80:0/3477519912 >> 172.21.15.80:0/3477519912 conn(0x7f7e88061d20 msgr2=0x7f7e880641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:36.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.409+0000 7f7e8f81f700 1 Processor -- start 2019-11-28T11:52:36.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.409+0000 7f7e8f81f700 1 -- start start 2019-11-28T11:52:36.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8f81f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e88153db0 0x7f7e8810dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:36.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8f81f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e8810e270 0x7f7e88148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:36.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8f81f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e881057a0 con 0x7f7e88148570 2019-11-28T11:52:36.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8f81f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e881085b0 con 0x7f7e8810e270 2019-11-28T11:52:36.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8f81f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e88108880 con 0x7f7e88153db0 2019-11-28T11:52:36.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8d5bb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e8810e270 0x7f7e88148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8d5bb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7e8810e270 0x7f7e88148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43198/0 (socket says 172.21.15.80:43198) 2019-11-28T11:52:36.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8e5bd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7e88148570 0x7f7e8810cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42516/0 (socket says 172.21.15.80:42516) 2019-11-28T11:52:36.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8d5bb700 1 -- 172.21.15.80:0/504111159 learned_addr learned my addr 172.21.15.80:0/504111159 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:36.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8ddbc700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e88153db0 0x7f7e8810dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8d5bb700 1 -- 172.21.15.80:0/504111159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e88153db0 msgr2=0x7f7e8810dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8d5bb700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e88153db0 0x7f7e8810dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8d5bb700 1 -- 172.21.15.80:0/504111159 >> v1:172.21.15.80:6789/0 conn(0x7f7e88148570 legacy=0x7f7e8810cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8d5bb700 1 -- 172.21.15.80:0/504111159 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e88106be0 con 0x7f7e8810e270 2019-11-28T11:52:36.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8ddbc700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e88153db0 0x7f7e8810dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:52:36.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e867fc700 1 -- 172.21.15.80:0/504111159 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407459212 0 0) 0x7f7e80001240 con 0x7f7e88148570 2019-11-28T11:52:36.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8d5bb700 1 --2- 172.21.15.80:0/504111159 >> v2:172.21.15.80:3300/0 conn(0x7f7e8810e270 0x7f7e88148030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e7c010410 tx=0x7f7e7c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8d5bb700 1 --2- 172.21.15.80:0/504111159 >> v2:172.21.15.80:3300/0 conn(0x7f7e8810e270 0x7f7e88148030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e7c010410 tx=0x7f7e7c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8d5bb700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8810e270 0x7f7e88148030 secure :-1 s=READY pgs=2240 cs=0 l=1 rx=0x7f7e7c010410 tx=0x7f7e7c0107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:36.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8d5bb700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8810e270 0x7f7e88148030 secure :-1 s=THROTTLE_DONE pgs=2240 cs=0 l=1 rx=0x7f7e7c010410 tx=0x7f7e7c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8d5bb700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8810e270 0x7f7e88148030 secure :-1 s=THROTTLE_DONE pgs=2240 cs=0 l=1 rx=0x7f7e7c010410 tx=0x7f7e7c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e867fc700 1 -- 172.21.15.80:0/504111159 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e7c00a8c0 con 0x7f7e8810e270 2019-11-28T11:52:36.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8d5bb700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8810e270 0x7f7e88148030 secure :-1 s=THROTTLE_DONE pgs=2240 cs=0 l=1 rx=0x7f7e7c010410 tx=0x7f7e7c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e867fc700 1 -- 172.21.15.80:0/504111159 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c009770 con 0x7f7e8810e270 2019-11-28T11:52:36.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e8f81f700 1 -- 172.21.15.80:0/504111159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e88106f60 con 0x7f7e8810e270 2019-11-28T11:52:36.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.410+0000 7f7e867fc700 1 -- 172.21.15.80:0/504111159 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e7c009e40 con 0x7f7e8810e270 2019-11-28T11:52:36.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.411+0000 7f7e8f81f700 1 -- 172.21.15.80:0/504111159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e88106be0 con 0x7f7e8810e270 2019-11-28T11:52:36.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.411+0000 7f7e8d5bb700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8810e270 0x7f7e88148030 secure :-1 s=THROTTLE_DONE pgs=2240 cs=0 l=1 rx=0x7f7e7c010410 tx=0x7f7e7c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.411+0000 7f7e867fc700 1 -- 172.21.15.80:0/504111159 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7e7c009960 con 0x7f7e8810e270 2019-11-28T11:52:36.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.411+0000 7f7e8d5bb700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8810e270 0x7f7e88148030 secure :-1 s=THROTTLE_DONE pgs=2240 cs=0 l=1 rx=0x7f7e7c010410 tx=0x7f7e7c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.411+0000 7f7e867fc700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7e68018730 0x7f7e6801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:36.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.411+0000 7f7e867fc700 1 -- 172.21.15.80:0/504111159 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7e7c031d80 con 0x7f7e8810e270 2019-11-28T11:52:36.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.411+0000 7f7e8ddbc700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7e68018730 0x7f7e6801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.412+0000 7f7e8ddbc700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7e68018730 0x7f7e6801abe0 crc :-1 s=READY pgs=917 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:36.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.419+0000 7f7e8f81f700 1 -- 172.21.15.80:0/504111159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e88106f60 con 0x7f7e8810e270 2019-11-28T11:52:36.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.422+0000 7f7e8d5bb700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8810e270 0x7f7e88148030 secure :-1 s=THROTTLE_DONE pgs=2240 cs=0 l=1 rx=0x7f7e7c010410 tx=0x7f7e7c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.422+0000 7f7e867fc700 1 -- 172.21.15.80:0/504111159 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7e7c0175c0 con 0x7f7e8810e270 2019-11-28T11:52:36.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.590+0000 7f7e8f81f700 1 -- 172.21.15.80:0/504111159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f7e88106be0 con 0x7f7e8810e270 2019-11-28T11:52:36.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.590+0000 7f7e8d5bb700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8810e270 0x7f7e88148030 secure :-1 s=THROTTLE_DONE pgs=2240 cs=0 l=1 rx=0x7f7e7c010410 tx=0x7f7e7c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.590+0000 7f7e867fc700 1 -- 172.21.15.80:0/504111159 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v176) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7e7c0177d0 con 0x7f7e8810e270 2019-11-28T11:52:36.643 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:52:36.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.593+0000 7f7e8f81f700 1 -- 172.21.15.80:0/504111159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7e68018730 msgr2=0x7f7e6801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.593+0000 7f7e8f81f700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7e68018730 0x7f7e6801abe0 crc :-1 s=READY pgs=917 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.593+0000 7f7e8f81f700 1 -- 172.21.15.80:0/504111159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8810e270 msgr2=0x7f7e88148030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.593+0000 7f7e8f81f700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8810e270 0x7f7e88148030 secure :-1 s=READY pgs=2240 cs=0 l=1 rx=0x7f7e7c010410 tx=0x7f7e7c0107b0).stop 2019-11-28T11:52:36.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.593+0000 7f7e8f81f700 1 -- 172.21.15.80:0/504111159 shutdown_connections 2019-11-28T11:52:36.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.593+0000 7f7e8f81f700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7e68018730 0x7f7e6801abe0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.593+0000 7f7e8f81f700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e8810e270 0x7f7e88148030 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.593+0000 7f7e8f81f700 1 --2- 172.21.15.80:0/504111159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e88153db0 0x7f7e8810dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.593+0000 7f7e8f81f700 1 -- 172.21.15.80:0/504111159 shutdown_connections 2019-11-28T11:52:36.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.593+0000 7f7e8f81f700 1 -- 172.21.15.80:0/504111159 wait complete. 2019-11-28T11:52:36.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.593+0000 7f7e8f81f700 1 -- 172.21.15.80:0/504111159 >> 172.21.15.80:0/504111159 conn(0x7f7e8815e2d0 msgr2=0x7f7e88147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:36.655 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:52:36.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.724+0000 7fd2bab88700 1 Processor -- start 2019-11-28T11:52:36.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.724+0000 7fd2bab88700 1 -- start start 2019-11-28T11:52:36.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.725+0000 7fd2bab88700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2b415f100 0x7fd2b406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:36.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.725+0000 7fd2bab88700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd2b406c2f0 0x7fd2b406c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:36.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.725+0000 7fd2bab88700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b406db60 con 0x7fd2b415ed10 2019-11-28T11:52:36.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.725+0000 7fd2bab88700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b406fe00 con 0x7fd2b415f100 2019-11-28T11:52:36.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.725+0000 7fd2bab88700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b40700d0 con 0x7fd2b406c2f0 2019-11-28T11:52:36.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.725+0000 7fd2b8924700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2b415f100 0x7fd2b406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.725+0000 7fd2b8924700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2b415f100 0x7fd2b406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43208/0 (socket says 172.21.15.80:43208) 2019-11-28T11:52:36.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.725+0000 7fd2b8924700 1 -- 172.21.15.80:0/3527985378 learned_addr learned my addr 172.21.15.80:0/3527985378 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:36.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.725+0000 7fd2b9926700 1 --2- 172.21.15.80:0/3527985378 >> v2:172.21.15.174:3300/0 conn(0x7fd2b406c2f0 0x7fd2b406c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.726+0000 7fd2b8924700 1 -- 172.21.15.80:0/3527985378 >> v2:172.21.15.174:3300/0 conn(0x7fd2b406c2f0 msgr2=0x7fd2b406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:36.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.726+0000 7fd2b8924700 1 --2- 172.21.15.80:0/3527985378 >> v2:172.21.15.174:3300/0 conn(0x7fd2b406c2f0 0x7fd2b406c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:36.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.726+0000 7fd2b8924700 1 -- 172.21.15.80:0/3527985378 >> v1:172.21.15.80:6789/0 conn(0x7fd2b415ed10 legacy=0x7fd2b4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.726+0000 7fd2b3fff700 1 -- 172.21.15.80:0/3527985378 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919215669 0 0) 0x7fd2a4001100 con 0x7fd2b415ed10 2019-11-28T11:52:36.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.726+0000 7fd2b8924700 1 -- 172.21.15.80:0/3527985378 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b4070760 con 0x7fd2b415f100 2019-11-28T11:52:36.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.726+0000 7fd2b8924700 1 --2- 172.21.15.80:0/3527985378 >> v2:172.21.15.80:3300/0 conn(0x7fd2b415f100 0x7fd2b406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd29c00fa40 tx=0x7fd29c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.726+0000 7fd2b8924700 1 --2- 172.21.15.80:0/3527985378 >> v2:172.21.15.80:3300/0 conn(0x7fd2b415f100 0x7fd2b406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd29c00fa40 tx=0x7fd29c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.726+0000 7fd2b8924700 1 --2- 172.21.15.80:0/3527985378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b415f100 0x7fd2b406bdb0 secure :-1 s=READY pgs=2242 cs=0 l=1 rx=0x7fd29c00fa40 tx=0x7fd29c00fde0).ready entity=mon.0 client_cookie=d8059c6950ad661 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:36.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.726+0000 7fd2b8924700 1 --2- 172.21.15.80:0/3527985378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b415f100 0x7fd2b406bdb0 secure :-1 s=THROTTLE_DONE pgs=2242 cs=0 l=1 rx=0x7fd29c00fa40 tx=0x7fd29c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.726+0000 7fd2b3fff700 1 -- 172.21.15.80:0/3527985378 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29c000ce0 con 0x7fd2b415f100 2019-11-28T11:52:36.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.726+0000 7fd2b8924700 1 --2- 172.21.15.80:0/3527985378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b415f100 0x7fd2b406bdb0 secure :-1 s=THROTTLE_DONE pgs=2242 cs=0 l=1 rx=0x7fd29c00fa40 tx=0x7fd29c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.726+0000 7fd2b8924700 1 --2- 172.21.15.80:0/3527985378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b415f100 0x7fd2b406bdb0 secure :-1 s=THROTTLE_DONE pgs=2242 cs=0 l=1 rx=0x7fd29c00fa40 tx=0x7fd29c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.726+0000 7fd2b3fff700 1 -- 172.21.15.80:0/3527985378 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c001010 con 0x7fd2b415f100 2019-11-28T11:52:36.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.726+0000 7fd2b3fff700 1 -- 172.21.15.80:0/3527985378 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29c000ce0 con 0x7fd2b415f100 2019-11-28T11:52:36.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.726+0000 7fd2bab88700 1 -- 172.21.15.80:0/3527985378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b415f100 msgr2=0x7fd2b406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.726+0000 7fd2bab88700 1 --2- 172.21.15.80:0/3527985378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b415f100 0x7fd2b406bdb0 secure :-1 s=READY pgs=2242 cs=0 l=1 rx=0x7fd29c00fa40 tx=0x7fd29c00fde0).stop 2019-11-28T11:52:36.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.727+0000 7fd2bab88700 1 -- 172.21.15.80:0/3527985378 shutdown_connections 2019-11-28T11:52:36.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.727+0000 7fd2bab88700 1 --2- 172.21.15.80:0/3527985378 >> v2:172.21.15.174:3300/0 conn(0x7fd2b406c2f0 0x7fd2b406c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:36.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.727+0000 7fd2bab88700 1 --2- 172.21.15.80:0/3527985378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b415f100 0x7fd2b406bdb0 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.727+0000 7fd2bab88700 1 -- 172.21.15.80:0/3527985378 shutdown_connections 2019-11-28T11:52:36.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.727+0000 7fd2bab88700 1 -- 172.21.15.80:0/3527985378 wait complete. 2019-11-28T11:52:36.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.727+0000 7fd2bab88700 1 -- 172.21.15.80:0/3527985378 >> 172.21.15.80:0/3527985378 conn(0x7fd2b4061d20 msgr2=0x7fd2b40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:36.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.729+0000 7fd2bab88700 1 Processor -- start 2019-11-28T11:52:36.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.729+0000 7fd2bab88700 1 -- start start 2019-11-28T11:52:36.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.730+0000 7fd2bab88700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2b41079b0 0x7fd2b4107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:36.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.730+0000 7fd2bab88700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2b4108380 0x7fd2b4168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:36.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.730+0000 7fd2bab88700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b41087f0 con 0x7fd2b4148320 2019-11-28T11:52:36.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.730+0000 7fd2bab88700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b413aa20 con 0x7fd2b41079b0 2019-11-28T11:52:36.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.730+0000 7fd2bab88700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b413acf0 con 0x7fd2b4108380 2019-11-28T11:52:36.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.730+0000 7fd2b8924700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2b41079b0 0x7fd2b4107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.730+0000 7fd2b8924700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2b41079b0 0x7fd2b4107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43212/0 (socket says 172.21.15.80:43212) 2019-11-28T11:52:36.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.730+0000 7fd2b8924700 1 -- 172.21.15.80:0/1523476790 learned_addr learned my addr 172.21.15.80:0/1523476790 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:36.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2b9926700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2b4108380 0x7fd2b4168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2b8924700 1 -- 172.21.15.80:0/1523476790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2b4108380 msgr2=0x7fd2b4168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2b8924700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2b4108380 0x7fd2b4168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2b8924700 1 -- 172.21.15.80:0/1523476790 >> v1:172.21.15.174:6789/0 conn(0x7fd2b4148320 legacy=0x7fd2b410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2b8924700 1 -- 172.21.15.80:0/1523476790 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b410c490 con 0x7fd2b41079b0 2019-11-28T11:52:36.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2b9926700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2b4108380 0x7fd2b4168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:52:36.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2b8924700 1 --2- 172.21.15.80:0/1523476790 >> v2:172.21.15.80:3300/0 conn(0x7fd2b41079b0 0x7fd2b4107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd29c0107e0 tx=0x7fd29c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2b8924700 1 --2- 172.21.15.80:0/1523476790 >> v2:172.21.15.80:3300/0 conn(0x7fd2b41079b0 0x7fd2b4107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd29c0107e0 tx=0x7fd29c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2b8924700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b41079b0 0x7fd2b4107e40 secure :-1 s=READY pgs=2243 cs=0 l=1 rx=0x7fd29c0107e0 tx=0x7fd29c010b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:36.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2b8924700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b41079b0 0x7fd2b4107e40 secure :-1 s=THROTTLE_DONE pgs=2243 cs=0 l=1 rx=0x7fd29c0107e0 tx=0x7fd29c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2b8924700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b41079b0 0x7fd2b4107e40 secure :-1 s=THROTTLE_DONE pgs=2243 cs=0 l=1 rx=0x7fd29c0107e0 tx=0x7fd29c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2b8924700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b41079b0 0x7fd2b4107e40 secure :-1 s=THROTTLE_DONE pgs=2243 cs=0 l=1 rx=0x7fd29c0107e0 tx=0x7fd29c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2b1ffb700 1 -- 172.21.15.80:0/1523476790 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29c007d40 con 0x7fd2b41079b0 2019-11-28T11:52:36.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2b1ffb700 1 -- 172.21.15.80:0/1523476790 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c0011c0 con 0x7fd2b41079b0 2019-11-28T11:52:36.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2bab88700 1 -- 172.21.15.80:0/1523476790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b410c810 con 0x7fd2b41079b0 2019-11-28T11:52:36.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2b1ffb700 1 -- 172.21.15.80:0/1523476790 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29c001890 con 0x7fd2b41079b0 2019-11-28T11:52:36.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2bab88700 1 -- 172.21.15.80:0/1523476790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b410c490 con 0x7fd2b41079b0 2019-11-28T11:52:36.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.731+0000 7fd2b8924700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b41079b0 0x7fd2b4107e40 secure :-1 s=THROTTLE_DONE pgs=2243 cs=0 l=1 rx=0x7fd29c0107e0 tx=0x7fd29c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.732+0000 7fd2b1ffb700 1 -- 172.21.15.80:0/1523476790 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd29c007d40 con 0x7fd2b41079b0 2019-11-28T11:52:36.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.732+0000 7fd2b8924700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b41079b0 0x7fd2b4107e40 secure :-1 s=THROTTLE_DONE pgs=2243 cs=0 l=1 rx=0x7fd29c0107e0 tx=0x7fd29c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.732+0000 7fd2b1ffb700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd298018730 0x7fd29801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:36.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.732+0000 7fd2b1ffb700 1 -- 172.21.15.80:0/1523476790 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd29c031e60 con 0x7fd2b41079b0 2019-11-28T11:52:36.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.732+0000 7fd2b9125700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd298018730 0x7fd29801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:36.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.732+0000 7fd2b9125700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd298018730 0x7fd29801abc0 crc :-1 s=READY pgs=918 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:36.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.739+0000 7fd2bab88700 1 -- 172.21.15.80:0/1523476790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b410c810 con 0x7fd2b41079b0 2019-11-28T11:52:36.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.743+0000 7fd2b8924700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b41079b0 0x7fd2b4107e40 secure :-1 s=THROTTLE_DONE pgs=2243 cs=0 l=1 rx=0x7fd29c0107e0 tx=0x7fd29c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.743+0000 7fd2b1ffb700 1 -- 172.21.15.80:0/1523476790 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd29c007900 con 0x7fd2b41079b0 2019-11-28T11:52:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.909+0000 7fd2bab88700 1 -- 172.21.15.80:0/1523476790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fd2b410c490 con 0x7fd2b41079b0 2019-11-28T11:52:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.910+0000 7fd2b8924700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b41079b0 0x7fd2b4107e40 secure :-1 s=THROTTLE_DONE pgs=2243 cs=0 l=1 rx=0x7fd29c0107e0 tx=0x7fd29c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:36.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.910+0000 7fd2b1ffb700 1 -- 172.21.15.80:0/1523476790 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v176) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd29c007d40 con 0x7fd2b41079b0 2019-11-28T11:52:36.963 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:52:36.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.912+0000 7fd2bab88700 1 -- 172.21.15.80:0/1523476790 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd298018730 msgr2=0x7fd29801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.912+0000 7fd2bab88700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd298018730 0x7fd29801abc0 crc :-1 s=READY pgs=918 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.912+0000 7fd2bab88700 1 -- 172.21.15.80:0/1523476790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b41079b0 msgr2=0x7fd2b4107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:36.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.912+0000 7fd2bab88700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b41079b0 0x7fd2b4107e40 secure :-1 s=READY pgs=2243 cs=0 l=1 rx=0x7fd29c0107e0 tx=0x7fd29c010b80).stop 2019-11-28T11:52:36.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.912+0000 7fd2bab88700 1 -- 172.21.15.80:0/1523476790 shutdown_connections 2019-11-28T11:52:36.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.912+0000 7fd2bab88700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2b4108380 0x7fd2b4168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.912+0000 7fd2bab88700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2b41079b0 0x7fd2b4107e40 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.912+0000 7fd2bab88700 1 --2- 172.21.15.80:0/1523476790 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd298018730 0x7fd29801abc0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:36.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.913+0000 7fd2bab88700 1 -- 172.21.15.80:0/1523476790 shutdown_connections 2019-11-28T11:52:36.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.913+0000 7fd2bab88700 1 -- 172.21.15.80:0/1523476790 wait complete. 2019-11-28T11:52:36.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:36.913+0000 7fd2bab88700 1 -- 172.21.15.80:0/1523476790 >> 172.21.15.80:0/1523476790 conn(0x7fd2b415e2d0 msgr2=0x7fd2b4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:36.975 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:52:37.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.047+0000 7f5c2c458700 1 Processor -- start 2019-11-28T11:52:37.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.047+0000 7f5c2c458700 1 -- start start 2019-11-28T11:52:37.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.048+0000 7f5c2c458700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2415f100 0x7f5c2406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:37.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.048+0000 7f5c2c458700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5c2406c2f0 0x7f5c2406c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:37.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.048+0000 7f5c2c458700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2406db60 con 0x7f5c2415ed10 2019-11-28T11:52:37.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.048+0000 7f5c2c458700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c2406fe00 con 0x7f5c2406c2f0 2019-11-28T11:52:37.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.048+0000 7f5c2c458700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c240700d0 con 0x7f5c2415f100 2019-11-28T11:52:37.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.048+0000 7f5c2b1f6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5c2406c2f0 0x7f5c2406c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:37.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.048+0000 7f5c2a1f4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2415f100 0x7f5c2406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:37.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c2b1f6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5c2406c2f0 0x7f5c2406c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:58106/0 (socket says 172.21.15.80:58106) 2019-11-28T11:52:37.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c2b1f6700 1 -- 172.21.15.80:0/3910906084 learned_addr learned my addr 172.21.15.80:0/3910906084 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:37.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c2a9f5700 1 --1- 172.21.15.80:0/3910906084 >> v1:172.21.15.174:6789/0 conn(0x7f5c2415ed10 0x7f5c24073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58078/0 (socket says 172.21.15.80:58078) 2019-11-28T11:52:37.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c2a1f4700 1 -- 172.21.15.80:0/3910906084 >> v2:172.21.15.174:3300/0 conn(0x7f5c2406c2f0 msgr2=0x7f5c2406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:37.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c2a1f4700 1 --2- 172.21.15.80:0/3910906084 >> v2:172.21.15.174:3300/0 conn(0x7f5c2406c2f0 0x7f5c2406c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:37.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c2a1f4700 1 -- 172.21.15.80:0/3910906084 >> v1:172.21.15.174:6789/0 conn(0x7f5c2415ed10 legacy=0x7f5c24073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:37.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c2a1f4700 1 -- 172.21.15.80:0/3910906084 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c24070760 con 0x7f5c2415f100 2019-11-28T11:52:37.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c2b1f6700 1 --2- 172.21.15.80:0/3910906084 >> v2:172.21.15.174:3300/0 conn(0x7f5c2406c2f0 0x7f5c2406c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:37.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c2a1f4700 1 --2- 172.21.15.80:0/3910906084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2415f100 0x7f5c2406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5c0c00b2d0 tx=0x7f5c0c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c2a1f4700 1 --2- 172.21.15.80:0/3910906084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2415f100 0x7f5c2406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5c0c00b2d0 tx=0x7f5c0c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c2a1f4700 1 --2- 172.21.15.80:0/3910906084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2415f100 0x7f5c2406bdb0 secure :-1 s=READY pgs=322 cs=0 l=1 rx=0x7f5c0c00b2d0 tx=0x7f5c0c00bae0).ready entity=mon.2 client_cookie=7b48337615364a75 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:37.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c2a1f4700 1 --2- 172.21.15.80:0/3910906084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2415f100 0x7f5c2406bdb0 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7f5c0c00b2d0 tx=0x7f5c0c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c2a1f4700 1 --2- 172.21.15.80:0/3910906084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2415f100 0x7f5c2406bdb0 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7f5c0c00b2d0 tx=0x7f5c0c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c299f3700 1 -- 172.21.15.80:0/3910906084 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c0c007590 con 0x7f5c2415f100 2019-11-28T11:52:37.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c2a1f4700 1 --2- 172.21.15.80:0/3910906084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2415f100 0x7f5c2406bdb0 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7f5c0c00b2d0 tx=0x7f5c0c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c299f3700 1 -- 172.21.15.80:0/3910906084 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c009d30 con 0x7f5c2415f100 2019-11-28T11:52:37.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c299f3700 1 -- 172.21.15.80:0/3910906084 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c0c00a400 con 0x7f5c2415f100 2019-11-28T11:52:37.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c2c458700 1 -- 172.21.15.80:0/3910906084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2415f100 msgr2=0x7f5c2406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:37.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.049+0000 7f5c2c458700 1 --2- 172.21.15.80:0/3910906084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2415f100 0x7f5c2406bdb0 secure :-1 s=READY pgs=322 cs=0 l=1 rx=0x7f5c0c00b2d0 tx=0x7f5c0c00bae0).stop 2019-11-28T11:52:37.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.050+0000 7f5c2c458700 1 -- 172.21.15.80:0/3910906084 shutdown_connections 2019-11-28T11:52:37.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.050+0000 7f5c2c458700 1 --2- 172.21.15.80:0/3910906084 >> v2:172.21.15.174:3300/0 conn(0x7f5c2406c2f0 0x7f5c2406c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:37.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.050+0000 7f5c2c458700 1 --2- 172.21.15.80:0/3910906084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2415f100 0x7f5c2406bdb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:37.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.050+0000 7f5c2c458700 1 -- 172.21.15.80:0/3910906084 shutdown_connections 2019-11-28T11:52:37.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.050+0000 7f5c2c458700 1 -- 172.21.15.80:0/3910906084 wait complete. 2019-11-28T11:52:37.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.050+0000 7f5c2c458700 1 -- 172.21.15.80:0/3910906084 >> 172.21.15.80:0/3910906084 conn(0x7f5c24061d20 msgr2=0x7f5c240641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:37.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.053+0000 7f5c2c458700 1 Processor -- start 2019-11-28T11:52:37.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.053+0000 7f5c2c458700 1 -- start start 2019-11-28T11:52:37.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.053+0000 7f5c2c458700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2410e970 0x7f5c241087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:37.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.053+0000 7f5c2c458700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5c24108cf0 0x7f5c24107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:37.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2c458700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2410c250 con 0x7f5c24107b70 2019-11-28T11:52:37.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2c458700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c2410da00 con 0x7f5c24108cf0 2019-11-28T11:52:37.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2c458700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2410e430 con 0x7f5c2410e970 2019-11-28T11:52:37.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2a9f5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2410e970 0x7f5c241087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:37.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2a9f5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2410e970 0x7f5c241087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:45484/0 (socket says 172.21.15.80:45484) 2019-11-28T11:52:37.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2a9f5700 1 -- 172.21.15.80:0/1257674937 learned_addr learned my addr 172.21.15.80:0/1257674937 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:37.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2a1f4700 1 --2- 172.21.15.80:0/1257674937 >> v2:172.21.15.174:3300/0 conn(0x7f5c24108cf0 0x7f5c24107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:37.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2a9f5700 1 -- 172.21.15.80:0/1257674937 >> v2:172.21.15.174:3300/0 conn(0x7f5c24108cf0 msgr2=0x7f5c24107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:37.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2a9f5700 1 --2- 172.21.15.80:0/1257674937 >> v2:172.21.15.174:3300/0 conn(0x7f5c24108cf0 0x7f5c24107630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:37.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2a9f5700 1 -- 172.21.15.80:0/1257674937 >> v1:172.21.15.174:6789/0 conn(0x7f5c24107b70 legacy=0x7f5c2410ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:37.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2a9f5700 1 -- 172.21.15.80:0/1257674937 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c24105ef0 con 0x7f5c2410e970 2019-11-28T11:52:37.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c237fe700 1 -- 172.21.15.80:0/1257674937 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250577707 0 0) 0x7f5c1c0077e0 con 0x7f5c24107b70 2019-11-28T11:52:37.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2a1f4700 1 --2- 172.21.15.80:0/1257674937 >> v2:172.21.15.174:3300/0 conn(0x7f5c24108cf0 0x7f5c24107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:37.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2a9f5700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2410e970 0x7f5c241087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c14010440 tx=0x7f5c140107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2a9f5700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2410e970 0x7f5c241087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c14010440 tx=0x7f5c140107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2a9f5700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2410e970 0x7f5c241087b0 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7f5c14010440 tx=0x7f5c140107e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:37.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2a9f5700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2410e970 0x7f5c241087b0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f5c14010440 tx=0x7f5c140107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c237fe700 1 -- 172.21.15.80:0/1257674937 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c14000c10 con 0x7f5c2410e970 2019-11-28T11:52:37.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2a9f5700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2410e970 0x7f5c241087b0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f5c14010440 tx=0x7f5c140107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2a9f5700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2410e970 0x7f5c241087b0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f5c14010440 tx=0x7f5c140107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c237fe700 1 -- 172.21.15.80:0/1257674937 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c140041c0 con 0x7f5c2410e970 2019-11-28T11:52:37.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c237fe700 1 -- 172.21.15.80:0/1257674937 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c14004790 con 0x7f5c2410e970 2019-11-28T11:52:37.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2c458700 1 -- 172.21.15.80:0/1257674937 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c24106270 con 0x7f5c2410e970 2019-11-28T11:52:37.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.054+0000 7f5c2c458700 1 -- 172.21.15.80:0/1257674937 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c24105ef0 con 0x7f5c2410e970 2019-11-28T11:52:37.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.055+0000 7f5c2a9f5700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2410e970 0x7f5c241087b0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f5c14010440 tx=0x7f5c140107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.055+0000 7f5c237fe700 1 -- 172.21.15.80:0/1257674937 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5c140043b0 con 0x7f5c2410e970 2019-11-28T11:52:37.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.055+0000 7f5c2a9f5700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2410e970 0x7f5c241087b0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f5c14010440 tx=0x7f5c140107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.055+0000 7f5c237fe700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c08018730 0x7f5c0801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:37.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.055+0000 7f5c237fe700 1 -- 172.21.15.80:0/1257674937 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5c14031a70 con 0x7f5c2410e970 2019-11-28T11:52:37.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.055+0000 7f5c2a1f4700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c08018730 0x7f5c0801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:37.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.055+0000 7f5c2a1f4700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c08018730 0x7f5c0801abc0 crc :-1 s=READY pgs=919 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:37.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.062+0000 7f5c2c458700 1 -- 172.21.15.80:0/1257674937 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c24106270 con 0x7f5c2410e970 2019-11-28T11:52:37.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.066+0000 7f5c2a9f5700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2410e970 0x7f5c241087b0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f5c14010440 tx=0x7f5c140107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.066+0000 7f5c237fe700 1 -- 172.21.15.80:0/1257674937 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5c14001300 con 0x7f5c2410e970 2019-11-28T11:52:37.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.233+0000 7f5c2c458700 1 -- 172.21.15.80:0/1257674937 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f5c24105ef0 con 0x7f5c2410e970 2019-11-28T11:52:37.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.234+0000 7f5c2a9f5700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2410e970 0x7f5c241087b0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f5c14010440 tx=0x7f5c140107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.234+0000 7f5c237fe700 1 -- 172.21.15.80:0/1257674937 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v176) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5c140043b0 con 0x7f5c2410e970 2019-11-28T11:52:37.288 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:52:37.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.236+0000 7f5c2c458700 1 -- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c08018730 msgr2=0x7f5c0801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:37.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.236+0000 7f5c2c458700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c08018730 0x7f5c0801abc0 crc :-1 s=READY pgs=919 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:37.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.236+0000 7f5c2c458700 1 -- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2410e970 msgr2=0x7f5c241087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:37.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.236+0000 7f5c2c458700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2410e970 0x7f5c241087b0 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7f5c14010440 tx=0x7f5c140107e0).stop 2019-11-28T11:52:37.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.236+0000 7f5c2c458700 1 -- 172.21.15.80:0/1257674937 shutdown_connections 2019-11-28T11:52:37.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.236+0000 7f5c2c458700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5c08018730 0x7f5c0801abc0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:37.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.236+0000 7f5c2c458700 1 --2- 172.21.15.80:0/1257674937 >> v2:172.21.15.174:3300/0 conn(0x7f5c24108cf0 0x7f5c24107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:37.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.236+0000 7f5c2c458700 1 --2- 172.21.15.80:0/1257674937 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c2410e970 0x7f5c241087b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:37.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.236+0000 7f5c2c458700 1 -- 172.21.15.80:0/1257674937 shutdown_connections 2019-11-28T11:52:37.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.236+0000 7f5c2c458700 1 -- 172.21.15.80:0/1257674937 wait complete. 2019-11-28T11:52:37.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.236+0000 7f5c2c458700 1 -- 172.21.15.80:0/1257674937 >> 172.21.15.80:0/1257674937 conn(0x7f5c2415e2d0 msgr2=0x7f5c24147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:37.299 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:52:37.300 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:37.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.364+0000 7fe87c3fb700 1 Processor -- start 2019-11-28T11:52:37.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.364+0000 7fe87c3fb700 1 -- start start 2019-11-28T11:52:37.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.365+0000 7fe87c3fb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe87406d120 0x7fe874165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:37.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.365+0000 7fe87c3fb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87406d5a0 con 0x7fe87406c0a0 2019-11-28T11:52:37.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.365+0000 7fe87c3fb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87406db00 con 0x7fe87406c490 2019-11-28T11:52:37.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.365+0000 7fe87c3fb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87406fd60 con 0x7fe87406d120 2019-11-28T11:52:37.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.365+0000 7fe87a998700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe87406c0a0 0x7fe874072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42548/0 (socket says 172.21.15.80:42548) 2019-11-28T11:52:37.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.365+0000 7fe87a998700 1 -- 172.21.15.80:0/44414397 learned_addr learned my addr 172.21.15.80:0/44414397 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:37.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.365+0000 7fe87b199700 1 --2- 172.21.15.80:0/44414397 >> v2:172.21.15.174:3300/0 conn(0x7fe87406d120 0x7fe874165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:37.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.365+0000 7fe879996700 1 -- 172.21.15.80:0/44414397 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2215445950 0 0) 0x7fe85c0014d0 con 0x7fe87406c0a0 2019-11-28T11:52:37.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.365+0000 7fe879996700 1 -- 172.21.15.80:0/44414397 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe860002e80 con 0x7fe87406c0a0 2019-11-28T11:52:37.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.365+0000 7fe87b199700 1 -- 172.21.15.80:0/44414397 >> v1:172.21.15.174:6789/0 conn(0x7fe87406c490 legacy=0x7fe87406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.365+0000 7fe87b199700 1 -- 172.21.15.80:0/44414397 >> v1:172.21.15.80:6789/0 conn(0x7fe87406c0a0 legacy=0x7fe874072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.365+0000 7fe879996700 1 -- 172.21.15.80:0/44414397 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031757880 0 0) 0x7fe864001080 con 0x7fe87406c490 2019-11-28T11:52:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.365+0000 7fe87b199700 1 -- 172.21.15.80:0/44414397 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8740706c0 con 0x7fe87406d120 2019-11-28T11:52:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.366+0000 7fe87b199700 1 --2- 172.21.15.80:0/44414397 >> v2:172.21.15.174:3300/0 conn(0x7fe87406d120 0x7fe874165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe86c00af80 tx=0x7fe86c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.366+0000 7fe87b199700 1 --2- 172.21.15.80:0/44414397 >> v2:172.21.15.174:3300/0 conn(0x7fe87406d120 0x7fe874165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe86c00af80 tx=0x7fe86c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.366+0000 7fe87b199700 1 --2- 172.21.15.80:0/44414397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe87406d120 0x7fe874165d80 secure :-1 s=READY pgs=1340 cs=0 l=1 rx=0x7fe86c00af80 tx=0x7fe86c00b790).ready entity=mon.1 client_cookie=d108be3365debc4b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:37.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.366+0000 7fe87b199700 1 --2- 172.21.15.80:0/44414397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe87406d120 0x7fe874165d80 secure :-1 s=THROTTLE_DONE pgs=1340 cs=0 l=1 rx=0x7fe86c00af80 tx=0x7fe86c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.366+0000 7fe879996700 1 -- 172.21.15.80:0/44414397 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe86c007240 con 0x7fe87406d120 2019-11-28T11:52:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.366+0000 7fe87b199700 1 --2- 172.21.15.80:0/44414397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe87406d120 0x7fe874165d80 secure :-1 s=THROTTLE_DONE pgs=1340 cs=0 l=1 rx=0x7fe86c00af80 tx=0x7fe86c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.366+0000 7fe87b199700 1 --2- 172.21.15.80:0/44414397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe87406d120 0x7fe874165d80 secure :-1 s=THROTTLE_DONE pgs=1340 cs=0 l=1 rx=0x7fe86c00af80 tx=0x7fe86c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.366+0000 7fe879996700 1 -- 172.21.15.80:0/44414397 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c000bb0 con 0x7fe87406d120 2019-11-28T11:52:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.366+0000 7fe879996700 1 -- 172.21.15.80:0/44414397 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe86c009e60 con 0x7fe87406d120 2019-11-28T11:52:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.366+0000 7fe87c3fb700 1 -- 172.21.15.80:0/44414397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe87406d120 msgr2=0x7fe874165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:37.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.366+0000 7fe87c3fb700 1 --2- 172.21.15.80:0/44414397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe87406d120 0x7fe874165d80 secure :-1 s=READY pgs=1340 cs=0 l=1 rx=0x7fe86c00af80 tx=0x7fe86c00b790).stop 2019-11-28T11:52:37.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.367+0000 7fe87c3fb700 1 -- 172.21.15.80:0/44414397 shutdown_connections 2019-11-28T11:52:37.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.367+0000 7fe87c3fb700 1 --2- 172.21.15.80:0/44414397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe87406d120 0x7fe874165d80 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:37.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.367+0000 7fe87c3fb700 1 -- 172.21.15.80:0/44414397 shutdown_connections 2019-11-28T11:52:37.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.367+0000 7fe87c3fb700 1 -- 172.21.15.80:0/44414397 wait complete. 2019-11-28T11:52:37.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.367+0000 7fe87c3fb700 1 -- 172.21.15.80:0/44414397 >> 172.21.15.80:0/44414397 conn(0x7fe874061cf0 msgr2=0x7fe874064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:37.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.369+0000 7fe87c3fb700 1 Processor -- start 2019-11-28T11:52:37.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.369+0000 7fe87c3fb700 1 -- start start 2019-11-28T11:52:37.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87c3fb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe87413f580 0x7fe874115730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:37.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87c3fb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe874115c70 0x7fe874121e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:37.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87c3fb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8741223a0 0x7fe874122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:37.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87c3fb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe874112550 con 0x7fe87413f580 2019-11-28T11:52:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87c3fb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe874112820 con 0x7fe874115c70 2019-11-28T11:52:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87c3fb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe874124220 con 0x7fe8741223a0 2019-11-28T11:52:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87a998700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe87413f580 0x7fe874115730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87a998700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe87413f580 0x7fe874115730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43238/0 (socket says 172.21.15.80:43238) 2019-11-28T11:52:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87a998700 1 -- 172.21.15.80:0/2146791723 learned_addr learned my addr 172.21.15.80:0/2146791723 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87b199700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8741223a0 0x7fe874122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:37.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87a197700 1 --2- 172.21.15.80:0/2146791723 >> v2:172.21.15.174:3300/0 conn(0x7fe874115c70 0x7fe874121e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87a998700 1 -- 172.21.15.80:0/2146791723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8741223a0 msgr2=0x7fe874122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87a998700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8741223a0 0x7fe874122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87a998700 1 -- 172.21.15.80:0/2146791723 >> v2:172.21.15.174:3300/0 conn(0x7fe874115c70 msgr2=0x7fe874121e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87a998700 1 --2- 172.21.15.80:0/2146791723 >> v2:172.21.15.174:3300/0 conn(0x7fe874115c70 0x7fe874121e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87a998700 1 -- 172.21.15.80:0/2146791723 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe874112eb0 con 0x7fe87413f580 2019-11-28T11:52:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87a998700 1 --2- 172.21.15.80:0/2146791723 >> v2:172.21.15.80:3300/0 conn(0x7fe87413f580 0x7fe874115730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe85c010760 tx=0x7fe85c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87a998700 1 --2- 172.21.15.80:0/2146791723 >> v2:172.21.15.80:3300/0 conn(0x7fe87413f580 0x7fe874115730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe85c010760 tx=0x7fe85c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87a998700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87413f580 0x7fe874115730 secure :-1 s=READY pgs=2245 cs=0 l=1 rx=0x7fe85c010760 tx=0x7fe85c010660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87a998700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87413f580 0x7fe874115730 secure :-1 s=THROTTLE_DONE pgs=2245 cs=0 l=1 rx=0x7fe85c010760 tx=0x7fe85c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87a998700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87413f580 0x7fe874115730 secure :-1 s=THROTTLE_DONE pgs=2245 cs=0 l=1 rx=0x7fe85c010760 tx=0x7fe85c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe8737fe700 1 -- 172.21.15.80:0/2146791723 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe85c001010 con 0x7fe87413f580 2019-11-28T11:52:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.370+0000 7fe87a998700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87413f580 0x7fe874115730 secure :-1 s=THROTTLE_DONE pgs=2245 cs=0 l=1 rx=0x7fe85c010760 tx=0x7fe85c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.371+0000 7fe8737fe700 1 -- 172.21.15.80:0/2146791723 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85c001440 con 0x7fe87413f580 2019-11-28T11:52:37.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.371+0000 7fe8737fe700 1 -- 172.21.15.80:0/2146791723 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe85c001a50 con 0x7fe87413f580 2019-11-28T11:52:37.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.371+0000 7fe87c3fb700 1 -- 172.21.15.80:0/2146791723 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe874113230 con 0x7fe87413f580 2019-11-28T11:52:37.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.371+0000 7fe87c3fb700 1 -- 172.21.15.80:0/2146791723 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe874112eb0 con 0x7fe87413f580 2019-11-28T11:52:37.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.371+0000 7fe87a998700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87413f580 0x7fe874115730 secure :-1 s=THROTTLE_DONE pgs=2245 cs=0 l=1 rx=0x7fe85c010760 tx=0x7fe85c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.371+0000 7fe8737fe700 1 -- 172.21.15.80:0/2146791723 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe85c001010 con 0x7fe87413f580 2019-11-28T11:52:37.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.371+0000 7fe87a998700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87413f580 0x7fe874115730 secure :-1 s=THROTTLE_DONE pgs=2245 cs=0 l=1 rx=0x7fe85c010760 tx=0x7fe85c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.371+0000 7fe8737fe700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe858018730 0x7fe85801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:37.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.371+0000 7fe8737fe700 1 -- 172.21.15.80:0/2146791723 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe85c031d90 con 0x7fe87413f580 2019-11-28T11:52:37.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.371+0000 7fe87a197700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe858018730 0x7fe85801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:37.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.372+0000 7fe87a197700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe858018730 0x7fe85801abc0 crc :-1 s=READY pgs=920 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:37.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.379+0000 7fe87c3fb700 1 -- 172.21.15.80:0/2146791723 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe874113230 con 0x7fe87413f580 2019-11-28T11:52:37.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.382+0000 7fe87a998700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87413f580 0x7fe874115730 secure :-1 s=THROTTLE_DONE pgs=2245 cs=0 l=1 rx=0x7fe85c010760 tx=0x7fe85c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.382+0000 7fe8737fe700 1 -- 172.21.15.80:0/2146791723 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe85c024fa0 con 0x7fe87413f580 2019-11-28T11:52:37.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.554+0000 7fe87c3fb700 1 -- 172.21.15.80:0/2146791723 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe874112eb0 con 0x7fe87413f580 2019-11-28T11:52:37.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.555+0000 7fe87a998700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87413f580 0x7fe874115730 secure :-1 s=THROTTLE_DONE pgs=2245 cs=0 l=1 rx=0x7fe85c010760 tx=0x7fe85c010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:37.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.555+0000 7fe8737fe700 1 -- 172.21.15.80:0/2146791723 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 139 v139) v1 ==== 95+0+2114 (secure 0 0 0) 0x7fe85c024fa0 con 0x7fe87413f580 2019-11-28T11:52:37.609 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 139 2019-11-28T11:52:37.609 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:37.610 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":139,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6834/632195489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":632195489},{"type":"v1","addr":"172.21.15.80:6834","nonce":632195489}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":137}],"filesystems":[{"mdsmap":{"epoch":139,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:35.148974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7181":{"gid":7181,"name":"c","rank":0,"incarnation":138,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/3265178535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3265178535},{"type":"v1","addr":"172.21.15.174:6835","nonce":3265178535}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:37.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.557+0000 7fe87c3fb700 1 -- 172.21.15.80:0/2146791723 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe858018730 msgr2=0x7fe85801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:37.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.557+0000 7fe87c3fb700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe858018730 0x7fe85801abc0 crc :-1 s=READY pgs=920 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:37.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.557+0000 7fe87c3fb700 1 -- 172.21.15.80:0/2146791723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87413f580 msgr2=0x7fe874115730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:37.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.557+0000 7fe87c3fb700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87413f580 0x7fe874115730 secure :-1 s=READY pgs=2245 cs=0 l=1 rx=0x7fe85c010760 tx=0x7fe85c010660).stop 2019-11-28T11:52:37.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.557+0000 7fe87c3fb700 1 -- 172.21.15.80:0/2146791723 shutdown_connections 2019-11-28T11:52:37.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.557+0000 7fe87c3fb700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe858018730 0x7fe85801abc0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:37.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.557+0000 7fe87c3fb700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8741223a0 0x7fe874122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:37.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.557+0000 7fe87c3fb700 1 --2- 172.21.15.80:0/2146791723 >> v2:172.21.15.174:3300/0 conn(0x7fe874115c70 0x7fe874121e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.557+0000 7fe87c3fb700 1 --2- 172.21.15.80:0/2146791723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe87413f580 0x7fe874115730 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.558+0000 7fe87c3fb700 1 -- 172.21.15.80:0/2146791723 shutdown_connections 2019-11-28T11:52:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.558+0000 7fe87c3fb700 1 -- 172.21.15.80:0/2146791723 wait complete. 2019-11-28T11:52:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:37.558+0000 7fe87c3fb700 1 -- 172.21.15.80:0/2146791723 >> 172.21.15.80:0/2146791723 conn(0x7fe8741426c0 msgr2=0x7fe874110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:37.923 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7181}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 28, u'failed': [], u'epoch': 139, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [29], u'info': {u'gid_7181': {u'export_targets': [], u'name': u'c', u'incarnation': 138, u'state_seq': 2, u'state': u'up:active', u'gid': 7181, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3265178535, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 3265178535, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/3265178535'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:52:31.482361+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:52:35.148974+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:52:37.923 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:52:37.924 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:52:38.049 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:52:38.049 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:52:38.049 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:52:38.050 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 7181, 2019-11-28T11:52:38.050 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:52:38.050 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:52:38.050 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 3.8579318630000001, 2019-11-28T11:52:38.050 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 139, 2019-11-28T11:52:38.050 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 176, 2019-11-28T11:52:38.050 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 176, 2019-11-28T11:52:38.051 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 4.0970603209999998 2019-11-28T11:52:38.051 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:52:38.054 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7181, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.8579318630000001, "mdsmap_epoch": 139, "osdmap_epoch": 176, "osdmap_epoch_barrier": 176, "uptime": 4.0970603209999998 } 2019-11-28T11:52:38.055 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:52:38.055 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:52:38.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:52:38.055 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:52:38.124 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:52:38.124 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:52:38.244 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:52:38.245 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:52:38.245 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:52:38.245 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:52:38.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:52:38.245 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:52:38.317 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:52:38.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.383+0000 7fe6a0d96700 1 Processor -- start 2019-11-28T11:52:38.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.383+0000 7fe6a0d96700 1 -- start start 2019-11-28T11:52:38.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.384+0000 7fe6a0d96700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe69c06c0a0 0x7fe69c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.384+0000 7fe6a0d96700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe69c072620 0x7fe69c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.384+0000 7fe6a0d96700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c06db00 con 0x7fe69c0734e0 2019-11-28T11:52:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.384+0000 7fe6a0d96700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69c06fd60 con 0x7fe69c06c0a0 2019-11-28T11:52:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.384+0000 7fe6a0d96700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c070030 con 0x7fe69c072620 2019-11-28T11:52:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe69ad9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe69c06c0a0 0x7fe69c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe69b59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe69c072620 0x7fe69c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:38.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe69a59c700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe69c0734e0 0x7fe69c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58112/0 (socket says 172.21.15.80:58112) 2019-11-28T11:52:38.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe69a59c700 1 -- 172.21.15.80:0/2139459017 learned_addr learned my addr 172.21.15.80:0/2139459017 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:38.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe69ad9d700 1 -- 172.21.15.80:0/2139459017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe69c072620 msgr2=0x7fe69c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:38.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/2139459017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe69c072620 0x7fe69c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:38.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe69ad9d700 1 -- 172.21.15.80:0/2139459017 >> v1:172.21.15.174:6789/0 conn(0x7fe69c0734e0 legacy=0x7fe69c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:38.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe69ad9d700 1 -- 172.21.15.80:0/2139459017 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c0706c0 con 0x7fe69c06c0a0 2019-11-28T11:52:38.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe699d9b700 1 -- 172.21.15.80:0/2139459017 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915908151 0 0) 0x7fe6840013f0 con 0x7fe69c0734e0 2019-11-28T11:52:38.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe69b59e700 1 --2- 172.21.15.80:0/2139459017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe69c072620 0x7fe69c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:38.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/2139459017 >> v2:172.21.15.174:3300/0 conn(0x7fe69c06c0a0 0x7fe69c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe68c00af50 tx=0x7fe68c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/2139459017 >> v2:172.21.15.174:3300/0 conn(0x7fe69c06c0a0 0x7fe69c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe68c00af50 tx=0x7fe68c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/2139459017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c06c0a0 0x7fe69c072fa0 secure :-1 s=READY pgs=1342 cs=0 l=1 rx=0x7fe68c00af50 tx=0x7fe68c00b760).ready entity=mon.1 client_cookie=3d45e6007ae77fcb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:38.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/2139459017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c06c0a0 0x7fe69c072fa0 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7fe68c00af50 tx=0x7fe68c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe699d9b700 1 -- 172.21.15.80:0/2139459017 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe68c007210 con 0x7fe69c06c0a0 2019-11-28T11:52:38.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/2139459017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c06c0a0 0x7fe69c072fa0 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7fe68c00af50 tx=0x7fe68c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/2139459017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c06c0a0 0x7fe69c072fa0 secure :-1 s=THROTTLE_DONE pgs=1342 cs=0 l=1 rx=0x7fe68c00af50 tx=0x7fe68c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe699d9b700 1 -- 172.21.15.80:0/2139459017 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c0099b0 con 0x7fe69c06c0a0 2019-11-28T11:52:38.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe699d9b700 1 -- 172.21.15.80:0/2139459017 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe68c007210 con 0x7fe69c06c0a0 2019-11-28T11:52:38.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe6a0d96700 1 -- 172.21.15.80:0/2139459017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c06c0a0 msgr2=0x7fe69c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:38.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.385+0000 7fe6a0d96700 1 --2- 172.21.15.80:0/2139459017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c06c0a0 0x7fe69c072fa0 secure :-1 s=READY pgs=1342 cs=0 l=1 rx=0x7fe68c00af50 tx=0x7fe68c00b760).stop 2019-11-28T11:52:38.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.386+0000 7fe6a0d96700 1 -- 172.21.15.80:0/2139459017 shutdown_connections 2019-11-28T11:52:38.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.386+0000 7fe6a0d96700 1 --2- 172.21.15.80:0/2139459017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe69c072620 0x7fe69c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:38.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.386+0000 7fe6a0d96700 1 --2- 172.21.15.80:0/2139459017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c06c0a0 0x7fe69c072fa0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:38.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.386+0000 7fe6a0d96700 1 -- 172.21.15.80:0/2139459017 shutdown_connections 2019-11-28T11:52:38.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.386+0000 7fe6a0d96700 1 -- 172.21.15.80:0/2139459017 wait complete. 2019-11-28T11:52:38.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.386+0000 7fe6a0d96700 1 -- 172.21.15.80:0/2139459017 >> 172.21.15.80:0/2139459017 conn(0x7fe69c061cf0 msgr2=0x7fe69c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:38.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.388+0000 7fe6a0d96700 1 Processor -- start 2019-11-28T11:52:38.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.389+0000 7fe6a0d96700 1 -- start start 2019-11-28T11:52:38.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.389+0000 7fe6a0d96700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe69c104820 0x7fe69c10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:38.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.389+0000 7fe6a0d96700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c13bcd0 con 0x7fe69c10b9d0 2019-11-28T11:52:38.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.389+0000 7fe6a0d96700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c105ea0 con 0x7fe69c10c890 2019-11-28T11:52:38.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.389+0000 7fe6a0d96700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69c109130 con 0x7fe69c104820 2019-11-28T11:52:38.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.389+0000 7fe69b59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe69c10b9d0 0x7fe69c167a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42574/0 (socket says 172.21.15.80:42574) 2019-11-28T11:52:38.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.389+0000 7fe69b59e700 1 -- 172.21.15.80:0/756222259 learned_addr learned my addr 172.21.15.80:0/756222259 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:38.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/756222259 >> v2:172.21.15.174:3300/0 conn(0x7fe69c104820 0x7fe69c10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:38.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe6937fe700 1 -- 172.21.15.80:0/756222259 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053310049 0 0) 0x7fe694009890 con 0x7fe69c10b9d0 2019-11-28T11:52:38.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe6937fe700 1 -- 172.21.15.80:0/756222259 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe674002e80 con 0x7fe69c10b9d0 2019-11-28T11:52:38.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe6937fe700 1 -- 172.21.15.80:0/756222259 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348112185 0 0) 0x7fe684001600 con 0x7fe69c10c890 2019-11-28T11:52:38.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe69ad9d700 1 -- 172.21.15.80:0/756222259 >> v1:172.21.15.174:6789/0 conn(0x7fe69c10c890 legacy=0x7fe69c10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:38.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe69ad9d700 1 -- 172.21.15.80:0/756222259 >> v1:172.21.15.80:6789/0 conn(0x7fe69c10b9d0 legacy=0x7fe69c167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:38.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe69ad9d700 1 -- 172.21.15.80:0/756222259 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c109a90 con 0x7fe69c104820 2019-11-28T11:52:38.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/756222259 >> v2:172.21.15.174:3300/0 conn(0x7fe69c104820 0x7fe69c10c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe68c0103a0 tx=0x7fe68c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/756222259 >> v2:172.21.15.174:3300/0 conn(0x7fe69c104820 0x7fe69c10c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe68c0103a0 tx=0x7fe68c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c104820 0x7fe69c10c350 secure :-1 s=READY pgs=1344 cs=0 l=1 rx=0x7fe68c0103a0 tx=0x7fe68c010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:38.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c104820 0x7fe69c10c350 secure :-1 s=THROTTLE_DONE pgs=1344 cs=0 l=1 rx=0x7fe68c0103a0 tx=0x7fe68c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe6937fe700 1 -- 172.21.15.80:0/756222259 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe68c000940 con 0x7fe69c104820 2019-11-28T11:52:38.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c104820 0x7fe69c10c350 secure :-1 s=THROTTLE_DONE pgs=1344 cs=0 l=1 rx=0x7fe68c0103a0 tx=0x7fe68c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c104820 0x7fe69c10c350 secure :-1 s=THROTTLE_DONE pgs=1344 cs=0 l=1 rx=0x7fe68c0103a0 tx=0x7fe68c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe6937fe700 1 -- 172.21.15.80:0/756222259 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c00b250 con 0x7fe69c104820 2019-11-28T11:52:38.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe6a0d96700 1 -- 172.21.15.80:0/756222259 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69c109e10 con 0x7fe69c104820 2019-11-28T11:52:38.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe6937fe700 1 -- 172.21.15.80:0/756222259 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe68c009d60 con 0x7fe69c104820 2019-11-28T11:52:38.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.390+0000 7fe6a0d96700 1 -- 172.21.15.80:0/756222259 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69c109a90 con 0x7fe69c104820 2019-11-28T11:52:38.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.391+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c104820 0x7fe69c10c350 secure :-1 s=THROTTLE_DONE pgs=1344 cs=0 l=1 rx=0x7fe68c0103a0 tx=0x7fe68c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.391+0000 7fe6937fe700 1 -- 172.21.15.80:0/756222259 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe68c00a1b0 con 0x7fe69c104820 2019-11-28T11:52:38.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.391+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c104820 0x7fe69c10c350 secure :-1 s=THROTTLE_DONE pgs=1344 cs=0 l=1 rx=0x7fe68c0103a0 tx=0x7fe68c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.391+0000 7fe6937fe700 1 --2- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe674018780 0x7fe67401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:38.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.391+0000 7fe6937fe700 1 -- 172.21.15.80:0/756222259 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe68c031ad0 con 0x7fe69c104820 2019-11-28T11:52:38.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.391+0000 7fe69a59c700 1 --2- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe674018780 0x7fe67401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:38.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.392+0000 7fe69a59c700 1 --2- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe674018780 0x7fe67401abf0 crc :-1 s=READY pgs=922 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:38.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.398+0000 7fe6a0d96700 1 -- 172.21.15.80:0/756222259 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69c109e10 con 0x7fe69c104820 2019-11-28T11:52:38.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.402+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c104820 0x7fe69c10c350 secure :-1 s=THROTTLE_DONE pgs=1344 cs=0 l=1 rx=0x7fe68c0103a0 tx=0x7fe68c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.402+0000 7fe6937fe700 1 -- 172.21.15.80:0/756222259 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe68c009fa0 con 0x7fe69c104820 2019-11-28T11:52:38.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.582+0000 7fe6a0d96700 1 -- 172.21.15.80:0/756222259 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe69c109a90 con 0x7fe69c104820 2019-11-28T11:52:38.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.583+0000 7fe69ad9d700 1 --2- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c104820 0x7fe69c10c350 secure :-1 s=THROTTLE_DONE pgs=1344 cs=0 l=1 rx=0x7fe68c0103a0 tx=0x7fe68c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.583+0000 7fe6937fe700 1 -- 172.21.15.80:0/756222259 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+14871 (secure 0 0 0) 0x7fe68c00a1b0 con 0x7fe69c104820 2019-11-28T11:52:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:38.640 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":176,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:52:32.483537+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:52:29.768232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2019-11-28T11:52:30.506393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:52:38.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.587+0000 7fe6a0d96700 1 -- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe674018780 msgr2=0x7fe67401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:38.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.587+0000 7fe6a0d96700 1 --2- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe674018780 0x7fe67401abf0 crc :-1 s=READY pgs=922 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:38.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.587+0000 7fe6a0d96700 1 -- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c104820 msgr2=0x7fe69c10c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:38.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.587+0000 7fe6a0d96700 1 --2- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c104820 0x7fe69c10c350 secure :-1 s=READY pgs=1344 cs=0 l=1 rx=0x7fe68c0103a0 tx=0x7fe68c010740).stop 2019-11-28T11:52:38.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.588+0000 7fe6a0d96700 1 -- 172.21.15.80:0/756222259 shutdown_connections 2019-11-28T11:52:38.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.588+0000 7fe6a0d96700 1 --2- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe674018780 0x7fe67401abf0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:38.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.588+0000 7fe6a0d96700 1 --2- 172.21.15.80:0/756222259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe69c104820 0x7fe69c10c350 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:38.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.588+0000 7fe6a0d96700 1 -- 172.21.15.80:0/756222259 shutdown_connections 2019-11-28T11:52:38.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.588+0000 7fe6a0d96700 1 -- 172.21.15.80:0/756222259 wait complete. 2019-11-28T11:52:38.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.588+0000 7fe6a0d96700 1 -- 172.21.15.80:0/756222259 >> 172.21.15.80:0/756222259 conn(0x7fe69c13d620 msgr2=0x7fe69c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:38.651 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:52:29.768232+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 28, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'175', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:52:30.506393+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 29, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'176', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:52:38.652 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:52:38.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.721+0000 7fe7ca219700 1 Processor -- start 2019-11-28T11:52:38.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.722+0000 7fe7ca219700 1 -- start start 2019-11-28T11:52:38.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.722+0000 7fe7ca219700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe7c415ed10 0x7fe7c415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:38.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.722+0000 7fe7ca219700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7c40734b0 0x7fe7c40726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:38.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7ca219700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c406db60 con 0x7fe7c4073020 2019-11-28T11:52:38.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7ca219700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c406fe00 con 0x7fe7c415ed10 2019-11-28T11:52:38.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7ca219700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40700d0 con 0x7fe7c40734b0 2019-11-28T11:52:38.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7bbfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe7c4073020 0x7fe7c4071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42578/0 (socket says 172.21.15.80:42578) 2019-11-28T11:52:38.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7bbfff700 1 -- 172.21.15.80:0/4255130611 learned_addr learned my addr 172.21.15.80:0/4255130611 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:38.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7c3fff700 1 --2- 172.21.15.80:0/4255130611 >> v2:172.21.15.174:3300/0 conn(0x7fe7c415ed10 0x7fe7c415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:38.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7c8fb7700 1 --2- 172.21.15.80:0/4255130611 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7c40734b0 0x7fe7c40726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:38.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7c37fe700 1 -- 172.21.15.80:0/4255130611 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522997338 0 0) 0x7fe7ac001150 con 0x7fe7c4073020 2019-11-28T11:52:38.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7c37fe700 1 -- 172.21.15.80:0/4255130611 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7a4002e80 con 0x7fe7c4073020 2019-11-28T11:52:38.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7c3fff700 1 -- 172.21.15.80:0/4255130611 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7c40734b0 msgr2=0x7fe7c40726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:38.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7c3fff700 1 --2- 172.21.15.80:0/4255130611 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7c40734b0 0x7fe7c40726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:38.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7c3fff700 1 -- 172.21.15.80:0/4255130611 >> v1:172.21.15.80:6789/0 conn(0x7fe7c4073020 legacy=0x7fe7c4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:38.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7c3fff700 1 -- 172.21.15.80:0/4255130611 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c4070760 con 0x7fe7c415ed10 2019-11-28T11:52:38.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7c3fff700 1 --2- 172.21.15.80:0/4255130611 >> v2:172.21.15.174:3300/0 conn(0x7fe7c415ed10 0x7fe7c415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe7b400af50 tx=0x7fe7b400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7c3fff700 1 --2- 172.21.15.80:0/4255130611 >> v2:172.21.15.174:3300/0 conn(0x7fe7c415ed10 0x7fe7c415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe7b400af50 tx=0x7fe7b400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7c3fff700 1 --2- 172.21.15.80:0/4255130611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7c415ed10 0x7fe7c415f100 secure :-1 s=READY pgs=1345 cs=0 l=1 rx=0x7fe7b400af50 tx=0x7fe7b400b6e0).ready entity=mon.1 client_cookie=999a39df52348235 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:38.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7c3fff700 1 --2- 172.21.15.80:0/4255130611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7c415ed10 0x7fe7c415f100 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7fe7b400af50 tx=0x7fe7b400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7c37fe700 1 -- 172.21.15.80:0/4255130611 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b4007210 con 0x7fe7c415ed10 2019-11-28T11:52:38.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7c3fff700 1 --2- 172.21.15.80:0/4255130611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7c415ed10 0x7fe7c415f100 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7fe7b400af50 tx=0x7fe7b400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.723+0000 7fe7c3fff700 1 --2- 172.21.15.80:0/4255130611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7c415ed10 0x7fe7c415f100 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7fe7b400af50 tx=0x7fe7b400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.724+0000 7fe7c37fe700 1 -- 172.21.15.80:0/4255130611 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b40099b0 con 0x7fe7c415ed10 2019-11-28T11:52:38.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.724+0000 7fe7c37fe700 1 -- 172.21.15.80:0/4255130611 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b400a080 con 0x7fe7c415ed10 2019-11-28T11:52:38.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.724+0000 7fe7ca219700 1 -- 172.21.15.80:0/4255130611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7c415ed10 msgr2=0x7fe7c415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:38.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.724+0000 7fe7ca219700 1 --2- 172.21.15.80:0/4255130611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7c415ed10 0x7fe7c415f100 secure :-1 s=READY pgs=1345 cs=0 l=1 rx=0x7fe7b400af50 tx=0x7fe7b400b6e0).stop 2019-11-28T11:52:38.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.724+0000 7fe7ca219700 1 -- 172.21.15.80:0/4255130611 shutdown_connections 2019-11-28T11:52:38.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.724+0000 7fe7ca219700 1 --2- 172.21.15.80:0/4255130611 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7c40734b0 0x7fe7c40726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:38.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.724+0000 7fe7ca219700 1 --2- 172.21.15.80:0/4255130611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7c415ed10 0x7fe7c415f100 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:38.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.724+0000 7fe7ca219700 1 -- 172.21.15.80:0/4255130611 shutdown_connections 2019-11-28T11:52:38.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.724+0000 7fe7ca219700 1 -- 172.21.15.80:0/4255130611 wait complete. 2019-11-28T11:52:38.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.724+0000 7fe7ca219700 1 -- 172.21.15.80:0/4255130611 >> 172.21.15.80:0/4255130611 conn(0x7fe7c4061d20 msgr2=0x7fe7c40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:38.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.727+0000 7fe7ca219700 1 Processor -- start 2019-11-28T11:52:38.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.727+0000 7fe7ca219700 1 -- start start 2019-11-28T11:52:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.727+0000 7fe7ca219700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe7c410ed60 0x7fe7c410f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.727+0000 7fe7ca219700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe7c410f730 0x7fe7c4167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.727+0000 7fe7ca219700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c410c250 con 0x7fe7c410e970 2019-11-28T11:52:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.727+0000 7fe7ca219700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c410e430 con 0x7fe7c410ed60 2019-11-28T11:52:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.727+0000 7fe7ca219700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c4105860 con 0x7fe7c410f730 2019-11-28T11:52:38.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7bbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe7c410ed60 0x7fe7c410f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7bbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe7c410ed60 0x7fe7c410f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43268/0 (socket says 172.21.15.80:43268) 2019-11-28T11:52:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7bbfff700 1 -- 172.21.15.80:0/37293945 learned_addr learned my addr 172.21.15.80:0/37293945 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7c8fb7700 1 --2- 172.21.15.80:0/37293945 >> v2:172.21.15.174:3300/0 conn(0x7fe7c410f730 0x7fe7c4167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7bbfff700 1 -- 172.21.15.80:0/37293945 >> v2:172.21.15.174:3300/0 conn(0x7fe7c410f730 msgr2=0x7fe7c4167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7bbfff700 1 --2- 172.21.15.80:0/37293945 >> v2:172.21.15.174:3300/0 conn(0x7fe7c410f730 0x7fe7c4167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7bbfff700 1 -- 172.21.15.80:0/37293945 >> v1:172.21.15.80:6789/0 conn(0x7fe7c410e970 legacy=0x7fe7c41087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:38.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7bbfff700 1 -- 172.21.15.80:0/37293945 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c4105ef0 con 0x7fe7c410ed60 2019-11-28T11:52:38.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7c17fa700 1 -- 172.21.15.80:0/37293945 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370973454 0 0) 0x7fe7b40009d0 con 0x7fe7c410e970 2019-11-28T11:52:38.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7bbfff700 1 --2- 172.21.15.80:0/37293945 >> v2:172.21.15.80:3300/0 conn(0x7fe7c410ed60 0x7fe7c410f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe7ac010360 tx=0x7fe7ac010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7bbfff700 1 --2- 172.21.15.80:0/37293945 >> v2:172.21.15.80:3300/0 conn(0x7fe7c410ed60 0x7fe7c410f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe7ac010360 tx=0x7fe7ac010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7bbfff700 1 --2- 172.21.15.80:0/37293945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7c410ed60 0x7fe7c410f1f0 secure :-1 s=READY pgs=2249 cs=0 l=1 rx=0x7fe7ac010360 tx=0x7fe7ac010700).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:38.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7bbfff700 1 --2- 172.21.15.80:0/37293945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7c410ed60 0x7fe7c410f1f0 secure :-1 s=THROTTLE_DONE pgs=2249 cs=0 l=1 rx=0x7fe7ac010360 tx=0x7fe7ac010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7c17fa700 1 -- 172.21.15.80:0/37293945 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7ac000c90 con 0x7fe7c410ed60 2019-11-28T11:52:38.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7bbfff700 1 --2- 172.21.15.80:0/37293945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7c410ed60 0x7fe7c410f1f0 secure :-1 s=THROTTLE_DONE pgs=2249 cs=0 l=1 rx=0x7fe7ac010360 tx=0x7fe7ac010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7ca219700 1 -- 172.21.15.80:0/37293945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c4106270 con 0x7fe7c410ed60 2019-11-28T11:52:38.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7c17fa700 1 -- 172.21.15.80:0/37293945 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac000c90 con 0x7fe7c410ed60 2019-11-28T11:52:38.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7bbfff700 1 --2- 172.21.15.80:0/37293945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7c410ed60 0x7fe7c410f1f0 secure :-1 s=THROTTLE_DONE pgs=2249 cs=0 l=1 rx=0x7fe7ac010360 tx=0x7fe7ac010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7c17fa700 1 -- 172.21.15.80:0/37293945 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7ac000e80 con 0x7fe7c410ed60 2019-11-28T11:52:38.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.728+0000 7fe7ca219700 1 -- 172.21.15.80:0/37293945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c4105ef0 con 0x7fe7c410ed60 2019-11-28T11:52:38.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.729+0000 7fe7bbfff700 1 --2- 172.21.15.80:0/37293945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7c410ed60 0x7fe7c410f1f0 secure :-1 s=THROTTLE_DONE pgs=2249 cs=0 l=1 rx=0x7fe7ac010360 tx=0x7fe7ac010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.729+0000 7fe7c17fa700 1 -- 172.21.15.80:0/37293945 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe7ac000e80 con 0x7fe7c410ed60 2019-11-28T11:52:38.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.729+0000 7fe7bbfff700 1 --2- 172.21.15.80:0/37293945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7c410ed60 0x7fe7c410f1f0 secure :-1 s=THROTTLE_DONE pgs=2249 cs=0 l=1 rx=0x7fe7ac010360 tx=0x7fe7ac010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.729+0000 7fe7c17fa700 1 --2- 172.21.15.80:0/37293945 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe79c018730 0x7fe79c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:38.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.729+0000 7fe7c17fa700 1 -- 172.21.15.80:0/37293945 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe7ac031d00 con 0x7fe7c410ed60 2019-11-28T11:52:38.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.729+0000 7fe7c3fff700 1 --2- 172.21.15.80:0/37293945 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe79c018730 0x7fe79c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:38.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.729+0000 7fe7c3fff700 1 --2- 172.21.15.80:0/37293945 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe79c018730 0x7fe79c01abc0 crc :-1 s=READY pgs=923 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:38.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.737+0000 7fe7ca219700 1 -- 172.21.15.80:0/37293945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c4106270 con 0x7fe7c410ed60 2019-11-28T11:52:38.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.740+0000 7fe7bbfff700 1 --2- 172.21.15.80:0/37293945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7c410ed60 0x7fe7c410f1f0 secure :-1 s=THROTTLE_DONE pgs=2249 cs=0 l=1 rx=0x7fe7ac010360 tx=0x7fe7ac010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.740+0000 7fe7c17fa700 1 -- 172.21.15.80:0/37293945 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe7ac0075d0 con 0x7fe7c410ed60 2019-11-28T11:52:38.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.909+0000 7fe7ca219700 1 -- 172.21.15.80:0/37293945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fe7c4105ef0 con 0x7fe7c410ed60 2019-11-28T11:52:38.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.909+0000 7fe7bbfff700 1 --2- 172.21.15.80:0/37293945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7c410ed60 0x7fe7c410f1f0 secure :-1 s=THROTTLE_DONE pgs=2249 cs=0 l=1 rx=0x7fe7ac010360 tx=0x7fe7ac010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:38.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.909+0000 7fe7c17fa700 1 -- 172.21.15.80:0/37293945 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v176) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe7ac000c90 con 0x7fe7c410ed60 2019-11-28T11:52:38.963 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:52:38.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.912+0000 7fe7ca219700 1 -- 172.21.15.80:0/37293945 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe79c018730 msgr2=0x7fe79c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:38.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.912+0000 7fe7ca219700 1 --2- 172.21.15.80:0/37293945 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe79c018730 0x7fe79c01abc0 crc :-1 s=READY pgs=923 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:38.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.912+0000 7fe7ca219700 1 -- 172.21.15.80:0/37293945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7c410ed60 msgr2=0x7fe7c410f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:38.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.912+0000 7fe7ca219700 1 --2- 172.21.15.80:0/37293945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7c410ed60 0x7fe7c410f1f0 secure :-1 s=READY pgs=2249 cs=0 l=1 rx=0x7fe7ac010360 tx=0x7fe7ac010700).stop 2019-11-28T11:52:38.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.912+0000 7fe7ca219700 1 -- 172.21.15.80:0/37293945 shutdown_connections 2019-11-28T11:52:38.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.912+0000 7fe7ca219700 1 --2- 172.21.15.80:0/37293945 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe79c018730 0x7fe79c01abc0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:38.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.912+0000 7fe7ca219700 1 --2- 172.21.15.80:0/37293945 >> v2:172.21.15.174:3300/0 conn(0x7fe7c410f730 0x7fe7c4167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:38.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.912+0000 7fe7ca219700 1 --2- 172.21.15.80:0/37293945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7c410ed60 0x7fe7c410f1f0 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:38.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.912+0000 7fe7ca219700 1 -- 172.21.15.80:0/37293945 shutdown_connections 2019-11-28T11:52:38.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.912+0000 7fe7ca219700 1 -- 172.21.15.80:0/37293945 wait complete. 2019-11-28T11:52:38.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:38.912+0000 7fe7ca219700 1 -- 172.21.15.80:0/37293945 >> 172.21.15.80:0/37293945 conn(0x7fe7c415e2d0 msgr2=0x7fe7c4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:38.975 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:52:39.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.044+0000 7f28e5d5f700 1 Processor -- start 2019-11-28T11:52:39.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.044+0000 7f28e5d5f700 1 -- start start 2019-11-28T11:52:39.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.045+0000 7f28e5d5f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28e015ed10 0x7f28e015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.045+0000 7f28e5d5f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e006db60 con 0x7f28e00734b0 2019-11-28T11:52:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.045+0000 7f28e5d5f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e006e060 con 0x7f28e0073020 2019-11-28T11:52:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.045+0000 7f28e5d5f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e006fe00 con 0x7f28e015ed10 2019-11-28T11:52:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28dffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28e015ed10 0x7f28e015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:39.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28dffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28e015ed10 0x7f28e015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43274/0 (socket says 172.21.15.80:43274) 2019-11-28T11:52:39.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28e4afd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f28e00734b0 0x7f28e00726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42594/0 (socket says 172.21.15.80:42594) 2019-11-28T11:52:39.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28dffff700 1 -- 172.21.15.80:0/2480946786 learned_addr learned my addr 172.21.15.80:0/2480946786 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:39.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28dffff700 1 -- 172.21.15.80:0/2480946786 >> v1:172.21.15.174:6789/0 conn(0x7f28e0073020 legacy=0x7f28e0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:39.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28dffff700 1 -- 172.21.15.80:0/2480946786 >> v1:172.21.15.80:6789/0 conn(0x7f28e00734b0 legacy=0x7f28e00726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28df7fe700 1 -- 172.21.15.80:0/2480946786 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139123361 0 0) 0x7f28d8001480 con 0x7f28e00734b0 2019-11-28T11:52:39.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28dffff700 1 -- 172.21.15.80:0/2480946786 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e0070760 con 0x7f28e015ed10 2019-11-28T11:52:39.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28dffff700 1 --2- 172.21.15.80:0/2480946786 >> v2:172.21.15.80:3300/0 conn(0x7f28e015ed10 0x7f28e015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f28d000f740 tx=0x7f28d000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28dffff700 1 --2- 172.21.15.80:0/2480946786 >> v2:172.21.15.80:3300/0 conn(0x7f28e015ed10 0x7f28e015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f28d000f740 tx=0x7f28d000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28dffff700 1 --2- 172.21.15.80:0/2480946786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e015ed10 0x7f28e015f100 secure :-1 s=READY pgs=2251 cs=0 l=1 rx=0x7f28d000f740 tx=0x7f28d000fae0).ready entity=mon.0 client_cookie=f9b596ea9abbb335 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28dffff700 1 --2- 172.21.15.80:0/2480946786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e015ed10 0x7f28e015f100 secure :-1 s=THROTTLE_DONE pgs=2251 cs=0 l=1 rx=0x7f28d000f740 tx=0x7f28d000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28df7fe700 1 -- 172.21.15.80:0/2480946786 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d0000960 con 0x7f28e015ed10 2019-11-28T11:52:39.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28dffff700 1 --2- 172.21.15.80:0/2480946786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e015ed10 0x7f28e015f100 secure :-1 s=THROTTLE_DONE pgs=2251 cs=0 l=1 rx=0x7f28d000f740 tx=0x7f28d000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28dffff700 1 --2- 172.21.15.80:0/2480946786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e015ed10 0x7f28e015f100 secure :-1 s=THROTTLE_DONE pgs=2251 cs=0 l=1 rx=0x7f28d000f740 tx=0x7f28d000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28df7fe700 1 -- 172.21.15.80:0/2480946786 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d0000c90 con 0x7f28e015ed10 2019-11-28T11:52:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28df7fe700 1 -- 172.21.15.80:0/2480946786 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d0001360 con 0x7f28e015ed10 2019-11-28T11:52:39.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28e5d5f700 1 -- 172.21.15.80:0/2480946786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e015ed10 msgr2=0x7f28e015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.046+0000 7f28e5d5f700 1 --2- 172.21.15.80:0/2480946786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e015ed10 0x7f28e015f100 secure :-1 s=READY pgs=2251 cs=0 l=1 rx=0x7f28d000f740 tx=0x7f28d000fae0).stop 2019-11-28T11:52:39.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.047+0000 7f28e5d5f700 1 -- 172.21.15.80:0/2480946786 shutdown_connections 2019-11-28T11:52:39.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.047+0000 7f28e5d5f700 1 --2- 172.21.15.80:0/2480946786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28e015ed10 0x7f28e015f100 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.047+0000 7f28e5d5f700 1 -- 172.21.15.80:0/2480946786 shutdown_connections 2019-11-28T11:52:39.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.047+0000 7f28e5d5f700 1 -- 172.21.15.80:0/2480946786 wait complete. 2019-11-28T11:52:39.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.047+0000 7f28e5d5f700 1 -- 172.21.15.80:0/2480946786 >> 172.21.15.80:0/2480946786 conn(0x7f28e0061d20 msgr2=0x7f28e00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:39.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.049+0000 7f28e5d5f700 1 Processor -- start 2019-11-28T11:52:39.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.049+0000 7f28e5d5f700 1 -- start start 2019-11-28T11:52:39.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.050+0000 7f28e5d5f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010e970 0x7f28e01087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:39.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.050+0000 7f28e5d5f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f28e0107e30 0x7f28e0167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:39.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.050+0000 7f28e5d5f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e010c250 con 0x7f28e0108cf0 2019-11-28T11:52:39.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.050+0000 7f28e5d5f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e010da00 con 0x7f28e0107e30 2019-11-28T11:52:39.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.050+0000 7f28e5d5f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e010e430 con 0x7f28e010e970 2019-11-28T11:52:39.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.050+0000 7f28e4afd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f28e0107e30 0x7f28e0167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:39.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28dffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010e970 0x7f28e01087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:39.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28e4afd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f28e0107e30 0x7f28e0167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:58170/0 (socket says 172.21.15.80:58170) 2019-11-28T11:52:39.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28e4afd700 1 -- 172.21.15.80:0/537262438 learned_addr learned my addr 172.21.15.80:0/537262438 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:39.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28dffff700 1 -- 172.21.15.80:0/537262438 >> v2:172.21.15.174:3300/0 conn(0x7f28e0107e30 msgr2=0x7f28e0167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28dffff700 1 --2- 172.21.15.80:0/537262438 >> v2:172.21.15.174:3300/0 conn(0x7f28e0107e30 0x7f28e0167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28dffff700 1 -- 172.21.15.80:0/537262438 >> v1:172.21.15.174:6789/0 conn(0x7f28e0108cf0 legacy=0x7f28e0107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28dffff700 1 -- 172.21.15.80:0/537262438 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e0105ef0 con 0x7f28e010e970 2019-11-28T11:52:39.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28e4afd700 1 --2- 172.21.15.80:0/537262438 >> v2:172.21.15.174:3300/0 conn(0x7f28e0107e30 0x7f28e0167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:39.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28dffff700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010e970 0x7f28e01087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28d0010390 tx=0x7f28d0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28dffff700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010e970 0x7f28e01087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28d0010390 tx=0x7f28d0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28dffff700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010e970 0x7f28e01087b0 secure :-1 s=READY pgs=325 cs=0 l=1 rx=0x7f28d0010390 tx=0x7f28d0010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:39.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28dffff700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010e970 0x7f28e01087b0 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7f28d0010390 tx=0x7f28d0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28dd7fa700 1 -- 172.21.15.80:0/537262438 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d0005770 con 0x7f28e010e970 2019-11-28T11:52:39.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28dffff700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010e970 0x7f28e01087b0 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7f28d0010390 tx=0x7f28d0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28dd7fa700 1 -- 172.21.15.80:0/537262438 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d0005390 con 0x7f28e010e970 2019-11-28T11:52:39.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28e5d5f700 1 -- 172.21.15.80:0/537262438 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e0106270 con 0x7f28e010e970 2019-11-28T11:52:39.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28dffff700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010e970 0x7f28e01087b0 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7f28d0010390 tx=0x7f28d0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28dd7fa700 1 -- 172.21.15.80:0/537262438 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d0005a20 con 0x7f28e010e970 2019-11-28T11:52:39.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.051+0000 7f28e5d5f700 1 -- 172.21.15.80:0/537262438 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e0105ef0 con 0x7f28e010e970 2019-11-28T11:52:39.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.052+0000 7f28dffff700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010e970 0x7f28e01087b0 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7f28d0010390 tx=0x7f28d0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.052+0000 7f28dd7fa700 1 -- 172.21.15.80:0/537262438 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f28d0005580 con 0x7f28e010e970 2019-11-28T11:52:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.052+0000 7f28dffff700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010e970 0x7f28e01087b0 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7f28d0010390 tx=0x7f28d0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.052+0000 7f28dd7fa700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28b8018730 0x7f28b801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.052+0000 7f28dd7fa700 1 -- 172.21.15.80:0/537262438 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f28d0031a10 con 0x7f28e010e970 2019-11-28T11:52:39.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.052+0000 7f28d7fff700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28b8018730 0x7f28b801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:39.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.053+0000 7f28d7fff700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28b8018730 0x7f28b801abc0 crc :-1 s=READY pgs=924 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:39.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.060+0000 7f28e5d5f700 1 -- 172.21.15.80:0/537262438 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e0106270 con 0x7f28e010e970 2019-11-28T11:52:39.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.064+0000 7f28dffff700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010e970 0x7f28e01087b0 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7f28d0010390 tx=0x7f28d0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.064+0000 7f28dd7fa700 1 -- 172.21.15.80:0/537262438 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f28d0005180 con 0x7f28e010e970 2019-11-28T11:52:39.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.234+0000 7f28e5d5f700 1 -- 172.21.15.80:0/537262438 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f28e0105ef0 con 0x7f28e010e970 2019-11-28T11:52:39.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.235+0000 7f28dffff700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010e970 0x7f28e01087b0 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7f28d0010390 tx=0x7f28d0010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.235+0000 7f28dd7fa700 1 -- 172.21.15.80:0/537262438 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v176) v1 ==== 104+0+10 (secure 0 0 0) 0x7f28d0017240 con 0x7f28e010e970 2019-11-28T11:52:39.289 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:52:39.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.237+0000 7f28e5d5f700 1 -- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28b8018730 msgr2=0x7f28b801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.237+0000 7f28e5d5f700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28b8018730 0x7f28b801abc0 crc :-1 s=READY pgs=924 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.237+0000 7f28e5d5f700 1 -- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010e970 msgr2=0x7f28e01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.237+0000 7f28e5d5f700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010e970 0x7f28e01087b0 secure :-1 s=READY pgs=325 cs=0 l=1 rx=0x7f28d0010390 tx=0x7f28d0010730).stop 2019-11-28T11:52:39.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.237+0000 7f28e5d5f700 1 -- 172.21.15.80:0/537262438 shutdown_connections 2019-11-28T11:52:39.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.237+0000 7f28e5d5f700 1 --2- 172.21.15.80:0/537262438 >> v2:172.21.15.174:3300/0 conn(0x7f28e0107e30 0x7f28e0167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.237+0000 7f28e5d5f700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f28b8018730 0x7f28b801abc0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.237+0000 7f28e5d5f700 1 --2- 172.21.15.80:0/537262438 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28e010e970 0x7f28e01087b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.237+0000 7f28e5d5f700 1 -- 172.21.15.80:0/537262438 shutdown_connections 2019-11-28T11:52:39.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.237+0000 7f28e5d5f700 1 -- 172.21.15.80:0/537262438 wait complete. 2019-11-28T11:52:39.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.237+0000 7f28e5d5f700 1 -- 172.21.15.80:0/537262438 >> 172.21.15.80:0/537262438 conn(0x7f28e015e2d0 msgr2=0x7f28e0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:39.301 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:52:39.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.370+0000 7f3bd3e36700 1 Processor -- start 2019-11-28T11:52:39.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.370+0000 7f3bd3e36700 1 -- start start 2019-11-28T11:52:39.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.371+0000 7f3bd3e36700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bcc15ed10 0x7f3bcc15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:39.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.371+0000 7f3bd3e36700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bcc06db60 con 0x7f3bcc0734b0 2019-11-28T11:52:39.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.371+0000 7f3bd3e36700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bcc06e060 con 0x7f3bcc073020 2019-11-28T11:52:39.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.371+0000 7f3bd3e36700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc06fe00 con 0x7f3bcc15ed10 2019-11-28T11:52:39.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.371+0000 7f3bd23d3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bcc15ed10 0x7f3bcc15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:39.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.371+0000 7f3bd2bd4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3bcc0734b0 0x7f3bcc0726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42606/0 (socket says 172.21.15.80:42606) 2019-11-28T11:52:39.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.371+0000 7f3bd2bd4700 1 -- 172.21.15.80:0/2757074280 learned_addr learned my addr 172.21.15.80:0/2757074280 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:39.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.372+0000 7f3bd23d3700 1 -- 172.21.15.80:0/2757074280 >> v1:172.21.15.174:6789/0 conn(0x7f3bcc073020 legacy=0x7f3bcc071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.372+0000 7f3bd23d3700 1 -- 172.21.15.80:0/2757074280 >> v1:172.21.15.80:6789/0 conn(0x7f3bcc0734b0 legacy=0x7f3bcc0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.372+0000 7f3bd23d3700 1 -- 172.21.15.80:0/2757074280 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc070760 con 0x7f3bcc15ed10 2019-11-28T11:52:39.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.372+0000 7f3bd13d1700 1 -- 172.21.15.80:0/2757074280 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805833824 0 0) 0x7f3bc4001150 con 0x7f3bcc0734b0 2019-11-28T11:52:39.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.372+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2757074280 >> v2:172.21.15.80:3300/0 conn(0x7f3bcc15ed10 0x7f3bcc15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3bb400b2d0 tx=0x7f3bb400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.372+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2757074280 >> v2:172.21.15.80:3300/0 conn(0x7f3bcc15ed10 0x7f3bcc15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3bb400b2d0 tx=0x7f3bb400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.372+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2757074280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc15ed10 0x7f3bcc15f100 secure :-1 s=READY pgs=2253 cs=0 l=1 rx=0x7f3bb400b2d0 tx=0x7f3bb400bae0).ready entity=mon.0 client_cookie=cfb3f5152075107 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:39.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.372+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2757074280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc15ed10 0x7f3bcc15f100 secure :-1 s=THROTTLE_DONE pgs=2253 cs=0 l=1 rx=0x7f3bb400b2d0 tx=0x7f3bb400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.372+0000 7f3bd13d1700 1 -- 172.21.15.80:0/2757074280 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bb4007590 con 0x7f3bcc15ed10 2019-11-28T11:52:39.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.372+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2757074280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc15ed10 0x7f3bcc15f100 secure :-1 s=THROTTLE_DONE pgs=2253 cs=0 l=1 rx=0x7f3bb400b2d0 tx=0x7f3bb400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.372+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2757074280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc15ed10 0x7f3bcc15f100 secure :-1 s=THROTTLE_DONE pgs=2253 cs=0 l=1 rx=0x7f3bb400b2d0 tx=0x7f3bb400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.372+0000 7f3bd13d1700 1 -- 172.21.15.80:0/2757074280 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb4009d30 con 0x7f3bcc15ed10 2019-11-28T11:52:39.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.372+0000 7f3bd13d1700 1 -- 172.21.15.80:0/2757074280 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bb400a400 con 0x7f3bcc15ed10 2019-11-28T11:52:39.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.372+0000 7f3bd3e36700 1 -- 172.21.15.80:0/2757074280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc15ed10 msgr2=0x7f3bcc15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.372+0000 7f3bd3e36700 1 --2- 172.21.15.80:0/2757074280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc15ed10 0x7f3bcc15f100 secure :-1 s=READY pgs=2253 cs=0 l=1 rx=0x7f3bb400b2d0 tx=0x7f3bb400bae0).stop 2019-11-28T11:52:39.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.373+0000 7f3bd3e36700 1 -- 172.21.15.80:0/2757074280 shutdown_connections 2019-11-28T11:52:39.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.373+0000 7f3bd3e36700 1 --2- 172.21.15.80:0/2757074280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc15ed10 0x7f3bcc15f100 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.373+0000 7f3bd3e36700 1 -- 172.21.15.80:0/2757074280 shutdown_connections 2019-11-28T11:52:39.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.373+0000 7f3bd3e36700 1 -- 172.21.15.80:0/2757074280 wait complete. 2019-11-28T11:52:39.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.373+0000 7f3bd3e36700 1 -- 172.21.15.80:0/2757074280 >> 172.21.15.80:0/2757074280 conn(0x7f3bcc061d20 msgr2=0x7f3bcc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:39.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.375+0000 7f3bd3e36700 1 Processor -- start 2019-11-28T11:52:39.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.375+0000 7f3bd3e36700 1 -- start start 2019-11-28T11:52:39.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.376+0000 7f3bd3e36700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bcc148320 0x7f3bcc10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:39.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.376+0000 7f3bd3e36700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bcc10e3d0 0x7f3bcc168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:39.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.376+0000 7f3bd3e36700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bcc148e00 con 0x7f3bcc10f290 2019-11-28T11:52:39.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.376+0000 7f3bd3e36700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc13aa20 con 0x7f3bcc148320 2019-11-28T11:52:39.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.376+0000 7f3bd3e36700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc13acf0 con 0x7f3bcc10e3d0 2019-11-28T11:52:39.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.376+0000 7f3bd23d3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bcc148320 0x7f3bcc10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:39.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.376+0000 7f3bd23d3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3bcc148320 0x7f3bcc10ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43298/0 (socket says 172.21.15.80:43298) 2019-11-28T11:52:39.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.376+0000 7f3bd23d3700 1 -- 172.21.15.80:0/2981186816 learned_addr learned my addr 172.21.15.80:0/2981186816 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:39.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.377+0000 7f3bd23d3700 1 -- 172.21.15.80:0/2981186816 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bcc10e3d0 msgr2=0x7f3bcc168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.377+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bcc10e3d0 0x7f3bcc168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.377+0000 7f3bd23d3700 1 -- 172.21.15.80:0/2981186816 >> v1:172.21.15.174:6789/0 conn(0x7f3bcc10f290 legacy=0x7f3bcc10dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.377+0000 7f3bd23d3700 1 -- 172.21.15.80:0/2981186816 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc10c490 con 0x7f3bcc148320 2019-11-28T11:52:39.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.377+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2981186816 >> v2:172.21.15.80:3300/0 conn(0x7f3bcc148320 0x7f3bcc10ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3bb40107d0 tx=0x7f3bb4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.377+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2981186816 >> v2:172.21.15.80:3300/0 conn(0x7f3bcc148320 0x7f3bcc10ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3bb40107d0 tx=0x7f3bb4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.377+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc148320 0x7f3bcc10ed50 secure :-1 s=READY pgs=2254 cs=0 l=1 rx=0x7f3bb40107d0 tx=0x7f3bb4010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:39.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.377+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc148320 0x7f3bcc10ed50 secure :-1 s=THROTTLE_DONE pgs=2254 cs=0 l=1 rx=0x7f3bb40107d0 tx=0x7f3bb4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.377+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc148320 0x7f3bcc10ed50 secure :-1 s=THROTTLE_DONE pgs=2254 cs=0 l=1 rx=0x7f3bb40107d0 tx=0x7f3bb4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.377+0000 7f3bcaffd700 1 -- 172.21.15.80:0/2981186816 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bb4000cc0 con 0x7f3bcc148320 2019-11-28T11:52:39.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.377+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc148320 0x7f3bcc10ed50 secure :-1 s=THROTTLE_DONE pgs=2254 cs=0 l=1 rx=0x7f3bb40107d0 tx=0x7f3bb4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.377+0000 7f3bcaffd700 1 -- 172.21.15.80:0/2981186816 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb4009d00 con 0x7f3bcc148320 2019-11-28T11:52:39.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.377+0000 7f3bd3e36700 1 -- 172.21.15.80:0/2981186816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bcc10c810 con 0x7f3bcc148320 2019-11-28T11:52:39.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.377+0000 7f3bcaffd700 1 -- 172.21.15.80:0/2981186816 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bb400a450 con 0x7f3bcc148320 2019-11-28T11:52:39.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.377+0000 7f3bd3e36700 1 -- 172.21.15.80:0/2981186816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bcc10c490 con 0x7f3bcc148320 2019-11-28T11:52:39.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.377+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc148320 0x7f3bcc10ed50 secure :-1 s=THROTTLE_DONE pgs=2254 cs=0 l=1 rx=0x7f3bb40107d0 tx=0x7f3bb4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.378+0000 7f3bcaffd700 1 -- 172.21.15.80:0/2981186816 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3bb4009ef0 con 0x7f3bcc148320 2019-11-28T11:52:39.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.378+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc148320 0x7f3bcc10ed50 secure :-1 s=THROTTLE_DONE pgs=2254 cs=0 l=1 rx=0x7f3bb40107d0 tx=0x7f3bb4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.378+0000 7f3bcaffd700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3bb0018730 0x7f3bb001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:39.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.378+0000 7f3bcaffd700 1 -- 172.21.15.80:0/2981186816 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3bb4031e60 con 0x7f3bcc148320 2019-11-28T11:52:39.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.378+0000 7f3bd1bd2700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3bb0018730 0x7f3bb001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:39.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.378+0000 7f3bd1bd2700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3bb0018730 0x7f3bb001abc0 crc :-1 s=READY pgs=926 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:39.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.385+0000 7f3bd3e36700 1 -- 172.21.15.80:0/2981186816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bcc10c810 con 0x7f3bcc148320 2019-11-28T11:52:39.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.389+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc148320 0x7f3bcc10ed50 secure :-1 s=THROTTLE_DONE pgs=2254 cs=0 l=1 rx=0x7f3bb40107d0 tx=0x7f3bb4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.389+0000 7f3bcaffd700 1 -- 172.21.15.80:0/2981186816 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3bb4009900 con 0x7f3bcc148320 2019-11-28T11:52:39.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.556+0000 7f3bd3e36700 1 -- 172.21.15.80:0/2981186816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f3bcc10c490 con 0x7f3bcc148320 2019-11-28T11:52:39.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.556+0000 7f3bd23d3700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc148320 0x7f3bcc10ed50 secure :-1 s=THROTTLE_DONE pgs=2254 cs=0 l=1 rx=0x7f3bb40107d0 tx=0x7f3bb4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.556+0000 7f3bcaffd700 1 -- 172.21.15.80:0/2981186816 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v176) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3bb4009ef0 con 0x7f3bcc148320 2019-11-28T11:52:39.611 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:52:39.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.559+0000 7f3bd3e36700 1 -- 172.21.15.80:0/2981186816 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3bb0018730 msgr2=0x7f3bb001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.559+0000 7f3bd3e36700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3bb0018730 0x7f3bb001abc0 crc :-1 s=READY pgs=926 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.559+0000 7f3bd3e36700 1 -- 172.21.15.80:0/2981186816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc148320 msgr2=0x7f3bcc10ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.559+0000 7f3bd3e36700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc148320 0x7f3bcc10ed50 secure :-1 s=READY pgs=2254 cs=0 l=1 rx=0x7f3bb40107d0 tx=0x7f3bb4010600).stop 2019-11-28T11:52:39.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.559+0000 7f3bd3e36700 1 -- 172.21.15.80:0/2981186816 shutdown_connections 2019-11-28T11:52:39.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.559+0000 7f3bd3e36700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bcc10e3d0 0x7f3bcc168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.559+0000 7f3bd3e36700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3bb0018730 0x7f3bb001abc0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.559+0000 7f3bd3e36700 1 --2- 172.21.15.80:0/2981186816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3bcc148320 0x7f3bcc10ed50 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.559+0000 7f3bd3e36700 1 -- 172.21.15.80:0/2981186816 shutdown_connections 2019-11-28T11:52:39.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.559+0000 7f3bd3e36700 1 -- 172.21.15.80:0/2981186816 wait complete. 2019-11-28T11:52:39.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.559+0000 7f3bd3e36700 1 -- 172.21.15.80:0/2981186816 >> 172.21.15.80:0/2981186816 conn(0x7f3bcc15e2d0 msgr2=0x7f3bcc147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:39.622 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:52:39.622 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:39.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.689+0000 7f6b4de65700 1 Processor -- start 2019-11-28T11:52:39.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.689+0000 7f6b4de65700 1 -- start start 2019-11-28T11:52:39.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b4de65700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6b4806c490 0x7f6b4806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:39.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b4de65700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6b4806ce60 0x7f6b48164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:39.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b4de65700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4806db00 con 0x7f6b4806c0a0 2019-11-28T11:52:39.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b4de65700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4806fd60 con 0x7f6b4806c490 2019-11-28T11:52:39.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b4de65700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b48070030 con 0x7f6b4806ce60 2019-11-28T11:52:39.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b3ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6b4806c490 0x7f6b4806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:39.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b3ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6b4806c490 0x7f6b4806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43306/0 (socket says 172.21.15.80:43306) 2019-11-28T11:52:39.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b3ffff700 1 -- 172.21.15.80:0/4089999141 learned_addr learned my addr 172.21.15.80:0/4089999141 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:39.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b4cc03700 1 --2- 172.21.15.80:0/4089999141 >> v2:172.21.15.174:3300/0 conn(0x7f6b4806ce60 0x7f6b48164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:39.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b3ffff700 1 -- 172.21.15.80:0/4089999141 >> v2:172.21.15.174:3300/0 conn(0x7f6b4806ce60 msgr2=0x7f6b48164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:39.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/4089999141 >> v2:172.21.15.174:3300/0 conn(0x7f6b4806ce60 0x7f6b48164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:39.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b3ffff700 1 -- 172.21.15.80:0/4089999141 >> v1:172.21.15.174:6789/0 conn(0x7f6b4806c0a0 legacy=0x7f6b48072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b3ffff700 1 -- 172.21.15.80:0/4089999141 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b480706c0 con 0x7f6b4806c490 2019-11-28T11:52:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/4089999141 >> v2:172.21.15.80:3300/0 conn(0x7f6b4806c490 0x7f6b4806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6b3000f6c0 tx=0x7f6b3000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/4089999141 >> v2:172.21.15.80:3300/0 conn(0x7f6b4806c490 0x7f6b4806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6b3000f6c0 tx=0x7f6b3000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/4089999141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4806c490 0x7f6b4806c920 secure :-1 s=READY pgs=2255 cs=0 l=1 rx=0x7f6b3000f6c0 tx=0x7f6b3000fa60).ready entity=mon.0 client_cookie=f9cc65f34d44e541 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/4089999141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4806c490 0x7f6b4806c920 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7f6b3000f6c0 tx=0x7f6b3000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/4089999141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4806c490 0x7f6b4806c920 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7f6b3000f6c0 tx=0x7f6b3000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b477fe700 1 -- 172.21.15.80:0/4089999141 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b30000960 con 0x7f6b4806c490 2019-11-28T11:52:39.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/4089999141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4806c490 0x7f6b4806c920 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7f6b3000f6c0 tx=0x7f6b3000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b477fe700 1 -- 172.21.15.80:0/4089999141 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b30000c90 con 0x7f6b4806c490 2019-11-28T11:52:39.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b477fe700 1 -- 172.21.15.80:0/4089999141 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b300013a0 con 0x7f6b4806c490 2019-11-28T11:52:39.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b4de65700 1 -- 172.21.15.80:0/4089999141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4806c490 msgr2=0x7f6b4806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.690+0000 7f6b4de65700 1 --2- 172.21.15.80:0/4089999141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4806c490 0x7f6b4806c920 secure :-1 s=READY pgs=2255 cs=0 l=1 rx=0x7f6b3000f6c0 tx=0x7f6b3000fa60).stop 2019-11-28T11:52:39.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.691+0000 7f6b4de65700 1 -- 172.21.15.80:0/4089999141 shutdown_connections 2019-11-28T11:52:39.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.691+0000 7f6b4de65700 1 --2- 172.21.15.80:0/4089999141 >> v2:172.21.15.174:3300/0 conn(0x7f6b4806ce60 0x7f6b48164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:39.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.691+0000 7f6b4de65700 1 --2- 172.21.15.80:0/4089999141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4806c490 0x7f6b4806c920 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.691+0000 7f6b4de65700 1 -- 172.21.15.80:0/4089999141 shutdown_connections 2019-11-28T11:52:39.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.691+0000 7f6b4de65700 1 -- 172.21.15.80:0/4089999141 wait complete. 2019-11-28T11:52:39.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.691+0000 7f6b4de65700 1 -- 172.21.15.80:0/4089999141 >> 172.21.15.80:0/4089999141 conn(0x7f6b48061cf0 msgr2=0x7f6b48064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:39.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.694+0000 7f6b4de65700 1 Processor -- start 2019-11-28T11:52:39.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.694+0000 7f6b4de65700 1 -- start start 2019-11-28T11:52:39.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.694+0000 7f6b4de65700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6b4813a780 0x7f6b4812d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:39.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.694+0000 7f6b4de65700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6b4812d9c0 0x7f6b4812c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:39.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.694+0000 7f6b4de65700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b4812c840 0x7f6b4812cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:39.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.694+0000 7f6b4de65700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4812a260 con 0x7f6b4812d9c0 2019-11-28T11:52:39.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.694+0000 7f6b4de65700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4812a530 con 0x7f6b4813a780 2019-11-28T11:52:39.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.694+0000 7f6b4de65700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b48129830 con 0x7f6b4812c840 2019-11-28T11:52:39.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.694+0000 7f6b3ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6b4812d9c0 0x7f6b4812c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:39.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b3ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6b4812d9c0 0x7f6b4812c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43312/0 (socket says 172.21.15.80:43312) 2019-11-28T11:52:39.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b3ffff700 1 -- 172.21.15.80:0/3056893321 learned_addr learned my addr 172.21.15.80:0/3056893321 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:39.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b47fff700 1 --2- 172.21.15.80:0/3056893321 >> v2:172.21.15.174:3300/0 conn(0x7f6b4813a780 0x7f6b4812d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:39.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b4cc03700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b4812c840 0x7f6b4812cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:39.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b3ffff700 1 -- 172.21.15.80:0/3056893321 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b4812c840 msgr2=0x7f6b4812cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b4812c840 0x7f6b4812cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b3ffff700 1 -- 172.21.15.80:0/3056893321 >> v2:172.21.15.174:3300/0 conn(0x7f6b4813a780 msgr2=0x7f6b4812d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/3056893321 >> v2:172.21.15.174:3300/0 conn(0x7f6b4813a780 0x7f6b4812d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b3ffff700 1 -- 172.21.15.80:0/3056893321 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4812abc0 con 0x7f6b4812d9c0 2019-11-28T11:52:39.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/3056893321 >> v2:172.21.15.80:3300/0 conn(0x7f6b4812d9c0 0x7f6b4812c300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b30010440 tx=0x7f6b30010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/3056893321 >> v2:172.21.15.80:3300/0 conn(0x7f6b4812d9c0 0x7f6b4812c300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b30010440 tx=0x7f6b30010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4812d9c0 0x7f6b4812c300 secure :-1 s=READY pgs=2256 cs=0 l=1 rx=0x7f6b30010440 tx=0x7f6b30010370).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:39.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4812d9c0 0x7f6b4812c300 secure :-1 s=THROTTLE_DONE pgs=2256 cs=0 l=1 rx=0x7f6b30010440 tx=0x7f6b30010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b457fa700 1 -- 172.21.15.80:0/3056893321 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b30000940 con 0x7f6b4812d9c0 2019-11-28T11:52:39.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4812d9c0 0x7f6b4812c300 secure :-1 s=THROTTLE_DONE pgs=2256 cs=0 l=1 rx=0x7f6b30010440 tx=0x7f6b30010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4812d9c0 0x7f6b4812c300 secure :-1 s=THROTTLE_DONE pgs=2256 cs=0 l=1 rx=0x7f6b30010440 tx=0x7f6b30010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b457fa700 1 -- 172.21.15.80:0/3056893321 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b30000f50 con 0x7f6b4812d9c0 2019-11-28T11:52:39.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b4de65700 1 -- 172.21.15.80:0/3056893321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4812af40 con 0x7f6b4812d9c0 2019-11-28T11:52:39.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b457fa700 1 -- 172.21.15.80:0/3056893321 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b300015a0 con 0x7f6b4812d9c0 2019-11-28T11:52:39.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b4de65700 1 -- 172.21.15.80:0/3056893321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4812abc0 con 0x7f6b4812d9c0 2019-11-28T11:52:39.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.695+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4812d9c0 0x7f6b4812c300 secure :-1 s=THROTTLE_DONE pgs=2256 cs=0 l=1 rx=0x7f6b30010440 tx=0x7f6b30010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.696+0000 7f6b457fa700 1 -- 172.21.15.80:0/3056893321 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6b30001140 con 0x7f6b4812d9c0 2019-11-28T11:52:39.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.696+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4812d9c0 0x7f6b4812c300 secure :-1 s=THROTTLE_DONE pgs=2256 cs=0 l=1 rx=0x7f6b30010440 tx=0x7f6b30010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.696+0000 7f6b457fa700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6b2c018730 0x7f6b2c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:39.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.696+0000 7f6b457fa700 1 -- 172.21.15.80:0/3056893321 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6b30031a10 con 0x7f6b4812d9c0 2019-11-28T11:52:39.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.696+0000 7f6b47fff700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6b2c018730 0x7f6b2c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:39.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.696+0000 7f6b47fff700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6b2c018730 0x7f6b2c01abc0 crc :-1 s=READY pgs=927 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:39.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.703+0000 7f6b4de65700 1 -- 172.21.15.80:0/3056893321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4812af40 con 0x7f6b4812d9c0 2019-11-28T11:52:39.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.707+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4812d9c0 0x7f6b4812c300 secure :-1 s=THROTTLE_DONE pgs=2256 cs=0 l=1 rx=0x7f6b30010440 tx=0x7f6b30010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.707+0000 7f6b457fa700 1 -- 172.21.15.80:0/3056893321 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6b3002df70 con 0x7f6b4812d9c0 2019-11-28T11:52:39.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.878+0000 7f6b4de65700 1 -- 172.21.15.80:0/3056893321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b4812abc0 con 0x7f6b4812d9c0 2019-11-28T11:52:39.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.879+0000 7f6b3ffff700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4812d9c0 0x7f6b4812c300 secure :-1 s=THROTTLE_DONE pgs=2256 cs=0 l=1 rx=0x7f6b30010440 tx=0x7f6b30010370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:39.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.879+0000 7f6b457fa700 1 -- 172.21.15.80:0/3056893321 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 140 v140) v1 ==== 95+0+2447 (secure 0 0 0) 0x7f6b3002df70 con 0x7f6b4812d9c0 2019-11-28T11:52:39.933 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 140 2019-11-28T11:52:39.934 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:39.934 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":140,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6834/632195489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":632195489},{"type":"v1","addr":"172.21.15.80:6834","nonce":632195489}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":137},{"gid":10551,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/59183969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":59183969},{"type":"v1","addr":"172.21.15.80:6835","nonce":59183969}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":140}],"filesystems":[{"mdsmap":{"epoch":139,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:35.148974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7181":{"gid":7181,"name":"c","rank":0,"incarnation":138,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/3265178535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3265178535},{"type":"v1","addr":"172.21.15.174:6835","nonce":3265178535}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:39.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.881+0000 7f6b4de65700 1 -- 172.21.15.80:0/3056893321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6b2c018730 msgr2=0x7f6b2c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.881+0000 7f6b4de65700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6b2c018730 0x7f6b2c01abc0 crc :-1 s=READY pgs=927 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.881+0000 7f6b4de65700 1 -- 172.21.15.80:0/3056893321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4812d9c0 msgr2=0x7f6b4812c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:39.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.881+0000 7f6b4de65700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4812d9c0 0x7f6b4812c300 secure :-1 s=READY pgs=2256 cs=0 l=1 rx=0x7f6b30010440 tx=0x7f6b30010370).stop 2019-11-28T11:52:39.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.881+0000 7f6b4de65700 1 -- 172.21.15.80:0/3056893321 shutdown_connections 2019-11-28T11:52:39.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.881+0000 7f6b4de65700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6b2c018730 0x7f6b2c01abc0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.881+0000 7f6b4de65700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b4812c840 0x7f6b4812cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.881+0000 7f6b4de65700 1 --2- 172.21.15.80:0/3056893321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b4812d9c0 0x7f6b4812c300 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.881+0000 7f6b4de65700 1 --2- 172.21.15.80:0/3056893321 >> v2:172.21.15.174:3300/0 conn(0x7f6b4813a780 0x7f6b4812d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:39.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.881+0000 7f6b4de65700 1 -- 172.21.15.80:0/3056893321 shutdown_connections 2019-11-28T11:52:39.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.881+0000 7f6b4de65700 1 -- 172.21.15.80:0/3056893321 wait complete. 2019-11-28T11:52:39.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:39.881+0000 7f6b4de65700 1 -- 172.21.15.80:0/3056893321 >> 172.21.15.80:0/3056893321 conn(0x7f6b48127dc0 msgr2=0x7f6b48141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:40.250 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7181}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 28, u'failed': [], u'epoch': 139, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [29], u'info': {u'gid_7181': {u'export_targets': [], u'name': u'c', u'incarnation': 138, u'state_seq': 2, u'state': u'up:active', u'gid': 7181, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3265178535, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 3265178535, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/3265178535'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:52:31.482361+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:52:35.148974+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:52:40.250 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:52:40.250 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:52:40.378 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:52:40.378 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:52:40.378 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:52:40.378 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 7181, 2019-11-28T11:52:40.379 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:52:40.379 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:52:40.379 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 6.1865772520000002, 2019-11-28T11:52:40.379 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 139, 2019-11-28T11:52:40.380 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 176, 2019-11-28T11:52:40.380 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 176, 2019-11-28T11:52:40.380 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 6.4257048279999998 2019-11-28T11:52:40.381 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:52:40.384 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7181, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.1865772520000002, "mdsmap_epoch": 139, "osdmap_epoch": 176, "osdmap_epoch_barrier": 176, "uptime": 6.4257048279999998 } 2019-11-28T11:52:40.384 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:52:40.384 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:52:40.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:52:40.385 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:52:40.457 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:52:40.457 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:52:40.578 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:52:40.578 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:52:40.578 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:52:40.578 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:52:40.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:52:40.579 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:52:40.656 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:52:40.780 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:52:40.782 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:52:40.782 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:52:40.789 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:52:40.789 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:52:40.911 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:52:40.911 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:52:40.911 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:52:40.916 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:52:40.917 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:52:40.917 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:52:40.917 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:52:40.919 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:52:40.919 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:52:40.919 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:52:40.922 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:52:40.922 DEBUG:teuthology.parallel:result is None 2019-11-28T11:52:40.923 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:52:40.923 DEBUG:teuthology.parallel:result is None 2019-11-28T11:52:40.924 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:52:40.925 DEBUG:teuthology.parallel:result is None 2019-11-28T11:52:40.925 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:52:40.925 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:52:40.927 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:52:41.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.074+0000 7f5016a63700 1 Processor -- start 2019-11-28T11:52:41.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.074+0000 7f5016a63700 1 -- start start 2019-11-28T11:52:41.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.075+0000 7f5016a63700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f501006c490 0x7f501006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:41.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.075+0000 7f5016a63700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501006ce60 0x7f5010164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:41.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.075+0000 7f5016a63700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f501006db00 con 0x7f501006c0a0 2019-11-28T11:52:41.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.075+0000 7f5016a63700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501006fd60 con 0x7f501006c490 2019-11-28T11:52:41.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.075+0000 7f5016a63700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5010070030 con 0x7f501006ce60 2019-11-28T11:52:41.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f500ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f501006c490 0x7f501006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:41.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f500ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f501006c490 0x7f501006c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43326/0 (socket says 172.21.15.80:43326) 2019-11-28T11:52:41.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f500ffff700 1 -- 172.21.15.80:0/1900068900 learned_addr learned my addr 172.21.15.80:0/1900068900 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:41.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f5015801700 1 --2- 172.21.15.80:0/1900068900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501006ce60 0x7f5010164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:41.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f500ffff700 1 -- 172.21.15.80:0/1900068900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501006ce60 msgr2=0x7f5010164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:41.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f500ffff700 1 --2- 172.21.15.80:0/1900068900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501006ce60 0x7f5010164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:41.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f500ffff700 1 -- 172.21.15.80:0/1900068900 >> v1:172.21.15.174:6789/0 conn(0x7f501006c0a0 legacy=0x7f5010072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:41.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f500ffff700 1 -- 172.21.15.80:0/1900068900 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50100706c0 con 0x7f501006c490 2019-11-28T11:52:41.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f5015801700 1 --2- 172.21.15.80:0/1900068900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501006ce60 0x7f5010164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:52:41.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f500ffff700 1 --2- 172.21.15.80:0/1900068900 >> v2:172.21.15.80:3300/0 conn(0x7f501006c490 0x7f501006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4ffc00f740 tx=0x7f4ffc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f500ffff700 1 --2- 172.21.15.80:0/1900068900 >> v2:172.21.15.80:3300/0 conn(0x7f501006c490 0x7f501006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4ffc00f740 tx=0x7f4ffc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f500ffff700 1 --2- 172.21.15.80:0/1900068900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f501006c490 0x7f501006c920 secure :-1 s=READY pgs=2260 cs=0 l=1 rx=0x7f4ffc00f740 tx=0x7f4ffc00fae0).ready entity=mon.0 client_cookie=52576bff098a0fc5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:41.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f500ffff700 1 --2- 172.21.15.80:0/1900068900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f501006c490 0x7f501006c920 secure :-1 s=THROTTLE_DONE pgs=2260 cs=0 l=1 rx=0x7f4ffc00f740 tx=0x7f4ffc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f500f7fe700 1 -- 172.21.15.80:0/1900068900 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ffc000960 con 0x7f501006c490 2019-11-28T11:52:41.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f500ffff700 1 --2- 172.21.15.80:0/1900068900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f501006c490 0x7f501006c920 secure :-1 s=THROTTLE_DONE pgs=2260 cs=0 l=1 rx=0x7f4ffc00f740 tx=0x7f4ffc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f500f7fe700 1 -- 172.21.15.80:0/1900068900 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc007210 con 0x7f501006c490 2019-11-28T11:52:41.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f500ffff700 1 --2- 172.21.15.80:0/1900068900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f501006c490 0x7f501006c920 secure :-1 s=THROTTLE_DONE pgs=2260 cs=0 l=1 rx=0x7f4ffc00f740 tx=0x7f4ffc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f500f7fe700 1 -- 172.21.15.80:0/1900068900 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ffc000e80 con 0x7f501006c490 2019-11-28T11:52:41.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7f5016a63700 1 -- 172.21.15.80:0/1900068900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f501006c490 msgr2=0x7f501006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:41.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7f5016a63700 1 --2- 172.21.15.80:0/1900068900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f501006c490 0x7f501006c920 secure :-1 s=READY pgs=2260 cs=0 l=1 rx=0x7f4ffc00f740 tx=0x7f4ffc00fae0).stop 2019-11-28T11:52:41.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7f5016a63700 1 -- 172.21.15.80:0/1900068900 shutdown_connections 2019-11-28T11:52:41.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7f5016a63700 1 --2- 172.21.15.80:0/1900068900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501006ce60 0x7f5010164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:41.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7f5016a63700 1 --2- 172.21.15.80:0/1900068900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f501006c490 0x7f501006c920 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:41.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7f5016a63700 1 -- 172.21.15.80:0/1900068900 shutdown_connections 2019-11-28T11:52:41.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7f5016a63700 1 -- 172.21.15.80:0/1900068900 wait complete. 2019-11-28T11:52:41.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7f5016a63700 1 -- 172.21.15.80:0/1900068900 >> 172.21.15.80:0/1900068900 conn(0x7f5010061cf0 msgr2=0x7f5010064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:41.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.074+0000 7f2aa42e6700 1 Processor -- start 2019-11-28T11:52:41.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.074+0000 7f2aa42e6700 1 -- start start 2019-11-28T11:52:41.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.075+0000 7f2aa42e6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2a9c06c0a0 0x7f2a9c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:41.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.075+0000 7f2aa42e6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c0734e0 0x7f2a9c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:41.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.075+0000 7f2aa42e6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a9c06db00 con 0x7f2a9c072360 2019-11-28T11:52:41.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.075+0000 7f2aa42e6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a9c06fd60 con 0x7f2a9c06c0a0 2019-11-28T11:52:41.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.075+0000 7f2aa42e6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c070030 con 0x7f2a9c0734e0 2019-11-28T11:52:41.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.075+0000 7f2aa3084700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2a9c072360 0x7f2a9c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42634/0 (socket says 172.21.15.80:42634) 2019-11-28T11:52:41.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.075+0000 7f2aa3084700 1 -- 172.21.15.80:0/4226513552 learned_addr learned my addr 172.21.15.80:0/4226513552 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:41.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.075+0000 7f2aa2883700 1 --2- 172.21.15.80:0/4226513552 >> v2:172.21.15.80:3300/0 conn(0x7f2a9c06c0a0 0x7f2a9c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:41.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f2aa2082700 1 --2- 172.21.15.80:0/4226513552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c0734e0 0x7f2a9c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:41.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f2aa2883700 1 -- 172.21.15.80:0/4226513552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c0734e0 msgr2=0x7f2a9c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:41.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f2aa2883700 1 --2- 172.21.15.80:0/4226513552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c0734e0 0x7f2a9c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:41.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f2aa2883700 1 -- 172.21.15.80:0/4226513552 >> v1:172.21.15.80:6789/0 conn(0x7f2a9c072360 legacy=0x7f2a9c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:41.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f2aa2883700 1 -- 172.21.15.80:0/4226513552 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9c0706c0 con 0x7f2a9c06c0a0 2019-11-28T11:52:41.140 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f2aa2883700 1 --2- 172.21.15.80:0/4226513552 >> v2:172.21.15.80:3300/0 conn(0x7f2a9c06c0a0 0x7f2a9c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2a9000b2d0 tx=0x7f2a9000ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f2aa2883700 1 --2- 172.21.15.80:0/4226513552 >> v2:172.21.15.80:3300/0 conn(0x7f2a9c06c0a0 0x7f2a9c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2a9000b2d0 tx=0x7f2a9000ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f2aa2883700 1 --2- 172.21.15.80:0/4226513552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a9c06c0a0 0x7f2a9c072fa0 secure :-1 s=READY pgs=2259 cs=0 l=1 rx=0x7f2a9000b2d0 tx=0x7f2a9000ba60).ready entity=mon.0 client_cookie=4cb443bfeac82ac7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:41.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f2aa2883700 1 --2- 172.21.15.80:0/4226513552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a9c06c0a0 0x7f2a9c072fa0 secure :-1 s=THROTTLE_DONE pgs=2259 cs=0 l=1 rx=0x7f2a9000b2d0 tx=0x7f2a9000ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.141 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f2aa2883700 1 --2- 172.21.15.80:0/4226513552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a9c06c0a0 0x7f2a9c072fa0 secure :-1 s=THROTTLE_DONE pgs=2259 cs=0 l=1 rx=0x7f2a9000b2d0 tx=0x7f2a9000ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f2aa1881700 1 -- 172.21.15.80:0/4226513552 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a90007590 con 0x7f2a9c06c0a0 2019-11-28T11:52:41.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f2aa2883700 1 --2- 172.21.15.80:0/4226513552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a9c06c0a0 0x7f2a9c072fa0 secure :-1 s=THROTTLE_DONE pgs=2259 cs=0 l=1 rx=0x7f2a9000b2d0 tx=0x7f2a9000ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.142 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f2aa1881700 1 -- 172.21.15.80:0/4226513552 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a90009d30 con 0x7f2a9c06c0a0 2019-11-28T11:52:41.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7f2aa1881700 1 -- 172.21.15.80:0/4226513552 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9000a400 con 0x7f2a9c06c0a0 2019-11-28T11:52:41.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7f2aa42e6700 1 -- 172.21.15.80:0/4226513552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a9c06c0a0 msgr2=0x7f2a9c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:41.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7f2aa42e6700 1 --2- 172.21.15.80:0/4226513552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a9c06c0a0 0x7f2a9c072fa0 secure :-1 s=READY pgs=2259 cs=0 l=1 rx=0x7f2a9000b2d0 tx=0x7f2a9000ba60).stop 2019-11-28T11:52:41.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7f2aa42e6700 1 -- 172.21.15.80:0/4226513552 shutdown_connections 2019-11-28T11:52:41.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7f2aa42e6700 1 --2- 172.21.15.80:0/4226513552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c0734e0 0x7f2a9c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:41.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7f2aa42e6700 1 --2- 172.21.15.80:0/4226513552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a9c06c0a0 0x7f2a9c072fa0 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:41.143 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7f2aa42e6700 1 -- 172.21.15.80:0/4226513552 shutdown_connections 2019-11-28T11:52:41.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.078+0000 7f2aa42e6700 1 -- 172.21.15.80:0/4226513552 wait complete. 2019-11-28T11:52:41.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.078+0000 7f2aa42e6700 1 -- 172.21.15.80:0/4226513552 >> 172.21.15.80:0/4226513552 conn(0x7f2a9c061cf0 msgr2=0x7f2a9c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:41.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.074+0000 7fa4f1636700 1 Processor -- start 2019-11-28T11:52:41.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.074+0000 7fa4f1636700 1 -- start start 2019-11-28T11:52:41.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.075+0000 7fa4f1636700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4ec06c490 0x7fa4ec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:41.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.075+0000 7fa4f1636700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa4ec06ce60 0x7fa4ec164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:41.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7fa4f1636700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ec06db00 con 0x7fa4ec06c0a0 2019-11-28T11:52:41.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7fa4f1636700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ec06fd60 con 0x7fa4ec06c490 2019-11-28T11:52:41.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7fa4f1636700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ec070030 con 0x7fa4ec06ce60 2019-11-28T11:52:41.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7fa4e3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4ec06c490 0x7fa4ec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:41.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7fa4e3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa4ec06c490 0x7fa4ec06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43334/0 (socket says 172.21.15.80:43334) 2019-11-28T11:52:41.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7fa4e3fff700 1 -- 172.21.15.80:0/4197773958 learned_addr learned my addr 172.21.15.80:0/4197773958 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:41.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7fa4ebfff700 1 --2- 172.21.15.80:0/4197773958 >> v2:172.21.15.174:3300/0 conn(0x7fa4ec06ce60 0x7fa4ec164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:41.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7fa4e3fff700 1 -- 172.21.15.80:0/4197773958 >> v2:172.21.15.174:3300/0 conn(0x7fa4ec06ce60 msgr2=0x7fa4ec164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:41.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4197773958 >> v2:172.21.15.174:3300/0 conn(0x7fa4ec06ce60 0x7fa4ec164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:41.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7fa4e3fff700 1 -- 172.21.15.80:0/4197773958 >> v1:172.21.15.174:6789/0 conn(0x7fa4ec06c0a0 legacy=0x7fa4ec072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:41.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7fa4e3fff700 1 -- 172.21.15.80:0/4197773958 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec0706c0 con 0x7fa4ec06c490 2019-11-28T11:52:41.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4197773958 >> v2:172.21.15.80:3300/0 conn(0x7fa4ec06c490 0x7fa4ec06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa4d400f6c0 tx=0x7fa4d400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4197773958 >> v2:172.21.15.80:3300/0 conn(0x7fa4ec06c490 0x7fa4ec06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa4d400f6c0 tx=0x7fa4d400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4197773958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec06c490 0x7fa4ec06c920 secure :-1 s=READY pgs=2261 cs=0 l=1 rx=0x7fa4d400f6c0 tx=0x7fa4d400fa60).ready entity=mon.0 client_cookie=1f3fa448997739cf server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.076+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4197773958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec06c490 0x7fa4ec06c920 secure :-1 s=THROTTLE_DONE pgs=2261 cs=0 l=1 rx=0x7fa4d400f6c0 tx=0x7fa4d400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7fa4eaffd700 1 -- 172.21.15.80:0/4197773958 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d4000940 con 0x7fa4ec06c490 2019-11-28T11:52:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4197773958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec06c490 0x7fa4ec06c920 secure :-1 s=THROTTLE_DONE pgs=2261 cs=0 l=1 rx=0x7fa4d400f6c0 tx=0x7fa4d400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4197773958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec06c490 0x7fa4ec06c920 secure :-1 s=THROTTLE_DONE pgs=2261 cs=0 l=1 rx=0x7fa4d400f6c0 tx=0x7fa4d400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7fa4eaffd700 1 -- 172.21.15.80:0/4197773958 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d4007210 con 0x7fa4ec06c490 2019-11-28T11:52:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7fa4eaffd700 1 -- 172.21.15.80:0/4197773958 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d4000940 con 0x7fa4ec06c490 2019-11-28T11:52:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7fa4f1636700 1 -- 172.21.15.80:0/4197773958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec06c490 msgr2=0x7fa4ec06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7fa4f1636700 1 --2- 172.21.15.80:0/4197773958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec06c490 0x7fa4ec06c920 secure :-1 s=READY pgs=2261 cs=0 l=1 rx=0x7fa4d400f6c0 tx=0x7fa4d400fa60).stop 2019-11-28T11:52:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7fa4f1636700 1 -- 172.21.15.80:0/4197773958 shutdown_connections 2019-11-28T11:52:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7fa4f1636700 1 --2- 172.21.15.80:0/4197773958 >> v2:172.21.15.174:3300/0 conn(0x7fa4ec06ce60 0x7fa4ec164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.077+0000 7fa4f1636700 1 --2- 172.21.15.80:0/4197773958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4ec06c490 0x7fa4ec06c920 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:41.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.078+0000 7fa4f1636700 1 -- 172.21.15.80:0/4197773958 shutdown_connections 2019-11-28T11:52:41.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.078+0000 7fa4f1636700 1 -- 172.21.15.80:0/4197773958 wait complete. 2019-11-28T11:52:41.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.078+0000 7fa4f1636700 1 -- 172.21.15.80:0/4197773958 >> 172.21.15.80:0/4197773958 conn(0x7fa4ec061cf0 msgr2=0x7fa4ec064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:41.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.080+0000 7f2aa42e6700 1 Processor -- start 2019-11-28T11:52:41.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.080+0000 7f2aa42e6700 1 -- start start 2019-11-28T11:52:41.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f2aa42e6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c13dc00 0x7f2a9c109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:41.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f2aa42e6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2a9c10a3a0 0x7f2a9c108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:41.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f2aa42e6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a9c1312c0 con 0x7f2a9c109220 2019-11-28T11:52:41.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f2aa42e6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a9c104e00 con 0x7f2a9c10a3a0 2019-11-28T11:52:41.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f2aa42e6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c105830 con 0x7f2a9c13dc00 2019-11-28T11:52:41.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f2aa2883700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c13dc00 0x7f2a9c109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:41.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f2aa2883700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c13dc00 0x7f2a9c109e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:45596/0 (socket says 172.21.15.80:45596) 2019-11-28T11:52:41.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f2aa2883700 1 -- 172.21.15.80:0/1294519512 learned_addr learned my addr 172.21.15.80:0/1294519512 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:41.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f2aa2082700 1 --2- 172.21.15.80:0/1294519512 >> v2:172.21.15.80:3300/0 conn(0x7f2a9c10a3a0 0x7f2a9c108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:41.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f2aa2883700 1 -- 172.21.15.80:0/1294519512 >> v2:172.21.15.80:3300/0 conn(0x7f2a9c10a3a0 msgr2=0x7f2a9c108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:41.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f2aa2883700 1 --2- 172.21.15.80:0/1294519512 >> v2:172.21.15.80:3300/0 conn(0x7f2a9c10a3a0 0x7f2a9c108ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:41.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f2aa2883700 1 -- 172.21.15.80:0/1294519512 >> v1:172.21.15.80:6789/0 conn(0x7f2a9c109220 legacy=0x7f2a9c103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:41.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f2aa2883700 1 -- 172.21.15.80:0/1294519512 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9c106190 con 0x7f2a9c13dc00 2019-11-28T11:52:41.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f2aa2883700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c13dc00 0x7f2a9c109e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2a900107d0 tx=0x7f2a90010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f2aa2883700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c13dc00 0x7f2a9c109e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2a900107d0 tx=0x7f2a90010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f2aa2883700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c13dc00 0x7f2a9c109e60 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7f2a900107d0 tx=0x7f2a90010600).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:41.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f2aa2883700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c13dc00 0x7f2a9c109e60 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f2a900107d0 tx=0x7f2a90010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f2aa2883700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c13dc00 0x7f2a9c109e60 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f2a900107d0 tx=0x7f2a90010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f2aa2883700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c13dc00 0x7f2a9c109e60 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f2a900107d0 tx=0x7f2a90010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f2a9b7fe700 1 -- 172.21.15.80:0/1294519512 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a90000cc0 con 0x7f2a9c13dc00 2019-11-28T11:52:41.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f2a9b7fe700 1 -- 172.21.15.80:0/1294519512 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a90009af0 con 0x7f2a9c13dc00 2019-11-28T11:52:41.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f2a9b7fe700 1 -- 172.21.15.80:0/1294519512 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9000a180 con 0x7f2a9c13dc00 2019-11-28T11:52:41.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f2aa42e6700 1 -- 172.21.15.80:0/1294519512 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a9c106510 con 0x7f2a9c13dc00 2019-11-28T11:52:41.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f2aa42e6700 1 -- 172.21.15.80:0/1294519512 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a9c106190 con 0x7f2a9c13dc00 2019-11-28T11:52:41.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.083+0000 7f2aa2883700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c13dc00 0x7f2a9c109e60 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f2a900107d0 tx=0x7f2a90010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.083+0000 7f2a9b7fe700 1 -- 172.21.15.80:0/1294519512 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2a90009ce0 con 0x7f2a9c13dc00 2019-11-28T11:52:41.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.083+0000 7f2aa2883700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c13dc00 0x7f2a9c109e60 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f2a900107d0 tx=0x7f2a90010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.083+0000 7f2a9b7fe700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a84018730 0x7f2a8401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:41.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.083+0000 7f2a9b7fe700 1 -- 172.21.15.80:0/1294519512 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2a90031e50 con 0x7f2a9c13dc00 2019-11-28T11:52:41.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.083+0000 7f2aa2082700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a84018730 0x7f2a8401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:41.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.083+0000 7f2aa2082700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a84018730 0x7f2a8401abc0 crc :-1 s=READY pgs=929 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:41.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.089+0000 7f2aa42e6700 1 -- 172.21.15.80:0/1294519512 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9c106510 con 0x7f2a9c13dc00 2019-11-28T11:52:41.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.093+0000 7f2aa2883700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c13dc00 0x7f2a9c109e60 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f2a900107d0 tx=0x7f2a90010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.093+0000 7f2a9b7fe700 1 -- 172.21.15.80:0/1294519512 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2a90000cc0 con 0x7f2a9c13dc00 2019-11-28T11:52:41.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.080+0000 7f5016a63700 1 Processor -- start 2019-11-28T11:52:41.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.080+0000 7f5016a63700 1 -- start start 2019-11-28T11:52:41.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f5016a63700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f501013a780 0x7f501012d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:41.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f5016a63700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501012cb00 0x7f5010167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:41.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f5016a63700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5010139a60 con 0x7f501012d9c0 2019-11-28T11:52:41.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f5016a63700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501012a260 con 0x7f501013a780 2019-11-28T11:52:41.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f5016a63700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501012a530 con 0x7f501012cb00 2019-11-28T11:52:41.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f5015000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f501013a780 0x7f501012d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:41.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f500ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f501012d9c0 0x7f501012c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42666/0 (socket says 172.21.15.80:42666) 2019-11-28T11:52:41.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f500ffff700 1 -- 172.21.15.80:0/1715383879 learned_addr learned my addr 172.21.15.80:0/1715383879 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:41.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7f5015801700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501012cb00 0x7f5010167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:41.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f500d7fa700 1 -- 172.21.15.80:0/1715383879 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491265918 0 0) 0x7f4ffc007da0 con 0x7f501012d9c0 2019-11-28T11:52:41.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f5015801700 1 -- 172.21.15.80:0/1715383879 >> v2:172.21.15.80:3300/0 conn(0x7f501013a780 msgr2=0x7f501012d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:41.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f5015801700 1 --2- 172.21.15.80:0/1715383879 >> v2:172.21.15.80:3300/0 conn(0x7f501013a780 0x7f501012d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:41.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f5015801700 1 -- 172.21.15.80:0/1715383879 >> v1:172.21.15.80:6789/0 conn(0x7f501012d9c0 legacy=0x7f501012c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:41.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f5015801700 1 -- 172.21.15.80:0/1715383879 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501012abc0 con 0x7f501012cb00 2019-11-28T11:52:41.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f5015801700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501012cb00 0x7f5010167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5008010740 tx=0x7f5008010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f5015000700 1 --2- 172.21.15.80:0/1715383879 >> v2:172.21.15.80:3300/0 conn(0x7f501013a780 0x7f501012d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:41.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f5015801700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501012cb00 0x7f5010167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5008010740 tx=0x7f5008010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f5015801700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501012cb00 0x7f5010167d70 secure :-1 s=READY pgs=327 cs=0 l=1 rx=0x7f5008010740 tx=0x7f5008010ae0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:41.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f5015801700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501012cb00 0x7f5010167d70 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7f5008010740 tx=0x7f5008010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f500d7fa700 1 -- 172.21.15.80:0/1715383879 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f500800c110 con 0x7f501012cb00 2019-11-28T11:52:41.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f5015801700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501012cb00 0x7f5010167d70 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7f5008010740 tx=0x7f5008010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f5015801700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501012cb00 0x7f5010167d70 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7f5008010740 tx=0x7f5008010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f500d7fa700 1 -- 172.21.15.80:0/1715383879 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500800c310 con 0x7f501012cb00 2019-11-28T11:52:41.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f5016a63700 1 -- 172.21.15.80:0/1715383879 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501012af40 con 0x7f501012cb00 2019-11-28T11:52:41.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f500d7fa700 1 -- 172.21.15.80:0/1715383879 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f500800c9a0 con 0x7f501012cb00 2019-11-28T11:52:41.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7f5016a63700 1 -- 172.21.15.80:0/1715383879 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501012abc0 con 0x7f501012cb00 2019-11-28T11:52:41.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.083+0000 7f5015801700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501012cb00 0x7f5010167d70 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7f5008010740 tx=0x7f5008010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.083+0000 7f500d7fa700 1 -- 172.21.15.80:0/1715383879 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f500800c130 con 0x7f501012cb00 2019-11-28T11:52:41.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.083+0000 7f500d7fa700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ff0018730 0x7f4ff001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:41.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.084+0000 7f5015801700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501012cb00 0x7f5010167d70 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7f5008010740 tx=0x7f5008010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.084+0000 7f500d7fa700 1 -- 172.21.15.80:0/1715383879 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f500800bf00 con 0x7f501012cb00 2019-11-28T11:52:41.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.084+0000 7f5015000700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ff0018730 0x7f4ff001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:41.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.084+0000 7f5015000700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ff0018730 0x7f4ff001abc0 crc :-1 s=READY pgs=930 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:41.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.090+0000 7f5016a63700 1 -- 172.21.15.80:0/1715383879 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f501012af40 con 0x7f501012cb00 2019-11-28T11:52:41.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.096+0000 7f5015801700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501012cb00 0x7f5010167d70 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7f5008010740 tx=0x7f5008010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.097+0000 7f500d7fa700 1 -- 172.21.15.80:0/1715383879 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f500800bf00 con 0x7f501012cb00 2019-11-28T11:52:41.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.080+0000 7fa4f1636700 1 Processor -- start 2019-11-28T11:52:41.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.080+0000 7fa4f1636700 1 -- start start 2019-11-28T11:52:41.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7fa4f1636700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa4ec154870 0x7fa4ec154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:41.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7fa4f1636700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ec106b20 con 0x7fa4ec155240 2019-11-28T11:52:41.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7fa4f1636700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ec150f20 con 0x7fa4ec106670 2019-11-28T11:52:41.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7fa4f1636700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ec1527d0 con 0x7fa4ec154870 2019-11-28T11:52:41.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7fa4eb7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa4ec106670 0x7fa4ec1559f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58200/0 (socket says 172.21.15.80:58200) 2019-11-28T11:52:41.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7fa4eb7fe700 1 -- 172.21.15.80:0/4180774272 learned_addr learned my addr 172.21.15.80:0/4180774272 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:41.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4180774272 >> v2:172.21.15.174:3300/0 conn(0x7fa4ec154870 0x7fa4ec154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:41.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7fa4e3fff700 1 -- 172.21.15.80:0/4180774272 >> v1:172.21.15.174:6789/0 conn(0x7fa4ec106670 legacy=0x7fa4ec1559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:41.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7fa4e3fff700 1 -- 172.21.15.80:0/4180774272 >> v1:172.21.15.80:6789/0 conn(0x7fa4ec155240 legacy=0x7fa4ec14fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:41.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7fa4e8ff9700 1 -- 172.21.15.80:0/4180774272 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202741463 0 0) 0x7fa4e4001400 con 0x7fa4ec155240 2019-11-28T11:52:41.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7fa4e3fff700 1 -- 172.21.15.80:0/4180774272 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec153130 con 0x7fa4ec154870 2019-11-28T11:52:41.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.081+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4180774272 >> v2:172.21.15.174:3300/0 conn(0x7fa4ec154870 0x7fa4ec154d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4d4010350 tx=0x7fa4d40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4180774272 >> v2:172.21.15.174:3300/0 conn(0x7fa4ec154870 0x7fa4ec154d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4d4010350 tx=0x7fa4d40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ec154870 0x7fa4ec154d00 secure :-1 s=READY pgs=1354 cs=0 l=1 rx=0x7fa4d4010350 tx=0x7fa4d40106f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ec154870 0x7fa4ec154d00 secure :-1 s=THROTTLE_DONE pgs=1354 cs=0 l=1 rx=0x7fa4d4010350 tx=0x7fa4d40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7fa4e8ff9700 1 -- 172.21.15.80:0/4180774272 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d4007a10 con 0x7fa4ec154870 2019-11-28T11:52:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ec154870 0x7fa4ec154d00 secure :-1 s=THROTTLE_DONE pgs=1354 cs=0 l=1 rx=0x7fa4d4010350 tx=0x7fa4d40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ec154870 0x7fa4ec154d00 secure :-1 s=THROTTLE_DONE pgs=1354 cs=0 l=1 rx=0x7fa4d4010350 tx=0x7fa4d40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7fa4e8ff9700 1 -- 172.21.15.80:0/4180774272 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d4005580 con 0x7fa4ec154870 2019-11-28T11:52:41.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7fa4e8ff9700 1 -- 172.21.15.80:0/4180774272 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d4005c90 con 0x7fa4ec154870 2019-11-28T11:52:41.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7fa4f1636700 1 -- 172.21.15.80:0/4180774272 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ec1534b0 con 0x7fa4ec154870 2019-11-28T11:52:41.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7fa4f1636700 1 -- 172.21.15.80:0/4180774272 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ec153130 con 0x7fa4ec154870 2019-11-28T11:52:41.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.082+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ec154870 0x7fa4ec154d00 secure :-1 s=THROTTLE_DONE pgs=1354 cs=0 l=1 rx=0x7fa4d4010350 tx=0x7fa4d40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.083+0000 7fa4e8ff9700 1 -- 172.21.15.80:0/4180774272 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa4d4005770 con 0x7fa4ec154870 2019-11-28T11:52:41.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.083+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ec154870 0x7fa4ec154d00 secure :-1 s=THROTTLE_DONE pgs=1354 cs=0 l=1 rx=0x7fa4d4010350 tx=0x7fa4d40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.083+0000 7fa4e8ff9700 1 --2- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4d0018730 0x7fa4d001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:41.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.083+0000 7fa4e8ff9700 1 -- 172.21.15.80:0/4180774272 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa4d4031ab0 con 0x7fa4ec154870 2019-11-28T11:52:41.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.083+0000 7fa4eb7fe700 1 --2- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4d0018730 0x7fa4d001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:41.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.083+0000 7fa4eb7fe700 1 --2- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4d0018730 0x7fa4d001abc0 crc :-1 s=READY pgs=928 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:41.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.089+0000 7fa4f1636700 1 -- 172.21.15.80:0/4180774272 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ec1534b0 con 0x7fa4ec154870 2019-11-28T11:52:41.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.093+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ec154870 0x7fa4ec154d00 secure :-1 s=THROTTLE_DONE pgs=1354 cs=0 l=1 rx=0x7fa4d4010350 tx=0x7fa4d40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:41.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.093+0000 7fa4e8ff9700 1 -- 172.21.15.80:0/4180774272 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa4d4005180 con 0x7fa4ec154870 2019-11-28T11:52:41.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.280+0000 7fa4f1636700 1 -- 172.21.15.80:0/4180774272 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fa4ec153130 con 0x7fa4ec154870 2019-11-28T11:52:41.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.281+0000 7f2aa42e6700 1 -- 172.21.15.80:0/1294519512 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f2a9c106190 con 0x7f2a9c13dc00 2019-11-28T11:52:41.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:41.281+0000 7f5016a63700 1 -- 172.21.15.80:0/1715383879 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f501012abc0 con 0x7f501012cb00 2019-11-28T11:52:42.228 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:52:42.175+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:52:42.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.180+0000 7f5015801700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501012cb00 0x7f5010167d70 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7f5008010740 tx=0x7f5008010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.180+0000 7f500d7fa700 1 -- 172.21.15.80:0/1715383879 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7181 v141) v1 ==== 95+0+0 (secure 0 0 0) 0x7f500800c110 con 0x7f501012cb00 2019-11-28T11:52:42.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.180+0000 7f2aa2883700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c13dc00 0x7f2a9c109e60 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f2a900107d0 tx=0x7f2a90010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.180+0000 7f2a9b7fe700 1 -- 172.21.15.80:0/1294519512 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7184 v141) v1 ==== 95+0+0 (secure 0 0 0) 0x7f2a90009ce0 con 0x7f2a9c13dc00 2019-11-28T11:52:42.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.180+0000 7fa4e3fff700 1 --2- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ec154870 0x7fa4ec154d00 secure :-1 s=THROTTLE_DONE pgs=1354 cs=0 l=1 rx=0x7fa4d4010350 tx=0x7fa4d40106f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.180+0000 7fa4e8ff9700 1 -- 172.21.15.80:0/4180774272 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 10551 v141) v1 ==== 96+0+0 (secure 0 0 0) 0x7fa4d4005770 con 0x7fa4ec154870 2019-11-28T11:52:42.249 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 10551 2019-11-28T11:52:42.249 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 7184 2019-11-28T11:52:42.250 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 7181 2019-11-28T11:52:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7f2aa42e6700 1 -- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a84018730 msgr2=0x7f2a8401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:42.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7f2aa42e6700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a84018730 0x7f2a8401abc0 crc :-1 s=READY pgs=929 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7f2aa42e6700 1 -- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c13dc00 msgr2=0x7f2a9c109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:42.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7f2aa42e6700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c13dc00 0x7f2a9c109e60 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7f2a900107d0 tx=0x7f2a90010600).stop 2019-11-28T11:52:42.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7f2aa42e6700 1 -- 172.21.15.80:0/1294519512 shutdown_connections 2019-11-28T11:52:42.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7f2aa42e6700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a84018730 0x7f2a8401abc0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7f2aa42e6700 1 --2- 172.21.15.80:0/1294519512 >> v2:172.21.15.80:3300/0 conn(0x7f2a9c10a3a0 0x7f2a9c108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7f2aa42e6700 1 --2- 172.21.15.80:0/1294519512 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a9c13dc00 0x7f2a9c109e60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7f2aa42e6700 1 -- 172.21.15.80:0/1294519512 shutdown_connections 2019-11-28T11:52:42.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7f2aa42e6700 1 -- 172.21.15.80:0/1294519512 wait complete. 2019-11-28T11:52:42.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7f2aa42e6700 1 -- 172.21.15.80:0/1294519512 >> 172.21.15.80:0/1294519512 conn(0x7f2a9c11bfc0 msgr2=0x7f2a9c141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:42.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7fa4f1636700 1 -- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4d0018730 msgr2=0x7fa4d001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:42.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7fa4f1636700 1 --2- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4d0018730 0x7fa4d001abc0 crc :-1 s=READY pgs=928 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7fa4f1636700 1 -- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ec154870 msgr2=0x7fa4ec154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7fa4f1636700 1 --2- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ec154870 0x7fa4ec154d00 secure :-1 s=READY pgs=1354 cs=0 l=1 rx=0x7fa4d4010350 tx=0x7fa4d40106f0).stop 2019-11-28T11:52:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7fa4f1636700 1 -- 172.21.15.80:0/4180774272 shutdown_connections 2019-11-28T11:52:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7fa4f1636700 1 --2- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4ec154870 0x7fa4ec154d00 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7fa4f1636700 1 --2- 172.21.15.80:0/4180774272 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa4d0018730 0x7fa4d001abc0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7fa4f1636700 1 -- 172.21.15.80:0/4180774272 shutdown_connections 2019-11-28T11:52:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7fa4f1636700 1 -- 172.21.15.80:0/4180774272 wait complete. 2019-11-28T11:52:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.198+0000 7fa4f1636700 1 -- 172.21.15.80:0/4180774272 >> 172.21.15.80:0/4180774272 conn(0x7fa4ec07b730 msgr2=0x7fa4ec13f150 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.199+0000 7f5016a63700 1 -- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ff0018730 msgr2=0x7f4ff001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.199+0000 7f5016a63700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ff0018730 0x7f4ff001abc0 crc :-1 s=READY pgs=930 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.199+0000 7f5016a63700 1 -- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501012cb00 msgr2=0x7f5010167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.199+0000 7f5016a63700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501012cb00 0x7f5010167d70 secure :-1 s=READY pgs=327 cs=0 l=1 rx=0x7f5008010740 tx=0x7f5008010ae0).stop 2019-11-28T11:52:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.200+0000 7f5016a63700 1 -- 172.21.15.80:0/1715383879 shutdown_connections 2019-11-28T11:52:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.200+0000 7f5016a63700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ff0018730 0x7f4ff001abc0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.200+0000 7f5016a63700 1 --2- 172.21.15.80:0/1715383879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f501012cb00 0x7f5010167d70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.200+0000 7f5016a63700 1 --2- 172.21.15.80:0/1715383879 >> v2:172.21.15.80:3300/0 conn(0x7f501013a780 0x7f501012d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.200+0000 7f5016a63700 1 -- 172.21.15.80:0/1715383879 shutdown_connections 2019-11-28T11:52:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.200+0000 7f5016a63700 1 -- 172.21.15.80:0/1715383879 wait complete. 2019-11-28T11:52:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.200+0000 7f5016a63700 1 -- 172.21.15.80:0/1715383879 >> 172.21.15.80:0/1715383879 conn(0x7f5010127dc0 msgr2=0x7f5010141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:42.262 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:52:42.264 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:52:42.265 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:52:42.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:52:42.265 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:52:42.266 INFO:teuthology.orchestra.run.smithi076:> import glob 2019-11-28T11:52:42.266 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:52:42.266 INFO:teuthology.orchestra.run.smithi076:> import json 2019-11-28T11:52:42.266 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:52:42.266 INFO:teuthology.orchestra.run.smithi076:> def get_id_to_dir(): 2019-11-28T11:52:42.266 INFO:teuthology.orchestra.run.smithi076:> result = {} 2019-11-28T11:52:42.266 INFO:teuthology.orchestra.run.smithi076:> for dir in glob.glob("/sys/kernel/debug/ceph/*"): 2019-11-28T11:52:42.267 INFO:teuthology.orchestra.run.smithi076:> mds_sessions_lines = open(os.path.join(dir, "mds_sessions")).readlines() 2019-11-28T11:52:42.267 INFO:teuthology.orchestra.run.smithi076:> client_id = mds_sessions_lines[1].split()[1].strip('"'"'"'"'"') 2019-11-28T11:52:42.267 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:52:42.267 INFO:teuthology.orchestra.run.smithi076:> result[client_id] = dir 2019-11-28T11:52:42.267 INFO:teuthology.orchestra.run.smithi076:> return result 2019-11-28T11:52:42.267 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:52:42.267 INFO:teuthology.orchestra.run.smithi076:> print(json.dumps(get_id_to_dir())) 2019-11-28T11:52:42.267 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:52:42.391 INFO:teuthology.orchestra.run.smithi076.stdout:{"0": "/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client7229"} 2019-11-28T11:52:42.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:52:42.392 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:52:42.392 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:52:42.392 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:52:42.392 INFO:teuthology.orchestra.run.smithi076:> print(open(os.path.join("/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client7229", "mds_sessions")).read()) 2019-11-28T11:52:42.392 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:52:42.464 INFO:teuthology.orchestra.run.smithi076.stdout:global_id 7229 2019-11-28T11:52:42.464 INFO:teuthology.orchestra.run.smithi076.stdout:name "0" 2019-11-28T11:52:42.464 INFO:teuthology.orchestra.run.smithi076.stdout:mds.0 restarting 2019-11-28T11:52:42.464 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:52:42.465 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:52:42.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:52:42.465 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2019-11-28T11:52:42.540 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:52:42.545 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:52:42.581 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:52:42.581 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:52:42.582 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:52:42.582 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:52:42.583 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:52:42.583 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:52:42.587 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:52:42.587 DEBUG:teuthology.parallel:result is None 2019-11-28T11:52:42.588 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:52:42.588 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:52:42.589 DEBUG:teuthology.parallel:result is None 2019-11-28T11:52:42.589 DEBUG:teuthology.parallel:result is None 2019-11-28T11:52:42.589 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:42.672 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:52:42.679 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:52:42.679 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:52:42.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.660+0000 7fced502b700 1 Processor -- start 2019-11-28T11:52:42.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.660+0000 7fced502b700 1 -- start start 2019-11-28T11:52:42.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.661+0000 7fced502b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fced006c0a0 0x7fced0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:42.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.661+0000 7fced502b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fced0072620 0x7fced0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:42.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.661+0000 7fced502b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced006db00 con 0x7fced00734e0 2019-11-28T11:52:42.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.661+0000 7fced502b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced006f330 con 0x7fced0072620 2019-11-28T11:52:42.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.661+0000 7fced502b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced00706c0 con 0x7fced006c0a0 2019-11-28T11:52:42.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.661+0000 7fced482a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fced0072620 0x7fced0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:42.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.661+0000 7fceced9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fced00734e0 0x7fced0071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42704/0 (socket says 172.21.15.80:42704) 2019-11-28T11:52:42.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.661+0000 7fceced9d700 1 -- 172.21.15.80:0/1782996318 learned_addr learned my addr 172.21.15.80:0/1782996318 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:42.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.661+0000 7fcecf59e700 1 --2- 172.21.15.80:0/1782996318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fced006c0a0 0x7fced0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:42.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.662+0000 7fced482a700 1 -- 172.21.15.80:0/1782996318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fced006c0a0 msgr2=0x7fced0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:42.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.662+0000 7fced482a700 1 --2- 172.21.15.80:0/1782996318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fced006c0a0 0x7fced0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:42.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.662+0000 7fced482a700 1 -- 172.21.15.80:0/1782996318 >> v1:172.21.15.80:6789/0 conn(0x7fced00734e0 legacy=0x7fced0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:42.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.662+0000 7fced482a700 1 -- 172.21.15.80:0/1782996318 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced0070a40 con 0x7fced0072620 2019-11-28T11:52:42.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.662+0000 7fcece59c700 1 -- 172.21.15.80:0/1782996318 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245053156 0 0) 0x7fceb80013f0 con 0x7fced00734e0 2019-11-28T11:52:42.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.662+0000 7fced482a700 1 --2- 172.21.15.80:0/1782996318 >> v2:172.21.15.80:3300/0 conn(0x7fced0072620 0x7fced0164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcec800af50 tx=0x7fcec800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.662+0000 7fced482a700 1 --2- 172.21.15.80:0/1782996318 >> v2:172.21.15.80:3300/0 conn(0x7fced0072620 0x7fced0164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcec800af50 tx=0x7fcec800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.662+0000 7fced482a700 1 --2- 172.21.15.80:0/1782996318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced0072620 0x7fced0164d70 secure :-1 s=READY pgs=2270 cs=0 l=1 rx=0x7fcec800af50 tx=0x7fcec800b6e0).ready entity=mon.0 client_cookie=15e6561732a34169 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:42.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.662+0000 7fced482a700 1 --2- 172.21.15.80:0/1782996318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced0072620 0x7fced0164d70 secure :-1 s=THROTTLE_DONE pgs=2270 cs=0 l=1 rx=0x7fcec800af50 tx=0x7fcec800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.662+0000 7fcece59c700 1 -- 172.21.15.80:0/1782996318 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcec8009ba0 con 0x7fced0072620 2019-11-28T11:52:42.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.662+0000 7fced482a700 1 --2- 172.21.15.80:0/1782996318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced0072620 0x7fced0164d70 secure :-1 s=THROTTLE_DONE pgs=2270 cs=0 l=1 rx=0x7fcec800af50 tx=0x7fcec800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.662+0000 7fced482a700 1 --2- 172.21.15.80:0/1782996318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced0072620 0x7fced0164d70 secure :-1 s=THROTTLE_DONE pgs=2270 cs=0 l=1 rx=0x7fcec800af50 tx=0x7fcec800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.662+0000 7fcece59c700 1 -- 172.21.15.80:0/1782996318 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec80097c0 con 0x7fced0072620 2019-11-28T11:52:42.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.662+0000 7fcece59c700 1 -- 172.21.15.80:0/1782996318 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcec800a180 con 0x7fced0072620 2019-11-28T11:52:42.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.662+0000 7fced502b700 1 -- 172.21.15.80:0/1782996318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced0072620 msgr2=0x7fced0164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:42.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.662+0000 7fced502b700 1 --2- 172.21.15.80:0/1782996318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced0072620 0x7fced0164d70 secure :-1 s=READY pgs=2270 cs=0 l=1 rx=0x7fcec800af50 tx=0x7fcec800b6e0).stop 2019-11-28T11:52:42.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.663+0000 7fced502b700 1 -- 172.21.15.80:0/1782996318 shutdown_connections 2019-11-28T11:52:42.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.663+0000 7fced502b700 1 --2- 172.21.15.80:0/1782996318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced0072620 0x7fced0164d70 unknown :-1 s=CLOSED pgs=2270 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.663+0000 7fced502b700 1 --2- 172.21.15.80:0/1782996318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fced006c0a0 0x7fced0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:42.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.663+0000 7fced502b700 1 -- 172.21.15.80:0/1782996318 shutdown_connections 2019-11-28T11:52:42.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.663+0000 7fced502b700 1 -- 172.21.15.80:0/1782996318 wait complete. 2019-11-28T11:52:42.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.663+0000 7fced502b700 1 -- 172.21.15.80:0/1782996318 >> 172.21.15.80:0/1782996318 conn(0x7fced0061cf0 msgr2=0x7fced0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.665+0000 7fced502b700 1 Processor -- start 2019-11-28T11:52:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.665+0000 7fced502b700 1 -- start start 2019-11-28T11:52:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fced502b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fced013e5f0 0x7fced013e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fced502b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fced010a070 0x7fced010bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fced502b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fced010a4e0 0x7fced010c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fced502b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced010e060 con 0x7fced013e5f0 2019-11-28T11:52:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fced502b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced010e330 con 0x7fced010a4e0 2019-11-28T11:52:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fced502b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced010d630 con 0x7fced010a070 2019-11-28T11:52:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fcecf59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fced013e5f0 0x7fced013e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fcecf59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fced013e5f0 0x7fced013e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43390/0 (socket says 172.21.15.80:43390) 2019-11-28T11:52:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fcecf59e700 1 -- 172.21.15.80:0/3771997935 learned_addr learned my addr 172.21.15.80:0/3771997935 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fced482a700 1 --2- 172.21.15.80:0/3771997935 >> v2:172.21.15.174:3300/0 conn(0x7fced010a4e0 0x7fced010c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:42.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fceced9d700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fced010a070 0x7fced010bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:42.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fcecf59e700 1 -- 172.21.15.80:0/3771997935 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fced010a070 msgr2=0x7fced010bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:42.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fcecf59e700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fced010a070 0x7fced010bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fcecf59e700 1 -- 172.21.15.80:0/3771997935 >> v2:172.21.15.174:3300/0 conn(0x7fced010a4e0 msgr2=0x7fced010c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:42.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fcecf59e700 1 --2- 172.21.15.80:0/3771997935 >> v2:172.21.15.174:3300/0 conn(0x7fced010a4e0 0x7fced010c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fcecf59e700 1 -- 172.21.15.80:0/3771997935 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced010e9c0 con 0x7fced013e5f0 2019-11-28T11:52:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fced482a700 1 --2- 172.21.15.80:0/3771997935 >> v2:172.21.15.174:3300/0 conn(0x7fced010a4e0 0x7fced010c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:52:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.666+0000 7fcecf59e700 1 --2- 172.21.15.80:0/3771997935 >> v2:172.21.15.80:3300/0 conn(0x7fced013e5f0 0x7fced013e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcec0010450 tx=0x7fcec0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.667+0000 7fcecf59e700 1 --2- 172.21.15.80:0/3771997935 >> v2:172.21.15.80:3300/0 conn(0x7fced013e5f0 0x7fced013e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcec0010450 tx=0x7fcec0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.667+0000 7fcecf59e700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced013e5f0 0x7fced013e9e0 secure :-1 s=READY pgs=2271 cs=0 l=1 rx=0x7fcec0010450 tx=0x7fcec0010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.667+0000 7fcecf59e700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced013e5f0 0x7fced013e9e0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7fcec0010450 tx=0x7fcec0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.667+0000 7fcec7fff700 1 -- 172.21.15.80:0/3771997935 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcec0000940 con 0x7fced013e5f0 2019-11-28T11:52:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.667+0000 7fcecf59e700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced013e5f0 0x7fced013e9e0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7fcec0010450 tx=0x7fcec0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.667+0000 7fcecf59e700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced013e5f0 0x7fced013e9e0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7fcec0010450 tx=0x7fcec0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.667+0000 7fcec7fff700 1 -- 172.21.15.80:0/3771997935 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec0005370 con 0x7fced013e5f0 2019-11-28T11:52:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.667+0000 7fced502b700 1 -- 172.21.15.80:0/3771997935 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced010ed40 con 0x7fced013e5f0 2019-11-28T11:52:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.667+0000 7fcec7fff700 1 -- 172.21.15.80:0/3771997935 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcec0005a00 con 0x7fced013e5f0 2019-11-28T11:52:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.667+0000 7fced502b700 1 -- 172.21.15.80:0/3771997935 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced010e9c0 con 0x7fced013e5f0 2019-11-28T11:52:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.667+0000 7fcecf59e700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced013e5f0 0x7fced013e9e0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7fcec0010450 tx=0x7fcec0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.667+0000 7fcec7fff700 1 -- 172.21.15.80:0/3771997935 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcec0005560 con 0x7fced013e5f0 2019-11-28T11:52:42.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.667+0000 7fcecf59e700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced013e5f0 0x7fced013e9e0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7fcec0010450 tx=0x7fcec0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.667+0000 7fcec7fff700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcea8018730 0x7fcea801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:42.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.668+0000 7fcec7fff700 1 -- 172.21.15.80:0/3771997935 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fcec0031a80 con 0x7fced013e5f0 2019-11-28T11:52:42.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.668+0000 7fceced9d700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcea8018730 0x7fcea801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:42.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.668+0000 7fceced9d700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcea8018730 0x7fcea801abc0 crc :-1 s=READY pgs=931 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:42.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.675+0000 7fced502b700 1 -- 172.21.15.80:0/3771997935 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced010ed40 con 0x7fced013e5f0 2019-11-28T11:52:42.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.679+0000 7fcecf59e700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced013e5f0 0x7fced013e9e0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7fcec0010450 tx=0x7fcec0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.679+0000 7fcec7fff700 1 -- 172.21.15.80:0/3771997935 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcec0012c90 con 0x7fced013e5f0 2019-11-28T11:52:42.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.852+0000 7fced502b700 1 -- 172.21.15.80:0/3771997935 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fced010e9c0 con 0x7fced013e5f0 2019-11-28T11:52:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.853+0000 7fcecf59e700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced013e5f0 0x7fced013e9e0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7fcec0010450 tx=0x7fcec0010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.853+0000 7fcec7fff700 1 -- 172.21.15.80:0/3771997935 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) v1 ==== 95+0+1432 (secure 0 0 0) 0x7fcec0012c90 con 0x7fced013e5f0 2019-11-28T11:52:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 141 2019-11-28T11:52:42.907 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:42.908 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":141,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":141,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:42.176450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:42.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.855+0000 7fced502b700 1 -- 172.21.15.80:0/3771997935 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcea8018730 msgr2=0x7fcea801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:42.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.855+0000 7fced502b700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcea8018730 0x7fcea801abc0 crc :-1 s=READY pgs=931 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.855+0000 7fced502b700 1 -- 172.21.15.80:0/3771997935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced013e5f0 msgr2=0x7fced013e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.855+0000 7fced502b700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced013e5f0 0x7fced013e9e0 secure :-1 s=READY pgs=2271 cs=0 l=1 rx=0x7fcec0010450 tx=0x7fcec0010280).stop 2019-11-28T11:52:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.855+0000 7fced502b700 1 -- 172.21.15.80:0/3771997935 shutdown_connections 2019-11-28T11:52:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.855+0000 7fced502b700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcea8018730 0x7fcea801abc0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.855+0000 7fced502b700 1 --2- 172.21.15.80:0/3771997935 >> v2:172.21.15.174:3300/0 conn(0x7fced010a4e0 0x7fced010c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.855+0000 7fced502b700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fced010a070 0x7fced010bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.855+0000 7fced502b700 1 --2- 172.21.15.80:0/3771997935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fced013e5f0 0x7fced013e9e0 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:42.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.855+0000 7fced502b700 1 -- 172.21.15.80:0/3771997935 shutdown_connections 2019-11-28T11:52:42.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.856+0000 7fced502b700 1 -- 172.21.15.80:0/3771997935 wait complete. 2019-11-28T11:52:42.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:42.856+0000 7fced502b700 1 -- 172.21.15.80:0/3771997935 >> 172.21.15.80:0/3771997935 conn(0x7fced013d620 msgr2=0x7fced013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:42.919 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T11:52:43.920 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:44.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.988+0000 7f00c3793700 1 Processor -- start 2019-11-28T11:52:44.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.988+0000 7f00c3793700 1 -- start start 2019-11-28T11:52:44.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.989+0000 7f00c3793700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f00bc06c0a0 0x7f00bc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:44.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.989+0000 7f00c3793700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00bc0734e0 0x7f00bc071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:44.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.989+0000 7f00c3793700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f00bc072360 0x7f00bc072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.989+0000 7f00c3793700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00bc06fd60 con 0x7f00bc072360 2019-11-28T11:52:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.989+0000 7f00c3793700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00bc070030 con 0x7f00bc06c0a0 2019-11-28T11:52:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.989+0000 7f00c3793700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc06f330 con 0x7f00bc0734e0 2019-11-28T11:52:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c2531700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f00bc072360 0x7f00bc072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c2531700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f00bc072360 0x7f00bc072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43400/0 (socket says 172.21.15.80:43400) 2019-11-28T11:52:44.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c2531700 1 -- 172.21.15.80:0/46613989 learned_addr learned my addr 172.21.15.80:0/46613989 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:44.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c1d30700 1 --2- 172.21.15.80:0/46613989 >> v2:172.21.15.174:3300/0 conn(0x7f00bc06c0a0 0x7f00bc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:44.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c152f700 1 --2- 172.21.15.80:0/46613989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00bc0734e0 0x7f00bc071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:44.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c2531700 1 -- 172.21.15.80:0/46613989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00bc0734e0 msgr2=0x7f00bc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c2531700 1 --2- 172.21.15.80:0/46613989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00bc0734e0 0x7f00bc071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c2531700 1 -- 172.21.15.80:0/46613989 >> v2:172.21.15.174:3300/0 conn(0x7f00bc06c0a0 msgr2=0x7f00bc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c2531700 1 --2- 172.21.15.80:0/46613989 >> v2:172.21.15.174:3300/0 conn(0x7f00bc06c0a0 0x7f00bc072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c2531700 1 -- 172.21.15.80:0/46613989 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00bc0706c0 con 0x7f00bc072360 2019-11-28T11:52:44.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c1d30700 1 --2- 172.21.15.80:0/46613989 >> v2:172.21.15.174:3300/0 conn(0x7f00bc06c0a0 0x7f00bc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:52:44.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c2531700 1 --2- 172.21.15.80:0/46613989 >> v2:172.21.15.80:3300/0 conn(0x7f00bc072360 0x7f00bc072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f00b400f730 tx=0x7f00b4007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:44.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c2531700 1 --2- 172.21.15.80:0/46613989 >> v2:172.21.15.80:3300/0 conn(0x7f00bc072360 0x7f00bc072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f00b400f730 tx=0x7f00b4007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:44.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c2531700 1 --2- 172.21.15.80:0/46613989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc072360 0x7f00bc072800 secure :-1 s=READY pgs=2272 cs=0 l=1 rx=0x7f00b400f730 tx=0x7f00b4007d50).ready entity=mon.0 client_cookie=95fd8d341a8ed26d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:44.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c2531700 1 --2- 172.21.15.80:0/46613989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc072360 0x7f00bc072800 secure :-1 s=THROTTLE_DONE pgs=2272 cs=0 l=1 rx=0x7f00b400f730 tx=0x7f00b4007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:44.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c2531700 1 --2- 172.21.15.80:0/46613989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc072360 0x7f00bc072800 secure :-1 s=THROTTLE_DONE pgs=2272 cs=0 l=1 rx=0x7f00b400f730 tx=0x7f00b4007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:44.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c0d2e700 1 -- 172.21.15.80:0/46613989 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00b4000ba0 con 0x7f00bc072360 2019-11-28T11:52:44.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c2531700 1 --2- 172.21.15.80:0/46613989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc072360 0x7f00bc072800 secure :-1 s=THROTTLE_DONE pgs=2272 cs=0 l=1 rx=0x7f00b400f730 tx=0x7f00b4007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:44.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c0d2e700 1 -- 172.21.15.80:0/46613989 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b40010e0 con 0x7f00bc072360 2019-11-28T11:52:44.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c0d2e700 1 -- 172.21.15.80:0/46613989 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00b40017b0 con 0x7f00bc072360 2019-11-28T11:52:44.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c3793700 1 -- 172.21.15.80:0/46613989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc072360 msgr2=0x7f00bc072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:44.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.990+0000 7f00c3793700 1 --2- 172.21.15.80:0/46613989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc072360 0x7f00bc072800 secure :-1 s=READY pgs=2272 cs=0 l=1 rx=0x7f00b400f730 tx=0x7f00b4007d50).stop 2019-11-28T11:52:44.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.991+0000 7f00c3793700 1 -- 172.21.15.80:0/46613989 shutdown_connections 2019-11-28T11:52:44.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.991+0000 7f00c3793700 1 --2- 172.21.15.80:0/46613989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc072360 0x7f00bc072800 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:44.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.991+0000 7f00c3793700 1 --2- 172.21.15.80:0/46613989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00bc0734e0 0x7f00bc071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:44.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.991+0000 7f00c3793700 1 --2- 172.21.15.80:0/46613989 >> v2:172.21.15.174:3300/0 conn(0x7f00bc06c0a0 0x7f00bc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:44.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.991+0000 7f00c3793700 1 -- 172.21.15.80:0/46613989 shutdown_connections 2019-11-28T11:52:44.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.991+0000 7f00c3793700 1 -- 172.21.15.80:0/46613989 wait complete. 2019-11-28T11:52:44.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.991+0000 7f00c3793700 1 -- 172.21.15.80:0/46613989 >> 172.21.15.80:0/46613989 conn(0x7f00bc061cf0 msgr2=0x7f00bc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:44.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.994+0000 7f00c3793700 1 Processor -- start 2019-11-28T11:52:44.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.994+0000 7f00c3793700 1 -- start start 2019-11-28T11:52:44.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.994+0000 7f00c3793700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f00bc103000 0x7f00bc103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:44.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.994+0000 7f00c3793700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f00bc1039d0 0x7f00bc167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:44.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.994+0000 7f00c3793700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00bc1312c0 con 0x7f00bc13dc00 2019-11-28T11:52:44.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.994+0000 7f00c3793700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00bc105830 con 0x7f00bc1039d0 2019-11-28T11:52:44.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.994+0000 7f00c3793700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00bc105b00 con 0x7f00bc103000 2019-11-28T11:52:44.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00c1d30700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f00bc13dc00 0x7f00bc109e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42720/0 (socket says 172.21.15.80:42720) 2019-11-28T11:52:44.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00c1d30700 1 -- 172.21.15.80:0/3052724059 learned_addr learned my addr 172.21.15.80:0/3052724059 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:44.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00c2531700 1 --2- 172.21.15.80:0/3052724059 >> v2:172.21.15.80:3300/0 conn(0x7f00bc1039d0 0x7f00bc167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:44.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00ba7fc700 1 -- 172.21.15.80:0/3052724059 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784549530 0 0) 0x7f00a4001220 con 0x7f00bc13dc00 2019-11-28T11:52:44.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00c152f700 1 --2- 172.21.15.80:0/3052724059 >> v2:172.21.15.174:3300/0 conn(0x7f00bc103000 0x7f00bc103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:44.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00ba7fc700 1 -- 172.21.15.80:0/3052724059 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00a0002e80 con 0x7f00bc13dc00 2019-11-28T11:52:44.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00c2531700 1 -- 172.21.15.80:0/3052724059 >> v2:172.21.15.174:3300/0 conn(0x7f00bc103000 msgr2=0x7f00bc103490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:44.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00c2531700 1 --2- 172.21.15.80:0/3052724059 >> v2:172.21.15.174:3300/0 conn(0x7f00bc103000 0x7f00bc103490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:44.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00c2531700 1 -- 172.21.15.80:0/3052724059 >> v1:172.21.15.80:6789/0 conn(0x7f00bc13dc00 legacy=0x7f00bc109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:44.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00c2531700 1 -- 172.21.15.80:0/3052724059 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00bc106190 con 0x7f00bc1039d0 2019-11-28T11:52:44.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00c2531700 1 --2- 172.21.15.80:0/3052724059 >> v2:172.21.15.80:3300/0 conn(0x7f00bc1039d0 0x7f00bc167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00b4014730 tx=0x7f00b4014ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:44.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00c2531700 1 --2- 172.21.15.80:0/3052724059 >> v2:172.21.15.80:3300/0 conn(0x7f00bc1039d0 0x7f00bc167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00b4014730 tx=0x7f00b4014ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:44.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00c2531700 1 --2- 172.21.15.80:0/3052724059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc1039d0 0x7f00bc167a10 secure :-1 s=READY pgs=2274 cs=0 l=1 rx=0x7f00b4014730 tx=0x7f00b4014ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:44.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00c2531700 1 --2- 172.21.15.80:0/3052724059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc1039d0 0x7f00bc167a10 secure :-1 s=THROTTLE_DONE pgs=2274 cs=0 l=1 rx=0x7f00b4014730 tx=0x7f00b4014ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:44.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00c2531700 1 --2- 172.21.15.80:0/3052724059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc1039d0 0x7f00bc167a10 secure :-1 s=THROTTLE_DONE pgs=2274 cs=0 l=1 rx=0x7f00b4014730 tx=0x7f00b4014ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:44.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00ba7fc700 1 -- 172.21.15.80:0/3052724059 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00b4008180 con 0x7f00bc1039d0 2019-11-28T11:52:44.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00c2531700 1 --2- 172.21.15.80:0/3052724059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc1039d0 0x7f00bc167a10 secure :-1 s=THROTTLE_DONE pgs=2274 cs=0 l=1 rx=0x7f00b4014730 tx=0x7f00b4014ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:44.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00ba7fc700 1 -- 172.21.15.80:0/3052724059 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b40010c0 con 0x7f00bc1039d0 2019-11-28T11:52:44.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00c3793700 1 -- 172.21.15.80:0/3052724059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00bc106510 con 0x7f00bc1039d0 2019-11-28T11:52:44.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00ba7fc700 1 -- 172.21.15.80:0/3052724059 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00b4001790 con 0x7f00bc1039d0 2019-11-28T11:52:44.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.995+0000 7f00c3793700 1 -- 172.21.15.80:0/3052724059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00bc106190 con 0x7f00bc1039d0 2019-11-28T11:52:44.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.996+0000 7f00c2531700 1 --2- 172.21.15.80:0/3052724059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc1039d0 0x7f00bc167a10 secure :-1 s=THROTTLE_DONE pgs=2274 cs=0 l=1 rx=0x7f00b4014730 tx=0x7f00b4014ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:44.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.996+0000 7f00ba7fc700 1 -- 172.21.15.80:0/3052724059 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f00b40012b0 con 0x7f00bc1039d0 2019-11-28T11:52:44.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.996+0000 7f00c2531700 1 --2- 172.21.15.80:0/3052724059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc1039d0 0x7f00bc167a10 secure :-1 s=THROTTLE_DONE pgs=2274 cs=0 l=1 rx=0x7f00b4014730 tx=0x7f00b4014ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:44.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.996+0000 7f00ba7fc700 1 --2- 172.21.15.80:0/3052724059 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00a0018770 0x7f00a001ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:44.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.996+0000 7f00ba7fc700 1 -- 172.21.15.80:0/3052724059 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f00b4035f70 con 0x7f00bc1039d0 2019-11-28T11:52:44.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.996+0000 7f00c1d30700 1 --2- 172.21.15.80:0/3052724059 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00a0018770 0x7f00a001ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:44.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:43.996+0000 7f00c1d30700 1 --2- 172.21.15.80:0/3052724059 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00a0018770 0x7f00a001ac00 crc :-1 s=READY pgs=932 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:44.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.004+0000 7f00c3793700 1 -- 172.21.15.80:0/3052724059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00bc106510 con 0x7f00bc1039d0 2019-11-28T11:52:44.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.007+0000 7f00c2531700 1 --2- 172.21.15.80:0/3052724059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc1039d0 0x7f00bc167a10 secure :-1 s=THROTTLE_DONE pgs=2274 cs=0 l=1 rx=0x7f00b4014730 tx=0x7f00b4014ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:44.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.007+0000 7f00ba7fc700 1 -- 172.21.15.80:0/3052724059 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f00b4000eb0 con 0x7f00bc1039d0 2019-11-28T11:52:44.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.179+0000 7f00c3793700 1 -- 172.21.15.80:0/3052724059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00bc106190 con 0x7f00bc1039d0 2019-11-28T11:52:44.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.179+0000 7f00c2531700 1 --2- 172.21.15.80:0/3052724059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc1039d0 0x7f00bc167a10 secure :-1 s=THROTTLE_DONE pgs=2274 cs=0 l=1 rx=0x7f00b4014730 tx=0x7f00b4014ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:44.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.179+0000 7f00ba7fc700 1 -- 172.21.15.80:0/3052724059 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f00b40010c0 con 0x7f00bc1039d0 2019-11-28T11:52:44.241 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 141 2019-11-28T11:52:44.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.182+0000 7f00c3793700 1 -- 172.21.15.80:0/3052724059 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00a0018770 msgr2=0x7f00a001ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:44.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.182+0000 7f00c3793700 1 --2- 172.21.15.80:0/3052724059 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00a0018770 0x7f00a001ac00 crc :-1 s=READY pgs=932 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:44.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.182+0000 7f00c3793700 1 -- 172.21.15.80:0/3052724059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc1039d0 msgr2=0x7f00bc167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:44.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.182+0000 7f00c3793700 1 --2- 172.21.15.80:0/3052724059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc1039d0 0x7f00bc167a10 secure :-1 s=READY pgs=2274 cs=0 l=1 rx=0x7f00b4014730 tx=0x7f00b4014ad0).stop 2019-11-28T11:52:44.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.182+0000 7f00c3793700 1 -- 172.21.15.80:0/3052724059 shutdown_connections 2019-11-28T11:52:44.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.182+0000 7f00c3793700 1 --2- 172.21.15.80:0/3052724059 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00a0018770 0x7f00a001ac00 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:44.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.182+0000 7f00c3793700 1 --2- 172.21.15.80:0/3052724059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00bc1039d0 0x7f00bc167a10 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:44.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.182+0000 7f00c3793700 1 --2- 172.21.15.80:0/3052724059 >> v2:172.21.15.174:3300/0 conn(0x7f00bc103000 0x7f00bc103490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:44.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.182+0000 7f00c3793700 1 -- 172.21.15.80:0/3052724059 shutdown_connections 2019-11-28T11:52:44.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.182+0000 7f00c3793700 1 -- 172.21.15.80:0/3052724059 wait complete. 2019-11-28T11:52:44.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:44.182+0000 7f00c3793700 1 -- 172.21.15.80:0/3052724059 >> 172.21.15.80:0/3052724059 conn(0x7f00bc11bfc0 msgr2=0x7f00bc141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:44.243 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:44.244 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":141,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":141,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:42.176450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:44.246 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T11:52:45.232 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:52:45.238 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:52:45.243 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:52:45.247 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:45.248 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:52:45.252 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:52:45.257 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:52:45.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.324+0000 7f33ed5f9700 1 Processor -- start 2019-11-28T11:52:45.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.324+0000 7f33ed5f9700 1 -- start start 2019-11-28T11:52:45.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33ed5f9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f33e806c490 0x7f33e806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:45.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33ed5f9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e806db00 con 0x7f33e806ce60 2019-11-28T11:52:45.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33ed5f9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e806e000 con 0x7f33e806c0a0 2019-11-28T11:52:45.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33ed5f9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e806fd60 con 0x7f33e806c490 2019-11-28T11:52:45.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33e6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f33e806c490 0x7f33e806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:45.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33e6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f33e806c490 0x7f33e806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43416/0 (socket says 172.21.15.80:43416) 2019-11-28T11:52:45.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33e7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f33e806ce60 0x7f33e8164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42730/0 (socket says 172.21.15.80:42730) 2019-11-28T11:52:45.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33e6ffd700 1 -- 172.21.15.80:0/1528517712 learned_addr learned my addr 172.21.15.80:0/1528517712 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:45.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33e6ffd700 1 -- 172.21.15.80:0/1528517712 >> v1:172.21.15.174:6789/0 conn(0x7f33e806c0a0 legacy=0x7f33e8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:45.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33e6ffd700 1 -- 172.21.15.80:0/1528517712 >> v1:172.21.15.80:6789/0 conn(0x7f33e806ce60 legacy=0x7f33e8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:45.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33e6ffd700 1 -- 172.21.15.80:0/1528517712 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e80706c0 con 0x7f33e806c490 2019-11-28T11:52:45.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33e67fc700 1 -- 172.21.15.80:0/1528517712 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860691126 0 0) 0x7f33e0000d30 con 0x7f33e806ce60 2019-11-28T11:52:45.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/1528517712 >> v2:172.21.15.80:3300/0 conn(0x7f33e806c490 0x7f33e806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f33d800f740 tx=0x7f33d800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:45.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/1528517712 >> v2:172.21.15.80:3300/0 conn(0x7f33e806c490 0x7f33e806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f33d800f740 tx=0x7f33d800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:45.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/1528517712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e806c490 0x7f33e806c920 secure :-1 s=READY pgs=2276 cs=0 l=1 rx=0x7f33d800f740 tx=0x7f33d800fae0).ready entity=mon.0 client_cookie=c842b13703f9bcce server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:45.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/1528517712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e806c490 0x7f33e806c920 secure :-1 s=THROTTLE_DONE pgs=2276 cs=0 l=1 rx=0x7f33d800f740 tx=0x7f33d800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:45.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.325+0000 7f33e67fc700 1 -- 172.21.15.80:0/1528517712 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d8000960 con 0x7f33e806c490 2019-11-28T11:52:45.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.326+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/1528517712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e806c490 0x7f33e806c920 secure :-1 s=THROTTLE_DONE pgs=2276 cs=0 l=1 rx=0x7f33d800f740 tx=0x7f33d800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:45.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.326+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/1528517712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e806c490 0x7f33e806c920 secure :-1 s=THROTTLE_DONE pgs=2276 cs=0 l=1 rx=0x7f33d800f740 tx=0x7f33d800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:45.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.326+0000 7f33e67fc700 1 -- 172.21.15.80:0/1528517712 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d8000c90 con 0x7f33e806c490 2019-11-28T11:52:45.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.326+0000 7f33e67fc700 1 -- 172.21.15.80:0/1528517712 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d80013e0 con 0x7f33e806c490 2019-11-28T11:52:45.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.326+0000 7f33ed5f9700 1 -- 172.21.15.80:0/1528517712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e806c490 msgr2=0x7f33e806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.326+0000 7f33ed5f9700 1 --2- 172.21.15.80:0/1528517712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e806c490 0x7f33e806c920 secure :-1 s=READY pgs=2276 cs=0 l=1 rx=0x7f33d800f740 tx=0x7f33d800fae0).stop 2019-11-28T11:52:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.326+0000 7f33ed5f9700 1 -- 172.21.15.80:0/1528517712 shutdown_connections 2019-11-28T11:52:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.326+0000 7f33ed5f9700 1 --2- 172.21.15.80:0/1528517712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e806c490 0x7f33e806c920 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:45.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.326+0000 7f33ed5f9700 1 -- 172.21.15.80:0/1528517712 shutdown_connections 2019-11-28T11:52:45.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.326+0000 7f33ed5f9700 1 -- 172.21.15.80:0/1528517712 wait complete. 2019-11-28T11:52:45.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.326+0000 7f33ed5f9700 1 -- 172.21.15.80:0/1528517712 >> 172.21.15.80:0/1528517712 conn(0x7f33e8061cf0 msgr2=0x7f33e8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:45.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.329+0000 7f33ed5f9700 1 Processor -- start 2019-11-28T11:52:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.329+0000 7f33ed5f9700 1 -- start start 2019-11-28T11:52:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33ed5f9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e812cea0 0x7f33e8111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33ed5f9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f33e81230e0 0x7f33e8123570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:45.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33ed5f9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e8124260 con 0x7f33e8123ab0 2019-11-28T11:52:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33ed5f9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e8120610 con 0x7f33e81230e0 2019-11-28T11:52:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33ed5f9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8121040 con 0x7f33e812cea0 2019-11-28T11:52:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33e6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f33e81230e0 0x7f33e8123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:45.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33e7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f33e8123ab0 0x7f33e812d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42736/0 (socket says 172.21.15.80:42736) 2019-11-28T11:52:45.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33e7fff700 1 -- 172.21.15.80:0/3699992089 learned_addr learned my addr 172.21.15.80:0/3699992089 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:45.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33e77fe700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e812cea0 0x7f33e8111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:45.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33e6ffd700 1 -- 172.21.15.80:0/3699992089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e812cea0 msgr2=0x7f33e8111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:45.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e812cea0 0x7f33e8111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:45.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33dffff700 1 -- 172.21.15.80:0/3699992089 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71207434 0 0) 0x7f33e0001300 con 0x7f33e8123ab0 2019-11-28T11:52:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33e6ffd700 1 -- 172.21.15.80:0/3699992089 >> v1:172.21.15.80:6789/0 conn(0x7f33e8123ab0 legacy=0x7f33e812d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33e6ffd700 1 -- 172.21.15.80:0/3699992089 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e81219a0 con 0x7f33e81230e0 2019-11-28T11:52:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/3699992089 >> v2:172.21.15.80:3300/0 conn(0x7f33e81230e0 0x7f33e8123570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f33d8010210 tx=0x7f33d8012880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/3699992089 >> v2:172.21.15.80:3300/0 conn(0x7f33e81230e0 0x7f33e8123570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f33d8010210 tx=0x7f33d8012880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:45.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e81230e0 0x7f33e8123570 secure :-1 s=READY pgs=2278 cs=0 l=1 rx=0x7f33d8010210 tx=0x7f33d8012880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:45.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e81230e0 0x7f33e8123570 secure :-1 s=THROTTLE_DONE pgs=2278 cs=0 l=1 rx=0x7f33d8010210 tx=0x7f33d8012880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:45.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33dffff700 1 -- 172.21.15.80:0/3699992089 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d8000f50 con 0x7f33e81230e0 2019-11-28T11:52:45.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e81230e0 0x7f33e8123570 secure :-1 s=THROTTLE_DONE pgs=2278 cs=0 l=1 rx=0x7f33d8010210 tx=0x7f33d8012880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:45.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33dffff700 1 -- 172.21.15.80:0/3699992089 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d8000940 con 0x7f33e81230e0 2019-11-28T11:52:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e81230e0 0x7f33e8123570 secure :-1 s=THROTTLE_DONE pgs=2278 cs=0 l=1 rx=0x7f33d8010210 tx=0x7f33d8012880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33ed5f9700 1 -- 172.21.15.80:0/3699992089 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e8121d20 con 0x7f33e81230e0 2019-11-28T11:52:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33dffff700 1 -- 172.21.15.80:0/3699992089 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d8001140 con 0x7f33e81230e0 2019-11-28T11:52:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.330+0000 7f33ed5f9700 1 -- 172.21.15.80:0/3699992089 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e81122f0 con 0x7f33e81230e0 2019-11-28T11:52:45.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.331+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e81230e0 0x7f33e8123570 secure :-1 s=THROTTLE_DONE pgs=2278 cs=0 l=1 rx=0x7f33d8010210 tx=0x7f33d8012880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:45.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.331+0000 7f33dffff700 1 -- 172.21.15.80:0/3699992089 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f33d8000d60 con 0x7f33e81230e0 2019-11-28T11:52:45.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.331+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e81230e0 0x7f33e8123570 secure :-1 s=THROTTLE_DONE pgs=2278 cs=0 l=1 rx=0x7f33d8010210 tx=0x7f33d8012880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:45.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.331+0000 7f33dffff700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f33cc018730 0x7f33cc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:45.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.331+0000 7f33dffff700 1 -- 172.21.15.80:0/3699992089 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f33d8033be0 con 0x7f33e81230e0 2019-11-28T11:52:45.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.331+0000 7f33e77fe700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f33cc018730 0x7f33cc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:45.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.332+0000 7f33e77fe700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f33cc018730 0x7f33cc01abc0 crc :-1 s=READY pgs=933 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:45.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.339+0000 7f33ed5f9700 1 -- 172.21.15.80:0/3699992089 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e81219a0 con 0x7f33e81230e0 2019-11-28T11:52:45.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.342+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e81230e0 0x7f33e8123570 secure :-1 s=THROTTLE_DONE pgs=2278 cs=0 l=1 rx=0x7f33d8010210 tx=0x7f33d8012880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:45.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.342+0000 7f33dffff700 1 -- 172.21.15.80:0/3699992089 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f33d8000b30 con 0x7f33e81230e0 2019-11-28T11:52:45.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.519+0000 7f33ed5f9700 1 -- 172.21.15.80:0/3699992089 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33e8121d20 con 0x7f33e81230e0 2019-11-28T11:52:45.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.520+0000 7f33e6ffd700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e81230e0 0x7f33e8123570 secure :-1 s=THROTTLE_DONE pgs=2278 cs=0 l=1 rx=0x7f33d8010210 tx=0x7f33d8012880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:45.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.520+0000 7f33dffff700 1 -- 172.21.15.80:0/3699992089 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f33d8000d40 con 0x7f33e81230e0 2019-11-28T11:52:45.578 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 141 2019-11-28T11:52:45.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.522+0000 7f33ed5f9700 1 -- 172.21.15.80:0/3699992089 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f33cc018730 msgr2=0x7f33cc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:45.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.522+0000 7f33ed5f9700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f33cc018730 0x7f33cc01abc0 crc :-1 s=READY pgs=933 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:45.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.522+0000 7f33ed5f9700 1 -- 172.21.15.80:0/3699992089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e81230e0 msgr2=0x7f33e8123570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:45.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.522+0000 7f33ed5f9700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e81230e0 0x7f33e8123570 secure :-1 s=READY pgs=2278 cs=0 l=1 rx=0x7f33d8010210 tx=0x7f33d8012880).stop 2019-11-28T11:52:45.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.522+0000 7f33ed5f9700 1 -- 172.21.15.80:0/3699992089 shutdown_connections 2019-11-28T11:52:45.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.522+0000 7f33ed5f9700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f33cc018730 0x7f33cc01abc0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:45.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.522+0000 7f33ed5f9700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33e81230e0 0x7f33e8123570 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:45.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.522+0000 7f33ed5f9700 1 --2- 172.21.15.80:0/3699992089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e812cea0 0x7f33e8111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:45.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.523+0000 7f33ed5f9700 1 -- 172.21.15.80:0/3699992089 shutdown_connections 2019-11-28T11:52:45.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.523+0000 7f33ed5f9700 1 -- 172.21.15.80:0/3699992089 wait complete. 2019-11-28T11:52:45.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:45.523+0000 7f33ed5f9700 1 -- 172.21.15.80:0/3699992089 >> 172.21.15.80:0/3699992089 conn(0x7f33e81426c0 msgr2=0x7f33e8110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:45.580 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:45.580 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":141,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":141,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:42.176450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:45.586 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T11:52:46.587 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:46.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.654+0000 7f7a53fb5700 1 Processor -- start 2019-11-28T11:52:46.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.654+0000 7f7a53fb5700 1 -- start start 2019-11-28T11:52:46.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.655+0000 7f7a53fb5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7a4c06c0a0 0x7f7a4c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:46.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.655+0000 7f7a53fb5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7a4c072620 0x7f7a4c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:46.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.655+0000 7f7a53fb5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c06db00 con 0x7f7a4c0734e0 2019-11-28T11:52:46.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.655+0000 7f7a53fb5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c06fd60 con 0x7f7a4c072620 2019-11-28T11:52:46.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.655+0000 7f7a53fb5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c070030 con 0x7f7a4c06c0a0 2019-11-28T11:52:46.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.655+0000 7f7a52d53700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7a4c072620 0x7f7a4c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:46.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.655+0000 7f7a52d53700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7a4c072620 0x7f7a4c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43428/0 (socket says 172.21.15.80:43428) 2019-11-28T11:52:46.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.655+0000 7f7a52d53700 1 -- 172.21.15.80:0/3190876775 learned_addr learned my addr 172.21.15.80:0/3190876775 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:46.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.655+0000 7f7a52552700 1 --2- 172.21.15.80:0/3190876775 >> v2:172.21.15.174:3300/0 conn(0x7f7a4c06c0a0 0x7f7a4c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:46.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.656+0000 7f7a52d53700 1 -- 172.21.15.80:0/3190876775 >> v2:172.21.15.174:3300/0 conn(0x7f7a4c06c0a0 msgr2=0x7f7a4c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:46.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.656+0000 7f7a52d53700 1 --2- 172.21.15.80:0/3190876775 >> v2:172.21.15.174:3300/0 conn(0x7f7a4c06c0a0 0x7f7a4c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:46.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.656+0000 7f7a52d53700 1 -- 172.21.15.80:0/3190876775 >> v1:172.21.15.174:6789/0 conn(0x7f7a4c0734e0 legacy=0x7f7a4c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:46.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.656+0000 7f7a52d53700 1 -- 172.21.15.80:0/3190876775 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0706c0 con 0x7f7a4c072620 2019-11-28T11:52:46.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.656+0000 7f7a52d53700 1 --2- 172.21.15.80:0/3190876775 >> v2:172.21.15.80:3300/0 conn(0x7f7a4c072620 0x7f7a4c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7a4400f6b0 tx=0x7f7a4400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:46.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.656+0000 7f7a52d53700 1 --2- 172.21.15.80:0/3190876775 >> v2:172.21.15.80:3300/0 conn(0x7f7a4c072620 0x7f7a4c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7a4400f6b0 tx=0x7f7a4400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:46.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.656+0000 7f7a52d53700 1 --2- 172.21.15.80:0/3190876775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a4c072620 0x7f7a4c164d70 secure :-1 s=READY pgs=2279 cs=0 l=1 rx=0x7f7a4400f6b0 tx=0x7f7a4400fa50).ready entity=mon.0 client_cookie=88f69e41ca479b77 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:46.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.656+0000 7f7a52d53700 1 --2- 172.21.15.80:0/3190876775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a4c072620 0x7f7a4c164d70 secure :-1 s=THROTTLE_DONE pgs=2279 cs=0 l=1 rx=0x7f7a4400f6b0 tx=0x7f7a4400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:46.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.656+0000 7f7a51550700 1 -- 172.21.15.80:0/3190876775 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a44000a70 con 0x7f7a4c072620 2019-11-28T11:52:46.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.656+0000 7f7a52d53700 1 --2- 172.21.15.80:0/3190876775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a4c072620 0x7f7a4c164d70 secure :-1 s=THROTTLE_DONE pgs=2279 cs=0 l=1 rx=0x7f7a4400f6b0 tx=0x7f7a4400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:46.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.656+0000 7f7a52d53700 1 --2- 172.21.15.80:0/3190876775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a4c072620 0x7f7a4c164d70 secure :-1 s=THROTTLE_DONE pgs=2279 cs=0 l=1 rx=0x7f7a4400f6b0 tx=0x7f7a4400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:46.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.656+0000 7f7a51550700 1 -- 172.21.15.80:0/3190876775 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a440010e0 con 0x7f7a4c072620 2019-11-28T11:52:46.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.656+0000 7f7a51550700 1 -- 172.21.15.80:0/3190876775 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a440017b0 con 0x7f7a4c072620 2019-11-28T11:52:46.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.656+0000 7f7a53fb5700 1 -- 172.21.15.80:0/3190876775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a4c072620 msgr2=0x7f7a4c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.656+0000 7f7a53fb5700 1 --2- 172.21.15.80:0/3190876775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a4c072620 0x7f7a4c164d70 secure :-1 s=READY pgs=2279 cs=0 l=1 rx=0x7f7a4400f6b0 tx=0x7f7a4400fa50).stop 2019-11-28T11:52:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.657+0000 7f7a53fb5700 1 -- 172.21.15.80:0/3190876775 shutdown_connections 2019-11-28T11:52:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.657+0000 7f7a53fb5700 1 --2- 172.21.15.80:0/3190876775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a4c072620 0x7f7a4c164d70 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.657+0000 7f7a53fb5700 1 --2- 172.21.15.80:0/3190876775 >> v2:172.21.15.174:3300/0 conn(0x7f7a4c06c0a0 0x7f7a4c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.657+0000 7f7a53fb5700 1 -- 172.21.15.80:0/3190876775 shutdown_connections 2019-11-28T11:52:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.657+0000 7f7a53fb5700 1 -- 172.21.15.80:0/3190876775 wait complete. 2019-11-28T11:52:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.657+0000 7f7a53fb5700 1 -- 172.21.15.80:0/3190876775 >> 172.21.15.80:0/3190876775 conn(0x7f7a4c061cf0 msgr2=0x7f7a4c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.659+0000 7f7a53fb5700 1 Processor -- start 2019-11-28T11:52:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.659+0000 7f7a53fb5700 1 -- start start 2019-11-28T11:52:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.660+0000 7f7a53fb5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7a4c104820 0x7f7a4c10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.660+0000 7f7a53fb5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a4c10b9d0 0x7f7a4c167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.660+0000 7f7a53fb5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c13bcd0 con 0x7f7a4c10c890 2019-11-28T11:52:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.660+0000 7f7a53fb5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c109130 con 0x7f7a4c104820 2019-11-28T11:52:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.660+0000 7f7a53fb5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c109400 con 0x7f7a4c10b9d0 2019-11-28T11:52:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.660+0000 7f7a52552700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7a4c104820 0x7f7a4c10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.660+0000 7f7a52d53700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a4c10b9d0 0x7f7a4c167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.660+0000 7f7a52552700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7a4c104820 0x7f7a4c10c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:58318/0 (socket says 172.21.15.80:58318) 2019-11-28T11:52:46.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.660+0000 7f7a52552700 1 -- 172.21.15.80:0/3738984124 learned_addr learned my addr 172.21.15.80:0/3738984124 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:46.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.660+0000 7f7a51d51700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f7a4c10c890 0x7f7a4c10b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58294/0 (socket says 172.21.15.80:58294) 2019-11-28T11:52:46.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a52552700 1 -- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a4c10b9d0 msgr2=0x7f7a4c167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:46.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a52552700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a4c10b9d0 0x7f7a4c167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:46.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a52552700 1 -- 172.21.15.80:0/3738984124 >> v1:172.21.15.174:6789/0 conn(0x7f7a4c10c890 legacy=0x7f7a4c10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:46.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a4affd700 1 -- 172.21.15.80:0/3738984124 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26321476 0 0) 0x7f7a3c0013a0 con 0x7f7a4c10c890 2019-11-28T11:52:46.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a52552700 1 -- 172.21.15.80:0/3738984124 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c109a90 con 0x7f7a4c104820 2019-11-28T11:52:46.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a52d53700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a4c10b9d0 0x7f7a4c167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:46.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a52552700 1 --2- 172.21.15.80:0/3738984124 >> v2:172.21.15.174:3300/0 conn(0x7f7a4c104820 0x7f7a4c10c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7a34010450 tx=0x7f7a340107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:46.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a52552700 1 --2- 172.21.15.80:0/3738984124 >> v2:172.21.15.174:3300/0 conn(0x7f7a4c104820 0x7f7a4c10c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7a34010450 tx=0x7f7a340107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:46.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a52552700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c104820 0x7f7a4c10c350 secure :-1 s=READY pgs=1365 cs=0 l=1 rx=0x7f7a34010450 tx=0x7f7a340107f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:46.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a52552700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c104820 0x7f7a4c10c350 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f7a34010450 tx=0x7f7a340107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:46.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a4affd700 1 -- 172.21.15.80:0/3738984124 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a34000940 con 0x7f7a4c104820 2019-11-28T11:52:46.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a52552700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c104820 0x7f7a4c10c350 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f7a34010450 tx=0x7f7a340107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:46.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a53fb5700 1 -- 172.21.15.80:0/3738984124 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4c109e10 con 0x7f7a4c104820 2019-11-28T11:52:46.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a4affd700 1 -- 172.21.15.80:0/3738984124 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a34000940 con 0x7f7a4c104820 2019-11-28T11:52:46.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a52552700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c104820 0x7f7a4c10c350 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f7a34010450 tx=0x7f7a340107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:46.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a4affd700 1 -- 172.21.15.80:0/3738984124 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a34008ae0 con 0x7f7a4c104820 2019-11-28T11:52:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a53fb5700 1 -- 172.21.15.80:0/3738984124 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4c109a90 con 0x7f7a4c104820 2019-11-28T11:52:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.661+0000 7f7a52552700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c104820 0x7f7a4c10c350 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f7a34010450 tx=0x7f7a340107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.662+0000 7f7a4affd700 1 -- 172.21.15.80:0/3738984124 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7a34009240 con 0x7f7a4c104820 2019-11-28T11:52:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.662+0000 7f7a52552700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c104820 0x7f7a4c10c350 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f7a34010450 tx=0x7f7a340107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.662+0000 7f7a4affd700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7a30018730 0x7f7a3001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.662+0000 7f7a4affd700 1 -- 172.21.15.80:0/3738984124 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f7a34031ac0 con 0x7f7a4c104820 2019-11-28T11:52:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.662+0000 7f7a51d51700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7a30018730 0x7f7a3001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:46.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.662+0000 7f7a51d51700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7a30018730 0x7f7a3001abc0 crc :-1 s=READY pgs=934 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:46.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.669+0000 7f7a53fb5700 1 -- 172.21.15.80:0/3738984124 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c109e10 con 0x7f7a4c104820 2019-11-28T11:52:46.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.673+0000 7f7a52552700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c104820 0x7f7a4c10c350 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f7a34010450 tx=0x7f7a340107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:46.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.673+0000 7f7a4affd700 1 -- 172.21.15.80:0/3738984124 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7a34009030 con 0x7f7a4c104820 2019-11-28T11:52:46.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.849+0000 7f7a53fb5700 1 -- 172.21.15.80:0/3738984124 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a4c109a90 con 0x7f7a4c104820 2019-11-28T11:52:46.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.851+0000 7f7a52552700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c104820 0x7f7a4c10c350 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f7a34010450 tx=0x7f7a340107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:46.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.851+0000 7f7a4affd700 1 -- 172.21.15.80:0/3738984124 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 142 v142) v1 ==== 95+0+2453 (secure 0 0 0) 0x7f7a34009240 con 0x7f7a4c104820 2019-11-28T11:52:46.904 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 142 2019-11-28T11:52:46.904 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:46.904 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":142,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":142,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:46.760459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:replay","state_seq":2,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:46.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.852+0000 7f7a53fb5700 1 -- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7a30018730 msgr2=0x7f7a3001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:46.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.852+0000 7f7a53fb5700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7a30018730 0x7f7a3001abc0 crc :-1 s=READY pgs=934 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:46.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.852+0000 7f7a53fb5700 1 -- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c104820 msgr2=0x7f7a4c10c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:46.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.852+0000 7f7a53fb5700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c104820 0x7f7a4c10c350 secure :-1 s=READY pgs=1365 cs=0 l=1 rx=0x7f7a34010450 tx=0x7f7a340107f0).stop 2019-11-28T11:52:46.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.852+0000 7f7a53fb5700 1 -- 172.21.15.80:0/3738984124 shutdown_connections 2019-11-28T11:52:46.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.852+0000 7f7a53fb5700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a4c10b9d0 0x7f7a4c167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:46.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.852+0000 7f7a53fb5700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7a30018730 0x7f7a3001abc0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:46.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.852+0000 7f7a53fb5700 1 --2- 172.21.15.80:0/3738984124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c104820 0x7f7a4c10c350 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.852+0000 7f7a53fb5700 1 -- 172.21.15.80:0/3738984124 shutdown_connections 2019-11-28T11:52:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.852+0000 7f7a53fb5700 1 -- 172.21.15.80:0/3738984124 wait complete. 2019-11-28T11:52:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:46.852+0000 7f7a53fb5700 1 -- 172.21.15.80:0/3738984124 >> 172.21.15.80:0/3738984124 conn(0x7f7a4c13d620 msgr2=0x7f7a4c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:46.916 INFO:tasks.cephfs.filesystem:mapped states [u'up:replay'] to None 2019-11-28T11:52:47.917 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.982+0000 7f3efd129700 1 Processor -- start 2019-11-28T11:52:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.982+0000 7f3efd129700 1 -- start start 2019-11-28T11:52:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.983+0000 7f3efd129700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3ef806c0a0 0x7f3ef8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.983+0000 7f3efd129700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ef80734e0 0x7f3ef8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.983+0000 7f3efd129700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef806db00 con 0x7f3ef8072360 2019-11-28T11:52:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.983+0000 7f3efd129700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef806fd60 con 0x7f3ef80734e0 2019-11-28T11:52:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.983+0000 7f3efd129700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef8070030 con 0x7f3ef806c0a0 2019-11-28T11:52:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.983+0000 7f3ef6d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ef80734e0 0x7f3ef8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.983+0000 7f3ef759e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3ef806c0a0 0x7f3ef8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.983+0000 7f3ef6d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ef80734e0 0x7f3ef8071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43462/0 (socket says 172.21.15.80:43462) 2019-11-28T11:52:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.983+0000 7f3efc928700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f3ef8072360 0x7f3ef806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58320/0 (socket says 172.21.15.80:58320) 2019-11-28T11:52:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.983+0000 7f3ef6d9d700 1 -- 172.21.15.80:0/882870343 learned_addr learned my addr 172.21.15.80:0/882870343 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3ef6d9d700 1 -- 172.21.15.80:0/882870343 >> v2:172.21.15.174:3300/0 conn(0x7f3ef806c0a0 msgr2=0x7f3ef8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/882870343 >> v2:172.21.15.174:3300/0 conn(0x7f3ef806c0a0 0x7f3ef8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3ef6d9d700 1 -- 172.21.15.80:0/882870343 >> v1:172.21.15.174:6789/0 conn(0x7f3ef8072360 legacy=0x7f3ef806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:48.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3ef6d9d700 1 -- 172.21.15.80:0/882870343 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80706c0 con 0x7f3ef80734e0 2019-11-28T11:52:48.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3ef659c700 1 -- 172.21.15.80:0/882870343 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655621419 0 0) 0x7f3ef00009b0 con 0x7f3ef8072360 2019-11-28T11:52:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3ef759e700 1 --2- 172.21.15.80:0/882870343 >> v2:172.21.15.174:3300/0 conn(0x7f3ef806c0a0 0x7f3ef8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/882870343 >> v2:172.21.15.80:3300/0 conn(0x7f3ef80734e0 0x7f3ef8071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3ee000fac0 tx=0x7f3ee000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/882870343 >> v2:172.21.15.80:3300/0 conn(0x7f3ef80734e0 0x7f3ef8071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3ee000fac0 tx=0x7f3ee000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/882870343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef80734e0 0x7f3ef8071e20 secure :-1 s=READY pgs=2280 cs=0 l=1 rx=0x7f3ee000fac0 tx=0x7f3ee000fe60).ready entity=mon.0 client_cookie=1cdc2aa88178ed76 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/882870343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef80734e0 0x7f3ef8071e20 secure :-1 s=THROTTLE_DONE pgs=2280 cs=0 l=1 rx=0x7f3ee000fac0 tx=0x7f3ee000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3ef659c700 1 -- 172.21.15.80:0/882870343 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee0000ce0 con 0x7f3ef80734e0 2019-11-28T11:52:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/882870343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef80734e0 0x7f3ef8071e20 secure :-1 s=THROTTLE_DONE pgs=2280 cs=0 l=1 rx=0x7f3ee000fac0 tx=0x7f3ee000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/882870343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef80734e0 0x7f3ef8071e20 secure :-1 s=THROTTLE_DONE pgs=2280 cs=0 l=1 rx=0x7f3ee000fac0 tx=0x7f3ee000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3ef659c700 1 -- 172.21.15.80:0/882870343 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee0001010 con 0x7f3ef80734e0 2019-11-28T11:52:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3ef659c700 1 -- 172.21.15.80:0/882870343 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee0001720 con 0x7f3ef80734e0 2019-11-28T11:52:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3efd129700 1 -- 172.21.15.80:0/882870343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef80734e0 msgr2=0x7f3ef8071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.984+0000 7f3efd129700 1 --2- 172.21.15.80:0/882870343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef80734e0 0x7f3ef8071e20 secure :-1 s=READY pgs=2280 cs=0 l=1 rx=0x7f3ee000fac0 tx=0x7f3ee000fe60).stop 2019-11-28T11:52:48.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.985+0000 7f3efd129700 1 -- 172.21.15.80:0/882870343 shutdown_connections 2019-11-28T11:52:48.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.985+0000 7f3efd129700 1 --2- 172.21.15.80:0/882870343 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef80734e0 0x7f3ef8071e20 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:48.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.985+0000 7f3efd129700 1 --2- 172.21.15.80:0/882870343 >> v2:172.21.15.174:3300/0 conn(0x7f3ef806c0a0 0x7f3ef8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.985+0000 7f3efd129700 1 -- 172.21.15.80:0/882870343 shutdown_connections 2019-11-28T11:52:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.985+0000 7f3efd129700 1 -- 172.21.15.80:0/882870343 wait complete. 2019-11-28T11:52:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.985+0000 7f3efd129700 1 -- 172.21.15.80:0/882870343 >> 172.21.15.80:0/882870343 conn(0x7f3ef8061cf0 msgr2=0x7f3ef8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.987+0000 7f3efd129700 1 Processor -- start 2019-11-28T11:52:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.987+0000 7f3efd129700 1 -- start start 2019-11-28T11:52:48.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.988+0000 7f3efd129700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef813a780 0x7f3ef812d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:48.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.988+0000 7f3efd129700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ef812d9c0 0x7f3ef812c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:48.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.988+0000 7f3efd129700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef8139a60 con 0x7f3ef812c840 2019-11-28T11:52:48.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.988+0000 7f3efd129700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef8129830 con 0x7f3ef812d9c0 2019-11-28T11:52:48.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.988+0000 7f3efd129700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef812a260 con 0x7f3ef813a780 2019-11-28T11:52:48.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.988+0000 7f3ef6d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ef812d9c0 0x7f3ef812c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:48.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.988+0000 7f3efc928700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3ef812c840 0x7f3ef81281b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42782/0 (socket says 172.21.15.80:42782) 2019-11-28T11:52:48.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.988+0000 7f3efc928700 1 -- 172.21.15.80:0/2578973009 learned_addr learned my addr 172.21.15.80:0/2578973009 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:48.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.988+0000 7f3ef759e700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef813a780 0x7f3ef812d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:48.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3ef6d9d700 1 -- 172.21.15.80:0/2578973009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef813a780 msgr2=0x7f3ef812d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:48.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef813a780 0x7f3ef812d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:48.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3ef6d9d700 1 -- 172.21.15.80:0/2578973009 >> v1:172.21.15.80:6789/0 conn(0x7f3ef812c840 legacy=0x7f3ef81281b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:48.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3ef6d9d700 1 -- 172.21.15.80:0/2578973009 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef812abc0 con 0x7f3ef812d9c0 2019-11-28T11:52:48.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3eeffff700 1 -- 172.21.15.80:0/2578973009 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857471329 0 0) 0x7f3ef0001290 con 0x7f3ef812c840 2019-11-28T11:52:48.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/2578973009 >> v2:172.21.15.80:3300/0 conn(0x7f3ef812d9c0 0x7f3ef812c300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ee0054770 tx=0x7f3ee0010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/2578973009 >> v2:172.21.15.80:3300/0 conn(0x7f3ef812d9c0 0x7f3ef812c300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ee0054770 tx=0x7f3ee0010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef812d9c0 0x7f3ef812c300 secure :-1 s=READY pgs=2282 cs=0 l=1 rx=0x7f3ee0054770 tx=0x7f3ee0010160).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:48.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef812d9c0 0x7f3ef812c300 secure :-1 s=THROTTLE_DONE pgs=2282 cs=0 l=1 rx=0x7f3ee0054770 tx=0x7f3ee0010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3eeffff700 1 -- 172.21.15.80:0/2578973009 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee0005900 con 0x7f3ef812d9c0 2019-11-28T11:52:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef812d9c0 0x7f3ef812c300 secure :-1 s=THROTTLE_DONE pgs=2282 cs=0 l=1 rx=0x7f3ee0054770 tx=0x7f3ee0010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef812d9c0 0x7f3ef812c300 secure :-1 s=THROTTLE_DONE pgs=2282 cs=0 l=1 rx=0x7f3ee0054770 tx=0x7f3ee0010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3eeffff700 1 -- 172.21.15.80:0/2578973009 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee0008160 con 0x7f3ef812d9c0 2019-11-28T11:52:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3efd129700 1 -- 172.21.15.80:0/2578973009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef812af40 con 0x7f3ef812d9c0 2019-11-28T11:52:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3eeffff700 1 -- 172.21.15.80:0/2578973009 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee0005ee0 con 0x7f3ef812d9c0 2019-11-28T11:52:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3efd129700 1 -- 172.21.15.80:0/2578973009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef812abc0 con 0x7f3ef812d9c0 2019-11-28T11:52:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.989+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef812d9c0 0x7f3ef812c300 secure :-1 s=THROTTLE_DONE pgs=2282 cs=0 l=1 rx=0x7f3ee0054770 tx=0x7f3ee0010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.990+0000 7f3eeffff700 1 -- 172.21.15.80:0/2578973009 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3ee0005710 con 0x7f3ef812d9c0 2019-11-28T11:52:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.990+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef812d9c0 0x7f3ef812c300 secure :-1 s=THROTTLE_DONE pgs=2282 cs=0 l=1 rx=0x7f3ee0054770 tx=0x7f3ee0010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.990+0000 7f3eeffff700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ed0018730 0x7f3ed001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.990+0000 7f3eeffff700 1 -- 172.21.15.80:0/2578973009 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f3ee0075db0 con 0x7f3ef812d9c0 2019-11-28T11:52:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.990+0000 7f3ef759e700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ed0018730 0x7f3ed001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:48.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.990+0000 7f3ef759e700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ed0018730 0x7f3ed001abc0 crc :-1 s=READY pgs=941 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:48.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:47.998+0000 7f3efd129700 1 -- 172.21.15.80:0/2578973009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef812af40 con 0x7f3ef812d9c0 2019-11-28T11:52:48.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.001+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef812d9c0 0x7f3ef812c300 secure :-1 s=THROTTLE_DONE pgs=2282 cs=0 l=1 rx=0x7f3ee0054770 tx=0x7f3ee0010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.001+0000 7f3eeffff700 1 -- 172.21.15.80:0/2578973009 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3ee0005500 con 0x7f3ef812d9c0 2019-11-28T11:52:48.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.173+0000 7f3efd129700 1 -- 172.21.15.80:0/2578973009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ef812abc0 con 0x7f3ef812d9c0 2019-11-28T11:52:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.174+0000 7f3ef6d9d700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef812d9c0 0x7f3ef812c300 secure :-1 s=THROTTLE_DONE pgs=2282 cs=0 l=1 rx=0x7f3ee0054770 tx=0x7f3ee0010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.174+0000 7f3eeffff700 1 -- 172.21.15.80:0/2578973009 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f3ee0005710 con 0x7f3ef812d9c0 2019-11-28T11:52:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:52:48.228 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:48.229 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:48.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.176+0000 7f3efd129700 1 -- 172.21.15.80:0/2578973009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ed0018730 msgr2=0x7f3ed001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:48.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.176+0000 7f3efd129700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ed0018730 0x7f3ed001abc0 crc :-1 s=READY pgs=941 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.176+0000 7f3efd129700 1 -- 172.21.15.80:0/2578973009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef812d9c0 msgr2=0x7f3ef812c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.176+0000 7f3efd129700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef812d9c0 0x7f3ef812c300 secure :-1 s=READY pgs=2282 cs=0 l=1 rx=0x7f3ee0054770 tx=0x7f3ee0010160).stop 2019-11-28T11:52:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.176+0000 7f3efd129700 1 -- 172.21.15.80:0/2578973009 shutdown_connections 2019-11-28T11:52:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.176+0000 7f3efd129700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ed0018730 0x7f3ed001abc0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.176+0000 7f3efd129700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef812d9c0 0x7f3ef812c300 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.176+0000 7f3efd129700 1 --2- 172.21.15.80:0/2578973009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ef813a780 0x7f3ef812d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.176+0000 7f3efd129700 1 -- 172.21.15.80:0/2578973009 shutdown_connections 2019-11-28T11:52:48.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.176+0000 7f3efd129700 1 -- 172.21.15.80:0/2578973009 wait complete. 2019-11-28T11:52:48.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.176+0000 7f3efd129700 1 -- 172.21.15.80:0/2578973009 >> 172.21.15.80:0/2578973009 conn(0x7f3ef8127dc0 msgr2=0x7f3ef8141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:48.240 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to up:reconnect 2019-11-28T11:52:48.240 INFO:tasks.cephfs.filesystem:reached state 'up:reconnect' in 5.65113282204s 2019-11-28T11:52:48.240 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:48.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.306+0000 7f0f8db4c700 1 Processor -- start 2019-11-28T11:52:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.306+0000 7f0f8db4c700 1 -- start start 2019-11-28T11:52:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f8db4c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0f8806c0a0 0x7f0f88072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f8db4c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f880734e0 0x7f0f88071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f8db4c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f8806db00 con 0x7f0f88072360 2019-11-28T11:52:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f8db4c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f8806fd60 con 0x7f0f880734e0 2019-11-28T11:52:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f8db4c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f88070030 con 0x7f0f8806c0a0 2019-11-28T11:52:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f7ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f880734e0 0x7f0f88071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f7ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f880734e0 0x7f0f88071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43470/0 (socket says 172.21.15.80:43470) 2019-11-28T11:52:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f7ffff700 1 -- 172.21.15.80:0/2814636970 learned_addr learned my addr 172.21.15.80:0/2814636970 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f87fff700 1 --2- 172.21.15.80:0/2814636970 >> v2:172.21.15.174:3300/0 conn(0x7f0f8806c0a0 0x7f0f88072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f7ffff700 1 -- 172.21.15.80:0/2814636970 >> v2:172.21.15.174:3300/0 conn(0x7f0f8806c0a0 msgr2=0x7f0f88072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:48.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2814636970 >> v2:172.21.15.174:3300/0 conn(0x7f0f8806c0a0 0x7f0f88072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:48.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f7ffff700 1 -- 172.21.15.80:0/2814636970 >> v1:172.21.15.80:6789/0 conn(0x7f0f88072360 legacy=0x7f0f8806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:48.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f877fe700 1 -- 172.21.15.80:0/2814636970 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744644521 0 0) 0x7f0f80001480 con 0x7f0f88072360 2019-11-28T11:52:48.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f7ffff700 1 -- 172.21.15.80:0/2814636970 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f880706c0 con 0x7f0f880734e0 2019-11-28T11:52:48.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2814636970 >> v2:172.21.15.80:3300/0 conn(0x7f0f880734e0 0x7f0f88071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0f7000f6c0 tx=0x7f0f7000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2814636970 >> v2:172.21.15.80:3300/0 conn(0x7f0f880734e0 0x7f0f88071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0f7000f6c0 tx=0x7f0f7000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2814636970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f880734e0 0x7f0f88071e20 secure :-1 s=READY pgs=2284 cs=0 l=1 rx=0x7f0f7000f6c0 tx=0x7f0f7000fa60).ready entity=mon.0 client_cookie=7562fa2714a004ed server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2814636970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f880734e0 0x7f0f88071e20 secure :-1 s=THROTTLE_DONE pgs=2284 cs=0 l=1 rx=0x7f0f7000f6c0 tx=0x7f0f7000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f877fe700 1 -- 172.21.15.80:0/2814636970 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f70000960 con 0x7f0f880734e0 2019-11-28T11:52:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2814636970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f880734e0 0x7f0f88071e20 secure :-1 s=THROTTLE_DONE pgs=2284 cs=0 l=1 rx=0x7f0f7000f6c0 tx=0x7f0f7000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2814636970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f880734e0 0x7f0f88071e20 secure :-1 s=THROTTLE_DONE pgs=2284 cs=0 l=1 rx=0x7f0f7000f6c0 tx=0x7f0f7000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.307+0000 7f0f877fe700 1 -- 172.21.15.80:0/2814636970 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f70000c90 con 0x7f0f880734e0 2019-11-28T11:52:48.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.308+0000 7f0f877fe700 1 -- 172.21.15.80:0/2814636970 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f70000960 con 0x7f0f880734e0 2019-11-28T11:52:48.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.308+0000 7f0f8db4c700 1 -- 172.21.15.80:0/2814636970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f880734e0 msgr2=0x7f0f88071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:48.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.308+0000 7f0f8db4c700 1 --2- 172.21.15.80:0/2814636970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f880734e0 0x7f0f88071e20 secure :-1 s=READY pgs=2284 cs=0 l=1 rx=0x7f0f7000f6c0 tx=0x7f0f7000fa60).stop 2019-11-28T11:52:48.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.308+0000 7f0f8db4c700 1 -- 172.21.15.80:0/2814636970 shutdown_connections 2019-11-28T11:52:48.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.308+0000 7f0f8db4c700 1 --2- 172.21.15.80:0/2814636970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f880734e0 0x7f0f88071e20 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:48.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.308+0000 7f0f8db4c700 1 --2- 172.21.15.80:0/2814636970 >> v2:172.21.15.174:3300/0 conn(0x7f0f8806c0a0 0x7f0f88072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:48.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.308+0000 7f0f8db4c700 1 -- 172.21.15.80:0/2814636970 shutdown_connections 2019-11-28T11:52:48.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.308+0000 7f0f8db4c700 1 -- 172.21.15.80:0/2814636970 wait complete. 2019-11-28T11:52:48.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.308+0000 7f0f8db4c700 1 -- 172.21.15.80:0/2814636970 >> 172.21.15.80:0/2814636970 conn(0x7f0f88061cf0 msgr2=0x7f0f88064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:48.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.311+0000 7f0f8db4c700 1 Processor -- start 2019-11-28T11:52:48.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.311+0000 7f0f8db4c700 1 -- start start 2019-11-28T11:52:48.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f8db4c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f8813a780 0x7f0f8812d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f8db4c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0f8812d9c0 0x7f0f8812c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f8db4c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f88139a60 con 0x7f0f8812c840 2019-11-28T11:52:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f8db4c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f88129830 con 0x7f0f8812d9c0 2019-11-28T11:52:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f8db4c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8812a260 con 0x7f0f8813a780 2019-11-28T11:52:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f87fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f8813a780 0x7f0f8812d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:48.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f7ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0f8812d9c0 0x7f0f8812c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f87fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f8813a780 0x7f0f8812d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:45734/0 (socket says 172.21.15.80:45734) 2019-11-28T11:52:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f7ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0f8812d9c0 0x7f0f8812c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:58362/0 (socket says 172.21.15.80:58362) 2019-11-28T11:52:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f8c8ea700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f0f8812c840 0x7f0f881281b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58338/0 (socket says 172.21.15.80:58338) 2019-11-28T11:52:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f87fff700 1 -- 172.21.15.80:0/2196551180 learned_addr learned my addr 172.21.15.80:0/2196551180 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f7ffff700 1 -- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f8813a780 msgr2=0x7f0f8812d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f8813a780 0x7f0f8812d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f7ffff700 1 -- 172.21.15.80:0/2196551180 >> v1:172.21.15.174:6789/0 conn(0x7f0f8812c840 legacy=0x7f0f881281b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:48.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f7ffff700 1 -- 172.21.15.80:0/2196551180 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8812abc0 con 0x7f0f8812d9c0 2019-11-28T11:52:48.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f857fa700 1 -- 172.21.15.80:0/2196551180 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960972780 0 0) 0x7f0f800010a0 con 0x7f0f8812c840 2019-11-28T11:52:48.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f87fff700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f8813a780 0x7f0f8812d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:48.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2196551180 >> v2:172.21.15.174:3300/0 conn(0x7f0f8812d9c0 0x7f0f8812c300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f700543f0 tx=0x7f0f70054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2196551180 >> v2:172.21.15.174:3300/0 conn(0x7f0f8812d9c0 0x7f0f8812c300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f700543f0 tx=0x7f0f70054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f8812d9c0 0x7f0f8812c300 secure :-1 s=READY pgs=1368 cs=0 l=1 rx=0x7f0f700543f0 tx=0x7f0f70054790).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:48.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f8812d9c0 0x7f0f8812c300 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f0f700543f0 tx=0x7f0f70054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f857fa700 1 -- 172.21.15.80:0/2196551180 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f70000c50 con 0x7f0f8812d9c0 2019-11-28T11:52:48.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f8812d9c0 0x7f0f8812c300 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f0f700543f0 tx=0x7f0f70054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f8812d9c0 0x7f0f8812c300 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f0f700543f0 tx=0x7f0f70054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f857fa700 1 -- 172.21.15.80:0/2196551180 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f70007340 con 0x7f0f8812d9c0 2019-11-28T11:52:48.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f8db4c700 1 -- 172.21.15.80:0/2196551180 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8812af40 con 0x7f0f8812d9c0 2019-11-28T11:52:48.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.312+0000 7f0f857fa700 1 -- 172.21.15.80:0/2196551180 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f70001230 con 0x7f0f8812d9c0 2019-11-28T11:52:48.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.313+0000 7f0f8db4c700 1 -- 172.21.15.80:0/2196551180 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8812abc0 con 0x7f0f8812d9c0 2019-11-28T11:52:48.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.313+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f8812d9c0 0x7f0f8812c300 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f0f700543f0 tx=0x7f0f70054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.313+0000 7f0f857fa700 1 -- 172.21.15.80:0/2196551180 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0f70000c50 con 0x7f0f8812d9c0 2019-11-28T11:52:48.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.313+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f8812d9c0 0x7f0f8812c300 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f0f700543f0 tx=0x7f0f70054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.313+0000 7f0f857fa700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f6c018730 0x7f0f6c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:48.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.313+0000 7f0f857fa700 1 -- 172.21.15.80:0/2196551180 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f0f700759f0 con 0x7f0f8812d9c0 2019-11-28T11:52:48.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.313+0000 7f0f87fff700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f6c018730 0x7f0f6c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:48.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.314+0000 7f0f87fff700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f6c018730 0x7f0f6c01abc0 crc :-1 s=READY pgs=942 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:48.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.321+0000 7f0f8db4c700 1 -- 172.21.15.80:0/2196551180 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8812af40 con 0x7f0f8812d9c0 2019-11-28T11:52:48.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.325+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f8812d9c0 0x7f0f8812c300 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f0f700543f0 tx=0x7f0f70054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.325+0000 7f0f857fa700 1 -- 172.21.15.80:0/2196551180 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0f700076c0 con 0x7f0f8812d9c0 2019-11-28T11:52:48.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.498+0000 7f0f8db4c700 1 -- 172.21.15.80:0/2196551180 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f8812abc0 con 0x7f0f8812d9c0 2019-11-28T11:52:48.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.500+0000 7f0f7ffff700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f8812d9c0 0x7f0f8812c300 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7f0f700543f0 tx=0x7f0f70054790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.500+0000 7f0f857fa700 1 -- 172.21.15.80:0/2196551180 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f0f700076c0 con 0x7f0f8812d9c0 2019-11-28T11:52:48.553 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:52:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:48.554 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:48.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.501+0000 7f0f8db4c700 1 -- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f6c018730 msgr2=0x7f0f6c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:48.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.501+0000 7f0f8db4c700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f6c018730 0x7f0f6c01abc0 crc :-1 s=READY pgs=942 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:48.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.501+0000 7f0f8db4c700 1 -- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f8812d9c0 msgr2=0x7f0f8812c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:48.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.501+0000 7f0f8db4c700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f8812d9c0 0x7f0f8812c300 secure :-1 s=READY pgs=1368 cs=0 l=1 rx=0x7f0f700543f0 tx=0x7f0f70054790).stop 2019-11-28T11:52:48.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.501+0000 7f0f8db4c700 1 -- 172.21.15.80:0/2196551180 shutdown_connections 2019-11-28T11:52:48.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.501+0000 7f0f8db4c700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f6c018730 0x7f0f6c01abc0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:48.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.501+0000 7f0f8db4c700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f8812d9c0 0x7f0f8812c300 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:48.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.501+0000 7f0f8db4c700 1 --2- 172.21.15.80:0/2196551180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f8813a780 0x7f0f8812d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:48.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.501+0000 7f0f8db4c700 1 -- 172.21.15.80:0/2196551180 shutdown_connections 2019-11-28T11:52:48.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.501+0000 7f0f8db4c700 1 -- 172.21.15.80:0/2196551180 wait complete. 2019-11-28T11:52:48.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.501+0000 7f0f8db4c700 1 -- 172.21.15.80:0/2196551180 >> 172.21.15.80:0/2196551180 conn(0x7f0f88127dc0 msgr2=0x7f0f88141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:48.565 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-11-28T11:52:48.689 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:52:48.690 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:52:48.690 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T11:52:48.690 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 7259, 2019-11-28T11:52:48.690 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:reconnect", 2019-11-28T11:52:48.690 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:reconnect", 2019-11-28T11:52:48.690 INFO:teuthology.orchestra.run.smithi080.stdout: "reconnect_status": { 2019-11-28T11:52:48.691 INFO:teuthology.orchestra.run.smithi080.stdout: "client_reconnect_gather": "7229" 2019-11-28T11:52:48.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:48.691 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 1.8729580669999999, 2019-11-28T11:52:48.691 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 143, 2019-11-28T11:52:48.691 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 179, 2019-11-28T11:52:48.691 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 0, 2019-11-28T11:52:48.692 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 6.0085608519999996 2019-11-28T11:52:48.692 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:52:48.695 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7259, "want_state": "up:reconnect", "state": "up:reconnect", "reconnect_status": { "client_reconnect_gather": "7229" }, "rank_uptime": 1.8729580669999999, "mdsmap_epoch": 143, "osdmap_epoch": 179, "osdmap_epoch_barrier": 0, "uptime": 6.0085608519999996 } 2019-11-28T11:52:48.695 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:48.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.761+0000 7f66d8661700 1 Processor -- start 2019-11-28T11:52:48.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.761+0000 7f66d8661700 1 -- start start 2019-11-28T11:52:48.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.762+0000 7f66d8661700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f66d006c0a0 0x7f66d0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:48.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.762+0000 7f66d8661700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66d0072620 0x7f66d0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:48.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.762+0000 7f66d8661700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d006db00 con 0x7f66d00734e0 2019-11-28T11:52:48.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.762+0000 7f66d8661700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d006fd60 con 0x7f66d006c0a0 2019-11-28T11:52:48.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.762+0000 7f66d8661700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d0070030 con 0x7f66d0072620 2019-11-28T11:52:48.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d73ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66d0072620 0x7f66d0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:48.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d73ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66d0072620 0x7f66d0164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:45744/0 (socket says 172.21.15.80:45744) 2019-11-28T11:52:48.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d73ff700 1 -- 172.21.15.80:0/2969548368 learned_addr learned my addr 172.21.15.80:0/2969548368 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:48.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d6bfe700 1 --2- 172.21.15.80:0/2969548368 >> v2:172.21.15.174:3300/0 conn(0x7f66d006c0a0 0x7f66d0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:48.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d73ff700 1 -- 172.21.15.80:0/2969548368 >> v2:172.21.15.174:3300/0 conn(0x7f66d006c0a0 msgr2=0x7f66d0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:48.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d73ff700 1 --2- 172.21.15.80:0/2969548368 >> v2:172.21.15.174:3300/0 conn(0x7f66d006c0a0 0x7f66d0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:48.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d73ff700 1 -- 172.21.15.80:0/2969548368 >> v1:172.21.15.174:6789/0 conn(0x7f66d00734e0 legacy=0x7f66d0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:48.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d73ff700 1 -- 172.21.15.80:0/2969548368 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d00706c0 con 0x7f66d0072620 2019-11-28T11:52:48.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d73ff700 1 --2- 172.21.15.80:0/2969548368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66d0072620 0x7f66d0164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f66c800f760 tx=0x7f66c800f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d73ff700 1 --2- 172.21.15.80:0/2969548368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66d0072620 0x7f66d0164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f66c800f760 tx=0x7f66c800f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d73ff700 1 --2- 172.21.15.80:0/2969548368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66d0072620 0x7f66d0164d70 secure :-1 s=READY pgs=330 cs=0 l=1 rx=0x7f66c800f760 tx=0x7f66c800f590).ready entity=mon.2 client_cookie=748df3de54d5199e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:48.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d73ff700 1 --2- 172.21.15.80:0/2969548368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66d0072620 0x7f66d0164d70 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f66c800f760 tx=0x7f66c800f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d5bfc700 1 -- 172.21.15.80:0/2969548368 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66c8000a70 con 0x7f66d0072620 2019-11-28T11:52:48.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d73ff700 1 --2- 172.21.15.80:0/2969548368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66d0072620 0x7f66d0164d70 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f66c800f760 tx=0x7f66c800f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d73ff700 1 --2- 172.21.15.80:0/2969548368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66d0072620 0x7f66d0164d70 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f66c800f760 tx=0x7f66c800f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d5bfc700 1 -- 172.21.15.80:0/2969548368 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c8000e70 con 0x7f66d0072620 2019-11-28T11:52:48.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d5bfc700 1 -- 172.21.15.80:0/2969548368 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66c8001500 con 0x7f66d0072620 2019-11-28T11:52:48.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d8661700 1 -- 172.21.15.80:0/2969548368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66d0072620 msgr2=0x7f66d0164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:48.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.763+0000 7f66d8661700 1 --2- 172.21.15.80:0/2969548368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66d0072620 0x7f66d0164d70 secure :-1 s=READY pgs=330 cs=0 l=1 rx=0x7f66c800f760 tx=0x7f66c800f590).stop 2019-11-28T11:52:48.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.764+0000 7f66d8661700 1 -- 172.21.15.80:0/2969548368 shutdown_connections 2019-11-28T11:52:48.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.764+0000 7f66d8661700 1 --2- 172.21.15.80:0/2969548368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66d0072620 0x7f66d0164d70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:48.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.764+0000 7f66d8661700 1 --2- 172.21.15.80:0/2969548368 >> v2:172.21.15.174:3300/0 conn(0x7f66d006c0a0 0x7f66d0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:48.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.764+0000 7f66d8661700 1 -- 172.21.15.80:0/2969548368 shutdown_connections 2019-11-28T11:52:48.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.764+0000 7f66d8661700 1 -- 172.21.15.80:0/2969548368 wait complete. 2019-11-28T11:52:48.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.764+0000 7f66d8661700 1 -- 172.21.15.80:0/2969548368 >> 172.21.15.80:0/2969548368 conn(0x7f66d0061cf0 msgr2=0x7f66d0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:48.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.767+0000 7f66d8661700 1 Processor -- start 2019-11-28T11:52:48.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.767+0000 7f66d8661700 1 -- start start 2019-11-28T11:52:48.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d8661700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66d01350e0 0x7f66d0169c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:48.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d8661700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d0106270 con 0x7f66d01364c0 2019-11-28T11:52:48.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d8661700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d0106770 con 0x7f66d01027b0 2019-11-28T11:52:48.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d8661700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d0132840 con 0x7f66d01350e0 2019-11-28T11:52:48.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d73ff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66d01350e0 0x7f66d0169c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:48.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d73ff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66d01350e0 0x7f66d0169c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43492/0 (socket says 172.21.15.80:43492) 2019-11-28T11:52:48.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d63fd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f66d01364c0 0x7f66d01348e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42806/0 (socket says 172.21.15.80:42806) 2019-11-28T11:52:48.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d73ff700 1 -- 172.21.15.80:0/4005410177 learned_addr learned my addr 172.21.15.80:0/4005410177 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:48.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d73ff700 1 -- 172.21.15.80:0/4005410177 >> v1:172.21.15.174:6789/0 conn(0x7f66d01027b0 legacy=0x7f66d0136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:48.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d73ff700 1 -- 172.21.15.80:0/4005410177 >> v1:172.21.15.80:6789/0 conn(0x7f66d01364c0 legacy=0x7f66d01348e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:48.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d73ff700 1 -- 172.21.15.80:0/4005410177 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d01331a0 con 0x7f66d01350e0 2019-11-28T11:52:48.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d73ff700 1 --2- 172.21.15.80:0/4005410177 >> v2:172.21.15.80:3300/0 conn(0x7f66d01350e0 0x7f66d0169c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f66c8010470 tx=0x7f66c8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d73ff700 1 --2- 172.21.15.80:0/4005410177 >> v2:172.21.15.80:3300/0 conn(0x7f66d01350e0 0x7f66d0169c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f66c8010470 tx=0x7f66c8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d73ff700 1 --2- 172.21.15.80:0/4005410177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66d01350e0 0x7f66d0169c40 secure :-1 s=READY pgs=2286 cs=0 l=1 rx=0x7f66c8010470 tx=0x7f66c8010810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:48.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d73ff700 1 --2- 172.21.15.80:0/4005410177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66d01350e0 0x7f66d0169c40 secure :-1 s=THROTTLE_DONE pgs=2286 cs=0 l=1 rx=0x7f66c8010470 tx=0x7f66c8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d73ff700 1 --2- 172.21.15.80:0/4005410177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66d01350e0 0x7f66d0169c40 secure :-1 s=THROTTLE_DONE pgs=2286 cs=0 l=1 rx=0x7f66c8010470 tx=0x7f66c8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66d73ff700 1 --2- 172.21.15.80:0/4005410177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66d01350e0 0x7f66d0169c40 secure :-1 s=THROTTLE_DONE pgs=2286 cs=0 l=1 rx=0x7f66c8010470 tx=0x7f66c8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66cf7fe700 1 -- 172.21.15.80:0/4005410177 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66c80081b0 con 0x7f66d01350e0 2019-11-28T11:52:48.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.768+0000 7f66cf7fe700 1 -- 172.21.15.80:0/4005410177 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c8000c60 con 0x7f66d01350e0 2019-11-28T11:52:48.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.769+0000 7f66cf7fe700 1 -- 172.21.15.80:0/4005410177 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66c80012b0 con 0x7f66d01350e0 2019-11-28T11:52:48.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.769+0000 7f66d8661700 1 -- 172.21.15.80:0/4005410177 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d0133520 con 0x7f66d01350e0 2019-11-28T11:52:48.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.769+0000 7f66d8661700 1 -- 172.21.15.80:0/4005410177 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d01331a0 con 0x7f66d01350e0 2019-11-28T11:52:48.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.769+0000 7f66d73ff700 1 --2- 172.21.15.80:0/4005410177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66d01350e0 0x7f66d0169c40 secure :-1 s=THROTTLE_DONE pgs=2286 cs=0 l=1 rx=0x7f66c8010470 tx=0x7f66c8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.769+0000 7f66cf7fe700 1 -- 172.21.15.80:0/4005410177 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f66c8000e50 con 0x7f66d01350e0 2019-11-28T11:52:48.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.769+0000 7f66d73ff700 1 --2- 172.21.15.80:0/4005410177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66d01350e0 0x7f66d0169c40 secure :-1 s=THROTTLE_DONE pgs=2286 cs=0 l=1 rx=0x7f66c8010470 tx=0x7f66c8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.769+0000 7f66cf7fe700 1 --2- 172.21.15.80:0/4005410177 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66b4018730 0x7f66b401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:48.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.769+0000 7f66cf7fe700 1 -- 172.21.15.80:0/4005410177 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f66c8031db0 con 0x7f66d01350e0 2019-11-28T11:52:48.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.770+0000 7f66d6bfe700 1 --2- 172.21.15.80:0/4005410177 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66b4018730 0x7f66b401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:48.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.770+0000 7f66d6bfe700 1 --2- 172.21.15.80:0/4005410177 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66b4018730 0x7f66b401abc0 crc :-1 s=READY pgs=943 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:48.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.776+0000 7f66d8661700 1 -- 172.21.15.80:0/4005410177 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d0133520 con 0x7f66d01350e0 2019-11-28T11:52:48.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.780+0000 7f66d73ff700 1 --2- 172.21.15.80:0/4005410177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66d01350e0 0x7f66d0169c40 secure :-1 s=THROTTLE_DONE pgs=2286 cs=0 l=1 rx=0x7f66c8010470 tx=0x7f66c8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:48.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.780+0000 7f66cf7fe700 1 -- 172.21.15.80:0/4005410177 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f66c8007350 con 0x7f66d01350e0 2019-11-28T11:52:49.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.951+0000 7f66d8661700 1 -- 172.21.15.80:0/4005410177 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66d01331a0 con 0x7f66d01350e0 2019-11-28T11:52:49.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.951+0000 7f66d73ff700 1 --2- 172.21.15.80:0/4005410177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66d01350e0 0x7f66d0169c40 secure :-1 s=THROTTLE_DONE pgs=2286 cs=0 l=1 rx=0x7f66c8010470 tx=0x7f66c8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.951+0000 7f66cf7fe700 1 -- 172.21.15.80:0/4005410177 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f66c8000c40 con 0x7f66d01350e0 2019-11-28T11:52:49.006 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:52:49.006 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:49.006 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:49.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.954+0000 7f66d8661700 1 -- 172.21.15.80:0/4005410177 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66b4018730 msgr2=0x7f66b401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:49.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.954+0000 7f66d8661700 1 --2- 172.21.15.80:0/4005410177 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66b4018730 0x7f66b401abc0 crc :-1 s=READY pgs=943 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:49.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.954+0000 7f66d8661700 1 -- 172.21.15.80:0/4005410177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66d01350e0 msgr2=0x7f66d0169c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:49.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.954+0000 7f66d8661700 1 --2- 172.21.15.80:0/4005410177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66d01350e0 0x7f66d0169c40 secure :-1 s=READY pgs=2286 cs=0 l=1 rx=0x7f66c8010470 tx=0x7f66c8010810).stop 2019-11-28T11:52:49.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.954+0000 7f66d8661700 1 -- 172.21.15.80:0/4005410177 shutdown_connections 2019-11-28T11:52:49.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.954+0000 7f66d8661700 1 --2- 172.21.15.80:0/4005410177 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66d01350e0 0x7f66d0169c40 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:49.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.954+0000 7f66d8661700 1 --2- 172.21.15.80:0/4005410177 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66b4018730 0x7f66b401abc0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:49.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.954+0000 7f66d8661700 1 -- 172.21.15.80:0/4005410177 shutdown_connections 2019-11-28T11:52:49.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.954+0000 7f66d8661700 1 -- 172.21.15.80:0/4005410177 wait complete. 2019-11-28T11:52:49.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:48.954+0000 7f66d8661700 1 -- 172.21.15.80:0/4005410177 >> 172.21.15.80:0/4005410177 conn(0x7f66d01104d0 msgr2=0x7f66d012e720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:49.018 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok session ls 2019-11-28T11:52:49.142 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:52:49.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:49.143 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 10650, 2019-11-28T11:52:49.143 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": { 2019-11-28T11:52:49.143 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2019-11-28T11:52:49.143 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2019-11-28T11:52:49.144 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 10650 2019-11-28T11:52:49.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.144 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2019-11-28T11:52:49.144 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:49.144 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.16:0", 2019-11-28T11:52:49.145 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1076095543 2019-11-28T11:52:49.145 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:49.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.145 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "open", 2019-11-28T11:52:49.145 INFO:teuthology.orchestra.run.smithi080.stdout: "num_leases": 0, 2019-11-28T11:52:49.145 INFO:teuthology.orchestra.run.smithi080.stdout: "num_caps": 1, 2019-11-28T11:52:49.145 INFO:teuthology.orchestra.run.smithi080.stdout: "request_load_avg": 0, 2019-11-28T11:52:49.146 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 2.3188783179999999, 2019-11-28T11:52:49.146 INFO:teuthology.orchestra.run.smithi080.stdout: "requests_in_flight": 0, 2019-11-28T11:52:49.146 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": 0, 2019-11-28T11:52:49.146 INFO:teuthology.orchestra.run.smithi080.stdout: "reconnecting": false, 2019-11-28T11:52:49.146 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps": { 2019-11-28T11:52:49.146 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.147 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:52:49.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.147 INFO:teuthology.orchestra.run.smithi080.stdout: "release_caps": { 2019-11-28T11:52:49.147 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.147 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:52:49.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.148 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle": { 2019-11-28T11:52:49.148 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.148 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 2.5 2019-11-28T11:52:49.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.148 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle2o": { 2019-11-28T11:52:49.149 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.149 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 0.5 2019-11-28T11:52:49.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.149 INFO:teuthology.orchestra.run.smithi080.stdout: "session_cache_liveness": { 2019-11-28T11:52:49.149 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0.9969595646893491, 2019-11-28T11:52:49.149 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 300 2019-11-28T11:52:49.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.150 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": "client.10650 v1:172.21.15.16:0/1076095543", 2019-11-28T11:52:49.150 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": [], 2019-11-28T11:52:49.150 INFO:teuthology.orchestra.run.smithi080.stdout: "prealloc_inos": [], 2019-11-28T11:52:49.150 INFO:teuthology.orchestra.run.smithi080.stdout: "used_inos": [], 2019-11-28T11:52:49.150 INFO:teuthology.orchestra.run.smithi080.stdout: "client_metadata": { 2019-11-28T11:52:49.150 INFO:teuthology.orchestra.run.smithi080.stdout: "features": "00000000000000ff", 2019-11-28T11:52:49.150 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "1", 2019-11-28T11:52:49.151 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi016", 2019-11-28T11:52:49.151 INFO:teuthology.orchestra.run.smithi080.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:52:49.151 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2019-11-28T11:52:49.151 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:49.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:49.152 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 7229, 2019-11-28T11:52:49.152 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": { 2019-11-28T11:52:49.152 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2019-11-28T11:52:49.152 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2019-11-28T11:52:49.154 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 7229 2019-11-28T11:52:49.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.154 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2019-11-28T11:52:49.154 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:49.155 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.76:0", 2019-11-28T11:52:49.155 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2848418618 2019-11-28T11:52:49.155 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:49.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.155 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "open", 2019-11-28T11:52:49.155 INFO:teuthology.orchestra.run.smithi080.stdout: "num_leases": 0, 2019-11-28T11:52:49.156 INFO:teuthology.orchestra.run.smithi080.stdout: "num_caps": 0, 2019-11-28T11:52:49.156 INFO:teuthology.orchestra.run.smithi080.stdout: "request_load_avg": 0, 2019-11-28T11:52:49.156 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 2.3198782659999999, 2019-11-28T11:52:49.156 INFO:teuthology.orchestra.run.smithi080.stdout: "requests_in_flight": 0, 2019-11-28T11:52:49.156 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": 1, 2019-11-28T11:52:49.156 INFO:teuthology.orchestra.run.smithi080.stdout: "reconnecting": true, 2019-11-28T11:52:49.156 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps": { 2019-11-28T11:52:49.157 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.157 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:52:49.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.157 INFO:teuthology.orchestra.run.smithi080.stdout: "release_caps": { 2019-11-28T11:52:49.157 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.157 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:52:49.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.158 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle": { 2019-11-28T11:52:49.158 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.159 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 2.5 2019-11-28T11:52:49.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.159 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle2o": { 2019-11-28T11:52:49.159 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.159 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 0.5 2019-11-28T11:52:49.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.160 INFO:teuthology.orchestra.run.smithi080.stdout: "session_cache_liveness": { 2019-11-28T11:52:49.160 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.160 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 300 2019-11-28T11:52:49.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.160 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": "client.7229 v1:172.21.15.76:0/2848418618", 2019-11-28T11:52:49.161 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": [ 2019-11-28T11:52:49.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:49.161 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2, 2019-11-28T11:52:49.161 INFO:teuthology.orchestra.run.smithi080.stdout: "created_ino": "0x0" 2019-11-28T11:52:49.161 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:49.161 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:52:49.162 INFO:teuthology.orchestra.run.smithi080.stdout: "prealloc_inos": [], 2019-11-28T11:52:49.162 INFO:teuthology.orchestra.run.smithi080.stdout: "used_inos": [], 2019-11-28T11:52:49.162 INFO:teuthology.orchestra.run.smithi080.stdout: "client_metadata": { 2019-11-28T11:52:49.162 INFO:teuthology.orchestra.run.smithi080.stdout: "features": "00000000000000ff", 2019-11-28T11:52:49.162 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "0", 2019-11-28T11:52:49.162 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi076.front.sepia.ceph.com", 2019-11-28T11:52:49.162 INFO:teuthology.orchestra.run.smithi080.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:52:49.163 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2019-11-28T11:52:49.163 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:49.163 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:49.163 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:52:49.164 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 10650, "entity": { "name": { "type": "client", "num": 10650 }, "addr": { "type": "v1", "addr": "172.21.15.16:0", "nonce": 1076095543 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 2.3188783179999999, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.9969595646893491, "halflife": 300 }, "inst": "client.10650 v1:172.21.15.16:0/1076095543", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "1", "hostname": "smithi016", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } }, { "id": 7229, "entity": { "name": { "type": "client", "num": 7229 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 2848418618 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 2.3198782659999999, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": true, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "inst": "client.7229 v1:172.21.15.76:0/2848418618", "completed_requests": [ { "tid": 2, "created_ino": "0x0" } ], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076.front.sepia.ceph.com", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:52:49.165 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:49.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.231+0000 7faed2801700 1 Processor -- start 2019-11-28T11:52:49.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.231+0000 7faed2801700 1 -- start start 2019-11-28T11:52:49.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.232+0000 7faed2801700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faecc06c490 0x7faecc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:49.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.232+0000 7faed2801700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faecc06ce60 0x7faecc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:49.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.232+0000 7faed2801700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faecc06db00 con 0x7faecc06c0a0 2019-11-28T11:52:49.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.232+0000 7faed2801700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faecc06fd60 con 0x7faecc06ce60 2019-11-28T11:52:49.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.232+0000 7faed2801700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc070030 con 0x7faecc06c490 2019-11-28T11:52:49.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.232+0000 7faed159f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faecc06ce60 0x7faecc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:49.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.232+0000 7faecbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faecc06c490 0x7faecc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:49.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.232+0000 7faed159f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faecc06ce60 0x7faecc164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:58386/0 (socket says 172.21.15.80:58386) 2019-11-28T11:52:49.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.232+0000 7faed159f700 1 -- 172.21.15.80:0/4121861500 learned_addr learned my addr 172.21.15.80:0/4121861500 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:49.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.232+0000 7faed159f700 1 -- 172.21.15.80:0/4121861500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faecc06c490 msgr2=0x7faecc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:49.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.232+0000 7faed159f700 1 --2- 172.21.15.80:0/4121861500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faecc06c490 0x7faecc06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:49.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.232+0000 7faed159f700 1 -- 172.21.15.80:0/4121861500 >> v1:172.21.15.174:6789/0 conn(0x7faecc06c0a0 legacy=0x7faecc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:49.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.232+0000 7faed159f700 1 -- 172.21.15.80:0/4121861500 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc0706c0 con 0x7faecc06ce60 2019-11-28T11:52:49.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.232+0000 7faecbfff700 1 --2- 172.21.15.80:0/4121861500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faecc06c490 0x7faecc06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:49.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.232+0000 7faed159f700 1 --2- 172.21.15.80:0/4121861500 >> v2:172.21.15.174:3300/0 conn(0x7faecc06ce60 0x7faecc164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faec400fae0 tx=0x7faec400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.233+0000 7faed159f700 1 --2- 172.21.15.80:0/4121861500 >> v2:172.21.15.174:3300/0 conn(0x7faecc06ce60 0x7faecc164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faec400fae0 tx=0x7faec400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.233+0000 7faed159f700 1 --2- 172.21.15.80:0/4121861500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faecc06ce60 0x7faecc164d70 secure :-1 s=READY pgs=1372 cs=0 l=1 rx=0x7faec400fae0 tx=0x7faec400fe80).ready entity=mon.1 client_cookie=ec1f54fac98e843f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:49.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.233+0000 7faed159f700 1 --2- 172.21.15.80:0/4121861500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faecc06ce60 0x7faecc164d70 secure :-1 s=THROTTLE_DONE pgs=1372 cs=0 l=1 rx=0x7faec400fae0 tx=0x7faec400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.233+0000 7faed159f700 1 --2- 172.21.15.80:0/4121861500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faecc06ce60 0x7faecc164d70 secure :-1 s=THROTTLE_DONE pgs=1372 cs=0 l=1 rx=0x7faec400fae0 tx=0x7faec400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.233+0000 7faecb7fe700 1 -- 172.21.15.80:0/4121861500 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec4000df0 con 0x7faecc06ce60 2019-11-28T11:52:49.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.233+0000 7faed159f700 1 --2- 172.21.15.80:0/4121861500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faecc06ce60 0x7faecc164d70 secure :-1 s=THROTTLE_DONE pgs=1372 cs=0 l=1 rx=0x7faec400fae0 tx=0x7faec400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.233+0000 7faecb7fe700 1 -- 172.21.15.80:0/4121861500 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec40011f0 con 0x7faecc06ce60 2019-11-28T11:52:49.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.233+0000 7faecb7fe700 1 -- 172.21.15.80:0/4121861500 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec4001880 con 0x7faecc06ce60 2019-11-28T11:52:49.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.233+0000 7faed2801700 1 -- 172.21.15.80:0/4121861500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faecc06ce60 msgr2=0x7faecc164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:49.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.233+0000 7faed2801700 1 --2- 172.21.15.80:0/4121861500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faecc06ce60 0x7faecc164d70 secure :-1 s=READY pgs=1372 cs=0 l=1 rx=0x7faec400fae0 tx=0x7faec400fe80).stop 2019-11-28T11:52:49.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.233+0000 7faed2801700 1 -- 172.21.15.80:0/4121861500 shutdown_connections 2019-11-28T11:52:49.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.233+0000 7faed2801700 1 --2- 172.21.15.80:0/4121861500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faecc06ce60 0x7faecc164d70 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:49.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.233+0000 7faed2801700 1 --2- 172.21.15.80:0/4121861500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faecc06c490 0x7faecc06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:49.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.234+0000 7faed2801700 1 -- 172.21.15.80:0/4121861500 shutdown_connections 2019-11-28T11:52:49.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.234+0000 7faed2801700 1 -- 172.21.15.80:0/4121861500 wait complete. 2019-11-28T11:52:49.294 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.234+0000 7faed2801700 1 -- 172.21.15.80:0/4121861500 >> 172.21.15.80:0/4121861500 conn(0x7faecc061cf0 msgr2=0x7faecc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:49.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.236+0000 7faed2801700 1 Processor -- start 2019-11-28T11:52:49.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.236+0000 7faed2801700 1 -- start start 2019-11-28T11:52:49.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.237+0000 7faed2801700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faecc10cfb0 0x7faecc10d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:49.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.237+0000 7faed2801700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faecc10d980 0x7faecc12c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:49.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.237+0000 7faed2801700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faecc135c60 con 0x7faecc104d10 2019-11-28T11:52:49.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.237+0000 7faed2801700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faecc141e60 con 0x7faecc10cfb0 2019-11-28T11:52:49.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.237+0000 7faed2801700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc107cb0 con 0x7faecc10d980 2019-11-28T11:52:49.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.237+0000 7faecbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faecc10cfb0 0x7faecc10d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:49.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.237+0000 7faecbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faecc10cfb0 0x7faecc10d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43504/0 (socket says 172.21.15.80:43504) 2019-11-28T11:52:49.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.237+0000 7faecbfff700 1 -- 172.21.15.80:0/3567223312 learned_addr learned my addr 172.21.15.80:0/3567223312 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:49.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.237+0000 7faed159f700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faecc10d980 0x7faecc12c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:49.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.237+0000 7faecbfff700 1 -- 172.21.15.80:0/3567223312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faecc10d980 msgr2=0x7faecc12c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:49.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.237+0000 7faecbfff700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faecc10d980 0x7faecc12c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:49.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.237+0000 7faecbfff700 1 -- 172.21.15.80:0/3567223312 >> v1:172.21.15.174:6789/0 conn(0x7faecc104d10 legacy=0x7faecc10e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.237+0000 7faecbfff700 1 -- 172.21.15.80:0/3567223312 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc1424f0 con 0x7faecc10cfb0 2019-11-28T11:52:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.237+0000 7faec97fa700 1 -- 172.21.15.80:0/3567223312 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166129229 0 0) 0x7faeb4001080 con 0x7faecc104d10 2019-11-28T11:52:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.237+0000 7faecbfff700 1 --2- 172.21.15.80:0/3567223312 >> v2:172.21.15.80:3300/0 conn(0x7faecc10cfb0 0x7faecc10d440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faebc010390 tx=0x7faebc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.237+0000 7faecbfff700 1 --2- 172.21.15.80:0/3567223312 >> v2:172.21.15.80:3300/0 conn(0x7faecc10cfb0 0x7faecc10d440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faebc010390 tx=0x7faebc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.238+0000 7faecbfff700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faecc10cfb0 0x7faecc10d440 secure :-1 s=READY pgs=2287 cs=0 l=1 rx=0x7faebc010390 tx=0x7faebc010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.238+0000 7faecbfff700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faecc10cfb0 0x7faecc10d440 secure :-1 s=THROTTLE_DONE pgs=2287 cs=0 l=1 rx=0x7faebc010390 tx=0x7faebc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.238+0000 7faec97fa700 1 -- 172.21.15.80:0/3567223312 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faebc00a8c0 con 0x7faecc10cfb0 2019-11-28T11:52:49.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.238+0000 7faecbfff700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faecc10cfb0 0x7faecc10d440 secure :-1 s=THROTTLE_DONE pgs=2287 cs=0 l=1 rx=0x7faebc010390 tx=0x7faebc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.238+0000 7faec97fa700 1 -- 172.21.15.80:0/3567223312 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc00a8c0 con 0x7faecc10cfb0 2019-11-28T11:52:49.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.238+0000 7faed2801700 1 -- 172.21.15.80:0/3567223312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faecc10ddf0 con 0x7faecc10cfb0 2019-11-28T11:52:49.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.238+0000 7faecbfff700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faecc10cfb0 0x7faecc10d440 secure :-1 s=THROTTLE_DONE pgs=2287 cs=0 l=1 rx=0x7faebc010390 tx=0x7faebc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.238+0000 7faec97fa700 1 -- 172.21.15.80:0/3567223312 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faebc00edb0 con 0x7faecc10cfb0 2019-11-28T11:52:49.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.238+0000 7faed2801700 1 -- 172.21.15.80:0/3567223312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faecc1424f0 con 0x7faecc10cfb0 2019-11-28T11:52:49.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.238+0000 7faecbfff700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faecc10cfb0 0x7faecc10d440 secure :-1 s=THROTTLE_DONE pgs=2287 cs=0 l=1 rx=0x7faebc010390 tx=0x7faebc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.238+0000 7faec97fa700 1 -- 172.21.15.80:0/3567223312 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7faebc009580 con 0x7faecc10cfb0 2019-11-28T11:52:49.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.238+0000 7faecbfff700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faecc10cfb0 0x7faecc10d440 secure :-1 s=THROTTLE_DONE pgs=2287 cs=0 l=1 rx=0x7faebc010390 tx=0x7faebc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.238+0000 7faec97fa700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faeb0018730 0x7faeb001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:49.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.238+0000 7faec97fa700 1 -- 172.21.15.80:0/3567223312 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7faebc031a20 con 0x7faecc10cfb0 2019-11-28T11:52:49.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.239+0000 7faed0d9e700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faeb0018730 0x7faeb001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:49.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.239+0000 7faed0d9e700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faeb0018730 0x7faeb001abc0 crc :-1 s=READY pgs=944 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:49.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.246+0000 7faed2801700 1 -- 172.21.15.80:0/3567223312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faecc1424f0 con 0x7faecc10cfb0 2019-11-28T11:52:49.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.249+0000 7faecbfff700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faecc10cfb0 0x7faecc10d440 secure :-1 s=THROTTLE_DONE pgs=2287 cs=0 l=1 rx=0x7faebc010390 tx=0x7faebc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.249+0000 7faec97fa700 1 -- 172.21.15.80:0/3567223312 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7faebc00a590 con 0x7faecc10cfb0 2019-11-28T11:52:49.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.422+0000 7faed2801700 1 -- 172.21.15.80:0/3567223312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faecc1424f0 con 0x7faecc10cfb0 2019-11-28T11:52:49.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.423+0000 7faecbfff700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faecc10cfb0 0x7faecc10d440 secure :-1 s=THROTTLE_DONE pgs=2287 cs=0 l=1 rx=0x7faebc010390 tx=0x7faebc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.423+0000 7faec97fa700 1 -- 172.21.15.80:0/3567223312 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7faebc009580 con 0x7faecc10cfb0 2019-11-28T11:52:49.477 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:52:49.478 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:49.478 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.425+0000 7faed2801700 1 -- 172.21.15.80:0/3567223312 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faeb0018730 msgr2=0x7faeb001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.425+0000 7faed2801700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faeb0018730 0x7faeb001abc0 crc :-1 s=READY pgs=944 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:49.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.425+0000 7faed2801700 1 -- 172.21.15.80:0/3567223312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faecc10cfb0 msgr2=0x7faecc10d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:49.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.425+0000 7faed2801700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faecc10cfb0 0x7faecc10d440 secure :-1 s=READY pgs=2287 cs=0 l=1 rx=0x7faebc010390 tx=0x7faebc010730).stop 2019-11-28T11:52:49.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.425+0000 7faed2801700 1 -- 172.21.15.80:0/3567223312 shutdown_connections 2019-11-28T11:52:49.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.425+0000 7faed2801700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faecc10d980 0x7faecc12c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:49.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.425+0000 7faed2801700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faecc10cfb0 0x7faecc10d440 unknown :-1 s=CLOSED pgs=2287 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:49.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.425+0000 7faed2801700 1 --2- 172.21.15.80:0/3567223312 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faeb0018730 0x7faeb001abc0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:49.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.426+0000 7faed2801700 1 -- 172.21.15.80:0/3567223312 shutdown_connections 2019-11-28T11:52:49.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.426+0000 7faed2801700 1 -- 172.21.15.80:0/3567223312 wait complete. 2019-11-28T11:52:49.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.426+0000 7faed2801700 1 -- 172.21.15.80:0/3567223312 >> 172.21.15.80:0/3567223312 conn(0x7faecc15e210 msgr2=0x7faecc10b140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:49.489 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok session ls 2019-11-28T11:52:49.614 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:52:49.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:49.615 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 10650, 2019-11-28T11:52:49.615 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": { 2019-11-28T11:52:49.615 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2019-11-28T11:52:49.615 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2019-11-28T11:52:49.616 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 10650 2019-11-28T11:52:49.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.616 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2019-11-28T11:52:49.616 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:49.616 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.16:0", 2019-11-28T11:52:49.616 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1076095543 2019-11-28T11:52:49.617 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:49.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.617 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "open", 2019-11-28T11:52:49.617 INFO:teuthology.orchestra.run.smithi080.stdout: "num_leases": 0, 2019-11-28T11:52:49.617 INFO:teuthology.orchestra.run.smithi080.stdout: "num_caps": 1, 2019-11-28T11:52:49.617 INFO:teuthology.orchestra.run.smithi080.stdout: "request_load_avg": 0, 2019-11-28T11:52:49.617 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 2.7908535510000001, 2019-11-28T11:52:49.618 INFO:teuthology.orchestra.run.smithi080.stdout: "requests_in_flight": 0, 2019-11-28T11:52:49.618 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": 0, 2019-11-28T11:52:49.618 INFO:teuthology.orchestra.run.smithi080.stdout: "reconnecting": false, 2019-11-28T11:52:49.618 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps": { 2019-11-28T11:52:49.618 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.618 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:52:49.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.618 INFO:teuthology.orchestra.run.smithi080.stdout: "release_caps": { 2019-11-28T11:52:49.619 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.619 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:52:49.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.619 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle": { 2019-11-28T11:52:49.619 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.619 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 2.5 2019-11-28T11:52:49.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.620 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle2o": { 2019-11-28T11:52:49.620 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.620 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 0.5 2019-11-28T11:52:49.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.620 INFO:teuthology.orchestra.run.smithi080.stdout: "session_cache_liveness": { 2019-11-28T11:52:49.620 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0.9958729784924143, 2019-11-28T11:52:49.620 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 300 2019-11-28T11:52:49.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.621 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": "client.10650 v1:172.21.15.16:0/1076095543", 2019-11-28T11:52:49.621 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": [], 2019-11-28T11:52:49.621 INFO:teuthology.orchestra.run.smithi080.stdout: "prealloc_inos": [], 2019-11-28T11:52:49.621 INFO:teuthology.orchestra.run.smithi080.stdout: "used_inos": [], 2019-11-28T11:52:49.621 INFO:teuthology.orchestra.run.smithi080.stdout: "client_metadata": { 2019-11-28T11:52:49.621 INFO:teuthology.orchestra.run.smithi080.stdout: "features": "00000000000000ff", 2019-11-28T11:52:49.622 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "1", 2019-11-28T11:52:49.622 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi016", 2019-11-28T11:52:49.622 INFO:teuthology.orchestra.run.smithi080.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:52:49.622 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2019-11-28T11:52:49.622 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:49.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:49.623 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 7229, 2019-11-28T11:52:49.623 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": { 2019-11-28T11:52:49.623 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2019-11-28T11:52:49.623 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2019-11-28T11:52:49.623 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 7229 2019-11-28T11:52:49.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.623 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2019-11-28T11:52:49.624 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:52:49.624 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.76:0", 2019-11-28T11:52:49.624 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2848418618 2019-11-28T11:52:49.624 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:49.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.624 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "open", 2019-11-28T11:52:49.624 INFO:teuthology.orchestra.run.smithi080.stdout: "num_leases": 0, 2019-11-28T11:52:49.625 INFO:teuthology.orchestra.run.smithi080.stdout: "num_caps": 0, 2019-11-28T11:52:49.625 INFO:teuthology.orchestra.run.smithi080.stdout: "request_load_avg": 0, 2019-11-28T11:52:49.625 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 2.7918534990000001, 2019-11-28T11:52:49.625 INFO:teuthology.orchestra.run.smithi080.stdout: "requests_in_flight": 0, 2019-11-28T11:52:49.625 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": 1, 2019-11-28T11:52:49.625 INFO:teuthology.orchestra.run.smithi080.stdout: "reconnecting": true, 2019-11-28T11:52:49.625 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps": { 2019-11-28T11:52:49.626 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.626 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:52:49.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.626 INFO:teuthology.orchestra.run.smithi080.stdout: "release_caps": { 2019-11-28T11:52:49.626 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.626 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:52:49.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.627 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle": { 2019-11-28T11:52:49.627 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.627 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 2.5 2019-11-28T11:52:49.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.627 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle2o": { 2019-11-28T11:52:49.627 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.627 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 0.5 2019-11-28T11:52:49.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.628 INFO:teuthology.orchestra.run.smithi080.stdout: "session_cache_liveness": { 2019-11-28T11:52:49.628 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:52:49.628 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 300 2019-11-28T11:52:49.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:52:49.628 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": "client.7229 v1:172.21.15.76:0/2848418618", 2019-11-28T11:52:49.628 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": [ 2019-11-28T11:52:49.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:52:49.629 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2, 2019-11-28T11:52:49.629 INFO:teuthology.orchestra.run.smithi080.stdout: "created_ino": "0x0" 2019-11-28T11:52:49.629 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:49.629 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:52:49.629 INFO:teuthology.orchestra.run.smithi080.stdout: "prealloc_inos": [], 2019-11-28T11:52:49.629 INFO:teuthology.orchestra.run.smithi080.stdout: "used_inos": [], 2019-11-28T11:52:49.630 INFO:teuthology.orchestra.run.smithi080.stdout: "client_metadata": { 2019-11-28T11:52:49.630 INFO:teuthology.orchestra.run.smithi080.stdout: "features": "00000000000000ff", 2019-11-28T11:52:49.630 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "0", 2019-11-28T11:52:49.630 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi076.front.sepia.ceph.com", 2019-11-28T11:52:49.630 INFO:teuthology.orchestra.run.smithi080.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:52:49.630 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2019-11-28T11:52:49.630 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:49.630 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:52:49.631 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:52:49.632 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 10650, "entity": { "name": { "type": "client", "num": 10650 }, "addr": { "type": "v1", "addr": "172.21.15.16:0", "nonce": 1076095543 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 2.7908535510000001, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.9958729784924143, "halflife": 300 }, "inst": "client.10650 v1:172.21.15.16:0/1076095543", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "1", "hostname": "smithi016", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } }, { "id": 7229, "entity": { "name": { "type": "client", "num": 7229 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 2848418618 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 2.7918534990000001, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": true, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "inst": "client.7229 v1:172.21.15.76:0/2848418618", "completed_requests": [ { "tid": 2, "created_ino": "0x0" } ], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076.front.sepia.ceph.com", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:52:49.632 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:49.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.697+0000 7f337307f700 1 Processor -- start 2019-11-28T11:52:49.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.697+0000 7f337307f700 1 -- start start 2019-11-28T11:52:49.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.698+0000 7f337307f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f336c06c490 0x7f336c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:49.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.698+0000 7f337307f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336c06db00 con 0x7f336c06ce60 2019-11-28T11:52:49.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.698+0000 7f337307f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336c06e000 con 0x7f336c06c0a0 2019-11-28T11:52:49.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.698+0000 7f337307f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336c06fd60 con 0x7f336c06c490 2019-11-28T11:52:49.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.698+0000 7f3370e1b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f336c06c490 0x7f336c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:49.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.698+0000 7f3371e1d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f336c06ce60 0x7f336c164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42828/0 (socket says 172.21.15.80:42828) 2019-11-28T11:52:49.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.698+0000 7f3371e1d700 1 -- 172.21.15.80:0/3632286941 learned_addr learned my addr 172.21.15.80:0/3632286941 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:49.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.699+0000 7f3370e1b700 1 -- 172.21.15.80:0/3632286941 >> v1:172.21.15.174:6789/0 conn(0x7f336c06c0a0 legacy=0x7f336c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:49.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.699+0000 7f3370e1b700 1 -- 172.21.15.80:0/3632286941 >> v1:172.21.15.80:6789/0 conn(0x7f336c06ce60 legacy=0x7f336c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:49.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.699+0000 7f3370e1b700 1 -- 172.21.15.80:0/3632286941 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c0706c0 con 0x7f336c06c490 2019-11-28T11:52:49.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.699+0000 7f336bfff700 1 -- 172.21.15.80:0/3632286941 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668983404 0 0) 0x7f3364001150 con 0x7f336c06ce60 2019-11-28T11:52:49.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.699+0000 7f3370e1b700 1 --2- 172.21.15.80:0/3632286941 >> v2:172.21.15.80:3300/0 conn(0x7f336c06c490 0x7f336c06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f335c00af50 tx=0x7f335c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.699+0000 7f3370e1b700 1 --2- 172.21.15.80:0/3632286941 >> v2:172.21.15.80:3300/0 conn(0x7f336c06c490 0x7f336c06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f335c00af50 tx=0x7f335c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.699+0000 7f3370e1b700 1 --2- 172.21.15.80:0/3632286941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c06c490 0x7f336c06c920 secure :-1 s=READY pgs=2289 cs=0 l=1 rx=0x7f335c00af50 tx=0x7f335c00b760).ready entity=mon.0 client_cookie=e99127034aef9195 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:49.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.699+0000 7f3370e1b700 1 --2- 172.21.15.80:0/3632286941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c06c490 0x7f336c06c920 secure :-1 s=THROTTLE_DONE pgs=2289 cs=0 l=1 rx=0x7f335c00af50 tx=0x7f335c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.699+0000 7f336bfff700 1 -- 172.21.15.80:0/3632286941 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f335c000960 con 0x7f336c06c490 2019-11-28T11:52:49.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.699+0000 7f3370e1b700 1 --2- 172.21.15.80:0/3632286941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c06c490 0x7f336c06c920 secure :-1 s=THROTTLE_DONE pgs=2289 cs=0 l=1 rx=0x7f335c00af50 tx=0x7f335c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.699+0000 7f3370e1b700 1 --2- 172.21.15.80:0/3632286941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c06c490 0x7f336c06c920 secure :-1 s=THROTTLE_DONE pgs=2289 cs=0 l=1 rx=0x7f335c00af50 tx=0x7f335c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.699+0000 7f336bfff700 1 -- 172.21.15.80:0/3632286941 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c009860 con 0x7f336c06c490 2019-11-28T11:52:49.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.699+0000 7f336bfff700 1 -- 172.21.15.80:0/3632286941 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f335c000960 con 0x7f336c06c490 2019-11-28T11:52:49.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.699+0000 7f337307f700 1 -- 172.21.15.80:0/3632286941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c06c490 msgr2=0x7f336c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:49.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.699+0000 7f337307f700 1 --2- 172.21.15.80:0/3632286941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c06c490 0x7f336c06c920 secure :-1 s=READY pgs=2289 cs=0 l=1 rx=0x7f335c00af50 tx=0x7f335c00b760).stop 2019-11-28T11:52:49.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.700+0000 7f337307f700 1 -- 172.21.15.80:0/3632286941 shutdown_connections 2019-11-28T11:52:49.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.700+0000 7f337307f700 1 --2- 172.21.15.80:0/3632286941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c06c490 0x7f336c06c920 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:49.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.700+0000 7f337307f700 1 -- 172.21.15.80:0/3632286941 shutdown_connections 2019-11-28T11:52:49.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.700+0000 7f337307f700 1 -- 172.21.15.80:0/3632286941 wait complete. 2019-11-28T11:52:49.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.700+0000 7f337307f700 1 -- 172.21.15.80:0/3632286941 >> 172.21.15.80:0/3632286941 conn(0x7f336c061cf0 msgr2=0x7f336c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:49.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.702+0000 7f337307f700 1 Processor -- start 2019-11-28T11:52:49.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.702+0000 7f337307f700 1 -- start start 2019-11-28T11:52:49.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.703+0000 7f337307f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f336c137500 0x7f336c137990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:49.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.703+0000 7f337307f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336c106fc0 con 0x7f336c1065d0 2019-11-28T11:52:49.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.703+0000 7f337307f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336c103350 con 0x7f336c137ed0 2019-11-28T11:52:49.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.703+0000 7f337307f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336c134680 con 0x7f336c137500 2019-11-28T11:52:49.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.703+0000 7f3370e1b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f336c137500 0x7f336c137990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:49.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.703+0000 7f3370e1b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f336c137500 0x7f336c137990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43518/0 (socket says 172.21.15.80:43518) 2019-11-28T11:52:49.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.703+0000 7f3370e1b700 1 -- 172.21.15.80:0/2345697853 learned_addr learned my addr 172.21.15.80:0/2345697853 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:49.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f3370e1b700 1 -- 172.21.15.80:0/2345697853 >> v1:172.21.15.174:6789/0 conn(0x7f336c137ed0 legacy=0x7f336c12d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:49.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f3370e1b700 1 -- 172.21.15.80:0/2345697853 >> v1:172.21.15.80:6789/0 conn(0x7f336c1065d0 legacy=0x7f336c138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:49.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f3370e1b700 1 -- 172.21.15.80:0/2345697853 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c134fe0 con 0x7f336c137500 2019-11-28T11:52:49.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f3370e1b700 1 --2- 172.21.15.80:0/2345697853 >> v2:172.21.15.80:3300/0 conn(0x7f336c137500 0x7f336c137990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f335c010470 tx=0x7f335c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f3370e1b700 1 --2- 172.21.15.80:0/2345697853 >> v2:172.21.15.80:3300/0 conn(0x7f336c137500 0x7f336c137990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f335c010470 tx=0x7f335c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f3370e1b700 1 --2- 172.21.15.80:0/2345697853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c137500 0x7f336c137990 secure :-1 s=READY pgs=2291 cs=0 l=1 rx=0x7f335c010470 tx=0x7f335c010810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:49.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f3370e1b700 1 --2- 172.21.15.80:0/2345697853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c137500 0x7f336c137990 secure :-1 s=THROTTLE_DONE pgs=2291 cs=0 l=1 rx=0x7f335c010470 tx=0x7f335c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f3369ffb700 1 -- 172.21.15.80:0/2345697853 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f335c000940 con 0x7f336c137500 2019-11-28T11:52:49.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f3370e1b700 1 --2- 172.21.15.80:0/2345697853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c137500 0x7f336c137990 secure :-1 s=THROTTLE_DONE pgs=2291 cs=0 l=1 rx=0x7f335c010470 tx=0x7f335c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f3370e1b700 1 --2- 172.21.15.80:0/2345697853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c137500 0x7f336c137990 secure :-1 s=THROTTLE_DONE pgs=2291 cs=0 l=1 rx=0x7f335c010470 tx=0x7f335c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f3369ffb700 1 -- 172.21.15.80:0/2345697853 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c009980 con 0x7f336c137500 2019-11-28T11:52:49.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f3369ffb700 1 -- 172.21.15.80:0/2345697853 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f335c000940 con 0x7f336c137500 2019-11-28T11:52:49.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f337307f700 1 -- 172.21.15.80:0/2345697853 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c135360 con 0x7f336c137500 2019-11-28T11:52:49.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f337307f700 1 -- 172.21.15.80:0/2345697853 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c136440 con 0x7f336c137500 2019-11-28T11:52:49.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f3370e1b700 1 --2- 172.21.15.80:0/2345697853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c137500 0x7f336c137990 secure :-1 s=THROTTLE_DONE pgs=2291 cs=0 l=1 rx=0x7f335c010470 tx=0x7f335c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f3369ffb700 1 -- 172.21.15.80:0/2345697853 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f335c009580 con 0x7f336c137500 2019-11-28T11:52:49.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.704+0000 7f3370e1b700 1 --2- 172.21.15.80:0/2345697853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c137500 0x7f336c137990 secure :-1 s=THROTTLE_DONE pgs=2291 cs=0 l=1 rx=0x7f335c010470 tx=0x7f335c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.705+0000 7f3369ffb700 1 --2- 172.21.15.80:0/2345697853 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3350018730 0x7f335001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:49.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.705+0000 7f3369ffb700 1 -- 172.21.15.80:0/2345697853 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f335c031b60 con 0x7f336c137500 2019-11-28T11:52:49.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.705+0000 7f337161c700 1 --2- 172.21.15.80:0/2345697853 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3350018730 0x7f335001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:49.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.705+0000 7f337161c700 1 --2- 172.21.15.80:0/2345697853 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3350018730 0x7f335001abc0 crc :-1 s=READY pgs=945 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:49.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.712+0000 7f337307f700 1 -- 172.21.15.80:0/2345697853 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336c134fe0 con 0x7f336c137500 2019-11-28T11:52:49.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.716+0000 7f3370e1b700 1 --2- 172.21.15.80:0/2345697853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c137500 0x7f336c137990 secure :-1 s=THROTTLE_DONE pgs=2291 cs=0 l=1 rx=0x7f335c010470 tx=0x7f335c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.716+0000 7f3369ffb700 1 -- 172.21.15.80:0/2345697853 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f335c000940 con 0x7f336c137500 2019-11-28T11:52:49.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.888+0000 7f337307f700 1 -- 172.21.15.80:0/2345697853 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f336c135360 con 0x7f336c137500 2019-11-28T11:52:49.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.889+0000 7f3370e1b700 1 --2- 172.21.15.80:0/2345697853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c137500 0x7f336c137990 secure :-1 s=THROTTLE_DONE pgs=2291 cs=0 l=1 rx=0x7f335c010470 tx=0x7f335c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:49.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.889+0000 7f3369ffb700 1 -- 172.21.15.80:0/2345697853 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f335c009580 con 0x7f336c137500 2019-11-28T11:52:49.944 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:52:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:49.945 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:49.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.891+0000 7f337307f700 1 -- 172.21.15.80:0/2345697853 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3350018730 msgr2=0x7f335001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:49.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.891+0000 7f337307f700 1 --2- 172.21.15.80:0/2345697853 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3350018730 0x7f335001abc0 crc :-1 s=READY pgs=945 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:49.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.891+0000 7f337307f700 1 -- 172.21.15.80:0/2345697853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c137500 msgr2=0x7f336c137990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:49.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.891+0000 7f337307f700 1 --2- 172.21.15.80:0/2345697853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c137500 0x7f336c137990 secure :-1 s=READY pgs=2291 cs=0 l=1 rx=0x7f335c010470 tx=0x7f335c010810).stop 2019-11-28T11:52:49.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.891+0000 7f337307f700 1 -- 172.21.15.80:0/2345697853 shutdown_connections 2019-11-28T11:52:49.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.891+0000 7f337307f700 1 --2- 172.21.15.80:0/2345697853 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3350018730 0x7f335001abc0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:49.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.891+0000 7f337307f700 1 --2- 172.21.15.80:0/2345697853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f336c137500 0x7f336c137990 unknown :-1 s=CLOSED pgs=2291 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:49.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.891+0000 7f337307f700 1 -- 172.21.15.80:0/2345697853 shutdown_connections 2019-11-28T11:52:49.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.891+0000 7f337307f700 1 -- 172.21.15.80:0/2345697853 wait complete. 2019-11-28T11:52:49.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:49.891+0000 7f337307f700 1 -- 172.21.15.80:0/2345697853 >> 172.21.15.80:0/2345697853 conn(0x7f336c13d930 msgr2=0x7f336c102360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:49.955 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:52:50.956 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:51.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.030+0000 7f882c235700 1 Processor -- start 2019-11-28T11:52:51.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.030+0000 7f882c235700 1 -- start start 2019-11-28T11:52:51.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.031+0000 7f882c235700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f882406c0a0 0x7f8824072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:51.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.031+0000 7f882c235700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882406db00 con 0x7f88240734e0 2019-11-28T11:52:51.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.031+0000 7f882c235700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882406e000 con 0x7f8824072620 2019-11-28T11:52:51.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.031+0000 7f882c235700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f882406fd60 con 0x7f882406c0a0 2019-11-28T11:52:51.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.031+0000 7f882a7d2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f882406c0a0 0x7f8824072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:51.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.031+0000 7f8829fd1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f88240734e0 0x7f8824071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42844/0 (socket says 172.21.15.80:42844) 2019-11-28T11:52:51.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.031+0000 7f882a7d2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f882406c0a0 0x7f8824072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43524/0 (socket says 172.21.15.80:43524) 2019-11-28T11:52:51.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.031+0000 7f8829fd1700 1 -- 172.21.15.80:0/3385267535 learned_addr learned my addr 172.21.15.80:0/3385267535 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:51.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.031+0000 7f882a7d2700 1 -- 172.21.15.80:0/3385267535 >> v1:172.21.15.174:6789/0 conn(0x7f8824072620 legacy=0x7f8824164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:51.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.031+0000 7f882a7d2700 1 -- 172.21.15.80:0/3385267535 >> v1:172.21.15.80:6789/0 conn(0x7f88240734e0 legacy=0x7f8824071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:51.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.031+0000 7f882a7d2700 1 -- 172.21.15.80:0/3385267535 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88240706c0 con 0x7f882406c0a0 2019-11-28T11:52:51.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.031+0000 7f88297d0700 1 -- 172.21.15.80:0/3385267535 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463570450 0 0) 0x7f880c001150 con 0x7f88240734e0 2019-11-28T11:52:51.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.032+0000 7f882a7d2700 1 --2- 172.21.15.80:0/3385267535 >> v2:172.21.15.80:3300/0 conn(0x7f882406c0a0 0x7f8824072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f881400af50 tx=0x7f881400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:51.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.032+0000 7f882a7d2700 1 --2- 172.21.15.80:0/3385267535 >> v2:172.21.15.80:3300/0 conn(0x7f882406c0a0 0x7f8824072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f881400af50 tx=0x7f881400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:51.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.032+0000 7f882a7d2700 1 --2- 172.21.15.80:0/3385267535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f882406c0a0 0x7f8824072fa0 secure :-1 s=READY pgs=2293 cs=0 l=1 rx=0x7f881400af50 tx=0x7f881400b760).ready entity=mon.0 client_cookie=8c32459fc02b19f4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:51.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.032+0000 7f882a7d2700 1 --2- 172.21.15.80:0/3385267535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f882406c0a0 0x7f8824072fa0 secure :-1 s=THROTTLE_DONE pgs=2293 cs=0 l=1 rx=0x7f881400af50 tx=0x7f881400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:51.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.032+0000 7f88297d0700 1 -- 172.21.15.80:0/3385267535 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8814007210 con 0x7f882406c0a0 2019-11-28T11:52:51.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.032+0000 7f882a7d2700 1 --2- 172.21.15.80:0/3385267535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f882406c0a0 0x7f8824072fa0 secure :-1 s=THROTTLE_DONE pgs=2293 cs=0 l=1 rx=0x7f881400af50 tx=0x7f881400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:51.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.032+0000 7f882a7d2700 1 --2- 172.21.15.80:0/3385267535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f882406c0a0 0x7f8824072fa0 secure :-1 s=THROTTLE_DONE pgs=2293 cs=0 l=1 rx=0x7f881400af50 tx=0x7f881400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:51.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.032+0000 7f88297d0700 1 -- 172.21.15.80:0/3385267535 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88140099b0 con 0x7f882406c0a0 2019-11-28T11:52:51.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.032+0000 7f88297d0700 1 -- 172.21.15.80:0/3385267535 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f881400a080 con 0x7f882406c0a0 2019-11-28T11:52:51.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.032+0000 7f882c235700 1 -- 172.21.15.80:0/3385267535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f882406c0a0 msgr2=0x7f8824072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:51.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.032+0000 7f882c235700 1 --2- 172.21.15.80:0/3385267535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f882406c0a0 0x7f8824072fa0 secure :-1 s=READY pgs=2293 cs=0 l=1 rx=0x7f881400af50 tx=0x7f881400b760).stop 2019-11-28T11:52:51.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.033+0000 7f882c235700 1 -- 172.21.15.80:0/3385267535 shutdown_connections 2019-11-28T11:52:51.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.033+0000 7f882c235700 1 --2- 172.21.15.80:0/3385267535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f882406c0a0 0x7f8824072fa0 unknown :-1 s=CLOSED pgs=2293 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:51.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.033+0000 7f882c235700 1 -- 172.21.15.80:0/3385267535 shutdown_connections 2019-11-28T11:52:51.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.033+0000 7f882c235700 1 -- 172.21.15.80:0/3385267535 wait complete. 2019-11-28T11:52:51.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.033+0000 7f882c235700 1 -- 172.21.15.80:0/3385267535 >> 172.21.15.80:0/3385267535 conn(0x7f8824061cf0 msgr2=0x7f8824064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:51.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.035+0000 7f882c235700 1 Processor -- start 2019-11-28T11:52:51.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.035+0000 7f882c235700 1 -- start start 2019-11-28T11:52:51.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.036+0000 7f882c235700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f882413f580 0x7f8824114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:51.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.036+0000 7f882c235700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f882411edb0 0x7f8824168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:51.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.036+0000 7f882c235700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882413fc20 con 0x7f8824114670 2019-11-28T11:52:51.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.036+0000 7f882c235700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8824122c80 con 0x7f882411edb0 2019-11-28T11:52:51.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.036+0000 7f882c235700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8824122140 con 0x7f882413f580 2019-11-28T11:52:51.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.036+0000 7f8829fd1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8824114670 0x7f882411e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42848/0 (socket says 172.21.15.80:42848) 2019-11-28T11:52:51.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.036+0000 7f8829fd1700 1 -- 172.21.15.80:0/2552074688 learned_addr learned my addr 172.21.15.80:0/2552074688 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:51.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.036+0000 7f882a7d2700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f882413f580 0x7f8824114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:51.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.036+0000 7f882afd3700 1 --2- 172.21.15.80:0/2552074688 >> v2:172.21.15.174:3300/0 conn(0x7f882411edb0 0x7f8824168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:51.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.036+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174900723 0 0) 0x7f880c001150 con 0x7f8824114670 2019-11-28T11:52:51.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.036+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8808002e80 con 0x7f8824114670 2019-11-28T11:52:51.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.036+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1542066672 0 0) 0x7f880c001300 con 0x7f8824114670 2019-11-28T11:52:51.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.036+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f88080032e0 con 0x7f8824114670 2019-11-28T11:52:51.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.036+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f880c0018d0 con 0x7f8824114670 2019-11-28T11:52:51.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f882413f580 msgr2=0x7f8824114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:51.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f8822ffd700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f882413f580 0x7f8824114130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:51.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 >> v2:172.21.15.174:3300/0 conn(0x7f882411edb0 msgr2=0x7f8824168a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:51.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f8822ffd700 1 --2- 172.21.15.80:0/2552074688 >> v2:172.21.15.174:3300/0 conn(0x7f882411edb0 0x7f8824168a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:51.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 >> v1:172.21.15.80:6789/0 conn(0x7f8824114670 legacy=0x7f882411e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:51.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f8822ffd700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8808003370 0x7f88080037a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:51.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f8822ffd700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8808003ce0 0x7f8808004150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:51.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f8822ffd700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8808004830 0x7f8808004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:51.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880800bb60 con 0x7f8808003370 2019-11-28T11:52:51.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880800bd60 con 0x7f8808004830 2019-11-28T11:52:51.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880800bf90 con 0x7f8808003ce0 2019-11-28T11:52:51.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f882a7d2700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8808003370 0x7f88080037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:51.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f882afd3700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8808004830 0x7f8808004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:51.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f8829fd1700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8808003ce0 0x7f8808004150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:51.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f882a7d2700 1 -- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8808003ce0 msgr2=0x7f8808004150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:51.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f882a7d2700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8808003ce0 0x7f8808004150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:51.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f882a7d2700 1 -- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8808004830 msgr2=0x7f8808004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:51.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f882a7d2700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8808004830 0x7f8808004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:51.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f882a7d2700 1 -- 172.21.15.80:0/2552074688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880800c240 con 0x7f8808003370 2019-11-28T11:52:51.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f882c235700 1 -- 172.21.15.80:0/2552074688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8824124010 con 0x7f8808003370 2019-11-28T11:52:51.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f882a7d2700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8808003370 0x7f88080037a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8814010350 tx=0x7f8814010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:51.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f882afd3700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8808004830 0x7f8808004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:52:51.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f882c235700 1 -- 172.21.15.80:0/2552074688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882413fc20 con 0x7f8808003370 2019-11-28T11:52:51.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f882a7d2700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8808003370 0x7f88080037a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8814010350 tx=0x7f8814010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:51.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f882a7d2700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8808003370 0x7f88080037a0 secure :-1 s=READY pgs=2295 cs=0 l=1 rx=0x7f8814010350 tx=0x7f8814010200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:51.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f882a7d2700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8808003370 0x7f88080037a0 secure :-1 s=THROTTLE_DONE pgs=2295 cs=0 l=1 rx=0x7f8814010350 tx=0x7f8814010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:51.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8814000940 con 0x7f8808003370 2019-11-28T11:52:51.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f882a7d2700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8808003370 0x7f88080037a0 secure :-1 s=THROTTLE_DONE pgs=2295 cs=0 l=1 rx=0x7f8814010350 tx=0x7f8814010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:51.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f882a7d2700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8808003370 0x7f88080037a0 secure :-1 s=THROTTLE_DONE pgs=2295 cs=0 l=1 rx=0x7f8814010350 tx=0x7f8814010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:51.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8814009770 con 0x7f8808003370 2019-11-28T11:52:51.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.037+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8814009e00 con 0x7f8808003370 2019-11-28T11:52:51.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.038+0000 7f882a7d2700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8808003370 0x7f88080037a0 secure :-1 s=THROTTLE_DONE pgs=2295 cs=0 l=1 rx=0x7f8814010350 tx=0x7f8814010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:51.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.038+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8814009960 con 0x7f8808003370 2019-11-28T11:52:51.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.038+0000 7f882a7d2700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8808003370 0x7f88080037a0 secure :-1 s=THROTTLE_DONE pgs=2295 cs=0 l=1 rx=0x7f8814010350 tx=0x7f8814010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:51.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.038+0000 7f8822ffd700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8808020ac0 0x7f8808022f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:51.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.038+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8814031c10 con 0x7f8808003370 2019-11-28T11:52:51.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.038+0000 7f8829fd1700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8808020ac0 0x7f8808022f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:51.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.038+0000 7f8829fd1700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8808020ac0 0x7f8808022f10 crc :-1 s=READY pgs=946 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:51.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.045+0000 7f882c235700 1 -- 172.21.15.80:0/2552074688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8824124010 con 0x7f8808003370 2019-11-28T11:52:51.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.049+0000 7f882a7d2700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8808003370 0x7f88080037a0 secure :-1 s=THROTTLE_DONE pgs=2295 cs=0 l=1 rx=0x7f8814010350 tx=0x7f8814010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:51.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.049+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f881400b5b0 con 0x7f8808003370 2019-11-28T11:52:51.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.220+0000 7f882c235700 1 -- 172.21.15.80:0/2552074688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8824124010 con 0x7f8808003370 2019-11-28T11:52:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.221+0000 7f882a7d2700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8808003370 0x7f88080037a0 secure :-1 s=THROTTLE_DONE pgs=2295 cs=0 l=1 rx=0x7f8814010350 tx=0x7f8814010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:51.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.221+0000 7f8822ffd700 1 -- 172.21.15.80:0/2552074688 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f8814009750 con 0x7f8808003370 2019-11-28T11:52:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:52:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:51.275 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:51.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.223+0000 7f882c235700 1 -- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8808020ac0 msgr2=0x7f8808022f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:51.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.223+0000 7f882c235700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8808020ac0 0x7f8808022f10 crc :-1 s=READY pgs=946 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:51.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.223+0000 7f882c235700 1 -- 172.21.15.80:0/2552074688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8808003370 msgr2=0x7f88080037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:51.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.223+0000 7f882c235700 1 --2- 172.21.15.80:0/2552074688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8808003370 0x7f88080037a0 secure :-1 s=READY pgs=2295 cs=0 l=1 rx=0x7f8814010350 tx=0x7f8814010200).stop 2019-11-28T11:52:51.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.223+0000 7f882afd3700 1 -- 172.21.15.80:0/2552074688 reap_dead start 2019-11-28T11:52:51.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.223+0000 7f882c235700 1 -- 172.21.15.80:0/2552074688 shutdown_connections 2019-11-28T11:52:51.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.223+0000 7f882c235700 1 -- 172.21.15.80:0/2552074688 shutdown_connections 2019-11-28T11:52:51.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.223+0000 7f882c235700 1 -- 172.21.15.80:0/2552074688 wait complete. 2019-11-28T11:52:51.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:51.223+0000 7f882c235700 1 -- 172.21.15.80:0/2552074688 >> 172.21.15.80:0/2552074688 conn(0x7f88241426c0 msgr2=0x7f8824110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:51.288 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:52:52.289 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:52.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.358+0000 7f45fda3e700 1 Processor -- start 2019-11-28T11:52:52.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.358+0000 7f45fda3e700 1 -- start start 2019-11-28T11:52:52.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.359+0000 7f45fda3e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f45f806d120 0x7f45f8165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:52.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.359+0000 7f45fda3e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f806d5a0 con 0x7f45f806c0a0 2019-11-28T11:52:52.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.359+0000 7f45fda3e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f806db00 con 0x7f45f806c490 2019-11-28T11:52:52.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.359+0000 7f45fda3e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f806fd60 con 0x7f45f806d120 2019-11-28T11:52:52.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.359+0000 7f45f7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f45f806d120 0x7f45f8165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:52.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.359+0000 7f45f77fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f45f806c0a0 0x7f45f8072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42860/0 (socket says 172.21.15.80:42860) 2019-11-28T11:52:52.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.359+0000 7f45f7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f45f806d120 0x7f45f8165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43546/0 (socket says 172.21.15.80:43546) 2019-11-28T11:52:52.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.359+0000 7f45f77fe700 1 -- 172.21.15.80:0/393077100 learned_addr learned my addr 172.21.15.80:0/393077100 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:52.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.360+0000 7f45f7fff700 1 -- 172.21.15.80:0/393077100 >> v1:172.21.15.174:6789/0 conn(0x7f45f806c490 legacy=0x7f45f806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:52.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.360+0000 7f45f7fff700 1 -- 172.21.15.80:0/393077100 >> v1:172.21.15.80:6789/0 conn(0x7f45f806c0a0 legacy=0x7f45f8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:52.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.360+0000 7f45f67fc700 1 -- 172.21.15.80:0/393077100 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979799476 0 0) 0x7f45e8001150 con 0x7f45f806c0a0 2019-11-28T11:52:52.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.360+0000 7f45f7fff700 1 -- 172.21.15.80:0/393077100 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f80706c0 con 0x7f45f806d120 2019-11-28T11:52:52.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.360+0000 7f45f7fff700 1 --2- 172.21.15.80:0/393077100 >> v2:172.21.15.80:3300/0 conn(0x7f45f806d120 0x7f45f8165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f45f000af50 tx=0x7f45f000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:52.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.360+0000 7f45f7fff700 1 --2- 172.21.15.80:0/393077100 >> v2:172.21.15.80:3300/0 conn(0x7f45f806d120 0x7f45f8165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f45f000af50 tx=0x7f45f000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:52.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.360+0000 7f45f7fff700 1 --2- 172.21.15.80:0/393077100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45f806d120 0x7f45f8165d80 secure :-1 s=READY pgs=2297 cs=0 l=1 rx=0x7f45f000af50 tx=0x7f45f000b760).ready entity=mon.0 client_cookie=732eeec5cfc215a1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:52.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.360+0000 7f45f7fff700 1 --2- 172.21.15.80:0/393077100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45f806d120 0x7f45f8165d80 secure :-1 s=THROTTLE_DONE pgs=2297 cs=0 l=1 rx=0x7f45f000af50 tx=0x7f45f000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:52.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.360+0000 7f45f67fc700 1 -- 172.21.15.80:0/393077100 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f0009ba0 con 0x7f45f806d120 2019-11-28T11:52:52.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.360+0000 7f45f7fff700 1 --2- 172.21.15.80:0/393077100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45f806d120 0x7f45f8165d80 secure :-1 s=THROTTLE_DONE pgs=2297 cs=0 l=1 rx=0x7f45f000af50 tx=0x7f45f000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:52.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.360+0000 7f45f67fc700 1 -- 172.21.15.80:0/393077100 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f0000a70 con 0x7f45f806d120 2019-11-28T11:52:52.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.360+0000 7f45f7fff700 1 --2- 172.21.15.80:0/393077100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45f806d120 0x7f45f8165d80 secure :-1 s=THROTTLE_DONE pgs=2297 cs=0 l=1 rx=0x7f45f000af50 tx=0x7f45f000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:52.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.360+0000 7f45f67fc700 1 -- 172.21.15.80:0/393077100 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f0009ba0 con 0x7f45f806d120 2019-11-28T11:52:52.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.360+0000 7f45fda3e700 1 -- 172.21.15.80:0/393077100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45f806d120 msgr2=0x7f45f8165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:52.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.360+0000 7f45fda3e700 1 --2- 172.21.15.80:0/393077100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45f806d120 0x7f45f8165d80 secure :-1 s=READY pgs=2297 cs=0 l=1 rx=0x7f45f000af50 tx=0x7f45f000b760).stop 2019-11-28T11:52:52.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.361+0000 7f45fda3e700 1 -- 172.21.15.80:0/393077100 shutdown_connections 2019-11-28T11:52:52.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.361+0000 7f45fda3e700 1 --2- 172.21.15.80:0/393077100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45f806d120 0x7f45f8165d80 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:52.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.361+0000 7f45fda3e700 1 -- 172.21.15.80:0/393077100 shutdown_connections 2019-11-28T11:52:52.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.361+0000 7f45fda3e700 1 -- 172.21.15.80:0/393077100 wait complete. 2019-11-28T11:52:52.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.361+0000 7f45fda3e700 1 -- 172.21.15.80:0/393077100 >> 172.21.15.80:0/393077100 conn(0x7f45f8061cf0 msgr2=0x7f45f8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:52.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.363+0000 7f45fda3e700 1 Processor -- start 2019-11-28T11:52:52.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.364+0000 7f45fda3e700 1 -- start start 2019-11-28T11:52:52.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.364+0000 7f45fda3e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f45f812cea0 0x7f45f8111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:52.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.364+0000 7f45fda3e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f8124260 con 0x7f45f8165a00 2019-11-28T11:52:52.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.364+0000 7f45fda3e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f812e5d0 con 0x7f45f81230e0 2019-11-28T11:52:52.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.364+0000 7f45fda3e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f8121040 con 0x7f45f812cea0 2019-11-28T11:52:52.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45f7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f45f8165a00 0x7f45f8167e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42870/0 (socket says 172.21.15.80:42870) 2019-11-28T11:52:52.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45f7fff700 1 -- 172.21.15.80:0/3229282926 learned_addr learned my addr 172.21.15.80:0/3229282926 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:52.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45f77fe700 1 --2- 172.21.15.80:0/3229282926 >> v2:172.21.15.174:3300/0 conn(0x7f45f812cea0 0x7f45f8111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:52.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45effff700 1 -- 172.21.15.80:0/3229282926 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876477392 0 0) 0x7f45f0000940 con 0x7f45f8165a00 2019-11-28T11:52:52.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45effff700 1 -- 172.21.15.80:0/3229282926 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45d0002e80 con 0x7f45f8165a00 2019-11-28T11:52:52.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45effff700 1 -- 172.21.15.80:0/3229282926 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2686783908 0 0) 0x7f45f0000b60 con 0x7f45f8165a00 2019-11-28T11:52:52.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45effff700 1 -- 172.21.15.80:0/3229282926 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f45d00032e0 con 0x7f45f8165a00 2019-11-28T11:52:52.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45effff700 1 -- 172.21.15.80:0/3229282926 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f45f000afc0 con 0x7f45f8165a00 2019-11-28T11:52:52.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45f77fe700 1 -- 172.21.15.80:0/3229282926 >> v1:172.21.15.174:6789/0 conn(0x7f45f81230e0 legacy=0x7f45f8123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:52.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45f77fe700 1 -- 172.21.15.80:0/3229282926 >> v1:172.21.15.80:6789/0 conn(0x7f45f8165a00 legacy=0x7f45f8167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:52.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45f77fe700 1 -- 172.21.15.80:0/3229282926 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f81219a0 con 0x7f45f812cea0 2019-11-28T11:52:52.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45f77fe700 1 --2- 172.21.15.80:0/3229282926 >> v2:172.21.15.174:3300/0 conn(0x7f45f812cea0 0x7f45f8111db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f45e8010370 tx=0x7f45e8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:52.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45f77fe700 1 --2- 172.21.15.80:0/3229282926 >> v2:172.21.15.174:3300/0 conn(0x7f45f812cea0 0x7f45f8111db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f45e8010370 tx=0x7f45e8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:52.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45f77fe700 1 --2- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45f812cea0 0x7f45f8111db0 secure :-1 s=READY pgs=1379 cs=0 l=1 rx=0x7f45e8010370 tx=0x7f45e8010710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:52.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45f77fe700 1 --2- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45f812cea0 0x7f45f8111db0 secure :-1 s=THROTTLE_DONE pgs=1379 cs=0 l=1 rx=0x7f45e8010370 tx=0x7f45e8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:52.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45effff700 1 -- 172.21.15.80:0/3229282926 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45e8000ef0 con 0x7f45f812cea0 2019-11-28T11:52:52.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45f77fe700 1 --2- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45f812cea0 0x7f45f8111db0 secure :-1 s=THROTTLE_DONE pgs=1379 cs=0 l=1 rx=0x7f45e8010370 tx=0x7f45e8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:52.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45effff700 1 -- 172.21.15.80:0/3229282926 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e8004240 con 0x7f45f812cea0 2019-11-28T11:52:52.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45f77fe700 1 --2- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45f812cea0 0x7f45f8111db0 secure :-1 s=THROTTLE_DONE pgs=1379 cs=0 l=1 rx=0x7f45e8010370 tx=0x7f45e8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:52.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45effff700 1 -- 172.21.15.80:0/3229282926 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45e8001200 con 0x7f45f812cea0 2019-11-28T11:52:52.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45fda3e700 1 -- 172.21.15.80:0/3229282926 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f8121d20 con 0x7f45f812cea0 2019-11-28T11:52:52.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.365+0000 7f45fda3e700 1 -- 172.21.15.80:0/3229282926 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f81122f0 con 0x7f45f812cea0 2019-11-28T11:52:52.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.366+0000 7f45f77fe700 1 --2- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45f812cea0 0x7f45f8111db0 secure :-1 s=THROTTLE_DONE pgs=1379 cs=0 l=1 rx=0x7f45e8010370 tx=0x7f45e8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:52.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.366+0000 7f45effff700 1 -- 172.21.15.80:0/3229282926 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f45e8004430 con 0x7f45f812cea0 2019-11-28T11:52:52.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.366+0000 7f45f77fe700 1 --2- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45f812cea0 0x7f45f8111db0 secure :-1 s=THROTTLE_DONE pgs=1379 cs=0 l=1 rx=0x7f45e8010370 tx=0x7f45e8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:52.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.366+0000 7f45effff700 1 --2- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f45d0018770 0x7f45d001ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:52.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.366+0000 7f45effff700 1 -- 172.21.15.80:0/3229282926 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f45e8031a60 con 0x7f45f812cea0 2019-11-28T11:52:52.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.366+0000 7f45f6ffd700 1 --2- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f45d0018770 0x7f45d001ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:52.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.367+0000 7f45f6ffd700 1 --2- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f45d0018770 0x7f45d001ac00 crc :-1 s=READY pgs=947 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:52.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.374+0000 7f45fda3e700 1 -- 172.21.15.80:0/3229282926 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f81219a0 con 0x7f45f812cea0 2019-11-28T11:52:52.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.377+0000 7f45f77fe700 1 --2- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45f812cea0 0x7f45f8111db0 secure :-1 s=THROTTLE_DONE pgs=1379 cs=0 l=1 rx=0x7f45e8010370 tx=0x7f45e8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:52.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.377+0000 7f45effff700 1 -- 172.21.15.80:0/3229282926 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f45e8000c90 con 0x7f45f812cea0 2019-11-28T11:52:52.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.553+0000 7f45fda3e700 1 -- 172.21.15.80:0/3229282926 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45f8121d20 con 0x7f45f812cea0 2019-11-28T11:52:52.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.553+0000 7f45f77fe700 1 --2- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45f812cea0 0x7f45f8111db0 secure :-1 s=THROTTLE_DONE pgs=1379 cs=0 l=1 rx=0x7f45e8010370 tx=0x7f45e8010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:52.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.554+0000 7f45effff700 1 -- 172.21.15.80:0/3229282926 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f45e8004430 con 0x7f45f812cea0 2019-11-28T11:52:52.607 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:52:52.607 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:52.607 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:52.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.556+0000 7f45fda3e700 1 -- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f45d0018770 msgr2=0x7f45d001ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:52.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.556+0000 7f45fda3e700 1 --2- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f45d0018770 0x7f45d001ac00 crc :-1 s=READY pgs=947 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:52.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.556+0000 7f45fda3e700 1 -- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45f812cea0 msgr2=0x7f45f8111db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:52.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.556+0000 7f45fda3e700 1 --2- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45f812cea0 0x7f45f8111db0 secure :-1 s=READY pgs=1379 cs=0 l=1 rx=0x7f45e8010370 tx=0x7f45e8010710).stop 2019-11-28T11:52:52.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.556+0000 7f45fda3e700 1 -- 172.21.15.80:0/3229282926 shutdown_connections 2019-11-28T11:52:52.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.556+0000 7f45fda3e700 1 --2- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f45d0018770 0x7f45d001ac00 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:52.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.556+0000 7f45fda3e700 1 --2- 172.21.15.80:0/3229282926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45f812cea0 0x7f45f8111db0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:52.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.556+0000 7f45fda3e700 1 -- 172.21.15.80:0/3229282926 shutdown_connections 2019-11-28T11:52:52.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.556+0000 7f45fda3e700 1 -- 172.21.15.80:0/3229282926 wait complete. 2019-11-28T11:52:52.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:52.556+0000 7f45fda3e700 1 -- 172.21.15.80:0/3229282926 >> 172.21.15.80:0/3229282926 conn(0x7f45f81426c0 msgr2=0x7f45f8110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:52.619 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:52:53.620 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:53.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.688+0000 7fb735d6d700 1 Processor -- start 2019-11-28T11:52:53.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.688+0000 7fb735d6d700 1 -- start start 2019-11-28T11:52:53.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.689+0000 7fb735d6d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb73006c490 0x7fb73006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:53.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.689+0000 7fb735d6d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb73006db00 con 0x7fb73006c0a0 2019-11-28T11:52:53.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.689+0000 7fb735d6d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb73006e000 con 0x7fb73006ce60 2019-11-28T11:52:53.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.689+0000 7fb735d6d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73006fd60 con 0x7fb73006c490 2019-11-28T11:52:53.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb73006c0a0 0x7fb730072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42874/0 (socket says 172.21.15.80:42874) 2019-11-28T11:52:53.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72ffff700 1 -- 172.21.15.80:0/3041584659 learned_addr learned my addr 172.21.15.80:0/3041584659 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:53.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb727fff700 1 --2- 172.21.15.80:0/3041584659 >> v2:172.21.15.174:3300/0 conn(0x7fb73006c490 0x7fb73006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:53.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72f7fe700 1 -- 172.21.15.80:0/3041584659 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935617459 0 0) 0x7fb720001150 con 0x7fb73006c0a0 2019-11-28T11:52:53.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72f7fe700 1 -- 172.21.15.80:0/3041584659 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb71c002e80 con 0x7fb73006c0a0 2019-11-28T11:52:53.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72f7fe700 1 -- 172.21.15.80:0/3041584659 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1231943255 0 0) 0x7fb720001130 con 0x7fb73006c0a0 2019-11-28T11:52:53.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72f7fe700 1 -- 172.21.15.80:0/3041584659 >> v2:172.21.15.174:3300/0 conn(0x7fb73006c490 msgr2=0x7fb73006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:53.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72f7fe700 1 --2- 172.21.15.80:0/3041584659 >> v2:172.21.15.174:3300/0 conn(0x7fb73006c490 0x7fb73006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:53.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72f7fe700 1 -- 172.21.15.80:0/3041584659 >> v1:172.21.15.174:6789/0 conn(0x7fb73006ce60 legacy=0x7fb730164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:53.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72f7fe700 1 -- 172.21.15.80:0/3041584659 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7300706c0 con 0x7fb73006c0a0 2019-11-28T11:52:53.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72f7fe700 1 -- 172.21.15.80:0/3041584659 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fb720001660 con 0x7fb73006c0a0 2019-11-28T11:52:53.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72f7fe700 1 -- 172.21.15.80:0/3041584659 >> v1:172.21.15.80:6789/0 conn(0x7fb73006c0a0 legacy=0x7fb730072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:53.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72f7fe700 1 --2- 172.21.15.80:0/3041584659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb71c003ab0 0x7fb71c005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72f7fe700 1 --2- 172.21.15.80:0/3041584659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb71c006690 0x7fb71c008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72f7fe700 1 --2- 172.21.15.80:0/3041584659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb71c009380 0x7fb71c00b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72f7fe700 1 -- 172.21.15.80:0/3041584659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c00c000 con 0x7fb71c006690 2019-11-28T11:52:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72f7fe700 1 -- 172.21.15.80:0/3041584659 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c050200 con 0x7fb71c009380 2019-11-28T11:52:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72f7fe700 1 -- 172.21.15.80:0/3041584659 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c050430 con 0x7fb71c003ab0 2019-11-28T11:52:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb727fff700 1 --2- 172.21.15.80:0/3041584659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb71c006690 0x7fb71c008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:53.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb72ffff700 1 --2- 172.21.15.80:0/3041584659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb71c003ab0 0x7fb71c005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:53.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb734b0b700 1 --2- 172.21.15.80:0/3041584659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb71c009380 0x7fb71c00b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:53.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb727fff700 1 -- 172.21.15.80:0/3041584659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb71c003ab0 msgr2=0x7fb71c005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:53.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb727fff700 1 --2- 172.21.15.80:0/3041584659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb71c003ab0 0x7fb71c005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:53.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb727fff700 1 -- 172.21.15.80:0/3041584659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb71c009380 msgr2=0x7fb71c00b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:53.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb727fff700 1 --2- 172.21.15.80:0/3041584659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb71c009380 0x7fb71c00b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:53.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb734b0b700 1 -- 172.21.15.80:0/3041584659 reap_dead start 2019-11-28T11:52:53.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.690+0000 7fb727fff700 1 -- 172.21.15.80:0/3041584659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c0506e0 con 0x7fb71c006690 2019-11-28T11:52:53.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.691+0000 7fb727fff700 1 --2- 172.21.15.80:0/3041584659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb71c006690 0x7fb71c008b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb71800a840 tx=0x7fb71800aab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:53.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.691+0000 7fb727fff700 1 --2- 172.21.15.80:0/3041584659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb71c006690 0x7fb71c008b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb71800a840 tx=0x7fb71800aab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:53.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.691+0000 7fb727fff700 1 --2- 172.21.15.80:0/3041584659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb71c006690 0x7fb71c008b20 secure :-1 s=READY pgs=2300 cs=0 l=1 rx=0x7fb71800a840 tx=0x7fb71800aab0).ready entity=mon.0 client_cookie=eee4a17a0cbbe272 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:53.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.691+0000 7fb727fff700 1 --2- 172.21.15.80:0/3041584659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb71c006690 0x7fb71c008b20 secure :-1 s=THROTTLE_DONE pgs=2300 cs=0 l=1 rx=0x7fb71800a840 tx=0x7fb71800aab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:53.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.691+0000 7fb72f7fe700 1 -- 172.21.15.80:0/3041584659 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb718000960 con 0x7fb71c006690 2019-11-28T11:52:53.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.691+0000 7fb727fff700 1 --2- 172.21.15.80:0/3041584659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb71c006690 0x7fb71c008b20 secure :-1 s=THROTTLE_DONE pgs=2300 cs=0 l=1 rx=0x7fb71800a840 tx=0x7fb71800aab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:53.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.691+0000 7fb72f7fe700 1 -- 172.21.15.80:0/3041584659 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb718000960 con 0x7fb71c006690 2019-11-28T11:52:53.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.691+0000 7fb727fff700 1 --2- 172.21.15.80:0/3041584659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb71c006690 0x7fb71c008b20 secure :-1 s=THROTTLE_DONE pgs=2300 cs=0 l=1 rx=0x7fb71800a840 tx=0x7fb71800aab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:53.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.691+0000 7fb72f7fe700 1 -- 172.21.15.80:0/3041584659 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb718009960 con 0x7fb71c006690 2019-11-28T11:52:53.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.691+0000 7fb735d6d700 1 -- 172.21.15.80:0/3041584659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb71c006690 msgr2=0x7fb71c008b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:53.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.691+0000 7fb735d6d700 1 --2- 172.21.15.80:0/3041584659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb71c006690 0x7fb71c008b20 secure :-1 s=READY pgs=2300 cs=0 l=1 rx=0x7fb71800a840 tx=0x7fb71800aab0).stop 2019-11-28T11:52:53.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.691+0000 7fb735d6d700 1 -- 172.21.15.80:0/3041584659 shutdown_connections 2019-11-28T11:52:53.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.691+0000 7fb735d6d700 1 --2- 172.21.15.80:0/3041584659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb71c006690 0x7fb71c008b20 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:53.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.692+0000 7fb735d6d700 1 -- 172.21.15.80:0/3041584659 shutdown_connections 2019-11-28T11:52:53.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.692+0000 7fb735d6d700 1 -- 172.21.15.80:0/3041584659 wait complete. 2019-11-28T11:52:53.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.692+0000 7fb735d6d700 1 -- 172.21.15.80:0/3041584659 >> 172.21.15.80:0/3041584659 conn(0x7fb730061cf0 msgr2=0x7fb730064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:53.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.694+0000 7fb735d6d700 1 Processor -- start 2019-11-28T11:52:53.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.694+0000 7fb735d6d700 1 -- start start 2019-11-28T11:52:53.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb735d6d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb7300750f0 0x7fb730151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:53.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb735d6d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb730151f90 0x7fb7301523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:53.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb735d6d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb730079230 con 0x7fb730074d00 2019-11-28T11:52:53.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb735d6d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73007ab30 con 0x7fb7300750f0 2019-11-28T11:52:53.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb735d6d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73007ae00 con 0x7fb730151f90 2019-11-28T11:52:53.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb727fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb7300750f0 0x7fb730151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:53.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb727fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb7300750f0 0x7fb730151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43572/0 (socket says 172.21.15.80:43572) 2019-11-28T11:52:53.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb727fff700 1 -- 172.21.15.80:0/2105284112 learned_addr learned my addr 172.21.15.80:0/2105284112 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:53.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb734b0b700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb730151f90 0x7fb7301523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:53.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb727fff700 1 -- 172.21.15.80:0/2105284112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb730151f90 msgr2=0x7fb7301523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:53.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb727fff700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb730151f90 0x7fb7301523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:53.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb727fff700 1 -- 172.21.15.80:0/2105284112 >> v1:172.21.15.174:6789/0 conn(0x7fb730074d00 legacy=0x7fb730152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:53.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb727fff700 1 -- 172.21.15.80:0/2105284112 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73007b490 con 0x7fb7300750f0 2019-11-28T11:52:53.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb727fff700 1 --2- 172.21.15.80:0/2105284112 >> v2:172.21.15.80:3300/0 conn(0x7fb7300750f0 0x7fb730151a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb718010450 tx=0x7fb718010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:53.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb727fff700 1 --2- 172.21.15.80:0/2105284112 >> v2:172.21.15.80:3300/0 conn(0x7fb7300750f0 0x7fb730151a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb718010450 tx=0x7fb718010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:53.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb727fff700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7300750f0 0x7fb730151a50 secure :-1 s=READY pgs=2301 cs=0 l=1 rx=0x7fb718010450 tx=0x7fb718010250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:53.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb727fff700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7300750f0 0x7fb730151a50 secure :-1 s=THROTTLE_DONE pgs=2301 cs=0 l=1 rx=0x7fb718010450 tx=0x7fb718010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:53.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb727fff700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7300750f0 0x7fb730151a50 secure :-1 s=THROTTLE_DONE pgs=2301 cs=0 l=1 rx=0x7fb718010450 tx=0x7fb718010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:53.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb727fff700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7300750f0 0x7fb730151a50 secure :-1 s=THROTTLE_DONE pgs=2301 cs=0 l=1 rx=0x7fb718010450 tx=0x7fb718010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:53.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb72d7fa700 1 -- 172.21.15.80:0/2105284112 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb718009790 con 0x7fb7300750f0 2019-11-28T11:52:53.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb72d7fa700 1 -- 172.21.15.80:0/2105284112 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71800a950 con 0x7fb7300750f0 2019-11-28T11:52:53.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.695+0000 7fb735d6d700 1 -- 172.21.15.80:0/2105284112 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73007b810 con 0x7fb7300750f0 2019-11-28T11:52:53.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.696+0000 7fb72d7fa700 1 -- 172.21.15.80:0/2105284112 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb718009e50 con 0x7fb7300750f0 2019-11-28T11:52:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.696+0000 7fb735d6d700 1 -- 172.21.15.80:0/2105284112 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb73007b490 con 0x7fb7300750f0 2019-11-28T11:52:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.696+0000 7fb727fff700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7300750f0 0x7fb730151a50 secure :-1 s=THROTTLE_DONE pgs=2301 cs=0 l=1 rx=0x7fb718010450 tx=0x7fb718010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.696+0000 7fb72d7fa700 1 -- 172.21.15.80:0/2105284112 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb718009620 con 0x7fb7300750f0 2019-11-28T11:52:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.696+0000 7fb727fff700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7300750f0 0x7fb730151a50 secure :-1 s=THROTTLE_DONE pgs=2301 cs=0 l=1 rx=0x7fb718010450 tx=0x7fb718010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.696+0000 7fb72d7fa700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb714018730 0x7fb71401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.696+0000 7fb72d7fa700 1 -- 172.21.15.80:0/2105284112 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fb718031ac0 con 0x7fb7300750f0 2019-11-28T11:52:53.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.696+0000 7fb72ffff700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb714018730 0x7fb71401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:53.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.697+0000 7fb72ffff700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb714018730 0x7fb71401abc0 crc :-1 s=READY pgs=948 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:53.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.703+0000 7fb735d6d700 1 -- 172.21.15.80:0/2105284112 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73007b810 con 0x7fb7300750f0 2019-11-28T11:52:53.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.707+0000 7fb727fff700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7300750f0 0x7fb730151a50 secure :-1 s=THROTTLE_DONE pgs=2301 cs=0 l=1 rx=0x7fb718010450 tx=0x7fb718010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:53.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.707+0000 7fb72d7fa700 1 -- 172.21.15.80:0/2105284112 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb718000990 con 0x7fb7300750f0 2019-11-28T11:52:53.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.880+0000 7fb735d6d700 1 -- 172.21.15.80:0/2105284112 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb73007b490 con 0x7fb7300750f0 2019-11-28T11:52:53.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.881+0000 7fb727fff700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7300750f0 0x7fb730151a50 secure :-1 s=THROTTLE_DONE pgs=2301 cs=0 l=1 rx=0x7fb718010450 tx=0x7fb718010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:53.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.881+0000 7fb72d7fa700 1 -- 172.21.15.80:0/2105284112 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7fb718009580 con 0x7fb7300750f0 2019-11-28T11:52:53.934 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:52:53.934 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:53.935 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:53.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.883+0000 7fb735d6d700 1 -- 172.21.15.80:0/2105284112 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb714018730 msgr2=0x7fb71401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:53.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.883+0000 7fb735d6d700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb714018730 0x7fb71401abc0 crc :-1 s=READY pgs=948 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:53.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.883+0000 7fb735d6d700 1 -- 172.21.15.80:0/2105284112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7300750f0 msgr2=0x7fb730151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:53.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.883+0000 7fb735d6d700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7300750f0 0x7fb730151a50 secure :-1 s=READY pgs=2301 cs=0 l=1 rx=0x7fb718010450 tx=0x7fb718010250).stop 2019-11-28T11:52:53.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.883+0000 7fb735d6d700 1 -- 172.21.15.80:0/2105284112 shutdown_connections 2019-11-28T11:52:53.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.883+0000 7fb735d6d700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb730151f90 0x7fb7301523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:53.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.883+0000 7fb735d6d700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7300750f0 0x7fb730151a50 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:53.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.883+0000 7fb735d6d700 1 --2- 172.21.15.80:0/2105284112 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb714018730 0x7fb71401abc0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:53.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.883+0000 7fb735d6d700 1 -- 172.21.15.80:0/2105284112 shutdown_connections 2019-11-28T11:52:53.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.883+0000 7fb735d6d700 1 -- 172.21.15.80:0/2105284112 wait complete. 2019-11-28T11:52:53.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:53.883+0000 7fb735d6d700 1 -- 172.21.15.80:0/2105284112 >> 172.21.15.80:0/2105284112 conn(0x7fb73013fa50 msgr2=0x7fb73007c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:53.947 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:52:54.947 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:55.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.016+0000 7f6e9c136700 1 Processor -- start 2019-11-28T11:52:55.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.016+0000 7f6e9c136700 1 -- start start 2019-11-28T11:52:55.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.017+0000 7f6e9c136700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6e9406c0a0 0x7f6e94072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:55.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.017+0000 7f6e9c136700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9406db00 con 0x7f6e940734e0 2019-11-28T11:52:55.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.017+0000 7f6e9c136700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9406e000 con 0x7f6e94072620 2019-11-28T11:52:55.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.017+0000 7f6e9c136700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e9406fd60 con 0x7f6e9406c0a0 2019-11-28T11:52:55.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.017+0000 7f6e99ed2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6e940734e0 0x7f6e94071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42898/0 (socket says 172.21.15.80:42898) 2019-11-28T11:52:55.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.017+0000 7f6e99ed2700 1 -- 172.21.15.80:0/4262172893 learned_addr learned my addr 172.21.15.80:0/4262172893 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:55.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.017+0000 7f6e9a6d3700 1 --2- 172.21.15.80:0/4262172893 >> v2:172.21.15.174:3300/0 conn(0x7f6e9406c0a0 0x7f6e94072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:55.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.017+0000 7f6e996d1700 1 -- 172.21.15.80:0/4262172893 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231974628 0 0) 0x7f6e84001070 con 0x7f6e940734e0 2019-11-28T11:52:55.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.017+0000 7f6e996d1700 1 -- 172.21.15.80:0/4262172893 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e80002e80 con 0x7f6e940734e0 2019-11-28T11:52:55.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.017+0000 7f6e9a6d3700 1 -- 172.21.15.80:0/4262172893 >> v1:172.21.15.174:6789/0 conn(0x7f6e94072620 legacy=0x7f6e94164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:55.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.017+0000 7f6e996d1700 1 -- 172.21.15.80:0/4262172893 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378242602 0 0) 0x7f6e8c0009b0 con 0x7f6e94072620 2019-11-28T11:52:55.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.017+0000 7f6e9a6d3700 1 -- 172.21.15.80:0/4262172893 >> v1:172.21.15.80:6789/0 conn(0x7f6e940734e0 legacy=0x7f6e94071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:55.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.017+0000 7f6e9a6d3700 1 -- 172.21.15.80:0/4262172893 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e940706c0 con 0x7f6e9406c0a0 2019-11-28T11:52:55.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.018+0000 7f6e9a6d3700 1 --2- 172.21.15.80:0/4262172893 >> v2:172.21.15.174:3300/0 conn(0x7f6e9406c0a0 0x7f6e94072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6e7c00b2d0 tx=0x7f6e7c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:55.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.018+0000 7f6e9a6d3700 1 --2- 172.21.15.80:0/4262172893 >> v2:172.21.15.174:3300/0 conn(0x7f6e9406c0a0 0x7f6e94072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6e7c00b2d0 tx=0x7f6e7c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:55.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.018+0000 7f6e9a6d3700 1 --2- 172.21.15.80:0/4262172893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e9406c0a0 0x7f6e94072fa0 secure :-1 s=READY pgs=1383 cs=0 l=1 rx=0x7f6e7c00b2d0 tx=0x7f6e7c00bae0).ready entity=mon.1 client_cookie=78330882dc1d4268 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:55.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.018+0000 7f6e9a6d3700 1 --2- 172.21.15.80:0/4262172893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e9406c0a0 0x7f6e94072fa0 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7f6e7c00b2d0 tx=0x7f6e7c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:55.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.018+0000 7f6e996d1700 1 -- 172.21.15.80:0/4262172893 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e7c000ce0 con 0x7f6e9406c0a0 2019-11-28T11:52:55.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.018+0000 7f6e9a6d3700 1 --2- 172.21.15.80:0/4262172893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e9406c0a0 0x7f6e94072fa0 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7f6e7c00b2d0 tx=0x7f6e7c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:55.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.018+0000 7f6e9a6d3700 1 --2- 172.21.15.80:0/4262172893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e9406c0a0 0x7f6e94072fa0 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7f6e7c00b2d0 tx=0x7f6e7c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:55.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.018+0000 7f6e996d1700 1 -- 172.21.15.80:0/4262172893 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c000ce0 con 0x7f6e9406c0a0 2019-11-28T11:52:55.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.018+0000 7f6e996d1700 1 -- 172.21.15.80:0/4262172893 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e7c00a060 con 0x7f6e9406c0a0 2019-11-28T11:52:55.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.018+0000 7f6e9c136700 1 -- 172.21.15.80:0/4262172893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e9406c0a0 msgr2=0x7f6e94072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:55.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.018+0000 7f6e9c136700 1 --2- 172.21.15.80:0/4262172893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e9406c0a0 0x7f6e94072fa0 secure :-1 s=READY pgs=1383 cs=0 l=1 rx=0x7f6e7c00b2d0 tx=0x7f6e7c00bae0).stop 2019-11-28T11:52:55.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.019+0000 7f6e9c136700 1 -- 172.21.15.80:0/4262172893 shutdown_connections 2019-11-28T11:52:55.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.019+0000 7f6e9c136700 1 --2- 172.21.15.80:0/4262172893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e9406c0a0 0x7f6e94072fa0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:55.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.019+0000 7f6e9c136700 1 -- 172.21.15.80:0/4262172893 shutdown_connections 2019-11-28T11:52:55.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.019+0000 7f6e9c136700 1 -- 172.21.15.80:0/4262172893 wait complete. 2019-11-28T11:52:55.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.019+0000 7f6e9c136700 1 -- 172.21.15.80:0/4262172893 >> 172.21.15.80:0/4262172893 conn(0x7f6e94061cf0 msgr2=0x7f6e94064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.021+0000 7f6e9c136700 1 Processor -- start 2019-11-28T11:52:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.021+0000 7f6e9c136700 1 -- start start 2019-11-28T11:52:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e9c136700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6e941346b0 0x7f6e94135040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e9c136700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e94135580 0x7f6e941359b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:55.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e9c136700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9413f410 con 0x7f6e941342c0 2019-11-28T11:52:55.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e9c136700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e94141670 con 0x7f6e941346b0 2019-11-28T11:52:55.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e9c136700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e94141940 con 0x7f6e94135580 2019-11-28T11:52:55.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e9a6d3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6e941342c0 0x7f6e941361c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42900/0 (socket says 172.21.15.80:42900) 2019-11-28T11:52:55.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e9a6d3700 1 -- 172.21.15.80:0/2097053700 learned_addr learned my addr 172.21.15.80:0/2097053700 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:55.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e99ed2700 1 --2- 172.21.15.80:0/2097053700 >> v2:172.21.15.174:3300/0 conn(0x7f6e941346b0 0x7f6e94135040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:55.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e9aed4700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e94135580 0x7f6e941359b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:55.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e92ffd700 1 -- 172.21.15.80:0/2097053700 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151344316 0 0) 0x7f6e7c00b780 con 0x7f6e941342c0 2019-11-28T11:52:55.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e92ffd700 1 -- 172.21.15.80:0/2097053700 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e78002e80 con 0x7f6e941342c0 2019-11-28T11:52:55.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e99ed2700 1 -- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e94135580 msgr2=0x7f6e941359b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:55.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e99ed2700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e94135580 0x7f6e941359b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:55.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e99ed2700 1 -- 172.21.15.80:0/2097053700 >> v1:172.21.15.80:6789/0 conn(0x7f6e941342c0 legacy=0x7f6e941361c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:55.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e92ffd700 1 -- 172.21.15.80:0/2097053700 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4062158730 0 0) 0x7f6e7c000cc0 con 0x7f6e941342c0 2019-11-28T11:52:55.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e99ed2700 1 -- 172.21.15.80:0/2097053700 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e94141fd0 con 0x7f6e941346b0 2019-11-28T11:52:55.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.022+0000 7f6e99ed2700 1 --2- 172.21.15.80:0/2097053700 >> v2:172.21.15.174:3300/0 conn(0x7f6e941346b0 0x7f6e94135040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6e840102e0 tx=0x7f6e84010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:55.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.023+0000 7f6e99ed2700 1 --2- 172.21.15.80:0/2097053700 >> v2:172.21.15.174:3300/0 conn(0x7f6e941346b0 0x7f6e94135040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6e840102e0 tx=0x7f6e84010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:55.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.023+0000 7f6e99ed2700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e941346b0 0x7f6e94135040 secure :-1 s=READY pgs=1384 cs=0 l=1 rx=0x7f6e840102e0 tx=0x7f6e84010680).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:55.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.023+0000 7f6e99ed2700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e941346b0 0x7f6e94135040 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7f6e840102e0 tx=0x7f6e84010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:55.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.023+0000 7f6e92ffd700 1 -- 172.21.15.80:0/2097053700 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e84000940 con 0x7f6e941346b0 2019-11-28T11:52:55.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.023+0000 7f6e99ed2700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e941346b0 0x7f6e94135040 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7f6e840102e0 tx=0x7f6e84010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:55.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.023+0000 7f6e92ffd700 1 -- 172.21.15.80:0/2097053700 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e840041d0 con 0x7f6e941346b0 2019-11-28T11:52:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.023+0000 7f6e99ed2700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e941346b0 0x7f6e94135040 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7f6e840102e0 tx=0x7f6e84010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.023+0000 7f6e92ffd700 1 -- 172.21.15.80:0/2097053700 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e840043c0 con 0x7f6e941346b0 2019-11-28T11:52:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.023+0000 7f6e9c136700 1 -- 172.21.15.80:0/2097053700 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e94142350 con 0x7f6e941346b0 2019-11-28T11:52:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.023+0000 7f6e9c136700 1 -- 172.21.15.80:0/2097053700 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e94141fd0 con 0x7f6e941346b0 2019-11-28T11:52:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.023+0000 7f6e99ed2700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e941346b0 0x7f6e94135040 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7f6e840102e0 tx=0x7f6e84010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.023+0000 7f6e92ffd700 1 -- 172.21.15.80:0/2097053700 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6e840043c0 con 0x7f6e941346b0 2019-11-28T11:52:55.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.023+0000 7f6e99ed2700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e941346b0 0x7f6e94135040 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7f6e840102e0 tx=0x7f6e84010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.024+0000 7f6e92ffd700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e78018780 0x7f6e7801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.024+0000 7f6e92ffd700 1 -- 172.21.15.80:0/2097053700 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f6e840319a0 con 0x7f6e941346b0 2019-11-28T11:52:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.024+0000 7f6e9a6d3700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e78018780 0x7f6e7801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.024+0000 7f6e9a6d3700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e78018780 0x7f6e7801abf0 crc :-1 s=READY pgs=949 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.031+0000 7f6e9c136700 1 -- 172.21.15.80:0/2097053700 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e94142350 con 0x7f6e941346b0 2019-11-28T11:52:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.035+0000 7f6e99ed2700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e941346b0 0x7f6e94135040 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7f6e840102e0 tx=0x7f6e84010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.035+0000 7f6e92ffd700 1 -- 172.21.15.80:0/2097053700 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6e84001520 con 0x7f6e941346b0 2019-11-28T11:52:55.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.206+0000 7f6e9c136700 1 -- 172.21.15.80:0/2097053700 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e94141fd0 con 0x7f6e941346b0 2019-11-28T11:52:55.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.207+0000 7f6e99ed2700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e941346b0 0x7f6e94135040 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7f6e840102e0 tx=0x7f6e84010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:55.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.207+0000 7f6e92ffd700 1 -- 172.21.15.80:0/2097053700 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f6e840043a0 con 0x7f6e941346b0 2019-11-28T11:52:55.261 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:52:55.261 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:55.261 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:55.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.209+0000 7f6e9c136700 1 -- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e78018780 msgr2=0x7f6e7801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:55.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.209+0000 7f6e9c136700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e78018780 0x7f6e7801abf0 crc :-1 s=READY pgs=949 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:55.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.209+0000 7f6e9c136700 1 -- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e941346b0 msgr2=0x7f6e94135040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:55.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.209+0000 7f6e9c136700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e941346b0 0x7f6e94135040 secure :-1 s=READY pgs=1384 cs=0 l=1 rx=0x7f6e840102e0 tx=0x7f6e84010680).stop 2019-11-28T11:52:55.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.209+0000 7f6e9c136700 1 -- 172.21.15.80:0/2097053700 shutdown_connections 2019-11-28T11:52:55.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.209+0000 7f6e9c136700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e78018780 0x7f6e7801abf0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:55.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.209+0000 7f6e9c136700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e94135580 0x7f6e941359b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:55.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.209+0000 7f6e9c136700 1 --2- 172.21.15.80:0/2097053700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e941346b0 0x7f6e94135040 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:55.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.210+0000 7f6e9c136700 1 -- 172.21.15.80:0/2097053700 shutdown_connections 2019-11-28T11:52:55.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.210+0000 7f6e9c136700 1 -- 172.21.15.80:0/2097053700 wait complete. 2019-11-28T11:52:55.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:55.210+0000 7f6e9c136700 1 -- 172.21.15.80:0/2097053700 >> 172.21.15.80:0/2097053700 conn(0x7f6e94159ae0 msgr2=0x7f6e9413d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:55.272 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:52:56.273 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:56.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.342+0000 7fc34c52a700 1 Processor -- start 2019-11-28T11:52:56.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.342+0000 7fc34c52a700 1 -- start start 2019-11-28T11:52:56.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc34c52a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc34406d120 0x7fc344165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:56.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc34c52a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34406d5a0 con 0x7fc34406c0a0 2019-11-28T11:52:56.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc34c52a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34406db00 con 0x7fc34406c490 2019-11-28T11:52:56.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc34c52a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34406fd60 con 0x7fc34406d120 2019-11-28T11:52:56.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc34aac7700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc34406c0a0 0x7fc344072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42908/0 (socket says 172.21.15.80:42908) 2019-11-28T11:52:56.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc34aac7700 1 -- 172.21.15.80:0/2468776529 learned_addr learned my addr 172.21.15.80:0/2468776529 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:52:56.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc34b2c8700 1 --2- 172.21.15.80:0/2468776529 >> v2:172.21.15.174:3300/0 conn(0x7fc34406d120 0x7fc344165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:56.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 -- 172.21.15.80:0/2468776529 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151300579 0 0) 0x7fc32c001150 con 0x7fc34406c0a0 2019-11-28T11:52:56.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 -- 172.21.15.80:0/2468776529 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc330002e80 con 0x7fc34406c0a0 2019-11-28T11:52:56.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 -- 172.21.15.80:0/2468776529 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644733470 0 0) 0x7fc334001400 con 0x7fc34406c490 2019-11-28T11:52:56.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 -- 172.21.15.80:0/2468776529 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3300030b0 con 0x7fc34406c490 2019-11-28T11:52:56.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 -- 172.21.15.80:0/2468776529 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 300050997 0 0) 0x7fc32c001130 con 0x7fc34406c0a0 2019-11-28T11:52:56.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 -- 172.21.15.80:0/2468776529 >> v2:172.21.15.174:3300/0 conn(0x7fc34406d120 msgr2=0x7fc344165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:56.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 --2- 172.21.15.80:0/2468776529 >> v2:172.21.15.174:3300/0 conn(0x7fc34406d120 0x7fc344165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:56.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 -- 172.21.15.80:0/2468776529 >> v1:172.21.15.174:6789/0 conn(0x7fc34406c490 legacy=0x7fc34406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:56.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 -- 172.21.15.80:0/2468776529 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3440706c0 con 0x7fc34406c0a0 2019-11-28T11:52:56.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 -- 172.21.15.80:0/2468776529 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc32c001660 con 0x7fc34406c0a0 2019-11-28T11:52:56.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc34b2c8700 1 --2- 172.21.15.80:0/2468776529 >> v2:172.21.15.174:3300/0 conn(0x7fc34406d120 0x7fc344165d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:56.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 -- 172.21.15.80:0/2468776529 >> v1:172.21.15.80:6789/0 conn(0x7fc34406c0a0 legacy=0x7fc344072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:56.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 --2- 172.21.15.80:0/2468776529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc330003b80 0x7fc330005fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:56.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 --2- 172.21.15.80:0/2468776529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3300066b0 0x7fc330008b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:56.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 --2- 172.21.15.80:0/2468776529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc33004d3a0 0x7fc33004f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:56.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 -- 172.21.15.80:0/2468776529 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33004fff0 con 0x7fc3300066b0 2019-11-28T11:52:56.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 -- 172.21.15.80:0/2468776529 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc330050220 con 0x7fc33004d3a0 2019-11-28T11:52:56.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc349ac5700 1 -- 172.21.15.80:0/2468776529 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc330050450 con 0x7fc330003b80 2019-11-28T11:52:56.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc34a2c6700 1 --2- 172.21.15.80:0/2468776529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3300066b0 0x7fc330008b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:56.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.344+0000 7fc34aac7700 1 --2- 172.21.15.80:0/2468776529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc330003b80 0x7fc330005fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:56.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc34b2c8700 1 --2- 172.21.15.80:0/2468776529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc33004d3a0 0x7fc33004f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:56.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc34a2c6700 1 -- 172.21.15.80:0/2468776529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc330003b80 msgr2=0x7fc330005fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:56.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc34a2c6700 1 --2- 172.21.15.80:0/2468776529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc330003b80 0x7fc330005fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:56.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc34a2c6700 1 -- 172.21.15.80:0/2468776529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc33004d3a0 msgr2=0x7fc33004f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:56.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc34a2c6700 1 --2- 172.21.15.80:0/2468776529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc33004d3a0 0x7fc33004f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:56.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc34a2c6700 1 -- 172.21.15.80:0/2468776529 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc330050700 con 0x7fc3300066b0 2019-11-28T11:52:56.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc34b2c8700 1 -- 172.21.15.80:0/2468776529 reap_dead start 2019-11-28T11:52:56.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc34a2c6700 1 --2- 172.21.15.80:0/2468776529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3300066b0 0x7fc330008b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc33400b2f0 tx=0x7fc33400b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:56.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc34a2c6700 1 --2- 172.21.15.80:0/2468776529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3300066b0 0x7fc330008b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc33400b2f0 tx=0x7fc33400b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:56.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc34a2c6700 1 --2- 172.21.15.80:0/2468776529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3300066b0 0x7fc330008b30 secure :-1 s=READY pgs=2305 cs=0 l=1 rx=0x7fc33400b2f0 tx=0x7fc33400b670).ready entity=mon.0 client_cookie=ed624f58ed09405c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:56.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc34a2c6700 1 --2- 172.21.15.80:0/2468776529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3300066b0 0x7fc330008b30 secure :-1 s=THROTTLE_DONE pgs=2305 cs=0 l=1 rx=0x7fc33400b2f0 tx=0x7fc33400b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:56.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc349ac5700 1 -- 172.21.15.80:0/2468776529 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc33400a000 con 0x7fc3300066b0 2019-11-28T11:52:56.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc34a2c6700 1 --2- 172.21.15.80:0/2468776529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3300066b0 0x7fc330008b30 secure :-1 s=THROTTLE_DONE pgs=2305 cs=0 l=1 rx=0x7fc33400b2f0 tx=0x7fc33400b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:56.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc34a2c6700 1 --2- 172.21.15.80:0/2468776529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3300066b0 0x7fc330008b30 secure :-1 s=THROTTLE_DONE pgs=2305 cs=0 l=1 rx=0x7fc33400b2f0 tx=0x7fc33400b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:56.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc349ac5700 1 -- 172.21.15.80:0/2468776529 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc334009c20 con 0x7fc3300066b0 2019-11-28T11:52:56.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc349ac5700 1 -- 172.21.15.80:0/2468776529 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc33400a730 con 0x7fc3300066b0 2019-11-28T11:52:56.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc34c52a700 1 -- 172.21.15.80:0/2468776529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3300066b0 msgr2=0x7fc330008b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:56.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.345+0000 7fc34c52a700 1 --2- 172.21.15.80:0/2468776529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3300066b0 0x7fc330008b30 secure :-1 s=READY pgs=2305 cs=0 l=1 rx=0x7fc33400b2f0 tx=0x7fc33400b670).stop 2019-11-28T11:52:56.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.346+0000 7fc34c52a700 1 -- 172.21.15.80:0/2468776529 shutdown_connections 2019-11-28T11:52:56.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.346+0000 7fc34c52a700 1 --2- 172.21.15.80:0/2468776529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3300066b0 0x7fc330008b30 unknown :-1 s=CLOSED pgs=2305 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:56.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.346+0000 7fc34c52a700 1 -- 172.21.15.80:0/2468776529 shutdown_connections 2019-11-28T11:52:56.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.346+0000 7fc34c52a700 1 -- 172.21.15.80:0/2468776529 wait complete. 2019-11-28T11:52:56.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.346+0000 7fc34c52a700 1 -- 172.21.15.80:0/2468776529 >> 172.21.15.80:0/2468776529 conn(0x7fc344061cf0 msgr2=0x7fc344064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:56.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.348+0000 7fc34c52a700 1 Processor -- start 2019-11-28T11:52:56.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.348+0000 7fc34c52a700 1 -- start start 2019-11-28T11:52:56.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.349+0000 7fc34c52a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc344077040 0x7fc3441574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:56.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.349+0000 7fc34c52a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc344157a00 0x7fc344074a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:56.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.349+0000 7fc34c52a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc344140820 con 0x7fc344074f50 2019-11-28T11:52:56.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.349+0000 7fc34c52a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc344137110 con 0x7fc344077040 2019-11-28T11:52:56.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.349+0000 7fc34c52a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3441373e0 con 0x7fc344157a00 2019-11-28T11:52:56.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.349+0000 7fc34aac7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc344077040 0x7fc3441574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:56.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.349+0000 7fc34aac7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc344077040 0x7fc3441574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43604/0 (socket says 172.21.15.80:43604) 2019-11-28T11:52:56.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.349+0000 7fc34aac7700 1 -- 172.21.15.80:0/667700457 learned_addr learned my addr 172.21.15.80:0/667700457 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:56.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.349+0000 7fc34a2c6700 1 --2- 172.21.15.80:0/667700457 >> v2:172.21.15.174:3300/0 conn(0x7fc344157a00 0x7fc344074a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:56.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.349+0000 7fc34aac7700 1 -- 172.21.15.80:0/667700457 >> v2:172.21.15.174:3300/0 conn(0x7fc344157a00 msgr2=0x7fc344074a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:56.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.349+0000 7fc34aac7700 1 --2- 172.21.15.80:0/667700457 >> v2:172.21.15.174:3300/0 conn(0x7fc344157a00 0x7fc344074a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:56.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.349+0000 7fc34aac7700 1 -- 172.21.15.80:0/667700457 >> v1:172.21.15.174:6789/0 conn(0x7fc344074f50 legacy=0x7fc344156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:56.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.350+0000 7fc34aac7700 1 -- 172.21.15.80:0/667700457 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc344137a70 con 0x7fc344077040 2019-11-28T11:52:56.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.350+0000 7fc34aac7700 1 --2- 172.21.15.80:0/667700457 >> v2:172.21.15.80:3300/0 conn(0x7fc344077040 0x7fc3441574c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc32c010440 tx=0x7fc32c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:56.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.350+0000 7fc34aac7700 1 --2- 172.21.15.80:0/667700457 >> v2:172.21.15.80:3300/0 conn(0x7fc344077040 0x7fc3441574c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc32c010440 tx=0x7fc32c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:56.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.350+0000 7fc34aac7700 1 --2- 172.21.15.80:0/667700457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc344077040 0x7fc3441574c0 secure :-1 s=READY pgs=2306 cs=0 l=1 rx=0x7fc32c010440 tx=0x7fc32c010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:56.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.350+0000 7fc34aac7700 1 --2- 172.21.15.80:0/667700457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc344077040 0x7fc3441574c0 secure :-1 s=THROTTLE_DONE pgs=2306 cs=0 l=1 rx=0x7fc32c010440 tx=0x7fc32c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:56.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.350+0000 7fc34aac7700 1 --2- 172.21.15.80:0/667700457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc344077040 0x7fc3441574c0 secure :-1 s=THROTTLE_DONE pgs=2306 cs=0 l=1 rx=0x7fc32c010440 tx=0x7fc32c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:56.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.350+0000 7fc34aac7700 1 --2- 172.21.15.80:0/667700457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc344077040 0x7fc3441574c0 secure :-1 s=THROTTLE_DONE pgs=2306 cs=0 l=1 rx=0x7fc32c010440 tx=0x7fc32c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:56.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.350+0000 7fc3437fe700 1 -- 172.21.15.80:0/667700457 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc32c004430 con 0x7fc344077040 2019-11-28T11:52:56.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.350+0000 7fc3437fe700 1 -- 172.21.15.80:0/667700457 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c001c40 con 0x7fc344077040 2019-11-28T11:52:56.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.350+0000 7fc3437fe700 1 -- 172.21.15.80:0/667700457 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc32c004a10 con 0x7fc344077040 2019-11-28T11:52:56.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.350+0000 7fc34c52a700 1 -- 172.21.15.80:0/667700457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc344137df0 con 0x7fc344077040 2019-11-28T11:52:56.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.350+0000 7fc34c52a700 1 -- 172.21.15.80:0/667700457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc344137a70 con 0x7fc344077040 2019-11-28T11:52:56.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.350+0000 7fc34aac7700 1 --2- 172.21.15.80:0/667700457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc344077040 0x7fc3441574c0 secure :-1 s=THROTTLE_DONE pgs=2306 cs=0 l=1 rx=0x7fc32c010440 tx=0x7fc32c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:56.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.351+0000 7fc3437fe700 1 -- 172.21.15.80:0/667700457 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc32c004240 con 0x7fc344077040 2019-11-28T11:52:56.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.351+0000 7fc34aac7700 1 --2- 172.21.15.80:0/667700457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc344077040 0x7fc3441574c0 secure :-1 s=THROTTLE_DONE pgs=2306 cs=0 l=1 rx=0x7fc32c010440 tx=0x7fc32c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:56.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.351+0000 7fc3437fe700 1 --2- 172.21.15.80:0/667700457 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc328018730 0x7fc32801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:56.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.351+0000 7fc3437fe700 1 -- 172.21.15.80:0/667700457 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fc32c031ad0 con 0x7fc344077040 2019-11-28T11:52:56.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.351+0000 7fc34a2c6700 1 --2- 172.21.15.80:0/667700457 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc328018730 0x7fc32801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:56.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.351+0000 7fc34a2c6700 1 --2- 172.21.15.80:0/667700457 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc328018730 0x7fc32801abc0 crc :-1 s=READY pgs=950 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:56.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.358+0000 7fc34c52a700 1 -- 172.21.15.80:0/667700457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc344137df0 con 0x7fc344077040 2019-11-28T11:52:56.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.361+0000 7fc34aac7700 1 --2- 172.21.15.80:0/667700457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc344077040 0x7fc3441574c0 secure :-1 s=THROTTLE_DONE pgs=2306 cs=0 l=1 rx=0x7fc32c010440 tx=0x7fc32c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:56.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.361+0000 7fc3437fe700 1 -- 172.21.15.80:0/667700457 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc32c020f20 con 0x7fc344077040 2019-11-28T11:52:56.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.533+0000 7fc34c52a700 1 -- 172.21.15.80:0/667700457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc344137a70 con 0x7fc344077040 2019-11-28T11:52:56.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.533+0000 7fc34aac7700 1 --2- 172.21.15.80:0/667700457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc344077040 0x7fc3441574c0 secure :-1 s=THROTTLE_DONE pgs=2306 cs=0 l=1 rx=0x7fc32c010440 tx=0x7fc32c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:56.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.533+0000 7fc3437fe700 1 -- 172.21.15.80:0/667700457 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7fc32c020f20 con 0x7fc344077040 2019-11-28T11:52:56.588 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:52:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:56.588 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:56.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.536+0000 7fc34c52a700 1 -- 172.21.15.80:0/667700457 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc328018730 msgr2=0x7fc32801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:56.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.536+0000 7fc34c52a700 1 --2- 172.21.15.80:0/667700457 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc328018730 0x7fc32801abc0 crc :-1 s=READY pgs=950 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:56.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.536+0000 7fc34c52a700 1 -- 172.21.15.80:0/667700457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc344077040 msgr2=0x7fc3441574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.536+0000 7fc34c52a700 1 --2- 172.21.15.80:0/667700457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc344077040 0x7fc3441574c0 secure :-1 s=READY pgs=2306 cs=0 l=1 rx=0x7fc32c010440 tx=0x7fc32c010270).stop 2019-11-28T11:52:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.536+0000 7fc34c52a700 1 -- 172.21.15.80:0/667700457 shutdown_connections 2019-11-28T11:52:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.536+0000 7fc34c52a700 1 --2- 172.21.15.80:0/667700457 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc328018730 0x7fc32801abc0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.536+0000 7fc34c52a700 1 --2- 172.21.15.80:0/667700457 >> v2:172.21.15.174:3300/0 conn(0x7fc344157a00 0x7fc344074a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.536+0000 7fc34c52a700 1 --2- 172.21.15.80:0/667700457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc344077040 0x7fc3441574c0 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:56.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.536+0000 7fc34c52a700 1 -- 172.21.15.80:0/667700457 shutdown_connections 2019-11-28T11:52:56.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.536+0000 7fc34c52a700 1 -- 172.21.15.80:0/667700457 wait complete. 2019-11-28T11:52:56.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:56.536+0000 7fc34c52a700 1 -- 172.21.15.80:0/667700457 >> 172.21.15.80:0/667700457 conn(0x7fc34413fa50 msgr2=0x7fc34407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:56.600 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:52:57.601 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:57.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.670+0000 7f0f764e0700 1 Processor -- start 2019-11-28T11:52:57.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.670+0000 7f0f764e0700 1 -- start start 2019-11-28T11:52:57.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.671+0000 7f0f764e0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0f7006c0a0 0x7f0f70072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:57.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.671+0000 7f0f764e0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f70072620 0x7f0f70164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:57.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.671+0000 7f0f764e0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f7006db00 con 0x7f0f700734e0 2019-11-28T11:52:57.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.671+0000 7f0f764e0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7006fd60 con 0x7f0f7006c0a0 2019-11-28T11:52:57.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.671+0000 7f0f764e0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f70070030 con 0x7f0f70072620 2019-11-28T11:52:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.671+0000 7f0f74a7d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0f7006c0a0 0x7f0f70072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.671+0000 7f0f7527e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f70072620 0x7f0f70164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:57.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.671+0000 7f0f74a7d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0f7006c0a0 0x7f0f70072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:58498/0 (socket says 172.21.15.80:58498) 2019-11-28T11:52:57.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.671+0000 7f0f6ffff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f0f700734e0 0x7f0f70071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58472/0 (socket says 172.21.15.80:58472) 2019-11-28T11:52:57.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.671+0000 7f0f74a7d700 1 -- 172.21.15.80:0/3866348162 learned_addr learned my addr 172.21.15.80:0/3866348162 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:57.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f74a7d700 1 -- 172.21.15.80:0/3866348162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f70072620 msgr2=0x7f0f70164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:52:57.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f74a7d700 1 --2- 172.21.15.80:0/3866348162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f70072620 0x7f0f70164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:57.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f74a7d700 1 -- 172.21.15.80:0/3866348162 >> v1:172.21.15.174:6789/0 conn(0x7f0f700734e0 legacy=0x7f0f70071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:57.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f74a7d700 1 -- 172.21.15.80:0/3866348162 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f700706c0 con 0x7f0f7006c0a0 2019-11-28T11:52:57.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f6f7fe700 1 -- 172.21.15.80:0/3866348162 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130613630 0 0) 0x7f0f60001400 con 0x7f0f700734e0 2019-11-28T11:52:57.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f7527e700 1 --2- 172.21.15.80:0/3866348162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f70072620 0x7f0f70164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:52:57.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f74a7d700 1 --2- 172.21.15.80:0/3866348162 >> v2:172.21.15.174:3300/0 conn(0x7f0f7006c0a0 0x7f0f70072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0f5800f740 tx=0x7f0f5800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:57.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f74a7d700 1 --2- 172.21.15.80:0/3866348162 >> v2:172.21.15.174:3300/0 conn(0x7f0f7006c0a0 0x7f0f70072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0f5800f740 tx=0x7f0f5800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:57.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f74a7d700 1 --2- 172.21.15.80:0/3866348162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f7006c0a0 0x7f0f70072fa0 secure :-1 s=READY pgs=1388 cs=0 l=1 rx=0x7f0f5800f740 tx=0x7f0f5800fae0).ready entity=mon.1 client_cookie=1aa217c8a5071813 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:57.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f74a7d700 1 --2- 172.21.15.80:0/3866348162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f7006c0a0 0x7f0f70072fa0 secure :-1 s=THROTTLE_DONE pgs=1388 cs=0 l=1 rx=0x7f0f5800f740 tx=0x7f0f5800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:57.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f6f7fe700 1 -- 172.21.15.80:0/3866348162 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f58000960 con 0x7f0f7006c0a0 2019-11-28T11:52:57.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f74a7d700 1 --2- 172.21.15.80:0/3866348162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f7006c0a0 0x7f0f70072fa0 secure :-1 s=THROTTLE_DONE pgs=1388 cs=0 l=1 rx=0x7f0f5800f740 tx=0x7f0f5800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:57.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f6f7fe700 1 -- 172.21.15.80:0/3866348162 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f58000c90 con 0x7f0f7006c0a0 2019-11-28T11:52:57.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f74a7d700 1 --2- 172.21.15.80:0/3866348162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f7006c0a0 0x7f0f70072fa0 secure :-1 s=THROTTLE_DONE pgs=1388 cs=0 l=1 rx=0x7f0f5800f740 tx=0x7f0f5800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:57.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f6f7fe700 1 -- 172.21.15.80:0/3866348162 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f58007210 con 0x7f0f7006c0a0 2019-11-28T11:52:57.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f764e0700 1 -- 172.21.15.80:0/3866348162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f7006c0a0 msgr2=0x7f0f70072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:57.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.672+0000 7f0f764e0700 1 --2- 172.21.15.80:0/3866348162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f7006c0a0 0x7f0f70072fa0 secure :-1 s=READY pgs=1388 cs=0 l=1 rx=0x7f0f5800f740 tx=0x7f0f5800fae0).stop 2019-11-28T11:52:57.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.673+0000 7f0f764e0700 1 -- 172.21.15.80:0/3866348162 shutdown_connections 2019-11-28T11:52:57.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.673+0000 7f0f764e0700 1 --2- 172.21.15.80:0/3866348162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f70072620 0x7f0f70164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:52:57.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.673+0000 7f0f764e0700 1 --2- 172.21.15.80:0/3866348162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f7006c0a0 0x7f0f70072fa0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:57.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.673+0000 7f0f764e0700 1 -- 172.21.15.80:0/3866348162 shutdown_connections 2019-11-28T11:52:57.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.673+0000 7f0f764e0700 1 -- 172.21.15.80:0/3866348162 wait complete. 2019-11-28T11:52:57.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.673+0000 7f0f764e0700 1 -- 172.21.15.80:0/3866348162 >> 172.21.15.80:0/3866348162 conn(0x7f0f70061cf0 msgr2=0x7f0f70064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:57.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.676+0000 7f0f764e0700 1 Processor -- start 2019-11-28T11:52:57.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.676+0000 7f0f764e0700 1 -- start start 2019-11-28T11:52:57.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f764e0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f7013e9e0 0x7f0f70108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:57.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f764e0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f70109430 0x7f0f701098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f764e0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f701066e0 con 0x7f0f7013e5f0 2019-11-28T11:52:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f764e0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7010e060 con 0x7f0f70109430 2019-11-28T11:52:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f764e0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7010e330 con 0x7f0f7013e9e0 2019-11-28T11:52:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f7527e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f70109430 0x7f0f701098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f7527e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f70109430 0x7f0f701098a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43622/0 (socket says 172.21.15.80:43622) 2019-11-28T11:52:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f7527e700 1 -- 172.21.15.80:0/713189397 learned_addr learned my addr 172.21.15.80:0/713189397 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:57.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f6ffff700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f7013e9e0 0x7f0f70108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:57.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f7527e700 1 -- 172.21.15.80:0/713189397 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f7013e9e0 msgr2=0x7f0f70108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:57.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f7527e700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f7013e9e0 0x7f0f70108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:57.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f7527e700 1 -- 172.21.15.80:0/713189397 >> v1:172.21.15.174:6789/0 conn(0x7f0f7013e5f0 legacy=0x7f0f7010a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:57.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f7527e700 1 -- 172.21.15.80:0/713189397 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7010e9c0 con 0x7f0f70109430 2019-11-28T11:52:57.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f7527e700 1 --2- 172.21.15.80:0/713189397 >> v2:172.21.15.80:3300/0 conn(0x7f0f70109430 0x7f0f701098a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f68010430 tx=0x7f0f680102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:57.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f7527e700 1 --2- 172.21.15.80:0/713189397 >> v2:172.21.15.80:3300/0 conn(0x7f0f70109430 0x7f0f701098a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f68010430 tx=0x7f0f680102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:57.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f7527e700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f70109430 0x7f0f701098a0 secure :-1 s=READY pgs=2307 cs=0 l=1 rx=0x7f0f68010430 tx=0x7f0f680102b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:57.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f7527e700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f70109430 0x7f0f701098a0 secure :-1 s=THROTTLE_DONE pgs=2307 cs=0 l=1 rx=0x7f0f68010430 tx=0x7f0f680102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:57.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f6d7fa700 1 -- 172.21.15.80:0/713189397 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f6800a750 con 0x7f0f70109430 2019-11-28T11:52:57.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f7527e700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f70109430 0x7f0f701098a0 secure :-1 s=THROTTLE_DONE pgs=2307 cs=0 l=1 rx=0x7f0f68010430 tx=0x7f0f680102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:57.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f6d7fa700 1 -- 172.21.15.80:0/713189397 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f680095b0 con 0x7f0f70109430 2019-11-28T11:52:57.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f7527e700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f70109430 0x7f0f701098a0 secure :-1 s=THROTTLE_DONE pgs=2307 cs=0 l=1 rx=0x7f0f68010430 tx=0x7f0f680102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:57.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f764e0700 1 -- 172.21.15.80:0/713189397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7010ed40 con 0x7f0f70109430 2019-11-28T11:52:57.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f6d7fa700 1 -- 172.21.15.80:0/713189397 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f6800aa60 con 0x7f0f70109430 2019-11-28T11:52:57.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.677+0000 7f0f764e0700 1 -- 172.21.15.80:0/713189397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7010e9c0 con 0x7f0f70109430 2019-11-28T11:52:57.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.678+0000 7f0f7527e700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f70109430 0x7f0f701098a0 secure :-1 s=THROTTLE_DONE pgs=2307 cs=0 l=1 rx=0x7f0f68010430 tx=0x7f0f680102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:57.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.678+0000 7f0f6d7fa700 1 -- 172.21.15.80:0/713189397 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0f680097a0 con 0x7f0f70109430 2019-11-28T11:52:57.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.678+0000 7f0f7527e700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f70109430 0x7f0f701098a0 secure :-1 s=THROTTLE_DONE pgs=2307 cs=0 l=1 rx=0x7f0f68010430 tx=0x7f0f680102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:57.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.678+0000 7f0f6d7fa700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f54018730 0x7f0f5401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:57.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.678+0000 7f0f6d7fa700 1 -- 172.21.15.80:0/713189397 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f0f68031a60 con 0x7f0f70109430 2019-11-28T11:52:57.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.678+0000 7f0f74a7d700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f54018730 0x7f0f5401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:57.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.679+0000 7f0f74a7d700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f54018730 0x7f0f5401abc0 crc :-1 s=READY pgs=951 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:57.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.685+0000 7f0f764e0700 1 -- 172.21.15.80:0/713189397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7010ed40 con 0x7f0f70109430 2019-11-28T11:52:57.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.689+0000 7f0f7527e700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f70109430 0x7f0f701098a0 secure :-1 s=THROTTLE_DONE pgs=2307 cs=0 l=1 rx=0x7f0f68010430 tx=0x7f0f680102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:57.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.689+0000 7f0f6d7fa700 1 -- 172.21.15.80:0/713189397 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0f68000a70 con 0x7f0f70109430 2019-11-28T11:52:57.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.864+0000 7f0f764e0700 1 -- 172.21.15.80:0/713189397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f7010e9c0 con 0x7f0f70109430 2019-11-28T11:52:57.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.865+0000 7f0f7527e700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f70109430 0x7f0f701098a0 secure :-1 s=THROTTLE_DONE pgs=2307 cs=0 l=1 rx=0x7f0f68010430 tx=0x7f0f680102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:57.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.865+0000 7f0f6d7fa700 1 -- 172.21.15.80:0/713189397 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f0f680097a0 con 0x7f0f70109430 2019-11-28T11:52:57.920 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:52:57.920 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:57.920 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:57.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.867+0000 7f0f764e0700 1 -- 172.21.15.80:0/713189397 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f54018730 msgr2=0x7f0f5401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:57.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.867+0000 7f0f764e0700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f54018730 0x7f0f5401abc0 crc :-1 s=READY pgs=951 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:57.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.867+0000 7f0f764e0700 1 -- 172.21.15.80:0/713189397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f70109430 msgr2=0x7f0f701098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:57.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.867+0000 7f0f764e0700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f70109430 0x7f0f701098a0 secure :-1 s=READY pgs=2307 cs=0 l=1 rx=0x7f0f68010430 tx=0x7f0f680102b0).stop 2019-11-28T11:52:57.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.867+0000 7f0f764e0700 1 -- 172.21.15.80:0/713189397 shutdown_connections 2019-11-28T11:52:57.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.867+0000 7f0f764e0700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f70109430 0x7f0f701098a0 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:57.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.867+0000 7f0f764e0700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f7013e9e0 0x7f0f70108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:57.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.867+0000 7f0f764e0700 1 --2- 172.21.15.80:0/713189397 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0f54018730 0x7f0f5401abc0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:57.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.867+0000 7f0f764e0700 1 -- 172.21.15.80:0/713189397 shutdown_connections 2019-11-28T11:52:57.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.867+0000 7f0f764e0700 1 -- 172.21.15.80:0/713189397 wait complete. 2019-11-28T11:52:57.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:57.867+0000 7f0f764e0700 1 -- 172.21.15.80:0/713189397 >> 172.21.15.80:0/713189397 conn(0x7f0f7013d620 msgr2=0x7f0f7013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:57.941 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:52:58.942 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:52:59.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.009+0000 7f7b8dd09700 1 Processor -- start 2019-11-28T11:52:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.009+0000 7f7b8dd09700 1 -- start start 2019-11-28T11:52:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.010+0000 7f7b8dd09700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7b8806c490 0x7f7b8806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:52:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.010+0000 7f7b8dd09700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8806db00 con 0x7f7b8806c0a0 2019-11-28T11:52:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.010+0000 7f7b8dd09700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8806e000 con 0x7f7b8806ce60 2019-11-28T11:52:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.010+0000 7f7b8dd09700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b8806fd60 con 0x7f7b8806c490 2019-11-28T11:52:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.010+0000 7f7b7ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7b8806c490 0x7f7b8806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.010+0000 7f7b7ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7b8806c490 0x7f7b8806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43626/0 (socket says 172.21.15.80:43626) 2019-11-28T11:52:59.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.010+0000 7f7b87fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7b8806c0a0 0x7f7b88072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42942/0 (socket says 172.21.15.80:42942) 2019-11-28T11:52:59.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.010+0000 7f7b7ffff700 1 -- 172.21.15.80:0/405002162 learned_addr learned my addr 172.21.15.80:0/405002162 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:59.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.011+0000 7f7b7ffff700 1 -- 172.21.15.80:0/405002162 >> v1:172.21.15.174:6789/0 conn(0x7f7b8806ce60 legacy=0x7f7b88164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:59.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.011+0000 7f7b7ffff700 1 -- 172.21.15.80:0/405002162 >> v1:172.21.15.80:6789/0 conn(0x7f7b8806c0a0 legacy=0x7f7b88072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:59.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.011+0000 7f7b7ffff700 1 -- 172.21.15.80:0/405002162 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b880706c0 con 0x7f7b8806c490 2019-11-28T11:52:59.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.011+0000 7f7b877fe700 1 -- 172.21.15.80:0/405002162 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219003935 0 0) 0x7f7b78001100 con 0x7f7b8806c0a0 2019-11-28T11:52:59.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.011+0000 7f7b7ffff700 1 --2- 172.21.15.80:0/405002162 >> v2:172.21.15.80:3300/0 conn(0x7f7b8806c490 0x7f7b8806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7b7000f740 tx=0x7f7b7000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:59.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.011+0000 7f7b7ffff700 1 --2- 172.21.15.80:0/405002162 >> v2:172.21.15.80:3300/0 conn(0x7f7b8806c490 0x7f7b8806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7b7000f740 tx=0x7f7b7000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:59.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.011+0000 7f7b7ffff700 1 --2- 172.21.15.80:0/405002162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b8806c490 0x7f7b8806c920 secure :-1 s=READY pgs=2309 cs=0 l=1 rx=0x7f7b7000f740 tx=0x7f7b7000fae0).ready entity=mon.0 client_cookie=523706d2ec674cec server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:59.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.011+0000 7f7b7ffff700 1 --2- 172.21.15.80:0/405002162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b8806c490 0x7f7b8806c920 secure :-1 s=THROTTLE_DONE pgs=2309 cs=0 l=1 rx=0x7f7b7000f740 tx=0x7f7b7000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:59.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.011+0000 7f7b877fe700 1 -- 172.21.15.80:0/405002162 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b70000960 con 0x7f7b8806c490 2019-11-28T11:52:59.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.011+0000 7f7b7ffff700 1 --2- 172.21.15.80:0/405002162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b8806c490 0x7f7b8806c920 secure :-1 s=THROTTLE_DONE pgs=2309 cs=0 l=1 rx=0x7f7b7000f740 tx=0x7f7b7000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:59.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.011+0000 7f7b7ffff700 1 --2- 172.21.15.80:0/405002162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b8806c490 0x7f7b8806c920 secure :-1 s=THROTTLE_DONE pgs=2309 cs=0 l=1 rx=0x7f7b7000f740 tx=0x7f7b7000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:59.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.011+0000 7f7b877fe700 1 -- 172.21.15.80:0/405002162 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b70000c90 con 0x7f7b8806c490 2019-11-28T11:52:59.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.011+0000 7f7b877fe700 1 -- 172.21.15.80:0/405002162 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b700013e0 con 0x7f7b8806c490 2019-11-28T11:52:59.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.011+0000 7f7b8dd09700 1 -- 172.21.15.80:0/405002162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b8806c490 msgr2=0x7f7b8806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:59.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.011+0000 7f7b8dd09700 1 --2- 172.21.15.80:0/405002162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b8806c490 0x7f7b8806c920 secure :-1 s=READY pgs=2309 cs=0 l=1 rx=0x7f7b7000f740 tx=0x7f7b7000fae0).stop 2019-11-28T11:52:59.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.012+0000 7f7b8dd09700 1 -- 172.21.15.80:0/405002162 shutdown_connections 2019-11-28T11:52:59.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.012+0000 7f7b8dd09700 1 --2- 172.21.15.80:0/405002162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b8806c490 0x7f7b8806c920 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:59.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.012+0000 7f7b8dd09700 1 -- 172.21.15.80:0/405002162 shutdown_connections 2019-11-28T11:52:59.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.012+0000 7f7b8dd09700 1 -- 172.21.15.80:0/405002162 wait complete. 2019-11-28T11:52:59.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.012+0000 7f7b8dd09700 1 -- 172.21.15.80:0/405002162 >> 172.21.15.80:0/405002162 conn(0x7f7b88061cf0 msgr2=0x7f7b88064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.014+0000 7f7b8dd09700 1 Processor -- start 2019-11-28T11:52:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.014+0000 7f7b8dd09700 1 -- start start 2019-11-28T11:52:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.015+0000 7f7b8dd09700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7b881145b0 0x7f7b88114a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:59.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.015+0000 7f7b8dd09700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8813fc50 con 0x7f7b88114f80 2019-11-28T11:52:59.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.015+0000 7f7b8dd09700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b88122ef0 con 0x7f7b8813f580 2019-11-28T11:52:59.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.015+0000 7f7b8dd09700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b88112550 con 0x7f7b881145b0 2019-11-28T11:52:59.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.015+0000 7f7b7ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7b881145b0 0x7f7b88114a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:59.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.015+0000 7f7b7ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7b881145b0 0x7f7b88114a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43634/0 (socket says 172.21.15.80:43634) 2019-11-28T11:52:59.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.015+0000 7f7b7ffff700 1 -- 172.21.15.80:0/659808217 learned_addr learned my addr 172.21.15.80:0/659808217 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:52:59.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.015+0000 7f7b7ffff700 1 -- 172.21.15.80:0/659808217 >> v1:172.21.15.174:6789/0 conn(0x7f7b8813f580 legacy=0x7f7b88115730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.015+0000 7f7b7ffff700 1 -- 172.21.15.80:0/659808217 >> v1:172.21.15.80:6789/0 conn(0x7f7b88114f80 legacy=0x7f7b88168a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.015+0000 7f7b7ffff700 1 -- 172.21.15.80:0/659808217 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b88115400 con 0x7f7b881145b0 2019-11-28T11:52:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.015+0000 7f7b7ffff700 1 --2- 172.21.15.80:0/659808217 >> v2:172.21.15.80:3300/0 conn(0x7f7b881145b0 0x7f7b88114a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b700104f0 tx=0x7f7b70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.015+0000 7f7b7ffff700 1 --2- 172.21.15.80:0/659808217 >> v2:172.21.15.80:3300/0 conn(0x7f7b881145b0 0x7f7b88114a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b700104f0 tx=0x7f7b70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:59.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.016+0000 7f7b7ffff700 1 --2- 172.21.15.80:0/659808217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b881145b0 0x7f7b88114a40 secure :-1 s=READY pgs=2311 cs=0 l=1 rx=0x7f7b700104f0 tx=0x7f7b70010890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:59.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.016+0000 7f7b7ffff700 1 --2- 172.21.15.80:0/659808217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b881145b0 0x7f7b88114a40 secure :-1 s=THROTTLE_DONE pgs=2311 cs=0 l=1 rx=0x7f7b700104f0 tx=0x7f7b70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:59.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.016+0000 7f7b7ffff700 1 --2- 172.21.15.80:0/659808217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b881145b0 0x7f7b88114a40 secure :-1 s=THROTTLE_DONE pgs=2311 cs=0 l=1 rx=0x7f7b700104f0 tx=0x7f7b70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:59.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.016+0000 7f7b7ffff700 1 --2- 172.21.15.80:0/659808217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b881145b0 0x7f7b88114a40 secure :-1 s=THROTTLE_DONE pgs=2311 cs=0 l=1 rx=0x7f7b700104f0 tx=0x7f7b70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:59.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.016+0000 7f7b857fa700 1 -- 172.21.15.80:0/659808217 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b70000c60 con 0x7f7b881145b0 2019-11-28T11:52:59.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.016+0000 7f7b857fa700 1 -- 172.21.15.80:0/659808217 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b70001070 con 0x7f7b881145b0 2019-11-28T11:52:59.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.016+0000 7f7b8dd09700 1 -- 172.21.15.80:0/659808217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b88115400 con 0x7f7b881145b0 2019-11-28T11:52:59.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.016+0000 7f7b857fa700 1 -- 172.21.15.80:0/659808217 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b70001780 con 0x7f7b881145b0 2019-11-28T11:52:59.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.016+0000 7f7b8dd09700 1 -- 172.21.15.80:0/659808217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b88115400 con 0x7f7b881145b0 2019-11-28T11:52:59.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.016+0000 7f7b7ffff700 1 --2- 172.21.15.80:0/659808217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b881145b0 0x7f7b88114a40 secure :-1 s=THROTTLE_DONE pgs=2311 cs=0 l=1 rx=0x7f7b700104f0 tx=0x7f7b70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:59.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.016+0000 7f7b857fa700 1 -- 172.21.15.80:0/659808217 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7b70000c60 con 0x7f7b881145b0 2019-11-28T11:52:59.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.016+0000 7f7b7ffff700 1 --2- 172.21.15.80:0/659808217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b881145b0 0x7f7b88114a40 secure :-1 s=THROTTLE_DONE pgs=2311 cs=0 l=1 rx=0x7f7b700104f0 tx=0x7f7b70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:59.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.016+0000 7f7b857fa700 1 --2- 172.21.15.80:0/659808217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b60018730 0x7f7b6001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:52:59.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.016+0000 7f7b857fa700 1 -- 172.21.15.80:0/659808217 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f7b70031b00 con 0x7f7b881145b0 2019-11-28T11:52:59.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.017+0000 7f7b87fff700 1 --2- 172.21.15.80:0/659808217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b60018730 0x7f7b6001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:52:59.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.017+0000 7f7b87fff700 1 --2- 172.21.15.80:0/659808217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b60018730 0x7f7b6001abc0 crc :-1 s=READY pgs=952 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:52:59.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.024+0000 7f7b8dd09700 1 -- 172.21.15.80:0/659808217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b88112eb0 con 0x7f7b881145b0 2019-11-28T11:52:59.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.028+0000 7f7b7ffff700 1 --2- 172.21.15.80:0/659808217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b881145b0 0x7f7b88114a40 secure :-1 s=THROTTLE_DONE pgs=2311 cs=0 l=1 rx=0x7f7b700104f0 tx=0x7f7b70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:59.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.028+0000 7f7b857fa700 1 -- 172.21.15.80:0/659808217 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7b700075d0 con 0x7f7b881145b0 2019-11-28T11:52:59.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.200+0000 7f7b8dd09700 1 -- 172.21.15.80:0/659808217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b88113230 con 0x7f7b881145b0 2019-11-28T11:52:59.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.200+0000 7f7b7ffff700 1 --2- 172.21.15.80:0/659808217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b881145b0 0x7f7b88114a40 secure :-1 s=THROTTLE_DONE pgs=2311 cs=0 l=1 rx=0x7f7b700104f0 tx=0x7f7b70010890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:52:59.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.200+0000 7f7b857fa700 1 -- 172.21.15.80:0/659808217 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f7b70028f40 con 0x7f7b881145b0 2019-11-28T11:52:59.272 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:52:59.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.203+0000 7f7b8dd09700 1 -- 172.21.15.80:0/659808217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b60018730 msgr2=0x7f7b6001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:59.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.203+0000 7f7b8dd09700 1 --2- 172.21.15.80:0/659808217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b60018730 0x7f7b6001abc0 crc :-1 s=READY pgs=952 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:59.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.203+0000 7f7b8dd09700 1 -- 172.21.15.80:0/659808217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b881145b0 msgr2=0x7f7b88114a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:52:59.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.203+0000 7f7b8dd09700 1 --2- 172.21.15.80:0/659808217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b881145b0 0x7f7b88114a40 secure :-1 s=READY pgs=2311 cs=0 l=1 rx=0x7f7b700104f0 tx=0x7f7b70010890).stop 2019-11-28T11:52:59.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.203+0000 7f7b8dd09700 1 -- 172.21.15.80:0/659808217 shutdown_connections 2019-11-28T11:52:59.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.203+0000 7f7b8dd09700 1 --2- 172.21.15.80:0/659808217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b881145b0 0x7f7b88114a40 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:59.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.203+0000 7f7b8dd09700 1 --2- 172.21.15.80:0/659808217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b60018730 0x7f7b6001abc0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:52:59.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.203+0000 7f7b8dd09700 1 -- 172.21.15.80:0/659808217 shutdown_connections 2019-11-28T11:52:59.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.203+0000 7f7b8dd09700 1 -- 172.21.15.80:0/659808217 wait complete. 2019-11-28T11:52:59.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:52:59.203+0000 7f7b8dd09700 1 -- 172.21.15.80:0/659808217 >> 172.21.15.80:0/659808217 conn(0x7f7b881426c0 msgr2=0x7f7b88110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:52:59.275 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:52:59.275 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:52:59.276 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:00.276 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:00.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.355+0000 7f1817308700 1 Processor -- start 2019-11-28T11:53:00.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.356+0000 7f1817308700 1 -- start start 2019-11-28T11:53:00.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.356+0000 7f1817308700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f181006c0a0 0x7f1810072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:00.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.356+0000 7f1817308700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1810072620 0x7f1810164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:00.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.356+0000 7f1817308700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181006db00 con 0x7f18100734e0 2019-11-28T11:53:00.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.356+0000 7f1817308700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181006fd60 con 0x7f181006c0a0 2019-11-28T11:53:00.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.356+0000 7f1817308700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1810070030 con 0x7f1810072620 2019-11-28T11:53:00.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18158a5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f181006c0a0 0x7f1810072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:00.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18160a6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1810072620 0x7f1810164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:00.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18158a5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f181006c0a0 0x7f1810072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:58526/0 (socket says 172.21.15.80:58526) 2019-11-28T11:53:00.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18150a4700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f18100734e0 0x7f1810071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58504/0 (socket says 172.21.15.80:58504) 2019-11-28T11:53:00.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18158a5700 1 -- 172.21.15.80:0/424129824 learned_addr learned my addr 172.21.15.80:0/424129824 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:00.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18160a6700 1 --2- 172.21.15.80:0/424129824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1810072620 0x7f1810164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:45902/0 (socket says 172.21.15.80:45902) 2019-11-28T11:53:00.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18160a6700 1 -- 172.21.15.80:0/424129824 >> v2:172.21.15.174:3300/0 conn(0x7f181006c0a0 msgr2=0x7f1810072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:00.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18160a6700 1 --2- 172.21.15.80:0/424129824 >> v2:172.21.15.174:3300/0 conn(0x7f181006c0a0 0x7f1810072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:00.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18160a6700 1 -- 172.21.15.80:0/424129824 >> v1:172.21.15.174:6789/0 conn(0x7f18100734e0 legacy=0x7f1810071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:00.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18160a6700 1 -- 172.21.15.80:0/424129824 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18100706c0 con 0x7f1810072620 2019-11-28T11:53:00.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18158a5700 1 --2- 172.21.15.80:0/424129824 >> v2:172.21.15.174:3300/0 conn(0x7f181006c0a0 0x7f1810072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:00.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18160a6700 1 --2- 172.21.15.80:0/424129824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1810072620 0x7f1810164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f180800b300 tx=0x7f180800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:00.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18160a6700 1 --2- 172.21.15.80:0/424129824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1810072620 0x7f1810164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f180800b300 tx=0x7f180800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:00.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18160a6700 1 --2- 172.21.15.80:0/424129824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1810072620 0x7f1810164d70 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7f180800b300 tx=0x7f180800bb10).ready entity=mon.2 client_cookie=b71b98f80d45f5f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:00.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18160a6700 1 --2- 172.21.15.80:0/424129824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1810072620 0x7f1810164d70 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f180800b300 tx=0x7f180800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:00.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18160a6700 1 --2- 172.21.15.80:0/424129824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1810072620 0x7f1810164d70 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f180800b300 tx=0x7f180800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:00.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.358+0000 7f18160a6700 1 --2- 172.21.15.80:0/424129824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1810072620 0x7f1810164d70 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f180800b300 tx=0x7f180800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:00.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.357+0000 7f18148a3700 1 -- 172.21.15.80:0/424129824 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1808000f40 con 0x7f1810072620 2019-11-28T11:53:00.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.358+0000 7f18148a3700 1 -- 172.21.15.80:0/424129824 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1808009b70 con 0x7f1810072620 2019-11-28T11:53:00.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.358+0000 7f18148a3700 1 -- 172.21.15.80:0/424129824 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f180800a240 con 0x7f1810072620 2019-11-28T11:53:00.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.358+0000 7f1817308700 1 -- 172.21.15.80:0/424129824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1810072620 msgr2=0x7f1810164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:00.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.358+0000 7f1817308700 1 --2- 172.21.15.80:0/424129824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1810072620 0x7f1810164d70 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7f180800b300 tx=0x7f180800bb10).stop 2019-11-28T11:53:00.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.358+0000 7f1817308700 1 -- 172.21.15.80:0/424129824 shutdown_connections 2019-11-28T11:53:00.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.358+0000 7f1817308700 1 --2- 172.21.15.80:0/424129824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1810072620 0x7f1810164d70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:00.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.358+0000 7f1817308700 1 --2- 172.21.15.80:0/424129824 >> v2:172.21.15.174:3300/0 conn(0x7f181006c0a0 0x7f1810072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:00.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.358+0000 7f1817308700 1 -- 172.21.15.80:0/424129824 shutdown_connections 2019-11-28T11:53:00.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.359+0000 7f1817308700 1 -- 172.21.15.80:0/424129824 wait complete. 2019-11-28T11:53:00.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.359+0000 7f1817308700 1 -- 172.21.15.80:0/424129824 >> 172.21.15.80:0/424129824 conn(0x7f1810061cf0 msgr2=0x7f1810064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:00.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.361+0000 7f1817308700 1 Processor -- start 2019-11-28T11:53:00.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.361+0000 7f1817308700 1 -- start start 2019-11-28T11:53:00.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f1817308700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181013e5f0 0x7f181013e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:00.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f1817308700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f181010a4e0 0x7f181010c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:00.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f1817308700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18101066e0 con 0x7f181010a070 2019-11-28T11:53:00.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f1817308700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181010d630 con 0x7f181010a4e0 2019-11-28T11:53:00.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f1817308700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181010e060 con 0x7f181013e5f0 2019-11-28T11:53:00.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f18150a4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f181010a070 0x7f181010bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42962/0 (socket says 172.21.15.80:42962) 2019-11-28T11:53:00.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f18150a4700 1 -- 172.21.15.80:0/1632065067 learned_addr learned my addr 172.21.15.80:0/1632065067 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:00.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f18160a6700 1 --2- 172.21.15.80:0/1632065067 >> v2:172.21.15.174:3300/0 conn(0x7f181010a4e0 0x7f181010c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:00.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f18158a5700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181013e5f0 0x7f181013e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:00.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f180e7fc700 1 -- 172.21.15.80:0/1632065067 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055586978 0 0) 0x7f18040010b0 con 0x7f181010a070 2019-11-28T11:53:00.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f180e7fc700 1 -- 172.21.15.80:0/1632065067 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f0002e80 con 0x7f181010a070 2019-11-28T11:53:00.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f18160a6700 1 -- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181013e5f0 msgr2=0x7f181013e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:00.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f18160a6700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181013e5f0 0x7f181013e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:00.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f18160a6700 1 -- 172.21.15.80:0/1632065067 >> v1:172.21.15.80:6789/0 conn(0x7f181010a070 legacy=0x7f181010bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:00.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f18160a6700 1 -- 172.21.15.80:0/1632065067 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181010e9c0 con 0x7f181010a4e0 2019-11-28T11:53:00.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f18158a5700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181013e5f0 0x7f181013e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:00.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.362+0000 7f18160a6700 1 --2- 172.21.15.80:0/1632065067 >> v2:172.21.15.174:3300/0 conn(0x7f181010a4e0 0x7f181010c5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1808010720 tx=0x7f1808010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:00.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.363+0000 7f18160a6700 1 --2- 172.21.15.80:0/1632065067 >> v2:172.21.15.174:3300/0 conn(0x7f181010a4e0 0x7f181010c5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1808010720 tx=0x7f1808010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:00.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.363+0000 7f18160a6700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f181010a4e0 0x7f181010c5b0 secure :-1 s=READY pgs=1393 cs=0 l=1 rx=0x7f1808010720 tx=0x7f1808010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:00.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.363+0000 7f18160a6700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f181010a4e0 0x7f181010c5b0 secure :-1 s=THROTTLE_DONE pgs=1393 cs=0 l=1 rx=0x7f1808010720 tx=0x7f1808010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:00.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.363+0000 7f180e7fc700 1 -- 172.21.15.80:0/1632065067 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f180800b2e0 con 0x7f181010a4e0 2019-11-28T11:53:00.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.363+0000 7f18160a6700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f181010a4e0 0x7f181010c5b0 secure :-1 s=THROTTLE_DONE pgs=1393 cs=0 l=1 rx=0x7f1808010720 tx=0x7f1808010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:00.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.363+0000 7f18160a6700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f181010a4e0 0x7f181010c5b0 secure :-1 s=THROTTLE_DONE pgs=1393 cs=0 l=1 rx=0x7f1808010720 tx=0x7f1808010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:00.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.363+0000 7f180e7fc700 1 -- 172.21.15.80:0/1632065067 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1808009930 con 0x7f181010a4e0 2019-11-28T11:53:00.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.363+0000 7f1817308700 1 -- 172.21.15.80:0/1632065067 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181010ed40 con 0x7f181010a4e0 2019-11-28T11:53:00.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.363+0000 7f180e7fc700 1 -- 172.21.15.80:0/1632065067 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1808009b60 con 0x7f181010a4e0 2019-11-28T11:53:00.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.363+0000 7f1817308700 1 -- 172.21.15.80:0/1632065067 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181010e9c0 con 0x7f181010a4e0 2019-11-28T11:53:00.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.363+0000 7f18160a6700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f181010a4e0 0x7f181010c5b0 secure :-1 s=THROTTLE_DONE pgs=1393 cs=0 l=1 rx=0x7f1808010720 tx=0x7f1808010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:00.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.363+0000 7f180e7fc700 1 -- 172.21.15.80:0/1632065067 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1808009b20 con 0x7f181010a4e0 2019-11-28T11:53:00.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.363+0000 7f18160a6700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f181010a4e0 0x7f181010c5b0 secure :-1 s=THROTTLE_DONE pgs=1393 cs=0 l=1 rx=0x7f1808010720 tx=0x7f1808010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:00.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.364+0000 7f180e7fc700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17f0018770 0x7f17f001ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:00.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.364+0000 7f180e7fc700 1 -- 172.21.15.80:0/1632065067 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f1808031fa0 con 0x7f181010a4e0 2019-11-28T11:53:00.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.364+0000 7f18158a5700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17f0018770 0x7f17f001ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:00.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.364+0000 7f18158a5700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17f0018770 0x7f17f001ac00 crc :-1 s=READY pgs=953 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:00.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.371+0000 7f1817308700 1 -- 172.21.15.80:0/1632065067 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181010ed40 con 0x7f181010a4e0 2019-11-28T11:53:00.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.374+0000 7f18160a6700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f181010a4e0 0x7f181010c5b0 secure :-1 s=THROTTLE_DONE pgs=1393 cs=0 l=1 rx=0x7f1808010720 tx=0x7f1808010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:00.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.374+0000 7f180e7fc700 1 -- 172.21.15.80:0/1632065067 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f180800b170 con 0x7f181010a4e0 2019-11-28T11:53:00.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.548+0000 7f1817308700 1 -- 172.21.15.80:0/1632065067 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f181010e9c0 con 0x7f181010a4e0 2019-11-28T11:53:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.548+0000 7f18160a6700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f181010a4e0 0x7f181010c5b0 secure :-1 s=THROTTLE_DONE pgs=1393 cs=0 l=1 rx=0x7f1808010720 tx=0x7f1808010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:00.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.548+0000 7f180e7fc700 1 -- 172.21.15.80:0/1632065067 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f1808009930 con 0x7f181010a4e0 2019-11-28T11:53:00.604 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:00.604 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:00.604 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.551+0000 7f1817308700 1 -- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17f0018770 msgr2=0x7f17f001ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.551+0000 7f1817308700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17f0018770 0x7f17f001ac00 crc :-1 s=READY pgs=953 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:00.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.551+0000 7f1817308700 1 -- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f181010a4e0 msgr2=0x7f181010c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.551+0000 7f1817308700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f181010a4e0 0x7f181010c5b0 secure :-1 s=READY pgs=1393 cs=0 l=1 rx=0x7f1808010720 tx=0x7f1808010ac0).stop 2019-11-28T11:53:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.551+0000 7f1817308700 1 -- 172.21.15.80:0/1632065067 shutdown_connections 2019-11-28T11:53:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.551+0000 7f1817308700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f17f0018770 0x7f17f001ac00 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.551+0000 7f1817308700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f181010a4e0 0x7f181010c5b0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:00.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.551+0000 7f1817308700 1 --2- 172.21.15.80:0/1632065067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f181013e5f0 0x7f181013e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:00.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.551+0000 7f1817308700 1 -- 172.21.15.80:0/1632065067 shutdown_connections 2019-11-28T11:53:00.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.551+0000 7f1817308700 1 -- 172.21.15.80:0/1632065067 wait complete. 2019-11-28T11:53:00.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:00.551+0000 7f1817308700 1 -- 172.21.15.80:0/1632065067 >> 172.21.15.80:0/1632065067 conn(0x7f181013d620 msgr2=0x7f181013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:00.615 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:01.616 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:01.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.687+0000 7f055b6e3700 1 Processor -- start 2019-11-28T11:53:01.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.687+0000 7f055b6e3700 1 -- start start 2019-11-28T11:53:01.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.688+0000 7f055b6e3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f055406c490 0x7f055406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:01.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.688+0000 7f055b6e3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f055406ce60 0x7f0554164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:01.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.688+0000 7f055b6e3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055406db00 con 0x7f055406c0a0 2019-11-28T11:53:01.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.688+0000 7f055b6e3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055406fd60 con 0x7f055406ce60 2019-11-28T11:53:01.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.688+0000 7f055b6e3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0554070030 con 0x7f055406c490 2019-11-28T11:53:01.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.688+0000 7f055a481700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f055406ce60 0x7f0554164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:01.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.688+0000 7f055a481700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f055406ce60 0x7f0554164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43656/0 (socket says 172.21.15.80:43656) 2019-11-28T11:53:01.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.688+0000 7f055a481700 1 -- 172.21.15.80:0/3553306872 learned_addr learned my addr 172.21.15.80:0/3553306872 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:01.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.688+0000 7f055947f700 1 --2- 172.21.15.80:0/3553306872 >> v2:172.21.15.174:3300/0 conn(0x7f055406c490 0x7f055406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:01.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.688+0000 7f055a481700 1 -- 172.21.15.80:0/3553306872 >> v2:172.21.15.174:3300/0 conn(0x7f055406c490 msgr2=0x7f055406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:01.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.688+0000 7f055a481700 1 --2- 172.21.15.80:0/3553306872 >> v2:172.21.15.174:3300/0 conn(0x7f055406c490 0x7f055406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:01.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.688+0000 7f055a481700 1 -- 172.21.15.80:0/3553306872 >> v1:172.21.15.174:6789/0 conn(0x7f055406c0a0 legacy=0x7f0554072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:01.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.688+0000 7f055a481700 1 -- 172.21.15.80:0/3553306872 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05540706c0 con 0x7f055406ce60 2019-11-28T11:53:01.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.688+0000 7f055a481700 1 --2- 172.21.15.80:0/3553306872 >> v2:172.21.15.80:3300/0 conn(0x7f055406ce60 0x7f0554164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f054c00f6b0 tx=0x7f054c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:01.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.689+0000 7f055a481700 1 --2- 172.21.15.80:0/3553306872 >> v2:172.21.15.80:3300/0 conn(0x7f055406ce60 0x7f0554164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f054c00f6b0 tx=0x7f054c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:01.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.689+0000 7f055a481700 1 --2- 172.21.15.80:0/3553306872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f055406ce60 0x7f0554164d70 secure :-1 s=READY pgs=2313 cs=0 l=1 rx=0x7f054c00f6b0 tx=0x7f054c00fa50).ready entity=mon.0 client_cookie=c756409cc2021fb2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:01.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.689+0000 7f055a481700 1 --2- 172.21.15.80:0/3553306872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f055406ce60 0x7f0554164d70 secure :-1 s=THROTTLE_DONE pgs=2313 cs=0 l=1 rx=0x7f054c00f6b0 tx=0x7f054c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:01.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.689+0000 7f0558c7e700 1 -- 172.21.15.80:0/3553306872 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c000a70 con 0x7f055406ce60 2019-11-28T11:53:01.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.689+0000 7f055a481700 1 --2- 172.21.15.80:0/3553306872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f055406ce60 0x7f0554164d70 secure :-1 s=THROTTLE_DONE pgs=2313 cs=0 l=1 rx=0x7f054c00f6b0 tx=0x7f054c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:01.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.689+0000 7f055a481700 1 --2- 172.21.15.80:0/3553306872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f055406ce60 0x7f0554164d70 secure :-1 s=THROTTLE_DONE pgs=2313 cs=0 l=1 rx=0x7f054c00f6b0 tx=0x7f054c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:01.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.689+0000 7f0558c7e700 1 -- 172.21.15.80:0/3553306872 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c0010e0 con 0x7f055406ce60 2019-11-28T11:53:01.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.689+0000 7f0558c7e700 1 -- 172.21.15.80:0/3553306872 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c0017d0 con 0x7f055406ce60 2019-11-28T11:53:01.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.689+0000 7f055b6e3700 1 -- 172.21.15.80:0/3553306872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f055406ce60 msgr2=0x7f0554164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:01.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.689+0000 7f055b6e3700 1 --2- 172.21.15.80:0/3553306872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f055406ce60 0x7f0554164d70 secure :-1 s=READY pgs=2313 cs=0 l=1 rx=0x7f054c00f6b0 tx=0x7f054c00fa50).stop 2019-11-28T11:53:01.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.689+0000 7f055b6e3700 1 -- 172.21.15.80:0/3553306872 shutdown_connections 2019-11-28T11:53:01.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.689+0000 7f055b6e3700 1 --2- 172.21.15.80:0/3553306872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f055406ce60 0x7f0554164d70 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:01.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.689+0000 7f055b6e3700 1 --2- 172.21.15.80:0/3553306872 >> v2:172.21.15.174:3300/0 conn(0x7f055406c490 0x7f055406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:01.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.690+0000 7f055b6e3700 1 -- 172.21.15.80:0/3553306872 shutdown_connections 2019-11-28T11:53:01.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.690+0000 7f055b6e3700 1 -- 172.21.15.80:0/3553306872 wait complete. 2019-11-28T11:53:01.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.690+0000 7f055b6e3700 1 -- 172.21.15.80:0/3553306872 >> 172.21.15.80:0/3553306872 conn(0x7f0554061cf0 msgr2=0x7f0554064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:01.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.692+0000 7f055b6e3700 1 Processor -- start 2019-11-28T11:53:01.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.692+0000 7f055b6e3700 1 -- start start 2019-11-28T11:53:01.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.693+0000 7f055b6e3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0554103c90 0x7f0554168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:01.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.693+0000 7f055b6e3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05541312c0 con 0x7f055413dc00 2019-11-28T11:53:01.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.693+0000 7f055b6e3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0554131730 con 0x7f0554103000 2019-11-28T11:53:01.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.693+0000 7f055b6e3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0554105830 con 0x7f0554103c90 2019-11-28T11:53:01.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.693+0000 7f0559c80700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f055413dc00 0x7f0554109e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42976/0 (socket says 172.21.15.80:42976) 2019-11-28T11:53:01.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.693+0000 7f0559c80700 1 -- 172.21.15.80:0/3834762709 learned_addr learned my addr 172.21.15.80:0/3834762709 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:01.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.693+0000 7f055a481700 1 --2- 172.21.15.80:0/3834762709 >> v2:172.21.15.174:3300/0 conn(0x7f0554103c90 0x7f0554168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:01.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.693+0000 7f05527fc700 1 -- 172.21.15.80:0/3834762709 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190857738 0 0) 0x7f0544001490 con 0x7f055413dc00 2019-11-28T11:53:01.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.693+0000 7f05527fc700 1 -- 172.21.15.80:0/3834762709 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0538002e80 con 0x7f055413dc00 2019-11-28T11:53:01.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.693+0000 7f05527fc700 1 -- 172.21.15.80:0/3834762709 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133703756 0 0) 0x7f053c000f30 con 0x7f0554103000 2019-11-28T11:53:01.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.693+0000 7f055a481700 1 -- 172.21.15.80:0/3834762709 >> v1:172.21.15.174:6789/0 conn(0x7f0554103000 legacy=0x7f0554103490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:01.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.693+0000 7f055a481700 1 -- 172.21.15.80:0/3834762709 >> v1:172.21.15.80:6789/0 conn(0x7f055413dc00 legacy=0x7f0554109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:01.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.693+0000 7f055a481700 1 -- 172.21.15.80:0/3834762709 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0554106190 con 0x7f0554103c90 2019-11-28T11:53:01.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.693+0000 7f055a481700 1 --2- 172.21.15.80:0/3834762709 >> v2:172.21.15.174:3300/0 conn(0x7f0554103c90 0x7f0554168a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:01.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.693+0000 7f055a481700 1 --2- 172.21.15.80:0/3834762709 >> v2:172.21.15.174:3300/0 conn(0x7f0554103c90 0x7f0554168a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:01.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.693+0000 7f055a481700 1 --2- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0554103c90 0x7f0554168a20 secure :-1 s=READY pgs=1396 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:01.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.694+0000 7f055a481700 1 --2- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0554103c90 0x7f0554168a20 secure :-1 s=THROTTLE_DONE pgs=1396 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:01.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.694+0000 7f05527fc700 1 -- 172.21.15.80:0/3834762709 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c001290 con 0x7f0554103c90 2019-11-28T11:53:01.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.694+0000 7f055a481700 1 --2- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0554103c90 0x7f0554168a20 secure :-1 s=THROTTLE_DONE pgs=1396 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:01.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.694+0000 7f055a481700 1 --2- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0554103c90 0x7f0554168a20 secure :-1 s=THROTTLE_DONE pgs=1396 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:01.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.694+0000 7f05527fc700 1 -- 172.21.15.80:0/3834762709 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c000eb0 con 0x7f0554103c90 2019-11-28T11:53:01.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.694+0000 7f055b6e3700 1 -- 172.21.15.80:0/3834762709 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0554106510 con 0x7f0554103c90 2019-11-28T11:53:01.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.694+0000 7f05527fc700 1 -- 172.21.15.80:0/3834762709 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c0010a0 con 0x7f0554103c90 2019-11-28T11:53:01.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.694+0000 7f055b6e3700 1 -- 172.21.15.80:0/3834762709 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0554106190 con 0x7f0554103c90 2019-11-28T11:53:01.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.694+0000 7f055a481700 1 --2- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0554103c90 0x7f0554168a20 secure :-1 s=THROTTLE_DONE pgs=1396 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:01.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.695+0000 7f05527fc700 1 -- 172.21.15.80:0/3834762709 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f054c0010a0 con 0x7f0554103c90 2019-11-28T11:53:01.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.695+0000 7f055a481700 1 --2- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0554103c90 0x7f0554168a20 secure :-1 s=THROTTLE_DONE pgs=1396 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:01.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.695+0000 7f05527fc700 1 --2- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0538018780 0x7f053801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:01.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.695+0000 7f05527fc700 1 -- 172.21.15.80:0/3834762709 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f054c031cc0 con 0x7f0554103c90 2019-11-28T11:53:01.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.695+0000 7f0559c80700 1 --2- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0538018780 0x7f053801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:01.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.695+0000 7f0559c80700 1 --2- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0538018780 0x7f053801abf0 crc :-1 s=READY pgs=954 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:01.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.702+0000 7f055b6e3700 1 -- 172.21.15.80:0/3834762709 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0554106510 con 0x7f0554103c90 2019-11-28T11:53:01.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.706+0000 7f055a481700 1 --2- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0554103c90 0x7f0554168a20 secure :-1 s=THROTTLE_DONE pgs=1396 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:01.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.706+0000 7f05527fc700 1 -- 172.21.15.80:0/3834762709 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f054c007580 con 0x7f0554103c90 2019-11-28T11:53:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.880+0000 7f055b6e3700 1 -- 172.21.15.80:0/3834762709 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0554106190 con 0x7f0554103c90 2019-11-28T11:53:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.881+0000 7f055a481700 1 --2- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0554103c90 0x7f0554168a20 secure :-1 s=THROTTLE_DONE pgs=1396 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:01.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.881+0000 7f05527fc700 1 -- 172.21.15.80:0/3834762709 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f054c000eb0 con 0x7f0554103c90 2019-11-28T11:53:01.936 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:01.936 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:01.936 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:01.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.883+0000 7f055b6e3700 1 -- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0538018780 msgr2=0x7f053801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:01.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.883+0000 7f055b6e3700 1 --2- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0538018780 0x7f053801abf0 crc :-1 s=READY pgs=954 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:01.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.883+0000 7f055b6e3700 1 -- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0554103c90 msgr2=0x7f0554168a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:01.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.883+0000 7f055b6e3700 1 --2- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0554103c90 0x7f0554168a20 secure :-1 s=READY pgs=1396 cs=0 l=1 rx=0x7f054c010380 tx=0x7f054c010720).stop 2019-11-28T11:53:01.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.883+0000 7f055b6e3700 1 -- 172.21.15.80:0/3834762709 shutdown_connections 2019-11-28T11:53:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.883+0000 7f055b6e3700 1 --2- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0554103c90 0x7f0554168a20 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.883+0000 7f055b6e3700 1 --2- 172.21.15.80:0/3834762709 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0538018780 0x7f053801abf0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.883+0000 7f055b6e3700 1 -- 172.21.15.80:0/3834762709 shutdown_connections 2019-11-28T11:53:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.883+0000 7f055b6e3700 1 -- 172.21.15.80:0/3834762709 wait complete. 2019-11-28T11:53:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:01.883+0000 7f055b6e3700 1 -- 172.21.15.80:0/3834762709 >> 172.21.15.80:0/3834762709 conn(0x7f055411bfc0 msgr2=0x7f0554141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:01.947 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:02.948 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:03.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.015+0000 7f01f3099700 1 Processor -- start 2019-11-28T11:53:03.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.015+0000 7f01f3099700 1 -- start start 2019-11-28T11:53:03.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.016+0000 7f01f3099700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01ec06c490 0x7f01ec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:03.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.016+0000 7f01f3099700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec06ce60 0x7f01ec164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:03.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.016+0000 7f01f3099700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec06db00 con 0x7f01ec06c0a0 2019-11-28T11:53:03.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.016+0000 7f01f3099700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec06fd60 con 0x7f01ec06c490 2019-11-28T11:53:03.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.016+0000 7f01f3099700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec070030 con 0x7f01ec06ce60 2019-11-28T11:53:03.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f1e37700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec06ce60 0x7f01ec164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:03.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f0e35700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01ec06c490 0x7f01ec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:03.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f1636700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f01ec06c0a0 0x7f01ec072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58528/0 (socket says 172.21.15.80:58528) 2019-11-28T11:53:03.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f0e35700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01ec06c490 0x7f01ec06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:58558/0 (socket says 172.21.15.80:58558) 2019-11-28T11:53:03.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f1636700 1 -- 172.21.15.80:0/3355099839 learned_addr learned my addr 172.21.15.80:0/3355099839 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:03.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f1e37700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec06ce60 0x7f01ec164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:45930/0 (socket says 172.21.15.80:45930) 2019-11-28T11:53:03.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f1e37700 1 -- 172.21.15.80:0/3355099839 >> v2:172.21.15.174:3300/0 conn(0x7f01ec06c490 msgr2=0x7f01ec06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:03.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f1e37700 1 --2- 172.21.15.80:0/3355099839 >> v2:172.21.15.174:3300/0 conn(0x7f01ec06c490 0x7f01ec06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:03.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f1e37700 1 -- 172.21.15.80:0/3355099839 >> v1:172.21.15.174:6789/0 conn(0x7f01ec06c0a0 legacy=0x7f01ec072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:03.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f1e37700 1 -- 172.21.15.80:0/3355099839 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec0706c0 con 0x7f01ec06ce60 2019-11-28T11:53:03.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01ebfff700 1 -- 172.21.15.80:0/3355099839 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971069491 0 0) 0x7f01dc001100 con 0x7f01ec06c0a0 2019-11-28T11:53:03.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f0e35700 1 --2- 172.21.15.80:0/3355099839 >> v2:172.21.15.174:3300/0 conn(0x7f01ec06c490 0x7f01ec06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:03.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f1e37700 1 --2- 172.21.15.80:0/3355099839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec06ce60 0x7f01ec164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f01e400b300 tx=0x7f01e400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:03.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f1e37700 1 --2- 172.21.15.80:0/3355099839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec06ce60 0x7f01ec164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f01e400b300 tx=0x7f01e400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:03.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f1e37700 1 --2- 172.21.15.80:0/3355099839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec06ce60 0x7f01ec164d70 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f01e400b300 tx=0x7f01e400bb10).ready entity=mon.2 client_cookie=2bc7c0395f1bad54 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:03.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f1e37700 1 --2- 172.21.15.80:0/3355099839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec06ce60 0x7f01ec164d70 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f01e400b300 tx=0x7f01e400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:03.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01ebfff700 1 -- 172.21.15.80:0/3355099839 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01e4000f40 con 0x7f01ec06ce60 2019-11-28T11:53:03.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f1e37700 1 --2- 172.21.15.80:0/3355099839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec06ce60 0x7f01ec164d70 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f01e400b300 tx=0x7f01e400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:03.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f1e37700 1 --2- 172.21.15.80:0/3355099839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec06ce60 0x7f01ec164d70 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f01e400b300 tx=0x7f01e400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:03.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01ebfff700 1 -- 172.21.15.80:0/3355099839 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e4009b70 con 0x7f01ec06ce60 2019-11-28T11:53:03.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01ebfff700 1 -- 172.21.15.80:0/3355099839 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01e4000f40 con 0x7f01ec06ce60 2019-11-28T11:53:03.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f3099700 1 -- 172.21.15.80:0/3355099839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec06ce60 msgr2=0x7f01ec164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:03.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.017+0000 7f01f3099700 1 --2- 172.21.15.80:0/3355099839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec06ce60 0x7f01ec164d70 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f01e400b300 tx=0x7f01e400bb10).stop 2019-11-28T11:53:03.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.018+0000 7f01f3099700 1 -- 172.21.15.80:0/3355099839 shutdown_connections 2019-11-28T11:53:03.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.018+0000 7f01f3099700 1 --2- 172.21.15.80:0/3355099839 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec06ce60 0x7f01ec164d70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:03.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.018+0000 7f01f3099700 1 --2- 172.21.15.80:0/3355099839 >> v2:172.21.15.174:3300/0 conn(0x7f01ec06c490 0x7f01ec06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:03.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.018+0000 7f01f3099700 1 -- 172.21.15.80:0/3355099839 shutdown_connections 2019-11-28T11:53:03.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.018+0000 7f01f3099700 1 -- 172.21.15.80:0/3355099839 wait complete. 2019-11-28T11:53:03.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.018+0000 7f01f3099700 1 -- 172.21.15.80:0/3355099839 >> 172.21.15.80:0/3355099839 conn(0x7f01ec061cf0 msgr2=0x7f01ec064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:03.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.021+0000 7f01f3099700 1 Processor -- start 2019-11-28T11:53:03.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.021+0000 7f01f3099700 1 -- start start 2019-11-28T11:53:03.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01f3099700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec164ff0 0x7f01ec1653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:03.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01f3099700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec131680 con 0x7f01ec133820 2019-11-28T11:53:03.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01f3099700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec10cb40 con 0x7f01ec133cb0 2019-11-28T11:53:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01f3099700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec10d360 con 0x7f01ec164ff0 2019-11-28T11:53:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01f0e35700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f01ec133820 0x7f01ec1326a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42992/0 (socket says 172.21.15.80:42992) 2019-11-28T11:53:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01f0e35700 1 -- 172.21.15.80:0/3242741700 learned_addr learned my addr 172.21.15.80:0/3242741700 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01f1636700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec164ff0 0x7f01ec1653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01e9ffb700 1 -- 172.21.15.80:0/3242741700 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392881105 0 0) 0x7f01e000dd90 con 0x7f01ec133820 2019-11-28T11:53:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01e9ffb700 1 -- 172.21.15.80:0/3242741700 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01cc002e80 con 0x7f01ec133820 2019-11-28T11:53:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01e9ffb700 1 -- 172.21.15.80:0/3242741700 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83740779 0 0) 0x7f01e400af60 con 0x7f01ec133cb0 2019-11-28T11:53:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01e9ffb700 1 -- 172.21.15.80:0/3242741700 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01cc0030b0 con 0x7f01ec133cb0 2019-11-28T11:53:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01f1636700 1 -- 172.21.15.80:0/3242741700 >> v1:172.21.15.174:6789/0 conn(0x7f01ec133cb0 legacy=0x7f01ec132ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01f1636700 1 -- 172.21.15.80:0/3242741700 >> v1:172.21.15.80:6789/0 conn(0x7f01ec133820 legacy=0x7f01ec1326a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01f1636700 1 -- 172.21.15.80:0/3242741700 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec10e6f0 con 0x7f01ec164ff0 2019-11-28T11:53:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01f1636700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec164ff0 0x7f01ec1653e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f01dc010390 tx=0x7f01dc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01f1636700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec164ff0 0x7f01ec1653e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f01dc010390 tx=0x7f01dc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.022+0000 7f01f1636700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec164ff0 0x7f01ec1653e0 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7f01dc010390 tx=0x7f01dc010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.023+0000 7f01f1636700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec164ff0 0x7f01ec1653e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f01dc010390 tx=0x7f01dc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.023+0000 7f01e9ffb700 1 -- 172.21.15.80:0/3242741700 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01dc001100 con 0x7f01ec164ff0 2019-11-28T11:53:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.023+0000 7f01f1636700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec164ff0 0x7f01ec1653e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f01dc010390 tx=0x7f01dc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:03.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.023+0000 7f01f1636700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec164ff0 0x7f01ec1653e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f01dc010390 tx=0x7f01dc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:03.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.023+0000 7f01e9ffb700 1 -- 172.21.15.80:0/3242741700 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc0043b0 con 0x7f01ec164ff0 2019-11-28T11:53:03.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.023+0000 7f01e9ffb700 1 -- 172.21.15.80:0/3242741700 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01dc004a80 con 0x7f01ec164ff0 2019-11-28T11:53:03.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.023+0000 7f01f3099700 1 -- 172.21.15.80:0/3242741700 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec10ea70 con 0x7f01ec164ff0 2019-11-28T11:53:03.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.023+0000 7f01f3099700 1 -- 172.21.15.80:0/3242741700 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec10e6f0 con 0x7f01ec164ff0 2019-11-28T11:53:03.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.023+0000 7f01f1636700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec164ff0 0x7f01ec1653e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f01dc010390 tx=0x7f01dc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:03.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.023+0000 7f01e9ffb700 1 -- 172.21.15.80:0/3242741700 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f01dc001000 con 0x7f01ec164ff0 2019-11-28T11:53:03.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.023+0000 7f01f1636700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec164ff0 0x7f01ec1653e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f01dc010390 tx=0x7f01dc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:03.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.023+0000 7f01e9ffb700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01cc018750 0x7f01cc01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:03.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.023+0000 7f01e9ffb700 1 -- 172.21.15.80:0/3242741700 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f01dc031aa0 con 0x7f01ec164ff0 2019-11-28T11:53:03.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.024+0000 7f01f0e35700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01cc018750 0x7f01cc01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:03.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.024+0000 7f01f0e35700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01cc018750 0x7f01cc01abe0 crc :-1 s=READY pgs=955 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:03.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.030+0000 7f01f3099700 1 -- 172.21.15.80:0/3242741700 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ec10ea70 con 0x7f01ec164ff0 2019-11-28T11:53:03.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.034+0000 7f01f1636700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec164ff0 0x7f01ec1653e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f01dc010390 tx=0x7f01dc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:03.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.034+0000 7f01e9ffb700 1 -- 172.21.15.80:0/3242741700 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f01dc000df0 con 0x7f01ec164ff0 2019-11-28T11:53:03.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.211+0000 7f01f3099700 1 -- 172.21.15.80:0/3242741700 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01ec10e6f0 con 0x7f01ec164ff0 2019-11-28T11:53:03.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.212+0000 7f01f1636700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec164ff0 0x7f01ec1653e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f01dc010390 tx=0x7f01dc010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:03.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.212+0000 7f01e9ffb700 1 -- 172.21.15.80:0/3242741700 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f01dc001000 con 0x7f01ec164ff0 2019-11-28T11:53:03.267 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:03.267 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:03.267 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:03.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.214+0000 7f01f3099700 1 -- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01cc018750 msgr2=0x7f01cc01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:03.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.214+0000 7f01f3099700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01cc018750 0x7f01cc01abe0 crc :-1 s=READY pgs=955 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:03.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.214+0000 7f01f3099700 1 -- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec164ff0 msgr2=0x7f01ec1653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:03.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.214+0000 7f01f3099700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec164ff0 0x7f01ec1653e0 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7f01dc010390 tx=0x7f01dc010730).stop 2019-11-28T11:53:03.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.214+0000 7f01f3099700 1 -- 172.21.15.80:0/3242741700 shutdown_connections 2019-11-28T11:53:03.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.214+0000 7f01f3099700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f01cc018750 0x7f01cc01abe0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:03.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.214+0000 7f01f3099700 1 --2- 172.21.15.80:0/3242741700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01ec164ff0 0x7f01ec1653e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:03.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.214+0000 7f01f3099700 1 -- 172.21.15.80:0/3242741700 shutdown_connections 2019-11-28T11:53:03.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.214+0000 7f01f3099700 1 -- 172.21.15.80:0/3242741700 wait complete. 2019-11-28T11:53:03.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:03.214+0000 7f01f3099700 1 -- 172.21.15.80:0/3242741700 >> 172.21.15.80:0/3242741700 conn(0x7f01ec11bfc0 msgr2=0x7f01ec141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:03.278 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:04.280 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:04.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.350+0000 7f80124f3700 1 Processor -- start 2019-11-28T11:53:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.350+0000 7f80124f3700 1 -- start start 2019-11-28T11:53:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f80124f3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f800c06c0a0 0x7f800c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f80124f3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c0734e0 0x7f800c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f80124f3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800c06db00 con 0x7f800c072360 2019-11-28T11:53:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f80124f3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c06fd60 con 0x7f800c06c0a0 2019-11-28T11:53:04.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f80124f3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800c070030 con 0x7f800c0734e0 2019-11-28T11:53:04.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f8011291700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f800c072360 0x7f800c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43002/0 (socket says 172.21.15.80:43002) 2019-11-28T11:53:04.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f8011291700 1 -- 172.21.15.80:0/603427270 learned_addr learned my addr 172.21.15.80:0/603427270 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:04.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f800b7fe700 1 -- 172.21.15.80:0/603427270 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597644965 0 0) 0x7f80040014d0 con 0x7f800c072360 2019-11-28T11:53:04.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f800bfff700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c0734e0 0x7f800c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:04.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f8010a90700 1 --2- 172.21.15.80:0/603427270 >> v2:172.21.15.174:3300/0 conn(0x7f800c06c0a0 0x7f800c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:04.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f800b7fe700 1 -- 172.21.15.80:0/603427270 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ff8002e80 con 0x7f800c072360 2019-11-28T11:53:04.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f800b7fe700 1 -- 172.21.15.80:0/603427270 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3485381858 0 0) 0x7f80040014b0 con 0x7f800c072360 2019-11-28T11:53:04.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f800b7fe700 1 -- 172.21.15.80:0/603427270 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c0734e0 msgr2=0x7f800c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:04.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f800b7fe700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c0734e0 0x7f800c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:04.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f800b7fe700 1 -- 172.21.15.80:0/603427270 >> v2:172.21.15.174:3300/0 conn(0x7f800c06c0a0 msgr2=0x7f800c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f800b7fe700 1 --2- 172.21.15.80:0/603427270 >> v2:172.21.15.174:3300/0 conn(0x7f800c06c0a0 0x7f800c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f800b7fe700 1 -- 172.21.15.80:0/603427270 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c0706c0 con 0x7f800c072360 2019-11-28T11:53:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f800b7fe700 1 -- 172.21.15.80:0/603427270 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f80040019e0 con 0x7f800c072360 2019-11-28T11:53:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.351+0000 7f800b7fe700 1 -- 172.21.15.80:0/603427270 >> v1:172.21.15.80:6789/0 conn(0x7f800c072360 legacy=0x7f800c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f800b7fe700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ff80479e0 0x7f7ff8049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f800b7fe700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ff804a5c0 0x7f7ff804ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f800b7fe700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ff804d260 0x7f7ff804f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f800b7fe700 1 -- 172.21.15.80:0/603427270 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff804ff40 con 0x7f7ff804d260 2019-11-28T11:53:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f800b7fe700 1 -- 172.21.15.80:0/603427270 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff8050130 con 0x7f7ff80479e0 2019-11-28T11:53:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f800b7fe700 1 -- 172.21.15.80:0/603427270 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff8050360 con 0x7f7ff804a5c0 2019-11-28T11:53:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f8011291700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ff804d260 0x7f7ff804f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f800bfff700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ff804a5c0 0x7f7ff804ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f8010a90700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ff80479e0 0x7f7ff8049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f8011291700 1 -- 172.21.15.80:0/603427270 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ff804a5c0 msgr2=0x7f7ff804ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f8011291700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ff804a5c0 0x7f7ff804ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f8011291700 1 -- 172.21.15.80:0/603427270 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ff80479e0 msgr2=0x7f7ff8049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f8011291700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ff80479e0 0x7f7ff8049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f8011291700 1 -- 172.21.15.80:0/603427270 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff8050610 con 0x7f7ff804d260 2019-11-28T11:53:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f8011291700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ff804d260 0x7f7ff804f730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f800400fc10 tx=0x7f8004001ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f8011291700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ff804d260 0x7f7ff804f730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f800400fc10 tx=0x7f8004001ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f8011291700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ff804d260 0x7f7ff804f730 secure :-1 s=READY pgs=2317 cs=0 l=1 rx=0x7f800400fc10 tx=0x7f8004001ac0).ready entity=mon.0 client_cookie=b08be95aa0dd85f1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f8011291700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ff804d260 0x7f7ff804f730 secure :-1 s=THROTTLE_DONE pgs=2317 cs=0 l=1 rx=0x7f800400fc10 tx=0x7f8004001ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f8011291700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ff804d260 0x7f7ff804f730 secure :-1 s=THROTTLE_DONE pgs=2317 cs=0 l=1 rx=0x7f800400fc10 tx=0x7f8004001ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:04.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f800b7fe700 1 -- 172.21.15.80:0/603427270 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8004001c00 con 0x7f7ff804d260 2019-11-28T11:53:04.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f8011291700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ff804d260 0x7f7ff804f730 secure :-1 s=THROTTLE_DONE pgs=2317 cs=0 l=1 rx=0x7f800400fc10 tx=0x7f8004001ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:04.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f800b7fe700 1 -- 172.21.15.80:0/603427270 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80040045c0 con 0x7f7ff804d260 2019-11-28T11:53:04.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f800b7fe700 1 -- 172.21.15.80:0/603427270 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8004004cd0 con 0x7f7ff804d260 2019-11-28T11:53:04.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f80124f3700 1 -- 172.21.15.80:0/603427270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ff804d260 msgr2=0x7f7ff804f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:04.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f80124f3700 1 --2- 172.21.15.80:0/603427270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ff804d260 0x7f7ff804f730 secure :-1 s=READY pgs=2317 cs=0 l=1 rx=0x7f800400fc10 tx=0x7f8004001ac0).stop 2019-11-28T11:53:04.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.352+0000 7f8011291700 1 -- 172.21.15.80:0/603427270 reap_dead start 2019-11-28T11:53:04.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.353+0000 7f80124f3700 1 -- 172.21.15.80:0/603427270 shutdown_connections 2019-11-28T11:53:04.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.353+0000 7f80124f3700 1 -- 172.21.15.80:0/603427270 shutdown_connections 2019-11-28T11:53:04.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.353+0000 7f80124f3700 1 -- 172.21.15.80:0/603427270 wait complete. 2019-11-28T11:53:04.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.353+0000 7f80124f3700 1 -- 172.21.15.80:0/603427270 >> 172.21.15.80:0/603427270 conn(0x7f800c061cf0 msgr2=0x7f800c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:04.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.355+0000 7f80124f3700 1 Processor -- start 2019-11-28T11:53:04.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.355+0000 7f80124f3700 1 -- start start 2019-11-28T11:53:04.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.356+0000 7f80124f3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f800c13fb20 0x7f800c107940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:04.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.356+0000 7f80124f3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c108540 0x7f800c1629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:04.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.356+0000 7f80124f3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800c107110 con 0x7f800c1080b0 2019-11-28T11:53:04.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.356+0000 7f80124f3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c13b5e0 con 0x7f800c13fb20 2019-11-28T11:53:04.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.356+0000 7f80124f3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800c13b8b0 con 0x7f800c108540 2019-11-28T11:53:04.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f8010a90700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f800c13fb20 0x7f800c107940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:04.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f8011291700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c108540 0x7f800c1629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:04.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f8010a90700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f800c13fb20 0x7f800c107940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:58580/0 (socket says 172.21.15.80:58580) 2019-11-28T11:53:04.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f800bfff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f800c1080b0 0x7f800c10f260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58556/0 (socket says 172.21.15.80:58556) 2019-11-28T11:53:04.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f8010a90700 1 -- 172.21.15.80:0/3082797550 learned_addr learned my addr 172.21.15.80:0/3082797550 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:04.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f8011291700 1 -- 172.21.15.80:0/3082797550 >> v2:172.21.15.174:3300/0 conn(0x7f800c13fb20 msgr2=0x7f800c107940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:04.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f8011291700 1 --2- 172.21.15.80:0/3082797550 >> v2:172.21.15.174:3300/0 conn(0x7f800c13fb20 0x7f800c107940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:04.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f8011291700 1 -- 172.21.15.80:0/3082797550 >> v1:172.21.15.174:6789/0 conn(0x7f800c1080b0 legacy=0x7f800c10f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:04.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f80097fa700 1 -- 172.21.15.80:0/3082797550 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957354355 0 0) 0x7f7ffc000c90 con 0x7f800c1080b0 2019-11-28T11:53:04.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f8011291700 1 -- 172.21.15.80:0/3082797550 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c13bf40 con 0x7f800c108540 2019-11-28T11:53:04.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f8010a90700 1 --2- 172.21.15.80:0/3082797550 >> v2:172.21.15.174:3300/0 conn(0x7f800c13fb20 0x7f800c107940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:04.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f8011291700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c108540 0x7f800c1629f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80040106f0 tx=0x7f8004010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:04.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f8011291700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c108540 0x7f800c1629f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80040106f0 tx=0x7f8004010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:04.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f8011291700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c108540 0x7f800c1629f0 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7f80040106f0 tx=0x7f8004010a90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:04.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f8011291700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c108540 0x7f800c1629f0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f80040106f0 tx=0x7f8004010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:04.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f80097fa700 1 -- 172.21.15.80:0/3082797550 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f800400f900 con 0x7f800c108540 2019-11-28T11:53:04.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f8011291700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c108540 0x7f800c1629f0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f80040106f0 tx=0x7f8004010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:04.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f80124f3700 1 -- 172.21.15.80:0/3082797550 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800c10dea0 con 0x7f800c108540 2019-11-28T11:53:04.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f80097fa700 1 -- 172.21.15.80:0/3082797550 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800400f900 con 0x7f800c108540 2019-11-28T11:53:04.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f8011291700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c108540 0x7f800c1629f0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f80040106f0 tx=0x7f8004010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:04.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f80097fa700 1 -- 172.21.15.80:0/3082797550 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80040049a0 con 0x7f800c108540 2019-11-28T11:53:04.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.357+0000 7f80124f3700 1 -- 172.21.15.80:0/3082797550 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800c13bf40 con 0x7f800c108540 2019-11-28T11:53:04.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.358+0000 7f8011291700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c108540 0x7f800c1629f0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f80040106f0 tx=0x7f8004010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:04.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.358+0000 7f80097fa700 1 -- 172.21.15.80:0/3082797550 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f80040045c0 con 0x7f800c108540 2019-11-28T11:53:04.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.358+0000 7f8011291700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c108540 0x7f800c1629f0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f80040106f0 tx=0x7f8004010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:04.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.358+0000 7f80097fa700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ff0018730 0x7f7ff001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:04.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.358+0000 7f80097fa700 1 -- 172.21.15.80:0/3082797550 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8004031d30 con 0x7f800c108540 2019-11-28T11:53:04.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.358+0000 7f8010a90700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ff0018730 0x7f7ff001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:04.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.359+0000 7f8010a90700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ff0018730 0x7f7ff001abc0 crc :-1 s=READY pgs=956 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:04.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.365+0000 7f80124f3700 1 -- 172.21.15.80:0/3082797550 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800c10dea0 con 0x7f800c108540 2019-11-28T11:53:04.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.369+0000 7f8011291700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c108540 0x7f800c1629f0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f80040106f0 tx=0x7f8004010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:04.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.369+0000 7f80097fa700 1 -- 172.21.15.80:0/3082797550 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8004001270 con 0x7f800c108540 2019-11-28T11:53:04.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.541+0000 7f80124f3700 1 -- 172.21.15.80:0/3082797550 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f800c13bf40 con 0x7f800c108540 2019-11-28T11:53:04.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.542+0000 7f8011291700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c108540 0x7f800c1629f0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f80040106f0 tx=0x7f8004010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:04.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.542+0000 7f80097fa700 1 -- 172.21.15.80:0/3082797550 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f80040045c0 con 0x7f800c108540 2019-11-28T11:53:04.597 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:04.597 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:04.597 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:04.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.544+0000 7f80124f3700 1 -- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ff0018730 msgr2=0x7f7ff001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:04.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.544+0000 7f80124f3700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ff0018730 0x7f7ff001abc0 crc :-1 s=READY pgs=956 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:04.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.544+0000 7f80124f3700 1 -- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c108540 msgr2=0x7f800c1629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:04.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.544+0000 7f80124f3700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c108540 0x7f800c1629f0 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7f80040106f0 tx=0x7f8004010a90).stop 2019-11-28T11:53:04.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.544+0000 7f80124f3700 1 -- 172.21.15.80:0/3082797550 shutdown_connections 2019-11-28T11:53:04.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.544+0000 7f80124f3700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f800c108540 0x7f800c1629f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:04.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.544+0000 7f80124f3700 1 --2- 172.21.15.80:0/3082797550 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ff0018730 0x7f7ff001abc0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:04.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.544+0000 7f80124f3700 1 --2- 172.21.15.80:0/3082797550 >> v2:172.21.15.174:3300/0 conn(0x7f800c13fb20 0x7f800c107940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:04.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.544+0000 7f80124f3700 1 -- 172.21.15.80:0/3082797550 shutdown_connections 2019-11-28T11:53:04.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.544+0000 7f80124f3700 1 -- 172.21.15.80:0/3082797550 wait complete. 2019-11-28T11:53:04.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:04.544+0000 7f80124f3700 1 -- 172.21.15.80:0/3082797550 >> 172.21.15.80:0/3082797550 conn(0x7f800c142090 msgr2=0x7f800c10ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:04.609 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:05.610 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:05.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.676+0000 7f5a9c1c4700 1 Processor -- start 2019-11-28T11:53:05.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.676+0000 7f5a9c1c4700 1 -- start start 2019-11-28T11:53:05.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.677+0000 7f5a9c1c4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a9406c0a0 0x7f5a94072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:05.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.677+0000 7f5a9c1c4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5a94072620 0x7f5a94164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:05.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.677+0000 7f5a9c1c4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9406db00 con 0x7f5a940734e0 2019-11-28T11:53:05.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.677+0000 7f5a9c1c4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9406f330 con 0x7f5a94072620 2019-11-28T11:53:05.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.677+0000 7f5a9c1c4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a940706c0 con 0x7f5a9406c0a0 2019-11-28T11:53:05.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.677+0000 7f5a9a761700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a9406c0a0 0x7f5a94072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:05.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.677+0000 7f5a9af62700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5a94072620 0x7f5a94164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:05.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.677+0000 7f5a99f60700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f5a940734e0 0x7f5a94071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58566/0 (socket says 172.21.15.80:58566) 2019-11-28T11:53:05.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.677+0000 7f5a9a761700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a9406c0a0 0x7f5a94072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:45962/0 (socket says 172.21.15.80:45962) 2019-11-28T11:53:05.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.677+0000 7f5a99f60700 1 -- 172.21.15.80:0/3592780417 learned_addr learned my addr 172.21.15.80:0/3592780417 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:05.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.677+0000 7f5a9a761700 1 -- 172.21.15.80:0/3592780417 >> v2:172.21.15.174:3300/0 conn(0x7f5a94072620 msgr2=0x7f5a94164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:05.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.677+0000 7f5a9a761700 1 --2- 172.21.15.80:0/3592780417 >> v2:172.21.15.174:3300/0 conn(0x7f5a94072620 0x7f5a94164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:05.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.677+0000 7f5a9a761700 1 -- 172.21.15.80:0/3592780417 >> v1:172.21.15.174:6789/0 conn(0x7f5a940734e0 legacy=0x7f5a94071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:05.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.677+0000 7f5a9975f700 1 -- 172.21.15.80:0/3592780417 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924985382 0 0) 0x7f5a7c001030 con 0x7f5a940734e0 2019-11-28T11:53:05.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.677+0000 7f5a9a761700 1 -- 172.21.15.80:0/3592780417 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a94070a40 con 0x7f5a9406c0a0 2019-11-28T11:53:05.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.677+0000 7f5a9af62700 1 --2- 172.21.15.80:0/3592780417 >> v2:172.21.15.174:3300/0 conn(0x7f5a94072620 0x7f5a94164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:05.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.678+0000 7f5a9a761700 1 --2- 172.21.15.80:0/3592780417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a9406c0a0 0x7f5a94072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a8400b2d0 tx=0x7f5a8400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:05.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.678+0000 7f5a9a761700 1 --2- 172.21.15.80:0/3592780417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a9406c0a0 0x7f5a94072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a8400b2d0 tx=0x7f5a8400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:05.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.678+0000 7f5a9a761700 1 --2- 172.21.15.80:0/3592780417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a9406c0a0 0x7f5a94072fa0 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7f5a8400b2d0 tx=0x7f5a8400bae0).ready entity=mon.2 client_cookie=9eebe94928947a4e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:05.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.678+0000 7f5a9a761700 1 --2- 172.21.15.80:0/3592780417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a9406c0a0 0x7f5a94072fa0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7f5a8400b2d0 tx=0x7f5a8400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:05.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.678+0000 7f5a9a761700 1 --2- 172.21.15.80:0/3592780417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a9406c0a0 0x7f5a94072fa0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7f5a8400b2d0 tx=0x7f5a8400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:05.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.678+0000 7f5a9975f700 1 -- 172.21.15.80:0/3592780417 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a84007590 con 0x7f5a9406c0a0 2019-11-28T11:53:05.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.678+0000 7f5a9a761700 1 --2- 172.21.15.80:0/3592780417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a9406c0a0 0x7f5a94072fa0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7f5a8400b2d0 tx=0x7f5a8400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:05.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.678+0000 7f5a9975f700 1 -- 172.21.15.80:0/3592780417 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a84009d30 con 0x7f5a9406c0a0 2019-11-28T11:53:05.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.678+0000 7f5a9975f700 1 -- 172.21.15.80:0/3592780417 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a8400a400 con 0x7f5a9406c0a0 2019-11-28T11:53:05.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.678+0000 7f5a9c1c4700 1 -- 172.21.15.80:0/3592780417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a9406c0a0 msgr2=0x7f5a94072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:05.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.678+0000 7f5a9c1c4700 1 --2- 172.21.15.80:0/3592780417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a9406c0a0 0x7f5a94072fa0 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7f5a8400b2d0 tx=0x7f5a8400bae0).stop 2019-11-28T11:53:05.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.679+0000 7f5a9c1c4700 1 -- 172.21.15.80:0/3592780417 shutdown_connections 2019-11-28T11:53:05.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.679+0000 7f5a9c1c4700 1 --2- 172.21.15.80:0/3592780417 >> v2:172.21.15.174:3300/0 conn(0x7f5a94072620 0x7f5a94164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:05.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.679+0000 7f5a9c1c4700 1 --2- 172.21.15.80:0/3592780417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a9406c0a0 0x7f5a94072fa0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:05.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.679+0000 7f5a9c1c4700 1 -- 172.21.15.80:0/3592780417 shutdown_connections 2019-11-28T11:53:05.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.679+0000 7f5a9c1c4700 1 -- 172.21.15.80:0/3592780417 wait complete. 2019-11-28T11:53:05.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.679+0000 7f5a9c1c4700 1 -- 172.21.15.80:0/3592780417 >> 172.21.15.80:0/3592780417 conn(0x7f5a94061cf0 msgr2=0x7f5a94064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:05.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.681+0000 7f5a9c1c4700 1 Processor -- start 2019-11-28T11:53:05.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.681+0000 7f5a9c1c4700 1 -- start start 2019-11-28T11:53:05.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.682+0000 7f5a9c1c4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5a9413e9e0 0x7f5a94108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:05.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.682+0000 7f5a9c1c4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a94109430 0x7f5a941098b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:05.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.682+0000 7f5a9c1c4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a941066e0 con 0x7f5a9413e5f0 2019-11-28T11:53:05.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.682+0000 7f5a9c1c4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9410e060 con 0x7f5a94109430 2019-11-28T11:53:05.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.682+0000 7f5a9c1c4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9410e330 con 0x7f5a9413e9e0 2019-11-28T11:53:05.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.682+0000 7f5a9af62700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a94109430 0x7f5a941098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:05.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.682+0000 7f5a9af62700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5a94109430 0x7f5a941098b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43712/0 (socket says 172.21.15.80:43712) 2019-11-28T11:53:05.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.682+0000 7f5a9af62700 1 -- 172.21.15.80:0/3212693451 learned_addr learned my addr 172.21.15.80:0/3212693451 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:05.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.682+0000 7f5a99f60700 1 --2- 172.21.15.80:0/3212693451 >> v2:172.21.15.174:3300/0 conn(0x7f5a9413e9e0 0x7f5a94108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:05.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.682+0000 7f5a9af62700 1 -- 172.21.15.80:0/3212693451 >> v2:172.21.15.174:3300/0 conn(0x7f5a9413e9e0 msgr2=0x7f5a94108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:05.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.682+0000 7f5a9af62700 1 --2- 172.21.15.80:0/3212693451 >> v2:172.21.15.174:3300/0 conn(0x7f5a9413e9e0 0x7f5a94108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:05.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.682+0000 7f5a9af62700 1 -- 172.21.15.80:0/3212693451 >> v1:172.21.15.174:6789/0 conn(0x7f5a9413e5f0 legacy=0x7f5a9410a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:05.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.682+0000 7f5a9af62700 1 -- 172.21.15.80:0/3212693451 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9410e9c0 con 0x7f5a94109430 2019-11-28T11:53:05.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.682+0000 7f5a9af62700 1 --2- 172.21.15.80:0/3212693451 >> v2:172.21.15.80:3300/0 conn(0x7f5a94109430 0x7f5a941098b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a8c010430 tx=0x7f5a8c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:05.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.682+0000 7f5a9af62700 1 --2- 172.21.15.80:0/3212693451 >> v2:172.21.15.80:3300/0 conn(0x7f5a94109430 0x7f5a941098b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a8c010430 tx=0x7f5a8c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:05.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.682+0000 7f5a9af62700 1 --2- 172.21.15.80:0/3212693451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a94109430 0x7f5a941098b0 secure :-1 s=READY pgs=2318 cs=0 l=1 rx=0x7f5a8c010430 tx=0x7f5a8c0102b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:05.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.683+0000 7f5a9af62700 1 --2- 172.21.15.80:0/3212693451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a94109430 0x7f5a941098b0 secure :-1 s=THROTTLE_DONE pgs=2318 cs=0 l=1 rx=0x7f5a8c010430 tx=0x7f5a8c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:05.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.683+0000 7f5a92ffd700 1 -- 172.21.15.80:0/3212693451 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a8c00a750 con 0x7f5a94109430 2019-11-28T11:53:05.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.683+0000 7f5a9af62700 1 --2- 172.21.15.80:0/3212693451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a94109430 0x7f5a941098b0 secure :-1 s=THROTTLE_DONE pgs=2318 cs=0 l=1 rx=0x7f5a8c010430 tx=0x7f5a8c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:05.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.683+0000 7f5a9af62700 1 --2- 172.21.15.80:0/3212693451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a94109430 0x7f5a941098b0 secure :-1 s=THROTTLE_DONE pgs=2318 cs=0 l=1 rx=0x7f5a8c010430 tx=0x7f5a8c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:05.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.683+0000 7f5a92ffd700 1 -- 172.21.15.80:0/3212693451 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c0095b0 con 0x7f5a94109430 2019-11-28T11:53:05.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.683+0000 7f5a92ffd700 1 -- 172.21.15.80:0/3212693451 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a8c009c40 con 0x7f5a94109430 2019-11-28T11:53:05.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.683+0000 7f5a9c1c4700 1 -- 172.21.15.80:0/3212693451 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9410ed40 con 0x7f5a94109430 2019-11-28T11:53:05.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.683+0000 7f5a9c1c4700 1 -- 172.21.15.80:0/3212693451 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9410e9c0 con 0x7f5a94109430 2019-11-28T11:53:05.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.683+0000 7f5a9af62700 1 --2- 172.21.15.80:0/3212693451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a94109430 0x7f5a941098b0 secure :-1 s=THROTTLE_DONE pgs=2318 cs=0 l=1 rx=0x7f5a8c010430 tx=0x7f5a8c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:05.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.683+0000 7f5a92ffd700 1 -- 172.21.15.80:0/3212693451 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5a8c00aa60 con 0x7f5a94109430 2019-11-28T11:53:05.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.683+0000 7f5a9af62700 1 --2- 172.21.15.80:0/3212693451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a94109430 0x7f5a941098b0 secure :-1 s=THROTTLE_DONE pgs=2318 cs=0 l=1 rx=0x7f5a8c010430 tx=0x7f5a8c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:05.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.683+0000 7f5a92ffd700 1 --2- 172.21.15.80:0/3212693451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a78018730 0x7f5a7801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:05.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.683+0000 7f5a92ffd700 1 -- 172.21.15.80:0/3212693451 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f5a8c031ad0 con 0x7f5a94109430 2019-11-28T11:53:05.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.684+0000 7f5a9a761700 1 --2- 172.21.15.80:0/3212693451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a78018730 0x7f5a7801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:05.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.684+0000 7f5a9a761700 1 --2- 172.21.15.80:0/3212693451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a78018730 0x7f5a7801abc0 crc :-1 s=READY pgs=957 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:05.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.691+0000 7f5a9c1c4700 1 -- 172.21.15.80:0/3212693451 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9410ed40 con 0x7f5a94109430 2019-11-28T11:53:05.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.694+0000 7f5a9af62700 1 --2- 172.21.15.80:0/3212693451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a94109430 0x7f5a941098b0 secure :-1 s=THROTTLE_DONE pgs=2318 cs=0 l=1 rx=0x7f5a8c010430 tx=0x7f5a8c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:05.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.695+0000 7f5a92ffd700 1 -- 172.21.15.80:0/3212693451 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5a8c000a70 con 0x7f5a94109430 2019-11-28T11:53:05.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.868+0000 7f5a9c1c4700 1 -- 172.21.15.80:0/3212693451 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a9410e9c0 con 0x7f5a94109430 2019-11-28T11:53:05.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.869+0000 7f5a9af62700 1 --2- 172.21.15.80:0/3212693451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a94109430 0x7f5a941098b0 secure :-1 s=THROTTLE_DONE pgs=2318 cs=0 l=1 rx=0x7f5a8c010430 tx=0x7f5a8c0102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:05.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.869+0000 7f5a92ffd700 1 -- 172.21.15.80:0/3212693451 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f5a8c00aa60 con 0x7f5a94109430 2019-11-28T11:53:05.924 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:05.924 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:05.925 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:05.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.871+0000 7f5a9c1c4700 1 -- 172.21.15.80:0/3212693451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a78018730 msgr2=0x7f5a7801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:05.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.871+0000 7f5a9c1c4700 1 --2- 172.21.15.80:0/3212693451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a78018730 0x7f5a7801abc0 crc :-1 s=READY pgs=957 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:05.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.871+0000 7f5a9c1c4700 1 -- 172.21.15.80:0/3212693451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a94109430 msgr2=0x7f5a941098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:05.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.871+0000 7f5a9c1c4700 1 --2- 172.21.15.80:0/3212693451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a94109430 0x7f5a941098b0 secure :-1 s=READY pgs=2318 cs=0 l=1 rx=0x7f5a8c010430 tx=0x7f5a8c0102b0).stop 2019-11-28T11:53:05.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.871+0000 7f5a9c1c4700 1 -- 172.21.15.80:0/3212693451 shutdown_connections 2019-11-28T11:53:05.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.871+0000 7f5a9c1c4700 1 --2- 172.21.15.80:0/3212693451 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a94109430 0x7f5a941098b0 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.871+0000 7f5a9c1c4700 1 --2- 172.21.15.80:0/3212693451 >> v2:172.21.15.174:3300/0 conn(0x7f5a9413e9e0 0x7f5a94108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.871+0000 7f5a9c1c4700 1 --2- 172.21.15.80:0/3212693451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a78018730 0x7f5a7801abc0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.871+0000 7f5a9c1c4700 1 -- 172.21.15.80:0/3212693451 shutdown_connections 2019-11-28T11:53:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.871+0000 7f5a9c1c4700 1 -- 172.21.15.80:0/3212693451 wait complete. 2019-11-28T11:53:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:05.871+0000 7f5a9c1c4700 1 -- 172.21.15.80:0/3212693451 >> 172.21.15.80:0/3212693451 conn(0x7f5a9413d620 msgr2=0x7f5a9413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:05.935 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:06.936 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:07.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.009+0000 7f35c08e5700 1 Processor -- start 2019-11-28T11:53:07.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.009+0000 7f35c08e5700 1 -- start start 2019-11-28T11:53:07.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.010+0000 7f35c08e5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f35bc06c0a0 0x7f35bc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:07.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.010+0000 7f35c08e5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35bc0734e0 0x7f35bc071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:07.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.010+0000 7f35c08e5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35bc072360 0x7f35bc072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:07.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.010+0000 7f35c08e5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35bc06fd60 con 0x7f35bc0734e0 2019-11-28T11:53:07.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.010+0000 7f35c08e5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35bc070030 con 0x7f35bc06c0a0 2019-11-28T11:53:07.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.010+0000 7f35c08e5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc06f330 con 0x7f35bc072360 2019-11-28T11:53:07.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.010+0000 7f35ba59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35bc0734e0 0x7f35bc071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:07.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.010+0000 7f35ba59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35bc0734e0 0x7f35bc071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43720/0 (socket says 172.21.15.80:43720) 2019-11-28T11:53:07.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.010+0000 7f35ba59c700 1 -- 172.21.15.80:0/2242819612 learned_addr learned my addr 172.21.15.80:0/2242819612 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:07.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.010+0000 7f35bad9d700 1 --2- 172.21.15.80:0/2242819612 >> v2:172.21.15.174:3300/0 conn(0x7f35bc06c0a0 0x7f35bc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:07.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.010+0000 7f35bb59e700 1 --2- 172.21.15.80:0/2242819612 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35bc072360 0x7f35bc072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:07.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.011+0000 7f35ba59c700 1 -- 172.21.15.80:0/2242819612 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35bc072360 msgr2=0x7f35bc072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:07.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.011+0000 7f35ba59c700 1 --2- 172.21.15.80:0/2242819612 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35bc072360 0x7f35bc072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:07.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.011+0000 7f35ba59c700 1 -- 172.21.15.80:0/2242819612 >> v2:172.21.15.174:3300/0 conn(0x7f35bc06c0a0 msgr2=0x7f35bc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:07.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.011+0000 7f35ba59c700 1 --2- 172.21.15.80:0/2242819612 >> v2:172.21.15.174:3300/0 conn(0x7f35bc06c0a0 0x7f35bc072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:07.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.011+0000 7f35ba59c700 1 -- 172.21.15.80:0/2242819612 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc0706c0 con 0x7f35bc0734e0 2019-11-28T11:53:07.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.011+0000 7f35ba59c700 1 --2- 172.21.15.80:0/2242819612 >> v2:172.21.15.80:3300/0 conn(0x7f35bc0734e0 0x7f35bc071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f35ac00f6c0 tx=0x7f35ac00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:07.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.011+0000 7f35ba59c700 1 --2- 172.21.15.80:0/2242819612 >> v2:172.21.15.80:3300/0 conn(0x7f35bc0734e0 0x7f35bc071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f35ac00f6c0 tx=0x7f35ac00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:07.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.011+0000 7f35ba59c700 1 --2- 172.21.15.80:0/2242819612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc0734e0 0x7f35bc071e20 secure :-1 s=READY pgs=2319 cs=0 l=1 rx=0x7f35ac00f6c0 tx=0x7f35ac00f570).ready entity=mon.0 client_cookie=bb4cf14483b6989d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:07.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.011+0000 7f35ba59c700 1 --2- 172.21.15.80:0/2242819612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc0734e0 0x7f35bc071e20 secure :-1 s=THROTTLE_DONE pgs=2319 cs=0 l=1 rx=0x7f35ac00f6c0 tx=0x7f35ac00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:07.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.011+0000 7f35ba59c700 1 --2- 172.21.15.80:0/2242819612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc0734e0 0x7f35bc071e20 secure :-1 s=THROTTLE_DONE pgs=2319 cs=0 l=1 rx=0x7f35ac00f6c0 tx=0x7f35ac00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:07.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.011+0000 7f35b9d9b700 1 -- 172.21.15.80:0/2242819612 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35ac000960 con 0x7f35bc0734e0 2019-11-28T11:53:07.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.011+0000 7f35ba59c700 1 --2- 172.21.15.80:0/2242819612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc0734e0 0x7f35bc071e20 secure :-1 s=THROTTLE_DONE pgs=2319 cs=0 l=1 rx=0x7f35ac00f6c0 tx=0x7f35ac00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:07.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.011+0000 7f35b9d9b700 1 -- 172.21.15.80:0/2242819612 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac000c90 con 0x7f35bc0734e0 2019-11-28T11:53:07.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.011+0000 7f35b9d9b700 1 -- 172.21.15.80:0/2242819612 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35ac0013a0 con 0x7f35bc0734e0 2019-11-28T11:53:07.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.011+0000 7f35c08e5700 1 -- 172.21.15.80:0/2242819612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc0734e0 msgr2=0x7f35bc071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:07.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.011+0000 7f35c08e5700 1 --2- 172.21.15.80:0/2242819612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc0734e0 0x7f35bc071e20 secure :-1 s=READY pgs=2319 cs=0 l=1 rx=0x7f35ac00f6c0 tx=0x7f35ac00f570).stop 2019-11-28T11:53:07.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.012+0000 7f35c08e5700 1 -- 172.21.15.80:0/2242819612 shutdown_connections 2019-11-28T11:53:07.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.012+0000 7f35c08e5700 1 --2- 172.21.15.80:0/2242819612 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35bc072360 0x7f35bc072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:07.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.012+0000 7f35c08e5700 1 --2- 172.21.15.80:0/2242819612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc0734e0 0x7f35bc071e20 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:07.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.012+0000 7f35c08e5700 1 --2- 172.21.15.80:0/2242819612 >> v2:172.21.15.174:3300/0 conn(0x7f35bc06c0a0 0x7f35bc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:07.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.012+0000 7f35c08e5700 1 -- 172.21.15.80:0/2242819612 shutdown_connections 2019-11-28T11:53:07.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.012+0000 7f35c08e5700 1 -- 172.21.15.80:0/2242819612 wait complete. 2019-11-28T11:53:07.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.012+0000 7f35c08e5700 1 -- 172.21.15.80:0/2242819612 >> 172.21.15.80:0/2242819612 conn(0x7f35bc061cf0 msgr2=0x7f35bc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:07.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.014+0000 7f35c08e5700 1 Processor -- start 2019-11-28T11:53:07.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.014+0000 7f35c08e5700 1 -- start start 2019-11-28T11:53:07.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.015+0000 7f35c08e5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f35bc13a780 0x7f35bc12d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:07.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.015+0000 7f35c08e5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35bc12d9c0 0x7f35bc12c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:07.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.015+0000 7f35c08e5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35bc12c840 0x7f35bc12ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:07.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.015+0000 7f35c08e5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35bc12a260 con 0x7f35bc12c840 2019-11-28T11:53:07.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.015+0000 7f35c08e5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35bc12a530 con 0x7f35bc13a780 2019-11-28T11:53:07.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.015+0000 7f35c08e5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc129830 con 0x7f35bc12d9c0 2019-11-28T11:53:07.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.015+0000 7f35bb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35bc12c840 0x7f35bc12ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:07.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.015+0000 7f35bb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35bc12c840 0x7f35bc12ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43726/0 (socket says 172.21.15.80:43726) 2019-11-28T11:53:07.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.015+0000 7f35bb59e700 1 -- 172.21.15.80:0/2612455902 learned_addr learned my addr 172.21.15.80:0/2612455902 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:07.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.015+0000 7f35ba59c700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35bc12d9c0 0x7f35bc12c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:07.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.015+0000 7f35bad9d700 1 --2- 172.21.15.80:0/2612455902 >> v2:172.21.15.174:3300/0 conn(0x7f35bc13a780 0x7f35bc12d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:07.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35bb59e700 1 -- 172.21.15.80:0/2612455902 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35bc12d9c0 msgr2=0x7f35bc12c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:07.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35bb59e700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35bc12d9c0 0x7f35bc12c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:07.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35bb59e700 1 -- 172.21.15.80:0/2612455902 >> v2:172.21.15.174:3300/0 conn(0x7f35bc13a780 msgr2=0x7f35bc12d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:07.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35bb59e700 1 --2- 172.21.15.80:0/2612455902 >> v2:172.21.15.174:3300/0 conn(0x7f35bc13a780 0x7f35bc12d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:07.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35bb59e700 1 -- 172.21.15.80:0/2612455902 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc12abc0 con 0x7f35bc12c840 2019-11-28T11:53:07.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35bb59e700 1 --2- 172.21.15.80:0/2612455902 >> v2:172.21.15.80:3300/0 conn(0x7f35bc12c840 0x7f35bc12ccc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f35b40107e0 tx=0x7f35b4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:07.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35bb59e700 1 --2- 172.21.15.80:0/2612455902 >> v2:172.21.15.80:3300/0 conn(0x7f35bc12c840 0x7f35bc12ccc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f35b40107e0 tx=0x7f35b4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:07.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35bb59e700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc12c840 0x7f35bc12ccc0 secure :-1 s=READY pgs=2320 cs=0 l=1 rx=0x7f35b40107e0 tx=0x7f35b4010660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:07.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35bb59e700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc12c840 0x7f35bc12ccc0 secure :-1 s=THROTTLE_DONE pgs=2320 cs=0 l=1 rx=0x7f35b40107e0 tx=0x7f35b4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:07.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35b37fe700 1 -- 172.21.15.80:0/2612455902 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b400aa30 con 0x7f35bc12c840 2019-11-28T11:53:07.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35bb59e700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc12c840 0x7f35bc12ccc0 secure :-1 s=THROTTLE_DONE pgs=2320 cs=0 l=1 rx=0x7f35b40107e0 tx=0x7f35b4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:07.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35bb59e700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc12c840 0x7f35bc12ccc0 secure :-1 s=THROTTLE_DONE pgs=2320 cs=0 l=1 rx=0x7f35b40107e0 tx=0x7f35b4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:07.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35b37fe700 1 -- 172.21.15.80:0/2612455902 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b40013e0 con 0x7f35bc12c840 2019-11-28T11:53:07.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35c08e5700 1 -- 172.21.15.80:0/2612455902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35bc12af40 con 0x7f35bc12c840 2019-11-28T11:53:07.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35b37fe700 1 -- 172.21.15.80:0/2612455902 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b40019b0 con 0x7f35bc12c840 2019-11-28T11:53:07.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35c08e5700 1 -- 172.21.15.80:0/2612455902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35bc12abc0 con 0x7f35bc12c840 2019-11-28T11:53:07.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.016+0000 7f35bb59e700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc12c840 0x7f35bc12ccc0 secure :-1 s=THROTTLE_DONE pgs=2320 cs=0 l=1 rx=0x7f35b40107e0 tx=0x7f35b4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:07.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.017+0000 7f35b37fe700 1 -- 172.21.15.80:0/2612455902 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f35b4000df0 con 0x7f35bc12c840 2019-11-28T11:53:07.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.017+0000 7f35bb59e700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc12c840 0x7f35bc12ccc0 secure :-1 s=THROTTLE_DONE pgs=2320 cs=0 l=1 rx=0x7f35b40107e0 tx=0x7f35b4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:07.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.017+0000 7f35b37fe700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f35a0018730 0x7f35a001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:07.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.017+0000 7f35b37fe700 1 -- 172.21.15.80:0/2612455902 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f35b4031d40 con 0x7f35bc12c840 2019-11-28T11:53:07.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.017+0000 7f35bad9d700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f35a0018730 0x7f35a001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:07.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.017+0000 7f35bad9d700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f35a0018730 0x7f35a001abc0 crc :-1 s=READY pgs=958 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:07.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.024+0000 7f35c08e5700 1 -- 172.21.15.80:0/2612455902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35bc12af40 con 0x7f35bc12c840 2019-11-28T11:53:07.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.028+0000 7f35bb59e700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc12c840 0x7f35bc12ccc0 secure :-1 s=THROTTLE_DONE pgs=2320 cs=0 l=1 rx=0x7f35b40107e0 tx=0x7f35b4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:07.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.028+0000 7f35b37fe700 1 -- 172.21.15.80:0/2612455902 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f35b4027f20 con 0x7f35bc12c840 2019-11-28T11:53:07.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.197+0000 7f35c08e5700 1 -- 172.21.15.80:0/2612455902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35bc12abc0 con 0x7f35bc12c840 2019-11-28T11:53:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.198+0000 7f35bb59e700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc12c840 0x7f35bc12ccc0 secure :-1 s=THROTTLE_DONE pgs=2320 cs=0 l=1 rx=0x7f35b40107e0 tx=0x7f35b4010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.198+0000 7f35b37fe700 1 -- 172.21.15.80:0/2612455902 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f35b4027f20 con 0x7f35bc12c840 2019-11-28T11:53:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:07.253 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:07.253 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:07.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.200+0000 7f35c08e5700 1 -- 172.21.15.80:0/2612455902 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f35a0018730 msgr2=0x7f35a001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:07.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.200+0000 7f35c08e5700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f35a0018730 0x7f35a001abc0 crc :-1 s=READY pgs=958 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:07.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.200+0000 7f35c08e5700 1 -- 172.21.15.80:0/2612455902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc12c840 msgr2=0x7f35bc12ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:07.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.200+0000 7f35c08e5700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc12c840 0x7f35bc12ccc0 secure :-1 s=READY pgs=2320 cs=0 l=1 rx=0x7f35b40107e0 tx=0x7f35b4010660).stop 2019-11-28T11:53:07.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.200+0000 7f35c08e5700 1 -- 172.21.15.80:0/2612455902 shutdown_connections 2019-11-28T11:53:07.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.200+0000 7f35c08e5700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f35a0018730 0x7f35a001abc0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:07.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.200+0000 7f35c08e5700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35bc12c840 0x7f35bc12ccc0 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:07.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.200+0000 7f35c08e5700 1 --2- 172.21.15.80:0/2612455902 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35bc12d9c0 0x7f35bc12c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:07.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.200+0000 7f35c08e5700 1 --2- 172.21.15.80:0/2612455902 >> v2:172.21.15.174:3300/0 conn(0x7f35bc13a780 0x7f35bc12d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:07.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.201+0000 7f35c08e5700 1 -- 172.21.15.80:0/2612455902 shutdown_connections 2019-11-28T11:53:07.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.201+0000 7f35c08e5700 1 -- 172.21.15.80:0/2612455902 wait complete. 2019-11-28T11:53:07.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:07.201+0000 7f35c08e5700 1 -- 172.21.15.80:0/2612455902 >> 172.21.15.80:0/2612455902 conn(0x7f35bc127dc0 msgr2=0x7f35bc141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:07.265 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:08.266 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:08.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.334+0000 7f91e2d61700 1 Processor -- start 2019-11-28T11:53:08.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.334+0000 7f91e2d61700 1 -- start start 2019-11-28T11:53:08.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e2d61700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91dc06c0a0 0x7f91dc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:08.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e2d61700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f91dc0734e0 0x7f91dc071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:08.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e2d61700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91dc06db00 con 0x7f91dc072360 2019-11-28T11:53:08.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e2d61700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc06fd60 con 0x7f91dc06c0a0 2019-11-28T11:53:08.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e2d61700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc070030 con 0x7f91dc0734e0 2019-11-28T11:53:08.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e12fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91dc06c0a0 0x7f91dc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:08.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e1aff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f91dc072360 0x7f91dc06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43048/0 (socket says 172.21.15.80:43048) 2019-11-28T11:53:08.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e1aff700 1 -- 172.21.15.80:0/2373662047 learned_addr learned my addr 172.21.15.80:0/2373662047 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:08.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e0afd700 1 --2- 172.21.15.80:0/2373662047 >> v2:172.21.15.174:3300/0 conn(0x7f91dc0734e0 0x7f91dc071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:08.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e12fe700 1 -- 172.21.15.80:0/2373662047 >> v2:172.21.15.174:3300/0 conn(0x7f91dc0734e0 msgr2=0x7f91dc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:08.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e12fe700 1 --2- 172.21.15.80:0/2373662047 >> v2:172.21.15.174:3300/0 conn(0x7f91dc0734e0 0x7f91dc071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:08.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e12fe700 1 -- 172.21.15.80:0/2373662047 >> v1:172.21.15.80:6789/0 conn(0x7f91dc072360 legacy=0x7f91dc06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:08.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e12fe700 1 -- 172.21.15.80:0/2373662047 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc0706c0 con 0x7f91dc06c0a0 2019-11-28T11:53:08.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91dbfff700 1 -- 172.21.15.80:0/2373662047 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717511033 0 0) 0x7f91d40014d0 con 0x7f91dc072360 2019-11-28T11:53:08.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e12fe700 1 --2- 172.21.15.80:0/2373662047 >> v2:172.21.15.80:3300/0 conn(0x7f91dc06c0a0 0x7f91dc072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f91cc00af50 tx=0x7f91cc00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:08.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e12fe700 1 --2- 172.21.15.80:0/2373662047 >> v2:172.21.15.80:3300/0 conn(0x7f91dc06c0a0 0x7f91dc072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f91cc00af50 tx=0x7f91cc00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:08.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e12fe700 1 --2- 172.21.15.80:0/2373662047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc06c0a0 0x7f91dc072fa0 secure :-1 s=READY pgs=2322 cs=0 l=1 rx=0x7f91cc00af50 tx=0x7f91cc00b6e0).ready entity=mon.0 client_cookie=519936e37d61a28f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:08.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.335+0000 7f91e12fe700 1 --2- 172.21.15.80:0/2373662047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc06c0a0 0x7f91dc072fa0 secure :-1 s=THROTTLE_DONE pgs=2322 cs=0 l=1 rx=0x7f91cc00af50 tx=0x7f91cc00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:08.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.336+0000 7f91dbfff700 1 -- 172.21.15.80:0/2373662047 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91cc007210 con 0x7f91dc06c0a0 2019-11-28T11:53:08.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.336+0000 7f91e12fe700 1 --2- 172.21.15.80:0/2373662047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc06c0a0 0x7f91dc072fa0 secure :-1 s=THROTTLE_DONE pgs=2322 cs=0 l=1 rx=0x7f91cc00af50 tx=0x7f91cc00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:08.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.336+0000 7f91e12fe700 1 --2- 172.21.15.80:0/2373662047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc06c0a0 0x7f91dc072fa0 secure :-1 s=THROTTLE_DONE pgs=2322 cs=0 l=1 rx=0x7f91cc00af50 tx=0x7f91cc00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:08.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.336+0000 7f91dbfff700 1 -- 172.21.15.80:0/2373662047 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc0099b0 con 0x7f91dc06c0a0 2019-11-28T11:53:08.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.336+0000 7f91dbfff700 1 -- 172.21.15.80:0/2373662047 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91cc00a080 con 0x7f91dc06c0a0 2019-11-28T11:53:08.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.336+0000 7f91e2d61700 1 -- 172.21.15.80:0/2373662047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc06c0a0 msgr2=0x7f91dc072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:08.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.336+0000 7f91e2d61700 1 --2- 172.21.15.80:0/2373662047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc06c0a0 0x7f91dc072fa0 secure :-1 s=READY pgs=2322 cs=0 l=1 rx=0x7f91cc00af50 tx=0x7f91cc00b6e0).stop 2019-11-28T11:53:08.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.336+0000 7f91e2d61700 1 -- 172.21.15.80:0/2373662047 shutdown_connections 2019-11-28T11:53:08.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.336+0000 7f91e2d61700 1 --2- 172.21.15.80:0/2373662047 >> v2:172.21.15.174:3300/0 conn(0x7f91dc0734e0 0x7f91dc071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:08.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.336+0000 7f91e2d61700 1 --2- 172.21.15.80:0/2373662047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91dc06c0a0 0x7f91dc072fa0 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:08.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.336+0000 7f91e2d61700 1 -- 172.21.15.80:0/2373662047 shutdown_connections 2019-11-28T11:53:08.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.336+0000 7f91e2d61700 1 -- 172.21.15.80:0/2373662047 wait complete. 2019-11-28T11:53:08.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.336+0000 7f91e2d61700 1 -- 172.21.15.80:0/2373662047 >> 172.21.15.80:0/2373662047 conn(0x7f91dc061cf0 msgr2=0x7f91dc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:08.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.339+0000 7f91e2d61700 1 Processor -- start 2019-11-28T11:53:08.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.339+0000 7f91e2d61700 1 -- start start 2019-11-28T11:53:08.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91e2d61700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f91dc104820 0x7f91dc10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:08.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91e2d61700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc10b9d0 0x7f91dc167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:08.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91e2d61700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91dc13bcd0 con 0x7f91dc10c890 2019-11-28T11:53:08.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91e2d61700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc109130 con 0x7f91dc104820 2019-11-28T11:53:08.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91e2d61700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc109400 con 0x7f91dc10b9d0 2019-11-28T11:53:08.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91e0afd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f91dc10c890 0x7f91dc10b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43054/0 (socket says 172.21.15.80:43054) 2019-11-28T11:53:08.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91e0afd700 1 -- 172.21.15.80:0/3732956307 learned_addr learned my addr 172.21.15.80:0/3732956307 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:08.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111023703 0 0) 0x7f91d00010b0 con 0x7f91dc10c890 2019-11-28T11:53:08.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91bc002e80 con 0x7f91dc10c890 2019-11-28T11:53:08.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91e1aff700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc10b9d0 0x7f91dc167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:08.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91e12fe700 1 --2- 172.21.15.80:0/3732956307 >> v2:172.21.15.174:3300/0 conn(0x7f91dc104820 0x7f91dc10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:08.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4175458072 0 0) 0x7f91d0000940 con 0x7f91dc10c890 2019-11-28T11:53:08.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f91bc0032e0 con 0x7f91dc10c890 2019-11-28T11:53:08.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f91d0001500 con 0x7f91dc10c890 2019-11-28T11:53:08.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc10b9d0 msgr2=0x7f91dc167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:08.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91d9ffb700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc10b9d0 0x7f91dc167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:08.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 >> v2:172.21.15.174:3300/0 conn(0x7f91dc104820 msgr2=0x7f91dc10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:08.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91d9ffb700 1 --2- 172.21.15.80:0/3732956307 >> v2:172.21.15.174:3300/0 conn(0x7f91dc104820 0x7f91dc10c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:08.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 >> v1:172.21.15.80:6789/0 conn(0x7f91dc10c890 legacy=0x7f91dc10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:08.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91d9ffb700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91bc0038e0 0x7f91bc003d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:08.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91d9ffb700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91bc004250 0x7f91bc0046c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:08.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91d9ffb700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91bc004d10 0x7f91bc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:08.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc00bc90 con 0x7f91bc004d10 2019-11-28T11:53:08.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc00be50 con 0x7f91bc004250 2019-11-28T11:53:08.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.340+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc00c010 con 0x7f91bc0038e0 2019-11-28T11:53:08.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e1aff700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91bc004d10 0x7f91bc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:08.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e0afd700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91bc004250 0x7f91bc0046c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:08.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e12fe700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91bc0038e0 0x7f91bc003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:08.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e1aff700 1 -- 172.21.15.80:0/3732956307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91bc0038e0 msgr2=0x7f91bc003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:08.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e1aff700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91bc0038e0 0x7f91bc003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:08.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e1aff700 1 -- 172.21.15.80:0/3732956307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91bc004250 msgr2=0x7f91bc0046c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:08.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e1aff700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91bc004250 0x7f91bc0046c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:08.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e1aff700 1 -- 172.21.15.80:0/3732956307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc00c290 con 0x7f91bc004d10 2019-11-28T11:53:08.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e2d61700 1 -- 172.21.15.80:0/3732956307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91dc109e10 con 0x7f91bc004d10 2019-11-28T11:53:08.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e1aff700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91bc004d10 0x7f91bc00b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f91d4010670 tx=0x7f91d4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:08.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e2d61700 1 -- 172.21.15.80:0/3732956307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91dc109a90 con 0x7f91bc004d10 2019-11-28T11:53:08.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e1aff700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91bc004d10 0x7f91bc00b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f91d4010670 tx=0x7f91d4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:08.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e1aff700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91bc004d10 0x7f91bc00b750 secure :-1 s=READY pgs=2324 cs=0 l=1 rx=0x7f91d4010670 tx=0x7f91d4010520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e1aff700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91bc004d10 0x7f91bc00b750 secure :-1 s=THROTTLE_DONE pgs=2324 cs=0 l=1 rx=0x7f91d4010670 tx=0x7f91d4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91d4000cc0 con 0x7f91bc004d10 2019-11-28T11:53:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e1aff700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91bc004d10 0x7f91bc00b750 secure :-1 s=THROTTLE_DONE pgs=2324 cs=0 l=1 rx=0x7f91d4010670 tx=0x7f91d4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d4000cc0 con 0x7f91bc004d10 2019-11-28T11:53:08.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e1aff700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91bc004d10 0x7f91bc00b750 secure :-1 s=THROTTLE_DONE pgs=2324 cs=0 l=1 rx=0x7f91d4010670 tx=0x7f91d4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:08.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91d4001650 con 0x7f91bc004d10 2019-11-28T11:53:08.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.341+0000 7f91e1aff700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91bc004d10 0x7f91bc00b750 secure :-1 s=THROTTLE_DONE pgs=2324 cs=0 l=1 rx=0x7f91d4010670 tx=0x7f91d4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:08.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.342+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f91d4001270 con 0x7f91bc004d10 2019-11-28T11:53:08.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.342+0000 7f91e1aff700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91bc004d10 0x7f91bc00b750 secure :-1 s=THROTTLE_DONE pgs=2324 cs=0 l=1 rx=0x7f91d4010670 tx=0x7f91d4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.342+0000 7f91d9ffb700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91bc020b10 0x7f91bc022f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.342+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f91d4031f50 con 0x7f91bc004d10 2019-11-28T11:53:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.342+0000 7f91e12fe700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91bc020b10 0x7f91bc022f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.342+0000 7f91e12fe700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91bc020b10 0x7f91bc022f40 crc :-1 s=READY pgs=959 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.349+0000 7f91e2d61700 1 -- 172.21.15.80:0/3732956307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b4002e60 con 0x7f91bc004d10 2019-11-28T11:53:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.353+0000 7f91e1aff700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91bc004d10 0x7f91bc00b750 secure :-1 s=THROTTLE_DONE pgs=2324 cs=0 l=1 rx=0x7f91d4010670 tx=0x7f91d4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.353+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f91d4008920 con 0x7f91bc004d10 2019-11-28T11:53:08.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.525+0000 7f91e2d61700 1 -- 172.21.15.80:0/3732956307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91b4001d10 con 0x7f91bc004d10 2019-11-28T11:53:08.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.525+0000 7f91e1aff700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91bc004d10 0x7f91bc00b750 secure :-1 s=THROTTLE_DONE pgs=2324 cs=0 l=1 rx=0x7f91d4010670 tx=0x7f91d4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:08.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.525+0000 7f91d9ffb700 1 -- 172.21.15.80:0/3732956307 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f91d4001270 con 0x7f91bc004d10 2019-11-28T11:53:08.581 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:08.581 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:08.581 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:08.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.528+0000 7f91e2d61700 1 -- 172.21.15.80:0/3732956307 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91bc020b10 msgr2=0x7f91bc022f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:08.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.528+0000 7f91e2d61700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91bc020b10 0x7f91bc022f40 crc :-1 s=READY pgs=959 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:08.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.528+0000 7f91e2d61700 1 -- 172.21.15.80:0/3732956307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91bc004d10 msgr2=0x7f91bc00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:08.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.528+0000 7f91e2d61700 1 --2- 172.21.15.80:0/3732956307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91bc004d10 0x7f91bc00b750 secure :-1 s=READY pgs=2324 cs=0 l=1 rx=0x7f91d4010670 tx=0x7f91d4010520).stop 2019-11-28T11:53:08.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.528+0000 7f91e1aff700 1 -- 172.21.15.80:0/3732956307 reap_dead start 2019-11-28T11:53:08.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.528+0000 7f91e1aff700 1 -- 172.21.15.80:0/3732956307 reap_dead start 2019-11-28T11:53:08.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.528+0000 7f91e2d61700 1 -- 172.21.15.80:0/3732956307 shutdown_connections 2019-11-28T11:53:08.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.528+0000 7f91e2d61700 1 -- 172.21.15.80:0/3732956307 shutdown_connections 2019-11-28T11:53:08.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.528+0000 7f91e2d61700 1 -- 172.21.15.80:0/3732956307 wait complete. 2019-11-28T11:53:08.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:08.528+0000 7f91e2d61700 1 -- 172.21.15.80:0/3732956307 >> 172.21.15.80:0/3732956307 conn(0x7f91dc13d620 msgr2=0x7f91dc13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:08.593 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:09.595 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:09.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.660+0000 7f68d02c9700 1 Processor -- start 2019-11-28T11:53:09.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.660+0000 7f68d02c9700 1 -- start start 2019-11-28T11:53:09.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.661+0000 7f68d02c9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68c806c0a0 0x7f68c8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:09.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.661+0000 7f68d02c9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68c80734e0 0x7f68c8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:09.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.661+0000 7f68d02c9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c806db00 con 0x7f68c8072360 2019-11-28T11:53:09.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.661+0000 7f68d02c9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c806f330 con 0x7f68c80734e0 2019-11-28T11:53:09.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.661+0000 7f68d02c9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c80706c0 con 0x7f68c806c0a0 2019-11-28T11:53:09.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.661+0000 7f68ce065700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68c80734e0 0x7f68c8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:09.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.661+0000 7f68ce065700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68c80734e0 0x7f68c8071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43754/0 (socket says 172.21.15.80:43754) 2019-11-28T11:53:09.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.661+0000 7f68ce065700 1 -- 172.21.15.80:0/1535590925 learned_addr learned my addr 172.21.15.80:0/1535590925 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:09.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.661+0000 7f68ce866700 1 --2- 172.21.15.80:0/1535590925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68c806c0a0 0x7f68c8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:09.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.662+0000 7f68ce065700 1 -- 172.21.15.80:0/1535590925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68c806c0a0 msgr2=0x7f68c8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:09.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.662+0000 7f68ce065700 1 --2- 172.21.15.80:0/1535590925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68c806c0a0 0x7f68c8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:09.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.662+0000 7f68ce065700 1 -- 172.21.15.80:0/1535590925 >> v1:172.21.15.174:6789/0 conn(0x7f68c8072360 legacy=0x7f68c806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:09.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.662+0000 7f68cd864700 1 -- 172.21.15.80:0/1535590925 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370044141 0 0) 0x7f68b80009b0 con 0x7f68c8072360 2019-11-28T11:53:09.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.662+0000 7f68ce065700 1 -- 172.21.15.80:0/1535590925 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c8070a40 con 0x7f68c80734e0 2019-11-28T11:53:09.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.662+0000 7f68ce065700 1 --2- 172.21.15.80:0/1535590925 >> v2:172.21.15.80:3300/0 conn(0x7f68c80734e0 0x7f68c8071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f68c000f6c0 tx=0x7f68c000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:09.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.662+0000 7f68ce065700 1 --2- 172.21.15.80:0/1535590925 >> v2:172.21.15.80:3300/0 conn(0x7f68c80734e0 0x7f68c8071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f68c000f6c0 tx=0x7f68c000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:09.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.662+0000 7f68ce065700 1 --2- 172.21.15.80:0/1535590925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c80734e0 0x7f68c8071e20 secure :-1 s=READY pgs=2325 cs=0 l=1 rx=0x7f68c000f6c0 tx=0x7f68c000fa60).ready entity=mon.0 client_cookie=c628419d6139aa21 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:09.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.662+0000 7f68ce065700 1 --2- 172.21.15.80:0/1535590925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c80734e0 0x7f68c8071e20 secure :-1 s=THROTTLE_DONE pgs=2325 cs=0 l=1 rx=0x7f68c000f6c0 tx=0x7f68c000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:09.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.662+0000 7f68cd864700 1 -- 172.21.15.80:0/1535590925 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c0000960 con 0x7f68c80734e0 2019-11-28T11:53:09.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.662+0000 7f68ce065700 1 --2- 172.21.15.80:0/1535590925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c80734e0 0x7f68c8071e20 secure :-1 s=THROTTLE_DONE pgs=2325 cs=0 l=1 rx=0x7f68c000f6c0 tx=0x7f68c000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:09.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.662+0000 7f68ce065700 1 --2- 172.21.15.80:0/1535590925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c80734e0 0x7f68c8071e20 secure :-1 s=THROTTLE_DONE pgs=2325 cs=0 l=1 rx=0x7f68c000f6c0 tx=0x7f68c000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:09.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.662+0000 7f68cd864700 1 -- 172.21.15.80:0/1535590925 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c0000c90 con 0x7f68c80734e0 2019-11-28T11:53:09.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.662+0000 7f68cd864700 1 -- 172.21.15.80:0/1535590925 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c0000960 con 0x7f68c80734e0 2019-11-28T11:53:09.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.662+0000 7f68d02c9700 1 -- 172.21.15.80:0/1535590925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c80734e0 msgr2=0x7f68c8071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:09.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.662+0000 7f68d02c9700 1 --2- 172.21.15.80:0/1535590925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c80734e0 0x7f68c8071e20 secure :-1 s=READY pgs=2325 cs=0 l=1 rx=0x7f68c000f6c0 tx=0x7f68c000fa60).stop 2019-11-28T11:53:09.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.663+0000 7f68d02c9700 1 -- 172.21.15.80:0/1535590925 shutdown_connections 2019-11-28T11:53:09.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.663+0000 7f68d02c9700 1 --2- 172.21.15.80:0/1535590925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68c80734e0 0x7f68c8071e20 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:09.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.663+0000 7f68d02c9700 1 --2- 172.21.15.80:0/1535590925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68c806c0a0 0x7f68c8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:09.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.663+0000 7f68d02c9700 1 -- 172.21.15.80:0/1535590925 shutdown_connections 2019-11-28T11:53:09.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.663+0000 7f68d02c9700 1 -- 172.21.15.80:0/1535590925 wait complete. 2019-11-28T11:53:09.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.663+0000 7f68d02c9700 1 -- 172.21.15.80:0/1535590925 >> 172.21.15.80:0/1535590925 conn(0x7f68c8061cf0 msgr2=0x7f68c8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:09.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.665+0000 7f68d02c9700 1 Processor -- start 2019-11-28T11:53:09.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.665+0000 7f68d02c9700 1 -- start start 2019-11-28T11:53:09.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.666+0000 7f68d02c9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f68c81281b0 0x7f68c8128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:09.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.666+0000 7f68d02c9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c8139a60 con 0x7f68c813a780 2019-11-28T11:53:09.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.666+0000 7f68d02c9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c813b060 con 0x7f68c8128b80 2019-11-28T11:53:09.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.666+0000 7f68d02c9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c812a260 con 0x7f68c81281b0 2019-11-28T11:53:09.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.666+0000 7f68ce866700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f68c813a780 0x7f68c812d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43072/0 (socket says 172.21.15.80:43072) 2019-11-28T11:53:09.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.666+0000 7f68ce866700 1 -- 172.21.15.80:0/714544175 learned_addr learned my addr 172.21.15.80:0/714544175 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:09.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.666+0000 7f68ce065700 1 --2- 172.21.15.80:0/714544175 >> v2:172.21.15.174:3300/0 conn(0x7f68c81281b0 0x7f68c8128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:09.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.666+0000 7f68c77fe700 1 -- 172.21.15.80:0/714544175 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736124095 0 0) 0x7f68b0001330 con 0x7f68c813a780 2019-11-28T11:53:09.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.666+0000 7f68c77fe700 1 -- 172.21.15.80:0/714544175 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68ac002e80 con 0x7f68c813a780 2019-11-28T11:53:09.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.667+0000 7f68ce065700 1 -- 172.21.15.80:0/714544175 >> v1:172.21.15.174:6789/0 conn(0x7f68c8128b80 legacy=0x7f68c8167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:09.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.667+0000 7f68ce065700 1 -- 172.21.15.80:0/714544175 >> v1:172.21.15.80:6789/0 conn(0x7f68c813a780 legacy=0x7f68c812d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:09.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.667+0000 7f68c77fe700 1 -- 172.21.15.80:0/714544175 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3760768692 0 0) 0x7f68b0001420 con 0x7f68c813a780 2019-11-28T11:53:09.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.667+0000 7f68ce065700 1 -- 172.21.15.80:0/714544175 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c812abc0 con 0x7f68c81281b0 2019-11-28T11:53:09.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.667+0000 7f68ce065700 1 --2- 172.21.15.80:0/714544175 >> v2:172.21.15.174:3300/0 conn(0x7f68c81281b0 0x7f68c8128640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68c0054390 tx=0x7f68c0054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:09.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.667+0000 7f68ce065700 1 --2- 172.21.15.80:0/714544175 >> v2:172.21.15.174:3300/0 conn(0x7f68c81281b0 0x7f68c8128640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68c0054390 tx=0x7f68c0054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:09.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.667+0000 7f68ce065700 1 --2- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c81281b0 0x7f68c8128640 secure :-1 s=READY pgs=1404 cs=0 l=1 rx=0x7f68c0054390 tx=0x7f68c0054730).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:09.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.667+0000 7f68ce065700 1 --2- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c81281b0 0x7f68c8128640 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f68c0054390 tx=0x7f68c0054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:09.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.667+0000 7f68c77fe700 1 -- 172.21.15.80:0/714544175 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c0007c90 con 0x7f68c81281b0 2019-11-28T11:53:09.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.667+0000 7f68ce065700 1 --2- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c81281b0 0x7f68c8128640 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f68c0054390 tx=0x7f68c0054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:09.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.667+0000 7f68c77fe700 1 -- 172.21.15.80:0/714544175 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c0007c90 con 0x7f68c81281b0 2019-11-28T11:53:09.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.667+0000 7f68ce065700 1 --2- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c81281b0 0x7f68c8128640 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f68c0054390 tx=0x7f68c0054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:09.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.667+0000 7f68d02c9700 1 -- 172.21.15.80:0/714544175 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c812af40 con 0x7f68c81281b0 2019-11-28T11:53:09.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.667+0000 7f68c77fe700 1 -- 172.21.15.80:0/714544175 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c0005770 con 0x7f68c81281b0 2019-11-28T11:53:09.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.667+0000 7f68d02c9700 1 -- 172.21.15.80:0/714544175 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c812abc0 con 0x7f68c81281b0 2019-11-28T11:53:09.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.667+0000 7f68ce065700 1 --2- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c81281b0 0x7f68c8128640 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f68c0054390 tx=0x7f68c0054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:09.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.668+0000 7f68c77fe700 1 -- 172.21.15.80:0/714544175 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f68c0007e80 con 0x7f68c81281b0 2019-11-28T11:53:09.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.668+0000 7f68ce065700 1 --2- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c81281b0 0x7f68c8128640 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f68c0054390 tx=0x7f68c0054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:09.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.668+0000 7f68c77fe700 1 --2- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f68ac018780 0x7f68ac01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:09.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.668+0000 7f68c77fe700 1 -- 172.21.15.80:0/714544175 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f68c0075a40 con 0x7f68c81281b0 2019-11-28T11:53:09.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.668+0000 7f68ce866700 1 --2- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f68ac018780 0x7f68ac01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:09.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.668+0000 7f68ce866700 1 --2- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f68ac018780 0x7f68ac01abf0 crc :-1 s=READY pgs=960 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:09.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.675+0000 7f68d02c9700 1 -- 172.21.15.80:0/714544175 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c812af40 con 0x7f68c81281b0 2019-11-28T11:53:09.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.679+0000 7f68ce065700 1 --2- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c81281b0 0x7f68c8128640 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f68c0054390 tx=0x7f68c0054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:09.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.679+0000 7f68c77fe700 1 -- 172.21.15.80:0/714544175 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f68c005b3d0 con 0x7f68c81281b0 2019-11-28T11:53:09.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.853+0000 7f68d02c9700 1 -- 172.21.15.80:0/714544175 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68c812abc0 con 0x7f68c81281b0 2019-11-28T11:53:09.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.853+0000 7f68ce065700 1 --2- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c81281b0 0x7f68c8128640 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f68c0054390 tx=0x7f68c0054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:09.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.853+0000 7f68c77fe700 1 -- 172.21.15.80:0/714544175 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f68c0007e80 con 0x7f68c81281b0 2019-11-28T11:53:09.907 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:09.908 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:09.908 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:09.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.856+0000 7f68d02c9700 1 -- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f68ac018780 msgr2=0x7f68ac01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:09.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.856+0000 7f68d02c9700 1 --2- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f68ac018780 0x7f68ac01abf0 crc :-1 s=READY pgs=960 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:09.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.856+0000 7f68d02c9700 1 -- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c81281b0 msgr2=0x7f68c8128640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:09.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.856+0000 7f68d02c9700 1 --2- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c81281b0 0x7f68c8128640 secure :-1 s=READY pgs=1404 cs=0 l=1 rx=0x7f68c0054390 tx=0x7f68c0054730).stop 2019-11-28T11:53:09.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.856+0000 7f68d02c9700 1 -- 172.21.15.80:0/714544175 shutdown_connections 2019-11-28T11:53:09.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.856+0000 7f68d02c9700 1 --2- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f68ac018780 0x7f68ac01abf0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:09.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.856+0000 7f68d02c9700 1 --2- 172.21.15.80:0/714544175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68c81281b0 0x7f68c8128640 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:09.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.856+0000 7f68d02c9700 1 -- 172.21.15.80:0/714544175 shutdown_connections 2019-11-28T11:53:09.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.856+0000 7f68d02c9700 1 -- 172.21.15.80:0/714544175 wait complete. 2019-11-28T11:53:09.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:09.856+0000 7f68d02c9700 1 -- 172.21.15.80:0/714544175 >> 172.21.15.80:0/714544175 conn(0x7f68c8127dc0 msgr2=0x7f68c8141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:09.921 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:10.921 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.989+0000 7ff1a1960700 1 Processor -- start 2019-11-28T11:53:11.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.989+0000 7ff1a1960700 1 -- start start 2019-11-28T11:53:11.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.990+0000 7ff1a1960700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff19c06c0a0 0x7ff19c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:11.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.990+0000 7ff1a1960700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff19c072620 0x7ff19c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:11.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.990+0000 7ff1a1960700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19c06db00 con 0x7ff19c0734e0 2019-11-28T11:53:11.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.990+0000 7ff1a1960700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19c06f330 con 0x7ff19c072620 2019-11-28T11:53:11.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.990+0000 7ff1a1960700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c0706c0 con 0x7ff19c06c0a0 2019-11-28T11:53:11.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.990+0000 7ff19bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff19c072620 0x7ff19c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:11.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.990+0000 7ff19b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff19c06c0a0 0x7ff19c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:11.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.990+0000 7ff19affd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff19c0734e0 0x7ff19c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58628/0 (socket says 172.21.15.80:58628) 2019-11-28T11:53:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.990+0000 7ff19affd700 1 -- 172.21.15.80:0/767185900 learned_addr learned my addr 172.21.15.80:0/767185900 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:11.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff19a7fc700 1 -- 172.21.15.80:0/767185900 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643233190 0 0) 0x7ff1840013b0 con 0x7ff19c0734e0 2019-11-28T11:53:11.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff19a7fc700 1 -- 172.21.15.80:0/767185900 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff17c002e80 con 0x7ff19c0734e0 2019-11-28T11:53:11.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff19bfff700 1 -- 172.21.15.80:0/767185900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff19c06c0a0 msgr2=0x7ff19c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:11.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff19bfff700 1 --2- 172.21.15.80:0/767185900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff19c06c0a0 0x7ff19c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:11.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff19bfff700 1 -- 172.21.15.80:0/767185900 >> v1:172.21.15.174:6789/0 conn(0x7ff19c0734e0 legacy=0x7ff19c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:11.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff19bfff700 1 -- 172.21.15.80:0/767185900 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c070a40 con 0x7ff19c072620 2019-11-28T11:53:11.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff19b7fe700 1 --2- 172.21.15.80:0/767185900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff19c06c0a0 0x7ff19c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:11.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff19bfff700 1 --2- 172.21.15.80:0/767185900 >> v2:172.21.15.174:3300/0 conn(0x7ff19c072620 0x7ff19c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff19400af80 tx=0x7ff19400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:11.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff19bfff700 1 --2- 172.21.15.80:0/767185900 >> v2:172.21.15.174:3300/0 conn(0x7ff19c072620 0x7ff19c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff19400af80 tx=0x7ff19400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:11.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff19bfff700 1 --2- 172.21.15.80:0/767185900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff19c072620 0x7ff19c164d70 secure :-1 s=READY pgs=1406 cs=0 l=1 rx=0x7ff19400af80 tx=0x7ff19400b790).ready entity=mon.1 client_cookie=912956611d28fb7b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:11.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff19bfff700 1 --2- 172.21.15.80:0/767185900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff19c072620 0x7ff19c164d70 secure :-1 s=THROTTLE_DONE pgs=1406 cs=0 l=1 rx=0x7ff19400af80 tx=0x7ff19400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:11.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff19a7fc700 1 -- 172.21.15.80:0/767185900 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff194000bc0 con 0x7ff19c072620 2019-11-28T11:53:11.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff19bfff700 1 --2- 172.21.15.80:0/767185900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff19c072620 0x7ff19c164d70 secure :-1 s=THROTTLE_DONE pgs=1406 cs=0 l=1 rx=0x7ff19400af80 tx=0x7ff19400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:11.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff19bfff700 1 --2- 172.21.15.80:0/767185900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff19c072620 0x7ff19c164d70 secure :-1 s=THROTTLE_DONE pgs=1406 cs=0 l=1 rx=0x7ff19400af80 tx=0x7ff19400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:11.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff19a7fc700 1 -- 172.21.15.80:0/767185900 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1940097f0 con 0x7ff19c072620 2019-11-28T11:53:11.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff19a7fc700 1 -- 172.21.15.80:0/767185900 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff194009ec0 con 0x7ff19c072620 2019-11-28T11:53:11.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff1a1960700 1 -- 172.21.15.80:0/767185900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff19c072620 msgr2=0x7ff19c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:11.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.991+0000 7ff1a1960700 1 --2- 172.21.15.80:0/767185900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff19c072620 0x7ff19c164d70 secure :-1 s=READY pgs=1406 cs=0 l=1 rx=0x7ff19400af80 tx=0x7ff19400b790).stop 2019-11-28T11:53:11.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.992+0000 7ff1a1960700 1 -- 172.21.15.80:0/767185900 shutdown_connections 2019-11-28T11:53:11.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.992+0000 7ff1a1960700 1 --2- 172.21.15.80:0/767185900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff19c072620 0x7ff19c164d70 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.992+0000 7ff1a1960700 1 --2- 172.21.15.80:0/767185900 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff19c06c0a0 0x7ff19c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.992+0000 7ff1a1960700 1 -- 172.21.15.80:0/767185900 shutdown_connections 2019-11-28T11:53:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.992+0000 7ff1a1960700 1 -- 172.21.15.80:0/767185900 wait complete. 2019-11-28T11:53:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.992+0000 7ff1a1960700 1 -- 172.21.15.80:0/767185900 >> 172.21.15.80:0/767185900 conn(0x7ff19c061cf0 msgr2=0x7ff19c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:11.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.994+0000 7ff1a1960700 1 Processor -- start 2019-11-28T11:53:11.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.994+0000 7ff1a1960700 1 -- start start 2019-11-28T11:53:11.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.995+0000 7ff1a1960700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff19c10d6c0 0x7ff19c10c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.995+0000 7ff1a1960700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff19c10db50 0x7ff19c10ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.995+0000 7ff1a1960700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19c1066e0 con 0x7ff19c13e300 2019-11-28T11:53:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.995+0000 7ff1a1960700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19c10a4a0 con 0x7ff19c10d6c0 2019-11-28T11:53:11.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.995+0000 7ff1a1960700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c10a770 con 0x7ff19c10db50 2019-11-28T11:53:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.995+0000 7ff19affd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff19c10d6c0 0x7ff19c10c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.995+0000 7ff19b7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff19c13e300 0x7ff19c13e6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58630/0 (socket says 172.21.15.80:58630) 2019-11-28T11:53:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.995+0000 7ff19b7fe700 1 -- 172.21.15.80:0/1281904557 learned_addr learned my addr 172.21.15.80:0/1281904557 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:11.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.995+0000 7ff19bfff700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff19c10db50 0x7ff19c10ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff193fff700 1 -- 172.21.15.80:0/1281904557 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040671547 0 0) 0x7ff18c000fb0 con 0x7ff19c13e300 2019-11-28T11:53:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff193fff700 1 -- 172.21.15.80:0/1281904557 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff174002e80 con 0x7ff19c13e300 2019-11-28T11:53:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff19affd700 1 -- 172.21.15.80:0/1281904557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff19c10db50 msgr2=0x7ff19c10ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:11.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff19affd700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff19c10db50 0x7ff19c10ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff19affd700 1 -- 172.21.15.80:0/1281904557 >> v1:172.21.15.174:6789/0 conn(0x7ff19c13e300 legacy=0x7ff19c13e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:11.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff19affd700 1 -- 172.21.15.80:0/1281904557 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c10ae00 con 0x7ff19c10d6c0 2019-11-28T11:53:11.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff19bfff700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff19c10db50 0x7ff19c10ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:11.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff19affd700 1 --2- 172.21.15.80:0/1281904557 >> v2:172.21.15.80:3300/0 conn(0x7ff19c10d6c0 0x7ff19c10c540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff184010700 tx=0x7ff184010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:11.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff19affd700 1 --2- 172.21.15.80:0/1281904557 >> v2:172.21.15.80:3300/0 conn(0x7ff19c10d6c0 0x7ff19c10c540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff184010700 tx=0x7ff184010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:11.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff19affd700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff19c10d6c0 0x7ff19c10c540 secure :-1 s=READY pgs=2327 cs=0 l=1 rx=0x7ff184010700 tx=0x7ff184010aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:11.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff19affd700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff19c10d6c0 0x7ff19c10c540 secure :-1 s=THROTTLE_DONE pgs=2327 cs=0 l=1 rx=0x7ff184010700 tx=0x7ff184010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:11.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff193fff700 1 -- 172.21.15.80:0/1281904557 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff184000ce0 con 0x7ff19c10d6c0 2019-11-28T11:53:11.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff19affd700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff19c10d6c0 0x7ff19c10c540 secure :-1 s=THROTTLE_DONE pgs=2327 cs=0 l=1 rx=0x7ff184010700 tx=0x7ff184010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:11.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff193fff700 1 -- 172.21.15.80:0/1281904557 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff184004360 con 0x7ff19c10d6c0 2019-11-28T11:53:11.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff19affd700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff19c10d6c0 0x7ff19c10c540 secure :-1 s=THROTTLE_DONE pgs=2327 cs=0 l=1 rx=0x7ff184010700 tx=0x7ff184010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:11.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff1a1960700 1 -- 172.21.15.80:0/1281904557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19c10b180 con 0x7ff19c10d6c0 2019-11-28T11:53:11.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff193fff700 1 -- 172.21.15.80:0/1281904557 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff184004550 con 0x7ff19c10d6c0 2019-11-28T11:53:11.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff1a1960700 1 -- 172.21.15.80:0/1281904557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c10ae00 con 0x7ff19c10d6c0 2019-11-28T11:53:11.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.996+0000 7ff19affd700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff19c10d6c0 0x7ff19c10c540 secure :-1 s=THROTTLE_DONE pgs=2327 cs=0 l=1 rx=0x7ff184010700 tx=0x7ff184010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:11.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.997+0000 7ff193fff700 1 -- 172.21.15.80:0/1281904557 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff184004550 con 0x7ff19c10d6c0 2019-11-28T11:53:11.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.997+0000 7ff19affd700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff19c10d6c0 0x7ff19c10c540 secure :-1 s=THROTTLE_DONE pgs=2327 cs=0 l=1 rx=0x7ff184010700 tx=0x7ff184010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:11.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.997+0000 7ff193fff700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff174018770 0x7ff17401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:11.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.997+0000 7ff193fff700 1 -- 172.21.15.80:0/1281904557 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7ff184031d60 con 0x7ff19c10d6c0 2019-11-28T11:53:11.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.997+0000 7ff19b7fe700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff174018770 0x7ff17401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:11.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:10.997+0000 7ff19b7fe700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff174018770 0x7ff17401abe0 crc :-1 s=READY pgs=961 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:11.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.004+0000 7ff1a1960700 1 -- 172.21.15.80:0/1281904557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c10b180 con 0x7ff19c10d6c0 2019-11-28T11:53:11.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.008+0000 7ff19affd700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff19c10d6c0 0x7ff19c10c540 secure :-1 s=THROTTLE_DONE pgs=2327 cs=0 l=1 rx=0x7ff184010700 tx=0x7ff184010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:11.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.008+0000 7ff193fff700 1 -- 172.21.15.80:0/1281904557 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff1840015c0 con 0x7ff19c10d6c0 2019-11-28T11:53:11.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.180+0000 7ff1a1960700 1 -- 172.21.15.80:0/1281904557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff19c10ae00 con 0x7ff19c10d6c0 2019-11-28T11:53:11.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.181+0000 7ff19affd700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff19c10d6c0 0x7ff19c10c540 secure :-1 s=THROTTLE_DONE pgs=2327 cs=0 l=1 rx=0x7ff184010700 tx=0x7ff184010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:11.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.181+0000 7ff193fff700 1 -- 172.21.15.80:0/1281904557 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7ff184001010 con 0x7ff19c10d6c0 2019-11-28T11:53:11.237 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:11.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.183+0000 7ff1a1960700 1 -- 172.21.15.80:0/1281904557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff174018770 msgr2=0x7ff17401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:11.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.183+0000 7ff1a1960700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff174018770 0x7ff17401abe0 crc :-1 s=READY pgs=961 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:11.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.183+0000 7ff1a1960700 1 -- 172.21.15.80:0/1281904557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff19c10d6c0 msgr2=0x7ff19c10c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:11.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.183+0000 7ff1a1960700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff19c10d6c0 0x7ff19c10c540 secure :-1 s=READY pgs=2327 cs=0 l=1 rx=0x7ff184010700 tx=0x7ff184010aa0).stop 2019-11-28T11:53:11.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.183+0000 7ff1a1960700 1 -- 172.21.15.80:0/1281904557 shutdown_connections 2019-11-28T11:53:11.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.183+0000 7ff1a1960700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff19c10db50 0x7ff19c10ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:11.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.183+0000 7ff1a1960700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff19c10d6c0 0x7ff19c10c540 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:11.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.183+0000 7ff1a1960700 1 --2- 172.21.15.80:0/1281904557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff174018770 0x7ff17401abe0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:11.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.184+0000 7ff1a1960700 1 -- 172.21.15.80:0/1281904557 shutdown_connections 2019-11-28T11:53:11.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.184+0000 7ff1a1960700 1 -- 172.21.15.80:0/1281904557 wait complete. 2019-11-28T11:53:11.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:11.184+0000 7ff1a1960700 1 -- 172.21.15.80:0/1281904557 >> 172.21.15.80:0/1281904557 conn(0x7ff19c13d620 msgr2=0x7ff19c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:11.239 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:11.240 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:11.248 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:12.249 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:12.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.318+0000 7fe608c1a700 1 Processor -- start 2019-11-28T11:53:12.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.319+0000 7fe608c1a700 1 -- start start 2019-11-28T11:53:12.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.320+0000 7fe608c1a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe60406d120 0x7fe604165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:12.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.320+0000 7fe608c1a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60406d5a0 con 0x7fe60406c490 2019-11-28T11:53:12.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.320+0000 7fe608c1a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60406db00 con 0x7fe60406c0a0 2019-11-28T11:53:12.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.320+0000 7fe608c1a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe60406fd60 con 0x7fe60406d120 2019-11-28T11:53:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.320+0000 7fe60259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe60406c490 0x7fe60406c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43098/0 (socket says 172.21.15.80:43098) 2019-11-28T11:53:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.320+0000 7fe60259c700 1 -- 172.21.15.80:0/802898615 learned_addr learned my addr 172.21.15.80:0/802898615 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:12.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.320+0000 7fe60359e700 1 --2- 172.21.15.80:0/802898615 >> v2:172.21.15.174:3300/0 conn(0x7fe60406d120 0x7fe604165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:12.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.320+0000 7fe601d9b700 1 -- 172.21.15.80:0/802898615 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982467333 0 0) 0x7fe5ec0014d0 con 0x7fe60406c490 2019-11-28T11:53:12.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.320+0000 7fe601d9b700 1 -- 172.21.15.80:0/802898615 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e4002e80 con 0x7fe60406c490 2019-11-28T11:53:12.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.320+0000 7fe601d9b700 1 -- 172.21.15.80:0/802898615 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1240431554 0 0) 0x7fe5ec0014b0 con 0x7fe60406c490 2019-11-28T11:53:12.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.320+0000 7fe60359e700 1 -- 172.21.15.80:0/802898615 >> v1:172.21.15.174:6789/0 conn(0x7fe60406c0a0 legacy=0x7fe604072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:12.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.320+0000 7fe60359e700 1 -- 172.21.15.80:0/802898615 >> v1:172.21.15.80:6789/0 conn(0x7fe60406c490 legacy=0x7fe60406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:12.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.320+0000 7fe60359e700 1 -- 172.21.15.80:0/802898615 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6040706c0 con 0x7fe60406d120 2019-11-28T11:53:12.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.320+0000 7fe60359e700 1 --2- 172.21.15.80:0/802898615 >> v2:172.21.15.174:3300/0 conn(0x7fe60406d120 0x7fe604165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe5fc00af80 tx=0x7fe5fc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:12.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.320+0000 7fe60359e700 1 --2- 172.21.15.80:0/802898615 >> v2:172.21.15.174:3300/0 conn(0x7fe60406d120 0x7fe604165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe5fc00af80 tx=0x7fe5fc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:12.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.320+0000 7fe60359e700 1 --2- 172.21.15.80:0/802898615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe60406d120 0x7fe604165d80 secure :-1 s=READY pgs=1409 cs=0 l=1 rx=0x7fe5fc00af80 tx=0x7fe5fc00b790).ready entity=mon.1 client_cookie=820e7d21023a5f7d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:12.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.321+0000 7fe60359e700 1 --2- 172.21.15.80:0/802898615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe60406d120 0x7fe604165d80 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7fe5fc00af80 tx=0x7fe5fc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:12.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.321+0000 7fe601d9b700 1 -- 172.21.15.80:0/802898615 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5fc007240 con 0x7fe60406d120 2019-11-28T11:53:12.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.321+0000 7fe60359e700 1 --2- 172.21.15.80:0/802898615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe60406d120 0x7fe604165d80 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7fe5fc00af80 tx=0x7fe5fc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:12.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.321+0000 7fe60359e700 1 --2- 172.21.15.80:0/802898615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe60406d120 0x7fe604165d80 secure :-1 s=THROTTLE_DONE pgs=1409 cs=0 l=1 rx=0x7fe5fc00af80 tx=0x7fe5fc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:12.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.321+0000 7fe601d9b700 1 -- 172.21.15.80:0/802898615 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc000bb0 con 0x7fe60406d120 2019-11-28T11:53:12.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.321+0000 7fe601d9b700 1 -- 172.21.15.80:0/802898615 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5fc009e60 con 0x7fe60406d120 2019-11-28T11:53:12.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.321+0000 7fe608c1a700 1 -- 172.21.15.80:0/802898615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe60406d120 msgr2=0x7fe604165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:12.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.321+0000 7fe608c1a700 1 --2- 172.21.15.80:0/802898615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe60406d120 0x7fe604165d80 secure :-1 s=READY pgs=1409 cs=0 l=1 rx=0x7fe5fc00af80 tx=0x7fe5fc00b790).stop 2019-11-28T11:53:12.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.321+0000 7fe608c1a700 1 -- 172.21.15.80:0/802898615 shutdown_connections 2019-11-28T11:53:12.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.321+0000 7fe608c1a700 1 --2- 172.21.15.80:0/802898615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe60406d120 0x7fe604165d80 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:12.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.322+0000 7fe608c1a700 1 -- 172.21.15.80:0/802898615 shutdown_connections 2019-11-28T11:53:12.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.322+0000 7fe608c1a700 1 -- 172.21.15.80:0/802898615 wait complete. 2019-11-28T11:53:12.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.322+0000 7fe608c1a700 1 -- 172.21.15.80:0/802898615 >> 172.21.15.80:0/802898615 conn(0x7fe604061cf0 msgr2=0x7fe604064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:12.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.324+0000 7fe608c1a700 1 Processor -- start 2019-11-28T11:53:12.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.324+0000 7fe608c1a700 1 -- start start 2019-11-28T11:53:12.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe608c1a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe604142ff0 0x7fe60415a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:12.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe608c1a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe60415aa10 0x7fe604127360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:12.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe608c1a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe604102680 con 0x7fe6041278a0 2019-11-28T11:53:12.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe608c1a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe604110350 con 0x7fe604142ff0 2019-11-28T11:53:12.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe608c1a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe604110620 con 0x7fe60415aa10 2019-11-28T11:53:12.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe602d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe604142ff0 0x7fe60415a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:12.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe602d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe604142ff0 0x7fe60415a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43784/0 (socket says 172.21.15.80:43784) 2019-11-28T11:53:12.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe602d9d700 1 -- 172.21.15.80:0/3949229790 learned_addr learned my addr 172.21.15.80:0/3949229790 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:12.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe60259c700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe60415aa10 0x7fe604127360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:12.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe602d9d700 1 -- 172.21.15.80:0/3949229790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe60415aa10 msgr2=0x7fe604127360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:12.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe602d9d700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe60415aa10 0x7fe604127360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:12.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe602d9d700 1 -- 172.21.15.80:0/3949229790 >> v1:172.21.15.174:6789/0 conn(0x7fe6041278a0 legacy=0x7fe604159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:12.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe602d9d700 1 -- 172.21.15.80:0/3949229790 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe604110cb0 con 0x7fe604142ff0 2019-11-28T11:53:12.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe60259c700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe60415aa10 0x7fe604127360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:53:12.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe602d9d700 1 --2- 172.21.15.80:0/3949229790 >> v2:172.21.15.80:3300/0 conn(0x7fe604142ff0 0x7fe60415a4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5f4010410 tx=0x7fe5f40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:12.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe602d9d700 1 --2- 172.21.15.80:0/3949229790 >> v2:172.21.15.80:3300/0 conn(0x7fe604142ff0 0x7fe60415a4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5f4010410 tx=0x7fe5f40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:12.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe602d9d700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe604142ff0 0x7fe60415a4d0 secure :-1 s=READY pgs=2329 cs=0 l=1 rx=0x7fe5f4010410 tx=0x7fe5f40107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:12.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe602d9d700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe604142ff0 0x7fe60415a4d0 secure :-1 s=THROTTLE_DONE pgs=2329 cs=0 l=1 rx=0x7fe5f4010410 tx=0x7fe5f40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:12.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe5fb7fe700 1 -- 172.21.15.80:0/3949229790 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5f4005720 con 0x7fe604142ff0 2019-11-28T11:53:12.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe602d9d700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe604142ff0 0x7fe60415a4d0 secure :-1 s=THROTTLE_DONE pgs=2329 cs=0 l=1 rx=0x7fe5f4010410 tx=0x7fe5f40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:12.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe602d9d700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe604142ff0 0x7fe60415a4d0 secure :-1 s=THROTTLE_DONE pgs=2329 cs=0 l=1 rx=0x7fe5f4010410 tx=0x7fe5f40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:12.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe5fb7fe700 1 -- 172.21.15.80:0/3949229790 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f4005340 con 0x7fe604142ff0 2019-11-28T11:53:12.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe608c1a700 1 -- 172.21.15.80:0/3949229790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe604111030 con 0x7fe604142ff0 2019-11-28T11:53:12.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.325+0000 7fe5fb7fe700 1 -- 172.21.15.80:0/3949229790 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5f4005d00 con 0x7fe604142ff0 2019-11-28T11:53:12.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.326+0000 7fe608c1a700 1 -- 172.21.15.80:0/3949229790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe604110cb0 con 0x7fe604142ff0 2019-11-28T11:53:12.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.326+0000 7fe602d9d700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe604142ff0 0x7fe60415a4d0 secure :-1 s=THROTTLE_DONE pgs=2329 cs=0 l=1 rx=0x7fe5f4010410 tx=0x7fe5f40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.326+0000 7fe5fb7fe700 1 -- 172.21.15.80:0/3949229790 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe5f4005530 con 0x7fe604142ff0 2019-11-28T11:53:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.326+0000 7fe602d9d700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe604142ff0 0x7fe60415a4d0 secure :-1 s=THROTTLE_DONE pgs=2329 cs=0 l=1 rx=0x7fe5f4010410 tx=0x7fe5f40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.326+0000 7fe5fb7fe700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe5dc018730 0x7fe5dc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:12.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.326+0000 7fe5fb7fe700 1 -- 172.21.15.80:0/3949229790 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fe5f4031ac0 con 0x7fe604142ff0 2019-11-28T11:53:12.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.326+0000 7fe60259c700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe5dc018730 0x7fe5dc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:12.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.327+0000 7fe60259c700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe5dc018730 0x7fe5dc01abc0 crc :-1 s=READY pgs=962 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:12.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.334+0000 7fe608c1a700 1 -- 172.21.15.80:0/3949229790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe604111030 con 0x7fe604142ff0 2019-11-28T11:53:12.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.337+0000 7fe602d9d700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe604142ff0 0x7fe60415a4d0 secure :-1 s=THROTTLE_DONE pgs=2329 cs=0 l=1 rx=0x7fe5f4010410 tx=0x7fe5f40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:12.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.337+0000 7fe5fb7fe700 1 -- 172.21.15.80:0/3949229790 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe5f4027b70 con 0x7fe604142ff0 2019-11-28T11:53:12.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.511+0000 7fe608c1a700 1 -- 172.21.15.80:0/3949229790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe604110cb0 con 0x7fe604142ff0 2019-11-28T11:53:12.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.512+0000 7fe602d9d700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe604142ff0 0x7fe60415a4d0 secure :-1 s=THROTTLE_DONE pgs=2329 cs=0 l=1 rx=0x7fe5f4010410 tx=0x7fe5f40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:12.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.512+0000 7fe5fb7fe700 1 -- 172.21.15.80:0/3949229790 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7fe5f4027b70 con 0x7fe604142ff0 2019-11-28T11:53:12.566 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:12.567 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:12.567 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:12.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.514+0000 7fe608c1a700 1 -- 172.21.15.80:0/3949229790 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe5dc018730 msgr2=0x7fe5dc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:12.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.514+0000 7fe608c1a700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe5dc018730 0x7fe5dc01abc0 crc :-1 s=READY pgs=962 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:12.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.514+0000 7fe608c1a700 1 -- 172.21.15.80:0/3949229790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe604142ff0 msgr2=0x7fe60415a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:12.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.514+0000 7fe608c1a700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe604142ff0 0x7fe60415a4d0 secure :-1 s=READY pgs=2329 cs=0 l=1 rx=0x7fe5f4010410 tx=0x7fe5f40107b0).stop 2019-11-28T11:53:12.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.515+0000 7fe608c1a700 1 -- 172.21.15.80:0/3949229790 shutdown_connections 2019-11-28T11:53:12.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.515+0000 7fe608c1a700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe5dc018730 0x7fe5dc01abc0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:12.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.515+0000 7fe608c1a700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe60415aa10 0x7fe604127360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:12.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.515+0000 7fe608c1a700 1 --2- 172.21.15.80:0/3949229790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe604142ff0 0x7fe60415a4d0 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:12.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.515+0000 7fe608c1a700 1 -- 172.21.15.80:0/3949229790 shutdown_connections 2019-11-28T11:53:12.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.515+0000 7fe608c1a700 1 -- 172.21.15.80:0/3949229790 wait complete. 2019-11-28T11:53:12.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:12.515+0000 7fe608c1a700 1 -- 172.21.15.80:0/3949229790 >> 172.21.15.80:0/3949229790 conn(0x7fe60407c680 msgr2=0x7fe604112150 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:12.579 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:13.579 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:13.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.650+0000 7fe657ce0700 1 Processor -- start 2019-11-28T11:53:13.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.650+0000 7fe657ce0700 1 -- start start 2019-11-28T11:53:13.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.651+0000 7fe657ce0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe65006c490 0x7fe65006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:13.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.651+0000 7fe657ce0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe65006ce60 0x7fe650164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:13.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.651+0000 7fe657ce0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65006db00 con 0x7fe65006c0a0 2019-11-28T11:53:13.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.651+0000 7fe657ce0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65006fd60 con 0x7fe65006ce60 2019-11-28T11:53:13.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.651+0000 7fe657ce0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe650070030 con 0x7fe65006c490 2019-11-28T11:53:13.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.651+0000 7fe656a7e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe65006ce60 0x7fe650164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:13.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.651+0000 7fe656a7e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe65006ce60 0x7fe650164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43794/0 (socket says 172.21.15.80:43794) 2019-11-28T11:53:13.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.651+0000 7fe656a7e700 1 -- 172.21.15.80:0/352748542 learned_addr learned my addr 172.21.15.80:0/352748542 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:13.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.651+0000 7fe655a7c700 1 --2- 172.21.15.80:0/352748542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe65006c490 0x7fe65006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:13.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.651+0000 7fe656a7e700 1 -- 172.21.15.80:0/352748542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe65006c490 msgr2=0x7fe65006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:13.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.651+0000 7fe656a7e700 1 --2- 172.21.15.80:0/352748542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe65006c490 0x7fe65006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:13.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.651+0000 7fe656a7e700 1 -- 172.21.15.80:0/352748542 >> v1:172.21.15.174:6789/0 conn(0x7fe65006c0a0 legacy=0x7fe650072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:13.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.651+0000 7fe656a7e700 1 -- 172.21.15.80:0/352748542 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6500706c0 con 0x7fe65006ce60 2019-11-28T11:53:13.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.651+0000 7fe656a7e700 1 --2- 172.21.15.80:0/352748542 >> v2:172.21.15.80:3300/0 conn(0x7fe65006ce60 0x7fe650164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe64800fa30 tx=0x7fe64800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:13.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.651+0000 7fe656a7e700 1 --2- 172.21.15.80:0/352748542 >> v2:172.21.15.80:3300/0 conn(0x7fe65006ce60 0x7fe650164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe64800fa30 tx=0x7fe64800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:13.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.651+0000 7fe656a7e700 1 --2- 172.21.15.80:0/352748542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe65006ce60 0x7fe650164d70 secure :-1 s=READY pgs=2330 cs=0 l=1 rx=0x7fe64800fa30 tx=0x7fe64800fdd0).ready entity=mon.0 client_cookie=ab6b8c4315df9164 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:13.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.652+0000 7fe656a7e700 1 --2- 172.21.15.80:0/352748542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe65006ce60 0x7fe650164d70 secure :-1 s=THROTTLE_DONE pgs=2330 cs=0 l=1 rx=0x7fe64800fa30 tx=0x7fe64800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:13.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.652+0000 7fe656a7e700 1 --2- 172.21.15.80:0/352748542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe65006ce60 0x7fe650164d70 secure :-1 s=THROTTLE_DONE pgs=2330 cs=0 l=1 rx=0x7fe64800fa30 tx=0x7fe64800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:13.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.652+0000 7fe65527b700 1 -- 172.21.15.80:0/352748542 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe648000df0 con 0x7fe65006ce60 2019-11-28T11:53:13.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.652+0000 7fe656a7e700 1 --2- 172.21.15.80:0/352748542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe65006ce60 0x7fe650164d70 secure :-1 s=THROTTLE_DONE pgs=2330 cs=0 l=1 rx=0x7fe64800fa30 tx=0x7fe64800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:13.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.652+0000 7fe65527b700 1 -- 172.21.15.80:0/352748542 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe648001460 con 0x7fe65006ce60 2019-11-28T11:53:13.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.652+0000 7fe65527b700 1 -- 172.21.15.80:0/352748542 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe648001b30 con 0x7fe65006ce60 2019-11-28T11:53:13.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.652+0000 7fe657ce0700 1 -- 172.21.15.80:0/352748542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe65006ce60 msgr2=0x7fe650164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:13.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.652+0000 7fe657ce0700 1 --2- 172.21.15.80:0/352748542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe65006ce60 0x7fe650164d70 secure :-1 s=READY pgs=2330 cs=0 l=1 rx=0x7fe64800fa30 tx=0x7fe64800fdd0).stop 2019-11-28T11:53:13.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.652+0000 7fe657ce0700 1 -- 172.21.15.80:0/352748542 shutdown_connections 2019-11-28T11:53:13.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.652+0000 7fe657ce0700 1 --2- 172.21.15.80:0/352748542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe65006ce60 0x7fe650164d70 unknown :-1 s=CLOSED pgs=2330 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:13.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.652+0000 7fe657ce0700 1 --2- 172.21.15.80:0/352748542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe65006c490 0x7fe65006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:13.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.652+0000 7fe657ce0700 1 -- 172.21.15.80:0/352748542 shutdown_connections 2019-11-28T11:53:13.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.652+0000 7fe657ce0700 1 -- 172.21.15.80:0/352748542 wait complete. 2019-11-28T11:53:13.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.652+0000 7fe657ce0700 1 -- 172.21.15.80:0/352748542 >> 172.21.15.80:0/352748542 conn(0x7fe650061cf0 msgr2=0x7fe650064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:13.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.655+0000 7fe657ce0700 1 Processor -- start 2019-11-28T11:53:13.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.655+0000 7fe657ce0700 1 -- start start 2019-11-28T11:53:13.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.656+0000 7fe657ce0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe6501281b0 0x7fe650128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:13.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.656+0000 7fe657ce0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe650128b80 0x7fe650167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:13.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.656+0000 7fe657ce0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe650139a60 con 0x7fe65013a780 2019-11-28T11:53:13.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.656+0000 7fe657ce0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65012a260 con 0x7fe6501281b0 2019-11-28T11:53:13.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.656+0000 7fe657ce0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65012a530 con 0x7fe650128b80 2019-11-28T11:53:13.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.656+0000 7fe655a7c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe6501281b0 0x7fe650128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:13.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.656+0000 7fe655a7c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe6501281b0 0x7fe650128640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:58686/0 (socket says 172.21.15.80:58686) 2019-11-28T11:53:13.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.656+0000 7fe656a7e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe650128b80 0x7fe650167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:13.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.656+0000 7fe655a7c700 1 -- 172.21.15.80:0/1951781377 learned_addr learned my addr 172.21.15.80:0/1951781377 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:13.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.656+0000 7fe655a7c700 1 -- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe650128b80 msgr2=0x7fe650167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:13.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.656+0000 7fe655a7c700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe650128b80 0x7fe650167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:13.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.656+0000 7fe655a7c700 1 -- 172.21.15.80:0/1951781377 >> v1:172.21.15.174:6789/0 conn(0x7fe65013a780 legacy=0x7fe65012d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:13.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.656+0000 7fe655a7c700 1 -- 172.21.15.80:0/1951781377 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65012abc0 con 0x7fe6501281b0 2019-11-28T11:53:13.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.656+0000 7fe656a7e700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe650128b80 0x7fe650167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:13.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.656+0000 7fe655a7c700 1 --2- 172.21.15.80:0/1951781377 >> v2:172.21.15.174:3300/0 conn(0x7fe6501281b0 0x7fe650128640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe644010440 tx=0x7fe6440107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:13.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.656+0000 7fe655a7c700 1 --2- 172.21.15.80:0/1951781377 >> v2:172.21.15.174:3300/0 conn(0x7fe6501281b0 0x7fe650128640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe644010440 tx=0x7fe6440107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:13.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.657+0000 7fe655a7c700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6501281b0 0x7fe650128640 secure :-1 s=READY pgs=1413 cs=0 l=1 rx=0x7fe644010440 tx=0x7fe6440107e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:13.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.657+0000 7fe655a7c700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6501281b0 0x7fe650128640 secure :-1 s=THROTTLE_DONE pgs=1413 cs=0 l=1 rx=0x7fe644010440 tx=0x7fe6440107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:13.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.657+0000 7fe64effd700 1 -- 172.21.15.80:0/1951781377 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe644008890 con 0x7fe6501281b0 2019-11-28T11:53:13.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.657+0000 7fe655a7c700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6501281b0 0x7fe650128640 secure :-1 s=THROTTLE_DONE pgs=1413 cs=0 l=1 rx=0x7fe644010440 tx=0x7fe6440107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:13.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.657+0000 7fe64effd700 1 -- 172.21.15.80:0/1951781377 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6440084b0 con 0x7fe6501281b0 2019-11-28T11:53:13.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.657+0000 7fe655a7c700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6501281b0 0x7fe650128640 secure :-1 s=THROTTLE_DONE pgs=1413 cs=0 l=1 rx=0x7fe644010440 tx=0x7fe6440107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:13.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.657+0000 7fe657ce0700 1 -- 172.21.15.80:0/1951781377 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65012af40 con 0x7fe6501281b0 2019-11-28T11:53:13.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.657+0000 7fe64effd700 1 -- 172.21.15.80:0/1951781377 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe644008a80 con 0x7fe6501281b0 2019-11-28T11:53:13.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.657+0000 7fe657ce0700 1 -- 172.21.15.80:0/1951781377 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65012abc0 con 0x7fe6501281b0 2019-11-28T11:53:13.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.657+0000 7fe655a7c700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6501281b0 0x7fe650128640 secure :-1 s=THROTTLE_DONE pgs=1413 cs=0 l=1 rx=0x7fe644010440 tx=0x7fe6440107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:13.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.657+0000 7fe64effd700 1 -- 172.21.15.80:0/1951781377 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe6440086a0 con 0x7fe6501281b0 2019-11-28T11:53:13.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.657+0000 7fe655a7c700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6501281b0 0x7fe650128640 secure :-1 s=THROTTLE_DONE pgs=1413 cs=0 l=1 rx=0x7fe644010440 tx=0x7fe6440107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:13.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.658+0000 7fe64effd700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe630018730 0x7fe63001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:13.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.658+0000 7fe64effd700 1 -- 172.21.15.80:0/1951781377 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fe644031ac0 con 0x7fe6501281b0 2019-11-28T11:53:13.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.658+0000 7fe65627d700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe630018730 0x7fe63001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:13.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.658+0000 7fe65627d700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe630018730 0x7fe63001abc0 crc :-1 s=READY pgs=963 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:13.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.665+0000 7fe657ce0700 1 -- 172.21.15.80:0/1951781377 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65012af40 con 0x7fe6501281b0 2019-11-28T11:53:13.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.669+0000 7fe655a7c700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6501281b0 0x7fe650128640 secure :-1 s=THROTTLE_DONE pgs=1413 cs=0 l=1 rx=0x7fe644010440 tx=0x7fe6440107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:13.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.669+0000 7fe64effd700 1 -- 172.21.15.80:0/1951781377 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe644002a00 con 0x7fe6501281b0 2019-11-28T11:53:13.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.842+0000 7fe657ce0700 1 -- 172.21.15.80:0/1951781377 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe65012abc0 con 0x7fe6501281b0 2019-11-28T11:53:13.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.843+0000 7fe655a7c700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6501281b0 0x7fe650128640 secure :-1 s=THROTTLE_DONE pgs=1413 cs=0 l=1 rx=0x7fe644010440 tx=0x7fe6440107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:13.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.843+0000 7fe64effd700 1 -- 172.21.15.80:0/1951781377 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7fe6440086a0 con 0x7fe6501281b0 2019-11-28T11:53:13.902 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:13.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.845+0000 7fe657ce0700 1 -- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe630018730 msgr2=0x7fe63001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:13.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.845+0000 7fe657ce0700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe630018730 0x7fe63001abc0 crc :-1 s=READY pgs=963 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:13.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.845+0000 7fe657ce0700 1 -- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6501281b0 msgr2=0x7fe650128640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:13.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.845+0000 7fe657ce0700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6501281b0 0x7fe650128640 secure :-1 s=READY pgs=1413 cs=0 l=1 rx=0x7fe644010440 tx=0x7fe6440107e0).stop 2019-11-28T11:53:13.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.845+0000 7fe657ce0700 1 -- 172.21.15.80:0/1951781377 shutdown_connections 2019-11-28T11:53:13.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.845+0000 7fe657ce0700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe650128b80 0x7fe650167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:13.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.845+0000 7fe657ce0700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6501281b0 0x7fe650128640 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:13.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.845+0000 7fe657ce0700 1 --2- 172.21.15.80:0/1951781377 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe630018730 0x7fe63001abc0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:13.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.845+0000 7fe657ce0700 1 -- 172.21.15.80:0/1951781377 shutdown_connections 2019-11-28T11:53:13.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.845+0000 7fe657ce0700 1 -- 172.21.15.80:0/1951781377 wait complete. 2019-11-28T11:53:13.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:13.845+0000 7fe657ce0700 1 -- 172.21.15.80:0/1951781377 >> 172.21.15.80:0/1951781377 conn(0x7fe650127dc0 msgr2=0x7fe650141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:13.904 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:13.904 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:13.910 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:14.911 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.978+0000 7f324efdb700 1 Processor -- start 2019-11-28T11:53:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.978+0000 7f324efdb700 1 -- start start 2019-11-28T11:53:15.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.979+0000 7f324efdb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f324806d120 0x7f3248165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.979+0000 7f324efdb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324806d5a0 con 0x7f324806c490 2019-11-28T11:53:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.979+0000 7f324efdb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324806db00 con 0x7f324806c0a0 2019-11-28T11:53:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.979+0000 7f324efdb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324806fd60 con 0x7f324806d120 2019-11-28T11:53:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.979+0000 7f324dd79700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f324806d120 0x7f3248165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.979+0000 7f324cd77700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f324806c490 0x7f324806c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43126/0 (socket says 172.21.15.80:43126) 2019-11-28T11:53:15.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.979+0000 7f324cd77700 1 -- 172.21.15.80:0/1232609301 learned_addr learned my addr 172.21.15.80:0/1232609301 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:15.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.980+0000 7f324dd79700 1 -- 172.21.15.80:0/1232609301 >> v1:172.21.15.174:6789/0 conn(0x7f324806c0a0 legacy=0x7f3248072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:15.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.980+0000 7f324dd79700 1 -- 172.21.15.80:0/1232609301 >> v1:172.21.15.80:6789/0 conn(0x7f324806c490 legacy=0x7f324806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:15.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.980+0000 7f324dd79700 1 -- 172.21.15.80:0/1232609301 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32480706c0 con 0x7f324806d120 2019-11-28T11:53:15.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.980+0000 7f3247fff700 1 -- 172.21.15.80:0/1232609301 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148985389 0 0) 0x7f3230001150 con 0x7f324806c490 2019-11-28T11:53:15.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.980+0000 7f324dd79700 1 --2- 172.21.15.80:0/1232609301 >> v2:172.21.15.80:3300/0 conn(0x7f324806d120 0x7f3248165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f324000af50 tx=0x7f324000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:15.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.980+0000 7f324dd79700 1 --2- 172.21.15.80:0/1232609301 >> v2:172.21.15.80:3300/0 conn(0x7f324806d120 0x7f3248165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f324000af50 tx=0x7f324000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:15.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.980+0000 7f324dd79700 1 --2- 172.21.15.80:0/1232609301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324806d120 0x7f3248165d80 secure :-1 s=READY pgs=2332 cs=0 l=1 rx=0x7f324000af50 tx=0x7f324000b760).ready entity=mon.0 client_cookie=d3817b50658b4036 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:15.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.980+0000 7f324dd79700 1 --2- 172.21.15.80:0/1232609301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324806d120 0x7f3248165d80 secure :-1 s=THROTTLE_DONE pgs=2332 cs=0 l=1 rx=0x7f324000af50 tx=0x7f324000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:15.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.980+0000 7f3247fff700 1 -- 172.21.15.80:0/1232609301 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3240009ba0 con 0x7f324806d120 2019-11-28T11:53:15.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.980+0000 7f324dd79700 1 --2- 172.21.15.80:0/1232609301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324806d120 0x7f3248165d80 secure :-1 s=THROTTLE_DONE pgs=2332 cs=0 l=1 rx=0x7f324000af50 tx=0x7f324000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:15.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.980+0000 7f324dd79700 1 --2- 172.21.15.80:0/1232609301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324806d120 0x7f3248165d80 secure :-1 s=THROTTLE_DONE pgs=2332 cs=0 l=1 rx=0x7f324000af50 tx=0x7f324000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:15.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.980+0000 7f3247fff700 1 -- 172.21.15.80:0/1232609301 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3240000a70 con 0x7f324806d120 2019-11-28T11:53:15.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.980+0000 7f3247fff700 1 -- 172.21.15.80:0/1232609301 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f324000a180 con 0x7f324806d120 2019-11-28T11:53:15.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.980+0000 7f324efdb700 1 -- 172.21.15.80:0/1232609301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324806d120 msgr2=0x7f3248165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:15.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.980+0000 7f324efdb700 1 --2- 172.21.15.80:0/1232609301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324806d120 0x7f3248165d80 secure :-1 s=READY pgs=2332 cs=0 l=1 rx=0x7f324000af50 tx=0x7f324000b760).stop 2019-11-28T11:53:15.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.981+0000 7f324efdb700 1 -- 172.21.15.80:0/1232609301 shutdown_connections 2019-11-28T11:53:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.981+0000 7f324efdb700 1 --2- 172.21.15.80:0/1232609301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f324806d120 0x7f3248165d80 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.981+0000 7f324efdb700 1 -- 172.21.15.80:0/1232609301 shutdown_connections 2019-11-28T11:53:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.981+0000 7f324efdb700 1 -- 172.21.15.80:0/1232609301 wait complete. 2019-11-28T11:53:15.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.981+0000 7f324efdb700 1 -- 172.21.15.80:0/1232609301 >> 172.21.15.80:0/1232609301 conn(0x7f3248061cf0 msgr2=0x7f3248064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:15.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.983+0000 7f324efdb700 1 Processor -- start 2019-11-28T11:53:15.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.983+0000 7f324efdb700 1 -- start start 2019-11-28T11:53:15.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.984+0000 7f324efdb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3248142ff0 0x7f324815a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:15.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.984+0000 7f324efdb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3248127b60 con 0x7f324810ea60 2019-11-28T11:53:15.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.984+0000 7f324efdb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3248102680 con 0x7f324815aa10 2019-11-28T11:53:15.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.984+0000 7f324efdb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3248110350 con 0x7f3248142ff0 2019-11-28T11:53:15.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.984+0000 7f324d578700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3248142ff0 0x7f324815a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:15.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.984+0000 7f324dd79700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f324810ea60 0x7f324810ef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43132/0 (socket says 172.21.15.80:43132) 2019-11-28T11:53:15.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.984+0000 7f324dd79700 1 -- 172.21.15.80:0/953966321 learned_addr learned my addr 172.21.15.80:0/953966321 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:15.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.985+0000 7f324d578700 1 -- 172.21.15.80:0/953966321 >> v1:172.21.15.174:6789/0 conn(0x7f324815aa10 legacy=0x7f3248127360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:15.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.985+0000 7f324d578700 1 -- 172.21.15.80:0/953966321 >> v1:172.21.15.80:6789/0 conn(0x7f324810ea60 legacy=0x7f324810ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:15.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.985+0000 7f3245ffb700 1 -- 172.21.15.80:0/953966321 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340293198 0 0) 0x7f3240000940 con 0x7f324810ea60 2019-11-28T11:53:15.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.985+0000 7f324d578700 1 -- 172.21.15.80:0/953966321 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3248110cb0 con 0x7f3248142ff0 2019-11-28T11:53:15.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.985+0000 7f324d578700 1 --2- 172.21.15.80:0/953966321 >> v2:172.21.15.80:3300/0 conn(0x7f3248142ff0 0x7f324815a4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3238010720 tx=0x7f3238010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:15.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.985+0000 7f324d578700 1 --2- 172.21.15.80:0/953966321 >> v2:172.21.15.80:3300/0 conn(0x7f3248142ff0 0x7f324815a4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3238010720 tx=0x7f3238010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:15.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.985+0000 7f324d578700 1 --2- 172.21.15.80:0/953966321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3248142ff0 0x7f324815a4d0 secure :-1 s=READY pgs=2334 cs=0 l=1 rx=0x7f3238010720 tx=0x7f3238010ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:15.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.985+0000 7f324d578700 1 --2- 172.21.15.80:0/953966321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3248142ff0 0x7f324815a4d0 secure :-1 s=THROTTLE_DONE pgs=2334 cs=0 l=1 rx=0x7f3238010720 tx=0x7f3238010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:15.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.985+0000 7f324d578700 1 --2- 172.21.15.80:0/953966321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3248142ff0 0x7f324815a4d0 secure :-1 s=THROTTLE_DONE pgs=2334 cs=0 l=1 rx=0x7f3238010720 tx=0x7f3238010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:15.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.985+0000 7f324d578700 1 --2- 172.21.15.80:0/953966321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3248142ff0 0x7f324815a4d0 secure :-1 s=THROTTLE_DONE pgs=2334 cs=0 l=1 rx=0x7f3238010720 tx=0x7f3238010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:15.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.985+0000 7f3245ffb700 1 -- 172.21.15.80:0/953966321 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3238009b10 con 0x7f3248142ff0 2019-11-28T11:53:15.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.985+0000 7f3245ffb700 1 -- 172.21.15.80:0/953966321 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323800aa30 con 0x7f3248142ff0 2019-11-28T11:53:15.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.985+0000 7f3245ffb700 1 -- 172.21.15.80:0/953966321 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f323800a270 con 0x7f3248142ff0 2019-11-28T11:53:15.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.985+0000 7f324efdb700 1 -- 172.21.15.80:0/953966321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3248111030 con 0x7f3248142ff0 2019-11-28T11:53:15.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.985+0000 7f324efdb700 1 -- 172.21.15.80:0/953966321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3248110cb0 con 0x7f3248142ff0 2019-11-28T11:53:15.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.985+0000 7f324d578700 1 --2- 172.21.15.80:0/953966321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3248142ff0 0x7f324815a4d0 secure :-1 s=THROTTLE_DONE pgs=2334 cs=0 l=1 rx=0x7f3238010720 tx=0x7f3238010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:15.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.986+0000 7f3245ffb700 1 -- 172.21.15.80:0/953966321 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3238009900 con 0x7f3248142ff0 2019-11-28T11:53:15.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.986+0000 7f324d578700 1 --2- 172.21.15.80:0/953966321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3248142ff0 0x7f324815a4d0 secure :-1 s=THROTTLE_DONE pgs=2334 cs=0 l=1 rx=0x7f3238010720 tx=0x7f3238010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:15.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.986+0000 7f3245ffb700 1 --2- 172.21.15.80:0/953966321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f322c018730 0x7f322c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:15.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.986+0000 7f3245ffb700 1 -- 172.21.15.80:0/953966321 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f3238031e20 con 0x7f3248142ff0 2019-11-28T11:53:15.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.986+0000 7f324cd77700 1 --2- 172.21.15.80:0/953966321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f322c018730 0x7f322c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:15.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.986+0000 7f324cd77700 1 --2- 172.21.15.80:0/953966321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f322c018730 0x7f322c01abc0 crc :-1 s=READY pgs=964 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:15.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.993+0000 7f324efdb700 1 -- 172.21.15.80:0/953966321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3248111030 con 0x7f3248142ff0 2019-11-28T11:53:15.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.997+0000 7f324d578700 1 --2- 172.21.15.80:0/953966321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3248142ff0 0x7f324815a4d0 secure :-1 s=THROTTLE_DONE pgs=2334 cs=0 l=1 rx=0x7f3238010720 tx=0x7f3238010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:15.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:14.997+0000 7f3245ffb700 1 -- 172.21.15.80:0/953966321 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3238000f90 con 0x7f3248142ff0 2019-11-28T11:53:15.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:15.168+0000 7f324efdb700 1 -- 172.21.15.80:0/953966321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3248110cb0 con 0x7f3248142ff0 2019-11-28T11:53:15.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:15.168+0000 7f324d578700 1 --2- 172.21.15.80:0/953966321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3248142ff0 0x7f324815a4d0 secure :-1 s=THROTTLE_DONE pgs=2334 cs=0 l=1 rx=0x7f3238010720 tx=0x7f3238010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:15.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:15.168+0000 7f3245ffb700 1 -- 172.21.15.80:0/953966321 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f3238017790 con 0x7f3248142ff0 2019-11-28T11:53:15.224 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:15.225 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:15.225 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:15.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:15.171+0000 7f324efdb700 1 -- 172.21.15.80:0/953966321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f322c018730 msgr2=0x7f322c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:15.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:15.171+0000 7f324efdb700 1 --2- 172.21.15.80:0/953966321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f322c018730 0x7f322c01abc0 crc :-1 s=READY pgs=964 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:15.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:15.171+0000 7f324efdb700 1 -- 172.21.15.80:0/953966321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3248142ff0 msgr2=0x7f324815a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:15.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:15.171+0000 7f324efdb700 1 --2- 172.21.15.80:0/953966321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3248142ff0 0x7f324815a4d0 secure :-1 s=READY pgs=2334 cs=0 l=1 rx=0x7f3238010720 tx=0x7f3238010ac0).stop 2019-11-28T11:53:15.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:15.171+0000 7f324efdb700 1 -- 172.21.15.80:0/953966321 shutdown_connections 2019-11-28T11:53:15.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:15.171+0000 7f324efdb700 1 --2- 172.21.15.80:0/953966321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f322c018730 0x7f322c01abc0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:15.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:15.171+0000 7f324efdb700 1 --2- 172.21.15.80:0/953966321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3248142ff0 0x7f324815a4d0 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:15.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:15.171+0000 7f324efdb700 1 -- 172.21.15.80:0/953966321 shutdown_connections 2019-11-28T11:53:15.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:15.171+0000 7f324efdb700 1 -- 172.21.15.80:0/953966321 wait complete. 2019-11-28T11:53:15.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:15.171+0000 7f324efdb700 1 -- 172.21.15.80:0/953966321 >> 172.21.15.80:0/953966321 conn(0x7f324807c680 msgr2=0x7f3248112150 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:15.237 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:15.350 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:53:15.357 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:53:15.362 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:53:15.366 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:53:15.369 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:53:15.377 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:53:16.237 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:16.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.304+0000 7fdab9487700 1 Processor -- start 2019-11-28T11:53:16.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.304+0000 7fdab9487700 1 -- start start 2019-11-28T11:53:16.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.305+0000 7fdab9487700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdab406c0a0 0x7fdab4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:16.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.305+0000 7fdab9487700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdab40734e0 0x7fdab4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:16.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.305+0000 7fdab9487700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab406db00 con 0x7fdab4072360 2019-11-28T11:53:16.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.305+0000 7fdab9487700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab406fd60 con 0x7fdab406c0a0 2019-11-28T11:53:16.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.305+0000 7fdab9487700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab4070030 con 0x7fdab40734e0 2019-11-28T11:53:16.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.305+0000 7fdab37fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdab406c0a0 0x7fdab4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:16.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.305+0000 7fdab3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdab4072360 0x7fdab406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43138/0 (socket says 172.21.15.80:43138) 2019-11-28T11:53:16.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.305+0000 7fdab3fff700 1 -- 172.21.15.80:0/3928720015 learned_addr learned my addr 172.21.15.80:0/3928720015 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:16.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab2ffd700 1 --2- 172.21.15.80:0/3928720015 >> v2:172.21.15.174:3300/0 conn(0x7fdab40734e0 0x7fdab4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:16.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab37fe700 1 -- 172.21.15.80:0/3928720015 >> v2:172.21.15.174:3300/0 conn(0x7fdab40734e0 msgr2=0x7fdab4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:16.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab37fe700 1 --2- 172.21.15.80:0/3928720015 >> v2:172.21.15.174:3300/0 conn(0x7fdab40734e0 0x7fdab4071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:16.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab37fe700 1 -- 172.21.15.80:0/3928720015 >> v1:172.21.15.80:6789/0 conn(0x7fdab4072360 legacy=0x7fdab406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:16.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab37fe700 1 -- 172.21.15.80:0/3928720015 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab40706c0 con 0x7fdab406c0a0 2019-11-28T11:53:16.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab27fc700 1 -- 172.21.15.80:0/3928720015 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504758398 0 0) 0x7fdaac001150 con 0x7fdab4072360 2019-11-28T11:53:16.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab37fe700 1 --2- 172.21.15.80:0/3928720015 >> v2:172.21.15.80:3300/0 conn(0x7fdab406c0a0 0x7fdab4072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fda9c00b2d0 tx=0x7fda9c00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:16.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab37fe700 1 --2- 172.21.15.80:0/3928720015 >> v2:172.21.15.80:3300/0 conn(0x7fdab406c0a0 0x7fdab4072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fda9c00b2d0 tx=0x7fda9c00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:16.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab37fe700 1 --2- 172.21.15.80:0/3928720015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab406c0a0 0x7fdab4072fa0 secure :-1 s=READY pgs=2336 cs=0 l=1 rx=0x7fda9c00b2d0 tx=0x7fda9c00ba60).ready entity=mon.0 client_cookie=66ac8dc4fa6e7b82 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:16.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab37fe700 1 --2- 172.21.15.80:0/3928720015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab406c0a0 0x7fdab4072fa0 secure :-1 s=THROTTLE_DONE pgs=2336 cs=0 l=1 rx=0x7fda9c00b2d0 tx=0x7fda9c00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:16.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab27fc700 1 -- 172.21.15.80:0/3928720015 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda9c007590 con 0x7fdab406c0a0 2019-11-28T11:53:16.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab37fe700 1 --2- 172.21.15.80:0/3928720015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab406c0a0 0x7fdab4072fa0 secure :-1 s=THROTTLE_DONE pgs=2336 cs=0 l=1 rx=0x7fda9c00b2d0 tx=0x7fda9c00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:16.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab37fe700 1 --2- 172.21.15.80:0/3928720015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab406c0a0 0x7fdab4072fa0 secure :-1 s=THROTTLE_DONE pgs=2336 cs=0 l=1 rx=0x7fda9c00b2d0 tx=0x7fda9c00ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:16.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab27fc700 1 -- 172.21.15.80:0/3928720015 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9c009d30 con 0x7fdab406c0a0 2019-11-28T11:53:16.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab27fc700 1 -- 172.21.15.80:0/3928720015 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda9c00a400 con 0x7fdab406c0a0 2019-11-28T11:53:16.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab9487700 1 -- 172.21.15.80:0/3928720015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab406c0a0 msgr2=0x7fdab4072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:16.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.306+0000 7fdab9487700 1 --2- 172.21.15.80:0/3928720015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab406c0a0 0x7fdab4072fa0 secure :-1 s=READY pgs=2336 cs=0 l=1 rx=0x7fda9c00b2d0 tx=0x7fda9c00ba60).stop 2019-11-28T11:53:16.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.307+0000 7fdab9487700 1 -- 172.21.15.80:0/3928720015 shutdown_connections 2019-11-28T11:53:16.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.307+0000 7fdab9487700 1 --2- 172.21.15.80:0/3928720015 >> v2:172.21.15.174:3300/0 conn(0x7fdab40734e0 0x7fdab4071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:16.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.307+0000 7fdab9487700 1 --2- 172.21.15.80:0/3928720015 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab406c0a0 0x7fdab4072fa0 unknown :-1 s=CLOSED pgs=2336 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:16.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.307+0000 7fdab9487700 1 -- 172.21.15.80:0/3928720015 shutdown_connections 2019-11-28T11:53:16.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.307+0000 7fdab9487700 1 -- 172.21.15.80:0/3928720015 wait complete. 2019-11-28T11:53:16.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.307+0000 7fdab9487700 1 -- 172.21.15.80:0/3928720015 >> 172.21.15.80:0/3928720015 conn(0x7fdab4061cf0 msgr2=0x7fdab4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:16.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.309+0000 7fdab9487700 1 Processor -- start 2019-11-28T11:53:16.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.309+0000 7fdab9487700 1 -- start start 2019-11-28T11:53:16.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.310+0000 7fdab9487700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdab413e9e0 0x7fdab4108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:16.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.310+0000 7fdab9487700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdab4109430 0x7fdab41098b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:16.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.310+0000 7fdab9487700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab41066e0 con 0x7fdab413e5f0 2019-11-28T11:53:16.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.310+0000 7fdab9487700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab410e060 con 0x7fdab4109430 2019-11-28T11:53:16.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.310+0000 7fdab9487700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab410e330 con 0x7fdab413e9e0 2019-11-28T11:53:16.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.310+0000 7fdab3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdab4109430 0x7fdab41098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:16.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.310+0000 7fdab3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdab4109430 0x7fdab41098b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43830/0 (socket says 172.21.15.80:43830) 2019-11-28T11:53:16.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.310+0000 7fdab3fff700 1 -- 172.21.15.80:0/3561527809 learned_addr learned my addr 172.21.15.80:0/3561527809 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:16.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.310+0000 7fdab2ffd700 1 --2- 172.21.15.80:0/3561527809 >> v2:172.21.15.174:3300/0 conn(0x7fdab413e9e0 0x7fdab4108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:16.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.311+0000 7fdab3fff700 1 -- 172.21.15.80:0/3561527809 >> v2:172.21.15.174:3300/0 conn(0x7fdab413e9e0 msgr2=0x7fdab4108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:16.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.311+0000 7fdab3fff700 1 --2- 172.21.15.80:0/3561527809 >> v2:172.21.15.174:3300/0 conn(0x7fdab413e9e0 0x7fdab4108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:16.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.311+0000 7fdab3fff700 1 -- 172.21.15.80:0/3561527809 >> v1:172.21.15.174:6789/0 conn(0x7fdab413e5f0 legacy=0x7fdab410a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:16.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.311+0000 7fdab3fff700 1 -- 172.21.15.80:0/3561527809 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab410e9c0 con 0x7fdab4109430 2019-11-28T11:53:16.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.311+0000 7fdab3fff700 1 --2- 172.21.15.80:0/3561527809 >> v2:172.21.15.80:3300/0 conn(0x7fdab4109430 0x7fdab41098b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdaac010410 tx=0x7fdaac010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:16.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.311+0000 7fdab3fff700 1 --2- 172.21.15.80:0/3561527809 >> v2:172.21.15.80:3300/0 conn(0x7fdab4109430 0x7fdab41098b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdaac010410 tx=0x7fdaac010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:16.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.311+0000 7fdab3fff700 1 --2- 172.21.15.80:0/3561527809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab4109430 0x7fdab41098b0 secure :-1 s=READY pgs=2337 cs=0 l=1 rx=0x7fdaac010410 tx=0x7fdaac010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:16.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.311+0000 7fdab3fff700 1 --2- 172.21.15.80:0/3561527809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab4109430 0x7fdab41098b0 secure :-1 s=THROTTLE_DONE pgs=2337 cs=0 l=1 rx=0x7fdaac010410 tx=0x7fdaac010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:16.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.311+0000 7fdab3fff700 1 --2- 172.21.15.80:0/3561527809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab4109430 0x7fdab41098b0 secure :-1 s=THROTTLE_DONE pgs=2337 cs=0 l=1 rx=0x7fdaac010410 tx=0x7fdaac010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:16.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.311+0000 7fdaabfff700 1 -- 172.21.15.80:0/3561527809 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaac000960 con 0x7fdab4109430 2019-11-28T11:53:16.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.311+0000 7fdab3fff700 1 --2- 172.21.15.80:0/3561527809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab4109430 0x7fdab41098b0 secure :-1 s=THROTTLE_DONE pgs=2337 cs=0 l=1 rx=0x7fdaac010410 tx=0x7fdaac010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:16.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.311+0000 7fdaabfff700 1 -- 172.21.15.80:0/3561527809 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac0010e0 con 0x7fdab4109430 2019-11-28T11:53:16.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.311+0000 7fdaabfff700 1 -- 172.21.15.80:0/3561527809 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaac0017f0 con 0x7fdab4109430 2019-11-28T11:53:16.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.311+0000 7fdab9487700 1 -- 172.21.15.80:0/3561527809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab410ed40 con 0x7fdab4109430 2019-11-28T11:53:16.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.311+0000 7fdab9487700 1 -- 172.21.15.80:0/3561527809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab410e9c0 con 0x7fdab4109430 2019-11-28T11:53:16.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.311+0000 7fdab3fff700 1 --2- 172.21.15.80:0/3561527809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab4109430 0x7fdab41098b0 secure :-1 s=THROTTLE_DONE pgs=2337 cs=0 l=1 rx=0x7fdaac010410 tx=0x7fdaac010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:16.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.312+0000 7fdaabfff700 1 -- 172.21.15.80:0/3561527809 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fdaac000960 con 0x7fdab4109430 2019-11-28T11:53:16.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.312+0000 7fdab3fff700 1 --2- 172.21.15.80:0/3561527809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab4109430 0x7fdab41098b0 secure :-1 s=THROTTLE_DONE pgs=2337 cs=0 l=1 rx=0x7fdaac010410 tx=0x7fdaac010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:16.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.312+0000 7fdaabfff700 1 --2- 172.21.15.80:0/3561527809 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda8c018730 0x7fda8c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:16.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.312+0000 7fdaabfff700 1 -- 172.21.15.80:0/3561527809 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fdaac031ab0 con 0x7fdab4109430 2019-11-28T11:53:16.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.312+0000 7fdab37fe700 1 --2- 172.21.15.80:0/3561527809 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda8c018730 0x7fda8c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:16.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.312+0000 7fdab37fe700 1 --2- 172.21.15.80:0/3561527809 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda8c018730 0x7fda8c01abc0 crc :-1 s=READY pgs=965 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:16.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.320+0000 7fdab9487700 1 -- 172.21.15.80:0/3561527809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab410ed40 con 0x7fdab4109430 2019-11-28T11:53:16.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.323+0000 7fdab3fff700 1 --2- 172.21.15.80:0/3561527809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab4109430 0x7fdab41098b0 secure :-1 s=THROTTLE_DONE pgs=2337 cs=0 l=1 rx=0x7fdaac010410 tx=0x7fdaac010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:16.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.323+0000 7fdaabfff700 1 -- 172.21.15.80:0/3561527809 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fdaac0075b0 con 0x7fdab4109430 2019-11-28T11:53:16.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.495+0000 7fdab9487700 1 -- 172.21.15.80:0/3561527809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdab410e9c0 con 0x7fdab4109430 2019-11-28T11:53:16.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.496+0000 7fdab3fff700 1 --2- 172.21.15.80:0/3561527809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab4109430 0x7fdab41098b0 secure :-1 s=THROTTLE_DONE pgs=2337 cs=0 l=1 rx=0x7fdaac010410 tx=0x7fdaac010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:16.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.496+0000 7fdaabfff700 1 -- 172.21.15.80:0/3561527809 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7fdaac000940 con 0x7fdab4109430 2019-11-28T11:53:16.551 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:16.551 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:16.551 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:16.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.498+0000 7fdab9487700 1 -- 172.21.15.80:0/3561527809 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda8c018730 msgr2=0x7fda8c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:16.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.498+0000 7fdab9487700 1 --2- 172.21.15.80:0/3561527809 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda8c018730 0x7fda8c01abc0 crc :-1 s=READY pgs=965 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:16.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.498+0000 7fdab9487700 1 -- 172.21.15.80:0/3561527809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab4109430 msgr2=0x7fdab41098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:16.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.498+0000 7fdab9487700 1 --2- 172.21.15.80:0/3561527809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab4109430 0x7fdab41098b0 secure :-1 s=READY pgs=2337 cs=0 l=1 rx=0x7fdaac010410 tx=0x7fdaac010270).stop 2019-11-28T11:53:16.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.498+0000 7fdab9487700 1 -- 172.21.15.80:0/3561527809 shutdown_connections 2019-11-28T11:53:16.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.498+0000 7fdab9487700 1 --2- 172.21.15.80:0/3561527809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdab4109430 0x7fdab41098b0 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:16.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.498+0000 7fdab9487700 1 --2- 172.21.15.80:0/3561527809 >> v2:172.21.15.174:3300/0 conn(0x7fdab413e9e0 0x7fdab4108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:16.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.498+0000 7fdab9487700 1 --2- 172.21.15.80:0/3561527809 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fda8c018730 0x7fda8c01abc0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:16.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.498+0000 7fdab9487700 1 -- 172.21.15.80:0/3561527809 shutdown_connections 2019-11-28T11:53:16.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.498+0000 7fdab9487700 1 -- 172.21.15.80:0/3561527809 wait complete. 2019-11-28T11:53:16.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:16.498+0000 7fdab9487700 1 -- 172.21.15.80:0/3561527809 >> 172.21.15.80:0/3561527809 conn(0x7fdab413d620 msgr2=0x7fdab413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:16.563 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:17.564 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:17.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.628+0000 7faabbf36700 1 Processor -- start 2019-11-28T11:53:17.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.628+0000 7faabbf36700 1 -- start start 2019-11-28T11:53:17.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.629+0000 7faabbf36700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faab406c490 0x7faab406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:17.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.629+0000 7faabbf36700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab406ce60 0x7faab4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:17.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.629+0000 7faabbf36700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab406db00 con 0x7faab406c0a0 2019-11-28T11:53:17.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.629+0000 7faabbf36700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab406fd60 con 0x7faab406c490 2019-11-28T11:53:17.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.629+0000 7faabbf36700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab4070030 con 0x7faab406ce60 2019-11-28T11:53:17.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.629+0000 7faab9cd2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faab406c490 0x7faab406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:17.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.629+0000 7faab9cd2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faab406c490 0x7faab406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43838/0 (socket says 172.21.15.80:43838) 2019-11-28T11:53:17.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.629+0000 7faab9cd2700 1 -- 172.21.15.80:0/1094713712 learned_addr learned my addr 172.21.15.80:0/1094713712 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:17.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.629+0000 7faabacd4700 1 --2- 172.21.15.80:0/1094713712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab406ce60 0x7faab4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:17.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.629+0000 7faab9cd2700 1 -- 172.21.15.80:0/1094713712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab406ce60 msgr2=0x7faab4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:17.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.629+0000 7faab9cd2700 1 --2- 172.21.15.80:0/1094713712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab406ce60 0x7faab4164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.630+0000 7faab9cd2700 1 -- 172.21.15.80:0/1094713712 >> v1:172.21.15.174:6789/0 conn(0x7faab406c0a0 legacy=0x7faab4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.630+0000 7faab9cd2700 1 -- 172.21.15.80:0/1094713712 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab40706c0 con 0x7faab406c490 2019-11-28T11:53:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.630+0000 7faabacd4700 1 --2- 172.21.15.80:0/1094713712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab406ce60 0x7faab4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:53:17.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.630+0000 7faab9cd2700 1 --2- 172.21.15.80:0/1094713712 >> v2:172.21.15.80:3300/0 conn(0x7faab406c490 0x7faab406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faaac00fac0 tx=0x7faaac00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:17.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.630+0000 7faab9cd2700 1 --2- 172.21.15.80:0/1094713712 >> v2:172.21.15.80:3300/0 conn(0x7faab406c490 0x7faab406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faaac00fac0 tx=0x7faaac00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:17.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.630+0000 7faab9cd2700 1 --2- 172.21.15.80:0/1094713712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab406c490 0x7faab406c920 secure :-1 s=READY pgs=2338 cs=0 l=1 rx=0x7faaac00fac0 tx=0x7faaac00fe60).ready entity=mon.0 client_cookie=777196b126f42693 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:17.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.630+0000 7faab9cd2700 1 --2- 172.21.15.80:0/1094713712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab406c490 0x7faab406c920 secure :-1 s=THROTTLE_DONE pgs=2338 cs=0 l=1 rx=0x7faaac00fac0 tx=0x7faaac00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:17.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.630+0000 7faab9cd2700 1 --2- 172.21.15.80:0/1094713712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab406c490 0x7faab406c920 secure :-1 s=THROTTLE_DONE pgs=2338 cs=0 l=1 rx=0x7faaac00fac0 tx=0x7faaac00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:17.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.630+0000 7faab9cd2700 1 --2- 172.21.15.80:0/1094713712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab406c490 0x7faab406c920 secure :-1 s=THROTTLE_DONE pgs=2338 cs=0 l=1 rx=0x7faaac00fac0 tx=0x7faaac00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.630+0000 7faab94d1700 1 -- 172.21.15.80:0/1094713712 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaac000ce0 con 0x7faab406c490 2019-11-28T11:53:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.630+0000 7faab94d1700 1 -- 172.21.15.80:0/1094713712 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac001010 con 0x7faab406c490 2019-11-28T11:53:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.630+0000 7faab94d1700 1 -- 172.21.15.80:0/1094713712 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaac001720 con 0x7faab406c490 2019-11-28T11:53:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.630+0000 7faabbf36700 1 -- 172.21.15.80:0/1094713712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab406c490 msgr2=0x7faab406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.630+0000 7faabbf36700 1 --2- 172.21.15.80:0/1094713712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab406c490 0x7faab406c920 secure :-1 s=READY pgs=2338 cs=0 l=1 rx=0x7faaac00fac0 tx=0x7faaac00fe60).stop 2019-11-28T11:53:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.631+0000 7faabbf36700 1 -- 172.21.15.80:0/1094713712 shutdown_connections 2019-11-28T11:53:17.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.631+0000 7faabbf36700 1 --2- 172.21.15.80:0/1094713712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab406ce60 0x7faab4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:17.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.631+0000 7faabbf36700 1 --2- 172.21.15.80:0/1094713712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab406c490 0x7faab406c920 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:17.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.631+0000 7faabbf36700 1 -- 172.21.15.80:0/1094713712 shutdown_connections 2019-11-28T11:53:17.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.631+0000 7faabbf36700 1 -- 172.21.15.80:0/1094713712 wait complete. 2019-11-28T11:53:17.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.631+0000 7faabbf36700 1 -- 172.21.15.80:0/1094713712 >> 172.21.15.80:0/1094713712 conn(0x7faab4061cf0 msgr2=0x7faab4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:17.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.633+0000 7faabbf36700 1 Processor -- start 2019-11-28T11:53:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.633+0000 7faabbf36700 1 -- start start 2019-11-28T11:53:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.634+0000 7faabbf36700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faab4104d10 0x7faab410e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.634+0000 7faabbf36700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faab413eaf0 0x7faab412c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.634+0000 7faabbf36700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab4135c60 con 0x7faab410e670 2019-11-28T11:53:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.634+0000 7faabbf36700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab4141e60 con 0x7faab413eaf0 2019-11-28T11:53:17.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.634+0000 7faabbf36700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab4107cb0 con 0x7faab4104d10 2019-11-28T11:53:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.634+0000 7faab9cd2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faab410e670 0x7faab413e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43156/0 (socket says 172.21.15.80:43156) 2019-11-28T11:53:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.634+0000 7faab9cd2700 1 -- 172.21.15.80:0/2220340400 learned_addr learned my addr 172.21.15.80:0/2220340400 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.634+0000 7faabacd4700 1 --2- 172.21.15.80:0/2220340400 >> v2:172.21.15.80:3300/0 conn(0x7faab413eaf0 0x7faab412c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.634+0000 7faaba4d3700 1 --2- 172.21.15.80:0/2220340400 >> v2:172.21.15.174:3300/0 conn(0x7faab4104d10 0x7faab410e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.634+0000 7faab2ffd700 1 -- 172.21.15.80:0/2220340400 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310184989 0 0) 0x7faaac008120 con 0x7faab410e670 2019-11-28T11:53:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.634+0000 7faab2ffd700 1 -- 172.21.15.80:0/2220340400 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa98002e80 con 0x7faab410e670 2019-11-28T11:53:17.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.634+0000 7faabacd4700 1 -- 172.21.15.80:0/2220340400 >> v2:172.21.15.174:3300/0 conn(0x7faab4104d10 msgr2=0x7faab410e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:17.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.634+0000 7faabacd4700 1 --2- 172.21.15.80:0/2220340400 >> v2:172.21.15.174:3300/0 conn(0x7faab4104d10 0x7faab410e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:17.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.634+0000 7faabacd4700 1 -- 172.21.15.80:0/2220340400 >> v1:172.21.15.80:6789/0 conn(0x7faab410e670 legacy=0x7faab413e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:17.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.634+0000 7faabacd4700 1 -- 172.21.15.80:0/2220340400 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab41424f0 con 0x7faab413eaf0 2019-11-28T11:53:17.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.634+0000 7faabacd4700 1 --2- 172.21.15.80:0/2220340400 >> v2:172.21.15.80:3300/0 conn(0x7faab413eaf0 0x7faab412c410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faa9c0103c0 tx=0x7faa9c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:17.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.635+0000 7faabacd4700 1 --2- 172.21.15.80:0/2220340400 >> v2:172.21.15.80:3300/0 conn(0x7faab413eaf0 0x7faab412c410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faa9c0103c0 tx=0x7faa9c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:17.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.635+0000 7faabacd4700 1 --2- 172.21.15.80:0/2220340400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab413eaf0 0x7faab412c410 secure :-1 s=READY pgs=2340 cs=0 l=1 rx=0x7faa9c0103c0 tx=0x7faa9c0101c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:17.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.635+0000 7faabacd4700 1 --2- 172.21.15.80:0/2220340400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab413eaf0 0x7faab412c410 secure :-1 s=THROTTLE_DONE pgs=2340 cs=0 l=1 rx=0x7faa9c0103c0 tx=0x7faa9c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:17.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.635+0000 7faabacd4700 1 --2- 172.21.15.80:0/2220340400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab413eaf0 0x7faab412c410 secure :-1 s=THROTTLE_DONE pgs=2340 cs=0 l=1 rx=0x7faa9c0103c0 tx=0x7faa9c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:17.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.635+0000 7faab2ffd700 1 -- 172.21.15.80:0/2220340400 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa9c009bd0 con 0x7faab413eaf0 2019-11-28T11:53:17.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.635+0000 7faabacd4700 1 --2- 172.21.15.80:0/2220340400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab413eaf0 0x7faab412c410 secure :-1 s=THROTTLE_DONE pgs=2340 cs=0 l=1 rx=0x7faa9c0103c0 tx=0x7faa9c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:17.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.635+0000 7faab2ffd700 1 -- 172.21.15.80:0/2220340400 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c0097f0 con 0x7faab413eaf0 2019-11-28T11:53:17.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.635+0000 7faabbf36700 1 -- 172.21.15.80:0/2220340400 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab41424f0 con 0x7faab413eaf0 2019-11-28T11:53:17.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.635+0000 7faab2ffd700 1 -- 172.21.15.80:0/2220340400 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa9c00a1b0 con 0x7faab413eaf0 2019-11-28T11:53:17.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.635+0000 7faabbf36700 1 -- 172.21.15.80:0/2220340400 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab41424f0 con 0x7faab413eaf0 2019-11-28T11:53:17.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.635+0000 7faabacd4700 1 --2- 172.21.15.80:0/2220340400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab413eaf0 0x7faab412c410 secure :-1 s=THROTTLE_DONE pgs=2340 cs=0 l=1 rx=0x7faa9c0103c0 tx=0x7faa9c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:17.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.635+0000 7faab2ffd700 1 -- 172.21.15.80:0/2220340400 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7faa9c000b10 con 0x7faab413eaf0 2019-11-28T11:53:17.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.635+0000 7faabacd4700 1 --2- 172.21.15.80:0/2220340400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab413eaf0 0x7faab412c410 secure :-1 s=THROTTLE_DONE pgs=2340 cs=0 l=1 rx=0x7faa9c0103c0 tx=0x7faa9c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:17.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.635+0000 7faab2ffd700 1 --2- 172.21.15.80:0/2220340400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa98018770 0x7faa9801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:17.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.636+0000 7faab2ffd700 1 -- 172.21.15.80:0/2220340400 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7faa9c0319f0 con 0x7faab413eaf0 2019-11-28T11:53:17.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.636+0000 7faaba4d3700 1 --2- 172.21.15.80:0/2220340400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa98018770 0x7faa9801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:17.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.636+0000 7faaba4d3700 1 --2- 172.21.15.80:0/2220340400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa98018770 0x7faa9801abe0 crc :-1 s=READY pgs=966 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:17.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.643+0000 7faabbf36700 1 -- 172.21.15.80:0/2220340400 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab41424f0 con 0x7faab413eaf0 2019-11-28T11:53:17.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.647+0000 7faabacd4700 1 --2- 172.21.15.80:0/2220340400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab413eaf0 0x7faab412c410 secure :-1 s=THROTTLE_DONE pgs=2340 cs=0 l=1 rx=0x7faa9c0103c0 tx=0x7faa9c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:17.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.647+0000 7faab2ffd700 1 -- 172.21.15.80:0/2220340400 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7faa9c0095e0 con 0x7faab413eaf0 2019-11-28T11:53:17.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.817+0000 7faabbf36700 1 -- 172.21.15.80:0/2220340400 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faab41424f0 con 0x7faab413eaf0 2019-11-28T11:53:17.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.818+0000 7faabacd4700 1 --2- 172.21.15.80:0/2220340400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab413eaf0 0x7faab412c410 secure :-1 s=THROTTLE_DONE pgs=2340 cs=0 l=1 rx=0x7faa9c0103c0 tx=0x7faa9c0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:17.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.818+0000 7faab2ffd700 1 -- 172.21.15.80:0/2220340400 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7faa9c001480 con 0x7faab413eaf0 2019-11-28T11:53:17.873 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:17.874 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:17.874 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:17.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.820+0000 7faabbf36700 1 -- 172.21.15.80:0/2220340400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa98018770 msgr2=0x7faa9801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:17.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.820+0000 7faabbf36700 1 --2- 172.21.15.80:0/2220340400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa98018770 0x7faa9801abe0 crc :-1 s=READY pgs=966 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:17.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.820+0000 7faabbf36700 1 -- 172.21.15.80:0/2220340400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab413eaf0 msgr2=0x7faab412c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:17.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.820+0000 7faabbf36700 1 --2- 172.21.15.80:0/2220340400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab413eaf0 0x7faab412c410 secure :-1 s=READY pgs=2340 cs=0 l=1 rx=0x7faa9c0103c0 tx=0x7faa9c0101c0).stop 2019-11-28T11:53:17.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.820+0000 7faabbf36700 1 -- 172.21.15.80:0/2220340400 shutdown_connections 2019-11-28T11:53:17.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.820+0000 7faabbf36700 1 --2- 172.21.15.80:0/2220340400 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa98018770 0x7faa9801abe0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:17.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.820+0000 7faabbf36700 1 --2- 172.21.15.80:0/2220340400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faab413eaf0 0x7faab412c410 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:17.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.820+0000 7faabbf36700 1 --2- 172.21.15.80:0/2220340400 >> v2:172.21.15.174:3300/0 conn(0x7faab4104d10 0x7faab410e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:17.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.820+0000 7faabbf36700 1 -- 172.21.15.80:0/2220340400 shutdown_connections 2019-11-28T11:53:17.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.821+0000 7faabbf36700 1 -- 172.21.15.80:0/2220340400 wait complete. 2019-11-28T11:53:17.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:17.821+0000 7faabbf36700 1 -- 172.21.15.80:0/2220340400 >> 172.21.15.80:0/2220340400 conn(0x7faab415e210 msgr2=0x7faab410b140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:17.885 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:18.886 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:19.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.955+0000 7f1accb78700 1 Processor -- start 2019-11-28T11:53:19.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.955+0000 7f1accb78700 1 -- start start 2019-11-28T11:53:19.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.956+0000 7f1accb78700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac806c0a0 0x7f1ac8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:19.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.956+0000 7f1accb78700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1ac8072620 0x7f1ac8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:19.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.956+0000 7f1accb78700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac806db00 con 0x7f1ac80734e0 2019-11-28T11:53:19.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.956+0000 7f1accb78700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac806f330 con 0x7f1ac8072620 2019-11-28T11:53:19.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.956+0000 7f1accb78700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac80706c0 con 0x7f1ac806c0a0 2019-11-28T11:53:19.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.956+0000 7f1ac759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1ac8072620 0x7f1ac8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:19.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.956+0000 7f1ac759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1ac8072620 0x7f1ac8164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43852/0 (socket says 172.21.15.80:43852) 2019-11-28T11:53:19.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.956+0000 7f1ac759e700 1 -- 172.21.15.80:0/2111845292 learned_addr learned my addr 172.21.15.80:0/2111845292 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:19.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.956+0000 7f1ac6d9d700 1 --2- 172.21.15.80:0/2111845292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac806c0a0 0x7f1ac8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:19.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.957+0000 7f1ac759e700 1 -- 172.21.15.80:0/2111845292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac806c0a0 msgr2=0x7f1ac8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:19.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.957+0000 7f1ac759e700 1 --2- 172.21.15.80:0/2111845292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac806c0a0 0x7f1ac8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:19.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.957+0000 7f1ac759e700 1 -- 172.21.15.80:0/2111845292 >> v1:172.21.15.80:6789/0 conn(0x7f1ac80734e0 legacy=0x7f1ac8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:19.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.957+0000 7f1ac759e700 1 -- 172.21.15.80:0/2111845292 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac8070a40 con 0x7f1ac8072620 2019-11-28T11:53:19.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.957+0000 7f1ac759e700 1 --2- 172.21.15.80:0/2111845292 >> v2:172.21.15.80:3300/0 conn(0x7f1ac8072620 0x7f1ac8164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1ac000f730 tx=0x7f1ac0007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:19.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.957+0000 7f1ac759e700 1 --2- 172.21.15.80:0/2111845292 >> v2:172.21.15.80:3300/0 conn(0x7f1ac8072620 0x7f1ac8164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1ac000f730 tx=0x7f1ac0007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:19.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.957+0000 7f1ac759e700 1 --2- 172.21.15.80:0/2111845292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac8072620 0x7f1ac8164d70 secure :-1 s=READY pgs=2342 cs=0 l=1 rx=0x7f1ac000f730 tx=0x7f1ac0007d50).ready entity=mon.0 client_cookie=1375d48aebd2e6cb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:19.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.958+0000 7f1ac759e700 1 --2- 172.21.15.80:0/2111845292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac8072620 0x7f1ac8164d70 secure :-1 s=THROTTLE_DONE pgs=2342 cs=0 l=1 rx=0x7f1ac000f730 tx=0x7f1ac0007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:19.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.958+0000 7f1ac759e700 1 --2- 172.21.15.80:0/2111845292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac8072620 0x7f1ac8164d70 secure :-1 s=THROTTLE_DONE pgs=2342 cs=0 l=1 rx=0x7f1ac000f730 tx=0x7f1ac0007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:19.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.958+0000 7f1ac759e700 1 --2- 172.21.15.80:0/2111845292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac8072620 0x7f1ac8164d70 secure :-1 s=THROTTLE_DONE pgs=2342 cs=0 l=1 rx=0x7f1ac000f730 tx=0x7f1ac0007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:19.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.958+0000 7f1ac5d9b700 1 -- 172.21.15.80:0/2111845292 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac0000a70 con 0x7f1ac8072620 2019-11-28T11:53:19.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.958+0000 7f1ac5d9b700 1 -- 172.21.15.80:0/2111845292 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac00010e0 con 0x7f1ac8072620 2019-11-28T11:53:19.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.958+0000 7f1ac5d9b700 1 -- 172.21.15.80:0/2111845292 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac00017b0 con 0x7f1ac8072620 2019-11-28T11:53:19.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.958+0000 7f1accb78700 1 -- 172.21.15.80:0/2111845292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac8072620 msgr2=0x7f1ac8164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:19.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.958+0000 7f1accb78700 1 --2- 172.21.15.80:0/2111845292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac8072620 0x7f1ac8164d70 secure :-1 s=READY pgs=2342 cs=0 l=1 rx=0x7f1ac000f730 tx=0x7f1ac0007d50).stop 2019-11-28T11:53:19.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.959+0000 7f1accb78700 1 -- 172.21.15.80:0/2111845292 shutdown_connections 2019-11-28T11:53:19.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.959+0000 7f1accb78700 1 --2- 172.21.15.80:0/2111845292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac8072620 0x7f1ac8164d70 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:19.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.959+0000 7f1accb78700 1 --2- 172.21.15.80:0/2111845292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac806c0a0 0x7f1ac8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:19.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.959+0000 7f1accb78700 1 -- 172.21.15.80:0/2111845292 shutdown_connections 2019-11-28T11:53:19.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.959+0000 7f1accb78700 1 -- 172.21.15.80:0/2111845292 wait complete. 2019-11-28T11:53:19.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.959+0000 7f1accb78700 1 -- 172.21.15.80:0/2111845292 >> 172.21.15.80:0/2111845292 conn(0x7f1ac8061cf0 msgr2=0x7f1ac8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:19.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.961+0000 7f1accb78700 1 Processor -- start 2019-11-28T11:53:19.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.961+0000 7f1accb78700 1 -- start start 2019-11-28T11:53:19.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.962+0000 7f1accb78700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac8104c10 0x7f1ac81050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:19.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.962+0000 7f1accb78700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1ac81055e0 0x7f1ac8167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:19.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.962+0000 7f1accb78700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac8105a30 con 0x7f1ac8104820 2019-11-28T11:53:19.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.962+0000 7f1accb78700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac8109130 con 0x7f1ac81055e0 2019-11-28T11:53:19.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.962+0000 7f1accb78700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac8109400 con 0x7f1ac8104c10 2019-11-28T11:53:19.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.962+0000 7f1ac759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1ac81055e0 0x7f1ac8167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:19.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.962+0000 7f1ac759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1ac81055e0 0x7f1ac8167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43856/0 (socket says 172.21.15.80:43856) 2019-11-28T11:53:19.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.962+0000 7f1ac759e700 1 -- 172.21.15.80:0/3670585388 learned_addr learned my addr 172.21.15.80:0/3670585388 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:19.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1ac659c700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac8104c10 0x7f1ac81050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:19.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1ac759e700 1 -- 172.21.15.80:0/3670585388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac8104c10 msgr2=0x7f1ac81050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:19.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1ac759e700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac8104c10 0x7f1ac81050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:19.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1ac759e700 1 -- 172.21.15.80:0/3670585388 >> v1:172.21.15.80:6789/0 conn(0x7f1ac8104820 legacy=0x7f1ac810c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:19.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1ac759e700 1 -- 172.21.15.80:0/3670585388 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac8109a90 con 0x7f1ac81055e0 2019-11-28T11:53:19.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1abf7fe700 1 -- 172.21.15.80:0/3670585388 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259422228 0 0) 0x7f1ab0001430 con 0x7f1ac8104820 2019-11-28T11:53:19.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1ac759e700 1 --2- 172.21.15.80:0/3670585388 >> v2:172.21.15.80:3300/0 conn(0x7f1ac81055e0 0x7f1ac8167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1ac0010440 tx=0x7f1ac00107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:19.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1ac659c700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac8104c10 0x7f1ac81050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:53:19.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1ac759e700 1 --2- 172.21.15.80:0/3670585388 >> v2:172.21.15.80:3300/0 conn(0x7f1ac81055e0 0x7f1ac8167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1ac0010440 tx=0x7f1ac00107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:19.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1ac759e700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac81055e0 0x7f1ac8167a10 secure :-1 s=READY pgs=2344 cs=0 l=1 rx=0x7f1ac0010440 tx=0x7f1ac00107e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:19.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1ac759e700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac81055e0 0x7f1ac8167a10 secure :-1 s=THROTTLE_DONE pgs=2344 cs=0 l=1 rx=0x7f1ac0010440 tx=0x7f1ac00107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:19.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1abf7fe700 1 -- 172.21.15.80:0/3670585388 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac00012b0 con 0x7f1ac81055e0 2019-11-28T11:53:19.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1ac759e700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac81055e0 0x7f1ac8167a10 secure :-1 s=THROTTLE_DONE pgs=2344 cs=0 l=1 rx=0x7f1ac0010440 tx=0x7f1ac00107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:19.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1ac759e700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac81055e0 0x7f1ac8167a10 secure :-1 s=THROTTLE_DONE pgs=2344 cs=0 l=1 rx=0x7f1ac0010440 tx=0x7f1ac00107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:19.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1abf7fe700 1 -- 172.21.15.80:0/3670585388 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac0008180 con 0x7f1ac81055e0 2019-11-28T11:53:19.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1accb78700 1 -- 172.21.15.80:0/3670585388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac8109e10 con 0x7f1ac81055e0 2019-11-28T11:53:19.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1abf7fe700 1 -- 172.21.15.80:0/3670585388 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac0007ca0 con 0x7f1ac81055e0 2019-11-28T11:53:19.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1accb78700 1 -- 172.21.15.80:0/3670585388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac8109a90 con 0x7f1ac81055e0 2019-11-28T11:53:19.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.963+0000 7f1ac759e700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac81055e0 0x7f1ac8167a10 secure :-1 s=THROTTLE_DONE pgs=2344 cs=0 l=1 rx=0x7f1ac0010440 tx=0x7f1ac00107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:19.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.964+0000 7f1abf7fe700 1 -- 172.21.15.80:0/3670585388 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1ac00010c0 con 0x7f1ac81055e0 2019-11-28T11:53:19.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.964+0000 7f1ac759e700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac81055e0 0x7f1ac8167a10 secure :-1 s=THROTTLE_DONE pgs=2344 cs=0 l=1 rx=0x7f1ac0010440 tx=0x7f1ac00107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:19.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.964+0000 7f1abf7fe700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1aa0018730 0x7f1aa001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:19.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.964+0000 7f1abf7fe700 1 -- 172.21.15.80:0/3670585388 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f1ac0031a70 con 0x7f1ac81055e0 2019-11-28T11:53:19.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.964+0000 7f1ac6d9d700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1aa0018730 0x7f1aa001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:19.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.964+0000 7f1ac6d9d700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1aa0018730 0x7f1aa001abc0 crc :-1 s=READY pgs=967 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:19.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.970+0000 7f1accb78700 1 -- 172.21.15.80:0/3670585388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac8109e10 con 0x7f1ac81055e0 2019-11-28T11:53:19.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.974+0000 7f1ac759e700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac81055e0 0x7f1ac8167a10 secure :-1 s=THROTTLE_DONE pgs=2344 cs=0 l=1 rx=0x7f1ac0010440 tx=0x7f1ac00107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:19.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:18.974+0000 7f1abf7fe700 1 -- 172.21.15.80:0/3670585388 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1ac0030770 con 0x7f1ac81055e0 2019-11-28T11:53:19.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:19.146+0000 7f1accb78700 1 -- 172.21.15.80:0/3670585388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ac8109a90 con 0x7f1ac81055e0 2019-11-28T11:53:19.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:19.146+0000 7f1ac759e700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac81055e0 0x7f1ac8167a10 secure :-1 s=THROTTLE_DONE pgs=2344 cs=0 l=1 rx=0x7f1ac0010440 tx=0x7f1ac00107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:19.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:19.146+0000 7f1abf7fe700 1 -- 172.21.15.80:0/3670585388 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f1ac0030770 con 0x7f1ac81055e0 2019-11-28T11:53:19.218 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:19.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:19.149+0000 7f1accb78700 1 -- 172.21.15.80:0/3670585388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1aa0018730 msgr2=0x7f1aa001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:19.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:19.149+0000 7f1accb78700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1aa0018730 0x7f1aa001abc0 crc :-1 s=READY pgs=967 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:19.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:19.149+0000 7f1accb78700 1 -- 172.21.15.80:0/3670585388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac81055e0 msgr2=0x7f1ac8167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:19.149+0000 7f1accb78700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac81055e0 0x7f1ac8167a10 secure :-1 s=READY pgs=2344 cs=0 l=1 rx=0x7f1ac0010440 tx=0x7f1ac00107e0).stop 2019-11-28T11:53:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:19.149+0000 7f1accb78700 1 -- 172.21.15.80:0/3670585388 shutdown_connections 2019-11-28T11:53:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:19.149+0000 7f1accb78700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1aa0018730 0x7f1aa001abc0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:19.149+0000 7f1accb78700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1ac81055e0 0x7f1ac8167a10 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:19.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:19.149+0000 7f1accb78700 1 --2- 172.21.15.80:0/3670585388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ac8104c10 0x7f1ac81050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:19.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:19.149+0000 7f1accb78700 1 -- 172.21.15.80:0/3670585388 shutdown_connections 2019-11-28T11:53:19.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:19.149+0000 7f1accb78700 1 -- 172.21.15.80:0/3670585388 wait complete. 2019-11-28T11:53:19.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:19.149+0000 7f1accb78700 1 -- 172.21.15.80:0/3670585388 >> 172.21.15.80:0/3670585388 conn(0x7f1ac813d620 msgr2=0x7f1ac813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:19.220 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:19.221 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:19.222 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:20.222 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:20.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.291+0000 7f9101dab700 1 Processor -- start 2019-11-28T11:53:20.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.291+0000 7f9101dab700 1 -- start start 2019-11-28T11:53:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.292+0000 7f9101dab700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90fc06c0a0 0x7f90fc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.292+0000 7f9101dab700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90fc06db00 con 0x7f90fc072620 2019-11-28T11:53:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.292+0000 7f9101dab700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90fc06e000 con 0x7f90fc0734e0 2019-11-28T11:53:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.292+0000 7f9101dab700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90fc06fd60 con 0x7f90fc06c0a0 2019-11-28T11:53:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.292+0000 7f90fbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90fc06c0a0 0x7f90fc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:20.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.293+0000 7f90fbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90fc06c0a0 0x7f90fc072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43862/0 (socket says 172.21.15.80:43862) 2019-11-28T11:53:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.293+0000 7f90fbfff700 1 -- 172.21.15.80:0/573444176 learned_addr learned my addr 172.21.15.80:0/573444176 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.293+0000 7f90fbfff700 1 -- 172.21.15.80:0/573444176 >> v1:172.21.15.174:6789/0 conn(0x7f90fc0734e0 legacy=0x7f90fc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.293+0000 7f90fbfff700 1 -- 172.21.15.80:0/573444176 >> v1:172.21.15.80:6789/0 conn(0x7f90fc072620 legacy=0x7f90fc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.293+0000 7f90fbfff700 1 -- 172.21.15.80:0/573444176 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90fc0706c0 con 0x7f90fc06c0a0 2019-11-28T11:53:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.293+0000 7f90fbfff700 1 --2- 172.21.15.80:0/573444176 >> v2:172.21.15.80:3300/0 conn(0x7f90fc06c0a0 0x7f90fc072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f90ec00f740 tx=0x7f90ec00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.293+0000 7f90fbfff700 1 --2- 172.21.15.80:0/573444176 >> v2:172.21.15.80:3300/0 conn(0x7f90fc06c0a0 0x7f90fc072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f90ec00f740 tx=0x7f90ec00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:20.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.293+0000 7f90fbfff700 1 --2- 172.21.15.80:0/573444176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90fc06c0a0 0x7f90fc072fa0 secure :-1 s=READY pgs=2346 cs=0 l=1 rx=0x7f90ec00f740 tx=0x7f90ec00fae0).ready entity=mon.0 client_cookie=8015cf53af67f790 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.293+0000 7f90fbfff700 1 --2- 172.21.15.80:0/573444176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90fc06c0a0 0x7f90fc072fa0 secure :-1 s=THROTTLE_DONE pgs=2346 cs=0 l=1 rx=0x7f90ec00f740 tx=0x7f90ec00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.293+0000 7f90fbfff700 1 --2- 172.21.15.80:0/573444176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90fc06c0a0 0x7f90fc072fa0 secure :-1 s=THROTTLE_DONE pgs=2346 cs=0 l=1 rx=0x7f90ec00f740 tx=0x7f90ec00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.293+0000 7f90fbfff700 1 --2- 172.21.15.80:0/573444176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90fc06c0a0 0x7f90fc072fa0 secure :-1 s=THROTTLE_DONE pgs=2346 cs=0 l=1 rx=0x7f90ec00f740 tx=0x7f90ec00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.293+0000 7f90fb7fe700 1 -- 172.21.15.80:0/573444176 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90ec000960 con 0x7f90fc06c0a0 2019-11-28T11:53:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.293+0000 7f90fb7fe700 1 -- 172.21.15.80:0/573444176 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec000c90 con 0x7f90fc06c0a0 2019-11-28T11:53:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.293+0000 7f90fb7fe700 1 -- 172.21.15.80:0/573444176 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90ec001360 con 0x7f90fc06c0a0 2019-11-28T11:53:20.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.293+0000 7f9101dab700 1 -- 172.21.15.80:0/573444176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90fc06c0a0 msgr2=0x7f90fc072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.293+0000 7f9101dab700 1 --2- 172.21.15.80:0/573444176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90fc06c0a0 0x7f90fc072fa0 secure :-1 s=READY pgs=2346 cs=0 l=1 rx=0x7f90ec00f740 tx=0x7f90ec00fae0).stop 2019-11-28T11:53:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.294+0000 7f9101dab700 1 -- 172.21.15.80:0/573444176 shutdown_connections 2019-11-28T11:53:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.294+0000 7f9101dab700 1 --2- 172.21.15.80:0/573444176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90fc06c0a0 0x7f90fc072fa0 unknown :-1 s=CLOSED pgs=2346 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.294+0000 7f9101dab700 1 -- 172.21.15.80:0/573444176 shutdown_connections 2019-11-28T11:53:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.294+0000 7f9101dab700 1 -- 172.21.15.80:0/573444176 wait complete. 2019-11-28T11:53:20.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.294+0000 7f9101dab700 1 -- 172.21.15.80:0/573444176 >> 172.21.15.80:0/573444176 conn(0x7f90fc061cf0 msgr2=0x7f90fc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:20.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.296+0000 7f9101dab700 1 Processor -- start 2019-11-28T11:53:20.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.296+0000 7f9101dab700 1 -- start start 2019-11-28T11:53:20.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.297+0000 7f9101dab700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90fc1346b0 0x7f90fc135040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:20.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.297+0000 7f9101dab700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90fc13f410 con 0x7f90fc1342c0 2019-11-28T11:53:20.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.297+0000 7f9101dab700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90fc12ed00 con 0x7f90fc135580 2019-11-28T11:53:20.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.297+0000 7f9101dab700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc141670 con 0x7f90fc1346b0 2019-11-28T11:53:20.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.297+0000 7f90fbfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f90fc1342c0 0x7f90fc1361c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43182/0 (socket says 172.21.15.80:43182) 2019-11-28T11:53:20.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.297+0000 7f90fbfff700 1 -- 172.21.15.80:0/1265552345 learned_addr learned my addr 172.21.15.80:0/1265552345 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:20.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.297+0000 7f90f3fff700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90fc1346b0 0x7f90fc135040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:20.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.297+0000 7f90f97fa700 1 -- 172.21.15.80:0/1265552345 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258340770 0 0) 0x7f90ec0075d0 con 0x7f90fc1342c0 2019-11-28T11:53:20.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.297+0000 7f90f97fa700 1 -- 172.21.15.80:0/1265552345 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d4002e80 con 0x7f90fc1342c0 2019-11-28T11:53:20.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f97fa700 1 -- 172.21.15.80:0/1265552345 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254045624 0 0) 0x7f90f40011a0 con 0x7f90fc135580 2019-11-28T11:53:20.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f97fa700 1 -- 172.21.15.80:0/1265552345 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d40030b0 con 0x7f90fc135580 2019-11-28T11:53:20.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f97fa700 1 -- 172.21.15.80:0/1265552345 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 269693332 0 0) 0x7f90ec0079e0 con 0x7f90fc1342c0 2019-11-28T11:53:20.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f97fa700 1 -- 172.21.15.80:0/1265552345 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f90d4004680 con 0x7f90fc1342c0 2019-11-28T11:53:20.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f97fa700 1 -- 172.21.15.80:0/1265552345 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f90ec000940 con 0x7f90fc1342c0 2019-11-28T11:53:20.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f3fff700 1 -- 172.21.15.80:0/1265552345 >> v1:172.21.15.174:6789/0 conn(0x7f90fc135580 legacy=0x7f90fc1ac5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:20.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f3fff700 1 -- 172.21.15.80:0/1265552345 >> v1:172.21.15.80:6789/0 conn(0x7f90fc1342c0 legacy=0x7f90fc1361c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:20.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f3fff700 1 -- 172.21.15.80:0/1265552345 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90fc141fd0 con 0x7f90fc1346b0 2019-11-28T11:53:20.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f3fff700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90fc1346b0 0x7f90fc135040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f90e40103a0 tx=0x7f90e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:20.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f3fff700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90fc1346b0 0x7f90fc135040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f90e40103a0 tx=0x7f90e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:20.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f3fff700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90fc1346b0 0x7f90fc135040 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7f90e40103a0 tx=0x7f90e4010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:20.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f3fff700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90fc1346b0 0x7f90fc135040 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f90e40103a0 tx=0x7f90e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:20.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f97fa700 1 -- 172.21.15.80:0/1265552345 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90e4000960 con 0x7f90fc1346b0 2019-11-28T11:53:20.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f3fff700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90fc1346b0 0x7f90fc135040 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f90e40103a0 tx=0x7f90e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:20.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f97fa700 1 -- 172.21.15.80:0/1265552345 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e400eef0 con 0x7f90fc1346b0 2019-11-28T11:53:20.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f3fff700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90fc1346b0 0x7f90fc135040 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f90e40103a0 tx=0x7f90e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:20.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f9101dab700 1 -- 172.21.15.80:0/1265552345 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90fc142350 con 0x7f90fc1346b0 2019-11-28T11:53:20.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f90f97fa700 1 -- 172.21.15.80:0/1265552345 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90e4000960 con 0x7f90fc1346b0 2019-11-28T11:53:20.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.298+0000 7f9101dab700 1 -- 172.21.15.80:0/1265552345 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90fc141fd0 con 0x7f90fc1346b0 2019-11-28T11:53:20.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.299+0000 7f90f3fff700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90fc1346b0 0x7f90fc135040 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f90e40103a0 tx=0x7f90e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:20.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.299+0000 7f90f3fff700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90fc1346b0 0x7f90fc135040 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f90e40103a0 tx=0x7f90e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:20.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.299+0000 7f90f97fa700 1 -- 172.21.15.80:0/1265552345 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f90e400f500 con 0x7f90fc1346b0 2019-11-28T11:53:20.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.299+0000 7f90f97fa700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90d4018770 0x7f90d401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:20.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.299+0000 7f90f97fa700 1 -- 172.21.15.80:0/1265552345 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f90e4031a50 con 0x7f90fc1346b0 2019-11-28T11:53:20.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.299+0000 7f90fbfff700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90d4018770 0x7f90d401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:20.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.299+0000 7f90fbfff700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90d4018770 0x7f90d401abe0 crc :-1 s=READY pgs=968 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:20.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.306+0000 7f9101dab700 1 -- 172.21.15.80:0/1265552345 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90fc142350 con 0x7f90fc1346b0 2019-11-28T11:53:20.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.310+0000 7f90f3fff700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90fc1346b0 0x7f90fc135040 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f90e40103a0 tx=0x7f90e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:20.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.310+0000 7f90f97fa700 1 -- 172.21.15.80:0/1265552345 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f90e400f2d0 con 0x7f90fc1346b0 2019-11-28T11:53:20.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.484+0000 7f9101dab700 1 -- 172.21.15.80:0/1265552345 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90fc141fd0 con 0x7f90fc1346b0 2019-11-28T11:53:20.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.485+0000 7f90f3fff700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90fc1346b0 0x7f90fc135040 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f90e40103a0 tx=0x7f90e4010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:20.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.485+0000 7f90f97fa700 1 -- 172.21.15.80:0/1265552345 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f90e400f4e0 con 0x7f90fc1346b0 2019-11-28T11:53:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:20.541 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:20.541 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.487+0000 7f9101dab700 1 -- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90d4018770 msgr2=0x7f90d401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.487+0000 7f9101dab700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90d4018770 0x7f90d401abe0 crc :-1 s=READY pgs=968 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.487+0000 7f9101dab700 1 -- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90fc1346b0 msgr2=0x7f90fc135040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.487+0000 7f9101dab700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90fc1346b0 0x7f90fc135040 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7f90e40103a0 tx=0x7f90e4010740).stop 2019-11-28T11:53:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.487+0000 7f9101dab700 1 -- 172.21.15.80:0/1265552345 shutdown_connections 2019-11-28T11:53:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.487+0000 7f9101dab700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f90d4018770 0x7f90d401abe0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.487+0000 7f9101dab700 1 --2- 172.21.15.80:0/1265552345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90fc1346b0 0x7f90fc135040 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.487+0000 7f9101dab700 1 -- 172.21.15.80:0/1265552345 shutdown_connections 2019-11-28T11:53:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.487+0000 7f9101dab700 1 -- 172.21.15.80:0/1265552345 wait complete. 2019-11-28T11:53:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:20.487+0000 7f9101dab700 1 -- 172.21.15.80:0/1265552345 >> 172.21.15.80:0/1265552345 conn(0x7f90fc159ae0 msgr2=0x7f90fc13d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:20.553 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:21.554 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:21.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.618+0000 7fdc8c0bf700 1 Processor -- start 2019-11-28T11:53:21.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.618+0000 7fdc8c0bf700 1 -- start start 2019-11-28T11:53:21.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.619+0000 7fdc8c0bf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdc8406c0a0 0x7fdc84072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:21.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.619+0000 7fdc8c0bf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdc84072620 0x7fdc84164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:21.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.619+0000 7fdc8c0bf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8406db00 con 0x7fdc840734e0 2019-11-28T11:53:21.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.619+0000 7fdc8c0bf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8406fd60 con 0x7fdc84072620 2019-11-28T11:53:21.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.619+0000 7fdc8c0bf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc84070030 con 0x7fdc8406c0a0 2019-11-28T11:53:21.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.619+0000 7fdc8ae5d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdc84072620 0x7fdc84164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:21.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.619+0000 7fdc8ae5d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdc84072620 0x7fdc84164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43876/0 (socket says 172.21.15.80:43876) 2019-11-28T11:53:21.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.619+0000 7fdc89e5b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdc840734e0 0x7fdc84071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43194/0 (socket says 172.21.15.80:43194) 2019-11-28T11:53:21.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.619+0000 7fdc8ae5d700 1 -- 172.21.15.80:0/833024296 learned_addr learned my addr 172.21.15.80:0/833024296 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:21.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8a65c700 1 --2- 172.21.15.80:0/833024296 >> v2:172.21.15.174:3300/0 conn(0x7fdc8406c0a0 0x7fdc84072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:21.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8ae5d700 1 -- 172.21.15.80:0/833024296 >> v2:172.21.15.174:3300/0 conn(0x7fdc8406c0a0 msgr2=0x7fdc84072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:21.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8ae5d700 1 --2- 172.21.15.80:0/833024296 >> v2:172.21.15.174:3300/0 conn(0x7fdc8406c0a0 0x7fdc84072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:21.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8ae5d700 1 -- 172.21.15.80:0/833024296 >> v1:172.21.15.80:6789/0 conn(0x7fdc840734e0 legacy=0x7fdc84071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:21.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8ae5d700 1 -- 172.21.15.80:0/833024296 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc840706c0 con 0x7fdc84072620 2019-11-28T11:53:21.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8965a700 1 -- 172.21.15.80:0/833024296 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615549094 0 0) 0x7fdc74001070 con 0x7fdc840734e0 2019-11-28T11:53:21.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8a65c700 1 --2- 172.21.15.80:0/833024296 >> v2:172.21.15.174:3300/0 conn(0x7fdc8406c0a0 0x7fdc84072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:53:21.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8ae5d700 1 --2- 172.21.15.80:0/833024296 >> v2:172.21.15.80:3300/0 conn(0x7fdc84072620 0x7fdc84164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdc7c00f730 tx=0x7fdc7c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:21.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8ae5d700 1 --2- 172.21.15.80:0/833024296 >> v2:172.21.15.80:3300/0 conn(0x7fdc84072620 0x7fdc84164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdc7c00f730 tx=0x7fdc7c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:21.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8ae5d700 1 --2- 172.21.15.80:0/833024296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc84072620 0x7fdc84164d70 secure :-1 s=READY pgs=2349 cs=0 l=1 rx=0x7fdc7c00f730 tx=0x7fdc7c00fad0).ready entity=mon.0 client_cookie=bfda8bb74aae1b87 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:21.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8ae5d700 1 --2- 172.21.15.80:0/833024296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc84072620 0x7fdc84164d70 secure :-1 s=THROTTLE_DONE pgs=2349 cs=0 l=1 rx=0x7fdc7c00f730 tx=0x7fdc7c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:21.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8965a700 1 -- 172.21.15.80:0/833024296 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc7c000b90 con 0x7fdc84072620 2019-11-28T11:53:21.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8ae5d700 1 --2- 172.21.15.80:0/833024296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc84072620 0x7fdc84164d70 secure :-1 s=THROTTLE_DONE pgs=2349 cs=0 l=1 rx=0x7fdc7c00f730 tx=0x7fdc7c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:21.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8ae5d700 1 --2- 172.21.15.80:0/833024296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc84072620 0x7fdc84164d70 secure :-1 s=THROTTLE_DONE pgs=2349 cs=0 l=1 rx=0x7fdc7c00f730 tx=0x7fdc7c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:21.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8965a700 1 -- 172.21.15.80:0/833024296 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c000b90 con 0x7fdc84072620 2019-11-28T11:53:21.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8965a700 1 -- 172.21.15.80:0/833024296 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc7c0012d0 con 0x7fdc84072620 2019-11-28T11:53:21.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8c0bf700 1 -- 172.21.15.80:0/833024296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc84072620 msgr2=0x7fdc84164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:21.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.620+0000 7fdc8c0bf700 1 --2- 172.21.15.80:0/833024296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc84072620 0x7fdc84164d70 secure :-1 s=READY pgs=2349 cs=0 l=1 rx=0x7fdc7c00f730 tx=0x7fdc7c00fad0).stop 2019-11-28T11:53:21.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.621+0000 7fdc8c0bf700 1 -- 172.21.15.80:0/833024296 shutdown_connections 2019-11-28T11:53:21.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.621+0000 7fdc8c0bf700 1 --2- 172.21.15.80:0/833024296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc84072620 0x7fdc84164d70 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:21.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.621+0000 7fdc8c0bf700 1 --2- 172.21.15.80:0/833024296 >> v2:172.21.15.174:3300/0 conn(0x7fdc8406c0a0 0x7fdc84072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:21.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.621+0000 7fdc8c0bf700 1 -- 172.21.15.80:0/833024296 shutdown_connections 2019-11-28T11:53:21.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.621+0000 7fdc8c0bf700 1 -- 172.21.15.80:0/833024296 wait complete. 2019-11-28T11:53:21.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.621+0000 7fdc8c0bf700 1 -- 172.21.15.80:0/833024296 >> 172.21.15.80:0/833024296 conn(0x7fdc84061cf0 msgr2=0x7fdc84064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:21.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.623+0000 7fdc8c0bf700 1 Processor -- start 2019-11-28T11:53:21.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.623+0000 7fdc8c0bf700 1 -- start start 2019-11-28T11:53:21.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.624+0000 7fdc8c0bf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdc8413e5f0 0x7fdc8413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:21.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.624+0000 7fdc8c0bf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc8410a070 0x7fdc8410bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:21.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.624+0000 7fdc8c0bf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc841066e0 con 0x7fdc8410a4e0 2019-11-28T11:53:21.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.624+0000 7fdc8c0bf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8410e060 con 0x7fdc8413e5f0 2019-11-28T11:53:21.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.624+0000 7fdc8c0bf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8410e330 con 0x7fdc8410a070 2019-11-28T11:53:21.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.624+0000 7fdc8ae5d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdc8410a4e0 0x7fdc8410c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43200/0 (socket says 172.21.15.80:43200) 2019-11-28T11:53:21.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.624+0000 7fdc8ae5d700 1 -- 172.21.15.80:0/4288301989 learned_addr learned my addr 172.21.15.80:0/4288301989 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:21.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc8a65c700 1 --2- 172.21.15.80:0/4288301989 >> v2:172.21.15.174:3300/0 conn(0x7fdc8413e5f0 0x7fdc8413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:21.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc89e5b700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc8410a070 0x7fdc8410bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:21.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753493545 0 0) 0x7fdc7c007580 con 0x7fdc8410a4e0 2019-11-28T11:53:21.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc68002e80 con 0x7fdc8410a4e0 2019-11-28T11:53:21.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2220455802 0 0) 0x7fdc7c008180 con 0x7fdc8410a4e0 2019-11-28T11:53:21.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdc680032e0 con 0x7fdc8410a4e0 2019-11-28T11:53:21.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fdc7c007ba0 con 0x7fdc8410a4e0 2019-11-28T11:53:21.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc8410a070 msgr2=0x7fdc8410bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:21.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc82ffd700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc8410a070 0x7fdc8410bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:21.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 >> v2:172.21.15.174:3300/0 conn(0x7fdc8413e5f0 msgr2=0x7fdc8413e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:21.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc82ffd700 1 --2- 172.21.15.80:0/4288301989 >> v2:172.21.15.174:3300/0 conn(0x7fdc8413e5f0 0x7fdc8413e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:21.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 >> v1:172.21.15.80:6789/0 conn(0x7fdc8410a4e0 legacy=0x7fdc8410c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:21.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc82ffd700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc680033a0 0x7fdc680037f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:21.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc82ffd700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc68003d30 0x7fdc680041f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:21.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc82ffd700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc68004950 0x7fdc68004e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:21.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6800bc50 con 0x7fdc68003d30 2019-11-28T11:53:21.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6800be80 con 0x7fdc68004950 2019-11-28T11:53:21.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6800c0b0 con 0x7fdc680033a0 2019-11-28T11:53:21.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc8a65c700 1 --2- 172.21.15.80:0/4288301989 >> v2:172.21.15.174:3300/0 conn(0x7fdc8413e5f0 0x7fdc8413e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:21.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc89e5b700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc8410a070 0x7fdc8410bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:21.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc89e5b700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc68003d30 0x7fdc680041f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:21.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc8ae5d700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc68004950 0x7fdc68004e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:21.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc8a65c700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc680033a0 0x7fdc680037f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:21.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc89e5b700 1 -- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc680033a0 msgr2=0x7fdc680037f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:21.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc89e5b700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc680033a0 0x7fdc680037f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:21.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc89e5b700 1 -- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc68004950 msgr2=0x7fdc68004e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:21.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc89e5b700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc68004950 0x7fdc68004e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:21.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc89e5b700 1 -- 172.21.15.80:0/4288301989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6800c360 con 0x7fdc68003d30 2019-11-28T11:53:21.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc8a65c700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc680033a0 0x7fdc680037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:53:21.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc8c0bf700 1 -- 172.21.15.80:0/4288301989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8410ed40 con 0x7fdc68003d30 2019-11-28T11:53:21.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc89e5b700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc68003d30 0x7fdc680041f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc74010390 tx=0x7fdc74010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:21.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.625+0000 7fdc8c0bf700 1 -- 172.21.15.80:0/4288301989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8410e9c0 con 0x7fdc68003d30 2019-11-28T11:53:21.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.626+0000 7fdc89e5b700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc68003d30 0x7fdc680041f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc74010390 tx=0x7fdc74010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:21.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.626+0000 7fdc89e5b700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc68003d30 0x7fdc680041f0 secure :-1 s=READY pgs=2351 cs=0 l=1 rx=0x7fdc74010390 tx=0x7fdc74010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:21.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.626+0000 7fdc89e5b700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc68003d30 0x7fdc680041f0 secure :-1 s=THROTTLE_DONE pgs=2351 cs=0 l=1 rx=0x7fdc74010390 tx=0x7fdc74010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:21.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.626+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc740043e0 con 0x7fdc68003d30 2019-11-28T11:53:21.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.626+0000 7fdc89e5b700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc68003d30 0x7fdc680041f0 secure :-1 s=THROTTLE_DONE pgs=2351 cs=0 l=1 rx=0x7fdc74010390 tx=0x7fdc74010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:21.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.626+0000 7fdc89e5b700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc68003d30 0x7fdc680041f0 secure :-1 s=THROTTLE_DONE pgs=2351 cs=0 l=1 rx=0x7fdc74010390 tx=0x7fdc74010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:21.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.626+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc74003fe0 con 0x7fdc68003d30 2019-11-28T11:53:21.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.626+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc740049c0 con 0x7fdc68003d30 2019-11-28T11:53:21.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.626+0000 7fdc89e5b700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc68003d30 0x7fdc680041f0 secure :-1 s=THROTTLE_DONE pgs=2351 cs=0 l=1 rx=0x7fdc74010390 tx=0x7fdc74010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:21.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.626+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fdc740041d0 con 0x7fdc68003d30 2019-11-28T11:53:21.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.626+0000 7fdc89e5b700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc68003d30 0x7fdc680041f0 secure :-1 s=THROTTLE_DONE pgs=2351 cs=0 l=1 rx=0x7fdc74010390 tx=0x7fdc74010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:21.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.626+0000 7fdc82ffd700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdc68020b00 0x7fdc68022f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:21.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.626+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fdc74031bb0 con 0x7fdc68003d30 2019-11-28T11:53:21.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.626+0000 7fdc8a65c700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdc68020b00 0x7fdc68022f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:21.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.627+0000 7fdc8a65c700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdc68020b00 0x7fdc68022f30 crc :-1 s=READY pgs=969 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:21.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.634+0000 7fdc8c0bf700 1 -- 172.21.15.80:0/4288301989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8410ed40 con 0x7fdc68003d30 2019-11-28T11:53:21.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.637+0000 7fdc89e5b700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc68003d30 0x7fdc680041f0 secure :-1 s=THROTTLE_DONE pgs=2351 cs=0 l=1 rx=0x7fdc74010390 tx=0x7fdc74010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:21.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.637+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fdc74000940 con 0x7fdc68003d30 2019-11-28T11:53:21.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.809+0000 7fdc8c0bf700 1 -- 172.21.15.80:0/4288301989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc8410e9c0 con 0x7fdc68003d30 2019-11-28T11:53:21.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.810+0000 7fdc89e5b700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc68003d30 0x7fdc680041f0 secure :-1 s=THROTTLE_DONE pgs=2351 cs=0 l=1 rx=0x7fdc74010390 tx=0x7fdc74010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:21.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.810+0000 7fdc82ffd700 1 -- 172.21.15.80:0/4288301989 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7fdc74003fe0 con 0x7fdc68003d30 2019-11-28T11:53:21.865 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:21.866 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:21.866 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:21.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.812+0000 7fdc8c0bf700 1 -- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdc68020b00 msgr2=0x7fdc68022f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:21.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.812+0000 7fdc8c0bf700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdc68020b00 0x7fdc68022f30 crc :-1 s=READY pgs=969 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:21.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.812+0000 7fdc8c0bf700 1 -- 172.21.15.80:0/4288301989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc68003d30 msgr2=0x7fdc680041f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.812+0000 7fdc8c0bf700 1 --2- 172.21.15.80:0/4288301989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdc68003d30 0x7fdc680041f0 secure :-1 s=READY pgs=2351 cs=0 l=1 rx=0x7fdc74010390 tx=0x7fdc74010290).stop 2019-11-28T11:53:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.812+0000 7fdc8ae5d700 1 -- 172.21.15.80:0/4288301989 reap_dead start 2019-11-28T11:53:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.812+0000 7fdc8ae5d700 1 -- 172.21.15.80:0/4288301989 reap_dead start 2019-11-28T11:53:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.812+0000 7fdc8c0bf700 1 -- 172.21.15.80:0/4288301989 shutdown_connections 2019-11-28T11:53:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.812+0000 7fdc8c0bf700 1 -- 172.21.15.80:0/4288301989 shutdown_connections 2019-11-28T11:53:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.812+0000 7fdc8c0bf700 1 -- 172.21.15.80:0/4288301989 wait complete. 2019-11-28T11:53:21.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:21.812+0000 7fdc8c0bf700 1 -- 172.21.15.80:0/4288301989 >> 172.21.15.80:0/4288301989 conn(0x7fdc8413d620 msgr2=0x7fdc8413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:21.878 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:22.878 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.944+0000 7f066055c700 1 Processor -- start 2019-11-28T11:53:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.944+0000 7f066055c700 1 -- start start 2019-11-28T11:53:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.945+0000 7f066055c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f065806c490 0x7f065806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.945+0000 7f066055c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065806db00 con 0x7f065806ce60 2019-11-28T11:53:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.945+0000 7f066055c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065806e000 con 0x7f065806c0a0 2019-11-28T11:53:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.945+0000 7f066055c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065806fd60 con 0x7f065806c490 2019-11-28T11:53:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.945+0000 7f065e2f8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f065806c490 0x7f065806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.945+0000 7f065e2f8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f065806c490 0x7f065806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43898/0 (socket says 172.21.15.80:43898) 2019-11-28T11:53:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.945+0000 7f065f2fa700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f065806ce60 0x7f0658164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43212/0 (socket says 172.21.15.80:43212) 2019-11-28T11:53:23.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.945+0000 7f065e2f8700 1 -- 172.21.15.80:0/4015577089 learned_addr learned my addr 172.21.15.80:0/4015577089 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:23.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.945+0000 7f065e2f8700 1 -- 172.21.15.80:0/4015577089 >> v1:172.21.15.174:6789/0 conn(0x7f065806c0a0 legacy=0x7f0658072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:23.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.945+0000 7f065e2f8700 1 -- 172.21.15.80:0/4015577089 >> v1:172.21.15.80:6789/0 conn(0x7f065806ce60 legacy=0x7f0658164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:23.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.945+0000 7f065e2f8700 1 -- 172.21.15.80:0/4015577089 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06580706c0 con 0x7f065806c490 2019-11-28T11:53:23.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.945+0000 7f065daf7700 1 -- 172.21.15.80:0/4015577089 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960797912 0 0) 0x7f06500009b0 con 0x7f065806ce60 2019-11-28T11:53:23.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.945+0000 7f065e2f8700 1 --2- 172.21.15.80:0/4015577089 >> v2:172.21.15.80:3300/0 conn(0x7f065806c490 0x7f065806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f064c00fac0 tx=0x7f064c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:23.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.945+0000 7f065e2f8700 1 --2- 172.21.15.80:0/4015577089 >> v2:172.21.15.80:3300/0 conn(0x7f065806c490 0x7f065806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f064c00fac0 tx=0x7f064c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:23.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.945+0000 7f065e2f8700 1 --2- 172.21.15.80:0/4015577089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806c490 0x7f065806c920 secure :-1 s=READY pgs=2353 cs=0 l=1 rx=0x7f064c00fac0 tx=0x7f064c00fe60).ready entity=mon.0 client_cookie=f44fdd8c7d78bcda server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:23.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.946+0000 7f065e2f8700 1 --2- 172.21.15.80:0/4015577089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806c490 0x7f065806c920 secure :-1 s=THROTTLE_DONE pgs=2353 cs=0 l=1 rx=0x7f064c00fac0 tx=0x7f064c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:23.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.946+0000 7f065daf7700 1 -- 172.21.15.80:0/4015577089 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064c000ce0 con 0x7f065806c490 2019-11-28T11:53:23.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.946+0000 7f065e2f8700 1 --2- 172.21.15.80:0/4015577089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806c490 0x7f065806c920 secure :-1 s=THROTTLE_DONE pgs=2353 cs=0 l=1 rx=0x7f064c00fac0 tx=0x7f064c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:23.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.946+0000 7f065e2f8700 1 --2- 172.21.15.80:0/4015577089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806c490 0x7f065806c920 secure :-1 s=THROTTLE_DONE pgs=2353 cs=0 l=1 rx=0x7f064c00fac0 tx=0x7f064c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:23.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.946+0000 7f065daf7700 1 -- 172.21.15.80:0/4015577089 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c001010 con 0x7f065806c490 2019-11-28T11:53:23.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.946+0000 7f065daf7700 1 -- 172.21.15.80:0/4015577089 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064c001760 con 0x7f065806c490 2019-11-28T11:53:23.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.946+0000 7f066055c700 1 -- 172.21.15.80:0/4015577089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806c490 msgr2=0x7f065806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:23.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.946+0000 7f066055c700 1 --2- 172.21.15.80:0/4015577089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806c490 0x7f065806c920 secure :-1 s=READY pgs=2353 cs=0 l=1 rx=0x7f064c00fac0 tx=0x7f064c00fe60).stop 2019-11-28T11:53:23.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.946+0000 7f066055c700 1 -- 172.21.15.80:0/4015577089 shutdown_connections 2019-11-28T11:53:23.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.946+0000 7f066055c700 1 --2- 172.21.15.80:0/4015577089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065806c490 0x7f065806c920 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:23.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.946+0000 7f066055c700 1 -- 172.21.15.80:0/4015577089 shutdown_connections 2019-11-28T11:53:23.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.946+0000 7f066055c700 1 -- 172.21.15.80:0/4015577089 wait complete. 2019-11-28T11:53:23.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.946+0000 7f066055c700 1 -- 172.21.15.80:0/4015577089 >> 172.21.15.80:0/4015577089 conn(0x7f0658061cf0 msgr2=0x7f0658064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:23.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.949+0000 7f066055c700 1 Processor -- start 2019-11-28T11:53:23.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.949+0000 7f066055c700 1 -- start start 2019-11-28T11:53:23.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f066055c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f065813f580 0x7f0658114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:23.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f066055c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0658114670 0x7f065811e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:23.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f066055c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065813fc20 con 0x7f065811eaf0 2019-11-28T11:53:23.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f066055c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06581236b0 con 0x7f065813f580 2019-11-28T11:53:23.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f066055c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0658123980 con 0x7f0658114670 2019-11-28T11:53:23.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f065eaf9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f065813f580 0x7f0658114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:23.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f065eaf9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f065813f580 0x7f0658114130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43900/0 (socket says 172.21.15.80:43900) 2019-11-28T11:53:23.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f065eaf9700 1 -- 172.21.15.80:0/140820717 learned_addr learned my addr 172.21.15.80:0/140820717 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:23.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f065e2f8700 1 --2- 172.21.15.80:0/140820717 >> v2:172.21.15.174:3300/0 conn(0x7f0658114670 0x7f065811e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:23.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f065eaf9700 1 -- 172.21.15.80:0/140820717 >> v2:172.21.15.174:3300/0 conn(0x7f0658114670 msgr2=0x7f065811e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:23.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f065eaf9700 1 --2- 172.21.15.80:0/140820717 >> v2:172.21.15.174:3300/0 conn(0x7f0658114670 0x7f065811e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:23.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f065eaf9700 1 -- 172.21.15.80:0/140820717 >> v1:172.21.15.174:6789/0 conn(0x7f065811eaf0 legacy=0x7f0658112fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:23.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f065eaf9700 1 -- 172.21.15.80:0/140820717 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0658124010 con 0x7f065813f580 2019-11-28T11:53:23.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f065eaf9700 1 --2- 172.21.15.80:0/140820717 >> v2:172.21.15.80:3300/0 conn(0x7f065813f580 0x7f0658114130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0648010410 tx=0x7f0648010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:23.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f065eaf9700 1 --2- 172.21.15.80:0/140820717 >> v2:172.21.15.80:3300/0 conn(0x7f065813f580 0x7f0658114130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0648010410 tx=0x7f0648010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:23.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f065eaf9700 1 --2- 172.21.15.80:0/140820717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065813f580 0x7f0658114130 secure :-1 s=READY pgs=2354 cs=0 l=1 rx=0x7f0648010410 tx=0x7f0648010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f065eaf9700 1 --2- 172.21.15.80:0/140820717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065813f580 0x7f0658114130 secure :-1 s=THROTTLE_DONE pgs=2354 cs=0 l=1 rx=0x7f0648010410 tx=0x7f0648010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f065eaf9700 1 --2- 172.21.15.80:0/140820717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065813f580 0x7f0658114130 secure :-1 s=THROTTLE_DONE pgs=2354 cs=0 l=1 rx=0x7f0648010410 tx=0x7f0648010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f065eaf9700 1 --2- 172.21.15.80:0/140820717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065813f580 0x7f0658114130 secure :-1 s=THROTTLE_DONE pgs=2354 cs=0 l=1 rx=0x7f0648010410 tx=0x7f0648010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f06577fe700 1 -- 172.21.15.80:0/140820717 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0648000960 con 0x7f065813f580 2019-11-28T11:53:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f06577fe700 1 -- 172.21.15.80:0/140820717 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06480010a0 con 0x7f065813f580 2019-11-28T11:53:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f06577fe700 1 -- 172.21.15.80:0/140820717 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06480017f0 con 0x7f065813f580 2019-11-28T11:53:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f066055c700 1 -- 172.21.15.80:0/140820717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0658124010 con 0x7f065813f580 2019-11-28T11:53:23.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.950+0000 7f066055c700 1 -- 172.21.15.80:0/140820717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0658124010 con 0x7f065813f580 2019-11-28T11:53:23.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.951+0000 7f065eaf9700 1 --2- 172.21.15.80:0/140820717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065813f580 0x7f0658114130 secure :-1 s=THROTTLE_DONE pgs=2354 cs=0 l=1 rx=0x7f0648010410 tx=0x7f0648010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:23.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.951+0000 7f06577fe700 1 -- 172.21.15.80:0/140820717 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0648001290 con 0x7f065813f580 2019-11-28T11:53:23.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.951+0000 7f065eaf9700 1 --2- 172.21.15.80:0/140820717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065813f580 0x7f0658114130 secure :-1 s=THROTTLE_DONE pgs=2354 cs=0 l=1 rx=0x7f0648010410 tx=0x7f0648010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:23.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.951+0000 7f06577fe700 1 --2- 172.21.15.80:0/140820717 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0638018730 0x7f063801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:23.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.951+0000 7f06577fe700 1 -- 172.21.15.80:0/140820717 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f0648031ad0 con 0x7f065813f580 2019-11-28T11:53:23.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.951+0000 7f065e2f8700 1 --2- 172.21.15.80:0/140820717 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0638018730 0x7f063801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:23.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.952+0000 7f065e2f8700 1 --2- 172.21.15.80:0/140820717 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0638018730 0x7f063801abc0 crc :-1 s=READY pgs=970 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:23.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.959+0000 7f066055c700 1 -- 172.21.15.80:0/140820717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0658124010 con 0x7f065813f580 2019-11-28T11:53:23.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.962+0000 7f065eaf9700 1 --2- 172.21.15.80:0/140820717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065813f580 0x7f0658114130 secure :-1 s=THROTTLE_DONE pgs=2354 cs=0 l=1 rx=0x7f0648010410 tx=0x7f0648010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:23.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:22.962+0000 7f06577fe700 1 -- 172.21.15.80:0/140820717 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0648022180 con 0x7f065813f580 2019-11-28T11:53:23.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:23.132+0000 7f066055c700 1 -- 172.21.15.80:0/140820717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0658124010 con 0x7f065813f580 2019-11-28T11:53:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:23.133+0000 7f065eaf9700 1 --2- 172.21.15.80:0/140820717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065813f580 0x7f0658114130 secure :-1 s=THROTTLE_DONE pgs=2354 cs=0 l=1 rx=0x7f0648010410 tx=0x7f0648010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:23.133+0000 7f06577fe700 1 -- 172.21.15.80:0/140820717 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f0648022180 con 0x7f065813f580 2019-11-28T11:53:23.189 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:23.189 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:23.189 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:23.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:23.135+0000 7f066055c700 1 -- 172.21.15.80:0/140820717 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0638018730 msgr2=0x7f063801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:23.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:23.135+0000 7f066055c700 1 --2- 172.21.15.80:0/140820717 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0638018730 0x7f063801abc0 crc :-1 s=READY pgs=970 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:23.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:23.135+0000 7f066055c700 1 -- 172.21.15.80:0/140820717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065813f580 msgr2=0x7f0658114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:23.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:23.135+0000 7f066055c700 1 --2- 172.21.15.80:0/140820717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065813f580 0x7f0658114130 secure :-1 s=READY pgs=2354 cs=0 l=1 rx=0x7f0648010410 tx=0x7f0648010270).stop 2019-11-28T11:53:23.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:23.135+0000 7f066055c700 1 -- 172.21.15.80:0/140820717 shutdown_connections 2019-11-28T11:53:23.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:23.135+0000 7f066055c700 1 --2- 172.21.15.80:0/140820717 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0638018730 0x7f063801abc0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:23.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:23.135+0000 7f066055c700 1 --2- 172.21.15.80:0/140820717 >> v2:172.21.15.174:3300/0 conn(0x7f0658114670 0x7f065811e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:23.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:23.135+0000 7f066055c700 1 --2- 172.21.15.80:0/140820717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065813f580 0x7f0658114130 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:23.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:23.135+0000 7f066055c700 1 -- 172.21.15.80:0/140820717 shutdown_connections 2019-11-28T11:53:23.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:23.135+0000 7f066055c700 1 -- 172.21.15.80:0/140820717 wait complete. 2019-11-28T11:53:23.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:23.135+0000 7f066055c700 1 -- 172.21.15.80:0/140820717 >> 172.21.15.80:0/140820717 conn(0x7f06581426c0 msgr2=0x7f0658110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:23.200 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:24.201 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:24.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.268+0000 7fd6a4b25700 1 Processor -- start 2019-11-28T11:53:24.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.268+0000 7fd6a4b25700 1 -- start start 2019-11-28T11:53:24.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd6a4b25700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd6a006c490 0x7fd6a006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:24.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd6a4b25700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a006db00 con 0x7fd6a006ce60 2019-11-28T11:53:24.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd6a4b25700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a006e000 con 0x7fd6a006c0a0 2019-11-28T11:53:24.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd6a4b25700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a006fd60 con 0x7fd6a006c490 2019-11-28T11:53:24.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69f59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd6a006ce60 0x7fd6a0164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43226/0 (socket says 172.21.15.80:43226) 2019-11-28T11:53:24.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69f59e700 1 -- 172.21.15.80:0/1241475238 learned_addr learned my addr 172.21.15.80:0/1241475238 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:24.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69e59c700 1 --2- 172.21.15.80:0/1241475238 >> v2:172.21.15.174:3300/0 conn(0x7fd6a006c490 0x7fd6a006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:24.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69dd9b700 1 -- 172.21.15.80:0/1241475238 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24359421 0 0) 0x7fd698001480 con 0x7fd6a006ce60 2019-11-28T11:53:24.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69dd9b700 1 -- 172.21.15.80:0/1241475238 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd680002e80 con 0x7fd6a006ce60 2019-11-28T11:53:24.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69dd9b700 1 -- 172.21.15.80:0/1241475238 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1191134779 0 0) 0x7fd698001460 con 0x7fd6a006ce60 2019-11-28T11:53:24.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69dd9b700 1 -- 172.21.15.80:0/1241475238 >> v2:172.21.15.174:3300/0 conn(0x7fd6a006c490 msgr2=0x7fd6a006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:24.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69dd9b700 1 --2- 172.21.15.80:0/1241475238 >> v2:172.21.15.174:3300/0 conn(0x7fd6a006c490 0x7fd6a006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:24.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69dd9b700 1 -- 172.21.15.80:0/1241475238 >> v1:172.21.15.174:6789/0 conn(0x7fd6a006c0a0 legacy=0x7fd6a0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:24.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69dd9b700 1 -- 172.21.15.80:0/1241475238 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a00706c0 con 0x7fd6a006ce60 2019-11-28T11:53:24.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69dd9b700 1 -- 172.21.15.80:0/1241475238 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd6980019d0 con 0x7fd6a006ce60 2019-11-28T11:53:24.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69dd9b700 1 -- 172.21.15.80:0/1241475238 >> v1:172.21.15.80:6789/0 conn(0x7fd6a006ce60 legacy=0x7fd6a0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:24.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69dd9b700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd680003b20 0x7fd680005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:24.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69dd9b700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd680006730 0x7fd680008be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:24.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69dd9b700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd680009440 0x7fd68000b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:24.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69dd9b700 1 -- 172.21.15.80:0/1241475238 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68000c0c0 con 0x7fd680003b20 2019-11-28T11:53:24.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69dd9b700 1 -- 172.21.15.80:0/1241475238 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800502c0 con 0x7fd680009440 2019-11-28T11:53:24.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69dd9b700 1 -- 172.21.15.80:0/1241475238 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800504f0 con 0x7fd680006730 2019-11-28T11:53:24.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69e59c700 1 --2- 172.21.15.80:0/1241475238 >> v2:172.21.15.174:3300/0 conn(0x7fd6a006c490 0x7fd6a006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:24.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.270+0000 7fd69ed9d700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd680003b20 0x7fd680005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:24.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69f59e700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd680009440 0x7fd68000b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:24.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69e59c700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd680006730 0x7fd680008be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:24.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69ed9d700 1 -- 172.21.15.80:0/1241475238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd680006730 msgr2=0x7fd680008be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:24.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69ed9d700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd680006730 0x7fd680008be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:24.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69ed9d700 1 -- 172.21.15.80:0/1241475238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd680009440 msgr2=0x7fd68000b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:24.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69ed9d700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd680009440 0x7fd68000b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:24.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69ed9d700 1 -- 172.21.15.80:0/1241475238 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6800507a0 con 0x7fd680003b20 2019-11-28T11:53:24.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69e59c700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd680006730 0x7fd680008be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:53:24.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69f59e700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd680009440 0x7fd68000b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:53:24.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69f59e700 1 -- 172.21.15.80:0/1241475238 reap_dead start 2019-11-28T11:53:24.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69ed9d700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd680003b20 0x7fd680005f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd69000af50 tx=0x7fd69000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:24.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69ed9d700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd680003b20 0x7fd680005f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd69000af50 tx=0x7fd69000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:24.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69ed9d700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd680003b20 0x7fd680005f80 secure :-1 s=READY pgs=2356 cs=0 l=1 rx=0x7fd69000af50 tx=0x7fd69000b760).ready entity=mon.0 client_cookie=60baa1fa76d76bba server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:24.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69ed9d700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd680003b20 0x7fd680005f80 secure :-1 s=THROTTLE_DONE pgs=2356 cs=0 l=1 rx=0x7fd69000af50 tx=0x7fd69000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:24.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69dd9b700 1 -- 172.21.15.80:0/1241475238 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd690000960 con 0x7fd680003b20 2019-11-28T11:53:24.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69ed9d700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd680003b20 0x7fd680005f80 secure :-1 s=THROTTLE_DONE pgs=2356 cs=0 l=1 rx=0x7fd69000af50 tx=0x7fd69000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:24.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69ed9d700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd680003b20 0x7fd680005f80 secure :-1 s=THROTTLE_DONE pgs=2356 cs=0 l=1 rx=0x7fd69000af50 tx=0x7fd69000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:24.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69dd9b700 1 -- 172.21.15.80:0/1241475238 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd690009980 con 0x7fd680003b20 2019-11-28T11:53:24.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd69dd9b700 1 -- 172.21.15.80:0/1241475238 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd690000960 con 0x7fd680003b20 2019-11-28T11:53:24.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd6a4b25700 1 -- 172.21.15.80:0/1241475238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd680003b20 msgr2=0x7fd680005f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:24.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.271+0000 7fd6a4b25700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd680003b20 0x7fd680005f80 secure :-1 s=READY pgs=2356 cs=0 l=1 rx=0x7fd69000af50 tx=0x7fd69000b760).stop 2019-11-28T11:53:24.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.272+0000 7fd6a4b25700 1 -- 172.21.15.80:0/1241475238 shutdown_connections 2019-11-28T11:53:24.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.272+0000 7fd6a4b25700 1 --2- 172.21.15.80:0/1241475238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd680003b20 0x7fd680005f80 unknown :-1 s=CLOSED pgs=2356 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:24.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.272+0000 7fd6a4b25700 1 -- 172.21.15.80:0/1241475238 shutdown_connections 2019-11-28T11:53:24.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.272+0000 7fd6a4b25700 1 -- 172.21.15.80:0/1241475238 wait complete. 2019-11-28T11:53:24.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.272+0000 7fd6a4b25700 1 -- 172.21.15.80:0/1241475238 >> 172.21.15.80:0/1241475238 conn(0x7fd6a0061cf0 msgr2=0x7fd6a0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:24.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.274+0000 7fd6a4b25700 1 Processor -- start 2019-11-28T11:53:24.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.274+0000 7fd6a4b25700 1 -- start start 2019-11-28T11:53:24.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.275+0000 7fd6a4b25700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd6a0074d00 0x7fd6a007aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:24.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.275+0000 7fd6a4b25700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd6a0150f50 0x7fd6a007af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:24.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.275+0000 7fd6a4b25700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a00754d0 con 0x7fd6a007bba0 2019-11-28T11:53:24.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.275+0000 7fd6a4b25700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a0078980 con 0x7fd6a0074d00 2019-11-28T11:53:24.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.275+0000 7fd6a4b25700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a0078c50 con 0x7fd6a0150f50 2019-11-28T11:53:24.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.275+0000 7fd69f59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd6a007bba0 0x7fd6a0076d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43240/0 (socket says 172.21.15.80:43240) 2019-11-28T11:53:24.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.275+0000 7fd69f59e700 1 -- 172.21.15.80:0/3591695674 learned_addr learned my addr 172.21.15.80:0/3591695674 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:24.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.275+0000 7fd69e59c700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd6a0150f50 0x7fd6a007af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:24.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.275+0000 7fd69ed9d700 1 --2- 172.21.15.80:0/3591695674 >> v2:172.21.15.174:3300/0 conn(0x7fd6a0074d00 0x7fd6a007aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:24.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.275+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067745023 0 0) 0x7fd698001270 con 0x7fd6a007bba0 2019-11-28T11:53:24.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.275+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd678004f00 con 0x7fd6a007bba0 2019-11-28T11:53:24.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2355677969 0 0) 0x7fd698000cc0 con 0x7fd6a007bba0 2019-11-28T11:53:24.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd678005470 con 0x7fd6a007bba0 2019-11-28T11:53:24.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd698001ca0 con 0x7fd6a007bba0 2019-11-28T11:53:24.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd6a0150f50 msgr2=0x7fd6a007af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:24.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd6a0150f50 0x7fd6a007af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:24.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 >> v2:172.21.15.174:3300/0 conn(0x7fd6a0074d00 msgr2=0x7fd6a007aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:24.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 --2- 172.21.15.80:0/3591695674 >> v2:172.21.15.174:3300/0 conn(0x7fd6a0074d00 0x7fd6a007aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:24.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 >> v1:172.21.15.80:6789/0 conn(0x7fd6a007bba0 legacy=0x7fd6a0076d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:24.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd678005d60 0x7fd678008270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:24.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6780087b0 0x7fd67800abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:24.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd67800b170 0x7fd67800d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:24.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67800dda0 con 0x7fd6780087b0 2019-11-28T11:53:24.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67800dfd0 con 0x7fd678005d60 2019-11-28T11:53:24.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67800e200 con 0x7fd67800b170 2019-11-28T11:53:24.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd69e59c700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd6a0150f50 0x7fd6a007af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:24.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd69e59c700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6780087b0 0x7fd67800abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:24.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd69ed9d700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd678005d60 0x7fd678008270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:24.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd69f59e700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd67800b170 0x7fd67800d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:24.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd69e59c700 1 -- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd67800b170 msgr2=0x7fd67800d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:24.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd69e59c700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd67800b170 0x7fd67800d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:24.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd69e59c700 1 -- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd678005d60 msgr2=0x7fd678008270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:24.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd69e59c700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd678005d60 0x7fd678008270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:24.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd69e59c700 1 -- 172.21.15.80:0/3591695674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67800e4b0 con 0x7fd6780087b0 2019-11-28T11:53:24.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6a4b25700 1 -- 172.21.15.80:0/3591695674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a0079660 con 0x7fd6780087b0 2019-11-28T11:53:24.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd69e59c700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6780087b0 0x7fd67800abb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6880102f0 tx=0x7fd68800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:24.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6a4b25700 1 -- 172.21.15.80:0/3591695674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a00792e0 con 0x7fd6780087b0 2019-11-28T11:53:24.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd69e59c700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6780087b0 0x7fd67800abb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6880102f0 tx=0x7fd68800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:24.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd69e59c700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6780087b0 0x7fd67800abb0 secure :-1 s=READY pgs=2358 cs=0 l=1 rx=0x7fd6880102f0 tx=0x7fd68800ada0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:24.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd69e59c700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6780087b0 0x7fd67800abb0 secure :-1 s=THROTTLE_DONE pgs=2358 cs=0 l=1 rx=0x7fd6880102f0 tx=0x7fd68800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:24.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd688009960 con 0x7fd6780087b0 2019-11-28T11:53:24.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd69e59c700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6780087b0 0x7fd67800abb0 secure :-1 s=THROTTLE_DONE pgs=2358 cs=0 l=1 rx=0x7fd6880102f0 tx=0x7fd68800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:24.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd69e59c700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6780087b0 0x7fd67800abb0 secure :-1 s=THROTTLE_DONE pgs=2358 cs=0 l=1 rx=0x7fd6880102f0 tx=0x7fd68800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:24.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd688009580 con 0x7fd6780087b0 2019-11-28T11:53:24.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.276+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd688009770 con 0x7fd6780087b0 2019-11-28T11:53:24.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.277+0000 7fd69e59c700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6780087b0 0x7fd67800abb0 secure :-1 s=THROTTLE_DONE pgs=2358 cs=0 l=1 rx=0x7fd6880102f0 tx=0x7fd68800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:24.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.277+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd688009770 con 0x7fd6780087b0 2019-11-28T11:53:24.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.277+0000 7fd69e59c700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6780087b0 0x7fd67800abb0 secure :-1 s=THROTTLE_DONE pgs=2358 cs=0 l=1 rx=0x7fd6880102f0 tx=0x7fd68800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:24.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.277+0000 7fd6977fe700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd678022d50 0x7fd678025180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:24.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.277+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fd688031b80 con 0x7fd6780087b0 2019-11-28T11:53:24.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.277+0000 7fd69ed9d700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd678022d50 0x7fd678025180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:24.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.278+0000 7fd69ed9d700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd678022d50 0x7fd678025180 crc :-1 s=READY pgs=971 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:24.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.284+0000 7fd6a4b25700 1 -- 172.21.15.80:0/3591695674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a0079660 con 0x7fd6780087b0 2019-11-28T11:53:24.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.287+0000 7fd69e59c700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6780087b0 0x7fd67800abb0 secure :-1 s=THROTTLE_DONE pgs=2358 cs=0 l=1 rx=0x7fd6880102f0 tx=0x7fd68800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:24.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.287+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd68800a5e0 con 0x7fd6780087b0 2019-11-28T11:53:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.460+0000 7fd6a4b25700 1 -- 172.21.15.80:0/3591695674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6a00792e0 con 0x7fd6780087b0 2019-11-28T11:53:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.460+0000 7fd69e59c700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6780087b0 0x7fd67800abb0 secure :-1 s=THROTTLE_DONE pgs=2358 cs=0 l=1 rx=0x7fd6880102f0 tx=0x7fd68800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.460+0000 7fd6977fe700 1 -- 172.21.15.80:0/3591695674 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7fd688009580 con 0x7fd6780087b0 2019-11-28T11:53:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:24.517 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:24.517 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:24.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.463+0000 7fd6a4b25700 1 -- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd678022d50 msgr2=0x7fd678025180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:24.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.463+0000 7fd6a4b25700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd678022d50 0x7fd678025180 crc :-1 s=READY pgs=971 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:24.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.463+0000 7fd6a4b25700 1 -- 172.21.15.80:0/3591695674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6780087b0 msgr2=0x7fd67800abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:24.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.463+0000 7fd6a4b25700 1 --2- 172.21.15.80:0/3591695674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6780087b0 0x7fd67800abb0 secure :-1 s=READY pgs=2358 cs=0 l=1 rx=0x7fd6880102f0 tx=0x7fd68800ada0).stop 2019-11-28T11:53:24.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.463+0000 7fd69f59e700 1 -- 172.21.15.80:0/3591695674 reap_dead start 2019-11-28T11:53:24.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.463+0000 7fd69f59e700 1 -- 172.21.15.80:0/3591695674 reap_dead start 2019-11-28T11:53:24.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.463+0000 7fd6a4b25700 1 -- 172.21.15.80:0/3591695674 shutdown_connections 2019-11-28T11:53:24.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.463+0000 7fd6a4b25700 1 -- 172.21.15.80:0/3591695674 shutdown_connections 2019-11-28T11:53:24.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.463+0000 7fd6a4b25700 1 -- 172.21.15.80:0/3591695674 wait complete. 2019-11-28T11:53:24.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:24.463+0000 7fd6a4b25700 1 -- 172.21.15.80:0/3591695674 >> 172.21.15.80:0/3591695674 conn(0x7fd6a013fa50 msgr2=0x7fd6a007c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:24.528 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:25.529 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:25.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.597+0000 7ff569d49700 1 Processor -- start 2019-11-28T11:53:25.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.597+0000 7ff569d49700 1 -- start start 2019-11-28T11:53:25.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.598+0000 7ff569d49700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff56406c0a0 0x7ff564072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:25.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.598+0000 7ff569d49700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5640734e0 0x7ff564071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:25.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.598+0000 7ff569d49700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56406db00 con 0x7ff564072360 2019-11-28T11:53:25.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.598+0000 7ff569d49700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56406f330 con 0x7ff5640734e0 2019-11-28T11:53:25.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.598+0000 7ff569d49700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640706c0 con 0x7ff56406c0a0 2019-11-28T11:53:25.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.598+0000 7ff55bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5640734e0 0x7ff564071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:25.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.598+0000 7ff55bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5640734e0 0x7ff564071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43934/0 (socket says 172.21.15.80:43934) 2019-11-28T11:53:25.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.598+0000 7ff55bfff700 1 -- 172.21.15.80:0/4251599498 learned_addr learned my addr 172.21.15.80:0/4251599498 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:25.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.598+0000 7ff563fff700 1 --2- 172.21.15.80:0/4251599498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff56406c0a0 0x7ff564072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:25.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.599+0000 7ff55bfff700 1 -- 172.21.15.80:0/4251599498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff56406c0a0 msgr2=0x7ff564072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:25.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.599+0000 7ff55bfff700 1 --2- 172.21.15.80:0/4251599498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff56406c0a0 0x7ff564072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:25.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.599+0000 7ff55bfff700 1 -- 172.21.15.80:0/4251599498 >> v1:172.21.15.174:6789/0 conn(0x7ff564072360 legacy=0x7ff56406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:25.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.599+0000 7ff55bfff700 1 -- 172.21.15.80:0/4251599498 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564070a40 con 0x7ff5640734e0 2019-11-28T11:53:25.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.599+0000 7ff55bfff700 1 --2- 172.21.15.80:0/4251599498 >> v2:172.21.15.80:3300/0 conn(0x7ff5640734e0 0x7ff564071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff54c00f6c0 tx=0x7ff54c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:25.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.599+0000 7ff55bfff700 1 --2- 172.21.15.80:0/4251599498 >> v2:172.21.15.80:3300/0 conn(0x7ff5640734e0 0x7ff564071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff54c00f6c0 tx=0x7ff54c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:25.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.599+0000 7ff55bfff700 1 --2- 172.21.15.80:0/4251599498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5640734e0 0x7ff564071e20 secure :-1 s=READY pgs=2359 cs=0 l=1 rx=0x7ff54c00f6c0 tx=0x7ff54c00fa60).ready entity=mon.0 client_cookie=8d5015dad457becd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:25.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.599+0000 7ff55bfff700 1 --2- 172.21.15.80:0/4251599498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5640734e0 0x7ff564071e20 secure :-1 s=THROTTLE_DONE pgs=2359 cs=0 l=1 rx=0x7ff54c00f6c0 tx=0x7ff54c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:25.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.599+0000 7ff55bfff700 1 --2- 172.21.15.80:0/4251599498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5640734e0 0x7ff564071e20 secure :-1 s=THROTTLE_DONE pgs=2359 cs=0 l=1 rx=0x7ff54c00f6c0 tx=0x7ff54c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:25.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.599+0000 7ff5637fe700 1 -- 172.21.15.80:0/4251599498 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff54c000960 con 0x7ff5640734e0 2019-11-28T11:53:25.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.599+0000 7ff55bfff700 1 --2- 172.21.15.80:0/4251599498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5640734e0 0x7ff564071e20 secure :-1 s=THROTTLE_DONE pgs=2359 cs=0 l=1 rx=0x7ff54c00f6c0 tx=0x7ff54c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:25.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.599+0000 7ff5637fe700 1 -- 172.21.15.80:0/4251599498 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c000c90 con 0x7ff5640734e0 2019-11-28T11:53:25.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.599+0000 7ff5637fe700 1 -- 172.21.15.80:0/4251599498 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff54c0013a0 con 0x7ff5640734e0 2019-11-28T11:53:25.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.599+0000 7ff569d49700 1 -- 172.21.15.80:0/4251599498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5640734e0 msgr2=0x7ff564071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:25.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.599+0000 7ff569d49700 1 --2- 172.21.15.80:0/4251599498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5640734e0 0x7ff564071e20 secure :-1 s=READY pgs=2359 cs=0 l=1 rx=0x7ff54c00f6c0 tx=0x7ff54c00fa60).stop 2019-11-28T11:53:25.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.600+0000 7ff569d49700 1 -- 172.21.15.80:0/4251599498 shutdown_connections 2019-11-28T11:53:25.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.600+0000 7ff569d49700 1 --2- 172.21.15.80:0/4251599498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5640734e0 0x7ff564071e20 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:25.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.600+0000 7ff569d49700 1 --2- 172.21.15.80:0/4251599498 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff56406c0a0 0x7ff564072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:25.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.600+0000 7ff569d49700 1 -- 172.21.15.80:0/4251599498 shutdown_connections 2019-11-28T11:53:25.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.600+0000 7ff569d49700 1 -- 172.21.15.80:0/4251599498 wait complete. 2019-11-28T11:53:25.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.600+0000 7ff569d49700 1 -- 172.21.15.80:0/4251599498 >> 172.21.15.80:0/4251599498 conn(0x7ff564061cf0 msgr2=0x7ff564064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:25.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.602+0000 7ff569d49700 1 Processor -- start 2019-11-28T11:53:25.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.602+0000 7ff569d49700 1 -- start start 2019-11-28T11:53:25.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff569d49700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff564074590 0x7ff564074a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:25.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff569d49700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff564074f40 0x7ff56412cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:25.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff569d49700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56411a2b0 con 0x7ff5640741a0 2019-11-28T11:53:25.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff569d49700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff564076e40 con 0x7ff564074f40 2019-11-28T11:53:25.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff569d49700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff564077110 con 0x7ff564074590 2019-11-28T11:53:25.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff568ae7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff564074f40 0x7ff56412cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:25.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff563fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff5640741a0 0x7ff564117630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43256/0 (socket says 172.21.15.80:43256) 2019-11-28T11:53:25.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff563fff700 1 -- 172.21.15.80:0/946710383 learned_addr learned my addr 172.21.15.80:0/946710383 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:25.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff55bfff700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff564074590 0x7ff564074a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:25.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff568ae7700 1 -- 172.21.15.80:0/946710383 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff564074590 msgr2=0x7ff564074a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:25.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff568ae7700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff564074590 0x7ff564074a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:25.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff568ae7700 1 -- 172.21.15.80:0/946710383 >> v1:172.21.15.80:6789/0 conn(0x7ff5640741a0 legacy=0x7ff564117630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:25.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff568ae7700 1 -- 172.21.15.80:0/946710383 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5640777a0 con 0x7ff564074f40 2019-11-28T11:53:25.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff5617fa700 1 -- 172.21.15.80:0/946710383 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930644058 0 0) 0x7ff554000fe0 con 0x7ff5640741a0 2019-11-28T11:53:25.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff568ae7700 1 --2- 172.21.15.80:0/946710383 >> v2:172.21.15.80:3300/0 conn(0x7ff564074f40 0x7ff56412cf50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff55c010730 tx=0x7ff55c00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:25.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff568ae7700 1 --2- 172.21.15.80:0/946710383 >> v2:172.21.15.80:3300/0 conn(0x7ff564074f40 0x7ff56412cf50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff55c010730 tx=0x7ff55c00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:25.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.603+0000 7ff568ae7700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff564074f40 0x7ff56412cf50 secure :-1 s=READY pgs=2361 cs=0 l=1 rx=0x7ff55c010730 tx=0x7ff55c00b670).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:25.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.604+0000 7ff568ae7700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff564074f40 0x7ff56412cf50 secure :-1 s=THROTTLE_DONE pgs=2361 cs=0 l=1 rx=0x7ff55c010730 tx=0x7ff55c00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:25.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.604+0000 7ff5617fa700 1 -- 172.21.15.80:0/946710383 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff55c000f40 con 0x7ff564074f40 2019-11-28T11:53:25.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.604+0000 7ff568ae7700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff564074f40 0x7ff56412cf50 secure :-1 s=THROTTLE_DONE pgs=2361 cs=0 l=1 rx=0x7ff55c010730 tx=0x7ff55c00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:25.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.604+0000 7ff5617fa700 1 -- 172.21.15.80:0/946710383 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c00f160 con 0x7ff564074f40 2019-11-28T11:53:25.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.604+0000 7ff568ae7700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff564074f40 0x7ff56412cf50 secure :-1 s=THROTTLE_DONE pgs=2361 cs=0 l=1 rx=0x7ff55c010730 tx=0x7ff55c00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:25.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.604+0000 7ff569d49700 1 -- 172.21.15.80:0/946710383 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff564077b20 con 0x7ff564074f40 2019-11-28T11:53:25.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.604+0000 7ff5617fa700 1 -- 172.21.15.80:0/946710383 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff55c00f350 con 0x7ff564074f40 2019-11-28T11:53:25.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.604+0000 7ff569d49700 1 -- 172.21.15.80:0/946710383 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5640777a0 con 0x7ff564074f40 2019-11-28T11:53:25.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.604+0000 7ff568ae7700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff564074f40 0x7ff56412cf50 secure :-1 s=THROTTLE_DONE pgs=2361 cs=0 l=1 rx=0x7ff55c010730 tx=0x7ff55c00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:25.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.604+0000 7ff5617fa700 1 -- 172.21.15.80:0/946710383 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff55c00f350 con 0x7ff564074f40 2019-11-28T11:53:25.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.604+0000 7ff568ae7700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff564074f40 0x7ff56412cf50 secure :-1 s=THROTTLE_DONE pgs=2361 cs=0 l=1 rx=0x7ff55c010730 tx=0x7ff55c00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:25.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.604+0000 7ff5617fa700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff53c018730 0x7ff53c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:25.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.604+0000 7ff5617fa700 1 -- 172.21.15.80:0/946710383 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7ff55c031d50 con 0x7ff564074f40 2019-11-28T11:53:25.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.605+0000 7ff563fff700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff53c018730 0x7ff53c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:25.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.605+0000 7ff563fff700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff53c018730 0x7ff53c01abc0 crc :-1 s=READY pgs=972 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:25.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.612+0000 7ff569d49700 1 -- 172.21.15.80:0/946710383 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff564077b20 con 0x7ff564074f40 2019-11-28T11:53:25.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.616+0000 7ff568ae7700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff564074f40 0x7ff56412cf50 secure :-1 s=THROTTLE_DONE pgs=2361 cs=0 l=1 rx=0x7ff55c010730 tx=0x7ff55c00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:25.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.616+0000 7ff5617fa700 1 -- 172.21.15.80:0/946710383 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff55c00ed60 con 0x7ff564074f40 2019-11-28T11:53:25.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.789+0000 7ff569d49700 1 -- 172.21.15.80:0/946710383 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5640777a0 con 0x7ff564074f40 2019-11-28T11:53:25.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.789+0000 7ff568ae7700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff564074f40 0x7ff56412cf50 secure :-1 s=THROTTLE_DONE pgs=2361 cs=0 l=1 rx=0x7ff55c010730 tx=0x7ff55c00b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:25.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.789+0000 7ff5617fa700 1 -- 172.21.15.80:0/946710383 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7ff55c00f350 con 0x7ff564074f40 2019-11-28T11:53:25.845 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:25.845 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:25.845 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.792+0000 7ff569d49700 1 -- 172.21.15.80:0/946710383 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff53c018730 msgr2=0x7ff53c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.792+0000 7ff569d49700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff53c018730 0x7ff53c01abc0 crc :-1 s=READY pgs=972 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.792+0000 7ff569d49700 1 -- 172.21.15.80:0/946710383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff564074f40 msgr2=0x7ff56412cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.792+0000 7ff569d49700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff564074f40 0x7ff56412cf50 secure :-1 s=READY pgs=2361 cs=0 l=1 rx=0x7ff55c010730 tx=0x7ff55c00b670).stop 2019-11-28T11:53:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.792+0000 7ff569d49700 1 -- 172.21.15.80:0/946710383 shutdown_connections 2019-11-28T11:53:25.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.792+0000 7ff569d49700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff53c018730 0x7ff53c01abc0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:25.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.792+0000 7ff569d49700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff564074f40 0x7ff56412cf50 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:25.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.792+0000 7ff569d49700 1 --2- 172.21.15.80:0/946710383 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff564074590 0x7ff564074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:25.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.792+0000 7ff569d49700 1 -- 172.21.15.80:0/946710383 shutdown_connections 2019-11-28T11:53:25.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.792+0000 7ff569d49700 1 -- 172.21.15.80:0/946710383 wait complete. 2019-11-28T11:53:25.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:25.792+0000 7ff569d49700 1 -- 172.21.15.80:0/946710383 >> 172.21.15.80:0/946710383 conn(0x7ff56413d930 msgr2=0x7ff56407b940 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:25.856 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:26.858 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:26.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.925+0000 7f2392668700 1 Processor -- start 2019-11-28T11:53:26.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.925+0000 7f2392668700 1 -- start start 2019-11-28T11:53:26.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.926+0000 7f2392668700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c06c0a0 0x7f238c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:26.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.926+0000 7f2392668700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f238c072620 0x7f238c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:26.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.926+0000 7f2392668700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238c06db00 con 0x7f238c0734e0 2019-11-28T11:53:26.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.926+0000 7f2392668700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238c06f330 con 0x7f238c072620 2019-11-28T11:53:26.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.926+0000 7f2392668700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0706c0 con 0x7f238c06c0a0 2019-11-28T11:53:26.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.926+0000 7f238bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f238c0734e0 0x7f238c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43264/0 (socket says 172.21.15.80:43264) 2019-11-28T11:53:26.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.926+0000 7f238bfff700 1 -- 172.21.15.80:0/1608261695 learned_addr learned my addr 172.21.15.80:0/1608261695 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:26.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.926+0000 7f2390c05700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c06c0a0 0x7f238c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:26.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.926+0000 7f2391406700 1 --2- 172.21.15.80:0/1608261695 >> v2:172.21.15.174:3300/0 conn(0x7f238c072620 0x7f238c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:26.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.926+0000 7f238b7fe700 1 -- 172.21.15.80:0/1608261695 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032796219 0 0) 0x7f237c0014d0 con 0x7f238c0734e0 2019-11-28T11:53:26.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.926+0000 7f238b7fe700 1 -- 172.21.15.80:0/1608261695 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2378002e80 con 0x7f238c0734e0 2019-11-28T11:53:26.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.926+0000 7f238b7fe700 1 -- 172.21.15.80:0/1608261695 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3288069019 0 0) 0x7f237c0014b0 con 0x7f238c0734e0 2019-11-28T11:53:26.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238b7fe700 1 -- 172.21.15.80:0/1608261695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c06c0a0 msgr2=0x7f238c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:26.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238b7fe700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c06c0a0 0x7f238c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:26.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238b7fe700 1 -- 172.21.15.80:0/1608261695 >> v2:172.21.15.174:3300/0 conn(0x7f238c072620 msgr2=0x7f238c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:26.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238b7fe700 1 --2- 172.21.15.80:0/1608261695 >> v2:172.21.15.174:3300/0 conn(0x7f238c072620 0x7f238c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:26.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238b7fe700 1 -- 172.21.15.80:0/1608261695 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c070a40 con 0x7f238c0734e0 2019-11-28T11:53:26.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238b7fe700 1 -- 172.21.15.80:0/1608261695 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f237c0019e0 con 0x7f238c0734e0 2019-11-28T11:53:26.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238b7fe700 1 -- 172.21.15.80:0/1608261695 >> v1:172.21.15.80:6789/0 conn(0x7f238c0734e0 legacy=0x7f238c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:26.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238b7fe700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2378047b30 0x7f2378049f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:26.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238b7fe700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f237804a710 0x7f237804cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:26.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238b7fe700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f237804d440 0x7f237804f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:26.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238b7fe700 1 -- 172.21.15.80:0/1608261695 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2378050090 con 0x7f2378047b30 2019-11-28T11:53:26.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238b7fe700 1 -- 172.21.15.80:0/1608261695 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23780502c0 con 0x7f237804a710 2019-11-28T11:53:26.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238b7fe700 1 -- 172.21.15.80:0/1608261695 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23780504f0 con 0x7f237804d440 2019-11-28T11:53:26.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2390c05700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c06c0a0 0x7f238c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:26.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2391406700 1 --2- 172.21.15.80:0/1608261695 >> v2:172.21.15.174:3300/0 conn(0x7f238c072620 0x7f238c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2390c05700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2378047b30 0x7f2378049f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238bfff700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f237804a710 0x7f237804cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2391406700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f237804d440 0x7f237804f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2390c05700 1 -- 172.21.15.80:0/1608261695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f237804d440 msgr2=0x7f237804f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2390c05700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f237804d440 0x7f237804f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:27.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2390c05700 1 -- 172.21.15.80:0/1608261695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f237804a710 msgr2=0x7f237804cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:27.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2390c05700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f237804a710 0x7f237804cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:27.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2390c05700 1 -- 172.21.15.80:0/1608261695 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23780507a0 con 0x7f2378047b30 2019-11-28T11:53:27.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2391406700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f237804d440 0x7f237804f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:53:27.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2390c05700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2378047b30 0x7f2378049f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f237400d180 tx=0x7f237400d4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:27.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2390c05700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2378047b30 0x7f2378049f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f237400d180 tx=0x7f237400d4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:27.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2390c05700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2378047b30 0x7f2378049f90 secure :-1 s=READY pgs=2363 cs=0 l=1 rx=0x7f237400d180 tx=0x7f237400d4e0).ready entity=mon.0 client_cookie=348fa52a330b3700 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:27.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2390c05700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2378047b30 0x7f2378049f90 secure :-1 s=THROTTLE_DONE pgs=2363 cs=0 l=1 rx=0x7f237400d180 tx=0x7f237400d4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:27.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238b7fe700 1 -- 172.21.15.80:0/1608261695 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f237400a750 con 0x7f2378047b30 2019-11-28T11:53:27.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2390c05700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2378047b30 0x7f2378049f90 secure :-1 s=THROTTLE_DONE pgs=2363 cs=0 l=1 rx=0x7f237400d180 tx=0x7f237400d4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:27.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2390c05700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2378047b30 0x7f2378049f90 secure :-1 s=THROTTLE_DONE pgs=2363 cs=0 l=1 rx=0x7f237400d180 tx=0x7f237400d4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:27.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238b7fe700 1 -- 172.21.15.80:0/1608261695 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23740098b0 con 0x7f2378047b30 2019-11-28T11:53:27.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f238b7fe700 1 -- 172.21.15.80:0/1608261695 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2374009f40 con 0x7f2378047b30 2019-11-28T11:53:27.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.927+0000 7f2392668700 1 -- 172.21.15.80:0/1608261695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2378047b30 msgr2=0x7f2378049f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:27.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.928+0000 7f2392668700 1 --2- 172.21.15.80:0/1608261695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2378047b30 0x7f2378049f90 secure :-1 s=READY pgs=2363 cs=0 l=1 rx=0x7f237400d180 tx=0x7f237400d4e0).stop 2019-11-28T11:53:27.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.928+0000 7f2391406700 1 -- 172.21.15.80:0/1608261695 reap_dead start 2019-11-28T11:53:27.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.928+0000 7f2392668700 1 -- 172.21.15.80:0/1608261695 shutdown_connections 2019-11-28T11:53:27.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.928+0000 7f2392668700 1 -- 172.21.15.80:0/1608261695 shutdown_connections 2019-11-28T11:53:27.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.928+0000 7f2392668700 1 -- 172.21.15.80:0/1608261695 wait complete. 2019-11-28T11:53:27.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.928+0000 7f2392668700 1 -- 172.21.15.80:0/1608261695 >> 172.21.15.80:0/1608261695 conn(0x7f238c061cf0 msgr2=0x7f238c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:27.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.931+0000 7f2392668700 1 Processor -- start 2019-11-28T11:53:27.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.931+0000 7f2392668700 1 -- start start 2019-11-28T11:53:27.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.932+0000 7f2392668700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f238c139620 0x7f238c139ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:27.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.932+0000 7f2392668700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c166ea0 0x7f238c1692a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:27.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.932+0000 7f2392668700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238c137060 con 0x7f238c106930 2019-11-28T11:53:27.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.932+0000 7f2392668700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238c114e70 con 0x7f238c139620 2019-11-28T11:53:27.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.932+0000 7f2392668700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c138890 con 0x7f238c166ea0 2019-11-28T11:53:27.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.932+0000 7f2391406700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c166ea0 0x7f238c1692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:27.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.932+0000 7f238bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f238c139620 0x7f238c139ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:27.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.932+0000 7f2391406700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c166ea0 0x7f238c1692a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:46224/0 (socket says 172.21.15.80:46224) 2019-11-28T11:53:27.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.932+0000 7f2391406700 1 -- 172.21.15.80:0/1483424422 learned_addr learned my addr 172.21.15.80:0/1483424422 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:27.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.932+0000 7f2391406700 1 -- 172.21.15.80:0/1483424422 >> v2:172.21.15.174:3300/0 conn(0x7f238c139620 msgr2=0x7f238c139ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:27.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.932+0000 7f2391406700 1 --2- 172.21.15.80:0/1483424422 >> v2:172.21.15.174:3300/0 conn(0x7f238c139620 0x7f238c139ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:27.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.932+0000 7f2391406700 1 -- 172.21.15.80:0/1483424422 >> v1:172.21.15.174:6789/0 conn(0x7f238c106930 legacy=0x7f238c13a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:27.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.932+0000 7f2391406700 1 -- 172.21.15.80:0/1483424422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c115500 con 0x7f238c166ea0 2019-11-28T11:53:27.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.932+0000 7f2391406700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c166ea0 0x7f238c1692a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2384010430 tx=0x7f23840102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:27.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.932+0000 7f2391406700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c166ea0 0x7f238c1692a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2384010430 tx=0x7f23840102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:27.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.932+0000 7f2391406700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c166ea0 0x7f238c1692a0 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7f2384010430 tx=0x7f23840102b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:27.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.933+0000 7f2391406700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c166ea0 0x7f238c1692a0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f2384010430 tx=0x7f23840102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:27.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.933+0000 7f2391406700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c166ea0 0x7f238c1692a0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f2384010430 tx=0x7f23840102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:27.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.933+0000 7f23897fa700 1 -- 172.21.15.80:0/1483424422 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2384009990 con 0x7f238c166ea0 2019-11-28T11:53:27.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.933+0000 7f2391406700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c166ea0 0x7f238c1692a0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f2384010430 tx=0x7f23840102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:27.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.933+0000 7f23897fa700 1 -- 172.21.15.80:0/1483424422 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23840095b0 con 0x7f238c166ea0 2019-11-28T11:53:27.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.933+0000 7f2392668700 1 -- 172.21.15.80:0/1483424422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238c115880 con 0x7f238c166ea0 2019-11-28T11:53:27.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.933+0000 7f23897fa700 1 -- 172.21.15.80:0/1483424422 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2384009f70 con 0x7f238c166ea0 2019-11-28T11:53:27.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.933+0000 7f2392668700 1 -- 172.21.15.80:0/1483424422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238c1147b0 con 0x7f238c166ea0 2019-11-28T11:53:27.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.933+0000 7f2391406700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c166ea0 0x7f238c1692a0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f2384010430 tx=0x7f23840102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:27.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.933+0000 7f23897fa700 1 -- 172.21.15.80:0/1483424422 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f23840097a0 con 0x7f238c166ea0 2019-11-28T11:53:27.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.933+0000 7f2391406700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c166ea0 0x7f238c1692a0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f2384010430 tx=0x7f23840102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:27.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.933+0000 7f23897fa700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2370018730 0x7f237001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:27.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.933+0000 7f23897fa700 1 -- 172.21.15.80:0/1483424422 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f2384031ad0 con 0x7f238c166ea0 2019-11-28T11:53:27.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.934+0000 7f2390c05700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2370018730 0x7f237001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:27.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.934+0000 7f2390c05700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2370018730 0x7f237001abc0 crc :-1 s=READY pgs=973 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:27.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.940+0000 7f2392668700 1 -- 172.21.15.80:0/1483424422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238c115500 con 0x7f238c166ea0 2019-11-28T11:53:27.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.944+0000 7f2391406700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c166ea0 0x7f238c1692a0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f2384010430 tx=0x7f23840102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:27.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:26.944+0000 7f23897fa700 1 -- 172.21.15.80:0/1483424422 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2384002ae0 con 0x7f238c166ea0 2019-11-28T11:53:27.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:27.115+0000 7f2392668700 1 -- 172.21.15.80:0/1483424422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f238c115880 con 0x7f238c166ea0 2019-11-28T11:53:27.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:27.117+0000 7f2391406700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c166ea0 0x7f238c1692a0 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7f2384010430 tx=0x7f23840102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:27.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:27.117+0000 7f23897fa700 1 -- 172.21.15.80:0/1483424422 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f23840097a0 con 0x7f238c166ea0 2019-11-28T11:53:27.171 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:27.172 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:27.172 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:27.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:27.118+0000 7f2392668700 1 -- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2370018730 msgr2=0x7f237001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:27.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:27.118+0000 7f2392668700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2370018730 0x7f237001abc0 crc :-1 s=READY pgs=973 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:27.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:27.118+0000 7f2392668700 1 -- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c166ea0 msgr2=0x7f238c1692a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:27.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:27.118+0000 7f2392668700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c166ea0 0x7f238c1692a0 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7f2384010430 tx=0x7f23840102b0).stop 2019-11-28T11:53:27.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:27.118+0000 7f2392668700 1 -- 172.21.15.80:0/1483424422 shutdown_connections 2019-11-28T11:53:27.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:27.118+0000 7f2392668700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238c166ea0 0x7f238c1692a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:27.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:27.118+0000 7f2392668700 1 --2- 172.21.15.80:0/1483424422 >> v2:172.21.15.174:3300/0 conn(0x7f238c139620 0x7f238c139ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:27.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:27.118+0000 7f2392668700 1 --2- 172.21.15.80:0/1483424422 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2370018730 0x7f237001abc0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:27.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:27.118+0000 7f2392668700 1 -- 172.21.15.80:0/1483424422 shutdown_connections 2019-11-28T11:53:27.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:27.118+0000 7f2392668700 1 -- 172.21.15.80:0/1483424422 wait complete. 2019-11-28T11:53:27.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:27.118+0000 7f2392668700 1 -- 172.21.15.80:0/1483424422 >> 172.21.15.80:0/1483424422 conn(0x7f238c141d10 msgr2=0x7f238c13ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:27.183 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:28.184 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:28.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.250+0000 7f8877897700 1 Processor -- start 2019-11-28T11:53:28.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.250+0000 7f8877897700 1 -- start start 2019-11-28T11:53:28.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.251+0000 7f8877897700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f887006d120 0x7f8870165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:28.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.251+0000 7f8877897700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887006d5a0 con 0x7f887006c490 2019-11-28T11:53:28.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.251+0000 7f8877897700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887006db00 con 0x7f887006c0a0 2019-11-28T11:53:28.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.251+0000 7f8877897700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887006fd60 con 0x7f887006d120 2019-11-28T11:53:28.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.251+0000 7f8876635700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f887006d120 0x7f8870165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:28.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.251+0000 7f8875633700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f887006c490 0x7f887006c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43288/0 (socket says 172.21.15.80:43288) 2019-11-28T11:53:28.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.251+0000 7f8875633700 1 -- 172.21.15.80:0/1368490437 learned_addr learned my addr 172.21.15.80:0/1368490437 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:28.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.252+0000 7f8876635700 1 -- 172.21.15.80:0/1368490437 >> v1:172.21.15.174:6789/0 conn(0x7f887006c0a0 legacy=0x7f8870072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:28.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.252+0000 7f8876635700 1 -- 172.21.15.80:0/1368490437 >> v1:172.21.15.80:6789/0 conn(0x7f887006c490 legacy=0x7f887006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:28.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.252+0000 7f8876635700 1 -- 172.21.15.80:0/1368490437 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88700706c0 con 0x7f887006d120 2019-11-28T11:53:28.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.252+0000 7f8874e32700 1 -- 172.21.15.80:0/1368490437 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333606580 0 0) 0x7f8860001100 con 0x7f887006c490 2019-11-28T11:53:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.252+0000 7f8876635700 1 --2- 172.21.15.80:0/1368490437 >> v2:172.21.15.80:3300/0 conn(0x7f887006d120 0x7f8870165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f886800af50 tx=0x7f886800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.252+0000 7f8876635700 1 --2- 172.21.15.80:0/1368490437 >> v2:172.21.15.80:3300/0 conn(0x7f887006d120 0x7f8870165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f886800af50 tx=0x7f886800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.252+0000 7f8876635700 1 --2- 172.21.15.80:0/1368490437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f887006d120 0x7f8870165d80 secure :-1 s=READY pgs=2365 cs=0 l=1 rx=0x7f886800af50 tx=0x7f886800b760).ready entity=mon.0 client_cookie=120e41da83d4bd6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:28.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.252+0000 7f8876635700 1 --2- 172.21.15.80:0/1368490437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f887006d120 0x7f8870165d80 secure :-1 s=THROTTLE_DONE pgs=2365 cs=0 l=1 rx=0x7f886800af50 tx=0x7f886800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.252+0000 7f8874e32700 1 -- 172.21.15.80:0/1368490437 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8868009ba0 con 0x7f887006d120 2019-11-28T11:53:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.252+0000 7f8876635700 1 --2- 172.21.15.80:0/1368490437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f887006d120 0x7f8870165d80 secure :-1 s=THROTTLE_DONE pgs=2365 cs=0 l=1 rx=0x7f886800af50 tx=0x7f886800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.252+0000 7f8876635700 1 --2- 172.21.15.80:0/1368490437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f887006d120 0x7f8870165d80 secure :-1 s=THROTTLE_DONE pgs=2365 cs=0 l=1 rx=0x7f886800af50 tx=0x7f886800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:28.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.252+0000 7f8874e32700 1 -- 172.21.15.80:0/1368490437 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8868000a70 con 0x7f887006d120 2019-11-28T11:53:28.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.252+0000 7f8874e32700 1 -- 172.21.15.80:0/1368490437 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f886800a180 con 0x7f887006d120 2019-11-28T11:53:28.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.252+0000 7f8877897700 1 -- 172.21.15.80:0/1368490437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f887006d120 msgr2=0x7f8870165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:28.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.252+0000 7f8877897700 1 --2- 172.21.15.80:0/1368490437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f887006d120 0x7f8870165d80 secure :-1 s=READY pgs=2365 cs=0 l=1 rx=0x7f886800af50 tx=0x7f886800b760).stop 2019-11-28T11:53:28.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.253+0000 7f8877897700 1 -- 172.21.15.80:0/1368490437 shutdown_connections 2019-11-28T11:53:28.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.253+0000 7f8877897700 1 --2- 172.21.15.80:0/1368490437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f887006d120 0x7f8870165d80 unknown :-1 s=CLOSED pgs=2365 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:28.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.253+0000 7f8877897700 1 -- 172.21.15.80:0/1368490437 shutdown_connections 2019-11-28T11:53:28.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.253+0000 7f8877897700 1 -- 172.21.15.80:0/1368490437 wait complete. 2019-11-28T11:53:28.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.253+0000 7f8877897700 1 -- 172.21.15.80:0/1368490437 >> 172.21.15.80:0/1368490437 conn(0x7f8870061cf0 msgr2=0x7f8870064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:28.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.255+0000 7f8877897700 1 Processor -- start 2019-11-28T11:53:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.255+0000 7f8877897700 1 -- start start 2019-11-28T11:53:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.256+0000 7f8877897700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f88701277f0 0x7f887010f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.256+0000 7f8877897700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8870102680 con 0x7f8870142ff0 2019-11-28T11:53:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.256+0000 7f8877897700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8870158e00 con 0x7f8870127360 2019-11-28T11:53:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.256+0000 7f8877897700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8870110350 con 0x7f88701277f0 2019-11-28T11:53:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.256+0000 7f8876635700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f88701277f0 0x7f887010f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:28.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.256+0000 7f8876635700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f88701277f0 0x7f887010f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43976/0 (socket says 172.21.15.80:43976) 2019-11-28T11:53:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.256+0000 7f8876635700 1 -- 172.21.15.80:0/2177878282 learned_addr learned my addr 172.21.15.80:0/2177878282 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.257+0000 7f8876635700 1 -- 172.21.15.80:0/2177878282 >> v1:172.21.15.174:6789/0 conn(0x7f8870127360 legacy=0x7f887010ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:28.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.257+0000 7f8876635700 1 -- 172.21.15.80:0/2177878282 >> v1:172.21.15.80:6789/0 conn(0x7f8870142ff0 legacy=0x7f887015a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.257+0000 7f8876635700 1 -- 172.21.15.80:0/2177878282 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8870110cb0 con 0x7f88701277f0 2019-11-28T11:53:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.257+0000 7f886e7fc700 1 -- 172.21.15.80:0/2177878282 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955386578 0 0) 0x7f8858001440 con 0x7f8870142ff0 2019-11-28T11:53:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.257+0000 7f8876635700 1 --2- 172.21.15.80:0/2177878282 >> v2:172.21.15.80:3300/0 conn(0x7f88701277f0 0x7f887010f260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8868010450 tx=0x7f88680107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.257+0000 7f8876635700 1 --2- 172.21.15.80:0/2177878282 >> v2:172.21.15.80:3300/0 conn(0x7f88701277f0 0x7f887010f260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8868010450 tx=0x7f88680107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:28.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.257+0000 7f8876635700 1 --2- 172.21.15.80:0/2177878282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88701277f0 0x7f887010f260 secure :-1 s=READY pgs=2367 cs=0 l=1 rx=0x7f8868010450 tx=0x7f88680107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.257+0000 7f8876635700 1 --2- 172.21.15.80:0/2177878282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88701277f0 0x7f887010f260 secure :-1 s=THROTTLE_DONE pgs=2367 cs=0 l=1 rx=0x7f8868010450 tx=0x7f88680107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.257+0000 7f886e7fc700 1 -- 172.21.15.80:0/2177878282 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f886800af20 con 0x7f88701277f0 2019-11-28T11:53:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.257+0000 7f8876635700 1 --2- 172.21.15.80:0/2177878282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88701277f0 0x7f887010f260 secure :-1 s=THROTTLE_DONE pgs=2367 cs=0 l=1 rx=0x7f8868010450 tx=0x7f88680107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:28.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.257+0000 7f8876635700 1 --2- 172.21.15.80:0/2177878282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88701277f0 0x7f887010f260 secure :-1 s=THROTTLE_DONE pgs=2367 cs=0 l=1 rx=0x7f8868010450 tx=0x7f88680107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.257+0000 7f886e7fc700 1 -- 172.21.15.80:0/2177878282 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8868009770 con 0x7f88701277f0 2019-11-28T11:53:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.257+0000 7f8877897700 1 -- 172.21.15.80:0/2177878282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8870111030 con 0x7f88701277f0 2019-11-28T11:53:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.257+0000 7f886e7fc700 1 -- 172.21.15.80:0/2177878282 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f886800af20 con 0x7f88701277f0 2019-11-28T11:53:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.257+0000 7f8877897700 1 -- 172.21.15.80:0/2177878282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8870110cb0 con 0x7f88701277f0 2019-11-28T11:53:28.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.257+0000 7f8876635700 1 --2- 172.21.15.80:0/2177878282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88701277f0 0x7f887010f260 secure :-1 s=THROTTLE_DONE pgs=2367 cs=0 l=1 rx=0x7f8868010450 tx=0x7f88680107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.258+0000 7f886e7fc700 1 -- 172.21.15.80:0/2177878282 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f886800ae30 con 0x7f88701277f0 2019-11-28T11:53:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.258+0000 7f8876635700 1 --2- 172.21.15.80:0/2177878282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88701277f0 0x7f887010f260 secure :-1 s=THROTTLE_DONE pgs=2367 cs=0 l=1 rx=0x7f8868010450 tx=0x7f88680107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.258+0000 7f886e7fc700 1 --2- 172.21.15.80:0/2177878282 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8854018730 0x7f885401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.258+0000 7f886e7fc700 1 -- 172.21.15.80:0/2177878282 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8868031b40 con 0x7f88701277f0 2019-11-28T11:53:28.326 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.258+0000 7f8875e34700 1 --2- 172.21.15.80:0/2177878282 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8854018730 0x7f885401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.258+0000 7f8875e34700 1 --2- 172.21.15.80:0/2177878282 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8854018730 0x7f885401abc0 crc :-1 s=READY pgs=974 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:28.327 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.266+0000 7f8877897700 1 -- 172.21.15.80:0/2177878282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8870111030 con 0x7f88701277f0 2019-11-28T11:53:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.269+0000 7f8876635700 1 --2- 172.21.15.80:0/2177878282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88701277f0 0x7f887010f260 secure :-1 s=THROTTLE_DONE pgs=2367 cs=0 l=1 rx=0x7f8868010450 tx=0x7f88680107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:28.328 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.269+0000 7f886e7fc700 1 -- 172.21.15.80:0/2177878282 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8868025ec0 con 0x7f88701277f0 2019-11-28T11:53:28.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.441+0000 7f8877897700 1 -- 172.21.15.80:0/2177878282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8870110cb0 con 0x7f88701277f0 2019-11-28T11:53:28.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.441+0000 7f8876635700 1 --2- 172.21.15.80:0/2177878282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88701277f0 0x7f887010f260 secure :-1 s=THROTTLE_DONE pgs=2367 cs=0 l=1 rx=0x7f8868010450 tx=0x7f88680107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:28.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.441+0000 7f886e7fc700 1 -- 172.21.15.80:0/2177878282 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f8868025a90 con 0x7f88701277f0 2019-11-28T11:53:28.496 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:28.497 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:28.497 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:28.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.444+0000 7f8877897700 1 -- 172.21.15.80:0/2177878282 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8854018730 msgr2=0x7f885401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:28.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.444+0000 7f8877897700 1 --2- 172.21.15.80:0/2177878282 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8854018730 0x7f885401abc0 crc :-1 s=READY pgs=974 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:28.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.444+0000 7f8877897700 1 -- 172.21.15.80:0/2177878282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88701277f0 msgr2=0x7f887010f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:28.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.444+0000 7f8877897700 1 --2- 172.21.15.80:0/2177878282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88701277f0 0x7f887010f260 secure :-1 s=READY pgs=2367 cs=0 l=1 rx=0x7f8868010450 tx=0x7f88680107f0).stop 2019-11-28T11:53:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.444+0000 7f8877897700 1 -- 172.21.15.80:0/2177878282 shutdown_connections 2019-11-28T11:53:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.444+0000 7f8877897700 1 --2- 172.21.15.80:0/2177878282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f88701277f0 0x7f887010f260 unknown :-1 s=CLOSED pgs=2367 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.444+0000 7f8877897700 1 --2- 172.21.15.80:0/2177878282 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8854018730 0x7f885401abc0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.444+0000 7f8877897700 1 -- 172.21.15.80:0/2177878282 shutdown_connections 2019-11-28T11:53:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.444+0000 7f8877897700 1 -- 172.21.15.80:0/2177878282 wait complete. 2019-11-28T11:53:28.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:28.444+0000 7f8877897700 1 -- 172.21.15.80:0/2177878282 >> 172.21.15.80:0/2177878282 conn(0x7f887007c680 msgr2=0x7f8870112150 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:28.508 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:29.509 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:29.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.575+0000 7ff5c74c8700 1 Processor -- start 2019-11-28T11:53:29.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.575+0000 7ff5c74c8700 1 -- start start 2019-11-28T11:53:29.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.576+0000 7ff5c74c8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5c006c0a0 0x7ff5c0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:29.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.576+0000 7ff5c74c8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5c0072620 0x7ff5c0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:29.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.576+0000 7ff5c74c8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c006db00 con 0x7ff5c00734e0 2019-11-28T11:53:29.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.576+0000 7ff5c74c8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c006fd60 con 0x7ff5c006c0a0 2019-11-28T11:53:29.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.576+0000 7ff5c74c8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c0070030 con 0x7ff5c0072620 2019-11-28T11:53:29.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.576+0000 7ff5c5a65700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5c006c0a0 0x7ff5c0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:29.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.576+0000 7ff5c5a65700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5c006c0a0 0x7ff5c0072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43982/0 (socket says 172.21.15.80:43982) 2019-11-28T11:53:29.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.576+0000 7ff5c5a65700 1 -- 172.21.15.80:0/1185949615 learned_addr learned my addr 172.21.15.80:0/1185949615 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:29.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.576+0000 7ff5c6266700 1 --2- 172.21.15.80:0/1185949615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5c0072620 0x7ff5c0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:29.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.577+0000 7ff5c5a65700 1 -- 172.21.15.80:0/1185949615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5c0072620 msgr2=0x7ff5c0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:29.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.577+0000 7ff5c5a65700 1 --2- 172.21.15.80:0/1185949615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5c0072620 0x7ff5c0164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:29.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.577+0000 7ff5c5a65700 1 -- 172.21.15.80:0/1185949615 >> v1:172.21.15.174:6789/0 conn(0x7ff5c00734e0 legacy=0x7ff5c0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:29.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.577+0000 7ff5c5a65700 1 -- 172.21.15.80:0/1185949615 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c00706c0 con 0x7ff5c006c0a0 2019-11-28T11:53:29.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.577+0000 7ff5c6266700 1 --2- 172.21.15.80:0/1185949615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5c0072620 0x7ff5c0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:53:29.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.577+0000 7ff5c5a65700 1 --2- 172.21.15.80:0/1185949615 >> v2:172.21.15.80:3300/0 conn(0x7ff5c006c0a0 0x7ff5c0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff5a800fac0 tx=0x7ff5a800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:29.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.577+0000 7ff5c5a65700 1 --2- 172.21.15.80:0/1185949615 >> v2:172.21.15.80:3300/0 conn(0x7ff5c006c0a0 0x7ff5c0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff5a800fac0 tx=0x7ff5a800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:29.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.577+0000 7ff5c5a65700 1 --2- 172.21.15.80:0/1185949615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c006c0a0 0x7ff5c0072fa0 secure :-1 s=READY pgs=2368 cs=0 l=1 rx=0x7ff5a800fac0 tx=0x7ff5a800fe60).ready entity=mon.0 client_cookie=a77a3a39f5233bbf server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:29.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.577+0000 7ff5c5a65700 1 --2- 172.21.15.80:0/1185949615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c006c0a0 0x7ff5c0072fa0 secure :-1 s=THROTTLE_DONE pgs=2368 cs=0 l=1 rx=0x7ff5a800fac0 tx=0x7ff5a800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.577+0000 7ff5c5a65700 1 --2- 172.21.15.80:0/1185949615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c006c0a0 0x7ff5c0072fa0 secure :-1 s=THROTTLE_DONE pgs=2368 cs=0 l=1 rx=0x7ff5a800fac0 tx=0x7ff5a800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.577+0000 7ff5c5a65700 1 --2- 172.21.15.80:0/1185949615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c006c0a0 0x7ff5c0072fa0 secure :-1 s=THROTTLE_DONE pgs=2368 cs=0 l=1 rx=0x7ff5a800fac0 tx=0x7ff5a800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.577+0000 7ff5c4a63700 1 -- 172.21.15.80:0/1185949615 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5a8000ce0 con 0x7ff5c006c0a0 2019-11-28T11:53:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.577+0000 7ff5c4a63700 1 -- 172.21.15.80:0/1185949615 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a8001010 con 0x7ff5c006c0a0 2019-11-28T11:53:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.577+0000 7ff5c4a63700 1 -- 172.21.15.80:0/1185949615 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5a8001760 con 0x7ff5c006c0a0 2019-11-28T11:53:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.577+0000 7ff5c74c8700 1 -- 172.21.15.80:0/1185949615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c006c0a0 msgr2=0x7ff5c0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:29.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.577+0000 7ff5c74c8700 1 --2- 172.21.15.80:0/1185949615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c006c0a0 0x7ff5c0072fa0 secure :-1 s=READY pgs=2368 cs=0 l=1 rx=0x7ff5a800fac0 tx=0x7ff5a800fe60).stop 2019-11-28T11:53:29.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.578+0000 7ff5c74c8700 1 -- 172.21.15.80:0/1185949615 shutdown_connections 2019-11-28T11:53:29.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.578+0000 7ff5c74c8700 1 --2- 172.21.15.80:0/1185949615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5c0072620 0x7ff5c0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:29.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.578+0000 7ff5c74c8700 1 --2- 172.21.15.80:0/1185949615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c006c0a0 0x7ff5c0072fa0 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:29.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.578+0000 7ff5c74c8700 1 -- 172.21.15.80:0/1185949615 shutdown_connections 2019-11-28T11:53:29.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.578+0000 7ff5c74c8700 1 -- 172.21.15.80:0/1185949615 wait complete. 2019-11-28T11:53:29.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.578+0000 7ff5c74c8700 1 -- 172.21.15.80:0/1185949615 >> 172.21.15.80:0/1185949615 conn(0x7ff5c0061cf0 msgr2=0x7ff5c0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:29.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.580+0000 7ff5c74c8700 1 Processor -- start 2019-11-28T11:53:29.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.580+0000 7ff5c74c8700 1 -- start start 2019-11-28T11:53:29.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.581+0000 7ff5c74c8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5c0140cd0 0x7ff5c015fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:29.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.581+0000 7ff5c74c8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff5c015f2e0 0x7ff5c01ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:29.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.581+0000 7ff5c74c8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c0126790 con 0x7ff5c01601a0 2019-11-28T11:53:29.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.581+0000 7ff5c74c8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c0110180 con 0x7ff5c015f2e0 2019-11-28T11:53:29.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.581+0000 7ff5c74c8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c0110450 con 0x7ff5c0140cd0 2019-11-28T11:53:29.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.581+0000 7ff5c5264700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff5c01601a0 0x7ff5c015eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58848/0 (socket says 172.21.15.80:58848) 2019-11-28T11:53:29.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.581+0000 7ff5c5264700 1 -- 172.21.15.80:0/2418670942 learned_addr learned my addr 172.21.15.80:0/2418670942 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:29.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.581+0000 7ff5c5a65700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5c0140cd0 0x7ff5c015fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:29.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.581+0000 7ff5c6266700 1 --2- 172.21.15.80:0/2418670942 >> v2:172.21.15.174:3300/0 conn(0x7ff5c015f2e0 0x7ff5c01ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:29.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.581+0000 7ff5be7fc700 1 -- 172.21.15.80:0/2418670942 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758255764 0 0) 0x7ff5b0000b10 con 0x7ff5c01601a0 2019-11-28T11:53:29.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.581+0000 7ff5be7fc700 1 -- 172.21.15.80:0/2418670942 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5a4002e80 con 0x7ff5c01601a0 2019-11-28T11:53:29.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5c6266700 1 -- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5c0140cd0 msgr2=0x7ff5c015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:29.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5c6266700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5c0140cd0 0x7ff5c015fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:29.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5c6266700 1 -- 172.21.15.80:0/2418670942 >> v1:172.21.15.174:6789/0 conn(0x7ff5c01601a0 legacy=0x7ff5c015eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:29.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5c6266700 1 -- 172.21.15.80:0/2418670942 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c0111510 con 0x7ff5c015f2e0 2019-11-28T11:53:29.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5c5a65700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5c0140cd0 0x7ff5c015fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:29.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5c6266700 1 --2- 172.21.15.80:0/2418670942 >> v2:172.21.15.174:3300/0 conn(0x7ff5c015f2e0 0x7ff5c01ad2e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5b80103a0 tx=0x7ff5b8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:29.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5c6266700 1 --2- 172.21.15.80:0/2418670942 >> v2:172.21.15.174:3300/0 conn(0x7ff5c015f2e0 0x7ff5c01ad2e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5b80103a0 tx=0x7ff5b8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:29.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5c6266700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5c015f2e0 0x7ff5c01ad2e0 secure :-1 s=READY pgs=1428 cs=0 l=1 rx=0x7ff5b80103a0 tx=0x7ff5b8010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:29.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5c6266700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5c015f2e0 0x7ff5c01ad2e0 secure :-1 s=THROTTLE_DONE pgs=1428 cs=0 l=1 rx=0x7ff5b80103a0 tx=0x7ff5b8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:29.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5be7fc700 1 -- 172.21.15.80:0/2418670942 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5b8002b20 con 0x7ff5c015f2e0 2019-11-28T11:53:29.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5c6266700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5c015f2e0 0x7ff5c01ad2e0 secure :-1 s=THROTTLE_DONE pgs=1428 cs=0 l=1 rx=0x7ff5b80103a0 tx=0x7ff5b8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:29.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5be7fc700 1 -- 172.21.15.80:0/2418670942 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b8002b20 con 0x7ff5c015f2e0 2019-11-28T11:53:29.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5c6266700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5c015f2e0 0x7ff5c01ad2e0 secure :-1 s=THROTTLE_DONE pgs=1428 cs=0 l=1 rx=0x7ff5b80103a0 tx=0x7ff5b8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:29.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5c74c8700 1 -- 172.21.15.80:0/2418670942 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c0111890 con 0x7ff5c015f2e0 2019-11-28T11:53:29.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5be7fc700 1 -- 172.21.15.80:0/2418670942 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5b8009d10 con 0x7ff5c015f2e0 2019-11-28T11:53:29.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5c74c8700 1 -- 172.21.15.80:0/2418670942 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c0112970 con 0x7ff5c015f2e0 2019-11-28T11:53:29.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.582+0000 7ff5c6266700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5c015f2e0 0x7ff5c01ad2e0 secure :-1 s=THROTTLE_DONE pgs=1428 cs=0 l=1 rx=0x7ff5b80103a0 tx=0x7ff5b8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:29.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.583+0000 7ff5be7fc700 1 -- 172.21.15.80:0/2418670942 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff5b8005310 con 0x7ff5c015f2e0 2019-11-28T11:53:29.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.583+0000 7ff5c6266700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5c015f2e0 0x7ff5c01ad2e0 secure :-1 s=THROTTLE_DONE pgs=1428 cs=0 l=1 rx=0x7ff5b80103a0 tx=0x7ff5b8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:29.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.583+0000 7ff5be7fc700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5a4018770 0x7ff5a401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:29.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.583+0000 7ff5be7fc700 1 -- 172.21.15.80:0/2418670942 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7ff5b8031c80 con 0x7ff5c015f2e0 2019-11-28T11:53:29.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.583+0000 7ff5c5a65700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5a4018770 0x7ff5a401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:29.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.583+0000 7ff5c5a65700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5a4018770 0x7ff5a401abe0 crc :-1 s=READY pgs=975 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.590+0000 7ff5c74c8700 1 -- 172.21.15.80:0/2418670942 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c0111510 con 0x7ff5c015f2e0 2019-11-28T11:53:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.594+0000 7ff5c6266700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5c015f2e0 0x7ff5c01ad2e0 secure :-1 s=THROTTLE_DONE pgs=1428 cs=0 l=1 rx=0x7ff5b80103a0 tx=0x7ff5b8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:29.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.594+0000 7ff5be7fc700 1 -- 172.21.15.80:0/2418670942 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff5b8009a00 con 0x7ff5c015f2e0 2019-11-28T11:53:29.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.768+0000 7ff5c74c8700 1 -- 172.21.15.80:0/2418670942 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5c0111890 con 0x7ff5c015f2e0 2019-11-28T11:53:29.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.768+0000 7ff5c6266700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5c015f2e0 0x7ff5c01ad2e0 secure :-1 s=THROTTLE_DONE pgs=1428 cs=0 l=1 rx=0x7ff5b80103a0 tx=0x7ff5b8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:29.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.769+0000 7ff5be7fc700 1 -- 172.21.15.80:0/2418670942 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7ff5b8005c80 con 0x7ff5c015f2e0 2019-11-28T11:53:29.823 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:29.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.771+0000 7ff5c74c8700 1 -- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5a4018770 msgr2=0x7ff5a401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:29.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.771+0000 7ff5c74c8700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5a4018770 0x7ff5a401abe0 crc :-1 s=READY pgs=975 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:29.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.771+0000 7ff5c74c8700 1 -- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5c015f2e0 msgr2=0x7ff5c01ad2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:29.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.771+0000 7ff5c74c8700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5c015f2e0 0x7ff5c01ad2e0 secure :-1 s=READY pgs=1428 cs=0 l=1 rx=0x7ff5b80103a0 tx=0x7ff5b8010740).stop 2019-11-28T11:53:29.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.771+0000 7ff5c74c8700 1 -- 172.21.15.80:0/2418670942 shutdown_connections 2019-11-28T11:53:29.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.771+0000 7ff5c74c8700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5c015f2e0 0x7ff5c01ad2e0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:29.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.771+0000 7ff5c74c8700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5a4018770 0x7ff5a401abe0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:29.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.771+0000 7ff5c74c8700 1 --2- 172.21.15.80:0/2418670942 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5c0140cd0 0x7ff5c015fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:29.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.771+0000 7ff5c74c8700 1 -- 172.21.15.80:0/2418670942 shutdown_connections 2019-11-28T11:53:29.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.771+0000 7ff5c74c8700 1 -- 172.21.15.80:0/2418670942 wait complete. 2019-11-28T11:53:29.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:29.771+0000 7ff5c74c8700 1 -- 172.21.15.80:0/2418670942 >> 172.21.15.80:0/2418670942 conn(0x7ff5c015dfd0 msgr2=0x7ff5c0159ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:29.835 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:30.836 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:30.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.910+0000 7f30415fe700 1 Processor -- start 2019-11-28T11:53:30.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.910+0000 7f30415fe700 1 -- start start 2019-11-28T11:53:30.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.911+0000 7f30415fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c06c0a0 0x7f303c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:30.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.911+0000 7f30415fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f303c0734e0 0x7f303c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:30.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.911+0000 7f30415fe700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303c06db00 con 0x7f303c072360 2019-11-28T11:53:30.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.911+0000 7f30415fe700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303c06f330 con 0x7f303c0734e0 2019-11-28T11:53:30.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.911+0000 7f30415fe700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c0706c0 con 0x7f303c06c0a0 2019-11-28T11:53:30.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.911+0000 7f303affd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f303c0734e0 0x7f303c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:30.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303affd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f303c0734e0 0x7f303c071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44000/0 (socket says 172.21.15.80:44000) 2019-11-28T11:53:30.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303affd700 1 -- 172.21.15.80:0/1891561452 learned_addr learned my addr 172.21.15.80:0/1891561452 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:30.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303b7fe700 1 --2- 172.21.15.80:0/1891561452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c06c0a0 0x7f303c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303affd700 1 -- 172.21.15.80:0/1891561452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c06c0a0 msgr2=0x7f303c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303affd700 1 --2- 172.21.15.80:0/1891561452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c06c0a0 0x7f303c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303affd700 1 -- 172.21.15.80:0/1891561452 >> v1:172.21.15.174:6789/0 conn(0x7f303c072360 legacy=0x7f303c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303affd700 1 -- 172.21.15.80:0/1891561452 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c070a40 con 0x7f303c0734e0 2019-11-28T11:53:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303b7fe700 1 --2- 172.21.15.80:0/1891561452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c06c0a0 0x7f303c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:53:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303affd700 1 --2- 172.21.15.80:0/1891561452 >> v2:172.21.15.80:3300/0 conn(0x7f303c0734e0 0x7f303c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f302c00f740 tx=0x7f302c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303affd700 1 --2- 172.21.15.80:0/1891561452 >> v2:172.21.15.80:3300/0 conn(0x7f303c0734e0 0x7f303c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f302c00f740 tx=0x7f302c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303affd700 1 --2- 172.21.15.80:0/1891561452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f303c0734e0 0x7f303c071e20 secure :-1 s=READY pgs=2369 cs=0 l=1 rx=0x7f302c00f740 tx=0x7f302c00fae0).ready entity=mon.0 client_cookie=46482cb33fbf5d6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303affd700 1 --2- 172.21.15.80:0/1891561452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f303c0734e0 0x7f303c071e20 secure :-1 s=THROTTLE_DONE pgs=2369 cs=0 l=1 rx=0x7f302c00f740 tx=0x7f302c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303affd700 1 --2- 172.21.15.80:0/1891561452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f303c0734e0 0x7f303c071e20 secure :-1 s=THROTTLE_DONE pgs=2369 cs=0 l=1 rx=0x7f302c00f740 tx=0x7f302c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303affd700 1 --2- 172.21.15.80:0/1891561452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f303c0734e0 0x7f303c071e20 secure :-1 s=THROTTLE_DONE pgs=2369 cs=0 l=1 rx=0x7f302c00f740 tx=0x7f302c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303a7fc700 1 -- 172.21.15.80:0/1891561452 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302c000960 con 0x7f303c0734e0 2019-11-28T11:53:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303a7fc700 1 -- 172.21.15.80:0/1891561452 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c000c90 con 0x7f303c0734e0 2019-11-28T11:53:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f303a7fc700 1 -- 172.21.15.80:0/1891561452 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302c0013a0 con 0x7f303c0734e0 2019-11-28T11:53:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f30415fe700 1 -- 172.21.15.80:0/1891561452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f303c0734e0 msgr2=0x7f303c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.912+0000 7f30415fe700 1 --2- 172.21.15.80:0/1891561452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f303c0734e0 0x7f303c071e20 secure :-1 s=READY pgs=2369 cs=0 l=1 rx=0x7f302c00f740 tx=0x7f302c00fae0).stop 2019-11-28T11:53:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.913+0000 7f30415fe700 1 -- 172.21.15.80:0/1891561452 shutdown_connections 2019-11-28T11:53:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.913+0000 7f30415fe700 1 --2- 172.21.15.80:0/1891561452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f303c0734e0 0x7f303c071e20 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:30.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.913+0000 7f30415fe700 1 --2- 172.21.15.80:0/1891561452 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c06c0a0 0x7f303c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:30.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.913+0000 7f30415fe700 1 -- 172.21.15.80:0/1891561452 shutdown_connections 2019-11-28T11:53:30.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.913+0000 7f30415fe700 1 -- 172.21.15.80:0/1891561452 wait complete. 2019-11-28T11:53:30.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.913+0000 7f30415fe700 1 -- 172.21.15.80:0/1891561452 >> 172.21.15.80:0/1891561452 conn(0x7f303c061cf0 msgr2=0x7f303c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:30.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.915+0000 7f30415fe700 1 Processor -- start 2019-11-28T11:53:30.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.916+0000 7f30415fe700 1 -- start start 2019-11-28T11:53:30.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.916+0000 7f30415fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c13e900 0x7f303c15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:30.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.916+0000 7f30415fe700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303c13f0b0 con 0x7f303c15c3f0 2019-11-28T11:53:30.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.916+0000 7f30415fe700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303c13bcb0 con 0x7f303c0768c0 2019-11-28T11:53:30.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.916+0000 7f30415fe700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c077bf0 con 0x7f303c13e900 2019-11-28T11:53:30.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f303affd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f303c15c3f0 0x7f303c0760c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43320/0 (socket says 172.21.15.80:43320) 2019-11-28T11:53:30.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f303affd700 1 -- 172.21.15.80:0/1824758010 learned_addr learned my addr 172.21.15.80:0/1824758010 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:30.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f303b7fe700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c13e900 0x7f303c15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:30.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f3033fff700 1 -- 172.21.15.80:0/1824758010 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216902380 0 0) 0x7f302c007da0 con 0x7f303c15c3f0 2019-11-28T11:53:30.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f3033fff700 1 -- 172.21.15.80:0/1824758010 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3014002e80 con 0x7f303c15c3f0 2019-11-28T11:53:30.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f3033fff700 1 -- 172.21.15.80:0/1824758010 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044192737 0 0) 0x7f3034001030 con 0x7f303c0768c0 2019-11-28T11:53:30.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f3033fff700 1 -- 172.21.15.80:0/1824758010 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3014002ec0 con 0x7f303c0768c0 2019-11-28T11:53:30.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f303b7fe700 1 -- 172.21.15.80:0/1824758010 >> v1:172.21.15.174:6789/0 conn(0x7f303c0768c0 legacy=0x7f303c15ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:30.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f303b7fe700 1 -- 172.21.15.80:0/1824758010 >> v1:172.21.15.80:6789/0 conn(0x7f303c15c3f0 legacy=0x7f303c0760c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:30.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f303b7fe700 1 -- 172.21.15.80:0/1824758010 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c1595f0 con 0x7f303c13e900 2019-11-28T11:53:30.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f303b7fe700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c13e900 0x7f303c15beb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f30240106d0 tx=0x7f3024010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:30.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f303b7fe700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c13e900 0x7f303c15beb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f30240106d0 tx=0x7f3024010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:30.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f303b7fe700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c13e900 0x7f303c15beb0 secure :-1 s=READY pgs=338 cs=0 l=1 rx=0x7f30240106d0 tx=0x7f3024010a70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:30.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f303b7fe700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c13e900 0x7f303c15beb0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f30240106d0 tx=0x7f3024010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:30.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f3033fff700 1 -- 172.21.15.80:0/1824758010 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3024001130 con 0x7f303c13e900 2019-11-28T11:53:30.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f303b7fe700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c13e900 0x7f303c15beb0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f30240106d0 tx=0x7f3024010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:30.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f303b7fe700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c13e900 0x7f303c15beb0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f30240106d0 tx=0x7f3024010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:30.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f3033fff700 1 -- 172.21.15.80:0/1824758010 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3024009b20 con 0x7f303c13e900 2019-11-28T11:53:30.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f3033fff700 1 -- 172.21.15.80:0/1824758010 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3024001710 con 0x7f303c13e900 2019-11-28T11:53:30.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f30415fe700 1 -- 172.21.15.80:0/1824758010 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c159970 con 0x7f303c13e900 2019-11-28T11:53:30.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.917+0000 7f30415fe700 1 -- 172.21.15.80:0/1824758010 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303c158950 con 0x7f303c13e900 2019-11-28T11:53:30.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.918+0000 7f303b7fe700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c13e900 0x7f303c15beb0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f30240106d0 tx=0x7f3024010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:30.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.918+0000 7f3033fff700 1 -- 172.21.15.80:0/1824758010 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3024000f40 con 0x7f303c13e900 2019-11-28T11:53:30.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.918+0000 7f303b7fe700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c13e900 0x7f303c15beb0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f30240106d0 tx=0x7f3024010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:30.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.918+0000 7f3033fff700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3014018790 0x7f301401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:30.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.918+0000 7f3033fff700 1 -- 172.21.15.80:0/1824758010 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f3024031de0 con 0x7f303c13e900 2019-11-28T11:53:30.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.918+0000 7f303affd700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3014018790 0x7f301401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:30.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.919+0000 7f303affd700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3014018790 0x7f301401abe0 crc :-1 s=READY pgs=976 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:30.987 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.926+0000 7f30415fe700 1 -- 172.21.15.80:0/1824758010 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303c1595f0 con 0x7f303c13e900 2019-11-28T11:53:30.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.930+0000 7f303b7fe700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c13e900 0x7f303c15beb0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f30240106d0 tx=0x7f3024010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:30.988 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:30.930+0000 7f3033fff700 1 -- 172.21.15.80:0/1824758010 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3024011bc0 con 0x7f303c13e900 2019-11-28T11:53:31.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:31.101+0000 7f30415fe700 1 -- 172.21.15.80:0/1824758010 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f303c159970 con 0x7f303c13e900 2019-11-28T11:53:31.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:31.101+0000 7f303b7fe700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c13e900 0x7f303c15beb0 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f30240106d0 tx=0x7f3024010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:31.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:31.101+0000 7f3033fff700 1 -- 172.21.15.80:0/1824758010 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f3024011bc0 con 0x7f303c13e900 2019-11-28T11:53:31.156 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:31.156 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:31.157 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:31.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:31.104+0000 7f30415fe700 1 -- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3014018790 msgr2=0x7f301401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:31.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:31.104+0000 7f30415fe700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3014018790 0x7f301401abe0 crc :-1 s=READY pgs=976 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:31.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:31.104+0000 7f30415fe700 1 -- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c13e900 msgr2=0x7f303c15beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:31.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:31.104+0000 7f30415fe700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c13e900 0x7f303c15beb0 secure :-1 s=READY pgs=338 cs=0 l=1 rx=0x7f30240106d0 tx=0x7f3024010a70).stop 2019-11-28T11:53:31.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:31.104+0000 7f30415fe700 1 -- 172.21.15.80:0/1824758010 shutdown_connections 2019-11-28T11:53:31.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:31.104+0000 7f30415fe700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3014018790 0x7f301401abe0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:31.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:31.104+0000 7f30415fe700 1 --2- 172.21.15.80:0/1824758010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f303c13e900 0x7f303c15beb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:31.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:31.104+0000 7f30415fe700 1 -- 172.21.15.80:0/1824758010 shutdown_connections 2019-11-28T11:53:31.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:31.104+0000 7f30415fe700 1 -- 172.21.15.80:0/1824758010 wait complete. 2019-11-28T11:53:31.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:31.104+0000 7f30415fe700 1 -- 172.21.15.80:0/1824758010 >> 172.21.15.80:0/1824758010 conn(0x7f303c13d930 msgr2=0x7f303c07b940 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:31.168 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:32.169 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:32.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.242+0000 7fc49bfbe700 1 Processor -- start 2019-11-28T11:53:32.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.242+0000 7fc49bfbe700 1 -- start start 2019-11-28T11:53:32.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.244+0000 7fc49bfbe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc49406d120 0x7fc494165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:32.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.244+0000 7fc49bfbe700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc49406d5a0 con 0x7fc49406c0a0 2019-11-28T11:53:32.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.244+0000 7fc49bfbe700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc49406db00 con 0x7fc49406c490 2019-11-28T11:53:32.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.244+0000 7fc49bfbe700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49406fd60 con 0x7fc49406d120 2019-11-28T11:53:32.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.244+0000 7fc49a55b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc49406c0a0 0x7fc494072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43326/0 (socket says 172.21.15.80:43326) 2019-11-28T11:53:32.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.244+0000 7fc49a55b700 1 -- 172.21.15.80:0/2356003460 learned_addr learned my addr 172.21.15.80:0/2356003460 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:32.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.244+0000 7fc49ad5c700 1 --2- 172.21.15.80:0/2356003460 >> v2:172.21.15.174:3300/0 conn(0x7fc49406d120 0x7fc494165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:32.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.244+0000 7fc499559700 1 -- 172.21.15.80:0/2356003460 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519932913 0 0) 0x7fc47c0014d0 con 0x7fc49406c0a0 2019-11-28T11:53:32.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.244+0000 7fc499559700 1 -- 172.21.15.80:0/2356003460 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc480002e80 con 0x7fc49406c0a0 2019-11-28T11:53:32.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.244+0000 7fc499559700 1 -- 172.21.15.80:0/2356003460 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1348308593 0 0) 0x7fc47c0014b0 con 0x7fc49406c0a0 2019-11-28T11:53:32.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.244+0000 7fc49ad5c700 1 -- 172.21.15.80:0/2356003460 >> v1:172.21.15.174:6789/0 conn(0x7fc49406c490 legacy=0x7fc49406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:32.303 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.244+0000 7fc49ad5c700 1 -- 172.21.15.80:0/2356003460 >> v1:172.21.15.80:6789/0 conn(0x7fc49406c0a0 legacy=0x7fc494072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:32.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.244+0000 7fc49ad5c700 1 -- 172.21.15.80:0/2356003460 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4940706c0 con 0x7fc49406d120 2019-11-28T11:53:32.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.244+0000 7fc49ad5c700 1 --2- 172.21.15.80:0/2356003460 >> v2:172.21.15.174:3300/0 conn(0x7fc49406d120 0x7fc494165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc48c00af80 tx=0x7fc48c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:32.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.244+0000 7fc49ad5c700 1 --2- 172.21.15.80:0/2356003460 >> v2:172.21.15.174:3300/0 conn(0x7fc49406d120 0x7fc494165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc48c00af80 tx=0x7fc48c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:32.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.244+0000 7fc49ad5c700 1 --2- 172.21.15.80:0/2356003460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc49406d120 0x7fc494165d80 secure :-1 s=READY pgs=1432 cs=0 l=1 rx=0x7fc48c00af80 tx=0x7fc48c00b790).ready entity=mon.1 client_cookie=a65bc5300c7147b5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:32.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.245+0000 7fc49ad5c700 1 --2- 172.21.15.80:0/2356003460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc49406d120 0x7fc494165d80 secure :-1 s=THROTTLE_DONE pgs=1432 cs=0 l=1 rx=0x7fc48c00af80 tx=0x7fc48c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:32.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.245+0000 7fc499559700 1 -- 172.21.15.80:0/2356003460 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc48c007240 con 0x7fc49406d120 2019-11-28T11:53:32.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.245+0000 7fc49ad5c700 1 --2- 172.21.15.80:0/2356003460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc49406d120 0x7fc494165d80 secure :-1 s=THROTTLE_DONE pgs=1432 cs=0 l=1 rx=0x7fc48c00af80 tx=0x7fc48c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:32.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.245+0000 7fc49ad5c700 1 --2- 172.21.15.80:0/2356003460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc49406d120 0x7fc494165d80 secure :-1 s=THROTTLE_DONE pgs=1432 cs=0 l=1 rx=0x7fc48c00af80 tx=0x7fc48c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:32.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.245+0000 7fc499559700 1 -- 172.21.15.80:0/2356003460 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48c000bb0 con 0x7fc49406d120 2019-11-28T11:53:32.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.245+0000 7fc499559700 1 -- 172.21.15.80:0/2356003460 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc48c009e60 con 0x7fc49406d120 2019-11-28T11:53:32.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.245+0000 7fc49bfbe700 1 -- 172.21.15.80:0/2356003460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc49406d120 msgr2=0x7fc494165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:32.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.245+0000 7fc49bfbe700 1 --2- 172.21.15.80:0/2356003460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc49406d120 0x7fc494165d80 secure :-1 s=READY pgs=1432 cs=0 l=1 rx=0x7fc48c00af80 tx=0x7fc48c00b790).stop 2019-11-28T11:53:32.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.245+0000 7fc49bfbe700 1 -- 172.21.15.80:0/2356003460 shutdown_connections 2019-11-28T11:53:32.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.245+0000 7fc49bfbe700 1 --2- 172.21.15.80:0/2356003460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc49406d120 0x7fc494165d80 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:32.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.245+0000 7fc49bfbe700 1 -- 172.21.15.80:0/2356003460 shutdown_connections 2019-11-28T11:53:32.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.245+0000 7fc49bfbe700 1 -- 172.21.15.80:0/2356003460 wait complete. 2019-11-28T11:53:32.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.245+0000 7fc49bfbe700 1 -- 172.21.15.80:0/2356003460 >> 172.21.15.80:0/2356003460 conn(0x7fc494061cf0 msgr2=0x7fc494064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:32.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.248+0000 7fc49bfbe700 1 Processor -- start 2019-11-28T11:53:32.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.248+0000 7fc49bfbe700 1 -- start start 2019-11-28T11:53:32.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc49bfbe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc49413f580 0x7fc494114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:32.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc49bfbe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc494114670 0x7fc49411e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:32.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc49bfbe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc49411eaf0 0x7fc49411ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:32.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc49bfbe700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc494122c80 con 0x7fc494114670 2019-11-28T11:53:32.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc49bfbe700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc494122140 con 0x7fc49411eaf0 2019-11-28T11:53:32.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc49bfbe700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc494121e60 con 0x7fc49413f580 2019-11-28T11:53:32.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc499d5a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc494114670 0x7fc49411e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:32.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc499d5a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc494114670 0x7fc49411e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44018/0 (socket says 172.21.15.80:44018) 2019-11-28T11:53:32.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc499d5a700 1 -- 172.21.15.80:0/4096193139 learned_addr learned my addr 172.21.15.80:0/4096193139 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:32.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc49ad5c700 1 --2- 172.21.15.80:0/4096193139 >> v2:172.21.15.174:3300/0 conn(0x7fc49411eaf0 0x7fc49411ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:32.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc49a55b700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc49413f580 0x7fc494114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:32.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc499d5a700 1 -- 172.21.15.80:0/4096193139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc49413f580 msgr2=0x7fc494114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:32.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc499d5a700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc49413f580 0x7fc494114130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:32.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc499d5a700 1 -- 172.21.15.80:0/4096193139 >> v2:172.21.15.174:3300/0 conn(0x7fc49411eaf0 msgr2=0x7fc49411ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:32.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc499d5a700 1 --2- 172.21.15.80:0/4096193139 >> v2:172.21.15.174:3300/0 conn(0x7fc49411eaf0 0x7fc49411ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:32.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc499d5a700 1 -- 172.21.15.80:0/4096193139 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc494124010 con 0x7fc494114670 2019-11-28T11:53:32.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc499d5a700 1 --2- 172.21.15.80:0/4096193139 >> v2:172.21.15.80:3300/0 conn(0x7fc494114670 0x7fc49411e5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc484010410 tx=0x7fc4840102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:32.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc499d5a700 1 --2- 172.21.15.80:0/4096193139 >> v2:172.21.15.80:3300/0 conn(0x7fc494114670 0x7fc49411e5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc484010410 tx=0x7fc4840102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:32.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc499d5a700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc494114670 0x7fc49411e5b0 secure :-1 s=READY pgs=2372 cs=0 l=1 rx=0x7fc484010410 tx=0x7fc4840102f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:32.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc499d5a700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc494114670 0x7fc49411e5b0 secure :-1 s=THROTTLE_DONE pgs=2372 cs=0 l=1 rx=0x7fc484010410 tx=0x7fc4840102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:32.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc492ffd700 1 -- 172.21.15.80:0/4096193139 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc484005720 con 0x7fc494114670 2019-11-28T11:53:32.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc499d5a700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc494114670 0x7fc49411e5b0 secure :-1 s=THROTTLE_DONE pgs=2372 cs=0 l=1 rx=0x7fc484010410 tx=0x7fc4840102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:32.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc499d5a700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc494114670 0x7fc49411e5b0 secure :-1 s=THROTTLE_DONE pgs=2372 cs=0 l=1 rx=0x7fc484010410 tx=0x7fc4840102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:32.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc492ffd700 1 -- 172.21.15.80:0/4096193139 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc484005340 con 0x7fc494114670 2019-11-28T11:53:32.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc49bfbe700 1 -- 172.21.15.80:0/4096193139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc494124010 con 0x7fc494114670 2019-11-28T11:53:32.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc492ffd700 1 -- 172.21.15.80:0/4096193139 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc484005d00 con 0x7fc494114670 2019-11-28T11:53:32.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.249+0000 7fc49bfbe700 1 -- 172.21.15.80:0/4096193139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc494124010 con 0x7fc494114670 2019-11-28T11:53:32.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.250+0000 7fc499d5a700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc494114670 0x7fc49411e5b0 secure :-1 s=THROTTLE_DONE pgs=2372 cs=0 l=1 rx=0x7fc484010410 tx=0x7fc4840102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:32.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.250+0000 7fc492ffd700 1 -- 172.21.15.80:0/4096193139 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc484005530 con 0x7fc494114670 2019-11-28T11:53:32.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.250+0000 7fc499d5a700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc494114670 0x7fc49411e5b0 secure :-1 s=THROTTLE_DONE pgs=2372 cs=0 l=1 rx=0x7fc484010410 tx=0x7fc4840102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:32.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.250+0000 7fc492ffd700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc478018730 0x7fc47801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:32.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.250+0000 7fc492ffd700 1 -- 172.21.15.80:0/4096193139 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fc4840319b0 con 0x7fc494114670 2019-11-28T11:53:32.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.250+0000 7fc49a55b700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc478018730 0x7fc47801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:32.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.251+0000 7fc49a55b700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc478018730 0x7fc47801abc0 crc :-1 s=READY pgs=977 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:32.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.258+0000 7fc49bfbe700 1 -- 172.21.15.80:0/4096193139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc494124010 con 0x7fc494114670 2019-11-28T11:53:32.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.261+0000 7fc499d5a700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc494114670 0x7fc49411e5b0 secure :-1 s=THROTTLE_DONE pgs=2372 cs=0 l=1 rx=0x7fc484010410 tx=0x7fc4840102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:32.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.261+0000 7fc492ffd700 1 -- 172.21.15.80:0/4096193139 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc4840075b0 con 0x7fc494114670 2019-11-28T11:53:32.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.432+0000 7fc49bfbe700 1 -- 172.21.15.80:0/4096193139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc494124010 con 0x7fc494114670 2019-11-28T11:53:32.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.433+0000 7fc499d5a700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc494114670 0x7fc49411e5b0 secure :-1 s=THROTTLE_DONE pgs=2372 cs=0 l=1 rx=0x7fc484010410 tx=0x7fc4840102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:32.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.433+0000 7fc492ffd700 1 -- 172.21.15.80:0/4096193139 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7fc484005f40 con 0x7fc494114670 2019-11-28T11:53:32.488 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:32.488 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:32.488 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.435+0000 7fc49bfbe700 1 -- 172.21.15.80:0/4096193139 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc478018730 msgr2=0x7fc47801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.435+0000 7fc49bfbe700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc478018730 0x7fc47801abc0 crc :-1 s=READY pgs=977 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.435+0000 7fc49bfbe700 1 -- 172.21.15.80:0/4096193139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc494114670 msgr2=0x7fc49411e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.435+0000 7fc49bfbe700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc494114670 0x7fc49411e5b0 secure :-1 s=READY pgs=2372 cs=0 l=1 rx=0x7fc484010410 tx=0x7fc4840102f0).stop 2019-11-28T11:53:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.435+0000 7fc49bfbe700 1 -- 172.21.15.80:0/4096193139 shutdown_connections 2019-11-28T11:53:32.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.435+0000 7fc49bfbe700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc478018730 0x7fc47801abc0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.435+0000 7fc49bfbe700 1 --2- 172.21.15.80:0/4096193139 >> v2:172.21.15.174:3300/0 conn(0x7fc49411eaf0 0x7fc49411ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.435+0000 7fc49bfbe700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc494114670 0x7fc49411e5b0 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.435+0000 7fc49bfbe700 1 --2- 172.21.15.80:0/4096193139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc49413f580 0x7fc494114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.435+0000 7fc49bfbe700 1 -- 172.21.15.80:0/4096193139 shutdown_connections 2019-11-28T11:53:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.435+0000 7fc49bfbe700 1 -- 172.21.15.80:0/4096193139 wait complete. 2019-11-28T11:53:32.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:32.435+0000 7fc49bfbe700 1 -- 172.21.15.80:0/4096193139 >> 172.21.15.80:0/4096193139 conn(0x7fc4941426c0 msgr2=0x7fc494110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:32.499 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:33.500 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:33.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.565+0000 7f30a5edf700 1 Processor -- start 2019-11-28T11:53:33.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.565+0000 7f30a5edf700 1 -- start start 2019-11-28T11:53:33.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.566+0000 7f30a5edf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a006c490 0x7f30a006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:33.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.566+0000 7f30a5edf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f30a006ce60 0x7f30a0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:33.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.566+0000 7f30a5edf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a006db00 con 0x7f30a006c0a0 2019-11-28T11:53:33.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.566+0000 7f30a5edf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a006fd60 con 0x7f30a006ce60 2019-11-28T11:53:33.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.566+0000 7f30a5edf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a0070030 con 0x7f30a006c490 2019-11-28T11:53:33.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.566+0000 7f3097fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a006c490 0x7f30a006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:33.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.566+0000 7f30a4c7d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f30a006ce60 0x7f30a0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:33.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.566+0000 7f30a4c7d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f30a006ce60 0x7f30a0164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:58914/0 (socket says 172.21.15.80:58914) 2019-11-28T11:53:33.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.566+0000 7f3097fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a006c490 0x7f30a006c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:46284/0 (socket says 172.21.15.80:46284) 2019-11-28T11:53:33.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.566+0000 7f309ffff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f30a006c0a0 0x7f30a0072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58884/0 (socket says 172.21.15.80:58884) 2019-11-28T11:53:33.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.566+0000 7f30a4c7d700 1 -- 172.21.15.80:0/2145422035 learned_addr learned my addr 172.21.15.80:0/2145422035 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:33.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.567+0000 7f30a4c7d700 1 -- 172.21.15.80:0/2145422035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a006c490 msgr2=0x7f30a006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:33.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.567+0000 7f30a4c7d700 1 --2- 172.21.15.80:0/2145422035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a006c490 0x7f30a006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:33.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.567+0000 7f30a4c7d700 1 -- 172.21.15.80:0/2145422035 >> v1:172.21.15.174:6789/0 conn(0x7f30a006c0a0 legacy=0x7f30a0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:33.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.567+0000 7f30a4c7d700 1 -- 172.21.15.80:0/2145422035 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a00706c0 con 0x7f30a006ce60 2019-11-28T11:53:33.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.567+0000 7f309f7fe700 1 -- 172.21.15.80:0/2145422035 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750872881 0 0) 0x7f3090001080 con 0x7f30a006c0a0 2019-11-28T11:53:33.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.567+0000 7f30a4c7d700 1 --2- 172.21.15.80:0/2145422035 >> v2:172.21.15.174:3300/0 conn(0x7f30a006ce60 0x7f30a0164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f309800fa60 tx=0x7f309800fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:33.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.567+0000 7f30a4c7d700 1 --2- 172.21.15.80:0/2145422035 >> v2:172.21.15.174:3300/0 conn(0x7f30a006ce60 0x7f30a0164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f309800fa60 tx=0x7f309800fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:33.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.567+0000 7f30a4c7d700 1 --2- 172.21.15.80:0/2145422035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a006ce60 0x7f30a0164d70 secure :-1 s=READY pgs=1434 cs=0 l=1 rx=0x7f309800fa60 tx=0x7f309800fe00).ready entity=mon.1 client_cookie=a6a24ba3b7a13fe0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:33.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.567+0000 7f30a4c7d700 1 --2- 172.21.15.80:0/2145422035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a006ce60 0x7f30a0164d70 secure :-1 s=THROTTLE_DONE pgs=1434 cs=0 l=1 rx=0x7f309800fa60 tx=0x7f309800fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:33.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.567+0000 7f309f7fe700 1 -- 172.21.15.80:0/2145422035 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3098000df0 con 0x7f30a006ce60 2019-11-28T11:53:33.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.567+0000 7f30a4c7d700 1 --2- 172.21.15.80:0/2145422035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a006ce60 0x7f30a0164d70 secure :-1 s=THROTTLE_DONE pgs=1434 cs=0 l=1 rx=0x7f309800fa60 tx=0x7f309800fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:33.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.567+0000 7f30a4c7d700 1 --2- 172.21.15.80:0/2145422035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a006ce60 0x7f30a0164d70 secure :-1 s=THROTTLE_DONE pgs=1434 cs=0 l=1 rx=0x7f309800fa60 tx=0x7f309800fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:33.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.567+0000 7f309f7fe700 1 -- 172.21.15.80:0/2145422035 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30980011f0 con 0x7f30a006ce60 2019-11-28T11:53:33.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.567+0000 7f309f7fe700 1 -- 172.21.15.80:0/2145422035 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3098001880 con 0x7f30a006ce60 2019-11-28T11:53:33.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.567+0000 7f30a5edf700 1 -- 172.21.15.80:0/2145422035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a006ce60 msgr2=0x7f30a0164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:33.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.567+0000 7f30a5edf700 1 --2- 172.21.15.80:0/2145422035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a006ce60 0x7f30a0164d70 secure :-1 s=READY pgs=1434 cs=0 l=1 rx=0x7f309800fa60 tx=0x7f309800fe00).stop 2019-11-28T11:53:33.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.568+0000 7f30a5edf700 1 -- 172.21.15.80:0/2145422035 shutdown_connections 2019-11-28T11:53:33.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.568+0000 7f30a5edf700 1 --2- 172.21.15.80:0/2145422035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a006ce60 0x7f30a0164d70 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:33.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.568+0000 7f30a5edf700 1 --2- 172.21.15.80:0/2145422035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a006c490 0x7f30a006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:33.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.568+0000 7f30a5edf700 1 -- 172.21.15.80:0/2145422035 shutdown_connections 2019-11-28T11:53:33.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.568+0000 7f30a5edf700 1 -- 172.21.15.80:0/2145422035 wait complete. 2019-11-28T11:53:33.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.568+0000 7f30a5edf700 1 -- 172.21.15.80:0/2145422035 >> 172.21.15.80:0/2145422035 conn(0x7f30a0061cf0 msgr2=0x7f30a0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:33.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.570+0000 7f30a5edf700 1 Processor -- start 2019-11-28T11:53:33.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.571+0000 7f30a5edf700 1 -- start start 2019-11-28T11:53:33.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.571+0000 7f30a5edf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f30a0120540 0x7f30a01209d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:33.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.571+0000 7f30a5edf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a0120f10 0x7f30a013a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:33.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.571+0000 7f30a5edf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a012a080 con 0x7f30a013e900 2019-11-28T11:53:33.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.571+0000 7f30a5edf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a0128a10 con 0x7f30a0120540 2019-11-28T11:53:33.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.571+0000 7f30a5edf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a0128ce0 con 0x7f30a0120f10 2019-11-28T11:53:33.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f30a4c7d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a0120f10 0x7f30a013a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:33.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f3097fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f30a0120540 0x7f30a01209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:33.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f3097fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f30a0120540 0x7f30a01209d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:58918/0 (socket says 172.21.15.80:58918) 2019-11-28T11:53:33.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f30a4c7d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a0120f10 0x7f30a013a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:46294/0 (socket says 172.21.15.80:46294) 2019-11-28T11:53:33.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f309ffff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f30a013e900 0x7f30a01216c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58890/0 (socket says 172.21.15.80:58890) 2019-11-28T11:53:33.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f3097fff700 1 -- 172.21.15.80:0/3053774023 learned_addr learned my addr 172.21.15.80:0/3053774023 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:33.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f3097fff700 1 -- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a0120f10 msgr2=0x7f30a013a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:33.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f3097fff700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a0120f10 0x7f30a013a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:33.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f3097fff700 1 -- 172.21.15.80:0/3053774023 >> v1:172.21.15.174:6789/0 conn(0x7f30a013e900 legacy=0x7f30a01216c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:33.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f309d7fa700 1 -- 172.21.15.80:0/3053774023 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037655948 0 0) 0x7f3090000ca0 con 0x7f30a013e900 2019-11-28T11:53:33.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f3097fff700 1 -- 172.21.15.80:0/3053774023 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a0129370 con 0x7f30a0120540 2019-11-28T11:53:33.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f30a4c7d700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a0120f10 0x7f30a013a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:33.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f3097fff700 1 --2- 172.21.15.80:0/3053774023 >> v2:172.21.15.174:3300/0 conn(0x7f30a0120540 0x7f30a01209d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3088010450 tx=0x7f30880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:33.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f3097fff700 1 --2- 172.21.15.80:0/3053774023 >> v2:172.21.15.174:3300/0 conn(0x7f30a0120540 0x7f30a01209d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3088010450 tx=0x7f30880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:33.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f3097fff700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a0120540 0x7f30a01209d0 secure :-1 s=READY pgs=1436 cs=0 l=1 rx=0x7f3088010450 tx=0x7f30880107f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:33.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f3097fff700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a0120540 0x7f30a01209d0 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7f3088010450 tx=0x7f30880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:33.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f309d7fa700 1 -- 172.21.15.80:0/3053774023 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3088000940 con 0x7f30a0120540 2019-11-28T11:53:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f3097fff700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a0120540 0x7f30a01209d0 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7f3088010450 tx=0x7f30880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f309d7fa700 1 -- 172.21.15.80:0/3053774023 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30880088f0 con 0x7f30a0120540 2019-11-28T11:53:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f3097fff700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a0120540 0x7f30a01209d0 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7f3088010450 tx=0x7f30880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f30a5edf700 1 -- 172.21.15.80:0/3053774023 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a01296f0 con 0x7f30a0120540 2019-11-28T11:53:33.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f309d7fa700 1 -- 172.21.15.80:0/3053774023 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3088008ae0 con 0x7f30a0120540 2019-11-28T11:53:33.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.572+0000 7f30a5edf700 1 -- 172.21.15.80:0/3053774023 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a0129370 con 0x7f30a0120540 2019-11-28T11:53:33.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.573+0000 7f3097fff700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a0120540 0x7f30a01209d0 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7f3088010450 tx=0x7f30880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:33.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.573+0000 7f309d7fa700 1 -- 172.21.15.80:0/3053774023 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f30880084f0 con 0x7f30a0120540 2019-11-28T11:53:33.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.573+0000 7f3097fff700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a0120540 0x7f30a01209d0 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7f3088010450 tx=0x7f30880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:33.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.573+0000 7f309d7fa700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3084018730 0x7f308401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:33.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.573+0000 7f309d7fa700 1 -- 172.21.15.80:0/3053774023 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f3088031af0 con 0x7f30a0120540 2019-11-28T11:53:33.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.573+0000 7f309ffff700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3084018730 0x7f308401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:33.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.574+0000 7f309ffff700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3084018730 0x7f308401abc0 crc :-1 s=READY pgs=978 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:33.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.581+0000 7f30a5edf700 1 -- 172.21.15.80:0/3053774023 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a01296f0 con 0x7f30a0120540 2019-11-28T11:53:33.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.584+0000 7f3097fff700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a0120540 0x7f30a01209d0 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7f3088010450 tx=0x7f30880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:33.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.584+0000 7f309d7fa700 1 -- 172.21.15.80:0/3053774023 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3088017330 con 0x7f30a0120540 2019-11-28T11:53:33.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.755+0000 7f30a5edf700 1 -- 172.21.15.80:0/3053774023 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30a0129370 con 0x7f30a0120540 2019-11-28T11:53:33.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.756+0000 7f3097fff700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a0120540 0x7f30a01209d0 secure :-1 s=THROTTLE_DONE pgs=1436 cs=0 l=1 rx=0x7f3088010450 tx=0x7f30880107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:33.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.756+0000 7f309d7fa700 1 -- 172.21.15.80:0/3053774023 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f30880084f0 con 0x7f30a0120540 2019-11-28T11:53:33.810 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:33.810 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:33.811 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:33.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.758+0000 7f30a5edf700 1 -- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3084018730 msgr2=0x7f308401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:33.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.758+0000 7f30a5edf700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3084018730 0x7f308401abc0 crc :-1 s=READY pgs=978 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:33.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.758+0000 7f30a5edf700 1 -- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a0120540 msgr2=0x7f30a01209d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:33.813 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.758+0000 7f30a5edf700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a0120540 0x7f30a01209d0 secure :-1 s=READY pgs=1436 cs=0 l=1 rx=0x7f3088010450 tx=0x7f30880107f0).stop 2019-11-28T11:53:33.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.758+0000 7f30a5edf700 1 -- 172.21.15.80:0/3053774023 shutdown_connections 2019-11-28T11:53:33.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.758+0000 7f30a5edf700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a0120f10 0x7f30a013a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:33.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.758+0000 7f30a5edf700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a0120540 0x7f30a01209d0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:33.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.758+0000 7f30a5edf700 1 --2- 172.21.15.80:0/3053774023 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3084018730 0x7f308401abc0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.758+0000 7f30a5edf700 1 -- 172.21.15.80:0/3053774023 shutdown_connections 2019-11-28T11:53:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.758+0000 7f30a5edf700 1 -- 172.21.15.80:0/3053774023 wait complete. 2019-11-28T11:53:33.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:33.758+0000 7f30a5edf700 1 -- 172.21.15.80:0/3053774023 >> 172.21.15.80:0/3053774023 conn(0x7f30a0127dc0 msgr2=0x7f30a0141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:33.822 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:34.824 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:34.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.889+0000 7fd03faa3700 1 Processor -- start 2019-11-28T11:53:34.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.889+0000 7fd03faa3700 1 -- start start 2019-11-28T11:53:34.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03faa3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd03806c0a0 0x7fd038072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:34.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03faa3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd038072620 0x7fd038164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:34.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03faa3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd03806db00 con 0x7fd0380734e0 2019-11-28T11:53:34.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03faa3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03806fd60 con 0x7fd03806c0a0 2019-11-28T11:53:34.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03faa3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd038070030 con 0x7fd038072620 2019-11-28T11:53:34.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03d83f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd0380734e0 0x7fd038071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43358/0 (socket says 172.21.15.80:43358) 2019-11-28T11:53:34.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03d83f700 1 -- 172.21.15.80:0/3879313033 learned_addr learned my addr 172.21.15.80:0/3879313033 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:34.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03e040700 1 --2- 172.21.15.80:0/3879313033 >> v2:172.21.15.174:3300/0 conn(0x7fd03806c0a0 0x7fd038072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:34.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03e841700 1 --2- 172.21.15.80:0/3879313033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd038072620 0x7fd038164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:34.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03d03e700 1 -- 172.21.15.80:0/3879313033 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248492673 0 0) 0x7fd02c001070 con 0x7fd0380734e0 2019-11-28T11:53:34.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03d03e700 1 -- 172.21.15.80:0/3879313033 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd020002e80 con 0x7fd0380734e0 2019-11-28T11:53:34.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03e040700 1 -- 172.21.15.80:0/3879313033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd038072620 msgr2=0x7fd038164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:34.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03e040700 1 --2- 172.21.15.80:0/3879313033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd038072620 0x7fd038164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:34.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03e040700 1 -- 172.21.15.80:0/3879313033 >> v1:172.21.15.80:6789/0 conn(0x7fd0380734e0 legacy=0x7fd038071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:34.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03e040700 1 -- 172.21.15.80:0/3879313033 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0380706c0 con 0x7fd03806c0a0 2019-11-28T11:53:34.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03e841700 1 --2- 172.21.15.80:0/3879313033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd038072620 0x7fd038164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:34.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03e040700 1 --2- 172.21.15.80:0/3879313033 >> v2:172.21.15.174:3300/0 conn(0x7fd03806c0a0 0x7fd038072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd02800af50 tx=0x7fd02800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:34.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.890+0000 7fd03e040700 1 --2- 172.21.15.80:0/3879313033 >> v2:172.21.15.174:3300/0 conn(0x7fd03806c0a0 0x7fd038072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd02800af50 tx=0x7fd02800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:34.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.891+0000 7fd03e040700 1 --2- 172.21.15.80:0/3879313033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd03806c0a0 0x7fd038072fa0 secure :-1 s=READY pgs=1437 cs=0 l=1 rx=0x7fd02800af50 tx=0x7fd02800b760).ready entity=mon.1 client_cookie=c159023eefe3f861 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:34.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.891+0000 7fd03e040700 1 --2- 172.21.15.80:0/3879313033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd03806c0a0 0x7fd038072fa0 secure :-1 s=THROTTLE_DONE pgs=1437 cs=0 l=1 rx=0x7fd02800af50 tx=0x7fd02800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:34.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.891+0000 7fd03d03e700 1 -- 172.21.15.80:0/3879313033 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd028007210 con 0x7fd03806c0a0 2019-11-28T11:53:34.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.891+0000 7fd03e040700 1 --2- 172.21.15.80:0/3879313033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd03806c0a0 0x7fd038072fa0 secure :-1 s=THROTTLE_DONE pgs=1437 cs=0 l=1 rx=0x7fd02800af50 tx=0x7fd02800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:34.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.891+0000 7fd03e040700 1 --2- 172.21.15.80:0/3879313033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd03806c0a0 0x7fd038072fa0 secure :-1 s=THROTTLE_DONE pgs=1437 cs=0 l=1 rx=0x7fd02800af50 tx=0x7fd02800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:34.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.891+0000 7fd03d03e700 1 -- 172.21.15.80:0/3879313033 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0280099b0 con 0x7fd03806c0a0 2019-11-28T11:53:34.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.891+0000 7fd03d03e700 1 -- 172.21.15.80:0/3879313033 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd02800a080 con 0x7fd03806c0a0 2019-11-28T11:53:34.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.891+0000 7fd03faa3700 1 -- 172.21.15.80:0/3879313033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd03806c0a0 msgr2=0x7fd038072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:34.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.891+0000 7fd03faa3700 1 --2- 172.21.15.80:0/3879313033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd03806c0a0 0x7fd038072fa0 secure :-1 s=READY pgs=1437 cs=0 l=1 rx=0x7fd02800af50 tx=0x7fd02800b760).stop 2019-11-28T11:53:34.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.891+0000 7fd03faa3700 1 -- 172.21.15.80:0/3879313033 shutdown_connections 2019-11-28T11:53:34.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.891+0000 7fd03faa3700 1 --2- 172.21.15.80:0/3879313033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd038072620 0x7fd038164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:34.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.891+0000 7fd03faa3700 1 --2- 172.21.15.80:0/3879313033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd03806c0a0 0x7fd038072fa0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:34.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.892+0000 7fd03faa3700 1 -- 172.21.15.80:0/3879313033 shutdown_connections 2019-11-28T11:53:34.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.892+0000 7fd03faa3700 1 -- 172.21.15.80:0/3879313033 wait complete. 2019-11-28T11:53:34.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.892+0000 7fd03faa3700 1 -- 172.21.15.80:0/3879313033 >> 172.21.15.80:0/3879313033 conn(0x7fd038061cf0 msgr2=0x7fd038064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:34.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.894+0000 7fd03faa3700 1 Processor -- start 2019-11-28T11:53:34.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.894+0000 7fd03faa3700 1 -- start start 2019-11-28T11:53:34.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03faa3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd038105fa0 0x7fd038106430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:34.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03faa3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd038164c20 0x7fd0381650c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:34.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03faa3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd03813bd00 con 0x7fd03813e8e0 2019-11-28T11:53:34.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03faa3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03810df40 con 0x7fd038164c20 2019-11-28T11:53:34.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03faa3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd038104240 con 0x7fd038105fa0 2019-11-28T11:53:34.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03e040700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd03813e8e0 0x7fd03814fb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43360/0 (socket says 172.21.15.80:43360) 2019-11-28T11:53:34.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03e040700 1 -- 172.21.15.80:0/3997061355 learned_addr learned my addr 172.21.15.80:0/3997061355 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:34.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03e841700 1 --2- 172.21.15.80:0/3997061355 >> v2:172.21.15.80:3300/0 conn(0x7fd038164c20 0x7fd0381650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:34.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03d83f700 1 --2- 172.21.15.80:0/3997061355 >> v2:172.21.15.174:3300/0 conn(0x7fd038105fa0 0x7fd038106430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:34.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd036ffd700 1 -- 172.21.15.80:0/3997061355 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303478126 0 0) 0x7fd02800b3d0 con 0x7fd03813e8e0 2019-11-28T11:53:34.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd036ffd700 1 -- 172.21.15.80:0/3997061355 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd018002e80 con 0x7fd03813e8e0 2019-11-28T11:53:34.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03e841700 1 -- 172.21.15.80:0/3997061355 >> v2:172.21.15.174:3300/0 conn(0x7fd038105fa0 msgr2=0x7fd038106430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:34.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03e841700 1 --2- 172.21.15.80:0/3997061355 >> v2:172.21.15.174:3300/0 conn(0x7fd038105fa0 0x7fd038106430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:34.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03e841700 1 -- 172.21.15.80:0/3997061355 >> v1:172.21.15.80:6789/0 conn(0x7fd03813e8e0 legacy=0x7fd03814fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:34.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd036ffd700 1 -- 172.21.15.80:0/3997061355 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1370345893 0 0) 0x7fd028000940 con 0x7fd03813e8e0 2019-11-28T11:53:34.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03e841700 1 -- 172.21.15.80:0/3997061355 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0381048d0 con 0x7fd038164c20 2019-11-28T11:53:34.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03d83f700 1 --2- 172.21.15.80:0/3997061355 >> v2:172.21.15.174:3300/0 conn(0x7fd038105fa0 0x7fd038106430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:34.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03e841700 1 --2- 172.21.15.80:0/3997061355 >> v2:172.21.15.80:3300/0 conn(0x7fd038164c20 0x7fd0381650c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd030010700 tx=0x7fd030010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:34.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03e841700 1 --2- 172.21.15.80:0/3997061355 >> v2:172.21.15.80:3300/0 conn(0x7fd038164c20 0x7fd0381650c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd030010700 tx=0x7fd030010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:34.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03e841700 1 --2- 172.21.15.80:0/3997061355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd038164c20 0x7fd0381650c0 secure :-1 s=READY pgs=2375 cs=0 l=1 rx=0x7fd030010700 tx=0x7fd030010aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:34.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03e841700 1 --2- 172.21.15.80:0/3997061355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd038164c20 0x7fd0381650c0 secure :-1 s=THROTTLE_DONE pgs=2375 cs=0 l=1 rx=0x7fd030010700 tx=0x7fd030010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:34.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd036ffd700 1 -- 172.21.15.80:0/3997061355 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd03000a9f0 con 0x7fd038164c20 2019-11-28T11:53:34.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03e841700 1 --2- 172.21.15.80:0/3997061355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd038164c20 0x7fd0381650c0 secure :-1 s=THROTTLE_DONE pgs=2375 cs=0 l=1 rx=0x7fd030010700 tx=0x7fd030010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:34.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03e841700 1 --2- 172.21.15.80:0/3997061355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd038164c20 0x7fd0381650c0 secure :-1 s=THROTTLE_DONE pgs=2375 cs=0 l=1 rx=0x7fd030010700 tx=0x7fd030010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:34.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd036ffd700 1 -- 172.21.15.80:0/3997061355 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd030009930 con 0x7fd038164c20 2019-11-28T11:53:34.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd03faa3700 1 -- 172.21.15.80:0/3997061355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd038104c50 con 0x7fd038164c20 2019-11-28T11:53:34.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.895+0000 7fd036ffd700 1 -- 172.21.15.80:0/3997061355 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd03000a000 con 0x7fd038164c20 2019-11-28T11:53:34.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.896+0000 7fd03faa3700 1 -- 172.21.15.80:0/3997061355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0381048d0 con 0x7fd038164c20 2019-11-28T11:53:34.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.896+0000 7fd03e841700 1 --2- 172.21.15.80:0/3997061355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd038164c20 0x7fd0381650c0 secure :-1 s=THROTTLE_DONE pgs=2375 cs=0 l=1 rx=0x7fd030010700 tx=0x7fd030010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:34.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.896+0000 7fd036ffd700 1 -- 172.21.15.80:0/3997061355 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd03000ad90 con 0x7fd038164c20 2019-11-28T11:53:34.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.896+0000 7fd03e841700 1 --2- 172.21.15.80:0/3997061355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd038164c20 0x7fd0381650c0 secure :-1 s=THROTTLE_DONE pgs=2375 cs=0 l=1 rx=0x7fd030010700 tx=0x7fd030010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:34.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.896+0000 7fd036ffd700 1 --2- 172.21.15.80:0/3997061355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd018018780 0x7fd01801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:34.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.896+0000 7fd036ffd700 1 -- 172.21.15.80:0/3997061355 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fd030031d60 con 0x7fd038164c20 2019-11-28T11:53:34.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.897+0000 7fd03e040700 1 --2- 172.21.15.80:0/3997061355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd018018780 0x7fd01801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:34.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.897+0000 7fd03e040700 1 --2- 172.21.15.80:0/3997061355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd018018780 0x7fd01801abf0 crc :-1 s=READY pgs=979 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:34.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.904+0000 7fd03faa3700 1 -- 172.21.15.80:0/3997061355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd038104c50 con 0x7fd038164c20 2019-11-28T11:53:34.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.908+0000 7fd03e841700 1 --2- 172.21.15.80:0/3997061355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd038164c20 0x7fd0381650c0 secure :-1 s=THROTTLE_DONE pgs=2375 cs=0 l=1 rx=0x7fd030010700 tx=0x7fd030010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:34.977 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:34.908+0000 7fd036ffd700 1 -- 172.21.15.80:0/3997061355 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd030031130 con 0x7fd038164c20 2019-11-28T11:53:35.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:35.079+0000 7fd03faa3700 1 -- 172.21.15.80:0/3997061355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0381048d0 con 0x7fd038164c20 2019-11-28T11:53:35.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:35.080+0000 7fd03e841700 1 --2- 172.21.15.80:0/3997061355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd038164c20 0x7fd0381650c0 secure :-1 s=THROTTLE_DONE pgs=2375 cs=0 l=1 rx=0x7fd030010700 tx=0x7fd030010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:35.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:35.080+0000 7fd036ffd700 1 -- 172.21.15.80:0/3997061355 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7fd030031130 con 0x7fd038164c20 2019-11-28T11:53:35.135 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:35.136 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:35.136 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:35.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:35.082+0000 7fd03faa3700 1 -- 172.21.15.80:0/3997061355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd018018780 msgr2=0x7fd01801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:35.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:35.082+0000 7fd03faa3700 1 --2- 172.21.15.80:0/3997061355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd018018780 0x7fd01801abf0 crc :-1 s=READY pgs=979 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:35.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:35.082+0000 7fd03faa3700 1 -- 172.21.15.80:0/3997061355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd038164c20 msgr2=0x7fd0381650c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:35.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:35.082+0000 7fd03faa3700 1 --2- 172.21.15.80:0/3997061355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd038164c20 0x7fd0381650c0 secure :-1 s=READY pgs=2375 cs=0 l=1 rx=0x7fd030010700 tx=0x7fd030010aa0).stop 2019-11-28T11:53:35.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:35.082+0000 7fd03faa3700 1 -- 172.21.15.80:0/3997061355 shutdown_connections 2019-11-28T11:53:35.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:35.082+0000 7fd03faa3700 1 --2- 172.21.15.80:0/3997061355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd018018780 0x7fd01801abf0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:35.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:35.082+0000 7fd03faa3700 1 --2- 172.21.15.80:0/3997061355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd038164c20 0x7fd0381650c0 unknown :-1 s=CLOSED pgs=2375 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:35.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:35.082+0000 7fd03faa3700 1 --2- 172.21.15.80:0/3997061355 >> v2:172.21.15.174:3300/0 conn(0x7fd038105fa0 0x7fd038106430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:35.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:35.082+0000 7fd03faa3700 1 -- 172.21.15.80:0/3997061355 shutdown_connections 2019-11-28T11:53:35.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:35.082+0000 7fd03faa3700 1 -- 172.21.15.80:0/3997061355 wait complete. 2019-11-28T11:53:35.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:35.082+0000 7fd03faa3700 1 -- 172.21.15.80:0/3997061355 >> 172.21.15.80:0/3997061355 conn(0x7fd03813d620 msgr2=0x7fd03813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:35.147 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:36.148 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:36.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.212+0000 7f0e45c0a700 1 Processor -- start 2019-11-28T11:53:36.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.212+0000 7f0e45c0a700 1 -- start start 2019-11-28T11:53:36.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.213+0000 7f0e45c0a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e4006c0a0 0x7f0e40072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:36.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.213+0000 7f0e45c0a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0e400734e0 0x7f0e40071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:36.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.213+0000 7f0e45c0a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4006db00 con 0x7f0e40072360 2019-11-28T11:53:36.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.213+0000 7f0e45c0a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4006fd60 con 0x7f0e4006c0a0 2019-11-28T11:53:36.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.213+0000 7f0e45c0a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e40070030 con 0x7f0e400734e0 2019-11-28T11:53:36.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.213+0000 7f0e3ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e4006c0a0 0x7f0e40072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:36.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.213+0000 7f0e3ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e4006c0a0 0x7f0e40072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44052/0 (socket says 172.21.15.80:44052) 2019-11-28T11:53:36.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.213+0000 7f0e3ffff700 1 -- 172.21.15.80:0/4200143197 learned_addr learned my addr 172.21.15.80:0/4200143197 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:36.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e37fff700 1 --2- 172.21.15.80:0/4200143197 >> v2:172.21.15.174:3300/0 conn(0x7f0e400734e0 0x7f0e40071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:36.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e3ffff700 1 -- 172.21.15.80:0/4200143197 >> v2:172.21.15.174:3300/0 conn(0x7f0e400734e0 msgr2=0x7f0e40071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:36.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e3ffff700 1 --2- 172.21.15.80:0/4200143197 >> v2:172.21.15.174:3300/0 conn(0x7f0e400734e0 0x7f0e40071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:36.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e3ffff700 1 -- 172.21.15.80:0/4200143197 >> v1:172.21.15.174:6789/0 conn(0x7f0e40072360 legacy=0x7f0e4006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:36.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e3ffff700 1 -- 172.21.15.80:0/4200143197 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e400706c0 con 0x7f0e4006c0a0 2019-11-28T11:53:36.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e37fff700 1 --2- 172.21.15.80:0/4200143197 >> v2:172.21.15.174:3300/0 conn(0x7f0e400734e0 0x7f0e40071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:53:36.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e3ffff700 1 --2- 172.21.15.80:0/4200143197 >> v2:172.21.15.80:3300/0 conn(0x7f0e4006c0a0 0x7f0e40072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0e3000f740 tx=0x7f0e3000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:36.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e3ffff700 1 --2- 172.21.15.80:0/4200143197 >> v2:172.21.15.80:3300/0 conn(0x7f0e4006c0a0 0x7f0e40072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0e3000f740 tx=0x7f0e3000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:36.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e3ffff700 1 --2- 172.21.15.80:0/4200143197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e4006c0a0 0x7f0e40072fa0 secure :-1 s=READY pgs=2376 cs=0 l=1 rx=0x7f0e3000f740 tx=0x7f0e3000fae0).ready entity=mon.0 client_cookie=46d27d18aedd01d3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:36.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e3ffff700 1 --2- 172.21.15.80:0/4200143197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e4006c0a0 0x7f0e40072fa0 secure :-1 s=THROTTLE_DONE pgs=2376 cs=0 l=1 rx=0x7f0e3000f740 tx=0x7f0e3000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:36.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e3ffff700 1 --2- 172.21.15.80:0/4200143197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e4006c0a0 0x7f0e40072fa0 secure :-1 s=THROTTLE_DONE pgs=2376 cs=0 l=1 rx=0x7f0e3000f740 tx=0x7f0e3000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:36.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e3f7fe700 1 -- 172.21.15.80:0/4200143197 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e30000960 con 0x7f0e4006c0a0 2019-11-28T11:53:36.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e3ffff700 1 --2- 172.21.15.80:0/4200143197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e4006c0a0 0x7f0e40072fa0 secure :-1 s=THROTTLE_DONE pgs=2376 cs=0 l=1 rx=0x7f0e3000f740 tx=0x7f0e3000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:36.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e3f7fe700 1 -- 172.21.15.80:0/4200143197 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e30000c90 con 0x7f0e4006c0a0 2019-11-28T11:53:36.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e3f7fe700 1 -- 172.21.15.80:0/4200143197 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e300013a0 con 0x7f0e4006c0a0 2019-11-28T11:53:36.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e45c0a700 1 -- 172.21.15.80:0/4200143197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e4006c0a0 msgr2=0x7f0e40072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:36.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.214+0000 7f0e45c0a700 1 --2- 172.21.15.80:0/4200143197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e4006c0a0 0x7f0e40072fa0 secure :-1 s=READY pgs=2376 cs=0 l=1 rx=0x7f0e3000f740 tx=0x7f0e3000fae0).stop 2019-11-28T11:53:36.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.215+0000 7f0e45c0a700 1 -- 172.21.15.80:0/4200143197 shutdown_connections 2019-11-28T11:53:36.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.215+0000 7f0e45c0a700 1 --2- 172.21.15.80:0/4200143197 >> v2:172.21.15.174:3300/0 conn(0x7f0e400734e0 0x7f0e40071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:36.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.215+0000 7f0e45c0a700 1 --2- 172.21.15.80:0/4200143197 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e4006c0a0 0x7f0e40072fa0 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:36.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.215+0000 7f0e45c0a700 1 -- 172.21.15.80:0/4200143197 shutdown_connections 2019-11-28T11:53:36.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.215+0000 7f0e45c0a700 1 -- 172.21.15.80:0/4200143197 wait complete. 2019-11-28T11:53:36.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.215+0000 7f0e45c0a700 1 -- 172.21.15.80:0/4200143197 >> 172.21.15.80:0/4200143197 conn(0x7f0e40061cf0 msgr2=0x7f0e40064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:36.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.217+0000 7f0e45c0a700 1 Processor -- start 2019-11-28T11:53:36.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.217+0000 7f0e45c0a700 1 -- start start 2019-11-28T11:53:36.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.218+0000 7f0e45c0a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e40105fa0 0x7f0e40106430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:36.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.218+0000 7f0e45c0a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0e40164c20 0x7f0e401650c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:36.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.218+0000 7f0e45c0a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4013bd00 con 0x7f0e4013e8e0 2019-11-28T11:53:36.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.218+0000 7f0e45c0a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4010df40 con 0x7f0e40105fa0 2019-11-28T11:53:36.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.218+0000 7f0e45c0a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e40104240 con 0x7f0e40164c20 2019-11-28T11:53:36.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.218+0000 7f0e37fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e40105fa0 0x7f0e40106430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:36.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.218+0000 7f0e37fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e40105fa0 0x7f0e40106430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44062/0 (socket says 172.21.15.80:44062) 2019-11-28T11:53:36.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.218+0000 7f0e37fff700 1 -- 172.21.15.80:0/1266197894 learned_addr learned my addr 172.21.15.80:0/1266197894 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:36.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.218+0000 7f0e449a8700 1 --2- 172.21.15.80:0/1266197894 >> v2:172.21.15.174:3300/0 conn(0x7f0e40164c20 0x7f0e401650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:36.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.218+0000 7f0e37fff700 1 -- 172.21.15.80:0/1266197894 >> v2:172.21.15.174:3300/0 conn(0x7f0e40164c20 msgr2=0x7f0e401650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:36.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.218+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1266197894 >> v2:172.21.15.174:3300/0 conn(0x7f0e40164c20 0x7f0e401650c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:36.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.219+0000 7f0e37fff700 1 -- 172.21.15.80:0/1266197894 >> v1:172.21.15.174:6789/0 conn(0x7f0e4013e8e0 legacy=0x7f0e4014fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:36.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.219+0000 7f0e37fff700 1 -- 172.21.15.80:0/1266197894 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e401048d0 con 0x7f0e40105fa0 2019-11-28T11:53:36.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.219+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1266197894 >> v2:172.21.15.80:3300/0 conn(0x7f0e40105fa0 0x7f0e40106430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0e28010460 tx=0x7f0e28010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:36.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.219+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1266197894 >> v2:172.21.15.80:3300/0 conn(0x7f0e40105fa0 0x7f0e40106430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0e28010460 tx=0x7f0e28010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:36.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.219+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1266197894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e40105fa0 0x7f0e40106430 secure :-1 s=READY pgs=2377 cs=0 l=1 rx=0x7f0e28010460 tx=0x7f0e28010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:36.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.219+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1266197894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e40105fa0 0x7f0e40106430 secure :-1 s=THROTTLE_DONE pgs=2377 cs=0 l=1 rx=0x7f0e28010460 tx=0x7f0e28010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:36.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.219+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1266197894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e40105fa0 0x7f0e40106430 secure :-1 s=THROTTLE_DONE pgs=2377 cs=0 l=1 rx=0x7f0e28010460 tx=0x7f0e28010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:36.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.219+0000 7f0e3d7fa700 1 -- 172.21.15.80:0/1266197894 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e28000940 con 0x7f0e40105fa0 2019-11-28T11:53:36.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.219+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1266197894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e40105fa0 0x7f0e40106430 secure :-1 s=THROTTLE_DONE pgs=2377 cs=0 l=1 rx=0x7f0e28010460 tx=0x7f0e28010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:36.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.219+0000 7f0e3d7fa700 1 -- 172.21.15.80:0/1266197894 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e28001090 con 0x7f0e40105fa0 2019-11-28T11:53:36.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.219+0000 7f0e45c0a700 1 -- 172.21.15.80:0/1266197894 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e40104c50 con 0x7f0e40105fa0 2019-11-28T11:53:36.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.219+0000 7f0e3d7fa700 1 -- 172.21.15.80:0/1266197894 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e280016e0 con 0x7f0e40105fa0 2019-11-28T11:53:36.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.219+0000 7f0e45c0a700 1 -- 172.21.15.80:0/1266197894 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e401048d0 con 0x7f0e40105fa0 2019-11-28T11:53:36.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.219+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1266197894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e40105fa0 0x7f0e40106430 secure :-1 s=THROTTLE_DONE pgs=2377 cs=0 l=1 rx=0x7f0e28010460 tx=0x7f0e28010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:36.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.219+0000 7f0e3d7fa700 1 -- 172.21.15.80:0/1266197894 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0e28001280 con 0x7f0e40105fa0 2019-11-28T11:53:36.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.220+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1266197894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e40105fa0 0x7f0e40106430 secure :-1 s=THROTTLE_DONE pgs=2377 cs=0 l=1 rx=0x7f0e28010460 tx=0x7f0e28010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:36.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.220+0000 7f0e3d7fa700 1 --2- 172.21.15.80:0/1266197894 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0e24018730 0x7f0e2401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:36.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.220+0000 7f0e3d7fa700 1 -- 172.21.15.80:0/1266197894 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f0e28031aa0 con 0x7f0e40105fa0 2019-11-28T11:53:36.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.220+0000 7f0e3ffff700 1 --2- 172.21.15.80:0/1266197894 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0e24018730 0x7f0e2401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:36.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.220+0000 7f0e3ffff700 1 --2- 172.21.15.80:0/1266197894 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0e24018730 0x7f0e2401abc0 crc :-1 s=READY pgs=980 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:36.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.227+0000 7f0e45c0a700 1 -- 172.21.15.80:0/1266197894 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e40104c50 con 0x7f0e40105fa0 2019-11-28T11:53:36.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.231+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1266197894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e40105fa0 0x7f0e40106430 secure :-1 s=THROTTLE_DONE pgs=2377 cs=0 l=1 rx=0x7f0e28010460 tx=0x7f0e28010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:36.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.231+0000 7f0e3d7fa700 1 -- 172.21.15.80:0/1266197894 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0e28000c90 con 0x7f0e40105fa0 2019-11-28T11:53:36.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.403+0000 7f0e45c0a700 1 -- 172.21.15.80:0/1266197894 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e401048d0 con 0x7f0e40105fa0 2019-11-28T11:53:36.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.403+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1266197894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e40105fa0 0x7f0e40106430 secure :-1 s=THROTTLE_DONE pgs=2377 cs=0 l=1 rx=0x7f0e28010460 tx=0x7f0e28010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:36.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.403+0000 7f0e3d7fa700 1 -- 172.21.15.80:0/1266197894 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f0e28001260 con 0x7f0e40105fa0 2019-11-28T11:53:36.462 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:36.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.406+0000 7f0e45c0a700 1 -- 172.21.15.80:0/1266197894 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0e24018730 msgr2=0x7f0e2401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:36.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.406+0000 7f0e45c0a700 1 --2- 172.21.15.80:0/1266197894 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0e24018730 0x7f0e2401abc0 crc :-1 s=READY pgs=980 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.406+0000 7f0e45c0a700 1 -- 172.21.15.80:0/1266197894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e40105fa0 msgr2=0x7f0e40106430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.406+0000 7f0e45c0a700 1 --2- 172.21.15.80:0/1266197894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e40105fa0 0x7f0e40106430 secure :-1 s=READY pgs=2377 cs=0 l=1 rx=0x7f0e28010460 tx=0x7f0e28010290).stop 2019-11-28T11:53:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.406+0000 7f0e45c0a700 1 -- 172.21.15.80:0/1266197894 shutdown_connections 2019-11-28T11:53:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.406+0000 7f0e45c0a700 1 --2- 172.21.15.80:0/1266197894 >> v2:172.21.15.174:3300/0 conn(0x7f0e40164c20 0x7f0e401650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.406+0000 7f0e45c0a700 1 --2- 172.21.15.80:0/1266197894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e40105fa0 0x7f0e40106430 unknown :-1 s=CLOSED pgs=2377 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:36.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.406+0000 7f0e45c0a700 1 --2- 172.21.15.80:0/1266197894 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0e24018730 0x7f0e2401abc0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:36.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.406+0000 7f0e45c0a700 1 -- 172.21.15.80:0/1266197894 shutdown_connections 2019-11-28T11:53:36.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.406+0000 7f0e45c0a700 1 -- 172.21.15.80:0/1266197894 wait complete. 2019-11-28T11:53:36.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:36.406+0000 7f0e45c0a700 1 -- 172.21.15.80:0/1266197894 >> 172.21.15.80:0/1266197894 conn(0x7f0e4013d620 msgr2=0x7f0e4013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:36.464 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:36.464 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:36.471 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:37.472 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:37.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.543+0000 7f079424b700 1 Processor -- start 2019-11-28T11:53:37.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.543+0000 7f079424b700 1 -- start start 2019-11-28T11:53:37.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.544+0000 7f079424b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f078c06c0a0 0x7f078c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:37.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.544+0000 7f079424b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f078c0734e0 0x7f078c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:37.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.544+0000 7f079424b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c06db00 con 0x7f078c072360 2019-11-28T11:53:37.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.544+0000 7f079424b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c06fd60 con 0x7f078c06c0a0 2019-11-28T11:53:37.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.544+0000 7f079424b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c070030 con 0x7f078c0734e0 2019-11-28T11:53:37.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.544+0000 7f07927e8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f078c06c0a0 0x7f078c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:37.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.544+0000 7f07927e8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f078c06c0a0 0x7f078c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44066/0 (socket says 172.21.15.80:44066) 2019-11-28T11:53:37.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.544+0000 7f07927e8700 1 -- 172.21.15.80:0/3509082708 learned_addr learned my addr 172.21.15.80:0/3509082708 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:37.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.545+0000 7f0791fe7700 1 --2- 172.21.15.80:0/3509082708 >> v2:172.21.15.174:3300/0 conn(0x7f078c0734e0 0x7f078c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:37.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.545+0000 7f07927e8700 1 -- 172.21.15.80:0/3509082708 >> v2:172.21.15.174:3300/0 conn(0x7f078c0734e0 msgr2=0x7f078c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:37.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.545+0000 7f07927e8700 1 --2- 172.21.15.80:0/3509082708 >> v2:172.21.15.174:3300/0 conn(0x7f078c0734e0 0x7f078c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:37.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.545+0000 7f07927e8700 1 -- 172.21.15.80:0/3509082708 >> v1:172.21.15.174:6789/0 conn(0x7f078c072360 legacy=0x7f078c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:37.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.545+0000 7f07927e8700 1 -- 172.21.15.80:0/3509082708 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c0706c0 con 0x7f078c06c0a0 2019-11-28T11:53:37.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.545+0000 7f07927e8700 1 --2- 172.21.15.80:0/3509082708 >> v2:172.21.15.80:3300/0 conn(0x7f078c06c0a0 0x7f078c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f077400fa40 tx=0x7f077400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:37.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.545+0000 7f07927e8700 1 --2- 172.21.15.80:0/3509082708 >> v2:172.21.15.80:3300/0 conn(0x7f078c06c0a0 0x7f078c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f077400fa40 tx=0x7f077400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:37.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.545+0000 7f07927e8700 1 --2- 172.21.15.80:0/3509082708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c06c0a0 0x7f078c072fa0 secure :-1 s=READY pgs=2378 cs=0 l=1 rx=0x7f077400fa40 tx=0x7f077400fde0).ready entity=mon.0 client_cookie=27eb69728102bed8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:37.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.545+0000 7f07927e8700 1 --2- 172.21.15.80:0/3509082708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c06c0a0 0x7f078c072fa0 secure :-1 s=THROTTLE_DONE pgs=2378 cs=0 l=1 rx=0x7f077400fa40 tx=0x7f077400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:37.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.545+0000 7f07927e8700 1 --2- 172.21.15.80:0/3509082708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c06c0a0 0x7f078c072fa0 secure :-1 s=THROTTLE_DONE pgs=2378 cs=0 l=1 rx=0x7f077400fa40 tx=0x7f077400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:37.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.545+0000 7f07917e6700 1 -- 172.21.15.80:0/3509082708 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0774000ce0 con 0x7f078c06c0a0 2019-11-28T11:53:37.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.545+0000 7f07927e8700 1 --2- 172.21.15.80:0/3509082708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c06c0a0 0x7f078c072fa0 secure :-1 s=THROTTLE_DONE pgs=2378 cs=0 l=1 rx=0x7f077400fa40 tx=0x7f077400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:37.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.545+0000 7f07917e6700 1 -- 172.21.15.80:0/3509082708 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0774001010 con 0x7f078c06c0a0 2019-11-28T11:53:37.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.545+0000 7f07917e6700 1 -- 172.21.15.80:0/3509082708 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0774001720 con 0x7f078c06c0a0 2019-11-28T11:53:37.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.545+0000 7f079424b700 1 -- 172.21.15.80:0/3509082708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c06c0a0 msgr2=0x7f078c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:37.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.545+0000 7f079424b700 1 --2- 172.21.15.80:0/3509082708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c06c0a0 0x7f078c072fa0 secure :-1 s=READY pgs=2378 cs=0 l=1 rx=0x7f077400fa40 tx=0x7f077400fde0).stop 2019-11-28T11:53:37.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.546+0000 7f079424b700 1 -- 172.21.15.80:0/3509082708 shutdown_connections 2019-11-28T11:53:37.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.546+0000 7f079424b700 1 --2- 172.21.15.80:0/3509082708 >> v2:172.21.15.174:3300/0 conn(0x7f078c0734e0 0x7f078c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:37.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.546+0000 7f079424b700 1 --2- 172.21.15.80:0/3509082708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c06c0a0 0x7f078c072fa0 unknown :-1 s=CLOSED pgs=2378 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:37.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.546+0000 7f079424b700 1 -- 172.21.15.80:0/3509082708 shutdown_connections 2019-11-28T11:53:37.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.546+0000 7f079424b700 1 -- 172.21.15.80:0/3509082708 wait complete. 2019-11-28T11:53:37.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.546+0000 7f079424b700 1 -- 172.21.15.80:0/3509082708 >> 172.21.15.80:0/3509082708 conn(0x7f078c061cf0 msgr2=0x7f078c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:37.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.549+0000 7f079424b700 1 Processor -- start 2019-11-28T11:53:37.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.549+0000 7f079424b700 1 -- start start 2019-11-28T11:53:37.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.549+0000 7f079424b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f078c12ae50 0x7f078c12b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:37.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.549+0000 7f079424b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f078c1380d0 0x7f078c136fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:37.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.549+0000 7f079424b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f078c138560 0x7f078c137500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:37.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.549+0000 7f079424b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c104eb0 con 0x7f078c12ae50 2019-11-28T11:53:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.549+0000 7f079424b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c105180 con 0x7f078c138560 2019-11-28T11:53:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.549+0000 7f079424b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c104480 con 0x7f078c1380d0 2019-11-28T11:53:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f07927e8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f078c12ae50 0x7f078c12b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f07927e8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f078c12ae50 0x7f078c12b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44074/0 (socket says 172.21.15.80:44074) 2019-11-28T11:53:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f07927e8700 1 -- 172.21.15.80:0/3455054644 learned_addr learned my addr 172.21.15.80:0/3455054644 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f0792fe9700 1 --2- 172.21.15.80:0/3455054644 >> v2:172.21.15.174:3300/0 conn(0x7f078c138560 0x7f078c137500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:37.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f0791fe7700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f078c1380d0 0x7f078c136fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:37.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f07927e8700 1 -- 172.21.15.80:0/3455054644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f078c1380d0 msgr2=0x7f078c136fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:37.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f07927e8700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f078c1380d0 0x7f078c136fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:37.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f07927e8700 1 -- 172.21.15.80:0/3455054644 >> v2:172.21.15.174:3300/0 conn(0x7f078c138560 msgr2=0x7f078c137500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:37.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f07927e8700 1 --2- 172.21.15.80:0/3455054644 >> v2:172.21.15.174:3300/0 conn(0x7f078c138560 0x7f078c137500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:37.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f07927e8700 1 -- 172.21.15.80:0/3455054644 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c105810 con 0x7f078c12ae50 2019-11-28T11:53:37.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f07927e8700 1 --2- 172.21.15.80:0/3455054644 >> v2:172.21.15.80:3300/0 conn(0x7f078c12ae50 0x7f078c12b240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0774010790 tx=0x7f0774010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:37.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f07927e8700 1 --2- 172.21.15.80:0/3455054644 >> v2:172.21.15.80:3300/0 conn(0x7f078c12ae50 0x7f078c12b240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0774010790 tx=0x7f0774010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:37.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f07927e8700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c12ae50 0x7f078c12b240 secure :-1 s=READY pgs=2379 cs=0 l=1 rx=0x7f0774010790 tx=0x7f0774010690).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:37.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f07927e8700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c12ae50 0x7f078c12b240 secure :-1 s=THROTTLE_DONE pgs=2379 cs=0 l=1 rx=0x7f0774010790 tx=0x7f0774010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:37.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f07927e8700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c12ae50 0x7f078c12b240 secure :-1 s=THROTTLE_DONE pgs=2379 cs=0 l=1 rx=0x7f0774010790 tx=0x7f0774010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:37.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f07927e8700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c12ae50 0x7f078c12b240 secure :-1 s=THROTTLE_DONE pgs=2379 cs=0 l=1 rx=0x7f0774010790 tx=0x7f0774010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:37.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f078affd700 1 -- 172.21.15.80:0/3455054644 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0774005af0 con 0x7f078c12ae50 2019-11-28T11:53:37.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f078affd700 1 -- 172.21.15.80:0/3455054644 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0774005710 con 0x7f078c12ae50 2019-11-28T11:53:37.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f079424b700 1 -- 172.21.15.80:0/3455054644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c105b90 con 0x7f078c12ae50 2019-11-28T11:53:37.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f078affd700 1 -- 172.21.15.80:0/3455054644 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07740060d0 con 0x7f078c12ae50 2019-11-28T11:53:37.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.550+0000 7f079424b700 1 -- 172.21.15.80:0/3455054644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078c106c70 con 0x7f078c12ae50 2019-11-28T11:53:37.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.551+0000 7f07927e8700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c12ae50 0x7f078c12b240 secure :-1 s=THROTTLE_DONE pgs=2379 cs=0 l=1 rx=0x7f0774010790 tx=0x7f0774010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:37.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.551+0000 7f078affd700 1 -- 172.21.15.80:0/3455054644 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0774005900 con 0x7f078c12ae50 2019-11-28T11:53:37.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.551+0000 7f07927e8700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c12ae50 0x7f078c12b240 secure :-1 s=THROTTLE_DONE pgs=2379 cs=0 l=1 rx=0x7f0774010790 tx=0x7f0774010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:37.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.551+0000 7f078affd700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0770018730 0x7f077001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.551+0000 7f078affd700 1 -- 172.21.15.80:0/3455054644 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f0774031d60 con 0x7f078c12ae50 2019-11-28T11:53:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.551+0000 7f0791fe7700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0770018730 0x7f077001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.551+0000 7f0791fe7700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0770018730 0x7f077001abc0 crc :-1 s=READY pgs=981 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:37.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.558+0000 7f079424b700 1 -- 172.21.15.80:0/3455054644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078c105810 con 0x7f078c12ae50 2019-11-28T11:53:37.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.562+0000 7f07927e8700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c12ae50 0x7f078c12b240 secure :-1 s=THROTTLE_DONE pgs=2379 cs=0 l=1 rx=0x7f0774010790 tx=0x7f0774010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:37.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.562+0000 7f078affd700 1 -- 172.21.15.80:0/3455054644 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0774005500 con 0x7f078c12ae50 2019-11-28T11:53:37.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.734+0000 7f079424b700 1 -- 172.21.15.80:0/3455054644 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f078c105b90 con 0x7f078c12ae50 2019-11-28T11:53:37.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.735+0000 7f07927e8700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c12ae50 0x7f078c12b240 secure :-1 s=THROTTLE_DONE pgs=2379 cs=0 l=1 rx=0x7f0774010790 tx=0x7f0774010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:37.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.735+0000 7f078affd700 1 -- 172.21.15.80:0/3455054644 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) v1 ==== 95+0+2456 (secure 0 0 0) 0x7f0774005900 con 0x7f078c12ae50 2019-11-28T11:53:37.791 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 143 2019-11-28T11:53:37.791 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:37.791 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":143,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":143,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:52:47.766901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:37.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.737+0000 7f079424b700 1 -- 172.21.15.80:0/3455054644 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0770018730 msgr2=0x7f077001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:37.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.737+0000 7f079424b700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0770018730 0x7f077001abc0 crc :-1 s=READY pgs=981 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:37.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.737+0000 7f079424b700 1 -- 172.21.15.80:0/3455054644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c12ae50 msgr2=0x7f078c12b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:37.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.737+0000 7f079424b700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c12ae50 0x7f078c12b240 secure :-1 s=READY pgs=2379 cs=0 l=1 rx=0x7f0774010790 tx=0x7f0774010690).stop 2019-11-28T11:53:37.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.737+0000 7f079424b700 1 -- 172.21.15.80:0/3455054644 shutdown_connections 2019-11-28T11:53:37.797 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.737+0000 7f079424b700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0770018730 0x7f077001abc0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:37.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.737+0000 7f079424b700 1 --2- 172.21.15.80:0/3455054644 >> v2:172.21.15.174:3300/0 conn(0x7f078c138560 0x7f078c137500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:37.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.737+0000 7f079424b700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f078c1380d0 0x7f078c136fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:37.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.737+0000 7f079424b700 1 --2- 172.21.15.80:0/3455054644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f078c12ae50 0x7f078c12b240 unknown :-1 s=CLOSED pgs=2379 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:37.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.737+0000 7f079424b700 1 -- 172.21.15.80:0/3455054644 shutdown_connections 2019-11-28T11:53:37.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.737+0000 7f079424b700 1 -- 172.21.15.80:0/3455054644 wait complete. 2019-11-28T11:53:37.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:37.737+0000 7f079424b700 1 -- 172.21.15.80:0/3455054644 >> 172.21.15.80:0/3455054644 conn(0x7f078c136bc0 msgr2=0x7f078c111610 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:37.803 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T11:53:38.804 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:38.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.870+0000 7fb74c720700 1 Processor -- start 2019-11-28T11:53:38.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.870+0000 7fb74c720700 1 -- start start 2019-11-28T11:53:38.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.871+0000 7fb74c720700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb74406c0a0 0x7fb744072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:38.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.871+0000 7fb74c720700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:38.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.871+0000 7fb74c720700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74406db00 con 0x7fb7440734e0 2019-11-28T11:53:38.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.871+0000 7fb74c720700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74406fd60 con 0x7fb74406c0a0 2019-11-28T11:53:38.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.871+0000 7fb74c720700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb744070030 con 0x7fb744072620 2019-11-28T11:53:38.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.871+0000 7fb74a4bc700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb7440734e0 0x7fb744071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43396/0 (socket says 172.21.15.80:43396) 2019-11-28T11:53:38.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.871+0000 7fb74a4bc700 1 -- 172.21.15.80:0/3447967448 learned_addr learned my addr 172.21.15.80:0/3447967448 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:38.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.871+0000 7fb74acbd700 1 --2- 172.21.15.80:0/3447967448 >> v2:172.21.15.174:3300/0 conn(0x7fb74406c0a0 0x7fb744072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:38.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.871+0000 7fb74b4be700 1 --2- 172.21.15.80:0/3447967448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:38.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.872+0000 7fb74b4be700 1 -- 172.21.15.80:0/3447967448 >> v2:172.21.15.174:3300/0 conn(0x7fb74406c0a0 msgr2=0x7fb744072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:38.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.872+0000 7fb74b4be700 1 --2- 172.21.15.80:0/3447967448 >> v2:172.21.15.174:3300/0 conn(0x7fb74406c0a0 0x7fb744072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:38.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.872+0000 7fb74b4be700 1 -- 172.21.15.80:0/3447967448 >> v1:172.21.15.80:6789/0 conn(0x7fb7440734e0 legacy=0x7fb744071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:38.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.872+0000 7fb74b4be700 1 -- 172.21.15.80:0/3447967448 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7440706c0 con 0x7fb744072620 2019-11-28T11:53:38.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.872+0000 7fb74acbd700 1 --2- 172.21.15.80:0/3447967448 >> v2:172.21.15.174:3300/0 conn(0x7fb74406c0a0 0x7fb744072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:38.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.872+0000 7fb74b4be700 1 --2- 172.21.15.80:0/3447967448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb73c00af80 tx=0x7fb73c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.872+0000 7fb74b4be700 1 --2- 172.21.15.80:0/3447967448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb73c00af80 tx=0x7fb73c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.872+0000 7fb74b4be700 1 --2- 172.21.15.80:0/3447967448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7fb73c00af80 tx=0x7fb73c00b790).ready entity=mon.2 client_cookie=e108aee5fe05f973 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.875+0000 7fb74b4be700 1 --2- 172.21.15.80:0/3447967448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7fb73c00af80 tx=0x7fb73c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.875+0000 7fb74b4be700 1 --2- 172.21.15.80:0/3447967448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7fb73c00af80 tx=0x7fb73c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.875+0000 7fb74b4be700 1 --2- 172.21.15.80:0/3447967448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 secure :-1 s=THROTTLE_DONE pgs=339 cs=0 l=1 rx=0x7fb73c00af80 tx=0x7fb73c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.875+0000 7fb749cbb700 1 -- 172.21.15.80:0/3447967448 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb73c000bc0 con 0x7fb744072620 2019-11-28T11:53:38.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.875+0000 7fb749cbb700 1 -- 172.21.15.80:0/3447967448 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c0097f0 con 0x7fb744072620 2019-11-28T11:53:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.875+0000 7fb749cbb700 1 -- 172.21.15.80:0/3447967448 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb73c009ec0 con 0x7fb744072620 2019-11-28T11:53:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.875+0000 7fb74c720700 1 -- 172.21.15.80:0/3447967448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 msgr2=0x7fb744164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.875+0000 7fb74c720700 1 --2- 172.21.15.80:0/3447967448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7fb73c00af80 tx=0x7fb73c00b790).stop 2019-11-28T11:53:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.876+0000 7fb74c720700 1 -- 172.21.15.80:0/3447967448 shutdown_connections 2019-11-28T11:53:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.876+0000 7fb74c720700 1 --2- 172.21.15.80:0/3447967448 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb744072620 0x7fb744164d70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:38.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.876+0000 7fb74c720700 1 --2- 172.21.15.80:0/3447967448 >> v2:172.21.15.174:3300/0 conn(0x7fb74406c0a0 0x7fb744072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:38.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.876+0000 7fb74c720700 1 -- 172.21.15.80:0/3447967448 shutdown_connections 2019-11-28T11:53:38.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.876+0000 7fb74c720700 1 -- 172.21.15.80:0/3447967448 wait complete. 2019-11-28T11:53:38.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.876+0000 7fb74c720700 1 -- 172.21.15.80:0/3447967448 >> 172.21.15.80:0/3447967448 conn(0x7fb744061cf0 msgr2=0x7fb744064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:38.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.879+0000 7fb74c720700 1 Processor -- start 2019-11-28T11:53:38.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.879+0000 7fb74c720700 1 -- start start 2019-11-28T11:53:38.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.879+0000 7fb74c720700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb74411b2e0 0x7fb74411b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:38.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.879+0000 7fb74c720700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74413f190 con 0x7fb7441299b0 2019-11-28T11:53:38.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.879+0000 7fb74c720700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7441425f0 con 0x7fb74411bea0 2019-11-28T11:53:38.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.879+0000 7fb74c720700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb744142d50 con 0x7fb74411b2e0 2019-11-28T11:53:38.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.879+0000 7fb74acbd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb7441299b0 0x7fb74411c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43402/0 (socket says 172.21.15.80:43402) 2019-11-28T11:53:38.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.879+0000 7fb74acbd700 1 -- 172.21.15.80:0/2474691289 learned_addr learned my addr 172.21.15.80:0/2474691289 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:38.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb74a4bc700 1 --2- 172.21.15.80:0/2474691289 >> v2:172.21.15.80:3300/0 conn(0x7fb74411b2e0 0x7fb74411b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:38.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb74a4bc700 1 -- 172.21.15.80:0/2474691289 >> v1:172.21.15.174:6789/0 conn(0x7fb74411bea0 legacy=0x7fb74413e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:38.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb74a4bc700 1 -- 172.21.15.80:0/2474691289 >> v1:172.21.15.80:6789/0 conn(0x7fb7441299b0 legacy=0x7fb74411c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:38.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb74a4bc700 1 -- 172.21.15.80:0/2474691289 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb744119ba0 con 0x7fb74411b2e0 2019-11-28T11:53:38.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb7437fe700 1 -- 172.21.15.80:0/2474691289 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181318135 0 0) 0x7fb73400dd90 con 0x7fb7441299b0 2019-11-28T11:53:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb74a4bc700 1 --2- 172.21.15.80:0/2474691289 >> v2:172.21.15.80:3300/0 conn(0x7fb74411b2e0 0x7fb74411b960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb7380106e0 tx=0x7fb738010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb74a4bc700 1 --2- 172.21.15.80:0/2474691289 >> v2:172.21.15.80:3300/0 conn(0x7fb74411b2e0 0x7fb74411b960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb7380106e0 tx=0x7fb738010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb74a4bc700 1 --2- 172.21.15.80:0/2474691289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb74411b2e0 0x7fb74411b960 secure :-1 s=READY pgs=2382 cs=0 l=1 rx=0x7fb7380106e0 tx=0x7fb738010a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb74a4bc700 1 --2- 172.21.15.80:0/2474691289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb74411b2e0 0x7fb74411b960 secure :-1 s=THROTTLE_DONE pgs=2382 cs=0 l=1 rx=0x7fb7380106e0 tx=0x7fb738010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:38.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb7437fe700 1 -- 172.21.15.80:0/2474691289 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb738004360 con 0x7fb74411b2e0 2019-11-28T11:53:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb74a4bc700 1 --2- 172.21.15.80:0/2474691289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb74411b2e0 0x7fb74411b960 secure :-1 s=THROTTLE_DONE pgs=2382 cs=0 l=1 rx=0x7fb7380106e0 tx=0x7fb738010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb74c720700 1 -- 172.21.15.80:0/2474691289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb744119f20 con 0x7fb74411b2e0 2019-11-28T11:53:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb7437fe700 1 -- 172.21.15.80:0/2474691289 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb738001010 con 0x7fb74411b2e0 2019-11-28T11:53:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb74a4bc700 1 --2- 172.21.15.80:0/2474691289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb74411b2e0 0x7fb74411b960 secure :-1 s=THROTTLE_DONE pgs=2382 cs=0 l=1 rx=0x7fb7380106e0 tx=0x7fb738010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb7437fe700 1 -- 172.21.15.80:0/2474691289 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb738001200 con 0x7fb74411b2e0 2019-11-28T11:53:38.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb74c720700 1 -- 172.21.15.80:0/2474691289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb744119ba0 con 0x7fb74411b2e0 2019-11-28T11:53:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.880+0000 7fb74a4bc700 1 --2- 172.21.15.80:0/2474691289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb74411b2e0 0x7fb74411b960 secure :-1 s=THROTTLE_DONE pgs=2382 cs=0 l=1 rx=0x7fb7380106e0 tx=0x7fb738010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.881+0000 7fb7437fe700 1 -- 172.21.15.80:0/2474691289 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb738004360 con 0x7fb74411b2e0 2019-11-28T11:53:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.881+0000 7fb74a4bc700 1 --2- 172.21.15.80:0/2474691289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb74411b2e0 0x7fb74411b960 secure :-1 s=THROTTLE_DONE pgs=2382 cs=0 l=1 rx=0x7fb7380106e0 tx=0x7fb738010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.881+0000 7fb7437fe700 1 --2- 172.21.15.80:0/2474691289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb724018730 0x7fb72401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.881+0000 7fb7437fe700 1 -- 172.21.15.80:0/2474691289 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fb738031f00 con 0x7fb74411b2e0 2019-11-28T11:53:38.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.881+0000 7fb74acbd700 1 --2- 172.21.15.80:0/2474691289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb724018730 0x7fb72401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:38.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.881+0000 7fb74acbd700 1 --2- 172.21.15.80:0/2474691289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb724018730 0x7fb72401abc0 crc :-1 s=READY pgs=982 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:38.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.885+0000 7fb74c720700 1 -- 172.21.15.80:0/2474691289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb744119f20 con 0x7fb74411b2e0 2019-11-28T11:53:38.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.889+0000 7fb74a4bc700 1 --2- 172.21.15.80:0/2474691289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb74411b2e0 0x7fb74411b960 secure :-1 s=THROTTLE_DONE pgs=2382 cs=0 l=1 rx=0x7fb7380106e0 tx=0x7fb738010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:38.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:38.889+0000 7fb7437fe700 1 -- 172.21.15.80:0/2474691289 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb7380015a0 con 0x7fb74411b2e0 2019-11-28T11:53:39.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:39.060+0000 7fb74c720700 1 -- 172.21.15.80:0/2474691289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb744119ba0 con 0x7fb74411b2e0 2019-11-28T11:53:39.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:39.060+0000 7fb74a4bc700 1 --2- 172.21.15.80:0/2474691289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb74411b2e0 0x7fb74411b960 secure :-1 s=THROTTLE_DONE pgs=2382 cs=0 l=1 rx=0x7fb7380106e0 tx=0x7fb738010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:39.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:39.060+0000 7fb7437fe700 1 -- 172.21.15.80:0/2474691289 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) v1 ==== 95+0+2454 (secure 0 0 0) 0x7fb738004360 con 0x7fb74411b2e0 2019-11-28T11:53:39.117 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 144 2019-11-28T11:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":144,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:53:38.871176+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:39.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:39.063+0000 7fb74c720700 1 -- 172.21.15.80:0/2474691289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb724018730 msgr2=0x7fb72401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:39.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:39.063+0000 7fb74c720700 1 --2- 172.21.15.80:0/2474691289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb724018730 0x7fb72401abc0 crc :-1 s=READY pgs=982 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:39.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:39.063+0000 7fb74c720700 1 -- 172.21.15.80:0/2474691289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb74411b2e0 msgr2=0x7fb74411b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:39.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:39.063+0000 7fb74c720700 1 --2- 172.21.15.80:0/2474691289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb74411b2e0 0x7fb74411b960 secure :-1 s=READY pgs=2382 cs=0 l=1 rx=0x7fb7380106e0 tx=0x7fb738010a80).stop 2019-11-28T11:53:39.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:39.063+0000 7fb74c720700 1 -- 172.21.15.80:0/2474691289 shutdown_connections 2019-11-28T11:53:39.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:39.063+0000 7fb74c720700 1 --2- 172.21.15.80:0/2474691289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb724018730 0x7fb72401abc0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:39.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:39.063+0000 7fb74c720700 1 --2- 172.21.15.80:0/2474691289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb74411b2e0 0x7fb74411b960 unknown :-1 s=CLOSED pgs=2382 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:39.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:39.063+0000 7fb74c720700 1 -- 172.21.15.80:0/2474691289 shutdown_connections 2019-11-28T11:53:39.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:39.063+0000 7fb74c720700 1 -- 172.21.15.80:0/2474691289 wait complete. 2019-11-28T11:53:39.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:39.063+0000 7fb74c720700 1 -- 172.21.15.80:0/2474691289 >> 172.21.15.80:0/2474691289 conn(0x7fb74413b860 msgr2=0x7fb7441050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:39.128 INFO:tasks.cephfs.filesystem:mapped states [u'up:rejoin'] to None 2019-11-28T11:53:40.129 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:40.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.193+0000 7f4d3fc01700 1 Processor -- start 2019-11-28T11:53:40.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.193+0000 7f4d3fc01700 1 -- start start 2019-11-28T11:53:40.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.194+0000 7f4d3fc01700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4d3806d120 0x7f4d38165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:40.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3fc01700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3806d5a0 con 0x7f4d3806c0a0 2019-11-28T11:53:40.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3fc01700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3806db00 con 0x7f4d3806c490 2019-11-28T11:53:40.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3fc01700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3806fd60 con 0x7f4d3806d120 2019-11-28T11:53:40.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3e19e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4d3806c0a0 0x7f4d38072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43410/0 (socket says 172.21.15.80:43410) 2019-11-28T11:53:40.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3e19e700 1 -- 172.21.15.80:0/2509905385 learned_addr learned my addr 172.21.15.80:0/2509905385 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:40.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3e99f700 1 --2- 172.21.15.80:0/2509905385 >> v2:172.21.15.174:3300/0 conn(0x7f4d3806d120 0x7f4d38165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:40.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3d19c700 1 -- 172.21.15.80:0/2509905385 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459345813 0 0) 0x7f4d28001150 con 0x7f4d3806c0a0 2019-11-28T11:53:40.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3d19c700 1 -- 172.21.15.80:0/2509905385 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d24002e80 con 0x7f4d3806c0a0 2019-11-28T11:53:40.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3d19c700 1 -- 172.21.15.80:0/2509905385 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1423620169 0 0) 0x7f4d28001130 con 0x7f4d3806c0a0 2019-11-28T11:53:40.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3d19c700 1 -- 172.21.15.80:0/2509905385 >> v2:172.21.15.174:3300/0 conn(0x7f4d3806d120 msgr2=0x7f4d38165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:40.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3d19c700 1 --2- 172.21.15.80:0/2509905385 >> v2:172.21.15.174:3300/0 conn(0x7f4d3806d120 0x7f4d38165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:40.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3d19c700 1 -- 172.21.15.80:0/2509905385 >> v1:172.21.15.174:6789/0 conn(0x7f4d3806c490 legacy=0x7f4d3806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3d19c700 1 -- 172.21.15.80:0/2509905385 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d380706c0 con 0x7f4d3806c0a0 2019-11-28T11:53:40.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3d19c700 1 -- 172.21.15.80:0/2509905385 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f4d28001660 con 0x7f4d3806c0a0 2019-11-28T11:53:40.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3d19c700 1 -- 172.21.15.80:0/2509905385 >> v1:172.21.15.80:6789/0 conn(0x7f4d3806c0a0 legacy=0x7f4d38072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3d19c700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d24003a80 0x7f4d24005ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:40.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3d19c700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d24006660 0x7f4d24008b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:40.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3d19c700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d24009390 0x7f4d2400b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:40.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3d19c700 1 -- 172.21.15.80:0/2509905385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2400c010 con 0x7f4d24009390 2019-11-28T11:53:40.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3e99f700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d24009390 0x7f4d2400b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:40.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3d19c700 1 -- 172.21.15.80:0/2509905385 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d24050210 con 0x7f4d24003a80 2019-11-28T11:53:40.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3d19c700 1 -- 172.21.15.80:0/2509905385 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d24050440 con 0x7f4d24006660 2019-11-28T11:53:40.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3e19e700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d24003a80 0x7f4d24005ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:40.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.195+0000 7f4d3d99d700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d24006660 0x7f4d24008b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:40.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3e99f700 1 -- 172.21.15.80:0/2509905385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d24006660 msgr2=0x7f4d24008b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:40.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3e99f700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d24006660 0x7f4d24008b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:40.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3e99f700 1 -- 172.21.15.80:0/2509905385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d24003a80 msgr2=0x7f4d24005ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:40.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3e99f700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d24003a80 0x7f4d24005ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:40.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3e99f700 1 -- 172.21.15.80:0/2509905385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d240506f0 con 0x7f4d24009390 2019-11-28T11:53:40.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3e19e700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d24003a80 0x7f4d24005ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:53:40.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3e99f700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d24009390 0x7f4d2400b860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4d3000eba0 tx=0x7f4d3000ec90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3e99f700 1 -- 172.21.15.80:0/2509905385 reap_dead start 2019-11-28T11:53:40.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3e99f700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d24009390 0x7f4d2400b860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4d3000eba0 tx=0x7f4d3000ec90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3e99f700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d24009390 0x7f4d2400b860 secure :-1 s=READY pgs=2384 cs=0 l=1 rx=0x7f4d3000eba0 tx=0x7f4d3000ec90).ready entity=mon.0 client_cookie=ea85f793d86e0f7b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:40.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3e99f700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d24009390 0x7f4d2400b860 secure :-1 s=THROTTLE_DONE pgs=2384 cs=0 l=1 rx=0x7f4d3000eba0 tx=0x7f4d3000ec90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3e99f700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d24009390 0x7f4d2400b860 secure :-1 s=THROTTLE_DONE pgs=2384 cs=0 l=1 rx=0x7f4d3000eba0 tx=0x7f4d3000ec90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3d19c700 1 -- 172.21.15.80:0/2509905385 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d3000f1a0 con 0x7f4d24009390 2019-11-28T11:53:40.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3e99f700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d24009390 0x7f4d2400b860 secure :-1 s=THROTTLE_DONE pgs=2384 cs=0 l=1 rx=0x7f4d3000eba0 tx=0x7f4d3000ec90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3d19c700 1 -- 172.21.15.80:0/2509905385 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3000edc0 con 0x7f4d24009390 2019-11-28T11:53:40.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3d19c700 1 -- 172.21.15.80:0/2509905385 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d3000f8d0 con 0x7f4d24009390 2019-11-28T11:53:40.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3fc01700 1 -- 172.21.15.80:0/2509905385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d24009390 msgr2=0x7f4d2400b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.196+0000 7f4d3fc01700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d24009390 0x7f4d2400b860 secure :-1 s=READY pgs=2384 cs=0 l=1 rx=0x7f4d3000eba0 tx=0x7f4d3000ec90).stop 2019-11-28T11:53:40.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.197+0000 7f4d3fc01700 1 -- 172.21.15.80:0/2509905385 shutdown_connections 2019-11-28T11:53:40.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.197+0000 7f4d3fc01700 1 --2- 172.21.15.80:0/2509905385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d24009390 0x7f4d2400b860 unknown :-1 s=CLOSED pgs=2384 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:40.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.197+0000 7f4d3fc01700 1 -- 172.21.15.80:0/2509905385 shutdown_connections 2019-11-28T11:53:40.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.197+0000 7f4d3fc01700 1 -- 172.21.15.80:0/2509905385 wait complete. 2019-11-28T11:53:40.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.197+0000 7f4d3fc01700 1 -- 172.21.15.80:0/2509905385 >> 172.21.15.80:0/2509905385 conn(0x7f4d38061cf0 msgr2=0x7f4d38064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:40.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.199+0000 7f4d3fc01700 1 Processor -- start 2019-11-28T11:53:40.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.199+0000 7f4d3fc01700 1 -- start start 2019-11-28T11:53:40.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.200+0000 7f4d3fc01700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4d38074d00 0x7f4d3807aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:40.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.200+0000 7f4d3fc01700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d380754d0 con 0x7f4d3807bba0 2019-11-28T11:53:40.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.200+0000 7f4d3fc01700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3812eb20 con 0x7f4d38150f50 2019-11-28T11:53:40.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.200+0000 7f4d3fc01700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d38078980 con 0x7f4d38074d00 2019-11-28T11:53:40.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.200+0000 7f4d3e99f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4d3807bba0 0x7f4d38167c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43424/0 (socket says 172.21.15.80:43424) 2019-11-28T11:53:40.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.200+0000 7f4d3e99f700 1 -- 172.21.15.80:0/2291026865 learned_addr learned my addr 172.21.15.80:0/2291026865 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:40.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.200+0000 7f4d3e19e700 1 --2- 172.21.15.80:0/2291026865 >> v2:172.21.15.174:3300/0 conn(0x7f4d38074d00 0x7f4d3807aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:40.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.200+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082642818 0 0) 0x7f4d30001480 con 0x7f4d3807bba0 2019-11-28T11:53:40.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.200+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d1c002e80 con 0x7f4d3807bba0 2019-11-28T11:53:40.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.200+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 459896573 0 0) 0x7f4d30001600 con 0x7f4d3807bba0 2019-11-28T11:53:40.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.200+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4d1c0032e0 con 0x7f4d3807bba0 2019-11-28T11:53:40.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f4d30001bb0 con 0x7f4d3807bba0 2019-11-28T11:53:40.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 >> v2:172.21.15.174:3300/0 conn(0x7f4d38074d00 msgr2=0x7f4d3807aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d36ffd700 1 --2- 172.21.15.80:0/2291026865 >> v2:172.21.15.174:3300/0 conn(0x7f4d38074d00 0x7f4d3807aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:40.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 >> v1:172.21.15.174:6789/0 conn(0x7f4d38150f50 legacy=0x7f4d3807af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 >> v1:172.21.15.80:6789/0 conn(0x7f4d3807bba0 legacy=0x7f4d38167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d36ffd700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d1c0035b0 0x7f4d1c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:40.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d36ffd700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d1c003f00 0x7f4d1c0043c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:40.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d36ffd700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d1c004b00 0x7f4d1c004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:40.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c00bbd0 con 0x7f4d1c003f00 2019-11-28T11:53:40.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c00be00 con 0x7f4d1c004b00 2019-11-28T11:53:40.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c00c030 con 0x7f4d1c0035b0 2019-11-28T11:53:40.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3d99d700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d1c003f00 0x7f4d1c0043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:40.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3e19e700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d1c0035b0 0x7f4d1c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:40.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3e99f700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d1c004b00 0x7f4d1c004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:40.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3d99d700 1 -- 172.21.15.80:0/2291026865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d1c0035b0 msgr2=0x7f4d1c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3d99d700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d1c0035b0 0x7f4d1c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:40.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3d99d700 1 -- 172.21.15.80:0/2291026865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d1c004b00 msgr2=0x7f4d1c004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3d99d700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d1c004b00 0x7f4d1c004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:40.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3d99d700 1 -- 172.21.15.80:0/2291026865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c00c2e0 con 0x7f4d1c003f00 2019-11-28T11:53:40.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3e99f700 1 -- 172.21.15.80:0/2291026865 reap_dead start 2019-11-28T11:53:40.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3fc01700 1 -- 172.21.15.80:0/2291026865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d38079660 con 0x7f4d1c003f00 2019-11-28T11:53:40.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3d99d700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d1c003f00 0x7f4d1c0043c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d20010360 tx=0x7f4d20010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3fc01700 1 -- 172.21.15.80:0/2291026865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d380792e0 con 0x7f4d1c003f00 2019-11-28T11:53:40.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3d99d700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d1c003f00 0x7f4d1c0043c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d20010360 tx=0x7f4d20010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3d99d700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d1c003f00 0x7f4d1c0043c0 secure :-1 s=READY pgs=2386 cs=0 l=1 rx=0x7f4d20010360 tx=0x7f4d20010210).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:40.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3d99d700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d1c003f00 0x7f4d1c0043c0 secure :-1 s=THROTTLE_DONE pgs=2386 cs=0 l=1 rx=0x7f4d20010360 tx=0x7f4d20010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3d99d700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d1c003f00 0x7f4d1c0043c0 secure :-1 s=THROTTLE_DONE pgs=2386 cs=0 l=1 rx=0x7f4d20010360 tx=0x7f4d20010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d20000960 con 0x7f4d1c003f00 2019-11-28T11:53:40.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d3d99d700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d1c003f00 0x7f4d1c0043c0 secure :-1 s=THROTTLE_DONE pgs=2386 cs=0 l=1 rx=0x7f4d20010360 tx=0x7f4d20010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d20001220 con 0x7f4d1c003f00 2019-11-28T11:53:40.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.201+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d200018f0 con 0x7f4d1c003f00 2019-11-28T11:53:40.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.202+0000 7f4d3d99d700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d1c003f00 0x7f4d1c0043c0 secure :-1 s=THROTTLE_DONE pgs=2386 cs=0 l=1 rx=0x7f4d20010360 tx=0x7f4d20010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.202+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4d20001410 con 0x7f4d1c003f00 2019-11-28T11:53:40.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.202+0000 7f4d3d99d700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d1c003f00 0x7f4d1c0043c0 secure :-1 s=THROTTLE_DONE pgs=2386 cs=0 l=1 rx=0x7f4d20010360 tx=0x7f4d20010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.202+0000 7f4d36ffd700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d1c01b510 0x7f4d1c01d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:40.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.202+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f4d20031b20 con 0x7f4d1c003f00 2019-11-28T11:53:40.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.202+0000 7f4d3e19e700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d1c01b510 0x7f4d1c01d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:40.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.202+0000 7f4d3e19e700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d1c01b510 0x7f4d1c01d940 crc :-1 s=READY pgs=983 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:40.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.209+0000 7f4d3fc01700 1 -- 172.21.15.80:0/2291026865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d38079660 con 0x7f4d1c003f00 2019-11-28T11:53:40.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.212+0000 7f4d3d99d700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d1c003f00 0x7f4d1c0043c0 secure :-1 s=THROTTLE_DONE pgs=2386 cs=0 l=1 rx=0x7f4d20010360 tx=0x7f4d20010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.212+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4d20001010 con 0x7f4d1c003f00 2019-11-28T11:53:40.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.386+0000 7f4d3fc01700 1 -- 172.21.15.80:0/2291026865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d380792e0 con 0x7f4d1c003f00 2019-11-28T11:53:40.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.387+0000 7f4d3d99d700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d1c003f00 0x7f4d1c0043c0 secure :-1 s=THROTTLE_DONE pgs=2386 cs=0 l=1 rx=0x7f4d20010360 tx=0x7f4d20010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.387+0000 7f4d36ffd700 1 -- 172.21.15.80:0/2291026865 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 145 v145) v1 ==== 95+0+2454 (secure 0 0 0) 0x7f4d20001220 con 0x7f4d1c003f00 2019-11-28T11:53:40.452 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 145 2019-11-28T11:53:40.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.390+0000 7f4d3fc01700 1 -- 172.21.15.80:0/2291026865 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d1c01b510 msgr2=0x7f4d1c01d940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.390+0000 7f4d3fc01700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d1c01b510 0x7f4d1c01d940 crc :-1 s=READY pgs=983 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:40.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.390+0000 7f4d3fc01700 1 -- 172.21.15.80:0/2291026865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d1c003f00 msgr2=0x7f4d1c0043c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.390+0000 7f4d3fc01700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d1c003f00 0x7f4d1c0043c0 secure :-1 s=READY pgs=2386 cs=0 l=1 rx=0x7f4d20010360 tx=0x7f4d20010210).stop 2019-11-28T11:53:40.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.390+0000 7f4d3fc01700 1 -- 172.21.15.80:0/2291026865 shutdown_connections 2019-11-28T11:53:40.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.390+0000 7f4d3fc01700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4d1c01b510 0x7f4d1c01d940 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:40.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.390+0000 7f4d3fc01700 1 --2- 172.21.15.80:0/2291026865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4d1c003f00 0x7f4d1c0043c0 unknown :-1 s=CLOSED pgs=2386 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:40.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.390+0000 7f4d3fc01700 1 -- 172.21.15.80:0/2291026865 shutdown_connections 2019-11-28T11:53:40.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.390+0000 7f4d3fc01700 1 -- 172.21.15.80:0/2291026865 wait complete. 2019-11-28T11:53:40.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.390+0000 7f4d3fc01700 1 -- 172.21.15.80:0/2291026865 >> 172.21.15.80:0/2291026865 conn(0x7f4d3813fa50 msgr2=0x7f4d3807c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:40.454 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:40.454 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":145,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":145,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:53:39.872442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:active","state_seq":17,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:40.455 INFO:tasks.cephfs.filesystem:mapped states [u'up:active'] to up:active 2019-11-28T11:53:40.455 INFO:tasks.cephfs.filesystem:reached state 'up:active' in 50.8234329224s 2019-11-28T11:53:40.456 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:40.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.526+0000 7fd5dea68700 1 Processor -- start 2019-11-28T11:53:40.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.526+0000 7fd5dea68700 1 -- start start 2019-11-28T11:53:40.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.527+0000 7fd5dea68700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d806c0a0 0x7fd5d8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.527+0000 7fd5dea68700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d806db00 con 0x7fd5d80734e0 2019-11-28T11:53:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.527+0000 7fd5dea68700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d806e000 con 0x7fd5d8072620 2019-11-28T11:53:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.527+0000 7fd5dea68700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d806f330 con 0x7fd5d806c0a0 2019-11-28T11:53:40.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.527+0000 7fd5dc804700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd5d80734e0 0x7fd5d8071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43440/0 (socket says 172.21.15.80:43440) 2019-11-28T11:53:40.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.527+0000 7fd5dc804700 1 -- 172.21.15.80:0/2315133761 learned_addr learned my addr 172.21.15.80:0/2315133761 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:40.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.527+0000 7fd5dd005700 1 --2- 172.21.15.80:0/2315133761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d806c0a0 0x7fd5d8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:40.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.527+0000 7fd5dd806700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd5d8072620 0x7fd5d8164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:58982/0 (socket says 172.21.15.80:58982) 2019-11-28T11:53:40.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.527+0000 7fd5d7fff700 1 -- 172.21.15.80:0/2315133761 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138843387 0 0) 0x7fd5cc0013f0 con 0x7fd5d80734e0 2019-11-28T11:53:40.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5d7fff700 1 -- 172.21.15.80:0/2315133761 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5c0002e80 con 0x7fd5d80734e0 2019-11-28T11:53:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5d7fff700 1 -- 172.21.15.80:0/2315133761 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388171502 0 0) 0x7fd5d00009b0 con 0x7fd5d8072620 2019-11-28T11:53:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5d7fff700 1 -- 172.21.15.80:0/2315133761 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5c0004170 con 0x7fd5d8072620 2019-11-28T11:53:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5dd005700 1 -- 172.21.15.80:0/2315133761 >> v1:172.21.15.174:6789/0 conn(0x7fd5d8072620 legacy=0x7fd5d8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5dd005700 1 -- 172.21.15.80:0/2315133761 >> v1:172.21.15.80:6789/0 conn(0x7fd5d80734e0 legacy=0x7fd5d8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5dd005700 1 -- 172.21.15.80:0/2315133761 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d80706c0 con 0x7fd5d806c0a0 2019-11-28T11:53:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5dd005700 1 --2- 172.21.15.80:0/2315133761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d806c0a0 0x7fd5d8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd5c800af50 tx=0x7fd5c800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5dd005700 1 --2- 172.21.15.80:0/2315133761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d806c0a0 0x7fd5d8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd5c800af50 tx=0x7fd5c800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5dd005700 1 --2- 172.21.15.80:0/2315133761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d806c0a0 0x7fd5d8072fa0 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7fd5c800af50 tx=0x7fd5c800b760).ready entity=mon.2 client_cookie=bd7bcd7d1ff6c3d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:40.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5dd005700 1 --2- 172.21.15.80:0/2315133761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d806c0a0 0x7fd5d8072fa0 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7fd5c800af50 tx=0x7fd5c800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5d7fff700 1 -- 172.21.15.80:0/2315133761 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5c8000960 con 0x7fd5d806c0a0 2019-11-28T11:53:40.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5dd005700 1 --2- 172.21.15.80:0/2315133761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d806c0a0 0x7fd5d8072fa0 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7fd5c800af50 tx=0x7fd5c800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5dd005700 1 --2- 172.21.15.80:0/2315133761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d806c0a0 0x7fd5d8072fa0 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7fd5c800af50 tx=0x7fd5c800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5d7fff700 1 -- 172.21.15.80:0/2315133761 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c8009860 con 0x7fd5d806c0a0 2019-11-28T11:53:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5d7fff700 1 -- 172.21.15.80:0/2315133761 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5c8009f30 con 0x7fd5d806c0a0 2019-11-28T11:53:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5dea68700 1 -- 172.21.15.80:0/2315133761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d806c0a0 msgr2=0x7fd5d8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.528+0000 7fd5dea68700 1 --2- 172.21.15.80:0/2315133761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d806c0a0 0x7fd5d8072fa0 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7fd5c800af50 tx=0x7fd5c800b760).stop 2019-11-28T11:53:40.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.529+0000 7fd5dea68700 1 -- 172.21.15.80:0/2315133761 shutdown_connections 2019-11-28T11:53:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.529+0000 7fd5dea68700 1 --2- 172.21.15.80:0/2315133761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d806c0a0 0x7fd5d8072fa0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.529+0000 7fd5dea68700 1 -- 172.21.15.80:0/2315133761 shutdown_connections 2019-11-28T11:53:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.529+0000 7fd5dea68700 1 -- 172.21.15.80:0/2315133761 wait complete. 2019-11-28T11:53:40.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.529+0000 7fd5dea68700 1 -- 172.21.15.80:0/2315133761 >> 172.21.15.80:0/2315133761 conn(0x7fd5d8061cf0 msgr2=0x7fd5d8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:40.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.532+0000 7fd5dea68700 1 Processor -- start 2019-11-28T11:53:40.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.532+0000 7fd5dea68700 1 -- start start 2019-11-28T11:53:40.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dea68700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d8111db0 0x7fd5d81238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:40.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dea68700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd5d8165a00 0x7fd5d8167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:40.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dea68700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d8124260 con 0x7fd5d812cea0 2019-11-28T11:53:40.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dea68700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d8121040 con 0x7fd5d8165a00 2019-11-28T11:53:40.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dea68700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d8121310 con 0x7fd5d8111db0 2019-11-28T11:53:40.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dd005700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd5d812cea0 0x7fd5d81230e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43442/0 (socket says 172.21.15.80:43442) 2019-11-28T11:53:40.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dd005700 1 -- 172.21.15.80:0/206387520 learned_addr learned my addr 172.21.15.80:0/206387520 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:40.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dc804700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d8111db0 0x7fd5d81238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:40.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dd806700 1 --2- 172.21.15.80:0/206387520 >> v2:172.21.15.174:3300/0 conn(0x7fd5d8165a00 0x7fd5d8167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:40.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5d5ffb700 1 -- 172.21.15.80:0/206387520 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441698012 0 0) 0x7fd5c800b3d0 con 0x7fd5d812cea0 2019-11-28T11:53:40.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5d5ffb700 1 -- 172.21.15.80:0/206387520 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5b8002e80 con 0x7fd5d812cea0 2019-11-28T11:53:40.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dc804700 1 -- 172.21.15.80:0/206387520 >> v2:172.21.15.174:3300/0 conn(0x7fd5d8165a00 msgr2=0x7fd5d8167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dc804700 1 --2- 172.21.15.80:0/206387520 >> v2:172.21.15.174:3300/0 conn(0x7fd5d8165a00 0x7fd5d8167e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:40.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dc804700 1 -- 172.21.15.80:0/206387520 >> v1:172.21.15.80:6789/0 conn(0x7fd5d812cea0 legacy=0x7fd5d81230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5d5ffb700 1 -- 172.21.15.80:0/206387520 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 643062581 0 0) 0x7fd5c8000940 con 0x7fd5d812cea0 2019-11-28T11:53:40.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dc804700 1 -- 172.21.15.80:0/206387520 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d81219a0 con 0x7fd5d8111db0 2019-11-28T11:53:40.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dd806700 1 --2- 172.21.15.80:0/206387520 >> v2:172.21.15.174:3300/0 conn(0x7fd5d8165a00 0x7fd5d8167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:40.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dc804700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d8111db0 0x7fd5d81238e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd5cc010710 tx=0x7fd5cc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dc804700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d8111db0 0x7fd5d81238e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd5cc010710 tx=0x7fd5cc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.533+0000 7fd5dc804700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d8111db0 0x7fd5d81238e0 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7fd5cc010710 tx=0x7fd5cc010ab0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:40.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.534+0000 7fd5dc804700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d8111db0 0x7fd5d81238e0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7fd5cc010710 tx=0x7fd5cc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.534+0000 7fd5d5ffb700 1 -- 172.21.15.80:0/206387520 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5cc000ce0 con 0x7fd5d8111db0 2019-11-28T11:53:40.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.534+0000 7fd5dc804700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d8111db0 0x7fd5d81238e0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7fd5cc010710 tx=0x7fd5cc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.534+0000 7fd5dc804700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d8111db0 0x7fd5d81238e0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7fd5cc010710 tx=0x7fd5cc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.534+0000 7fd5d5ffb700 1 -- 172.21.15.80:0/206387520 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc001500 con 0x7fd5d8111db0 2019-11-28T11:53:40.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.534+0000 7fd5dea68700 1 -- 172.21.15.80:0/206387520 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d8121d20 con 0x7fd5d8111db0 2019-11-28T11:53:40.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.534+0000 7fd5d5ffb700 1 -- 172.21.15.80:0/206387520 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5cc001c10 con 0x7fd5d8111db0 2019-11-28T11:53:40.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.534+0000 7fd5dea68700 1 -- 172.21.15.80:0/206387520 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d81219a0 con 0x7fd5d8111db0 2019-11-28T11:53:40.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.534+0000 7fd5dc804700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d8111db0 0x7fd5d81238e0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7fd5cc010710 tx=0x7fd5cc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.534+0000 7fd5d5ffb700 1 -- 172.21.15.80:0/206387520 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd5cc0016f0 con 0x7fd5d8111db0 2019-11-28T11:53:40.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.534+0000 7fd5dc804700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d8111db0 0x7fd5d81238e0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7fd5cc010710 tx=0x7fd5cc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.534+0000 7fd5d5ffb700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd5b8018780 0x7fd5b801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:40.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.534+0000 7fd5d5ffb700 1 -- 172.21.15.80:0/206387520 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fd5cc031d40 con 0x7fd5d8111db0 2019-11-28T11:53:40.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.535+0000 7fd5dd005700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd5b8018780 0x7fd5b801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:40.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.535+0000 7fd5dd005700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd5b8018780 0x7fd5b801abf0 crc :-1 s=READY pgs=984 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:40.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.541+0000 7fd5dea68700 1 -- 172.21.15.80:0/206387520 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d8121d20 con 0x7fd5d8111db0 2019-11-28T11:53:40.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.545+0000 7fd5dc804700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d8111db0 0x7fd5d81238e0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7fd5cc010710 tx=0x7fd5cc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.545+0000 7fd5d5ffb700 1 -- 172.21.15.80:0/206387520 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd5cc001100 con 0x7fd5d8111db0 2019-11-28T11:53:40.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.716+0000 7fd5dea68700 1 -- 172.21.15.80:0/206387520 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5d81219a0 con 0x7fd5d8111db0 2019-11-28T11:53:40.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.717+0000 7fd5dc804700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d8111db0 0x7fd5d81238e0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7fd5cc010710 tx=0x7fd5cc010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:40.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.717+0000 7fd5d5ffb700 1 -- 172.21.15.80:0/206387520 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 145 v145) v1 ==== 95+0+2454 (secure 0 0 0) 0x7fd5cc0016f0 con 0x7fd5d8111db0 2019-11-28T11:53:40.778 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 145 2019-11-28T11:53:40.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.719+0000 7fd5dea68700 1 -- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd5b8018780 msgr2=0x7fd5b801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.719+0000 7fd5dea68700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd5b8018780 0x7fd5b801abf0 crc :-1 s=READY pgs=984 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:40.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.719+0000 7fd5dea68700 1 -- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d8111db0 msgr2=0x7fd5d81238e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:40.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.719+0000 7fd5dea68700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d8111db0 0x7fd5d81238e0 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7fd5cc010710 tx=0x7fd5cc010ab0).stop 2019-11-28T11:53:40.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.719+0000 7fd5dea68700 1 -- 172.21.15.80:0/206387520 shutdown_connections 2019-11-28T11:53:40.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.719+0000 7fd5dea68700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd5b8018780 0x7fd5b801abf0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:40.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.719+0000 7fd5dea68700 1 --2- 172.21.15.80:0/206387520 >> v2:172.21.15.174:3300/0 conn(0x7fd5d8165a00 0x7fd5d8167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:40.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.719+0000 7fd5dea68700 1 --2- 172.21.15.80:0/206387520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5d8111db0 0x7fd5d81238e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:40.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.719+0000 7fd5dea68700 1 -- 172.21.15.80:0/206387520 shutdown_connections 2019-11-28T11:53:40.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.719+0000 7fd5dea68700 1 -- 172.21.15.80:0/206387520 wait complete. 2019-11-28T11:53:40.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:40.719+0000 7fd5dea68700 1 -- 172.21.15.80:0/206387520 >> 172.21.15.80:0/206387520 conn(0x7fd5d81426c0 msgr2=0x7fd5d8110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:40.790 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:40.791 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":145,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":145,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:53:39.872442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:active","state_seq":17,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:40.792 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok session ls 2019-11-28T11:53:40.930 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:53:40.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:40.930 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 10650, 2019-11-28T11:53:40.931 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": { 2019-11-28T11:53:40.931 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2019-11-28T11:53:40.931 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2019-11-28T11:53:40.931 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 10650 2019-11-28T11:53:40.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:40.931 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2019-11-28T11:53:40.931 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:40.932 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.16:0", 2019-11-28T11:53:40.932 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1076095543 2019-11-28T11:53:40.932 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:40.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:40.932 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "open", 2019-11-28T11:53:40.932 INFO:teuthology.orchestra.run.smithi080.stdout: "num_leases": 0, 2019-11-28T11:53:40.933 INFO:teuthology.orchestra.run.smithi080.stdout: "num_caps": 1, 2019-11-28T11:53:40.933 INFO:teuthology.orchestra.run.smithi080.stdout: "request_load_avg": 0, 2019-11-28T11:53:40.933 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 54.105160857000001, 2019-11-28T11:53:40.933 INFO:teuthology.orchestra.run.smithi080.stdout: "requests_in_flight": 0, 2019-11-28T11:53:40.933 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": 0, 2019-11-28T11:53:40.934 INFO:teuthology.orchestra.run.smithi080.stdout: "reconnecting": false, 2019-11-28T11:53:40.934 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps": { 2019-11-28T11:53:40.936 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:53:40.937 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:53:40.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: "release_caps": { 2019-11-28T11:53:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:53:40.939 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:53:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle": { 2019-11-28T11:53:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:53:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 2.5 2019-11-28T11:53:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle2o": { 2019-11-28T11:53:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:53:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 0.5 2019-11-28T11:53:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: "session_cache_liveness": { 2019-11-28T11:53:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0.88453182439248157, 2019-11-28T11:53:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 300 2019-11-28T11:53:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:40.946 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": "client.10650 v1:172.21.15.16:0/1076095543", 2019-11-28T11:53:40.946 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": [], 2019-11-28T11:53:40.946 INFO:teuthology.orchestra.run.smithi080.stdout: "prealloc_inos": [], 2019-11-28T11:53:40.947 INFO:teuthology.orchestra.run.smithi080.stdout: "used_inos": [], 2019-11-28T11:53:40.947 INFO:teuthology.orchestra.run.smithi080.stdout: "client_metadata": { 2019-11-28T11:53:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: "features": "00000000000000ff", 2019-11-28T11:53:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "1", 2019-11-28T11:53:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi016", 2019-11-28T11:53:40.949 INFO:teuthology.orchestra.run.smithi080.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:53:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2019-11-28T11:53:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:40.950 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:53:40.951 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 10650, "entity": { "name": { "type": "client", "num": 10650 }, "addr": { "type": "v1", "addr": "172.21.15.16:0", "nonce": 1076095543 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 54.105160857000001, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.88453182439248157, "halflife": 300 }, "inst": "client.10650 v1:172.21.15.16:0/1076095543", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "1", "hostname": "smithi016", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:53:40.952 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:53:41.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.020+0000 7fcdec65c700 1 Processor -- start 2019-11-28T11:53:41.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.020+0000 7fcdec65c700 1 -- start start 2019-11-28T11:53:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdec65c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcde406c0a0 0x7fcde4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdec65c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcde40734e0 0x7fcde4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdec65c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde406db00 con 0x7fcde4072360 2019-11-28T11:53:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdec65c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde406fd60 con 0x7fcde406c0a0 2019-11-28T11:53:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdec65c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde4070030 con 0x7fcde40734e0 2019-11-28T11:53:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdeabf9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcde406c0a0 0x7fcde4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdeabf9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcde406c0a0 0x7fcde4072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44134/0 (socket says 172.21.15.80:44134) 2019-11-28T11:53:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdeabf9700 1 -- 172.21.15.80:0/1677073184 learned_addr learned my addr 172.21.15.80:0/1677073184 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdea3f8700 1 --2- 172.21.15.80:0/1677073184 >> v2:172.21.15.174:3300/0 conn(0x7fcde40734e0 0x7fcde4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdeabf9700 1 -- 172.21.15.80:0/1677073184 >> v2:172.21.15.174:3300/0 conn(0x7fcde40734e0 msgr2=0x7fcde4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdeabf9700 1 --2- 172.21.15.80:0/1677073184 >> v2:172.21.15.174:3300/0 conn(0x7fcde40734e0 0x7fcde4071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdeabf9700 1 -- 172.21.15.80:0/1677073184 >> v1:172.21.15.174:6789/0 conn(0x7fcde4072360 legacy=0x7fcde406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdeabf9700 1 -- 172.21.15.80:0/1677073184 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde40706c0 con 0x7fcde406c0a0 2019-11-28T11:53:41.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdea3f8700 1 --2- 172.21.15.80:0/1677073184 >> v2:172.21.15.174:3300/0 conn(0x7fcde40734e0 0x7fcde4071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:53:41.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdeabf9700 1 --2- 172.21.15.80:0/1677073184 >> v2:172.21.15.80:3300/0 conn(0x7fcde406c0a0 0x7fcde4072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcdd400fac0 tx=0x7fcdd400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdeabf9700 1 --2- 172.21.15.80:0/1677073184 >> v2:172.21.15.80:3300/0 conn(0x7fcde406c0a0 0x7fcde4072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcdd400fac0 tx=0x7fcdd400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.021+0000 7fcdeabf9700 1 --2- 172.21.15.80:0/1677073184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde406c0a0 0x7fcde4072fa0 secure :-1 s=READY pgs=2389 cs=0 l=1 rx=0x7fcdd400fac0 tx=0x7fcdd400fe60).ready entity=mon.0 client_cookie=676249842e097e72 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:41.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.022+0000 7fcdeabf9700 1 --2- 172.21.15.80:0/1677073184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde406c0a0 0x7fcde4072fa0 secure :-1 s=THROTTLE_DONE pgs=2389 cs=0 l=1 rx=0x7fcdd400fac0 tx=0x7fcdd400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.022+0000 7fcdeabf9700 1 --2- 172.21.15.80:0/1677073184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde406c0a0 0x7fcde4072fa0 secure :-1 s=THROTTLE_DONE pgs=2389 cs=0 l=1 rx=0x7fcdd400fac0 tx=0x7fcdd400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.022+0000 7fcde9bf7700 1 -- 172.21.15.80:0/1677073184 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdd4000ce0 con 0x7fcde406c0a0 2019-11-28T11:53:41.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.022+0000 7fcdeabf9700 1 --2- 172.21.15.80:0/1677073184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde406c0a0 0x7fcde4072fa0 secure :-1 s=THROTTLE_DONE pgs=2389 cs=0 l=1 rx=0x7fcdd400fac0 tx=0x7fcdd400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.022+0000 7fcde9bf7700 1 -- 172.21.15.80:0/1677073184 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd4001010 con 0x7fcde406c0a0 2019-11-28T11:53:41.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.022+0000 7fcde9bf7700 1 -- 172.21.15.80:0/1677073184 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdd4001720 con 0x7fcde406c0a0 2019-11-28T11:53:41.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.022+0000 7fcdec65c700 1 -- 172.21.15.80:0/1677073184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde406c0a0 msgr2=0x7fcde4072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.022+0000 7fcdec65c700 1 --2- 172.21.15.80:0/1677073184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde406c0a0 0x7fcde4072fa0 secure :-1 s=READY pgs=2389 cs=0 l=1 rx=0x7fcdd400fac0 tx=0x7fcdd400fe60).stop 2019-11-28T11:53:41.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.022+0000 7fcdec65c700 1 -- 172.21.15.80:0/1677073184 shutdown_connections 2019-11-28T11:53:41.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.022+0000 7fcdec65c700 1 --2- 172.21.15.80:0/1677073184 >> v2:172.21.15.174:3300/0 conn(0x7fcde40734e0 0x7fcde4071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:41.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.022+0000 7fcdec65c700 1 --2- 172.21.15.80:0/1677073184 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde406c0a0 0x7fcde4072fa0 unknown :-1 s=CLOSED pgs=2389 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.022+0000 7fcdec65c700 1 -- 172.21.15.80:0/1677073184 shutdown_connections 2019-11-28T11:53:41.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.022+0000 7fcdec65c700 1 -- 172.21.15.80:0/1677073184 wait complete. 2019-11-28T11:53:41.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.022+0000 7fcdec65c700 1 -- 172.21.15.80:0/1677073184 >> 172.21.15.80:0/1677073184 conn(0x7fcde4061cf0 msgr2=0x7fcde4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:41.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.025+0000 7fcdec65c700 1 Processor -- start 2019-11-28T11:53:41.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.025+0000 7fcdec65c700 1 -- start start 2019-11-28T11:53:41.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcdec65c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcde413e9e0 0x7fcde4108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:41.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcdec65c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcde4109430 0x7fcde41098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:41.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcdec65c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde41066e0 con 0x7fcde413e5f0 2019-11-28T11:53:41.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcdec65c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde410e060 con 0x7fcde4109430 2019-11-28T11:53:41.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcdec65c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde410e330 con 0x7fcde413e9e0 2019-11-28T11:53:41.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcdeabf9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcde413e5f0 0x7fcde410a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43456/0 (socket says 172.21.15.80:43456) 2019-11-28T11:53:41.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcdeb3fa700 1 --2- 172.21.15.80:0/4254395174 >> v2:172.21.15.80:3300/0 conn(0x7fcde4109430 0x7fcde41098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:41.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcdeabf9700 1 -- 172.21.15.80:0/4254395174 learned_addr learned my addr 172.21.15.80:0/4254395174 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:41.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcdea3f8700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcde413e9e0 0x7fcde4108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:41.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcde37fe700 1 -- 172.21.15.80:0/4254395174 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949667734 0 0) 0x7fcdd4008190 con 0x7fcde413e5f0 2019-11-28T11:53:41.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcde37fe700 1 -- 172.21.15.80:0/4254395174 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdc4002e80 con 0x7fcde413e5f0 2019-11-28T11:53:41.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcdeb3fa700 1 -- 172.21.15.80:0/4254395174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcde413e9e0 msgr2=0x7fcde4108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcdeb3fa700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcde413e9e0 0x7fcde4108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcdeb3fa700 1 -- 172.21.15.80:0/4254395174 >> v1:172.21.15.80:6789/0 conn(0x7fcde413e5f0 legacy=0x7fcde410a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcdeb3fa700 1 -- 172.21.15.80:0/4254395174 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde410e9c0 con 0x7fcde4109430 2019-11-28T11:53:41.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcdeb3fa700 1 --2- 172.21.15.80:0/4254395174 >> v2:172.21.15.80:3300/0 conn(0x7fcde4109430 0x7fcde41098a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcddc0103b0 tx=0x7fcddc00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcdeb3fa700 1 --2- 172.21.15.80:0/4254395174 >> v2:172.21.15.80:3300/0 conn(0x7fcde4109430 0x7fcde41098a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcddc0103b0 tx=0x7fcddc00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.026+0000 7fcdeb3fa700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde4109430 0x7fcde41098a0 secure :-1 s=READY pgs=2391 cs=0 l=1 rx=0x7fcddc0103b0 tx=0x7fcddc00b2f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:41.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.027+0000 7fcdeb3fa700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde4109430 0x7fcde41098a0 secure :-1 s=THROTTLE_DONE pgs=2391 cs=0 l=1 rx=0x7fcddc0103b0 tx=0x7fcddc00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.027+0000 7fcde37fe700 1 -- 172.21.15.80:0/4254395174 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcddc0097a0 con 0x7fcde4109430 2019-11-28T11:53:41.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.027+0000 7fcdeb3fa700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde4109430 0x7fcde41098a0 secure :-1 s=THROTTLE_DONE pgs=2391 cs=0 l=1 rx=0x7fcddc0103b0 tx=0x7fcddc00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.027+0000 7fcdeb3fa700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde4109430 0x7fcde41098a0 secure :-1 s=THROTTLE_DONE pgs=2391 cs=0 l=1 rx=0x7fcddc0103b0 tx=0x7fcddc00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.027+0000 7fcde37fe700 1 -- 172.21.15.80:0/4254395174 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc00a6c0 con 0x7fcde4109430 2019-11-28T11:53:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.027+0000 7fcde37fe700 1 -- 172.21.15.80:0/4254395174 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcddc0097a0 con 0x7fcde4109430 2019-11-28T11:53:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.027+0000 7fcdec65c700 1 -- 172.21.15.80:0/4254395174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde410ed40 con 0x7fcde4109430 2019-11-28T11:53:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.027+0000 7fcdec65c700 1 -- 172.21.15.80:0/4254395174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde410e9c0 con 0x7fcde4109430 2019-11-28T11:53:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.027+0000 7fcdeb3fa700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde4109430 0x7fcde41098a0 secure :-1 s=THROTTLE_DONE pgs=2391 cs=0 l=1 rx=0x7fcddc0103b0 tx=0x7fcddc00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.027+0000 7fcde37fe700 1 -- 172.21.15.80:0/4254395174 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcddc009590 con 0x7fcde4109430 2019-11-28T11:53:41.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.027+0000 7fcdeb3fa700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde4109430 0x7fcde41098a0 secure :-1 s=THROTTLE_DONE pgs=2391 cs=0 l=1 rx=0x7fcddc0103b0 tx=0x7fcddc00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.027+0000 7fcde37fe700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcdc4018770 0x7fcdc401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:41.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.027+0000 7fcde37fe700 1 -- 172.21.15.80:0/4254395174 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fcddc031a00 con 0x7fcde4109430 2019-11-28T11:53:41.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.028+0000 7fcdeabf9700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcdc4018770 0x7fcdc401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:41.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.028+0000 7fcdeabf9700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcdc4018770 0x7fcdc401abe0 crc :-1 s=READY pgs=985 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:41.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.035+0000 7fcdec65c700 1 -- 172.21.15.80:0/4254395174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde410ed40 con 0x7fcde4109430 2019-11-28T11:53:41.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.039+0000 7fcdeb3fa700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde4109430 0x7fcde41098a0 secure :-1 s=THROTTLE_DONE pgs=2391 cs=0 l=1 rx=0x7fcddc0103b0 tx=0x7fcddc00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.039+0000 7fcde37fe700 1 -- 172.21.15.80:0/4254395174 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcddc000c00 con 0x7fcde4109430 2019-11-28T11:53:41.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.214+0000 7fcdec65c700 1 -- 172.21.15.80:0/4254395174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcde410e9c0 con 0x7fcde4109430 2019-11-28T11:53:41.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.215+0000 7fcdeb3fa700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde4109430 0x7fcde41098a0 secure :-1 s=THROTTLE_DONE pgs=2391 cs=0 l=1 rx=0x7fcddc0103b0 tx=0x7fcddc00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.215+0000 7fcde37fe700 1 -- 172.21.15.80:0/4254395174 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+15064 (secure 0 0 0) 0x7fcddc009590 con 0x7fcde4109430 2019-11-28T11:53:41.271 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:41.271 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":180,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:53:37.870040+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:52:29.768232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2019-11-28T11:52:30.506393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.76:0/2848418618":"2019-11-28T12:53:37.633207+0000","172.21.15.174:6835/3265178535":"2019-11-29T11:52:41.288215+0000","172.21.15.174:6834/3265178535":"2019-11-29T11:52:41.288215+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:53:41.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.217+0000 7fcdec65c700 1 -- 172.21.15.80:0/4254395174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcdc4018770 msgr2=0x7fcdc401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.217+0000 7fcdec65c700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcdc4018770 0x7fcdc401abe0 crc :-1 s=READY pgs=985 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.217+0000 7fcdec65c700 1 -- 172.21.15.80:0/4254395174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde4109430 msgr2=0x7fcde41098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.217+0000 7fcdec65c700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde4109430 0x7fcde41098a0 secure :-1 s=READY pgs=2391 cs=0 l=1 rx=0x7fcddc0103b0 tx=0x7fcddc00b2f0).stop 2019-11-28T11:53:41.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.217+0000 7fcdec65c700 1 -- 172.21.15.80:0/4254395174 shutdown_connections 2019-11-28T11:53:41.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.217+0000 7fcdec65c700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcdc4018770 0x7fcdc401abe0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.217+0000 7fcdec65c700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcde4109430 0x7fcde41098a0 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.217+0000 7fcdec65c700 1 --2- 172.21.15.80:0/4254395174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcde413e9e0 0x7fcde4108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.217+0000 7fcdec65c700 1 -- 172.21.15.80:0/4254395174 shutdown_connections 2019-11-28T11:53:41.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.217+0000 7fcdec65c700 1 -- 172.21.15.80:0/4254395174 wait complete. 2019-11-28T11:53:41.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.217+0000 7fcdec65c700 1 -- 172.21.15.80:0/4254395174 >> 172.21.15.80:0/4254395174 conn(0x7fcde413d620 msgr2=0x7fcde413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:41.283 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:52:29.768232+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 28, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'175', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:52:30.506393+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 29, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'176', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:53:41.283 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:53:41.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.350+0000 7f7118759700 1 Processor -- start 2019-11-28T11:53:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.350+0000 7f7118759700 1 -- start start 2019-11-28T11:53:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.351+0000 7f7118759700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f711015f100 0x7f711006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f7118759700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f711006c2f0 0x7f711006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f7118759700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711006db60 con 0x7f711015ed10 2019-11-28T11:53:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f7118759700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711006fe00 con 0x7f711006c2f0 2019-11-28T11:53:41.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f7118759700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71100700d0 con 0x7f711015f100 2019-11-28T11:53:41.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f71174f7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f711006c2f0 0x7f711006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:41.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f71174f7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f711006c2f0 0x7f711006c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44150/0 (socket says 172.21.15.80:44150) 2019-11-28T11:53:41.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f7116cf6700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f711015ed10 0x7f7110073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43464/0 (socket says 172.21.15.80:43464) 2019-11-28T11:53:41.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f71174f7700 1 -- 172.21.15.80:0/278743578 learned_addr learned my addr 172.21.15.80:0/278743578 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:41.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f71164f5700 1 --2- 172.21.15.80:0/278743578 >> v2:172.21.15.174:3300/0 conn(0x7f711015f100 0x7f711006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:41.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f71174f7700 1 -- 172.21.15.80:0/278743578 >> v2:172.21.15.174:3300/0 conn(0x7f711015f100 msgr2=0x7f711006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:41.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f71174f7700 1 --2- 172.21.15.80:0/278743578 >> v2:172.21.15.174:3300/0 conn(0x7f711015f100 0x7f711006bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f71174f7700 1 -- 172.21.15.80:0/278743578 >> v1:172.21.15.80:6789/0 conn(0x7f711015ed10 legacy=0x7f7110073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f71174f7700 1 -- 172.21.15.80:0/278743578 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7110070760 con 0x7f711006c2f0 2019-11-28T11:53:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f7115cf4700 1 -- 172.21.15.80:0/278743578 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669760950 0 0) 0x7f7100001100 con 0x7f711015ed10 2019-11-28T11:53:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f71174f7700 1 --2- 172.21.15.80:0/278743578 >> v2:172.21.15.80:3300/0 conn(0x7f711006c2f0 0x7f711006c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f710800fa30 tx=0x7f710800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f71174f7700 1 --2- 172.21.15.80:0/278743578 >> v2:172.21.15.80:3300/0 conn(0x7f711006c2f0 0x7f711006c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f710800fa30 tx=0x7f710800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f71174f7700 1 --2- 172.21.15.80:0/278743578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f711006c2f0 0x7f711006c770 secure :-1 s=READY pgs=2393 cs=0 l=1 rx=0x7f710800fa30 tx=0x7f710800fdd0).ready entity=mon.0 client_cookie=8b7dff71cc2545ef server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:41.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f71174f7700 1 --2- 172.21.15.80:0/278743578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f711006c2f0 0x7f711006c770 secure :-1 s=THROTTLE_DONE pgs=2393 cs=0 l=1 rx=0x7f710800fa30 tx=0x7f710800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f7115cf4700 1 -- 172.21.15.80:0/278743578 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7108000df0 con 0x7f711006c2f0 2019-11-28T11:53:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f71174f7700 1 --2- 172.21.15.80:0/278743578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f711006c2f0 0x7f711006c770 secure :-1 s=THROTTLE_DONE pgs=2393 cs=0 l=1 rx=0x7f710800fa30 tx=0x7f710800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f7115cf4700 1 -- 172.21.15.80:0/278743578 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7108001460 con 0x7f711006c2f0 2019-11-28T11:53:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f71174f7700 1 --2- 172.21.15.80:0/278743578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f711006c2f0 0x7f711006c770 secure :-1 s=THROTTLE_DONE pgs=2393 cs=0 l=1 rx=0x7f710800fa30 tx=0x7f710800fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f7115cf4700 1 -- 172.21.15.80:0/278743578 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7108001650 con 0x7f711006c2f0 2019-11-28T11:53:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f7118759700 1 -- 172.21.15.80:0/278743578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f711006c2f0 msgr2=0x7f711006c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.352+0000 7f7118759700 1 --2- 172.21.15.80:0/278743578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f711006c2f0 0x7f711006c770 secure :-1 s=READY pgs=2393 cs=0 l=1 rx=0x7f710800fa30 tx=0x7f710800fdd0).stop 2019-11-28T11:53:41.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.353+0000 7f7118759700 1 -- 172.21.15.80:0/278743578 shutdown_connections 2019-11-28T11:53:41.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.353+0000 7f7118759700 1 --2- 172.21.15.80:0/278743578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f711006c2f0 0x7f711006c770 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.353+0000 7f7118759700 1 --2- 172.21.15.80:0/278743578 >> v2:172.21.15.174:3300/0 conn(0x7f711015f100 0x7f711006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:41.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.353+0000 7f7118759700 1 -- 172.21.15.80:0/278743578 shutdown_connections 2019-11-28T11:53:41.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.353+0000 7f7118759700 1 -- 172.21.15.80:0/278743578 wait complete. 2019-11-28T11:53:41.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.353+0000 7f7118759700 1 -- 172.21.15.80:0/278743578 >> 172.21.15.80:0/278743578 conn(0x7f7110061d20 msgr2=0x7f71100641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:41.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.356+0000 7f7118759700 1 Processor -- start 2019-11-28T11:53:41.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.356+0000 7f7118759700 1 -- start start 2019-11-28T11:53:41.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.356+0000 7f7118759700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f711010e970 0x7f71101087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:41.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.356+0000 7f7118759700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7110107e30 0x7f7110167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:41.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.356+0000 7f7118759700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711010c250 con 0x7f7110108cf0 2019-11-28T11:53:41.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.356+0000 7f7118759700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711010e430 con 0x7f711010e970 2019-11-28T11:53:41.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.356+0000 7f7118759700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7110105860 con 0x7f7110107e30 2019-11-28T11:53:41.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f71164f5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7110108cf0 0x7f7110107630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43472/0 (socket says 172.21.15.80:43472) 2019-11-28T11:53:41.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f71164f5700 1 -- 172.21.15.80:0/1091851885 learned_addr learned my addr 172.21.15.80:0/1091851885 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:41.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f7116cf6700 1 --2- 172.21.15.80:0/1091851885 >> v2:172.21.15.174:3300/0 conn(0x7f711010e970 0x7f71101087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:41.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f71174f7700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7110107e30 0x7f7110167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:41.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f710f7fe700 1 -- 172.21.15.80:0/1091851885 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898754245 0 0) 0x7f70f80057b0 con 0x7f7110108cf0 2019-11-28T11:53:41.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f710f7fe700 1 -- 172.21.15.80:0/1091851885 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70f4002e80 con 0x7f7110108cf0 2019-11-28T11:53:41.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f710f7fe700 1 -- 172.21.15.80:0/1091851885 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2796409335 0 0) 0x7f70f8000dc0 con 0x7f7110108cf0 2019-11-28T11:53:41.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f7116cf6700 1 -- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7110107e30 msgr2=0x7f7110167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f7116cf6700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7110107e30 0x7f7110167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f7116cf6700 1 -- 172.21.15.80:0/1091851885 >> v1:172.21.15.80:6789/0 conn(0x7f7110108cf0 legacy=0x7f7110107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f7116cf6700 1 -- 172.21.15.80:0/1091851885 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7110105ef0 con 0x7f711010e970 2019-11-28T11:53:41.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f71174f7700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7110107e30 0x7f7110167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:41.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f7116cf6700 1 --2- 172.21.15.80:0/1091851885 >> v2:172.21.15.174:3300/0 conn(0x7f711010e970 0x7f71101087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7100010370 tx=0x7f7100010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f7116cf6700 1 --2- 172.21.15.80:0/1091851885 >> v2:172.21.15.174:3300/0 conn(0x7f711010e970 0x7f71101087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7100010370 tx=0x7f7100010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f7116cf6700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f711010e970 0x7f71101087b0 secure :-1 s=READY pgs=1446 cs=0 l=1 rx=0x7f7100010370 tx=0x7f7100010710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:41.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f7116cf6700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f711010e970 0x7f71101087b0 secure :-1 s=THROTTLE_DONE pgs=1446 cs=0 l=1 rx=0x7f7100010370 tx=0x7f7100010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f710f7fe700 1 -- 172.21.15.80:0/1091851885 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7100004240 con 0x7f711010e970 2019-11-28T11:53:41.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f7116cf6700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f711010e970 0x7f71101087b0 secure :-1 s=THROTTLE_DONE pgs=1446 cs=0 l=1 rx=0x7f7100010370 tx=0x7f7100010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f710f7fe700 1 -- 172.21.15.80:0/1091851885 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7100000c90 con 0x7f711010e970 2019-11-28T11:53:41.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f7116cf6700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f711010e970 0x7f71101087b0 secure :-1 s=THROTTLE_DONE pgs=1446 cs=0 l=1 rx=0x7f7100010370 tx=0x7f7100010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f7118759700 1 -- 172.21.15.80:0/1091851885 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7110106270 con 0x7f711010e970 2019-11-28T11:53:41.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f710f7fe700 1 -- 172.21.15.80:0/1091851885 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7100004430 con 0x7f711010e970 2019-11-28T11:53:41.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.357+0000 7f7118759700 1 -- 172.21.15.80:0/1091851885 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7110105ef0 con 0x7f711010e970 2019-11-28T11:53:41.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.358+0000 7f7116cf6700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f711010e970 0x7f71101087b0 secure :-1 s=THROTTLE_DONE pgs=1446 cs=0 l=1 rx=0x7f7100010370 tx=0x7f7100010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.358+0000 7f710f7fe700 1 -- 172.21.15.80:0/1091851885 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7100004240 con 0x7f711010e970 2019-11-28T11:53:41.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.358+0000 7f7116cf6700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f711010e970 0x7f71101087b0 secure :-1 s=THROTTLE_DONE pgs=1446 cs=0 l=1 rx=0x7f7100010370 tx=0x7f7100010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.358+0000 7f710f7fe700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70f4018780 0x7f70f401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:41.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.358+0000 7f710f7fe700 1 -- 172.21.15.80:0/1091851885 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f71000319e0 con 0x7f711010e970 2019-11-28T11:53:41.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.358+0000 7f71164f5700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70f4018780 0x7f70f401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:41.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.359+0000 7f71164f5700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70f4018780 0x7f70f401abf0 crc :-1 s=READY pgs=986 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:41.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.366+0000 7f7118759700 1 -- 172.21.15.80:0/1091851885 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7110106270 con 0x7f711010e970 2019-11-28T11:53:41.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.370+0000 7f7116cf6700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f711010e970 0x7f71101087b0 secure :-1 s=THROTTLE_DONE pgs=1446 cs=0 l=1 rx=0x7f7100010370 tx=0x7f7100010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.370+0000 7f710f7fe700 1 -- 172.21.15.80:0/1091851885 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7100001220 con 0x7f711010e970 2019-11-28T11:53:41.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.536+0000 7f7118759700 1 -- 172.21.15.80:0/1091851885 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f7110105ef0 con 0x7f711010e970 2019-11-28T11:53:41.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.536+0000 7f7116cf6700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f711010e970 0x7f71101087b0 secure :-1 s=THROTTLE_DONE pgs=1446 cs=0 l=1 rx=0x7f7100010370 tx=0x7f7100010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.536+0000 7f710f7fe700 1 -- 172.21.15.80:0/1091851885 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v180) v1 ==== 92+0+10 (secure 0 0 0) 0x7f710001c630 con 0x7f711010e970 2019-11-28T11:53:41.592 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:53:41.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.538+0000 7f7118759700 1 -- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70f4018780 msgr2=0x7f70f401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.538+0000 7f7118759700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70f4018780 0x7f70f401abf0 crc :-1 s=READY pgs=986 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.538+0000 7f7118759700 1 -- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f711010e970 msgr2=0x7f71101087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.538+0000 7f7118759700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f711010e970 0x7f71101087b0 secure :-1 s=READY pgs=1446 cs=0 l=1 rx=0x7f7100010370 tx=0x7f7100010710).stop 2019-11-28T11:53:41.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.538+0000 7f7118759700 1 -- 172.21.15.80:0/1091851885 shutdown_connections 2019-11-28T11:53:41.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.538+0000 7f7118759700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f70f4018780 0x7f70f401abf0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.538+0000 7f7118759700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7110107e30 0x7f7110167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.538+0000 7f7118759700 1 --2- 172.21.15.80:0/1091851885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f711010e970 0x7f71101087b0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.539+0000 7f7118759700 1 -- 172.21.15.80:0/1091851885 shutdown_connections 2019-11-28T11:53:41.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.539+0000 7f7118759700 1 -- 172.21.15.80:0/1091851885 wait complete. 2019-11-28T11:53:41.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.539+0000 7f7118759700 1 -- 172.21.15.80:0/1091851885 >> 172.21.15.80:0/1091851885 conn(0x7f711015e2d0 msgr2=0x7f7110147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:41.603 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:53:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.670+0000 7f8097083700 1 Processor -- start 2019-11-28T11:53:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.670+0000 7f8097083700 1 -- start start 2019-11-28T11:53:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.671+0000 7f8097083700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f809015ed10 0x7f809015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:41.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.671+0000 7f8097083700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80900734b0 0x7f80900726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:41.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.671+0000 7f8097083700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f809006db60 con 0x7f8090073020 2019-11-28T11:53:41.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.671+0000 7f8097083700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809006fe00 con 0x7f80900734b0 2019-11-28T11:53:41.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.671+0000 7f8097083700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80900700d0 con 0x7f809015ed10 2019-11-28T11:53:41.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.671+0000 7f8095e21700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80900734b0 0x7f80900726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:41.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f8095e21700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80900734b0 0x7f80900726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44162/0 (socket says 172.21.15.80:44162) 2019-11-28T11:53:41.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f8095e21700 1 -- 172.21.15.80:0/1936101051 learned_addr learned my addr 172.21.15.80:0/1936101051 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:41.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f8095620700 1 --2- 172.21.15.80:0/1936101051 >> v2:172.21.15.174:3300/0 conn(0x7f809015ed10 0x7f809015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:41.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f8095e21700 1 -- 172.21.15.80:0/1936101051 >> v2:172.21.15.174:3300/0 conn(0x7f809015ed10 msgr2=0x7f809015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:41.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f8095e21700 1 --2- 172.21.15.80:0/1936101051 >> v2:172.21.15.174:3300/0 conn(0x7f809015ed10 0x7f809015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:41.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f8095e21700 1 -- 172.21.15.80:0/1936101051 >> v1:172.21.15.80:6789/0 conn(0x7f8090073020 legacy=0x7f8090071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f8095e21700 1 -- 172.21.15.80:0/1936101051 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8090070760 con 0x7f80900734b0 2019-11-28T11:53:41.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f8095e21700 1 --2- 172.21.15.80:0/1936101051 >> v2:172.21.15.80:3300/0 conn(0x7f80900734b0 0x7f80900726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f808800f6b0 tx=0x7f808800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f8095e21700 1 --2- 172.21.15.80:0/1936101051 >> v2:172.21.15.80:3300/0 conn(0x7f80900734b0 0x7f80900726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f808800f6b0 tx=0x7f808800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f8095e21700 1 --2- 172.21.15.80:0/1936101051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80900734b0 0x7f80900726a0 secure :-1 s=READY pgs=2396 cs=0 l=1 rx=0x7f808800f6b0 tx=0x7f808800fa50).ready entity=mon.0 client_cookie=fad0dcc2e15b6cc7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f8095e21700 1 --2- 172.21.15.80:0/1936101051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80900734b0 0x7f80900726a0 secure :-1 s=THROTTLE_DONE pgs=2396 cs=0 l=1 rx=0x7f808800f6b0 tx=0x7f808800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f808ffff700 1 -- 172.21.15.80:0/1936101051 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8088000a70 con 0x7f80900734b0 2019-11-28T11:53:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f8095e21700 1 --2- 172.21.15.80:0/1936101051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80900734b0 0x7f80900726a0 secure :-1 s=THROTTLE_DONE pgs=2396 cs=0 l=1 rx=0x7f808800f6b0 tx=0x7f808800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f8095e21700 1 --2- 172.21.15.80:0/1936101051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80900734b0 0x7f80900726a0 secure :-1 s=THROTTLE_DONE pgs=2396 cs=0 l=1 rx=0x7f808800f6b0 tx=0x7f808800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f808ffff700 1 -- 172.21.15.80:0/1936101051 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80880010e0 con 0x7f80900734b0 2019-11-28T11:53:41.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f808ffff700 1 -- 172.21.15.80:0/1936101051 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80880017b0 con 0x7f80900734b0 2019-11-28T11:53:41.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f8097083700 1 -- 172.21.15.80:0/1936101051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80900734b0 msgr2=0x7f80900726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.672+0000 7f8097083700 1 --2- 172.21.15.80:0/1936101051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80900734b0 0x7f80900726a0 secure :-1 s=READY pgs=2396 cs=0 l=1 rx=0x7f808800f6b0 tx=0x7f808800fa50).stop 2019-11-28T11:53:41.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.673+0000 7f8097083700 1 -- 172.21.15.80:0/1936101051 shutdown_connections 2019-11-28T11:53:41.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.673+0000 7f8097083700 1 --2- 172.21.15.80:0/1936101051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80900734b0 0x7f80900726a0 unknown :-1 s=CLOSED pgs=2396 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.673+0000 7f8097083700 1 --2- 172.21.15.80:0/1936101051 >> v2:172.21.15.174:3300/0 conn(0x7f809015ed10 0x7f809015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:41.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.673+0000 7f8097083700 1 -- 172.21.15.80:0/1936101051 shutdown_connections 2019-11-28T11:53:41.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.673+0000 7f8097083700 1 -- 172.21.15.80:0/1936101051 wait complete. 2019-11-28T11:53:41.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.673+0000 7f8097083700 1 -- 172.21.15.80:0/1936101051 >> 172.21.15.80:0/1936101051 conn(0x7f8090061d20 msgr2=0x7f80900641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:41.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.675+0000 7f8097083700 1 Processor -- start 2019-11-28T11:53:41.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.675+0000 7f8097083700 1 -- start start 2019-11-28T11:53:41.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.676+0000 7f8097083700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8090148320 0x7f809010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:41.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.676+0000 7f8097083700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f809010f290 0x7f809010dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:41.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.676+0000 7f8097083700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8090148e00 con 0x7f809010e110 2019-11-28T11:53:41.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.676+0000 7f8097083700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8090139ff0 con 0x7f809010f290 2019-11-28T11:53:41.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.676+0000 7f8097083700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809013aa20 con 0x7f8090148320 2019-11-28T11:53:41.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8094e1f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f809010f290 0x7f809010dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:41.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8095e21700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f809010e110 0x7f80901079b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43488/0 (socket says 172.21.15.80:43488) 2019-11-28T11:53:41.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8094e1f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f809010f290 0x7f809010dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44170/0 (socket says 172.21.15.80:44170) 2019-11-28T11:53:41.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8095e21700 1 -- 172.21.15.80:0/4052181906 learned_addr learned my addr 172.21.15.80:0/4052181906 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:41.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8095620700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8090148320 0x7f809010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:41.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8094e1f700 1 -- 172.21.15.80:0/4052181906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8090148320 msgr2=0x7f809010ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8094e1f700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8090148320 0x7f809010ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8094e1f700 1 -- 172.21.15.80:0/4052181906 >> v1:172.21.15.80:6789/0 conn(0x7f809010e110 legacy=0x7f80901079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8094e1f700 1 -- 172.21.15.80:0/4052181906 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809010c490 con 0x7f809010f290 2019-11-28T11:53:41.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f808dffb700 1 -- 172.21.15.80:0/4052181906 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741993278 0 0) 0x7f8088000940 con 0x7f809010e110 2019-11-28T11:53:41.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8094e1f700 1 --2- 172.21.15.80:0/4052181906 >> v2:172.21.15.80:3300/0 conn(0x7f809010f290 0x7f809010dbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80800103b0 tx=0x7f808000b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8094e1f700 1 --2- 172.21.15.80:0/4052181906 >> v2:172.21.15.80:3300/0 conn(0x7f809010f290 0x7f809010dbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80800103b0 tx=0x7f808000b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8094e1f700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f809010f290 0x7f809010dbd0 secure :-1 s=READY pgs=2398 cs=0 l=1 rx=0x7f80800103b0 tx=0x7f808000b2f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:41.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8094e1f700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f809010f290 0x7f809010dbd0 secure :-1 s=THROTTLE_DONE pgs=2398 cs=0 l=1 rx=0x7f80800103b0 tx=0x7f808000b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f808dffb700 1 -- 172.21.15.80:0/4052181906 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80800097a0 con 0x7f809010f290 2019-11-28T11:53:41.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8094e1f700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f809010f290 0x7f809010dbd0 secure :-1 s=THROTTLE_DONE pgs=2398 cs=0 l=1 rx=0x7f80800103b0 tx=0x7f808000b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8094e1f700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f809010f290 0x7f809010dbd0 secure :-1 s=THROTTLE_DONE pgs=2398 cs=0 l=1 rx=0x7f80800103b0 tx=0x7f808000b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f808dffb700 1 -- 172.21.15.80:0/4052181906 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808000a6c0 con 0x7f809010f290 2019-11-28T11:53:41.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8097083700 1 -- 172.21.15.80:0/4052181906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809010c810 con 0x7f809010f290 2019-11-28T11:53:41.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f808dffb700 1 -- 172.21.15.80:0/4052181906 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8080009e20 con 0x7f809010f290 2019-11-28T11:53:41.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.677+0000 7f8097083700 1 -- 172.21.15.80:0/4052181906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809010c490 con 0x7f809010f290 2019-11-28T11:53:41.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.678+0000 7f8094e1f700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f809010f290 0x7f809010dbd0 secure :-1 s=THROTTLE_DONE pgs=2398 cs=0 l=1 rx=0x7f80800103b0 tx=0x7f808000b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.678+0000 7f808dffb700 1 -- 172.21.15.80:0/4052181906 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8080000aa0 con 0x7f809010f290 2019-11-28T11:53:41.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.678+0000 7f8094e1f700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f809010f290 0x7f809010dbd0 secure :-1 s=THROTTLE_DONE pgs=2398 cs=0 l=1 rx=0x7f80800103b0 tx=0x7f808000b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.678+0000 7f808dffb700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8074018730 0x7f807401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:41.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.678+0000 7f808dffb700 1 -- 172.21.15.80:0/4052181906 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f8080031a00 con 0x7f809010f290 2019-11-28T11:53:41.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.678+0000 7f8095620700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8074018730 0x7f807401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:41.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.678+0000 7f8095620700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8074018730 0x7f807401abc0 crc :-1 s=READY pgs=987 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:41.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.686+0000 7f8097083700 1 -- 172.21.15.80:0/4052181906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809010c810 con 0x7f809010f290 2019-11-28T11:53:41.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.689+0000 7f8094e1f700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f809010f290 0x7f809010dbd0 secure :-1 s=THROTTLE_DONE pgs=2398 cs=0 l=1 rx=0x7f80800103b0 tx=0x7f808000b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.689+0000 7f808dffb700 1 -- 172.21.15.80:0/4052181906 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f80800173a0 con 0x7f809010f290 2019-11-28T11:53:41.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.857+0000 7f8097083700 1 -- 172.21.15.80:0/4052181906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f809010c490 con 0x7f809010f290 2019-11-28T11:53:41.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.857+0000 7f8094e1f700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f809010f290 0x7f809010dbd0 secure :-1 s=THROTTLE_DONE pgs=2398 cs=0 l=1 rx=0x7f80800103b0 tx=0x7f808000b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:41.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.857+0000 7f808dffb700 1 -- 172.21.15.80:0/4052181906 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v180) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8080000940 con 0x7f809010f290 2019-11-28T11:53:41.913 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:53:41.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.860+0000 7f8097083700 1 -- 172.21.15.80:0/4052181906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8074018730 msgr2=0x7f807401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.860+0000 7f8097083700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8074018730 0x7f807401abc0 crc :-1 s=READY pgs=987 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.860+0000 7f8097083700 1 -- 172.21.15.80:0/4052181906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f809010f290 msgr2=0x7f809010dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:41.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.860+0000 7f8097083700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f809010f290 0x7f809010dbd0 secure :-1 s=READY pgs=2398 cs=0 l=1 rx=0x7f80800103b0 tx=0x7f808000b2f0).stop 2019-11-28T11:53:41.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.860+0000 7f8097083700 1 -- 172.21.15.80:0/4052181906 shutdown_connections 2019-11-28T11:53:41.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.860+0000 7f8097083700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8074018730 0x7f807401abc0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.860+0000 7f8097083700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f809010f290 0x7f809010dbd0 unknown :-1 s=CLOSED pgs=2398 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.860+0000 7f8097083700 1 --2- 172.21.15.80:0/4052181906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8090148320 0x7f809010ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:41.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.860+0000 7f8097083700 1 -- 172.21.15.80:0/4052181906 shutdown_connections 2019-11-28T11:53:41.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.860+0000 7f8097083700 1 -- 172.21.15.80:0/4052181906 wait complete. 2019-11-28T11:53:41.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.860+0000 7f8097083700 1 -- 172.21.15.80:0/4052181906 >> 172.21.15.80:0/4052181906 conn(0x7f809015e2d0 msgr2=0x7f8090147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:41.925 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:53:42.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.992+0000 7f32a46e0700 1 Processor -- start 2019-11-28T11:53:42.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.992+0000 7f32a46e0700 1 -- start start 2019-11-28T11:53:42.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.993+0000 7f32a46e0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c1639f0 0x7f329c165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:42.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a46e0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329c06db60 con 0x7f329c15f100 2019-11-28T11:53:42.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a46e0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329c06e060 con 0x7f329c15ed10 2019-11-28T11:53:42.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a46e0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329c06fe00 con 0x7f329c1639f0 2019-11-28T11:53:42.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a247c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f329c15f100 0x7f329c06bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43496/0 (socket says 172.21.15.80:43496) 2019-11-28T11:53:42.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a247c700 1 -- 172.21.15.80:0/4260999442 learned_addr learned my addr 172.21.15.80:0/4260999442 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:42.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a347e700 1 --2- 172.21.15.80:0/4260999442 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c1639f0 0x7f329c165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:42.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a1c7b700 1 -- 172.21.15.80:0/4260999442 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213364805 0 0) 0x7f3290001150 con 0x7f329c15f100 2019-11-28T11:53:42.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a1c7b700 1 -- 172.21.15.80:0/4260999442 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3284002e80 con 0x7f329c15f100 2019-11-28T11:53:42.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a1c7b700 1 -- 172.21.15.80:0/4260999442 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142505676 0 0) 0x7f328c001080 con 0x7f329c15ed10 2019-11-28T11:53:42.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a1c7b700 1 -- 172.21.15.80:0/4260999442 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3284004170 con 0x7f329c15ed10 2019-11-28T11:53:42.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a347e700 1 -- 172.21.15.80:0/4260999442 >> v1:172.21.15.174:6789/0 conn(0x7f329c15ed10 legacy=0x7f329c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:42.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a347e700 1 -- 172.21.15.80:0/4260999442 >> v1:172.21.15.80:6789/0 conn(0x7f329c15f100 legacy=0x7f329c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:42.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a347e700 1 -- 172.21.15.80:0/4260999442 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c070760 con 0x7f329c1639f0 2019-11-28T11:53:42.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a347e700 1 --2- 172.21.15.80:0/4260999442 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c1639f0 0x7f329c165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f329400b300 tx=0x7f329400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a347e700 1 --2- 172.21.15.80:0/4260999442 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c1639f0 0x7f329c165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f329400b300 tx=0x7f329400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a347e700 1 --2- 172.21.15.80:0/4260999442 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c1639f0 0x7f329c165df0 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7f329400b300 tx=0x7f329400bb10).ready entity=mon.2 client_cookie=18e8b60ec86ea88a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:42.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a347e700 1 --2- 172.21.15.80:0/4260999442 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c1639f0 0x7f329c165df0 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7f329400b300 tx=0x7f329400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a1c7b700 1 -- 172.21.15.80:0/4260999442 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32940075c0 con 0x7f329c1639f0 2019-11-28T11:53:42.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a347e700 1 --2- 172.21.15.80:0/4260999442 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c1639f0 0x7f329c165df0 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7f329400b300 tx=0x7f329400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a347e700 1 --2- 172.21.15.80:0/4260999442 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c1639f0 0x7f329c165df0 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7f329400b300 tx=0x7f329400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a1c7b700 1 -- 172.21.15.80:0/4260999442 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3294000f30 con 0x7f329c1639f0 2019-11-28T11:53:42.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.994+0000 7f32a1c7b700 1 -- 172.21.15.80:0/4260999442 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f329400a1e0 con 0x7f329c1639f0 2019-11-28T11:53:42.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.995+0000 7f32a46e0700 1 -- 172.21.15.80:0/4260999442 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c1639f0 msgr2=0x7f329c165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:42.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.995+0000 7f32a46e0700 1 --2- 172.21.15.80:0/4260999442 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c1639f0 0x7f329c165df0 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7f329400b300 tx=0x7f329400bb10).stop 2019-11-28T11:53:42.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.995+0000 7f32a46e0700 1 -- 172.21.15.80:0/4260999442 shutdown_connections 2019-11-28T11:53:42.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.995+0000 7f32a46e0700 1 --2- 172.21.15.80:0/4260999442 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f329c1639f0 0x7f329c165df0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:42.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.995+0000 7f32a46e0700 1 -- 172.21.15.80:0/4260999442 shutdown_connections 2019-11-28T11:53:42.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.995+0000 7f32a46e0700 1 -- 172.21.15.80:0/4260999442 wait complete. 2019-11-28T11:53:42.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.995+0000 7f32a46e0700 1 -- 172.21.15.80:0/4260999442 >> 172.21.15.80:0/4260999442 conn(0x7f329c061d20 msgr2=0x7f329c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:42.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.998+0000 7f32a46e0700 1 Processor -- start 2019-11-28T11:53:42.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.998+0000 7f32a46e0700 1 -- start start 2019-11-28T11:53:42.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a46e0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f329c1320b0 0x7f329c132570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:42.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a46e0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329c07c080 con 0x7f329c12ae80 2019-11-28T11:53:42.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a46e0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329c078560 con 0x7f329c12aa90 2019-11-28T11:53:42.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a46e0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329c07a2c0 con 0x7f329c1320b0 2019-11-28T11:53:42.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a347e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f329c1320b0 0x7f329c132570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:42.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a347e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f329c1320b0 0x7f329c132570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44186/0 (socket says 172.21.15.80:44186) 2019-11-28T11:53:42.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a347e700 1 -- 172.21.15.80:0/4104242753 learned_addr learned my addr 172.21.15.80:0/4104242753 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:42.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a347e700 1 -- 172.21.15.80:0/4104242753 >> v1:172.21.15.174:6789/0 conn(0x7f329c12aa90 legacy=0x7f329c0741e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:42.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a347e700 1 -- 172.21.15.80:0/4104242753 >> v1:172.21.15.80:6789/0 conn(0x7f329c12ae80 legacy=0x7f329c12d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:42.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f329b7fe700 1 -- 172.21.15.80:0/4104242753 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495896518 0 0) 0x7f328c001240 con 0x7f329c12aa90 2019-11-28T11:53:42.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a347e700 1 -- 172.21.15.80:0/4104242753 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c07ac20 con 0x7f329c1320b0 2019-11-28T11:53:42.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a347e700 1 --2- 172.21.15.80:0/4104242753 >> v2:172.21.15.80:3300/0 conn(0x7f329c1320b0 0x7f329c132570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f32940107c0 tx=0x7f3294010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a347e700 1 --2- 172.21.15.80:0/4104242753 >> v2:172.21.15.80:3300/0 conn(0x7f329c1320b0 0x7f329c132570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f32940107c0 tx=0x7f3294010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a347e700 1 --2- 172.21.15.80:0/4104242753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f329c1320b0 0x7f329c132570 secure :-1 s=READY pgs=2401 cs=0 l=1 rx=0x7f32940107c0 tx=0x7f3294010b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:42.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a347e700 1 --2- 172.21.15.80:0/4104242753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f329c1320b0 0x7f329c132570 secure :-1 s=THROTTLE_DONE pgs=2401 cs=0 l=1 rx=0x7f32940107c0 tx=0x7f3294010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f329b7fe700 1 -- 172.21.15.80:0/4104242753 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f329400b360 con 0x7f329c1320b0 2019-11-28T11:53:42.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a347e700 1 --2- 172.21.15.80:0/4104242753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f329c1320b0 0x7f329c132570 secure :-1 s=THROTTLE_DONE pgs=2401 cs=0 l=1 rx=0x7f32940107c0 tx=0x7f3294010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f329b7fe700 1 -- 172.21.15.80:0/4104242753 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329400b2a0 con 0x7f329c1320b0 2019-11-28T11:53:42.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a347e700 1 --2- 172.21.15.80:0/4104242753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f329c1320b0 0x7f329c132570 secure :-1 s=THROTTLE_DONE pgs=2401 cs=0 l=1 rx=0x7f32940107c0 tx=0x7f3294010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a46e0700 1 -- 172.21.15.80:0/4104242753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329c07afa0 con 0x7f329c1320b0 2019-11-28T11:53:42.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f329b7fe700 1 -- 172.21.15.80:0/4104242753 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f329400b490 con 0x7f329c1320b0 2019-11-28T11:53:42.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:41.999+0000 7f32a46e0700 1 -- 172.21.15.80:0/4104242753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329c07ac20 con 0x7f329c1320b0 2019-11-28T11:53:42.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.000+0000 7f32a347e700 1 --2- 172.21.15.80:0/4104242753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f329c1320b0 0x7f329c132570 secure :-1 s=THROTTLE_DONE pgs=2401 cs=0 l=1 rx=0x7f32940107c0 tx=0x7f3294010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.000+0000 7f329b7fe700 1 -- 172.21.15.80:0/4104242753 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3294009b40 con 0x7f329c1320b0 2019-11-28T11:53:42.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.000+0000 7f32a347e700 1 --2- 172.21.15.80:0/4104242753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f329c1320b0 0x7f329c132570 secure :-1 s=THROTTLE_DONE pgs=2401 cs=0 l=1 rx=0x7f32940107c0 tx=0x7f3294010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.000+0000 7f329b7fe700 1 --2- 172.21.15.80:0/4104242753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f327c018730 0x7f327c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:42.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.000+0000 7f329b7fe700 1 -- 172.21.15.80:0/4104242753 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f3294031f00 con 0x7f329c1320b0 2019-11-28T11:53:42.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.000+0000 7f32a2c7d700 1 --2- 172.21.15.80:0/4104242753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f327c018730 0x7f327c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:42.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.000+0000 7f32a2c7d700 1 --2- 172.21.15.80:0/4104242753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f327c018730 0x7f327c01abc0 crc :-1 s=READY pgs=988 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:42.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.008+0000 7f32a46e0700 1 -- 172.21.15.80:0/4104242753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329c07afa0 con 0x7f329c1320b0 2019-11-28T11:53:42.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.011+0000 7f32a347e700 1 --2- 172.21.15.80:0/4104242753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f329c1320b0 0x7f329c132570 secure :-1 s=THROTTLE_DONE pgs=2401 cs=0 l=1 rx=0x7f32940107c0 tx=0x7f3294010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.011+0000 7f329b7fe700 1 -- 172.21.15.80:0/4104242753 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3294026f00 con 0x7f329c1320b0 2019-11-28T11:53:42.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.178+0000 7f32a46e0700 1 -- 172.21.15.80:0/4104242753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f329c07ac20 con 0x7f329c1320b0 2019-11-28T11:53:42.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.179+0000 7f32a347e700 1 --2- 172.21.15.80:0/4104242753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f329c1320b0 0x7f329c132570 secure :-1 s=THROTTLE_DONE pgs=2401 cs=0 l=1 rx=0x7f32940107c0 tx=0x7f3294010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.179+0000 7f329b7fe700 1 -- 172.21.15.80:0/4104242753 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v180) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3294027f30 con 0x7f329c1320b0 2019-11-28T11:53:42.235 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:53:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.181+0000 7f32a46e0700 1 -- 172.21.15.80:0/4104242753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f327c018730 msgr2=0x7f327c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.181+0000 7f32a46e0700 1 --2- 172.21.15.80:0/4104242753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f327c018730 0x7f327c01abc0 crc :-1 s=READY pgs=988 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.181+0000 7f32a46e0700 1 -- 172.21.15.80:0/4104242753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f329c1320b0 msgr2=0x7f329c132570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.181+0000 7f32a46e0700 1 --2- 172.21.15.80:0/4104242753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f329c1320b0 0x7f329c132570 secure :-1 s=READY pgs=2401 cs=0 l=1 rx=0x7f32940107c0 tx=0x7f3294010b60).stop 2019-11-28T11:53:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.181+0000 7f32a46e0700 1 -- 172.21.15.80:0/4104242753 shutdown_connections 2019-11-28T11:53:42.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.181+0000 7f32a46e0700 1 --2- 172.21.15.80:0/4104242753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f329c1320b0 0x7f329c132570 unknown :-1 s=CLOSED pgs=2401 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:42.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.181+0000 7f32a46e0700 1 --2- 172.21.15.80:0/4104242753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f327c018730 0x7f327c01abc0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:42.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.181+0000 7f32a46e0700 1 -- 172.21.15.80:0/4104242753 shutdown_connections 2019-11-28T11:53:42.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.181+0000 7f32a46e0700 1 -- 172.21.15.80:0/4104242753 wait complete. 2019-11-28T11:53:42.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.181+0000 7f32a46e0700 1 -- 172.21.15.80:0/4104242753 >> 172.21.15.80:0/4104242753 conn(0x7f329c147670 msgr2=0x7f329c1641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:42.247 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:53:42.247 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:42.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.310+0000 7fbeb600c700 1 Processor -- start 2019-11-28T11:53:42.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.310+0000 7fbeb600c700 1 -- start start 2019-11-28T11:53:42.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.311+0000 7fbeb600c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbeb006c490 0x7fbeb006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:42.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.311+0000 7fbeb600c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbeb006ce60 0x7fbeb0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:42.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.311+0000 7fbeb600c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb006db00 con 0x7fbeb006c0a0 2019-11-28T11:53:42.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.311+0000 7fbeb600c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb006fd60 con 0x7fbeb006c490 2019-11-28T11:53:42.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.311+0000 7fbeb600c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb0070030 con 0x7fbeb006ce60 2019-11-28T11:53:42.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.311+0000 7fbea7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbeb006c490 0x7fbeb006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:42.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.311+0000 7fbeaffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbeb006c0a0 0x7fbeb0072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43506/0 (socket says 172.21.15.80:43506) 2019-11-28T11:53:42.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.311+0000 7fbea7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbeb006c490 0x7fbeb006c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44190/0 (socket says 172.21.15.80:44190) 2019-11-28T11:53:42.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.311+0000 7fbeaffff700 1 -- 172.21.15.80:0/1290364322 learned_addr learned my addr 172.21.15.80:0/1290364322 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:42.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.311+0000 7fbeb4daa700 1 --2- 172.21.15.80:0/1290364322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbeb006ce60 0x7fbeb0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:42.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.311+0000 7fbea7fff700 1 -- 172.21.15.80:0/1290364322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbeb006ce60 msgr2=0x7fbeb0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:42.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.311+0000 7fbea7fff700 1 --2- 172.21.15.80:0/1290364322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbeb006ce60 0x7fbeb0164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:42.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.311+0000 7fbea7fff700 1 -- 172.21.15.80:0/1290364322 >> v1:172.21.15.80:6789/0 conn(0x7fbeb006c0a0 legacy=0x7fbeb0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:42.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.311+0000 7fbea7fff700 1 -- 172.21.15.80:0/1290364322 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb00706c0 con 0x7fbeb006c490 2019-11-28T11:53:42.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.311+0000 7fbeaf7fe700 1 -- 172.21.15.80:0/1290364322 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667354152 0 0) 0x7fbea0001150 con 0x7fbeb006c0a0 2019-11-28T11:53:42.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.312+0000 7fbea7fff700 1 --2- 172.21.15.80:0/1290364322 >> v2:172.21.15.80:3300/0 conn(0x7fbeb006c490 0x7fbeb006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbe9800af50 tx=0x7fbe9800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.312+0000 7fbea7fff700 1 --2- 172.21.15.80:0/1290364322 >> v2:172.21.15.80:3300/0 conn(0x7fbeb006c490 0x7fbeb006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbe9800af50 tx=0x7fbe9800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.312+0000 7fbea7fff700 1 --2- 172.21.15.80:0/1290364322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb006c490 0x7fbeb006c920 secure :-1 s=READY pgs=2403 cs=0 l=1 rx=0x7fbe9800af50 tx=0x7fbe9800b6e0).ready entity=mon.0 client_cookie=7faec2e7564298a2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:42.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.312+0000 7fbea7fff700 1 --2- 172.21.15.80:0/1290364322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb006c490 0x7fbeb006c920 secure :-1 s=THROTTLE_DONE pgs=2403 cs=0 l=1 rx=0x7fbe9800af50 tx=0x7fbe9800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.312+0000 7fbeaf7fe700 1 -- 172.21.15.80:0/1290364322 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe98007210 con 0x7fbeb006c490 2019-11-28T11:53:42.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.312+0000 7fbea7fff700 1 --2- 172.21.15.80:0/1290364322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb006c490 0x7fbeb006c920 secure :-1 s=THROTTLE_DONE pgs=2403 cs=0 l=1 rx=0x7fbe9800af50 tx=0x7fbe9800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.312+0000 7fbeaf7fe700 1 -- 172.21.15.80:0/1290364322 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe980097c0 con 0x7fbeb006c490 2019-11-28T11:53:42.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.312+0000 7fbea7fff700 1 --2- 172.21.15.80:0/1290364322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb006c490 0x7fbeb006c920 secure :-1 s=THROTTLE_DONE pgs=2403 cs=0 l=1 rx=0x7fbe9800af50 tx=0x7fbe9800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.312+0000 7fbeaf7fe700 1 -- 172.21.15.80:0/1290364322 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe980099b0 con 0x7fbeb006c490 2019-11-28T11:53:42.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.312+0000 7fbeb600c700 1 -- 172.21.15.80:0/1290364322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb006c490 msgr2=0x7fbeb006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:42.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.312+0000 7fbeb600c700 1 --2- 172.21.15.80:0/1290364322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb006c490 0x7fbeb006c920 secure :-1 s=READY pgs=2403 cs=0 l=1 rx=0x7fbe9800af50 tx=0x7fbe9800b6e0).stop 2019-11-28T11:53:42.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.313+0000 7fbeb600c700 1 -- 172.21.15.80:0/1290364322 shutdown_connections 2019-11-28T11:53:42.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.313+0000 7fbeb600c700 1 --2- 172.21.15.80:0/1290364322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbeb006ce60 0x7fbeb0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:42.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.313+0000 7fbeb600c700 1 --2- 172.21.15.80:0/1290364322 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb006c490 0x7fbeb006c920 unknown :-1 s=CLOSED pgs=2403 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:42.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.313+0000 7fbeb600c700 1 -- 172.21.15.80:0/1290364322 shutdown_connections 2019-11-28T11:53:42.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.313+0000 7fbeb600c700 1 -- 172.21.15.80:0/1290364322 wait complete. 2019-11-28T11:53:42.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.313+0000 7fbeb600c700 1 -- 172.21.15.80:0/1290364322 >> 172.21.15.80:0/1290364322 conn(0x7fbeb0061cf0 msgr2=0x7fbeb0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:42.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.315+0000 7fbeb600c700 1 Processor -- start 2019-11-28T11:53:42.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.315+0000 7fbeb600c700 1 -- start start 2019-11-28T11:53:42.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbeb600c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbeb013e320 0x7fbeb013e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:42.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbeb600c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb0139e00 con 0x7fbeb015fdf0 2019-11-28T11:53:42.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbeb600c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb013b4e0 con 0x7fbeb012a3c0 2019-11-28T11:53:42.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbeb600c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb0108820 con 0x7fbeb013e320 2019-11-28T11:53:42.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbea7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbeb013e320 0x7fbeb013e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:42.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbea7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbeb013e320 0x7fbeb013e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44198/0 (socket says 172.21.15.80:44198) 2019-11-28T11:53:42.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbea7fff700 1 -- 172.21.15.80:0/3688802208 learned_addr learned my addr 172.21.15.80:0/3688802208 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:42.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbea7fff700 1 -- 172.21.15.80:0/3688802208 >> v1:172.21.15.174:6789/0 conn(0x7fbeb012a3c0 legacy=0x7fbeb012a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:42.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbea7fff700 1 -- 172.21.15.80:0/3688802208 >> v1:172.21.15.80:6789/0 conn(0x7fbeb015fdf0 legacy=0x7fbeb012b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:42.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbea7fff700 1 -- 172.21.15.80:0/3688802208 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb010a8c0 con 0x7fbeb013e320 2019-11-28T11:53:42.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbea7fff700 1 --2- 172.21.15.80:0/3688802208 >> v2:172.21.15.80:3300/0 conn(0x7fbeb013e320 0x7fbeb013e7b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbe98054440 tx=0x7fbe980547e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbea7fff700 1 --2- 172.21.15.80:0/3688802208 >> v2:172.21.15.80:3300/0 conn(0x7fbeb013e320 0x7fbeb013e7b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbe98054440 tx=0x7fbe980547e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbea7fff700 1 --2- 172.21.15.80:0/3688802208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb013e320 0x7fbeb013e7b0 secure :-1 s=READY pgs=2405 cs=0 l=1 rx=0x7fbe98054440 tx=0x7fbe980547e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbea7fff700 1 --2- 172.21.15.80:0/3688802208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb013e320 0x7fbeb013e7b0 secure :-1 s=THROTTLE_DONE pgs=2405 cs=0 l=1 rx=0x7fbe98054440 tx=0x7fbe980547e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbea7fff700 1 --2- 172.21.15.80:0/3688802208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb013e320 0x7fbeb013e7b0 secure :-1 s=THROTTLE_DONE pgs=2405 cs=0 l=1 rx=0x7fbe98054440 tx=0x7fbe980547e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbead7fa700 1 -- 172.21.15.80:0/3688802208 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe9800abb0 con 0x7fbeb013e320 2019-11-28T11:53:42.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbea7fff700 1 --2- 172.21.15.80:0/3688802208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb013e320 0x7fbeb013e7b0 secure :-1 s=THROTTLE_DONE pgs=2405 cs=0 l=1 rx=0x7fbe98054440 tx=0x7fbe980547e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbead7fa700 1 -- 172.21.15.80:0/3688802208 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe98009770 con 0x7fbeb013e320 2019-11-28T11:53:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbead7fa700 1 -- 172.21.15.80:0/3688802208 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe98009e40 con 0x7fbeb013e320 2019-11-28T11:53:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.316+0000 7fbeb600c700 1 -- 172.21.15.80:0/3688802208 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb010a8c0 con 0x7fbeb013e320 2019-11-28T11:53:42.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.317+0000 7fbeb600c700 1 -- 172.21.15.80:0/3688802208 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb010a8c0 con 0x7fbeb013e320 2019-11-28T11:53:42.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.317+0000 7fbea7fff700 1 --2- 172.21.15.80:0/3688802208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb013e320 0x7fbeb013e7b0 secure :-1 s=THROTTLE_DONE pgs=2405 cs=0 l=1 rx=0x7fbe98054440 tx=0x7fbe980547e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.317+0000 7fbead7fa700 1 -- 172.21.15.80:0/3688802208 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbe9800abb0 con 0x7fbeb013e320 2019-11-28T11:53:42.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.317+0000 7fbea7fff700 1 --2- 172.21.15.80:0/3688802208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb013e320 0x7fbeb013e7b0 secure :-1 s=THROTTLE_DONE pgs=2405 cs=0 l=1 rx=0x7fbe98054440 tx=0x7fbe980547e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.317+0000 7fbead7fa700 1 --2- 172.21.15.80:0/3688802208 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe94018730 0x7fbe9401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:42.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.317+0000 7fbead7fa700 1 -- 172.21.15.80:0/3688802208 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fbe98075b00 con 0x7fbeb013e320 2019-11-28T11:53:42.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.317+0000 7fbeaffff700 1 --2- 172.21.15.80:0/3688802208 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe94018730 0x7fbe9401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:42.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.318+0000 7fbeaffff700 1 --2- 172.21.15.80:0/3688802208 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe94018730 0x7fbe9401abc0 crc :-1 s=READY pgs=989 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:42.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.325+0000 7fbeb600c700 1 -- 172.21.15.80:0/3688802208 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb0109180 con 0x7fbeb013e320 2019-11-28T11:53:42.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.329+0000 7fbea7fff700 1 --2- 172.21.15.80:0/3688802208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb013e320 0x7fbeb013e7b0 secure :-1 s=THROTTLE_DONE pgs=2405 cs=0 l=1 rx=0x7fbe98054440 tx=0x7fbe980547e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.329+0000 7fbead7fa700 1 -- 172.21.15.80:0/3688802208 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbe9800abb0 con 0x7fbeb013e320 2019-11-28T11:53:42.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.504+0000 7fbeb600c700 1 -- 172.21.15.80:0/3688802208 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbeb0109500 con 0x7fbeb013e320 2019-11-28T11:53:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.505+0000 7fbea7fff700 1 --2- 172.21.15.80:0/3688802208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb013e320 0x7fbeb013e7b0 secure :-1 s=THROTTLE_DONE pgs=2405 cs=0 l=1 rx=0x7fbe98054440 tx=0x7fbe980547e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:42.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.505+0000 7fbead7fa700 1 -- 172.21.15.80:0/3688802208 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 145 v145) v1 ==== 95+0+2454 (secure 0 0 0) 0x7fbe9800abb0 con 0x7fbeb013e320 2019-11-28T11:53:42.561 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 145 2019-11-28T11:53:42.561 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:42.561 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":145,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":145,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:53:39.872442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:active","state_seq":17,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:42.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.507+0000 7fbeb600c700 1 -- 172.21.15.80:0/3688802208 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe94018730 msgr2=0x7fbe9401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:42.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.507+0000 7fbeb600c700 1 --2- 172.21.15.80:0/3688802208 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe94018730 0x7fbe9401abc0 crc :-1 s=READY pgs=989 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:42.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.507+0000 7fbeb600c700 1 -- 172.21.15.80:0/3688802208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb013e320 msgr2=0x7fbeb013e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:42.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.507+0000 7fbeb600c700 1 --2- 172.21.15.80:0/3688802208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb013e320 0x7fbeb013e7b0 secure :-1 s=READY pgs=2405 cs=0 l=1 rx=0x7fbe98054440 tx=0x7fbe980547e0).stop 2019-11-28T11:53:42.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.507+0000 7fbeb600c700 1 -- 172.21.15.80:0/3688802208 shutdown_connections 2019-11-28T11:53:42.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.507+0000 7fbeb600c700 1 --2- 172.21.15.80:0/3688802208 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe94018730 0x7fbe9401abc0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:42.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.507+0000 7fbeb600c700 1 --2- 172.21.15.80:0/3688802208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbeb013e320 0x7fbeb013e7b0 unknown :-1 s=CLOSED pgs=2405 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:42.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.507+0000 7fbeb600c700 1 -- 172.21.15.80:0/3688802208 shutdown_connections 2019-11-28T11:53:42.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.507+0000 7fbeb600c700 1 -- 172.21.15.80:0/3688802208 wait complete. 2019-11-28T11:53:42.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:42.507+0000 7fbeb600c700 1 -- 172.21.15.80:0/3688802208 >> 172.21.15.80:0/3688802208 conn(0x7fbeb0127dc0 msgr2=0x7fbeb0141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:42.875 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7259}, u'last_failure_osd_epoch': 179, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 28, u'failed': [], u'epoch': 145, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [29], u'info': {u'gid_7259': {u'export_targets': [], u'name': u'b', u'incarnation': 142, u'state_seq': 17, u'state': u'up:active', u'gid': 7259, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 777730016, u'type': u'v2', u'addr': u'172.21.15.80:6832'}, {u'nonce': 777730016, u'type': u'v1', u'addr': u'172.21.15.80:6834'}]}, u'addr': u'172.21.15.80:6834/777730016'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:52:31.482361+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:53:39.872442+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:53:42.875 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:53:42.876 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-11-28T11:53:43.003 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:53:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:53:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T11:53:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 7259, 2019-11-28T11:53:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2019-11-28T11:53:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2019-11-28T11:53:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 56.185401319, 2019-11-28T11:53:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 145, 2019-11-28T11:53:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 180, 2019-11-28T11:53:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 180, 2019-11-28T11:53:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 60.321002106999998 2019-11-28T11:53:43.005 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:53:43.009 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7259, "want_state": "up:active", "state": "up:active", "rank_uptime": 56.185401319, "mdsmap_epoch": 145, "osdmap_epoch": 180, "osdmap_epoch_barrier": 180, "uptime": 60.321002106999998 } 2019-11-28T11:53:43.010 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:53:43.010 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:53:43.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:53:43.010 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:53:43.079 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:53:43.079 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:53:43.199 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:53:43.199 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:53:43.199 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:53:43.200 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:53:43.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:53:43.200 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:53:43.270 DEBUG:tasks.cephfs.mount:Creating test file 2019-11-28 11:53:43.270205 0 2019-11-28T11:53:43.270 INFO:teuthology.orchestra.run.smithi076:> sudo touch '/home/ubuntu/cephtest/mnt.0/2019-11-28 11:53:43.270205 0' 2019-11-28T11:53:43.325 DEBUG:tasks.cephfs.mount:Deleting test file 2019-11-28 11:53:43.270205 0 2019-11-28T11:53:43.325 INFO:teuthology.orchestra.run.smithi076:> sudo rm -f '/home/ubuntu/cephtest/mnt.0/2019-11-28 11:53:43.270205 0' 2019-11-28T11:53:43.379 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:43.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.443+0000 7fe55e14e700 1 Processor -- start 2019-11-28T11:53:43.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.443+0000 7fe55e14e700 1 -- start start 2019-11-28T11:53:43.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.444+0000 7fe55e14e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe55806c0a0 0x7fe558072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:43.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.444+0000 7fe55e14e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe558072620 0x7fe558164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:43.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.444+0000 7fe55e14e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55806db00 con 0x7fe5580734e0 2019-11-28T11:53:43.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.444+0000 7fe55e14e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55806fd60 con 0x7fe55806c0a0 2019-11-28T11:53:43.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.444+0000 7fe55e14e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe558070030 con 0x7fe558072620 2019-11-28T11:53:43.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.444+0000 7fe557fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe55806c0a0 0x7fe558072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:43.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.444+0000 7fe55ceec700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe558072620 0x7fe558164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.444+0000 7fe557fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe55806c0a0 0x7fe558072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:59090/0 (socket says 172.21.15.80:59090) 2019-11-28T11:53:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.444+0000 7fe55ceec700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe558072620 0x7fe558164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:46466/0 (socket says 172.21.15.80:46466) 2019-11-28T11:53:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.444+0000 7fe54ffff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe5580734e0 0x7fe558071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:59064/0 (socket says 172.21.15.80:59064) 2019-11-28T11:53:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.444+0000 7fe557fff700 1 -- 172.21.15.80:0/3627367011 learned_addr learned my addr 172.21.15.80:0/3627367011 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.445+0000 7fe557fff700 1 -- 172.21.15.80:0/3627367011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe558072620 msgr2=0x7fe558164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.445+0000 7fe557fff700 1 --2- 172.21.15.80:0/3627367011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe558072620 0x7fe558164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:43.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.445+0000 7fe557fff700 1 -- 172.21.15.80:0/3627367011 >> v1:172.21.15.174:6789/0 conn(0x7fe5580734e0 legacy=0x7fe558071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.445+0000 7fe5577fe700 1 -- 172.21.15.80:0/3627367011 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076522951 0 0) 0x7fe5400010c0 con 0x7fe5580734e0 2019-11-28T11:53:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.445+0000 7fe557fff700 1 -- 172.21.15.80:0/3627367011 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5580706c0 con 0x7fe55806c0a0 2019-11-28T11:53:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.445+0000 7fe557fff700 1 --2- 172.21.15.80:0/3627367011 >> v2:172.21.15.174:3300/0 conn(0x7fe55806c0a0 0x7fe558072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe54800f6c0 tx=0x7fe54800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.445+0000 7fe557fff700 1 --2- 172.21.15.80:0/3627367011 >> v2:172.21.15.174:3300/0 conn(0x7fe55806c0a0 0x7fe558072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe54800f6c0 tx=0x7fe54800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.445+0000 7fe557fff700 1 --2- 172.21.15.80:0/3627367011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe55806c0a0 0x7fe558072fa0 secure :-1 s=READY pgs=1451 cs=0 l=1 rx=0x7fe54800f6c0 tx=0x7fe54800fa60).ready entity=mon.1 client_cookie=2525315f45048bdc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.445+0000 7fe557fff700 1 --2- 172.21.15.80:0/3627367011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe55806c0a0 0x7fe558072fa0 secure :-1 s=THROTTLE_DONE pgs=1451 cs=0 l=1 rx=0x7fe54800f6c0 tx=0x7fe54800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:43.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.445+0000 7fe5577fe700 1 -- 172.21.15.80:0/3627367011 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe548000960 con 0x7fe55806c0a0 2019-11-28T11:53:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.445+0000 7fe557fff700 1 --2- 172.21.15.80:0/3627367011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe55806c0a0 0x7fe558072fa0 secure :-1 s=THROTTLE_DONE pgs=1451 cs=0 l=1 rx=0x7fe54800f6c0 tx=0x7fe54800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.445+0000 7fe557fff700 1 --2- 172.21.15.80:0/3627367011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe55806c0a0 0x7fe558072fa0 secure :-1 s=THROTTLE_DONE pgs=1451 cs=0 l=1 rx=0x7fe54800f6c0 tx=0x7fe54800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.445+0000 7fe5577fe700 1 -- 172.21.15.80:0/3627367011 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe548000c90 con 0x7fe55806c0a0 2019-11-28T11:53:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.445+0000 7fe5577fe700 1 -- 172.21.15.80:0/3627367011 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5480013a0 con 0x7fe55806c0a0 2019-11-28T11:53:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.445+0000 7fe55e14e700 1 -- 172.21.15.80:0/3627367011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe55806c0a0 msgr2=0x7fe558072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.445+0000 7fe55e14e700 1 --2- 172.21.15.80:0/3627367011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe55806c0a0 0x7fe558072fa0 secure :-1 s=READY pgs=1451 cs=0 l=1 rx=0x7fe54800f6c0 tx=0x7fe54800fa60).stop 2019-11-28T11:53:43.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.446+0000 7fe55e14e700 1 -- 172.21.15.80:0/3627367011 shutdown_connections 2019-11-28T11:53:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.446+0000 7fe55e14e700 1 --2- 172.21.15.80:0/3627367011 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe558072620 0x7fe558164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.446+0000 7fe55e14e700 1 --2- 172.21.15.80:0/3627367011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe55806c0a0 0x7fe558072fa0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.446+0000 7fe55e14e700 1 -- 172.21.15.80:0/3627367011 shutdown_connections 2019-11-28T11:53:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.446+0000 7fe55e14e700 1 -- 172.21.15.80:0/3627367011 wait complete. 2019-11-28T11:53:43.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.446+0000 7fe55e14e700 1 -- 172.21.15.80:0/3627367011 >> 172.21.15.80:0/3627367011 conn(0x7fe558061cf0 msgr2=0x7fe558064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:43.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.448+0000 7fe55e14e700 1 Processor -- start 2019-11-28T11:53:43.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.448+0000 7fe55e14e700 1 -- start start 2019-11-28T11:53:43.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.449+0000 7fe55e14e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe55813e5f0 0x7fe55813e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:43.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.449+0000 7fe55e14e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe55810a4e0 0x7fe55810c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:43.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.449+0000 7fe55e14e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5581066e0 con 0x7fe55810a070 2019-11-28T11:53:43.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.449+0000 7fe55e14e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55810d630 con 0x7fe55810a4e0 2019-11-28T11:53:43.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.449+0000 7fe55e14e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55810e060 con 0x7fe55813e5f0 2019-11-28T11:53:43.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.449+0000 7fe55ceec700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe55810a4e0 0x7fe55810c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:43.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.449+0000 7fe54ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe55810a070 0x7fe55810bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43524/0 (socket says 172.21.15.80:43524) 2019-11-28T11:53:43.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.449+0000 7fe54ffff700 1 -- 172.21.15.80:0/1095724370 learned_addr learned my addr 172.21.15.80:0/1095724370 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:43.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.449+0000 7fe557fff700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe55813e5f0 0x7fe55813e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:43.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe55ceec700 1 -- 172.21.15.80:0/1095724370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe55813e5f0 msgr2=0x7fe55813e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:43.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe55ceec700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe55813e5f0 0x7fe55813e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:43.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe55ceec700 1 -- 172.21.15.80:0/1095724370 >> v1:172.21.15.80:6789/0 conn(0x7fe55810a070 legacy=0x7fe55810bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:43.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe5557fa700 1 -- 172.21.15.80:0/1095724370 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481701983 0 0) 0x7fe540000c60 con 0x7fe55810a070 2019-11-28T11:53:43.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe55ceec700 1 -- 172.21.15.80:0/1095724370 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55810e9c0 con 0x7fe55810a4e0 2019-11-28T11:53:43.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe557fff700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe55813e5f0 0x7fe55813e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:43.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe55ceec700 1 --2- 172.21.15.80:0/1095724370 >> v2:172.21.15.80:3300/0 conn(0x7fe55810a4e0 0x7fe55810c5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe55000edc0 tx=0x7fe550010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:43.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe55ceec700 1 --2- 172.21.15.80:0/1095724370 >> v2:172.21.15.80:3300/0 conn(0x7fe55810a4e0 0x7fe55810c5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe55000edc0 tx=0x7fe550010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:43.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe55ceec700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55810a4e0 0x7fe55810c5b0 secure :-1 s=READY pgs=2407 cs=0 l=1 rx=0x7fe55000edc0 tx=0x7fe550010a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:43.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe55ceec700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55810a4e0 0x7fe55810c5b0 secure :-1 s=THROTTLE_DONE pgs=2407 cs=0 l=1 rx=0x7fe55000edc0 tx=0x7fe550010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:43.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe5557fa700 1 -- 172.21.15.80:0/1095724370 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe55000f200 con 0x7fe55810a4e0 2019-11-28T11:53:43.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe55ceec700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55810a4e0 0x7fe55810c5b0 secure :-1 s=THROTTLE_DONE pgs=2407 cs=0 l=1 rx=0x7fe55000edc0 tx=0x7fe550010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:43.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe55ceec700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55810a4e0 0x7fe55810c5b0 secure :-1 s=THROTTLE_DONE pgs=2407 cs=0 l=1 rx=0x7fe55000edc0 tx=0x7fe550010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:43.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe5557fa700 1 -- 172.21.15.80:0/1095724370 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55000f400 con 0x7fe55810a4e0 2019-11-28T11:53:43.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe55e14e700 1 -- 172.21.15.80:0/1095724370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55810ed40 con 0x7fe55810a4e0 2019-11-28T11:53:43.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe5557fa700 1 -- 172.21.15.80:0/1095724370 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe55000fad0 con 0x7fe55810a4e0 2019-11-28T11:53:43.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe55e14e700 1 -- 172.21.15.80:0/1095724370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55810e9c0 con 0x7fe55810a4e0 2019-11-28T11:53:43.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe55ceec700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55810a4e0 0x7fe55810c5b0 secure :-1 s=THROTTLE_DONE pgs=2407 cs=0 l=1 rx=0x7fe55000edc0 tx=0x7fe550010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:43.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.450+0000 7fe5557fa700 1 -- 172.21.15.80:0/1095724370 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe55000ef60 con 0x7fe55810a4e0 2019-11-28T11:53:43.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.451+0000 7fe55ceec700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55810a4e0 0x7fe55810c5b0 secure :-1 s=THROTTLE_DONE pgs=2407 cs=0 l=1 rx=0x7fe55000edc0 tx=0x7fe550010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:43.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.451+0000 7fe5557fa700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe530018730 0x7fe53001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:43.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.451+0000 7fe5557fa700 1 -- 172.21.15.80:0/1095724370 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fe550031d90 con 0x7fe55810a4e0 2019-11-28T11:53:43.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.451+0000 7fe557fff700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe530018730 0x7fe53001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:43.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.451+0000 7fe557fff700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe530018730 0x7fe53001abc0 crc :-1 s=READY pgs=990 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:43.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.458+0000 7fe55e14e700 1 -- 172.21.15.80:0/1095724370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55810ed40 con 0x7fe55810a4e0 2019-11-28T11:53:43.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.462+0000 7fe55ceec700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55810a4e0 0x7fe55810c5b0 secure :-1 s=THROTTLE_DONE pgs=2407 cs=0 l=1 rx=0x7fe55000edc0 tx=0x7fe550010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:43.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.462+0000 7fe5557fa700 1 -- 172.21.15.80:0/1095724370 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe550000e80 con 0x7fe55810a4e0 2019-11-28T11:53:43.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.635+0000 7fe55e14e700 1 -- 172.21.15.80:0/1095724370 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe55810e9c0 con 0x7fe55810a4e0 2019-11-28T11:53:43.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.636+0000 7fe55ceec700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55810a4e0 0x7fe55810c5b0 secure :-1 s=THROTTLE_DONE pgs=2407 cs=0 l=1 rx=0x7fe55000edc0 tx=0x7fe550010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:43.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.636+0000 7fe5557fa700 1 -- 172.21.15.80:0/1095724370 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 145 v145) v1 ==== 95+0+2454 (secure 0 0 0) 0x7fe550000e80 con 0x7fe55810a4e0 2019-11-28T11:53:43.692 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 145 2019-11-28T11:53:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:43.692 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":145,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":10030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2990762950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2990762950},{"type":"v1","addr":"172.21.15.174:6835","nonce":2990762950}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142},{"gid":10701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/863386583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":863386583},{"type":"v1","addr":"172.21.15.80:6835","nonce":863386583}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":142}],"filesystems":[{"mdsmap":{"epoch":145,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:53:39.872442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":179,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7259":{"gid":7259,"name":"b","rank":0,"incarnation":142,"state":"up:active","state_seq":17,"addr":"172.21.15.80:6834/777730016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":777730016},{"type":"v1","addr":"172.21.15.80:6834","nonce":777730016}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:43.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.638+0000 7fe55e14e700 1 -- 172.21.15.80:0/1095724370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe530018730 msgr2=0x7fe53001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:43.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.638+0000 7fe55e14e700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe530018730 0x7fe53001abc0 crc :-1 s=READY pgs=990 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:43.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.638+0000 7fe55e14e700 1 -- 172.21.15.80:0/1095724370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55810a4e0 msgr2=0x7fe55810c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:43.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.638+0000 7fe55e14e700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55810a4e0 0x7fe55810c5b0 secure :-1 s=READY pgs=2407 cs=0 l=1 rx=0x7fe55000edc0 tx=0x7fe550010a70).stop 2019-11-28T11:53:43.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.638+0000 7fe55e14e700 1 -- 172.21.15.80:0/1095724370 shutdown_connections 2019-11-28T11:53:43.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.638+0000 7fe55e14e700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe530018730 0x7fe53001abc0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:43.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.638+0000 7fe55e14e700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe55810a4e0 0x7fe55810c5b0 unknown :-1 s=CLOSED pgs=2407 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:43.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.638+0000 7fe55e14e700 1 --2- 172.21.15.80:0/1095724370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe55813e5f0 0x7fe55813e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:43.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.638+0000 7fe55e14e700 1 -- 172.21.15.80:0/1095724370 shutdown_connections 2019-11-28T11:53:43.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.638+0000 7fe55e14e700 1 -- 172.21.15.80:0/1095724370 wait complete. 2019-11-28T11:53:43.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.638+0000 7fe55e14e700 1 -- 172.21.15.80:0/1095724370 >> 172.21.15.80:0/1095724370 conn(0x7fe55813d620 msgr2=0x7fe55813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:43.705 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok session ls 2019-11-28T11:53:43.831 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:53:43.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:43.832 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 7451, 2019-11-28T11:53:43.832 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": { 2019-11-28T11:53:43.832 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2019-11-28T11:53:43.832 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2019-11-28T11:53:43.833 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 7451 2019-11-28T11:53:43.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:43.833 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2019-11-28T11:53:43.833 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:43.834 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.76:0", 2019-11-28T11:53:43.834 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1965770209 2019-11-28T11:53:43.834 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:43.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:43.835 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "open", 2019-11-28T11:53:43.835 INFO:teuthology.orchestra.run.smithi080.stdout: "num_leases": 1, 2019-11-28T11:53:43.835 INFO:teuthology.orchestra.run.smithi080.stdout: "num_caps": 2, 2019-11-28T11:53:43.835 INFO:teuthology.orchestra.run.smithi080.stdout: "request_load_avg": 2, 2019-11-28T11:53:43.836 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 0.661965264, 2019-11-28T11:53:43.836 INFO:teuthology.orchestra.run.smithi080.stdout: "requests_in_flight": 0, 2019-11-28T11:53:43.836 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": 1, 2019-11-28T11:53:43.836 INFO:teuthology.orchestra.run.smithi080.stdout: "reconnecting": false, 2019-11-28T11:53:43.837 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps": { 2019-11-28T11:53:43.837 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:53:43.837 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:53:43.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:43.837 INFO:teuthology.orchestra.run.smithi080.stdout: "release_caps": { 2019-11-28T11:53:43.838 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:53:43.838 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:53:43.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:43.838 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle": { 2019-11-28T11:53:43.839 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:53:43.839 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 2.5 2019-11-28T11:53:43.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:43.839 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle2o": { 2019-11-28T11:53:43.840 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:53:43.840 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 0.5 2019-11-28T11:53:43.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:43.841 INFO:teuthology.orchestra.run.smithi080.stdout: "session_cache_liveness": { 2019-11-28T11:53:43.841 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 5.9928652818678838, 2019-11-28T11:53:43.841 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 300 2019-11-28T11:53:43.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:43.842 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": "client.7451 v1:172.21.15.76:0/1965770209", 2019-11-28T11:53:43.843 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": [ 2019-11-28T11:53:43.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:43.843 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 3, 2019-11-28T11:53:43.844 INFO:teuthology.orchestra.run.smithi080.stdout: "created_ino": "0x0" 2019-11-28T11:53:43.844 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:43.845 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:53:43.845 INFO:teuthology.orchestra.run.smithi080.stdout: "prealloc_inos": [ 2019-11-28T11:53:43.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:43.846 INFO:teuthology.orchestra.run.smithi080.stdout: "start": 1099511627777, 2019-11-28T11:53:43.846 INFO:teuthology.orchestra.run.smithi080.stdout: "length": 1000 2019-11-28T11:53:43.847 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:43.847 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:53:43.848 INFO:teuthology.orchestra.run.smithi080.stdout: "used_inos": [], 2019-11-28T11:53:43.848 INFO:teuthology.orchestra.run.smithi080.stdout: "client_metadata": { 2019-11-28T11:53:43.848 INFO:teuthology.orchestra.run.smithi080.stdout: "features": "00000000000000ff", 2019-11-28T11:53:43.849 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "0", 2019-11-28T11:53:43.849 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi076.front.sepia.ceph.com", 2019-11-28T11:53:43.850 INFO:teuthology.orchestra.run.smithi080.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:53:43.850 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2019-11-28T11:53:43.850 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:43.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:43.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:43.852 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 10650, 2019-11-28T11:53:43.853 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": { 2019-11-28T11:53:43.853 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2019-11-28T11:53:43.853 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2019-11-28T11:53:43.854 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 10650 2019-11-28T11:53:43.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:43.855 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2019-11-28T11:53:43.855 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:43.855 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.16:0", 2019-11-28T11:53:43.856 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 1076095543 2019-11-28T11:53:43.856 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:43.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:43.857 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "open", 2019-11-28T11:53:43.858 INFO:teuthology.orchestra.run.smithi080.stdout: "num_leases": 0, 2019-11-28T11:53:43.858 INFO:teuthology.orchestra.run.smithi080.stdout: "num_caps": 1, 2019-11-28T11:53:43.858 INFO:teuthology.orchestra.run.smithi080.stdout: "request_load_avg": 0, 2019-11-28T11:53:43.859 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 57.005008689, 2019-11-28T11:53:43.859 INFO:teuthology.orchestra.run.smithi080.stdout: "requests_in_flight": 0, 2019-11-28T11:53:43.860 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": 0, 2019-11-28T11:53:43.860 INFO:teuthology.orchestra.run.smithi080.stdout: "reconnecting": false, 2019-11-28T11:53:43.860 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps": { 2019-11-28T11:53:43.861 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:53:43.861 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:53:43.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:43.862 INFO:teuthology.orchestra.run.smithi080.stdout: "release_caps": { 2019-11-28T11:53:43.862 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:53:43.863 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:53:43.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:43.864 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle": { 2019-11-28T11:53:43.864 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:53:43.864 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 2.5 2019-11-28T11:53:43.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:43.865 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle2o": { 2019-11-28T11:53:43.865 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:53:43.866 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 0.5 2019-11-28T11:53:43.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:43.866 INFO:teuthology.orchestra.run.smithi080.stdout: "session_cache_liveness": { 2019-11-28T11:53:43.866 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 2.8762792493733556, 2019-11-28T11:53:43.867 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 300 2019-11-28T11:53:43.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:43.867 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": "client.10650 v1:172.21.15.16:0/1076095543", 2019-11-28T11:53:43.867 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": [], 2019-11-28T11:53:43.868 INFO:teuthology.orchestra.run.smithi080.stdout: "prealloc_inos": [], 2019-11-28T11:53:43.868 INFO:teuthology.orchestra.run.smithi080.stdout: "used_inos": [], 2019-11-28T11:53:43.868 INFO:teuthology.orchestra.run.smithi080.stdout: "client_metadata": { 2019-11-28T11:53:43.869 INFO:teuthology.orchestra.run.smithi080.stdout: "features": "00000000000000ff", 2019-11-28T11:53:43.869 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "1", 2019-11-28T11:53:43.869 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi016", 2019-11-28T11:53:43.869 INFO:teuthology.orchestra.run.smithi080.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:53:43.869 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2019-11-28T11:53:43.870 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:43.870 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:43.870 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:53:43.872 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 7451, "entity": { "name": { "type": "client", "num": 7451 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 1965770209 } }, "state": "open", "num_leases": 1, "num_caps": 2, "request_load_avg": 2, "uptime": 0.661965264, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 5.9928652818678838, "halflife": 300 }, "inst": "client.7451 v1:172.21.15.76:0/1965770209", "completed_requests": [ { "tid": 3, "created_ino": "0x0" } ], "prealloc_inos": [ { "start": 1099511627777, "length": 1000 } ], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076.front.sepia.ceph.com", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } }, { "id": 10650, "entity": { "name": { "type": "client", "num": 10650 }, "addr": { "type": "v1", "addr": "172.21.15.16:0", "nonce": 1076095543 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 57.005008689, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 2.8762792493733556, "halflife": 300 }, "inst": "client.10650 v1:172.21.15.16:0/1076095543", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "1", "hostname": "smithi016", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:53:43.872 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_timeout' 2019-11-28T11:53:43.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.937+0000 7f7ef7e22700 1 Processor -- start 2019-11-28T11:53:43.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.937+0000 7f7ef7e22700 1 -- start start 2019-11-28T11:53:43.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.938+0000 7f7ef7e22700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ef006c0a0 0x7f7ef0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:43.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.938+0000 7f7ef7e22700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7ef00734e0 0x7f7ef0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:43.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.938+0000 7f7ef7e22700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef006db00 con 0x7f7ef0072360 2019-11-28T11:53:43.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.938+0000 7f7ef7e22700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006fd60 con 0x7f7ef006c0a0 2019-11-28T11:53:43.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.938+0000 7f7ef7e22700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef0070030 con 0x7f7ef00734e0 2019-11-28T11:53:43.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.938+0000 7f7ef63bf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ef006c0a0 0x7f7ef0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:43.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.938+0000 7f7ef63bf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ef006c0a0 0x7f7ef0072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44216/0 (socket says 172.21.15.80:44216) 2019-11-28T11:53:43.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.938+0000 7f7ef63bf700 1 -- 172.21.15.80:0/3800769619 learned_addr learned my addr 172.21.15.80:0/3800769619 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:43.998 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.938+0000 7f7ef5bbe700 1 --2- 172.21.15.80:0/3800769619 >> v2:172.21.15.174:3300/0 conn(0x7f7ef00734e0 0x7f7ef0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.939+0000 7f7ef63bf700 1 -- 172.21.15.80:0/3800769619 >> v2:172.21.15.174:3300/0 conn(0x7f7ef00734e0 msgr2=0x7f7ef0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.939+0000 7f7ef63bf700 1 --2- 172.21.15.80:0/3800769619 >> v2:172.21.15.174:3300/0 conn(0x7f7ef00734e0 0x7f7ef0071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.939+0000 7f7ef63bf700 1 -- 172.21.15.80:0/3800769619 >> v1:172.21.15.80:6789/0 conn(0x7f7ef0072360 legacy=0x7f7ef006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.939+0000 7f7ef63bf700 1 -- 172.21.15.80:0/3800769619 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef00706c0 con 0x7f7ef006c0a0 2019-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.939+0000 7f7ef53bd700 1 -- 172.21.15.80:0/3800769619 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536524560 0 0) 0x7f7ee8000dc0 con 0x7f7ef0072360 2019-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.939+0000 7f7ef63bf700 1 --2- 172.21.15.80:0/3800769619 >> v2:172.21.15.80:3300/0 conn(0x7f7ef006c0a0 0x7f7ef0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ee000f6c0 tx=0x7f7ee000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.939+0000 7f7ef63bf700 1 --2- 172.21.15.80:0/3800769619 >> v2:172.21.15.80:3300/0 conn(0x7f7ef006c0a0 0x7f7ef0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ee000f6c0 tx=0x7f7ee000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:44.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.939+0000 7f7ef63bf700 1 --2- 172.21.15.80:0/3800769619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef006c0a0 0x7f7ef0072fa0 secure :-1 s=READY pgs=2409 cs=0 l=1 rx=0x7f7ee000f6c0 tx=0x7f7ee000fa60).ready entity=mon.0 client_cookie=7ba5d8c59bdfc250 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:44.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.939+0000 7f7ef63bf700 1 --2- 172.21.15.80:0/3800769619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef006c0a0 0x7f7ef0072fa0 secure :-1 s=THROTTLE_DONE pgs=2409 cs=0 l=1 rx=0x7f7ee000f6c0 tx=0x7f7ee000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:44.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.939+0000 7f7ef53bd700 1 -- 172.21.15.80:0/3800769619 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee0000960 con 0x7f7ef006c0a0 2019-11-28T11:53:44.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.939+0000 7f7ef63bf700 1 --2- 172.21.15.80:0/3800769619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef006c0a0 0x7f7ef0072fa0 secure :-1 s=THROTTLE_DONE pgs=2409 cs=0 l=1 rx=0x7f7ee000f6c0 tx=0x7f7ee000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:44.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.939+0000 7f7ef63bf700 1 --2- 172.21.15.80:0/3800769619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef006c0a0 0x7f7ef0072fa0 secure :-1 s=THROTTLE_DONE pgs=2409 cs=0 l=1 rx=0x7f7ee000f6c0 tx=0x7f7ee000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:44.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.939+0000 7f7ef53bd700 1 -- 172.21.15.80:0/3800769619 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee0000960 con 0x7f7ef006c0a0 2019-11-28T11:53:44.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.939+0000 7f7ef53bd700 1 -- 172.21.15.80:0/3800769619 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee0001070 con 0x7f7ef006c0a0 2019-11-28T11:53:44.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.939+0000 7f7ef7e22700 1 -- 172.21.15.80:0/3800769619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef006c0a0 msgr2=0x7f7ef0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:44.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.939+0000 7f7ef7e22700 1 --2- 172.21.15.80:0/3800769619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef006c0a0 0x7f7ef0072fa0 secure :-1 s=READY pgs=2409 cs=0 l=1 rx=0x7f7ee000f6c0 tx=0x7f7ee000fa60).stop 2019-11-28T11:53:44.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.940+0000 7f7ef7e22700 1 -- 172.21.15.80:0/3800769619 shutdown_connections 2019-11-28T11:53:44.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.940+0000 7f7ef7e22700 1 --2- 172.21.15.80:0/3800769619 >> v2:172.21.15.174:3300/0 conn(0x7f7ef00734e0 0x7f7ef0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:44.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.940+0000 7f7ef7e22700 1 --2- 172.21.15.80:0/3800769619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef006c0a0 0x7f7ef0072fa0 unknown :-1 s=CLOSED pgs=2409 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:44.001 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.940+0000 7f7ef7e22700 1 -- 172.21.15.80:0/3800769619 shutdown_connections 2019-11-28T11:53:44.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.940+0000 7f7ef7e22700 1 -- 172.21.15.80:0/3800769619 wait complete. 2019-11-28T11:53:44.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.940+0000 7f7ef7e22700 1 -- 172.21.15.80:0/3800769619 >> 172.21.15.80:0/3800769619 conn(0x7f7ef0061cf0 msgr2=0x7f7ef0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:44.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.942+0000 7f7ef7e22700 1 Processor -- start 2019-11-28T11:53:44.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.942+0000 7f7ef7e22700 1 -- start start 2019-11-28T11:53:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.943+0000 7f7ef7e22700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ef012dc20 0x7f7ef012e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.943+0000 7f7ef7e22700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef0076690 con 0x7f7ef010adf0 2019-11-28T11:53:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.943+0000 7f7ef7e22700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef01141d0 con 0x7f7ef0075a00 2019-11-28T11:53:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.943+0000 7f7ef7e22700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef0073960 con 0x7f7ef012dc20 2019-11-28T11:53:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.943+0000 7f7ef6bc0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ef012dc20 0x7f7ef012e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.943+0000 7f7ef6bc0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7ef012dc20 0x7f7ef012e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44224/0 (socket says 172.21.15.80:44224) 2019-11-28T11:53:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.943+0000 7f7ef6bc0700 1 -- 172.21.15.80:0/2618875319 learned_addr learned my addr 172.21.15.80:0/2618875319 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.943+0000 7f7ef63bf700 1 --1- 172.21.15.80:0/2618875319 >> v1:172.21.15.80:6789/0 conn(0x7f7ef010adf0 0x7f7ef01592b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43538/0 (socket says 172.21.15.80:43538) 2019-11-28T11:53:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.943+0000 7f7eeeffd700 1 -- 172.21.15.80:0/2618875319 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191132310 0 0) 0x7f7ee0007da0 con 0x7f7ef010adf0 2019-11-28T11:53:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.943+0000 7f7eeeffd700 1 -- 172.21.15.80:0/2618875319 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed0002e80 con 0x7f7ef010adf0 2019-11-28T11:53:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.943+0000 7f7ef6bc0700 1 -- 172.21.15.80:0/2618875319 >> v1:172.21.15.174:6789/0 conn(0x7f7ef0075a00 legacy=0x7f7ef0075e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.943+0000 7f7ef6bc0700 1 -- 172.21.15.80:0/2618875319 >> v1:172.21.15.80:6789/0 conn(0x7f7ef010adf0 legacy=0x7f7ef01592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.943+0000 7f7ef6bc0700 1 -- 172.21.15.80:0/2618875319 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef00742c0 con 0x7f7ef012dc20 2019-11-28T11:53:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.944+0000 7f7ef6bc0700 1 --2- 172.21.15.80:0/2618875319 >> v2:172.21.15.80:3300/0 conn(0x7f7ef012dc20 0x7f7ef012e0c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ee8010790 tx=0x7f7ee8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.944+0000 7f7ef6bc0700 1 --2- 172.21.15.80:0/2618875319 >> v2:172.21.15.80:3300/0 conn(0x7f7ef012dc20 0x7f7ef012e0c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ee8010790 tx=0x7f7ee8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.944+0000 7f7ef6bc0700 1 --2- 172.21.15.80:0/2618875319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef012dc20 0x7f7ef012e0c0 secure :-1 s=READY pgs=2411 cs=0 l=1 rx=0x7f7ee8010790 tx=0x7f7ee8010b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.944+0000 7f7ef6bc0700 1 --2- 172.21.15.80:0/2618875319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef012dc20 0x7f7ef012e0c0 secure :-1 s=THROTTLE_DONE pgs=2411 cs=0 l=1 rx=0x7f7ee8010790 tx=0x7f7ee8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.944+0000 7f7eeeffd700 1 -- 172.21.15.80:0/2618875319 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee8005af0 con 0x7f7ef012dc20 2019-11-28T11:53:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.944+0000 7f7ef6bc0700 1 --2- 172.21.15.80:0/2618875319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef012dc20 0x7f7ef012e0c0 secure :-1 s=THROTTLE_DONE pgs=2411 cs=0 l=1 rx=0x7f7ee8010790 tx=0x7f7ee8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.944+0000 7f7ef7e22700 1 -- 172.21.15.80:0/2618875319 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef0074640 con 0x7f7ef012dc20 2019-11-28T11:53:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.944+0000 7f7eeeffd700 1 -- 172.21.15.80:0/2618875319 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee8005710 con 0x7f7ef012dc20 2019-11-28T11:53:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.944+0000 7f7ef6bc0700 1 --2- 172.21.15.80:0/2618875319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef012dc20 0x7f7ef012e0c0 secure :-1 s=THROTTLE_DONE pgs=2411 cs=0 l=1 rx=0x7f7ee8010790 tx=0x7f7ee8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.944+0000 7f7eeeffd700 1 -- 172.21.15.80:0/2618875319 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee8005900 con 0x7f7ef012dc20 2019-11-28T11:53:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.944+0000 7f7ef7e22700 1 -- 172.21.15.80:0/2618875319 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef00742c0 con 0x7f7ef012dc20 2019-11-28T11:53:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.944+0000 7f7ef6bc0700 1 --2- 172.21.15.80:0/2618875319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef012dc20 0x7f7ef012e0c0 secure :-1 s=THROTTLE_DONE pgs=2411 cs=0 l=1 rx=0x7f7ee8010790 tx=0x7f7ee8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.944+0000 7f7eeeffd700 1 -- 172.21.15.80:0/2618875319 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7ee8005900 con 0x7f7ef012dc20 2019-11-28T11:53:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.944+0000 7f7ef6bc0700 1 --2- 172.21.15.80:0/2618875319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef012dc20 0x7f7ef012e0c0 secure :-1 s=THROTTLE_DONE pgs=2411 cs=0 l=1 rx=0x7f7ee8010790 tx=0x7f7ee8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.945+0000 7f7eeeffd700 1 --2- 172.21.15.80:0/2618875319 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ed0018770 0x7f7ed001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.945+0000 7f7eeeffd700 1 -- 172.21.15.80:0/2618875319 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f7ee8031e50 con 0x7f7ef012dc20 2019-11-28T11:53:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.945+0000 7f7ef63bf700 1 --2- 172.21.15.80:0/2618875319 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ed0018770 0x7f7ed001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.945+0000 7f7ef63bf700 1 --2- 172.21.15.80:0/2618875319 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ed0018770 0x7f7ed001abe0 crc :-1 s=READY pgs=991 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.953+0000 7f7ef7e22700 1 -- 172.21.15.80:0/2618875319 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef0074640 con 0x7f7ef012dc20 2019-11-28T11:53:44.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.956+0000 7f7ef6bc0700 1 --2- 172.21.15.80:0/2618875319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef012dc20 0x7f7ef012e0c0 secure :-1 s=THROTTLE_DONE pgs=2411 cs=0 l=1 rx=0x7f7ee8010790 tx=0x7f7ee8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:44.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:43.956+0000 7f7eeeffd700 1 -- 172.21.15.80:0/2618875319 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7ee8007920 con 0x7f7ef012dc20 2019-11-28T11:53:44.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:44.129+0000 7f7ef7e22700 1 -- 172.21.15.80:0/2618875319 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_timeout"]} v 0) v1 -- 0x7f7ef00742c0 con 0x7f7ef012dc20 2019-11-28T11:53:44.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:44.915+0000 7f7ef6bc0700 1 --2- 172.21.15.80:0/2618875319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef012dc20 0x7f7ef012e0c0 secure :-1 s=THROTTLE_DONE pgs=2411 cs=0 l=1 rx=0x7f7ee8010790 tx=0x7f7ee8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:44.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:44.915+0000 7f7eeeffd700 1 -- 172.21.15.80:0/2618875319 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_timeout"]}]=0 v680) v1 ==== 154+0+0 (secure 0 0 0) 0x7f7ee8005900 con 0x7f7ef012dc20 2019-11-28T11:53:45.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:44.947+0000 7f7ef7e22700 1 -- 172.21.15.80:0/2618875319 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ed0018770 msgr2=0x7f7ed001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:45.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:44.947+0000 7f7ef7e22700 1 --2- 172.21.15.80:0/2618875319 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ed0018770 0x7f7ed001abe0 crc :-1 s=READY pgs=991 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:45.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:44.947+0000 7f7ef7e22700 1 -- 172.21.15.80:0/2618875319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef012dc20 msgr2=0x7f7ef012e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:45.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:44.947+0000 7f7ef7e22700 1 --2- 172.21.15.80:0/2618875319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef012dc20 0x7f7ef012e0c0 secure :-1 s=READY pgs=2411 cs=0 l=1 rx=0x7f7ee8010790 tx=0x7f7ee8010b30).stop 2019-11-28T11:53:45.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:44.947+0000 7f7ef7e22700 1 -- 172.21.15.80:0/2618875319 shutdown_connections 2019-11-28T11:53:45.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:44.947+0000 7f7ef7e22700 1 --2- 172.21.15.80:0/2618875319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ef012dc20 0x7f7ef012e0c0 unknown :-1 s=CLOSED pgs=2411 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:45.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:44.947+0000 7f7ef7e22700 1 --2- 172.21.15.80:0/2618875319 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ed0018770 0x7f7ed001abe0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:45.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:44.947+0000 7f7ef7e22700 1 -- 172.21.15.80:0/2618875319 shutdown_connections 2019-11-28T11:53:45.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:44.947+0000 7f7ef7e22700 1 -- 172.21.15.80:0/2618875319 wait complete. 2019-11-28T11:53:45.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:44.947+0000 7f7ef7e22700 1 -- 172.21.15.80:0/2618875319 >> 172.21.15.80:0/2618875319 conn(0x7f7ef013d930 msgr2=0x7f7ef0111550 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:45.013 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:53:45.013 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:53:45.088 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:53:45.147 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:53:45.208 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:53:45.268 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:53:45.328 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:53:45.391 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:53:45.391 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:53:45.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:53:45.392 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T11:53:45.461 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:53:45.465 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:53:45.467 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:53:45.472 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:53:45.476 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:53:45.503 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:53:45.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:53:45.504 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:53:45.545 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:53:45.550 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:53:45.555 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:53:45.631 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:53:45.635 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:53:45.674 INFO:tasks.cephfs_test_runner:test_reconnect_timeout (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2019-11-28T11:53:45.674 INFO:tasks.cephfs_test_runner:Starting test: test_restart (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T11:53:45.675 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_restart' 2019-11-28T11:53:45.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.740+0000 7fb8cc784700 1 Processor -- start 2019-11-28T11:53:45.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.740+0000 7fb8cc784700 1 -- start start 2019-11-28T11:53:45.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.741+0000 7fb8cc784700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb8c406d120 0x7fb8c4165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:45.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.741+0000 7fb8cc784700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c406d5a0 con 0x7fb8c406c0a0 2019-11-28T11:53:45.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.741+0000 7fb8cc784700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c406db00 con 0x7fb8c406c490 2019-11-28T11:53:45.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.741+0000 7fb8cc784700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c406fd60 con 0x7fb8c406d120 2019-11-28T11:53:45.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.741+0000 7fb8cad21700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb8c406c0a0 0x7fb8c4072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43546/0 (socket says 172.21.15.80:43546) 2019-11-28T11:53:45.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.741+0000 7fb8cad21700 1 -- 172.21.15.80:0/4015241749 learned_addr learned my addr 172.21.15.80:0/4015241749 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:45.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8cb522700 1 --2- 172.21.15.80:0/4015241749 >> v2:172.21.15.174:3300/0 conn(0x7fb8c406d120 0x7fb8c4165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:45.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8c9d1f700 1 -- 172.21.15.80:0/4015241749 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813228869 0 0) 0x7fb8b4001150 con 0x7fb8c406c0a0 2019-11-28T11:53:45.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8c9d1f700 1 -- 172.21.15.80:0/4015241749 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b0002e80 con 0x7fb8c406c0a0 2019-11-28T11:53:45.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8c9d1f700 1 -- 172.21.15.80:0/4015241749 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2190289679 0 0) 0x7fb8b4001130 con 0x7fb8c406c0a0 2019-11-28T11:53:45.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8c9d1f700 1 -- 172.21.15.80:0/4015241749 >> v2:172.21.15.174:3300/0 conn(0x7fb8c406d120 msgr2=0x7fb8c4165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:45.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8c9d1f700 1 --2- 172.21.15.80:0/4015241749 >> v2:172.21.15.174:3300/0 conn(0x7fb8c406d120 0x7fb8c4165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:45.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8c9d1f700 1 -- 172.21.15.80:0/4015241749 >> v1:172.21.15.174:6789/0 conn(0x7fb8c406c490 legacy=0x7fb8c406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:45.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8c9d1f700 1 -- 172.21.15.80:0/4015241749 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c40706c0 con 0x7fb8c406c0a0 2019-11-28T11:53:45.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8c9d1f700 1 -- 172.21.15.80:0/4015241749 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fb8b4001660 con 0x7fb8c406c0a0 2019-11-28T11:53:45.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8c9d1f700 1 -- 172.21.15.80:0/4015241749 >> v1:172.21.15.80:6789/0 conn(0x7fb8c406c0a0 legacy=0x7fb8c4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:45.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8c9d1f700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b0003ab0 0x7fb8b0005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:45.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8c9d1f700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8b0006690 0x7fb8b0008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:45.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8c9d1f700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8b0009380 0x7fb8b000b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:45.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8c9d1f700 1 -- 172.21.15.80:0/4015241749 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b000c000 con 0x7fb8b0003ab0 2019-11-28T11:53:45.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8c9d1f700 1 -- 172.21.15.80:0/4015241749 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0050200 con 0x7fb8b0006690 2019-11-28T11:53:45.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8c9d1f700 1 -- 172.21.15.80:0/4015241749 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0050430 con 0x7fb8b0009380 2019-11-28T11:53:45.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8cad21700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b0003ab0 0x7fb8b0005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:45.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8ca520700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8b0006690 0x7fb8b0008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:45.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8cb522700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8b0009380 0x7fb8b000b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:45.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8cad21700 1 -- 172.21.15.80:0/4015241749 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8b0009380 msgr2=0x7fb8b000b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:45.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8cad21700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8b0009380 0x7fb8b000b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:45.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8cad21700 1 -- 172.21.15.80:0/4015241749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8b0006690 msgr2=0x7fb8b0008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:45.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8cad21700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8b0006690 0x7fb8b0008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:45.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8cad21700 1 -- 172.21.15.80:0/4015241749 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b00506e0 con 0x7fb8b0003ab0 2019-11-28T11:53:45.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8ca520700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8b0006690 0x7fb8b0008b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:53:45.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8cb522700 1 -- 172.21.15.80:0/4015241749 reap_dead start 2019-11-28T11:53:45.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8cad21700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b0003ab0 0x7fb8b0005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb8b400f8e0 tx=0x7fb8b400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:45.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8cad21700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b0003ab0 0x7fb8b0005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb8b400f8e0 tx=0x7fb8b400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:45.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.742+0000 7fb8cad21700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b0003ab0 0x7fb8b0005f10 secure :-1 s=READY pgs=2413 cs=0 l=1 rx=0x7fb8b400f8e0 tx=0x7fb8b400f790).ready entity=mon.0 client_cookie=931fc9344b286922 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:45.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.743+0000 7fb8cad21700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b0003ab0 0x7fb8b0005f10 secure :-1 s=THROTTLE_DONE pgs=2413 cs=0 l=1 rx=0x7fb8b400f8e0 tx=0x7fb8b400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:45.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.743+0000 7fb8c9d1f700 1 -- 172.21.15.80:0/4015241749 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8b4001130 con 0x7fb8b0003ab0 2019-11-28T11:53:45.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.743+0000 7fb8cad21700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b0003ab0 0x7fb8b0005f10 secure :-1 s=THROTTLE_DONE pgs=2413 cs=0 l=1 rx=0x7fb8b400f8e0 tx=0x7fb8b400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:45.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.743+0000 7fb8c9d1f700 1 -- 172.21.15.80:0/4015241749 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b4004430 con 0x7fb8b0003ab0 2019-11-28T11:53:45.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.743+0000 7fb8cad21700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b0003ab0 0x7fb8b0005f10 secure :-1 s=THROTTLE_DONE pgs=2413 cs=0 l=1 rx=0x7fb8b400f8e0 tx=0x7fb8b400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:45.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.743+0000 7fb8c9d1f700 1 -- 172.21.15.80:0/4015241749 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8b4004620 con 0x7fb8b0003ab0 2019-11-28T11:53:45.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.743+0000 7fb8cc784700 1 -- 172.21.15.80:0/4015241749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b0003ab0 msgr2=0x7fb8b0005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:45.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.743+0000 7fb8cc784700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b0003ab0 0x7fb8b0005f10 secure :-1 s=READY pgs=2413 cs=0 l=1 rx=0x7fb8b400f8e0 tx=0x7fb8b400f790).stop 2019-11-28T11:53:45.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.743+0000 7fb8cc784700 1 -- 172.21.15.80:0/4015241749 shutdown_connections 2019-11-28T11:53:45.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.743+0000 7fb8cc784700 1 --2- 172.21.15.80:0/4015241749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8b0003ab0 0x7fb8b0005f10 unknown :-1 s=CLOSED pgs=2413 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:45.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.743+0000 7fb8cc784700 1 -- 172.21.15.80:0/4015241749 shutdown_connections 2019-11-28T11:53:45.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.743+0000 7fb8cc784700 1 -- 172.21.15.80:0/4015241749 wait complete. 2019-11-28T11:53:45.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.743+0000 7fb8cc784700 1 -- 172.21.15.80:0/4015241749 >> 172.21.15.80:0/4015241749 conn(0x7fb8c4061cf0 msgr2=0x7fb8c4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:45.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.746+0000 7fb8cc784700 1 Processor -- start 2019-11-28T11:53:45.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.746+0000 7fb8cc784700 1 -- start start 2019-11-28T11:53:45.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cc784700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb8c4074d00 0x7fb8c407aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:45.814 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cc784700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8c407bba0 0x7fb8c4167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:45.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cc784700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c40754d0 con 0x7fb8c4150f50 2019-11-28T11:53:45.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cc784700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c4078980 con 0x7fb8c4074d00 2019-11-28T11:53:45.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cc784700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c4078c50 con 0x7fb8c407bba0 2019-11-28T11:53:45.815 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cad21700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb8c4074d00 0x7fb8c407aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:45.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cad21700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb8c4074d00 0x7fb8c407aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44242/0 (socket says 172.21.15.80:44242) 2019-11-28T11:53:45.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8ca520700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb8c4150f50 0x7fb8c407af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43560/0 (socket says 172.21.15.80:43560) 2019-11-28T11:53:45.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cad21700 1 -- 172.21.15.80:0/809235989 learned_addr learned my addr 172.21.15.80:0/809235989 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:45.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cb522700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8c407bba0 0x7fb8c4167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:45.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cad21700 1 -- 172.21.15.80:0/809235989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8c407bba0 msgr2=0x7fb8c4167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:45.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cad21700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8c407bba0 0x7fb8c4167c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:45.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cad21700 1 -- 172.21.15.80:0/809235989 >> v1:172.21.15.80:6789/0 conn(0x7fb8c4150f50 legacy=0x7fb8c407af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:45.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cad21700 1 -- 172.21.15.80:0/809235989 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c40792e0 con 0x7fb8c4074d00 2019-11-28T11:53:45.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8c37fe700 1 -- 172.21.15.80:0/809235989 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033648353 0 0) 0x7fb8ac001400 con 0x7fb8c4150f50 2019-11-28T11:53:45.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cad21700 1 --2- 172.21.15.80:0/809235989 >> v2:172.21.15.80:3300/0 conn(0x7fb8c4074d00 0x7fb8c407aa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb8b4010440 tx=0x7fb8b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:45.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cad21700 1 --2- 172.21.15.80:0/809235989 >> v2:172.21.15.80:3300/0 conn(0x7fb8c4074d00 0x7fb8c407aa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb8b4010440 tx=0x7fb8b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:45.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cad21700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c4074d00 0x7fb8c407aa20 secure :-1 s=READY pgs=2415 cs=0 l=1 rx=0x7fb8b4010440 tx=0x7fb8b4010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:45.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cad21700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c4074d00 0x7fb8c407aa20 secure :-1 s=THROTTLE_DONE pgs=2415 cs=0 l=1 rx=0x7fb8b4010440 tx=0x7fb8b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:45.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8c37fe700 1 -- 172.21.15.80:0/809235989 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8b4001640 con 0x7fb8c4074d00 2019-11-28T11:53:45.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cad21700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c4074d00 0x7fb8c407aa20 secure :-1 s=THROTTLE_DONE pgs=2415 cs=0 l=1 rx=0x7fb8b4010440 tx=0x7fb8b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:45.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cad21700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c4074d00 0x7fb8c407aa20 secure :-1 s=THROTTLE_DONE pgs=2415 cs=0 l=1 rx=0x7fb8b4010440 tx=0x7fb8b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:45.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8c37fe700 1 -- 172.21.15.80:0/809235989 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b4004430 con 0x7fb8c4074d00 2019-11-28T11:53:45.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cc784700 1 -- 172.21.15.80:0/809235989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c4079660 con 0x7fb8c4074d00 2019-11-28T11:53:45.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8c37fe700 1 -- 172.21.15.80:0/809235989 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8b4001640 con 0x7fb8c4074d00 2019-11-28T11:53:45.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.747+0000 7fb8cc784700 1 -- 172.21.15.80:0/809235989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c40792e0 con 0x7fb8c4074d00 2019-11-28T11:53:45.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.748+0000 7fb8cad21700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c4074d00 0x7fb8c407aa20 secure :-1 s=THROTTLE_DONE pgs=2415 cs=0 l=1 rx=0x7fb8b4010440 tx=0x7fb8b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.748+0000 7fb8c37fe700 1 -- 172.21.15.80:0/809235989 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb8b4004620 con 0x7fb8c4074d00 2019-11-28T11:53:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.748+0000 7fb8cad21700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c4074d00 0x7fb8c407aa20 secure :-1 s=THROTTLE_DONE pgs=2415 cs=0 l=1 rx=0x7fb8b4010440 tx=0x7fb8b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.748+0000 7fb8c37fe700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8a8018730 0x7fb8a801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.748+0000 7fb8c37fe700 1 -- 172.21.15.80:0/809235989 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fb8b4031ab0 con 0x7fb8c4074d00 2019-11-28T11:53:45.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.748+0000 7fb8ca520700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8a8018730 0x7fb8a801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:45.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.748+0000 7fb8ca520700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8a8018730 0x7fb8a801abc0 crc :-1 s=READY pgs=992 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:45.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.755+0000 7fb8cc784700 1 -- 172.21.15.80:0/809235989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c4079660 con 0x7fb8c4074d00 2019-11-28T11:53:45.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.759+0000 7fb8cad21700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c4074d00 0x7fb8c407aa20 secure :-1 s=THROTTLE_DONE pgs=2415 cs=0 l=1 rx=0x7fb8b4010440 tx=0x7fb8b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:45.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.759+0000 7fb8c37fe700 1 -- 172.21.15.80:0/809235989 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb8b4001970 con 0x7fb8c4074d00 2019-11-28T11:53:45.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:45.936+0000 7fb8cc784700 1 -- 172.21.15.80:0/809235989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_restart"]} v 0) v1 -- 0x7fb8c40792e0 con 0x7fb8c4074d00 2019-11-28T11:53:46.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:46.923+0000 7fb8cad21700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c4074d00 0x7fb8c407aa20 secure :-1 s=THROTTLE_DONE pgs=2415 cs=0 l=1 rx=0x7fb8b4010440 tx=0x7fb8b4010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:46.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:46.923+0000 7fb8c37fe700 1 -- 172.21.15.80:0/809235989 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_restart"]}]=0 v682) v1 ==== 147+0+0 (secure 0 0 0) 0x7fb8b401f8c0 con 0x7fb8c4074d00 2019-11-28T11:53:47.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:46.953+0000 7fb8cc784700 1 -- 172.21.15.80:0/809235989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8a8018730 msgr2=0x7fb8a801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:47.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:46.953+0000 7fb8cc784700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8a8018730 0x7fb8a801abc0 crc :-1 s=READY pgs=992 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:47.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:46.953+0000 7fb8cc784700 1 -- 172.21.15.80:0/809235989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c4074d00 msgr2=0x7fb8c407aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:47.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:46.953+0000 7fb8cc784700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c4074d00 0x7fb8c407aa20 secure :-1 s=READY pgs=2415 cs=0 l=1 rx=0x7fb8b4010440 tx=0x7fb8b4010270).stop 2019-11-28T11:53:47.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:46.953+0000 7fb8cc784700 1 -- 172.21.15.80:0/809235989 shutdown_connections 2019-11-28T11:53:47.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:46.953+0000 7fb8cc784700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8a8018730 0x7fb8a801abc0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:47.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:46.953+0000 7fb8cc784700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8c407bba0 0x7fb8c4167c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:47.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:46.953+0000 7fb8cc784700 1 --2- 172.21.15.80:0/809235989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8c4074d00 0x7fb8c407aa20 unknown :-1 s=CLOSED pgs=2415 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:47.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:46.953+0000 7fb8cc784700 1 -- 172.21.15.80:0/809235989 shutdown_connections 2019-11-28T11:53:47.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:46.953+0000 7fb8cc784700 1 -- 172.21.15.80:0/809235989 wait complete. 2019-11-28T11:53:47.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:46.953+0000 7fb8cc784700 1 -- 172.21.15.80:0/809235989 >> 172.21.15.80:0/809235989 conn(0x7fb8c413fa50 msgr2=0x7fb8c407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:47.019 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:53:47.019 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:53:47.087 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:53:47.146 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:53:47.208 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:53:47.264 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:53:47.325 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:53:47.381 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:53:47.381 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:53:47.381 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:53:47.382 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:53:47.382 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:53:47.382 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:53:47.382 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:53:47.387 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:53:47.387 DEBUG:teuthology.parallel:result is None 2019-11-28T11:53:47.389 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:53:47.389 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:53:47.390 DEBUG:teuthology.parallel:result is None 2019-11-28T11:53:47.390 DEBUG:teuthology.parallel:result is None 2019-11-28T11:53:47.390 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:53:47.391 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:53:47.391 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:53:47.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.537+0000 7ff601caa700 1 Processor -- start 2019-11-28T11:53:47.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.537+0000 7ff601caa700 1 -- start start 2019-11-28T11:53:47.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.538+0000 7ff601caa700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff5fc06c0a0 0x7ff5fc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:47.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.538+0000 7ff601caa700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc06db00 con 0x7ff5fc072620 2019-11-28T11:53:47.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.538+0000 7ff601caa700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc06e000 con 0x7ff5fc0734e0 2019-11-28T11:53:47.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.538+0000 7ff601caa700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5fc06fd60 con 0x7ff5fc06c0a0 2019-11-28T11:53:47.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff600a48700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff5fc072620 0x7ff5fc164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43566/0 (socket says 172.21.15.80:43566) 2019-11-28T11:53:47.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff600a48700 1 -- 172.21.15.80:0/3665915770 learned_addr learned my addr 172.21.15.80:0/3665915770 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:47.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fbfff700 1 --2- 172.21.15.80:0/3665915770 >> v2:172.21.15.174:3300/0 conn(0x7ff5fc06c0a0 0x7ff5fc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:47.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 -- 172.21.15.80:0/3665915770 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902947394 0 0) 0x7ff5f40014d0 con 0x7ff5fc072620 2019-11-28T11:53:47.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 -- 172.21.15.80:0/3665915770 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e8002e80 con 0x7ff5fc072620 2019-11-28T11:53:47.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 -- 172.21.15.80:0/3665915770 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710547406 0 0) 0x7ff5e4001080 con 0x7ff5fc0734e0 2019-11-28T11:53:47.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 -- 172.21.15.80:0/3665915770 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e80030b0 con 0x7ff5fc0734e0 2019-11-28T11:53:47.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 -- 172.21.15.80:0/3665915770 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4141384496 0 0) 0x7ff5f40014b0 con 0x7ff5fc072620 2019-11-28T11:53:47.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 -- 172.21.15.80:0/3665915770 >> v2:172.21.15.174:3300/0 conn(0x7ff5fc06c0a0 msgr2=0x7ff5fc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:47.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 --2- 172.21.15.80:0/3665915770 >> v2:172.21.15.174:3300/0 conn(0x7ff5fc06c0a0 0x7ff5fc072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:47.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 -- 172.21.15.80:0/3665915770 >> v1:172.21.15.174:6789/0 conn(0x7ff5fc0734e0 legacy=0x7ff5fc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:47.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 -- 172.21.15.80:0/3665915770 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc0706c0 con 0x7ff5fc072620 2019-11-28T11:53:47.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 -- 172.21.15.80:0/3665915770 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff5f40019e0 con 0x7ff5fc072620 2019-11-28T11:53:47.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 -- 172.21.15.80:0/3665915770 >> v1:172.21.15.80:6789/0 conn(0x7ff5fc072620 legacy=0x7ff5fc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:47.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5e8003b80 0x7ff5e8005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:47.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5e80066d0 0x7ff5e8008b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:47.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e804d3c0 0x7ff5e804f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:47.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 -- 172.21.15.80:0/3665915770 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e804fff0 con 0x7ff5e804d3c0 2019-11-28T11:53:47.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 -- 172.21.15.80:0/3665915770 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8050220 con 0x7ff5e80066d0 2019-11-28T11:53:47.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fb7fe700 1 -- 172.21.15.80:0/3665915770 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8050450 con 0x7ff5e8003b80 2019-11-28T11:53:47.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5f3fff700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5e80066d0 0x7ff5e8008b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:47.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff5fbfff700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5e8003b80 0x7ff5e8005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:47.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.539+0000 7ff600a48700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e804d3c0 0x7ff5e804f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:47.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff600a48700 1 -- 172.21.15.80:0/3665915770 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5e8003b80 msgr2=0x7ff5e8005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:47.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff600a48700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5e8003b80 0x7ff5e8005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:47.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff600a48700 1 -- 172.21.15.80:0/3665915770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5e80066d0 msgr2=0x7ff5e8008b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:47.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff600a48700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5e80066d0 0x7ff5e8008b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:47.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff600a48700 1 -- 172.21.15.80:0/3665915770 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e8050700 con 0x7ff5e804d3c0 2019-11-28T11:53:47.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff5f3fff700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5e80066d0 0x7ff5e8008b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:47.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff600a48700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e804d3c0 0x7ff5e804f870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff5f400fc90 tx=0x7ff5f400fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff600a48700 1 -- 172.21.15.80:0/3665915770 reap_dead start 2019-11-28T11:53:47.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff600a48700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e804d3c0 0x7ff5e804f870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff5f400fc90 tx=0x7ff5f400fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff600a48700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e804d3c0 0x7ff5e804f870 secure :-1 s=READY pgs=2417 cs=0 l=1 rx=0x7ff5f400fc90 tx=0x7ff5f400fb10).ready entity=mon.0 client_cookie=91e00df1d1e93f21 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:47.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff600a48700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e804d3c0 0x7ff5e804f870 secure :-1 s=THROTTLE_DONE pgs=2417 cs=0 l=1 rx=0x7ff5f400fc90 tx=0x7ff5f400fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff600a48700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e804d3c0 0x7ff5e804f870 secure :-1 s=THROTTLE_DONE pgs=2417 cs=0 l=1 rx=0x7ff5f400fc90 tx=0x7ff5f400fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff5fb7fe700 1 -- 172.21.15.80:0/3665915770 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5f4001860 con 0x7ff5e804d3c0 2019-11-28T11:53:47.612 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff600a48700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e804d3c0 0x7ff5e804f870 secure :-1 s=THROTTLE_DONE pgs=2417 cs=0 l=1 rx=0x7ff5f400fc90 tx=0x7ff5f400fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff5fb7fe700 1 -- 172.21.15.80:0/3665915770 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f40014b0 con 0x7ff5e804d3c0 2019-11-28T11:53:47.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff5fb7fe700 1 -- 172.21.15.80:0/3665915770 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5f4004b90 con 0x7ff5e804d3c0 2019-11-28T11:53:47.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff601caa700 1 -- 172.21.15.80:0/3665915770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e804d3c0 msgr2=0x7ff5e804f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:47.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.540+0000 7ff601caa700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e804d3c0 0x7ff5e804f870 secure :-1 s=READY pgs=2417 cs=0 l=1 rx=0x7ff5f400fc90 tx=0x7ff5f400fb10).stop 2019-11-28T11:53:47.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.541+0000 7ff601caa700 1 -- 172.21.15.80:0/3665915770 shutdown_connections 2019-11-28T11:53:47.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.541+0000 7ff601caa700 1 --2- 172.21.15.80:0/3665915770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e804d3c0 0x7ff5e804f870 unknown :-1 s=CLOSED pgs=2417 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:47.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.541+0000 7ff601caa700 1 -- 172.21.15.80:0/3665915770 shutdown_connections 2019-11-28T11:53:47.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.541+0000 7ff601caa700 1 -- 172.21.15.80:0/3665915770 wait complete. 2019-11-28T11:53:47.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.541+0000 7ff601caa700 1 -- 172.21.15.80:0/3665915770 >> 172.21.15.80:0/3665915770 conn(0x7ff5fc061cf0 msgr2=0x7ff5fc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:47.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.543+0000 7ff601caa700 1 Processor -- start 2019-11-28T11:53:47.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.543+0000 7ff601caa700 1 -- start start 2019-11-28T11:53:47.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.544+0000 7ff601caa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5fc077040 0x7ff5fc1574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:47.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.544+0000 7ff601caa700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5fc157a00 0x7ff5fc074a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:47.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.544+0000 7ff601caa700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc140820 con 0x7ff5fc074f50 2019-11-28T11:53:47.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.544+0000 7ff601caa700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5fc137110 con 0x7ff5fc077040 2019-11-28T11:53:47.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.544+0000 7ff601caa700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc1373e0 con 0x7ff5fc157a00 2019-11-28T11:53:47.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.544+0000 7ff5fbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5fc077040 0x7ff5fc1574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:47.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.544+0000 7ff5fbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5fc077040 0x7ff5fc1574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44260/0 (socket says 172.21.15.80:44260) 2019-11-28T11:53:47.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.544+0000 7ff5fbfff700 1 -- 172.21.15.80:0/422245731 learned_addr learned my addr 172.21.15.80:0/422245731 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:47.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.544+0000 7ff5f3fff700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5fc157a00 0x7ff5fc074a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:47.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.544+0000 7ff5fbfff700 1 -- 172.21.15.80:0/422245731 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5fc157a00 msgr2=0x7ff5fc074a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:47.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.544+0000 7ff5fbfff700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5fc157a00 0x7ff5fc074a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:47.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7ff5fbfff700 1 -- 172.21.15.80:0/422245731 >> v1:172.21.15.80:6789/0 conn(0x7ff5fc074f50 legacy=0x7ff5fc156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:47.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.544+0000 7ff5f97fa700 1 -- 172.21.15.80:0/422245731 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186029329 0 0) 0x7ff5f4001270 con 0x7ff5fc074f50 2019-11-28T11:53:47.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7ff5fbfff700 1 -- 172.21.15.80:0/422245731 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc137a70 con 0x7ff5fc077040 2019-11-28T11:53:47.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7ff5fbfff700 1 --2- 172.21.15.80:0/422245731 >> v2:172.21.15.80:3300/0 conn(0x7ff5fc077040 0x7ff5fc1574c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5ec010450 tx=0x7ff5ec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7ff5fbfff700 1 --2- 172.21.15.80:0/422245731 >> v2:172.21.15.80:3300/0 conn(0x7ff5fc077040 0x7ff5fc1574c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5ec010450 tx=0x7ff5ec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7ff5fbfff700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc077040 0x7ff5fc1574c0 secure :-1 s=READY pgs=2419 cs=0 l=1 rx=0x7ff5ec010450 tx=0x7ff5ec010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:47.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7ff5fbfff700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc077040 0x7ff5fc1574c0 secure :-1 s=THROTTLE_DONE pgs=2419 cs=0 l=1 rx=0x7ff5ec010450 tx=0x7ff5ec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7ff5f97fa700 1 -- 172.21.15.80:0/422245731 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5ec000940 con 0x7ff5fc077040 2019-11-28T11:53:47.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7ff5fbfff700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc077040 0x7ff5fc1574c0 secure :-1 s=THROTTLE_DONE pgs=2419 cs=0 l=1 rx=0x7ff5ec010450 tx=0x7ff5ec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7ff5fbfff700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc077040 0x7ff5fc1574c0 secure :-1 s=THROTTLE_DONE pgs=2419 cs=0 l=1 rx=0x7ff5ec010450 tx=0x7ff5ec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7ff5f97fa700 1 -- 172.21.15.80:0/422245731 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec005580 con 0x7ff5fc077040 2019-11-28T11:53:47.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7ff601caa700 1 -- 172.21.15.80:0/422245731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5fc137df0 con 0x7ff5fc077040 2019-11-28T11:53:47.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7ff601caa700 1 -- 172.21.15.80:0/422245731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5fc137a70 con 0x7ff5fc077040 2019-11-28T11:53:47.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7ff5f97fa700 1 -- 172.21.15.80:0/422245731 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5ec005bd0 con 0x7ff5fc077040 2019-11-28T11:53:47.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7ff5fbfff700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc077040 0x7ff5fc1574c0 secure :-1 s=THROTTLE_DONE pgs=2419 cs=0 l=1 rx=0x7ff5ec010450 tx=0x7ff5ec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7ff5f97fa700 1 -- 172.21.15.80:0/422245731 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff5ec005180 con 0x7ff5fc077040 2019-11-28T11:53:47.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7ff5fbfff700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc077040 0x7ff5fc1574c0 secure :-1 s=THROTTLE_DONE pgs=2419 cs=0 l=1 rx=0x7ff5ec010450 tx=0x7ff5ec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7ff5f97fa700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5e0018730 0x7ff5e001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:47.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7ff5f97fa700 1 -- 172.21.15.80:0/422245731 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6149+0+0 (secure 0 0 0) 0x7ff5ec031b50 con 0x7ff5fc077040 2019-11-28T11:53:47.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7ff5f3fff700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5e0018730 0x7ff5e001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:47.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7ff5f3fff700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5e0018730 0x7ff5e001abc0 crc :-1 s=READY pgs=993 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:47.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.544+0000 7f498bd5f700 1 Processor -- start 2019-11-28T11:53:47.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.544+0000 7f498bd5f700 1 -- start start 2019-11-28T11:53:47.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f498bd5f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f498406c490 0x7f498406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:47.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f498bd5f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498406db00 con 0x7f498406c0a0 2019-11-28T11:53:47.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f498bd5f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498406e000 con 0x7f498406ce60 2019-11-28T11:53:47.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f498bd5f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498406fd60 con 0x7f498406c490 2019-11-28T11:53:47.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f4989afb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f498406c490 0x7f498406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:47.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f498a2fc700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f498406c0a0 0x7f4984072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43588/0 (socket says 172.21.15.80:43588) 2019-11-28T11:53:47.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f4989afb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f498406c490 0x7f498406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44276/0 (socket says 172.21.15.80:44276) 2019-11-28T11:53:47.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f498a2fc700 1 -- 172.21.15.80:0/352886476 learned_addr learned my addr 172.21.15.80:0/352886476 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:47.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f49892fa700 1 -- 172.21.15.80:0/352886476 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346042354 0 0) 0x7f4980001430 con 0x7f498406c0a0 2019-11-28T11:53:47.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f49892fa700 1 -- 172.21.15.80:0/352886476 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4970002e80 con 0x7f498406c0a0 2019-11-28T11:53:47.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f49892fa700 1 -- 172.21.15.80:0/352886476 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412495481 0 0) 0x7f497c001080 con 0x7f498406ce60 2019-11-28T11:53:47.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f49892fa700 1 -- 172.21.15.80:0/352886476 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49700030b0 con 0x7f498406ce60 2019-11-28T11:53:47.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f4989afb700 1 -- 172.21.15.80:0/352886476 >> v1:172.21.15.174:6789/0 conn(0x7f498406ce60 legacy=0x7f4984164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:47.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f4989afb700 1 -- 172.21.15.80:0/352886476 >> v1:172.21.15.80:6789/0 conn(0x7f498406c0a0 legacy=0x7f4984072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:47.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f4989afb700 1 -- 172.21.15.80:0/352886476 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49840706c0 con 0x7f498406c490 2019-11-28T11:53:47.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f4989afb700 1 --2- 172.21.15.80:0/352886476 >> v2:172.21.15.80:3300/0 conn(0x7f498406c490 0x7f498406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f497400af50 tx=0x7f497400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f4989afb700 1 --2- 172.21.15.80:0/352886476 >> v2:172.21.15.80:3300/0 conn(0x7f498406c490 0x7f498406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f497400af50 tx=0x7f497400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f4989afb700 1 --2- 172.21.15.80:0/352886476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f498406c490 0x7f498406c920 secure :-1 s=READY pgs=2423 cs=0 l=1 rx=0x7f497400af50 tx=0x7f497400b760).ready entity=mon.0 client_cookie=65ed6f27768508b7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:47.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.547+0000 7f4989afb700 1 --2- 172.21.15.80:0/352886476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f498406c490 0x7f498406c920 secure :-1 s=THROTTLE_DONE pgs=2423 cs=0 l=1 rx=0x7f497400af50 tx=0x7f497400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.547+0000 7f4989afb700 1 --2- 172.21.15.80:0/352886476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f498406c490 0x7f498406c920 secure :-1 s=THROTTLE_DONE pgs=2423 cs=0 l=1 rx=0x7f497400af50 tx=0x7f497400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.547+0000 7f49892fa700 1 -- 172.21.15.80:0/352886476 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4974000960 con 0x7f498406c490 2019-11-28T11:53:47.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.547+0000 7f4989afb700 1 --2- 172.21.15.80:0/352886476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f498406c490 0x7f498406c920 secure :-1 s=THROTTLE_DONE pgs=2423 cs=0 l=1 rx=0x7f497400af50 tx=0x7f497400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.547+0000 7f49892fa700 1 -- 172.21.15.80:0/352886476 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4974009860 con 0x7f498406c490 2019-11-28T11:53:47.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.547+0000 7f49892fa700 1 -- 172.21.15.80:0/352886476 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4974009f30 con 0x7f498406c490 2019-11-28T11:53:47.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.547+0000 7f498bd5f700 1 -- 172.21.15.80:0/352886476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f498406c490 msgr2=0x7f498406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:47.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.547+0000 7f498bd5f700 1 --2- 172.21.15.80:0/352886476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f498406c490 0x7f498406c920 secure :-1 s=READY pgs=2423 cs=0 l=1 rx=0x7f497400af50 tx=0x7f497400b760).stop 2019-11-28T11:53:47.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.548+0000 7f498bd5f700 1 -- 172.21.15.80:0/352886476 shutdown_connections 2019-11-28T11:53:47.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.548+0000 7f498bd5f700 1 --2- 172.21.15.80:0/352886476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f498406c490 0x7f498406c920 unknown :-1 s=CLOSED pgs=2423 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:47.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.548+0000 7f498bd5f700 1 -- 172.21.15.80:0/352886476 shutdown_connections 2019-11-28T11:53:47.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.548+0000 7f498bd5f700 1 -- 172.21.15.80:0/352886476 wait complete. 2019-11-28T11:53:47.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.548+0000 7f498bd5f700 1 -- 172.21.15.80:0/352886476 >> 172.21.15.80:0/352886476 conn(0x7f4984061cf0 msgr2=0x7f4984064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:47.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.550+0000 7f498bd5f700 1 Processor -- start 2019-11-28T11:53:47.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.550+0000 7f498bd5f700 1 -- start start 2019-11-28T11:53:47.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f498bd5f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f498412cea0 0x7f4984111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:47.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f498bd5f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4984165a00 0x7f4984167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:47.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f498bd5f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4984124260 con 0x7f49841230e0 2019-11-28T11:53:47.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f498bd5f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4984120610 con 0x7f4984165a00 2019-11-28T11:53:47.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f498bd5f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4984121040 con 0x7f498412cea0 2019-11-28T11:53:47.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f498a2fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f498412cea0 0x7f4984111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:47.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f498a2fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f498412cea0 0x7f4984111db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:46540/0 (socket says 172.21.15.80:46540) 2019-11-28T11:53:47.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f498a2fc700 1 -- 172.21.15.80:0/1756159201 learned_addr learned my addr 172.21.15.80:0/1756159201 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:47.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f498aafd700 1 --2- 172.21.15.80:0/1756159201 >> v2:172.21.15.80:3300/0 conn(0x7f4984165a00 0x7f4984167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:47.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f498a2fc700 1 -- 172.21.15.80:0/1756159201 >> v2:172.21.15.80:3300/0 conn(0x7f4984165a00 msgr2=0x7f4984167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:47.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f498a2fc700 1 --2- 172.21.15.80:0/1756159201 >> v2:172.21.15.80:3300/0 conn(0x7f4984165a00 0x7f4984167e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:47.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f498a2fc700 1 -- 172.21.15.80:0/1756159201 >> v1:172.21.15.174:6789/0 conn(0x7f49841230e0 legacy=0x7f4984123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:47.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f498a2fc700 1 -- 172.21.15.80:0/1756159201 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49841219a0 con 0x7f498412cea0 2019-11-28T11:53:47.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f498a2fc700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f498412cea0 0x7f4984111db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4980010760 tx=0x7f49800105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f498a2fc700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f498412cea0 0x7f4984111db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4980010760 tx=0x7f49800105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f498a2fc700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f498412cea0 0x7f4984111db0 secure :-1 s=READY pgs=344 cs=0 l=1 rx=0x7f4980010760 tx=0x7f49800105e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:47.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f498a2fc700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f498412cea0 0x7f4984111db0 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f4980010760 tx=0x7f49800105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f497affd700 1 -- 172.21.15.80:0/1756159201 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4980007920 con 0x7f498412cea0 2019-11-28T11:53:47.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f498a2fc700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f498412cea0 0x7f4984111db0 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f4980010760 tx=0x7f49800105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f498a2fc700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f498412cea0 0x7f4984111db0 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f4980010760 tx=0x7f49800105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f497affd700 1 -- 172.21.15.80:0/1756159201 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4980001200 con 0x7f498412cea0 2019-11-28T11:53:47.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f498bd5f700 1 -- 172.21.15.80:0/1756159201 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4984121d20 con 0x7f498412cea0 2019-11-28T11:53:47.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f497affd700 1 -- 172.21.15.80:0/1756159201 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4980001950 con 0x7f498412cea0 2019-11-28T11:53:47.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f498bd5f700 1 -- 172.21.15.80:0/1756159201 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49841122f0 con 0x7f498412cea0 2019-11-28T11:53:47.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f498a2fc700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f498412cea0 0x7f4984111db0 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f4980010760 tx=0x7f49800105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.553+0000 7f497affd700 1 -- 172.21.15.80:0/1756159201 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f49800013f0 con 0x7f498412cea0 2019-11-28T11:53:47.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.553+0000 7f498a2fc700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f498412cea0 0x7f4984111db0 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f4980010760 tx=0x7f49800105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.553+0000 7f497affd700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f496c018730 0x7f496c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:47.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.553+0000 7f497affd700 1 -- 172.21.15.80:0/1756159201 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f4980032050 con 0x7f498412cea0 2019-11-28T11:53:47.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.553+0000 7f4989afb700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f496c018730 0x7f496c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:47.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.553+0000 7f4989afb700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f496c018730 0x7f496c01abe0 crc :-1 s=READY pgs=994 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:47.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.559+0000 7f498bd5f700 1 -- 172.21.15.80:0/1756159201 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49841219a0 con 0x7f498412cea0 2019-11-28T11:53:47.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.564+0000 7f498a2fc700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f498412cea0 0x7f4984111db0 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f4980010760 tx=0x7f49800105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.564+0000 7f497affd700 1 -- 172.21.15.80:0/1756159201 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4980001c30 con 0x7f498412cea0 2019-11-28T11:53:47.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.544+0000 7f1548659700 1 Processor -- start 2019-11-28T11:53:47.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.544+0000 7f1548659700 1 -- start start 2019-11-28T11:53:47.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7f1548659700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f154006c0a0 0x7f1540072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:47.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7f1548659700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1540072620 0x7f1540164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:47.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7f1548659700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154006db00 con 0x7f15400734e0 2019-11-28T11:53:47.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7f1548659700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154006fd60 con 0x7f1540072620 2019-11-28T11:53:47.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7f1548659700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1540070030 con 0x7f154006c0a0 2019-11-28T11:53:47.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7f15473f7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1540072620 0x7f1540164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:47.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7f15463f5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f15400734e0 0x7f1540071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43584/0 (socket says 172.21.15.80:43584) 2019-11-28T11:53:47.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7f15463f5700 1 -- 172.21.15.80:0/2867247344 learned_addr learned my addr 172.21.15.80:0/2867247344 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:47.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.545+0000 7f1546bf6700 1 --2- 172.21.15.80:0/2867247344 >> v2:172.21.15.174:3300/0 conn(0x7f154006c0a0 0x7f1540072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:47.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f1545bf4700 1 -- 172.21.15.80:0/2867247344 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431974473 0 0) 0x7f1534001150 con 0x7f15400734e0 2019-11-28T11:53:47.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f15473f7700 1 -- 172.21.15.80:0/2867247344 >> v2:172.21.15.174:3300/0 conn(0x7f154006c0a0 msgr2=0x7f1540072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:47.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f15473f7700 1 --2- 172.21.15.80:0/2867247344 >> v2:172.21.15.174:3300/0 conn(0x7f154006c0a0 0x7f1540072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:47.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f15473f7700 1 -- 172.21.15.80:0/2867247344 >> v1:172.21.15.80:6789/0 conn(0x7f15400734e0 legacy=0x7f1540071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:47.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f15473f7700 1 -- 172.21.15.80:0/2867247344 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15400706c0 con 0x7f1540072620 2019-11-28T11:53:47.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f15473f7700 1 --2- 172.21.15.80:0/2867247344 >> v2:172.21.15.80:3300/0 conn(0x7f1540072620 0x7f1540164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f153800af50 tx=0x7f153800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f15473f7700 1 --2- 172.21.15.80:0/2867247344 >> v2:172.21.15.80:3300/0 conn(0x7f1540072620 0x7f1540164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f153800af50 tx=0x7f153800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f15473f7700 1 --2- 172.21.15.80:0/2867247344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1540072620 0x7f1540164d70 secure :-1 s=READY pgs=2422 cs=0 l=1 rx=0x7f153800af50 tx=0x7f153800b250).ready entity=mon.0 client_cookie=69de4f275cc5ccc2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:47.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f15473f7700 1 --2- 172.21.15.80:0/2867247344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1540072620 0x7f1540164d70 secure :-1 s=THROTTLE_DONE pgs=2422 cs=0 l=1 rx=0x7f153800af50 tx=0x7f153800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f1545bf4700 1 -- 172.21.15.80:0/2867247344 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1538009ba0 con 0x7f1540072620 2019-11-28T11:53:47.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f15473f7700 1 --2- 172.21.15.80:0/2867247344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1540072620 0x7f1540164d70 secure :-1 s=THROTTLE_DONE pgs=2422 cs=0 l=1 rx=0x7f153800af50 tx=0x7f153800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f1545bf4700 1 -- 172.21.15.80:0/2867247344 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1538000b90 con 0x7f1540072620 2019-11-28T11:53:47.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.546+0000 7f15473f7700 1 --2- 172.21.15.80:0/2867247344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1540072620 0x7f1540164d70 secure :-1 s=THROTTLE_DONE pgs=2422 cs=0 l=1 rx=0x7f153800af50 tx=0x7f153800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.547+0000 7f1545bf4700 1 -- 172.21.15.80:0/2867247344 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1538009ba0 con 0x7f1540072620 2019-11-28T11:53:47.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.547+0000 7f1548659700 1 -- 172.21.15.80:0/2867247344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1540072620 msgr2=0x7f1540164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:47.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.547+0000 7f1548659700 1 --2- 172.21.15.80:0/2867247344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1540072620 0x7f1540164d70 secure :-1 s=READY pgs=2422 cs=0 l=1 rx=0x7f153800af50 tx=0x7f153800b250).stop 2019-11-28T11:53:47.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.547+0000 7f1548659700 1 -- 172.21.15.80:0/2867247344 shutdown_connections 2019-11-28T11:53:47.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.547+0000 7f1548659700 1 --2- 172.21.15.80:0/2867247344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1540072620 0x7f1540164d70 unknown :-1 s=CLOSED pgs=2422 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:47.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.547+0000 7f1548659700 1 --2- 172.21.15.80:0/2867247344 >> v2:172.21.15.174:3300/0 conn(0x7f154006c0a0 0x7f1540072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:47.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.548+0000 7f1548659700 1 -- 172.21.15.80:0/2867247344 shutdown_connections 2019-11-28T11:53:47.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.548+0000 7f1548659700 1 -- 172.21.15.80:0/2867247344 wait complete. 2019-11-28T11:53:47.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.548+0000 7f1548659700 1 -- 172.21.15.80:0/2867247344 >> 172.21.15.80:0/2867247344 conn(0x7f1540061cf0 msgr2=0x7f1540064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:47.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.550+0000 7f1548659700 1 Processor -- start 2019-11-28T11:53:47.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.550+0000 7f1548659700 1 -- start start 2019-11-28T11:53:47.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f1548659700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f154015d7c0 0x7f154012e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:47.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f1548659700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1540159970 0x7f1540158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:47.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f1548659700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1540112260 con 0x7f1540159e00 2019-11-28T11:53:47.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f1548659700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1540140ff0 con 0x7f1540159970 2019-11-28T11:53:47.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f1548659700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15401412c0 con 0x7f154015d7c0 2019-11-28T11:53:47.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f1546bf6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f154015d7c0 0x7f154012e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:47.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f1546bf6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f154015d7c0 0x7f154012e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:59172/0 (socket says 172.21.15.80:59172) 2019-11-28T11:53:47.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f1546bf6700 1 -- 172.21.15.80:0/233451677 learned_addr learned my addr 172.21.15.80:0/233451677 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:47.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f15463f5700 1 --2- 172.21.15.80:0/233451677 >> v2:172.21.15.80:3300/0 conn(0x7f1540159970 0x7f1540158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:47.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f1546bf6700 1 -- 172.21.15.80:0/233451677 >> v2:172.21.15.80:3300/0 conn(0x7f1540159970 msgr2=0x7f1540158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:47.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f1546bf6700 1 --2- 172.21.15.80:0/233451677 >> v2:172.21.15.80:3300/0 conn(0x7f1540159970 0x7f1540158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:47.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.551+0000 7f1546bf6700 1 -- 172.21.15.80:0/233451677 >> v1:172.21.15.80:6789/0 conn(0x7f1540159e00 legacy=0x7f1540158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f1546bf6700 1 -- 172.21.15.80:0/233451677 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1540141950 con 0x7f154015d7c0 2019-11-28T11:53:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f1546bf6700 1 --2- 172.21.15.80:0/233451677 >> v2:172.21.15.174:3300/0 conn(0x7f154015d7c0 0x7f154012e690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15300107d0 tx=0x7f1530010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f1546bf6700 1 --2- 172.21.15.80:0/233451677 >> v2:172.21.15.174:3300/0 conn(0x7f154015d7c0 0x7f154012e690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15300107d0 tx=0x7f1530010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f1546bf6700 1 --2- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f154015d7c0 0x7f154012e690 secure :-1 s=READY pgs=1457 cs=0 l=1 rx=0x7f15300107d0 tx=0x7f1530010600).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:47.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f1546bf6700 1 --2- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f154015d7c0 0x7f154012e690 secure :-1 s=THROTTLE_DONE pgs=1457 cs=0 l=1 rx=0x7f15300107d0 tx=0x7f1530010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f153f7fe700 1 -- 172.21.15.80:0/233451677 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1530000cc0 con 0x7f154015d7c0 2019-11-28T11:53:47.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f1546bf6700 1 --2- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f154015d7c0 0x7f154012e690 secure :-1 s=THROTTLE_DONE pgs=1457 cs=0 l=1 rx=0x7f15300107d0 tx=0x7f1530010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f1546bf6700 1 --2- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f154015d7c0 0x7f154012e690 secure :-1 s=THROTTLE_DONE pgs=1457 cs=0 l=1 rx=0x7f15300107d0 tx=0x7f1530010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f153f7fe700 1 -- 172.21.15.80:0/233451677 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1530008c70 con 0x7f154015d7c0 2019-11-28T11:53:47.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f153f7fe700 1 -- 172.21.15.80:0/233451677 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1530009340 con 0x7f154015d7c0 2019-11-28T11:53:47.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f1548659700 1 -- 172.21.15.80:0/233451677 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1540141cd0 con 0x7f154015d7c0 2019-11-28T11:53:47.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f1548659700 1 -- 172.21.15.80:0/233451677 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1540141950 con 0x7f154015d7c0 2019-11-28T11:53:47.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.552+0000 7f1546bf6700 1 --2- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f154015d7c0 0x7f154012e690 secure :-1 s=THROTTLE_DONE pgs=1457 cs=0 l=1 rx=0x7f15300107d0 tx=0x7f1530010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.553+0000 7f1546bf6700 1 --2- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f154015d7c0 0x7f154012e690 secure :-1 s=THROTTLE_DONE pgs=1457 cs=0 l=1 rx=0x7f15300107d0 tx=0x7f1530010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.553+0000 7f153f7fe700 1 -- 172.21.15.80:0/233451677 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1530008870 con 0x7f154015d7c0 2019-11-28T11:53:47.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.553+0000 7f153f7fe700 1 --2- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1520018730 0x7f152001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:47.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.553+0000 7f153f7fe700 1 -- 172.21.15.80:0/233451677 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f1530032120 con 0x7f154015d7c0 2019-11-28T11:53:47.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.553+0000 7f15463f5700 1 --2- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1520018730 0x7f152001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:47.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.553+0000 7f15463f5700 1 --2- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1520018730 0x7f152001abc0 crc :-1 s=READY pgs=995 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:47.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.559+0000 7f1548659700 1 -- 172.21.15.80:0/233451677 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1540141cd0 con 0x7f154015d7c0 2019-11-28T11:53:47.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.563+0000 7f1546bf6700 1 --2- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f154015d7c0 0x7f154012e690 secure :-1 s=THROTTLE_DONE pgs=1457 cs=0 l=1 rx=0x7f15300107d0 tx=0x7f1530010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.563+0000 7f153f7fe700 1 -- 172.21.15.80:0/233451677 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1530000cc0 con 0x7f154015d7c0 2019-11-28T11:53:47.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.553+0000 7ff601caa700 1 -- 172.21.15.80:0/422245731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5fc137df0 con 0x7ff5fc077040 2019-11-28T11:53:47.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.556+0000 7ff5fbfff700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc077040 0x7ff5fc1574c0 secure :-1 s=THROTTLE_DONE pgs=2419 cs=0 l=1 rx=0x7ff5ec010450 tx=0x7ff5ec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:47.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.557+0000 7ff5f97fa700 1 -- 172.21.15.80:0/422245731 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff5ec0060a0 con 0x7ff5fc077040 2019-11-28T11:53:47.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.744+0000 7ff601caa700 1 -- 172.21.15.80:0/422245731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7ff5fc137a70 con 0x7ff5fc077040 2019-11-28T11:53:47.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.752+0000 7f498bd5f700 1 -- 172.21.15.80:0/1756159201 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f4984121d20 con 0x7f498412cea0 2019-11-28T11:53:47.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.752+0000 7f1548659700 1 -- 172.21.15.80:0/233451677 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f1540141950 con 0x7f154015d7c0 2019-11-28T11:53:47.977 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:53:47.923+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:53:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.931+0000 7ff5fbfff700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc077040 0x7ff5fc1574c0 secure :-1 s=THROTTLE_DONE pgs=2419 cs=0 l=1 rx=0x7ff5ec010450 tx=0x7ff5ec010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.931+0000 7ff5f97fa700 1 -- 172.21.15.80:0/422245731 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7259 v146) v1 ==== 95+0+0 (secure 0 0 0) 0x7ff5ec005180 con 0x7ff5fc077040 2019-11-28T11:53:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 7259 2019-11-28T11:53:48.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.931+0000 7f498a2fc700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f498412cea0 0x7f4984111db0 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f4980010760 tx=0x7f49800105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.931+0000 7f497affd700 1 -- 172.21.15.80:0/1756159201 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 10030 v146) v1 ==== 96+0+0 (secure 0 0 0) 0x7f4980001200 con 0x7f498412cea0 2019-11-28T11:53:48.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.931+0000 7f1546bf6700 1 --2- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f154015d7c0 0x7f154012e690 secure :-1 s=THROTTLE_DONE pgs=1457 cs=0 l=1 rx=0x7f15300107d0 tx=0x7f1530010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.931+0000 7f153f7fe700 1 -- 172.21.15.80:0/233451677 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 10701 v146) v1 ==== 96+0+0 (secure 0 0 0) 0x7f1530008870 con 0x7f154015d7c0 2019-11-28T11:53:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.960+0000 7ff601caa700 1 -- 172.21.15.80:0/422245731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5e0018730 msgr2=0x7ff5e001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.960+0000 7ff601caa700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5e0018730 0x7ff5e001abc0 crc :-1 s=READY pgs=993 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.960+0000 7ff601caa700 1 -- 172.21.15.80:0/422245731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc077040 msgr2=0x7ff5fc1574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.960+0000 7ff601caa700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc077040 0x7ff5fc1574c0 secure :-1 s=READY pgs=2419 cs=0 l=1 rx=0x7ff5ec010450 tx=0x7ff5ec010280).stop 2019-11-28T11:53:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.960+0000 7ff601caa700 1 -- 172.21.15.80:0/422245731 shutdown_connections 2019-11-28T11:53:48.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.960+0000 7ff601caa700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5e0018730 0x7ff5e001abc0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.960+0000 7ff601caa700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5fc157a00 0x7ff5fc074a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.960+0000 7ff601caa700 1 --2- 172.21.15.80:0/422245731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc077040 0x7ff5fc1574c0 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.960+0000 7ff601caa700 1 -- 172.21.15.80:0/422245731 shutdown_connections 2019-11-28T11:53:48.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.960+0000 7ff601caa700 1 -- 172.21.15.80:0/422245731 wait complete. 2019-11-28T11:53:48.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.960+0000 7ff601caa700 1 -- 172.21.15.80:0/422245731 >> 172.21.15.80:0/422245731 conn(0x7ff5fc13fa50 msgr2=0x7ff5fc07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:48.020 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 10030 2019-11-28T11:53:48.020 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 10701 2019-11-28T11:53:48.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f498bd5f700 1 -- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f496c018730 msgr2=0x7f496c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f498bd5f700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f496c018730 0x7f496c01abe0 crc :-1 s=READY pgs=994 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f498bd5f700 1 -- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f498412cea0 msgr2=0x7f4984111db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f498bd5f700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f498412cea0 0x7f4984111db0 secure :-1 s=READY pgs=344 cs=0 l=1 rx=0x7f4980010760 tx=0x7f49800105e0).stop 2019-11-28T11:53:48.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f498bd5f700 1 -- 172.21.15.80:0/1756159201 shutdown_connections 2019-11-28T11:53:48.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f498bd5f700 1 --2- 172.21.15.80:0/1756159201 >> v2:172.21.15.80:3300/0 conn(0x7f4984165a00 0x7f4984167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f498bd5f700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f496c018730 0x7f496c01abe0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f498bd5f700 1 --2- 172.21.15.80:0/1756159201 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f498412cea0 0x7f4984111db0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f498bd5f700 1 -- 172.21.15.80:0/1756159201 shutdown_connections 2019-11-28T11:53:48.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f498bd5f700 1 -- 172.21.15.80:0/1756159201 wait complete. 2019-11-28T11:53:48.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f498bd5f700 1 -- 172.21.15.80:0/1756159201 >> 172.21.15.80:0/1756159201 conn(0x7f49841426c0 msgr2=0x7f4984110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:48.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f1548659700 1 -- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1520018730 msgr2=0x7f152001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f1548659700 1 --2- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1520018730 0x7f152001abc0 crc :-1 s=READY pgs=995 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f1548659700 1 -- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f154015d7c0 msgr2=0x7f154012e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f1548659700 1 --2- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f154015d7c0 0x7f154012e690 secure :-1 s=READY pgs=1457 cs=0 l=1 rx=0x7f15300107d0 tx=0x7f1530010600).stop 2019-11-28T11:53:48.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f1548659700 1 -- 172.21.15.80:0/233451677 shutdown_connections 2019-11-28T11:53:48.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f1548659700 1 --2- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1520018730 0x7f152001abc0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f1548659700 1 --2- 172.21.15.80:0/233451677 >> v2:172.21.15.80:3300/0 conn(0x7f1540159970 0x7f1540158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f1548659700 1 --2- 172.21.15.80:0/233451677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f154015d7c0 0x7f154012e690 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f1548659700 1 -- 172.21.15.80:0/233451677 shutdown_connections 2019-11-28T11:53:48.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f1548659700 1 -- 172.21.15.80:0/233451677 wait complete. 2019-11-28T11:53:48.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:47.968+0000 7f1548659700 1 -- 172.21.15.80:0/233451677 >> 172.21.15.80:0/233451677 conn(0x7f154013b860 msgr2=0x7f15401050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:48.028 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:53:48.033 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:53:48.034 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:53:48.034 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:53:48.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.164+0000 7f22a61b4700 1 Processor -- start 2019-11-28T11:53:48.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.164+0000 7f22a61b4700 1 -- start start 2019-11-28T11:53:48.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.165+0000 7f22a61b4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22a006c0a0 0x7f22a0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:48.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.165+0000 7f22a61b4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a006db00 con 0x7f22a00734e0 2019-11-28T11:53:48.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.165+0000 7f22a61b4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a006e000 con 0x7f22a0072620 2019-11-28T11:53:48.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.165+0000 7f22a61b4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a006f330 con 0x7f22a006c0a0 2019-11-28T11:53:48.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.165+0000 7f2297fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f22a00734e0 0x7f22a0071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43612/0 (socket says 172.21.15.80:43612) 2019-11-28T11:53:48.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f2297fff700 1 -- 172.21.15.80:0/522468199 learned_addr learned my addr 172.21.15.80:0/522468199 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:48.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229ffff700 1 --2- 172.21.15.80:0/522468199 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22a006c0a0 0x7f22a0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:48.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229f7fe700 1 -- 172.21.15.80:0/522468199 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262142985 0 0) 0x7f2288001150 con 0x7f22a00734e0 2019-11-28T11:53:48.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229f7fe700 1 -- 172.21.15.80:0/522468199 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f228c002e80 con 0x7f22a00734e0 2019-11-28T11:53:48.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229f7fe700 1 -- 172.21.15.80:0/522468199 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558948298 0 0) 0x7f2298001400 con 0x7f22a0072620 2019-11-28T11:53:48.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229f7fe700 1 -- 172.21.15.80:0/522468199 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f228c0030b0 con 0x7f22a0072620 2019-11-28T11:53:48.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229ffff700 1 -- 172.21.15.80:0/522468199 >> v1:172.21.15.174:6789/0 conn(0x7f22a0072620 legacy=0x7f22a0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229ffff700 1 -- 172.21.15.80:0/522468199 >> v1:172.21.15.80:6789/0 conn(0x7f22a00734e0 legacy=0x7f22a0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229ffff700 1 -- 172.21.15.80:0/522468199 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a00706c0 con 0x7f22a006c0a0 2019-11-28T11:53:48.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229ffff700 1 --2- 172.21.15.80:0/522468199 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22a006c0a0 0x7f22a0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f229000af50 tx=0x7f229000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229ffff700 1 --2- 172.21.15.80:0/522468199 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22a006c0a0 0x7f22a0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f229000af50 tx=0x7f229000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229ffff700 1 --2- 172.21.15.80:0/522468199 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22a006c0a0 0x7f22a0072fa0 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7f229000af50 tx=0x7f229000b760).ready entity=mon.2 client_cookie=ac3503aee8385b6b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:48.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229ffff700 1 --2- 172.21.15.80:0/522468199 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22a006c0a0 0x7f22a0072fa0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f229000af50 tx=0x7f229000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229f7fe700 1 -- 172.21.15.80:0/522468199 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2290000960 con 0x7f22a006c0a0 2019-11-28T11:53:48.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229ffff700 1 --2- 172.21.15.80:0/522468199 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22a006c0a0 0x7f22a0072fa0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f229000af50 tx=0x7f229000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229f7fe700 1 -- 172.21.15.80:0/522468199 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2290009860 con 0x7f22a006c0a0 2019-11-28T11:53:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229ffff700 1 --2- 172.21.15.80:0/522468199 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22a006c0a0 0x7f22a0072fa0 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f229000af50 tx=0x7f229000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f229f7fe700 1 -- 172.21.15.80:0/522468199 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2290000960 con 0x7f22a006c0a0 2019-11-28T11:53:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f22a61b4700 1 -- 172.21.15.80:0/522468199 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22a006c0a0 msgr2=0x7f22a0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.166+0000 7f22a61b4700 1 --2- 172.21.15.80:0/522468199 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22a006c0a0 0x7f22a0072fa0 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7f229000af50 tx=0x7f229000b760).stop 2019-11-28T11:53:48.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.167+0000 7f22a61b4700 1 -- 172.21.15.80:0/522468199 shutdown_connections 2019-11-28T11:53:48.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.167+0000 7f22a61b4700 1 --2- 172.21.15.80:0/522468199 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22a006c0a0 0x7f22a0072fa0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.167+0000 7f22a61b4700 1 -- 172.21.15.80:0/522468199 shutdown_connections 2019-11-28T11:53:48.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.167+0000 7f22a61b4700 1 -- 172.21.15.80:0/522468199 wait complete. 2019-11-28T11:53:48.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.167+0000 7f22a61b4700 1 -- 172.21.15.80:0/522468199 >> 172.21.15.80:0/522468199 conn(0x7f22a0061cf0 msgr2=0x7f22a0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:48.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.169+0000 7f22a61b4700 1 Processor -- start 2019-11-28T11:53:48.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.169+0000 7f22a61b4700 1 -- start start 2019-11-28T11:53:48.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.170+0000 7f22a61b4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f22a012b7b0 0x7f22a012bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.170+0000 7f22a61b4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22a0075cb0 0x7f22a015b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.170+0000 7f22a61b4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a0106f00 con 0x7f22a015bdb0 2019-11-28T11:53:48.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.170+0000 7f22a61b4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a0073c10 con 0x7f22a012b7b0 2019-11-28T11:53:48.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.170+0000 7f22a61b4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a0073ee0 con 0x7f22a0075cb0 2019-11-28T11:53:48.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.170+0000 7f229ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f22a012b7b0 0x7f22a012bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:48.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.170+0000 7f229ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f22a012b7b0 0x7f22a012bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44302/0 (socket says 172.21.15.80:44302) 2019-11-28T11:53:48.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.170+0000 7f229ffff700 1 -- 172.21.15.80:0/2809814443 learned_addr learned my addr 172.21.15.80:0/2809814443 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:48.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f2297fff700 1 --2- 172.21.15.80:0/2809814443 >> v2:172.21.15.174:3300/0 conn(0x7f22a0075cb0 0x7f22a015b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:48.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f229ffff700 1 -- 172.21.15.80:0/2809814443 >> v2:172.21.15.174:3300/0 conn(0x7f22a0075cb0 msgr2=0x7f22a015b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f229ffff700 1 --2- 172.21.15.80:0/2809814443 >> v2:172.21.15.174:3300/0 conn(0x7f22a0075cb0 0x7f22a015b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f229ffff700 1 -- 172.21.15.80:0/2809814443 >> v1:172.21.15.174:6789/0 conn(0x7f22a015bdb0 legacy=0x7f22a012e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f229ffff700 1 -- 172.21.15.80:0/2809814443 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a0074570 con 0x7f22a012b7b0 2019-11-28T11:53:48.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f2297fff700 1 --2- 172.21.15.80:0/2809814443 >> v2:172.21.15.174:3300/0 conn(0x7f22a0075cb0 0x7f22a015b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:53:48.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f229ffff700 1 --2- 172.21.15.80:0/2809814443 >> v2:172.21.15.80:3300/0 conn(0x7f22a012b7b0 0x7f22a012bba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2290010400 tx=0x7f22900107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f229ffff700 1 --2- 172.21.15.80:0/2809814443 >> v2:172.21.15.80:3300/0 conn(0x7f22a012b7b0 0x7f22a012bba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2290010400 tx=0x7f22900107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f229ffff700 1 --2- 172.21.15.80:0/2809814443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a012b7b0 0x7f22a012bba0 secure :-1 s=READY pgs=2426 cs=0 l=1 rx=0x7f2290010400 tx=0x7f22900107a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:48.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f229ffff700 1 --2- 172.21.15.80:0/2809814443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a012b7b0 0x7f22a012bba0 secure :-1 s=THROTTLE_DONE pgs=2426 cs=0 l=1 rx=0x7f2290010400 tx=0x7f22900107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f229d7fa700 1 -- 172.21.15.80:0/2809814443 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2290000940 con 0x7f22a012b7b0 2019-11-28T11:53:48.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f229ffff700 1 --2- 172.21.15.80:0/2809814443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a012b7b0 0x7f22a012bba0 secure :-1 s=THROTTLE_DONE pgs=2426 cs=0 l=1 rx=0x7f2290010400 tx=0x7f22900107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f229ffff700 1 --2- 172.21.15.80:0/2809814443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a012b7b0 0x7f22a012bba0 secure :-1 s=THROTTLE_DONE pgs=2426 cs=0 l=1 rx=0x7f2290010400 tx=0x7f22900107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f229d7fa700 1 -- 172.21.15.80:0/2809814443 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2290009980 con 0x7f22a012b7b0 2019-11-28T11:53:48.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f22a61b4700 1 -- 172.21.15.80:0/2809814443 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a00748f0 con 0x7f22a012b7b0 2019-11-28T11:53:48.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f229d7fa700 1 -- 172.21.15.80:0/2809814443 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2290000940 con 0x7f22a012b7b0 2019-11-28T11:53:48.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f22a61b4700 1 -- 172.21.15.80:0/2809814443 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a0074570 con 0x7f22a012b7b0 2019-11-28T11:53:48.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.171+0000 7f229ffff700 1 --2- 172.21.15.80:0/2809814443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a012b7b0 0x7f22a012bba0 secure :-1 s=THROTTLE_DONE pgs=2426 cs=0 l=1 rx=0x7f2290010400 tx=0x7f22900107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.172+0000 7f229d7fa700 1 -- 172.21.15.80:0/2809814443 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2290009580 con 0x7f22a012b7b0 2019-11-28T11:53:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.172+0000 7f229ffff700 1 --2- 172.21.15.80:0/2809814443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a012b7b0 0x7f22a012bba0 secure :-1 s=THROTTLE_DONE pgs=2426 cs=0 l=1 rx=0x7f2290010400 tx=0x7f22900107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.172+0000 7f229d7fa700 1 --2- 172.21.15.80:0/2809814443 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2284018730 0x7f228401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.172+0000 7f229d7fa700 1 -- 172.21.15.80:0/2809814443 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f2290031ad0 con 0x7f22a012b7b0 2019-11-28T11:53:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.172+0000 7f2297fff700 1 --2- 172.21.15.80:0/2809814443 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2284018730 0x7f228401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.172+0000 7f2297fff700 1 --2- 172.21.15.80:0/2809814443 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2284018730 0x7f228401abc0 crc :-1 s=READY pgs=996 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:48.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.179+0000 7f22a61b4700 1 -- 172.21.15.80:0/2809814443 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a00748f0 con 0x7f22a012b7b0 2019-11-28T11:53:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.183+0000 7f229ffff700 1 --2- 172.21.15.80:0/2809814443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a012b7b0 0x7f22a012bba0 secure :-1 s=THROTTLE_DONE pgs=2426 cs=0 l=1 rx=0x7f2290010400 tx=0x7f22900107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.183+0000 7f229d7fa700 1 -- 172.21.15.80:0/2809814443 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2290000940 con 0x7f22a012b7b0 2019-11-28T11:53:48.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.359+0000 7f22a61b4700 1 -- 172.21.15.80:0/2809814443 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f22a0074570 con 0x7f22a012b7b0 2019-11-28T11:53:48.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.360+0000 7f229ffff700 1 --2- 172.21.15.80:0/2809814443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a012b7b0 0x7f22a012bba0 secure :-1 s=THROTTLE_DONE pgs=2426 cs=0 l=1 rx=0x7f2290010400 tx=0x7f22900107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.360+0000 7f229d7fa700 1 -- 172.21.15.80:0/2809814443 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v183) v1 ==== 81+0+31997 (secure 0 0 0) 0x7f2290009580 con 0x7f22a012b7b0 2019-11-28T11:53:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:48.418 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:53:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 183, 2019-11-28T11:53:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:53:48.418 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:53:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:53:47.760031+0000", 2019-11-28T11:53:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:53:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:53:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:53:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:53:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:53:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:53:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:53:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:53:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:53:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:53:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:53:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:53:48.420 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:53:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:53:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:53:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 29, 2019-11-28T11:53:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:53:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:53:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:53:48.421 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:53:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:53:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:53:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:53:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:53:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:53:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:53:48.422 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:53:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:53:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:53:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:53:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:53:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:53:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:53:48.423 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:53:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:53:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:53:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:53:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:53:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:53:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:53:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:53:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:53:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:53:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:53:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:53:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:53:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:53:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:53:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:53:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:53:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:53:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:53:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:53:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:53:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:53:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:53:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:53:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:53:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:53:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:53:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:53:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:53:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:53:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:53:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:53:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:53:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:53:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:53:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:53:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:53:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:53:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:53:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:53:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:53:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:53:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:53:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:53:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:53:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:53:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:53:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:53:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:53:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:53:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:53:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:53:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 28, 2019-11-28T11:53:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:53:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:52:29.768232+0000", 2019-11-28T11:53:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:53:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:53:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:53:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:53:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:53:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:53:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:53:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:53:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:53:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:53:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:53:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:53:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:53:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:53:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:53:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:53:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:53:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:53:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:53:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:53:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "175", 2019-11-28T11:53:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:53:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:53:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:53:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:53:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:53:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:53:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:53:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:53:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:53:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:53:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:53:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:53:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:53:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:53:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:53:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:53:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:53:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:53:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:53:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:53:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:53:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:53:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:53:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:53:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:53:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:53:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:53:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:53:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:53:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:53:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:53:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:53:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:53:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:53:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:53:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:53:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:53:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:53:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:53:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:53:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:53:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:53:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:53:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:53:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 29, 2019-11-28T11:53:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:53:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:52:30.506393+0000", 2019-11-28T11:53:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:53:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:53:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:53:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:53:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:53:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:53:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:53:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:53:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:53:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:53:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:53:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:53:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:53:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:53:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:53:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:53:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:53:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:53:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:53:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:53:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "176", 2019-11-28T11:53:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:53:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:53:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:53:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:53:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:53:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:53:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:53:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:53:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:53:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:53:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:53:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:53:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:53:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:53:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:53:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:53:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:53:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:53:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:53:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:53:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:53:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:53:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:53:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:53:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:53:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:53:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:53:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:53:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:53:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:53:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:53:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:53:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:53:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:53:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:53:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:53:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:53:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:53:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:53:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:53:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:53:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:53:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:53:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:53:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:53:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:53:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:53:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:53:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:53:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:53:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:53:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:53:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 173, 2019-11-28T11:53:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:53:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:53:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:53:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:53:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:53:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:53:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:53:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:53:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:53:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:53:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:53:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:53:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:53:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:53:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:53:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:53:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:53:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:53:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:53:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:53:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:53:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:53:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:53:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:53:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:53:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:53:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:53:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:53:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:53:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:53:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:53:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:53:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:53:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:53:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:53:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:53:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:53:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:53:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 174, 2019-11-28T11:53:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:53:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:53:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:53:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:53:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:53:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:53:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:53:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:53:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:53:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:53:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:53:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:53:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:53:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:53:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:53:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:53:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:53:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:53:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:53:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:53:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:53:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:53:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:53:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:53:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:53:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:53:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:53:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:53:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:53:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:53:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:53:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:53:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:53:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:53:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:53:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:53:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:53:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:53:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 160, 2019-11-28T11:53:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:53:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:53:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:53:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:53:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:53:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:53:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:53:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:53:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:53:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:53:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:53:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:53:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:53:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:53:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:53:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:53:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:53:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:53:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:53:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:53:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:53:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:53:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:53:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:53:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:53:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:53:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:53:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:53:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:53:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:53:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:53:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:53:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:53:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:53:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:53:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:53:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:53:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:53:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 150, 2019-11-28T11:53:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:53:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:53:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:53:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:53:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:53:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:53:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:53:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:53:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:53:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:53:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:53:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:53:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:53:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:53:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:53:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:53:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:53:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:53:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:53:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:53:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:53:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:53:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:53:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:53:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:53:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:53:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:53:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:53:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:53:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:53:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:53:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:53:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:53:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:53:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:53:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:53:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:53:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:53:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 174, 2019-11-28T11:53:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:53:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:53:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:53:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:53:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:53:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:53:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:53:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:53:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:53:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:53:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:53:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:53:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:53:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:53:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:53:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:53:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:53:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:53:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:53:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:53:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:53:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:53:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:53:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:53:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:53:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:53:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:53:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:53:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:53:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:53:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:53:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:53:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:53:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:53:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:53:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:53:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:53:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:53:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 173, 2019-11-28T11:53:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:53:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:53:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:53:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:53:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:53:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:53:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:53:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:53:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:53:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:53:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:53:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:53:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:53:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:53:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:53:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:53:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:53:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:53:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:53:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:53:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:53:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:53:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:53:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:53:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:53:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:53:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:53:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:53:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:53:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:53:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:53:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:53:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:53:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:53:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:53:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:53:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:53:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:53:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 174, 2019-11-28T11:53:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:53:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:53:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:53:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:53:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:53:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:53:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:53:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:53:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:53:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:53:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:53:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:53:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:53:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:53:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:53:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:53:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:53:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:53:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:53:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:53:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:53:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:53:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:53:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:53:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:53:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:53:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:53:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:53:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:53:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:53:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:53:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:53:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:53:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:53:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:53:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:53:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:53:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:53:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 174, 2019-11-28T11:53:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:53:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:53:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:53:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.547 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:53:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:53:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:53:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:53:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:53:48.550 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.550 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.550 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:53:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:53:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:53:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:53:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:53:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:53:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:53:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:53:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:53:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:53:48.555 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:53:48.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:53:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:53:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:53:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:53:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:53:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:53:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.558 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:53:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:53:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:53:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:53:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:53:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:53:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:53:48.560 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:48.560 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.560 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:53:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:53:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:53:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:53:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:53:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:53:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:53:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:53:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:53:48.563 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:53:48.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:53:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:53:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:53:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:53:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:53:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:53:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:53:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:53:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:53:48.566 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:53:48.566 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:53:48.566 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:53:48.566 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:53:48.566 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:53:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:53:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:53:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:53:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:53:48.568 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:53:48.568 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:53:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:53:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:53:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:53:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:53:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:53:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:53:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:53:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:53:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:53:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:53:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:53:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:53:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:53:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:53:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:53:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:53:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:53:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:53:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:53:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:53:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:53:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:53:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:53:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:53:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:53:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:53:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:53:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:53:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:53:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:53:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:53:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:53:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:53:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:53:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:53:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:53:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:53:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:53:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:53:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:53:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:53:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:53:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6834/777730016": "2019-11-29T11:53:47.744872+0000", 2019-11-28T11:53:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.76:0/2848418618": "2019-11-28T12:53:37.633207+0000", 2019-11-28T11:53:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6832/777730016": "2019-11-29T11:53:47.744872+0000", 2019-11-28T11:53:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/3265178535": "2019-11-29T11:52:41.288215+0000", 2019-11-28T11:53:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/3265178535": "2019-11-29T11:52:41.288215+0000" 2019-11-28T11:53:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:53:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:53:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:53:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:53:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:53:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:53:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:53:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:53:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:53:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:53:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:53:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:53:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:53:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:53:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:53:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:53:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:53:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:53:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:53:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:48.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:48.581 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:53:48.581 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:53:48.581 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:53:48.581 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:53:48.582 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:53:48.582 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:53:48.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.364+0000 7f22a61b4700 1 -- 172.21.15.80:0/2809814443 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2284018730 msgr2=0x7f228401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.364+0000 7f22a61b4700 1 --2- 172.21.15.80:0/2809814443 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2284018730 0x7f228401abc0 crc :-1 s=READY pgs=996 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.364+0000 7f22a61b4700 1 -- 172.21.15.80:0/2809814443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a012b7b0 msgr2=0x7f22a012bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.364+0000 7f22a61b4700 1 --2- 172.21.15.80:0/2809814443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a012b7b0 0x7f22a012bba0 secure :-1 s=READY pgs=2426 cs=0 l=1 rx=0x7f2290010400 tx=0x7f22900107a0).stop 2019-11-28T11:53:48.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.364+0000 7f22a61b4700 1 -- 172.21.15.80:0/2809814443 shutdown_connections 2019-11-28T11:53:48.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.364+0000 7f22a61b4700 1 --2- 172.21.15.80:0/2809814443 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2284018730 0x7f228401abc0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.364+0000 7f22a61b4700 1 --2- 172.21.15.80:0/2809814443 >> v2:172.21.15.174:3300/0 conn(0x7f22a0075cb0 0x7f22a015b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.364+0000 7f22a61b4700 1 --2- 172.21.15.80:0/2809814443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22a012b7b0 0x7f22a012bba0 unknown :-1 s=CLOSED pgs=2426 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.365+0000 7f22a61b4700 1 -- 172.21.15.80:0/2809814443 shutdown_connections 2019-11-28T11:53:48.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.365+0000 7f22a61b4700 1 -- 172.21.15.80:0/2809814443 wait complete. 2019-11-28T11:53:48.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.365+0000 7f22a61b4700 1 -- 172.21.15.80:0/2809814443 >> 172.21.15.80:0/2809814443 conn(0x7f22a013e0e0 msgr2=0x7f22a014fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:48.585 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:48.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.651+0000 7fcfb20b6700 1 Processor -- start 2019-11-28T11:53:48.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.651+0000 7fcfb20b6700 1 -- start start 2019-11-28T11:53:48.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfb20b6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcfac06c490 0x7fcfac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:48.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfb20b6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac06ce60 0x7fcfac164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:48.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfb20b6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfac06db00 con 0x7fcfac06c0a0 2019-11-28T11:53:48.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfb20b6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfac06fd60 con 0x7fcfac06c490 2019-11-28T11:53:48.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfb20b6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac070030 con 0x7fcfac06ce60 2019-11-28T11:53:48.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfabfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcfac06c0a0 0x7fcfac072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43626/0 (socket says 172.21.15.80:43626) 2019-11-28T11:53:48.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfabfff700 1 -- 172.21.15.80:0/1118402717 learned_addr learned my addr 172.21.15.80:0/1118402717 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:48.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfab7fe700 1 --2- 172.21.15.80:0/1118402717 >> v2:172.21.15.174:3300/0 conn(0x7fcfac06c490 0x7fcfac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:48.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfb0e54700 1 --2- 172.21.15.80:0/1118402717 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac06ce60 0x7fcfac164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:48.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfaaffd700 1 -- 172.21.15.80:0/1118402717 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747435563 0 0) 0x7fcf9c001150 con 0x7fcfac06c0a0 2019-11-28T11:53:48.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfaaffd700 1 -- 172.21.15.80:0/1118402717 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf94002e80 con 0x7fcfac06c0a0 2019-11-28T11:53:48.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfab7fe700 1 -- 172.21.15.80:0/1118402717 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac06ce60 msgr2=0x7fcfac164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:48.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfab7fe700 1 --2- 172.21.15.80:0/1118402717 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac06ce60 0x7fcfac164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:48.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfab7fe700 1 -- 172.21.15.80:0/1118402717 >> v1:172.21.15.80:6789/0 conn(0x7fcfac06c0a0 legacy=0x7fcfac072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfab7fe700 1 -- 172.21.15.80:0/1118402717 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac0706c0 con 0x7fcfac06c490 2019-11-28T11:53:48.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfb0e54700 1 --2- 172.21.15.80:0/1118402717 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac06ce60 0x7fcfac164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:48.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfab7fe700 1 --2- 172.21.15.80:0/1118402717 >> v2:172.21.15.174:3300/0 conn(0x7fcfac06c490 0x7fcfac06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcfa000af50 tx=0x7fcfa000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfab7fe700 1 --2- 172.21.15.80:0/1118402717 >> v2:172.21.15.174:3300/0 conn(0x7fcfac06c490 0x7fcfac06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcfa000af50 tx=0x7fcfa000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfab7fe700 1 --2- 172.21.15.80:0/1118402717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfac06c490 0x7fcfac06c920 secure :-1 s=READY pgs=1460 cs=0 l=1 rx=0x7fcfa000af50 tx=0x7fcfa000b760).ready entity=mon.1 client_cookie=cccb835ad70eebdd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:48.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfab7fe700 1 --2- 172.21.15.80:0/1118402717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfac06c490 0x7fcfac06c920 secure :-1 s=THROTTLE_DONE pgs=1460 cs=0 l=1 rx=0x7fcfa000af50 tx=0x7fcfa000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfaaffd700 1 -- 172.21.15.80:0/1118402717 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfa0007210 con 0x7fcfac06c490 2019-11-28T11:53:48.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.652+0000 7fcfab7fe700 1 --2- 172.21.15.80:0/1118402717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfac06c490 0x7fcfac06c920 secure :-1 s=THROTTLE_DONE pgs=1460 cs=0 l=1 rx=0x7fcfa000af50 tx=0x7fcfa000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.653+0000 7fcfab7fe700 1 --2- 172.21.15.80:0/1118402717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfac06c490 0x7fcfac06c920 secure :-1 s=THROTTLE_DONE pgs=1460 cs=0 l=1 rx=0x7fcfa000af50 tx=0x7fcfa000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.653+0000 7fcfaaffd700 1 -- 172.21.15.80:0/1118402717 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa00099b0 con 0x7fcfac06c490 2019-11-28T11:53:48.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.653+0000 7fcfaaffd700 1 -- 172.21.15.80:0/1118402717 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfa000a080 con 0x7fcfac06c490 2019-11-28T11:53:48.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.653+0000 7fcfb20b6700 1 -- 172.21.15.80:0/1118402717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfac06c490 msgr2=0x7fcfac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.653+0000 7fcfb20b6700 1 --2- 172.21.15.80:0/1118402717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfac06c490 0x7fcfac06c920 secure :-1 s=READY pgs=1460 cs=0 l=1 rx=0x7fcfa000af50 tx=0x7fcfa000b760).stop 2019-11-28T11:53:48.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.653+0000 7fcfb20b6700 1 -- 172.21.15.80:0/1118402717 shutdown_connections 2019-11-28T11:53:48.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.653+0000 7fcfb20b6700 1 --2- 172.21.15.80:0/1118402717 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac06ce60 0x7fcfac164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:48.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.653+0000 7fcfb20b6700 1 --2- 172.21.15.80:0/1118402717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfac06c490 0x7fcfac06c920 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.653+0000 7fcfb20b6700 1 -- 172.21.15.80:0/1118402717 shutdown_connections 2019-11-28T11:53:48.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.653+0000 7fcfb20b6700 1 -- 172.21.15.80:0/1118402717 wait complete. 2019-11-28T11:53:48.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.653+0000 7fcfb20b6700 1 -- 172.21.15.80:0/1118402717 >> 172.21.15.80:0/1118402717 conn(0x7fcfac061cf0 msgr2=0x7fcfac064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:48.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.656+0000 7fcfb20b6700 1 Processor -- start 2019-11-28T11:53:48.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.656+0000 7fcfb20b6700 1 -- start start 2019-11-28T11:53:48.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfb20b6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcfac1209a0 0x7fcfac120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:48.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfb20b6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac13a490 0x7fcfac13a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:48.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfb20b6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfac139df0 con 0x7fcfac13e900 2019-11-28T11:53:48.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfb20b6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfac128920 con 0x7fcfac1209a0 2019-11-28T11:53:48.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfb20b6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac13b850 con 0x7fcfac13a490 2019-11-28T11:53:48.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfb0e54700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac13a490 0x7fcfac13a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:48.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfab7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcfac1209a0 0x7fcfac120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:48.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfb0e54700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac13a490 0x7fcfac13a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:46580/0 (socket says 172.21.15.80:46580) 2019-11-28T11:53:48.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfb0e54700 1 -- 172.21.15.80:0/1073132756 learned_addr learned my addr 172.21.15.80:0/1073132756 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:48.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfabfff700 1 --1- 172.21.15.80:0/1073132756 >> v1:172.21.15.174:6789/0 conn(0x7fcfac13e900 0x7fcfac121750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:59176/0 (socket says 172.21.15.80:59176) 2019-11-28T11:53:48.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfb0e54700 1 -- 172.21.15.80:0/1073132756 >> v2:172.21.15.174:3300/0 conn(0x7fcfac1209a0 msgr2=0x7fcfac120e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfb0e54700 1 --2- 172.21.15.80:0/1073132756 >> v2:172.21.15.174:3300/0 conn(0x7fcfac1209a0 0x7fcfac120e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfb0e54700 1 -- 172.21.15.80:0/1073132756 >> v1:172.21.15.174:6789/0 conn(0x7fcfac13e900 legacy=0x7fcfac121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfb0e54700 1 -- 172.21.15.80:0/1073132756 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac128fb0 con 0x7fcfac13a490 2019-11-28T11:53:48.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfa8ff9700 1 -- 172.21.15.80:0/1073132756 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003248398 0 0) 0x7fcf9c000f40 con 0x7fcfac13e900 2019-11-28T11:53:48.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfab7fe700 1 --2- 172.21.15.80:0/1073132756 >> v2:172.21.15.174:3300/0 conn(0x7fcfac1209a0 0x7fcfac120e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:48.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfb0e54700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac13a490 0x7fcfac13a8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcfa40107b0 tx=0x7fcfa4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfb0e54700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac13a490 0x7fcfac13a8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcfa40107b0 tx=0x7fcfa4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.657+0000 7fcfb0e54700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac13a490 0x7fcfac13a8e0 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7fcfa40107b0 tx=0x7fcfa4010b50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:48.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.658+0000 7fcfb0e54700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac13a490 0x7fcfac13a8e0 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7fcfa40107b0 tx=0x7fcfa4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.658+0000 7fcfa8ff9700 1 -- 172.21.15.80:0/1073132756 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfa400add0 con 0x7fcfac13a490 2019-11-28T11:53:48.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.658+0000 7fcfb0e54700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac13a490 0x7fcfac13a8e0 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7fcfa40107b0 tx=0x7fcfa4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.658+0000 7fcfa8ff9700 1 -- 172.21.15.80:0/1073132756 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa4009b20 con 0x7fcfac13a490 2019-11-28T11:53:48.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.658+0000 7fcfb20b6700 1 -- 172.21.15.80:0/1073132756 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfac129330 con 0x7fcfac13a490 2019-11-28T11:53:48.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.658+0000 7fcfb0e54700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac13a490 0x7fcfac13a8e0 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7fcfa40107b0 tx=0x7fcfa4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.658+0000 7fcfa8ff9700 1 -- 172.21.15.80:0/1073132756 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfa400aac0 con 0x7fcfac13a490 2019-11-28T11:53:48.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.658+0000 7fcfb20b6700 1 -- 172.21.15.80:0/1073132756 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfac1281b0 con 0x7fcfac13a490 2019-11-28T11:53:48.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.658+0000 7fcfb0e54700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac13a490 0x7fcfac13a8e0 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7fcfa40107b0 tx=0x7fcfa4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.658+0000 7fcfa8ff9700 1 -- 172.21.15.80:0/1073132756 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcfa4009d10 con 0x7fcfac13a490 2019-11-28T11:53:48.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.658+0000 7fcfb0e54700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac13a490 0x7fcfac13a8e0 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7fcfa40107b0 tx=0x7fcfa4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.658+0000 7fcfa8ff9700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf8c018730 0x7fcf8c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:48.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.658+0000 7fcfa8ff9700 1 -- 172.21.15.80:0/1073132756 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fcfa4031e70 con 0x7fcfac13a490 2019-11-28T11:53:48.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.659+0000 7fcfabfff700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf8c018730 0x7fcf8c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:48.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.659+0000 7fcfabfff700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf8c018730 0x7fcf8c01abc0 crc :-1 s=READY pgs=997 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:48.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.666+0000 7fcfb20b6700 1 -- 172.21.15.80:0/1073132756 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfac128fb0 con 0x7fcfac13a490 2019-11-28T11:53:48.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.670+0000 7fcfb0e54700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac13a490 0x7fcfac13a8e0 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7fcfa40107b0 tx=0x7fcfa4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.670+0000 7fcfa8ff9700 1 -- 172.21.15.80:0/1073132756 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcfa4027d60 con 0x7fcfac13a490 2019-11-28T11:53:48.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.842+0000 7fcfb20b6700 1 -- 172.21.15.80:0/1073132756 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfac129330 con 0x7fcfac13a490 2019-11-28T11:53:48.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.842+0000 7fcfb0e54700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac13a490 0x7fcfac13a8e0 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7fcfa40107b0 tx=0x7fcfa4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:48.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.842+0000 7fcfa8ff9700 1 -- 172.21.15.80:0/1073132756 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 146 v146) v1 ==== 95+0+1432 (secure 0 0 0) 0x7fcfa4027d60 con 0x7fcfac13a490 2019-11-28T11:53:48.898 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 146 2019-11-28T11:53:48.898 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:48.898 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":146,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":146,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:53:47.923731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":181,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:48.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.844+0000 7fcfb20b6700 1 -- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf8c018730 msgr2=0x7fcf8c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.844+0000 7fcfb20b6700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf8c018730 0x7fcf8c01abc0 crc :-1 s=READY pgs=997 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.844+0000 7fcfb20b6700 1 -- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac13a490 msgr2=0x7fcfac13a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:48.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.844+0000 7fcfb20b6700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac13a490 0x7fcfac13a8e0 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7fcfa40107b0 tx=0x7fcfa4010b50).stop 2019-11-28T11:53:48.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.844+0000 7fcfb20b6700 1 -- 172.21.15.80:0/1073132756 shutdown_connections 2019-11-28T11:53:48.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.844+0000 7fcfb20b6700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfac13a490 0x7fcfac13a8e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.844+0000 7fcfb20b6700 1 --2- 172.21.15.80:0/1073132756 >> v2:172.21.15.174:3300/0 conn(0x7fcfac1209a0 0x7fcfac120e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.844+0000 7fcfb20b6700 1 --2- 172.21.15.80:0/1073132756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcf8c018730 0x7fcf8c01abc0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:48.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.845+0000 7fcfb20b6700 1 -- 172.21.15.80:0/1073132756 shutdown_connections 2019-11-28T11:53:48.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.845+0000 7fcfb20b6700 1 -- 172.21.15.80:0/1073132756 wait complete. 2019-11-28T11:53:48.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.845+0000 7fcfb20b6700 1 -- 172.21.15.80:0/1073132756 >> 172.21.15.80:0/1073132756 conn(0x7fcfac127dc0 msgr2=0x7fcfac141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:48.909 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:53:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.979+0000 7f16ce4c0700 1 Processor -- start 2019-11-28T11:53:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.979+0000 7f16ce4c0700 1 -- start start 2019-11-28T11:53:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.980+0000 7f16ce4c0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f16c806c490 0x7f16c806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.980+0000 7f16ce4c0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16c806ce60 0x7f16c8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.980+0000 7f16ce4c0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c806db00 con 0x7f16c806c0a0 2019-11-28T11:53:49.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.980+0000 7f16ce4c0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c806fd60 con 0x7f16c806ce60 2019-11-28T11:53:49.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.980+0000 7f16ce4c0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c8070030 con 0x7f16c806c490 2019-11-28T11:53:49.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.980+0000 7f16cd25e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16c806ce60 0x7f16c8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:49.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.980+0000 7f16cd25e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16c806ce60 0x7f16c8164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44324/0 (socket says 172.21.15.80:44324) 2019-11-28T11:53:49.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.980+0000 7f16cd25e700 1 -- 172.21.15.80:0/183956144 learned_addr learned my addr 172.21.15.80:0/183956144 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.980+0000 7f16c7fff700 1 --2- 172.21.15.80:0/183956144 >> v2:172.21.15.174:3300/0 conn(0x7f16c806c490 0x7f16c806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.981+0000 7f16cd25e700 1 -- 172.21.15.80:0/183956144 >> v2:172.21.15.174:3300/0 conn(0x7f16c806c490 msgr2=0x7f16c806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.981+0000 7f16cd25e700 1 --2- 172.21.15.80:0/183956144 >> v2:172.21.15.174:3300/0 conn(0x7f16c806c490 0x7f16c806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.981+0000 7f16cd25e700 1 -- 172.21.15.80:0/183956144 >> v1:172.21.15.174:6789/0 conn(0x7f16c806c0a0 legacy=0x7f16c8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.981+0000 7f16cd25e700 1 -- 172.21.15.80:0/183956144 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c80706c0 con 0x7f16c806ce60 2019-11-28T11:53:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.981+0000 7f16cd25e700 1 --2- 172.21.15.80:0/183956144 >> v2:172.21.15.80:3300/0 conn(0x7f16c806ce60 0x7f16c8164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f16c000fa30 tx=0x7f16c000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.981+0000 7f16cd25e700 1 --2- 172.21.15.80:0/183956144 >> v2:172.21.15.80:3300/0 conn(0x7f16c806ce60 0x7f16c8164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f16c000fa30 tx=0x7f16c000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.981+0000 7f16cd25e700 1 --2- 172.21.15.80:0/183956144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c806ce60 0x7f16c8164d70 secure :-1 s=READY pgs=2428 cs=0 l=1 rx=0x7f16c000fa30 tx=0x7f16c000fdd0).ready entity=mon.0 client_cookie=77d9905779c242f9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.981+0000 7f16cd25e700 1 --2- 172.21.15.80:0/183956144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c806ce60 0x7f16c8164d70 secure :-1 s=THROTTLE_DONE pgs=2428 cs=0 l=1 rx=0x7f16c000fa30 tx=0x7f16c000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.981+0000 7f16cd25e700 1 --2- 172.21.15.80:0/183956144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c806ce60 0x7f16c8164d70 secure :-1 s=THROTTLE_DONE pgs=2428 cs=0 l=1 rx=0x7f16c000fa30 tx=0x7f16c000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.981+0000 7f16c77fe700 1 -- 172.21.15.80:0/183956144 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16c0000df0 con 0x7f16c806ce60 2019-11-28T11:53:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.981+0000 7f16cd25e700 1 --2- 172.21.15.80:0/183956144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c806ce60 0x7f16c8164d70 secure :-1 s=THROTTLE_DONE pgs=2428 cs=0 l=1 rx=0x7f16c000fa30 tx=0x7f16c000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.981+0000 7f16c77fe700 1 -- 172.21.15.80:0/183956144 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c0001460 con 0x7f16c806ce60 2019-11-28T11:53:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.981+0000 7f16c77fe700 1 -- 172.21.15.80:0/183956144 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16c0001b30 con 0x7f16c806ce60 2019-11-28T11:53:49.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.981+0000 7f16ce4c0700 1 -- 172.21.15.80:0/183956144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c806ce60 msgr2=0x7f16c8164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:49.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.981+0000 7f16ce4c0700 1 --2- 172.21.15.80:0/183956144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c806ce60 0x7f16c8164d70 secure :-1 s=READY pgs=2428 cs=0 l=1 rx=0x7f16c000fa30 tx=0x7f16c000fdd0).stop 2019-11-28T11:53:49.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.982+0000 7f16ce4c0700 1 -- 172.21.15.80:0/183956144 shutdown_connections 2019-11-28T11:53:49.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.982+0000 7f16ce4c0700 1 --2- 172.21.15.80:0/183956144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c806ce60 0x7f16c8164d70 unknown :-1 s=CLOSED pgs=2428 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:49.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.982+0000 7f16ce4c0700 1 --2- 172.21.15.80:0/183956144 >> v2:172.21.15.174:3300/0 conn(0x7f16c806c490 0x7f16c806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:49.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.982+0000 7f16ce4c0700 1 -- 172.21.15.80:0/183956144 shutdown_connections 2019-11-28T11:53:49.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.982+0000 7f16ce4c0700 1 -- 172.21.15.80:0/183956144 wait complete. 2019-11-28T11:53:49.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.982+0000 7f16ce4c0700 1 -- 172.21.15.80:0/183956144 >> 172.21.15.80:0/183956144 conn(0x7f16c8061cf0 msgr2=0x7f16c8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:49.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.984+0000 7f16ce4c0700 1 Processor -- start 2019-11-28T11:53:49.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.984+0000 7f16ce4c0700 1 -- start start 2019-11-28T11:53:49.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16ce4c0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c813dc00 0x7f16c8109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:49.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16ce4c0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f16c810a3a0 0x7f16c8108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:49.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16ce4c0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16c8109220 0x7f16c8109680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:49.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16ce4c0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c8104e00 con 0x7f16c8109220 2019-11-28T11:53:49.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16ce4c0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c8105830 con 0x7f16c810a3a0 2019-11-28T11:53:49.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16ce4c0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8106190 con 0x7f16c813dc00 2019-11-28T11:53:49.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16cd25e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16c8109220 0x7f16c8109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:49.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16cd25e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16c8109220 0x7f16c8109680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44332/0 (socket says 172.21.15.80:44332) 2019-11-28T11:53:49.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16cd25e700 1 -- 172.21.15.80:0/1959598259 learned_addr learned my addr 172.21.15.80:0/1959598259 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:49.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16cca5d700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c813dc00 0x7f16c8109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:49.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16c7fff700 1 --2- 172.21.15.80:0/1959598259 >> v2:172.21.15.174:3300/0 conn(0x7f16c810a3a0 0x7f16c8108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:49.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16cd25e700 1 -- 172.21.15.80:0/1959598259 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c813dc00 msgr2=0x7f16c8109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:49.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16cd25e700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c813dc00 0x7f16c8109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:49.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16cd25e700 1 -- 172.21.15.80:0/1959598259 >> v2:172.21.15.174:3300/0 conn(0x7f16c810a3a0 msgr2=0x7f16c8108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:49.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16cd25e700 1 --2- 172.21.15.80:0/1959598259 >> v2:172.21.15.174:3300/0 conn(0x7f16c810a3a0 0x7f16c8108ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:49.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16cd25e700 1 -- 172.21.15.80:0/1959598259 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c8106510 con 0x7f16c8109220 2019-11-28T11:53:49.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16cd25e700 1 --2- 172.21.15.80:0/1959598259 >> v2:172.21.15.80:3300/0 conn(0x7f16c8109220 0x7f16c8109680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f16c00107d0 tx=0x7f16c00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:49.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16cd25e700 1 --2- 172.21.15.80:0/1959598259 >> v2:172.21.15.80:3300/0 conn(0x7f16c8109220 0x7f16c8109680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f16c00107d0 tx=0x7f16c00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:49.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.985+0000 7f16cd25e700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c8109220 0x7f16c8109680 secure :-1 s=READY pgs=2429 cs=0 l=1 rx=0x7f16c00107d0 tx=0x7f16c00106d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:49.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.986+0000 7f16cd25e700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c8109220 0x7f16c8109680 secure :-1 s=THROTTLE_DONE pgs=2429 cs=0 l=1 rx=0x7f16c00107d0 tx=0x7f16c00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:49.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.986+0000 7f16cd25e700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c8109220 0x7f16c8109680 secure :-1 s=THROTTLE_DONE pgs=2429 cs=0 l=1 rx=0x7f16c00107d0 tx=0x7f16c00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:49.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.986+0000 7f16cd25e700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c8109220 0x7f16c8109680 secure :-1 s=THROTTLE_DONE pgs=2429 cs=0 l=1 rx=0x7f16c00107d0 tx=0x7f16c00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:49.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.986+0000 7f16c57fa700 1 -- 172.21.15.80:0/1959598259 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16c0001910 con 0x7f16c8109220 2019-11-28T11:53:49.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.986+0000 7f16c57fa700 1 -- 172.21.15.80:0/1959598259 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c0001530 con 0x7f16c8109220 2019-11-28T11:53:49.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.986+0000 7f16ce4c0700 1 -- 172.21.15.80:0/1959598259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c8106510 con 0x7f16c8109220 2019-11-28T11:53:49.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.986+0000 7f16c57fa700 1 -- 172.21.15.80:0/1959598259 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16c0001ef0 con 0x7f16c8109220 2019-11-28T11:53:49.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.986+0000 7f16ce4c0700 1 -- 172.21.15.80:0/1959598259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c8106510 con 0x7f16c8109220 2019-11-28T11:53:49.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.986+0000 7f16cd25e700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c8109220 0x7f16c8109680 secure :-1 s=THROTTLE_DONE pgs=2429 cs=0 l=1 rx=0x7f16c00107d0 tx=0x7f16c00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:49.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.986+0000 7f16c57fa700 1 -- 172.21.15.80:0/1959598259 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f16c0001720 con 0x7f16c8109220 2019-11-28T11:53:49.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.986+0000 7f16cd25e700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c8109220 0x7f16c8109680 secure :-1 s=THROTTLE_DONE pgs=2429 cs=0 l=1 rx=0x7f16c00107d0 tx=0x7f16c00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:49.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.986+0000 7f16c57fa700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16ac018730 0x7f16ac01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:49.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.986+0000 7f16c57fa700 1 -- 172.21.15.80:0/1959598259 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f16c0031d90 con 0x7f16c8109220 2019-11-28T11:53:49.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.987+0000 7f16cca5d700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16ac018730 0x7f16ac01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:49.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.987+0000 7f16cca5d700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16ac018730 0x7f16ac01abc0 crc :-1 s=READY pgs=998 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:49.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.994+0000 7f16ce4c0700 1 -- 172.21.15.80:0/1959598259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c8106510 con 0x7f16c8109220 2019-11-28T11:53:49.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.998+0000 7f16cd25e700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c8109220 0x7f16c8109680 secure :-1 s=THROTTLE_DONE pgs=2429 cs=0 l=1 rx=0x7f16c00107d0 tx=0x7f16c00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:49.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:48.998+0000 7f16c57fa700 1 -- 172.21.15.80:0/1959598259 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f16c0027f70 con 0x7f16c8109220 2019-11-28T11:53:49.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:49.163+0000 7f16ce4c0700 1 -- 172.21.15.80:0/1959598259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f16c8106510 con 0x7f16c8109220 2019-11-28T11:53:49.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:49.936+0000 7f16cd25e700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c8109220 0x7f16c8109680 secure :-1 s=THROTTLE_DONE pgs=2429 cs=0 l=1 rx=0x7f16c00107d0 tx=0x7f16c00106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:49.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:49.936+0000 7f16c57fa700 1 -- 172.21.15.80:0/1959598259 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v147) v1 ==== 161+0+0 (secure 0 0 0) 0x7f16c0001720 con 0x7f16c8109220 2019-11-28T11:53:50.033 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:53:50.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:49.981+0000 7f16ce4c0700 1 -- 172.21.15.80:0/1959598259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16ac018730 msgr2=0x7f16ac01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:50.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:49.981+0000 7f16ce4c0700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16ac018730 0x7f16ac01abc0 crc :-1 s=READY pgs=998 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:50.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:49.981+0000 7f16ce4c0700 1 -- 172.21.15.80:0/1959598259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c8109220 msgr2=0x7f16c8109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:50.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:49.981+0000 7f16ce4c0700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c8109220 0x7f16c8109680 secure :-1 s=READY pgs=2429 cs=0 l=1 rx=0x7f16c00107d0 tx=0x7f16c00106d0).stop 2019-11-28T11:53:50.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:49.981+0000 7f16ce4c0700 1 -- 172.21.15.80:0/1959598259 shutdown_connections 2019-11-28T11:53:50.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:49.981+0000 7f16ce4c0700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f16ac018730 0x7f16ac01abc0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:50.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:49.981+0000 7f16ce4c0700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16c8109220 0x7f16c8109680 unknown :-1 s=CLOSED pgs=2429 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:50.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:49.981+0000 7f16ce4c0700 1 --2- 172.21.15.80:0/1959598259 >> v2:172.21.15.174:3300/0 conn(0x7f16c810a3a0 0x7f16c8108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:50.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:49.981+0000 7f16ce4c0700 1 --2- 172.21.15.80:0/1959598259 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16c813dc00 0x7f16c8109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:50.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:49.981+0000 7f16ce4c0700 1 -- 172.21.15.80:0/1959598259 shutdown_connections 2019-11-28T11:53:50.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:49.981+0000 7f16ce4c0700 1 -- 172.21.15.80:0/1959598259 wait complete. 2019-11-28T11:53:50.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:49.981+0000 7f16ce4c0700 1 -- 172.21.15.80:0/1959598259 >> 172.21.15.80:0/1959598259 conn(0x7f16c811bfc0 msgr2=0x7f16c8141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:50.048 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:50.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.117+0000 7fbe777dc700 1 Processor -- start 2019-11-28T11:53:50.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.117+0000 7fbe777dc700 1 -- start start 2019-11-28T11:53:50.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.118+0000 7fbe777dc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe7006c0a0 0x7fbe70072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:50.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.118+0000 7fbe777dc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbe700734e0 0x7fbe70071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:50.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.118+0000 7fbe777dc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe70072360 0x7fbe700727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:50.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.118+0000 7fbe777dc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7006f330 con 0x7fbe70072360 2019-11-28T11:53:50.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.118+0000 7fbe777dc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe700706c0 con 0x7fbe700734e0 2019-11-28T11:53:50.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.118+0000 7fbe777dc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe70070a40 con 0x7fbe7006c0a0 2019-11-28T11:53:50.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.118+0000 7fbe7657a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe70072360 0x7fbe700727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:50.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.118+0000 7fbe7657a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe70072360 0x7fbe700727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44338/0 (socket says 172.21.15.80:44338) 2019-11-28T11:53:50.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.118+0000 7fbe7657a700 1 -- 172.21.15.80:0/66491351 learned_addr learned my addr 172.21.15.80:0/66491351 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:50.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.118+0000 7fbe75578700 1 --2- 172.21.15.80:0/66491351 >> v2:172.21.15.174:3300/0 conn(0x7fbe700734e0 0x7fbe70071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:50.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.118+0000 7fbe75d79700 1 --2- 172.21.15.80:0/66491351 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe7006c0a0 0x7fbe70072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:50.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.119+0000 7fbe7657a700 1 -- 172.21.15.80:0/66491351 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe7006c0a0 msgr2=0x7fbe70072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:50.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.119+0000 7fbe7657a700 1 --2- 172.21.15.80:0/66491351 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe7006c0a0 0x7fbe70072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:50.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.119+0000 7fbe7657a700 1 -- 172.21.15.80:0/66491351 >> v2:172.21.15.174:3300/0 conn(0x7fbe700734e0 msgr2=0x7fbe70071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:50.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.119+0000 7fbe7657a700 1 --2- 172.21.15.80:0/66491351 >> v2:172.21.15.174:3300/0 conn(0x7fbe700734e0 0x7fbe70071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:50.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.119+0000 7fbe7657a700 1 -- 172.21.15.80:0/66491351 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7006db00 con 0x7fbe70072360 2019-11-28T11:53:50.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.119+0000 7fbe7657a700 1 --2- 172.21.15.80:0/66491351 >> v2:172.21.15.80:3300/0 conn(0x7fbe70072360 0x7fbe700727e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbe6800f6b0 tx=0x7fbe68007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.119+0000 7fbe7657a700 1 --2- 172.21.15.80:0/66491351 >> v2:172.21.15.80:3300/0 conn(0x7fbe70072360 0x7fbe700727e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbe6800f6b0 tx=0x7fbe68007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.119+0000 7fbe7657a700 1 --2- 172.21.15.80:0/66491351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe70072360 0x7fbe700727e0 secure :-1 s=READY pgs=2430 cs=0 l=1 rx=0x7fbe6800f6b0 tx=0x7fbe68007d50).ready entity=mon.0 client_cookie=cb686aa33ac39d40 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:50.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.119+0000 7fbe7657a700 1 --2- 172.21.15.80:0/66491351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe70072360 0x7fbe700727e0 secure :-1 s=THROTTLE_DONE pgs=2430 cs=0 l=1 rx=0x7fbe6800f6b0 tx=0x7fbe68007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.119+0000 7fbe7657a700 1 --2- 172.21.15.80:0/66491351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe70072360 0x7fbe700727e0 secure :-1 s=THROTTLE_DONE pgs=2430 cs=0 l=1 rx=0x7fbe6800f6b0 tx=0x7fbe68007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.119+0000 7fbe74d77700 1 -- 172.21.15.80:0/66491351 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe68000a70 con 0x7fbe70072360 2019-11-28T11:53:50.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.119+0000 7fbe7657a700 1 --2- 172.21.15.80:0/66491351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe70072360 0x7fbe700727e0 secure :-1 s=THROTTLE_DONE pgs=2430 cs=0 l=1 rx=0x7fbe6800f6b0 tx=0x7fbe68007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.119+0000 7fbe74d77700 1 -- 172.21.15.80:0/66491351 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe680010e0 con 0x7fbe70072360 2019-11-28T11:53:50.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.119+0000 7fbe74d77700 1 -- 172.21.15.80:0/66491351 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe68001830 con 0x7fbe70072360 2019-11-28T11:53:50.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.119+0000 7fbe777dc700 1 -- 172.21.15.80:0/66491351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe70072360 msgr2=0x7fbe700727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:50.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.119+0000 7fbe777dc700 1 --2- 172.21.15.80:0/66491351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe70072360 0x7fbe700727e0 secure :-1 s=READY pgs=2430 cs=0 l=1 rx=0x7fbe6800f6b0 tx=0x7fbe68007d50).stop 2019-11-28T11:53:50.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.120+0000 7fbe777dc700 1 -- 172.21.15.80:0/66491351 shutdown_connections 2019-11-28T11:53:50.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.120+0000 7fbe777dc700 1 --2- 172.21.15.80:0/66491351 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe70072360 0x7fbe700727e0 unknown :-1 s=CLOSED pgs=2430 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:50.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.120+0000 7fbe777dc700 1 --2- 172.21.15.80:0/66491351 >> v2:172.21.15.174:3300/0 conn(0x7fbe700734e0 0x7fbe70071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:50.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.120+0000 7fbe777dc700 1 --2- 172.21.15.80:0/66491351 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe7006c0a0 0x7fbe70072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:50.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.120+0000 7fbe777dc700 1 -- 172.21.15.80:0/66491351 shutdown_connections 2019-11-28T11:53:50.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.120+0000 7fbe777dc700 1 -- 172.21.15.80:0/66491351 wait complete. 2019-11-28T11:53:50.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.120+0000 7fbe777dc700 1 -- 172.21.15.80:0/66491351 >> 172.21.15.80:0/66491351 conn(0x7fbe70061cf0 msgr2=0x7fbe70064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:50.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.122+0000 7fbe777dc700 1 Processor -- start 2019-11-28T11:53:50.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.122+0000 7fbe777dc700 1 -- start start 2019-11-28T11:53:50.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.123+0000 7fbe777dc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbe70104c10 0x7fbe701050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:50.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.123+0000 7fbe777dc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7013bcd0 con 0x7fbe701055e0 2019-11-28T11:53:50.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.123+0000 7fbe777dc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe70105ea0 con 0x7fbe70104820 2019-11-28T11:53:50.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.123+0000 7fbe777dc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe70109130 con 0x7fbe70104c10 2019-11-28T11:53:50.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.123+0000 7fbe7657a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbe701055e0 0x7fbe70167a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43660/0 (socket says 172.21.15.80:43660) 2019-11-28T11:53:50.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.123+0000 7fbe7657a700 1 -- 172.21.15.80:0/3412711738 learned_addr learned my addr 172.21.15.80:0/3412711738 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:50.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.123+0000 7fbe75578700 1 --2- 172.21.15.80:0/3412711738 >> v2:172.21.15.174:3300/0 conn(0x7fbe70104c10 0x7fbe701050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:50.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe6e7fc700 1 -- 172.21.15.80:0/3412711738 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461928787 0 0) 0x7fbe68007db0 con 0x7fbe701055e0 2019-11-28T11:53:50.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe6e7fc700 1 -- 172.21.15.80:0/3412711738 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe54002e80 con 0x7fbe701055e0 2019-11-28T11:53:50.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe6e7fc700 1 -- 172.21.15.80:0/3412711738 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183352315 0 0) 0x7fbe580012b0 con 0x7fbe70104820 2019-11-28T11:53:50.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe6e7fc700 1 -- 172.21.15.80:0/3412711738 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe540030b0 con 0x7fbe70104820 2019-11-28T11:53:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe75578700 1 -- 172.21.15.80:0/3412711738 >> v1:172.21.15.174:6789/0 conn(0x7fbe70104820 legacy=0x7fbe7010c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe75578700 1 -- 172.21.15.80:0/3412711738 >> v1:172.21.15.80:6789/0 conn(0x7fbe701055e0 legacy=0x7fbe70167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe75578700 1 -- 172.21.15.80:0/3412711738 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe70109a90 con 0x7fbe70104c10 2019-11-28T11:53:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe75578700 1 --2- 172.21.15.80:0/3412711738 >> v2:172.21.15.174:3300/0 conn(0x7fbe70104c10 0x7fbe701050a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbe60010390 tx=0x7fbe60010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe75578700 1 --2- 172.21.15.80:0/3412711738 >> v2:172.21.15.174:3300/0 conn(0x7fbe70104c10 0x7fbe701050a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbe60010390 tx=0x7fbe60010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe75578700 1 --2- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe70104c10 0x7fbe701050a0 secure :-1 s=READY pgs=1463 cs=0 l=1 rx=0x7fbe60010390 tx=0x7fbe60010730).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe75578700 1 --2- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe70104c10 0x7fbe701050a0 secure :-1 s=THROTTLE_DONE pgs=1463 cs=0 l=1 rx=0x7fbe60010390 tx=0x7fbe60010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe6e7fc700 1 -- 172.21.15.80:0/3412711738 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe60009640 con 0x7fbe70104c10 2019-11-28T11:53:50.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe75578700 1 --2- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe70104c10 0x7fbe701050a0 secure :-1 s=THROTTLE_DONE pgs=1463 cs=0 l=1 rx=0x7fbe60010390 tx=0x7fbe60010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe75578700 1 --2- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe70104c10 0x7fbe701050a0 secure :-1 s=THROTTLE_DONE pgs=1463 cs=0 l=1 rx=0x7fbe60010390 tx=0x7fbe60010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe6e7fc700 1 -- 172.21.15.80:0/3412711738 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe60000940 con 0x7fbe70104c10 2019-11-28T11:53:50.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe777dc700 1 -- 172.21.15.80:0/3412711738 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe70109e10 con 0x7fbe70104c10 2019-11-28T11:53:50.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe6e7fc700 1 -- 172.21.15.80:0/3412711738 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe6000a0e0 con 0x7fbe70104c10 2019-11-28T11:53:50.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.124+0000 7fbe777dc700 1 -- 172.21.15.80:0/3412711738 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe70109a90 con 0x7fbe70104c10 2019-11-28T11:53:50.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.125+0000 7fbe75578700 1 --2- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe70104c10 0x7fbe701050a0 secure :-1 s=THROTTLE_DONE pgs=1463 cs=0 l=1 rx=0x7fbe60010390 tx=0x7fbe60010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.125+0000 7fbe75578700 1 --2- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe70104c10 0x7fbe701050a0 secure :-1 s=THROTTLE_DONE pgs=1463 cs=0 l=1 rx=0x7fbe60010390 tx=0x7fbe60010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.125+0000 7fbe6e7fc700 1 -- 172.21.15.80:0/3412711738 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbe600099f0 con 0x7fbe70104c10 2019-11-28T11:53:50.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.125+0000 7fbe6e7fc700 1 --2- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe54018750 0x7fbe5401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:50.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.125+0000 7fbe6e7fc700 1 -- 172.21.15.80:0/3412711738 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fbe60031ad0 con 0x7fbe70104c10 2019-11-28T11:53:50.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.125+0000 7fbe75d79700 1 --2- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe54018750 0x7fbe5401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:50.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.125+0000 7fbe75d79700 1 --2- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe54018750 0x7fbe5401abe0 crc :-1 s=READY pgs=999 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:50.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.132+0000 7fbe777dc700 1 -- 172.21.15.80:0/3412711738 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe70109e10 con 0x7fbe70104c10 2019-11-28T11:53:50.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.136+0000 7fbe75578700 1 --2- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe70104c10 0x7fbe701050a0 secure :-1 s=THROTTLE_DONE pgs=1463 cs=0 l=1 rx=0x7fbe60010390 tx=0x7fbe60010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.136+0000 7fbe6e7fc700 1 -- 172.21.15.80:0/3412711738 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbe600095f0 con 0x7fbe70104c10 2019-11-28T11:53:50.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.309+0000 7fbe777dc700 1 -- 172.21.15.80:0/3412711738 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe70109a90 con 0x7fbe70104c10 2019-11-28T11:53:50.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.310+0000 7fbe75578700 1 --2- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe70104c10 0x7fbe701050a0 secure :-1 s=THROTTLE_DONE pgs=1463 cs=0 l=1 rx=0x7fbe60010390 tx=0x7fbe60010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.310+0000 7fbe6e7fc700 1 -- 172.21.15.80:0/3412711738 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 147 v147) v1 ==== 95+0+1432 (secure 0 0 0) 0x7fbe6000a390 con 0x7fbe70104c10 2019-11-28T11:53:50.365 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 147 2019-11-28T11:53:50.366 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:50.366 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":147,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":147,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:52:31.482361+0000","modified":"2019-11-28T11:53:49.932655+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":181,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2019-11-28T11:53:50.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.312+0000 7fbe777dc700 1 -- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe54018750 msgr2=0x7fbe5401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:50.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.312+0000 7fbe777dc700 1 --2- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe54018750 0x7fbe5401abe0 crc :-1 s=READY pgs=999 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:50.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.312+0000 7fbe777dc700 1 -- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe70104c10 msgr2=0x7fbe701050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:50.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.312+0000 7fbe777dc700 1 --2- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe70104c10 0x7fbe701050a0 secure :-1 s=READY pgs=1463 cs=0 l=1 rx=0x7fbe60010390 tx=0x7fbe60010730).stop 2019-11-28T11:53:50.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.312+0000 7fbe777dc700 1 -- 172.21.15.80:0/3412711738 shutdown_connections 2019-11-28T11:53:50.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.312+0000 7fbe777dc700 1 --2- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe70104c10 0x7fbe701050a0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:50.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.312+0000 7fbe777dc700 1 --2- 172.21.15.80:0/3412711738 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe54018750 0x7fbe5401abe0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:50.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.312+0000 7fbe777dc700 1 -- 172.21.15.80:0/3412711738 shutdown_connections 2019-11-28T11:53:50.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.312+0000 7fbe777dc700 1 -- 172.21.15.80:0/3412711738 wait complete. 2019-11-28T11:53:50.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.312+0000 7fbe777dc700 1 -- 172.21.15.80:0/3412711738 >> 172.21.15.80:0/3412711738 conn(0x7fbe7013d620 msgr2=0x7fbe7013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:50.377 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:53:50.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.445+0000 7f9b659e5700 1 Processor -- start 2019-11-28T11:53:50.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.445+0000 7f9b659e5700 1 -- start start 2019-11-28T11:53:50.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.446+0000 7f9b659e5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b6006c0a0 0x7f9b60072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:50.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.446+0000 7f9b659e5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6006db00 con 0x7f9b60072620 2019-11-28T11:53:50.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.446+0000 7f9b659e5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6006e000 con 0x7f9b600734e0 2019-11-28T11:53:50.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.446+0000 7f9b659e5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b6006fd60 con 0x7f9b6006c0a0 2019-11-28T11:53:50.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.446+0000 7f9b5f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b6006c0a0 0x7f9b60072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:50.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.446+0000 7f9b5f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b6006c0a0 0x7f9b60072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44350/0 (socket says 172.21.15.80:44350) 2019-11-28T11:53:50.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.446+0000 7f9b5f7fe700 1 -- 172.21.15.80:0/699284344 learned_addr learned my addr 172.21.15.80:0/699284344 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:50.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.446+0000 7f9b5ffff700 1 --1- 172.21.15.80:0/699284344 >> v1:172.21.15.80:6789/0 conn(0x7f9b60072620 0x7f9b60164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43668/0 (socket says 172.21.15.80:43668) 2019-11-28T11:53:50.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.446+0000 7f9b5f7fe700 1 -- 172.21.15.80:0/699284344 >> v1:172.21.15.174:6789/0 conn(0x7f9b600734e0 legacy=0x7f9b60071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:50.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.446+0000 7f9b5f7fe700 1 -- 172.21.15.80:0/699284344 >> v1:172.21.15.80:6789/0 conn(0x7f9b60072620 legacy=0x7f9b60164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:50.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.446+0000 7f9b5f7fe700 1 -- 172.21.15.80:0/699284344 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b600706c0 con 0x7f9b6006c0a0 2019-11-28T11:53:50.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.446+0000 7f9b5f7fe700 1 --2- 172.21.15.80:0/699284344 >> v2:172.21.15.80:3300/0 conn(0x7f9b6006c0a0 0x7f9b60072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9b5000f740 tx=0x7f9b5000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.446+0000 7f9b5f7fe700 1 --2- 172.21.15.80:0/699284344 >> v2:172.21.15.80:3300/0 conn(0x7f9b6006c0a0 0x7f9b60072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9b5000f740 tx=0x7f9b5000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.447+0000 7f9b5f7fe700 1 --2- 172.21.15.80:0/699284344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6006c0a0 0x7f9b60072fa0 secure :-1 s=READY pgs=2433 cs=0 l=1 rx=0x7f9b5000f740 tx=0x7f9b5000fae0).ready entity=mon.0 client_cookie=867e6e85931c9897 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:50.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.447+0000 7f9b5f7fe700 1 --2- 172.21.15.80:0/699284344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6006c0a0 0x7f9b60072fa0 secure :-1 s=THROTTLE_DONE pgs=2433 cs=0 l=1 rx=0x7f9b5000f740 tx=0x7f9b5000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.447+0000 7f9b5e7fc700 1 -- 172.21.15.80:0/699284344 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b50000960 con 0x7f9b6006c0a0 2019-11-28T11:53:50.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.447+0000 7f9b5f7fe700 1 --2- 172.21.15.80:0/699284344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6006c0a0 0x7f9b60072fa0 secure :-1 s=THROTTLE_DONE pgs=2433 cs=0 l=1 rx=0x7f9b5000f740 tx=0x7f9b5000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.447+0000 7f9b5f7fe700 1 --2- 172.21.15.80:0/699284344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6006c0a0 0x7f9b60072fa0 secure :-1 s=THROTTLE_DONE pgs=2433 cs=0 l=1 rx=0x7f9b5000f740 tx=0x7f9b5000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.447+0000 7f9b5e7fc700 1 -- 172.21.15.80:0/699284344 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b50000c90 con 0x7f9b6006c0a0 2019-11-28T11:53:50.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.447+0000 7f9b5e7fc700 1 -- 172.21.15.80:0/699284344 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b50001360 con 0x7f9b6006c0a0 2019-11-28T11:53:50.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.447+0000 7f9b659e5700 1 -- 172.21.15.80:0/699284344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6006c0a0 msgr2=0x7f9b60072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:50.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.447+0000 7f9b659e5700 1 --2- 172.21.15.80:0/699284344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6006c0a0 0x7f9b60072fa0 secure :-1 s=READY pgs=2433 cs=0 l=1 rx=0x7f9b5000f740 tx=0x7f9b5000fae0).stop 2019-11-28T11:53:50.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.447+0000 7f9b659e5700 1 -- 172.21.15.80:0/699284344 shutdown_connections 2019-11-28T11:53:50.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.447+0000 7f9b659e5700 1 --2- 172.21.15.80:0/699284344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6006c0a0 0x7f9b60072fa0 unknown :-1 s=CLOSED pgs=2433 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:50.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.447+0000 7f9b659e5700 1 -- 172.21.15.80:0/699284344 shutdown_connections 2019-11-28T11:53:50.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.447+0000 7f9b659e5700 1 -- 172.21.15.80:0/699284344 wait complete. 2019-11-28T11:53:50.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.447+0000 7f9b659e5700 1 -- 172.21.15.80:0/699284344 >> 172.21.15.80:0/699284344 conn(0x7f9b60061cf0 msgr2=0x7f9b60064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:50.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.450+0000 7f9b659e5700 1 Processor -- start 2019-11-28T11:53:50.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.450+0000 7f9b659e5700 1 -- start start 2019-11-28T11:53:50.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b659e5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b6015ce10 0x7f9b60140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:50.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b659e5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6015d4a0 con 0x7f9b6015c9a0 2019-11-28T11:53:50.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b659e5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6013f510 con 0x7f9b6012a8e0 2019-11-28T11:53:50.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b659e5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b60163ae0 con 0x7f9b6015ce10 2019-11-28T11:53:50.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b5ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b6015ce10 0x7f9b60140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:50.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b5ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b6015ce10 0x7f9b60140720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44360/0 (socket says 172.21.15.80:44360) 2019-11-28T11:53:50.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b5ffff700 1 -- 172.21.15.80:0/1117616039 learned_addr learned my addr 172.21.15.80:0/1117616039 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:50.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b5ffff700 1 -- 172.21.15.80:0/1117616039 >> v1:172.21.15.174:6789/0 conn(0x7f9b6012a8e0 legacy=0x7f9b60140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:50.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b5ffff700 1 -- 172.21.15.80:0/1117616039 >> v1:172.21.15.80:6789/0 conn(0x7f9b6015c9a0 legacy=0x7f9b6013ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:50.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b5ffff700 1 -- 172.21.15.80:0/1117616039 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b60164440 con 0x7f9b6015ce10 2019-11-28T11:53:50.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b57fff700 1 -- 172.21.15.80:0/1117616039 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990881174 0 0) 0x7f9b48001440 con 0x7f9b6015c9a0 2019-11-28T11:53:50.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b5ffff700 1 --2- 172.21.15.80:0/1117616039 >> v2:172.21.15.80:3300/0 conn(0x7f9b6015ce10 0x7f9b60140720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b580103e0 tx=0x7f9b58010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b5ffff700 1 --2- 172.21.15.80:0/1117616039 >> v2:172.21.15.80:3300/0 conn(0x7f9b6015ce10 0x7f9b60140720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b580103e0 tx=0x7f9b58010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b5ffff700 1 --2- 172.21.15.80:0/1117616039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6015ce10 0x7f9b60140720 secure :-1 s=READY pgs=2435 cs=0 l=1 rx=0x7f9b580103e0 tx=0x7f9b58010780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:50.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b5ffff700 1 --2- 172.21.15.80:0/1117616039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6015ce10 0x7f9b60140720 secure :-1 s=THROTTLE_DONE pgs=2435 cs=0 l=1 rx=0x7f9b580103e0 tx=0x7f9b58010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b57fff700 1 -- 172.21.15.80:0/1117616039 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b58000940 con 0x7f9b6015ce10 2019-11-28T11:53:50.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b5ffff700 1 --2- 172.21.15.80:0/1117616039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6015ce10 0x7f9b60140720 secure :-1 s=THROTTLE_DONE pgs=2435 cs=0 l=1 rx=0x7f9b580103e0 tx=0x7f9b58010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b5ffff700 1 --2- 172.21.15.80:0/1117616039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6015ce10 0x7f9b60140720 secure :-1 s=THROTTLE_DONE pgs=2435 cs=0 l=1 rx=0x7f9b580103e0 tx=0x7f9b58010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b57fff700 1 -- 172.21.15.80:0/1117616039 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b58001100 con 0x7f9b6015ce10 2019-11-28T11:53:50.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b659e5700 1 -- 172.21.15.80:0/1117616039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b601647c0 con 0x7f9b6015ce10 2019-11-28T11:53:50.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.451+0000 7f9b57fff700 1 -- 172.21.15.80:0/1117616039 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b58001810 con 0x7f9b6015ce10 2019-11-28T11:53:50.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.452+0000 7f9b659e5700 1 -- 172.21.15.80:0/1117616039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b60163380 con 0x7f9b6015ce10 2019-11-28T11:53:50.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.452+0000 7f9b5ffff700 1 --2- 172.21.15.80:0/1117616039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6015ce10 0x7f9b60140720 secure :-1 s=THROTTLE_DONE pgs=2435 cs=0 l=1 rx=0x7f9b580103e0 tx=0x7f9b58010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.452+0000 7f9b57fff700 1 -- 172.21.15.80:0/1117616039 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9b58000940 con 0x7f9b6015ce10 2019-11-28T11:53:50.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.452+0000 7f9b5ffff700 1 --2- 172.21.15.80:0/1117616039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6015ce10 0x7f9b60140720 secure :-1 s=THROTTLE_DONE pgs=2435 cs=0 l=1 rx=0x7f9b580103e0 tx=0x7f9b58010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.452+0000 7f9b57fff700 1 --2- 172.21.15.80:0/1117616039 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b38018730 0x7f9b3801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:50.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.452+0000 7f9b57fff700 1 -- 172.21.15.80:0/1117616039 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f9b58031b10 con 0x7f9b6015ce10 2019-11-28T11:53:50.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.452+0000 7f9b5f7fe700 1 --2- 172.21.15.80:0/1117616039 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b38018730 0x7f9b3801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:50.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.453+0000 7f9b5f7fe700 1 --2- 172.21.15.80:0/1117616039 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b38018730 0x7f9b3801abc0 crc :-1 s=READY pgs=1000 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:50.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.460+0000 7f9b659e5700 1 -- 172.21.15.80:0/1117616039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b60164440 con 0x7f9b6015ce10 2019-11-28T11:53:50.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.464+0000 7f9b5ffff700 1 --2- 172.21.15.80:0/1117616039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6015ce10 0x7f9b60140720 secure :-1 s=THROTTLE_DONE pgs=2435 cs=0 l=1 rx=0x7f9b580103e0 tx=0x7f9b58010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.464+0000 7f9b57fff700 1 -- 172.21.15.80:0/1117616039 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9b58000ef0 con 0x7f9b6015ce10 2019-11-28T11:53:50.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.639+0000 7f9b659e5700 1 -- 172.21.15.80:0/1117616039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9b601647c0 con 0x7f9b6015ce10 2019-11-28T11:53:50.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.940+0000 7f9b5ffff700 1 --2- 172.21.15.80:0/1117616039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6015ce10 0x7f9b60140720 secure :-1 s=THROTTLE_DONE pgs=2435 cs=0 l=1 rx=0x7f9b580103e0 tx=0x7f9b58010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:50.995 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.940+0000 7f9b57fff700 1 -- 172.21.15.80:0/1117616039 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v148) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9b58000940 con 0x7f9b6015ce10 2019-11-28T11:53:51.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.955+0000 7f9b659e5700 1 -- 172.21.15.80:0/1117616039 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b38018730 msgr2=0x7f9b3801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:51.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.955+0000 7f9b659e5700 1 --2- 172.21.15.80:0/1117616039 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b38018730 0x7f9b3801abc0 crc :-1 s=READY pgs=1000 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:51.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.955+0000 7f9b659e5700 1 -- 172.21.15.80:0/1117616039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6015ce10 msgr2=0x7f9b60140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:51.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.955+0000 7f9b659e5700 1 --2- 172.21.15.80:0/1117616039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6015ce10 0x7f9b60140720 secure :-1 s=READY pgs=2435 cs=0 l=1 rx=0x7f9b580103e0 tx=0x7f9b58010780).stop 2019-11-28T11:53:51.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.955+0000 7f9b659e5700 1 -- 172.21.15.80:0/1117616039 shutdown_connections 2019-11-28T11:53:51.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.955+0000 7f9b659e5700 1 --2- 172.21.15.80:0/1117616039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b6015ce10 0x7f9b60140720 unknown :-1 s=CLOSED pgs=2435 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:51.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.955+0000 7f9b659e5700 1 --2- 172.21.15.80:0/1117616039 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9b38018730 0x7f9b3801abc0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:51.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.955+0000 7f9b659e5700 1 -- 172.21.15.80:0/1117616039 shutdown_connections 2019-11-28T11:53:51.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.955+0000 7f9b659e5700 1 -- 172.21.15.80:0/1117616039 wait complete. 2019-11-28T11:53:51.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:50.955+0000 7f9b659e5700 1 -- 172.21.15.80:0/1117616039 >> 172.21.15.80:0/1117616039 conn(0x7f9b60159ae0 msgr2=0x7f9b6013d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:51.020 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:53:51.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.088+0000 7fe54a531700 1 Processor -- start 2019-11-28T11:53:51.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.088+0000 7fe54a531700 1 -- start start 2019-11-28T11:53:51.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.089+0000 7fe54a531700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54415f100 0x7fe54406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:51.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.089+0000 7fe54a531700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe54406c2f0 0x7fe54406c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:51.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.089+0000 7fe54a531700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54406db60 con 0x7fe54415ed10 2019-11-28T11:53:51.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.089+0000 7fe54a531700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54406fe00 con 0x7fe54406c2f0 2019-11-28T11:53:51.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.089+0000 7fe54a531700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440700d0 con 0x7fe54415f100 2019-11-28T11:53:51.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe543fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54415f100 0x7fe54406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:51.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe5492cf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe54406c2f0 0x7fe54406c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:51.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe5492cf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe54406c2f0 0x7fe54406c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:59250/0 (socket says 172.21.15.80:59250) 2019-11-28T11:53:51.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe543fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54415f100 0x7fe54406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:46624/0 (socket says 172.21.15.80:46624) 2019-11-28T11:53:51.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe5492cf700 1 -- 172.21.15.80:0/488483936 learned_addr learned my addr 172.21.15.80:0/488483936 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:51.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe548ace700 1 --1- 172.21.15.80:0/488483936 >> v1:172.21.15.174:6789/0 conn(0x7fe54415ed10 0x7fe544073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:59224/0 (socket says 172.21.15.80:59224) 2019-11-28T11:53:51.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe543fff700 1 -- 172.21.15.80:0/488483936 >> v2:172.21.15.174:3300/0 conn(0x7fe54406c2f0 msgr2=0x7fe54406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:51.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe543fff700 1 --2- 172.21.15.80:0/488483936 >> v2:172.21.15.174:3300/0 conn(0x7fe54406c2f0 0x7fe54406c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:51.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe543fff700 1 -- 172.21.15.80:0/488483936 >> v1:172.21.15.174:6789/0 conn(0x7fe54415ed10 legacy=0x7fe544073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:51.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe543fff700 1 -- 172.21.15.80:0/488483936 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe544070760 con 0x7fe54415f100 2019-11-28T11:53:51.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe5437fe700 1 -- 172.21.15.80:0/488483936 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477502828 0 0) 0x7fe52c001080 con 0x7fe54415ed10 2019-11-28T11:53:51.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe5492cf700 1 --2- 172.21.15.80:0/488483936 >> v2:172.21.15.174:3300/0 conn(0x7fe54406c2f0 0x7fe54406c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:51.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe543fff700 1 --2- 172.21.15.80:0/488483936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54415f100 0x7fe54406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe53400b2d0 tx=0x7fe53400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:51.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe543fff700 1 --2- 172.21.15.80:0/488483936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54415f100 0x7fe54406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe53400b2d0 tx=0x7fe53400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:51.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe543fff700 1 --2- 172.21.15.80:0/488483936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54415f100 0x7fe54406bdb0 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7fe53400b2d0 tx=0x7fe53400bae0).ready entity=mon.2 client_cookie=150bbdf9179bac37 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:51.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe543fff700 1 --2- 172.21.15.80:0/488483936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54415f100 0x7fe54406bdb0 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7fe53400b2d0 tx=0x7fe53400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:51.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe5437fe700 1 -- 172.21.15.80:0/488483936 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe534007590 con 0x7fe54415f100 2019-11-28T11:53:51.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe543fff700 1 --2- 172.21.15.80:0/488483936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54415f100 0x7fe54406bdb0 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7fe53400b2d0 tx=0x7fe53400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:51.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe5437fe700 1 -- 172.21.15.80:0/488483936 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe534009d30 con 0x7fe54415f100 2019-11-28T11:53:51.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe543fff700 1 --2- 172.21.15.80:0/488483936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54415f100 0x7fe54406bdb0 secure :-1 s=THROTTLE_DONE pgs=347 cs=0 l=1 rx=0x7fe53400b2d0 tx=0x7fe53400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:51.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe5437fe700 1 -- 172.21.15.80:0/488483936 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe534007590 con 0x7fe54415f100 2019-11-28T11:53:51.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe54a531700 1 -- 172.21.15.80:0/488483936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54415f100 msgr2=0x7fe54406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:51.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.090+0000 7fe54a531700 1 --2- 172.21.15.80:0/488483936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54415f100 0x7fe54406bdb0 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7fe53400b2d0 tx=0x7fe53400bae0).stop 2019-11-28T11:53:51.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.091+0000 7fe54a531700 1 -- 172.21.15.80:0/488483936 shutdown_connections 2019-11-28T11:53:51.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.091+0000 7fe54a531700 1 --2- 172.21.15.80:0/488483936 >> v2:172.21.15.174:3300/0 conn(0x7fe54406c2f0 0x7fe54406c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:51.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.091+0000 7fe54a531700 1 --2- 172.21.15.80:0/488483936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54415f100 0x7fe54406bdb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:51.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.091+0000 7fe54a531700 1 -- 172.21.15.80:0/488483936 shutdown_connections 2019-11-28T11:53:51.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.091+0000 7fe54a531700 1 -- 172.21.15.80:0/488483936 wait complete. 2019-11-28T11:53:51.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.091+0000 7fe54a531700 1 -- 172.21.15.80:0/488483936 >> 172.21.15.80:0/488483936 conn(0x7fe544061d20 msgr2=0x7fe5440641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:51.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.094+0000 7fe54a531700 1 Processor -- start 2019-11-28T11:53:51.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.094+0000 7fe54a531700 1 -- start start 2019-11-28T11:53:51.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe54a531700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe544148320 0x7fe54410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:51.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe54a531700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54410f290 0x7fe54410dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:51.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe54a531700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe544148e00 con 0x7fe54410e110 2019-11-28T11:53:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe54a531700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54413aa20 con 0x7fe544148320 2019-11-28T11:53:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe54a531700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54413acf0 con 0x7fe54410f290 2019-11-28T11:53:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe548ace700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe544148320 0x7fe54410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe548ace700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe544148320 0x7fe54410ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44368/0 (socket says 172.21.15.80:44368) 2019-11-28T11:53:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe548ace700 1 -- 172.21.15.80:0/1152596236 learned_addr learned my addr 172.21.15.80:0/1152596236 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe543fff700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54410f290 0x7fe54410dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:51.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe548ace700 1 -- 172.21.15.80:0/1152596236 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54410f290 msgr2=0x7fe54410dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:51.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe548ace700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54410f290 0x7fe54410dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:51.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe548ace700 1 -- 172.21.15.80:0/1152596236 >> v1:172.21.15.80:6789/0 conn(0x7fe54410e110 legacy=0x7fe5441079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:51.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe548ace700 1 -- 172.21.15.80:0/1152596236 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54410c490 con 0x7fe544148320 2019-11-28T11:53:51.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe5417fa700 1 -- 172.21.15.80:0/1152596236 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829606049 0 0) 0x7fe53c0077e0 con 0x7fe54410e110 2019-11-28T11:53:51.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe543fff700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54410f290 0x7fe54410dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:51.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe548ace700 1 --2- 172.21.15.80:0/1152596236 >> v2:172.21.15.80:3300/0 conn(0x7fe544148320 0x7fe54410ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe52c010440 tx=0x7fe52c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:51.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe548ace700 1 --2- 172.21.15.80:0/1152596236 >> v2:172.21.15.80:3300/0 conn(0x7fe544148320 0x7fe54410ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe52c010440 tx=0x7fe52c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:51.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe548ace700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe544148320 0x7fe54410ed50 secure :-1 s=READY pgs=2437 cs=0 l=1 rx=0x7fe52c010440 tx=0x7fe52c0107e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:51.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe548ace700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe544148320 0x7fe54410ed50 secure :-1 s=THROTTLE_DONE pgs=2437 cs=0 l=1 rx=0x7fe52c010440 tx=0x7fe52c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:51.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe5417fa700 1 -- 172.21.15.80:0/1152596236 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe52c0041c0 con 0x7fe544148320 2019-11-28T11:53:51.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe548ace700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe544148320 0x7fe54410ed50 secure :-1 s=THROTTLE_DONE pgs=2437 cs=0 l=1 rx=0x7fe52c010440 tx=0x7fe52c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:51.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe5417fa700 1 -- 172.21.15.80:0/1152596236 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c000c60 con 0x7fe544148320 2019-11-28T11:53:51.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe548ace700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe544148320 0x7fe54410ed50 secure :-1 s=THROTTLE_DONE pgs=2437 cs=0 l=1 rx=0x7fe52c010440 tx=0x7fe52c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:51.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe54a531700 1 -- 172.21.15.80:0/1152596236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54410c810 con 0x7fe544148320 2019-11-28T11:53:51.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe5417fa700 1 -- 172.21.15.80:0/1152596236 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe52c000e50 con 0x7fe544148320 2019-11-28T11:53:51.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.095+0000 7fe54a531700 1 -- 172.21.15.80:0/1152596236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54410c490 con 0x7fe544148320 2019-11-28T11:53:51.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.096+0000 7fe548ace700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe544148320 0x7fe54410ed50 secure :-1 s=THROTTLE_DONE pgs=2437 cs=0 l=1 rx=0x7fe52c010440 tx=0x7fe52c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:51.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.096+0000 7fe5417fa700 1 -- 172.21.15.80:0/1152596236 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe52c0041c0 con 0x7fe544148320 2019-11-28T11:53:51.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.096+0000 7fe548ace700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe544148320 0x7fe54410ed50 secure :-1 s=THROTTLE_DONE pgs=2437 cs=0 l=1 rx=0x7fe52c010440 tx=0x7fe52c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.096+0000 7fe5417fa700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe528018730 0x7fe52801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:51.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.096+0000 7fe5417fa700 1 -- 172.21.15.80:0/1152596236 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fe52c031ae0 con 0x7fe544148320 2019-11-28T11:53:51.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.096+0000 7fe543fff700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe528018730 0x7fe52801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:51.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.097+0000 7fe543fff700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe528018730 0x7fe52801abc0 crc :-1 s=READY pgs=1001 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:51.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.104+0000 7fe54a531700 1 -- 172.21.15.80:0/1152596236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54410c810 con 0x7fe544148320 2019-11-28T11:53:51.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.107+0000 7fe548ace700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe544148320 0x7fe54410ed50 secure :-1 s=THROTTLE_DONE pgs=2437 cs=0 l=1 rx=0x7fe52c010440 tx=0x7fe52c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:51.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.107+0000 7fe5417fa700 1 -- 172.21.15.80:0/1152596236 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe52c001300 con 0x7fe544148320 2019-11-28T11:53:51.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.279+0000 7fe54a531700 1 -- 172.21.15.80:0/1152596236 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe54410c490 con 0x7fe544148320 2019-11-28T11:53:52.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.951+0000 7fe548ace700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe544148320 0x7fe54410ed50 secure :-1 s=THROTTLE_DONE pgs=2437 cs=0 l=1 rx=0x7fe52c010440 tx=0x7fe52c0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:52.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.951+0000 7fe5417fa700 1 -- 172.21.15.80:0/1152596236 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v184) v1 ==== 185+0+0 (secure 0 0 0) 0x7fe52c0042f0 con 0x7fe544148320 2019-11-28T11:53:52.048 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:53:52.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.996+0000 7fe54a531700 1 -- 172.21.15.80:0/1152596236 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe528018730 msgr2=0x7fe52801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:52.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.996+0000 7fe54a531700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe528018730 0x7fe52801abc0 crc :-1 s=READY pgs=1001 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:52.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.996+0000 7fe54a531700 1 -- 172.21.15.80:0/1152596236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe544148320 msgr2=0x7fe54410ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:52.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.996+0000 7fe54a531700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe544148320 0x7fe54410ed50 secure :-1 s=READY pgs=2437 cs=0 l=1 rx=0x7fe52c010440 tx=0x7fe52c0107e0).stop 2019-11-28T11:53:52.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.996+0000 7fe54a531700 1 -- 172.21.15.80:0/1152596236 shutdown_connections 2019-11-28T11:53:52.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.996+0000 7fe54a531700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe528018730 0x7fe52801abc0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:52.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.996+0000 7fe54a531700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe54410f290 0x7fe54410dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:52.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.996+0000 7fe54a531700 1 --2- 172.21.15.80:0/1152596236 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe544148320 0x7fe54410ed50 unknown :-1 s=CLOSED pgs=2437 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:52.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.996+0000 7fe54a531700 1 -- 172.21.15.80:0/1152596236 shutdown_connections 2019-11-28T11:53:52.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.996+0000 7fe54a531700 1 -- 172.21.15.80:0/1152596236 wait complete. 2019-11-28T11:53:52.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:51.996+0000 7fe54a531700 1 -- 172.21.15.80:0/1152596236 >> 172.21.15.80:0/1152596236 conn(0x7fe54415e2d0 msgr2=0x7fe544147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:52.061 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:53:52.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.138+0000 7f3b13d03700 1 Processor -- start 2019-11-28T11:53:52.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.138+0000 7f3b13d03700 1 -- start start 2019-11-28T11:53:52.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b13d03700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3b0c1639f0 0x7f3b0c165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:52.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b13d03700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0c06db60 con 0x7f3b0c15f100 2019-11-28T11:53:52.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b13d03700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0c06e060 con 0x7f3b0c15ed10 2019-11-28T11:53:52.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b13d03700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0c06fe00 con 0x7f3b0c1639f0 2019-11-28T11:53:52.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b11a9f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3b0c15f100 0x7f3b0c06bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43692/0 (socket says 172.21.15.80:43692) 2019-11-28T11:53:52.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b11a9f700 1 -- 172.21.15.80:0/1781175330 learned_addr learned my addr 172.21.15.80:0/1781175330 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:52.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b12aa1700 1 --2- 172.21.15.80:0/1781175330 >> v2:172.21.15.174:3300/0 conn(0x7f3b0c1639f0 0x7f3b0c165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:52.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b1129e700 1 -- 172.21.15.80:0/1781175330 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497534725 0 0) 0x7f3afc001100 con 0x7f3b0c15f100 2019-11-28T11:53:52.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b1129e700 1 -- 172.21.15.80:0/1781175330 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af4002e80 con 0x7f3b0c15f100 2019-11-28T11:53:52.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b1129e700 1 -- 172.21.15.80:0/1781175330 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918394789 0 0) 0x7f3b00001400 con 0x7f3b0c15ed10 2019-11-28T11:53:52.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b1129e700 1 -- 172.21.15.80:0/1781175330 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af40030b0 con 0x7f3b0c15ed10 2019-11-28T11:53:52.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b12aa1700 1 -- 172.21.15.80:0/1781175330 >> v1:172.21.15.174:6789/0 conn(0x7f3b0c15ed10 legacy=0x7f3b0c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:52.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b12aa1700 1 -- 172.21.15.80:0/1781175330 >> v1:172.21.15.80:6789/0 conn(0x7f3b0c15f100 legacy=0x7f3b0c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:52.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b12aa1700 1 -- 172.21.15.80:0/1781175330 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c070760 con 0x7f3b0c1639f0 2019-11-28T11:53:52.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b12aa1700 1 --2- 172.21.15.80:0/1781175330 >> v2:172.21.15.174:3300/0 conn(0x7f3b0c1639f0 0x7f3b0c165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b0400af80 tx=0x7f3b0400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:52.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b12aa1700 1 --2- 172.21.15.80:0/1781175330 >> v2:172.21.15.174:3300/0 conn(0x7f3b0c1639f0 0x7f3b0c165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b0400af80 tx=0x7f3b0400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:52.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.140+0000 7f3b12aa1700 1 --2- 172.21.15.80:0/1781175330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b0c1639f0 0x7f3b0c165df0 secure :-1 s=READY pgs=1468 cs=0 l=1 rx=0x7f3b0400af80 tx=0x7f3b0400b790).ready entity=mon.1 client_cookie=deb5a7d25566af48 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:52.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.141+0000 7f3b12aa1700 1 --2- 172.21.15.80:0/1781175330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b0c1639f0 0x7f3b0c165df0 secure :-1 s=THROTTLE_DONE pgs=1468 cs=0 l=1 rx=0x7f3b0400af80 tx=0x7f3b0400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:52.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.141+0000 7f3b1129e700 1 -- 172.21.15.80:0/1781175330 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b04007240 con 0x7f3b0c1639f0 2019-11-28T11:53:52.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.141+0000 7f3b12aa1700 1 --2- 172.21.15.80:0/1781175330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b0c1639f0 0x7f3b0c165df0 secure :-1 s=THROTTLE_DONE pgs=1468 cs=0 l=1 rx=0x7f3b0400af80 tx=0x7f3b0400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:52.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.141+0000 7f3b12aa1700 1 --2- 172.21.15.80:0/1781175330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b0c1639f0 0x7f3b0c165df0 secure :-1 s=THROTTLE_DONE pgs=1468 cs=0 l=1 rx=0x7f3b0400af80 tx=0x7f3b0400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:52.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.141+0000 7f3b1129e700 1 -- 172.21.15.80:0/1781175330 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b04000bb0 con 0x7f3b0c1639f0 2019-11-28T11:53:52.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.141+0000 7f3b1129e700 1 -- 172.21.15.80:0/1781175330 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b04009bd0 con 0x7f3b0c1639f0 2019-11-28T11:53:52.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.141+0000 7f3b13d03700 1 -- 172.21.15.80:0/1781175330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b0c1639f0 msgr2=0x7f3b0c165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:52.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.141+0000 7f3b13d03700 1 --2- 172.21.15.80:0/1781175330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b0c1639f0 0x7f3b0c165df0 secure :-1 s=READY pgs=1468 cs=0 l=1 rx=0x7f3b0400af80 tx=0x7f3b0400b790).stop 2019-11-28T11:53:52.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.141+0000 7f3b13d03700 1 -- 172.21.15.80:0/1781175330 shutdown_connections 2019-11-28T11:53:52.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.141+0000 7f3b13d03700 1 --2- 172.21.15.80:0/1781175330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b0c1639f0 0x7f3b0c165df0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:52.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.141+0000 7f3b13d03700 1 -- 172.21.15.80:0/1781175330 shutdown_connections 2019-11-28T11:53:52.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.141+0000 7f3b13d03700 1 -- 172.21.15.80:0/1781175330 wait complete. 2019-11-28T11:53:52.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.141+0000 7f3b13d03700 1 -- 172.21.15.80:0/1781175330 >> 172.21.15.80:0/1781175330 conn(0x7f3b0c061d20 msgr2=0x7f3b0c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:52.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.144+0000 7f3b13d03700 1 Processor -- start 2019-11-28T11:53:52.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.144+0000 7f3b13d03700 1 -- start start 2019-11-28T11:53:52.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b13d03700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b0c0743a0 0x7f3b0c074830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:52.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b13d03700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0c0751b0 con 0x7f3b0c073290 2019-11-28T11:53:52.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b13d03700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0c1321a0 con 0x7f3b0c074d70 2019-11-28T11:53:52.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b13d03700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c07a4f0 con 0x7f3b0c0743a0 2019-11-28T11:53:52.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b122a0700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3b0c073290 0x7f3b0c075520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43698/0 (socket says 172.21.15.80:43698) 2019-11-28T11:53:52.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b122a0700 1 -- 172.21.15.80:0/1033472999 learned_addr learned my addr 172.21.15.80:0/1033472999 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:52.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b11a9f700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b0c0743a0 0x7f3b0c074830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:52.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b0affd700 1 -- 172.21.15.80:0/1033472999 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390286199 0 0) 0x7f3b000015c0 con 0x7f3b0c073290 2019-11-28T11:53:52.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b0affd700 1 -- 172.21.15.80:0/1033472999 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aec002e80 con 0x7f3b0c073290 2019-11-28T11:53:52.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b0affd700 1 -- 172.21.15.80:0/1033472999 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283822222 0 0) 0x7f3b04009990 con 0x7f3b0c074d70 2019-11-28T11:53:52.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b0affd700 1 -- 172.21.15.80:0/1033472999 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aec0030b0 con 0x7f3b0c074d70 2019-11-28T11:53:52.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b11a9f700 1 -- 172.21.15.80:0/1033472999 >> v1:172.21.15.174:6789/0 conn(0x7f3b0c074d70 legacy=0x7f3b0c12db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:52.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b0affd700 1 -- 172.21.15.80:0/1033472999 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3127449108 0 0) 0x7f3b000017c0 con 0x7f3b0c073290 2019-11-28T11:53:52.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b11a9f700 1 -- 172.21.15.80:0/1033472999 >> v1:172.21.15.80:6789/0 conn(0x7f3b0c073290 legacy=0x7f3b0c075520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:52.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b11a9f700 1 -- 172.21.15.80:0/1033472999 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c07ae50 con 0x7f3b0c0743a0 2019-11-28T11:53:52.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b11a9f700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b0c0743a0 0x7f3b0c074830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3afc010380 tx=0x7f3afc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:52.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b11a9f700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b0c0743a0 0x7f3b0c074830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3afc010380 tx=0x7f3afc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:52.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.145+0000 7f3b11a9f700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b0c0743a0 0x7f3b0c074830 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f3afc010380 tx=0x7f3afc010720).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:52.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.146+0000 7f3b11a9f700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b0c0743a0 0x7f3b0c074830 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f3afc010380 tx=0x7f3afc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:52.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.146+0000 7f3b0affd700 1 -- 172.21.15.80:0/1033472999 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3afc00f1d0 con 0x7f3b0c0743a0 2019-11-28T11:53:52.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.146+0000 7f3b11a9f700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b0c0743a0 0x7f3b0c074830 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f3afc010380 tx=0x7f3afc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:52.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.146+0000 7f3b11a9f700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b0c0743a0 0x7f3b0c074830 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f3afc010380 tx=0x7f3afc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:52.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.146+0000 7f3b0affd700 1 -- 172.21.15.80:0/1033472999 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc00ed50 con 0x7f3b0c0743a0 2019-11-28T11:53:52.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.146+0000 7f3b13d03700 1 -- 172.21.15.80:0/1033472999 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0c07b1d0 con 0x7f3b0c0743a0 2019-11-28T11:53:52.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.146+0000 7f3b0affd700 1 -- 172.21.15.80:0/1033472999 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3afc000c90 con 0x7f3b0c0743a0 2019-11-28T11:53:52.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.146+0000 7f3b13d03700 1 -- 172.21.15.80:0/1033472999 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c07ae50 con 0x7f3b0c0743a0 2019-11-28T11:53:52.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.146+0000 7f3b11a9f700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b0c0743a0 0x7f3b0c074830 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f3afc010380 tx=0x7f3afc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:52.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.146+0000 7f3b0affd700 1 -- 172.21.15.80:0/1033472999 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3afc00f1f0 con 0x7f3b0c0743a0 2019-11-28T11:53:52.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.146+0000 7f3b11a9f700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b0c0743a0 0x7f3b0c074830 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f3afc010380 tx=0x7f3afc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:52.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.146+0000 7f3b0affd700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3aec018750 0x7f3aec01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:52.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.146+0000 7f3b0affd700 1 -- 172.21.15.80:0/1033472999 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5797+0+0 (secure 0 0 0) 0x7f3afc031a20 con 0x7f3b0c0743a0 2019-11-28T11:53:52.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.147+0000 7f3b122a0700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3aec018750 0x7f3aec01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:52.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.147+0000 7f3b122a0700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3aec018750 0x7f3aec01abe0 crc :-1 s=READY pgs=1002 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:52.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.154+0000 7f3b13d03700 1 -- 172.21.15.80:0/1033472999 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0c07b1d0 con 0x7f3b0c0743a0 2019-11-28T11:53:52.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.158+0000 7f3b11a9f700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b0c0743a0 0x7f3b0c074830 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f3afc010380 tx=0x7f3afc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:52.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.158+0000 7f3b0affd700 1 -- 172.21.15.80:0/1033472999 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3afc00efe0 con 0x7f3b0c0743a0 2019-11-28T11:53:52.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.325+0000 7f3b13d03700 1 -- 172.21.15.80:0/1033472999 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3b0c07ae50 con 0x7f3b0c0743a0 2019-11-28T11:53:53.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.955+0000 7f3b11a9f700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b0c0743a0 0x7f3b0c074830 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f3afc010380 tx=0x7f3afc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:53.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.955+0000 7f3b0affd700 1 -- 172.21.15.80:0/1033472999 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v185) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3afc017390 con 0x7f3b0c0743a0 2019-11-28T11:53:53.044 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:53:53.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.992+0000 7f3b13d03700 1 -- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3aec018750 msgr2=0x7f3aec01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:53.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.992+0000 7f3b13d03700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3aec018750 0x7f3aec01abe0 crc :-1 s=READY pgs=1002 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:53.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.992+0000 7f3b13d03700 1 -- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b0c0743a0 msgr2=0x7f3b0c074830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:53.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.992+0000 7f3b13d03700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b0c0743a0 0x7f3b0c074830 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f3afc010380 tx=0x7f3afc010720).stop 2019-11-28T11:53:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.992+0000 7f3b13d03700 1 -- 172.21.15.80:0/1033472999 shutdown_connections 2019-11-28T11:53:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.992+0000 7f3b13d03700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3aec018750 0x7f3aec01abe0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.992+0000 7f3b13d03700 1 --2- 172.21.15.80:0/1033472999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b0c0743a0 0x7f3b0c074830 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.992+0000 7f3b13d03700 1 -- 172.21.15.80:0/1033472999 shutdown_connections 2019-11-28T11:53:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.992+0000 7f3b13d03700 1 -- 172.21.15.80:0/1033472999 wait complete. 2019-11-28T11:53:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:52.992+0000 7f3b13d03700 1 -- 172.21.15.80:0/1033472999 >> 172.21.15.80:0/1033472999 conn(0x7f3b0c147670 msgr2=0x7f3b0c1641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:53.057 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:53:53.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.125+0000 7fd2706c6700 1 Processor -- start 2019-11-28T11:53:53.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.125+0000 7fd2706c6700 1 -- start start 2019-11-28T11:53:53.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd2706c6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd26806c490 0x7fd26806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:53.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd2706c6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd26806ce60 0x7fd268164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:53.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd2706c6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26806db00 con 0x7fd26806c0a0 2019-11-28T11:53:53.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd2706c6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd26806fd60 con 0x7fd26806c490 2019-11-28T11:53:53.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd2706c6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd268070030 con 0x7fd26806ce60 2019-11-28T11:53:53.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd26e462700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd26806c490 0x7fd26806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:53.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd26e462700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd26806c490 0x7fd26806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44394/0 (socket says 172.21.15.80:44394) 2019-11-28T11:53:53.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd26e462700 1 -- 172.21.15.80:0/3058348713 learned_addr learned my addr 172.21.15.80:0/3058348713 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:53.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd26f464700 1 --2- 172.21.15.80:0/3058348713 >> v2:172.21.15.174:3300/0 conn(0x7fd26806ce60 0x7fd268164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:53.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd26e462700 1 -- 172.21.15.80:0/3058348713 >> v2:172.21.15.174:3300/0 conn(0x7fd26806ce60 msgr2=0x7fd268164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd26e462700 1 --2- 172.21.15.80:0/3058348713 >> v2:172.21.15.174:3300/0 conn(0x7fd26806ce60 0x7fd268164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd26e462700 1 -- 172.21.15.80:0/3058348713 >> v1:172.21.15.80:6789/0 conn(0x7fd26806c0a0 legacy=0x7fd268072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd26e462700 1 -- 172.21.15.80:0/3058348713 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2680706c0 con 0x7fd26806c490 2019-11-28T11:53:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd26dc61700 1 -- 172.21.15.80:0/3058348713 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033215052 0 0) 0x7fd260001100 con 0x7fd26806c0a0 2019-11-28T11:53:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd26e462700 1 --2- 172.21.15.80:0/3058348713 >> v2:172.21.15.80:3300/0 conn(0x7fd26806c490 0x7fd26806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd25800fa40 tx=0x7fd25800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd26e462700 1 --2- 172.21.15.80:0/3058348713 >> v2:172.21.15.80:3300/0 conn(0x7fd26806c490 0x7fd26806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd25800fa40 tx=0x7fd25800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd26e462700 1 --2- 172.21.15.80:0/3058348713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26806c490 0x7fd26806c920 secure :-1 s=READY pgs=2441 cs=0 l=1 rx=0x7fd25800fa40 tx=0x7fd25800fde0).ready entity=mon.0 client_cookie=6e34844d3ae35e8b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:53.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd26e462700 1 --2- 172.21.15.80:0/3058348713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26806c490 0x7fd26806c920 secure :-1 s=THROTTLE_DONE pgs=2441 cs=0 l=1 rx=0x7fd25800fa40 tx=0x7fd25800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:53.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd26dc61700 1 -- 172.21.15.80:0/3058348713 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd258000ce0 con 0x7fd26806c490 2019-11-28T11:53:53.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd26e462700 1 --2- 172.21.15.80:0/3058348713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26806c490 0x7fd26806c920 secure :-1 s=THROTTLE_DONE pgs=2441 cs=0 l=1 rx=0x7fd25800fa40 tx=0x7fd25800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:53.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.126+0000 7fd26e462700 1 --2- 172.21.15.80:0/3058348713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26806c490 0x7fd26806c920 secure :-1 s=THROTTLE_DONE pgs=2441 cs=0 l=1 rx=0x7fd25800fa40 tx=0x7fd25800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:53.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.127+0000 7fd26dc61700 1 -- 172.21.15.80:0/3058348713 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd258001010 con 0x7fd26806c490 2019-11-28T11:53:53.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.127+0000 7fd26dc61700 1 -- 172.21.15.80:0/3058348713 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd258001720 con 0x7fd26806c490 2019-11-28T11:53:53.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.127+0000 7fd2706c6700 1 -- 172.21.15.80:0/3058348713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26806c490 msgr2=0x7fd26806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:53.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.127+0000 7fd2706c6700 1 --2- 172.21.15.80:0/3058348713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26806c490 0x7fd26806c920 secure :-1 s=READY pgs=2441 cs=0 l=1 rx=0x7fd25800fa40 tx=0x7fd25800fde0).stop 2019-11-28T11:53:53.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.127+0000 7fd2706c6700 1 -- 172.21.15.80:0/3058348713 shutdown_connections 2019-11-28T11:53:53.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.127+0000 7fd2706c6700 1 --2- 172.21.15.80:0/3058348713 >> v2:172.21.15.174:3300/0 conn(0x7fd26806ce60 0x7fd268164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:53.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.127+0000 7fd2706c6700 1 --2- 172.21.15.80:0/3058348713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26806c490 0x7fd26806c920 unknown :-1 s=CLOSED pgs=2441 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:53.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.127+0000 7fd2706c6700 1 -- 172.21.15.80:0/3058348713 shutdown_connections 2019-11-28T11:53:53.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.127+0000 7fd2706c6700 1 -- 172.21.15.80:0/3058348713 wait complete. 2019-11-28T11:53:53.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.127+0000 7fd2706c6700 1 -- 172.21.15.80:0/3058348713 >> 172.21.15.80:0/3058348713 conn(0x7fd268061cf0 msgr2=0x7fd268064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:53.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.130+0000 7fd2706c6700 1 Processor -- start 2019-11-28T11:53:53.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.130+0000 7fd2706c6700 1 -- start start 2019-11-28T11:53:53.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd2706c6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd26813a780 0x7fd26812d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:53.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd2706c6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd26812d9c0 0x7fd26812c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:53.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd2706c6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd268139a60 con 0x7fd26812c840 2019-11-28T11:53:53.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd2706c6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd268129830 con 0x7fd26812d9c0 2019-11-28T11:53:53.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd2706c6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26812a260 con 0x7fd26813a780 2019-11-28T11:53:53.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd26e462700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd26812d9c0 0x7fd26812c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:53.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd26e462700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd26812d9c0 0x7fd26812c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44398/0 (socket says 172.21.15.80:44398) 2019-11-28T11:53:53.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd26e462700 1 -- 172.21.15.80:0/2885782918 learned_addr learned my addr 172.21.15.80:0/2885782918 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:53.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd26ec63700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd26813a780 0x7fd26812d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:53.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd26e462700 1 -- 172.21.15.80:0/2885782918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd26813a780 msgr2=0x7fd26812d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:53.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd26e462700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd26813a780 0x7fd26812d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:53.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd26e462700 1 -- 172.21.15.80:0/2885782918 >> v1:172.21.15.174:6789/0 conn(0x7fd26812c840 legacy=0x7fd2681281b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:53.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd26e462700 1 -- 172.21.15.80:0/2885782918 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26812abc0 con 0x7fd26812d9c0 2019-11-28T11:53:53.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd26e462700 1 --2- 172.21.15.80:0/2885782918 >> v2:172.21.15.80:3300/0 conn(0x7fd26812d9c0 0x7fd26812c300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2580107c0 tx=0x7fd258010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:53.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd26e462700 1 --2- 172.21.15.80:0/2885782918 >> v2:172.21.15.80:3300/0 conn(0x7fd26812d9c0 0x7fd26812c300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2580107c0 tx=0x7fd258010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:53.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd26e462700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26812d9c0 0x7fd26812c300 secure :-1 s=READY pgs=2442 cs=0 l=1 rx=0x7fd2580107c0 tx=0x7fd258010670).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:53.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd26e462700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26812d9c0 0x7fd26812c300 secure :-1 s=THROTTLE_DONE pgs=2442 cs=0 l=1 rx=0x7fd2580107c0 tx=0x7fd258010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:53.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd26e462700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26812d9c0 0x7fd26812c300 secure :-1 s=THROTTLE_DONE pgs=2442 cs=0 l=1 rx=0x7fd2580107c0 tx=0x7fd258010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:53.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd26e462700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26812d9c0 0x7fd26812c300 secure :-1 s=THROTTLE_DONE pgs=2442 cs=0 l=1 rx=0x7fd2580107c0 tx=0x7fd258010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:53.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd2677fe700 1 -- 172.21.15.80:0/2885782918 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd258000cc0 con 0x7fd26812d9c0 2019-11-28T11:53:53.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd2677fe700 1 -- 172.21.15.80:0/2885782918 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2580012d0 con 0x7fd26812d9c0 2019-11-28T11:53:53.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd2706c6700 1 -- 172.21.15.80:0/2885782918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd26812af40 con 0x7fd26812d9c0 2019-11-28T11:53:53.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd2677fe700 1 -- 172.21.15.80:0/2885782918 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2580018e0 con 0x7fd26812d9c0 2019-11-28T11:53:53.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.131+0000 7fd2706c6700 1 -- 172.21.15.80:0/2885782918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd26812abc0 con 0x7fd26812d9c0 2019-11-28T11:53:53.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.132+0000 7fd26e462700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26812d9c0 0x7fd26812c300 secure :-1 s=THROTTLE_DONE pgs=2442 cs=0 l=1 rx=0x7fd2580107c0 tx=0x7fd258010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:53.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.132+0000 7fd2677fe700 1 -- 172.21.15.80:0/2885782918 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd2580014c0 con 0x7fd26812d9c0 2019-11-28T11:53:53.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.132+0000 7fd26e462700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26812d9c0 0x7fd26812c300 secure :-1 s=THROTTLE_DONE pgs=2442 cs=0 l=1 rx=0x7fd2580107c0 tx=0x7fd258010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:53.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.132+0000 7fd2677fe700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd24c018730 0x7fd24c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:53.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.132+0000 7fd2677fe700 1 -- 172.21.15.80:0/2885782918 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5415+0+0 (secure 0 0 0) 0x7fd258031df0 con 0x7fd26812d9c0 2019-11-28T11:53:53.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.132+0000 7fd26ec63700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd24c018730 0x7fd24c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:53.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.132+0000 7fd26ec63700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd24c018730 0x7fd24c01abc0 crc :-1 s=READY pgs=1003 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:53.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.140+0000 7fd2706c6700 1 -- 172.21.15.80:0/2885782918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26812af40 con 0x7fd26812d9c0 2019-11-28T11:53:53.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.143+0000 7fd26e462700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26812d9c0 0x7fd26812c300 secure :-1 s=THROTTLE_DONE pgs=2442 cs=0 l=1 rx=0x7fd2580107c0 tx=0x7fd258010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:53.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.143+0000 7fd2677fe700 1 -- 172.21.15.80:0/2885782918 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd258000ed0 con 0x7fd26812d9c0 2019-11-28T11:53:53.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.329+0000 7fd2706c6700 1 -- 172.21.15.80:0/2885782918 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fd26812abc0 con 0x7fd26812d9c0 2019-11-28T11:53:54.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.955+0000 7fd26e462700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26812d9c0 0x7fd26812c300 secure :-1 s=THROTTLE_DONE pgs=2442 cs=0 l=1 rx=0x7fd2580107c0 tx=0x7fd258010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.955+0000 7fd2677fe700 1 -- 172.21.15.80:0/2885782918 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v186) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd2580014c0 con 0x7fd26812d9c0 2019-11-28T11:53:54.049 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:53:54.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.996+0000 7fd2706c6700 1 -- 172.21.15.80:0/2885782918 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd24c018730 msgr2=0x7fd24c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.996+0000 7fd2706c6700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd24c018730 0x7fd24c01abc0 crc :-1 s=READY pgs=1003 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.996+0000 7fd2706c6700 1 -- 172.21.15.80:0/2885782918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26812d9c0 msgr2=0x7fd26812c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.996+0000 7fd2706c6700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26812d9c0 0x7fd26812c300 secure :-1 s=READY pgs=2442 cs=0 l=1 rx=0x7fd2580107c0 tx=0x7fd258010670).stop 2019-11-28T11:53:54.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.996+0000 7fd2706c6700 1 -- 172.21.15.80:0/2885782918 shutdown_connections 2019-11-28T11:53:54.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.996+0000 7fd2706c6700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd24c018730 0x7fd24c01abc0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.996+0000 7fd2706c6700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd26812d9c0 0x7fd26812c300 unknown :-1 s=CLOSED pgs=2442 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.996+0000 7fd2706c6700 1 --2- 172.21.15.80:0/2885782918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd26813a780 0x7fd26812d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.996+0000 7fd2706c6700 1 -- 172.21.15.80:0/2885782918 shutdown_connections 2019-11-28T11:53:54.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.996+0000 7fd2706c6700 1 -- 172.21.15.80:0/2885782918 wait complete. 2019-11-28T11:53:54.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:53.996+0000 7fd2706c6700 1 -- 172.21.15.80:0/2885782918 >> 172.21.15.80:0/2885782918 conn(0x7fd268127dc0 msgr2=0x7fd268141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:54.062 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:53:54.062 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:53:54.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.126+0000 7f73add37700 1 Processor -- start 2019-11-28T11:53:54.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.126+0000 7f73add37700 1 -- start start 2019-11-28T11:53:54.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.127+0000 7f73add37700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f73a806c490 0x7f73a806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:54.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.127+0000 7f73add37700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73a806ce60 0x7f73a8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:54.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.127+0000 7f73add37700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a806db00 con 0x7f73a806c0a0 2019-11-28T11:53:54.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.127+0000 7f73add37700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a806fd60 con 0x7f73a806c490 2019-11-28T11:53:54.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.127+0000 7f73add37700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a8070030 con 0x7f73a806ce60 2019-11-28T11:53:54.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.127+0000 7f739ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f73a806c490 0x7f73a806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:54.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.127+0000 7f73acad5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73a806ce60 0x7f73a8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:54.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.127+0000 7f739ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f73a806c490 0x7f73a806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:59290/0 (socket says 172.21.15.80:59290) 2019-11-28T11:53:54.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.127+0000 7f73acad5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73a806ce60 0x7f73a8164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:46668/0 (socket says 172.21.15.80:46668) 2019-11-28T11:53:54.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.127+0000 7f739ffff700 1 -- 172.21.15.80:0/411178219 learned_addr learned my addr 172.21.15.80:0/411178219 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:54.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.128+0000 7f73acad5700 1 -- 172.21.15.80:0/411178219 >> v2:172.21.15.174:3300/0 conn(0x7f73a806c490 msgr2=0x7f73a806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:54.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.128+0000 7f73acad5700 1 --2- 172.21.15.80:0/411178219 >> v2:172.21.15.174:3300/0 conn(0x7f73a806c490 0x7f73a806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:54.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.128+0000 7f73acad5700 1 -- 172.21.15.80:0/411178219 >> v1:172.21.15.174:6789/0 conn(0x7f73a806c0a0 legacy=0x7f73a8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.128+0000 7f73acad5700 1 -- 172.21.15.80:0/411178219 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a80706c0 con 0x7f73a806ce60 2019-11-28T11:53:54.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.128+0000 7f739ffff700 1 --2- 172.21.15.80:0/411178219 >> v2:172.21.15.174:3300/0 conn(0x7f73a806c490 0x7f73a806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:54.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.128+0000 7f73acad5700 1 --2- 172.21.15.80:0/411178219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73a806ce60 0x7f73a8164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f73a000b300 tx=0x7f73a000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.128+0000 7f73acad5700 1 --2- 172.21.15.80:0/411178219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73a806ce60 0x7f73a8164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f73a000b300 tx=0x7f73a000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.128+0000 7f73acad5700 1 --2- 172.21.15.80:0/411178219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73a806ce60 0x7f73a8164d70 secure :-1 s=READY pgs=349 cs=0 l=1 rx=0x7f73a000b300 tx=0x7f73a000bb10).ready entity=mon.2 client_cookie=38f752238686a67e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:54.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.128+0000 7f73acad5700 1 --2- 172.21.15.80:0/411178219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73a806ce60 0x7f73a8164d70 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7f73a000b300 tx=0x7f73a000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.128+0000 7f73acad5700 1 --2- 172.21.15.80:0/411178219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73a806ce60 0x7f73a8164d70 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7f73a000b300 tx=0x7f73a000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.128+0000 7f73a77fe700 1 -- 172.21.15.80:0/411178219 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73a0000f40 con 0x7f73a806ce60 2019-11-28T11:53:54.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.128+0000 7f73acad5700 1 --2- 172.21.15.80:0/411178219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73a806ce60 0x7f73a8164d70 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7f73a000b300 tx=0x7f73a000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.128+0000 7f73a77fe700 1 -- 172.21.15.80:0/411178219 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a0009b70 con 0x7f73a806ce60 2019-11-28T11:53:54.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.128+0000 7f73a77fe700 1 -- 172.21.15.80:0/411178219 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73a000a240 con 0x7f73a806ce60 2019-11-28T11:53:54.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.128+0000 7f73add37700 1 -- 172.21.15.80:0/411178219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73a806ce60 msgr2=0x7f73a8164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.128+0000 7f73add37700 1 --2- 172.21.15.80:0/411178219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73a806ce60 0x7f73a8164d70 secure :-1 s=READY pgs=349 cs=0 l=1 rx=0x7f73a000b300 tx=0x7f73a000bb10).stop 2019-11-28T11:53:54.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.129+0000 7f73add37700 1 -- 172.21.15.80:0/411178219 shutdown_connections 2019-11-28T11:53:54.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.129+0000 7f73add37700 1 --2- 172.21.15.80:0/411178219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73a806ce60 0x7f73a8164d70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.129+0000 7f73add37700 1 --2- 172.21.15.80:0/411178219 >> v2:172.21.15.174:3300/0 conn(0x7f73a806c490 0x7f73a806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:54.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.129+0000 7f73add37700 1 -- 172.21.15.80:0/411178219 shutdown_connections 2019-11-28T11:53:54.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.129+0000 7f73add37700 1 -- 172.21.15.80:0/411178219 wait complete. 2019-11-28T11:53:54.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.129+0000 7f73add37700 1 -- 172.21.15.80:0/411178219 >> 172.21.15.80:0/411178219 conn(0x7f73a8061cf0 msgr2=0x7f73a8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:54.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.131+0000 7f73add37700 1 Processor -- start 2019-11-28T11:53:54.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.131+0000 7f73add37700 1 -- start start 2019-11-28T11:53:54.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.132+0000 7f73add37700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f73a813eb40 0x7f73a810afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:54.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.132+0000 7f73add37700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f73a810b500 0x7f73a81629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:54.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.132+0000 7f73add37700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a813f1e0 con 0x7f73a8162f30 2019-11-28T11:53:54.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.132+0000 7f73add37700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a81234c0 con 0x7f73a810b500 2019-11-28T11:53:54.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.132+0000 7f73add37700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a813e0d0 con 0x7f73a813eb40 2019-11-28T11:53:54.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.132+0000 7f739ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f73a810b500 0x7f73a81629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:54.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.132+0000 7f73acad5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f73a8162f30 0x7f73a8109e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43730/0 (socket says 172.21.15.80:43730) 2019-11-28T11:53:54.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.132+0000 7f73acad5700 1 -- 172.21.15.80:0/2439250000 learned_addr learned my addr 172.21.15.80:0/2439250000 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:54.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.132+0000 7f739ffff700 1 --2- 172.21.15.80:0/2439250000 >> v2:172.21.15.80:3300/0 conn(0x7f73a810b500 0x7f73a81629f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44412/0 (socket says 172.21.15.80:44412) 2019-11-28T11:53:54.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.132+0000 7f73a7fff700 1 --2- 172.21.15.80:0/2439250000 >> v2:172.21.15.174:3300/0 conn(0x7f73a813eb40 0x7f73a810afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:54.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f739ffff700 1 -- 172.21.15.80:0/2439250000 >> v2:172.21.15.174:3300/0 conn(0x7f73a813eb40 msgr2=0x7f73a810afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f739ffff700 1 --2- 172.21.15.80:0/2439250000 >> v2:172.21.15.174:3300/0 conn(0x7f73a813eb40 0x7f73a810afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f739ffff700 1 -- 172.21.15.80:0/2439250000 >> v1:172.21.15.80:6789/0 conn(0x7f73a8162f30 legacy=0x7f73a8109e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f739ffff700 1 -- 172.21.15.80:0/2439250000 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a8108700 con 0x7f73a810b500 2019-11-28T11:53:54.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f73a57fa700 1 -- 172.21.15.80:0/2439250000 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460813556 0 0) 0x7f73a000b370 con 0x7f73a8162f30 2019-11-28T11:53:54.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f739ffff700 1 --2- 172.21.15.80:0/2439250000 >> v2:172.21.15.80:3300/0 conn(0x7f73a810b500 0x7f73a81629f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7390010390 tx=0x7f7390010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f739ffff700 1 --2- 172.21.15.80:0/2439250000 >> v2:172.21.15.80:3300/0 conn(0x7f73a810b500 0x7f73a81629f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7390010390 tx=0x7f7390010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f739ffff700 1 --2- 172.21.15.80:0/2439250000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73a810b500 0x7f73a81629f0 secure :-1 s=READY pgs=2444 cs=0 l=1 rx=0x7f7390010390 tx=0x7f7390010190).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:54.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f739ffff700 1 --2- 172.21.15.80:0/2439250000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73a810b500 0x7f73a81629f0 secure :-1 s=THROTTLE_DONE pgs=2444 cs=0 l=1 rx=0x7f7390010390 tx=0x7f7390010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f73a57fa700 1 -- 172.21.15.80:0/2439250000 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7390000ea0 con 0x7f73a810b500 2019-11-28T11:53:54.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f739ffff700 1 --2- 172.21.15.80:0/2439250000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73a810b500 0x7f73a81629f0 secure :-1 s=THROTTLE_DONE pgs=2444 cs=0 l=1 rx=0x7f7390010390 tx=0x7f7390010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f739ffff700 1 --2- 172.21.15.80:0/2439250000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73a810b500 0x7f73a81629f0 secure :-1 s=THROTTLE_DONE pgs=2444 cs=0 l=1 rx=0x7f7390010390 tx=0x7f7390010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f73a57fa700 1 -- 172.21.15.80:0/2439250000 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7390007580 con 0x7f73a810b500 2019-11-28T11:53:54.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f73add37700 1 -- 172.21.15.80:0/2439250000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a8108a80 con 0x7f73a810b500 2019-11-28T11:53:54.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f73a57fa700 1 -- 172.21.15.80:0/2439250000 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7390001480 con 0x7f73a810b500 2019-11-28T11:53:54.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f73add37700 1 -- 172.21.15.80:0/2439250000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a8108700 con 0x7f73a810b500 2019-11-28T11:53:54.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.133+0000 7f739ffff700 1 --2- 172.21.15.80:0/2439250000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73a810b500 0x7f73a81629f0 secure :-1 s=THROTTLE_DONE pgs=2444 cs=0 l=1 rx=0x7f7390010390 tx=0x7f7390010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.134+0000 7f73a57fa700 1 -- 172.21.15.80:0/2439250000 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7390000ea0 con 0x7f73a810b500 2019-11-28T11:53:54.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.134+0000 7f739ffff700 1 --2- 172.21.15.80:0/2439250000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73a810b500 0x7f73a81629f0 secure :-1 s=THROTTLE_DONE pgs=2444 cs=0 l=1 rx=0x7f7390010390 tx=0x7f7390010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.134+0000 7f73a57fa700 1 --2- 172.21.15.80:0/2439250000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f738c018730 0x7f738c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:54.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.134+0000 7f73a57fa700 1 -- 172.21.15.80:0/2439250000 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f73900319d0 con 0x7f73a810b500 2019-11-28T11:53:54.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.134+0000 7f73a7fff700 1 --2- 172.21.15.80:0/2439250000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f738c018730 0x7f738c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:54.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.134+0000 7f73a7fff700 1 --2- 172.21.15.80:0/2439250000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f738c018730 0x7f738c01abc0 crc :-1 s=READY pgs=1004 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:54.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.141+0000 7f73add37700 1 -- 172.21.15.80:0/2439250000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a8108a80 con 0x7f73a810b500 2019-11-28T11:53:54.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.145+0000 7f739ffff700 1 --2- 172.21.15.80:0/2439250000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73a810b500 0x7f73a81629f0 secure :-1 s=THROTTLE_DONE pgs=2444 cs=0 l=1 rx=0x7f7390010390 tx=0x7f7390010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.145+0000 7f73a57fa700 1 -- 172.21.15.80:0/2439250000 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7390000c90 con 0x7f73a810b500 2019-11-28T11:53:54.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.314+0000 7f73add37700 1 -- 172.21.15.80:0/2439250000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f73a8108700 con 0x7f73a810b500 2019-11-28T11:53:54.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.315+0000 7f739ffff700 1 --2- 172.21.15.80:0/2439250000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73a810b500 0x7f73a81629f0 secure :-1 s=THROTTLE_DONE pgs=2444 cs=0 l=1 rx=0x7f7390010390 tx=0x7f7390010190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.315+0000 7f73a57fa700 1 -- 172.21.15.80:0/2439250000 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v63) v1 ==== 80+0+4797 (secure 0 0 0) 0x7f739002ccf0 con 0x7f73a810b500 2019-11-28T11:53:54.371 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:54.371 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:53:54.371 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:53:54.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.372 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:53:54.372 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:53:54.372 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.372 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:53:54.372 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:53:54.372 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:53:54.373 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:53:54.373 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.373 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:53:54.373 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:53:54.373 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.374 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:53:54.374 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:53:54.374 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:53:54.374 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:53:54.374 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.375 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:53:54.375 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:53:54.375 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.375 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:53:54.375 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:53:54.375 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:53:54.375 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:53:54.376 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.376 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:53:54.376 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:53:54.376 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.376 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:53:54.376 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:53:54.377 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:53:54.377 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.377 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:53:54.377 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:53:54.378 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.378 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:53:54.378 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:53:54.378 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:53:54.378 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.378 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:53:54.379 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:53:54.379 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.379 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:53:54.379 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:53:54.379 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:53:54.379 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.380 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:53:54.380 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:53:54.380 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.380 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:53:54.380 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:53:54.381 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:53:54.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.381 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:53:54.381 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:53:54.381 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.382 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:53:54.382 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:53:54.382 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:53:54.382 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.382 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:53:54.383 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:53:54.383 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.383 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:53:54.383 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:53:54.383 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:53:54.383 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.384 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:53:54.384 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:53:54.384 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.384 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:53:54.384 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:53:54.384 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:53:54.384 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.385 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:53:54.385 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:53:54.385 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.385 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:53:54.385 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:53:54.386 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:53:54.386 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.386 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:53:54.386 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:53:54.386 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.387 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:53:54.387 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:53:54.387 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:53:54.387 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.388 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:53:54.388 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:53:54.388 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.388 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:53:54.388 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:53:54.388 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:53:54.388 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.389 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:53:54.389 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:53:54.389 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.389 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:53:54.390 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:53:54.390 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:53:54.390 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.390 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:53:54.390 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:53:54.391 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.391 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:53:54.391 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:53:54.391 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:53:54.391 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.392 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:53:54.392 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:53:54.392 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.392 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:53:54.392 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:53:54.392 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:53:54.392 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:53:54.393 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.393 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:53:54.393 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:53:54.393 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.393 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:53:54.394 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:53:54.394 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:53:54.394 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:53:54.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:54.394 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:53:54.394 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:53:54.395 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:53:54.395 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:53:54.395 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:53:54.395 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:53:54.395 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.395 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:54.395 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:53:54.396 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:53:54.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.317+0000 7f73add37700 1 -- 172.21.15.80:0/2439250000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f738c018730 msgr2=0x7f738c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.317+0000 7f73add37700 1 --2- 172.21.15.80:0/2439250000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f738c018730 0x7f738c01abc0 crc :-1 s=READY pgs=1004 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.317+0000 7f73add37700 1 -- 172.21.15.80:0/2439250000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73a810b500 msgr2=0x7f73a81629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.317+0000 7f73add37700 1 --2- 172.21.15.80:0/2439250000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73a810b500 0x7f73a81629f0 secure :-1 s=READY pgs=2444 cs=0 l=1 rx=0x7f7390010390 tx=0x7f7390010190).stop 2019-11-28T11:53:54.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.317+0000 7f73add37700 1 -- 172.21.15.80:0/2439250000 shutdown_connections 2019-11-28T11:53:54.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.317+0000 7f73add37700 1 --2- 172.21.15.80:0/2439250000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f738c018730 0x7f738c01abc0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.317+0000 7f73add37700 1 --2- 172.21.15.80:0/2439250000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73a810b500 0x7f73a81629f0 unknown :-1 s=CLOSED pgs=2444 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.317+0000 7f73add37700 1 --2- 172.21.15.80:0/2439250000 >> v2:172.21.15.174:3300/0 conn(0x7f73a813eb40 0x7f73a810afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.317+0000 7f73add37700 1 -- 172.21.15.80:0/2439250000 shutdown_connections 2019-11-28T11:53:54.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.317+0000 7f73add37700 1 -- 172.21.15.80:0/2439250000 wait complete. 2019-11-28T11:53:54.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.317+0000 7f73add37700 1 -- 172.21.15.80:0/2439250000 >> 172.21.15.80:0/2439250000 conn(0x7f73a811bfc0 msgr2=0x7f73a8141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:54.399 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:53:54.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.463+0000 7fb90288f700 1 Processor -- start 2019-11-28T11:53:54.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.463+0000 7fb90288f700 1 -- start start 2019-11-28T11:53:54.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.464+0000 7fb90288f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb8fc06c0a0 0x7fb8fc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:54.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.464+0000 7fb90288f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8fc06db00 con 0x7fb8fc072620 2019-11-28T11:53:54.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.464+0000 7fb90288f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8fc06e000 con 0x7fb8fc0734e0 2019-11-28T11:53:54.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.464+0000 7fb90288f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8fc06fd60 con 0x7fb8fc06c0a0 2019-11-28T11:53:54.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.464+0000 7fb900e2c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb8fc06c0a0 0x7fb8fc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:54.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.464+0000 7fb900e2c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb8fc06c0a0 0x7fb8fc072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44418/0 (socket says 172.21.15.80:44418) 2019-11-28T11:53:54.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.464+0000 7fb90162d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb8fc072620 0x7fb8fc164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43738/0 (socket says 172.21.15.80:43738) 2019-11-28T11:53:54.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.464+0000 7fb900e2c700 1 -- 172.21.15.80:0/3236941325 learned_addr learned my addr 172.21.15.80:0/3236941325 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:54.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.465+0000 7fb900e2c700 1 -- 172.21.15.80:0/3236941325 >> v1:172.21.15.174:6789/0 conn(0x7fb8fc0734e0 legacy=0x7fb8fc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.465+0000 7fb900e2c700 1 -- 172.21.15.80:0/3236941325 >> v1:172.21.15.80:6789/0 conn(0x7fb8fc072620 legacy=0x7fb8fc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.465+0000 7fb8fb7fe700 1 -- 172.21.15.80:0/3236941325 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147002203 0 0) 0x7fb8ec001400 con 0x7fb8fc0734e0 2019-11-28T11:53:54.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.465+0000 7fb900e2c700 1 -- 172.21.15.80:0/3236941325 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc0706c0 con 0x7fb8fc06c0a0 2019-11-28T11:53:54.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.465+0000 7fb900e2c700 1 --2- 172.21.15.80:0/3236941325 >> v2:172.21.15.80:3300/0 conn(0x7fb8fc06c0a0 0x7fb8fc072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb8e400f740 tx=0x7fb8e400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.465+0000 7fb900e2c700 1 --2- 172.21.15.80:0/3236941325 >> v2:172.21.15.80:3300/0 conn(0x7fb8fc06c0a0 0x7fb8fc072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb8e400f740 tx=0x7fb8e400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.465+0000 7fb900e2c700 1 --2- 172.21.15.80:0/3236941325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc06c0a0 0x7fb8fc072fa0 secure :-1 s=READY pgs=2446 cs=0 l=1 rx=0x7fb8e400f740 tx=0x7fb8e400fae0).ready entity=mon.0 client_cookie=70cf7d32490cc40f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:54.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.465+0000 7fb900e2c700 1 --2- 172.21.15.80:0/3236941325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc06c0a0 0x7fb8fc072fa0 secure :-1 s=THROTTLE_DONE pgs=2446 cs=0 l=1 rx=0x7fb8e400f740 tx=0x7fb8e400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.465+0000 7fb8fb7fe700 1 -- 172.21.15.80:0/3236941325 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8e4000960 con 0x7fb8fc06c0a0 2019-11-28T11:53:54.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.465+0000 7fb900e2c700 1 --2- 172.21.15.80:0/3236941325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc06c0a0 0x7fb8fc072fa0 secure :-1 s=THROTTLE_DONE pgs=2446 cs=0 l=1 rx=0x7fb8e400f740 tx=0x7fb8e400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.465+0000 7fb8fb7fe700 1 -- 172.21.15.80:0/3236941325 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e4000960 con 0x7fb8fc06c0a0 2019-11-28T11:53:54.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.465+0000 7fb900e2c700 1 --2- 172.21.15.80:0/3236941325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc06c0a0 0x7fb8fc072fa0 secure :-1 s=THROTTLE_DONE pgs=2446 cs=0 l=1 rx=0x7fb8e400f740 tx=0x7fb8e400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.465+0000 7fb8fb7fe700 1 -- 172.21.15.80:0/3236941325 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8e4001070 con 0x7fb8fc06c0a0 2019-11-28T11:53:54.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.465+0000 7fb90288f700 1 -- 172.21.15.80:0/3236941325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc06c0a0 msgr2=0x7fb8fc072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.465+0000 7fb90288f700 1 --2- 172.21.15.80:0/3236941325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc06c0a0 0x7fb8fc072fa0 secure :-1 s=READY pgs=2446 cs=0 l=1 rx=0x7fb8e400f740 tx=0x7fb8e400fae0).stop 2019-11-28T11:53:54.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.466+0000 7fb90288f700 1 -- 172.21.15.80:0/3236941325 shutdown_connections 2019-11-28T11:53:54.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.466+0000 7fb90288f700 1 --2- 172.21.15.80:0/3236941325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc06c0a0 0x7fb8fc072fa0 unknown :-1 s=CLOSED pgs=2446 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.466+0000 7fb90288f700 1 -- 172.21.15.80:0/3236941325 shutdown_connections 2019-11-28T11:53:54.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.466+0000 7fb90288f700 1 -- 172.21.15.80:0/3236941325 wait complete. 2019-11-28T11:53:54.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.466+0000 7fb90288f700 1 -- 172.21.15.80:0/3236941325 >> 172.21.15.80:0/3236941325 conn(0x7fb8fc061cf0 msgr2=0x7fb8fc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:54.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.468+0000 7fb90288f700 1 Processor -- start 2019-11-28T11:53:54.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.468+0000 7fb90288f700 1 -- start start 2019-11-28T11:53:54.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.469+0000 7fb90288f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8fc111db0 0x7fb8fc1238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:54.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.469+0000 7fb90288f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb8fc165a00 0x7fb8fc167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:54.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.469+0000 7fb90288f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8fc124260 con 0x7fb8fc12cea0 2019-11-28T11:53:54.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.469+0000 7fb90288f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8fc121040 con 0x7fb8fc165a00 2019-11-28T11:53:54.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.469+0000 7fb90288f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc121310 con 0x7fb8fc111db0 2019-11-28T11:53:54.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.469+0000 7fb90162d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb8fc165a00 0x7fb8fc167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:54.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.469+0000 7fb90162d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb8fc165a00 0x7fb8fc167e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44426/0 (socket says 172.21.15.80:44426) 2019-11-28T11:53:54.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.469+0000 7fb90162d700 1 -- 172.21.15.80:0/578555356 learned_addr learned my addr 172.21.15.80:0/578555356 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:54.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.469+0000 7fb8fbfff700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8fc111db0 0x7fb8fc1238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:54.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.469+0000 7fb90162d700 1 -- 172.21.15.80:0/578555356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8fc111db0 msgr2=0x7fb8fc1238e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.469+0000 7fb90162d700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8fc111db0 0x7fb8fc1238e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.469+0000 7fb90162d700 1 -- 172.21.15.80:0/578555356 >> v1:172.21.15.174:6789/0 conn(0x7fb8fc12cea0 legacy=0x7fb8fc1230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.469+0000 7fb90162d700 1 -- 172.21.15.80:0/578555356 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc1219a0 con 0x7fb8fc165a00 2019-11-28T11:53:54.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.469+0000 7fb90162d700 1 --2- 172.21.15.80:0/578555356 >> v2:172.21.15.80:3300/0 conn(0x7fb8fc165a00 0x7fb8fc167e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb8f4010360 tx=0x7fb8f4010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.470+0000 7fb90162d700 1 --2- 172.21.15.80:0/578555356 >> v2:172.21.15.80:3300/0 conn(0x7fb8fc165a00 0x7fb8fc167e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb8f4010360 tx=0x7fb8f4010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.470+0000 7fb90162d700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc165a00 0x7fb8fc167e00 secure :-1 s=READY pgs=2447 cs=0 l=1 rx=0x7fb8f4010360 tx=0x7fb8f4010700).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:54.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.470+0000 7fb90162d700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc165a00 0x7fb8fc167e00 secure :-1 s=THROTTLE_DONE pgs=2447 cs=0 l=1 rx=0x7fb8f4010360 tx=0x7fb8f4010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.470+0000 7fb8f97fa700 1 -- 172.21.15.80:0/578555356 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8f4000940 con 0x7fb8fc165a00 2019-11-28T11:53:54.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.470+0000 7fb90162d700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc165a00 0x7fb8fc167e00 secure :-1 s=THROTTLE_DONE pgs=2447 cs=0 l=1 rx=0x7fb8f4010360 tx=0x7fb8f4010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.470+0000 7fb8f97fa700 1 -- 172.21.15.80:0/578555356 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f4001100 con 0x7fb8fc165a00 2019-11-28T11:53:54.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.470+0000 7fb90162d700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc165a00 0x7fb8fc167e00 secure :-1 s=THROTTLE_DONE pgs=2447 cs=0 l=1 rx=0x7fb8f4010360 tx=0x7fb8f4010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.470+0000 7fb90288f700 1 -- 172.21.15.80:0/578555356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8fc121d20 con 0x7fb8fc165a00 2019-11-28T11:53:54.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.470+0000 7fb8f97fa700 1 -- 172.21.15.80:0/578555356 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8f40075d0 con 0x7fb8fc165a00 2019-11-28T11:53:54.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.470+0000 7fb90288f700 1 -- 172.21.15.80:0/578555356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8fc1219a0 con 0x7fb8fc165a00 2019-11-28T11:53:54.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.470+0000 7fb90162d700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc165a00 0x7fb8fc167e00 secure :-1 s=THROTTLE_DONE pgs=2447 cs=0 l=1 rx=0x7fb8f4010360 tx=0x7fb8f4010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.470+0000 7fb8f97fa700 1 -- 172.21.15.80:0/578555356 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb8f40012f0 con 0x7fb8fc165a00 2019-11-28T11:53:54.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.470+0000 7fb90162d700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc165a00 0x7fb8fc167e00 secure :-1 s=THROTTLE_DONE pgs=2447 cs=0 l=1 rx=0x7fb8f4010360 tx=0x7fb8f4010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.470+0000 7fb8f97fa700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8e0018730 0x7fb8e001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:54.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.470+0000 7fb8f97fa700 1 -- 172.21.15.80:0/578555356 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fb8f4031a50 con 0x7fb8fc165a00 2019-11-28T11:53:54.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.471+0000 7fb900e2c700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8e0018730 0x7fb8e001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:54.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.471+0000 7fb900e2c700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8e0018730 0x7fb8e001abc0 crc :-1 s=READY pgs=1005 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:54.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.478+0000 7fb90288f700 1 -- 172.21.15.80:0/578555356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8fc121d20 con 0x7fb8fc165a00 2019-11-28T11:53:54.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.482+0000 7fb90162d700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc165a00 0x7fb8fc167e00 secure :-1 s=THROTTLE_DONE pgs=2447 cs=0 l=1 rx=0x7fb8f4010360 tx=0x7fb8f4010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.482+0000 7fb8f97fa700 1 -- 172.21.15.80:0/578555356 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb8f402dfb0 con 0x7fb8fc165a00 2019-11-28T11:53:54.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.659+0000 7fb90288f700 1 -- 172.21.15.80:0/578555356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8fc1219a0 con 0x7fb8fc165a00 2019-11-28T11:53:54.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.660+0000 7fb90162d700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc165a00 0x7fb8fc167e00 secure :-1 s=THROTTLE_DONE pgs=2447 cs=0 l=1 rx=0x7fb8f4010360 tx=0x7fb8f4010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.660+0000 7fb8f97fa700 1 -- 172.21.15.80:0/578555356 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+12010 (secure 0 0 0) 0x7fb8f402dfb0 con 0x7fb8fc165a00 2019-11-28T11:53:54.716 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:54.717 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":186,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:53:53.951982+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:53:54.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.662+0000 7fb90288f700 1 -- 172.21.15.80:0/578555356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8e0018730 msgr2=0x7fb8e001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.662+0000 7fb90288f700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8e0018730 0x7fb8e001abc0 crc :-1 s=READY pgs=1005 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.662+0000 7fb90288f700 1 -- 172.21.15.80:0/578555356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc165a00 msgr2=0x7fb8fc167e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.662+0000 7fb90288f700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc165a00 0x7fb8fc167e00 secure :-1 s=READY pgs=2447 cs=0 l=1 rx=0x7fb8f4010360 tx=0x7fb8f4010700).stop 2019-11-28T11:53:54.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.662+0000 7fb90288f700 1 -- 172.21.15.80:0/578555356 shutdown_connections 2019-11-28T11:53:54.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.662+0000 7fb90288f700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8fc165a00 0x7fb8fc167e00 unknown :-1 s=CLOSED pgs=2447 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.662+0000 7fb90288f700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8fc111db0 0x7fb8fc1238e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.662+0000 7fb90288f700 1 --2- 172.21.15.80:0/578555356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb8e0018730 0x7fb8e001abc0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.662+0000 7fb90288f700 1 -- 172.21.15.80:0/578555356 shutdown_connections 2019-11-28T11:53:54.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.662+0000 7fb90288f700 1 -- 172.21.15.80:0/578555356 wait complete. 2019-11-28T11:53:54.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.662+0000 7fb90288f700 1 -- 172.21.15.80:0/578555356 >> 172.21.15.80:0/578555356 conn(0x7fb8fc1426c0 msgr2=0x7fb8fc110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:54.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:53:54.729 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:53:54.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.796+0000 7f8582b8e700 1 Processor -- start 2019-11-28T11:53:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.796+0000 7f8582b8e700 1 -- start start 2019-11-28T11:53:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.797+0000 7f8582b8e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f857c15f100 0x7f857c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.797+0000 7f8582b8e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f857c06c2f0 0x7f857c06c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.797+0000 7f8582b8e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857c06db60 con 0x7f857c15ed10 2019-11-28T11:53:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.797+0000 7f8582b8e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857c06fe00 con 0x7f857c15f100 2019-11-28T11:53:54.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.797+0000 7f8582b8e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0700d0 con 0x7f857c06c2f0 2019-11-28T11:53:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.797+0000 7f858092a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f857c15f100 0x7f857c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.797+0000 7f858092a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f857c15f100 0x7f857c06bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44434/0 (socket says 172.21.15.80:44434) 2019-11-28T11:53:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.797+0000 7f858092a700 1 -- 172.21.15.80:0/2246371266 learned_addr learned my addr 172.21.15.80:0/2246371266 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f858192c700 1 --2- 172.21.15.80:0/2246371266 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f857c06c2f0 0x7f857c06c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f858092a700 1 -- 172.21.15.80:0/2246371266 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f857c06c2f0 msgr2=0x7f857c06c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f858092a700 1 --2- 172.21.15.80:0/2246371266 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f857c06c2f0 0x7f857c06c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:54.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f858092a700 1 -- 172.21.15.80:0/2246371266 >> v1:172.21.15.80:6789/0 conn(0x7f857c15ed10 legacy=0x7f857c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f8573fff700 1 -- 172.21.15.80:0/2246371266 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895481122 0 0) 0x7f856c001100 con 0x7f857c15ed10 2019-11-28T11:53:54.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f858092a700 1 -- 172.21.15.80:0/2246371266 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c070760 con 0x7f857c15f100 2019-11-28T11:53:54.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f858092a700 1 --2- 172.21.15.80:0/2246371266 >> v2:172.21.15.80:3300/0 conn(0x7f857c15f100 0x7f857c06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f857800fa40 tx=0x7f857800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f858092a700 1 --2- 172.21.15.80:0/2246371266 >> v2:172.21.15.80:3300/0 conn(0x7f857c15f100 0x7f857c06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f857800fa40 tx=0x7f857800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f858092a700 1 --2- 172.21.15.80:0/2246371266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f857c15f100 0x7f857c06bdb0 secure :-1 s=READY pgs=2449 cs=0 l=1 rx=0x7f857800fa40 tx=0x7f857800fde0).ready entity=mon.0 client_cookie=b8d527ec810e5aa5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:54.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f858092a700 1 --2- 172.21.15.80:0/2246371266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f857c15f100 0x7f857c06bdb0 secure :-1 s=THROTTLE_DONE pgs=2449 cs=0 l=1 rx=0x7f857800fa40 tx=0x7f857800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f8573fff700 1 -- 172.21.15.80:0/2246371266 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8578000ce0 con 0x7f857c15f100 2019-11-28T11:53:54.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f858092a700 1 --2- 172.21.15.80:0/2246371266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f857c15f100 0x7f857c06bdb0 secure :-1 s=THROTTLE_DONE pgs=2449 cs=0 l=1 rx=0x7f857800fa40 tx=0x7f857800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f858092a700 1 --2- 172.21.15.80:0/2246371266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f857c15f100 0x7f857c06bdb0 secure :-1 s=THROTTLE_DONE pgs=2449 cs=0 l=1 rx=0x7f857800fa40 tx=0x7f857800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f8573fff700 1 -- 172.21.15.80:0/2246371266 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8578001010 con 0x7f857c15f100 2019-11-28T11:53:54.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f8573fff700 1 -- 172.21.15.80:0/2246371266 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8578001720 con 0x7f857c15f100 2019-11-28T11:53:54.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f8582b8e700 1 -- 172.21.15.80:0/2246371266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f857c15f100 msgr2=0x7f857c06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.798+0000 7f8582b8e700 1 --2- 172.21.15.80:0/2246371266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f857c15f100 0x7f857c06bdb0 secure :-1 s=READY pgs=2449 cs=0 l=1 rx=0x7f857800fa40 tx=0x7f857800fde0).stop 2019-11-28T11:53:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.799+0000 7f8582b8e700 1 -- 172.21.15.80:0/2246371266 shutdown_connections 2019-11-28T11:53:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.799+0000 7f8582b8e700 1 --2- 172.21.15.80:0/2246371266 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f857c06c2f0 0x7f857c06c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.799+0000 7f8582b8e700 1 --2- 172.21.15.80:0/2246371266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f857c15f100 0x7f857c06bdb0 unknown :-1 s=CLOSED pgs=2449 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.799+0000 7f8582b8e700 1 -- 172.21.15.80:0/2246371266 shutdown_connections 2019-11-28T11:53:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.799+0000 7f8582b8e700 1 -- 172.21.15.80:0/2246371266 wait complete. 2019-11-28T11:53:54.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.799+0000 7f8582b8e700 1 -- 172.21.15.80:0/2246371266 >> 172.21.15.80:0/2246371266 conn(0x7f857c061d20 msgr2=0x7f857c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:54.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.801+0000 7f8582b8e700 1 Processor -- start 2019-11-28T11:53:54.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.801+0000 7f8582b8e700 1 -- start start 2019-11-28T11:53:54.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.802+0000 7f8582b8e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f857c167d80 0x7f857c16a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:54.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.802+0000 7f8582b8e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857c148e00 con 0x7f857c148320 2019-11-28T11:53:54.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.802+0000 7f8582b8e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857c108b10 con 0x7f857c1079b0 2019-11-28T11:53:54.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.802+0000 7f8582b8e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857c13aa20 con 0x7f857c167d80 2019-11-28T11:53:54.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.802+0000 7f858112b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f857c148320 0x7f857c10ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43754/0 (socket says 172.21.15.80:43754) 2019-11-28T11:53:54.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.802+0000 7f858112b700 1 -- 172.21.15.80:0/1368205171 learned_addr learned my addr 172.21.15.80:0/1368205171 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:54.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.802+0000 7f858192c700 1 --2- 172.21.15.80:0/1368205171 >> v2:172.21.15.174:3300/0 conn(0x7f857c167d80 0x7f857c16a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:54.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f8571ffb700 1 -- 172.21.15.80:0/1368205171 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371875189 0 0) 0x7f856c000f40 con 0x7f857c148320 2019-11-28T11:53:54.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f8571ffb700 1 -- 172.21.15.80:0/1368205171 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f855c002e80 con 0x7f857c148320 2019-11-28T11:53:54.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f8571ffb700 1 -- 172.21.15.80:0/1368205171 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2709785034 0 0) 0x7f856c001570 con 0x7f857c148320 2019-11-28T11:53:54.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f858192c700 1 -- 172.21.15.80:0/1368205171 >> v1:172.21.15.174:6789/0 conn(0x7f857c1079b0 legacy=0x7f857c107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f858192c700 1 -- 172.21.15.80:0/1368205171 >> v1:172.21.15.80:6789/0 conn(0x7f857c148320 legacy=0x7f857c10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:54.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f858192c700 1 -- 172.21.15.80:0/1368205171 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c10c490 con 0x7f857c167d80 2019-11-28T11:53:54.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f858192c700 1 --2- 172.21.15.80:0/1368205171 >> v2:172.21.15.174:3300/0 conn(0x7f857c167d80 0x7f857c16a180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85740103a0 tx=0x7f8574010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f858192c700 1 --2- 172.21.15.80:0/1368205171 >> v2:172.21.15.174:3300/0 conn(0x7f857c167d80 0x7f857c16a180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85740103a0 tx=0x7f8574010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f858192c700 1 --2- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f857c167d80 0x7f857c16a180 secure :-1 s=READY pgs=1475 cs=0 l=1 rx=0x7f85740103a0 tx=0x7f8574010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:54.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f858192c700 1 --2- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f857c167d80 0x7f857c16a180 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7f85740103a0 tx=0x7f8574010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f8571ffb700 1 -- 172.21.15.80:0/1368205171 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85740051d0 con 0x7f857c167d80 2019-11-28T11:53:54.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f858192c700 1 --2- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f857c167d80 0x7f857c16a180 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7f85740103a0 tx=0x7f8574010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f858192c700 1 --2- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f857c167d80 0x7f857c16a180 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7f85740103a0 tx=0x7f8574010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f8571ffb700 1 -- 172.21.15.80:0/1368205171 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8574005870 con 0x7f857c167d80 2019-11-28T11:53:54.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f8582b8e700 1 -- 172.21.15.80:0/1368205171 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857c10c810 con 0x7f857c167d80 2019-11-28T11:53:54.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f8571ffb700 1 -- 172.21.15.80:0/1368205171 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8574005a60 con 0x7f857c167d80 2019-11-28T11:53:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.803+0000 7f8582b8e700 1 -- 172.21.15.80:0/1368205171 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857c10c490 con 0x7f857c167d80 2019-11-28T11:53:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.804+0000 7f858192c700 1 --2- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f857c167d80 0x7f857c16a180 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7f85740103a0 tx=0x7f8574010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.804+0000 7f8571ffb700 1 -- 172.21.15.80:0/1368205171 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8574005a60 con 0x7f857c167d80 2019-11-28T11:53:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.804+0000 7f858192c700 1 --2- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f857c167d80 0x7f857c16a180 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7f85740103a0 tx=0x7f8574010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.804+0000 7f8571ffb700 1 --2- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f855c018780 0x7f855c01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.804+0000 7f8571ffb700 1 -- 172.21.15.80:0/1368205171 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f8574031a70 con 0x7f857c167d80 2019-11-28T11:53:54.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.804+0000 7f858112b700 1 --2- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f855c018780 0x7f855c01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:54.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.804+0000 7f858112b700 1 --2- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f855c018780 0x7f855c01abf0 crc :-1 s=READY pgs=1006 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:54.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.811+0000 7f8582b8e700 1 -- 172.21.15.80:0/1368205171 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857c10c810 con 0x7f857c167d80 2019-11-28T11:53:54.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.815+0000 7f858192c700 1 --2- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f857c167d80 0x7f857c16a180 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7f85740103a0 tx=0x7f8574010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:54.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.815+0000 7f8571ffb700 1 -- 172.21.15.80:0/1368205171 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8574005470 con 0x7f857c167d80 2019-11-28T11:53:55.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.986+0000 7f8582b8e700 1 -- 172.21.15.80:0/1368205171 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f857c10c490 con 0x7f857c167d80 2019-11-28T11:53:55.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.986+0000 7f858192c700 1 --2- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f857c167d80 0x7f857c16a180 secure :-1 s=THROTTLE_DONE pgs=1475 cs=0 l=1 rx=0x7f85740103a0 tx=0x7f8574010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.987+0000 7f8571ffb700 1 -- 172.21.15.80:0/1368205171 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v186) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8574017440 con 0x7f857c167d80 2019-11-28T11:53:55.043 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:53:55.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.989+0000 7f8582b8e700 1 -- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f855c018780 msgr2=0x7f855c01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:55.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.989+0000 7f8582b8e700 1 --2- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f855c018780 0x7f855c01abf0 crc :-1 s=READY pgs=1006 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:55.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.989+0000 7f8582b8e700 1 -- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f857c167d80 msgr2=0x7f857c16a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:55.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.989+0000 7f8582b8e700 1 --2- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f857c167d80 0x7f857c16a180 secure :-1 s=READY pgs=1475 cs=0 l=1 rx=0x7f85740103a0 tx=0x7f8574010740).stop 2019-11-28T11:53:55.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.989+0000 7f8582b8e700 1 -- 172.21.15.80:0/1368205171 shutdown_connections 2019-11-28T11:53:55.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.989+0000 7f8582b8e700 1 --2- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f857c167d80 0x7f857c16a180 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:55.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.989+0000 7f8582b8e700 1 --2- 172.21.15.80:0/1368205171 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f855c018780 0x7f855c01abf0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:55.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.989+0000 7f8582b8e700 1 -- 172.21.15.80:0/1368205171 shutdown_connections 2019-11-28T11:53:55.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.989+0000 7f8582b8e700 1 -- 172.21.15.80:0/1368205171 wait complete. 2019-11-28T11:53:55.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:54.989+0000 7f8582b8e700 1 -- 172.21.15.80:0/1368205171 >> 172.21.15.80:0/1368205171 conn(0x7f857c15e2d0 msgr2=0x7f857c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:55.055 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:53:55.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.119+0000 7f48ecab7700 1 Processor -- start 2019-11-28T11:53:55.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.119+0000 7f48ecab7700 1 -- start start 2019-11-28T11:53:55.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.120+0000 7f48ecab7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f48e806c490 0x7f48e806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:55.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.120+0000 7f48ecab7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e806db00 con 0x7f48e806c0a0 2019-11-28T11:53:55.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.120+0000 7f48ecab7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e806e000 con 0x7f48e806ce60 2019-11-28T11:53:55.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.120+0000 7f48ecab7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e806fd60 con 0x7f48e806c490 2019-11-28T11:53:55.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.120+0000 7f48e659c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f48e806c490 0x7f48e806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:55.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.120+0000 7f48e659c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f48e806c490 0x7f48e806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44450/0 (socket says 172.21.15.80:44450) 2019-11-28T11:53:55.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.120+0000 7f48e659c700 1 -- 172.21.15.80:0/1551788528 learned_addr learned my addr 172.21.15.80:0/1551788528 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:55.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.120+0000 7f48e6d9d700 1 --1- 172.21.15.80:0/1551788528 >> v1:172.21.15.80:6789/0 conn(0x7f48e806c0a0 0x7f48e8072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43762/0 (socket says 172.21.15.80:43762) 2019-11-28T11:53:55.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.120+0000 7f48e659c700 1 -- 172.21.15.80:0/1551788528 >> v1:172.21.15.174:6789/0 conn(0x7f48e806ce60 legacy=0x7f48e8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:55.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.120+0000 7f48e659c700 1 -- 172.21.15.80:0/1551788528 >> v1:172.21.15.80:6789/0 conn(0x7f48e806c0a0 legacy=0x7f48e8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:55.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.121+0000 7f48e659c700 1 -- 172.21.15.80:0/1551788528 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e80706c0 con 0x7f48e806c490 2019-11-28T11:53:55.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.121+0000 7f48e5d9b700 1 -- 172.21.15.80:0/1551788528 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 860283466 0 0) 0x7f48e0001100 con 0x7f48e806c0a0 2019-11-28T11:53:55.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.121+0000 7f48e659c700 1 --2- 172.21.15.80:0/1551788528 >> v2:172.21.15.80:3300/0 conn(0x7f48e806c490 0x7f48e806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f48d000fac0 tx=0x7f48d000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.121+0000 7f48e659c700 1 --2- 172.21.15.80:0/1551788528 >> v2:172.21.15.80:3300/0 conn(0x7f48e806c490 0x7f48e806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f48d000fac0 tx=0x7f48d000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.121+0000 7f48e659c700 1 --2- 172.21.15.80:0/1551788528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48e806c490 0x7f48e806c920 secure :-1 s=READY pgs=2452 cs=0 l=1 rx=0x7f48d000fac0 tx=0x7f48d000fe60).ready entity=mon.0 client_cookie=1b448c9275bff778 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:55.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.121+0000 7f48e659c700 1 --2- 172.21.15.80:0/1551788528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48e806c490 0x7f48e806c920 secure :-1 s=THROTTLE_DONE pgs=2452 cs=0 l=1 rx=0x7f48d000fac0 tx=0x7f48d000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.121+0000 7f48e5d9b700 1 -- 172.21.15.80:0/1551788528 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d0000ce0 con 0x7f48e806c490 2019-11-28T11:53:55.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.121+0000 7f48e659c700 1 --2- 172.21.15.80:0/1551788528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48e806c490 0x7f48e806c920 secure :-1 s=THROTTLE_DONE pgs=2452 cs=0 l=1 rx=0x7f48d000fac0 tx=0x7f48d000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.121+0000 7f48e659c700 1 --2- 172.21.15.80:0/1551788528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48e806c490 0x7f48e806c920 secure :-1 s=THROTTLE_DONE pgs=2452 cs=0 l=1 rx=0x7f48d000fac0 tx=0x7f48d000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.121+0000 7f48e5d9b700 1 -- 172.21.15.80:0/1551788528 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d0001010 con 0x7f48e806c490 2019-11-28T11:53:55.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.121+0000 7f48e5d9b700 1 -- 172.21.15.80:0/1551788528 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d0001760 con 0x7f48e806c490 2019-11-28T11:53:55.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.121+0000 7f48ecab7700 1 -- 172.21.15.80:0/1551788528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48e806c490 msgr2=0x7f48e806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:55.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.121+0000 7f48ecab7700 1 --2- 172.21.15.80:0/1551788528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48e806c490 0x7f48e806c920 secure :-1 s=READY pgs=2452 cs=0 l=1 rx=0x7f48d000fac0 tx=0x7f48d000fe60).stop 2019-11-28T11:53:55.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.122+0000 7f48ecab7700 1 -- 172.21.15.80:0/1551788528 shutdown_connections 2019-11-28T11:53:55.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.122+0000 7f48ecab7700 1 --2- 172.21.15.80:0/1551788528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48e806c490 0x7f48e806c920 unknown :-1 s=CLOSED pgs=2452 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:55.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.122+0000 7f48ecab7700 1 -- 172.21.15.80:0/1551788528 shutdown_connections 2019-11-28T11:53:55.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.122+0000 7f48ecab7700 1 -- 172.21.15.80:0/1551788528 wait complete. 2019-11-28T11:53:55.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.122+0000 7f48ecab7700 1 -- 172.21.15.80:0/1551788528 >> 172.21.15.80:0/1551788528 conn(0x7f48e8061cf0 msgr2=0x7f48e8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:55.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.124+0000 7f48ecab7700 1 Processor -- start 2019-11-28T11:53:55.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.124+0000 7f48ecab7700 1 -- start start 2019-11-28T11:53:55.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.125+0000 7f48ecab7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f48e813f580 0x7f48e8114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:55.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.125+0000 7f48ecab7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48e8114670 0x7f48e811e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:55.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.125+0000 7f48ecab7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e813fc20 con 0x7f48e811eaf0 2019-11-28T11:53:55.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.125+0000 7f48ecab7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e81236b0 con 0x7f48e813f580 2019-11-28T11:53:55.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.125+0000 7f48ecab7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e8123980 con 0x7f48e8114670 2019-11-28T11:53:55.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.125+0000 7f48e759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f48e811eaf0 0x7f48e8112fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43770/0 (socket says 172.21.15.80:43770) 2019-11-28T11:53:55.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.125+0000 7f48e759e700 1 -- 172.21.15.80:0/310020217 learned_addr learned my addr 172.21.15.80:0/310020217 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:55.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.125+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891885014 0 0) 0x7f48d8001140 con 0x7f48e811eaf0 2019-11-28T11:53:55.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.125+0000 7f48e6d9d700 1 --2- 172.21.15.80:0/310020217 >> v2:172.21.15.174:3300/0 conn(0x7f48e813f580 0x7f48e8114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:55.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.125+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48c0002e80 con 0x7f48e811eaf0 2019-11-28T11:53:55.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.125+0000 7f48e659c700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48e8114670 0x7f48e811e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:55.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2483191569 0 0) 0x7f48d80012b0 con 0x7f48e811eaf0 2019-11-28T11:53:55.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f48c00032e0 con 0x7f48e811eaf0 2019-11-28T11:53:55.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f48d8001880 con 0x7f48e811eaf0 2019-11-28T11:53:55.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48e8114670 msgr2=0x7f48e811e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:55.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48e8114670 0x7f48e811e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:55.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 >> v2:172.21.15.174:3300/0 conn(0x7f48e813f580 msgr2=0x7f48e8114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:55.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 --2- 172.21.15.80:0/310020217 >> v2:172.21.15.174:3300/0 conn(0x7f48e813f580 0x7f48e8114130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:55.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 >> v1:172.21.15.80:6789/0 conn(0x7f48e811eaf0 legacy=0x7f48e8112fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:55.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c00033f0 0x7f48c0003800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:55.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48c0003d40 0x7f48c00041b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:55.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48c0004820 0x7f48c0004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:55.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c000bb60 con 0x7f48c00033f0 2019-11-28T11:53:55.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c000bd50 con 0x7f48c0004820 2019-11-28T11:53:55.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c000bf80 con 0x7f48c0003d40 2019-11-28T11:53:55.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48e6d9d700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c00033f0 0x7f48c0003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:55.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48e659c700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48c0003d40 0x7f48c00041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:55.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48e759e700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48c0004820 0x7f48c0004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:55.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48e6d9d700 1 -- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48c0003d40 msgr2=0x7f48c00041b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:55.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48e6d9d700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48c0003d40 0x7f48c00041b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:55.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48e6d9d700 1 -- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48c0004820 msgr2=0x7f48c0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:55.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48e6d9d700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48c0004820 0x7f48c0004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:55.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48e6d9d700 1 -- 172.21.15.80:0/310020217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c000c230 con 0x7f48c00033f0 2019-11-28T11:53:55.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48e759e700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48c0004820 0x7f48c0004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:53:55.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48ecab7700 1 -- 172.21.15.80:0/310020217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e8124010 con 0x7f48c00033f0 2019-11-28T11:53:55.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48e6d9d700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c00033f0 0x7f48c0003800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48e0010610 tx=0x7f48e0010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48ecab7700 1 -- 172.21.15.80:0/310020217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e813fc20 con 0x7f48c00033f0 2019-11-28T11:53:55.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48e6d9d700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c00033f0 0x7f48c0003800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48e0010610 tx=0x7f48e0010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48e6d9d700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c00033f0 0x7f48c0003800 secure :-1 s=READY pgs=2454 cs=0 l=1 rx=0x7f48e0010610 tx=0x7f48e0010410).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:55.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48e6d9d700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c00033f0 0x7f48c0003800 secure :-1 s=THROTTLE_DONE pgs=2454 cs=0 l=1 rx=0x7f48e0010610 tx=0x7f48e0010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48e0004640 con 0x7f48c00033f0 2019-11-28T11:53:55.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48e6d9d700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c00033f0 0x7f48c0003800 secure :-1 s=THROTTLE_DONE pgs=2454 cs=0 l=1 rx=0x7f48e0010610 tx=0x7f48e0010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e0000ef0 con 0x7f48c00033f0 2019-11-28T11:53:55.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48e6d9d700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c00033f0 0x7f48c0003800 secure :-1 s=THROTTLE_DONE pgs=2454 cs=0 l=1 rx=0x7f48e0010610 tx=0x7f48e0010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.126+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48e0004830 con 0x7f48c00033f0 2019-11-28T11:53:55.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.127+0000 7f48e6d9d700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c00033f0 0x7f48c0003800 secure :-1 s=THROTTLE_DONE pgs=2454 cs=0 l=1 rx=0x7f48e0010610 tx=0x7f48e0010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.127+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f48e0004450 con 0x7f48c00033f0 2019-11-28T11:53:55.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.127+0000 7f48e6d9d700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c00033f0 0x7f48c0003800 secure :-1 s=THROTTLE_DONE pgs=2454 cs=0 l=1 rx=0x7f48e0010610 tx=0x7f48e0010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.127+0000 7f48df7fe700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f48c0020ae0 0x7f48c0022f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:55.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.127+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f48e0031e70 con 0x7f48c00033f0 2019-11-28T11:53:55.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.127+0000 7f48e659c700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f48c0020ae0 0x7f48c0022f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:55.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.127+0000 7f48e659c700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f48c0020ae0 0x7f48c0022f10 crc :-1 s=READY pgs=1007 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:55.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.134+0000 7f48ecab7700 1 -- 172.21.15.80:0/310020217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e8124010 con 0x7f48c00033f0 2019-11-28T11:53:55.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.138+0000 7f48e6d9d700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c00033f0 0x7f48c0003800 secure :-1 s=THROTTLE_DONE pgs=2454 cs=0 l=1 rx=0x7f48e0010610 tx=0x7f48e0010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.138+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f48e0004240 con 0x7f48c00033f0 2019-11-28T11:53:55.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.300+0000 7f48ecab7700 1 -- 172.21.15.80:0/310020217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f48e8124010 con 0x7f48c00033f0 2019-11-28T11:53:55.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.300+0000 7f48e6d9d700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c00033f0 0x7f48c0003800 secure :-1 s=THROTTLE_DONE pgs=2454 cs=0 l=1 rx=0x7f48e0010610 tx=0x7f48e0010410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.300+0000 7f48df7fe700 1 -- 172.21.15.80:0/310020217 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v186) v1 ==== 84+0+64 (secure 0 0 0) 0x7f48e0004450 con 0x7f48c00033f0 2019-11-28T11:53:55.357 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:55.357 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:53:55.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:53:55.357 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:53:55.357 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:53:55.357 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:53:55.358 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:53:55.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.303+0000 7f48ecab7700 1 -- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f48c0020ae0 msgr2=0x7f48c0022f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:55.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.303+0000 7f48ecab7700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f48c0020ae0 0x7f48c0022f10 crc :-1 s=READY pgs=1007 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:55.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.303+0000 7f48ecab7700 1 -- 172.21.15.80:0/310020217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c00033f0 msgr2=0x7f48c0003800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:55.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.303+0000 7f48ecab7700 1 --2- 172.21.15.80:0/310020217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c00033f0 0x7f48c0003800 secure :-1 s=READY pgs=2454 cs=0 l=1 rx=0x7f48e0010610 tx=0x7f48e0010410).stop 2019-11-28T11:53:55.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.303+0000 7f48e759e700 1 -- 172.21.15.80:0/310020217 reap_dead start 2019-11-28T11:53:55.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.303+0000 7f48e759e700 1 -- 172.21.15.80:0/310020217 reap_dead start 2019-11-28T11:53:55.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.303+0000 7f48ecab7700 1 -- 172.21.15.80:0/310020217 shutdown_connections 2019-11-28T11:53:55.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.303+0000 7f48ecab7700 1 -- 172.21.15.80:0/310020217 shutdown_connections 2019-11-28T11:53:55.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.303+0000 7f48ecab7700 1 -- 172.21.15.80:0/310020217 wait complete. 2019-11-28T11:53:55.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.303+0000 7f48ecab7700 1 -- 172.21.15.80:0/310020217 >> 172.21.15.80:0/310020217 conn(0x7f48e81426c0 msgr2=0x7f48e8110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:55.368 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:53:55.369 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:53:55.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.438+0000 7f23f6f2f700 1 Processor -- start 2019-11-28T11:53:55.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.439+0000 7f23f6f2f700 1 -- start start 2019-11-28T11:53:55.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.439+0000 7f23f6f2f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f23f015ed10 0x7f23f015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:55.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.439+0000 7f23f6f2f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23f0073020 0x7f23f0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:55.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.439+0000 7f23f6f2f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f006db60 con 0x7f23f00734b0 2019-11-28T11:53:55.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.439+0000 7f23f6f2f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f006fe00 con 0x7f23f0073020 2019-11-28T11:53:55.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.439+0000 7f23f6f2f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f00700d0 con 0x7f23f015ed10 2019-11-28T11:53:55.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23f4ccb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23f0073020 0x7f23f0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:55.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23f4ccb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23f0073020 0x7f23f0071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44470/0 (socket says 172.21.15.80:44470) 2019-11-28T11:53:55.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23f4ccb700 1 -- 172.21.15.80:0/3951605397 learned_addr learned my addr 172.21.15.80:0/3951605397 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:55.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23f4ccb700 1 -- 172.21.15.80:0/3951605397 >> v2:172.21.15.174:3300/0 conn(0x7f23f015ed10 msgr2=0x7f23f015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:55.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23f54cc700 1 --2- 172.21.15.80:0/3951605397 >> v2:172.21.15.174:3300/0 conn(0x7f23f015ed10 0x7f23f015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:55.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/3951605397 >> v2:172.21.15.174:3300/0 conn(0x7f23f015ed10 0x7f23f015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:55.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23f4ccb700 1 -- 172.21.15.80:0/3951605397 >> v1:172.21.15.174:6789/0 conn(0x7f23f00734b0 legacy=0x7f23f00723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:55.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23f4ccb700 1 -- 172.21.15.80:0/3951605397 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f0070760 con 0x7f23f0073020 2019-11-28T11:53:55.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/3951605397 >> v2:172.21.15.80:3300/0 conn(0x7f23f0073020 0x7f23f0071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f23e000f740 tx=0x7f23e000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/3951605397 >> v2:172.21.15.80:3300/0 conn(0x7f23f0073020 0x7f23f0071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f23e000f740 tx=0x7f23e000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/3951605397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23f0073020 0x7f23f0071ea0 secure :-1 s=READY pgs=2455 cs=0 l=1 rx=0x7f23e000f740 tx=0x7f23e000f570).ready entity=mon.0 client_cookie=bab981b7e70373e9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:55.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/3951605397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23f0073020 0x7f23f0071ea0 secure :-1 s=THROTTLE_DONE pgs=2455 cs=0 l=1 rx=0x7f23e000f740 tx=0x7f23e000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/3951605397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23f0073020 0x7f23f0071ea0 secure :-1 s=THROTTLE_DONE pgs=2455 cs=0 l=1 rx=0x7f23e000f740 tx=0x7f23e000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23effff700 1 -- 172.21.15.80:0/3951605397 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23e0000960 con 0x7f23f0073020 2019-11-28T11:53:55.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/3951605397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23f0073020 0x7f23f0071ea0 secure :-1 s=THROTTLE_DONE pgs=2455 cs=0 l=1 rx=0x7f23e000f740 tx=0x7f23e000f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23effff700 1 -- 172.21.15.80:0/3951605397 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e0000c90 con 0x7f23f0073020 2019-11-28T11:53:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23effff700 1 -- 172.21.15.80:0/3951605397 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23e00013a0 con 0x7f23f0073020 2019-11-28T11:53:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23f6f2f700 1 -- 172.21.15.80:0/3951605397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23f0073020 msgr2=0x7f23f0071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.440+0000 7f23f6f2f700 1 --2- 172.21.15.80:0/3951605397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23f0073020 0x7f23f0071ea0 secure :-1 s=READY pgs=2455 cs=0 l=1 rx=0x7f23e000f740 tx=0x7f23e000f570).stop 2019-11-28T11:53:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.441+0000 7f23f6f2f700 1 -- 172.21.15.80:0/3951605397 shutdown_connections 2019-11-28T11:53:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.441+0000 7f23f6f2f700 1 --2- 172.21.15.80:0/3951605397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23f0073020 0x7f23f0071ea0 unknown :-1 s=CLOSED pgs=2455 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.441+0000 7f23f6f2f700 1 --2- 172.21.15.80:0/3951605397 >> v2:172.21.15.174:3300/0 conn(0x7f23f015ed10 0x7f23f015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.441+0000 7f23f6f2f700 1 -- 172.21.15.80:0/3951605397 shutdown_connections 2019-11-28T11:53:55.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.441+0000 7f23f6f2f700 1 -- 172.21.15.80:0/3951605397 wait complete. 2019-11-28T11:53:55.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.441+0000 7f23f6f2f700 1 -- 172.21.15.80:0/3951605397 >> 172.21.15.80:0/3951605397 conn(0x7f23f0061d20 msgr2=0x7f23f00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:55.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.444+0000 7f23f6f2f700 1 Processor -- start 2019-11-28T11:53:55.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.444+0000 7f23f6f2f700 1 -- start start 2019-11-28T11:53:55.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f6f2f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f23f010ed60 0x7f23f010f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:55.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f6f2f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f010c250 con 0x7f23f010e970 2019-11-28T11:53:55.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f6f2f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f010c6d0 con 0x7f23f010f730 2019-11-28T11:53:55.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f6f2f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f010e430 con 0x7f23f010ed60 2019-11-28T11:53:55.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f54cc700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f23f010e970 0x7f23f01087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43788/0 (socket says 172.21.15.80:43788) 2019-11-28T11:53:55.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f54cc700 1 -- 172.21.15.80:0/2454519289 learned_addr learned my addr 172.21.15.80:0/2454519289 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:55.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/2454519289 >> v2:172.21.15.174:3300/0 conn(0x7f23f010ed60 0x7f23f010f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:55.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23edffb700 1 -- 172.21.15.80:0/2454519289 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856123224 0 0) 0x7f23d8001330 con 0x7f23f010e970 2019-11-28T11:53:55.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23edffb700 1 -- 172.21.15.80:0/2454519289 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23d4002e80 con 0x7f23f010e970 2019-11-28T11:53:55.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f4ccb700 1 -- 172.21.15.80:0/2454519289 >> v1:172.21.15.174:6789/0 conn(0x7f23f010f730 legacy=0x7f23f0167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:55.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23edffb700 1 -- 172.21.15.80:0/2454519289 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543043812 0 0) 0x7f23e8001070 con 0x7f23f010f730 2019-11-28T11:53:55.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f4ccb700 1 -- 172.21.15.80:0/2454519289 >> v1:172.21.15.80:6789/0 conn(0x7f23f010e970 legacy=0x7f23f01087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:55.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f4ccb700 1 -- 172.21.15.80:0/2454519289 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f0105ef0 con 0x7f23f010ed60 2019-11-28T11:53:55.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/2454519289 >> v2:172.21.15.174:3300/0 conn(0x7f23f010ed60 0x7f23f010f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23e00124f0 tx=0x7f23e0012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/2454519289 >> v2:172.21.15.174:3300/0 conn(0x7f23f010ed60 0x7f23f010f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23e00124f0 tx=0x7f23e0012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f010ed60 0x7f23f010f1f0 secure :-1 s=READY pgs=1479 cs=0 l=1 rx=0x7f23e00124f0 tx=0x7f23e0012890).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:55.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f010ed60 0x7f23f010f1f0 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7f23e00124f0 tx=0x7f23e0012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23edffb700 1 -- 172.21.15.80:0/2454519289 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23e00029a0 con 0x7f23f010ed60 2019-11-28T11:53:55.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f010ed60 0x7f23f010f1f0 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7f23e00124f0 tx=0x7f23e0012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23edffb700 1 -- 172.21.15.80:0/2454519289 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e0000b30 con 0x7f23f010ed60 2019-11-28T11:53:55.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f010ed60 0x7f23f010f1f0 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7f23e00124f0 tx=0x7f23e0012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23edffb700 1 -- 172.21.15.80:0/2454519289 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23e0000d20 con 0x7f23f010ed60 2019-11-28T11:53:55.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.445+0000 7f23f6f2f700 1 -- 172.21.15.80:0/2454519289 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f0106270 con 0x7f23f010ed60 2019-11-28T11:53:55.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.446+0000 7f23f6f2f700 1 -- 172.21.15.80:0/2454519289 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f0105ef0 con 0x7f23f010ed60 2019-11-28T11:53:55.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.446+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f010ed60 0x7f23f010f1f0 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7f23e00124f0 tx=0x7f23e0012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.446+0000 7f23edffb700 1 -- 172.21.15.80:0/2454519289 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f23e0000d20 con 0x7f23f010ed60 2019-11-28T11:53:55.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.446+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f010ed60 0x7f23f010f1f0 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7f23e00124f0 tx=0x7f23e0012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.446+0000 7f23edffb700 1 --2- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f23d4018780 0x7f23d401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:55.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.446+0000 7f23edffb700 1 -- 172.21.15.80:0/2454519289 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f23e0033ca0 con 0x7f23f010ed60 2019-11-28T11:53:55.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.447+0000 7f23f54cc700 1 --2- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f23d4018780 0x7f23d401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:55.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.447+0000 7f23f54cc700 1 --2- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f23d4018780 0x7f23d401abf0 crc :-1 s=READY pgs=1008 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:55.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.454+0000 7f23f6f2f700 1 -- 172.21.15.80:0/2454519289 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f0106270 con 0x7f23f010ed60 2019-11-28T11:53:55.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.458+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f010ed60 0x7f23f010f1f0 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7f23e00124f0 tx=0x7f23e0012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:55.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.458+0000 7f23edffb700 1 -- 172.21.15.80:0/2454519289 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f23e0007230 con 0x7f23f010ed60 2019-11-28T11:53:55.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.627+0000 7f23f6f2f700 1 -- 172.21.15.80:0/2454519289 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f23f0105ef0 con 0x7f23f010ed60 2019-11-28T11:53:56.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.968+0000 7f23f4ccb700 1 --2- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f010ed60 0x7f23f010f1f0 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7f23e00124f0 tx=0x7f23e0012890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:56.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.968+0000 7f23edffb700 1 -- 172.21.15.80:0/2454519289 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v187) v1 ==== 133+0+0 (secure 0 0 0) 0x7f23e0019430 con 0x7f23f010ed60 2019-11-28T11:53:56.046 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:53:56.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.993+0000 7f23f6f2f700 1 -- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f23d4018780 msgr2=0x7f23d401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:56.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.993+0000 7f23f6f2f700 1 --2- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f23d4018780 0x7f23d401abf0 crc :-1 s=READY pgs=1008 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:56.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.993+0000 7f23f6f2f700 1 -- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f010ed60 msgr2=0x7f23f010f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:56.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.993+0000 7f23f6f2f700 1 --2- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f010ed60 0x7f23f010f1f0 secure :-1 s=READY pgs=1479 cs=0 l=1 rx=0x7f23e00124f0 tx=0x7f23e0012890).stop 2019-11-28T11:53:56.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.993+0000 7f23f6f2f700 1 -- 172.21.15.80:0/2454519289 shutdown_connections 2019-11-28T11:53:56.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.993+0000 7f23f6f2f700 1 --2- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f23d4018780 0x7f23d401abf0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:56.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.993+0000 7f23f6f2f700 1 --2- 172.21.15.80:0/2454519289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23f010ed60 0x7f23f010f1f0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:56.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.993+0000 7f23f6f2f700 1 -- 172.21.15.80:0/2454519289 shutdown_connections 2019-11-28T11:53:56.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.993+0000 7f23f6f2f700 1 -- 172.21.15.80:0/2454519289 wait complete. 2019-11-28T11:53:56.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:55.993+0000 7f23f6f2f700 1 -- 172.21.15.80:0/2454519289 >> 172.21.15.80:0/2454519289 conn(0x7f23f015e2d0 msgr2=0x7f23f0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:56.059 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:53:56.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.127+0000 7ff1f38dd700 1 Processor -- start 2019-11-28T11:53:56.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.127+0000 7ff1f38dd700 1 -- start start 2019-11-28T11:53:56.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.128+0000 7ff1f38dd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1ec15ed10 0x7ff1ec15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:56.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.128+0000 7ff1f38dd700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec06db60 con 0x7ff1ec073020 2019-11-28T11:53:56.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.128+0000 7ff1f38dd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec06e060 con 0x7ff1ec0734b0 2019-11-28T11:53:56.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.128+0000 7ff1f38dd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ec06fe00 con 0x7ff1ec15ed10 2019-11-28T11:53:56.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.128+0000 7ff1f1e7a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1ec15ed10 0x7ff1ec15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:56.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.128+0000 7ff1f1e7a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1ec15ed10 0x7ff1ec15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44480/0 (socket says 172.21.15.80:44480) 2019-11-28T11:53:56.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.128+0000 7ff1f1e7a700 1 -- 172.21.15.80:0/492132569 learned_addr learned my addr 172.21.15.80:0/492132569 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:56.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.129+0000 7ff1f1e7a700 1 -- 172.21.15.80:0/492132569 >> v1:172.21.15.174:6789/0 conn(0x7ff1ec0734b0 legacy=0x7ff1ec0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:56.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.129+0000 7ff1f1e7a700 1 -- 172.21.15.80:0/492132569 >> v1:172.21.15.80:6789/0 conn(0x7ff1ec073020 legacy=0x7ff1ec071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:56.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.129+0000 7ff1f0e78700 1 -- 172.21.15.80:0/492132569 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686601045 0 0) 0x7ff1dc001030 con 0x7ff1ec073020 2019-11-28T11:53:56.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.129+0000 7ff1f1e7a700 1 -- 172.21.15.80:0/492132569 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec070760 con 0x7ff1ec15ed10 2019-11-28T11:53:56.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.129+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/492132569 >> v2:172.21.15.80:3300/0 conn(0x7ff1ec15ed10 0x7ff1ec15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff1d400fac0 tx=0x7ff1d400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:56.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.129+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/492132569 >> v2:172.21.15.80:3300/0 conn(0x7ff1ec15ed10 0x7ff1ec15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff1d400fac0 tx=0x7ff1d400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:56.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.129+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/492132569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec15ed10 0x7ff1ec15f100 secure :-1 s=READY pgs=2458 cs=0 l=1 rx=0x7ff1d400fac0 tx=0x7ff1d400fe60).ready entity=mon.0 client_cookie=38302c74e4ad75c1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:56.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.129+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/492132569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec15ed10 0x7ff1ec15f100 secure :-1 s=THROTTLE_DONE pgs=2458 cs=0 l=1 rx=0x7ff1d400fac0 tx=0x7ff1d400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:56.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.129+0000 7ff1f0e78700 1 -- 172.21.15.80:0/492132569 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1d4000ce0 con 0x7ff1ec15ed10 2019-11-28T11:53:56.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.129+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/492132569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec15ed10 0x7ff1ec15f100 secure :-1 s=THROTTLE_DONE pgs=2458 cs=0 l=1 rx=0x7ff1d400fac0 tx=0x7ff1d400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:56.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.129+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/492132569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec15ed10 0x7ff1ec15f100 secure :-1 s=THROTTLE_DONE pgs=2458 cs=0 l=1 rx=0x7ff1d400fac0 tx=0x7ff1d400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:56.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.129+0000 7ff1f0e78700 1 -- 172.21.15.80:0/492132569 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d4001010 con 0x7ff1ec15ed10 2019-11-28T11:53:56.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.129+0000 7ff1f0e78700 1 -- 172.21.15.80:0/492132569 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1d4000ce0 con 0x7ff1ec15ed10 2019-11-28T11:53:56.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.129+0000 7ff1f38dd700 1 -- 172.21.15.80:0/492132569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec15ed10 msgr2=0x7ff1ec15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:56.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.129+0000 7ff1f38dd700 1 --2- 172.21.15.80:0/492132569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec15ed10 0x7ff1ec15f100 secure :-1 s=READY pgs=2458 cs=0 l=1 rx=0x7ff1d400fac0 tx=0x7ff1d400fe60).stop 2019-11-28T11:53:56.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.130+0000 7ff1f38dd700 1 -- 172.21.15.80:0/492132569 shutdown_connections 2019-11-28T11:53:56.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.130+0000 7ff1f38dd700 1 --2- 172.21.15.80:0/492132569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1ec15ed10 0x7ff1ec15f100 unknown :-1 s=CLOSED pgs=2458 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:56.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.130+0000 7ff1f38dd700 1 -- 172.21.15.80:0/492132569 shutdown_connections 2019-11-28T11:53:56.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.130+0000 7ff1f38dd700 1 -- 172.21.15.80:0/492132569 wait complete. 2019-11-28T11:53:56.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.130+0000 7ff1f38dd700 1 -- 172.21.15.80:0/492132569 >> 172.21.15.80:0/492132569 conn(0x7ff1ec061d20 msgr2=0x7ff1ec0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:56.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.132+0000 7ff1f38dd700 1 Processor -- start 2019-11-28T11:53:56.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.132+0000 7ff1f38dd700 1 -- start start 2019-11-28T11:53:56.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.133+0000 7ff1f38dd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec127280 0x7ff1ec079840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:56.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.133+0000 7ff1f38dd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff1ec12e9a0 0x7ff1ec077830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:56.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.133+0000 7ff1f38dd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec162a90 con 0x7ff1ec079d80 2019-11-28T11:53:56.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.133+0000 7ff1f38dd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ec14ce70 con 0x7ff1ec12e9a0 2019-11-28T11:53:56.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.133+0000 7ff1f38dd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec0751f0 con 0x7ff1ec127280 2019-11-28T11:53:56.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.133+0000 7ff1f1e7a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec127280 0x7ff1ec079840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:56.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.133+0000 7ff1f267b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff1ec12e9a0 0x7ff1ec077830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:56.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.133+0000 7ff1f1e7a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec127280 0x7ff1ec079840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:46746/0 (socket says 172.21.15.80:46746) 2019-11-28T11:53:56.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.133+0000 7ff1f1e7a700 1 -- 172.21.15.80:0/3401373178 learned_addr learned my addr 172.21.15.80:0/3401373178 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:56.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.134+0000 7ff1f1e7a700 1 -- 172.21.15.80:0/3401373178 >> v2:172.21.15.174:3300/0 conn(0x7ff1ec12e9a0 msgr2=0x7ff1ec077830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:56.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.134+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/3401373178 >> v2:172.21.15.174:3300/0 conn(0x7ff1ec12e9a0 0x7ff1ec077830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:56.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.134+0000 7ff1f1e7a700 1 -- 172.21.15.80:0/3401373178 >> v1:172.21.15.174:6789/0 conn(0x7ff1ec079d80 legacy=0x7ff1ec165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:56.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.134+0000 7ff1f1e7a700 1 -- 172.21.15.80:0/3401373178 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec076160 con 0x7ff1ec127280 2019-11-28T11:53:56.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.134+0000 7ff1f267b700 1 --2- 172.21.15.80:0/3401373178 >> v2:172.21.15.174:3300/0 conn(0x7ff1ec12e9a0 0x7ff1ec077830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:56.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.134+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec127280 0x7ff1ec079840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff1d4010780 tx=0x7ff1d4010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:56.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.134+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec127280 0x7ff1ec079840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff1d4010780 tx=0x7ff1d4010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:56.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.134+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec127280 0x7ff1ec079840 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7ff1d4010780 tx=0x7ff1d4010b20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:56.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.134+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec127280 0x7ff1ec079840 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7ff1d4010780 tx=0x7ff1d4010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:56.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.134+0000 7ff1ea7fc700 1 -- 172.21.15.80:0/3401373178 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1d40058e0 con 0x7ff1ec127280 2019-11-28T11:53:56.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.134+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec127280 0x7ff1ec079840 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7ff1d4010780 tx=0x7ff1d4010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:56.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.134+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec127280 0x7ff1ec079840 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7ff1d4010780 tx=0x7ff1d4010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:56.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.134+0000 7ff1ea7fc700 1 -- 172.21.15.80:0/3401373178 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d4005500 con 0x7ff1ec127280 2019-11-28T11:53:56.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.134+0000 7ff1ea7fc700 1 -- 172.21.15.80:0/3401373178 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1d40056f0 con 0x7ff1ec127280 2019-11-28T11:53:56.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.134+0000 7ff1f38dd700 1 -- 172.21.15.80:0/3401373178 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ec0764e0 con 0x7ff1ec127280 2019-11-28T11:53:56.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.134+0000 7ff1f38dd700 1 -- 172.21.15.80:0/3401373178 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ec076160 con 0x7ff1ec127280 2019-11-28T11:53:56.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.135+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec127280 0x7ff1ec079840 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7ff1d4010780 tx=0x7ff1d4010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:56.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.135+0000 7ff1ea7fc700 1 -- 172.21.15.80:0/3401373178 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff1d40056f0 con 0x7ff1ec127280 2019-11-28T11:53:56.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.135+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec127280 0x7ff1ec079840 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7ff1d4010780 tx=0x7ff1d4010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:56.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.135+0000 7ff1ea7fc700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1d0018730 0x7ff1d001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:56.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.135+0000 7ff1ea7fc700 1 -- 172.21.15.80:0/3401373178 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff1d4031de0 con 0x7ff1ec127280 2019-11-28T11:53:56.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.135+0000 7ff1f1679700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1d0018730 0x7ff1d001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:56.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.136+0000 7ff1f1679700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1d0018730 0x7ff1d001abc0 crc :-1 s=READY pgs=1009 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:56.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.143+0000 7ff1f38dd700 1 -- 172.21.15.80:0/3401373178 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ec0764e0 con 0x7ff1ec127280 2019-11-28T11:53:56.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.147+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec127280 0x7ff1ec079840 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7ff1d4010780 tx=0x7ff1d4010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:56.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.147+0000 7ff1ea7fc700 1 -- 172.21.15.80:0/3401373178 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff1d4007590 con 0x7ff1ec127280 2019-11-28T11:53:56.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.315+0000 7ff1f38dd700 1 -- 172.21.15.80:0/3401373178 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7ff1ec076160 con 0x7ff1ec127280 2019-11-28T11:53:57.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.977+0000 7ff1f1e7a700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec127280 0x7ff1ec079840 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7ff1d4010780 tx=0x7ff1d4010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.977+0000 7ff1ea7fc700 1 -- 172.21.15.80:0/3401373178 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v188) v1 ==== 125+0+0 (secure 0 0 0) 0x7ff1d4007590 con 0x7ff1ec127280 2019-11-28T11:53:57.035 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:53:57.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.982+0000 7ff1f38dd700 1 -- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1d0018730 msgr2=0x7ff1d001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.982+0000 7ff1f38dd700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1d0018730 0x7ff1d001abc0 crc :-1 s=READY pgs=1009 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.982+0000 7ff1f38dd700 1 -- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec127280 msgr2=0x7ff1ec079840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.982+0000 7ff1f38dd700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec127280 0x7ff1ec079840 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7ff1d4010780 tx=0x7ff1d4010b20).stop 2019-11-28T11:53:57.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.982+0000 7ff1f38dd700 1 -- 172.21.15.80:0/3401373178 shutdown_connections 2019-11-28T11:53:57.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.982+0000 7ff1f38dd700 1 --2- 172.21.15.80:0/3401373178 >> v2:172.21.15.174:3300/0 conn(0x7ff1ec12e9a0 0x7ff1ec077830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.982+0000 7ff1f38dd700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1d0018730 0x7ff1d001abc0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.982+0000 7ff1f38dd700 1 --2- 172.21.15.80:0/3401373178 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1ec127280 0x7ff1ec079840 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.982+0000 7ff1f38dd700 1 -- 172.21.15.80:0/3401373178 shutdown_connections 2019-11-28T11:53:57.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.982+0000 7ff1f38dd700 1 -- 172.21.15.80:0/3401373178 wait complete. 2019-11-28T11:53:57.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:56.982+0000 7ff1f38dd700 1 -- 172.21.15.80:0/3401373178 >> 172.21.15.80:0/3401373178 conn(0x7ff1ec166440 msgr2=0x7ff1ec1494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:57.048 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:53:57.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.115+0000 7faa26c05700 1 Processor -- start 2019-11-28T11:53:57.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.115+0000 7faa26c05700 1 -- start start 2019-11-28T11:53:57.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.116+0000 7faa26c05700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faa201639f0 0x7faa20165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:57.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.116+0000 7faa26c05700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2006db60 con 0x7faa2015f100 2019-11-28T11:53:57.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.116+0000 7faa26c05700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2006e060 con 0x7faa2015ed10 2019-11-28T11:53:57.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.116+0000 7faa26c05700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2006fe00 con 0x7faa201639f0 2019-11-28T11:53:57.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.116+0000 7faa259a3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faa201639f0 0x7faa20165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.116+0000 7faa249a1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faa2015f100 0x7faa2006bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43814/0 (socket says 172.21.15.80:43814) 2019-11-28T11:53:57.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.116+0000 7faa249a1700 1 -- 172.21.15.80:0/26178216 learned_addr learned my addr 172.21.15.80:0/26178216 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:57.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.117+0000 7faa259a3700 1 -- 172.21.15.80:0/26178216 >> v1:172.21.15.174:6789/0 conn(0x7faa2015ed10 legacy=0x7faa20073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.117+0000 7faa259a3700 1 -- 172.21.15.80:0/26178216 >> v1:172.21.15.80:6789/0 conn(0x7faa2015f100 legacy=0x7faa2006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.117+0000 7faa259a3700 1 -- 172.21.15.80:0/26178216 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa20070760 con 0x7faa201639f0 2019-11-28T11:53:57.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.117+0000 7faa1ffff700 1 -- 172.21.15.80:0/26178216 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570694681 0 0) 0x7faa14001150 con 0x7faa2015f100 2019-11-28T11:53:57.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.117+0000 7faa259a3700 1 --2- 172.21.15.80:0/26178216 >> v2:172.21.15.80:3300/0 conn(0x7faa201639f0 0x7faa20165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faa1800af50 tx=0x7faa1800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.117+0000 7faa259a3700 1 --2- 172.21.15.80:0/26178216 >> v2:172.21.15.80:3300/0 conn(0x7faa201639f0 0x7faa20165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faa1800af50 tx=0x7faa1800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.117+0000 7faa259a3700 1 --2- 172.21.15.80:0/26178216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa201639f0 0x7faa20165df0 secure :-1 s=READY pgs=2460 cs=0 l=1 rx=0x7faa1800af50 tx=0x7faa1800b760).ready entity=mon.0 client_cookie=724711e066b2c9dc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:57.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.117+0000 7faa259a3700 1 --2- 172.21.15.80:0/26178216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa201639f0 0x7faa20165df0 secure :-1 s=THROTTLE_DONE pgs=2460 cs=0 l=1 rx=0x7faa1800af50 tx=0x7faa1800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.117+0000 7faa1ffff700 1 -- 172.21.15.80:0/26178216 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa18009ba0 con 0x7faa201639f0 2019-11-28T11:53:57.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.117+0000 7faa259a3700 1 --2- 172.21.15.80:0/26178216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa201639f0 0x7faa20165df0 secure :-1 s=THROTTLE_DONE pgs=2460 cs=0 l=1 rx=0x7faa1800af50 tx=0x7faa1800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.117+0000 7faa1ffff700 1 -- 172.21.15.80:0/26178216 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa18000960 con 0x7faa201639f0 2019-11-28T11:53:57.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.117+0000 7faa259a3700 1 --2- 172.21.15.80:0/26178216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa201639f0 0x7faa20165df0 secure :-1 s=THROTTLE_DONE pgs=2460 cs=0 l=1 rx=0x7faa1800af50 tx=0x7faa1800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.117+0000 7faa1ffff700 1 -- 172.21.15.80:0/26178216 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa18009ba0 con 0x7faa201639f0 2019-11-28T11:53:57.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.117+0000 7faa26c05700 1 -- 172.21.15.80:0/26178216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa201639f0 msgr2=0x7faa20165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.117+0000 7faa26c05700 1 --2- 172.21.15.80:0/26178216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa201639f0 0x7faa20165df0 secure :-1 s=READY pgs=2460 cs=0 l=1 rx=0x7faa1800af50 tx=0x7faa1800b760).stop 2019-11-28T11:53:57.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.118+0000 7faa26c05700 1 -- 172.21.15.80:0/26178216 shutdown_connections 2019-11-28T11:53:57.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.118+0000 7faa26c05700 1 --2- 172.21.15.80:0/26178216 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa201639f0 0x7faa20165df0 unknown :-1 s=CLOSED pgs=2460 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.118+0000 7faa26c05700 1 -- 172.21.15.80:0/26178216 shutdown_connections 2019-11-28T11:53:57.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.118+0000 7faa26c05700 1 -- 172.21.15.80:0/26178216 wait complete. 2019-11-28T11:53:57.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.118+0000 7faa26c05700 1 -- 172.21.15.80:0/26178216 >> 172.21.15.80:0/26178216 conn(0x7faa20061d20 msgr2=0x7faa200641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.120+0000 7faa26c05700 1 Processor -- start 2019-11-28T11:53:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.120+0000 7faa26c05700 1 -- start start 2019-11-28T11:53:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.121+0000 7faa26c05700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa2012aa90 0x7faa2012ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:57.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.121+0000 7faa26c05700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2007c080 con 0x7faa20074670 2019-11-28T11:53:57.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.121+0000 7faa26c05700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa20078560 con 0x7faa200741e0 2019-11-28T11:53:57.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.121+0000 7faa26c05700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa20079890 con 0x7faa2012aa90 2019-11-28T11:53:57.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.121+0000 7faa259a3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faa20074670 0x7faa20073860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43820/0 (socket says 172.21.15.80:43820) 2019-11-28T11:53:57.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.121+0000 7faa259a3700 1 -- 172.21.15.80:0/1100160149 learned_addr learned my addr 172.21.15.80:0/1100160149 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:57.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119597335 0 0) 0x7faa18000940 con 0x7faa20074670 2019-11-28T11:53:57.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa00002e80 con 0x7faa20074670 2019-11-28T11:53:57.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa251a2700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa2012aa90 0x7faa2012ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1671402943 0 0) 0x7faa18000b60 con 0x7faa20074670 2019-11-28T11:53:57.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa000032e0 con 0x7faa20074670 2019-11-28T11:53:57.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7faa1800b3f0 con 0x7faa20074670 2019-11-28T11:53:57.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa2012aa90 msgr2=0x7faa2012ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa1dffb700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa2012aa90 0x7faa2012ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 >> v1:172.21.15.174:6789/0 conn(0x7faa200741e0 legacy=0x7faa20073060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 >> v1:172.21.15.80:6789/0 conn(0x7faa20074670 legacy=0x7faa20073860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa1dffb700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa00003970 0x7faa00005d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:57.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa1dffb700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa000062b0 0x7faa000086b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:57.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa1dffb700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa00008eb0 0x7faa0000b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:57.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0000bb90 con 0x7faa00003970 2019-11-28T11:53:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0000bdc0 con 0x7faa00008eb0 2019-11-28T11:53:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0000bff0 con 0x7faa000062b0 2019-11-28T11:53:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa251a2700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa00003970 0x7faa00005d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa259a3700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa00008eb0 0x7faa0000b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa249a1700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa000062b0 0x7faa000086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa251a2700 1 -- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa000062b0 msgr2=0x7faa000086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa251a2700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa000062b0 0x7faa000086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa251a2700 1 -- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa00008eb0 msgr2=0x7faa0000b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa251a2700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa00008eb0 0x7faa0000b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa251a2700 1 -- 172.21.15.80:0/1100160149 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0000c2a0 con 0x7faa00003970 2019-11-28T11:53:57.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa26c05700 1 -- 172.21.15.80:0/1100160149 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2007afa0 con 0x7faa00003970 2019-11-28T11:53:57.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa259a3700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa00008eb0 0x7faa0000b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:53:57.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa251a2700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa00003970 0x7faa00005d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faa10010660 tx=0x7faa10010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.122+0000 7faa26c05700 1 -- 172.21.15.80:0/1100160149 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2007ac20 con 0x7faa00003970 2019-11-28T11:53:57.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.123+0000 7faa251a2700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa00003970 0x7faa00005d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faa10010660 tx=0x7faa10010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.123+0000 7faa251a2700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa00003970 0x7faa00005d70 secure :-1 s=READY pgs=2462 cs=0 l=1 rx=0x7faa10010660 tx=0x7faa10010a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:57.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.123+0000 7faa251a2700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa00003970 0x7faa00005d70 secure :-1 s=THROTTLE_DONE pgs=2462 cs=0 l=1 rx=0x7faa10010660 tx=0x7faa10010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.123+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa10000ce0 con 0x7faa00003970 2019-11-28T11:53:57.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.123+0000 7faa251a2700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa00003970 0x7faa00005d70 secure :-1 s=THROTTLE_DONE pgs=2462 cs=0 l=1 rx=0x7faa10010660 tx=0x7faa10010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.123+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa10000ce0 con 0x7faa00003970 2019-11-28T11:53:57.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.123+0000 7faa251a2700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa00003970 0x7faa00005d70 secure :-1 s=THROTTLE_DONE pgs=2462 cs=0 l=1 rx=0x7faa10010660 tx=0x7faa10010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.123+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa100020d0 con 0x7faa00003970 2019-11-28T11:53:57.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.123+0000 7faa251a2700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa00003970 0x7faa00005d70 secure :-1 s=THROTTLE_DONE pgs=2462 cs=0 l=1 rx=0x7faa10010660 tx=0x7faa10010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.123+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7faa10001020 con 0x7faa00003970 2019-11-28T11:53:57.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.123+0000 7faa251a2700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa00003970 0x7faa00005d70 secure :-1 s=THROTTLE_DONE pgs=2462 cs=0 l=1 rx=0x7faa10010660 tx=0x7faa10010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.123+0000 7faa1dffb700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa00020b50 0x7faa00022f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:57.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.123+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5904+0+0 (secure 0 0 0) 0x7faa10031f40 con 0x7faa00003970 2019-11-28T11:53:57.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.124+0000 7faa249a1700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa00020b50 0x7faa00022f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.124+0000 7faa249a1700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa00020b50 0x7faa00022f80 crc :-1 s=READY pgs=1010 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:57.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.130+0000 7faa26c05700 1 -- 172.21.15.80:0/1100160149 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f8002e60 con 0x7faa00003970 2019-11-28T11:53:57.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.134+0000 7faa251a2700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa00003970 0x7faa00005d70 secure :-1 s=THROTTLE_DONE pgs=2462 cs=0 l=1 rx=0x7faa10010660 tx=0x7faa10010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.134+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7faa100095d0 con 0x7faa00003970 2019-11-28T11:53:57.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.300+0000 7faa26c05700 1 -- 172.21.15.80:0/1100160149 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7fa9f8001d40 con 0x7faa00003970 2019-11-28T11:53:57.356 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:53:57.301+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:53:57.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.304+0000 7faa251a2700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa00003970 0x7faa00005d70 secure :-1 s=THROTTLE_DONE pgs=2462 cs=0 l=1 rx=0x7faa10010660 tx=0x7faa10010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.304+0000 7faa1dffb700 1 -- 172.21.15.80:0/1100160149 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 30 and data pool 31 v149) v1 ==== 174+0+0 (secure 0 0 0) 0x7faa10001020 con 0x7faa00003970 2019-11-28T11:53:57.363 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 30 and data pool 31 2019-11-28T11:53:57.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.309+0000 7faa26c05700 1 -- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa00020b50 msgr2=0x7faa00022f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.309+0000 7faa26c05700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7faa00020b50 0x7faa00022f80 crc :-1 s=READY pgs=1010 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.309+0000 7faa26c05700 1 -- 172.21.15.80:0/1100160149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa00003970 msgr2=0x7faa00005d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.309+0000 7faa26c05700 1 --2- 172.21.15.80:0/1100160149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa00003970 0x7faa00005d70 secure :-1 s=READY pgs=2462 cs=0 l=1 rx=0x7faa10010660 tx=0x7faa10010a00).stop 2019-11-28T11:53:57.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.309+0000 7faa259a3700 1 -- 172.21.15.80:0/1100160149 reap_dead start 2019-11-28T11:53:57.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.310+0000 7faa26c05700 1 -- 172.21.15.80:0/1100160149 shutdown_connections 2019-11-28T11:53:57.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.310+0000 7faa26c05700 1 -- 172.21.15.80:0/1100160149 shutdown_connections 2019-11-28T11:53:57.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.310+0000 7faa26c05700 1 -- 172.21.15.80:0/1100160149 wait complete. 2019-11-28T11:53:57.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.310+0000 7faa26c05700 1 -- 172.21.15.80:0/1100160149 >> 172.21.15.80:0/1100160149 conn(0x7faa20147670 msgr2=0x7faa201641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:57.375 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:53:57.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.437+0000 7f94122fb700 1 Processor -- start 2019-11-28T11:53:57.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.437+0000 7f94122fb700 1 -- start start 2019-11-28T11:53:57.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.438+0000 7f94122fb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f940c06c0a0 0x7f940c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:57.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.438+0000 7f94122fb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940c06db00 con 0x7f940c0734e0 2019-11-28T11:53:57.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.438+0000 7f94122fb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940c06e000 con 0x7f940c072620 2019-11-28T11:53:57.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.438+0000 7f94122fb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f940c06fd60 con 0x7f940c06c0a0 2019-11-28T11:53:57.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f940c0734e0 0x7f940c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43830/0 (socket says 172.21.15.80:43830) 2019-11-28T11:53:57.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940bfff700 1 -- 172.21.15.80:0/2824010159 learned_addr learned my addr 172.21.15.80:0/2824010159 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:57.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f9410898700 1 --2- 172.21.15.80:0/2824010159 >> v2:172.21.15.174:3300/0 conn(0x7f940c06c0a0 0x7f940c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 -- 172.21.15.80:0/2824010159 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173809639 0 0) 0x7f93fc0014d0 con 0x7f940c0734e0 2019-11-28T11:53:57.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 -- 172.21.15.80:0/2824010159 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93f8002e80 con 0x7f940c0734e0 2019-11-28T11:53:57.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 -- 172.21.15.80:0/2824010159 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097613233 0 0) 0x7f94040009b0 con 0x7f940c072620 2019-11-28T11:53:57.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 -- 172.21.15.80:0/2824010159 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93f80030b0 con 0x7f940c072620 2019-11-28T11:53:57.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 -- 172.21.15.80:0/2824010159 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1663724277 0 0) 0x7f93fc0014b0 con 0x7f940c0734e0 2019-11-28T11:53:57.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 -- 172.21.15.80:0/2824010159 >> v2:172.21.15.174:3300/0 conn(0x7f940c06c0a0 msgr2=0x7f940c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:57.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 --2- 172.21.15.80:0/2824010159 >> v2:172.21.15.174:3300/0 conn(0x7f940c06c0a0 0x7f940c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:57.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 -- 172.21.15.80:0/2824010159 >> v1:172.21.15.174:6789/0 conn(0x7f940c072620 legacy=0x7f940c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 -- 172.21.15.80:0/2824010159 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c0706c0 con 0x7f940c0734e0 2019-11-28T11:53:57.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 -- 172.21.15.80:0/2824010159 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f93fc0019e0 con 0x7f940c0734e0 2019-11-28T11:53:57.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 -- 172.21.15.80:0/2824010159 >> v1:172.21.15.80:6789/0 conn(0x7f940c0734e0 legacy=0x7f940c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f8003b80 0x7f93f8005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:57.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93f80066d0 0x7f93f8008b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:57.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93f804d3a0 0x7f93f804f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:57.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 -- 172.21.15.80:0/2824010159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f804fff0 con 0x7f93f8003b80 2019-11-28T11:53:57.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 -- 172.21.15.80:0/2824010159 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f8050220 con 0x7f93f804d3a0 2019-11-28T11:53:57.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940b7fe700 1 -- 172.21.15.80:0/2824010159 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f8050450 con 0x7f93f80066d0 2019-11-28T11:53:57.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f9410898700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f8003b80 0x7f93f8005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f940bfff700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93f80066d0 0x7f93f8008b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.439+0000 7f9411099700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93f804d3a0 0x7f93f804f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f9410898700 1 -- 172.21.15.80:0/2824010159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93f80066d0 msgr2=0x7f93f8008b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:57.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f9410898700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93f80066d0 0x7f93f8008b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:57.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f9410898700 1 -- 172.21.15.80:0/2824010159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93f804d3a0 msgr2=0x7f93f804f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:57.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f9410898700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93f804d3a0 0x7f93f804f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:57.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f9410898700 1 -- 172.21.15.80:0/2824010159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f8050700 con 0x7f93f8003b80 2019-11-28T11:53:57.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f9411099700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93f804d3a0 0x7f93f804f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:53:57.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f940bfff700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93f80066d0 0x7f93f8008b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:53:57.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f9411099700 1 -- 172.21.15.80:0/2824010159 reap_dead start 2019-11-28T11:53:57.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f9410898700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f8003b80 0x7f93f8005fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f93f400b6e0 tx=0x7f93f400ba80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f9410898700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f8003b80 0x7f93f8005fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f93f400b6e0 tx=0x7f93f400ba80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f9410898700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f8003b80 0x7f93f8005fe0 secure :-1 s=READY pgs=2464 cs=0 l=1 rx=0x7f93f400b6e0 tx=0x7f93f400ba80).ready entity=mon.0 client_cookie=a266690b595db1f3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:57.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f9410898700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f8003b80 0x7f93f8005fe0 secure :-1 s=THROTTLE_DONE pgs=2464 cs=0 l=1 rx=0x7f93f400b6e0 tx=0x7f93f400ba80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f940b7fe700 1 -- 172.21.15.80:0/2824010159 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93f4000960 con 0x7f93f8003b80 2019-11-28T11:53:57.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f9410898700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f8003b80 0x7f93f8005fe0 secure :-1 s=THROTTLE_DONE pgs=2464 cs=0 l=1 rx=0x7f93f400b6e0 tx=0x7f93f400ba80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f9410898700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f8003b80 0x7f93f8005fe0 secure :-1 s=THROTTLE_DONE pgs=2464 cs=0 l=1 rx=0x7f93f400b6e0 tx=0x7f93f400ba80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f940b7fe700 1 -- 172.21.15.80:0/2824010159 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f4009770 con 0x7f93f8003b80 2019-11-28T11:53:57.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f940b7fe700 1 -- 172.21.15.80:0/2824010159 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93f4009e00 con 0x7f93f8003b80 2019-11-28T11:53:57.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f94122fb700 1 -- 172.21.15.80:0/2824010159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f8003b80 msgr2=0x7f93f8005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f94122fb700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f8003b80 0x7f93f8005fe0 secure :-1 s=READY pgs=2464 cs=0 l=1 rx=0x7f93f400b6e0 tx=0x7f93f400ba80).stop 2019-11-28T11:53:57.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f94122fb700 1 -- 172.21.15.80:0/2824010159 shutdown_connections 2019-11-28T11:53:57.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.440+0000 7f94122fb700 1 --2- 172.21.15.80:0/2824010159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f8003b80 0x7f93f8005fe0 unknown :-1 s=CLOSED pgs=2464 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.441+0000 7f94122fb700 1 -- 172.21.15.80:0/2824010159 shutdown_connections 2019-11-28T11:53:57.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.441+0000 7f94122fb700 1 -- 172.21.15.80:0/2824010159 wait complete. 2019-11-28T11:53:57.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.441+0000 7f94122fb700 1 -- 172.21.15.80:0/2824010159 >> 172.21.15.80:0/2824010159 conn(0x7f940c061cf0 msgr2=0x7f940c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:57.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.443+0000 7f94122fb700 1 Processor -- start 2019-11-28T11:53:57.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.443+0000 7f94122fb700 1 -- start start 2019-11-28T11:53:57.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.444+0000 7f94122fb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f940c074d00 0x7f940c0750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:57.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.444+0000 7f94122fb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f940c152bd0 0x7f940c140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:57.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.444+0000 7f94122fb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940c079230 con 0x7f940c153040 2019-11-28T11:53:57.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.444+0000 7f94122fb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f940c07ab30 con 0x7f940c152bd0 2019-11-28T11:53:57.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.444+0000 7f94122fb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f940c07ae00 con 0x7f940c074d00 2019-11-28T11:53:57.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.444+0000 7f940bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f940c152bd0 0x7f940c140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.444+0000 7f940bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f940c152bd0 0x7f940c140440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44530/0 (socket says 172.21.15.80:44530) 2019-11-28T11:53:57.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.444+0000 7f940bfff700 1 -- 172.21.15.80:0/1683637406 learned_addr learned my addr 172.21.15.80:0/1683637406 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:57.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.444+0000 7f9410898700 1 --2- 172.21.15.80:0/1683637406 >> v2:172.21.15.174:3300/0 conn(0x7f940c074d00 0x7f940c0750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.444+0000 7f940bfff700 1 -- 172.21.15.80:0/1683637406 >> v2:172.21.15.174:3300/0 conn(0x7f940c074d00 msgr2=0x7f940c0750f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.444+0000 7f940bfff700 1 --2- 172.21.15.80:0/1683637406 >> v2:172.21.15.174:3300/0 conn(0x7f940c074d00 0x7f940c0750f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.444+0000 7f940bfff700 1 -- 172.21.15.80:0/1683637406 >> v1:172.21.15.174:6789/0 conn(0x7f940c153040 legacy=0x7f940c140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.445+0000 7f940bfff700 1 -- 172.21.15.80:0/1683637406 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c07b490 con 0x7f940c152bd0 2019-11-28T11:53:57.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.445+0000 7f940bfff700 1 --2- 172.21.15.80:0/1683637406 >> v2:172.21.15.80:3300/0 conn(0x7f940c152bd0 0x7f940c140440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f93fc010760 tx=0x7f93fc010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.445+0000 7f940bfff700 1 --2- 172.21.15.80:0/1683637406 >> v2:172.21.15.80:3300/0 conn(0x7f940c152bd0 0x7f940c140440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f93fc010760 tx=0x7f93fc010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.445+0000 7f940bfff700 1 --2- 172.21.15.80:0/1683637406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940c152bd0 0x7f940c140440 secure :-1 s=READY pgs=2465 cs=0 l=1 rx=0x7f93fc010760 tx=0x7f93fc010b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:57.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.445+0000 7f940bfff700 1 --2- 172.21.15.80:0/1683637406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940c152bd0 0x7f940c140440 secure :-1 s=THROTTLE_DONE pgs=2465 cs=0 l=1 rx=0x7f93fc010760 tx=0x7f93fc010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.445+0000 7f940bfff700 1 --2- 172.21.15.80:0/1683637406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940c152bd0 0x7f940c140440 secure :-1 s=THROTTLE_DONE pgs=2465 cs=0 l=1 rx=0x7f93fc010760 tx=0x7f93fc010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.445+0000 7f94097fa700 1 -- 172.21.15.80:0/1683637406 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93fc001050 con 0x7f940c152bd0 2019-11-28T11:53:57.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.445+0000 7f940bfff700 1 --2- 172.21.15.80:0/1683637406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940c152bd0 0x7f940c140440 secure :-1 s=THROTTLE_DONE pgs=2465 cs=0 l=1 rx=0x7f93fc010760 tx=0x7f93fc010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.445+0000 7f94097fa700 1 -- 172.21.15.80:0/1683637406 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93fc0047b0 con 0x7f940c152bd0 2019-11-28T11:53:57.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.445+0000 7f94122fb700 1 -- 172.21.15.80:0/1683637406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f940c07b810 con 0x7f940c152bd0 2019-11-28T11:53:57.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.445+0000 7f94097fa700 1 -- 172.21.15.80:0/1683637406 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93fc004e80 con 0x7f940c152bd0 2019-11-28T11:53:57.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.445+0000 7f94122fb700 1 -- 172.21.15.80:0/1683637406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f940c07b490 con 0x7f940c152bd0 2019-11-28T11:53:57.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.445+0000 7f940bfff700 1 --2- 172.21.15.80:0/1683637406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940c152bd0 0x7f940c140440 secure :-1 s=THROTTLE_DONE pgs=2465 cs=0 l=1 rx=0x7f93fc010760 tx=0x7f93fc010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.445+0000 7f94097fa700 1 -- 172.21.15.80:0/1683637406 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f93fc001870 con 0x7f940c152bd0 2019-11-28T11:53:57.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.445+0000 7f940bfff700 1 --2- 172.21.15.80:0/1683637406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940c152bd0 0x7f940c140440 secure :-1 s=THROTTLE_DONE pgs=2465 cs=0 l=1 rx=0x7f93fc010760 tx=0x7f93fc010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.446+0000 7f94097fa700 1 --2- 172.21.15.80:0/1683637406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93f0018730 0x7f93f001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:57.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.446+0000 7f94097fa700 1 -- 172.21.15.80:0/1683637406 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f93fc0320c0 con 0x7f940c152bd0 2019-11-28T11:53:57.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.446+0000 7f9410898700 1 --2- 172.21.15.80:0/1683637406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93f0018730 0x7f93f001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.446+0000 7f9410898700 1 --2- 172.21.15.80:0/1683637406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93f0018730 0x7f93f001abc0 crc :-1 s=READY pgs=1011 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:57.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.453+0000 7f94122fb700 1 -- 172.21.15.80:0/1683637406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e4002e60 con 0x7f940c152bd0 2019-11-28T11:53:57.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.456+0000 7f940bfff700 1 --2- 172.21.15.80:0/1683637406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940c152bd0 0x7f940c140440 secure :-1 s=THROTTLE_DONE pgs=2465 cs=0 l=1 rx=0x7f93fc010760 tx=0x7f93fc010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.456+0000 7f94097fa700 1 -- 172.21.15.80:0/1683637406 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f93fc001560 con 0x7f940c152bd0 2019-11-28T11:53:57.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.634+0000 7f94122fb700 1 -- 172.21.15.80:0/1683637406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93e4001d10 con 0x7f940c152bd0 2019-11-28T11:53:57.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.635+0000 7f940bfff700 1 --2- 172.21.15.80:0/1683637406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940c152bd0 0x7f940c140440 secure :-1 s=THROTTLE_DONE pgs=2465 cs=0 l=1 rx=0x7f93fc010760 tx=0x7f93fc010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.635+0000 7f94097fa700 1 -- 172.21.15.80:0/1683637406 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+14884 (secure 0 0 0) 0x7f93fc001870 con 0x7f940c152bd0 2019-11-28T11:53:57.691 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:57.692 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":189,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:53:57.302158+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:53:55.640729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":31,"pool_name":"cephfs_data","create_time":"2019-11-28T11:53:56.329039+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:53:57.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.637+0000 7f94122fb700 1 -- 172.21.15.80:0/1683637406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93f0018730 msgr2=0x7f93f001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.637+0000 7f94122fb700 1 --2- 172.21.15.80:0/1683637406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93f0018730 0x7f93f001abc0 crc :-1 s=READY pgs=1011 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.637+0000 7f94122fb700 1 -- 172.21.15.80:0/1683637406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940c152bd0 msgr2=0x7f940c140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.637+0000 7f94122fb700 1 --2- 172.21.15.80:0/1683637406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940c152bd0 0x7f940c140440 secure :-1 s=READY pgs=2465 cs=0 l=1 rx=0x7f93fc010760 tx=0x7f93fc010b00).stop 2019-11-28T11:53:57.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.637+0000 7f94122fb700 1 -- 172.21.15.80:0/1683637406 shutdown_connections 2019-11-28T11:53:57.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.637+0000 7f94122fb700 1 --2- 172.21.15.80:0/1683637406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93f0018730 0x7f93f001abc0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.637+0000 7f94122fb700 1 --2- 172.21.15.80:0/1683637406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940c152bd0 0x7f940c140440 unknown :-1 s=CLOSED pgs=2465 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.637+0000 7f94122fb700 1 --2- 172.21.15.80:0/1683637406 >> v2:172.21.15.174:3300/0 conn(0x7f940c074d00 0x7f940c0750f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.637+0000 7f94122fb700 1 -- 172.21.15.80:0/1683637406 shutdown_connections 2019-11-28T11:53:57.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.637+0000 7f94122fb700 1 -- 172.21.15.80:0/1683637406 wait complete. 2019-11-28T11:53:57.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.637+0000 7f94122fb700 1 -- 172.21.15.80:0/1683637406 >> 172.21.15.80:0/1683637406 conn(0x7f940c13fa50 msgr2=0x7f940c07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:57.704 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:53:57.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.768+0000 7f6d02216700 1 Processor -- start 2019-11-28T11:53:57.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.768+0000 7f6d02216700 1 -- start start 2019-11-28T11:53:57.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6d02216700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6cfc06c490 0x7f6cfc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:57.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6d02216700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cfc06db00 con 0x7f6cfc06c0a0 2019-11-28T11:53:57.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6d02216700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cfc06e000 con 0x7f6cfc06ce60 2019-11-28T11:53:57.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6d02216700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cfc06fd60 con 0x7f6cfc06c490 2019-11-28T11:53:57.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6cf3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6cfc06c490 0x7f6cfc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6cfbfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6cfc06c0a0 0x7f6cfc072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43850/0 (socket says 172.21.15.80:43850) 2019-11-28T11:53:57.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6cfbfff700 1 -- 172.21.15.80:0/176878317 learned_addr learned my addr 172.21.15.80:0/176878317 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:57.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6cf3fff700 1 -- 172.21.15.80:0/176878317 >> v1:172.21.15.174:6789/0 conn(0x7f6cfc06ce60 legacy=0x7f6cfc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6cf3fff700 1 -- 172.21.15.80:0/176878317 >> v1:172.21.15.80:6789/0 conn(0x7f6cfc06c0a0 legacy=0x7f6cfc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6cf3fff700 1 -- 172.21.15.80:0/176878317 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc0706c0 con 0x7f6cfc06c490 2019-11-28T11:53:57.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6cfb7fe700 1 -- 172.21.15.80:0/176878317 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780280460 0 0) 0x7f6cec001150 con 0x7f6cfc06c0a0 2019-11-28T11:53:57.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/176878317 >> v2:172.21.15.80:3300/0 conn(0x7f6cfc06c490 0x7f6cfc06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ce400af50 tx=0x7f6ce400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/176878317 >> v2:172.21.15.80:3300/0 conn(0x7f6cfc06c490 0x7f6cfc06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ce400af50 tx=0x7f6ce400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/176878317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cfc06c490 0x7f6cfc06c920 secure :-1 s=READY pgs=2467 cs=0 l=1 rx=0x7f6ce400af50 tx=0x7f6ce400b760).ready entity=mon.0 client_cookie=acd77ebc3c2794e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:57.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/176878317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cfc06c490 0x7f6cfc06c920 secure :-1 s=THROTTLE_DONE pgs=2467 cs=0 l=1 rx=0x7f6ce400af50 tx=0x7f6ce400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6cfb7fe700 1 -- 172.21.15.80:0/176878317 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ce4000960 con 0x7f6cfc06c490 2019-11-28T11:53:57.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/176878317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cfc06c490 0x7f6cfc06c920 secure :-1 s=THROTTLE_DONE pgs=2467 cs=0 l=1 rx=0x7f6ce400af50 tx=0x7f6ce400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/176878317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cfc06c490 0x7f6cfc06c920 secure :-1 s=THROTTLE_DONE pgs=2467 cs=0 l=1 rx=0x7f6ce400af50 tx=0x7f6ce400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6cfb7fe700 1 -- 172.21.15.80:0/176878317 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce4009860 con 0x7f6cfc06c490 2019-11-28T11:53:57.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6cfb7fe700 1 -- 172.21.15.80:0/176878317 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ce4009f30 con 0x7f6cfc06c490 2019-11-28T11:53:57.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.769+0000 7f6d02216700 1 -- 172.21.15.80:0/176878317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cfc06c490 msgr2=0x7f6cfc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.770+0000 7f6d02216700 1 --2- 172.21.15.80:0/176878317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cfc06c490 0x7f6cfc06c920 secure :-1 s=READY pgs=2467 cs=0 l=1 rx=0x7f6ce400af50 tx=0x7f6ce400b760).stop 2019-11-28T11:53:57.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.770+0000 7f6d02216700 1 -- 172.21.15.80:0/176878317 shutdown_connections 2019-11-28T11:53:57.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.770+0000 7f6d02216700 1 --2- 172.21.15.80:0/176878317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cfc06c490 0x7f6cfc06c920 unknown :-1 s=CLOSED pgs=2467 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.770+0000 7f6d02216700 1 -- 172.21.15.80:0/176878317 shutdown_connections 2019-11-28T11:53:57.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.770+0000 7f6d02216700 1 -- 172.21.15.80:0/176878317 wait complete. 2019-11-28T11:53:57.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.770+0000 7f6d02216700 1 -- 172.21.15.80:0/176878317 >> 172.21.15.80:0/176878317 conn(0x7f6cfc061cf0 msgr2=0x7f6cfc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:57.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.773+0000 7f6d02216700 1 Processor -- start 2019-11-28T11:53:57.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.773+0000 7f6d02216700 1 -- start start 2019-11-28T11:53:57.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.773+0000 7f6d02216700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cfc1145b0 0x7f6cfc114a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:57.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.773+0000 7f6d02216700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6cfc114f80 0x7f6cfc168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:57.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.773+0000 7f6d02216700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cfc13fc50 con 0x7f6cfc13f580 2019-11-28T11:53:57.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.773+0000 7f6d02216700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cfc112550 con 0x7f6cfc114f80 2019-11-28T11:53:57.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.773+0000 7f6d02216700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc112820 con 0x7f6cfc1145b0 2019-11-28T11:53:57.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6cf3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cfc1145b0 0x7f6cfc114a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6d00fb4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6cfc114f80 0x7f6cfc168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6cf3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cfc1145b0 0x7f6cfc114a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:46800/0 (socket says 172.21.15.80:46800) 2019-11-28T11:53:57.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6cf3fff700 1 -- 172.21.15.80:0/4188655911 learned_addr learned my addr 172.21.15.80:0/4188655911 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:57.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6cf3fff700 1 -- 172.21.15.80:0/4188655911 >> v2:172.21.15.174:3300/0 conn(0x7f6cfc114f80 msgr2=0x7f6cfc168a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/4188655911 >> v2:172.21.15.174:3300/0 conn(0x7f6cfc114f80 0x7f6cfc168a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6cf3fff700 1 -- 172.21.15.80:0/4188655911 >> v1:172.21.15.174:6789/0 conn(0x7f6cfc13f580 legacy=0x7f6cfc115730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6cf3fff700 1 -- 172.21.15.80:0/4188655911 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc112eb0 con 0x7f6cfc1145b0 2019-11-28T11:53:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cfc1145b0 0x7f6cfc114a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ce4010440 tx=0x7f6ce40102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cfc1145b0 0x7f6cfc114a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ce4010440 tx=0x7f6ce40102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cfc1145b0 0x7f6cfc114a40 secure :-1 s=READY pgs=351 cs=0 l=1 rx=0x7f6ce4010440 tx=0x7f6ce40102c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cfc1145b0 0x7f6cfc114a40 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f6ce4010440 tx=0x7f6ce40102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6cf97fa700 1 -- 172.21.15.80:0/4188655911 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ce4000940 con 0x7f6cfc1145b0 2019-11-28T11:53:57.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cfc1145b0 0x7f6cfc114a40 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f6ce4010440 tx=0x7f6ce40102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cfc1145b0 0x7f6cfc114a40 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f6ce4010440 tx=0x7f6ce40102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6cf97fa700 1 -- 172.21.15.80:0/4188655911 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce4009980 con 0x7f6cfc1145b0 2019-11-28T11:53:57.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6cf97fa700 1 -- 172.21.15.80:0/4188655911 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ce400a0d0 con 0x7f6cfc1145b0 2019-11-28T11:53:57.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.774+0000 7f6d02216700 1 -- 172.21.15.80:0/4188655911 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cfc113230 con 0x7f6cfc1145b0 2019-11-28T11:53:57.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.775+0000 7f6d02216700 1 -- 172.21.15.80:0/4188655911 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cfc112eb0 con 0x7f6cfc1145b0 2019-11-28T11:53:57.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.775+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cfc1145b0 0x7f6cfc114a40 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f6ce4010440 tx=0x7f6ce40102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.775+0000 7f6cf97fa700 1 -- 172.21.15.80:0/4188655911 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6ce4009790 con 0x7f6cfc1145b0 2019-11-28T11:53:57.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.775+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cfc1145b0 0x7f6cfc114a40 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f6ce4010440 tx=0x7f6ce40102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.775+0000 7f6cf97fa700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ce0018730 0x7f6ce001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:57.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.775+0000 7f6cf97fa700 1 -- 172.21.15.80:0/4188655911 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6ce4031a40 con 0x7f6cfc1145b0 2019-11-28T11:53:57.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.776+0000 7f6cfbfff700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ce0018730 0x7f6ce001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:57.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.776+0000 7f6cfbfff700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ce0018730 0x7f6ce001abc0 crc :-1 s=READY pgs=1012 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:57.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.783+0000 7f6d02216700 1 -- 172.21.15.80:0/4188655911 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cfc113230 con 0x7f6cfc1145b0 2019-11-28T11:53:57.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.787+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cfc1145b0 0x7f6cfc114a40 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f6ce4010440 tx=0x7f6ce40102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:57.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.787+0000 7f6cf97fa700 1 -- 172.21.15.80:0/4188655911 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6ce4009580 con 0x7f6cfc1145b0 2019-11-28T11:53:58.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.962+0000 7f6d02216700 1 -- 172.21.15.80:0/4188655911 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cfc112eb0 con 0x7f6cfc1145b0 2019-11-28T11:53:58.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.963+0000 7f6cf3fff700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cfc1145b0 0x7f6cfc114a40 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f6ce4010440 tx=0x7f6ce40102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:58.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.963+0000 7f6cf97fa700 1 -- 172.21.15.80:0/4188655911 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+14884 (secure 0 0 0) 0x7f6ce4009790 con 0x7f6cfc1145b0 2019-11-28T11:53:58.022 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:58.022 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":189,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:53:57.302158+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:53:55.640729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":31,"pool_name":"cephfs_data","create_time":"2019-11-28T11:53:56.329039+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:53:58.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.967+0000 7f6d02216700 1 -- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ce0018730 msgr2=0x7f6ce001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:58.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.967+0000 7f6d02216700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ce0018730 0x7f6ce001abc0 crc :-1 s=READY pgs=1012 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:58.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.967+0000 7f6d02216700 1 -- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cfc1145b0 msgr2=0x7f6cfc114a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:58.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.967+0000 7f6d02216700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cfc1145b0 0x7f6cfc114a40 secure :-1 s=READY pgs=351 cs=0 l=1 rx=0x7f6ce4010440 tx=0x7f6ce40102c0).stop 2019-11-28T11:53:58.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.967+0000 7f6d02216700 1 -- 172.21.15.80:0/4188655911 shutdown_connections 2019-11-28T11:53:58.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.967+0000 7f6d02216700 1 --2- 172.21.15.80:0/4188655911 >> v2:172.21.15.174:3300/0 conn(0x7f6cfc114f80 0x7f6cfc168a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:58.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.967+0000 7f6d02216700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cfc1145b0 0x7f6cfc114a40 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:58.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.967+0000 7f6d02216700 1 --2- 172.21.15.80:0/4188655911 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ce0018730 0x7f6ce001abc0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:58.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.967+0000 7f6d02216700 1 -- 172.21.15.80:0/4188655911 shutdown_connections 2019-11-28T11:53:58.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.968+0000 7f6d02216700 1 -- 172.21.15.80:0/4188655911 wait complete. 2019-11-28T11:53:58.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:57.968+0000 7f6d02216700 1 -- 172.21.15.80:0/4188655911 >> 172.21.15.80:0/4188655911 conn(0x7f6cfc1426c0 msgr2=0x7f6cfc110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:58.035 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:53:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.102+0000 7fc032bbd700 1 Processor -- start 2019-11-28T11:53:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.102+0000 7fc032bbd700 1 -- start start 2019-11-28T11:53:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.103+0000 7fc032bbd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02c15f100 0x7fc02c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.103+0000 7fc032bbd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc02c06c2f0 0x7fc02c06c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.103+0000 7fc032bbd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02c06db60 con 0x7fc02c15ed10 2019-11-28T11:53:58.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.103+0000 7fc032bbd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02c06fe00 con 0x7fc02c06c2f0 2019-11-28T11:53:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.103+0000 7fc032bbd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c0700d0 con 0x7fc02c15f100 2019-11-28T11:53:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.103+0000 7fc030959700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02c15f100 0x7fc02c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.103+0000 7fc03195b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc02c06c2f0 0x7fc02c06c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc030959700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02c15f100 0x7fc02c06bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:46812/0 (socket says 172.21.15.80:46812) 2019-11-28T11:53:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc03195b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc02c06c2f0 0x7fc02c06c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:59436/0 (socket says 172.21.15.80:59436) 2019-11-28T11:53:58.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc03115a700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc02c15ed10 0x7fc02c073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:59408/0 (socket says 172.21.15.80:59408) 2019-11-28T11:53:58.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc030959700 1 -- 172.21.15.80:0/3189760129 learned_addr learned my addr 172.21.15.80:0/3189760129 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:58.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc030959700 1 -- 172.21.15.80:0/3189760129 >> v2:172.21.15.174:3300/0 conn(0x7fc02c06c2f0 msgr2=0x7fc02c06c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:58.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc030959700 1 --2- 172.21.15.80:0/3189760129 >> v2:172.21.15.174:3300/0 conn(0x7fc02c06c2f0 0x7fc02c06c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:58.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc030959700 1 -- 172.21.15.80:0/3189760129 >> v1:172.21.15.174:6789/0 conn(0x7fc02c15ed10 legacy=0x7fc02c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:58.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc02bfff700 1 -- 172.21.15.80:0/3189760129 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133988817 0 0) 0x7fc014001400 con 0x7fc02c15ed10 2019-11-28T11:53:58.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc030959700 1 -- 172.21.15.80:0/3189760129 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c070760 con 0x7fc02c15f100 2019-11-28T11:53:58.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc03195b700 1 --2- 172.21.15.80:0/3189760129 >> v2:172.21.15.174:3300/0 conn(0x7fc02c06c2f0 0x7fc02c06c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:58.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc030959700 1 --2- 172.21.15.80:0/3189760129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02c15f100 0x7fc02c06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc01c00f740 tx=0x7fc01c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:58.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc030959700 1 --2- 172.21.15.80:0/3189760129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02c15f100 0x7fc02c06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc01c00f740 tx=0x7fc01c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:58.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc030959700 1 --2- 172.21.15.80:0/3189760129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02c15f100 0x7fc02c06bdb0 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7fc01c00f740 tx=0x7fc01c00fae0).ready entity=mon.2 client_cookie=420d307a579fbb9d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:58.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc030959700 1 --2- 172.21.15.80:0/3189760129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02c15f100 0x7fc02c06bdb0 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7fc01c00f740 tx=0x7fc01c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:58.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc02bfff700 1 -- 172.21.15.80:0/3189760129 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc01c000960 con 0x7fc02c15f100 2019-11-28T11:53:58.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc030959700 1 --2- 172.21.15.80:0/3189760129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02c15f100 0x7fc02c06bdb0 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7fc01c00f740 tx=0x7fc01c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:58.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc02bfff700 1 -- 172.21.15.80:0/3189760129 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c000c90 con 0x7fc02c15f100 2019-11-28T11:53:58.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc030959700 1 --2- 172.21.15.80:0/3189760129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02c15f100 0x7fc02c06bdb0 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7fc01c00f740 tx=0x7fc01c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:58.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc02bfff700 1 -- 172.21.15.80:0/3189760129 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc01c007210 con 0x7fc02c15f100 2019-11-28T11:53:58.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc032bbd700 1 -- 172.21.15.80:0/3189760129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02c15f100 msgr2=0x7fc02c06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:58.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.104+0000 7fc032bbd700 1 --2- 172.21.15.80:0/3189760129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02c15f100 0x7fc02c06bdb0 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7fc01c00f740 tx=0x7fc01c00fae0).stop 2019-11-28T11:53:58.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.105+0000 7fc032bbd700 1 -- 172.21.15.80:0/3189760129 shutdown_connections 2019-11-28T11:53:58.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.105+0000 7fc032bbd700 1 --2- 172.21.15.80:0/3189760129 >> v2:172.21.15.174:3300/0 conn(0x7fc02c06c2f0 0x7fc02c06c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:58.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.105+0000 7fc032bbd700 1 --2- 172.21.15.80:0/3189760129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc02c15f100 0x7fc02c06bdb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:58.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.105+0000 7fc032bbd700 1 -- 172.21.15.80:0/3189760129 shutdown_connections 2019-11-28T11:53:58.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.105+0000 7fc032bbd700 1 -- 172.21.15.80:0/3189760129 wait complete. 2019-11-28T11:53:58.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.105+0000 7fc032bbd700 1 -- 172.21.15.80:0/3189760129 >> 172.21.15.80:0/3189760129 conn(0x7fc02c061d20 msgr2=0x7fc02c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:58.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.108+0000 7fc032bbd700 1 Processor -- start 2019-11-28T11:53:58.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.108+0000 7fc032bbd700 1 -- start start 2019-11-28T11:53:58.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc032bbd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc02c10e970 0x7fc02c1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:58.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc032bbd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc02c108cf0 0x7fc02c107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:58.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc032bbd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02c10c250 con 0x7fc02c107b70 2019-11-28T11:53:58.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc032bbd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02c10e430 con 0x7fc02c108cf0 2019-11-28T11:53:58.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc032bbd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02c105860 con 0x7fc02c10e970 2019-11-28T11:53:58.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc030959700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc02c108cf0 0x7fc02c107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:58.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc03115a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc02c10e970 0x7fc02c1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:58.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc030959700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc02c108cf0 0x7fc02c107630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44556/0 (socket says 172.21.15.80:44556) 2019-11-28T11:53:58.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc030959700 1 -- 172.21.15.80:0/1045191266 learned_addr learned my addr 172.21.15.80:0/1045191266 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:58.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc030959700 1 -- 172.21.15.80:0/1045191266 >> v2:172.21.15.174:3300/0 conn(0x7fc02c10e970 msgr2=0x7fc02c1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:58.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc030959700 1 --2- 172.21.15.80:0/1045191266 >> v2:172.21.15.174:3300/0 conn(0x7fc02c10e970 0x7fc02c1087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:58.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc030959700 1 -- 172.21.15.80:0/1045191266 >> v1:172.21.15.174:6789/0 conn(0x7fc02c107b70 legacy=0x7fc02c10ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:58.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc030959700 1 -- 172.21.15.80:0/1045191266 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c105ef0 con 0x7fc02c108cf0 2019-11-28T11:53:58.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc030959700 1 --2- 172.21.15.80:0/1045191266 >> v2:172.21.15.80:3300/0 conn(0x7fc02c108cf0 0x7fc02c107630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc01c0544c0 tx=0x7fc01c0079e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:58.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc030959700 1 --2- 172.21.15.80:0/1045191266 >> v2:172.21.15.80:3300/0 conn(0x7fc02c108cf0 0x7fc02c107630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc01c0544c0 tx=0x7fc01c0079e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:58.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc030959700 1 --2- 172.21.15.80:0/1045191266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c108cf0 0x7fc02c107630 secure :-1 s=READY pgs=2468 cs=0 l=1 rx=0x7fc01c0544c0 tx=0x7fc01c0079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:58.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc030959700 1 --2- 172.21.15.80:0/1045191266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c108cf0 0x7fc02c107630 secure :-1 s=THROTTLE_DONE pgs=2468 cs=0 l=1 rx=0x7fc01c0544c0 tx=0x7fc01c0079e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:58.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc029ffb700 1 -- 172.21.15.80:0/1045191266 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc01c007de0 con 0x7fc02c108cf0 2019-11-28T11:53:58.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc030959700 1 --2- 172.21.15.80:0/1045191266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c108cf0 0x7fc02c107630 secure :-1 s=THROTTLE_DONE pgs=2468 cs=0 l=1 rx=0x7fc01c0544c0 tx=0x7fc01c0079e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:58.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc032bbd700 1 -- 172.21.15.80:0/1045191266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02c106270 con 0x7fc02c108cf0 2019-11-28T11:53:58.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc029ffb700 1 -- 172.21.15.80:0/1045191266 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c007cd0 con 0x7fc02c108cf0 2019-11-28T11:53:58.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc030959700 1 --2- 172.21.15.80:0/1045191266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c108cf0 0x7fc02c107630 secure :-1 s=THROTTLE_DONE pgs=2468 cs=0 l=1 rx=0x7fc01c0544c0 tx=0x7fc01c0079e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:58.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc029ffb700 1 -- 172.21.15.80:0/1045191266 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc01c005560 con 0x7fc02c108cf0 2019-11-28T11:53:58.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.109+0000 7fc032bbd700 1 -- 172.21.15.80:0/1045191266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02c105ef0 con 0x7fc02c108cf0 2019-11-28T11:53:58.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.110+0000 7fc030959700 1 --2- 172.21.15.80:0/1045191266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c108cf0 0x7fc02c107630 secure :-1 s=THROTTLE_DONE pgs=2468 cs=0 l=1 rx=0x7fc01c0544c0 tx=0x7fc01c0079e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:58.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.110+0000 7fc029ffb700 1 -- 172.21.15.80:0/1045191266 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc01c005180 con 0x7fc02c108cf0 2019-11-28T11:53:58.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.110+0000 7fc030959700 1 --2- 172.21.15.80:0/1045191266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c108cf0 0x7fc02c107630 secure :-1 s=THROTTLE_DONE pgs=2468 cs=0 l=1 rx=0x7fc01c0544c0 tx=0x7fc01c0079e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:58.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.110+0000 7fc029ffb700 1 --2- 172.21.15.80:0/1045191266 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc010018730 0x7fc01001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:58.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.110+0000 7fc029ffb700 1 -- 172.21.15.80:0/1045191266 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc01c075b60 con 0x7fc02c108cf0 2019-11-28T11:53:58.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.110+0000 7fc03115a700 1 --2- 172.21.15.80:0/1045191266 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc010018730 0x7fc01001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:58.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.111+0000 7fc03115a700 1 --2- 172.21.15.80:0/1045191266 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc010018730 0x7fc01001abc0 crc :-1 s=READY pgs=1013 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:58.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.118+0000 7fc032bbd700 1 -- 172.21.15.80:0/1045191266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02c106270 con 0x7fc02c108cf0 2019-11-28T11:53:58.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.121+0000 7fc030959700 1 --2- 172.21.15.80:0/1045191266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c108cf0 0x7fc02c107630 secure :-1 s=THROTTLE_DONE pgs=2468 cs=0 l=1 rx=0x7fc01c0544c0 tx=0x7fc01c0079e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:58.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.121+0000 7fc029ffb700 1 -- 172.21.15.80:0/1045191266 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc01c0029d0 con 0x7fc02c108cf0 2019-11-28T11:53:58.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.293+0000 7fc032bbd700 1 -- 172.21.15.80:0/1045191266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7fc02c105ef0 con 0x7fc02c108cf0 2019-11-28T11:53:59.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.977+0000 7fc030959700 1 --2- 172.21.15.80:0/1045191266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c108cf0 0x7fc02c107630 secure :-1 s=THROTTLE_DONE pgs=2468 cs=0 l=1 rx=0x7fc01c0544c0 tx=0x7fc01c0079e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:58.977+0000 7fc029ffb700 1 -- 172.21.15.80:0/1045191266 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v150) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc01c005180 con 0x7fc02c108cf0 2019-11-28T11:53:59.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.011+0000 7fc032bbd700 1 -- 172.21.15.80:0/1045191266 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc010018730 msgr2=0x7fc01001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.011+0000 7fc032bbd700 1 --2- 172.21.15.80:0/1045191266 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc010018730 0x7fc01001abc0 crc :-1 s=READY pgs=1013 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.011+0000 7fc032bbd700 1 -- 172.21.15.80:0/1045191266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c108cf0 msgr2=0x7fc02c107630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.011+0000 7fc032bbd700 1 --2- 172.21.15.80:0/1045191266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c108cf0 0x7fc02c107630 secure :-1 s=READY pgs=2468 cs=0 l=1 rx=0x7fc01c0544c0 tx=0x7fc01c0079e0).stop 2019-11-28T11:53:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.011+0000 7fc032bbd700 1 -- 172.21.15.80:0/1045191266 shutdown_connections 2019-11-28T11:53:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.011+0000 7fc032bbd700 1 --2- 172.21.15.80:0/1045191266 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc010018730 0x7fc01001abc0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.011+0000 7fc032bbd700 1 --2- 172.21.15.80:0/1045191266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc02c108cf0 0x7fc02c107630 unknown :-1 s=CLOSED pgs=2468 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.011+0000 7fc032bbd700 1 --2- 172.21.15.80:0/1045191266 >> v2:172.21.15.174:3300/0 conn(0x7fc02c10e970 0x7fc02c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.011+0000 7fc032bbd700 1 -- 172.21.15.80:0/1045191266 shutdown_connections 2019-11-28T11:53:59.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.011+0000 7fc032bbd700 1 -- 172.21.15.80:0/1045191266 wait complete. 2019-11-28T11:53:59.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.011+0000 7fc032bbd700 1 -- 172.21.15.80:0/1045191266 >> 172.21.15.80:0/1045191266 conn(0x7fc02c15e2d0 msgr2=0x7fc02c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:59.077 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:53:59.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.140+0000 7f3993820700 1 Processor -- start 2019-11-28T11:53:59.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.140+0000 7f3993820700 1 -- start start 2019-11-28T11:53:59.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.141+0000 7f3993820700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f398c06c490 0x7f398c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:59.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.141+0000 7f3993820700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f398c06ce60 0x7f398c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:59.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.141+0000 7f3993820700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c06db00 con 0x7f398c06c0a0 2019-11-28T11:53:59.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.141+0000 7f3993820700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c06fd60 con 0x7f398c06c490 2019-11-28T11:53:59.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.141+0000 7f3993820700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c070030 con 0x7f398c06ce60 2019-11-28T11:53:59.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f39915bc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f398c06c490 0x7f398c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:59.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f39915bc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f398c06c490 0x7f398c06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44566/0 (socket says 172.21.15.80:44566) 2019-11-28T11:53:59.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f39915bc700 1 -- 172.21.15.80:0/1468002684 learned_addr learned my addr 172.21.15.80:0/1468002684 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:59.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f39925be700 1 --2- 172.21.15.80:0/1468002684 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f398c06ce60 0x7f398c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:59.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f39915bc700 1 -- 172.21.15.80:0/1468002684 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f398c06ce60 msgr2=0x7f398c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:59.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f39915bc700 1 --2- 172.21.15.80:0/1468002684 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f398c06ce60 0x7f398c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:59.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f39915bc700 1 -- 172.21.15.80:0/1468002684 >> v1:172.21.15.174:6789/0 conn(0x7f398c06c0a0 legacy=0x7f398c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f39915bc700 1 -- 172.21.15.80:0/1468002684 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c0706c0 con 0x7f398c06c490 2019-11-28T11:53:59.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f3990dbb700 1 -- 172.21.15.80:0/1468002684 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766936719 0 0) 0x7f3974001400 con 0x7f398c06c0a0 2019-11-28T11:53:59.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f39915bc700 1 --2- 172.21.15.80:0/1468002684 >> v2:172.21.15.80:3300/0 conn(0x7f398c06c490 0x7f398c06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f397c00f6c0 tx=0x7f397c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f39915bc700 1 --2- 172.21.15.80:0/1468002684 >> v2:172.21.15.80:3300/0 conn(0x7f398c06c490 0x7f398c06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f397c00f6c0 tx=0x7f397c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f39915bc700 1 --2- 172.21.15.80:0/1468002684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c06c490 0x7f398c06c920 secure :-1 s=READY pgs=2469 cs=0 l=1 rx=0x7f397c00f6c0 tx=0x7f397c00fa60).ready entity=mon.0 client_cookie=b6e37bf8c63509c4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:59.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f39915bc700 1 --2- 172.21.15.80:0/1468002684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c06c490 0x7f398c06c920 secure :-1 s=THROTTLE_DONE pgs=2469 cs=0 l=1 rx=0x7f397c00f6c0 tx=0x7f397c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f3990dbb700 1 -- 172.21.15.80:0/1468002684 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f397c000960 con 0x7f398c06c490 2019-11-28T11:53:59.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f39915bc700 1 --2- 172.21.15.80:0/1468002684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c06c490 0x7f398c06c920 secure :-1 s=THROTTLE_DONE pgs=2469 cs=0 l=1 rx=0x7f397c00f6c0 tx=0x7f397c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f3990dbb700 1 -- 172.21.15.80:0/1468002684 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c000c90 con 0x7f398c06c490 2019-11-28T11:53:59.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f39915bc700 1 --2- 172.21.15.80:0/1468002684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c06c490 0x7f398c06c920 secure :-1 s=THROTTLE_DONE pgs=2469 cs=0 l=1 rx=0x7f397c00f6c0 tx=0x7f397c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f3990dbb700 1 -- 172.21.15.80:0/1468002684 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f397c007210 con 0x7f398c06c490 2019-11-28T11:53:59.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f3993820700 1 -- 172.21.15.80:0/1468002684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c06c490 msgr2=0x7f398c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.142+0000 7f3993820700 1 --2- 172.21.15.80:0/1468002684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c06c490 0x7f398c06c920 secure :-1 s=READY pgs=2469 cs=0 l=1 rx=0x7f397c00f6c0 tx=0x7f397c00fa60).stop 2019-11-28T11:53:59.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.143+0000 7f3993820700 1 -- 172.21.15.80:0/1468002684 shutdown_connections 2019-11-28T11:53:59.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.143+0000 7f3993820700 1 --2- 172.21.15.80:0/1468002684 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f398c06ce60 0x7f398c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:59.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.143+0000 7f3993820700 1 --2- 172.21.15.80:0/1468002684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c06c490 0x7f398c06c920 unknown :-1 s=CLOSED pgs=2469 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.143+0000 7f3993820700 1 -- 172.21.15.80:0/1468002684 shutdown_connections 2019-11-28T11:53:59.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.143+0000 7f3993820700 1 -- 172.21.15.80:0/1468002684 wait complete. 2019-11-28T11:53:59.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.143+0000 7f3993820700 1 -- 172.21.15.80:0/1468002684 >> 172.21.15.80:0/1468002684 conn(0x7f398c061cf0 msgr2=0x7f398c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:59.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.146+0000 7f3993820700 1 Processor -- start 2019-11-28T11:53:59.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.146+0000 7f3993820700 1 -- start start 2019-11-28T11:53:59.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.146+0000 7f3993820700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f398c10cfb0 0x7f398c10d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:59.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.146+0000 7f3993820700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f398c10d980 0x7f398c12c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:59.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.146+0000 7f3993820700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c135c60 con 0x7f398c104d10 2019-11-28T11:53:59.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.146+0000 7f3993820700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c141e60 con 0x7f398c10d980 2019-11-28T11:53:59.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.146+0000 7f3993820700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c107cb0 con 0x7f398c10cfb0 2019-11-28T11:53:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f39925be700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f398c10d980 0x7f398c12c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f39925be700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f398c10d980 0x7f398c12c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44572/0 (socket says 172.21.15.80:44572) 2019-11-28T11:53:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f39925be700 1 -- 172.21.15.80:0/1011336662 learned_addr learned my addr 172.21.15.80:0/1011336662 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f39915bc700 1 --2- 172.21.15.80:0/1011336662 >> v2:172.21.15.174:3300/0 conn(0x7f398c10cfb0 0x7f398c10d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f39925be700 1 -- 172.21.15.80:0/1011336662 >> v2:172.21.15.174:3300/0 conn(0x7f398c10cfb0 msgr2=0x7f398c10d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f39925be700 1 --2- 172.21.15.80:0/1011336662 >> v2:172.21.15.174:3300/0 conn(0x7f398c10cfb0 0x7f398c10d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f39925be700 1 -- 172.21.15.80:0/1011336662 >> v1:172.21.15.174:6789/0 conn(0x7f398c104d10 legacy=0x7f398c10e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f39925be700 1 -- 172.21.15.80:0/1011336662 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c1424f0 con 0x7f398c10d980 2019-11-28T11:53:59.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f39925be700 1 --2- 172.21.15.80:0/1011336662 >> v2:172.21.15.80:3300/0 conn(0x7f398c10d980 0x7f398c12c410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3984010450 tx=0x7f3984010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f39925be700 1 --2- 172.21.15.80:0/1011336662 >> v2:172.21.15.80:3300/0 conn(0x7f398c10d980 0x7f398c12c410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3984010450 tx=0x7f3984010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f39925be700 1 --2- 172.21.15.80:0/1011336662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c10d980 0x7f398c12c410 secure :-1 s=READY pgs=2470 cs=0 l=1 rx=0x7f3984010450 tx=0x7f3984010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:59.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f39925be700 1 --2- 172.21.15.80:0/1011336662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c10d980 0x7f398c12c410 secure :-1 s=THROTTLE_DONE pgs=2470 cs=0 l=1 rx=0x7f3984010450 tx=0x7f3984010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f398a7fc700 1 -- 172.21.15.80:0/1011336662 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f398400f090 con 0x7f398c10d980 2019-11-28T11:53:59.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f39925be700 1 --2- 172.21.15.80:0/1011336662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c10d980 0x7f398c12c410 secure :-1 s=THROTTLE_DONE pgs=2470 cs=0 l=1 rx=0x7f3984010450 tx=0x7f3984010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f39925be700 1 --2- 172.21.15.80:0/1011336662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c10d980 0x7f398c12c410 secure :-1 s=THROTTLE_DONE pgs=2470 cs=0 l=1 rx=0x7f3984010450 tx=0x7f3984010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f398a7fc700 1 -- 172.21.15.80:0/1011336662 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3984000a70 con 0x7f398c10d980 2019-11-28T11:53:59.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f3993820700 1 -- 172.21.15.80:0/1011336662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c1424f0 con 0x7f398c10d980 2019-11-28T11:53:59.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f398a7fc700 1 -- 172.21.15.80:0/1011336662 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f398400f670 con 0x7f398c10d980 2019-11-28T11:53:59.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.147+0000 7f3993820700 1 -- 172.21.15.80:0/1011336662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c1424f0 con 0x7f398c10d980 2019-11-28T11:53:59.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.148+0000 7f39925be700 1 --2- 172.21.15.80:0/1011336662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c10d980 0x7f398c12c410 secure :-1 s=THROTTLE_DONE pgs=2470 cs=0 l=1 rx=0x7f3984010450 tx=0x7f3984010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.148+0000 7f398a7fc700 1 -- 172.21.15.80:0/1011336662 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f398400ed50 con 0x7f398c10d980 2019-11-28T11:53:59.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.148+0000 7f398a7fc700 1 --2- 172.21.15.80:0/1011336662 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3970018730 0x7f397001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:59.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.148+0000 7f3991dbd700 1 --2- 172.21.15.80:0/1011336662 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3970018730 0x7f397001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:59.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.148+0000 7f39925be700 1 --2- 172.21.15.80:0/1011336662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c10d980 0x7f398c12c410 secure :-1 s=THROTTLE_DONE pgs=2470 cs=0 l=1 rx=0x7f3984010450 tx=0x7f3984010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.148+0000 7f398a7fc700 1 -- 172.21.15.80:0/1011336662 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3984000a70 con 0x7f398c10d980 2019-11-28T11:53:59.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.148+0000 7f3991dbd700 1 --2- 172.21.15.80:0/1011336662 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3970018730 0x7f397001abe0 crc :-1 s=READY pgs=1014 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:59.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.156+0000 7f3993820700 1 -- 172.21.15.80:0/1011336662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c1424f0 con 0x7f398c10d980 2019-11-28T11:53:59.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.159+0000 7f39925be700 1 --2- 172.21.15.80:0/1011336662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c10d980 0x7f398c12c410 secure :-1 s=THROTTLE_DONE pgs=2470 cs=0 l=1 rx=0x7f3984010450 tx=0x7f3984010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.159+0000 7f398a7fc700 1 -- 172.21.15.80:0/1011336662 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f398400ea80 con 0x7f398c10d980 2019-11-28T11:53:59.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.336+0000 7f3993820700 1 -- 172.21.15.80:0/1011336662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f398c1424f0 con 0x7f398c10d980 2019-11-28T11:53:59.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.336+0000 7f39925be700 1 --2- 172.21.15.80:0/1011336662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c10d980 0x7f398c12c410 secure :-1 s=THROTTLE_DONE pgs=2470 cs=0 l=1 rx=0x7f3984010450 tx=0x7f3984010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.336+0000 7f398a7fc700 1 -- 172.21.15.80:0/1011336662 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) v1 ==== 95+0+1428 (secure 0 0 0) 0x7f3984017a50 con 0x7f398c10d980 2019-11-28T11:53:59.394 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 150 2019-11-28T11:53:59.394 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:59.394 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":150,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:53:57.302329+0000","modified":"2019-11-28T11:53:58.974554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2019-11-28T11:53:59.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.339+0000 7f3993820700 1 -- 172.21.15.80:0/1011336662 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3970018730 msgr2=0x7f397001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.339+0000 7f3993820700 1 --2- 172.21.15.80:0/1011336662 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3970018730 0x7f397001abe0 crc :-1 s=READY pgs=1014 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.339+0000 7f3993820700 1 -- 172.21.15.80:0/1011336662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c10d980 msgr2=0x7f398c12c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.339+0000 7f3993820700 1 --2- 172.21.15.80:0/1011336662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c10d980 0x7f398c12c410 secure :-1 s=READY pgs=2470 cs=0 l=1 rx=0x7f3984010450 tx=0x7f3984010280).stop 2019-11-28T11:53:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.339+0000 7f3993820700 1 -- 172.21.15.80:0/1011336662 shutdown_connections 2019-11-28T11:53:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.339+0000 7f3993820700 1 --2- 172.21.15.80:0/1011336662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398c10d980 0x7f398c12c410 unknown :-1 s=CLOSED pgs=2470 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.339+0000 7f3993820700 1 --2- 172.21.15.80:0/1011336662 >> v2:172.21.15.174:3300/0 conn(0x7f398c10cfb0 0x7f398c10d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.339+0000 7f3993820700 1 --2- 172.21.15.80:0/1011336662 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3970018730 0x7f397001abe0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.339+0000 7f3993820700 1 -- 172.21.15.80:0/1011336662 shutdown_connections 2019-11-28T11:53:59.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.339+0000 7f3993820700 1 -- 172.21.15.80:0/1011336662 wait complete. 2019-11-28T11:53:59.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.339+0000 7f3993820700 1 -- 172.21.15.80:0/1011336662 >> 172.21.15.80:0/1011336662 conn(0x7f398c15e210 msgr2=0x7f398c10b140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:59.407 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:53:59.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.470+0000 7f1e9b234700 1 Processor -- start 2019-11-28T11:53:59.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.470+0000 7f1e9b234700 1 -- start start 2019-11-28T11:53:59.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.471+0000 7f1e9b234700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9406c0a0 0x7f1e94072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:59.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.471+0000 7f1e9b234700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9406db00 con 0x7f1e940734e0 2019-11-28T11:53:59.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.471+0000 7f1e9b234700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9406e000 con 0x7f1e94072620 2019-11-28T11:53:59.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.471+0000 7f1e9b234700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9406f330 con 0x7f1e9406c0a0 2019-11-28T11:53:59.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e98fd0700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1e940734e0 0x7f1e94071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43896/0 (socket says 172.21.15.80:43896) 2019-11-28T11:53:59.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e98fd0700 1 -- 172.21.15.80:0/2208242219 learned_addr learned my addr 172.21.15.80:0/2208242219 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:59.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e997d1700 1 --2- 172.21.15.80:0/2208242219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9406c0a0 0x7f1e94072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:59.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e93fff700 1 -- 172.21.15.80:0/2208242219 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399020368 0 0) 0x7f1e84001070 con 0x7f1e940734e0 2019-11-28T11:53:59.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e93fff700 1 -- 172.21.15.80:0/2208242219 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e80002e80 con 0x7f1e940734e0 2019-11-28T11:53:59.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e93fff700 1 -- 172.21.15.80:0/2208242219 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008338546 0 0) 0x7f1e8c0009b0 con 0x7f1e94072620 2019-11-28T11:53:59.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e93fff700 1 -- 172.21.15.80:0/2208242219 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e800030b0 con 0x7f1e94072620 2019-11-28T11:53:59.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e997d1700 1 -- 172.21.15.80:0/2208242219 >> v1:172.21.15.174:6789/0 conn(0x7f1e94072620 legacy=0x7f1e94164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e997d1700 1 -- 172.21.15.80:0/2208242219 >> v1:172.21.15.80:6789/0 conn(0x7f1e940734e0 legacy=0x7f1e94071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e997d1700 1 -- 172.21.15.80:0/2208242219 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e940706c0 con 0x7f1e9406c0a0 2019-11-28T11:53:59.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e997d1700 1 --2- 172.21.15.80:0/2208242219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9406c0a0 0x7f1e94072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1e7c00b2d0 tx=0x7f1e7c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e997d1700 1 --2- 172.21.15.80:0/2208242219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9406c0a0 0x7f1e94072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1e7c00b2d0 tx=0x7f1e7c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e997d1700 1 --2- 172.21.15.80:0/2208242219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9406c0a0 0x7f1e94072fa0 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7f1e7c00b2d0 tx=0x7f1e7c00bae0).ready entity=mon.2 client_cookie=b5797f1b212c5624 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:59.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e997d1700 1 --2- 172.21.15.80:0/2208242219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9406c0a0 0x7f1e94072fa0 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f1e7c00b2d0 tx=0x7f1e7c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e93fff700 1 -- 172.21.15.80:0/2208242219 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e7c000ce0 con 0x7f1e9406c0a0 2019-11-28T11:53:59.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e997d1700 1 --2- 172.21.15.80:0/2208242219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9406c0a0 0x7f1e94072fa0 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f1e7c00b2d0 tx=0x7f1e7c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e997d1700 1 --2- 172.21.15.80:0/2208242219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9406c0a0 0x7f1e94072fa0 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f1e7c00b2d0 tx=0x7f1e7c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e93fff700 1 -- 172.21.15.80:0/2208242219 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c009be0 con 0x7f1e9406c0a0 2019-11-28T11:53:59.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e93fff700 1 -- 172.21.15.80:0/2208242219 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e7c00a2b0 con 0x7f1e9406c0a0 2019-11-28T11:53:59.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e9b234700 1 -- 172.21.15.80:0/2208242219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9406c0a0 msgr2=0x7f1e94072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.472+0000 7f1e9b234700 1 --2- 172.21.15.80:0/2208242219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9406c0a0 0x7f1e94072fa0 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7f1e7c00b2d0 tx=0x7f1e7c00bae0).stop 2019-11-28T11:53:59.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.473+0000 7f1e9b234700 1 -- 172.21.15.80:0/2208242219 shutdown_connections 2019-11-28T11:53:59.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.473+0000 7f1e9b234700 1 --2- 172.21.15.80:0/2208242219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e9406c0a0 0x7f1e94072fa0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.473+0000 7f1e9b234700 1 -- 172.21.15.80:0/2208242219 shutdown_connections 2019-11-28T11:53:59.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.473+0000 7f1e9b234700 1 -- 172.21.15.80:0/2208242219 wait complete. 2019-11-28T11:53:59.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.473+0000 7f1e9b234700 1 -- 172.21.15.80:0/2208242219 >> 172.21.15.80:0/2208242219 conn(0x7f1e94061cf0 msgr2=0x7f1e94064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:59.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.476+0000 7f1e9b234700 1 Processor -- start 2019-11-28T11:53:59.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.476+0000 7f1e9b234700 1 -- start start 2019-11-28T11:53:59.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e9b234700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1e94160760 0x7f1e94160b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:59.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e9b234700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e94101e80 0x7f1e94139da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:59.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e9b234700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e941613a0 con 0x7f1e9413a2e0 2019-11-28T11:53:59.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e9b234700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e941624d0 con 0x7f1e94160760 2019-11-28T11:53:59.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e9b234700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e941627a0 con 0x7f1e94101e80 2019-11-28T11:53:59.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e997d1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1e94160760 0x7f1e94160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:59.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e98fd0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e94101e80 0x7f1e94139da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:59.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e997d1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1e94160760 0x7f1e94160b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:59468/0 (socket says 172.21.15.80:59468) 2019-11-28T11:53:59.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e98fd0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e94101e80 0x7f1e94139da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:46846/0 (socket says 172.21.15.80:46846) 2019-11-28T11:53:59.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e997d1700 1 -- 172.21.15.80:0/2051376598 learned_addr learned my addr 172.21.15.80:0/2051376598 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:59.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e98fd0700 1 -- 172.21.15.80:0/2051376598 >> v2:172.21.15.174:3300/0 conn(0x7f1e94160760 msgr2=0x7f1e94160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e98fd0700 1 --2- 172.21.15.80:0/2051376598 >> v2:172.21.15.174:3300/0 conn(0x7f1e94160760 0x7f1e94160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e98fd0700 1 -- 172.21.15.80:0/2051376598 >> v1:172.21.15.174:6789/0 conn(0x7f1e9413a2e0 legacy=0x7f1e94164570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e98fd0700 1 -- 172.21.15.80:0/2051376598 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e94162e30 con 0x7f1e94101e80 2019-11-28T11:53:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e98fd0700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e94101e80 0x7f1e94139da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1e84010330 tx=0x7f1e840101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e98fd0700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e94101e80 0x7f1e94139da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1e84010330 tx=0x7f1e840101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e98fd0700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e94101e80 0x7f1e94139da0 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7f1e84010330 tx=0x7f1e840101b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e98fd0700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e94101e80 0x7f1e94139da0 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7f1e84010330 tx=0x7f1e840101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e98fd0700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e94101e80 0x7f1e94139da0 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7f1e84010330 tx=0x7f1e840101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e91ffb700 1 -- 172.21.15.80:0/2051376598 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e84001230 con 0x7f1e94101e80 2019-11-28T11:53:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e98fd0700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e94101e80 0x7f1e94139da0 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7f1e84010330 tx=0x7f1e840101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.477+0000 7f1e91ffb700 1 -- 172.21.15.80:0/2051376598 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e84000960 con 0x7f1e94101e80 2019-11-28T11:53:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.478+0000 7f1e91ffb700 1 -- 172.21.15.80:0/2051376598 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e840045b0 con 0x7f1e94101e80 2019-11-28T11:53:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.478+0000 7f1e9b234700 1 -- 172.21.15.80:0/2051376598 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e941631b0 con 0x7f1e94101e80 2019-11-28T11:53:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.478+0000 7f1e9b234700 1 -- 172.21.15.80:0/2051376598 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e94162e30 con 0x7f1e94101e80 2019-11-28T11:53:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.478+0000 7f1e98fd0700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e94101e80 0x7f1e94139da0 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7f1e84010330 tx=0x7f1e840101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.478+0000 7f1e91ffb700 1 -- 172.21.15.80:0/2051376598 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1e84003fe0 con 0x7f1e94101e80 2019-11-28T11:53:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.478+0000 7f1e98fd0700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e94101e80 0x7f1e94139da0 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7f1e84010330 tx=0x7f1e840101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.478+0000 7f1e91ffb700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e78018730 0x7f1e7801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.478+0000 7f1e91ffb700 1 -- 172.21.15.80:0/2051376598 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1e840319e0 con 0x7f1e94101e80 2019-11-28T11:53:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.478+0000 7f1e997d1700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e78018730 0x7f1e7801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.479+0000 7f1e997d1700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e78018730 0x7f1e7801abc0 crc :-1 s=READY pgs=1015 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:59.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.485+0000 7f1e9b234700 1 -- 172.21.15.80:0/2051376598 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e941631b0 con 0x7f1e94101e80 2019-11-28T11:53:59.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.490+0000 7f1e98fd0700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e94101e80 0x7f1e94139da0 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7f1e84010330 tx=0x7f1e840101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.490+0000 7f1e91ffb700 1 -- 172.21.15.80:0/2051376598 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1e84000ce0 con 0x7f1e94101e80 2019-11-28T11:53:59.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.665+0000 7f1e9b234700 1 -- 172.21.15.80:0/2051376598 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e94162e30 con 0x7f1e94101e80 2019-11-28T11:53:59.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.667+0000 7f1e98fd0700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e94101e80 0x7f1e94139da0 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7f1e84010330 tx=0x7f1e840101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.667+0000 7f1e91ffb700 1 -- 172.21.15.80:0/2051376598 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f1e84000ef0 con 0x7f1e94101e80 2019-11-28T11:53:59.724 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:53:59.725 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":190,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:53:58.303811+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:53:55.640729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":31,"pool_name":"cephfs_data","create_time":"2019-11-28T11:53:56.329039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:53:59.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.670+0000 7f1e9b234700 1 -- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e78018730 msgr2=0x7f1e7801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.670+0000 7f1e9b234700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e78018730 0x7f1e7801abc0 crc :-1 s=READY pgs=1015 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.670+0000 7f1e9b234700 1 -- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e94101e80 msgr2=0x7f1e94139da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.670+0000 7f1e9b234700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e94101e80 0x7f1e94139da0 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7f1e84010330 tx=0x7f1e840101b0).stop 2019-11-28T11:53:59.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.671+0000 7f1e9b234700 1 -- 172.21.15.80:0/2051376598 shutdown_connections 2019-11-28T11:53:59.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.671+0000 7f1e9b234700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1e78018730 0x7f1e7801abc0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.671+0000 7f1e9b234700 1 --2- 172.21.15.80:0/2051376598 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1e94101e80 0x7f1e94139da0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.671+0000 7f1e9b234700 1 --2- 172.21.15.80:0/2051376598 >> v2:172.21.15.174:3300/0 conn(0x7f1e94160760 0x7f1e94160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.671+0000 7f1e9b234700 1 -- 172.21.15.80:0/2051376598 shutdown_connections 2019-11-28T11:53:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.671+0000 7f1e9b234700 1 -- 172.21.15.80:0/2051376598 wait complete. 2019-11-28T11:53:59.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.671+0000 7f1e9b234700 1 -- 172.21.15.80:0/2051376598 >> 172.21.15.80:0/2051376598 conn(0x7f1e94158c60 msgr2=0x7f1e94159050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:59.737 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:53:59.738 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:53:59.738 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:53:59.738 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:53:59.739 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:53:59.739 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:53:59.743 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:53:59.743 DEBUG:teuthology.parallel:result is None 2019-11-28T11:53:59.744 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:53:59.744 DEBUG:teuthology.parallel:result is None 2019-11-28T11:53:59.745 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:53:59.745 DEBUG:teuthology.parallel:result is None 2019-11-28T11:53:59.745 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:53:59.830 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:53:59.836 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:53:59.836 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:53:59.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.827+0000 7f5ff5f4e700 1 Processor -- start 2019-11-28T11:53:59.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.827+0000 7f5ff5f4e700 1 -- start start 2019-11-28T11:53:59.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.828+0000 7f5ff5f4e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5ff015ed10 0x7f5ff015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:59.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.828+0000 7f5ff5f4e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ff0073020 0x7f5ff0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:53:59.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.828+0000 7f5ff5f4e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff006db60 con 0x7f5ff00734b0 2019-11-28T11:53:59.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.828+0000 7f5ff5f4e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff006fe00 con 0x7f5ff015ed10 2019-11-28T11:53:59.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.828+0000 7f5ff5f4e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00700d0 con 0x7f5ff0073020 2019-11-28T11:53:59.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.828+0000 7f5ff4cec700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5ff00734b0 0x7f5ff00723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43934/0 (socket says 172.21.15.80:43934) 2019-11-28T11:53:59.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.828+0000 7f5ff4cec700 1 -- 172.21.15.80:0/3460255670 learned_addr learned my addr 172.21.15.80:0/3460255670 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:53:59.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.828+0000 7f5fe7fff700 1 --2- 172.21.15.80:0/3460255670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ff0073020 0x7f5ff0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:59.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.828+0000 7f5feffff700 1 --2- 172.21.15.80:0/3460255670 >> v2:172.21.15.174:3300/0 conn(0x7f5ff015ed10 0x7f5ff015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:59.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.828+0000 7f5fef7fe700 1 -- 172.21.15.80:0/3460255670 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349311313 0 0) 0x7f5fe80014d0 con 0x7f5ff00734b0 2019-11-28T11:53:59.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.828+0000 7f5fef7fe700 1 -- 172.21.15.80:0/3460255670 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fdc002e80 con 0x7f5ff00734b0 2019-11-28T11:53:59.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5feffff700 1 -- 172.21.15.80:0/3460255670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ff0073020 msgr2=0x7f5ff0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:53:59.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5feffff700 1 --2- 172.21.15.80:0/3460255670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ff0073020 0x7f5ff0071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:59.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5feffff700 1 -- 172.21.15.80:0/3460255670 >> v1:172.21.15.80:6789/0 conn(0x7f5ff00734b0 legacy=0x7f5ff00723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5fef7fe700 1 -- 172.21.15.80:0/3460255670 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2664120694 0 0) 0x7f5fe80014b0 con 0x7f5ff00734b0 2019-11-28T11:53:59.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5feffff700 1 -- 172.21.15.80:0/3460255670 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff0070760 con 0x7f5ff015ed10 2019-11-28T11:53:59.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5fe7fff700 1 --2- 172.21.15.80:0/3460255670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ff0073020 0x7f5ff0071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:53:59.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5feffff700 1 --2- 172.21.15.80:0/3460255670 >> v2:172.21.15.174:3300/0 conn(0x7f5ff015ed10 0x7f5ff015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5fe000af50 tx=0x7f5fe000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5feffff700 1 --2- 172.21.15.80:0/3460255670 >> v2:172.21.15.174:3300/0 conn(0x7f5ff015ed10 0x7f5ff015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5fe000af50 tx=0x7f5fe000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5feffff700 1 --2- 172.21.15.80:0/3460255670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ff015ed10 0x7f5ff015f100 secure :-1 s=READY pgs=1500 cs=0 l=1 rx=0x7f5fe000af50 tx=0x7f5fe000b760).ready entity=mon.1 client_cookie=29633ed3bfd71163 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5feffff700 1 --2- 172.21.15.80:0/3460255670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ff015ed10 0x7f5ff015f100 secure :-1 s=THROTTLE_DONE pgs=1500 cs=0 l=1 rx=0x7f5fe000af50 tx=0x7f5fe000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5fef7fe700 1 -- 172.21.15.80:0/3460255670 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe0007210 con 0x7f5ff015ed10 2019-11-28T11:53:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5feffff700 1 --2- 172.21.15.80:0/3460255670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ff015ed10 0x7f5ff015f100 secure :-1 s=THROTTLE_DONE pgs=1500 cs=0 l=1 rx=0x7f5fe000af50 tx=0x7f5fe000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5feffff700 1 --2- 172.21.15.80:0/3460255670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ff015ed10 0x7f5ff015f100 secure :-1 s=THROTTLE_DONE pgs=1500 cs=0 l=1 rx=0x7f5fe000af50 tx=0x7f5fe000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5fef7fe700 1 -- 172.21.15.80:0/3460255670 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe00099b0 con 0x7f5ff015ed10 2019-11-28T11:53:59.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5fef7fe700 1 -- 172.21.15.80:0/3460255670 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe000a080 con 0x7f5ff015ed10 2019-11-28T11:53:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5ff5f4e700 1 -- 172.21.15.80:0/3460255670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ff015ed10 msgr2=0x7f5ff015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.829+0000 7f5ff5f4e700 1 --2- 172.21.15.80:0/3460255670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ff015ed10 0x7f5ff015f100 secure :-1 s=READY pgs=1500 cs=0 l=1 rx=0x7f5fe000af50 tx=0x7f5fe000b760).stop 2019-11-28T11:53:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.830+0000 7f5ff5f4e700 1 -- 172.21.15.80:0/3460255670 shutdown_connections 2019-11-28T11:53:59.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.830+0000 7f5ff5f4e700 1 --2- 172.21.15.80:0/3460255670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ff0073020 0x7f5ff0071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:53:59.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.830+0000 7f5ff5f4e700 1 --2- 172.21.15.80:0/3460255670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ff015ed10 0x7f5ff015f100 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.830+0000 7f5ff5f4e700 1 -- 172.21.15.80:0/3460255670 shutdown_connections 2019-11-28T11:53:59.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.830+0000 7f5ff5f4e700 1 -- 172.21.15.80:0/3460255670 wait complete. 2019-11-28T11:53:59.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.830+0000 7f5ff5f4e700 1 -- 172.21.15.80:0/3460255670 >> 172.21.15.80:0/3460255670 conn(0x7f5ff0061d40 msgr2=0x7f5ff00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:53:59.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.832+0000 7f5ff5f4e700 1 Processor -- start 2019-11-28T11:53:59.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.832+0000 7f5ff5f4e700 1 -- start start 2019-11-28T11:53:59.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.833+0000 7f5ff5f4e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ff0152750 0x7f5ff0135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:59.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.833+0000 7f5ff5f4e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5ff0130dc0 0x7f5ff0131250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:59.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.833+0000 7f5ff5f4e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5ff0131790 0x7f5ff0134610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.833+0000 7f5ff5f4e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff0131c10 con 0x7f5ff0130dc0 2019-11-28T11:53:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.833+0000 7f5ff5f4e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff010a460 con 0x7f5ff0131790 2019-11-28T11:53:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.833+0000 7f5ff5f4e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff0132570 con 0x7f5ff0152750 2019-11-28T11:53:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.833+0000 7f5fe7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5ff0130dc0 0x7f5ff0131250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.833+0000 7f5fe7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5ff0130dc0 0x7f5ff0131250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44622/0 (socket says 172.21.15.80:44622) 2019-11-28T11:53:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.833+0000 7f5fe7fff700 1 -- 172.21.15.80:0/4024188158 learned_addr learned my addr 172.21.15.80:0/4024188158 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:53:59.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.833+0000 7f5feffff700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ff0152750 0x7f5ff0135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.833+0000 7f5ff4cec700 1 --2- 172.21.15.80:0/4024188158 >> v2:172.21.15.174:3300/0 conn(0x7f5ff0131790 0x7f5ff0134610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.833+0000 7f5fe7fff700 1 -- 172.21.15.80:0/4024188158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ff0152750 msgr2=0x7f5ff0135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.833+0000 7f5fe7fff700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ff0152750 0x7f5ff0135790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.833+0000 7f5fe7fff700 1 -- 172.21.15.80:0/4024188158 >> v2:172.21.15.174:3300/0 conn(0x7f5ff0131790 msgr2=0x7f5ff0134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:53:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.833+0000 7f5fe7fff700 1 --2- 172.21.15.80:0/4024188158 >> v2:172.21.15.174:3300/0 conn(0x7f5ff0131790 0x7f5ff0134610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:53:59.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.833+0000 7f5fe7fff700 1 -- 172.21.15.80:0/4024188158 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff0132ed0 con 0x7f5ff0130dc0 2019-11-28T11:53:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.834+0000 7f5fe7fff700 1 --2- 172.21.15.80:0/4024188158 >> v2:172.21.15.80:3300/0 conn(0x7f5ff0130dc0 0x7f5ff0131250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5fd8010410 tx=0x7f5fd8010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.834+0000 7f5fe7fff700 1 --2- 172.21.15.80:0/4024188158 >> v2:172.21.15.80:3300/0 conn(0x7f5ff0130dc0 0x7f5ff0131250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5fd8010410 tx=0x7f5fd8010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.834+0000 7f5fe7fff700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff0130dc0 0x7f5ff0131250 secure :-1 s=READY pgs=2480 cs=0 l=1 rx=0x7f5fd8010410 tx=0x7f5fd8010310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.834+0000 7f5fe7fff700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff0130dc0 0x7f5ff0131250 secure :-1 s=THROTTLE_DONE pgs=2480 cs=0 l=1 rx=0x7f5fd8010410 tx=0x7f5fd8010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.834+0000 7f5fe7fff700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff0130dc0 0x7f5ff0131250 secure :-1 s=THROTTLE_DONE pgs=2480 cs=0 l=1 rx=0x7f5fd8010410 tx=0x7f5fd8010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.834+0000 7f5fed7fa700 1 -- 172.21.15.80:0/4024188158 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fd800a8c0 con 0x7f5ff0130dc0 2019-11-28T11:53:59.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.834+0000 7f5fe7fff700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff0130dc0 0x7f5ff0131250 secure :-1 s=THROTTLE_DONE pgs=2480 cs=0 l=1 rx=0x7f5fd8010410 tx=0x7f5fd8010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.834+0000 7f5fed7fa700 1 -- 172.21.15.80:0/4024188158 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd800db40 con 0x7f5ff0130dc0 2019-11-28T11:53:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.834+0000 7f5ff5f4e700 1 -- 172.21.15.80:0/4024188158 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff0133250 con 0x7f5ff0130dc0 2019-11-28T11:53:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.834+0000 7f5fed7fa700 1 -- 172.21.15.80:0/4024188158 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fd800e190 con 0x7f5ff0130dc0 2019-11-28T11:53:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.834+0000 7f5ff5f4e700 1 -- 172.21.15.80:0/4024188158 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff0132ed0 con 0x7f5ff0130dc0 2019-11-28T11:53:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.834+0000 7f5fe7fff700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff0130dc0 0x7f5ff0131250 secure :-1 s=THROTTLE_DONE pgs=2480 cs=0 l=1 rx=0x7f5fd8010410 tx=0x7f5fd8010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.834+0000 7f5fed7fa700 1 -- 172.21.15.80:0/4024188158 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5fd8009580 con 0x7f5ff0130dc0 2019-11-28T11:53:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.834+0000 7f5fe7fff700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff0130dc0 0x7f5ff0131250 secure :-1 s=THROTTLE_DONE pgs=2480 cs=0 l=1 rx=0x7f5fd8010410 tx=0x7f5fd8010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.834+0000 7f5fed7fa700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5fd401a940 0x7f5fd401cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:53:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.835+0000 7f5fed7fa700 1 -- 172.21.15.80:0/4024188158 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5fd80319d0 con 0x7f5ff0130dc0 2019-11-28T11:53:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.835+0000 7f5feffff700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5fd401a940 0x7f5fd401cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:53:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.835+0000 7f5feffff700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5fd401a940 0x7f5fd401cdd0 crc :-1 s=READY pgs=1016 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:53:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.842+0000 7f5ff5f4e700 1 -- 172.21.15.80:0/4024188158 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff0133250 con 0x7f5ff0130dc0 2019-11-28T11:53:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.845+0000 7f5fe7fff700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff0130dc0 0x7f5ff0131250 secure :-1 s=THROTTLE_DONE pgs=2480 cs=0 l=1 rx=0x7f5fd8010410 tx=0x7f5fd8010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:53:59.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:53:59.845+0000 7f5fed7fa700 1 -- 172.21.15.80:0/4024188158 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5fd8024f40 con 0x7f5ff0130dc0 2019-11-28T11:54:00.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.016+0000 7f5ff5f4e700 1 -- 172.21.15.80:0/4024188158 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5ff0132ed0 con 0x7f5ff0130dc0 2019-11-28T11:54:00.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.018+0000 7f5fe7fff700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff0130dc0 0x7f5ff0131250 secure :-1 s=THROTTLE_DONE pgs=2480 cs=0 l=1 rx=0x7f5fd8010410 tx=0x7f5fd8010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.018+0000 7f5fed7fa700 1 -- 172.21.15.80:0/4024188158 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v64) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5fd8009580 con 0x7f5ff0130dc0 2019-11-28T11:54:00.075 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:54:00.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.021+0000 7f5ff5f4e700 1 -- 172.21.15.80:0/4024188158 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5fd401a940 msgr2=0x7f5fd401cdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:00.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.021+0000 7f5ff5f4e700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5fd401a940 0x7f5fd401cdd0 crc :-1 s=READY pgs=1016 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:00.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.021+0000 7f5ff5f4e700 1 -- 172.21.15.80:0/4024188158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff0130dc0 msgr2=0x7f5ff0131250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:00.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.021+0000 7f5ff5f4e700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff0130dc0 0x7f5ff0131250 secure :-1 s=READY pgs=2480 cs=0 l=1 rx=0x7f5fd8010410 tx=0x7f5fd8010310).stop 2019-11-28T11:54:00.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.021+0000 7f5ff5f4e700 1 -- 172.21.15.80:0/4024188158 shutdown_connections 2019-11-28T11:54:00.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.021+0000 7f5ff5f4e700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5fd401a940 0x7f5fd401cdd0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:00.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.021+0000 7f5ff5f4e700 1 --2- 172.21.15.80:0/4024188158 >> v2:172.21.15.174:3300/0 conn(0x7f5ff0131790 0x7f5ff0134610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:00.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.021+0000 7f5ff5f4e700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ff0130dc0 0x7f5ff0131250 unknown :-1 s=CLOSED pgs=2480 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:00.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.021+0000 7f5ff5f4e700 1 --2- 172.21.15.80:0/4024188158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ff0152750 0x7f5ff0135790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:00.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.021+0000 7f5ff5f4e700 1 -- 172.21.15.80:0/4024188158 shutdown_connections 2019-11-28T11:54:00.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.021+0000 7f5ff5f4e700 1 -- 172.21.15.80:0/4024188158 wait complete. 2019-11-28T11:54:00.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.021+0000 7f5ff5f4e700 1 -- 172.21.15.80:0/4024188158 >> 172.21.15.80:0/4024188158 conn(0x7f5ff01476e0 msgr2=0x7f5ff012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:00.087 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:54:00.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.162+0000 7f86e57ac700 1 Processor -- start 2019-11-28T11:54:00.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.162+0000 7f86e57ac700 1 -- start start 2019-11-28T11:54:00.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86e57ac700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f86e015ed10 0x7f86e015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:00.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86e57ac700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86e0073020 0x7f86e0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:00.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86e57ac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f86e00734b0 0x7f86e00723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:00.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86e57ac700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e006fe00 con 0x7f86e00734b0 2019-11-28T11:54:00.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86e57ac700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e00700d0 con 0x7f86e015ed10 2019-11-28T11:54:00.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86e57ac700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e006f3d0 con 0x7f86e0073020 2019-11-28T11:54:00.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86dffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f86e00734b0 0x7f86e00723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:00.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86dffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f86e00734b0 0x7f86e00723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44628/0 (socket says 172.21.15.80:44628) 2019-11-28T11:54:00.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86dffff700 1 -- 172.21.15.80:0/2035570479 learned_addr learned my addr 172.21.15.80:0/2035570479 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:00.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86df7fe700 1 --2- 172.21.15.80:0/2035570479 >> v2:172.21.15.174:3300/0 conn(0x7f86e015ed10 0x7f86e015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:00.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86deffd700 1 --2- 172.21.15.80:0/2035570479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86e0073020 0x7f86e0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:00.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86dffff700 1 -- 172.21.15.80:0/2035570479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86e0073020 msgr2=0x7f86e0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:00.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86dffff700 1 --2- 172.21.15.80:0/2035570479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86e0073020 0x7f86e0071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:00.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86dffff700 1 -- 172.21.15.80:0/2035570479 >> v2:172.21.15.174:3300/0 conn(0x7f86e015ed10 msgr2=0x7f86e015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:00.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86dffff700 1 --2- 172.21.15.80:0/2035570479 >> v2:172.21.15.174:3300/0 conn(0x7f86e015ed10 0x7f86e015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:00.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86dffff700 1 -- 172.21.15.80:0/2035570479 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e0070760 con 0x7f86e00734b0 2019-11-28T11:54:00.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86dffff700 1 --2- 172.21.15.80:0/2035570479 >> v2:172.21.15.80:3300/0 conn(0x7f86e00734b0 0x7f86e00723e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f86d800f6b0 tx=0x7f86d8007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86dffff700 1 --2- 172.21.15.80:0/2035570479 >> v2:172.21.15.80:3300/0 conn(0x7f86e00734b0 0x7f86e00723e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f86d800f6b0 tx=0x7f86d8007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86dffff700 1 --2- 172.21.15.80:0/2035570479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e00734b0 0x7f86e00723e0 secure :-1 s=READY pgs=2481 cs=0 l=1 rx=0x7f86d800f6b0 tx=0x7f86d8007d50).ready entity=mon.0 client_cookie=607118d7c0691ff6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:00.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86dffff700 1 --2- 172.21.15.80:0/2035570479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e00734b0 0x7f86e00723e0 secure :-1 s=THROTTLE_DONE pgs=2481 cs=0 l=1 rx=0x7f86d800f6b0 tx=0x7f86d8007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.164+0000 7f86dffff700 1 --2- 172.21.15.80:0/2035570479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e00734b0 0x7f86e00723e0 secure :-1 s=THROTTLE_DONE pgs=2481 cs=0 l=1 rx=0x7f86d800f6b0 tx=0x7f86d8007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.163+0000 7f86de7fc700 1 -- 172.21.15.80:0/2035570479 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86d8000a70 con 0x7f86e00734b0 2019-11-28T11:54:00.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.164+0000 7f86dffff700 1 --2- 172.21.15.80:0/2035570479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e00734b0 0x7f86e00723e0 secure :-1 s=THROTTLE_DONE pgs=2481 cs=0 l=1 rx=0x7f86d800f6b0 tx=0x7f86d8007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.164+0000 7f86de7fc700 1 -- 172.21.15.80:0/2035570479 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d80010e0 con 0x7f86e00734b0 2019-11-28T11:54:00.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.164+0000 7f86de7fc700 1 -- 172.21.15.80:0/2035570479 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86d8001830 con 0x7f86e00734b0 2019-11-28T11:54:00.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.164+0000 7f86e57ac700 1 -- 172.21.15.80:0/2035570479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e00734b0 msgr2=0x7f86e00723e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:00.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.164+0000 7f86e57ac700 1 --2- 172.21.15.80:0/2035570479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e00734b0 0x7f86e00723e0 secure :-1 s=READY pgs=2481 cs=0 l=1 rx=0x7f86d800f6b0 tx=0x7f86d8007d50).stop 2019-11-28T11:54:00.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.164+0000 7f86e57ac700 1 -- 172.21.15.80:0/2035570479 shutdown_connections 2019-11-28T11:54:00.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.164+0000 7f86e57ac700 1 --2- 172.21.15.80:0/2035570479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e00734b0 0x7f86e00723e0 unknown :-1 s=CLOSED pgs=2481 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:00.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.164+0000 7f86e57ac700 1 --2- 172.21.15.80:0/2035570479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86e0073020 0x7f86e0071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:00.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.164+0000 7f86e57ac700 1 --2- 172.21.15.80:0/2035570479 >> v2:172.21.15.174:3300/0 conn(0x7f86e015ed10 0x7f86e015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:00.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.164+0000 7f86e57ac700 1 -- 172.21.15.80:0/2035570479 shutdown_connections 2019-11-28T11:54:00.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.164+0000 7f86e57ac700 1 -- 172.21.15.80:0/2035570479 wait complete. 2019-11-28T11:54:00.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.164+0000 7f86e57ac700 1 -- 172.21.15.80:0/2035570479 >> 172.21.15.80:0/2035570479 conn(0x7f86e0061d40 msgr2=0x7f86e00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:00.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.167+0000 7f86e57ac700 1 Processor -- start 2019-11-28T11:54:00.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.167+0000 7f86e57ac700 1 -- start start 2019-11-28T11:54:00.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86e57ac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f86e0152750 0x7f86e0135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:00.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86e57ac700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f86e0130dc0 0x7f86e0131250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:00.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86e57ac700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e0109d70 con 0x7f86e0131790 2019-11-28T11:54:00.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86e57ac700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e0131c10 con 0x7f86e0152750 2019-11-28T11:54:00.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86e57ac700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e0132570 con 0x7f86e0130dc0 2019-11-28T11:54:00.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86df7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f86e0152750 0x7f86e0135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:00.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86df7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f86e0152750 0x7f86e0135790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44634/0 (socket says 172.21.15.80:44634) 2019-11-28T11:54:00.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86df7fe700 1 -- 172.21.15.80:0/2366228886 learned_addr learned my addr 172.21.15.80:0/2366228886 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:00.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86dffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f86e0131790 0x7f86e0134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43954/0 (socket says 172.21.15.80:43954) 2019-11-28T11:54:00.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86deffd700 1 --2- 172.21.15.80:0/2366228886 >> v2:172.21.15.174:3300/0 conn(0x7f86e0130dc0 0x7f86e0131250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:00.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86df7fe700 1 -- 172.21.15.80:0/2366228886 >> v2:172.21.15.174:3300/0 conn(0x7f86e0130dc0 msgr2=0x7f86e0131250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:00.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86df7fe700 1 --2- 172.21.15.80:0/2366228886 >> v2:172.21.15.174:3300/0 conn(0x7f86e0130dc0 0x7f86e0131250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:00.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86df7fe700 1 -- 172.21.15.80:0/2366228886 >> v1:172.21.15.80:6789/0 conn(0x7f86e0131790 legacy=0x7f86e0134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:00.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86df7fe700 1 -- 172.21.15.80:0/2366228886 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e0132ed0 con 0x7f86e0152750 2019-11-28T11:54:00.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86d7fff700 1 -- 172.21.15.80:0/2366228886 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669620699 0 0) 0x7f86d8000be0 con 0x7f86e0131790 2019-11-28T11:54:00.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86df7fe700 1 --2- 172.21.15.80:0/2366228886 >> v2:172.21.15.80:3300/0 conn(0x7f86e0152750 0x7f86e0135790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f86d00107d0 tx=0x7f86d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86df7fe700 1 --2- 172.21.15.80:0/2366228886 >> v2:172.21.15.80:3300/0 conn(0x7f86e0152750 0x7f86e0135790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f86d00107d0 tx=0x7f86d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86df7fe700 1 --2- 172.21.15.80:0/2366228886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e0152750 0x7f86e0135790 secure :-1 s=READY pgs=2483 cs=0 l=1 rx=0x7f86d00107d0 tx=0x7f86d0010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:00.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86df7fe700 1 --2- 172.21.15.80:0/2366228886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e0152750 0x7f86e0135790 secure :-1 s=THROTTLE_DONE pgs=2483 cs=0 l=1 rx=0x7f86d00107d0 tx=0x7f86d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86d7fff700 1 -- 172.21.15.80:0/2366228886 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86d0000cc0 con 0x7f86e0152750 2019-11-28T11:54:00.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86df7fe700 1 --2- 172.21.15.80:0/2366228886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e0152750 0x7f86e0135790 secure :-1 s=THROTTLE_DONE pgs=2483 cs=0 l=1 rx=0x7f86d00107d0 tx=0x7f86d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86df7fe700 1 --2- 172.21.15.80:0/2366228886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e0152750 0x7f86e0135790 secure :-1 s=THROTTLE_DONE pgs=2483 cs=0 l=1 rx=0x7f86d00107d0 tx=0x7f86d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86d7fff700 1 -- 172.21.15.80:0/2366228886 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d0001200 con 0x7f86e0152750 2019-11-28T11:54:00.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86e57ac700 1 -- 172.21.15.80:0/2366228886 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e0133250 con 0x7f86e0152750 2019-11-28T11:54:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86d7fff700 1 -- 172.21.15.80:0/2366228886 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86d0001850 con 0x7f86e0152750 2019-11-28T11:54:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.168+0000 7f86e57ac700 1 -- 172.21.15.80:0/2366228886 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e0132ed0 con 0x7f86e0152750 2019-11-28T11:54:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.169+0000 7f86df7fe700 1 --2- 172.21.15.80:0/2366228886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e0152750 0x7f86e0135790 secure :-1 s=THROTTLE_DONE pgs=2483 cs=0 l=1 rx=0x7f86d00107d0 tx=0x7f86d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.169+0000 7f86d7fff700 1 -- 172.21.15.80:0/2366228886 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f86d0001010 con 0x7f86e0152750 2019-11-28T11:54:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.169+0000 7f86df7fe700 1 --2- 172.21.15.80:0/2366228886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e0152750 0x7f86e0135790 secure :-1 s=THROTTLE_DONE pgs=2483 cs=0 l=1 rx=0x7f86d00107d0 tx=0x7f86d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.170+0000 7f86d7fff700 1 --2- 172.21.15.80:0/2366228886 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f86c4018730 0x7f86c401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:00.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.170+0000 7f86d7fff700 1 -- 172.21.15.80:0/2366228886 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f86d0031e20 con 0x7f86e0152750 2019-11-28T11:54:00.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.170+0000 7f86deffd700 1 --2- 172.21.15.80:0/2366228886 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f86c4018730 0x7f86c401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:00.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.170+0000 7f86deffd700 1 --2- 172.21.15.80:0/2366228886 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f86c4018730 0x7f86c401abc0 crc :-1 s=READY pgs=1017 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:00.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.177+0000 7f86e57ac700 1 -- 172.21.15.80:0/2366228886 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e0133250 con 0x7f86e0152750 2019-11-28T11:54:00.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.180+0000 7f86df7fe700 1 --2- 172.21.15.80:0/2366228886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e0152750 0x7f86e0135790 secure :-1 s=THROTTLE_DONE pgs=2483 cs=0 l=1 rx=0x7f86d00107d0 tx=0x7f86d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.180+0000 7f86d7fff700 1 -- 172.21.15.80:0/2366228886 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f86d00095d0 con 0x7f86e0152750 2019-11-28T11:54:00.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.350+0000 7f86e57ac700 1 -- 172.21.15.80:0/2366228886 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f86e0132ed0 con 0x7f86e0152750 2019-11-28T11:54:00.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.353+0000 7f86df7fe700 1 --2- 172.21.15.80:0/2366228886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e0152750 0x7f86e0135790 secure :-1 s=THROTTLE_DONE pgs=2483 cs=0 l=1 rx=0x7f86d00107d0 tx=0x7f86d0010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.353+0000 7f86d7fff700 1 -- 172.21.15.80:0/2366228886 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v65) v1 ==== 184+0+0 (secure 0 0 0) 0x7f86d0001140 con 0x7f86e0152750 2019-11-28T11:54:00.409 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:54:00.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.355+0000 7f86e57ac700 1 -- 172.21.15.80:0/2366228886 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f86c4018730 msgr2=0x7f86c401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:00.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.355+0000 7f86e57ac700 1 --2- 172.21.15.80:0/2366228886 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f86c4018730 0x7f86c401abc0 crc :-1 s=READY pgs=1017 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:00.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.355+0000 7f86e57ac700 1 -- 172.21.15.80:0/2366228886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e0152750 msgr2=0x7f86e0135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:00.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.355+0000 7f86e57ac700 1 --2- 172.21.15.80:0/2366228886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e0152750 0x7f86e0135790 secure :-1 s=READY pgs=2483 cs=0 l=1 rx=0x7f86d00107d0 tx=0x7f86d0010600).stop 2019-11-28T11:54:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.355+0000 7f86e57ac700 1 -- 172.21.15.80:0/2366228886 shutdown_connections 2019-11-28T11:54:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.355+0000 7f86e57ac700 1 --2- 172.21.15.80:0/2366228886 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f86c4018730 0x7f86c401abc0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.355+0000 7f86e57ac700 1 --2- 172.21.15.80:0/2366228886 >> v2:172.21.15.174:3300/0 conn(0x7f86e0130dc0 0x7f86e0131250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.355+0000 7f86e57ac700 1 --2- 172.21.15.80:0/2366228886 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f86e0152750 0x7f86e0135790 unknown :-1 s=CLOSED pgs=2483 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.355+0000 7f86e57ac700 1 -- 172.21.15.80:0/2366228886 shutdown_connections 2019-11-28T11:54:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.355+0000 7f86e57ac700 1 -- 172.21.15.80:0/2366228886 wait complete. 2019-11-28T11:54:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.355+0000 7f86e57ac700 1 -- 172.21.15.80:0/2366228886 >> 172.21.15.80:0/2366228886 conn(0x7f86e01476e0 msgr2=0x7f86e012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:00.427 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:54:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.500+0000 7f62965f1700 1 Processor -- start 2019-11-28T11:54:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.501+0000 7f62965f1700 1 -- start start 2019-11-28T11:54:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.501+0000 7f62965f1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f629015ed10 0x7f629015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.501+0000 7f62965f1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6290073020 0x7f6290071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.501+0000 7f62965f1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62900734b0 0x7f62900723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:00.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.501+0000 7f62965f1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629006fe00 con 0x7f629015ed10 2019-11-28T11:54:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.501+0000 7f62965f1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62900700d0 con 0x7f6290073020 2019-11-28T11:54:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.501+0000 7f62965f1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629006f3d0 con 0x7f62900734b0 2019-11-28T11:54:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f6294b8e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f629015ed10 0x7f629015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f6294b8e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f629015ed10 0x7f629015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44642/0 (socket says 172.21.15.80:44642) 2019-11-28T11:54:00.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f6294b8e700 1 -- 172.21.15.80:0/263354907 learned_addr learned my addr 172.21.15.80:0/263354907 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f628ffff700 1 --2- 172.21.15.80:0/263354907 >> v2:172.21.15.174:3300/0 conn(0x7f6290073020 0x7f6290071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f629538f700 1 --2- 172.21.15.80:0/263354907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62900734b0 0x7f62900723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f6294b8e700 1 -- 172.21.15.80:0/263354907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62900734b0 msgr2=0x7f62900723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f6294b8e700 1 --2- 172.21.15.80:0/263354907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62900734b0 0x7f62900723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f6294b8e700 1 -- 172.21.15.80:0/263354907 >> v2:172.21.15.174:3300/0 conn(0x7f6290073020 msgr2=0x7f6290071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f6294b8e700 1 --2- 172.21.15.80:0/263354907 >> v2:172.21.15.174:3300/0 conn(0x7f6290073020 0x7f6290071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f6294b8e700 1 -- 172.21.15.80:0/263354907 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290070760 con 0x7f629015ed10 2019-11-28T11:54:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f6294b8e700 1 --2- 172.21.15.80:0/263354907 >> v2:172.21.15.80:3300/0 conn(0x7f629015ed10 0x7f629015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f627800f6c0 tx=0x7f627800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f6294b8e700 1 --2- 172.21.15.80:0/263354907 >> v2:172.21.15.80:3300/0 conn(0x7f629015ed10 0x7f629015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f627800f6c0 tx=0x7f627800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f6294b8e700 1 --2- 172.21.15.80:0/263354907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f629015ed10 0x7f629015f100 secure :-1 s=READY pgs=2484 cs=0 l=1 rx=0x7f627800f6c0 tx=0x7f627800f570).ready entity=mon.0 client_cookie=3570b2319dc390ec server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f6294b8e700 1 --2- 172.21.15.80:0/263354907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f629015ed10 0x7f629015f100 secure :-1 s=THROTTLE_DONE pgs=2484 cs=0 l=1 rx=0x7f627800f6c0 tx=0x7f627800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f6294b8e700 1 --2- 172.21.15.80:0/263354907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f629015ed10 0x7f629015f100 secure :-1 s=THROTTLE_DONE pgs=2484 cs=0 l=1 rx=0x7f627800f6c0 tx=0x7f627800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f628f7fe700 1 -- 172.21.15.80:0/263354907 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6278000960 con 0x7f629015ed10 2019-11-28T11:54:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f6294b8e700 1 --2- 172.21.15.80:0/263354907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f629015ed10 0x7f629015f100 secure :-1 s=THROTTLE_DONE pgs=2484 cs=0 l=1 rx=0x7f627800f6c0 tx=0x7f627800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f628f7fe700 1 -- 172.21.15.80:0/263354907 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6278000c90 con 0x7f629015ed10 2019-11-28T11:54:00.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f628f7fe700 1 -- 172.21.15.80:0/263354907 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62780013a0 con 0x7f629015ed10 2019-11-28T11:54:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f62965f1700 1 -- 172.21.15.80:0/263354907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f629015ed10 msgr2=0x7f629015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.502+0000 7f62965f1700 1 --2- 172.21.15.80:0/263354907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f629015ed10 0x7f629015f100 secure :-1 s=READY pgs=2484 cs=0 l=1 rx=0x7f627800f6c0 tx=0x7f627800f570).stop 2019-11-28T11:54:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.503+0000 7f62965f1700 1 -- 172.21.15.80:0/263354907 shutdown_connections 2019-11-28T11:54:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.503+0000 7f62965f1700 1 --2- 172.21.15.80:0/263354907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62900734b0 0x7f62900723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.503+0000 7f62965f1700 1 --2- 172.21.15.80:0/263354907 >> v2:172.21.15.174:3300/0 conn(0x7f6290073020 0x7f6290071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.503+0000 7f62965f1700 1 --2- 172.21.15.80:0/263354907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f629015ed10 0x7f629015f100 unknown :-1 s=CLOSED pgs=2484 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:00.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.503+0000 7f62965f1700 1 -- 172.21.15.80:0/263354907 shutdown_connections 2019-11-28T11:54:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.503+0000 7f62965f1700 1 -- 172.21.15.80:0/263354907 wait complete. 2019-11-28T11:54:00.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.503+0000 7f62965f1700 1 -- 172.21.15.80:0/263354907 >> 172.21.15.80:0/263354907 conn(0x7f6290061d40 msgr2=0x7f62900641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:00.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.505+0000 7f62965f1700 1 Processor -- start 2019-11-28T11:54:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.506+0000 7f62965f1700 1 -- start start 2019-11-28T11:54:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f62965f1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6290167d80 0x7f629016a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f62965f1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6290130b20 con 0x7f6290114f60 2019-11-28T11:54:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f62965f1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6290130620 con 0x7f629012e1a0 2019-11-28T11:54:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f62965f1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6290148b60 con 0x7f6290167d80 2019-11-28T11:54:00.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f6294b8e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6290114f60 0x7f6290106b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43964/0 (socket says 172.21.15.80:43964) 2019-11-28T11:54:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f6294b8e700 1 -- 172.21.15.80:0/2567948654 learned_addr learned my addr 172.21.15.80:0/2567948654 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f629538f700 1 --2- 172.21.15.80:0/2567948654 >> v2:172.21.15.174:3300/0 conn(0x7f6290167d80 0x7f629016a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f628d7fa700 1 -- 172.21.15.80:0/2567948654 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900162677 0 0) 0x7f6278007da0 con 0x7f6290114f60 2019-11-28T11:54:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f628d7fa700 1 -- 172.21.15.80:0/2567948654 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6274002e80 con 0x7f6290114f60 2019-11-28T11:54:00.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f629538f700 1 -- 172.21.15.80:0/2567948654 >> v1:172.21.15.174:6789/0 conn(0x7f629012e1a0 legacy=0x7f629012e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f628d7fa700 1 -- 172.21.15.80:0/2567948654 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727359510 0 0) 0x7f62800012b0 con 0x7f629012e1a0 2019-11-28T11:54:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f629538f700 1 -- 172.21.15.80:0/2567948654 >> v1:172.21.15.80:6789/0 conn(0x7f6290114f60 legacy=0x7f6290106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f629538f700 1 -- 172.21.15.80:0/2567948654 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290104390 con 0x7f6290167d80 2019-11-28T11:54:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f629538f700 1 --2- 172.21.15.80:0/2567948654 >> v2:172.21.15.174:3300/0 conn(0x7f6290167d80 0x7f629016a180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6288010390 tx=0x7f6288010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f629538f700 1 --2- 172.21.15.80:0/2567948654 >> v2:172.21.15.174:3300/0 conn(0x7f6290167d80 0x7f629016a180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6288010390 tx=0x7f6288010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f629538f700 1 --2- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6290167d80 0x7f629016a180 secure :-1 s=READY pgs=1502 cs=0 l=1 rx=0x7f6288010390 tx=0x7f6288010730).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:00.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f629538f700 1 --2- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6290167d80 0x7f629016a180 secure :-1 s=THROTTLE_DONE pgs=1502 cs=0 l=1 rx=0x7f6288010390 tx=0x7f6288010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f628d7fa700 1 -- 172.21.15.80:0/2567948654 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6288000b10 con 0x7f6290167d80 2019-11-28T11:54:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f629538f700 1 --2- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6290167d80 0x7f629016a180 secure :-1 s=THROTTLE_DONE pgs=1502 cs=0 l=1 rx=0x7f6288010390 tx=0x7f6288010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f629538f700 1 --2- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6290167d80 0x7f629016a180 secure :-1 s=THROTTLE_DONE pgs=1502 cs=0 l=1 rx=0x7f6288010390 tx=0x7f6288010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f628d7fa700 1 -- 172.21.15.80:0/2567948654 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628800ef80 con 0x7f6290167d80 2019-11-28T11:54:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f628d7fa700 1 -- 172.21.15.80:0/2567948654 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6288000af0 con 0x7f6290167d80 2019-11-28T11:54:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f62965f1700 1 -- 172.21.15.80:0/2567948654 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6290104710 con 0x7f6290167d80 2019-11-28T11:54:00.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.507+0000 7f62965f1700 1 -- 172.21.15.80:0/2567948654 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6290104390 con 0x7f6290167d80 2019-11-28T11:54:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.508+0000 7f629538f700 1 --2- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6290167d80 0x7f629016a180 secure :-1 s=THROTTLE_DONE pgs=1502 cs=0 l=1 rx=0x7f6288010390 tx=0x7f6288010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.508+0000 7f628d7fa700 1 -- 172.21.15.80:0/2567948654 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f628800ec20 con 0x7f6290167d80 2019-11-28T11:54:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.508+0000 7f629538f700 1 --2- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6290167d80 0x7f629016a180 secure :-1 s=THROTTLE_DONE pgs=1502 cs=0 l=1 rx=0x7f6288010390 tx=0x7f6288010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.508+0000 7f628d7fa700 1 --2- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6274018780 0x7f627401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.508+0000 7f628d7fa700 1 -- 172.21.15.80:0/2567948654 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6288031a60 con 0x7f6290167d80 2019-11-28T11:54:00.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.508+0000 7f6294b8e700 1 --2- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6274018780 0x7f627401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.509+0000 7f6294b8e700 1 --2- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6274018780 0x7f627401abf0 crc :-1 s=READY pgs=1018 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.516+0000 7f62965f1700 1 -- 172.21.15.80:0/2567948654 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6290104710 con 0x7f6290167d80 2019-11-28T11:54:00.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.519+0000 7f629538f700 1 --2- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6290167d80 0x7f629016a180 secure :-1 s=THROTTLE_DONE pgs=1502 cs=0 l=1 rx=0x7f6288010390 tx=0x7f6288010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.519+0000 7f628d7fa700 1 -- 172.21.15.80:0/2567948654 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6288000ad0 con 0x7f6290167d80 2019-11-28T11:54:00.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.690+0000 7f62965f1700 1 -- 172.21.15.80:0/2567948654 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6290104390 con 0x7f6290167d80 2019-11-28T11:54:00.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.696+0000 7f629538f700 1 --2- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6290167d80 0x7f629016a180 secure :-1 s=THROTTLE_DONE pgs=1502 cs=0 l=1 rx=0x7f6288010390 tx=0x7f6288010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.696+0000 7f628d7fa700 1 -- 172.21.15.80:0/2567948654 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v66) v1 ==== 184+0+0 (secure 0 0 0) 0x7f628800eb30 con 0x7f6290167d80 2019-11-28T11:54:00.752 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:54:00.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.699+0000 7f62965f1700 1 -- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6274018780 msgr2=0x7f627401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:00.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.699+0000 7f62965f1700 1 --2- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6274018780 0x7f627401abf0 crc :-1 s=READY pgs=1018 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:00.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.699+0000 7f62965f1700 1 -- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6290167d80 msgr2=0x7f629016a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:00.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.699+0000 7f62965f1700 1 --2- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6290167d80 0x7f629016a180 secure :-1 s=READY pgs=1502 cs=0 l=1 rx=0x7f6288010390 tx=0x7f6288010730).stop 2019-11-28T11:54:00.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.699+0000 7f62965f1700 1 -- 172.21.15.80:0/2567948654 shutdown_connections 2019-11-28T11:54:00.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.699+0000 7f62965f1700 1 --2- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6290167d80 0x7f629016a180 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:00.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.699+0000 7f62965f1700 1 --2- 172.21.15.80:0/2567948654 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6274018780 0x7f627401abf0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:00.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.699+0000 7f62965f1700 1 -- 172.21.15.80:0/2567948654 shutdown_connections 2019-11-28T11:54:00.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.699+0000 7f62965f1700 1 -- 172.21.15.80:0/2567948654 wait complete. 2019-11-28T11:54:00.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.699+0000 7f62965f1700 1 -- 172.21.15.80:0/2567948654 >> 172.21.15.80:0/2567948654 conn(0x7f62901476e0 msgr2=0x7f629012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:00.764 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:54:00.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.840+0000 7f2dfc27e700 1 Processor -- start 2019-11-28T11:54:00.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.840+0000 7f2dfc27e700 1 -- start start 2019-11-28T11:54:00.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.841+0000 7f2dfc27e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2df415ed10 0x7f2df415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:00.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.841+0000 7f2dfc27e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df406db60 con 0x7f2df40734b0 2019-11-28T11:54:00.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.841+0000 7f2dfc27e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df406e060 con 0x7f2df4073020 2019-11-28T11:54:00.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.841+0000 7f2dfc27e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df406fe00 con 0x7f2df415ed10 2019-11-28T11:54:00.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.841+0000 7f2dfa81b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2df415ed10 0x7f2df415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:00.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.841+0000 7f2dfa81b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2df415ed10 0x7f2df415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44656/0 (socket says 172.21.15.80:44656) 2019-11-28T11:54:00.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.841+0000 7f2dfb01c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2df40734b0 0x7f2df40726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43974/0 (socket says 172.21.15.80:43974) 2019-11-28T11:54:00.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.841+0000 7f2dfa81b700 1 -- 172.21.15.80:0/1779562770 learned_addr learned my addr 172.21.15.80:0/1779562770 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:00.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.841+0000 7f2dfa81b700 1 -- 172.21.15.80:0/1779562770 >> v1:172.21.15.174:6789/0 conn(0x7f2df4073020 legacy=0x7f2df4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:00.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.841+0000 7f2dfa81b700 1 -- 172.21.15.80:0/1779562770 >> v1:172.21.15.80:6789/0 conn(0x7f2df40734b0 legacy=0x7f2df40726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:00.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.841+0000 7f2dfa81b700 1 -- 172.21.15.80:0/1779562770 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df4070760 con 0x7f2df415ed10 2019-11-28T11:54:00.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.841+0000 7f2df9819700 1 -- 172.21.15.80:0/1779562770 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146862814 0 0) 0x7f2dec000d30 con 0x7f2df40734b0 2019-11-28T11:54:00.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.841+0000 7f2dfa81b700 1 --2- 172.21.15.80:0/1779562770 >> v2:172.21.15.80:3300/0 conn(0x7f2df415ed10 0x7f2df415f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2de400f740 tx=0x7f2de400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.841+0000 7f2dfa81b700 1 --2- 172.21.15.80:0/1779562770 >> v2:172.21.15.80:3300/0 conn(0x7f2df415ed10 0x7f2df415f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2de400f740 tx=0x7f2de400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.841+0000 7f2dfa81b700 1 --2- 172.21.15.80:0/1779562770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df415ed10 0x7f2df415f100 secure :-1 s=READY pgs=2487 cs=0 l=1 rx=0x7f2de400f740 tx=0x7f2de400fae0).ready entity=mon.0 client_cookie=6f45614d2ada41a3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:00.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.842+0000 7f2dfa81b700 1 --2- 172.21.15.80:0/1779562770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df415ed10 0x7f2df415f100 secure :-1 s=THROTTLE_DONE pgs=2487 cs=0 l=1 rx=0x7f2de400f740 tx=0x7f2de400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.842+0000 7f2df9819700 1 -- 172.21.15.80:0/1779562770 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2de4000960 con 0x7f2df415ed10 2019-11-28T11:54:00.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.842+0000 7f2dfa81b700 1 --2- 172.21.15.80:0/1779562770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df415ed10 0x7f2df415f100 secure :-1 s=THROTTLE_DONE pgs=2487 cs=0 l=1 rx=0x7f2de400f740 tx=0x7f2de400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.842+0000 7f2dfa81b700 1 --2- 172.21.15.80:0/1779562770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df415ed10 0x7f2df415f100 secure :-1 s=THROTTLE_DONE pgs=2487 cs=0 l=1 rx=0x7f2de400f740 tx=0x7f2de400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.842+0000 7f2df9819700 1 -- 172.21.15.80:0/1779562770 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de4000c90 con 0x7f2df415ed10 2019-11-28T11:54:00.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.842+0000 7f2df9819700 1 -- 172.21.15.80:0/1779562770 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2de40013e0 con 0x7f2df415ed10 2019-11-28T11:54:00.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.842+0000 7f2dfc27e700 1 -- 172.21.15.80:0/1779562770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df415ed10 msgr2=0x7f2df415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:00.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.842+0000 7f2dfc27e700 1 --2- 172.21.15.80:0/1779562770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df415ed10 0x7f2df415f100 secure :-1 s=READY pgs=2487 cs=0 l=1 rx=0x7f2de400f740 tx=0x7f2de400fae0).stop 2019-11-28T11:54:00.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.842+0000 7f2dfc27e700 1 -- 172.21.15.80:0/1779562770 shutdown_connections 2019-11-28T11:54:00.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.842+0000 7f2dfc27e700 1 --2- 172.21.15.80:0/1779562770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df415ed10 0x7f2df415f100 unknown :-1 s=CLOSED pgs=2487 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:00.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.842+0000 7f2dfc27e700 1 -- 172.21.15.80:0/1779562770 shutdown_connections 2019-11-28T11:54:00.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.842+0000 7f2dfc27e700 1 -- 172.21.15.80:0/1779562770 wait complete. 2019-11-28T11:54:00.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.842+0000 7f2dfc27e700 1 -- 172.21.15.80:0/1779562770 >> 172.21.15.80:0/1779562770 conn(0x7f2df4061d40 msgr2=0x7f2df40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:00.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.845+0000 7f2dfc27e700 1 Processor -- start 2019-11-28T11:54:00.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.845+0000 7f2dfc27e700 1 -- start start 2019-11-28T11:54:00.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfc27e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2df4152750 0x7f2df4135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:00.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfc27e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df4109d70 con 0x7f2df4130dc0 2019-11-28T11:54:00.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfc27e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df41308e0 con 0x7f2df4165d60 2019-11-28T11:54:00.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfc27e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df4132570 con 0x7f2df4152750 2019-11-28T11:54:00.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfa81b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2df4152750 0x7f2df4135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:00.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfa01a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2df4130dc0 0x7f2df4131250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43980/0 (socket says 172.21.15.80:43980) 2019-11-28T11:54:00.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfa01a700 1 -- 172.21.15.80:0/1414126310 learned_addr learned my addr 172.21.15.80:0/1414126310 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfa81b700 1 -- 172.21.15.80:0/1414126310 >> v1:172.21.15.174:6789/0 conn(0x7f2df4165d60 legacy=0x7f2df4168160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfa81b700 1 -- 172.21.15.80:0/1414126310 >> v1:172.21.15.80:6789/0 conn(0x7f2df4130dc0 legacy=0x7f2df4131250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfa81b700 1 -- 172.21.15.80:0/1414126310 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df4132ed0 con 0x7f2df4152750 2019-11-28T11:54:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2df37fe700 1 -- 172.21.15.80:0/1414126310 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292280862 0 0) 0x7f2de8001170 con 0x7f2df4130dc0 2019-11-28T11:54:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfa81b700 1 --2- 172.21.15.80:0/1414126310 >> v2:172.21.15.80:3300/0 conn(0x7f2df4152750 0x7f2df4135790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2de40125a0 tx=0x7f2de4012940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfa81b700 1 --2- 172.21.15.80:0/1414126310 >> v2:172.21.15.80:3300/0 conn(0x7f2df4152750 0x7f2df4135790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2de40125a0 tx=0x7f2de4012940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfa81b700 1 --2- 172.21.15.80:0/1414126310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df4152750 0x7f2df4135790 secure :-1 s=READY pgs=2489 cs=0 l=1 rx=0x7f2de40125a0 tx=0x7f2de4012940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfa81b700 1 --2- 172.21.15.80:0/1414126310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df4152750 0x7f2df4135790 secure :-1 s=THROTTLE_DONE pgs=2489 cs=0 l=1 rx=0x7f2de40125a0 tx=0x7f2de4012940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2df37fe700 1 -- 172.21.15.80:0/1414126310 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2de4000f50 con 0x7f2df4152750 2019-11-28T11:54:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfa81b700 1 --2- 172.21.15.80:0/1414126310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df4152750 0x7f2df4135790 secure :-1 s=THROTTLE_DONE pgs=2489 cs=0 l=1 rx=0x7f2de40125a0 tx=0x7f2de4012940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2df37fe700 1 -- 172.21.15.80:0/1414126310 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de4000940 con 0x7f2df4152750 2019-11-28T11:54:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfa81b700 1 --2- 172.21.15.80:0/1414126310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df4152750 0x7f2df4135790 secure :-1 s=THROTTLE_DONE pgs=2489 cs=0 l=1 rx=0x7f2de40125a0 tx=0x7f2de4012940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfc27e700 1 -- 172.21.15.80:0/1414126310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df4133250 con 0x7f2df4152750 2019-11-28T11:54:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2df37fe700 1 -- 172.21.15.80:0/1414126310 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2de4001140 con 0x7f2df4152750 2019-11-28T11:54:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.846+0000 7f2dfc27e700 1 -- 172.21.15.80:0/1414126310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df4132ed0 con 0x7f2df4152750 2019-11-28T11:54:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.847+0000 7f2dfa81b700 1 --2- 172.21.15.80:0/1414126310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df4152750 0x7f2df4135790 secure :-1 s=THROTTLE_DONE pgs=2489 cs=0 l=1 rx=0x7f2de40125a0 tx=0x7f2de4012940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.847+0000 7f2df37fe700 1 -- 172.21.15.80:0/1414126310 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2de4000d60 con 0x7f2df4152750 2019-11-28T11:54:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.847+0000 7f2dfa81b700 1 --2- 172.21.15.80:0/1414126310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df4152750 0x7f2df4135790 secure :-1 s=THROTTLE_DONE pgs=2489 cs=0 l=1 rx=0x7f2de40125a0 tx=0x7f2de4012940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.847+0000 7f2df37fe700 1 --2- 172.21.15.80:0/1414126310 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2dd4018730 0x7f2dd401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.847+0000 7f2df37fe700 1 -- 172.21.15.80:0/1414126310 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2de4033c30 con 0x7f2df4152750 2019-11-28T11:54:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.847+0000 7f2dfa01a700 1 --2- 172.21.15.80:0/1414126310 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2dd4018730 0x7f2dd401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.847+0000 7f2dfa01a700 1 --2- 172.21.15.80:0/1414126310 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2dd4018730 0x7f2dd401abc0 crc :-1 s=READY pgs=1019 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.855+0000 7f2dfc27e700 1 -- 172.21.15.80:0/1414126310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df4133250 con 0x7f2df4152750 2019-11-28T11:54:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.858+0000 7f2dfa81b700 1 --2- 172.21.15.80:0/1414126310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df4152750 0x7f2df4135790 secure :-1 s=THROTTLE_DONE pgs=2489 cs=0 l=1 rx=0x7f2de40125a0 tx=0x7f2de4012940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:00.858+0000 7f2df37fe700 1 -- 172.21.15.80:0/1414126310 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2de4000b30 con 0x7f2df4152750 2019-11-28T11:54:01.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.031+0000 7f2dfc27e700 1 -- 172.21.15.80:0/1414126310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f2df4132ed0 con 0x7f2df4152750 2019-11-28T11:54:01.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.036+0000 7f2dfa81b700 1 --2- 172.21.15.80:0/1414126310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df4152750 0x7f2df4135790 secure :-1 s=THROTTLE_DONE pgs=2489 cs=0 l=1 rx=0x7f2de40125a0 tx=0x7f2de4012940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:01.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.036+0000 7f2df37fe700 1 -- 172.21.15.80:0/1414126310 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v67) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2de4001070 con 0x7f2df4152750 2019-11-28T11:54:01.094 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:54:01.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.040+0000 7f2dfc27e700 1 -- 172.21.15.80:0/1414126310 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2dd4018730 msgr2=0x7f2dd401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:01.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.040+0000 7f2dfc27e700 1 --2- 172.21.15.80:0/1414126310 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2dd4018730 0x7f2dd401abc0 crc :-1 s=READY pgs=1019 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:01.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.040+0000 7f2dfc27e700 1 -- 172.21.15.80:0/1414126310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df4152750 msgr2=0x7f2df4135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:01.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.040+0000 7f2dfc27e700 1 --2- 172.21.15.80:0/1414126310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df4152750 0x7f2df4135790 secure :-1 s=READY pgs=2489 cs=0 l=1 rx=0x7f2de40125a0 tx=0x7f2de4012940).stop 2019-11-28T11:54:01.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.040+0000 7f2dfc27e700 1 -- 172.21.15.80:0/1414126310 shutdown_connections 2019-11-28T11:54:01.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.040+0000 7f2dfc27e700 1 --2- 172.21.15.80:0/1414126310 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2dd4018730 0x7f2dd401abc0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:01.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.040+0000 7f2dfc27e700 1 --2- 172.21.15.80:0/1414126310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2df4152750 0x7f2df4135790 unknown :-1 s=CLOSED pgs=2489 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:01.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.040+0000 7f2dfc27e700 1 -- 172.21.15.80:0/1414126310 shutdown_connections 2019-11-28T11:54:01.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.040+0000 7f2dfc27e700 1 -- 172.21.15.80:0/1414126310 wait complete. 2019-11-28T11:54:01.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.040+0000 7f2dfc27e700 1 -- 172.21.15.80:0/1414126310 >> 172.21.15.80:0/1414126310 conn(0x7f2df41476e0 msgr2=0x7f2df412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:01.106 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:01.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.169+0000 7f5fb0384700 1 Processor -- start 2019-11-28T11:54:01.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.169+0000 7f5fb0384700 1 -- start start 2019-11-28T11:54:01.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.170+0000 7f5fb0384700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5fa806c0a0 0x7f5fa8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:01.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.170+0000 7f5fb0384700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa8072620 0x7f5fa8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:01.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.170+0000 7f5fb0384700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa806db00 con 0x7f5fa80734e0 2019-11-28T11:54:01.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.170+0000 7f5fb0384700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa806fd60 con 0x7f5fa806c0a0 2019-11-28T11:54:01.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.170+0000 7f5fb0384700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa8070030 con 0x7f5fa8072620 2019-11-28T11:54:01.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.170+0000 7f5fae921700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5fa806c0a0 0x7f5fa8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:01.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.170+0000 7f5fae921700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5fa806c0a0 0x7f5fa8072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44670/0 (socket says 172.21.15.80:44670) 2019-11-28T11:54:01.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.170+0000 7f5fae921700 1 -- 172.21.15.80:0/1373865687 learned_addr learned my addr 172.21.15.80:0/1373865687 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:01.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.170+0000 7f5faf122700 1 --2- 172.21.15.80:0/1373865687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa8072620 0x7f5fa8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:01.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.170+0000 7f5fae921700 1 -- 172.21.15.80:0/1373865687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa8072620 msgr2=0x7f5fa8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:01.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.170+0000 7f5fae921700 1 --2- 172.21.15.80:0/1373865687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa8072620 0x7f5fa8164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:01.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.170+0000 7f5fae921700 1 -- 172.21.15.80:0/1373865687 >> v1:172.21.15.174:6789/0 conn(0x7f5fa80734e0 legacy=0x7f5fa8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:01.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.170+0000 7f5fae921700 1 -- 172.21.15.80:0/1373865687 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa80706c0 con 0x7f5fa806c0a0 2019-11-28T11:54:01.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.170+0000 7f5faf122700 1 --2- 172.21.15.80:0/1373865687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa8072620 0x7f5fa8164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:01.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.171+0000 7f5fae921700 1 --2- 172.21.15.80:0/1373865687 >> v2:172.21.15.80:3300/0 conn(0x7f5fa806c0a0 0x7f5fa8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5f9c00f740 tx=0x7f5f9c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:01.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.171+0000 7f5fae921700 1 --2- 172.21.15.80:0/1373865687 >> v2:172.21.15.80:3300/0 conn(0x7f5fa806c0a0 0x7f5fa8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5f9c00f740 tx=0x7f5f9c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:01.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.171+0000 7f5fae921700 1 --2- 172.21.15.80:0/1373865687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa806c0a0 0x7f5fa8072fa0 secure :-1 s=READY pgs=2490 cs=0 l=1 rx=0x7f5f9c00f740 tx=0x7f5f9c00fae0).ready entity=mon.0 client_cookie=4773f744ff0f18d6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:01.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.171+0000 7f5fae921700 1 --2- 172.21.15.80:0/1373865687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa806c0a0 0x7f5fa8072fa0 secure :-1 s=THROTTLE_DONE pgs=2490 cs=0 l=1 rx=0x7f5f9c00f740 tx=0x7f5f9c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:01.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.171+0000 7f5fae921700 1 --2- 172.21.15.80:0/1373865687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa806c0a0 0x7f5fa8072fa0 secure :-1 s=THROTTLE_DONE pgs=2490 cs=0 l=1 rx=0x7f5f9c00f740 tx=0x7f5f9c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:01.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.171+0000 7f5fad91f700 1 -- 172.21.15.80:0/1373865687 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f9c000960 con 0x7f5fa806c0a0 2019-11-28T11:54:01.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.171+0000 7f5fae921700 1 --2- 172.21.15.80:0/1373865687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa806c0a0 0x7f5fa8072fa0 secure :-1 s=THROTTLE_DONE pgs=2490 cs=0 l=1 rx=0x7f5f9c00f740 tx=0x7f5f9c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:01.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.171+0000 7f5fad91f700 1 -- 172.21.15.80:0/1373865687 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9c000c90 con 0x7f5fa806c0a0 2019-11-28T11:54:01.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.171+0000 7f5fad91f700 1 -- 172.21.15.80:0/1373865687 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f9c0013a0 con 0x7f5fa806c0a0 2019-11-28T11:54:01.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.171+0000 7f5fb0384700 1 -- 172.21.15.80:0/1373865687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa806c0a0 msgr2=0x7f5fa8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:01.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.171+0000 7f5fb0384700 1 --2- 172.21.15.80:0/1373865687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa806c0a0 0x7f5fa8072fa0 secure :-1 s=READY pgs=2490 cs=0 l=1 rx=0x7f5f9c00f740 tx=0x7f5f9c00fae0).stop 2019-11-28T11:54:01.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.172+0000 7f5fb0384700 1 -- 172.21.15.80:0/1373865687 shutdown_connections 2019-11-28T11:54:01.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.172+0000 7f5fb0384700 1 --2- 172.21.15.80:0/1373865687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa8072620 0x7f5fa8164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:01.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.172+0000 7f5fb0384700 1 --2- 172.21.15.80:0/1373865687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa806c0a0 0x7f5fa8072fa0 unknown :-1 s=CLOSED pgs=2490 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:01.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.172+0000 7f5fb0384700 1 -- 172.21.15.80:0/1373865687 shutdown_connections 2019-11-28T11:54:01.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.172+0000 7f5fb0384700 1 -- 172.21.15.80:0/1373865687 wait complete. 2019-11-28T11:54:01.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.172+0000 7f5fb0384700 1 -- 172.21.15.80:0/1373865687 >> 172.21.15.80:0/1373865687 conn(0x7f5fa8061cf0 msgr2=0x7f5fa8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.174+0000 7f5fb0384700 1 Processor -- start 2019-11-28T11:54:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.174+0000 7f5fb0384700 1 -- start start 2019-11-28T11:54:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5fb0384700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa8104820 0x7f5fa810c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5fb0384700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5fa810c890 0x7f5fa810b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:01.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5fb0384700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5fa810b710 0x7f5fa810bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:01.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5fb0384700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa8108700 con 0x7f5fa810b710 2019-11-28T11:54:01.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5fb0384700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa81081f0 con 0x7f5fa810c890 2019-11-28T11:54:01.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5fb0384700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa8109130 con 0x7f5fa8104820 2019-11-28T11:54:01.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5faf122700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5fa810b710 0x7f5fa810bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:01.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5faf122700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5fa810b710 0x7f5fa810bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44678/0 (socket says 172.21.15.80:44678) 2019-11-28T11:54:01.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5faf122700 1 -- 172.21.15.80:0/1742725305 learned_addr learned my addr 172.21.15.80:0/1742725305 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:01.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5fae921700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa8104820 0x7f5fa810c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:01.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5fae120700 1 --2- 172.21.15.80:0/1742725305 >> v2:172.21.15.174:3300/0 conn(0x7f5fa810c890 0x7f5fa810b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:01.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5faf122700 1 -- 172.21.15.80:0/1742725305 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa8104820 msgr2=0x7f5fa810c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:01.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5faf122700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa8104820 0x7f5fa810c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:01.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5faf122700 1 -- 172.21.15.80:0/1742725305 >> v2:172.21.15.174:3300/0 conn(0x7f5fa810c890 msgr2=0x7f5fa810b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:01.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5faf122700 1 --2- 172.21.15.80:0/1742725305 >> v2:172.21.15.174:3300/0 conn(0x7f5fa810c890 0x7f5fa810b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:01.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5faf122700 1 -- 172.21.15.80:0/1742725305 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa8109a90 con 0x7f5fa810b710 2019-11-28T11:54:01.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5fae120700 1 --2- 172.21.15.80:0/1742725305 >> v2:172.21.15.174:3300/0 conn(0x7f5fa810c890 0x7f5fa810b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:01.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5faf122700 1 --2- 172.21.15.80:0/1742725305 >> v2:172.21.15.80:3300/0 conn(0x7f5fa810b710 0x7f5fa810bb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5fa00103f0 tx=0x7f5fa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:01.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5faf122700 1 --2- 172.21.15.80:0/1742725305 >> v2:172.21.15.80:3300/0 conn(0x7f5fa810b710 0x7f5fa810bb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5fa00103f0 tx=0x7f5fa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:01.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.175+0000 7f5faf122700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa810b710 0x7f5fa810bb70 secure :-1 s=READY pgs=2491 cs=0 l=1 rx=0x7f5fa00103f0 tx=0x7f5fa0010790).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:01.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.176+0000 7f5faf122700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa810b710 0x7f5fa810bb70 secure :-1 s=THROTTLE_DONE pgs=2491 cs=0 l=1 rx=0x7f5fa00103f0 tx=0x7f5fa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:01.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.176+0000 7f5faf122700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa810b710 0x7f5fa810bb70 secure :-1 s=THROTTLE_DONE pgs=2491 cs=0 l=1 rx=0x7f5fa00103f0 tx=0x7f5fa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:01.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.176+0000 7f5f9b7fe700 1 -- 172.21.15.80:0/1742725305 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fa0001460 con 0x7f5fa810b710 2019-11-28T11:54:01.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.176+0000 7f5faf122700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa810b710 0x7f5fa810bb70 secure :-1 s=THROTTLE_DONE pgs=2491 cs=0 l=1 rx=0x7f5fa00103f0 tx=0x7f5fa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:01.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.176+0000 7f5f9b7fe700 1 -- 172.21.15.80:0/1742725305 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa0001080 con 0x7f5fa810b710 2019-11-28T11:54:01.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.176+0000 7f5fb0384700 1 -- 172.21.15.80:0/1742725305 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa8109e10 con 0x7f5fa810b710 2019-11-28T11:54:01.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.176+0000 7f5f9b7fe700 1 -- 172.21.15.80:0/1742725305 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fa0001a40 con 0x7f5fa810b710 2019-11-28T11:54:01.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.176+0000 7f5fb0384700 1 -- 172.21.15.80:0/1742725305 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa8109a90 con 0x7f5fa810b710 2019-11-28T11:54:01.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.176+0000 7f5faf122700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa810b710 0x7f5fa810bb70 secure :-1 s=THROTTLE_DONE pgs=2491 cs=0 l=1 rx=0x7f5fa00103f0 tx=0x7f5fa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:01.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.176+0000 7f5f9b7fe700 1 -- 172.21.15.80:0/1742725305 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5fa0001270 con 0x7f5fa810b710 2019-11-28T11:54:01.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.176+0000 7f5faf122700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa810b710 0x7f5fa810bb70 secure :-1 s=THROTTLE_DONE pgs=2491 cs=0 l=1 rx=0x7f5fa00103f0 tx=0x7f5fa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:01.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.176+0000 7f5f9b7fe700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f90018730 0x7f5f9001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:01.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.176+0000 7f5f9b7fe700 1 -- 172.21.15.80:0/1742725305 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5fa0031a40 con 0x7f5fa810b710 2019-11-28T11:54:01.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.177+0000 7f5fae921700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f90018730 0x7f5f9001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:01.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.177+0000 7f5fae921700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f90018730 0x7f5f9001abc0 crc :-1 s=READY pgs=1020 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:01.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.184+0000 7f5fb0384700 1 -- 172.21.15.80:0/1742725305 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa8109e10 con 0x7f5fa810b710 2019-11-28T11:54:01.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.187+0000 7f5faf122700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa810b710 0x7f5fa810bb70 secure :-1 s=THROTTLE_DONE pgs=2491 cs=0 l=1 rx=0x7f5fa00103f0 tx=0x7f5fa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:01.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.187+0000 7f5f9b7fe700 1 -- 172.21.15.80:0/1742725305 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5fa0000e70 con 0x7f5fa810b710 2019-11-28T11:54:01.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.359+0000 7f5fb0384700 1 -- 172.21.15.80:0/1742725305 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fa8109a90 con 0x7f5fa810b710 2019-11-28T11:54:01.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.360+0000 7f5faf122700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa810b710 0x7f5fa810bb70 secure :-1 s=THROTTLE_DONE pgs=2491 cs=0 l=1 rx=0x7f5fa00103f0 tx=0x7f5fa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:01.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.360+0000 7f5f9b7fe700 1 -- 172.21.15.80:0/1742725305 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) v1 ==== 95+0+1428 (secure 0 0 0) 0x7f5fa0001be0 con 0x7f5fa810b710 2019-11-28T11:54:01.416 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 150 2019-11-28T11:54:01.417 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:01.417 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":150,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:53:57.302329+0000","modified":"2019-11-28T11:53:58.974554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2019-11-28T11:54:01.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.362+0000 7f5fb0384700 1 -- 172.21.15.80:0/1742725305 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f90018730 msgr2=0x7f5f9001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:01.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.362+0000 7f5fb0384700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f90018730 0x7f5f9001abc0 crc :-1 s=READY pgs=1020 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:01.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.362+0000 7f5fb0384700 1 -- 172.21.15.80:0/1742725305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa810b710 msgr2=0x7f5fa810bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:01.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.362+0000 7f5fb0384700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa810b710 0x7f5fa810bb70 secure :-1 s=READY pgs=2491 cs=0 l=1 rx=0x7f5fa00103f0 tx=0x7f5fa0010790).stop 2019-11-28T11:54:01.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.363+0000 7f5fb0384700 1 -- 172.21.15.80:0/1742725305 shutdown_connections 2019-11-28T11:54:01.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.363+0000 7f5fb0384700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5f90018730 0x7f5f9001abc0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:01.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.363+0000 7f5fb0384700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5fa810b710 0x7f5fa810bb70 unknown :-1 s=CLOSED pgs=2491 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:01.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.363+0000 7f5fb0384700 1 --2- 172.21.15.80:0/1742725305 >> v2:172.21.15.174:3300/0 conn(0x7f5fa810c890 0x7f5fa810b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:01.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.363+0000 7f5fb0384700 1 --2- 172.21.15.80:0/1742725305 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fa8104820 0x7f5fa810c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:01.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.363+0000 7f5fb0384700 1 -- 172.21.15.80:0/1742725305 shutdown_connections 2019-11-28T11:54:01.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.363+0000 7f5fb0384700 1 -- 172.21.15.80:0/1742725305 wait complete. 2019-11-28T11:54:01.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:01.363+0000 7f5fb0384700 1 -- 172.21.15.80:0/1742725305 >> 172.21.15.80:0/1742725305 conn(0x7f5fa813d620 msgr2=0x7f5fa813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:01.731 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 30, u'failed': [], u'epoch': 150, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [31], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:53:57.302329+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:53:58.974554+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:54:01.731 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:54:02.732 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:02.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.796+0000 7f53f65f8700 1 Processor -- start 2019-11-28T11:54:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.796+0000 7f53f65f8700 1 -- start start 2019-11-28T11:54:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.797+0000 7f53f65f8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53f006c0a0 0x7f53f0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.797+0000 7f53f65f8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53f0072620 0x7f53f0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.797+0000 7f53f65f8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f006db00 con 0x7f53f00734e0 2019-11-28T11:54:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.797+0000 7f53f65f8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f006f330 con 0x7f53f0072620 2019-11-28T11:54:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.797+0000 7f53f65f8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f00706c0 con 0x7f53f006c0a0 2019-11-28T11:54:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.797+0000 7f53f5396700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53f0072620 0x7f53f0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.797+0000 7f53f5396700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53f0072620 0x7f53f0164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44682/0 (socket says 172.21.15.80:44682) 2019-11-28T11:54:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.797+0000 7f53f5396700 1 -- 172.21.15.80:0/4262833465 learned_addr learned my addr 172.21.15.80:0/4262833465 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53f4b95700 1 --2- 172.21.15.80:0/4262833465 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53f006c0a0 0x7f53f0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53f5396700 1 -- 172.21.15.80:0/4262833465 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53f006c0a0 msgr2=0x7f53f0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:02.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53f5396700 1 --2- 172.21.15.80:0/4262833465 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53f006c0a0 0x7f53f0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53f5396700 1 -- 172.21.15.80:0/4262833465 >> v1:172.21.15.174:6789/0 conn(0x7f53f00734e0 legacy=0x7f53f0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53f5396700 1 -- 172.21.15.80:0/4262833465 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f0070a40 con 0x7f53f0072620 2019-11-28T11:54:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53f4b95700 1 --2- 172.21.15.80:0/4262833465 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53f006c0a0 0x7f53f0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53f5396700 1 --2- 172.21.15.80:0/4262833465 >> v2:172.21.15.80:3300/0 conn(0x7f53f0072620 0x7f53f0164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f53e800f730 tx=0x7f53e800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:02.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53f5396700 1 --2- 172.21.15.80:0/4262833465 >> v2:172.21.15.80:3300/0 conn(0x7f53f0072620 0x7f53f0164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f53e800f730 tx=0x7f53e800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53f5396700 1 --2- 172.21.15.80:0/4262833465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f0072620 0x7f53f0164d70 secure :-1 s=READY pgs=2492 cs=0 l=1 rx=0x7f53e800f730 tx=0x7f53e800fad0).ready entity=mon.0 client_cookie=89e0d8e069fbeb5e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53f5396700 1 --2- 172.21.15.80:0/4262833465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f0072620 0x7f53f0164d70 secure :-1 s=THROTTLE_DONE pgs=2492 cs=0 l=1 rx=0x7f53e800f730 tx=0x7f53e800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:02.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53ef7fe700 1 -- 172.21.15.80:0/4262833465 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53e8000b90 con 0x7f53f0072620 2019-11-28T11:54:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53f5396700 1 --2- 172.21.15.80:0/4262833465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f0072620 0x7f53f0164d70 secure :-1 s=THROTTLE_DONE pgs=2492 cs=0 l=1 rx=0x7f53e800f730 tx=0x7f53e800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:02.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53f5396700 1 --2- 172.21.15.80:0/4262833465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f0072620 0x7f53f0164d70 secure :-1 s=THROTTLE_DONE pgs=2492 cs=0 l=1 rx=0x7f53e800f730 tx=0x7f53e800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53ef7fe700 1 -- 172.21.15.80:0/4262833465 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e80010e0 con 0x7f53f0072620 2019-11-28T11:54:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53ef7fe700 1 -- 172.21.15.80:0/4262833465 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53e8001830 con 0x7f53f0072620 2019-11-28T11:54:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53f65f8700 1 -- 172.21.15.80:0/4262833465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f0072620 msgr2=0x7f53f0164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.798+0000 7f53f65f8700 1 --2- 172.21.15.80:0/4262833465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f0072620 0x7f53f0164d70 secure :-1 s=READY pgs=2492 cs=0 l=1 rx=0x7f53e800f730 tx=0x7f53e800fad0).stop 2019-11-28T11:54:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.799+0000 7f53f65f8700 1 -- 172.21.15.80:0/4262833465 shutdown_connections 2019-11-28T11:54:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.799+0000 7f53f65f8700 1 --2- 172.21.15.80:0/4262833465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f0072620 0x7f53f0164d70 unknown :-1 s=CLOSED pgs=2492 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:02.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.799+0000 7f53f65f8700 1 --2- 172.21.15.80:0/4262833465 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53f006c0a0 0x7f53f0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:02.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.799+0000 7f53f65f8700 1 -- 172.21.15.80:0/4262833465 shutdown_connections 2019-11-28T11:54:02.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.799+0000 7f53f65f8700 1 -- 172.21.15.80:0/4262833465 wait complete. 2019-11-28T11:54:02.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.799+0000 7f53f65f8700 1 -- 172.21.15.80:0/4262833465 >> 172.21.15.80:0/4262833465 conn(0x7f53f0061cf0 msgr2=0x7f53f0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.801+0000 7f53f65f8700 1 Processor -- start 2019-11-28T11:54:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.801+0000 7f53f65f8700 1 -- start start 2019-11-28T11:54:02.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.802+0000 7f53f65f8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53f013e5f0 0x7f53f013e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.802+0000 7f53f65f8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53f010a4e0 0x7f53f010c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.802+0000 7f53f65f8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f01066e0 con 0x7f53f010a070 2019-11-28T11:54:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.802+0000 7f53f65f8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f010d630 con 0x7f53f010a4e0 2019-11-28T11:54:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.802+0000 7f53f65f8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f010e060 con 0x7f53f013e5f0 2019-11-28T11:54:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.802+0000 7f53f5396700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53f010a4e0 0x7f53f010c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.802+0000 7f53f5396700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53f010a4e0 0x7f53f010c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44690/0 (socket says 172.21.15.80:44690) 2019-11-28T11:54:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.802+0000 7f53f5396700 1 -- 172.21.15.80:0/3785312766 learned_addr learned my addr 172.21.15.80:0/3785312766 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.802+0000 7f53effff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f53f010a070 0x7f53f010bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44004/0 (socket says 172.21.15.80:44004) 2019-11-28T11:54:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.802+0000 7f53f4b95700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53f013e5f0 0x7f53f013e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53f5396700 1 -- 172.21.15.80:0/3785312766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53f013e5f0 msgr2=0x7f53f013e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53f5396700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53f013e5f0 0x7f53f013e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53f5396700 1 -- 172.21.15.80:0/3785312766 >> v1:172.21.15.80:6789/0 conn(0x7f53f010a070 legacy=0x7f53f010bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:02.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53ed7fa700 1 -- 172.21.15.80:0/3785312766 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969133760 0 0) 0x7f53e0001440 con 0x7f53f010a070 2019-11-28T11:54:02.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53f5396700 1 -- 172.21.15.80:0/3785312766 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f010e9c0 con 0x7f53f010a4e0 2019-11-28T11:54:02.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53f4b95700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53f013e5f0 0x7f53f013e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:02.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53f5396700 1 --2- 172.21.15.80:0/3785312766 >> v2:172.21.15.80:3300/0 conn(0x7f53f010a4e0 0x7f53f010c5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f53e8010460 tx=0x7f53e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53f5396700 1 --2- 172.21.15.80:0/3785312766 >> v2:172.21.15.80:3300/0 conn(0x7f53f010a4e0 0x7f53f010c5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f53e8010460 tx=0x7f53e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53f5396700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f010a4e0 0x7f53f010c5b0 secure :-1 s=READY pgs=2494 cs=0 l=1 rx=0x7f53e8010460 tx=0x7f53e8010800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53f5396700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f010a4e0 0x7f53f010c5b0 secure :-1 s=THROTTLE_DONE pgs=2494 cs=0 l=1 rx=0x7f53e8010460 tx=0x7f53e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53ed7fa700 1 -- 172.21.15.80:0/3785312766 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53e80012b0 con 0x7f53f010a4e0 2019-11-28T11:54:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53f65f8700 1 -- 172.21.15.80:0/3785312766 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f010ed40 con 0x7f53f010a4e0 2019-11-28T11:54:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53f65f8700 1 -- 172.21.15.80:0/3785312766 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f010e9c0 con 0x7f53f010a4e0 2019-11-28T11:54:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53f5396700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f010a4e0 0x7f53f010c5b0 secure :-1 s=THROTTLE_DONE pgs=2494 cs=0 l=1 rx=0x7f53e8010460 tx=0x7f53e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53f5396700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f010a4e0 0x7f53f010c5b0 secure :-1 s=THROTTLE_DONE pgs=2494 cs=0 l=1 rx=0x7f53e8010460 tx=0x7f53e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53ed7fa700 1 -- 172.21.15.80:0/3785312766 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e8000eb0 con 0x7f53f010a4e0 2019-11-28T11:54:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53ed7fa700 1 -- 172.21.15.80:0/3785312766 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53e80014c0 con 0x7f53f010a4e0 2019-11-28T11:54:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.803+0000 7f53f5396700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f010a4e0 0x7f53f010c5b0 secure :-1 s=THROTTLE_DONE pgs=2494 cs=0 l=1 rx=0x7f53e8010460 tx=0x7f53e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.804+0000 7f53ed7fa700 1 -- 172.21.15.80:0/3785312766 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f53e80012b0 con 0x7f53f010a4e0 2019-11-28T11:54:02.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.804+0000 7f53f5396700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f010a4e0 0x7f53f010c5b0 secure :-1 s=THROTTLE_DONE pgs=2494 cs=0 l=1 rx=0x7f53e8010460 tx=0x7f53e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.804+0000 7f53ed7fa700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f53d4018730 0x7f53d401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.804+0000 7f53ed7fa700 1 -- 172.21.15.80:0/3785312766 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f53e8031af0 con 0x7f53f010a4e0 2019-11-28T11:54:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.804+0000 7f53f4b95700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f53d4018730 0x7f53d401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:02.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.804+0000 7f53f4b95700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f53d4018730 0x7f53d401abc0 crc :-1 s=READY pgs=1021 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.812+0000 7f53f65f8700 1 -- 172.21.15.80:0/3785312766 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f010ed40 con 0x7f53f010a4e0 2019-11-28T11:54:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.815+0000 7f53f5396700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f010a4e0 0x7f53f010c5b0 secure :-1 s=THROTTLE_DONE pgs=2494 cs=0 l=1 rx=0x7f53e8010460 tx=0x7f53e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:02.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.815+0000 7f53ed7fa700 1 -- 172.21.15.80:0/3785312766 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f53e8000eb0 con 0x7f53f010a4e0 2019-11-28T11:54:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.989+0000 7f53f65f8700 1 -- 172.21.15.80:0/3785312766 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53f010e9c0 con 0x7f53f010a4e0 2019-11-28T11:54:03.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.989+0000 7f53f5396700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f010a4e0 0x7f53f010c5b0 secure :-1 s=THROTTLE_DONE pgs=2494 cs=0 l=1 rx=0x7f53e8010460 tx=0x7f53e8010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:03.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.989+0000 7f53ed7fa700 1 -- 172.21.15.80:0/3785312766 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) v1 ==== 95+0+1428 (secure 0 0 0) 0x7f53e8001bd0 con 0x7f53f010a4e0 2019-11-28T11:54:03.046 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:03.046 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":150,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:53:57.302329+0000","modified":"2019-11-28T11:53:58.974554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2019-11-28T11:54:03.047 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 150 2019-11-28T11:54:03.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.992+0000 7f53f65f8700 1 -- 172.21.15.80:0/3785312766 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f53d4018730 msgr2=0x7f53d401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.992+0000 7f53f65f8700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f53d4018730 0x7f53d401abc0 crc :-1 s=READY pgs=1021 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.992+0000 7f53f65f8700 1 -- 172.21.15.80:0/3785312766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f010a4e0 msgr2=0x7f53f010c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.992+0000 7f53f65f8700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f010a4e0 0x7f53f010c5b0 secure :-1 s=READY pgs=2494 cs=0 l=1 rx=0x7f53e8010460 tx=0x7f53e8010800).stop 2019-11-28T11:54:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.992+0000 7f53f65f8700 1 -- 172.21.15.80:0/3785312766 shutdown_connections 2019-11-28T11:54:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.992+0000 7f53f65f8700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f53d4018730 0x7f53d401abc0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:03.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.992+0000 7f53f65f8700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53f010a4e0 0x7f53f010c5b0 unknown :-1 s=CLOSED pgs=2494 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.992+0000 7f53f65f8700 1 --2- 172.21.15.80:0/3785312766 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53f013e5f0 0x7f53f013e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.992+0000 7f53f65f8700 1 -- 172.21.15.80:0/3785312766 shutdown_connections 2019-11-28T11:54:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.992+0000 7f53f65f8700 1 -- 172.21.15.80:0/3785312766 wait complete. 2019-11-28T11:54:03.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:02.992+0000 7f53f65f8700 1 -- 172.21.15.80:0/3785312766 >> 172.21.15.80:0/3785312766 conn(0x7f53f013d620 msgr2=0x7f53f013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:03.361 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 30, u'failed': [], u'epoch': 150, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [31], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:53:57.302329+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:53:58.974554+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:54:03.361 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:54:04.362 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:04.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.426+0000 7ff2a52d9700 1 Processor -- start 2019-11-28T11:54:04.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.426+0000 7ff2a52d9700 1 -- start start 2019-11-28T11:54:04.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.427+0000 7ff2a52d9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2a006c490 0x7ff2a006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:04.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.427+0000 7ff2a52d9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2a006ce60 0x7ff2a0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:04.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.427+0000 7ff2a52d9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a006db00 con 0x7ff2a006c0a0 2019-11-28T11:54:04.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.427+0000 7ff2a52d9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a006fd60 con 0x7ff2a006c490 2019-11-28T11:54:04.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.427+0000 7ff2a52d9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0070030 con 0x7ff2a006ce60 2019-11-28T11:54:04.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.427+0000 7ff29ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2a006ce60 0x7ff2a0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:04.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.427+0000 7ff29effd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2a006c490 0x7ff2a006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:04.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.427+0000 7ff29effd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2a006c490 0x7ff2a006c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:59600/0 (socket says 172.21.15.80:59600) 2019-11-28T11:54:04.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.427+0000 7ff29ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2a006ce60 0x7ff2a0164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:46972/0 (socket says 172.21.15.80:46972) 2019-11-28T11:54:04.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.427+0000 7ff29effd700 1 -- 172.21.15.80:0/1625037593 learned_addr learned my addr 172.21.15.80:0/1625037593 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:04.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff29effd700 1 -- 172.21.15.80:0/1625037593 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2a006ce60 msgr2=0x7ff2a0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:04.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff29effd700 1 --2- 172.21.15.80:0/1625037593 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2a006ce60 0x7ff2a0164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:04.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff29effd700 1 -- 172.21.15.80:0/1625037593 >> v1:172.21.15.174:6789/0 conn(0x7ff2a006c0a0 legacy=0x7ff2a0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:04.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff29effd700 1 -- 172.21.15.80:0/1625037593 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a00706c0 con 0x7ff2a006c490 2019-11-28T11:54:04.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff29e7fc700 1 -- 172.21.15.80:0/1625037593 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371086439 0 0) 0x7ff290001080 con 0x7ff2a006c0a0 2019-11-28T11:54:04.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff29ffff700 1 --2- 172.21.15.80:0/1625037593 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2a006ce60 0x7ff2a0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:04.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff29effd700 1 --2- 172.21.15.80:0/1625037593 >> v2:172.21.15.174:3300/0 conn(0x7ff2a006c490 0x7ff2a006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff28800fac0 tx=0x7ff28800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:04.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff29effd700 1 --2- 172.21.15.80:0/1625037593 >> v2:172.21.15.174:3300/0 conn(0x7ff2a006c490 0x7ff2a006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff28800fac0 tx=0x7ff28800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:04.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff29effd700 1 --2- 172.21.15.80:0/1625037593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a006c490 0x7ff2a006c920 secure :-1 s=READY pgs=1508 cs=0 l=1 rx=0x7ff28800fac0 tx=0x7ff28800f8f0).ready entity=mon.1 client_cookie=6c2f92cc1de08a2f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:04.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff29effd700 1 --2- 172.21.15.80:0/1625037593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a006c490 0x7ff2a006c920 secure :-1 s=THROTTLE_DONE pgs=1508 cs=0 l=1 rx=0x7ff28800fac0 tx=0x7ff28800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:04.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff29e7fc700 1 -- 172.21.15.80:0/1625037593 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff288000ce0 con 0x7ff2a006c490 2019-11-28T11:54:04.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff29effd700 1 --2- 172.21.15.80:0/1625037593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a006c490 0x7ff2a006c920 secure :-1 s=THROTTLE_DONE pgs=1508 cs=0 l=1 rx=0x7ff28800fac0 tx=0x7ff28800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:04.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff29effd700 1 --2- 172.21.15.80:0/1625037593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a006c490 0x7ff2a006c920 secure :-1 s=THROTTLE_DONE pgs=1508 cs=0 l=1 rx=0x7ff28800fac0 tx=0x7ff28800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:04.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff29e7fc700 1 -- 172.21.15.80:0/1625037593 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff288001010 con 0x7ff2a006c490 2019-11-28T11:54:04.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff29e7fc700 1 -- 172.21.15.80:0/1625037593 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff288001720 con 0x7ff2a006c490 2019-11-28T11:54:04.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff2a52d9700 1 -- 172.21.15.80:0/1625037593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a006c490 msgr2=0x7ff2a006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:04.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.428+0000 7ff2a52d9700 1 --2- 172.21.15.80:0/1625037593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a006c490 0x7ff2a006c920 secure :-1 s=READY pgs=1508 cs=0 l=1 rx=0x7ff28800fac0 tx=0x7ff28800f8f0).stop 2019-11-28T11:54:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.429+0000 7ff2a52d9700 1 -- 172.21.15.80:0/1625037593 shutdown_connections 2019-11-28T11:54:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.429+0000 7ff2a52d9700 1 --2- 172.21.15.80:0/1625037593 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2a006ce60 0x7ff2a0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.429+0000 7ff2a52d9700 1 --2- 172.21.15.80:0/1625037593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a006c490 0x7ff2a006c920 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:04.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.429+0000 7ff2a52d9700 1 -- 172.21.15.80:0/1625037593 shutdown_connections 2019-11-28T11:54:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.429+0000 7ff2a52d9700 1 -- 172.21.15.80:0/1625037593 wait complete. 2019-11-28T11:54:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.429+0000 7ff2a52d9700 1 -- 172.21.15.80:0/1625037593 >> 172.21.15.80:0/1625037593 conn(0x7ff2a0061cf0 msgr2=0x7ff2a0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.431+0000 7ff2a52d9700 1 Processor -- start 2019-11-28T11:54:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.432+0000 7ff2a52d9700 1 -- start start 2019-11-28T11:54:04.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.432+0000 7ff2a52d9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2a01239b0 0x7ff2a0116fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:04.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.432+0000 7ff2a52d9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a013aba0 con 0x7ff2a01155b0 2019-11-28T11:54:04.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.432+0000 7ff2a52d9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a013b050 con 0x7ff2a0117510 2019-11-28T11:54:04.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.432+0000 7ff2a52d9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a0112d10 con 0x7ff2a01239b0 2019-11-28T11:54:04.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.432+0000 7ff29ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff2a01155b0 0x7ff2a0139640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44036/0 (socket says 172.21.15.80:44036) 2019-11-28T11:54:04.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff29ffff700 1 -- 172.21.15.80:0/2609057523 learned_addr learned my addr 172.21.15.80:0/2609057523 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:04.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff29f7fe700 1 --2- 172.21.15.80:0/2609057523 >> v2:172.21.15.174:3300/0 conn(0x7ff2a01239b0 0x7ff2a0116fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:04.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff297fff700 1 -- 172.21.15.80:0/2609057523 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552289329 0 0) 0x7ff298009890 con 0x7ff2a01155b0 2019-11-28T11:54:04.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff297fff700 1 -- 172.21.15.80:0/2609057523 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff278002e80 con 0x7ff2a01155b0 2019-11-28T11:54:04.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff297fff700 1 -- 172.21.15.80:0/2609057523 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483054813 0 0) 0x7ff288007c80 con 0x7ff2a0117510 2019-11-28T11:54:04.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff29f7fe700 1 -- 172.21.15.80:0/2609057523 >> v1:172.21.15.174:6789/0 conn(0x7ff2a0117510 legacy=0x7ff2a0114db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:04.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff29f7fe700 1 -- 172.21.15.80:0/2609057523 >> v1:172.21.15.80:6789/0 conn(0x7ff2a01155b0 legacy=0x7ff2a0139640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:04.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff29f7fe700 1 -- 172.21.15.80:0/2609057523 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a0113670 con 0x7ff2a01239b0 2019-11-28T11:54:04.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff29f7fe700 1 --2- 172.21.15.80:0/2609057523 >> v2:172.21.15.174:3300/0 conn(0x7ff2a01239b0 0x7ff2a0116fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff2900103a0 tx=0x7ff290010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:04.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff29f7fe700 1 --2- 172.21.15.80:0/2609057523 >> v2:172.21.15.174:3300/0 conn(0x7ff2a01239b0 0x7ff2a0116fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff2900103a0 tx=0x7ff290010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:04.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff29f7fe700 1 --2- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a01239b0 0x7ff2a0116fd0 secure :-1 s=READY pgs=1510 cs=0 l=1 rx=0x7ff2900103a0 tx=0x7ff290010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:04.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff29f7fe700 1 --2- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a01239b0 0x7ff2a0116fd0 secure :-1 s=THROTTLE_DONE pgs=1510 cs=0 l=1 rx=0x7ff2900103a0 tx=0x7ff290010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff297fff700 1 -- 172.21.15.80:0/2609057523 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff290009960 con 0x7ff2a01239b0 2019-11-28T11:54:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff29f7fe700 1 --2- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a01239b0 0x7ff2a0116fd0 secure :-1 s=THROTTLE_DONE pgs=1510 cs=0 l=1 rx=0x7ff2900103a0 tx=0x7ff290010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff29f7fe700 1 --2- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a01239b0 0x7ff2a0116fd0 secure :-1 s=THROTTLE_DONE pgs=1510 cs=0 l=1 rx=0x7ff2900103a0 tx=0x7ff290010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff297fff700 1 -- 172.21.15.80:0/2609057523 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff290000a70 con 0x7ff2a01239b0 2019-11-28T11:54:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff2a52d9700 1 -- 172.21.15.80:0/2609057523 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a01139f0 con 0x7ff2a01239b0 2019-11-28T11:54:04.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff297fff700 1 -- 172.21.15.80:0/2609057523 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff290009f40 con 0x7ff2a01239b0 2019-11-28T11:54:04.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.433+0000 7ff2a52d9700 1 -- 172.21.15.80:0/2609057523 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a0113670 con 0x7ff2a01239b0 2019-11-28T11:54:04.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.434+0000 7ff29f7fe700 1 --2- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a01239b0 0x7ff2a0116fd0 secure :-1 s=THROTTLE_DONE pgs=1510 cs=0 l=1 rx=0x7ff2900103a0 tx=0x7ff290010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:04.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.434+0000 7ff297fff700 1 -- 172.21.15.80:0/2609057523 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff29000a410 con 0x7ff2a01239b0 2019-11-28T11:54:04.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.434+0000 7ff29f7fe700 1 --2- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a01239b0 0x7ff2a0116fd0 secure :-1 s=THROTTLE_DONE pgs=1510 cs=0 l=1 rx=0x7ff2900103a0 tx=0x7ff290010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:04.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.434+0000 7ff297fff700 1 --2- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff278018780 0x7ff27801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:04.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.434+0000 7ff297fff700 1 -- 172.21.15.80:0/2609057523 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff290031a80 con 0x7ff2a01239b0 2019-11-28T11:54:04.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.434+0000 7ff29effd700 1 --2- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff278018780 0x7ff27801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:04.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.434+0000 7ff29effd700 1 --2- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff278018780 0x7ff27801abf0 crc :-1 s=READY pgs=1025 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:04.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.441+0000 7ff2a52d9700 1 -- 172.21.15.80:0/2609057523 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a01139f0 con 0x7ff2a01239b0 2019-11-28T11:54:04.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.445+0000 7ff29f7fe700 1 --2- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a01239b0 0x7ff2a0116fd0 secure :-1 s=THROTTLE_DONE pgs=1510 cs=0 l=1 rx=0x7ff2900103a0 tx=0x7ff290010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:04.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.445+0000 7ff297fff700 1 -- 172.21.15.80:0/2609057523 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff29000a200 con 0x7ff2a01239b0 2019-11-28T11:54:04.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.618+0000 7ff2a52d9700 1 -- 172.21.15.80:0/2609057523 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2a0113670 con 0x7ff2a01239b0 2019-11-28T11:54:04.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.618+0000 7ff29f7fe700 1 --2- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a01239b0 0x7ff2a0116fd0 secure :-1 s=THROTTLE_DONE pgs=1510 cs=0 l=1 rx=0x7ff2900103a0 tx=0x7ff290010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:04.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.618+0000 7ff297fff700 1 -- 172.21.15.80:0/2609057523 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) v1 ==== 95+0+2456 (secure 0 0 0) 0x7ff29000a410 con 0x7ff2a01239b0 2019-11-28T11:54:04.678 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 152 2019-11-28T11:54:04.678 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:04.678 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":152,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":11286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/867823380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":867823380},{"type":"v1","addr":"172.21.15.174:6835","nonce":867823380}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":151},{"gid":11301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/1741196077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1741196077},{"type":"v1","addr":"172.21.15.80:6833","nonce":1741196077}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":151}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:53:57.302329+0000","modified":"2019-11-28T11:54:03.993213+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7541},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7541":{"gid":7541,"name":"b","rank":0,"incarnation":152,"state":"up:creating","state_seq":2,"addr":"172.21.15.80:6835/3753292454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3753292454},{"type":"v1","addr":"172.21.15.80:6835","nonce":3753292454}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2019-11-28T11:54:04.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.621+0000 7ff2a52d9700 1 -- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff278018780 msgr2=0x7ff27801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:04.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.621+0000 7ff2a52d9700 1 --2- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff278018780 0x7ff27801abf0 crc :-1 s=READY pgs=1025 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:04.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.621+0000 7ff2a52d9700 1 -- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a01239b0 msgr2=0x7ff2a0116fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:04.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.621+0000 7ff2a52d9700 1 --2- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a01239b0 0x7ff2a0116fd0 secure :-1 s=READY pgs=1510 cs=0 l=1 rx=0x7ff2900103a0 tx=0x7ff290010740).stop 2019-11-28T11:54:04.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.621+0000 7ff2a52d9700 1 -- 172.21.15.80:0/2609057523 shutdown_connections 2019-11-28T11:54:04.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.621+0000 7ff2a52d9700 1 --2- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff278018780 0x7ff27801abf0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:04.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.621+0000 7ff2a52d9700 1 --2- 172.21.15.80:0/2609057523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a01239b0 0x7ff2a0116fd0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:04.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.621+0000 7ff2a52d9700 1 -- 172.21.15.80:0/2609057523 shutdown_connections 2019-11-28T11:54:04.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.621+0000 7ff2a52d9700 1 -- 172.21.15.80:0/2609057523 wait complete. 2019-11-28T11:54:04.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:04.621+0000 7ff2a52d9700 1 -- 172.21.15.80:0/2609057523 >> 172.21.15.80:0/2609057523 conn(0x7ff2a01427c0 msgr2=0x7ff2a014fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:05.005 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7541}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 30, u'failed': [], u'epoch': 152, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [31], u'info': {u'gid_7541': {u'export_targets': [], u'name': u'b', u'incarnation': 152, u'state_seq': 2, u'state': u'up:creating', u'gid': 7541, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3753292454, u'type': u'v2', u'addr': u'172.21.15.80:6834'}, {u'nonce': 3753292454, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/3753292454'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:53:57.302329+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:54:03.993213+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:54:05.005 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7541:up:creating 2019-11-28T11:54:06.006 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:06.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.074+0000 7faa19b5e700 1 Processor -- start 2019-11-28T11:54:06.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.074+0000 7faa19b5e700 1 -- start start 2019-11-28T11:54:06.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.075+0000 7faa19b5e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faa1406d120 0x7faa14165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:06.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.075+0000 7faa19b5e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1406d5a0 con 0x7faa1406c0a0 2019-11-28T11:54:06.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.075+0000 7faa19b5e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1406db00 con 0x7faa1406c490 2019-11-28T11:54:06.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.075+0000 7faa19b5e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1406fd60 con 0x7faa1406d120 2019-11-28T11:54:06.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.075+0000 7faa188fc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faa1406d120 0x7faa14165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:06.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.075+0000 7faa188fc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faa1406d120 0x7faa14165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44732/0 (socket says 172.21.15.80:44732) 2019-11-28T11:54:06.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.075+0000 7faa13fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faa1406c0a0 0x7faa14072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44044/0 (socket says 172.21.15.80:44044) 2019-11-28T11:54:06.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.075+0000 7faa188fc700 1 -- 172.21.15.80:0/2467952487 learned_addr learned my addr 172.21.15.80:0/2467952487 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:06.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.076+0000 7faa188fc700 1 -- 172.21.15.80:0/2467952487 >> v1:172.21.15.174:6789/0 conn(0x7faa1406c490 legacy=0x7faa1406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:06.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.076+0000 7faa188fc700 1 -- 172.21.15.80:0/2467952487 >> v1:172.21.15.80:6789/0 conn(0x7faa1406c0a0 legacy=0x7faa14072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:06.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.076+0000 7faa188fc700 1 -- 172.21.15.80:0/2467952487 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa140706c0 con 0x7faa1406d120 2019-11-28T11:54:06.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.076+0000 7faa188fc700 1 --2- 172.21.15.80:0/2467952487 >> v2:172.21.15.80:3300/0 conn(0x7faa1406d120 0x7faa14165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faa0c00fab0 tx=0x7faa0c00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.076+0000 7faa188fc700 1 --2- 172.21.15.80:0/2467952487 >> v2:172.21.15.80:3300/0 conn(0x7faa1406d120 0x7faa14165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faa0c00fab0 tx=0x7faa0c00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.076+0000 7faa188fc700 1 --2- 172.21.15.80:0/2467952487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa1406d120 0x7faa14165d80 secure :-1 s=READY pgs=2497 cs=0 l=1 rx=0x7faa0c00fab0 tx=0x7faa0c00fe50).ready entity=mon.0 client_cookie=e1dabf7439376d56 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:06.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.076+0000 7faa188fc700 1 --2- 172.21.15.80:0/2467952487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa1406d120 0x7faa14165d80 secure :-1 s=THROTTLE_DONE pgs=2497 cs=0 l=1 rx=0x7faa0c00fab0 tx=0x7faa0c00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.076+0000 7faa188fc700 1 --2- 172.21.15.80:0/2467952487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa1406d120 0x7faa14165d80 secure :-1 s=THROTTLE_DONE pgs=2497 cs=0 l=1 rx=0x7faa0c00fab0 tx=0x7faa0c00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.137 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.076+0000 7faa137fe700 1 -- 172.21.15.80:0/2467952487 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa0c001460 con 0x7faa1406d120 2019-11-28T11:54:06.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.076+0000 7faa188fc700 1 --2- 172.21.15.80:0/2467952487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa1406d120 0x7faa14165d80 secure :-1 s=THROTTLE_DONE pgs=2497 cs=0 l=1 rx=0x7faa0c00fab0 tx=0x7faa0c00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.076+0000 7faa137fe700 1 -- 172.21.15.80:0/2467952487 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c000df0 con 0x7faa1406d120 2019-11-28T11:54:06.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.076+0000 7faa137fe700 1 -- 172.21.15.80:0/2467952487 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa0c001a40 con 0x7faa1406d120 2019-11-28T11:54:06.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.076+0000 7faa19b5e700 1 -- 172.21.15.80:0/2467952487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa1406d120 msgr2=0x7faa14165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:06.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.076+0000 7faa19b5e700 1 --2- 172.21.15.80:0/2467952487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa1406d120 0x7faa14165d80 secure :-1 s=READY pgs=2497 cs=0 l=1 rx=0x7faa0c00fab0 tx=0x7faa0c00fe50).stop 2019-11-28T11:54:06.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.077+0000 7faa19b5e700 1 -- 172.21.15.80:0/2467952487 shutdown_connections 2019-11-28T11:54:06.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.077+0000 7faa19b5e700 1 --2- 172.21.15.80:0/2467952487 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa1406d120 0x7faa14165d80 unknown :-1 s=CLOSED pgs=2497 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:06.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.077+0000 7faa19b5e700 1 -- 172.21.15.80:0/2467952487 shutdown_connections 2019-11-28T11:54:06.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.077+0000 7faa19b5e700 1 -- 172.21.15.80:0/2467952487 wait complete. 2019-11-28T11:54:06.139 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.077+0000 7faa19b5e700 1 -- 172.21.15.80:0/2467952487 >> 172.21.15.80:0/2467952487 conn(0x7faa14061cf0 msgr2=0x7faa14064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:06.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.079+0000 7faa19b5e700 1 Processor -- start 2019-11-28T11:54:06.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.079+0000 7faa19b5e700 1 -- start start 2019-11-28T11:54:06.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.080+0000 7faa19b5e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa1412aaf0 0x7faa1410ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:06.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.080+0000 7faa19b5e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1412ed00 con 0x7faa14142e00 2019-11-28T11:54:06.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.080+0000 7faa19b5e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa141025b0 con 0x7faa14142a10 2019-11-28T11:54:06.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.080+0000 7faa19b5e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa14139360 con 0x7faa1412aaf0 2019-11-28T11:54:06.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.080+0000 7faa0bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faa14142e00 0x7faa1412a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44052/0 (socket says 172.21.15.80:44052) 2019-11-28T11:54:06.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.080+0000 7faa0bfff700 1 -- 172.21.15.80:0/2372413557 learned_addr learned my addr 172.21.15.80:0/2372413557 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:06.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.080+0000 7faa188fc700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa1412aaf0 0x7faa1410ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:06.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.080+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037429429 0 0) 0x7fa9fc001150 con 0x7faa14142e00 2019-11-28T11:54:06.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.080+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f8002e80 con 0x7faa14142e00 2019-11-28T11:54:06.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.080+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808134989 0 0) 0x7faa04001100 con 0x7faa14142a10 2019-11-28T11:54:06.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.080+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f80030b0 con 0x7faa14142a10 2019-11-28T11:54:06.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.080+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1853558216 0 0) 0x7fa9fc0012c0 con 0x7faa14142e00 2019-11-28T11:54:06.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.080+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa9f80033c0 con 0x7faa14142e00 2019-11-28T11:54:06.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.080+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fa9fc001870 con 0x7faa14142e00 2019-11-28T11:54:06.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.080+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa1412aaf0 msgr2=0x7faa1410ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:06.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa117fa700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa1412aaf0 0x7faa1410ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:06.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 >> v1:172.21.15.174:6789/0 conn(0x7faa14142a10 legacy=0x7faa1410fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:06.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 >> v1:172.21.15.80:6789/0 conn(0x7faa14142e00 legacy=0x7faa1412a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:06.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa117fa700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9f8005d40 0x7fa9f8006130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:06.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa117fa700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f80046f0 0x7fa9f8004b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:06.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa117fa700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9f80051c0 0x7fa9f80032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:06.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f80039d0 con 0x7fa9f80046f0 2019-11-28T11:54:06.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f8003c00 con 0x7fa9f80051c0 2019-11-28T11:54:06.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f8003e30 con 0x7fa9f8005d40 2019-11-28T11:54:06.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa188fc700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa1412aaf0 0x7faa1410ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:06.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa0bfff700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f80046f0 0x7fa9f8004b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:06.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa13fff700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9f8005d40 0x7fa9f8006130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:06.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa188fc700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9f80051c0 0x7fa9f80032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:06.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa0bfff700 1 -- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9f8005d40 msgr2=0x7fa9f8006130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:06.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa0bfff700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9f8005d40 0x7fa9f8006130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:06.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa0bfff700 1 -- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9f80051c0 msgr2=0x7fa9f80032e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:06.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa0bfff700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9f80051c0 0x7fa9f80032e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:06.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa0bfff700 1 -- 172.21.15.80:0/2372413557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f80040e0 con 0x7fa9f80046f0 2019-11-28T11:54:06.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa188fc700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9f80051c0 0x7fa9f80032e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:06.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa19b5e700 1 -- 172.21.15.80:0/2372413557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1413b3b0 con 0x7fa9f80046f0 2019-11-28T11:54:06.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa0bfff700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f80046f0 0x7fa9f8004b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa9fc010410 tx=0x7fa9fc010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa19b5e700 1 -- 172.21.15.80:0/2372413557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa141399f0 con 0x7fa9f80046f0 2019-11-28T11:54:06.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa0bfff700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f80046f0 0x7fa9f8004b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa9fc010410 tx=0x7fa9fc010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa0bfff700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f80046f0 0x7fa9f8004b70 secure :-1 s=READY pgs=2499 cs=0 l=1 rx=0x7fa9fc010410 tx=0x7fa9fc010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:06.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa0bfff700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f80046f0 0x7fa9f8004b70 secure :-1 s=THROTTLE_DONE pgs=2499 cs=0 l=1 rx=0x7fa9fc010410 tx=0x7fa9fc010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9fc001a90 con 0x7fa9f80046f0 2019-11-28T11:54:06.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa0bfff700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f80046f0 0x7fa9f8004b70 secure :-1 s=THROTTLE_DONE pgs=2499 cs=0 l=1 rx=0x7fa9fc010410 tx=0x7fa9fc010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa0bfff700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f80046f0 0x7fa9f8004b70 secure :-1 s=THROTTLE_DONE pgs=2499 cs=0 l=1 rx=0x7fa9fc010410 tx=0x7fa9fc010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc001a90 con 0x7fa9f80046f0 2019-11-28T11:54:06.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.081+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9fc0045e0 con 0x7fa9f80046f0 2019-11-28T11:54:06.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.082+0000 7faa0bfff700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f80046f0 0x7fa9f8004b70 secure :-1 s=THROTTLE_DONE pgs=2499 cs=0 l=1 rx=0x7fa9fc010410 tx=0x7fa9fc010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.082+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa9fc004200 con 0x7fa9f80046f0 2019-11-28T11:54:06.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.082+0000 7faa0bfff700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f80046f0 0x7fa9f8004b70 secure :-1 s=THROTTLE_DONE pgs=2499 cs=0 l=1 rx=0x7fa9fc010410 tx=0x7fa9fc010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.082+0000 7faa117fa700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa9f8020bf0 0x7fa9f8023020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:06.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.082+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa9fc031c30 con 0x7fa9f80046f0 2019-11-28T11:54:06.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.082+0000 7faa13fff700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa9f8020bf0 0x7fa9f8023020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:06.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.082+0000 7faa13fff700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa9f8020bf0 0x7fa9f8023020 crc :-1 s=READY pgs=1029 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:06.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.090+0000 7faa19b5e700 1 -- 172.21.15.80:0/2372413557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9ec002e60 con 0x7fa9f80046f0 2019-11-28T11:54:06.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.093+0000 7faa0bfff700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f80046f0 0x7fa9f8004b70 secure :-1 s=THROTTLE_DONE pgs=2499 cs=0 l=1 rx=0x7fa9fc010410 tx=0x7fa9fc010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.093+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa9fc001a90 con 0x7fa9f80046f0 2019-11-28T11:54:06.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.264+0000 7faa19b5e700 1 -- 172.21.15.80:0/2372413557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9ec001d10 con 0x7fa9f80046f0 2019-11-28T11:54:06.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.265+0000 7faa0bfff700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f80046f0 0x7fa9f8004b70 secure :-1 s=THROTTLE_DONE pgs=2499 cs=0 l=1 rx=0x7fa9fc010410 tx=0x7fa9fc010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.265+0000 7faa117fa700 1 -- 172.21.15.80:0/2372413557 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) v1 ==== 95+0+2454 (secure 0 0 0) 0x7fa9fc001a90 con 0x7fa9f80046f0 2019-11-28T11:54:06.322 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 153 2019-11-28T11:54:06.322 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:06.322 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":153,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":11286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/867823380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":867823380},{"type":"v1","addr":"172.21.15.174:6835","nonce":867823380}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":151},{"gid":11301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/1741196077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1741196077},{"type":"v1","addr":"172.21.15.80:6833","nonce":1741196077}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":151}],"filesystems":[{"mdsmap":{"epoch":153,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:53:57.302329+0000","modified":"2019-11-28T11:54:04.996007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7541},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7541":{"gid":7541,"name":"b","rank":0,"incarnation":152,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6835/3753292454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3753292454},{"type":"v1","addr":"172.21.15.80:6835","nonce":3753292454}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2019-11-28T11:54:06.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.268+0000 7faa19b5e700 1 -- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa9f8020bf0 msgr2=0x7fa9f8023020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:06.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.268+0000 7faa19b5e700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa9f8020bf0 0x7fa9f8023020 crc :-1 s=READY pgs=1029 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:06.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.268+0000 7faa19b5e700 1 -- 172.21.15.80:0/2372413557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f80046f0 msgr2=0x7fa9f8004b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:06.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.268+0000 7faa19b5e700 1 --2- 172.21.15.80:0/2372413557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa9f80046f0 0x7fa9f8004b70 secure :-1 s=READY pgs=2499 cs=0 l=1 rx=0x7fa9fc010410 tx=0x7fa9fc010290).stop 2019-11-28T11:54:06.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.268+0000 7faa188fc700 1 -- 172.21.15.80:0/2372413557 reap_dead start 2019-11-28T11:54:06.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.268+0000 7faa188fc700 1 -- 172.21.15.80:0/2372413557 reap_dead start 2019-11-28T11:54:06.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.268+0000 7faa19b5e700 1 -- 172.21.15.80:0/2372413557 shutdown_connections 2019-11-28T11:54:06.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.268+0000 7faa19b5e700 1 -- 172.21.15.80:0/2372413557 shutdown_connections 2019-11-28T11:54:06.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.268+0000 7faa19b5e700 1 -- 172.21.15.80:0/2372413557 wait complete. 2019-11-28T11:54:06.325 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.268+0000 7faa19b5e700 1 -- 172.21.15.80:0/2372413557 >> 172.21.15.80:0/2372413557 conn(0x7faa1407c680 msgr2=0x7faa14112150 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:06.639 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7541}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 30, u'failed': [], u'epoch': 153, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [31], u'info': {u'gid_7541': {u'export_targets': [], u'name': u'b', u'incarnation': 152, u'state_seq': 3, u'state': u'up:active', u'gid': 7541, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3753292454, u'type': u'v2', u'addr': u'172.21.15.80:6834'}, {u'nonce': 3753292454, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/3753292454'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:53:57.302329+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:54:04.996007+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:54:06.639 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:54:06.640 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-11-28T11:54:06.766 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:54:06.766 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:54:06.766 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T11:54:06.767 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 7541, 2019-11-28T11:54:06.767 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2019-11-28T11:54:06.767 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2019-11-28T11:54:06.767 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 2.7140830199999999, 2019-11-28T11:54:06.767 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 153, 2019-11-28T11:54:06.767 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 190, 2019-11-28T11:54:06.767 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 190, 2019-11-28T11:54:06.768 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 6.9268707579999997 2019-11-28T11:54:06.768 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:54:06.771 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7541, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.7140830199999999, "mdsmap_epoch": 153, "osdmap_epoch": 190, "osdmap_epoch_barrier": 190, "uptime": 6.9268707579999997 } 2019-11-28T11:54:06.772 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:54:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.836+0000 7f707024b700 1 Processor -- start 2019-11-28T11:54:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.836+0000 7f707024b700 1 -- start start 2019-11-28T11:54:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.837+0000 7f707024b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f706806c490 0x7f706806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.837+0000 7f707024b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f706806ce60 0x7f7068164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.837+0000 7f707024b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706806db00 con 0x7f706806c0a0 2019-11-28T11:54:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.837+0000 7f707024b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706806fd60 con 0x7f706806c490 2019-11-28T11:54:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.837+0000 7f707024b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7068070030 con 0x7f706806ce60 2019-11-28T11:54:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.837+0000 7f706e7e8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f706806c0a0 0x7f7068072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44064/0 (socket says 172.21.15.80:44064) 2019-11-28T11:54:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.837+0000 7f706e7e8700 1 -- 172.21.15.80:0/1713586840 learned_addr learned my addr 172.21.15.80:0/1713586840 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.837+0000 7f706efe9700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f706806ce60 0x7f7068164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.837+0000 7f706dfe7700 1 --2- 172.21.15.80:0/1713586840 >> v2:172.21.15.174:3300/0 conn(0x7f706806c490 0x7f706806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.837+0000 7f706d7e6700 1 -- 172.21.15.80:0/1713586840 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413382238 0 0) 0x7f705c0014d0 con 0x7f706806c0a0 2019-11-28T11:54:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 -- 172.21.15.80:0/1713586840 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7058002e80 con 0x7f706806c0a0 2019-11-28T11:54:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 -- 172.21.15.80:0/1713586840 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3235000615 0 0) 0x7f705c0014b0 con 0x7f706806c0a0 2019-11-28T11:54:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 -- 172.21.15.80:0/1713586840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f706806ce60 msgr2=0x7f7068164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f706806ce60 0x7f7068164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 -- 172.21.15.80:0/1713586840 >> v2:172.21.15.174:3300/0 conn(0x7f706806c490 msgr2=0x7f706806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:06.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 --2- 172.21.15.80:0/1713586840 >> v2:172.21.15.174:3300/0 conn(0x7f706806c490 0x7f706806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:06.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 -- 172.21.15.80:0/1713586840 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70680706c0 con 0x7f706806c0a0 2019-11-28T11:54:06.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 -- 172.21.15.80:0/1713586840 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f705c0019e0 con 0x7f706806c0a0 2019-11-28T11:54:06.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 -- 172.21.15.80:0/1713586840 >> v1:172.21.15.80:6789/0 conn(0x7f706806c0a0 legacy=0x7f7068072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:06.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70580479e0 0x7f7058049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:06.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f705804a5c0 0x7f705804ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:06.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f705804d270 0x7f705804f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:06.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 -- 172.21.15.80:0/1713586840 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705804ff50 con 0x7f705804a5c0 2019-11-28T11:54:06.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 -- 172.21.15.80:0/1713586840 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7058050140 con 0x7f705804d270 2019-11-28T11:54:06.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 -- 172.21.15.80:0/1713586840 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7058050370 con 0x7f70580479e0 2019-11-28T11:54:06.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706dfe7700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f705804a5c0 0x7f705804ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:06.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706e7e8700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70580479e0 0x7f7058049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:06.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706efe9700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f705804d270 0x7f705804f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:06.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706dfe7700 1 -- 172.21.15.80:0/1713586840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70580479e0 msgr2=0x7f7058049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706dfe7700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70580479e0 0x7f7058049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706dfe7700 1 -- 172.21.15.80:0/1713586840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f705804d270 msgr2=0x7f705804f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706dfe7700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f705804d270 0x7f705804f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706dfe7700 1 -- 172.21.15.80:0/1713586840 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7058050620 con 0x7f705804a5c0 2019-11-28T11:54:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706e7e8700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f70580479e0 0x7f7058049e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706efe9700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f705804d270 0x7f705804f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706dfe7700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f705804a5c0 0x7f705804ca70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f705400b6e0 tx=0x7f705400ba80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706dfe7700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f705804a5c0 0x7f705804ca70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f705400b6e0 tx=0x7f705400ba80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706dfe7700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f705804a5c0 0x7f705804ca70 secure :-1 s=READY pgs=2501 cs=0 l=1 rx=0x7f705400b6e0 tx=0x7f705400ba80).ready entity=mon.0 client_cookie=4076195a111daabc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706dfe7700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f705804a5c0 0x7f705804ca70 secure :-1 s=THROTTLE_DONE pgs=2501 cs=0 l=1 rx=0x7f705400b6e0 tx=0x7f705400ba80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706dfe7700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f705804a5c0 0x7f705804ca70 secure :-1 s=THROTTLE_DONE pgs=2501 cs=0 l=1 rx=0x7f705400b6e0 tx=0x7f705400ba80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 -- 172.21.15.80:0/1713586840 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7054000960 con 0x7f705804a5c0 2019-11-28T11:54:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706dfe7700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f705804a5c0 0x7f705804ca70 secure :-1 s=THROTTLE_DONE pgs=2501 cs=0 l=1 rx=0x7f705400b6e0 tx=0x7f705400ba80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.838+0000 7f706d7e6700 1 -- 172.21.15.80:0/1713586840 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7054009980 con 0x7f705804a5c0 2019-11-28T11:54:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.839+0000 7f706d7e6700 1 -- 172.21.15.80:0/1713586840 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f705400a010 con 0x7f705804a5c0 2019-11-28T11:54:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.839+0000 7f707024b700 1 -- 172.21.15.80:0/1713586840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f705804a5c0 msgr2=0x7f705804ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.839+0000 7f707024b700 1 --2- 172.21.15.80:0/1713586840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f705804a5c0 0x7f705804ca70 secure :-1 s=READY pgs=2501 cs=0 l=1 rx=0x7f705400b6e0 tx=0x7f705400ba80).stop 2019-11-28T11:54:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.839+0000 7f706efe9700 1 -- 172.21.15.80:0/1713586840 reap_dead start 2019-11-28T11:54:06.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.839+0000 7f707024b700 1 -- 172.21.15.80:0/1713586840 shutdown_connections 2019-11-28T11:54:06.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.839+0000 7f707024b700 1 -- 172.21.15.80:0/1713586840 shutdown_connections 2019-11-28T11:54:06.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.839+0000 7f707024b700 1 -- 172.21.15.80:0/1713586840 wait complete. 2019-11-28T11:54:06.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.839+0000 7f707024b700 1 -- 172.21.15.80:0/1713586840 >> 172.21.15.80:0/1713586840 conn(0x7f7068061cf0 msgr2=0x7f7068064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:06.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.842+0000 7f707024b700 1 Processor -- start 2019-11-28T11:54:06.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.842+0000 7f707024b700 1 -- start start 2019-11-28T11:54:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.843+0000 7f707024b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7068104480 0x7f7068104910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.843+0000 7f707024b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7068104e50 0x7f7068079980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.843+0000 7f707024b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7068110bc0 con 0x7f7068110620 2019-11-28T11:54:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.843+0000 7f707024b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70681026b0 con 0x7f7068104e50 2019-11-28T11:54:06.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.843+0000 7f707024b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706807be70 con 0x7f7068104480 2019-11-28T11:54:06.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.843+0000 7f706efe9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7068104e50 0x7f7068079980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:06.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.843+0000 7f706dfe7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7068104480 0x7f7068104910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:06.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.843+0000 7f706efe9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7068104e50 0x7f7068079980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:59650/0 (socket says 172.21.15.80:59650) 2019-11-28T11:54:06.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.843+0000 7f706efe9700 1 -- 172.21.15.80:0/76687306 learned_addr learned my addr 172.21.15.80:0/76687306 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:06.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.843+0000 7f706dfe7700 1 -- 172.21.15.80:0/76687306 >> v2:172.21.15.174:3300/0 conn(0x7f7068104e50 msgr2=0x7f7068079980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:06.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.843+0000 7f706dfe7700 1 --2- 172.21.15.80:0/76687306 >> v2:172.21.15.174:3300/0 conn(0x7f7068104e50 0x7f7068079980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.843+0000 7f706dfe7700 1 -- 172.21.15.80:0/76687306 >> v1:172.21.15.174:6789/0 conn(0x7f7068110620 legacy=0x7f7068105600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.843+0000 7f706dfe7700 1 -- 172.21.15.80:0/76687306 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7068102d40 con 0x7f7068104480 2019-11-28T11:54:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.843+0000 7f706efe9700 1 --2- 172.21.15.80:0/76687306 >> v2:172.21.15.174:3300/0 conn(0x7f7068104e50 0x7f7068079980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.843+0000 7f706dfe7700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7068104480 0x7f7068104910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f70540103a0 tx=0x7f7054010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.844+0000 7f706dfe7700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7068104480 0x7f7068104910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f70540103a0 tx=0x7f7054010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.844+0000 7f706dfe7700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7068104480 0x7f7068104910 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7f70540103a0 tx=0x7f7054010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.844+0000 7f706dfe7700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7068104480 0x7f7068104910 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f70540103a0 tx=0x7f7054010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.844+0000 7f7066ffd700 1 -- 172.21.15.80:0/76687306 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f705400b270 con 0x7f7068104480 2019-11-28T11:54:06.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.844+0000 7f706dfe7700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7068104480 0x7f7068104910 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f70540103a0 tx=0x7f7054010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.844+0000 7f706dfe7700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7068104480 0x7f7068104910 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f70540103a0 tx=0x7f7054010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.844+0000 7f7066ffd700 1 -- 172.21.15.80:0/76687306 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7054009790 con 0x7f7068104480 2019-11-28T11:54:06.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.844+0000 7f7066ffd700 1 -- 172.21.15.80:0/76687306 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7054009de0 con 0x7f7068104480 2019-11-28T11:54:06.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.844+0000 7f707024b700 1 -- 172.21.15.80:0/76687306 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70681030c0 con 0x7f7068104480 2019-11-28T11:54:06.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.844+0000 7f707024b700 1 -- 172.21.15.80:0/76687306 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706807c140 con 0x7f7068104480 2019-11-28T11:54:06.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.844+0000 7f706dfe7700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7068104480 0x7f7068104910 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f70540103a0 tx=0x7f7054010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.844+0000 7f7066ffd700 1 -- 172.21.15.80:0/76687306 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7054009980 con 0x7f7068104480 2019-11-28T11:54:06.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.844+0000 7f706dfe7700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7068104480 0x7f7068104910 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f70540103a0 tx=0x7f7054010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.845+0000 7f7066ffd700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7050018730 0x7f705001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:06.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.845+0000 7f7066ffd700 1 -- 172.21.15.80:0/76687306 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7054031a00 con 0x7f7068104480 2019-11-28T11:54:06.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.845+0000 7f706e7e8700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7050018730 0x7f705001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:06.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.845+0000 7f706e7e8700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7050018730 0x7f705001abc0 crc :-1 s=READY pgs=1030 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:06.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.851+0000 7f707024b700 1 -- 172.21.15.80:0/76687306 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7068101e80 con 0x7f7068104480 2019-11-28T11:54:06.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.855+0000 7f706dfe7700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7068104480 0x7f7068104910 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f70540103a0 tx=0x7f7054010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:06.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:06.856+0000 7f7066ffd700 1 -- 172.21.15.80:0/76687306 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7054009580 con 0x7f7068104480 2019-11-28T11:54:07.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.033+0000 7f707024b700 1 -- 172.21.15.80:0/76687306 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7068102d40 con 0x7f7068104480 2019-11-28T11:54:07.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.034+0000 7f706dfe7700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7068104480 0x7f7068104910 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f70540103a0 tx=0x7f7054010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.034+0000 7f7066ffd700 1 -- 172.21.15.80:0/76687306 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f7054009980 con 0x7f7068104480 2019-11-28T11:54:07.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.036+0000 7f707024b700 1 -- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7050018730 msgr2=0x7f705001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.036+0000 7f707024b700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7050018730 0x7f705001abc0 crc :-1 s=READY pgs=1030 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.036+0000 7f707024b700 1 -- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7068104480 msgr2=0x7f7068104910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.036+0000 7f707024b700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7068104480 0x7f7068104910 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7f70540103a0 tx=0x7f7054010740).stop 2019-11-28T11:54:07.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.036+0000 7f707024b700 1 -- 172.21.15.80:0/76687306 shutdown_connections 2019-11-28T11:54:07.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.036+0000 7f707024b700 1 --2- 172.21.15.80:0/76687306 >> v2:172.21.15.174:3300/0 conn(0x7f7068104e50 0x7f7068079980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.036+0000 7f707024b700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7068104480 0x7f7068104910 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.036+0000 7f707024b700 1 --2- 172.21.15.80:0/76687306 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7050018730 0x7f705001abc0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.036+0000 7f707024b700 1 -- 172.21.15.80:0/76687306 shutdown_connections 2019-11-28T11:54:07.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.036+0000 7f707024b700 1 -- 172.21.15.80:0/76687306 wait complete. 2019-11-28T11:54:07.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.036+0000 7f707024b700 1 -- 172.21.15.80:0/76687306 >> 172.21.15.80:0/76687306 conn(0x7f7068122580 msgr2=0x7f7068122970 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:07.096 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:07.096 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":190,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:53:58.303811+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:53:55.640729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":31,"pool_name":"cephfs_data","create_time":"2019-11-28T11:53:56.329039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:54:07.102 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:53:55.640729+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 30, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'189', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:53:56.329039+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 31, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'190', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:54:07.102 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:54:07.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.171+0000 7f991daf4700 1 Processor -- start 2019-11-28T11:54:07.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.171+0000 7f991daf4700 1 -- start start 2019-11-28T11:54:07.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.171+0000 7f991daf4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f991815ed10 0x7f991815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:07.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f991daf4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991806db60 con 0x7f99180734b0 2019-11-28T11:54:07.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f991daf4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991806e060 con 0x7f9918073020 2019-11-28T11:54:07.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f991daf4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991806fe00 con 0x7f991815ed10 2019-11-28T11:54:07.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f991c892700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f99180734b0 0x7f99180726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44088/0 (socket says 172.21.15.80:44088) 2019-11-28T11:54:07.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f991c892700 1 -- 172.21.15.80:0/2499185317 learned_addr learned my addr 172.21.15.80:0/2499185317 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:07.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f9917fff700 1 --2- 172.21.15.80:0/2499185317 >> v2:172.21.15.174:3300/0 conn(0x7f991815ed10 0x7f991815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f99177fe700 1 -- 172.21.15.80:0/2499185317 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930368454 0 0) 0x7f99100014d0 con 0x7f99180734b0 2019-11-28T11:54:07.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f99177fe700 1 -- 172.21.15.80:0/2499185317 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9904002e80 con 0x7f99180734b0 2019-11-28T11:54:07.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f99177fe700 1 -- 172.21.15.80:0/2499185317 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 198369939 0 0) 0x7f99100014b0 con 0x7f99180734b0 2019-11-28T11:54:07.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f99177fe700 1 -- 172.21.15.80:0/2499185317 >> v2:172.21.15.174:3300/0 conn(0x7f991815ed10 msgr2=0x7f991815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:07.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f99177fe700 1 --2- 172.21.15.80:0/2499185317 >> v2:172.21.15.174:3300/0 conn(0x7f991815ed10 0x7f991815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:07.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f99177fe700 1 -- 172.21.15.80:0/2499185317 >> v1:172.21.15.174:6789/0 conn(0x7f9918073020 legacy=0x7f9918071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f99177fe700 1 -- 172.21.15.80:0/2499185317 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9918070760 con 0x7f99180734b0 2019-11-28T11:54:07.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f99177fe700 1 -- 172.21.15.80:0/2499185317 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f99100019e0 con 0x7f99180734b0 2019-11-28T11:54:07.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f99177fe700 1 -- 172.21.15.80:0/2499185317 >> v1:172.21.15.80:6789/0 conn(0x7f99180734b0 legacy=0x7f99180726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f99177fe700 1 --2- 172.21.15.80:0/2499185317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9904003ab0 0x7f9904005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:07.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f99177fe700 1 --2- 172.21.15.80:0/2499185317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9904006690 0x7f9904008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:07.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f99177fe700 1 --2- 172.21.15.80:0/2499185317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9904009380 0x7f990400b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:07.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f99177fe700 1 -- 172.21.15.80:0/2499185317 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990400c000 con 0x7f9904009380 2019-11-28T11:54:07.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f99177fe700 1 -- 172.21.15.80:0/2499185317 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9904050200 con 0x7f9904006690 2019-11-28T11:54:07.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f99177fe700 1 -- 172.21.15.80:0/2499185317 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9904050430 con 0x7f9904003ab0 2019-11-28T11:54:07.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f991c892700 1 --2- 172.21.15.80:0/2499185317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9904009380 0x7f990400b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.172+0000 7f990ffff700 1 --2- 172.21.15.80:0/2499185317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9904006690 0x7f9904008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f9917fff700 1 --2- 172.21.15.80:0/2499185317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9904003ab0 0x7f9904005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f991c892700 1 -- 172.21.15.80:0/2499185317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9904003ab0 msgr2=0x7f9904005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:07.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f991c892700 1 --2- 172.21.15.80:0/2499185317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9904003ab0 0x7f9904005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:07.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f991c892700 1 -- 172.21.15.80:0/2499185317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9904006690 msgr2=0x7f9904008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:07.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f991c892700 1 --2- 172.21.15.80:0/2499185317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9904006690 0x7f9904008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:07.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f991c892700 1 -- 172.21.15.80:0/2499185317 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99040506e0 con 0x7f9904009380 2019-11-28T11:54:07.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f991c892700 1 --2- 172.21.15.80:0/2499185317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9904009380 0x7f990400b850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f991000fbe0 tx=0x7f991000fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f991c892700 1 -- 172.21.15.80:0/2499185317 reap_dead start 2019-11-28T11:54:07.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f991c892700 1 --2- 172.21.15.80:0/2499185317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9904009380 0x7f990400b850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f991000fbe0 tx=0x7f991000fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f991c892700 1 --2- 172.21.15.80:0/2499185317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9904009380 0x7f990400b850 secure :-1 s=READY pgs=2503 cs=0 l=1 rx=0x7f991000fbe0 tx=0x7f991000fb10).ready entity=mon.0 client_cookie=eb66c113a0848dbc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:07.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f991c892700 1 --2- 172.21.15.80:0/2499185317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9904009380 0x7f990400b850 secure :-1 s=THROTTLE_DONE pgs=2503 cs=0 l=1 rx=0x7f991000fbe0 tx=0x7f991000fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f991c892700 1 --2- 172.21.15.80:0/2499185317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9904009380 0x7f990400b850 secure :-1 s=THROTTLE_DONE pgs=2503 cs=0 l=1 rx=0x7f991000fbe0 tx=0x7f991000fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f99177fe700 1 -- 172.21.15.80:0/2499185317 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9910000da0 con 0x7f9904009380 2019-11-28T11:54:07.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f991c892700 1 --2- 172.21.15.80:0/2499185317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9904009380 0x7f990400b850 secure :-1 s=THROTTLE_DONE pgs=2503 cs=0 l=1 rx=0x7f991000fbe0 tx=0x7f991000fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f99177fe700 1 -- 172.21.15.80:0/2499185317 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99100045c0 con 0x7f9904009380 2019-11-28T11:54:07.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f99177fe700 1 -- 172.21.15.80:0/2499185317 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9910004d10 con 0x7f9904009380 2019-11-28T11:54:07.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f991daf4700 1 -- 172.21.15.80:0/2499185317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9904009380 msgr2=0x7f990400b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.173+0000 7f991daf4700 1 --2- 172.21.15.80:0/2499185317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9904009380 0x7f990400b850 secure :-1 s=READY pgs=2503 cs=0 l=1 rx=0x7f991000fbe0 tx=0x7f991000fb10).stop 2019-11-28T11:54:07.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.174+0000 7f991daf4700 1 -- 172.21.15.80:0/2499185317 shutdown_connections 2019-11-28T11:54:07.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.174+0000 7f991daf4700 1 --2- 172.21.15.80:0/2499185317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9904009380 0x7f990400b850 unknown :-1 s=CLOSED pgs=2503 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.174+0000 7f991daf4700 1 -- 172.21.15.80:0/2499185317 shutdown_connections 2019-11-28T11:54:07.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.174+0000 7f991daf4700 1 -- 172.21.15.80:0/2499185317 wait complete. 2019-11-28T11:54:07.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.174+0000 7f991daf4700 1 -- 172.21.15.80:0/2499185317 >> 172.21.15.80:0/2499185317 conn(0x7f9918061d20 msgr2=0x7f99180641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:07.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.176+0000 7f991daf4700 1 Processor -- start 2019-11-28T11:54:07.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.176+0000 7f991daf4700 1 -- start start 2019-11-28T11:54:07.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f991daf4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9918108630 0x7f9918152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:07.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f991daf4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99181527a0 0x7f991812c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:07.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f991daf4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991810a310 con 0x7f991812c7e0 2019-11-28T11:54:07.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f991daf4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991812ee80 con 0x7f9918108630 2019-11-28T11:54:07.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f991daf4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99181329f0 con 0x7f99181527a0 2019-11-28T11:54:07.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f9917fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9918108630 0x7f9918152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f9917fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9918108630 0x7f9918152260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44782/0 (socket says 172.21.15.80:44782) 2019-11-28T11:54:07.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f9917fff700 1 -- 172.21.15.80:0/3265989097 learned_addr learned my addr 172.21.15.80:0/3265989097 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:07.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f991c892700 1 --1- 172.21.15.80:0/3265989097 >> v1:172.21.15.80:6789/0 conn(0x7f991812c7e0 0x7f991814b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44100/0 (socket says 172.21.15.80:44100) 2019-11-28T11:54:07.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f990ffff700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99181527a0 0x7f991812c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f9917fff700 1 -- 172.21.15.80:0/3265989097 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99181527a0 msgr2=0x7f991812c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f9917fff700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99181527a0 0x7f991812c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f9917fff700 1 -- 172.21.15.80:0/3265989097 >> v1:172.21.15.80:6789/0 conn(0x7f991812c7e0 legacy=0x7f991814b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f99157fa700 1 -- 172.21.15.80:0/3265989097 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319674541 0 0) 0x7f9910000ed0 con 0x7f991812c7e0 2019-11-28T11:54:07.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f9917fff700 1 -- 172.21.15.80:0/3265989097 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9918133350 con 0x7f9918108630 2019-11-28T11:54:07.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f990ffff700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99181527a0 0x7f991812c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:07.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f9917fff700 1 --2- 172.21.15.80:0/3265989097 >> v2:172.21.15.80:3300/0 conn(0x7f9918108630 0x7f9918152260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9908010440 tx=0x7f99080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.177+0000 7f9917fff700 1 --2- 172.21.15.80:0/3265989097 >> v2:172.21.15.80:3300/0 conn(0x7f9918108630 0x7f9918152260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9908010440 tx=0x7f99080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.178+0000 7f9917fff700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9918108630 0x7f9918152260 secure :-1 s=READY pgs=2505 cs=0 l=1 rx=0x7f9908010440 tx=0x7f99080107e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:07.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.178+0000 7f9917fff700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9918108630 0x7f9918152260 secure :-1 s=THROTTLE_DONE pgs=2505 cs=0 l=1 rx=0x7f9908010440 tx=0x7f99080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.178+0000 7f99157fa700 1 -- 172.21.15.80:0/3265989097 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9908005770 con 0x7f9918108630 2019-11-28T11:54:07.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.178+0000 7f9917fff700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9918108630 0x7f9918152260 secure :-1 s=THROTTLE_DONE pgs=2505 cs=0 l=1 rx=0x7f9908010440 tx=0x7f99080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.178+0000 7f9917fff700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9918108630 0x7f9918152260 secure :-1 s=THROTTLE_DONE pgs=2505 cs=0 l=1 rx=0x7f9908010440 tx=0x7f99080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.178+0000 7f99157fa700 1 -- 172.21.15.80:0/3265989097 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9908005390 con 0x7f9918108630 2019-11-28T11:54:07.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.178+0000 7f99157fa700 1 -- 172.21.15.80:0/3265989097 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9908005d50 con 0x7f9918108630 2019-11-28T11:54:07.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.178+0000 7f991daf4700 1 -- 172.21.15.80:0/3265989097 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99181336d0 con 0x7f9918108630 2019-11-28T11:54:07.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.178+0000 7f991daf4700 1 -- 172.21.15.80:0/3265989097 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9918133350 con 0x7f9918108630 2019-11-28T11:54:07.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.178+0000 7f9917fff700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9918108630 0x7f9918152260 secure :-1 s=THROTTLE_DONE pgs=2505 cs=0 l=1 rx=0x7f9908010440 tx=0x7f99080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.178+0000 7f99157fa700 1 -- 172.21.15.80:0/3265989097 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9908005580 con 0x7f9918108630 2019-11-28T11:54:07.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.178+0000 7f9917fff700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9918108630 0x7f9918152260 secure :-1 s=THROTTLE_DONE pgs=2505 cs=0 l=1 rx=0x7f9908010440 tx=0x7f99080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.178+0000 7f99157fa700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f98fc018730 0x7f98fc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:07.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.178+0000 7f99157fa700 1 -- 172.21.15.80:0/3265989097 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9908031ae0 con 0x7f9918108630 2019-11-28T11:54:07.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.179+0000 7f990ffff700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f98fc018730 0x7f98fc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.179+0000 7f990ffff700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f98fc018730 0x7f98fc01abc0 crc :-1 s=READY pgs=1031 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:07.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.186+0000 7f991daf4700 1 -- 172.21.15.80:0/3265989097 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99181336d0 con 0x7f9918108630 2019-11-28T11:54:07.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.189+0000 7f9917fff700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9918108630 0x7f9918152260 secure :-1 s=THROTTLE_DONE pgs=2505 cs=0 l=1 rx=0x7f9908010440 tx=0x7f99080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.189+0000 7f99157fa700 1 -- 172.21.15.80:0/3265989097 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9908005180 con 0x7f9918108630 2019-11-28T11:54:07.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.355+0000 7f991daf4700 1 -- 172.21.15.80:0/3265989097 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f9918133350 con 0x7f9918108630 2019-11-28T11:54:07.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.355+0000 7f9917fff700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9918108630 0x7f9918152260 secure :-1 s=THROTTLE_DONE pgs=2505 cs=0 l=1 rx=0x7f9908010440 tx=0x7f99080107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.355+0000 7f99157fa700 1 -- 172.21.15.80:0/3265989097 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v190) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9908005560 con 0x7f9918108630 2019-11-28T11:54:07.412 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:54:07.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.358+0000 7f991daf4700 1 -- 172.21.15.80:0/3265989097 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f98fc018730 msgr2=0x7f98fc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.358+0000 7f991daf4700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f98fc018730 0x7f98fc01abc0 crc :-1 s=READY pgs=1031 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.358+0000 7f991daf4700 1 -- 172.21.15.80:0/3265989097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9918108630 msgr2=0x7f9918152260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.358+0000 7f991daf4700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9918108630 0x7f9918152260 secure :-1 s=READY pgs=2505 cs=0 l=1 rx=0x7f9908010440 tx=0x7f99080107e0).stop 2019-11-28T11:54:07.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.358+0000 7f991daf4700 1 -- 172.21.15.80:0/3265989097 shutdown_connections 2019-11-28T11:54:07.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.358+0000 7f991daf4700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f98fc018730 0x7f98fc01abc0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.358+0000 7f991daf4700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99181527a0 0x7f991812c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.358+0000 7f991daf4700 1 --2- 172.21.15.80:0/3265989097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9918108630 0x7f9918152260 unknown :-1 s=CLOSED pgs=2505 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.358+0000 7f991daf4700 1 -- 172.21.15.80:0/3265989097 shutdown_connections 2019-11-28T11:54:07.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.358+0000 7f991daf4700 1 -- 172.21.15.80:0/3265989097 wait complete. 2019-11-28T11:54:07.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.358+0000 7f991daf4700 1 -- 172.21.15.80:0/3265989097 >> 172.21.15.80:0/3265989097 conn(0x7f991814dbb0 msgr2=0x7f9918142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:07.423 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:54:07.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.495+0000 7f184c392700 1 Processor -- start 2019-11-28T11:54:07.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.495+0000 7f184c392700 1 -- start start 2019-11-28T11:54:07.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.496+0000 7f184c392700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184415f100 0x7f184406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:07.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.496+0000 7f184c392700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f184406db60 con 0x7f184415ed10 2019-11-28T11:54:07.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.496+0000 7f184c392700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f184406e060 con 0x7f184406c2f0 2019-11-28T11:54:07.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.496+0000 7f184c392700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184406fe00 con 0x7f184415f100 2019-11-28T11:54:07.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.496+0000 7f184a92f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f184415ed10 0x7f1844073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44104/0 (socket says 172.21.15.80:44104) 2019-11-28T11:54:07.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.496+0000 7f184a92f700 1 -- 172.21.15.80:0/1453798695 learned_addr learned my addr 172.21.15.80:0/1453798695 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:07.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.496+0000 7f184a12e700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184415f100 0x7f184406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.496+0000 7f184992d700 1 -- 172.21.15.80:0/1453798695 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133425928 0 0) 0x7f1834001150 con 0x7f184415ed10 2019-11-28T11:54:07.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.496+0000 7f184992d700 1 -- 172.21.15.80:0/1453798695 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1830002e80 con 0x7f184415ed10 2019-11-28T11:54:07.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.496+0000 7f184992d700 1 -- 172.21.15.80:0/1453798695 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867289979 0 0) 0x7f183c001080 con 0x7f184406c2f0 2019-11-28T11:54:07.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.496+0000 7f184992d700 1 -- 172.21.15.80:0/1453798695 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18300030b0 con 0x7f184406c2f0 2019-11-28T11:54:07.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.496+0000 7f184992d700 1 -- 172.21.15.80:0/1453798695 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 726076096 0 0) 0x7f1834001130 con 0x7f184415ed10 2019-11-28T11:54:07.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.496+0000 7f184992d700 1 -- 172.21.15.80:0/1453798695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184415f100 msgr2=0x7f184406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:07.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.496+0000 7f184992d700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184415f100 0x7f184406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:07.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184992d700 1 -- 172.21.15.80:0/1453798695 >> v1:172.21.15.174:6789/0 conn(0x7f184406c2f0 legacy=0x7f184406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184992d700 1 -- 172.21.15.80:0/1453798695 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1844070760 con 0x7f184415ed10 2019-11-28T11:54:07.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184992d700 1 -- 172.21.15.80:0/1453798695 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f1834001660 con 0x7f184415ed10 2019-11-28T11:54:07.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184992d700 1 -- 172.21.15.80:0/1453798695 >> v1:172.21.15.80:6789/0 conn(0x7f184415ed10 legacy=0x7f1844073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184992d700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1830003bd0 0x7f1830006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:07.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184992d700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1830006740 0x7f1830008bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:07.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184a92f700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1830003bd0 0x7f1830006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184992d700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f183004d3c0 0x7f183004f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:07.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184992d700 1 -- 172.21.15.80:0/1453798695 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1830050080 con 0x7f1830003bd0 2019-11-28T11:54:07.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184992d700 1 -- 172.21.15.80:0/1453798695 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18300502b0 con 0x7f183004d3c0 2019-11-28T11:54:07.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184992d700 1 -- 172.21.15.80:0/1453798695 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18300504e0 con 0x7f1830006740 2019-11-28T11:54:07.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184a12e700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f184415f100 0x7f184406bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:07.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184b130700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f183004d3c0 0x7f183004f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184a92f700 1 -- 172.21.15.80:0/1453798695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1830006740 msgr2=0x7f1830008bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:07.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184a92f700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1830006740 0x7f1830008bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:07.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184a92f700 1 -- 172.21.15.80:0/1453798695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f183004d3c0 msgr2=0x7f183004f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:07.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184a92f700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f183004d3c0 0x7f183004f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:07.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184a92f700 1 -- 172.21.15.80:0/1453798695 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1830050790 con 0x7f1830003bd0 2019-11-28T11:54:07.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184b130700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f183004d3c0 0x7f183004f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:07.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184a92f700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1830003bd0 0x7f1830006010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f183400f890 tx=0x7f183400fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184a92f700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1830003bd0 0x7f1830006010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f183400f890 tx=0x7f183400fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184a92f700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1830003bd0 0x7f1830006010 secure :-1 s=READY pgs=2507 cs=0 l=1 rx=0x7f183400f890 tx=0x7f183400fc30).ready entity=mon.0 client_cookie=7f055fd1f797f33d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:07.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184a92f700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1830003bd0 0x7f1830006010 secure :-1 s=THROTTLE_DONE pgs=2507 cs=0 l=1 rx=0x7f183400f890 tx=0x7f183400fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184992d700 1 -- 172.21.15.80:0/1453798695 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1834004240 con 0x7f1830003bd0 2019-11-28T11:54:07.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184a92f700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1830003bd0 0x7f1830006010 secure :-1 s=THROTTLE_DONE pgs=2507 cs=0 l=1 rx=0x7f183400f890 tx=0x7f183400fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184a92f700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1830003bd0 0x7f1830006010 secure :-1 s=THROTTLE_DONE pgs=2507 cs=0 l=1 rx=0x7f183400f890 tx=0x7f183400fc30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184992d700 1 -- 172.21.15.80:0/1453798695 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1834001130 con 0x7f1830003bd0 2019-11-28T11:54:07.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184992d700 1 -- 172.21.15.80:0/1453798695 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1834004240 con 0x7f1830003bd0 2019-11-28T11:54:07.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184c392700 1 -- 172.21.15.80:0/1453798695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1830003bd0 msgr2=0x7f1830006010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184c392700 1 --2- 172.21.15.80:0/1453798695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1830003bd0 0x7f1830006010 secure :-1 s=READY pgs=2507 cs=0 l=1 rx=0x7f183400f890 tx=0x7f183400fc30).stop 2019-11-28T11:54:07.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.497+0000 7f184b130700 1 -- 172.21.15.80:0/1453798695 reap_dead start 2019-11-28T11:54:07.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.498+0000 7f184c392700 1 -- 172.21.15.80:0/1453798695 shutdown_connections 2019-11-28T11:54:07.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.498+0000 7f184c392700 1 -- 172.21.15.80:0/1453798695 shutdown_connections 2019-11-28T11:54:07.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.498+0000 7f184c392700 1 -- 172.21.15.80:0/1453798695 wait complete. 2019-11-28T11:54:07.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.498+0000 7f184c392700 1 -- 172.21.15.80:0/1453798695 >> 172.21.15.80:0/1453798695 conn(0x7f1844061d20 msgr2=0x7f18440641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:07.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.500+0000 7f184c392700 1 Processor -- start 2019-11-28T11:54:07.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.500+0000 7f184c392700 1 -- start start 2019-11-28T11:54:07.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.501+0000 7f184c392700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1844167d80 0x7f184416a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:07.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.501+0000 7f184c392700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18441531f0 con 0x7f184415d820 2019-11-28T11:54:07.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.501+0000 7f184c392700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1844152cd0 con 0x7f1844138e30 2019-11-28T11:54:07.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.501+0000 7f184c392700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18441383e0 con 0x7f1844167d80 2019-11-28T11:54:07.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.501+0000 7f184a92f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f184415d820 0x7f18441395a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44116/0 (socket says 172.21.15.80:44116) 2019-11-28T11:54:07.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.501+0000 7f184a92f700 1 -- 172.21.15.80:0/1784522836 learned_addr learned my addr 172.21.15.80:0/1784522836 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:07.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184b130700 1 --2- 172.21.15.80:0/1784522836 >> v2:172.21.15.174:3300/0 conn(0x7f1844167d80 0x7f184416a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169178759 0 0) 0x7f18340018d0 con 0x7f184415d820 2019-11-28T11:54:07.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f182c002e80 con 0x7f184415d820 2019-11-28T11:54:07.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583014025 0 0) 0x7f18400012b0 con 0x7f1844138e30 2019-11-28T11:54:07.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f182c0030b0 con 0x7f1844138e30 2019-11-28T11:54:07.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1912138407 0 0) 0x7f1834001a40 con 0x7f184415d820 2019-11-28T11:54:07.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f182c0033c0 con 0x7f184415d820 2019-11-28T11:54:07.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f1834000ea0 con 0x7f184415d820 2019-11-28T11:54:07.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 >> v2:172.21.15.174:3300/0 conn(0x7f1844167d80 msgr2=0x7f184416a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 --2- 172.21.15.80:0/1784522836 >> v2:172.21.15.174:3300/0 conn(0x7f1844167d80 0x7f184416a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 >> v1:172.21.15.174:6789/0 conn(0x7f1844138e30 legacy=0x7f1844075620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 >> v1:172.21.15.80:6789/0 conn(0x7f184415d820 legacy=0x7f18441395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f182c005d40 0x7f182c006130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:07.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f182c0046f0 0x7f182c004b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:07.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f182c005120 0x7f182c0032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:07.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c003970 con 0x7f182c0046f0 2019-11-28T11:54:07.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c003ba0 con 0x7f182c005d40 2019-11-28T11:54:07.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182c003dd0 con 0x7f182c005120 2019-11-28T11:54:07.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184a12e700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f182c0046f0 0x7f182c004b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184b130700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f182c005120 0x7f182c0032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184a92f700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f182c005d40 0x7f182c006130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184a12e700 1 -- 172.21.15.80:0/1784522836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f182c005120 msgr2=0x7f182c0032e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184a12e700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f182c005120 0x7f182c0032e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184a12e700 1 -- 172.21.15.80:0/1784522836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f182c005d40 msgr2=0x7f182c006130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184a12e700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f182c005d40 0x7f182c006130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184a12e700 1 -- 172.21.15.80:0/1784522836 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c004080 con 0x7f182c0046f0 2019-11-28T11:54:07.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184c392700 1 -- 172.21.15.80:0/1784522836 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18440742a0 con 0x7f182c0046f0 2019-11-28T11:54:07.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184a12e700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f182c0046f0 0x7f182c004b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18400106e0 tx=0x7f1840010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184a92f700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f182c005d40 0x7f182c006130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:07.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184b130700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f182c005120 0x7f182c0032e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:07.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184b130700 1 -- 172.21.15.80:0/1784522836 reap_dead start 2019-11-28T11:54:07.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184c392700 1 -- 172.21.15.80:0/1784522836 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1844075e20 con 0x7f182c0046f0 2019-11-28T11:54:07.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184a12e700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f182c0046f0 0x7f182c004b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18400106e0 tx=0x7f1840010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184a12e700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f182c0046f0 0x7f182c004b90 secure :-1 s=READY pgs=2509 cs=0 l=1 rx=0x7f18400106e0 tx=0x7f1840010a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:07.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.502+0000 7f184a12e700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f182c0046f0 0x7f182c004b90 secure :-1 s=THROTTLE_DONE pgs=2509 cs=0 l=1 rx=0x7f18400106e0 tx=0x7f1840010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.503+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1840000ce0 con 0x7f182c0046f0 2019-11-28T11:54:07.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.503+0000 7f184a12e700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f182c0046f0 0x7f182c004b90 secure :-1 s=THROTTLE_DONE pgs=2509 cs=0 l=1 rx=0x7f18400106e0 tx=0x7f1840010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.503+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1840000ce0 con 0x7f182c0046f0 2019-11-28T11:54:07.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.503+0000 7f184a12e700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f182c0046f0 0x7f182c004b90 secure :-1 s=THROTTLE_DONE pgs=2509 cs=0 l=1 rx=0x7f18400106e0 tx=0x7f1840010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.503+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1840001600 con 0x7f182c0046f0 2019-11-28T11:54:07.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.503+0000 7f184a12e700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f182c0046f0 0x7f182c004b90 secure :-1 s=THROTTLE_DONE pgs=2509 cs=0 l=1 rx=0x7f18400106e0 tx=0x7f1840010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.503+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1840001220 con 0x7f182c0046f0 2019-11-28T11:54:07.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.503+0000 7f184a12e700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f182c0046f0 0x7f182c004b90 secure :-1 s=THROTTLE_DONE pgs=2509 cs=0 l=1 rx=0x7f18400106e0 tx=0x7f1840010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.503+0000 7f183b7fe700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f182c023c80 0x7f182c026110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:07.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.503+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1840031ee0 con 0x7f182c0046f0 2019-11-28T11:54:07.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.503+0000 7f184a92f700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f182c023c80 0x7f182c026110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.504+0000 7f184a92f700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f182c023c80 0x7f182c026110 crc :-1 s=READY pgs=1032 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:07.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.510+0000 7f184c392700 1 -- 172.21.15.80:0/1784522836 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18440742a0 con 0x7f182c0046f0 2019-11-28T11:54:07.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.513+0000 7f184a12e700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f182c0046f0 0x7f182c004b90 secure :-1 s=THROTTLE_DONE pgs=2509 cs=0 l=1 rx=0x7f18400106e0 tx=0x7f1840010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.513+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1840001010 con 0x7f182c0046f0 2019-11-28T11:54:07.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.680+0000 7f184c392700 1 -- 172.21.15.80:0/1784522836 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f18440742a0 con 0x7f182c0046f0 2019-11-28T11:54:07.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.680+0000 7f184a12e700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f182c0046f0 0x7f182c004b90 secure :-1 s=THROTTLE_DONE pgs=2509 cs=0 l=1 rx=0x7f18400106e0 tx=0x7f1840010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.680+0000 7f183b7fe700 1 -- 172.21.15.80:0/1784522836 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v190) v1 ==== 104+0+10 (secure 0 0 0) 0x7f1840000cc0 con 0x7f182c0046f0 2019-11-28T11:54:07.736 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:54:07.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.683+0000 7f184c392700 1 -- 172.21.15.80:0/1784522836 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f182c023c80 msgr2=0x7f182c026110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.683+0000 7f184c392700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f182c023c80 0x7f182c026110 crc :-1 s=READY pgs=1032 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.683+0000 7f184c392700 1 -- 172.21.15.80:0/1784522836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f182c0046f0 msgr2=0x7f182c004b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.683+0000 7f184c392700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f182c0046f0 0x7f182c004b90 secure :-1 s=READY pgs=2509 cs=0 l=1 rx=0x7f18400106e0 tx=0x7f1840010a80).stop 2019-11-28T11:54:07.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.683+0000 7f184c392700 1 -- 172.21.15.80:0/1784522836 shutdown_connections 2019-11-28T11:54:07.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.683+0000 7f184c392700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f182c023c80 0x7f182c026110 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.683+0000 7f184c392700 1 --2- 172.21.15.80:0/1784522836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f182c0046f0 0x7f182c004b90 unknown :-1 s=CLOSED pgs=2509 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.683+0000 7f184c392700 1 -- 172.21.15.80:0/1784522836 shutdown_connections 2019-11-28T11:54:07.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.683+0000 7f184c392700 1 -- 172.21.15.80:0/1784522836 wait complete. 2019-11-28T11:54:07.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.683+0000 7f184c392700 1 -- 172.21.15.80:0/1784522836 >> 172.21.15.80:0/1784522836 conn(0x7f1844153d90 msgr2=0x7f184414d920 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:07.748 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:54:07.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.817+0000 7fd14430e700 1 Processor -- start 2019-11-28T11:54:07.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.817+0000 7fd14430e700 1 -- start start 2019-11-28T11:54:07.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.818+0000 7fd14430e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c1639f0 0x7fd13c165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:07.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.818+0000 7fd14430e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13c06db60 con 0x7fd13c15ed10 2019-11-28T11:54:07.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.818+0000 7fd14430e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13c06e060 con 0x7fd13c15f100 2019-11-28T11:54:07.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.818+0000 7fd14430e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c06fe00 con 0x7fd13c1639f0 2019-11-28T11:54:07.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.818+0000 7fd1428ab700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd13c15ed10 0x7fd13c073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44130/0 (socket says 172.21.15.80:44130) 2019-11-28T11:54:07.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.818+0000 7fd1428ab700 1 -- 172.21.15.80:0/961291073 learned_addr learned my addr 172.21.15.80:0/961291073 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:07.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1430ac700 1 --2- 172.21.15.80:0/961291073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c1639f0 0x7fd13c165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1418a9700 1 -- 172.21.15.80:0/961291073 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304894107 0 0) 0x7fd1240014d0 con 0x7fd13c15ed10 2019-11-28T11:54:07.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1418a9700 1 -- 172.21.15.80:0/961291073 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd128002e80 con 0x7fd13c15ed10 2019-11-28T11:54:07.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1418a9700 1 -- 172.21.15.80:0/961291073 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238754637 0 0) 0x7fd12c001080 con 0x7fd13c15f100 2019-11-28T11:54:07.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1418a9700 1 -- 172.21.15.80:0/961291073 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1280030b0 con 0x7fd13c15f100 2019-11-28T11:54:07.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1418a9700 1 -- 172.21.15.80:0/961291073 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3098472993 0 0) 0x7fd1240014b0 con 0x7fd13c15ed10 2019-11-28T11:54:07.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1430ac700 1 -- 172.21.15.80:0/961291073 >> v1:172.21.15.174:6789/0 conn(0x7fd13c15f100 legacy=0x7fd13c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1430ac700 1 -- 172.21.15.80:0/961291073 >> v1:172.21.15.80:6789/0 conn(0x7fd13c15ed10 legacy=0x7fd13c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1430ac700 1 -- 172.21.15.80:0/961291073 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c070760 con 0x7fd13c1639f0 2019-11-28T11:54:07.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1430ac700 1 --2- 172.21.15.80:0/961291073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c1639f0 0x7fd13c165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd13400af80 tx=0x7fd13400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1430ac700 1 --2- 172.21.15.80:0/961291073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c1639f0 0x7fd13c165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd13400af80 tx=0x7fd13400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1430ac700 1 --2- 172.21.15.80:0/961291073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c1639f0 0x7fd13c165df0 secure :-1 s=READY pgs=358 cs=0 l=1 rx=0x7fd13400af80 tx=0x7fd13400b790).ready entity=mon.2 client_cookie=79827bb165055ab1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:07.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1430ac700 1 --2- 172.21.15.80:0/961291073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c1639f0 0x7fd13c165df0 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7fd13400af80 tx=0x7fd13400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1418a9700 1 -- 172.21.15.80:0/961291073 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd134007240 con 0x7fd13c1639f0 2019-11-28T11:54:07.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1430ac700 1 --2- 172.21.15.80:0/961291073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c1639f0 0x7fd13c165df0 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7fd13400af80 tx=0x7fd13400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1430ac700 1 --2- 172.21.15.80:0/961291073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c1639f0 0x7fd13c165df0 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7fd13400af80 tx=0x7fd13400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1418a9700 1 -- 172.21.15.80:0/961291073 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd134000bb0 con 0x7fd13c1639f0 2019-11-28T11:54:07.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd1418a9700 1 -- 172.21.15.80:0/961291073 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd134009bd0 con 0x7fd13c1639f0 2019-11-28T11:54:07.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd14430e700 1 -- 172.21.15.80:0/961291073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c1639f0 msgr2=0x7fd13c165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.819+0000 7fd14430e700 1 --2- 172.21.15.80:0/961291073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c1639f0 0x7fd13c165df0 secure :-1 s=READY pgs=358 cs=0 l=1 rx=0x7fd13400af80 tx=0x7fd13400b790).stop 2019-11-28T11:54:07.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.820+0000 7fd14430e700 1 -- 172.21.15.80:0/961291073 shutdown_connections 2019-11-28T11:54:07.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.820+0000 7fd14430e700 1 --2- 172.21.15.80:0/961291073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c1639f0 0x7fd13c165df0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.820+0000 7fd14430e700 1 -- 172.21.15.80:0/961291073 shutdown_connections 2019-11-28T11:54:07.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.820+0000 7fd14430e700 1 -- 172.21.15.80:0/961291073 wait complete. 2019-11-28T11:54:07.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.820+0000 7fd14430e700 1 -- 172.21.15.80:0/961291073 >> 172.21.15.80:0/961291073 conn(0x7fd13c061d20 msgr2=0x7fd13c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:07.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.823+0000 7fd14430e700 1 Processor -- start 2019-11-28T11:54:07.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.823+0000 7fd14430e700 1 -- start start 2019-11-28T11:54:07.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.823+0000 7fd14430e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c148320 0x7fd13c10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:07.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.823+0000 7fd14430e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd13c10f290 0x7fd13c10dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:07.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.823+0000 7fd14430e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd13c10e110 0x7fd13c10e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:07.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.823+0000 7fd14430e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13c139ff0 con 0x7fd13c10f290 2019-11-28T11:54:07.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.823+0000 7fd14430e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13c13aa20 con 0x7fd13c10e110 2019-11-28T11:54:07.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.823+0000 7fd14430e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c10c490 con 0x7fd13c148320 2019-11-28T11:54:07.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1420aa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd13c10f290 0x7fd13c10dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1420aa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd13c10f290 0x7fd13c10dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44822/0 (socket says 172.21.15.80:44822) 2019-11-28T11:54:07.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1420aa700 1 -- 172.21.15.80:0/2966364228 learned_addr learned my addr 172.21.15.80:0/2966364228 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:07.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1430ac700 1 --2- 172.21.15.80:0/2966364228 >> v2:172.21.15.174:3300/0 conn(0x7fd13c10e110 0x7fd13c10e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1428ab700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c148320 0x7fd13c10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1420aa700 1 -- 172.21.15.80:0/2966364228 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c148320 msgr2=0x7fd13c10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1420aa700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c148320 0x7fd13c10ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1420aa700 1 -- 172.21.15.80:0/2966364228 >> v2:172.21.15.174:3300/0 conn(0x7fd13c10e110 msgr2=0x7fd13c10e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:07.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1420aa700 1 --2- 172.21.15.80:0/2966364228 >> v2:172.21.15.174:3300/0 conn(0x7fd13c10e110 0x7fd13c10e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:07.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1420aa700 1 -- 172.21.15.80:0/2966364228 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c10c810 con 0x7fd13c10f290 2019-11-28T11:54:07.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1428ab700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c148320 0x7fd13c10ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:07.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1420aa700 1 --2- 172.21.15.80:0/2966364228 >> v2:172.21.15.80:3300/0 conn(0x7fd13c10f290 0x7fd13c10dbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd12c010410 tx=0x7fd12c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1420aa700 1 --2- 172.21.15.80:0/2966364228 >> v2:172.21.15.80:3300/0 conn(0x7fd13c10f290 0x7fd13c10dbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd12c010410 tx=0x7fd12c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1420aa700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd13c10f290 0x7fd13c10dbd0 secure :-1 s=READY pgs=2511 cs=0 l=1 rx=0x7fd12c010410 tx=0x7fd12c010310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:07.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1420aa700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd13c10f290 0x7fd13c10dbd0 secure :-1 s=THROTTLE_DONE pgs=2511 cs=0 l=1 rx=0x7fd12c010410 tx=0x7fd12c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd13b7fe700 1 -- 172.21.15.80:0/2966364228 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd12c000b90 con 0x7fd13c10f290 2019-11-28T11:54:07.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1420aa700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd13c10f290 0x7fd13c10dbd0 secure :-1 s=THROTTLE_DONE pgs=2511 cs=0 l=1 rx=0x7fd12c010410 tx=0x7fd12c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd1420aa700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd13c10f290 0x7fd13c10dbd0 secure :-1 s=THROTTLE_DONE pgs=2511 cs=0 l=1 rx=0x7fd12c010410 tx=0x7fd12c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd13b7fe700 1 -- 172.21.15.80:0/2966364228 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c005580 con 0x7fd13c10f290 2019-11-28T11:54:07.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd13b7fe700 1 -- 172.21.15.80:0/2966364228 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd12c005b50 con 0x7fd13c10f290 2019-11-28T11:54:07.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd14430e700 1 -- 172.21.15.80:0/2966364228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13c10c810 con 0x7fd13c10f290 2019-11-28T11:54:07.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.824+0000 7fd14430e700 1 -- 172.21.15.80:0/2966364228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13c10c810 con 0x7fd13c10f290 2019-11-28T11:54:07.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.825+0000 7fd1420aa700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd13c10f290 0x7fd13c10dbd0 secure :-1 s=THROTTLE_DONE pgs=2511 cs=0 l=1 rx=0x7fd12c010410 tx=0x7fd12c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.825+0000 7fd13b7fe700 1 -- 172.21.15.80:0/2966364228 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd12c005770 con 0x7fd13c10f290 2019-11-28T11:54:07.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.825+0000 7fd1420aa700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd13c10f290 0x7fd13c10dbd0 secure :-1 s=THROTTLE_DONE pgs=2511 cs=0 l=1 rx=0x7fd12c010410 tx=0x7fd12c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.825+0000 7fd13b7fe700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd120018730 0x7fd12001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:07.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.825+0000 7fd13b7fe700 1 -- 172.21.15.80:0/2966364228 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd12c031ca0 con 0x7fd13c10f290 2019-11-28T11:54:07.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.825+0000 7fd1428ab700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd120018730 0x7fd12001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:07.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.825+0000 7fd1428ab700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd120018730 0x7fd12001abc0 crc :-1 s=READY pgs=1033 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:07.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.833+0000 7fd14430e700 1 -- 172.21.15.80:0/2966364228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13c10c810 con 0x7fd13c10f290 2019-11-28T11:54:07.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.836+0000 7fd1420aa700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd13c10f290 0x7fd13c10dbd0 secure :-1 s=THROTTLE_DONE pgs=2511 cs=0 l=1 rx=0x7fd12c010410 tx=0x7fd12c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:07.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:07.836+0000 7fd13b7fe700 1 -- 172.21.15.80:0/2966364228 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd12c0075a0 con 0x7fd13c10f290 2019-11-28T11:54:08.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.002+0000 7fd14430e700 1 -- 172.21.15.80:0/2966364228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fd13c10c810 con 0x7fd13c10f290 2019-11-28T11:54:08.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.002+0000 7fd1420aa700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd13c10f290 0x7fd13c10dbd0 secure :-1 s=THROTTLE_DONE pgs=2511 cs=0 l=1 rx=0x7fd12c010410 tx=0x7fd12c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:08.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.002+0000 7fd13b7fe700 1 -- 172.21.15.80:0/2966364228 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v190) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd12c005580 con 0x7fd13c10f290 2019-11-28T11:54:08.058 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:54:08.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.005+0000 7fd14430e700 1 -- 172.21.15.80:0/2966364228 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd120018730 msgr2=0x7fd12001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:08.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.005+0000 7fd14430e700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd120018730 0x7fd12001abc0 crc :-1 s=READY pgs=1033 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:08.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.005+0000 7fd14430e700 1 -- 172.21.15.80:0/2966364228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd13c10f290 msgr2=0x7fd13c10dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:08.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.005+0000 7fd14430e700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd13c10f290 0x7fd13c10dbd0 secure :-1 s=READY pgs=2511 cs=0 l=1 rx=0x7fd12c010410 tx=0x7fd12c010310).stop 2019-11-28T11:54:08.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.005+0000 7fd14430e700 1 -- 172.21.15.80:0/2966364228 shutdown_connections 2019-11-28T11:54:08.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.005+0000 7fd14430e700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd120018730 0x7fd12001abc0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:08.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.005+0000 7fd14430e700 1 --2- 172.21.15.80:0/2966364228 >> v2:172.21.15.174:3300/0 conn(0x7fd13c10e110 0x7fd13c10e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:08.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.005+0000 7fd14430e700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd13c10f290 0x7fd13c10dbd0 unknown :-1 s=CLOSED pgs=2511 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:08.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.005+0000 7fd14430e700 1 --2- 172.21.15.80:0/2966364228 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd13c148320 0x7fd13c10ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:08.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.005+0000 7fd14430e700 1 -- 172.21.15.80:0/2966364228 shutdown_connections 2019-11-28T11:54:08.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.005+0000 7fd14430e700 1 -- 172.21.15.80:0/2966364228 wait complete. 2019-11-28T11:54:08.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.005+0000 7fd14430e700 1 -- 172.21.15.80:0/2966364228 >> 172.21.15.80:0/2966364228 conn(0x7fd13c15e2d0 msgr2=0x7fd13c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:08.070 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:54:08.070 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:08.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.136+0000 7f0f1416a700 1 Processor -- start 2019-11-28T11:54:08.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.136+0000 7f0f1416a700 1 -- start start 2019-11-28T11:54:08.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f1416a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f0c06c0a0 0x7f0f0c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:08.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f1416a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0f0c0734e0 0x7f0f0c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:08.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f1416a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0c072360 0x7f0f0c072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:08.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f1416a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c06fd60 con 0x7f0f0c06c0a0 2019-11-28T11:54:08.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f1416a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c070030 con 0x7f0f0c0734e0 2019-11-28T11:54:08.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f1416a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c06f330 con 0x7f0f0c072360 2019-11-28T11:54:08.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f12707700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f0c06c0a0 0x7f0f0c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:08.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f12707700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f0c06c0a0 0x7f0f0c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44828/0 (socket says 172.21.15.80:44828) 2019-11-28T11:54:08.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f12707700 1 -- 172.21.15.80:0/1227428223 learned_addr learned my addr 172.21.15.80:0/1227428223 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:08.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f12f08700 1 --2- 172.21.15.80:0/1227428223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0c072360 0x7f0f0c072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:08.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f11f06700 1 --2- 172.21.15.80:0/1227428223 >> v2:172.21.15.174:3300/0 conn(0x7f0f0c0734e0 0x7f0f0c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:08.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f12707700 1 -- 172.21.15.80:0/1227428223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0c072360 msgr2=0x7f0f0c072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:08.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f12707700 1 --2- 172.21.15.80:0/1227428223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0c072360 0x7f0f0c072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:08.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f12707700 1 -- 172.21.15.80:0/1227428223 >> v2:172.21.15.174:3300/0 conn(0x7f0f0c0734e0 msgr2=0x7f0f0c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:08.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f12707700 1 --2- 172.21.15.80:0/1227428223 >> v2:172.21.15.174:3300/0 conn(0x7f0f0c0734e0 0x7f0f0c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:08.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f12707700 1 -- 172.21.15.80:0/1227428223 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c0706c0 con 0x7f0f0c06c0a0 2019-11-28T11:54:08.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f12f08700 1 --2- 172.21.15.80:0/1227428223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0c072360 0x7f0f0c072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:08.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f11f06700 1 --2- 172.21.15.80:0/1227428223 >> v2:172.21.15.174:3300/0 conn(0x7f0f0c0734e0 0x7f0f0c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:08.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f12707700 1 --2- 172.21.15.80:0/1227428223 >> v2:172.21.15.80:3300/0 conn(0x7f0f0c06c0a0 0x7f0f0c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0ef400f740 tx=0x7f0ef400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:08.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f12707700 1 --2- 172.21.15.80:0/1227428223 >> v2:172.21.15.80:3300/0 conn(0x7f0f0c06c0a0 0x7f0f0c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0ef400f740 tx=0x7f0ef400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:08.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f12707700 1 --2- 172.21.15.80:0/1227428223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c06c0a0 0x7f0f0c072fa0 secure :-1 s=READY pgs=2512 cs=0 l=1 rx=0x7f0ef400f740 tx=0x7f0ef400fae0).ready entity=mon.0 client_cookie=c23141ff5707f5a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:08.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f12707700 1 --2- 172.21.15.80:0/1227428223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c06c0a0 0x7f0f0c072fa0 secure :-1 s=THROTTLE_DONE pgs=2512 cs=0 l=1 rx=0x7f0ef400f740 tx=0x7f0ef400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:08.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f12707700 1 --2- 172.21.15.80:0/1227428223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c06c0a0 0x7f0f0c072fa0 secure :-1 s=THROTTLE_DONE pgs=2512 cs=0 l=1 rx=0x7f0ef400f740 tx=0x7f0ef400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:08.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f11705700 1 -- 172.21.15.80:0/1227428223 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ef4000960 con 0x7f0f0c06c0a0 2019-11-28T11:54:08.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.137+0000 7f0f12707700 1 --2- 172.21.15.80:0/1227428223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c06c0a0 0x7f0f0c072fa0 secure :-1 s=THROTTLE_DONE pgs=2512 cs=0 l=1 rx=0x7f0ef400f740 tx=0x7f0ef400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:08.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.138+0000 7f0f11705700 1 -- 172.21.15.80:0/1227428223 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef4000e80 con 0x7f0f0c06c0a0 2019-11-28T11:54:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.138+0000 7f0f11705700 1 -- 172.21.15.80:0/1227428223 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ef40015d0 con 0x7f0f0c06c0a0 2019-11-28T11:54:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.138+0000 7f0f1416a700 1 -- 172.21.15.80:0/1227428223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c06c0a0 msgr2=0x7f0f0c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.138+0000 7f0f1416a700 1 --2- 172.21.15.80:0/1227428223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c06c0a0 0x7f0f0c072fa0 secure :-1 s=READY pgs=2512 cs=0 l=1 rx=0x7f0ef400f740 tx=0x7f0ef400fae0).stop 2019-11-28T11:54:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.138+0000 7f0f1416a700 1 -- 172.21.15.80:0/1227428223 shutdown_connections 2019-11-28T11:54:08.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.138+0000 7f0f1416a700 1 --2- 172.21.15.80:0/1227428223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0c072360 0x7f0f0c072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:08.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.138+0000 7f0f1416a700 1 --2- 172.21.15.80:0/1227428223 >> v2:172.21.15.174:3300/0 conn(0x7f0f0c0734e0 0x7f0f0c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:08.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.138+0000 7f0f1416a700 1 --2- 172.21.15.80:0/1227428223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c06c0a0 0x7f0f0c072fa0 unknown :-1 s=CLOSED pgs=2512 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:08.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.138+0000 7f0f1416a700 1 -- 172.21.15.80:0/1227428223 shutdown_connections 2019-11-28T11:54:08.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.138+0000 7f0f1416a700 1 -- 172.21.15.80:0/1227428223 wait complete. 2019-11-28T11:54:08.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.138+0000 7f0f1416a700 1 -- 172.21.15.80:0/1227428223 >> 172.21.15.80:0/1227428223 conn(0x7f0f0c061cf0 msgr2=0x7f0f0c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:08.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.141+0000 7f0f1416a700 1 Processor -- start 2019-11-28T11:54:08.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.141+0000 7f0f1416a700 1 -- start start 2019-11-28T11:54:08.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f1416a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f0c104820 0x7f0f0c10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:08.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f1416a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0c10b9d0 0x7f0f0c167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f1416a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0c13bcd0 con 0x7f0f0c10c890 2019-11-28T11:54:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f1416a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c109130 con 0x7f0f0c104820 2019-11-28T11:54:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f1416a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c109400 con 0x7f0f0c10b9d0 2019-11-28T11:54:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f12707700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0f0c104820 0x7f0f0c10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f11f06700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0f0c10c890 0x7f0f0c10b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44152/0 (socket says 172.21.15.80:44152) 2019-11-28T11:54:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f11f06700 1 -- 172.21.15.80:0/237821347 learned_addr learned my addr 172.21.15.80:0/237821347 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f12f08700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0c10b9d0 0x7f0f0c167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f12707700 1 -- 172.21.15.80:0/237821347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0c10b9d0 msgr2=0x7f0f0c167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f12707700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0c10b9d0 0x7f0f0c167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f12707700 1 -- 172.21.15.80:0/237821347 >> v1:172.21.15.80:6789/0 conn(0x7f0f0c10c890 legacy=0x7f0f0c10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f0affd700 1 -- 172.21.15.80:0/237821347 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678605327 0 0) 0x7f0efc000ea0 con 0x7f0f0c10c890 2019-11-28T11:54:08.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f12707700 1 -- 172.21.15.80:0/237821347 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c109a90 con 0x7f0f0c104820 2019-11-28T11:54:08.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f12707700 1 --2- 172.21.15.80:0/237821347 >> v2:172.21.15.80:3300/0 conn(0x7f0f0c104820 0x7f0f0c10c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ef40103f0 tx=0x7f0ef4010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:08.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f12f08700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0c10b9d0 0x7f0f0c167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:08.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f12707700 1 --2- 172.21.15.80:0/237821347 >> v2:172.21.15.80:3300/0 conn(0x7f0f0c104820 0x7f0f0c10c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ef40103f0 tx=0x7f0ef4010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:08.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f12707700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c104820 0x7f0f0c10c350 secure :-1 s=READY pgs=2514 cs=0 l=1 rx=0x7f0ef40103f0 tx=0x7f0ef4010790).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:08.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f12707700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c104820 0x7f0f0c10c350 secure :-1 s=THROTTLE_DONE pgs=2514 cs=0 l=1 rx=0x7f0ef40103f0 tx=0x7f0ef4010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:08.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f0affd700 1 -- 172.21.15.80:0/237821347 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ef4005770 con 0x7f0f0c104820 2019-11-28T11:54:08.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f12707700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c104820 0x7f0f0c10c350 secure :-1 s=THROTTLE_DONE pgs=2514 cs=0 l=1 rx=0x7f0ef40103f0 tx=0x7f0ef4010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:08.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f12707700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c104820 0x7f0f0c10c350 secure :-1 s=THROTTLE_DONE pgs=2514 cs=0 l=1 rx=0x7f0ef40103f0 tx=0x7f0ef4010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:08.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f0affd700 1 -- 172.21.15.80:0/237821347 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef4005390 con 0x7f0f0c104820 2019-11-28T11:54:08.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f1416a700 1 -- 172.21.15.80:0/237821347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0c109e10 con 0x7f0f0c104820 2019-11-28T11:54:08.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f0affd700 1 -- 172.21.15.80:0/237821347 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ef4005d50 con 0x7f0f0c104820 2019-11-28T11:54:08.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.142+0000 7f0f1416a700 1 -- 172.21.15.80:0/237821347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c109a90 con 0x7f0f0c104820 2019-11-28T11:54:08.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.143+0000 7f0f12707700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c104820 0x7f0f0c10c350 secure :-1 s=THROTTLE_DONE pgs=2514 cs=0 l=1 rx=0x7f0ef40103f0 tx=0x7f0ef4010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:08.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.143+0000 7f0f0affd700 1 -- 172.21.15.80:0/237821347 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0ef4005580 con 0x7f0f0c104820 2019-11-28T11:54:08.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.143+0000 7f0f12707700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c104820 0x7f0f0c10c350 secure :-1 s=THROTTLE_DONE pgs=2514 cs=0 l=1 rx=0x7f0ef40103f0 tx=0x7f0ef4010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:08.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.143+0000 7f0f0affd700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0ef001a940 0x7f0ef001cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:08.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.143+0000 7f0f0affd700 1 -- 172.21.15.80:0/237821347 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0ef40319e0 con 0x7f0f0c104820 2019-11-28T11:54:08.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.143+0000 7f0f11f06700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0ef001a940 0x7f0ef001cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:08.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.144+0000 7f0f11f06700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0ef001a940 0x7f0ef001cdd0 crc :-1 s=READY pgs=1034 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:08.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.151+0000 7f0f1416a700 1 -- 172.21.15.80:0/237821347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c109e10 con 0x7f0f0c104820 2019-11-28T11:54:08.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.154+0000 7f0f12707700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c104820 0x7f0f0c10c350 secure :-1 s=THROTTLE_DONE pgs=2514 cs=0 l=1 rx=0x7f0ef40103f0 tx=0x7f0ef4010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:08.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.154+0000 7f0f0affd700 1 -- 172.21.15.80:0/237821347 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0ef4005180 con 0x7f0f0c104820 2019-11-28T11:54:08.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.327+0000 7f0f1416a700 1 -- 172.21.15.80:0/237821347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f0c109a90 con 0x7f0f0c104820 2019-11-28T11:54:08.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.327+0000 7f0f12707700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c104820 0x7f0f0c10c350 secure :-1 s=THROTTLE_DONE pgs=2514 cs=0 l=1 rx=0x7f0ef40103f0 tx=0x7f0ef4010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:08.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.327+0000 7f0f0affd700 1 -- 172.21.15.80:0/237821347 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) v1 ==== 95+0+2454 (secure 0 0 0) 0x7f0ef4005580 con 0x7f0f0c104820 2019-11-28T11:54:08.384 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 153 2019-11-28T11:54:08.384 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:08.384 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":153,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":11286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/867823380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":867823380},{"type":"v1","addr":"172.21.15.174:6835","nonce":867823380}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":151},{"gid":11301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/1741196077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1741196077},{"type":"v1","addr":"172.21.15.80:6833","nonce":1741196077}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":151}],"filesystems":[{"mdsmap":{"epoch":153,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:53:57.302329+0000","modified":"2019-11-28T11:54:04.996007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7541},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7541":{"gid":7541,"name":"b","rank":0,"incarnation":152,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6835/3753292454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3753292454},{"type":"v1","addr":"172.21.15.80:6835","nonce":3753292454}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2019-11-28T11:54:08.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.329+0000 7f0f1416a700 1 -- 172.21.15.80:0/237821347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0ef001a940 msgr2=0x7f0ef001cdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:08.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.329+0000 7f0f1416a700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0ef001a940 0x7f0ef001cdd0 crc :-1 s=READY pgs=1034 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:08.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.329+0000 7f0f1416a700 1 -- 172.21.15.80:0/237821347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c104820 msgr2=0x7f0f0c10c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:08.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.329+0000 7f0f1416a700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c104820 0x7f0f0c10c350 secure :-1 s=READY pgs=2514 cs=0 l=1 rx=0x7f0ef40103f0 tx=0x7f0ef4010790).stop 2019-11-28T11:54:08.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.329+0000 7f0f1416a700 1 -- 172.21.15.80:0/237821347 shutdown_connections 2019-11-28T11:54:08.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.329+0000 7f0f1416a700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0ef001a940 0x7f0ef001cdd0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:08.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.329+0000 7f0f1416a700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0f0c10b9d0 0x7f0f0c167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:08.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.329+0000 7f0f1416a700 1 --2- 172.21.15.80:0/237821347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0f0c104820 0x7f0f0c10c350 unknown :-1 s=CLOSED pgs=2514 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:08.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.330+0000 7f0f1416a700 1 -- 172.21.15.80:0/237821347 shutdown_connections 2019-11-28T11:54:08.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.330+0000 7f0f1416a700 1 -- 172.21.15.80:0/237821347 wait complete. 2019-11-28T11:54:08.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:08.330+0000 7f0f1416a700 1 -- 172.21.15.80:0/237821347 >> 172.21.15.80:0/237821347 conn(0x7f0f0c13d620 msgr2=0x7f0f0c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:08.698 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7541}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 30, u'failed': [], u'epoch': 153, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [31], u'info': {u'gid_7541': {u'export_targets': [], u'name': u'b', u'incarnation': 152, u'state_seq': 3, u'state': u'up:active', u'gid': 7541, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3753292454, u'type': u'v2', u'addr': u'172.21.15.80:6834'}, {u'nonce': 3753292454, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/3753292454'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:53:57.302329+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:54:04.996007+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:54:08.698 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:54:08.698 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-11-28T11:54:08.825 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:54:08.825 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:54:08.825 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T11:54:08.826 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 7541, 2019-11-28T11:54:08.826 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2019-11-28T11:54:08.826 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2019-11-28T11:54:08.826 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 4.7725061709999999, 2019-11-28T11:54:08.827 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 153, 2019-11-28T11:54:08.827 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 190, 2019-11-28T11:54:08.827 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 190, 2019-11-28T11:54:08.827 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 8.9852926760000003 2019-11-28T11:54:08.827 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:54:08.834 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7541, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.7725061709999999, "mdsmap_epoch": 153, "osdmap_epoch": 190, "osdmap_epoch_barrier": 190, "uptime": 8.9852926760000003 } 2019-11-28T11:54:08.835 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:54:08.835 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:54:08.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:54:08.835 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:54:08.915 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:54:08.915 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:54:09.043 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:54:09.043 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:54:09.043 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:54:09.044 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:54:09.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:54:09.044 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:54:09.117 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:54:09.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.183+0000 7f3822cac700 1 Processor -- start 2019-11-28T11:54:09.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.183+0000 7f3822cac700 1 -- start start 2019-11-28T11:54:09.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.184+0000 7f3822cac700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f381c06c0a0 0x7f381c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:09.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.184+0000 7f3822cac700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f381c072620 0x7f381c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:09.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.184+0000 7f3822cac700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381c06db00 con 0x7f381c0734e0 2019-11-28T11:54:09.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.184+0000 7f3822cac700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c06fd60 con 0x7f381c06c0a0 2019-11-28T11:54:09.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.184+0000 7f3822cac700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c070030 con 0x7f381c072620 2019-11-28T11:54:09.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.184+0000 7f3821a4a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f381c072620 0x7f381c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:09.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f3821a4a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f381c072620 0x7f381c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:47104/0 (socket says 172.21.15.80:47104) 2019-11-28T11:54:09.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f3821a4a700 1 -- 172.21.15.80:0/821046939 learned_addr learned my addr 172.21.15.80:0/821046939 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:09.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f3821249700 1 --2- 172.21.15.80:0/821046939 >> v2:172.21.15.174:3300/0 conn(0x7f381c06c0a0 0x7f381c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:09.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f3821a4a700 1 -- 172.21.15.80:0/821046939 >> v2:172.21.15.174:3300/0 conn(0x7f381c06c0a0 msgr2=0x7f381c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:09.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f3821a4a700 1 --2- 172.21.15.80:0/821046939 >> v2:172.21.15.174:3300/0 conn(0x7f381c06c0a0 0x7f381c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:09.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f3821a4a700 1 -- 172.21.15.80:0/821046939 >> v1:172.21.15.174:6789/0 conn(0x7f381c0734e0 legacy=0x7f381c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f3821a4a700 1 -- 172.21.15.80:0/821046939 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c0706c0 con 0x7f381c072620 2019-11-28T11:54:09.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f3821a4a700 1 --2- 172.21.15.80:0/821046939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f381c072620 0x7f381c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f381400fa60 tx=0x7f381400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f3821a4a700 1 --2- 172.21.15.80:0/821046939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f381c072620 0x7f381c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f381400fa60 tx=0x7f381400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f3821a4a700 1 --2- 172.21.15.80:0/821046939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f381c072620 0x7f381c164d70 secure :-1 s=READY pgs=359 cs=0 l=1 rx=0x7f381400fa60 tx=0x7f381400fe00).ready entity=mon.2 client_cookie=fd798d0df854c62f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:09.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f3821a4a700 1 --2- 172.21.15.80:0/821046939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f381c072620 0x7f381c164d70 secure :-1 s=THROTTLE_DONE pgs=359 cs=0 l=1 rx=0x7f381400fa60 tx=0x7f381400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f3821a4a700 1 --2- 172.21.15.80:0/821046939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f381c072620 0x7f381c164d70 secure :-1 s=THROTTLE_DONE pgs=359 cs=0 l=1 rx=0x7f381400fa60 tx=0x7f381400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f381bfff700 1 -- 172.21.15.80:0/821046939 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3814000df0 con 0x7f381c072620 2019-11-28T11:54:09.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f3821a4a700 1 --2- 172.21.15.80:0/821046939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f381c072620 0x7f381c164d70 secure :-1 s=THROTTLE_DONE pgs=359 cs=0 l=1 rx=0x7f381400fa60 tx=0x7f381400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f381bfff700 1 -- 172.21.15.80:0/821046939 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38140011f0 con 0x7f381c072620 2019-11-28T11:54:09.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f381bfff700 1 -- 172.21.15.80:0/821046939 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3814001880 con 0x7f381c072620 2019-11-28T11:54:09.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f3822cac700 1 -- 172.21.15.80:0/821046939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f381c072620 msgr2=0x7f381c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.185+0000 7f3822cac700 1 --2- 172.21.15.80:0/821046939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f381c072620 0x7f381c164d70 secure :-1 s=READY pgs=359 cs=0 l=1 rx=0x7f381400fa60 tx=0x7f381400fe00).stop 2019-11-28T11:54:09.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.186+0000 7f3822cac700 1 -- 172.21.15.80:0/821046939 shutdown_connections 2019-11-28T11:54:09.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.186+0000 7f3822cac700 1 --2- 172.21.15.80:0/821046939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f381c072620 0x7f381c164d70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:09.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.186+0000 7f3822cac700 1 --2- 172.21.15.80:0/821046939 >> v2:172.21.15.174:3300/0 conn(0x7f381c06c0a0 0x7f381c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:09.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.186+0000 7f3822cac700 1 -- 172.21.15.80:0/821046939 shutdown_connections 2019-11-28T11:54:09.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.186+0000 7f3822cac700 1 -- 172.21.15.80:0/821046939 wait complete. 2019-11-28T11:54:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.186+0000 7f3822cac700 1 -- 172.21.15.80:0/821046939 >> 172.21.15.80:0/821046939 conn(0x7f381c061cf0 msgr2=0x7f381c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:09.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.189+0000 7f3822cac700 1 Processor -- start 2019-11-28T11:54:09.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.189+0000 7f3822cac700 1 -- start start 2019-11-28T11:54:09.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3822cac700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f381c13e9e0 0x7f381c108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:09.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3822cac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f381c109430 0x7f381c1098b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:09.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3822cac700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381c1066e0 con 0x7f381c13e5f0 2019-11-28T11:54:09.304 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3822cac700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c10e060 con 0x7f381c109430 2019-11-28T11:54:09.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3822cac700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c10e330 con 0x7f381c13e9e0 2019-11-28T11:54:09.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3821249700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f381c13e5f0 0x7f381c10a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44164/0 (socket says 172.21.15.80:44164) 2019-11-28T11:54:09.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3821249700 1 -- 172.21.15.80:0/3368719482 learned_addr learned my addr 172.21.15.80:0/3368719482 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:09.305 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3821a4a700 1 --2- 172.21.15.80:0/3368719482 >> v2:172.21.15.80:3300/0 conn(0x7f381c109430 0x7f381c1098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:09.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3820a48700 1 --2- 172.21.15.80:0/3368719482 >> v2:172.21.15.174:3300/0 conn(0x7f381c13e9e0 0x7f381c108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:09.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3821a4a700 1 -- 172.21.15.80:0/3368719482 >> v2:172.21.15.174:3300/0 conn(0x7f381c13e9e0 msgr2=0x7f381c108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3821a4a700 1 --2- 172.21.15.80:0/3368719482 >> v2:172.21.15.174:3300/0 conn(0x7f381c13e9e0 0x7f381c108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:09.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3821a4a700 1 -- 172.21.15.80:0/3368719482 >> v1:172.21.15.80:6789/0 conn(0x7f381c13e5f0 legacy=0x7f381c10a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3821a4a700 1 -- 172.21.15.80:0/3368719482 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c10e9c0 con 0x7f381c109430 2019-11-28T11:54:09.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3819ffb700 1 -- 172.21.15.80:0/3368719482 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269725419 0 0) 0x7f380c0010b0 con 0x7f381c13e5f0 2019-11-28T11:54:09.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3821a4a700 1 --2- 172.21.15.80:0/3368719482 >> v2:172.21.15.80:3300/0 conn(0x7f381c109430 0x7f381c1098b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3814010730 tx=0x7f38140105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3821a4a700 1 --2- 172.21.15.80:0/3368719482 >> v2:172.21.15.80:3300/0 conn(0x7f381c109430 0x7f381c1098b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3814010730 tx=0x7f38140105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3821a4a700 1 --2- 172.21.15.80:0/3368719482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f381c109430 0x7f381c1098b0 secure :-1 s=READY pgs=2517 cs=0 l=1 rx=0x7f3814010730 tx=0x7f38140105e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:09.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3821a4a700 1 --2- 172.21.15.80:0/3368719482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f381c109430 0x7f381c1098b0 secure :-1 s=THROTTLE_DONE pgs=2517 cs=0 l=1 rx=0x7f3814010730 tx=0x7f38140105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.190+0000 7f3819ffb700 1 -- 172.21.15.80:0/3368719482 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3814008510 con 0x7f381c109430 2019-11-28T11:54:09.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.191+0000 7f3821a4a700 1 --2- 172.21.15.80:0/3368719482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f381c109430 0x7f381c1098b0 secure :-1 s=THROTTLE_DONE pgs=2517 cs=0 l=1 rx=0x7f3814010730 tx=0x7f38140105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.191+0000 7f3822cac700 1 -- 172.21.15.80:0/3368719482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381c10ed40 con 0x7f381c109430 2019-11-28T11:54:09.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.191+0000 7f3819ffb700 1 -- 172.21.15.80:0/3368719482 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3814008510 con 0x7f381c109430 2019-11-28T11:54:09.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.191+0000 7f3821a4a700 1 --2- 172.21.15.80:0/3368719482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f381c109430 0x7f381c1098b0 secure :-1 s=THROTTLE_DONE pgs=2517 cs=0 l=1 rx=0x7f3814010730 tx=0x7f38140105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.191+0000 7f3819ffb700 1 -- 172.21.15.80:0/3368719482 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3814005930 con 0x7f381c109430 2019-11-28T11:54:09.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.191+0000 7f3822cac700 1 -- 172.21.15.80:0/3368719482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381c10e9c0 con 0x7f381c109430 2019-11-28T11:54:09.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.191+0000 7f3821a4a700 1 --2- 172.21.15.80:0/3368719482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f381c109430 0x7f381c1098b0 secure :-1 s=THROTTLE_DONE pgs=2517 cs=0 l=1 rx=0x7f3814010730 tx=0x7f38140105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.191+0000 7f3819ffb700 1 -- 172.21.15.80:0/3368719482 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f38140081e0 con 0x7f381c109430 2019-11-28T11:54:09.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.191+0000 7f3821a4a700 1 --2- 172.21.15.80:0/3368719482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f381c109430 0x7f381c1098b0 secure :-1 s=THROTTLE_DONE pgs=2517 cs=0 l=1 rx=0x7f3814010730 tx=0x7f38140105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.191+0000 7f3819ffb700 1 --2- 172.21.15.80:0/3368719482 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3800018730 0x7f380001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:09.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.191+0000 7f3819ffb700 1 -- 172.21.15.80:0/3368719482 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3814031d90 con 0x7f381c109430 2019-11-28T11:54:09.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.191+0000 7f3821249700 1 --2- 172.21.15.80:0/3368719482 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3800018730 0x7f380001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:09.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.192+0000 7f3821249700 1 --2- 172.21.15.80:0/3368719482 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3800018730 0x7f380001abc0 crc :-1 s=READY pgs=1035 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:09.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.198+0000 7f3822cac700 1 -- 172.21.15.80:0/3368719482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381c10ed40 con 0x7f381c109430 2019-11-28T11:54:09.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.202+0000 7f3821a4a700 1 --2- 172.21.15.80:0/3368719482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f381c109430 0x7f381c1098b0 secure :-1 s=THROTTLE_DONE pgs=2517 cs=0 l=1 rx=0x7f3814010730 tx=0x7f38140105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.202+0000 7f3819ffb700 1 -- 172.21.15.80:0/3368719482 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3814007620 con 0x7f381c109430 2019-11-28T11:54:09.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.376+0000 7f3822cac700 1 -- 172.21.15.80:0/3368719482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f381c10e9c0 con 0x7f381c109430 2019-11-28T11:54:09.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.377+0000 7f3821a4a700 1 --2- 172.21.15.80:0/3368719482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f381c109430 0x7f381c1098b0 secure :-1 s=THROTTLE_DONE pgs=2517 cs=0 l=1 rx=0x7f3814010730 tx=0x7f38140105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.377+0000 7f3819ffb700 1 -- 172.21.15.80:0/3368719482 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f3814008170 con 0x7f381c109430 2019-11-28T11:54:09.433 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:09.434 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":190,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:53:58.303811+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:53:55.640729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":31,"pool_name":"cephfs_data","create_time":"2019-11-28T11:53:56.329039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:54:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.379+0000 7f3822cac700 1 -- 172.21.15.80:0/3368719482 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3800018730 msgr2=0x7f380001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.379+0000 7f3822cac700 1 --2- 172.21.15.80:0/3368719482 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3800018730 0x7f380001abc0 crc :-1 s=READY pgs=1035 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.379+0000 7f3822cac700 1 -- 172.21.15.80:0/3368719482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f381c109430 msgr2=0x7f381c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.379+0000 7f3822cac700 1 --2- 172.21.15.80:0/3368719482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f381c109430 0x7f381c1098b0 secure :-1 s=READY pgs=2517 cs=0 l=1 rx=0x7f3814010730 tx=0x7f38140105e0).stop 2019-11-28T11:54:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.379+0000 7f3822cac700 1 -- 172.21.15.80:0/3368719482 shutdown_connections 2019-11-28T11:54:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.379+0000 7f3822cac700 1 --2- 172.21.15.80:0/3368719482 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3800018730 0x7f380001abc0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:09.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.379+0000 7f3822cac700 1 --2- 172.21.15.80:0/3368719482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f381c109430 0x7f381c1098b0 unknown :-1 s=CLOSED pgs=2517 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:09.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.379+0000 7f3822cac700 1 --2- 172.21.15.80:0/3368719482 >> v2:172.21.15.174:3300/0 conn(0x7f381c13e9e0 0x7f381c108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:09.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.379+0000 7f3822cac700 1 -- 172.21.15.80:0/3368719482 shutdown_connections 2019-11-28T11:54:09.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.379+0000 7f3822cac700 1 -- 172.21.15.80:0/3368719482 wait complete. 2019-11-28T11:54:09.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.379+0000 7f3822cac700 1 -- 172.21.15.80:0/3368719482 >> 172.21.15.80:0/3368719482 conn(0x7f381c13d620 msgr2=0x7f381c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:09.445 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:53:55.640729+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 30, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'189', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:53:56.329039+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 31, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'190', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:54:09.446 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:54:09.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.514+0000 7ff2013de700 1 Processor -- start 2019-11-28T11:54:09.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.514+0000 7ff2013de700 1 -- start start 2019-11-28T11:54:09.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.515+0000 7ff2013de700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1fc15ed10 0x7ff1fc15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:09.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.515+0000 7ff2013de700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff1fc0734b0 0x7ff1fc0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:09.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.515+0000 7ff2013de700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1fc06db60 con 0x7ff1fc073020 2019-11-28T11:54:09.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.515+0000 7ff2013de700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1fc06fe00 con 0x7ff1fc15ed10 2019-11-28T11:54:09.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.515+0000 7ff2013de700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1fc0700d0 con 0x7ff1fc0734b0 2019-11-28T11:54:09.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.515+0000 7ff1fb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1fc15ed10 0x7ff1fc15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1faffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff1fc073020 0x7ff1fc071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44172/0 (socket says 172.21.15.80:44172) 2019-11-28T11:54:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1fc15ed10 0x7ff1fc15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44856/0 (socket says 172.21.15.80:44856) 2019-11-28T11:54:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fb7fe700 1 -- 172.21.15.80:0/3454357010 learned_addr learned my addr 172.21.15.80:0/3454357010 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fbfff700 1 --2- 172.21.15.80:0/3454357010 >> v2:172.21.15.174:3300/0 conn(0x7ff1fc0734b0 0x7ff1fc0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fb7fe700 1 -- 172.21.15.80:0/3454357010 >> v2:172.21.15.174:3300/0 conn(0x7ff1fc0734b0 msgr2=0x7ff1fc0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/3454357010 >> v2:172.21.15.174:3300/0 conn(0x7ff1fc0734b0 0x7ff1fc0726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fb7fe700 1 -- 172.21.15.80:0/3454357010 >> v1:172.21.15.80:6789/0 conn(0x7ff1fc073020 legacy=0x7ff1fc071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fa7fc700 1 -- 172.21.15.80:0/3454357010 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620131625 0 0) 0x7ff1ec001480 con 0x7ff1fc073020 2019-11-28T11:54:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fb7fe700 1 -- 172.21.15.80:0/3454357010 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc070760 con 0x7ff1fc15ed10 2019-11-28T11:54:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/3454357010 >> v2:172.21.15.80:3300/0 conn(0x7ff1fc15ed10 0x7ff1fc15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff1e400f6c0 tx=0x7ff1e400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/3454357010 >> v2:172.21.15.80:3300/0 conn(0x7ff1fc15ed10 0x7ff1fc15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff1e400f6c0 tx=0x7ff1e400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/3454357010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc15ed10 0x7ff1fc15f100 secure :-1 s=READY pgs=2519 cs=0 l=1 rx=0x7ff1e400f6c0 tx=0x7ff1e400fa60).ready entity=mon.0 client_cookie=dbd257a3ada9b361 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/3454357010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc15ed10 0x7ff1fc15f100 secure :-1 s=THROTTLE_DONE pgs=2519 cs=0 l=1 rx=0x7ff1e400f6c0 tx=0x7ff1e400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fa7fc700 1 -- 172.21.15.80:0/3454357010 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1e4000960 con 0x7ff1fc15ed10 2019-11-28T11:54:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/3454357010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc15ed10 0x7ff1fc15f100 secure :-1 s=THROTTLE_DONE pgs=2519 cs=0 l=1 rx=0x7ff1e400f6c0 tx=0x7ff1e400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/3454357010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc15ed10 0x7ff1fc15f100 secure :-1 s=THROTTLE_DONE pgs=2519 cs=0 l=1 rx=0x7ff1e400f6c0 tx=0x7ff1e400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fa7fc700 1 -- 172.21.15.80:0/3454357010 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e4000c90 con 0x7ff1fc15ed10 2019-11-28T11:54:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff1fa7fc700 1 -- 172.21.15.80:0/3454357010 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1e40013a0 con 0x7ff1fc15ed10 2019-11-28T11:54:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff2013de700 1 -- 172.21.15.80:0/3454357010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc15ed10 msgr2=0x7ff1fc15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.516+0000 7ff2013de700 1 --2- 172.21.15.80:0/3454357010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc15ed10 0x7ff1fc15f100 secure :-1 s=READY pgs=2519 cs=0 l=1 rx=0x7ff1e400f6c0 tx=0x7ff1e400fa60).stop 2019-11-28T11:54:09.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.517+0000 7ff2013de700 1 -- 172.21.15.80:0/3454357010 shutdown_connections 2019-11-28T11:54:09.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.517+0000 7ff2013de700 1 --2- 172.21.15.80:0/3454357010 >> v2:172.21.15.174:3300/0 conn(0x7ff1fc0734b0 0x7ff1fc0726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:09.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.517+0000 7ff2013de700 1 --2- 172.21.15.80:0/3454357010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc15ed10 0x7ff1fc15f100 unknown :-1 s=CLOSED pgs=2519 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:09.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.517+0000 7ff2013de700 1 -- 172.21.15.80:0/3454357010 shutdown_connections 2019-11-28T11:54:09.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.517+0000 7ff2013de700 1 -- 172.21.15.80:0/3454357010 wait complete. 2019-11-28T11:54:09.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.517+0000 7ff2013de700 1 -- 172.21.15.80:0/3454357010 >> 172.21.15.80:0/3454357010 conn(0x7ff1fc061d20 msgr2=0x7ff1fc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:09.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.519+0000 7ff2013de700 1 Processor -- start 2019-11-28T11:54:09.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.520+0000 7ff2013de700 1 -- start start 2019-11-28T11:54:09.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.520+0000 7ff2013de700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1fc10e970 0x7ff1fc1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:09.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.520+0000 7ff2013de700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1fc108cf0 0x7ff1fc107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:09.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.520+0000 7ff2013de700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1fc10c250 con 0x7ff1fc107b70 2019-11-28T11:54:09.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.520+0000 7ff2013de700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1fc10e430 con 0x7ff1fc10e970 2019-11-28T11:54:09.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff2013de700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc105860 con 0x7ff1fc108cf0 2019-11-28T11:54:09.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1fb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1fc10e970 0x7ff1fc1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:09.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1fb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1fc10e970 0x7ff1fc1087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44862/0 (socket says 172.21.15.80:44862) 2019-11-28T11:54:09.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1fb7fe700 1 -- 172.21.15.80:0/442517078 learned_addr learned my addr 172.21.15.80:0/442517078 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:09.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1faffd700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1fc108cf0 0x7ff1fc107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:09.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1fb7fe700 1 -- 172.21.15.80:0/442517078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1fc108cf0 msgr2=0x7ff1fc107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1fc108cf0 0x7ff1fc107630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:09.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1fb7fe700 1 -- 172.21.15.80:0/442517078 >> v1:172.21.15.174:6789/0 conn(0x7ff1fc107b70 legacy=0x7ff1fc10ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1fb7fe700 1 -- 172.21.15.80:0/442517078 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc105ef0 con 0x7ff1fc10e970 2019-11-28T11:54:09.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/442517078 >> v2:172.21.15.80:3300/0 conn(0x7ff1fc10e970 0x7ff1fc1087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff1e4010460 tx=0x7ff1e4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/442517078 >> v2:172.21.15.80:3300/0 conn(0x7ff1fc10e970 0x7ff1fc1087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff1e4010460 tx=0x7ff1e4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc10e970 0x7ff1fc1087b0 secure :-1 s=READY pgs=2520 cs=0 l=1 rx=0x7ff1e4010460 tx=0x7ff1e4010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:09.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc10e970 0x7ff1fc1087b0 secure :-1 s=THROTTLE_DONE pgs=2520 cs=0 l=1 rx=0x7ff1e4010460 tx=0x7ff1e4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc10e970 0x7ff1fc1087b0 secure :-1 s=THROTTLE_DONE pgs=2520 cs=0 l=1 rx=0x7ff1e4010460 tx=0x7ff1e4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc10e970 0x7ff1fc1087b0 secure :-1 s=THROTTLE_DONE pgs=2520 cs=0 l=1 rx=0x7ff1e4010460 tx=0x7ff1e4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1f3fff700 1 -- 172.21.15.80:0/442517078 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1e40078e0 con 0x7ff1fc10e970 2019-11-28T11:54:09.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1f3fff700 1 -- 172.21.15.80:0/442517078 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e4000e40 con 0x7ff1fc10e970 2019-11-28T11:54:09.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff2013de700 1 -- 172.21.15.80:0/442517078 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1fc106270 con 0x7ff1fc10e970 2019-11-28T11:54:09.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff1f3fff700 1 -- 172.21.15.80:0/442517078 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1e4001510 con 0x7ff1fc10e970 2019-11-28T11:54:09.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.521+0000 7ff2013de700 1 -- 172.21.15.80:0/442517078 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1fc105ef0 con 0x7ff1fc10e970 2019-11-28T11:54:09.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.522+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc10e970 0x7ff1fc1087b0 secure :-1 s=THROTTLE_DONE pgs=2520 cs=0 l=1 rx=0x7ff1e4010460 tx=0x7ff1e4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.522+0000 7ff1f3fff700 1 -- 172.21.15.80:0/442517078 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff1e40078c0 con 0x7ff1fc10e970 2019-11-28T11:54:09.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.522+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc10e970 0x7ff1fc1087b0 secure :-1 s=THROTTLE_DONE pgs=2520 cs=0 l=1 rx=0x7ff1e4010460 tx=0x7ff1e4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.522+0000 7ff1f3fff700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1e0018730 0x7ff1e001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:09.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.522+0000 7ff1f3fff700 1 -- 172.21.15.80:0/442517078 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff1e4031ae0 con 0x7ff1fc10e970 2019-11-28T11:54:09.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.522+0000 7ff1faffd700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1e0018730 0x7ff1e001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:09.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.522+0000 7ff1faffd700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1e0018730 0x7ff1e001abc0 crc :-1 s=READY pgs=1036 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:09.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.530+0000 7ff2013de700 1 -- 172.21.15.80:0/442517078 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1fc106270 con 0x7ff1fc10e970 2019-11-28T11:54:09.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.533+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc10e970 0x7ff1fc1087b0 secure :-1 s=THROTTLE_DONE pgs=2520 cs=0 l=1 rx=0x7ff1e4010460 tx=0x7ff1e4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.533+0000 7ff1f3fff700 1 -- 172.21.15.80:0/442517078 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff1e4007580 con 0x7ff1fc10e970 2019-11-28T11:54:09.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.699+0000 7ff2013de700 1 -- 172.21.15.80:0/442517078 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7ff1fc105ef0 con 0x7ff1fc10e970 2019-11-28T11:54:09.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.700+0000 7ff1fb7fe700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc10e970 0x7ff1fc1087b0 secure :-1 s=THROTTLE_DONE pgs=2520 cs=0 l=1 rx=0x7ff1e4010460 tx=0x7ff1e4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.700+0000 7ff1f3fff700 1 -- 172.21.15.80:0/442517078 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v190) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff1e40078c0 con 0x7ff1fc10e970 2019-11-28T11:54:09.756 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:54:09.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.702+0000 7ff2013de700 1 -- 172.21.15.80:0/442517078 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1e0018730 msgr2=0x7ff1e001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.702+0000 7ff2013de700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1e0018730 0x7ff1e001abc0 crc :-1 s=READY pgs=1036 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:09.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.702+0000 7ff2013de700 1 -- 172.21.15.80:0/442517078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc10e970 msgr2=0x7ff1fc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.702+0000 7ff2013de700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc10e970 0x7ff1fc1087b0 secure :-1 s=READY pgs=2520 cs=0 l=1 rx=0x7ff1e4010460 tx=0x7ff1e4010290).stop 2019-11-28T11:54:09.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.702+0000 7ff2013de700 1 -- 172.21.15.80:0/442517078 shutdown_connections 2019-11-28T11:54:09.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.702+0000 7ff2013de700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff1e0018730 0x7ff1e001abc0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:09.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.702+0000 7ff2013de700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff1fc108cf0 0x7ff1fc107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:09.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.702+0000 7ff2013de700 1 --2- 172.21.15.80:0/442517078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1fc10e970 0x7ff1fc1087b0 unknown :-1 s=CLOSED pgs=2520 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:09.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.702+0000 7ff2013de700 1 -- 172.21.15.80:0/442517078 shutdown_connections 2019-11-28T11:54:09.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.702+0000 7ff2013de700 1 -- 172.21.15.80:0/442517078 wait complete. 2019-11-28T11:54:09.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.702+0000 7ff2013de700 1 -- 172.21.15.80:0/442517078 >> 172.21.15.80:0/442517078 conn(0x7ff1fc15e2d0 msgr2=0x7ff1fc147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:09.767 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:54:09.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.837+0000 7fc6ff568700 1 Processor -- start 2019-11-28T11:54:09.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.837+0000 7fc6ff568700 1 -- start start 2019-11-28T11:54:09.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.838+0000 7fc6ff568700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc6f81639f0 0x7fc6f8165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:09.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.838+0000 7fc6ff568700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f806db60 con 0x7fc6f815ed10 2019-11-28T11:54:09.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.838+0000 7fc6ff568700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f806e060 con 0x7fc6f815f100 2019-11-28T11:54:09.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.838+0000 7fc6ff568700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f806fe00 con 0x7fc6f81639f0 2019-11-28T11:54:09.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.838+0000 7fc6fdb05700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc6f815ed10 0x7fc6f8073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44186/0 (socket says 172.21.15.80:44186) 2019-11-28T11:54:09.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.838+0000 7fc6fdb05700 1 -- 172.21.15.80:0/1618315488 learned_addr learned my addr 172.21.15.80:0/1618315488 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:09.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.838+0000 7fc6fe306700 1 --2- 172.21.15.80:0/1618315488 >> v2:172.21.15.174:3300/0 conn(0x7fc6f81639f0 0x7fc6f8165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:09.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.838+0000 7fc6fcb03700 1 -- 172.21.15.80:0/1618315488 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424656933 0 0) 0x7fc6e80014d0 con 0x7fc6f815ed10 2019-11-28T11:54:09.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.838+0000 7fc6fcb03700 1 -- 172.21.15.80:0/1618315488 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6e0002e80 con 0x7fc6f815ed10 2019-11-28T11:54:09.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fcb03700 1 -- 172.21.15.80:0/1618315488 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1676832220 0 0) 0x7fc6e80014b0 con 0x7fc6f815ed10 2019-11-28T11:54:09.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fcb03700 1 -- 172.21.15.80:0/1618315488 >> v2:172.21.15.174:3300/0 conn(0x7fc6f81639f0 msgr2=0x7fc6f8165df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:09.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fcb03700 1 --2- 172.21.15.80:0/1618315488 >> v2:172.21.15.174:3300/0 conn(0x7fc6f81639f0 0x7fc6f8165df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:09.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fcb03700 1 -- 172.21.15.80:0/1618315488 >> v1:172.21.15.174:6789/0 conn(0x7fc6f815f100 legacy=0x7fc6f806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fcb03700 1 -- 172.21.15.80:0/1618315488 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f8070760 con 0x7fc6f815ed10 2019-11-28T11:54:09.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fcb03700 1 -- 172.21.15.80:0/1618315488 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc6e80019e0 con 0x7fc6f815ed10 2019-11-28T11:54:09.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fcb03700 1 -- 172.21.15.80:0/1618315488 >> v1:172.21.15.80:6789/0 conn(0x7fc6f815ed10 legacy=0x7fc6f8073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fcb03700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6e0003a80 0x7fc6e0005ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:09.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fcb03700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6e0006690 0x7fc6e0008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:09.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fcb03700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6e00093a0 0x7fc6e000b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:09.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fcb03700 1 -- 172.21.15.80:0/1618315488 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e000c020 con 0x7fc6e00093a0 2019-11-28T11:54:09.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fcb03700 1 -- 172.21.15.80:0/1618315488 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0050260 con 0x7fc6e0006690 2019-11-28T11:54:09.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fe306700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6e00093a0 0x7fc6e000b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:09.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fcb03700 1 -- 172.21.15.80:0/1618315488 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0050450 con 0x7fc6e0003a80 2019-11-28T11:54:09.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fdb05700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6e0003a80 0x7fc6e0005ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:09.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fd304700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6e0006690 0x7fc6e0008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:09.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fe306700 1 -- 172.21.15.80:0/1618315488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6e0003a80 msgr2=0x7fc6e0005ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:09.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fe306700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6e0003a80 0x7fc6e0005ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:09.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fe306700 1 -- 172.21.15.80:0/1618315488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6e0006690 msgr2=0x7fc6e0008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:09.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fe306700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6e0006690 0x7fc6e0008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:09.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fe306700 1 -- 172.21.15.80:0/1618315488 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e0050700 con 0x7fc6e00093a0 2019-11-28T11:54:09.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fd304700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6e0006690 0x7fc6e0008b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:09.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fdb05700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6e0003a80 0x7fc6e0005ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:09.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fe306700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6e00093a0 0x7fc6e000b870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc6f000e8a0 tx=0x7fc6f000e990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fe306700 1 -- 172.21.15.80:0/1618315488 reap_dead start 2019-11-28T11:54:09.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fe306700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6e00093a0 0x7fc6e000b870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc6f000e8a0 tx=0x7fc6f000e990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fe306700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6e00093a0 0x7fc6e000b870 secure :-1 s=READY pgs=2522 cs=0 l=1 rx=0x7fc6f000e8a0 tx=0x7fc6f000e990).ready entity=mon.0 client_cookie=597b085852d71577 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:09.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fe306700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6e00093a0 0x7fc6e000b870 secure :-1 s=THROTTLE_DONE pgs=2522 cs=0 l=1 rx=0x7fc6f000e8a0 tx=0x7fc6f000e990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fe306700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6e00093a0 0x7fc6e000b870 secure :-1 s=THROTTLE_DONE pgs=2522 cs=0 l=1 rx=0x7fc6f000e8a0 tx=0x7fc6f000e990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fcb03700 1 -- 172.21.15.80:0/1618315488 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6f000edf0 con 0x7fc6e00093a0 2019-11-28T11:54:09.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fe306700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6e00093a0 0x7fc6e000b870 secure :-1 s=THROTTLE_DONE pgs=2522 cs=0 l=1 rx=0x7fc6f000e8a0 tx=0x7fc6f000e990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fcb03700 1 -- 172.21.15.80:0/1618315488 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f000ea10 con 0x7fc6e00093a0 2019-11-28T11:54:09.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6fcb03700 1 -- 172.21.15.80:0/1618315488 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6f000f470 con 0x7fc6e00093a0 2019-11-28T11:54:09.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6ff568700 1 -- 172.21.15.80:0/1618315488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6e00093a0 msgr2=0x7fc6e000b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.839+0000 7fc6ff568700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6e00093a0 0x7fc6e000b870 secure :-1 s=READY pgs=2522 cs=0 l=1 rx=0x7fc6f000e8a0 tx=0x7fc6f000e990).stop 2019-11-28T11:54:09.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.840+0000 7fc6ff568700 1 -- 172.21.15.80:0/1618315488 shutdown_connections 2019-11-28T11:54:09.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.840+0000 7fc6ff568700 1 --2- 172.21.15.80:0/1618315488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc6e00093a0 0x7fc6e000b870 unknown :-1 s=CLOSED pgs=2522 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:09.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.840+0000 7fc6ff568700 1 -- 172.21.15.80:0/1618315488 shutdown_connections 2019-11-28T11:54:09.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.840+0000 7fc6ff568700 1 -- 172.21.15.80:0/1618315488 wait complete. 2019-11-28T11:54:09.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.840+0000 7fc6ff568700 1 -- 172.21.15.80:0/1618315488 >> 172.21.15.80:0/1618315488 conn(0x7fc6f8061d20 msgr2=0x7fc6f80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:09.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.843+0000 7fc6ff568700 1 Processor -- start 2019-11-28T11:54:09.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.843+0000 7fc6ff568700 1 -- start start 2019-11-28T11:54:09.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.843+0000 7fc6ff568700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc6f8166d70 0x7fc6f8169170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:09.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.843+0000 7fc6ff568700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f8133a20 con 0x7fc6f8108630 2019-11-28T11:54:09.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.843+0000 7fc6ff568700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f8109fc0 con 0x7fc6f81502e0 2019-11-28T11:54:09.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.843+0000 7fc6ff568700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f8131980 con 0x7fc6f8166d70 2019-11-28T11:54:09.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.843+0000 7fc6fdb05700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc6f8108630 0x7fc6f8151200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44198/0 (socket says 172.21.15.80:44198) 2019-11-28T11:54:09.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.843+0000 7fc6fdb05700 1 -- 172.21.15.80:0/3128102989 learned_addr learned my addr 172.21.15.80:0/3128102989 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:09.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6fe306700 1 --2- 172.21.15.80:0/3128102989 >> v2:172.21.15.174:3300/0 conn(0x7fc6f8166d70 0x7fc6f8169170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:09.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6f67fc700 1 -- 172.21.15.80:0/3128102989 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001817009 0 0) 0x7fc6e8001e00 con 0x7fc6f8108630 2019-11-28T11:54:09.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6f67fc700 1 -- 172.21.15.80:0/3128102989 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6d8002e80 con 0x7fc6f8108630 2019-11-28T11:54:09.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6f67fc700 1 -- 172.21.15.80:0/3128102989 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3299387158 0 0) 0x7fc6e8002020 con 0x7fc6f8108630 2019-11-28T11:54:09.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6f67fc700 1 -- 172.21.15.80:0/3128102989 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc6d80032e0 con 0x7fc6f8108630 2019-11-28T11:54:09.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6f67fc700 1 -- 172.21.15.80:0/3128102989 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc6e8001660 con 0x7fc6f8108630 2019-11-28T11:54:09.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6fe306700 1 -- 172.21.15.80:0/3128102989 >> v1:172.21.15.174:6789/0 conn(0x7fc6f81502e0 legacy=0x7fc6f8150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6fe306700 1 -- 172.21.15.80:0/3128102989 >> v1:172.21.15.80:6789/0 conn(0x7fc6f8108630 legacy=0x7fc6f8151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:09.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6fe306700 1 -- 172.21.15.80:0/3128102989 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f81322e0 con 0x7fc6f8166d70 2019-11-28T11:54:09.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6fe306700 1 --2- 172.21.15.80:0/3128102989 >> v2:172.21.15.174:3300/0 conn(0x7fc6f8166d70 0x7fc6f8169170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc6f00103b0 tx=0x7fc6f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6fe306700 1 --2- 172.21.15.80:0/3128102989 >> v2:172.21.15.174:3300/0 conn(0x7fc6f8166d70 0x7fc6f8169170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc6f00103b0 tx=0x7fc6f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6fe306700 1 --2- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6f8166d70 0x7fc6f8169170 secure :-1 s=READY pgs=1522 cs=0 l=1 rx=0x7fc6f00103b0 tx=0x7fc6f0010750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:09.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6fe306700 1 --2- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6f8166d70 0x7fc6f8169170 secure :-1 s=THROTTLE_DONE pgs=1522 cs=0 l=1 rx=0x7fc6f00103b0 tx=0x7fc6f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6f67fc700 1 -- 172.21.15.80:0/3128102989 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6f000e0b0 con 0x7fc6f8166d70 2019-11-28T11:54:09.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6fe306700 1 --2- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6f8166d70 0x7fc6f8169170 secure :-1 s=THROTTLE_DONE pgs=1522 cs=0 l=1 rx=0x7fc6f00103b0 tx=0x7fc6f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6fe306700 1 --2- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6f8166d70 0x7fc6f8169170 secure :-1 s=THROTTLE_DONE pgs=1522 cs=0 l=1 rx=0x7fc6f00103b0 tx=0x7fc6f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6f67fc700 1 -- 172.21.15.80:0/3128102989 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f000e9a0 con 0x7fc6f8166d70 2019-11-28T11:54:09.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6f67fc700 1 -- 172.21.15.80:0/3128102989 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6f000f070 con 0x7fc6f8166d70 2019-11-28T11:54:09.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.844+0000 7fc6ff568700 1 -- 172.21.15.80:0/3128102989 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f8132660 con 0x7fc6f8166d70 2019-11-28T11:54:09.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.845+0000 7fc6ff568700 1 -- 172.21.15.80:0/3128102989 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f81322e0 con 0x7fc6f8166d70 2019-11-28T11:54:09.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.845+0000 7fc6fe306700 1 --2- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6f8166d70 0x7fc6f8169170 secure :-1 s=THROTTLE_DONE pgs=1522 cs=0 l=1 rx=0x7fc6f00103b0 tx=0x7fc6f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.845+0000 7fc6f67fc700 1 -- 172.21.15.80:0/3128102989 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc6f000e0b0 con 0x7fc6f8166d70 2019-11-28T11:54:09.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.845+0000 7fc6fe306700 1 --2- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6f8166d70 0x7fc6f8169170 secure :-1 s=THROTTLE_DONE pgs=1522 cs=0 l=1 rx=0x7fc6f00103b0 tx=0x7fc6f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.845+0000 7fc6f67fc700 1 --2- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc6d8018770 0x7fc6d801ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:09.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.845+0000 7fc6f67fc700 1 -- 172.21.15.80:0/3128102989 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc6f0031a80 con 0x7fc6f8166d70 2019-11-28T11:54:09.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.845+0000 7fc6fdb05700 1 --2- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc6d8018770 0x7fc6d801ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:09.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.846+0000 7fc6fdb05700 1 --2- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc6d8018770 0x7fc6d801ac00 crc :-1 s=READY pgs=1037 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:09.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.852+0000 7fc6ff568700 1 -- 172.21.15.80:0/3128102989 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f8132660 con 0x7fc6f8166d70 2019-11-28T11:54:09.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.856+0000 7fc6fe306700 1 --2- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6f8166d70 0x7fc6f8169170 secure :-1 s=THROTTLE_DONE pgs=1522 cs=0 l=1 rx=0x7fc6f00103b0 tx=0x7fc6f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:09.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:09.856+0000 7fc6f67fc700 1 -- 172.21.15.80:0/3128102989 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc6f0017420 con 0x7fc6f8166d70 2019-11-28T11:54:10.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.023+0000 7fc6ff568700 1 -- 172.21.15.80:0/3128102989 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fc6f81322e0 con 0x7fc6f8166d70 2019-11-28T11:54:10.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.024+0000 7fc6fe306700 1 --2- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6f8166d70 0x7fc6f8169170 secure :-1 s=THROTTLE_DONE pgs=1522 cs=0 l=1 rx=0x7fc6f00103b0 tx=0x7fc6f0010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.024+0000 7fc6f67fc700 1 -- 172.21.15.80:0/3128102989 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v190) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc6f000e0b0 con 0x7fc6f8166d70 2019-11-28T11:54:10.079 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:54:10.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.026+0000 7fc6ff568700 1 -- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc6d8018770 msgr2=0x7fc6d801ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.026+0000 7fc6ff568700 1 --2- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc6d8018770 0x7fc6d801ac00 crc :-1 s=READY pgs=1037 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:10.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.026+0000 7fc6ff568700 1 -- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6f8166d70 msgr2=0x7fc6f8169170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.026+0000 7fc6ff568700 1 --2- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6f8166d70 0x7fc6f8169170 secure :-1 s=READY pgs=1522 cs=0 l=1 rx=0x7fc6f00103b0 tx=0x7fc6f0010750).stop 2019-11-28T11:54:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.026+0000 7fc6ff568700 1 -- 172.21.15.80:0/3128102989 shutdown_connections 2019-11-28T11:54:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.026+0000 7fc6ff568700 1 --2- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6f8166d70 0x7fc6f8169170 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.026+0000 7fc6ff568700 1 --2- 172.21.15.80:0/3128102989 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc6d8018770 0x7fc6d801ac00 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.026+0000 7fc6ff568700 1 -- 172.21.15.80:0/3128102989 shutdown_connections 2019-11-28T11:54:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.026+0000 7fc6ff568700 1 -- 172.21.15.80:0/3128102989 wait complete. 2019-11-28T11:54:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.026+0000 7fc6ff568700 1 -- 172.21.15.80:0/3128102989 >> 172.21.15.80:0/3128102989 conn(0x7fc6f814dbb0 msgr2=0x7fc6f8142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:10.091 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:54:10.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.158+0000 7f7255add700 1 Processor -- start 2019-11-28T11:54:10.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.158+0000 7f7255add700 1 -- start start 2019-11-28T11:54:10.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.159+0000 7f7255add700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f725015ed10 0x7f725015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:10.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.159+0000 7f7255add700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7250073020 0x7f7250071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:10.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.159+0000 7f7255add700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725006db60 con 0x7f72500734b0 2019-11-28T11:54:10.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.159+0000 7f7255add700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725006f3d0 con 0x7f7250073020 2019-11-28T11:54:10.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.159+0000 7f7255add700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725006fe00 con 0x7f725015ed10 2019-11-28T11:54:10.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f7247fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7250073020 0x7f7250071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:10.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f7247fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7250073020 0x7f7250071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44890/0 (socket says 172.21.15.80:44890) 2019-11-28T11:54:10.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f7247fff700 1 -- 172.21.15.80:0/3026530161 learned_addr learned my addr 172.21.15.80:0/3026530161 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:10.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f724ffff700 1 --2- 172.21.15.80:0/3026530161 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f725015ed10 0x7f725015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:10.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f7247fff700 1 -- 172.21.15.80:0/3026530161 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f725015ed10 msgr2=0x7f725015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:10.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f7247fff700 1 --2- 172.21.15.80:0/3026530161 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f725015ed10 0x7f725015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:10.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f7247fff700 1 -- 172.21.15.80:0/3026530161 >> v1:172.21.15.80:6789/0 conn(0x7f72500734b0 legacy=0x7f72500723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f7247fff700 1 -- 172.21.15.80:0/3026530161 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250070760 con 0x7f7250073020 2019-11-28T11:54:10.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f7247fff700 1 --2- 172.21.15.80:0/3026530161 >> v2:172.21.15.80:3300/0 conn(0x7f7250073020 0x7f7250071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f723800f6c0 tx=0x7f723800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f7247fff700 1 --2- 172.21.15.80:0/3026530161 >> v2:172.21.15.80:3300/0 conn(0x7f7250073020 0x7f7250071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f723800f6c0 tx=0x7f723800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f7247fff700 1 --2- 172.21.15.80:0/3026530161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7250073020 0x7f7250071ea0 secure :-1 s=READY pgs=2525 cs=0 l=1 rx=0x7f723800f6c0 tx=0x7f723800fa60).ready entity=mon.0 client_cookie=eaa432af596a380d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:10.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f7247fff700 1 --2- 172.21.15.80:0/3026530161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7250073020 0x7f7250071ea0 secure :-1 s=THROTTLE_DONE pgs=2525 cs=0 l=1 rx=0x7f723800f6c0 tx=0x7f723800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f7247fff700 1 --2- 172.21.15.80:0/3026530161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7250073020 0x7f7250071ea0 secure :-1 s=THROTTLE_DONE pgs=2525 cs=0 l=1 rx=0x7f723800f6c0 tx=0x7f723800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f724f7fe700 1 -- 172.21.15.80:0/3026530161 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7238000960 con 0x7f7250073020 2019-11-28T11:54:10.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f7247fff700 1 --2- 172.21.15.80:0/3026530161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7250073020 0x7f7250071ea0 secure :-1 s=THROTTLE_DONE pgs=2525 cs=0 l=1 rx=0x7f723800f6c0 tx=0x7f723800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f724f7fe700 1 -- 172.21.15.80:0/3026530161 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7238000c90 con 0x7f7250073020 2019-11-28T11:54:10.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f724f7fe700 1 -- 172.21.15.80:0/3026530161 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72380013a0 con 0x7f7250073020 2019-11-28T11:54:10.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f7255add700 1 -- 172.21.15.80:0/3026530161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7250073020 msgr2=0x7f7250071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.160+0000 7f7255add700 1 --2- 172.21.15.80:0/3026530161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7250073020 0x7f7250071ea0 secure :-1 s=READY pgs=2525 cs=0 l=1 rx=0x7f723800f6c0 tx=0x7f723800fa60).stop 2019-11-28T11:54:10.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.161+0000 7f7255add700 1 -- 172.21.15.80:0/3026530161 shutdown_connections 2019-11-28T11:54:10.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.161+0000 7f7255add700 1 --2- 172.21.15.80:0/3026530161 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7250073020 0x7f7250071ea0 unknown :-1 s=CLOSED pgs=2525 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:10.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.161+0000 7f7255add700 1 --2- 172.21.15.80:0/3026530161 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f725015ed10 0x7f725015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:10.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.161+0000 7f7255add700 1 -- 172.21.15.80:0/3026530161 shutdown_connections 2019-11-28T11:54:10.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.161+0000 7f7255add700 1 -- 172.21.15.80:0/3026530161 wait complete. 2019-11-28T11:54:10.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.161+0000 7f7255add700 1 -- 172.21.15.80:0/3026530161 >> 172.21.15.80:0/3026530161 conn(0x7f7250061d20 msgr2=0x7f72500641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:10.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.163+0000 7f7255add700 1 Processor -- start 2019-11-28T11:54:10.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.164+0000 7f7255add700 1 -- start start 2019-11-28T11:54:10.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.164+0000 7f7255add700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f725010e970 0x7f72501087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:10.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.164+0000 7f7255add700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725010c250 con 0x7f7250108cf0 2019-11-28T11:54:10.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.164+0000 7f7255add700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725010c6d0 con 0x7f7250107e30 2019-11-28T11:54:10.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.164+0000 7f7255add700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725010e430 con 0x7f725010e970 2019-11-28T11:54:10.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f7247fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7250108cf0 0x7f7250107630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44212/0 (socket says 172.21.15.80:44212) 2019-11-28T11:54:10.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f7247fff700 1 -- 172.21.15.80:0/4083996054 learned_addr learned my addr 172.21.15.80:0/4083996054 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:10.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724ffff700 1 --2- 172.21.15.80:0/4083996054 >> v2:172.21.15.174:3300/0 conn(0x7f725010e970 0x7f72501087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:10.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499033467 0 0) 0x7f72380075d0 con 0x7f7250108cf0 2019-11-28T11:54:10.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7234002e80 con 0x7f7250108cf0 2019-11-28T11:54:10.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686291597 0 0) 0x7f7248001070 con 0x7f7250107e30 2019-11-28T11:54:10.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72340030b0 con 0x7f7250107e30 2019-11-28T11:54:10.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 612677009 0 0) 0x7f72380079e0 con 0x7f7250108cf0 2019-11-28T11:54:10.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7234004680 con 0x7f7250108cf0 2019-11-28T11:54:10.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f7238000940 con 0x7f7250108cf0 2019-11-28T11:54:10.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 >> v2:172.21.15.174:3300/0 conn(0x7f725010e970 msgr2=0x7f72501087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 --2- 172.21.15.80:0/4083996054 >> v2:172.21.15.174:3300/0 conn(0x7f725010e970 0x7f72501087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:10.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 >> v1:172.21.15.174:6789/0 conn(0x7f7250107e30 legacy=0x7f7250167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 >> v1:172.21.15.80:6789/0 conn(0x7f7250108cf0 legacy=0x7f7250107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7234003880 0x7f7234003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7234004240 0x7f7234008720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7234008f80 0x7f723400b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723400bc00 con 0x7f7234004240 2019-11-28T11:54:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723400be30 con 0x7f7234003880 2019-11-28T11:54:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723400c060 con 0x7f7234008f80 2019-11-28T11:54:10.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f7247fff700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7234004240 0x7f7234008720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:10.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f724ffff700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7234003880 0x7f7234003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:10.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f725487b700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7234008f80 0x7f723400b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:10.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f7247fff700 1 -- 172.21.15.80:0/4083996054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7234008f80 msgr2=0x7f723400b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f7247fff700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7234008f80 0x7f723400b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:10.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f7247fff700 1 -- 172.21.15.80:0/4083996054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7234003880 msgr2=0x7f7234003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f7247fff700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7234003880 0x7f7234003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:10.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.165+0000 7f7247fff700 1 -- 172.21.15.80:0/4083996054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723400c310 con 0x7f7234004240 2019-11-28T11:54:10.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f725487b700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7234008f80 0x7f723400b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:10.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f7255add700 1 -- 172.21.15.80:0/4083996054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7250106270 con 0x7f7234004240 2019-11-28T11:54:10.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f725487b700 1 -- 172.21.15.80:0/4083996054 reap_dead start 2019-11-28T11:54:10.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f7247fff700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7234004240 0x7f7234008720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f72380104a0 tx=0x7f7238010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f7255add700 1 -- 172.21.15.80:0/4083996054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7250105ef0 con 0x7f7234004240 2019-11-28T11:54:10.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f7247fff700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7234004240 0x7f7234008720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f72380104a0 tx=0x7f7238010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f7247fff700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7234004240 0x7f7234008720 secure :-1 s=READY pgs=2527 cs=0 l=1 rx=0x7f72380104a0 tx=0x7f7238010350).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:10.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f7247fff700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7234004240 0x7f7234008720 secure :-1 s=THROTTLE_DONE pgs=2527 cs=0 l=1 rx=0x7f72380104a0 tx=0x7f7238010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7238007c00 con 0x7f7234004240 2019-11-28T11:54:10.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f7247fff700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7234004240 0x7f7234008720 secure :-1 s=THROTTLE_DONE pgs=2527 cs=0 l=1 rx=0x7f72380104a0 tx=0x7f7238010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7238007c00 con 0x7f7234004240 2019-11-28T11:54:10.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f7247fff700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7234004240 0x7f7234008720 secure :-1 s=THROTTLE_DONE pgs=2527 cs=0 l=1 rx=0x7f72380104a0 tx=0x7f7238010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7238005390 con 0x7f7234004240 2019-11-28T11:54:10.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f7247fff700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7234004240 0x7f7234008720 secure :-1 s=THROTTLE_DONE pgs=2527 cs=0 l=1 rx=0x7f72380104a0 tx=0x7f7238010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7238007ef0 con 0x7f7234004240 2019-11-28T11:54:10.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f7247fff700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7234004240 0x7f7234008720 secure :-1 s=THROTTLE_DONE pgs=2527 cs=0 l=1 rx=0x7f72380104a0 tx=0x7f7238010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f724d7fa700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f723401b490 0x7f723401d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:10.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.166+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7238031c30 con 0x7f7234004240 2019-11-28T11:54:10.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.167+0000 7f724ffff700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f723401b490 0x7f723401d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:10.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.167+0000 7f724ffff700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f723401b490 0x7f723401d8c0 crc :-1 s=READY pgs=1038 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:10.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.174+0000 7f7255add700 1 -- 172.21.15.80:0/4083996054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7228002e60 con 0x7f7234004240 2019-11-28T11:54:10.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.177+0000 7f7247fff700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7234004240 0x7f7234008720 secure :-1 s=THROTTLE_DONE pgs=2527 cs=0 l=1 rx=0x7f72380104a0 tx=0x7f7238010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.177+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7238017360 con 0x7f7234004240 2019-11-28T11:54:10.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.344+0000 7f7255add700 1 -- 172.21.15.80:0/4083996054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f7228001d30 con 0x7f7234004240 2019-11-28T11:54:10.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.344+0000 7f7247fff700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7234004240 0x7f7234008720 secure :-1 s=THROTTLE_DONE pgs=2527 cs=0 l=1 rx=0x7f72380104a0 tx=0x7f7238010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.344+0000 7f724d7fa700 1 -- 172.21.15.80:0/4083996054 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v190) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7238007c00 con 0x7f7234004240 2019-11-28T11:54:10.400 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:54:10.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.346+0000 7f7255add700 1 -- 172.21.15.80:0/4083996054 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f723401b490 msgr2=0x7f723401d8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.346+0000 7f7255add700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f723401b490 0x7f723401d8c0 crc :-1 s=READY pgs=1038 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:10.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.346+0000 7f7255add700 1 -- 172.21.15.80:0/4083996054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7234004240 msgr2=0x7f7234008720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.346+0000 7f7255add700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7234004240 0x7f7234008720 secure :-1 s=READY pgs=2527 cs=0 l=1 rx=0x7f72380104a0 tx=0x7f7238010350).stop 2019-11-28T11:54:10.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.346+0000 7f7255add700 1 -- 172.21.15.80:0/4083996054 shutdown_connections 2019-11-28T11:54:10.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.346+0000 7f7255add700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f723401b490 0x7f723401d8c0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:10.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.346+0000 7f7255add700 1 --2- 172.21.15.80:0/4083996054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7234004240 0x7f7234008720 unknown :-1 s=CLOSED pgs=2527 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:10.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.346+0000 7f7255add700 1 -- 172.21.15.80:0/4083996054 shutdown_connections 2019-11-28T11:54:10.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.346+0000 7f7255add700 1 -- 172.21.15.80:0/4083996054 wait complete. 2019-11-28T11:54:10.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.346+0000 7f7255add700 1 -- 172.21.15.80:0/4083996054 >> 172.21.15.80:0/4083996054 conn(0x7f725015e2d0 msgr2=0x7f7250147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:10.411 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:54:10.412 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:10.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.475+0000 7fd18fe29700 1 Processor -- start 2019-11-28T11:54:10.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.475+0000 7fd18fe29700 1 -- start start 2019-11-28T11:54:10.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.476+0000 7fd18fe29700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd18806c0a0 0x7fd188072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:10.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.476+0000 7fd18fe29700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd188072620 0x7fd188164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:10.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.476+0000 7fd18fe29700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18806db00 con 0x7fd1880734e0 2019-11-28T11:54:10.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.476+0000 7fd18fe29700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd18806fd60 con 0x7fd188072620 2019-11-28T11:54:10.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.476+0000 7fd18fe29700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd188070030 con 0x7fd18806c0a0 2019-11-28T11:54:10.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.476+0000 7fd18ebc7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd188072620 0x7fd188164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:10.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.476+0000 7fd18ebc7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd188072620 0x7fd188164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44908/0 (socket says 172.21.15.80:44908) 2019-11-28T11:54:10.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.476+0000 7fd18ebc7700 1 -- 172.21.15.80:0/2343379894 learned_addr learned my addr 172.21.15.80:0/2343379894 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:10.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.477+0000 7fd18e3c6700 1 --2- 172.21.15.80:0/2343379894 >> v2:172.21.15.174:3300/0 conn(0x7fd18806c0a0 0x7fd188072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:10.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.477+0000 7fd18ebc7700 1 -- 172.21.15.80:0/2343379894 >> v2:172.21.15.174:3300/0 conn(0x7fd18806c0a0 msgr2=0x7fd188072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:10.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.477+0000 7fd18ebc7700 1 --2- 172.21.15.80:0/2343379894 >> v2:172.21.15.174:3300/0 conn(0x7fd18806c0a0 0x7fd188072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:10.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.477+0000 7fd18ebc7700 1 -- 172.21.15.80:0/2343379894 >> v1:172.21.15.174:6789/0 conn(0x7fd1880734e0 legacy=0x7fd188071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.477+0000 7fd18ebc7700 1 -- 172.21.15.80:0/2343379894 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1880706c0 con 0x7fd188072620 2019-11-28T11:54:10.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.477+0000 7fd18ebc7700 1 --2- 172.21.15.80:0/2343379894 >> v2:172.21.15.80:3300/0 conn(0x7fd188072620 0x7fd188164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd17000f730 tx=0x7fd170007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.477+0000 7fd18ebc7700 1 --2- 172.21.15.80:0/2343379894 >> v2:172.21.15.80:3300/0 conn(0x7fd188072620 0x7fd188164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd17000f730 tx=0x7fd170007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.477+0000 7fd18ebc7700 1 --2- 172.21.15.80:0/2343379894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd188072620 0x7fd188164d70 secure :-1 s=READY pgs=2528 cs=0 l=1 rx=0x7fd17000f730 tx=0x7fd170007d50).ready entity=mon.0 client_cookie=f5ef059ee6fbcb5d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:10.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.477+0000 7fd18ebc7700 1 --2- 172.21.15.80:0/2343379894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd188072620 0x7fd188164d70 secure :-1 s=THROTTLE_DONE pgs=2528 cs=0 l=1 rx=0x7fd17000f730 tx=0x7fd170007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.477+0000 7fd18d3c4700 1 -- 172.21.15.80:0/2343379894 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd170000a70 con 0x7fd188072620 2019-11-28T11:54:10.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.477+0000 7fd18ebc7700 1 --2- 172.21.15.80:0/2343379894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd188072620 0x7fd188164d70 secure :-1 s=THROTTLE_DONE pgs=2528 cs=0 l=1 rx=0x7fd17000f730 tx=0x7fd170007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.477+0000 7fd18ebc7700 1 --2- 172.21.15.80:0/2343379894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd188072620 0x7fd188164d70 secure :-1 s=THROTTLE_DONE pgs=2528 cs=0 l=1 rx=0x7fd17000f730 tx=0x7fd170007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.477+0000 7fd18d3c4700 1 -- 172.21.15.80:0/2343379894 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1700010e0 con 0x7fd188072620 2019-11-28T11:54:10.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.477+0000 7fd18d3c4700 1 -- 172.21.15.80:0/2343379894 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1700017b0 con 0x7fd188072620 2019-11-28T11:54:10.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.477+0000 7fd18fe29700 1 -- 172.21.15.80:0/2343379894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd188072620 msgr2=0x7fd188164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.477+0000 7fd18fe29700 1 --2- 172.21.15.80:0/2343379894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd188072620 0x7fd188164d70 secure :-1 s=READY pgs=2528 cs=0 l=1 rx=0x7fd17000f730 tx=0x7fd170007d50).stop 2019-11-28T11:54:10.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.478+0000 7fd18fe29700 1 -- 172.21.15.80:0/2343379894 shutdown_connections 2019-11-28T11:54:10.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.478+0000 7fd18fe29700 1 --2- 172.21.15.80:0/2343379894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd188072620 0x7fd188164d70 unknown :-1 s=CLOSED pgs=2528 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:10.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.478+0000 7fd18fe29700 1 --2- 172.21.15.80:0/2343379894 >> v2:172.21.15.174:3300/0 conn(0x7fd18806c0a0 0x7fd188072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:10.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.478+0000 7fd18fe29700 1 -- 172.21.15.80:0/2343379894 shutdown_connections 2019-11-28T11:54:10.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.478+0000 7fd18fe29700 1 -- 172.21.15.80:0/2343379894 wait complete. 2019-11-28T11:54:10.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.478+0000 7fd18fe29700 1 -- 172.21.15.80:0/2343379894 >> 172.21.15.80:0/2343379894 conn(0x7fd188061cf0 msgr2=0x7fd188064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:10.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.480+0000 7fd18fe29700 1 Processor -- start 2019-11-28T11:54:10.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.480+0000 7fd18fe29700 1 -- start start 2019-11-28T11:54:10.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.481+0000 7fd18fe29700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1881299b0 0x7fd18811b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:10.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.481+0000 7fd18fe29700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd18811c4b0 0x7fd18811b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:10.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.481+0000 7fd18fe29700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18813f190 con 0x7fd18811bea0 2019-11-28T11:54:10.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.481+0000 7fd18fe29700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd188142320 con 0x7fd18811c4b0 2019-11-28T11:54:10.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.481+0000 7fd18fe29700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd188142d50 con 0x7fd1881299b0 2019-11-28T11:54:10.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.481+0000 7fd18ebc7700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd18811bea0 0x7fd18813e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44234/0 (socket says 172.21.15.80:44234) 2019-11-28T11:54:10.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.481+0000 7fd18ebc7700 1 -- 172.21.15.80:0/2882123600 learned_addr learned my addr 172.21.15.80:0/2882123600 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:10.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd18e3c6700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1881299b0 0x7fd18811b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:10.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774988505 0 0) 0x7fd170000940 con 0x7fd18811bea0 2019-11-28T11:54:10.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd18dbc5700 1 --2- 172.21.15.80:0/2882123600 >> v2:172.21.15.174:3300/0 conn(0x7fd18811c4b0 0x7fd18811b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:10.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd16c002e80 con 0x7fd18811bea0 2019-11-28T11:54:10.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3864636895 0 0) 0x7fd170000b60 con 0x7fd18811bea0 2019-11-28T11:54:10.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd16c0032e0 con 0x7fd18811bea0 2019-11-28T11:54:10.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd170007bf0 con 0x7fd18811bea0 2019-11-28T11:54:10.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1881299b0 msgr2=0x7fd18811b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd186ffd700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1881299b0 0x7fd18811b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:10.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 >> v2:172.21.15.174:3300/0 conn(0x7fd18811c4b0 msgr2=0x7fd18811b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd186ffd700 1 --2- 172.21.15.80:0/2882123600 >> v2:172.21.15.174:3300/0 conn(0x7fd18811c4b0 0x7fd18811b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:10.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 >> v1:172.21.15.80:6789/0 conn(0x7fd18811bea0 legacy=0x7fd18813e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd186ffd700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd16c003610 0x7fd16c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:10.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd186ffd700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd16c003fa0 0x7fd16c004410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:10.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd186ffd700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd16c0049a0 0x7fd16c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:10.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c00bbc0 con 0x7fd16c003fa0 2019-11-28T11:54:10.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c010200 con 0x7fd16c0049a0 2019-11-28T11:54:10.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c0103f0 con 0x7fd16c003610 2019-11-28T11:54:10.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd18e3c6700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1881299b0 0x7fd18811b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:10.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd18dbc5700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd16c003fa0 0x7fd16c004410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:10.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd18ebc7700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd16c0049a0 0x7fd16c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:10.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd18e3c6700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd16c003610 0x7fd16c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:10.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd18dbc5700 1 -- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd16c003610 msgr2=0x7fd16c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd18dbc5700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd16c003610 0x7fd16c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:10.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd18dbc5700 1 -- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd16c0049a0 msgr2=0x7fd16c004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd18dbc5700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd16c0049a0 0x7fd16c004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:10.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd18dbc5700 1 -- 172.21.15.80:0/2882123600 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c0106a0 con 0x7fd16c003fa0 2019-11-28T11:54:10.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd18fe29700 1 -- 172.21.15.80:0/2882123600 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd188119f20 con 0x7fd16c003fa0 2019-11-28T11:54:10.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd18dbc5700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd16c003fa0 0x7fd16c004410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd17800d7b0 tx=0x7fd17800e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.482+0000 7fd18fe29700 1 -- 172.21.15.80:0/2882123600 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd188119ba0 con 0x7fd16c003fa0 2019-11-28T11:54:10.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.483+0000 7fd18dbc5700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd16c003fa0 0x7fd16c004410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd17800d7b0 tx=0x7fd17800e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.483+0000 7fd18dbc5700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd16c003fa0 0x7fd16c004410 secure :-1 s=READY pgs=2530 cs=0 l=1 rx=0x7fd17800d7b0 tx=0x7fd17800e800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:10.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.483+0000 7fd18dbc5700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd16c003fa0 0x7fd16c004410 secure :-1 s=THROTTLE_DONE pgs=2530 cs=0 l=1 rx=0x7fd17800d7b0 tx=0x7fd17800e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.483+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd17800dd50 con 0x7fd16c003fa0 2019-11-28T11:54:10.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.483+0000 7fd18dbc5700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd16c003fa0 0x7fd16c004410 secure :-1 s=THROTTLE_DONE pgs=2530 cs=0 l=1 rx=0x7fd17800d7b0 tx=0x7fd17800e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.483+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd178009b20 con 0x7fd16c003fa0 2019-11-28T11:54:10.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.483+0000 7fd18dbc5700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd16c003fa0 0x7fd16c004410 secure :-1 s=THROTTLE_DONE pgs=2530 cs=0 l=1 rx=0x7fd17800d7b0 tx=0x7fd17800e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.483+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd178009d10 con 0x7fd16c003fa0 2019-11-28T11:54:10.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.483+0000 7fd18dbc5700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd16c003fa0 0x7fd16c004410 secure :-1 s=THROTTLE_DONE pgs=2530 cs=0 l=1 rx=0x7fd17800d7b0 tx=0x7fd17800e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.483+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd178009d10 con 0x7fd16c003fa0 2019-11-28T11:54:10.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.483+0000 7fd18dbc5700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd16c003fa0 0x7fd16c004410 secure :-1 s=THROTTLE_DONE pgs=2530 cs=0 l=1 rx=0x7fd17800d7b0 tx=0x7fd17800e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.483+0000 7fd186ffd700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd16c024ee0 0x7fd16c027310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:10.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.483+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd1780321b0 con 0x7fd16c003fa0 2019-11-28T11:54:10.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.484+0000 7fd18e3c6700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd16c024ee0 0x7fd16c027310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:10.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.484+0000 7fd18e3c6700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd16c024ee0 0x7fd16c027310 crc :-1 s=READY pgs=1039 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:10.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.491+0000 7fd18fe29700 1 -- 172.21.15.80:0/2882123600 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd188119f20 con 0x7fd16c003fa0 2019-11-28T11:54:10.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.494+0000 7fd18dbc5700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd16c003fa0 0x7fd16c004410 secure :-1 s=THROTTLE_DONE pgs=2530 cs=0 l=1 rx=0x7fd17800d7b0 tx=0x7fd17800e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.494+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd17800ac50 con 0x7fd16c003fa0 2019-11-28T11:54:10.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.667+0000 7fd18fe29700 1 -- 172.21.15.80:0/2882123600 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd188119ba0 con 0x7fd16c003fa0 2019-11-28T11:54:10.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.667+0000 7fd18dbc5700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd16c003fa0 0x7fd16c004410 secure :-1 s=THROTTLE_DONE pgs=2530 cs=0 l=1 rx=0x7fd17800d7b0 tx=0x7fd17800e800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:10.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.667+0000 7fd186ffd700 1 -- 172.21.15.80:0/2882123600 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) v1 ==== 95+0+2454 (secure 0 0 0) 0x7fd178009b20 con 0x7fd16c003fa0 2019-11-28T11:54:10.723 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 153 2019-11-28T11:54:10.723 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:10.724 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":153,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":11286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/867823380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":867823380},{"type":"v1","addr":"172.21.15.174:6835","nonce":867823380}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":151},{"gid":11301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/1741196077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1741196077},{"type":"v1","addr":"172.21.15.80:6833","nonce":1741196077}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":151}],"filesystems":[{"mdsmap":{"epoch":153,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:53:57.302329+0000","modified":"2019-11-28T11:54:04.996007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7541},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7541":{"gid":7541,"name":"b","rank":0,"incarnation":152,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6835/3753292454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3753292454},{"type":"v1","addr":"172.21.15.80:6835","nonce":3753292454}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2019-11-28T11:54:10.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.670+0000 7fd18fe29700 1 -- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd16c024ee0 msgr2=0x7fd16c027310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.670+0000 7fd18fe29700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd16c024ee0 0x7fd16c027310 crc :-1 s=READY pgs=1039 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:10.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.670+0000 7fd18fe29700 1 -- 172.21.15.80:0/2882123600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd16c003fa0 msgr2=0x7fd16c004410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:10.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.670+0000 7fd18fe29700 1 --2- 172.21.15.80:0/2882123600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd16c003fa0 0x7fd16c004410 secure :-1 s=READY pgs=2530 cs=0 l=1 rx=0x7fd17800d7b0 tx=0x7fd17800e800).stop 2019-11-28T11:54:10.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.670+0000 7fd18ebc7700 1 -- 172.21.15.80:0/2882123600 reap_dead start 2019-11-28T11:54:10.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.670+0000 7fd18ebc7700 1 -- 172.21.15.80:0/2882123600 reap_dead start 2019-11-28T11:54:10.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.670+0000 7fd18fe29700 1 -- 172.21.15.80:0/2882123600 shutdown_connections 2019-11-28T11:54:10.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.670+0000 7fd18fe29700 1 -- 172.21.15.80:0/2882123600 shutdown_connections 2019-11-28T11:54:10.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.670+0000 7fd18fe29700 1 -- 172.21.15.80:0/2882123600 wait complete. 2019-11-28T11:54:10.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:10.670+0000 7fd18fe29700 1 -- 172.21.15.80:0/2882123600 >> 172.21.15.80:0/2882123600 conn(0x7fd18813b860 msgr2=0x7fd1881050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:11.036 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7541}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 30, u'failed': [], u'epoch': 153, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [31], u'info': {u'gid_7541': {u'export_targets': [], u'name': u'b', u'incarnation': 152, u'state_seq': 3, u'state': u'up:active', u'gid': 7541, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3753292454, u'type': u'v2', u'addr': u'172.21.15.80:6834'}, {u'nonce': 3753292454, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/3753292454'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:53:57.302329+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:54:04.996007+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:54:11.037 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:54:11.037 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-11-28T11:54:11.164 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:54:11.164 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:54:11.164 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T11:54:11.165 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 7541, 2019-11-28T11:54:11.165 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2019-11-28T11:54:11.165 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2019-11-28T11:54:11.165 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 7.1123711590000003, 2019-11-28T11:54:11.165 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 153, 2019-11-28T11:54:11.165 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 190, 2019-11-28T11:54:11.166 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 190, 2019-11-28T11:54:11.166 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 11.325158878 2019-11-28T11:54:11.166 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:54:11.170 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7541, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.1123711590000003, "mdsmap_epoch": 153, "osdmap_epoch": 190, "osdmap_epoch_barrier": 190, "uptime": 11.325158878 } 2019-11-28T11:54:11.170 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:54:11.170 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:54:11.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:54:11.171 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:54:11.243 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:54:11.243 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:54:11.363 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:54:11.364 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:54:11.364 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:54:11.364 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:54:11.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:54:11.365 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:54:11.434 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:54:11.565 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:54:11.566 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:54:11.566 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:54:11.571 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:54:11.572 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:54:11.694 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:54:11.694 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:54:11.694 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:54:11.699 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:54:11.700 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:54:11.700 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:54:11.700 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:54:11.700 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:54:11.701 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:54:11.701 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:54:11.705 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:54:11.705 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:54:11.707 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:54:11.707 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:54:11.708 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:54:11.708 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:54:11.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.816+0000 7f236243f700 1 Processor -- start 2019-11-28T11:54:11.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.816+0000 7f236243f700 1 -- start start 2019-11-28T11:54:11.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.817+0000 7f236243f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c06c0a0 0x7f235c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:11.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.817+0000 7f236243f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f235c072620 0x7f235c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:11.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.817+0000 7f236243f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235c06db00 con 0x7f235c0734e0 2019-11-28T11:54:11.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.817+0000 7f236243f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235c06f330 con 0x7f235c072620 2019-11-28T11:54:11.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.817+0000 7f236243f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0706c0 con 0x7f235c06c0a0 2019-11-28T11:54:11.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.817+0000 7f235bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f235c0734e0 0x7f235c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44244/0 (socket says 172.21.15.80:44244) 2019-11-28T11:54:11.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.817+0000 7f235bfff700 1 -- 172.21.15.80:0/3093900940 learned_addr learned my addr 172.21.15.80:0/3093900940 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:11.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.817+0000 7f23611dd700 1 --2- 172.21.15.80:0/3093900940 >> v2:172.21.15.174:3300/0 conn(0x7f235c072620 0x7f235c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.817+0000 7f23609dc700 1 --2- 172.21.15.80:0/3093900940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c06c0a0 0x7f235c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.817+0000 7f235b7fe700 1 -- 172.21.15.80:0/3093900940 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641521904 0 0) 0x7f2344001150 con 0x7f235c0734e0 2019-11-28T11:54:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.817+0000 7f235b7fe700 1 -- 172.21.15.80:0/3093900940 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2348002e80 con 0x7f235c0734e0 2019-11-28T11:54:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f23609dc700 1 -- 172.21.15.80:0/3093900940 >> v2:172.21.15.174:3300/0 conn(0x7f235c072620 msgr2=0x7f235c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f23609dc700 1 --2- 172.21.15.80:0/3093900940 >> v2:172.21.15.174:3300/0 conn(0x7f235c072620 0x7f235c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f23609dc700 1 -- 172.21.15.80:0/3093900940 >> v1:172.21.15.80:6789/0 conn(0x7f235c0734e0 legacy=0x7f235c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f235b7fe700 1 -- 172.21.15.80:0/3093900940 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 200633868 0 0) 0x7f2344001130 con 0x7f235c0734e0 2019-11-28T11:54:11.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f23609dc700 1 -- 172.21.15.80:0/3093900940 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c070a40 con 0x7f235c06c0a0 2019-11-28T11:54:11.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f23611dd700 1 --2- 172.21.15.80:0/3093900940 >> v2:172.21.15.174:3300/0 conn(0x7f235c072620 0x7f235c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:11.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f23609dc700 1 --2- 172.21.15.80:0/3093900940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c06c0a0 0x7f235c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f235400b2d0 tx=0x7f235400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f23609dc700 1 --2- 172.21.15.80:0/3093900940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c06c0a0 0x7f235c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f235400b2d0 tx=0x7f235400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f23609dc700 1 --2- 172.21.15.80:0/3093900940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c06c0a0 0x7f235c072fa0 secure :-1 s=READY pgs=360 cs=0 l=1 rx=0x7f235400b2d0 tx=0x7f235400bae0).ready entity=mon.2 client_cookie=4b55aced1e429761 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:11.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f23609dc700 1 --2- 172.21.15.80:0/3093900940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c06c0a0 0x7f235c072fa0 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7f235400b2d0 tx=0x7f235400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f235b7fe700 1 -- 172.21.15.80:0/3093900940 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2354007590 con 0x7f235c06c0a0 2019-11-28T11:54:11.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f23609dc700 1 --2- 172.21.15.80:0/3093900940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c06c0a0 0x7f235c072fa0 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7f235400b2d0 tx=0x7f235400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f23609dc700 1 --2- 172.21.15.80:0/3093900940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c06c0a0 0x7f235c072fa0 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7f235400b2d0 tx=0x7f235400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f235b7fe700 1 -- 172.21.15.80:0/3093900940 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2354009d30 con 0x7f235c06c0a0 2019-11-28T11:54:11.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f235b7fe700 1 -- 172.21.15.80:0/3093900940 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f235400a400 con 0x7f235c06c0a0 2019-11-28T11:54:11.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f236243f700 1 -- 172.21.15.80:0/3093900940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c06c0a0 msgr2=0x7f235c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:11.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.818+0000 7f236243f700 1 --2- 172.21.15.80:0/3093900940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c06c0a0 0x7f235c072fa0 secure :-1 s=READY pgs=360 cs=0 l=1 rx=0x7f235400b2d0 tx=0x7f235400bae0).stop 2019-11-28T11:54:11.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.819+0000 7f236243f700 1 -- 172.21.15.80:0/3093900940 shutdown_connections 2019-11-28T11:54:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.819+0000 7f236243f700 1 --2- 172.21.15.80:0/3093900940 >> v2:172.21.15.174:3300/0 conn(0x7f235c072620 0x7f235c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.819+0000 7f236243f700 1 --2- 172.21.15.80:0/3093900940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c06c0a0 0x7f235c072fa0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.819+0000 7f236243f700 1 -- 172.21.15.80:0/3093900940 shutdown_connections 2019-11-28T11:54:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.819+0000 7f236243f700 1 -- 172.21.15.80:0/3093900940 wait complete. 2019-11-28T11:54:11.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.819+0000 7f236243f700 1 -- 172.21.15.80:0/3093900940 >> 172.21.15.80:0/3093900940 conn(0x7f235c061cf0 msgr2=0x7f235c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:11.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.822+0000 7f236243f700 1 Processor -- start 2019-11-28T11:54:11.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.822+0000 7f236243f700 1 -- start start 2019-11-28T11:54:11.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f236243f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c154ab0 0x7f235c154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:11.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f236243f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f235c104780 0x7f235c104bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:11.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f236243f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235c109a30 con 0x7f235c15fd70 2019-11-28T11:54:11.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f236243f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235c155d50 con 0x7f235c104780 2019-11-28T11:54:11.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f236243f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c155a80 con 0x7f235c154ab0 2019-11-28T11:54:11.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f23609dc700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f235c15fd70 0x7f235c105620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:59794/0 (socket says 172.21.15.80:59794) 2019-11-28T11:54:11.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f23609dc700 1 -- 172.21.15.80:0/685001994 learned_addr learned my addr 172.21.15.80:0/685001994 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:11.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f235bfff700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c154ab0 0x7f235c154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f23611dd700 1 --2- 172.21.15.80:0/685001994 >> v2:172.21.15.80:3300/0 conn(0x7f235c104780 0x7f235c104bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f23597fa700 1 -- 172.21.15.80:0/685001994 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246679050 0 0) 0x7f235400b140 con 0x7f235c15fd70 2019-11-28T11:54:11.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f23597fa700 1 -- 172.21.15.80:0/685001994 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2340002e80 con 0x7f235c15fd70 2019-11-28T11:54:11.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f235bfff700 1 -- 172.21.15.80:0/685001994 >> v2:172.21.15.80:3300/0 conn(0x7f235c104780 msgr2=0x7f235c104bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:11.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f235bfff700 1 --2- 172.21.15.80:0/685001994 >> v2:172.21.15.80:3300/0 conn(0x7f235c104780 0x7f235c104bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:11.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f235bfff700 1 -- 172.21.15.80:0/685001994 >> v1:172.21.15.174:6789/0 conn(0x7f235c15fd70 legacy=0x7f235c105620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:11.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f235bfff700 1 -- 172.21.15.80:0/685001994 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c13ac00 con 0x7f235c154ab0 2019-11-28T11:54:11.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f23611dd700 1 --2- 172.21.15.80:0/685001994 >> v2:172.21.15.80:3300/0 conn(0x7f235c104780 0x7f235c104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:11.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f235bfff700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c154ab0 0x7f235c154f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23440103a0 tx=0x7f2344010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f235bfff700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c154ab0 0x7f235c154f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23440103a0 tx=0x7f2344010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.823+0000 7f235bfff700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c154ab0 0x7f235c154f40 secure :-1 s=READY pgs=361 cs=0 l=1 rx=0x7f23440103a0 tx=0x7f2344010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:11.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.824+0000 7f235bfff700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c154ab0 0x7f235c154f40 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f23440103a0 tx=0x7f2344010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.824+0000 7f235bfff700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c154ab0 0x7f235c154f40 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f23440103a0 tx=0x7f2344010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.824+0000 7f235bfff700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c154ab0 0x7f235c154f40 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f23440103a0 tx=0x7f2344010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.824+0000 7f23597fa700 1 -- 172.21.15.80:0/685001994 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2344000c90 con 0x7f235c154ab0 2019-11-28T11:54:11.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.824+0000 7f23597fa700 1 -- 172.21.15.80:0/685001994 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2344001380 con 0x7f235c154ab0 2019-11-28T11:54:11.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.824+0000 7f236243f700 1 -- 172.21.15.80:0/685001994 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235c13af80 con 0x7f235c154ab0 2019-11-28T11:54:11.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.824+0000 7f23597fa700 1 -- 172.21.15.80:0/685001994 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2344001a10 con 0x7f235c154ab0 2019-11-28T11:54:11.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.824+0000 7f236243f700 1 -- 172.21.15.80:0/685001994 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235c13ac00 con 0x7f235c154ab0 2019-11-28T11:54:11.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.824+0000 7f235bfff700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c154ab0 0x7f235c154f40 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f23440103a0 tx=0x7f2344010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.824+0000 7f23597fa700 1 -- 172.21.15.80:0/685001994 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2344000ea0 con 0x7f235c154ab0 2019-11-28T11:54:11.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.824+0000 7f235bfff700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c154ab0 0x7f235c154f40 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f23440103a0 tx=0x7f2344010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.824+0000 7f23597fa700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2340018770 0x7f234001ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:11.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.824+0000 7f23597fa700 1 -- 172.21.15.80:0/685001994 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2344031c70 con 0x7f235c154ab0 2019-11-28T11:54:11.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.825+0000 7f23609dc700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2340018770 0x7f234001ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.825+0000 7f23609dc700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2340018770 0x7f234001ac00 crc :-1 s=READY pgs=1040 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:11.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.832+0000 7f236243f700 1 -- 172.21.15.80:0/685001994 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235c13af80 con 0x7f235c154ab0 2019-11-28T11:54:11.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.835+0000 7f235bfff700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c154ab0 0x7f235c154f40 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f23440103a0 tx=0x7f2344010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.835+0000 7f23597fa700 1 -- 172.21.15.80:0/685001994 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2344000c90 con 0x7f235c154ab0 2019-11-28T11:54:11.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.863+0000 7f55eef72700 1 Processor -- start 2019-11-28T11:54:11.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.863+0000 7f55eef72700 1 -- start start 2019-11-28T11:54:11.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.864+0000 7f55eef72700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f55e806c0a0 0x7f55e8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:11.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.864+0000 7f55eef72700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f55e80734e0 0x7f55e8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:11.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.864+0000 7f55eef72700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e806db00 con 0x7f55e8072360 2019-11-28T11:54:11.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.864+0000 7f55eef72700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e806fd60 con 0x7f55e806c0a0 2019-11-28T11:54:11.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.864+0000 7f55eef72700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e8070030 con 0x7f55e80734e0 2019-11-28T11:54:11.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.864+0000 7f55ed50f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f55e806c0a0 0x7f55e8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.864+0000 7f55edd10700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f55e8072360 0x7f55e806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44258/0 (socket says 172.21.15.80:44258) 2019-11-28T11:54:11.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.864+0000 7f55edd10700 1 -- 172.21.15.80:0/2790240666 learned_addr learned my addr 172.21.15.80:0/2790240666 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:11.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.864+0000 7f55ecd0e700 1 --2- 172.21.15.80:0/2790240666 >> v2:172.21.15.174:3300/0 conn(0x7f55e80734e0 0x7f55e8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55ed50f700 1 -- 172.21.15.80:0/2790240666 >> v2:172.21.15.174:3300/0 conn(0x7f55e80734e0 msgr2=0x7f55e8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:11.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55ed50f700 1 --2- 172.21.15.80:0/2790240666 >> v2:172.21.15.174:3300/0 conn(0x7f55e80734e0 0x7f55e8071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:11.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55ed50f700 1 -- 172.21.15.80:0/2790240666 >> v1:172.21.15.80:6789/0 conn(0x7f55e8072360 legacy=0x7f55e806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:11.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55dbfff700 1 -- 172.21.15.80:0/2790240666 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786760846 0 0) 0x7f55dc001100 con 0x7f55e8072360 2019-11-28T11:54:11.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55ed50f700 1 -- 172.21.15.80:0/2790240666 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e80706c0 con 0x7f55e806c0a0 2019-11-28T11:54:11.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55ecd0e700 1 --2- 172.21.15.80:0/2790240666 >> v2:172.21.15.174:3300/0 conn(0x7f55e80734e0 0x7f55e8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:11.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55ed50f700 1 --2- 172.21.15.80:0/2790240666 >> v2:172.21.15.80:3300/0 conn(0x7f55e806c0a0 0x7f55e8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f55e000af50 tx=0x7f55e000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55ed50f700 1 --2- 172.21.15.80:0/2790240666 >> v2:172.21.15.80:3300/0 conn(0x7f55e806c0a0 0x7f55e8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f55e000af50 tx=0x7f55e000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55ed50f700 1 --2- 172.21.15.80:0/2790240666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e806c0a0 0x7f55e8072fa0 secure :-1 s=READY pgs=2533 cs=0 l=1 rx=0x7f55e000af50 tx=0x7f55e000b760).ready entity=mon.0 client_cookie=9f869f2a005eef51 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:11.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55ed50f700 1 --2- 172.21.15.80:0/2790240666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e806c0a0 0x7f55e8072fa0 secure :-1 s=THROTTLE_DONE pgs=2533 cs=0 l=1 rx=0x7f55e000af50 tx=0x7f55e000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55dbfff700 1 -- 172.21.15.80:0/2790240666 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55e0007210 con 0x7f55e806c0a0 2019-11-28T11:54:11.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55ed50f700 1 --2- 172.21.15.80:0/2790240666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e806c0a0 0x7f55e8072fa0 secure :-1 s=THROTTLE_DONE pgs=2533 cs=0 l=1 rx=0x7f55e000af50 tx=0x7f55e000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55ed50f700 1 --2- 172.21.15.80:0/2790240666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e806c0a0 0x7f55e8072fa0 secure :-1 s=THROTTLE_DONE pgs=2533 cs=0 l=1 rx=0x7f55e000af50 tx=0x7f55e000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55dbfff700 1 -- 172.21.15.80:0/2790240666 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e00097c0 con 0x7f55e806c0a0 2019-11-28T11:54:11.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55dbfff700 1 -- 172.21.15.80:0/2790240666 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55e00099b0 con 0x7f55e806c0a0 2019-11-28T11:54:11.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55eef72700 1 -- 172.21.15.80:0/2790240666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e806c0a0 msgr2=0x7f55e8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:11.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.865+0000 7f55eef72700 1 --2- 172.21.15.80:0/2790240666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e806c0a0 0x7f55e8072fa0 secure :-1 s=READY pgs=2533 cs=0 l=1 rx=0x7f55e000af50 tx=0x7f55e000b760).stop 2019-11-28T11:54:11.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.866+0000 7f55eef72700 1 -- 172.21.15.80:0/2790240666 shutdown_connections 2019-11-28T11:54:11.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.866+0000 7f55eef72700 1 --2- 172.21.15.80:0/2790240666 >> v2:172.21.15.174:3300/0 conn(0x7f55e80734e0 0x7f55e8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:11.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.866+0000 7f55eef72700 1 --2- 172.21.15.80:0/2790240666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e806c0a0 0x7f55e8072fa0 unknown :-1 s=CLOSED pgs=2533 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:11.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.866+0000 7f55eef72700 1 -- 172.21.15.80:0/2790240666 shutdown_connections 2019-11-28T11:54:11.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.866+0000 7f55eef72700 1 -- 172.21.15.80:0/2790240666 wait complete. 2019-11-28T11:54:11.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.866+0000 7f55eef72700 1 -- 172.21.15.80:0/2790240666 >> 172.21.15.80:0/2790240666 conn(0x7f55e8061cf0 msgr2=0x7f55e8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:11.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.868+0000 7f55eef72700 1 Processor -- start 2019-11-28T11:54:11.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.868+0000 7f55eef72700 1 -- start start 2019-11-28T11:54:11.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.869+0000 7f55eef72700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f55e81096f0 0x7f55e8169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:11.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.869+0000 7f55eef72700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e81066e0 con 0x7f55e813e9e0 2019-11-28T11:54:11.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.869+0000 7f55eef72700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e810ce40 con 0x7f55e813e5f0 2019-11-28T11:54:11.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.869+0000 7f55eef72700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e810e060 con 0x7f55e81096f0 2019-11-28T11:54:11.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55ecd0e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f55e813e9e0 0x7f55e8108ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44266/0 (socket says 172.21.15.80:44266) 2019-11-28T11:54:11.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55ecd0e700 1 -- 172.21.15.80:0/4034178756 learned_addr learned my addr 172.21.15.80:0/4034178756 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:11.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55edd10700 1 --2- 172.21.15.80:0/4034178756 >> v2:172.21.15.80:3300/0 conn(0x7f55e81096f0 0x7f55e8169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55d9ffb700 1 -- 172.21.15.80:0/4034178756 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874374688 0 0) 0x7f55e400e110 con 0x7f55e813e9e0 2019-11-28T11:54:11.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55d9ffb700 1 -- 172.21.15.80:0/4034178756 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c8002e80 con 0x7f55e813e9e0 2019-11-28T11:54:11.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55d9ffb700 1 -- 172.21.15.80:0/4034178756 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556609641 0 0) 0x7f55e000b250 con 0x7f55e813e5f0 2019-11-28T11:54:11.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55d9ffb700 1 -- 172.21.15.80:0/4034178756 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c8004220 con 0x7f55e813e5f0 2019-11-28T11:54:11.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55edd10700 1 -- 172.21.15.80:0/4034178756 >> v1:172.21.15.174:6789/0 conn(0x7f55e813e5f0 legacy=0x7f55e810a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:11.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55edd10700 1 -- 172.21.15.80:0/4034178756 >> v1:172.21.15.80:6789/0 conn(0x7f55e813e9e0 legacy=0x7f55e8108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:11.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55edd10700 1 -- 172.21.15.80:0/4034178756 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e810e9c0 con 0x7f55e81096f0 2019-11-28T11:54:11.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55edd10700 1 --2- 172.21.15.80:0/4034178756 >> v2:172.21.15.80:3300/0 conn(0x7f55e81096f0 0x7f55e8169ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f55dc010380 tx=0x7f55dc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55edd10700 1 --2- 172.21.15.80:0/4034178756 >> v2:172.21.15.80:3300/0 conn(0x7f55e81096f0 0x7f55e8169ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f55dc010380 tx=0x7f55dc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55edd10700 1 --2- 172.21.15.80:0/4034178756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e81096f0 0x7f55e8169ed0 secure :-1 s=READY pgs=2535 cs=0 l=1 rx=0x7f55dc010380 tx=0x7f55dc010720).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:11.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55edd10700 1 --2- 172.21.15.80:0/4034178756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e81096f0 0x7f55e8169ed0 secure :-1 s=THROTTLE_DONE pgs=2535 cs=0 l=1 rx=0x7f55dc010380 tx=0x7f55dc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55d9ffb700 1 -- 172.21.15.80:0/4034178756 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55dc000960 con 0x7f55e81096f0 2019-11-28T11:54:11.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55eef72700 1 -- 172.21.15.80:0/4034178756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e810ed40 con 0x7f55e81096f0 2019-11-28T11:54:11.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55edd10700 1 --2- 172.21.15.80:0/4034178756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e81096f0 0x7f55e8169ed0 secure :-1 s=THROTTLE_DONE pgs=2535 cs=0 l=1 rx=0x7f55dc010380 tx=0x7f55dc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55d9ffb700 1 -- 172.21.15.80:0/4034178756 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55dc000960 con 0x7f55e81096f0 2019-11-28T11:54:11.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55edd10700 1 --2- 172.21.15.80:0/4034178756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e81096f0 0x7f55e8169ed0 secure :-1 s=THROTTLE_DONE pgs=2535 cs=0 l=1 rx=0x7f55dc010380 tx=0x7f55dc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55eef72700 1 -- 172.21.15.80:0/4034178756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e810e9c0 con 0x7f55e81096f0 2019-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f55d9ffb700 1 -- 172.21.15.80:0/4034178756 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55dc001660 con 0x7f55e81096f0 2019-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f55edd10700 1 --2- 172.21.15.80:0/4034178756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e81096f0 0x7f55e8169ed0 secure :-1 s=THROTTLE_DONE pgs=2535 cs=0 l=1 rx=0x7f55dc010380 tx=0x7f55dc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f55d9ffb700 1 -- 172.21.15.80:0/4034178756 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f55dc000ef0 con 0x7f55e81096f0 2019-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f55edd10700 1 --2- 172.21.15.80:0/4034178756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e81096f0 0x7f55e8169ed0 secure :-1 s=THROTTLE_DONE pgs=2535 cs=0 l=1 rx=0x7f55dc010380 tx=0x7f55dc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f55d9ffb700 1 --2- 172.21.15.80:0/4034178756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f55c8018760 0x7f55c801ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f55d9ffb700 1 -- 172.21.15.80:0/4034178756 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f55dc031cf0 con 0x7f55e81096f0 2019-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.872+0000 7f55ed50f700 1 --2- 172.21.15.80:0/4034178756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f55c8018760 0x7f55c801ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.872+0000 7f55ed50f700 1 --2- 172.21.15.80:0/4034178756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f55c8018760 0x7f55c801ac10 crc :-1 s=READY pgs=1041 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:11.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.879+0000 7f55eef72700 1 -- 172.21.15.80:0/4034178756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e810ed40 con 0x7f55e81096f0 2019-11-28T11:54:11.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.869+0000 7f23820e7700 1 Processor -- start 2019-11-28T11:54:11.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.869+0000 7f23820e7700 1 -- start start 2019-11-28T11:54:11.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f23820e7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f237c06c0a0 0x7f237c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:11.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f23820e7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f237c0734e0 0x7f237c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:11.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f23820e7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237c06db00 con 0x7f237c072360 2019-11-28T11:54:11.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f23820e7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c06fd60 con 0x7f237c0734e0 2019-11-28T11:54:11.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f23820e7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c070030 con 0x7f237c06c0a0 2019-11-28T11:54:11.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f2373fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f237c0734e0 0x7f237c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f237bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f237c06c0a0 0x7f237c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f2373fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f237c0734e0 0x7f237c071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44956/0 (socket says 172.21.15.80:44956) 2019-11-28T11:54:11.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f237bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f237c06c0a0 0x7f237c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:59840/0 (socket says 172.21.15.80:59840) 2019-11-28T11:54:11.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f2373fff700 1 -- 172.21.15.80:0/970916439 learned_addr learned my addr 172.21.15.80:0/970916439 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:11.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.870+0000 7f2380e85700 1 --1- 172.21.15.80:0/970916439 >> v1:172.21.15.174:6789/0 conn(0x7f237c072360 0x7f237c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:59818/0 (socket says 172.21.15.80:59818) 2019-11-28T11:54:11.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f237b7fe700 1 -- 172.21.15.80:0/970916439 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 642748454 0 0) 0x7f2374001080 con 0x7f237c072360 2019-11-28T11:54:11.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f2373fff700 1 -- 172.21.15.80:0/970916439 >> v2:172.21.15.174:3300/0 conn(0x7f237c06c0a0 msgr2=0x7f237c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:11.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f2373fff700 1 --2- 172.21.15.80:0/970916439 >> v2:172.21.15.174:3300/0 conn(0x7f237c06c0a0 0x7f237c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:11.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f2373fff700 1 -- 172.21.15.80:0/970916439 >> v1:172.21.15.174:6789/0 conn(0x7f237c072360 legacy=0x7f237c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:11.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f2373fff700 1 -- 172.21.15.80:0/970916439 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c0706c0 con 0x7f237c0734e0 2019-11-28T11:54:11.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f2373fff700 1 --2- 172.21.15.80:0/970916439 >> v2:172.21.15.80:3300/0 conn(0x7f237c0734e0 0x7f237c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f236400f740 tx=0x7f236400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f2373fff700 1 --2- 172.21.15.80:0/970916439 >> v2:172.21.15.80:3300/0 conn(0x7f237c0734e0 0x7f237c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f236400f740 tx=0x7f236400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f2373fff700 1 --2- 172.21.15.80:0/970916439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f237c0734e0 0x7f237c071e20 secure :-1 s=READY pgs=2536 cs=0 l=1 rx=0x7f236400f740 tx=0x7f236400f570).ready entity=mon.0 client_cookie=8a4af2f153fde60f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:11.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f2373fff700 1 --2- 172.21.15.80:0/970916439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f237c0734e0 0x7f237c071e20 secure :-1 s=THROTTLE_DONE pgs=2536 cs=0 l=1 rx=0x7f236400f740 tx=0x7f236400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f2373fff700 1 --2- 172.21.15.80:0/970916439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f237c0734e0 0x7f237c071e20 secure :-1 s=THROTTLE_DONE pgs=2536 cs=0 l=1 rx=0x7f236400f740 tx=0x7f236400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f237b7fe700 1 -- 172.21.15.80:0/970916439 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2364000940 con 0x7f237c0734e0 2019-11-28T11:54:11.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f2373fff700 1 --2- 172.21.15.80:0/970916439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f237c0734e0 0x7f237c071e20 secure :-1 s=THROTTLE_DONE pgs=2536 cs=0 l=1 rx=0x7f236400f740 tx=0x7f236400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f237b7fe700 1 -- 172.21.15.80:0/970916439 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2364000c90 con 0x7f237c0734e0 2019-11-28T11:54:11.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.871+0000 7f237b7fe700 1 -- 172.21.15.80:0/970916439 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23640012a0 con 0x7f237c0734e0 2019-11-28T11:54:11.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.872+0000 7f23820e7700 1 -- 172.21.15.80:0/970916439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f237c0734e0 msgr2=0x7f237c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:11.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.872+0000 7f23820e7700 1 --2- 172.21.15.80:0/970916439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f237c0734e0 0x7f237c071e20 secure :-1 s=READY pgs=2536 cs=0 l=1 rx=0x7f236400f740 tx=0x7f236400f570).stop 2019-11-28T11:54:11.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.872+0000 7f23820e7700 1 -- 172.21.15.80:0/970916439 shutdown_connections 2019-11-28T11:54:11.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.872+0000 7f23820e7700 1 --2- 172.21.15.80:0/970916439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f237c0734e0 0x7f237c071e20 unknown :-1 s=CLOSED pgs=2536 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:11.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.872+0000 7f23820e7700 1 --2- 172.21.15.80:0/970916439 >> v2:172.21.15.174:3300/0 conn(0x7f237c06c0a0 0x7f237c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:11.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.872+0000 7f23820e7700 1 -- 172.21.15.80:0/970916439 shutdown_connections 2019-11-28T11:54:11.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.872+0000 7f23820e7700 1 -- 172.21.15.80:0/970916439 wait complete. 2019-11-28T11:54:11.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.872+0000 7f23820e7700 1 -- 172.21.15.80:0/970916439 >> 172.21.15.80:0/970916439 conn(0x7f237c061cf0 msgr2=0x7f237c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:11.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.874+0000 7f23820e7700 1 Processor -- start 2019-11-28T11:54:11.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.875+0000 7f23820e7700 1 -- start start 2019-11-28T11:54:11.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.875+0000 7f23820e7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f237c13a780 0x7f237c12d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:11.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.875+0000 7f23820e7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f237c12cb00 0x7f237c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:11.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.875+0000 7f23820e7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237c139a60 con 0x7f237c12d9c0 2019-11-28T11:54:11.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.875+0000 7f23820e7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c12a260 con 0x7f237c13a780 2019-11-28T11:54:11.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.875+0000 7f23820e7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c12a530 con 0x7f237c12cb00 2019-11-28T11:54:11.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.875+0000 7f2373fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f237c12d9c0 0x7f237c12c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44278/0 (socket says 172.21.15.80:44278) 2019-11-28T11:54:11.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.875+0000 7f2373fff700 1 -- 172.21.15.80:0/2440775841 learned_addr learned my addr 172.21.15.80:0/2440775841 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:11.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f237bfff700 1 --2- 172.21.15.80:0/2440775841 >> v2:172.21.15.174:3300/0 conn(0x7f237c13a780 0x7f237c12d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799792962 0 0) 0x7f2364007950 con 0x7f237c12d9c0 2019-11-28T11:54:11.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f2380e85700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f237c12cb00 0x7f237c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2360002e80 con 0x7f237c12d9c0 2019-11-28T11:54:11.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3625744929 0 0) 0x7f23640075d0 con 0x7f237c12d9c0 2019-11-28T11:54:11.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f23600032e0 con 0x7f237c12d9c0 2019-11-28T11:54:11.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f2364000940 con 0x7f237c12d9c0 2019-11-28T11:54:11.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f237c12cb00 msgr2=0x7f237c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:11.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f23797fa700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f237c12cb00 0x7f237c167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:11.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 >> v2:172.21.15.174:3300/0 conn(0x7f237c13a780 msgr2=0x7f237c12d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:11.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f23797fa700 1 --2- 172.21.15.80:0/2440775841 >> v2:172.21.15.174:3300/0 conn(0x7f237c13a780 0x7f237c12d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:11.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 >> v1:172.21.15.80:6789/0 conn(0x7f237c12d9c0 legacy=0x7f237c12c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:11.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f23797fa700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2360003950 0x7f2360005d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:11.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f23797fa700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2360006290 0x7f2360008690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:11.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f23797fa700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2360008e40 0x7f236000b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:11.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236000bb00 con 0x7f2360008e40 2019-11-28T11:54:11.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236000bd30 con 0x7f2360003950 2019-11-28T11:54:11.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236000bf60 con 0x7f2360006290 2019-11-28T11:54:11.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f2380e85700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2360008e40 0x7f236000b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f2373fff700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2360006290 0x7f2360008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f237bfff700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2360003950 0x7f2360005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f2380e85700 1 -- 172.21.15.80:0/2440775841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2360006290 msgr2=0x7f2360008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:11.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f2380e85700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2360006290 0x7f2360008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:11.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f2380e85700 1 -- 172.21.15.80:0/2440775841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2360003950 msgr2=0x7f2360005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:11.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f2380e85700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2360003950 0x7f2360005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:11.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.876+0000 7f2380e85700 1 -- 172.21.15.80:0/2440775841 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236000c210 con 0x7f2360008e40 2019-11-28T11:54:11.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.877+0000 7f2380e85700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2360008e40 0x7f236000b2f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2374010370 tx=0x7f2374010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.877+0000 7f23820e7700 1 -- 172.21.15.80:0/2440775841 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237c12af40 con 0x7f2360008e40 2019-11-28T11:54:11.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.877+0000 7f23820e7700 1 -- 172.21.15.80:0/2440775841 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c12abc0 con 0x7f2360008e40 2019-11-28T11:54:11.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.877+0000 7f2380e85700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2360008e40 0x7f236000b2f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2374010370 tx=0x7f2374010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.877+0000 7f2380e85700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2360008e40 0x7f236000b2f0 secure :-1 s=READY pgs=2538 cs=0 l=1 rx=0x7f2374010370 tx=0x7f2374010220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:11.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.877+0000 7f2380e85700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2360008e40 0x7f236000b2f0 secure :-1 s=THROTTLE_DONE pgs=2538 cs=0 l=1 rx=0x7f2374010370 tx=0x7f2374010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.877+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2374000b70 con 0x7f2360008e40 2019-11-28T11:54:11.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.877+0000 7f2380e85700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2360008e40 0x7f236000b2f0 secure :-1 s=THROTTLE_DONE pgs=2538 cs=0 l=1 rx=0x7f2374010370 tx=0x7f2374010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.877+0000 7f2380e85700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2360008e40 0x7f236000b2f0 secure :-1 s=THROTTLE_DONE pgs=2538 cs=0 l=1 rx=0x7f2374010370 tx=0x7f2374010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.877+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2374001060 con 0x7f2360008e40 2019-11-28T11:54:11.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.877+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2374000b70 con 0x7f2360008e40 2019-11-28T11:54:11.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.877+0000 7f2380e85700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2360008e40 0x7f236000b2f0 secure :-1 s=THROTTLE_DONE pgs=2538 cs=0 l=1 rx=0x7f2374010370 tx=0x7f2374010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.877+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2374000ab0 con 0x7f2360008e40 2019-11-28T11:54:11.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.877+0000 7f2380e85700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2360008e40 0x7f236000b2f0 secure :-1 s=THROTTLE_DONE pgs=2538 cs=0 l=1 rx=0x7f2374010370 tx=0x7f2374010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.877+0000 7f23797fa700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2360020b40 0x7f2360022f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:11.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.878+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2374031bc0 con 0x7f2360008e40 2019-11-28T11:54:11.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.878+0000 7f237bfff700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2360020b40 0x7f2360022f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:11.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.878+0000 7f237bfff700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2360020b40 0x7f2360022f70 crc :-1 s=READY pgs=1042 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:11.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.882+0000 7f55edd10700 1 --2- 172.21.15.80:0/4034178756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e81096f0 0x7f55e8169ed0 secure :-1 s=THROTTLE_DONE pgs=2535 cs=0 l=1 rx=0x7f55dc010380 tx=0x7f55dc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.882+0000 7f55d9ffb700 1 -- 172.21.15.80:0/4034178756 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f55dc0019a0 con 0x7f55e81096f0 2019-11-28T11:54:11.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.884+0000 7f23820e7700 1 -- 172.21.15.80:0/2440775841 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2354002e60 con 0x7f2360008e40 2019-11-28T11:54:11.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.888+0000 7f2380e85700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2360008e40 0x7f236000b2f0 secure :-1 s=THROTTLE_DONE pgs=2538 cs=0 l=1 rx=0x7f2374010370 tx=0x7f2374010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:11.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:11.888+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2374008580 con 0x7f2360008e40 2019-11-28T11:54:12.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.031+0000 7f236243f700 1 -- 172.21.15.80:0/685001994 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f235c13ac00 con 0x7f235c154ab0 2019-11-28T11:54:12.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.070+0000 7f55eef72700 1 -- 172.21.15.80:0/4034178756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f55e810e9c0 con 0x7f55e81096f0 2019-11-28T11:54:12.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.077+0000 7f23820e7700 1 -- 172.21.15.80:0/2440775841 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f2354001d10 con 0x7f2360008e40 2019-11-28T11:54:12.829 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:54:12.773+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:54:12.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.778+0000 7f55edd10700 1 --2- 172.21.15.80:0/4034178756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e81096f0 0x7f55e8169ed0 secure :-1 s=THROTTLE_DONE pgs=2535 cs=0 l=1 rx=0x7f55dc010380 tx=0x7f55dc010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:12.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.778+0000 7f55d9ffb700 1 -- 172.21.15.80:0/4034178756 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 11301 v154) v1 ==== 96+0+0 (secure 0 0 0) 0x7f55dc000940 con 0x7f55e81096f0 2019-11-28T11:54:12.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.778+0000 7f2380e85700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2360008e40 0x7f236000b2f0 secure :-1 s=THROTTLE_DONE pgs=2538 cs=0 l=1 rx=0x7f2374010370 tx=0x7f2374010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:12.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.778+0000 7f23797fa700 1 -- 172.21.15.80:0/2440775841 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7541 v154) v1 ==== 95+0+0 (secure 0 0 0) 0x7f2374000ab0 con 0x7f2360008e40 2019-11-28T11:54:12.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.778+0000 7f235bfff700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c154ab0 0x7f235c154f40 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f23440103a0 tx=0x7f2344010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:12.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.778+0000 7f23597fa700 1 -- 172.21.15.80:0/685001994 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 11286 v154) v1 ==== 96+0+0 (secure 0 0 0) 0x7f2344000ea0 con 0x7f235c154ab0 2019-11-28T11:54:12.840 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 11301 2019-11-28T11:54:12.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.786+0000 7f55eef72700 1 -- 172.21.15.80:0/4034178756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f55c8018760 msgr2=0x7f55c801ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:12.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.786+0000 7f55eef72700 1 --2- 172.21.15.80:0/4034178756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f55c8018760 0x7f55c801ac10 crc :-1 s=READY pgs=1041 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:12.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.786+0000 7f55eef72700 1 -- 172.21.15.80:0/4034178756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e81096f0 msgr2=0x7f55e8169ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:12.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.786+0000 7f55eef72700 1 --2- 172.21.15.80:0/4034178756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e81096f0 0x7f55e8169ed0 secure :-1 s=READY pgs=2535 cs=0 l=1 rx=0x7f55dc010380 tx=0x7f55dc010720).stop 2019-11-28T11:54:12.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.786+0000 7f55eef72700 1 -- 172.21.15.80:0/4034178756 shutdown_connections 2019-11-28T11:54:12.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.786+0000 7f55eef72700 1 --2- 172.21.15.80:0/4034178756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55e81096f0 0x7f55e8169ed0 unknown :-1 s=CLOSED pgs=2535 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:12.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.786+0000 7f55eef72700 1 --2- 172.21.15.80:0/4034178756 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f55c8018760 0x7f55c801ac10 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:12.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.786+0000 7f55eef72700 1 -- 172.21.15.80:0/4034178756 shutdown_connections 2019-11-28T11:54:12.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.787+0000 7f55eef72700 1 -- 172.21.15.80:0/4034178756 wait complete. 2019-11-28T11:54:12.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.787+0000 7f55eef72700 1 -- 172.21.15.80:0/4034178756 >> 172.21.15.80:0/4034178756 conn(0x7f55e813d620 msgr2=0x7f55e813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:12.846 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 7541 2019-11-28T11:54:12.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.792+0000 7f23820e7700 1 -- 172.21.15.80:0/2440775841 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2360020b40 msgr2=0x7f2360022f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:12.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.792+0000 7f23820e7700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2360020b40 0x7f2360022f70 crc :-1 s=READY pgs=1042 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:12.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.792+0000 7f23820e7700 1 -- 172.21.15.80:0/2440775841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2360008e40 msgr2=0x7f236000b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:12.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.792+0000 7f23820e7700 1 --2- 172.21.15.80:0/2440775841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2360008e40 0x7f236000b2f0 secure :-1 s=READY pgs=2538 cs=0 l=1 rx=0x7f2374010370 tx=0x7f2374010220).stop 2019-11-28T11:54:12.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.792+0000 7f2380e85700 1 -- 172.21.15.80:0/2440775841 reap_dead start 2019-11-28T11:54:12.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.793+0000 7f2380e85700 1 -- 172.21.15.80:0/2440775841 reap_dead start 2019-11-28T11:54:12.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.793+0000 7f23820e7700 1 -- 172.21.15.80:0/2440775841 shutdown_connections 2019-11-28T11:54:12.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.793+0000 7f23820e7700 1 -- 172.21.15.80:0/2440775841 shutdown_connections 2019-11-28T11:54:12.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.793+0000 7f23820e7700 1 -- 172.21.15.80:0/2440775841 wait complete. 2019-11-28T11:54:12.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.793+0000 7f23820e7700 1 -- 172.21.15.80:0/2440775841 >> 172.21.15.80:0/2440775841 conn(0x7f237c127dc0 msgr2=0x7f237c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:12.851 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 11286 2019-11-28T11:54:12.853 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:54:12.853 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:54:12.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.797+0000 7f236243f700 1 -- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2340018770 msgr2=0x7f234001ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:12.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.797+0000 7f236243f700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2340018770 0x7f234001ac00 crc :-1 s=READY pgs=1040 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:12.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.797+0000 7f236243f700 1 -- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c154ab0 msgr2=0x7f235c154f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:12.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.797+0000 7f236243f700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c154ab0 0x7f235c154f40 secure :-1 s=READY pgs=361 cs=0 l=1 rx=0x7f23440103a0 tx=0x7f2344010740).stop 2019-11-28T11:54:12.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.797+0000 7f236243f700 1 -- 172.21.15.80:0/685001994 shutdown_connections 2019-11-28T11:54:12.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.797+0000 7f236243f700 1 --2- 172.21.15.80:0/685001994 >> v2:172.21.15.80:3300/0 conn(0x7f235c104780 0x7f235c104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:12.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.797+0000 7f236243f700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f235c154ab0 0x7f235c154f40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:12.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.797+0000 7f236243f700 1 --2- 172.21.15.80:0/685001994 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2340018770 0x7f234001ac00 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:12.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.797+0000 7f236243f700 1 -- 172.21.15.80:0/685001994 shutdown_connections 2019-11-28T11:54:12.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.797+0000 7f236243f700 1 -- 172.21.15.80:0/685001994 wait complete. 2019-11-28T11:54:12.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.797+0000 7f236243f700 1 -- 172.21.15.80:0/685001994 >> 172.21.15.80:0/685001994 conn(0x7f235c141190 msgr2=0x7f235c121bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:12.859 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:54:12.859 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:54:12.859 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:54:12.860 DEBUG:teuthology.parallel:result is None 2019-11-28T11:54:12.863 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:54:12.864 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:54:12.867 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:54:12.868 DEBUG:teuthology.parallel:result is None 2019-11-28T11:54:12.912 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:54:12.912 DEBUG:teuthology.parallel:result is None 2019-11-28T11:54:12.912 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:12.943 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:54:12.951 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:54:12.990 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:54:13.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.979+0000 7f71a3724700 1 Processor -- start 2019-11-28T11:54:13.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.979+0000 7f71a3724700 1 -- start start 2019-11-28T11:54:13.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.980+0000 7f71a3724700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f719c06c0a0 0x7f719c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:13.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.980+0000 7f71a3724700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f719c0734e0 0x7f719c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:13.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.980+0000 7f71a3724700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c06db00 con 0x7f719c072360 2019-11-28T11:54:13.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.980+0000 7f71a3724700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c06fd60 con 0x7f719c06c0a0 2019-11-28T11:54:13.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.980+0000 7f71a3724700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c070030 con 0x7f719c0734e0 2019-11-28T11:54:13.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a1cc1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f719c06c0a0 0x7f719c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:13.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a1cc1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f719c06c0a0 0x7f719c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45000/0 (socket says 172.21.15.80:45000) 2019-11-28T11:54:13.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a1cc1700 1 -- 172.21.15.80:0/2053738026 learned_addr learned my addr 172.21.15.80:0/2053738026 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:13.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a14c0700 1 --2- 172.21.15.80:0/2053738026 >> v2:172.21.15.174:3300/0 conn(0x7f719c0734e0 0x7f719c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:13.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a1cc1700 1 -- 172.21.15.80:0/2053738026 >> v2:172.21.15.174:3300/0 conn(0x7f719c0734e0 msgr2=0x7f719c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:13.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/2053738026 >> v2:172.21.15.174:3300/0 conn(0x7f719c0734e0 0x7f719c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:13.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a1cc1700 1 -- 172.21.15.80:0/2053738026 >> v1:172.21.15.80:6789/0 conn(0x7f719c072360 legacy=0x7f719c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:13.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a1cc1700 1 -- 172.21.15.80:0/2053738026 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0706c0 con 0x7f719c06c0a0 2019-11-28T11:54:13.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a14c0700 1 --2- 172.21.15.80:0/2053738026 >> v2:172.21.15.174:3300/0 conn(0x7f719c0734e0 0x7f719c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:13.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/2053738026 >> v2:172.21.15.80:3300/0 conn(0x7f719c06c0a0 0x7f719c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f719000fac0 tx=0x7f719000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:13.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/2053738026 >> v2:172.21.15.80:3300/0 conn(0x7f719c06c0a0 0x7f719c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f719000fac0 tx=0x7f719000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:13.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/2053738026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c06c0a0 0x7f719c072fa0 secure :-1 s=READY pgs=2546 cs=0 l=1 rx=0x7f719000fac0 tx=0x7f719000fe60).ready entity=mon.0 client_cookie=af0e97bd91e09608 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:13.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/2053738026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c06c0a0 0x7f719c072fa0 secure :-1 s=THROTTLE_DONE pgs=2546 cs=0 l=1 rx=0x7f719000fac0 tx=0x7f719000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:13.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/2053738026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c06c0a0 0x7f719c072fa0 secure :-1 s=THROTTLE_DONE pgs=2546 cs=0 l=1 rx=0x7f719000fac0 tx=0x7f719000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:13.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/2053738026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c06c0a0 0x7f719c072fa0 secure :-1 s=THROTTLE_DONE pgs=2546 cs=0 l=1 rx=0x7f719000fac0 tx=0x7f719000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:13.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a0cbf700 1 -- 172.21.15.80:0/2053738026 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7190000ce0 con 0x7f719c06c0a0 2019-11-28T11:54:13.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a0cbf700 1 -- 172.21.15.80:0/2053738026 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7190001010 con 0x7f719c06c0a0 2019-11-28T11:54:13.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a0cbf700 1 -- 172.21.15.80:0/2053738026 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7190001720 con 0x7f719c06c0a0 2019-11-28T11:54:13.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a3724700 1 -- 172.21.15.80:0/2053738026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c06c0a0 msgr2=0x7f719c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:13.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.981+0000 7f71a3724700 1 --2- 172.21.15.80:0/2053738026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c06c0a0 0x7f719c072fa0 secure :-1 s=READY pgs=2546 cs=0 l=1 rx=0x7f719000fac0 tx=0x7f719000fe60).stop 2019-11-28T11:54:13.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.982+0000 7f71a3724700 1 -- 172.21.15.80:0/2053738026 shutdown_connections 2019-11-28T11:54:13.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.982+0000 7f71a3724700 1 --2- 172.21.15.80:0/2053738026 >> v2:172.21.15.174:3300/0 conn(0x7f719c0734e0 0x7f719c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:13.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.982+0000 7f71a3724700 1 --2- 172.21.15.80:0/2053738026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c06c0a0 0x7f719c072fa0 unknown :-1 s=CLOSED pgs=2546 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:13.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.982+0000 7f71a3724700 1 -- 172.21.15.80:0/2053738026 shutdown_connections 2019-11-28T11:54:13.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.982+0000 7f71a3724700 1 -- 172.21.15.80:0/2053738026 wait complete. 2019-11-28T11:54:13.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.982+0000 7f71a3724700 1 -- 172.21.15.80:0/2053738026 >> 172.21.15.80:0/2053738026 conn(0x7f719c061cf0 msgr2=0x7f719c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:13.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.985+0000 7f71a3724700 1 Processor -- start 2019-11-28T11:54:13.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.985+0000 7f71a3724700 1 -- start start 2019-11-28T11:54:13.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.985+0000 7f71a3724700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f719c10adf0 0x7f719c1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:13.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.985+0000 7f71a3724700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f719c076200 0x7f719c112e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:13.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.985+0000 7f71a3724700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c076660 con 0x7f719c1597f0 2019-11-28T11:54:13.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.985+0000 7f71a3724700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c073960 con 0x7f719c10adf0 2019-11-28T11:54:13.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.985+0000 7f71a3724700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c073c30 con 0x7f719c076200 2019-11-28T11:54:13.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a1cc1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f719c10adf0 0x7f719c1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:13.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a1cc1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f719c10adf0 0x7f719c1592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45006/0 (socket says 172.21.15.80:45006) 2019-11-28T11:54:13.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a1cc1700 1 -- 172.21.15.80:0/181067677 learned_addr learned my addr 172.21.15.80:0/181067677 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:13.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a24c2700 1 --2- 172.21.15.80:0/181067677 >> v2:172.21.15.174:3300/0 conn(0x7f719c076200 0x7f719c112e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:13.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a1cc1700 1 -- 172.21.15.80:0/181067677 >> v2:172.21.15.174:3300/0 conn(0x7f719c076200 msgr2=0x7f719c112e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:13.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/181067677 >> v2:172.21.15.174:3300/0 conn(0x7f719c076200 0x7f719c112e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:13.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a1cc1700 1 -- 172.21.15.80:0/181067677 >> v1:172.21.15.174:6789/0 conn(0x7f719c1597f0 legacy=0x7f719c075a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:13.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a1cc1700 1 -- 172.21.15.80:0/181067677 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0742c0 con 0x7f719c10adf0 2019-11-28T11:54:13.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/181067677 >> v2:172.21.15.80:3300/0 conn(0x7f719c10adf0 0x7f719c1592b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f71900107c0 tx=0x7f7190010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:13.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/181067677 >> v2:172.21.15.80:3300/0 conn(0x7f719c10adf0 0x7f719c1592b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f71900107c0 tx=0x7f7190010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:13.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/181067677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c10adf0 0x7f719c1592b0 secure :-1 s=READY pgs=2547 cs=0 l=1 rx=0x7f71900107c0 tx=0x7f7190010670).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:13.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/181067677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c10adf0 0x7f719c1592b0 secure :-1 s=THROTTLE_DONE pgs=2547 cs=0 l=1 rx=0x7f71900107c0 tx=0x7f7190010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:13.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/181067677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c10adf0 0x7f719c1592b0 secure :-1 s=THROTTLE_DONE pgs=2547 cs=0 l=1 rx=0x7f71900107c0 tx=0x7f7190010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:13.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/181067677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c10adf0 0x7f719c1592b0 secure :-1 s=THROTTLE_DONE pgs=2547 cs=0 l=1 rx=0x7f71900107c0 tx=0x7f7190010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:13.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f719a7fc700 1 -- 172.21.15.80:0/181067677 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71900058e0 con 0x7f719c10adf0 2019-11-28T11:54:13.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f719a7fc700 1 -- 172.21.15.80:0/181067677 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7190005500 con 0x7f719c10adf0 2019-11-28T11:54:13.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a3724700 1 -- 172.21.15.80:0/181067677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c074640 con 0x7f719c10adf0 2019-11-28T11:54:13.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f719a7fc700 1 -- 172.21.15.80:0/181067677 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7190005ec0 con 0x7f719c10adf0 2019-11-28T11:54:13.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a3724700 1 -- 172.21.15.80:0/181067677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c0742c0 con 0x7f719c10adf0 2019-11-28T11:54:13.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.986+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/181067677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c10adf0 0x7f719c1592b0 secure :-1 s=THROTTLE_DONE pgs=2547 cs=0 l=1 rx=0x7f71900107c0 tx=0x7f7190010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:13.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.987+0000 7f719a7fc700 1 -- 172.21.15.80:0/181067677 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f71900056f0 con 0x7f719c10adf0 2019-11-28T11:54:13.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.987+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/181067677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c10adf0 0x7f719c1592b0 secure :-1 s=THROTTLE_DONE pgs=2547 cs=0 l=1 rx=0x7f71900107c0 tx=0x7f7190010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:13.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.987+0000 7f719a7fc700 1 --2- 172.21.15.80:0/181067677 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f717c018730 0x7f717c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:13.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.987+0000 7f719a7fc700 1 -- 172.21.15.80:0/181067677 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f71900320c0 con 0x7f719c10adf0 2019-11-28T11:54:13.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.987+0000 7f71a14c0700 1 --2- 172.21.15.80:0/181067677 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f717c018730 0x7f717c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:13.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.987+0000 7f71a14c0700 1 --2- 172.21.15.80:0/181067677 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f717c018730 0x7f717c01abe0 crc :-1 s=READY pgs=1043 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:13.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.995+0000 7f71a3724700 1 -- 172.21.15.80:0/181067677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c074640 con 0x7f719c10adf0 2019-11-28T11:54:13.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.998+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/181067677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c10adf0 0x7f719c1592b0 secure :-1 s=THROTTLE_DONE pgs=2547 cs=0 l=1 rx=0x7f71900107c0 tx=0x7f7190010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:13.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:12.998+0000 7f719a7fc700 1 -- 172.21.15.80:0/181067677 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7190007620 con 0x7f719c10adf0 2019-11-28T11:54:13.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:13.172+0000 7f71a3724700 1 -- 172.21.15.80:0/181067677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f719c0742c0 con 0x7f719c10adf0 2019-11-28T11:54:13.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:13.172+0000 7f71a1cc1700 1 --2- 172.21.15.80:0/181067677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c10adf0 0x7f719c1592b0 secure :-1 s=THROTTLE_DONE pgs=2547 cs=0 l=1 rx=0x7f71900107c0 tx=0x7f7190010670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:13.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:13.172+0000 7f719a7fc700 1 -- 172.21.15.80:0/181067677 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 154 v154) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f7190006040 con 0x7f719c10adf0 2019-11-28T11:54:13.229 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 154 2019-11-28T11:54:13.229 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:13.230 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":154,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":154,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:53:57.302329+0000","modified":"2019-11-28T11:54:12.774548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":193,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2019-11-28T11:54:13.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:13.175+0000 7f71a3724700 1 -- 172.21.15.80:0/181067677 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f717c018730 msgr2=0x7f717c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:13.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:13.175+0000 7f71a3724700 1 --2- 172.21.15.80:0/181067677 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f717c018730 0x7f717c01abe0 crc :-1 s=READY pgs=1043 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:13.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:13.175+0000 7f71a3724700 1 -- 172.21.15.80:0/181067677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c10adf0 msgr2=0x7f719c1592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:13.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:13.175+0000 7f71a3724700 1 --2- 172.21.15.80:0/181067677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c10adf0 0x7f719c1592b0 secure :-1 s=READY pgs=2547 cs=0 l=1 rx=0x7f71900107c0 tx=0x7f7190010670).stop 2019-11-28T11:54:13.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:13.175+0000 7f71a3724700 1 -- 172.21.15.80:0/181067677 shutdown_connections 2019-11-28T11:54:13.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:13.175+0000 7f71a3724700 1 --2- 172.21.15.80:0/181067677 >> v2:172.21.15.174:3300/0 conn(0x7f719c076200 0x7f719c112e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:13.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:13.175+0000 7f71a3724700 1 --2- 172.21.15.80:0/181067677 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f717c018730 0x7f717c01abe0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:13.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:13.175+0000 7f71a3724700 1 --2- 172.21.15.80:0/181067677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f719c10adf0 0x7f719c1592b0 unknown :-1 s=CLOSED pgs=2547 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:13.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:13.175+0000 7f71a3724700 1 -- 172.21.15.80:0/181067677 shutdown_connections 2019-11-28T11:54:13.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:13.175+0000 7f71a3724700 1 -- 172.21.15.80:0/181067677 wait complete. 2019-11-28T11:54:13.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:13.175+0000 7f71a3724700 1 -- 172.21.15.80:0/181067677 >> 172.21.15.80:0/181067677 conn(0x7f719c13d930 msgr2=0x7f719c111550 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:13.241 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T11:54:14.242 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:14.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.306+0000 7f3f29882700 1 Processor -- start 2019-11-28T11:54:14.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.306+0000 7f3f29882700 1 -- start start 2019-11-28T11:54:14.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.307+0000 7f3f29882700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2406c0a0 0x7f3f24072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:14.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.307+0000 7f3f29882700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3f24072620 0x7f3f24164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:14.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.307+0000 7f3f29882700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2406db00 con 0x7f3f240734e0 2019-11-28T11:54:14.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.307+0000 7f3f29882700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f2406f330 con 0x7f3f24072620 2019-11-28T11:54:14.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.307+0000 7f3f29882700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f240706c0 con 0x7f3f2406c0a0 2019-11-28T11:54:14.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f23fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3f24072620 0x7f3f24164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:14.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f237fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2406c0a0 0x7f3f24072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:14.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f237fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2406c0a0 0x7f3f24072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:47286/0 (socket says 172.21.15.80:47286) 2019-11-28T11:54:14.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f23fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3f24072620 0x7f3f24164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:59916/0 (socket says 172.21.15.80:59916) 2019-11-28T11:54:14.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f237fe700 1 -- 172.21.15.80:0/1681268930 learned_addr learned my addr 172.21.15.80:0/1681268930 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:14.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f23fff700 1 -- 172.21.15.80:0/1681268930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2406c0a0 msgr2=0x7f3f24072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:14.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f23fff700 1 --2- 172.21.15.80:0/1681268930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2406c0a0 0x7f3f24072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:14.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f23fff700 1 -- 172.21.15.80:0/1681268930 >> v1:172.21.15.174:6789/0 conn(0x7f3f240734e0 legacy=0x7f3f24071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:14.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f23fff700 1 -- 172.21.15.80:0/1681268930 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f24070a40 con 0x7f3f24072620 2019-11-28T11:54:14.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f237fe700 1 --2- 172.21.15.80:0/1681268930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2406c0a0 0x7f3f24072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:14.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f23fff700 1 --2- 172.21.15.80:0/1681268930 >> v2:172.21.15.174:3300/0 conn(0x7f3f24072620 0x7f3f24164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3f1c00af80 tx=0x7f3f1c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:14.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f23fff700 1 --2- 172.21.15.80:0/1681268930 >> v2:172.21.15.174:3300/0 conn(0x7f3f24072620 0x7f3f24164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3f1c00af80 tx=0x7f3f1c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:14.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f23fff700 1 --2- 172.21.15.80:0/1681268930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f24072620 0x7f3f24164d70 secure :-1 s=READY pgs=1537 cs=0 l=1 rx=0x7f3f1c00af80 tx=0x7f3f1c00b790).ready entity=mon.1 client_cookie=5bc422c8e4804dd4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:14.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f23fff700 1 --2- 172.21.15.80:0/1681268930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f24072620 0x7f3f24164d70 secure :-1 s=THROTTLE_DONE pgs=1537 cs=0 l=1 rx=0x7f3f1c00af80 tx=0x7f3f1c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:14.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f227fc700 1 -- 172.21.15.80:0/1681268930 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f1c000bc0 con 0x7f3f24072620 2019-11-28T11:54:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f23fff700 1 --2- 172.21.15.80:0/1681268930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f24072620 0x7f3f24164d70 secure :-1 s=THROTTLE_DONE pgs=1537 cs=0 l=1 rx=0x7f3f1c00af80 tx=0x7f3f1c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f23fff700 1 --2- 172.21.15.80:0/1681268930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f24072620 0x7f3f24164d70 secure :-1 s=THROTTLE_DONE pgs=1537 cs=0 l=1 rx=0x7f3f1c00af80 tx=0x7f3f1c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.308+0000 7f3f227fc700 1 -- 172.21.15.80:0/1681268930 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1c0097f0 con 0x7f3f24072620 2019-11-28T11:54:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.309+0000 7f3f227fc700 1 -- 172.21.15.80:0/1681268930 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f1c009ec0 con 0x7f3f24072620 2019-11-28T11:54:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.309+0000 7f3f29882700 1 -- 172.21.15.80:0/1681268930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f24072620 msgr2=0x7f3f24164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.309+0000 7f3f29882700 1 --2- 172.21.15.80:0/1681268930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f24072620 0x7f3f24164d70 secure :-1 s=READY pgs=1537 cs=0 l=1 rx=0x7f3f1c00af80 tx=0x7f3f1c00b790).stop 2019-11-28T11:54:14.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.309+0000 7f3f29882700 1 -- 172.21.15.80:0/1681268930 shutdown_connections 2019-11-28T11:54:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.309+0000 7f3f29882700 1 --2- 172.21.15.80:0/1681268930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f24072620 0x7f3f24164d70 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.309+0000 7f3f29882700 1 --2- 172.21.15.80:0/1681268930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2406c0a0 0x7f3f24072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.309+0000 7f3f29882700 1 -- 172.21.15.80:0/1681268930 shutdown_connections 2019-11-28T11:54:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.309+0000 7f3f29882700 1 -- 172.21.15.80:0/1681268930 wait complete. 2019-11-28T11:54:14.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.309+0000 7f3f29882700 1 -- 172.21.15.80:0/1681268930 >> 172.21.15.80:0/1681268930 conn(0x7f3f24061cf0 msgr2=0x7f3f24064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:14.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.312+0000 7f3f29882700 1 Processor -- start 2019-11-28T11:54:14.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.312+0000 7f3f29882700 1 -- start start 2019-11-28T11:54:14.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f29882700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2413e9e0 0x7f3f24108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:14.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f29882700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f241066e0 con 0x7f3f2413e5f0 2019-11-28T11:54:14.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f29882700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2410ce40 con 0x7f3f24109430 2019-11-28T11:54:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f29882700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2410e060 con 0x7f3f2413e9e0 2019-11-28T11:54:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f237fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3f2413e5f0 0x7f3f2410a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44348/0 (socket says 172.21.15.80:44348) 2019-11-28T11:54:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f237fe700 1 -- 172.21.15.80:0/2132656449 learned_addr learned my addr 172.21.15.80:0/2132656449 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:14.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f22ffd700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2413e9e0 0x7f3f24108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:14.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f1bfff700 1 -- 172.21.15.80:0/2132656449 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116060870 0 0) 0x7f3f0c0079a0 con 0x7f3f2413e5f0 2019-11-28T11:54:14.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f1bfff700 1 -- 172.21.15.80:0/2132656449 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f08002e80 con 0x7f3f2413e5f0 2019-11-28T11:54:14.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f1bfff700 1 -- 172.21.15.80:0/2132656449 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856126572 0 0) 0x7f3f1c0095b0 con 0x7f3f24109430 2019-11-28T11:54:14.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f1bfff700 1 -- 172.21.15.80:0/2132656449 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f08004220 con 0x7f3f24109430 2019-11-28T11:54:14.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f22ffd700 1 -- 172.21.15.80:0/2132656449 >> v1:172.21.15.174:6789/0 conn(0x7f3f24109430 legacy=0x7f3f24168ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:14.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f22ffd700 1 -- 172.21.15.80:0/2132656449 >> v1:172.21.15.80:6789/0 conn(0x7f3f2413e5f0 legacy=0x7f3f2410a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:14.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f22ffd700 1 -- 172.21.15.80:0/2132656449 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2410e9c0 con 0x7f3f2413e9e0 2019-11-28T11:54:14.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f22ffd700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2413e9e0 0x7f3f24108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3f14010720 tx=0x7f3f14010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:14.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f22ffd700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2413e9e0 0x7f3f24108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3f14010720 tx=0x7f3f14010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:14.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.313+0000 7f3f22ffd700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2413e9e0 0x7f3f24108ef0 secure :-1 s=READY pgs=363 cs=0 l=1 rx=0x7f3f14010720 tx=0x7f3f14010ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:14.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.314+0000 7f3f22ffd700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2413e9e0 0x7f3f24108ef0 secure :-1 s=THROTTLE_DONE pgs=363 cs=0 l=1 rx=0x7f3f14010720 tx=0x7f3f14010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:14.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.314+0000 7f3f1bfff700 1 -- 172.21.15.80:0/2132656449 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f14000ce0 con 0x7f3f2413e9e0 2019-11-28T11:54:14.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.314+0000 7f3f22ffd700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2413e9e0 0x7f3f24108ef0 secure :-1 s=THROTTLE_DONE pgs=363 cs=0 l=1 rx=0x7f3f14010720 tx=0x7f3f14010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:14.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.314+0000 7f3f22ffd700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2413e9e0 0x7f3f24108ef0 secure :-1 s=THROTTLE_DONE pgs=363 cs=0 l=1 rx=0x7f3f14010720 tx=0x7f3f14010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:14.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.314+0000 7f3f1bfff700 1 -- 172.21.15.80:0/2132656449 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1400f270 con 0x7f3f2413e9e0 2019-11-28T11:54:14.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.314+0000 7f3f1bfff700 1 -- 172.21.15.80:0/2132656449 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f1400f980 con 0x7f3f2413e9e0 2019-11-28T11:54:14.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.314+0000 7f3f29882700 1 -- 172.21.15.80:0/2132656449 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2410ed40 con 0x7f3f2413e9e0 2019-11-28T11:54:14.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.314+0000 7f3f29882700 1 -- 172.21.15.80:0/2132656449 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2410e9c0 con 0x7f3f2413e9e0 2019-11-28T11:54:14.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.314+0000 7f3f22ffd700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2413e9e0 0x7f3f24108ef0 secure :-1 s=THROTTLE_DONE pgs=363 cs=0 l=1 rx=0x7f3f14010720 tx=0x7f3f14010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:14.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.314+0000 7f3f1bfff700 1 -- 172.21.15.80:0/2132656449 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3f1400f670 con 0x7f3f2413e9e0 2019-11-28T11:54:14.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.314+0000 7f3f22ffd700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2413e9e0 0x7f3f24108ef0 secure :-1 s=THROTTLE_DONE pgs=363 cs=0 l=1 rx=0x7f3f14010720 tx=0x7f3f14010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:14.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.314+0000 7f3f1bfff700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f08018750 0x7f3f0801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:14.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.314+0000 7f3f1bfff700 1 -- 172.21.15.80:0/2132656449 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f3f14031e90 con 0x7f3f2413e9e0 2019-11-28T11:54:14.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.315+0000 7f3f237fe700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f08018750 0x7f3f0801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:14.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.315+0000 7f3f237fe700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f08018750 0x7f3f0801abe0 crc :-1 s=READY pgs=1045 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:14.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.322+0000 7f3f29882700 1 -- 172.21.15.80:0/2132656449 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2410ed40 con 0x7f3f2413e9e0 2019-11-28T11:54:14.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.325+0000 7f3f22ffd700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2413e9e0 0x7f3f24108ef0 secure :-1 s=THROTTLE_DONE pgs=363 cs=0 l=1 rx=0x7f3f14010720 tx=0x7f3f14010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:14.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.325+0000 7f3f1bfff700 1 -- 172.21.15.80:0/2132656449 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3f1400f460 con 0x7f3f2413e9e0 2019-11-28T11:54:14.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.497+0000 7f3f29882700 1 -- 172.21.15.80:0/2132656449 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f2410e9c0 con 0x7f3f2413e9e0 2019-11-28T11:54:14.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.498+0000 7f3f22ffd700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2413e9e0 0x7f3f24108ef0 secure :-1 s=THROTTLE_DONE pgs=363 cs=0 l=1 rx=0x7f3f14010720 tx=0x7f3f14010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:14.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.498+0000 7f3f1bfff700 1 -- 172.21.15.80:0/2132656449 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 156 v156) v1 ==== 95+0+1782 (secure 0 0 0) 0x7f3f1400f670 con 0x7f3f2413e9e0 2019-11-28T11:54:14.555 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:14.555 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":156,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":156,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:53:57.302329+0000","modified":"2019-11-28T11:54:13.780572+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":193,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10771},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10771":{"gid":10771,"name":"b","rank":0,"incarnation":156,"state":"up:replay","state_seq":1,"addr":"172.21.15.80:6835/4038262210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":4038262210},{"type":"v1","addr":"172.21.15.80:6835","nonce":4038262210}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2019-11-28T11:54:14.555 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 156 2019-11-28T11:54:14.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.500+0000 7f3f29882700 1 -- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f08018750 msgr2=0x7f3f0801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:14.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.500+0000 7f3f29882700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f08018750 0x7f3f0801abe0 crc :-1 s=READY pgs=1045 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:14.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.500+0000 7f3f29882700 1 -- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2413e9e0 msgr2=0x7f3f24108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:14.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.500+0000 7f3f29882700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2413e9e0 0x7f3f24108ef0 secure :-1 s=READY pgs=363 cs=0 l=1 rx=0x7f3f14010720 tx=0x7f3f14010ac0).stop 2019-11-28T11:54:14.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.500+0000 7f3f29882700 1 -- 172.21.15.80:0/2132656449 shutdown_connections 2019-11-28T11:54:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.500+0000 7f3f29882700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3f08018750 0x7f3f0801abe0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.500+0000 7f3f29882700 1 --2- 172.21.15.80:0/2132656449 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f2413e9e0 0x7f3f24108ef0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.500+0000 7f3f29882700 1 -- 172.21.15.80:0/2132656449 shutdown_connections 2019-11-28T11:54:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.500+0000 7f3f29882700 1 -- 172.21.15.80:0/2132656449 wait complete. 2019-11-28T11:54:14.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:14.500+0000 7f3f29882700 1 -- 172.21.15.80:0/2132656449 >> 172.21.15.80:0/2132656449 conn(0x7f3f2413d620 msgr2=0x7f3f2413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:14.566 INFO:tasks.cephfs.filesystem:mapped states [u'up:replay'] to None 2019-11-28T11:54:15.567 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:15.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.631+0000 7f27f75fe700 1 Processor -- start 2019-11-28T11:54:15.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.632+0000 7f27f75fe700 1 -- start start 2019-11-28T11:54:15.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f75fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f006c490 0x7f27f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:15.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f75fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f27f006ce60 0x7f27f0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:15.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f75fe700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f006db00 con 0x7f27f006c0a0 2019-11-28T11:54:15.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f75fe700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f006fd60 con 0x7f27f006ce60 2019-11-28T11:54:15.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f75fe700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f0070030 con 0x7f27f006c490 2019-11-28T11:54:15.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f5b9b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f27f006c0a0 0x7f27f0072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44356/0 (socket says 172.21.15.80:44356) 2019-11-28T11:54:15.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f5b9b700 1 -- 172.21.15.80:0/2658374503 learned_addr learned my addr 172.21.15.80:0/2658374503 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:15.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f639c700 1 --2- 172.21.15.80:0/2658374503 >> v2:172.21.15.174:3300/0 conn(0x7f27f006ce60 0x7f27f0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:15.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f539a700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f006c490 0x7f27f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:15.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f4b99700 1 -- 172.21.15.80:0/2658374503 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828306073 0 0) 0x7f27e0001150 con 0x7f27f006c0a0 2019-11-28T11:54:15.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f4b99700 1 -- 172.21.15.80:0/2658374503 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27dc002e80 con 0x7f27f006c0a0 2019-11-28T11:54:15.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f4b99700 1 -- 172.21.15.80:0/2658374503 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3484714011 0 0) 0x7f27e0001130 con 0x7f27f006c0a0 2019-11-28T11:54:15.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f4b99700 1 -- 172.21.15.80:0/2658374503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f006c490 msgr2=0x7f27f006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:15.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f4b99700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f006c490 0x7f27f006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:15.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f4b99700 1 -- 172.21.15.80:0/2658374503 >> v2:172.21.15.174:3300/0 conn(0x7f27f006ce60 msgr2=0x7f27f0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:15.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f4b99700 1 --2- 172.21.15.80:0/2658374503 >> v2:172.21.15.174:3300/0 conn(0x7f27f006ce60 0x7f27f0164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:15.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f4b99700 1 -- 172.21.15.80:0/2658374503 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00706c0 con 0x7f27f006c0a0 2019-11-28T11:54:15.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f4b99700 1 -- 172.21.15.80:0/2658374503 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f27e0001660 con 0x7f27f006c0a0 2019-11-28T11:54:15.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f4b99700 1 -- 172.21.15.80:0/2658374503 >> v1:172.21.15.80:6789/0 conn(0x7f27f006c0a0 legacy=0x7f27f0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:15.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f4b99700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27dc0479e0 0x7f27dc049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:15.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f4b99700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27dc04a5c0 0x7f27dc04ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:15.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f4b99700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27dc04d260 0x7f27dc04f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:15.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f4b99700 1 -- 172.21.15.80:0/2658374503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc04ff40 con 0x7f27dc0479e0 2019-11-28T11:54:15.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f4b99700 1 -- 172.21.15.80:0/2658374503 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc050130 con 0x7f27dc04d260 2019-11-28T11:54:15.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.633+0000 7f27f4b99700 1 -- 172.21.15.80:0/2658374503 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc050360 con 0x7f27dc04a5c0 2019-11-28T11:54:15.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f5b9b700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27dc0479e0 0x7f27dc049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:15.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f639c700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27dc04d260 0x7f27dc04f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:15.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f539a700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27dc04a5c0 0x7f27dc04ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:15.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f5b9b700 1 -- 172.21.15.80:0/2658374503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27dc04a5c0 msgr2=0x7f27dc04ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:15.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f5b9b700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27dc04a5c0 0x7f27dc04ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:15.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f5b9b700 1 -- 172.21.15.80:0/2658374503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27dc04d260 msgr2=0x7f27dc04f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:15.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f5b9b700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27dc04d260 0x7f27dc04f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:15.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f5b9b700 1 -- 172.21.15.80:0/2658374503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc050610 con 0x7f27dc0479e0 2019-11-28T11:54:15.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f539a700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27dc04a5c0 0x7f27dc04ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:15.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f639c700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27dc04d260 0x7f27dc04f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:15.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f5b9b700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27dc0479e0 0x7f27dc049e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f27e000f8e0 tx=0x7f27e000fc80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:15.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f5b9b700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27dc0479e0 0x7f27dc049e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f27e000f8e0 tx=0x7f27e000fc80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:15.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f5b9b700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27dc0479e0 0x7f27dc049e40 secure :-1 s=READY pgs=2550 cs=0 l=1 rx=0x7f27e000f8e0 tx=0x7f27e000fc80).ready entity=mon.0 client_cookie=d973298dc9911c96 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:15.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f5b9b700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27dc0479e0 0x7f27dc049e40 secure :-1 s=THROTTLE_DONE pgs=2550 cs=0 l=1 rx=0x7f27e000f8e0 tx=0x7f27e000fc80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:15.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f4b99700 1 -- 172.21.15.80:0/2658374503 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27e0001130 con 0x7f27dc0479e0 2019-11-28T11:54:15.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f5b9b700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27dc0479e0 0x7f27dc049e40 secure :-1 s=THROTTLE_DONE pgs=2550 cs=0 l=1 rx=0x7f27e000f8e0 tx=0x7f27e000fc80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:15.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f5b9b700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27dc0479e0 0x7f27dc049e40 secure :-1 s=THROTTLE_DONE pgs=2550 cs=0 l=1 rx=0x7f27e000f8e0 tx=0x7f27e000fc80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:15.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f4b99700 1 -- 172.21.15.80:0/2658374503 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e0004430 con 0x7f27dc0479e0 2019-11-28T11:54:15.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f4b99700 1 -- 172.21.15.80:0/2658374503 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27e0004a80 con 0x7f27dc0479e0 2019-11-28T11:54:15.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f75fe700 1 -- 172.21.15.80:0/2658374503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27dc0479e0 msgr2=0x7f27dc049e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:15.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f75fe700 1 --2- 172.21.15.80:0/2658374503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27dc0479e0 0x7f27dc049e40 secure :-1 s=READY pgs=2550 cs=0 l=1 rx=0x7f27e000f8e0 tx=0x7f27e000fc80).stop 2019-11-28T11:54:15.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.634+0000 7f27f639c700 1 -- 172.21.15.80:0/2658374503 reap_dead start 2019-11-28T11:54:15.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.635+0000 7f27f75fe700 1 -- 172.21.15.80:0/2658374503 shutdown_connections 2019-11-28T11:54:15.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.635+0000 7f27f75fe700 1 -- 172.21.15.80:0/2658374503 shutdown_connections 2019-11-28T11:54:15.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.635+0000 7f27f75fe700 1 -- 172.21.15.80:0/2658374503 wait complete. 2019-11-28T11:54:15.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.635+0000 7f27f75fe700 1 -- 172.21.15.80:0/2658374503 >> 172.21.15.80:0/2658374503 conn(0x7f27f0061cf0 msgr2=0x7f27f0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:15.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.637+0000 7f27f75fe700 1 Processor -- start 2019-11-28T11:54:15.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.637+0000 7f27f75fe700 1 -- start start 2019-11-28T11:54:15.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.638+0000 7f27f75fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f0169e60 0x7f27f016c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:15.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.638+0000 7f27f75fe700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f010fa50 con 0x7f27f010ced0 2019-11-28T11:54:15.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.638+0000 7f27f75fe700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f010db60 con 0x7f27f013fb20 2019-11-28T11:54:15.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.638+0000 7f27f75fe700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f01073b0 con 0x7f27f0169e60 2019-11-28T11:54:15.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.638+0000 7f27f539a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f27f010ced0 0x7f27f010d360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44368/0 (socket says 172.21.15.80:44368) 2019-11-28T11:54:15.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.638+0000 7f27f539a700 1 -- 172.21.15.80:0/2836276993 learned_addr learned my addr 172.21.15.80:0/2836276993 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:15.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.638+0000 7f27f639c700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f0169e60 0x7f27f016c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:15.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.638+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704266012 0 0) 0x7f27d8000ed0 con 0x7f27f010ced0 2019-11-28T11:54:15.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d4002e80 con 0x7f27f010ced0 2019-11-28T11:54:15.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3492377920 0 0) 0x7f27d80010d0 con 0x7f27f010ced0 2019-11-28T11:54:15.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f27d40032e0 con 0x7f27f010ced0 2019-11-28T11:54:15.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f27d80016a0 con 0x7f27f010ced0 2019-11-28T11:54:15.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f0169e60 msgr2=0x7f27f016c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27ee7fc700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f0169e60 0x7f27f016c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 >> v1:172.21.15.174:6789/0 conn(0x7f27f013fb20 legacy=0x7f27f010df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 >> v1:172.21.15.80:6789/0 conn(0x7f27f010ced0 legacy=0x7f27f010d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27ee7fc700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27d4003330 0x7f27d4003760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27ee7fc700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d4003ca0 0x7f27d4004120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27ee7fc700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27d4004910 0x7f27d4004da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d400bb90 con 0x7f27d4003ca0 2019-11-28T11:54:15.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d400bdc0 con 0x7f27d4003330 2019-11-28T11:54:15.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d400bff0 con 0x7f27d4004910 2019-11-28T11:54:15.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27f539a700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d4003ca0 0x7f27d4004120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:15.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27f5b9b700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27d4003330 0x7f27d4003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:15.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27f639c700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27d4004910 0x7f27d4004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:15.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27f539a700 1 -- 172.21.15.80:0/2836276993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27d4004910 msgr2=0x7f27d4004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:15.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27f539a700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27d4004910 0x7f27d4004da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:15.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27f539a700 1 -- 172.21.15.80:0/2836276993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27d4003330 msgr2=0x7f27d4003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:15.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27f539a700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27d4003330 0x7f27d4003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:15.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27f539a700 1 -- 172.21.15.80:0/2836276993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d400c2a0 con 0x7f27d4003ca0 2019-11-28T11:54:15.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27f75fe700 1 -- 172.21.15.80:0/2836276993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f013acd0 con 0x7f27d4003ca0 2019-11-28T11:54:15.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27f539a700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d4003ca0 0x7f27d4004120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27d8010790 tx=0x7f27d800b8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:15.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27f539a700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d4003ca0 0x7f27d4004120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27d8010790 tx=0x7f27d800b8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:15.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.639+0000 7f27f539a700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d4003ca0 0x7f27d4004120 secure :-1 s=READY pgs=2552 cs=0 l=1 rx=0x7f27d8010790 tx=0x7f27d800b8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:15.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.640+0000 7f27f75fe700 1 -- 172.21.15.80:0/2836276993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f013a950 con 0x7f27d4003ca0 2019-11-28T11:54:15.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.640+0000 7f27f539a700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d4003ca0 0x7f27d4004120 secure :-1 s=THROTTLE_DONE pgs=2552 cs=0 l=1 rx=0x7f27d8010790 tx=0x7f27d800b8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:15.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.640+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27d8009b10 con 0x7f27d4003ca0 2019-11-28T11:54:15.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.640+0000 7f27f539a700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d4003ca0 0x7f27d4004120 secure :-1 s=THROTTLE_DONE pgs=2552 cs=0 l=1 rx=0x7f27d8010790 tx=0x7f27d800b8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:15.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.640+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d8009b10 con 0x7f27d4003ca0 2019-11-28T11:54:15.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.640+0000 7f27f539a700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d4003ca0 0x7f27d4004120 secure :-1 s=THROTTLE_DONE pgs=2552 cs=0 l=1 rx=0x7f27d8010790 tx=0x7f27d800b8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:15.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.640+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27d800a400 con 0x7f27d4003ca0 2019-11-28T11:54:15.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.640+0000 7f27f539a700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d4003ca0 0x7f27d4004120 secure :-1 s=THROTTLE_DONE pgs=2552 cs=0 l=1 rx=0x7f27d8010790 tx=0x7f27d800b8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:15.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.640+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f27d8009df0 con 0x7f27d4003ca0 2019-11-28T11:54:15.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.640+0000 7f27f539a700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d4003ca0 0x7f27d4004120 secure :-1 s=THROTTLE_DONE pgs=2552 cs=0 l=1 rx=0x7f27d8010790 tx=0x7f27d800b8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:15.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.640+0000 7f27ee7fc700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27d4029380 0x7f27d402b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:15.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.640+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f27d8031fe0 con 0x7f27d4003ca0 2019-11-28T11:54:15.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.641+0000 7f27f5b9b700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27d4029380 0x7f27d402b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:15.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.641+0000 7f27f5b9b700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27d4029380 0x7f27d402b7b0 crc :-1 s=READY pgs=1046 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:15.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.647+0000 7f27f75fe700 1 -- 172.21.15.80:0/2836276993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c8002e60 con 0x7f27d4003ca0 2019-11-28T11:54:15.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.650+0000 7f27f539a700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d4003ca0 0x7f27d4004120 secure :-1 s=THROTTLE_DONE pgs=2552 cs=0 l=1 rx=0x7f27d8010790 tx=0x7f27d800b8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:15.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.650+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f27d8017720 con 0x7f27d4003ca0 2019-11-28T11:54:15.718 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:54:15.728 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:54:15.733 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:54:15.739 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:54:15.743 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:54:15.747 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:54:15.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.831+0000 7f27f75fe700 1 -- 172.21.15.80:0/2836276993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27c8001d10 con 0x7f27d4003ca0 2019-11-28T11:54:15.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.831+0000 7f27f539a700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d4003ca0 0x7f27d4004120 secure :-1 s=THROTTLE_DONE pgs=2552 cs=0 l=1 rx=0x7f27d8010790 tx=0x7f27d800b8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:15.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.831+0000 7f27ee7fc700 1 -- 172.21.15.80:0/2836276993 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 158 v158) v1 ==== 95+0+1782 (secure 0 0 0) 0x7f27d8009df0 con 0x7f27d4003ca0 2019-11-28T11:54:15.891 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 158 2019-11-28T11:54:15.891 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:15.891 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":158,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":158,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:53:57.302329+0000","modified":"2019-11-28T11:54:15.784963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":193,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10771},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10771":{"gid":10771,"name":"b","rank":0,"incarnation":156,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.80:6835/4038262210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":4038262210},{"type":"v1","addr":"172.21.15.80:6835","nonce":4038262210}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2019-11-28T11:54:15.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.834+0000 7f27f75fe700 1 -- 172.21.15.80:0/2836276993 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27d4029380 msgr2=0x7f27d402b7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:15.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.834+0000 7f27f75fe700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f27d4029380 0x7f27d402b7b0 crc :-1 s=READY pgs=1046 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:15.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.834+0000 7f27f75fe700 1 -- 172.21.15.80:0/2836276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d4003ca0 msgr2=0x7f27d4004120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:15.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.834+0000 7f27f75fe700 1 --2- 172.21.15.80:0/2836276993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27d4003ca0 0x7f27d4004120 secure :-1 s=READY pgs=2552 cs=0 l=1 rx=0x7f27d8010790 tx=0x7f27d800b8d0).stop 2019-11-28T11:54:15.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.834+0000 7f27f639c700 1 -- 172.21.15.80:0/2836276993 reap_dead start 2019-11-28T11:54:15.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.834+0000 7f27f75fe700 1 -- 172.21.15.80:0/2836276993 shutdown_connections 2019-11-28T11:54:15.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.834+0000 7f27f75fe700 1 -- 172.21.15.80:0/2836276993 shutdown_connections 2019-11-28T11:54:15.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.834+0000 7f27f75fe700 1 -- 172.21.15.80:0/2836276993 wait complete. 2019-11-28T11:54:15.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:15.834+0000 7f27f75fe700 1 -- 172.21.15.80:0/2836276993 >> 172.21.15.80:0/2836276993 conn(0x7f27f0142090 msgr2=0x7f27f010ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:15.900 INFO:tasks.cephfs.filesystem:mapped states [u'up:rejoin'] to None 2019-11-28T11:54:16.900 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.966+0000 7f473f857700 1 Processor -- start 2019-11-28T11:54:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.966+0000 7f473f857700 1 -- start start 2019-11-28T11:54:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473f857700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f473806c0a0 0x7f4738072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473f857700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47380734e0 0x7f4738071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473f857700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473806db00 con 0x7f4738072360 2019-11-28T11:54:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473f857700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473806fd60 con 0x7f473806c0a0 2019-11-28T11:54:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473f857700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4738070030 con 0x7f47380734e0 2019-11-28T11:54:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473ddf4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f473806c0a0 0x7f4738072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473e5f5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4738072360 0x7f473806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44384/0 (socket says 172.21.15.80:44384) 2019-11-28T11:54:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473e5f5700 1 -- 172.21.15.80:0/3996832324 learned_addr learned my addr 172.21.15.80:0/3996832324 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473d5f3700 1 --2- 172.21.15.80:0/3996832324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47380734e0 0x7f4738071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473ddf4700 1 -- 172.21.15.80:0/3996832324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47380734e0 msgr2=0x7f4738071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473ddf4700 1 --2- 172.21.15.80:0/3996832324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47380734e0 0x7f4738071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473ddf4700 1 -- 172.21.15.80:0/3996832324 >> v1:172.21.15.80:6789/0 conn(0x7f4738072360 legacy=0x7f473806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473cdf2700 1 -- 172.21.15.80:0/3996832324 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3977233595 0 0) 0x7f4730001150 con 0x7f4738072360 2019-11-28T11:54:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473ddf4700 1 -- 172.21.15.80:0/3996832324 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47380706c0 con 0x7f473806c0a0 2019-11-28T11:54:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473ddf4700 1 --2- 172.21.15.80:0/3996832324 >> v2:172.21.15.80:3300/0 conn(0x7f473806c0a0 0x7f4738072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f472800af50 tx=0x7f472800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473ddf4700 1 --2- 172.21.15.80:0/3996832324 >> v2:172.21.15.80:3300/0 conn(0x7f473806c0a0 0x7f4738072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f472800af50 tx=0x7f472800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473ddf4700 1 --2- 172.21.15.80:0/3996832324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f473806c0a0 0x7f4738072fa0 secure :-1 s=READY pgs=2554 cs=0 l=1 rx=0x7f472800af50 tx=0x7f472800b6e0).ready entity=mon.0 client_cookie=b5da76075b8ebc65 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473ddf4700 1 --2- 172.21.15.80:0/3996832324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f473806c0a0 0x7f4738072fa0 secure :-1 s=THROTTLE_DONE pgs=2554 cs=0 l=1 rx=0x7f472800af50 tx=0x7f472800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473cdf2700 1 -- 172.21.15.80:0/3996832324 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4728007210 con 0x7f473806c0a0 2019-11-28T11:54:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.967+0000 7f473ddf4700 1 --2- 172.21.15.80:0/3996832324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f473806c0a0 0x7f4738072fa0 secure :-1 s=THROTTLE_DONE pgs=2554 cs=0 l=1 rx=0x7f472800af50 tx=0x7f472800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.968+0000 7f473ddf4700 1 --2- 172.21.15.80:0/3996832324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f473806c0a0 0x7f4738072fa0 secure :-1 s=THROTTLE_DONE pgs=2554 cs=0 l=1 rx=0x7f472800af50 tx=0x7f472800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.968+0000 7f473cdf2700 1 -- 172.21.15.80:0/3996832324 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47280099b0 con 0x7f473806c0a0 2019-11-28T11:54:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.968+0000 7f473cdf2700 1 -- 172.21.15.80:0/3996832324 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4728009ba0 con 0x7f473806c0a0 2019-11-28T11:54:17.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.968+0000 7f473f857700 1 -- 172.21.15.80:0/3996832324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f473806c0a0 msgr2=0x7f4738072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:17.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.968+0000 7f473f857700 1 --2- 172.21.15.80:0/3996832324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f473806c0a0 0x7f4738072fa0 secure :-1 s=READY pgs=2554 cs=0 l=1 rx=0x7f472800af50 tx=0x7f472800b6e0).stop 2019-11-28T11:54:17.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.968+0000 7f473f857700 1 -- 172.21.15.80:0/3996832324 shutdown_connections 2019-11-28T11:54:17.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.968+0000 7f473f857700 1 --2- 172.21.15.80:0/3996832324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47380734e0 0x7f4738071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:17.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.968+0000 7f473f857700 1 --2- 172.21.15.80:0/3996832324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f473806c0a0 0x7f4738072fa0 unknown :-1 s=CLOSED pgs=2554 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:17.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.968+0000 7f473f857700 1 -- 172.21.15.80:0/3996832324 shutdown_connections 2019-11-28T11:54:17.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.968+0000 7f473f857700 1 -- 172.21.15.80:0/3996832324 wait complete. 2019-11-28T11:54:17.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.968+0000 7f473f857700 1 -- 172.21.15.80:0/3996832324 >> 172.21.15.80:0/3996832324 conn(0x7f4738061cf0 msgr2=0x7f4738064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.971+0000 7f473f857700 1 Processor -- start 2019-11-28T11:54:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.971+0000 7f473f857700 1 -- start start 2019-11-28T11:54:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f473f857700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4738103000 0x7f4738103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:17.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f473f857700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47381039d0 0x7f4738167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:17.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f473f857700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47381312c0 con 0x7f473813dc00 2019-11-28T11:54:17.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f473f857700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4738105830 con 0x7f47381039d0 2019-11-28T11:54:17.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f473f857700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4738105b00 con 0x7f4738103000 2019-11-28T11:54:17.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f473e5f5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47381039d0 0x7f4738167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:17.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f473e5f5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47381039d0 0x7f4738167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45076/0 (socket says 172.21.15.80:45076) 2019-11-28T11:54:17.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f473e5f5700 1 -- 172.21.15.80:0/2273838026 learned_addr learned my addr 172.21.15.80:0/2273838026 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:17.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f473d5f3700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4738103000 0x7f4738103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:17.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f473e5f5700 1 -- 172.21.15.80:0/2273838026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4738103000 msgr2=0x7f4738103490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:17.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f47367fc700 1 -- 172.21.15.80:0/2273838026 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398694998 0 0) 0x7f47280097e0 con 0x7f473813dc00 2019-11-28T11:54:17.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f473e5f5700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4738103000 0x7f4738103490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:17.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f473e5f5700 1 -- 172.21.15.80:0/2273838026 >> v1:172.21.15.174:6789/0 conn(0x7f473813dc00 legacy=0x7f4738109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:17.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f473e5f5700 1 -- 172.21.15.80:0/2273838026 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4738106190 con 0x7f47381039d0 2019-11-28T11:54:17.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f473e5f5700 1 --2- 172.21.15.80:0/2273838026 >> v2:172.21.15.80:3300/0 conn(0x7f47381039d0 0x7f4738167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4730010410 tx=0x7f4730010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f473e5f5700 1 --2- 172.21.15.80:0/2273838026 >> v2:172.21.15.80:3300/0 conn(0x7f47381039d0 0x7f4738167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4730010410 tx=0x7f4730010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.972+0000 7f473e5f5700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47381039d0 0x7f4738167a10 secure :-1 s=READY pgs=2555 cs=0 l=1 rx=0x7f4730010410 tx=0x7f4730010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:17.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.973+0000 7f473e5f5700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47381039d0 0x7f4738167a10 secure :-1 s=THROTTLE_DONE pgs=2555 cs=0 l=1 rx=0x7f4730010410 tx=0x7f4730010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.973+0000 7f47367fc700 1 -- 172.21.15.80:0/2273838026 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4730000960 con 0x7f47381039d0 2019-11-28T11:54:17.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.973+0000 7f473e5f5700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47381039d0 0x7f4738167a10 secure :-1 s=THROTTLE_DONE pgs=2555 cs=0 l=1 rx=0x7f4730010410 tx=0x7f4730010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.973+0000 7f47367fc700 1 -- 172.21.15.80:0/2273838026 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47300010e0 con 0x7f47381039d0 2019-11-28T11:54:17.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.973+0000 7f473e5f5700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47381039d0 0x7f4738167a10 secure :-1 s=THROTTLE_DONE pgs=2555 cs=0 l=1 rx=0x7f4730010410 tx=0x7f4730010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.973+0000 7f47367fc700 1 -- 172.21.15.80:0/2273838026 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47300012d0 con 0x7f47381039d0 2019-11-28T11:54:17.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.973+0000 7f473f857700 1 -- 172.21.15.80:0/2273838026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4738106510 con 0x7f47381039d0 2019-11-28T11:54:17.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.973+0000 7f473f857700 1 -- 172.21.15.80:0/2273838026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4738106190 con 0x7f47381039d0 2019-11-28T11:54:17.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.974+0000 7f473e5f5700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47381039d0 0x7f4738167a10 secure :-1 s=THROTTLE_DONE pgs=2555 cs=0 l=1 rx=0x7f4730010410 tx=0x7f4730010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.974+0000 7f473e5f5700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47381039d0 0x7f4738167a10 secure :-1 s=THROTTLE_DONE pgs=2555 cs=0 l=1 rx=0x7f4730010410 tx=0x7f4730010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.974+0000 7f47367fc700 1 -- 172.21.15.80:0/2273838026 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4730000960 con 0x7f47381039d0 2019-11-28T11:54:17.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.974+0000 7f47367fc700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f471c018730 0x7f471c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:17.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.974+0000 7f47367fc700 1 -- 172.21.15.80:0/2273838026 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f4730031aa0 con 0x7f47381039d0 2019-11-28T11:54:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.974+0000 7f473ddf4700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f471c018730 0x7f471c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.974+0000 7f473ddf4700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f471c018730 0x7f471c01abc0 crc :-1 s=READY pgs=1047 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.981+0000 7f473f857700 1 -- 172.21.15.80:0/2273838026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4738106510 con 0x7f47381039d0 2019-11-28T11:54:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.984+0000 7f473e5f5700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47381039d0 0x7f4738167a10 secure :-1 s=THROTTLE_DONE pgs=2555 cs=0 l=1 rx=0x7f4730010410 tx=0x7f4730010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:16.984+0000 7f47367fc700 1 -- 172.21.15.80:0/2273838026 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f47300075b0 con 0x7f47381039d0 2019-11-28T11:54:17.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.158+0000 7f473f857700 1 -- 172.21.15.80:0/2273838026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4738106190 con 0x7f47381039d0 2019-11-28T11:54:17.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.159+0000 7f473e5f5700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47381039d0 0x7f4738167a10 secure :-1 s=THROTTLE_DONE pgs=2555 cs=0 l=1 rx=0x7f4730010410 tx=0x7f4730010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.159+0000 7f47367fc700 1 -- 172.21.15.80:0/2273838026 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 159 v159) v1 ==== 95+0+1782 (secure 0 0 0) 0x7f4730000960 con 0x7f47381039d0 2019-11-28T11:54:17.216 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 159 2019-11-28T11:54:17.216 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:17.216 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":159,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":159,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:53:57.302329+0000","modified":"2019-11-28T11:54:16.788807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":193,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10771},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10771":{"gid":10771,"name":"b","rank":0,"incarnation":156,"state":"up:active","state_seq":4,"addr":"172.21.15.80:6835/4038262210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":4038262210},{"type":"v1","addr":"172.21.15.80:6835","nonce":4038262210}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2019-11-28T11:54:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.161+0000 7f473f857700 1 -- 172.21.15.80:0/2273838026 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f471c018730 msgr2=0x7f471c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.161+0000 7f473f857700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f471c018730 0x7f471c01abc0 crc :-1 s=READY pgs=1047 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.161+0000 7f473f857700 1 -- 172.21.15.80:0/2273838026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47381039d0 msgr2=0x7f4738167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.161+0000 7f473f857700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47381039d0 0x7f4738167a10 secure :-1 s=READY pgs=2555 cs=0 l=1 rx=0x7f4730010410 tx=0x7f4730010270).stop 2019-11-28T11:54:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.161+0000 7f473f857700 1 -- 172.21.15.80:0/2273838026 shutdown_connections 2019-11-28T11:54:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.161+0000 7f473f857700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47381039d0 0x7f4738167a10 unknown :-1 s=CLOSED pgs=2555 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.161+0000 7f473f857700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4738103000 0x7f4738103490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.161+0000 7f473f857700 1 --2- 172.21.15.80:0/2273838026 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f471c018730 0x7f471c01abc0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.161+0000 7f473f857700 1 -- 172.21.15.80:0/2273838026 shutdown_connections 2019-11-28T11:54:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.161+0000 7f473f857700 1 -- 172.21.15.80:0/2273838026 wait complete. 2019-11-28T11:54:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.161+0000 7f473f857700 1 -- 172.21.15.80:0/2273838026 >> 172.21.15.80:0/2273838026 conn(0x7f473811bfc0 msgr2=0x7f4738141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:17.227 INFO:tasks.cephfs.filesystem:mapped states [u'up:active'] to up:active 2019-11-28T11:54:17.228 INFO:tasks.cephfs.filesystem:reached state 'up:active' in 4.31537699699s 2019-11-28T11:54:17.228 DEBUG:tasks.cephfs.mount:Creating test file 2019-11-28 11:54:17.228365 0 2019-11-28T11:54:17.228 INFO:teuthology.orchestra.run.smithi076:> sudo touch '/home/ubuntu/cephtest/mnt.0/2019-11-28 11:54:17.228365 0' 2019-11-28T11:54:17.289 DEBUG:tasks.cephfs.mount:Deleting test file 2019-11-28 11:54:17.228365 0 2019-11-28T11:54:17.290 INFO:teuthology.orchestra.run.smithi076:> sudo rm -f '/home/ubuntu/cephtest/mnt.0/2019-11-28 11:54:17.228365 0' 2019-11-28T11:54:17.345 DEBUG:tasks.cephfs.mount:Creating test file 2019-11-28 11:54:17.345173 1 2019-11-28T11:54:17.345 INFO:teuthology.orchestra.run.smithi016:> sudo touch '/home/ubuntu/cephtest/mnt.1/2019-11-28 11:54:17.345173 1' 2019-11-28T11:54:17.415 DEBUG:tasks.cephfs.mount:Deleting test file 2019-11-28 11:54:17.345173 1 2019-11-28T11:54:17.415 INFO:teuthology.orchestra.run.smithi016:> sudo rm -f '/home/ubuntu/cephtest/mnt.1/2019-11-28 11:54:17.345173 1' 2019-11-28T11:54:17.485 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_restart' 2019-11-28T11:54:17.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.547+0000 7fc021f11700 1 Processor -- start 2019-11-28T11:54:17.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.547+0000 7fc021f11700 1 -- start start 2019-11-28T11:54:17.613 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.548+0000 7fc021f11700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc01c06c0a0 0x7fc01c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:17.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.548+0000 7fc021f11700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c072620 0x7fc01c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:17.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.548+0000 7fc021f11700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c06db00 con 0x7fc01c0734e0 2019-11-28T11:54:17.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.548+0000 7fc021f11700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01c06fd60 con 0x7fc01c06c0a0 2019-11-28T11:54:17.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.548+0000 7fc021f11700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c070030 con 0x7fc01c072620 2019-11-28T11:54:17.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.548+0000 7fc020caf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c072620 0x7fc01c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:17.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.548+0000 7fc01bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc01c06c0a0 0x7fc01c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:17.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.548+0000 7fc013fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc01c0734e0 0x7fc01c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:59940/0 (socket says 172.21.15.80:59940) 2019-11-28T11:54:17.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.548+0000 7fc01bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc01c06c0a0 0x7fc01c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:59966/0 (socket says 172.21.15.80:59966) 2019-11-28T11:54:17.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.548+0000 7fc020caf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c072620 0x7fc01c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:47344/0 (socket says 172.21.15.80:47344) 2019-11-28T11:54:17.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.548+0000 7fc01bfff700 1 -- 172.21.15.80:0/1436645460 learned_addr learned my addr 172.21.15.80:0/1436645460 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:17.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.548+0000 7fc020caf700 1 -- 172.21.15.80:0/1436645460 >> v2:172.21.15.174:3300/0 conn(0x7fc01c06c0a0 msgr2=0x7fc01c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:17.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.548+0000 7fc020caf700 1 --2- 172.21.15.80:0/1436645460 >> v2:172.21.15.174:3300/0 conn(0x7fc01c06c0a0 0x7fc01c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:17.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.548+0000 7fc020caf700 1 -- 172.21.15.80:0/1436645460 >> v1:172.21.15.174:6789/0 conn(0x7fc01c0734e0 legacy=0x7fc01c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:17.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.548+0000 7fc020caf700 1 -- 172.21.15.80:0/1436645460 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c0706c0 con 0x7fc01c072620 2019-11-28T11:54:17.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.549+0000 7fc020caf700 1 --2- 172.21.15.80:0/1436645460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c072620 0x7fc01c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc01400b300 tx=0x7fc01400b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.549+0000 7fc020caf700 1 --2- 172.21.15.80:0/1436645460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c072620 0x7fc01c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc01400b300 tx=0x7fc01400b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.616 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.549+0000 7fc020caf700 1 --2- 172.21.15.80:0/1436645460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c072620 0x7fc01c164d70 secure :-1 s=READY pgs=364 cs=0 l=1 rx=0x7fc01400b300 tx=0x7fc01400b600).ready entity=mon.2 client_cookie=3512252aa0443785 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:17.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.549+0000 7fc020caf700 1 --2- 172.21.15.80:0/1436645460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c072620 0x7fc01c164d70 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7fc01400b300 tx=0x7fc01400b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.549+0000 7fc020caf700 1 --2- 172.21.15.80:0/1436645460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c072620 0x7fc01c164d70 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7fc01400b300 tx=0x7fc01400b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.549+0000 7fc01b7fe700 1 -- 172.21.15.80:0/1436645460 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0140075c0 con 0x7fc01c072620 2019-11-28T11:54:17.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.549+0000 7fc020caf700 1 --2- 172.21.15.80:0/1436645460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c072620 0x7fc01c164d70 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7fc01400b300 tx=0x7fc01400b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.549+0000 7fc01b7fe700 1 -- 172.21.15.80:0/1436645460 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc014000e90 con 0x7fc01c072620 2019-11-28T11:54:17.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.549+0000 7fc01b7fe700 1 -- 172.21.15.80:0/1436645460 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc01400a220 con 0x7fc01c072620 2019-11-28T11:54:17.617 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.549+0000 7fc021f11700 1 -- 172.21.15.80:0/1436645460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c072620 msgr2=0x7fc01c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:17.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.549+0000 7fc021f11700 1 --2- 172.21.15.80:0/1436645460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c072620 0x7fc01c164d70 secure :-1 s=READY pgs=364 cs=0 l=1 rx=0x7fc01400b300 tx=0x7fc01400b600).stop 2019-11-28T11:54:17.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.550+0000 7fc021f11700 1 -- 172.21.15.80:0/1436645460 shutdown_connections 2019-11-28T11:54:17.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.550+0000 7fc021f11700 1 --2- 172.21.15.80:0/1436645460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c072620 0x7fc01c164d70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:17.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.550+0000 7fc021f11700 1 --2- 172.21.15.80:0/1436645460 >> v2:172.21.15.174:3300/0 conn(0x7fc01c06c0a0 0x7fc01c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:17.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.550+0000 7fc021f11700 1 -- 172.21.15.80:0/1436645460 shutdown_connections 2019-11-28T11:54:17.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.550+0000 7fc021f11700 1 -- 172.21.15.80:0/1436645460 wait complete. 2019-11-28T11:54:17.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.550+0000 7fc021f11700 1 -- 172.21.15.80:0/1436645460 >> 172.21.15.80:0/1436645460 conn(0x7fc01c061cf0 msgr2=0x7fc01c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:17.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.552+0000 7fc021f11700 1 Processor -- start 2019-11-28T11:54:17.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.552+0000 7fc021f11700 1 -- start start 2019-11-28T11:54:17.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.553+0000 7fc021f11700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc01c13e300 0x7fc01c13e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:17.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.553+0000 7fc021f11700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c10d6c0 0x7fc01c1081f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:17.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.553+0000 7fc021f11700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c1066e0 con 0x7fc01c10db50 2019-11-28T11:54:17.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.553+0000 7fc021f11700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01c10a4a0 con 0x7fc01c13e300 2019-11-28T11:54:17.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.553+0000 7fc021f11700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c10a770 con 0x7fc01c10d6c0 2019-11-28T11:54:17.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.553+0000 7fc01bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc01c13e300 0x7fc01c13e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:17.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.553+0000 7fc013fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c10d6c0 0x7fc01c1081f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:17.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.553+0000 7fc020caf700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc01c10db50 0x7fc01c108730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:59950/0 (socket says 172.21.15.80:59950) 2019-11-28T11:54:17.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.553+0000 7fc020caf700 1 -- 172.21.15.80:0/9653903 learned_addr learned my addr 172.21.15.80:0/9653903 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:17.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.553+0000 7fc01bfff700 1 -- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c10d6c0 msgr2=0x7fc01c1081f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:17.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.553+0000 7fc01bfff700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c10d6c0 0x7fc01c1081f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:17.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.553+0000 7fc01bfff700 1 -- 172.21.15.80:0/9653903 >> v1:172.21.15.174:6789/0 conn(0x7fc01c10db50 legacy=0x7fc01c108730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:17.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.553+0000 7fc0197fa700 1 -- 172.21.15.80:0/9653903 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002290478 0 0) 0x7fc01400af60 con 0x7fc01c10db50 2019-11-28T11:54:17.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.553+0000 7fc01bfff700 1 -- 172.21.15.80:0/9653903 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c10ae00 con 0x7fc01c13e300 2019-11-28T11:54:17.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.553+0000 7fc013fff700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c10d6c0 0x7fc01c1081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:17.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.553+0000 7fc01bfff700 1 --2- 172.21.15.80:0/9653903 >> v2:172.21.15.174:3300/0 conn(0x7fc01c13e300 0x7fc01c13e6f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc00c0103a0 tx=0x7fc00c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.554+0000 7fc01bfff700 1 --2- 172.21.15.80:0/9653903 >> v2:172.21.15.174:3300/0 conn(0x7fc01c13e300 0x7fc01c13e6f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc00c0103a0 tx=0x7fc00c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.554+0000 7fc01bfff700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01c13e300 0x7fc01c13e6f0 secure :-1 s=READY pgs=1543 cs=0 l=1 rx=0x7fc00c0103a0 tx=0x7fc00c010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:17.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.554+0000 7fc01bfff700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01c13e300 0x7fc01c13e6f0 secure :-1 s=THROTTLE_DONE pgs=1543 cs=0 l=1 rx=0x7fc00c0103a0 tx=0x7fc00c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.554+0000 7fc0197fa700 1 -- 172.21.15.80:0/9653903 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc00c0095f0 con 0x7fc01c13e300 2019-11-28T11:54:17.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.554+0000 7fc01bfff700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01c13e300 0x7fc01c13e6f0 secure :-1 s=THROTTLE_DONE pgs=1543 cs=0 l=1 rx=0x7fc00c0103a0 tx=0x7fc00c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.554+0000 7fc01bfff700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01c13e300 0x7fc01c13e6f0 secure :-1 s=THROTTLE_DONE pgs=1543 cs=0 l=1 rx=0x7fc00c0103a0 tx=0x7fc00c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.554+0000 7fc0197fa700 1 -- 172.21.15.80:0/9653903 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c009c60 con 0x7fc01c13e300 2019-11-28T11:54:17.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.554+0000 7fc0197fa700 1 -- 172.21.15.80:0/9653903 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc00c0095f0 con 0x7fc01c13e300 2019-11-28T11:54:17.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.554+0000 7fc021f11700 1 -- 172.21.15.80:0/9653903 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c10b180 con 0x7fc01c13e300 2019-11-28T11:54:17.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.554+0000 7fc021f11700 1 -- 172.21.15.80:0/9653903 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c10ae00 con 0x7fc01c13e300 2019-11-28T11:54:17.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.554+0000 7fc01bfff700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01c13e300 0x7fc01c13e6f0 secure :-1 s=THROTTLE_DONE pgs=1543 cs=0 l=1 rx=0x7fc00c0103a0 tx=0x7fc00c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.554+0000 7fc0197fa700 1 -- 172.21.15.80:0/9653903 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc00c009800 con 0x7fc01c13e300 2019-11-28T11:54:17.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.555+0000 7fc01bfff700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01c13e300 0x7fc01c13e6f0 secure :-1 s=THROTTLE_DONE pgs=1543 cs=0 l=1 rx=0x7fc00c0103a0 tx=0x7fc00c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.555+0000 7fc0197fa700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbff4018730 0x7fbff401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:17.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.555+0000 7fc0197fa700 1 -- 172.21.15.80:0/9653903 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fc00c031a70 con 0x7fc01c13e300 2019-11-28T11:54:17.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.555+0000 7fc013fff700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbff4018730 0x7fbff401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:17.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.555+0000 7fc013fff700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbff4018730 0x7fbff401abc0 crc :-1 s=READY pgs=1048 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:17.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.562+0000 7fc021f11700 1 -- 172.21.15.80:0/9653903 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c10b180 con 0x7fc01c13e300 2019-11-28T11:54:17.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.566+0000 7fc01bfff700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01c13e300 0x7fc01c13e6f0 secure :-1 s=THROTTLE_DONE pgs=1543 cs=0 l=1 rx=0x7fc00c0103a0 tx=0x7fc00c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.566+0000 7fc0197fa700 1 -- 172.21.15.80:0/9653903 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc00c0095f0 con 0x7fc01c13e300 2019-11-28T11:54:17.795 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.738+0000 7fc021f11700 1 -- 172.21.15.80:0/9653903 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_restart"]} v 0) v1 -- 0x7fc01c10ae00 con 0x7fc01c13e300 2019-11-28T11:54:17.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.800+0000 7fc01bfff700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01c13e300 0x7fc01c13e6f0 secure :-1 s=THROTTLE_DONE pgs=1543 cs=0 l=1 rx=0x7fc00c0103a0 tx=0x7fc00c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:17.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.800+0000 7fc0197fa700 1 -- 172.21.15.80:0/9653903 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_restart"]}]=0 v711) v1 ==== 144+0+0 (secure 0 0 0) 0x7fc00c009800 con 0x7fc01c13e300 2019-11-28T11:54:17.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.804+0000 7fc021f11700 1 -- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbff4018730 msgr2=0x7fbff401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:17.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.804+0000 7fc021f11700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbff4018730 0x7fbff401abc0 crc :-1 s=READY pgs=1048 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:17.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.804+0000 7fc021f11700 1 -- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01c13e300 msgr2=0x7fc01c13e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:17.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.804+0000 7fc021f11700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01c13e300 0x7fc01c13e6f0 secure :-1 s=READY pgs=1543 cs=0 l=1 rx=0x7fc00c0103a0 tx=0x7fc00c010740).stop 2019-11-28T11:54:17.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.804+0000 7fc021f11700 1 -- 172.21.15.80:0/9653903 shutdown_connections 2019-11-28T11:54:17.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.804+0000 7fc021f11700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbff4018730 0x7fbff401abc0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:17.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.804+0000 7fc021f11700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc01c10d6c0 0x7fc01c1081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:17.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.804+0000 7fc021f11700 1 --2- 172.21.15.80:0/9653903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc01c13e300 0x7fc01c13e6f0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:17.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.804+0000 7fc021f11700 1 -- 172.21.15.80:0/9653903 shutdown_connections 2019-11-28T11:54:17.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.804+0000 7fc021f11700 1 -- 172.21.15.80:0/9653903 wait complete. 2019-11-28T11:54:17.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:17.804+0000 7fc021f11700 1 -- 172.21.15.80:0/9653903 >> 172.21.15.80:0/9653903 conn(0x7fc01c13d620 msgr2=0x7fc01c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:17.871 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:54:17.871 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:54:17.935 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:54:17.996 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:54:18.066 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:54:18.122 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:54:18.184 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:54:18.240 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:54:18.240 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:54:18.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:54:18.241 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T11:54:18.312 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:54:18.316 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:54:18.354 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:54:18.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:54:18.354 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:54:18.476 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:54:18.481 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:54:18.522 INFO:tasks.cephfs_test_runner:test_restart (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2019-11-28T11:54:18.522 INFO:tasks.cephfs_test_runner:Starting test: test_stale_read_caps (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T11:54:18.522 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_read_caps' 2019-11-28T11:54:18.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.585+0000 7f8bc0b2a700 1 Processor -- start 2019-11-28T11:54:18.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.585+0000 7f8bc0b2a700 1 -- start start 2019-11-28T11:54:18.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.586+0000 7f8bc0b2a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bbc06c490 0x7f8bbc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:18.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.586+0000 7f8bc0b2a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8bbc06ce60 0x7f8bbc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:18.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.586+0000 7f8bc0b2a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bbc06db00 con 0x7f8bbc06c0a0 2019-11-28T11:54:18.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.586+0000 7f8bc0b2a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bbc06fd60 con 0x7f8bbc06ce60 2019-11-28T11:54:18.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bc0b2a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc070030 con 0x7f8bbc06c490 2019-11-28T11:54:18.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bbb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8bbc06ce60 0x7f8bbc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:18.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bbb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8bbc06ce60 0x7f8bbc164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45098/0 (socket says 172.21.15.80:45098) 2019-11-28T11:54:18.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bbb59e700 1 -- 172.21.15.80:0/4185971745 learned_addr learned my addr 172.21.15.80:0/4185971745 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:18.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bba59c700 1 --2- 172.21.15.80:0/4185971745 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bbc06c490 0x7f8bbc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:18.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bbb59e700 1 -- 172.21.15.80:0/4185971745 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bbc06c490 msgr2=0x7f8bbc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:18.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/4185971745 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bbc06c490 0x7f8bbc06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:18.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bbb59e700 1 -- 172.21.15.80:0/4185971745 >> v1:172.21.15.174:6789/0 conn(0x7f8bbc06c0a0 legacy=0x7f8bbc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:18.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bbb59e700 1 -- 172.21.15.80:0/4185971745 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc0706c0 con 0x7f8bbc06ce60 2019-11-28T11:54:18.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/4185971745 >> v2:172.21.15.80:3300/0 conn(0x7f8bbc06ce60 0x7f8bbc164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8bb400f6b0 tx=0x7f8bb400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:18.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/4185971745 >> v2:172.21.15.80:3300/0 conn(0x7f8bbc06ce60 0x7f8bbc164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8bb400f6b0 tx=0x7f8bb400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:18.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/4185971745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc06ce60 0x7f8bbc164d70 secure :-1 s=READY pgs=2556 cs=0 l=1 rx=0x7f8bb400f6b0 tx=0x7f8bb400fa50).ready entity=mon.0 client_cookie=e4bb65d9034d387c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:18.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/4185971745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc06ce60 0x7f8bbc164d70 secure :-1 s=THROTTLE_DONE pgs=2556 cs=0 l=1 rx=0x7f8bb400f6b0 tx=0x7f8bb400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:18.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/4185971745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc06ce60 0x7f8bbc164d70 secure :-1 s=THROTTLE_DONE pgs=2556 cs=0 l=1 rx=0x7f8bb400f6b0 tx=0x7f8bb400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:18.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/4185971745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc06ce60 0x7f8bbc164d70 secure :-1 s=THROTTLE_DONE pgs=2556 cs=0 l=1 rx=0x7f8bb400f6b0 tx=0x7f8bb400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:18.649 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bb9d9b700 1 -- 172.21.15.80:0/4185971745 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bb4000a70 con 0x7f8bbc06ce60 2019-11-28T11:54:18.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bb9d9b700 1 -- 172.21.15.80:0/4185971745 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb40010e0 con 0x7f8bbc06ce60 2019-11-28T11:54:18.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bb9d9b700 1 -- 172.21.15.80:0/4185971745 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bb40017b0 con 0x7f8bbc06ce60 2019-11-28T11:54:18.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bc0b2a700 1 -- 172.21.15.80:0/4185971745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc06ce60 msgr2=0x7f8bbc164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:18.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.587+0000 7f8bc0b2a700 1 --2- 172.21.15.80:0/4185971745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc06ce60 0x7f8bbc164d70 secure :-1 s=READY pgs=2556 cs=0 l=1 rx=0x7f8bb400f6b0 tx=0x7f8bb400fa50).stop 2019-11-28T11:54:18.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.588+0000 7f8bc0b2a700 1 -- 172.21.15.80:0/4185971745 shutdown_connections 2019-11-28T11:54:18.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.588+0000 7f8bc0b2a700 1 --2- 172.21.15.80:0/4185971745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc06ce60 0x7f8bbc164d70 unknown :-1 s=CLOSED pgs=2556 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:18.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.588+0000 7f8bc0b2a700 1 --2- 172.21.15.80:0/4185971745 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bbc06c490 0x7f8bbc06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:18.650 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.588+0000 7f8bc0b2a700 1 -- 172.21.15.80:0/4185971745 shutdown_connections 2019-11-28T11:54:18.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.588+0000 7f8bc0b2a700 1 -- 172.21.15.80:0/4185971745 wait complete. 2019-11-28T11:54:18.651 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.588+0000 7f8bc0b2a700 1 -- 172.21.15.80:0/4185971745 >> 172.21.15.80:0/4185971745 conn(0x7f8bbc061cf0 msgr2=0x7f8bbc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:18.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.591+0000 7f8bc0b2a700 1 Processor -- start 2019-11-28T11:54:18.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.591+0000 7f8bc0b2a700 1 -- start start 2019-11-28T11:54:18.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.591+0000 7f8bc0b2a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8bbc13e320 0x7f8bbc13e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:18.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.591+0000 7f8bc0b2a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8bbc12a3c0 0x7f8bbc12a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:18.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.591+0000 7f8bc0b2a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bbc139e00 con 0x7f8bbc15fdf0 2019-11-28T11:54:18.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.591+0000 7f8bc0b2a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bbc108820 con 0x7f8bbc12a3c0 2019-11-28T11:54:18.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.591+0000 7f8bc0b2a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bbc108af0 con 0x7f8bbc13e320 2019-11-28T11:54:18.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.591+0000 7f8bbb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8bbc12a3c0 0x7f8bbc12a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:18.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bbb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8bbc12a3c0 0x7f8bbc12a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45106/0 (socket says 172.21.15.80:45106) 2019-11-28T11:54:18.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bbb59e700 1 -- 172.21.15.80:0/725802937 learned_addr learned my addr 172.21.15.80:0/725802937 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:18.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bba59c700 1 --2- 172.21.15.80:0/725802937 >> v2:172.21.15.174:3300/0 conn(0x7f8bbc13e320 0x7f8bbc13e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:18.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bbb59e700 1 -- 172.21.15.80:0/725802937 >> v2:172.21.15.174:3300/0 conn(0x7f8bbc13e320 msgr2=0x7f8bbc13e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:18.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/725802937 >> v2:172.21.15.174:3300/0 conn(0x7f8bbc13e320 0x7f8bbc13e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:18.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bbb59e700 1 -- 172.21.15.80:0/725802937 >> v1:172.21.15.174:6789/0 conn(0x7f8bbc15fdf0 legacy=0x7f8bbc12b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:18.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bbb59e700 1 -- 172.21.15.80:0/725802937 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc10a8c0 con 0x7f8bbc12a3c0 2019-11-28T11:54:18.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bba59c700 1 --2- 172.21.15.80:0/725802937 >> v2:172.21.15.174:3300/0 conn(0x7f8bbc13e320 0x7f8bbc13e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:18.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/725802937 >> v2:172.21.15.80:3300/0 conn(0x7f8bbc12a3c0 0x7f8bbc12a820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8bb4010450 tx=0x7f8bb40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:18.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/725802937 >> v2:172.21.15.80:3300/0 conn(0x7f8bbc12a3c0 0x7f8bbc12a820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8bb4010450 tx=0x7f8bb40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:18.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/725802937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc12a3c0 0x7f8bbc12a820 secure :-1 s=READY pgs=2557 cs=0 l=1 rx=0x7f8bb4010450 tx=0x7f8bb40107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:18.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/725802937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc12a3c0 0x7f8bbc12a820 secure :-1 s=THROTTLE_DONE pgs=2557 cs=0 l=1 rx=0x7f8bb4010450 tx=0x7f8bb40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:18.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/725802937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc12a3c0 0x7f8bbc12a820 secure :-1 s=THROTTLE_DONE pgs=2557 cs=0 l=1 rx=0x7f8bb4010450 tx=0x7f8bb40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:18.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bb37fe700 1 -- 172.21.15.80:0/725802937 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bb4001590 con 0x7f8bbc12a3c0 2019-11-28T11:54:18.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/725802937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc12a3c0 0x7f8bbc12a820 secure :-1 s=THROTTLE_DONE pgs=2557 cs=0 l=1 rx=0x7f8bb4010450 tx=0x7f8bb40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:18.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bb37fe700 1 -- 172.21.15.80:0/725802937 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb40011b0 con 0x7f8bbc12a3c0 2019-11-28T11:54:18.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bc0b2a700 1 -- 172.21.15.80:0/725802937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bbc10a8c0 con 0x7f8bbc12a3c0 2019-11-28T11:54:18.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bb37fe700 1 -- 172.21.15.80:0/725802937 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bb4001b70 con 0x7f8bbc12a3c0 2019-11-28T11:54:18.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bc0b2a700 1 -- 172.21.15.80:0/725802937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bbc10a8c0 con 0x7f8bbc12a3c0 2019-11-28T11:54:18.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.592+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/725802937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc12a3c0 0x7f8bbc12a820 secure :-1 s=THROTTLE_DONE pgs=2557 cs=0 l=1 rx=0x7f8bb4010450 tx=0x7f8bb40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:18.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.593+0000 7f8bb37fe700 1 -- 172.21.15.80:0/725802937 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8bb40013a0 con 0x7f8bbc12a3c0 2019-11-28T11:54:18.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.593+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/725802937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc12a3c0 0x7f8bbc12a820 secure :-1 s=THROTTLE_DONE pgs=2557 cs=0 l=1 rx=0x7f8bb4010450 tx=0x7f8bb40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:18.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.593+0000 7f8bb37fe700 1 --2- 172.21.15.80:0/725802937 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b94018730 0x7f8b9401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:18.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.593+0000 7f8bb37fe700 1 -- 172.21.15.80:0/725802937 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8bb4031b00 con 0x7f8bbc12a3c0 2019-11-28T11:54:18.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.593+0000 7f8bbad9d700 1 --2- 172.21.15.80:0/725802937 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b94018730 0x7f8b9401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:18.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.593+0000 7f8bbad9d700 1 --2- 172.21.15.80:0/725802937 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b94018730 0x7f8b9401abc0 crc :-1 s=READY pgs=1051 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:18.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.601+0000 7f8bc0b2a700 1 -- 172.21.15.80:0/725802937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bbc109180 con 0x7f8bbc12a3c0 2019-11-28T11:54:18.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.604+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/725802937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc12a3c0 0x7f8bbc12a820 secure :-1 s=THROTTLE_DONE pgs=2557 cs=0 l=1 rx=0x7f8bb4010450 tx=0x7f8bb40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:18.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.604+0000 7f8bb37fe700 1 -- 172.21.15.80:0/725802937 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8bb4000eb0 con 0x7f8bbc12a3c0 2019-11-28T11:54:18.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.775+0000 7f8bc0b2a700 1 -- 172.21.15.80:0/725802937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_read_caps"]} v 0) v1 -- 0x7f8bbc109500 con 0x7f8bbc12a3c0 2019-11-28T11:54:18.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.801+0000 7f8bbb59e700 1 --2- 172.21.15.80:0/725802937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc12a3c0 0x7f8bbc12a820 secure :-1 s=THROTTLE_DONE pgs=2557 cs=0 l=1 rx=0x7f8bb4010450 tx=0x7f8bb40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:18.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.801+0000 7f8bb37fe700 1 -- 172.21.15.80:0/725802937 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_read_caps"]}]=0 v712) v1 ==== 155+0+0 (secure 0 0 0) 0x7f8bb40012a0 con 0x7f8bbc12a3c0 2019-11-28T11:54:18.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.809+0000 7f8bc0b2a700 1 -- 172.21.15.80:0/725802937 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b94018730 msgr2=0x7f8b9401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:18.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.809+0000 7f8bc0b2a700 1 --2- 172.21.15.80:0/725802937 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b94018730 0x7f8b9401abc0 crc :-1 s=READY pgs=1051 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:18.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.809+0000 7f8bc0b2a700 1 -- 172.21.15.80:0/725802937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc12a3c0 msgr2=0x7f8bbc12a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:18.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.809+0000 7f8bc0b2a700 1 --2- 172.21.15.80:0/725802937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc12a3c0 0x7f8bbc12a820 secure :-1 s=READY pgs=2557 cs=0 l=1 rx=0x7f8bb4010450 tx=0x7f8bb40107f0).stop 2019-11-28T11:54:18.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.809+0000 7f8bc0b2a700 1 -- 172.21.15.80:0/725802937 shutdown_connections 2019-11-28T11:54:18.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.809+0000 7f8bc0b2a700 1 --2- 172.21.15.80:0/725802937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc12a3c0 0x7f8bbc12a820 unknown :-1 s=CLOSED pgs=2557 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:18.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.809+0000 7f8bc0b2a700 1 --2- 172.21.15.80:0/725802937 >> v2:172.21.15.174:3300/0 conn(0x7f8bbc13e320 0x7f8bbc13e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:18.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.809+0000 7f8bc0b2a700 1 --2- 172.21.15.80:0/725802937 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8b94018730 0x7f8b9401abc0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:18.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.809+0000 7f8bc0b2a700 1 -- 172.21.15.80:0/725802937 shutdown_connections 2019-11-28T11:54:18.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.809+0000 7f8bc0b2a700 1 -- 172.21.15.80:0/725802937 wait complete. 2019-11-28T11:54:18.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:18.809+0000 7f8bc0b2a700 1 -- 172.21.15.80:0/725802937 >> 172.21.15.80:0/725802937 conn(0x7f8bbc127dc0 msgr2=0x7f8bbc141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:18.875 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:54:18.876 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:54:18.941 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:54:19.004 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:54:19.066 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:54:19.122 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:54:19.183 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:54:19.248 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:54:19.248 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:54:19.249 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:54:19.249 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:54:19.249 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:54:19.249 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:54:19.250 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:54:19.262 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:54:19.262 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:54:19.263 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:54:19.263 DEBUG:teuthology.parallel:result is None 2019-11-28T11:54:19.263 DEBUG:teuthology.parallel:result is None 2019-11-28T11:54:19.263 DEBUG:teuthology.parallel:result is None 2019-11-28T11:54:19.264 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:54:19.264 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:54:19.265 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:54:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.408+0000 7fdf883a1700 1 Processor -- start 2019-11-28T11:54:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.409+0000 7fdf883a1700 1 -- start start 2019-11-28T11:54:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7fdf883a1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdf8006c0a0 0x7fdf80072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:19.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7fdf883a1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf80072620 0x7fdf80164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7fdf883a1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8006db00 con 0x7fdf800734e0 2019-11-28T11:54:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7fdf883a1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8006fd60 con 0x7fdf8006c0a0 2019-11-28T11:54:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7fdf883a1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf80070030 con 0x7fdf80072620 2019-11-28T11:54:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7fdf8713f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf80072620 0x7fdf80164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7fdf8613d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdf800734e0 0x7fdf80071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44442/0 (socket says 172.21.15.80:44442) 2019-11-28T11:54:19.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7fdf8613d700 1 -- 172.21.15.80:0/309790362 learned_addr learned my addr 172.21.15.80:0/309790362 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:19.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7fdf8693e700 1 --2- 172.21.15.80:0/309790362 >> v2:172.21.15.174:3300/0 conn(0x7fdf8006c0a0 0x7fdf80072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:19.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7fdf8713f700 1 -- 172.21.15.80:0/309790362 >> v2:172.21.15.174:3300/0 conn(0x7fdf8006c0a0 msgr2=0x7fdf80072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:19.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7fdf8713f700 1 --2- 172.21.15.80:0/309790362 >> v2:172.21.15.174:3300/0 conn(0x7fdf8006c0a0 0x7fdf80072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:19.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7fdf8713f700 1 -- 172.21.15.80:0/309790362 >> v1:172.21.15.80:6789/0 conn(0x7fdf800734e0 legacy=0x7fdf80071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7fdf8713f700 1 -- 172.21.15.80:0/309790362 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf800706c0 con 0x7fdf80072620 2019-11-28T11:54:19.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7fdf8713f700 1 --2- 172.21.15.80:0/309790362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf80072620 0x7fdf80164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdf7800b300 tx=0x7fdf7800b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.481 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7fdf8713f700 1 --2- 172.21.15.80:0/309790362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf80072620 0x7fdf80164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdf7800b300 tx=0x7fdf7800b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7fdf8713f700 1 --2- 172.21.15.80:0/309790362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf80072620 0x7fdf80164d70 secure :-1 s=READY pgs=365 cs=0 l=1 rx=0x7fdf7800b300 tx=0x7fdf7800b600).ready entity=mon.2 client_cookie=c589be2c1624d7d5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:19.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7fdf8713f700 1 --2- 172.21.15.80:0/309790362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf80072620 0x7fdf80164d70 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7fdf7800b300 tx=0x7fdf7800b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7fdf8713f700 1 --2- 172.21.15.80:0/309790362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf80072620 0x7fdf80164d70 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7fdf7800b300 tx=0x7fdf7800b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7fdf8593c700 1 -- 172.21.15.80:0/309790362 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf780075c0 con 0x7fdf80072620 2019-11-28T11:54:19.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7fdf8713f700 1 --2- 172.21.15.80:0/309790362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf80072620 0x7fdf80164d70 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7fdf7800b300 tx=0x7fdf7800b600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7fdf8593c700 1 -- 172.21.15.80:0/309790362 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf78000e90 con 0x7fdf80072620 2019-11-28T11:54:19.482 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7fdf8593c700 1 -- 172.21.15.80:0/309790362 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf7800a220 con 0x7fdf80072620 2019-11-28T11:54:19.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7fdf883a1700 1 -- 172.21.15.80:0/309790362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf80072620 msgr2=0x7fdf80164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7fdf883a1700 1 --2- 172.21.15.80:0/309790362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf80072620 0x7fdf80164d70 secure :-1 s=READY pgs=365 cs=0 l=1 rx=0x7fdf7800b300 tx=0x7fdf7800b600).stop 2019-11-28T11:54:19.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7fdf883a1700 1 -- 172.21.15.80:0/309790362 shutdown_connections 2019-11-28T11:54:19.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7fdf883a1700 1 --2- 172.21.15.80:0/309790362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf80072620 0x7fdf80164d70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7fdf883a1700 1 --2- 172.21.15.80:0/309790362 >> v2:172.21.15.174:3300/0 conn(0x7fdf8006c0a0 0x7fdf80072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:19.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7fdf883a1700 1 -- 172.21.15.80:0/309790362 shutdown_connections 2019-11-28T11:54:19.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7fdf883a1700 1 -- 172.21.15.80:0/309790362 wait complete. 2019-11-28T11:54:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7fdf883a1700 1 -- 172.21.15.80:0/309790362 >> 172.21.15.80:0/309790362 conn(0x7fdf80061cf0 msgr2=0x7fdf80064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.414+0000 7fdf883a1700 1 Processor -- start 2019-11-28T11:54:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.415+0000 7fdf883a1700 1 -- start start 2019-11-28T11:54:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.415+0000 7fdf883a1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdf80104820 0x7fdf8010c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.415+0000 7fdf883a1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdf8010b9d0 0x7fdf80167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.415+0000 7fdf883a1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8013bcd0 con 0x7fdf8010c890 2019-11-28T11:54:19.484 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.415+0000 7fdf883a1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf80109130 con 0x7fdf8010b9d0 2019-11-28T11:54:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.415+0000 7fdf883a1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf80109400 con 0x7fdf80104820 2019-11-28T11:54:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf8713f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdf8010b9d0 0x7fdf80167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf8713f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdf8010b9d0 0x7fdf80167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45134/0 (socket says 172.21.15.80:45134) 2019-11-28T11:54:19.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf8713f700 1 -- 172.21.15.80:0/3202924797 learned_addr learned my addr 172.21.15.80:0/3202924797 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf8693e700 1 --2- 172.21.15.80:0/3202924797 >> v2:172.21.15.174:3300/0 conn(0x7fdf80104820 0x7fdf8010c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf8713f700 1 -- 172.21.15.80:0/3202924797 >> v2:172.21.15.174:3300/0 conn(0x7fdf80104820 msgr2=0x7fdf8010c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf8713f700 1 --2- 172.21.15.80:0/3202924797 >> v2:172.21.15.174:3300/0 conn(0x7fdf80104820 0x7fdf8010c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf8713f700 1 -- 172.21.15.80:0/3202924797 >> v1:172.21.15.174:6789/0 conn(0x7fdf8010c890 legacy=0x7fdf8010b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf8713f700 1 -- 172.21.15.80:0/3202924797 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf80109a90 con 0x7fdf8010b9d0 2019-11-28T11:54:19.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf8713f700 1 --2- 172.21.15.80:0/3202924797 >> v2:172.21.15.80:3300/0 conn(0x7fdf8010b9d0 0x7fdf80167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf78010740 tx=0x7fdf78010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf8713f700 1 --2- 172.21.15.80:0/3202924797 >> v2:172.21.15.80:3300/0 conn(0x7fdf8010b9d0 0x7fdf80167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf78010740 tx=0x7fdf78010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf8713f700 1 --2- 172.21.15.80:0/3202924797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf8010b9d0 0x7fdf80167a10 secure :-1 s=READY pgs=2563 cs=0 l=1 rx=0x7fdf78010740 tx=0x7fdf78010ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:19.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf8713f700 1 --2- 172.21.15.80:0/3202924797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf8010b9d0 0x7fdf80167a10 secure :-1 s=THROTTLE_DONE pgs=2563 cs=0 l=1 rx=0x7fdf78010740 tx=0x7fdf78010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf8713f700 1 --2- 172.21.15.80:0/3202924797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf8010b9d0 0x7fdf80167a10 secure :-1 s=THROTTLE_DONE pgs=2563 cs=0 l=1 rx=0x7fdf78010740 tx=0x7fdf78010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf777fe700 1 -- 172.21.15.80:0/3202924797 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf7800b360 con 0x7fdf8010b9d0 2019-11-28T11:54:19.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf8713f700 1 --2- 172.21.15.80:0/3202924797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf8010b9d0 0x7fdf80167a10 secure :-1 s=THROTTLE_DONE pgs=2563 cs=0 l=1 rx=0x7fdf78010740 tx=0x7fdf78010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf777fe700 1 -- 172.21.15.80:0/3202924797 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf78009d30 con 0x7fdf8010b9d0 2019-11-28T11:54:19.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf883a1700 1 -- 172.21.15.80:0/3202924797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf80109e10 con 0x7fdf8010b9d0 2019-11-28T11:54:19.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf777fe700 1 -- 172.21.15.80:0/3202924797 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf7800a3c0 con 0x7fdf8010b9d0 2019-11-28T11:54:19.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.416+0000 7fdf883a1700 1 -- 172.21.15.80:0/3202924797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf80109a90 con 0x7fdf8010b9d0 2019-11-28T11:54:19.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7fdf8713f700 1 --2- 172.21.15.80:0/3202924797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf8010b9d0 0x7fdf80167a10 secure :-1 s=THROTTLE_DONE pgs=2563 cs=0 l=1 rx=0x7fdf78010740 tx=0x7fdf78010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7fdf777fe700 1 -- 172.21.15.80:0/3202924797 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fdf78009f20 con 0x7fdf8010b9d0 2019-11-28T11:54:19.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7fdf8713f700 1 --2- 172.21.15.80:0/3202924797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf8010b9d0 0x7fdf80167a10 secure :-1 s=THROTTLE_DONE pgs=2563 cs=0 l=1 rx=0x7fdf78010740 tx=0x7fdf78010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7fdf777fe700 1 --2- 172.21.15.80:0/3202924797 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdf68018730 0x7fdf6801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7fdf777fe700 1 -- 172.21.15.80:0/3202924797 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fdf78031dc0 con 0x7fdf8010b9d0 2019-11-28T11:54:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7fdf8693e700 1 --2- 172.21.15.80:0/3202924797 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdf68018730 0x7fdf6801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7fdf8693e700 1 --2- 172.21.15.80:0/3202924797 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdf68018730 0x7fdf6801abc0 crc :-1 s=READY pgs=1052 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.409+0000 7f1b09544700 1 Processor -- start 2019-11-28T11:54:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.409+0000 7f1b09544700 1 -- start start 2019-11-28T11:54:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f1b09544700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1b0406c490 0x7f1b0406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f1b09544700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1b0406ce60 0x7f1b04164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f1b09544700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0406db00 con 0x7f1b0406c0a0 2019-11-28T11:54:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f1b09544700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0406fd60 con 0x7f1b0406c490 2019-11-28T11:54:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f1b09544700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b04070030 con 0x7f1b0406ce60 2019-11-28T11:54:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f1b037fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1b0406c0a0 0x7f1b04072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44434/0 (socket says 172.21.15.80:44434) 2019-11-28T11:54:19.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f1b037fe700 1 -- 172.21.15.80:0/1715649827 learned_addr learned my addr 172.21.15.80:0/1715649827 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:19.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f1afaffd700 1 --2- 172.21.15.80:0/1715649827 >> v2:172.21.15.80:3300/0 conn(0x7f1b0406c490 0x7f1b0406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:19.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f1b03fff700 1 --2- 172.21.15.80:0/1715649827 >> v2:172.21.15.174:3300/0 conn(0x7f1b0406ce60 0x7f1b04164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:19.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f1b02ffd700 1 -- 172.21.15.80:0/1715649827 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593590180 0 0) 0x7f1af4001150 con 0x7f1b0406c0a0 2019-11-28T11:54:19.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f1afaffd700 1 -- 172.21.15.80:0/1715649827 >> v2:172.21.15.174:3300/0 conn(0x7f1b0406ce60 msgr2=0x7f1b04164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:19.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f1afaffd700 1 --2- 172.21.15.80:0/1715649827 >> v2:172.21.15.174:3300/0 conn(0x7f1b0406ce60 0x7f1b04164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:19.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f1afaffd700 1 -- 172.21.15.80:0/1715649827 >> v1:172.21.15.80:6789/0 conn(0x7f1b0406c0a0 legacy=0x7f1b04072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f1afaffd700 1 -- 172.21.15.80:0/1715649827 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b040706c0 con 0x7f1b0406c490 2019-11-28T11:54:19.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f1afaffd700 1 --2- 172.21.15.80:0/1715649827 >> v2:172.21.15.80:3300/0 conn(0x7f1b0406c490 0x7f1b0406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1aec00af50 tx=0x7f1aec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f1b03fff700 1 --2- 172.21.15.80:0/1715649827 >> v2:172.21.15.174:3300/0 conn(0x7f1b0406ce60 0x7f1b04164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:19.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7f1afaffd700 1 --2- 172.21.15.80:0/1715649827 >> v2:172.21.15.80:3300/0 conn(0x7f1b0406c490 0x7f1b0406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1aec00af50 tx=0x7f1aec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7f1afaffd700 1 --2- 172.21.15.80:0/1715649827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0406c490 0x7f1b0406c920 secure :-1 s=READY pgs=2562 cs=0 l=1 rx=0x7f1aec00af50 tx=0x7f1aec00b760).ready entity=mon.0 client_cookie=c60edad2da4853fe server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:19.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7f1afaffd700 1 --2- 172.21.15.80:0/1715649827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0406c490 0x7f1b0406c920 secure :-1 s=THROTTLE_DONE pgs=2562 cs=0 l=1 rx=0x7f1aec00af50 tx=0x7f1aec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7f1b02ffd700 1 -- 172.21.15.80:0/1715649827 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aec007210 con 0x7f1b0406c490 2019-11-28T11:54:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7f1afaffd700 1 --2- 172.21.15.80:0/1715649827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0406c490 0x7f1b0406c920 secure :-1 s=THROTTLE_DONE pgs=2562 cs=0 l=1 rx=0x7f1aec00af50 tx=0x7f1aec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7f1b02ffd700 1 -- 172.21.15.80:0/1715649827 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec0097c0 con 0x7f1b0406c490 2019-11-28T11:54:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7f1afaffd700 1 --2- 172.21.15.80:0/1715649827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0406c490 0x7f1b0406c920 secure :-1 s=THROTTLE_DONE pgs=2562 cs=0 l=1 rx=0x7f1aec00af50 tx=0x7f1aec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7f1b02ffd700 1 -- 172.21.15.80:0/1715649827 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aec0099b0 con 0x7f1b0406c490 2019-11-28T11:54:19.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7f1b09544700 1 -- 172.21.15.80:0/1715649827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0406c490 msgr2=0x7f1b0406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7f1b09544700 1 --2- 172.21.15.80:0/1715649827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0406c490 0x7f1b0406c920 secure :-1 s=READY pgs=2562 cs=0 l=1 rx=0x7f1aec00af50 tx=0x7f1aec00b760).stop 2019-11-28T11:54:19.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7f1b09544700 1 -- 172.21.15.80:0/1715649827 shutdown_connections 2019-11-28T11:54:19.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7f1b09544700 1 --2- 172.21.15.80:0/1715649827 >> v2:172.21.15.174:3300/0 conn(0x7f1b0406ce60 0x7f1b04164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:19.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7f1b09544700 1 --2- 172.21.15.80:0/1715649827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0406c490 0x7f1b0406c920 unknown :-1 s=CLOSED pgs=2562 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7f1b09544700 1 -- 172.21.15.80:0/1715649827 shutdown_connections 2019-11-28T11:54:19.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7f1b09544700 1 -- 172.21.15.80:0/1715649827 wait complete. 2019-11-28T11:54:19.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7f1b09544700 1 -- 172.21.15.80:0/1715649827 >> 172.21.15.80:0/1715649827 conn(0x7f1b04061cf0 msgr2=0x7f1b04064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:19.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.415+0000 7f1b09544700 1 Processor -- start 2019-11-28T11:54:19.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.415+0000 7f1b09544700 1 -- start start 2019-11-28T11:54:19.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f1b09544700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1b0413a780 0x7f1b0412d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:19.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f1b09544700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b0412cb00 0x7f1b04167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:19.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f1b09544700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b04139a60 con 0x7f1b0412d9c0 2019-11-28T11:54:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f1b09544700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0412a260 con 0x7f1b0413a780 2019-11-28T11:54:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f1b09544700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0412a530 con 0x7f1b0412cb00 2019-11-28T11:54:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f1b037fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1b0413a780 0x7f1b0412d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f1b037fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1b0413a780 0x7f1b0412d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45140/0 (socket says 172.21.15.80:45140) 2019-11-28T11:54:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f1b037fe700 1 -- 172.21.15.80:0/3850389597 learned_addr learned my addr 172.21.15.80:0/3850389597 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:19.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f1b03fff700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b0412cb00 0x7f1b04167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:19.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f1b037fe700 1 -- 172.21.15.80:0/3850389597 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b0412cb00 msgr2=0x7f1b04167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f1b037fe700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b0412cb00 0x7f1b04167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f1b037fe700 1 -- 172.21.15.80:0/3850389597 >> v1:172.21.15.174:6789/0 conn(0x7f1b0412d9c0 legacy=0x7f1b0412c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f1b037fe700 1 -- 172.21.15.80:0/3850389597 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0412abc0 con 0x7f1b0413a780 2019-11-28T11:54:19.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f1b037fe700 1 --2- 172.21.15.80:0/3850389597 >> v2:172.21.15.80:3300/0 conn(0x7f1b0413a780 0x7f1b0412d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1af4010430 tx=0x7f1af40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f1b037fe700 1 --2- 172.21.15.80:0/3850389597 >> v2:172.21.15.80:3300/0 conn(0x7f1b0413a780 0x7f1b0412d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1af4010430 tx=0x7f1af40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f1b037fe700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0413a780 0x7f1b0412d480 secure :-1 s=READY pgs=2565 cs=0 l=1 rx=0x7f1af4010430 tx=0x7f1af40107d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:19.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f1b037fe700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0413a780 0x7f1b0412d480 secure :-1 s=THROTTLE_DONE pgs=2565 cs=0 l=1 rx=0x7f1af4010430 tx=0x7f1af40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f1b037fe700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0413a780 0x7f1b0412d480 secure :-1 s=THROTTLE_DONE pgs=2565 cs=0 l=1 rx=0x7f1af4010430 tx=0x7f1af40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f1b037fe700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0413a780 0x7f1b0412d480 secure :-1 s=THROTTLE_DONE pgs=2565 cs=0 l=1 rx=0x7f1af4010430 tx=0x7f1af40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f1b00ff9700 1 -- 172.21.15.80:0/3850389597 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1af4004430 con 0x7f1b0413a780 2019-11-28T11:54:19.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f1b00ff9700 1 -- 172.21.15.80:0/3850389597 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af4000ef0 con 0x7f1b0413a780 2019-11-28T11:54:19.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f1b00ff9700 1 -- 172.21.15.80:0/3850389597 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1af4004730 con 0x7f1b0413a780 2019-11-28T11:54:19.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f1b09544700 1 -- 172.21.15.80:0/3850389597 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0412af40 con 0x7f1b0413a780 2019-11-28T11:54:19.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f1b09544700 1 -- 172.21.15.80:0/3850389597 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0412abc0 con 0x7f1b0413a780 2019-11-28T11:54:19.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.419+0000 7f1b037fe700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0413a780 0x7f1b0412d480 secure :-1 s=THROTTLE_DONE pgs=2565 cs=0 l=1 rx=0x7f1af4010430 tx=0x7f1af40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.419+0000 7f1b00ff9700 1 -- 172.21.15.80:0/3850389597 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1af4004240 con 0x7f1b0413a780 2019-11-28T11:54:19.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.419+0000 7f1b037fe700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0413a780 0x7f1b0412d480 secure :-1 s=THROTTLE_DONE pgs=2565 cs=0 l=1 rx=0x7f1af4010430 tx=0x7f1af40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.419+0000 7f1b00ff9700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ae8018730 0x7f1ae801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:19.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.419+0000 7f1b00ff9700 1 -- 172.21.15.80:0/3850389597 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f1af4031ac0 con 0x7f1b0413a780 2019-11-28T11:54:19.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.419+0000 7f1afaffd700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ae8018730 0x7f1ae801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:19.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.420+0000 7f1afaffd700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ae8018730 0x7f1ae801abc0 crc :-1 s=READY pgs=1054 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:19.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.408+0000 7f2aac6e8700 1 Processor -- start 2019-11-28T11:54:19.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.408+0000 7f2aac6e8700 1 -- start start 2019-11-28T11:54:19.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f2aac6e8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2aa406c490 0x7f2aa406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:19.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f2aac6e8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa406db00 con 0x7f2aa406ce60 2019-11-28T11:54:19.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f2aac6e8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa406e000 con 0x7f2aa406c0a0 2019-11-28T11:54:19.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f2aac6e8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa406fd60 con 0x7f2aa406c490 2019-11-28T11:54:19.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f2aaa484700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2aa406c490 0x7f2aa406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:19.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f2aab486700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2aa406ce60 0x7f2aa4164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44432/0 (socket says 172.21.15.80:44432) 2019-11-28T11:54:19.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f2aab486700 1 -- 172.21.15.80:0/4059158838 learned_addr learned my addr 172.21.15.80:0/4059158838 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:19.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f2aaa484700 1 -- 172.21.15.80:0/4059158838 >> v1:172.21.15.174:6789/0 conn(0x7f2aa406c0a0 legacy=0x7f2aa4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f2aaa484700 1 -- 172.21.15.80:0/4059158838 >> v1:172.21.15.80:6789/0 conn(0x7f2aa406ce60 legacy=0x7f2aa4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f2aaa484700 1 -- 172.21.15.80:0/4059158838 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa40706c0 con 0x7f2aa406c490 2019-11-28T11:54:19.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f2aaa484700 1 --2- 172.21.15.80:0/4059158838 >> v2:172.21.15.80:3300/0 conn(0x7f2aa406c490 0x7f2aa406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2aa000b2d0 tx=0x7f2aa000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f2aaa484700 1 --2- 172.21.15.80:0/4059158838 >> v2:172.21.15.80:3300/0 conn(0x7f2aa406c490 0x7f2aa406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2aa000b2d0 tx=0x7f2aa000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f2aaa484700 1 --2- 172.21.15.80:0/4059158838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2aa406c490 0x7f2aa406c920 secure :-1 s=READY pgs=2561 cs=0 l=1 rx=0x7f2aa000b2d0 tx=0x7f2aa000bae0).ready entity=mon.0 client_cookie=396cd34dc996bcc0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:19.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f2aaa484700 1 --2- 172.21.15.80:0/4059158838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2aa406c490 0x7f2aa406c920 secure :-1 s=THROTTLE_DONE pgs=2561 cs=0 l=1 rx=0x7f2aa000b2d0 tx=0x7f2aa000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7f2aaa484700 1 --2- 172.21.15.80:0/4059158838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2aa406c490 0x7f2aa406c920 secure :-1 s=THROTTLE_DONE pgs=2561 cs=0 l=1 rx=0x7f2aa000b2d0 tx=0x7f2aa000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.410+0000 7f2aa9c83700 1 -- 172.21.15.80:0/4059158838 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aa0000ce0 con 0x7f2aa406c490 2019-11-28T11:54:19.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7f2aaa484700 1 --2- 172.21.15.80:0/4059158838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2aa406c490 0x7f2aa406c920 secure :-1 s=THROTTLE_DONE pgs=2561 cs=0 l=1 rx=0x7f2aa000b2d0 tx=0x7f2aa000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7f2aa9c83700 1 -- 172.21.15.80:0/4059158838 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa0009be0 con 0x7f2aa406c490 2019-11-28T11:54:19.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7f2aa9c83700 1 -- 172.21.15.80:0/4059158838 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aa000a2b0 con 0x7f2aa406c490 2019-11-28T11:54:19.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7f2aac6e8700 1 -- 172.21.15.80:0/4059158838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2aa406c490 msgr2=0x7f2aa406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.411+0000 7f2aac6e8700 1 --2- 172.21.15.80:0/4059158838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2aa406c490 0x7f2aa406c920 secure :-1 s=READY pgs=2561 cs=0 l=1 rx=0x7f2aa000b2d0 tx=0x7f2aa000bae0).stop 2019-11-28T11:54:19.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7f2aac6e8700 1 -- 172.21.15.80:0/4059158838 shutdown_connections 2019-11-28T11:54:19.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7f2aac6e8700 1 --2- 172.21.15.80:0/4059158838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2aa406c490 0x7f2aa406c920 unknown :-1 s=CLOSED pgs=2561 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7f2aac6e8700 1 -- 172.21.15.80:0/4059158838 shutdown_connections 2019-11-28T11:54:19.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7f2aac6e8700 1 -- 172.21.15.80:0/4059158838 wait complete. 2019-11-28T11:54:19.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.412+0000 7f2aac6e8700 1 -- 172.21.15.80:0/4059158838 >> 172.21.15.80:0/4059158838 conn(0x7f2aa4061cf0 msgr2=0x7f2aa4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:19.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.415+0000 7f2aac6e8700 1 Processor -- start 2019-11-28T11:54:19.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.415+0000 7f2aac6e8700 1 -- start start 2019-11-28T11:54:19.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2aac6e8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2aa4135760 0x7f2aa4137480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:19.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2aac6e8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2aa412a150 0x7f2aa412a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:19.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2aac6e8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa4136480 con 0x7f2aa412ab20 2019-11-28T11:54:19.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2aac6e8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa41346a0 con 0x7f2aa412a150 2019-11-28T11:54:19.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2aac6e8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa4104a00 con 0x7f2aa4135760 2019-11-28T11:54:19.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2aaac85700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2aa4135760 0x7f2aa4137480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:19.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2aaac85700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2aa4135760 0x7f2aa4137480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:47396/0 (socket says 172.21.15.80:47396) 2019-11-28T11:54:19.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2aaac85700 1 -- 172.21.15.80:0/3351240197 learned_addr learned my addr 172.21.15.80:0/3351240197 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:19.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2a977fe700 1 -- 172.21.15.80:0/3351240197 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049934 0 0) 0x7f2a98000ab0 con 0x7f2aa412ab20 2019-11-28T11:54:19.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2a977fe700 1 -- 172.21.15.80:0/3351240197 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a8c002e80 con 0x7f2aa412ab20 2019-11-28T11:54:19.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2aaac85700 1 -- 172.21.15.80:0/3351240197 >> v2:172.21.15.80:3300/0 conn(0x7f2aa412a150 msgr2=0x7f2aa412a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2aaac85700 1 --2- 172.21.15.80:0/3351240197 >> v2:172.21.15.80:3300/0 conn(0x7f2aa412a150 0x7f2aa412a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2aaac85700 1 -- 172.21.15.80:0/3351240197 >> v1:172.21.15.80:6789/0 conn(0x7f2aa412ab20 legacy=0x7f2aa4106140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2aaac85700 1 -- 172.21.15.80:0/3351240197 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa4104d80 con 0x7f2aa4135760 2019-11-28T11:54:19.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2aaac85700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2aa4135760 0x7f2aa4137480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2a9c010270 tx=0x7f2a9c0128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2aaac85700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2aa4135760 0x7f2aa4137480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2a9c010270 tx=0x7f2a9c0128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.417+0000 7f2aaac85700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2aa4135760 0x7f2aa4137480 secure :-1 s=READY pgs=366 cs=0 l=1 rx=0x7f2a9c010270 tx=0x7f2a9c0128e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:19.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f2aaac85700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2aa4135760 0x7f2aa4137480 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f2a9c010270 tx=0x7f2a9c0128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f2aaac85700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2aa4135760 0x7f2aa4137480 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f2a9c010270 tx=0x7f2a9c0128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f2aaac85700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2aa4135760 0x7f2aa4137480 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f2a9c010270 tx=0x7f2a9c0128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f2a977fe700 1 -- 172.21.15.80:0/3351240197 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9c000960 con 0x7f2aa4135760 2019-11-28T11:54:19.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f2a977fe700 1 -- 172.21.15.80:0/3351240197 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c000e90 con 0x7f2aa4135760 2019-11-28T11:54:19.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f2a977fe700 1 -- 172.21.15.80:0/3351240197 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9c0014e0 con 0x7f2aa4135760 2019-11-28T11:54:19.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f2aac6e8700 1 -- 172.21.15.80:0/3351240197 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa4104d80 con 0x7f2aa4135760 2019-11-28T11:54:19.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f2aac6e8700 1 -- 172.21.15.80:0/3351240197 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa4104d80 con 0x7f2aa4135760 2019-11-28T11:54:19.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.418+0000 7f2aaac85700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2aa4135760 0x7f2aa4137480 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f2a9c010270 tx=0x7f2a9c0128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.419+0000 7f2a977fe700 1 -- 172.21.15.80:0/3351240197 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2a9c001080 con 0x7f2aa4135760 2019-11-28T11:54:19.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.419+0000 7f2aaac85700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2aa4135760 0x7f2aa4137480 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f2a9c010270 tx=0x7f2a9c0128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.419+0000 7f2a977fe700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a8c018770 0x7f2a8c01ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:19.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.419+0000 7f2a977fe700 1 -- 172.21.15.80:0/3351240197 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f2a9c033f40 con 0x7f2aa4135760 2019-11-28T11:54:19.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.419+0000 7f2aaa484700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a8c018770 0x7f2a8c01ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:19.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.419+0000 7f2aaa484700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a8c018770 0x7f2a8c01ac00 crc :-1 s=READY pgs=1053 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:19.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.424+0000 7f2aac6e8700 1 -- 172.21.15.80:0/3351240197 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa4104d80 con 0x7f2aa4135760 2019-11-28T11:54:19.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.427+0000 7f2aaac85700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2aa4135760 0x7f2aa4137480 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f2a9c010270 tx=0x7f2a9c0128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.427+0000 7f2a977fe700 1 -- 172.21.15.80:0/3351240197 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2a9c007210 con 0x7f2aa4135760 2019-11-28T11:54:19.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.424+0000 7fdf883a1700 1 -- 172.21.15.80:0/3202924797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf80109e10 con 0x7fdf8010b9d0 2019-11-28T11:54:19.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.427+0000 7fdf8713f700 1 --2- 172.21.15.80:0/3202924797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf8010b9d0 0x7fdf80167a10 secure :-1 s=THROTTLE_DONE pgs=2563 cs=0 l=1 rx=0x7fdf78010740 tx=0x7fdf78010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.427+0000 7fdf777fe700 1 -- 172.21.15.80:0/3202924797 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fdf78009930 con 0x7fdf8010b9d0 2019-11-28T11:54:19.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.424+0000 7f1b09544700 1 -- 172.21.15.80:0/3850389597 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0412af40 con 0x7f1b0413a780 2019-11-28T11:54:19.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.430+0000 7f1b037fe700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0413a780 0x7f1b0412d480 secure :-1 s=THROTTLE_DONE pgs=2565 cs=0 l=1 rx=0x7f1af4010430 tx=0x7f1af40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.430+0000 7f1b00ff9700 1 -- 172.21.15.80:0/3850389597 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1af40012b0 con 0x7f1b0413a780 2019-11-28T11:54:19.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.614+0000 7f2aac6e8700 1 -- 172.21.15.80:0/3351240197 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f2aa4104a00 con 0x7f2aa4135760 2019-11-28T11:54:19.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.615+0000 7fdf883a1700 1 -- 172.21.15.80:0/3202924797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fdf80109a90 con 0x7fdf8010b9d0 2019-11-28T11:54:19.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.618+0000 7f1b09544700 1 -- 172.21.15.80:0/3850389597 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f1b0412abc0 con 0x7f1b0413a780 2019-11-28T11:54:19.861 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:54:19.805+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:54:19.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.807+0000 7fdf8713f700 1 --2- 172.21.15.80:0/3202924797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf8010b9d0 0x7fdf80167a10 secure :-1 s=THROTTLE_DONE pgs=2563 cs=0 l=1 rx=0x7fdf78010740 tx=0x7fdf78010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.807+0000 7fdf777fe700 1 -- 172.21.15.80:0/3202924797 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 10771 v161) v1 ==== 96+0+0 (secure 0 0 0) 0x7fdf78009f20 con 0x7fdf8010b9d0 2019-11-28T11:54:19.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.807+0000 7f1b037fe700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0413a780 0x7f1b0412d480 secure :-1 s=THROTTLE_DONE pgs=2565 cs=0 l=1 rx=0x7f1af4010430 tx=0x7f1af40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.807+0000 7f1b00ff9700 1 -- 172.21.15.80:0/3850389597 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7619 v161) v1 ==== 95+0+0 (secure 0 0 0) 0x7f1af401f680 con 0x7f1b0413a780 2019-11-28T11:54:19.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.807+0000 7f2aaac85700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2aa4135760 0x7f2aa4137480 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7f2a9c010270 tx=0x7f2a9c0128e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:19.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.807+0000 7f2a977fe700 1 -- 172.21.15.80:0/3351240197 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 10765 v161) v1 ==== 96+0+0 (secure 0 0 0) 0x7f2a9c000e70 con 0x7f2aa4135760 2019-11-28T11:54:19.884 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 10765 2019-11-28T11:54:19.886 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 10771 2019-11-28T11:54:19.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.830+0000 7f2aac6e8700 1 -- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a8c018770 msgr2=0x7f2a8c01ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.830+0000 7f2aac6e8700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a8c018770 0x7f2a8c01ac00 crc :-1 s=READY pgs=1053 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.830+0000 7f2aac6e8700 1 -- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2aa4135760 msgr2=0x7f2aa4137480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.830+0000 7f2aac6e8700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2aa4135760 0x7f2aa4137480 secure :-1 s=READY pgs=366 cs=0 l=1 rx=0x7f2a9c010270 tx=0x7f2a9c0128e0).stop 2019-11-28T11:54:19.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7f2aac6e8700 1 -- 172.21.15.80:0/3351240197 shutdown_connections 2019-11-28T11:54:19.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7f2aac6e8700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2a8c018770 0x7f2a8c01ac00 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7f2aac6e8700 1 --2- 172.21.15.80:0/3351240197 >> v2:172.21.15.80:3300/0 conn(0x7f2aa412a150 0x7f2aa412a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7f2aac6e8700 1 --2- 172.21.15.80:0/3351240197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2aa4135760 0x7f2aa4137480 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7f2aac6e8700 1 -- 172.21.15.80:0/3351240197 shutdown_connections 2019-11-28T11:54:19.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7f2aac6e8700 1 -- 172.21.15.80:0/3351240197 wait complete. 2019-11-28T11:54:19.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7f2aac6e8700 1 -- 172.21.15.80:0/3351240197 >> 172.21.15.80:0/3351240197 conn(0x7f2aa413d930 msgr2=0x7f2aa4102360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:19.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7fdf883a1700 1 -- 172.21.15.80:0/3202924797 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdf68018730 msgr2=0x7fdf6801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7fdf883a1700 1 --2- 172.21.15.80:0/3202924797 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdf68018730 0x7fdf6801abc0 crc :-1 s=READY pgs=1052 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7fdf883a1700 1 -- 172.21.15.80:0/3202924797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf8010b9d0 msgr2=0x7fdf80167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7fdf883a1700 1 --2- 172.21.15.80:0/3202924797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf8010b9d0 0x7fdf80167a10 secure :-1 s=READY pgs=2563 cs=0 l=1 rx=0x7fdf78010740 tx=0x7fdf78010ae0).stop 2019-11-28T11:54:19.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7fdf883a1700 1 -- 172.21.15.80:0/3202924797 shutdown_connections 2019-11-28T11:54:19.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7fdf883a1700 1 --2- 172.21.15.80:0/3202924797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf8010b9d0 0x7fdf80167a10 unknown :-1 s=CLOSED pgs=2563 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7fdf883a1700 1 --2- 172.21.15.80:0/3202924797 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fdf68018730 0x7fdf6801abc0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7fdf883a1700 1 --2- 172.21.15.80:0/3202924797 >> v2:172.21.15.174:3300/0 conn(0x7fdf80104820 0x7fdf8010c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7fdf883a1700 1 -- 172.21.15.80:0/3202924797 shutdown_connections 2019-11-28T11:54:19.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7fdf883a1700 1 -- 172.21.15.80:0/3202924797 wait complete. 2019-11-28T11:54:19.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.831+0000 7fdf883a1700 1 -- 172.21.15.80:0/3202924797 >> 172.21.15.80:0/3202924797 conn(0x7fdf8013d620 msgr2=0x7fdf8013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:19.892 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 7619 2019-11-28T11:54:19.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.833+0000 7f1b09544700 1 -- 172.21.15.80:0/3850389597 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ae8018730 msgr2=0x7f1ae801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.833+0000 7f1b09544700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ae8018730 0x7f1ae801abc0 crc :-1 s=READY pgs=1054 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.833+0000 7f1b09544700 1 -- 172.21.15.80:0/3850389597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0413a780 msgr2=0x7f1b0412d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:19.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.833+0000 7f1b09544700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0413a780 0x7f1b0412d480 secure :-1 s=READY pgs=2565 cs=0 l=1 rx=0x7f1af4010430 tx=0x7f1af40107d0).stop 2019-11-28T11:54:19.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.834+0000 7f1b09544700 1 -- 172.21.15.80:0/3850389597 shutdown_connections 2019-11-28T11:54:19.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.834+0000 7f1b09544700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b0412cb00 0x7f1b04167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.834+0000 7f1b09544700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1ae8018730 0x7f1ae801abc0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.834+0000 7f1b09544700 1 --2- 172.21.15.80:0/3850389597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b0413a780 0x7f1b0412d480 unknown :-1 s=CLOSED pgs=2565 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:19.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.834+0000 7f1b09544700 1 -- 172.21.15.80:0/3850389597 shutdown_connections 2019-11-28T11:54:19.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.834+0000 7f1b09544700 1 -- 172.21.15.80:0/3850389597 wait complete. 2019-11-28T11:54:19.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:19.834+0000 7f1b09544700 1 -- 172.21.15.80:0/3850389597 >> 172.21.15.80:0/3850389597 conn(0x7f1b04127dc0 msgr2=0x7f1b04141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:19.899 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:54:19.900 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:54:19.900 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:54:19.908 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:54:20.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.033+0000 7f8283265700 1 Processor -- start 2019-11-28T11:54:20.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.034+0000 7f8283265700 1 -- start start 2019-11-28T11:54:20.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.035+0000 7f8283265700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f827c06d120 0x7f827c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:20.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.035+0000 7f8283265700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827c06d580 con 0x7f827c06c0a0 2019-11-28T11:54:20.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.035+0000 7f8283265700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827c06db00 con 0x7f827c06c490 2019-11-28T11:54:20.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.035+0000 7f8283265700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827c06fd60 con 0x7f827c06d120 2019-11-28T11:54:20.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.035+0000 7f8281802700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f827c06c0a0 0x7f827c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44470/0 (socket says 172.21.15.80:44470) 2019-11-28T11:54:20.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.035+0000 7f8281802700 1 -- 172.21.15.80:0/2266103505 learned_addr learned my addr 172.21.15.80:0/2266103505 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:20.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.035+0000 7f8282003700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f827c06d120 0x7f827c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.035+0000 7f8280800700 1 -- 172.21.15.80:0/2266103505 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495267946 0 0) 0x7f8264001480 con 0x7f827c06c0a0 2019-11-28T11:54:20.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.035+0000 7f8280800700 1 -- 172.21.15.80:0/2266103505 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8268002e80 con 0x7f827c06c0a0 2019-11-28T11:54:20.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 -- 172.21.15.80:0/2266103505 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089178609 0 0) 0x7f826c001080 con 0x7f827c06c490 2019-11-28T11:54:20.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 -- 172.21.15.80:0/2266103505 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82680030b0 con 0x7f827c06c490 2019-11-28T11:54:20.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 -- 172.21.15.80:0/2266103505 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3240361749 0 0) 0x7f8264001460 con 0x7f827c06c0a0 2019-11-28T11:54:20.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 -- 172.21.15.80:0/2266103505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f827c06d120 msgr2=0x7f827c165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:20.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f827c06d120 0x7f827c165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:20.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 -- 172.21.15.80:0/2266103505 >> v1:172.21.15.174:6789/0 conn(0x7f827c06c490 legacy=0x7f827c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:20.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 -- 172.21.15.80:0/2266103505 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c0706c0 con 0x7f827c06c0a0 2019-11-28T11:54:20.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 -- 172.21.15.80:0/2266103505 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f8264001a10 con 0x7f827c06c0a0 2019-11-28T11:54:20.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8282003700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f827c06d120 0x7f827c165d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:20.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 -- 172.21.15.80:0/2266103505 >> v1:172.21.15.80:6789/0 conn(0x7f827c06c0a0 legacy=0x7f827c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:20.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8268003b80 0x7f8268005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:20.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8268006690 0x7f8268008b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:20.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f826804d310 0x7f826804f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:20.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 -- 172.21.15.80:0/2266103505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826804fff0 con 0x7f8268006690 2019-11-28T11:54:20.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 -- 172.21.15.80:0/2266103505 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82680501e0 con 0x7f826804d310 2019-11-28T11:54:20.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 -- 172.21.15.80:0/2266103505 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8268050410 con 0x7f8268003b80 2019-11-28T11:54:20.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8281001700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8268006690 0x7f8268008b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8281802700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8268003b80 0x7f8268005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8282003700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f826804d310 0x7f826804f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8281001700 1 -- 172.21.15.80:0/2266103505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8268003b80 msgr2=0x7f8268005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:20.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8281001700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8268003b80 0x7f8268005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:20.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8281001700 1 -- 172.21.15.80:0/2266103505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f826804d310 msgr2=0x7f826804f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:20.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8281001700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f826804d310 0x7f826804f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:20.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8281001700 1 -- 172.21.15.80:0/2266103505 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82680506c0 con 0x7f8268006690 2019-11-28T11:54:20.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8281001700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8268006690 0x7f8268008b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f826c00af70 tx=0x7f826c00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8281001700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8268006690 0x7f8268008b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f826c00af70 tx=0x7f826c00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8281001700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8268006690 0x7f8268008b00 secure :-1 s=READY pgs=2567 cs=0 l=1 rx=0x7f826c00af70 tx=0x7f826c00b2f0).ready entity=mon.0 client_cookie=c403d2419db5a4fc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:20.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8281001700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8268006690 0x7f8268008b00 secure :-1 s=THROTTLE_DONE pgs=2567 cs=0 l=1 rx=0x7f826c00af70 tx=0x7f826c00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8281001700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8268006690 0x7f8268008b00 secure :-1 s=THROTTLE_DONE pgs=2567 cs=0 l=1 rx=0x7f826c00af70 tx=0x7f826c00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 -- 172.21.15.80:0/2266103505 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f826c009d40 con 0x7f8268006690 2019-11-28T11:54:20.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8281001700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8268006690 0x7f8268008b00 secure :-1 s=THROTTLE_DONE pgs=2567 cs=0 l=1 rx=0x7f826c00af70 tx=0x7f826c00b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 -- 172.21.15.80:0/2266103505 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c009960 con 0x7f8268006690 2019-11-28T11:54:20.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8280800700 1 -- 172.21.15.80:0/2266103505 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f826c00a320 con 0x7f8268006690 2019-11-28T11:54:20.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.036+0000 7f8283265700 1 -- 172.21.15.80:0/2266103505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8268006690 msgr2=0x7f8268008b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:20.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.037+0000 7f8283265700 1 --2- 172.21.15.80:0/2266103505 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8268006690 0x7f8268008b00 secure :-1 s=READY pgs=2567 cs=0 l=1 rx=0x7f826c00af70 tx=0x7f826c00b2f0).stop 2019-11-28T11:54:20.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.037+0000 7f8282003700 1 -- 172.21.15.80:0/2266103505 reap_dead start 2019-11-28T11:54:20.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.037+0000 7f8283265700 1 -- 172.21.15.80:0/2266103505 shutdown_connections 2019-11-28T11:54:20.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.037+0000 7f8283265700 1 -- 172.21.15.80:0/2266103505 shutdown_connections 2019-11-28T11:54:20.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.037+0000 7f8283265700 1 -- 172.21.15.80:0/2266103505 wait complete. 2019-11-28T11:54:20.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.037+0000 7f8283265700 1 -- 172.21.15.80:0/2266103505 >> 172.21.15.80:0/2266103505 conn(0x7f827c061cf0 msgr2=0x7f827c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:20.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.040+0000 7f8283265700 1 Processor -- start 2019-11-28T11:54:20.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.040+0000 7f8283265700 1 -- start start 2019-11-28T11:54:20.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.041+0000 7f8283265700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f827c07bba0 0x7f827c168c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:20.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.041+0000 7f8283265700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827c0754d0 con 0x7f827c074d00 2019-11-28T11:54:20.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.041+0000 7f8283265700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827c12eb20 con 0x7f827c150f50 2019-11-28T11:54:20.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.041+0000 7f8283265700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827c078980 con 0x7f827c07bba0 2019-11-28T11:54:20.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.041+0000 7f8281802700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f827c074d00 0x7f827c07aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44482/0 (socket says 172.21.15.80:44482) 2019-11-28T11:54:20.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.041+0000 7f8281802700 1 -- 172.21.15.80:0/1575354999 learned_addr learned my addr 172.21.15.80:0/1575354999 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:20.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.041+0000 7f8282003700 1 --2- 172.21.15.80:0/1575354999 >> v2:172.21.15.174:3300/0 conn(0x7f827c07bba0 0x7f827c168c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.041+0000 7f827a7fc700 1 -- 172.21.15.80:0/1575354999 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832289859 0 0) 0x7f8264001120 con 0x7f827c074d00 2019-11-28T11:54:20.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.041+0000 7f827a7fc700 1 -- 172.21.15.80:0/1575354999 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8260002e80 con 0x7f827c074d00 2019-11-28T11:54:20.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.041+0000 7f827a7fc700 1 -- 172.21.15.80:0/1575354999 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943838569 0 0) 0x7f826c0095a0 con 0x7f827c150f50 2019-11-28T11:54:20.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.041+0000 7f827a7fc700 1 -- 172.21.15.80:0/1575354999 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82600030b0 con 0x7f827c150f50 2019-11-28T11:54:20.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.041+0000 7f827a7fc700 1 -- 172.21.15.80:0/1575354999 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2133421492 0 0) 0x7f8264001e00 con 0x7f827c074d00 2019-11-28T11:54:20.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.041+0000 7f8282003700 1 -- 172.21.15.80:0/1575354999 >> v1:172.21.15.174:6789/0 conn(0x7f827c150f50 legacy=0x7f827c07b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:20.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.041+0000 7f8282003700 1 -- 172.21.15.80:0/1575354999 >> v1:172.21.15.80:6789/0 conn(0x7f827c074d00 legacy=0x7f827c07aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:20.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.041+0000 7f8282003700 1 -- 172.21.15.80:0/1575354999 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c0792e0 con 0x7f827c07bba0 2019-11-28T11:54:20.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.042+0000 7f8282003700 1 --2- 172.21.15.80:0/1575354999 >> v2:172.21.15.174:3300/0 conn(0x7f827c07bba0 0x7f827c168c30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8274010380 tx=0x7f8274010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.042+0000 7f8282003700 1 --2- 172.21.15.80:0/1575354999 >> v2:172.21.15.174:3300/0 conn(0x7f827c07bba0 0x7f827c168c30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8274010380 tx=0x7f8274010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.042+0000 7f8282003700 1 --2- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c07bba0 0x7f827c168c30 secure :-1 s=READY pgs=1551 cs=0 l=1 rx=0x7f8274010380 tx=0x7f8274010720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:20.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.042+0000 7f8282003700 1 --2- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c07bba0 0x7f827c168c30 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7f8274010380 tx=0x7f8274010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.042+0000 7f827a7fc700 1 -- 172.21.15.80:0/1575354999 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8274000a70 con 0x7f827c07bba0 2019-11-28T11:54:20.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.042+0000 7f8282003700 1 --2- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c07bba0 0x7f827c168c30 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7f8274010380 tx=0x7f8274010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.042+0000 7f8282003700 1 --2- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c07bba0 0x7f827c168c30 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7f8274010380 tx=0x7f8274010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.042+0000 7f827a7fc700 1 -- 172.21.15.80:0/1575354999 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82740099b0 con 0x7f827c07bba0 2019-11-28T11:54:20.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.042+0000 7f8283265700 1 -- 172.21.15.80:0/1575354999 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827c079660 con 0x7f827c07bba0 2019-11-28T11:54:20.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.042+0000 7f827a7fc700 1 -- 172.21.15.80:0/1575354999 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8274009ed0 con 0x7f827c07bba0 2019-11-28T11:54:20.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.042+0000 7f8283265700 1 -- 172.21.15.80:0/1575354999 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827c0792e0 con 0x7f827c07bba0 2019-11-28T11:54:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.042+0000 7f8282003700 1 --2- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c07bba0 0x7f827c168c30 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7f8274010380 tx=0x7f8274010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.042+0000 7f827a7fc700 1 -- 172.21.15.80:0/1575354999 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8274000a70 con 0x7f827c07bba0 2019-11-28T11:54:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.042+0000 7f8282003700 1 --2- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c07bba0 0x7f827c168c30 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7f8274010380 tx=0x7f8274010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.043+0000 7f827a7fc700 1 --2- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8260018750 0x7f826001ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.043+0000 7f827a7fc700 1 -- 172.21.15.80:0/1575354999 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f8274031c80 con 0x7f827c07bba0 2019-11-28T11:54:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.043+0000 7f8281802700 1 --2- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8260018750 0x7f826001ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.043+0000 7f8281802700 1 --2- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8260018750 0x7f826001ac00 crc :-1 s=READY pgs=1055 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:20.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.049+0000 7f8283265700 1 -- 172.21.15.80:0/1575354999 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f827c079660 con 0x7f827c07bba0 2019-11-28T11:54:20.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.053+0000 7f8282003700 1 --2- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c07bba0 0x7f827c168c30 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7f8274010380 tx=0x7f8274010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.053+0000 7f827a7fc700 1 -- 172.21.15.80:0/1575354999 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8274000a70 con 0x7f827c07bba0 2019-11-28T11:54:20.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.233+0000 7f8283265700 1 -- 172.21.15.80:0/1575354999 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f827c0792e0 con 0x7f827c07bba0 2019-11-28T11:54:20.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.235+0000 7f8282003700 1 --2- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c07bba0 0x7f827c168c30 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7f8274010380 tx=0x7f8274010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.235+0000 7f827a7fc700 1 -- 172.21.15.80:0/1575354999 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v196) v1 ==== 81+0+31925 (secure 0 0 0) 0x7f8274017580 con 0x7f827c07bba0 2019-11-28T11:54:20.293 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:20.293 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:54:20.293 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 196, 2019-11-28T11:54:20.293 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:54:20.295 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:54:20.295 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:54:19.628086+0000", 2019-11-28T11:54:20.296 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:54:20.296 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:54:20.296 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:54:20.296 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:54:20.296 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:54:20.296 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:54:20.297 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:54:20.297 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:54:20.297 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:54:20.297 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:54:20.297 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:54:20.297 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:54:20.318 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:54:20.318 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:54:20.318 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:54:20.319 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 31, 2019-11-28T11:54:20.319 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:54:20.319 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:54:20.319 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:54:20.319 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:54:20.319 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:54:20.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.320 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:54:20.320 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:54:20.320 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:54:20.320 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:54:20.320 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:54:20.320 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:54:20.325 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:54:20.325 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:54:20.325 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:54:20.325 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:54:20.326 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:54:20.326 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:54:20.326 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:54:20.327 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:54:20.328 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:54:20.328 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:54:20.328 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:54:20.328 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:54:20.328 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:54:20.328 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:54:20.328 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:54:20.329 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:54:20.329 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:54:20.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.329 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:54:20.329 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:54:20.329 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:54:20.329 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:54:20.330 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:54:20.330 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:54:20.330 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:54:20.330 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:54:20.330 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:54:20.330 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:54:20.331 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:54:20.331 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:54:20.331 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:54:20.331 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:54:20.331 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:54:20.331 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:54:20.336 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:54:20.336 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:54:20.336 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:54:20.336 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:54:20.336 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:54:20.336 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:54:20.337 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:54:20.337 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:54:20.337 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:54:20.337 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:54:20.337 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:54:20.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.337 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:54:20.338 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:54:20.338 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:54:20.338 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:54:20.338 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:54:20.338 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:54:20.338 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:54:20.339 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:54:20.339 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:54:20.339 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:54:20.339 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:54:20.340 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:54:20.340 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:54:20.340 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:54:20.340 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.341 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 30, 2019-11-28T11:54:20.341 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:54:20.342 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:53:55.640729+0000", 2019-11-28T11:54:20.342 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:54:20.342 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:54:20.342 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:54:20.342 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:54:20.342 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:54:20.343 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:54:20.343 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:54:20.343 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:54:20.343 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:54:20.344 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:54:20.344 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:54:20.344 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:54:20.345 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:54:20.345 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:54:20.345 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:54:20.345 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:54:20.345 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:54:20.345 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:54:20.345 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:54:20.346 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:54:20.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.346 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "189", 2019-11-28T11:54:20.346 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:54:20.346 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:54:20.346 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:54:20.346 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:54:20.347 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:54:20.347 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:54:20.347 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:54:20.347 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:54:20.347 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:54:20.347 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:54:20.348 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:54:20.348 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:54:20.348 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:54:20.348 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:54:20.348 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:54:20.348 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:54:20.348 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:54:20.349 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:54:20.349 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:54:20.349 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:54:20.349 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:54:20.349 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:54:20.349 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:54:20.349 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:54:20.350 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:54:20.350 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:54:20.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.350 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:54:20.350 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:54:20.350 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:54:20.350 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:54:20.351 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:54:20.351 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:54:20.351 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:54:20.351 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:54:20.351 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:54:20.351 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:54:20.351 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:54:20.352 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:54:20.352 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:54:20.352 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:54:20.352 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:54:20.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.352 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:54:20.352 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:54:20.355 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:54:20.355 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.356 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.356 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 31, 2019-11-28T11:54:20.356 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:54:20.356 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:53:56.329039+0000", 2019-11-28T11:54:20.357 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:54:20.357 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:54:20.357 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:54:20.357 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:54:20.357 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:54:20.358 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:54:20.358 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:54:20.358 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:54:20.358 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:54:20.358 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:54:20.358 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:54:20.358 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:54:20.359 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:54:20.359 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:54:20.359 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:54:20.359 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:54:20.359 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:54:20.359 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:54:20.360 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:54:20.360 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:54:20.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.360 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "190", 2019-11-28T11:54:20.360 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:54:20.360 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:54:20.360 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:54:20.361 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:54:20.361 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:54:20.361 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:54:20.361 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:54:20.361 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:54:20.361 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:54:20.361 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:54:20.362 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:54:20.362 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:54:20.362 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:54:20.362 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:54:20.362 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:54:20.362 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:54:20.362 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:54:20.363 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:54:20.363 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:54:20.363 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:54:20.363 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:54:20.363 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:54:20.364 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:54:20.364 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:54:20.364 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:54:20.364 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:54:20.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.365 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:54:20.365 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:54:20.366 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:54:20.366 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:54:20.367 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:54:20.367 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:54:20.367 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:54:20.367 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:54:20.367 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:54:20.368 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:54:20.368 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:54:20.368 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:54:20.368 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:54:20.368 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:54:20.368 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:54:20.368 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.369 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.369 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.369 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:54:20.369 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:54:20.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.369 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:54:20.370 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:54:20.370 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:54:20.370 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:54:20.370 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:54:20.370 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:54:20.370 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:54:20.370 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:54:20.371 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:54:20.371 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 188, 2019-11-28T11:54:20.371 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:54:20.371 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:54:20.371 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:54:20.371 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.372 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.372 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:54:20.372 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:54:20.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.373 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.373 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:54:20.374 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:54:20.374 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.374 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.374 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:54:20.374 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.375 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.375 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:54:20.375 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:54:20.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.376 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.376 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:54:20.376 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:54:20.376 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.376 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.377 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:54:20.377 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.377 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.377 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:54:20.377 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:54:20.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.378 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.378 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:54:20.378 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:54:20.378 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.378 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.379 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:54:20.379 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.379 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.379 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:54:20.379 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:54:20.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.380 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.380 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:54:20.380 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:54:20.380 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.380 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.381 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:54:20.381 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:54:20.381 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:54:20.381 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:54:20.381 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:54:20.381 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:54:20.382 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:54:20.382 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.382 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:54:20.382 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:54:20.383 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:54:20.383 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:54:20.384 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:54:20.387 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:54:20.387 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:54:20.387 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:54:20.387 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:54:20.387 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 188, 2019-11-28T11:54:20.388 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:54:20.388 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:54:20.388 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:54:20.388 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.388 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.389 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:54:20.389 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:54:20.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.390 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.390 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:54:20.391 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:54:20.391 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.391 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.392 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:54:20.392 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.392 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.392 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:54:20.392 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:54:20.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.393 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.393 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:54:20.393 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:54:20.393 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.393 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.394 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:54:20.394 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.394 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.394 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:54:20.395 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:54:20.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.395 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.395 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:54:20.395 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:54:20.395 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.396 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.396 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:54:20.396 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.396 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.396 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:54:20.397 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:54:20.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.397 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.397 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:54:20.397 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:54:20.397 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.398 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.398 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:54:20.398 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:54:20.398 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:54:20.398 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:54:20.398 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:54:20.399 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:54:20.399 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:54:20.399 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.399 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:54:20.399 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:54:20.400 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:54:20.400 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:54:20.400 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:54:20.400 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:54:20.400 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:54:20.400 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:54:20.401 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:54:20.401 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 187, 2019-11-28T11:54:20.401 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:54:20.401 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:54:20.401 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:54:20.401 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.402 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.402 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:54:20.402 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:54:20.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.403 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.403 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:54:20.403 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:54:20.403 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.403 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.404 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:54:20.404 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.404 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.404 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:54:20.404 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:54:20.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.405 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.405 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:54:20.405 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:54:20.405 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.405 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.406 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:54:20.406 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.406 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.406 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:54:20.406 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:54:20.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.407 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.407 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:54:20.407 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:54:20.407 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.407 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.408 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:54:20.408 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.408 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.409 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:54:20.409 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:54:20.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.409 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.409 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:54:20.409 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:54:20.410 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.410 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.410 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:54:20.410 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:54:20.410 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:54:20.410 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:54:20.411 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:54:20.411 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:54:20.411 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:54:20.411 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.411 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:54:20.411 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:54:20.412 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:54:20.412 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:54:20.412 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:54:20.412 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:54:20.412 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:54:20.412 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:54:20.413 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:54:20.413 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 187, 2019-11-28T11:54:20.413 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:54:20.413 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:54:20.413 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:54:20.413 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.414 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.414 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:54:20.414 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:54:20.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.414 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.415 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:54:20.415 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:54:20.417 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.417 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.417 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:54:20.417 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.418 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.418 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:54:20.418 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:54:20.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.418 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.419 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:54:20.419 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:54:20.419 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.419 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.419 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:54:20.419 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.420 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.420 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:54:20.420 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:54:20.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.420 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.421 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:54:20.422 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:54:20.422 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.422 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.422 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:54:20.422 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.423 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.423 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:54:20.423 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:54:20.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.424 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.424 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:54:20.424 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:54:20.424 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.424 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.424 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:54:20.425 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:54:20.425 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:54:20.425 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:54:20.425 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:54:20.425 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:54:20.425 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:54:20.425 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.426 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:54:20.426 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:54:20.426 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:54:20.427 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:54:20.427 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:54:20.427 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:54:20.428 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:54:20.428 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:54:20.429 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:54:20.429 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 188, 2019-11-28T11:54:20.429 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:54:20.429 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:54:20.429 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:54:20.429 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.430 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.430 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:54:20.430 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:54:20.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.430 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.430 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:54:20.431 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:54:20.431 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.431 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.431 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:54:20.431 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.432 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.432 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:54:20.432 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:54:20.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.432 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.432 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:54:20.433 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:54:20.433 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.433 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.433 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:54:20.433 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.434 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.434 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:54:20.434 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:54:20.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.434 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.435 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:54:20.435 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:54:20.435 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.435 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.436 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:54:20.436 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.436 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.437 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:54:20.437 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:54:20.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.438 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.438 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:54:20.438 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:54:20.438 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.439 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.439 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:54:20.439 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:54:20.439 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:54:20.439 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:54:20.440 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:54:20.440 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:54:20.440 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:54:20.440 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.441 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:54:20.441 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:54:20.441 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:54:20.441 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:54:20.441 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:54:20.442 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:54:20.442 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:54:20.442 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:54:20.442 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:54:20.442 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 187, 2019-11-28T11:54:20.442 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:54:20.442 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:54:20.443 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:54:20.443 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.443 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.443 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:54:20.443 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:54:20.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.444 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.444 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:54:20.444 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:54:20.444 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.444 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.445 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:54:20.445 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.445 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.445 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:54:20.445 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:54:20.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.446 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.446 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:54:20.446 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:54:20.446 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.447 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.447 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:54:20.448 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.448 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.448 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:54:20.449 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:54:20.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.449 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.449 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:54:20.449 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:54:20.450 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.450 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.450 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:54:20.450 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.450 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.451 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:54:20.451 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:54:20.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.451 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.451 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:54:20.451 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:54:20.452 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.452 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.452 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:54:20.452 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:54:20.452 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:54:20.452 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:54:20.453 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:54:20.453 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:54:20.454 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:54:20.454 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.454 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:54:20.454 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:54:20.454 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:54:20.455 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:54:20.455 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:54:20.455 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:54:20.455 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:54:20.455 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:54:20.455 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:54:20.455 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 188, 2019-11-28T11:54:20.456 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:54:20.456 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:54:20.456 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:54:20.456 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.456 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.456 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:54:20.457 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:54:20.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.457 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.457 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:54:20.457 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:54:20.457 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.458 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.459 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:54:20.459 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.459 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.460 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:54:20.460 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:54:20.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.460 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.460 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:54:20.461 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:54:20.461 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.461 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.461 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:54:20.461 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.462 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.462 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:54:20.462 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:54:20.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.462 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.462 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:54:20.463 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:54:20.463 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.463 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.463 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:54:20.463 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.464 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.464 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:54:20.464 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:54:20.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.464 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.465 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:54:20.465 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:54:20.465 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.465 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.465 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:54:20.466 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:54:20.466 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:54:20.466 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:54:20.466 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:54:20.466 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:54:20.466 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:54:20.466 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.467 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:54:20.467 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:54:20.467 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:54:20.467 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:54:20.468 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:54:20.468 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:54:20.468 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:54:20.468 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:54:20.469 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:54:20.469 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 187, 2019-11-28T11:54:20.469 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:54:20.469 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:54:20.469 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:54:20.469 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.470 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.470 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:54:20.471 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:54:20.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.471 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.471 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:54:20.471 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:54:20.472 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.472 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.472 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:54:20.472 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.473 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.473 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:54:20.473 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:54:20.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.473 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.473 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:54:20.474 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:54:20.474 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.474 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.474 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:54:20.474 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.475 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.475 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:54:20.475 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:54:20.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.475 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.476 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:54:20.476 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:54:20.476 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.476 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.476 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:54:20.476 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:54:20.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.477 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:54:20.477 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:54:20.477 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:54:20.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.477 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:54:20.478 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:54:20.478 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:54:20.478 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.478 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.478 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:54:20.478 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:54:20.479 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:54:20.479 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:54:20.479 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:54:20.479 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:54:20.480 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:54:20.480 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:20.480 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.480 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:54:20.481 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:54:20.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.481 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:54:20.481 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:54:20.481 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:54:20.481 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:54:20.482 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:54:20.482 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:54:20.482 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:54:20.482 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:54:20.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.482 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:54:20.483 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:54:20.483 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:54:20.483 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:54:20.483 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:54:20.483 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:54:20.483 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:54:20.483 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:54:20.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.484 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:54:20.484 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:54:20.484 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:54:20.484 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:54:20.484 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:54:20.485 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:54:20.485 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:54:20.485 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:54:20.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.485 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:54:20.485 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:54:20.486 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:54:20.486 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:54:20.486 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:54:20.486 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:54:20.486 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:54:20.486 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:54:20.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.487 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:54:20.487 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:54:20.487 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:54:20.487 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:54:20.487 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:54:20.487 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:54:20.488 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:54:20.488 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:54:20.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.488 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:54:20.488 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:54:20.488 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:54:20.489 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:54:20.489 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:54:20.489 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:54:20.489 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:54:20.490 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:54:20.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.490 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:54:20.490 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:54:20.490 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:54:20.491 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:54:20.491 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:54:20.491 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:54:20.492 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:54:20.492 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:54:20.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:20.492 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:54:20.492 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:54:20.492 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:54:20.493 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:54:20.493 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:54:20.493 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:54:20.493 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:54:20.493 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:54:20.493 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.493 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:54:20.494 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:54:20.494 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:54:20.494 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:54:20.494 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:54:20.494 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:54:20.494 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6835/4038262210": "2019-11-29T11:54:19.619414+0000", 2019-11-28T11:54:20.494 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6834/4038262210": "2019-11-29T11:54:19.619414+0000", 2019-11-28T11:54:20.495 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6835/3753292454": "2019-11-29T11:54:12.077535+0000", 2019-11-28T11:54:20.495 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6834/3753292454": "2019-11-29T11:54:12.077535+0000" 2019-11-28T11:54:20.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.495 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:54:20.495 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:54:20.495 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:54:20.495 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:54:20.496 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:54:20.496 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:54:20.496 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:54:20.496 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:54:20.496 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:54:20.496 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:54:20.496 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:54:20.497 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:54:20.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.497 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:54:20.497 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:54:20.497 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:54:20.497 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:54:20.497 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:54:20.498 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:54:20.498 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:54:20.498 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:20.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:20.498 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:54:20.498 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:54:20.498 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:54:20.499 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:54:20.499 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:54:20.499 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:54:20.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.238+0000 7f8283265700 1 -- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8260018750 msgr2=0x7f826001ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:20.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.238+0000 7f8283265700 1 --2- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8260018750 0x7f826001ac00 crc :-1 s=READY pgs=1055 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:20.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.238+0000 7f8283265700 1 -- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c07bba0 msgr2=0x7f827c168c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:20.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.238+0000 7f8283265700 1 --2- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c07bba0 0x7f827c168c30 secure :-1 s=READY pgs=1551 cs=0 l=1 rx=0x7f8274010380 tx=0x7f8274010720).stop 2019-11-28T11:54:20.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.238+0000 7f8283265700 1 -- 172.21.15.80:0/1575354999 shutdown_connections 2019-11-28T11:54:20.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.238+0000 7f8283265700 1 --2- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c07bba0 0x7f827c168c30 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:20.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.238+0000 7f8283265700 1 --2- 172.21.15.80:0/1575354999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8260018750 0x7f826001ac00 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:20.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.238+0000 7f8283265700 1 -- 172.21.15.80:0/1575354999 shutdown_connections 2019-11-28T11:54:20.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.238+0000 7f8283265700 1 -- 172.21.15.80:0/1575354999 wait complete. 2019-11-28T11:54:20.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.238+0000 7f8283265700 1 -- 172.21.15.80:0/1575354999 >> 172.21.15.80:0/1575354999 conn(0x7f827c13fa50 msgr2=0x7f827c07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:20.508 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:20.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.571+0000 7f35a6bba700 1 Processor -- start 2019-11-28T11:54:20.632 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.571+0000 7f35a6bba700 1 -- start start 2019-11-28T11:54:20.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.572+0000 7f35a6bba700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f35a006c0a0 0x7f35a0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:20.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.572+0000 7f35a6bba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35a00734e0 0x7f35a0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:20.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.572+0000 7f35a6bba700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a0072360 0x7f35a0072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:20.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.572+0000 7f35a6bba700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a006fd60 con 0x7f35a00734e0 2019-11-28T11:54:20.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.572+0000 7f35a6bba700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a0070030 con 0x7f35a006c0a0 2019-11-28T11:54:20.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.572+0000 7f35a6bba700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a006f330 con 0x7f35a0072360 2019-11-28T11:54:20.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a4956700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35a00734e0 0x7f35a0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a4956700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35a00734e0 0x7f35a0071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45178/0 (socket says 172.21.15.80:45178) 2019-11-28T11:54:20.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a4956700 1 -- 172.21.15.80:0/3599327736 learned_addr learned my addr 172.21.15.80:0/3599327736 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:20.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a5958700 1 --2- 172.21.15.80:0/3599327736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a0072360 0x7f35a0072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a5157700 1 --2- 172.21.15.80:0/3599327736 >> v2:172.21.15.174:3300/0 conn(0x7f35a006c0a0 0x7f35a0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a4956700 1 -- 172.21.15.80:0/3599327736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a0072360 msgr2=0x7f35a0072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:20.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a4956700 1 --2- 172.21.15.80:0/3599327736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a0072360 0x7f35a0072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:20.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a4956700 1 -- 172.21.15.80:0/3599327736 >> v2:172.21.15.174:3300/0 conn(0x7f35a006c0a0 msgr2=0x7f35a0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:20.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a4956700 1 --2- 172.21.15.80:0/3599327736 >> v2:172.21.15.174:3300/0 conn(0x7f35a006c0a0 0x7f35a0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:20.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a4956700 1 -- 172.21.15.80:0/3599327736 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a00706c0 con 0x7f35a00734e0 2019-11-28T11:54:20.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a5958700 1 --2- 172.21.15.80:0/3599327736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a0072360 0x7f35a0072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:20.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a5157700 1 --2- 172.21.15.80:0/3599327736 >> v2:172.21.15.174:3300/0 conn(0x7f35a006c0a0 0x7f35a0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:20.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a4956700 1 --2- 172.21.15.80:0/3599327736 >> v2:172.21.15.80:3300/0 conn(0x7f35a00734e0 0x7f35a0071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f359400f740 tx=0x7f359400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a4956700 1 --2- 172.21.15.80:0/3599327736 >> v2:172.21.15.80:3300/0 conn(0x7f35a00734e0 0x7f35a0071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f359400f740 tx=0x7f359400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a4956700 1 --2- 172.21.15.80:0/3599327736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35a00734e0 0x7f35a0071e20 secure :-1 s=READY pgs=2569 cs=0 l=1 rx=0x7f359400f740 tx=0x7f359400fae0).ready entity=mon.0 client_cookie=14d3db2fee6742e4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:20.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a4956700 1 --2- 172.21.15.80:0/3599327736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35a00734e0 0x7f35a0071e20 secure :-1 s=THROTTLE_DONE pgs=2569 cs=0 l=1 rx=0x7f359400f740 tx=0x7f359400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f359ffff700 1 -- 172.21.15.80:0/3599327736 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3594000960 con 0x7f35a00734e0 2019-11-28T11:54:20.636 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a4956700 1 --2- 172.21.15.80:0/3599327736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35a00734e0 0x7f35a0071e20 secure :-1 s=THROTTLE_DONE pgs=2569 cs=0 l=1 rx=0x7f359400f740 tx=0x7f359400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a4956700 1 --2- 172.21.15.80:0/3599327736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35a00734e0 0x7f35a0071e20 secure :-1 s=THROTTLE_DONE pgs=2569 cs=0 l=1 rx=0x7f359400f740 tx=0x7f359400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f359ffff700 1 -- 172.21.15.80:0/3599327736 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3594000e80 con 0x7f35a00734e0 2019-11-28T11:54:20.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f359ffff700 1 -- 172.21.15.80:0/3599327736 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35940015d0 con 0x7f35a00734e0 2019-11-28T11:54:20.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a6bba700 1 -- 172.21.15.80:0/3599327736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35a00734e0 msgr2=0x7f35a0071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:20.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.573+0000 7f35a6bba700 1 --2- 172.21.15.80:0/3599327736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35a00734e0 0x7f35a0071e20 secure :-1 s=READY pgs=2569 cs=0 l=1 rx=0x7f359400f740 tx=0x7f359400fae0).stop 2019-11-28T11:54:20.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.574+0000 7f35a6bba700 1 -- 172.21.15.80:0/3599327736 shutdown_connections 2019-11-28T11:54:20.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.574+0000 7f35a6bba700 1 --2- 172.21.15.80:0/3599327736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a0072360 0x7f35a0072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:20.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.574+0000 7f35a6bba700 1 --2- 172.21.15.80:0/3599327736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35a00734e0 0x7f35a0071e20 unknown :-1 s=CLOSED pgs=2569 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:20.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.574+0000 7f35a6bba700 1 --2- 172.21.15.80:0/3599327736 >> v2:172.21.15.174:3300/0 conn(0x7f35a006c0a0 0x7f35a0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:20.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.574+0000 7f35a6bba700 1 -- 172.21.15.80:0/3599327736 shutdown_connections 2019-11-28T11:54:20.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.574+0000 7f35a6bba700 1 -- 172.21.15.80:0/3599327736 wait complete. 2019-11-28T11:54:20.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.574+0000 7f35a6bba700 1 -- 172.21.15.80:0/3599327736 >> 172.21.15.80:0/3599327736 conn(0x7f35a0061cf0 msgr2=0x7f35a0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:20.641 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.577+0000 7f35a6bba700 1 Processor -- start 2019-11-28T11:54:20.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.577+0000 7f35a6bba700 1 -- start start 2019-11-28T11:54:20.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a6bba700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a013a780 0x7f35a012d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:20.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a6bba700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f35a012d9c0 0x7f35a012c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:20.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a6bba700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a0139a60 con 0x7f35a012c840 2019-11-28T11:54:20.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a6bba700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a0129830 con 0x7f35a012d9c0 2019-11-28T11:54:20.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a6bba700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a012a260 con 0x7f35a013a780 2019-11-28T11:54:20.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a5958700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f35a012c840 0x7f35a01281b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44500/0 (socket says 172.21.15.80:44500) 2019-11-28T11:54:20.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a5958700 1 -- 172.21.15.80:0/1194246460 learned_addr learned my addr 172.21.15.80:0/1194246460 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:20.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a5157700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a013a780 0x7f35a012d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a4956700 1 --2- 172.21.15.80:0/1194246460 >> v2:172.21.15.174:3300/0 conn(0x7f35a012d9c0 0x7f35a012c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f359dffb700 1 -- 172.21.15.80:0/1194246460 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685289207 0 0) 0x7f3598002500 con 0x7f35a012c840 2019-11-28T11:54:20.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f359dffb700 1 -- 172.21.15.80:0/1194246460 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3580002e80 con 0x7f35a012c840 2019-11-28T11:54:20.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a4956700 1 -- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a013a780 msgr2=0x7f35a012d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:20.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a4956700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a013a780 0x7f35a012d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:20.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a4956700 1 -- 172.21.15.80:0/1194246460 >> v1:172.21.15.80:6789/0 conn(0x7f35a012c840 legacy=0x7f35a01281b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:20.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a4956700 1 -- 172.21.15.80:0/1194246460 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a012abc0 con 0x7f35a012d9c0 2019-11-28T11:54:20.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a5157700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a013a780 0x7f35a012d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:20.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a4956700 1 --2- 172.21.15.80:0/1194246460 >> v2:172.21.15.174:3300/0 conn(0x7f35a012d9c0 0x7f35a012c300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f35940103a0 tx=0x7f3594010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a4956700 1 --2- 172.21.15.80:0/1194246460 >> v2:172.21.15.174:3300/0 conn(0x7f35a012d9c0 0x7f35a012c300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f35940103a0 tx=0x7f3594010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a4956700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a012d9c0 0x7f35a012c300 secure :-1 s=READY pgs=1552 cs=0 l=1 rx=0x7f35940103a0 tx=0x7f3594010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:20.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a4956700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a012d9c0 0x7f35a012c300 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7f35940103a0 tx=0x7f3594010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f359dffb700 1 -- 172.21.15.80:0/1194246460 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3594000940 con 0x7f35a012d9c0 2019-11-28T11:54:20.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a4956700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a012d9c0 0x7f35a012c300 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7f35940103a0 tx=0x7f3594010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.645 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a4956700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a012d9c0 0x7f35a012c300 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7f35940103a0 tx=0x7f3594010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f359dffb700 1 -- 172.21.15.80:0/1194246460 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3594000f50 con 0x7f35a012d9c0 2019-11-28T11:54:20.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a6bba700 1 -- 172.21.15.80:0/1194246460 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a012af40 con 0x7f35a012d9c0 2019-11-28T11:54:20.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f359dffb700 1 -- 172.21.15.80:0/1194246460 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35940015e0 con 0x7f35a012d9c0 2019-11-28T11:54:20.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.578+0000 7f35a6bba700 1 -- 172.21.15.80:0/1194246460 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a012abc0 con 0x7f35a012d9c0 2019-11-28T11:54:20.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.579+0000 7f35a4956700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a012d9c0 0x7f35a012c300 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7f35940103a0 tx=0x7f3594010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.579+0000 7f359dffb700 1 -- 172.21.15.80:0/1194246460 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3594001140 con 0x7f35a012d9c0 2019-11-28T11:54:20.646 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.579+0000 7f35a4956700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a012d9c0 0x7f35a012c300 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7f35940103a0 tx=0x7f3594010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.579+0000 7f359dffb700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3580018770 0x7f358001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:20.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.579+0000 7f359dffb700 1 -- 172.21.15.80:0/1194246460 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f3594031a10 con 0x7f35a012d9c0 2019-11-28T11:54:20.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.579+0000 7f35a5157700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3580018770 0x7f358001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.580+0000 7f35a5157700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3580018770 0x7f358001abe0 crc :-1 s=READY pgs=1056 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:20.647 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.586+0000 7f35a6bba700 1 -- 172.21.15.80:0/1194246460 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a012af40 con 0x7f35a012d9c0 2019-11-28T11:54:20.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.591+0000 7f35a4956700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a012d9c0 0x7f35a012c300 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7f35940103a0 tx=0x7f3594010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.648 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.591+0000 7f359dffb700 1 -- 172.21.15.80:0/1194246460 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3594000b50 con 0x7f35a012d9c0 2019-11-28T11:54:20.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.761+0000 7f35a6bba700 1 -- 172.21.15.80:0/1194246460 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35a012abc0 con 0x7f35a012d9c0 2019-11-28T11:54:20.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.761+0000 7f35a4956700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a012d9c0 0x7f35a012c300 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7f35940103a0 tx=0x7f3594010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.761+0000 7f359dffb700 1 -- 172.21.15.80:0/1194246460 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 161 v161) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f3594017a20 con 0x7f35a012d9c0 2019-11-28T11:54:20.819 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 161 2019-11-28T11:54:20.819 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:20.819 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":161,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":161,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:53:57.302329+0000","modified":"2019-11-28T11:54:19.806562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":195,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2019-11-28T11:54:20.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.764+0000 7f35a6bba700 1 -- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3580018770 msgr2=0x7f358001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:20.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.764+0000 7f35a6bba700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3580018770 0x7f358001abe0 crc :-1 s=READY pgs=1056 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:20.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.764+0000 7f35a6bba700 1 -- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a012d9c0 msgr2=0x7f35a012c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:20.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.764+0000 7f35a6bba700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a012d9c0 0x7f35a012c300 secure :-1 s=READY pgs=1552 cs=0 l=1 rx=0x7f35940103a0 tx=0x7f3594010740).stop 2019-11-28T11:54:20.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.764+0000 7f35a6bba700 1 -- 172.21.15.80:0/1194246460 shutdown_connections 2019-11-28T11:54:20.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.764+0000 7f35a6bba700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3580018770 0x7f358001abe0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:20.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.764+0000 7f35a6bba700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a012d9c0 0x7f35a012c300 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:20.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.764+0000 7f35a6bba700 1 --2- 172.21.15.80:0/1194246460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a013a780 0x7f35a012d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:20.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.764+0000 7f35a6bba700 1 -- 172.21.15.80:0/1194246460 shutdown_connections 2019-11-28T11:54:20.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.764+0000 7f35a6bba700 1 -- 172.21.15.80:0/1194246460 wait complete. 2019-11-28T11:54:20.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.764+0000 7f35a6bba700 1 -- 172.21.15.80:0/1194246460 >> 172.21.15.80:0/1194246460 conn(0x7f35a0127dc0 msgr2=0x7f35a0141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:20.830 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:54:20.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.898+0000 7fd125eed700 1 Processor -- start 2019-11-28T11:54:20.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.898+0000 7fd125eed700 1 -- start start 2019-11-28T11:54:20.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd125eed700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd12006c0a0 0x7fd120072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:20.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd125eed700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1200734e0 0x7fd120071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:20.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd125eed700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd120072360 0x7fd120072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:20.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd125eed700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12006fd60 con 0x7fd120072360 2019-11-28T11:54:20.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd125eed700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd120070030 con 0x7fd12006c0a0 2019-11-28T11:54:20.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd125eed700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12006f330 con 0x7fd1200734e0 2019-11-28T11:54:20.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd124c8b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd120072360 0x7fd120072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd124c8b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd120072360 0x7fd120072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45192/0 (socket says 172.21.15.80:45192) 2019-11-28T11:54:20.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd124c8b700 1 -- 172.21.15.80:0/4110123770 learned_addr learned my addr 172.21.15.80:0/4110123770 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:20.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd117fff700 1 --2- 172.21.15.80:0/4110123770 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1200734e0 0x7fd120071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd11ffff700 1 --2- 172.21.15.80:0/4110123770 >> v2:172.21.15.174:3300/0 conn(0x7fd12006c0a0 0x7fd120072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd124c8b700 1 -- 172.21.15.80:0/4110123770 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1200734e0 msgr2=0x7fd120071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:20.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd124c8b700 1 --2- 172.21.15.80:0/4110123770 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1200734e0 0x7fd120071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:20.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd124c8b700 1 -- 172.21.15.80:0/4110123770 >> v2:172.21.15.174:3300/0 conn(0x7fd12006c0a0 msgr2=0x7fd120072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:20.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd124c8b700 1 --2- 172.21.15.80:0/4110123770 >> v2:172.21.15.174:3300/0 conn(0x7fd12006c0a0 0x7fd120072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:20.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd124c8b700 1 -- 172.21.15.80:0/4110123770 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1200706c0 con 0x7fd120072360 2019-11-28T11:54:20.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd124c8b700 1 --2- 172.21.15.80:0/4110123770 >> v2:172.21.15.80:3300/0 conn(0x7fd120072360 0x7fd120072800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd11800fa30 tx=0x7fd1180080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd124c8b700 1 --2- 172.21.15.80:0/4110123770 >> v2:172.21.15.80:3300/0 conn(0x7fd120072360 0x7fd120072800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd11800fa30 tx=0x7fd1180080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.899+0000 7fd124c8b700 1 --2- 172.21.15.80:0/4110123770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd120072360 0x7fd120072800 secure :-1 s=READY pgs=2571 cs=0 l=1 rx=0x7fd11800fa30 tx=0x7fd1180080d0).ready entity=mon.0 client_cookie=f960ba46154b7c2b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:20.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.900+0000 7fd124c8b700 1 --2- 172.21.15.80:0/4110123770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd120072360 0x7fd120072800 secure :-1 s=THROTTLE_DONE pgs=2571 cs=0 l=1 rx=0x7fd11800fa30 tx=0x7fd1180080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.900+0000 7fd124c8b700 1 --2- 172.21.15.80:0/4110123770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd120072360 0x7fd120072800 secure :-1 s=THROTTLE_DONE pgs=2571 cs=0 l=1 rx=0x7fd11800fa30 tx=0x7fd1180080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.900+0000 7fd11f7fe700 1 -- 172.21.15.80:0/4110123770 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd118000df0 con 0x7fd120072360 2019-11-28T11:54:20.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.900+0000 7fd124c8b700 1 --2- 172.21.15.80:0/4110123770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd120072360 0x7fd120072800 secure :-1 s=THROTTLE_DONE pgs=2571 cs=0 l=1 rx=0x7fd11800fa30 tx=0x7fd1180080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.900+0000 7fd11f7fe700 1 -- 172.21.15.80:0/4110123770 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd118001460 con 0x7fd120072360 2019-11-28T11:54:20.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.900+0000 7fd11f7fe700 1 -- 172.21.15.80:0/4110123770 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd118001bb0 con 0x7fd120072360 2019-11-28T11:54:20.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.900+0000 7fd125eed700 1 -- 172.21.15.80:0/4110123770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd120072360 msgr2=0x7fd120072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:20.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.900+0000 7fd125eed700 1 --2- 172.21.15.80:0/4110123770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd120072360 0x7fd120072800 secure :-1 s=READY pgs=2571 cs=0 l=1 rx=0x7fd11800fa30 tx=0x7fd1180080d0).stop 2019-11-28T11:54:20.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.900+0000 7fd125eed700 1 -- 172.21.15.80:0/4110123770 shutdown_connections 2019-11-28T11:54:20.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.900+0000 7fd125eed700 1 --2- 172.21.15.80:0/4110123770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd120072360 0x7fd120072800 unknown :-1 s=CLOSED pgs=2571 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:20.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.900+0000 7fd125eed700 1 --2- 172.21.15.80:0/4110123770 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1200734e0 0x7fd120071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:20.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.900+0000 7fd125eed700 1 --2- 172.21.15.80:0/4110123770 >> v2:172.21.15.174:3300/0 conn(0x7fd12006c0a0 0x7fd120072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:20.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.900+0000 7fd125eed700 1 -- 172.21.15.80:0/4110123770 shutdown_connections 2019-11-28T11:54:20.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.900+0000 7fd125eed700 1 -- 172.21.15.80:0/4110123770 wait complete. 2019-11-28T11:54:20.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.900+0000 7fd125eed700 1 -- 172.21.15.80:0/4110123770 >> 172.21.15.80:0/4110123770 conn(0x7fd120061cf0 msgr2=0x7fd120064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:20.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.903+0000 7fd125eed700 1 Processor -- start 2019-11-28T11:54:20.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.903+0000 7fd125eed700 1 -- start start 2019-11-28T11:54:20.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd125eed700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd12013dc00 0x7fd120109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:20.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd125eed700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd12010a3a0 0x7fd120108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:20.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd125eed700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1201312c0 con 0x7fd120109220 2019-11-28T11:54:20.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd125eed700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd120105830 con 0x7fd12013dc00 2019-11-28T11:54:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd125eed700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd120105b00 con 0x7fd12010a3a0 2019-11-28T11:54:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd11ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd12013dc00 0x7fd120109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd117fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd12010a3a0 0x7fd120108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd11ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd12013dc00 0x7fd120109e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:60080/0 (socket says 172.21.15.80:60080) 2019-11-28T11:54:20.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd11ffff700 1 -- 172.21.15.80:0/4158089746 learned_addr learned my addr 172.21.15.80:0/4158089746 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:20.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd11ffff700 1 -- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd12010a3a0 msgr2=0x7fd120108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:20.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd11ffff700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd12010a3a0 0x7fd120108ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:20.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd11ffff700 1 -- 172.21.15.80:0/4158089746 >> v1:172.21.15.174:6789/0 conn(0x7fd120109220 legacy=0x7fd120103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:20.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd11ffff700 1 -- 172.21.15.80:0/4158089746 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd120106190 con 0x7fd12013dc00 2019-11-28T11:54:20.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd11ffff700 1 --2- 172.21.15.80:0/4158089746 >> v2:172.21.15.174:3300/0 conn(0x7fd12013dc00 0x7fd120109e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd110010450 tx=0x7fd110010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd11ffff700 1 --2- 172.21.15.80:0/4158089746 >> v2:172.21.15.174:3300/0 conn(0x7fd12013dc00 0x7fd120109e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd110010450 tx=0x7fd110010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd11ffff700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd12013dc00 0x7fd120109e60 secure :-1 s=READY pgs=1554 cs=0 l=1 rx=0x7fd110010450 tx=0x7fd110010280).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:20.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd11ffff700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd12013dc00 0x7fd120109e60 secure :-1 s=THROTTLE_DONE pgs=1554 cs=0 l=1 rx=0x7fd110010450 tx=0x7fd110010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd11ffff700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd12013dc00 0x7fd120109e60 secure :-1 s=THROTTLE_DONE pgs=1554 cs=0 l=1 rx=0x7fd110010450 tx=0x7fd110010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd11d7fa700 1 -- 172.21.15.80:0/4158089746 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd110000940 con 0x7fd12013dc00 2019-11-28T11:54:20.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd11ffff700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd12013dc00 0x7fd120109e60 secure :-1 s=THROTTLE_DONE pgs=1554 cs=0 l=1 rx=0x7fd110010450 tx=0x7fd110010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd11d7fa700 1 -- 172.21.15.80:0/4158089746 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd110008700 con 0x7fd12013dc00 2019-11-28T11:54:20.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd11d7fa700 1 -- 172.21.15.80:0/4158089746 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd110008d90 con 0x7fd12013dc00 2019-11-28T11:54:20.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.904+0000 7fd125eed700 1 -- 172.21.15.80:0/4158089746 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd120106510 con 0x7fd12013dc00 2019-11-28T11:54:20.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.905+0000 7fd125eed700 1 -- 172.21.15.80:0/4158089746 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd120106190 con 0x7fd12013dc00 2019-11-28T11:54:20.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.905+0000 7fd11ffff700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd12013dc00 0x7fd120109e60 secure :-1 s=THROTTLE_DONE pgs=1554 cs=0 l=1 rx=0x7fd110010450 tx=0x7fd110010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.905+0000 7fd11d7fa700 1 -- 172.21.15.80:0/4158089746 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd1100088f0 con 0x7fd12013dc00 2019-11-28T11:54:20.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.905+0000 7fd11ffff700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd12013dc00 0x7fd120109e60 secure :-1 s=THROTTLE_DONE pgs=1554 cs=0 l=1 rx=0x7fd110010450 tx=0x7fd110010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.905+0000 7fd11d7fa700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd104018730 0x7fd10401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:20.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.905+0000 7fd11d7fa700 1 -- 172.21.15.80:0/4158089746 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fd110031b20 con 0x7fd12013dc00 2019-11-28T11:54:20.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.906+0000 7fd117fff700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd104018730 0x7fd10401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:20.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.906+0000 7fd117fff700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd104018730 0x7fd10401abc0 crc :-1 s=READY pgs=1057 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:20.972 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.913+0000 7fd125eed700 1 -- 172.21.15.80:0/4158089746 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd120106510 con 0x7fd12013dc00 2019-11-28T11:54:20.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.916+0000 7fd11ffff700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd12013dc00 0x7fd120109e60 secure :-1 s=THROTTLE_DONE pgs=1554 cs=0 l=1 rx=0x7fd110010450 tx=0x7fd110010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:20.973 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:20.916+0000 7fd11d7fa700 1 -- 172.21.15.80:0/4158089746 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd110013710 con 0x7fd12013dc00 2019-11-28T11:54:21.138 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.082+0000 7fd125eed700 1 -- 172.21.15.80:0/4158089746 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd120106190 con 0x7fd12013dc00 2019-11-28T11:54:21.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.812+0000 7fd11ffff700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd12013dc00 0x7fd120109e60 secure :-1 s=THROTTLE_DONE pgs=1554 cs=0 l=1 rx=0x7fd110010450 tx=0x7fd110010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:21.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.812+0000 7fd11d7fa700 1 -- 172.21.15.80:0/4158089746 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v162) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd1100088f0 con 0x7fd12013dc00 2019-11-28T11:54:21.903 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:54:21.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.849+0000 7fd125eed700 1 -- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd104018730 msgr2=0x7fd10401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:21.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.849+0000 7fd125eed700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd104018730 0x7fd10401abc0 crc :-1 s=READY pgs=1057 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:21.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.849+0000 7fd125eed700 1 -- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd12013dc00 msgr2=0x7fd120109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:21.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.849+0000 7fd125eed700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd12013dc00 0x7fd120109e60 secure :-1 s=READY pgs=1554 cs=0 l=1 rx=0x7fd110010450 tx=0x7fd110010280).stop 2019-11-28T11:54:21.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.849+0000 7fd125eed700 1 -- 172.21.15.80:0/4158089746 shutdown_connections 2019-11-28T11:54:21.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.849+0000 7fd125eed700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd104018730 0x7fd10401abc0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:21.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.849+0000 7fd125eed700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd12010a3a0 0x7fd120108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:21.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.849+0000 7fd125eed700 1 --2- 172.21.15.80:0/4158089746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd12013dc00 0x7fd120109e60 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:21.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.849+0000 7fd125eed700 1 -- 172.21.15.80:0/4158089746 shutdown_connections 2019-11-28T11:54:21.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.849+0000 7fd125eed700 1 -- 172.21.15.80:0/4158089746 wait complete. 2019-11-28T11:54:21.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.849+0000 7fd125eed700 1 -- 172.21.15.80:0/4158089746 >> 172.21.15.80:0/4158089746 conn(0x7fd12011bfc0 msgr2=0x7fd120141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:21.916 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:22.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.979+0000 7f3211ab9700 1 Processor -- start 2019-11-28T11:54:22.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.979+0000 7f3211ab9700 1 -- start start 2019-11-28T11:54:22.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.980+0000 7f3211ab9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f320c06c0a0 0x7f320c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:22.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.980+0000 7f3211ab9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320c06db00 con 0x7f320c0734e0 2019-11-28T11:54:22.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.980+0000 7f3211ab9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320c06e000 con 0x7f320c072620 2019-11-28T11:54:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.980+0000 7f3211ab9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f320c06fd60 con 0x7f320c06c0a0 2019-11-28T11:54:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.980+0000 7f320bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f320c06c0a0 0x7f320c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:22.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.980+0000 7f320bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f320c06c0a0 0x7f320c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45202/0 (socket says 172.21.15.80:45202) 2019-11-28T11:54:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.980+0000 7f3203fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f320c0734e0 0x7f320c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44518/0 (socket says 172.21.15.80:44518) 2019-11-28T11:54:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.980+0000 7f320bfff700 1 -- 172.21.15.80:0/1776403513 learned_addr learned my addr 172.21.15.80:0/1776403513 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.980+0000 7f320bfff700 1 -- 172.21.15.80:0/1776403513 >> v1:172.21.15.174:6789/0 conn(0x7f320c072620 legacy=0x7f320c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:22.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.980+0000 7f320bfff700 1 -- 172.21.15.80:0/1776403513 >> v1:172.21.15.80:6789/0 conn(0x7f320c0734e0 legacy=0x7f320c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.980+0000 7f320b7fe700 1 -- 172.21.15.80:0/1776403513 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838019188 0 0) 0x7f31f4001100 con 0x7f320c0734e0 2019-11-28T11:54:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.980+0000 7f320bfff700 1 -- 172.21.15.80:0/1776403513 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320c0706c0 con 0x7f320c06c0a0 2019-11-28T11:54:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.980+0000 7f320bfff700 1 --2- 172.21.15.80:0/1776403513 >> v2:172.21.15.80:3300/0 conn(0x7f320c06c0a0 0x7f320c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f31fc00f740 tx=0x7f31fc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.981+0000 7f320bfff700 1 --2- 172.21.15.80:0/1776403513 >> v2:172.21.15.80:3300/0 conn(0x7f320c06c0a0 0x7f320c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f31fc00f740 tx=0x7f31fc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.981+0000 7f320bfff700 1 --2- 172.21.15.80:0/1776403513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c06c0a0 0x7f320c072fa0 secure :-1 s=READY pgs=2573 cs=0 l=1 rx=0x7f31fc00f740 tx=0x7f31fc00fae0).ready entity=mon.0 client_cookie=75669f59f336deaf server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.981+0000 7f320bfff700 1 --2- 172.21.15.80:0/1776403513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c06c0a0 0x7f320c072fa0 secure :-1 s=THROTTLE_DONE pgs=2573 cs=0 l=1 rx=0x7f31fc00f740 tx=0x7f31fc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.981+0000 7f320b7fe700 1 -- 172.21.15.80:0/1776403513 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31fc000960 con 0x7f320c06c0a0 2019-11-28T11:54:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.981+0000 7f320bfff700 1 --2- 172.21.15.80:0/1776403513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c06c0a0 0x7f320c072fa0 secure :-1 s=THROTTLE_DONE pgs=2573 cs=0 l=1 rx=0x7f31fc00f740 tx=0x7f31fc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.981+0000 7f320bfff700 1 --2- 172.21.15.80:0/1776403513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c06c0a0 0x7f320c072fa0 secure :-1 s=THROTTLE_DONE pgs=2573 cs=0 l=1 rx=0x7f31fc00f740 tx=0x7f31fc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.981+0000 7f320b7fe700 1 -- 172.21.15.80:0/1776403513 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc000c90 con 0x7f320c06c0a0 2019-11-28T11:54:22.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.981+0000 7f320b7fe700 1 -- 172.21.15.80:0/1776403513 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31fc0013e0 con 0x7f320c06c0a0 2019-11-28T11:54:22.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.981+0000 7f3211ab9700 1 -- 172.21.15.80:0/1776403513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c06c0a0 msgr2=0x7f320c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:22.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.981+0000 7f3211ab9700 1 --2- 172.21.15.80:0/1776403513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c06c0a0 0x7f320c072fa0 secure :-1 s=READY pgs=2573 cs=0 l=1 rx=0x7f31fc00f740 tx=0x7f31fc00fae0).stop 2019-11-28T11:54:22.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.981+0000 7f3211ab9700 1 -- 172.21.15.80:0/1776403513 shutdown_connections 2019-11-28T11:54:22.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.981+0000 7f3211ab9700 1 --2- 172.21.15.80:0/1776403513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c06c0a0 0x7f320c072fa0 unknown :-1 s=CLOSED pgs=2573 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:22.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.981+0000 7f3211ab9700 1 -- 172.21.15.80:0/1776403513 shutdown_connections 2019-11-28T11:54:22.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.981+0000 7f3211ab9700 1 -- 172.21.15.80:0/1776403513 wait complete. 2019-11-28T11:54:22.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.981+0000 7f3211ab9700 1 -- 172.21.15.80:0/1776403513 >> 172.21.15.80:0/1776403513 conn(0x7f320c061cf0 msgr2=0x7f320c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:22.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.984+0000 7f3211ab9700 1 Processor -- start 2019-11-28T11:54:22.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.984+0000 7f3211ab9700 1 -- start start 2019-11-28T11:54:22.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3211ab9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f320c13f580 0x7f320c114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:22.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3211ab9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f320c114670 0x7f320c11e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:22.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3211ab9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f320c11eaf0 0x7f320c11ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:22.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3211ab9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f320c1236b0 con 0x7f320c11eaf0 2019-11-28T11:54:22.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3211ab9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f320c123980 con 0x7f320c13f580 2019-11-28T11:54:22.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3211ab9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320c122c80 con 0x7f320c114670 2019-11-28T11:54:22.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3210857700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f320c11eaf0 0x7f320c11ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:22.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3210857700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f320c11eaf0 0x7f320c11ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45212/0 (socket says 172.21.15.80:45212) 2019-11-28T11:54:22.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3210857700 1 -- 172.21.15.80:0/2647204554 learned_addr learned my addr 172.21.15.80:0/2647204554 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:22.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f320bfff700 1 --2- 172.21.15.80:0/2647204554 >> v2:172.21.15.174:3300/0 conn(0x7f320c13f580 0x7f320c114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:22.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3203fff700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f320c114670 0x7f320c11e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:22.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3210857700 1 -- 172.21.15.80:0/2647204554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f320c114670 msgr2=0x7f320c11e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:22.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3210857700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f320c114670 0x7f320c11e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:22.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3210857700 1 -- 172.21.15.80:0/2647204554 >> v2:172.21.15.174:3300/0 conn(0x7f320c13f580 msgr2=0x7f320c114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:22.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3210857700 1 --2- 172.21.15.80:0/2647204554 >> v2:172.21.15.174:3300/0 conn(0x7f320c13f580 0x7f320c114130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:22.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3210857700 1 -- 172.21.15.80:0/2647204554 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320c124010 con 0x7f320c11eaf0 2019-11-28T11:54:22.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3210857700 1 --2- 172.21.15.80:0/2647204554 >> v2:172.21.15.80:3300/0 conn(0x7f320c11eaf0 0x7f320c11ef40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f32040107a0 tx=0x7f3204010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3210857700 1 --2- 172.21.15.80:0/2647204554 >> v2:172.21.15.80:3300/0 conn(0x7f320c11eaf0 0x7f320c11ef40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f32040107a0 tx=0x7f3204010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3210857700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c11eaf0 0x7f320c11ef40 secure :-1 s=READY pgs=2574 cs=0 l=1 rx=0x7f32040107a0 tx=0x7f3204010680).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:22.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3210857700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c11eaf0 0x7f320c11ef40 secure :-1 s=THROTTLE_DONE pgs=2574 cs=0 l=1 rx=0x7f32040107a0 tx=0x7f3204010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f32097fa700 1 -- 172.21.15.80:0/2647204554 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3204001410 con 0x7f320c11eaf0 2019-11-28T11:54:22.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3210857700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c11eaf0 0x7f320c11ef40 secure :-1 s=THROTTLE_DONE pgs=2574 cs=0 l=1 rx=0x7f32040107a0 tx=0x7f3204010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3210857700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c11eaf0 0x7f320c11ef40 secure :-1 s=THROTTLE_DONE pgs=2574 cs=0 l=1 rx=0x7f32040107a0 tx=0x7f3204010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f32097fa700 1 -- 172.21.15.80:0/2647204554 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3204000df0 con 0x7f320c11eaf0 2019-11-28T11:54:22.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f32097fa700 1 -- 172.21.15.80:0/2647204554 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32040019f0 con 0x7f320c11eaf0 2019-11-28T11:54:22.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3211ab9700 1 -- 172.21.15.80:0/2647204554 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320c124010 con 0x7f320c11eaf0 2019-11-28T11:54:22.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.985+0000 7f3211ab9700 1 -- 172.21.15.80:0/2647204554 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320c124010 con 0x7f320c11eaf0 2019-11-28T11:54:22.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.986+0000 7f3210857700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c11eaf0 0x7f320c11ef40 secure :-1 s=THROTTLE_DONE pgs=2574 cs=0 l=1 rx=0x7f32040107a0 tx=0x7f3204010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.986+0000 7f32097fa700 1 -- 172.21.15.80:0/2647204554 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3204001220 con 0x7f320c11eaf0 2019-11-28T11:54:22.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.986+0000 7f3210857700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c11eaf0 0x7f320c11ef40 secure :-1 s=THROTTLE_DONE pgs=2574 cs=0 l=1 rx=0x7f32040107a0 tx=0x7f3204010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.986+0000 7f32097fa700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f31f0018730 0x7f31f001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.986+0000 7f32097fa700 1 -- 172.21.15.80:0/2647204554 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f3204031d50 con 0x7f320c11eaf0 2019-11-28T11:54:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.986+0000 7f320bfff700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f31f0018730 0x7f31f001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.987+0000 7f320bfff700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f31f0018730 0x7f31f001abc0 crc :-1 s=READY pgs=1058 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.994+0000 7f3211ab9700 1 -- 172.21.15.80:0/2647204554 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320c124010 con 0x7f320c11eaf0 2019-11-28T11:54:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.997+0000 7f3210857700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c11eaf0 0x7f320c11ef40 secure :-1 s=THROTTLE_DONE pgs=2574 cs=0 l=1 rx=0x7f32040107a0 tx=0x7f3204010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:21.997+0000 7f32097fa700 1 -- 172.21.15.80:0/2647204554 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3204007910 con 0x7f320c11eaf0 2019-11-28T11:54:22.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.170+0000 7f3211ab9700 1 -- 172.21.15.80:0/2647204554 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f320c124010 con 0x7f320c11eaf0 2019-11-28T11:54:22.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.171+0000 7f3210857700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c11eaf0 0x7f320c11ef40 secure :-1 s=THROTTLE_DONE pgs=2574 cs=0 l=1 rx=0x7f32040107a0 tx=0x7f3204010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.171+0000 7f32097fa700 1 -- 172.21.15.80:0/2647204554 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 162 v162) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f3204017ae0 con 0x7f320c11eaf0 2019-11-28T11:54:22.228 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 162 2019-11-28T11:54:22.228 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:22.228 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":162,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":162,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:53:57.302329+0000","modified":"2019-11-28T11:54:21.808488+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":195,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2019-11-28T11:54:22.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.173+0000 7f3211ab9700 1 -- 172.21.15.80:0/2647204554 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f31f0018730 msgr2=0x7f31f001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:22.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.173+0000 7f3211ab9700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f31f0018730 0x7f31f001abc0 crc :-1 s=READY pgs=1058 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:22.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.173+0000 7f3211ab9700 1 -- 172.21.15.80:0/2647204554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c11eaf0 msgr2=0x7f320c11ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:22.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.173+0000 7f3211ab9700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c11eaf0 0x7f320c11ef40 secure :-1 s=READY pgs=2574 cs=0 l=1 rx=0x7f32040107a0 tx=0x7f3204010680).stop 2019-11-28T11:54:22.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.173+0000 7f3211ab9700 1 -- 172.21.15.80:0/2647204554 shutdown_connections 2019-11-28T11:54:22.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.173+0000 7f3211ab9700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f31f0018730 0x7f31f001abc0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:22.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.173+0000 7f3211ab9700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f320c11eaf0 0x7f320c11ef40 unknown :-1 s=CLOSED pgs=2574 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:22.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.173+0000 7f3211ab9700 1 --2- 172.21.15.80:0/2647204554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f320c114670 0x7f320c11e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:22.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.173+0000 7f3211ab9700 1 --2- 172.21.15.80:0/2647204554 >> v2:172.21.15.174:3300/0 conn(0x7f320c13f580 0x7f320c114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:22.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.173+0000 7f3211ab9700 1 -- 172.21.15.80:0/2647204554 shutdown_connections 2019-11-28T11:54:22.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.173+0000 7f3211ab9700 1 -- 172.21.15.80:0/2647204554 wait complete. 2019-11-28T11:54:22.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.173+0000 7f3211ab9700 1 -- 172.21.15.80:0/2647204554 >> 172.21.15.80:0/2647204554 conn(0x7f320c1426c0 msgr2=0x7f320c110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:22.241 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:54:22.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.307+0000 7f4723667700 1 Processor -- start 2019-11-28T11:54:22.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.308+0000 7f4723667700 1 -- start start 2019-11-28T11:54:22.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4723667700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f471c06c0a0 0x7f471c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:22.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4723667700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f471c0734e0 0x7f471c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:22.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4723667700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f471c06db00 con 0x7f471c072360 2019-11-28T11:54:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4723667700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f471c06fd60 con 0x7f471c06c0a0 2019-11-28T11:54:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4723667700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471c070030 con 0x7f471c0734e0 2019-11-28T11:54:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4721c04700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f471c06c0a0 0x7f471c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4721c04700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f471c06c0a0 0x7f471c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45216/0 (socket says 172.21.15.80:45216) 2019-11-28T11:54:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4722405700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f471c072360 0x7f471c06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:60078/0 (socket says 172.21.15.80:60078) 2019-11-28T11:54:22.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4721c04700 1 -- 172.21.15.80:0/1608226916 learned_addr learned my addr 172.21.15.80:0/1608226916 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:22.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4721403700 1 --2- 172.21.15.80:0/1608226916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f471c0734e0 0x7f471c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:22.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4721c04700 1 -- 172.21.15.80:0/1608226916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f471c0734e0 msgr2=0x7f471c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:22.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4721c04700 1 --2- 172.21.15.80:0/1608226916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f471c0734e0 0x7f471c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:22.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4721c04700 1 -- 172.21.15.80:0/1608226916 >> v1:172.21.15.174:6789/0 conn(0x7f471c072360 legacy=0x7f471c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:22.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4721c04700 1 -- 172.21.15.80:0/1608226916 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c0706c0 con 0x7f471c06c0a0 2019-11-28T11:54:22.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4720c02700 1 -- 172.21.15.80:0/1608226916 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669186861 0 0) 0x7f47140009b0 con 0x7f471c072360 2019-11-28T11:54:22.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4721c04700 1 --2- 172.21.15.80:0/1608226916 >> v2:172.21.15.80:3300/0 conn(0x7f471c06c0a0 0x7f471c072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f470c00fa40 tx=0x7f470c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4721c04700 1 --2- 172.21.15.80:0/1608226916 >> v2:172.21.15.80:3300/0 conn(0x7f471c06c0a0 0x7f471c072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f470c00fa40 tx=0x7f470c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4721c04700 1 --2- 172.21.15.80:0/1608226916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c06c0a0 0x7f471c072fa0 secure :-1 s=READY pgs=2575 cs=0 l=1 rx=0x7f470c00fa40 tx=0x7f470c00fde0).ready entity=mon.0 client_cookie=2c5f28c4855f071d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:22.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4721c04700 1 --2- 172.21.15.80:0/1608226916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c06c0a0 0x7f471c072fa0 secure :-1 s=THROTTLE_DONE pgs=2575 cs=0 l=1 rx=0x7f470c00fa40 tx=0x7f470c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4720c02700 1 -- 172.21.15.80:0/1608226916 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f470c000ce0 con 0x7f471c06c0a0 2019-11-28T11:54:22.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4721c04700 1 --2- 172.21.15.80:0/1608226916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c06c0a0 0x7f471c072fa0 secure :-1 s=THROTTLE_DONE pgs=2575 cs=0 l=1 rx=0x7f470c00fa40 tx=0x7f470c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.309+0000 7f4721c04700 1 --2- 172.21.15.80:0/1608226916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c06c0a0 0x7f471c072fa0 secure :-1 s=THROTTLE_DONE pgs=2575 cs=0 l=1 rx=0x7f470c00fa40 tx=0x7f470c00fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.310+0000 7f4720c02700 1 -- 172.21.15.80:0/1608226916 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470c001010 con 0x7f471c06c0a0 2019-11-28T11:54:22.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.310+0000 7f4720c02700 1 -- 172.21.15.80:0/1608226916 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f470c001720 con 0x7f471c06c0a0 2019-11-28T11:54:22.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.310+0000 7f4723667700 1 -- 172.21.15.80:0/1608226916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c06c0a0 msgr2=0x7f471c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:22.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.310+0000 7f4723667700 1 --2- 172.21.15.80:0/1608226916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c06c0a0 0x7f471c072fa0 secure :-1 s=READY pgs=2575 cs=0 l=1 rx=0x7f470c00fa40 tx=0x7f470c00fde0).stop 2019-11-28T11:54:22.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.310+0000 7f4723667700 1 -- 172.21.15.80:0/1608226916 shutdown_connections 2019-11-28T11:54:22.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.310+0000 7f4723667700 1 --2- 172.21.15.80:0/1608226916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f471c0734e0 0x7f471c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:22.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.310+0000 7f4723667700 1 --2- 172.21.15.80:0/1608226916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c06c0a0 0x7f471c072fa0 unknown :-1 s=CLOSED pgs=2575 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:22.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.310+0000 7f4723667700 1 -- 172.21.15.80:0/1608226916 shutdown_connections 2019-11-28T11:54:22.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.310+0000 7f4723667700 1 -- 172.21.15.80:0/1608226916 wait complete. 2019-11-28T11:54:22.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.310+0000 7f4723667700 1 -- 172.21.15.80:0/1608226916 >> 172.21.15.80:0/1608226916 conn(0x7f471c061cf0 msgr2=0x7f471c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:22.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.313+0000 7f4723667700 1 Processor -- start 2019-11-28T11:54:22.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.313+0000 7f4723667700 1 -- start start 2019-11-28T11:54:22.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4723667700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f471c13eb40 0x7f471c10afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:22.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4723667700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f471c10b500 0x7f471c1629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:22.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4723667700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f471c162f30 0x7f471c1633c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:22.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4723667700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f471c1234c0 con 0x7f471c10b500 2019-11-28T11:54:22.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4723667700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f471c13d6a0 con 0x7f471c162f30 2019-11-28T11:54:22.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4723667700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471c108700 con 0x7f471c13eb40 2019-11-28T11:54:22.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4721403700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f471c10b500 0x7f471c1629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:22.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4721403700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f471c10b500 0x7f471c1629f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45224/0 (socket says 172.21.15.80:45224) 2019-11-28T11:54:22.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4721403700 1 -- 172.21.15.80:0/1584128650 learned_addr learned my addr 172.21.15.80:0/1584128650 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:22.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4721c04700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f471c13eb40 0x7f471c10afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:22.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4722405700 1 --2- 172.21.15.80:0/1584128650 >> v2:172.21.15.174:3300/0 conn(0x7f471c162f30 0x7f471c1633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:22.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4721403700 1 -- 172.21.15.80:0/1584128650 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f471c13eb40 msgr2=0x7f471c10afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:22.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4721403700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f471c13eb40 0x7f471c10afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:22.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4721403700 1 -- 172.21.15.80:0/1584128650 >> v2:172.21.15.174:3300/0 conn(0x7f471c162f30 msgr2=0x7f471c1633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:22.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4721403700 1 --2- 172.21.15.80:0/1584128650 >> v2:172.21.15.174:3300/0 conn(0x7f471c162f30 0x7f471c1633c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:22.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4721403700 1 -- 172.21.15.80:0/1584128650 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c108a80 con 0x7f471c10b500 2019-11-28T11:54:22.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4721403700 1 --2- 172.21.15.80:0/1584128650 >> v2:172.21.15.80:3300/0 conn(0x7f471c10b500 0x7f471c1629f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47040103d0 tx=0x7f4704010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4721403700 1 --2- 172.21.15.80:0/1584128650 >> v2:172.21.15.80:3300/0 conn(0x7f471c10b500 0x7f471c1629f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47040103d0 tx=0x7f4704010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4721403700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c10b500 0x7f471c1629f0 secure :-1 s=READY pgs=2576 cs=0 l=1 rx=0x7f47040103d0 tx=0x7f4704010250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:22.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4721403700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c10b500 0x7f471c1629f0 secure :-1 s=THROTTLE_DONE pgs=2576 cs=0 l=1 rx=0x7f47040103d0 tx=0x7f4704010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4721403700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c10b500 0x7f471c1629f0 secure :-1 s=THROTTLE_DONE pgs=2576 cs=0 l=1 rx=0x7f47040103d0 tx=0x7f4704010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f471a7fc700 1 -- 172.21.15.80:0/1584128650 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4704005770 con 0x7f471c10b500 2019-11-28T11:54:22.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4721403700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c10b500 0x7f471c1629f0 secure :-1 s=THROTTLE_DONE pgs=2576 cs=0 l=1 rx=0x7f47040103d0 tx=0x7f4704010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f471a7fc700 1 -- 172.21.15.80:0/1584128650 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4704005390 con 0x7f471c10b500 2019-11-28T11:54:22.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f4723667700 1 -- 172.21.15.80:0/1584128650 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f471c108a80 con 0x7f471c10b500 2019-11-28T11:54:22.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.314+0000 7f471a7fc700 1 -- 172.21.15.80:0/1584128650 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4704005d50 con 0x7f471c10b500 2019-11-28T11:54:22.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.315+0000 7f4723667700 1 -- 172.21.15.80:0/1584128650 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471c108a80 con 0x7f471c10b500 2019-11-28T11:54:22.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.315+0000 7f4721403700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c10b500 0x7f471c1629f0 secure :-1 s=THROTTLE_DONE pgs=2576 cs=0 l=1 rx=0x7f47040103d0 tx=0x7f4704010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.315+0000 7f471a7fc700 1 -- 172.21.15.80:0/1584128650 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4704005580 con 0x7f471c10b500 2019-11-28T11:54:22.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.315+0000 7f4721403700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c10b500 0x7f471c1629f0 secure :-1 s=THROTTLE_DONE pgs=2576 cs=0 l=1 rx=0x7f47040103d0 tx=0x7f4704010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.315+0000 7f471a7fc700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4700018730 0x7f470001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:22.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.315+0000 7f471a7fc700 1 -- 172.21.15.80:0/1584128650 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f4704031bf0 con 0x7f471c10b500 2019-11-28T11:54:22.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.315+0000 7f4721c04700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4700018730 0x7f470001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:22.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.316+0000 7f4721c04700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4700018730 0x7f470001abe0 crc :-1 s=READY pgs=1059 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:22.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.323+0000 7f4723667700 1 -- 172.21.15.80:0/1584128650 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471c108a80 con 0x7f471c10b500 2019-11-28T11:54:22.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.326+0000 7f4721403700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c10b500 0x7f471c1629f0 secure :-1 s=THROTTLE_DONE pgs=2576 cs=0 l=1 rx=0x7f47040103d0 tx=0x7f4704010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.326+0000 7f471a7fc700 1 -- 172.21.15.80:0/1584128650 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4704005180 con 0x7f471c10b500 2019-11-28T11:54:22.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.501+0000 7f4723667700 1 -- 172.21.15.80:0/1584128650 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f471c108a80 con 0x7f471c10b500 2019-11-28T11:54:22.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.813+0000 7f4721403700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c10b500 0x7f471c1629f0 secure :-1 s=THROTTLE_DONE pgs=2576 cs=0 l=1 rx=0x7f47040103d0 tx=0x7f4704010250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:22.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.813+0000 7f471a7fc700 1 -- 172.21.15.80:0/1584128650 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v163) v1 ==== 104+0+0 (secure 0 0 0) 0x7f47040173c0 con 0x7f471c10b500 2019-11-28T11:54:22.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.818+0000 7f4723667700 1 -- 172.21.15.80:0/1584128650 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4700018730 msgr2=0x7f470001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:22.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.818+0000 7f4723667700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4700018730 0x7f470001abe0 crc :-1 s=READY pgs=1059 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:22.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.818+0000 7f4723667700 1 -- 172.21.15.80:0/1584128650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c10b500 msgr2=0x7f471c1629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:22.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.818+0000 7f4723667700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c10b500 0x7f471c1629f0 secure :-1 s=READY pgs=2576 cs=0 l=1 rx=0x7f47040103d0 tx=0x7f4704010250).stop 2019-11-28T11:54:22.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.818+0000 7f4723667700 1 -- 172.21.15.80:0/1584128650 shutdown_connections 2019-11-28T11:54:22.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.818+0000 7f4723667700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4700018730 0x7f470001abe0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:22.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.818+0000 7f4723667700 1 --2- 172.21.15.80:0/1584128650 >> v2:172.21.15.174:3300/0 conn(0x7f471c162f30 0x7f471c1633c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:22.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.818+0000 7f4723667700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f471c10b500 0x7f471c1629f0 unknown :-1 s=CLOSED pgs=2576 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:22.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.818+0000 7f4723667700 1 --2- 172.21.15.80:0/1584128650 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f471c13eb40 0x7f471c10afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:22.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.818+0000 7f4723667700 1 -- 172.21.15.80:0/1584128650 shutdown_connections 2019-11-28T11:54:22.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.818+0000 7f4723667700 1 -- 172.21.15.80:0/1584128650 wait complete. 2019-11-28T11:54:22.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.818+0000 7f4723667700 1 -- 172.21.15.80:0/1584128650 >> 172.21.15.80:0/1584128650 conn(0x7f471c11bfc0 msgr2=0x7f471c141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:22.885 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:54:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.952+0000 7f9e70136700 1 Processor -- start 2019-11-28T11:54:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.952+0000 7f9e70136700 1 -- start start 2019-11-28T11:54:23.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.953+0000 7f9e70136700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9e6815f100 0x7f9e6806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.953+0000 7f9e70136700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e6806c2f0 0x7f9e6806c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.953+0000 7f9e70136700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6806db60 con 0x7f9e6815ed10 2019-11-28T11:54:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.953+0000 7f9e70136700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6806fe00 con 0x7f9e6815f100 2019-11-28T11:54:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.953+0000 7f9e70136700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e680700d0 con 0x7f9e6806c2f0 2019-11-28T11:54:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.953+0000 7f9e6e6d3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9e6815ed10 0x7f9e68073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44546/0 (socket says 172.21.15.80:44546) 2019-11-28T11:54:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.953+0000 7f9e6e6d3700 1 -- 172.21.15.80:0/1943093745 learned_addr learned my addr 172.21.15.80:0/1943093745 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:23.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.953+0000 7f9e6ded2700 1 --2- 172.21.15.80:0/1943093745 >> v2:172.21.15.174:3300/0 conn(0x7f9e6815f100 0x7f9e6806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:23.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.953+0000 7f9e6eed4700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e6806c2f0 0x7f9e6806c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:23.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.953+0000 7f9e6d6d1700 1 -- 172.21.15.80:0/1943093745 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794598002 0 0) 0x7f9e58001150 con 0x7f9e6815ed10 2019-11-28T11:54:23.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.953+0000 7f9e6d6d1700 1 -- 172.21.15.80:0/1943093745 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e54002e80 con 0x7f9e6815ed10 2019-11-28T11:54:23.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.953+0000 7f9e6d6d1700 1 -- 172.21.15.80:0/1943093745 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 128327125 0 0) 0x7f9e58001130 con 0x7f9e6815ed10 2019-11-28T11:54:23.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.953+0000 7f9e6d6d1700 1 -- 172.21.15.80:0/1943093745 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e6806c2f0 msgr2=0x7f9e6806c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:23.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.953+0000 7f9e6d6d1700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e6806c2f0 0x7f9e6806c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:23.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.953+0000 7f9e6d6d1700 1 -- 172.21.15.80:0/1943093745 >> v2:172.21.15.174:3300/0 conn(0x7f9e6815f100 msgr2=0x7f9e6806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:23.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.953+0000 7f9e6d6d1700 1 --2- 172.21.15.80:0/1943093745 >> v2:172.21.15.174:3300/0 conn(0x7f9e6815f100 0x7f9e6806bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:23.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6d6d1700 1 -- 172.21.15.80:0/1943093745 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e68070760 con 0x7f9e6815ed10 2019-11-28T11:54:23.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6d6d1700 1 -- 172.21.15.80:0/1943093745 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f9e580016c0 con 0x7f9e6815ed10 2019-11-28T11:54:23.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6d6d1700 1 -- 172.21.15.80:0/1943093745 >> v1:172.21.15.80:6789/0 conn(0x7f9e6815ed10 legacy=0x7f9e68073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:23.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6d6d1700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e540479e0 0x7f9e54049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:23.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6d6d1700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e5404a5c0 0x7f9e5404ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:23.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6d6d1700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e5404d2f0 0x7f9e5404f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:23.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6d6d1700 1 -- 172.21.15.80:0/1943093745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5404ff40 con 0x7f9e5404a5c0 2019-11-28T11:54:23.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6d6d1700 1 -- 172.21.15.80:0/1943093745 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e54050130 con 0x7f9e540479e0 2019-11-28T11:54:23.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6d6d1700 1 -- 172.21.15.80:0/1943093745 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e54050360 con 0x7f9e5404d2f0 2019-11-28T11:54:23.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6ded2700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e5404a5c0 0x7f9e5404ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:23.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6e6d3700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e540479e0 0x7f9e54049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:23.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6eed4700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e5404d2f0 0x7f9e5404f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:23.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6ded2700 1 -- 172.21.15.80:0/1943093745 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e5404d2f0 msgr2=0x7f9e5404f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:23.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6ded2700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e5404d2f0 0x7f9e5404f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:23.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6ded2700 1 -- 172.21.15.80:0/1943093745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e540479e0 msgr2=0x7f9e54049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:23.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6ded2700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e540479e0 0x7f9e54049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:23.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6ded2700 1 -- 172.21.15.80:0/1943093745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e54050610 con 0x7f9e5404a5c0 2019-11-28T11:54:23.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6ded2700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e5404a5c0 0x7f9e5404ca90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9e5000ba60 tx=0x7f9e5000b930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:23.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6ded2700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e5404a5c0 0x7f9e5404ca90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9e5000ba60 tx=0x7f9e5000b930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:23.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6ded2700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e5404a5c0 0x7f9e5404ca90 secure :-1 s=READY pgs=2578 cs=0 l=1 rx=0x7f9e5000ba60 tx=0x7f9e5000b930).ready entity=mon.0 client_cookie=2787e7baf8de58e7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:23.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6ded2700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e5404a5c0 0x7f9e5404ca90 secure :-1 s=THROTTLE_DONE pgs=2578 cs=0 l=1 rx=0x7f9e5000ba60 tx=0x7f9e5000b930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:23.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6d6d1700 1 -- 172.21.15.80:0/1943093745 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e50000ce0 con 0x7f9e5404a5c0 2019-11-28T11:54:23.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6ded2700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e5404a5c0 0x7f9e5404ca90 secure :-1 s=THROTTLE_DONE pgs=2578 cs=0 l=1 rx=0x7f9e5000ba60 tx=0x7f9e5000b930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:23.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6ded2700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e5404a5c0 0x7f9e5404ca90 secure :-1 s=THROTTLE_DONE pgs=2578 cs=0 l=1 rx=0x7f9e5000ba60 tx=0x7f9e5000b930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:23.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6d6d1700 1 -- 172.21.15.80:0/1943093745 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e50009d00 con 0x7f9e5404a5c0 2019-11-28T11:54:23.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6d6d1700 1 -- 172.21.15.80:0/1943093745 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e5000a3d0 con 0x7f9e5404a5c0 2019-11-28T11:54:23.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e70136700 1 -- 172.21.15.80:0/1943093745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e5404a5c0 msgr2=0x7f9e5404ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:23.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e70136700 1 --2- 172.21.15.80:0/1943093745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9e5404a5c0 0x7f9e5404ca90 secure :-1 s=READY pgs=2578 cs=0 l=1 rx=0x7f9e5000ba60 tx=0x7f9e5000b930).stop 2019-11-28T11:54:23.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.954+0000 7f9e6eed4700 1 -- 172.21.15.80:0/1943093745 reap_dead start 2019-11-28T11:54:23.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.955+0000 7f9e70136700 1 -- 172.21.15.80:0/1943093745 shutdown_connections 2019-11-28T11:54:23.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.955+0000 7f9e70136700 1 -- 172.21.15.80:0/1943093745 shutdown_connections 2019-11-28T11:54:23.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.955+0000 7f9e70136700 1 -- 172.21.15.80:0/1943093745 wait complete. 2019-11-28T11:54:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.955+0000 7f9e70136700 1 -- 172.21.15.80:0/1943093745 >> 172.21.15.80:0/1943093745 conn(0x7f9e68061d20 msgr2=0x7f9e680641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.958+0000 7f9e70136700 1 Processor -- start 2019-11-28T11:54:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.958+0000 7f9e70136700 1 -- start start 2019-11-28T11:54:23.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e70136700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e68108630 0x7f9e68152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:23.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e70136700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9e6812caa0 0x7f9e681510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:23.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e70136700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6810a310 con 0x7f9e681527a0 2019-11-28T11:54:23.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e70136700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6812ee80 con 0x7f9e6812caa0 2019-11-28T11:54:23.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e70136700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e68131fc0 con 0x7f9e68108630 2019-11-28T11:54:23.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e6e6d3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e68108630 0x7f9e68152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:23.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e6e6d3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e68108630 0x7f9e68152260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:47502/0 (socket says 172.21.15.80:47502) 2019-11-28T11:54:23.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e6e6d3700 1 -- 172.21.15.80:0/3725171370 learned_addr learned my addr 172.21.15.80:0/3725171370 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:23.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e6ded2700 1 --1- 172.21.15.80:0/3725171370 >> v1:172.21.15.174:6789/0 conn(0x7f9e681527a0 0x7f9e6812c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:60104/0 (socket says 172.21.15.80:60104) 2019-11-28T11:54:23.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e6eed4700 1 --2- 172.21.15.80:0/3725171370 >> v2:172.21.15.174:3300/0 conn(0x7f9e6812caa0 0x7f9e681510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:23.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e6e6d3700 1 -- 172.21.15.80:0/3725171370 >> v2:172.21.15.174:3300/0 conn(0x7f9e6812caa0 msgr2=0x7f9e681510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:23.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e6e6d3700 1 --2- 172.21.15.80:0/3725171370 >> v2:172.21.15.174:3300/0 conn(0x7f9e6812caa0 0x7f9e681510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:23.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e6e6d3700 1 -- 172.21.15.80:0/3725171370 >> v1:172.21.15.174:6789/0 conn(0x7f9e681527a0 legacy=0x7f9e6812c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:23.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e66ffd700 1 -- 172.21.15.80:0/3725171370 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729915930 0 0) 0x7f9e50009900 con 0x7f9e681527a0 2019-11-28T11:54:23.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e6e6d3700 1 -- 172.21.15.80:0/3725171370 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e68133350 con 0x7f9e68108630 2019-11-28T11:54:23.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e6eed4700 1 --2- 172.21.15.80:0/3725171370 >> v2:172.21.15.174:3300/0 conn(0x7f9e6812caa0 0x7f9e681510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:23.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e6e6d3700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e68108630 0x7f9e68152260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9e58010430 tx=0x7f9e580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:23.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e6e6d3700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e68108630 0x7f9e68152260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9e58010430 tx=0x7f9e580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:23.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e6e6d3700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e68108630 0x7f9e68152260 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7f9e58010430 tx=0x7f9e580107d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:23.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e6e6d3700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e68108630 0x7f9e68152260 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f9e58010430 tx=0x7f9e580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:23.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e66ffd700 1 -- 172.21.15.80:0/3725171370 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e58001b80 con 0x7f9e68108630 2019-11-28T11:54:23.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e6e6d3700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e68108630 0x7f9e68152260 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f9e58010430 tx=0x7f9e580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:23.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e66ffd700 1 -- 172.21.15.80:0/3725171370 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e58004240 con 0x7f9e68108630 2019-11-28T11:54:23.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e6e6d3700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e68108630 0x7f9e68152260 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f9e58010430 tx=0x7f9e580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:23.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e70136700 1 -- 172.21.15.80:0/3725171370 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e681336d0 con 0x7f9e68108630 2019-11-28T11:54:23.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e66ffd700 1 -- 172.21.15.80:0/3725171370 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e58001b80 con 0x7f9e68108630 2019-11-28T11:54:23.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.959+0000 7f9e70136700 1 -- 172.21.15.80:0/3725171370 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e68133350 con 0x7f9e68108630 2019-11-28T11:54:23.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.960+0000 7f9e6e6d3700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e68108630 0x7f9e68152260 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f9e58010430 tx=0x7f9e580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:23.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.960+0000 7f9e66ffd700 1 -- 172.21.15.80:0/3725171370 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9e58004430 con 0x7f9e68108630 2019-11-28T11:54:23.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.960+0000 7f9e6e6d3700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e68108630 0x7f9e68152260 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f9e58010430 tx=0x7f9e580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:23.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.960+0000 7f9e66ffd700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9e4c018730 0x7f9e4c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:23.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.960+0000 7f9e66ffd700 1 -- 172.21.15.80:0/3725171370 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f9e58031aa0 con 0x7f9e68108630 2019-11-28T11:54:23.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.960+0000 7f9e6ded2700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9e4c018730 0x7f9e4c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:23.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.961+0000 7f9e6ded2700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9e4c018730 0x7f9e4c01abc0 crc :-1 s=READY pgs=1060 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:23.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.967+0000 7f9e70136700 1 -- 172.21.15.80:0/3725171370 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e681336d0 con 0x7f9e68108630 2019-11-28T11:54:23.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.971+0000 7f9e6e6d3700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e68108630 0x7f9e68152260 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f9e58010430 tx=0x7f9e580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:23.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:22.971+0000 7f9e66ffd700 1 -- 172.21.15.80:0/3725171370 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9e58000c90 con 0x7f9e68108630 2019-11-28T11:54:23.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.138+0000 7f9e70136700 1 -- 172.21.15.80:0/3725171370 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9e68133350 con 0x7f9e68108630 2019-11-28T11:54:23.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.819+0000 7f9e6e6d3700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e68108630 0x7f9e68152260 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7f9e58010430 tx=0x7f9e580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:23.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.819+0000 7f9e66ffd700 1 -- 172.21.15.80:0/3725171370 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v197) v1 ==== 185+0+0 (secure 0 0 0) 0x7f9e5801f8b0 con 0x7f9e68108630 2019-11-28T11:54:23.909 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:54:23.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.855+0000 7f9e70136700 1 -- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9e4c018730 msgr2=0x7f9e4c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:23.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.855+0000 7f9e70136700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9e4c018730 0x7f9e4c01abc0 crc :-1 s=READY pgs=1060 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:23.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.855+0000 7f9e70136700 1 -- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e68108630 msgr2=0x7f9e68152260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:23.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.855+0000 7f9e70136700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e68108630 0x7f9e68152260 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7f9e58010430 tx=0x7f9e580107d0).stop 2019-11-28T11:54:23.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.855+0000 7f9e70136700 1 -- 172.21.15.80:0/3725171370 shutdown_connections 2019-11-28T11:54:23.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.855+0000 7f9e70136700 1 --2- 172.21.15.80:0/3725171370 >> v2:172.21.15.174:3300/0 conn(0x7f9e6812caa0 0x7f9e681510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:23.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.855+0000 7f9e70136700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9e4c018730 0x7f9e4c01abc0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:23.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.855+0000 7f9e70136700 1 --2- 172.21.15.80:0/3725171370 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e68108630 0x7f9e68152260 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:23.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.855+0000 7f9e70136700 1 -- 172.21.15.80:0/3725171370 shutdown_connections 2019-11-28T11:54:23.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.855+0000 7f9e70136700 1 -- 172.21.15.80:0/3725171370 wait complete. 2019-11-28T11:54:23.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.855+0000 7f9e70136700 1 -- 172.21.15.80:0/3725171370 >> 172.21.15.80:0/3725171370 conn(0x7f9e6814dbb0 msgr2=0x7f9e68142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:23.922 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:54:24.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.990+0000 7f91e085f700 1 Processor -- start 2019-11-28T11:54:24.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.990+0000 7f91e085f700 1 -- start start 2019-11-28T11:54:24.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91e085f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc15ed10 0x7f91dc15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:24.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91e085f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f91dc073020 0x7f91dc071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:24.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91e085f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91dc06db60 con 0x7f91dc0734b0 2019-11-28T11:54:24.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91e085f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc06f3d0 con 0x7f91dc073020 2019-11-28T11:54:24.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91e085f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc06fe00 con 0x7f91dc15ed10 2019-11-28T11:54:24.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91da59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f91dc073020 0x7f91dc071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:24.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91dad9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc15ed10 0x7f91dc15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:24.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91dad9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc15ed10 0x7f91dc15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:47510/0 (socket says 172.21.15.80:47510) 2019-11-28T11:54:24.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91da59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f91dc073020 0x7f91dc071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:60140/0 (socket says 172.21.15.80:60140) 2019-11-28T11:54:24.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91dad9d700 1 -- 172.21.15.80:0/1425002003 learned_addr learned my addr 172.21.15.80:0/1425002003 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:24.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91dad9d700 1 -- 172.21.15.80:0/1425002003 >> v2:172.21.15.174:3300/0 conn(0x7f91dc073020 msgr2=0x7f91dc071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:24.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91dad9d700 1 --2- 172.21.15.80:0/1425002003 >> v2:172.21.15.174:3300/0 conn(0x7f91dc073020 0x7f91dc071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:24.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91dad9d700 1 -- 172.21.15.80:0/1425002003 >> v1:172.21.15.174:6789/0 conn(0x7f91dc0734b0 legacy=0x7f91dc0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:24.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91dad9d700 1 -- 172.21.15.80:0/1425002003 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc070760 con 0x7f91dc15ed10 2019-11-28T11:54:24.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91dad9d700 1 --2- 172.21.15.80:0/1425002003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc15ed10 0x7f91dc15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f91c400f740 tx=0x7f91c400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:24.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91dad9d700 1 --2- 172.21.15.80:0/1425002003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc15ed10 0x7f91dc15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f91c400f740 tx=0x7f91c400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:24.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.992+0000 7f91dad9d700 1 --2- 172.21.15.80:0/1425002003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc15ed10 0x7f91dc15f100 secure :-1 s=READY pgs=368 cs=0 l=1 rx=0x7f91c400f740 tx=0x7f91c400f570).ready entity=mon.2 client_cookie=f231d253010b0f8f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:24.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.993+0000 7f91dad9d700 1 --2- 172.21.15.80:0/1425002003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc15ed10 0x7f91dc15f100 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7f91c400f740 tx=0x7f91c400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:24.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.993+0000 7f91dad9d700 1 --2- 172.21.15.80:0/1425002003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc15ed10 0x7f91dc15f100 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7f91c400f740 tx=0x7f91c400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:24.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.993+0000 7f91d9d9b700 1 -- 172.21.15.80:0/1425002003 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91c4000960 con 0x7f91dc15ed10 2019-11-28T11:54:24.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.993+0000 7f91dad9d700 1 --2- 172.21.15.80:0/1425002003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc15ed10 0x7f91dc15f100 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7f91c400f740 tx=0x7f91c400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:24.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.993+0000 7f91d9d9b700 1 -- 172.21.15.80:0/1425002003 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c4000c90 con 0x7f91dc15ed10 2019-11-28T11:54:24.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.993+0000 7f91d9d9b700 1 -- 172.21.15.80:0/1425002003 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91c40013a0 con 0x7f91dc15ed10 2019-11-28T11:54:24.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.993+0000 7f91e085f700 1 -- 172.21.15.80:0/1425002003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc15ed10 msgr2=0x7f91dc15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:24.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.993+0000 7f91e085f700 1 --2- 172.21.15.80:0/1425002003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc15ed10 0x7f91dc15f100 secure :-1 s=READY pgs=368 cs=0 l=1 rx=0x7f91c400f740 tx=0x7f91c400f570).stop 2019-11-28T11:54:24.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.993+0000 7f91e085f700 1 -- 172.21.15.80:0/1425002003 shutdown_connections 2019-11-28T11:54:24.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.993+0000 7f91e085f700 1 --2- 172.21.15.80:0/1425002003 >> v2:172.21.15.174:3300/0 conn(0x7f91dc073020 0x7f91dc071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:24.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.993+0000 7f91e085f700 1 --2- 172.21.15.80:0/1425002003 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc15ed10 0x7f91dc15f100 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:24.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.994+0000 7f91e085f700 1 -- 172.21.15.80:0/1425002003 shutdown_connections 2019-11-28T11:54:24.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.994+0000 7f91e085f700 1 -- 172.21.15.80:0/1425002003 wait complete. 2019-11-28T11:54:24.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.994+0000 7f91e085f700 1 -- 172.21.15.80:0/1425002003 >> 172.21.15.80:0/1425002003 conn(0x7f91dc061d20 msgr2=0x7f91dc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:24.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.996+0000 7f91e085f700 1 Processor -- start 2019-11-28T11:54:24.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.996+0000 7f91e085f700 1 -- start start 2019-11-28T11:54:24.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91e085f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f91dc155060 0x7f91dc1554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:24.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91e085f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc155a30 0x7f91dc12d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:24.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91e085f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91dc15cb50 con 0x7f91dc15f800 2019-11-28T11:54:24.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91e085f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc102e00 con 0x7f91dc155060 2019-11-28T11:54:24.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91e085f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc1030d0 con 0x7f91dc155a30 2019-11-28T11:54:24.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91dad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f91dc15f800 0x7f91dc156170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44572/0 (socket says 172.21.15.80:44572) 2019-11-28T11:54:24.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91dad9d700 1 -- 172.21.15.80:0/1255586585 learned_addr learned my addr 172.21.15.80:0/1255586585 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:24.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91da59c700 1 --2- 172.21.15.80:0/1255586585 >> v2:172.21.15.174:3300/0 conn(0x7f91dc155060 0x7f91dc1554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:24.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91db59e700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc155a30 0x7f91dc12d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:24.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91d37fe700 1 -- 172.21.15.80:0/1255586585 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586644043 0 0) 0x7f91c4008070 con 0x7f91dc15f800 2019-11-28T11:54:24.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91d37fe700 1 -- 172.21.15.80:0/1255586585 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91b4002e80 con 0x7f91dc15f800 2019-11-28T11:54:24.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91da59c700 1 -- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc155a30 msgr2=0x7f91dc12d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:24.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91da59c700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc155a30 0x7f91dc12d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:24.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91da59c700 1 -- 172.21.15.80:0/1255586585 >> v1:172.21.15.80:6789/0 conn(0x7f91dc15f800 legacy=0x7f91dc156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:24.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91da59c700 1 -- 172.21.15.80:0/1255586585 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc103760 con 0x7f91dc155060 2019-11-28T11:54:24.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91da59c700 1 --2- 172.21.15.80:0/1255586585 >> v2:172.21.15.174:3300/0 conn(0x7f91dc155060 0x7f91dc1554f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f91cc010390 tx=0x7f91cc00b360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:24.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91da59c700 1 --2- 172.21.15.80:0/1255586585 >> v2:172.21.15.174:3300/0 conn(0x7f91dc155060 0x7f91dc1554f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f91cc010390 tx=0x7f91cc00b360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:24.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.997+0000 7f91da59c700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc155060 0x7f91dc1554f0 secure :-1 s=READY pgs=1559 cs=0 l=1 rx=0x7f91cc010390 tx=0x7f91cc00b360).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:24.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.998+0000 7f91da59c700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc155060 0x7f91dc1554f0 secure :-1 s=THROTTLE_DONE pgs=1559 cs=0 l=1 rx=0x7f91cc010390 tx=0x7f91cc00b360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:24.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.998+0000 7f91d37fe700 1 -- 172.21.15.80:0/1255586585 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91cc009640 con 0x7f91dc155060 2019-11-28T11:54:24.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.998+0000 7f91da59c700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc155060 0x7f91dc1554f0 secure :-1 s=THROTTLE_DONE pgs=1559 cs=0 l=1 rx=0x7f91cc010390 tx=0x7f91cc00b360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:24.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.998+0000 7f91da59c700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc155060 0x7f91dc1554f0 secure :-1 s=THROTTLE_DONE pgs=1559 cs=0 l=1 rx=0x7f91cc010390 tx=0x7f91cc00b360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:24.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.998+0000 7f91d37fe700 1 -- 172.21.15.80:0/1255586585 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc000940 con 0x7f91dc155060 2019-11-28T11:54:24.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.998+0000 7f91e085f700 1 -- 172.21.15.80:0/1255586585 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91dc103ae0 con 0x7f91dc155060 2019-11-28T11:54:24.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.998+0000 7f91d37fe700 1 -- 172.21.15.80:0/1255586585 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91cc00a0e0 con 0x7f91dc155060 2019-11-28T11:54:24.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.998+0000 7f91e085f700 1 -- 172.21.15.80:0/1255586585 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91dc104bc0 con 0x7f91dc155060 2019-11-28T11:54:24.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.998+0000 7f91da59c700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc155060 0x7f91dc1554f0 secure :-1 s=THROTTLE_DONE pgs=1559 cs=0 l=1 rx=0x7f91cc010390 tx=0x7f91cc00b360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:24.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.998+0000 7f91d37fe700 1 -- 172.21.15.80:0/1255586585 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f91cc009a70 con 0x7f91dc155060 2019-11-28T11:54:24.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.998+0000 7f91da59c700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc155060 0x7f91dc1554f0 secure :-1 s=THROTTLE_DONE pgs=1559 cs=0 l=1 rx=0x7f91cc010390 tx=0x7f91cc00b360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:24.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.998+0000 7f91d37fe700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91b4018770 0x7f91b401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:24.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.998+0000 7f91d37fe700 1 -- 172.21.15.80:0/1255586585 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5754+0+0 (secure 0 0 0) 0x7f91cc031a30 con 0x7f91dc155060 2019-11-28T11:54:24.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.999+0000 7f91dad9d700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91b4018770 0x7f91b401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:24.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:23.999+0000 7f91dad9d700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91b4018770 0x7f91b401abe0 crc :-1 s=READY pgs=1061 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:24.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.006+0000 7f91e085f700 1 -- 172.21.15.80:0/1255586585 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91dc103760 con 0x7f91dc155060 2019-11-28T11:54:24.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.010+0000 7f91da59c700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc155060 0x7f91dc1554f0 secure :-1 s=THROTTLE_DONE pgs=1559 cs=0 l=1 rx=0x7f91cc010390 tx=0x7f91cc00b360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:24.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.010+0000 7f91d37fe700 1 -- 172.21.15.80:0/1255586585 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f91cc009840 con 0x7f91dc155060 2019-11-28T11:54:24.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.176+0000 7f91e085f700 1 -- 172.21.15.80:0/1255586585 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f91dc103ae0 con 0x7f91dc155060 2019-11-28T11:54:24.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.830+0000 7f91da59c700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc155060 0x7f91dc1554f0 secure :-1 s=THROTTLE_DONE pgs=1559 cs=0 l=1 rx=0x7f91cc010390 tx=0x7f91cc00b360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:24.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.830+0000 7f91d37fe700 1 -- 172.21.15.80:0/1255586585 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v198) v1 ==== 173+0+0 (secure 0 0 0) 0x7f91cc009e00 con 0x7f91dc155060 2019-11-28T11:54:24.897 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:54:24.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.843+0000 7f91e085f700 1 -- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91b4018770 msgr2=0x7f91b401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:24.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.843+0000 7f91e085f700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91b4018770 0x7f91b401abe0 crc :-1 s=READY pgs=1061 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.843+0000 7f91e085f700 1 -- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc155060 msgr2=0x7f91dc1554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.843+0000 7f91e085f700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc155060 0x7f91dc1554f0 secure :-1 s=READY pgs=1559 cs=0 l=1 rx=0x7f91cc010390 tx=0x7f91cc00b360).stop 2019-11-28T11:54:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.843+0000 7f91e085f700 1 -- 172.21.15.80:0/1255586585 shutdown_connections 2019-11-28T11:54:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.843+0000 7f91e085f700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f91b4018770 0x7f91b401abe0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.843+0000 7f91e085f700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc155a30 0x7f91dc12d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:24.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.843+0000 7f91e085f700 1 --2- 172.21.15.80:0/1255586585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc155060 0x7f91dc1554f0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:24.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.843+0000 7f91e085f700 1 -- 172.21.15.80:0/1255586585 shutdown_connections 2019-11-28T11:54:24.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.843+0000 7f91e085f700 1 -- 172.21.15.80:0/1255586585 wait complete. 2019-11-28T11:54:24.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.843+0000 7f91e085f700 1 -- 172.21.15.80:0/1255586585 >> 172.21.15.80:0/1255586585 conn(0x7f91dc07c4f0 msgr2=0x7f91dc15ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:24.910 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:54:25.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.979+0000 7f90290b1700 1 Processor -- start 2019-11-28T11:54:25.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.979+0000 7f90290b1700 1 -- start start 2019-11-28T11:54:25.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.980+0000 7f90290b1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902406c0a0 0x7f9024072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:25.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.980+0000 7f90290b1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9024072620 0x7f9024164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:25.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.980+0000 7f90290b1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902406db00 con 0x7f90240734e0 2019-11-28T11:54:25.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.980+0000 7f90290b1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902406f330 con 0x7f9024072620 2019-11-28T11:54:25.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.980+0000 7f90290b1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90240706c0 con 0x7f902406c0a0 2019-11-28T11:54:25.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.980+0000 7f90288b0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9024072620 0x7f9024164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:25.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.980+0000 7f902359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902406c0a0 0x7f9024072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:25.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.980+0000 7f90288b0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9024072620 0x7f9024164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:60152/0 (socket says 172.21.15.80:60152) 2019-11-28T11:54:25.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.980+0000 7f902359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902406c0a0 0x7f9024072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:47524/0 (socket says 172.21.15.80:47524) 2019-11-28T11:54:25.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.980+0000 7f90288b0700 1 -- 172.21.15.80:0/2713982332 learned_addr learned my addr 172.21.15.80:0/2713982332 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:25.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.980+0000 7f90288b0700 1 -- 172.21.15.80:0/2713982332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902406c0a0 msgr2=0x7f9024072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:25.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.980+0000 7f90288b0700 1 --2- 172.21.15.80:0/2713982332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902406c0a0 0x7f9024072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:25.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.980+0000 7f90288b0700 1 -- 172.21.15.80:0/2713982332 >> v1:172.21.15.174:6789/0 conn(0x7f90240734e0 legacy=0x7f9024071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:25.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.980+0000 7f90288b0700 1 -- 172.21.15.80:0/2713982332 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9024070a40 con 0x7f9024072620 2019-11-28T11:54:25.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.980+0000 7f902359e700 1 --2- 172.21.15.80:0/2713982332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902406c0a0 0x7f9024072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:25.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.980+0000 7f90288b0700 1 --2- 172.21.15.80:0/2713982332 >> v2:172.21.15.174:3300/0 conn(0x7f9024072620 0x7f9024164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f901c00f760 tx=0x7f901c00fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:25.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.981+0000 7f90288b0700 1 --2- 172.21.15.80:0/2713982332 >> v2:172.21.15.174:3300/0 conn(0x7f9024072620 0x7f9024164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f901c00f760 tx=0x7f901c00fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:25.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.981+0000 7f90288b0700 1 --2- 172.21.15.80:0/2713982332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9024072620 0x7f9024164d70 secure :-1 s=READY pgs=1561 cs=0 l=1 rx=0x7f901c00f760 tx=0x7f901c00fb00).ready entity=mon.1 client_cookie=2a719df768adfee1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:25.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.981+0000 7f90288b0700 1 --2- 172.21.15.80:0/2713982332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9024072620 0x7f9024164d70 secure :-1 s=THROTTLE_DONE pgs=1561 cs=0 l=1 rx=0x7f901c00f760 tx=0x7f901c00fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:25.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.981+0000 7f90288b0700 1 --2- 172.21.15.80:0/2713982332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9024072620 0x7f9024164d70 secure :-1 s=THROTTLE_DONE pgs=1561 cs=0 l=1 rx=0x7f901c00f760 tx=0x7f901c00fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:25.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.981+0000 7f902259c700 1 -- 172.21.15.80:0/2713982332 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f901c000a70 con 0x7f9024072620 2019-11-28T11:54:25.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.981+0000 7f90288b0700 1 --2- 172.21.15.80:0/2713982332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9024072620 0x7f9024164d70 secure :-1 s=THROTTLE_DONE pgs=1561 cs=0 l=1 rx=0x7f901c00f760 tx=0x7f901c00fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:25.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.981+0000 7f902259c700 1 -- 172.21.15.80:0/2713982332 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c000e70 con 0x7f9024072620 2019-11-28T11:54:25.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.981+0000 7f902259c700 1 -- 172.21.15.80:0/2713982332 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f901c001500 con 0x7f9024072620 2019-11-28T11:54:25.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.981+0000 7f90290b1700 1 -- 172.21.15.80:0/2713982332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9024072620 msgr2=0x7f9024164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:25.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.981+0000 7f90290b1700 1 --2- 172.21.15.80:0/2713982332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9024072620 0x7f9024164d70 secure :-1 s=READY pgs=1561 cs=0 l=1 rx=0x7f901c00f760 tx=0x7f901c00fb00).stop 2019-11-28T11:54:25.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.981+0000 7f90290b1700 1 -- 172.21.15.80:0/2713982332 shutdown_connections 2019-11-28T11:54:25.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.981+0000 7f90290b1700 1 --2- 172.21.15.80:0/2713982332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9024072620 0x7f9024164d70 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:25.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.981+0000 7f90290b1700 1 --2- 172.21.15.80:0/2713982332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902406c0a0 0x7f9024072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:25.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.982+0000 7f90290b1700 1 -- 172.21.15.80:0/2713982332 shutdown_connections 2019-11-28T11:54:25.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.982+0000 7f90290b1700 1 -- 172.21.15.80:0/2713982332 wait complete. 2019-11-28T11:54:25.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.982+0000 7f90290b1700 1 -- 172.21.15.80:0/2713982332 >> 172.21.15.80:0/2713982332 conn(0x7f9024061cf0 msgr2=0x7f9024064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:25.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.984+0000 7f90290b1700 1 Processor -- start 2019-11-28T11:54:25.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.984+0000 7f90290b1700 1 -- start start 2019-11-28T11:54:25.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.985+0000 7f90290b1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902413e9e0 0x7f9024108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:25.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.985+0000 7f90290b1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90241066e0 con 0x7f9024109430 2019-11-28T11:54:25.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.985+0000 7f90290b1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902410ce40 con 0x7f902413e5f0 2019-11-28T11:54:25.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.985+0000 7f90290b1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902410e060 con 0x7f902413e9e0 2019-11-28T11:54:25.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.985+0000 7f90288b0700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9024109430 0x7f9024168ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44590/0 (socket says 172.21.15.80:44590) 2019-11-28T11:54:25.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.985+0000 7f90288b0700 1 -- 172.21.15.80:0/1817704070 learned_addr learned my addr 172.21.15.80:0/1817704070 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:25.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.985+0000 7f9022d9d700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902413e9e0 0x7f9024108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:25.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.985+0000 7f901bfff700 1 -- 172.21.15.80:0/1817704070 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293651444 0 0) 0x7f901c008080 con 0x7f9024109430 2019-11-28T11:54:25.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.985+0000 7f901bfff700 1 -- 172.21.15.80:0/1817704070 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ffc002e80 con 0x7f9024109430 2019-11-28T11:54:25.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.985+0000 7f901bfff700 1 -- 172.21.15.80:0/1817704070 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644217287 0 0) 0x7f9014000f30 con 0x7f902413e5f0 2019-11-28T11:54:25.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.985+0000 7f901bfff700 1 -- 172.21.15.80:0/1817704070 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ffc0030b0 con 0x7f902413e5f0 2019-11-28T11:54:25.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.985+0000 7f9022d9d700 1 -- 172.21.15.80:0/1817704070 >> v1:172.21.15.174:6789/0 conn(0x7f902413e5f0 legacy=0x7f902410a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:25.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.986+0000 7f9022d9d700 1 -- 172.21.15.80:0/1817704070 >> v1:172.21.15.80:6789/0 conn(0x7f9024109430 legacy=0x7f9024168ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:25.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.986+0000 7f9022d9d700 1 -- 172.21.15.80:0/1817704070 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902410e9c0 con 0x7f902413e9e0 2019-11-28T11:54:25.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.986+0000 7f9022d9d700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902413e9e0 0x7f9024108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:25.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.986+0000 7f9022d9d700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902413e9e0 0x7f9024108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:25.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.986+0000 7f9022d9d700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902413e9e0 0x7f9024108ef0 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:25.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.986+0000 7f9022d9d700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902413e9e0 0x7f9024108ef0 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:25.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.986+0000 7f901bfff700 1 -- 172.21.15.80:0/1817704070 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f900c009fe0 con 0x7f902413e9e0 2019-11-28T11:54:25.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.986+0000 7f9022d9d700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902413e9e0 0x7f9024108ef0 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:25.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.986+0000 7f901bfff700 1 -- 172.21.15.80:0/1817704070 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c009c00 con 0x7f902413e9e0 2019-11-28T11:54:25.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.986+0000 7f90290b1700 1 -- 172.21.15.80:0/1817704070 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902410ed40 con 0x7f902413e9e0 2019-11-28T11:54:25.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.986+0000 7f9022d9d700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902413e9e0 0x7f9024108ef0 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:25.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.986+0000 7f901bfff700 1 -- 172.21.15.80:0/1817704070 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f900c009df0 con 0x7f902413e9e0 2019-11-28T11:54:25.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.986+0000 7f90290b1700 1 -- 172.21.15.80:0/1817704070 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902410e9c0 con 0x7f902413e9e0 2019-11-28T11:54:25.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.986+0000 7f9022d9d700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902413e9e0 0x7f9024108ef0 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:25.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.987+0000 7f901bfff700 1 -- 172.21.15.80:0/1817704070 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f900c009df0 con 0x7f902413e9e0 2019-11-28T11:54:25.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.987+0000 7f9022d9d700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902413e9e0 0x7f9024108ef0 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:25.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.987+0000 7f901bfff700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ffc018750 0x7f8ffc01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:25.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.987+0000 7f901bfff700 1 -- 172.21.15.80:0/1817704070 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5372+0+0 (secure 0 0 0) 0x7f900c031e30 con 0x7f902413e9e0 2019-11-28T11:54:25.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.987+0000 7f902359e700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ffc018750 0x7f8ffc01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:25.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.987+0000 7f902359e700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ffc018750 0x7f8ffc01abe0 crc :-1 s=READY pgs=1062 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:25.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.994+0000 7f90290b1700 1 -- 172.21.15.80:0/1817704070 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902410ed40 con 0x7f902413e9e0 2019-11-28T11:54:25.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.998+0000 7f9022d9d700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902413e9e0 0x7f9024108ef0 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:25.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:24.998+0000 7f901bfff700 1 -- 172.21.15.80:0/1817704070 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f900c000d20 con 0x7f902413e9e0 2019-11-28T11:54:25.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.187+0000 7f90290b1700 1 -- 172.21.15.80:0/1817704070 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f902410e9c0 con 0x7f902413e9e0 2019-11-28T11:54:25.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.839+0000 7f9022d9d700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902413e9e0 0x7f9024108ef0 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:25.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.839+0000 7f901bfff700 1 -- 172.21.15.80:0/1817704070 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v199) v1 ==== 97+0+0 (secure 0 0 0) 0x7f900c009dd0 con 0x7f902413e9e0 2019-11-28T11:54:25.909 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:54:25.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.856+0000 7f90290b1700 1 -- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ffc018750 msgr2=0x7f8ffc01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:25.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.856+0000 7f90290b1700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ffc018750 0x7f8ffc01abe0 crc :-1 s=READY pgs=1062 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:25.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.856+0000 7f90290b1700 1 -- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902413e9e0 msgr2=0x7f9024108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:25.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.856+0000 7f90290b1700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902413e9e0 0x7f9024108ef0 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7f900c010720 tx=0x7f900c010ac0).stop 2019-11-28T11:54:25.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.856+0000 7f90290b1700 1 -- 172.21.15.80:0/1817704070 shutdown_connections 2019-11-28T11:54:25.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.856+0000 7f90290b1700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f902413e9e0 0x7f9024108ef0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:25.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.856+0000 7f90290b1700 1 --2- 172.21.15.80:0/1817704070 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ffc018750 0x7f8ffc01abe0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:25.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.856+0000 7f90290b1700 1 -- 172.21.15.80:0/1817704070 shutdown_connections 2019-11-28T11:54:25.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.856+0000 7f90290b1700 1 -- 172.21.15.80:0/1817704070 wait complete. 2019-11-28T11:54:25.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.856+0000 7f90290b1700 1 -- 172.21.15.80:0/1817704070 >> 172.21.15.80:0/1817704070 conn(0x7f902413d620 msgr2=0x7f902413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:25.923 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:54:25.923 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:54:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.991+0000 7fea02f6d700 1 Processor -- start 2019-11-28T11:54:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.991+0000 7fea02f6d700 1 -- start start 2019-11-28T11:54:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.992+0000 7fea02f6d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9fc06c0a0 0x7fe9fc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.992+0000 7fea02f6d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe9fc0734e0 0x7fe9fc071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.992+0000 7fea02f6d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9fc06db00 con 0x7fe9fc072360 2019-11-28T11:54:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.992+0000 7fea02f6d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc06fd60 con 0x7fe9fc06c0a0 2019-11-28T11:54:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.992+0000 7fea02f6d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc070030 con 0x7fe9fc0734e0 2019-11-28T11:54:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea0150a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9fc06c0a0 0x7fe9fc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea0150a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9fc06c0a0 0x7fe9fc072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45278/0 (socket says 172.21.15.80:45278) 2019-11-28T11:54:26.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea01d0b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe9fc072360 0x7fe9fc06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44596/0 (socket says 172.21.15.80:44596) 2019-11-28T11:54:26.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea0150a700 1 -- 172.21.15.80:0/570575640 learned_addr learned my addr 172.21.15.80:0/570575640 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:26.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea00d09700 1 --2- 172.21.15.80:0/570575640 >> v2:172.21.15.174:3300/0 conn(0x7fe9fc0734e0 0x7fe9fc071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea0150a700 1 -- 172.21.15.80:0/570575640 >> v2:172.21.15.174:3300/0 conn(0x7fe9fc0734e0 msgr2=0x7fe9fc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:26.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea0150a700 1 --2- 172.21.15.80:0/570575640 >> v2:172.21.15.174:3300/0 conn(0x7fe9fc0734e0 0x7fe9fc071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:26.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea0150a700 1 -- 172.21.15.80:0/570575640 >> v1:172.21.15.80:6789/0 conn(0x7fe9fc072360 legacy=0x7fe9fc06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea0150a700 1 -- 172.21.15.80:0/570575640 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc0706c0 con 0x7fe9fc06c0a0 2019-11-28T11:54:26.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fe9fbfff700 1 -- 172.21.15.80:0/570575640 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521011962 0 0) 0x7fe9f4000d30 con 0x7fe9fc072360 2019-11-28T11:54:26.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea0150a700 1 --2- 172.21.15.80:0/570575640 >> v2:172.21.15.80:3300/0 conn(0x7fe9fc06c0a0 0x7fe9fc072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe9ec00f6c0 tx=0x7fe9ec00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea0150a700 1 --2- 172.21.15.80:0/570575640 >> v2:172.21.15.80:3300/0 conn(0x7fe9fc06c0a0 0x7fe9fc072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe9ec00f6c0 tx=0x7fe9ec00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea0150a700 1 --2- 172.21.15.80:0/570575640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc06c0a0 0x7fe9fc072fa0 secure :-1 s=READY pgs=2582 cs=0 l=1 rx=0x7fe9ec00f6c0 tx=0x7fe9ec00fa60).ready entity=mon.0 client_cookie=2a457b62c639c0a1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:26.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea0150a700 1 --2- 172.21.15.80:0/570575640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc06c0a0 0x7fe9fc072fa0 secure :-1 s=THROTTLE_DONE pgs=2582 cs=0 l=1 rx=0x7fe9ec00f6c0 tx=0x7fe9ec00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fe9fbfff700 1 -- 172.21.15.80:0/570575640 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9ec000960 con 0x7fe9fc06c0a0 2019-11-28T11:54:26.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea0150a700 1 --2- 172.21.15.80:0/570575640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc06c0a0 0x7fe9fc072fa0 secure :-1 s=THROTTLE_DONE pgs=2582 cs=0 l=1 rx=0x7fe9ec00f6c0 tx=0x7fe9ec00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea0150a700 1 --2- 172.21.15.80:0/570575640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc06c0a0 0x7fe9fc072fa0 secure :-1 s=THROTTLE_DONE pgs=2582 cs=0 l=1 rx=0x7fe9ec00f6c0 tx=0x7fe9ec00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fe9fbfff700 1 -- 172.21.15.80:0/570575640 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec007210 con 0x7fe9fc06c0a0 2019-11-28T11:54:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fe9fbfff700 1 -- 172.21.15.80:0/570575640 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9ec000e80 con 0x7fe9fc06c0a0 2019-11-28T11:54:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea02f6d700 1 -- 172.21.15.80:0/570575640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc06c0a0 msgr2=0x7fe9fc072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.993+0000 7fea02f6d700 1 --2- 172.21.15.80:0/570575640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc06c0a0 0x7fe9fc072fa0 secure :-1 s=READY pgs=2582 cs=0 l=1 rx=0x7fe9ec00f6c0 tx=0x7fe9ec00fa60).stop 2019-11-28T11:54:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.994+0000 7fea02f6d700 1 -- 172.21.15.80:0/570575640 shutdown_connections 2019-11-28T11:54:26.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.994+0000 7fea02f6d700 1 --2- 172.21.15.80:0/570575640 >> v2:172.21.15.174:3300/0 conn(0x7fe9fc0734e0 0x7fe9fc071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:26.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.994+0000 7fea02f6d700 1 --2- 172.21.15.80:0/570575640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc06c0a0 0x7fe9fc072fa0 unknown :-1 s=CLOSED pgs=2582 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.994+0000 7fea02f6d700 1 -- 172.21.15.80:0/570575640 shutdown_connections 2019-11-28T11:54:26.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.994+0000 7fea02f6d700 1 -- 172.21.15.80:0/570575640 wait complete. 2019-11-28T11:54:26.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.994+0000 7fea02f6d700 1 -- 172.21.15.80:0/570575640 >> 172.21.15.80:0/570575640 conn(0x7fe9fc061cf0 msgr2=0x7fe9fc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:26.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.997+0000 7fea02f6d700 1 Processor -- start 2019-11-28T11:54:26.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.997+0000 7fea02f6d700 1 -- start start 2019-11-28T11:54:26.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea02f6d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9fc10adf0 0x7fe9fc1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:26.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea02f6d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9fc076200 0x7fe9fc112e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:26.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea02f6d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9fc076670 con 0x7fe9fc1597f0 2019-11-28T11:54:26.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea02f6d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc073960 con 0x7fe9fc076200 2019-11-28T11:54:26.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea02f6d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0742c0 con 0x7fe9fc10adf0 2019-11-28T11:54:26.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea01d0b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9fc076200 0x7fe9fc112e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea01d0b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe9fc076200 0x7fe9fc112e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45288/0 (socket says 172.21.15.80:45288) 2019-11-28T11:54:26.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea00d09700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe9fc1597f0 0x7fe9fc075a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44602/0 (socket says 172.21.15.80:44602) 2019-11-28T11:54:26.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea01d0b700 1 -- 172.21.15.80:0/1022133722 learned_addr learned my addr 172.21.15.80:0/1022133722 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:26.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea0150a700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9fc10adf0 0x7fe9fc1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea01d0b700 1 -- 172.21.15.80:0/1022133722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9fc10adf0 msgr2=0x7fe9fc1592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea01d0b700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9fc10adf0 0x7fe9fc1592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea01d0b700 1 -- 172.21.15.80:0/1022133722 >> v1:172.21.15.80:6789/0 conn(0x7fe9fc1597f0 legacy=0x7fe9fc075a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea01d0b700 1 -- 172.21.15.80:0/1022133722 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc074640 con 0x7fe9fc076200 2019-11-28T11:54:26.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fe9f9ffb700 1 -- 172.21.15.80:0/1022133722 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963374715 0 0) 0x7fe9f00099a0 con 0x7fe9fc1597f0 2019-11-28T11:54:26.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea01d0b700 1 --2- 172.21.15.80:0/1022133722 >> v2:172.21.15.80:3300/0 conn(0x7fe9fc076200 0x7fe9fc112e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9f4010760 tx=0x7fe9f40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea01d0b700 1 --2- 172.21.15.80:0/1022133722 >> v2:172.21.15.80:3300/0 conn(0x7fe9fc076200 0x7fe9fc112e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9f4010760 tx=0x7fe9f40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea01d0b700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc076200 0x7fe9fc112e40 secure :-1 s=READY pgs=2584 cs=0 l=1 rx=0x7fe9f4010760 tx=0x7fe9f40105e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:26.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea01d0b700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc076200 0x7fe9fc112e40 secure :-1 s=THROTTLE_DONE pgs=2584 cs=0 l=1 rx=0x7fe9f4010760 tx=0x7fe9f40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fe9f9ffb700 1 -- 172.21.15.80:0/1022133722 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f4000cc0 con 0x7fe9fc076200 2019-11-28T11:54:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea01d0b700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc076200 0x7fe9fc112e40 secure :-1 s=THROTTLE_DONE pgs=2584 cs=0 l=1 rx=0x7fe9f4010760 tx=0x7fe9f40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fe9f9ffb700 1 -- 172.21.15.80:0/1022133722 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f4007950 con 0x7fe9fc076200 2019-11-28T11:54:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea02f6d700 1 -- 172.21.15.80:0/1022133722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9fc074640 con 0x7fe9fc076200 2019-11-28T11:54:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea01d0b700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc076200 0x7fe9fc112e40 secure :-1 s=THROTTLE_DONE pgs=2584 cs=0 l=1 rx=0x7fe9f4010760 tx=0x7fe9f40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fe9f9ffb700 1 -- 172.21.15.80:0/1022133722 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f4000cc0 con 0x7fe9fc076200 2019-11-28T11:54:26.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.998+0000 7fea02f6d700 1 -- 172.21.15.80:0/1022133722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9fc074640 con 0x7fe9fc076200 2019-11-28T11:54:26.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.999+0000 7fea01d0b700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc076200 0x7fe9fc112e40 secure :-1 s=THROTTLE_DONE pgs=2584 cs=0 l=1 rx=0x7fe9f4010760 tx=0x7fe9f40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.999+0000 7fe9f9ffb700 1 -- 172.21.15.80:0/1022133722 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe9f4001270 con 0x7fe9fc076200 2019-11-28T11:54:26.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.999+0000 7fea01d0b700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc076200 0x7fe9fc112e40 secure :-1 s=THROTTLE_DONE pgs=2584 cs=0 l=1 rx=0x7fe9f4010760 tx=0x7fe9f40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.999+0000 7fe9f9ffb700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe9dc018730 0x7fe9dc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:26.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.999+0000 7fe9f9ffb700 1 -- 172.21.15.80:0/1022133722 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fe9f4031e00 con 0x7fe9fc076200 2019-11-28T11:54:26.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.999+0000 7fea0150a700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe9dc018730 0x7fe9dc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:25.999+0000 7fea0150a700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe9dc018730 0x7fe9dc01abc0 crc :-1 s=READY pgs=1063 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:26.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.007+0000 7fea02f6d700 1 -- 172.21.15.80:0/1022133722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9fc074640 con 0x7fe9fc076200 2019-11-28T11:54:26.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.010+0000 7fea01d0b700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc076200 0x7fe9fc112e40 secure :-1 s=THROTTLE_DONE pgs=2584 cs=0 l=1 rx=0x7fe9f4010760 tx=0x7fe9f40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.010+0000 7fe9f9ffb700 1 -- 172.21.15.80:0/1022133722 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe9f402cf00 con 0x7fe9fc076200 2019-11-28T11:54:26.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.180+0000 7fea02f6d700 1 -- 172.21.15.80:0/1022133722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe9fc074640 con 0x7fe9fc076200 2019-11-28T11:54:26.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.180+0000 7fea01d0b700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc076200 0x7fe9fc112e40 secure :-1 s=THROTTLE_DONE pgs=2584 cs=0 l=1 rx=0x7fe9f4010760 tx=0x7fe9f40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.180+0000 7fe9f9ffb700 1 -- 172.21.15.80:0/1022133722 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v67) v1 ==== 80+0+4797 (secure 0 0 0) 0x7fe9f402cf00 con 0x7fe9fc076200 2019-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.238 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:54:26.238 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:54:26.238 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:54:26.238 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:54:26.238 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.239 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:54:26.239 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:54:26.239 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.239 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:54:26.239 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:54:26.239 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:54:26.239 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:54:26.240 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.240 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:54:26.240 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:54:26.240 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.240 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:54:26.241 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:54:26.241 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:54:26.241 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:54:26.241 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.241 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.243 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:54:26.243 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:54:26.243 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.243 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:54:26.243 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:54:26.243 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:54:26.243 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.244 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:54:26.244 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:54:26.244 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.244 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:54:26.244 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:54:26.245 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:54:26.245 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.245 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:54:26.245 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:54:26.245 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.246 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:54:26.246 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:54:26.246 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:54:26.246 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.246 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:54:26.247 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:54:26.247 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.247 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:54:26.247 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:54:26.247 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:54:26.247 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.248 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:54:26.248 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:54:26.248 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.248 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:54:26.248 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:54:26.248 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:54:26.249 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.249 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:54:26.249 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:54:26.249 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.250 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:54:26.250 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:54:26.250 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:54:26.250 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.250 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:54:26.251 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:54:26.251 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.251 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:54:26.251 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:54:26.251 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:54:26.251 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.252 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:54:26.252 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:54:26.252 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.252 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:54:26.252 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:54:26.253 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:54:26.253 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.268 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:54:26.269 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:54:26.269 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.269 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:54:26.269 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:54:26.269 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:54:26.269 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.270 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:54:26.270 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:54:26.270 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.270 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:54:26.270 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:54:26.270 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:54:26.271 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.271 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:54:26.271 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:54:26.271 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.271 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:54:26.271 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:54:26.272 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:54:26.272 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.272 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:54:26.272 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:54:26.272 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.273 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:54:26.273 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:54:26.273 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:54:26.284 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:54:26.284 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.284 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:54:26.285 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:54:26.285 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.285 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:54:26.285 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:54:26.286 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:54:26.286 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:54:26.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:26.286 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:54:26.286 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:54:26.286 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:54:26.286 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:54:26.287 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:54:26.287 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:54:26.287 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.287 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:26.287 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:54:26.287 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:54:26.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.183+0000 7fea02f6d700 1 -- 172.21.15.80:0/1022133722 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe9dc018730 msgr2=0x7fe9dc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.183+0000 7fea02f6d700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe9dc018730 0x7fe9dc01abc0 crc :-1 s=READY pgs=1063 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.183+0000 7fea02f6d700 1 -- 172.21.15.80:0/1022133722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc076200 msgr2=0x7fe9fc112e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.183+0000 7fea02f6d700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc076200 0x7fe9fc112e40 secure :-1 s=READY pgs=2584 cs=0 l=1 rx=0x7fe9f4010760 tx=0x7fe9f40105e0).stop 2019-11-28T11:54:26.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.183+0000 7fea02f6d700 1 -- 172.21.15.80:0/1022133722 shutdown_connections 2019-11-28T11:54:26.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.183+0000 7fea02f6d700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe9dc018730 0x7fe9dc01abc0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.183+0000 7fea02f6d700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe9fc076200 0x7fe9fc112e40 unknown :-1 s=CLOSED pgs=2584 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.183+0000 7fea02f6d700 1 --2- 172.21.15.80:0/1022133722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9fc10adf0 0x7fe9fc1592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.183+0000 7fea02f6d700 1 -- 172.21.15.80:0/1022133722 shutdown_connections 2019-11-28T11:54:26.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.183+0000 7fea02f6d700 1 -- 172.21.15.80:0/1022133722 wait complete. 2019-11-28T11:54:26.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.183+0000 7fea02f6d700 1 -- 172.21.15.80:0/1022133722 >> 172.21.15.80:0/1022133722 conn(0x7fe9fc13d930 msgr2=0x7fe9fc111550 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:26.293 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:54:26.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.369+0000 7ff95ab9f700 1 Processor -- start 2019-11-28T11:54:26.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.369+0000 7ff95ab9f700 1 -- start start 2019-11-28T11:54:26.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.370+0000 7ff95ab9f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95406d120 0x7ff954165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:26.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.370+0000 7ff95ab9f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff95406d580 con 0x7ff95406c0a0 2019-11-28T11:54:26.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.370+0000 7ff95ab9f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff95406db00 con 0x7ff95406c490 2019-11-28T11:54:26.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.370+0000 7ff95ab9f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95406fd60 con 0x7ff95406d120 2019-11-28T11:54:26.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.370+0000 7ff95913c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff95406c0a0 0x7ff954072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44608/0 (socket says 172.21.15.80:44608) 2019-11-28T11:54:26.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.370+0000 7ff95913c700 1 -- 172.21.15.80:0/1166611725 learned_addr learned my addr 172.21.15.80:0/1166611725 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:26.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.370+0000 7ff95993d700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95406d120 0x7ff954165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.370+0000 7ff953fff700 1 -- 172.21.15.80:0/1166611725 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368081108 0 0) 0x7ff9440014d0 con 0x7ff95406c0a0 2019-11-28T11:54:26.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.370+0000 7ff953fff700 1 -- 172.21.15.80:0/1166611725 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff940002e80 con 0x7ff95406c0a0 2019-11-28T11:54:26.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff953fff700 1 -- 172.21.15.80:0/1166611725 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 883611303 0 0) 0x7ff9440014b0 con 0x7ff95406c0a0 2019-11-28T11:54:26.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff953fff700 1 -- 172.21.15.80:0/1166611725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95406d120 msgr2=0x7ff954165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:26.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff953fff700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff95406d120 0x7ff954165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:26.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff953fff700 1 -- 172.21.15.80:0/1166611725 >> v1:172.21.15.174:6789/0 conn(0x7ff95406c490 legacy=0x7ff95406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff953fff700 1 -- 172.21.15.80:0/1166611725 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540706c0 con 0x7ff95406c0a0 2019-11-28T11:54:26.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff953fff700 1 -- 172.21.15.80:0/1166611725 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff944001a40 con 0x7ff95406c0a0 2019-11-28T11:54:26.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff953fff700 1 -- 172.21.15.80:0/1166611725 >> v1:172.21.15.80:6789/0 conn(0x7ff95406c0a0 legacy=0x7ff954072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff953fff700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff940003ab0 0x7ff940005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:26.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff953fff700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff940006640 0x7ff940008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:26.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff953fff700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff940009310 0x7ff94000b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:26.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff953fff700 1 -- 172.21.15.80:0/1166611725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94000bff0 con 0x7ff940009310 2019-11-28T11:54:26.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff953fff700 1 -- 172.21.15.80:0/1166611725 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9400501f0 con 0x7ff940006640 2019-11-28T11:54:26.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff953fff700 1 -- 172.21.15.80:0/1166611725 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff940050420 con 0x7ff940003ab0 2019-11-28T11:54:26.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95993d700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff940009310 0x7ff94000b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95913c700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff940003ab0 0x7ff940005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95893b700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff940006640 0x7ff940008b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95993d700 1 -- 172.21.15.80:0/1166611725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff940003ab0 msgr2=0x7ff940005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:26.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95993d700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff940003ab0 0x7ff940005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:26.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95993d700 1 -- 172.21.15.80:0/1166611725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff940006640 msgr2=0x7ff940008b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:26.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95993d700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff940006640 0x7ff940008b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:26.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95993d700 1 -- 172.21.15.80:0/1166611725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9400506d0 con 0x7ff940009310 2019-11-28T11:54:26.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95913c700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff940003ab0 0x7ff940005f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:26.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95893b700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff940006640 0x7ff940008b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:26.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95993d700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff940009310 0x7ff94000b7e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff94c002a20 tx=0x7ff94c002dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95993d700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff940009310 0x7ff94000b7e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff94c002a20 tx=0x7ff94c002dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95993d700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff940009310 0x7ff94000b7e0 secure :-1 s=READY pgs=2586 cs=0 l=1 rx=0x7ff94c002a20 tx=0x7ff94c002dc0).ready entity=mon.0 client_cookie=6d2e5240c37c8061 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:26.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95993d700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff940009310 0x7ff94000b7e0 secure :-1 s=THROTTLE_DONE pgs=2586 cs=0 l=1 rx=0x7ff94c002a20 tx=0x7ff94c002dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff953fff700 1 -- 172.21.15.80:0/1166611725 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff94c000a70 con 0x7ff940009310 2019-11-28T11:54:26.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95993d700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff940009310 0x7ff94000b7e0 secure :-1 s=THROTTLE_DONE pgs=2586 cs=0 l=1 rx=0x7ff94c002a20 tx=0x7ff94c002dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95993d700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff940009310 0x7ff94000b7e0 secure :-1 s=THROTTLE_DONE pgs=2586 cs=0 l=1 rx=0x7ff94c002a20 tx=0x7ff94c002dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff953fff700 1 -- 172.21.15.80:0/1166611725 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c00ec90 con 0x7ff940009310 2019-11-28T11:54:26.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff953fff700 1 -- 172.21.15.80:0/1166611725 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff94c00f3a0 con 0x7ff940009310 2019-11-28T11:54:26.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95ab9f700 1 -- 172.21.15.80:0/1166611725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff940009310 msgr2=0x7ff94000b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95ab9f700 1 --2- 172.21.15.80:0/1166611725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff940009310 0x7ff94000b7e0 secure :-1 s=READY pgs=2586 cs=0 l=1 rx=0x7ff94c002a20 tx=0x7ff94c002dc0).stop 2019-11-28T11:54:26.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.371+0000 7ff95993d700 1 -- 172.21.15.80:0/1166611725 reap_dead start 2019-11-28T11:54:26.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.372+0000 7ff95ab9f700 1 -- 172.21.15.80:0/1166611725 shutdown_connections 2019-11-28T11:54:26.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.372+0000 7ff95ab9f700 1 -- 172.21.15.80:0/1166611725 shutdown_connections 2019-11-28T11:54:26.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.372+0000 7ff95ab9f700 1 -- 172.21.15.80:0/1166611725 wait complete. 2019-11-28T11:54:26.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.372+0000 7ff95ab9f700 1 -- 172.21.15.80:0/1166611725 >> 172.21.15.80:0/1166611725 conn(0x7ff954061cf0 msgr2=0x7ff954064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:26.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.375+0000 7ff95ab9f700 1 Processor -- start 2019-11-28T11:54:26.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.375+0000 7ff95ab9f700 1 -- start start 2019-11-28T11:54:26.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95ab9f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff954077040 0x7ff9541574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:26.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95ab9f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff954157a00 0x7ff954074a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:26.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95ab9f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff954074f50 0x7ff9540753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:26.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95ab9f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff954137110 con 0x7ff954077040 2019-11-28T11:54:26.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95ab9f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9541373e0 con 0x7ff954157a00 2019-11-28T11:54:26.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95ab9f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9541366e0 con 0x7ff954074f50 2019-11-28T11:54:26.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95913c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff954077040 0x7ff9541574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95913c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff954077040 0x7ff9541574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45304/0 (socket says 172.21.15.80:45304) 2019-11-28T11:54:26.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95913c700 1 -- 172.21.15.80:0/1121543339 learned_addr learned my addr 172.21.15.80:0/1121543339 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:26.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95993d700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff954074f50 0x7ff9540753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95893b700 1 --2- 172.21.15.80:0/1121543339 >> v2:172.21.15.174:3300/0 conn(0x7ff954157a00 0x7ff954074a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95913c700 1 -- 172.21.15.80:0/1121543339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff954074f50 msgr2=0x7ff9540753b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95913c700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff954074f50 0x7ff9540753b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95913c700 1 -- 172.21.15.80:0/1121543339 >> v2:172.21.15.174:3300/0 conn(0x7ff954157a00 msgr2=0x7ff954074a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95913c700 1 --2- 172.21.15.80:0/1121543339 >> v2:172.21.15.174:3300/0 conn(0x7ff954157a00 0x7ff954074a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95913c700 1 -- 172.21.15.80:0/1121543339 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff954137a70 con 0x7ff954077040 2019-11-28T11:54:26.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95993d700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff954074f50 0x7ff9540753b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:26.456 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95893b700 1 --2- 172.21.15.80:0/1121543339 >> v2:172.21.15.174:3300/0 conn(0x7ff954157a00 0x7ff954074a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:26.458 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95913c700 1 --2- 172.21.15.80:0/1121543339 >> v2:172.21.15.80:3300/0 conn(0x7ff954077040 0x7ff9541574c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff9440107b0 tx=0x7ff944010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95913c700 1 --2- 172.21.15.80:0/1121543339 >> v2:172.21.15.80:3300/0 conn(0x7ff954077040 0x7ff9541574c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff9440107b0 tx=0x7ff944010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95913c700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff954077040 0x7ff9541574c0 secure :-1 s=READY pgs=2587 cs=0 l=1 rx=0x7ff9440107b0 tx=0x7ff944010b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:26.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95913c700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff954077040 0x7ff9541574c0 secure :-1 s=THROTTLE_DONE pgs=2587 cs=0 l=1 rx=0x7ff9440107b0 tx=0x7ff944010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95913c700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff954077040 0x7ff9541574c0 secure :-1 s=THROTTLE_DONE pgs=2587 cs=0 l=1 rx=0x7ff9440107b0 tx=0x7ff944010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff951ffb700 1 -- 172.21.15.80:0/1121543339 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9440047b0 con 0x7ff954077040 2019-11-28T11:54:26.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.376+0000 7ff95913c700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff954077040 0x7ff9541574c0 secure :-1 s=THROTTLE_DONE pgs=2587 cs=0 l=1 rx=0x7ff9440107b0 tx=0x7ff944010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.377+0000 7ff951ffb700 1 -- 172.21.15.80:0/1121543339 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff944001010 con 0x7ff954077040 2019-11-28T11:54:26.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.377+0000 7ff95ab9f700 1 -- 172.21.15.80:0/1121543339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff954137df0 con 0x7ff954077040 2019-11-28T11:54:26.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.377+0000 7ff951ffb700 1 -- 172.21.15.80:0/1121543339 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff944004d90 con 0x7ff954077040 2019-11-28T11:54:26.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.377+0000 7ff95ab9f700 1 -- 172.21.15.80:0/1121543339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff954137a70 con 0x7ff954077040 2019-11-28T11:54:26.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.377+0000 7ff95913c700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff954077040 0x7ff9541574c0 secure :-1 s=THROTTLE_DONE pgs=2587 cs=0 l=1 rx=0x7ff9440107b0 tx=0x7ff944010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.377+0000 7ff951ffb700 1 -- 172.21.15.80:0/1121543339 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff9440045c0 con 0x7ff954077040 2019-11-28T11:54:26.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.377+0000 7ff95913c700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff954077040 0x7ff9541574c0 secure :-1 s=THROTTLE_DONE pgs=2587 cs=0 l=1 rx=0x7ff9440107b0 tx=0x7ff944010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.377+0000 7ff951ffb700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff938018730 0x7ff93801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:26.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.377+0000 7ff951ffb700 1 -- 172.21.15.80:0/1121543339 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5200+0+0 (secure 0 0 0) 0x7ff944031d50 con 0x7ff954077040 2019-11-28T11:54:26.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.378+0000 7ff95893b700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff938018730 0x7ff93801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.378+0000 7ff95893b700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff938018730 0x7ff93801abc0 crc :-1 s=READY pgs=1064 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:26.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.384+0000 7ff95ab9f700 1 -- 172.21.15.80:0/1121543339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff954137df0 con 0x7ff954077040 2019-11-28T11:54:26.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.388+0000 7ff95913c700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff954077040 0x7ff9541574c0 secure :-1 s=THROTTLE_DONE pgs=2587 cs=0 l=1 rx=0x7ff9440107b0 tx=0x7ff944010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.388+0000 7ff951ffb700 1 -- 172.21.15.80:0/1121543339 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff94402aee0 con 0x7ff954077040 2019-11-28T11:54:26.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.562+0000 7ff95ab9f700 1 -- 172.21.15.80:0/1121543339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff954137a70 con 0x7ff954077040 2019-11-28T11:54:26.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.563+0000 7ff95913c700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff954077040 0x7ff9541574c0 secure :-1 s=THROTTLE_DONE pgs=2587 cs=0 l=1 rx=0x7ff9440107b0 tx=0x7ff944010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.563+0000 7ff951ffb700 1 -- 172.21.15.80:0/1121543339 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+12010 (secure 0 0 0) 0x7ff94402aee0 con 0x7ff954077040 2019-11-28T11:54:26.619 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:26.619 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":199,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:54:25.829719+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:54:26.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.565+0000 7ff95ab9f700 1 -- 172.21.15.80:0/1121543339 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff938018730 msgr2=0x7ff93801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.565+0000 7ff95ab9f700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff938018730 0x7ff93801abc0 crc :-1 s=READY pgs=1064 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.565+0000 7ff95ab9f700 1 -- 172.21.15.80:0/1121543339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff954077040 msgr2=0x7ff9541574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.565+0000 7ff95ab9f700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff954077040 0x7ff9541574c0 secure :-1 s=READY pgs=2587 cs=0 l=1 rx=0x7ff9440107b0 tx=0x7ff944010b50).stop 2019-11-28T11:54:26.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.565+0000 7ff95ab9f700 1 -- 172.21.15.80:0/1121543339 shutdown_connections 2019-11-28T11:54:26.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.565+0000 7ff95ab9f700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff938018730 0x7ff93801abc0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.565+0000 7ff95ab9f700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff954074f50 0x7ff9540753b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.565+0000 7ff95ab9f700 1 --2- 172.21.15.80:0/1121543339 >> v2:172.21.15.174:3300/0 conn(0x7ff954157a00 0x7ff954074a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.565+0000 7ff95ab9f700 1 --2- 172.21.15.80:0/1121543339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff954077040 0x7ff9541574c0 unknown :-1 s=CLOSED pgs=2587 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.565+0000 7ff95ab9f700 1 -- 172.21.15.80:0/1121543339 shutdown_connections 2019-11-28T11:54:26.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.565+0000 7ff95ab9f700 1 -- 172.21.15.80:0/1121543339 wait complete. 2019-11-28T11:54:26.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.565+0000 7ff95ab9f700 1 -- 172.21.15.80:0/1121543339 >> 172.21.15.80:0/1121543339 conn(0x7ff95413fa50 msgr2=0x7ff95407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:26.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:54:26.635 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:54:26.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.703+0000 7fc1307ca700 1 Processor -- start 2019-11-28T11:54:26.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.703+0000 7fc1307ca700 1 -- start start 2019-11-28T11:54:26.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc1307ca700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc12815f100 0x7fc12806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:26.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc1307ca700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc12806c2f0 0x7fc12806c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:26.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc1307ca700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc12806db60 con 0x7fc12815ed10 2019-11-28T11:54:26.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc1307ca700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12806fe00 con 0x7fc12806c2f0 2019-11-28T11:54:26.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc1307ca700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1280700d0 con 0x7fc12815f100 2019-11-28T11:54:26.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc12f568700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc12806c2f0 0x7fc12806c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc12ed67700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc12815ed10 0x7fc128073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44628/0 (socket says 172.21.15.80:44628) 2019-11-28T11:54:26.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc12ed67700 1 -- 172.21.15.80:0/121337084 learned_addr learned my addr 172.21.15.80:0/121337084 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:26.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc12e566700 1 --2- 172.21.15.80:0/121337084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc12815f100 0x7fc12806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc12dd65700 1 -- 172.21.15.80:0/121337084 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080144515 0 0) 0x7fc1100014d0 con 0x7fc12815ed10 2019-11-28T11:54:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc12dd65700 1 -- 172.21.15.80:0/121337084 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc114002e80 con 0x7fc12815ed10 2019-11-28T11:54:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc12f568700 1 -- 172.21.15.80:0/121337084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc12815f100 msgr2=0x7fc12806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc12f568700 1 --2- 172.21.15.80:0/121337084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc12815f100 0x7fc12806bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc12f568700 1 -- 172.21.15.80:0/121337084 >> v1:172.21.15.80:6789/0 conn(0x7fc12815ed10 legacy=0x7fc128073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc12f568700 1 -- 172.21.15.80:0/121337084 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc128070760 con 0x7fc12806c2f0 2019-11-28T11:54:26.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc12e566700 1 --2- 172.21.15.80:0/121337084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc12815f100 0x7fc12806bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:26.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc12f568700 1 --2- 172.21.15.80:0/121337084 >> v2:172.21.15.80:3300/0 conn(0x7fc12806c2f0 0x7fc12806c790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc11800af50 tx=0x7fc11800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc12f568700 1 --2- 172.21.15.80:0/121337084 >> v2:172.21.15.80:3300/0 conn(0x7fc12806c2f0 0x7fc12806c790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc11800af50 tx=0x7fc11800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc12f568700 1 --2- 172.21.15.80:0/121337084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc12806c2f0 0x7fc12806c790 secure :-1 s=READY pgs=2589 cs=0 l=1 rx=0x7fc11800af50 tx=0x7fc11800b760).ready entity=mon.0 client_cookie=25b0ae05ce1fc80c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:26.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.704+0000 7fc12f568700 1 --2- 172.21.15.80:0/121337084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc12806c2f0 0x7fc12806c790 secure :-1 s=THROTTLE_DONE pgs=2589 cs=0 l=1 rx=0x7fc11800af50 tx=0x7fc11800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.705+0000 7fc12dd65700 1 -- 172.21.15.80:0/121337084 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc118009ba0 con 0x7fc12806c2f0 2019-11-28T11:54:26.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.705+0000 7fc12f568700 1 --2- 172.21.15.80:0/121337084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc12806c2f0 0x7fc12806c790 secure :-1 s=THROTTLE_DONE pgs=2589 cs=0 l=1 rx=0x7fc11800af50 tx=0x7fc11800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.705+0000 7fc12f568700 1 --2- 172.21.15.80:0/121337084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc12806c2f0 0x7fc12806c790 secure :-1 s=THROTTLE_DONE pgs=2589 cs=0 l=1 rx=0x7fc11800af50 tx=0x7fc11800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.705+0000 7fc12dd65700 1 -- 172.21.15.80:0/121337084 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1180097c0 con 0x7fc12806c2f0 2019-11-28T11:54:26.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.705+0000 7fc12dd65700 1 -- 172.21.15.80:0/121337084 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc118000bc0 con 0x7fc12806c2f0 2019-11-28T11:54:26.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.705+0000 7fc1307ca700 1 -- 172.21.15.80:0/121337084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc12806c2f0 msgr2=0x7fc12806c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.705+0000 7fc1307ca700 1 --2- 172.21.15.80:0/121337084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc12806c2f0 0x7fc12806c790 secure :-1 s=READY pgs=2589 cs=0 l=1 rx=0x7fc11800af50 tx=0x7fc11800b760).stop 2019-11-28T11:54:26.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.705+0000 7fc1307ca700 1 -- 172.21.15.80:0/121337084 shutdown_connections 2019-11-28T11:54:26.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.705+0000 7fc1307ca700 1 --2- 172.21.15.80:0/121337084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc12806c2f0 0x7fc12806c790 unknown :-1 s=CLOSED pgs=2589 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.705+0000 7fc1307ca700 1 --2- 172.21.15.80:0/121337084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc12815f100 0x7fc12806bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:26.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.705+0000 7fc1307ca700 1 -- 172.21.15.80:0/121337084 shutdown_connections 2019-11-28T11:54:26.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.705+0000 7fc1307ca700 1 -- 172.21.15.80:0/121337084 wait complete. 2019-11-28T11:54:26.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.705+0000 7fc1307ca700 1 -- 172.21.15.80:0/121337084 >> 172.21.15.80:0/121337084 conn(0x7fc128061d20 msgr2=0x7fc1280641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:26.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.708+0000 7fc1307ca700 1 Processor -- start 2019-11-28T11:54:26.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.708+0000 7fc1307ca700 1 -- start start 2019-11-28T11:54:26.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc1307ca700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc128153890 0x7fc128115020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:26.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc1307ca700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc128115560 0x7fc12812e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:26.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc1307ca700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc12812e670 0x7fc128113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:26.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc1307ca700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc128110bb0 con 0x7fc128153890 2019-11-28T11:54:26.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc1307ca700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc128110e80 con 0x7fc12812e670 2019-11-28T11:54:26.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc1307ca700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc128110180 con 0x7fc128115560 2019-11-28T11:54:26.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12ed67700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc128153890 0x7fc128115020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12ed67700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc128153890 0x7fc128115020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45318/0 (socket says 172.21.15.80:45318) 2019-11-28T11:54:26.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12ed67700 1 -- 172.21.15.80:0/2951699384 learned_addr learned my addr 172.21.15.80:0/2951699384 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:26.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12f568700 1 --2- 172.21.15.80:0/2951699384 >> v2:172.21.15.174:3300/0 conn(0x7fc12812e670 0x7fc128113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12e566700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc128115560 0x7fc12812e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12ed67700 1 -- 172.21.15.80:0/2951699384 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc128115560 msgr2=0x7fc12812e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12ed67700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc128115560 0x7fc12812e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12ed67700 1 -- 172.21.15.80:0/2951699384 >> v2:172.21.15.174:3300/0 conn(0x7fc12812e670 msgr2=0x7fc128113ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12ed67700 1 --2- 172.21.15.80:0/2951699384 >> v2:172.21.15.174:3300/0 conn(0x7fc12812e670 0x7fc128113ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12ed67700 1 -- 172.21.15.80:0/2951699384 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc128112760 con 0x7fc128153890 2019-11-28T11:54:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12e566700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc128115560 0x7fc12812e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12ed67700 1 --2- 172.21.15.80:0/2951699384 >> v2:172.21.15.80:3300/0 conn(0x7fc128153890 0x7fc128115020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc110010760 tx=0x7fc110010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12ed67700 1 --2- 172.21.15.80:0/2951699384 >> v2:172.21.15.80:3300/0 conn(0x7fc128153890 0x7fc128115020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc110010760 tx=0x7fc110010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12ed67700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128153890 0x7fc128115020 secure :-1 s=READY pgs=2590 cs=0 l=1 rx=0x7fc110010760 tx=0x7fc110010660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12ed67700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128153890 0x7fc128115020 secure :-1 s=THROTTLE_DONE pgs=2590 cs=0 l=1 rx=0x7fc110010760 tx=0x7fc110010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12ed67700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128153890 0x7fc128115020 secure :-1 s=THROTTLE_DONE pgs=2590 cs=0 l=1 rx=0x7fc110010760 tx=0x7fc110010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc1277fe700 1 -- 172.21.15.80:0/2951699384 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc110001010 con 0x7fc128153890 2019-11-28T11:54:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc12ed67700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128153890 0x7fc128115020 secure :-1 s=THROTTLE_DONE pgs=2590 cs=0 l=1 rx=0x7fc110010760 tx=0x7fc110010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc1277fe700 1 -- 172.21.15.80:0/2951699384 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc110001440 con 0x7fc128153890 2019-11-28T11:54:26.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc1277fe700 1 -- 172.21.15.80:0/2951699384 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc110001a50 con 0x7fc128153890 2019-11-28T11:54:26.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc1307ca700 1 -- 172.21.15.80:0/2951699384 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc128112ae0 con 0x7fc128153890 2019-11-28T11:54:26.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.709+0000 7fc1307ca700 1 -- 172.21.15.80:0/2951699384 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc128112760 con 0x7fc128153890 2019-11-28T11:54:26.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.710+0000 7fc12ed67700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128153890 0x7fc128115020 secure :-1 s=THROTTLE_DONE pgs=2590 cs=0 l=1 rx=0x7fc110010760 tx=0x7fc110010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.710+0000 7fc1277fe700 1 -- 172.21.15.80:0/2951699384 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc110001010 con 0x7fc128153890 2019-11-28T11:54:26.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.710+0000 7fc12ed67700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128153890 0x7fc128115020 secure :-1 s=THROTTLE_DONE pgs=2590 cs=0 l=1 rx=0x7fc110010760 tx=0x7fc110010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.710+0000 7fc1277fe700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc10c018730 0x7fc10c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:26.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.710+0000 7fc1277fe700 1 -- 172.21.15.80:0/2951699384 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fc110031d80 con 0x7fc128153890 2019-11-28T11:54:26.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.710+0000 7fc12e566700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc10c018730 0x7fc10c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:26.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.711+0000 7fc12e566700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc10c018730 0x7fc10c01abc0 crc :-1 s=READY pgs=1065 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:26.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.718+0000 7fc1307ca700 1 -- 172.21.15.80:0/2951699384 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc128112ae0 con 0x7fc128153890 2019-11-28T11:54:26.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.721+0000 7fc12ed67700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128153890 0x7fc128115020 secure :-1 s=THROTTLE_DONE pgs=2590 cs=0 l=1 rx=0x7fc110010760 tx=0x7fc110010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.722+0000 7fc1277fe700 1 -- 172.21.15.80:0/2951699384 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc110007920 con 0x7fc128153890 2019-11-28T11:54:26.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.889+0000 7fc1307ca700 1 -- 172.21.15.80:0/2951699384 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fc128112760 con 0x7fc128153890 2019-11-28T11:54:26.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.890+0000 7fc12ed67700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128153890 0x7fc128115020 secure :-1 s=THROTTLE_DONE pgs=2590 cs=0 l=1 rx=0x7fc110010760 tx=0x7fc110010660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:26.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.890+0000 7fc1277fe700 1 -- 172.21.15.80:0/2951699384 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v199) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc110001010 con 0x7fc128153890 2019-11-28T11:54:26.946 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:54:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.892+0000 7fc1307ca700 1 -- 172.21.15.80:0/2951699384 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc10c018730 msgr2=0x7fc10c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.892+0000 7fc1307ca700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc10c018730 0x7fc10c01abc0 crc :-1 s=READY pgs=1065 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.892+0000 7fc1307ca700 1 -- 172.21.15.80:0/2951699384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128153890 msgr2=0x7fc128115020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:26.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.892+0000 7fc1307ca700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128153890 0x7fc128115020 secure :-1 s=READY pgs=2590 cs=0 l=1 rx=0x7fc110010760 tx=0x7fc110010660).stop 2019-11-28T11:54:26.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.892+0000 7fc1307ca700 1 -- 172.21.15.80:0/2951699384 shutdown_connections 2019-11-28T11:54:26.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.892+0000 7fc1307ca700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc10c018730 0x7fc10c01abc0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.892+0000 7fc1307ca700 1 --2- 172.21.15.80:0/2951699384 >> v2:172.21.15.174:3300/0 conn(0x7fc12812e670 0x7fc128113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.892+0000 7fc1307ca700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc128115560 0x7fc12812e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.892+0000 7fc1307ca700 1 --2- 172.21.15.80:0/2951699384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc128153890 0x7fc128115020 unknown :-1 s=CLOSED pgs=2590 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:26.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.893+0000 7fc1307ca700 1 -- 172.21.15.80:0/2951699384 shutdown_connections 2019-11-28T11:54:26.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.893+0000 7fc1307ca700 1 -- 172.21.15.80:0/2951699384 wait complete. 2019-11-28T11:54:26.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:26.893+0000 7fc1307ca700 1 -- 172.21.15.80:0/2951699384 >> 172.21.15.80:0/2951699384 conn(0x7fc12814f9f0 msgr2=0x7fc128111c60 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:26.958 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:54:27.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.021+0000 7fde585e4700 1 Processor -- start 2019-11-28T11:54:27.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.021+0000 7fde585e4700 1 -- start start 2019-11-28T11:54:27.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.022+0000 7fde585e4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde5006c490 0x7fde5006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:27.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.022+0000 7fde585e4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5006db00 con 0x7fde5006c0a0 2019-11-28T11:54:27.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.022+0000 7fde585e4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5006e000 con 0x7fde5006ce60 2019-11-28T11:54:27.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.022+0000 7fde585e4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5006fd60 con 0x7fde5006c490 2019-11-28T11:54:27.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.022+0000 7fde56b81700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fde5006c0a0 0x7fde50072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44642/0 (socket says 172.21.15.80:44642) 2019-11-28T11:54:27.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.022+0000 7fde56b81700 1 -- 172.21.15.80:0/3071454841 learned_addr learned my addr 172.21.15.80:0/3071454841 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:27.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.022+0000 7fde56380700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde5006c490 0x7fde5006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:27.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.022+0000 7fde55b7f700 1 -- 172.21.15.80:0/3071454841 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143967034 0 0) 0x7fde4c0014d0 con 0x7fde5006c0a0 2019-11-28T11:54:27.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.022+0000 7fde55b7f700 1 -- 172.21.15.80:0/3071454841 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde3c002e80 con 0x7fde5006c0a0 2019-11-28T11:54:27.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.022+0000 7fde55b7f700 1 -- 172.21.15.80:0/3071454841 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553029631 0 0) 0x7fde48001080 con 0x7fde5006ce60 2019-11-28T11:54:27.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.022+0000 7fde55b7f700 1 -- 172.21.15.80:0/3071454841 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde3c0030b0 con 0x7fde5006ce60 2019-11-28T11:54:27.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde55b7f700 1 -- 172.21.15.80:0/3071454841 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1965921232 0 0) 0x7fde4c0014b0 con 0x7fde5006c0a0 2019-11-28T11:54:27.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde55b7f700 1 -- 172.21.15.80:0/3071454841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde5006c490 msgr2=0x7fde5006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:27.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde55b7f700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde5006c490 0x7fde5006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:27.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde55b7f700 1 -- 172.21.15.80:0/3071454841 >> v1:172.21.15.174:6789/0 conn(0x7fde5006ce60 legacy=0x7fde50164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:27.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde55b7f700 1 -- 172.21.15.80:0/3071454841 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde500706c0 con 0x7fde5006c0a0 2019-11-28T11:54:27.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde55b7f700 1 -- 172.21.15.80:0/3071454841 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fde4c001a40 con 0x7fde5006c0a0 2019-11-28T11:54:27.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde55b7f700 1 -- 172.21.15.80:0/3071454841 >> v1:172.21.15.80:6789/0 conn(0x7fde5006c0a0 legacy=0x7fde50072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:27.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde55b7f700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde3c003c20 0x7fde3c006080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:27.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde55b7f700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde3c006730 0x7fde3c008ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:27.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde55b7f700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde3c04d3b0 0x7fde3c04f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:27.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde55b7f700 1 -- 172.21.15.80:0/3071454841 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c050090 con 0x7fde3c04d3b0 2019-11-28T11:54:27.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde55b7f700 1 -- 172.21.15.80:0/3071454841 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0502c0 con 0x7fde3c006730 2019-11-28T11:54:27.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde55b7f700 1 -- 172.21.15.80:0/3071454841 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0504f0 con 0x7fde3c003c20 2019-11-28T11:54:27.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde56380700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde5006c490 0x7fde5006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde57382700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde3c04d3b0 0x7fde3c04f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde56b81700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde3c003c20 0x7fde3c006080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde56380700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde3c006730 0x7fde3c008ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde57382700 1 -- 172.21.15.80:0/3071454841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde3c003c20 msgr2=0x7fde3c006080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde57382700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde3c003c20 0x7fde3c006080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde57382700 1 -- 172.21.15.80:0/3071454841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde3c006730 msgr2=0x7fde3c008ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:27.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde57382700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde3c006730 0x7fde3c008ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde57382700 1 -- 172.21.15.80:0/3071454841 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c0507a0 con 0x7fde3c04d3b0 2019-11-28T11:54:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde56b81700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde3c003c20 0x7fde3c006080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde56380700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde3c006730 0x7fde3c008ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde57382700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde3c04d3b0 0x7fde3c04f880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fde4800afa0 tx=0x7fde4800b750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde57382700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde3c04d3b0 0x7fde3c04f880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fde4800afa0 tx=0x7fde4800b750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde57382700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde3c04d3b0 0x7fde3c04f880 secure :-1 s=READY pgs=2592 cs=0 l=1 rx=0x7fde4800afa0 tx=0x7fde4800b750).ready entity=mon.0 client_cookie=9b7d72c8a4027424 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:27.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde57382700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde3c04d3b0 0x7fde3c04f880 secure :-1 s=THROTTLE_DONE pgs=2592 cs=0 l=1 rx=0x7fde4800afa0 tx=0x7fde4800b750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde55b7f700 1 -- 172.21.15.80:0/3071454841 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde48000940 con 0x7fde3c04d3b0 2019-11-28T11:54:27.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde57382700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde3c04d3b0 0x7fde3c04f880 secure :-1 s=THROTTLE_DONE pgs=2592 cs=0 l=1 rx=0x7fde4800afa0 tx=0x7fde4800b750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde57382700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde3c04d3b0 0x7fde3c04f880 secure :-1 s=THROTTLE_DONE pgs=2592 cs=0 l=1 rx=0x7fde4800afa0 tx=0x7fde4800b750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde55b7f700 1 -- 172.21.15.80:0/3071454841 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde480099e0 con 0x7fde3c04d3b0 2019-11-28T11:54:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde55b7f700 1 -- 172.21.15.80:0/3071454841 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde4800a030 con 0x7fde3c04d3b0 2019-11-28T11:54:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde585e4700 1 -- 172.21.15.80:0/3071454841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde3c04d3b0 msgr2=0x7fde3c04f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde585e4700 1 --2- 172.21.15.80:0/3071454841 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde3c04d3b0 0x7fde3c04f880 secure :-1 s=READY pgs=2592 cs=0 l=1 rx=0x7fde4800afa0 tx=0x7fde4800b750).stop 2019-11-28T11:54:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.023+0000 7fde57382700 1 -- 172.21.15.80:0/3071454841 reap_dead start 2019-11-28T11:54:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.024+0000 7fde585e4700 1 -- 172.21.15.80:0/3071454841 shutdown_connections 2019-11-28T11:54:27.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.024+0000 7fde585e4700 1 -- 172.21.15.80:0/3071454841 shutdown_connections 2019-11-28T11:54:27.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.024+0000 7fde585e4700 1 -- 172.21.15.80:0/3071454841 wait complete. 2019-11-28T11:54:27.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.024+0000 7fde585e4700 1 -- 172.21.15.80:0/3071454841 >> 172.21.15.80:0/3071454841 conn(0x7fde50061cf0 msgr2=0x7fde50064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:27.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.027+0000 7fde585e4700 1 Processor -- start 2019-11-28T11:54:27.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.027+0000 7fde585e4700 1 -- start start 2019-11-28T11:54:27.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde585e4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fde50074d00 0x7fde500750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde585e4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde50153040 0x7fde50140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde585e4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde50079230 con 0x7fde50152bd0 2019-11-28T11:54:27.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde585e4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5007ab30 con 0x7fde50074d00 2019-11-28T11:54:27.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde585e4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5007ae00 con 0x7fde50153040 2019-11-28T11:54:27.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde56380700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fde50152bd0 0x7fde50140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44656/0 (socket says 172.21.15.80:44656) 2019-11-28T11:54:27.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde56380700 1 -- 172.21.15.80:0/3021981349 learned_addr learned my addr 172.21.15.80:0/3021981349 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:27.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde57382700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde50153040 0x7fde50140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:27.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde56b81700 1 --2- 172.21.15.80:0/3021981349 >> v2:172.21.15.174:3300/0 conn(0x7fde50074d00 0x7fde500750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:27.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde477fe700 1 -- 172.21.15.80:0/3021981349 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37476029 0 0) 0x7fde40009790 con 0x7fde50152bd0 2019-11-28T11:54:27.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde477fe700 1 -- 172.21.15.80:0/3021981349 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde38002e80 con 0x7fde50152bd0 2019-11-28T11:54:27.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde57382700 1 -- 172.21.15.80:0/3021981349 >> v2:172.21.15.174:3300/0 conn(0x7fde50074d00 msgr2=0x7fde500750f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:27.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde57382700 1 --2- 172.21.15.80:0/3021981349 >> v2:172.21.15.174:3300/0 conn(0x7fde50074d00 0x7fde500750f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:27.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde57382700 1 -- 172.21.15.80:0/3021981349 >> v1:172.21.15.80:6789/0 conn(0x7fde50152bd0 legacy=0x7fde50140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:27.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde57382700 1 -- 172.21.15.80:0/3021981349 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5007b490 con 0x7fde50153040 2019-11-28T11:54:27.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde56b81700 1 --2- 172.21.15.80:0/3021981349 >> v2:172.21.15.174:3300/0 conn(0x7fde50074d00 0x7fde500750f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:27.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde57382700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde50153040 0x7fde50140c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde480103a0 tx=0x7fde48010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde57382700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde50153040 0x7fde50140c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde480103a0 tx=0x7fde48010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde57382700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde50153040 0x7fde50140c40 secure :-1 s=READY pgs=370 cs=0 l=1 rx=0x7fde480103a0 tx=0x7fde48010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:27.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde57382700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde50153040 0x7fde50140c40 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7fde480103a0 tx=0x7fde48010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde477fe700 1 -- 172.21.15.80:0/3021981349 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde48000940 con 0x7fde50153040 2019-11-28T11:54:27.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde57382700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde50153040 0x7fde50140c40 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7fde480103a0 tx=0x7fde48010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde585e4700 1 -- 172.21.15.80:0/3021981349 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5007b810 con 0x7fde50153040 2019-11-28T11:54:27.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.028+0000 7fde57382700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde50153040 0x7fde50140c40 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7fde480103a0 tx=0x7fde48010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.029+0000 7fde477fe700 1 -- 172.21.15.80:0/3021981349 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde48000940 con 0x7fde50153040 2019-11-28T11:54:27.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.029+0000 7fde585e4700 1 -- 172.21.15.80:0/3021981349 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5007b490 con 0x7fde50153040 2019-11-28T11:54:27.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.029+0000 7fde477fe700 1 -- 172.21.15.80:0/3021981349 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde48009ba0 con 0x7fde50153040 2019-11-28T11:54:27.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.029+0000 7fde57382700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde50153040 0x7fde50140c40 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7fde480103a0 tx=0x7fde48010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.029+0000 7fde477fe700 1 -- 172.21.15.80:0/3021981349 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fde480097c0 con 0x7fde50153040 2019-11-28T11:54:27.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.029+0000 7fde57382700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde50153040 0x7fde50140c40 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7fde480103a0 tx=0x7fde48010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.029+0000 7fde477fe700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fde38018770 0x7fde3801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:27.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.029+0000 7fde477fe700 1 -- 172.21.15.80:0/3021981349 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fde480319d0 con 0x7fde50153040 2019-11-28T11:54:27.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.029+0000 7fde56b81700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fde38018770 0x7fde3801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:27.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.030+0000 7fde56b81700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fde38018770 0x7fde3801abe0 crc :-1 s=READY pgs=1066 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:27.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.036+0000 7fde585e4700 1 -- 172.21.15.80:0/3021981349 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5007b810 con 0x7fde50153040 2019-11-28T11:54:27.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.040+0000 7fde57382700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde50153040 0x7fde50140c40 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7fde480103a0 tx=0x7fde48010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.040+0000 7fde477fe700 1 -- 172.21.15.80:0/3021981349 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fde48024f40 con 0x7fde50153040 2019-11-28T11:54:27.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.203+0000 7fde585e4700 1 -- 172.21.15.80:0/3021981349 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fde5007b490 con 0x7fde50153040 2019-11-28T11:54:27.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.203+0000 7fde57382700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde50153040 0x7fde50140c40 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7fde480103a0 tx=0x7fde48010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.204+0000 7fde477fe700 1 -- 172.21.15.80:0/3021981349 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v199) v1 ==== 84+0+64 (secure 0 0 0) 0x7fde48024f40 con 0x7fde50153040 2019-11-28T11:54:27.260 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:27.260 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:54:27.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:54:27.261 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:54:27.261 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:54:27.261 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:54:27.261 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:54:27.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.206+0000 7fde585e4700 1 -- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fde38018770 msgr2=0x7fde3801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:27.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.206+0000 7fde585e4700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fde38018770 0x7fde3801abe0 crc :-1 s=READY pgs=1066 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:27.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.206+0000 7fde585e4700 1 -- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde50153040 msgr2=0x7fde50140c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:27.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.206+0000 7fde585e4700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde50153040 0x7fde50140c40 secure :-1 s=READY pgs=370 cs=0 l=1 rx=0x7fde480103a0 tx=0x7fde48010740).stop 2019-11-28T11:54:27.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.206+0000 7fde585e4700 1 -- 172.21.15.80:0/3021981349 shutdown_connections 2019-11-28T11:54:27.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.206+0000 7fde585e4700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fde38018770 0x7fde3801abe0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:27.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.206+0000 7fde585e4700 1 --2- 172.21.15.80:0/3021981349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde50153040 0x7fde50140c40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:27.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.206+0000 7fde585e4700 1 --2- 172.21.15.80:0/3021981349 >> v2:172.21.15.174:3300/0 conn(0x7fde50074d00 0x7fde500750f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:27.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.206+0000 7fde585e4700 1 -- 172.21.15.80:0/3021981349 shutdown_connections 2019-11-28T11:54:27.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.206+0000 7fde585e4700 1 -- 172.21.15.80:0/3021981349 wait complete. 2019-11-28T11:54:27.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.206+0000 7fde585e4700 1 -- 172.21.15.80:0/3021981349 >> 172.21.15.80:0/3021981349 conn(0x7fde5013fa50 msgr2=0x7fde5007c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:27.272 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:54:27.272 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:54:27.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.342+0000 7f4c3551e700 1 Processor -- start 2019-11-28T11:54:27.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.342+0000 7f4c3551e700 1 -- start start 2019-11-28T11:54:27.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c3551e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c3015ed10 0x7f4c3015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:27.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c3551e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4c30073020 0x7f4c30071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:27.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c3551e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4c300734b0 0x7f4c300723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:27.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c3551e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3006f3d0 con 0x7f4c30073020 2019-11-28T11:54:27.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c3551e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3006fe00 con 0x7f4c300734b0 2019-11-28T11:54:27.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c3551e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c30070760 con 0x7f4c3015ed10 2019-11-28T11:54:27.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2effd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4c30073020 0x7f4c30071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:27.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2effd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4c30073020 0x7f4c30071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45346/0 (socket says 172.21.15.80:45346) 2019-11-28T11:54:27.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2effd700 1 -- 172.21.15.80:0/3382989624 learned_addr learned my addr 172.21.15.80:0/3382989624 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:27.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2ffff700 1 --2- 172.21.15.80:0/3382989624 >> v2:172.21.15.174:3300/0 conn(0x7f4c300734b0 0x7f4c300723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:27.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2f7fe700 1 --2- 172.21.15.80:0/3382989624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c3015ed10 0x7f4c3015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:27.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2effd700 1 -- 172.21.15.80:0/3382989624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c3015ed10 msgr2=0x7f4c3015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:27.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2effd700 1 --2- 172.21.15.80:0/3382989624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c3015ed10 0x7f4c3015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:27.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2effd700 1 -- 172.21.15.80:0/3382989624 >> v2:172.21.15.174:3300/0 conn(0x7f4c300734b0 msgr2=0x7f4c300723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:27.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2effd700 1 --2- 172.21.15.80:0/3382989624 >> v2:172.21.15.174:3300/0 conn(0x7f4c300734b0 0x7f4c300723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:27.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2effd700 1 -- 172.21.15.80:0/3382989624 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c30070ae0 con 0x7f4c30073020 2019-11-28T11:54:27.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2ffff700 1 --2- 172.21.15.80:0/3382989624 >> v2:172.21.15.174:3300/0 conn(0x7f4c300734b0 0x7f4c300723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:27.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2f7fe700 1 --2- 172.21.15.80:0/3382989624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c3015ed10 0x7f4c3015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:27.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2effd700 1 --2- 172.21.15.80:0/3382989624 >> v2:172.21.15.80:3300/0 conn(0x7f4c30073020 0x7f4c30071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4c2000fac0 tx=0x7f4c2000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2effd700 1 --2- 172.21.15.80:0/3382989624 >> v2:172.21.15.80:3300/0 conn(0x7f4c30073020 0x7f4c30071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4c2000fac0 tx=0x7f4c2000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2effd700 1 --2- 172.21.15.80:0/3382989624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30073020 0x7f4c30071ea0 secure :-1 s=READY pgs=2594 cs=0 l=1 rx=0x7f4c2000fac0 tx=0x7f4c2000fe60).ready entity=mon.0 client_cookie=c91cf3b3f316699 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:27.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2effd700 1 --2- 172.21.15.80:0/3382989624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30073020 0x7f4c30071ea0 secure :-1 s=THROTTLE_DONE pgs=2594 cs=0 l=1 rx=0x7f4c2000fac0 tx=0x7f4c2000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2effd700 1 --2- 172.21.15.80:0/3382989624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30073020 0x7f4c30071ea0 secure :-1 s=THROTTLE_DONE pgs=2594 cs=0 l=1 rx=0x7f4c2000fac0 tx=0x7f4c2000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2effd700 1 --2- 172.21.15.80:0/3382989624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30073020 0x7f4c30071ea0 secure :-1 s=THROTTLE_DONE pgs=2594 cs=0 l=1 rx=0x7f4c2000fac0 tx=0x7f4c2000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2e7fc700 1 -- 172.21.15.80:0/3382989624 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c20000ce0 con 0x7f4c30073020 2019-11-28T11:54:27.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2e7fc700 1 -- 172.21.15.80:0/3382989624 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c20001200 con 0x7f4c30073020 2019-11-28T11:54:27.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c2e7fc700 1 -- 172.21.15.80:0/3382989624 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c20001950 con 0x7f4c30073020 2019-11-28T11:54:27.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c3551e700 1 -- 172.21.15.80:0/3382989624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30073020 msgr2=0x7f4c30071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:27.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.343+0000 7f4c3551e700 1 --2- 172.21.15.80:0/3382989624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30073020 0x7f4c30071ea0 secure :-1 s=READY pgs=2594 cs=0 l=1 rx=0x7f4c2000fac0 tx=0x7f4c2000fe60).stop 2019-11-28T11:54:27.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.344+0000 7f4c3551e700 1 -- 172.21.15.80:0/3382989624 shutdown_connections 2019-11-28T11:54:27.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.344+0000 7f4c3551e700 1 --2- 172.21.15.80:0/3382989624 >> v2:172.21.15.174:3300/0 conn(0x7f4c300734b0 0x7f4c300723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:27.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.344+0000 7f4c3551e700 1 --2- 172.21.15.80:0/3382989624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30073020 0x7f4c30071ea0 unknown :-1 s=CLOSED pgs=2594 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:27.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.344+0000 7f4c3551e700 1 --2- 172.21.15.80:0/3382989624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c3015ed10 0x7f4c3015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:27.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.344+0000 7f4c3551e700 1 -- 172.21.15.80:0/3382989624 shutdown_connections 2019-11-28T11:54:27.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.344+0000 7f4c3551e700 1 -- 172.21.15.80:0/3382989624 wait complete. 2019-11-28T11:54:27.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.344+0000 7f4c3551e700 1 -- 172.21.15.80:0/3382989624 >> 172.21.15.80:0/3382989624 conn(0x7f4c30061d20 msgr2=0x7f4c300641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:27.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.346+0000 7f4c3551e700 1 Processor -- start 2019-11-28T11:54:27.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.347+0000 7f4c3551e700 1 -- start start 2019-11-28T11:54:27.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.347+0000 7f4c3551e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4c30148320 0x7f4c3010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:27.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c3551e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c3010f290 0x7f4c3010dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:27.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c3551e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4c3010e110 0x7f4c3010e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:27.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c3551e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3013aa20 con 0x7f4c30148320 2019-11-28T11:54:27.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c3551e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3013acf0 con 0x7f4c3010e110 2019-11-28T11:54:27.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c3551e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c30139ff0 con 0x7f4c3010f290 2019-11-28T11:54:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4c30148320 0x7f4c3010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4c30148320 0x7f4c3010ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45350/0 (socket says 172.21.15.80:45350) 2019-11-28T11:54:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2f7fe700 1 -- 172.21.15.80:0/3249820879 learned_addr learned my addr 172.21.15.80:0/3249820879 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2effd700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c3010f290 0x7f4c3010dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2ffff700 1 --2- 172.21.15.80:0/3249820879 >> v2:172.21.15.174:3300/0 conn(0x7f4c3010e110 0x7f4c3010e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:27.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2f7fe700 1 -- 172.21.15.80:0/3249820879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c3010f290 msgr2=0x7f4c3010dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2f7fe700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c3010f290 0x7f4c3010dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2f7fe700 1 -- 172.21.15.80:0/3249820879 >> v2:172.21.15.174:3300/0 conn(0x7f4c3010e110 msgr2=0x7f4c3010e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2f7fe700 1 --2- 172.21.15.80:0/3249820879 >> v2:172.21.15.174:3300/0 conn(0x7f4c3010e110 0x7f4c3010e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2f7fe700 1 -- 172.21.15.80:0/3249820879 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3010c490 con 0x7f4c30148320 2019-11-28T11:54:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2effd700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c3010f290 0x7f4c3010dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2ffff700 1 --2- 172.21.15.80:0/3249820879 >> v2:172.21.15.174:3300/0 conn(0x7f4c3010e110 0x7f4c3010e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:27.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2f7fe700 1 --2- 172.21.15.80:0/3249820879 >> v2:172.21.15.80:3300/0 conn(0x7f4c30148320 0x7f4c3010ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4c18010430 tx=0x7f4c180107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2f7fe700 1 --2- 172.21.15.80:0/3249820879 >> v2:172.21.15.80:3300/0 conn(0x7f4c30148320 0x7f4c3010ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4c18010430 tx=0x7f4c180107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2f7fe700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30148320 0x7f4c3010ed50 secure :-1 s=READY pgs=2595 cs=0 l=1 rx=0x7f4c18010430 tx=0x7f4c180107d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:27.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2f7fe700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30148320 0x7f4c3010ed50 secure :-1 s=THROTTLE_DONE pgs=2595 cs=0 l=1 rx=0x7f4c18010430 tx=0x7f4c180107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2f7fe700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30148320 0x7f4c3010ed50 secure :-1 s=THROTTLE_DONE pgs=2595 cs=0 l=1 rx=0x7f4c18010430 tx=0x7f4c180107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c27fff700 1 -- 172.21.15.80:0/3249820879 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c180096c0 con 0x7f4c30148320 2019-11-28T11:54:27.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c2f7fe700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30148320 0x7f4c3010ed50 secure :-1 s=THROTTLE_DONE pgs=2595 cs=0 l=1 rx=0x7f4c18010430 tx=0x7f4c180107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c27fff700 1 -- 172.21.15.80:0/3249820879 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c18000ba0 con 0x7f4c30148320 2019-11-28T11:54:27.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c3551e700 1 -- 172.21.15.80:0/3249820879 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3010c810 con 0x7f4c30148320 2019-11-28T11:54:27.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c27fff700 1 -- 172.21.15.80:0/3249820879 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c180011f0 con 0x7f4c30148320 2019-11-28T11:54:27.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.348+0000 7f4c3551e700 1 -- 172.21.15.80:0/3249820879 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3010c490 con 0x7f4c30148320 2019-11-28T11:54:27.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.349+0000 7f4c2f7fe700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30148320 0x7f4c3010ed50 secure :-1 s=THROTTLE_DONE pgs=2595 cs=0 l=1 rx=0x7f4c18010430 tx=0x7f4c180107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.349+0000 7f4c27fff700 1 -- 172.21.15.80:0/3249820879 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4c180096c0 con 0x7f4c30148320 2019-11-28T11:54:27.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.349+0000 7f4c2f7fe700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30148320 0x7f4c3010ed50 secure :-1 s=THROTTLE_DONE pgs=2595 cs=0 l=1 rx=0x7f4c18010430 tx=0x7f4c180107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.349+0000 7f4c27fff700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4c14018730 0x7f4c1401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:27.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.349+0000 7f4c27fff700 1 -- 172.21.15.80:0/3249820879 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f4c18031a50 con 0x7f4c30148320 2019-11-28T11:54:27.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.349+0000 7f4c2effd700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4c14018730 0x7f4c1401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:27.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.349+0000 7f4c2effd700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4c14018730 0x7f4c1401abc0 crc :-1 s=READY pgs=1067 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:27.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.357+0000 7f4c3551e700 1 -- 172.21.15.80:0/3249820879 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3010c810 con 0x7f4c30148320 2019-11-28T11:54:27.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.360+0000 7f4c2f7fe700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30148320 0x7f4c3010ed50 secure :-1 s=THROTTLE_DONE pgs=2595 cs=0 l=1 rx=0x7f4c18010430 tx=0x7f4c180107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.360+0000 7f4c27fff700 1 -- 172.21.15.80:0/3249820879 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4c180094b0 con 0x7f4c30148320 2019-11-28T11:54:27.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.528+0000 7f4c3551e700 1 -- 172.21.15.80:0/3249820879 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f4c3010c490 con 0x7f4c30148320 2019-11-28T11:54:27.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.849+0000 7f4c2f7fe700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30148320 0x7f4c3010ed50 secure :-1 s=THROTTLE_DONE pgs=2595 cs=0 l=1 rx=0x7f4c18010430 tx=0x7f4c180107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:27.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.849+0000 7f4c27fff700 1 -- 172.21.15.80:0/3249820879 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v200) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4c180094b0 con 0x7f4c30148320 2019-11-28T11:54:27.948 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:54:27.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.895+0000 7f4c3551e700 1 -- 172.21.15.80:0/3249820879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4c14018730 msgr2=0x7f4c1401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:27.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.895+0000 7f4c3551e700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4c14018730 0x7f4c1401abc0 crc :-1 s=READY pgs=1067 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:27.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.895+0000 7f4c3551e700 1 -- 172.21.15.80:0/3249820879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30148320 msgr2=0x7f4c3010ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:27.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.895+0000 7f4c3551e700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30148320 0x7f4c3010ed50 secure :-1 s=READY pgs=2595 cs=0 l=1 rx=0x7f4c18010430 tx=0x7f4c180107d0).stop 2019-11-28T11:54:27.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.895+0000 7f4c3551e700 1 -- 172.21.15.80:0/3249820879 shutdown_connections 2019-11-28T11:54:27.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.895+0000 7f4c3551e700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4c14018730 0x7f4c1401abc0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:27.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.895+0000 7f4c3551e700 1 --2- 172.21.15.80:0/3249820879 >> v2:172.21.15.174:3300/0 conn(0x7f4c3010e110 0x7f4c3010e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:27.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.895+0000 7f4c3551e700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c3010f290 0x7f4c3010dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:27.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.895+0000 7f4c3551e700 1 --2- 172.21.15.80:0/3249820879 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c30148320 0x7f4c3010ed50 unknown :-1 s=CLOSED pgs=2595 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:27.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.895+0000 7f4c3551e700 1 -- 172.21.15.80:0/3249820879 shutdown_connections 2019-11-28T11:54:27.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.895+0000 7f4c3551e700 1 -- 172.21.15.80:0/3249820879 wait complete. 2019-11-28T11:54:27.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:27.895+0000 7f4c3551e700 1 -- 172.21.15.80:0/3249820879 >> 172.21.15.80:0/3249820879 conn(0x7f4c3015e2d0 msgr2=0x7f4c30147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:27.961 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:54:28.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.028+0000 7f232258b700 1 Processor -- start 2019-11-28T11:54:28.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.028+0000 7f232258b700 1 -- start start 2019-11-28T11:54:28.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.029+0000 7f232258b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f231c15ed10 0x7f231c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:28.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.029+0000 7f232258b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f231c073020 0x7f231c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:28.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.029+0000 7f232258b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231c06db60 con 0x7f231c0734b0 2019-11-28T11:54:28.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.029+0000 7f232258b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231c06f3d0 con 0x7f231c073020 2019-11-28T11:54:28.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.029+0000 7f232258b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231c06fe00 con 0x7f231c15ed10 2019-11-28T11:54:28.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.029+0000 7f2321329700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f231c0734b0 0x7f231c0723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44674/0 (socket says 172.21.15.80:44674) 2019-11-28T11:54:28.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.029+0000 7f2321329700 1 -- 172.21.15.80:0/1499366130 learned_addr learned my addr 172.21.15.80:0/1499366130 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:28.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.029+0000 7f2320b28700 1 --2- 172.21.15.80:0/1499366130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f231c15ed10 0x7f231c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:28.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.029+0000 7f231bfff700 1 --2- 172.21.15.80:0/1499366130 >> v2:172.21.15.174:3300/0 conn(0x7f231c073020 0x7f231c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:28.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.029+0000 7f231b7fe700 1 -- 172.21.15.80:0/1499366130 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183100175 0 0) 0x7f23140014d0 con 0x7f231c0734b0 2019-11-28T11:54:28.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.029+0000 7f231b7fe700 1 -- 172.21.15.80:0/1499366130 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2308002e80 con 0x7f231c0734b0 2019-11-28T11:54:28.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.029+0000 7f2320b28700 1 -- 172.21.15.80:0/1499366130 >> v2:172.21.15.174:3300/0 conn(0x7f231c073020 msgr2=0x7f231c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:28.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.029+0000 7f2320b28700 1 --2- 172.21.15.80:0/1499366130 >> v2:172.21.15.174:3300/0 conn(0x7f231c073020 0x7f231c071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:28.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.029+0000 7f2320b28700 1 -- 172.21.15.80:0/1499366130 >> v1:172.21.15.80:6789/0 conn(0x7f231c0734b0 legacy=0x7f231c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:28.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.029+0000 7f231b7fe700 1 -- 172.21.15.80:0/1499366130 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3631698710 0 0) 0x7f23140014b0 con 0x7f231c0734b0 2019-11-28T11:54:28.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.030+0000 7f2320b28700 1 -- 172.21.15.80:0/1499366130 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c070760 con 0x7f231c15ed10 2019-11-28T11:54:28.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.030+0000 7f231bfff700 1 --2- 172.21.15.80:0/1499366130 >> v2:172.21.15.174:3300/0 conn(0x7f231c073020 0x7f231c071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:28.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.030+0000 7f2320b28700 1 --2- 172.21.15.80:0/1499366130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f231c15ed10 0x7f231c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f230400af50 tx=0x7f230400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:28.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.030+0000 7f2320b28700 1 --2- 172.21.15.80:0/1499366130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f231c15ed10 0x7f231c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f230400af50 tx=0x7f230400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:28.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.030+0000 7f2320b28700 1 --2- 172.21.15.80:0/1499366130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f231c15ed10 0x7f231c15f100 secure :-1 s=READY pgs=371 cs=0 l=1 rx=0x7f230400af50 tx=0x7f230400b760).ready entity=mon.2 client_cookie=9111011da27e482 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:28.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.030+0000 7f2320b28700 1 --2- 172.21.15.80:0/1499366130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f231c15ed10 0x7f231c15f100 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7f230400af50 tx=0x7f230400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:28.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.030+0000 7f231b7fe700 1 -- 172.21.15.80:0/1499366130 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2304007210 con 0x7f231c15ed10 2019-11-28T11:54:28.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.030+0000 7f2320b28700 1 --2- 172.21.15.80:0/1499366130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f231c15ed10 0x7f231c15f100 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7f230400af50 tx=0x7f230400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:28.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.030+0000 7f2320b28700 1 --2- 172.21.15.80:0/1499366130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f231c15ed10 0x7f231c15f100 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7f230400af50 tx=0x7f230400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:28.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.030+0000 7f231b7fe700 1 -- 172.21.15.80:0/1499366130 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23040099b0 con 0x7f231c15ed10 2019-11-28T11:54:28.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.030+0000 7f231b7fe700 1 -- 172.21.15.80:0/1499366130 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230400a080 con 0x7f231c15ed10 2019-11-28T11:54:28.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.030+0000 7f232258b700 1 -- 172.21.15.80:0/1499366130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f231c15ed10 msgr2=0x7f231c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:28.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.030+0000 7f232258b700 1 --2- 172.21.15.80:0/1499366130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f231c15ed10 0x7f231c15f100 secure :-1 s=READY pgs=371 cs=0 l=1 rx=0x7f230400af50 tx=0x7f230400b760).stop 2019-11-28T11:54:28.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.031+0000 7f232258b700 1 -- 172.21.15.80:0/1499366130 shutdown_connections 2019-11-28T11:54:28.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.031+0000 7f232258b700 1 --2- 172.21.15.80:0/1499366130 >> v2:172.21.15.174:3300/0 conn(0x7f231c073020 0x7f231c071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:28.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.031+0000 7f232258b700 1 --2- 172.21.15.80:0/1499366130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f231c15ed10 0x7f231c15f100 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:28.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.031+0000 7f232258b700 1 -- 172.21.15.80:0/1499366130 shutdown_connections 2019-11-28T11:54:28.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.031+0000 7f232258b700 1 -- 172.21.15.80:0/1499366130 wait complete. 2019-11-28T11:54:28.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.031+0000 7f232258b700 1 -- 172.21.15.80:0/1499366130 >> 172.21.15.80:0/1499366130 conn(0x7f231c061d20 msgr2=0x7f231c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:28.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.033+0000 7f232258b700 1 Processor -- start 2019-11-28T11:54:28.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.033+0000 7f232258b700 1 -- start start 2019-11-28T11:54:28.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.034+0000 7f232258b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f231c148320 0x7f231c10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:28.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.034+0000 7f232258b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f231c10e3d0 0x7f231c168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:28.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.034+0000 7f232258b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231c148e00 con 0x7f231c10f290 2019-11-28T11:54:28.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.034+0000 7f232258b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231c13aa20 con 0x7f231c148320 2019-11-28T11:54:28.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.034+0000 7f232258b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231c13acf0 con 0x7f231c10e3d0 2019-11-28T11:54:28.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.034+0000 7f2320b28700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f231c148320 0x7f231c10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.034+0000 7f2320b28700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f231c148320 0x7f231c10ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45362/0 (socket says 172.21.15.80:45362) 2019-11-28T11:54:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.034+0000 7f2320b28700 1 -- 172.21.15.80:0/3082308043 learned_addr learned my addr 172.21.15.80:0/3082308043 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.034+0000 7f2321329700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f231c10e3d0 0x7f231c168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.034+0000 7f2320b28700 1 -- 172.21.15.80:0/3082308043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f231c10e3d0 msgr2=0x7f231c168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.034+0000 7f2320b28700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f231c10e3d0 0x7f231c168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.034+0000 7f2320b28700 1 -- 172.21.15.80:0/3082308043 >> v1:172.21.15.80:6789/0 conn(0x7f231c10f290 legacy=0x7f231c10dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:28.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.034+0000 7f2320b28700 1 -- 172.21.15.80:0/3082308043 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c10c490 con 0x7f231c148320 2019-11-28T11:54:28.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.034+0000 7f2320b28700 1 --2- 172.21.15.80:0/3082308043 >> v2:172.21.15.80:3300/0 conn(0x7f231c148320 0x7f231c10ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2304010470 tx=0x7f2304010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:28.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.035+0000 7f2320b28700 1 --2- 172.21.15.80:0/3082308043 >> v2:172.21.15.80:3300/0 conn(0x7f231c148320 0x7f231c10ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2304010470 tx=0x7f2304010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:28.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.035+0000 7f2320b28700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f231c148320 0x7f231c10ed50 secure :-1 s=READY pgs=2598 cs=0 l=1 rx=0x7f2304010470 tx=0x7f2304010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:28.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.035+0000 7f2320b28700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f231c148320 0x7f231c10ed50 secure :-1 s=THROTTLE_DONE pgs=2598 cs=0 l=1 rx=0x7f2304010470 tx=0x7f2304010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:28.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.035+0000 7f23197fa700 1 -- 172.21.15.80:0/3082308043 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2304000940 con 0x7f231c148320 2019-11-28T11:54:28.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.035+0000 7f2320b28700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f231c148320 0x7f231c10ed50 secure :-1 s=THROTTLE_DONE pgs=2598 cs=0 l=1 rx=0x7f2304010470 tx=0x7f2304010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.035+0000 7f2320b28700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f231c148320 0x7f231c10ed50 secure :-1 s=THROTTLE_DONE pgs=2598 cs=0 l=1 rx=0x7f2304010470 tx=0x7f2304010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.035+0000 7f23197fa700 1 -- 172.21.15.80:0/3082308043 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230400b380 con 0x7f231c148320 2019-11-28T11:54:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.035+0000 7f23197fa700 1 -- 172.21.15.80:0/3082308043 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2304009d60 con 0x7f231c148320 2019-11-28T11:54:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.035+0000 7f232258b700 1 -- 172.21.15.80:0/3082308043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231c10c810 con 0x7f231c148320 2019-11-28T11:54:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.035+0000 7f232258b700 1 -- 172.21.15.80:0/3082308043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231c10c490 con 0x7f231c148320 2019-11-28T11:54:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.035+0000 7f2320b28700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f231c148320 0x7f231c10ed50 secure :-1 s=THROTTLE_DONE pgs=2598 cs=0 l=1 rx=0x7f2304010470 tx=0x7f2304010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.035+0000 7f23197fa700 1 -- 172.21.15.80:0/3082308043 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2304009790 con 0x7f231c148320 2019-11-28T11:54:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.035+0000 7f2320b28700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f231c148320 0x7f231c10ed50 secure :-1 s=THROTTLE_DONE pgs=2598 cs=0 l=1 rx=0x7f2304010470 tx=0x7f2304010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.036+0000 7f23197fa700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2300018730 0x7f230001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.036+0000 7f23197fa700 1 -- 172.21.15.80:0/3082308043 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2304031a80 con 0x7f231c148320 2019-11-28T11:54:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.036+0000 7f231bfff700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2300018730 0x7f230001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.036+0000 7f231bfff700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2300018730 0x7f230001abc0 crc :-1 s=READY pgs=1068 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:28.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.043+0000 7f232258b700 1 -- 172.21.15.80:0/3082308043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231c10c810 con 0x7f231c148320 2019-11-28T11:54:28.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.047+0000 7f2320b28700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f231c148320 0x7f231c10ed50 secure :-1 s=THROTTLE_DONE pgs=2598 cs=0 l=1 rx=0x7f2304010470 tx=0x7f2304010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:28.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.047+0000 7f23197fa700 1 -- 172.21.15.80:0/3082308043 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2304009580 con 0x7f231c148320 2019-11-28T11:54:28.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.213+0000 7f232258b700 1 -- 172.21.15.80:0/3082308043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f231c10c490 con 0x7f231c148320 2019-11-28T11:54:28.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.852+0000 7f2320b28700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f231c148320 0x7f231c10ed50 secure :-1 s=THROTTLE_DONE pgs=2598 cs=0 l=1 rx=0x7f2304010470 tx=0x7f2304010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:28.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.852+0000 7f23197fa700 1 -- 172.21.15.80:0/3082308043 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v201) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2304009790 con 0x7f231c148320 2019-11-28T11:54:28.936 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:54:28.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.880+0000 7f232258b700 1 -- 172.21.15.80:0/3082308043 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2300018730 msgr2=0x7f230001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:28.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.880+0000 7f232258b700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2300018730 0x7f230001abc0 crc :-1 s=READY pgs=1068 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:28.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.880+0000 7f232258b700 1 -- 172.21.15.80:0/3082308043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f231c148320 msgr2=0x7f231c10ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:28.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.880+0000 7f232258b700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f231c148320 0x7f231c10ed50 secure :-1 s=READY pgs=2598 cs=0 l=1 rx=0x7f2304010470 tx=0x7f2304010270).stop 2019-11-28T11:54:28.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.880+0000 7f232258b700 1 -- 172.21.15.80:0/3082308043 shutdown_connections 2019-11-28T11:54:28.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.880+0000 7f232258b700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2300018730 0x7f230001abc0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:28.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.880+0000 7f232258b700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f231c10e3d0 0x7f231c168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:28.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.880+0000 7f232258b700 1 --2- 172.21.15.80:0/3082308043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f231c148320 0x7f231c10ed50 unknown :-1 s=CLOSED pgs=2598 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:28.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.880+0000 7f232258b700 1 -- 172.21.15.80:0/3082308043 shutdown_connections 2019-11-28T11:54:28.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.880+0000 7f232258b700 1 -- 172.21.15.80:0/3082308043 wait complete. 2019-11-28T11:54:28.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:28.880+0000 7f232258b700 1 -- 172.21.15.80:0/3082308043 >> 172.21.15.80:0/3082308043 conn(0x7f231c15e2d0 msgr2=0x7f231c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:28.946 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:54:29.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.014+0000 7fc70d860700 1 Processor -- start 2019-11-28T11:54:29.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.014+0000 7fc70d860700 1 -- start start 2019-11-28T11:54:29.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.015+0000 7fc70d860700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc70815ed10 0x7fc70815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:29.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.015+0000 7fc70d860700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc708073020 0x7fc708071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:29.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.015+0000 7fc70d860700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7080734b0 0x7fc7080723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:29.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.015+0000 7fc70d860700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70806f3d0 con 0x7fc7080734b0 2019-11-28T11:54:29.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.015+0000 7fc70d860700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70806fe00 con 0x7fc708073020 2019-11-28T11:54:29.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.015+0000 7fc70d860700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc708070760 con 0x7fc70815ed10 2019-11-28T11:54:29.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.015+0000 7fc707fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7080734b0 0x7fc7080723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:29.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.015+0000 7fc707fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7080734b0 0x7fc7080723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45370/0 (socket says 172.21.15.80:45370) 2019-11-28T11:54:29.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.015+0000 7fc707fff700 1 -- 172.21.15.80:0/3930513731 learned_addr learned my addr 172.21.15.80:0/3930513731 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:29.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.015+0000 7fc7077fe700 1 --2- 172.21.15.80:0/3930513731 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc70815ed10 0x7fc70815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:29.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc706ffd700 1 --2- 172.21.15.80:0/3930513731 >> v2:172.21.15.174:3300/0 conn(0x7fc708073020 0x7fc708071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:29.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc707fff700 1 -- 172.21.15.80:0/3930513731 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc70815ed10 msgr2=0x7fc70815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:29.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc707fff700 1 --2- 172.21.15.80:0/3930513731 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc70815ed10 0x7fc70815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:29.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc707fff700 1 -- 172.21.15.80:0/3930513731 >> v2:172.21.15.174:3300/0 conn(0x7fc708073020 msgr2=0x7fc708071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:29.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc707fff700 1 --2- 172.21.15.80:0/3930513731 >> v2:172.21.15.174:3300/0 conn(0x7fc708073020 0x7fc708071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:29.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc707fff700 1 -- 172.21.15.80:0/3930513731 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc708070ae0 con 0x7fc7080734b0 2019-11-28T11:54:29.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc706ffd700 1 --2- 172.21.15.80:0/3930513731 >> v2:172.21.15.174:3300/0 conn(0x7fc708073020 0x7fc708071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:29.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc707fff700 1 --2- 172.21.15.80:0/3930513731 >> v2:172.21.15.80:3300/0 conn(0x7fc7080734b0 0x7fc7080723e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc70000f6b0 tx=0x7fc70000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc707fff700 1 --2- 172.21.15.80:0/3930513731 >> v2:172.21.15.80:3300/0 conn(0x7fc7080734b0 0x7fc7080723e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc70000f6b0 tx=0x7fc70000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc707fff700 1 --2- 172.21.15.80:0/3930513731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7080734b0 0x7fc7080723e0 secure :-1 s=READY pgs=2599 cs=0 l=1 rx=0x7fc70000f6b0 tx=0x7fc70000fa50).ready entity=mon.0 client_cookie=f22758132174f904 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:29.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc707fff700 1 --2- 172.21.15.80:0/3930513731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7080734b0 0x7fc7080723e0 secure :-1 s=THROTTLE_DONE pgs=2599 cs=0 l=1 rx=0x7fc70000f6b0 tx=0x7fc70000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc707fff700 1 --2- 172.21.15.80:0/3930513731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7080734b0 0x7fc7080723e0 secure :-1 s=THROTTLE_DONE pgs=2599 cs=0 l=1 rx=0x7fc70000f6b0 tx=0x7fc70000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc7067fc700 1 -- 172.21.15.80:0/3930513731 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7000010e0 con 0x7fc7080734b0 2019-11-28T11:54:29.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc707fff700 1 --2- 172.21.15.80:0/3930513731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7080734b0 0x7fc7080723e0 secure :-1 s=THROTTLE_DONE pgs=2599 cs=0 l=1 rx=0x7fc70000f6b0 tx=0x7fc70000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc7067fc700 1 -- 172.21.15.80:0/3930513731 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc700000b90 con 0x7fc7080734b0 2019-11-28T11:54:29.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc7067fc700 1 -- 172.21.15.80:0/3930513731 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7000016c0 con 0x7fc7080734b0 2019-11-28T11:54:29.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc70d860700 1 -- 172.21.15.80:0/3930513731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7080734b0 msgr2=0x7fc7080723e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.016+0000 7fc70d860700 1 --2- 172.21.15.80:0/3930513731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7080734b0 0x7fc7080723e0 secure :-1 s=READY pgs=2599 cs=0 l=1 rx=0x7fc70000f6b0 tx=0x7fc70000fa50).stop 2019-11-28T11:54:29.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.017+0000 7fc70d860700 1 -- 172.21.15.80:0/3930513731 shutdown_connections 2019-11-28T11:54:29.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.017+0000 7fc70d860700 1 --2- 172.21.15.80:0/3930513731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7080734b0 0x7fc7080723e0 unknown :-1 s=CLOSED pgs=2599 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.017+0000 7fc70d860700 1 --2- 172.21.15.80:0/3930513731 >> v2:172.21.15.174:3300/0 conn(0x7fc708073020 0x7fc708071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:29.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.017+0000 7fc70d860700 1 --2- 172.21.15.80:0/3930513731 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc70815ed10 0x7fc70815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:29.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.017+0000 7fc70d860700 1 -- 172.21.15.80:0/3930513731 shutdown_connections 2019-11-28T11:54:29.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.017+0000 7fc70d860700 1 -- 172.21.15.80:0/3930513731 wait complete. 2019-11-28T11:54:29.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.017+0000 7fc70d860700 1 -- 172.21.15.80:0/3930513731 >> 172.21.15.80:0/3930513731 conn(0x7fc708061d20 msgr2=0x7fc7080641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:29.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.019+0000 7fc70d860700 1 Processor -- start 2019-11-28T11:54:29.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.019+0000 7fc70d860700 1 -- start start 2019-11-28T11:54:29.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.020+0000 7fc70d860700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc70810ed60 0x7fc70810f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:29.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.020+0000 7fc70d860700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc70810f730 0x7fc708167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:29.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.020+0000 7fc70d860700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70810c250 con 0x7fc70810e970 2019-11-28T11:54:29.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.020+0000 7fc70d860700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70810e430 con 0x7fc70810f730 2019-11-28T11:54:29.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.020+0000 7fc70d860700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc708105860 con 0x7fc70810ed60 2019-11-28T11:54:29.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.020+0000 7fc7077fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc70810e970 0x7fc7081087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44690/0 (socket says 172.21.15.80:44690) 2019-11-28T11:54:29.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.020+0000 7fc7077fe700 1 -- 172.21.15.80:0/3801426868 learned_addr learned my addr 172.21.15.80:0/3801426868 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:29.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.020+0000 7fc707fff700 1 --2- 172.21.15.80:0/3801426868 >> v2:172.21.15.80:3300/0 conn(0x7fc70810f730 0x7fc708167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:29.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.020+0000 7fc706ffd700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc70810ed60 0x7fc70810f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:29.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc6fffff700 1 -- 172.21.15.80:0/3801426868 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626934200 0 0) 0x7fc6f8005b30 con 0x7fc70810e970 2019-11-28T11:54:29.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc707fff700 1 -- 172.21.15.80:0/3801426868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc70810ed60 msgr2=0x7fc70810f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc707fff700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc70810ed60 0x7fc70810f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc707fff700 1 -- 172.21.15.80:0/3801426868 >> v1:172.21.15.80:6789/0 conn(0x7fc70810e970 legacy=0x7fc7081087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc707fff700 1 -- 172.21.15.80:0/3801426868 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc708105ef0 con 0x7fc70810f730 2019-11-28T11:54:29.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc707fff700 1 --2- 172.21.15.80:0/3801426868 >> v2:172.21.15.80:3300/0 conn(0x7fc70810f730 0x7fc708167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc700010360 tx=0x7fc7000101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc707fff700 1 --2- 172.21.15.80:0/3801426868 >> v2:172.21.15.80:3300/0 conn(0x7fc70810f730 0x7fc708167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc700010360 tx=0x7fc7000101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc707fff700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70810f730 0x7fc708167d70 secure :-1 s=READY pgs=2601 cs=0 l=1 rx=0x7fc700010360 tx=0x7fc7000101e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:29.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc707fff700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70810f730 0x7fc708167d70 secure :-1 s=THROTTLE_DONE pgs=2601 cs=0 l=1 rx=0x7fc700010360 tx=0x7fc7000101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc6fffff700 1 -- 172.21.15.80:0/3801426868 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc700000940 con 0x7fc70810f730 2019-11-28T11:54:29.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc707fff700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70810f730 0x7fc708167d70 secure :-1 s=THROTTLE_DONE pgs=2601 cs=0 l=1 rx=0x7fc700010360 tx=0x7fc7000101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc6fffff700 1 -- 172.21.15.80:0/3801426868 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7000012b0 con 0x7fc70810f730 2019-11-28T11:54:29.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc707fff700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70810f730 0x7fc708167d70 secure :-1 s=THROTTLE_DONE pgs=2601 cs=0 l=1 rx=0x7fc700010360 tx=0x7fc7000101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc6fffff700 1 -- 172.21.15.80:0/3801426868 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc700000940 con 0x7fc70810f730 2019-11-28T11:54:29.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc70d860700 1 -- 172.21.15.80:0/3801426868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc708106270 con 0x7fc70810f730 2019-11-28T11:54:29.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc70d860700 1 -- 172.21.15.80:0/3801426868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc708105ef0 con 0x7fc70810f730 2019-11-28T11:54:29.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.021+0000 7fc707fff700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70810f730 0x7fc708167d70 secure :-1 s=THROTTLE_DONE pgs=2601 cs=0 l=1 rx=0x7fc700010360 tx=0x7fc7000101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.022+0000 7fc6fffff700 1 -- 172.21.15.80:0/3801426868 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc7000014a0 con 0x7fc70810f730 2019-11-28T11:54:29.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.022+0000 7fc707fff700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70810f730 0x7fc708167d70 secure :-1 s=THROTTLE_DONE pgs=2601 cs=0 l=1 rx=0x7fc700010360 tx=0x7fc7000101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.022+0000 7fc6fffff700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc6e0018730 0x7fc6e001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:29.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.022+0000 7fc6fffff700 1 -- 172.21.15.80:0/3801426868 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5904+0+0 (secure 0 0 0) 0x7fc700031c20 con 0x7fc70810f730 2019-11-28T11:54:29.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.022+0000 7fc7077fe700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc6e0018730 0x7fc6e001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:29.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.022+0000 7fc7077fe700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc6e0018730 0x7fc6e001abc0 crc :-1 s=READY pgs=1069 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:29.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.029+0000 7fc70d860700 1 -- 172.21.15.80:0/3801426868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc708106270 con 0x7fc70810f730 2019-11-28T11:54:29.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.033+0000 7fc707fff700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70810f730 0x7fc708167d70 secure :-1 s=THROTTLE_DONE pgs=2601 cs=0 l=1 rx=0x7fc700010360 tx=0x7fc7000101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.033+0000 7fc6fffff700 1 -- 172.21.15.80:0/3801426868 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc700000eb0 con 0x7fc70810f730 2019-11-28T11:54:29.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.201+0000 7fc70d860700 1 -- 172.21.15.80:0/3801426868 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7fc708105ef0 con 0x7fc70810f730 2019-11-28T11:54:29.257 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:54:29.201+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:54:29.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.205+0000 7fc707fff700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70810f730 0x7fc708167d70 secure :-1 s=THROTTLE_DONE pgs=2601 cs=0 l=1 rx=0x7fc700010360 tx=0x7fc7000101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.205+0000 7fc6fffff700 1 -- 172.21.15.80:0/3801426868 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 32 and data pool 33 v164) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc7000014f0 con 0x7fc70810f730 2019-11-28T11:54:29.270 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 32 and data pool 33 2019-11-28T11:54:29.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.210+0000 7fc70d860700 1 -- 172.21.15.80:0/3801426868 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc6e0018730 msgr2=0x7fc6e001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.210+0000 7fc70d860700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc6e0018730 0x7fc6e001abc0 crc :-1 s=READY pgs=1069 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.210+0000 7fc70d860700 1 -- 172.21.15.80:0/3801426868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70810f730 msgr2=0x7fc708167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.210+0000 7fc70d860700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70810f730 0x7fc708167d70 secure :-1 s=READY pgs=2601 cs=0 l=1 rx=0x7fc700010360 tx=0x7fc7000101e0).stop 2019-11-28T11:54:29.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.210+0000 7fc70d860700 1 -- 172.21.15.80:0/3801426868 shutdown_connections 2019-11-28T11:54:29.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.210+0000 7fc70d860700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc6e0018730 0x7fc6e001abc0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.210+0000 7fc70d860700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc70810f730 0x7fc708167d70 unknown :-1 s=CLOSED pgs=2601 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.210+0000 7fc70d860700 1 --2- 172.21.15.80:0/3801426868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc70810ed60 0x7fc70810f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.211+0000 7fc70d860700 1 -- 172.21.15.80:0/3801426868 shutdown_connections 2019-11-28T11:54:29.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.211+0000 7fc70d860700 1 -- 172.21.15.80:0/3801426868 wait complete. 2019-11-28T11:54:29.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.211+0000 7fc70d860700 1 -- 172.21.15.80:0/3801426868 >> 172.21.15.80:0/3801426868 conn(0x7fc70815e2d0 msgr2=0x7fc708147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:29.283 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:54:29.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.348+0000 7fb258abd700 1 Processor -- start 2019-11-28T11:54:29.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.348+0000 7fb258abd700 1 -- start start 2019-11-28T11:54:29.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.349+0000 7fb258abd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb25406c0a0 0x7fb254072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:29.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.349+0000 7fb258abd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb2540734e0 0x7fb254071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:29.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.349+0000 7fb258abd700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb25406db00 con 0x7fb254072360 2019-11-28T11:54:29.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.349+0000 7fb258abd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25406fd60 con 0x7fb25406c0a0 2019-11-28T11:54:29.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.349+0000 7fb258abd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb254070030 con 0x7fb2540734e0 2019-11-28T11:54:29.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.349+0000 7fb252d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb25406c0a0 0x7fb254072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:29.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.349+0000 7fb252d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb25406c0a0 0x7fb254072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45382/0 (socket says 172.21.15.80:45382) 2019-11-28T11:54:29.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.349+0000 7fb25359e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb254072360 0x7fb25406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44700/0 (socket says 172.21.15.80:44700) 2019-11-28T11:54:29.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb252d9d700 1 -- 172.21.15.80:0/143367985 learned_addr learned my addr 172.21.15.80:0/143367985 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:29.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb25259c700 1 --2- 172.21.15.80:0/143367985 >> v2:172.21.15.174:3300/0 conn(0x7fb2540734e0 0x7fb254071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:29.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb252d9d700 1 -- 172.21.15.80:0/143367985 >> v2:172.21.15.174:3300/0 conn(0x7fb2540734e0 msgr2=0x7fb254071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:29.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb252d9d700 1 --2- 172.21.15.80:0/143367985 >> v2:172.21.15.174:3300/0 conn(0x7fb2540734e0 0x7fb254071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:29.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb252d9d700 1 -- 172.21.15.80:0/143367985 >> v1:172.21.15.80:6789/0 conn(0x7fb254072360 legacy=0x7fb25406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb251d9b700 1 -- 172.21.15.80:0/143367985 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884971225 0 0) 0x7fb24c000d30 con 0x7fb254072360 2019-11-28T11:54:29.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb252d9d700 1 -- 172.21.15.80:0/143367985 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2540706c0 con 0x7fb25406c0a0 2019-11-28T11:54:29.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb252d9d700 1 --2- 172.21.15.80:0/143367985 >> v2:172.21.15.80:3300/0 conn(0x7fb25406c0a0 0x7fb254072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb24400f6c0 tx=0x7fb24400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb252d9d700 1 --2- 172.21.15.80:0/143367985 >> v2:172.21.15.80:3300/0 conn(0x7fb25406c0a0 0x7fb254072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb24400f6c0 tx=0x7fb24400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb252d9d700 1 --2- 172.21.15.80:0/143367985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25406c0a0 0x7fb254072fa0 secure :-1 s=READY pgs=2603 cs=0 l=1 rx=0x7fb24400f6c0 tx=0x7fb24400fa60).ready entity=mon.0 client_cookie=ebe01714da9a2f28 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:29.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb252d9d700 1 --2- 172.21.15.80:0/143367985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25406c0a0 0x7fb254072fa0 secure :-1 s=THROTTLE_DONE pgs=2603 cs=0 l=1 rx=0x7fb24400f6c0 tx=0x7fb24400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb251d9b700 1 -- 172.21.15.80:0/143367985 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb244000960 con 0x7fb25406c0a0 2019-11-28T11:54:29.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb252d9d700 1 --2- 172.21.15.80:0/143367985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25406c0a0 0x7fb254072fa0 secure :-1 s=THROTTLE_DONE pgs=2603 cs=0 l=1 rx=0x7fb24400f6c0 tx=0x7fb24400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb252d9d700 1 --2- 172.21.15.80:0/143367985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25406c0a0 0x7fb254072fa0 secure :-1 s=THROTTLE_DONE pgs=2603 cs=0 l=1 rx=0x7fb24400f6c0 tx=0x7fb24400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb251d9b700 1 -- 172.21.15.80:0/143367985 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb244000c90 con 0x7fb25406c0a0 2019-11-28T11:54:29.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb251d9b700 1 -- 172.21.15.80:0/143367985 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb244007210 con 0x7fb25406c0a0 2019-11-28T11:54:29.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb258abd700 1 -- 172.21.15.80:0/143367985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25406c0a0 msgr2=0x7fb254072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.350+0000 7fb258abd700 1 --2- 172.21.15.80:0/143367985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25406c0a0 0x7fb254072fa0 secure :-1 s=READY pgs=2603 cs=0 l=1 rx=0x7fb24400f6c0 tx=0x7fb24400fa60).stop 2019-11-28T11:54:29.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.351+0000 7fb258abd700 1 -- 172.21.15.80:0/143367985 shutdown_connections 2019-11-28T11:54:29.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.351+0000 7fb258abd700 1 --2- 172.21.15.80:0/143367985 >> v2:172.21.15.174:3300/0 conn(0x7fb2540734e0 0x7fb254071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:29.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.351+0000 7fb258abd700 1 --2- 172.21.15.80:0/143367985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25406c0a0 0x7fb254072fa0 unknown :-1 s=CLOSED pgs=2603 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.351+0000 7fb258abd700 1 -- 172.21.15.80:0/143367985 shutdown_connections 2019-11-28T11:54:29.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.351+0000 7fb258abd700 1 -- 172.21.15.80:0/143367985 wait complete. 2019-11-28T11:54:29.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.351+0000 7fb258abd700 1 -- 172.21.15.80:0/143367985 >> 172.21.15.80:0/143367985 conn(0x7fb254061cf0 msgr2=0x7fb254064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:29.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.353+0000 7fb258abd700 1 Processor -- start 2019-11-28T11:54:29.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.353+0000 7fb258abd700 1 -- start start 2019-11-28T11:54:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.354+0000 7fb258abd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb25413e300 0x7fb25413e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:29.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.354+0000 7fb258abd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb25410db50 0x7fb2541089f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.354+0000 7fb258abd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2541066e0 con 0x7fb25410d6c0 2019-11-28T11:54:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.354+0000 7fb258abd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25410a4a0 con 0x7fb25413e300 2019-11-28T11:54:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.354+0000 7fb258abd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25410a770 con 0x7fb25410db50 2019-11-28T11:54:29.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.354+0000 7fb252d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb25413e300 0x7fb25413e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:29.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.354+0000 7fb252d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb25413e300 0x7fb25413e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45388/0 (socket says 172.21.15.80:45388) 2019-11-28T11:54:29.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.354+0000 7fb252d9d700 1 -- 172.21.15.80:0/400976316 learned_addr learned my addr 172.21.15.80:0/400976316 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:29.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.354+0000 7fb25359e700 1 --2- 172.21.15.80:0/400976316 >> v2:172.21.15.174:3300/0 conn(0x7fb25410db50 0x7fb2541089f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:29.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb252d9d700 1 -- 172.21.15.80:0/400976316 >> v2:172.21.15.174:3300/0 conn(0x7fb25410db50 msgr2=0x7fb2541089f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb252d9d700 1 --2- 172.21.15.80:0/400976316 >> v2:172.21.15.174:3300/0 conn(0x7fb25410db50 0x7fb2541089f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb252d9d700 1 -- 172.21.15.80:0/400976316 >> v1:172.21.15.174:6789/0 conn(0x7fb25410d6c0 legacy=0x7fb2541081f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb252d9d700 1 -- 172.21.15.80:0/400976316 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25410ae00 con 0x7fb25413e300 2019-11-28T11:54:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb25359e700 1 --2- 172.21.15.80:0/400976316 >> v2:172.21.15.174:3300/0 conn(0x7fb25410db50 0x7fb2541089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb252d9d700 1 --2- 172.21.15.80:0/400976316 >> v2:172.21.15.80:3300/0 conn(0x7fb25413e300 0x7fb25413e6f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb244010450 tx=0x7fb2440107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb252d9d700 1 --2- 172.21.15.80:0/400976316 >> v2:172.21.15.80:3300/0 conn(0x7fb25413e300 0x7fb25413e6f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb244010450 tx=0x7fb2440107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb252d9d700 1 --2- 172.21.15.80:0/400976316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25413e300 0x7fb25413e6f0 secure :-1 s=READY pgs=2604 cs=0 l=1 rx=0x7fb244010450 tx=0x7fb2440107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb252d9d700 1 --2- 172.21.15.80:0/400976316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25413e300 0x7fb25413e6f0 secure :-1 s=THROTTLE_DONE pgs=2604 cs=0 l=1 rx=0x7fb244010450 tx=0x7fb2440107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb24b7fe700 1 -- 172.21.15.80:0/400976316 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb244000940 con 0x7fb25413e300 2019-11-28T11:54:29.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb252d9d700 1 --2- 172.21.15.80:0/400976316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25413e300 0x7fb25413e6f0 secure :-1 s=THROTTLE_DONE pgs=2604 cs=0 l=1 rx=0x7fb244010450 tx=0x7fb2440107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb252d9d700 1 --2- 172.21.15.80:0/400976316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25413e300 0x7fb25413e6f0 secure :-1 s=THROTTLE_DONE pgs=2604 cs=0 l=1 rx=0x7fb244010450 tx=0x7fb2440107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb24b7fe700 1 -- 172.21.15.80:0/400976316 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb244000e60 con 0x7fb25413e300 2019-11-28T11:54:29.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb258abd700 1 -- 172.21.15.80:0/400976316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb25410b180 con 0x7fb25413e300 2019-11-28T11:54:29.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb24b7fe700 1 -- 172.21.15.80:0/400976316 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2440014b0 con 0x7fb25413e300 2019-11-28T11:54:29.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb258abd700 1 -- 172.21.15.80:0/400976316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25410ae00 con 0x7fb25413e300 2019-11-28T11:54:29.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.355+0000 7fb252d9d700 1 --2- 172.21.15.80:0/400976316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25413e300 0x7fb25413e6f0 secure :-1 s=THROTTLE_DONE pgs=2604 cs=0 l=1 rx=0x7fb244010450 tx=0x7fb2440107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.356+0000 7fb24b7fe700 1 -- 172.21.15.80:0/400976316 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb244001050 con 0x7fb25413e300 2019-11-28T11:54:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.356+0000 7fb252d9d700 1 --2- 172.21.15.80:0/400976316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25413e300 0x7fb25413e6f0 secure :-1 s=THROTTLE_DONE pgs=2604 cs=0 l=1 rx=0x7fb244010450 tx=0x7fb2440107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.356+0000 7fb24b7fe700 1 --2- 172.21.15.80:0/400976316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb238018730 0x7fb23801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:29.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.356+0000 7fb24b7fe700 1 -- 172.21.15.80:0/400976316 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb244031ad0 con 0x7fb25413e300 2019-11-28T11:54:29.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.356+0000 7fb25259c700 1 --2- 172.21.15.80:0/400976316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb238018730 0x7fb23801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:29.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.356+0000 7fb25259c700 1 --2- 172.21.15.80:0/400976316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb238018730 0x7fb23801abc0 crc :-1 s=READY pgs=1070 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:29.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.364+0000 7fb258abd700 1 -- 172.21.15.80:0/400976316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25410b180 con 0x7fb25413e300 2019-11-28T11:54:29.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.367+0000 7fb252d9d700 1 --2- 172.21.15.80:0/400976316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25413e300 0x7fb25413e6f0 secure :-1 s=THROTTLE_DONE pgs=2604 cs=0 l=1 rx=0x7fb244010450 tx=0x7fb2440107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.367+0000 7fb24b7fe700 1 -- 172.21.15.80:0/400976316 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb244000c50 con 0x7fb25413e300 2019-11-28T11:54:29.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.541+0000 7fb258abd700 1 -- 172.21.15.80:0/400976316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb25410ae00 con 0x7fb25413e300 2019-11-28T11:54:29.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.542+0000 7fb252d9d700 1 --2- 172.21.15.80:0/400976316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25413e300 0x7fb25413e6f0 secure :-1 s=THROTTLE_DONE pgs=2604 cs=0 l=1 rx=0x7fb244010450 tx=0x7fb2440107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.542+0000 7fb24b7fe700 1 -- 172.21.15.80:0/400976316 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+14884 (secure 0 0 0) 0x7fb244017270 con 0x7fb25413e300 2019-11-28T11:54:29.598 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:29.598 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":202,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:54:29.201867+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:54:27.540791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":33,"pool_name":"cephfs_data","create_time":"2019-11-28T11:54:28.225144+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:54:29.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.544+0000 7fb258abd700 1 -- 172.21.15.80:0/400976316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb238018730 msgr2=0x7fb23801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.544+0000 7fb258abd700 1 --2- 172.21.15.80:0/400976316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb238018730 0x7fb23801abc0 crc :-1 s=READY pgs=1070 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.544+0000 7fb258abd700 1 -- 172.21.15.80:0/400976316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25413e300 msgr2=0x7fb25413e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.544+0000 7fb258abd700 1 --2- 172.21.15.80:0/400976316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25413e300 0x7fb25413e6f0 secure :-1 s=READY pgs=2604 cs=0 l=1 rx=0x7fb244010450 tx=0x7fb2440107f0).stop 2019-11-28T11:54:29.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.544+0000 7fb258abd700 1 -- 172.21.15.80:0/400976316 shutdown_connections 2019-11-28T11:54:29.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.544+0000 7fb258abd700 1 --2- 172.21.15.80:0/400976316 >> v2:172.21.15.174:3300/0 conn(0x7fb25410db50 0x7fb2541089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.544+0000 7fb258abd700 1 --2- 172.21.15.80:0/400976316 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb238018730 0x7fb23801abc0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.544+0000 7fb258abd700 1 --2- 172.21.15.80:0/400976316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb25413e300 0x7fb25413e6f0 unknown :-1 s=CLOSED pgs=2604 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.544+0000 7fb258abd700 1 -- 172.21.15.80:0/400976316 shutdown_connections 2019-11-28T11:54:29.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.544+0000 7fb258abd700 1 -- 172.21.15.80:0/400976316 wait complete. 2019-11-28T11:54:29.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.544+0000 7fb258abd700 1 -- 172.21.15.80:0/400976316 >> 172.21.15.80:0/400976316 conn(0x7fb25413d620 msgr2=0x7fb25413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:29.611 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:54:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.675+0000 7f2b44a5a700 1 Processor -- start 2019-11-28T11:54:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.675+0000 7f2b44a5a700 1 -- start start 2019-11-28T11:54:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b44a5a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2b4006c0a0 0x7f2b40072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b44a5a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b400734e0 0x7f2b40071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b44a5a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4006db00 con 0x7f2b40072360 2019-11-28T11:54:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b44a5a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4006fd60 con 0x7f2b400734e0 2019-11-28T11:54:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b44a5a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b40070030 con 0x7f2b4006c0a0 2019-11-28T11:54:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b3e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b400734e0 0x7f2b40071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b3e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b400734e0 0x7f2b40071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45396/0 (socket says 172.21.15.80:45396) 2019-11-28T11:54:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b3e59c700 1 -- 172.21.15.80:0/2801807772 learned_addr learned my addr 172.21.15.80:0/2801807772 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b3ed9d700 1 --2- 172.21.15.80:0/2801807772 >> v2:172.21.15.174:3300/0 conn(0x7f2b4006c0a0 0x7f2b40072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b3e59c700 1 -- 172.21.15.80:0/2801807772 >> v2:172.21.15.174:3300/0 conn(0x7f2b4006c0a0 msgr2=0x7f2b40072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:29.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b3e59c700 1 --2- 172.21.15.80:0/2801807772 >> v2:172.21.15.174:3300/0 conn(0x7f2b4006c0a0 0x7f2b40072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:29.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b3e59c700 1 -- 172.21.15.80:0/2801807772 >> v1:172.21.15.174:6789/0 conn(0x7f2b40072360 legacy=0x7f2b4006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b3e59c700 1 -- 172.21.15.80:0/2801807772 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b400706c0 con 0x7f2b400734e0 2019-11-28T11:54:29.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b3e59c700 1 --2- 172.21.15.80:0/2801807772 >> v2:172.21.15.80:3300/0 conn(0x7f2b400734e0 0x7f2b40071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2b3000f6c0 tx=0x7f2b3000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b3e59c700 1 --2- 172.21.15.80:0/2801807772 >> v2:172.21.15.80:3300/0 conn(0x7f2b400734e0 0x7f2b40071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2b3000f6c0 tx=0x7f2b3000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b3e59c700 1 --2- 172.21.15.80:0/2801807772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b400734e0 0x7f2b40071e20 secure :-1 s=READY pgs=2605 cs=0 l=1 rx=0x7f2b3000f6c0 tx=0x7f2b3000fa60).ready entity=mon.0 client_cookie=4931e68db1685f14 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.676+0000 7f2b3e59c700 1 --2- 172.21.15.80:0/2801807772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b400734e0 0x7f2b40071e20 secure :-1 s=THROTTLE_DONE pgs=2605 cs=0 l=1 rx=0x7f2b3000f6c0 tx=0x7f2b3000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.677+0000 7f2b3dd9b700 1 -- 172.21.15.80:0/2801807772 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b30000960 con 0x7f2b400734e0 2019-11-28T11:54:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.677+0000 7f2b3e59c700 1 --2- 172.21.15.80:0/2801807772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b400734e0 0x7f2b40071e20 secure :-1 s=THROTTLE_DONE pgs=2605 cs=0 l=1 rx=0x7f2b3000f6c0 tx=0x7f2b3000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.677+0000 7f2b3e59c700 1 --2- 172.21.15.80:0/2801807772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b400734e0 0x7f2b40071e20 secure :-1 s=THROTTLE_DONE pgs=2605 cs=0 l=1 rx=0x7f2b3000f6c0 tx=0x7f2b3000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.677+0000 7f2b3dd9b700 1 -- 172.21.15.80:0/2801807772 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b30000c90 con 0x7f2b400734e0 2019-11-28T11:54:29.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.677+0000 7f2b3dd9b700 1 -- 172.21.15.80:0/2801807772 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b300013a0 con 0x7f2b400734e0 2019-11-28T11:54:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.677+0000 7f2b44a5a700 1 -- 172.21.15.80:0/2801807772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b400734e0 msgr2=0x7f2b40071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.677+0000 7f2b44a5a700 1 --2- 172.21.15.80:0/2801807772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b400734e0 0x7f2b40071e20 secure :-1 s=READY pgs=2605 cs=0 l=1 rx=0x7f2b3000f6c0 tx=0x7f2b3000fa60).stop 2019-11-28T11:54:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.677+0000 7f2b44a5a700 1 -- 172.21.15.80:0/2801807772 shutdown_connections 2019-11-28T11:54:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.677+0000 7f2b44a5a700 1 --2- 172.21.15.80:0/2801807772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b400734e0 0x7f2b40071e20 unknown :-1 s=CLOSED pgs=2605 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.677+0000 7f2b44a5a700 1 --2- 172.21.15.80:0/2801807772 >> v2:172.21.15.174:3300/0 conn(0x7f2b4006c0a0 0x7f2b40072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.677+0000 7f2b44a5a700 1 -- 172.21.15.80:0/2801807772 shutdown_connections 2019-11-28T11:54:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.677+0000 7f2b44a5a700 1 -- 172.21.15.80:0/2801807772 wait complete. 2019-11-28T11:54:29.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.677+0000 7f2b44a5a700 1 -- 172.21.15.80:0/2801807772 >> 172.21.15.80:0/2801807772 conn(0x7f2b40061cf0 msgr2=0x7f2b40064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:29.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.680+0000 7f2b44a5a700 1 Processor -- start 2019-11-28T11:54:29.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.680+0000 7f2b44a5a700 1 -- start start 2019-11-28T11:54:29.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b44a5a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2b4013a780 0x7f2b4012d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:29.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b44a5a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b4012d9c0 0x7f2b4012c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:29.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b44a5a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b40139a60 con 0x7f2b4012c840 2019-11-28T11:54:29.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b44a5a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4012a260 con 0x7f2b4013a780 2019-11-28T11:54:29.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b44a5a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4012a530 con 0x7f2b4012d9c0 2019-11-28T11:54:29.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b3ed9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2b4013a780 0x7f2b4012d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:29.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b3e59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b4012d9c0 0x7f2b4012c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:29.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b3ed9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2b4013a780 0x7f2b4012d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:60288/0 (socket says 172.21.15.80:60288) 2019-11-28T11:54:29.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b3ed9d700 1 -- 172.21.15.80:0/540696592 learned_addr learned my addr 172.21.15.80:0/540696592 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:29.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b3e59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b4012d9c0 0x7f2b4012c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:47662/0 (socket says 172.21.15.80:47662) 2019-11-28T11:54:29.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b3ed9d700 1 -- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b4012d9c0 msgr2=0x7f2b4012c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b3ed9d700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b4012d9c0 0x7f2b4012c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b3ed9d700 1 -- 172.21.15.80:0/540696592 >> v1:172.21.15.174:6789/0 conn(0x7f2b4012c840 legacy=0x7f2b401281b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b3ed9d700 1 -- 172.21.15.80:0/540696592 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4012abc0 con 0x7f2b4013a780 2019-11-28T11:54:29.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b3ed9d700 1 --2- 172.21.15.80:0/540696592 >> v2:172.21.15.174:3300/0 conn(0x7f2b4013a780 0x7f2b4012d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b34010750 tx=0x7f2b34010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b3ed9d700 1 --2- 172.21.15.80:0/540696592 >> v2:172.21.15.174:3300/0 conn(0x7f2b4013a780 0x7f2b4012d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b34010750 tx=0x7f2b34010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.681+0000 7f2b3ed9d700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b4013a780 0x7f2b4012d480 secure :-1 s=READY pgs=1568 cs=0 l=1 rx=0x7f2b34010750 tx=0x7f2b34010af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:29.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.682+0000 7f2b3ed9d700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b4013a780 0x7f2b4012d480 secure :-1 s=THROTTLE_DONE pgs=1568 cs=0 l=1 rx=0x7f2b34010750 tx=0x7f2b34010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.682+0000 7f2b2f7fe700 1 -- 172.21.15.80:0/540696592 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b34000cc0 con 0x7f2b4013a780 2019-11-28T11:54:29.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.682+0000 7f2b3ed9d700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b4013a780 0x7f2b4012d480 secure :-1 s=THROTTLE_DONE pgs=1568 cs=0 l=1 rx=0x7f2b34010750 tx=0x7f2b34010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.682+0000 7f2b3ed9d700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b4013a780 0x7f2b4012d480 secure :-1 s=THROTTLE_DONE pgs=1568 cs=0 l=1 rx=0x7f2b34010750 tx=0x7f2b34010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.682+0000 7f2b2f7fe700 1 -- 172.21.15.80:0/540696592 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b34008a80 con 0x7f2b4013a780 2019-11-28T11:54:29.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.682+0000 7f2b2f7fe700 1 -- 172.21.15.80:0/540696592 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b34009110 con 0x7f2b4013a780 2019-11-28T11:54:29.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.682+0000 7f2b44a5a700 1 -- 172.21.15.80:0/540696592 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4012af40 con 0x7f2b4013a780 2019-11-28T11:54:29.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.682+0000 7f2b44a5a700 1 -- 172.21.15.80:0/540696592 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4012abc0 con 0x7f2b4013a780 2019-11-28T11:54:29.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.682+0000 7f2b3ed9d700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b4013a780 0x7f2b4012d480 secure :-1 s=THROTTLE_DONE pgs=1568 cs=0 l=1 rx=0x7f2b34010750 tx=0x7f2b34010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.682+0000 7f2b2f7fe700 1 -- 172.21.15.80:0/540696592 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2b34008c70 con 0x7f2b4013a780 2019-11-28T11:54:29.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.682+0000 7f2b3ed9d700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b4013a780 0x7f2b4012d480 secure :-1 s=THROTTLE_DONE pgs=1568 cs=0 l=1 rx=0x7f2b34010750 tx=0x7f2b34010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.682+0000 7f2b2f7fe700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b24018730 0x7f2b2401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:29.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.683+0000 7f2b2f7fe700 1 -- 172.21.15.80:0/540696592 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2b34031e50 con 0x7f2b4013a780 2019-11-28T11:54:29.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.683+0000 7f2b3e59c700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b24018730 0x7f2b2401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:29.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.683+0000 7f2b3e59c700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b24018730 0x7f2b2401abc0 crc :-1 s=READY pgs=1071 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:29.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.690+0000 7f2b44a5a700 1 -- 172.21.15.80:0/540696592 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4012af40 con 0x7f2b4013a780 2019-11-28T11:54:29.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.694+0000 7f2b3ed9d700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b4013a780 0x7f2b4012d480 secure :-1 s=THROTTLE_DONE pgs=1568 cs=0 l=1 rx=0x7f2b34010750 tx=0x7f2b34010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.694+0000 7f2b2f7fe700 1 -- 172.21.15.80:0/540696592 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2b34008870 con 0x7f2b4013a780 2019-11-28T11:54:29.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.869+0000 7f2b44a5a700 1 -- 172.21.15.80:0/540696592 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b4012abc0 con 0x7f2b4013a780 2019-11-28T11:54:29.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.870+0000 7f2b3ed9d700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b4013a780 0x7f2b4012d480 secure :-1 s=THROTTLE_DONE pgs=1568 cs=0 l=1 rx=0x7f2b34010750 tx=0x7f2b34010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:29.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.870+0000 7f2b2f7fe700 1 -- 172.21.15.80:0/540696592 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+14884 (secure 0 0 0) 0x7f2b34008c50 con 0x7f2b4013a780 2019-11-28T11:54:29.928 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:29.928 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":202,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:54:29.201867+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:54:27.540791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":33,"pool_name":"cephfs_data","create_time":"2019-11-28T11:54:28.225144+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:54:29.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.874+0000 7f2b44a5a700 1 -- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b24018730 msgr2=0x7f2b2401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.874+0000 7f2b44a5a700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b24018730 0x7f2b2401abc0 crc :-1 s=READY pgs=1071 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.874+0000 7f2b44a5a700 1 -- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b4013a780 msgr2=0x7f2b4012d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.874+0000 7f2b44a5a700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b4013a780 0x7f2b4012d480 secure :-1 s=READY pgs=1568 cs=0 l=1 rx=0x7f2b34010750 tx=0x7f2b34010af0).stop 2019-11-28T11:54:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.874+0000 7f2b44a5a700 1 -- 172.21.15.80:0/540696592 shutdown_connections 2019-11-28T11:54:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.874+0000 7f2b44a5a700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b24018730 0x7f2b2401abc0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.874+0000 7f2b44a5a700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b4012d9c0 0x7f2b4012c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.874+0000 7f2b44a5a700 1 --2- 172.21.15.80:0/540696592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b4013a780 0x7f2b4012d480 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:29.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.875+0000 7f2b44a5a700 1 -- 172.21.15.80:0/540696592 shutdown_connections 2019-11-28T11:54:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.875+0000 7f2b44a5a700 1 -- 172.21.15.80:0/540696592 wait complete. 2019-11-28T11:54:29.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:29.875+0000 7f2b44a5a700 1 -- 172.21.15.80:0/540696592 >> 172.21.15.80:0/540696592 conn(0x7f2b40127dc0 msgr2=0x7f2b40141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:29.941 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:54:30.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.008+0000 7fd28ab4d700 1 Processor -- start 2019-11-28T11:54:30.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.008+0000 7fd28ab4d700 1 -- start start 2019-11-28T11:54:30.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.009+0000 7fd28ab4d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd28415f100 0x7fd28406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:30.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.009+0000 7fd28ab4d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28406db60 con 0x7fd28406c2f0 2019-11-28T11:54:30.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.009+0000 7fd28ab4d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28406e060 con 0x7fd28415ed10 2019-11-28T11:54:30.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.009+0000 7fd28ab4d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28406fe00 con 0x7fd28415f100 2019-11-28T11:54:30.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.009+0000 7fd2898eb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd28406c2f0 0x7fd28406c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44730/0 (socket says 172.21.15.80:44730) 2019-11-28T11:54:30.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.009+0000 7fd2898eb700 1 -- 172.21.15.80:0/163882368 learned_addr learned my addr 172.21.15.80:0/163882368 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:30.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd2888e9700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd28415f100 0x7fd28406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:30.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 -- 172.21.15.80:0/163882368 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518901457 0 0) 0x7fd27c001150 con 0x7fd28406c2f0 2019-11-28T11:54:30.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 -- 172.21.15.80:0/163882368 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd270002e80 con 0x7fd28406c2f0 2019-11-28T11:54:30.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 -- 172.21.15.80:0/163882368 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273109083 0 0) 0x7fd274001080 con 0x7fd28415ed10 2019-11-28T11:54:30.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 -- 172.21.15.80:0/163882368 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2700030b0 con 0x7fd28415ed10 2019-11-28T11:54:30.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 -- 172.21.15.80:0/163882368 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2278841068 0 0) 0x7fd27c001130 con 0x7fd28406c2f0 2019-11-28T11:54:30.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 -- 172.21.15.80:0/163882368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd28415f100 msgr2=0x7fd28406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:30.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd28415f100 0x7fd28406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:30.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 -- 172.21.15.80:0/163882368 >> v1:172.21.15.174:6789/0 conn(0x7fd28415ed10 legacy=0x7fd284073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:30.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 -- 172.21.15.80:0/163882368 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284070760 con 0x7fd28406c2f0 2019-11-28T11:54:30.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 -- 172.21.15.80:0/163882368 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd27c001660 con 0x7fd28406c2f0 2019-11-28T11:54:30.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 -- 172.21.15.80:0/163882368 >> v1:172.21.15.80:6789/0 conn(0x7fd28406c2f0 legacy=0x7fd28406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:30.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd270003b30 0x7fd270005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:30.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2700066c0 0x7fd270008b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:30.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd27004d3a0 0x7fd27004f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:30.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 -- 172.21.15.80:0/163882368 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27004ffd0 con 0x7fd270003b30 2019-11-28T11:54:30.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 -- 172.21.15.80:0/163882368 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd270050200 con 0x7fd2700066c0 2019-11-28T11:54:30.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd27bfff700 1 -- 172.21.15.80:0/163882368 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd270050430 con 0x7fd27004d3a0 2019-11-28T11:54:30.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd2890ea700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd270003b30 0x7fd270005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:30.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd2888e9700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2700066c0 0x7fd270008b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:30.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd2898eb700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd27004d3a0 0x7fd27004f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:30.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd2890ea700 1 -- 172.21.15.80:0/163882368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd27004d3a0 msgr2=0x7fd27004f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:30.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd2890ea700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd27004d3a0 0x7fd27004f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:30.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd2890ea700 1 -- 172.21.15.80:0/163882368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2700066c0 msgr2=0x7fd270008b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:30.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd2890ea700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2700066c0 0x7fd270008b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:30.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd2890ea700 1 -- 172.21.15.80:0/163882368 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2700506e0 con 0x7fd270003b30 2019-11-28T11:54:30.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd2898eb700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd27004d3a0 0x7fd27004f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:30.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd2890ea700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd270003b30 0x7fd270005f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd27400af70 tx=0x7fd27400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:30.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd2890ea700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd270003b30 0x7fd270005f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd27400af70 tx=0x7fd27400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:30.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.010+0000 7fd2890ea700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd270003b30 0x7fd270005f90 secure :-1 s=READY pgs=2607 cs=0 l=1 rx=0x7fd27400af70 tx=0x7fd27400b2f0).ready entity=mon.0 client_cookie=e175b61ee83bf9b7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:30.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.011+0000 7fd2890ea700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd270003b30 0x7fd270005f90 secure :-1 s=THROTTLE_DONE pgs=2607 cs=0 l=1 rx=0x7fd27400af70 tx=0x7fd27400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:30.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.011+0000 7fd27bfff700 1 -- 172.21.15.80:0/163882368 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd274009d50 con 0x7fd270003b30 2019-11-28T11:54:30.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.011+0000 7fd2890ea700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd270003b30 0x7fd270005f90 secure :-1 s=THROTTLE_DONE pgs=2607 cs=0 l=1 rx=0x7fd27400af70 tx=0x7fd27400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:30.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.011+0000 7fd2890ea700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd270003b30 0x7fd270005f90 secure :-1 s=THROTTLE_DONE pgs=2607 cs=0 l=1 rx=0x7fd27400af70 tx=0x7fd27400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:30.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.011+0000 7fd27bfff700 1 -- 172.21.15.80:0/163882368 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2740098d0 con 0x7fd270003b30 2019-11-28T11:54:30.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.011+0000 7fd27bfff700 1 -- 172.21.15.80:0/163882368 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd27400a330 con 0x7fd270003b30 2019-11-28T11:54:30.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.011+0000 7fd28ab4d700 1 -- 172.21.15.80:0/163882368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd270003b30 msgr2=0x7fd270005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:30.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.011+0000 7fd28ab4d700 1 --2- 172.21.15.80:0/163882368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd270003b30 0x7fd270005f90 secure :-1 s=READY pgs=2607 cs=0 l=1 rx=0x7fd27400af70 tx=0x7fd27400b2f0).stop 2019-11-28T11:54:30.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.011+0000 7fd2898eb700 1 -- 172.21.15.80:0/163882368 reap_dead start 2019-11-28T11:54:30.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.011+0000 7fd28ab4d700 1 -- 172.21.15.80:0/163882368 shutdown_connections 2019-11-28T11:54:30.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.011+0000 7fd28ab4d700 1 -- 172.21.15.80:0/163882368 shutdown_connections 2019-11-28T11:54:30.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.011+0000 7fd28ab4d700 1 -- 172.21.15.80:0/163882368 wait complete. 2019-11-28T11:54:30.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.011+0000 7fd28ab4d700 1 -- 172.21.15.80:0/163882368 >> 172.21.15.80:0/163882368 conn(0x7fd284061d20 msgr2=0x7fd2840641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:30.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.014+0000 7fd28ab4d700 1 Processor -- start 2019-11-28T11:54:30.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.014+0000 7fd28ab4d700 1 -- start start 2019-11-28T11:54:30.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd28ab4d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd284131490 0x7fd284131920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:30.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd28ab4d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28415ddb0 con 0x7fd284108920 2019-11-28T11:54:30.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd28ab4d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28410a1b0 con 0x7fd284131e60 2019-11-28T11:54:30.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd28ab4d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28411ec40 con 0x7fd284131490 2019-11-28T11:54:30.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd2888e9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd284131490 0x7fd284131920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:30.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd2890ea700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd284108920 0x7fd284132610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44738/0 (socket says 172.21.15.80:44738) 2019-11-28T11:54:30.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd2890ea700 1 -- 172.21.15.80:0/4072166931 learned_addr learned my addr 172.21.15.80:0/4072166931 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:30.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd2888e9700 1 -- 172.21.15.80:0/4072166931 >> v1:172.21.15.174:6789/0 conn(0x7fd284131e60 legacy=0x7fd28416ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:30.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd2888e9700 1 -- 172.21.15.80:0/4072166931 >> v1:172.21.15.80:6789/0 conn(0x7fd284108920 legacy=0x7fd284132610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:30.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd2888e9700 1 -- 172.21.15.80:0/4072166931 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2841300d0 con 0x7fd284131490 2019-11-28T11:54:30.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd2888e9700 1 --2- 172.21.15.80:0/4072166931 >> v2:172.21.15.80:3300/0 conn(0x7fd284131490 0x7fd284131920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2800106e0 tx=0x7fd280010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:30.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd2888e9700 1 --2- 172.21.15.80:0/4072166931 >> v2:172.21.15.80:3300/0 conn(0x7fd284131490 0x7fd284131920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2800106e0 tx=0x7fd280010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd2888e9700 1 --2- 172.21.15.80:0/4072166931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd284131490 0x7fd284131920 secure :-1 s=READY pgs=2609 cs=0 l=1 rx=0x7fd2800106e0 tx=0x7fd280010a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd2888e9700 1 --2- 172.21.15.80:0/4072166931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd284131490 0x7fd284131920 secure :-1 s=THROTTLE_DONE pgs=2609 cs=0 l=1 rx=0x7fd2800106e0 tx=0x7fd280010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd2888e9700 1 --2- 172.21.15.80:0/4072166931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd284131490 0x7fd284131920 secure :-1 s=THROTTLE_DONE pgs=2609 cs=0 l=1 rx=0x7fd2800106e0 tx=0x7fd280010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd2888e9700 1 --2- 172.21.15.80:0/4072166931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd284131490 0x7fd284131920 secure :-1 s=THROTTLE_DONE pgs=2609 cs=0 l=1 rx=0x7fd2800106e0 tx=0x7fd280010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.015+0000 7fd279ffb700 1 -- 172.21.15.80:0/4072166931 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd280000cc0 con 0x7fd284131490 2019-11-28T11:54:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.016+0000 7fd279ffb700 1 -- 172.21.15.80:0/4072166931 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd280001410 con 0x7fd284131490 2019-11-28T11:54:30.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.016+0000 7fd279ffb700 1 -- 172.21.15.80:0/4072166931 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd280001ae0 con 0x7fd284131490 2019-11-28T11:54:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.016+0000 7fd28ab4d700 1 -- 172.21.15.80:0/4072166931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28411e510 con 0x7fd284131490 2019-11-28T11:54:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.016+0000 7fd28ab4d700 1 -- 172.21.15.80:0/4072166931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2841300d0 con 0x7fd284131490 2019-11-28T11:54:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.016+0000 7fd2888e9700 1 --2- 172.21.15.80:0/4072166931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd284131490 0x7fd284131920 secure :-1 s=THROTTLE_DONE pgs=2609 cs=0 l=1 rx=0x7fd2800106e0 tx=0x7fd280010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.016+0000 7fd279ffb700 1 -- 172.21.15.80:0/4072166931 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd280001010 con 0x7fd284131490 2019-11-28T11:54:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.016+0000 7fd2888e9700 1 --2- 172.21.15.80:0/4072166931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd284131490 0x7fd284131920 secure :-1 s=THROTTLE_DONE pgs=2609 cs=0 l=1 rx=0x7fd2800106e0 tx=0x7fd280010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.016+0000 7fd279ffb700 1 --2- 172.21.15.80:0/4072166931 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd264018730 0x7fd26401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:30.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.016+0000 7fd279ffb700 1 -- 172.21.15.80:0/4072166931 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd280031de0 con 0x7fd284131490 2019-11-28T11:54:30.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.016+0000 7fd2890ea700 1 --2- 172.21.15.80:0/4072166931 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd264018730 0x7fd26401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:30.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.017+0000 7fd2890ea700 1 --2- 172.21.15.80:0/4072166931 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd264018730 0x7fd26401abc0 crc :-1 s=READY pgs=1072 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:30.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.024+0000 7fd28ab4d700 1 -- 172.21.15.80:0/4072166931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28411e510 con 0x7fd284131490 2019-11-28T11:54:30.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.027+0000 7fd2888e9700 1 --2- 172.21.15.80:0/4072166931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd284131490 0x7fd284131920 secure :-1 s=THROTTLE_DONE pgs=2609 cs=0 l=1 rx=0x7fd2800106e0 tx=0x7fd280010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:30.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.027+0000 7fd279ffb700 1 -- 172.21.15.80:0/4072166931 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd280024ff0 con 0x7fd284131490 2019-11-28T11:54:30.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.202+0000 7fd28ab4d700 1 -- 172.21.15.80:0/4072166931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7fd2841300d0 con 0x7fd284131490 2019-11-28T11:54:30.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.861+0000 7fd2888e9700 1 --2- 172.21.15.80:0/4072166931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd284131490 0x7fd284131920 secure :-1 s=THROTTLE_DONE pgs=2609 cs=0 l=1 rx=0x7fd2800106e0 tx=0x7fd280010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:30.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.861+0000 7fd279ffb700 1 -- 172.21.15.80:0/4072166931 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v165) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd280024ff0 con 0x7fd284131490 2019-11-28T11:54:30.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.869+0000 7fd28ab4d700 1 -- 172.21.15.80:0/4072166931 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd264018730 msgr2=0x7fd26401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:30.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.869+0000 7fd28ab4d700 1 --2- 172.21.15.80:0/4072166931 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd264018730 0x7fd26401abc0 crc :-1 s=READY pgs=1072 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:30.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.869+0000 7fd28ab4d700 1 -- 172.21.15.80:0/4072166931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd284131490 msgr2=0x7fd284131920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:30.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.869+0000 7fd28ab4d700 1 --2- 172.21.15.80:0/4072166931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd284131490 0x7fd284131920 secure :-1 s=READY pgs=2609 cs=0 l=1 rx=0x7fd2800106e0 tx=0x7fd280010a80).stop 2019-11-28T11:54:30.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.869+0000 7fd28ab4d700 1 -- 172.21.15.80:0/4072166931 shutdown_connections 2019-11-28T11:54:30.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.869+0000 7fd28ab4d700 1 --2- 172.21.15.80:0/4072166931 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd264018730 0x7fd26401abc0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:30.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.869+0000 7fd28ab4d700 1 --2- 172.21.15.80:0/4072166931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd284131490 0x7fd284131920 unknown :-1 s=CLOSED pgs=2609 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:30.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.869+0000 7fd28ab4d700 1 -- 172.21.15.80:0/4072166931 shutdown_connections 2019-11-28T11:54:30.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.869+0000 7fd28ab4d700 1 -- 172.21.15.80:0/4072166931 wait complete. 2019-11-28T11:54:30.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.869+0000 7fd28ab4d700 1 -- 172.21.15.80:0/4072166931 >> 172.21.15.80:0/4072166931 conn(0x7fd28414dbb0 msgr2=0x7fd284142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:30.935 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:31.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.998+0000 7f9efee88700 1 Processor -- start 2019-11-28T11:54:31.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:30.999+0000 7f9efee88700 1 -- start start 2019-11-28T11:54:31.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efee88700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ef806c0a0 0x7f9ef8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:31.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efee88700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9ef80734e0 0x7f9ef8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:31.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efee88700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9ef8072360 0x7f9ef80727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:31.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efee88700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef806f330 con 0x7f9ef80734e0 2019-11-28T11:54:31.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efee88700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef80706c0 con 0x7f9ef8072360 2019-11-28T11:54:31.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efee88700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8070a40 con 0x7f9ef806c0a0 2019-11-28T11:54:31.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efcc24700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9ef80734e0 0x7f9ef8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:31.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efcc24700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9ef80734e0 0x7f9ef8071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45434/0 (socket says 172.21.15.80:45434) 2019-11-28T11:54:31.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efcc24700 1 -- 172.21.15.80:0/1515799114 learned_addr learned my addr 172.21.15.80:0/1515799114 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:31.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efdc26700 1 --2- 172.21.15.80:0/1515799114 >> v2:172.21.15.174:3300/0 conn(0x7f9ef8072360 0x7f9ef80727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:31.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efd425700 1 --2- 172.21.15.80:0/1515799114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ef806c0a0 0x7f9ef8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:31.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efcc24700 1 -- 172.21.15.80:0/1515799114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ef806c0a0 msgr2=0x7f9ef8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:31.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efcc24700 1 --2- 172.21.15.80:0/1515799114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ef806c0a0 0x7f9ef8072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:31.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efcc24700 1 -- 172.21.15.80:0/1515799114 >> v2:172.21.15.174:3300/0 conn(0x7f9ef8072360 msgr2=0x7f9ef80727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:31.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efcc24700 1 --2- 172.21.15.80:0/1515799114 >> v2:172.21.15.174:3300/0 conn(0x7f9ef8072360 0x7f9ef80727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:31.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efcc24700 1 -- 172.21.15.80:0/1515799114 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef806db00 con 0x7f9ef80734e0 2019-11-28T11:54:31.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efd425700 1 --2- 172.21.15.80:0/1515799114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ef806c0a0 0x7f9ef8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:31.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efdc26700 1 --2- 172.21.15.80:0/1515799114 >> v2:172.21.15.174:3300/0 conn(0x7f9ef8072360 0x7f9ef80727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:31.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efcc24700 1 --2- 172.21.15.80:0/1515799114 >> v2:172.21.15.80:3300/0 conn(0x7f9ef80734e0 0x7f9ef8071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9ee000fac0 tx=0x7f9ee000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efcc24700 1 --2- 172.21.15.80:0/1515799114 >> v2:172.21.15.80:3300/0 conn(0x7f9ef80734e0 0x7f9ef8071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9ee000fac0 tx=0x7f9ee000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efcc24700 1 --2- 172.21.15.80:0/1515799114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef80734e0 0x7f9ef8071e20 secure :-1 s=READY pgs=2610 cs=0 l=1 rx=0x7f9ee000fac0 tx=0x7f9ee000fe60).ready entity=mon.0 client_cookie=3f2240f4c724e9e1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:31.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efcc24700 1 --2- 172.21.15.80:0/1515799114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef80734e0 0x7f9ef8071e20 secure :-1 s=THROTTLE_DONE pgs=2610 cs=0 l=1 rx=0x7f9ee000fac0 tx=0x7f9ee000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efcc24700 1 --2- 172.21.15.80:0/1515799114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef80734e0 0x7f9ef8071e20 secure :-1 s=THROTTLE_DONE pgs=2610 cs=0 l=1 rx=0x7f9ee000fac0 tx=0x7f9ee000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9ef7fff700 1 -- 172.21.15.80:0/1515799114 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ee0000ce0 con 0x7f9ef80734e0 2019-11-28T11:54:31.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.000+0000 7f9efcc24700 1 --2- 172.21.15.80:0/1515799114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef80734e0 0x7f9ef8071e20 secure :-1 s=THROTTLE_DONE pgs=2610 cs=0 l=1 rx=0x7f9ee000fac0 tx=0x7f9ee000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.001+0000 7f9ef7fff700 1 -- 172.21.15.80:0/1515799114 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee0001200 con 0x7f9ef80734e0 2019-11-28T11:54:31.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.001+0000 7f9ef7fff700 1 -- 172.21.15.80:0/1515799114 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ee0001950 con 0x7f9ef80734e0 2019-11-28T11:54:31.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.001+0000 7f9efee88700 1 -- 172.21.15.80:0/1515799114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef80734e0 msgr2=0x7f9ef8071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.001+0000 7f9efee88700 1 --2- 172.21.15.80:0/1515799114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef80734e0 0x7f9ef8071e20 secure :-1 s=READY pgs=2610 cs=0 l=1 rx=0x7f9ee000fac0 tx=0x7f9ee000fe60).stop 2019-11-28T11:54:31.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.001+0000 7f9efee88700 1 -- 172.21.15.80:0/1515799114 shutdown_connections 2019-11-28T11:54:31.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.001+0000 7f9efee88700 1 --2- 172.21.15.80:0/1515799114 >> v2:172.21.15.174:3300/0 conn(0x7f9ef8072360 0x7f9ef80727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:31.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.001+0000 7f9efee88700 1 --2- 172.21.15.80:0/1515799114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef80734e0 0x7f9ef8071e20 unknown :-1 s=CLOSED pgs=2610 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.001+0000 7f9efee88700 1 --2- 172.21.15.80:0/1515799114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ef806c0a0 0x7f9ef8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:31.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.001+0000 7f9efee88700 1 -- 172.21.15.80:0/1515799114 shutdown_connections 2019-11-28T11:54:31.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.001+0000 7f9efee88700 1 -- 172.21.15.80:0/1515799114 wait complete. 2019-11-28T11:54:31.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.001+0000 7f9efee88700 1 -- 172.21.15.80:0/1515799114 >> 172.21.15.80:0/1515799114 conn(0x7f9ef8061cf0 msgr2=0x7f9ef8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:31.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.004+0000 7f9efee88700 1 Processor -- start 2019-11-28T11:54:31.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.004+0000 7f9efee88700 1 -- start start 2019-11-28T11:54:31.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efee88700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9ef815fdf0 0x7f9ef812b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:31.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efee88700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ef812a3c0 0x7f9ef812a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:31.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efee88700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef813eb20 con 0x7f9ef812b8a0 2019-11-28T11:54:31.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efee88700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef8108820 con 0x7f9ef815fdf0 2019-11-28T11:54:31.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efee88700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8108af0 con 0x7f9ef812a3c0 2019-11-28T11:54:31.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efd425700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9ef815fdf0 0x7f9ef812b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:31.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efd425700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9ef815fdf0 0x7f9ef812b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45436/0 (socket says 172.21.15.80:45436) 2019-11-28T11:54:31.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efd425700 1 -- 172.21.15.80:0/3246178527 learned_addr learned my addr 172.21.15.80:0/3246178527 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:31.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efdc26700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ef812a3c0 0x7f9ef812a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:31.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efd425700 1 -- 172.21.15.80:0/3246178527 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ef812a3c0 msgr2=0x7f9ef812a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efd425700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ef812a3c0 0x7f9ef812a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efd425700 1 -- 172.21.15.80:0/3246178527 >> v1:172.21.15.174:6789/0 conn(0x7f9ef812b8a0 legacy=0x7f9ef813e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efd425700 1 -- 172.21.15.80:0/3246178527 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef810a8c0 con 0x7f9ef815fdf0 2019-11-28T11:54:31.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efd425700 1 --2- 172.21.15.80:0/3246178527 >> v2:172.21.15.80:3300/0 conn(0x7f9ef815fdf0 0x7f9ef812b360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9ee8010430 tx=0x7f9ee80102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efd425700 1 --2- 172.21.15.80:0/3246178527 >> v2:172.21.15.80:3300/0 conn(0x7f9ef815fdf0 0x7f9ef812b360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9ee8010430 tx=0x7f9ee80102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efd425700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef815fdf0 0x7f9ef812b360 secure :-1 s=READY pgs=2611 cs=0 l=1 rx=0x7f9ee8010430 tx=0x7f9ee80102b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:31.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efd425700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef815fdf0 0x7f9ef812b360 secure :-1 s=THROTTLE_DONE pgs=2611 cs=0 l=1 rx=0x7f9ee8010430 tx=0x7f9ee80102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efd425700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef815fdf0 0x7f9ef812b360 secure :-1 s=THROTTLE_DONE pgs=2611 cs=0 l=1 rx=0x7f9ee8010430 tx=0x7f9ee80102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9ef5ffb700 1 -- 172.21.15.80:0/3246178527 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ee80094b0 con 0x7f9ef815fdf0 2019-11-28T11:54:31.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efd425700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef815fdf0 0x7f9ef812b360 secure :-1 s=THROTTLE_DONE pgs=2611 cs=0 l=1 rx=0x7f9ee8010430 tx=0x7f9ee80102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9ef5ffb700 1 -- 172.21.15.80:0/3246178527 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee80096b0 con 0x7f9ef815fdf0 2019-11-28T11:54:31.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9ef5ffb700 1 -- 172.21.15.80:0/3246178527 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ee80012d0 con 0x7f9ef815fdf0 2019-11-28T11:54:31.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efee88700 1 -- 172.21.15.80:0/3246178527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef810a8c0 con 0x7f9ef815fdf0 2019-11-28T11:54:31.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.005+0000 7f9efee88700 1 -- 172.21.15.80:0/3246178527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef810a8c0 con 0x7f9ef815fdf0 2019-11-28T11:54:31.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.006+0000 7f9efd425700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef815fdf0 0x7f9ef812b360 secure :-1 s=THROTTLE_DONE pgs=2611 cs=0 l=1 rx=0x7f9ee8010430 tx=0x7f9ee80102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.006+0000 7f9ef5ffb700 1 -- 172.21.15.80:0/3246178527 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9ee8000bc0 con 0x7f9ef815fdf0 2019-11-28T11:54:31.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.006+0000 7f9efd425700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef815fdf0 0x7f9ef812b360 secure :-1 s=THROTTLE_DONE pgs=2611 cs=0 l=1 rx=0x7f9ee8010430 tx=0x7f9ee80102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.006+0000 7f9ef5ffb700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9edc018730 0x7f9edc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:31.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.006+0000 7f9ef5ffb700 1 -- 172.21.15.80:0/3246178527 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9ee8031ab0 con 0x7f9ef815fdf0 2019-11-28T11:54:31.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.006+0000 7f9efcc24700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9edc018730 0x7f9edc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:31.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.007+0000 7f9efcc24700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9edc018730 0x7f9edc01abc0 crc :-1 s=READY pgs=1073 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:31.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.014+0000 7f9efee88700 1 -- 172.21.15.80:0/3246178527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef8109180 con 0x7f9ef815fdf0 2019-11-28T11:54:31.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.017+0000 7f9efd425700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef815fdf0 0x7f9ef812b360 secure :-1 s=THROTTLE_DONE pgs=2611 cs=0 l=1 rx=0x7f9ee8010430 tx=0x7f9ee80102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.017+0000 7f9ef5ffb700 1 -- 172.21.15.80:0/3246178527 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9ee8000990 con 0x7f9ef815fdf0 2019-11-28T11:54:31.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.188+0000 7f9efee88700 1 -- 172.21.15.80:0/3246178527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ef8109500 con 0x7f9ef815fdf0 2019-11-28T11:54:31.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.189+0000 7f9efd425700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef815fdf0 0x7f9ef812b360 secure :-1 s=THROTTLE_DONE pgs=2611 cs=0 l=1 rx=0x7f9ee8010430 tx=0x7f9ee80102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.189+0000 7f9ef5ffb700 1 -- 172.21.15.80:0/3246178527 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 165 v165) v1 ==== 95+0+1428 (secure 0 0 0) 0x7f9ee8017930 con 0x7f9ef815fdf0 2019-11-28T11:54:31.245 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 165 2019-11-28T11:54:31.246 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:31.246 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":165,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":165,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:54:29.202039+0000","modified":"2019-11-28T11:54:30.856572+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2019-11-28T11:54:31.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.191+0000 7f9efee88700 1 -- 172.21.15.80:0/3246178527 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9edc018730 msgr2=0x7f9edc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.191+0000 7f9efee88700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9edc018730 0x7f9edc01abc0 crc :-1 s=READY pgs=1073 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.191+0000 7f9efee88700 1 -- 172.21.15.80:0/3246178527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef815fdf0 msgr2=0x7f9ef812b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.191+0000 7f9efee88700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef815fdf0 0x7f9ef812b360 secure :-1 s=READY pgs=2611 cs=0 l=1 rx=0x7f9ee8010430 tx=0x7f9ee80102b0).stop 2019-11-28T11:54:31.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.191+0000 7f9efee88700 1 -- 172.21.15.80:0/3246178527 shutdown_connections 2019-11-28T11:54:31.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.191+0000 7f9efee88700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ef812a3c0 0x7f9ef812a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.191+0000 7f9efee88700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9edc018730 0x7f9edc01abc0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.191+0000 7f9efee88700 1 --2- 172.21.15.80:0/3246178527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ef815fdf0 0x7f9ef812b360 unknown :-1 s=CLOSED pgs=2611 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.192+0000 7f9efee88700 1 -- 172.21.15.80:0/3246178527 shutdown_connections 2019-11-28T11:54:31.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.192+0000 7f9efee88700 1 -- 172.21.15.80:0/3246178527 wait complete. 2019-11-28T11:54:31.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.192+0000 7f9efee88700 1 -- 172.21.15.80:0/3246178527 >> 172.21.15.80:0/3246178527 conn(0x7f9ef8127dc0 msgr2=0x7f9ef8141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:31.258 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:54:31.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.320+0000 7fc7e932e700 1 Processor -- start 2019-11-28T11:54:31.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.320+0000 7fc7e932e700 1 -- start start 2019-11-28T11:54:31.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.321+0000 7fc7e932e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7e406d120 0x7fc7e4165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:31.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.321+0000 7fc7e932e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e406d5a0 con 0x7fc7e406c490 2019-11-28T11:54:31.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.321+0000 7fc7e932e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e406db00 con 0x7fc7e406c0a0 2019-11-28T11:54:31.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.321+0000 7fc7e932e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e406fd60 con 0x7fc7e406d120 2019-11-28T11:54:31.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.321+0000 7fc7e3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7e406d120 0x7fc7e4165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:31.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.321+0000 7fc7e3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7e406d120 0x7fc7e4165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45446/0 (socket says 172.21.15.80:45446) 2019-11-28T11:54:31.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.321+0000 7fc7e3fff700 1 -- 172.21.15.80:0/1179597924 learned_addr learned my addr 172.21.15.80:0/1179597924 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:31.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.321+0000 7fc7e2ffd700 1 --1- 172.21.15.80:0/1179597924 >> v1:172.21.15.80:6789/0 conn(0x7fc7e406c490 0x7fc7e406c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44764/0 (socket says 172.21.15.80:44764) 2019-11-28T11:54:31.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.322+0000 7fc7e3fff700 1 -- 172.21.15.80:0/1179597924 >> v1:172.21.15.174:6789/0 conn(0x7fc7e406c0a0 legacy=0x7fc7e4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:31.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.322+0000 7fc7e3fff700 1 -- 172.21.15.80:0/1179597924 >> v1:172.21.15.80:6789/0 conn(0x7fc7e406c490 legacy=0x7fc7e406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.322+0000 7fc7e27fc700 1 -- 172.21.15.80:0/1179597924 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242409460 0 0) 0x7fc7d4001100 con 0x7fc7e406c490 2019-11-28T11:54:31.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.322+0000 7fc7e3fff700 1 -- 172.21.15.80:0/1179597924 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e40706c0 con 0x7fc7e406d120 2019-11-28T11:54:31.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.322+0000 7fc7e3fff700 1 --2- 172.21.15.80:0/1179597924 >> v2:172.21.15.80:3300/0 conn(0x7fc7e406d120 0x7fc7e4165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc7dc00fab0 tx=0x7fc7dc00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.322+0000 7fc7e3fff700 1 --2- 172.21.15.80:0/1179597924 >> v2:172.21.15.80:3300/0 conn(0x7fc7e406d120 0x7fc7e4165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc7dc00fab0 tx=0x7fc7dc00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.322+0000 7fc7e3fff700 1 --2- 172.21.15.80:0/1179597924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e406d120 0x7fc7e4165d80 secure :-1 s=READY pgs=2613 cs=0 l=1 rx=0x7fc7dc00fab0 tx=0x7fc7dc00fe50).ready entity=mon.0 client_cookie=e6c28f37c38a8b61 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:31.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.322+0000 7fc7e3fff700 1 --2- 172.21.15.80:0/1179597924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e406d120 0x7fc7e4165d80 secure :-1 s=THROTTLE_DONE pgs=2613 cs=0 l=1 rx=0x7fc7dc00fab0 tx=0x7fc7dc00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.322+0000 7fc7e27fc700 1 -- 172.21.15.80:0/1179597924 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7dc000df0 con 0x7fc7e406d120 2019-11-28T11:54:31.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.322+0000 7fc7e3fff700 1 --2- 172.21.15.80:0/1179597924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e406d120 0x7fc7e4165d80 secure :-1 s=THROTTLE_DONE pgs=2613 cs=0 l=1 rx=0x7fc7dc00fab0 tx=0x7fc7dc00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.322+0000 7fc7e27fc700 1 -- 172.21.15.80:0/1179597924 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc000ce0 con 0x7fc7e406d120 2019-11-28T11:54:31.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.322+0000 7fc7e3fff700 1 --2- 172.21.15.80:0/1179597924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e406d120 0x7fc7e4165d80 secure :-1 s=THROTTLE_DONE pgs=2613 cs=0 l=1 rx=0x7fc7dc00fab0 tx=0x7fc7dc00fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.322+0000 7fc7e27fc700 1 -- 172.21.15.80:0/1179597924 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7dc000ed0 con 0x7fc7e406d120 2019-11-28T11:54:31.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.322+0000 7fc7e932e700 1 -- 172.21.15.80:0/1179597924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e406d120 msgr2=0x7fc7e4165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.322+0000 7fc7e932e700 1 --2- 172.21.15.80:0/1179597924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e406d120 0x7fc7e4165d80 secure :-1 s=READY pgs=2613 cs=0 l=1 rx=0x7fc7dc00fab0 tx=0x7fc7dc00fe50).stop 2019-11-28T11:54:31.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.323+0000 7fc7e932e700 1 -- 172.21.15.80:0/1179597924 shutdown_connections 2019-11-28T11:54:31.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.323+0000 7fc7e932e700 1 --2- 172.21.15.80:0/1179597924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e406d120 0x7fc7e4165d80 unknown :-1 s=CLOSED pgs=2613 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.323+0000 7fc7e932e700 1 -- 172.21.15.80:0/1179597924 shutdown_connections 2019-11-28T11:54:31.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.323+0000 7fc7e932e700 1 -- 172.21.15.80:0/1179597924 wait complete. 2019-11-28T11:54:31.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.323+0000 7fc7e932e700 1 -- 172.21.15.80:0/1179597924 >> 172.21.15.80:0/1179597924 conn(0x7fc7e4061cf0 msgr2=0x7fc7e4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:31.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.325+0000 7fc7e932e700 1 Processor -- start 2019-11-28T11:54:31.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.325+0000 7fc7e932e700 1 -- start start 2019-11-28T11:54:31.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.326+0000 7fc7e932e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7e41167a0 0x7fc7e4121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:31.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.326+0000 7fc7e932e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc7e4121c90 0x7fc7e413efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:31.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.326+0000 7fc7e932e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e4116b90 con 0x7fc7e413f4e0 2019-11-28T11:54:31.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.326+0000 7fc7e932e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e41563f0 con 0x7fc7e41167a0 2019-11-28T11:54:31.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.326+0000 7fc7e932e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e41566c0 con 0x7fc7e4121c90 2019-11-28T11:54:31.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.326+0000 7fc7e37fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc7e41167a0 0x7fc7e4121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:31.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.326+0000 7fc7e3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc7e413f4e0 0x7fc7e4164a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44768/0 (socket says 172.21.15.80:44768) 2019-11-28T11:54:31.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.326+0000 7fc7e3fff700 1 -- 172.21.15.80:0/1292233544 learned_addr learned my addr 172.21.15.80:0/1292233544 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:31.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.326+0000 7fc7e2ffd700 1 --2- 172.21.15.80:0/1292233544 >> v2:172.21.15.174:3300/0 conn(0x7fc7e4121c90 0x7fc7e413efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:31.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.326+0000 7fc7e37fe700 1 -- 172.21.15.80:0/1292233544 >> v2:172.21.15.174:3300/0 conn(0x7fc7e4121c90 msgr2=0x7fc7e413efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.326+0000 7fc7e37fe700 1 --2- 172.21.15.80:0/1292233544 >> v2:172.21.15.174:3300/0 conn(0x7fc7e4121c90 0x7fc7e413efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7e37fe700 1 -- 172.21.15.80:0/1292233544 >> v1:172.21.15.80:6789/0 conn(0x7fc7e413f4e0 legacy=0x7fc7e4164a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.326+0000 7fc7cbfff700 1 -- 172.21.15.80:0/1292233544 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874148105 0 0) 0x7fc7dc000ed0 con 0x7fc7e413f4e0 2019-11-28T11:54:31.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7e37fe700 1 -- 172.21.15.80:0/1292233544 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e4156d50 con 0x7fc7e41167a0 2019-11-28T11:54:31.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7e2ffd700 1 --2- 172.21.15.80:0/1292233544 >> v2:172.21.15.174:3300/0 conn(0x7fc7e4121c90 0x7fc7e413efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:31.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7e37fe700 1 --2- 172.21.15.80:0/1292233544 >> v2:172.21.15.80:3300/0 conn(0x7fc7e41167a0 0x7fc7e4121750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7d80103a0 tx=0x7fc7d8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7e37fe700 1 --2- 172.21.15.80:0/1292233544 >> v2:172.21.15.80:3300/0 conn(0x7fc7e41167a0 0x7fc7e4121750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7d80103a0 tx=0x7fc7d8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7e37fe700 1 --2- 172.21.15.80:0/1292233544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e41167a0 0x7fc7e4121750 secure :-1 s=READY pgs=2615 cs=0 l=1 rx=0x7fc7d80103a0 tx=0x7fc7d8010740).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:31.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7e37fe700 1 --2- 172.21.15.80:0/1292233544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e41167a0 0x7fc7e4121750 secure :-1 s=THROTTLE_DONE pgs=2615 cs=0 l=1 rx=0x7fc7d80103a0 tx=0x7fc7d8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7cbfff700 1 -- 172.21.15.80:0/1292233544 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7d8000c10 con 0x7fc7e41167a0 2019-11-28T11:54:31.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7e37fe700 1 --2- 172.21.15.80:0/1292233544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e41167a0 0x7fc7e4121750 secure :-1 s=THROTTLE_DONE pgs=2615 cs=0 l=1 rx=0x7fc7d80103a0 tx=0x7fc7d8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7e37fe700 1 --2- 172.21.15.80:0/1292233544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e41167a0 0x7fc7e4121750 secure :-1 s=THROTTLE_DONE pgs=2615 cs=0 l=1 rx=0x7fc7d80103a0 tx=0x7fc7d8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7cbfff700 1 -- 172.21.15.80:0/1292233544 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d8009a60 con 0x7fc7e41167a0 2019-11-28T11:54:31.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7cbfff700 1 -- 172.21.15.80:0/1292233544 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7d800a170 con 0x7fc7e41167a0 2019-11-28T11:54:31.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7e932e700 1 -- 172.21.15.80:0/1292233544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e41570d0 con 0x7fc7e41167a0 2019-11-28T11:54:31.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7e932e700 1 -- 172.21.15.80:0/1292233544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e4156d50 con 0x7fc7e41167a0 2019-11-28T11:54:31.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7e37fe700 1 --2- 172.21.15.80:0/1292233544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e41167a0 0x7fc7e4121750 secure :-1 s=THROTTLE_DONE pgs=2615 cs=0 l=1 rx=0x7fc7d80103a0 tx=0x7fc7d8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7cbfff700 1 -- 172.21.15.80:0/1292233544 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc7d8009c50 con 0x7fc7e41167a0 2019-11-28T11:54:31.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7e37fe700 1 --2- 172.21.15.80:0/1292233544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e41167a0 0x7fc7e4121750 secure :-1 s=THROTTLE_DONE pgs=2615 cs=0 l=1 rx=0x7fc7d80103a0 tx=0x7fc7d8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.327+0000 7fc7cbfff700 1 --2- 172.21.15.80:0/1292233544 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7c4018730 0x7fc7c401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:31.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.328+0000 7fc7cbfff700 1 -- 172.21.15.80:0/1292233544 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc7d80319d0 con 0x7fc7e41167a0 2019-11-28T11:54:31.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.328+0000 7fc7e2ffd700 1 --2- 172.21.15.80:0/1292233544 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7c4018730 0x7fc7c401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:31.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.328+0000 7fc7e2ffd700 1 --2- 172.21.15.80:0/1292233544 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7c4018730 0x7fc7c401abc0 crc :-1 s=READY pgs=1074 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:31.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.335+0000 7fc7e932e700 1 -- 172.21.15.80:0/1292233544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e41570d0 con 0x7fc7e41167a0 2019-11-28T11:54:31.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.339+0000 7fc7e37fe700 1 --2- 172.21.15.80:0/1292233544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e41167a0 0x7fc7e4121750 secure :-1 s=THROTTLE_DONE pgs=2615 cs=0 l=1 rx=0x7fc7d80103a0 tx=0x7fc7d8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.339+0000 7fc7cbfff700 1 -- 172.21.15.80:0/1292233544 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc7d8009610 con 0x7fc7e41167a0 2019-11-28T11:54:31.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.514+0000 7fc7e932e700 1 -- 172.21.15.80:0/1292233544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7e4156d50 con 0x7fc7e41167a0 2019-11-28T11:54:31.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.514+0000 7fc7e37fe700 1 --2- 172.21.15.80:0/1292233544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e41167a0 0x7fc7e4121750 secure :-1 s=THROTTLE_DONE pgs=2615 cs=0 l=1 rx=0x7fc7d80103a0 tx=0x7fc7d8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.514+0000 7fc7cbfff700 1 -- 172.21.15.80:0/1292233544 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) v1 ==== 74+0+14871 (secure 0 0 0) 0x7fc7d8017410 con 0x7fc7e41167a0 2019-11-28T11:54:31.572 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:31.572 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":203,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:54:30.203239+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:54:27.540791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":33,"pool_name":"cephfs_data","create_time":"2019-11-28T11:54:28.225144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:54:31.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.516+0000 7fc7e932e700 1 -- 172.21.15.80:0/1292233544 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7c4018730 msgr2=0x7fc7c401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.516+0000 7fc7e932e700 1 --2- 172.21.15.80:0/1292233544 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7c4018730 0x7fc7c401abc0 crc :-1 s=READY pgs=1074 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.516+0000 7fc7e932e700 1 -- 172.21.15.80:0/1292233544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e41167a0 msgr2=0x7fc7e4121750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.516+0000 7fc7e932e700 1 --2- 172.21.15.80:0/1292233544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e41167a0 0x7fc7e4121750 secure :-1 s=READY pgs=2615 cs=0 l=1 rx=0x7fc7d80103a0 tx=0x7fc7d8010740).stop 2019-11-28T11:54:31.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.517+0000 7fc7e932e700 1 -- 172.21.15.80:0/1292233544 shutdown_connections 2019-11-28T11:54:31.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.517+0000 7fc7e932e700 1 --2- 172.21.15.80:0/1292233544 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc7c4018730 0x7fc7c401abc0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.517+0000 7fc7e932e700 1 --2- 172.21.15.80:0/1292233544 >> v2:172.21.15.174:3300/0 conn(0x7fc7e4121c90 0x7fc7e413efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.517+0000 7fc7e932e700 1 --2- 172.21.15.80:0/1292233544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc7e41167a0 0x7fc7e4121750 unknown :-1 s=CLOSED pgs=2615 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.517+0000 7fc7e932e700 1 -- 172.21.15.80:0/1292233544 shutdown_connections 2019-11-28T11:54:31.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.517+0000 7fc7e932e700 1 -- 172.21.15.80:0/1292233544 wait complete. 2019-11-28T11:54:31.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.517+0000 7fc7e932e700 1 -- 172.21.15.80:0/1292233544 >> 172.21.15.80:0/1292233544 conn(0x7fc7e41426c0 msgr2=0x7fc7e4110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:31.595 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:54:31.595 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:54:31.595 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:54:31.596 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:54:31.596 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:54:31.596 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:54:31.600 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:54:31.600 DEBUG:teuthology.parallel:result is None 2019-11-28T11:54:31.601 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:54:31.601 DEBUG:teuthology.parallel:result is None 2019-11-28T11:54:31.602 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:54:31.602 DEBUG:teuthology.parallel:result is None 2019-11-28T11:54:31.602 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:54:31.694 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:54:31.694 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:54:31.695 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:54:31.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.683+0000 7f36d268d700 1 Processor -- start 2019-11-28T11:54:31.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.683+0000 7f36d268d700 1 -- start start 2019-11-28T11:54:31.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.684+0000 7f36d268d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36cc15f100 0x7f36cc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:31.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.684+0000 7f36d268d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36cc06db60 con 0x7f36cc15ed10 2019-11-28T11:54:31.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.684+0000 7f36d268d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36cc06e060 con 0x7f36cc06c2f0 2019-11-28T11:54:31.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.684+0000 7f36d268d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc06fe00 con 0x7f36cc15f100 2019-11-28T11:54:31.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36d0c2a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f36cc15ed10 0x7f36cc073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44798/0 (socket says 172.21.15.80:44798) 2019-11-28T11:54:31.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36d0c2a700 1 -- 172.21.15.80:0/4263855033 learned_addr learned my addr 172.21.15.80:0/4263855033 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:31.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cbfff700 1 --2- 172.21.15.80:0/4263855033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36cc15f100 0x7f36cc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:31.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cb7fe700 1 -- 172.21.15.80:0/4263855033 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375577563 0 0) 0x7f36b4001150 con 0x7f36cc15ed10 2019-11-28T11:54:31.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cb7fe700 1 -- 172.21.15.80:0/4263855033 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36b8002e80 con 0x7f36cc15ed10 2019-11-28T11:54:31.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cb7fe700 1 -- 172.21.15.80:0/4263855033 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073925922 0 0) 0x7f36c40009b0 con 0x7f36cc06c2f0 2019-11-28T11:54:31.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cb7fe700 1 -- 172.21.15.80:0/4263855033 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36b8004170 con 0x7f36cc06c2f0 2019-11-28T11:54:31.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cbfff700 1 -- 172.21.15.80:0/4263855033 >> v1:172.21.15.174:6789/0 conn(0x7f36cc06c2f0 legacy=0x7f36cc06c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cbfff700 1 -- 172.21.15.80:0/4263855033 >> v1:172.21.15.80:6789/0 conn(0x7f36cc15ed10 legacy=0x7f36cc073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cbfff700 1 -- 172.21.15.80:0/4263855033 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36cc070760 con 0x7f36cc15f100 2019-11-28T11:54:31.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cbfff700 1 --2- 172.21.15.80:0/4263855033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36cc15f100 0x7f36cc06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f36bc00b2d0 tx=0x7f36bc00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cbfff700 1 --2- 172.21.15.80:0/4263855033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36cc15f100 0x7f36cc06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f36bc00b2d0 tx=0x7f36bc00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cbfff700 1 --2- 172.21.15.80:0/4263855033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36cc15f100 0x7f36cc06bdb0 secure :-1 s=READY pgs=374 cs=0 l=1 rx=0x7f36bc00b2d0 tx=0x7f36bc00bae0).ready entity=mon.2 client_cookie=dae67846b62e8a8d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:31.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cbfff700 1 --2- 172.21.15.80:0/4263855033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36cc15f100 0x7f36cc06bdb0 secure :-1 s=THROTTLE_DONE pgs=374 cs=0 l=1 rx=0x7f36bc00b2d0 tx=0x7f36bc00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cb7fe700 1 -- 172.21.15.80:0/4263855033 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36bc000ce0 con 0x7f36cc15f100 2019-11-28T11:54:31.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cbfff700 1 --2- 172.21.15.80:0/4263855033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36cc15f100 0x7f36cc06bdb0 secure :-1 s=THROTTLE_DONE pgs=374 cs=0 l=1 rx=0x7f36bc00b2d0 tx=0x7f36bc00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cbfff700 1 --2- 172.21.15.80:0/4263855033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36cc15f100 0x7f36cc06bdb0 secure :-1 s=THROTTLE_DONE pgs=374 cs=0 l=1 rx=0x7f36bc00b2d0 tx=0x7f36bc00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cb7fe700 1 -- 172.21.15.80:0/4263855033 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36bc009be0 con 0x7f36cc15f100 2019-11-28T11:54:31.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36cb7fe700 1 -- 172.21.15.80:0/4263855033 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36bc00a2b0 con 0x7f36cc15f100 2019-11-28T11:54:31.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36d268d700 1 -- 172.21.15.80:0/4263855033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36cc15f100 msgr2=0x7f36cc06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.685+0000 7f36d268d700 1 --2- 172.21.15.80:0/4263855033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36cc15f100 0x7f36cc06bdb0 secure :-1 s=READY pgs=374 cs=0 l=1 rx=0x7f36bc00b2d0 tx=0x7f36bc00bae0).stop 2019-11-28T11:54:31.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.686+0000 7f36d268d700 1 -- 172.21.15.80:0/4263855033 shutdown_connections 2019-11-28T11:54:31.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.686+0000 7f36d268d700 1 --2- 172.21.15.80:0/4263855033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36cc15f100 0x7f36cc06bdb0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.686+0000 7f36d268d700 1 -- 172.21.15.80:0/4263855033 shutdown_connections 2019-11-28T11:54:31.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.686+0000 7f36d268d700 1 -- 172.21.15.80:0/4263855033 wait complete. 2019-11-28T11:54:31.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.686+0000 7f36d268d700 1 -- 172.21.15.80:0/4263855033 >> 172.21.15.80:0/4263855033 conn(0x7f36cc061d40 msgr2=0x7f36cc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:31.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.688+0000 7f36d268d700 1 Processor -- start 2019-11-28T11:54:31.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.688+0000 7f36d268d700 1 -- start start 2019-11-28T11:54:31.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.689+0000 7f36d268d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f36cc152750 0x7f36cc1058b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:31.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.689+0000 7f36d268d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36cc105df0 0x7f36cc12c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:31.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.689+0000 7f36d268d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f36cc12c880 0x7f36cc1047a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:31.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.689+0000 7f36d268d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36cc106880 con 0x7f36cc152750 2019-11-28T11:54:31.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.689+0000 7f36d268d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36cc109d70 con 0x7f36cc12c880 2019-11-28T11:54:31.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.689+0000 7f36d268d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc10a040 con 0x7f36cc105df0 2019-11-28T11:54:31.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d0c2a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f36cc152750 0x7f36cc1058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:31.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d0c2a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f36cc152750 0x7f36cc1058b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45486/0 (socket says 172.21.15.80:45486) 2019-11-28T11:54:31.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d0c2a700 1 -- 172.21.15.80:0/3631868355 learned_addr learned my addr 172.21.15.80:0/3631868355 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:31.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36cbfff700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36cc105df0 0x7f36cc12c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:31.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d142b700 1 --2- 172.21.15.80:0/3631868355 >> v2:172.21.15.174:3300/0 conn(0x7f36cc12c880 0x7f36cc1047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:31.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d0c2a700 1 -- 172.21.15.80:0/3631868355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36cc105df0 msgr2=0x7f36cc12c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d0c2a700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36cc105df0 0x7f36cc12c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d0c2a700 1 -- 172.21.15.80:0/3631868355 >> v2:172.21.15.174:3300/0 conn(0x7f36cc12c880 msgr2=0x7f36cc1047a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d0c2a700 1 --2- 172.21.15.80:0/3631868355 >> v2:172.21.15.174:3300/0 conn(0x7f36cc12c880 0x7f36cc1047a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d0c2a700 1 -- 172.21.15.80:0/3631868355 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36cc106f10 con 0x7f36cc152750 2019-11-28T11:54:31.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d0c2a700 1 --2- 172.21.15.80:0/3631868355 >> v2:172.21.15.80:3300/0 conn(0x7f36cc152750 0x7f36cc1058b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f36b40103e0 tx=0x7f36b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d0c2a700 1 --2- 172.21.15.80:0/3631868355 >> v2:172.21.15.80:3300/0 conn(0x7f36cc152750 0x7f36cc1058b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f36b40103e0 tx=0x7f36b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d0c2a700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36cc152750 0x7f36cc1058b0 secure :-1 s=READY pgs=2624 cs=0 l=1 rx=0x7f36b40103e0 tx=0x7f36b4010260).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:31.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d0c2a700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36cc152750 0x7f36cc1058b0 secure :-1 s=THROTTLE_DONE pgs=2624 cs=0 l=1 rx=0x7f36b40103e0 tx=0x7f36b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36c97fa700 1 -- 172.21.15.80:0/3631868355 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36b4000c90 con 0x7f36cc152750 2019-11-28T11:54:31.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d0c2a700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36cc152750 0x7f36cc1058b0 secure :-1 s=THROTTLE_DONE pgs=2624 cs=0 l=1 rx=0x7f36b40103e0 tx=0x7f36b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d0c2a700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36cc152750 0x7f36cc1058b0 secure :-1 s=THROTTLE_DONE pgs=2624 cs=0 l=1 rx=0x7f36b40103e0 tx=0x7f36b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36c97fa700 1 -- 172.21.15.80:0/3631868355 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b40010c0 con 0x7f36cc152750 2019-11-28T11:54:31.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d268d700 1 -- 172.21.15.80:0/3631868355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36cc107290 con 0x7f36cc152750 2019-11-28T11:54:31.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36c97fa700 1 -- 172.21.15.80:0/3631868355 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36b40012b0 con 0x7f36cc152750 2019-11-28T11:54:31.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.690+0000 7f36d268d700 1 -- 172.21.15.80:0/3631868355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36cc106f10 con 0x7f36cc152750 2019-11-28T11:54:31.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.691+0000 7f36d0c2a700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36cc152750 0x7f36cc1058b0 secure :-1 s=THROTTLE_DONE pgs=2624 cs=0 l=1 rx=0x7f36b40103e0 tx=0x7f36b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.691+0000 7f36c97fa700 1 -- 172.21.15.80:0/3631868355 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f36b4000c90 con 0x7f36cc152750 2019-11-28T11:54:31.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.691+0000 7f36d0c2a700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36cc152750 0x7f36cc1058b0 secure :-1 s=THROTTLE_DONE pgs=2624 cs=0 l=1 rx=0x7f36b40103e0 tx=0x7f36b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.691+0000 7f36c97fa700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36b0018730 0x7f36b001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:31.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.691+0000 7f36c97fa700 1 -- 172.21.15.80:0/3631868355 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f36b4031a10 con 0x7f36cc152750 2019-11-28T11:54:31.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.691+0000 7f36cbfff700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36b0018730 0x7f36b001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:31.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.691+0000 7f36cbfff700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36b0018730 0x7f36b001abc0 crc :-1 s=READY pgs=1075 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:31.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.699+0000 7f36d268d700 1 -- 172.21.15.80:0/3631868355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36cc107290 con 0x7f36cc152750 2019-11-28T11:54:31.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.702+0000 7f36d0c2a700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36cc152750 0x7f36cc1058b0 secure :-1 s=THROTTLE_DONE pgs=2624 cs=0 l=1 rx=0x7f36b40103e0 tx=0x7f36b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.702+0000 7f36c97fa700 1 -- 172.21.15.80:0/3631868355 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f36b40075d0 con 0x7f36cc152750 2019-11-28T11:54:31.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.879+0000 7f36d268d700 1 -- 172.21.15.80:0/3631868355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f36cc106f10 con 0x7f36cc152750 2019-11-28T11:54:31.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.881+0000 7f36d0c2a700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36cc152750 0x7f36cc1058b0 secure :-1 s=THROTTLE_DONE pgs=2624 cs=0 l=1 rx=0x7f36b40103e0 tx=0x7f36b4010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:31.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.881+0000 7f36c97fa700 1 -- 172.21.15.80:0/3631868355 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v68) v1 ==== 184+0+0 (secure 0 0 0) 0x7f36b40012b0 con 0x7f36cc152750 2019-11-28T11:54:31.939 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:54:31.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.884+0000 7f36d268d700 1 -- 172.21.15.80:0/3631868355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36b0018730 msgr2=0x7f36b001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.884+0000 7f36d268d700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36b0018730 0x7f36b001abc0 crc :-1 s=READY pgs=1075 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.884+0000 7f36d268d700 1 -- 172.21.15.80:0/3631868355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36cc152750 msgr2=0x7f36cc1058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.884+0000 7f36d268d700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36cc152750 0x7f36cc1058b0 secure :-1 s=READY pgs=2624 cs=0 l=1 rx=0x7f36b40103e0 tx=0x7f36b4010260).stop 2019-11-28T11:54:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.884+0000 7f36d268d700 1 -- 172.21.15.80:0/3631868355 shutdown_connections 2019-11-28T11:54:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.884+0000 7f36d268d700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f36b0018730 0x7f36b001abc0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.884+0000 7f36d268d700 1 --2- 172.21.15.80:0/3631868355 >> v2:172.21.15.174:3300/0 conn(0x7f36cc12c880 0x7f36cc1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.884+0000 7f36d268d700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36cc105df0 0x7f36cc12c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.884+0000 7f36d268d700 1 --2- 172.21.15.80:0/3631868355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36cc152750 0x7f36cc1058b0 unknown :-1 s=CLOSED pgs=2624 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.884+0000 7f36d268d700 1 -- 172.21.15.80:0/3631868355 shutdown_connections 2019-11-28T11:54:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.884+0000 7f36d268d700 1 -- 172.21.15.80:0/3631868355 wait complete. 2019-11-28T11:54:31.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:31.884+0000 7f36d268d700 1 -- 172.21.15.80:0/3631868355 >> 172.21.15.80:0/3631868355 conn(0x7f36cc1476e0 msgr2=0x7f36cc12fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:31.953 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:54:32.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.027+0000 7f0b95fc2700 1 Processor -- start 2019-11-28T11:54:32.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.028+0000 7f0b95fc2700 1 -- start start 2019-11-28T11:54:32.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.028+0000 7f0b95fc2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b9015f100 0x7f0b9006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:32.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.028+0000 7f0b95fc2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0b9006c2f0 0x7f0b9006c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:32.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.028+0000 7f0b95fc2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9006db60 con 0x7f0b9015ed10 2019-11-28T11:54:32.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b95fc2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9006fe00 con 0x7f0b9006c2f0 2019-11-28T11:54:32.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b95fc2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b900700d0 con 0x7f0b9015f100 2019-11-28T11:54:32.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b94d60700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0b9006c2f0 0x7f0b9006c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:32.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b87fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b9015f100 0x7f0b9006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:32.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b94d60700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0b9006c2f0 0x7f0b9006c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:60384/0 (socket says 172.21.15.80:60384) 2019-11-28T11:54:32.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b87fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b9015f100 0x7f0b9006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:47756/0 (socket says 172.21.15.80:47756) 2019-11-28T11:54:32.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b94d60700 1 -- 172.21.15.80:0/472373871 learned_addr learned my addr 172.21.15.80:0/472373871 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:32.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b8ffff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f0b9015ed10 0x7f0b90073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:60354/0 (socket says 172.21.15.80:60354) 2019-11-28T11:54:32.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b94d60700 1 -- 172.21.15.80:0/472373871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b9015f100 msgr2=0x7f0b9006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:32.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b94d60700 1 --2- 172.21.15.80:0/472373871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b9015f100 0x7f0b9006bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:32.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b94d60700 1 -- 172.21.15.80:0/472373871 >> v1:172.21.15.174:6789/0 conn(0x7f0b9015ed10 legacy=0x7f0b90073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b8f7fe700 1 -- 172.21.15.80:0/472373871 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505525014 0 0) 0x7f0b800010c0 con 0x7f0b9015ed10 2019-11-28T11:54:32.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b94d60700 1 -- 172.21.15.80:0/472373871 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b90070760 con 0x7f0b9006c2f0 2019-11-28T11:54:32.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b87fff700 1 --2- 172.21.15.80:0/472373871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b9015f100 0x7f0b9006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:32.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b94d60700 1 --2- 172.21.15.80:0/472373871 >> v2:172.21.15.174:3300/0 conn(0x7f0b9006c2f0 0x7f0b9006c790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0b8800fae0 tx=0x7f0b8800fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b94d60700 1 --2- 172.21.15.80:0/472373871 >> v2:172.21.15.174:3300/0 conn(0x7f0b9006c2f0 0x7f0b9006c790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0b8800fae0 tx=0x7f0b8800fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.029+0000 7f0b94d60700 1 --2- 172.21.15.80:0/472373871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9006c2f0 0x7f0b9006c790 secure :-1 s=READY pgs=1579 cs=0 l=1 rx=0x7f0b8800fae0 tx=0x7f0b8800fe80).ready entity=mon.1 client_cookie=6b5b9b31e8e728d2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:32.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.030+0000 7f0b94d60700 1 --2- 172.21.15.80:0/472373871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9006c2f0 0x7f0b9006c790 secure :-1 s=THROTTLE_DONE pgs=1579 cs=0 l=1 rx=0x7f0b8800fae0 tx=0x7f0b8800fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.030+0000 7f0b8f7fe700 1 -- 172.21.15.80:0/472373871 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b88000df0 con 0x7f0b9006c2f0 2019-11-28T11:54:32.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.030+0000 7f0b94d60700 1 --2- 172.21.15.80:0/472373871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9006c2f0 0x7f0b9006c790 secure :-1 s=THROTTLE_DONE pgs=1579 cs=0 l=1 rx=0x7f0b8800fae0 tx=0x7f0b8800fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.030+0000 7f0b94d60700 1 --2- 172.21.15.80:0/472373871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9006c2f0 0x7f0b9006c790 secure :-1 s=THROTTLE_DONE pgs=1579 cs=0 l=1 rx=0x7f0b8800fae0 tx=0x7f0b8800fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.030+0000 7f0b8f7fe700 1 -- 172.21.15.80:0/472373871 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b880011f0 con 0x7f0b9006c2f0 2019-11-28T11:54:32.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.030+0000 7f0b8f7fe700 1 -- 172.21.15.80:0/472373871 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b88001880 con 0x7f0b9006c2f0 2019-11-28T11:54:32.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.030+0000 7f0b95fc2700 1 -- 172.21.15.80:0/472373871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9006c2f0 msgr2=0x7f0b9006c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.030+0000 7f0b95fc2700 1 --2- 172.21.15.80:0/472373871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9006c2f0 0x7f0b9006c790 secure :-1 s=READY pgs=1579 cs=0 l=1 rx=0x7f0b8800fae0 tx=0x7f0b8800fe80).stop 2019-11-28T11:54:32.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.030+0000 7f0b95fc2700 1 -- 172.21.15.80:0/472373871 shutdown_connections 2019-11-28T11:54:32.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.030+0000 7f0b95fc2700 1 --2- 172.21.15.80:0/472373871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9006c2f0 0x7f0b9006c790 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.030+0000 7f0b95fc2700 1 --2- 172.21.15.80:0/472373871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b9015f100 0x7f0b9006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:32.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.030+0000 7f0b95fc2700 1 -- 172.21.15.80:0/472373871 shutdown_connections 2019-11-28T11:54:32.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.030+0000 7f0b95fc2700 1 -- 172.21.15.80:0/472373871 wait complete. 2019-11-28T11:54:32.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.030+0000 7f0b95fc2700 1 -- 172.21.15.80:0/472373871 >> 172.21.15.80:0/472373871 conn(0x7f0b90061d40 msgr2=0x7f0b900641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:32.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.033+0000 7f0b95fc2700 1 Processor -- start 2019-11-28T11:54:32.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.033+0000 7f0b95fc2700 1 -- start start 2019-11-28T11:54:32.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b95fc2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0b9012e1a0 0x7f0b9012e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:32.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b95fc2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b9012eb70 0x7f0b90105a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:32.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b95fc2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b90130b20 con 0x7f0b90114f60 2019-11-28T11:54:32.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b95fc2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b90148b60 con 0x7f0b9012e1a0 2019-11-28T11:54:32.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b95fc2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b90148e30 con 0x7f0b9012eb70 2019-11-28T11:54:32.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b87fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0b9012e1a0 0x7f0b9012e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:32.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b94d60700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b9012eb70 0x7f0b90105a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:32.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b87fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0b9012e1a0 0x7f0b9012e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:60388/0 (socket says 172.21.15.80:60388) 2019-11-28T11:54:32.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b8ffff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f0b90114f60 0x7f0b90106b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:60360/0 (socket says 172.21.15.80:60360) 2019-11-28T11:54:32.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b87fff700 1 -- 172.21.15.80:0/510810653 learned_addr learned my addr 172.21.15.80:0/510810653 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:32.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b94d60700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b9012eb70 0x7f0b90105a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:47764/0 (socket says 172.21.15.80:47764) 2019-11-28T11:54:32.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b87fff700 1 -- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b9012eb70 msgr2=0x7f0b90105a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b87fff700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b9012eb70 0x7f0b90105a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b8d7fa700 1 -- 172.21.15.80:0/510810653 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30142796 0 0) 0x7f0b800010c0 con 0x7f0b90114f60 2019-11-28T11:54:32.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b87fff700 1 -- 172.21.15.80:0/510810653 >> v1:172.21.15.174:6789/0 conn(0x7f0b90114f60 legacy=0x7f0b90106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b87fff700 1 -- 172.21.15.80:0/510810653 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b90104390 con 0x7f0b9012e1a0 2019-11-28T11:54:32.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b94d60700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b9012eb70 0x7f0b90105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:32.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b87fff700 1 --2- 172.21.15.80:0/510810653 >> v2:172.21.15.174:3300/0 conn(0x7f0b9012e1a0 0x7f0b9012e630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0b78010430 tx=0x7f0b780107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b87fff700 1 --2- 172.21.15.80:0/510810653 >> v2:172.21.15.174:3300/0 conn(0x7f0b9012e1a0 0x7f0b9012e630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0b78010430 tx=0x7f0b780107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b87fff700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9012e1a0 0x7f0b9012e630 secure :-1 s=READY pgs=1581 cs=0 l=1 rx=0x7f0b78010430 tx=0x7f0b780107d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:32.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b87fff700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9012e1a0 0x7f0b9012e630 secure :-1 s=THROTTLE_DONE pgs=1581 cs=0 l=1 rx=0x7f0b78010430 tx=0x7f0b780107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b8d7fa700 1 -- 172.21.15.80:0/510810653 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b78007510 con 0x7f0b9012e1a0 2019-11-28T11:54:32.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b87fff700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9012e1a0 0x7f0b9012e630 secure :-1 s=THROTTLE_DONE pgs=1581 cs=0 l=1 rx=0x7f0b78010430 tx=0x7f0b780107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.034+0000 7f0b87fff700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9012e1a0 0x7f0b9012e630 secure :-1 s=THROTTLE_DONE pgs=1581 cs=0 l=1 rx=0x7f0b78010430 tx=0x7f0b780107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.035+0000 7f0b8d7fa700 1 -- 172.21.15.80:0/510810653 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7800edd0 con 0x7f0b9012e1a0 2019-11-28T11:54:32.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.035+0000 7f0b95fc2700 1 -- 172.21.15.80:0/510810653 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b90104710 con 0x7f0b9012e1a0 2019-11-28T11:54:32.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.035+0000 7f0b8d7fa700 1 -- 172.21.15.80:0/510810653 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b7800f460 con 0x7f0b9012e1a0 2019-11-28T11:54:32.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.035+0000 7f0b95fc2700 1 -- 172.21.15.80:0/510810653 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b90104390 con 0x7f0b9012e1a0 2019-11-28T11:54:32.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.035+0000 7f0b87fff700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9012e1a0 0x7f0b9012e630 secure :-1 s=THROTTLE_DONE pgs=1581 cs=0 l=1 rx=0x7f0b78010430 tx=0x7f0b780107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.035+0000 7f0b8d7fa700 1 -- 172.21.15.80:0/510810653 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0b7800e9b0 con 0x7f0b9012e1a0 2019-11-28T11:54:32.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.035+0000 7f0b87fff700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9012e1a0 0x7f0b9012e630 secure :-1 s=THROTTLE_DONE pgs=1581 cs=0 l=1 rx=0x7f0b78010430 tx=0x7f0b780107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.035+0000 7f0b8d7fa700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0b74018730 0x7f0b7401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:32.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.035+0000 7f0b8d7fa700 1 -- 172.21.15.80:0/510810653 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0b78031a90 con 0x7f0b9012e1a0 2019-11-28T11:54:32.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.035+0000 7f0b8ffff700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0b74018730 0x7f0b7401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:32.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.036+0000 7f0b8ffff700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0b74018730 0x7f0b7401abc0 crc :-1 s=READY pgs=1077 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:32.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.043+0000 7f0b95fc2700 1 -- 172.21.15.80:0/510810653 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b90104710 con 0x7f0b9012e1a0 2019-11-28T11:54:32.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.046+0000 7f0b87fff700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9012e1a0 0x7f0b9012e630 secure :-1 s=THROTTLE_DONE pgs=1581 cs=0 l=1 rx=0x7f0b78010430 tx=0x7f0b780107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.046+0000 7f0b8d7fa700 1 -- 172.21.15.80:0/510810653 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0b78025fb0 con 0x7f0b9012e1a0 2019-11-28T11:54:32.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.216+0000 7f0b95fc2700 1 -- 172.21.15.80:0/510810653 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0b90104390 con 0x7f0b9012e1a0 2019-11-28T11:54:32.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.225+0000 7f0b87fff700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9012e1a0 0x7f0b9012e630 secure :-1 s=THROTTLE_DONE pgs=1581 cs=0 l=1 rx=0x7f0b78010430 tx=0x7f0b780107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.225+0000 7f0b8d7fa700 1 -- 172.21.15.80:0/510810653 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v69) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0b7800e9b0 con 0x7f0b9012e1a0 2019-11-28T11:54:32.288 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:54:32.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.233+0000 7f0b95fc2700 1 -- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0b74018730 msgr2=0x7f0b7401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.233+0000 7f0b95fc2700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0b74018730 0x7f0b7401abc0 crc :-1 s=READY pgs=1077 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.233+0000 7f0b95fc2700 1 -- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9012e1a0 msgr2=0x7f0b9012e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.233+0000 7f0b95fc2700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9012e1a0 0x7f0b9012e630 secure :-1 s=READY pgs=1581 cs=0 l=1 rx=0x7f0b78010430 tx=0x7f0b780107d0).stop 2019-11-28T11:54:32.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.233+0000 7f0b95fc2700 1 -- 172.21.15.80:0/510810653 shutdown_connections 2019-11-28T11:54:32.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.233+0000 7f0b95fc2700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b9012eb70 0x7f0b90105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.233+0000 7f0b95fc2700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b9012e1a0 0x7f0b9012e630 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.233+0000 7f0b95fc2700 1 --2- 172.21.15.80:0/510810653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0b74018730 0x7f0b7401abc0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.234+0000 7f0b95fc2700 1 -- 172.21.15.80:0/510810653 shutdown_connections 2019-11-28T11:54:32.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.234+0000 7f0b95fc2700 1 -- 172.21.15.80:0/510810653 wait complete. 2019-11-28T11:54:32.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.234+0000 7f0b95fc2700 1 -- 172.21.15.80:0/510810653 >> 172.21.15.80:0/510810653 conn(0x7f0b901476e0 msgr2=0x7f0b9012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:32.301 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:54:32.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.374+0000 7f6dc0ae1700 1 Processor -- start 2019-11-28T11:54:32.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.374+0000 7f6dc0ae1700 1 -- start start 2019-11-28T11:54:32.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dc0ae1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6dbc1639f0 0x7f6dbc165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:32.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dc0ae1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc06db60 con 0x7f6dbc15ed10 2019-11-28T11:54:32.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dc0ae1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc06e060 con 0x7f6dbc15f100 2019-11-28T11:54:32.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dc0ae1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dbc06fe00 con 0x7f6dbc1639f0 2019-11-28T11:54:32.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dbb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6dbc1639f0 0x7f6dbc165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:32.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dbad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6dbc15ed10 0x7f6dbc073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44824/0 (socket says 172.21.15.80:44824) 2019-11-28T11:54:32.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dbb59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6dbc1639f0 0x7f6dbc165df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45510/0 (socket says 172.21.15.80:45510) 2019-11-28T11:54:32.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dbad9d700 1 -- 172.21.15.80:0/1730666514 learned_addr learned my addr 172.21.15.80:0/1730666514 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:32.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dbb59e700 1 -- 172.21.15.80:0/1730666514 >> v1:172.21.15.174:6789/0 conn(0x7f6dbc15f100 legacy=0x7f6dbc06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dbb59e700 1 -- 172.21.15.80:0/1730666514 >> v1:172.21.15.80:6789/0 conn(0x7f6dbc15ed10 legacy=0x7f6dbc073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dbb59e700 1 -- 172.21.15.80:0/1730666514 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc070760 con 0x7f6dbc1639f0 2019-11-28T11:54:32.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6db9d9b700 1 -- 172.21.15.80:0/1730666514 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394095727 0 0) 0x7f6da40014d0 con 0x7f6dbc15ed10 2019-11-28T11:54:32.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dbb59e700 1 --2- 172.21.15.80:0/1730666514 >> v2:172.21.15.80:3300/0 conn(0x7f6dbc1639f0 0x7f6dbc165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6db400af50 tx=0x7f6db400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dbb59e700 1 --2- 172.21.15.80:0/1730666514 >> v2:172.21.15.80:3300/0 conn(0x7f6dbc1639f0 0x7f6dbc165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6db400af50 tx=0x7f6db400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dbb59e700 1 --2- 172.21.15.80:0/1730666514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dbc1639f0 0x7f6dbc165df0 secure :-1 s=READY pgs=2626 cs=0 l=1 rx=0x7f6db400af50 tx=0x7f6db400b760).ready entity=mon.0 client_cookie=d8025c1ba5d46228 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:32.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dbb59e700 1 --2- 172.21.15.80:0/1730666514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dbc1639f0 0x7f6dbc165df0 secure :-1 s=THROTTLE_DONE pgs=2626 cs=0 l=1 rx=0x7f6db400af50 tx=0x7f6db400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6db9d9b700 1 -- 172.21.15.80:0/1730666514 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6db4009ba0 con 0x7f6dbc1639f0 2019-11-28T11:54:32.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dbb59e700 1 --2- 172.21.15.80:0/1730666514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dbc1639f0 0x7f6dbc165df0 secure :-1 s=THROTTLE_DONE pgs=2626 cs=0 l=1 rx=0x7f6db400af50 tx=0x7f6db400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dbb59e700 1 --2- 172.21.15.80:0/1730666514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dbc1639f0 0x7f6dbc165df0 secure :-1 s=THROTTLE_DONE pgs=2626 cs=0 l=1 rx=0x7f6db400af50 tx=0x7f6db400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6db9d9b700 1 -- 172.21.15.80:0/1730666514 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db4000a70 con 0x7f6dbc1639f0 2019-11-28T11:54:32.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6db9d9b700 1 -- 172.21.15.80:0/1730666514 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6db4009f90 con 0x7f6dbc1639f0 2019-11-28T11:54:32.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dc0ae1700 1 -- 172.21.15.80:0/1730666514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dbc1639f0 msgr2=0x7f6dbc165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.376+0000 7f6dc0ae1700 1 --2- 172.21.15.80:0/1730666514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dbc1639f0 0x7f6dbc165df0 secure :-1 s=READY pgs=2626 cs=0 l=1 rx=0x7f6db400af50 tx=0x7f6db400b760).stop 2019-11-28T11:54:32.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.377+0000 7f6dc0ae1700 1 -- 172.21.15.80:0/1730666514 shutdown_connections 2019-11-28T11:54:32.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.377+0000 7f6dc0ae1700 1 --2- 172.21.15.80:0/1730666514 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dbc1639f0 0x7f6dbc165df0 unknown :-1 s=CLOSED pgs=2626 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.377+0000 7f6dc0ae1700 1 -- 172.21.15.80:0/1730666514 shutdown_connections 2019-11-28T11:54:32.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.377+0000 7f6dc0ae1700 1 -- 172.21.15.80:0/1730666514 wait complete. 2019-11-28T11:54:32.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.377+0000 7f6dc0ae1700 1 -- 172.21.15.80:0/1730666514 >> 172.21.15.80:0/1730666514 conn(0x7f6dbc061d40 msgr2=0x7f6dbc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:32.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.380+0000 7f6dc0ae1700 1 Processor -- start 2019-11-28T11:54:32.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.380+0000 7f6dc0ae1700 1 -- start start 2019-11-28T11:54:32.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dc0ae1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6dbc152750 0x7f6dbc135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:32.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dc0ae1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc130dc0 0x7f6dbc131250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:32.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dc0ae1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc109d70 con 0x7f6dbc131790 2019-11-28T11:54:32.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dc0ae1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dbc132570 con 0x7f6dbc152750 2019-11-28T11:54:32.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dc0ae1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc132840 con 0x7f6dbc130dc0 2019-11-28T11:54:32.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dbb59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6dbc131790 0x7f6dbc134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44834/0 (socket says 172.21.15.80:44834) 2019-11-28T11:54:32.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dbb59e700 1 -- 172.21.15.80:0/740131261 learned_addr learned my addr 172.21.15.80:0/740131261 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:32.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dba59c700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc130dc0 0x7f6dbc131250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:32.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dbad9d700 1 --2- 172.21.15.80:0/740131261 >> v2:172.21.15.174:3300/0 conn(0x7f6dbc152750 0x7f6dbc135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:32.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6db37fe700 1 -- 172.21.15.80:0/740131261 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315829591 0 0) 0x7f6db4000940 con 0x7f6dbc131790 2019-11-28T11:54:32.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6db37fe700 1 -- 172.21.15.80:0/740131261 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d94002e80 con 0x7f6dbc131790 2019-11-28T11:54:32.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dba59c700 1 -- 172.21.15.80:0/740131261 >> v2:172.21.15.174:3300/0 conn(0x7f6dbc152750 msgr2=0x7f6dbc135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dba59c700 1 --2- 172.21.15.80:0/740131261 >> v2:172.21.15.174:3300/0 conn(0x7f6dbc152750 0x7f6dbc135790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dba59c700 1 -- 172.21.15.80:0/740131261 >> v1:172.21.15.80:6789/0 conn(0x7f6dbc131790 legacy=0x7f6dbc134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dba59c700 1 -- 172.21.15.80:0/740131261 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc132ed0 con 0x7f6dbc130dc0 2019-11-28T11:54:32.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dba59c700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc130dc0 0x7f6dbc131250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6dac0103a0 tx=0x7f6dac00b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dba59c700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc130dc0 0x7f6dbc131250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6dac0103a0 tx=0x7f6dac00b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dba59c700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc130dc0 0x7f6dbc131250 secure :-1 s=READY pgs=375 cs=0 l=1 rx=0x7f6dac0103a0 tx=0x7f6dac00b2e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:32.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dba59c700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc130dc0 0x7f6dbc131250 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f6dac0103a0 tx=0x7f6dac00b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6db37fe700 1 -- 172.21.15.80:0/740131261 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6dac000960 con 0x7f6dbc130dc0 2019-11-28T11:54:32.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dba59c700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc130dc0 0x7f6dbc131250 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f6dac0103a0 tx=0x7f6dac00b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dba59c700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc130dc0 0x7f6dbc131250 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f6dac0103a0 tx=0x7f6dac00b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6db37fe700 1 -- 172.21.15.80:0/740131261 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac0098b0 con 0x7f6dbc130dc0 2019-11-28T11:54:32.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6db37fe700 1 -- 172.21.15.80:0/740131261 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6dac00a000 con 0x7f6dbc130dc0 2019-11-28T11:54:32.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dc0ae1700 1 -- 172.21.15.80:0/740131261 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dbc133250 con 0x7f6dbc130dc0 2019-11-28T11:54:32.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.381+0000 7f6dc0ae1700 1 -- 172.21.15.80:0/740131261 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc132ed0 con 0x7f6dbc130dc0 2019-11-28T11:54:32.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.382+0000 7f6dba59c700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc130dc0 0x7f6dbc131250 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f6dac0103a0 tx=0x7f6dac00b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.382+0000 7f6db37fe700 1 -- 172.21.15.80:0/740131261 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6dac009aa0 con 0x7f6dbc130dc0 2019-11-28T11:54:32.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.382+0000 7f6dba59c700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc130dc0 0x7f6dbc131250 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f6dac0103a0 tx=0x7f6dac00b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.382+0000 7f6db37fe700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d94018770 0x7f6d9401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:32.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.382+0000 7f6db37fe700 1 -- 172.21.15.80:0/740131261 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6dac031aa0 con 0x7f6dbc130dc0 2019-11-28T11:54:32.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.382+0000 7f6dbad9d700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d94018770 0x7f6d9401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:32.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.383+0000 7f6dbad9d700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d94018770 0x7f6d9401abe0 crc :-1 s=READY pgs=1078 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:32.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.390+0000 7f6dc0ae1700 1 -- 172.21.15.80:0/740131261 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dbc133250 con 0x7f6dbc130dc0 2019-11-28T11:54:32.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.394+0000 7f6dba59c700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc130dc0 0x7f6dbc131250 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f6dac0103a0 tx=0x7f6dac00b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.394+0000 7f6db37fe700 1 -- 172.21.15.80:0/740131261 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6dac007110 con 0x7f6dbc130dc0 2019-11-28T11:54:32.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.566+0000 7f6dc0ae1700 1 -- 172.21.15.80:0/740131261 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6dbc132ed0 con 0x7f6dbc130dc0 2019-11-28T11:54:32.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.572+0000 7f6dba59c700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc130dc0 0x7f6dbc131250 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7f6dac0103a0 tx=0x7f6dac00b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.572+0000 7f6db37fe700 1 -- 172.21.15.80:0/740131261 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v70) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6dac009de0 con 0x7f6dbc130dc0 2019-11-28T11:54:32.631 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:54:32.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.575+0000 7f6dc0ae1700 1 -- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d94018770 msgr2=0x7f6d9401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.575+0000 7f6dc0ae1700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d94018770 0x7f6d9401abe0 crc :-1 s=READY pgs=1078 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.575+0000 7f6dc0ae1700 1 -- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc130dc0 msgr2=0x7f6dbc131250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.575+0000 7f6dc0ae1700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc130dc0 0x7f6dbc131250 secure :-1 s=READY pgs=375 cs=0 l=1 rx=0x7f6dac0103a0 tx=0x7f6dac00b2e0).stop 2019-11-28T11:54:32.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.575+0000 7f6dc0ae1700 1 -- 172.21.15.80:0/740131261 shutdown_connections 2019-11-28T11:54:32.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.575+0000 7f6dc0ae1700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d94018770 0x7f6d9401abe0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.575+0000 7f6dc0ae1700 1 --2- 172.21.15.80:0/740131261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6dbc130dc0 0x7f6dbc131250 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.575+0000 7f6dc0ae1700 1 --2- 172.21.15.80:0/740131261 >> v2:172.21.15.174:3300/0 conn(0x7f6dbc152750 0x7f6dbc135790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.575+0000 7f6dc0ae1700 1 -- 172.21.15.80:0/740131261 shutdown_connections 2019-11-28T11:54:32.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.575+0000 7f6dc0ae1700 1 -- 172.21.15.80:0/740131261 wait complete. 2019-11-28T11:54:32.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.575+0000 7f6dc0ae1700 1 -- 172.21.15.80:0/740131261 >> 172.21.15.80:0/740131261 conn(0x7f6dbc1476e0 msgr2=0x7f6dbc12fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:32.643 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:54:32.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.717+0000 7ff600c0f700 1 Processor -- start 2019-11-28T11:54:32.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.717+0000 7ff600c0f700 1 -- start start 2019-11-28T11:54:32.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.718+0000 7ff600c0f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5fc15ed10 0x7ff5fc15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:32.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.718+0000 7ff600c0f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc06db60 con 0x7ff5fc0734b0 2019-11-28T11:54:32.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.718+0000 7ff600c0f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc06e060 con 0x7ff5fc073020 2019-11-28T11:54:32.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.718+0000 7ff600c0f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5fc06fe00 con 0x7ff5fc15ed10 2019-11-28T11:54:32.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.718+0000 7ff5fad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5fc15ed10 0x7ff5fc15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:32.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.718+0000 7ff5fad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5fc15ed10 0x7ff5fc15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45522/0 (socket says 172.21.15.80:45522) 2019-11-28T11:54:32.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.718+0000 7ff5fb59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff5fc0734b0 0x7ff5fc0726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44840/0 (socket says 172.21.15.80:44840) 2019-11-28T11:54:32.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.718+0000 7ff5fad9d700 1 -- 172.21.15.80:0/2675055517 learned_addr learned my addr 172.21.15.80:0/2675055517 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:32.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.719+0000 7ff5fad9d700 1 -- 172.21.15.80:0/2675055517 >> v1:172.21.15.174:6789/0 conn(0x7ff5fc073020 legacy=0x7ff5fc071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.719+0000 7ff5fad9d700 1 -- 172.21.15.80:0/2675055517 >> v1:172.21.15.80:6789/0 conn(0x7ff5fc0734b0 legacy=0x7ff5fc0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.719+0000 7ff5fad9d700 1 -- 172.21.15.80:0/2675055517 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc070760 con 0x7ff5fc15ed10 2019-11-28T11:54:32.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.719+0000 7ff5f9d9b700 1 -- 172.21.15.80:0/2675055517 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836654823 0 0) 0x7ff5f40009b0 con 0x7ff5fc0734b0 2019-11-28T11:54:32.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.719+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/2675055517 >> v2:172.21.15.80:3300/0 conn(0x7ff5fc15ed10 0x7ff5fc15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff5ec00fac0 tx=0x7ff5ec00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.719+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/2675055517 >> v2:172.21.15.80:3300/0 conn(0x7ff5fc15ed10 0x7ff5fc15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff5ec00fac0 tx=0x7ff5ec00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.719+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/2675055517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc15ed10 0x7ff5fc15f100 secure :-1 s=READY pgs=2629 cs=0 l=1 rx=0x7ff5ec00fac0 tx=0x7ff5ec00fe60).ready entity=mon.0 client_cookie=d4b41d4e2712cd37 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:32.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.719+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/2675055517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc15ed10 0x7ff5fc15f100 secure :-1 s=THROTTLE_DONE pgs=2629 cs=0 l=1 rx=0x7ff5ec00fac0 tx=0x7ff5ec00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.719+0000 7ff5f9d9b700 1 -- 172.21.15.80:0/2675055517 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5ec000ce0 con 0x7ff5fc15ed10 2019-11-28T11:54:32.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.719+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/2675055517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc15ed10 0x7ff5fc15f100 secure :-1 s=THROTTLE_DONE pgs=2629 cs=0 l=1 rx=0x7ff5ec00fac0 tx=0x7ff5ec00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.719+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/2675055517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc15ed10 0x7ff5fc15f100 secure :-1 s=THROTTLE_DONE pgs=2629 cs=0 l=1 rx=0x7ff5ec00fac0 tx=0x7ff5ec00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.719+0000 7ff5f9d9b700 1 -- 172.21.15.80:0/2675055517 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec001010 con 0x7ff5fc15ed10 2019-11-28T11:54:32.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.719+0000 7ff5f9d9b700 1 -- 172.21.15.80:0/2675055517 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5ec001760 con 0x7ff5fc15ed10 2019-11-28T11:54:32.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.719+0000 7ff600c0f700 1 -- 172.21.15.80:0/2675055517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc15ed10 msgr2=0x7ff5fc15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.719+0000 7ff600c0f700 1 --2- 172.21.15.80:0/2675055517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc15ed10 0x7ff5fc15f100 secure :-1 s=READY pgs=2629 cs=0 l=1 rx=0x7ff5ec00fac0 tx=0x7ff5ec00fe60).stop 2019-11-28T11:54:32.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.720+0000 7ff600c0f700 1 -- 172.21.15.80:0/2675055517 shutdown_connections 2019-11-28T11:54:32.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.720+0000 7ff600c0f700 1 --2- 172.21.15.80:0/2675055517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc15ed10 0x7ff5fc15f100 unknown :-1 s=CLOSED pgs=2629 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.720+0000 7ff600c0f700 1 -- 172.21.15.80:0/2675055517 shutdown_connections 2019-11-28T11:54:32.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.720+0000 7ff600c0f700 1 -- 172.21.15.80:0/2675055517 wait complete. 2019-11-28T11:54:32.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.720+0000 7ff600c0f700 1 -- 172.21.15.80:0/2675055517 >> 172.21.15.80:0/2675055517 conn(0x7ff5fc061d40 msgr2=0x7ff5fc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:32.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.722+0000 7ff600c0f700 1 Processor -- start 2019-11-28T11:54:32.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.722+0000 7ff600c0f700 1 -- start start 2019-11-28T11:54:32.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.723+0000 7ff600c0f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5fc152750 0x7ff5fc1058b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:32.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.723+0000 7ff600c0f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5fc12cb40 0x7ff5fc1047a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:32.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.723+0000 7ff600c0f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc107c20 con 0x7ff5fc105df0 2019-11-28T11:54:32.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.723+0000 7ff600c0f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5fc106880 con 0x7ff5fc152750 2019-11-28T11:54:32.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.723+0000 7ff600c0f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc109d70 con 0x7ff5fc12cb40 2019-11-28T11:54:32.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.723+0000 7ff5fad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5fc152750 0x7ff5fc1058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:32.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.723+0000 7ff5fad9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5fc152750 0x7ff5fc1058b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45528/0 (socket says 172.21.15.80:45528) 2019-11-28T11:54:32.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.723+0000 7ff5fad9d700 1 -- 172.21.15.80:0/3222788074 learned_addr learned my addr 172.21.15.80:0/3222788074 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:32.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.723+0000 7ff5fa59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff5fc105df0 0x7ff5fc12c340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44846/0 (socket says 172.21.15.80:44846) 2019-11-28T11:54:32.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.723+0000 7ff5fad9d700 1 -- 172.21.15.80:0/3222788074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5fc12cb40 msgr2=0x7ff5fc1047a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff5fb59e700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5fc12cb40 0x7ff5fc1047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:32.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff5f37fe700 1 -- 172.21.15.80:0/3222788074 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972945839 0 0) 0x7ff5e40009b0 con 0x7ff5fc105df0 2019-11-28T11:54:32.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5fc12cb40 0x7ff5fc1047a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff5fad9d700 1 -- 172.21.15.80:0/3222788074 >> v1:172.21.15.80:6789/0 conn(0x7ff5fc105df0 legacy=0x7ff5fc12c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff5fad9d700 1 -- 172.21.15.80:0/3222788074 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc106f10 con 0x7ff5fc152750 2019-11-28T11:54:32.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff5fb59e700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5fc12cb40 0x7ff5fc1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:32.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/3222788074 >> v2:172.21.15.80:3300/0 conn(0x7ff5fc152750 0x7ff5fc1058b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5ec0107e0 tx=0x7ff5ec010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/3222788074 >> v2:172.21.15.80:3300/0 conn(0x7ff5fc152750 0x7ff5fc1058b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5ec0107e0 tx=0x7ff5ec010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc152750 0x7ff5fc1058b0 secure :-1 s=READY pgs=2631 cs=0 l=1 rx=0x7ff5ec0107e0 tx=0x7ff5ec010b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:32.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc152750 0x7ff5fc1058b0 secure :-1 s=THROTTLE_DONE pgs=2631 cs=0 l=1 rx=0x7ff5ec0107e0 tx=0x7ff5ec010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff5f37fe700 1 -- 172.21.15.80:0/3222788074 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5ec0058e0 con 0x7ff5fc152750 2019-11-28T11:54:32.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc152750 0x7ff5fc1058b0 secure :-1 s=THROTTLE_DONE pgs=2631 cs=0 l=1 rx=0x7ff5ec0107e0 tx=0x7ff5ec010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff600c0f700 1 -- 172.21.15.80:0/3222788074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5fc107290 con 0x7ff5fc152750 2019-11-28T11:54:32.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff5f37fe700 1 -- 172.21.15.80:0/3222788074 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec005500 con 0x7ff5fc152750 2019-11-28T11:54:32.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc152750 0x7ff5fc1058b0 secure :-1 s=THROTTLE_DONE pgs=2631 cs=0 l=1 rx=0x7ff5ec0107e0 tx=0x7ff5ec010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff5f37fe700 1 -- 172.21.15.80:0/3222788074 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5ec005b50 con 0x7ff5fc152750 2019-11-28T11:54:32.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff600c0f700 1 -- 172.21.15.80:0/3222788074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5fc106f10 con 0x7ff5fc152750 2019-11-28T11:54:32.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.724+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc152750 0x7ff5fc1058b0 secure :-1 s=THROTTLE_DONE pgs=2631 cs=0 l=1 rx=0x7ff5ec0107e0 tx=0x7ff5ec010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.725+0000 7ff5f37fe700 1 -- 172.21.15.80:0/3222788074 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff5ec0056f0 con 0x7ff5fc152750 2019-11-28T11:54:32.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.725+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc152750 0x7ff5fc1058b0 secure :-1 s=THROTTLE_DONE pgs=2631 cs=0 l=1 rx=0x7ff5ec0107e0 tx=0x7ff5ec010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.725+0000 7ff5f37fe700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5d4018730 0x7ff5d401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:32.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.725+0000 7ff5f37fe700 1 -- 172.21.15.80:0/3222788074 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff5ec031e50 con 0x7ff5fc152750 2019-11-28T11:54:32.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.725+0000 7ff5fa59c700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5d4018730 0x7ff5d401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:32.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.725+0000 7ff5fa59c700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5d4018730 0x7ff5d401abc0 crc :-1 s=READY pgs=1079 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:32.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.732+0000 7ff600c0f700 1 -- 172.21.15.80:0/3222788074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5fc107290 con 0x7ff5fc152750 2019-11-28T11:54:32.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.736+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc152750 0x7ff5fc1058b0 secure :-1 s=THROTTLE_DONE pgs=2631 cs=0 l=1 rx=0x7ff5ec0107e0 tx=0x7ff5ec010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.736+0000 7ff5f37fe700 1 -- 172.21.15.80:0/3222788074 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff5ec007570 con 0x7ff5fc152750 2019-11-28T11:54:32.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.908+0000 7ff600c0f700 1 -- 172.21.15.80:0/3222788074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff5fc106f10 con 0x7ff5fc152750 2019-11-28T11:54:32.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.914+0000 7ff5fad9d700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc152750 0x7ff5fc1058b0 secure :-1 s=THROTTLE_DONE pgs=2631 cs=0 l=1 rx=0x7ff5ec0107e0 tx=0x7ff5ec010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:32.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.914+0000 7ff5f37fe700 1 -- 172.21.15.80:0/3222788074 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v71) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff5ec017a70 con 0x7ff5fc152750 2019-11-28T11:54:32.972 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:54:32.974 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.917+0000 7ff600c0f700 1 -- 172.21.15.80:0/3222788074 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5d4018730 msgr2=0x7ff5d401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.917+0000 7ff600c0f700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5d4018730 0x7ff5d401abc0 crc :-1 s=READY pgs=1079 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.917+0000 7ff600c0f700 1 -- 172.21.15.80:0/3222788074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc152750 msgr2=0x7ff5fc1058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:32.975 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.917+0000 7ff600c0f700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc152750 0x7ff5fc1058b0 secure :-1 s=READY pgs=2631 cs=0 l=1 rx=0x7ff5ec0107e0 tx=0x7ff5ec010b80).stop 2019-11-28T11:54:32.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.917+0000 7ff600c0f700 1 -- 172.21.15.80:0/3222788074 shutdown_connections 2019-11-28T11:54:32.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.917+0000 7ff600c0f700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5d4018730 0x7ff5d401abc0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.917+0000 7ff600c0f700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5fc12cb40 0x7ff5fc1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.917+0000 7ff600c0f700 1 --2- 172.21.15.80:0/3222788074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5fc152750 0x7ff5fc1058b0 unknown :-1 s=CLOSED pgs=2631 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:32.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.917+0000 7ff600c0f700 1 -- 172.21.15.80:0/3222788074 shutdown_connections 2019-11-28T11:54:32.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.917+0000 7ff600c0f700 1 -- 172.21.15.80:0/3222788074 wait complete. 2019-11-28T11:54:32.976 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:32.917+0000 7ff600c0f700 1 -- 172.21.15.80:0/3222788074 >> 172.21.15.80:0/3222788074 conn(0x7ff5fc1476e0 msgr2=0x7ff5fc12fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:32.984 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:33.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.047+0000 7f3ee1837700 1 Processor -- start 2019-11-28T11:54:33.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.047+0000 7f3ee1837700 1 -- start start 2019-11-28T11:54:33.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3ee1837700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3edc06c0a0 0x7f3edc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:33.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3ee1837700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3edc06db00 con 0x7f3edc0734e0 2019-11-28T11:54:33.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3ee1837700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3edc06e000 con 0x7f3edc072620 2019-11-28T11:54:33.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3ee1837700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3edc06fd60 con 0x7f3edc06c0a0 2019-11-28T11:54:33.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3edaffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3edc0734e0 0x7f3edc071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44856/0 (socket says 172.21.15.80:44856) 2019-11-28T11:54:33.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3edaffd700 1 -- 172.21.15.80:0/2614598859 learned_addr learned my addr 172.21.15.80:0/2614598859 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:33.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3edb7fe700 1 --2- 172.21.15.80:0/2614598859 >> v2:172.21.15.174:3300/0 conn(0x7f3edc06c0a0 0x7f3edc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:33.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3eda7fc700 1 -- 172.21.15.80:0/2614598859 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380368493 0 0) 0x7f3ec4001070 con 0x7f3edc0734e0 2019-11-28T11:54:33.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3eda7fc700 1 -- 172.21.15.80:0/2614598859 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ec8002e80 con 0x7f3edc0734e0 2019-11-28T11:54:33.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3eda7fc700 1 -- 172.21.15.80:0/2614598859 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1501219185 0 0) 0x7f3ec4001050 con 0x7f3edc0734e0 2019-11-28T11:54:33.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3eda7fc700 1 -- 172.21.15.80:0/2614598859 >> v2:172.21.15.174:3300/0 conn(0x7f3edc06c0a0 msgr2=0x7f3edc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:33.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3eda7fc700 1 --2- 172.21.15.80:0/2614598859 >> v2:172.21.15.174:3300/0 conn(0x7f3edc06c0a0 0x7f3edc072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:33.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3eda7fc700 1 -- 172.21.15.80:0/2614598859 >> v1:172.21.15.174:6789/0 conn(0x7f3edc072620 legacy=0x7f3edc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:33.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3eda7fc700 1 -- 172.21.15.80:0/2614598859 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc0706c0 con 0x7f3edc0734e0 2019-11-28T11:54:33.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3eda7fc700 1 -- 172.21.15.80:0/2614598859 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f3ec40015e0 con 0x7f3edc0734e0 2019-11-28T11:54:33.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3edb7fe700 1 --2- 172.21.15.80:0/2614598859 >> v2:172.21.15.174:3300/0 conn(0x7f3edc06c0a0 0x7f3edc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:33.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3eda7fc700 1 -- 172.21.15.80:0/2614598859 >> v1:172.21.15.80:6789/0 conn(0x7f3edc0734e0 legacy=0x7f3edc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:33.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3eda7fc700 1 --2- 172.21.15.80:0/2614598859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ec8003a80 0x7f3ec8005ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:33.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3eda7fc700 1 --2- 172.21.15.80:0/2614598859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ec8006690 0x7f3ec8008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:33.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.048+0000 7f3eda7fc700 1 --2- 172.21.15.80:0/2614598859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ec80093a0 0x7f3ec800b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:33.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3eda7fc700 1 -- 172.21.15.80:0/2614598859 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec8050030 con 0x7f3ec80093a0 2019-11-28T11:54:33.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3eda7fc700 1 -- 172.21.15.80:0/2614598859 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec8050220 con 0x7f3ec8003a80 2019-11-28T11:54:33.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3eda7fc700 1 -- 172.21.15.80:0/2614598859 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec8050450 con 0x7f3ec8006690 2019-11-28T11:54:33.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3edbfff700 1 --2- 172.21.15.80:0/2614598859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ec80093a0 0x7f3ec800b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:33.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3edb7fe700 1 --2- 172.21.15.80:0/2614598859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ec8003a80 0x7f3ec8005ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:33.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3edaffd700 1 --2- 172.21.15.80:0/2614598859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ec8006690 0x7f3ec8008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:33.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3edbfff700 1 -- 172.21.15.80:0/2614598859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ec8006690 msgr2=0x7f3ec8008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:33.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3edbfff700 1 --2- 172.21.15.80:0/2614598859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ec8006690 0x7f3ec8008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:33.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3edbfff700 1 -- 172.21.15.80:0/2614598859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ec8003a80 msgr2=0x7f3ec8005ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:33.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3edbfff700 1 --2- 172.21.15.80:0/2614598859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ec8003a80 0x7f3ec8005ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:33.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3edbfff700 1 -- 172.21.15.80:0/2614598859 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec8050700 con 0x7f3ec80093a0 2019-11-28T11:54:33.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3edbfff700 1 --2- 172.21.15.80:0/2614598859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ec80093a0 0x7f3ec800b870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3ecc00af80 tx=0x7f3ecc00b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3edbfff700 1 -- 172.21.15.80:0/2614598859 reap_dead start 2019-11-28T11:54:33.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3edbfff700 1 --2- 172.21.15.80:0/2614598859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ec80093a0 0x7f3ec800b870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3ecc00af80 tx=0x7f3ecc00b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3edbfff700 1 --2- 172.21.15.80:0/2614598859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ec80093a0 0x7f3ec800b870 secure :-1 s=READY pgs=2633 cs=0 l=1 rx=0x7f3ecc00af80 tx=0x7f3ecc00b300).ready entity=mon.0 client_cookie=1b16663a4ac9d9d9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:33.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3edbfff700 1 --2- 172.21.15.80:0/2614598859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ec80093a0 0x7f3ec800b870 secure :-1 s=THROTTLE_DONE pgs=2633 cs=0 l=1 rx=0x7f3ecc00af80 tx=0x7f3ecc00b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3eda7fc700 1 -- 172.21.15.80:0/2614598859 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ecc0095c0 con 0x7f3ec80093a0 2019-11-28T11:54:33.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3edbfff700 1 --2- 172.21.15.80:0/2614598859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ec80093a0 0x7f3ec800b870 secure :-1 s=THROTTLE_DONE pgs=2633 cs=0 l=1 rx=0x7f3ecc00af80 tx=0x7f3ecc00b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3edbfff700 1 --2- 172.21.15.80:0/2614598859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ec80093a0 0x7f3ec800b870 secure :-1 s=THROTTLE_DONE pgs=2633 cs=0 l=1 rx=0x7f3ecc00af80 tx=0x7f3ecc00b300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3eda7fc700 1 -- 172.21.15.80:0/2614598859 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc000a20 con 0x7f3ec80093a0 2019-11-28T11:54:33.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3eda7fc700 1 -- 172.21.15.80:0/2614598859 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ecc00a050 con 0x7f3ec80093a0 2019-11-28T11:54:33.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3ee1837700 1 -- 172.21.15.80:0/2614598859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ec80093a0 msgr2=0x7f3ec800b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:33.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.049+0000 7f3ee1837700 1 --2- 172.21.15.80:0/2614598859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ec80093a0 0x7f3ec800b870 secure :-1 s=READY pgs=2633 cs=0 l=1 rx=0x7f3ecc00af80 tx=0x7f3ecc00b300).stop 2019-11-28T11:54:33.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.050+0000 7f3ee1837700 1 -- 172.21.15.80:0/2614598859 shutdown_connections 2019-11-28T11:54:33.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.050+0000 7f3ee1837700 1 --2- 172.21.15.80:0/2614598859 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ec80093a0 0x7f3ec800b870 unknown :-1 s=CLOSED pgs=2633 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:33.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.050+0000 7f3ee1837700 1 -- 172.21.15.80:0/2614598859 shutdown_connections 2019-11-28T11:54:33.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.050+0000 7f3ee1837700 1 -- 172.21.15.80:0/2614598859 wait complete. 2019-11-28T11:54:33.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.050+0000 7f3ee1837700 1 -- 172.21.15.80:0/2614598859 >> 172.21.15.80:0/2614598859 conn(0x7f3edc061cf0 msgr2=0x7f3edc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:33.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.052+0000 7f3ee1837700 1 Processor -- start 2019-11-28T11:54:33.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.053+0000 7f3ee1837700 1 -- start start 2019-11-28T11:54:33.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.053+0000 7f3ee1837700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3edc074d00 0x7f3edc07aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:33.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.053+0000 7f3ee1837700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3edc150f50 0x7f3edc07af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:33.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.053+0000 7f3ee1837700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3edc0754d0 con 0x7f3edc07bba0 2019-11-28T11:54:33.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.053+0000 7f3ee1837700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3edc077f50 con 0x7f3edc150f50 2019-11-28T11:54:33.131 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.053+0000 7f3ee1837700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc078980 con 0x7f3edc074d00 2019-11-28T11:54:33.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3edb7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3edc074d00 0x7f3edc07aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:33.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3edaffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3edc150f50 0x7f3edc07af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:33.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3edb7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3edc074d00 0x7f3edc07aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:47808/0 (socket says 172.21.15.80:47808) 2019-11-28T11:54:33.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3edb7fe700 1 -- 172.21.15.80:0/3767224507 learned_addr learned my addr 172.21.15.80:0/3767224507 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:33.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3edaffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3edc150f50 0x7f3edc07af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:60434/0 (socket says 172.21.15.80:60434) 2019-11-28T11:54:33.132 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3edb7fe700 1 -- 172.21.15.80:0/3767224507 >> v2:172.21.15.174:3300/0 conn(0x7f3edc150f50 msgr2=0x7f3edc07af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:33.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3edb7fe700 1 --2- 172.21.15.80:0/3767224507 >> v2:172.21.15.174:3300/0 conn(0x7f3edc150f50 0x7f3edc07af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:33.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3edb7fe700 1 -- 172.21.15.80:0/3767224507 >> v1:172.21.15.174:6789/0 conn(0x7f3edc07bba0 legacy=0x7f3edc076d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:33.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3edb7fe700 1 -- 172.21.15.80:0/3767224507 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc0792e0 con 0x7f3edc074d00 2019-11-28T11:54:33.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3edb7fe700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3edc074d00 0x7f3edc07aa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ed40107c0 tx=0x7f3ed4010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3edb7fe700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3edc074d00 0x7f3edc07aa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ed40107c0 tx=0x7f3ed4010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.133 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3edb7fe700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3edc074d00 0x7f3edc07aa20 secure :-1 s=READY pgs=376 cs=0 l=1 rx=0x7f3ed40107c0 tx=0x7f3ed4010640).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:33.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3edb7fe700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3edc074d00 0x7f3edc07aa20 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f3ed40107c0 tx=0x7f3ed4010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3edb7fe700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3edc074d00 0x7f3edc07aa20 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f3ed40107c0 tx=0x7f3ed4010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3ed3fff700 1 -- 172.21.15.80:0/3767224507 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ed4000cc0 con 0x7f3edc074d00 2019-11-28T11:54:33.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3edb7fe700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3edc074d00 0x7f3edc07aa20 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f3ed40107c0 tx=0x7f3ed4010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3ed3fff700 1 -- 172.21.15.80:0/3767224507 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed4009af0 con 0x7f3edc074d00 2019-11-28T11:54:33.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3ed3fff700 1 -- 172.21.15.80:0/3767224507 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ed400a100 con 0x7f3edc074d00 2019-11-28T11:54:33.134 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3ee1837700 1 -- 172.21.15.80:0/3767224507 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3edc079660 con 0x7f3edc074d00 2019-11-28T11:54:33.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.054+0000 7f3ee1837700 1 -- 172.21.15.80:0/3767224507 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3edc0792e0 con 0x7f3edc074d00 2019-11-28T11:54:33.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.055+0000 7f3edb7fe700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3edc074d00 0x7f3edc07aa20 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f3ed40107c0 tx=0x7f3ed4010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.055+0000 7f3ed3fff700 1 -- 172.21.15.80:0/3767224507 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3ed4009ce0 con 0x7f3edc074d00 2019-11-28T11:54:33.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.055+0000 7f3edb7fe700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3edc074d00 0x7f3edc07aa20 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f3ed40107c0 tx=0x7f3ed4010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.055+0000 7f3ed3fff700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ec0018730 0x7f3ec001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:33.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.055+0000 7f3ed3fff700 1 -- 172.21.15.80:0/3767224507 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3ed4031ec0 con 0x7f3edc074d00 2019-11-28T11:54:33.135 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.055+0000 7f3edaffd700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ec0018730 0x7f3ec001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:33.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.055+0000 7f3edaffd700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ec0018730 0x7f3ec001abc0 crc :-1 s=READY pgs=1080 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:33.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.062+0000 7f3ee1837700 1 -- 172.21.15.80:0/3767224507 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3edc079660 con 0x7f3edc074d00 2019-11-28T11:54:33.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.066+0000 7f3edb7fe700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3edc074d00 0x7f3edc07aa20 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f3ed40107c0 tx=0x7f3ed4010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.136 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.066+0000 7f3ed3fff700 1 -- 172.21.15.80:0/3767224507 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3ed400abc0 con 0x7f3edc074d00 2019-11-28T11:54:33.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.237+0000 7f3ee1837700 1 -- 172.21.15.80:0/3767224507 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3edc0792e0 con 0x7f3edc074d00 2019-11-28T11:54:33.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.237+0000 7f3edb7fe700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3edc074d00 0x7f3edc07aa20 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f3ed40107c0 tx=0x7f3ed4010640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.237+0000 7f3ed3fff700 1 -- 172.21.15.80:0/3767224507 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 167 v167) v1 ==== 95+0+1783 (secure 0 0 0) 0x7f3ed4009cc0 con 0x7f3edc074d00 2019-11-28T11:54:33.296 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 167 2019-11-28T11:54:33.296 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:33.296 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":167,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":167,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:54:29.202039+0000","modified":"2019-11-28T11:54:32.779460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10972},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10972":{"gid":10972,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/2209008547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2209008547},{"type":"v1","addr":"172.21.15.174:6835","nonce":2209008547}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2019-11-28T11:54:33.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.240+0000 7f3ee1837700 1 -- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ec0018730 msgr2=0x7f3ec001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:33.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.240+0000 7f3ee1837700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ec0018730 0x7f3ec001abc0 crc :-1 s=READY pgs=1080 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:33.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.240+0000 7f3ee1837700 1 -- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3edc074d00 msgr2=0x7f3edc07aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:33.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.240+0000 7f3ee1837700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3edc074d00 0x7f3edc07aa20 secure :-1 s=READY pgs=376 cs=0 l=1 rx=0x7f3ed40107c0 tx=0x7f3ed4010640).stop 2019-11-28T11:54:33.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.240+0000 7f3ee1837700 1 -- 172.21.15.80:0/3767224507 shutdown_connections 2019-11-28T11:54:33.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.240+0000 7f3ee1837700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ec0018730 0x7f3ec001abc0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:33.301 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.240+0000 7f3ee1837700 1 --2- 172.21.15.80:0/3767224507 >> v2:172.21.15.174:3300/0 conn(0x7f3edc150f50 0x7f3edc07af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:33.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.240+0000 7f3ee1837700 1 --2- 172.21.15.80:0/3767224507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3edc074d00 0x7f3edc07aa20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:33.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.240+0000 7f3ee1837700 1 -- 172.21.15.80:0/3767224507 shutdown_connections 2019-11-28T11:54:33.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.240+0000 7f3ee1837700 1 -- 172.21.15.80:0/3767224507 wait complete. 2019-11-28T11:54:33.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.240+0000 7f3ee1837700 1 -- 172.21.15.80:0/3767224507 >> 172.21.15.80:0/3767224507 conn(0x7f3edc13fa50 msgr2=0x7f3edc07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:33.614 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 10972}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 32, u'failed': [], u'epoch': 167, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [33], u'info': {u'gid_10972': {u'export_targets': [], u'name': u'c', u'incarnation': 166, u'state_seq': 2, u'state': u'up:active', u'gid': 10972, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2209008547, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2209008547, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2209008547'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:54:29.202039+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:54:32.779460+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:54:33.614 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:54:33.615 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:54:33.741 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:54:33.742 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:54:33.742 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:54:33.742 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 10972, 2019-11-28T11:54:33.742 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:54:33.742 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:54:33.743 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 1.9090813659999999, 2019-11-28T11:54:33.743 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 167, 2019-11-28T11:54:33.743 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 203, 2019-11-28T11:54:33.743 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 203, 2019-11-28T11:54:33.743 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 2.0442674520000002 2019-11-28T11:54:33.743 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:54:33.747 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 10972, "want_state": "up:active", "state": "up:active", "rank_uptime": 1.9090813659999999, "mdsmap_epoch": 167, "osdmap_epoch": 203, "osdmap_epoch_barrier": 203, "uptime": 2.0442674520000002 } 2019-11-28T11:54:33.747 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:54:33.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.811+0000 7ff378a9e700 1 Processor -- start 2019-11-28T11:54:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.811+0000 7ff378a9e700 1 -- start start 2019-11-28T11:54:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.812+0000 7ff378a9e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff37406c0a0 0x7ff374072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.812+0000 7ff378a9e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff374072620 0x7ff374164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:33.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.812+0000 7ff378a9e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37406db00 con 0x7ff3740734e0 2019-11-28T11:54:33.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.812+0000 7ff378a9e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37406fd60 con 0x7ff37406c0a0 2019-11-28T11:54:33.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.812+0000 7ff378a9e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff374070030 con 0x7ff374072620 2019-11-28T11:54:33.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.812+0000 7ff37359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff374072620 0x7ff374164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:33.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.812+0000 7ff372d9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff37406c0a0 0x7ff374072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:33.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.812+0000 7ff37359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff374072620 0x7ff374164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:47818/0 (socket says 172.21.15.80:47818) 2019-11-28T11:54:33.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.812+0000 7ff37359e700 1 -- 172.21.15.80:0/2868770287 learned_addr learned my addr 172.21.15.80:0/2868770287 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:33.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff372d9d700 1 -- 172.21.15.80:0/2868770287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff374072620 msgr2=0x7ff374164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:33.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff372d9d700 1 --2- 172.21.15.80:0/2868770287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff374072620 0x7ff374164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:33.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff372d9d700 1 -- 172.21.15.80:0/2868770287 >> v1:172.21.15.174:6789/0 conn(0x7ff3740734e0 legacy=0x7ff374071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:33.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff371d9b700 1 -- 172.21.15.80:0/2868770287 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933430857 0 0) 0x7ff35c001030 con 0x7ff3740734e0 2019-11-28T11:54:33.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff372d9d700 1 -- 172.21.15.80:0/2868770287 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3740706c0 con 0x7ff37406c0a0 2019-11-28T11:54:33.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff37359e700 1 --2- 172.21.15.80:0/2868770287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff374072620 0x7ff374164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff372d9d700 1 --2- 172.21.15.80:0/2868770287 >> v2:172.21.15.174:3300/0 conn(0x7ff37406c0a0 0x7ff374072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff36400af50 tx=0x7ff36400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff372d9d700 1 --2- 172.21.15.80:0/2868770287 >> v2:172.21.15.174:3300/0 conn(0x7ff37406c0a0 0x7ff374072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff36400af50 tx=0x7ff36400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff372d9d700 1 --2- 172.21.15.80:0/2868770287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff37406c0a0 0x7ff374072fa0 secure :-1 s=READY pgs=1587 cs=0 l=1 rx=0x7ff36400af50 tx=0x7ff36400b760).ready entity=mon.1 client_cookie=80eaa1b7d495f552 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff372d9d700 1 --2- 172.21.15.80:0/2868770287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff37406c0a0 0x7ff374072fa0 secure :-1 s=THROTTLE_DONE pgs=1587 cs=0 l=1 rx=0x7ff36400af50 tx=0x7ff36400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff371d9b700 1 -- 172.21.15.80:0/2868770287 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff364007210 con 0x7ff37406c0a0 2019-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff372d9d700 1 --2- 172.21.15.80:0/2868770287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff37406c0a0 0x7ff374072fa0 secure :-1 s=THROTTLE_DONE pgs=1587 cs=0 l=1 rx=0x7ff36400af50 tx=0x7ff36400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff371d9b700 1 -- 172.21.15.80:0/2868770287 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3640097c0 con 0x7ff37406c0a0 2019-11-28T11:54:33.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff372d9d700 1 --2- 172.21.15.80:0/2868770287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff37406c0a0 0x7ff374072fa0 secure :-1 s=THROTTLE_DONE pgs=1587 cs=0 l=1 rx=0x7ff36400af50 tx=0x7ff36400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff378a9e700 1 -- 172.21.15.80:0/2868770287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff37406c0a0 msgr2=0x7ff374072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:33.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff371d9b700 1 -- 172.21.15.80:0/2868770287 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3640099b0 con 0x7ff37406c0a0 2019-11-28T11:54:33.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.813+0000 7ff378a9e700 1 --2- 172.21.15.80:0/2868770287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff37406c0a0 0x7ff374072fa0 secure :-1 s=READY pgs=1587 cs=0 l=1 rx=0x7ff36400af50 tx=0x7ff36400b760).stop 2019-11-28T11:54:33.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.814+0000 7ff378a9e700 1 -- 172.21.15.80:0/2868770287 shutdown_connections 2019-11-28T11:54:33.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.814+0000 7ff378a9e700 1 --2- 172.21.15.80:0/2868770287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff374072620 0x7ff374164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:33.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.814+0000 7ff378a9e700 1 --2- 172.21.15.80:0/2868770287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff37406c0a0 0x7ff374072fa0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:33.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.814+0000 7ff378a9e700 1 -- 172.21.15.80:0/2868770287 shutdown_connections 2019-11-28T11:54:33.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.814+0000 7ff378a9e700 1 -- 172.21.15.80:0/2868770287 wait complete. 2019-11-28T11:54:33.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.814+0000 7ff378a9e700 1 -- 172.21.15.80:0/2868770287 >> 172.21.15.80:0/2868770287 conn(0x7ff374061cf0 msgr2=0x7ff374064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:33.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.816+0000 7ff378a9e700 1 Processor -- start 2019-11-28T11:54:33.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.816+0000 7ff378a9e700 1 -- start start 2019-11-28T11:54:33.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.817+0000 7ff378a9e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff374104820 0x7ff37410c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:33.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.817+0000 7ff378a9e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff37410c890 0x7ff37410b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:33.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.817+0000 7ff378a9e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff37410b710 0x7ff37410bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:33.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.817+0000 7ff378a9e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff374109130 con 0x7ff37410b710 2019-11-28T11:54:33.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.817+0000 7ff378a9e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff374109400 con 0x7ff374104820 2019-11-28T11:54:33.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.817+0000 7ff378a9e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff374108700 con 0x7ff37410c890 2019-11-28T11:54:33.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.817+0000 7ff37359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff37410b710 0x7ff37410bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:33.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.817+0000 7ff372d9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff374104820 0x7ff37410c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:33.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.817+0000 7ff37359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff37410b710 0x7ff37410bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45564/0 (socket says 172.21.15.80:45564) 2019-11-28T11:54:33.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.817+0000 7ff37359e700 1 -- 172.21.15.80:0/1504343223 learned_addr learned my addr 172.21.15.80:0/1504343223 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:33.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.817+0000 7ff37259c700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff37410c890 0x7ff37410b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:33.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff37359e700 1 -- 172.21.15.80:0/1504343223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff37410c890 msgr2=0x7ff37410b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:33.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff37359e700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff37410c890 0x7ff37410b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:33.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff37359e700 1 -- 172.21.15.80:0/1504343223 >> v2:172.21.15.174:3300/0 conn(0x7ff374104820 msgr2=0x7ff37410c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:33.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff37359e700 1 --2- 172.21.15.80:0/1504343223 >> v2:172.21.15.174:3300/0 conn(0x7ff374104820 0x7ff37410c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:33.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff37359e700 1 -- 172.21.15.80:0/1504343223 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff374109a90 con 0x7ff37410b710 2019-11-28T11:54:33.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff372d9d700 1 --2- 172.21.15.80:0/1504343223 >> v2:172.21.15.174:3300/0 conn(0x7ff374104820 0x7ff37410c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:33.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff37359e700 1 --2- 172.21.15.80:0/1504343223 >> v2:172.21.15.80:3300/0 conn(0x7ff37410b710 0x7ff37410bb90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff36c010780 tx=0x7ff36c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff37359e700 1 --2- 172.21.15.80:0/1504343223 >> v2:172.21.15.80:3300/0 conn(0x7ff37410b710 0x7ff37410bb90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff36c010780 tx=0x7ff36c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff37359e700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff37410b710 0x7ff37410bb90 secure :-1 s=READY pgs=2634 cs=0 l=1 rx=0x7ff36c010780 tx=0x7ff36c010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:33.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff37359e700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff37410b710 0x7ff37410bb90 secure :-1 s=THROTTLE_DONE pgs=2634 cs=0 l=1 rx=0x7ff36c010780 tx=0x7ff36c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff36b7fe700 1 -- 172.21.15.80:0/1504343223 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff36c001400 con 0x7ff37410b710 2019-11-28T11:54:33.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff37359e700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff37410b710 0x7ff37410bb90 secure :-1 s=THROTTLE_DONE pgs=2634 cs=0 l=1 rx=0x7ff36c010780 tx=0x7ff36c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff378a9e700 1 -- 172.21.15.80:0/1504343223 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff374109e10 con 0x7ff37410b710 2019-11-28T11:54:33.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff36b7fe700 1 -- 172.21.15.80:0/1504343223 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c000fb0 con 0x7ff37410b710 2019-11-28T11:54:33.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff37359e700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff37410b710 0x7ff37410bb90 secure :-1 s=THROTTLE_DONE pgs=2634 cs=0 l=1 rx=0x7ff36c010780 tx=0x7ff36c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff36b7fe700 1 -- 172.21.15.80:0/1504343223 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff36c0015f0 con 0x7ff37410b710 2019-11-28T11:54:33.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff378a9e700 1 -- 172.21.15.80:0/1504343223 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff374109a90 con 0x7ff37410b710 2019-11-28T11:54:33.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.818+0000 7ff37359e700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff37410b710 0x7ff37410bb90 secure :-1 s=THROTTLE_DONE pgs=2634 cs=0 l=1 rx=0x7ff36c010780 tx=0x7ff36c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.819+0000 7ff36b7fe700 1 -- 172.21.15.80:0/1504343223 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff36c001400 con 0x7ff37410b710 2019-11-28T11:54:33.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.819+0000 7ff37359e700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff37410b710 0x7ff37410bb90 secure :-1 s=THROTTLE_DONE pgs=2634 cs=0 l=1 rx=0x7ff36c010780 tx=0x7ff36c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.819+0000 7ff36b7fe700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff34c018730 0x7ff34c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:33.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.819+0000 7ff36b7fe700 1 -- 172.21.15.80:0/1504343223 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff36c031db0 con 0x7ff37410b710 2019-11-28T11:54:33.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.819+0000 7ff372d9d700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff34c018730 0x7ff34c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:33.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.819+0000 7ff372d9d700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff34c018730 0x7ff34c01abc0 crc :-1 s=READY pgs=1081 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:33.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.826+0000 7ff378a9e700 1 -- 172.21.15.80:0/1504343223 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff374109e10 con 0x7ff37410b710 2019-11-28T11:54:33.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.830+0000 7ff37359e700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff37410b710 0x7ff37410bb90 secure :-1 s=THROTTLE_DONE pgs=2634 cs=0 l=1 rx=0x7ff36c010780 tx=0x7ff36c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:33.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:33.830+0000 7ff36b7fe700 1 -- 172.21.15.80:0/1504343223 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff36c0011f0 con 0x7ff37410b710 2019-11-28T11:54:34.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.006+0000 7ff378a9e700 1 -- 172.21.15.80:0/1504343223 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff374109a90 con 0x7ff37410b710 2019-11-28T11:54:34.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.006+0000 7ff37359e700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff37410b710 0x7ff37410bb90 secure :-1 s=THROTTLE_DONE pgs=2634 cs=0 l=1 rx=0x7ff36c010780 tx=0x7ff36c010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.006+0000 7ff36b7fe700 1 -- 172.21.15.80:0/1504343223 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) v1 ==== 74+0+14871 (secure 0 0 0) 0x7ff36c001400 con 0x7ff37410b710 2019-11-28T11:54:34.064 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:34.065 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":203,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:54:30.203239+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:54:27.540791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":33,"pool_name":"cephfs_data","create_time":"2019-11-28T11:54:28.225144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:54:34.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.008+0000 7ff378a9e700 1 -- 172.21.15.80:0/1504343223 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff34c018730 msgr2=0x7ff34c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.008+0000 7ff378a9e700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff34c018730 0x7ff34c01abc0 crc :-1 s=READY pgs=1081 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.008+0000 7ff378a9e700 1 -- 172.21.15.80:0/1504343223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff37410b710 msgr2=0x7ff37410bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.008+0000 7ff378a9e700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff37410b710 0x7ff37410bb90 secure :-1 s=READY pgs=2634 cs=0 l=1 rx=0x7ff36c010780 tx=0x7ff36c010600).stop 2019-11-28T11:54:34.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.009+0000 7ff378a9e700 1 -- 172.21.15.80:0/1504343223 shutdown_connections 2019-11-28T11:54:34.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.009+0000 7ff378a9e700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff34c018730 0x7ff34c01abc0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.009+0000 7ff378a9e700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff37410b710 0x7ff37410bb90 unknown :-1 s=CLOSED pgs=2634 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.009+0000 7ff378a9e700 1 --2- 172.21.15.80:0/1504343223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff37410c890 0x7ff37410b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.009+0000 7ff378a9e700 1 --2- 172.21.15.80:0/1504343223 >> v2:172.21.15.174:3300/0 conn(0x7ff374104820 0x7ff37410c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.009+0000 7ff378a9e700 1 -- 172.21.15.80:0/1504343223 shutdown_connections 2019-11-28T11:54:34.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.009+0000 7ff378a9e700 1 -- 172.21.15.80:0/1504343223 wait complete. 2019-11-28T11:54:34.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.009+0000 7ff378a9e700 1 -- 172.21.15.80:0/1504343223 >> 172.21.15.80:0/1504343223 conn(0x7ff37413d620 msgr2=0x7ff37413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:34.077 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:54:27.540791+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 32, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'202', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:54:28.225144+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 33, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'203', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:54:34.078 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:54:34.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.146+0000 7fef9381b700 1 Processor -- start 2019-11-28T11:54:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.146+0000 7fef9381b700 1 -- start start 2019-11-28T11:54:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.147+0000 7fef9381b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8c15ed10 0x7fef8c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.147+0000 7fef9381b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fef8c073020 0x7fef8c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.147+0000 7fef9381b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8c06db60 con 0x7fef8c0734b0 2019-11-28T11:54:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.147+0000 7fef9381b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8c06f3d0 con 0x7fef8c073020 2019-11-28T11:54:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.147+0000 7fef9381b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c06fe00 con 0x7fef8c15ed10 2019-11-28T11:54:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.147+0000 7fef91db8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8c15ed10 0x7fef8c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.147+0000 7fef915b7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fef8c073020 0x7fef8c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.147+0000 7fef91db8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8c15ed10 0x7fef8c15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:47830/0 (socket says 172.21.15.80:47830) 2019-11-28T11:54:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.147+0000 7fef915b7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fef8c073020 0x7fef8c071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:60460/0 (socket says 172.21.15.80:60460) 2019-11-28T11:54:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.147+0000 7fef91db8700 1 -- 172.21.15.80:0/2016000764 learned_addr learned my addr 172.21.15.80:0/2016000764 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.147+0000 7fef925b9700 1 --1- 172.21.15.80:0/2016000764 >> v1:172.21.15.174:6789/0 conn(0x7fef8c0734b0 0x7fef8c0723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:60432/0 (socket says 172.21.15.80:60432) 2019-11-28T11:54:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef91db8700 1 -- 172.21.15.80:0/2016000764 >> v2:172.21.15.174:3300/0 conn(0x7fef8c073020 msgr2=0x7fef8c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef91db8700 1 --2- 172.21.15.80:0/2016000764 >> v2:172.21.15.174:3300/0 conn(0x7fef8c073020 0x7fef8c071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef91db8700 1 -- 172.21.15.80:0/2016000764 >> v1:172.21.15.174:6789/0 conn(0x7fef8c0734b0 legacy=0x7fef8c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef90db6700 1 -- 172.21.15.80:0/2016000764 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217031911 0 0) 0x7fef840009b0 con 0x7fef8c0734b0 2019-11-28T11:54:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef91db8700 1 -- 172.21.15.80:0/2016000764 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c070760 con 0x7fef8c15ed10 2019-11-28T11:54:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef915b7700 1 --2- 172.21.15.80:0/2016000764 >> v2:172.21.15.174:3300/0 conn(0x7fef8c073020 0x7fef8c071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef91db8700 1 --2- 172.21.15.80:0/2016000764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8c15ed10 0x7fef8c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fef7c00f740 tx=0x7fef7c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef91db8700 1 --2- 172.21.15.80:0/2016000764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8c15ed10 0x7fef8c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fef7c00f740 tx=0x7fef7c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef91db8700 1 --2- 172.21.15.80:0/2016000764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8c15ed10 0x7fef8c15f100 secure :-1 s=READY pgs=377 cs=0 l=1 rx=0x7fef7c00f740 tx=0x7fef7c00fae0).ready entity=mon.2 client_cookie=b92b7d6647c07e42 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:34.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef91db8700 1 --2- 172.21.15.80:0/2016000764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8c15ed10 0x7fef8c15f100 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7fef7c00f740 tx=0x7fef7c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef91db8700 1 --2- 172.21.15.80:0/2016000764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8c15ed10 0x7fef8c15f100 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7fef7c00f740 tx=0x7fef7c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef90db6700 1 -- 172.21.15.80:0/2016000764 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef7c000960 con 0x7fef8c15ed10 2019-11-28T11:54:34.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef91db8700 1 --2- 172.21.15.80:0/2016000764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8c15ed10 0x7fef8c15f100 secure :-1 s=THROTTLE_DONE pgs=377 cs=0 l=1 rx=0x7fef7c00f740 tx=0x7fef7c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef90db6700 1 -- 172.21.15.80:0/2016000764 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c000c90 con 0x7fef8c15ed10 2019-11-28T11:54:34.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef90db6700 1 -- 172.21.15.80:0/2016000764 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef7c0013a0 con 0x7fef8c15ed10 2019-11-28T11:54:34.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef9381b700 1 -- 172.21.15.80:0/2016000764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8c15ed10 msgr2=0x7fef8c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.148+0000 7fef9381b700 1 --2- 172.21.15.80:0/2016000764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8c15ed10 0x7fef8c15f100 secure :-1 s=READY pgs=377 cs=0 l=1 rx=0x7fef7c00f740 tx=0x7fef7c00fae0).stop 2019-11-28T11:54:34.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.149+0000 7fef9381b700 1 -- 172.21.15.80:0/2016000764 shutdown_connections 2019-11-28T11:54:34.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.149+0000 7fef9381b700 1 --2- 172.21.15.80:0/2016000764 >> v2:172.21.15.174:3300/0 conn(0x7fef8c073020 0x7fef8c071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:34.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.149+0000 7fef9381b700 1 --2- 172.21.15.80:0/2016000764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8c15ed10 0x7fef8c15f100 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.149+0000 7fef9381b700 1 -- 172.21.15.80:0/2016000764 shutdown_connections 2019-11-28T11:54:34.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.149+0000 7fef9381b700 1 -- 172.21.15.80:0/2016000764 wait complete. 2019-11-28T11:54:34.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.149+0000 7fef9381b700 1 -- 172.21.15.80:0/2016000764 >> 172.21.15.80:0/2016000764 conn(0x7fef8c061d20 msgr2=0x7fef8c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:34.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.152+0000 7fef9381b700 1 Processor -- start 2019-11-28T11:54:34.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.152+0000 7fef9381b700 1 -- start start 2019-11-28T11:54:34.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.152+0000 7fef9381b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef8c10f9f0 0x7fef8c168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:34.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.152+0000 7fef9381b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8c10c250 con 0x7fef8c10e970 2019-11-28T11:54:34.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.152+0000 7fef9381b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8c10fe70 con 0x7fef8c10ed60 2019-11-28T11:54:34.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.152+0000 7fef9381b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8c10e430 con 0x7fef8c10f9f0 2019-11-28T11:54:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.152+0000 7fef925b9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef8c10f9f0 0x7fef8c168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef925b9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef8c10f9f0 0x7fef8c168d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45580/0 (socket says 172.21.15.80:45580) 2019-11-28T11:54:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef91db8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fef8c10e970 0x7fef8c1087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44892/0 (socket says 172.21.15.80:44892) 2019-11-28T11:54:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef925b9700 1 -- 172.21.15.80:0/2682590688 learned_addr learned my addr 172.21.15.80:0/2682590688 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef8a7fc700 1 -- 172.21.15.80:0/2682590688 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186249706 0 0) 0x7fef7400df00 con 0x7fef8c10ed60 2019-11-28T11:54:34.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef925b9700 1 -- 172.21.15.80:0/2682590688 >> v1:172.21.15.174:6789/0 conn(0x7fef8c10ed60 legacy=0x7fef8c10f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef925b9700 1 -- 172.21.15.80:0/2682590688 >> v1:172.21.15.80:6789/0 conn(0x7fef8c10e970 legacy=0x7fef8c1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef925b9700 1 -- 172.21.15.80:0/2682590688 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c105ef0 con 0x7fef8c10f9f0 2019-11-28T11:54:34.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef925b9700 1 --2- 172.21.15.80:0/2682590688 >> v2:172.21.15.80:3300/0 conn(0x7fef8c10f9f0 0x7fef8c168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fef84010410 tx=0x7fef840107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef925b9700 1 --2- 172.21.15.80:0/2682590688 >> v2:172.21.15.80:3300/0 conn(0x7fef8c10f9f0 0x7fef8c168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fef84010410 tx=0x7fef840107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef925b9700 1 --2- 172.21.15.80:0/2682590688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8c10f9f0 0x7fef8c168d80 secure :-1 s=READY pgs=2636 cs=0 l=1 rx=0x7fef84010410 tx=0x7fef840107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:34.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef925b9700 1 --2- 172.21.15.80:0/2682590688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8c10f9f0 0x7fef8c168d80 secure :-1 s=THROTTLE_DONE pgs=2636 cs=0 l=1 rx=0x7fef84010410 tx=0x7fef840107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef8a7fc700 1 -- 172.21.15.80:0/2682590688 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef84000940 con 0x7fef8c10f9f0 2019-11-28T11:54:34.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef925b9700 1 --2- 172.21.15.80:0/2682590688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8c10f9f0 0x7fef8c168d80 secure :-1 s=THROTTLE_DONE pgs=2636 cs=0 l=1 rx=0x7fef84010410 tx=0x7fef840107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef925b9700 1 --2- 172.21.15.80:0/2682590688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8c10f9f0 0x7fef8c168d80 secure :-1 s=THROTTLE_DONE pgs=2636 cs=0 l=1 rx=0x7fef84010410 tx=0x7fef840107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef8a7fc700 1 -- 172.21.15.80:0/2682590688 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef840012f0 con 0x7fef8c10f9f0 2019-11-28T11:54:34.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef9381b700 1 -- 172.21.15.80:0/2682590688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8c106270 con 0x7fef8c10f9f0 2019-11-28T11:54:34.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef8a7fc700 1 -- 172.21.15.80:0/2682590688 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef840043b0 con 0x7fef8c10f9f0 2019-11-28T11:54:34.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.153+0000 7fef9381b700 1 -- 172.21.15.80:0/2682590688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8c105ef0 con 0x7fef8c10f9f0 2019-11-28T11:54:34.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.154+0000 7fef925b9700 1 --2- 172.21.15.80:0/2682590688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8c10f9f0 0x7fef8c168d80 secure :-1 s=THROTTLE_DONE pgs=2636 cs=0 l=1 rx=0x7fef84010410 tx=0x7fef840107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.154+0000 7fef8a7fc700 1 -- 172.21.15.80:0/2682590688 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fef840041c0 con 0x7fef8c10f9f0 2019-11-28T11:54:34.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.154+0000 7fef925b9700 1 --2- 172.21.15.80:0/2682590688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8c10f9f0 0x7fef8c168d80 secure :-1 s=THROTTLE_DONE pgs=2636 cs=0 l=1 rx=0x7fef84010410 tx=0x7fef840107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.154+0000 7fef8a7fc700 1 --2- 172.21.15.80:0/2682590688 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef70018730 0x7fef7001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:34.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.154+0000 7fef8a7fc700 1 -- 172.21.15.80:0/2682590688 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fef84031d40 con 0x7fef8c10f9f0 2019-11-28T11:54:34.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.154+0000 7fef91db8700 1 --2- 172.21.15.80:0/2682590688 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef70018730 0x7fef7001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:34.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.155+0000 7fef91db8700 1 --2- 172.21.15.80:0/2682590688 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef70018730 0x7fef7001abe0 crc :-1 s=READY pgs=1082 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:34.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.162+0000 7fef9381b700 1 -- 172.21.15.80:0/2682590688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8c106270 con 0x7fef8c10f9f0 2019-11-28T11:54:34.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.165+0000 7fef925b9700 1 --2- 172.21.15.80:0/2682590688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8c10f9f0 0x7fef8c168d80 secure :-1 s=THROTTLE_DONE pgs=2636 cs=0 l=1 rx=0x7fef84010410 tx=0x7fef840107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.165+0000 7fef8a7fc700 1 -- 172.21.15.80:0/2682590688 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fef84000e70 con 0x7fef8c10f9f0 2019-11-28T11:54:34.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.332+0000 7fef9381b700 1 -- 172.21.15.80:0/2682590688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fef8c105ef0 con 0x7fef8c10f9f0 2019-11-28T11:54:34.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.333+0000 7fef925b9700 1 --2- 172.21.15.80:0/2682590688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8c10f9f0 0x7fef8c168d80 secure :-1 s=THROTTLE_DONE pgs=2636 cs=0 l=1 rx=0x7fef84010410 tx=0x7fef840107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.333+0000 7fef8a7fc700 1 -- 172.21.15.80:0/2682590688 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v203) v1 ==== 92+0+10 (secure 0 0 0) 0x7fef840041c0 con 0x7fef8c10f9f0 2019-11-28T11:54:34.390 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:54:34.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.335+0000 7fef9381b700 1 -- 172.21.15.80:0/2682590688 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef70018730 msgr2=0x7fef7001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.335+0000 7fef9381b700 1 --2- 172.21.15.80:0/2682590688 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef70018730 0x7fef7001abe0 crc :-1 s=READY pgs=1082 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.335+0000 7fef9381b700 1 -- 172.21.15.80:0/2682590688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8c10f9f0 msgr2=0x7fef8c168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.335+0000 7fef9381b700 1 --2- 172.21.15.80:0/2682590688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8c10f9f0 0x7fef8c168d80 secure :-1 s=READY pgs=2636 cs=0 l=1 rx=0x7fef84010410 tx=0x7fef840107b0).stop 2019-11-28T11:54:34.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.335+0000 7fef9381b700 1 -- 172.21.15.80:0/2682590688 shutdown_connections 2019-11-28T11:54:34.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.335+0000 7fef9381b700 1 --2- 172.21.15.80:0/2682590688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8c10f9f0 0x7fef8c168d80 unknown :-1 s=CLOSED pgs=2636 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.335+0000 7fef9381b700 1 --2- 172.21.15.80:0/2682590688 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fef70018730 0x7fef7001abe0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.335+0000 7fef9381b700 1 -- 172.21.15.80:0/2682590688 shutdown_connections 2019-11-28T11:54:34.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.335+0000 7fef9381b700 1 -- 172.21.15.80:0/2682590688 wait complete. 2019-11-28T11:54:34.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.335+0000 7fef9381b700 1 -- 172.21.15.80:0/2682590688 >> 172.21.15.80:0/2682590688 conn(0x7fef8c15e2d0 msgr2=0x7fef8c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:34.402 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:54:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.468+0000 7f99473ee700 1 Processor -- start 2019-11-28T11:54:34.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.468+0000 7f99473ee700 1 -- start start 2019-11-28T11:54:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.469+0000 7f99473ee700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f994015ed10 0x7f994015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.469+0000 7f99473ee700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f994006db60 con 0x7f99400734b0 2019-11-28T11:54:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.469+0000 7f99473ee700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f994006e060 con 0x7f9940073020 2019-11-28T11:54:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.469+0000 7f99473ee700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994006f3d0 con 0x7f994015ed10 2019-11-28T11:54:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.469+0000 7f994618c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f99400734b0 0x7f99400726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44902/0 (socket says 172.21.15.80:44902) 2019-11-28T11:54:34.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.469+0000 7f994618c700 1 -- 172.21.15.80:0/2608793643 learned_addr learned my addr 172.21.15.80:0/2608793643 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.469+0000 7f994598b700 1 --2- 172.21.15.80:0/2608793643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f994015ed10 0x7f994015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f9944989700 1 -- 172.21.15.80:0/2608793643 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116649639 0 0) 0x7f9938001150 con 0x7f99400734b0 2019-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f9944989700 1 -- 172.21.15.80:0/2608793643 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f992c002e80 con 0x7f99400734b0 2019-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f9944989700 1 -- 172.21.15.80:0/2608793643 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268041703 0 0) 0x7f99280013b0 con 0x7f9940073020 2019-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f9944989700 1 -- 172.21.15.80:0/2608793643 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f992c004170 con 0x7f9940073020 2019-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f994598b700 1 -- 172.21.15.80:0/2608793643 >> v1:172.21.15.174:6789/0 conn(0x7f9940073020 legacy=0x7f9940071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f994598b700 1 -- 172.21.15.80:0/2608793643 >> v1:172.21.15.80:6789/0 conn(0x7f99400734b0 legacy=0x7f99400726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f994598b700 1 -- 172.21.15.80:0/2608793643 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9940070760 con 0x7f994015ed10 2019-11-28T11:54:34.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f994598b700 1 --2- 172.21.15.80:0/2608793643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f994015ed10 0x7f994015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f993000af50 tx=0x7f993000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f994598b700 1 --2- 172.21.15.80:0/2608793643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f994015ed10 0x7f994015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f993000af50 tx=0x7f993000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f994598b700 1 --2- 172.21.15.80:0/2608793643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f994015ed10 0x7f994015f100 secure :-1 s=READY pgs=378 cs=0 l=1 rx=0x7f993000af50 tx=0x7f993000b760).ready entity=mon.2 client_cookie=281982c6254bcbaa server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:34.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f994598b700 1 --2- 172.21.15.80:0/2608793643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f994015ed10 0x7f994015f100 secure :-1 s=THROTTLE_DONE pgs=378 cs=0 l=1 rx=0x7f993000af50 tx=0x7f993000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f9944989700 1 -- 172.21.15.80:0/2608793643 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9930000960 con 0x7f994015ed10 2019-11-28T11:54:34.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f994598b700 1 --2- 172.21.15.80:0/2608793643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f994015ed10 0x7f994015f100 secure :-1 s=THROTTLE_DONE pgs=378 cs=0 l=1 rx=0x7f993000af50 tx=0x7f993000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f994598b700 1 --2- 172.21.15.80:0/2608793643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f994015ed10 0x7f994015f100 secure :-1 s=THROTTLE_DONE pgs=378 cs=0 l=1 rx=0x7f993000af50 tx=0x7f993000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f9944989700 1 -- 172.21.15.80:0/2608793643 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9930009860 con 0x7f994015ed10 2019-11-28T11:54:34.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f9944989700 1 -- 172.21.15.80:0/2608793643 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9930009f30 con 0x7f994015ed10 2019-11-28T11:54:34.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f99473ee700 1 -- 172.21.15.80:0/2608793643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f994015ed10 msgr2=0x7f994015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.470+0000 7f99473ee700 1 --2- 172.21.15.80:0/2608793643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f994015ed10 0x7f994015f100 secure :-1 s=READY pgs=378 cs=0 l=1 rx=0x7f993000af50 tx=0x7f993000b760).stop 2019-11-28T11:54:34.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.471+0000 7f99473ee700 1 -- 172.21.15.80:0/2608793643 shutdown_connections 2019-11-28T11:54:34.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.471+0000 7f99473ee700 1 --2- 172.21.15.80:0/2608793643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f994015ed10 0x7f994015f100 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.471+0000 7f99473ee700 1 -- 172.21.15.80:0/2608793643 shutdown_connections 2019-11-28T11:54:34.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.471+0000 7f99473ee700 1 -- 172.21.15.80:0/2608793643 wait complete. 2019-11-28T11:54:34.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.471+0000 7f99473ee700 1 -- 172.21.15.80:0/2608793643 >> 172.21.15.80:0/2608793643 conn(0x7f9940061d20 msgr2=0x7f99400641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:34.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.473+0000 7f99473ee700 1 Processor -- start 2019-11-28T11:54:34.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.473+0000 7f99473ee700 1 -- start start 2019-11-28T11:54:34.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.474+0000 7f99473ee700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9940165480 0x7f994014b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:34.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.474+0000 7f99473ee700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f994014b660 0x7f9940077400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:34.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.474+0000 7f99473ee700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9940165da0 con 0x7f9940077940 2019-11-28T11:54:34.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.474+0000 7f99473ee700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9940148d30 con 0x7f994014b660 2019-11-28T11:54:34.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.474+0000 7f99473ee700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9940079980 con 0x7f9940165480 2019-11-28T11:54:34.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.474+0000 7f994618c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9940077940 0x7f994007ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44910/0 (socket says 172.21.15.80:44910) 2019-11-28T11:54:34.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.474+0000 7f994618c700 1 -- 172.21.15.80:0/1247462478 learned_addr learned my addr 172.21.15.80:0/1247462478 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:34.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.474+0000 7f994598b700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9940165480 0x7f994014b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:34.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.474+0000 7f994518a700 1 --2- 172.21.15.80:0/1247462478 >> v2:172.21.15.174:3300/0 conn(0x7f994014b660 0x7f9940077400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:34.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f993e7fc700 1 -- 172.21.15.80:0/1247462478 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043900615 0 0) 0x7f9938001150 con 0x7f9940077940 2019-11-28T11:54:34.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f993e7fc700 1 -- 172.21.15.80:0/1247462478 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9924002e80 con 0x7f9940077940 2019-11-28T11:54:34.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f994598b700 1 -- 172.21.15.80:0/1247462478 >> v2:172.21.15.174:3300/0 conn(0x7f994014b660 msgr2=0x7f9940077400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f994598b700 1 --2- 172.21.15.80:0/1247462478 >> v2:172.21.15.174:3300/0 conn(0x7f994014b660 0x7f9940077400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f994598b700 1 -- 172.21.15.80:0/1247462478 >> v1:172.21.15.80:6789/0 conn(0x7f9940077940 legacy=0x7f994007ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f994598b700 1 -- 172.21.15.80:0/1247462478 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994007a2e0 con 0x7f9940165480 2019-11-28T11:54:34.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f994598b700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9940165480 0x7f994014b120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f99300103d0 tx=0x7f9930010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f994598b700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9940165480 0x7f994014b120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f99300103d0 tx=0x7f9930010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f994598b700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9940165480 0x7f994014b120 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7f99300103d0 tx=0x7f9930010200).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:34.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f994598b700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9940165480 0x7f994014b120 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f99300103d0 tx=0x7f9930010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f993e7fc700 1 -- 172.21.15.80:0/1247462478 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9930000940 con 0x7f9940165480 2019-11-28T11:54:34.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f994598b700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9940165480 0x7f994014b120 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f99300103d0 tx=0x7f9930010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f993e7fc700 1 -- 172.21.15.80:0/1247462478 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9930009980 con 0x7f9940165480 2019-11-28T11:54:34.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f994598b700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9940165480 0x7f994014b120 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f99300103d0 tx=0x7f9930010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f99473ee700 1 -- 172.21.15.80:0/1247462478 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994007a660 con 0x7f9940165480 2019-11-28T11:54:34.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f993e7fc700 1 -- 172.21.15.80:0/1247462478 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9930000940 con 0x7f9940165480 2019-11-28T11:54:34.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.475+0000 7f99473ee700 1 -- 172.21.15.80:0/1247462478 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994007a2e0 con 0x7f9940165480 2019-11-28T11:54:34.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.476+0000 7f994598b700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9940165480 0x7f994014b120 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f99300103d0 tx=0x7f9930010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.476+0000 7f994598b700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9940165480 0x7f994014b120 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f99300103d0 tx=0x7f9930010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.476+0000 7f993e7fc700 1 -- 172.21.15.80:0/1247462478 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9930009580 con 0x7f9940165480 2019-11-28T11:54:34.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.476+0000 7f993e7fc700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9924018770 0x7f992401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:34.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.476+0000 7f993e7fc700 1 -- 172.21.15.80:0/1247462478 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9930031c90 con 0x7f9940165480 2019-11-28T11:54:34.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.476+0000 7f994518a700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9924018770 0x7f992401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:34.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.476+0000 7f994518a700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9924018770 0x7f992401abe0 crc :-1 s=READY pgs=1083 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:34.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.483+0000 7f99473ee700 1 -- 172.21.15.80:0/1247462478 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994007a660 con 0x7f9940165480 2019-11-28T11:54:34.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.487+0000 7f994598b700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9940165480 0x7f994014b120 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f99300103d0 tx=0x7f9930010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.487+0000 7f993e7fc700 1 -- 172.21.15.80:0/1247462478 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9930000940 con 0x7f9940165480 2019-11-28T11:54:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.652+0000 7f99473ee700 1 -- 172.21.15.80:0/1247462478 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f994007a2e0 con 0x7f9940165480 2019-11-28T11:54:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.653+0000 7f994598b700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9940165480 0x7f994014b120 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f99300103d0 tx=0x7f9930010200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.653+0000 7f993e7fc700 1 -- 172.21.15.80:0/1247462478 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v203) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9930009580 con 0x7f9940165480 2019-11-28T11:54:34.711 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:54:34.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.655+0000 7f99473ee700 1 -- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9924018770 msgr2=0x7f992401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.655+0000 7f99473ee700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9924018770 0x7f992401abe0 crc :-1 s=READY pgs=1083 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.655+0000 7f99473ee700 1 -- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9940165480 msgr2=0x7f994014b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.655+0000 7f99473ee700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9940165480 0x7f994014b120 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7f99300103d0 tx=0x7f9930010200).stop 2019-11-28T11:54:34.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.655+0000 7f99473ee700 1 -- 172.21.15.80:0/1247462478 shutdown_connections 2019-11-28T11:54:34.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.655+0000 7f99473ee700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9924018770 0x7f992401abe0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.655+0000 7f99473ee700 1 --2- 172.21.15.80:0/1247462478 >> v2:172.21.15.174:3300/0 conn(0x7f994014b660 0x7f9940077400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.655+0000 7f99473ee700 1 --2- 172.21.15.80:0/1247462478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9940165480 0x7f994014b120 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.656+0000 7f99473ee700 1 -- 172.21.15.80:0/1247462478 shutdown_connections 2019-11-28T11:54:34.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.656+0000 7f99473ee700 1 -- 172.21.15.80:0/1247462478 wait complete. 2019-11-28T11:54:34.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.656+0000 7f99473ee700 1 -- 172.21.15.80:0/1247462478 >> 172.21.15.80:0/1247462478 conn(0x7f9940166440 msgr2=0x7f99401494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:34.722 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:54:34.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.789+0000 7ff16f38f700 1 Processor -- start 2019-11-28T11:54:34.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.789+0000 7ff16f38f700 1 -- start start 2019-11-28T11:54:34.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.790+0000 7ff16f38f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1681639f0 0x7ff168165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:34.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.790+0000 7ff16f38f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16806db60 con 0x7ff16815ed10 2019-11-28T11:54:34.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.790+0000 7ff16f38f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16806e060 con 0x7ff16815f100 2019-11-28T11:54:34.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.790+0000 7ff16f38f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16806fe00 con 0x7ff1681639f0 2019-11-28T11:54:34.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.790+0000 7ff16e12d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1681639f0 0x7ff168165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:34.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.790+0000 7ff16e12d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff1681639f0 0x7ff168165df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45600/0 (socket says 172.21.15.80:45600) 2019-11-28T11:54:34.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.790+0000 7ff16d92c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff16815ed10 0x7ff168073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44914/0 (socket says 172.21.15.80:44914) 2019-11-28T11:54:34.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.790+0000 7ff16e12d700 1 -- 172.21.15.80:0/685999806 learned_addr learned my addr 172.21.15.80:0/685999806 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:34.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.790+0000 7ff16e12d700 1 -- 172.21.15.80:0/685999806 >> v1:172.21.15.174:6789/0 conn(0x7ff16815f100 legacy=0x7ff16806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:34.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.790+0000 7ff16e12d700 1 -- 172.21.15.80:0/685999806 >> v1:172.21.15.80:6789/0 conn(0x7ff16815ed10 legacy=0x7ff168073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.790+0000 7ff16c92a700 1 -- 172.21.15.80:0/685999806 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144741575 0 0) 0x7ff158001100 con 0x7ff16815ed10 2019-11-28T11:54:34.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.790+0000 7ff16e12d700 1 -- 172.21.15.80:0/685999806 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff168070760 con 0x7ff1681639f0 2019-11-28T11:54:34.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.791+0000 7ff16e12d700 1 --2- 172.21.15.80:0/685999806 >> v2:172.21.15.80:3300/0 conn(0x7ff1681639f0 0x7ff168165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff16000f730 tx=0x7ff16000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.791+0000 7ff16e12d700 1 --2- 172.21.15.80:0/685999806 >> v2:172.21.15.80:3300/0 conn(0x7ff1681639f0 0x7ff168165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff16000f730 tx=0x7ff16000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.791+0000 7ff16e12d700 1 --2- 172.21.15.80:0/685999806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1681639f0 0x7ff168165df0 secure :-1 s=READY pgs=2640 cs=0 l=1 rx=0x7ff16000f730 tx=0x7ff16000fad0).ready entity=mon.0 client_cookie=6bbafbd9d2ef11c4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:34.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.791+0000 7ff16e12d700 1 --2- 172.21.15.80:0/685999806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1681639f0 0x7ff168165df0 secure :-1 s=THROTTLE_DONE pgs=2640 cs=0 l=1 rx=0x7ff16000f730 tx=0x7ff16000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.791+0000 7ff16c92a700 1 -- 172.21.15.80:0/685999806 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1600010e0 con 0x7ff1681639f0 2019-11-28T11:54:34.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.791+0000 7ff16e12d700 1 --2- 172.21.15.80:0/685999806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1681639f0 0x7ff168165df0 secure :-1 s=THROTTLE_DONE pgs=2640 cs=0 l=1 rx=0x7ff16000f730 tx=0x7ff16000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.791+0000 7ff16e12d700 1 --2- 172.21.15.80:0/685999806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1681639f0 0x7ff168165df0 secure :-1 s=THROTTLE_DONE pgs=2640 cs=0 l=1 rx=0x7ff16000f730 tx=0x7ff16000fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.791+0000 7ff16c92a700 1 -- 172.21.15.80:0/685999806 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff160000a70 con 0x7ff1681639f0 2019-11-28T11:54:34.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.791+0000 7ff16c92a700 1 -- 172.21.15.80:0/685999806 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1600016c0 con 0x7ff1681639f0 2019-11-28T11:54:34.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.791+0000 7ff16f38f700 1 -- 172.21.15.80:0/685999806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1681639f0 msgr2=0x7ff168165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.791+0000 7ff16f38f700 1 --2- 172.21.15.80:0/685999806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1681639f0 0x7ff168165df0 secure :-1 s=READY pgs=2640 cs=0 l=1 rx=0x7ff16000f730 tx=0x7ff16000fad0).stop 2019-11-28T11:54:34.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.791+0000 7ff16f38f700 1 -- 172.21.15.80:0/685999806 shutdown_connections 2019-11-28T11:54:34.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.791+0000 7ff16f38f700 1 --2- 172.21.15.80:0/685999806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff1681639f0 0x7ff168165df0 unknown :-1 s=CLOSED pgs=2640 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.792+0000 7ff16f38f700 1 -- 172.21.15.80:0/685999806 shutdown_connections 2019-11-28T11:54:34.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.792+0000 7ff16f38f700 1 -- 172.21.15.80:0/685999806 wait complete. 2019-11-28T11:54:34.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.792+0000 7ff16f38f700 1 -- 172.21.15.80:0/685999806 >> 172.21.15.80:0/685999806 conn(0x7ff168061d20 msgr2=0x7ff1680641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:34.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.794+0000 7ff16f38f700 1 Processor -- start 2019-11-28T11:54:34.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.794+0000 7ff16f38f700 1 -- start start 2019-11-28T11:54:34.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16f38f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff16810e970 0x7ff1681087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:34.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16f38f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff168107e30 0x7ff168167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:34.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16f38f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16810c250 con 0x7ff168108cf0 2019-11-28T11:54:34.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16f38f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16810e430 con 0x7ff16810e970 2019-11-28T11:54:34.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16f38f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff168105860 con 0x7ff168107e30 2019-11-28T11:54:34.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16d92c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff16810e970 0x7ff1681087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:34.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16d92c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff16810e970 0x7ff1681087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45604/0 (socket says 172.21.15.80:45604) 2019-11-28T11:54:34.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16d12b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff168108cf0 0x7ff168107630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44922/0 (socket says 172.21.15.80:44922) 2019-11-28T11:54:34.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16d92c700 1 -- 172.21.15.80:0/223940578 learned_addr learned my addr 172.21.15.80:0/223940578 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:34.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16e12d700 1 --2- 172.21.15.80:0/223940578 >> v2:172.21.15.174:3300/0 conn(0x7ff168107e30 0x7ff168167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:34.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16d92c700 1 -- 172.21.15.80:0/223940578 >> v2:172.21.15.174:3300/0 conn(0x7ff168107e30 msgr2=0x7ff168167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16d92c700 1 --2- 172.21.15.80:0/223940578 >> v2:172.21.15.174:3300/0 conn(0x7ff168107e30 0x7ff168167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:34.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16d92c700 1 -- 172.21.15.80:0/223940578 >> v1:172.21.15.80:6789/0 conn(0x7ff168108cf0 legacy=0x7ff168107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:34.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16d92c700 1 -- 172.21.15.80:0/223940578 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff168105ef0 con 0x7ff16810e970 2019-11-28T11:54:34.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff1667fc700 1 -- 172.21.15.80:0/223940578 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127754996 0 0) 0x7ff150001440 con 0x7ff168108cf0 2019-11-28T11:54:34.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16e12d700 1 --2- 172.21.15.80:0/223940578 >> v2:172.21.15.174:3300/0 conn(0x7ff168107e30 0x7ff168167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:34.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16d92c700 1 --2- 172.21.15.80:0/223940578 >> v2:172.21.15.80:3300/0 conn(0x7ff16810e970 0x7ff1681087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff158010430 tx=0x7ff1580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16d92c700 1 --2- 172.21.15.80:0/223940578 >> v2:172.21.15.80:3300/0 conn(0x7ff16810e970 0x7ff1681087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff158010430 tx=0x7ff1580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16d92c700 1 --2- 172.21.15.80:0/223940578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff16810e970 0x7ff1681087b0 secure :-1 s=READY pgs=2642 cs=0 l=1 rx=0x7ff158010430 tx=0x7ff1580107d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:34.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.795+0000 7ff16d92c700 1 --2- 172.21.15.80:0/223940578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff16810e970 0x7ff1681087b0 secure :-1 s=THROTTLE_DONE pgs=2642 cs=0 l=1 rx=0x7ff158010430 tx=0x7ff1580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.796+0000 7ff1667fc700 1 -- 172.21.15.80:0/223940578 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff158000c90 con 0x7ff16810e970 2019-11-28T11:54:34.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.796+0000 7ff16d92c700 1 --2- 172.21.15.80:0/223940578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff16810e970 0x7ff1681087b0 secure :-1 s=THROTTLE_DONE pgs=2642 cs=0 l=1 rx=0x7ff158010430 tx=0x7ff1580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.796+0000 7ff16d92c700 1 --2- 172.21.15.80:0/223940578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff16810e970 0x7ff1681087b0 secure :-1 s=THROTTLE_DONE pgs=2642 cs=0 l=1 rx=0x7ff158010430 tx=0x7ff1580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.796+0000 7ff1667fc700 1 -- 172.21.15.80:0/223940578 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff158004240 con 0x7ff16810e970 2019-11-28T11:54:34.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.796+0000 7ff1667fc700 1 -- 172.21.15.80:0/223940578 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff158004430 con 0x7ff16810e970 2019-11-28T11:54:34.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.796+0000 7ff16f38f700 1 -- 172.21.15.80:0/223940578 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff168106270 con 0x7ff16810e970 2019-11-28T11:54:34.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.796+0000 7ff16f38f700 1 -- 172.21.15.80:0/223940578 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff168105ef0 con 0x7ff16810e970 2019-11-28T11:54:34.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.796+0000 7ff16d92c700 1 --2- 172.21.15.80:0/223940578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff16810e970 0x7ff1681087b0 secure :-1 s=THROTTLE_DONE pgs=2642 cs=0 l=1 rx=0x7ff158010430 tx=0x7ff1580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.796+0000 7ff1667fc700 1 -- 172.21.15.80:0/223940578 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff158004430 con 0x7ff16810e970 2019-11-28T11:54:34.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.796+0000 7ff16d92c700 1 --2- 172.21.15.80:0/223940578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff16810e970 0x7ff1681087b0 secure :-1 s=THROTTLE_DONE pgs=2642 cs=0 l=1 rx=0x7ff158010430 tx=0x7ff1580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.796+0000 7ff1667fc700 1 --2- 172.21.15.80:0/223940578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff14c018730 0x7ff14c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:34.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.796+0000 7ff1667fc700 1 -- 172.21.15.80:0/223940578 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff158031ae0 con 0x7ff16810e970 2019-11-28T11:54:34.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.797+0000 7ff16d12b700 1 --2- 172.21.15.80:0/223940578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff14c018730 0x7ff14c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:34.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.797+0000 7ff16d12b700 1 --2- 172.21.15.80:0/223940578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff14c018730 0x7ff14c01abc0 crc :-1 s=READY pgs=1084 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:34.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.804+0000 7ff16f38f700 1 -- 172.21.15.80:0/223940578 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff168106270 con 0x7ff16810e970 2019-11-28T11:54:34.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.808+0000 7ff16d92c700 1 --2- 172.21.15.80:0/223940578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff16810e970 0x7ff1681087b0 secure :-1 s=THROTTLE_DONE pgs=2642 cs=0 l=1 rx=0x7ff158010430 tx=0x7ff1580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:34.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.808+0000 7ff1667fc700 1 -- 172.21.15.80:0/223940578 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff1580012e0 con 0x7ff16810e970 2019-11-28T11:54:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.975+0000 7ff16f38f700 1 -- 172.21.15.80:0/223940578 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7ff168105ef0 con 0x7ff16810e970 2019-11-28T11:54:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.975+0000 7ff16d92c700 1 --2- 172.21.15.80:0/223940578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff16810e970 0x7ff1681087b0 secure :-1 s=THROTTLE_DONE pgs=2642 cs=0 l=1 rx=0x7ff158010430 tx=0x7ff1580107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.975+0000 7ff1667fc700 1 -- 172.21.15.80:0/223940578 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v203) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff158004430 con 0x7ff16810e970 2019-11-28T11:54:35.033 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:54:35.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.978+0000 7ff16f38f700 1 -- 172.21.15.80:0/223940578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff14c018730 msgr2=0x7ff14c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:35.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.978+0000 7ff16f38f700 1 --2- 172.21.15.80:0/223940578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff14c018730 0x7ff14c01abc0 crc :-1 s=READY pgs=1084 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:35.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.978+0000 7ff16f38f700 1 -- 172.21.15.80:0/223940578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff16810e970 msgr2=0x7ff1681087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:35.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.978+0000 7ff16f38f700 1 --2- 172.21.15.80:0/223940578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff16810e970 0x7ff1681087b0 secure :-1 s=READY pgs=2642 cs=0 l=1 rx=0x7ff158010430 tx=0x7ff1580107d0).stop 2019-11-28T11:54:35.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.978+0000 7ff16f38f700 1 -- 172.21.15.80:0/223940578 shutdown_connections 2019-11-28T11:54:35.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.978+0000 7ff16f38f700 1 --2- 172.21.15.80:0/223940578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff14c018730 0x7ff14c01abc0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:35.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.978+0000 7ff16f38f700 1 --2- 172.21.15.80:0/223940578 >> v2:172.21.15.174:3300/0 conn(0x7ff168107e30 0x7ff168167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:35.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.978+0000 7ff16f38f700 1 --2- 172.21.15.80:0/223940578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff16810e970 0x7ff1681087b0 unknown :-1 s=CLOSED pgs=2642 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:35.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.978+0000 7ff16f38f700 1 -- 172.21.15.80:0/223940578 shutdown_connections 2019-11-28T11:54:35.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.978+0000 7ff16f38f700 1 -- 172.21.15.80:0/223940578 wait complete. 2019-11-28T11:54:35.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:34.978+0000 7ff16f38f700 1 -- 172.21.15.80:0/223940578 >> 172.21.15.80:0/223940578 conn(0x7ff16815e2d0 msgr2=0x7ff168147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:35.045 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:54:35.045 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:35.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.107+0000 7f8bd754b700 1 Processor -- start 2019-11-28T11:54:35.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.107+0000 7f8bd754b700 1 -- start start 2019-11-28T11:54:35.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.108+0000 7f8bd754b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8bd006c0a0 0x7f8bd0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:35.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.108+0000 7f8bd754b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd00734e0 0x7f8bd0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:35.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.108+0000 7f8bd754b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd006db00 con 0x7f8bd0072360 2019-11-28T11:54:35.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.108+0000 7f8bd754b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd006fd60 con 0x7f8bd006c0a0 2019-11-28T11:54:35.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.108+0000 7f8bd754b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0070030 con 0x7f8bd00734e0 2019-11-28T11:54:35.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.108+0000 7f8bd62e9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8bd0072360 0x7f8bd006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44930/0 (socket says 172.21.15.80:44930) 2019-11-28T11:54:35.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.108+0000 7f8bd62e9700 1 -- 172.21.15.80:0/2291484613 learned_addr learned my addr 172.21.15.80:0/2291484613 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.108+0000 7f8bd5ae8700 1 --2- 172.21.15.80:0/2291484613 >> v2:172.21.15.174:3300/0 conn(0x7f8bd006c0a0 0x7f8bd0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.108+0000 7f8bd52e7700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd00734e0 0x7f8bd0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.108+0000 7f8bd4ae6700 1 -- 172.21.15.80:0/2291484613 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687950580 0 0) 0x7f8bc80014d0 con 0x7f8bd0072360 2019-11-28T11:54:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.108+0000 7f8bd4ae6700 1 -- 172.21.15.80:0/2291484613 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bbc002e80 con 0x7f8bd0072360 2019-11-28T11:54:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd4ae6700 1 -- 172.21.15.80:0/2291484613 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2054348844 0 0) 0x7f8bc80014b0 con 0x7f8bd0072360 2019-11-28T11:54:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd4ae6700 1 -- 172.21.15.80:0/2291484613 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd00734e0 msgr2=0x7f8bd0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:35.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd4ae6700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd00734e0 0x7f8bd0071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:35.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd4ae6700 1 -- 172.21.15.80:0/2291484613 >> v2:172.21.15.174:3300/0 conn(0x7f8bd006c0a0 msgr2=0x7f8bd0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:35.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd4ae6700 1 --2- 172.21.15.80:0/2291484613 >> v2:172.21.15.174:3300/0 conn(0x7f8bd006c0a0 0x7f8bd0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:35.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd4ae6700 1 -- 172.21.15.80:0/2291484613 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd00706c0 con 0x7f8bd0072360 2019-11-28T11:54:35.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd4ae6700 1 -- 172.21.15.80:0/2291484613 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f8bc80019e0 con 0x7f8bd0072360 2019-11-28T11:54:35.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd4ae6700 1 -- 172.21.15.80:0/2291484613 >> v1:172.21.15.80:6789/0 conn(0x7f8bd0072360 legacy=0x7f8bd006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd4ae6700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bbc0479e0 0x7f8bbc049e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd4ae6700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bbc04a5d0 0x7f8bbc04ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd4ae6700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc04d270 0x7f8bbc04f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd4ae6700 1 -- 172.21.15.80:0/2291484613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc04ff50 con 0x7f8bbc04d270 2019-11-28T11:54:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd4ae6700 1 -- 172.21.15.80:0/2291484613 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc050140 con 0x7f8bbc0479e0 2019-11-28T11:54:35.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd4ae6700 1 -- 172.21.15.80:0/2291484613 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc050370 con 0x7f8bbc04a5d0 2019-11-28T11:54:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd62e9700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc04d270 0x7f8bbc04f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd5ae8700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bbc0479e0 0x7f8bbc049e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:35.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd52e7700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bbc04a5d0 0x7f8bbc04ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd62e9700 1 -- 172.21.15.80:0/2291484613 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bbc04a5d0 msgr2=0x7f8bbc04ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd62e9700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bbc04a5d0 0x7f8bbc04ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd62e9700 1 -- 172.21.15.80:0/2291484613 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bbc0479e0 msgr2=0x7f8bbc049e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:35.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd62e9700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bbc0479e0 0x7f8bbc049e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:35.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd62e9700 1 -- 172.21.15.80:0/2291484613 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc050620 con 0x7f8bbc04d270 2019-11-28T11:54:35.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd62e9700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc04d270 0x7f8bbc04f740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8bc800fc10 tx=0x7f8bc800fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:35.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd62e9700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc04d270 0x7f8bbc04f740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8bc800fc10 tx=0x7f8bc800fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:35.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd62e9700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc04d270 0x7f8bbc04f740 secure :-1 s=READY pgs=2644 cs=0 l=1 rx=0x7f8bc800fc10 tx=0x7f8bc800fb10).ready entity=mon.0 client_cookie=3bdb1feceeae4234 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:35.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd62e9700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc04d270 0x7f8bbc04f740 secure :-1 s=THROTTLE_DONE pgs=2644 cs=0 l=1 rx=0x7f8bc800fc10 tx=0x7f8bc800fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:35.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd4ae6700 1 -- 172.21.15.80:0/2291484613 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bc80014b0 con 0x7f8bbc04d270 2019-11-28T11:54:35.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd62e9700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc04d270 0x7f8bbc04f740 secure :-1 s=THROTTLE_DONE pgs=2644 cs=0 l=1 rx=0x7f8bc800fc10 tx=0x7f8bc800fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:35.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.109+0000 7f8bd62e9700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc04d270 0x7f8bbc04f740 secure :-1 s=THROTTLE_DONE pgs=2644 cs=0 l=1 rx=0x7f8bc800fc10 tx=0x7f8bc800fb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:35.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.110+0000 7f8bd4ae6700 1 -- 172.21.15.80:0/2291484613 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc80045c0 con 0x7f8bbc04d270 2019-11-28T11:54:35.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.110+0000 7f8bd4ae6700 1 -- 172.21.15.80:0/2291484613 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bc8004cd0 con 0x7f8bbc04d270 2019-11-28T11:54:35.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.110+0000 7f8bd754b700 1 -- 172.21.15.80:0/2291484613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc04d270 msgr2=0x7f8bbc04f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:35.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.110+0000 7f8bd754b700 1 --2- 172.21.15.80:0/2291484613 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8bbc04d270 0x7f8bbc04f740 secure :-1 s=READY pgs=2644 cs=0 l=1 rx=0x7f8bc800fc10 tx=0x7f8bc800fb10).stop 2019-11-28T11:54:35.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.110+0000 7f8bd62e9700 1 -- 172.21.15.80:0/2291484613 reap_dead start 2019-11-28T11:54:35.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.110+0000 7f8bd754b700 1 -- 172.21.15.80:0/2291484613 shutdown_connections 2019-11-28T11:54:35.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.110+0000 7f8bd754b700 1 -- 172.21.15.80:0/2291484613 shutdown_connections 2019-11-28T11:54:35.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.110+0000 7f8bd754b700 1 -- 172.21.15.80:0/2291484613 wait complete. 2019-11-28T11:54:35.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.110+0000 7f8bd754b700 1 -- 172.21.15.80:0/2291484613 >> 172.21.15.80:0/2291484613 conn(0x7f8bd0061cf0 msgr2=0x7f8bd0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:35.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.113+0000 7f8bd754b700 1 Processor -- start 2019-11-28T11:54:35.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.113+0000 7f8bd754b700 1 -- start start 2019-11-28T11:54:35.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd754b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8bd01061f0 0x7f8bd010f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:35.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd754b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd013a350 0x7f8bd013a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:35.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd754b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd0107940 con 0x7f8bd013ad20 2019-11-28T11:54:35.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd754b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd010c300 con 0x7f8bd01061f0 2019-11-28T11:54:35.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd754b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd010c5d0 con 0x7f8bd013a350 2019-11-28T11:54:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd52e7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd013a350 0x7f8bd013a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd5ae8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8bd01061f0 0x7f8bd010f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd52e7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd013a350 0x7f8bd013a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:47886/0 (socket says 172.21.15.80:47886) 2019-11-28T11:54:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd52e7700 1 -- 172.21.15.80:0/4293179481 learned_addr learned my addr 172.21.15.80:0/4293179481 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:35.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd52e7700 1 -- 172.21.15.80:0/4293179481 >> v2:172.21.15.174:3300/0 conn(0x7f8bd01061f0 msgr2=0x7f8bd010f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:35.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd52e7700 1 --2- 172.21.15.80:0/4293179481 >> v2:172.21.15.174:3300/0 conn(0x7f8bd01061f0 0x7f8bd010f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:35.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd52e7700 1 -- 172.21.15.80:0/4293179481 >> v1:172.21.15.174:6789/0 conn(0x7f8bd013ad20 legacy=0x7f8bd010e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:35.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd52e7700 1 -- 172.21.15.80:0/4293179481 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd010cc60 con 0x7f8bd013a350 2019-11-28T11:54:35.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd5ae8700 1 --2- 172.21.15.80:0/4293179481 >> v2:172.21.15.174:3300/0 conn(0x7f8bd01061f0 0x7f8bd010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:35.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd52e7700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd013a350 0x7f8bd013a7e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8bc0010460 tx=0x7f8bc0010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:35.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd52e7700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd013a350 0x7f8bd013a7e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8bc0010460 tx=0x7f8bc0010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:35.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.114+0000 7f8bd52e7700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd013a350 0x7f8bd013a7e0 secure :-1 s=READY pgs=380 cs=0 l=1 rx=0x7f8bc0010460 tx=0x7f8bc0010800).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:35.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.115+0000 7f8bd52e7700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd013a350 0x7f8bd013a7e0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f8bc0010460 tx=0x7f8bc0010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:35.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.115+0000 7f8bd52e7700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd013a350 0x7f8bd013a7e0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f8bc0010460 tx=0x7f8bc0010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:35.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.115+0000 7f8bc67fc700 1 -- 172.21.15.80:0/4293179481 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bc0000940 con 0x7f8bd013a350 2019-11-28T11:54:35.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.115+0000 7f8bd52e7700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd013a350 0x7f8bd013a7e0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f8bc0010460 tx=0x7f8bc0010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:35.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.115+0000 7f8bc67fc700 1 -- 172.21.15.80:0/4293179481 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc00088f0 con 0x7f8bd013a350 2019-11-28T11:54:35.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.115+0000 7f8bd754b700 1 -- 172.21.15.80:0/4293179481 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd010cfe0 con 0x7f8bd013a350 2019-11-28T11:54:35.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.115+0000 7f8bc67fc700 1 -- 172.21.15.80:0/4293179481 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bc0008f80 con 0x7f8bd013a350 2019-11-28T11:54:35.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.115+0000 7f8bd754b700 1 -- 172.21.15.80:0/4293179481 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd010cc60 con 0x7f8bd013a350 2019-11-28T11:54:35.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.115+0000 7f8bd52e7700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd013a350 0x7f8bd013a7e0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f8bc0010460 tx=0x7f8bc0010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:35.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.115+0000 7f8bc67fc700 1 -- 172.21.15.80:0/4293179481 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8bc00084f0 con 0x7f8bd013a350 2019-11-28T11:54:35.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.115+0000 7f8bd52e7700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd013a350 0x7f8bd013a7e0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f8bc0010460 tx=0x7f8bc0010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:35.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.115+0000 7f8bc67fc700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bb8018730 0x7f8bb801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:35.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.116+0000 7f8bc67fc700 1 -- 172.21.15.80:0/4293179481 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8bc0031ae0 con 0x7f8bd013a350 2019-11-28T11:54:35.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.116+0000 7f8bd5ae8700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bb8018730 0x7f8bb801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:35.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.116+0000 7f8bd5ae8700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bb8018730 0x7f8bb801abc0 crc :-1 s=READY pgs=1085 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:35.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.122+0000 7f8bd754b700 1 -- 172.21.15.80:0/4293179481 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd010cfe0 con 0x7f8bd013a350 2019-11-28T11:54:35.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.126+0000 7f8bd52e7700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd013a350 0x7f8bd013a7e0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f8bc0010460 tx=0x7f8bc0010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:35.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.126+0000 7f8bc67fc700 1 -- 172.21.15.80:0/4293179481 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8bc0000940 con 0x7f8bd013a350 2019-11-28T11:54:35.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.298+0000 7f8bd754b700 1 -- 172.21.15.80:0/4293179481 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bd010cc60 con 0x7f8bd013a350 2019-11-28T11:54:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.299+0000 7f8bd52e7700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd013a350 0x7f8bd013a7e0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f8bc0010460 tx=0x7f8bc0010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.299+0000 7f8bc67fc700 1 -- 172.21.15.80:0/4293179481 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 167 v167) v1 ==== 95+0+1783 (secure 0 0 0) 0x7f8bc00084f0 con 0x7f8bd013a350 2019-11-28T11:54:35.356 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 167 2019-11-28T11:54:35.357 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:35.357 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":167,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":167,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:54:29.202039+0000","modified":"2019-11-28T11:54:32.779460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10972},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10972":{"gid":10972,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/2209008547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2209008547},{"type":"v1","addr":"172.21.15.174:6835","nonce":2209008547}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2019-11-28T11:54:35.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.301+0000 7f8bd754b700 1 -- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bb8018730 msgr2=0x7f8bb801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:35.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.301+0000 7f8bd754b700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bb8018730 0x7f8bb801abc0 crc :-1 s=READY pgs=1085 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:35.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.301+0000 7f8bd754b700 1 -- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd013a350 msgr2=0x7f8bd013a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:35.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.301+0000 7f8bd754b700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd013a350 0x7f8bd013a7e0 secure :-1 s=READY pgs=380 cs=0 l=1 rx=0x7f8bc0010460 tx=0x7f8bc0010800).stop 2019-11-28T11:54:35.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.301+0000 7f8bd754b700 1 -- 172.21.15.80:0/4293179481 shutdown_connections 2019-11-28T11:54:35.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.301+0000 7f8bd754b700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bb8018730 0x7f8bb801abc0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:35.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.301+0000 7f8bd754b700 1 --2- 172.21.15.80:0/4293179481 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8bd013a350 0x7f8bd013a7e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:35.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.301+0000 7f8bd754b700 1 --2- 172.21.15.80:0/4293179481 >> v2:172.21.15.174:3300/0 conn(0x7f8bd01061f0 0x7f8bd010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:35.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.301+0000 7f8bd754b700 1 -- 172.21.15.80:0/4293179481 shutdown_connections 2019-11-28T11:54:35.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.301+0000 7f8bd754b700 1 -- 172.21.15.80:0/4293179481 wait complete. 2019-11-28T11:54:35.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:35.301+0000 7f8bd754b700 1 -- 172.21.15.80:0/4293179481 >> 172.21.15.80:0/4293179481 conn(0x7f8bd0142090 msgr2=0x7f8bd010ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:35.671 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 10972}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 32, u'failed': [], u'epoch': 167, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [33], u'info': {u'gid_10972': {u'export_targets': [], u'name': u'c', u'incarnation': 166, u'state_seq': 2, u'state': u'up:active', u'gid': 10972, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2209008547, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2209008547, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2209008547'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:54:29.202039+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:54:32.779460+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:54:35.671 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:54:35.671 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:54:35.798 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:54:35.799 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:54:35.801 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:54:35.801 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 10972, 2019-11-28T11:54:35.802 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:54:35.802 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:54:35.802 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 3.9659969340000001, 2019-11-28T11:54:35.803 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 167, 2019-11-28T11:54:35.803 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 203, 2019-11-28T11:54:35.803 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 203, 2019-11-28T11:54:35.803 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 4.1011825760000002 2019-11-28T11:54:35.803 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:54:35.805 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 10972, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.9659969340000001, "mdsmap_epoch": 167, "osdmap_epoch": 203, "osdmap_epoch_barrier": 203, "uptime": 4.1011825760000002 } 2019-11-28T11:54:35.805 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:54:35.806 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:54:35.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:54:35.806 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:54:35.881 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:54:35.882 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:54:36.009 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:54:36.009 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:54:36.009 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:54:36.010 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:54:36.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:54:36.010 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:54:36.095 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:54:36.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.166+0000 7f980bc15700 1 Processor -- start 2019-11-28T11:54:36.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.166+0000 7f980bc15700 1 -- start start 2019-11-28T11:54:36.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.167+0000 7f980bc15700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f980406c490 0x7f980406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:36.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.167+0000 7f980bc15700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980406db00 con 0x7f980406c0a0 2019-11-28T11:54:36.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.167+0000 7f980bc15700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980406e000 con 0x7f980406ce60 2019-11-28T11:54:36.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.167+0000 7f980bc15700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980406fd60 con 0x7f980406c490 2019-11-28T11:54:36.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.167+0000 7f980a1b2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f980406c0a0 0x7f9804072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44952/0 (socket says 172.21.15.80:44952) 2019-11-28T11:54:36.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.167+0000 7f980a1b2700 1 -- 172.21.15.80:0/1449586319 learned_addr learned my addr 172.21.15.80:0/1449586319 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:36.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.167+0000 7f98099b1700 1 --2- 172.21.15.80:0/1449586319 >> v2:172.21.15.174:3300/0 conn(0x7f980406c490 0x7f980406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:36.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.167+0000 7f98091b0700 1 -- 172.21.15.80:0/1449586319 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342064273 0 0) 0x7f98000014d0 con 0x7f980406c0a0 2019-11-28T11:54:36.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.167+0000 7f98091b0700 1 -- 172.21.15.80:0/1449586319 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97f0002e80 con 0x7f980406c0a0 2019-11-28T11:54:36.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98091b0700 1 -- 172.21.15.80:0/1449586319 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4197622974 0 0) 0x7f98000014b0 con 0x7f980406c0a0 2019-11-28T11:54:36.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98091b0700 1 -- 172.21.15.80:0/1449586319 >> v2:172.21.15.174:3300/0 conn(0x7f980406c490 msgr2=0x7f980406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:36.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98091b0700 1 --2- 172.21.15.80:0/1449586319 >> v2:172.21.15.174:3300/0 conn(0x7f980406c490 0x7f980406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:36.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98091b0700 1 -- 172.21.15.80:0/1449586319 >> v1:172.21.15.174:6789/0 conn(0x7f980406ce60 legacy=0x7f9804164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98091b0700 1 -- 172.21.15.80:0/1449586319 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98040706c0 con 0x7f980406c0a0 2019-11-28T11:54:36.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98091b0700 1 -- 172.21.15.80:0/1449586319 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f98000019e0 con 0x7f980406c0a0 2019-11-28T11:54:36.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98091b0700 1 -- 172.21.15.80:0/1449586319 >> v1:172.21.15.80:6789/0 conn(0x7f980406c0a0 legacy=0x7f9804072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98091b0700 1 --2- 172.21.15.80:0/1449586319 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97f0003b20 0x7f97f0005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:36.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98091b0700 1 --2- 172.21.15.80:0/1449586319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f0006730 0x7f97f0008be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:36.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98091b0700 1 --2- 172.21.15.80:0/1449586319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f97f0009440 0x7f97f000b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:36.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98091b0700 1 -- 172.21.15.80:0/1449586319 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f000c0c0 con 0x7f97f0006730 2019-11-28T11:54:36.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98091b0700 1 -- 172.21.15.80:0/1449586319 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f000c2f0 con 0x7f97f0009440 2019-11-28T11:54:36.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98091b0700 1 -- 172.21.15.80:0/1449586319 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f0050530 con 0x7f97f0003b20 2019-11-28T11:54:36.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98099b1700 1 --2- 172.21.15.80:0/1449586319 >> v2:172.21.15.174:3300/0 conn(0x7f980406c490 0x7f980406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:36.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f980a1b2700 1 --2- 172.21.15.80:0/1449586319 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97f0003b20 0x7f97f0005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:36.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f980a9b3700 1 --2- 172.21.15.80:0/1449586319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f97f0009440 0x7f97f000b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:36.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98099b1700 1 --2- 172.21.15.80:0/1449586319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f0006730 0x7f97f0008be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98099b1700 1 -- 172.21.15.80:0/1449586319 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97f0003b20 msgr2=0x7f97f0005f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98099b1700 1 --2- 172.21.15.80:0/1449586319 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97f0003b20 0x7f97f0005f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98099b1700 1 -- 172.21.15.80:0/1449586319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f97f0009440 msgr2=0x7f97f000b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98099b1700 1 --2- 172.21.15.80:0/1449586319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f97f0009440 0x7f97f000b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98099b1700 1 -- 172.21.15.80:0/1449586319 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00507a0 con 0x7f97f0006730 2019-11-28T11:54:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f980a9b3700 1 -- 172.21.15.80:0/1449586319 reap_dead start 2019-11-28T11:54:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98099b1700 1 --2- 172.21.15.80:0/1449586319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f0006730 0x7f97f0008be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f97f400b160 tx=0x7f97f4007470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98099b1700 1 --2- 172.21.15.80:0/1449586319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f0006730 0x7f97f0008be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f97f400b160 tx=0x7f97f4007470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98099b1700 1 --2- 172.21.15.80:0/1449586319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f0006730 0x7f97f0008be0 secure :-1 s=READY pgs=2647 cs=0 l=1 rx=0x7f97f400b160 tx=0x7f97f4007470).ready entity=mon.0 client_cookie=2629c1c9663c898b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98099b1700 1 --2- 172.21.15.80:0/1449586319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f0006730 0x7f97f0008be0 secure :-1 s=THROTTLE_DONE pgs=2647 cs=0 l=1 rx=0x7f97f400b160 tx=0x7f97f4007470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98091b0700 1 -- 172.21.15.80:0/1449586319 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97f400bb10 con 0x7f97f0006730 2019-11-28T11:54:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98099b1700 1 --2- 172.21.15.80:0/1449586319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f0006730 0x7f97f0008be0 secure :-1 s=THROTTLE_DONE pgs=2647 cs=0 l=1 rx=0x7f97f400b160 tx=0x7f97f4007470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98099b1700 1 --2- 172.21.15.80:0/1449586319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f0006730 0x7f97f0008be0 secure :-1 s=THROTTLE_DONE pgs=2647 cs=0 l=1 rx=0x7f97f400b160 tx=0x7f97f4007470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98091b0700 1 -- 172.21.15.80:0/1449586319 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f400a620 con 0x7f97f0006730 2019-11-28T11:54:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f98091b0700 1 -- 172.21.15.80:0/1449586319 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97f400c0f0 con 0x7f97f0006730 2019-11-28T11:54:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f980bc15700 1 -- 172.21.15.80:0/1449586319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f0006730 msgr2=0x7f97f0008be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.168+0000 7f980bc15700 1 --2- 172.21.15.80:0/1449586319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f0006730 0x7f97f0008be0 secure :-1 s=READY pgs=2647 cs=0 l=1 rx=0x7f97f400b160 tx=0x7f97f4007470).stop 2019-11-28T11:54:36.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.169+0000 7f980bc15700 1 -- 172.21.15.80:0/1449586319 shutdown_connections 2019-11-28T11:54:36.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.169+0000 7f980bc15700 1 --2- 172.21.15.80:0/1449586319 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97f0006730 0x7f97f0008be0 unknown :-1 s=CLOSED pgs=2647 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:36.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.169+0000 7f980bc15700 1 -- 172.21.15.80:0/1449586319 shutdown_connections 2019-11-28T11:54:36.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.169+0000 7f980bc15700 1 -- 172.21.15.80:0/1449586319 wait complete. 2019-11-28T11:54:36.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.169+0000 7f980bc15700 1 -- 172.21.15.80:0/1449586319 >> 172.21.15.80:0/1449586319 conn(0x7f9804061cf0 msgr2=0x7f9804064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:36.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.172+0000 7f980bc15700 1 Processor -- start 2019-11-28T11:54:36.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.172+0000 7f980bc15700 1 -- start start 2019-11-28T11:54:36.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.172+0000 7f980bc15700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9804074d00 0x7f980407aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:36.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.172+0000 7f980bc15700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f980407bba0 0x7f9804167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:36.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.172+0000 7f980bc15700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98040754d0 con 0x7f9804150f50 2019-11-28T11:54:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.172+0000 7f980bc15700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9804078980 con 0x7f980407bba0 2019-11-28T11:54:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.172+0000 7f980bc15700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9804078c50 con 0x7f9804074d00 2019-11-28T11:54:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980a9b3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f980407bba0 0x7f9804167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980a9b3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f980407bba0 0x7f9804167c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45652/0 (socket says 172.21.15.80:45652) 2019-11-28T11:54:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980a9b3700 1 -- 172.21.15.80:0/2231305753 learned_addr learned my addr 172.21.15.80:0/2231305753 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980a1b2700 1 --2- 172.21.15.80:0/2231305753 >> v2:172.21.15.174:3300/0 conn(0x7f9804074d00 0x7f980407aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980a9b3700 1 -- 172.21.15.80:0/2231305753 >> v2:172.21.15.174:3300/0 conn(0x7f9804074d00 msgr2=0x7f980407aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980a9b3700 1 --2- 172.21.15.80:0/2231305753 >> v2:172.21.15.174:3300/0 conn(0x7f9804074d00 0x7f980407aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980a9b3700 1 -- 172.21.15.80:0/2231305753 >> v1:172.21.15.174:6789/0 conn(0x7f9804150f50 legacy=0x7f980407af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980a9b3700 1 -- 172.21.15.80:0/2231305753 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98040792e0 con 0x7f980407bba0 2019-11-28T11:54:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980a1b2700 1 --2- 172.21.15.80:0/2231305753 >> v2:172.21.15.174:3300/0 conn(0x7f9804074d00 0x7f980407aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980a9b3700 1 --2- 172.21.15.80:0/2231305753 >> v2:172.21.15.80:3300/0 conn(0x7f980407bba0 0x7f9804167c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f97fc010450 tx=0x7f97fc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980a9b3700 1 --2- 172.21.15.80:0/2231305753 >> v2:172.21.15.80:3300/0 conn(0x7f980407bba0 0x7f9804167c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f97fc010450 tx=0x7f97fc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980a9b3700 1 --2- 172.21.15.80:0/2231305753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f980407bba0 0x7f9804167c20 secure :-1 s=READY pgs=2648 cs=0 l=1 rx=0x7f97fc010450 tx=0x7f97fc0107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980a9b3700 1 --2- 172.21.15.80:0/2231305753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f980407bba0 0x7f9804167c20 secure :-1 s=THROTTLE_DONE pgs=2648 cs=0 l=1 rx=0x7f97fc010450 tx=0x7f97fc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980a9b3700 1 --2- 172.21.15.80:0/2231305753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f980407bba0 0x7f9804167c20 secure :-1 s=THROTTLE_DONE pgs=2648 cs=0 l=1 rx=0x7f97fc010450 tx=0x7f97fc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f97faffd700 1 -- 172.21.15.80:0/2231305753 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97fc00a6a0 con 0x7f980407bba0 2019-11-28T11:54:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980a9b3700 1 --2- 172.21.15.80:0/2231305753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f980407bba0 0x7f9804167c20 secure :-1 s=THROTTLE_DONE pgs=2648 cs=0 l=1 rx=0x7f97fc010450 tx=0x7f97fc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f97faffd700 1 -- 172.21.15.80:0/2231305753 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc009790 con 0x7f980407bba0 2019-11-28T11:54:36.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f97faffd700 1 -- 172.21.15.80:0/2231305753 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97fc009e20 con 0x7f980407bba0 2019-11-28T11:54:36.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980bc15700 1 -- 172.21.15.80:0/2231305753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9804079660 con 0x7f980407bba0 2019-11-28T11:54:36.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.173+0000 7f980bc15700 1 -- 172.21.15.80:0/2231305753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98040792e0 con 0x7f980407bba0 2019-11-28T11:54:36.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.174+0000 7f980a9b3700 1 --2- 172.21.15.80:0/2231305753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f980407bba0 0x7f9804167c20 secure :-1 s=THROTTLE_DONE pgs=2648 cs=0 l=1 rx=0x7f97fc010450 tx=0x7f97fc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.174+0000 7f97faffd700 1 -- 172.21.15.80:0/2231305753 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f97fc00a740 con 0x7f980407bba0 2019-11-28T11:54:36.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.174+0000 7f980a9b3700 1 --2- 172.21.15.80:0/2231305753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f980407bba0 0x7f9804167c20 secure :-1 s=THROTTLE_DONE pgs=2648 cs=0 l=1 rx=0x7f97fc010450 tx=0x7f97fc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.174+0000 7f97faffd700 1 --2- 172.21.15.80:0/2231305753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f97ec018730 0x7f97ec01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:36.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.174+0000 7f97faffd700 1 -- 172.21.15.80:0/2231305753 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f97fc031ab0 con 0x7f980407bba0 2019-11-28T11:54:36.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.175+0000 7f980a1b2700 1 --2- 172.21.15.80:0/2231305753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f97ec018730 0x7f97ec01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:36.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.175+0000 7f980a1b2700 1 --2- 172.21.15.80:0/2231305753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f97ec018730 0x7f97ec01abc0 crc :-1 s=READY pgs=1088 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:36.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.181+0000 7f980bc15700 1 -- 172.21.15.80:0/2231305753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9804079660 con 0x7f980407bba0 2019-11-28T11:54:36.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.185+0000 7f980a9b3700 1 --2- 172.21.15.80:0/2231305753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f980407bba0 0x7f9804167c20 secure :-1 s=THROTTLE_DONE pgs=2648 cs=0 l=1 rx=0x7f97fc010450 tx=0x7f97fc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.185+0000 7f97faffd700 1 -- 172.21.15.80:0/2231305753 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f97fc000ac0 con 0x7f980407bba0 2019-11-28T11:54:36.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.359+0000 7f980bc15700 1 -- 172.21.15.80:0/2231305753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98040792e0 con 0x7f980407bba0 2019-11-28T11:54:36.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.360+0000 7f980a9b3700 1 --2- 172.21.15.80:0/2231305753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f980407bba0 0x7f9804167c20 secure :-1 s=THROTTLE_DONE pgs=2648 cs=0 l=1 rx=0x7f97fc010450 tx=0x7f97fc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.360+0000 7f97faffd700 1 -- 172.21.15.80:0/2231305753 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f97fc00a6a0 con 0x7f980407bba0 2019-11-28T11:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:36.418 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":203,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:54:30.203239+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:54:27.540791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":33,"pool_name":"cephfs_data","create_time":"2019-11-28T11:54:28.225144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:54:36.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.362+0000 7f980bc15700 1 -- 172.21.15.80:0/2231305753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f97ec018730 msgr2=0x7f97ec01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.362+0000 7f980bc15700 1 --2- 172.21.15.80:0/2231305753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f97ec018730 0x7f97ec01abc0 crc :-1 s=READY pgs=1088 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.362+0000 7f980bc15700 1 -- 172.21.15.80:0/2231305753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f980407bba0 msgr2=0x7f9804167c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.362+0000 7f980bc15700 1 --2- 172.21.15.80:0/2231305753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f980407bba0 0x7f9804167c20 secure :-1 s=READY pgs=2648 cs=0 l=1 rx=0x7f97fc010450 tx=0x7f97fc0107f0).stop 2019-11-28T11:54:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.362+0000 7f980bc15700 1 -- 172.21.15.80:0/2231305753 shutdown_connections 2019-11-28T11:54:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.362+0000 7f980bc15700 1 --2- 172.21.15.80:0/2231305753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f980407bba0 0x7f9804167c20 unknown :-1 s=CLOSED pgs=2648 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.362+0000 7f980bc15700 1 --2- 172.21.15.80:0/2231305753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f97ec018730 0x7f97ec01abc0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.362+0000 7f980bc15700 1 --2- 172.21.15.80:0/2231305753 >> v2:172.21.15.174:3300/0 conn(0x7f9804074d00 0x7f980407aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:36.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.362+0000 7f980bc15700 1 -- 172.21.15.80:0/2231305753 shutdown_connections 2019-11-28T11:54:36.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.362+0000 7f980bc15700 1 -- 172.21.15.80:0/2231305753 wait complete. 2019-11-28T11:54:36.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.362+0000 7f980bc15700 1 -- 172.21.15.80:0/2231305753 >> 172.21.15.80:0/2231305753 conn(0x7f980413fa50 msgr2=0x7f980407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:36.430 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:54:27.540791+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 32, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'202', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:54:28.225144+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 33, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'203', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:54:36.430 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:54:36.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.496+0000 7f1521373700 1 Processor -- start 2019-11-28T11:54:36.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.496+0000 7f1521373700 1 -- start start 2019-11-28T11:54:36.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f1521373700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f151c15f100 0x7f151c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:36.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f1521373700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f151c06db60 con 0x7f151c06c2f0 2019-11-28T11:54:36.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f1521373700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f151c06e060 con 0x7f151c15ed10 2019-11-28T11:54:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f1521373700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f151c06fe00 con 0x7f151c15f100 2019-11-28T11:54:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f151c06c2f0 0x7f151c06c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44974/0 (socket says 172.21.15.80:44974) 2019-11-28T11:54:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151bfff700 1 -- 172.21.15.80:0/3256582953 learned_addr learned my addr 172.21.15.80:0/3256582953 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151affd700 1 --2- 172.21.15.80:0/3256582953 >> v2:172.21.15.174:3300/0 conn(0x7f151c15f100 0x7f151c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151a7fc700 1 -- 172.21.15.80:0/3256582953 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018114772 0 0) 0x7f1514001150 con 0x7f151c06c2f0 2019-11-28T11:54:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151a7fc700 1 -- 172.21.15.80:0/3256582953 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14fc002e80 con 0x7f151c06c2f0 2019-11-28T11:54:36.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151a7fc700 1 -- 172.21.15.80:0/3256582953 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809380890 0 0) 0x7f150c001080 con 0x7f151c15ed10 2019-11-28T11:54:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151a7fc700 1 -- 172.21.15.80:0/3256582953 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14fc004220 con 0x7f151c15ed10 2019-11-28T11:54:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151affd700 1 -- 172.21.15.80:0/3256582953 >> v1:172.21.15.174:6789/0 conn(0x7f151c15ed10 legacy=0x7f151c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151affd700 1 -- 172.21.15.80:0/3256582953 >> v1:172.21.15.80:6789/0 conn(0x7f151c06c2f0 legacy=0x7f151c06c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151affd700 1 -- 172.21.15.80:0/3256582953 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c070760 con 0x7f151c15f100 2019-11-28T11:54:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151affd700 1 --2- 172.21.15.80:0/3256582953 >> v2:172.21.15.174:3300/0 conn(0x7f151c15f100 0x7f151c06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f150400b2d0 tx=0x7f150400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151affd700 1 --2- 172.21.15.80:0/3256582953 >> v2:172.21.15.174:3300/0 conn(0x7f151c15f100 0x7f151c06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f150400b2d0 tx=0x7f150400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151affd700 1 --2- 172.21.15.80:0/3256582953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f151c15f100 0x7f151c06bdb0 secure :-1 s=READY pgs=1596 cs=0 l=1 rx=0x7f150400b2d0 tx=0x7f150400bae0).ready entity=mon.1 client_cookie=1e218dc2e13e23ed server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151affd700 1 --2- 172.21.15.80:0/3256582953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f151c15f100 0x7f151c06bdb0 secure :-1 s=THROTTLE_DONE pgs=1596 cs=0 l=1 rx=0x7f150400b2d0 tx=0x7f150400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151a7fc700 1 -- 172.21.15.80:0/3256582953 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1504000ce0 con 0x7f151c15f100 2019-11-28T11:54:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151affd700 1 --2- 172.21.15.80:0/3256582953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f151c15f100 0x7f151c06bdb0 secure :-1 s=THROTTLE_DONE pgs=1596 cs=0 l=1 rx=0x7f150400b2d0 tx=0x7f150400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151affd700 1 --2- 172.21.15.80:0/3256582953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f151c15f100 0x7f151c06bdb0 secure :-1 s=THROTTLE_DONE pgs=1596 cs=0 l=1 rx=0x7f150400b2d0 tx=0x7f150400bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151a7fc700 1 -- 172.21.15.80:0/3256582953 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1504009be0 con 0x7f151c15f100 2019-11-28T11:54:36.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.498+0000 7f151a7fc700 1 -- 172.21.15.80:0/3256582953 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f150400a2b0 con 0x7f151c15f100 2019-11-28T11:54:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.499+0000 7f1521373700 1 -- 172.21.15.80:0/3256582953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f151c15f100 msgr2=0x7f151c06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.499+0000 7f1521373700 1 --2- 172.21.15.80:0/3256582953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f151c15f100 0x7f151c06bdb0 secure :-1 s=READY pgs=1596 cs=0 l=1 rx=0x7f150400b2d0 tx=0x7f150400bae0).stop 2019-11-28T11:54:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.499+0000 7f1521373700 1 -- 172.21.15.80:0/3256582953 shutdown_connections 2019-11-28T11:54:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.499+0000 7f1521373700 1 --2- 172.21.15.80:0/3256582953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f151c15f100 0x7f151c06bdb0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.499+0000 7f1521373700 1 -- 172.21.15.80:0/3256582953 shutdown_connections 2019-11-28T11:54:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.499+0000 7f1521373700 1 -- 172.21.15.80:0/3256582953 wait complete. 2019-11-28T11:54:36.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.499+0000 7f1521373700 1 -- 172.21.15.80:0/3256582953 >> 172.21.15.80:0/3256582953 conn(0x7f151c061d20 msgr2=0x7f151c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:36.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.502+0000 7f1521373700 1 Processor -- start 2019-11-28T11:54:36.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.502+0000 7f1521373700 1 -- start start 2019-11-28T11:54:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f1521373700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f151c128430 0x7f151c07c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f1521373700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f151c101e80 0x7f151c165190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f1521373700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f151c106bb0 con 0x7f151c1656d0 2019-11-28T11:54:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f1521373700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f151c0793b0 con 0x7f151c101e80 2019-11-28T11:54:36.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f1521373700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f151c079680 con 0x7f151c128430 2019-11-28T11:54:36.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f151affd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f151c101e80 0x7f151c165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:36.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f151affd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f151c101e80 0x7f151c165190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45664/0 (socket says 172.21.15.80:45664) 2019-11-28T11:54:36.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f151affd700 1 -- 172.21.15.80:0/2458351686 learned_addr learned my addr 172.21.15.80:0/2458351686 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:36.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f151b7fe700 1 --2- 172.21.15.80:0/2458351686 >> v2:172.21.15.174:3300/0 conn(0x7f151c128430 0x7f151c07c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:36.569 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f151affd700 1 -- 172.21.15.80:0/2458351686 >> v2:172.21.15.174:3300/0 conn(0x7f151c128430 msgr2=0x7f151c07c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f151affd700 1 --2- 172.21.15.80:0/2458351686 >> v2:172.21.15.174:3300/0 conn(0x7f151c128430 0x7f151c07c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:36.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f151affd700 1 -- 172.21.15.80:0/2458351686 >> v1:172.21.15.174:6789/0 conn(0x7f151c1656d0 legacy=0x7f151c077400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f151affd700 1 -- 172.21.15.80:0/2458351686 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c079d10 con 0x7f151c101e80 2019-11-28T11:54:36.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f151affd700 1 --2- 172.21.15.80:0/2458351686 >> v2:172.21.15.80:3300/0 conn(0x7f151c101e80 0x7f151c165190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1504010820 tx=0x7f1504010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f151affd700 1 --2- 172.21.15.80:0/2458351686 >> v2:172.21.15.80:3300/0 conn(0x7f151c101e80 0x7f151c165190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1504010820 tx=0x7f1504010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f151affd700 1 --2- 172.21.15.80:0/2458351686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c101e80 0x7f151c165190 secure :-1 s=READY pgs=2650 cs=0 l=1 rx=0x7f1504010820 tx=0x7f1504010650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:36.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f151affd700 1 --2- 172.21.15.80:0/2458351686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c101e80 0x7f151c165190 secure :-1 s=THROTTLE_DONE pgs=2650 cs=0 l=1 rx=0x7f1504010820 tx=0x7f1504010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f1513fff700 1 -- 172.21.15.80:0/2458351686 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1504000cc0 con 0x7f151c101e80 2019-11-28T11:54:36.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f151affd700 1 --2- 172.21.15.80:0/2458351686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c101e80 0x7f151c165190 secure :-1 s=THROTTLE_DONE pgs=2650 cs=0 l=1 rx=0x7f1504010820 tx=0x7f1504010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f1513fff700 1 -- 172.21.15.80:0/2458351686 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1504009d00 con 0x7f151c101e80 2019-11-28T11:54:36.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f151affd700 1 --2- 172.21.15.80:0/2458351686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c101e80 0x7f151c165190 secure :-1 s=THROTTLE_DONE pgs=2650 cs=0 l=1 rx=0x7f1504010820 tx=0x7f1504010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f1513fff700 1 -- 172.21.15.80:0/2458351686 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1504009ef0 con 0x7f151c101e80 2019-11-28T11:54:36.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f1521373700 1 -- 172.21.15.80:0/2458351686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151c07a090 con 0x7f151c101e80 2019-11-28T11:54:36.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.503+0000 7f1521373700 1 -- 172.21.15.80:0/2458351686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151c079d10 con 0x7f151c101e80 2019-11-28T11:54:36.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.504+0000 7f151affd700 1 --2- 172.21.15.80:0/2458351686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c101e80 0x7f151c165190 secure :-1 s=THROTTLE_DONE pgs=2650 cs=0 l=1 rx=0x7f1504010820 tx=0x7f1504010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.504+0000 7f1513fff700 1 -- 172.21.15.80:0/2458351686 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1504009ef0 con 0x7f151c101e80 2019-11-28T11:54:36.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.504+0000 7f151affd700 1 --2- 172.21.15.80:0/2458351686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c101e80 0x7f151c165190 secure :-1 s=THROTTLE_DONE pgs=2650 cs=0 l=1 rx=0x7f1504010820 tx=0x7f1504010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.504+0000 7f1513fff700 1 --2- 172.21.15.80:0/2458351686 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f14f4018730 0x7f14f401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:36.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.504+0000 7f1513fff700 1 -- 172.21.15.80:0/2458351686 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1504031e50 con 0x7f151c101e80 2019-11-28T11:54:36.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.504+0000 7f151b7fe700 1 --2- 172.21.15.80:0/2458351686 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f14f4018730 0x7f14f401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:36.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.504+0000 7f151b7fe700 1 --2- 172.21.15.80:0/2458351686 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f14f4018730 0x7f14f401abc0 crc :-1 s=READY pgs=1089 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:36.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.512+0000 7f1521373700 1 -- 172.21.15.80:0/2458351686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151c07a090 con 0x7f151c101e80 2019-11-28T11:54:36.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.515+0000 7f151affd700 1 --2- 172.21.15.80:0/2458351686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c101e80 0x7f151c165190 secure :-1 s=THROTTLE_DONE pgs=2650 cs=0 l=1 rx=0x7f1504010820 tx=0x7f1504010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.573 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.515+0000 7f1513fff700 1 -- 172.21.15.80:0/2458351686 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1504009900 con 0x7f151c101e80 2019-11-28T11:54:36.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.684+0000 7f1521373700 1 -- 172.21.15.80:0/2458351686 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f151c079d10 con 0x7f151c101e80 2019-11-28T11:54:36.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.685+0000 7f151affd700 1 --2- 172.21.15.80:0/2458351686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c101e80 0x7f151c165190 secure :-1 s=THROTTLE_DONE pgs=2650 cs=0 l=1 rx=0x7f1504010820 tx=0x7f1504010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.685+0000 7f1513fff700 1 -- 172.21.15.80:0/2458351686 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v203) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1504009ed0 con 0x7f151c101e80 2019-11-28T11:54:36.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.687+0000 7f1521373700 1 -- 172.21.15.80:0/2458351686 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f14f4018730 msgr2=0x7f14f401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.687+0000 7f1521373700 1 --2- 172.21.15.80:0/2458351686 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f14f4018730 0x7f14f401abc0 crc :-1 s=READY pgs=1089 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:36.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.687+0000 7f1521373700 1 -- 172.21.15.80:0/2458351686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c101e80 msgr2=0x7f151c165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.687+0000 7f1521373700 1 --2- 172.21.15.80:0/2458351686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c101e80 0x7f151c165190 secure :-1 s=READY pgs=2650 cs=0 l=1 rx=0x7f1504010820 tx=0x7f1504010650).stop 2019-11-28T11:54:36.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.687+0000 7f1521373700 1 -- 172.21.15.80:0/2458351686 shutdown_connections 2019-11-28T11:54:36.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.687+0000 7f1521373700 1 --2- 172.21.15.80:0/2458351686 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f14f4018730 0x7f14f401abc0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:36.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.687+0000 7f1521373700 1 --2- 172.21.15.80:0/2458351686 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f151c101e80 0x7f151c165190 unknown :-1 s=CLOSED pgs=2650 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:36.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.687+0000 7f1521373700 1 --2- 172.21.15.80:0/2458351686 >> v2:172.21.15.174:3300/0 conn(0x7f151c128430 0x7f151c07c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:36.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.687+0000 7f1521373700 1 -- 172.21.15.80:0/2458351686 shutdown_connections 2019-11-28T11:54:36.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.688+0000 7f1521373700 1 -- 172.21.15.80:0/2458351686 wait complete. 2019-11-28T11:54:36.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.688+0000 7f1521373700 1 -- 172.21.15.80:0/2458351686 >> 172.21.15.80:0/2458351686 conn(0x7f151c166440 msgr2=0x7f151c1494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:36.751 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:54:36.754 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:54:36.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.821+0000 7f5884b5d700 1 Processor -- start 2019-11-28T11:54:36.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.821+0000 7f5884b5d700 1 -- start start 2019-11-28T11:54:36.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.822+0000 7f5884b5d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f588015ed10 0x7f588015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:36.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.822+0000 7f5884b5d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5880073020 0x7f5880071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:36.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.822+0000 7f5884b5d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f588006db60 con 0x7f58800734b0 2019-11-28T11:54:36.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.822+0000 7f5884b5d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588006fe00 con 0x7f588015ed10 2019-11-28T11:54:36.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.822+0000 7f5884b5d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58800700d0 con 0x7f5880073020 2019-11-28T11:54:36.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.822+0000 7f587f59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f58800734b0 0x7f58800723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44988/0 (socket says 172.21.15.80:44988) 2019-11-28T11:54:36.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.822+0000 7f587f59e700 1 -- 172.21.15.80:0/2420990083 learned_addr learned my addr 172.21.15.80:0/2420990083 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:36.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.822+0000 7f587e59c700 1 --2- 172.21.15.80:0/2420990083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5880073020 0x7f5880071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:36.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.822+0000 7f587ed9d700 1 --2- 172.21.15.80:0/2420990083 >> v2:172.21.15.174:3300/0 conn(0x7f588015ed10 0x7f588015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:36.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.822+0000 7f587dd9b700 1 -- 172.21.15.80:0/2420990083 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340480728 0 0) 0x7f58780014d0 con 0x7f58800734b0 2019-11-28T11:54:36.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.822+0000 7f587dd9b700 1 -- 172.21.15.80:0/2420990083 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5860002e80 con 0x7f58800734b0 2019-11-28T11:54:36.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f587e59c700 1 -- 172.21.15.80:0/2420990083 >> v2:172.21.15.174:3300/0 conn(0x7f588015ed10 msgr2=0x7f588015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:36.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f587e59c700 1 --2- 172.21.15.80:0/2420990083 >> v2:172.21.15.174:3300/0 conn(0x7f588015ed10 0x7f588015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:36.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f587e59c700 1 -- 172.21.15.80:0/2420990083 >> v1:172.21.15.80:6789/0 conn(0x7f58800734b0 legacy=0x7f58800723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f587dd9b700 1 -- 172.21.15.80:0/2420990083 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4128707704 0 0) 0x7f58780014b0 con 0x7f58800734b0 2019-11-28T11:54:36.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f587e59c700 1 -- 172.21.15.80:0/2420990083 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5880070760 con 0x7f5880073020 2019-11-28T11:54:36.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f587ed9d700 1 --2- 172.21.15.80:0/2420990083 >> v2:172.21.15.174:3300/0 conn(0x7f588015ed10 0x7f588015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:36.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f587e59c700 1 --2- 172.21.15.80:0/2420990083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5880073020 0x7f5880071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f587000af50 tx=0x7f587000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f587e59c700 1 --2- 172.21.15.80:0/2420990083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5880073020 0x7f5880071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f587000af50 tx=0x7f587000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f587e59c700 1 --2- 172.21.15.80:0/2420990083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5880073020 0x7f5880071ea0 secure :-1 s=READY pgs=381 cs=0 l=1 rx=0x7f587000af50 tx=0x7f587000b760).ready entity=mon.2 client_cookie=1b941e0fc4333e91 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:36.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f587e59c700 1 --2- 172.21.15.80:0/2420990083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5880073020 0x7f5880071ea0 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f587000af50 tx=0x7f587000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f587dd9b700 1 -- 172.21.15.80:0/2420990083 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5870007210 con 0x7f5880073020 2019-11-28T11:54:36.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f587e59c700 1 --2- 172.21.15.80:0/2420990083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5880073020 0x7f5880071ea0 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f587000af50 tx=0x7f587000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f587e59c700 1 --2- 172.21.15.80:0/2420990083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5880073020 0x7f5880071ea0 secure :-1 s=THROTTLE_DONE pgs=381 cs=0 l=1 rx=0x7f587000af50 tx=0x7f587000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f587dd9b700 1 -- 172.21.15.80:0/2420990083 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58700099b0 con 0x7f5880073020 2019-11-28T11:54:36.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f587dd9b700 1 -- 172.21.15.80:0/2420990083 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f587000a080 con 0x7f5880073020 2019-11-28T11:54:36.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f5884b5d700 1 -- 172.21.15.80:0/2420990083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5880073020 msgr2=0x7f5880071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.823+0000 7f5884b5d700 1 --2- 172.21.15.80:0/2420990083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5880073020 0x7f5880071ea0 secure :-1 s=READY pgs=381 cs=0 l=1 rx=0x7f587000af50 tx=0x7f587000b760).stop 2019-11-28T11:54:36.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.824+0000 7f5884b5d700 1 -- 172.21.15.80:0/2420990083 shutdown_connections 2019-11-28T11:54:36.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.824+0000 7f5884b5d700 1 --2- 172.21.15.80:0/2420990083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5880073020 0x7f5880071ea0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:36.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.824+0000 7f5884b5d700 1 --2- 172.21.15.80:0/2420990083 >> v2:172.21.15.174:3300/0 conn(0x7f588015ed10 0x7f588015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:36.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.824+0000 7f5884b5d700 1 -- 172.21.15.80:0/2420990083 shutdown_connections 2019-11-28T11:54:36.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.824+0000 7f5884b5d700 1 -- 172.21.15.80:0/2420990083 wait complete. 2019-11-28T11:54:36.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.824+0000 7f5884b5d700 1 -- 172.21.15.80:0/2420990083 >> 172.21.15.80:0/2420990083 conn(0x7f5880061d20 msgr2=0x7f58800641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:36.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.826+0000 7f5884b5d700 1 Processor -- start 2019-11-28T11:54:36.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.826+0000 7f5884b5d700 1 -- start start 2019-11-28T11:54:36.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.827+0000 7f5884b5d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5880148320 0x7f588010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:36.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.827+0000 7f5884b5d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f588010f290 0x7f588010dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:36.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.827+0000 7f5884b5d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5880148e00 con 0x7f588010e110 2019-11-28T11:54:36.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.827+0000 7f5884b5d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588013aa20 con 0x7f5880148320 2019-11-28T11:54:36.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.827+0000 7f5884b5d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588013acf0 con 0x7f588010f290 2019-11-28T11:54:36.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.827+0000 7f587ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5880148320 0x7f588010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:36.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.827+0000 7f587ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5880148320 0x7f588010ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45676/0 (socket says 172.21.15.80:45676) 2019-11-28T11:54:36.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.827+0000 7f587ed9d700 1 -- 172.21.15.80:0/2973269909 learned_addr learned my addr 172.21.15.80:0/2973269909 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:36.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.827+0000 7f587e59c700 1 --2- 172.21.15.80:0/2973269909 >> v2:172.21.15.174:3300/0 conn(0x7f588010f290 0x7f588010dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:36.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f587ed9d700 1 -- 172.21.15.80:0/2973269909 >> v2:172.21.15.174:3300/0 conn(0x7f588010f290 msgr2=0x7f588010dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f587ed9d700 1 --2- 172.21.15.80:0/2973269909 >> v2:172.21.15.174:3300/0 conn(0x7f588010f290 0x7f588010dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:36.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f587ed9d700 1 -- 172.21.15.80:0/2973269909 >> v1:172.21.15.174:6789/0 conn(0x7f588010e110 legacy=0x7f58801079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:36.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f58777fe700 1 -- 172.21.15.80:0/2973269909 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703796787 0 0) 0x7f5878000d30 con 0x7f588010e110 2019-11-28T11:54:36.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f587ed9d700 1 -- 172.21.15.80:0/2973269909 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588010c490 con 0x7f5880148320 2019-11-28T11:54:36.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f587ed9d700 1 --2- 172.21.15.80:0/2973269909 >> v2:172.21.15.80:3300/0 conn(0x7f5880148320 0x7f588010ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5868010410 tx=0x7f5868010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f587ed9d700 1 --2- 172.21.15.80:0/2973269909 >> v2:172.21.15.80:3300/0 conn(0x7f5880148320 0x7f588010ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5868010410 tx=0x7f5868010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f587ed9d700 1 --2- 172.21.15.80:0/2973269909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5880148320 0x7f588010ed50 secure :-1 s=READY pgs=2652 cs=0 l=1 rx=0x7f5868010410 tx=0x7f5868010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:36.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f587ed9d700 1 --2- 172.21.15.80:0/2973269909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5880148320 0x7f588010ed50 secure :-1 s=THROTTLE_DONE pgs=2652 cs=0 l=1 rx=0x7f5868010410 tx=0x7f5868010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f58777fe700 1 -- 172.21.15.80:0/2973269909 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5868000940 con 0x7f5880148320 2019-11-28T11:54:36.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f587ed9d700 1 --2- 172.21.15.80:0/2973269909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5880148320 0x7f588010ed50 secure :-1 s=THROTTLE_DONE pgs=2652 cs=0 l=1 rx=0x7f5868010410 tx=0x7f5868010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f5884b5d700 1 -- 172.21.15.80:0/2973269909 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588010c810 con 0x7f5880148320 2019-11-28T11:54:36.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f58777fe700 1 -- 172.21.15.80:0/2973269909 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586800a8c0 con 0x7f5880148320 2019-11-28T11:54:36.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f587ed9d700 1 --2- 172.21.15.80:0/2973269909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5880148320 0x7f588010ed50 secure :-1 s=THROTTLE_DONE pgs=2652 cs=0 l=1 rx=0x7f5868010410 tx=0x7f5868010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f58777fe700 1 -- 172.21.15.80:0/2973269909 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5868009960 con 0x7f5880148320 2019-11-28T11:54:36.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f5884b5d700 1 -- 172.21.15.80:0/2973269909 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588010c490 con 0x7f5880148320 2019-11-28T11:54:36.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f587ed9d700 1 --2- 172.21.15.80:0/2973269909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5880148320 0x7f588010ed50 secure :-1 s=THROTTLE_DONE pgs=2652 cs=0 l=1 rx=0x7f5868010410 tx=0x7f5868010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f58777fe700 1 -- 172.21.15.80:0/2973269909 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5868009580 con 0x7f5880148320 2019-11-28T11:54:36.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.828+0000 7f587ed9d700 1 --2- 172.21.15.80:0/2973269909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5880148320 0x7f588010ed50 secure :-1 s=THROTTLE_DONE pgs=2652 cs=0 l=1 rx=0x7f5868010410 tx=0x7f5868010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.829+0000 7f58777fe700 1 --2- 172.21.15.80:0/2973269909 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5858018730 0x7f585801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:36.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.829+0000 7f58777fe700 1 -- 172.21.15.80:0/2973269909 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5868031a90 con 0x7f5880148320 2019-11-28T11:54:36.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.829+0000 7f587e59c700 1 --2- 172.21.15.80:0/2973269909 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5858018730 0x7f585801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:36.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.829+0000 7f587e59c700 1 --2- 172.21.15.80:0/2973269909 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5858018730 0x7f585801abc0 crc :-1 s=READY pgs=1090 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:36.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.836+0000 7f5884b5d700 1 -- 172.21.15.80:0/2973269909 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588010c810 con 0x7f5880148320 2019-11-28T11:54:36.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.840+0000 7f587ed9d700 1 --2- 172.21.15.80:0/2973269909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5880148320 0x7f588010ed50 secure :-1 s=THROTTLE_DONE pgs=2652 cs=0 l=1 rx=0x7f5868010410 tx=0x7f5868010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:36.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:36.840+0000 7f58777fe700 1 -- 172.21.15.80:0/2973269909 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f586800a570 con 0x7f5880148320 2019-11-28T11:54:37.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.008+0000 7f5884b5d700 1 -- 172.21.15.80:0/2973269909 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f588010c490 con 0x7f5880148320 2019-11-28T11:54:37.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.008+0000 7f587ed9d700 1 --2- 172.21.15.80:0/2973269909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5880148320 0x7f588010ed50 secure :-1 s=THROTTLE_DONE pgs=2652 cs=0 l=1 rx=0x7f5868010410 tx=0x7f5868010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.008+0000 7f58777fe700 1 -- 172.21.15.80:0/2973269909 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v203) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5868017430 con 0x7f5880148320 2019-11-28T11:54:37.066 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:54:37.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.011+0000 7f5884b5d700 1 -- 172.21.15.80:0/2973269909 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5858018730 msgr2=0x7f585801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:37.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.011+0000 7f5884b5d700 1 --2- 172.21.15.80:0/2973269909 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5858018730 0x7f585801abc0 crc :-1 s=READY pgs=1090 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:37.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.011+0000 7f5884b5d700 1 -- 172.21.15.80:0/2973269909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5880148320 msgr2=0x7f588010ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:37.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.011+0000 7f5884b5d700 1 --2- 172.21.15.80:0/2973269909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5880148320 0x7f588010ed50 secure :-1 s=READY pgs=2652 cs=0 l=1 rx=0x7f5868010410 tx=0x7f5868010290).stop 2019-11-28T11:54:37.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.011+0000 7f5884b5d700 1 -- 172.21.15.80:0/2973269909 shutdown_connections 2019-11-28T11:54:37.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.011+0000 7f5884b5d700 1 --2- 172.21.15.80:0/2973269909 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5858018730 0x7f585801abc0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:37.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.011+0000 7f5884b5d700 1 --2- 172.21.15.80:0/2973269909 >> v2:172.21.15.174:3300/0 conn(0x7f588010f290 0x7f588010dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:37.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.011+0000 7f5884b5d700 1 --2- 172.21.15.80:0/2973269909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5880148320 0x7f588010ed50 unknown :-1 s=CLOSED pgs=2652 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:37.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.011+0000 7f5884b5d700 1 -- 172.21.15.80:0/2973269909 shutdown_connections 2019-11-28T11:54:37.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.011+0000 7f5884b5d700 1 -- 172.21.15.80:0/2973269909 wait complete. 2019-11-28T11:54:37.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.011+0000 7f5884b5d700 1 -- 172.21.15.80:0/2973269909 >> 172.21.15.80:0/2973269909 conn(0x7f588015e2d0 msgr2=0x7f5880147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:37.078 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:54:37.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.145+0000 7f29c1676700 1 Processor -- start 2019-11-28T11:54:37.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.145+0000 7f29c1676700 1 -- start start 2019-11-28T11:54:37.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29c1676700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29bc15f100 0x7f29bc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:37.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29c1676700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f29bc06c2f0 0x7f29bc06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:37.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29c1676700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc06db60 con 0x7f29bc15ed10 2019-11-28T11:54:37.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29c1676700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc06fe00 con 0x7f29bc15f100 2019-11-28T11:54:37.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29c1676700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc0700d0 con 0x7f29bc06c2f0 2019-11-28T11:54:37.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29baffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29bc15f100 0x7f29bc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:37.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29baffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29bc15f100 0x7f29bc06bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45686/0 (socket says 172.21.15.80:45686) 2019-11-28T11:54:37.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29baffd700 1 -- 172.21.15.80:0/3152845508 learned_addr learned my addr 172.21.15.80:0/3152845508 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:37.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29bbfff700 1 --2- 172.21.15.80:0/3152845508 >> v2:172.21.15.174:3300/0 conn(0x7f29bc06c2f0 0x7f29bc06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:37.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29baffd700 1 -- 172.21.15.80:0/3152845508 >> v2:172.21.15.174:3300/0 conn(0x7f29bc06c2f0 msgr2=0x7f29bc06c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:37.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29baffd700 1 --2- 172.21.15.80:0/3152845508 >> v2:172.21.15.174:3300/0 conn(0x7f29bc06c2f0 0x7f29bc06c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:37.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29baffd700 1 -- 172.21.15.80:0/3152845508 >> v1:172.21.15.174:6789/0 conn(0x7f29bc15ed10 legacy=0x7f29bc073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:37.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29baffd700 1 -- 172.21.15.80:0/3152845508 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc070760 con 0x7f29bc15f100 2019-11-28T11:54:37.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29bbfff700 1 --2- 172.21.15.80:0/3152845508 >> v2:172.21.15.174:3300/0 conn(0x7f29bc06c2f0 0x7f29bc06c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:37.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29baffd700 1 --2- 172.21.15.80:0/3152845508 >> v2:172.21.15.80:3300/0 conn(0x7f29bc15f100 0x7f29bc06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f29ac00f740 tx=0x7f29ac00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29baffd700 1 --2- 172.21.15.80:0/3152845508 >> v2:172.21.15.80:3300/0 conn(0x7f29bc15f100 0x7f29bc06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f29ac00f740 tx=0x7f29ac00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29baffd700 1 --2- 172.21.15.80:0/3152845508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc15f100 0x7f29bc06bdb0 secure :-1 s=READY pgs=2653 cs=0 l=1 rx=0x7f29ac00f740 tx=0x7f29ac00fae0).ready entity=mon.0 client_cookie=20c92f60ed66b852 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:37.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29baffd700 1 --2- 172.21.15.80:0/3152845508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc15f100 0x7f29bc06bdb0 secure :-1 s=THROTTLE_DONE pgs=2653 cs=0 l=1 rx=0x7f29ac00f740 tx=0x7f29ac00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29baffd700 1 --2- 172.21.15.80:0/3152845508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc15f100 0x7f29bc06bdb0 secure :-1 s=THROTTLE_DONE pgs=2653 cs=0 l=1 rx=0x7f29ac00f740 tx=0x7f29ac00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29ba7fc700 1 -- 172.21.15.80:0/3152845508 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29ac000960 con 0x7f29bc15f100 2019-11-28T11:54:37.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29baffd700 1 --2- 172.21.15.80:0/3152845508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc15f100 0x7f29bc06bdb0 secure :-1 s=THROTTLE_DONE pgs=2653 cs=0 l=1 rx=0x7f29ac00f740 tx=0x7f29ac00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29ba7fc700 1 -- 172.21.15.80:0/3152845508 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac000c90 con 0x7f29bc15f100 2019-11-28T11:54:37.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29ba7fc700 1 -- 172.21.15.80:0/3152845508 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29ac0013a0 con 0x7f29bc15f100 2019-11-28T11:54:37.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29c1676700 1 -- 172.21.15.80:0/3152845508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc15f100 msgr2=0x7f29bc06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:37.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.146+0000 7f29c1676700 1 --2- 172.21.15.80:0/3152845508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc15f100 0x7f29bc06bdb0 secure :-1 s=READY pgs=2653 cs=0 l=1 rx=0x7f29ac00f740 tx=0x7f29ac00fae0).stop 2019-11-28T11:54:37.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.147+0000 7f29c1676700 1 -- 172.21.15.80:0/3152845508 shutdown_connections 2019-11-28T11:54:37.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.147+0000 7f29c1676700 1 --2- 172.21.15.80:0/3152845508 >> v2:172.21.15.174:3300/0 conn(0x7f29bc06c2f0 0x7f29bc06c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:37.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.147+0000 7f29c1676700 1 --2- 172.21.15.80:0/3152845508 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc15f100 0x7f29bc06bdb0 unknown :-1 s=CLOSED pgs=2653 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:37.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.147+0000 7f29c1676700 1 -- 172.21.15.80:0/3152845508 shutdown_connections 2019-11-28T11:54:37.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.147+0000 7f29c1676700 1 -- 172.21.15.80:0/3152845508 wait complete. 2019-11-28T11:54:37.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.147+0000 7f29c1676700 1 -- 172.21.15.80:0/3152845508 >> 172.21.15.80:0/3152845508 conn(0x7f29bc061d20 msgr2=0x7f29bc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:37.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.149+0000 7f29c1676700 1 Processor -- start 2019-11-28T11:54:37.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.150+0000 7f29c1676700 1 -- start start 2019-11-28T11:54:37.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.150+0000 7f29c1676700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29bc10ed60 0x7f29bc10f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:37.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.150+0000 7f29c1676700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29bc10f730 0x7f29bc167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:37.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.150+0000 7f29c1676700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc10c250 con 0x7f29bc10e970 2019-11-28T11:54:37.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.150+0000 7f29c1676700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc10e430 con 0x7f29bc10ed60 2019-11-28T11:54:37.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.150+0000 7f29c1676700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc105860 con 0x7f29bc10f730 2019-11-28T11:54:37.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.150+0000 7f29baffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29bc10ed60 0x7f29bc10f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:37.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.150+0000 7f29baffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29bc10ed60 0x7f29bc10f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45692/0 (socket says 172.21.15.80:45692) 2019-11-28T11:54:37.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29baffd700 1 -- 172.21.15.80:0/3418460404 learned_addr learned my addr 172.21.15.80:0/3418460404 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:37.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29bb7fe700 1 --1- 172.21.15.80:0/3418460404 >> v1:172.21.15.80:6789/0 conn(0x7f29bc10e970 0x7f29bc1087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45006/0 (socket says 172.21.15.80:45006) 2019-11-28T11:54:37.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29bbfff700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29bc10f730 0x7f29bc167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:37.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29baffd700 1 -- 172.21.15.80:0/3418460404 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29bc10f730 msgr2=0x7f29bc167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:37.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29baffd700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29bc10f730 0x7f29bc167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:37.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29baffd700 1 -- 172.21.15.80:0/3418460404 >> v1:172.21.15.80:6789/0 conn(0x7f29bc10e970 legacy=0x7f29bc1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29baffd700 1 -- 172.21.15.80:0/3418460404 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc105ef0 con 0x7f29bc10ed60 2019-11-28T11:54:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29bbfff700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29bc10f730 0x7f29bc167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29a3fff700 1 -- 172.21.15.80:0/3418460404 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286534526 0 0) 0x7f29b00010c0 con 0x7f29bc10e970 2019-11-28T11:54:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29baffd700 1 --2- 172.21.15.80:0/3418460404 >> v2:172.21.15.80:3300/0 conn(0x7f29bc10ed60 0x7f29bc10f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29ac010440 tx=0x7f29ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29baffd700 1 --2- 172.21.15.80:0/3418460404 >> v2:172.21.15.80:3300/0 conn(0x7f29bc10ed60 0x7f29bc10f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29ac010440 tx=0x7f29ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29baffd700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc10ed60 0x7f29bc10f1f0 secure :-1 s=READY pgs=2655 cs=0 l=1 rx=0x7f29ac010440 tx=0x7f29ac0107e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:37.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29baffd700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc10ed60 0x7f29bc10f1f0 secure :-1 s=THROTTLE_DONE pgs=2655 cs=0 l=1 rx=0x7f29ac010440 tx=0x7f29ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29a3fff700 1 -- 172.21.15.80:0/3418460404 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29ac000940 con 0x7f29bc10ed60 2019-11-28T11:54:37.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29baffd700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc10ed60 0x7f29bc10f1f0 secure :-1 s=THROTTLE_DONE pgs=2655 cs=0 l=1 rx=0x7f29ac010440 tx=0x7f29ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29c1676700 1 -- 172.21.15.80:0/3418460404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29bc106270 con 0x7f29bc10ed60 2019-11-28T11:54:37.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29a3fff700 1 -- 172.21.15.80:0/3418460404 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac000940 con 0x7f29bc10ed60 2019-11-28T11:54:37.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29baffd700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc10ed60 0x7f29bc10f1f0 secure :-1 s=THROTTLE_DONE pgs=2655 cs=0 l=1 rx=0x7f29ac010440 tx=0x7f29ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29a3fff700 1 -- 172.21.15.80:0/3418460404 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29ac001140 con 0x7f29bc10ed60 2019-11-28T11:54:37.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29c1676700 1 -- 172.21.15.80:0/3418460404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc105ef0 con 0x7f29bc10ed60 2019-11-28T11:54:37.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.151+0000 7f29baffd700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc10ed60 0x7f29bc10f1f0 secure :-1 s=THROTTLE_DONE pgs=2655 cs=0 l=1 rx=0x7f29ac010440 tx=0x7f29ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.152+0000 7f29a3fff700 1 -- 172.21.15.80:0/3418460404 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f29ac000d60 con 0x7f29bc10ed60 2019-11-28T11:54:37.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.152+0000 7f29baffd700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc10ed60 0x7f29bc10f1f0 secure :-1 s=THROTTLE_DONE pgs=2655 cs=0 l=1 rx=0x7f29ac010440 tx=0x7f29ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.152+0000 7f29a3fff700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f299c018730 0x7f299c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:37.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.152+0000 7f29a3fff700 1 -- 172.21.15.80:0/3418460404 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f29ac031aa0 con 0x7f29bc10ed60 2019-11-28T11:54:37.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.152+0000 7f29bb7fe700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f299c018730 0x7f299c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.152+0000 7f29bb7fe700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f299c018730 0x7f299c01abc0 crc :-1 s=READY pgs=1091 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.160+0000 7f29c1676700 1 -- 172.21.15.80:0/3418460404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29bc106270 con 0x7f29bc10ed60 2019-11-28T11:54:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.163+0000 7f29baffd700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc10ed60 0x7f29bc10f1f0 secure :-1 s=THROTTLE_DONE pgs=2655 cs=0 l=1 rx=0x7f29ac010440 tx=0x7f29ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.163+0000 7f29a3fff700 1 -- 172.21.15.80:0/3418460404 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f29ac000b30 con 0x7f29bc10ed60 2019-11-28T11:54:37.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.331+0000 7f29c1676700 1 -- 172.21.15.80:0/3418460404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f29bc105ef0 con 0x7f29bc10ed60 2019-11-28T11:54:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.331+0000 7f29baffd700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc10ed60 0x7f29bc10f1f0 secure :-1 s=THROTTLE_DONE pgs=2655 cs=0 l=1 rx=0x7f29ac010440 tx=0x7f29ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.331+0000 7f29a3fff700 1 -- 172.21.15.80:0/3418460404 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v203) v1 ==== 100+0+10 (secure 0 0 0) 0x7f29ac000d40 con 0x7f29bc10ed60 2019-11-28T11:54:37.390 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:54:37.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.334+0000 7f29c1676700 1 -- 172.21.15.80:0/3418460404 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f299c018730 msgr2=0x7f299c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:37.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.334+0000 7f29c1676700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f299c018730 0x7f299c01abc0 crc :-1 s=READY pgs=1091 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:37.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.334+0000 7f29c1676700 1 -- 172.21.15.80:0/3418460404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc10ed60 msgr2=0x7f29bc10f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:37.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.334+0000 7f29c1676700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc10ed60 0x7f29bc10f1f0 secure :-1 s=READY pgs=2655 cs=0 l=1 rx=0x7f29ac010440 tx=0x7f29ac0107e0).stop 2019-11-28T11:54:37.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.334+0000 7f29c1676700 1 -- 172.21.15.80:0/3418460404 shutdown_connections 2019-11-28T11:54:37.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.334+0000 7f29c1676700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f299c018730 0x7f299c01abc0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:37.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.334+0000 7f29c1676700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f29bc10f730 0x7f29bc167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:37.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.334+0000 7f29c1676700 1 --2- 172.21.15.80:0/3418460404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29bc10ed60 0x7f29bc10f1f0 unknown :-1 s=CLOSED pgs=2655 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:37.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.334+0000 7f29c1676700 1 -- 172.21.15.80:0/3418460404 shutdown_connections 2019-11-28T11:54:37.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.334+0000 7f29c1676700 1 -- 172.21.15.80:0/3418460404 wait complete. 2019-11-28T11:54:37.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.334+0000 7f29c1676700 1 -- 172.21.15.80:0/3418460404 >> 172.21.15.80:0/3418460404 conn(0x7f29bc15e2d0 msgr2=0x7f29bc147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:37.402 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:54:37.402 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:37.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.464+0000 7f0b29913700 1 Processor -- start 2019-11-28T11:54:37.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.464+0000 7f0b29913700 1 -- start start 2019-11-28T11:54:37.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.465+0000 7f0b29913700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0b2406c0a0 0x7f0b24072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:37.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.465+0000 7f0b29913700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0b240734e0 0x7f0b24071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:37.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.465+0000 7f0b29913700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b2406db00 con 0x7f0b24072360 2019-11-28T11:54:37.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.465+0000 7f0b29913700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b2406fd60 con 0x7f0b2406c0a0 2019-11-28T11:54:37.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.465+0000 7f0b29913700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b24070030 con 0x7f0b240734e0 2019-11-28T11:54:37.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.465+0000 7f0b237fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0b2406c0a0 0x7f0b24072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:37.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.465+0000 7f0b237fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0b2406c0a0 0x7f0b24072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45698/0 (socket says 172.21.15.80:45698) 2019-11-28T11:54:37.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.465+0000 7f0b237fe700 1 -- 172.21.15.80:0/2923819096 learned_addr learned my addr 172.21.15.80:0/2923819096 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:37.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.465+0000 7f0b22ffd700 1 --2- 172.21.15.80:0/2923819096 >> v2:172.21.15.174:3300/0 conn(0x7f0b240734e0 0x7f0b24071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:37.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.466+0000 7f0b237fe700 1 -- 172.21.15.80:0/2923819096 >> v2:172.21.15.174:3300/0 conn(0x7f0b240734e0 msgr2=0x7f0b24071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:37.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.466+0000 7f0b237fe700 1 --2- 172.21.15.80:0/2923819096 >> v2:172.21.15.174:3300/0 conn(0x7f0b240734e0 0x7f0b24071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:37.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.466+0000 7f0b237fe700 1 -- 172.21.15.80:0/2923819096 >> v1:172.21.15.174:6789/0 conn(0x7f0b24072360 legacy=0x7f0b2406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:37.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.466+0000 7f0b237fe700 1 -- 172.21.15.80:0/2923819096 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b240706c0 con 0x7f0b2406c0a0 2019-11-28T11:54:37.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.466+0000 7f0b237fe700 1 --2- 172.21.15.80:0/2923819096 >> v2:172.21.15.80:3300/0 conn(0x7f0b2406c0a0 0x7f0b24072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0b1400f6c0 tx=0x7f0b1400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.466+0000 7f0b237fe700 1 --2- 172.21.15.80:0/2923819096 >> v2:172.21.15.80:3300/0 conn(0x7f0b2406c0a0 0x7f0b24072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0b1400f6c0 tx=0x7f0b1400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.466+0000 7f0b237fe700 1 --2- 172.21.15.80:0/2923819096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b2406c0a0 0x7f0b24072fa0 secure :-1 s=READY pgs=2656 cs=0 l=1 rx=0x7f0b1400f6c0 tx=0x7f0b1400fa60).ready entity=mon.0 client_cookie=bb04ed1714c25c52 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:37.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.466+0000 7f0b237fe700 1 --2- 172.21.15.80:0/2923819096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b2406c0a0 0x7f0b24072fa0 secure :-1 s=THROTTLE_DONE pgs=2656 cs=0 l=1 rx=0x7f0b1400f6c0 tx=0x7f0b1400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.466+0000 7f0b237fe700 1 --2- 172.21.15.80:0/2923819096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b2406c0a0 0x7f0b24072fa0 secure :-1 s=THROTTLE_DONE pgs=2656 cs=0 l=1 rx=0x7f0b1400f6c0 tx=0x7f0b1400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.466+0000 7f0b237fe700 1 --2- 172.21.15.80:0/2923819096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b2406c0a0 0x7f0b24072fa0 secure :-1 s=THROTTLE_DONE pgs=2656 cs=0 l=1 rx=0x7f0b1400f6c0 tx=0x7f0b1400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.466+0000 7f0b227fc700 1 -- 172.21.15.80:0/2923819096 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b14000960 con 0x7f0b2406c0a0 2019-11-28T11:54:37.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.466+0000 7f0b227fc700 1 -- 172.21.15.80:0/2923819096 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b14000c90 con 0x7f0b2406c0a0 2019-11-28T11:54:37.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.466+0000 7f0b227fc700 1 -- 172.21.15.80:0/2923819096 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b140013a0 con 0x7f0b2406c0a0 2019-11-28T11:54:37.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.466+0000 7f0b29913700 1 -- 172.21.15.80:0/2923819096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b2406c0a0 msgr2=0x7f0b24072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:37.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.466+0000 7f0b29913700 1 --2- 172.21.15.80:0/2923819096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b2406c0a0 0x7f0b24072fa0 secure :-1 s=READY pgs=2656 cs=0 l=1 rx=0x7f0b1400f6c0 tx=0x7f0b1400fa60).stop 2019-11-28T11:54:37.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.467+0000 7f0b29913700 1 -- 172.21.15.80:0/2923819096 shutdown_connections 2019-11-28T11:54:37.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.467+0000 7f0b29913700 1 --2- 172.21.15.80:0/2923819096 >> v2:172.21.15.174:3300/0 conn(0x7f0b240734e0 0x7f0b24071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:37.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.467+0000 7f0b29913700 1 --2- 172.21.15.80:0/2923819096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b2406c0a0 0x7f0b24072fa0 unknown :-1 s=CLOSED pgs=2656 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:37.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.467+0000 7f0b29913700 1 -- 172.21.15.80:0/2923819096 shutdown_connections 2019-11-28T11:54:37.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.467+0000 7f0b29913700 1 -- 172.21.15.80:0/2923819096 wait complete. 2019-11-28T11:54:37.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.467+0000 7f0b29913700 1 -- 172.21.15.80:0/2923819096 >> 172.21.15.80:0/2923819096 conn(0x7f0b24061cf0 msgr2=0x7f0b24064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:37.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.469+0000 7f0b29913700 1 Processor -- start 2019-11-28T11:54:37.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.469+0000 7f0b29913700 1 -- start start 2019-11-28T11:54:37.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.470+0000 7f0b29913700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0b2413e5f0 0x7f0b2413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:37.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.470+0000 7f0b29913700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b2410a4e0 0x7f0b2410c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:37.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.470+0000 7f0b29913700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b241066e0 con 0x7f0b2410a070 2019-11-28T11:54:37.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.470+0000 7f0b29913700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b2410e060 con 0x7f0b2413e5f0 2019-11-28T11:54:37.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.470+0000 7f0b29913700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2410e330 con 0x7f0b2410a4e0 2019-11-28T11:54:37.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.470+0000 7f0b22ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0b2410a070 0x7f0b2410bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45022/0 (socket says 172.21.15.80:45022) 2019-11-28T11:54:37.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.470+0000 7f0b22ffd700 1 -- 172.21.15.80:0/4259288215 learned_addr learned my addr 172.21.15.80:0/4259288215 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:37.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.470+0000 7f0b23fff700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b2410a4e0 0x7f0b2410c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:37.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.470+0000 7f0b237fe700 1 --2- 172.21.15.80:0/4259288215 >> v2:172.21.15.174:3300/0 conn(0x7f0b2413e5f0 0x7f0b2413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:37.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.470+0000 7f0b1bfff700 1 -- 172.21.15.80:0/4259288215 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509993864 0 0) 0x7f0b0c001330 con 0x7f0b2410a070 2019-11-28T11:54:37.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.470+0000 7f0b1bfff700 1 -- 172.21.15.80:0/4259288215 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0afc002e80 con 0x7f0b2410a070 2019-11-28T11:54:37.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b1bfff700 1 -- 172.21.15.80:0/4259288215 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2208948185 0 0) 0x7f0b0c001420 con 0x7f0b2410a070 2019-11-28T11:54:37.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b237fe700 1 -- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b2410a4e0 msgr2=0x7f0b2410c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:37.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b237fe700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b2410a4e0 0x7f0b2410c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:37.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b237fe700 1 -- 172.21.15.80:0/4259288215 >> v1:172.21.15.80:6789/0 conn(0x7f0b2410a070 legacy=0x7f0b2410bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:37.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b237fe700 1 -- 172.21.15.80:0/4259288215 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2410e9c0 con 0x7f0b2413e5f0 2019-11-28T11:54:37.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b237fe700 1 --2- 172.21.15.80:0/4259288215 >> v2:172.21.15.174:3300/0 conn(0x7f0b2413e5f0 0x7f0b2413e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0b140103a0 tx=0x7f0b140101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b237fe700 1 --2- 172.21.15.80:0/4259288215 >> v2:172.21.15.174:3300/0 conn(0x7f0b2413e5f0 0x7f0b2413e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0b140103a0 tx=0x7f0b140101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b237fe700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b2413e5f0 0x7f0b2413e9e0 secure :-1 s=READY pgs=1600 cs=0 l=1 rx=0x7f0b140103a0 tx=0x7f0b140101d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:37.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b237fe700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b2413e5f0 0x7f0b2413e9e0 secure :-1 s=THROTTLE_DONE pgs=1600 cs=0 l=1 rx=0x7f0b140103a0 tx=0x7f0b140101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b1bfff700 1 -- 172.21.15.80:0/4259288215 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b14005560 con 0x7f0b2413e5f0 2019-11-28T11:54:37.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b237fe700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b2413e5f0 0x7f0b2413e9e0 secure :-1 s=THROTTLE_DONE pgs=1600 cs=0 l=1 rx=0x7f0b140103a0 tx=0x7f0b140101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b237fe700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b2413e5f0 0x7f0b2413e9e0 secure :-1 s=THROTTLE_DONE pgs=1600 cs=0 l=1 rx=0x7f0b140103a0 tx=0x7f0b140101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b1bfff700 1 -- 172.21.15.80:0/4259288215 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b14005180 con 0x7f0b2413e5f0 2019-11-28T11:54:37.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b29913700 1 -- 172.21.15.80:0/4259288215 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b2410ed40 con 0x7f0b2413e5f0 2019-11-28T11:54:37.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b1bfff700 1 -- 172.21.15.80:0/4259288215 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b14005750 con 0x7f0b2413e5f0 2019-11-28T11:54:37.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b29913700 1 -- 172.21.15.80:0/4259288215 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b2410e9c0 con 0x7f0b2413e5f0 2019-11-28T11:54:37.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.471+0000 7f0b237fe700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b2413e5f0 0x7f0b2413e9e0 secure :-1 s=THROTTLE_DONE pgs=1600 cs=0 l=1 rx=0x7f0b140103a0 tx=0x7f0b140101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.472+0000 7f0b1bfff700 1 -- 172.21.15.80:0/4259288215 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0b14005370 con 0x7f0b2413e5f0 2019-11-28T11:54:37.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.472+0000 7f0b237fe700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b2413e5f0 0x7f0b2413e9e0 secure :-1 s=THROTTLE_DONE pgs=1600 cs=0 l=1 rx=0x7f0b140103a0 tx=0x7f0b140101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.472+0000 7f0b1bfff700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0afc018780 0x7f0afc01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:37.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.472+0000 7f0b1bfff700 1 -- 172.21.15.80:0/4259288215 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0b140319d0 con 0x7f0b2413e5f0 2019-11-28T11:54:37.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.472+0000 7f0b22ffd700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0afc018780 0x7f0afc01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:37.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.472+0000 7f0b22ffd700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0afc018780 0x7f0afc01abf0 crc :-1 s=READY pgs=1092 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:37.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.479+0000 7f0b29913700 1 -- 172.21.15.80:0/4259288215 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b2410ed40 con 0x7f0b2413e5f0 2019-11-28T11:54:37.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.484+0000 7f0b237fe700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b2413e5f0 0x7f0b2413e9e0 secure :-1 s=THROTTLE_DONE pgs=1600 cs=0 l=1 rx=0x7f0b140103a0 tx=0x7f0b140101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.484+0000 7f0b1bfff700 1 -- 172.21.15.80:0/4259288215 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0b14007310 con 0x7f0b2413e5f0 2019-11-28T11:54:37.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.654+0000 7f0b29913700 1 -- 172.21.15.80:0/4259288215 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b2410e9c0 con 0x7f0b2413e5f0 2019-11-28T11:54:37.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.654+0000 7f0b237fe700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b2413e5f0 0x7f0b2413e9e0 secure :-1 s=THROTTLE_DONE pgs=1600 cs=0 l=1 rx=0x7f0b140103a0 tx=0x7f0b140101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:37.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.654+0000 7f0b1bfff700 1 -- 172.21.15.80:0/4259288215 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 168 v168) v1 ==== 95+0+2459 (secure 0 0 0) 0x7f0b14005d80 con 0x7f0b2413e5f0 2019-11-28T11:54:37.715 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 168 2019-11-28T11:54:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:37.717 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":168,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7754,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3904352671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3904352671},{"type":"v1","addr":"172.21.15.80:6835","nonce":3904352671}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":168},{"gid":11703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3665230874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3665230874},{"type":"v1","addr":"172.21.15.80:6834","nonce":3665230874}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":168}],"filesystems":[{"mdsmap":{"epoch":167,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:54:29.202039+0000","modified":"2019-11-28T11:54:32.779460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10972},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10972":{"gid":10972,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/2209008547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2209008547},{"type":"v1","addr":"172.21.15.174:6835","nonce":2209008547}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2019-11-28T11:54:37.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.657+0000 7f0b29913700 1 -- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0afc018780 msgr2=0x7f0afc01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:37.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.657+0000 7f0b29913700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0afc018780 0x7f0afc01abf0 crc :-1 s=READY pgs=1092 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:37.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.657+0000 7f0b29913700 1 -- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b2413e5f0 msgr2=0x7f0b2413e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:37.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.657+0000 7f0b29913700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b2413e5f0 0x7f0b2413e9e0 secure :-1 s=READY pgs=1600 cs=0 l=1 rx=0x7f0b140103a0 tx=0x7f0b140101d0).stop 2019-11-28T11:54:37.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.657+0000 7f0b29913700 1 -- 172.21.15.80:0/4259288215 shutdown_connections 2019-11-28T11:54:37.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.657+0000 7f0b29913700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0afc018780 0x7f0afc01abf0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:37.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.657+0000 7f0b29913700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b2410a4e0 0x7f0b2410c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:37.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.657+0000 7f0b29913700 1 --2- 172.21.15.80:0/4259288215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b2413e5f0 0x7f0b2413e9e0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:37.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.657+0000 7f0b29913700 1 -- 172.21.15.80:0/4259288215 shutdown_connections 2019-11-28T11:54:37.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.657+0000 7f0b29913700 1 -- 172.21.15.80:0/4259288215 wait complete. 2019-11-28T11:54:37.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:37.657+0000 7f0b29913700 1 -- 172.21.15.80:0/4259288215 >> 172.21.15.80:0/4259288215 conn(0x7f0b2413d620 msgr2=0x7f0b2413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:38.027 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 10972}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 32, u'failed': [], u'epoch': 167, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [33], u'info': {u'gid_10972': {u'export_targets': [], u'name': u'c', u'incarnation': 166, u'state_seq': 2, u'state': u'up:active', u'gid': 10972, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2209008547, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2209008547, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2209008547'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:54:29.202039+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:54:32.779460+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:54:38.027 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:54:38.028 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:54:38.161 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:54:38.161 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:54:38.161 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:54:38.161 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 10972, 2019-11-28T11:54:38.161 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:54:38.161 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:54:38.162 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 6.3281445319999996, 2019-11-28T11:54:38.162 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 167, 2019-11-28T11:54:38.162 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 203, 2019-11-28T11:54:38.162 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 203, 2019-11-28T11:54:38.162 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 6.4633295180000001 2019-11-28T11:54:38.170 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:54:38.175 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 10972, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.3281445319999996, "mdsmap_epoch": 167, "osdmap_epoch": 203, "osdmap_epoch_barrier": 203, "uptime": 6.4633295180000001 } 2019-11-28T11:54:38.194 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:54:38.195 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:54:38.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:54:38.196 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:54:38.278 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:54:38.278 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:54:38.401 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:54:38.401 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:54:38.401 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:54:38.401 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:54:38.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:54:38.402 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:54:38.491 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:54:38.612 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:54:38.613 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:54:38.613 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:54:38.617 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:54:38.618 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:54:38.740 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:54:38.740 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:54:38.740 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:54:38.746 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:54:38.746 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:38.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.810+0000 7f439471d700 1 Processor -- start 2019-11-28T11:54:38.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.810+0000 7f439471d700 1 -- start start 2019-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.811+0000 7f439471d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f438c06d120 0x7f438c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.811+0000 7f439471d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c06d5a0 con 0x7f438c06c490 2019-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.811+0000 7f439471d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c06db00 con 0x7f438c06c0a0 2019-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.811+0000 7f439471d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438c06fd60 con 0x7f438c06d120 2019-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.811+0000 7f43934bb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f438c06d120 0x7f438c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.811+0000 7f43934bb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f438c06d120 0x7f438c165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45714/0 (socket says 172.21.15.80:45714) 2019-11-28T11:54:38.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.811+0000 7f43924b9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f438c06c490 0x7f438c06c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45032/0 (socket says 172.21.15.80:45032) 2019-11-28T11:54:38.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.811+0000 7f43934bb700 1 -- 172.21.15.80:0/3371529716 learned_addr learned my addr 172.21.15.80:0/3371529716 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:38.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.811+0000 7f43934bb700 1 -- 172.21.15.80:0/3371529716 >> v1:172.21.15.174:6789/0 conn(0x7f438c06c0a0 legacy=0x7f438c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:38.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.811+0000 7f43934bb700 1 -- 172.21.15.80:0/3371529716 >> v1:172.21.15.80:6789/0 conn(0x7f438c06c490 legacy=0x7f438c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:38.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.811+0000 7f43934bb700 1 -- 172.21.15.80:0/3371529716 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c0706c0 con 0x7f438c06d120 2019-11-28T11:54:38.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.811+0000 7f4391cb8700 1 -- 172.21.15.80:0/3371529716 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906825347 0 0) 0x7f4374001480 con 0x7f438c06c490 2019-11-28T11:54:38.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.811+0000 7f43934bb700 1 --2- 172.21.15.80:0/3371529716 >> v2:172.21.15.80:3300/0 conn(0x7f438c06d120 0x7f438c165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f438400f730 tx=0x7f438400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:38.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.811+0000 7f43934bb700 1 --2- 172.21.15.80:0/3371529716 >> v2:172.21.15.80:3300/0 conn(0x7f438c06d120 0x7f438c165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f438400f730 tx=0x7f438400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:38.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.811+0000 7f43934bb700 1 --2- 172.21.15.80:0/3371529716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f438c06d120 0x7f438c165d80 secure :-1 s=READY pgs=2659 cs=0 l=1 rx=0x7f438400f730 tx=0x7f438400fad0).ready entity=mon.0 client_cookie=39775364ac2b8871 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:38.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.812+0000 7f43934bb700 1 --2- 172.21.15.80:0/3371529716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f438c06d120 0x7f438c165d80 secure :-1 s=THROTTLE_DONE pgs=2659 cs=0 l=1 rx=0x7f438400f730 tx=0x7f438400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:38.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.812+0000 7f4391cb8700 1 -- 172.21.15.80:0/3371529716 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43840010e0 con 0x7f438c06d120 2019-11-28T11:54:38.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.812+0000 7f43934bb700 1 --2- 172.21.15.80:0/3371529716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f438c06d120 0x7f438c165d80 secure :-1 s=THROTTLE_DONE pgs=2659 cs=0 l=1 rx=0x7f438400f730 tx=0x7f438400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:38.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.812+0000 7f4391cb8700 1 -- 172.21.15.80:0/3371529716 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4384000a70 con 0x7f438c06d120 2019-11-28T11:54:38.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.812+0000 7f43934bb700 1 --2- 172.21.15.80:0/3371529716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f438c06d120 0x7f438c165d80 secure :-1 s=THROTTLE_DONE pgs=2659 cs=0 l=1 rx=0x7f438400f730 tx=0x7f438400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:38.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.812+0000 7f4391cb8700 1 -- 172.21.15.80:0/3371529716 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43840012d0 con 0x7f438c06d120 2019-11-28T11:54:38.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.812+0000 7f439471d700 1 -- 172.21.15.80:0/3371529716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f438c06d120 msgr2=0x7f438c165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:38.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.812+0000 7f439471d700 1 --2- 172.21.15.80:0/3371529716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f438c06d120 0x7f438c165d80 secure :-1 s=READY pgs=2659 cs=0 l=1 rx=0x7f438400f730 tx=0x7f438400fad0).stop 2019-11-28T11:54:38.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.812+0000 7f439471d700 1 -- 172.21.15.80:0/3371529716 shutdown_connections 2019-11-28T11:54:38.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.812+0000 7f439471d700 1 --2- 172.21.15.80:0/3371529716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f438c06d120 0x7f438c165d80 unknown :-1 s=CLOSED pgs=2659 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:38.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.812+0000 7f439471d700 1 -- 172.21.15.80:0/3371529716 shutdown_connections 2019-11-28T11:54:38.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.812+0000 7f439471d700 1 -- 172.21.15.80:0/3371529716 wait complete. 2019-11-28T11:54:38.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.813+0000 7f439471d700 1 -- 172.21.15.80:0/3371529716 >> 172.21.15.80:0/3371529716 conn(0x7f438c061cf0 msgr2=0x7f438c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:38.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.815+0000 7f439471d700 1 Processor -- start 2019-11-28T11:54:38.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.815+0000 7f439471d700 1 -- start start 2019-11-28T11:54:38.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f439471d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f438c13f580 0x7f438c115730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:38.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f439471d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c13fc50 con 0x7f438c115c70 2019-11-28T11:54:38.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f439471d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c122ef0 con 0x7f438c122660 2019-11-28T11:54:38.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f439471d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c124220 con 0x7f438c13f580 2019-11-28T11:54:38.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f43924b9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f438c115c70 0x7f438c121e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45036/0 (socket says 172.21.15.80:45036) 2019-11-28T11:54:38.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f43924b9700 1 -- 172.21.15.80:0/126855347 learned_addr learned my addr 172.21.15.80:0/126855347 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:38.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f4392cba700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f438c13f580 0x7f438c115730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:38.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f438b7fe700 1 -- 172.21.15.80:0/126855347 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031039627 0 0) 0x7f43740014d0 con 0x7f438c115c70 2019-11-28T11:54:38.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f438b7fe700 1 -- 172.21.15.80:0/126855347 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4370002e80 con 0x7f438c115c70 2019-11-28T11:54:38.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f438b7fe700 1 -- 172.21.15.80:0/126855347 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089907307 0 0) 0x7f4384000940 con 0x7f438c122660 2019-11-28T11:54:38.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f438b7fe700 1 -- 172.21.15.80:0/126855347 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43700030b0 con 0x7f438c122660 2019-11-28T11:54:38.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f438b7fe700 1 -- 172.21.15.80:0/126855347 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2513679793 0 0) 0x7f4374001680 con 0x7f438c115c70 2019-11-28T11:54:38.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f438b7fe700 1 -- 172.21.15.80:0/126855347 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f43700033c0 con 0x7f438c115c70 2019-11-28T11:54:38.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f438b7fe700 1 -- 172.21.15.80:0/126855347 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f4374001c50 con 0x7f438c115c70 2019-11-28T11:54:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f4392cba700 1 -- 172.21.15.80:0/126855347 >> v1:172.21.15.174:6789/0 conn(0x7f438c122660 legacy=0x7f438c168a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f4392cba700 1 -- 172.21.15.80:0/126855347 >> v1:172.21.15.80:6789/0 conn(0x7f438c115c70 legacy=0x7f438c121e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f4392cba700 1 -- 172.21.15.80:0/126855347 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c112eb0 con 0x7f438c13f580 2019-11-28T11:54:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f4392cba700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f438c13f580 0x7f438c115730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f437c0103a0 tx=0x7f437c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.816+0000 7f4392cba700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f438c13f580 0x7f438c115730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f437c0103a0 tx=0x7f437c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.817+0000 7f4392cba700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f438c13f580 0x7f438c115730 secure :-1 s=READY pgs=383 cs=0 l=1 rx=0x7f437c0103a0 tx=0x7f437c010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:38.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.817+0000 7f4392cba700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f438c13f580 0x7f438c115730 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7f437c0103a0 tx=0x7f437c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:38.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.817+0000 7f438b7fe700 1 -- 172.21.15.80:0/126855347 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f437c000960 con 0x7f438c13f580 2019-11-28T11:54:38.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.817+0000 7f4392cba700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f438c13f580 0x7f438c115730 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7f437c0103a0 tx=0x7f437c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:38.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.817+0000 7f4392cba700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f438c13f580 0x7f438c115730 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7f437c0103a0 tx=0x7f437c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:38.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.817+0000 7f438b7fe700 1 -- 172.21.15.80:0/126855347 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c00eef0 con 0x7f438c13f580 2019-11-28T11:54:38.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.817+0000 7f438b7fe700 1 -- 172.21.15.80:0/126855347 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f437c00f0e0 con 0x7f438c13f580 2019-11-28T11:54:38.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.817+0000 7f439471d700 1 -- 172.21.15.80:0/126855347 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438c113230 con 0x7f438c13f580 2019-11-28T11:54:38.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.817+0000 7f439471d700 1 -- 172.21.15.80:0/126855347 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c112eb0 con 0x7f438c13f580 2019-11-28T11:54:38.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.817+0000 7f4392cba700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f438c13f580 0x7f438c115730 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7f437c0103a0 tx=0x7f437c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:38.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.817+0000 7f438b7fe700 1 -- 172.21.15.80:0/126855347 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f437c00f2f0 con 0x7f438c13f580 2019-11-28T11:54:38.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.817+0000 7f4392cba700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f438c13f580 0x7f438c115730 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7f437c0103a0 tx=0x7f437c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:38.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.817+0000 7f438b7fe700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f43700187a0 0x7f437001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:38.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.817+0000 7f438b7fe700 1 -- 172.21.15.80:0/126855347 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f437c031a60 con 0x7f438c13f580 2019-11-28T11:54:38.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.818+0000 7f43924b9700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f43700187a0 0x7f437001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:38.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.818+0000 7f43924b9700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f43700187a0 0x7f437001abf0 crc :-1 s=READY pgs=1093 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:38.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.825+0000 7f439471d700 1 -- 172.21.15.80:0/126855347 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438c113230 con 0x7f438c13f580 2019-11-28T11:54:38.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.829+0000 7f4392cba700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f438c13f580 0x7f438c115730 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7f437c0103a0 tx=0x7f437c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:38.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:38.829+0000 7f438b7fe700 1 -- 172.21.15.80:0/126855347 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f437c00efd0 con 0x7f438c13f580 2019-11-28T11:54:39.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:39.001+0000 7f439471d700 1 -- 172.21.15.80:0/126855347 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f438c112eb0 con 0x7f438c13f580 2019-11-28T11:54:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:39.002+0000 7f4392cba700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f438c13f580 0x7f438c115730 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7f437c0103a0 tx=0x7f437c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:39.002+0000 7f438b7fe700 1 -- 172.21.15.80:0/126855347 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 168 v168) v1 ==== 95+0+2459 (secure 0 0 0) 0x7f437c00f1e0 con 0x7f438c13f580 2019-11-28T11:54:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 168 2019-11-28T11:54:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:39.061 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":168,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7754,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3904352671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3904352671},{"type":"v1","addr":"172.21.15.80:6835","nonce":3904352671}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":168},{"gid":11703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3665230874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3665230874},{"type":"v1","addr":"172.21.15.80:6834","nonce":3665230874}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":168}],"filesystems":[{"mdsmap":{"epoch":167,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:54:29.202039+0000","modified":"2019-11-28T11:54:32.779460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10972},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10972":{"gid":10972,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/2209008547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2209008547},{"type":"v1","addr":"172.21.15.174:6835","nonce":2209008547}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2019-11-28T11:54:39.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:39.004+0000 7f439471d700 1 -- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f43700187a0 msgr2=0x7f437001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:39.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:39.004+0000 7f439471d700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f43700187a0 0x7f437001abf0 crc :-1 s=READY pgs=1093 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:39.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:39.004+0000 7f439471d700 1 -- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f438c13f580 msgr2=0x7f438c115730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:39.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:39.004+0000 7f439471d700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f438c13f580 0x7f438c115730 secure :-1 s=READY pgs=383 cs=0 l=1 rx=0x7f437c0103a0 tx=0x7f437c010740).stop 2019-11-28T11:54:39.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:39.004+0000 7f439471d700 1 -- 172.21.15.80:0/126855347 shutdown_connections 2019-11-28T11:54:39.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:39.004+0000 7f439471d700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f43700187a0 0x7f437001abf0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:39.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:39.004+0000 7f439471d700 1 --2- 172.21.15.80:0/126855347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f438c13f580 0x7f438c115730 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:39.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:39.004+0000 7f439471d700 1 -- 172.21.15.80:0/126855347 shutdown_connections 2019-11-28T11:54:39.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:39.004+0000 7f439471d700 1 -- 172.21.15.80:0/126855347 wait complete. 2019-11-28T11:54:39.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:39.004+0000 7f439471d700 1 -- 172.21.15.80:0/126855347 >> 172.21.15.80:0/126855347 conn(0x7f438c1426c0 msgr2=0x7f438c110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:39.072 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch background_file 2019-11-28T11:54:39.136 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:54:39.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:54:39.137 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T11:54:41.740 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:54:41.745 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:54:41.789 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:54:41.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.855+0000 7f8c150fd700 1 Processor -- start 2019-11-28T11:54:41.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.855+0000 7f8c150fd700 1 -- start start 2019-11-28T11:54:41.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.856+0000 7f8c150fd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1006c490 0x7f8c1006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:41.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.856+0000 7f8c150fd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8c1006ce60 0x7f8c10164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:41.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.856+0000 7f8c150fd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1006db00 con 0x7f8c1006c0a0 2019-11-28T11:54:41.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.856+0000 7f8c150fd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1006fd60 con 0x7f8c1006ce60 2019-11-28T11:54:41.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.856+0000 7f8c150fd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c10070030 con 0x7f8c1006c490 2019-11-28T11:54:41.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.856+0000 7f8c148fc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8c1006ce60 0x7f8c10164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:41.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.856+0000 7f8c148fc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8c1006ce60 0x7f8c10164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45728/0 (socket says 172.21.15.80:45728) 2019-11-28T11:54:41.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.856+0000 7f8c148fc700 1 -- 172.21.15.80:0/216571377 learned_addr learned my addr 172.21.15.80:0/216571377 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:41.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.856+0000 7f8c0ed9d700 1 --2- 172.21.15.80:0/216571377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1006c490 0x7f8c1006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:41.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.857+0000 7f8c148fc700 1 -- 172.21.15.80:0/216571377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1006c490 msgr2=0x7f8c1006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:41.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.857+0000 7f8c148fc700 1 --2- 172.21.15.80:0/216571377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1006c490 0x7f8c1006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:41.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.857+0000 7f8c148fc700 1 -- 172.21.15.80:0/216571377 >> v1:172.21.15.174:6789/0 conn(0x7f8c1006c0a0 legacy=0x7f8c10072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:41.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.857+0000 7f8c148fc700 1 -- 172.21.15.80:0/216571377 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c100706c0 con 0x7f8c1006ce60 2019-11-28T11:54:41.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.857+0000 7f8c148fc700 1 --2- 172.21.15.80:0/216571377 >> v2:172.21.15.80:3300/0 conn(0x7f8c1006ce60 0x7f8c10164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8c0800f6b0 tx=0x7f8c0800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:41.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.857+0000 7f8c148fc700 1 --2- 172.21.15.80:0/216571377 >> v2:172.21.15.80:3300/0 conn(0x7f8c1006ce60 0x7f8c10164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8c0800f6b0 tx=0x7f8c0800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:41.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.857+0000 7f8c148fc700 1 --2- 172.21.15.80:0/216571377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c1006ce60 0x7f8c10164d70 secure :-1 s=READY pgs=2661 cs=0 l=1 rx=0x7f8c0800f6b0 tx=0x7f8c0800fa50).ready entity=mon.0 client_cookie=90294cd04e414530 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:41.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.857+0000 7f8c148fc700 1 --2- 172.21.15.80:0/216571377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c1006ce60 0x7f8c10164d70 secure :-1 s=THROTTLE_DONE pgs=2661 cs=0 l=1 rx=0x7f8c0800f6b0 tx=0x7f8c0800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:41.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.857+0000 7f8c0e59c700 1 -- 172.21.15.80:0/216571377 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c08000a70 con 0x7f8c1006ce60 2019-11-28T11:54:41.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.857+0000 7f8c148fc700 1 --2- 172.21.15.80:0/216571377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c1006ce60 0x7f8c10164d70 secure :-1 s=THROTTLE_DONE pgs=2661 cs=0 l=1 rx=0x7f8c0800f6b0 tx=0x7f8c0800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:41.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.857+0000 7f8c148fc700 1 --2- 172.21.15.80:0/216571377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c1006ce60 0x7f8c10164d70 secure :-1 s=THROTTLE_DONE pgs=2661 cs=0 l=1 rx=0x7f8c0800f6b0 tx=0x7f8c0800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:41.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.857+0000 7f8c0e59c700 1 -- 172.21.15.80:0/216571377 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c08000a70 con 0x7f8c1006ce60 2019-11-28T11:54:41.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.857+0000 7f8c0e59c700 1 -- 172.21.15.80:0/216571377 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c080012d0 con 0x7f8c1006ce60 2019-11-28T11:54:41.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.857+0000 7f8c150fd700 1 -- 172.21.15.80:0/216571377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c1006ce60 msgr2=0x7f8c10164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:41.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.857+0000 7f8c150fd700 1 --2- 172.21.15.80:0/216571377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c1006ce60 0x7f8c10164d70 secure :-1 s=READY pgs=2661 cs=0 l=1 rx=0x7f8c0800f6b0 tx=0x7f8c0800fa50).stop 2019-11-28T11:54:41.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.858+0000 7f8c150fd700 1 -- 172.21.15.80:0/216571377 shutdown_connections 2019-11-28T11:54:41.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.858+0000 7f8c150fd700 1 --2- 172.21.15.80:0/216571377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c1006ce60 0x7f8c10164d70 unknown :-1 s=CLOSED pgs=2661 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:41.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.858+0000 7f8c150fd700 1 --2- 172.21.15.80:0/216571377 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1006c490 0x7f8c1006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:41.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.858+0000 7f8c150fd700 1 -- 172.21.15.80:0/216571377 shutdown_connections 2019-11-28T11:54:41.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.858+0000 7f8c150fd700 1 -- 172.21.15.80:0/216571377 wait complete. 2019-11-28T11:54:41.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.858+0000 7f8c150fd700 1 -- 172.21.15.80:0/216571377 >> 172.21.15.80:0/216571377 conn(0x7f8c10061cf0 msgr2=0x7f8c10064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:41.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.860+0000 7f8c150fd700 1 Processor -- start 2019-11-28T11:54:41.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.860+0000 7f8c150fd700 1 -- start start 2019-11-28T11:54:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.861+0000 7f8c150fd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8c1015fdf0 0x7f8c1012b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.861+0000 7f8c150fd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1012b8a0 0x7f8c1013e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.861+0000 7f8c150fd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c10139e00 con 0x7f8c1013e860 2019-11-28T11:54:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.861+0000 7f8c150fd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c10108820 con 0x7f8c1015fdf0 2019-11-28T11:54:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.861+0000 7f8c150fd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c10108af0 con 0x7f8c1012b8a0 2019-11-28T11:54:41.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.861+0000 7f8c0f59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8c1015fdf0 0x7f8c1012b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:41.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.861+0000 7f8c0ed9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1012b8a0 0x7f8c1013e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.861+0000 7f8c0f59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8c1015fdf0 0x7f8c1012b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:60620/0 (socket says 172.21.15.80:60620) 2019-11-28T11:54:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.861+0000 7f8c0f59e700 1 -- 172.21.15.80:0/1781318451 learned_addr learned my addr 172.21.15.80:0/1781318451 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c0ed9d700 1 -- 172.21.15.80:0/1781318451 >> v2:172.21.15.174:3300/0 conn(0x7f8c1015fdf0 msgr2=0x7f8c1012b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c0ed9d700 1 --2- 172.21.15.80:0/1781318451 >> v2:172.21.15.174:3300/0 conn(0x7f8c1015fdf0 0x7f8c1012b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:41.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c0ed9d700 1 -- 172.21.15.80:0/1781318451 >> v1:172.21.15.174:6789/0 conn(0x7f8c1013e860 legacy=0x7f8c1012a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:41.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c0ed9d700 1 -- 172.21.15.80:0/1781318451 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1010a8c0 con 0x7f8c1012b8a0 2019-11-28T11:54:41.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c07fff700 1 -- 172.21.15.80:0/1781318451 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038176219 0 0) 0x7f8c08000940 con 0x7f8c1013e860 2019-11-28T11:54:41.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c0f59e700 1 --2- 172.21.15.80:0/1781318451 >> v2:172.21.15.174:3300/0 conn(0x7f8c1015fdf0 0x7f8c1012b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:41.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c0ed9d700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1012b8a0 0x7f8c1013e320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8bf80103c0 tx=0x7f8bf8010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:41.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c0ed9d700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1012b8a0 0x7f8c1013e320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8bf80103c0 tx=0x7f8bf8010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:41.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c0ed9d700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1012b8a0 0x7f8c1013e320 secure :-1 s=READY pgs=384 cs=0 l=1 rx=0x7f8bf80103c0 tx=0x7f8bf8010760).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:41.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c0ed9d700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1012b8a0 0x7f8c1013e320 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f8bf80103c0 tx=0x7f8bf8010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:41.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c07fff700 1 -- 172.21.15.80:0/1781318451 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bf800f1e0 con 0x7f8c1012b8a0 2019-11-28T11:54:41.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c0ed9d700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1012b8a0 0x7f8c1013e320 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f8bf80103c0 tx=0x7f8bf8010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:41.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c0ed9d700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1012b8a0 0x7f8c1013e320 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f8bf80103c0 tx=0x7f8bf8010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:41.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c07fff700 1 -- 172.21.15.80:0/1781318451 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf800ee00 con 0x7f8c1012b8a0 2019-11-28T11:54:41.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c150fd700 1 -- 172.21.15.80:0/1781318451 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1010a8c0 con 0x7f8c1012b8a0 2019-11-28T11:54:41.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c07fff700 1 -- 172.21.15.80:0/1781318451 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bf800f860 con 0x7f8c1012b8a0 2019-11-28T11:54:41.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c150fd700 1 -- 172.21.15.80:0/1781318451 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1010a8c0 con 0x7f8c1012b8a0 2019-11-28T11:54:41.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.862+0000 7f8c0ed9d700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1012b8a0 0x7f8c1013e320 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f8bf80103c0 tx=0x7f8bf8010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:41.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.863+0000 7f8c07fff700 1 -- 172.21.15.80:0/1781318451 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8bf800f410 con 0x7f8c1012b8a0 2019-11-28T11:54:41.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.863+0000 7f8c0ed9d700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1012b8a0 0x7f8c1013e320 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f8bf80103c0 tx=0x7f8bf8010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:41.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.863+0000 7f8c07fff700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bf4018730 0x7f8bf401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:41.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.863+0000 7f8c07fff700 1 -- 172.21.15.80:0/1781318451 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8bf80319f0 con 0x7f8c1012b8a0 2019-11-28T11:54:41.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.863+0000 7f8c0f59e700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bf4018730 0x7f8bf401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:41.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.863+0000 7f8c0f59e700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bf4018730 0x7f8bf401abc0 crc :-1 s=READY pgs=1094 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:41.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.870+0000 7f8c150fd700 1 -- 172.21.15.80:0/1781318451 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c10109180 con 0x7f8c1012b8a0 2019-11-28T11:54:41.936 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.874+0000 7f8c0ed9d700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1012b8a0 0x7f8c1013e320 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f8bf80103c0 tx=0x7f8bf8010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:41.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:41.874+0000 7f8c07fff700 1 -- 172.21.15.80:0/1781318451 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8bf800f200 con 0x7f8c1012b8a0 2019-11-28T11:54:42.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.050+0000 7f8c150fd700 1 -- 172.21.15.80:0/1781318451 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c10109500 con 0x7f8c1012b8a0 2019-11-28T11:54:42.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.052+0000 7f8c0ed9d700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1012b8a0 0x7f8c1013e320 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f8bf80103c0 tx=0x7f8bf8010760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.052+0000 7f8c07fff700 1 -- 172.21.15.80:0/1781318451 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f8bf800f410 con 0x7f8c1012b8a0 2019-11-28T11:54:42.111 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:42.111 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":203,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:54:30.203239+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:54:27.540791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":33,"pool_name":"cephfs_data","create_time":"2019-11-28T11:54:28.225144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:54:42.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.055+0000 7f8c150fd700 1 -- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bf4018730 msgr2=0x7f8bf401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.055+0000 7f8c150fd700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bf4018730 0x7f8bf401abc0 crc :-1 s=READY pgs=1094 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:42.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.055+0000 7f8c150fd700 1 -- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1012b8a0 msgr2=0x7f8c1013e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.055+0000 7f8c150fd700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1012b8a0 0x7f8c1013e320 secure :-1 s=READY pgs=384 cs=0 l=1 rx=0x7f8bf80103c0 tx=0x7f8bf8010760).stop 2019-11-28T11:54:42.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.055+0000 7f8c150fd700 1 -- 172.21.15.80:0/1781318451 shutdown_connections 2019-11-28T11:54:42.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.055+0000 7f8c150fd700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8bf4018730 0x7f8bf401abc0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.055+0000 7f8c150fd700 1 --2- 172.21.15.80:0/1781318451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1012b8a0 0x7f8c1013e320 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.055+0000 7f8c150fd700 1 --2- 172.21.15.80:0/1781318451 >> v2:172.21.15.174:3300/0 conn(0x7f8c1015fdf0 0x7f8c1012b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.055+0000 7f8c150fd700 1 -- 172.21.15.80:0/1781318451 shutdown_connections 2019-11-28T11:54:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.055+0000 7f8c150fd700 1 -- 172.21.15.80:0/1781318451 wait complete. 2019-11-28T11:54:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.055+0000 7f8c150fd700 1 -- 172.21.15.80:0/1781318451 >> 172.21.15.80:0/1781318451 conn(0x7f8c10127dc0 msgr2=0x7f8c10141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:42.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:54:27.540791+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 32, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'202', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:54:28.225144+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 33, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'203', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:54:42.124 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:54:42.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.190+0000 7fe3acbd3700 1 Processor -- start 2019-11-28T11:54:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.191+0000 7fe3acbd3700 1 -- start start 2019-11-28T11:54:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3acbd3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3a815ed10 0x7fe3a815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3acbd3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a8073020 0x7fe3a8071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3acbd3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a806db60 con 0x7fe3a80734b0 2019-11-28T11:54:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3acbd3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a806fe00 con 0x7fe3a815ed10 2019-11-28T11:54:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3acbd3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a80700d0 con 0x7fe3a8073020 2019-11-28T11:54:42.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a6d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3a815ed10 0x7fe3a815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:42.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe3a80734b0 0x7fe3a80723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45058/0 (socket says 172.21.15.80:45058) 2019-11-28T11:54:42.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a6d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3a815ed10 0x7fe3a815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45740/0 (socket says 172.21.15.80:45740) 2019-11-28T11:54:42.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a759e700 1 -- 172.21.15.80:0/3789964166 learned_addr learned my addr 172.21.15.80:0/3789964166 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:42.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a659c700 1 --2- 172.21.15.80:0/3789964166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a8073020 0x7fe3a8071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:42.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a6d9d700 1 -- 172.21.15.80:0/3789964166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a8073020 msgr2=0x7fe3a8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:42.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a6d9d700 1 --2- 172.21.15.80:0/3789964166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a8073020 0x7fe3a8071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:42.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a6d9d700 1 -- 172.21.15.80:0/3789964166 >> v1:172.21.15.80:6789/0 conn(0x7fe3a80734b0 legacy=0x7fe3a80723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a6d9d700 1 -- 172.21.15.80:0/3789964166 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a8070760 con 0x7fe3a815ed10 2019-11-28T11:54:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a5d9b700 1 -- 172.21.15.80:0/3789964166 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811534072 0 0) 0x7fe3a0001150 con 0x7fe3a80734b0 2019-11-28T11:54:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a6d9d700 1 --2- 172.21.15.80:0/3789964166 >> v2:172.21.15.80:3300/0 conn(0x7fe3a815ed10 0x7fe3a815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe39000b2d0 tx=0x7fe39000ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a6d9d700 1 --2- 172.21.15.80:0/3789964166 >> v2:172.21.15.80:3300/0 conn(0x7fe3a815ed10 0x7fe3a815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe39000b2d0 tx=0x7fe39000ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a6d9d700 1 --2- 172.21.15.80:0/3789964166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a815ed10 0x7fe3a815f100 secure :-1 s=READY pgs=2663 cs=0 l=1 rx=0x7fe39000b2d0 tx=0x7fe39000ba60).ready entity=mon.0 client_cookie=78903450247614af server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a6d9d700 1 --2- 172.21.15.80:0/3789964166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a815ed10 0x7fe3a815f100 secure :-1 s=THROTTLE_DONE pgs=2663 cs=0 l=1 rx=0x7fe39000b2d0 tx=0x7fe39000ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a5d9b700 1 -- 172.21.15.80:0/3789964166 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe390007590 con 0x7fe3a815ed10 2019-11-28T11:54:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a6d9d700 1 --2- 172.21.15.80:0/3789964166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a815ed10 0x7fe3a815f100 secure :-1 s=THROTTLE_DONE pgs=2663 cs=0 l=1 rx=0x7fe39000b2d0 tx=0x7fe39000ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a6d9d700 1 --2- 172.21.15.80:0/3789964166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a815ed10 0x7fe3a815f100 secure :-1 s=THROTTLE_DONE pgs=2663 cs=0 l=1 rx=0x7fe39000b2d0 tx=0x7fe39000ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a5d9b700 1 -- 172.21.15.80:0/3789964166 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe390009d30 con 0x7fe3a815ed10 2019-11-28T11:54:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.192+0000 7fe3a5d9b700 1 -- 172.21.15.80:0/3789964166 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe39000a400 con 0x7fe3a815ed10 2019-11-28T11:54:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.193+0000 7fe3acbd3700 1 -- 172.21.15.80:0/3789964166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a815ed10 msgr2=0x7fe3a815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.193+0000 7fe3acbd3700 1 --2- 172.21.15.80:0/3789964166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a815ed10 0x7fe3a815f100 secure :-1 s=READY pgs=2663 cs=0 l=1 rx=0x7fe39000b2d0 tx=0x7fe39000ba60).stop 2019-11-28T11:54:42.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.193+0000 7fe3acbd3700 1 -- 172.21.15.80:0/3789964166 shutdown_connections 2019-11-28T11:54:42.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.193+0000 7fe3acbd3700 1 --2- 172.21.15.80:0/3789964166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a8073020 0x7fe3a8071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:42.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.193+0000 7fe3acbd3700 1 --2- 172.21.15.80:0/3789964166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3a815ed10 0x7fe3a815f100 unknown :-1 s=CLOSED pgs=2663 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:42.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.193+0000 7fe3acbd3700 1 -- 172.21.15.80:0/3789964166 shutdown_connections 2019-11-28T11:54:42.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.193+0000 7fe3acbd3700 1 -- 172.21.15.80:0/3789964166 wait complete. 2019-11-28T11:54:42.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.193+0000 7fe3acbd3700 1 -- 172.21.15.80:0/3789964166 >> 172.21.15.80:0/3789964166 conn(0x7fe3a8061d20 msgr2=0x7fe3a80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:42.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.196+0000 7fe3acbd3700 1 Processor -- start 2019-11-28T11:54:42.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.196+0000 7fe3acbd3700 1 -- start start 2019-11-28T11:54:42.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3acbd3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a810ed60 0x7fe3a810f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:42.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3acbd3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a810c250 con 0x7fe3a810f730 2019-11-28T11:54:42.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3acbd3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a810c6d0 con 0x7fe3a810e970 2019-11-28T11:54:42.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3acbd3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a810e430 con 0x7fe3a810ed60 2019-11-28T11:54:42.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3a759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe3a810f730 0x7fe3a8167d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45066/0 (socket says 172.21.15.80:45066) 2019-11-28T11:54:42.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3a759e700 1 -- 172.21.15.80:0/3057974973 learned_addr learned my addr 172.21.15.80:0/3057974973 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:42.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3a659c700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a810ed60 0x7fe3a810f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:42.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe39f7fe700 1 -- 172.21.15.80:0/3057974973 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756431798 0 0) 0x7fe3a0000f40 con 0x7fe3a810f730 2019-11-28T11:54:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe39f7fe700 1 -- 172.21.15.80:0/3057974973 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe380002e80 con 0x7fe3a810f730 2019-11-28T11:54:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe39f7fe700 1 -- 172.21.15.80:0/3057974973 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036468929 0 0) 0x7fe39000afa0 con 0x7fe3a810e970 2019-11-28T11:54:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe39f7fe700 1 -- 172.21.15.80:0/3057974973 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3800030b0 con 0x7fe3a810e970 2019-11-28T11:54:42.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3a659c700 1 -- 172.21.15.80:0/3057974973 >> v1:172.21.15.174:6789/0 conn(0x7fe3a810e970 legacy=0x7fe3a81087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3a659c700 1 -- 172.21.15.80:0/3057974973 >> v1:172.21.15.80:6789/0 conn(0x7fe3a810f730 legacy=0x7fe3a8167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3a659c700 1 -- 172.21.15.80:0/3057974973 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a8105ef0 con 0x7fe3a810ed60 2019-11-28T11:54:42.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3a659c700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a810ed60 0x7fe3a810f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe398010390 tx=0x7fe398010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3a659c700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a810ed60 0x7fe3a810f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe398010390 tx=0x7fe398010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3a659c700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a810ed60 0x7fe3a810f1f0 secure :-1 s=READY pgs=385 cs=0 l=1 rx=0x7fe398010390 tx=0x7fe398010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:42.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3a659c700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a810ed60 0x7fe3a810f1f0 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7fe398010390 tx=0x7fe398010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe39f7fe700 1 -- 172.21.15.80:0/3057974973 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe398000940 con 0x7fe3a810ed60 2019-11-28T11:54:42.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3a659c700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a810ed60 0x7fe3a810f1f0 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7fe398010390 tx=0x7fe398010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe39f7fe700 1 -- 172.21.15.80:0/3057974973 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398009c60 con 0x7fe3a810ed60 2019-11-28T11:54:42.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3a659c700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a810ed60 0x7fe3a810f1f0 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7fe398010390 tx=0x7fe398010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3acbd3700 1 -- 172.21.15.80:0/3057974973 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a8106270 con 0x7fe3a810ed60 2019-11-28T11:54:42.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe39f7fe700 1 -- 172.21.15.80:0/3057974973 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe398009e50 con 0x7fe3a810ed60 2019-11-28T11:54:42.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.197+0000 7fe3acbd3700 1 -- 172.21.15.80:0/3057974973 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a8105ef0 con 0x7fe3a810ed60 2019-11-28T11:54:42.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.198+0000 7fe3a659c700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a810ed60 0x7fe3a810f1f0 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7fe398010390 tx=0x7fe398010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.198+0000 7fe39f7fe700 1 -- 172.21.15.80:0/3057974973 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe39800a530 con 0x7fe3a810ed60 2019-11-28T11:54:42.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.198+0000 7fe3a659c700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a810ed60 0x7fe3a810f1f0 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7fe398010390 tx=0x7fe398010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.198+0000 7fe39f7fe700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe380018750 0x7fe38001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:42.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.198+0000 7fe39f7fe700 1 -- 172.21.15.80:0/3057974973 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe398031ac0 con 0x7fe3a810ed60 2019-11-28T11:54:42.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.198+0000 7fe3a6d9d700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe380018750 0x7fe38001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:42.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.199+0000 7fe3a6d9d700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe380018750 0x7fe38001abe0 crc :-1 s=READY pgs=1095 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:42.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.206+0000 7fe3acbd3700 1 -- 172.21.15.80:0/3057974973 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a8106270 con 0x7fe3a810ed60 2019-11-28T11:54:42.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.210+0000 7fe3a659c700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a810ed60 0x7fe3a810f1f0 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7fe398010390 tx=0x7fe398010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.210+0000 7fe39f7fe700 1 -- 172.21.15.80:0/3057974973 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe39800a300 con 0x7fe3a810ed60 2019-11-28T11:54:42.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.375+0000 7fe3acbd3700 1 -- 172.21.15.80:0/3057974973 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fe3a8105ef0 con 0x7fe3a810ed60 2019-11-28T11:54:42.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.375+0000 7fe3a659c700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a810ed60 0x7fe3a810f1f0 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7fe398010390 tx=0x7fe398010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.375+0000 7fe39f7fe700 1 -- 172.21.15.80:0/3057974973 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v203) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe39800a510 con 0x7fe3a810ed60 2019-11-28T11:54:42.433 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:54:42.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.377+0000 7fe3acbd3700 1 -- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe380018750 msgr2=0x7fe38001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.377+0000 7fe3acbd3700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe380018750 0x7fe38001abe0 crc :-1 s=READY pgs=1095 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:42.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.377+0000 7fe3acbd3700 1 -- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a810ed60 msgr2=0x7fe3a810f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.377+0000 7fe3acbd3700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a810ed60 0x7fe3a810f1f0 secure :-1 s=READY pgs=385 cs=0 l=1 rx=0x7fe398010390 tx=0x7fe398010730).stop 2019-11-28T11:54:42.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.378+0000 7fe3acbd3700 1 -- 172.21.15.80:0/3057974973 shutdown_connections 2019-11-28T11:54:42.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.378+0000 7fe3acbd3700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a810ed60 0x7fe3a810f1f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:42.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.378+0000 7fe3acbd3700 1 --2- 172.21.15.80:0/3057974973 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe380018750 0x7fe38001abe0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:42.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.378+0000 7fe3acbd3700 1 -- 172.21.15.80:0/3057974973 shutdown_connections 2019-11-28T11:54:42.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.378+0000 7fe3acbd3700 1 -- 172.21.15.80:0/3057974973 wait complete. 2019-11-28T11:54:42.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.378+0000 7fe3acbd3700 1 -- 172.21.15.80:0/3057974973 >> 172.21.15.80:0/3057974973 conn(0x7fe3a815e2d0 msgr2=0x7fe3a8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:42.445 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:54:42.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.513+0000 7f4e93125700 1 Processor -- start 2019-11-28T11:54:42.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.514+0000 7f4e93125700 1 -- start start 2019-11-28T11:54:42.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e93125700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e8c15ed10 0x7f4e8c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:42.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e93125700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c06db60 con 0x7f4e8c073020 2019-11-28T11:54:42.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e93125700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c06e060 con 0x7f4e8c0734b0 2019-11-28T11:54:42.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e93125700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c06fe00 con 0x7f4e8c15ed10 2019-11-28T11:54:42.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e916c2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e8c15ed10 0x7f4e8c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:42.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e916c2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e8c15ed10 0x7f4e8c15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45754/0 (socket says 172.21.15.80:45754) 2019-11-28T11:54:42.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e90ec1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4e8c073020 0x7f4e8c071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45074/0 (socket says 172.21.15.80:45074) 2019-11-28T11:54:42.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e916c2700 1 -- 172.21.15.80:0/3781953644 learned_addr learned my addr 172.21.15.80:0/3781953644 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e916c2700 1 -- 172.21.15.80:0/3781953644 >> v1:172.21.15.174:6789/0 conn(0x7f4e8c0734b0 legacy=0x7f4e8c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e916c2700 1 -- 172.21.15.80:0/3781953644 >> v1:172.21.15.80:6789/0 conn(0x7f4e8c073020 legacy=0x7f4e8c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e916c2700 1 -- 172.21.15.80:0/3781953644 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c070760 con 0x7f4e8c15ed10 2019-11-28T11:54:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e8bfff700 1 -- 172.21.15.80:0/3781953644 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137485266 0 0) 0x7f4e74001070 con 0x7f4e8c073020 2019-11-28T11:54:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e916c2700 1 --2- 172.21.15.80:0/3781953644 >> v2:172.21.15.80:3300/0 conn(0x7f4e8c15ed10 0x7f4e8c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4e7c00fac0 tx=0x7f4e7c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e916c2700 1 --2- 172.21.15.80:0/3781953644 >> v2:172.21.15.80:3300/0 conn(0x7f4e8c15ed10 0x7f4e8c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4e7c00fac0 tx=0x7f4e7c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e916c2700 1 --2- 172.21.15.80:0/3781953644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c15ed10 0x7f4e8c15f100 secure :-1 s=READY pgs=2666 cs=0 l=1 rx=0x7f4e7c00fac0 tx=0x7f4e7c00fe60).ready entity=mon.0 client_cookie=cd48b7bf8d0f7eea server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:42.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e916c2700 1 --2- 172.21.15.80:0/3781953644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c15ed10 0x7f4e8c15f100 secure :-1 s=THROTTLE_DONE pgs=2666 cs=0 l=1 rx=0x7f4e7c00fac0 tx=0x7f4e7c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e916c2700 1 --2- 172.21.15.80:0/3781953644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c15ed10 0x7f4e8c15f100 secure :-1 s=THROTTLE_DONE pgs=2666 cs=0 l=1 rx=0x7f4e7c00fac0 tx=0x7f4e7c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e8bfff700 1 -- 172.21.15.80:0/3781953644 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7c000ce0 con 0x7f4e8c15ed10 2019-11-28T11:54:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e916c2700 1 --2- 172.21.15.80:0/3781953644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c15ed10 0x7f4e8c15f100 secure :-1 s=THROTTLE_DONE pgs=2666 cs=0 l=1 rx=0x7f4e7c00fac0 tx=0x7f4e7c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e8bfff700 1 -- 172.21.15.80:0/3781953644 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c001010 con 0x7f4e8c15ed10 2019-11-28T11:54:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e8bfff700 1 -- 172.21.15.80:0/3781953644 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7c0016e0 con 0x7f4e8c15ed10 2019-11-28T11:54:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e93125700 1 -- 172.21.15.80:0/3781953644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c15ed10 msgr2=0x7f4e8c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.515+0000 7f4e93125700 1 --2- 172.21.15.80:0/3781953644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c15ed10 0x7f4e8c15f100 secure :-1 s=READY pgs=2666 cs=0 l=1 rx=0x7f4e7c00fac0 tx=0x7f4e7c00fe60).stop 2019-11-28T11:54:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.516+0000 7f4e93125700 1 -- 172.21.15.80:0/3781953644 shutdown_connections 2019-11-28T11:54:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.516+0000 7f4e93125700 1 --2- 172.21.15.80:0/3781953644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c15ed10 0x7f4e8c15f100 unknown :-1 s=CLOSED pgs=2666 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.516+0000 7f4e93125700 1 -- 172.21.15.80:0/3781953644 shutdown_connections 2019-11-28T11:54:42.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.516+0000 7f4e93125700 1 -- 172.21.15.80:0/3781953644 wait complete. 2019-11-28T11:54:42.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.516+0000 7f4e93125700 1 -- 172.21.15.80:0/3781953644 >> 172.21.15.80:0/3781953644 conn(0x7f4e8c061d20 msgr2=0x7f4e8c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:42.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.519+0000 7f4e93125700 1 Processor -- start 2019-11-28T11:54:42.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.519+0000 7f4e93125700 1 -- start start 2019-11-28T11:54:42.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e93125700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e8c1079b0 0x7f4e8c107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:42.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e93125700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e8c108380 0x7f4e8c168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:42.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e93125700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c1087d0 con 0x7f4e8c148320 2019-11-28T11:54:42.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e93125700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c13aa20 con 0x7f4e8c108380 2019-11-28T11:54:42.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e93125700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c13acf0 con 0x7f4e8c1079b0 2019-11-28T11:54:42.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e91ec3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e8c108380 0x7f4e8c168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:42.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e916c2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4e8c148320 0x7f4e8c10ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45076/0 (socket says 172.21.15.80:45076) 2019-11-28T11:54:42.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e916c2700 1 -- 172.21.15.80:0/884897999 learned_addr learned my addr 172.21.15.80:0/884897999 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:42.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e90ec1700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e8c1079b0 0x7f4e8c107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:42.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e91ec3700 1 -- 172.21.15.80:0/884897999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e8c1079b0 msgr2=0x7f4e8c107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e91ec3700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e8c1079b0 0x7f4e8c107e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:42.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e91ec3700 1 -- 172.21.15.80:0/884897999 >> v1:172.21.15.80:6789/0 conn(0x7f4e8c148320 legacy=0x7f4e8c10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e91ec3700 1 -- 172.21.15.80:0/884897999 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c10c490 con 0x7f4e8c108380 2019-11-28T11:54:42.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e89ffb700 1 -- 172.21.15.80:0/884897999 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788010878 0 0) 0x7f4e7c007dc0 con 0x7f4e8c148320 2019-11-28T11:54:42.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e90ec1700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e8c1079b0 0x7f4e8c107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:42.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e91ec3700 1 --2- 172.21.15.80:0/884897999 >> v2:172.21.15.80:3300/0 conn(0x7f4e8c108380 0x7f4e8c168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4e840103b0 tx=0x7f4e84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e91ec3700 1 --2- 172.21.15.80:0/884897999 >> v2:172.21.15.80:3300/0 conn(0x7f4e8c108380 0x7f4e8c168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4e840103b0 tx=0x7f4e84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e91ec3700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c108380 0x7f4e8c168d80 secure :-1 s=READY pgs=2668 cs=0 l=1 rx=0x7f4e840103b0 tx=0x7f4e84010750).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:42.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e91ec3700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c108380 0x7f4e8c168d80 secure :-1 s=THROTTLE_DONE pgs=2668 cs=0 l=1 rx=0x7f4e840103b0 tx=0x7f4e84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e89ffb700 1 -- 172.21.15.80:0/884897999 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e84000960 con 0x7f4e8c108380 2019-11-28T11:54:42.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e91ec3700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c108380 0x7f4e8c168d80 secure :-1 s=THROTTLE_DONE pgs=2668 cs=0 l=1 rx=0x7f4e840103b0 tx=0x7f4e84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e93125700 1 -- 172.21.15.80:0/884897999 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8c10c810 con 0x7f4e8c108380 2019-11-28T11:54:42.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e89ffb700 1 -- 172.21.15.80:0/884897999 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e84000960 con 0x7f4e8c108380 2019-11-28T11:54:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e91ec3700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c108380 0x7f4e8c168d80 secure :-1 s=THROTTLE_DONE pgs=2668 cs=0 l=1 rx=0x7f4e840103b0 tx=0x7f4e84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e89ffb700 1 -- 172.21.15.80:0/884897999 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e8400efd0 con 0x7f4e8c108380 2019-11-28T11:54:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.520+0000 7f4e93125700 1 -- 172.21.15.80:0/884897999 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c10c490 con 0x7f4e8c108380 2019-11-28T11:54:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.521+0000 7f4e91ec3700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c108380 0x7f4e8c168d80 secure :-1 s=THROTTLE_DONE pgs=2668 cs=0 l=1 rx=0x7f4e840103b0 tx=0x7f4e84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.521+0000 7f4e89ffb700 1 -- 172.21.15.80:0/884897999 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4e8400ebf0 con 0x7f4e8c108380 2019-11-28T11:54:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.521+0000 7f4e91ec3700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c108380 0x7f4e8c168d80 secure :-1 s=THROTTLE_DONE pgs=2668 cs=0 l=1 rx=0x7f4e840103b0 tx=0x7f4e84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.521+0000 7f4e89ffb700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e70018730 0x7f4e7001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.521+0000 7f4e89ffb700 1 -- 172.21.15.80:0/884897999 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4e840319f0 con 0x7f4e8c108380 2019-11-28T11:54:42.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.521+0000 7f4e916c2700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e70018730 0x7f4e7001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:42.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.522+0000 7f4e916c2700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e70018730 0x7f4e7001abc0 crc :-1 s=READY pgs=1096 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:42.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.529+0000 7f4e93125700 1 -- 172.21.15.80:0/884897999 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8c10c810 con 0x7f4e8c108380 2019-11-28T11:54:42.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.532+0000 7f4e91ec3700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c108380 0x7f4e8c168d80 secure :-1 s=THROTTLE_DONE pgs=2668 cs=0 l=1 rx=0x7f4e840103b0 tx=0x7f4e84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.532+0000 7f4e89ffb700 1 -- 172.21.15.80:0/884897999 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4e84000bf0 con 0x7f4e8c108380 2019-11-28T11:54:42.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.698+0000 7f4e93125700 1 -- 172.21.15.80:0/884897999 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f4e8c10c490 con 0x7f4e8c108380 2019-11-28T11:54:42.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.698+0000 7f4e91ec3700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c108380 0x7f4e8c168d80 secure :-1 s=THROTTLE_DONE pgs=2668 cs=0 l=1 rx=0x7f4e840103b0 tx=0x7f4e84010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.699+0000 7f4e89ffb700 1 -- 172.21.15.80:0/884897999 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v203) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4e84000bf0 con 0x7f4e8c108380 2019-11-28T11:54:42.757 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:54:42.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.701+0000 7f4e93125700 1 -- 172.21.15.80:0/884897999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e70018730 msgr2=0x7f4e7001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.701+0000 7f4e93125700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e70018730 0x7f4e7001abc0 crc :-1 s=READY pgs=1096 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:42.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.701+0000 7f4e93125700 1 -- 172.21.15.80:0/884897999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c108380 msgr2=0x7f4e8c168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.701+0000 7f4e93125700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c108380 0x7f4e8c168d80 secure :-1 s=READY pgs=2668 cs=0 l=1 rx=0x7f4e840103b0 tx=0x7f4e84010750).stop 2019-11-28T11:54:42.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.701+0000 7f4e93125700 1 -- 172.21.15.80:0/884897999 shutdown_connections 2019-11-28T11:54:42.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.701+0000 7f4e93125700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4e70018730 0x7f4e7001abc0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:42.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.701+0000 7f4e93125700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e8c108380 0x7f4e8c168d80 unknown :-1 s=CLOSED pgs=2668 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:42.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.701+0000 7f4e93125700 1 --2- 172.21.15.80:0/884897999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e8c1079b0 0x7f4e8c107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:42.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.701+0000 7f4e93125700 1 -- 172.21.15.80:0/884897999 shutdown_connections 2019-11-28T11:54:42.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.701+0000 7f4e93125700 1 -- 172.21.15.80:0/884897999 wait complete. 2019-11-28T11:54:42.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.701+0000 7f4e93125700 1 -- 172.21.15.80:0/884897999 >> 172.21.15.80:0/884897999 conn(0x7f4e8c15e2d0 msgr2=0x7f4e8c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:42.772 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:54:42.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.840+0000 7f3abdd0c700 1 Processor -- start 2019-11-28T11:54:42.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.840+0000 7f3abdd0c700 1 -- start start 2019-11-28T11:54:42.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.841+0000 7f3abdd0c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3ab815ed10 0x7f3ab815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:42.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.841+0000 7f3abdd0c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab8073020 0x7f3ab8071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:42.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.841+0000 7f3abdd0c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab806db60 con 0x7f3ab80734b0 2019-11-28T11:54:42.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.841+0000 7f3abdd0c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab806fe00 con 0x7f3ab815ed10 2019-11-28T11:54:42.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.841+0000 7f3abdd0c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80700d0 con 0x7f3ab8073020 2019-11-28T11:54:42.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.841+0000 7f3aaffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab8073020 0x7f3ab8071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:42.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.841+0000 7f3ab7fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3ab815ed10 0x7f3ab815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:42.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.841+0000 7f3aaffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab8073020 0x7f3ab8071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:48028/0 (socket says 172.21.15.80:48028) 2019-11-28T11:54:42.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.841+0000 7f3aaffff700 1 -- 172.21.15.80:0/2842766390 learned_addr learned my addr 172.21.15.80:0/2842766390 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:42.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.841+0000 7f3abcaaa700 1 --1- 172.21.15.80:0/2842766390 >> v1:172.21.15.174:6789/0 conn(0x7f3ab80734b0 0x7f3ab80723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:60630/0 (socket says 172.21.15.80:60630) 2019-11-28T11:54:42.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.841+0000 7f3ab7fff700 1 -- 172.21.15.80:0/2842766390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab8073020 msgr2=0x7f3ab8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:42.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.841+0000 7f3ab7fff700 1 --2- 172.21.15.80:0/2842766390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab8073020 0x7f3ab8071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:42.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.841+0000 7f3ab7fff700 1 -- 172.21.15.80:0/2842766390 >> v1:172.21.15.174:6789/0 conn(0x7f3ab80734b0 legacy=0x7f3ab80723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.841+0000 7f3ab7fff700 1 -- 172.21.15.80:0/2842766390 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab8070760 con 0x7f3ab815ed10 2019-11-28T11:54:42.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.841+0000 7f3aaffff700 1 --2- 172.21.15.80:0/2842766390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab8073020 0x7f3ab8071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:42.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.841+0000 7f3ab7fff700 1 --2- 172.21.15.80:0/2842766390 >> v2:172.21.15.174:3300/0 conn(0x7f3ab815ed10 0x7f3ab815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3aa800af50 tx=0x7f3aa800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.842+0000 7f3ab7fff700 1 --2- 172.21.15.80:0/2842766390 >> v2:172.21.15.174:3300/0 conn(0x7f3ab815ed10 0x7f3ab815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3aa800af50 tx=0x7f3aa800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.842+0000 7f3ab7fff700 1 --2- 172.21.15.80:0/2842766390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ab815ed10 0x7f3ab815f100 secure :-1 s=READY pgs=1608 cs=0 l=1 rx=0x7f3aa800af50 tx=0x7f3aa800b760).ready entity=mon.1 client_cookie=5daf91c1ec57cec6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.842+0000 7f3ab7fff700 1 --2- 172.21.15.80:0/2842766390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ab815ed10 0x7f3ab815f100 secure :-1 s=THROTTLE_DONE pgs=1608 cs=0 l=1 rx=0x7f3aa800af50 tx=0x7f3aa800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.842+0000 7f3ab7fff700 1 --2- 172.21.15.80:0/2842766390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ab815ed10 0x7f3ab815f100 secure :-1 s=THROTTLE_DONE pgs=1608 cs=0 l=1 rx=0x7f3aa800af50 tx=0x7f3aa800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.842+0000 7f3ab7fff700 1 --2- 172.21.15.80:0/2842766390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ab815ed10 0x7f3ab815f100 secure :-1 s=THROTTLE_DONE pgs=1608 cs=0 l=1 rx=0x7f3aa800af50 tx=0x7f3aa800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.842+0000 7f3ab77fe700 1 -- 172.21.15.80:0/2842766390 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3aa8007210 con 0x7f3ab815ed10 2019-11-28T11:54:42.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.842+0000 7f3ab77fe700 1 -- 172.21.15.80:0/2842766390 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa80099b0 con 0x7f3ab815ed10 2019-11-28T11:54:42.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.842+0000 7f3ab77fe700 1 -- 172.21.15.80:0/2842766390 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3aa800a080 con 0x7f3ab815ed10 2019-11-28T11:54:42.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.842+0000 7f3abdd0c700 1 -- 172.21.15.80:0/2842766390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ab815ed10 msgr2=0x7f3ab815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.842+0000 7f3abdd0c700 1 --2- 172.21.15.80:0/2842766390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ab815ed10 0x7f3ab815f100 secure :-1 s=READY pgs=1608 cs=0 l=1 rx=0x7f3aa800af50 tx=0x7f3aa800b760).stop 2019-11-28T11:54:42.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.843+0000 7f3abdd0c700 1 -- 172.21.15.80:0/2842766390 shutdown_connections 2019-11-28T11:54:42.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.843+0000 7f3abdd0c700 1 --2- 172.21.15.80:0/2842766390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab8073020 0x7f3ab8071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:42.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.843+0000 7f3abdd0c700 1 --2- 172.21.15.80:0/2842766390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ab815ed10 0x7f3ab815f100 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.843+0000 7f3abdd0c700 1 -- 172.21.15.80:0/2842766390 shutdown_connections 2019-11-28T11:54:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.843+0000 7f3abdd0c700 1 -- 172.21.15.80:0/2842766390 wait complete. 2019-11-28T11:54:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.843+0000 7f3abdd0c700 1 -- 172.21.15.80:0/2842766390 >> 172.21.15.80:0/2842766390 conn(0x7f3ab8061d20 msgr2=0x7f3ab80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.845+0000 7f3abdd0c700 1 Processor -- start 2019-11-28T11:54:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.845+0000 7f3abdd0c700 1 -- start start 2019-11-28T11:54:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.846+0000 7f3abdd0c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab81079b0 0x7f3ab8107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.846+0000 7f3abdd0c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab81087d0 con 0x7f3ab8108380 2019-11-28T11:54:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.846+0000 7f3abdd0c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab8148e00 con 0x7f3ab8148320 2019-11-28T11:54:42.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.846+0000 7f3abdd0c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab813aa20 con 0x7f3ab81079b0 2019-11-28T11:54:42.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.846+0000 7f3abcaaa700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3ab8108380 0x7f3ab8168d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45092/0 (socket says 172.21.15.80:45092) 2019-11-28T11:54:42.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.846+0000 7f3abcaaa700 1 -- 172.21.15.80:0/1566595646 learned_addr learned my addr 172.21.15.80:0/1566595646 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:42.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.846+0000 7f3aaffff700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab81079b0 0x7f3ab8107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:42.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.846+0000 7f3ab57fa700 1 -- 172.21.15.80:0/1566595646 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690347975 0 0) 0x7f3ab0001610 con 0x7f3ab8108380 2019-11-28T11:54:42.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.846+0000 7f3ab57fa700 1 -- 172.21.15.80:0/1566595646 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a9c002e80 con 0x7f3ab8108380 2019-11-28T11:54:42.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.846+0000 7f3ab57fa700 1 -- 172.21.15.80:0/1566595646 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246217467 0 0) 0x7f3aa8009580 con 0x7f3ab8148320 2019-11-28T11:54:42.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.846+0000 7f3ab57fa700 1 -- 172.21.15.80:0/1566595646 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a9c004170 con 0x7f3ab8148320 2019-11-28T11:54:42.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.846+0000 7f3aaffff700 1 -- 172.21.15.80:0/1566595646 >> v1:172.21.15.174:6789/0 conn(0x7f3ab8148320 legacy=0x7f3ab810ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.846+0000 7f3aaffff700 1 -- 172.21.15.80:0/1566595646 >> v1:172.21.15.80:6789/0 conn(0x7f3ab8108380 legacy=0x7f3ab8168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:42.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.846+0000 7f3aaffff700 1 -- 172.21.15.80:0/1566595646 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab810c490 con 0x7f3ab81079b0 2019-11-28T11:54:42.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.846+0000 7f3aaffff700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab81079b0 0x7f3ab8107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3aa0010380 tx=0x7f3aa0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.847+0000 7f3aaffff700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab81079b0 0x7f3ab8107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3aa0010380 tx=0x7f3aa0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.847+0000 7f3aaffff700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab81079b0 0x7f3ab8107e40 secure :-1 s=READY pgs=386 cs=0 l=1 rx=0x7f3aa0010380 tx=0x7f3aa0010720).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:42.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.847+0000 7f3aaffff700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab81079b0 0x7f3ab8107e40 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f3aa0010380 tx=0x7f3aa0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.847+0000 7f3ab57fa700 1 -- 172.21.15.80:0/1566595646 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3aa0000940 con 0x7f3ab81079b0 2019-11-28T11:54:42.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.847+0000 7f3aaffff700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab81079b0 0x7f3ab8107e40 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f3aa0010380 tx=0x7f3aa0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.847+0000 7f3aaffff700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab81079b0 0x7f3ab8107e40 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f3aa0010380 tx=0x7f3aa0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.847+0000 7f3ab57fa700 1 -- 172.21.15.80:0/1566595646 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa0001090 con 0x7f3ab81079b0 2019-11-28T11:54:42.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.847+0000 7f3ab57fa700 1 -- 172.21.15.80:0/1566595646 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3aa0000940 con 0x7f3ab81079b0 2019-11-28T11:54:42.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.847+0000 7f3abdd0c700 1 -- 172.21.15.80:0/1566595646 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab810c810 con 0x7f3ab81079b0 2019-11-28T11:54:42.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.847+0000 7f3abdd0c700 1 -- 172.21.15.80:0/1566595646 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab810c490 con 0x7f3ab81079b0 2019-11-28T11:54:42.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.847+0000 7f3aaffff700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab81079b0 0x7f3ab8107e40 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f3aa0010380 tx=0x7f3aa0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.847+0000 7f3ab57fa700 1 -- 172.21.15.80:0/1566595646 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3aa0000c90 con 0x7f3ab81079b0 2019-11-28T11:54:42.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.847+0000 7f3aaffff700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab81079b0 0x7f3ab8107e40 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f3aa0010380 tx=0x7f3aa0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.847+0000 7f3ab57fa700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a9c018740 0x7f3a9c01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:42.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.847+0000 7f3ab57fa700 1 -- 172.21.15.80:0/1566595646 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3aa0031a50 con 0x7f3ab81079b0 2019-11-28T11:54:42.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.848+0000 7f3ab7fff700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a9c018740 0x7f3a9c01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.848+0000 7f3ab7fff700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a9c018740 0x7f3a9c01abf0 crc :-1 s=READY pgs=1097 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.855+0000 7f3abdd0c700 1 -- 172.21.15.80:0/1566595646 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab810c810 con 0x7f3ab81079b0 2019-11-28T11:54:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.859+0000 7f3aaffff700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab81079b0 0x7f3ab8107e40 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f3aa0010380 tx=0x7f3aa0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:42.859+0000 7f3ab57fa700 1 -- 172.21.15.80:0/1566595646 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3aa0015af0 con 0x7f3ab81079b0 2019-11-28T11:54:43.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.024+0000 7f3abdd0c700 1 -- 172.21.15.80:0/1566595646 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f3ab810c490 con 0x7f3ab81079b0 2019-11-28T11:54:43.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.025+0000 7f3aaffff700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab81079b0 0x7f3ab8107e40 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f3aa0010380 tx=0x7f3aa0010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:43.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.025+0000 7f3ab57fa700 1 -- 172.21.15.80:0/1566595646 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v203) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3aa0015af0 con 0x7f3ab81079b0 2019-11-28T11:54:43.083 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:54:43.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.027+0000 7f3abdd0c700 1 -- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a9c018740 msgr2=0x7f3a9c01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:43.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.027+0000 7f3abdd0c700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a9c018740 0x7f3a9c01abf0 crc :-1 s=READY pgs=1097 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:43.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.027+0000 7f3abdd0c700 1 -- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab81079b0 msgr2=0x7f3ab8107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:43.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.027+0000 7f3abdd0c700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab81079b0 0x7f3ab8107e40 secure :-1 s=READY pgs=386 cs=0 l=1 rx=0x7f3aa0010380 tx=0x7f3aa0010720).stop 2019-11-28T11:54:43.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.027+0000 7f3abdd0c700 1 -- 172.21.15.80:0/1566595646 shutdown_connections 2019-11-28T11:54:43.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.027+0000 7f3abdd0c700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ab81079b0 0x7f3ab8107e40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:43.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.027+0000 7f3abdd0c700 1 --2- 172.21.15.80:0/1566595646 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a9c018740 0x7f3a9c01abf0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:43.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.027+0000 7f3abdd0c700 1 -- 172.21.15.80:0/1566595646 shutdown_connections 2019-11-28T11:54:43.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.027+0000 7f3abdd0c700 1 -- 172.21.15.80:0/1566595646 wait complete. 2019-11-28T11:54:43.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.027+0000 7f3abdd0c700 1 -- 172.21.15.80:0/1566595646 >> 172.21.15.80:0/1566595646 conn(0x7f3ab815e2d0 msgr2=0x7f3ab8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:43.095 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:54:43.096 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:43.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.157+0000 7f1020d34700 1 Processor -- start 2019-11-28T11:54:43.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.157+0000 7f1020d34700 1 -- start start 2019-11-28T11:54:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1020d34700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f101c06d120 0x7f101c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1020d34700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101c06d5a0 con 0x7f101c06c0a0 2019-11-28T11:54:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1020d34700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101c06db00 con 0x7f101c06c490 2019-11-28T11:54:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1020d34700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101c06fd60 con 0x7f101c06d120 2019-11-28T11:54:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f101ad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f101c06c0a0 0x7f101c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45096/0 (socket says 172.21.15.80:45096) 2019-11-28T11:54:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f101ad9d700 1 -- 172.21.15.80:0/404062187 learned_addr learned my addr 172.21.15.80:0/404062187 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f101b59e700 1 --2- 172.21.15.80:0/404062187 >> v2:172.21.15.174:3300/0 conn(0x7f101c06d120 0x7f101c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1019d9b700 1 -- 172.21.15.80:0/404062187 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933755681 0 0) 0x7f100c001150 con 0x7f101c06c0a0 2019-11-28T11:54:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1019d9b700 1 -- 172.21.15.80:0/404062187 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1008002e80 con 0x7f101c06c0a0 2019-11-28T11:54:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1019d9b700 1 -- 172.21.15.80:0/404062187 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2338273854 0 0) 0x7f100c001130 con 0x7f101c06c0a0 2019-11-28T11:54:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1019d9b700 1 -- 172.21.15.80:0/404062187 >> v2:172.21.15.174:3300/0 conn(0x7f101c06d120 msgr2=0x7f101c165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:43.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1019d9b700 1 --2- 172.21.15.80:0/404062187 >> v2:172.21.15.174:3300/0 conn(0x7f101c06d120 0x7f101c165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:43.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1019d9b700 1 -- 172.21.15.80:0/404062187 >> v1:172.21.15.174:6789/0 conn(0x7f101c06c490 legacy=0x7f101c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:43.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1019d9b700 1 -- 172.21.15.80:0/404062187 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c0706c0 con 0x7f101c06c0a0 2019-11-28T11:54:43.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1019d9b700 1 -- 172.21.15.80:0/404062187 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f100c001660 con 0x7f101c06c0a0 2019-11-28T11:54:43.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1019d9b700 1 -- 172.21.15.80:0/404062187 >> v1:172.21.15.80:6789/0 conn(0x7f101c06c0a0 legacy=0x7f101c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:43.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1019d9b700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1008003b20 0x7f1008005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:43.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1019d9b700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1008006730 0x7f1008008be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:43.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1019d9b700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1008009440 0x7f100800b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:43.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1019d9b700 1 -- 172.21.15.80:0/404062187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100800c0c0 con 0x7f1008003b20 2019-11-28T11:54:43.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1019d9b700 1 -- 172.21.15.80:0/404062187 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10080502c0 con 0x7f1008006730 2019-11-28T11:54:43.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f1019d9b700 1 -- 172.21.15.80:0/404062187 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10080504f0 con 0x7f1008009440 2019-11-28T11:54:43.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f101b59e700 1 --2- 172.21.15.80:0/404062187 >> v2:172.21.15.174:3300/0 conn(0x7f101c06d120 0x7f101c165d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:54:43.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.159+0000 7f101ad9d700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1008003b20 0x7f1008005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:43.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f101a59c700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1008006730 0x7f1008008be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:43.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f101b59e700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1008009440 0x7f100800b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:43.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f101ad9d700 1 -- 172.21.15.80:0/404062187 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1008009440 msgr2=0x7f100800b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:43.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f101ad9d700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1008009440 0x7f100800b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:43.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f101ad9d700 1 -- 172.21.15.80:0/404062187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1008006730 msgr2=0x7f1008008be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:43.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f101ad9d700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1008006730 0x7f1008008be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:54:43.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f101ad9d700 1 -- 172.21.15.80:0/404062187 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10080507a0 con 0x7f1008003b20 2019-11-28T11:54:43.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f101b59e700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1008009440 0x7f100800b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:54:43.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f101b59e700 1 -- 172.21.15.80:0/404062187 reap_dead start 2019-11-28T11:54:43.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f101ad9d700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1008003b20 0x7f1008005f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f100c00f8e0 tx=0x7f100c00f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:43.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f101ad9d700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1008003b20 0x7f1008005f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f100c00f8e0 tx=0x7f100c00f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:43.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f101ad9d700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1008003b20 0x7f1008005f80 secure :-1 s=READY pgs=2671 cs=0 l=1 rx=0x7f100c00f8e0 tx=0x7f100c00f810).ready entity=mon.0 client_cookie=f35ee1fc67155443 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:43.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f101ad9d700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1008003b20 0x7f1008005f80 secure :-1 s=THROTTLE_DONE pgs=2671 cs=0 l=1 rx=0x7f100c00f8e0 tx=0x7f100c00f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:43.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f1019d9b700 1 -- 172.21.15.80:0/404062187 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f100c001130 con 0x7f1008003b20 2019-11-28T11:54:43.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f101ad9d700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1008003b20 0x7f1008005f80 secure :-1 s=THROTTLE_DONE pgs=2671 cs=0 l=1 rx=0x7f100c00f8e0 tx=0x7f100c00f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:43.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f101ad9d700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1008003b20 0x7f1008005f80 secure :-1 s=THROTTLE_DONE pgs=2671 cs=0 l=1 rx=0x7f100c00f8e0 tx=0x7f100c00f810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:43.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f1019d9b700 1 -- 172.21.15.80:0/404062187 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c004430 con 0x7f1008003b20 2019-11-28T11:54:43.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f1019d9b700 1 -- 172.21.15.80:0/404062187 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f100c004620 con 0x7f1008003b20 2019-11-28T11:54:43.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f1020d34700 1 -- 172.21.15.80:0/404062187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1008003b20 msgr2=0x7f1008005f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:43.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.160+0000 7f1020d34700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1008003b20 0x7f1008005f80 secure :-1 s=READY pgs=2671 cs=0 l=1 rx=0x7f100c00f8e0 tx=0x7f100c00f810).stop 2019-11-28T11:54:43.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.161+0000 7f1020d34700 1 -- 172.21.15.80:0/404062187 shutdown_connections 2019-11-28T11:54:43.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.161+0000 7f1020d34700 1 --2- 172.21.15.80:0/404062187 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1008003b20 0x7f1008005f80 unknown :-1 s=CLOSED pgs=2671 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:43.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.161+0000 7f1020d34700 1 -- 172.21.15.80:0/404062187 shutdown_connections 2019-11-28T11:54:43.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.161+0000 7f1020d34700 1 -- 172.21.15.80:0/404062187 wait complete. 2019-11-28T11:54:43.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.161+0000 7f1020d34700 1 -- 172.21.15.80:0/404062187 >> 172.21.15.80:0/404062187 conn(0x7f101c061cf0 msgr2=0x7f101c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:43.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.163+0000 7f1020d34700 1 Processor -- start 2019-11-28T11:54:43.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.163+0000 7f1020d34700 1 -- start start 2019-11-28T11:54:43.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.164+0000 7f1020d34700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f101c07bba0 0x7f101c168c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:43.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.164+0000 7f1020d34700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101c0754d0 con 0x7f101c074d00 2019-11-28T11:54:43.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.164+0000 7f1020d34700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101c12eb20 con 0x7f101c150f50 2019-11-28T11:54:43.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.164+0000 7f1020d34700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101c078980 con 0x7f101c07bba0 2019-11-28T11:54:43.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.164+0000 7f101ad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f101c074d00 0x7f101c07aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45108/0 (socket says 172.21.15.80:45108) 2019-11-28T11:54:43.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.164+0000 7f101ad9d700 1 -- 172.21.15.80:0/2565205444 learned_addr learned my addr 172.21.15.80:0/2565205444 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:43.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.164+0000 7f101b59e700 1 --2- 172.21.15.80:0/2565205444 >> v2:172.21.15.174:3300/0 conn(0x7f101c07bba0 0x7f101c168c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:43.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.164+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911761758 0 0) 0x7f100c000f90 con 0x7f101c074d00 2019-11-28T11:54:43.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.164+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1000002e80 con 0x7f101c074d00 2019-11-28T11:54:43.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.164+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1101147342 0 0) 0x7f100c001190 con 0x7f101c074d00 2019-11-28T11:54:43.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.164+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f10000032e0 con 0x7f101c074d00 2019-11-28T11:54:43.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.164+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f100c001760 con 0x7f101c074d00 2019-11-28T11:54:43.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 >> v2:172.21.15.174:3300/0 conn(0x7f101c07bba0 msgr2=0x7f101c168c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:43.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f10137fe700 1 --2- 172.21.15.80:0/2565205444 >> v2:172.21.15.174:3300/0 conn(0x7f101c07bba0 0x7f101c168c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:43.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 >> v1:172.21.15.174:6789/0 conn(0x7f101c150f50 legacy=0x7f101c07b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:43.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 >> v1:172.21.15.80:6789/0 conn(0x7f101c074d00 legacy=0x7f101c07aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:43.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f10137fe700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1000003400 0x7f1000003810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:43.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f10137fe700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1000003d50 0x7f10000041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:43.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f10137fe700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1000004930 0x7f1000004df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:43.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100000bbf0 con 0x7f1000003d50 2019-11-28T11:54:43.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100000be20 con 0x7f1000003400 2019-11-28T11:54:43.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100000c050 con 0x7f1000004930 2019-11-28T11:54:43.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101a59c700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1000003d50 0x7f10000041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:43.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101ad9d700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1000003400 0x7f1000003810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:43.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101b59e700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1000004930 0x7f1000004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:43.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101a59c700 1 -- 172.21.15.80:0/2565205444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1000004930 msgr2=0x7f1000004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:43.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101a59c700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1000004930 0x7f1000004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:43.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101a59c700 1 -- 172.21.15.80:0/2565205444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1000003400 msgr2=0x7f1000003810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:43.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101a59c700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1000003400 0x7f1000003810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:43.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101a59c700 1 -- 172.21.15.80:0/2565205444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100000c300 con 0x7f1000003d50 2019-11-28T11:54:43.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f1020d34700 1 -- 172.21.15.80:0/2565205444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101c079660 con 0x7f1000003d50 2019-11-28T11:54:43.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101a59c700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1000003d50 0x7f10000041d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10040103b0 tx=0x7f1004010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:43.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101b59e700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1000004930 0x7f1000004df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:54:43.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101b59e700 1 -- 172.21.15.80:0/2565205444 reap_dead start 2019-11-28T11:54:43.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f1020d34700 1 -- 172.21.15.80:0/2565205444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101c0792e0 con 0x7f1000003d50 2019-11-28T11:54:43.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101a59c700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1000003d50 0x7f10000041d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10040103b0 tx=0x7f1004010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:43.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101a59c700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1000003d50 0x7f10000041d0 secure :-1 s=READY pgs=2673 cs=0 l=1 rx=0x7f10040103b0 tx=0x7f1004010230).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:43.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101a59c700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1000003d50 0x7f10000041d0 secure :-1 s=THROTTLE_DONE pgs=2673 cs=0 l=1 rx=0x7f10040103b0 tx=0x7f1004010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:43.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1004005390 con 0x7f1000003d50 2019-11-28T11:54:43.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101a59c700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1000003d50 0x7f10000041d0 secure :-1 s=THROTTLE_DONE pgs=2673 cs=0 l=1 rx=0x7f10040103b0 tx=0x7f1004010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:43.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101a59c700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1000003d50 0x7f10000041d0 secure :-1 s=THROTTLE_DONE pgs=2673 cs=0 l=1 rx=0x7f10040103b0 tx=0x7f1004010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:43.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10040059a0 con 0x7f1000003d50 2019-11-28T11:54:43.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1004006030 con 0x7f1000003d50 2019-11-28T11:54:43.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.165+0000 7f101a59c700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1000003d50 0x7f10000041d0 secure :-1 s=THROTTLE_DONE pgs=2673 cs=0 l=1 rx=0x7f10040103b0 tx=0x7f1004010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:43.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.166+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1004005b90 con 0x7f1000003d50 2019-11-28T11:54:43.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.166+0000 7f101a59c700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1000003d50 0x7f10000041d0 secure :-1 s=THROTTLE_DONE pgs=2673 cs=0 l=1 rx=0x7f10040103b0 tx=0x7f1004010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:43.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.166+0000 7f10137fe700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f100001b4c0 0x7f100001d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:43.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.166+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1004031b40 con 0x7f1000003d50 2019-11-28T11:54:43.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.166+0000 7f101ad9d700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f100001b4c0 0x7f100001d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:43.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.166+0000 7f101ad9d700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f100001b4c0 0x7f100001d8f0 crc :-1 s=READY pgs=1098 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:43.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.173+0000 7f1020d34700 1 -- 172.21.15.80:0/2565205444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101c079660 con 0x7f1000003d50 2019-11-28T11:54:43.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.176+0000 7f101a59c700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1000003d50 0x7f10000041d0 secure :-1 s=THROTTLE_DONE pgs=2673 cs=0 l=1 rx=0x7f10040103b0 tx=0x7f1004010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:43.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.177+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f10040055a0 con 0x7f1000003d50 2019-11-28T11:54:43.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.348+0000 7f1020d34700 1 -- 172.21.15.80:0/2565205444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f101c0792e0 con 0x7f1000003d50 2019-11-28T11:54:43.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.349+0000 7f101a59c700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1000003d50 0x7f10000041d0 secure :-1 s=THROTTLE_DONE pgs=2673 cs=0 l=1 rx=0x7f10040103b0 tx=0x7f1004010230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:43.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.349+0000 7f10137fe700 1 -- 172.21.15.80:0/2565205444 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 168 v168) v1 ==== 95+0+2459 (secure 0 0 0) 0x7f10040059a0 con 0x7f1000003d50 2019-11-28T11:54:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 168 2019-11-28T11:54:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.351+0000 7f1020d34700 1 -- 172.21.15.80:0/2565205444 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f100001b4c0 msgr2=0x7f100001d8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.351+0000 7f1020d34700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f100001b4c0 0x7f100001d8f0 crc :-1 s=READY pgs=1098 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.351+0000 7f1020d34700 1 -- 172.21.15.80:0/2565205444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1000003d50 msgr2=0x7f10000041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.351+0000 7f1020d34700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1000003d50 0x7f10000041d0 secure :-1 s=READY pgs=2673 cs=0 l=1 rx=0x7f10040103b0 tx=0x7f1004010230).stop 2019-11-28T11:54:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.351+0000 7f1020d34700 1 -- 172.21.15.80:0/2565205444 shutdown_connections 2019-11-28T11:54:43.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.351+0000 7f1020d34700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f100001b4c0 0x7f100001d8f0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:43.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.351+0000 7f1020d34700 1 --2- 172.21.15.80:0/2565205444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1000003d50 0x7f10000041d0 unknown :-1 s=CLOSED pgs=2673 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:43.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.351+0000 7f1020d34700 1 -- 172.21.15.80:0/2565205444 shutdown_connections 2019-11-28T11:54:43.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.351+0000 7f1020d34700 1 -- 172.21.15.80:0/2565205444 wait complete. 2019-11-28T11:54:43.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:43.351+0000 7f1020d34700 1 -- 172.21.15.80:0/2565205444 >> 172.21.15.80:0/2565205444 conn(0x7f101c13fa50 msgr2=0x7f101c07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:43.411 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:43.411 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":168,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7754,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3904352671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3904352671},{"type":"v1","addr":"172.21.15.80:6835","nonce":3904352671}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":168},{"gid":11703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3665230874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3665230874},{"type":"v1","addr":"172.21.15.80:6834","nonce":3665230874}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":168}],"filesystems":[{"mdsmap":{"epoch":167,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:54:29.202039+0000","modified":"2019-11-28T11:54:32.779460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10972},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10972":{"gid":10972,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/2209008547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2209008547},{"type":"v1","addr":"172.21.15.174:6835","nonce":2209008547}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2019-11-28T11:54:43.721 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 10972}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 32, u'failed': [], u'epoch': 167, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [33], u'info': {u'gid_10972': {u'export_targets': [], u'name': u'c', u'incarnation': 166, u'state_seq': 2, u'state': u'up:active', u'gid': 10972, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2209008547, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2209008547, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2209008547'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:54:29.202039+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:54:32.779460+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:54:43.721 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:54:43.721 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:54:43.858 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:54:43.858 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:54:43.858 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:54:43.858 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 10972, 2019-11-28T11:54:43.858 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:54:43.858 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:54:43.859 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 12.025183608000001, 2019-11-28T11:54:43.859 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 167, 2019-11-28T11:54:43.859 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 203, 2019-11-28T11:54:43.859 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 203, 2019-11-28T11:54:43.859 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 12.160368238 2019-11-28T11:54:43.859 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:54:43.865 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 10972, "want_state": "up:active", "state": "up:active", "rank_uptime": 12.025183608000001, "mdsmap_epoch": 167, "osdmap_epoch": 203, "osdmap_epoch_barrier": 203, "uptime": 12.160368238 } 2019-11-28T11:54:43.865 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:54:43.865 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:54:43.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:54:43.866 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:54:43.941 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:54:43.941 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:54:44.025 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:54:44.026 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:54:44.034 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:54:44.035 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:54:44.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:54:44.076 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:54:44.146 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits daemon-helper kill python -c ' 2019-11-28T11:54:44.146 INFO:teuthology.orchestra.run.smithi076:> import time 2019-11-28T11:54:44.146 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:54:44.146 INFO:teuthology.orchestra.run.smithi076:> f = open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'r'"'"') 2019-11-28T11:54:44.147 INFO:teuthology.orchestra.run.smithi076:> while True: 2019-11-28T11:54:44.147 INFO:teuthology.orchestra.run.smithi076:> time.sleep(1) 2019-11-28T11:54:44.147 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:54:44.151 INFO:teuthology.orchestra.run.smithi076:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2019-11-28T11:54:44.203 INFO:teuthology.orchestra.run.smithi076.stdout:/home/ubuntu/cephtest/mnt.0/background_file 2019-11-28T11:54:44.205 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 0s 2019-11-28T11:54:44.205 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:54:44.329 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.268+0000 7f6115ccd700 1 Processor -- start 2019-11-28T11:54:44.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.268+0000 7f6115ccd700 1 -- start start 2019-11-28T11:54:44.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f6115ccd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f611006c490 0x7f611006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:54:44.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f6115ccd700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611006db00 con 0x7f611006c0a0 2019-11-28T11:54:44.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f6115ccd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611006e000 con 0x7f611006ce60 2019-11-28T11:54:44.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f6115ccd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f611006fd60 con 0x7f611006c490 2019-11-28T11:54:44.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f610f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f611006c490 0x7f611006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:44.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f610ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f611006c0a0 0x7f6110072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45122/0 (socket says 172.21.15.80:45122) 2019-11-28T11:54:44.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f610ffff700 1 -- 172.21.15.80:0/1929660502 learned_addr learned my addr 172.21.15.80:0/1929660502 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:54:44.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f610f7fe700 1 -- 172.21.15.80:0/1929660502 >> v1:172.21.15.174:6789/0 conn(0x7f611006ce60 legacy=0x7f6110164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:54:44.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f610f7fe700 1 -- 172.21.15.80:0/1929660502 >> v1:172.21.15.80:6789/0 conn(0x7f611006c0a0 legacy=0x7f6110072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:44.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f610effd700 1 -- 172.21.15.80:0/1929660502 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213306966 0 0) 0x7f6100001150 con 0x7f611006c0a0 2019-11-28T11:54:44.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f610f7fe700 1 -- 172.21.15.80:0/1929660502 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61100706c0 con 0x7f611006c490 2019-11-28T11:54:44.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f610f7fe700 1 --2- 172.21.15.80:0/1929660502 >> v2:172.21.15.80:3300/0 conn(0x7f611006c490 0x7f611006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f60fc00af50 tx=0x7f60fc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:44.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f610f7fe700 1 --2- 172.21.15.80:0/1929660502 >> v2:172.21.15.80:3300/0 conn(0x7f611006c490 0x7f611006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f60fc00af50 tx=0x7f60fc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:44.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f610f7fe700 1 --2- 172.21.15.80:0/1929660502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f611006c490 0x7f611006c920 secure :-1 s=READY pgs=2675 cs=0 l=1 rx=0x7f60fc00af50 tx=0x7f60fc00b760).ready entity=mon.0 client_cookie=8cedb589609e3259 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:44.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f610f7fe700 1 --2- 172.21.15.80:0/1929660502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f611006c490 0x7f611006c920 secure :-1 s=THROTTLE_DONE pgs=2675 cs=0 l=1 rx=0x7f60fc00af50 tx=0x7f60fc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:44.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f610effd700 1 -- 172.21.15.80:0/1929660502 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60fc000960 con 0x7f611006c490 2019-11-28T11:54:44.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f610f7fe700 1 --2- 172.21.15.80:0/1929660502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f611006c490 0x7f611006c920 secure :-1 s=THROTTLE_DONE pgs=2675 cs=0 l=1 rx=0x7f60fc00af50 tx=0x7f60fc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:44.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f610f7fe700 1 --2- 172.21.15.80:0/1929660502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f611006c490 0x7f611006c920 secure :-1 s=THROTTLE_DONE pgs=2675 cs=0 l=1 rx=0x7f60fc00af50 tx=0x7f60fc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:44.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f610effd700 1 -- 172.21.15.80:0/1929660502 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60fc009860 con 0x7f611006c490 2019-11-28T11:54:44.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f610effd700 1 -- 172.21.15.80:0/1929660502 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60fc000960 con 0x7f611006c490 2019-11-28T11:54:44.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f6115ccd700 1 -- 172.21.15.80:0/1929660502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f611006c490 msgr2=0x7f611006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:44.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.269+0000 7f6115ccd700 1 --2- 172.21.15.80:0/1929660502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f611006c490 0x7f611006c920 secure :-1 s=READY pgs=2675 cs=0 l=1 rx=0x7f60fc00af50 tx=0x7f60fc00b760).stop 2019-11-28T11:54:44.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.270+0000 7f6115ccd700 1 -- 172.21.15.80:0/1929660502 shutdown_connections 2019-11-28T11:54:44.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.270+0000 7f6115ccd700 1 --2- 172.21.15.80:0/1929660502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f611006c490 0x7f611006c920 unknown :-1 s=CLOSED pgs=2675 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:44.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.270+0000 7f6115ccd700 1 -- 172.21.15.80:0/1929660502 shutdown_connections 2019-11-28T11:54:44.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.270+0000 7f6115ccd700 1 -- 172.21.15.80:0/1929660502 wait complete. 2019-11-28T11:54:44.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.270+0000 7f6115ccd700 1 -- 172.21.15.80:0/1929660502 >> 172.21.15.80:0/1929660502 conn(0x7f6110061cf0 msgr2=0x7f6110064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:44.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.272+0000 7f6115ccd700 1 Processor -- start 2019-11-28T11:54:44.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.273+0000 7f6115ccd700 1 -- start start 2019-11-28T11:54:44.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.273+0000 7f6115ccd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6110135760 0x7f6110137480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:44.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.273+0000 7f6115ccd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f61101330b0 0x7f6110133540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:44.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.273+0000 7f6115ccd700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6110136480 con 0x7f611012a150 2019-11-28T11:54:44.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.273+0000 7f6115ccd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6110104370 con 0x7f6110135760 2019-11-28T11:54:44.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.273+0000 7f6115ccd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61101346a0 con 0x7f61101330b0 2019-11-28T11:54:44.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6110135760 0x7f6110137480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:44.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6110135760 0x7f6110137480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45810/0 (socket says 172.21.15.80:45810) 2019-11-28T11:54:44.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610f7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f611012a150 0x7f611012a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45128/0 (socket says 172.21.15.80:45128) 2019-11-28T11:54:44.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610ffff700 1 -- 172.21.15.80:0/110600364 learned_addr learned my addr 172.21.15.80:0/110600364 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:54:44.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f6114a6b700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f61101330b0 0x7f6110133540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:44.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610ffff700 1 -- 172.21.15.80:0/110600364 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f61101330b0 msgr2=0x7f6110133540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:44.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610ffff700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f61101330b0 0x7f6110133540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:44.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610ffff700 1 -- 172.21.15.80:0/110600364 >> v1:172.21.15.80:6789/0 conn(0x7f611012a150 legacy=0x7f611012a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:44.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610ffff700 1 -- 172.21.15.80:0/110600364 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110104a00 con 0x7f6110135760 2019-11-28T11:54:44.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610ffff700 1 --2- 172.21.15.80:0/110600364 >> v2:172.21.15.80:3300/0 conn(0x7f6110135760 0x7f6110137480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6100010430 tx=0x7f6100010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:44.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610ffff700 1 --2- 172.21.15.80:0/110600364 >> v2:172.21.15.80:3300/0 conn(0x7f6110135760 0x7f6110137480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6100010430 tx=0x7f6100010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:44.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610ffff700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6110135760 0x7f6110137480 secure :-1 s=READY pgs=2677 cs=0 l=1 rx=0x7f6100010430 tx=0x7f6100010260).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:44.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610ffff700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6110135760 0x7f6110137480 secure :-1 s=THROTTLE_DONE pgs=2677 cs=0 l=1 rx=0x7f6100010430 tx=0x7f6100010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:44.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610ffff700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6110135760 0x7f6110137480 secure :-1 s=THROTTLE_DONE pgs=2677 cs=0 l=1 rx=0x7f6100010430 tx=0x7f6100010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:44.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610ffff700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6110135760 0x7f6110137480 secure :-1 s=THROTTLE_DONE pgs=2677 cs=0 l=1 rx=0x7f6100010430 tx=0x7f6100010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:44.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610cff9700 1 -- 172.21.15.80:0/110600364 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6100000ed0 con 0x7f6110135760 2019-11-28T11:54:44.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610cff9700 1 -- 172.21.15.80:0/110600364 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6100004430 con 0x7f6110135760 2019-11-28T11:54:44.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f610cff9700 1 -- 172.21.15.80:0/110600364 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6100004a80 con 0x7f6110135760 2019-11-28T11:54:44.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f6115ccd700 1 -- 172.21.15.80:0/110600364 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6110104d80 con 0x7f6110135760 2019-11-28T11:54:44.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.274+0000 7f6115ccd700 1 -- 172.21.15.80:0/110600364 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6110104a00 con 0x7f6110135760 2019-11-28T11:54:44.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.275+0000 7f610ffff700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6110135760 0x7f6110137480 secure :-1 s=THROTTLE_DONE pgs=2677 cs=0 l=1 rx=0x7f6100010430 tx=0x7f6100010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:44.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.275+0000 7f610cff9700 1 -- 172.21.15.80:0/110600364 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6100004620 con 0x7f6110135760 2019-11-28T11:54:44.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.275+0000 7f610ffff700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6110135760 0x7f6110137480 secure :-1 s=THROTTLE_DONE pgs=2677 cs=0 l=1 rx=0x7f6100010430 tx=0x7f6100010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:44.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.275+0000 7f610cff9700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f60ec018730 0x7f60ec01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:54:44.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.275+0000 7f610cff9700 1 -- 172.21.15.80:0/110600364 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6100031ab0 con 0x7f6110135760 2019-11-28T11:54:44.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.275+0000 7f610f7fe700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f60ec018730 0x7f60ec01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:54:44.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.275+0000 7f610f7fe700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f60ec018730 0x7f60ec01abc0 crc :-1 s=READY pgs=1099 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:54:44.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.283+0000 7f6115ccd700 1 -- 172.21.15.80:0/110600364 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6110104d80 con 0x7f6110135760 2019-11-28T11:54:44.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.286+0000 7f610ffff700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6110135760 0x7f6110137480 secure :-1 s=THROTTLE_DONE pgs=2677 cs=0 l=1 rx=0x7f6100010430 tx=0x7f6100010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:44.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.286+0000 7f610cff9700 1 -- 172.21.15.80:0/110600364 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f61000012b0 con 0x7f6110135760 2019-11-28T11:54:44.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.460+0000 7f6115ccd700 1 -- 172.21.15.80:0/110600364 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6110104a00 con 0x7f6110135760 2019-11-28T11:54:44.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.461+0000 7f610ffff700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6110135760 0x7f6110137480 secure :-1 s=THROTTLE_DONE pgs=2677 cs=0 l=1 rx=0x7f6100010430 tx=0x7f6100010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:54:44.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.461+0000 7f610cff9700 1 -- 172.21.15.80:0/110600364 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 168 v168) v1 ==== 95+0+2459 (secure 0 0 0) 0x7f6100004620 con 0x7f6110135760 2019-11-28T11:54:44.519 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 168 2019-11-28T11:54:44.519 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:54:44.520 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":168,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7754,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3904352671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3904352671},{"type":"v1","addr":"172.21.15.80:6835","nonce":3904352671}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":168},{"gid":11703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3665230874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3665230874},{"type":"v1","addr":"172.21.15.80:6834","nonce":3665230874}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":168}],"filesystems":[{"mdsmap":{"epoch":167,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:54:29.202039+0000","modified":"2019-11-28T11:54:32.779460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10972},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10972":{"gid":10972,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/2209008547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2209008547},{"type":"v1","addr":"172.21.15.174:6835","nonce":2209008547}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2019-11-28T11:54:44.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.463+0000 7f6115ccd700 1 -- 172.21.15.80:0/110600364 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f60ec018730 msgr2=0x7f60ec01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:44.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.463+0000 7f6115ccd700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f60ec018730 0x7f60ec01abc0 crc :-1 s=READY pgs=1099 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:44.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.463+0000 7f6115ccd700 1 -- 172.21.15.80:0/110600364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6110135760 msgr2=0x7f6110137480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:54:44.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.463+0000 7f6115ccd700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6110135760 0x7f6110137480 secure :-1 s=READY pgs=2677 cs=0 l=1 rx=0x7f6100010430 tx=0x7f6100010260).stop 2019-11-28T11:54:44.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.463+0000 7f6115ccd700 1 -- 172.21.15.80:0/110600364 shutdown_connections 2019-11-28T11:54:44.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.463+0000 7f6115ccd700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f60ec018730 0x7f60ec01abc0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:44.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.463+0000 7f6115ccd700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f61101330b0 0x7f6110133540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:44.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.463+0000 7f6115ccd700 1 --2- 172.21.15.80:0/110600364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6110135760 0x7f6110137480 unknown :-1 s=CLOSED pgs=2677 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:54:44.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.463+0000 7f6115ccd700 1 -- 172.21.15.80:0/110600364 shutdown_connections 2019-11-28T11:54:44.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.463+0000 7f6115ccd700 1 -- 172.21.15.80:0/110600364 wait complete. 2019-11-28T11:54:44.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:54:44.464+0000 7f6115ccd700 1 -- 172.21.15.80:0/110600364 >> 172.21.15.80:0/110600364 conn(0x7f611013d930 msgr2=0x7f6110102360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:54:44.535 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session ls 2019-11-28T11:54:44.668 INFO:teuthology.orchestra.run.smithi174.stdout:[ 2019-11-28T11:54:44.669 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:54:44.669 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 11137, 2019-11-28T11:54:44.669 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:54:44.669 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:54:44.669 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:54:44.670 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 11137 2019-11-28T11:54:44.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:54:44.670 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:54:44.670 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:54:44.670 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.76:0", 2019-11-28T11:54:44.670 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 3018229229 2019-11-28T11:54:44.670 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:54:44.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:54:44.671 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:54:44.671 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:54:44.671 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 2, 2019-11-28T11:54:44.671 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 1, 2019-11-28T11:54:44.671 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 0.63597395700000003, 2019-11-28T11:54:44.671 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:54:44.672 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 0, 2019-11-28T11:54:44.672 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:54:44.672 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:54:44.672 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:54:44.672 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:54:44.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:54:44.672 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:54:44.672 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:54:44.673 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:54:44.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:54:44.687 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:54:44.687 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:54:44.687 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:54:44.687 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:54:44.687 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:54:44.687 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:54:44.688 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:54:44.689 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:54:44.689 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:54:44.690 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 1.997464831896091, 2019-11-28T11:54:44.690 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:54:44.691 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:54:44.691 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.11137 v1:172.21.15.76:0/3018229229", 2019-11-28T11:54:44.691 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [], 2019-11-28T11:54:44.691 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T11:54:44.691 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:54:44.691 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:54:44.692 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:54:44.692 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "0", 2019-11-28T11:54:44.692 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi076.front.sepia.ceph.com", 2019-11-28T11:54:44.692 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:54:44.692 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:54:44.692 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:54:44.693 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:54:44.693 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:54:44.693 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 7808, 2019-11-28T11:54:44.693 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:54:44.693 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:54:44.693 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:54:44.693 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 7808 2019-11-28T11:54:44.694 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:54:44.694 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:54:44.694 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:54:44.695 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.16:0", 2019-11-28T11:54:44.695 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 1545332241 2019-11-28T11:54:44.695 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:54:44.695 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:54:44.695 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:54:44.695 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:54:44.696 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 1, 2019-11-28T11:54:44.696 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 0, 2019-11-28T11:54:44.696 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 6.2917410020000002, 2019-11-28T11:54:44.696 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:54:44.696 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 0, 2019-11-28T11:54:44.696 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:54:44.696 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:54:44.697 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:54:44.697 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:54:44.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:54:44.697 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:54:44.697 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:54:44.697 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:54:44.697 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:54:44.698 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:54:44.698 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:54:44.698 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:54:44.698 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:54:44.699 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:54:44.699 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:54:44.699 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:54:44.702 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:54:44.702 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:54:44.703 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 2.9601594580464088, 2019-11-28T11:54:44.703 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:54:44.703 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:54:44.703 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.7808 v1:172.21.15.16:0/1545332241", 2019-11-28T11:54:44.703 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [], 2019-11-28T11:54:44.703 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T11:54:44.703 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:54:44.704 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:54:44.704 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:54:44.704 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "1", 2019-11-28T11:54:44.704 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi016", 2019-11-28T11:54:44.704 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:54:44.704 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:54:44.704 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:54:44.705 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:54:44.705 INFO:teuthology.orchestra.run.smithi174.stdout:] 2019-11-28T11:54:44.707 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 11137, "entity": { "name": { "type": "client", "num": 11137 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 3018229229 } }, "state": "open", "num_leases": 0, "num_caps": 2, "request_load_avg": 1, "uptime": 0.63597395700000003, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 1.997464831896091, "halflife": 300 }, "inst": "client.11137 v1:172.21.15.76:0/3018229229", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076.front.sepia.ceph.com", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } }, { "id": 7808, "entity": { "name": { "type": "client", "num": 7808 }, "addr": { "type": "v1", "addr": "172.21.15.16:0", "nonce": 1545332241 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 6.2917410020000002, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 2.9601594580464088, "halflife": 300 }, "inst": "client.7808 v1:172.21.15.16:0/1545332241", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "1", "hostname": "smithi016", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:54:44.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:54:44.707 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:54:44.707 INFO:teuthology.orchestra.run.smithi076:> import glob 2019-11-28T11:54:44.707 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:54:44.708 INFO:teuthology.orchestra.run.smithi076:> import json 2019-11-28T11:54:44.708 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:54:44.708 INFO:teuthology.orchestra.run.smithi076:> def get_id_to_dir(): 2019-11-28T11:54:44.708 INFO:teuthology.orchestra.run.smithi076:> result = {} 2019-11-28T11:54:44.708 INFO:teuthology.orchestra.run.smithi076:> for dir in glob.glob("/sys/kernel/debug/ceph/*"): 2019-11-28T11:54:44.708 INFO:teuthology.orchestra.run.smithi076:> mds_sessions_lines = open(os.path.join(dir, "mds_sessions")).readlines() 2019-11-28T11:54:44.708 INFO:teuthology.orchestra.run.smithi076:> client_id = mds_sessions_lines[1].split()[1].strip('"'"'"'"'"') 2019-11-28T11:54:44.709 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:54:44.709 INFO:teuthology.orchestra.run.smithi076:> result[client_id] = dir 2019-11-28T11:54:44.710 INFO:teuthology.orchestra.run.smithi076:> return result 2019-11-28T11:54:44.710 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:54:44.710 INFO:teuthology.orchestra.run.smithi076:> print(json.dumps(get_id_to_dir())) 2019-11-28T11:54:44.710 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:54:44.796 INFO:teuthology.orchestra.run.smithi076.stdout:{"0": "/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client11137"} 2019-11-28T11:54:44.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:54:44.797 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:54:44.797 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:54:44.797 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:54:44.797 INFO:teuthology.orchestra.run.smithi076:> print(open(os.path.join("/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client11137", "mds_sessions")).read()) 2019-11-28T11:54:44.797 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:54:44.867 INFO:teuthology.orchestra.run.smithi076.stdout:global_id 11137 2019-11-28T11:54:44.867 INFO:teuthology.orchestra.run.smithi076.stdout:name "0" 2019-11-28T11:54:44.868 INFO:teuthology.orchestra.run.smithi076.stdout:mds.0 open 2019-11-28T11:54:44.868 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:54:44.868 INFO:teuthology.orchestra.run.smithi016:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file 2019-11-28T11:54:44.933 INFO:teuthology.orchestra.run.smithi016.stdout:/home/ubuntu/cephtest/mnt.1/background_file 2019-11-28T11:54:44.934 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2019-11-28T11:54:44.984 INFO:teuthology.orchestra.console:Performing hard reset of smithi076 2019-11-28T11:54:44.984 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power reset 2019-11-28T11:54:45.032 INFO:teuthology.orchestra.console:Hard reset for smithi076 completed 2019-11-28T11:54:45.831 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:54:45.838 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:54:45.843 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:54:45.848 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:54:45.853 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:54:45.858 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:54:50.138 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits daemon-helper kill python -c ' 2019-11-28T11:54:50.138 INFO:teuthology.orchestra.run.smithi016:> import os 2019-11-28T11:54:50.138 INFO:teuthology.orchestra.run.smithi016:> import time 2019-11-28T11:54:50.138 INFO:teuthology.orchestra.run.smithi016:> 2019-11-28T11:54:50.138 INFO:teuthology.orchestra.run.smithi016:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0644) 2019-11-28T11:54:50.138 INFO:teuthology.orchestra.run.smithi016:> try: 2019-11-28T11:54:50.139 INFO:teuthology.orchestra.run.smithi016:> while True: 2019-11-28T11:54:50.141 INFO:teuthology.orchestra.run.smithi016:> os.write(fd, '"'"'content'"'"') 2019-11-28T11:54:50.141 INFO:teuthology.orchestra.run.smithi016:> time.sleep(1) 2019-11-28T11:54:50.141 INFO:teuthology.orchestra.run.smithi016:> if not False: 2019-11-28T11:54:50.141 INFO:teuthology.orchestra.run.smithi016:> break 2019-11-28T11:54:50.141 INFO:teuthology.orchestra.run.smithi016:> except IOError, e: 2019-11-28T11:54:50.141 INFO:teuthology.orchestra.run.smithi016:> pass 2019-11-28T11:54:50.142 INFO:teuthology.orchestra.run.smithi016:> os.close(fd) 2019-11-28T11:54:50.142 INFO:teuthology.orchestra.run.smithi016:> ' 2019-11-28T11:55:15.946 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:55:15.953 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:55:15.958 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:55:47.724 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:55:47.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.852+0000 7f9b1e896700 1 Processor -- start 2019-11-28T11:55:47.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.852+0000 7f9b1e896700 1 -- start start 2019-11-28T11:55:47.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.852+0000 7f9b1e896700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b1806c0a0 0x7f9b18072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:55:47.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.852+0000 7f9b1e896700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9b180734e0 0x7f9b18071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:55:47.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1e896700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b18072360 0x7f9b18072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:55:47.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1e896700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1806fd60 con 0x7f9b1806c0a0 2019-11-28T11:55:47.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1e896700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b18070030 con 0x7f9b180734e0 2019-11-28T11:55:47.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1e896700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1806f330 con 0x7f9b18072360 2019-11-28T11:55:47.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1ce33700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b1806c0a0 0x7f9b18072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:55:47.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1ce33700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b1806c0a0 0x7f9b18072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45830/0 (socket says 172.21.15.80:45830) 2019-11-28T11:55:47.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1ce33700 1 -- 172.21.15.80:0/540822368 learned_addr learned my addr 172.21.15.80:0/540822368 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:55:47.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1d634700 1 --2- 172.21.15.80:0/540822368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b18072360 0x7f9b18072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:55:47.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b17fff700 1 --2- 172.21.15.80:0/540822368 >> v2:172.21.15.174:3300/0 conn(0x7f9b180734e0 0x7f9b18071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:55:47.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1ce33700 1 -- 172.21.15.80:0/540822368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b18072360 msgr2=0x7f9b18072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:55:47.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1ce33700 1 --2- 172.21.15.80:0/540822368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b18072360 0x7f9b18072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:55:47.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1ce33700 1 -- 172.21.15.80:0/540822368 >> v2:172.21.15.174:3300/0 conn(0x7f9b180734e0 msgr2=0x7f9b18071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:55:47.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1ce33700 1 --2- 172.21.15.80:0/540822368 >> v2:172.21.15.174:3300/0 conn(0x7f9b180734e0 0x7f9b18071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:55:47.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1ce33700 1 -- 172.21.15.80:0/540822368 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b180706c0 con 0x7f9b1806c0a0 2019-11-28T11:55:47.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b17fff700 1 --2- 172.21.15.80:0/540822368 >> v2:172.21.15.174:3300/0 conn(0x7f9b180734e0 0x7f9b18071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:55:47.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1ce33700 1 --2- 172.21.15.80:0/540822368 >> v2:172.21.15.80:3300/0 conn(0x7f9b1806c0a0 0x7f9b18072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9b1000fa40 tx=0x7f9b1000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:55:47.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1ce33700 1 --2- 172.21.15.80:0/540822368 >> v2:172.21.15.80:3300/0 conn(0x7f9b1806c0a0 0x7f9b18072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9b1000fa40 tx=0x7f9b1000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:55:47.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1ce33700 1 --2- 172.21.15.80:0/540822368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1806c0a0 0x7f9b18072fa0 secure :-1 s=READY pgs=2678 cs=0 l=1 rx=0x7f9b1000fa40 tx=0x7f9b1000fde0).ready entity=mon.0 client_cookie=938af0bfbf5e3a63 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:55:47.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1ce33700 1 --2- 172.21.15.80:0/540822368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1806c0a0 0x7f9b18072fa0 secure :-1 s=THROTTLE_DONE pgs=2678 cs=0 l=1 rx=0x7f9b1000fa40 tx=0x7f9b1000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:55:47.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b177fe700 1 -- 172.21.15.80:0/540822368 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b10000ce0 con 0x7f9b1806c0a0 2019-11-28T11:55:47.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1ce33700 1 --2- 172.21.15.80:0/540822368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1806c0a0 0x7f9b18072fa0 secure :-1 s=THROTTLE_DONE pgs=2678 cs=0 l=1 rx=0x7f9b1000fa40 tx=0x7f9b1000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:55:47.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1ce33700 1 --2- 172.21.15.80:0/540822368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1806c0a0 0x7f9b18072fa0 secure :-1 s=THROTTLE_DONE pgs=2678 cs=0 l=1 rx=0x7f9b1000fa40 tx=0x7f9b1000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:55:47.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b177fe700 1 -- 172.21.15.80:0/540822368 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b10001010 con 0x7f9b1806c0a0 2019-11-28T11:55:47.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b177fe700 1 -- 172.21.15.80:0/540822368 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b100017c0 con 0x7f9b1806c0a0 2019-11-28T11:55:47.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1e896700 1 -- 172.21.15.80:0/540822368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1806c0a0 msgr2=0x7f9b18072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:55:47.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.853+0000 7f9b1e896700 1 --2- 172.21.15.80:0/540822368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1806c0a0 0x7f9b18072fa0 secure :-1 s=READY pgs=2678 cs=0 l=1 rx=0x7f9b1000fa40 tx=0x7f9b1000fde0).stop 2019-11-28T11:55:47.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.854+0000 7f9b1e896700 1 -- 172.21.15.80:0/540822368 shutdown_connections 2019-11-28T11:55:47.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.854+0000 7f9b1e896700 1 --2- 172.21.15.80:0/540822368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b18072360 0x7f9b18072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:55:47.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.854+0000 7f9b1e896700 1 --2- 172.21.15.80:0/540822368 >> v2:172.21.15.174:3300/0 conn(0x7f9b180734e0 0x7f9b18071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:55:47.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.854+0000 7f9b1e896700 1 --2- 172.21.15.80:0/540822368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1806c0a0 0x7f9b18072fa0 unknown :-1 s=CLOSED pgs=2678 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:55:47.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.854+0000 7f9b1e896700 1 -- 172.21.15.80:0/540822368 shutdown_connections 2019-11-28T11:55:47.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.854+0000 7f9b1e896700 1 -- 172.21.15.80:0/540822368 wait complete. 2019-11-28T11:55:47.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.854+0000 7f9b1e896700 1 -- 172.21.15.80:0/540822368 >> 172.21.15.80:0/540822368 conn(0x7f9b18061cf0 msgr2=0x7f9b18064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:55:47.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.856+0000 7f9b1e896700 1 Processor -- start 2019-11-28T11:55:47.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.857+0000 7f9b1e896700 1 -- start start 2019-11-28T11:55:47.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.857+0000 7f9b1e896700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9b18104820 0x7f9b1810c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:55:47.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b1e896700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b1810c890 0x7f9b1810b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:55:47.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b1e896700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1813bcd0 con 0x7f9b1810b710 2019-11-28T11:55:47.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b1e896700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b18109130 con 0x7f9b1810c890 2019-11-28T11:55:47.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b1e896700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b18109400 con 0x7f9b18104820 2019-11-28T11:55:47.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b17fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b1810c890 0x7f9b1810b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:55:47.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b17fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9b1810c890 0x7f9b1810b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45838/0 (socket says 172.21.15.80:45838) 2019-11-28T11:55:47.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b17fff700 1 -- 172.21.15.80:0/2291080748 learned_addr learned my addr 172.21.15.80:0/2291080748 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:55:47.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b1ce33700 1 --2- 172.21.15.80:0/2291080748 >> v2:172.21.15.174:3300/0 conn(0x7f9b18104820 0x7f9b1810c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:55:47.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b17fff700 1 -- 172.21.15.80:0/2291080748 >> v2:172.21.15.174:3300/0 conn(0x7f9b18104820 msgr2=0x7f9b1810c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:55:47.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b17fff700 1 --2- 172.21.15.80:0/2291080748 >> v2:172.21.15.174:3300/0 conn(0x7f9b18104820 0x7f9b1810c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:55:47.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b17fff700 1 -- 172.21.15.80:0/2291080748 >> v1:172.21.15.174:6789/0 conn(0x7f9b1810b710 legacy=0x7f9b18104c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:55:47.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b17fff700 1 -- 172.21.15.80:0/2291080748 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b18109a90 con 0x7f9b1810c890 2019-11-28T11:55:47.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b17fff700 1 --2- 172.21.15.80:0/2291080748 >> v2:172.21.15.80:3300/0 conn(0x7f9b1810c890 0x7f9b1810b1d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b08010430 tx=0x7f9b080102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:55:47.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b17fff700 1 --2- 172.21.15.80:0/2291080748 >> v2:172.21.15.80:3300/0 conn(0x7f9b1810c890 0x7f9b1810b1d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b08010430 tx=0x7f9b080102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:55:47.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b17fff700 1 --2- 172.21.15.80:0/2291080748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1810c890 0x7f9b1810b1d0 secure :-1 s=READY pgs=2679 cs=0 l=1 rx=0x7f9b08010430 tx=0x7f9b080102b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:55:47.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b17fff700 1 --2- 172.21.15.80:0/2291080748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1810c890 0x7f9b1810b1d0 secure :-1 s=THROTTLE_DONE pgs=2679 cs=0 l=1 rx=0x7f9b08010430 tx=0x7f9b080102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:55:47.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b17fff700 1 --2- 172.21.15.80:0/2291080748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1810c890 0x7f9b1810b1d0 secure :-1 s=THROTTLE_DONE pgs=2679 cs=0 l=1 rx=0x7f9b08010430 tx=0x7f9b080102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:55:47.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b157fa700 1 -- 172.21.15.80:0/2291080748 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b080094b0 con 0x7f9b1810c890 2019-11-28T11:55:47.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b17fff700 1 --2- 172.21.15.80:0/2291080748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1810c890 0x7f9b1810b1d0 secure :-1 s=THROTTLE_DONE pgs=2679 cs=0 l=1 rx=0x7f9b08010430 tx=0x7f9b080102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:55:47.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b157fa700 1 -- 172.21.15.80:0/2291080748 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b080096b0 con 0x7f9b1810c890 2019-11-28T11:55:47.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b1e896700 1 -- 172.21.15.80:0/2291080748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b18109e10 con 0x7f9b1810c890 2019-11-28T11:55:47.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b157fa700 1 -- 172.21.15.80:0/2291080748 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b080012d0 con 0x7f9b1810c890 2019-11-28T11:55:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.858+0000 7f9b1e896700 1 -- 172.21.15.80:0/2291080748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b18109a90 con 0x7f9b1810c890 2019-11-28T11:55:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.859+0000 7f9b17fff700 1 --2- 172.21.15.80:0/2291080748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1810c890 0x7f9b1810b1d0 secure :-1 s=THROTTLE_DONE pgs=2679 cs=0 l=1 rx=0x7f9b08010430 tx=0x7f9b080102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:55:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.859+0000 7f9b157fa700 1 -- 172.21.15.80:0/2291080748 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9b08000bc0 con 0x7f9b1810c890 2019-11-28T11:55:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.859+0000 7f9b17fff700 1 --2- 172.21.15.80:0/2291080748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1810c890 0x7f9b1810b1d0 secure :-1 s=THROTTLE_DONE pgs=2679 cs=0 l=1 rx=0x7f9b08010430 tx=0x7f9b080102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:55:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.859+0000 7f9b157fa700 1 --2- 172.21.15.80:0/2291080748 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9afc018730 0x7f9afc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:55:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.859+0000 7f9b157fa700 1 -- 172.21.15.80:0/2291080748 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9b08031a70 con 0x7f9b1810c890 2019-11-28T11:55:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.859+0000 7f9b1ce33700 1 --2- 172.21.15.80:0/2291080748 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9afc018730 0x7f9afc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:55:47.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.860+0000 7f9b1ce33700 1 --2- 172.21.15.80:0/2291080748 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9afc018730 0x7f9afc01abc0 crc :-1 s=READY pgs=1113 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:55:47.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.867+0000 7f9b1e896700 1 -- 172.21.15.80:0/2291080748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b18109e10 con 0x7f9b1810c890 2019-11-28T11:55:47.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.870+0000 7f9b17fff700 1 --2- 172.21.15.80:0/2291080748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1810c890 0x7f9b1810b1d0 secure :-1 s=THROTTLE_DONE pgs=2679 cs=0 l=1 rx=0x7f9b08010430 tx=0x7f9b080102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:55:47.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:47.870+0000 7f9b157fa700 1 -- 172.21.15.80:0/2291080748 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9b08000990 con 0x7f9b1810c890 2019-11-28T11:55:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:48.042+0000 7f9b1e896700 1 -- 172.21.15.80:0/2291080748 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b18109a90 con 0x7f9b1810c890 2019-11-28T11:55:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:48.043+0000 7f9b17fff700 1 --2- 172.21.15.80:0/2291080748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1810c890 0x7f9b1810b1d0 secure :-1 s=THROTTLE_DONE pgs=2679 cs=0 l=1 rx=0x7f9b08010430 tx=0x7f9b080102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:55:48.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:48.043+0000 7f9b157fa700 1 -- 172.21.15.80:0/2291080748 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 168 v168) v1 ==== 95+0+2459 (secure 0 0 0) 0x7f9b080175b0 con 0x7f9b1810c890 2019-11-28T11:55:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 168 2019-11-28T11:55:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:55:48.044 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":168,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7754,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3904352671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3904352671},{"type":"v1","addr":"172.21.15.80:6835","nonce":3904352671}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":168},{"gid":11703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3665230874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3665230874},{"type":"v1","addr":"172.21.15.80:6834","nonce":3665230874}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":168}],"filesystems":[{"mdsmap":{"epoch":167,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:54:29.202039+0000","modified":"2019-11-28T11:54:32.779460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10972},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10972":{"gid":10972,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/2209008547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2209008547},{"type":"v1","addr":"172.21.15.174:6835","nonce":2209008547}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2019-11-28T11:55:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:48.045+0000 7f9b1e896700 1 -- 172.21.15.80:0/2291080748 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9afc018730 msgr2=0x7f9afc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:55:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:48.045+0000 7f9b1e896700 1 --2- 172.21.15.80:0/2291080748 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9afc018730 0x7f9afc01abc0 crc :-1 s=READY pgs=1113 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:55:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:48.045+0000 7f9b1e896700 1 -- 172.21.15.80:0/2291080748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1810c890 msgr2=0x7f9b1810b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:55:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:48.045+0000 7f9b1e896700 1 --2- 172.21.15.80:0/2291080748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1810c890 0x7f9b1810b1d0 secure :-1 s=READY pgs=2679 cs=0 l=1 rx=0x7f9b08010430 tx=0x7f9b080102b0).stop 2019-11-28T11:55:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:48.045+0000 7f9b1e896700 1 -- 172.21.15.80:0/2291080748 shutdown_connections 2019-11-28T11:55:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:48.045+0000 7f9b1e896700 1 --2- 172.21.15.80:0/2291080748 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9afc018730 0x7f9afc01abc0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:55:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:48.045+0000 7f9b1e896700 1 --2- 172.21.15.80:0/2291080748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b1810c890 0x7f9b1810b1d0 unknown :-1 s=CLOSED pgs=2679 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:55:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:48.045+0000 7f9b1e896700 1 --2- 172.21.15.80:0/2291080748 >> v2:172.21.15.174:3300/0 conn(0x7f9b18104820 0x7f9b1810c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:55:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:48.045+0000 7f9b1e896700 1 -- 172.21.15.80:0/2291080748 shutdown_connections 2019-11-28T11:55:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:48.045+0000 7f9b1e896700 1 -- 172.21.15.80:0/2291080748 wait complete. 2019-11-28T11:55:48.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:55:48.045+0000 7f9b1e896700 1 -- 172.21.15.80:0/2291080748 >> 172.21.15.80:0/2291080748 conn(0x7f9b1813d620 msgr2=0x7f9b1813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:55:48.056 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session ls 2019-11-28T11:55:48.182 INFO:teuthology.orchestra.run.smithi174.stdout:[ 2019-11-28T11:55:48.182 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:55:48.182 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 11137, 2019-11-28T11:55:48.182 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:55:48.182 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:55:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:55:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 11137 2019-11-28T11:55:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:55:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:55:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:55:48.183 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.76:0", 2019-11-28T11:55:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 3018229229 2019-11-28T11:55:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:55:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:55:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "stale", 2019-11-28T11:55:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:55:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 2, 2019-11-28T11:55:48.184 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 0, 2019-11-28T11:55:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 64.149506950000003, 2019-11-28T11:55:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:55:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 0, 2019-11-28T11:55:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:55:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:55:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:55:48.185 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:55:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:55:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:55:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:55:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:55:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:55:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:55:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:55:48.186 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:55:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:55:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:55:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:55:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:55:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:55:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:55:48.187 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 5.5893047497552777, 2019-11-28T11:55:48.188 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:55:48.188 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:55:48.188 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.11137 v1:172.21.15.76:0/3018229229", 2019-11-28T11:55:48.188 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [], 2019-11-28T11:55:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T11:55:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:55:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:55:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:55:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "0", 2019-11-28T11:55:48.201 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi076.front.sepia.ceph.com", 2019-11-28T11:55:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:55:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:55:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:55:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:55:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T11:55:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 7808, 2019-11-28T11:55:48.202 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T11:55:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T11:55:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T11:55:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 7808 2019-11-28T11:55:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:55:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T11:55:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T11:55:48.203 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.16:0", 2019-11-28T11:55:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 1545332241 2019-11-28T11:55:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:55:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:55:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T11:55:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T11:55:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 2, 2019-11-28T11:55:48.204 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 0, 2019-11-28T11:55:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 69.805273994999993, 2019-11-28T11:55:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T11:55:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 0, 2019-11-28T11:55:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T11:55:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T11:55:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:55:48.205 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:55:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:55:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T11:55:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:55:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T11:55:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:55:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T11:55:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:55:48.206 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T11:55:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:55:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T11:55:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T11:55:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T11:55:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:55:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T11:55:48.207 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 4.294886747752769, 2019-11-28T11:55:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T11:55:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T11:55:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.7808 v1:172.21.15.16:0/1545332241", 2019-11-28T11:55:48.208 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [], 2019-11-28T11:55:48.211 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T11:55:48.211 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T11:55:48.211 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T11:55:48.211 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T11:55:48.211 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "1", 2019-11-28T11:55:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi016", 2019-11-28T11:55:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:55:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T11:55:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:55:48.212 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T11:55:48.212 INFO:teuthology.orchestra.run.smithi174.stdout:] 2019-11-28T11:55:48.213 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 11137, "entity": { "name": { "type": "client", "num": 11137 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 3018229229 } }, "state": "stale", "num_leases": 0, "num_caps": 2, "request_load_avg": 0, "uptime": 64.149506950000003, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 5.5893047497552777, "halflife": 300 }, "inst": "client.11137 v1:172.21.15.76:0/3018229229", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076.front.sepia.ceph.com", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } }, { "id": 7808, "entity": { "name": { "type": "client", "num": 7808 }, "addr": { "type": "v1", "addr": "172.21.15.16:0", "nonce": 1545332241 } }, "state": "open", "num_leases": 0, "num_caps": 2, "request_load_avg": 0, "uptime": 69.805273994999993, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 4.294886747752769, "halflife": 300 }, "inst": "client.7808 v1:172.21.15.16:0/1545332241", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "1", "hostname": "smithi016", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:55:48.214 INFO:tasks.cephfs.test_client_recovery:cap_waiter waited 57.5684170723s 2019-11-28T11:57:08.157 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2019-11-28T11:57:08.157 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T11:57:08.184 DEBUG:tasks.ceph:Missed logrotate, host unreachable 2019-11-28T11:57:38.160 INFO:teuthology.misc:Re-opening connections... 2019-11-28T11:57:38.160 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T11:57:38.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:57:38.161 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:57:38.190 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:57:38.200 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:57:38.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T11:57:38.207 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T11:57:38.270 INFO:teuthology.orchestra.run.smithi076:> true 2019-11-28T11:57:38.309 INFO:teuthology.orchestra.run.smithi076:> true 2019-11-28T11:57:38.598 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:57:38.599 DEBUG:teuthology.misc:waited 0.43909907341 2019-11-28T11:57:38.602 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:57:38.607 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:57:38.612 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:57:39.600 INFO:teuthology.orchestra.run:Running command with timeout 10 2019-11-28T11:57:39.601 INFO:teuthology.orchestra.run.smithi076:> uptime 2019-11-28T11:57:39.689 INFO:teuthology.orchestra.run.smithi076.stdout: 11:57:39 up 1 min, 0 users, load average: 0.20, 0.08, 0.03 2019-11-28T11:57:39.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:57:39.690 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:57:39.769 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:57:39.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.891+0000 7f362870a700 1 Processor -- start 2019-11-28T11:57:39.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.891+0000 7f362870a700 1 -- start start 2019-11-28T11:57:39.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.892+0000 7f362870a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362006c0a0 0x7f3620072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:39.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.892+0000 7f362870a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3620072620 0x7f3620164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:39.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.892+0000 7f362870a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362006db00 con 0x7f36200734e0 2019-11-28T11:57:39.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.892+0000 7f362870a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362006f330 con 0x7f3620072620 2019-11-28T11:57:39.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.892+0000 7f362870a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36200706c0 con 0x7f362006c0a0 2019-11-28T11:57:39.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.892+0000 7f36274a8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3620072620 0x7f3620164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:39.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.892+0000 7f36274a8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3620072620 0x7f3620164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45846/0 (socket says 172.21.15.80:45846) 2019-11-28T11:57:39.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.892+0000 7f36264a6700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f36200734e0 0x7f3620071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45164/0 (socket says 172.21.15.80:45164) 2019-11-28T11:57:39.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.892+0000 7f36274a8700 1 -- 172.21.15.80:0/1125456616 learned_addr learned my addr 172.21.15.80:0/1125456616 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:39.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f3626ca7700 1 --2- 172.21.15.80:0/1125456616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362006c0a0 0x7f3620072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:39.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f36274a8700 1 -- 172.21.15.80:0/1125456616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362006c0a0 msgr2=0x7f3620072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:39.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f36274a8700 1 --2- 172.21.15.80:0/1125456616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362006c0a0 0x7f3620072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:39.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f36274a8700 1 -- 172.21.15.80:0/1125456616 >> v1:172.21.15.80:6789/0 conn(0x7f36200734e0 legacy=0x7f3620071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:39.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f3625ca5700 1 -- 172.21.15.80:0/1125456616 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074170064 0 0) 0x7f36080013f0 con 0x7f36200734e0 2019-11-28T11:57:39.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f36274a8700 1 -- 172.21.15.80:0/1125456616 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620070a40 con 0x7f3620072620 2019-11-28T11:57:39.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f36274a8700 1 --2- 172.21.15.80:0/1125456616 >> v2:172.21.15.80:3300/0 conn(0x7f3620072620 0x7f3620164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f361800f6b0 tx=0x7f361800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:39.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f36274a8700 1 --2- 172.21.15.80:0/1125456616 >> v2:172.21.15.80:3300/0 conn(0x7f3620072620 0x7f3620164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f361800f6b0 tx=0x7f361800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:39.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f36274a8700 1 --2- 172.21.15.80:0/1125456616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620072620 0x7f3620164d70 secure :-1 s=READY pgs=2681 cs=0 l=1 rx=0x7f361800f6b0 tx=0x7f361800fa50).ready entity=mon.0 client_cookie=e2bb14aec5ad00a5 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:39.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f36274a8700 1 --2- 172.21.15.80:0/1125456616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620072620 0x7f3620164d70 secure :-1 s=THROTTLE_DONE pgs=2681 cs=0 l=1 rx=0x7f361800f6b0 tx=0x7f361800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:39.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f3625ca5700 1 -- 172.21.15.80:0/1125456616 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3618000a70 con 0x7f3620072620 2019-11-28T11:57:39.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f36274a8700 1 --2- 172.21.15.80:0/1125456616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620072620 0x7f3620164d70 secure :-1 s=THROTTLE_DONE pgs=2681 cs=0 l=1 rx=0x7f361800f6b0 tx=0x7f361800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:39.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f36274a8700 1 --2- 172.21.15.80:0/1125456616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620072620 0x7f3620164d70 secure :-1 s=THROTTLE_DONE pgs=2681 cs=0 l=1 rx=0x7f361800f6b0 tx=0x7f361800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:39.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f3625ca5700 1 -- 172.21.15.80:0/1125456616 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36180010e0 con 0x7f3620072620 2019-11-28T11:57:39.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f3625ca5700 1 -- 172.21.15.80:0/1125456616 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36180017b0 con 0x7f3620072620 2019-11-28T11:57:39.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f362870a700 1 -- 172.21.15.80:0/1125456616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620072620 msgr2=0x7f3620164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:39.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.893+0000 7f362870a700 1 --2- 172.21.15.80:0/1125456616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620072620 0x7f3620164d70 secure :-1 s=READY pgs=2681 cs=0 l=1 rx=0x7f361800f6b0 tx=0x7f361800fa50).stop 2019-11-28T11:57:39.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.894+0000 7f362870a700 1 -- 172.21.15.80:0/1125456616 shutdown_connections 2019-11-28T11:57:39.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.894+0000 7f362870a700 1 --2- 172.21.15.80:0/1125456616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620072620 0x7f3620164d70 unknown :-1 s=CLOSED pgs=2681 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:39.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.894+0000 7f362870a700 1 --2- 172.21.15.80:0/1125456616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362006c0a0 0x7f3620072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:39.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.894+0000 7f362870a700 1 -- 172.21.15.80:0/1125456616 shutdown_connections 2019-11-28T11:57:39.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.894+0000 7f362870a700 1 -- 172.21.15.80:0/1125456616 wait complete. 2019-11-28T11:57:39.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.894+0000 7f362870a700 1 -- 172.21.15.80:0/1125456616 >> 172.21.15.80:0/1125456616 conn(0x7f3620061cf0 msgr2=0x7f3620064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:39.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.896+0000 7f362870a700 1 Processor -- start 2019-11-28T11:57:39.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.896+0000 7f362870a700 1 -- start start 2019-11-28T11:57:39.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.897+0000 7f362870a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3620104820 0x7f362010c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:39.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.897+0000 7f362870a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362013bcd0 con 0x7f362010c890 2019-11-28T11:57:39.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.897+0000 7f362870a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3620105ea0 con 0x7f362010b9d0 2019-11-28T11:57:39.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.897+0000 7f362870a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3620109130 con 0x7f3620104820 2019-11-28T11:57:39.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.897+0000 7f3626ca7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3620104820 0x7f362010c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:39.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.897+0000 7f36264a6700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f362010c890 0x7f362010b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45166/0 (socket says 172.21.15.80:45166) 2019-11-28T11:57:39.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.897+0000 7f36264a6700 1 -- 172.21.15.80:0/892450943 learned_addr learned my addr 172.21.15.80:0/892450943 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:39.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.897+0000 7f361f7fe700 1 -- 172.21.15.80:0/892450943 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137948270 0 0) 0x7f36080014e0 con 0x7f362010c890 2019-11-28T11:57:39.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.897+0000 7f361f7fe700 1 -- 172.21.15.80:0/892450943 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3604002e80 con 0x7f362010c890 2019-11-28T11:57:39.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.898+0000 7f3626ca7700 1 -- 172.21.15.80:0/892450943 >> v1:172.21.15.174:6789/0 conn(0x7f362010b9d0 legacy=0x7f3620167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:39.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.898+0000 7f3626ca7700 1 -- 172.21.15.80:0/892450943 >> v1:172.21.15.80:6789/0 conn(0x7f362010c890 legacy=0x7f362010b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:39.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.898+0000 7f3626ca7700 1 -- 172.21.15.80:0/892450943 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620109a90 con 0x7f3620104820 2019-11-28T11:57:39.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.898+0000 7f3626ca7700 1 --2- 172.21.15.80:0/892450943 >> v2:172.21.15.80:3300/0 conn(0x7f3620104820 0x7f362010c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f36100103b0 tx=0x7f3610010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:39.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.898+0000 7f3626ca7700 1 --2- 172.21.15.80:0/892450943 >> v2:172.21.15.80:3300/0 conn(0x7f3620104820 0x7f362010c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f36100103b0 tx=0x7f3610010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:39.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.898+0000 7f3626ca7700 1 --2- 172.21.15.80:0/892450943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620104820 0x7f362010c350 secure :-1 s=READY pgs=2683 cs=0 l=1 rx=0x7f36100103b0 tx=0x7f3610010750).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:39.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.898+0000 7f3626ca7700 1 --2- 172.21.15.80:0/892450943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620104820 0x7f362010c350 secure :-1 s=THROTTLE_DONE pgs=2683 cs=0 l=1 rx=0x7f36100103b0 tx=0x7f3610010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:39.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.898+0000 7f361f7fe700 1 -- 172.21.15.80:0/892450943 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3610005180 con 0x7f3620104820 2019-11-28T11:57:39.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.898+0000 7f3626ca7700 1 --2- 172.21.15.80:0/892450943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620104820 0x7f362010c350 secure :-1 s=THROTTLE_DONE pgs=2683 cs=0 l=1 rx=0x7f36100103b0 tx=0x7f3610010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:39.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.898+0000 7f361f7fe700 1 -- 172.21.15.80:0/892450943 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3610005180 con 0x7f3620104820 2019-11-28T11:57:39.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.898+0000 7f362870a700 1 -- 172.21.15.80:0/892450943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3620109e10 con 0x7f3620104820 2019-11-28T11:57:39.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.898+0000 7f3626ca7700 1 --2- 172.21.15.80:0/892450943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620104820 0x7f362010c350 secure :-1 s=THROTTLE_DONE pgs=2683 cs=0 l=1 rx=0x7f36100103b0 tx=0x7f3610010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:39.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.898+0000 7f361f7fe700 1 -- 172.21.15.80:0/892450943 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3610005a70 con 0x7f3620104820 2019-11-28T11:57:39.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.898+0000 7f362870a700 1 -- 172.21.15.80:0/892450943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3620109a90 con 0x7f3620104820 2019-11-28T11:57:39.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.898+0000 7f3626ca7700 1 --2- 172.21.15.80:0/892450943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620104820 0x7f362010c350 secure :-1 s=THROTTLE_DONE pgs=2683 cs=0 l=1 rx=0x7f36100103b0 tx=0x7f3610010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:39.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.899+0000 7f361f7fe700 1 -- 172.21.15.80:0/892450943 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3610005650 con 0x7f3620104820 2019-11-28T11:57:39.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.899+0000 7f3626ca7700 1 --2- 172.21.15.80:0/892450943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620104820 0x7f362010c350 secure :-1 s=THROTTLE_DONE pgs=2683 cs=0 l=1 rx=0x7f36100103b0 tx=0x7f3610010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:39.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.899+0000 7f361f7fe700 1 --2- 172.21.15.80:0/892450943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3604018770 0x7f360401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:39.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.899+0000 7f361f7fe700 1 -- 172.21.15.80:0/892450943 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3610031af0 con 0x7f3620104820 2019-11-28T11:57:39.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.899+0000 7f36264a6700 1 --2- 172.21.15.80:0/892450943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3604018770 0x7f360401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:39.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.899+0000 7f36264a6700 1 --2- 172.21.15.80:0/892450943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3604018770 0x7f360401abe0 crc :-1 s=READY pgs=1114 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:39.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.906+0000 7f362870a700 1 -- 172.21.15.80:0/892450943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3620109e10 con 0x7f3620104820 2019-11-28T11:57:39.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.910+0000 7f3626ca7700 1 --2- 172.21.15.80:0/892450943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620104820 0x7f362010c350 secure :-1 s=THROTTLE_DONE pgs=2683 cs=0 l=1 rx=0x7f36100103b0 tx=0x7f3610010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:39.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:39.910+0000 7f361f7fe700 1 -- 172.21.15.80:0/892450943 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3610005440 con 0x7f3620104820 2019-11-28T11:57:40.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.085+0000 7f362870a700 1 -- 172.21.15.80:0/892450943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3620109a90 con 0x7f3620104820 2019-11-28T11:57:40.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.086+0000 7f3626ca7700 1 --2- 172.21.15.80:0/892450943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620104820 0x7f362010c350 secure :-1 s=THROTTLE_DONE pgs=2683 cs=0 l=1 rx=0x7f36100103b0 tx=0x7f3610010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.086+0000 7f361f7fe700 1 -- 172.21.15.80:0/892450943 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f3610005650 con 0x7f3620104820 2019-11-28T11:57:40.084 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:57:40.085 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":203,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:54:30.203239+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:54:27.540791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":33,"pool_name":"cephfs_data","create_time":"2019-11-28T11:54:28.225144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:57:40.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.088+0000 7f362870a700 1 -- 172.21.15.80:0/892450943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3604018770 msgr2=0x7f360401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.088+0000 7f362870a700 1 --2- 172.21.15.80:0/892450943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3604018770 0x7f360401abe0 crc :-1 s=READY pgs=1114 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:40.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.088+0000 7f362870a700 1 -- 172.21.15.80:0/892450943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620104820 msgr2=0x7f362010c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.088+0000 7f362870a700 1 --2- 172.21.15.80:0/892450943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620104820 0x7f362010c350 secure :-1 s=READY pgs=2683 cs=0 l=1 rx=0x7f36100103b0 tx=0x7f3610010750).stop 2019-11-28T11:57:40.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.088+0000 7f362870a700 1 -- 172.21.15.80:0/892450943 shutdown_connections 2019-11-28T11:57:40.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.088+0000 7f362870a700 1 --2- 172.21.15.80:0/892450943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3604018770 0x7f360401abe0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:40.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.088+0000 7f362870a700 1 --2- 172.21.15.80:0/892450943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3620104820 0x7f362010c350 unknown :-1 s=CLOSED pgs=2683 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:40.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.089+0000 7f362870a700 1 -- 172.21.15.80:0/892450943 shutdown_connections 2019-11-28T11:57:40.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.089+0000 7f362870a700 1 -- 172.21.15.80:0/892450943 wait complete. 2019-11-28T11:57:40.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.089+0000 7f362870a700 1 -- 172.21.15.80:0/892450943 >> 172.21.15.80:0/892450943 conn(0x7f362013d620 msgr2=0x7f362013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:40.096 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:54:27.540791+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 32, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'202', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:54:28.225144+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 33, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'203', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:57:40.097 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:57:40.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.222+0000 7f6a61a4b700 1 Processor -- start 2019-11-28T11:57:40.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.223+0000 7f6a61a4b700 1 -- start start 2019-11-28T11:57:40.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.223+0000 7f6a61a4b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6a5c15f100 0x7f6a5c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a61a4b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a5c06c2f0 0x7f6a5c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a61a4b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c06db60 con 0x7f6a5c15ed10 2019-11-28T11:57:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a61a4b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5c06fe00 con 0x7f6a5c06c2f0 2019-11-28T11:57:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a61a4b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5c0700d0 con 0x7f6a5c15f100 2019-11-28T11:57:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a5c06c2f0 0x7f6a5c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5b7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6a5c15ed10 0x7f6a5c073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45174/0 (socket says 172.21.15.80:45174) 2019-11-28T11:57:40.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5b7fe700 1 -- 172.21.15.80:0/3410599118 learned_addr learned my addr 172.21.15.80:0/3410599118 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:40.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5affd700 1 --2- 172.21.15.80:0/3410599118 >> v2:172.21.15.174:3300/0 conn(0x7f6a5c15f100 0x7f6a5c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:40.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5bfff700 1 -- 172.21.15.80:0/3410599118 >> v2:172.21.15.174:3300/0 conn(0x7f6a5c15f100 msgr2=0x7f6a5c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:40.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/3410599118 >> v2:172.21.15.174:3300/0 conn(0x7f6a5c15f100 0x7f6a5c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:40.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5bfff700 1 -- 172.21.15.80:0/3410599118 >> v1:172.21.15.80:6789/0 conn(0x7f6a5c15ed10 legacy=0x7f6a5c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5bfff700 1 -- 172.21.15.80:0/3410599118 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c070760 con 0x7f6a5c06c2f0 2019-11-28T11:57:40.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5a7fc700 1 -- 172.21.15.80:0/3410599118 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178924714 0 0) 0x7f6a4c001150 con 0x7f6a5c15ed10 2019-11-28T11:57:40.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/3410599118 >> v2:172.21.15.80:3300/0 conn(0x7f6a5c06c2f0 0x7f6a5c06c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6a4400b2d0 tx=0x7f6a4400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/3410599118 >> v2:172.21.15.80:3300/0 conn(0x7f6a5c06c2f0 0x7f6a5c06c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6a4400b2d0 tx=0x7f6a4400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/3410599118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c06c2f0 0x7f6a5c06c770 secure :-1 s=READY pgs=2685 cs=0 l=1 rx=0x7f6a4400b2d0 tx=0x7f6a4400b5d0).ready entity=mon.0 client_cookie=a2a6c9bcdd747a04 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:40.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/3410599118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c06c2f0 0x7f6a5c06c770 secure :-1 s=THROTTLE_DONE pgs=2685 cs=0 l=1 rx=0x7f6a4400b2d0 tx=0x7f6a4400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5a7fc700 1 -- 172.21.15.80:0/3410599118 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a44009f20 con 0x7f6a5c06c2f0 2019-11-28T11:57:40.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/3410599118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c06c2f0 0x7f6a5c06c770 secure :-1 s=THROTTLE_DONE pgs=2685 cs=0 l=1 rx=0x7f6a4400b2d0 tx=0x7f6a4400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/3410599118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c06c2f0 0x7f6a5c06c770 secure :-1 s=THROTTLE_DONE pgs=2685 cs=0 l=1 rx=0x7f6a4400b2d0 tx=0x7f6a4400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5a7fc700 1 -- 172.21.15.80:0/3410599118 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a44009b40 con 0x7f6a5c06c2f0 2019-11-28T11:57:40.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a5a7fc700 1 -- 172.21.15.80:0/3410599118 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a4400a500 con 0x7f6a5c06c2f0 2019-11-28T11:57:40.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a61a4b700 1 -- 172.21.15.80:0/3410599118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c06c2f0 msgr2=0x7f6a5c06c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.224+0000 7f6a61a4b700 1 --2- 172.21.15.80:0/3410599118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c06c2f0 0x7f6a5c06c770 secure :-1 s=READY pgs=2685 cs=0 l=1 rx=0x7f6a4400b2d0 tx=0x7f6a4400b5d0).stop 2019-11-28T11:57:40.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.225+0000 7f6a61a4b700 1 -- 172.21.15.80:0/3410599118 shutdown_connections 2019-11-28T11:57:40.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.225+0000 7f6a61a4b700 1 --2- 172.21.15.80:0/3410599118 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a5c06c2f0 0x7f6a5c06c770 unknown :-1 s=CLOSED pgs=2685 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:40.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.225+0000 7f6a61a4b700 1 --2- 172.21.15.80:0/3410599118 >> v2:172.21.15.174:3300/0 conn(0x7f6a5c15f100 0x7f6a5c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:40.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.225+0000 7f6a61a4b700 1 -- 172.21.15.80:0/3410599118 shutdown_connections 2019-11-28T11:57:40.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.225+0000 7f6a61a4b700 1 -- 172.21.15.80:0/3410599118 wait complete. 2019-11-28T11:57:40.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.225+0000 7f6a61a4b700 1 -- 172.21.15.80:0/3410599118 >> 172.21.15.80:0/3410599118 conn(0x7f6a5c061d20 msgr2=0x7f6a5c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:40.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.228+0000 7f6a61a4b700 1 Processor -- start 2019-11-28T11:57:40.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.228+0000 7f6a61a4b700 1 -- start start 2019-11-28T11:57:40.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a61a4b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a5c148320 0x7f6a5c10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:40.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a61a4b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c148e00 con 0x7f6a5c10e3d0 2019-11-28T11:57:40.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a61a4b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c108b10 con 0x7f6a5c10f290 2019-11-28T11:57:40.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a61a4b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c139ff0 con 0x7f6a5c148320 2019-11-28T11:57:40.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a5bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6a5c10e3d0 0x7f6a5c168d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45184/0 (socket says 172.21.15.80:45184) 2019-11-28T11:57:40.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a5bfff700 1 -- 172.21.15.80:0/2936087497 learned_addr learned my addr 172.21.15.80:0/2936087497 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:40.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a5b7fe700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a5c148320 0x7f6a5c10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:40.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007186607 0 0) 0x7f6a44000cc0 con 0x7f6a5c10e3d0 2019-11-28T11:57:40.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a34002e80 con 0x7f6a5c10e3d0 2019-11-28T11:57:40.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225245501 0 0) 0x7f6a54000ea0 con 0x7f6a5c10f290 2019-11-28T11:57:40.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a340030b0 con 0x7f6a5c10f290 2019-11-28T11:57:40.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 474580173 0 0) 0x7f6a44000ee0 con 0x7f6a5c10e3d0 2019-11-28T11:57:40.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6a340033c0 con 0x7f6a5c10e3d0 2019-11-28T11:57:40.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f6a44009f00 con 0x7f6a5c10e3d0 2019-11-28T11:57:40.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a5c148320 msgr2=0x7f6a5c10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a5c148320 0x7f6a5c10ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:40.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 >> v1:172.21.15.174:6789/0 conn(0x7f6a5c10f290 legacy=0x7f6a5c10dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 >> v1:172.21.15.80:6789/0 conn(0x7f6a5c10e3d0 legacy=0x7f6a5c168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a34005d40 0x7f6a34006130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:40.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a340046f0 0x7f6a34004b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:40.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340051e0 0x7f6a340032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:40.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34003a90 con 0x7f6a340051e0 2019-11-28T11:57:40.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34003cc0 con 0x7f6a340046f0 2019-11-28T11:57:40.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34003ef0 con 0x7f6a34005d40 2019-11-28T11:57:40.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a5b7fe700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a5c148320 0x7f6a5c10ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:57:40.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340051e0 0x7f6a340032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:40.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.229+0000 7f6a5affd700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a340046f0 0x7f6a34004b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:40.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a5b7fe700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a34005d40 0x7f6a34006130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:40.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a5bfff700 1 -- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a34005d40 msgr2=0x7f6a34006130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a34005d40 0x7f6a34006130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:40.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a5bfff700 1 -- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a340046f0 msgr2=0x7f6a34004b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a340046f0 0x7f6a34004b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:40.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a5bfff700 1 -- 172.21.15.80:0/2936087497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a340041a0 con 0x7f6a340051e0 2019-11-28T11:57:40.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a61a4b700 1 -- 172.21.15.80:0/2936087497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c10c810 con 0x7f6a340051e0 2019-11-28T11:57:40.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340051e0 0x7f6a340032e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6a44010770 tx=0x7f6a44010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a61a4b700 1 -- 172.21.15.80:0/2936087497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c10c490 con 0x7f6a340051e0 2019-11-28T11:57:40.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340051e0 0x7f6a340032e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6a44010770 tx=0x7f6a44010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340051e0 0x7f6a340032e0 secure :-1 s=READY pgs=2687 cs=0 l=1 rx=0x7f6a44010770 tx=0x7f6a44010620).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:40.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340051e0 0x7f6a340032e0 secure :-1 s=THROTTLE_DONE pgs=2687 cs=0 l=1 rx=0x7f6a44010770 tx=0x7f6a44010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a44000fa0 con 0x7f6a340051e0 2019-11-28T11:57:40.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340051e0 0x7f6a340032e0 secure :-1 s=THROTTLE_DONE pgs=2687 cs=0 l=1 rx=0x7f6a44010770 tx=0x7f6a44010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a44000cc0 con 0x7f6a340051e0 2019-11-28T11:57:40.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340051e0 0x7f6a340032e0 secure :-1 s=THROTTLE_DONE pgs=2687 cs=0 l=1 rx=0x7f6a44010770 tx=0x7f6a44010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a44009ef0 con 0x7f6a340051e0 2019-11-28T11:57:40.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.230+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340051e0 0x7f6a340032e0 secure :-1 s=THROTTLE_DONE pgs=2687 cs=0 l=1 rx=0x7f6a44010770 tx=0x7f6a44010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.231+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6a44009b10 con 0x7f6a340051e0 2019-11-28T11:57:40.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.231+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340051e0 0x7f6a340032e0 secure :-1 s=THROTTLE_DONE pgs=2687 cs=0 l=1 rx=0x7f6a44010770 tx=0x7f6a44010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.231+0000 7f6a53fff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a34020b90 0x7f6a34022fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.231+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6a44031ff0 con 0x7f6a340051e0 2019-11-28T11:57:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.231+0000 7f6a5b7fe700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a34020b90 0x7f6a34022fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.231+0000 7f6a5b7fe700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a34020b90 0x7f6a34022fc0 crc :-1 s=READY pgs=1115 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:40.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.238+0000 7f6a61a4b700 1 -- 172.21.15.80:0/2936087497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a38002e60 con 0x7f6a340051e0 2019-11-28T11:57:40.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.241+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340051e0 0x7f6a340032e0 secure :-1 s=THROTTLE_DONE pgs=2687 cs=0 l=1 rx=0x7f6a44010770 tx=0x7f6a44010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.241+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6a44009900 con 0x7f6a340051e0 2019-11-28T11:57:40.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.408+0000 7f6a61a4b700 1 -- 172.21.15.80:0/2936087497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f6a38001d20 con 0x7f6a340051e0 2019-11-28T11:57:40.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.409+0000 7f6a5bfff700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340051e0 0x7f6a340032e0 secure :-1 s=THROTTLE_DONE pgs=2687 cs=0 l=1 rx=0x7f6a44010770 tx=0x7f6a44010620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.409+0000 7f6a53fff700 1 -- 172.21.15.80:0/2936087497 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v203) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6a44017a40 con 0x7f6a340051e0 2019-11-28T11:57:40.406 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:57:40.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.411+0000 7f6a61a4b700 1 -- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a34020b90 msgr2=0x7f6a34022fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.411+0000 7f6a61a4b700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a34020b90 0x7f6a34022fc0 crc :-1 s=READY pgs=1115 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:40.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.411+0000 7f6a61a4b700 1 -- 172.21.15.80:0/2936087497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340051e0 msgr2=0x7f6a340032e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.411+0000 7f6a61a4b700 1 --2- 172.21.15.80:0/2936087497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a340051e0 0x7f6a340032e0 secure :-1 s=READY pgs=2687 cs=0 l=1 rx=0x7f6a44010770 tx=0x7f6a44010620).stop 2019-11-28T11:57:40.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.411+0000 7f6a5bfff700 1 -- 172.21.15.80:0/2936087497 reap_dead start 2019-11-28T11:57:40.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.411+0000 7f6a5bfff700 1 -- 172.21.15.80:0/2936087497 reap_dead start 2019-11-28T11:57:40.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.411+0000 7f6a61a4b700 1 -- 172.21.15.80:0/2936087497 shutdown_connections 2019-11-28T11:57:40.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.411+0000 7f6a61a4b700 1 -- 172.21.15.80:0/2936087497 shutdown_connections 2019-11-28T11:57:40.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.411+0000 7f6a61a4b700 1 -- 172.21.15.80:0/2936087497 wait complete. 2019-11-28T11:57:40.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.411+0000 7f6a61a4b700 1 -- 172.21.15.80:0/2936087497 >> 172.21.15.80:0/2936087497 conn(0x7f6a5c15e2d0 msgr2=0x7f6a5c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:40.418 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:57:40.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.543+0000 7fc60d4c5700 1 Processor -- start 2019-11-28T11:57:40.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.543+0000 7fc60d4c5700 1 -- start start 2019-11-28T11:57:40.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.544+0000 7fc60d4c5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc60815ed10 0x7fc60815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:40.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.544+0000 7fc60d4c5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60806db60 con 0x7fc608073020 2019-11-28T11:57:40.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.544+0000 7fc60d4c5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60806e060 con 0x7fc6080734b0 2019-11-28T11:57:40.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.544+0000 7fc60d4c5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60806fe00 con 0x7fc60815ed10 2019-11-28T11:57:40.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.544+0000 7fc6077fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc60815ed10 0x7fc60815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:40.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.544+0000 7fc606ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc608073020 0x7fc608071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45198/0 (socket says 172.21.15.80:45198) 2019-11-28T11:57:40.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.544+0000 7fc606ffd700 1 -- 172.21.15.80:0/3665512564 learned_addr learned my addr 172.21.15.80:0/3665512564 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:40.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.545+0000 7fc6077fe700 1 -- 172.21.15.80:0/3665512564 >> v1:172.21.15.174:6789/0 conn(0x7fc6080734b0 legacy=0x7fc6080726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:40.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.545+0000 7fc6077fe700 1 -- 172.21.15.80:0/3665512564 >> v1:172.21.15.80:6789/0 conn(0x7fc608073020 legacy=0x7fc608071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.545+0000 7fc6077fe700 1 -- 172.21.15.80:0/3665512564 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc608070760 con 0x7fc60815ed10 2019-11-28T11:57:40.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.545+0000 7fc6067fc700 1 -- 172.21.15.80:0/3665512564 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233364890 0 0) 0x7fc5f8001070 con 0x7fc608073020 2019-11-28T11:57:40.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.545+0000 7fc6077fe700 1 --2- 172.21.15.80:0/3665512564 >> v2:172.21.15.80:3300/0 conn(0x7fc60815ed10 0x7fc60815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc5fc00af50 tx=0x7fc5fc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.545+0000 7fc6077fe700 1 --2- 172.21.15.80:0/3665512564 >> v2:172.21.15.80:3300/0 conn(0x7fc60815ed10 0x7fc60815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc5fc00af50 tx=0x7fc5fc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.545+0000 7fc6077fe700 1 --2- 172.21.15.80:0/3665512564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc60815ed10 0x7fc60815f100 secure :-1 s=READY pgs=2689 cs=0 l=1 rx=0x7fc5fc00af50 tx=0x7fc5fc00b760).ready entity=mon.0 client_cookie=37b2cee3198eb30c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:40.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.545+0000 7fc6077fe700 1 --2- 172.21.15.80:0/3665512564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc60815ed10 0x7fc60815f100 secure :-1 s=THROTTLE_DONE pgs=2689 cs=0 l=1 rx=0x7fc5fc00af50 tx=0x7fc5fc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.545+0000 7fc6067fc700 1 -- 172.21.15.80:0/3665512564 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5fc000960 con 0x7fc60815ed10 2019-11-28T11:57:40.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.545+0000 7fc6077fe700 1 --2- 172.21.15.80:0/3665512564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc60815ed10 0x7fc60815f100 secure :-1 s=THROTTLE_DONE pgs=2689 cs=0 l=1 rx=0x7fc5fc00af50 tx=0x7fc5fc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.545+0000 7fc6077fe700 1 --2- 172.21.15.80:0/3665512564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc60815ed10 0x7fc60815f100 secure :-1 s=THROTTLE_DONE pgs=2689 cs=0 l=1 rx=0x7fc5fc00af50 tx=0x7fc5fc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.545+0000 7fc6067fc700 1 -- 172.21.15.80:0/3665512564 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc009860 con 0x7fc60815ed10 2019-11-28T11:57:40.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.545+0000 7fc6067fc700 1 -- 172.21.15.80:0/3665512564 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5fc009f30 con 0x7fc60815ed10 2019-11-28T11:57:40.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.545+0000 7fc60d4c5700 1 -- 172.21.15.80:0/3665512564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc60815ed10 msgr2=0x7fc60815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.545+0000 7fc60d4c5700 1 --2- 172.21.15.80:0/3665512564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc60815ed10 0x7fc60815f100 secure :-1 s=READY pgs=2689 cs=0 l=1 rx=0x7fc5fc00af50 tx=0x7fc5fc00b760).stop 2019-11-28T11:57:40.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.546+0000 7fc60d4c5700 1 -- 172.21.15.80:0/3665512564 shutdown_connections 2019-11-28T11:57:40.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.546+0000 7fc60d4c5700 1 --2- 172.21.15.80:0/3665512564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc60815ed10 0x7fc60815f100 unknown :-1 s=CLOSED pgs=2689 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:40.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.546+0000 7fc60d4c5700 1 -- 172.21.15.80:0/3665512564 shutdown_connections 2019-11-28T11:57:40.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.546+0000 7fc60d4c5700 1 -- 172.21.15.80:0/3665512564 wait complete. 2019-11-28T11:57:40.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.546+0000 7fc60d4c5700 1 -- 172.21.15.80:0/3665512564 >> 172.21.15.80:0/3665512564 conn(0x7fc608061d20 msgr2=0x7fc6080641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:40.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.548+0000 7fc60d4c5700 1 Processor -- start 2019-11-28T11:57:40.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.548+0000 7fc60d4c5700 1 -- start start 2019-11-28T11:57:40.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.549+0000 7fc60d4c5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc60810cbb0 0x7fc60810d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:40.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.549+0000 7fc60d4c5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc60810d580 0x7fc60816ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:40.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.549+0000 7fc60d4c5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6081057a0 con 0x7fc608153db0 2019-11-28T11:57:40.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.549+0000 7fc60d4c5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc608106280 con 0x7fc60810d580 2019-11-28T11:57:40.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.549+0000 7fc60d4c5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc608106550 con 0x7fc60810cbb0 2019-11-28T11:57:40.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.549+0000 7fc607fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc60810d580 0x7fc60816ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:40.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.549+0000 7fc606ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc60810cbb0 0x7fc60810d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:40.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.549+0000 7fc607fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc60810d580 0x7fc60816ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:60770/0 (socket says 172.21.15.80:60770) 2019-11-28T11:57:40.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.549+0000 7fc607fff700 1 -- 172.21.15.80:0/1855207882 learned_addr learned my addr 172.21.15.80:0/1855207882 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:40.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.550+0000 7fc606ffd700 1 -- 172.21.15.80:0/1855207882 >> v2:172.21.15.174:3300/0 conn(0x7fc60810d580 msgr2=0x7fc60816ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.550+0000 7fc606ffd700 1 --2- 172.21.15.80:0/1855207882 >> v2:172.21.15.174:3300/0 conn(0x7fc60810d580 0x7fc60816ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:40.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.550+0000 7fc606ffd700 1 -- 172.21.15.80:0/1855207882 >> v1:172.21.15.174:6789/0 conn(0x7fc608153db0 legacy=0x7fc60810dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.550+0000 7fc606ffd700 1 -- 172.21.15.80:0/1855207882 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc608106be0 con 0x7fc60810cbb0 2019-11-28T11:57:40.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.550+0000 7fc606ffd700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc60810cbb0 0x7fc60810d040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5f8010330 tx=0x7fc5f80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.550+0000 7fc606ffd700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc60810cbb0 0x7fc60810d040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5f8010330 tx=0x7fc5f80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.550+0000 7fc606ffd700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc60810cbb0 0x7fc60810d040 secure :-1 s=READY pgs=387 cs=0 l=1 rx=0x7fc5f8010330 tx=0x7fc5f80101b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.550+0000 7fc606ffd700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc60810cbb0 0x7fc60810d040 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7fc5f8010330 tx=0x7fc5f80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.550+0000 7fc606ffd700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc60810cbb0 0x7fc60810d040 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7fc5f8010330 tx=0x7fc5f80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.550+0000 7fc5effff700 1 -- 172.21.15.80:0/1855207882 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5f8000df0 con 0x7fc60810cbb0 2019-11-28T11:57:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.550+0000 7fc606ffd700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc60810cbb0 0x7fc60810d040 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7fc5f8010330 tx=0x7fc5f80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.550+0000 7fc5effff700 1 -- 172.21.15.80:0/1855207882 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f80041d0 con 0x7fc60810cbb0 2019-11-28T11:57:40.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.550+0000 7fc5effff700 1 -- 172.21.15.80:0/1855207882 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5f8004920 con 0x7fc60810cbb0 2019-11-28T11:57:40.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.550+0000 7fc60d4c5700 1 -- 172.21.15.80:0/1855207882 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc608106f60 con 0x7fc60810cbb0 2019-11-28T11:57:40.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.550+0000 7fc60d4c5700 1 -- 172.21.15.80:0/1855207882 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc608106be0 con 0x7fc60810cbb0 2019-11-28T11:57:40.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.551+0000 7fc606ffd700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc60810cbb0 0x7fc60810d040 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7fc5f8010330 tx=0x7fc5f80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.551+0000 7fc5effff700 1 -- 172.21.15.80:0/1855207882 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc5f80043c0 con 0x7fc60810cbb0 2019-11-28T11:57:40.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.551+0000 7fc606ffd700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc60810cbb0 0x7fc60810d040 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7fc5f8010330 tx=0x7fc5f80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.551+0000 7fc5effff700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc5e8018730 0x7fc5e801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:40.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.551+0000 7fc5effff700 1 -- 172.21.15.80:0/1855207882 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc5f80319a0 con 0x7fc60810cbb0 2019-11-28T11:57:40.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.551+0000 7fc6077fe700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc5e8018730 0x7fc5e801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:40.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.551+0000 7fc6077fe700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc5e8018730 0x7fc5e801abc0 crc :-1 s=READY pgs=1116 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:40.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.558+0000 7fc60d4c5700 1 -- 172.21.15.80:0/1855207882 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc608106f60 con 0x7fc60810cbb0 2019-11-28T11:57:40.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.563+0000 7fc606ffd700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc60810cbb0 0x7fc60810d040 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7fc5f8010330 tx=0x7fc5f80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.563+0000 7fc5effff700 1 -- 172.21.15.80:0/1855207882 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc5f8001230 con 0x7fc60810cbb0 2019-11-28T11:57:40.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.726+0000 7fc60d4c5700 1 -- 172.21.15.80:0/1855207882 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fc608106be0 con 0x7fc60810cbb0 2019-11-28T11:57:40.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.727+0000 7fc606ffd700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc60810cbb0 0x7fc60810d040 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7fc5f8010330 tx=0x7fc5f80101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.727+0000 7fc5effff700 1 -- 172.21.15.80:0/1855207882 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v203) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc5f80043c0 con 0x7fc60810cbb0 2019-11-28T11:57:40.725 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:57:40.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.729+0000 7fc60d4c5700 1 -- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc5e8018730 msgr2=0x7fc5e801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.729+0000 7fc60d4c5700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc5e8018730 0x7fc5e801abc0 crc :-1 s=READY pgs=1116 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:40.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.729+0000 7fc60d4c5700 1 -- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc60810cbb0 msgr2=0x7fc60810d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.729+0000 7fc60d4c5700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc60810cbb0 0x7fc60810d040 secure :-1 s=READY pgs=387 cs=0 l=1 rx=0x7fc5f8010330 tx=0x7fc5f80101b0).stop 2019-11-28T11:57:40.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.729+0000 7fc60d4c5700 1 -- 172.21.15.80:0/1855207882 shutdown_connections 2019-11-28T11:57:40.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.729+0000 7fc60d4c5700 1 --2- 172.21.15.80:0/1855207882 >> v2:172.21.15.174:3300/0 conn(0x7fc60810d580 0x7fc60816ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:40.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.729+0000 7fc60d4c5700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc60810cbb0 0x7fc60810d040 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:40.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.729+0000 7fc60d4c5700 1 --2- 172.21.15.80:0/1855207882 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc5e8018730 0x7fc5e801abc0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.729+0000 7fc60d4c5700 1 -- 172.21.15.80:0/1855207882 shutdown_connections 2019-11-28T11:57:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.729+0000 7fc60d4c5700 1 -- 172.21.15.80:0/1855207882 wait complete. 2019-11-28T11:57:40.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.729+0000 7fc60d4c5700 1 -- 172.21.15.80:0/1855207882 >> 172.21.15.80:0/1855207882 conn(0x7fc60815e2d0 msgr2=0x7fc608147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:40.737 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:57:40.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.883+0000 7f9fb0420700 1 Processor -- start 2019-11-28T11:57:40.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.883+0000 7f9fb0420700 1 -- start start 2019-11-28T11:57:40.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.884+0000 7f9fb0420700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9fa815ed10 0x7f9fa815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:40.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.884+0000 7f9fb0420700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9fa8073020 0x7f9fa8071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.884+0000 7f9fb0420700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fa80734b0 0x7f9fa80723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.884+0000 7f9fb0420700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa806fe00 con 0x7f9fa815ed10 2019-11-28T11:57:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.884+0000 7f9fb0420700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa80700d0 con 0x7f9fa8073020 2019-11-28T11:57:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.884+0000 7f9fb0420700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa806f3d0 con 0x7f9fa80734b0 2019-11-28T11:57:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.884+0000 7f9fae9bd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9fa815ed10 0x7f9fa815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:40.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.884+0000 7f9fae9bd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9fa815ed10 0x7f9fa815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45892/0 (socket says 172.21.15.80:45892) 2019-11-28T11:57:40.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.884+0000 7f9fae9bd700 1 -- 172.21.15.80:0/896921779 learned_addr learned my addr 172.21.15.80:0/896921779 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:40.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fae1bc700 1 --2- 172.21.15.80:0/896921779 >> v2:172.21.15.174:3300/0 conn(0x7f9fa8073020 0x7f9fa8071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:40.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9faf1be700 1 --2- 172.21.15.80:0/896921779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fa80734b0 0x7f9fa80723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:40.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fae9bd700 1 -- 172.21.15.80:0/896921779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fa80734b0 msgr2=0x7f9fa80723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:40.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fae9bd700 1 --2- 172.21.15.80:0/896921779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fa80734b0 0x7f9fa80723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:40.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fae9bd700 1 -- 172.21.15.80:0/896921779 >> v2:172.21.15.174:3300/0 conn(0x7f9fa8073020 msgr2=0x7f9fa8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:40.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fae9bd700 1 --2- 172.21.15.80:0/896921779 >> v2:172.21.15.174:3300/0 conn(0x7f9fa8073020 0x7f9fa8071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:40.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fae9bd700 1 -- 172.21.15.80:0/896921779 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa8070760 con 0x7f9fa815ed10 2019-11-28T11:57:40.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fae9bd700 1 --2- 172.21.15.80:0/896921779 >> v2:172.21.15.80:3300/0 conn(0x7f9fa815ed10 0x7f9fa815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9f9000fa40 tx=0x7f9f9000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fae9bd700 1 --2- 172.21.15.80:0/896921779 >> v2:172.21.15.80:3300/0 conn(0x7f9fa815ed10 0x7f9fa815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9f9000fa40 tx=0x7f9f9000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fae9bd700 1 --2- 172.21.15.80:0/896921779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa815ed10 0x7f9fa815f100 secure :-1 s=READY pgs=2690 cs=0 l=1 rx=0x7f9f9000fa40 tx=0x7f9f9000f8f0).ready entity=mon.0 client_cookie=828eff1f69e4ed6c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:40.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fae9bd700 1 --2- 172.21.15.80:0/896921779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa815ed10 0x7f9fa815f100 secure :-1 s=THROTTLE_DONE pgs=2690 cs=0 l=1 rx=0x7f9f9000fa40 tx=0x7f9f9000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fae9bd700 1 --2- 172.21.15.80:0/896921779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa815ed10 0x7f9fa815f100 secure :-1 s=THROTTLE_DONE pgs=2690 cs=0 l=1 rx=0x7f9f9000fa40 tx=0x7f9f9000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fad9bb700 1 -- 172.21.15.80:0/896921779 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f90000ce0 con 0x7f9fa815ed10 2019-11-28T11:57:40.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fae9bd700 1 --2- 172.21.15.80:0/896921779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa815ed10 0x7f9fa815f100 secure :-1 s=THROTTLE_DONE pgs=2690 cs=0 l=1 rx=0x7f9f9000fa40 tx=0x7f9f9000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fad9bb700 1 -- 172.21.15.80:0/896921779 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f90001010 con 0x7f9fa815ed10 2019-11-28T11:57:40.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fad9bb700 1 -- 172.21.15.80:0/896921779 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f90001720 con 0x7f9fa815ed10 2019-11-28T11:57:40.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fb0420700 1 -- 172.21.15.80:0/896921779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa815ed10 msgr2=0x7f9fa815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.885+0000 7f9fb0420700 1 --2- 172.21.15.80:0/896921779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa815ed10 0x7f9fa815f100 secure :-1 s=READY pgs=2690 cs=0 l=1 rx=0x7f9f9000fa40 tx=0x7f9f9000f8f0).stop 2019-11-28T11:57:40.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.886+0000 7f9fb0420700 1 -- 172.21.15.80:0/896921779 shutdown_connections 2019-11-28T11:57:40.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.886+0000 7f9fb0420700 1 --2- 172.21.15.80:0/896921779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fa80734b0 0x7f9fa80723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:40.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.886+0000 7f9fb0420700 1 --2- 172.21.15.80:0/896921779 >> v2:172.21.15.174:3300/0 conn(0x7f9fa8073020 0x7f9fa8071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:40.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.886+0000 7f9fb0420700 1 --2- 172.21.15.80:0/896921779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fa815ed10 0x7f9fa815f100 unknown :-1 s=CLOSED pgs=2690 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:40.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.886+0000 7f9fb0420700 1 -- 172.21.15.80:0/896921779 shutdown_connections 2019-11-28T11:57:40.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.886+0000 7f9fb0420700 1 -- 172.21.15.80:0/896921779 wait complete. 2019-11-28T11:57:40.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.886+0000 7f9fb0420700 1 -- 172.21.15.80:0/896921779 >> 172.21.15.80:0/896921779 conn(0x7f9fa8061d20 msgr2=0x7f9fa80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:40.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.888+0000 7f9fb0420700 1 Processor -- start 2019-11-28T11:57:40.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.888+0000 7f9fb0420700 1 -- start start 2019-11-28T11:57:40.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.889+0000 7f9fb0420700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9fa810f9f0 0x7f9fa8168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:40.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.889+0000 7f9fb0420700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa810c250 con 0x7f9fa810ed60 2019-11-28T11:57:40.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.889+0000 7f9fb0420700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa810fe70 con 0x7f9fa810e970 2019-11-28T11:57:40.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.889+0000 7f9fb0420700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa810e430 con 0x7f9fa810f9f0 2019-11-28T11:57:40.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.889+0000 7f9fae1bc700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9fa810ed60 0x7f9fa810f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45218/0 (socket says 172.21.15.80:45218) 2019-11-28T11:57:40.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.889+0000 7f9fae1bc700 1 -- 172.21.15.80:0/582838775 learned_addr learned my addr 172.21.15.80:0/582838775 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:40.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.889+0000 7f9faf1be700 1 --2- 172.21.15.80:0/582838775 >> v2:172.21.15.174:3300/0 conn(0x7f9fa810f9f0 0x7f9fa8168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:40.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9fa77fe700 1 -- 172.21.15.80:0/582838775 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005147848 0 0) 0x7f9f98000fb0 con 0x7f9fa810ed60 2019-11-28T11:57:40.937 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9fa77fe700 1 -- 172.21.15.80:0/582838775 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f8c002e80 con 0x7f9fa810ed60 2019-11-28T11:57:40.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9faf1be700 1 -- 172.21.15.80:0/582838775 >> v1:172.21.15.174:6789/0 conn(0x7f9fa810e970 legacy=0x7f9fa81087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9faf1be700 1 -- 172.21.15.80:0/582838775 >> v1:172.21.15.80:6789/0 conn(0x7f9fa810ed60 legacy=0x7f9fa810f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:40.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9fa77fe700 1 -- 172.21.15.80:0/582838775 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902457495 0 0) 0x7f9f90000d50 con 0x7f9fa810e970 2019-11-28T11:57:40.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9faf1be700 1 -- 172.21.15.80:0/582838775 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa8105ef0 con 0x7f9fa810f9f0 2019-11-28T11:57:40.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9faf1be700 1 --2- 172.21.15.80:0/582838775 >> v2:172.21.15.174:3300/0 conn(0x7f9fa810f9f0 0x7f9fa8168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9fa0014700 tx=0x7f9fa0014aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9faf1be700 1 --2- 172.21.15.80:0/582838775 >> v2:172.21.15.174:3300/0 conn(0x7f9fa810f9f0 0x7f9fa8168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9fa0014700 tx=0x7f9fa0014aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9faf1be700 1 --2- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa810f9f0 0x7f9fa8168d80 secure :-1 s=READY pgs=1619 cs=0 l=1 rx=0x7f9fa0014700 tx=0x7f9fa0014aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:40.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9faf1be700 1 --2- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa810f9f0 0x7f9fa8168d80 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f9fa0014700 tx=0x7f9fa0014aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9fa77fe700 1 -- 172.21.15.80:0/582838775 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fa0000b60 con 0x7f9fa810f9f0 2019-11-28T11:57:40.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9faf1be700 1 --2- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa810f9f0 0x7f9fa8168d80 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f9fa0014700 tx=0x7f9fa0014aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9fa77fe700 1 -- 172.21.15.80:0/582838775 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa000ef30 con 0x7f9fa810f9f0 2019-11-28T11:57:40.940 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9faf1be700 1 --2- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa810f9f0 0x7f9fa8168d80 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f9fa0014700 tx=0x7f9fa0014aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9fb0420700 1 -- 172.21.15.80:0/582838775 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa8106270 con 0x7f9fa810f9f0 2019-11-28T11:57:40.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9fa77fe700 1 -- 172.21.15.80:0/582838775 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fa0000b40 con 0x7f9fa810f9f0 2019-11-28T11:57:40.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.890+0000 7f9fb0420700 1 -- 172.21.15.80:0/582838775 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa8105ef0 con 0x7f9fa810f9f0 2019-11-28T11:57:40.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.891+0000 7f9faf1be700 1 --2- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa810f9f0 0x7f9fa8168d80 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f9fa0014700 tx=0x7f9fa0014aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.891+0000 7f9fa77fe700 1 -- 172.21.15.80:0/582838775 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9fa000f350 con 0x7f9fa810f9f0 2019-11-28T11:57:40.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.891+0000 7f9faf1be700 1 --2- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa810f9f0 0x7f9fa8168d80 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f9fa0014700 tx=0x7f9fa0014aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.891+0000 7f9fa77fe700 1 --2- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f8c018750 0x7f9f8c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:40.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.891+0000 7f9fa77fe700 1 -- 172.21.15.80:0/582838775 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9fa0035e60 con 0x7f9fa810f9f0 2019-11-28T11:57:40.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.891+0000 7f9fae9bd700 1 --2- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f8c018750 0x7f9f8c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:40.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.891+0000 7f9fae9bd700 1 --2- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f8c018750 0x7f9f8c01abe0 crc :-1 s=READY pgs=1117 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:40.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.899+0000 7f9fb0420700 1 -- 172.21.15.80:0/582838775 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa8106270 con 0x7f9fa810f9f0 2019-11-28T11:57:40.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.903+0000 7f9faf1be700 1 --2- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa810f9f0 0x7f9fa8168d80 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f9fa0014700 tx=0x7f9fa0014aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:40.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:40.903+0000 7f9fa77fe700 1 -- 172.21.15.80:0/582838775 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9fa000f120 con 0x7f9fa810f9f0 2019-11-28T11:57:41.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.069+0000 7f9fb0420700 1 -- 172.21.15.80:0/582838775 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f9fa8105ef0 con 0x7f9fa810f9f0 2019-11-28T11:57:41.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.070+0000 7f9faf1be700 1 --2- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa810f9f0 0x7f9fa8168d80 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f9fa0014700 tx=0x7f9fa0014aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:41.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.070+0000 7f9fa77fe700 1 -- 172.21.15.80:0/582838775 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v203) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9fa000f350 con 0x7f9fa810f9f0 2019-11-28T11:57:41.069 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:57:41.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.072+0000 7f9fb0420700 1 -- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f8c018750 msgr2=0x7f9f8c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:41.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.072+0000 7f9fb0420700 1 --2- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f8c018750 0x7f9f8c01abe0 crc :-1 s=READY pgs=1117 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:41.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.072+0000 7f9fb0420700 1 -- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa810f9f0 msgr2=0x7f9fa8168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:41.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.072+0000 7f9fb0420700 1 --2- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa810f9f0 0x7f9fa8168d80 secure :-1 s=READY pgs=1619 cs=0 l=1 rx=0x7f9fa0014700 tx=0x7f9fa0014aa0).stop 2019-11-28T11:57:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.072+0000 7f9fb0420700 1 -- 172.21.15.80:0/582838775 shutdown_connections 2019-11-28T11:57:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.072+0000 7f9fb0420700 1 --2- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa810f9f0 0x7f9fa8168d80 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.072+0000 7f9fb0420700 1 --2- 172.21.15.80:0/582838775 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9f8c018750 0x7f9f8c01abe0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.072+0000 7f9fb0420700 1 -- 172.21.15.80:0/582838775 shutdown_connections 2019-11-28T11:57:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.072+0000 7f9fb0420700 1 -- 172.21.15.80:0/582838775 wait complete. 2019-11-28T11:57:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.072+0000 7f9fb0420700 1 -- 172.21.15.80:0/582838775 >> 172.21.15.80:0/582838775 conn(0x7f9fa815e2d0 msgr2=0x7f9fa8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:41.087 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:57:41.088 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:57:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.214+0000 7f8ad655b700 1 Processor -- start 2019-11-28T11:57:41.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.214+0000 7f8ad655b700 1 -- start start 2019-11-28T11:57:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.215+0000 7f8ad655b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8ad006c490 0x7f8ad006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.215+0000 7f8ad655b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ad006ce60 0x7f8ad0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.215+0000 7f8ad655b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad006db00 con 0x7f8ad006c0a0 2019-11-28T11:57:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.215+0000 7f8ad655b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad006fd60 con 0x7f8ad006ce60 2019-11-28T11:57:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.215+0000 7f8ad655b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad0070030 con 0x7f8ad006c490 2019-11-28T11:57:41.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.215+0000 7f8ad52f9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ad006ce60 0x7f8ad0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:41.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.215+0000 7f8ad52f9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ad006ce60 0x7f8ad0164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45910/0 (socket says 172.21.15.80:45910) 2019-11-28T11:57:41.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.215+0000 7f8acffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8ad006c490 0x7f8ad006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:41.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.215+0000 7f8ad52f9700 1 -- 172.21.15.80:0/2856009165 learned_addr learned my addr 172.21.15.80:0/2856009165 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:41.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.215+0000 7f8ad52f9700 1 -- 172.21.15.80:0/2856009165 >> v2:172.21.15.174:3300/0 conn(0x7f8ad006c490 msgr2=0x7f8ad006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:41.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.215+0000 7f8ad52f9700 1 --2- 172.21.15.80:0/2856009165 >> v2:172.21.15.174:3300/0 conn(0x7f8ad006c490 0x7f8ad006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:41.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.215+0000 7f8ad52f9700 1 -- 172.21.15.80:0/2856009165 >> v1:172.21.15.174:6789/0 conn(0x7f8ad006c0a0 legacy=0x7f8ad0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:41.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.215+0000 7f8ad52f9700 1 -- 172.21.15.80:0/2856009165 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad00706c0 con 0x7f8ad006ce60 2019-11-28T11:57:41.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.215+0000 7f8ad52f9700 1 --2- 172.21.15.80:0/2856009165 >> v2:172.21.15.80:3300/0 conn(0x7f8ad006ce60 0x7f8ad0164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8ab800f6b0 tx=0x7f8ab800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:41.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.215+0000 7f8ad52f9700 1 --2- 172.21.15.80:0/2856009165 >> v2:172.21.15.80:3300/0 conn(0x7f8ad006ce60 0x7f8ad0164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8ab800f6b0 tx=0x7f8ab800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:41.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.215+0000 7f8ad52f9700 1 --2- 172.21.15.80:0/2856009165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ad006ce60 0x7f8ad0164d70 secure :-1 s=READY pgs=2692 cs=0 l=1 rx=0x7f8ab800f6b0 tx=0x7f8ab800fa50).ready entity=mon.0 client_cookie=a0b170253fb00bb7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:41.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.216+0000 7f8ad52f9700 1 --2- 172.21.15.80:0/2856009165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ad006ce60 0x7f8ad0164d70 secure :-1 s=THROTTLE_DONE pgs=2692 cs=0 l=1 rx=0x7f8ab800f6b0 tx=0x7f8ab800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:41.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.216+0000 7f8acf7fe700 1 -- 172.21.15.80:0/2856009165 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ab8000a70 con 0x7f8ad006ce60 2019-11-28T11:57:41.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.216+0000 7f8ad52f9700 1 --2- 172.21.15.80:0/2856009165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ad006ce60 0x7f8ad0164d70 secure :-1 s=THROTTLE_DONE pgs=2692 cs=0 l=1 rx=0x7f8ab800f6b0 tx=0x7f8ab800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:41.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.216+0000 7f8ad52f9700 1 --2- 172.21.15.80:0/2856009165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ad006ce60 0x7f8ad0164d70 secure :-1 s=THROTTLE_DONE pgs=2692 cs=0 l=1 rx=0x7f8ab800f6b0 tx=0x7f8ab800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:41.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.216+0000 7f8acf7fe700 1 -- 172.21.15.80:0/2856009165 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab80010e0 con 0x7f8ad006ce60 2019-11-28T11:57:41.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.216+0000 7f8acf7fe700 1 -- 172.21.15.80:0/2856009165 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ab80017b0 con 0x7f8ad006ce60 2019-11-28T11:57:41.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.216+0000 7f8ad655b700 1 -- 172.21.15.80:0/2856009165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ad006ce60 msgr2=0x7f8ad0164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.216+0000 7f8ad655b700 1 --2- 172.21.15.80:0/2856009165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ad006ce60 0x7f8ad0164d70 secure :-1 s=READY pgs=2692 cs=0 l=1 rx=0x7f8ab800f6b0 tx=0x7f8ab800fa50).stop 2019-11-28T11:57:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.216+0000 7f8ad655b700 1 -- 172.21.15.80:0/2856009165 shutdown_connections 2019-11-28T11:57:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.216+0000 7f8ad655b700 1 --2- 172.21.15.80:0/2856009165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ad006ce60 0x7f8ad0164d70 unknown :-1 s=CLOSED pgs=2692 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.216+0000 7f8ad655b700 1 --2- 172.21.15.80:0/2856009165 >> v2:172.21.15.174:3300/0 conn(0x7f8ad006c490 0x7f8ad006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.216+0000 7f8ad655b700 1 -- 172.21.15.80:0/2856009165 shutdown_connections 2019-11-28T11:57:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.216+0000 7f8ad655b700 1 -- 172.21.15.80:0/2856009165 wait complete. 2019-11-28T11:57:41.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.216+0000 7f8ad655b700 1 -- 172.21.15.80:0/2856009165 >> 172.21.15.80:0/2856009165 conn(0x7f8ad0061cf0 msgr2=0x7f8ad0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:41.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.219+0000 7f8ad655b700 1 Processor -- start 2019-11-28T11:57:41.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.219+0000 7f8ad655b700 1 -- start start 2019-11-28T11:57:41.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad655b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8ad013eb40 0x7f8ad010afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:41.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad655b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad01631f0 0x7f8ad0105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:41.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad655b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad013f1e0 con 0x7f8ad010b500 2019-11-28T11:57:41.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad655b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad01234c0 con 0x7f8ad013eb40 2019-11-28T11:57:41.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad655b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad013e0d0 con 0x7f8ad01631f0 2019-11-28T11:57:41.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad4af8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8ad013eb40 0x7f8ad010afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:41.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad4af8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8ad013eb40 0x7f8ad010afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:60798/0 (socket says 172.21.15.80:60798) 2019-11-28T11:57:41.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad4af8700 1 -- 172.21.15.80:0/2147772000 learned_addr learned my addr 172.21.15.80:0/2147772000 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:41.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8acffff700 1 --1- 172.21.15.80:0/2147772000 >> v1:172.21.15.174:6789/0 conn(0x7f8ad010b500 0x7f8ad01629f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:60774/0 (socket says 172.21.15.80:60774) 2019-11-28T11:57:41.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad52f9700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad01631f0 0x7f8ad0105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:41.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad4af8700 1 -- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad01631f0 msgr2=0x7f8ad0105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:41.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad4af8700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad01631f0 0x7f8ad0105210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:41.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad4af8700 1 -- 172.21.15.80:0/2147772000 >> v1:172.21.15.174:6789/0 conn(0x7f8ad010b500 legacy=0x7f8ad01629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:41.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad4af8700 1 -- 172.21.15.80:0/2147772000 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad0108700 con 0x7f8ad013eb40 2019-11-28T11:57:41.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8acd7fa700 1 -- 172.21.15.80:0/2147772000 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601684380 0 0) 0x7f8ac0000f30 con 0x7f8ad010b500 2019-11-28T11:57:41.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad4af8700 1 --2- 172.21.15.80:0/2147772000 >> v2:172.21.15.174:3300/0 conn(0x7f8ad013eb40 0x7f8ad010afc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ac8010770 tx=0x7f8ac80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:41.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad4af8700 1 --2- 172.21.15.80:0/2147772000 >> v2:172.21.15.174:3300/0 conn(0x7f8ad013eb40 0x7f8ad010afc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ac8010770 tx=0x7f8ac80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:41.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad4af8700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ad013eb40 0x7f8ad010afc0 secure :-1 s=READY pgs=1622 cs=0 l=1 rx=0x7f8ac8010770 tx=0x7f8ac80105f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:41.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad4af8700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ad013eb40 0x7f8ad010afc0 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7f8ac8010770 tx=0x7f8ac80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:41.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8acd7fa700 1 -- 172.21.15.80:0/2147772000 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ac8000ce0 con 0x7f8ad013eb40 2019-11-28T11:57:41.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.220+0000 7f8ad4af8700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ad013eb40 0x7f8ad010afc0 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7f8ac8010770 tx=0x7f8ac80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:41.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.221+0000 7f8acd7fa700 1 -- 172.21.15.80:0/2147772000 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac8001020 con 0x7f8ad013eb40 2019-11-28T11:57:41.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.221+0000 7f8ad4af8700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ad013eb40 0x7f8ad010afc0 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7f8ac8010770 tx=0x7f8ac80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:41.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.221+0000 7f8ad655b700 1 -- 172.21.15.80:0/2147772000 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad0108a80 con 0x7f8ad013eb40 2019-11-28T11:57:41.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.221+0000 7f8acd7fa700 1 -- 172.21.15.80:0/2147772000 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ac8007930 con 0x7f8ad013eb40 2019-11-28T11:57:41.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.221+0000 7f8ad655b700 1 -- 172.21.15.80:0/2147772000 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad0108700 con 0x7f8ad013eb40 2019-11-28T11:57:41.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.221+0000 7f8ad4af8700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ad013eb40 0x7f8ad010afc0 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7f8ac8010770 tx=0x7f8ac80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:41.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.221+0000 7f8acd7fa700 1 -- 172.21.15.80:0/2147772000 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8ac8001210 con 0x7f8ad013eb40 2019-11-28T11:57:41.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.221+0000 7f8ad4af8700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ad013eb40 0x7f8ad010afc0 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7f8ac8010770 tx=0x7f8ac80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:41.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.221+0000 7f8acd7fa700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ab4018730 0x7f8ab401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:41.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.221+0000 7f8acd7fa700 1 -- 172.21.15.80:0/2147772000 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8ac8031e20 con 0x7f8ad013eb40 2019-11-28T11:57:41.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.221+0000 7f8acffff700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ab4018730 0x7f8ab401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:41.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.222+0000 7f8acffff700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ab4018730 0x7f8ab401abc0 crc :-1 s=READY pgs=1118 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:41.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.229+0000 7f8ad655b700 1 -- 172.21.15.80:0/2147772000 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad0108a80 con 0x7f8ad013eb40 2019-11-28T11:57:41.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.233+0000 7f8ad4af8700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ad013eb40 0x7f8ad010afc0 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7f8ac8010770 tx=0x7f8ac80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:41.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.233+0000 7f8acd7fa700 1 -- 172.21.15.80:0/2147772000 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8ac8007590 con 0x7f8ad013eb40 2019-11-28T11:57:41.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.405+0000 7f8ad655b700 1 -- 172.21.15.80:0/2147772000 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ad0108700 con 0x7f8ad013eb40 2019-11-28T11:57:41.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.406+0000 7f8ad4af8700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ad013eb40 0x7f8ad010afc0 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7f8ac8010770 tx=0x7f8ac80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:41.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.406+0000 7f8acd7fa700 1 -- 172.21.15.80:0/2147772000 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 168 v168) v1 ==== 95+0+2459 (secure 0 0 0) 0x7f8ac8001210 con 0x7f8ad013eb40 2019-11-28T11:57:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 168 2019-11-28T11:57:41.404 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:57:41.405 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":168,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7754,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3904352671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3904352671},{"type":"v1","addr":"172.21.15.80:6835","nonce":3904352671}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":168},{"gid":11703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3665230874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3665230874},{"type":"v1","addr":"172.21.15.80:6834","nonce":3665230874}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":168}],"filesystems":[{"mdsmap":{"epoch":167,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:54:29.202039+0000","modified":"2019-11-28T11:54:32.779460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10972},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10972":{"gid":10972,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/2209008547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2209008547},{"type":"v1","addr":"172.21.15.174:6835","nonce":2209008547}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2019-11-28T11:57:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.408+0000 7f8ad655b700 1 -- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ab4018730 msgr2=0x7f8ab401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.408+0000 7f8ad655b700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ab4018730 0x7f8ab401abc0 crc :-1 s=READY pgs=1118 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.408+0000 7f8ad655b700 1 -- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ad013eb40 msgr2=0x7f8ad010afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.408+0000 7f8ad655b700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ad013eb40 0x7f8ad010afc0 secure :-1 s=READY pgs=1622 cs=0 l=1 rx=0x7f8ac8010770 tx=0x7f8ac80105f0).stop 2019-11-28T11:57:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.408+0000 7f8ad655b700 1 -- 172.21.15.80:0/2147772000 shutdown_connections 2019-11-28T11:57:41.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.408+0000 7f8ad655b700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad01631f0 0x7f8ad0105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:41.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.408+0000 7f8ad655b700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ab4018730 0x7f8ab401abc0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:41.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.408+0000 7f8ad655b700 1 --2- 172.21.15.80:0/2147772000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ad013eb40 0x7f8ad010afc0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:41.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.408+0000 7f8ad655b700 1 -- 172.21.15.80:0/2147772000 shutdown_connections 2019-11-28T11:57:41.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.408+0000 7f8ad655b700 1 -- 172.21.15.80:0/2147772000 wait complete. 2019-11-28T11:57:41.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:41.408+0000 7f8ad655b700 1 -- 172.21.15.80:0/2147772000 >> 172.21.15.80:0/2147772000 conn(0x7f8ad011bfc0 msgr2=0x7f8ad0141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:41.720 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 10972}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 32, u'failed': [], u'epoch': 167, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [33], u'info': {u'gid_10972': {u'export_targets': [], u'name': u'c', u'incarnation': 166, u'state_seq': 2, u'state': u'up:active', u'gid': 10972, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2209008547, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 2209008547, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/2209008547'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:54:29.202039+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:54:32.779460+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:57:41.720 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:57:41.721 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:57:41.852 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:57:41.853 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:57:41.853 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:57:41.853 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 10972, 2019-11-28T11:57:41.853 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:57:41.853 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:57:41.853 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 190.012715824, 2019-11-28T11:57:41.854 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 167, 2019-11-28T11:57:41.854 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 203, 2019-11-28T11:57:41.854 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 203, 2019-11-28T11:57:41.854 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 190.14790006699999 2019-11-28T11:57:41.854 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:57:41.855 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 10972, "want_state": "up:active", "state": "up:active", "rank_uptime": 190.012715824, "mdsmap_epoch": 167, "osdmap_epoch": 203, "osdmap_epoch_barrier": 203, "uptime": 190.14790006699999 } 2019-11-28T11:57:41.856 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:57:41.856 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:57:41.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:57:41.856 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:57:41.926 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:57:41.926 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:57:42.052 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:57:42.053 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:57:42.090 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:57:42.090 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:57:42.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:57:42.103 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:57:42.173 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_read_caps' 2019-11-28T11:57:42.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.295+0000 7f575a804700 1 Processor -- start 2019-11-28T11:57:42.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.295+0000 7f575a804700 1 -- start start 2019-11-28T11:57:42.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f575a804700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f575406c0a0 0x7f5754072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:42.296 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f575a804700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f57540734e0 0x7f5754071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:42.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f575a804700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575406db00 con 0x7f5754072360 2019-11-28T11:57:42.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f575a804700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575406fd60 con 0x7f575406c0a0 2019-11-28T11:57:42.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f575a804700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5754070030 con 0x7f57540734e0 2019-11-28T11:57:42.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f5758da1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f575406c0a0 0x7f5754072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:42.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f5758da1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f575406c0a0 0x7f5754072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45920/0 (socket says 172.21.15.80:45920) 2019-11-28T11:57:42.297 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f5758da1700 1 -- 172.21.15.80:0/3276131191 learned_addr learned my addr 172.21.15.80:0/3276131191 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:42.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f5753fff700 1 --2- 172.21.15.80:0/3276131191 >> v2:172.21.15.174:3300/0 conn(0x7f57540734e0 0x7f5754071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:42.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f5758da1700 1 -- 172.21.15.80:0/3276131191 >> v2:172.21.15.174:3300/0 conn(0x7f57540734e0 msgr2=0x7f5754071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:42.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f5758da1700 1 --2- 172.21.15.80:0/3276131191 >> v2:172.21.15.174:3300/0 conn(0x7f57540734e0 0x7f5754071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:42.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f5758da1700 1 -- 172.21.15.80:0/3276131191 >> v1:172.21.15.174:6789/0 conn(0x7f5754072360 legacy=0x7f575406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:42.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f5758da1700 1 -- 172.21.15.80:0/3276131191 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57540706c0 con 0x7f575406c0a0 2019-11-28T11:57:42.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f5758da1700 1 --2- 172.21.15.80:0/3276131191 >> v2:172.21.15.80:3300/0 conn(0x7f575406c0a0 0x7f5754072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f573c00f6c0 tx=0x7f573c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:42.298 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f5758da1700 1 --2- 172.21.15.80:0/3276131191 >> v2:172.21.15.80:3300/0 conn(0x7f575406c0a0 0x7f5754072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f573c00f6c0 tx=0x7f573c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:42.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f5758da1700 1 --2- 172.21.15.80:0/3276131191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f575406c0a0 0x7f5754072fa0 secure :-1 s=READY pgs=2694 cs=0 l=1 rx=0x7f573c00f6c0 tx=0x7f573c00fa60).ready entity=mon.0 client_cookie=74679648a7da4a1a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:42.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f5758da1700 1 --2- 172.21.15.80:0/3276131191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f575406c0a0 0x7f5754072fa0 secure :-1 s=THROTTLE_DONE pgs=2694 cs=0 l=1 rx=0x7f573c00f6c0 tx=0x7f573c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:42.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f5758da1700 1 --2- 172.21.15.80:0/3276131191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f575406c0a0 0x7f5754072fa0 secure :-1 s=THROTTLE_DONE pgs=2694 cs=0 l=1 rx=0x7f573c00f6c0 tx=0x7f573c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:42.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f57537fe700 1 -- 172.21.15.80:0/3276131191 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f573c000960 con 0x7f575406c0a0 2019-11-28T11:57:42.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.296+0000 7f5758da1700 1 --2- 172.21.15.80:0/3276131191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f575406c0a0 0x7f5754072fa0 secure :-1 s=THROTTLE_DONE pgs=2694 cs=0 l=1 rx=0x7f573c00f6c0 tx=0x7f573c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:42.299 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.297+0000 7f57537fe700 1 -- 172.21.15.80:0/3276131191 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c000c90 con 0x7f575406c0a0 2019-11-28T11:57:42.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.297+0000 7f57537fe700 1 -- 172.21.15.80:0/3276131191 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f573c0013a0 con 0x7f575406c0a0 2019-11-28T11:57:42.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.297+0000 7f575a804700 1 -- 172.21.15.80:0/3276131191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f575406c0a0 msgr2=0x7f5754072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:42.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.297+0000 7f575a804700 1 --2- 172.21.15.80:0/3276131191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f575406c0a0 0x7f5754072fa0 secure :-1 s=READY pgs=2694 cs=0 l=1 rx=0x7f573c00f6c0 tx=0x7f573c00fa60).stop 2019-11-28T11:57:42.300 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.297+0000 7f575a804700 1 -- 172.21.15.80:0/3276131191 shutdown_connections 2019-11-28T11:57:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.297+0000 7f575a804700 1 --2- 172.21.15.80:0/3276131191 >> v2:172.21.15.174:3300/0 conn(0x7f57540734e0 0x7f5754071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.297+0000 7f575a804700 1 --2- 172.21.15.80:0/3276131191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f575406c0a0 0x7f5754072fa0 unknown :-1 s=CLOSED pgs=2694 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.297+0000 7f575a804700 1 -- 172.21.15.80:0/3276131191 shutdown_connections 2019-11-28T11:57:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.297+0000 7f575a804700 1 -- 172.21.15.80:0/3276131191 wait complete. 2019-11-28T11:57:42.302 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.297+0000 7f575a804700 1 -- 172.21.15.80:0/3276131191 >> 172.21.15.80:0/3276131191 conn(0x7f5754061cf0 msgr2=0x7f5754064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.300+0000 7f575a804700 1 Processor -- start 2019-11-28T11:57:42.306 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.300+0000 7f575a804700 1 -- start start 2019-11-28T11:57:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f575a804700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57541096f0 0x7f5754169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f575a804700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57541066e0 con 0x7f575413e9e0 2019-11-28T11:57:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f575a804700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575410ce40 con 0x7f575413e5f0 2019-11-28T11:57:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f575a804700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575410e060 con 0x7f57541096f0 2019-11-28T11:57:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f5753fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f575413e9e0 0x7f5754108ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45242/0 (socket says 172.21.15.80:45242) 2019-11-28T11:57:42.307 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f5753fff700 1 -- 172.21.15.80:0/1787364145 learned_addr learned my addr 172.21.15.80:0/1787364145 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:42.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f57595a2700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57541096f0 0x7f5754169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:42.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f57517fa700 1 -- 172.21.15.80:0/1787364145 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135448362 0 0) 0x7f5744001330 con 0x7f575413e9e0 2019-11-28T11:57:42.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f57517fa700 1 -- 172.21.15.80:0/1787364145 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5738002e80 con 0x7f575413e9e0 2019-11-28T11:57:42.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f57517fa700 1 -- 172.21.15.80:0/1787364145 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557788982 0 0) 0x7f573c0080b0 con 0x7f575413e5f0 2019-11-28T11:57:42.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f57517fa700 1 -- 172.21.15.80:0/1787364145 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57380030b0 con 0x7f575413e5f0 2019-11-28T11:57:42.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f57517fa700 1 -- 172.21.15.80:0/1787364145 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1745743484 0 0) 0x7f5744001420 con 0x7f575413e9e0 2019-11-28T11:57:42.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f57517fa700 1 -- 172.21.15.80:0/1787364145 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f57380033c0 con 0x7f575413e9e0 2019-11-28T11:57:42.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f57517fa700 1 -- 172.21.15.80:0/1787364145 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f57440019d0 con 0x7f575413e9e0 2019-11-28T11:57:42.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f57595a2700 1 -- 172.21.15.80:0/1787364145 >> v1:172.21.15.174:6789/0 conn(0x7f575413e5f0 legacy=0x7f575410a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:42.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f57595a2700 1 -- 172.21.15.80:0/1787364145 >> v1:172.21.15.80:6789/0 conn(0x7f575413e9e0 legacy=0x7f5754108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:42.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f57595a2700 1 -- 172.21.15.80:0/1787364145 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575410e9c0 con 0x7f57541096f0 2019-11-28T11:57:42.317 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f57595a2700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57541096f0 0x7f5754169ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f574c0103b0 tx=0x7f574c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:42.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f57595a2700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57541096f0 0x7f5754169ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f574c0103b0 tx=0x7f574c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:42.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.301+0000 7f57595a2700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57541096f0 0x7f5754169ed0 secure :-1 s=READY pgs=388 cs=0 l=1 rx=0x7f574c0103b0 tx=0x7f574c010750).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:42.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.302+0000 7f57595a2700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57541096f0 0x7f5754169ed0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f574c0103b0 tx=0x7f574c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:42.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.302+0000 7f57517fa700 1 -- 172.21.15.80:0/1787364145 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f574c000960 con 0x7f57541096f0 2019-11-28T11:57:42.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.302+0000 7f57595a2700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57541096f0 0x7f5754169ed0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f574c0103b0 tx=0x7f574c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:42.318 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.302+0000 7f57517fa700 1 -- 172.21.15.80:0/1787364145 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574c000960 con 0x7f57541096f0 2019-11-28T11:57:42.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.302+0000 7f575a804700 1 -- 172.21.15.80:0/1787364145 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575410ed40 con 0x7f57541096f0 2019-11-28T11:57:42.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.302+0000 7f57595a2700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57541096f0 0x7f5754169ed0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f574c0103b0 tx=0x7f574c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:42.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.302+0000 7f57517fa700 1 -- 172.21.15.80:0/1787364145 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f574c009b80 con 0x7f57541096f0 2019-11-28T11:57:42.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.302+0000 7f575a804700 1 -- 172.21.15.80:0/1787364145 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575410e9c0 con 0x7f57541096f0 2019-11-28T11:57:42.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.302+0000 7f57595a2700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57541096f0 0x7f5754169ed0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f574c0103b0 tx=0x7f574c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:42.319 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.302+0000 7f57517fa700 1 -- 172.21.15.80:0/1787364145 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f574c0097a0 con 0x7f57541096f0 2019-11-28T11:57:42.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.302+0000 7f57595a2700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57541096f0 0x7f5754169ed0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f574c0103b0 tx=0x7f574c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:42.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.302+0000 7f57517fa700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f57380187a0 0x7f573801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:42.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.302+0000 7f57517fa700 1 -- 172.21.15.80:0/1787364145 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f574c031ac0 con 0x7f57541096f0 2019-11-28T11:57:42.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.303+0000 7f5758da1700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f57380187a0 0x7f573801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:42.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.303+0000 7f5758da1700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f57380187a0 0x7f573801abf0 crc :-1 s=READY pgs=1119 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:42.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.310+0000 7f575a804700 1 -- 172.21.15.80:0/1787364145 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575410ed40 con 0x7f57541096f0 2019-11-28T11:57:42.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.314+0000 7f57595a2700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57541096f0 0x7f5754169ed0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f574c0103b0 tx=0x7f574c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:42.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.314+0000 7f57517fa700 1 -- 172.21.15.80:0/1787364145 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f574c017090 con 0x7f57541096f0 2019-11-28T11:57:42.483 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:42.486+0000 7f575a804700 1 -- 172.21.15.80:0/1787364145 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_read_caps"]} v 0) v1 -- 0x7f575410e9c0 con 0x7f57541096f0 2019-11-28T11:57:43.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:43.156+0000 7f57595a2700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57541096f0 0x7f5754169ed0 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f574c0103b0 tx=0x7f574c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:43.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:43.156+0000 7f57517fa700 1 -- 172.21.15.80:0/1787364145 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_read_caps"]}]=0 v758) v1 ==== 152+0+0 (secure 0 0 0) 0x7f574c017090 con 0x7f57541096f0 2019-11-28T11:57:43.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:43.203+0000 7f575a804700 1 -- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f57380187a0 msgr2=0x7f573801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:43.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:43.203+0000 7f575a804700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f57380187a0 0x7f573801abf0 crc :-1 s=READY pgs=1119 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:43.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:43.203+0000 7f575a804700 1 -- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57541096f0 msgr2=0x7f5754169ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:43.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:43.203+0000 7f575a804700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57541096f0 0x7f5754169ed0 secure :-1 s=READY pgs=388 cs=0 l=1 rx=0x7f574c0103b0 tx=0x7f574c010750).stop 2019-11-28T11:57:43.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:43.203+0000 7f575a804700 1 -- 172.21.15.80:0/1787364145 shutdown_connections 2019-11-28T11:57:43.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:43.203+0000 7f575a804700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f57541096f0 0x7f5754169ed0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:43.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:43.203+0000 7f575a804700 1 --2- 172.21.15.80:0/1787364145 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f57380187a0 0x7f573801abf0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:43.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:43.203+0000 7f575a804700 1 -- 172.21.15.80:0/1787364145 shutdown_connections 2019-11-28T11:57:43.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:43.203+0000 7f575a804700 1 -- 172.21.15.80:0/1787364145 wait complete. 2019-11-28T11:57:43.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:43.203+0000 7f575a804700 1 -- 172.21.15.80:0/1787364145 >> 172.21.15.80:0/1787364145 conn(0x7f575413d620 msgr2=0x7f575413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:43.211 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:57:43.211 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:57:43.278 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:57:43.341 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:57:43.413 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:57:43.470 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:57:43.531 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:57:43.588 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:57:43.588 INFO:tasks.cephfs.mount:Terminating background process 2019-11-28T11:57:43.588 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T11:57:43.589 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:57:43.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:57:43.589 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T11:57:43.667 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:57:43.672 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:57:43.713 INFO:tasks.cephfs.mount:Terminating background process 2019-11-28T11:57:43.713 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:57:43.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:57:43.714 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:57:43.838 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:57:43.843 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:57:43.883 INFO:tasks.cephfs_test_runner:test_stale_read_caps (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2019-11-28T11:57:43.884 INFO:tasks.cephfs_test_runner:Starting test: test_stale_renew (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T11:57:43.884 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_renew' 2019-11-28T11:57:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.005+0000 7f424bd3b700 1 Processor -- start 2019-11-28T11:57:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.005+0000 7f424bd3b700 1 -- start start 2019-11-28T11:57:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.006+0000 7f424bd3b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f424406c0a0 0x7f4244072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.006+0000 7f424bd3b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4244072620 0x7f4244164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.006+0000 7f424bd3b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f424406db00 con 0x7f42440734e0 2019-11-28T11:57:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.006+0000 7f424bd3b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424406fd60 con 0x7f424406c0a0 2019-11-28T11:57:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.006+0000 7f424bd3b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4244070030 con 0x7f4244072620 2019-11-28T11:57:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.006+0000 7f424a2d8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f424406c0a0 0x7f4244072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.006+0000 7f424a2d8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f424406c0a0 0x7f4244072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45932/0 (socket says 172.21.15.80:45932) 2019-11-28T11:57:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.006+0000 7f424a2d8700 1 -- 172.21.15.80:0/268350915 learned_addr learned my addr 172.21.15.80:0/268350915 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f424aad9700 1 --2- 172.21.15.80:0/268350915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4244072620 0x7f4244164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f424a2d8700 1 -- 172.21.15.80:0/268350915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4244072620 msgr2=0x7f4244164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f424a2d8700 1 --2- 172.21.15.80:0/268350915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4244072620 0x7f4244164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f424a2d8700 1 -- 172.21.15.80:0/268350915 >> v1:172.21.15.174:6789/0 conn(0x7f42440734e0 legacy=0x7f4244071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f424a2d8700 1 -- 172.21.15.80:0/268350915 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440706c0 con 0x7f424406c0a0 2019-11-28T11:57:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f424aad9700 1 --2- 172.21.15.80:0/268350915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4244072620 0x7f4244164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:57:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f424a2d8700 1 --2- 172.21.15.80:0/268350915 >> v2:172.21.15.80:3300/0 conn(0x7f424406c0a0 0x7f4244072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f423400fac0 tx=0x7f423400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f424a2d8700 1 --2- 172.21.15.80:0/268350915 >> v2:172.21.15.80:3300/0 conn(0x7f424406c0a0 0x7f4244072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f423400fac0 tx=0x7f423400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f424a2d8700 1 --2- 172.21.15.80:0/268350915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f424406c0a0 0x7f4244072fa0 secure :-1 s=READY pgs=2696 cs=0 l=1 rx=0x7f423400fac0 tx=0x7f423400fe60).ready entity=mon.0 client_cookie=2c74fe9b381b9ab4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f424a2d8700 1 --2- 172.21.15.80:0/268350915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f424406c0a0 0x7f4244072fa0 secure :-1 s=THROTTLE_DONE pgs=2696 cs=0 l=1 rx=0x7f423400fac0 tx=0x7f423400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f424a2d8700 1 --2- 172.21.15.80:0/268350915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f424406c0a0 0x7f4244072fa0 secure :-1 s=THROTTLE_DONE pgs=2696 cs=0 l=1 rx=0x7f423400fac0 tx=0x7f423400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f42492d6700 1 -- 172.21.15.80:0/268350915 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4234000ce0 con 0x7f424406c0a0 2019-11-28T11:57:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f424a2d8700 1 --2- 172.21.15.80:0/268350915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f424406c0a0 0x7f4244072fa0 secure :-1 s=THROTTLE_DONE pgs=2696 cs=0 l=1 rx=0x7f423400fac0 tx=0x7f423400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f42492d6700 1 -- 172.21.15.80:0/268350915 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4234001010 con 0x7f424406c0a0 2019-11-28T11:57:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f42492d6700 1 -- 172.21.15.80:0/268350915 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4234001720 con 0x7f424406c0a0 2019-11-28T11:57:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f424bd3b700 1 -- 172.21.15.80:0/268350915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f424406c0a0 msgr2=0x7f4244072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.007+0000 7f424bd3b700 1 --2- 172.21.15.80:0/268350915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f424406c0a0 0x7f4244072fa0 secure :-1 s=READY pgs=2696 cs=0 l=1 rx=0x7f423400fac0 tx=0x7f423400fe60).stop 2019-11-28T11:57:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.008+0000 7f424bd3b700 1 -- 172.21.15.80:0/268350915 shutdown_connections 2019-11-28T11:57:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.008+0000 7f424bd3b700 1 --2- 172.21.15.80:0/268350915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4244072620 0x7f4244164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:44.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.008+0000 7f424bd3b700 1 --2- 172.21.15.80:0/268350915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f424406c0a0 0x7f4244072fa0 unknown :-1 s=CLOSED pgs=2696 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:44.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.008+0000 7f424bd3b700 1 -- 172.21.15.80:0/268350915 shutdown_connections 2019-11-28T11:57:44.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.008+0000 7f424bd3b700 1 -- 172.21.15.80:0/268350915 wait complete. 2019-11-28T11:57:44.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.008+0000 7f424bd3b700 1 -- 172.21.15.80:0/268350915 >> 172.21.15.80:0/268350915 conn(0x7f4244061cf0 msgr2=0x7f4244064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:44.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.010+0000 7f424bd3b700 1 Processor -- start 2019-11-28T11:57:44.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.010+0000 7f424bd3b700 1 -- start start 2019-11-28T11:57:44.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.011+0000 7f424bd3b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4244159970 0x7f4244158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:44.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.011+0000 7f424bd3b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4244159e00 0x7f4244158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:44.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.011+0000 7f424bd3b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4244112260 con 0x7f424415d7c0 2019-11-28T11:57:44.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.011+0000 7f424bd3b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4244140ff0 con 0x7f4244159e00 2019-11-28T11:57:44.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.011+0000 7f424bd3b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42441412c0 con 0x7f4244159970 2019-11-28T11:57:44.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.011+0000 7f424aad9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4244159e00 0x7f4244158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:44.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.011+0000 7f424aad9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4244159e00 0x7f4244158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45942/0 (socket says 172.21.15.80:45942) 2019-11-28T11:57:44.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.011+0000 7f424aad9700 1 -- 172.21.15.80:0/2220184038 learned_addr learned my addr 172.21.15.80:0/2220184038 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:44.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.011+0000 7f4249ad7700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4244159970 0x7f4244158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:44.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.012+0000 7f424aad9700 1 -- 172.21.15.80:0/2220184038 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4244159970 msgr2=0x7f4244158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:44.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.012+0000 7f424aad9700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4244159970 0x7f4244158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:44.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.012+0000 7f424aad9700 1 -- 172.21.15.80:0/2220184038 >> v1:172.21.15.174:6789/0 conn(0x7f424415d7c0 legacy=0x7f424412e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:44.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.012+0000 7f424aad9700 1 -- 172.21.15.80:0/2220184038 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4244141950 con 0x7f4244159e00 2019-11-28T11:57:44.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.012+0000 7f424aad9700 1 --2- 172.21.15.80:0/2220184038 >> v2:172.21.15.80:3300/0 conn(0x7f4244159e00 0x7f4244158e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f423c010470 tx=0x7f423c00b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:44.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.012+0000 7f424aad9700 1 --2- 172.21.15.80:0/2220184038 >> v2:172.21.15.80:3300/0 conn(0x7f4244159e00 0x7f4244158e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f423c010470 tx=0x7f423c00b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:44.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.012+0000 7f424aad9700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4244159e00 0x7f4244158e90 secure :-1 s=READY pgs=2697 cs=0 l=1 rx=0x7f423c010470 tx=0x7f423c00b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:44.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.012+0000 7f424aad9700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4244159e00 0x7f4244158e90 secure :-1 s=THROTTLE_DONE pgs=2697 cs=0 l=1 rx=0x7f423c010470 tx=0x7f423c00b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:44.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.012+0000 7f424aad9700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4244159e00 0x7f4244158e90 secure :-1 s=THROTTLE_DONE pgs=2697 cs=0 l=1 rx=0x7f423c010470 tx=0x7f423c00b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:44.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.012+0000 7f424aad9700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4244159e00 0x7f4244158e90 secure :-1 s=THROTTLE_DONE pgs=2697 cs=0 l=1 rx=0x7f423c010470 tx=0x7f423c00b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:44.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.012+0000 7f4242ffd700 1 -- 172.21.15.80:0/2220184038 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423c001460 con 0x7f4244159e00 2019-11-28T11:57:44.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.012+0000 7f4242ffd700 1 -- 172.21.15.80:0/2220184038 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c001080 con 0x7f4244159e00 2019-11-28T11:57:44.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.012+0000 7f424bd3b700 1 -- 172.21.15.80:0/2220184038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4244141cd0 con 0x7f4244159e00 2019-11-28T11:57:44.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.012+0000 7f4242ffd700 1 -- 172.21.15.80:0/2220184038 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423c001a40 con 0x7f4244159e00 2019-11-28T11:57:44.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.012+0000 7f424bd3b700 1 -- 172.21.15.80:0/2220184038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4244141950 con 0x7f4244159e00 2019-11-28T11:57:44.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.012+0000 7f424aad9700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4244159e00 0x7f4244158e90 secure :-1 s=THROTTLE_DONE pgs=2697 cs=0 l=1 rx=0x7f423c010470 tx=0x7f423c00b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:44.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.013+0000 7f4242ffd700 1 -- 172.21.15.80:0/2220184038 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f423c001270 con 0x7f4244159e00 2019-11-28T11:57:44.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.013+0000 7f424aad9700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4244159e00 0x7f4244158e90 secure :-1 s=THROTTLE_DONE pgs=2697 cs=0 l=1 rx=0x7f423c010470 tx=0x7f423c00b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:44.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.013+0000 7f4242ffd700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4228018730 0x7f422801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:44.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.013+0000 7f4242ffd700 1 -- 172.21.15.80:0/2220184038 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f423c031b70 con 0x7f4244159e00 2019-11-28T11:57:44.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.013+0000 7f424a2d8700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4228018730 0x7f422801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:44.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.013+0000 7f424a2d8700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4228018730 0x7f422801abc0 crc :-1 s=READY pgs=1120 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:44.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.020+0000 7f424bd3b700 1 -- 172.21.15.80:0/2220184038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4244141cd0 con 0x7f4244159e00 2019-11-28T11:57:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.024+0000 7f424aad9700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4244159e00 0x7f4244158e90 secure :-1 s=THROTTLE_DONE pgs=2697 cs=0 l=1 rx=0x7f423c010470 tx=0x7f423c00b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.024+0000 7f4242ffd700 1 -- 172.21.15.80:0/2220184038 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f423c000e70 con 0x7f4244159e00 2019-11-28T11:57:44.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:44.197+0000 7f424bd3b700 1 -- 172.21.15.80:0/2220184038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_renew"]} v 0) v1 -- 0x7f4244141950 con 0x7f4244159e00 2019-11-28T11:57:45.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.160+0000 7f424aad9700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4244159e00 0x7f4244158e90 secure :-1 s=THROTTLE_DONE pgs=2697 cs=0 l=1 rx=0x7f423c010470 tx=0x7f423c00b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.160+0000 7f4242ffd700 1 -- 172.21.15.80:0/2220184038 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_renew"]}]=0 v760) v1 ==== 151+0+0 (secure 0 0 0) 0x7f423c001080 con 0x7f4244159e00 2019-11-28T11:57:45.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.166+0000 7f424bd3b700 1 -- 172.21.15.80:0/2220184038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4228018730 msgr2=0x7f422801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:45.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.166+0000 7f424bd3b700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4228018730 0x7f422801abc0 crc :-1 s=READY pgs=1120 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:45.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.166+0000 7f424bd3b700 1 -- 172.21.15.80:0/2220184038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4244159e00 msgr2=0x7f4244158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:45.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.166+0000 7f424bd3b700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4244159e00 0x7f4244158e90 secure :-1 s=READY pgs=2697 cs=0 l=1 rx=0x7f423c010470 tx=0x7f423c00b3b0).stop 2019-11-28T11:57:45.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.166+0000 7f424bd3b700 1 -- 172.21.15.80:0/2220184038 shutdown_connections 2019-11-28T11:57:45.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.166+0000 7f424bd3b700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4244159e00 0x7f4244158e90 unknown :-1 s=CLOSED pgs=2697 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:45.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.166+0000 7f424bd3b700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4244159970 0x7f4244158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:45.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.166+0000 7f424bd3b700 1 --2- 172.21.15.80:0/2220184038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4228018730 0x7f422801abc0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:45.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.166+0000 7f424bd3b700 1 -- 172.21.15.80:0/2220184038 shutdown_connections 2019-11-28T11:57:45.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.166+0000 7f424bd3b700 1 -- 172.21.15.80:0/2220184038 wait complete. 2019-11-28T11:57:45.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.166+0000 7f424bd3b700 1 -- 172.21.15.80:0/2220184038 >> 172.21.15.80:0/2220184038 conn(0x7f424413b860 msgr2=0x7f42441050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:45.176 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:57:45.176 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:57:45.243 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:57:45.318 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:57:45.379 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:57:45.436 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:57:45.496 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:57:45.557 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:57:45.558 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:57:45.558 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:57:45.559 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:57:45.559 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:57:45.559 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:57:45.560 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:57:45.564 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:57:45.564 DEBUG:teuthology.parallel:result is None 2019-11-28T11:57:45.566 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:57:45.566 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:57:45.567 DEBUG:teuthology.parallel:result is None 2019-11-28T11:57:45.567 DEBUG:teuthology.parallel:result is None 2019-11-28T11:57:45.567 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:57:45.568 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:57:45.569 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:57:45.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.772+0000 7ff6f3baf700 1 Processor -- start 2019-11-28T11:57:45.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.772+0000 7ff6f3baf700 1 -- start start 2019-11-28T11:57:45.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.773+0000 7ff6f3baf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6ec06c490 0x7ff6ec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:45.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.773+0000 7ff6f3baf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff6ec06ce60 0x7ff6ec164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:45.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.773+0000 7ff6f3baf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ec06db00 con 0x7ff6ec06c0a0 2019-11-28T11:57:45.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.773+0000 7ff6f3baf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ec06fd60 con 0x7ff6ec06c490 2019-11-28T11:57:45.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.773+0000 7ff6f3baf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ec070030 con 0x7ff6ec06ce60 2019-11-28T11:57:45.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.773+0000 7ff6f194b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6ec06c490 0x7ff6ec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:45.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.773+0000 7ff6f194b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6ec06c490 0x7ff6ec06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45948/0 (socket says 172.21.15.80:45948) 2019-11-28T11:57:45.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.773+0000 7ff6f194b700 1 -- 172.21.15.80:0/116078957 learned_addr learned my addr 172.21.15.80:0/116078957 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:45.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f294d700 1 --2- 172.21.15.80:0/116078957 >> v2:172.21.15.174:3300/0 conn(0x7ff6ec06ce60 0x7ff6ec164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:45.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f194b700 1 -- 172.21.15.80:0/116078957 >> v2:172.21.15.174:3300/0 conn(0x7ff6ec06ce60 msgr2=0x7ff6ec164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:45.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f194b700 1 --2- 172.21.15.80:0/116078957 >> v2:172.21.15.174:3300/0 conn(0x7ff6ec06ce60 0x7ff6ec164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:45.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f194b700 1 -- 172.21.15.80:0/116078957 >> v1:172.21.15.174:6789/0 conn(0x7ff6ec06c0a0 legacy=0x7ff6ec072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:45.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f194b700 1 -- 172.21.15.80:0/116078957 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec0706c0 con 0x7ff6ec06c490 2019-11-28T11:57:45.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f294d700 1 --2- 172.21.15.80:0/116078957 >> v2:172.21.15.174:3300/0 conn(0x7ff6ec06ce60 0x7ff6ec164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:57:45.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f194b700 1 --2- 172.21.15.80:0/116078957 >> v2:172.21.15.80:3300/0 conn(0x7ff6ec06c490 0x7ff6ec06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff6e800f740 tx=0x7ff6e800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f194b700 1 --2- 172.21.15.80:0/116078957 >> v2:172.21.15.80:3300/0 conn(0x7ff6ec06c490 0x7ff6ec06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff6e800f740 tx=0x7ff6e800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f194b700 1 --2- 172.21.15.80:0/116078957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ec06c490 0x7ff6ec06c920 secure :-1 s=READY pgs=2698 cs=0 l=1 rx=0x7ff6e800f740 tx=0x7ff6e800fae0).ready entity=mon.0 client_cookie=48bdf72fbc681371 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:45.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f194b700 1 --2- 172.21.15.80:0/116078957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ec06c490 0x7ff6ec06c920 secure :-1 s=THROTTLE_DONE pgs=2698 cs=0 l=1 rx=0x7ff6e800f740 tx=0x7ff6e800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f194b700 1 --2- 172.21.15.80:0/116078957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ec06c490 0x7ff6ec06c920 secure :-1 s=THROTTLE_DONE pgs=2698 cs=0 l=1 rx=0x7ff6e800f740 tx=0x7ff6e800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f194b700 1 --2- 172.21.15.80:0/116078957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ec06c490 0x7ff6ec06c920 secure :-1 s=THROTTLE_DONE pgs=2698 cs=0 l=1 rx=0x7ff6e800f740 tx=0x7ff6e800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f114a700 1 -- 172.21.15.80:0/116078957 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6e8000960 con 0x7ff6ec06c490 2019-11-28T11:57:45.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f114a700 1 -- 172.21.15.80:0/116078957 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e8000c90 con 0x7ff6ec06c490 2019-11-28T11:57:45.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f114a700 1 -- 172.21.15.80:0/116078957 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6e80013a0 con 0x7ff6ec06c490 2019-11-28T11:57:45.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f3baf700 1 -- 172.21.15.80:0/116078957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ec06c490 msgr2=0x7ff6ec06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:45.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7ff6f3baf700 1 --2- 172.21.15.80:0/116078957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ec06c490 0x7ff6ec06c920 secure :-1 s=READY pgs=2698 cs=0 l=1 rx=0x7ff6e800f740 tx=0x7ff6e800fae0).stop 2019-11-28T11:57:45.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7ff6f3baf700 1 -- 172.21.15.80:0/116078957 shutdown_connections 2019-11-28T11:57:45.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7ff6f3baf700 1 --2- 172.21.15.80:0/116078957 >> v2:172.21.15.174:3300/0 conn(0x7ff6ec06ce60 0x7ff6ec164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:45.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7ff6f3baf700 1 --2- 172.21.15.80:0/116078957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6ec06c490 0x7ff6ec06c920 unknown :-1 s=CLOSED pgs=2698 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:45.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7ff6f3baf700 1 -- 172.21.15.80:0/116078957 shutdown_connections 2019-11-28T11:57:45.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7ff6f3baf700 1 -- 172.21.15.80:0/116078957 wait complete. 2019-11-28T11:57:45.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7ff6f3baf700 1 -- 172.21.15.80:0/116078957 >> 172.21.15.80:0/116078957 conn(0x7ff6ec061cf0 msgr2=0x7ff6ec064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:45.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.773+0000 7f6ab6dce700 1 Processor -- start 2019-11-28T11:57:45.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.773+0000 7f6ab6dce700 1 -- start start 2019-11-28T11:57:45.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7f6ab6dce700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6ab006d120 0x7f6ab0165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:45.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7f6ab6dce700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab006d5a0 con 0x7f6ab006c0a0 2019-11-28T11:57:45.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7f6ab6dce700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab006db00 con 0x7f6ab006c490 2019-11-28T11:57:45.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7f6ab6dce700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab006fd60 con 0x7f6ab006d120 2019-11-28T11:57:45.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f6ab5b6c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6ab006d120 0x7f6ab0165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:45.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f6ab4b6a700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f6ab006c490 0x7f6ab006c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:60814/0 (socket says 172.21.15.80:60814) 2019-11-28T11:57:45.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f6ab4b6a700 1 -- 172.21.15.80:0/972548102 learned_addr learned my addr 172.21.15.80:0/972548102 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:45.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f6aaffff700 1 -- 172.21.15.80:0/972548102 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768141776 0 0) 0x7f6aa4001150 con 0x7f6ab006c490 2019-11-28T11:57:45.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f6aaffff700 1 -- 172.21.15.80:0/972548102 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a98002e80 con 0x7f6ab006c490 2019-11-28T11:57:45.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f6aaffff700 1 -- 172.21.15.80:0/972548102 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936576966 0 0) 0x7f6aa0001100 con 0x7f6ab006c0a0 2019-11-28T11:57:45.806 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f6aaffff700 1 -- 172.21.15.80:0/972548102 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a980030b0 con 0x7f6ab006c0a0 2019-11-28T11:57:45.807 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f6ab5b6c700 1 -- 172.21.15.80:0/972548102 >> v1:172.21.15.174:6789/0 conn(0x7f6ab006c490 legacy=0x7f6ab006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:45.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f6ab5b6c700 1 -- 172.21.15.80:0/972548102 >> v1:172.21.15.80:6789/0 conn(0x7f6ab006c0a0 legacy=0x7f6ab0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:45.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f6ab5b6c700 1 -- 172.21.15.80:0/972548102 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00706c0 con 0x7f6ab006d120 2019-11-28T11:57:45.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f6ab5b6c700 1 --2- 172.21.15.80:0/972548102 >> v2:172.21.15.174:3300/0 conn(0x7f6ab006d120 0x7f6ab0165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6aa800b300 tx=0x7f6aa800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.808 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f6ab5b6c700 1 --2- 172.21.15.80:0/972548102 >> v2:172.21.15.174:3300/0 conn(0x7f6ab006d120 0x7f6ab0165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6aa800b300 tx=0x7f6aa800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f6ab5b6c700 1 --2- 172.21.15.80:0/972548102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab006d120 0x7f6ab0165d80 secure :-1 s=READY pgs=1631 cs=0 l=1 rx=0x7f6aa800b300 tx=0x7f6aa800bb10).ready entity=mon.1 client_cookie=b04a9adda2d2de8c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:45.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f6ab5b6c700 1 --2- 172.21.15.80:0/972548102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab006d120 0x7f6ab0165d80 secure :-1 s=THROTTLE_DONE pgs=1631 cs=0 l=1 rx=0x7f6aa800b300 tx=0x7f6aa800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f6aaffff700 1 -- 172.21.15.80:0/972548102 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa80075c0 con 0x7f6ab006d120 2019-11-28T11:57:45.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f6ab5b6c700 1 --2- 172.21.15.80:0/972548102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab006d120 0x7f6ab0165d80 secure :-1 s=THROTTLE_DONE pgs=1631 cs=0 l=1 rx=0x7f6aa800b300 tx=0x7f6aa800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.809 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f6ab5b6c700 1 --2- 172.21.15.80:0/972548102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab006d120 0x7f6ab0165d80 secure :-1 s=THROTTLE_DONE pgs=1631 cs=0 l=1 rx=0x7f6aa800b300 tx=0x7f6aa800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f6aaffff700 1 -- 172.21.15.80:0/972548102 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa8000f30 con 0x7f6ab006d120 2019-11-28T11:57:45.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f6aaffff700 1 -- 172.21.15.80:0/972548102 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa800a1e0 con 0x7f6ab006d120 2019-11-28T11:57:45.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f6ab6dce700 1 -- 172.21.15.80:0/972548102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab006d120 msgr2=0x7f6ab0165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:45.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f6ab6dce700 1 --2- 172.21.15.80:0/972548102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab006d120 0x7f6ab0165d80 secure :-1 s=READY pgs=1631 cs=0 l=1 rx=0x7f6aa800b300 tx=0x7f6aa800bb10).stop 2019-11-28T11:57:45.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f6ab6dce700 1 -- 172.21.15.80:0/972548102 shutdown_connections 2019-11-28T11:57:45.810 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f6ab6dce700 1 --2- 172.21.15.80:0/972548102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab006d120 0x7f6ab0165d80 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:45.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.777+0000 7f6ab6dce700 1 -- 172.21.15.80:0/972548102 shutdown_connections 2019-11-28T11:57:45.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.777+0000 7f6ab6dce700 1 -- 172.21.15.80:0/972548102 wait complete. 2019-11-28T11:57:45.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.777+0000 7f6ab6dce700 1 -- 172.21.15.80:0/972548102 >> 172.21.15.80:0/972548102 conn(0x7f6ab0061cf0 msgr2=0x7f6ab0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:45.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7f6ab6dce700 1 Processor -- start 2019-11-28T11:57:45.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7f6ab6dce700 1 -- start start 2019-11-28T11:57:45.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7f6ab6dce700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab012cea0 0x7f6ab0111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:45.811 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7f6ab6dce700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab0124260 con 0x7f6ab01230e0 2019-11-28T11:57:45.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7f6ab6dce700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab012e5d0 con 0x7f6ab0165a00 2019-11-28T11:57:45.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7f6ab6dce700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab0120610 con 0x7f6ab012cea0 2019-11-28T11:57:45.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7f6ab536b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab012cea0 0x7f6ab0111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:45.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7f6ab536b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab012cea0 0x7f6ab0111db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:48230/0 (socket says 172.21.15.80:48230) 2019-11-28T11:57:45.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7f6ab536b700 1 -- 172.21.15.80:0/3495670031 learned_addr learned my addr 172.21.15.80:0/3495670031 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:45.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f6ab536b700 1 -- 172.21.15.80:0/3495670031 >> v1:172.21.15.174:6789/0 conn(0x7f6ab0165a00 legacy=0x7f6ab0167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:45.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f6ab536b700 1 -- 172.21.15.80:0/3495670031 >> v1:172.21.15.80:6789/0 conn(0x7f6ab01230e0 legacy=0x7f6ab0123570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2019-11-28T11:57:45.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f6ab536b700 1 -- 172.21.15.80:0/3495670031 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab01219a0 con 0x7f6ab012cea0 2019-11-28T11:57:45.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f6ab536b700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab012cea0 0x7f6ab0111db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6aa00103f0 tx=0x7f6aa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f6ab536b700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab012cea0 0x7f6ab0111db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6aa00103f0 tx=0x7f6aa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f6ab536b700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab012cea0 0x7f6ab0111db0 secure :-1 s=READY pgs=389 cs=0 l=1 rx=0x7f6aa00103f0 tx=0x7f6aa0010790).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:45.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f6ab536b700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab012cea0 0x7f6ab0111db0 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f6aa00103f0 tx=0x7f6aa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f6ab536b700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab012cea0 0x7f6ab0111db0 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f6aa00103f0 tx=0x7f6aa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f6aadffb700 1 -- 172.21.15.80:0/3495670031 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa0000a50 con 0x7f6ab012cea0 2019-11-28T11:57:45.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f6ab536b700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab012cea0 0x7f6ab0111db0 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f6aa00103f0 tx=0x7f6aa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f6aadffb700 1 -- 172.21.15.80:0/3495670031 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa0005370 con 0x7f6ab012cea0 2019-11-28T11:57:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f6ab6dce700 1 -- 172.21.15.80:0/3495670031 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab0121d20 con 0x7f6ab012cea0 2019-11-28T11:57:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f6aadffb700 1 -- 172.21.15.80:0/3495670031 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa0005a40 con 0x7f6ab012cea0 2019-11-28T11:57:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f6ab6dce700 1 -- 172.21.15.80:0/3495670031 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab01122f0 con 0x7f6ab012cea0 2019-11-28T11:57:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f6ab536b700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab012cea0 0x7f6ab0111db0 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f6aa00103f0 tx=0x7f6aa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f6aadffb700 1 -- 172.21.15.80:0/3495670031 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6aa0000a50 con 0x7f6ab012cea0 2019-11-28T11:57:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f6ab536b700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab012cea0 0x7f6ab0111db0 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f6aa00103f0 tx=0x7f6aa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f6aadffb700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a90018730 0x7f6a9001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:45.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f6aadffb700 1 -- 172.21.15.80:0/3495670031 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6aa0031dc0 con 0x7f6ab012cea0 2019-11-28T11:57:45.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f6ab4b6a700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a90018730 0x7f6a9001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:45.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f6ab4b6a700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a90018730 0x7f6a9001abe0 crc :-1 s=READY pgs=1122 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:45.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.788+0000 7f6ab6dce700 1 -- 172.21.15.80:0/3495670031 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab01219a0 con 0x7f6ab012cea0 2019-11-28T11:57:45.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.792+0000 7f6ab536b700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab012cea0 0x7f6ab0111db0 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f6aa00103f0 tx=0x7f6aa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.792+0000 7f6aadffb700 1 -- 172.21.15.80:0/3495670031 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6aa00071f0 con 0x7f6ab012cea0 2019-11-28T11:57:45.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.778+0000 7ff6f3baf700 1 Processor -- start 2019-11-28T11:57:45.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.778+0000 7ff6f3baf700 1 -- start start 2019-11-28T11:57:45.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f3baf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff6ec1281b0 0x7ff6ec128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:45.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f3baf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff6ec128b80 0x7ff6ec167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:45.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f3baf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ec139a60 con 0x7ff6ec13a780 2019-11-28T11:57:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f3baf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ec12a260 con 0x7ff6ec128b80 2019-11-28T11:57:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f3baf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ec12a530 con 0x7ff6ec1281b0 2019-11-28T11:57:45.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f194b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff6ec1281b0 0x7ff6ec128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f194b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff6ec1281b0 0x7ff6ec128640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:60852/0 (socket says 172.21.15.80:60852) 2019-11-28T11:57:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f194b700 1 -- 172.21.15.80:0/2009181887 learned_addr learned my addr 172.21.15.80:0/2009181887 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f294d700 1 --2- 172.21.15.80:0/2009181887 >> v2:172.21.15.80:3300/0 conn(0x7ff6ec128b80 0x7ff6ec167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f194b700 1 -- 172.21.15.80:0/2009181887 >> v2:172.21.15.80:3300/0 conn(0x7ff6ec128b80 msgr2=0x7ff6ec167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f194b700 1 --2- 172.21.15.80:0/2009181887 >> v2:172.21.15.80:3300/0 conn(0x7ff6ec128b80 0x7ff6ec167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:45.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f194b700 1 -- 172.21.15.80:0/2009181887 >> v1:172.21.15.80:6789/0 conn(0x7ff6ec13a780 legacy=0x7ff6ec12d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:45.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f194b700 1 -- 172.21.15.80:0/2009181887 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec12abc0 con 0x7ff6ec1281b0 2019-11-28T11:57:45.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f194b700 1 --2- 172.21.15.80:0/2009181887 >> v2:172.21.15.174:3300/0 conn(0x7ff6ec1281b0 0x7ff6ec128640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff6e8010380 tx=0x7ff6e8010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f194b700 1 --2- 172.21.15.80:0/2009181887 >> v2:172.21.15.174:3300/0 conn(0x7ff6ec1281b0 0x7ff6ec128640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff6e8010380 tx=0x7ff6e8010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f194b700 1 --2- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ec1281b0 0x7ff6ec128640 secure :-1 s=READY pgs=1632 cs=0 l=1 rx=0x7ff6e8010380 tx=0x7ff6e8010720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:45.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6f194b700 1 --2- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ec1281b0 0x7ff6ec128640 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7ff6e8010380 tx=0x7ff6e8010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7ff6f194b700 1 --2- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ec1281b0 0x7ff6ec128640 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7ff6e8010380 tx=0x7ff6e8010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.779+0000 7ff6e2ffd700 1 -- 172.21.15.80:0/2009181887 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6e8005560 con 0x7ff6ec1281b0 2019-11-28T11:57:45.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7ff6f194b700 1 --2- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ec1281b0 0x7ff6ec128640 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7ff6e8010380 tx=0x7ff6e8010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7ff6e2ffd700 1 -- 172.21.15.80:0/2009181887 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e8005180 con 0x7ff6ec1281b0 2019-11-28T11:57:45.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7ff6f3baf700 1 -- 172.21.15.80:0/2009181887 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ec12af40 con 0x7ff6ec1281b0 2019-11-28T11:57:45.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7ff6e2ffd700 1 -- 172.21.15.80:0/2009181887 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6e8005b40 con 0x7ff6ec1281b0 2019-11-28T11:57:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7ff6f3baf700 1 -- 172.21.15.80:0/2009181887 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ec12abc0 con 0x7ff6ec1281b0 2019-11-28T11:57:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7ff6f194b700 1 --2- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ec1281b0 0x7ff6ec128640 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7ff6e8010380 tx=0x7ff6e8010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7ff6e2ffd700 1 -- 172.21.15.80:0/2009181887 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff6e8005370 con 0x7ff6ec1281b0 2019-11-28T11:57:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7ff6f194b700 1 --2- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ec1281b0 0x7ff6ec128640 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7ff6e8010380 tx=0x7ff6e8010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7ff6e2ffd700 1 --2- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6d4018730 0x7ff6d401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:45.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7ff6e2ffd700 1 -- 172.21.15.80:0/2009181887 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff6e8031d20 con 0x7ff6ec1281b0 2019-11-28T11:57:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7ff6f214c700 1 --2- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6d4018730 0x7ff6d401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7ff6f214c700 1 --2- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6d4018730 0x7ff6d401abe0 crc :-1 s=READY pgs=1121 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.788+0000 7ff6f3baf700 1 -- 172.21.15.80:0/2009181887 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c8002e60 con 0x7ff6ec1281b0 2019-11-28T11:57:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.795+0000 7ff6f194b700 1 --2- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ec1281b0 0x7ff6ec128640 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7ff6e8010380 tx=0x7ff6e8010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.795+0000 7ff6e2ffd700 1 -- 172.21.15.80:0/2009181887 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff6e80078a0 con 0x7ff6ec1281b0 2019-11-28T11:57:45.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.773+0000 7f4804af8700 1 Processor -- start 2019-11-28T11:57:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.773+0000 7f4804af8700 1 -- start start 2019-11-28T11:57:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7f4804af8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f480006c0a0 0x7f4800072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.774+0000 7f4804af8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4800072620 0x7f4800164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f4804af8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f480006db00 con 0x7f48000734e0 2019-11-28T11:57:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f4804af8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f480006fd60 con 0x7f4800072620 2019-11-28T11:57:45.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f4804af8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4800070030 con 0x7f480006c0a0 2019-11-28T11:57:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f47fed9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f480006c0a0 0x7f4800072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f47fed9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f480006c0a0 0x7f4800072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:60842/0 (socket says 172.21.15.80:60842) 2019-11-28T11:57:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f47fed9d700 1 -- 172.21.15.80:0/2035573143 learned_addr learned my addr 172.21.15.80:0/2035573143 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f47ff59e700 1 --2- 172.21.15.80:0/2035573143 >> v2:172.21.15.80:3300/0 conn(0x7f4800072620 0x7f4800164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f47fed9d700 1 -- 172.21.15.80:0/2035573143 >> v2:172.21.15.80:3300/0 conn(0x7f4800072620 msgr2=0x7f4800164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:45.833 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f47fed9d700 1 --2- 172.21.15.80:0/2035573143 >> v2:172.21.15.80:3300/0 conn(0x7f4800072620 0x7f4800164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f47fed9d700 1 -- 172.21.15.80:0/2035573143 >> v1:172.21.15.174:6789/0 conn(0x7f48000734e0 legacy=0x7f4800071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f47fed9d700 1 -- 172.21.15.80:0/2035573143 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48000706c0 con 0x7f480006c0a0 2019-11-28T11:57:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f47fed9d700 1 --2- 172.21.15.80:0/2035573143 >> v2:172.21.15.174:3300/0 conn(0x7f480006c0a0 0x7f4800072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f47f800f740 tx=0x7f47f800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f47fed9d700 1 --2- 172.21.15.80:0/2035573143 >> v2:172.21.15.174:3300/0 conn(0x7f480006c0a0 0x7f4800072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f47f800f740 tx=0x7f47f800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f47fed9d700 1 --2- 172.21.15.80:0/2035573143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f480006c0a0 0x7f4800072fa0 secure :-1 s=READY pgs=1630 cs=0 l=1 rx=0x7f47f800f740 tx=0x7f47f800f570).ready entity=mon.1 client_cookie=9247fde91fc001f1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f47fed9d700 1 --2- 172.21.15.80:0/2035573143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f480006c0a0 0x7f4800072fa0 secure :-1 s=THROTTLE_DONE pgs=1630 cs=0 l=1 rx=0x7f47f800f740 tx=0x7f47f800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.834 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f47fed9d700 1 --2- 172.21.15.80:0/2035573143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f480006c0a0 0x7f4800072fa0 secure :-1 s=THROTTLE_DONE pgs=1630 cs=0 l=1 rx=0x7f47f800f740 tx=0x7f47f800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f47fdd9b700 1 -- 172.21.15.80:0/2035573143 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47f8000960 con 0x7f480006c0a0 2019-11-28T11:57:45.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.775+0000 7f47fed9d700 1 --2- 172.21.15.80:0/2035573143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f480006c0a0 0x7f4800072fa0 secure :-1 s=THROTTLE_DONE pgs=1630 cs=0 l=1 rx=0x7f47f800f740 tx=0x7f47f800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f47fdd9b700 1 -- 172.21.15.80:0/2035573143 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f8000c90 con 0x7f480006c0a0 2019-11-28T11:57:45.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f47fdd9b700 1 -- 172.21.15.80:0/2035573143 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47f80013a0 con 0x7f480006c0a0 2019-11-28T11:57:45.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f4804af8700 1 -- 172.21.15.80:0/2035573143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f480006c0a0 msgr2=0x7f4800072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:45.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f4804af8700 1 --2- 172.21.15.80:0/2035573143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f480006c0a0 0x7f4800072fa0 secure :-1 s=READY pgs=1630 cs=0 l=1 rx=0x7f47f800f740 tx=0x7f47f800f570).stop 2019-11-28T11:57:45.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f4804af8700 1 -- 172.21.15.80:0/2035573143 shutdown_connections 2019-11-28T11:57:45.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f4804af8700 1 --2- 172.21.15.80:0/2035573143 >> v2:172.21.15.80:3300/0 conn(0x7f4800072620 0x7f4800164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:45.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.776+0000 7f4804af8700 1 --2- 172.21.15.80:0/2035573143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f480006c0a0 0x7f4800072fa0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:45.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.777+0000 7f4804af8700 1 -- 172.21.15.80:0/2035573143 shutdown_connections 2019-11-28T11:57:45.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.778+0000 7f4804af8700 1 -- 172.21.15.80:0/2035573143 wait complete. 2019-11-28T11:57:45.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.778+0000 7f4804af8700 1 -- 172.21.15.80:0/2035573143 >> 172.21.15.80:0/2035573143 conn(0x7f4800061cf0 msgr2=0x7f4800064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:45.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7f4804af8700 1 Processor -- start 2019-11-28T11:57:45.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.780+0000 7f4804af8700 1 -- start start 2019-11-28T11:57:45.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f4804af8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48001355e0 0x7f4800135a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:45.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f4804af8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4800135fb0 0x7f4800168ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:45.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f4804af8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4800106980 con 0x7f48001043b0 2019-11-28T11:57:45.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f4804af8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4800133540 con 0x7f4800135fb0 2019-11-28T11:57:45.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f4804af8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4800133810 con 0x7f48001355e0 2019-11-28T11:57:45.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f47fed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f48001043b0 0x7f48001367a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45292/0 (socket says 172.21.15.80:45292) 2019-11-28T11:57:45.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f47fed9d700 1 -- 172.21.15.80:0/4272626889 learned_addr learned my addr 172.21.15.80:0/4272626889 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:45.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.781+0000 7f47ff59e700 1 --2- 172.21.15.80:0/4272626889 >> v2:172.21.15.174:3300/0 conn(0x7f4800135fb0 0x7f4800168ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:45.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f47fe59c700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48001355e0 0x7f4800135a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:45.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f47ff59e700 1 -- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48001355e0 msgr2=0x7f4800135a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:45.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f47ff59e700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48001355e0 0x7f4800135a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:45.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f47ff59e700 1 -- 172.21.15.80:0/4272626889 >> v1:172.21.15.80:6789/0 conn(0x7f48001043b0 legacy=0x7f48001367a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:45.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f47ff59e700 1 -- 172.21.15.80:0/4272626889 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4800133ea0 con 0x7f4800135fb0 2019-11-28T11:57:45.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f47ff59e700 1 --2- 172.21.15.80:0/4272626889 >> v2:172.21.15.174:3300/0 conn(0x7f4800135fb0 0x7f4800168ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47f0010700 tx=0x7f47f0010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f47ff59e700 1 --2- 172.21.15.80:0/4272626889 >> v2:172.21.15.174:3300/0 conn(0x7f4800135fb0 0x7f4800168ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47f0010700 tx=0x7f47f0010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f47ff59e700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4800135fb0 0x7f4800168ea0 secure :-1 s=READY pgs=1634 cs=0 l=1 rx=0x7f47f0010700 tx=0x7f47f0010500).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:45.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f47ff59e700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4800135fb0 0x7f4800168ea0 secure :-1 s=THROTTLE_DONE pgs=1634 cs=0 l=1 rx=0x7f47f0010700 tx=0x7f47f0010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f47ff59e700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4800135fb0 0x7f4800168ea0 secure :-1 s=THROTTLE_DONE pgs=1634 cs=0 l=1 rx=0x7f47f0010700 tx=0x7f47f0010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f47f77fe700 1 -- 172.21.15.80:0/4272626889 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47f0009b10 con 0x7f4800135fb0 2019-11-28T11:57:45.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f47ff59e700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4800135fb0 0x7f4800168ea0 secure :-1 s=THROTTLE_DONE pgs=1634 cs=0 l=1 rx=0x7f47f0010700 tx=0x7f47f0010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f47f77fe700 1 -- 172.21.15.80:0/4272626889 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f000aa30 con 0x7f4800135fb0 2019-11-28T11:57:45.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f4804af8700 1 -- 172.21.15.80:0/4272626889 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4800134220 con 0x7f4800135fb0 2019-11-28T11:57:45.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f47f77fe700 1 -- 172.21.15.80:0/4272626889 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47f000a0f0 con 0x7f4800135fb0 2019-11-28T11:57:45.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.782+0000 7f4804af8700 1 -- 172.21.15.80:0/4272626889 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4800133ea0 con 0x7f4800135fb0 2019-11-28T11:57:45.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.783+0000 7f47ff59e700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4800135fb0 0x7f4800168ea0 secure :-1 s=THROTTLE_DONE pgs=1634 cs=0 l=1 rx=0x7f47f0010700 tx=0x7f47f0010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.783+0000 7f47f77fe700 1 -- 172.21.15.80:0/4272626889 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f47f0009900 con 0x7f4800135fb0 2019-11-28T11:57:45.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.783+0000 7f47ff59e700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4800135fb0 0x7f4800168ea0 secure :-1 s=THROTTLE_DONE pgs=1634 cs=0 l=1 rx=0x7f47f0010700 tx=0x7f47f0010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.783+0000 7f47f77fe700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47e4018730 0x7f47e401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:45.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.783+0000 7f47f77fe700 1 -- 172.21.15.80:0/4272626889 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f47f0031ff0 con 0x7f4800135fb0 2019-11-28T11:57:45.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.783+0000 7f47fed9d700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47e4018730 0x7f47e401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:45.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.783+0000 7f47fed9d700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47e4018730 0x7f47e401abc0 crc :-1 s=READY pgs=1123 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:45.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.788+0000 7f4804af8700 1 -- 172.21.15.80:0/4272626889 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4800134220 con 0x7f4800135fb0 2019-11-28T11:57:45.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.792+0000 7f47ff59e700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4800135fb0 0x7f4800168ea0 secure :-1 s=THROTTLE_DONE pgs=1634 cs=0 l=1 rx=0x7f47f0010700 tx=0x7f47f0010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:45.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.792+0000 7f47f77fe700 1 -- 172.21.15.80:0/4272626889 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f47f000aa30 con 0x7f4800135fb0 2019-11-28T11:57:45.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:45.974+0000 7f6ab6dce700 1 -- 172.21.15.80:0/3495670031 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f6ab0121d20 con 0x7f6ab012cea0 2019-11-28T11:57:46.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.151+0000 7f4804af8700 1 -- 172.21.15.80:0/4272626889 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f4800133ea0 con 0x7f4800135fb0 2019-11-28T11:57:46.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.151+0000 7ff6f3baf700 1 -- 172.21.15.80:0/2009181887 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7ff6c8001d10 con 0x7ff6ec1281b0 2019-11-28T11:57:46.156 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:57:46.159+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:57:46.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.163+0000 7f6ab536b700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab012cea0 0x7f6ab0111db0 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f6aa00103f0 tx=0x7f6aa0010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.163+0000 7f6aadffb700 1 -- 172.21.15.80:0/3495670031 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7754 v169) v1 ==== 95+0+0 (secure 0 0 0) 0x7f6aa0000a50 con 0x7f6ab012cea0 2019-11-28T11:57:46.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.163+0000 7f47ff59e700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4800135fb0 0x7f4800168ea0 secure :-1 s=THROTTLE_DONE pgs=1634 cs=0 l=1 rx=0x7f47f0010700 tx=0x7f47f0010500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.163+0000 7f47f77fe700 1 -- 172.21.15.80:0/4272626889 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 10972 v169) v1 ==== 96+0+0 (secure 0 0 0) 0x7f47f0009900 con 0x7f4800135fb0 2019-11-28T11:57:46.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.163+0000 7ff6f194b700 1 --2- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ec1281b0 0x7ff6ec128640 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7ff6e8010380 tx=0x7ff6e8010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.163+0000 7ff6e2ffd700 1 -- 172.21.15.80:0/2009181887 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 11703 v169) v1 ==== 96+0+0 (secure 0 0 0) 0x7ff6e8007210 con 0x7ff6ec1281b0 2019-11-28T11:57:46.163 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 10972 2019-11-28T11:57:46.164 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 11703 2019-11-28T11:57:46.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7f4804af8700 1 -- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47e4018730 msgr2=0x7f47e401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7f4804af8700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47e4018730 0x7f47e401abc0 crc :-1 s=READY pgs=1123 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7f4804af8700 1 -- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4800135fb0 msgr2=0x7f4800168ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7f4804af8700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4800135fb0 0x7f4800168ea0 secure :-1 s=READY pgs=1634 cs=0 l=1 rx=0x7f47f0010700 tx=0x7f47f0010500).stop 2019-11-28T11:57:46.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7f4804af8700 1 -- 172.21.15.80:0/4272626889 shutdown_connections 2019-11-28T11:57:46.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7f4804af8700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47e4018730 0x7f47e401abc0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7f4804af8700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4800135fb0 0x7f4800168ea0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7f4804af8700 1 --2- 172.21.15.80:0/4272626889 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48001355e0 0x7f4800135a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7f4804af8700 1 -- 172.21.15.80:0/4272626889 shutdown_connections 2019-11-28T11:57:46.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7f4804af8700 1 -- 172.21.15.80:0/4272626889 wait complete. 2019-11-28T11:57:46.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7f4804af8700 1 -- 172.21.15.80:0/4272626889 >> 172.21.15.80:0/4272626889 conn(0x7f48001104d0 msgr2=0x7f480012e720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:46.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7ff6f3baf700 1 -- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6d4018730 msgr2=0x7ff6d401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7ff6f3baf700 1 --2- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6d4018730 0x7ff6d401abe0 crc :-1 s=READY pgs=1121 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7ff6f3baf700 1 -- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ec1281b0 msgr2=0x7ff6ec128640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7ff6f3baf700 1 --2- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ec1281b0 0x7ff6ec128640 secure :-1 s=READY pgs=1632 cs=0 l=1 rx=0x7ff6e8010380 tx=0x7ff6e8010720).stop 2019-11-28T11:57:46.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7ff6f3baf700 1 -- 172.21.15.80:0/2009181887 shutdown_connections 2019-11-28T11:57:46.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7ff6f3baf700 1 --2- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff6d4018730 0x7ff6d401abe0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7ff6f3baf700 1 --2- 172.21.15.80:0/2009181887 >> v2:172.21.15.80:3300/0 conn(0x7ff6ec128b80 0x7ff6ec167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7ff6f3baf700 1 --2- 172.21.15.80:0/2009181887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6ec1281b0 0x7ff6ec128640 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7ff6f3baf700 1 -- 172.21.15.80:0/2009181887 shutdown_connections 2019-11-28T11:57:46.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7ff6f3baf700 1 -- 172.21.15.80:0/2009181887 wait complete. 2019-11-28T11:57:46.171 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.170+0000 7ff6f3baf700 1 -- 172.21.15.80:0/2009181887 >> 172.21.15.80:0/2009181887 conn(0x7ff6ec127dc0 msgr2=0x7ff6ec141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:46.177 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:57:46.178 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:57:46.185 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 7754 2019-11-28T11:57:46.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.190+0000 7f6ab6dce700 1 -- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a90018730 msgr2=0x7f6a9001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.190+0000 7f6ab6dce700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a90018730 0x7f6a9001abe0 crc :-1 s=READY pgs=1122 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.190+0000 7f6ab6dce700 1 -- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab012cea0 msgr2=0x7f6ab0111db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.190+0000 7f6ab6dce700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab012cea0 0x7f6ab0111db0 secure :-1 s=READY pgs=389 cs=0 l=1 rx=0x7f6aa00103f0 tx=0x7f6aa0010790).stop 2019-11-28T11:57:46.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.190+0000 7f6ab6dce700 1 -- 172.21.15.80:0/3495670031 shutdown_connections 2019-11-28T11:57:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.190+0000 7f6ab6dce700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6a90018730 0x7f6a9001abe0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.190+0000 7f6ab6dce700 1 --2- 172.21.15.80:0/3495670031 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ab012cea0 0x7f6ab0111db0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.191+0000 7f6ab6dce700 1 -- 172.21.15.80:0/3495670031 shutdown_connections 2019-11-28T11:57:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.191+0000 7f6ab6dce700 1 -- 172.21.15.80:0/3495670031 wait complete. 2019-11-28T11:57:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.191+0000 7f6ab6dce700 1 -- 172.21.15.80:0/3495670031 >> 172.21.15.80:0/3495670031 conn(0x7f6ab01426c0 msgr2=0x7f6ab0110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:46.197 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:57:46.197 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:57:46.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.384+0000 7efd20da9700 1 Processor -- start 2019-11-28T11:57:46.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.384+0000 7efd20da9700 1 -- start start 2019-11-28T11:57:46.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.385+0000 7efd20da9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd1c06d120 0x7efd1c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:46.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.385+0000 7efd20da9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1c06d580 con 0x7efd1c06c490 2019-11-28T11:57:46.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.385+0000 7efd20da9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1c06db00 con 0x7efd1c06c0a0 2019-11-28T11:57:46.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.385+0000 7efd20da9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c06fd60 con 0x7efd1c06d120 2019-11-28T11:57:46.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.385+0000 7efd1a59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efd1c06c490 0x7efd1c06c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45306/0 (socket says 172.21.15.80:45306) 2019-11-28T11:57:46.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.385+0000 7efd1a59c700 1 -- 172.21.15.80:0/430765048 learned_addr learned my addr 172.21.15.80:0/430765048 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:46.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd1b59e700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd1c06d120 0x7efd1c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:46.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd19d9b700 1 -- 172.21.15.80:0/430765048 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633672180 0 0) 0x7efd04001150 con 0x7efd1c06c490 2019-11-28T11:57:46.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd19d9b700 1 -- 172.21.15.80:0/430765048 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcfc002e80 con 0x7efd1c06c490 2019-11-28T11:57:46.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd19d9b700 1 -- 172.21.15.80:0/430765048 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3384834931 0 0) 0x7efd04001130 con 0x7efd1c06c490 2019-11-28T11:57:46.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd19d9b700 1 -- 172.21.15.80:0/430765048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd1c06d120 msgr2=0x7efd1c165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:46.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd19d9b700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd1c06d120 0x7efd1c165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:46.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd19d9b700 1 -- 172.21.15.80:0/430765048 >> v1:172.21.15.174:6789/0 conn(0x7efd1c06c0a0 legacy=0x7efd1c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd19d9b700 1 -- 172.21.15.80:0/430765048 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c0706c0 con 0x7efd1c06c490 2019-11-28T11:57:46.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd19d9b700 1 -- 172.21.15.80:0/430765048 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7efd04001660 con 0x7efd1c06c490 2019-11-28T11:57:46.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd19d9b700 1 -- 172.21.15.80:0/430765048 >> v1:172.21.15.80:6789/0 conn(0x7efd1c06c490 legacy=0x7efd1c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd19d9b700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcfc003ab0 0x7efcfc005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:46.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd19d9b700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcfc006690 0x7efcfc008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:46.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd19d9b700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcfc009380 0x7efcfc00b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:46.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd19d9b700 1 -- 172.21.15.80:0/430765048 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc00bfd0 con 0x7efcfc006690 2019-11-28T11:57:46.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd19d9b700 1 -- 172.21.15.80:0/430765048 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc0501d0 con 0x7efcfc003ab0 2019-11-28T11:57:46.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd19d9b700 1 -- 172.21.15.80:0/430765048 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc050400 con 0x7efcfc009380 2019-11-28T11:57:46.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd1a59c700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcfc006690 0x7efcfc008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:46.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd1ad9d700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcfc003ab0 0x7efcfc005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:46.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd1b59e700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcfc009380 0x7efcfc00b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:46.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd1a59c700 1 -- 172.21.15.80:0/430765048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcfc009380 msgr2=0x7efcfc00b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:46.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd1a59c700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcfc009380 0x7efcfc00b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:46.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd1a59c700 1 -- 172.21.15.80:0/430765048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcfc003ab0 msgr2=0x7efcfc005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:46.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd1a59c700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcfc003ab0 0x7efcfc005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:46.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd1a59c700 1 -- 172.21.15.80:0/430765048 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc0506b0 con 0x7efcfc006690 2019-11-28T11:57:46.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd1b59e700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcfc009380 0x7efcfc00b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:57:46.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.386+0000 7efd1a59c700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcfc006690 0x7efcfc008b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efd0400f910 tx=0x7efd0400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.387+0000 7efd1a59c700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcfc006690 0x7efcfc008b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efd0400f910 tx=0x7efd0400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.387+0000 7efd1a59c700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcfc006690 0x7efcfc008b20 secure :-1 s=READY pgs=2703 cs=0 l=1 rx=0x7efd0400f910 tx=0x7efd0400f790).ready entity=mon.0 client_cookie=23cccb4aa53a8b0e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.387+0000 7efd1a59c700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcfc006690 0x7efcfc008b20 secure :-1 s=THROTTLE_DONE pgs=2703 cs=0 l=1 rx=0x7efd0400f910 tx=0x7efd0400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.387+0000 7efd1a59c700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcfc006690 0x7efcfc008b20 secure :-1 s=THROTTLE_DONE pgs=2703 cs=0 l=1 rx=0x7efd0400f910 tx=0x7efd0400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.387+0000 7efd19d9b700 1 -- 172.21.15.80:0/430765048 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd04001130 con 0x7efcfc006690 2019-11-28T11:57:46.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.387+0000 7efd1a59c700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcfc006690 0x7efcfc008b20 secure :-1 s=THROTTLE_DONE pgs=2703 cs=0 l=1 rx=0x7efd0400f910 tx=0x7efd0400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.387+0000 7efd19d9b700 1 -- 172.21.15.80:0/430765048 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd04004240 con 0x7efcfc006690 2019-11-28T11:57:46.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.387+0000 7efd19d9b700 1 -- 172.21.15.80:0/430765048 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd04004890 con 0x7efcfc006690 2019-11-28T11:57:46.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.387+0000 7efd20da9700 1 -- 172.21.15.80:0/430765048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcfc006690 msgr2=0x7efcfc008b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.387+0000 7efd20da9700 1 --2- 172.21.15.80:0/430765048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcfc006690 0x7efcfc008b20 secure :-1 s=READY pgs=2703 cs=0 l=1 rx=0x7efd0400f910 tx=0x7efd0400f790).stop 2019-11-28T11:57:46.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.387+0000 7efd1b59e700 1 -- 172.21.15.80:0/430765048 reap_dead start 2019-11-28T11:57:46.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.387+0000 7efd20da9700 1 -- 172.21.15.80:0/430765048 shutdown_connections 2019-11-28T11:57:46.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.387+0000 7efd20da9700 1 -- 172.21.15.80:0/430765048 shutdown_connections 2019-11-28T11:57:46.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.387+0000 7efd20da9700 1 -- 172.21.15.80:0/430765048 wait complete. 2019-11-28T11:57:46.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.387+0000 7efd20da9700 1 -- 172.21.15.80:0/430765048 >> 172.21.15.80:0/430765048 conn(0x7efd1c061cf0 msgr2=0x7efd1c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:46.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.390+0000 7efd20da9700 1 Processor -- start 2019-11-28T11:57:46.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.390+0000 7efd20da9700 1 -- start start 2019-11-28T11:57:46.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd20da9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd1c074d00 0x7efd1c0750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:46.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd20da9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1c079230 con 0x7efd1c152bd0 2019-11-28T11:57:46.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd20da9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1c079890 con 0x7efd1c153040 2019-11-28T11:57:46.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd20da9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c079e30 con 0x7efd1c074d00 2019-11-28T11:57:46.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd1a59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efd1c152bd0 0x7efd1c140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45316/0 (socket says 172.21.15.80:45316) 2019-11-28T11:57:46.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd1a59c700 1 -- 172.21.15.80:0/228432869 learned_addr learned my addr 172.21.15.80:0/228432869 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:46.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd1ad9d700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd1c074d00 0x7efd1c0750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:46.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862778942 0 0) 0x7efd04000c90 con 0x7efd1c152bd0 2019-11-28T11:57:46.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf4002e80 con 0x7efd1c152bd0 2019-11-28T11:57:46.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406572633 0 0) 0x7efd140097c0 con 0x7efd1c153040 2019-11-28T11:57:46.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf40030b0 con 0x7efd1c153040 2019-11-28T11:57:46.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2288866560 0 0) 0x7efd04000940 con 0x7efd1c152bd0 2019-11-28T11:57:46.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efcf40033c0 con 0x7efd1c152bd0 2019-11-28T11:57:46.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7efd040016d0 con 0x7efd1c152bd0 2019-11-28T11:57:46.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd1c074d00 msgr2=0x7efd1c0750f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd1c074d00 0x7efd1c0750f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 >> v1:172.21.15.174:6789/0 conn(0x7efd1c153040 legacy=0x7efd1c140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 >> v1:172.21.15.80:6789/0 conn(0x7efd1c152bd0 legacy=0x7efd1c140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcf4005d70 0x7efcf4006160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:46.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcf40046f0 0x7efcf4004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:46.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcf4005140 0x7efcf40032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:46.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40039b0 con 0x7efcf40046f0 2019-11-28T11:57:46.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4003be0 con 0x7efcf4005140 2019-11-28T11:57:46.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4003e10 con 0x7efcf4005d70 2019-11-28T11:57:46.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.391+0000 7efd1ad9d700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efd1c074d00 0x7efd1c0750f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:57:46.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1a59c700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcf40046f0 0x7efcf4004bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:46.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1b59e700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcf4005140 0x7efcf40032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:46.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1ad9d700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcf4005d70 0x7efcf4006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:46.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1a59c700 1 -- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcf4005d70 msgr2=0x7efcf4006160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1a59c700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcf4005d70 0x7efcf4006160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1a59c700 1 -- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcf4005140 msgr2=0x7efcf40032e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1a59c700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcf4005140 0x7efcf40032e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1a59c700 1 -- 172.21.15.80:0/228432869 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf40040c0 con 0x7efcf40046f0 2019-11-28T11:57:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd20da9700 1 -- 172.21.15.80:0/228432869 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1c07b810 con 0x7efcf40046f0 2019-11-28T11:57:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1a59c700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcf40046f0 0x7efcf4004bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efd04010400 tx=0x7efd040107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1ad9d700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcf4005d70 0x7efcf4006160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:57:46.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1b59e700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcf4005140 0x7efcf40032e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:57:46.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd20da9700 1 -- 172.21.15.80:0/228432869 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1c07b490 con 0x7efcf40046f0 2019-11-28T11:57:46.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1a59c700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcf40046f0 0x7efcf4004bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efd04010400 tx=0x7efd040107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1a59c700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcf40046f0 0x7efcf4004bb0 secure :-1 s=READY pgs=2705 cs=0 l=1 rx=0x7efd04010400 tx=0x7efd040107a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:46.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1a59c700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcf40046f0 0x7efcf4004bb0 secure :-1 s=THROTTLE_DONE pgs=2705 cs=0 l=1 rx=0x7efd04010400 tx=0x7efd040107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd04000940 con 0x7efcf40046f0 2019-11-28T11:57:46.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1a59c700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcf40046f0 0x7efcf4004bb0 secure :-1 s=THROTTLE_DONE pgs=2705 cs=0 l=1 rx=0x7efd04010400 tx=0x7efd040107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1a59c700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcf40046f0 0x7efcf4004bb0 secure :-1 s=THROTTLE_DONE pgs=2705 cs=0 l=1 rx=0x7efd04010400 tx=0x7efd040107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd04004240 con 0x7efcf40046f0 2019-11-28T11:57:46.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd04004990 con 0x7efcf40046f0 2019-11-28T11:57:46.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.392+0000 7efd1a59c700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcf40046f0 0x7efcf4004bb0 secure :-1 s=THROTTLE_DONE pgs=2705 cs=0 l=1 rx=0x7efd04010400 tx=0x7efd040107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.393+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efd04001880 con 0x7efcf40046f0 2019-11-28T11:57:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.393+0000 7efd1a59c700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcf40046f0 0x7efcf4004bb0 secure :-1 s=THROTTLE_DONE pgs=2705 cs=0 l=1 rx=0x7efd04010400 tx=0x7efd040107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.393+0000 7efd137fe700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efcf4020b90 0x7efcf4022fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.393+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6106+0+0 (secure 0 0 0) 0x7efd04031c30 con 0x7efcf40046f0 2019-11-28T11:57:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.393+0000 7efd1ad9d700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efcf4020b90 0x7efcf4022fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:46.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.393+0000 7efd1ad9d700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efcf4020b90 0x7efcf4022fc0 crc :-1 s=READY pgs=1124 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:46.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.399+0000 7efd20da9700 1 -- 172.21.15.80:0/228432869 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1c07b810 con 0x7efcf40046f0 2019-11-28T11:57:46.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.403+0000 7efd1a59c700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcf40046f0 0x7efcf4004bb0 secure :-1 s=THROTTLE_DONE pgs=2705 cs=0 l=1 rx=0x7efd04010400 tx=0x7efd040107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.403+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efd04001550 con 0x7efcf40046f0 2019-11-28T11:57:46.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.579+0000 7efd20da9700 1 -- 172.21.15.80:0/228432869 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7efd1c07b490 con 0x7efcf40046f0 2019-11-28T11:57:46.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.580+0000 7efd1a59c700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcf40046f0 0x7efcf4004bb0 secure :-1 s=THROTTLE_DONE pgs=2705 cs=0 l=1 rx=0x7efd04010400 tx=0x7efd040107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.580+0000 7efd137fe700 1 -- 172.21.15.80:0/228432869 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v206) v1 ==== 81+0+31777 (secure 0 0 0) 0x7efd04001860 con 0x7efcf40046f0 2019-11-28T11:57:46.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.584+0000 7efd20da9700 1 -- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efcf4020b90 msgr2=0x7efcf4022fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.585+0000 7efd20da9700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efcf4020b90 0x7efcf4022fc0 crc :-1 s=READY pgs=1124 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.585+0000 7efd20da9700 1 -- 172.21.15.80:0/228432869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcf40046f0 msgr2=0x7efcf4004bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.585+0000 7efd20da9700 1 --2- 172.21.15.80:0/228432869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcf40046f0 0x7efcf4004bb0 secure :-1 s=READY pgs=2705 cs=0 l=1 rx=0x7efd04010400 tx=0x7efd040107a0).stop 2019-11-28T11:57:46.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.585+0000 7efd1b59e700 1 -- 172.21.15.80:0/228432869 reap_dead start 2019-11-28T11:57:46.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.585+0000 7efd20da9700 1 -- 172.21.15.80:0/228432869 shutdown_connections 2019-11-28T11:57:46.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.585+0000 7efd20da9700 1 -- 172.21.15.80:0/228432869 shutdown_connections 2019-11-28T11:57:46.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.585+0000 7efd20da9700 1 -- 172.21.15.80:0/228432869 wait complete. 2019-11-28T11:57:46.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.585+0000 7efd20da9700 1 -- 172.21.15.80:0/228432869 >> 172.21.15.80:0/228432869 conn(0x7efd1c13fa50 msgr2=0x7efd1c07c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:46.585 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:57:46.586 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:57:46.586 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 206, 2019-11-28T11:57:46.586 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:57:46.586 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:57:46.587 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:57:46.156591+0000", 2019-11-28T11:57:46.587 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:57:46.587 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:57:46.587 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:57:46.588 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:57:46.588 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:57:46.588 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:57:46.588 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:57:46.588 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:57:46.589 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:57:46.589 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:57:46.589 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:57:46.589 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:57:46.590 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:57:46.590 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:57:46.590 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:57:46.590 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 33, 2019-11-28T11:57:46.591 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:57:46.591 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:57:46.591 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:57:46.591 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:57:46.592 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:57:46.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.592 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:57:46.594 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:57:46.594 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:57:46.594 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:57:46.595 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:57:46.595 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:57:46.595 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:57:46.595 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:57:46.596 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:57:46.596 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:57:46.596 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:57:46.596 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:57:46.596 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:57:46.597 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:57:46.597 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:57:46.597 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:57:46.597 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:57:46.598 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:57:46.598 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:57:46.598 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:57:46.598 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:57:46.599 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:57:46.599 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:57:46.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.599 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:57:46.600 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:57:46.600 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:57:46.608 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:57:46.608 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:57:46.608 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:57:46.608 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:57:46.609 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:57:46.609 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:57:46.609 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:57:46.609 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:57:46.609 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:57:46.610 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:57:46.610 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:57:46.610 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:57:46.610 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:57:46.610 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:57:46.611 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:57:46.611 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:57:46.611 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:57:46.611 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:57:46.611 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:57:46.612 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:57:46.612 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:57:46.612 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:57:46.612 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:57:46.613 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:57:46.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.613 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:57:46.613 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:57:46.613 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:57:46.614 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:57:46.614 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:57:46.614 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:57:46.614 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:57:46.614 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:57:46.614 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:57:46.614 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:57:46.615 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:57:46.615 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:57:46.615 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:57:46.615 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:57:46.615 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.615 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 32, 2019-11-28T11:57:46.616 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:57:46.616 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:54:27.540791+0000", 2019-11-28T11:57:46.616 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:57:46.616 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:57:46.616 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:57:46.616 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:57:46.616 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:57:46.617 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:57:46.617 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:57:46.617 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:57:46.617 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:57:46.617 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:57:46.617 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:57:46.617 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:57:46.618 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:57:46.618 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:57:46.618 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:57:46.618 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:57:46.618 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:57:46.618 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:57:46.618 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:57:46.619 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:57:46.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.619 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "202", 2019-11-28T11:57:46.619 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:57:46.619 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:57:46.619 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:57:46.619 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:57:46.620 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:57:46.620 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:57:46.620 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:57:46.620 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:57:46.620 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:57:46.620 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:57:46.620 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:57:46.621 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:57:46.621 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:57:46.621 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:57:46.621 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:57:46.621 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:57:46.621 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:57:46.621 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:57:46.622 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:57:46.622 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:57:46.622 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:57:46.622 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:57:46.622 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:57:46.622 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:57:46.622 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:57:46.623 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:57:46.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.623 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:57:46.623 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:57:46.623 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:57:46.623 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:57:46.623 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:57:46.624 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:57:46.624 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:57:46.624 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:57:46.624 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:57:46.624 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:57:46.624 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:57:46.624 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:57:46.625 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:57:46.625 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:57:46.625 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:57:46.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.625 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:57:46.625 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:57:46.625 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:57:46.626 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.626 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.626 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 33, 2019-11-28T11:57:46.626 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:57:46.626 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:54:28.225144+0000", 2019-11-28T11:57:46.626 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:57:46.627 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:57:46.627 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:57:46.627 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:57:46.627 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:57:46.627 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:57:46.627 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:57:46.627 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:57:46.628 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:57:46.628 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:57:46.628 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:57:46.628 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:57:46.628 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:57:46.628 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:57:46.628 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:57:46.629 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:57:46.629 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:57:46.629 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:57:46.629 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:57:46.629 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:57:46.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.630 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "203", 2019-11-28T11:57:46.630 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:57:46.630 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:57:46.630 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:57:46.630 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:57:46.630 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:57:46.630 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:57:46.630 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:57:46.631 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:57:46.631 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:57:46.631 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:57:46.631 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:57:46.631 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:57:46.631 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:57:46.631 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:57:46.632 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:57:46.632 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:57:46.632 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:57:46.632 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:57:46.632 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:57:46.632 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:57:46.632 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:57:46.633 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:57:46.633 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:57:46.633 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:57:46.633 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:57:46.633 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:57:46.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.633 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:57:46.634 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:57:46.634 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:57:46.634 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:57:46.634 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:57:46.634 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:57:46.634 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:57:46.634 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:57:46.635 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:57:46.635 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:57:46.635 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:57:46.635 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:57:46.635 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:57:46.635 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:57:46.635 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:57:46.636 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.636 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.637 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.637 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:57:46.637 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:57:46.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.637 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:57:46.637 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:57:46.637 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:57:46.638 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:57:46.638 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:57:46.638 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:57:46.638 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:57:46.638 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:57:46.638 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:57:46.638 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 200, 2019-11-28T11:57:46.639 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:57:46.639 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:57:46.639 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:57:46.639 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.639 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.639 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:57:46.640 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:57:46.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.640 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.640 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:57:46.640 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:57:46.640 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.641 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.641 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:57:46.641 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.641 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.641 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:57:46.642 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:57:46.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.644 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.644 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:57:46.644 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:57:46.644 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.644 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.645 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:57:46.645 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.645 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.646 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:57:46.646 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:57:46.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.647 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.647 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:57:46.647 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:57:46.647 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.647 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.648 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:57:46.648 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.648 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.648 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:57:46.648 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:57:46.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.649 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.649 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:57:46.649 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:57:46.649 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.649 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.650 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:57:46.650 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:57:46.650 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:57:46.650 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:57:46.650 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:57:46.650 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:57:46.651 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:57:46.651 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.651 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:57:46.651 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:57:46.651 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:57:46.652 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:57:46.652 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:57:46.652 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:57:46.652 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:57:46.652 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:57:46.652 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:57:46.653 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 188, 2019-11-28T11:57:46.653 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:57:46.653 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:57:46.653 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:57:46.653 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.654 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.654 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:57:46.654 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:57:46.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.654 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.654 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:57:46.654 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:57:46.655 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.655 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.655 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:57:46.655 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.655 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.656 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:57:46.656 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:57:46.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.656 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.656 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:57:46.656 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:57:46.657 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.657 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.657 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:57:46.657 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.657 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.658 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:57:46.658 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:57:46.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.658 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.658 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:57:46.658 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:57:46.659 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.659 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.659 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:57:46.659 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.659 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.660 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:57:46.660 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:57:46.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.660 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.660 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:57:46.660 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:57:46.661 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.661 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.661 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:57:46.661 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:57:46.661 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:57:46.661 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:57:46.661 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:57:46.662 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:57:46.662 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:57:46.662 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.662 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:57:46.662 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:57:46.663 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:57:46.663 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:57:46.663 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:57:46.663 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:57:46.663 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:57:46.663 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:57:46.663 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:57:46.664 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 201, 2019-11-28T11:57:46.664 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:57:46.664 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:57:46.664 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:57:46.664 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.664 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.665 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:57:46.665 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:57:46.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.665 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.665 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:57:46.665 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:57:46.666 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.666 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.666 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:57:46.666 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.666 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.666 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:57:46.667 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:57:46.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.667 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.667 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:57:46.667 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:57:46.667 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.668 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.668 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:57:46.668 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.668 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.668 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:57:46.669 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:57:46.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.669 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.669 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:57:46.669 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:57:46.669 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.670 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.670 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:57:46.670 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.670 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.670 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:57:46.671 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:57:46.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.671 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.671 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:57:46.671 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:57:46.671 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.671 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.672 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:57:46.672 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:57:46.672 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:57:46.672 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:57:46.672 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:57:46.672 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:57:46.673 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:57:46.673 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.673 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:57:46.673 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:57:46.673 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:57:46.674 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:57:46.674 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:57:46.674 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:57:46.674 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:57:46.674 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:57:46.674 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:57:46.674 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 201, 2019-11-28T11:57:46.675 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:57:46.675 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:57:46.675 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:57:46.675 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.675 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.675 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:57:46.676 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:57:46.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.676 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.676 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:57:46.676 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:57:46.676 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.677 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.677 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:57:46.677 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.677 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.677 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:57:46.678 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:57:46.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.678 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.678 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:57:46.678 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:57:46.678 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.678 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.679 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:57:46.679 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.679 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.679 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:57:46.679 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:57:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:57:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:57:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:57:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:57:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:57:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:57:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:57:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:57:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:57:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:57:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:57:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:57:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:57:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:57:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:57:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:57:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:57:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:57:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:57:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:57:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:57:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:57:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:57:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 188, 2019-11-28T11:57:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:57:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:57:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:57:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:57:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:57:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:57:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:57:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:57:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:57:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:57:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:57:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:57:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:57:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:57:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:57:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:57:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:57:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:57:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:57:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:57:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:57:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:57:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:57:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:57:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:57:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:57:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:57:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:57:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:57:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:57:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:57:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:57:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:57:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:57:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:57:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:57:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:57:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:57:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 201, 2019-11-28T11:57:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:57:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:57:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:57:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:57:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:57:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:57:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:57:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:57:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:57:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:57:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:57:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:57:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:57:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:57:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:57:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:57:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:57:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:57:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:57:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:57:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:57:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:57:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:57:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:57:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:57:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:57:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:57:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:57:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:57:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:57:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:57:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:57:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:57:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:57:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:57:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:57:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:57:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:57:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 200, 2019-11-28T11:57:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:57:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:57:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:57:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:57:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:57:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:57:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:57:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:57:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:57:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:57:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:57:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:57:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:57:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:57:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:57:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:57:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:57:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:57:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:57:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:57:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:57:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:57:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:57:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:57:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:57:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:57:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:57:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:57:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:57:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:57:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:57:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:57:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:57:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:57:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:57:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:57:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:57:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:57:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 187, 2019-11-28T11:57:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:57:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:57:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:57:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:57:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:57:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:57:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:57:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:57:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:57:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:57:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:57:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:57:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:57:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:57:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:57:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:57:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:57:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:57:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:57:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:57:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:57:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:57:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:57:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:57:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:57:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:57:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:57:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:57:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:57:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:57:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:57:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:57:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:57:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:57:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:57:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:57:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:57:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:57:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:57:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:57:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:57:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:57:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:57:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:57:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:57:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:57:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:57:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:57:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:57:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:57:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:57:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:57:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:57:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:57:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:57:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:57:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:57:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:57:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.734 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:57:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:57:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:57:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:57:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:57:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:57:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:57:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:57:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:57:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:57:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:57:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:57:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:57:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:57:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:57:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:57:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:57:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:57:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:57:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:57:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:57:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:57:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:57:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:57:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:57:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:57:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:57:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:57:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:57:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:57:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:57:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:57:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:57:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:57:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:57:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:57:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:57:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:57:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:57:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:57:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:57:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:57:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:57:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:57:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:57:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:57:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/2209008547": "2019-11-29T11:57:46.153543+0000", 2019-11-28T11:57:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/2209008547": "2019-11-29T11:57:46.153543+0000" 2019-11-28T11:57:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:57:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:57:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:57:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:57:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:57:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:57:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:57:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:57:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:57:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:57:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:57:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:57:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:57:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:57:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:57:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:57:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:57:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:57:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:57:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:57:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:57:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:57:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:57:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:57:46.748 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:57:46.750 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:57:46.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.873+0000 7f384ba4e700 1 Processor -- start 2019-11-28T11:57:46.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.873+0000 7f384ba4e700 1 -- start start 2019-11-28T11:57:46.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.874+0000 7f384ba4e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f384406c490 0x7f384406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:46.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.874+0000 7f384ba4e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f384406ce60 0x7f3844164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:46.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.874+0000 7f384ba4e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384406db00 con 0x7f384406c0a0 2019-11-28T11:57:46.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.874+0000 7f384ba4e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384406fd60 con 0x7f384406c490 2019-11-28T11:57:46.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.874+0000 7f384ba4e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3844070030 con 0x7f384406ce60 2019-11-28T11:57:46.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.874+0000 7f38497ea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f384406c490 0x7f384406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:46.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.874+0000 7f3849feb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f384406c0a0 0x7f3844072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45328/0 (socket says 172.21.15.80:45328) 2019-11-28T11:57:46.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.874+0000 7f3849feb700 1 -- 172.21.15.80:0/2855367659 learned_addr learned my addr 172.21.15.80:0/2855367659 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:46.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.874+0000 7f384a7ec700 1 --2- 172.21.15.80:0/2855367659 >> v2:172.21.15.174:3300/0 conn(0x7f384406ce60 0x7f3844164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:46.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.874+0000 7f38497ea700 1 -- 172.21.15.80:0/2855367659 >> v2:172.21.15.174:3300/0 conn(0x7f384406ce60 msgr2=0x7f3844164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.874+0000 7f38497ea700 1 --2- 172.21.15.80:0/2855367659 >> v2:172.21.15.174:3300/0 conn(0x7f384406ce60 0x7f3844164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.874+0000 7f38497ea700 1 -- 172.21.15.80:0/2855367659 >> v1:172.21.15.80:6789/0 conn(0x7f384406c0a0 legacy=0x7f3844072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.874+0000 7f38497ea700 1 -- 172.21.15.80:0/2855367659 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38440706c0 con 0x7f384406c490 2019-11-28T11:57:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.874+0000 7f3848fe9700 1 -- 172.21.15.80:0/2855367659 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836790299 0 0) 0x7f382c0014d0 con 0x7f384406c0a0 2019-11-28T11:57:46.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.875+0000 7f38497ea700 1 --2- 172.21.15.80:0/2855367659 >> v2:172.21.15.80:3300/0 conn(0x7f384406c490 0x7f384406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f383400af50 tx=0x7f383400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.875+0000 7f38497ea700 1 --2- 172.21.15.80:0/2855367659 >> v2:172.21.15.80:3300/0 conn(0x7f384406c490 0x7f384406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f383400af50 tx=0x7f383400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.875+0000 7f38497ea700 1 --2- 172.21.15.80:0/2855367659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f384406c490 0x7f384406c920 secure :-1 s=READY pgs=2707 cs=0 l=1 rx=0x7f383400af50 tx=0x7f383400b250).ready entity=mon.0 client_cookie=72e032246e78ea21 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:46.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.875+0000 7f38497ea700 1 --2- 172.21.15.80:0/2855367659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f384406c490 0x7f384406c920 secure :-1 s=THROTTLE_DONE pgs=2707 cs=0 l=1 rx=0x7f383400af50 tx=0x7f383400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.875+0000 7f3848fe9700 1 -- 172.21.15.80:0/2855367659 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3834007210 con 0x7f384406c490 2019-11-28T11:57:46.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.875+0000 7f38497ea700 1 --2- 172.21.15.80:0/2855367659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f384406c490 0x7f384406c920 secure :-1 s=THROTTLE_DONE pgs=2707 cs=0 l=1 rx=0x7f383400af50 tx=0x7f383400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.875+0000 7f3848fe9700 1 -- 172.21.15.80:0/2855367659 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38340099b0 con 0x7f384406c490 2019-11-28T11:57:46.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.875+0000 7f38497ea700 1 --2- 172.21.15.80:0/2855367659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f384406c490 0x7f384406c920 secure :-1 s=THROTTLE_DONE pgs=2707 cs=0 l=1 rx=0x7f383400af50 tx=0x7f383400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.875+0000 7f3848fe9700 1 -- 172.21.15.80:0/2855367659 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3834007210 con 0x7f384406c490 2019-11-28T11:57:46.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.875+0000 7f384ba4e700 1 -- 172.21.15.80:0/2855367659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f384406c490 msgr2=0x7f384406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.875+0000 7f384ba4e700 1 --2- 172.21.15.80:0/2855367659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f384406c490 0x7f384406c920 secure :-1 s=READY pgs=2707 cs=0 l=1 rx=0x7f383400af50 tx=0x7f383400b250).stop 2019-11-28T11:57:46.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.875+0000 7f384ba4e700 1 -- 172.21.15.80:0/2855367659 shutdown_connections 2019-11-28T11:57:46.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.875+0000 7f384ba4e700 1 --2- 172.21.15.80:0/2855367659 >> v2:172.21.15.174:3300/0 conn(0x7f384406ce60 0x7f3844164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:46.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.875+0000 7f384ba4e700 1 --2- 172.21.15.80:0/2855367659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f384406c490 0x7f384406c920 unknown :-1 s=CLOSED pgs=2707 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.876+0000 7f384ba4e700 1 -- 172.21.15.80:0/2855367659 shutdown_connections 2019-11-28T11:57:46.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.876+0000 7f384ba4e700 1 -- 172.21.15.80:0/2855367659 wait complete. 2019-11-28T11:57:46.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.876+0000 7f384ba4e700 1 -- 172.21.15.80:0/2855367659 >> 172.21.15.80:0/2855367659 conn(0x7f3844061cf0 msgr2=0x7f3844064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:46.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.878+0000 7f384ba4e700 1 Processor -- start 2019-11-28T11:57:46.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.878+0000 7f384ba4e700 1 -- start start 2019-11-28T11:57:46.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.879+0000 7f384ba4e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38441284f0 0x7f3844128980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:46.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.879+0000 7f384ba4e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f384412e240 0x7f384412e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:46.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.879+0000 7f384ba4e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3844101e80 con 0x7f3844142160 2019-11-28T11:57:46.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.879+0000 7f384ba4e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3844107520 con 0x7f384412e240 2019-11-28T11:57:46.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.879+0000 7f384ba4e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38441077f0 con 0x7f38441284f0 2019-11-28T11:57:46.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.879+0000 7f3849feb700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f3844142160 0x7f384410de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:60878/0 (socket says 172.21.15.80:60878) 2019-11-28T11:57:46.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.879+0000 7f3849feb700 1 -- 172.21.15.80:0/1352684785 learned_addr learned my addr 172.21.15.80:0/1352684785 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:46.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.879+0000 7f38497ea700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38441284f0 0x7f3844128980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:46.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.879+0000 7f384a7ec700 1 --2- 172.21.15.80:0/1352684785 >> v2:172.21.15.174:3300/0 conn(0x7f384412e240 0x7f384412e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:46.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.879+0000 7f38427fc700 1 -- 172.21.15.80:0/1352684785 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035349805 0 0) 0x7f382c0014d0 con 0x7f3844142160 2019-11-28T11:57:46.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.879+0000 7f38427fc700 1 -- 172.21.15.80:0/1352684785 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3828002e80 con 0x7f3844142160 2019-11-28T11:57:46.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.880+0000 7f38497ea700 1 -- 172.21.15.80:0/1352684785 >> v2:172.21.15.174:3300/0 conn(0x7f384412e240 msgr2=0x7f384412e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.880+0000 7f38497ea700 1 --2- 172.21.15.80:0/1352684785 >> v2:172.21.15.174:3300/0 conn(0x7f384412e240 0x7f384412e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:46.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.880+0000 7f38497ea700 1 -- 172.21.15.80:0/1352684785 >> v1:172.21.15.174:6789/0 conn(0x7f3844142160 legacy=0x7f384410de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:46.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.880+0000 7f38497ea700 1 -- 172.21.15.80:0/1352684785 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3844107e80 con 0x7f38441284f0 2019-11-28T11:57:46.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.880+0000 7f38497ea700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38441284f0 0x7f3844128980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3834010390 tx=0x7f3834010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.880+0000 7f38497ea700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38441284f0 0x7f3844128980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3834010390 tx=0x7f3834010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.880+0000 7f38497ea700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38441284f0 0x7f3844128980 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7f3834010390 tx=0x7f3834010210).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:46.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.880+0000 7f38497ea700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38441284f0 0x7f3844128980 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7f3834010390 tx=0x7f3834010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.880+0000 7f38427fc700 1 -- 172.21.15.80:0/1352684785 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3834000940 con 0x7f38441284f0 2019-11-28T11:57:46.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.880+0000 7f38497ea700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38441284f0 0x7f3844128980 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7f3834010390 tx=0x7f3834010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.880+0000 7f38427fc700 1 -- 172.21.15.80:0/1352684785 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383400a980 con 0x7f38441284f0 2019-11-28T11:57:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.880+0000 7f38497ea700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38441284f0 0x7f3844128980 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7f3834010390 tx=0x7f3834010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.880+0000 7f384ba4e700 1 -- 172.21.15.80:0/1352684785 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3844108200 con 0x7f38441284f0 2019-11-28T11:57:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.880+0000 7f38427fc700 1 -- 172.21.15.80:0/1352684785 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38340009e0 con 0x7f38441284f0 2019-11-28T11:57:46.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.880+0000 7f384ba4e700 1 -- 172.21.15.80:0/1352684785 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3844107e80 con 0x7f38441284f0 2019-11-28T11:57:46.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.880+0000 7f38497ea700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38441284f0 0x7f3844128980 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7f3834010390 tx=0x7f3834010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.881+0000 7f38427fc700 1 -- 172.21.15.80:0/1352684785 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3834009790 con 0x7f38441284f0 2019-11-28T11:57:46.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.881+0000 7f38497ea700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38441284f0 0x7f3844128980 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7f3834010390 tx=0x7f3834010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.881+0000 7f38427fc700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3828018770 0x7f382801ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:46.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.881+0000 7f38427fc700 1 -- 172.21.15.80:0/1352684785 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f3834031c80 con 0x7f38441284f0 2019-11-28T11:57:46.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.881+0000 7f3849feb700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3828018770 0x7f382801ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:46.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.881+0000 7f3849feb700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3828018770 0x7f382801ac00 crc :-1 s=READY pgs=1125 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:46.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.888+0000 7f384ba4e700 1 -- 172.21.15.80:0/1352684785 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3844108200 con 0x7f38441284f0 2019-11-28T11:57:46.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.892+0000 7f38497ea700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38441284f0 0x7f3844128980 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7f3834010390 tx=0x7f3834010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:46.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:46.892+0000 7f38427fc700 1 -- 172.21.15.80:0/1352684785 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f383400a980 con 0x7f38441284f0 2019-11-28T11:57:47.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.067+0000 7f384ba4e700 1 -- 172.21.15.80:0/1352684785 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3844107e80 con 0x7f38441284f0 2019-11-28T11:57:47.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.068+0000 7f38497ea700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38441284f0 0x7f3844128980 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7f3834010390 tx=0x7f3834010210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:47.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.068+0000 7f38427fc700 1 -- 172.21.15.80:0/1352684785 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 169 v169) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f383400a980 con 0x7f38441284f0 2019-11-28T11:57:47.065 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 169 2019-11-28T11:57:47.066 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:57:47.066 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":169,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":169,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:54:29.202039+0000","modified":"2019-11-28T11:57:46.160606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":205,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2019-11-28T11:57:47.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.070+0000 7f384ba4e700 1 -- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3828018770 msgr2=0x7f382801ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:47.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.070+0000 7f384ba4e700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3828018770 0x7f382801ac00 crc :-1 s=READY pgs=1125 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:47.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.070+0000 7f384ba4e700 1 -- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38441284f0 msgr2=0x7f3844128980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:47.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.070+0000 7f384ba4e700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38441284f0 0x7f3844128980 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7f3834010390 tx=0x7f3834010210).stop 2019-11-28T11:57:47.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.070+0000 7f384ba4e700 1 -- 172.21.15.80:0/1352684785 shutdown_connections 2019-11-28T11:57:47.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.070+0000 7f384ba4e700 1 --2- 172.21.15.80:0/1352684785 >> v2:172.21.15.174:3300/0 conn(0x7f384412e240 0x7f384412e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:47.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.070+0000 7f384ba4e700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38441284f0 0x7f3844128980 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:47.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.070+0000 7f384ba4e700 1 --2- 172.21.15.80:0/1352684785 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3828018770 0x7f382801ac00 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:47.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.070+0000 7f384ba4e700 1 -- 172.21.15.80:0/1352684785 shutdown_connections 2019-11-28T11:57:47.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.070+0000 7f384ba4e700 1 -- 172.21.15.80:0/1352684785 wait complete. 2019-11-28T11:57:47.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.070+0000 7f384ba4e700 1 -- 172.21.15.80:0/1352684785 >> 172.21.15.80:0/1352684785 conn(0x7f384415e210 msgr2=0x7f384410b140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:47.077 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:57:47.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.204+0000 7f96979d5700 1 Processor -- start 2019-11-28T11:57:47.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.204+0000 7f96979d5700 1 -- start start 2019-11-28T11:57:47.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.205+0000 7f96979d5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f969006c0a0 0x7f9690072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:47.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.205+0000 7f96979d5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9690072620 0x7f9690164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:47.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.205+0000 7f96979d5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969006db00 con 0x7f96900734e0 2019-11-28T11:57:47.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.205+0000 7f96979d5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969006fd60 con 0x7f969006c0a0 2019-11-28T11:57:47.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.205+0000 7f96979d5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9690070030 con 0x7f9690072620 2019-11-28T11:57:47.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9695f72700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f969006c0a0 0x7f9690072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:47.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9695f72700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f969006c0a0 0x7f9690072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46026/0 (socket says 172.21.15.80:46026) 2019-11-28T11:57:47.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9695f72700 1 -- 172.21.15.80:0/3283838719 learned_addr learned my addr 172.21.15.80:0/3283838719 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:47.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9696773700 1 --2- 172.21.15.80:0/3283838719 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9690072620 0x7f9690164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:47.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9695f72700 1 -- 172.21.15.80:0/3283838719 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9690072620 msgr2=0x7f9690164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:47.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9695f72700 1 --2- 172.21.15.80:0/3283838719 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9690072620 0x7f9690164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:47.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9695f72700 1 -- 172.21.15.80:0/3283838719 >> v1:172.21.15.174:6789/0 conn(0x7f96900734e0 legacy=0x7f9690071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:47.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9694f70700 1 -- 172.21.15.80:0/3283838719 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760282611 0 0) 0x7f9680000ff0 con 0x7f96900734e0 2019-11-28T11:57:47.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9695f72700 1 -- 172.21.15.80:0/3283838719 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900706c0 con 0x7f969006c0a0 2019-11-28T11:57:47.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9695f72700 1 --2- 172.21.15.80:0/3283838719 >> v2:172.21.15.80:3300/0 conn(0x7f969006c0a0 0x7f9690072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f967800fa40 tx=0x7f967800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:47.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9695f72700 1 --2- 172.21.15.80:0/3283838719 >> v2:172.21.15.80:3300/0 conn(0x7f969006c0a0 0x7f9690072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f967800fa40 tx=0x7f967800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:47.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9695f72700 1 --2- 172.21.15.80:0/3283838719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f969006c0a0 0x7f9690072fa0 secure :-1 s=READY pgs=2708 cs=0 l=1 rx=0x7f967800fa40 tx=0x7f967800fde0).ready entity=mon.0 client_cookie=31c6a91b0bf66929 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:47.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9695f72700 1 --2- 172.21.15.80:0/3283838719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f969006c0a0 0x7f9690072fa0 secure :-1 s=THROTTLE_DONE pgs=2708 cs=0 l=1 rx=0x7f967800fa40 tx=0x7f967800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:47.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9694f70700 1 -- 172.21.15.80:0/3283838719 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9678000ce0 con 0x7f969006c0a0 2019-11-28T11:57:47.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9695f72700 1 --2- 172.21.15.80:0/3283838719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f969006c0a0 0x7f9690072fa0 secure :-1 s=THROTTLE_DONE pgs=2708 cs=0 l=1 rx=0x7f967800fa40 tx=0x7f967800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:47.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9695f72700 1 --2- 172.21.15.80:0/3283838719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f969006c0a0 0x7f9690072fa0 secure :-1 s=THROTTLE_DONE pgs=2708 cs=0 l=1 rx=0x7f967800fa40 tx=0x7f967800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:47.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9694f70700 1 -- 172.21.15.80:0/3283838719 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9678001010 con 0x7f969006c0a0 2019-11-28T11:57:47.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f9694f70700 1 -- 172.21.15.80:0/3283838719 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9678001720 con 0x7f969006c0a0 2019-11-28T11:57:47.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f96979d5700 1 -- 172.21.15.80:0/3283838719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f969006c0a0 msgr2=0x7f9690072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:47.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.206+0000 7f96979d5700 1 --2- 172.21.15.80:0/3283838719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f969006c0a0 0x7f9690072fa0 secure :-1 s=READY pgs=2708 cs=0 l=1 rx=0x7f967800fa40 tx=0x7f967800fde0).stop 2019-11-28T11:57:47.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.207+0000 7f96979d5700 1 -- 172.21.15.80:0/3283838719 shutdown_connections 2019-11-28T11:57:47.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.207+0000 7f96979d5700 1 --2- 172.21.15.80:0/3283838719 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9690072620 0x7f9690164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:47.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.207+0000 7f96979d5700 1 --2- 172.21.15.80:0/3283838719 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f969006c0a0 0x7f9690072fa0 unknown :-1 s=CLOSED pgs=2708 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:47.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.207+0000 7f96979d5700 1 -- 172.21.15.80:0/3283838719 shutdown_connections 2019-11-28T11:57:47.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.207+0000 7f96979d5700 1 -- 172.21.15.80:0/3283838719 wait complete. 2019-11-28T11:57:47.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.207+0000 7f96979d5700 1 -- 172.21.15.80:0/3283838719 >> 172.21.15.80:0/3283838719 conn(0x7f9690061cf0 msgr2=0x7f9690064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:47.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.209+0000 7f96979d5700 1 Processor -- start 2019-11-28T11:57:47.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.210+0000 7f96979d5700 1 -- start start 2019-11-28T11:57:47.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.210+0000 7f96979d5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96901096f0 0x7f9690169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:47.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.210+0000 7f96979d5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96901066e0 con 0x7f969013e9e0 2019-11-28T11:57:47.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.210+0000 7f96979d5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969010ce40 con 0x7f969013e5f0 2019-11-28T11:57:47.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.210+0000 7f96979d5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969010e060 con 0x7f96901096f0 2019-11-28T11:57:47.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.210+0000 7f9695771700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f969013e9e0 0x7f9690108ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45348/0 (socket says 172.21.15.80:45348) 2019-11-28T11:57:47.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.210+0000 7f9695771700 1 -- 172.21.15.80:0/3855397875 learned_addr learned my addr 172.21.15.80:0/3855397875 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:47.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f9696773700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96901096f0 0x7f9690169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:47.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f968e7fc700 1 -- 172.21.15.80:0/3855397875 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948801968 0 0) 0x7f9680001190 con 0x7f969013e9e0 2019-11-28T11:57:47.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f968e7fc700 1 -- 172.21.15.80:0/3855397875 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9674002e80 con 0x7f969013e9e0 2019-11-28T11:57:47.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f968e7fc700 1 -- 172.21.15.80:0/3855397875 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748685426 0 0) 0x7f96780083a0 con 0x7f969013e5f0 2019-11-28T11:57:47.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f968e7fc700 1 -- 172.21.15.80:0/3855397875 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96740030b0 con 0x7f969013e5f0 2019-11-28T11:57:47.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f9696773700 1 -- 172.21.15.80:0/3855397875 >> v1:172.21.15.174:6789/0 conn(0x7f969013e5f0 legacy=0x7f969010a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:47.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f9696773700 1 -- 172.21.15.80:0/3855397875 >> v1:172.21.15.80:6789/0 conn(0x7f969013e9e0 legacy=0x7f9690108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:47.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f9696773700 1 -- 172.21.15.80:0/3855397875 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969010e9c0 con 0x7f96901096f0 2019-11-28T11:57:47.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f9696773700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96901096f0 0x7f9690169ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9688010390 tx=0x7f9688010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:47.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f9696773700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96901096f0 0x7f9690169ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9688010390 tx=0x7f9688010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:47.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f9696773700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96901096f0 0x7f9690169ed0 secure :-1 s=READY pgs=391 cs=0 l=1 rx=0x7f9688010390 tx=0x7f9688010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:47.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f9696773700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96901096f0 0x7f9690169ed0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f9688010390 tx=0x7f9688010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:47.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f968e7fc700 1 -- 172.21.15.80:0/3855397875 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96880099b0 con 0x7f96901096f0 2019-11-28T11:57:47.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f9696773700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96901096f0 0x7f9690169ed0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f9688010390 tx=0x7f9688010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:47.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f968e7fc700 1 -- 172.21.15.80:0/3855397875 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9688000c00 con 0x7f96901096f0 2019-11-28T11:57:47.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f96979d5700 1 -- 172.21.15.80:0/3855397875 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969010ed40 con 0x7f96901096f0 2019-11-28T11:57:47.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f9696773700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96901096f0 0x7f9690169ed0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f9688010390 tx=0x7f9688010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:47.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f968e7fc700 1 -- 172.21.15.80:0/3855397875 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f968800f020 con 0x7f96901096f0 2019-11-28T11:57:47.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.211+0000 7f96979d5700 1 -- 172.21.15.80:0/3855397875 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969010e9c0 con 0x7f96901096f0 2019-11-28T11:57:47.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.212+0000 7f9696773700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96901096f0 0x7f9690169ed0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f9688010390 tx=0x7f9688010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:47.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.212+0000 7f968e7fc700 1 -- 172.21.15.80:0/3855397875 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f968800ef80 con 0x7f96901096f0 2019-11-28T11:57:47.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.212+0000 7f9696773700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96901096f0 0x7f9690169ed0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f9688010390 tx=0x7f9688010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:47.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.212+0000 7f968e7fc700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9674018750 0x7f967401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:47.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.212+0000 7f968e7fc700 1 -- 172.21.15.80:0/3855397875 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f9688031d00 con 0x7f96901096f0 2019-11-28T11:57:47.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.212+0000 7f9695f72700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9674018750 0x7f967401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:47.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.213+0000 7f9695f72700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9674018750 0x7f967401abe0 crc :-1 s=READY pgs=1126 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:47.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.220+0000 7f96979d5700 1 -- 172.21.15.80:0/3855397875 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969010ed40 con 0x7f96901096f0 2019-11-28T11:57:47.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.224+0000 7f9696773700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96901096f0 0x7f9690169ed0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f9688010390 tx=0x7f9688010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:47.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.224+0000 7f968e7fc700 1 -- 172.21.15.80:0/3855397875 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f968800ed10 con 0x7f96901096f0 2019-11-28T11:57:47.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:47.390+0000 7f96979d5700 1 -- 172.21.15.80:0/3855397875 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f969010e9c0 con 0x7f96901096f0 2019-11-28T11:57:48.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.180+0000 7f9696773700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96901096f0 0x7f9690169ed0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f9688010390 tx=0x7f9688010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.180+0000 7f968e7fc700 1 -- 172.21.15.80:0/3855397875 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v170) v1 ==== 161+0+0 (secure 0 0 0) 0x7f968800ef20 con 0x7f96901096f0 2019-11-28T11:57:48.202 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:57:48.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.208+0000 7f96979d5700 1 -- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9674018750 msgr2=0x7f967401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:48.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.208+0000 7f96979d5700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9674018750 0x7f967401abe0 crc :-1 s=READY pgs=1126 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:48.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.208+0000 7f96979d5700 1 -- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96901096f0 msgr2=0x7f9690169ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:48.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.208+0000 7f96979d5700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96901096f0 0x7f9690169ed0 secure :-1 s=READY pgs=391 cs=0 l=1 rx=0x7f9688010390 tx=0x7f9688010730).stop 2019-11-28T11:57:48.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.208+0000 7f96979d5700 1 -- 172.21.15.80:0/3855397875 shutdown_connections 2019-11-28T11:57:48.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.208+0000 7f96979d5700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f96901096f0 0x7f9690169ed0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:48.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.208+0000 7f96979d5700 1 --2- 172.21.15.80:0/3855397875 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9674018750 0x7f967401abe0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:48.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.208+0000 7f96979d5700 1 -- 172.21.15.80:0/3855397875 shutdown_connections 2019-11-28T11:57:48.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.208+0000 7f96979d5700 1 -- 172.21.15.80:0/3855397875 wait complete. 2019-11-28T11:57:48.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.208+0000 7f96979d5700 1 -- 172.21.15.80:0/3855397875 >> 172.21.15.80:0/3855397875 conn(0x7f969013d620 msgr2=0x7f969013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:48.216 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:57:48.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.339+0000 7f8a8fde1700 1 Processor -- start 2019-11-28T11:57:48.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.339+0000 7f8a8fde1700 1 -- start start 2019-11-28T11:57:48.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8fde1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a8806c0a0 0x7f8a88072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:48.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8fde1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a880734e0 0x7f8a88071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:48.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8fde1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8a88072360 0x7f8a88072800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:48.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8fde1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a8806fd60 con 0x7f8a8806c0a0 2019-11-28T11:57:48.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8fde1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a88070030 con 0x7f8a88072360 2019-11-28T11:57:48.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8fde1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8806f330 con 0x7f8a880734e0 2019-11-28T11:57:48.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8e37e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a8806c0a0 0x7f8a88072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:48.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8e37e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a8806c0a0 0x7f8a88072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46040/0 (socket says 172.21.15.80:46040) 2019-11-28T11:57:48.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8e37e700 1 -- 172.21.15.80:0/4067240059 learned_addr learned my addr 172.21.15.80:0/4067240059 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:48.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8eb7f700 1 --2- 172.21.15.80:0/4067240059 >> v2:172.21.15.174:3300/0 conn(0x7f8a88072360 0x7f8a88072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:48.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8db7d700 1 --2- 172.21.15.80:0/4067240059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a880734e0 0x7f8a88071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:48.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8e37e700 1 -- 172.21.15.80:0/4067240059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a880734e0 msgr2=0x7f8a88071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:48.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/4067240059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a880734e0 0x7f8a88071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:48.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8e37e700 1 -- 172.21.15.80:0/4067240059 >> v2:172.21.15.174:3300/0 conn(0x7f8a88072360 msgr2=0x7f8a88072800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:48.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/4067240059 >> v2:172.21.15.174:3300/0 conn(0x7f8a88072360 0x7f8a88072800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:48.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8e37e700 1 -- 172.21.15.80:0/4067240059 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a880706c0 con 0x7f8a8806c0a0 2019-11-28T11:57:48.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8db7d700 1 --2- 172.21.15.80:0/4067240059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a880734e0 0x7f8a88071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:57:48.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/4067240059 >> v2:172.21.15.80:3300/0 conn(0x7f8a8806c0a0 0x7f8a88072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8a7000fac0 tx=0x7f8a7000f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/4067240059 >> v2:172.21.15.80:3300/0 conn(0x7f8a8806c0a0 0x7f8a88072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8a7000fac0 tx=0x7f8a7000f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.340+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/4067240059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8806c0a0 0x7f8a88072fa0 secure :-1 s=READY pgs=2710 cs=0 l=1 rx=0x7f8a7000fac0 tx=0x7f8a7000f970).ready entity=mon.0 client_cookie=6d1ddd84d2fecf9e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.341+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/4067240059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8806c0a0 0x7f8a88072fa0 secure :-1 s=THROTTLE_DONE pgs=2710 cs=0 l=1 rx=0x7f8a7000fac0 tx=0x7f8a7000f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.341+0000 7f8a8d37c700 1 -- 172.21.15.80:0/4067240059 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a70000ce0 con 0x7f8a8806c0a0 2019-11-28T11:57:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.341+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/4067240059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8806c0a0 0x7f8a88072fa0 secure :-1 s=THROTTLE_DONE pgs=2710 cs=0 l=1 rx=0x7f8a7000fac0 tx=0x7f8a7000f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.341+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/4067240059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8806c0a0 0x7f8a88072fa0 secure :-1 s=THROTTLE_DONE pgs=2710 cs=0 l=1 rx=0x7f8a7000fac0 tx=0x7f8a7000f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.341+0000 7f8a8d37c700 1 -- 172.21.15.80:0/4067240059 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a70001010 con 0x7f8a8806c0a0 2019-11-28T11:57:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.341+0000 7f8a8d37c700 1 -- 172.21.15.80:0/4067240059 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a70001720 con 0x7f8a8806c0a0 2019-11-28T11:57:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.341+0000 7f8a8fde1700 1 -- 172.21.15.80:0/4067240059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8806c0a0 msgr2=0x7f8a88072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.341+0000 7f8a8fde1700 1 --2- 172.21.15.80:0/4067240059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8806c0a0 0x7f8a88072fa0 secure :-1 s=READY pgs=2710 cs=0 l=1 rx=0x7f8a7000fac0 tx=0x7f8a7000f970).stop 2019-11-28T11:57:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.342+0000 7f8a8fde1700 1 -- 172.21.15.80:0/4067240059 shutdown_connections 2019-11-28T11:57:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.342+0000 7f8a8fde1700 1 --2- 172.21.15.80:0/4067240059 >> v2:172.21.15.174:3300/0 conn(0x7f8a88072360 0x7f8a88072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.342+0000 7f8a8fde1700 1 --2- 172.21.15.80:0/4067240059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a880734e0 0x7f8a88071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.342+0000 7f8a8fde1700 1 --2- 172.21.15.80:0/4067240059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8806c0a0 0x7f8a88072fa0 unknown :-1 s=CLOSED pgs=2710 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:48.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.342+0000 7f8a8fde1700 1 -- 172.21.15.80:0/4067240059 shutdown_connections 2019-11-28T11:57:48.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.342+0000 7f8a8fde1700 1 -- 172.21.15.80:0/4067240059 wait complete. 2019-11-28T11:57:48.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.342+0000 7f8a8fde1700 1 -- 172.21.15.80:0/4067240059 >> 172.21.15.80:0/4067240059 conn(0x7f8a88061cf0 msgr2=0x7f8a88064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:48.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.344+0000 7f8a8fde1700 1 Processor -- start 2019-11-28T11:57:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.344+0000 7f8a8fde1700 1 -- start start 2019-11-28T11:57:48.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8fde1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a8813dc00 0x7f8a88109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:48.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8fde1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a8810a3a0 0x7f8a88108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:48.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8fde1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a881312c0 con 0x7f8a88109220 2019-11-28T11:57:48.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8fde1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a88105830 con 0x7f8a8813dc00 2019-11-28T11:57:48.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8fde1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a88105b00 con 0x7f8a8810a3a0 2019-11-28T11:57:48.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8e37e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a8813dc00 0x7f8a88109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:48.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8e37e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a8813dc00 0x7f8a88109e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46046/0 (socket says 172.21.15.80:46046) 2019-11-28T11:57:48.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8e37e700 1 -- 172.21.15.80:0/339253211 learned_addr learned my addr 172.21.15.80:0/339253211 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:48.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8db7d700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a8810a3a0 0x7f8a88108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:48.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8e37e700 1 -- 172.21.15.80:0/339253211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a8810a3a0 msgr2=0x7f8a88108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:48.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a8810a3a0 0x7f8a88108ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:48.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8e37e700 1 -- 172.21.15.80:0/339253211 >> v1:172.21.15.174:6789/0 conn(0x7f8a88109220 legacy=0x7f8a88103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:48.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8e37e700 1 -- 172.21.15.80:0/339253211 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a88106190 con 0x7f8a8813dc00 2019-11-28T11:57:48.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/339253211 >> v2:172.21.15.80:3300/0 conn(0x7f8a8813dc00 0x7f8a88109e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a700107c0 tx=0x7f8a700105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/339253211 >> v2:172.21.15.80:3300/0 conn(0x7f8a8813dc00 0x7f8a88109e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a700107c0 tx=0x7f8a700105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8813dc00 0x7f8a88109e60 secure :-1 s=READY pgs=2711 cs=0 l=1 rx=0x7f8a700107c0 tx=0x7f8a700105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:48.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8813dc00 0x7f8a88109e60 secure :-1 s=THROTTLE_DONE pgs=2711 cs=0 l=1 rx=0x7f8a700107c0 tx=0x7f8a700105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a86ffd700 1 -- 172.21.15.80:0/339253211 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a70007de0 con 0x7f8a8813dc00 2019-11-28T11:57:48.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.345+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8813dc00 0x7f8a88109e60 secure :-1 s=THROTTLE_DONE pgs=2711 cs=0 l=1 rx=0x7f8a700107c0 tx=0x7f8a700105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.346+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8813dc00 0x7f8a88109e60 secure :-1 s=THROTTLE_DONE pgs=2711 cs=0 l=1 rx=0x7f8a700107c0 tx=0x7f8a700105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.346+0000 7f8a86ffd700 1 -- 172.21.15.80:0/339253211 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a700056f0 con 0x7f8a8813dc00 2019-11-28T11:57:48.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.346+0000 7f8a8fde1700 1 -- 172.21.15.80:0/339253211 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a88106510 con 0x7f8a8813dc00 2019-11-28T11:57:48.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.346+0000 7f8a86ffd700 1 -- 172.21.15.80:0/339253211 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a70005e00 con 0x7f8a8813dc00 2019-11-28T11:57:48.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.346+0000 7f8a8fde1700 1 -- 172.21.15.80:0/339253211 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a88106190 con 0x7f8a8813dc00 2019-11-28T11:57:48.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.346+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8813dc00 0x7f8a88109e60 secure :-1 s=THROTTLE_DONE pgs=2711 cs=0 l=1 rx=0x7f8a700107c0 tx=0x7f8a700105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.346+0000 7f8a86ffd700 1 -- 172.21.15.80:0/339253211 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8a700058e0 con 0x7f8a8813dc00 2019-11-28T11:57:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.346+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8813dc00 0x7f8a88109e60 secure :-1 s=THROTTLE_DONE pgs=2711 cs=0 l=1 rx=0x7f8a700107c0 tx=0x7f8a700105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.346+0000 7f8a86ffd700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a6c018730 0x7f8a6c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.346+0000 7f8a86ffd700 1 -- 172.21.15.80:0/339253211 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8a70031ea0 con 0x7f8a8813dc00 2019-11-28T11:57:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.347+0000 7f8a8db7d700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a6c018730 0x7f8a6c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:48.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.347+0000 7f8a8db7d700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a6c018730 0x7f8a6c01abc0 crc :-1 s=READY pgs=1127 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.354+0000 7f8a8fde1700 1 -- 172.21.15.80:0/339253211 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a88106510 con 0x7f8a8813dc00 2019-11-28T11:57:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.357+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8813dc00 0x7f8a88109e60 secure :-1 s=THROTTLE_DONE pgs=2711 cs=0 l=1 rx=0x7f8a700107c0 tx=0x7f8a700105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.357+0000 7f8a86ffd700 1 -- 172.21.15.80:0/339253211 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8a700075b0 con 0x7f8a8813dc00 2019-11-28T11:57:48.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.529+0000 7f8a8fde1700 1 -- 172.21.15.80:0/339253211 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a88106190 con 0x7f8a8813dc00 2019-11-28T11:57:48.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.529+0000 7f8a8e37e700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8813dc00 0x7f8a88109e60 secure :-1 s=THROTTLE_DONE pgs=2711 cs=0 l=1 rx=0x7f8a700107c0 tx=0x7f8a700105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.529+0000 7f8a86ffd700 1 -- 172.21.15.80:0/339253211 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 170 v170) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f8a70017e20 con 0x7f8a8813dc00 2019-11-28T11:57:48.528 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 170 2019-11-28T11:57:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:57:48.528 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":170,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":170,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:54:29.202039+0000","modified":"2019-11-28T11:57:48.173999+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":205,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2019-11-28T11:57:48.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.532+0000 7f8a8fde1700 1 -- 172.21.15.80:0/339253211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a6c018730 msgr2=0x7f8a6c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:48.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.532+0000 7f8a8fde1700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a6c018730 0x7f8a6c01abc0 crc :-1 s=READY pgs=1127 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:48.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.532+0000 7f8a8fde1700 1 -- 172.21.15.80:0/339253211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8813dc00 msgr2=0x7f8a88109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:48.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.532+0000 7f8a8fde1700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8813dc00 0x7f8a88109e60 secure :-1 s=READY pgs=2711 cs=0 l=1 rx=0x7f8a700107c0 tx=0x7f8a700105f0).stop 2019-11-28T11:57:48.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.532+0000 7f8a8fde1700 1 -- 172.21.15.80:0/339253211 shutdown_connections 2019-11-28T11:57:48.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.532+0000 7f8a8fde1700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8a6c018730 0x7f8a6c01abc0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:48.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.532+0000 7f8a8fde1700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a8810a3a0 0x7f8a88108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:48.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.532+0000 7f8a8fde1700 1 --2- 172.21.15.80:0/339253211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a8813dc00 0x7f8a88109e60 unknown :-1 s=CLOSED pgs=2711 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:48.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.532+0000 7f8a8fde1700 1 -- 172.21.15.80:0/339253211 shutdown_connections 2019-11-28T11:57:48.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.532+0000 7f8a8fde1700 1 -- 172.21.15.80:0/339253211 wait complete. 2019-11-28T11:57:48.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.532+0000 7f8a8fde1700 1 -- 172.21.15.80:0/339253211 >> 172.21.15.80:0/339253211 conn(0x7f8a8811bfc0 msgr2=0x7f8a88141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:48.566 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:57:48.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.695+0000 7fbe6293e700 1 Processor -- start 2019-11-28T11:57:48.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.695+0000 7fbe6293e700 1 -- start start 2019-11-28T11:57:48.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.696+0000 7fbe6293e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe5c06d120 0x7fbe5c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:48.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.696+0000 7fbe6293e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c06d580 con 0x7fbe5c06c0a0 2019-11-28T11:57:48.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.696+0000 7fbe6293e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c06db00 con 0x7fbe5c06c490 2019-11-28T11:57:48.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.696+0000 7fbe6293e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c06fd60 con 0x7fbe5c06d120 2019-11-28T11:57:48.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.696+0000 7fbe60edb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbe5c06c0a0 0x7fbe5c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45370/0 (socket says 172.21.15.80:45370) 2019-11-28T11:57:48.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.696+0000 7fbe60edb700 1 -- 172.21.15.80:0/2177936292 learned_addr learned my addr 172.21.15.80:0/2177936292 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:48.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe616dc700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe5c06d120 0x7fbe5c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:48.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5b7fe700 1 -- 172.21.15.80:0/2177936292 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933082673 0 0) 0x7fbe4c001150 con 0x7fbe5c06c0a0 2019-11-28T11:57:48.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5b7fe700 1 -- 172.21.15.80:0/2177936292 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe48002e80 con 0x7fbe5c06c0a0 2019-11-28T11:57:48.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5b7fe700 1 -- 172.21.15.80:0/2177936292 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2581760938 0 0) 0x7fbe4c001130 con 0x7fbe5c06c0a0 2019-11-28T11:57:48.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5b7fe700 1 -- 172.21.15.80:0/2177936292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe5c06d120 msgr2=0x7fbe5c165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:48.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5b7fe700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe5c06d120 0x7fbe5c165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:48.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5b7fe700 1 -- 172.21.15.80:0/2177936292 >> v1:172.21.15.174:6789/0 conn(0x7fbe5c06c490 legacy=0x7fbe5c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:48.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5b7fe700 1 -- 172.21.15.80:0/2177936292 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c0706c0 con 0x7fbe5c06c0a0 2019-11-28T11:57:48.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5b7fe700 1 -- 172.21.15.80:0/2177936292 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fbe4c001660 con 0x7fbe5c06c0a0 2019-11-28T11:57:48.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5b7fe700 1 -- 172.21.15.80:0/2177936292 >> v1:172.21.15.80:6789/0 conn(0x7fbe5c06c0a0 legacy=0x7fbe5c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:48.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5b7fe700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe48003ab0 0x7fbe48005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:48.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5b7fe700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe48006640 0x7fbe48008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:48.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5b7fe700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe48009310 0x7fbe4800b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:48.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5b7fe700 1 -- 172.21.15.80:0/2177936292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4800bff0 con 0x7fbe48006640 2019-11-28T11:57:48.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5b7fe700 1 -- 172.21.15.80:0/2177936292 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480501f0 con 0x7fbe48009310 2019-11-28T11:57:48.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5b7fe700 1 -- 172.21.15.80:0/2177936292 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe48050420 con 0x7fbe48003ab0 2019-11-28T11:57:48.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe48006640 0x7fbe48008b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:48.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe60edb700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe48003ab0 0x7fbe48005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:48.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe616dc700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe48009310 0x7fbe4800b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:48.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5bfff700 1 -- 172.21.15.80:0/2177936292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe48003ab0 msgr2=0x7fbe48005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:48.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe48003ab0 0x7fbe48005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:48.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5bfff700 1 -- 172.21.15.80:0/2177936292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe48009310 msgr2=0x7fbe4800b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:48.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe48009310 0x7fbe4800b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:48.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5bfff700 1 -- 172.21.15.80:0/2177936292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe480506d0 con 0x7fbe48006640 2019-11-28T11:57:48.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.697+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe48006640 0x7fbe48008b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbe4400af50 tx=0x7fbe4400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.698+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe48006640 0x7fbe48008b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbe4400af50 tx=0x7fbe4400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.698+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe48006640 0x7fbe48008b10 secure :-1 s=READY pgs=2713 cs=0 l=1 rx=0x7fbe4400af50 tx=0x7fbe4400b250).ready entity=mon.0 client_cookie=29470715c728ba5a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:48.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.698+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe48006640 0x7fbe48008b10 secure :-1 s=THROTTLE_DONE pgs=2713 cs=0 l=1 rx=0x7fbe4400af50 tx=0x7fbe4400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.698+0000 7fbe5b7fe700 1 -- 172.21.15.80:0/2177936292 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe44009ba0 con 0x7fbe48006640 2019-11-28T11:57:48.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.698+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe48006640 0x7fbe48008b10 secure :-1 s=THROTTLE_DONE pgs=2713 cs=0 l=1 rx=0x7fbe4400af50 tx=0x7fbe4400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.698+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe48006640 0x7fbe48008b10 secure :-1 s=THROTTLE_DONE pgs=2713 cs=0 l=1 rx=0x7fbe4400af50 tx=0x7fbe4400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.698+0000 7fbe5b7fe700 1 -- 172.21.15.80:0/2177936292 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe440097c0 con 0x7fbe48006640 2019-11-28T11:57:48.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.698+0000 7fbe5b7fe700 1 -- 172.21.15.80:0/2177936292 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe44000960 con 0x7fbe48006640 2019-11-28T11:57:48.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.698+0000 7fbe6293e700 1 -- 172.21.15.80:0/2177936292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe48006640 msgr2=0x7fbe48008b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:48.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.698+0000 7fbe6293e700 1 --2- 172.21.15.80:0/2177936292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe48006640 0x7fbe48008b10 secure :-1 s=READY pgs=2713 cs=0 l=1 rx=0x7fbe4400af50 tx=0x7fbe4400b250).stop 2019-11-28T11:57:48.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.698+0000 7fbe616dc700 1 -- 172.21.15.80:0/2177936292 reap_dead start 2019-11-28T11:57:48.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.698+0000 7fbe6293e700 1 -- 172.21.15.80:0/2177936292 shutdown_connections 2019-11-28T11:57:48.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.698+0000 7fbe6293e700 1 -- 172.21.15.80:0/2177936292 shutdown_connections 2019-11-28T11:57:48.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.698+0000 7fbe6293e700 1 -- 172.21.15.80:0/2177936292 wait complete. 2019-11-28T11:57:48.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.698+0000 7fbe6293e700 1 -- 172.21.15.80:0/2177936292 >> 172.21.15.80:0/2177936292 conn(0x7fbe5c061cf0 msgr2=0x7fbe5c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:48.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.701+0000 7fbe6293e700 1 Processor -- start 2019-11-28T11:57:48.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.701+0000 7fbe6293e700 1 -- start start 2019-11-28T11:57:48.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe6293e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe5c140070 0x7fbe5c114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:48.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe6293e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe5c114980 0x7fbe5c1134e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:48.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe6293e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c15b940 con 0x7fbe5c113a20 2019-11-28T11:57:48.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe6293e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5c158e70 con 0x7fbe5c114980 2019-11-28T11:57:48.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe6293e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c158950 con 0x7fbe5c140070 2019-11-28T11:57:48.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe5bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe5c114980 0x7fbe5c1134e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:48.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe5bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe5c114980 0x7fbe5c1134e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46070/0 (socket says 172.21.15.80:46070) 2019-11-28T11:57:48.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe5bfff700 1 -- 172.21.15.80:0/755785585 learned_addr learned my addr 172.21.15.80:0/755785585 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:48.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe60edb700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe5c140070 0x7fbe5c114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:48.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe5bfff700 1 -- 172.21.15.80:0/755785585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe5c140070 msgr2=0x7fbe5c114440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:48.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe5c140070 0x7fbe5c114440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:48.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe5bfff700 1 -- 172.21.15.80:0/755785585 >> v1:172.21.15.174:6789/0 conn(0x7fbe5c113a20 legacy=0x7fbe5c109f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:48.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe5bfff700 1 -- 172.21.15.80:0/755785585 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c15a200 con 0x7fbe5c114980 2019-11-28T11:57:48.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe597fa700 1 -- 172.21.15.80:0/755785585 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471014858 0 0) 0x7fbe540011f0 con 0x7fbe5c113a20 2019-11-28T11:57:48.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/755785585 >> v2:172.21.15.80:3300/0 conn(0x7fbe5c114980 0x7fbe5c1134e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbe44010450 tx=0x7fbe44010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/755785585 >> v2:172.21.15.80:3300/0 conn(0x7fbe5c114980 0x7fbe5c1134e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbe44010450 tx=0x7fbe44010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.702+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c114980 0x7fbe5c1134e0 secure :-1 s=READY pgs=2714 cs=0 l=1 rx=0x7fbe44010450 tx=0x7fbe44010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:48.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.703+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c114980 0x7fbe5c1134e0 secure :-1 s=THROTTLE_DONE pgs=2714 cs=0 l=1 rx=0x7fbe44010450 tx=0x7fbe44010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.703+0000 7fbe597fa700 1 -- 172.21.15.80:0/755785585 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe44000940 con 0x7fbe5c114980 2019-11-28T11:57:48.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.703+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c114980 0x7fbe5c1134e0 secure :-1 s=THROTTLE_DONE pgs=2714 cs=0 l=1 rx=0x7fbe44010450 tx=0x7fbe44010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.703+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c114980 0x7fbe5c1134e0 secure :-1 s=THROTTLE_DONE pgs=2714 cs=0 l=1 rx=0x7fbe44010450 tx=0x7fbe44010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.703+0000 7fbe597fa700 1 -- 172.21.15.80:0/755785585 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe44009a70 con 0x7fbe5c114980 2019-11-28T11:57:48.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.703+0000 7fbe6293e700 1 -- 172.21.15.80:0/755785585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c15a580 con 0x7fbe5c114980 2019-11-28T11:57:48.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.703+0000 7fbe597fa700 1 -- 172.21.15.80:0/755785585 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe4400a080 con 0x7fbe5c114980 2019-11-28T11:57:48.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.703+0000 7fbe6293e700 1 -- 172.21.15.80:0/755785585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c15a200 con 0x7fbe5c114980 2019-11-28T11:57:48.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.703+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c114980 0x7fbe5c1134e0 secure :-1 s=THROTTLE_DONE pgs=2714 cs=0 l=1 rx=0x7fbe44010450 tx=0x7fbe44010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.703+0000 7fbe597fa700 1 -- 172.21.15.80:0/755785585 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbe44009c60 con 0x7fbe5c114980 2019-11-28T11:57:48.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.703+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c114980 0x7fbe5c1134e0 secure :-1 s=THROTTLE_DONE pgs=2714 cs=0 l=1 rx=0x7fbe44010450 tx=0x7fbe44010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.703+0000 7fbe597fa700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe40018730 0x7fbe4001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:48.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.703+0000 7fbe597fa700 1 -- 172.21.15.80:0/755785585 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fbe44031b10 con 0x7fbe5c114980 2019-11-28T11:57:48.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.703+0000 7fbe60edb700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe40018730 0x7fbe4001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:48.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.704+0000 7fbe60edb700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe40018730 0x7fbe4001abc0 crc :-1 s=READY pgs=1128 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:48.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.711+0000 7fbe6293e700 1 -- 172.21.15.80:0/755785585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c15a580 con 0x7fbe5c114980 2019-11-28T11:57:48.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.714+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c114980 0x7fbe5c1134e0 secure :-1 s=THROTTLE_DONE pgs=2714 cs=0 l=1 rx=0x7fbe44010450 tx=0x7fbe44010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:48.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.714+0000 7fbe597fa700 1 -- 172.21.15.80:0/755785585 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbe44009670 con 0x7fbe5c114980 2019-11-28T11:57:48.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:48.888+0000 7fbe6293e700 1 -- 172.21.15.80:0/755785585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbe5c15a200 con 0x7fbe5c114980 2019-11-28T11:57:49.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.183+0000 7fbe5bfff700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c114980 0x7fbe5c1134e0 secure :-1 s=THROTTLE_DONE pgs=2714 cs=0 l=1 rx=0x7fbe44010450 tx=0x7fbe44010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:49.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.183+0000 7fbe597fa700 1 -- 172.21.15.80:0/755785585 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v171) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbe44009c60 con 0x7fbe5c114980 2019-11-28T11:57:49.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.204+0000 7fbe6293e700 1 -- 172.21.15.80:0/755785585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe40018730 msgr2=0x7fbe4001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:49.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.204+0000 7fbe6293e700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe40018730 0x7fbe4001abc0 crc :-1 s=READY pgs=1128 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:49.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.204+0000 7fbe6293e700 1 -- 172.21.15.80:0/755785585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c114980 msgr2=0x7fbe5c1134e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:49.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.204+0000 7fbe6293e700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c114980 0x7fbe5c1134e0 secure :-1 s=READY pgs=2714 cs=0 l=1 rx=0x7fbe44010450 tx=0x7fbe44010280).stop 2019-11-28T11:57:49.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.205+0000 7fbe6293e700 1 -- 172.21.15.80:0/755785585 shutdown_connections 2019-11-28T11:57:49.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.205+0000 7fbe6293e700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbe40018730 0x7fbe4001abc0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:49.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.205+0000 7fbe6293e700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5c114980 0x7fbe5c1134e0 unknown :-1 s=CLOSED pgs=2714 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:49.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.205+0000 7fbe6293e700 1 --2- 172.21.15.80:0/755785585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe5c140070 0x7fbe5c114440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:49.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.205+0000 7fbe6293e700 1 -- 172.21.15.80:0/755785585 shutdown_connections 2019-11-28T11:57:49.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.205+0000 7fbe6293e700 1 -- 172.21.15.80:0/755785585 wait complete. 2019-11-28T11:57:49.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.205+0000 7fbe6293e700 1 -- 172.21.15.80:0/755785585 >> 172.21.15.80:0/755785585 conn(0x7fbe5c14feb0 msgr2=0x7fbe5c10c740 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:49.212 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:57:49.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.340+0000 7f7ad234c700 1 Processor -- start 2019-11-28T11:57:49.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.340+0000 7f7ad234c700 1 -- start start 2019-11-28T11:57:49.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.341+0000 7f7ad234c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7acc15f100 0x7f7acc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:49.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.341+0000 7f7ad234c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7acc06c2f0 0x7f7acc06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:49.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.341+0000 7f7ad234c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7acc06db60 con 0x7f7acc15ed10 2019-11-28T11:57:49.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.341+0000 7f7ad234c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7acc06fe00 con 0x7f7acc06c2f0 2019-11-28T11:57:49.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.341+0000 7f7ad234c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7acc0700d0 con 0x7f7acc15f100 2019-11-28T11:57:49.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.341+0000 7f7ad08e9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7acc15ed10 0x7f7acc073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45390/0 (socket says 172.21.15.80:45390) 2019-11-28T11:57:49.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.341+0000 7f7ad10ea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7acc06c2f0 0x7f7acc06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:49.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.341+0000 7f7ad08e9700 1 -- 172.21.15.80:0/763247026 learned_addr learned my addr 172.21.15.80:0/763247026 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:49.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7acbfff700 1 --2- 172.21.15.80:0/763247026 >> v2:172.21.15.174:3300/0 conn(0x7f7acc15f100 0x7f7acc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:49.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7acb7fe700 1 -- 172.21.15.80:0/763247026 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343067004 0 0) 0x7f7ab4001150 con 0x7f7acc15ed10 2019-11-28T11:57:49.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7acb7fe700 1 -- 172.21.15.80:0/763247026 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ab8002e80 con 0x7f7acc15ed10 2019-11-28T11:57:49.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7ad10ea700 1 -- 172.21.15.80:0/763247026 >> v2:172.21.15.174:3300/0 conn(0x7f7acc15f100 msgr2=0x7f7acc06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:49.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7ad10ea700 1 --2- 172.21.15.80:0/763247026 >> v2:172.21.15.174:3300/0 conn(0x7f7acc15f100 0x7f7acc06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:49.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7ad10ea700 1 -- 172.21.15.80:0/763247026 >> v1:172.21.15.80:6789/0 conn(0x7f7acc15ed10 legacy=0x7f7acc073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:49.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7ad10ea700 1 -- 172.21.15.80:0/763247026 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc070760 con 0x7f7acc06c2f0 2019-11-28T11:57:49.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7ad10ea700 1 --2- 172.21.15.80:0/763247026 >> v2:172.21.15.80:3300/0 conn(0x7f7acc06c2f0 0x7f7acc06c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ac400af50 tx=0x7f7ac400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:49.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7ad10ea700 1 --2- 172.21.15.80:0/763247026 >> v2:172.21.15.80:3300/0 conn(0x7f7acc06c2f0 0x7f7acc06c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ac400af50 tx=0x7f7ac400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:49.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7ad10ea700 1 --2- 172.21.15.80:0/763247026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc06c2f0 0x7f7acc06c770 secure :-1 s=READY pgs=2716 cs=0 l=1 rx=0x7f7ac400af50 tx=0x7f7ac400b250).ready entity=mon.0 client_cookie=20ccff21e1d08920 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:49.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7ad10ea700 1 --2- 172.21.15.80:0/763247026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc06c2f0 0x7f7acc06c770 secure :-1 s=THROTTLE_DONE pgs=2716 cs=0 l=1 rx=0x7f7ac400af50 tx=0x7f7ac400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:49.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7acb7fe700 1 -- 172.21.15.80:0/763247026 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ac4009ba0 con 0x7f7acc06c2f0 2019-11-28T11:57:49.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7ad10ea700 1 --2- 172.21.15.80:0/763247026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc06c2f0 0x7f7acc06c770 secure :-1 s=THROTTLE_DONE pgs=2716 cs=0 l=1 rx=0x7f7ac400af50 tx=0x7f7ac400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:49.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7acb7fe700 1 -- 172.21.15.80:0/763247026 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac40097c0 con 0x7f7acc06c2f0 2019-11-28T11:57:49.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7ad10ea700 1 --2- 172.21.15.80:0/763247026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc06c2f0 0x7f7acc06c770 secure :-1 s=THROTTLE_DONE pgs=2716 cs=0 l=1 rx=0x7f7ac400af50 tx=0x7f7ac400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:49.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7acb7fe700 1 -- 172.21.15.80:0/763247026 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ac4009ba0 con 0x7f7acc06c2f0 2019-11-28T11:57:49.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7ad234c700 1 -- 172.21.15.80:0/763247026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc06c2f0 msgr2=0x7f7acc06c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:49.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.342+0000 7f7ad234c700 1 --2- 172.21.15.80:0/763247026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc06c2f0 0x7f7acc06c770 secure :-1 s=READY pgs=2716 cs=0 l=1 rx=0x7f7ac400af50 tx=0x7f7ac400b250).stop 2019-11-28T11:57:49.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.343+0000 7f7ad234c700 1 -- 172.21.15.80:0/763247026 shutdown_connections 2019-11-28T11:57:49.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.343+0000 7f7ad234c700 1 --2- 172.21.15.80:0/763247026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc06c2f0 0x7f7acc06c770 unknown :-1 s=CLOSED pgs=2716 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:49.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.343+0000 7f7ad234c700 1 --2- 172.21.15.80:0/763247026 >> v2:172.21.15.174:3300/0 conn(0x7f7acc15f100 0x7f7acc06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:49.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.343+0000 7f7ad234c700 1 -- 172.21.15.80:0/763247026 shutdown_connections 2019-11-28T11:57:49.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.343+0000 7f7ad234c700 1 -- 172.21.15.80:0/763247026 wait complete. 2019-11-28T11:57:49.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.343+0000 7f7ad234c700 1 -- 172.21.15.80:0/763247026 >> 172.21.15.80:0/763247026 conn(0x7f7acc061d20 msgr2=0x7f7acc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:49.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.345+0000 7f7ad234c700 1 Processor -- start 2019-11-28T11:57:49.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.345+0000 7f7ad234c700 1 -- start start 2019-11-28T11:57:49.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.346+0000 7f7ad234c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7acc10e970 0x7f7acc1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:49.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.346+0000 7f7ad234c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7acc108cf0 0x7f7acc107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:49.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.346+0000 7f7ad234c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7acc107b70 0x7f7acc107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.346+0000 7f7ad234c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7acc10da00 con 0x7f7acc108cf0 2019-11-28T11:57:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.346+0000 7f7ad234c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7acc10e430 con 0x7f7acc107b70 2019-11-28T11:57:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.346+0000 7f7ad234c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc105ef0 con 0x7f7acc10e970 2019-11-28T11:57:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.346+0000 7f7acbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7acc108cf0 0x7f7acc107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.346+0000 7f7acbfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7acc108cf0 0x7f7acc107630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46080/0 (socket says 172.21.15.80:46080) 2019-11-28T11:57:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.346+0000 7f7acbfff700 1 -- 172.21.15.80:0/662435727 learned_addr learned my addr 172.21.15.80:0/662435727 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:49.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.346+0000 7f7ad08e9700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7acc10e970 0x7f7acc1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:49.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.346+0000 7f7ad10ea700 1 --2- 172.21.15.80:0/662435727 >> v2:172.21.15.174:3300/0 conn(0x7f7acc107b70 0x7f7acc107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:49.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7acbfff700 1 -- 172.21.15.80:0/662435727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7acc10e970 msgr2=0x7f7acc1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:49.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7acbfff700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7acc10e970 0x7f7acc1087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:49.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7acbfff700 1 -- 172.21.15.80:0/662435727 >> v2:172.21.15.174:3300/0 conn(0x7f7acc107b70 msgr2=0x7f7acc107ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:49.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7acbfff700 1 --2- 172.21.15.80:0/662435727 >> v2:172.21.15.174:3300/0 conn(0x7f7acc107b70 0x7f7acc107ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:49.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7acbfff700 1 -- 172.21.15.80:0/662435727 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc106270 con 0x7f7acc108cf0 2019-11-28T11:57:49.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7acbfff700 1 --2- 172.21.15.80:0/662435727 >> v2:172.21.15.80:3300/0 conn(0x7f7acc108cf0 0x7f7acc107630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7abc0107d0 tx=0x7f7abc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:49.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7acbfff700 1 --2- 172.21.15.80:0/662435727 >> v2:172.21.15.80:3300/0 conn(0x7f7acc108cf0 0x7f7acc107630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7abc0107d0 tx=0x7f7abc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:49.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7acbfff700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc108cf0 0x7f7acc107630 secure :-1 s=READY pgs=2717 cs=0 l=1 rx=0x7f7abc0107d0 tx=0x7f7abc010650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:49.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7acbfff700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc108cf0 0x7f7acc107630 secure :-1 s=THROTTLE_DONE pgs=2717 cs=0 l=1 rx=0x7f7abc0107d0 tx=0x7f7abc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:49.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7acbfff700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc108cf0 0x7f7acc107630 secure :-1 s=THROTTLE_DONE pgs=2717 cs=0 l=1 rx=0x7f7abc0107d0 tx=0x7f7abc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:49.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7acbfff700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc108cf0 0x7f7acc107630 secure :-1 s=THROTTLE_DONE pgs=2717 cs=0 l=1 rx=0x7f7abc0107d0 tx=0x7f7abc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:49.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7ac97fa700 1 -- 172.21.15.80:0/662435727 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7abc005af0 con 0x7f7acc108cf0 2019-11-28T11:57:49.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7ac97fa700 1 -- 172.21.15.80:0/662435727 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc005710 con 0x7f7acc108cf0 2019-11-28T11:57:49.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7ad234c700 1 -- 172.21.15.80:0/662435727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7acc106270 con 0x7f7acc108cf0 2019-11-28T11:57:49.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7ac97fa700 1 -- 172.21.15.80:0/662435727 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7abc0060d0 con 0x7f7acc108cf0 2019-11-28T11:57:49.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7ad234c700 1 -- 172.21.15.80:0/662435727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7acc106270 con 0x7f7acc108cf0 2019-11-28T11:57:49.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.347+0000 7f7acbfff700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc108cf0 0x7f7acc107630 secure :-1 s=THROTTLE_DONE pgs=2717 cs=0 l=1 rx=0x7f7abc0107d0 tx=0x7f7abc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:49.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.348+0000 7f7ac97fa700 1 -- 172.21.15.80:0/662435727 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7abc005900 con 0x7f7acc108cf0 2019-11-28T11:57:49.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.348+0000 7f7acbfff700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc108cf0 0x7f7acc107630 secure :-1 s=THROTTLE_DONE pgs=2717 cs=0 l=1 rx=0x7f7abc0107d0 tx=0x7f7abc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:49.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.348+0000 7f7ac97fa700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ab0018730 0x7f7ab001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:49.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.348+0000 7f7ac97fa700 1 -- 172.21.15.80:0/662435727 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f7abc031ff0 con 0x7f7acc108cf0 2019-11-28T11:57:49.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.348+0000 7f7ad08e9700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ab0018730 0x7f7ab001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:49.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.348+0000 7f7ad08e9700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ab0018730 0x7f7ab001abc0 crc :-1 s=READY pgs=1129 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:49.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.355+0000 7f7ad234c700 1 -- 172.21.15.80:0/662435727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7acc106270 con 0x7f7acc108cf0 2019-11-28T11:57:49.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.359+0000 7f7acbfff700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc108cf0 0x7f7acc107630 secure :-1 s=THROTTLE_DONE pgs=2717 cs=0 l=1 rx=0x7f7abc0107d0 tx=0x7f7abc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:49.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.359+0000 7f7ac97fa700 1 -- 172.21.15.80:0/662435727 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7abc0177c0 con 0x7f7acc108cf0 2019-11-28T11:57:49.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:49.527+0000 7f7ad234c700 1 -- 172.21.15.80:0/662435727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7acc106270 con 0x7f7acc108cf0 2019-11-28T11:57:50.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.185+0000 7f7acbfff700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc108cf0 0x7f7acc107630 secure :-1 s=THROTTLE_DONE pgs=2717 cs=0 l=1 rx=0x7f7abc0107d0 tx=0x7f7abc010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:50.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.185+0000 7f7ac97fa700 1 -- 172.21.15.80:0/662435727 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v207) v1 ==== 185+0+0 (secure 0 0 0) 0x7f7abc017c30 con 0x7f7acc108cf0 2019-11-28T11:57:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:57:50.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.194+0000 7f7ad234c700 1 -- 172.21.15.80:0/662435727 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ab0018730 msgr2=0x7f7ab001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:50.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.194+0000 7f7ad234c700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ab0018730 0x7f7ab001abc0 crc :-1 s=READY pgs=1129 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:50.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.194+0000 7f7ad234c700 1 -- 172.21.15.80:0/662435727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc108cf0 msgr2=0x7f7acc107630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:50.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.194+0000 7f7ad234c700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc108cf0 0x7f7acc107630 secure :-1 s=READY pgs=2717 cs=0 l=1 rx=0x7f7abc0107d0 tx=0x7f7abc010650).stop 2019-11-28T11:57:50.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.194+0000 7f7ad234c700 1 -- 172.21.15.80:0/662435727 shutdown_connections 2019-11-28T11:57:50.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.194+0000 7f7ad234c700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7ab0018730 0x7f7ab001abc0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:50.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.194+0000 7f7ad234c700 1 --2- 172.21.15.80:0/662435727 >> v2:172.21.15.174:3300/0 conn(0x7f7acc107b70 0x7f7acc107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:50.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.194+0000 7f7ad234c700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7acc108cf0 0x7f7acc107630 unknown :-1 s=CLOSED pgs=2717 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:50.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.194+0000 7f7ad234c700 1 --2- 172.21.15.80:0/662435727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7acc10e970 0x7f7acc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:50.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.194+0000 7f7ad234c700 1 -- 172.21.15.80:0/662435727 shutdown_connections 2019-11-28T11:57:50.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.194+0000 7f7ad234c700 1 -- 172.21.15.80:0/662435727 wait complete. 2019-11-28T11:57:50.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.194+0000 7f7ad234c700 1 -- 172.21.15.80:0/662435727 >> 172.21.15.80:0/662435727 conn(0x7f7acc15e2d0 msgr2=0x7f7acc147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:50.202 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:57:50.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.329+0000 7fb5d38d4700 1 Processor -- start 2019-11-28T11:57:50.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.329+0000 7fb5d38d4700 1 -- start start 2019-11-28T11:57:50.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.330+0000 7fb5d38d4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5cc15ed10 0x7fb5cc15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:50.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.330+0000 7fb5d38d4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5cc06db60 con 0x7fb5cc0734b0 2019-11-28T11:57:50.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.330+0000 7fb5d38d4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5cc06e060 con 0x7fb5cc073020 2019-11-28T11:57:50.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.330+0000 7fb5d38d4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc06f3d0 con 0x7fb5cc15ed10 2019-11-28T11:57:50.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.330+0000 7fb5d2672700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb5cc0734b0 0x7fb5cc0726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45404/0 (socket says 172.21.15.80:45404) 2019-11-28T11:57:50.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.330+0000 7fb5d2672700 1 -- 172.21.15.80:0/1716525887 learned_addr learned my addr 172.21.15.80:0/1716525887 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:50.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.330+0000 7fb5d1e71700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5cc15ed10 0x7fb5cc15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:50.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.330+0000 7fb5d0e6f700 1 -- 172.21.15.80:0/1716525887 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258473585 0 0) 0x7fb5c4001150 con 0x7fb5cc0734b0 2019-11-28T11:57:50.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 -- 172.21.15.80:0/1716525887 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5b8002e80 con 0x7fb5cc0734b0 2019-11-28T11:57:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 -- 172.21.15.80:0/1716525887 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3455665538 0 0) 0x7fb5c4001130 con 0x7fb5cc0734b0 2019-11-28T11:57:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 -- 172.21.15.80:0/1716525887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5cc15ed10 msgr2=0x7fb5cc15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5cc15ed10 0x7fb5cc15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 -- 172.21.15.80:0/1716525887 >> v1:172.21.15.174:6789/0 conn(0x7fb5cc073020 legacy=0x7fb5cc071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 -- 172.21.15.80:0/1716525887 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc070760 con 0x7fb5cc0734b0 2019-11-28T11:57:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 -- 172.21.15.80:0/1716525887 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fb5c4001660 con 0x7fb5cc0734b0 2019-11-28T11:57:50.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 -- 172.21.15.80:0/1716525887 >> v1:172.21.15.80:6789/0 conn(0x7fb5cc0734b0 legacy=0x7fb5cc0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:50.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b8003ab0 0x7fb5b8005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:50.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5b8006690 0x7fb5b8008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:50.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5b8009380 0x7fb5b800b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:50.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 -- 172.21.15.80:0/1716525887 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b800bfd0 con 0x7fb5b8003ab0 2019-11-28T11:57:50.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 -- 172.21.15.80:0/1716525887 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b80501d0 con 0x7fb5b8006690 2019-11-28T11:57:50.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 -- 172.21.15.80:0/1716525887 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b8050400 con 0x7fb5b8009380 2019-11-28T11:57:50.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d1e71700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b8003ab0 0x7fb5b8005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:50.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d1670700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5b8006690 0x7fb5b8008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:50.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d2672700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5b8009380 0x7fb5b800b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:50.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d1e71700 1 -- 172.21.15.80:0/1716525887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5b8009380 msgr2=0x7fb5b800b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:50.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d1e71700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5b8009380 0x7fb5b800b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:50.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d1e71700 1 -- 172.21.15.80:0/1716525887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5b8006690 msgr2=0x7fb5b8008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:50.337 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d1e71700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5b8006690 0x7fb5b8008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d1e71700 1 -- 172.21.15.80:0/1716525887 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b80506b0 con 0x7fb5b8003ab0 2019-11-28T11:57:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d1e71700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b8003ab0 0x7fb5b8005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb5b400b3b0 tx=0x7fb5b400b6b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d1e71700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b8003ab0 0x7fb5b8005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb5b400b3b0 tx=0x7fb5b400b6b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d1e71700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b8003ab0 0x7fb5b8005f10 secure :-1 s=READY pgs=2719 cs=0 l=1 rx=0x7fb5b400b3b0 tx=0x7fb5b400b6b0).ready entity=mon.0 client_cookie=818f4b9bc71ebde3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d1e71700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b8003ab0 0x7fb5b8005f10 secure :-1 s=THROTTLE_DONE pgs=2719 cs=0 l=1 rx=0x7fb5b400b3b0 tx=0x7fb5b400b6b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d1e71700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b8003ab0 0x7fb5b8005f10 secure :-1 s=THROTTLE_DONE pgs=2719 cs=0 l=1 rx=0x7fb5b400b3b0 tx=0x7fb5b400b6b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:50.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 -- 172.21.15.80:0/1716525887 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b40058e0 con 0x7fb5b8003ab0 2019-11-28T11:57:50.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d1e71700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b8003ab0 0x7fb5b8005f10 secure :-1 s=THROTTLE_DONE pgs=2719 cs=0 l=1 rx=0x7fb5b400b3b0 tx=0x7fb5b400b6b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:50.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 -- 172.21.15.80:0/1716525887 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b4005500 con 0x7fb5b8003ab0 2019-11-28T11:57:50.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d0e6f700 1 -- 172.21.15.80:0/1716525887 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b4005ec0 con 0x7fb5b8003ab0 2019-11-28T11:57:50.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d38d4700 1 -- 172.21.15.80:0/1716525887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b8003ab0 msgr2=0x7fb5b8005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:50.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.331+0000 7fb5d38d4700 1 --2- 172.21.15.80:0/1716525887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b8003ab0 0x7fb5b8005f10 secure :-1 s=READY pgs=2719 cs=0 l=1 rx=0x7fb5b400b3b0 tx=0x7fb5b400b6b0).stop 2019-11-28T11:57:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.332+0000 7fb5d2672700 1 -- 172.21.15.80:0/1716525887 reap_dead start 2019-11-28T11:57:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.332+0000 7fb5d38d4700 1 -- 172.21.15.80:0/1716525887 shutdown_connections 2019-11-28T11:57:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.332+0000 7fb5d38d4700 1 -- 172.21.15.80:0/1716525887 shutdown_connections 2019-11-28T11:57:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.332+0000 7fb5d38d4700 1 -- 172.21.15.80:0/1716525887 wait complete. 2019-11-28T11:57:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.332+0000 7fb5d38d4700 1 -- 172.21.15.80:0/1716525887 >> 172.21.15.80:0/1716525887 conn(0x7fb5cc061d20 msgr2=0x7fb5cc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:50.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.335+0000 7fb5d38d4700 1 Processor -- start 2019-11-28T11:57:50.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.335+0000 7fb5d38d4700 1 -- start start 2019-11-28T11:57:50.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.335+0000 7fb5d38d4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5cc108630 0x7fb5cc151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:50.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.335+0000 7fb5d38d4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5cc151740 0x7fb5cc1502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:50.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d38d4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5cc133a20 con 0x7fb5cc150820 2019-11-28T11:57:50.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d38d4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5cc130f50 con 0x7fb5cc151740 2019-11-28T11:57:50.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d38d4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc131980 con 0x7fb5cc108630 2019-11-28T11:57:50.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d1670700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5cc151740 0x7fb5cc1502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:50.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d2672700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb5cc150820 0x7fb5cc12fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45418/0 (socket says 172.21.15.80:45418) 2019-11-28T11:57:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d1670700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5cc151740 0x7fb5cc1502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46100/0 (socket says 172.21.15.80:46100) 2019-11-28T11:57:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d2672700 1 -- 172.21.15.80:0/1217322436 learned_addr learned my addr 172.21.15.80:0/1217322436 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d1e71700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5cc108630 0x7fb5cc151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d1670700 1 -- 172.21.15.80:0/1217322436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5cc108630 msgr2=0x7fb5cc151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d1670700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5cc108630 0x7fb5cc151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d1670700 1 -- 172.21.15.80:0/1217322436 >> v1:172.21.15.80:6789/0 conn(0x7fb5cc150820 legacy=0x7fb5cc12fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5ca7fc700 1 -- 172.21.15.80:0/1217322436 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1087388839 0 0) 0x7fb5c4000a50 con 0x7fb5cc150820 2019-11-28T11:57:50.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d1670700 1 -- 172.21.15.80:0/1217322436 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc1322e0 con 0x7fb5cc151740 2019-11-28T11:57:50.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d1e71700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5cc108630 0x7fb5cc151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:57:50.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d1670700 1 --2- 172.21.15.80:0/1217322436 >> v2:172.21.15.80:3300/0 conn(0x7fb5cc151740 0x7fb5cc1502e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb5bc0103d0 tx=0x7fb5bc010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:50.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d1670700 1 --2- 172.21.15.80:0/1217322436 >> v2:172.21.15.80:3300/0 conn(0x7fb5cc151740 0x7fb5cc1502e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb5bc0103d0 tx=0x7fb5bc010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:50.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d1670700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5cc151740 0x7fb5cc1502e0 secure :-1 s=READY pgs=2721 cs=0 l=1 rx=0x7fb5bc0103d0 tx=0x7fb5bc010770).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:50.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d1670700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5cc151740 0x7fb5cc1502e0 secure :-1 s=THROTTLE_DONE pgs=2721 cs=0 l=1 rx=0x7fb5bc0103d0 tx=0x7fb5bc010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:50.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5ca7fc700 1 -- 172.21.15.80:0/1217322436 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5bc008690 con 0x7fb5cc151740 2019-11-28T11:57:50.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d1670700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5cc151740 0x7fb5cc1502e0 secure :-1 s=THROTTLE_DONE pgs=2721 cs=0 l=1 rx=0x7fb5bc0103d0 tx=0x7fb5bc010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:50.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d1670700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5cc151740 0x7fb5cc1502e0 secure :-1 s=THROTTLE_DONE pgs=2721 cs=0 l=1 rx=0x7fb5bc0103d0 tx=0x7fb5bc010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5ca7fc700 1 -- 172.21.15.80:0/1217322436 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc0089f0 con 0x7fb5cc151740 2019-11-28T11:57:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d38d4700 1 -- 172.21.15.80:0/1217322436 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5cc132660 con 0x7fb5cc151740 2019-11-28T11:57:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5ca7fc700 1 -- 172.21.15.80:0/1217322436 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5bc009080 con 0x7fb5cc151740 2019-11-28T11:57:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.336+0000 7fb5d38d4700 1 -- 172.21.15.80:0/1217322436 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5cc1322e0 con 0x7fb5cc151740 2019-11-28T11:57:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.337+0000 7fb5d1670700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5cc151740 0x7fb5cc1502e0 secure :-1 s=THROTTLE_DONE pgs=2721 cs=0 l=1 rx=0x7fb5bc0103d0 tx=0x7fb5bc010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.337+0000 7fb5ca7fc700 1 -- 172.21.15.80:0/1217322436 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb5bc0085e0 con 0x7fb5cc151740 2019-11-28T11:57:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.337+0000 7fb5d1670700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5cc151740 0x7fb5cc1502e0 secure :-1 s=THROTTLE_DONE pgs=2721 cs=0 l=1 rx=0x7fb5bc0103d0 tx=0x7fb5bc010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.337+0000 7fb5ca7fc700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5b0018730 0x7fb5b001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.337+0000 7fb5ca7fc700 1 -- 172.21.15.80:0/1217322436 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5668+0+0 (secure 0 0 0) 0x7fb5bc031c40 con 0x7fb5cc151740 2019-11-28T11:57:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.337+0000 7fb5d1e71700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5b0018730 0x7fb5b001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.338+0000 7fb5d1e71700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5b0018730 0x7fb5b001abe0 crc :-1 s=READY pgs=1130 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.344+0000 7fb5d38d4700 1 -- 172.21.15.80:0/1217322436 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5cc132660 con 0x7fb5cc151740 2019-11-28T11:57:50.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.348+0000 7fb5d1670700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5cc151740 0x7fb5cc1502e0 secure :-1 s=THROTTLE_DONE pgs=2721 cs=0 l=1 rx=0x7fb5bc0103d0 tx=0x7fb5bc010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:50.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.348+0000 7fb5ca7fc700 1 -- 172.21.15.80:0/1217322436 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb5bc0051c0 con 0x7fb5cc151740 2019-11-28T11:57:50.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:50.516+0000 7fb5d38d4700 1 -- 172.21.15.80:0/1217322436 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb5cc1322e0 con 0x7fb5cc151740 2019-11-28T11:57:51.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.195+0000 7fb5d1670700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5cc151740 0x7fb5cc1502e0 secure :-1 s=THROTTLE_DONE pgs=2721 cs=0 l=1 rx=0x7fb5bc0103d0 tx=0x7fb5bc010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:51.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.195+0000 7fb5ca7fc700 1 -- 172.21.15.80:0/1217322436 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v208) v1 ==== 173+0+0 (secure 0 0 0) 0x7fb5bc008660 con 0x7fb5cc151740 2019-11-28T11:57:51.232 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:57:51.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.233+0000 7fb5d38d4700 1 -- 172.21.15.80:0/1217322436 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5b0018730 msgr2=0x7fb5b001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:51.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.233+0000 7fb5d38d4700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5b0018730 0x7fb5b001abe0 crc :-1 s=READY pgs=1130 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:51.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.233+0000 7fb5d38d4700 1 -- 172.21.15.80:0/1217322436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5cc151740 msgr2=0x7fb5cc1502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:51.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.233+0000 7fb5d38d4700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5cc151740 0x7fb5cc1502e0 secure :-1 s=READY pgs=2721 cs=0 l=1 rx=0x7fb5bc0103d0 tx=0x7fb5bc010770).stop 2019-11-28T11:57:51.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.233+0000 7fb5d38d4700 1 -- 172.21.15.80:0/1217322436 shutdown_connections 2019-11-28T11:57:51.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.233+0000 7fb5d38d4700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb5b0018730 0x7fb5b001abe0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:51.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.233+0000 7fb5d38d4700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5cc151740 0x7fb5cc1502e0 unknown :-1 s=CLOSED pgs=2721 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:51.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.233+0000 7fb5d38d4700 1 --2- 172.21.15.80:0/1217322436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5cc108630 0x7fb5cc151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:51.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.233+0000 7fb5d38d4700 1 -- 172.21.15.80:0/1217322436 shutdown_connections 2019-11-28T11:57:51.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.233+0000 7fb5d38d4700 1 -- 172.21.15.80:0/1217322436 wait complete. 2019-11-28T11:57:51.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.233+0000 7fb5d38d4700 1 -- 172.21.15.80:0/1217322436 >> 172.21.15.80:0/1217322436 conn(0x7fb5cc14dbb0 msgr2=0x7fb5cc142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:51.240 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:57:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.367+0000 7f20496dd700 1 Processor -- start 2019-11-28T11:57:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.367+0000 7f20496dd700 1 -- start start 2019-11-28T11:57:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.368+0000 7f20496dd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f204406c490 0x7f204406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:51.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.368+0000 7f20496dd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f204406ce60 0x7f2044164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:51.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.368+0000 7f20496dd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204406db00 con 0x7f204406c0a0 2019-11-28T11:57:51.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.368+0000 7f20496dd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204406fd60 con 0x7f204406ce60 2019-11-28T11:57:51.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.368+0000 7f20496dd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2044070030 con 0x7f204406c490 2019-11-28T11:57:51.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.368+0000 7f2043fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f204406ce60 0x7f2044164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:51.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.368+0000 7f2043fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f204406ce60 0x7f2044164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46108/0 (socket says 172.21.15.80:46108) 2019-11-28T11:57:51.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.368+0000 7f2043fff700 1 -- 172.21.15.80:0/1654368305 learned_addr learned my addr 172.21.15.80:0/1654368305 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:51.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.368+0000 7f2042ffd700 1 --2- 172.21.15.80:0/1654368305 >> v2:172.21.15.174:3300/0 conn(0x7f204406c490 0x7f204406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:51.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.368+0000 7f2043fff700 1 -- 172.21.15.80:0/1654368305 >> v2:172.21.15.174:3300/0 conn(0x7f204406c490 msgr2=0x7f204406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:51.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.368+0000 7f2043fff700 1 --2- 172.21.15.80:0/1654368305 >> v2:172.21.15.174:3300/0 conn(0x7f204406c490 0x7f204406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:51.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.368+0000 7f2043fff700 1 -- 172.21.15.80:0/1654368305 >> v1:172.21.15.174:6789/0 conn(0x7f204406c0a0 legacy=0x7f2044072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:51.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.368+0000 7f2043fff700 1 -- 172.21.15.80:0/1654368305 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20440706c0 con 0x7f204406ce60 2019-11-28T11:57:51.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.368+0000 7f2043fff700 1 --2- 172.21.15.80:0/1654368305 >> v2:172.21.15.80:3300/0 conn(0x7f204406ce60 0x7f2044164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f203c00f6b0 tx=0x7f203c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:51.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.369+0000 7f2043fff700 1 --2- 172.21.15.80:0/1654368305 >> v2:172.21.15.80:3300/0 conn(0x7f204406ce60 0x7f2044164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f203c00f6b0 tx=0x7f203c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:51.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.369+0000 7f2043fff700 1 --2- 172.21.15.80:0/1654368305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f204406ce60 0x7f2044164d70 secure :-1 s=READY pgs=2722 cs=0 l=1 rx=0x7f203c00f6b0 tx=0x7f203c00fa50).ready entity=mon.0 client_cookie=22e36739f38eea34 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:51.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.369+0000 7f2043fff700 1 --2- 172.21.15.80:0/1654368305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f204406ce60 0x7f2044164d70 secure :-1 s=THROTTLE_DONE pgs=2722 cs=0 l=1 rx=0x7f203c00f6b0 tx=0x7f203c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:51.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.369+0000 7f2043fff700 1 --2- 172.21.15.80:0/1654368305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f204406ce60 0x7f2044164d70 secure :-1 s=THROTTLE_DONE pgs=2722 cs=0 l=1 rx=0x7f203c00f6b0 tx=0x7f203c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:51.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.369+0000 7f2043fff700 1 --2- 172.21.15.80:0/1654368305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f204406ce60 0x7f2044164d70 secure :-1 s=THROTTLE_DONE pgs=2722 cs=0 l=1 rx=0x7f203c00f6b0 tx=0x7f203c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:51.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.369+0000 7f20427fc700 1 -- 172.21.15.80:0/1654368305 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f203c000a70 con 0x7f204406ce60 2019-11-28T11:57:51.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.369+0000 7f20427fc700 1 -- 172.21.15.80:0/1654368305 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c0010e0 con 0x7f204406ce60 2019-11-28T11:57:51.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.369+0000 7f20427fc700 1 -- 172.21.15.80:0/1654368305 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f203c0017d0 con 0x7f204406ce60 2019-11-28T11:57:51.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.369+0000 7f20496dd700 1 -- 172.21.15.80:0/1654368305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f204406ce60 msgr2=0x7f2044164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:51.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.369+0000 7f20496dd700 1 --2- 172.21.15.80:0/1654368305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f204406ce60 0x7f2044164d70 secure :-1 s=READY pgs=2722 cs=0 l=1 rx=0x7f203c00f6b0 tx=0x7f203c00fa50).stop 2019-11-28T11:57:51.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.369+0000 7f20496dd700 1 -- 172.21.15.80:0/1654368305 shutdown_connections 2019-11-28T11:57:51.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.369+0000 7f20496dd700 1 --2- 172.21.15.80:0/1654368305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f204406ce60 0x7f2044164d70 unknown :-1 s=CLOSED pgs=2722 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:51.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.369+0000 7f20496dd700 1 --2- 172.21.15.80:0/1654368305 >> v2:172.21.15.174:3300/0 conn(0x7f204406c490 0x7f204406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:51.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.369+0000 7f20496dd700 1 -- 172.21.15.80:0/1654368305 shutdown_connections 2019-11-28T11:57:51.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.369+0000 7f20496dd700 1 -- 172.21.15.80:0/1654368305 wait complete. 2019-11-28T11:57:51.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.369+0000 7f20496dd700 1 -- 172.21.15.80:0/1654368305 >> 172.21.15.80:0/1654368305 conn(0x7f2044061cf0 msgr2=0x7f2044064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:51.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.372+0000 7f20496dd700 1 Processor -- start 2019-11-28T11:57:51.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.372+0000 7f20496dd700 1 -- start start 2019-11-28T11:57:51.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.373+0000 7f20496dd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204410e570 0x7f204410e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:51.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.373+0000 7f20496dd700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204412ece0 con 0x7f204412e050 2019-11-28T11:57:51.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.373+0000 7f20496dd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204412ff40 con 0x7f2044128990 2019-11-28T11:57:51.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.373+0000 7f20496dd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2044131c70 con 0x7f204410e570 2019-11-28T11:57:51.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.373+0000 7f2042ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f204412e050 0x7f204412e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45432/0 (socket says 172.21.15.80:45432) 2019-11-28T11:57:51.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.373+0000 7f2042ffd700 1 -- 172.21.15.80:0/1754746375 learned_addr learned my addr 172.21.15.80:0/1754746375 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:51.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.373+0000 7f2043fff700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204410e570 0x7f204410e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:51.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.373+0000 7f203bfff700 1 -- 172.21.15.80:0/1754746375 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109353705 0 0) 0x7f202c0057b0 con 0x7f204412e050 2019-11-28T11:57:51.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.373+0000 7f203bfff700 1 -- 172.21.15.80:0/1754746375 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f201c002e80 con 0x7f204412e050 2019-11-28T11:57:51.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.373+0000 7f203bfff700 1 -- 172.21.15.80:0/1754746375 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008766226 0 0) 0x7f2034001400 con 0x7f2044128990 2019-11-28T11:57:51.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.373+0000 7f203bfff700 1 -- 172.21.15.80:0/1754746375 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f201c002ec0 con 0x7f2044128990 2019-11-28T11:57:51.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.373+0000 7f2043fff700 1 -- 172.21.15.80:0/1754746375 >> v1:172.21.15.174:6789/0 conn(0x7f2044128990 legacy=0x7f2044117fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:51.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.373+0000 7f2043fff700 1 -- 172.21.15.80:0/1754746375 >> v1:172.21.15.80:6789/0 conn(0x7f204412e050 legacy=0x7f204412e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:51.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.373+0000 7f2043fff700 1 -- 172.21.15.80:0/1754746375 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20441325d0 con 0x7f204410e570 2019-11-28T11:57:51.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.373+0000 7f2043fff700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204410e570 0x7f204410e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f203c010380 tx=0x7f203c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.374+0000 7f2043fff700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204410e570 0x7f204410e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f203c010380 tx=0x7f203c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.374+0000 7f2043fff700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204410e570 0x7f204410e9e0 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7f203c010380 tx=0x7f203c010720).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.374+0000 7f2043fff700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204410e570 0x7f204410e9e0 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f203c010380 tx=0x7f203c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:51.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.374+0000 7f203bfff700 1 -- 172.21.15.80:0/1754746375 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f203c001290 con 0x7f204410e570 2019-11-28T11:57:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.374+0000 7f2043fff700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204410e570 0x7f204410e9e0 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f203c010380 tx=0x7f203c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.374+0000 7f2043fff700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204410e570 0x7f204410e9e0 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f203c010380 tx=0x7f203c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.374+0000 7f203bfff700 1 -- 172.21.15.80:0/1754746375 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c000eb0 con 0x7f204410e570 2019-11-28T11:57:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.374+0000 7f20496dd700 1 -- 172.21.15.80:0/1754746375 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2044132950 con 0x7f204410e570 2019-11-28T11:57:51.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.374+0000 7f203bfff700 1 -- 172.21.15.80:0/1754746375 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f203c001910 con 0x7f204410e570 2019-11-28T11:57:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.374+0000 7f20496dd700 1 -- 172.21.15.80:0/1754746375 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20441325d0 con 0x7f204410e570 2019-11-28T11:57:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.374+0000 7f2043fff700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204410e570 0x7f204410e9e0 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f203c010380 tx=0x7f203c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.374+0000 7f203bfff700 1 -- 172.21.15.80:0/1754746375 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f203c0010a0 con 0x7f204410e570 2019-11-28T11:57:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.374+0000 7f2043fff700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204410e570 0x7f204410e9e0 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f203c010380 tx=0x7f203c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:51.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.375+0000 7f203bfff700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f201c018790 0x7f201c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.375+0000 7f203bfff700 1 -- 172.21.15.80:0/1754746375 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 5286+0+0 (secure 0 0 0) 0x7f203c031a80 con 0x7f204410e570 2019-11-28T11:57:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.375+0000 7f20437fe700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f201c018790 0x7f201c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:51.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.375+0000 7f20437fe700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f201c018790 0x7f201c01abe0 crc :-1 s=READY pgs=1131 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:51.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.382+0000 7f20496dd700 1 -- 172.21.15.80:0/1754746375 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2044132950 con 0x7f204410e570 2019-11-28T11:57:51.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.386+0000 7f2043fff700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204410e570 0x7f204410e9e0 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f203c010380 tx=0x7f203c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:51.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.386+0000 7f203bfff700 1 -- 172.21.15.80:0/1754746375 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f203c007610 con 0x7f204410e570 2019-11-28T11:57:51.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:51.572+0000 7f20496dd700 1 -- 172.21.15.80:0/1754746375 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f20441325d0 con 0x7f204410e570 2019-11-28T11:57:52.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.202+0000 7f2043fff700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204410e570 0x7f204410e9e0 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f203c010380 tx=0x7f203c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.202+0000 7f203bfff700 1 -- 172.21.15.80:0/1754746375 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v209) v1 ==== 97+0+0 (secure 0 0 0) 0x7f203c0173f0 con 0x7f204410e570 2019-11-28T11:57:52.233 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:57:52.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.239+0000 7f20496dd700 1 -- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f201c018790 msgr2=0x7f201c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:52.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.239+0000 7f20496dd700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f201c018790 0x7f201c01abe0 crc :-1 s=READY pgs=1131 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.239+0000 7f20496dd700 1 -- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204410e570 msgr2=0x7f204410e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:52.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.239+0000 7f20496dd700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204410e570 0x7f204410e9e0 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7f203c010380 tx=0x7f203c010720).stop 2019-11-28T11:57:52.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.239+0000 7f20496dd700 1 -- 172.21.15.80:0/1754746375 shutdown_connections 2019-11-28T11:57:52.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.239+0000 7f20496dd700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f204410e570 0x7f204410e9e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.239+0000 7f20496dd700 1 --2- 172.21.15.80:0/1754746375 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f201c018790 0x7f201c01abe0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.239+0000 7f20496dd700 1 -- 172.21.15.80:0/1754746375 shutdown_connections 2019-11-28T11:57:52.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.239+0000 7f20496dd700 1 -- 172.21.15.80:0/1754746375 wait complete. 2019-11-28T11:57:52.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.239+0000 7f20496dd700 1 -- 172.21.15.80:0/1754746375 >> 172.21.15.80:0/1754746375 conn(0x7f204407c6e0 msgr2=0x7f20441050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:52.247 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:57:52.248 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:57:52.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.371+0000 7f9c39772700 1 Processor -- start 2019-11-28T11:57:52.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.371+0000 7f9c39772700 1 -- start start 2019-11-28T11:57:52.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.372+0000 7f9c39772700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9c3406c490 0x7f9c3406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.372+0000 7f9c39772700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3406ce60 0x7f9c34164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.372+0000 7f9c39772700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3406db00 con 0x7f9c3406c0a0 2019-11-28T11:57:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.372+0000 7f9c39772700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3406fd60 con 0x7f9c3406c490 2019-11-28T11:57:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.372+0000 7f9c39772700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c34070030 con 0x7f9c3406ce60 2019-11-28T11:57:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.373+0000 7f9c33fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3406ce60 0x7f9c34164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.373+0000 7f9c32ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9c3406c490 0x7f9c3406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.373+0000 7f9c32ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9c3406c490 0x7f9c3406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:32778/0 (socket says 172.21.15.80:32778) 2019-11-28T11:57:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.373+0000 7f9c33fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3406ce60 0x7f9c34164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:48382/0 (socket says 172.21.15.80:48382) 2019-11-28T11:57:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.373+0000 7f9c32ffd700 1 -- 172.21.15.80:0/2433597337 learned_addr learned my addr 172.21.15.80:0/2433597337 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.373+0000 7f9c33fff700 1 -- 172.21.15.80:0/2433597337 >> v2:172.21.15.174:3300/0 conn(0x7f9c3406c490 msgr2=0x7f9c3406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.373+0000 7f9c33fff700 1 --2- 172.21.15.80:0/2433597337 >> v2:172.21.15.174:3300/0 conn(0x7f9c3406c490 0x7f9c3406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.373+0000 7f9c33fff700 1 -- 172.21.15.80:0/2433597337 >> v1:172.21.15.174:6789/0 conn(0x7f9c3406c0a0 legacy=0x7f9c34072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:52.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.373+0000 7f9c33fff700 1 -- 172.21.15.80:0/2433597337 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c340706c0 con 0x7f9c3406ce60 2019-11-28T11:57:52.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.373+0000 7f9c32ffd700 1 --2- 172.21.15.80:0/2433597337 >> v2:172.21.15.174:3300/0 conn(0x7f9c3406c490 0x7f9c3406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:57:52.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.373+0000 7f9c33fff700 1 --2- 172.21.15.80:0/2433597337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3406ce60 0x7f9c34164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9c1c00b300 tx=0x7f9c1c00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.373+0000 7f9c33fff700 1 --2- 172.21.15.80:0/2433597337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3406ce60 0x7f9c34164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9c1c00b300 tx=0x7f9c1c00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.373+0000 7f9c33fff700 1 --2- 172.21.15.80:0/2433597337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3406ce60 0x7f9c34164d70 secure :-1 s=READY pgs=393 cs=0 l=1 rx=0x7f9c1c00b300 tx=0x7f9c1c00bb10).ready entity=mon.2 client_cookie=ff716991dfd2125c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:52.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.373+0000 7f9c33fff700 1 --2- 172.21.15.80:0/2433597337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3406ce60 0x7f9c34164d70 secure :-1 s=THROTTLE_DONE pgs=393 cs=0 l=1 rx=0x7f9c1c00b300 tx=0x7f9c1c00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.373+0000 7f9c327fc700 1 -- 172.21.15.80:0/2433597337 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c1c000f40 con 0x7f9c3406ce60 2019-11-28T11:57:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.374+0000 7f9c33fff700 1 --2- 172.21.15.80:0/2433597337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3406ce60 0x7f9c34164d70 secure :-1 s=THROTTLE_DONE pgs=393 cs=0 l=1 rx=0x7f9c1c00b300 tx=0x7f9c1c00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.374+0000 7f9c33fff700 1 --2- 172.21.15.80:0/2433597337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3406ce60 0x7f9c34164d70 secure :-1 s=THROTTLE_DONE pgs=393 cs=0 l=1 rx=0x7f9c1c00b300 tx=0x7f9c1c00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.374+0000 7f9c327fc700 1 -- 172.21.15.80:0/2433597337 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c009b70 con 0x7f9c3406ce60 2019-11-28T11:57:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.374+0000 7f9c327fc700 1 -- 172.21.15.80:0/2433597337 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c1c00a240 con 0x7f9c3406ce60 2019-11-28T11:57:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.374+0000 7f9c39772700 1 -- 172.21.15.80:0/2433597337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3406ce60 msgr2=0x7f9c34164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.374+0000 7f9c39772700 1 --2- 172.21.15.80:0/2433597337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3406ce60 0x7f9c34164d70 secure :-1 s=READY pgs=393 cs=0 l=1 rx=0x7f9c1c00b300 tx=0x7f9c1c00bb10).stop 2019-11-28T11:57:52.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.374+0000 7f9c39772700 1 -- 172.21.15.80:0/2433597337 shutdown_connections 2019-11-28T11:57:52.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.374+0000 7f9c39772700 1 --2- 172.21.15.80:0/2433597337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3406ce60 0x7f9c34164d70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.374+0000 7f9c39772700 1 --2- 172.21.15.80:0/2433597337 >> v2:172.21.15.174:3300/0 conn(0x7f9c3406c490 0x7f9c3406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:52.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.374+0000 7f9c39772700 1 -- 172.21.15.80:0/2433597337 shutdown_connections 2019-11-28T11:57:52.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.374+0000 7f9c39772700 1 -- 172.21.15.80:0/2433597337 wait complete. 2019-11-28T11:57:52.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.374+0000 7f9c39772700 1 -- 172.21.15.80:0/2433597337 >> 172.21.15.80:0/2433597337 conn(0x7f9c34061cf0 msgr2=0x7f9c34064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:52.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.377+0000 7f9c39772700 1 Processor -- start 2019-11-28T11:57:52.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.377+0000 7f9c39772700 1 -- start start 2019-11-28T11:57:52.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c39772700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9c3413dc00 0x7f9c34109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:52.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c39772700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3410a3a0 0x7f9c34108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:52.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c39772700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c341312c0 con 0x7f9c34109220 2019-11-28T11:57:52.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c39772700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c34105830 con 0x7f9c3413dc00 2019-11-28T11:57:52.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c39772700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c34105b00 con 0x7f9c3410a3a0 2019-11-28T11:57:52.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c33fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9c34109220 0x7f9c34103000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45444/0 (socket says 172.21.15.80:45444) 2019-11-28T11:57:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c33fff700 1 -- 172.21.15.80:0/774826362 learned_addr learned my addr 172.21.15.80:0/774826362 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c337fe700 1 --2- 172.21.15.80:0/774826362 >> v2:172.21.15.174:3300/0 conn(0x7f9c3413dc00 0x7f9c34109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c32ffd700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3410a3a0 0x7f9c34108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c2bfff700 1 -- 172.21.15.80:0/774826362 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610196848 0 0) 0x7f9c1c00b370 con 0x7f9c34109220 2019-11-28T11:57:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c2bfff700 1 -- 172.21.15.80:0/774826362 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c0c002e80 con 0x7f9c34109220 2019-11-28T11:57:52.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c32ffd700 1 -- 172.21.15.80:0/774826362 >> v2:172.21.15.174:3300/0 conn(0x7f9c3413dc00 msgr2=0x7f9c34109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c32ffd700 1 --2- 172.21.15.80:0/774826362 >> v2:172.21.15.174:3300/0 conn(0x7f9c3413dc00 0x7f9c34109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c32ffd700 1 -- 172.21.15.80:0/774826362 >> v1:172.21.15.80:6789/0 conn(0x7f9c34109220 legacy=0x7f9c34103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c32ffd700 1 -- 172.21.15.80:0/774826362 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c34106190 con 0x7f9c3410a3a0 2019-11-28T11:57:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c337fe700 1 --2- 172.21.15.80:0/774826362 >> v2:172.21.15.174:3300/0 conn(0x7f9c3413dc00 0x7f9c34109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:57:52.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.378+0000 7f9c32ffd700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3410a3a0 0x7f9c34108ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c2c010380 tx=0x7f9c2c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.379+0000 7f9c32ffd700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3410a3a0 0x7f9c34108ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c2c010380 tx=0x7f9c2c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.379+0000 7f9c32ffd700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3410a3a0 0x7f9c34108ce0 secure :-1 s=READY pgs=394 cs=0 l=1 rx=0x7f9c2c010380 tx=0x7f9c2c010720).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:52.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.379+0000 7f9c32ffd700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3410a3a0 0x7f9c34108ce0 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f9c2c010380 tx=0x7f9c2c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.379+0000 7f9c2bfff700 1 -- 172.21.15.80:0/774826362 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c2c001090 con 0x7f9c3410a3a0 2019-11-28T11:57:52.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.379+0000 7f9c32ffd700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3410a3a0 0x7f9c34108ce0 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f9c2c010380 tx=0x7f9c2c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.379+0000 7f9c2bfff700 1 -- 172.21.15.80:0/774826362 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c000940 con 0x7f9c3410a3a0 2019-11-28T11:57:52.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.379+0000 7f9c32ffd700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3410a3a0 0x7f9c34108ce0 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f9c2c010380 tx=0x7f9c2c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.379+0000 7f9c39772700 1 -- 172.21.15.80:0/774826362 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c34106510 con 0x7f9c3410a3a0 2019-11-28T11:57:52.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.379+0000 7f9c2bfff700 1 -- 172.21.15.80:0/774826362 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c2c001670 con 0x7f9c3410a3a0 2019-11-28T11:57:52.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.379+0000 7f9c39772700 1 -- 172.21.15.80:0/774826362 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c34106190 con 0x7f9c3410a3a0 2019-11-28T11:57:52.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.379+0000 7f9c32ffd700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3410a3a0 0x7f9c34108ce0 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f9c2c010380 tx=0x7f9c2c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.380+0000 7f9c2bfff700 1 -- 172.21.15.80:0/774826362 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9c2c000ea0 con 0x7f9c3410a3a0 2019-11-28T11:57:52.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.380+0000 7f9c32ffd700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3410a3a0 0x7f9c34108ce0 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f9c2c010380 tx=0x7f9c2c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.380+0000 7f9c2bfff700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9c0c018770 0x7f9c0c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:52.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.380+0000 7f9c2bfff700 1 -- 172.21.15.80:0/774826362 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f9c2c031a00 con 0x7f9c3410a3a0 2019-11-28T11:57:52.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.380+0000 7f9c337fe700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9c0c018770 0x7f9c0c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:52.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.380+0000 7f9c337fe700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9c0c018770 0x7f9c0c01abe0 crc :-1 s=READY pgs=1132 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:52.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.387+0000 7f9c39772700 1 -- 172.21.15.80:0/774826362 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c34106510 con 0x7f9c3410a3a0 2019-11-28T11:57:52.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.391+0000 7f9c32ffd700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3410a3a0 0x7f9c34108ce0 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f9c2c010380 tx=0x7f9c2c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.391+0000 7f9c2bfff700 1 -- 172.21.15.80:0/774826362 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9c2c000c90 con 0x7f9c3410a3a0 2019-11-28T11:57:52.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.561+0000 7f9c39772700 1 -- 172.21.15.80:0/774826362 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9c34106190 con 0x7f9c3410a3a0 2019-11-28T11:57:52.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.562+0000 7f9c32ffd700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3410a3a0 0x7f9c34108ce0 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f9c2c010380 tx=0x7f9c2c010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.560 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.562+0000 7f9c2bfff700 1 -- 172.21.15.80:0/774826362 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v71) v1 ==== 80+0+4797 (secure 0 0 0) 0x7f9c2c000ea0 con 0x7f9c3410a3a0 2019-11-28T11:57:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:57:52.560 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:57:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:57:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:57:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:57:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:57:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:57:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:57:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:57:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:57:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:57:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:57:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:57:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:57:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:57:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:57:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:57:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:57:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:57:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:57:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:57:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:57:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:57:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:57:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:57:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:57:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:57:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:57:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:57:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:57:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:57:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:57:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:57:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:57:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:57:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:57:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:57:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:57:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:57:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:57:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:57:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:57:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:57:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:57:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:57:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:57:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:57:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:57:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:57:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:57:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:57:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.584 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:57:52.584 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:57:52.584 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.584 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:57:52.584 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:57:52.585 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:57:52.585 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.585 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:57:52.585 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:57:52.586 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.586 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:57:52.586 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:57:52.586 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:57:52.586 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.587 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:57:52.587 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:57:52.587 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.587 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:57:52.587 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:57:52.587 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:57:52.588 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.588 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:57:52.588 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:57:52.588 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.589 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:57:52.589 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:57:52.589 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:57:52.589 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.589 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:57:52.590 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:57:52.590 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.590 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:57:52.590 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:57:52.590 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:57:52.590 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.591 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:57:52.591 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:57:52.591 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.591 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:57:52.591 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:57:52.592 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:57:52.592 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.592 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:57:52.592 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:57:52.593 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.593 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:57:52.593 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:57:52.593 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:57:52.593 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:57:52.593 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.594 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:57:52.594 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:57:52.594 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.594 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:57:52.595 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:57:52.595 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:57:52.595 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:57:52.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:52.595 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:57:52.595 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:57:52.596 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:57:52.596 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:57:52.596 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:57:52.596 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:57:52.596 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.596 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:52.596 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:57:52.597 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:57:52.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.564+0000 7f9c39772700 1 -- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9c0c018770 msgr2=0x7f9c0c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:52.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.564+0000 7f9c39772700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9c0c018770 0x7f9c0c01abe0 crc :-1 s=READY pgs=1132 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.564+0000 7f9c39772700 1 -- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3410a3a0 msgr2=0x7f9c34108ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:52.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.564+0000 7f9c39772700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3410a3a0 0x7f9c34108ce0 secure :-1 s=READY pgs=394 cs=0 l=1 rx=0x7f9c2c010380 tx=0x7f9c2c010720).stop 2019-11-28T11:57:52.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.564+0000 7f9c39772700 1 -- 172.21.15.80:0/774826362 shutdown_connections 2019-11-28T11:57:52.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.564+0000 7f9c39772700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9c0c018770 0x7f9c0c01abe0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.564+0000 7f9c39772700 1 --2- 172.21.15.80:0/774826362 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c3410a3a0 0x7f9c34108ce0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.564+0000 7f9c39772700 1 --2- 172.21.15.80:0/774826362 >> v2:172.21.15.174:3300/0 conn(0x7f9c3413dc00 0x7f9c34109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.565+0000 7f9c39772700 1 -- 172.21.15.80:0/774826362 shutdown_connections 2019-11-28T11:57:52.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.565+0000 7f9c39772700 1 -- 172.21.15.80:0/774826362 wait complete. 2019-11-28T11:57:52.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.565+0000 7f9c39772700 1 -- 172.21.15.80:0/774826362 >> 172.21.15.80:0/774826362 conn(0x7f9c3411bfc0 msgr2=0x7f9c34141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:52.601 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:57:52.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.723+0000 7f866c3cc700 1 Processor -- start 2019-11-28T11:57:52.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.723+0000 7f866c3cc700 1 -- start start 2019-11-28T11:57:52.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f866c3cc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f866406c0a0 0x7f8664072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:52.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f866c3cc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866406db00 con 0x7f8664072620 2019-11-28T11:57:52.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f866c3cc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866406e000 con 0x7f86640734e0 2019-11-28T11:57:52.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f866c3cc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866406fd60 con 0x7f866406c0a0 2019-11-28T11:57:52.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f866b16a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8664072620 0x7f8664164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45452/0 (socket says 172.21.15.80:45452) 2019-11-28T11:57:52.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f866b16a700 1 -- 172.21.15.80:0/2631112301 learned_addr learned my addr 172.21.15.80:0/2631112301 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:52.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f8669967700 1 -- 172.21.15.80:0/2631112301 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522054973 0 0) 0x7f865c001100 con 0x7f8664072620 2019-11-28T11:57:52.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f866a969700 1 --2- 172.21.15.80:0/2631112301 >> v2:172.21.15.174:3300/0 conn(0x7f866406c0a0 0x7f8664072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:52.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f8669967700 1 -- 172.21.15.80:0/2631112301 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f864c002e80 con 0x7f8664072620 2019-11-28T11:57:52.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f8669967700 1 -- 172.21.15.80:0/2631112301 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3400981726 0 0) 0x7f865c0010e0 con 0x7f8664072620 2019-11-28T11:57:52.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f8669967700 1 -- 172.21.15.80:0/2631112301 >> v2:172.21.15.174:3300/0 conn(0x7f866406c0a0 msgr2=0x7f8664072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:52.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f8669967700 1 --2- 172.21.15.80:0/2631112301 >> v2:172.21.15.174:3300/0 conn(0x7f866406c0a0 0x7f8664072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:52.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f8669967700 1 -- 172.21.15.80:0/2631112301 >> v1:172.21.15.174:6789/0 conn(0x7f86640734e0 legacy=0x7f8664071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:52.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f8669967700 1 -- 172.21.15.80:0/2631112301 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86640706c0 con 0x7f8664072620 2019-11-28T11:57:52.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f8669967700 1 -- 172.21.15.80:0/2631112301 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f865c001610 con 0x7f8664072620 2019-11-28T11:57:52.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f8669967700 1 -- 172.21.15.80:0/2631112301 >> v1:172.21.15.80:6789/0 conn(0x7f8664072620 legacy=0x7f8664164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:52.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f8669967700 1 --2- 172.21.15.80:0/2631112301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f864c003ab0 0x7f864c005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:52.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.724+0000 7f8669967700 1 --2- 172.21.15.80:0/2631112301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f864c006690 0x7f864c008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:52.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f8669967700 1 --2- 172.21.15.80:0/2631112301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f864c009380 0x7f864c00b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:52.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f8669967700 1 -- 172.21.15.80:0/2631112301 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c00c000 con 0x7f864c009380 2019-11-28T11:57:52.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f8669967700 1 -- 172.21.15.80:0/2631112301 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c050200 con 0x7f864c006690 2019-11-28T11:57:52.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f8669967700 1 -- 172.21.15.80:0/2631112301 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c050430 con 0x7f864c003ab0 2019-11-28T11:57:52.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866b16a700 1 --2- 172.21.15.80:0/2631112301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f864c009380 0x7f864c00b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:52.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866a969700 1 --2- 172.21.15.80:0/2631112301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f864c003ab0 0x7f864c005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:52.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866a168700 1 --2- 172.21.15.80:0/2631112301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f864c006690 0x7f864c008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:52.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866b16a700 1 -- 172.21.15.80:0/2631112301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f864c003ab0 msgr2=0x7f864c005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:52.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866b16a700 1 --2- 172.21.15.80:0/2631112301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f864c003ab0 0x7f864c005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:52.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866b16a700 1 -- 172.21.15.80:0/2631112301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f864c006690 msgr2=0x7f864c008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:52.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866b16a700 1 --2- 172.21.15.80:0/2631112301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f864c006690 0x7f864c008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:52.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866b16a700 1 -- 172.21.15.80:0/2631112301 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c0506e0 con 0x7f864c009380 2019-11-28T11:57:52.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866b16a700 1 --2- 172.21.15.80:0/2631112301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f864c009380 0x7f864c00b850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f865c00f860 tx=0x7f865c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866b16a700 1 -- 172.21.15.80:0/2631112301 reap_dead start 2019-11-28T11:57:52.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866b16a700 1 --2- 172.21.15.80:0/2631112301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f864c009380 0x7f864c00b850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f865c00f860 tx=0x7f865c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866b16a700 1 --2- 172.21.15.80:0/2631112301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f864c009380 0x7f864c00b850 secure :-1 s=READY pgs=2726 cs=0 l=1 rx=0x7f865c00f860 tx=0x7f865c00f790).ready entity=mon.0 client_cookie=34549b1f6bd6ae95 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866b16a700 1 --2- 172.21.15.80:0/2631112301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f864c009380 0x7f864c00b850 secure :-1 s=THROTTLE_DONE pgs=2726 cs=0 l=1 rx=0x7f865c00f860 tx=0x7f865c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866b16a700 1 --2- 172.21.15.80:0/2631112301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f864c009380 0x7f864c00b850 secure :-1 s=THROTTLE_DONE pgs=2726 cs=0 l=1 rx=0x7f865c00f860 tx=0x7f865c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f8669967700 1 -- 172.21.15.80:0/2631112301 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f865c0015d0 con 0x7f864c009380 2019-11-28T11:57:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866b16a700 1 --2- 172.21.15.80:0/2631112301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f864c009380 0x7f864c00b850 secure :-1 s=THROTTLE_DONE pgs=2726 cs=0 l=1 rx=0x7f865c00f860 tx=0x7f865c00f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f8669967700 1 -- 172.21.15.80:0/2631112301 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c004240 con 0x7f864c009380 2019-11-28T11:57:52.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f8669967700 1 -- 172.21.15.80:0/2631112301 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f865c004990 con 0x7f864c009380 2019-11-28T11:57:52.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866c3cc700 1 -- 172.21.15.80:0/2631112301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f864c009380 msgr2=0x7f864c00b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:52.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.725+0000 7f866c3cc700 1 --2- 172.21.15.80:0/2631112301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f864c009380 0x7f864c00b850 secure :-1 s=READY pgs=2726 cs=0 l=1 rx=0x7f865c00f860 tx=0x7f865c00f790).stop 2019-11-28T11:57:52.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.726+0000 7f866c3cc700 1 -- 172.21.15.80:0/2631112301 shutdown_connections 2019-11-28T11:57:52.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.726+0000 7f866c3cc700 1 --2- 172.21.15.80:0/2631112301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f864c009380 0x7f864c00b850 unknown :-1 s=CLOSED pgs=2726 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.726+0000 7f866c3cc700 1 -- 172.21.15.80:0/2631112301 shutdown_connections 2019-11-28T11:57:52.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.726+0000 7f866c3cc700 1 -- 172.21.15.80:0/2631112301 wait complete. 2019-11-28T11:57:52.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.726+0000 7f866c3cc700 1 -- 172.21.15.80:0/2631112301 >> 172.21.15.80:0/2631112301 conn(0x7f8664061cf0 msgr2=0x7f8664064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:52.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.728+0000 7f866c3cc700 1 Processor -- start 2019-11-28T11:57:52.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.728+0000 7f866c3cc700 1 -- start start 2019-11-28T11:57:52.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.729+0000 7f866c3cc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8664074d00 0x7f86640750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:52.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.729+0000 7f866c3cc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8664152bd0 0x7f8664140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:52.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.729+0000 7f866c3cc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8664153040 0x7f8664140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:52.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.729+0000 7f866c3cc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866407ab30 con 0x7f8664074d00 2019-11-28T11:57:52.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.729+0000 7f866c3cc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866407ae00 con 0x7f8664153040 2019-11-28T11:57:52.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.729+0000 7f866c3cc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8664079e30 con 0x7f8664152bd0 2019-11-28T11:57:52.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.729+0000 7f866a969700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8664074d00 0x7f86640750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:52.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.729+0000 7f866a969700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8664074d00 0x7f86640750f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46146/0 (socket says 172.21.15.80:46146) 2019-11-28T11:57:52.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.729+0000 7f866a969700 1 -- 172.21.15.80:0/2995285105 learned_addr learned my addr 172.21.15.80:0/2995285105 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.729+0000 7f866b16a700 1 --2- 172.21.15.80:0/2995285105 >> v2:172.21.15.174:3300/0 conn(0x7f8664153040 0x7f8664140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f866a168700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8664152bd0 0x7f8664140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f866a969700 1 -- 172.21.15.80:0/2995285105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8664152bd0 msgr2=0x7f8664140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f866a969700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8664152bd0 0x7f8664140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f866a969700 1 -- 172.21.15.80:0/2995285105 >> v2:172.21.15.174:3300/0 conn(0x7f8664153040 msgr2=0x7f8664140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:52.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f866a969700 1 --2- 172.21.15.80:0/2995285105 >> v2:172.21.15.174:3300/0 conn(0x7f8664153040 0x7f8664140980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f866a969700 1 -- 172.21.15.80:0/2995285105 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866407b490 con 0x7f8664074d00 2019-11-28T11:57:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f866b16a700 1 --2- 172.21.15.80:0/2995285105 >> v2:172.21.15.174:3300/0 conn(0x7f8664153040 0x7f8664140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:57:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f866a969700 1 --2- 172.21.15.80:0/2995285105 >> v2:172.21.15.80:3300/0 conn(0x7f8664074d00 0x7f86640750f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f86540107d0 tx=0x7f8654010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f866a969700 1 --2- 172.21.15.80:0/2995285105 >> v2:172.21.15.80:3300/0 conn(0x7f8664074d00 0x7f86640750f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f86540107d0 tx=0x7f8654010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f866a969700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8664074d00 0x7f86640750f0 secure :-1 s=READY pgs=2727 cs=0 l=1 rx=0x7f86540107d0 tx=0x7f8654010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:52.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f866a969700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8664074d00 0x7f86640750f0 secure :-1 s=THROTTLE_DONE pgs=2727 cs=0 l=1 rx=0x7f86540107d0 tx=0x7f8654010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f866a969700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8664074d00 0x7f86640750f0 secure :-1 s=THROTTLE_DONE pgs=2727 cs=0 l=1 rx=0x7f86540107d0 tx=0x7f8654010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f866a969700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8664074d00 0x7f86640750f0 secure :-1 s=THROTTLE_DONE pgs=2727 cs=0 l=1 rx=0x7f86540107d0 tx=0x7f8654010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f86637fe700 1 -- 172.21.15.80:0/2995285105 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8654000ce0 con 0x7f8664074d00 2019-11-28T11:57:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f86637fe700 1 -- 172.21.15.80:0/2995285105 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8654005900 con 0x7f8664074d00 2019-11-28T11:57:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f86637fe700 1 -- 172.21.15.80:0/2995285105 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8654005f90 con 0x7f8664074d00 2019-11-28T11:57:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f866c3cc700 1 -- 172.21.15.80:0/2995285105 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866407b810 con 0x7f8664074d00 2019-11-28T11:57:52.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f866c3cc700 1 -- 172.21.15.80:0/2995285105 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866407b490 con 0x7f8664074d00 2019-11-28T11:57:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.730+0000 7f866a969700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8664074d00 0x7f86640750f0 secure :-1 s=THROTTLE_DONE pgs=2727 cs=0 l=1 rx=0x7f86540107d0 tx=0x7f8654010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.731+0000 7f86637fe700 1 -- 172.21.15.80:0/2995285105 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8654005af0 con 0x7f8664074d00 2019-11-28T11:57:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.731+0000 7f866a969700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8664074d00 0x7f86640750f0 secure :-1 s=THROTTLE_DONE pgs=2727 cs=0 l=1 rx=0x7f86540107d0 tx=0x7f8654010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.731+0000 7f86637fe700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8644018730 0x7f864401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.731+0000 7f86637fe700 1 -- 172.21.15.80:0/2995285105 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f8654031db0 con 0x7f8664074d00 2019-11-28T11:57:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.731+0000 7f866a168700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8644018730 0x7f864401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:52.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.731+0000 7f866a168700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8644018730 0x7f864401abc0 crc :-1 s=READY pgs=1133 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:52.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.738+0000 7f866c3cc700 1 -- 172.21.15.80:0/2995285105 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866407b810 con 0x7f8664074d00 2019-11-28T11:57:52.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.742+0000 7f866a969700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8664074d00 0x7f86640750f0 secure :-1 s=THROTTLE_DONE pgs=2727 cs=0 l=1 rx=0x7f86540107d0 tx=0x7f8654010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.742+0000 7f86637fe700 1 -- 172.21.15.80:0/2995285105 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8654005500 con 0x7f8664074d00 2019-11-28T11:57:52.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.917+0000 7f866c3cc700 1 -- 172.21.15.80:0/2995285105 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f866407b490 con 0x7f8664074d00 2019-11-28T11:57:52.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.918+0000 7f866a969700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8664074d00 0x7f86640750f0 secure :-1 s=THROTTLE_DONE pgs=2727 cs=0 l=1 rx=0x7f86540107d0 tx=0x7f8654010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:52.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.918+0000 7f86637fe700 1 -- 172.21.15.80:0/2995285105 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v209) v1 ==== 74+0+12010 (secure 0 0 0) 0x7f86540177c0 con 0x7f8664074d00 2019-11-28T11:57:52.916 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:57:52.916 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":209,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:57:52.195095+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:57:52.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.920+0000 7f866c3cc700 1 -- 172.21.15.80:0/2995285105 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8644018730 msgr2=0x7f864401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:52.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.920+0000 7f866c3cc700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8644018730 0x7f864401abc0 crc :-1 s=READY pgs=1133 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.920+0000 7f866c3cc700 1 -- 172.21.15.80:0/2995285105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8664074d00 msgr2=0x7f86640750f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:52.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.920+0000 7f866c3cc700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8664074d00 0x7f86640750f0 secure :-1 s=READY pgs=2727 cs=0 l=1 rx=0x7f86540107d0 tx=0x7f8654010600).stop 2019-11-28T11:57:52.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.920+0000 7f866c3cc700 1 -- 172.21.15.80:0/2995285105 shutdown_connections 2019-11-28T11:57:52.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.920+0000 7f866c3cc700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8644018730 0x7f864401abc0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.920+0000 7f866c3cc700 1 --2- 172.21.15.80:0/2995285105 >> v2:172.21.15.174:3300/0 conn(0x7f8664153040 0x7f8664140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.920+0000 7f866c3cc700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8664152bd0 0x7f8664140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.920+0000 7f866c3cc700 1 --2- 172.21.15.80:0/2995285105 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8664074d00 0x7f86640750f0 unknown :-1 s=CLOSED pgs=2727 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:52.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.920+0000 7f866c3cc700 1 -- 172.21.15.80:0/2995285105 shutdown_connections 2019-11-28T11:57:52.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.920+0000 7f866c3cc700 1 -- 172.21.15.80:0/2995285105 wait complete. 2019-11-28T11:57:52.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:52.920+0000 7f866c3cc700 1 -- 172.21.15.80:0/2995285105 >> 172.21.15.80:0/2995285105 conn(0x7f866413fa50 msgr2=0x7f866407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:52.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:57:52.928 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:57:53.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.054+0000 7f93fbf9f700 1 Processor -- start 2019-11-28T11:57:53.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.054+0000 7f93fbf9f700 1 -- start start 2019-11-28T11:57:53.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93fbf9f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93f415f100 0x7f93f406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:53.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93fbf9f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f93f406c2f0 0x7f93f406c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:53.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93fbf9f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f406db60 con 0x7f93f415ed10 2019-11-28T11:57:53.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93fbf9f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f406fe00 con 0x7f93f415f100 2019-11-28T11:57:53.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93fbf9f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f40700d0 con 0x7f93f406c2f0 2019-11-28T11:57:53.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93f9d3b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93f415f100 0x7f93f406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:53.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93f9d3b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93f415f100 0x7f93f406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46158/0 (socket says 172.21.15.80:46158) 2019-11-28T11:57:53.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93f9d3b700 1 -- 172.21.15.80:0/1736532832 learned_addr learned my addr 172.21.15.80:0/1736532832 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:53.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93fad3d700 1 --2- 172.21.15.80:0/1736532832 >> v2:172.21.15.174:3300/0 conn(0x7f93f406c2f0 0x7f93f406c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:53.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93f9d3b700 1 -- 172.21.15.80:0/1736532832 >> v2:172.21.15.174:3300/0 conn(0x7f93f406c2f0 msgr2=0x7f93f406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:53.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1736532832 >> v2:172.21.15.174:3300/0 conn(0x7f93f406c2f0 0x7f93f406c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:53.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93f9d3b700 1 -- 172.21.15.80:0/1736532832 >> v1:172.21.15.174:6789/0 conn(0x7f93f415ed10 legacy=0x7f93f4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:53.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93f9d3b700 1 -- 172.21.15.80:0/1736532832 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f4070760 con 0x7f93f415f100 2019-11-28T11:57:53.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93fad3d700 1 --2- 172.21.15.80:0/1736532832 >> v2:172.21.15.174:3300/0 conn(0x7f93f406c2f0 0x7f93f406c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:57:53.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1736532832 >> v2:172.21.15.80:3300/0 conn(0x7f93f415f100 0x7f93f406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f93dc00f740 tx=0x7f93dc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1736532832 >> v2:172.21.15.80:3300/0 conn(0x7f93f415f100 0x7f93f406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f93dc00f740 tx=0x7f93dc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1736532832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f415f100 0x7f93f406bdb0 secure :-1 s=READY pgs=2728 cs=0 l=1 rx=0x7f93dc00f740 tx=0x7f93dc00fae0).ready entity=mon.0 client_cookie=db319a523e5244ad server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:53.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1736532832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f415f100 0x7f93f406bdb0 secure :-1 s=THROTTLE_DONE pgs=2728 cs=0 l=1 rx=0x7f93dc00f740 tx=0x7f93dc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1736532832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f415f100 0x7f93f406bdb0 secure :-1 s=THROTTLE_DONE pgs=2728 cs=0 l=1 rx=0x7f93dc00f740 tx=0x7f93dc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93f953a700 1 -- 172.21.15.80:0/1736532832 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93dc000960 con 0x7f93f415f100 2019-11-28T11:57:53.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1736532832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f415f100 0x7f93f406bdb0 secure :-1 s=THROTTLE_DONE pgs=2728 cs=0 l=1 rx=0x7f93dc00f740 tx=0x7f93dc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93f953a700 1 -- 172.21.15.80:0/1736532832 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93dc000c90 con 0x7f93f415f100 2019-11-28T11:57:53.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93f953a700 1 -- 172.21.15.80:0/1736532832 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93dc0013a0 con 0x7f93f415f100 2019-11-28T11:57:53.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93fbf9f700 1 -- 172.21.15.80:0/1736532832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f415f100 msgr2=0x7f93f406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:53.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.056+0000 7f93fbf9f700 1 --2- 172.21.15.80:0/1736532832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f415f100 0x7f93f406bdb0 secure :-1 s=READY pgs=2728 cs=0 l=1 rx=0x7f93dc00f740 tx=0x7f93dc00fae0).stop 2019-11-28T11:57:53.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.057+0000 7f93fbf9f700 1 -- 172.21.15.80:0/1736532832 shutdown_connections 2019-11-28T11:57:53.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.057+0000 7f93fbf9f700 1 --2- 172.21.15.80:0/1736532832 >> v2:172.21.15.174:3300/0 conn(0x7f93f406c2f0 0x7f93f406c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:53.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.057+0000 7f93fbf9f700 1 --2- 172.21.15.80:0/1736532832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f415f100 0x7f93f406bdb0 unknown :-1 s=CLOSED pgs=2728 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:53.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.057+0000 7f93fbf9f700 1 -- 172.21.15.80:0/1736532832 shutdown_connections 2019-11-28T11:57:53.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.057+0000 7f93fbf9f700 1 -- 172.21.15.80:0/1736532832 wait complete. 2019-11-28T11:57:53.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.057+0000 7f93fbf9f700 1 -- 172.21.15.80:0/1736532832 >> 172.21.15.80:0/1736532832 conn(0x7f93f4061d20 msgr2=0x7f93f40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:53.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.060+0000 7f93fbf9f700 1 Processor -- start 2019-11-28T11:57:53.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.060+0000 7f93fbf9f700 1 -- start start 2019-11-28T11:57:53.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.060+0000 7f93fbf9f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93f4148320 0x7f93f410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:53.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.060+0000 7f93fbf9f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93f410f290 0x7f93f410dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:53.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93fbf9f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f4148e00 con 0x7f93f410e110 2019-11-28T11:57:53.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93fbf9f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f4139ff0 con 0x7f93f410f290 2019-11-28T11:57:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93fbf9f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f413aa20 con 0x7f93f4148320 2019-11-28T11:57:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93f9d3b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93f410f290 0x7f93f410dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93f9d3b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93f410f290 0x7f93f410dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46162/0 (socket says 172.21.15.80:46162) 2019-11-28T11:57:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93f9d3b700 1 -- 172.21.15.80:0/1629505323 learned_addr learned my addr 172.21.15.80:0/1629505323 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93f9d3b700 1 -- 172.21.15.80:0/1629505323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93f4148320 msgr2=0x7f93f410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:53.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93fa53c700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93f4148320 0x7f93f410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93f4148320 0x7f93f410ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93f9d3b700 1 -- 172.21.15.80:0/1629505323 >> v1:172.21.15.80:6789/0 conn(0x7f93f410e110 legacy=0x7f93f41079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93f9d3b700 1 -- 172.21.15.80:0/1629505323 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f410c490 con 0x7f93f410f290 2019-11-28T11:57:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1629505323 >> v2:172.21.15.80:3300/0 conn(0x7f93f410f290 0x7f93f410dbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f93dc010460 tx=0x7f93dc010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1629505323 >> v2:172.21.15.80:3300/0 conn(0x7f93f410f290 0x7f93f410dbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f93dc010460 tx=0x7f93dc010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f410f290 0x7f93f410dbd0 secure :-1 s=READY pgs=2730 cs=0 l=1 rx=0x7f93dc010460 tx=0x7f93dc010310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f410f290 0x7f93f410dbd0 secure :-1 s=THROTTLE_DONE pgs=2730 cs=0 l=1 rx=0x7f93dc010460 tx=0x7f93dc010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93f2ffd700 1 -- 172.21.15.80:0/1629505323 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93dc000940 con 0x7f93f410f290 2019-11-28T11:57:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f410f290 0x7f93f410dbd0 secure :-1 s=THROTTLE_DONE pgs=2730 cs=0 l=1 rx=0x7f93dc010460 tx=0x7f93dc010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f410f290 0x7f93f410dbd0 secure :-1 s=THROTTLE_DONE pgs=2730 cs=0 l=1 rx=0x7f93dc010460 tx=0x7f93dc010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93f2ffd700 1 -- 172.21.15.80:0/1629505323 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93dc000f50 con 0x7f93f410f290 2019-11-28T11:57:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93f2ffd700 1 -- 172.21.15.80:0/1629505323 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93dc001620 con 0x7f93f410f290 2019-11-28T11:57:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93fbf9f700 1 -- 172.21.15.80:0/1629505323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f410c810 con 0x7f93f410f290 2019-11-28T11:57:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.061+0000 7f93fbf9f700 1 -- 172.21.15.80:0/1629505323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f410c490 con 0x7f93f410f290 2019-11-28T11:57:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.062+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f410f290 0x7f93f410dbd0 secure :-1 s=THROTTLE_DONE pgs=2730 cs=0 l=1 rx=0x7f93dc010460 tx=0x7f93dc010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.062+0000 7f93f2ffd700 1 -- 172.21.15.80:0/1629505323 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f93dc000d60 con 0x7f93f410f290 2019-11-28T11:57:53.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.062+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f410f290 0x7f93f410dbd0 secure :-1 s=THROTTLE_DONE pgs=2730 cs=0 l=1 rx=0x7f93dc010460 tx=0x7f93dc010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.062+0000 7f93f2ffd700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93d8018730 0x7f93d801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:53.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.062+0000 7f93f2ffd700 1 -- 172.21.15.80:0/1629505323 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f93dc031b40 con 0x7f93f410f290 2019-11-28T11:57:53.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.063+0000 7f93fa53c700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93d8018730 0x7f93d801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:53.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.063+0000 7f93fa53c700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93d8018730 0x7f93d801abc0 crc :-1 s=READY pgs=1134 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:53.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.070+0000 7f93fbf9f700 1 -- 172.21.15.80:0/1629505323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f410c810 con 0x7f93f410f290 2019-11-28T11:57:53.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.073+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f410f290 0x7f93f410dbd0 secure :-1 s=THROTTLE_DONE pgs=2730 cs=0 l=1 rx=0x7f93dc010460 tx=0x7f93dc010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.073+0000 7f93f2ffd700 1 -- 172.21.15.80:0/1629505323 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f93dc000b50 con 0x7f93f410f290 2019-11-28T11:57:53.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.239+0000 7f93fbf9f700 1 -- 172.21.15.80:0/1629505323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f93f410c490 con 0x7f93f410f290 2019-11-28T11:57:53.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.239+0000 7f93f9d3b700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f410f290 0x7f93f410dbd0 secure :-1 s=THROTTLE_DONE pgs=2730 cs=0 l=1 rx=0x7f93dc010460 tx=0x7f93dc010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.239+0000 7f93f2ffd700 1 -- 172.21.15.80:0/1629505323 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v209) v1 ==== 92+0+10 (secure 0 0 0) 0x7f93dc000d60 con 0x7f93f410f290 2019-11-28T11:57:53.237 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:57:53.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.242+0000 7f93fbf9f700 1 -- 172.21.15.80:0/1629505323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93d8018730 msgr2=0x7f93d801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:53.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.242+0000 7f93fbf9f700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93d8018730 0x7f93d801abc0 crc :-1 s=READY pgs=1134 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:53.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.242+0000 7f93fbf9f700 1 -- 172.21.15.80:0/1629505323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f410f290 msgr2=0x7f93f410dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:53.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.242+0000 7f93fbf9f700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f410f290 0x7f93f410dbd0 secure :-1 s=READY pgs=2730 cs=0 l=1 rx=0x7f93dc010460 tx=0x7f93dc010310).stop 2019-11-28T11:57:53.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.242+0000 7f93fbf9f700 1 -- 172.21.15.80:0/1629505323 shutdown_connections 2019-11-28T11:57:53.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.242+0000 7f93fbf9f700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f93d8018730 0x7f93d801abc0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:53.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.242+0000 7f93fbf9f700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93f410f290 0x7f93f410dbd0 unknown :-1 s=CLOSED pgs=2730 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:53.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.242+0000 7f93fbf9f700 1 --2- 172.21.15.80:0/1629505323 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f93f4148320 0x7f93f410ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:53.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.242+0000 7f93fbf9f700 1 -- 172.21.15.80:0/1629505323 shutdown_connections 2019-11-28T11:57:53.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.242+0000 7f93fbf9f700 1 -- 172.21.15.80:0/1629505323 wait complete. 2019-11-28T11:57:53.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.243+0000 7f93fbf9f700 1 -- 172.21.15.80:0/1629505323 >> 172.21.15.80:0/1629505323 conn(0x7f93f415e2d0 msgr2=0x7f93f4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:53.249 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:57:53.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.371+0000 7f48b51e3700 1 Processor -- start 2019-11-28T11:57:53.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.371+0000 7f48b51e3700 1 -- start start 2019-11-28T11:57:53.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.372+0000 7f48b51e3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b006c0a0 0x7f48b0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:53.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.372+0000 7f48b51e3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f48b00734e0 0x7f48b0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:53.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.372+0000 7f48b51e3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b006db00 con 0x7f48b0072360 2019-11-28T11:57:53.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.372+0000 7f48b51e3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b006f330 con 0x7f48b00734e0 2019-11-28T11:57:53.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.372+0000 7f48b51e3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00706c0 con 0x7f48b006c0a0 2019-11-28T11:57:53.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.372+0000 7f48aed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f48b00734e0 0x7f48b0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:53.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.372+0000 7f48b49e2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f48b0072360 0x7f48b006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45486/0 (socket says 172.21.15.80:45486) 2019-11-28T11:57:53.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.372+0000 7f48b49e2700 1 -- 172.21.15.80:0/148181096 learned_addr learned my addr 172.21.15.80:0/148181096 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:53.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.372+0000 7f48af59e700 1 --2- 172.21.15.80:0/148181096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b006c0a0 0x7f48b0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:53.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.372+0000 7f48ae59c700 1 -- 172.21.15.80:0/148181096 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214031561 0 0) 0x7f48a8001150 con 0x7f48b0072360 2019-11-28T11:57:53.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.372+0000 7f48ae59c700 1 -- 172.21.15.80:0/148181096 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4890002e80 con 0x7f48b0072360 2019-11-28T11:57:53.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.372+0000 7f48aed9d700 1 -- 172.21.15.80:0/148181096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b006c0a0 msgr2=0x7f48b0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:53.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.372+0000 7f48aed9d700 1 --2- 172.21.15.80:0/148181096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b006c0a0 0x7f48b0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:53.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.372+0000 7f48aed9d700 1 -- 172.21.15.80:0/148181096 >> v1:172.21.15.80:6789/0 conn(0x7f48b0072360 legacy=0x7f48b006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:53.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.372+0000 7f48aed9d700 1 -- 172.21.15.80:0/148181096 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b0070a40 con 0x7f48b00734e0 2019-11-28T11:57:53.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48aed9d700 1 --2- 172.21.15.80:0/148181096 >> v2:172.21.15.80:3300/0 conn(0x7f48b00734e0 0x7f48b0071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f489800b2d0 tx=0x7f489800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48aed9d700 1 --2- 172.21.15.80:0/148181096 >> v2:172.21.15.80:3300/0 conn(0x7f48b00734e0 0x7f48b0071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f489800b2d0 tx=0x7f489800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48aed9d700 1 --2- 172.21.15.80:0/148181096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48b00734e0 0x7f48b0071e20 secure :-1 s=READY pgs=2732 cs=0 l=1 rx=0x7f489800b2d0 tx=0x7f489800b5d0).ready entity=mon.0 client_cookie=cd4f3ea0e5f7e0a0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:53.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48aed9d700 1 --2- 172.21.15.80:0/148181096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48b00734e0 0x7f48b0071e20 secure :-1 s=THROTTLE_DONE pgs=2732 cs=0 l=1 rx=0x7f489800b2d0 tx=0x7f489800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48ae59c700 1 -- 172.21.15.80:0/148181096 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4898007590 con 0x7f48b00734e0 2019-11-28T11:57:53.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48aed9d700 1 --2- 172.21.15.80:0/148181096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48b00734e0 0x7f48b0071e20 secure :-1 s=THROTTLE_DONE pgs=2732 cs=0 l=1 rx=0x7f489800b2d0 tx=0x7f489800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48aed9d700 1 --2- 172.21.15.80:0/148181096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48b00734e0 0x7f48b0071e20 secure :-1 s=THROTTLE_DONE pgs=2732 cs=0 l=1 rx=0x7f489800b2d0 tx=0x7f489800b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48ae59c700 1 -- 172.21.15.80:0/148181096 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4898009d30 con 0x7f48b00734e0 2019-11-28T11:57:53.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48ae59c700 1 -- 172.21.15.80:0/148181096 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f489800a400 con 0x7f48b00734e0 2019-11-28T11:57:53.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48b51e3700 1 -- 172.21.15.80:0/148181096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48b00734e0 msgr2=0x7f48b0071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:53.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48b51e3700 1 --2- 172.21.15.80:0/148181096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48b00734e0 0x7f48b0071e20 secure :-1 s=READY pgs=2732 cs=0 l=1 rx=0x7f489800b2d0 tx=0x7f489800b5d0).stop 2019-11-28T11:57:53.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48b51e3700 1 -- 172.21.15.80:0/148181096 shutdown_connections 2019-11-28T11:57:53.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48b51e3700 1 --2- 172.21.15.80:0/148181096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48b00734e0 0x7f48b0071e20 unknown :-1 s=CLOSED pgs=2732 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:53.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48b51e3700 1 --2- 172.21.15.80:0/148181096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b006c0a0 0x7f48b0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:53.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48b51e3700 1 -- 172.21.15.80:0/148181096 shutdown_connections 2019-11-28T11:57:53.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48b51e3700 1 -- 172.21.15.80:0/148181096 wait complete. 2019-11-28T11:57:53.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.373+0000 7f48b51e3700 1 -- 172.21.15.80:0/148181096 >> 172.21.15.80:0/148181096 conn(0x7f48b0061cf0 msgr2=0x7f48b0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:53.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.376+0000 7f48b51e3700 1 Processor -- start 2019-11-28T11:57:53.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.376+0000 7f48b51e3700 1 -- start start 2019-11-28T11:57:53.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.377+0000 7f48b51e3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f48b015fdf0 0x7f48b012b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:53.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.377+0000 7f48b51e3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b012a3c0 0x7f48b012a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:53.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.377+0000 7f48b51e3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b013eb20 con 0x7f48b012b8a0 2019-11-28T11:57:53.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.377+0000 7f48b51e3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b0108820 con 0x7f48b015fdf0 2019-11-28T11:57:53.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.377+0000 7f48b51e3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0108af0 con 0x7f48b012a3c0 2019-11-28T11:57:53.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.377+0000 7f48b49e2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b012a3c0 0x7f48b012a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:53.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.377+0000 7f48af59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f48b015fdf0 0x7f48b012b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:53.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.377+0000 7f48b49e2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b012a3c0 0x7f48b012a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:48438/0 (socket says 172.21.15.80:48438) 2019-11-28T11:57:53.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.377+0000 7f48b49e2700 1 -- 172.21.15.80:0/2117086558 learned_addr learned my addr 172.21.15.80:0/2117086558 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:53.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.377+0000 7f48b49e2700 1 -- 172.21.15.80:0/2117086558 >> v2:172.21.15.174:3300/0 conn(0x7f48b015fdf0 msgr2=0x7f48b012b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:53.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.377+0000 7f48b49e2700 1 --2- 172.21.15.80:0/2117086558 >> v2:172.21.15.174:3300/0 conn(0x7f48b015fdf0 0x7f48b012b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:53.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.377+0000 7f48b49e2700 1 -- 172.21.15.80:0/2117086558 >> v1:172.21.15.174:6789/0 conn(0x7f48b012b8a0 legacy=0x7f48b013e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:53.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.377+0000 7f48b49e2700 1 -- 172.21.15.80:0/2117086558 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b010a8c0 con 0x7f48b012a3c0 2019-11-28T11:57:53.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.377+0000 7f48af59e700 1 --2- 172.21.15.80:0/2117086558 >> v2:172.21.15.174:3300/0 conn(0x7f48b015fdf0 0x7f48b012b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:57:53.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.378+0000 7f48b49e2700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b012a3c0 0x7f48b012a7d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48a8010430 tx=0x7f48a80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.378+0000 7f48b49e2700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b012a3c0 0x7f48b012a7d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48a8010430 tx=0x7f48a80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.378+0000 7f48b49e2700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b012a3c0 0x7f48b012a7d0 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7f48a8010430 tx=0x7f48a80107d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:53.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.378+0000 7f48b49e2700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b012a3c0 0x7f48b012a7d0 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7f48a8010430 tx=0x7f48a80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.378+0000 7f48a7fff700 1 -- 172.21.15.80:0/2117086558 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48a8000ef0 con 0x7f48b012a3c0 2019-11-28T11:57:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.378+0000 7f48b49e2700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b012a3c0 0x7f48b012a7d0 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7f48a8010430 tx=0x7f48a80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.378+0000 7f48b49e2700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b012a3c0 0x7f48b012a7d0 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7f48a8010430 tx=0x7f48a80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.378+0000 7f48a7fff700 1 -- 172.21.15.80:0/2117086558 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a8004240 con 0x7f48b012a3c0 2019-11-28T11:57:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.378+0000 7f48b51e3700 1 -- 172.21.15.80:0/2117086558 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b010a8c0 con 0x7f48b012a3c0 2019-11-28T11:57:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.378+0000 7f48a7fff700 1 -- 172.21.15.80:0/2117086558 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48a8004890 con 0x7f48b012a3c0 2019-11-28T11:57:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.378+0000 7f48b51e3700 1 -- 172.21.15.80:0/2117086558 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b010a8c0 con 0x7f48b012a3c0 2019-11-28T11:57:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.378+0000 7f48b49e2700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b012a3c0 0x7f48b012a7d0 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7f48a8010430 tx=0x7f48a80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.378+0000 7f48a7fff700 1 -- 172.21.15.80:0/2117086558 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f48a8004430 con 0x7f48b012a3c0 2019-11-28T11:57:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.379+0000 7f48b49e2700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b012a3c0 0x7f48b012a7d0 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7f48a8010430 tx=0x7f48a80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.379+0000 7f48a7fff700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4888018730 0x7f488801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.379+0000 7f48a7fff700 1 -- 172.21.15.80:0/2117086558 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f48a8031ae0 con 0x7f48b012a3c0 2019-11-28T11:57:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.379+0000 7f48af59e700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4888018730 0x7f488801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:53.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.379+0000 7f48af59e700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4888018730 0x7f488801abc0 crc :-1 s=READY pgs=1135 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.386+0000 7f48b51e3700 1 -- 172.21.15.80:0/2117086558 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b0109180 con 0x7f48b012a3c0 2019-11-28T11:57:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.390+0000 7f48b49e2700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b012a3c0 0x7f48b012a7d0 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7f48a8010430 tx=0x7f48a80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.390+0000 7f48a7fff700 1 -- 172.21.15.80:0/2117086558 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f48a8020f30 con 0x7f48b012a3c0 2019-11-28T11:57:53.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.552+0000 7f48b51e3700 1 -- 172.21.15.80:0/2117086558 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f48b0109500 con 0x7f48b012a3c0 2019-11-28T11:57:53.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.553+0000 7f48b49e2700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b012a3c0 0x7f48b012a7d0 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7f48a8010430 tx=0x7f48a80107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.553+0000 7f48a7fff700 1 -- 172.21.15.80:0/2117086558 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v209) v1 ==== 84+0+64 (secure 0 0 0) 0x7f48a8020f30 con 0x7f48b012a3c0 2019-11-28T11:57:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:57:53.550 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:57:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:57:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:57:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:57:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:57:53.551 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:57:53.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.555+0000 7f48b51e3700 1 -- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4888018730 msgr2=0x7f488801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:53.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.555+0000 7f48b51e3700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4888018730 0x7f488801abc0 crc :-1 s=READY pgs=1135 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:53.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.555+0000 7f48b51e3700 1 -- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b012a3c0 msgr2=0x7f48b012a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:53.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.555+0000 7f48b51e3700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b012a3c0 0x7f48b012a7d0 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7f48a8010430 tx=0x7f48a80107d0).stop 2019-11-28T11:57:53.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.555+0000 7f48b51e3700 1 -- 172.21.15.80:0/2117086558 shutdown_connections 2019-11-28T11:57:53.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.555+0000 7f48b51e3700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48b012a3c0 0x7f48b012a7d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:53.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.555+0000 7f48b51e3700 1 --2- 172.21.15.80:0/2117086558 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4888018730 0x7f488801abc0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:53.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.555+0000 7f48b51e3700 1 --2- 172.21.15.80:0/2117086558 >> v2:172.21.15.174:3300/0 conn(0x7f48b015fdf0 0x7f48b012b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:53.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.555+0000 7f48b51e3700 1 -- 172.21.15.80:0/2117086558 shutdown_connections 2019-11-28T11:57:53.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.555+0000 7f48b51e3700 1 -- 172.21.15.80:0/2117086558 wait complete. 2019-11-28T11:57:53.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.555+0000 7f48b51e3700 1 -- 172.21.15.80:0/2117086558 >> 172.21.15.80:0/2117086558 conn(0x7f48b0127dc0 msgr2=0x7f48b0141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:53.562 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:57:53.562 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:57:53.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.689+0000 7f2b8c23d700 1 Processor -- start 2019-11-28T11:57:53.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.689+0000 7f2b8c23d700 1 -- start start 2019-11-28T11:57:53.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.690+0000 7f2b8c23d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b841639f0 0x7f2b84165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:53.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.690+0000 7f2b8c23d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8406db60 con 0x7f2b8415f100 2019-11-28T11:57:53.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.690+0000 7f2b8c23d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8406e060 con 0x7f2b8415ed10 2019-11-28T11:57:53.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.690+0000 7f2b8c23d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8406fe00 con 0x7f2b841639f0 2019-11-28T11:57:53.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.690+0000 7f2b8afdb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b841639f0 0x7f2b84165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:53.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.690+0000 7f2b89fd9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2b8415f100 0x7f2b8406bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45498/0 (socket says 172.21.15.80:45498) 2019-11-28T11:57:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.690+0000 7f2b8afdb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2b841639f0 0x7f2b84165df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46186/0 (socket says 172.21.15.80:46186) 2019-11-28T11:57:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.690+0000 7f2b89fd9700 1 -- 172.21.15.80:0/4066006318 learned_addr learned my addr 172.21.15.80:0/4066006318 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.690+0000 7f2b8afdb700 1 -- 172.21.15.80:0/4066006318 >> v1:172.21.15.174:6789/0 conn(0x7f2b8415ed10 legacy=0x7f2b84073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.690+0000 7f2b8afdb700 1 -- 172.21.15.80:0/4066006318 >> v1:172.21.15.80:6789/0 conn(0x7f2b8415f100 legacy=0x7f2b8406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.690+0000 7f2b897d8700 1 -- 172.21.15.80:0/4066006318 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276050474 0 0) 0x7f2b78001150 con 0x7f2b8415f100 2019-11-28T11:57:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.690+0000 7f2b8afdb700 1 -- 172.21.15.80:0/4066006318 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b84070760 con 0x7f2b841639f0 2019-11-28T11:57:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.691+0000 7f2b8afdb700 1 --2- 172.21.15.80:0/4066006318 >> v2:172.21.15.80:3300/0 conn(0x7f2b841639f0 0x7f2b84165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2b7c00af50 tx=0x7f2b7c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.691+0000 7f2b8afdb700 1 --2- 172.21.15.80:0/4066006318 >> v2:172.21.15.80:3300/0 conn(0x7f2b841639f0 0x7f2b84165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2b7c00af50 tx=0x7f2b7c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.691+0000 7f2b8afdb700 1 --2- 172.21.15.80:0/4066006318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b841639f0 0x7f2b84165df0 secure :-1 s=READY pgs=2734 cs=0 l=1 rx=0x7f2b7c00af50 tx=0x7f2b7c00b760).ready entity=mon.0 client_cookie=1b3001666c9838ab server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.691+0000 7f2b8afdb700 1 --2- 172.21.15.80:0/4066006318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b841639f0 0x7f2b84165df0 secure :-1 s=THROTTLE_DONE pgs=2734 cs=0 l=1 rx=0x7f2b7c00af50 tx=0x7f2b7c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.691+0000 7f2b897d8700 1 -- 172.21.15.80:0/4066006318 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b7c009ba0 con 0x7f2b841639f0 2019-11-28T11:57:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.691+0000 7f2b8afdb700 1 --2- 172.21.15.80:0/4066006318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b841639f0 0x7f2b84165df0 secure :-1 s=THROTTLE_DONE pgs=2734 cs=0 l=1 rx=0x7f2b7c00af50 tx=0x7f2b7c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.691+0000 7f2b8afdb700 1 --2- 172.21.15.80:0/4066006318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b841639f0 0x7f2b84165df0 secure :-1 s=THROTTLE_DONE pgs=2734 cs=0 l=1 rx=0x7f2b7c00af50 tx=0x7f2b7c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.691+0000 7f2b897d8700 1 -- 172.21.15.80:0/4066006318 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c000a70 con 0x7f2b841639f0 2019-11-28T11:57:53.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.691+0000 7f2b897d8700 1 -- 172.21.15.80:0/4066006318 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b7c00a180 con 0x7f2b841639f0 2019-11-28T11:57:53.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.691+0000 7f2b8c23d700 1 -- 172.21.15.80:0/4066006318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b841639f0 msgr2=0x7f2b84165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:53.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.691+0000 7f2b8c23d700 1 --2- 172.21.15.80:0/4066006318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b841639f0 0x7f2b84165df0 secure :-1 s=READY pgs=2734 cs=0 l=1 rx=0x7f2b7c00af50 tx=0x7f2b7c00b760).stop 2019-11-28T11:57:53.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.692+0000 7f2b8c23d700 1 -- 172.21.15.80:0/4066006318 shutdown_connections 2019-11-28T11:57:53.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.692+0000 7f2b8c23d700 1 --2- 172.21.15.80:0/4066006318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2b841639f0 0x7f2b84165df0 unknown :-1 s=CLOSED pgs=2734 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:53.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.692+0000 7f2b8c23d700 1 -- 172.21.15.80:0/4066006318 shutdown_connections 2019-11-28T11:57:53.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.692+0000 7f2b8c23d700 1 -- 172.21.15.80:0/4066006318 wait complete. 2019-11-28T11:57:53.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.692+0000 7f2b8c23d700 1 -- 172.21.15.80:0/4066006318 >> 172.21.15.80:0/4066006318 conn(0x7f2b84061d20 msgr2=0x7f2b840641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:53.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.694+0000 7f2b8c23d700 1 Processor -- start 2019-11-28T11:57:53.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.694+0000 7f2b8c23d700 1 -- start start 2019-11-28T11:57:53.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.695+0000 7f2b8c23d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2b84148320 0x7f2b8410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:53.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.695+0000 7f2b8c23d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b8410e3d0 0x7f2b84168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:53.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.695+0000 7f2b8c23d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b84148e00 con 0x7f2b8410f290 2019-11-28T11:57:53.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.695+0000 7f2b8c23d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8413aa20 con 0x7f2b84148320 2019-11-28T11:57:53.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.695+0000 7f2b8c23d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8413acf0 con 0x7f2b8410e3d0 2019-11-28T11:57:53.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.695+0000 7f2b89fd9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2b8410f290 0x7f2b8410dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45506/0 (socket says 172.21.15.80:45506) 2019-11-28T11:57:53.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.695+0000 7f2b89fd9700 1 -- 172.21.15.80:0/4063397405 learned_addr learned my addr 172.21.15.80:0/4063397405 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:53.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.695+0000 7f2b8a7da700 1 --2- 172.21.15.80:0/4063397405 >> v2:172.21.15.174:3300/0 conn(0x7f2b84148320 0x7f2b8410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:53.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.695+0000 7f2b8afdb700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b8410e3d0 0x7f2b84168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:53.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.695+0000 7f2b82ffd700 1 -- 172.21.15.80:0/4063397405 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124055072 0 0) 0x7f2b78001170 con 0x7f2b8410f290 2019-11-28T11:57:53.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.695+0000 7f2b82ffd700 1 -- 172.21.15.80:0/4063397405 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b64002e80 con 0x7f2b8410f290 2019-11-28T11:57:53.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.695+0000 7f2b8a7da700 1 -- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b8410e3d0 msgr2=0x7f2b84168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:53.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.695+0000 7f2b8a7da700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b8410e3d0 0x7f2b84168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:53.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.695+0000 7f2b8a7da700 1 -- 172.21.15.80:0/4063397405 >> v1:172.21.15.80:6789/0 conn(0x7f2b8410f290 legacy=0x7f2b8410dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:53.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.696+0000 7f2b82ffd700 1 -- 172.21.15.80:0/4063397405 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 151488951 0 0) 0x7f2b78000ef0 con 0x7f2b8410f290 2019-11-28T11:57:53.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.696+0000 7f2b8a7da700 1 -- 172.21.15.80:0/4063397405 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8410c490 con 0x7f2b84148320 2019-11-28T11:57:53.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.696+0000 7f2b8a7da700 1 --2- 172.21.15.80:0/4063397405 >> v2:172.21.15.174:3300/0 conn(0x7f2b84148320 0x7f2b8410ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b740106a0 tx=0x7f2b74010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.696+0000 7f2b8a7da700 1 --2- 172.21.15.80:0/4063397405 >> v2:172.21.15.174:3300/0 conn(0x7f2b84148320 0x7f2b8410ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b740106a0 tx=0x7f2b74010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.696+0000 7f2b8a7da700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b84148320 0x7f2b8410ed50 secure :-1 s=READY pgs=1651 cs=0 l=1 rx=0x7f2b740106a0 tx=0x7f2b74010a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:53.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.696+0000 7f2b8a7da700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b84148320 0x7f2b8410ed50 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7f2b740106a0 tx=0x7f2b74010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.696+0000 7f2b82ffd700 1 -- 172.21.15.80:0/4063397405 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b74009ef0 con 0x7f2b84148320 2019-11-28T11:57:53.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.696+0000 7f2b8a7da700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b84148320 0x7f2b8410ed50 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7f2b740106a0 tx=0x7f2b74010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.696+0000 7f2b8a7da700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b84148320 0x7f2b8410ed50 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7f2b740106a0 tx=0x7f2b74010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.696+0000 7f2b82ffd700 1 -- 172.21.15.80:0/4063397405 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b74009b10 con 0x7f2b84148320 2019-11-28T11:57:53.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.696+0000 7f2b82ffd700 1 -- 172.21.15.80:0/4063397405 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b74009d00 con 0x7f2b84148320 2019-11-28T11:57:53.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.696+0000 7f2b8c23d700 1 -- 172.21.15.80:0/4063397405 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8410c810 con 0x7f2b84148320 2019-11-28T11:57:53.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.696+0000 7f2b8c23d700 1 -- 172.21.15.80:0/4063397405 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8410c490 con 0x7f2b84148320 2019-11-28T11:57:53.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.696+0000 7f2b8a7da700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b84148320 0x7f2b8410ed50 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7f2b740106a0 tx=0x7f2b74010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.697+0000 7f2b82ffd700 1 -- 172.21.15.80:0/4063397405 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2b74009da0 con 0x7f2b84148320 2019-11-28T11:57:53.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.697+0000 7f2b8a7da700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b84148320 0x7f2b8410ed50 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7f2b740106a0 tx=0x7f2b74010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.697+0000 7f2b82ffd700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b64018780 0x7f2b6401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:53.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.697+0000 7f2b82ffd700 1 -- 172.21.15.80:0/4063397405 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f2b74031d30 con 0x7f2b84148320 2019-11-28T11:57:53.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.697+0000 7f2b89fd9700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b64018780 0x7f2b6401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:53.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.697+0000 7f2b89fd9700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b64018780 0x7f2b6401abf0 crc :-1 s=READY pgs=1136 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:53.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.704+0000 7f2b8c23d700 1 -- 172.21.15.80:0/4063397405 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8410c810 con 0x7f2b84148320 2019-11-28T11:57:53.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.708+0000 7f2b8a7da700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b84148320 0x7f2b8410ed50 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7f2b740106a0 tx=0x7f2b74010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:53.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.708+0000 7f2b82ffd700 1 -- 172.21.15.80:0/4063397405 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2b74026bf0 con 0x7f2b84148320 2019-11-28T11:57:53.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:53.875+0000 7f2b8c23d700 1 -- 172.21.15.80:0/4063397405 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f2b8410c490 con 0x7f2b84148320 2019-11-28T11:57:54.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.215+0000 7f2b8a7da700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b84148320 0x7f2b8410ed50 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7f2b740106a0 tx=0x7f2b74010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:54.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.215+0000 7f2b82ffd700 1 -- 172.21.15.80:0/4063397405 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v210) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2b74009900 con 0x7f2b84148320 2019-11-28T11:57:54.235 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:57:54.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.241+0000 7f2b8c23d700 1 -- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b64018780 msgr2=0x7f2b6401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:54.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.241+0000 7f2b8c23d700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b64018780 0x7f2b6401abf0 crc :-1 s=READY pgs=1136 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:54.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.241+0000 7f2b8c23d700 1 -- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b84148320 msgr2=0x7f2b8410ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:54.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.241+0000 7f2b8c23d700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b84148320 0x7f2b8410ed50 secure :-1 s=READY pgs=1651 cs=0 l=1 rx=0x7f2b740106a0 tx=0x7f2b74010a40).stop 2019-11-28T11:57:54.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.241+0000 7f2b8c23d700 1 -- 172.21.15.80:0/4063397405 shutdown_connections 2019-11-28T11:57:54.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.241+0000 7f2b8c23d700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2b64018780 0x7f2b6401abf0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:54.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.241+0000 7f2b8c23d700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2b8410e3d0 0x7f2b84168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:54.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.241+0000 7f2b8c23d700 1 --2- 172.21.15.80:0/4063397405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b84148320 0x7f2b8410ed50 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:54.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.241+0000 7f2b8c23d700 1 -- 172.21.15.80:0/4063397405 shutdown_connections 2019-11-28T11:57:54.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.241+0000 7f2b8c23d700 1 -- 172.21.15.80:0/4063397405 wait complete. 2019-11-28T11:57:54.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.241+0000 7f2b8c23d700 1 -- 172.21.15.80:0/4063397405 >> 172.21.15.80:0/4063397405 conn(0x7f2b8415e2d0 msgr2=0x7f2b84147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:54.248 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:57:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.378+0000 7fb77120c700 1 Processor -- start 2019-11-28T11:57:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.378+0000 7fb77120c700 1 -- start start 2019-11-28T11:57:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.379+0000 7fb77120c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb76c15ed10 0x7fb76c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.379+0000 7fb77120c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c0734b0 0x7fb76c0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.379+0000 7fb77120c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76c06db60 con 0x7fb76c073020 2019-11-28T11:57:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.379+0000 7fb77120c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76c06fe00 con 0x7fb76c15ed10 2019-11-28T11:57:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.379+0000 7fb77120c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c0700d0 con 0x7fb76c0734b0 2019-11-28T11:57:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb76ad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb76c073020 0x7fb76c071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45516/0 (socket says 172.21.15.80:45516) 2019-11-28T11:57:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb76ad9d700 1 -- 172.21.15.80:0/2987677162 learned_addr learned my addr 172.21.15.80:0/2987677162 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb770a0b700 1 --2- 172.21.15.80:0/2987677162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c0734b0 0x7fb76c0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb76b59e700 1 --2- 172.21.15.80:0/2987677162 >> v2:172.21.15.174:3300/0 conn(0x7fb76c15ed10 0x7fb76c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb76a59c700 1 -- 172.21.15.80:0/2987677162 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231304716 0 0) 0x7fb75c001070 con 0x7fb76c073020 2019-11-28T11:57:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb76a59c700 1 -- 172.21.15.80:0/2987677162 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb74c002e80 con 0x7fb76c073020 2019-11-28T11:57:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb770a0b700 1 -- 172.21.15.80:0/2987677162 >> v2:172.21.15.174:3300/0 conn(0x7fb76c15ed10 msgr2=0x7fb76c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb770a0b700 1 --2- 172.21.15.80:0/2987677162 >> v2:172.21.15.174:3300/0 conn(0x7fb76c15ed10 0x7fb76c15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb770a0b700 1 -- 172.21.15.80:0/2987677162 >> v1:172.21.15.80:6789/0 conn(0x7fb76c073020 legacy=0x7fb76c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb770a0b700 1 -- 172.21.15.80:0/2987677162 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c070760 con 0x7fb76c0734b0 2019-11-28T11:57:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb76b59e700 1 --2- 172.21.15.80:0/2987677162 >> v2:172.21.15.174:3300/0 conn(0x7fb76c15ed10 0x7fb76c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:57:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb770a0b700 1 --2- 172.21.15.80:0/2987677162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c0734b0 0x7fb76c0726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb76400af80 tx=0x7fb76400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb770a0b700 1 --2- 172.21.15.80:0/2987677162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c0734b0 0x7fb76c0726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb76400af80 tx=0x7fb76400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb770a0b700 1 --2- 172.21.15.80:0/2987677162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c0734b0 0x7fb76c0726a0 secure :-1 s=READY pgs=396 cs=0 l=1 rx=0x7fb76400af80 tx=0x7fb76400b790).ready entity=mon.2 client_cookie=9e7bc1b223e6c335 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb770a0b700 1 --2- 172.21.15.80:0/2987677162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c0734b0 0x7fb76c0726a0 secure :-1 s=THROTTLE_DONE pgs=396 cs=0 l=1 rx=0x7fb76400af80 tx=0x7fb76400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:54.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb76a59c700 1 -- 172.21.15.80:0/2987677162 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb764000bc0 con 0x7fb76c0734b0 2019-11-28T11:57:54.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb770a0b700 1 --2- 172.21.15.80:0/2987677162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c0734b0 0x7fb76c0726a0 secure :-1 s=THROTTLE_DONE pgs=396 cs=0 l=1 rx=0x7fb76400af80 tx=0x7fb76400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:54.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb770a0b700 1 --2- 172.21.15.80:0/2987677162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c0734b0 0x7fb76c0726a0 secure :-1 s=THROTTLE_DONE pgs=396 cs=0 l=1 rx=0x7fb76400af80 tx=0x7fb76400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:54.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.380+0000 7fb76a59c700 1 -- 172.21.15.80:0/2987677162 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7640097f0 con 0x7fb76c0734b0 2019-11-28T11:57:54.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.381+0000 7fb76a59c700 1 -- 172.21.15.80:0/2987677162 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb764009ec0 con 0x7fb76c0734b0 2019-11-28T11:57:54.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.381+0000 7fb77120c700 1 -- 172.21.15.80:0/2987677162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c0734b0 msgr2=0x7fb76c0726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:54.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.381+0000 7fb77120c700 1 --2- 172.21.15.80:0/2987677162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c0734b0 0x7fb76c0726a0 secure :-1 s=READY pgs=396 cs=0 l=1 rx=0x7fb76400af80 tx=0x7fb76400b790).stop 2019-11-28T11:57:54.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.381+0000 7fb77120c700 1 -- 172.21.15.80:0/2987677162 shutdown_connections 2019-11-28T11:57:54.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.381+0000 7fb77120c700 1 --2- 172.21.15.80:0/2987677162 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c0734b0 0x7fb76c0726a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:54.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.381+0000 7fb77120c700 1 --2- 172.21.15.80:0/2987677162 >> v2:172.21.15.174:3300/0 conn(0x7fb76c15ed10 0x7fb76c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:54.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.381+0000 7fb77120c700 1 -- 172.21.15.80:0/2987677162 shutdown_connections 2019-11-28T11:57:54.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.381+0000 7fb77120c700 1 -- 172.21.15.80:0/2987677162 wait complete. 2019-11-28T11:57:54.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.381+0000 7fb77120c700 1 -- 172.21.15.80:0/2987677162 >> 172.21.15.80:0/2987677162 conn(0x7fb76c061d20 msgr2=0x7fb76c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:54.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.383+0000 7fb77120c700 1 Processor -- start 2019-11-28T11:57:54.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.384+0000 7fb77120c700 1 -- start start 2019-11-28T11:57:54.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.384+0000 7fb77120c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c10e970 0x7fb76c1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:54.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb77120c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76c10c250 con 0x7fb76c108cf0 2019-11-28T11:57:54.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb77120c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76c10c6d0 con 0x7fb76c107e30 2019-11-28T11:57:54.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb77120c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c10da00 con 0x7fb76c10e970 2019-11-28T11:57:54.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb76ad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb76c108cf0 0x7fb76c107630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45520/0 (socket says 172.21.15.80:45520) 2019-11-28T11:57:54.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb76ad9d700 1 -- 172.21.15.80:0/3866437947 learned_addr learned my addr 172.21.15.80:0/3866437947 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:54.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb76b59e700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c10e970 0x7fb76c1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:54.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb763fff700 1 -- 172.21.15.80:0/3866437947 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745772060 0 0) 0x7fb75c001280 con 0x7fb76c108cf0 2019-11-28T11:57:54.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb763fff700 1 -- 172.21.15.80:0/3866437947 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb744002e80 con 0x7fb76c108cf0 2019-11-28T11:57:54.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb763fff700 1 -- 172.21.15.80:0/3866437947 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083976893 0 0) 0x7fb7640095b0 con 0x7fb76c107e30 2019-11-28T11:57:54.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb763fff700 1 -- 172.21.15.80:0/3866437947 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7440030b0 con 0x7fb76c107e30 2019-11-28T11:57:54.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb76b59e700 1 -- 172.21.15.80:0/3866437947 >> v1:172.21.15.174:6789/0 conn(0x7fb76c107e30 legacy=0x7fb76c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:54.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb76b59e700 1 -- 172.21.15.80:0/3866437947 >> v1:172.21.15.80:6789/0 conn(0x7fb76c108cf0 legacy=0x7fb76c107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:54.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb76b59e700 1 -- 172.21.15.80:0/3866437947 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c105ef0 con 0x7fb76c10e970 2019-11-28T11:57:54.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb76b59e700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c10e970 0x7fb76c1087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb754010720 tx=0x7fb754010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:54.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb76b59e700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c10e970 0x7fb76c1087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb754010720 tx=0x7fb754010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:54.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb76b59e700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c10e970 0x7fb76c1087b0 secure :-1 s=READY pgs=397 cs=0 l=1 rx=0x7fb754010720 tx=0x7fb754010ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:54.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb76b59e700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c10e970 0x7fb76c1087b0 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7fb754010720 tx=0x7fb754010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:54.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb763fff700 1 -- 172.21.15.80:0/3866437947 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb754000cc0 con 0x7fb76c10e970 2019-11-28T11:57:54.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb76b59e700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c10e970 0x7fb76c1087b0 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7fb754010720 tx=0x7fb754010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:54.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb763fff700 1 -- 172.21.15.80:0/3866437947 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75400e370 con 0x7fb76c10e970 2019-11-28T11:57:54.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb76b59e700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c10e970 0x7fb76c1087b0 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7fb754010720 tx=0x7fb754010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:54.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb77120c700 1 -- 172.21.15.80:0/3866437947 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76c106270 con 0x7fb76c10e970 2019-11-28T11:57:54.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb763fff700 1 -- 172.21.15.80:0/3866437947 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb754000cc0 con 0x7fb76c10e970 2019-11-28T11:57:54.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.385+0000 7fb77120c700 1 -- 172.21.15.80:0/3866437947 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76c105ef0 con 0x7fb76c10e970 2019-11-28T11:57:54.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.386+0000 7fb76b59e700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c10e970 0x7fb76c1087b0 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7fb754010720 tx=0x7fb754010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:54.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.386+0000 7fb763fff700 1 -- 172.21.15.80:0/3866437947 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb75400ded0 con 0x7fb76c10e970 2019-11-28T11:57:54.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.386+0000 7fb76b59e700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c10e970 0x7fb76c1087b0 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7fb754010720 tx=0x7fb754010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:54.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.386+0000 7fb763fff700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb744018750 0x7fb74401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:54.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.386+0000 7fb763fff700 1 -- 172.21.15.80:0/3866437947 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb754031dd0 con 0x7fb76c10e970 2019-11-28T11:57:54.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.386+0000 7fb76ad9d700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb744018750 0x7fb74401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:54.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.387+0000 7fb76ad9d700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb744018750 0x7fb74401abe0 crc :-1 s=READY pgs=1137 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:54.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.394+0000 7fb77120c700 1 -- 172.21.15.80:0/3866437947 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76c106270 con 0x7fb76c10e970 2019-11-28T11:57:54.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.398+0000 7fb76b59e700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c10e970 0x7fb76c1087b0 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7fb754010720 tx=0x7fb754010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:54.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.398+0000 7fb763fff700 1 -- 172.21.15.80:0/3866437947 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb754000cc0 con 0x7fb76c10e970 2019-11-28T11:57:54.564 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:54.568+0000 7fb77120c700 1 -- 172.21.15.80:0/3866437947 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7fb76c105ef0 con 0x7fb76c10e970 2019-11-28T11:57:55.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.219+0000 7fb76b59e700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c10e970 0x7fb76c1087b0 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7fb754010720 tx=0x7fb754010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.219+0000 7fb763fff700 1 -- 172.21.15.80:0/3866437947 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v211) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb75400dde0 con 0x7fb76c10e970 2019-11-28T11:57:55.229 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:57:55.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.235+0000 7fb77120c700 1 -- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb744018750 msgr2=0x7fb74401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:55.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.235+0000 7fb77120c700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb744018750 0x7fb74401abe0 crc :-1 s=READY pgs=1137 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:55.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.235+0000 7fb77120c700 1 -- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c10e970 msgr2=0x7fb76c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:55.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.235+0000 7fb77120c700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c10e970 0x7fb76c1087b0 secure :-1 s=READY pgs=397 cs=0 l=1 rx=0x7fb754010720 tx=0x7fb754010ac0).stop 2019-11-28T11:57:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.235+0000 7fb77120c700 1 -- 172.21.15.80:0/3866437947 shutdown_connections 2019-11-28T11:57:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.235+0000 7fb77120c700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb744018750 0x7fb74401abe0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.235+0000 7fb77120c700 1 --2- 172.21.15.80:0/3866437947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb76c10e970 0x7fb76c1087b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.236+0000 7fb77120c700 1 -- 172.21.15.80:0/3866437947 shutdown_connections 2019-11-28T11:57:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.236+0000 7fb77120c700 1 -- 172.21.15.80:0/3866437947 wait complete. 2019-11-28T11:57:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.236+0000 7fb77120c700 1 -- 172.21.15.80:0/3866437947 >> 172.21.15.80:0/3866437947 conn(0x7fb76c15e2d0 msgr2=0x7fb76c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:55.247 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:57:55.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.383+0000 7f374f4f0700 1 Processor -- start 2019-11-28T11:57:55.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.383+0000 7f374f4f0700 1 -- start start 2019-11-28T11:57:55.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.384+0000 7f374f4f0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f37481639f0 0x7f3748165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:55.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.384+0000 7f374f4f0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374806db60 con 0x7f374815ed10 2019-11-28T11:57:55.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.384+0000 7f374f4f0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374806e060 con 0x7f374815f100 2019-11-28T11:57:55.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.384+0000 7f374f4f0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374806fe00 con 0x7f37481639f0 2019-11-28T11:57:55.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.384+0000 7f374da8d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f374815ed10 0x7f3748073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45526/0 (socket says 172.21.15.80:45526) 2019-11-28T11:57:55.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.384+0000 7f374da8d700 1 -- 172.21.15.80:0/2196207482 learned_addr learned my addr 172.21.15.80:0/2196207482 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:55.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.384+0000 7f374e28e700 1 --2- 172.21.15.80:0/2196207482 >> v2:172.21.15.174:3300/0 conn(0x7f37481639f0 0x7f3748165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:55.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.384+0000 7f374ca8b700 1 -- 172.21.15.80:0/2196207482 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342795316 0 0) 0x7f373c001150 con 0x7f374815ed10 2019-11-28T11:57:55.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.384+0000 7f374ca8b700 1 -- 172.21.15.80:0/2196207482 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3730002e80 con 0x7f374815ed10 2019-11-28T11:57:55.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.384+0000 7f374e28e700 1 -- 172.21.15.80:0/2196207482 >> v1:172.21.15.174:6789/0 conn(0x7f374815f100 legacy=0x7f374806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:55.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.385+0000 7f374ca8b700 1 -- 172.21.15.80:0/2196207482 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1852778879 0 0) 0x7f373c001130 con 0x7f374815ed10 2019-11-28T11:57:55.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.385+0000 7f374e28e700 1 -- 172.21.15.80:0/2196207482 >> v1:172.21.15.80:6789/0 conn(0x7f374815ed10 legacy=0x7f3748073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:55.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.385+0000 7f374e28e700 1 -- 172.21.15.80:0/2196207482 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3748070760 con 0x7f37481639f0 2019-11-28T11:57:55.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.385+0000 7f374e28e700 1 --2- 172.21.15.80:0/2196207482 >> v2:172.21.15.174:3300/0 conn(0x7f37481639f0 0x7f3748165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f374000af80 tx=0x7f374000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.385+0000 7f374e28e700 1 --2- 172.21.15.80:0/2196207482 >> v2:172.21.15.174:3300/0 conn(0x7f37481639f0 0x7f3748165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f374000af80 tx=0x7f374000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.385+0000 7f374e28e700 1 --2- 172.21.15.80:0/2196207482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481639f0 0x7f3748165df0 secure :-1 s=READY pgs=1654 cs=0 l=1 rx=0x7f374000af80 tx=0x7f374000b790).ready entity=mon.1 client_cookie=9cac682083212725 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:55.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.385+0000 7f374e28e700 1 --2- 172.21.15.80:0/2196207482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481639f0 0x7f3748165df0 secure :-1 s=THROTTLE_DONE pgs=1654 cs=0 l=1 rx=0x7f374000af80 tx=0x7f374000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.385+0000 7f374ca8b700 1 -- 172.21.15.80:0/2196207482 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3740007240 con 0x7f37481639f0 2019-11-28T11:57:55.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.385+0000 7f374e28e700 1 --2- 172.21.15.80:0/2196207482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481639f0 0x7f3748165df0 secure :-1 s=THROTTLE_DONE pgs=1654 cs=0 l=1 rx=0x7f374000af80 tx=0x7f374000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.385+0000 7f374e28e700 1 --2- 172.21.15.80:0/2196207482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481639f0 0x7f3748165df0 secure :-1 s=THROTTLE_DONE pgs=1654 cs=0 l=1 rx=0x7f374000af80 tx=0x7f374000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.385+0000 7f374ca8b700 1 -- 172.21.15.80:0/2196207482 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3740000bb0 con 0x7f37481639f0 2019-11-28T11:57:55.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.385+0000 7f374ca8b700 1 -- 172.21.15.80:0/2196207482 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3740009e60 con 0x7f37481639f0 2019-11-28T11:57:55.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.385+0000 7f374f4f0700 1 -- 172.21.15.80:0/2196207482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481639f0 msgr2=0x7f3748165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:55.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.385+0000 7f374f4f0700 1 --2- 172.21.15.80:0/2196207482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481639f0 0x7f3748165df0 secure :-1 s=READY pgs=1654 cs=0 l=1 rx=0x7f374000af80 tx=0x7f374000b790).stop 2019-11-28T11:57:55.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.386+0000 7f374f4f0700 1 -- 172.21.15.80:0/2196207482 shutdown_connections 2019-11-28T11:57:55.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.386+0000 7f374f4f0700 1 --2- 172.21.15.80:0/2196207482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481639f0 0x7f3748165df0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:55.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.386+0000 7f374f4f0700 1 -- 172.21.15.80:0/2196207482 shutdown_connections 2019-11-28T11:57:55.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.386+0000 7f374f4f0700 1 -- 172.21.15.80:0/2196207482 wait complete. 2019-11-28T11:57:55.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.386+0000 7f374f4f0700 1 -- 172.21.15.80:0/2196207482 >> 172.21.15.80:0/2196207482 conn(0x7f3748061d20 msgr2=0x7f37480641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:55.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.388+0000 7f374f4f0700 1 Processor -- start 2019-11-28T11:57:55.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.388+0000 7f374f4f0700 1 -- start start 2019-11-28T11:57:55.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.389+0000 7f374f4f0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f37481079b0 0x7f3748107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:55.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.389+0000 7f374f4f0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3748148e00 con 0x7f3748148320 2019-11-28T11:57:55.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.389+0000 7f374f4f0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3748108b10 con 0x7f3748108380 2019-11-28T11:57:55.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.389+0000 7f374f4f0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374813aa20 con 0x7f37481079b0 2019-11-28T11:57:55.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.389+0000 7f374da8d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3748148320 0x7f374810ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45532/0 (socket says 172.21.15.80:45532) 2019-11-28T11:57:55.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.389+0000 7f374da8d700 1 -- 172.21.15.80:0/1143625222 learned_addr learned my addr 172.21.15.80:0/1143625222 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:55.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.389+0000 7f374d28c700 1 --2- 172.21.15.80:0/1143625222 >> v2:172.21.15.174:3300/0 conn(0x7f37481079b0 0x7f3748107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:55.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.389+0000 7f37467fc700 1 -- 172.21.15.80:0/1143625222 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801789500 0 0) 0x7f373c000f40 con 0x7f3748148320 2019-11-28T11:57:55.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.389+0000 7f37467fc700 1 -- 172.21.15.80:0/1143625222 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3728002e80 con 0x7f3748148320 2019-11-28T11:57:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.389+0000 7f37467fc700 1 -- 172.21.15.80:0/1143625222 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121099906 0 0) 0x7f3740009990 con 0x7f3748108380 2019-11-28T11:57:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f37467fc700 1 -- 172.21.15.80:0/1143625222 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37280030b0 con 0x7f3748108380 2019-11-28T11:57:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f37467fc700 1 -- 172.21.15.80:0/1143625222 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 325876155 0 0) 0x7f373c000c90 con 0x7f3748148320 2019-11-28T11:57:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f374d28c700 1 -- 172.21.15.80:0/1143625222 >> v1:172.21.15.174:6789/0 conn(0x7f3748108380 legacy=0x7f3748168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f374d28c700 1 -- 172.21.15.80:0/1143625222 >> v1:172.21.15.80:6789/0 conn(0x7f3748148320 legacy=0x7f374810ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f374d28c700 1 -- 172.21.15.80:0/1143625222 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374810c490 con 0x7f37481079b0 2019-11-28T11:57:55.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f374d28c700 1 --2- 172.21.15.80:0/1143625222 >> v2:172.21.15.174:3300/0 conn(0x7f37481079b0 0x7f3748107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3738010720 tx=0x7f3738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f374d28c700 1 --2- 172.21.15.80:0/1143625222 >> v2:172.21.15.174:3300/0 conn(0x7f37481079b0 0x7f3748107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3738010720 tx=0x7f3738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f374d28c700 1 --2- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481079b0 0x7f3748107e40 secure :-1 s=READY pgs=1656 cs=0 l=1 rx=0x7f3738010720 tx=0x7f3738010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f374d28c700 1 --2- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481079b0 0x7f3748107e40 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7f3738010720 tx=0x7f3738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f37467fc700 1 -- 172.21.15.80:0/1143625222 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f373800f490 con 0x7f37481079b0 2019-11-28T11:57:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f374d28c700 1 --2- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481079b0 0x7f3748107e40 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7f3738010720 tx=0x7f3738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f37467fc700 1 -- 172.21.15.80:0/1143625222 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373800f0b0 con 0x7f37481079b0 2019-11-28T11:57:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f374d28c700 1 --2- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481079b0 0x7f3748107e40 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7f3738010720 tx=0x7f3738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f374f4f0700 1 -- 172.21.15.80:0/1143625222 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374810c810 con 0x7f37481079b0 2019-11-28T11:57:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f37467fc700 1 -- 172.21.15.80:0/1143625222 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f373800f340 con 0x7f37481079b0 2019-11-28T11:57:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f374f4f0700 1 -- 172.21.15.80:0/1143625222 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3748108820 con 0x7f37481079b0 2019-11-28T11:57:55.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.390+0000 7f374d28c700 1 --2- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481079b0 0x7f3748107e40 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7f3738010720 tx=0x7f3738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.391+0000 7f37467fc700 1 -- 172.21.15.80:0/1143625222 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f373800f340 con 0x7f37481079b0 2019-11-28T11:57:55.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.391+0000 7f374d28c700 1 --2- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481079b0 0x7f3748107e40 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7f3738010720 tx=0x7f3738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.391+0000 7f37467fc700 1 --2- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3728018750 0x7f372801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:55.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.391+0000 7f37467fc700 1 -- 172.21.15.80:0/1143625222 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 5904+0+0 (secure 0 0 0) 0x7f37380320d0 con 0x7f37481079b0 2019-11-28T11:57:55.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.391+0000 7f374da8d700 1 --2- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3728018750 0x7f372801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.391+0000 7f374da8d700 1 --2- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3728018750 0x7f372801abe0 crc :-1 s=READY pgs=1138 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:55.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.398+0000 7f374f4f0700 1 -- 172.21.15.80:0/1143625222 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374810c490 con 0x7f37481079b0 2019-11-28T11:57:55.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.402+0000 7f374d28c700 1 --2- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481079b0 0x7f3748107e40 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7f3738010720 tx=0x7f3738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.402+0000 7f37467fc700 1 -- 172.21.15.80:0/1143625222 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f373800fb50 con 0x7f37481079b0 2019-11-28T11:57:55.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.567+0000 7f374f4f0700 1 -- 172.21.15.80:0/1143625222 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f374810c810 con 0x7f37481079b0 2019-11-28T11:57:55.569 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:57:55.568+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:57:55.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.572+0000 7f374d28c700 1 --2- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481079b0 0x7f3748107e40 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7f3738010720 tx=0x7f3738010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.573+0000 7f37467fc700 1 -- 172.21.15.80:0/1143625222 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 34 and data pool 35 v172) v1 ==== 174+0+0 (secure 0 0 0) 0x7f373800f0b0 con 0x7f37481079b0 2019-11-28T11:57:55.572 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 34 and data pool 35 2019-11-28T11:57:55.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.577+0000 7f374f4f0700 1 -- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3728018750 msgr2=0x7f372801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:55.574 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.577+0000 7f374f4f0700 1 --2- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3728018750 0x7f372801abe0 crc :-1 s=READY pgs=1138 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:55.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.577+0000 7f374f4f0700 1 -- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481079b0 msgr2=0x7f3748107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:55.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.577+0000 7f374f4f0700 1 --2- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481079b0 0x7f3748107e40 secure :-1 s=READY pgs=1656 cs=0 l=1 rx=0x7f3738010720 tx=0x7f3738010ac0).stop 2019-11-28T11:57:55.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.577+0000 7f374f4f0700 1 -- 172.21.15.80:0/1143625222 shutdown_connections 2019-11-28T11:57:55.575 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.577+0000 7f374f4f0700 1 --2- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3728018750 0x7f372801abe0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:55.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.577+0000 7f374f4f0700 1 --2- 172.21.15.80:0/1143625222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37481079b0 0x7f3748107e40 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:55.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.577+0000 7f374f4f0700 1 -- 172.21.15.80:0/1143625222 shutdown_connections 2019-11-28T11:57:55.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.577+0000 7f374f4f0700 1 -- 172.21.15.80:0/1143625222 wait complete. 2019-11-28T11:57:55.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.577+0000 7f374f4f0700 1 -- 172.21.15.80:0/1143625222 >> 172.21.15.80:0/1143625222 conn(0x7f374815e2d0 msgr2=0x7f3748147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:55.585 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:57:55.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.711+0000 7f4ef6a9c700 1 Processor -- start 2019-11-28T11:57:55.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.711+0000 7f4ef6a9c700 1 -- start start 2019-11-28T11:57:55.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.712+0000 7f4ef6a9c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4ef006c490 0x7f4ef006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:55.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.712+0000 7f4ef6a9c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ef006ce60 0x7f4ef0164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:55.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.712+0000 7f4ef6a9c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef006db00 con 0x7f4ef006c0a0 2019-11-28T11:57:55.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.712+0000 7f4ef6a9c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef006fd60 con 0x7f4ef006c490 2019-11-28T11:57:55.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.712+0000 7f4ef6a9c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef0070030 con 0x7f4ef006ce60 2019-11-28T11:57:55.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.712+0000 7f4ef4838700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4ef006c490 0x7f4ef006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:55.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.712+0000 7f4ef583a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ef006ce60 0x7f4ef0164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.712+0000 7f4ef4838700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4ef006c490 0x7f4ef006c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:32882/0 (socket says 172.21.15.80:32882) 2019-11-28T11:57:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.712+0000 7f4ef583a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ef006ce60 0x7f4ef0164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:48486/0 (socket says 172.21.15.80:48486) 2019-11-28T11:57:55.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.712+0000 7f4ef4838700 1 -- 172.21.15.80:0/617039087 learned_addr learned my addr 172.21.15.80:0/617039087 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:55.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.712+0000 7f4ef5039700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f4ef006c0a0 0x7f4ef0072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:32852/0 (socket says 172.21.15.80:32852) 2019-11-28T11:57:55.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4ef4838700 1 -- 172.21.15.80:0/617039087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ef006ce60 msgr2=0x7f4ef0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:55.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4ef4838700 1 --2- 172.21.15.80:0/617039087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ef006ce60 0x7f4ef0164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:55.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4ef4838700 1 -- 172.21.15.80:0/617039087 >> v1:172.21.15.174:6789/0 conn(0x7f4ef006c0a0 legacy=0x7f4ef0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:55.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4ef4838700 1 -- 172.21.15.80:0/617039087 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef00706c0 con 0x7f4ef006c490 2019-11-28T11:57:55.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4eeffff700 1 -- 172.21.15.80:0/617039087 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714335372 0 0) 0x7f4ed8001400 con 0x7f4ef006c0a0 2019-11-28T11:57:55.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4ef583a700 1 --2- 172.21.15.80:0/617039087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ef006ce60 0x7f4ef0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:57:55.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4ef4838700 1 --2- 172.21.15.80:0/617039087 >> v2:172.21.15.174:3300/0 conn(0x7f4ef006c490 0x7f4ef006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4ee000f740 tx=0x7f4ee000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4ef4838700 1 --2- 172.21.15.80:0/617039087 >> v2:172.21.15.174:3300/0 conn(0x7f4ef006c490 0x7f4ef006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4ee000f740 tx=0x7f4ee000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4ef4838700 1 --2- 172.21.15.80:0/617039087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ef006c490 0x7f4ef006c920 secure :-1 s=READY pgs=1658 cs=0 l=1 rx=0x7f4ee000f740 tx=0x7f4ee000fae0).ready entity=mon.1 client_cookie=96118837d9c86daa server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:55.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4ef4838700 1 --2- 172.21.15.80:0/617039087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ef006c490 0x7f4ef006c920 secure :-1 s=THROTTLE_DONE pgs=1658 cs=0 l=1 rx=0x7f4ee000f740 tx=0x7f4ee000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4eeffff700 1 -- 172.21.15.80:0/617039087 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ee0000960 con 0x7f4ef006c490 2019-11-28T11:57:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4ef4838700 1 --2- 172.21.15.80:0/617039087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ef006c490 0x7f4ef006c920 secure :-1 s=THROTTLE_DONE pgs=1658 cs=0 l=1 rx=0x7f4ee000f740 tx=0x7f4ee000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4eeffff700 1 -- 172.21.15.80:0/617039087 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee0000c90 con 0x7f4ef006c490 2019-11-28T11:57:55.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4ef4838700 1 --2- 172.21.15.80:0/617039087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ef006c490 0x7f4ef006c920 secure :-1 s=THROTTLE_DONE pgs=1658 cs=0 l=1 rx=0x7f4ee000f740 tx=0x7f4ee000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4eeffff700 1 -- 172.21.15.80:0/617039087 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ee0007210 con 0x7f4ef006c490 2019-11-28T11:57:55.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4ef6a9c700 1 -- 172.21.15.80:0/617039087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ef006c490 msgr2=0x7f4ef006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:55.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.713+0000 7f4ef6a9c700 1 --2- 172.21.15.80:0/617039087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ef006c490 0x7f4ef006c920 secure :-1 s=READY pgs=1658 cs=0 l=1 rx=0x7f4ee000f740 tx=0x7f4ee000fae0).stop 2019-11-28T11:57:55.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.714+0000 7f4ef6a9c700 1 -- 172.21.15.80:0/617039087 shutdown_connections 2019-11-28T11:57:55.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.714+0000 7f4ef6a9c700 1 --2- 172.21.15.80:0/617039087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ef006ce60 0x7f4ef0164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:55.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.714+0000 7f4ef6a9c700 1 --2- 172.21.15.80:0/617039087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ef006c490 0x7f4ef006c920 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:55.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.714+0000 7f4ef6a9c700 1 -- 172.21.15.80:0/617039087 shutdown_connections 2019-11-28T11:57:55.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.714+0000 7f4ef6a9c700 1 -- 172.21.15.80:0/617039087 wait complete. 2019-11-28T11:57:55.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.714+0000 7f4ef6a9c700 1 -- 172.21.15.80:0/617039087 >> 172.21.15.80:0/617039087 conn(0x7f4ef0061cf0 msgr2=0x7f4ef0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:55.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.716+0000 7f4ef6a9c700 1 Processor -- start 2019-11-28T11:57:55.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.716+0000 7f4ef6a9c700 1 -- start start 2019-11-28T11:57:55.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.717+0000 7f4ef6a9c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4ef01239b0 0x7f4ef0116fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:55.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.717+0000 7f4ef6a9c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ef0117510 0x7f4ef0114db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.717+0000 7f4ef6a9c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef013aba0 con 0x7f4ef01152f0 2019-11-28T11:57:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.717+0000 7f4ef6a9c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef0112d10 con 0x7f4ef01239b0 2019-11-28T11:57:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.717+0000 7f4ef6a9c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef0112fe0 con 0x7f4ef0117510 2019-11-28T11:57:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.717+0000 7f4ef5039700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4ef01239b0 0x7f4ef0116fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4ef5039700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4ef01239b0 0x7f4ef0116fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46230/0 (socket says 172.21.15.80:46230) 2019-11-28T11:57:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4ef5039700 1 -- 172.21.15.80:0/2972028930 learned_addr learned my addr 172.21.15.80:0/2972028930 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:55.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4ef4838700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ef0117510 0x7f4ef0114db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4ef5039700 1 -- 172.21.15.80:0/2972028930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ef0117510 msgr2=0x7f4ef0114db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4ef5039700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ef0117510 0x7f4ef0114db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4ef5039700 1 -- 172.21.15.80:0/2972028930 >> v1:172.21.15.80:6789/0 conn(0x7f4ef01152f0 legacy=0x7f4ef01629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4ef5039700 1 -- 172.21.15.80:0/2972028930 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef0113670 con 0x7f4ef01239b0 2019-11-28T11:57:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4ef5039700 1 --2- 172.21.15.80:0/2972028930 >> v2:172.21.15.80:3300/0 conn(0x7f4ef01239b0 0x7f4ef0116fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4ed80107c0 tx=0x7f4ed80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4ef5039700 1 --2- 172.21.15.80:0/2972028930 >> v2:172.21.15.80:3300/0 conn(0x7f4ef01239b0 0x7f4ef0116fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4ed80107c0 tx=0x7f4ed80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4ef5039700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef01239b0 0x7f4ef0116fd0 secure :-1 s=READY pgs=2741 cs=0 l=1 rx=0x7f4ed80107c0 tx=0x7f4ed80105f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4ef5039700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef01239b0 0x7f4ef0116fd0 secure :-1 s=THROTTLE_DONE pgs=2741 cs=0 l=1 rx=0x7f4ed80107c0 tx=0x7f4ed80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4eedffb700 1 -- 172.21.15.80:0/2972028930 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ed8004540 con 0x7f4ef01239b0 2019-11-28T11:57:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4ef5039700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef01239b0 0x7f4ef0116fd0 secure :-1 s=THROTTLE_DONE pgs=2741 cs=0 l=1 rx=0x7f4ed80107c0 tx=0x7f4ed80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4ef5039700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef01239b0 0x7f4ef0116fd0 secure :-1 s=THROTTLE_DONE pgs=2741 cs=0 l=1 rx=0x7f4ed80107c0 tx=0x7f4ed80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4eedffb700 1 -- 172.21.15.80:0/2972028930 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed8000fe0 con 0x7f4ef01239b0 2019-11-28T11:57:55.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4ef6a9c700 1 -- 172.21.15.80:0/2972028930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef01139f0 con 0x7f4ef01239b0 2019-11-28T11:57:55.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4eedffb700 1 -- 172.21.15.80:0/2972028930 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ed8004b20 con 0x7f4ef01239b0 2019-11-28T11:57:55.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.718+0000 7f4ef6a9c700 1 -- 172.21.15.80:0/2972028930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef0113670 con 0x7f4ef01239b0 2019-11-28T11:57:55.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.719+0000 7f4ef5039700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef01239b0 0x7f4ef0116fd0 secure :-1 s=THROTTLE_DONE pgs=2741 cs=0 l=1 rx=0x7f4ed80107c0 tx=0x7f4ed80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.719+0000 7f4eedffb700 1 -- 172.21.15.80:0/2972028930 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4ed8004540 con 0x7f4ef01239b0 2019-11-28T11:57:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.719+0000 7f4ef5039700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef01239b0 0x7f4ef0116fd0 secure :-1 s=THROTTLE_DONE pgs=2741 cs=0 l=1 rx=0x7f4ed80107c0 tx=0x7f4ed80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.719+0000 7f4eedffb700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ed4018730 0x7f4ed401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.719+0000 7f4eedffb700 1 -- 172.21.15.80:0/2972028930 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4ed8031e60 con 0x7f4ef01239b0 2019-11-28T11:57:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.719+0000 7f4ef4838700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ed4018730 0x7f4ed401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:55.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.719+0000 7f4ef4838700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ed4018730 0x7f4ed401abc0 crc :-1 s=READY pgs=1139 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:55.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.726+0000 7f4ef6a9c700 1 -- 172.21.15.80:0/2972028930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef01139f0 con 0x7f4ef01239b0 2019-11-28T11:57:55.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.730+0000 7f4ef5039700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef01239b0 0x7f4ef0116fd0 secure :-1 s=THROTTLE_DONE pgs=2741 cs=0 l=1 rx=0x7f4ed80107c0 tx=0x7f4ed80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.730+0000 7f4eedffb700 1 -- 172.21.15.80:0/2972028930 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4ed802df70 con 0x7f4ef01239b0 2019-11-28T11:57:55.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.908+0000 7f4ef6a9c700 1 -- 172.21.15.80:0/2972028930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ef0113670 con 0x7f4ef01239b0 2019-11-28T11:57:55.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.909+0000 7f4ef5039700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef01239b0 0x7f4ef0116fd0 secure :-1 s=THROTTLE_DONE pgs=2741 cs=0 l=1 rx=0x7f4ed80107c0 tx=0x7f4ed80105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:55.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.909+0000 7f4eedffb700 1 -- 172.21.15.80:0/2972028930 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v212) v1 ==== 74+0+14884 (secure 0 0 0) 0x7f4ed802dbb0 con 0x7f4ef01239b0 2019-11-28T11:57:55.907 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:57:55.907 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":212,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:57:55.569274+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":35,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":34,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:57:53.888806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":35,"pool_name":"cephfs_data","create_time":"2019-11-28T11:57:54.582023+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:57:55.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.911+0000 7f4ef6a9c700 1 -- 172.21.15.80:0/2972028930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ed4018730 msgr2=0x7f4ed401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:55.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.911+0000 7f4ef6a9c700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ed4018730 0x7f4ed401abc0 crc :-1 s=READY pgs=1139 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:55.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.911+0000 7f4ef6a9c700 1 -- 172.21.15.80:0/2972028930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef01239b0 msgr2=0x7f4ef0116fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:55.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.911+0000 7f4ef6a9c700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef01239b0 0x7f4ef0116fd0 secure :-1 s=READY pgs=2741 cs=0 l=1 rx=0x7f4ed80107c0 tx=0x7f4ed80105f0).stop 2019-11-28T11:57:55.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.911+0000 7f4ef6a9c700 1 -- 172.21.15.80:0/2972028930 shutdown_connections 2019-11-28T11:57:55.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.911+0000 7f4ef6a9c700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ed4018730 0x7f4ed401abc0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:55.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.911+0000 7f4ef6a9c700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ef0117510 0x7f4ef0114db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:55.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.911+0000 7f4ef6a9c700 1 --2- 172.21.15.80:0/2972028930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef01239b0 0x7f4ef0116fd0 unknown :-1 s=CLOSED pgs=2741 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:55.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.911+0000 7f4ef6a9c700 1 -- 172.21.15.80:0/2972028930 shutdown_connections 2019-11-28T11:57:55.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.911+0000 7f4ef6a9c700 1 -- 172.21.15.80:0/2972028930 wait complete. 2019-11-28T11:57:55.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:55.911+0000 7f4ef6a9c700 1 -- 172.21.15.80:0/2972028930 >> 172.21.15.80:0/2972028930 conn(0x7f4ef01427c0 msgr2=0x7f4ef014fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:55.918 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:57:56.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.041+0000 7f734d4e4700 1 Processor -- start 2019-11-28T11:57:56.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.041+0000 7f734d4e4700 1 -- start start 2019-11-28T11:57:56.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.042+0000 7f734d4e4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734806c0a0 0x7f7348072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:56.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.042+0000 7f734d4e4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f73480734e0 0x7f7348071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:56.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.042+0000 7f734d4e4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734806db00 con 0x7f7348072360 2019-11-28T11:57:56.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.042+0000 7f734d4e4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734806f330 con 0x7f73480734e0 2019-11-28T11:57:56.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.042+0000 7f734d4e4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73480706c0 con 0x7f734806c0a0 2019-11-28T11:57:56.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.042+0000 7f7347fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7348072360 0x7f734806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45556/0 (socket says 172.21.15.80:45556) 2019-11-28T11:57:56.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.042+0000 7f7347fff700 1 -- 172.21.15.80:0/4113584059 learned_addr learned my addr 172.21.15.80:0/4113584059 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:56.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.042+0000 7f7346ffd700 1 --2- 172.21.15.80:0/4113584059 >> v2:172.21.15.174:3300/0 conn(0x7f73480734e0 0x7f7348071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:56.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.042+0000 7f73477fe700 1 --2- 172.21.15.80:0/4113584059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734806c0a0 0x7f7348072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:56.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.042+0000 7f73467fc700 1 -- 172.21.15.80:0/4113584059 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252136045 0 0) 0x7f7340001150 con 0x7f7348072360 2019-11-28T11:57:56.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.042+0000 7f73467fc700 1 -- 172.21.15.80:0/4113584059 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7328002e80 con 0x7f7348072360 2019-11-28T11:57:56.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.042+0000 7f7346ffd700 1 -- 172.21.15.80:0/4113584059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734806c0a0 msgr2=0x7f7348072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:56.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.042+0000 7f7346ffd700 1 --2- 172.21.15.80:0/4113584059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734806c0a0 0x7f7348072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:56.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.043+0000 7f7346ffd700 1 -- 172.21.15.80:0/4113584059 >> v1:172.21.15.80:6789/0 conn(0x7f7348072360 legacy=0x7f734806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:56.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.043+0000 7f7346ffd700 1 -- 172.21.15.80:0/4113584059 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7348070a40 con 0x7f73480734e0 2019-11-28T11:57:56.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.043+0000 7f73477fe700 1 --2- 172.21.15.80:0/4113584059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734806c0a0 0x7f7348072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:57:56.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.043+0000 7f7346ffd700 1 --2- 172.21.15.80:0/4113584059 >> v2:172.21.15.174:3300/0 conn(0x7f73480734e0 0x7f7348071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f733000b2d0 tx=0x7f733000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.043+0000 7f7346ffd700 1 --2- 172.21.15.80:0/4113584059 >> v2:172.21.15.174:3300/0 conn(0x7f73480734e0 0x7f7348071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f733000b2d0 tx=0x7f733000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.043+0000 7f7346ffd700 1 --2- 172.21.15.80:0/4113584059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73480734e0 0x7f7348071e20 secure :-1 s=READY pgs=1659 cs=0 l=1 rx=0x7f733000b2d0 tx=0x7f733000bae0).ready entity=mon.1 client_cookie=dff6bed280fc9837 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:56.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.043+0000 7f7346ffd700 1 --2- 172.21.15.80:0/4113584059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73480734e0 0x7f7348071e20 secure :-1 s=THROTTLE_DONE pgs=1659 cs=0 l=1 rx=0x7f733000b2d0 tx=0x7f733000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.043+0000 7f73467fc700 1 -- 172.21.15.80:0/4113584059 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7330007590 con 0x7f73480734e0 2019-11-28T11:57:56.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.043+0000 7f7346ffd700 1 --2- 172.21.15.80:0/4113584059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73480734e0 0x7f7348071e20 secure :-1 s=THROTTLE_DONE pgs=1659 cs=0 l=1 rx=0x7f733000b2d0 tx=0x7f733000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.043+0000 7f7346ffd700 1 --2- 172.21.15.80:0/4113584059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73480734e0 0x7f7348071e20 secure :-1 s=THROTTLE_DONE pgs=1659 cs=0 l=1 rx=0x7f733000b2d0 tx=0x7f733000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.043+0000 7f73467fc700 1 -- 172.21.15.80:0/4113584059 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7330009d30 con 0x7f73480734e0 2019-11-28T11:57:56.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.043+0000 7f73467fc700 1 -- 172.21.15.80:0/4113584059 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f733000a400 con 0x7f73480734e0 2019-11-28T11:57:56.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.043+0000 7f734d4e4700 1 -- 172.21.15.80:0/4113584059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73480734e0 msgr2=0x7f7348071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:56.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.043+0000 7f734d4e4700 1 --2- 172.21.15.80:0/4113584059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73480734e0 0x7f7348071e20 secure :-1 s=READY pgs=1659 cs=0 l=1 rx=0x7f733000b2d0 tx=0x7f733000bae0).stop 2019-11-28T11:57:56.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.044+0000 7f734d4e4700 1 -- 172.21.15.80:0/4113584059 shutdown_connections 2019-11-28T11:57:56.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.044+0000 7f734d4e4700 1 --2- 172.21.15.80:0/4113584059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73480734e0 0x7f7348071e20 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:56.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.044+0000 7f734d4e4700 1 --2- 172.21.15.80:0/4113584059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734806c0a0 0x7f7348072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:56.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.044+0000 7f734d4e4700 1 -- 172.21.15.80:0/4113584059 shutdown_connections 2019-11-28T11:57:56.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.044+0000 7f734d4e4700 1 -- 172.21.15.80:0/4113584059 wait complete. 2019-11-28T11:57:56.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.044+0000 7f734d4e4700 1 -- 172.21.15.80:0/4113584059 >> 172.21.15.80:0/4113584059 conn(0x7f7348061cf0 msgr2=0x7f7348064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:56.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.046+0000 7f734d4e4700 1 Processor -- start 2019-11-28T11:57:56.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.046+0000 7f734d4e4700 1 -- start start 2019-11-28T11:57:56.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.047+0000 7f734d4e4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f734813a780 0x7f734812d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:56.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.047+0000 7f734d4e4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734812d9c0 0x7f734812c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:56.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.047+0000 7f734d4e4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7348139a60 con 0x7f734812c840 2019-11-28T11:57:56.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.047+0000 7f734d4e4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734812a260 con 0x7f734813a780 2019-11-28T11:57:56.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.047+0000 7f734d4e4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734812a530 con 0x7f734812d9c0 2019-11-28T11:57:56.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.047+0000 7f7346ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734812d9c0 0x7f734812c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:56.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.047+0000 7f7346ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734812d9c0 0x7f734812c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:48504/0 (socket says 172.21.15.80:48504) 2019-11-28T11:57:56.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.047+0000 7f7346ffd700 1 -- 172.21.15.80:0/498656431 learned_addr learned my addr 172.21.15.80:0/498656431 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:56.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.047+0000 7f73477fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f734813a780 0x7f734812d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:56.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.048+0000 7f7346ffd700 1 -- 172.21.15.80:0/498656431 >> v2:172.21.15.174:3300/0 conn(0x7f734813a780 msgr2=0x7f734812d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:56.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.048+0000 7f7346ffd700 1 --2- 172.21.15.80:0/498656431 >> v2:172.21.15.174:3300/0 conn(0x7f734813a780 0x7f734812d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:56.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.048+0000 7f7346ffd700 1 -- 172.21.15.80:0/498656431 >> v1:172.21.15.174:6789/0 conn(0x7f734812c840 legacy=0x7f73481281b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:56.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.048+0000 7f7346ffd700 1 -- 172.21.15.80:0/498656431 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734812abc0 con 0x7f734812d9c0 2019-11-28T11:57:56.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.048+0000 7f7346ffd700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734812d9c0 0x7f734812c300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73300107f0 tx=0x7f73300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.048+0000 7f7346ffd700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734812d9c0 0x7f734812c300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73300107f0 tx=0x7f73300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.048+0000 7f7346ffd700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734812d9c0 0x7f734812c300 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7f73300107f0 tx=0x7f73300105f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:56.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.048+0000 7f7346ffd700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734812d9c0 0x7f734812c300 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f73300107f0 tx=0x7f73300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.048+0000 7f7346ffd700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734812d9c0 0x7f734812c300 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f73300107f0 tx=0x7f73300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.048+0000 7f733ffff700 1 -- 172.21.15.80:0/498656431 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7330000cc0 con 0x7f734812d9c0 2019-11-28T11:57:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.048+0000 7f7346ffd700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734812d9c0 0x7f734812c300 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f73300107f0 tx=0x7f73300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.048+0000 7f733ffff700 1 -- 172.21.15.80:0/498656431 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733000b700 con 0x7f734812d9c0 2019-11-28T11:57:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.048+0000 7f734d4e4700 1 -- 172.21.15.80:0/498656431 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734812af40 con 0x7f734812d9c0 2019-11-28T11:57:56.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.048+0000 7f733ffff700 1 -- 172.21.15.80:0/498656431 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f733000a0e0 con 0x7f734812d9c0 2019-11-28T11:57:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.048+0000 7f734d4e4700 1 -- 172.21.15.80:0/498656431 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734812abc0 con 0x7f734812d9c0 2019-11-28T11:57:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.048+0000 7f7346ffd700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734812d9c0 0x7f734812c300 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f73300107f0 tx=0x7f73300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.049+0000 7f733ffff700 1 -- 172.21.15.80:0/498656431 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f733000a5b0 con 0x7f734812d9c0 2019-11-28T11:57:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.049+0000 7f7346ffd700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734812d9c0 0x7f734812c300 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f73300107f0 tx=0x7f73300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.049+0000 7f733ffff700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7320018730 0x7f732001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:56.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.049+0000 7f733ffff700 1 -- 172.21.15.80:0/498656431 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7330031e90 con 0x7f734812d9c0 2019-11-28T11:57:56.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.049+0000 7f73477fe700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7320018730 0x7f732001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:56.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.049+0000 7f73477fe700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7320018730 0x7f732001abc0 crc :-1 s=READY pgs=1140 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:56.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.056+0000 7f734d4e4700 1 -- 172.21.15.80:0/498656431 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734812af40 con 0x7f734812d9c0 2019-11-28T11:57:56.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.060+0000 7f7346ffd700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734812d9c0 0x7f734812c300 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f73300107f0 tx=0x7f73300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.060+0000 7f733ffff700 1 -- 172.21.15.80:0/498656431 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f733000a290 con 0x7f734812d9c0 2019-11-28T11:57:56.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.233+0000 7f734d4e4700 1 -- 172.21.15.80:0/498656431 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f734812abc0 con 0x7f734812d9c0 2019-11-28T11:57:56.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.234+0000 7f7346ffd700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734812d9c0 0x7f734812c300 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f73300107f0 tx=0x7f73300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.234+0000 7f733ffff700 1 -- 172.21.15.80:0/498656431 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v212) v1 ==== 74+0+14884 (secure 0 0 0) 0x7f733000a4a0 con 0x7f734812d9c0 2019-11-28T11:57:56.231 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:57:56.232 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":212,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:57:55.569274+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":35,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":34,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:57:53.888806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":35,"pool_name":"cephfs_data","create_time":"2019-11-28T11:57:54.582023+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:57:56.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.236+0000 7f734d4e4700 1 -- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7320018730 msgr2=0x7f732001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:56.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.236+0000 7f734d4e4700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7320018730 0x7f732001abc0 crc :-1 s=READY pgs=1140 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:56.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.236+0000 7f734d4e4700 1 -- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734812d9c0 msgr2=0x7f734812c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:56.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.236+0000 7f734d4e4700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734812d9c0 0x7f734812c300 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7f73300107f0 tx=0x7f73300105f0).stop 2019-11-28T11:57:56.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.236+0000 7f734d4e4700 1 -- 172.21.15.80:0/498656431 shutdown_connections 2019-11-28T11:57:56.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.236+0000 7f734d4e4700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7320018730 0x7f732001abc0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:56.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.236+0000 7f734d4e4700 1 --2- 172.21.15.80:0/498656431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f734812d9c0 0x7f734812c300 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:56.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.236+0000 7f734d4e4700 1 --2- 172.21.15.80:0/498656431 >> v2:172.21.15.174:3300/0 conn(0x7f734813a780 0x7f734812d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:56.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.236+0000 7f734d4e4700 1 -- 172.21.15.80:0/498656431 shutdown_connections 2019-11-28T11:57:56.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.236+0000 7f734d4e4700 1 -- 172.21.15.80:0/498656431 wait complete. 2019-11-28T11:57:56.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.236+0000 7f734d4e4700 1 -- 172.21.15.80:0/498656431 >> 172.21.15.80:0/498656431 conn(0x7f7348127dc0 msgr2=0x7f7348141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:56.246 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:57:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.372+0000 7f34e681d700 1 Processor -- start 2019-11-28T11:57:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.372+0000 7f34e681d700 1 -- start start 2019-11-28T11:57:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.373+0000 7f34e681d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34e015f100 0x7f34e006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.373+0000 7f34e681d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e006db60 con 0x7f34e006c2f0 2019-11-28T11:57:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.373+0000 7f34e681d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e006e060 con 0x7f34e015ed10 2019-11-28T11:57:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.373+0000 7f34e681d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e006fe00 con 0x7f34e015f100 2019-11-28T11:57:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.373+0000 7f34dffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34e015f100 0x7f34e006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.373+0000 7f34dffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34e015f100 0x7f34e006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46256/0 (socket says 172.21.15.80:46256) 2019-11-28T11:57:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.373+0000 7f34e55bb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f34e006c2f0 0x7f34e006c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45570/0 (socket says 172.21.15.80:45570) 2019-11-28T11:57:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.373+0000 7f34dffff700 1 -- 172.21.15.80:0/571967333 learned_addr learned my addr 172.21.15.80:0/571967333 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:56.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.374+0000 7f34df7fe700 1 -- 172.21.15.80:0/571967333 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242422790 0 0) 0x7f34d0001080 con 0x7f34e015ed10 2019-11-28T11:57:56.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.374+0000 7f34dffff700 1 -- 172.21.15.80:0/571967333 >> v1:172.21.15.174:6789/0 conn(0x7f34e015ed10 legacy=0x7f34e0073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:56.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.374+0000 7f34dffff700 1 -- 172.21.15.80:0/571967333 >> v1:172.21.15.80:6789/0 conn(0x7f34e006c2f0 legacy=0x7f34e006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:56.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.374+0000 7f34dffff700 1 -- 172.21.15.80:0/571967333 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e0070760 con 0x7f34e015f100 2019-11-28T11:57:56.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.374+0000 7f34dffff700 1 --2- 172.21.15.80:0/571967333 >> v2:172.21.15.80:3300/0 conn(0x7f34e015f100 0x7f34e006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f34d400f740 tx=0x7f34d400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.374+0000 7f34dffff700 1 --2- 172.21.15.80:0/571967333 >> v2:172.21.15.80:3300/0 conn(0x7f34e015f100 0x7f34e006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f34d400f740 tx=0x7f34d400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.374+0000 7f34dffff700 1 --2- 172.21.15.80:0/571967333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e015f100 0x7f34e006bdb0 secure :-1 s=READY pgs=2744 cs=0 l=1 rx=0x7f34d400f740 tx=0x7f34d400fae0).ready entity=mon.0 client_cookie=97909fc051901628 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:56.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.374+0000 7f34dffff700 1 --2- 172.21.15.80:0/571967333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e015f100 0x7f34e006bdb0 secure :-1 s=THROTTLE_DONE pgs=2744 cs=0 l=1 rx=0x7f34d400f740 tx=0x7f34d400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.374+0000 7f34df7fe700 1 -- 172.21.15.80:0/571967333 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34d4000960 con 0x7f34e015f100 2019-11-28T11:57:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.374+0000 7f34dffff700 1 --2- 172.21.15.80:0/571967333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e015f100 0x7f34e006bdb0 secure :-1 s=THROTTLE_DONE pgs=2744 cs=0 l=1 rx=0x7f34d400f740 tx=0x7f34d400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.374+0000 7f34dffff700 1 --2- 172.21.15.80:0/571967333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e015f100 0x7f34e006bdb0 secure :-1 s=THROTTLE_DONE pgs=2744 cs=0 l=1 rx=0x7f34d400f740 tx=0x7f34d400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.374+0000 7f34df7fe700 1 -- 172.21.15.80:0/571967333 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d4000c90 con 0x7f34e015f100 2019-11-28T11:57:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.374+0000 7f34df7fe700 1 -- 172.21.15.80:0/571967333 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34d4000960 con 0x7f34e015f100 2019-11-28T11:57:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.374+0000 7f34e681d700 1 -- 172.21.15.80:0/571967333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e015f100 msgr2=0x7f34e006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.374+0000 7f34e681d700 1 --2- 172.21.15.80:0/571967333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e015f100 0x7f34e006bdb0 secure :-1 s=READY pgs=2744 cs=0 l=1 rx=0x7f34d400f740 tx=0x7f34d400fae0).stop 2019-11-28T11:57:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.375+0000 7f34e681d700 1 -- 172.21.15.80:0/571967333 shutdown_connections 2019-11-28T11:57:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.375+0000 7f34e681d700 1 --2- 172.21.15.80:0/571967333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e015f100 0x7f34e006bdb0 unknown :-1 s=CLOSED pgs=2744 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.375+0000 7f34e681d700 1 -- 172.21.15.80:0/571967333 shutdown_connections 2019-11-28T11:57:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.375+0000 7f34e681d700 1 -- 172.21.15.80:0/571967333 wait complete. 2019-11-28T11:57:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.375+0000 7f34e681d700 1 -- 172.21.15.80:0/571967333 >> 172.21.15.80:0/571967333 conn(0x7f34e0061d20 msgr2=0x7f34e00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.377+0000 7f34e681d700 1 Processor -- start 2019-11-28T11:57:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.377+0000 7f34e681d700 1 -- start start 2019-11-28T11:57:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.378+0000 7f34e681d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34e01079b0 0x7f34e0107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.378+0000 7f34e681d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e0148e00 con 0x7f34e0108380 2019-11-28T11:57:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.378+0000 7f34e681d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e0108b10 con 0x7f34e0148320 2019-11-28T11:57:56.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.378+0000 7f34e681d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e013aa20 con 0x7f34e01079b0 2019-11-28T11:57:56.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.378+0000 7f34dffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34e01079b0 0x7f34e0107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:56.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.378+0000 7f34dffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34e01079b0 0x7f34e0107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46260/0 (socket says 172.21.15.80:46260) 2019-11-28T11:57:56.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.378+0000 7f34dffff700 1 -- 172.21.15.80:0/2391501512 learned_addr learned my addr 172.21.15.80:0/2391501512 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:56.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.378+0000 7f34e55bb700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f34e0108380 0x7f34e0168d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45576/0 (socket says 172.21.15.80:45576) 2019-11-28T11:57:56.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.379+0000 7f34dffff700 1 -- 172.21.15.80:0/2391501512 >> v1:172.21.15.174:6789/0 conn(0x7f34e0148320 legacy=0x7f34e010ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:56.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.379+0000 7f34dffff700 1 -- 172.21.15.80:0/2391501512 >> v1:172.21.15.80:6789/0 conn(0x7f34e0108380 legacy=0x7f34e0168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:56.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.379+0000 7f34dd7fa700 1 -- 172.21.15.80:0/2391501512 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793339534 0 0) 0x7f34d8000d30 con 0x7f34e0108380 2019-11-28T11:57:56.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.379+0000 7f34dffff700 1 -- 172.21.15.80:0/2391501512 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e010c490 con 0x7f34e01079b0 2019-11-28T11:57:56.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.379+0000 7f34dffff700 1 --2- 172.21.15.80:0/2391501512 >> v2:172.21.15.80:3300/0 conn(0x7f34e01079b0 0x7f34e0107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f34d4010420 tx=0x7f34d40107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.379+0000 7f34dffff700 1 --2- 172.21.15.80:0/2391501512 >> v2:172.21.15.80:3300/0 conn(0x7f34e01079b0 0x7f34e0107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f34d4010420 tx=0x7f34d40107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.379+0000 7f34dffff700 1 --2- 172.21.15.80:0/2391501512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e01079b0 0x7f34e0107e40 secure :-1 s=READY pgs=2746 cs=0 l=1 rx=0x7f34d4010420 tx=0x7f34d40107c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:56.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.379+0000 7f34dffff700 1 --2- 172.21.15.80:0/2391501512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e01079b0 0x7f34e0107e40 secure :-1 s=THROTTLE_DONE pgs=2746 cs=0 l=1 rx=0x7f34d4010420 tx=0x7f34d40107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.379+0000 7f34dd7fa700 1 -- 172.21.15.80:0/2391501512 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34d4000f50 con 0x7f34e01079b0 2019-11-28T11:57:56.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.379+0000 7f34dffff700 1 --2- 172.21.15.80:0/2391501512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e01079b0 0x7f34e0107e40 secure :-1 s=THROTTLE_DONE pgs=2746 cs=0 l=1 rx=0x7f34d4010420 tx=0x7f34d40107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.379+0000 7f34e681d700 1 -- 172.21.15.80:0/2391501512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e010c810 con 0x7f34e01079b0 2019-11-28T11:57:56.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.379+0000 7f34dd7fa700 1 -- 172.21.15.80:0/2391501512 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d4000940 con 0x7f34e01079b0 2019-11-28T11:57:56.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.379+0000 7f34dffff700 1 --2- 172.21.15.80:0/2391501512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e01079b0 0x7f34e0107e40 secure :-1 s=THROTTLE_DONE pgs=2746 cs=0 l=1 rx=0x7f34d4010420 tx=0x7f34d40107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.379+0000 7f34dd7fa700 1 -- 172.21.15.80:0/2391501512 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34d4001140 con 0x7f34e01079b0 2019-11-28T11:57:56.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.379+0000 7f34e681d700 1 -- 172.21.15.80:0/2391501512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e0108820 con 0x7f34e01079b0 2019-11-28T11:57:56.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.379+0000 7f34dffff700 1 --2- 172.21.15.80:0/2391501512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e01079b0 0x7f34e0107e40 secure :-1 s=THROTTLE_DONE pgs=2746 cs=0 l=1 rx=0x7f34d4010420 tx=0x7f34d40107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.380+0000 7f34dd7fa700 1 -- 172.21.15.80:0/2391501512 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f34d4000d60 con 0x7f34e01079b0 2019-11-28T11:57:56.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.380+0000 7f34dffff700 1 --2- 172.21.15.80:0/2391501512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e01079b0 0x7f34e0107e40 secure :-1 s=THROTTLE_DONE pgs=2746 cs=0 l=1 rx=0x7f34d4010420 tx=0x7f34d40107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.380+0000 7f34dd7fa700 1 --2- 172.21.15.80:0/2391501512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f34c0018730 0x7f34c001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:56.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.380+0000 7f34dd7fa700 1 -- 172.21.15.80:0/2391501512 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f34d4031ba0 con 0x7f34e01079b0 2019-11-28T11:57:56.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.380+0000 7f34e4dba700 1 --2- 172.21.15.80:0/2391501512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f34c0018730 0x7f34c001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:56.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.380+0000 7f34e4dba700 1 --2- 172.21.15.80:0/2391501512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f34c0018730 0x7f34c001abc0 crc :-1 s=READY pgs=1141 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:56.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.388+0000 7f34e681d700 1 -- 172.21.15.80:0/2391501512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e010c490 con 0x7f34e01079b0 2019-11-28T11:57:56.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.391+0000 7f34dffff700 1 --2- 172.21.15.80:0/2391501512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e01079b0 0x7f34e0107e40 secure :-1 s=THROTTLE_DONE pgs=2746 cs=0 l=1 rx=0x7f34d4010420 tx=0x7f34d40107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:56.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.391+0000 7f34dd7fa700 1 -- 172.21.15.80:0/2391501512 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f34d4000b30 con 0x7f34e01079b0 2019-11-28T11:57:56.563 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:56.565+0000 7f34e681d700 1 -- 172.21.15.80:0/2391501512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f34e010c810 con 0x7f34e01079b0 2019-11-28T11:57:57.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.229+0000 7f34dffff700 1 --2- 172.21.15.80:0/2391501512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e01079b0 0x7f34e0107e40 secure :-1 s=THROTTLE_DONE pgs=2746 cs=0 l=1 rx=0x7f34d4010420 tx=0x7f34d40107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.229+0000 7f34dd7fa700 1 -- 172.21.15.80:0/2391501512 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v173) v1 ==== 118+0+0 (secure 0 0 0) 0x7f34d4000d40 con 0x7f34e01079b0 2019-11-28T11:57:57.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.232+0000 7f34e681d700 1 -- 172.21.15.80:0/2391501512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f34c0018730 msgr2=0x7f34c001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:57.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.232+0000 7f34e681d700 1 --2- 172.21.15.80:0/2391501512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f34c0018730 0x7f34c001abc0 crc :-1 s=READY pgs=1141 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:57.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.232+0000 7f34e681d700 1 -- 172.21.15.80:0/2391501512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e01079b0 msgr2=0x7f34e0107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:57.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.232+0000 7f34e681d700 1 --2- 172.21.15.80:0/2391501512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e01079b0 0x7f34e0107e40 secure :-1 s=READY pgs=2746 cs=0 l=1 rx=0x7f34d4010420 tx=0x7f34d40107c0).stop 2019-11-28T11:57:57.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.233+0000 7f34e681d700 1 -- 172.21.15.80:0/2391501512 shutdown_connections 2019-11-28T11:57:57.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.233+0000 7f34e681d700 1 --2- 172.21.15.80:0/2391501512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34e01079b0 0x7f34e0107e40 unknown :-1 s=CLOSED pgs=2746 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:57.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.233+0000 7f34e681d700 1 --2- 172.21.15.80:0/2391501512 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f34c0018730 0x7f34c001abc0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:57.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.233+0000 7f34e681d700 1 -- 172.21.15.80:0/2391501512 shutdown_connections 2019-11-28T11:57:57.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.233+0000 7f34e681d700 1 -- 172.21.15.80:0/2391501512 wait complete. 2019-11-28T11:57:57.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.233+0000 7f34e681d700 1 -- 172.21.15.80:0/2391501512 >> 172.21.15.80:0/2391501512 conn(0x7f34e015e2d0 msgr2=0x7f34e0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:57.239 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:57:57.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.363+0000 7f0314dad700 1 Processor -- start 2019-11-28T11:57:57.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.363+0000 7f0314dad700 1 -- start start 2019-11-28T11:57:57.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.364+0000 7f0314dad700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031006c490 0x7f031006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:57.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.364+0000 7f0314dad700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031006db00 con 0x7f031006c0a0 2019-11-28T11:57:57.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.364+0000 7f0314dad700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031006e000 con 0x7f031006ce60 2019-11-28T11:57:57.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.364+0000 7f0314dad700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031006fd60 con 0x7f031006c490 2019-11-28T11:57:57.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.364+0000 7f030ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f031006c0a0 0x7f0310072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45582/0 (socket says 172.21.15.80:45582) 2019-11-28T11:57:57.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.364+0000 7f030ed9d700 1 -- 172.21.15.80:0/3096406573 learned_addr learned my addr 172.21.15.80:0/3096406573 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:57.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.364+0000 7f030e59c700 1 --2- 172.21.15.80:0/3096406573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031006c490 0x7f031006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:57.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030dd9b700 1 -- 172.21.15.80:0/3096406573 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196538485 0 0) 0x7f02f80014d0 con 0x7f031006c0a0 2019-11-28T11:57:57.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030dd9b700 1 -- 172.21.15.80:0/3096406573 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02f0002e80 con 0x7f031006c0a0 2019-11-28T11:57:57.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030dd9b700 1 -- 172.21.15.80:0/3096406573 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937225776 0 0) 0x7f03080009b0 con 0x7f031006ce60 2019-11-28T11:57:57.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030dd9b700 1 -- 172.21.15.80:0/3096406573 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02f0004220 con 0x7f031006ce60 2019-11-28T11:57:57.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030dd9b700 1 -- 172.21.15.80:0/3096406573 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2711272517 0 0) 0x7f02f80014b0 con 0x7f031006c0a0 2019-11-28T11:57:57.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030e59c700 1 -- 172.21.15.80:0/3096406573 >> v1:172.21.15.174:6789/0 conn(0x7f031006ce60 legacy=0x7f0310164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:57.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030e59c700 1 -- 172.21.15.80:0/3096406573 >> v1:172.21.15.80:6789/0 conn(0x7f031006c0a0 legacy=0x7f0310072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:57.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030e59c700 1 -- 172.21.15.80:0/3096406573 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03100706c0 con 0x7f031006c490 2019-11-28T11:57:57.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030e59c700 1 --2- 172.21.15.80:0/3096406573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031006c490 0x7f031006c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f030000af50 tx=0x7f030000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030e59c700 1 --2- 172.21.15.80:0/3096406573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031006c490 0x7f031006c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f030000af50 tx=0x7f030000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030e59c700 1 --2- 172.21.15.80:0/3096406573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031006c490 0x7f031006c920 secure :-1 s=READY pgs=399 cs=0 l=1 rx=0x7f030000af50 tx=0x7f030000b760).ready entity=mon.2 client_cookie=7d33c7eeb048e0c2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030e59c700 1 --2- 172.21.15.80:0/3096406573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031006c490 0x7f031006c920 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7f030000af50 tx=0x7f030000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030dd9b700 1 -- 172.21.15.80:0/3096406573 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0300000960 con 0x7f031006c490 2019-11-28T11:57:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030e59c700 1 --2- 172.21.15.80:0/3096406573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031006c490 0x7f031006c920 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7f030000af50 tx=0x7f030000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030e59c700 1 --2- 172.21.15.80:0/3096406573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031006c490 0x7f031006c920 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7f030000af50 tx=0x7f030000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030dd9b700 1 -- 172.21.15.80:0/3096406573 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0300009860 con 0x7f031006c490 2019-11-28T11:57:57.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f030dd9b700 1 -- 172.21.15.80:0/3096406573 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0300000960 con 0x7f031006c490 2019-11-28T11:57:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f0314dad700 1 -- 172.21.15.80:0/3096406573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031006c490 msgr2=0x7f031006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.365+0000 7f0314dad700 1 --2- 172.21.15.80:0/3096406573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031006c490 0x7f031006c920 secure :-1 s=READY pgs=399 cs=0 l=1 rx=0x7f030000af50 tx=0x7f030000b760).stop 2019-11-28T11:57:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.366+0000 7f0314dad700 1 -- 172.21.15.80:0/3096406573 shutdown_connections 2019-11-28T11:57:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.366+0000 7f0314dad700 1 --2- 172.21.15.80:0/3096406573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f031006c490 0x7f031006c920 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.366+0000 7f0314dad700 1 -- 172.21.15.80:0/3096406573 shutdown_connections 2019-11-28T11:57:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.366+0000 7f0314dad700 1 -- 172.21.15.80:0/3096406573 wait complete. 2019-11-28T11:57:57.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.366+0000 7f0314dad700 1 -- 172.21.15.80:0/3096406573 >> 172.21.15.80:0/3096406573 conn(0x7f0310061cf0 msgr2=0x7f0310064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:57.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.368+0000 7f0314dad700 1 Processor -- start 2019-11-28T11:57:57.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.369+0000 7f0314dad700 1 -- start start 2019-11-28T11:57:57.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.369+0000 7f0314dad700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0310112fb0 0x7f0310113440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:57.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.369+0000 7f0314dad700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0310113980 0x7f0310168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:57.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.369+0000 7f0314dad700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031013fc20 con 0x7f031013f580 2019-11-28T11:57:57.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.369+0000 7f0314dad700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03101236b0 con 0x7f0310113980 2019-11-28T11:57:57.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.369+0000 7f0314dad700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0310123980 con 0x7f0310112fb0 2019-11-28T11:57:57.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.369+0000 7f030ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f031013f580 0x7f0310114130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45588/0 (socket says 172.21.15.80:45588) 2019-11-28T11:57:57.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.369+0000 7f030ed9d700 1 -- 172.21.15.80:0/2611474085 learned_addr learned my addr 172.21.15.80:0/2611474085 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f030f59e700 1 --2- 172.21.15.80:0/2611474085 >> v2:172.21.15.80:3300/0 conn(0x7f0310113980 0x7f0310168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f030e59c700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0310112fb0 0x7f0310113440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f03077fe700 1 -- 172.21.15.80:0/2611474085 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988306299 0 0) 0x7f02f80012c0 con 0x7f031013f580 2019-11-28T11:57:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f03077fe700 1 -- 172.21.15.80:0/2611474085 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02e8002e80 con 0x7f031013f580 2019-11-28T11:57:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f030f59e700 1 -- 172.21.15.80:0/2611474085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0310112fb0 msgr2=0x7f0310113440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f030f59e700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0310112fb0 0x7f0310113440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f030f59e700 1 -- 172.21.15.80:0/2611474085 >> v1:172.21.15.80:6789/0 conn(0x7f031013f580 legacy=0x7f0310114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f030f59e700 1 -- 172.21.15.80:0/2611474085 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0310113e00 con 0x7f0310113980 2019-11-28T11:57:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f030f59e700 1 --2- 172.21.15.80:0/2611474085 >> v2:172.21.15.80:3300/0 conn(0x7f0310113980 0x7f0310168a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0308010390 tx=0x7f03080101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f030f59e700 1 --2- 172.21.15.80:0/2611474085 >> v2:172.21.15.80:3300/0 conn(0x7f0310113980 0x7f0310168a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0308010390 tx=0x7f03080101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f030f59e700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0310113980 0x7f0310168a20 secure :-1 s=READY pgs=2749 cs=0 l=1 rx=0x7f0308010390 tx=0x7f03080101c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f030f59e700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0310113980 0x7f0310168a20 secure :-1 s=THROTTLE_DONE pgs=2749 cs=0 l=1 rx=0x7f0308010390 tx=0x7f03080101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f03077fe700 1 -- 172.21.15.80:0/2611474085 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0308009b80 con 0x7f0310113980 2019-11-28T11:57:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f030f59e700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0310113980 0x7f0310168a20 secure :-1 s=THROTTLE_DONE pgs=2749 cs=0 l=1 rx=0x7f0308010390 tx=0x7f03080101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f03077fe700 1 -- 172.21.15.80:0/2611474085 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0308000a20 con 0x7f0310113980 2019-11-28T11:57:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f030f59e700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0310113980 0x7f0310168a20 secure :-1 s=THROTTLE_DONE pgs=2749 cs=0 l=1 rx=0x7f0308010390 tx=0x7f03080101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f03077fe700 1 -- 172.21.15.80:0/2611474085 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0308009ce0 con 0x7f0310113980 2019-11-28T11:57:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f0314dad700 1 -- 172.21.15.80:0/2611474085 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0310113e00 con 0x7f0310113980 2019-11-28T11:57:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.370+0000 7f0314dad700 1 -- 172.21.15.80:0/2611474085 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0310113e00 con 0x7f0310113980 2019-11-28T11:57:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.371+0000 7f030f59e700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0310113980 0x7f0310168a20 secure :-1 s=THROTTLE_DONE pgs=2749 cs=0 l=1 rx=0x7f0308010390 tx=0x7f03080101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.371+0000 7f03077fe700 1 -- 172.21.15.80:0/2611474085 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0308009930 con 0x7f0310113980 2019-11-28T11:57:57.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.371+0000 7f030f59e700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0310113980 0x7f0310168a20 secure :-1 s=THROTTLE_DONE pgs=2749 cs=0 l=1 rx=0x7f0308010390 tx=0x7f03080101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.371+0000 7f03077fe700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f02e8018770 0x7f02e801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:57.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.371+0000 7f03077fe700 1 -- 172.21.15.80:0/2611474085 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0308031a20 con 0x7f0310113980 2019-11-28T11:57:57.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.371+0000 7f030ed9d700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f02e8018770 0x7f02e801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:57.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.372+0000 7f030ed9d700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f02e8018770 0x7f02e801abe0 crc :-1 s=READY pgs=1142 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:57.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.379+0000 7f0314dad700 1 -- 172.21.15.80:0/2611474085 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0310124010 con 0x7f0310113980 2019-11-28T11:57:57.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.382+0000 7f030f59e700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0310113980 0x7f0310168a20 secure :-1 s=THROTTLE_DONE pgs=2749 cs=0 l=1 rx=0x7f0308010390 tx=0x7f03080101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.382+0000 7f03077fe700 1 -- 172.21.15.80:0/2611474085 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0308009590 con 0x7f0310113980 2019-11-28T11:57:57.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.556+0000 7f0314dad700 1 -- 172.21.15.80:0/2611474085 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0310124010 con 0x7f0310113980 2019-11-28T11:57:57.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.557+0000 7f030f59e700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0310113980 0x7f0310168a20 secure :-1 s=THROTTLE_DONE pgs=2749 cs=0 l=1 rx=0x7f0308010390 tx=0x7f03080101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.557+0000 7f03077fe700 1 -- 172.21.15.80:0/2611474085 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 173 v173) v1 ==== 95+0+1428 (secure 0 0 0) 0x7f030800a330 con 0x7f0310113980 2019-11-28T11:57:57.556 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 173 2019-11-28T11:57:57.556 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:57:57.556 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":173,"default_fscid":17,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":173,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:57:55.569453+0000","modified":"2019-11-28T11:57:57.222535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[35],"metadata_pool":34,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":17}]} 2019-11-28T11:57:57.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.559+0000 7f0314dad700 1 -- 172.21.15.80:0/2611474085 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f02e8018770 msgr2=0x7f02e801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:57.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.559+0000 7f0314dad700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f02e8018770 0x7f02e801abe0 crc :-1 s=READY pgs=1142 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:57.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.559+0000 7f0314dad700 1 -- 172.21.15.80:0/2611474085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0310113980 msgr2=0x7f0310168a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:57.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.560+0000 7f0314dad700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0310113980 0x7f0310168a20 secure :-1 s=READY pgs=2749 cs=0 l=1 rx=0x7f0308010390 tx=0x7f03080101c0).stop 2019-11-28T11:57:57.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.560+0000 7f0314dad700 1 -- 172.21.15.80:0/2611474085 shutdown_connections 2019-11-28T11:57:57.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.560+0000 7f0314dad700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f02e8018770 0x7f02e801abe0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:57.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.560+0000 7f0314dad700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0310113980 0x7f0310168a20 unknown :-1 s=CLOSED pgs=2749 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:57.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.560+0000 7f0314dad700 1 --2- 172.21.15.80:0/2611474085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0310112fb0 0x7f0310113440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:57.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.560+0000 7f0314dad700 1 -- 172.21.15.80:0/2611474085 shutdown_connections 2019-11-28T11:57:57.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.560+0000 7f0314dad700 1 -- 172.21.15.80:0/2611474085 wait complete. 2019-11-28T11:57:57.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.560+0000 7f0314dad700 1 -- 172.21.15.80:0/2611474085 >> 172.21.15.80:0/2611474085 conn(0x7f03101426c0 msgr2=0x7f0310110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:57.566 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:57:57.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.688+0000 7f011bbf1700 1 Processor -- start 2019-11-28T11:57:57.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.688+0000 7f011bbf1700 1 -- start start 2019-11-28T11:57:57.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.689+0000 7f011bbf1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011406c0a0 0x7f0114072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:57.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.689+0000 7f011bbf1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01140734e0 0x7f0114071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:57.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.689+0000 7f011bbf1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011406db00 con 0x7f0114072360 2019-11-28T11:57:57.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.689+0000 7f011bbf1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f011406f330 con 0x7f01140734e0 2019-11-28T11:57:57.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.689+0000 7f011bbf1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01140706c0 con 0x7f011406c0a0 2019-11-28T11:57:57.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011998d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01140734e0 0x7f0114071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:57.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011a18e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011406c0a0 0x7f0114072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:57.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011998d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01140734e0 0x7f0114071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:32938/0 (socket says 172.21.15.80:32938) 2019-11-28T11:57:57.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011a18e700 1 --2- 172.21.15.80:0/29135142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011406c0a0 0x7f0114072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:48540/0 (socket says 172.21.15.80:48540) 2019-11-28T11:57:57.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011998d700 1 -- 172.21.15.80:0/29135142 learned_addr learned my addr 172.21.15.80:0/29135142 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:57.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011998d700 1 -- 172.21.15.80:0/29135142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011406c0a0 msgr2=0x7f0114072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:57.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011998d700 1 --2- 172.21.15.80:0/29135142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011406c0a0 0x7f0114072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:57.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011998d700 1 -- 172.21.15.80:0/29135142 >> v1:172.21.15.174:6789/0 conn(0x7f0114072360 legacy=0x7f011406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:57.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011998d700 1 -- 172.21.15.80:0/29135142 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0114070a40 con 0x7f01140734e0 2019-11-28T11:57:57.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011a18e700 1 --2- 172.21.15.80:0/29135142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011406c0a0 0x7f0114072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:57:57.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011998d700 1 --2- 172.21.15.80:0/29135142 >> v2:172.21.15.174:3300/0 conn(0x7f01140734e0 0x7f0114071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f00fc00fac0 tx=0x7f00fc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011998d700 1 --2- 172.21.15.80:0/29135142 >> v2:172.21.15.174:3300/0 conn(0x7f01140734e0 0x7f0114071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f00fc00fac0 tx=0x7f00fc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011998d700 1 --2- 172.21.15.80:0/29135142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01140734e0 0x7f0114071e20 secure :-1 s=READY pgs=1665 cs=0 l=1 rx=0x7f00fc00fac0 tx=0x7f00fc00fe60).ready entity=mon.1 client_cookie=81818c393a3603dc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:57.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011998d700 1 --2- 172.21.15.80:0/29135142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01140734e0 0x7f0114071e20 secure :-1 s=THROTTLE_DONE pgs=1665 cs=0 l=1 rx=0x7f00fc00fac0 tx=0x7f00fc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011998d700 1 --2- 172.21.15.80:0/29135142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01140734e0 0x7f0114071e20 secure :-1 s=THROTTLE_DONE pgs=1665 cs=0 l=1 rx=0x7f00fc00fac0 tx=0x7f00fc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011998d700 1 --2- 172.21.15.80:0/29135142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01140734e0 0x7f0114071e20 secure :-1 s=THROTTLE_DONE pgs=1665 cs=0 l=1 rx=0x7f00fc00fac0 tx=0x7f00fc00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.690+0000 7f011918c700 1 -- 172.21.15.80:0/29135142 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00fc000ce0 con 0x7f01140734e0 2019-11-28T11:57:57.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.691+0000 7f011918c700 1 -- 172.21.15.80:0/29135142 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc001010 con 0x7f01140734e0 2019-11-28T11:57:57.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.691+0000 7f011918c700 1 -- 172.21.15.80:0/29135142 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00fc001720 con 0x7f01140734e0 2019-11-28T11:57:57.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.691+0000 7f011bbf1700 1 -- 172.21.15.80:0/29135142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01140734e0 msgr2=0x7f0114071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:57.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.691+0000 7f011bbf1700 1 --2- 172.21.15.80:0/29135142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01140734e0 0x7f0114071e20 secure :-1 s=READY pgs=1665 cs=0 l=1 rx=0x7f00fc00fac0 tx=0x7f00fc00fe60).stop 2019-11-28T11:57:57.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.691+0000 7f011bbf1700 1 -- 172.21.15.80:0/29135142 shutdown_connections 2019-11-28T11:57:57.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.691+0000 7f011bbf1700 1 --2- 172.21.15.80:0/29135142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01140734e0 0x7f0114071e20 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:57.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.691+0000 7f011bbf1700 1 --2- 172.21.15.80:0/29135142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011406c0a0 0x7f0114072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:57.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.691+0000 7f011bbf1700 1 -- 172.21.15.80:0/29135142 shutdown_connections 2019-11-28T11:57:57.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.691+0000 7f011bbf1700 1 -- 172.21.15.80:0/29135142 wait complete. 2019-11-28T11:57:57.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.691+0000 7f011bbf1700 1 -- 172.21.15.80:0/29135142 >> 172.21.15.80:0/29135142 conn(0x7f0114061cf0 msgr2=0x7f0114064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:57.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.694+0000 7f011bbf1700 1 Processor -- start 2019-11-28T11:57:57.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.694+0000 7f011bbf1700 1 -- start start 2019-11-28T11:57:57.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011bbf1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f011415fdf0 0x7f011412b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:57.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011bbf1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011412a3c0 0x7f011412a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:57.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011bbf1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011413eb20 con 0x7f011412b8a0 2019-11-28T11:57:57.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011bbf1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0114108820 con 0x7f011415fdf0 2019-11-28T11:57:57.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011bbf1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0114108af0 con 0x7f011412a3c0 2019-11-28T11:57:57.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011a18e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f011415fdf0 0x7f011412b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:57.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011a18e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f011415fdf0 0x7f011412b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46288/0 (socket says 172.21.15.80:46288) 2019-11-28T11:57:57.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011a18e700 1 -- 172.21.15.80:0/1250230676 learned_addr learned my addr 172.21.15.80:0/1250230676 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:57.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011a98f700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011412a3c0 0x7f011412a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:57.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011a18e700 1 -- 172.21.15.80:0/1250230676 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011412a3c0 msgr2=0x7f011412a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:57.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011a18e700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011412a3c0 0x7f011412a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:57.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011a18e700 1 -- 172.21.15.80:0/1250230676 >> v1:172.21.15.174:6789/0 conn(0x7f011412b8a0 legacy=0x7f011413e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:57.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011a18e700 1 -- 172.21.15.80:0/1250230676 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011410a8c0 con 0x7f011415fdf0 2019-11-28T11:57:57.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011a18e700 1 --2- 172.21.15.80:0/1250230676 >> v2:172.21.15.80:3300/0 conn(0x7f011415fdf0 0x7f011412b360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0104010390 tx=0x7f0104010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011a18e700 1 --2- 172.21.15.80:0/1250230676 >> v2:172.21.15.80:3300/0 conn(0x7f011415fdf0 0x7f011412b360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0104010390 tx=0x7f0104010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011a18e700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011415fdf0 0x7f011412b360 secure :-1 s=READY pgs=2750 cs=0 l=1 rx=0x7f0104010390 tx=0x7f0104010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:57.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011a18e700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011415fdf0 0x7f011412b360 secure :-1 s=THROTTLE_DONE pgs=2750 cs=0 l=1 rx=0x7f0104010390 tx=0x7f0104010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f0112ffd700 1 -- 172.21.15.80:0/1250230676 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0104000960 con 0x7f011415fdf0 2019-11-28T11:57:57.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011a18e700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011415fdf0 0x7f011412b360 secure :-1 s=THROTTLE_DONE pgs=2750 cs=0 l=1 rx=0x7f0104010390 tx=0x7f0104010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f0112ffd700 1 -- 172.21.15.80:0/1250230676 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0104000960 con 0x7f011415fdf0 2019-11-28T11:57:57.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011a18e700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011415fdf0 0x7f011412b360 secure :-1 s=THROTTLE_DONE pgs=2750 cs=0 l=1 rx=0x7f0104010390 tx=0x7f0104010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011bbf1700 1 -- 172.21.15.80:0/1250230676 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011410a8c0 con 0x7f011415fdf0 2019-11-28T11:57:57.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f0112ffd700 1 -- 172.21.15.80:0/1250230676 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f010400edb0 con 0x7f011415fdf0 2019-11-28T11:57:57.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.695+0000 7f011bbf1700 1 -- 172.21.15.80:0/1250230676 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011410a8c0 con 0x7f011415fdf0 2019-11-28T11:57:57.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.696+0000 7f011a18e700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011415fdf0 0x7f011412b360 secure :-1 s=THROTTLE_DONE pgs=2750 cs=0 l=1 rx=0x7f0104010390 tx=0x7f0104010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.696+0000 7f0112ffd700 1 -- 172.21.15.80:0/1250230676 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0104009580 con 0x7f011415fdf0 2019-11-28T11:57:57.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.696+0000 7f011a18e700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011415fdf0 0x7f011412b360 secure :-1 s=THROTTLE_DONE pgs=2750 cs=0 l=1 rx=0x7f0104010390 tx=0x7f0104010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.696+0000 7f0112ffd700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00f8018730 0x7f00f801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:57.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.696+0000 7f0112ffd700 1 -- 172.21.15.80:0/1250230676 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0104031a90 con 0x7f011415fdf0 2019-11-28T11:57:57.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.696+0000 7f011998d700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00f8018730 0x7f00f801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:57.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.697+0000 7f011998d700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00f8018730 0x7f00f801abc0 crc :-1 s=READY pgs=1143 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:57.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.703+0000 7f011bbf1700 1 -- 172.21.15.80:0/1250230676 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0114109180 con 0x7f011415fdf0 2019-11-28T11:57:57.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.707+0000 7f011a18e700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011415fdf0 0x7f011412b360 secure :-1 s=THROTTLE_DONE pgs=2750 cs=0 l=1 rx=0x7f0104010390 tx=0x7f0104010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.707+0000 7f0112ffd700 1 -- 172.21.15.80:0/1250230676 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f01040285e0 con 0x7f011415fdf0 2019-11-28T11:57:57.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.883+0000 7f011bbf1700 1 -- 172.21.15.80:0/1250230676 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0114109500 con 0x7f011415fdf0 2019-11-28T11:57:57.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.883+0000 7f011a18e700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011415fdf0 0x7f011412b360 secure :-1 s=THROTTLE_DONE pgs=2750 cs=0 l=1 rx=0x7f0104010390 tx=0x7f0104010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:57.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.883+0000 7f0112ffd700 1 -- 172.21.15.80:0/1250230676 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v213) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f010400a490 con 0x7f011415fdf0 2019-11-28T11:57:57.881 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:57:57.881 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":213,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:57:56.570576+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":35,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":34,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:57:53.888806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":35,"pool_name":"cephfs_data","create_time":"2019-11-28T11:57:54.582023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"213","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:57:57.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.886+0000 7f011bbf1700 1 -- 172.21.15.80:0/1250230676 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00f8018730 msgr2=0x7f00f801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:57.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.886+0000 7f011bbf1700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00f8018730 0x7f00f801abc0 crc :-1 s=READY pgs=1143 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:57.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.886+0000 7f011bbf1700 1 -- 172.21.15.80:0/1250230676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011415fdf0 msgr2=0x7f011412b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:57.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.886+0000 7f011bbf1700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011415fdf0 0x7f011412b360 secure :-1 s=READY pgs=2750 cs=0 l=1 rx=0x7f0104010390 tx=0x7f0104010730).stop 2019-11-28T11:57:57.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.886+0000 7f011bbf1700 1 -- 172.21.15.80:0/1250230676 shutdown_connections 2019-11-28T11:57:57.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.886+0000 7f011bbf1700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f011412a3c0 0x7f011412a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:57.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.886+0000 7f011bbf1700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f00f8018730 0x7f00f801abc0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:57.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.886+0000 7f011bbf1700 1 --2- 172.21.15.80:0/1250230676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011415fdf0 0x7f011412b360 unknown :-1 s=CLOSED pgs=2750 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:57.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.886+0000 7f011bbf1700 1 -- 172.21.15.80:0/1250230676 shutdown_connections 2019-11-28T11:57:57.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.886+0000 7f011bbf1700 1 -- 172.21.15.80:0/1250230676 wait complete. 2019-11-28T11:57:57.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:57.886+0000 7f011bbf1700 1 -- 172.21.15.80:0/1250230676 >> 172.21.15.80:0/1250230676 conn(0x7f0114127dc0 msgr2=0x7f0114141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:57.900 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:57:57.901 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:57:57.903 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:57:57.903 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:57:57.905 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:57:57.906 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:57:57.915 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:57:57.916 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:57:57.917 DEBUG:teuthology.parallel:result is None 2019-11-28T11:57:57.917 DEBUG:teuthology.parallel:result is None 2019-11-28T11:57:57.922 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:57:57.923 DEBUG:teuthology.parallel:result is None 2019-11-28T11:57:57.923 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:57:57.997 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:57:58.002 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:57:58.003 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:57:58.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.075+0000 7f6d4bde6700 1 Processor -- start 2019-11-28T11:57:58.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.075+0000 7f6d4bde6700 1 -- start start 2019-11-28T11:57:58.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d4bde6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6d4415ed10 0x7f6d4415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:58.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d4bde6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d44073020 0x7f6d44071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:58.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d4bde6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4406db60 con 0x7f6d440734b0 2019-11-28T11:57:58.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d4bde6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d4406fe00 con 0x7f6d44073020 2019-11-28T11:57:58.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d4bde6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d440700d0 con 0x7f6d4415ed10 2019-11-28T11:57:58.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d49b82700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d44073020 0x7f6d44071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:58.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d49b82700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d44073020 0x7f6d44071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46320/0 (socket says 172.21.15.80:46320) 2019-11-28T11:57:58.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d49b82700 1 -- 172.21.15.80:0/129397281 learned_addr learned my addr 172.21.15.80:0/129397281 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:58.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d4a383700 1 --2- 172.21.15.80:0/129397281 >> v2:172.21.15.174:3300/0 conn(0x7f6d4415ed10 0x7f6d4415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d49b82700 1 -- 172.21.15.80:0/129397281 >> v2:172.21.15.174:3300/0 conn(0x7f6d4415ed10 msgr2=0x7f6d4415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d49b82700 1 --2- 172.21.15.80:0/129397281 >> v2:172.21.15.174:3300/0 conn(0x7f6d4415ed10 0x7f6d4415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d49b82700 1 -- 172.21.15.80:0/129397281 >> v1:172.21.15.174:6789/0 conn(0x7f6d440734b0 legacy=0x7f6d440723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d49b82700 1 -- 172.21.15.80:0/129397281 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d44070760 con 0x7f6d44073020 2019-11-28T11:57:58.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d49b82700 1 --2- 172.21.15.80:0/129397281 >> v2:172.21.15.80:3300/0 conn(0x7f6d44073020 0x7f6d44071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6d3400f740 tx=0x7f6d3400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d49b82700 1 --2- 172.21.15.80:0/129397281 >> v2:172.21.15.80:3300/0 conn(0x7f6d44073020 0x7f6d44071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6d3400f740 tx=0x7f6d3400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d49b82700 1 --2- 172.21.15.80:0/129397281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44073020 0x7f6d44071ea0 secure :-1 s=READY pgs=2758 cs=0 l=1 rx=0x7f6d3400f740 tx=0x7f6d3400f570).ready entity=mon.0 client_cookie=75f389d537efd973 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d49b82700 1 --2- 172.21.15.80:0/129397281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44073020 0x7f6d44071ea0 secure :-1 s=THROTTLE_DONE pgs=2758 cs=0 l=1 rx=0x7f6d3400f740 tx=0x7f6d3400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d49381700 1 -- 172.21.15.80:0/129397281 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d34000960 con 0x7f6d44073020 2019-11-28T11:57:58.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d49b82700 1 --2- 172.21.15.80:0/129397281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44073020 0x7f6d44071ea0 secure :-1 s=THROTTLE_DONE pgs=2758 cs=0 l=1 rx=0x7f6d3400f740 tx=0x7f6d3400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d49b82700 1 --2- 172.21.15.80:0/129397281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44073020 0x7f6d44071ea0 secure :-1 s=THROTTLE_DONE pgs=2758 cs=0 l=1 rx=0x7f6d3400f740 tx=0x7f6d3400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.076+0000 7f6d49381700 1 -- 172.21.15.80:0/129397281 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d34000c90 con 0x7f6d44073020 2019-11-28T11:57:58.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.077+0000 7f6d49381700 1 -- 172.21.15.80:0/129397281 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d340013a0 con 0x7f6d44073020 2019-11-28T11:57:58.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.077+0000 7f6d4bde6700 1 -- 172.21.15.80:0/129397281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44073020 msgr2=0x7f6d44071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.077+0000 7f6d4bde6700 1 --2- 172.21.15.80:0/129397281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44073020 0x7f6d44071ea0 secure :-1 s=READY pgs=2758 cs=0 l=1 rx=0x7f6d3400f740 tx=0x7f6d3400f570).stop 2019-11-28T11:57:58.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.077+0000 7f6d4bde6700 1 -- 172.21.15.80:0/129397281 shutdown_connections 2019-11-28T11:57:58.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.077+0000 7f6d4bde6700 1 --2- 172.21.15.80:0/129397281 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44073020 0x7f6d44071ea0 unknown :-1 s=CLOSED pgs=2758 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:58.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.077+0000 7f6d4bde6700 1 --2- 172.21.15.80:0/129397281 >> v2:172.21.15.174:3300/0 conn(0x7f6d4415ed10 0x7f6d4415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:58.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.077+0000 7f6d4bde6700 1 -- 172.21.15.80:0/129397281 shutdown_connections 2019-11-28T11:57:58.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.077+0000 7f6d4bde6700 1 -- 172.21.15.80:0/129397281 wait complete. 2019-11-28T11:57:58.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.077+0000 7f6d4bde6700 1 -- 172.21.15.80:0/129397281 >> 172.21.15.80:0/129397281 conn(0x7f6d44061d40 msgr2=0x7f6d440641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:58.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.080+0000 7f6d4bde6700 1 Processor -- start 2019-11-28T11:57:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.080+0000 7f6d4bde6700 1 -- start start 2019-11-28T11:57:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4bde6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d44114f60 0x7f6d44106b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:58.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4bde6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d4412e9a0 0x7f6d44105a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:58.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4bde6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d44130b20 con 0x7f6d441070d0 2019-11-28T11:57:58.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4bde6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d44148b60 con 0x7f6d44114f60 2019-11-28T11:57:58.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4bde6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d44148e30 con 0x7f6d4412e9a0 2019-11-28T11:57:58.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4a383700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d44114f60 0x7f6d44106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:58.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4a383700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d44114f60 0x7f6d44106b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46324/0 (socket says 172.21.15.80:46324) 2019-11-28T11:57:58.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4a383700 1 -- 172.21.15.80:0/3008019761 learned_addr learned my addr 172.21.15.80:0/3008019761 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:58.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4ab84700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d4412e9a0 0x7f6d44105a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:58.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4a383700 1 -- 172.21.15.80:0/3008019761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d4412e9a0 msgr2=0x7f6d44105a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4a383700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d4412e9a0 0x7f6d44105a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:58.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4a383700 1 -- 172.21.15.80:0/3008019761 >> v1:172.21.15.174:6789/0 conn(0x7f6d441070d0 legacy=0x7f6d4412e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d3affd700 1 -- 172.21.15.80:0/3008019761 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270543374 0 0) 0x7f6d34007580 con 0x7f6d441070d0 2019-11-28T11:57:58.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4a383700 1 -- 172.21.15.80:0/3008019761 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d44104390 con 0x7f6d44114f60 2019-11-28T11:57:58.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4a383700 1 --2- 172.21.15.80:0/3008019761 >> v2:172.21.15.80:3300/0 conn(0x7f6d44114f60 0x7f6d44106b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d40010450 tx=0x7f6d40010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4a383700 1 --2- 172.21.15.80:0/3008019761 >> v2:172.21.15.80:3300/0 conn(0x7f6d44114f60 0x7f6d44106b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d40010450 tx=0x7f6d40010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4a383700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44114f60 0x7f6d44106b90 secure :-1 s=READY pgs=2759 cs=0 l=1 rx=0x7f6d40010450 tx=0x7f6d40010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:58.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4a383700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44114f60 0x7f6d44106b90 secure :-1 s=THROTTLE_DONE pgs=2759 cs=0 l=1 rx=0x7f6d40010450 tx=0x7f6d40010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d3affd700 1 -- 172.21.15.80:0/3008019761 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d40000940 con 0x7f6d44114f60 2019-11-28T11:57:58.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4a383700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44114f60 0x7f6d44106b90 secure :-1 s=THROTTLE_DONE pgs=2759 cs=0 l=1 rx=0x7f6d40010450 tx=0x7f6d40010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d3affd700 1 -- 172.21.15.80:0/3008019761 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d40000e80 con 0x7f6d44114f60 2019-11-28T11:57:58.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4a383700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44114f60 0x7f6d44106b90 secure :-1 s=THROTTLE_DONE pgs=2759 cs=0 l=1 rx=0x7f6d40010450 tx=0x7f6d40010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4bde6700 1 -- 172.21.15.80:0/3008019761 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d44104710 con 0x7f6d44114f60 2019-11-28T11:57:58.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d3affd700 1 -- 172.21.15.80:0/3008019761 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d40001070 con 0x7f6d44114f60 2019-11-28T11:57:58.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.081+0000 7f6d4bde6700 1 -- 172.21.15.80:0/3008019761 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d44104390 con 0x7f6d44114f60 2019-11-28T11:57:58.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.082+0000 7f6d4a383700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44114f60 0x7f6d44106b90 secure :-1 s=THROTTLE_DONE pgs=2759 cs=0 l=1 rx=0x7f6d40010450 tx=0x7f6d40010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.082+0000 7f6d3affd700 1 -- 172.21.15.80:0/3008019761 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6d40001070 con 0x7f6d44114f60 2019-11-28T11:57:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.082+0000 7f6d4a383700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44114f60 0x7f6d44106b90 secure :-1 s=THROTTLE_DONE pgs=2759 cs=0 l=1 rx=0x7f6d40010450 tx=0x7f6d40010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.082+0000 7f6d3affd700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d2c018730 0x7f6d2c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.082+0000 7f6d3affd700 1 -- 172.21.15.80:0/3008019761 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6d40031af0 con 0x7f6d44114f60 2019-11-28T11:57:58.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.082+0000 7f6d49b82700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d2c018730 0x7f6d2c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.083+0000 7f6d49b82700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d2c018730 0x7f6d2c01abc0 crc :-1 s=READY pgs=1144 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:58.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.090+0000 7f6d4bde6700 1 -- 172.21.15.80:0/3008019761 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d44104710 con 0x7f6d44114f60 2019-11-28T11:57:58.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.093+0000 7f6d4a383700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44114f60 0x7f6d44106b90 secure :-1 s=THROTTLE_DONE pgs=2759 cs=0 l=1 rx=0x7f6d40010450 tx=0x7f6d40010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.093+0000 7f6d3affd700 1 -- 172.21.15.80:0/3008019761 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6d40009250 con 0x7f6d44114f60 2019-11-28T11:57:58.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.265+0000 7f6d4bde6700 1 -- 172.21.15.80:0/3008019761 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6d44104390 con 0x7f6d44114f60 2019-11-28T11:57:58.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.267+0000 7f6d4a383700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44114f60 0x7f6d44106b90 secure :-1 s=THROTTLE_DONE pgs=2759 cs=0 l=1 rx=0x7f6d40010450 tx=0x7f6d40010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.267+0000 7f6d3affd700 1 -- 172.21.15.80:0/3008019761 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v72) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6d400011a0 con 0x7f6d44114f60 2019-11-28T11:57:58.264 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:57:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.270+0000 7f6d4bde6700 1 -- 172.21.15.80:0/3008019761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d2c018730 msgr2=0x7f6d2c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.270+0000 7f6d4bde6700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d2c018730 0x7f6d2c01abc0 crc :-1 s=READY pgs=1144 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.270+0000 7f6d4bde6700 1 -- 172.21.15.80:0/3008019761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44114f60 msgr2=0x7f6d44106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.270+0000 7f6d4bde6700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44114f60 0x7f6d44106b90 secure :-1 s=READY pgs=2759 cs=0 l=1 rx=0x7f6d40010450 tx=0x7f6d40010280).stop 2019-11-28T11:57:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.270+0000 7f6d4bde6700 1 -- 172.21.15.80:0/3008019761 shutdown_connections 2019-11-28T11:57:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.270+0000 7f6d4bde6700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6d4412e9a0 0x7f6d44105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.270+0000 7f6d4bde6700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6d2c018730 0x7f6d2c01abc0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.270+0000 7f6d4bde6700 1 --2- 172.21.15.80:0/3008019761 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d44114f60 0x7f6d44106b90 unknown :-1 s=CLOSED pgs=2759 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:58.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.270+0000 7f6d4bde6700 1 -- 172.21.15.80:0/3008019761 shutdown_connections 2019-11-28T11:57:58.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.270+0000 7f6d4bde6700 1 -- 172.21.15.80:0/3008019761 wait complete. 2019-11-28T11:57:58.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.270+0000 7f6d4bde6700 1 -- 172.21.15.80:0/3008019761 >> 172.21.15.80:0/3008019761 conn(0x7f6d441476e0 msgr2=0x7f6d4412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:58.276 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:57:58.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.411+0000 7f61e644f700 1 Processor -- start 2019-11-28T11:57:58.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.411+0000 7f61e644f700 1 -- start start 2019-11-28T11:57:58.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61e644f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f61e015ed10 0x7f61e015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:58.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61e644f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f61e0073020 0x7f61e0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:58.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61e644f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e006db60 con 0x7f61e00734b0 2019-11-28T11:57:58.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61e644f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e006f3d0 con 0x7f61e0073020 2019-11-28T11:57:58.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61e644f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e006fe00 con 0x7f61e015ed10 2019-11-28T11:57:58.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61dffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f61e0073020 0x7f61e0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:58.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61dffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f61e0073020 0x7f61e0071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46332/0 (socket says 172.21.15.80:46332) 2019-11-28T11:57:58.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61dffff700 1 -- 172.21.15.80:0/3200295511 learned_addr learned my addr 172.21.15.80:0/3200295511 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:58.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61e49ec700 1 --2- 172.21.15.80:0/3200295511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f61e015ed10 0x7f61e015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:58.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61dffff700 1 -- 172.21.15.80:0/3200295511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f61e015ed10 msgr2=0x7f61e015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:58.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61dffff700 1 --2- 172.21.15.80:0/3200295511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f61e015ed10 0x7f61e015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:58.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61dffff700 1 -- 172.21.15.80:0/3200295511 >> v1:172.21.15.174:6789/0 conn(0x7f61e00734b0 legacy=0x7f61e00723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:58.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61dffff700 1 -- 172.21.15.80:0/3200295511 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e0070760 con 0x7f61e0073020 2019-11-28T11:57:58.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61e49ec700 1 --2- 172.21.15.80:0/3200295511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f61e015ed10 0x7f61e015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:57:58.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61dffff700 1 --2- 172.21.15.80:0/3200295511 >> v2:172.21.15.80:3300/0 conn(0x7f61e0073020 0x7f61e0071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f61d000f740 tx=0x7f61d000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61dffff700 1 --2- 172.21.15.80:0/3200295511 >> v2:172.21.15.80:3300/0 conn(0x7f61e0073020 0x7f61e0071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f61d000f740 tx=0x7f61d000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.412+0000 7f61dffff700 1 --2- 172.21.15.80:0/3200295511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0073020 0x7f61e0071ea0 secure :-1 s=READY pgs=2760 cs=0 l=1 rx=0x7f61d000f740 tx=0x7f61d000fae0).ready entity=mon.0 client_cookie=32b545fd6b37ab17 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:58.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.413+0000 7f61dffff700 1 --2- 172.21.15.80:0/3200295511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0073020 0x7f61e0071ea0 secure :-1 s=THROTTLE_DONE pgs=2760 cs=0 l=1 rx=0x7f61d000f740 tx=0x7f61d000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.413+0000 7f61dffff700 1 --2- 172.21.15.80:0/3200295511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0073020 0x7f61e0071ea0 secure :-1 s=THROTTLE_DONE pgs=2760 cs=0 l=1 rx=0x7f61d000f740 tx=0x7f61d000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.413+0000 7f61df7fe700 1 -- 172.21.15.80:0/3200295511 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61d0000960 con 0x7f61e0073020 2019-11-28T11:57:58.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.413+0000 7f61dffff700 1 --2- 172.21.15.80:0/3200295511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0073020 0x7f61e0071ea0 secure :-1 s=THROTTLE_DONE pgs=2760 cs=0 l=1 rx=0x7f61d000f740 tx=0x7f61d000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.413+0000 7f61df7fe700 1 -- 172.21.15.80:0/3200295511 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d0000c90 con 0x7f61e0073020 2019-11-28T11:57:58.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.413+0000 7f61df7fe700 1 -- 172.21.15.80:0/3200295511 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61d00013a0 con 0x7f61e0073020 2019-11-28T11:57:58.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.413+0000 7f61e644f700 1 -- 172.21.15.80:0/3200295511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0073020 msgr2=0x7f61e0071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.413+0000 7f61e644f700 1 --2- 172.21.15.80:0/3200295511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0073020 0x7f61e0071ea0 secure :-1 s=READY pgs=2760 cs=0 l=1 rx=0x7f61d000f740 tx=0x7f61d000fae0).stop 2019-11-28T11:57:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.413+0000 7f61e644f700 1 -- 172.21.15.80:0/3200295511 shutdown_connections 2019-11-28T11:57:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.413+0000 7f61e644f700 1 --2- 172.21.15.80:0/3200295511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0073020 0x7f61e0071ea0 unknown :-1 s=CLOSED pgs=2760 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.413+0000 7f61e644f700 1 --2- 172.21.15.80:0/3200295511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f61e015ed10 0x7f61e015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.413+0000 7f61e644f700 1 -- 172.21.15.80:0/3200295511 shutdown_connections 2019-11-28T11:57:58.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.413+0000 7f61e644f700 1 -- 172.21.15.80:0/3200295511 wait complete. 2019-11-28T11:57:58.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.413+0000 7f61e644f700 1 -- 172.21.15.80:0/3200295511 >> 172.21.15.80:0/3200295511 conn(0x7f61e0061d40 msgr2=0x7f61e00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.416+0000 7f61e644f700 1 Processor -- start 2019-11-28T11:57:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.416+0000 7f61e644f700 1 -- start start 2019-11-28T11:57:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.417+0000 7f61e644f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f61e0134610 0x7f61e0134aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:58.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.417+0000 7f61e644f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e0109d70 con 0x7f61e0134fe0 2019-11-28T11:57:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.417+0000 7f61e644f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e01308e0 con 0x7f61e0152750 2019-11-28T11:57:58.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.417+0000 7f61e644f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e0132570 con 0x7f61e0134610 2019-11-28T11:57:58.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.417+0000 7f61dffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f61e0134610 0x7f61e0134aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.417+0000 7f61dffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f61e0134610 0x7f61e0134aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46338/0 (socket says 172.21.15.80:46338) 2019-11-28T11:57:58.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.417+0000 7f61e51ed700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f61e0134fe0 0x7f61e0167d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45656/0 (socket says 172.21.15.80:45656) 2019-11-28T11:57:58.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.417+0000 7f61dffff700 1 -- 172.21.15.80:0/1473285922 learned_addr learned my addr 172.21.15.80:0/1473285922 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:58.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.417+0000 7f61dffff700 1 -- 172.21.15.80:0/1473285922 >> v1:172.21.15.174:6789/0 conn(0x7f61e0152750 legacy=0x7f61e0135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.417+0000 7f61dffff700 1 -- 172.21.15.80:0/1473285922 >> v1:172.21.15.80:6789/0 conn(0x7f61e0134fe0 legacy=0x7f61e0167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.417+0000 7f61dd7fa700 1 -- 172.21.15.80:0/1473285922 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634999054 0 0) 0x7f61c8007480 con 0x7f61e0152750 2019-11-28T11:57:58.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.417+0000 7f61dffff700 1 -- 172.21.15.80:0/1473285922 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e0135460 con 0x7f61e0134610 2019-11-28T11:57:58.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.417+0000 7f61dffff700 1 --2- 172.21.15.80:0/1473285922 >> v2:172.21.15.80:3300/0 conn(0x7f61e0134610 0x7f61e0134aa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f61d0010450 tx=0x7f61d00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.417+0000 7f61dffff700 1 --2- 172.21.15.80:0/1473285922 >> v2:172.21.15.80:3300/0 conn(0x7f61e0134610 0x7f61e0134aa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f61d0010450 tx=0x7f61d00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.417+0000 7f61dffff700 1 --2- 172.21.15.80:0/1473285922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0134610 0x7f61e0134aa0 secure :-1 s=READY pgs=2762 cs=0 l=1 rx=0x7f61d0010450 tx=0x7f61d00107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:58.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.418+0000 7f61dffff700 1 --2- 172.21.15.80:0/1473285922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0134610 0x7f61e0134aa0 secure :-1 s=THROTTLE_DONE pgs=2762 cs=0 l=1 rx=0x7f61d0010450 tx=0x7f61d00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.418+0000 7f61dd7fa700 1 -- 172.21.15.80:0/1473285922 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61d0005770 con 0x7f61e0134610 2019-11-28T11:57:58.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.418+0000 7f61dffff700 1 --2- 172.21.15.80:0/1473285922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0134610 0x7f61e0134aa0 secure :-1 s=THROTTLE_DONE pgs=2762 cs=0 l=1 rx=0x7f61d0010450 tx=0x7f61d00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.418+0000 7f61dffff700 1 --2- 172.21.15.80:0/1473285922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0134610 0x7f61e0134aa0 secure :-1 s=THROTTLE_DONE pgs=2762 cs=0 l=1 rx=0x7f61d0010450 tx=0x7f61d00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.418+0000 7f61dd7fa700 1 -- 172.21.15.80:0/1473285922 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d0005390 con 0x7f61e0134610 2019-11-28T11:57:58.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.418+0000 7f61e644f700 1 -- 172.21.15.80:0/1473285922 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e0135460 con 0x7f61e0134610 2019-11-28T11:57:58.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.418+0000 7f61dd7fa700 1 -- 172.21.15.80:0/1473285922 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61d0005960 con 0x7f61e0134610 2019-11-28T11:57:58.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.418+0000 7f61e644f700 1 -- 172.21.15.80:0/1473285922 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e0135460 con 0x7f61e0134610 2019-11-28T11:57:58.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.418+0000 7f61dffff700 1 --2- 172.21.15.80:0/1473285922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0134610 0x7f61e0134aa0 secure :-1 s=THROTTLE_DONE pgs=2762 cs=0 l=1 rx=0x7f61d0010450 tx=0x7f61d00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.418+0000 7f61dd7fa700 1 -- 172.21.15.80:0/1473285922 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f61d0005580 con 0x7f61e0134610 2019-11-28T11:57:58.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.418+0000 7f61dffff700 1 --2- 172.21.15.80:0/1473285922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0134610 0x7f61e0134aa0 secure :-1 s=THROTTLE_DONE pgs=2762 cs=0 l=1 rx=0x7f61d0010450 tx=0x7f61d00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.418+0000 7f61dd7fa700 1 --2- 172.21.15.80:0/1473285922 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f61c4018730 0x7f61c401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:58.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.418+0000 7f61dd7fa700 1 -- 172.21.15.80:0/1473285922 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f61d0031dc0 con 0x7f61e0134610 2019-11-28T11:57:58.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.418+0000 7f61e49ec700 1 --2- 172.21.15.80:0/1473285922 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f61c4018730 0x7f61c401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:58.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.419+0000 7f61e49ec700 1 --2- 172.21.15.80:0/1473285922 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f61c4018730 0x7f61c401abc0 crc :-1 s=READY pgs=1145 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:58.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.426+0000 7f61e644f700 1 -- 172.21.15.80:0/1473285922 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e0132ed0 con 0x7f61e0134610 2019-11-28T11:57:58.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.430+0000 7f61dffff700 1 --2- 172.21.15.80:0/1473285922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0134610 0x7f61e0134aa0 secure :-1 s=THROTTLE_DONE pgs=2762 cs=0 l=1 rx=0x7f61d0010450 tx=0x7f61d00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.430+0000 7f61dd7fa700 1 -- 172.21.15.80:0/1473285922 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f61d0005180 con 0x7f61e0134610 2019-11-28T11:57:58.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.599+0000 7f61e644f700 1 -- 172.21.15.80:0/1473285922 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f61e0133250 con 0x7f61e0134610 2019-11-28T11:57:58.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.602+0000 7f61dffff700 1 --2- 172.21.15.80:0/1473285922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0134610 0x7f61e0134aa0 secure :-1 s=THROTTLE_DONE pgs=2762 cs=0 l=1 rx=0x7f61d0010450 tx=0x7f61d00107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.603+0000 7f61dd7fa700 1 -- 172.21.15.80:0/1473285922 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v73) v1 ==== 184+0+0 (secure 0 0 0) 0x7f61d00055f0 con 0x7f61e0134610 2019-11-28T11:57:58.605 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:57:58.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.608+0000 7f61e644f700 1 -- 172.21.15.80:0/1473285922 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f61c4018730 msgr2=0x7f61c401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.608+0000 7f61e644f700 1 --2- 172.21.15.80:0/1473285922 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f61c4018730 0x7f61c401abc0 crc :-1 s=READY pgs=1145 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:58.607 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.608+0000 7f61e644f700 1 -- 172.21.15.80:0/1473285922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0134610 msgr2=0x7f61e0134aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.608+0000 7f61e644f700 1 --2- 172.21.15.80:0/1473285922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0134610 0x7f61e0134aa0 secure :-1 s=READY pgs=2762 cs=0 l=1 rx=0x7f61d0010450 tx=0x7f61d00107f0).stop 2019-11-28T11:57:58.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.609+0000 7f61e644f700 1 -- 172.21.15.80:0/1473285922 shutdown_connections 2019-11-28T11:57:58.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.609+0000 7f61e644f700 1 --2- 172.21.15.80:0/1473285922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f61e0134610 0x7f61e0134aa0 unknown :-1 s=CLOSED pgs=2762 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:58.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.609+0000 7f61e644f700 1 --2- 172.21.15.80:0/1473285922 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f61c4018730 0x7f61c401abc0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:58.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.609+0000 7f61e644f700 1 -- 172.21.15.80:0/1473285922 shutdown_connections 2019-11-28T11:57:58.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.609+0000 7f61e644f700 1 -- 172.21.15.80:0/1473285922 wait complete. 2019-11-28T11:57:58.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.609+0000 7f61e644f700 1 -- 172.21.15.80:0/1473285922 >> 172.21.15.80:0/1473285922 conn(0x7f61e01476e0 msgr2=0x7f61e012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:58.616 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:57:58.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.750+0000 7f6710864700 1 Processor -- start 2019-11-28T11:57:58.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.750+0000 7f6710864700 1 -- start start 2019-11-28T11:57:58.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.751+0000 7f6710864700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f670c15ed10 0x7f670c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:58.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.751+0000 7f6710864700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f670c073020 0x7f670c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:58.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.751+0000 7f6710864700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670c06db60 con 0x7f670c0734b0 2019-11-28T11:57:58.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.751+0000 7f6710864700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670c06f3d0 con 0x7f670c073020 2019-11-28T11:57:58.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.751+0000 7f6710864700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670c06fe00 con 0x7f670c15ed10 2019-11-28T11:57:58.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.751+0000 7f670a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f670c073020 0x7f670c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:58.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.751+0000 7f670a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f670c073020 0x7f670c071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46348/0 (socket says 172.21.15.80:46348) 2019-11-28T11:57:58.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.751+0000 7f670a59c700 1 -- 172.21.15.80:0/312292925 learned_addr learned my addr 172.21.15.80:0/312292925 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:58.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.751+0000 7f670ad9d700 1 --2- 172.21.15.80:0/312292925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f670c15ed10 0x7f670c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:58.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.752+0000 7f670a59c700 1 -- 172.21.15.80:0/312292925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f670c15ed10 msgr2=0x7f670c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:58.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.752+0000 7f670a59c700 1 --2- 172.21.15.80:0/312292925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f670c15ed10 0x7f670c15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:58.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.752+0000 7f670a59c700 1 -- 172.21.15.80:0/312292925 >> v1:172.21.15.174:6789/0 conn(0x7f670c0734b0 legacy=0x7f670c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.752+0000 7f670a59c700 1 -- 172.21.15.80:0/312292925 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c070760 con 0x7f670c073020 2019-11-28T11:57:58.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.752+0000 7f670a59c700 1 --2- 172.21.15.80:0/312292925 >> v2:172.21.15.80:3300/0 conn(0x7f670c073020 0x7f670c071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f66f400fa40 tx=0x7f66f400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.752+0000 7f670a59c700 1 --2- 172.21.15.80:0/312292925 >> v2:172.21.15.80:3300/0 conn(0x7f670c073020 0x7f670c071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f66f400fa40 tx=0x7f66f400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.752+0000 7f670a59c700 1 --2- 172.21.15.80:0/312292925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c073020 0x7f670c071ea0 secure :-1 s=READY pgs=2763 cs=0 l=1 rx=0x7f66f400fa40 tx=0x7f66f400fde0).ready entity=mon.0 client_cookie=1815f680b37d9ea6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:58.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.752+0000 7f670a59c700 1 --2- 172.21.15.80:0/312292925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c073020 0x7f670c071ea0 secure :-1 s=THROTTLE_DONE pgs=2763 cs=0 l=1 rx=0x7f66f400fa40 tx=0x7f66f400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.752+0000 7f670a59c700 1 --2- 172.21.15.80:0/312292925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c073020 0x7f670c071ea0 secure :-1 s=THROTTLE_DONE pgs=2763 cs=0 l=1 rx=0x7f66f400fa40 tx=0x7f66f400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.752+0000 7f6709d9b700 1 -- 172.21.15.80:0/312292925 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f4000ce0 con 0x7f670c073020 2019-11-28T11:57:58.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.752+0000 7f670a59c700 1 --2- 172.21.15.80:0/312292925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c073020 0x7f670c071ea0 secure :-1 s=THROTTLE_DONE pgs=2763 cs=0 l=1 rx=0x7f66f400fa40 tx=0x7f66f400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.752+0000 7f6709d9b700 1 -- 172.21.15.80:0/312292925 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f4001010 con 0x7f670c073020 2019-11-28T11:57:58.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.752+0000 7f6709d9b700 1 -- 172.21.15.80:0/312292925 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f4001720 con 0x7f670c073020 2019-11-28T11:57:58.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.752+0000 7f6710864700 1 -- 172.21.15.80:0/312292925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c073020 msgr2=0x7f670c071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.752+0000 7f6710864700 1 --2- 172.21.15.80:0/312292925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c073020 0x7f670c071ea0 secure :-1 s=READY pgs=2763 cs=0 l=1 rx=0x7f66f400fa40 tx=0x7f66f400fde0).stop 2019-11-28T11:57:58.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.753+0000 7f6710864700 1 -- 172.21.15.80:0/312292925 shutdown_connections 2019-11-28T11:57:58.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.753+0000 7f6710864700 1 --2- 172.21.15.80:0/312292925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c073020 0x7f670c071ea0 unknown :-1 s=CLOSED pgs=2763 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:58.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.753+0000 7f6710864700 1 --2- 172.21.15.80:0/312292925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f670c15ed10 0x7f670c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:58.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.753+0000 7f6710864700 1 -- 172.21.15.80:0/312292925 shutdown_connections 2019-11-28T11:57:58.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.753+0000 7f6710864700 1 -- 172.21.15.80:0/312292925 wait complete. 2019-11-28T11:57:58.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.753+0000 7f6710864700 1 -- 172.21.15.80:0/312292925 >> 172.21.15.80:0/312292925 conn(0x7f670c061d40 msgr2=0x7f670c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:58.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.755+0000 7f6710864700 1 Processor -- start 2019-11-28T11:57:58.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.755+0000 7f6710864700 1 -- start start 2019-11-28T11:57:58.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.756+0000 7f6710864700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f670c134610 0x7f670c134aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:58.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.756+0000 7f6710864700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f670c134fe0 0x7f670c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:58.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.756+0000 7f6710864700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670c135410 con 0x7f670c152750 2019-11-28T11:57:58.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.756+0000 7f6710864700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670c132570 con 0x7f670c134fe0 2019-11-28T11:57:58.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.756+0000 7f6710864700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670c132840 con 0x7f670c134610 2019-11-28T11:57:58.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.756+0000 7f670b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f670c134fe0 0x7f670c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:58.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.756+0000 7f670ad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f670c152750 0x7f670c135790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45666/0 (socket says 172.21.15.80:45666) 2019-11-28T11:57:58.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.756+0000 7f670ad9d700 1 -- 172.21.15.80:0/3973019306 learned_addr learned my addr 172.21.15.80:0/3973019306 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:58.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.756+0000 7f670a59c700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f670c134610 0x7f670c134aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:58.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f670b59e700 1 -- 172.21.15.80:0/3973019306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f670c134610 msgr2=0x7f670c134aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f670b59e700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f670c134610 0x7f670c134aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:58.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f670b59e700 1 -- 172.21.15.80:0/3973019306 >> v1:172.21.15.80:6789/0 conn(0x7f670c152750 legacy=0x7f670c135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f670b59e700 1 -- 172.21.15.80:0/3973019306 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c132ed0 con 0x7f670c134fe0 2019-11-28T11:57:58.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f67037fe700 1 -- 172.21.15.80:0/3973019306 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727122841 0 0) 0x7f66fc009610 con 0x7f670c152750 2019-11-28T11:57:58.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f670b59e700 1 --2- 172.21.15.80:0/3973019306 >> v2:172.21.15.80:3300/0 conn(0x7f670c134fe0 0x7f670c167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f67040103b0 tx=0x7f670400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f670b59e700 1 --2- 172.21.15.80:0/3973019306 >> v2:172.21.15.80:3300/0 conn(0x7f670c134fe0 0x7f670c167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f67040103b0 tx=0x7f670400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f670b59e700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c134fe0 0x7f670c167d70 secure :-1 s=READY pgs=2765 cs=0 l=1 rx=0x7f67040103b0 tx=0x7f670400b2f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:58.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f670b59e700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c134fe0 0x7f670c167d70 secure :-1 s=THROTTLE_DONE pgs=2765 cs=0 l=1 rx=0x7f67040103b0 tx=0x7f670400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f67037fe700 1 -- 172.21.15.80:0/3973019306 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6704000a50 con 0x7f670c134fe0 2019-11-28T11:57:58.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f670b59e700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c134fe0 0x7f670c167d70 secure :-1 s=THROTTLE_DONE pgs=2765 cs=0 l=1 rx=0x7f67040103b0 tx=0x7f670400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f670b59e700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c134fe0 0x7f670c167d70 secure :-1 s=THROTTLE_DONE pgs=2765 cs=0 l=1 rx=0x7f67040103b0 tx=0x7f670400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f67037fe700 1 -- 172.21.15.80:0/3973019306 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670400ede0 con 0x7f670c134fe0 2019-11-28T11:57:58.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f67037fe700 1 -- 172.21.15.80:0/3973019306 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f670400f4f0 con 0x7f670c134fe0 2019-11-28T11:57:58.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f6710864700 1 -- 172.21.15.80:0/3973019306 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670c133250 con 0x7f670c134fe0 2019-11-28T11:57:58.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f6710864700 1 -- 172.21.15.80:0/3973019306 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670c132ed0 con 0x7f670c134fe0 2019-11-28T11:57:58.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.757+0000 7f670b59e700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c134fe0 0x7f670c167d70 secure :-1 s=THROTTLE_DONE pgs=2765 cs=0 l=1 rx=0x7f67040103b0 tx=0x7f670400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.758+0000 7f67037fe700 1 -- 172.21.15.80:0/3973019306 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f670400f1e0 con 0x7f670c134fe0 2019-11-28T11:57:58.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.758+0000 7f670b59e700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c134fe0 0x7f670c167d70 secure :-1 s=THROTTLE_DONE pgs=2765 cs=0 l=1 rx=0x7f67040103b0 tx=0x7f670400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.758+0000 7f67037fe700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66e4018730 0x7f66e401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:58.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.758+0000 7f67037fe700 1 -- 172.21.15.80:0/3973019306 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6704031a40 con 0x7f670c134fe0 2019-11-28T11:57:58.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.758+0000 7f670ad9d700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66e4018730 0x7f66e401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:58.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.758+0000 7f670ad9d700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66e4018730 0x7f66e401abc0 crc :-1 s=READY pgs=1146 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:58.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.766+0000 7f6710864700 1 -- 172.21.15.80:0/3973019306 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670c133250 con 0x7f670c134fe0 2019-11-28T11:57:58.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.769+0000 7f670b59e700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c134fe0 0x7f670c167d70 secure :-1 s=THROTTLE_DONE pgs=2765 cs=0 l=1 rx=0x7f67040103b0 tx=0x7f670400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.769+0000 7f67037fe700 1 -- 172.21.15.80:0/3973019306 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f670400efd0 con 0x7f670c134fe0 2019-11-28T11:57:58.935 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.939+0000 7f6710864700 1 -- 172.21.15.80:0/3973019306 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f670c132ed0 con 0x7f670c134fe0 2019-11-28T11:57:58.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.942+0000 7f670b59e700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c134fe0 0x7f670c167d70 secure :-1 s=THROTTLE_DONE pgs=2765 cs=0 l=1 rx=0x7f67040103b0 tx=0x7f670400b2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:58.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.942+0000 7f67037fe700 1 -- 172.21.15.80:0/3973019306 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v74) v1 ==== 184+0+0 (secure 0 0 0) 0x7f670400f1e0 con 0x7f670c134fe0 2019-11-28T11:57:58.942 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:57:58.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.948+0000 7f6710864700 1 -- 172.21.15.80:0/3973019306 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66e4018730 msgr2=0x7f66e401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.948+0000 7f6710864700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66e4018730 0x7f66e401abc0 crc :-1 s=READY pgs=1146 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:58.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.948+0000 7f6710864700 1 -- 172.21.15.80:0/3973019306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c134fe0 msgr2=0x7f670c167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:58.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.948+0000 7f6710864700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c134fe0 0x7f670c167d70 secure :-1 s=READY pgs=2765 cs=0 l=1 rx=0x7f67040103b0 tx=0x7f670400b2f0).stop 2019-11-28T11:57:58.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.948+0000 7f6710864700 1 -- 172.21.15.80:0/3973019306 shutdown_connections 2019-11-28T11:57:58.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.948+0000 7f6710864700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f66e4018730 0x7f66e401abc0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:58.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.948+0000 7f6710864700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f670c134fe0 0x7f670c167d70 unknown :-1 s=CLOSED pgs=2765 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:58.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.948+0000 7f6710864700 1 --2- 172.21.15.80:0/3973019306 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f670c134610 0x7f670c134aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:58.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.948+0000 7f6710864700 1 -- 172.21.15.80:0/3973019306 shutdown_connections 2019-11-28T11:57:58.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.948+0000 7f6710864700 1 -- 172.21.15.80:0/3973019306 wait complete. 2019-11-28T11:57:58.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:58.948+0000 7f6710864700 1 -- 172.21.15.80:0/3973019306 >> 172.21.15.80:0/3973019306 conn(0x7f670c1476e0 msgr2=0x7f670c12fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:58.956 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:57:59.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.092+0000 7f0959a6f700 1 Processor -- start 2019-11-28T11:57:59.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.092+0000 7f0959a6f700 1 -- start start 2019-11-28T11:57:59.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.093+0000 7f0959a6f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f095415f100 0x7f095406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:59.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.093+0000 7f0959a6f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f095406db60 con 0x7f095406c2f0 2019-11-28T11:57:59.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.093+0000 7f0959a6f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f095406e060 con 0x7f095415ed10 2019-11-28T11:57:59.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.093+0000 7f0959a6f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095406fe00 con 0x7f095415f100 2019-11-28T11:57:59.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.093+0000 7f095880d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f095406c2f0 0x7f095406c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45678/0 (socket says 172.21.15.80:45678) 2019-11-28T11:57:59.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.093+0000 7f095880d700 1 -- 172.21.15.80:0/1610266544 learned_addr learned my addr 172.21.15.80:0/1610266544 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:59.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.093+0000 7f094bfff700 1 --2- 172.21.15.80:0/1610266544 >> v2:172.21.15.174:3300/0 conn(0x7f095415f100 0x7f095406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:59.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.093+0000 7f09537fe700 1 -- 172.21.15.80:0/1610266544 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503117339 0 0) 0x7f094c0014d0 con 0x7f095406c2f0 2019-11-28T11:57:59.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.093+0000 7f09537fe700 1 -- 172.21.15.80:0/1610266544 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0934002e80 con 0x7f095406c2f0 2019-11-28T11:57:59.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.093+0000 7f094bfff700 1 -- 172.21.15.80:0/1610266544 >> v1:172.21.15.174:6789/0 conn(0x7f095415ed10 legacy=0x7f0954073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:59.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.093+0000 7f09537fe700 1 -- 172.21.15.80:0/1610266544 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307184688 0 0) 0x7f0944001080 con 0x7f095415ed10 2019-11-28T11:57:59.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.093+0000 7f094bfff700 1 -- 172.21.15.80:0/1610266544 >> v1:172.21.15.80:6789/0 conn(0x7f095406c2f0 legacy=0x7f095406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:59.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.093+0000 7f094bfff700 1 -- 172.21.15.80:0/1610266544 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0954070760 con 0x7f095415f100 2019-11-28T11:57:59.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.093+0000 7f094bfff700 1 --2- 172.21.15.80:0/1610266544 >> v2:172.21.15.174:3300/0 conn(0x7f095415f100 0x7f095406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f093c00af50 tx=0x7f093c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.093+0000 7f094bfff700 1 --2- 172.21.15.80:0/1610266544 >> v2:172.21.15.174:3300/0 conn(0x7f095415f100 0x7f095406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f093c00af50 tx=0x7f093c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.093+0000 7f094bfff700 1 --2- 172.21.15.80:0/1610266544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f095415f100 0x7f095406bdb0 secure :-1 s=READY pgs=1679 cs=0 l=1 rx=0x7f093c00af50 tx=0x7f093c00b760).ready entity=mon.1 client_cookie=beeafdce6fd0da37 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:59.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.094+0000 7f094bfff700 1 --2- 172.21.15.80:0/1610266544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f095415f100 0x7f095406bdb0 secure :-1 s=THROTTLE_DONE pgs=1679 cs=0 l=1 rx=0x7f093c00af50 tx=0x7f093c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.094+0000 7f09537fe700 1 -- 172.21.15.80:0/1610266544 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f093c000960 con 0x7f095415f100 2019-11-28T11:57:59.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.094+0000 7f094bfff700 1 --2- 172.21.15.80:0/1610266544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f095415f100 0x7f095406bdb0 secure :-1 s=THROTTLE_DONE pgs=1679 cs=0 l=1 rx=0x7f093c00af50 tx=0x7f093c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.094+0000 7f094bfff700 1 --2- 172.21.15.80:0/1610266544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f095415f100 0x7f095406bdb0 secure :-1 s=THROTTLE_DONE pgs=1679 cs=0 l=1 rx=0x7f093c00af50 tx=0x7f093c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.094+0000 7f09537fe700 1 -- 172.21.15.80:0/1610266544 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c009860 con 0x7f095415f100 2019-11-28T11:57:59.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.094+0000 7f09537fe700 1 -- 172.21.15.80:0/1610266544 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f093c009f30 con 0x7f095415f100 2019-11-28T11:57:59.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.094+0000 7f0959a6f700 1 -- 172.21.15.80:0/1610266544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f095415f100 msgr2=0x7f095406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:59.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.094+0000 7f0959a6f700 1 --2- 172.21.15.80:0/1610266544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f095415f100 0x7f095406bdb0 secure :-1 s=READY pgs=1679 cs=0 l=1 rx=0x7f093c00af50 tx=0x7f093c00b760).stop 2019-11-28T11:57:59.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.094+0000 7f0959a6f700 1 -- 172.21.15.80:0/1610266544 shutdown_connections 2019-11-28T11:57:59.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.094+0000 7f0959a6f700 1 --2- 172.21.15.80:0/1610266544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f095415f100 0x7f095406bdb0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:59.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.094+0000 7f0959a6f700 1 -- 172.21.15.80:0/1610266544 shutdown_connections 2019-11-28T11:57:59.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.094+0000 7f0959a6f700 1 -- 172.21.15.80:0/1610266544 wait complete. 2019-11-28T11:57:59.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.094+0000 7f0959a6f700 1 -- 172.21.15.80:0/1610266544 >> 172.21.15.80:0/1610266544 conn(0x7f0954061d40 msgr2=0x7f09540641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:59.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.097+0000 7f0959a6f700 1 Processor -- start 2019-11-28T11:57:59.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.097+0000 7f0959a6f700 1 -- start start 2019-11-28T11:57:59.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f0959a6f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0954152750 0x7f0954135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:59.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f0959a6f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0954109d70 con 0x7f0954165d60 2019-11-28T11:57:59.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f0959a6f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09541308e0 con 0x7f0954130dc0 2019-11-28T11:57:59.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f0959a6f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0954132570 con 0x7f0954152750 2019-11-28T11:57:59.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f0953fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0954152750 0x7f0954135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:59.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f095880d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0954165d60 0x7f0954168160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45684/0 (socket says 172.21.15.80:45684) 2019-11-28T11:57:59.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f095880d700 1 -- 172.21.15.80:0/93195058 learned_addr learned my addr 172.21.15.80:0/93195058 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:57:59.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f0953fff700 1 -- 172.21.15.80:0/93195058 >> v1:172.21.15.174:6789/0 conn(0x7f0954130dc0 legacy=0x7f0954131250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:59.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f0953fff700 1 -- 172.21.15.80:0/93195058 >> v1:172.21.15.80:6789/0 conn(0x7f0954165d60 legacy=0x7f0954168160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:59.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f0953fff700 1 -- 172.21.15.80:0/93195058 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0954132ed0 con 0x7f0954152750 2019-11-28T11:57:59.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f09517fa700 1 -- 172.21.15.80:0/93195058 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584212542 0 0) 0x7f094c0014d0 con 0x7f0954165d60 2019-11-28T11:57:59.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f0953fff700 1 --2- 172.21.15.80:0/93195058 >> v2:172.21.15.80:3300/0 conn(0x7f0954152750 0x7f0954135790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0944010380 tx=0x7f0944010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f0953fff700 1 --2- 172.21.15.80:0/93195058 >> v2:172.21.15.80:3300/0 conn(0x7f0954152750 0x7f0954135790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0944010380 tx=0x7f0944010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f0953fff700 1 --2- 172.21.15.80:0/93195058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0954152750 0x7f0954135790 secure :-1 s=READY pgs=2768 cs=0 l=1 rx=0x7f0944010380 tx=0x7f0944010720).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:59.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f0953fff700 1 --2- 172.21.15.80:0/93195058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0954152750 0x7f0954135790 secure :-1 s=THROTTLE_DONE pgs=2768 cs=0 l=1 rx=0x7f0944010380 tx=0x7f0944010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f09517fa700 1 -- 172.21.15.80:0/93195058 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0944000ea0 con 0x7f0954152750 2019-11-28T11:57:59.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f0953fff700 1 --2- 172.21.15.80:0/93195058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0954152750 0x7f0954135790 secure :-1 s=THROTTLE_DONE pgs=2768 cs=0 l=1 rx=0x7f0944010380 tx=0x7f0944010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f09517fa700 1 -- 172.21.15.80:0/93195058 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0944000ea0 con 0x7f0954152750 2019-11-28T11:57:59.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f0959a6f700 1 -- 172.21.15.80:0/93195058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0954133250 con 0x7f0954152750 2019-11-28T11:57:59.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f0953fff700 1 --2- 172.21.15.80:0/93195058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0954152750 0x7f0954135790 secure :-1 s=THROTTLE_DONE pgs=2768 cs=0 l=1 rx=0x7f0944010380 tx=0x7f0944010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f09517fa700 1 -- 172.21.15.80:0/93195058 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0944005ad0 con 0x7f0954152750 2019-11-28T11:57:59.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.098+0000 7f0959a6f700 1 -- 172.21.15.80:0/93195058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0954132ed0 con 0x7f0954152750 2019-11-28T11:57:59.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.099+0000 7f0953fff700 1 --2- 172.21.15.80:0/93195058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0954152750 0x7f0954135790 secure :-1 s=THROTTLE_DONE pgs=2768 cs=0 l=1 rx=0x7f0944010380 tx=0x7f0944010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.099+0000 7f09517fa700 1 -- 172.21.15.80:0/93195058 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f09440056f0 con 0x7f0954152750 2019-11-28T11:57:59.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.099+0000 7f0953fff700 1 --2- 172.21.15.80:0/93195058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0954152750 0x7f0954135790 secure :-1 s=THROTTLE_DONE pgs=2768 cs=0 l=1 rx=0x7f0944010380 tx=0x7f0944010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.099+0000 7f09517fa700 1 --2- 172.21.15.80:0/93195058 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f092c018730 0x7f092c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:59.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.099+0000 7f09517fa700 1 -- 172.21.15.80:0/93195058 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0944031a90 con 0x7f0954152750 2019-11-28T11:57:59.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.099+0000 7f094bfff700 1 --2- 172.21.15.80:0/93195058 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f092c018730 0x7f092c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:59.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.100+0000 7f094bfff700 1 --2- 172.21.15.80:0/93195058 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f092c018730 0x7f092c01abc0 crc :-1 s=READY pgs=1147 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:59.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.107+0000 7f0959a6f700 1 -- 172.21.15.80:0/93195058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0954133250 con 0x7f0954152750 2019-11-28T11:57:59.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.110+0000 7f0953fff700 1 --2- 172.21.15.80:0/93195058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0954152750 0x7f0954135790 secure :-1 s=THROTTLE_DONE pgs=2768 cs=0 l=1 rx=0x7f0944010380 tx=0x7f0944010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.110+0000 7f09517fa700 1 -- 172.21.15.80:0/93195058 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0944025fb0 con 0x7f0954152750 2019-11-28T11:57:59.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.283+0000 7f0959a6f700 1 -- 172.21.15.80:0/93195058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0954132ed0 con 0x7f0954152750 2019-11-28T11:57:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.285+0000 7f0953fff700 1 --2- 172.21.15.80:0/93195058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0954152750 0x7f0954135790 secure :-1 s=THROTTLE_DONE pgs=2768 cs=0 l=1 rx=0x7f0944010380 tx=0x7f0944010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.285+0000 7f09517fa700 1 -- 172.21.15.80:0/93195058 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v75) v1 ==== 184+0+0 (secure 0 0 0) 0x7f09440056f0 con 0x7f0954152750 2019-11-28T11:57:59.282 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:57:59.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.288+0000 7f0959a6f700 1 -- 172.21.15.80:0/93195058 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f092c018730 msgr2=0x7f092c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:59.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.288+0000 7f0959a6f700 1 --2- 172.21.15.80:0/93195058 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f092c018730 0x7f092c01abc0 crc :-1 s=READY pgs=1147 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:59.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.288+0000 7f0959a6f700 1 -- 172.21.15.80:0/93195058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0954152750 msgr2=0x7f0954135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:59.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.288+0000 7f0959a6f700 1 --2- 172.21.15.80:0/93195058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0954152750 0x7f0954135790 secure :-1 s=READY pgs=2768 cs=0 l=1 rx=0x7f0944010380 tx=0x7f0944010720).stop 2019-11-28T11:57:59.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.288+0000 7f0959a6f700 1 -- 172.21.15.80:0/93195058 shutdown_connections 2019-11-28T11:57:59.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.288+0000 7f0959a6f700 1 --2- 172.21.15.80:0/93195058 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f092c018730 0x7f092c01abc0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:59.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.288+0000 7f0959a6f700 1 --2- 172.21.15.80:0/93195058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0954152750 0x7f0954135790 unknown :-1 s=CLOSED pgs=2768 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:59.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.288+0000 7f0959a6f700 1 -- 172.21.15.80:0/93195058 shutdown_connections 2019-11-28T11:57:59.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.288+0000 7f0959a6f700 1 -- 172.21.15.80:0/93195058 wait complete. 2019-11-28T11:57:59.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.288+0000 7f0959a6f700 1 -- 172.21.15.80:0/93195058 >> 172.21.15.80:0/93195058 conn(0x7f09541476e0 msgr2=0x7f095412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:59.295 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:57:59.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.418+0000 7f4541d5f700 1 Processor -- start 2019-11-28T11:57:59.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.418+0000 7f4541d5f700 1 -- start start 2019-11-28T11:57:59.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.419+0000 7f4541d5f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f453c06c0a0 0x7f453c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:59.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.419+0000 7f4541d5f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f453c0734e0 0x7f453c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:57:59.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.419+0000 7f4541d5f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c06db00 con 0x7f453c072360 2019-11-28T11:57:59.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.419+0000 7f4541d5f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c06fd60 con 0x7f453c0734e0 2019-11-28T11:57:59.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.419+0000 7f4541d5f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c070030 con 0x7f453c06c0a0 2019-11-28T11:57:59.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.419+0000 7f4533fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f453c0734e0 0x7f453c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:59.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.419+0000 7f4533fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f453c0734e0 0x7f453c071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46372/0 (socket says 172.21.15.80:46372) 2019-11-28T11:57:59.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.419+0000 7f4533fff700 1 -- 172.21.15.80:0/803859765 learned_addr learned my addr 172.21.15.80:0/803859765 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:59.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.419+0000 7f453bfff700 1 --2- 172.21.15.80:0/803859765 >> v2:172.21.15.174:3300/0 conn(0x7f453c06c0a0 0x7f453c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:59.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.419+0000 7f4533fff700 1 -- 172.21.15.80:0/803859765 >> v2:172.21.15.174:3300/0 conn(0x7f453c06c0a0 msgr2=0x7f453c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:57:59.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.419+0000 7f4533fff700 1 --2- 172.21.15.80:0/803859765 >> v2:172.21.15.174:3300/0 conn(0x7f453c06c0a0 0x7f453c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:59.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.419+0000 7f4533fff700 1 -- 172.21.15.80:0/803859765 >> v1:172.21.15.174:6789/0 conn(0x7f453c072360 legacy=0x7f453c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:59.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.419+0000 7f4533fff700 1 -- 172.21.15.80:0/803859765 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c0706c0 con 0x7f453c0734e0 2019-11-28T11:57:59.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.419+0000 7f4533fff700 1 --2- 172.21.15.80:0/803859765 >> v2:172.21.15.80:3300/0 conn(0x7f453c0734e0 0x7f453c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f452400f740 tx=0x7f452400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.419+0000 7f4533fff700 1 --2- 172.21.15.80:0/803859765 >> v2:172.21.15.80:3300/0 conn(0x7f453c0734e0 0x7f453c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f452400f740 tx=0x7f452400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.419+0000 7f4533fff700 1 --2- 172.21.15.80:0/803859765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c0734e0 0x7f453c071e20 secure :-1 s=READY pgs=2769 cs=0 l=1 rx=0x7f452400f740 tx=0x7f452400f570).ready entity=mon.0 client_cookie=64adce050aabcbf6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:59.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.420+0000 7f4533fff700 1 --2- 172.21.15.80:0/803859765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c0734e0 0x7f453c071e20 secure :-1 s=THROTTLE_DONE pgs=2769 cs=0 l=1 rx=0x7f452400f740 tx=0x7f452400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.420+0000 7f4533fff700 1 --2- 172.21.15.80:0/803859765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c0734e0 0x7f453c071e20 secure :-1 s=THROTTLE_DONE pgs=2769 cs=0 l=1 rx=0x7f452400f740 tx=0x7f452400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.420+0000 7f453b7fe700 1 -- 172.21.15.80:0/803859765 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4524000960 con 0x7f453c0734e0 2019-11-28T11:57:59.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.420+0000 7f4533fff700 1 --2- 172.21.15.80:0/803859765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c0734e0 0x7f453c071e20 secure :-1 s=THROTTLE_DONE pgs=2769 cs=0 l=1 rx=0x7f452400f740 tx=0x7f452400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.420+0000 7f453b7fe700 1 -- 172.21.15.80:0/803859765 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4524000c90 con 0x7f453c0734e0 2019-11-28T11:57:59.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.420+0000 7f453b7fe700 1 -- 172.21.15.80:0/803859765 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45240013a0 con 0x7f453c0734e0 2019-11-28T11:57:59.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.420+0000 7f4541d5f700 1 -- 172.21.15.80:0/803859765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c0734e0 msgr2=0x7f453c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:59.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.420+0000 7f4541d5f700 1 --2- 172.21.15.80:0/803859765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c0734e0 0x7f453c071e20 secure :-1 s=READY pgs=2769 cs=0 l=1 rx=0x7f452400f740 tx=0x7f452400f570).stop 2019-11-28T11:57:59.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.420+0000 7f4541d5f700 1 -- 172.21.15.80:0/803859765 shutdown_connections 2019-11-28T11:57:59.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.420+0000 7f4541d5f700 1 --2- 172.21.15.80:0/803859765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c0734e0 0x7f453c071e20 unknown :-1 s=CLOSED pgs=2769 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:59.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.420+0000 7f4541d5f700 1 --2- 172.21.15.80:0/803859765 >> v2:172.21.15.174:3300/0 conn(0x7f453c06c0a0 0x7f453c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:57:59.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.420+0000 7f4541d5f700 1 -- 172.21.15.80:0/803859765 shutdown_connections 2019-11-28T11:57:59.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.420+0000 7f4541d5f700 1 -- 172.21.15.80:0/803859765 wait complete. 2019-11-28T11:57:59.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.420+0000 7f4541d5f700 1 -- 172.21.15.80:0/803859765 >> 172.21.15.80:0/803859765 conn(0x7f453c061cf0 msgr2=0x7f453c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:59.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.423+0000 7f4541d5f700 1 Processor -- start 2019-11-28T11:57:59.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.423+0000 7f4541d5f700 1 -- start start 2019-11-28T11:57:59.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4541d5f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f453c1281b0 0x7f453c128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:59.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4541d5f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c139a60 con 0x7f453c128b80 2019-11-28T11:57:59.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4541d5f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c13b060 con 0x7f453c13a780 2019-11-28T11:57:59.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4541d5f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c12a260 con 0x7f453c1281b0 2019-11-28T11:57:59.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4533fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f453c1281b0 0x7f453c128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:59.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4533fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f453c1281b0 0x7f453c128640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46378/0 (socket says 172.21.15.80:46378) 2019-11-28T11:57:59.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4533fff700 1 -- 172.21.15.80:0/1011336854 learned_addr learned my addr 172.21.15.80:0/1011336854 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:57:59.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4533fff700 1 -- 172.21.15.80:0/1011336854 >> v1:172.21.15.174:6789/0 conn(0x7f453c13a780 legacy=0x7f453c12d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:59.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4533fff700 1 -- 172.21.15.80:0/1011336854 >> v1:172.21.15.80:6789/0 conn(0x7f453c128b80 legacy=0x7f453c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:59.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f45397fa700 1 -- 172.21.15.80:0/1011336854 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27951572 0 0) 0x7f452c000c90 con 0x7f453c13a780 2019-11-28T11:57:59.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4533fff700 1 -- 172.21.15.80:0/1011336854 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c12abc0 con 0x7f453c1281b0 2019-11-28T11:57:59.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4533fff700 1 --2- 172.21.15.80:0/1011336854 >> v2:172.21.15.80:3300/0 conn(0x7f453c1281b0 0x7f453c128640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4524007c50 tx=0x7f4524010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4533fff700 1 --2- 172.21.15.80:0/1011336854 >> v2:172.21.15.80:3300/0 conn(0x7f453c1281b0 0x7f453c128640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4524007c50 tx=0x7f4524010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4533fff700 1 --2- 172.21.15.80:0/1011336854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c1281b0 0x7f453c128640 secure :-1 s=READY pgs=2771 cs=0 l=1 rx=0x7f4524007c50 tx=0x7f4524010820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:59.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4533fff700 1 --2- 172.21.15.80:0/1011336854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c1281b0 0x7f453c128640 secure :-1 s=THROTTLE_DONE pgs=2771 cs=0 l=1 rx=0x7f4524007c50 tx=0x7f4524010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f45397fa700 1 -- 172.21.15.80:0/1011336854 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4524005580 con 0x7f453c1281b0 2019-11-28T11:57:59.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4533fff700 1 --2- 172.21.15.80:0/1011336854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c1281b0 0x7f453c128640 secure :-1 s=THROTTLE_DONE pgs=2771 cs=0 l=1 rx=0x7f4524007c50 tx=0x7f4524010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4533fff700 1 --2- 172.21.15.80:0/1011336854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c1281b0 0x7f453c128640 secure :-1 s=THROTTLE_DONE pgs=2771 cs=0 l=1 rx=0x7f4524007c50 tx=0x7f4524010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f45397fa700 1 -- 172.21.15.80:0/1011336854 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4524007d90 con 0x7f453c1281b0 2019-11-28T11:57:59.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4541d5f700 1 -- 172.21.15.80:0/1011336854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453c12af40 con 0x7f453c1281b0 2019-11-28T11:57:59.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f45397fa700 1 -- 172.21.15.80:0/1011336854 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4524005b60 con 0x7f453c1281b0 2019-11-28T11:57:59.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.424+0000 7f4541d5f700 1 -- 172.21.15.80:0/1011336854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453c12abc0 con 0x7f453c1281b0 2019-11-28T11:57:59.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.425+0000 7f4533fff700 1 --2- 172.21.15.80:0/1011336854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c1281b0 0x7f453c128640 secure :-1 s=THROTTLE_DONE pgs=2771 cs=0 l=1 rx=0x7f4524007c50 tx=0x7f4524010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.425+0000 7f45397fa700 1 -- 172.21.15.80:0/1011336854 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4524005390 con 0x7f453c1281b0 2019-11-28T11:57:59.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.425+0000 7f4533fff700 1 --2- 172.21.15.80:0/1011336854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c1281b0 0x7f453c128640 secure :-1 s=THROTTLE_DONE pgs=2771 cs=0 l=1 rx=0x7f4524007c50 tx=0x7f4524010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.425+0000 7f45397fa700 1 --2- 172.21.15.80:0/1011336854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4514018730 0x7f451401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:57:59.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.425+0000 7f45397fa700 1 -- 172.21.15.80:0/1011336854 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4524031ae0 con 0x7f453c1281b0 2019-11-28T11:57:59.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.425+0000 7f453bfff700 1 --2- 172.21.15.80:0/1011336854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4514018730 0x7f451401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:57:59.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.425+0000 7f453bfff700 1 --2- 172.21.15.80:0/1011336854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4514018730 0x7f451401abc0 crc :-1 s=READY pgs=1148 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:57:59.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.433+0000 7f4541d5f700 1 -- 172.21.15.80:0/1011336854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453c12af40 con 0x7f453c1281b0 2019-11-28T11:57:59.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.436+0000 7f4533fff700 1 --2- 172.21.15.80:0/1011336854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c1281b0 0x7f453c128640 secure :-1 s=THROTTLE_DONE pgs=2771 cs=0 l=1 rx=0x7f4524007c50 tx=0x7f4524010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.436+0000 7f45397fa700 1 -- 172.21.15.80:0/1011336854 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f452402f650 con 0x7f453c1281b0 2019-11-28T11:57:59.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.608+0000 7f4541d5f700 1 -- 172.21.15.80:0/1011336854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f453c12abc0 con 0x7f453c1281b0 2019-11-28T11:57:59.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.609+0000 7f4533fff700 1 --2- 172.21.15.80:0/1011336854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c1281b0 0x7f453c128640 secure :-1 s=THROTTLE_DONE pgs=2771 cs=0 l=1 rx=0x7f4524007c50 tx=0x7f4524010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:57:59.606 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.609+0000 7f45397fa700 1 -- 172.21.15.80:0/1011336854 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 173 v173) v1 ==== 95+0+1428 (secure 0 0 0) 0x7f452402f650 con 0x7f453c1281b0 2019-11-28T11:57:59.606 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 173 2019-11-28T11:57:59.606 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:57:59.607 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":173,"default_fscid":17,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":173,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:57:55.569453+0000","modified":"2019-11-28T11:57:57.222535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[35],"metadata_pool":34,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":17}]} 2019-11-28T11:57:59.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.611+0000 7f4541d5f700 1 -- 172.21.15.80:0/1011336854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4514018730 msgr2=0x7f451401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:59.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.611+0000 7f4541d5f700 1 --2- 172.21.15.80:0/1011336854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4514018730 0x7f451401abc0 crc :-1 s=READY pgs=1148 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:59.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.611+0000 7f4541d5f700 1 -- 172.21.15.80:0/1011336854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c1281b0 msgr2=0x7f453c128640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:57:59.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.611+0000 7f4541d5f700 1 --2- 172.21.15.80:0/1011336854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c1281b0 0x7f453c128640 secure :-1 s=READY pgs=2771 cs=0 l=1 rx=0x7f4524007c50 tx=0x7f4524010820).stop 2019-11-28T11:57:59.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.611+0000 7f4541d5f700 1 -- 172.21.15.80:0/1011336854 shutdown_connections 2019-11-28T11:57:59.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.611+0000 7f4541d5f700 1 --2- 172.21.15.80:0/1011336854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f453c1281b0 0x7f453c128640 unknown :-1 s=CLOSED pgs=2771 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:59.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.611+0000 7f4541d5f700 1 --2- 172.21.15.80:0/1011336854 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4514018730 0x7f451401abc0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:57:59.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.611+0000 7f4541d5f700 1 -- 172.21.15.80:0/1011336854 shutdown_connections 2019-11-28T11:57:59.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.611+0000 7f4541d5f700 1 -- 172.21.15.80:0/1011336854 wait complete. 2019-11-28T11:57:59.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:57:59.611+0000 7f4541d5f700 1 -- 172.21.15.80:0/1011336854 >> 172.21.15.80:0/1011336854 conn(0x7f453c127dc0 msgr2=0x7f453c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:57:59.920 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 34, u'failed': [], u'epoch': 173, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [35], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:57:55.569453+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:57:57.222535+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:57:59.920 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:58:00.921 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:58:01.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.046+0000 7f7c1ae1c700 1 Processor -- start 2019-11-28T11:58:01.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.047+0000 7f7c1ae1c700 1 -- start start 2019-11-28T11:58:01.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.047+0000 7f7c1ae1c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7c1406c490 0x7f7c1406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:01.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.047+0000 7f7c1ae1c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c1406ce60 0x7f7c14164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:01.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.047+0000 7f7c1ae1c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1406db00 con 0x7f7c1406c0a0 2019-11-28T11:58:01.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.047+0000 7f7c1ae1c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1406fd60 con 0x7f7c1406ce60 2019-11-28T11:58:01.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.047+0000 7f7c1ae1c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c14070030 con 0x7f7c1406c490 2019-11-28T11:58:01.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c19bba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c1406ce60 0x7f7c14164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:01.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c19bba700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c1406ce60 0x7f7c14164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46386/0 (socket says 172.21.15.80:46386) 2019-11-28T11:58:01.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c19bba700 1 -- 172.21.15.80:0/2269312224 learned_addr learned my addr 172.21.15.80:0/2269312224 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:01.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c18bb8700 1 --2- 172.21.15.80:0/2269312224 >> v2:172.21.15.174:3300/0 conn(0x7f7c1406c490 0x7f7c1406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:01.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c19bba700 1 -- 172.21.15.80:0/2269312224 >> v2:172.21.15.174:3300/0 conn(0x7f7c1406c490 msgr2=0x7f7c1406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:01.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c19bba700 1 --2- 172.21.15.80:0/2269312224 >> v2:172.21.15.174:3300/0 conn(0x7f7c1406c490 0x7f7c1406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:01.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c19bba700 1 -- 172.21.15.80:0/2269312224 >> v1:172.21.15.174:6789/0 conn(0x7f7c1406c0a0 legacy=0x7f7c14072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:01.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c19bba700 1 -- 172.21.15.80:0/2269312224 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c140706c0 con 0x7f7c1406ce60 2019-11-28T11:58:01.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c19bba700 1 --2- 172.21.15.80:0/2269312224 >> v2:172.21.15.80:3300/0 conn(0x7f7c1406ce60 0x7f7c14164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c0c00f6b0 tx=0x7f7c0c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:01.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c19bba700 1 --2- 172.21.15.80:0/2269312224 >> v2:172.21.15.80:3300/0 conn(0x7f7c1406ce60 0x7f7c14164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c0c00f6b0 tx=0x7f7c0c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:01.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c19bba700 1 --2- 172.21.15.80:0/2269312224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c1406ce60 0x7f7c14164d70 secure :-1 s=READY pgs=2772 cs=0 l=1 rx=0x7f7c0c00f6b0 tx=0x7f7c0c00fa50).ready entity=mon.0 client_cookie=3599552e74ea2538 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:01.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c19bba700 1 --2- 172.21.15.80:0/2269312224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c1406ce60 0x7f7c14164d70 secure :-1 s=THROTTLE_DONE pgs=2772 cs=0 l=1 rx=0x7f7c0c00f6b0 tx=0x7f7c0c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:01.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c19bba700 1 --2- 172.21.15.80:0/2269312224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c1406ce60 0x7f7c14164d70 secure :-1 s=THROTTLE_DONE pgs=2772 cs=0 l=1 rx=0x7f7c0c00f6b0 tx=0x7f7c0c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:01.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c13fff700 1 -- 172.21.15.80:0/2269312224 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c0c000a70 con 0x7f7c1406ce60 2019-11-28T11:58:01.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c19bba700 1 --2- 172.21.15.80:0/2269312224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c1406ce60 0x7f7c14164d70 secure :-1 s=THROTTLE_DONE pgs=2772 cs=0 l=1 rx=0x7f7c0c00f6b0 tx=0x7f7c0c00fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:01.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c13fff700 1 -- 172.21.15.80:0/2269312224 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c0010e0 con 0x7f7c1406ce60 2019-11-28T11:58:01.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c13fff700 1 -- 172.21.15.80:0/2269312224 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c0c0017b0 con 0x7f7c1406ce60 2019-11-28T11:58:01.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c1ae1c700 1 -- 172.21.15.80:0/2269312224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c1406ce60 msgr2=0x7f7c14164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.048+0000 7f7c1ae1c700 1 --2- 172.21.15.80:0/2269312224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c1406ce60 0x7f7c14164d70 secure :-1 s=READY pgs=2772 cs=0 l=1 rx=0x7f7c0c00f6b0 tx=0x7f7c0c00fa50).stop 2019-11-28T11:58:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.049+0000 7f7c1ae1c700 1 -- 172.21.15.80:0/2269312224 shutdown_connections 2019-11-28T11:58:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.049+0000 7f7c1ae1c700 1 --2- 172.21.15.80:0/2269312224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c1406ce60 0x7f7c14164d70 unknown :-1 s=CLOSED pgs=2772 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.049+0000 7f7c1ae1c700 1 --2- 172.21.15.80:0/2269312224 >> v2:172.21.15.174:3300/0 conn(0x7f7c1406c490 0x7f7c1406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.049+0000 7f7c1ae1c700 1 -- 172.21.15.80:0/2269312224 shutdown_connections 2019-11-28T11:58:01.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.049+0000 7f7c1ae1c700 1 -- 172.21.15.80:0/2269312224 wait complete. 2019-11-28T11:58:01.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.049+0000 7f7c1ae1c700 1 -- 172.21.15.80:0/2269312224 >> 172.21.15.80:0/2269312224 conn(0x7f7c14061cf0 msgr2=0x7f7c14064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:01.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.052+0000 7f7c1ae1c700 1 Processor -- start 2019-11-28T11:58:01.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.052+0000 7f7c1ae1c700 1 -- start start 2019-11-28T11:58:01.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c1ae1c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c14109e40 0x7f7c1410a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:01.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c1ae1c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c1410a810 0x7f7c14105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:01.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c1ae1c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1413f1e0 con 0x7f7c1413eb40 2019-11-28T11:58:01.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c1ae1c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c141234c0 con 0x7f7c14109e40 2019-11-28T11:58:01.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c1ae1c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1413e0d0 con 0x7f7c1410a810 2019-11-28T11:58:01.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c18bb8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c14109e40 0x7f7c1410a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:01.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c18bb8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c14109e40 0x7f7c1410a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46392/0 (socket says 172.21.15.80:46392) 2019-11-28T11:58:01.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c18bb8700 1 -- 172.21.15.80:0/1380865234 learned_addr learned my addr 172.21.15.80:0/1380865234 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:01.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c19bba700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c1410a810 0x7f7c14105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:01.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c18bb8700 1 -- 172.21.15.80:0/1380865234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c1410a810 msgr2=0x7f7c14105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:01.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c18bb8700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c1410a810 0x7f7c14105210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:01.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c18bb8700 1 -- 172.21.15.80:0/1380865234 >> v1:172.21.15.174:6789/0 conn(0x7f7c1413eb40 legacy=0x7f7c1410afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:01.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c18bb8700 1 -- 172.21.15.80:0/1380865234 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c14108700 con 0x7f7c14109e40 2019-11-28T11:58:01.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c18bb8700 1 --2- 172.21.15.80:0/1380865234 >> v2:172.21.15.80:3300/0 conn(0x7f7c14109e40 0x7f7c1410a2d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c08010450 tx=0x7f7c08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:01.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c18bb8700 1 --2- 172.21.15.80:0/1380865234 >> v2:172.21.15.80:3300/0 conn(0x7f7c14109e40 0x7f7c1410a2d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c08010450 tx=0x7f7c08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:01.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c18bb8700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c14109e40 0x7f7c1410a2d0 secure :-1 s=READY pgs=2773 cs=0 l=1 rx=0x7f7c08010450 tx=0x7f7c08010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:01.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c18bb8700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c14109e40 0x7f7c1410a2d0 secure :-1 s=THROTTLE_DONE pgs=2773 cs=0 l=1 rx=0x7f7c08010450 tx=0x7f7c08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:01.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c18bb8700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c14109e40 0x7f7c1410a2d0 secure :-1 s=THROTTLE_DONE pgs=2773 cs=0 l=1 rx=0x7f7c08010450 tx=0x7f7c08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:01.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c11ffb700 1 -- 172.21.15.80:0/1380865234 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c08000940 con 0x7f7c14109e40 2019-11-28T11:58:01.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c18bb8700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c14109e40 0x7f7c1410a2d0 secure :-1 s=THROTTLE_DONE pgs=2773 cs=0 l=1 rx=0x7f7c08010450 tx=0x7f7c08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:01.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c11ffb700 1 -- 172.21.15.80:0/1380865234 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c08000e80 con 0x7f7c14109e40 2019-11-28T11:58:01.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c11ffb700 1 -- 172.21.15.80:0/1380865234 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c08001570 con 0x7f7c14109e40 2019-11-28T11:58:01.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c1ae1c700 1 -- 172.21.15.80:0/1380865234 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c14108a80 con 0x7f7c14109e40 2019-11-28T11:58:01.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.053+0000 7f7c1ae1c700 1 -- 172.21.15.80:0/1380865234 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c14108700 con 0x7f7c14109e40 2019-11-28T11:58:01.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.054+0000 7f7c18bb8700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c14109e40 0x7f7c1410a2d0 secure :-1 s=THROTTLE_DONE pgs=2773 cs=0 l=1 rx=0x7f7c08010450 tx=0x7f7c08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:01.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.054+0000 7f7c11ffb700 1 -- 172.21.15.80:0/1380865234 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7c08001070 con 0x7f7c14109e40 2019-11-28T11:58:01.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.054+0000 7f7c18bb8700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c14109e40 0x7f7c1410a2d0 secure :-1 s=THROTTLE_DONE pgs=2773 cs=0 l=1 rx=0x7f7c08010450 tx=0x7f7c08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:01.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.054+0000 7f7c11ffb700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bf4018730 0x7f7bf401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:01.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.054+0000 7f7c11ffb700 1 -- 172.21.15.80:0/1380865234 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7c08031d40 con 0x7f7c14109e40 2019-11-28T11:58:01.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.054+0000 7f7c193b9700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bf4018730 0x7f7bf401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:01.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.054+0000 7f7c193b9700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bf4018730 0x7f7bf401abe0 crc :-1 s=READY pgs=1149 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:01.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.062+0000 7f7c1ae1c700 1 -- 172.21.15.80:0/1380865234 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c14108a80 con 0x7f7c14109e40 2019-11-28T11:58:01.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.065+0000 7f7c18bb8700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c14109e40 0x7f7c1410a2d0 secure :-1 s=THROTTLE_DONE pgs=2773 cs=0 l=1 rx=0x7f7c08010450 tx=0x7f7c08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:01.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.065+0000 7f7c11ffb700 1 -- 172.21.15.80:0/1380865234 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7c080092e0 con 0x7f7c14109e40 2019-11-28T11:58:01.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.238+0000 7f7c1ae1c700 1 -- 172.21.15.80:0/1380865234 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c14108700 con 0x7f7c14109e40 2019-11-28T11:58:01.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.239+0000 7f7c18bb8700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c14109e40 0x7f7c1410a2d0 secure :-1 s=THROTTLE_DONE pgs=2773 cs=0 l=1 rx=0x7f7c08010450 tx=0x7f7c08010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:01.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.239+0000 7f7c11ffb700 1 -- 172.21.15.80:0/1380865234 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 173 v173) v1 ==== 95+0+1428 (secure 0 0 0) 0x7f7c08017be0 con 0x7f7c14109e40 2019-11-28T11:58:01.237 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 173 2019-11-28T11:58:01.237 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:01.237 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":173,"default_fscid":17,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":173,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:57:55.569453+0000","modified":"2019-11-28T11:57:57.222535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[35],"metadata_pool":34,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":17}]} 2019-11-28T11:58:01.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.241+0000 7f7c1ae1c700 1 -- 172.21.15.80:0/1380865234 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bf4018730 msgr2=0x7f7bf401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:01.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.241+0000 7f7c1ae1c700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bf4018730 0x7f7bf401abe0 crc :-1 s=READY pgs=1149 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:01.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.241+0000 7f7c1ae1c700 1 -- 172.21.15.80:0/1380865234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c14109e40 msgr2=0x7f7c1410a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:01.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.241+0000 7f7c1ae1c700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c14109e40 0x7f7c1410a2d0 secure :-1 s=READY pgs=2773 cs=0 l=1 rx=0x7f7c08010450 tx=0x7f7c08010280).stop 2019-11-28T11:58:01.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.242+0000 7f7c1ae1c700 1 -- 172.21.15.80:0/1380865234 shutdown_connections 2019-11-28T11:58:01.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.242+0000 7f7c1ae1c700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c1410a810 0x7f7c14105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:01.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.242+0000 7f7c1ae1c700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c14109e40 0x7f7c1410a2d0 unknown :-1 s=CLOSED pgs=2773 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:01.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.242+0000 7f7c1ae1c700 1 --2- 172.21.15.80:0/1380865234 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7bf4018730 0x7f7bf401abe0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:01.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.242+0000 7f7c1ae1c700 1 -- 172.21.15.80:0/1380865234 shutdown_connections 2019-11-28T11:58:01.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.242+0000 7f7c1ae1c700 1 -- 172.21.15.80:0/1380865234 wait complete. 2019-11-28T11:58:01.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:01.242+0000 7f7c1ae1c700 1 -- 172.21.15.80:0/1380865234 >> 172.21.15.80:0/1380865234 conn(0x7f7c1411bfc0 msgr2=0x7f7c14141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:01.550 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 34, u'failed': [], u'epoch': 173, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [35], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:57:55.569453+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:57:57.222535+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:58:01.550 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:58:02.551 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:58:02.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.674+0000 7f4fcd30c700 1 Processor -- start 2019-11-28T11:58:02.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.674+0000 7f4fcd30c700 1 -- start start 2019-11-28T11:58:02.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fcd30c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4fc806c0a0 0x7f4fc8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:02.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fcd30c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4fc8072620 0x7f4fc8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:02.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fcd30c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc806db00 con 0x7f4fc80734e0 2019-11-28T11:58:02.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fcd30c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc806fd60 con 0x7f4fc806c0a0 2019-11-28T11:58:02.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fcd30c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc8070030 con 0x7f4fc8072620 2019-11-28T11:58:02.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4fc806c0a0 0x7f4fc8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:02.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4fc806c0a0 0x7f4fc8072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46398/0 (socket says 172.21.15.80:46398) 2019-11-28T11:58:02.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc77fe700 1 -- 172.21.15.80:0/3355300436 learned_addr learned my addr 172.21.15.80:0/3355300436 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:02.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc7fff700 1 --2- 172.21.15.80:0/3355300436 >> v2:172.21.15.174:3300/0 conn(0x7f4fc8072620 0x7f4fc8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:02.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc77fe700 1 -- 172.21.15.80:0/3355300436 >> v2:172.21.15.174:3300/0 conn(0x7f4fc8072620 msgr2=0x7f4fc8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:02.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc77fe700 1 --2- 172.21.15.80:0/3355300436 >> v2:172.21.15.174:3300/0 conn(0x7f4fc8072620 0x7f4fc8164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:02.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc77fe700 1 -- 172.21.15.80:0/3355300436 >> v1:172.21.15.174:6789/0 conn(0x7f4fc80734e0 legacy=0x7f4fc8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:02.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc77fe700 1 -- 172.21.15.80:0/3355300436 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc80706c0 con 0x7f4fc806c0a0 2019-11-28T11:58:02.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc77fe700 1 --2- 172.21.15.80:0/3355300436 >> v2:172.21.15.80:3300/0 conn(0x7f4fc806c0a0 0x7f4fc8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4fb000fa40 tx=0x7f4fb000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:02.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc77fe700 1 --2- 172.21.15.80:0/3355300436 >> v2:172.21.15.80:3300/0 conn(0x7f4fc806c0a0 0x7f4fc8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4fb000fa40 tx=0x7f4fb000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:02.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc77fe700 1 --2- 172.21.15.80:0/3355300436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fc806c0a0 0x7f4fc8072fa0 secure :-1 s=READY pgs=2774 cs=0 l=1 rx=0x7f4fb000fa40 tx=0x7f4fb000fde0).ready entity=mon.0 client_cookie=c670d13097aba58f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:02.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc77fe700 1 --2- 172.21.15.80:0/3355300436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fc806c0a0 0x7f4fc8072fa0 secure :-1 s=THROTTLE_DONE pgs=2774 cs=0 l=1 rx=0x7f4fb000fa40 tx=0x7f4fb000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:02.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc77fe700 1 --2- 172.21.15.80:0/3355300436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fc806c0a0 0x7f4fc8072fa0 secure :-1 s=THROTTLE_DONE pgs=2774 cs=0 l=1 rx=0x7f4fb000fa40 tx=0x7f4fb000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:02.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc67fc700 1 -- 172.21.15.80:0/3355300436 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb0000ce0 con 0x7f4fc806c0a0 2019-11-28T11:58:02.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc77fe700 1 --2- 172.21.15.80:0/3355300436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fc806c0a0 0x7f4fc8072fa0 secure :-1 s=THROTTLE_DONE pgs=2774 cs=0 l=1 rx=0x7f4fb000fa40 tx=0x7f4fb000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:02.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc67fc700 1 -- 172.21.15.80:0/3355300436 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb0001010 con 0x7f4fc806c0a0 2019-11-28T11:58:02.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fc67fc700 1 -- 172.21.15.80:0/3355300436 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb0001720 con 0x7f4fc806c0a0 2019-11-28T11:58:02.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fcd30c700 1 -- 172.21.15.80:0/3355300436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fc806c0a0 msgr2=0x7f4fc8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:02.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.675+0000 7f4fcd30c700 1 --2- 172.21.15.80:0/3355300436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fc806c0a0 0x7f4fc8072fa0 secure :-1 s=READY pgs=2774 cs=0 l=1 rx=0x7f4fb000fa40 tx=0x7f4fb000fde0).stop 2019-11-28T11:58:02.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.676+0000 7f4fcd30c700 1 -- 172.21.15.80:0/3355300436 shutdown_connections 2019-11-28T11:58:02.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.676+0000 7f4fcd30c700 1 --2- 172.21.15.80:0/3355300436 >> v2:172.21.15.174:3300/0 conn(0x7f4fc8072620 0x7f4fc8164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:02.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.676+0000 7f4fcd30c700 1 --2- 172.21.15.80:0/3355300436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fc806c0a0 0x7f4fc8072fa0 unknown :-1 s=CLOSED pgs=2774 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:02.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.676+0000 7f4fcd30c700 1 -- 172.21.15.80:0/3355300436 shutdown_connections 2019-11-28T11:58:02.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.676+0000 7f4fcd30c700 1 -- 172.21.15.80:0/3355300436 wait complete. 2019-11-28T11:58:02.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.676+0000 7f4fcd30c700 1 -- 172.21.15.80:0/3355300436 >> 172.21.15.80:0/3355300436 conn(0x7f4fc8061cf0 msgr2=0x7f4fc8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.678+0000 7f4fcd30c700 1 Processor -- start 2019-11-28T11:58:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.679+0000 7f4fcd30c700 1 -- start start 2019-11-28T11:58:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fcd30c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4fc8104c10 0x7f4fc81050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fcd30c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc813bcd0 con 0x7f4fc81055e0 2019-11-28T11:58:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fcd30c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc8105ea0 con 0x7f4fc8104820 2019-11-28T11:58:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fcd30c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc8109130 con 0x7f4fc8104c10 2019-11-28T11:58:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fc7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4fc81055e0 0x7f4fc8167a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45724/0 (socket says 172.21.15.80:45724) 2019-11-28T11:58:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fc7fff700 1 -- 172.21.15.80:0/963924340 learned_addr learned my addr 172.21.15.80:0/963924340 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fc6ffd700 1 --2- 172.21.15.80:0/963924340 >> v2:172.21.15.174:3300/0 conn(0x7f4fc8104c10 0x7f4fc81050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fbffff700 1 -- 172.21.15.80:0/963924340 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623166980 0 0) 0x7f4fc00095b0 con 0x7f4fc81055e0 2019-11-28T11:58:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fbffff700 1 -- 172.21.15.80:0/963924340 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fa0002e80 con 0x7f4fc81055e0 2019-11-28T11:58:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fc6ffd700 1 -- 172.21.15.80:0/963924340 >> v1:172.21.15.174:6789/0 conn(0x7f4fc8104820 legacy=0x7f4fc810c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:02.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fbffff700 1 -- 172.21.15.80:0/963924340 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143619421 0 0) 0x7f4fb00083a0 con 0x7f4fc8104820 2019-11-28T11:58:02.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fc6ffd700 1 -- 172.21.15.80:0/963924340 >> v1:172.21.15.80:6789/0 conn(0x7f4fc81055e0 legacy=0x7f4fc8167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:02.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fc6ffd700 1 -- 172.21.15.80:0/963924340 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc8109a90 con 0x7f4fc8104c10 2019-11-28T11:58:02.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fc6ffd700 1 --2- 172.21.15.80:0/963924340 >> v2:172.21.15.174:3300/0 conn(0x7f4fc8104c10 0x7f4fc81050a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4fb80103a0 tx=0x7f4fb8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:02.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fc6ffd700 1 --2- 172.21.15.80:0/963924340 >> v2:172.21.15.174:3300/0 conn(0x7f4fc8104c10 0x7f4fc81050a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4fb80103a0 tx=0x7f4fb8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:02.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fc6ffd700 1 --2- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc8104c10 0x7f4fc81050a0 secure :-1 s=READY pgs=1687 cs=0 l=1 rx=0x7f4fb80103a0 tx=0x7f4fb8010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:02.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fc6ffd700 1 --2- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc8104c10 0x7f4fc81050a0 secure :-1 s=THROTTLE_DONE pgs=1687 cs=0 l=1 rx=0x7f4fb80103a0 tx=0x7f4fb8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:02.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.680+0000 7f4fbffff700 1 -- 172.21.15.80:0/963924340 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb800f110 con 0x7f4fc8104c10 2019-11-28T11:58:02.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.681+0000 7f4fcd30c700 1 -- 172.21.15.80:0/963924340 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc8109e10 con 0x7f4fc8104c10 2019-11-28T11:58:02.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.681+0000 7f4fc6ffd700 1 --2- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc8104c10 0x7f4fc81050a0 secure :-1 s=THROTTLE_DONE pgs=1687 cs=0 l=1 rx=0x7f4fb80103a0 tx=0x7f4fb8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:02.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.681+0000 7f4fbffff700 1 -- 172.21.15.80:0/963924340 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb800ed30 con 0x7f4fc8104c10 2019-11-28T11:58:02.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.681+0000 7f4fc6ffd700 1 --2- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc8104c10 0x7f4fc81050a0 secure :-1 s=THROTTLE_DONE pgs=1687 cs=0 l=1 rx=0x7f4fb80103a0 tx=0x7f4fb8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:02.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.681+0000 7f4fbffff700 1 -- 172.21.15.80:0/963924340 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb800ef20 con 0x7f4fc8104c10 2019-11-28T11:58:02.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.681+0000 7f4fcd30c700 1 -- 172.21.15.80:0/963924340 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc8109a90 con 0x7f4fc8104c10 2019-11-28T11:58:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.681+0000 7f4fc6ffd700 1 --2- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc8104c10 0x7f4fc81050a0 secure :-1 s=THROTTLE_DONE pgs=1687 cs=0 l=1 rx=0x7f4fb80103a0 tx=0x7f4fb8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.681+0000 7f4fbffff700 1 -- 172.21.15.80:0/963924340 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4fb800ef20 con 0x7f4fc8104c10 2019-11-28T11:58:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.681+0000 7f4fc6ffd700 1 --2- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc8104c10 0x7f4fc81050a0 secure :-1 s=THROTTLE_DONE pgs=1687 cs=0 l=1 rx=0x7f4fb80103a0 tx=0x7f4fb8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.681+0000 7f4fbffff700 1 --2- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fa0018780 0x7f4fa001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.681+0000 7f4fbffff700 1 -- 172.21.15.80:0/963924340 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4fb8031b00 con 0x7f4fc8104c10 2019-11-28T11:58:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.682+0000 7f4fc77fe700 1 --2- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fa0018780 0x7f4fa001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.682+0000 7f4fc77fe700 1 --2- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fa0018780 0x7f4fa001abf0 crc :-1 s=READY pgs=1150 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:02.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.689+0000 7f4fcd30c700 1 -- 172.21.15.80:0/963924340 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc8109e10 con 0x7f4fc8104c10 2019-11-28T11:58:02.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.693+0000 7f4fc6ffd700 1 --2- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc8104c10 0x7f4fc81050a0 secure :-1 s=THROTTLE_DONE pgs=1687 cs=0 l=1 rx=0x7f4fb80103a0 tx=0x7f4fb8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:02.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.693+0000 7f4fbffff700 1 -- 172.21.15.80:0/963924340 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4fb800f610 con 0x7f4fc8104c10 2019-11-28T11:58:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.871+0000 7f4fcd30c700 1 -- 172.21.15.80:0/963924340 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fc8109a90 con 0x7f4fc8104c10 2019-11-28T11:58:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.871+0000 7f4fc6ffd700 1 --2- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc8104c10 0x7f4fc81050a0 secure :-1 s=THROTTLE_DONE pgs=1687 cs=0 l=1 rx=0x7f4fb80103a0 tx=0x7f4fb8010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.871+0000 7f4fbffff700 1 -- 172.21.15.80:0/963924340 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 175 v175) v1 ==== 95+0+2459 (secure 0 0 0) 0x7f4fb800ef20 con 0x7f4fc8104c10 2019-11-28T11:58:02.869 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 175 2019-11-28T11:58:02.869 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:02.870 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":175,"default_fscid":17,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":11371,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/4086131539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":4086131539},{"type":"v1","addr":"172.21.15.80:6835","nonce":4086131539}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":174},{"gid":12102,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2858222423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2858222423},{"type":"v1","addr":"172.21.15.80:6834","nonce":2858222423}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":174}],"filesystems":[{"mdsmap":{"epoch":175,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:57:55.569453+0000","modified":"2019-11-28T11:58:02.814612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7964":{"gid":7964,"name":"c","rank":0,"incarnation":175,"state":"up:creating","state_seq":2,"addr":"172.21.15.174:6835/4116799507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":4116799507},{"type":"v1","addr":"172.21.15.174:6835","nonce":4116799507}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[35],"metadata_pool":34,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":17}]} 2019-11-28T11:58:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.874+0000 7f4fcd30c700 1 -- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fa0018780 msgr2=0x7f4fa001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.874+0000 7f4fcd30c700 1 --2- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fa0018780 0x7f4fa001abf0 crc :-1 s=READY pgs=1150 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.874+0000 7f4fcd30c700 1 -- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc8104c10 msgr2=0x7f4fc81050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:02.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.874+0000 7f4fcd30c700 1 --2- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc8104c10 0x7f4fc81050a0 secure :-1 s=READY pgs=1687 cs=0 l=1 rx=0x7f4fb80103a0 tx=0x7f4fb8010740).stop 2019-11-28T11:58:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.874+0000 7f4fcd30c700 1 -- 172.21.15.80:0/963924340 shutdown_connections 2019-11-28T11:58:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.874+0000 7f4fcd30c700 1 --2- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fc8104c10 0x7f4fc81050a0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.874+0000 7f4fcd30c700 1 --2- 172.21.15.80:0/963924340 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4fa0018780 0x7f4fa001abf0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.874+0000 7f4fcd30c700 1 -- 172.21.15.80:0/963924340 shutdown_connections 2019-11-28T11:58:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.874+0000 7f4fcd30c700 1 -- 172.21.15.80:0/963924340 wait complete. 2019-11-28T11:58:02.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:02.874+0000 7f4fcd30c700 1 -- 172.21.15.80:0/963924340 >> 172.21.15.80:0/963924340 conn(0x7f4fc813d620 msgr2=0x7f4fc813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:03.183 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7964}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 34, u'failed': [], u'epoch': 175, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [35], u'info': {u'gid_7964': {u'export_targets': [], u'name': u'c', u'incarnation': 175, u'state_seq': 2, u'state': u'up:creating', u'gid': 7964, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 4116799507, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 4116799507, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/4116799507'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:57:55.569453+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:58:02.814612+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:58:03.183 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7964:up:creating 2019-11-28T11:58:04.184 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:58:04.308 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.307+0000 7f46b9b92700 1 Processor -- start 2019-11-28T11:58:04.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.307+0000 7f46b9b92700 1 -- start start 2019-11-28T11:58:04.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.308+0000 7f46b9b92700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46b406c490 0x7f46b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:04.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.308+0000 7f46b9b92700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f46b406ce60 0x7f46b4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:04.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.308+0000 7f46b9b92700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b406db00 con 0x7f46b406c0a0 2019-11-28T11:58:04.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.308+0000 7f46b9b92700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b406fd60 con 0x7f46b406ce60 2019-11-28T11:58:04.309 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.308+0000 7f46b9b92700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b4070030 con 0x7f46b406c490 2019-11-28T11:58:04.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.308+0000 7f46b3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f46b406c0a0 0x7f46b4072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45732/0 (socket says 172.21.15.80:45732) 2019-11-28T11:58:04.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.308+0000 7f46b3fff700 1 -- 172.21.15.80:0/2608931390 learned_addr learned my addr 172.21.15.80:0/2608931390 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:04.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46abfff700 1 --2- 172.21.15.80:0/2608931390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46b406c490 0x7f46b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:04.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46b8930700 1 --2- 172.21.15.80:0/2608931390 >> v2:172.21.15.174:3300/0 conn(0x7f46b406ce60 0x7f46b4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:04.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46b37fe700 1 -- 172.21.15.80:0/2608931390 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377814122 0 0) 0x7f46a4001150 con 0x7f46b406c0a0 2019-11-28T11:58:04.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46b37fe700 1 -- 172.21.15.80:0/2608931390 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46a0002e80 con 0x7f46b406c0a0 2019-11-28T11:58:04.310 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46b37fe700 1 -- 172.21.15.80:0/2608931390 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2744471419 0 0) 0x7f46a4001130 con 0x7f46b406c0a0 2019-11-28T11:58:04.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46abfff700 1 -- 172.21.15.80:0/2608931390 >> v2:172.21.15.174:3300/0 conn(0x7f46b406ce60 msgr2=0x7f46b4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:04.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46abfff700 1 --2- 172.21.15.80:0/2608931390 >> v2:172.21.15.174:3300/0 conn(0x7f46b406ce60 0x7f46b4164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:04.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46abfff700 1 -- 172.21.15.80:0/2608931390 >> v1:172.21.15.80:6789/0 conn(0x7f46b406c0a0 legacy=0x7f46b4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:04.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46abfff700 1 -- 172.21.15.80:0/2608931390 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b40706c0 con 0x7f46b406c490 2019-11-28T11:58:04.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46b8930700 1 --2- 172.21.15.80:0/2608931390 >> v2:172.21.15.174:3300/0 conn(0x7f46b406ce60 0x7f46b4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:04.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46abfff700 1 --2- 172.21.15.80:0/2608931390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46b406c490 0x7f46b406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f469c00af50 tx=0x7f469c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:04.311 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46abfff700 1 --2- 172.21.15.80:0/2608931390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46b406c490 0x7f46b406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f469c00af50 tx=0x7f469c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:04.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46abfff700 1 --2- 172.21.15.80:0/2608931390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46b406c490 0x7f46b406c920 secure :-1 s=READY pgs=401 cs=0 l=1 rx=0x7f469c00af50 tx=0x7f469c00b760).ready entity=mon.2 client_cookie=dc53ea22a115099c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:04.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46abfff700 1 --2- 172.21.15.80:0/2608931390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46b406c490 0x7f46b406c920 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7f469c00af50 tx=0x7f469c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:04.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46b37fe700 1 -- 172.21.15.80:0/2608931390 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f469c007210 con 0x7f46b406c490 2019-11-28T11:58:04.312 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46abfff700 1 --2- 172.21.15.80:0/2608931390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46b406c490 0x7f46b406c920 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7f469c00af50 tx=0x7f469c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:04.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46abfff700 1 --2- 172.21.15.80:0/2608931390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46b406c490 0x7f46b406c920 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7f469c00af50 tx=0x7f469c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:04.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46b37fe700 1 -- 172.21.15.80:0/2608931390 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c0099b0 con 0x7f46b406c490 2019-11-28T11:58:04.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46b37fe700 1 -- 172.21.15.80:0/2608931390 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f469c00a080 con 0x7f46b406c490 2019-11-28T11:58:04.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46b9b92700 1 -- 172.21.15.80:0/2608931390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46b406c490 msgr2=0x7f46b406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:04.313 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.309+0000 7f46b9b92700 1 --2- 172.21.15.80:0/2608931390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46b406c490 0x7f46b406c920 secure :-1 s=READY pgs=401 cs=0 l=1 rx=0x7f469c00af50 tx=0x7f469c00b760).stop 2019-11-28T11:58:04.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.310+0000 7f46b9b92700 1 -- 172.21.15.80:0/2608931390 shutdown_connections 2019-11-28T11:58:04.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.310+0000 7f46b9b92700 1 --2- 172.21.15.80:0/2608931390 >> v2:172.21.15.174:3300/0 conn(0x7f46b406ce60 0x7f46b4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:04.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.310+0000 7f46b9b92700 1 --2- 172.21.15.80:0/2608931390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f46b406c490 0x7f46b406c920 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:04.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.310+0000 7f46b9b92700 1 -- 172.21.15.80:0/2608931390 shutdown_connections 2019-11-28T11:58:04.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.310+0000 7f46b9b92700 1 -- 172.21.15.80:0/2608931390 wait complete. 2019-11-28T11:58:04.314 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.310+0000 7f46b9b92700 1 -- 172.21.15.80:0/2608931390 >> 172.21.15.80:0/2608931390 conn(0x7f46b4061cf0 msgr2=0x7f46b4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:04.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.312+0000 7f46b9b92700 1 Processor -- start 2019-11-28T11:58:04.315 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.313+0000 7f46b9b92700 1 -- start start 2019-11-28T11:58:04.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.313+0000 7f46b9b92700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f46b4109e40 0x7f46b410a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:04.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.313+0000 7f46b9b92700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b413f1e0 con 0x7f46b413eb40 2019-11-28T11:58:04.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.313+0000 7f46b9b92700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b4131a30 con 0x7f46b410a810 2019-11-28T11:58:04.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.313+0000 7f46b9b92700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b41234c0 con 0x7f46b4109e40 2019-11-28T11:58:04.316 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.313+0000 7f46b3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f46b413eb40 0x7f46b410afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45738/0 (socket says 172.21.15.80:45738) 2019-11-28T11:58:04.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.313+0000 7f46b3fff700 1 -- 172.21.15.80:0/555918938 learned_addr learned my addr 172.21.15.80:0/555918938 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:04.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46abfff700 1 --2- 172.21.15.80:0/555918938 >> v2:172.21.15.174:3300/0 conn(0x7f46b4109e40 0x7f46b410a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:04.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46b17fa700 1 -- 172.21.15.80:0/555918938 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947161246 0 0) 0x7f46a4000f40 con 0x7f46b413eb40 2019-11-28T11:58:04.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46b17fa700 1 -- 172.21.15.80:0/555918938 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4698002e80 con 0x7f46b413eb40 2019-11-28T11:58:04.320 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46b17fa700 1 -- 172.21.15.80:0/555918938 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3670959955 0 0) 0x7f46a4000c90 con 0x7f46b413eb40 2019-11-28T11:58:04.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46abfff700 1 -- 172.21.15.80:0/555918938 >> v1:172.21.15.174:6789/0 conn(0x7f46b410a810 legacy=0x7f46b4105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:04.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46abfff700 1 -- 172.21.15.80:0/555918938 >> v1:172.21.15.80:6789/0 conn(0x7f46b413eb40 legacy=0x7f46b410afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:04.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46abfff700 1 -- 172.21.15.80:0/555918938 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4108700 con 0x7f46b4109e40 2019-11-28T11:58:04.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46abfff700 1 --2- 172.21.15.80:0/555918938 >> v2:172.21.15.174:3300/0 conn(0x7f46b4109e40 0x7f46b410a2d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f469c010370 tx=0x7f469c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:04.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46abfff700 1 --2- 172.21.15.80:0/555918938 >> v2:172.21.15.174:3300/0 conn(0x7f46b4109e40 0x7f46b410a2d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f469c010370 tx=0x7f469c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:04.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46abfff700 1 --2- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46b4109e40 0x7f46b410a2d0 secure :-1 s=READY pgs=1689 cs=0 l=1 rx=0x7f469c010370 tx=0x7f469c010710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:04.321 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46abfff700 1 --2- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46b4109e40 0x7f46b410a2d0 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f469c010370 tx=0x7f469c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:04.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46b17fa700 1 -- 172.21.15.80:0/555918938 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f469c000940 con 0x7f46b4109e40 2019-11-28T11:58:04.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46abfff700 1 --2- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46b4109e40 0x7f46b410a2d0 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f469c010370 tx=0x7f469c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:04.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46abfff700 1 --2- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46b4109e40 0x7f46b410a2d0 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f469c010370 tx=0x7f469c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:04.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46b17fa700 1 -- 172.21.15.80:0/555918938 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c009810 con 0x7f46b4109e40 2019-11-28T11:58:04.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46b9b92700 1 -- 172.21.15.80:0/555918938 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b4108a80 con 0x7f46b4109e40 2019-11-28T11:58:04.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46b17fa700 1 -- 172.21.15.80:0/555918938 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f469c009ee0 con 0x7f46b4109e40 2019-11-28T11:58:04.322 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.314+0000 7f46b9b92700 1 -- 172.21.15.80:0/555918938 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b4108700 con 0x7f46b4109e40 2019-11-28T11:58:04.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.315+0000 7f46abfff700 1 --2- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46b4109e40 0x7f46b410a2d0 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f469c010370 tx=0x7f469c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:04.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.315+0000 7f46b17fa700 1 -- 172.21.15.80:0/555918938 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f469c009a00 con 0x7f46b4109e40 2019-11-28T11:58:04.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.315+0000 7f46abfff700 1 --2- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46b4109e40 0x7f46b410a2d0 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f469c010370 tx=0x7f469c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:04.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.315+0000 7f46b17fa700 1 --2- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4698018780 0x7f469801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:04.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.315+0000 7f46b17fa700 1 -- 172.21.15.80:0/555918938 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f469c031a20 con 0x7f46b4109e40 2019-11-28T11:58:04.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.315+0000 7f46b3fff700 1 --2- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4698018780 0x7f469801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:04.323 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.316+0000 7f46b3fff700 1 --2- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4698018780 0x7f469801abf0 crc :-1 s=READY pgs=1154 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:04.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.322+0000 7f46b9b92700 1 -- 172.21.15.80:0/555918938 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b4108a80 con 0x7f46b4109e40 2019-11-28T11:58:04.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.326+0000 7f46abfff700 1 --2- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46b4109e40 0x7f46b410a2d0 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f469c010370 tx=0x7f469c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:04.324 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.326+0000 7f46b17fa700 1 -- 172.21.15.80:0/555918938 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f469c0137d0 con 0x7f46b4109e40 2019-11-28T11:58:04.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.498+0000 7f46b9b92700 1 -- 172.21.15.80:0/555918938 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46b4108700 con 0x7f46b4109e40 2019-11-28T11:58:04.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.498+0000 7f46abfff700 1 --2- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46b4109e40 0x7f46b410a2d0 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f469c010370 tx=0x7f469c010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:04.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.498+0000 7f46b17fa700 1 -- 172.21.15.80:0/555918938 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 176 v176) v1 ==== 95+0+2457 (secure 0 0 0) 0x7f469c0137d0 con 0x7f46b4109e40 2019-11-28T11:58:04.496 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 176 2019-11-28T11:58:04.497 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:04.497 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":176,"default_fscid":17,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":11371,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/4086131539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":4086131539},{"type":"v1","addr":"172.21.15.80:6835","nonce":4086131539}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":174},{"gid":12102,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2858222423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2858222423},{"type":"v1","addr":"172.21.15.80:6834","nonce":2858222423}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":174}],"filesystems":[{"mdsmap":{"epoch":176,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:57:55.569453+0000","modified":"2019-11-28T11:58:03.818681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7964":{"gid":7964,"name":"c","rank":0,"incarnation":175,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/4116799507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":4116799507},{"type":"v1","addr":"172.21.15.174:6835","nonce":4116799507}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[35],"metadata_pool":34,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":17}]} 2019-11-28T11:58:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.501+0000 7f46b9b92700 1 -- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4698018780 msgr2=0x7f469801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:04.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.501+0000 7f46b9b92700 1 --2- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4698018780 0x7f469801abf0 crc :-1 s=READY pgs=1154 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:04.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.501+0000 7f46b9b92700 1 -- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46b4109e40 msgr2=0x7f46b410a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:04.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.501+0000 7f46b9b92700 1 --2- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46b4109e40 0x7f46b410a2d0 secure :-1 s=READY pgs=1689 cs=0 l=1 rx=0x7f469c010370 tx=0x7f469c010710).stop 2019-11-28T11:58:04.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.501+0000 7f46b9b92700 1 -- 172.21.15.80:0/555918938 shutdown_connections 2019-11-28T11:58:04.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.501+0000 7f46b9b92700 1 --2- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4698018780 0x7f469801abf0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:04.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.501+0000 7f46b9b92700 1 --2- 172.21.15.80:0/555918938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46b4109e40 0x7f46b410a2d0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:04.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.501+0000 7f46b9b92700 1 -- 172.21.15.80:0/555918938 shutdown_connections 2019-11-28T11:58:04.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.501+0000 7f46b9b92700 1 -- 172.21.15.80:0/555918938 wait complete. 2019-11-28T11:58:04.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:04.501+0000 7f46b9b92700 1 -- 172.21.15.80:0/555918938 >> 172.21.15.80:0/555918938 conn(0x7f46b411bfc0 msgr2=0x7f46b4141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:04.821 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7964}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 34, u'failed': [], u'epoch': 176, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [35], u'info': {u'gid_7964': {u'export_targets': [], u'name': u'c', u'incarnation': 175, u'state_seq': 3, u'state': u'up:active', u'gid': 7964, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 4116799507, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 4116799507, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/4116799507'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:57:55.569453+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:58:03.818681+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:58:04.821 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:58:04.822 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:58:04.953 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:58:04.953 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:58:04.953 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:58:04.953 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 7964, 2019-11-28T11:58:04.953 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:58:04.954 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:58:04.954 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 2.138040052, 2019-11-28T11:58:04.954 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 176, 2019-11-28T11:58:04.954 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 213, 2019-11-28T11:58:04.954 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 213, 2019-11-28T11:58:04.954 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 6.9539754719999998 2019-11-28T11:58:04.954 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:58:04.958 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7964, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.138040052, "mdsmap_epoch": 176, "osdmap_epoch": 213, "osdmap_epoch_barrier": 213, "uptime": 6.9539754719999998 } 2019-11-28T11:58:04.959 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:58:05.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.081+0000 7ff857450700 1 Processor -- start 2019-11-28T11:58:05.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.081+0000 7ff857450700 1 -- start start 2019-11-28T11:58:05.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.082+0000 7ff857450700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff85006d120 0x7ff850165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:05.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.082+0000 7ff857450700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85006d5a0 con 0x7ff85006c0a0 2019-11-28T11:58:05.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.082+0000 7ff857450700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85006db00 con 0x7ff85006c490 2019-11-28T11:58:05.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.082+0000 7ff857450700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85006fd60 con 0x7ff85006d120 2019-11-28T11:58:05.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.082+0000 7ff8559ed700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff85006c0a0 0x7ff850072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45746/0 (socket says 172.21.15.80:45746) 2019-11-28T11:58:05.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.082+0000 7ff8559ed700 1 -- 172.21.15.80:0/843759305 learned_addr learned my addr 172.21.15.80:0/843759305 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:05.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.082+0000 7ff8561ee700 1 --2- 172.21.15.80:0/843759305 >> v2:172.21.15.174:3300/0 conn(0x7ff85006d120 0x7ff850165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.082+0000 7ff8549eb700 1 -- 172.21.15.80:0/843759305 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229737424 0 0) 0x7ff8380014d0 con 0x7ff85006c0a0 2019-11-28T11:58:05.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.082+0000 7ff8549eb700 1 -- 172.21.15.80:0/843759305 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff83c002e80 con 0x7ff85006c0a0 2019-11-28T11:58:05.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.082+0000 7ff8549eb700 1 -- 172.21.15.80:0/843759305 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2660261631 0 0) 0x7ff8380014b0 con 0x7ff85006c0a0 2019-11-28T11:58:05.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.082+0000 7ff8549eb700 1 -- 172.21.15.80:0/843759305 >> v2:172.21.15.174:3300/0 conn(0x7ff85006d120 msgr2=0x7ff850165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:05.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.082+0000 7ff8549eb700 1 --2- 172.21.15.80:0/843759305 >> v2:172.21.15.174:3300/0 conn(0x7ff85006d120 0x7ff850165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:05.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.082+0000 7ff8549eb700 1 -- 172.21.15.80:0/843759305 >> v1:172.21.15.174:6789/0 conn(0x7ff85006c490 legacy=0x7ff85006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.082+0000 7ff8549eb700 1 -- 172.21.15.80:0/843759305 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8500706c0 con 0x7ff85006c0a0 2019-11-28T11:58:05.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8549eb700 1 -- 172.21.15.80:0/843759305 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff838001a40 con 0x7ff85006c0a0 2019-11-28T11:58:05.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8549eb700 1 -- 172.21.15.80:0/843759305 >> v1:172.21.15.80:6789/0 conn(0x7ff85006c0a0 legacy=0x7ff850072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8549eb700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff83c003ab0 0x7ff83c005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:05.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8549eb700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff83c006690 0x7ff83c008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:05.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8549eb700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff83c009380 0x7ff83c00b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:05.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8549eb700 1 -- 172.21.15.80:0/843759305 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c00c000 con 0x7ff83c003ab0 2019-11-28T11:58:05.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8549eb700 1 -- 172.21.15.80:0/843759305 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c050200 con 0x7ff83c009380 2019-11-28T11:58:05.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8549eb700 1 -- 172.21.15.80:0/843759305 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c050430 con 0x7ff83c006690 2019-11-28T11:58:05.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8559ed700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff83c003ab0 0x7ff83c005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8561ee700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff83c009380 0x7ff83c00b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8551ec700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff83c006690 0x7ff83c008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8559ed700 1 -- 172.21.15.80:0/843759305 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff83c006690 msgr2=0x7ff83c008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:05.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8559ed700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff83c006690 0x7ff83c008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:05.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8559ed700 1 -- 172.21.15.80:0/843759305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff83c009380 msgr2=0x7ff83c00b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:05.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8559ed700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff83c009380 0x7ff83c00b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:05.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8559ed700 1 -- 172.21.15.80:0/843759305 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c0506e0 con 0x7ff83c003ab0 2019-11-28T11:58:05.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8561ee700 1 -- 172.21.15.80:0/843759305 reap_dead start 2019-11-28T11:58:05.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8551ec700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff83c006690 0x7ff83c008b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:58:05.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8559ed700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff83c003ab0 0x7ff83c005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff83800fc90 tx=0x7ff83800fb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8559ed700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff83c003ab0 0x7ff83c005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff83800fc90 tx=0x7ff83800fb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8559ed700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff83c003ab0 0x7ff83c005f10 secure :-1 s=READY pgs=2779 cs=0 l=1 rx=0x7ff83800fc90 tx=0x7ff83800fb90).ready entity=mon.0 client_cookie=7f07da6b3d0bf01f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:05.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8559ed700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff83c003ab0 0x7ff83c005f10 secure :-1 s=THROTTLE_DONE pgs=2779 cs=0 l=1 rx=0x7ff83800fc90 tx=0x7ff83800fb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8549eb700 1 -- 172.21.15.80:0/843759305 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8380014b0 con 0x7ff83c003ab0 2019-11-28T11:58:05.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8559ed700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff83c003ab0 0x7ff83c005f10 secure :-1 s=THROTTLE_DONE pgs=2779 cs=0 l=1 rx=0x7ff83800fc90 tx=0x7ff83800fb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8559ed700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff83c003ab0 0x7ff83c005f10 secure :-1 s=THROTTLE_DONE pgs=2779 cs=0 l=1 rx=0x7ff83800fc90 tx=0x7ff83800fb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8549eb700 1 -- 172.21.15.80:0/843759305 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8380045c0 con 0x7ff83c003ab0 2019-11-28T11:58:05.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff8549eb700 1 -- 172.21.15.80:0/843759305 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff838004d10 con 0x7ff83c003ab0 2019-11-28T11:58:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff857450700 1 -- 172.21.15.80:0/843759305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff83c003ab0 msgr2=0x7ff83c005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.083+0000 7ff857450700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff83c003ab0 0x7ff83c005f10 secure :-1 s=READY pgs=2779 cs=0 l=1 rx=0x7ff83800fc90 tx=0x7ff83800fb90).stop 2019-11-28T11:58:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.084+0000 7ff857450700 1 -- 172.21.15.80:0/843759305 shutdown_connections 2019-11-28T11:58:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.084+0000 7ff857450700 1 --2- 172.21.15.80:0/843759305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff83c003ab0 0x7ff83c005f10 unknown :-1 s=CLOSED pgs=2779 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.084+0000 7ff857450700 1 -- 172.21.15.80:0/843759305 shutdown_connections 2019-11-28T11:58:05.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.084+0000 7ff857450700 1 -- 172.21.15.80:0/843759305 wait complete. 2019-11-28T11:58:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.084+0000 7ff857450700 1 -- 172.21.15.80:0/843759305 >> 172.21.15.80:0/843759305 conn(0x7ff850061cf0 msgr2=0x7ff850064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.087+0000 7ff857450700 1 Processor -- start 2019-11-28T11:58:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.087+0000 7ff857450700 1 -- start start 2019-11-28T11:58:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.087+0000 7ff857450700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8500750f0 0x7ff850151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.087+0000 7ff857450700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff850151f90 0x7ff850152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.087+0000 7ff857450700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff850079230 con 0x7ff850074d00 2019-11-28T11:58:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.087+0000 7ff857450700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85007ab30 con 0x7ff850151f90 2019-11-28T11:58:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.087+0000 7ff857450700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85007ae00 con 0x7ff8500750f0 2019-11-28T11:58:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff8559ed700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff850074d00 0x7ff850152bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45758/0 (socket says 172.21.15.80:45758) 2019-11-28T11:58:05.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff8559ed700 1 -- 172.21.15.80:0/473187415 learned_addr learned my addr 172.21.15.80:0/473187415 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:05.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff8551ec700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8500750f0 0x7ff850151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff8561ee700 1 --2- 172.21.15.80:0/473187415 >> v2:172.21.15.174:3300/0 conn(0x7ff850151f90 0x7ff850152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff84e7fc700 1 -- 172.21.15.80:0/473187415 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236567020 0 0) 0x7ff838001320 con 0x7ff850074d00 2019-11-28T11:58:05.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff84e7fc700 1 -- 172.21.15.80:0/473187415 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff834002e80 con 0x7ff850074d00 2019-11-28T11:58:05.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff8551ec700 1 -- 172.21.15.80:0/473187415 >> v2:172.21.15.174:3300/0 conn(0x7ff850151f90 msgr2=0x7ff850152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff8551ec700 1 --2- 172.21.15.80:0/473187415 >> v2:172.21.15.174:3300/0 conn(0x7ff850151f90 0x7ff850152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff8551ec700 1 -- 172.21.15.80:0/473187415 >> v1:172.21.15.80:6789/0 conn(0x7ff850074d00 legacy=0x7ff850152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff8551ec700 1 -- 172.21.15.80:0/473187415 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85007b490 con 0x7ff8500750f0 2019-11-28T11:58:05.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff8561ee700 1 --2- 172.21.15.80:0/473187415 >> v2:172.21.15.174:3300/0 conn(0x7ff850151f90 0x7ff850152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:05.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff8551ec700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8500750f0 0x7ff850151a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff840010390 tx=0x7ff840010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff8551ec700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8500750f0 0x7ff850151a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff840010390 tx=0x7ff840010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff8551ec700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8500750f0 0x7ff850151a50 secure :-1 s=READY pgs=402 cs=0 l=1 rx=0x7ff840010390 tx=0x7ff840010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:05.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff8551ec700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8500750f0 0x7ff850151a50 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7ff840010390 tx=0x7ff840010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff84e7fc700 1 -- 172.21.15.80:0/473187415 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff840009570 con 0x7ff8500750f0 2019-11-28T11:58:05.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff8551ec700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8500750f0 0x7ff850151a50 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7ff840010390 tx=0x7ff840010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff857450700 1 -- 172.21.15.80:0/473187415 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff85007b810 con 0x7ff8500750f0 2019-11-28T11:58:05.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff84e7fc700 1 -- 172.21.15.80:0/473187415 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff840009570 con 0x7ff8500750f0 2019-11-28T11:58:05.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff8551ec700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8500750f0 0x7ff850151a50 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7ff840010390 tx=0x7ff840010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.088+0000 7ff84e7fc700 1 -- 172.21.15.80:0/473187415 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff840009dd0 con 0x7ff8500750f0 2019-11-28T11:58:05.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.089+0000 7ff857450700 1 -- 172.21.15.80:0/473187415 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85007b490 con 0x7ff8500750f0 2019-11-28T11:58:05.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.089+0000 7ff8551ec700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8500750f0 0x7ff850151a50 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7ff840010390 tx=0x7ff840010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.089+0000 7ff84e7fc700 1 -- 172.21.15.80:0/473187415 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff84000a4f0 con 0x7ff8500750f0 2019-11-28T11:58:05.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.089+0000 7ff8551ec700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8500750f0 0x7ff850151a50 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7ff840010390 tx=0x7ff840010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.089+0000 7ff84e7fc700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff834018770 0x7ff83401ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:05.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.089+0000 7ff84e7fc700 1 -- 172.21.15.80:0/473187415 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff840031cd0 con 0x7ff8500750f0 2019-11-28T11:58:05.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.089+0000 7ff8559ed700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff834018770 0x7ff83401ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.090+0000 7ff8559ed700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff834018770 0x7ff83401ac00 crc :-1 s=READY pgs=1155 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:05.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.096+0000 7ff857450700 1 -- 172.21.15.80:0/473187415 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85007b810 con 0x7ff8500750f0 2019-11-28T11:58:05.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.100+0000 7ff8551ec700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8500750f0 0x7ff850151a50 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7ff840010390 tx=0x7ff840010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.100+0000 7ff84e7fc700 1 -- 172.21.15.80:0/473187415 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff84000a2c0 con 0x7ff8500750f0 2019-11-28T11:58:05.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.276+0000 7ff857450700 1 -- 172.21.15.80:0/473187415 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff85007b490 con 0x7ff8500750f0 2019-11-28T11:58:05.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.277+0000 7ff8551ec700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8500750f0 0x7ff850151a50 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7ff840010390 tx=0x7ff840010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.277+0000 7ff84e7fc700 1 -- 172.21.15.80:0/473187415 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v213) v1 ==== 74+0+14871 (secure 0 0 0) 0x7ff84000a4d0 con 0x7ff8500750f0 2019-11-28T11:58:05.276 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:05.276 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":213,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:57:56.570576+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":35,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":34,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:57:53.888806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":35,"pool_name":"cephfs_data","create_time":"2019-11-28T11:57:54.582023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"213","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:58:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.281+0000 7ff857450700 1 -- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff834018770 msgr2=0x7ff83401ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.281+0000 7ff857450700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff834018770 0x7ff83401ac00 crc :-1 s=READY pgs=1155 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.281+0000 7ff857450700 1 -- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8500750f0 msgr2=0x7ff850151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.281+0000 7ff857450700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8500750f0 0x7ff850151a50 secure :-1 s=READY pgs=402 cs=0 l=1 rx=0x7ff840010390 tx=0x7ff840010730).stop 2019-11-28T11:58:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.281+0000 7ff857450700 1 -- 172.21.15.80:0/473187415 shutdown_connections 2019-11-28T11:58:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.281+0000 7ff857450700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff834018770 0x7ff83401ac00 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.281+0000 7ff857450700 1 --2- 172.21.15.80:0/473187415 >> v2:172.21.15.174:3300/0 conn(0x7ff850151f90 0x7ff850152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.281+0000 7ff857450700 1 --2- 172.21.15.80:0/473187415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8500750f0 0x7ff850151a50 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.281+0000 7ff857450700 1 -- 172.21.15.80:0/473187415 shutdown_connections 2019-11-28T11:58:05.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.281+0000 7ff857450700 1 -- 172.21.15.80:0/473187415 wait complete. 2019-11-28T11:58:05.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.281+0000 7ff857450700 1 -- 172.21.15.80:0/473187415 >> 172.21.15.80:0/473187415 conn(0x7ff85013fa50 msgr2=0x7ff85007c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:05.288 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:57:53.888806+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 34, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'212', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:57:54.582023+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 35, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'213', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:58:05.289 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:58:05.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.415+0000 7ff3d656e700 1 Processor -- start 2019-11-28T11:58:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.415+0000 7ff3d656e700 1 -- start start 2019-11-28T11:58:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3d656e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff3d015ed10 0x7ff3d015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3d656e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff3d0073020 0x7ff3d0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3d656e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d006db60 con 0x7ff3d00734b0 2019-11-28T11:58:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3d656e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d006fe00 con 0x7ff3d0073020 2019-11-28T11:58:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3d656e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d00700d0 con 0x7ff3d015ed10 2019-11-28T11:58:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3cffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff3d0073020 0x7ff3d0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3cffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff3d0073020 0x7ff3d0071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46450/0 (socket says 172.21.15.80:46450) 2019-11-28T11:58:05.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3cffff700 1 -- 172.21.15.80:0/3818375467 learned_addr learned my addr 172.21.15.80:0/3818375467 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:05.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3d4b0b700 1 --2- 172.21.15.80:0/3818375467 >> v2:172.21.15.174:3300/0 conn(0x7ff3d015ed10 0x7ff3d015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3cffff700 1 -- 172.21.15.80:0/3818375467 >> v2:172.21.15.174:3300/0 conn(0x7ff3d015ed10 msgr2=0x7ff3d015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:05.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3cffff700 1 --2- 172.21.15.80:0/3818375467 >> v2:172.21.15.174:3300/0 conn(0x7ff3d015ed10 0x7ff3d015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:05.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3cffff700 1 -- 172.21.15.80:0/3818375467 >> v1:172.21.15.174:6789/0 conn(0x7ff3d00734b0 legacy=0x7ff3d00723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:05.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3cffff700 1 -- 172.21.15.80:0/3818375467 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d0070760 con 0x7ff3d0073020 2019-11-28T11:58:05.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3d4b0b700 1 --2- 172.21.15.80:0/3818375467 >> v2:172.21.15.174:3300/0 conn(0x7ff3d015ed10 0x7ff3d015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:58:05.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3cffff700 1 --2- 172.21.15.80:0/3818375467 >> v2:172.21.15.80:3300/0 conn(0x7ff3d0073020 0x7ff3d0071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff3c000f740 tx=0x7ff3c000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3cffff700 1 --2- 172.21.15.80:0/3818375467 >> v2:172.21.15.80:3300/0 conn(0x7ff3d0073020 0x7ff3d0071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff3c000f740 tx=0x7ff3c000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.416+0000 7ff3cffff700 1 --2- 172.21.15.80:0/3818375467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0073020 0x7ff3d0071ea0 secure :-1 s=READY pgs=2781 cs=0 l=1 rx=0x7ff3c000f740 tx=0x7ff3c000fae0).ready entity=mon.0 client_cookie=14adb44fdd7b65fd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:05.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.417+0000 7ff3cffff700 1 --2- 172.21.15.80:0/3818375467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0073020 0x7ff3d0071ea0 secure :-1 s=THROTTLE_DONE pgs=2781 cs=0 l=1 rx=0x7ff3c000f740 tx=0x7ff3c000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.417+0000 7ff3cf7fe700 1 -- 172.21.15.80:0/3818375467 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3c0000960 con 0x7ff3d0073020 2019-11-28T11:58:05.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.417+0000 7ff3cffff700 1 --2- 172.21.15.80:0/3818375467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0073020 0x7ff3d0071ea0 secure :-1 s=THROTTLE_DONE pgs=2781 cs=0 l=1 rx=0x7ff3c000f740 tx=0x7ff3c000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.417+0000 7ff3cffff700 1 --2- 172.21.15.80:0/3818375467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0073020 0x7ff3d0071ea0 secure :-1 s=THROTTLE_DONE pgs=2781 cs=0 l=1 rx=0x7ff3c000f740 tx=0x7ff3c000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.417+0000 7ff3cf7fe700 1 -- 172.21.15.80:0/3818375467 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c0007210 con 0x7ff3d0073020 2019-11-28T11:58:05.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.417+0000 7ff3cf7fe700 1 -- 172.21.15.80:0/3818375467 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3c0000e80 con 0x7ff3d0073020 2019-11-28T11:58:05.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.417+0000 7ff3d656e700 1 -- 172.21.15.80:0/3818375467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0073020 msgr2=0x7ff3d0071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.417+0000 7ff3d656e700 1 --2- 172.21.15.80:0/3818375467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0073020 0x7ff3d0071ea0 secure :-1 s=READY pgs=2781 cs=0 l=1 rx=0x7ff3c000f740 tx=0x7ff3c000fae0).stop 2019-11-28T11:58:05.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.417+0000 7ff3d656e700 1 -- 172.21.15.80:0/3818375467 shutdown_connections 2019-11-28T11:58:05.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.417+0000 7ff3d656e700 1 --2- 172.21.15.80:0/3818375467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0073020 0x7ff3d0071ea0 unknown :-1 s=CLOSED pgs=2781 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.417+0000 7ff3d656e700 1 --2- 172.21.15.80:0/3818375467 >> v2:172.21.15.174:3300/0 conn(0x7ff3d015ed10 0x7ff3d015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:05.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.417+0000 7ff3d656e700 1 -- 172.21.15.80:0/3818375467 shutdown_connections 2019-11-28T11:58:05.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.417+0000 7ff3d656e700 1 -- 172.21.15.80:0/3818375467 wait complete. 2019-11-28T11:58:05.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.417+0000 7ff3d656e700 1 -- 172.21.15.80:0/3818375467 >> 172.21.15.80:0/3818375467 conn(0x7ff3d0061d20 msgr2=0x7ff3d00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:05.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.420+0000 7ff3d656e700 1 Processor -- start 2019-11-28T11:58:05.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.420+0000 7ff3d656e700 1 -- start start 2019-11-28T11:58:05.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3d656e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3d010e970 0x7ff3d01087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:05.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3d656e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff3d0107e30 0x7ff3d0167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:05.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3d656e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d010c250 con 0x7ff3d0108cf0 2019-11-28T11:58:05.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3d656e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d010da00 con 0x7ff3d0107e30 2019-11-28T11:58:05.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3d656e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d010e430 con 0x7ff3d010e970 2019-11-28T11:58:05.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3d530c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff3d0107e30 0x7ff3d0167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3cffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff3d0108cf0 0x7ff3d0107630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45774/0 (socket says 172.21.15.80:45774) 2019-11-28T11:58:05.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3cffff700 1 -- 172.21.15.80:0/2108236618 learned_addr learned my addr 172.21.15.80:0/2108236618 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:05.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3d4b0b700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3d010e970 0x7ff3d01087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3d530c700 1 -- 172.21.15.80:0/2108236618 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3d010e970 msgr2=0x7ff3d01087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3d530c700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3d010e970 0x7ff3d01087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3d530c700 1 -- 172.21.15.80:0/2108236618 >> v1:172.21.15.80:6789/0 conn(0x7ff3d0108cf0 legacy=0x7ff3d0107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3cd7fa700 1 -- 172.21.15.80:0/2108236618 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108086981 0 0) 0x7ff3c00075d0 con 0x7ff3d0108cf0 2019-11-28T11:58:05.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3d530c700 1 -- 172.21.15.80:0/2108236618 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d0105ef0 con 0x7ff3d0107e30 2019-11-28T11:58:05.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3d530c700 1 --2- 172.21.15.80:0/2108236618 >> v2:172.21.15.80:3300/0 conn(0x7ff3d0107e30 0x7ff3d0167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff3c8010730 tx=0x7ff3c800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3d530c700 1 --2- 172.21.15.80:0/2108236618 >> v2:172.21.15.80:3300/0 conn(0x7ff3d0107e30 0x7ff3d0167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff3c8010730 tx=0x7ff3c800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3d530c700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0107e30 0x7ff3d0167d70 secure :-1 s=READY pgs=2783 cs=0 l=1 rx=0x7ff3c8010730 tx=0x7ff3c800b670).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:05.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3d530c700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0107e30 0x7ff3d0167d70 secure :-1 s=THROTTLE_DONE pgs=2783 cs=0 l=1 rx=0x7ff3c8010730 tx=0x7ff3c800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.421+0000 7ff3cd7fa700 1 -- 172.21.15.80:0/2108236618 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3c8000dd0 con 0x7ff3d0107e30 2019-11-28T11:58:05.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.422+0000 7ff3d530c700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0107e30 0x7ff3d0167d70 secure :-1 s=THROTTLE_DONE pgs=2783 cs=0 l=1 rx=0x7ff3c8010730 tx=0x7ff3c800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.422+0000 7ff3d530c700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0107e30 0x7ff3d0167d70 secure :-1 s=THROTTLE_DONE pgs=2783 cs=0 l=1 rx=0x7ff3c8010730 tx=0x7ff3c800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.422+0000 7ff3cd7fa700 1 -- 172.21.15.80:0/2108236618 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c800f160 con 0x7ff3d0107e30 2019-11-28T11:58:05.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.422+0000 7ff3d656e700 1 -- 172.21.15.80:0/2108236618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d0106270 con 0x7ff3d0107e30 2019-11-28T11:58:05.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.422+0000 7ff3cd7fa700 1 -- 172.21.15.80:0/2108236618 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3c800f870 con 0x7ff3d0107e30 2019-11-28T11:58:05.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.422+0000 7ff3d656e700 1 -- 172.21.15.80:0/2108236618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d0105ef0 con 0x7ff3d0107e30 2019-11-28T11:58:05.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.422+0000 7ff3d530c700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0107e30 0x7ff3d0167d70 secure :-1 s=THROTTLE_DONE pgs=2783 cs=0 l=1 rx=0x7ff3c8010730 tx=0x7ff3c800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.423+0000 7ff3cd7fa700 1 -- 172.21.15.80:0/2108236618 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff3c8000cc0 con 0x7ff3d0107e30 2019-11-28T11:58:05.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.423+0000 7ff3d530c700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0107e30 0x7ff3d0167d70 secure :-1 s=THROTTLE_DONE pgs=2783 cs=0 l=1 rx=0x7ff3c8010730 tx=0x7ff3c800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.423+0000 7ff3cd7fa700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff3b4018730 0x7ff3b401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:05.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.423+0000 7ff3cd7fa700 1 -- 172.21.15.80:0/2108236618 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff3c8031dc0 con 0x7ff3d0107e30 2019-11-28T11:58:05.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.423+0000 7ff3d4b0b700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff3b4018730 0x7ff3b401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.423+0000 7ff3d4b0b700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff3b4018730 0x7ff3b401abc0 crc :-1 s=READY pgs=1156 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:05.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.430+0000 7ff3d656e700 1 -- 172.21.15.80:0/2108236618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d0106270 con 0x7ff3d0107e30 2019-11-28T11:58:05.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.433+0000 7ff3d530c700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0107e30 0x7ff3d0167d70 secure :-1 s=THROTTLE_DONE pgs=2783 cs=0 l=1 rx=0x7ff3c8010730 tx=0x7ff3c800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.433+0000 7ff3cd7fa700 1 -- 172.21.15.80:0/2108236618 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff3c8017590 con 0x7ff3d0107e30 2019-11-28T11:58:05.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.600+0000 7ff3d656e700 1 -- 172.21.15.80:0/2108236618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7ff3d0105ef0 con 0x7ff3d0107e30 2019-11-28T11:58:05.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.600+0000 7ff3d530c700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0107e30 0x7ff3d0167d70 secure :-1 s=THROTTLE_DONE pgs=2783 cs=0 l=1 rx=0x7ff3c8010730 tx=0x7ff3c800b670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.598 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.600+0000 7ff3cd7fa700 1 -- 172.21.15.80:0/2108236618 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v213) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff3c8000cc0 con 0x7ff3d0107e30 2019-11-28T11:58:05.598 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:58:05.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.603+0000 7ff3d656e700 1 -- 172.21.15.80:0/2108236618 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff3b4018730 msgr2=0x7ff3b401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.603+0000 7ff3d656e700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff3b4018730 0x7ff3b401abc0 crc :-1 s=READY pgs=1156 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.599 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.603+0000 7ff3d656e700 1 -- 172.21.15.80:0/2108236618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0107e30 msgr2=0x7ff3d0167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.603+0000 7ff3d656e700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0107e30 0x7ff3d0167d70 secure :-1 s=READY pgs=2783 cs=0 l=1 rx=0x7ff3c8010730 tx=0x7ff3c800b670).stop 2019-11-28T11:58:05.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.603+0000 7ff3d656e700 1 -- 172.21.15.80:0/2108236618 shutdown_connections 2019-11-28T11:58:05.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.603+0000 7ff3d656e700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff3b4018730 0x7ff3b401abc0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.603+0000 7ff3d656e700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff3d0107e30 0x7ff3d0167d70 unknown :-1 s=CLOSED pgs=2783 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.603+0000 7ff3d656e700 1 --2- 172.21.15.80:0/2108236618 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3d010e970 0x7ff3d01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.603+0000 7ff3d656e700 1 -- 172.21.15.80:0/2108236618 shutdown_connections 2019-11-28T11:58:05.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.603+0000 7ff3d656e700 1 -- 172.21.15.80:0/2108236618 wait complete. 2019-11-28T11:58:05.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.603+0000 7ff3d656e700 1 -- 172.21.15.80:0/2108236618 >> 172.21.15.80:0/2108236618 conn(0x7ff3d015e2d0 msgr2=0x7ff3d0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:05.610 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:58:05.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.745+0000 7fad6dc5f700 1 Processor -- start 2019-11-28T11:58:05.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.745+0000 7fad6dc5f700 1 -- start start 2019-11-28T11:58:05.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad6dc5f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fad681639f0 0x7fad68165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:05.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad6dc5f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad6806db60 con 0x7fad6815f100 2019-11-28T11:58:05.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad6dc5f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad6806e060 con 0x7fad6815ed10 2019-11-28T11:58:05.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad6dc5f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6806fe00 con 0x7fad681639f0 2019-11-28T11:58:05.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad5ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fad6815f100 0x7fad6806bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45780/0 (socket says 172.21.15.80:45780) 2019-11-28T11:58:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad5ffff700 1 -- 172.21.15.80:0/167165138 learned_addr learned my addr 172.21.15.80:0/167165138 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad6c9fd700 1 --2- 172.21.15.80:0/167165138 >> v2:172.21.15.174:3300/0 conn(0x7fad681639f0 0x7fad68165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad677fe700 1 -- 172.21.15.80:0/167165138 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579719161 0 0) 0x7fad50001100 con 0x7fad6815f100 2019-11-28T11:58:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad677fe700 1 -- 172.21.15.80:0/167165138 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad54002e80 con 0x7fad6815f100 2019-11-28T11:58:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad677fe700 1 -- 172.21.15.80:0/167165138 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 850459403 0 0) 0x7fad500010e0 con 0x7fad6815f100 2019-11-28T11:58:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad677fe700 1 -- 172.21.15.80:0/167165138 >> v2:172.21.15.174:3300/0 conn(0x7fad681639f0 msgr2=0x7fad68165df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad677fe700 1 --2- 172.21.15.80:0/167165138 >> v2:172.21.15.174:3300/0 conn(0x7fad681639f0 0x7fad68165df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:05.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad677fe700 1 -- 172.21.15.80:0/167165138 >> v1:172.21.15.174:6789/0 conn(0x7fad6815ed10 legacy=0x7fad68073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad677fe700 1 -- 172.21.15.80:0/167165138 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad68070760 con 0x7fad6815f100 2019-11-28T11:58:05.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad677fe700 1 -- 172.21.15.80:0/167165138 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fad50001650 con 0x7fad6815f100 2019-11-28T11:58:05.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad677fe700 1 -- 172.21.15.80:0/167165138 >> v1:172.21.15.80:6789/0 conn(0x7fad6815f100 legacy=0x7fad6806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad677fe700 1 --2- 172.21.15.80:0/167165138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad54003ab0 0x7fad54005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:05.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad677fe700 1 --2- 172.21.15.80:0/167165138 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad54006670 0x7fad54008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:05.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad677fe700 1 --2- 172.21.15.80:0/167165138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad540093a0 0x7fad5400b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.746+0000 7fad677fe700 1 -- 172.21.15.80:0/167165138 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5400c020 con 0x7fad540093a0 2019-11-28T11:58:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad677fe700 1 -- 172.21.15.80:0/167165138 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad54050220 con 0x7fad54003ab0 2019-11-28T11:58:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad677fe700 1 -- 172.21.15.80:0/167165138 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad54050450 con 0x7fad54006670 2019-11-28T11:58:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad6c9fd700 1 --2- 172.21.15.80:0/167165138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad540093a0 0x7fad5400b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad67fff700 1 --2- 172.21.15.80:0/167165138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad54003ab0 0x7fad54005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad5ffff700 1 --2- 172.21.15.80:0/167165138 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad54006670 0x7fad54008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad6c9fd700 1 -- 172.21.15.80:0/167165138 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad54006670 msgr2=0x7fad54008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad6c9fd700 1 --2- 172.21.15.80:0/167165138 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad54006670 0x7fad54008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad6c9fd700 1 -- 172.21.15.80:0/167165138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad54003ab0 msgr2=0x7fad54005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad6c9fd700 1 --2- 172.21.15.80:0/167165138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad54003ab0 0x7fad54005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad6c9fd700 1 -- 172.21.15.80:0/167165138 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad54050700 con 0x7fad540093a0 2019-11-28T11:58:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad6c9fd700 1 --2- 172.21.15.80:0/167165138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad540093a0 0x7fad5400b870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fad6000ebb0 tx=0x7fad6000eae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad6c9fd700 1 -- 172.21.15.80:0/167165138 reap_dead start 2019-11-28T11:58:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad6c9fd700 1 --2- 172.21.15.80:0/167165138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad540093a0 0x7fad5400b870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fad6000ebb0 tx=0x7fad6000eae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad6c9fd700 1 --2- 172.21.15.80:0/167165138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad540093a0 0x7fad5400b870 secure :-1 s=READY pgs=2785 cs=0 l=1 rx=0x7fad6000ebb0 tx=0x7fad6000eae0).ready entity=mon.0 client_cookie=70d8b2aa8212a0c8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:05.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad6c9fd700 1 --2- 172.21.15.80:0/167165138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad540093a0 0x7fad5400b870 secure :-1 s=THROTTLE_DONE pgs=2785 cs=0 l=1 rx=0x7fad6000ebb0 tx=0x7fad6000eae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad6c9fd700 1 --2- 172.21.15.80:0/167165138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad540093a0 0x7fad5400b870 secure :-1 s=THROTTLE_DONE pgs=2785 cs=0 l=1 rx=0x7fad6000ebb0 tx=0x7fad6000eae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad677fe700 1 -- 172.21.15.80:0/167165138 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad6000f130 con 0x7fad540093a0 2019-11-28T11:58:05.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad6c9fd700 1 --2- 172.21.15.80:0/167165138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad540093a0 0x7fad5400b870 secure :-1 s=THROTTLE_DONE pgs=2785 cs=0 l=1 rx=0x7fad6000ebb0 tx=0x7fad6000eae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad677fe700 1 -- 172.21.15.80:0/167165138 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6000ed50 con 0x7fad540093a0 2019-11-28T11:58:05.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad677fe700 1 -- 172.21.15.80:0/167165138 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad6000f7b0 con 0x7fad540093a0 2019-11-28T11:58:05.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad6dc5f700 1 -- 172.21.15.80:0/167165138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad540093a0 msgr2=0x7fad5400b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.747+0000 7fad6dc5f700 1 --2- 172.21.15.80:0/167165138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad540093a0 0x7fad5400b870 secure :-1 s=READY pgs=2785 cs=0 l=1 rx=0x7fad6000ebb0 tx=0x7fad6000eae0).stop 2019-11-28T11:58:05.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.748+0000 7fad6dc5f700 1 -- 172.21.15.80:0/167165138 shutdown_connections 2019-11-28T11:58:05.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.748+0000 7fad6dc5f700 1 --2- 172.21.15.80:0/167165138 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad540093a0 0x7fad5400b870 unknown :-1 s=CLOSED pgs=2785 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.748+0000 7fad6dc5f700 1 -- 172.21.15.80:0/167165138 shutdown_connections 2019-11-28T11:58:05.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.748+0000 7fad6dc5f700 1 -- 172.21.15.80:0/167165138 wait complete. 2019-11-28T11:58:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.748+0000 7fad6dc5f700 1 -- 172.21.15.80:0/167165138 >> 172.21.15.80:0/167165138 conn(0x7fad68061d20 msgr2=0x7fad680641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.750+0000 7fad6dc5f700 1 Processor -- start 2019-11-28T11:58:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.750+0000 7fad6dc5f700 1 -- start start 2019-11-28T11:58:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.751+0000 7fad6dc5f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad681502e0 0x7fad68150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.751+0000 7fad6dc5f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad68150cb0 0x7fad68167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:05.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.751+0000 7fad6dc5f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad68133a20 con 0x7fad68108630 2019-11-28T11:58:05.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.751+0000 7fad6dc5f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad68131980 con 0x7fad681502e0 2019-11-28T11:58:05.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.751+0000 7fad6dc5f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad68131c50 con 0x7fad68150cb0 2019-11-28T11:58:05.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.751+0000 7fad5ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad681502e0 0x7fad68150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.751+0000 7fad67fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fad68108630 0x7fad68151200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45792/0 (socket says 172.21.15.80:45792) 2019-11-28T11:58:05.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.751+0000 7fad67fff700 1 -- 172.21.15.80:0/911897278 learned_addr learned my addr 172.21.15.80:0/911897278 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:05.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.751+0000 7fad6c9fd700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad68150cb0 0x7fad68167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.751+0000 7fad5ffff700 1 -- 172.21.15.80:0/911897278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad68150cb0 msgr2=0x7fad68167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.752+0000 7fad5ffff700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad68150cb0 0x7fad68167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.752+0000 7fad5ffff700 1 -- 172.21.15.80:0/911897278 >> v1:172.21.15.80:6789/0 conn(0x7fad68108630 legacy=0x7fad68151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.752+0000 7fad657fa700 1 -- 172.21.15.80:0/911897278 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664186309 0 0) 0x7fad580010c0 con 0x7fad68108630 2019-11-28T11:58:05.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.752+0000 7fad5ffff700 1 -- 172.21.15.80:0/911897278 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad681322e0 con 0x7fad681502e0 2019-11-28T11:58:05.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.752+0000 7fad5ffff700 1 --2- 172.21.15.80:0/911897278 >> v2:172.21.15.80:3300/0 conn(0x7fad681502e0 0x7fad68150770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad50010370 tx=0x7fad500101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.752+0000 7fad5ffff700 1 --2- 172.21.15.80:0/911897278 >> v2:172.21.15.80:3300/0 conn(0x7fad681502e0 0x7fad68150770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad50010370 tx=0x7fad500101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.752+0000 7fad5ffff700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad681502e0 0x7fad68150770 secure :-1 s=READY pgs=2787 cs=0 l=1 rx=0x7fad50010370 tx=0x7fad500101a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:05.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.752+0000 7fad5ffff700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad681502e0 0x7fad68150770 secure :-1 s=THROTTLE_DONE pgs=2787 cs=0 l=1 rx=0x7fad50010370 tx=0x7fad500101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.752+0000 7fad657fa700 1 -- 172.21.15.80:0/911897278 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad50001630 con 0x7fad681502e0 2019-11-28T11:58:05.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.752+0000 7fad5ffff700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad681502e0 0x7fad68150770 secure :-1 s=THROTTLE_DONE pgs=2787 cs=0 l=1 rx=0x7fad50010370 tx=0x7fad500101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.752+0000 7fad5ffff700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad681502e0 0x7fad68150770 secure :-1 s=THROTTLE_DONE pgs=2787 cs=0 l=1 rx=0x7fad50010370 tx=0x7fad500101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.752+0000 7fad657fa700 1 -- 172.21.15.80:0/911897278 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad50000940 con 0x7fad681502e0 2019-11-28T11:58:05.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.752+0000 7fad657fa700 1 -- 172.21.15.80:0/911897278 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad50004810 con 0x7fad681502e0 2019-11-28T11:58:05.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.752+0000 7fad6dc5f700 1 -- 172.21.15.80:0/911897278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad68132660 con 0x7fad681502e0 2019-11-28T11:58:05.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.752+0000 7fad6dc5f700 1 -- 172.21.15.80:0/911897278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad681322e0 con 0x7fad681502e0 2019-11-28T11:58:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.752+0000 7fad5ffff700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad681502e0 0x7fad68150770 secure :-1 s=THROTTLE_DONE pgs=2787 cs=0 l=1 rx=0x7fad50010370 tx=0x7fad500101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.753+0000 7fad657fa700 1 -- 172.21.15.80:0/911897278 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fad50004240 con 0x7fad681502e0 2019-11-28T11:58:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.753+0000 7fad5ffff700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad681502e0 0x7fad68150770 secure :-1 s=THROTTLE_DONE pgs=2787 cs=0 l=1 rx=0x7fad50010370 tx=0x7fad500101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.753+0000 7fad657fa700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fad4c018730 0x7fad4c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.753+0000 7fad657fa700 1 -- 172.21.15.80:0/911897278 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fad50031a10 con 0x7fad681502e0 2019-11-28T11:58:05.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.753+0000 7fad67fff700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fad4c018730 0x7fad4c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:05.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.753+0000 7fad67fff700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fad4c018730 0x7fad4c01abc0 crc :-1 s=READY pgs=1157 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:05.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.760+0000 7fad6dc5f700 1 -- 172.21.15.80:0/911897278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad68132660 con 0x7fad681502e0 2019-11-28T11:58:05.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.763+0000 7fad5ffff700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad681502e0 0x7fad68150770 secure :-1 s=THROTTLE_DONE pgs=2787 cs=0 l=1 rx=0x7fad50010370 tx=0x7fad500101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.763+0000 7fad657fa700 1 -- 172.21.15.80:0/911897278 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fad50001980 con 0x7fad681502e0 2019-11-28T11:58:05.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.931+0000 7fad6dc5f700 1 -- 172.21.15.80:0/911897278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fad681322e0 con 0x7fad681502e0 2019-11-28T11:58:05.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.931+0000 7fad5ffff700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad681502e0 0x7fad68150770 secure :-1 s=THROTTLE_DONE pgs=2787 cs=0 l=1 rx=0x7fad50010370 tx=0x7fad500101a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:05.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.931+0000 7fad657fa700 1 -- 172.21.15.80:0/911897278 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v213) v1 ==== 104+0+10 (secure 0 0 0) 0x7fad50004240 con 0x7fad681502e0 2019-11-28T11:58:05.930 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:58:05.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.934+0000 7fad6dc5f700 1 -- 172.21.15.80:0/911897278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fad4c018730 msgr2=0x7fad4c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.934+0000 7fad6dc5f700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fad4c018730 0x7fad4c01abc0 crc :-1 s=READY pgs=1157 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.934+0000 7fad6dc5f700 1 -- 172.21.15.80:0/911897278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad681502e0 msgr2=0x7fad68150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:05.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.934+0000 7fad6dc5f700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad681502e0 0x7fad68150770 secure :-1 s=READY pgs=2787 cs=0 l=1 rx=0x7fad50010370 tx=0x7fad500101a0).stop 2019-11-28T11:58:05.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.934+0000 7fad6dc5f700 1 -- 172.21.15.80:0/911897278 shutdown_connections 2019-11-28T11:58:05.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.934+0000 7fad6dc5f700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fad4c018730 0x7fad4c01abc0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.934+0000 7fad6dc5f700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad68150cb0 0x7fad68167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.934+0000 7fad6dc5f700 1 --2- 172.21.15.80:0/911897278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad681502e0 0x7fad68150770 unknown :-1 s=CLOSED pgs=2787 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:05.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.934+0000 7fad6dc5f700 1 -- 172.21.15.80:0/911897278 shutdown_connections 2019-11-28T11:58:05.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.934+0000 7fad6dc5f700 1 -- 172.21.15.80:0/911897278 wait complete. 2019-11-28T11:58:05.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:05.934+0000 7fad6dc5f700 1 -- 172.21.15.80:0/911897278 >> 172.21.15.80:0/911897278 conn(0x7fad6814dbb0 msgr2=0x7fad68142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:05.945 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:58:06.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.083+0000 7fb798d9b700 1 Processor -- start 2019-11-28T11:58:06.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.084+0000 7fb798d9b700 1 -- start start 2019-11-28T11:58:06.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb798d9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb79415f100 0x7fb79406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:06.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb798d9b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79406db60 con 0x7fb79406c2f0 2019-11-28T11:58:06.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb798d9b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79406e060 con 0x7fb79415ed10 2019-11-28T11:58:06.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb798d9b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79406fe00 con 0x7fb79415f100 2019-11-28T11:58:06.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb79359e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb79406c2f0 0x7fb79406c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45802/0 (socket says 172.21.15.80:45802) 2019-11-28T11:58:06.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb79359e700 1 -- 172.21.15.80:0/1147332145 learned_addr learned my addr 172.21.15.80:0/1147332145 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:06.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb79259c700 1 --2- 172.21.15.80:0/1147332145 >> v2:172.21.15.174:3300/0 conn(0x7fb79415f100 0x7fb79406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:06.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb791d9b700 1 -- 172.21.15.80:0/1147332145 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051882798 0 0) 0x7fb78c001150 con 0x7fb79406c2f0 2019-11-28T11:58:06.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb791d9b700 1 -- 172.21.15.80:0/1147332145 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb774002e80 con 0x7fb79406c2f0 2019-11-28T11:58:06.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb791d9b700 1 -- 172.21.15.80:0/1147332145 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987065793 0 0) 0x7fb77c001400 con 0x7fb79415ed10 2019-11-28T11:58:06.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb791d9b700 1 -- 172.21.15.80:0/1147332145 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7740030b0 con 0x7fb79415ed10 2019-11-28T11:58:06.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb79259c700 1 -- 172.21.15.80:0/1147332145 >> v1:172.21.15.174:6789/0 conn(0x7fb79415ed10 legacy=0x7fb794073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:06.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb79259c700 1 -- 172.21.15.80:0/1147332145 >> v1:172.21.15.80:6789/0 conn(0x7fb79406c2f0 legacy=0x7fb79406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:06.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb791d9b700 1 -- 172.21.15.80:0/1147332145 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 175759531 0 0) 0x7fb78c001130 con 0x7fb79406c2f0 2019-11-28T11:58:06.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb79259c700 1 -- 172.21.15.80:0/1147332145 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb794070760 con 0x7fb79415f100 2019-11-28T11:58:06.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb79259c700 1 --2- 172.21.15.80:0/1147332145 >> v2:172.21.15.174:3300/0 conn(0x7fb79415f100 0x7fb79406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb78400af50 tx=0x7fb78400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb79259c700 1 --2- 172.21.15.80:0/1147332145 >> v2:172.21.15.174:3300/0 conn(0x7fb79415f100 0x7fb79406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb78400af50 tx=0x7fb78400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.085+0000 7fb79259c700 1 --2- 172.21.15.80:0/1147332145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb79415f100 0x7fb79406bdb0 secure :-1 s=READY pgs=1694 cs=0 l=1 rx=0x7fb78400af50 tx=0x7fb78400b760).ready entity=mon.1 client_cookie=b4440e3e6ef8dfaa server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:06.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.086+0000 7fb79259c700 1 --2- 172.21.15.80:0/1147332145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb79415f100 0x7fb79406bdb0 secure :-1 s=THROTTLE_DONE pgs=1694 cs=0 l=1 rx=0x7fb78400af50 tx=0x7fb78400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.086+0000 7fb791d9b700 1 -- 172.21.15.80:0/1147332145 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb784000960 con 0x7fb79415f100 2019-11-28T11:58:06.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.086+0000 7fb79259c700 1 --2- 172.21.15.80:0/1147332145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb79415f100 0x7fb79406bdb0 secure :-1 s=THROTTLE_DONE pgs=1694 cs=0 l=1 rx=0x7fb78400af50 tx=0x7fb78400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.086+0000 7fb79259c700 1 --2- 172.21.15.80:0/1147332145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb79415f100 0x7fb79406bdb0 secure :-1 s=THROTTLE_DONE pgs=1694 cs=0 l=1 rx=0x7fb78400af50 tx=0x7fb78400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.086+0000 7fb791d9b700 1 -- 172.21.15.80:0/1147332145 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb784009860 con 0x7fb79415f100 2019-11-28T11:58:06.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.086+0000 7fb791d9b700 1 -- 172.21.15.80:0/1147332145 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb784009f30 con 0x7fb79415f100 2019-11-28T11:58:06.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.086+0000 7fb798d9b700 1 -- 172.21.15.80:0/1147332145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb79415f100 msgr2=0x7fb79406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:06.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.086+0000 7fb798d9b700 1 --2- 172.21.15.80:0/1147332145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb79415f100 0x7fb79406bdb0 secure :-1 s=READY pgs=1694 cs=0 l=1 rx=0x7fb78400af50 tx=0x7fb78400b760).stop 2019-11-28T11:58:06.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.086+0000 7fb798d9b700 1 -- 172.21.15.80:0/1147332145 shutdown_connections 2019-11-28T11:58:06.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.086+0000 7fb798d9b700 1 --2- 172.21.15.80:0/1147332145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb79415f100 0x7fb79406bdb0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:06.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.086+0000 7fb798d9b700 1 -- 172.21.15.80:0/1147332145 shutdown_connections 2019-11-28T11:58:06.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.086+0000 7fb798d9b700 1 -- 172.21.15.80:0/1147332145 wait complete. 2019-11-28T11:58:06.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.086+0000 7fb798d9b700 1 -- 172.21.15.80:0/1147332145 >> 172.21.15.80:0/1147332145 conn(0x7fb794061d20 msgr2=0x7fb7940641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:06.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.089+0000 7fb798d9b700 1 Processor -- start 2019-11-28T11:58:06.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.089+0000 7fb798d9b700 1 -- start start 2019-11-28T11:58:06.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.090+0000 7fb798d9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb794153db0 0x7fb79410dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:06.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.090+0000 7fb798d9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb79410e270 0x7fb794148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:06.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.090+0000 7fb798d9b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7941057a0 con 0x7fb794148570 2019-11-28T11:58:06.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.090+0000 7fb798d9b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb794106280 con 0x7fb794153db0 2019-11-28T11:58:06.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.090+0000 7fb798d9b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb794106550 con 0x7fb79410e270 2019-11-28T11:58:06.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.090+0000 7fb79259c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb79410e270 0x7fb794148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:06.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.090+0000 7fb79259c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb79410e270 0x7fb794148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:48752/0 (socket says 172.21.15.80:48752) 2019-11-28T11:58:06.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.090+0000 7fb792d9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb794153db0 0x7fb79410dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:06.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.090+0000 7fb79259c700 1 -- 172.21.15.80:0/1189301458 learned_addr learned my addr 172.21.15.80:0/1189301458 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:06.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.090+0000 7fb78b7fe700 1 -- 172.21.15.80:0/1189301458 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507021306 0 0) 0x7fb78c0009b0 con 0x7fb794148570 2019-11-28T11:58:06.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.090+0000 7fb78b7fe700 1 -- 172.21.15.80:0/1189301458 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb76c002e80 con 0x7fb794148570 2019-11-28T11:58:06.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.090+0000 7fb79259c700 1 -- 172.21.15.80:0/1189301458 >> v2:172.21.15.174:3300/0 conn(0x7fb794153db0 msgr2=0x7fb79410dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:06.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.090+0000 7fb79259c700 1 --2- 172.21.15.80:0/1189301458 >> v2:172.21.15.174:3300/0 conn(0x7fb794153db0 0x7fb79410dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:06.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.090+0000 7fb79259c700 1 -- 172.21.15.80:0/1189301458 >> v1:172.21.15.174:6789/0 conn(0x7fb794148570 legacy=0x7fb79410cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:06.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.090+0000 7fb79259c700 1 -- 172.21.15.80:0/1189301458 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb794106be0 con 0x7fb79410e270 2019-11-28T11:58:06.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.091+0000 7fb79259c700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb79410e270 0x7fb794148030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb784010440 tx=0x7fb7840102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.091+0000 7fb79259c700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb79410e270 0x7fb794148030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb784010440 tx=0x7fb7840102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.091+0000 7fb79259c700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb79410e270 0x7fb794148030 secure :-1 s=READY pgs=403 cs=0 l=1 rx=0x7fb784010440 tx=0x7fb7840102c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:06.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.091+0000 7fb79259c700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb79410e270 0x7fb794148030 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7fb784010440 tx=0x7fb7840102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.091+0000 7fb78b7fe700 1 -- 172.21.15.80:0/1189301458 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb784000940 con 0x7fb79410e270 2019-11-28T11:58:06.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.091+0000 7fb79259c700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb79410e270 0x7fb794148030 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7fb784010440 tx=0x7fb7840102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.091+0000 7fb79259c700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb79410e270 0x7fb794148030 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7fb784010440 tx=0x7fb7840102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.091+0000 7fb78b7fe700 1 -- 172.21.15.80:0/1189301458 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb784009980 con 0x7fb79410e270 2019-11-28T11:58:06.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.091+0000 7fb78b7fe700 1 -- 172.21.15.80:0/1189301458 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb78400a0d0 con 0x7fb79410e270 2019-11-28T11:58:06.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.091+0000 7fb798d9b700 1 -- 172.21.15.80:0/1189301458 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb794106f60 con 0x7fb79410e270 2019-11-28T11:58:06.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.091+0000 7fb798d9b700 1 -- 172.21.15.80:0/1189301458 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb794106be0 con 0x7fb79410e270 2019-11-28T11:58:06.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.091+0000 7fb79259c700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb79410e270 0x7fb794148030 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7fb784010440 tx=0x7fb7840102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.091+0000 7fb78b7fe700 1 -- 172.21.15.80:0/1189301458 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb784009b70 con 0x7fb79410e270 2019-11-28T11:58:06.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.091+0000 7fb79259c700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb79410e270 0x7fb794148030 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7fb784010440 tx=0x7fb7840102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.092+0000 7fb78b7fe700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb76c018770 0x7fb76c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:06.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.092+0000 7fb78b7fe700 1 -- 172.21.15.80:0/1189301458 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb784031af0 con 0x7fb79410e270 2019-11-28T11:58:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.092+0000 7fb792d9d700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb76c018770 0x7fb76c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.092+0000 7fb792d9d700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb76c018770 0x7fb76c01abe0 crc :-1 s=READY pgs=1158 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.099+0000 7fb798d9b700 1 -- 172.21.15.80:0/1189301458 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb794106f60 con 0x7fb79410e270 2019-11-28T11:58:06.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.103+0000 7fb79259c700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb79410e270 0x7fb794148030 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7fb784010440 tx=0x7fb7840102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.103+0000 7fb78b7fe700 1 -- 172.21.15.80:0/1189301458 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb784009580 con 0x7fb79410e270 2019-11-28T11:58:06.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.270+0000 7fb798d9b700 1 -- 172.21.15.80:0/1189301458 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fb794106be0 con 0x7fb79410e270 2019-11-28T11:58:06.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.270+0000 7fb79259c700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb79410e270 0x7fb794148030 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7fb784010440 tx=0x7fb7840102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.270+0000 7fb78b7fe700 1 -- 172.21.15.80:0/1189301458 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v213) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb784017280 con 0x7fb79410e270 2019-11-28T11:58:06.267 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:58:06.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.273+0000 7fb798d9b700 1 -- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb76c018770 msgr2=0x7fb76c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:06.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.273+0000 7fb798d9b700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb76c018770 0x7fb76c01abe0 crc :-1 s=READY pgs=1158 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:06.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.273+0000 7fb798d9b700 1 -- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb79410e270 msgr2=0x7fb794148030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:06.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.273+0000 7fb798d9b700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb79410e270 0x7fb794148030 secure :-1 s=READY pgs=403 cs=0 l=1 rx=0x7fb784010440 tx=0x7fb7840102c0).stop 2019-11-28T11:58:06.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.273+0000 7fb798d9b700 1 -- 172.21.15.80:0/1189301458 shutdown_connections 2019-11-28T11:58:06.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.273+0000 7fb798d9b700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb76c018770 0x7fb76c01abe0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:06.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.273+0000 7fb798d9b700 1 --2- 172.21.15.80:0/1189301458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb79410e270 0x7fb794148030 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:06.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.273+0000 7fb798d9b700 1 --2- 172.21.15.80:0/1189301458 >> v2:172.21.15.174:3300/0 conn(0x7fb794153db0 0x7fb79410dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:06.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.273+0000 7fb798d9b700 1 -- 172.21.15.80:0/1189301458 shutdown_connections 2019-11-28T11:58:06.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.273+0000 7fb798d9b700 1 -- 172.21.15.80:0/1189301458 wait complete. 2019-11-28T11:58:06.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.273+0000 7fb798d9b700 1 -- 172.21.15.80:0/1189301458 >> 172.21.15.80:0/1189301458 conn(0x7fb79415e2d0 msgr2=0x7fb794147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:06.279 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:58:06.279 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:58:06.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.407+0000 7f6acb083700 1 Processor -- start 2019-11-28T11:58:06.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.408+0000 7f6acb083700 1 -- start start 2019-11-28T11:58:06.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6acb083700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ac406c0a0 0x7f6ac4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:06.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6acb083700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ac40734e0 0x7f6ac4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6acb083700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac406db00 con 0x7f6ac4072360 2019-11-28T11:58:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6acb083700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac406f330 con 0x7f6ac40734e0 2019-11-28T11:58:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6acb083700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac40706c0 con 0x7f6ac406c0a0 2019-11-28T11:58:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac8e1f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ac40734e0 0x7f6ac4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac8e1f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ac40734e0 0x7f6ac4071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46502/0 (socket says 172.21.15.80:46502) 2019-11-28T11:58:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac9e21700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6ac4072360 0x7f6ac406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45816/0 (socket says 172.21.15.80:45816) 2019-11-28T11:58:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac8e1f700 1 -- 172.21.15.80:0/1625098694 learned_addr learned my addr 172.21.15.80:0/1625098694 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac9620700 1 --2- 172.21.15.80:0/1625098694 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ac406c0a0 0x7f6ac4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac8e1f700 1 -- 172.21.15.80:0/1625098694 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ac406c0a0 msgr2=0x7f6ac4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac8e1f700 1 --2- 172.21.15.80:0/1625098694 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ac406c0a0 0x7f6ac4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac8e1f700 1 -- 172.21.15.80:0/1625098694 >> v1:172.21.15.80:6789/0 conn(0x7f6ac4072360 legacy=0x7f6ac406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac8e1f700 1 -- 172.21.15.80:0/1625098694 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac4070a40 con 0x7f6ac40734e0 2019-11-28T11:58:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac3fff700 1 -- 172.21.15.80:0/1625098694 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002281770 0 0) 0x7f6abc0009b0 con 0x7f6ac4072360 2019-11-28T11:58:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac8e1f700 1 --2- 172.21.15.80:0/1625098694 >> v2:172.21.15.80:3300/0 conn(0x7f6ac40734e0 0x7f6ac4071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6aac00f6c0 tx=0x7f6aac00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac8e1f700 1 --2- 172.21.15.80:0/1625098694 >> v2:172.21.15.80:3300/0 conn(0x7f6ac40734e0 0x7f6ac4071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6aac00f6c0 tx=0x7f6aac00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac8e1f700 1 --2- 172.21.15.80:0/1625098694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac40734e0 0x7f6ac4071e20 secure :-1 s=READY pgs=2790 cs=0 l=1 rx=0x7f6aac00f6c0 tx=0x7f6aac00fa60).ready entity=mon.0 client_cookie=f96ac641bc54e70e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:06.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac8e1f700 1 --2- 172.21.15.80:0/1625098694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac40734e0 0x7f6ac4071e20 secure :-1 s=THROTTLE_DONE pgs=2790 cs=0 l=1 rx=0x7f6aac00f6c0 tx=0x7f6aac00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac8e1f700 1 --2- 172.21.15.80:0/1625098694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac40734e0 0x7f6ac4071e20 secure :-1 s=THROTTLE_DONE pgs=2790 cs=0 l=1 rx=0x7f6aac00f6c0 tx=0x7f6aac00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac3fff700 1 -- 172.21.15.80:0/1625098694 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aac000960 con 0x7f6ac40734e0 2019-11-28T11:58:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac8e1f700 1 --2- 172.21.15.80:0/1625098694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac40734e0 0x7f6ac4071e20 secure :-1 s=THROTTLE_DONE pgs=2790 cs=0 l=1 rx=0x7f6aac00f6c0 tx=0x7f6aac00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac3fff700 1 -- 172.21.15.80:0/1625098694 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac000c90 con 0x7f6ac40734e0 2019-11-28T11:58:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6ac3fff700 1 -- 172.21.15.80:0/1625098694 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aac0013a0 con 0x7f6ac40734e0 2019-11-28T11:58:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6acb083700 1 -- 172.21.15.80:0/1625098694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac40734e0 msgr2=0x7f6ac4071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.409+0000 7f6acb083700 1 --2- 172.21.15.80:0/1625098694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac40734e0 0x7f6ac4071e20 secure :-1 s=READY pgs=2790 cs=0 l=1 rx=0x7f6aac00f6c0 tx=0x7f6aac00fa60).stop 2019-11-28T11:58:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.410+0000 7f6acb083700 1 -- 172.21.15.80:0/1625098694 shutdown_connections 2019-11-28T11:58:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.410+0000 7f6acb083700 1 --2- 172.21.15.80:0/1625098694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac40734e0 0x7f6ac4071e20 unknown :-1 s=CLOSED pgs=2790 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.410+0000 7f6acb083700 1 --2- 172.21.15.80:0/1625098694 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ac406c0a0 0x7f6ac4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.410+0000 7f6acb083700 1 -- 172.21.15.80:0/1625098694 shutdown_connections 2019-11-28T11:58:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.410+0000 7f6acb083700 1 -- 172.21.15.80:0/1625098694 wait complete. 2019-11-28T11:58:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.410+0000 7f6acb083700 1 -- 172.21.15.80:0/1625098694 >> 172.21.15.80:0/1625098694 conn(0x7f6ac4061cf0 msgr2=0x7f6ac4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:06.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.413+0000 7f6acb083700 1 Processor -- start 2019-11-28T11:58:06.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.413+0000 7f6acb083700 1 -- start start 2019-11-28T11:58:06.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6acb083700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ac415fdf0 0x7f6ac412b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:06.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6acb083700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6ac412a3c0 0x7f6ac412a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:06.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6acb083700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac413eb20 con 0x7f6ac412b8a0 2019-11-28T11:58:06.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6acb083700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac4108820 con 0x7f6ac415fdf0 2019-11-28T11:58:06.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6acb083700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac4108af0 con 0x7f6ac412a3c0 2019-11-28T11:58:06.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac9620700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ac415fdf0 0x7f6ac412b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:06.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac9620700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ac415fdf0 0x7f6ac412b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46504/0 (socket says 172.21.15.80:46504) 2019-11-28T11:58:06.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac8e1f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6ac412b8a0 0x7f6ac413e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45822/0 (socket says 172.21.15.80:45822) 2019-11-28T11:58:06.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac9620700 1 -- 172.21.15.80:0/1599801826 learned_addr learned my addr 172.21.15.80:0/1599801826 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:06.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac9e21700 1 --2- 172.21.15.80:0/1599801826 >> v2:172.21.15.174:3300/0 conn(0x7f6ac412a3c0 0x7f6ac412a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:06.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac9620700 1 -- 172.21.15.80:0/1599801826 >> v2:172.21.15.174:3300/0 conn(0x7f6ac412a3c0 msgr2=0x7f6ac412a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:06.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac9620700 1 --2- 172.21.15.80:0/1599801826 >> v2:172.21.15.174:3300/0 conn(0x7f6ac412a3c0 0x7f6ac412a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:06.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac1ffb700 1 -- 172.21.15.80:0/1599801826 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110081952 0 0) 0x7f6aac0075d0 con 0x7f6ac412b8a0 2019-11-28T11:58:06.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac9620700 1 -- 172.21.15.80:0/1599801826 >> v1:172.21.15.80:6789/0 conn(0x7f6ac412b8a0 legacy=0x7f6ac413e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:06.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac9620700 1 -- 172.21.15.80:0/1599801826 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac410a8c0 con 0x7f6ac415fdf0 2019-11-28T11:58:06.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac9620700 1 --2- 172.21.15.80:0/1599801826 >> v2:172.21.15.80:3300/0 conn(0x7f6ac415fdf0 0x7f6ac412b360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ab4010780 tx=0x7f6ab4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac9620700 1 --2- 172.21.15.80:0/1599801826 >> v2:172.21.15.80:3300/0 conn(0x7f6ac415fdf0 0x7f6ac412b360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ab4010780 tx=0x7f6ab4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac9620700 1 --2- 172.21.15.80:0/1599801826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac415fdf0 0x7f6ac412b360 secure :-1 s=READY pgs=2792 cs=0 l=1 rx=0x7f6ab4010780 tx=0x7f6ab4010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:06.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac9620700 1 --2- 172.21.15.80:0/1599801826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac415fdf0 0x7f6ac412b360 secure :-1 s=THROTTLE_DONE pgs=2792 cs=0 l=1 rx=0x7f6ab4010780 tx=0x7f6ab4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac1ffb700 1 -- 172.21.15.80:0/1599801826 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ab4000cc0 con 0x7f6ac415fdf0 2019-11-28T11:58:06.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac9620700 1 --2- 172.21.15.80:0/1599801826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac415fdf0 0x7f6ac412b360 secure :-1 s=THROTTLE_DONE pgs=2792 cs=0 l=1 rx=0x7f6ab4010780 tx=0x7f6ab4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac1ffb700 1 -- 172.21.15.80:0/1599801826 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab4000cc0 con 0x7f6ac415fdf0 2019-11-28T11:58:06.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6acb083700 1 -- 172.21.15.80:0/1599801826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac410a8c0 con 0x7f6ac415fdf0 2019-11-28T11:58:06.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac9620700 1 --2- 172.21.15.80:0/1599801826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac415fdf0 0x7f6ac412b360 secure :-1 s=THROTTLE_DONE pgs=2792 cs=0 l=1 rx=0x7f6ab4010780 tx=0x7f6ab4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6ac1ffb700 1 -- 172.21.15.80:0/1599801826 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ab4001410 con 0x7f6ac415fdf0 2019-11-28T11:58:06.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.414+0000 7f6acb083700 1 -- 172.21.15.80:0/1599801826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac410a8c0 con 0x7f6ac415fdf0 2019-11-28T11:58:06.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.415+0000 7f6ac9620700 1 --2- 172.21.15.80:0/1599801826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac415fdf0 0x7f6ac412b360 secure :-1 s=THROTTLE_DONE pgs=2792 cs=0 l=1 rx=0x7f6ab4010780 tx=0x7f6ab4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.415+0000 7f6ac1ffb700 1 -- 172.21.15.80:0/1599801826 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6ab4001220 con 0x7f6ac415fdf0 2019-11-28T11:58:06.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.415+0000 7f6ac9620700 1 --2- 172.21.15.80:0/1599801826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac415fdf0 0x7f6ac412b360 secure :-1 s=THROTTLE_DONE pgs=2792 cs=0 l=1 rx=0x7f6ab4010780 tx=0x7f6ab4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.415+0000 7f6ac1ffb700 1 --2- 172.21.15.80:0/1599801826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6aa8018730 0x7f6aa801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:06.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.415+0000 7f6ac1ffb700 1 -- 172.21.15.80:0/1599801826 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6ab4031e20 con 0x7f6ac415fdf0 2019-11-28T11:58:06.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.415+0000 7f6ac8e1f700 1 --2- 172.21.15.80:0/1599801826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6aa8018730 0x7f6aa801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:06.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.416+0000 7f6ac8e1f700 1 --2- 172.21.15.80:0/1599801826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6aa8018730 0x7f6aa801abc0 crc :-1 s=READY pgs=1159 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:06.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.423+0000 7f6acb083700 1 -- 172.21.15.80:0/1599801826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac4109180 con 0x7f6ac415fdf0 2019-11-28T11:58:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.426+0000 7f6ac9620700 1 --2- 172.21.15.80:0/1599801826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac415fdf0 0x7f6ac412b360 secure :-1 s=THROTTLE_DONE pgs=2792 cs=0 l=1 rx=0x7f6ab4010780 tx=0x7f6ab4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.426+0000 7f6ac1ffb700 1 -- 172.21.15.80:0/1599801826 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6ab4001010 con 0x7f6ac415fdf0 2019-11-28T11:58:06.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.599+0000 7f6acb083700 1 -- 172.21.15.80:0/1599801826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ac4109500 con 0x7f6ac415fdf0 2019-11-28T11:58:06.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.600+0000 7f6ac9620700 1 --2- 172.21.15.80:0/1599801826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac415fdf0 0x7f6ac412b360 secure :-1 s=THROTTLE_DONE pgs=2792 cs=0 l=1 rx=0x7f6ab4010780 tx=0x7f6ab4010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:06.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.600+0000 7f6ac1ffb700 1 -- 172.21.15.80:0/1599801826 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 176 v176) v1 ==== 95+0+2457 (secure 0 0 0) 0x7f6ab40177a0 con 0x7f6ac415fdf0 2019-11-28T11:58:06.597 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 176 2019-11-28T11:58:06.597 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:06.597 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":176,"default_fscid":17,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":11371,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/4086131539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":4086131539},{"type":"v1","addr":"172.21.15.80:6835","nonce":4086131539}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":174},{"gid":12102,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2858222423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2858222423},{"type":"v1","addr":"172.21.15.80:6834","nonce":2858222423}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":174}],"filesystems":[{"mdsmap":{"epoch":176,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:57:55.569453+0000","modified":"2019-11-28T11:58:03.818681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7964":{"gid":7964,"name":"c","rank":0,"incarnation":175,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/4116799507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":4116799507},{"type":"v1","addr":"172.21.15.174:6835","nonce":4116799507}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[35],"metadata_pool":34,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":17}]} 2019-11-28T11:58:06.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.602+0000 7f6acb083700 1 -- 172.21.15.80:0/1599801826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6aa8018730 msgr2=0x7f6aa801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:06.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.602+0000 7f6acb083700 1 --2- 172.21.15.80:0/1599801826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6aa8018730 0x7f6aa801abc0 crc :-1 s=READY pgs=1159 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:06.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.602+0000 7f6acb083700 1 -- 172.21.15.80:0/1599801826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac415fdf0 msgr2=0x7f6ac412b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:06.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.602+0000 7f6acb083700 1 --2- 172.21.15.80:0/1599801826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac415fdf0 0x7f6ac412b360 secure :-1 s=READY pgs=2792 cs=0 l=1 rx=0x7f6ab4010780 tx=0x7f6ab4010600).stop 2019-11-28T11:58:06.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.602+0000 7f6acb083700 1 -- 172.21.15.80:0/1599801826 shutdown_connections 2019-11-28T11:58:06.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.602+0000 7f6acb083700 1 --2- 172.21.15.80:0/1599801826 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6aa8018730 0x7f6aa801abc0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:06.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.602+0000 7f6acb083700 1 --2- 172.21.15.80:0/1599801826 >> v2:172.21.15.174:3300/0 conn(0x7f6ac412a3c0 0x7f6ac412a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.602+0000 7f6acb083700 1 --2- 172.21.15.80:0/1599801826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ac415fdf0 0x7f6ac412b360 unknown :-1 s=CLOSED pgs=2792 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.602+0000 7f6acb083700 1 -- 172.21.15.80:0/1599801826 shutdown_connections 2019-11-28T11:58:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.602+0000 7f6acb083700 1 -- 172.21.15.80:0/1599801826 wait complete. 2019-11-28T11:58:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:06.602+0000 7f6acb083700 1 -- 172.21.15.80:0/1599801826 >> 172.21.15.80:0/1599801826 conn(0x7f6ac4127dc0 msgr2=0x7f6ac4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:06.910 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7964}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 34, u'failed': [], u'epoch': 176, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [35], u'info': {u'gid_7964': {u'export_targets': [], u'name': u'c', u'incarnation': 175, u'state_seq': 3, u'state': u'up:active', u'gid': 7964, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 4116799507, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 4116799507, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/4116799507'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:57:55.569453+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:58:03.818681+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:58:06.910 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:58:06.911 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:58:07.037 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:58:07.037 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:58:07.037 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:58:07.037 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 7964, 2019-11-28T11:58:07.037 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:58:07.037 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:58:07.038 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 4.221929126, 2019-11-28T11:58:07.038 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 176, 2019-11-28T11:58:07.038 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 213, 2019-11-28T11:58:07.038 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 213, 2019-11-28T11:58:07.038 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 9.0378637879999992 2019-11-28T11:58:07.038 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:58:07.042 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7964, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.221929126, "mdsmap_epoch": 176, "osdmap_epoch": 213, "osdmap_epoch_barrier": 213, "uptime": 9.0378637879999992 } 2019-11-28T11:58:07.042 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:58:07.043 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:58:07.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:58:07.043 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:58:07.113 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:58:07.114 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:58:07.233 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:58:07.234 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:58:07.234 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:58:07.234 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:58:07.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:58:07.234 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:58:07.313 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:58:07.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.436+0000 7f405d4d4700 1 Processor -- start 2019-11-28T11:58:07.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.436+0000 7f405d4d4700 1 -- start start 2019-11-28T11:58:07.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.437+0000 7f405d4d4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405806c0a0 0x7f4058072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:07.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.437+0000 7f405d4d4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f40580734e0 0x7f4058071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:07.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.437+0000 7f405d4d4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405806db00 con 0x7f4058072360 2019-11-28T11:58:07.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.437+0000 7f405d4d4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405806f330 con 0x7f40580734e0 2019-11-28T11:58:07.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.437+0000 7f405d4d4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40580706c0 con 0x7f405806c0a0 2019-11-28T11:58:07.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.437+0000 7f4056ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f40580734e0 0x7f4058071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:07.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.437+0000 7f4056ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f40580734e0 0x7f4058071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46512/0 (socket says 172.21.15.80:46512) 2019-11-28T11:58:07.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.437+0000 7f4057fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4058072360 0x7f405806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45832/0 (socket says 172.21.15.80:45832) 2019-11-28T11:58:07.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.437+0000 7f4056ffd700 1 -- 172.21.15.80:0/475684861 learned_addr learned my addr 172.21.15.80:0/475684861 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:07.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f40577fe700 1 --2- 172.21.15.80:0/475684861 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405806c0a0 0x7f4058072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:07.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f4056ffd700 1 -- 172.21.15.80:0/475684861 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405806c0a0 msgr2=0x7f4058072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:07.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f4056ffd700 1 --2- 172.21.15.80:0/475684861 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405806c0a0 0x7f4058072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:07.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f4056ffd700 1 -- 172.21.15.80:0/475684861 >> v1:172.21.15.80:6789/0 conn(0x7f4058072360 legacy=0x7f405806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:07.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f4056ffd700 1 -- 172.21.15.80:0/475684861 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4058070a40 con 0x7f40580734e0 2019-11-28T11:58:07.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f40567fc700 1 -- 172.21.15.80:0/475684861 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546211999 0 0) 0x7f4050000d30 con 0x7f4058072360 2019-11-28T11:58:07.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f40577fe700 1 --2- 172.21.15.80:0/475684861 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405806c0a0 0x7f4058072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:58:07.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f4056ffd700 1 --2- 172.21.15.80:0/475684861 >> v2:172.21.15.80:3300/0 conn(0x7f40580734e0 0x7f4058071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f404800f740 tx=0x7f404800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f4056ffd700 1 --2- 172.21.15.80:0/475684861 >> v2:172.21.15.80:3300/0 conn(0x7f40580734e0 0x7f4058071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f404800f740 tx=0x7f404800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f4056ffd700 1 --2- 172.21.15.80:0/475684861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40580734e0 0x7f4058071e20 secure :-1 s=READY pgs=2794 cs=0 l=1 rx=0x7f404800f740 tx=0x7f404800fae0).ready entity=mon.0 client_cookie=8b134bb29352934c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:07.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f4056ffd700 1 --2- 172.21.15.80:0/475684861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40580734e0 0x7f4058071e20 secure :-1 s=THROTTLE_DONE pgs=2794 cs=0 l=1 rx=0x7f404800f740 tx=0x7f404800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f40567fc700 1 -- 172.21.15.80:0/475684861 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4048000960 con 0x7f40580734e0 2019-11-28T11:58:07.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f4056ffd700 1 --2- 172.21.15.80:0/475684861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40580734e0 0x7f4058071e20 secure :-1 s=THROTTLE_DONE pgs=2794 cs=0 l=1 rx=0x7f404800f740 tx=0x7f404800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f4056ffd700 1 --2- 172.21.15.80:0/475684861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40580734e0 0x7f4058071e20 secure :-1 s=THROTTLE_DONE pgs=2794 cs=0 l=1 rx=0x7f404800f740 tx=0x7f404800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f40567fc700 1 -- 172.21.15.80:0/475684861 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4048000c90 con 0x7f40580734e0 2019-11-28T11:58:07.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f40567fc700 1 -- 172.21.15.80:0/475684861 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4048007210 con 0x7f40580734e0 2019-11-28T11:58:07.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f405d4d4700 1 -- 172.21.15.80:0/475684861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40580734e0 msgr2=0x7f4058071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:07.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.438+0000 7f405d4d4700 1 --2- 172.21.15.80:0/475684861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40580734e0 0x7f4058071e20 secure :-1 s=READY pgs=2794 cs=0 l=1 rx=0x7f404800f740 tx=0x7f404800fae0).stop 2019-11-28T11:58:07.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.439+0000 7f405d4d4700 1 -- 172.21.15.80:0/475684861 shutdown_connections 2019-11-28T11:58:07.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.439+0000 7f405d4d4700 1 --2- 172.21.15.80:0/475684861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40580734e0 0x7f4058071e20 unknown :-1 s=CLOSED pgs=2794 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:07.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.439+0000 7f405d4d4700 1 --2- 172.21.15.80:0/475684861 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405806c0a0 0x7f4058072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:07.443 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.439+0000 7f405d4d4700 1 -- 172.21.15.80:0/475684861 shutdown_connections 2019-11-28T11:58:07.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.439+0000 7f405d4d4700 1 -- 172.21.15.80:0/475684861 wait complete. 2019-11-28T11:58:07.444 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.439+0000 7f405d4d4700 1 -- 172.21.15.80:0/475684861 >> 172.21.15.80:0/475684861 conn(0x7f4058061cf0 msgr2=0x7f4058064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:07.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.441+0000 7f405d4d4700 1 Processor -- start 2019-11-28T11:58:07.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.441+0000 7f405d4d4700 1 -- start start 2019-11-28T11:58:07.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.442+0000 7f405d4d4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405815fdf0 0x7f405812b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:07.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.442+0000 7f405d4d4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f405812b8a0 0x7f405813e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:07.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.442+0000 7f405d4d4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4058139e00 con 0x7f405813e860 2019-11-28T11:58:07.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.442+0000 7f405d4d4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4058107df0 con 0x7f405812b8a0 2019-11-28T11:58:07.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.442+0000 7f405d4d4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4058107890 con 0x7f405815fdf0 2019-11-28T11:58:07.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.442+0000 7f40577fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405815fdf0 0x7f405812b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:07.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.442+0000 7f40577fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405815fdf0 0x7f405812b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:48778/0 (socket says 172.21.15.80:48778) 2019-11-28T11:58:07.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.442+0000 7f40577fe700 1 -- 172.21.15.80:0/4087948318 learned_addr learned my addr 172.21.15.80:0/4087948318 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:07.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.442+0000 7f4056ffd700 1 --2- 172.21.15.80:0/4087948318 >> v2:172.21.15.174:3300/0 conn(0x7f405812b8a0 0x7f405813e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:07.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.443+0000 7f40577fe700 1 -- 172.21.15.80:0/4087948318 >> v2:172.21.15.174:3300/0 conn(0x7f405812b8a0 msgr2=0x7f405813e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:07.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.443+0000 7f40577fe700 1 --2- 172.21.15.80:0/4087948318 >> v2:172.21.15.174:3300/0 conn(0x7f405812b8a0 0x7f405813e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:07.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.443+0000 7f40577fe700 1 -- 172.21.15.80:0/4087948318 >> v1:172.21.15.174:6789/0 conn(0x7f405813e860 legacy=0x7f405812a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:07.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.443+0000 7f40577fe700 1 -- 172.21.15.80:0/4087948318 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405810a8c0 con 0x7f405815fdf0 2019-11-28T11:58:07.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.443+0000 7f40577fe700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405815fdf0 0x7f405812b360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4044010460 tx=0x7f4044010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.443+0000 7f40577fe700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405815fdf0 0x7f405812b360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4044010460 tx=0x7f4044010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.443+0000 7f40577fe700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405815fdf0 0x7f405812b360 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7f4044010460 tx=0x7f4044010290).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:07.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.443+0000 7f40577fe700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405815fdf0 0x7f405812b360 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f4044010460 tx=0x7f4044010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.443+0000 7f404ffff700 1 -- 172.21.15.80:0/4087948318 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4044000940 con 0x7f405815fdf0 2019-11-28T11:58:07.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.443+0000 7f40577fe700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405815fdf0 0x7f405812b360 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f4044010460 tx=0x7f4044010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.443+0000 7f40577fe700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405815fdf0 0x7f405812b360 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f4044010460 tx=0x7f4044010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.443+0000 7f404ffff700 1 -- 172.21.15.80:0/4087948318 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4044001270 con 0x7f405815fdf0 2019-11-28T11:58:07.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.443+0000 7f405d4d4700 1 -- 172.21.15.80:0/4087948318 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405810a8c0 con 0x7f405815fdf0 2019-11-28T11:58:07.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.443+0000 7f404ffff700 1 -- 172.21.15.80:0/4087948318 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4044001460 con 0x7f405815fdf0 2019-11-28T11:58:07.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.443+0000 7f405d4d4700 1 -- 172.21.15.80:0/4087948318 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405810a8c0 con 0x7f405815fdf0 2019-11-28T11:58:07.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.443+0000 7f40577fe700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405815fdf0 0x7f405812b360 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f4044010460 tx=0x7f4044010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.444+0000 7f404ffff700 1 -- 172.21.15.80:0/4087948318 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4044000f80 con 0x7f405815fdf0 2019-11-28T11:58:07.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.444+0000 7f40577fe700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405815fdf0 0x7f405812b360 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f4044010460 tx=0x7f4044010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.444+0000 7f404ffff700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4034018730 0x7f403401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:07.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.444+0000 7f404ffff700 1 -- 172.21.15.80:0/4087948318 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4044031af0 con 0x7f405815fdf0 2019-11-28T11:58:07.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.444+0000 7f4056ffd700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4034018730 0x7f403401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:07.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.444+0000 7f4056ffd700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4034018730 0x7f403401abc0 crc :-1 s=READY pgs=1160 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:07.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.451+0000 7f405d4d4700 1 -- 172.21.15.80:0/4087948318 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4058109180 con 0x7f405815fdf0 2019-11-28T11:58:07.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.455+0000 7f40577fe700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405815fdf0 0x7f405812b360 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f4044010460 tx=0x7f4044010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.455+0000 7f404ffff700 1 -- 172.21.15.80:0/4087948318 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4044000d70 con 0x7f405815fdf0 2019-11-28T11:58:07.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.630+0000 7f405d4d4700 1 -- 172.21.15.80:0/4087948318 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4058109500 con 0x7f405815fdf0 2019-11-28T11:58:07.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.632+0000 7f40577fe700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405815fdf0 0x7f405812b360 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f4044010460 tx=0x7f4044010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.632+0000 7f404ffff700 1 -- 172.21.15.80:0/4087948318 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v213) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f4044000f60 con 0x7f405815fdf0 2019-11-28T11:58:07.631 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:07.631 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":213,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:57:56.570576+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":35,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":34,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:57:53.888806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":35,"pool_name":"cephfs_data","create_time":"2019-11-28T11:57:54.582023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"213","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:58:07.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.636+0000 7f405d4d4700 1 -- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4034018730 msgr2=0x7f403401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:07.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.636+0000 7f405d4d4700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4034018730 0x7f403401abc0 crc :-1 s=READY pgs=1160 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:07.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.636+0000 7f405d4d4700 1 -- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405815fdf0 msgr2=0x7f405812b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:07.633 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.636+0000 7f405d4d4700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405815fdf0 0x7f405812b360 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7f4044010460 tx=0x7f4044010290).stop 2019-11-28T11:58:07.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.636+0000 7f405d4d4700 1 -- 172.21.15.80:0/4087948318 shutdown_connections 2019-11-28T11:58:07.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.636+0000 7f405d4d4700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4034018730 0x7f403401abc0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:07.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.636+0000 7f405d4d4700 1 --2- 172.21.15.80:0/4087948318 >> v2:172.21.15.174:3300/0 conn(0x7f405812b8a0 0x7f405813e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:07.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.636+0000 7f405d4d4700 1 --2- 172.21.15.80:0/4087948318 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f405815fdf0 0x7f405812b360 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:07.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.636+0000 7f405d4d4700 1 -- 172.21.15.80:0/4087948318 shutdown_connections 2019-11-28T11:58:07.634 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.636+0000 7f405d4d4700 1 -- 172.21.15.80:0/4087948318 wait complete. 2019-11-28T11:58:07.635 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.636+0000 7f405d4d4700 1 -- 172.21.15.80:0/4087948318 >> 172.21.15.80:0/4087948318 conn(0x7f4058127dc0 msgr2=0x7f4058141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:07.643 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:57:53.888806+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 34, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'212', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:57:54.582023+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 35, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'213', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:58:07.644 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:58:07.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.770+0000 7f0160478700 1 Processor -- start 2019-11-28T11:58:07.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.770+0000 7f0160478700 1 -- start start 2019-11-28T11:58:07.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.771+0000 7f0160478700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f015815f100 0x7f015806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:07.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.771+0000 7f0160478700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f015806c2f0 0x7f015806c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:07.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.771+0000 7f0160478700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015806db60 con 0x7f015815ed10 2019-11-28T11:58:07.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.771+0000 7f0160478700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015806fe00 con 0x7f015806c2f0 2019-11-28T11:58:07.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.771+0000 7f0160478700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01580700d0 con 0x7f015815f100 2019-11-28T11:58:07.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.771+0000 7f015f216700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f015806c2f0 0x7f015806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:07.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.771+0000 7f015f216700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f015806c2f0 0x7f015806c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46528/0 (socket says 172.21.15.80:46528) 2019-11-28T11:58:07.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.771+0000 7f015f216700 1 -- 172.21.15.80:0/460377406 learned_addr learned my addr 172.21.15.80:0/460377406 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:07.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.771+0000 7f015e214700 1 --2- 172.21.15.80:0/460377406 >> v2:172.21.15.174:3300/0 conn(0x7f015815f100 0x7f015806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:07.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.771+0000 7f015f216700 1 -- 172.21.15.80:0/460377406 >> v2:172.21.15.174:3300/0 conn(0x7f015815f100 msgr2=0x7f015806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:07.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.771+0000 7f015f216700 1 --2- 172.21.15.80:0/460377406 >> v2:172.21.15.174:3300/0 conn(0x7f015815f100 0x7f015806bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:07.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.771+0000 7f015f216700 1 -- 172.21.15.80:0/460377406 >> v1:172.21.15.174:6789/0 conn(0x7f015815ed10 legacy=0x7f0158073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:07.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.771+0000 7f015f216700 1 -- 172.21.15.80:0/460377406 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158070760 con 0x7f015806c2f0 2019-11-28T11:58:07.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.771+0000 7f015f216700 1 --2- 172.21.15.80:0/460377406 >> v2:172.21.15.80:3300/0 conn(0x7f015806c2f0 0x7f015806c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f015000fab0 tx=0x7f01500080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.771+0000 7f015f216700 1 --2- 172.21.15.80:0/460377406 >> v2:172.21.15.80:3300/0 conn(0x7f015806c2f0 0x7f015806c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f015000fab0 tx=0x7f01500080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.771+0000 7f015f216700 1 --2- 172.21.15.80:0/460377406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015806c2f0 0x7f015806c770 secure :-1 s=READY pgs=2795 cs=0 l=1 rx=0x7f015000fab0 tx=0x7f01500080d0).ready entity=mon.0 client_cookie=2d6c433d87b49a2b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:07.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.772+0000 7f015f216700 1 --2- 172.21.15.80:0/460377406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015806c2f0 0x7f015806c770 secure :-1 s=THROTTLE_DONE pgs=2795 cs=0 l=1 rx=0x7f015000fab0 tx=0x7f01500080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.772+0000 7f015f216700 1 --2- 172.21.15.80:0/460377406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015806c2f0 0x7f015806c770 secure :-1 s=THROTTLE_DONE pgs=2795 cs=0 l=1 rx=0x7f015000fab0 tx=0x7f01500080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.772+0000 7f015da13700 1 -- 172.21.15.80:0/460377406 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0150000df0 con 0x7f015806c2f0 2019-11-28T11:58:07.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.772+0000 7f015f216700 1 --2- 172.21.15.80:0/460377406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015806c2f0 0x7f015806c770 secure :-1 s=THROTTLE_DONE pgs=2795 cs=0 l=1 rx=0x7f015000fab0 tx=0x7f01500080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.772+0000 7f015da13700 1 -- 172.21.15.80:0/460377406 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0150001460 con 0x7f015806c2f0 2019-11-28T11:58:07.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.772+0000 7f015da13700 1 -- 172.21.15.80:0/460377406 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0150001b30 con 0x7f015806c2f0 2019-11-28T11:58:07.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.772+0000 7f0160478700 1 -- 172.21.15.80:0/460377406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015806c2f0 msgr2=0x7f015806c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:07.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.772+0000 7f0160478700 1 --2- 172.21.15.80:0/460377406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015806c2f0 0x7f015806c770 secure :-1 s=READY pgs=2795 cs=0 l=1 rx=0x7f015000fab0 tx=0x7f01500080d0).stop 2019-11-28T11:58:07.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.772+0000 7f0160478700 1 -- 172.21.15.80:0/460377406 shutdown_connections 2019-11-28T11:58:07.785 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.772+0000 7f0160478700 1 --2- 172.21.15.80:0/460377406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015806c2f0 0x7f015806c770 unknown :-1 s=CLOSED pgs=2795 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:07.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.772+0000 7f0160478700 1 --2- 172.21.15.80:0/460377406 >> v2:172.21.15.174:3300/0 conn(0x7f015815f100 0x7f015806bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:07.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.772+0000 7f0160478700 1 -- 172.21.15.80:0/460377406 shutdown_connections 2019-11-28T11:58:07.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.772+0000 7f0160478700 1 -- 172.21.15.80:0/460377406 wait complete. 2019-11-28T11:58:07.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.772+0000 7f0160478700 1 -- 172.21.15.80:0/460377406 >> 172.21.15.80:0/460377406 conn(0x7f0158061d20 msgr2=0x7f01580641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:07.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.775+0000 7f0160478700 1 Processor -- start 2019-11-28T11:58:07.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.775+0000 7f0160478700 1 -- start start 2019-11-28T11:58:07.786 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f0160478700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f015810f9f0 0x7f0158168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:07.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f0160478700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015810c250 con 0x7f015810ed60 2019-11-28T11:58:07.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f0160478700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015810fe70 con 0x7f015810e970 2019-11-28T11:58:07.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f0160478700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015810e430 con 0x7f015810f9f0 2019-11-28T11:58:07.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f015f216700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f015810f9f0 0x7f0158168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:07.787 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f015f216700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f015810f9f0 0x7f0158168d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46536/0 (socket says 172.21.15.80:46536) 2019-11-28T11:58:07.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f015e214700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f015810ed60 0x7f015810f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45850/0 (socket says 172.21.15.80:45850) 2019-11-28T11:58:07.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f015f216700 1 -- 172.21.15.80:0/1317414900 learned_addr learned my addr 172.21.15.80:0/1317414900 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:07.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f015f216700 1 -- 172.21.15.80:0/1317414900 >> v1:172.21.15.174:6789/0 conn(0x7f015810e970 legacy=0x7f01581087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:07.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f015f216700 1 -- 172.21.15.80:0/1317414900 >> v1:172.21.15.80:6789/0 conn(0x7f015810ed60 legacy=0x7f015810f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:07.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f015f216700 1 -- 172.21.15.80:0/1317414900 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158105ef0 con 0x7f015810f9f0 2019-11-28T11:58:07.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f01577fe700 1 -- 172.21.15.80:0/1317414900 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685712554 0 0) 0x7f01400010b0 con 0x7f015810ed60 2019-11-28T11:58:07.800 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f015f216700 1 --2- 172.21.15.80:0/1317414900 >> v2:172.21.15.80:3300/0 conn(0x7f015810f9f0 0x7f0158168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f01500107b0 tx=0x7f0150010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f015f216700 1 --2- 172.21.15.80:0/1317414900 >> v2:172.21.15.80:3300/0 conn(0x7f015810f9f0 0x7f0158168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f01500107b0 tx=0x7f0150010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f015f216700 1 --2- 172.21.15.80:0/1317414900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015810f9f0 0x7f0158168d80 secure :-1 s=READY pgs=2797 cs=0 l=1 rx=0x7f01500107b0 tx=0x7f0150010b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:07.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f015f216700 1 --2- 172.21.15.80:0/1317414900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015810f9f0 0x7f0158168d80 secure :-1 s=THROTTLE_DONE pgs=2797 cs=0 l=1 rx=0x7f01500107b0 tx=0x7f0150010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f01577fe700 1 -- 172.21.15.80:0/1317414900 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0150005cb0 con 0x7f015810f9f0 2019-11-28T11:58:07.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f015f216700 1 --2- 172.21.15.80:0/1317414900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015810f9f0 0x7f0158168d80 secure :-1 s=THROTTLE_DONE pgs=2797 cs=0 l=1 rx=0x7f01500107b0 tx=0x7f0150010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f015f216700 1 --2- 172.21.15.80:0/1317414900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015810f9f0 0x7f0158168d80 secure :-1 s=THROTTLE_DONE pgs=2797 cs=0 l=1 rx=0x7f01500107b0 tx=0x7f0150010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f01577fe700 1 -- 172.21.15.80:0/1317414900 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01500058d0 con 0x7f015810f9f0 2019-11-28T11:58:07.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f01577fe700 1 -- 172.21.15.80:0/1317414900 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0150006290 con 0x7f015810f9f0 2019-11-28T11:58:07.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f0160478700 1 -- 172.21.15.80:0/1317414900 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0158106270 con 0x7f015810f9f0 2019-11-28T11:58:07.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.776+0000 7f0160478700 1 -- 172.21.15.80:0/1317414900 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0158105ef0 con 0x7f015810f9f0 2019-11-28T11:58:07.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.777+0000 7f015f216700 1 --2- 172.21.15.80:0/1317414900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015810f9f0 0x7f0158168d80 secure :-1 s=THROTTLE_DONE pgs=2797 cs=0 l=1 rx=0x7f01500107b0 tx=0x7f0150010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.777+0000 7f01577fe700 1 -- 172.21.15.80:0/1317414900 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0150005ac0 con 0x7f015810f9f0 2019-11-28T11:58:07.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.777+0000 7f015f216700 1 --2- 172.21.15.80:0/1317414900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015810f9f0 0x7f0158168d80 secure :-1 s=THROTTLE_DONE pgs=2797 cs=0 l=1 rx=0x7f01500107b0 tx=0x7f0150010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.777+0000 7f01577fe700 1 --2- 172.21.15.80:0/1317414900 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f013c018730 0x7f013c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:07.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.777+0000 7f01577fe700 1 -- 172.21.15.80:0/1317414900 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0150032150 con 0x7f015810f9f0 2019-11-28T11:58:07.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.777+0000 7f015ea15700 1 --2- 172.21.15.80:0/1317414900 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f013c018730 0x7f013c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:07.803 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.778+0000 7f015ea15700 1 --2- 172.21.15.80:0/1317414900 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f013c018730 0x7f013c01abc0 crc :-1 s=READY pgs=1161 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:07.804 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.786+0000 7f0160478700 1 -- 172.21.15.80:0/1317414900 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0158106270 con 0x7f015810f9f0 2019-11-28T11:58:07.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.788+0000 7f015f216700 1 --2- 172.21.15.80:0/1317414900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015810f9f0 0x7f0158168d80 secure :-1 s=THROTTLE_DONE pgs=2797 cs=0 l=1 rx=0x7f01500107b0 tx=0x7f0150010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.788+0000 7f01577fe700 1 -- 172.21.15.80:0/1317414900 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f01500056c0 con 0x7f015810f9f0 2019-11-28T11:58:07.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.957+0000 7f0160478700 1 -- 172.21.15.80:0/1317414900 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f0158105ef0 con 0x7f015810f9f0 2019-11-28T11:58:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.957+0000 7f015f216700 1 --2- 172.21.15.80:0/1317414900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015810f9f0 0x7f0158168d80 secure :-1 s=THROTTLE_DONE pgs=2797 cs=0 l=1 rx=0x7f01500107b0 tx=0x7f0150010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.957+0000 7f01577fe700 1 -- 172.21.15.80:0/1317414900 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v213) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0150008030 con 0x7f015810f9f0 2019-11-28T11:58:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.960+0000 7f0160478700 1 -- 172.21.15.80:0/1317414900 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f013c018730 msgr2=0x7f013c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.960+0000 7f0160478700 1 --2- 172.21.15.80:0/1317414900 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f013c018730 0x7f013c01abc0 crc :-1 s=READY pgs=1161 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.960+0000 7f0160478700 1 -- 172.21.15.80:0/1317414900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015810f9f0 msgr2=0x7f0158168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:07.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.960+0000 7f0160478700 1 --2- 172.21.15.80:0/1317414900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015810f9f0 0x7f0158168d80 secure :-1 s=READY pgs=2797 cs=0 l=1 rx=0x7f01500107b0 tx=0x7f0150010b50).stop 2019-11-28T11:58:07.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.960+0000 7f0160478700 1 -- 172.21.15.80:0/1317414900 shutdown_connections 2019-11-28T11:58:07.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.960+0000 7f0160478700 1 --2- 172.21.15.80:0/1317414900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f015810f9f0 0x7f0158168d80 unknown :-1 s=CLOSED pgs=2797 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:07.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.960+0000 7f0160478700 1 --2- 172.21.15.80:0/1317414900 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f013c018730 0x7f013c01abc0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:07.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.960+0000 7f0160478700 1 -- 172.21.15.80:0/1317414900 shutdown_connections 2019-11-28T11:58:07.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.960+0000 7f0160478700 1 -- 172.21.15.80:0/1317414900 wait complete. 2019-11-28T11:58:07.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:07.960+0000 7f0160478700 1 -- 172.21.15.80:0/1317414900 >> 172.21.15.80:0/1317414900 conn(0x7f015815e2d0 msgr2=0x7f0158147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:07.960 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:58:07.967 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:58:08.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.093+0000 7fc999761700 1 Processor -- start 2019-11-28T11:58:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.093+0000 7fc999761700 1 -- start start 2019-11-28T11:58:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.094+0000 7fc999761700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc99415f100 0x7fc99406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.094+0000 7fc999761700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc99406c2f0 0x7fc99406c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.094+0000 7fc999761700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99406db60 con 0x7fc99415ed10 2019-11-28T11:58:08.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.094+0000 7fc999761700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99406fe00 con 0x7fc99406c2f0 2019-11-28T11:58:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.094+0000 7fc999761700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9940700d0 con 0x7fc99415f100 2019-11-28T11:58:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9937fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc99415ed10 0x7fc994073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45856/0 (socket says 172.21.15.80:45856) 2019-11-28T11:58:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9937fe700 1 -- 172.21.15.80:0/757345718 learned_addr learned my addr 172.21.15.80:0/757345718 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc993fff700 1 --2- 172.21.15.80:0/757345718 >> v2:172.21.15.174:3300/0 conn(0x7fc99406c2f0 0x7fc99406c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc992ffd700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc99415f100 0x7fc99406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9927fc700 1 -- 172.21.15.80:0/757345718 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626719286 0 0) 0x7fc97c001150 con 0x7fc99415ed10 2019-11-28T11:58:08.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9927fc700 1 -- 172.21.15.80:0/757345718 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc974002e80 con 0x7fc99415ed10 2019-11-28T11:58:08.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9927fc700 1 -- 172.21.15.80:0/757345718 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3766784245 0 0) 0x7fc97c001130 con 0x7fc99415ed10 2019-11-28T11:58:08.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9927fc700 1 -- 172.21.15.80:0/757345718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc99415f100 msgr2=0x7fc99406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:08.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9927fc700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc99415f100 0x7fc99406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:08.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9927fc700 1 -- 172.21.15.80:0/757345718 >> v2:172.21.15.174:3300/0 conn(0x7fc99406c2f0 msgr2=0x7fc99406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:08.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9927fc700 1 --2- 172.21.15.80:0/757345718 >> v2:172.21.15.174:3300/0 conn(0x7fc99406c2f0 0x7fc99406c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:08.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9927fc700 1 -- 172.21.15.80:0/757345718 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc994070760 con 0x7fc99415ed10 2019-11-28T11:58:08.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9927fc700 1 -- 172.21.15.80:0/757345718 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc97c001660 con 0x7fc99415ed10 2019-11-28T11:58:08.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc993fff700 1 --2- 172.21.15.80:0/757345718 >> v2:172.21.15.174:3300/0 conn(0x7fc99406c2f0 0x7fc99406c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:08.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9927fc700 1 -- 172.21.15.80:0/757345718 >> v1:172.21.15.80:6789/0 conn(0x7fc99415ed10 legacy=0x7fc994073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9927fc700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9740479e0 0x7fc974049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:08.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9927fc700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97404a5a0 0x7fc97404ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:08.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9927fc700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc97404d270 0x7fc97404f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:08.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9927fc700 1 -- 172.21.15.80:0/757345718 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97404ff50 con 0x7fc97404a5a0 2019-11-28T11:58:08.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9927fc700 1 -- 172.21.15.80:0/757345718 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc974050140 con 0x7fc97404d270 2019-11-28T11:58:08.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9927fc700 1 -- 172.21.15.80:0/757345718 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc974050370 con 0x7fc9740479e0 2019-11-28T11:58:08.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc992ffd700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97404a5a0 0x7fc97404ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.095+0000 7fc9937fe700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9740479e0 0x7fc974049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc993fff700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc97404d270 0x7fc97404f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc992ffd700 1 -- 172.21.15.80:0/757345718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9740479e0 msgr2=0x7fc974049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:08.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc992ffd700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9740479e0 0x7fc974049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:08.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc992ffd700 1 -- 172.21.15.80:0/757345718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc97404d270 msgr2=0x7fc97404f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:08.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc992ffd700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc97404d270 0x7fc97404f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:08.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc992ffd700 1 -- 172.21.15.80:0/757345718 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc974050620 con 0x7fc97404a5a0 2019-11-28T11:58:08.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc9937fe700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9740479e0 0x7fc974049e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:58:08.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc993fff700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc97404d270 0x7fc97404f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:58:08.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc992ffd700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97404a5a0 0x7fc97404ca70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc98c00f9e0 tx=0x7fc98c00fd80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc992ffd700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97404a5a0 0x7fc97404ca70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc98c00f9e0 tx=0x7fc98c00fd80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc992ffd700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97404a5a0 0x7fc97404ca70 secure :-1 s=READY pgs=2799 cs=0 l=1 rx=0x7fc98c00f9e0 tx=0x7fc98c00fd80).ready entity=mon.0 client_cookie=e7395f033237bf2e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:08.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc992ffd700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97404a5a0 0x7fc97404ca70 secure :-1 s=THROTTLE_DONE pgs=2799 cs=0 l=1 rx=0x7fc98c00f9e0 tx=0x7fc98c00fd80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc9927fc700 1 -- 172.21.15.80:0/757345718 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc98c000cc0 con 0x7fc97404a5a0 2019-11-28T11:58:08.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc992ffd700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97404a5a0 0x7fc97404ca70 secure :-1 s=THROTTLE_DONE pgs=2799 cs=0 l=1 rx=0x7fc98c00f9e0 tx=0x7fc98c00fd80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc992ffd700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97404a5a0 0x7fc97404ca70 secure :-1 s=THROTTLE_DONE pgs=2799 cs=0 l=1 rx=0x7fc98c00f9e0 tx=0x7fc98c00fd80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc9927fc700 1 -- 172.21.15.80:0/757345718 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c001220 con 0x7fc97404a5a0 2019-11-28T11:58:08.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc9927fc700 1 -- 172.21.15.80:0/757345718 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc98c0018f0 con 0x7fc97404a5a0 2019-11-28T11:58:08.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc999761700 1 -- 172.21.15.80:0/757345718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97404a5a0 msgr2=0x7fc97404ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc999761700 1 --2- 172.21.15.80:0/757345718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc97404a5a0 0x7fc97404ca70 secure :-1 s=READY pgs=2799 cs=0 l=1 rx=0x7fc98c00f9e0 tx=0x7fc98c00fd80).stop 2019-11-28T11:58:08.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.096+0000 7fc993fff700 1 -- 172.21.15.80:0/757345718 reap_dead start 2019-11-28T11:58:08.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.097+0000 7fc999761700 1 -- 172.21.15.80:0/757345718 shutdown_connections 2019-11-28T11:58:08.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.097+0000 7fc999761700 1 -- 172.21.15.80:0/757345718 shutdown_connections 2019-11-28T11:58:08.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.097+0000 7fc999761700 1 -- 172.21.15.80:0/757345718 wait complete. 2019-11-28T11:58:08.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.097+0000 7fc999761700 1 -- 172.21.15.80:0/757345718 >> 172.21.15.80:0/757345718 conn(0x7fc994061d20 msgr2=0x7fc9940641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:08.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.099+0000 7fc999761700 1 Processor -- start 2019-11-28T11:58:08.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.099+0000 7fc999761700 1 -- start start 2019-11-28T11:58:08.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.100+0000 7fc999761700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc9941502e0 0x7fc994150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:08.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.100+0000 7fc999761700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc994150cb0 0x7fc994167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:08.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.100+0000 7fc999761700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc994133a20 con 0x7fc994108630 2019-11-28T11:58:08.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.100+0000 7fc999761700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc994131980 con 0x7fc9941502e0 2019-11-28T11:58:08.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.100+0000 7fc999761700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc994131c50 con 0x7fc994150cb0 2019-11-28T11:58:08.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.100+0000 7fc9937fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc994108630 0x7fc994151200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45868/0 (socket says 172.21.15.80:45868) 2019-11-28T11:58:08.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.100+0000 7fc9937fe700 1 -- 172.21.15.80:0/943925563 learned_addr learned my addr 172.21.15.80:0/943925563 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:08.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.100+0000 7fc992ffd700 1 --2- 172.21.15.80:0/943925563 >> v2:172.21.15.174:3300/0 conn(0x7fc9941502e0 0x7fc994150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.100+0000 7fc993fff700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc994150cb0 0x7fc994167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.100+0000 7fc98bfff700 1 -- 172.21.15.80:0/943925563 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022439929 0 0) 0x7fc97c000940 con 0x7fc994108630 2019-11-28T11:58:08.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc98bfff700 1 -- 172.21.15.80:0/943925563 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc96c002e80 con 0x7fc994108630 2019-11-28T11:58:08.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc98bfff700 1 -- 172.21.15.80:0/943925563 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 519536443 0 0) 0x7fc97c001c80 con 0x7fc994108630 2019-11-28T11:58:08.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc992ffd700 1 -- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc994150cb0 msgr2=0x7fc994167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc992ffd700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc994150cb0 0x7fc994167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:08.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc992ffd700 1 -- 172.21.15.80:0/943925563 >> v1:172.21.15.80:6789/0 conn(0x7fc994108630 legacy=0x7fc994151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc992ffd700 1 -- 172.21.15.80:0/943925563 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9941322e0 con 0x7fc9941502e0 2019-11-28T11:58:08.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc993fff700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc994150cb0 0x7fc994167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:08.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc992ffd700 1 --2- 172.21.15.80:0/943925563 >> v2:172.21.15.174:3300/0 conn(0x7fc9941502e0 0x7fc994150770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc98c010710 tx=0x7fc98c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc992ffd700 1 --2- 172.21.15.80:0/943925563 >> v2:172.21.15.174:3300/0 conn(0x7fc9941502e0 0x7fc994150770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc98c010710 tx=0x7fc98c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc992ffd700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9941502e0 0x7fc994150770 secure :-1 s=READY pgs=1700 cs=0 l=1 rx=0x7fc98c010710 tx=0x7fc98c010ab0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:08.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc992ffd700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9941502e0 0x7fc994150770 secure :-1 s=THROTTLE_DONE pgs=1700 cs=0 l=1 rx=0x7fc98c010710 tx=0x7fc98c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc98bfff700 1 -- 172.21.15.80:0/943925563 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc98c000cc0 con 0x7fc9941502e0 2019-11-28T11:58:08.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc992ffd700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9941502e0 0x7fc994150770 secure :-1 s=THROTTLE_DONE pgs=1700 cs=0 l=1 rx=0x7fc98c010710 tx=0x7fc98c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc992ffd700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9941502e0 0x7fc994150770 secure :-1 s=THROTTLE_DONE pgs=1700 cs=0 l=1 rx=0x7fc98c010710 tx=0x7fc98c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc98bfff700 1 -- 172.21.15.80:0/943925563 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c000f90 con 0x7fc9941502e0 2019-11-28T11:58:08.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc999761700 1 -- 172.21.15.80:0/943925563 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc994132660 con 0x7fc9941502e0 2019-11-28T11:58:08.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc98bfff700 1 -- 172.21.15.80:0/943925563 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc98c002560 con 0x7fc9941502e0 2019-11-28T11:58:08.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.101+0000 7fc999761700 1 -- 172.21.15.80:0/943925563 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9941322e0 con 0x7fc9941502e0 2019-11-28T11:58:08.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.102+0000 7fc992ffd700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9941502e0 0x7fc994150770 secure :-1 s=THROTTLE_DONE pgs=1700 cs=0 l=1 rx=0x7fc98c010710 tx=0x7fc98c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.102+0000 7fc98bfff700 1 -- 172.21.15.80:0/943925563 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc98c001180 con 0x7fc9941502e0 2019-11-28T11:58:08.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.102+0000 7fc992ffd700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9941502e0 0x7fc994150770 secure :-1 s=THROTTLE_DONE pgs=1700 cs=0 l=1 rx=0x7fc98c010710 tx=0x7fc98c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.102+0000 7fc98bfff700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc96c018780 0x7fc96c01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:08.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.102+0000 7fc98bfff700 1 -- 172.21.15.80:0/943925563 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc98c031de0 con 0x7fc9941502e0 2019-11-28T11:58:08.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.102+0000 7fc9937fe700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc96c018780 0x7fc96c01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.102+0000 7fc9937fe700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc96c018780 0x7fc96c01abf0 crc :-1 s=READY pgs=1162 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:08.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.109+0000 7fc999761700 1 -- 172.21.15.80:0/943925563 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc994132660 con 0x7fc9941502e0 2019-11-28T11:58:08.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.113+0000 7fc992ffd700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9941502e0 0x7fc994150770 secure :-1 s=THROTTLE_DONE pgs=1700 cs=0 l=1 rx=0x7fc98c010710 tx=0x7fc98c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.113+0000 7fc98bfff700 1 -- 172.21.15.80:0/943925563 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc98c00c990 con 0x7fc9941502e0 2019-11-28T11:58:08.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.277+0000 7fc999761700 1 -- 172.21.15.80:0/943925563 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fc9941322e0 con 0x7fc9941502e0 2019-11-28T11:58:08.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.279+0000 7fc992ffd700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9941502e0 0x7fc994150770 secure :-1 s=THROTTLE_DONE pgs=1700 cs=0 l=1 rx=0x7fc98c010710 tx=0x7fc98c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.279+0000 7fc98bfff700 1 -- 172.21.15.80:0/943925563 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v213) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc98c00c990 con 0x7fc9941502e0 2019-11-28T11:58:08.276 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:58:08.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.280+0000 7fc999761700 1 -- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc96c018780 msgr2=0x7fc96c01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.280+0000 7fc999761700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc96c018780 0x7fc96c01abf0 crc :-1 s=READY pgs=1162 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:08.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.280+0000 7fc999761700 1 -- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9941502e0 msgr2=0x7fc994150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.280+0000 7fc999761700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9941502e0 0x7fc994150770 secure :-1 s=READY pgs=1700 cs=0 l=1 rx=0x7fc98c010710 tx=0x7fc98c010ab0).stop 2019-11-28T11:58:08.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.280+0000 7fc999761700 1 -- 172.21.15.80:0/943925563 shutdown_connections 2019-11-28T11:58:08.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.280+0000 7fc999761700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc96c018780 0x7fc96c01abf0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:08.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.280+0000 7fc999761700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc994150cb0 0x7fc994167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:08.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.280+0000 7fc999761700 1 --2- 172.21.15.80:0/943925563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9941502e0 0x7fc994150770 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:08.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.280+0000 7fc999761700 1 -- 172.21.15.80:0/943925563 shutdown_connections 2019-11-28T11:58:08.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.280+0000 7fc999761700 1 -- 172.21.15.80:0/943925563 wait complete. 2019-11-28T11:58:08.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.280+0000 7fc999761700 1 -- 172.21.15.80:0/943925563 >> 172.21.15.80:0/943925563 conn(0x7fc99414dbb0 msgr2=0x7fc994142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:08.287 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:58:08.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.413+0000 7f166e516700 1 Processor -- start 2019-11-28T11:58:08.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.413+0000 7f166e516700 1 -- start start 2019-11-28T11:58:08.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.414+0000 7f166e516700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f166815f100 0x7f166806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:08.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.414+0000 7f166e516700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166806db60 con 0x7f166815ed10 2019-11-28T11:58:08.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.414+0000 7f166e516700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166806e060 con 0x7f166806c2f0 2019-11-28T11:58:08.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.414+0000 7f166e516700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166806fe00 con 0x7f166815f100 2019-11-28T11:58:08.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.414+0000 7f166cab3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f166815ed10 0x7f1668073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45876/0 (socket says 172.21.15.80:45876) 2019-11-28T11:58:08.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.414+0000 7f166cab3700 1 -- 172.21.15.80:0/934916996 learned_addr learned my addr 172.21.15.80:0/934916996 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:08.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.414+0000 7f1667fff700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f166815f100 0x7f166806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.414+0000 7f16677fe700 1 -- 172.21.15.80:0/934916996 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184680501 0 0) 0x7f1650001150 con 0x7f166815ed10 2019-11-28T11:58:08.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.414+0000 7f16677fe700 1 -- 172.21.15.80:0/934916996 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1654002e80 con 0x7f166815ed10 2019-11-28T11:58:08.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 -- 172.21.15.80:0/934916996 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111666315 0 0) 0x7f16600009b0 con 0x7f166806c2f0 2019-11-28T11:58:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 -- 172.21.15.80:0/934916996 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16540030b0 con 0x7f166806c2f0 2019-11-28T11:58:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 -- 172.21.15.80:0/934916996 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3961789984 0 0) 0x7f1650001130 con 0x7f166815ed10 2019-11-28T11:58:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 -- 172.21.15.80:0/934916996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f166815f100 msgr2=0x7f166806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f166815f100 0x7f166806bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 -- 172.21.15.80:0/934916996 >> v1:172.21.15.174:6789/0 conn(0x7f166806c2f0 legacy=0x7f166806c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 -- 172.21.15.80:0/934916996 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1668070760 con 0x7f166815ed10 2019-11-28T11:58:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 -- 172.21.15.80:0/934916996 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f1650001660 con 0x7f166815ed10 2019-11-28T11:58:08.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f1667fff700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f166815f100 0x7f166806bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:08.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 -- 172.21.15.80:0/934916996 >> v1:172.21.15.80:6789/0 conn(0x7f166815ed10 legacy=0x7f1668073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1654003b80 0x7f1654005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:08.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16540066b0 0x7f1654008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:08.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f165404d3b0 0x7f165404f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:08.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 -- 172.21.15.80:0/934916996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165404ffd0 con 0x7f16540066b0 2019-11-28T11:58:08.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 -- 172.21.15.80:0/934916996 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1654050200 con 0x7f1654003b80 2019-11-28T11:58:08.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 -- 172.21.15.80:0/934916996 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1654050430 con 0x7f165404d3b0 2019-11-28T11:58:08.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f166cab3700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1654003b80 0x7f1654005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f1667fff700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16540066b0 0x7f1654008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f166d2b4700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f165404d3b0 0x7f165404f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f1667fff700 1 -- 172.21.15.80:0/934916996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f165404d3b0 msgr2=0x7f165404f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:08.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f1667fff700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f165404d3b0 0x7f165404f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f1667fff700 1 -- 172.21.15.80:0/934916996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1654003b80 msgr2=0x7f1654005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f1667fff700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1654003b80 0x7f1654005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f1667fff700 1 -- 172.21.15.80:0/934916996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16540506e0 con 0x7f16540066b0 2019-11-28T11:58:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f1667fff700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16540066b0 0x7f1654008b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f165800f9b0 tx=0x7f1658002f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f1667fff700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16540066b0 0x7f1654008b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f165800f9b0 tx=0x7f1658002f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f1667fff700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16540066b0 0x7f1654008b40 secure :-1 s=READY pgs=2802 cs=0 l=1 rx=0x7f165800f9b0 tx=0x7f1658002f70).ready entity=mon.0 client_cookie=71ef97d689f9fbc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f1667fff700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16540066b0 0x7f1654008b40 secure :-1 s=THROTTLE_DONE pgs=2802 cs=0 l=1 rx=0x7f165800f9b0 tx=0x7f1658002f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f1667fff700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16540066b0 0x7f1654008b40 secure :-1 s=THROTTLE_DONE pgs=2802 cs=0 l=1 rx=0x7f165800f9b0 tx=0x7f1658002f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 -- 172.21.15.80:0/934916996 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1658000ce0 con 0x7f16540066b0 2019-11-28T11:58:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f1667fff700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16540066b0 0x7f1654008b40 secure :-1 s=THROTTLE_DONE pgs=2802 cs=0 l=1 rx=0x7f165800f9b0 tx=0x7f1658002f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 -- 172.21.15.80:0/934916996 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1658001200 con 0x7f16540066b0 2019-11-28T11:58:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.415+0000 7f16677fe700 1 -- 172.21.15.80:0/934916996 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1658001890 con 0x7f16540066b0 2019-11-28T11:58:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.416+0000 7f166e516700 1 -- 172.21.15.80:0/934916996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16540066b0 msgr2=0x7f1654008b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.416+0000 7f166e516700 1 --2- 172.21.15.80:0/934916996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16540066b0 0x7f1654008b40 secure :-1 s=READY pgs=2802 cs=0 l=1 rx=0x7f165800f9b0 tx=0x7f1658002f70).stop 2019-11-28T11:58:08.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.416+0000 7f166d2b4700 1 -- 172.21.15.80:0/934916996 reap_dead start 2019-11-28T11:58:08.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.416+0000 7f166e516700 1 -- 172.21.15.80:0/934916996 shutdown_connections 2019-11-28T11:58:08.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.416+0000 7f166e516700 1 -- 172.21.15.80:0/934916996 shutdown_connections 2019-11-28T11:58:08.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.416+0000 7f166e516700 1 -- 172.21.15.80:0/934916996 wait complete. 2019-11-28T11:58:08.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.416+0000 7f166e516700 1 -- 172.21.15.80:0/934916996 >> 172.21.15.80:0/934916996 conn(0x7f1668061d20 msgr2=0x7f16680641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:08.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.419+0000 7f166e516700 1 Processor -- start 2019-11-28T11:58:08.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.419+0000 7f166e516700 1 -- start start 2019-11-28T11:58:08.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166e516700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f16681502e0 0x7f1668150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:08.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166e516700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1668150cb0 0x7f1668167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:08.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166e516700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1668133a20 con 0x7f1668108630 2019-11-28T11:58:08.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166e516700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1668131980 con 0x7f1668150cb0 2019-11-28T11:58:08.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166e516700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1668131c50 con 0x7f16681502e0 2019-11-28T11:58:08.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166d2b4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1668150cb0 0x7f1668167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166d2b4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1668150cb0 0x7f1668167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46576/0 (socket says 172.21.15.80:46576) 2019-11-28T11:58:08.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166d2b4700 1 -- 172.21.15.80:0/3671902271 learned_addr learned my addr 172.21.15.80:0/3671902271 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:08.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f1667fff700 1 --2- 172.21.15.80:0/3671902271 >> v2:172.21.15.174:3300/0 conn(0x7f16681502e0 0x7f1668150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166d2b4700 1 -- 172.21.15.80:0/3671902271 >> v2:172.21.15.174:3300/0 conn(0x7f16681502e0 msgr2=0x7f1668150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166d2b4700 1 --2- 172.21.15.80:0/3671902271 >> v2:172.21.15.174:3300/0 conn(0x7f16681502e0 0x7f1668150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:08.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166d2b4700 1 -- 172.21.15.80:0/3671902271 >> v1:172.21.15.174:6789/0 conn(0x7f1668108630 legacy=0x7f1668151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166d2b4700 1 -- 172.21.15.80:0/3671902271 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16681322e0 con 0x7f1668150cb0 2019-11-28T11:58:08.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166d2b4700 1 --2- 172.21.15.80:0/3671902271 >> v2:172.21.15.80:3300/0 conn(0x7f1668150cb0 0x7f1668167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1660010420 tx=0x7f16600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166d2b4700 1 --2- 172.21.15.80:0/3671902271 >> v2:172.21.15.80:3300/0 conn(0x7f1668150cb0 0x7f1668167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1660010420 tx=0x7f16600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166d2b4700 1 --2- 172.21.15.80:0/3671902271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1668150cb0 0x7f1668167d70 secure :-1 s=READY pgs=2803 cs=0 l=1 rx=0x7f1660010420 tx=0x7f16600102a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:08.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166d2b4700 1 --2- 172.21.15.80:0/3671902271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1668150cb0 0x7f1668167d70 secure :-1 s=THROTTLE_DONE pgs=2803 cs=0 l=1 rx=0x7f1660010420 tx=0x7f16600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166d2b4700 1 --2- 172.21.15.80:0/3671902271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1668150cb0 0x7f1668167d70 secure :-1 s=THROTTLE_DONE pgs=2803 cs=0 l=1 rx=0x7f1660010420 tx=0x7f16600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166d2b4700 1 --2- 172.21.15.80:0/3671902271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1668150cb0 0x7f1668167d70 secure :-1 s=THROTTLE_DONE pgs=2803 cs=0 l=1 rx=0x7f1660010420 tx=0x7f16600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f16657fa700 1 -- 172.21.15.80:0/3671902271 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1660000960 con 0x7f1668150cb0 2019-11-28T11:58:08.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f16657fa700 1 -- 172.21.15.80:0/3671902271 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1660000e70 con 0x7f1668150cb0 2019-11-28T11:58:08.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166e516700 1 -- 172.21.15.80:0/3671902271 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1668132660 con 0x7f1668150cb0 2019-11-28T11:58:08.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f16657fa700 1 -- 172.21.15.80:0/3671902271 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1660001580 con 0x7f1668150cb0 2019-11-28T11:58:08.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.420+0000 7f166e516700 1 -- 172.21.15.80:0/3671902271 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16681322e0 con 0x7f1668150cb0 2019-11-28T11:58:08.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.421+0000 7f166d2b4700 1 --2- 172.21.15.80:0/3671902271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1668150cb0 0x7f1668167d70 secure :-1 s=THROTTLE_DONE pgs=2803 cs=0 l=1 rx=0x7f1660010420 tx=0x7f16600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.421+0000 7f16657fa700 1 -- 172.21.15.80:0/3671902271 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1660001060 con 0x7f1668150cb0 2019-11-28T11:58:08.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.421+0000 7f166d2b4700 1 --2- 172.21.15.80:0/3671902271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1668150cb0 0x7f1668167d70 secure :-1 s=THROTTLE_DONE pgs=2803 cs=0 l=1 rx=0x7f1660010420 tx=0x7f16600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.454 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.421+0000 7f16657fa700 1 --2- 172.21.15.80:0/3671902271 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f164c018730 0x7f164c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:08.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.421+0000 7f16657fa700 1 -- 172.21.15.80:0/3671902271 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1660031ce0 con 0x7f1668150cb0 2019-11-28T11:58:08.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.421+0000 7f166cab3700 1 --2- 172.21.15.80:0/3671902271 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f164c018730 0x7f164c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.422+0000 7f166cab3700 1 --2- 172.21.15.80:0/3671902271 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f164c018730 0x7f164c01abc0 crc :-1 s=READY pgs=1163 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:08.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.428+0000 7f166e516700 1 -- 172.21.15.80:0/3671902271 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1668132660 con 0x7f1668150cb0 2019-11-28T11:58:08.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.432+0000 7f166d2b4700 1 --2- 172.21.15.80:0/3671902271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1668150cb0 0x7f1668167d70 secure :-1 s=THROTTLE_DONE pgs=2803 cs=0 l=1 rx=0x7f1660010420 tx=0x7f16600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.455 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.432+0000 7f16657fa700 1 -- 172.21.15.80:0/3671902271 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f16600075e0 con 0x7f1668150cb0 2019-11-28T11:58:08.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.600+0000 7f166e516700 1 -- 172.21.15.80:0/3671902271 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f16681322e0 con 0x7f1668150cb0 2019-11-28T11:58:08.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.600+0000 7f166d2b4700 1 --2- 172.21.15.80:0/3671902271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1668150cb0 0x7f1668167d70 secure :-1 s=THROTTLE_DONE pgs=2803 cs=0 l=1 rx=0x7f1660010420 tx=0x7f16600102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.600+0000 7f16657fa700 1 -- 172.21.15.80:0/3671902271 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v213) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1660017410 con 0x7f1668150cb0 2019-11-28T11:58:08.598 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:58:08.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.602+0000 7f166e516700 1 -- 172.21.15.80:0/3671902271 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f164c018730 msgr2=0x7f164c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.602+0000 7f166e516700 1 --2- 172.21.15.80:0/3671902271 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f164c018730 0x7f164c01abc0 crc :-1 s=READY pgs=1163 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:08.600 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.602+0000 7f166e516700 1 -- 172.21.15.80:0/3671902271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1668150cb0 msgr2=0x7f1668167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.602+0000 7f166e516700 1 --2- 172.21.15.80:0/3671902271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1668150cb0 0x7f1668167d70 secure :-1 s=READY pgs=2803 cs=0 l=1 rx=0x7f1660010420 tx=0x7f16600102a0).stop 2019-11-28T11:58:08.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.603+0000 7f166e516700 1 -- 172.21.15.80:0/3671902271 shutdown_connections 2019-11-28T11:58:08.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.603+0000 7f166e516700 1 --2- 172.21.15.80:0/3671902271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1668150cb0 0x7f1668167d70 unknown :-1 s=CLOSED pgs=2803 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:08.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.603+0000 7f166e516700 1 --2- 172.21.15.80:0/3671902271 >> v2:172.21.15.174:3300/0 conn(0x7f16681502e0 0x7f1668150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:08.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.603+0000 7f166e516700 1 --2- 172.21.15.80:0/3671902271 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f164c018730 0x7f164c01abc0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:08.601 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.603+0000 7f166e516700 1 -- 172.21.15.80:0/3671902271 shutdown_connections 2019-11-28T11:58:08.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.603+0000 7f166e516700 1 -- 172.21.15.80:0/3671902271 wait complete. 2019-11-28T11:58:08.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.603+0000 7f166e516700 1 -- 172.21.15.80:0/3671902271 >> 172.21.15.80:0/3671902271 conn(0x7f166814dbb0 msgr2=0x7f1668142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:08.610 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:58:08.610 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:58:08.695 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:58:08.699 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:58:08.704 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:58:08.708 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:58:08.712 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:58:08.717 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:58:08.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309d1bf700 1 Processor -- start 2019-11-28T11:58:08.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309d1bf700 1 -- start start 2019-11-28T11:58:08.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309d1bf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f309806c0a0 0x7f3098072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:08.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309d1bf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3098072620 0x7f3098164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:08.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309d1bf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309806db00 con 0x7f30980734e0 2019-11-28T11:58:08.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309d1bf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309806fd60 con 0x7f309806c0a0 2019-11-28T11:58:08.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309d1bf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3098070030 con 0x7f3098072620 2019-11-28T11:58:08.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f309806c0a0 0x7f3098072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f3096d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f30980734e0 0x7f3098071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45896/0 (socket says 172.21.15.80:45896) 2019-11-28T11:58:08.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f3096d9d700 1 -- 172.21.15.80:0/2319126198 learned_addr learned my addr 172.21.15.80:0/2319126198 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:08.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309c9be700 1 --2- 172.21.15.80:0/2319126198 >> v2:172.21.15.174:3300/0 conn(0x7f3098072620 0x7f3098164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309659c700 1 -- 172.21.15.80:0/2319126198 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488724430 0 0) 0x7f3080001170 con 0x7f30980734e0 2019-11-28T11:58:08.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309659c700 1 -- 172.21.15.80:0/2319126198 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3084002e80 con 0x7f30980734e0 2019-11-28T11:58:08.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309759e700 1 -- 172.21.15.80:0/2319126198 >> v2:172.21.15.174:3300/0 conn(0x7f3098072620 msgr2=0x7f3098164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:08.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309759e700 1 --2- 172.21.15.80:0/2319126198 >> v2:172.21.15.174:3300/0 conn(0x7f3098072620 0x7f3098164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:08.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309759e700 1 -- 172.21.15.80:0/2319126198 >> v1:172.21.15.80:6789/0 conn(0x7f30980734e0 legacy=0x7f3098071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309759e700 1 -- 172.21.15.80:0/2319126198 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30980706c0 con 0x7f309806c0a0 2019-11-28T11:58:08.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309759e700 1 --2- 172.21.15.80:0/2319126198 >> v2:172.21.15.80:3300/0 conn(0x7f309806c0a0 0x7f3098072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f308800b2d0 tx=0x7f308800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309759e700 1 --2- 172.21.15.80:0/2319126198 >> v2:172.21.15.80:3300/0 conn(0x7f309806c0a0 0x7f3098072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f308800b2d0 tx=0x7f308800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.733+0000 7f309759e700 1 --2- 172.21.15.80:0/2319126198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f309806c0a0 0x7f3098072fa0 secure :-1 s=READY pgs=2805 cs=0 l=1 rx=0x7f308800b2d0 tx=0x7f308800ba60).ready entity=mon.0 client_cookie=3f25f0caab324d0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:08.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.734+0000 7f309759e700 1 --2- 172.21.15.80:0/2319126198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f309806c0a0 0x7f3098072fa0 secure :-1 s=THROTTLE_DONE pgs=2805 cs=0 l=1 rx=0x7f308800b2d0 tx=0x7f308800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.734+0000 7f309659c700 1 -- 172.21.15.80:0/2319126198 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3088007590 con 0x7f309806c0a0 2019-11-28T11:58:08.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.734+0000 7f309759e700 1 --2- 172.21.15.80:0/2319126198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f309806c0a0 0x7f3098072fa0 secure :-1 s=THROTTLE_DONE pgs=2805 cs=0 l=1 rx=0x7f308800b2d0 tx=0x7f308800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.734+0000 7f309759e700 1 --2- 172.21.15.80:0/2319126198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f309806c0a0 0x7f3098072fa0 secure :-1 s=THROTTLE_DONE pgs=2805 cs=0 l=1 rx=0x7f308800b2d0 tx=0x7f308800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.734+0000 7f309659c700 1 -- 172.21.15.80:0/2319126198 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3088009d30 con 0x7f309806c0a0 2019-11-28T11:58:08.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.734+0000 7f309659c700 1 -- 172.21.15.80:0/2319126198 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f308800a400 con 0x7f309806c0a0 2019-11-28T11:58:08.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.734+0000 7f309d1bf700 1 -- 172.21.15.80:0/2319126198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f309806c0a0 msgr2=0x7f3098072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.734+0000 7f309d1bf700 1 --2- 172.21.15.80:0/2319126198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f309806c0a0 0x7f3098072fa0 secure :-1 s=READY pgs=2805 cs=0 l=1 rx=0x7f308800b2d0 tx=0x7f308800ba60).stop 2019-11-28T11:58:08.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.734+0000 7f309d1bf700 1 -- 172.21.15.80:0/2319126198 shutdown_connections 2019-11-28T11:58:08.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.734+0000 7f309d1bf700 1 --2- 172.21.15.80:0/2319126198 >> v2:172.21.15.174:3300/0 conn(0x7f3098072620 0x7f3098164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:08.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.734+0000 7f309d1bf700 1 --2- 172.21.15.80:0/2319126198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f309806c0a0 0x7f3098072fa0 unknown :-1 s=CLOSED pgs=2805 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:08.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.734+0000 7f309d1bf700 1 -- 172.21.15.80:0/2319126198 shutdown_connections 2019-11-28T11:58:08.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.734+0000 7f309d1bf700 1 -- 172.21.15.80:0/2319126198 wait complete. 2019-11-28T11:58:08.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.734+0000 7f309d1bf700 1 -- 172.21.15.80:0/2319126198 >> 172.21.15.80:0/2319126198 conn(0x7f3098061cf0 msgr2=0x7f3098064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:08.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.737+0000 7f309d1bf700 1 Processor -- start 2019-11-28T11:58:08.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.737+0000 7f309d1bf700 1 -- start start 2019-11-28T11:58:08.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.738+0000 7f309d1bf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3098104820 0x7f309810c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:08.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.738+0000 7f309d1bf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309813bcd0 con 0x7f309810b9d0 2019-11-28T11:58:08.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.738+0000 7f309d1bf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3098105ea0 con 0x7f309810c890 2019-11-28T11:58:08.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.738+0000 7f309d1bf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3098108700 con 0x7f3098104820 2019-11-28T11:58:08.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.738+0000 7f309c9be700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f309810b9d0 0x7f3098167a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45902/0 (socket says 172.21.15.80:45902) 2019-11-28T11:58:08.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.738+0000 7f309c9be700 1 -- 172.21.15.80:0/3209799144 learned_addr learned my addr 172.21.15.80:0/3209799144 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:08.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.738+0000 7f309759e700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3098104820 0x7f309810c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.738+0000 7f308ffff700 1 -- 172.21.15.80:0/3209799144 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246778212 0 0) 0x7f3090001110 con 0x7f309810b9d0 2019-11-28T11:58:08.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.738+0000 7f308ffff700 1 -- 172.21.15.80:0/3209799144 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f307c002e80 con 0x7f309810b9d0 2019-11-28T11:58:08.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.738+0000 7f308ffff700 1 -- 172.21.15.80:0/3209799144 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230063911 0 0) 0x7f3080001170 con 0x7f309810c890 2019-11-28T11:58:08.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.738+0000 7f308ffff700 1 -- 172.21.15.80:0/3209799144 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f307c0030b0 con 0x7f309810c890 2019-11-28T11:58:08.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.738+0000 7f309759e700 1 -- 172.21.15.80:0/3209799144 >> v1:172.21.15.174:6789/0 conn(0x7f309810c890 legacy=0x7f309810b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.738+0000 7f308ffff700 1 -- 172.21.15.80:0/3209799144 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2634752625 0 0) 0x7f3090001280 con 0x7f309810b9d0 2019-11-28T11:58:08.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.738+0000 7f309759e700 1 -- 172.21.15.80:0/3209799144 >> v1:172.21.15.80:6789/0 conn(0x7f309810b9d0 legacy=0x7f3098167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.738+0000 7f309759e700 1 -- 172.21.15.80:0/3209799144 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3098109a90 con 0x7f3098104820 2019-11-28T11:58:08.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.738+0000 7f309759e700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3098104820 0x7f309810c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f30880106f0 tx=0x7f3088010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.739+0000 7f309759e700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3098104820 0x7f309810c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f30880106f0 tx=0x7f3088010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.739+0000 7f309759e700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3098104820 0x7f309810c350 secure :-1 s=READY pgs=405 cs=0 l=1 rx=0x7f30880106f0 tx=0x7f3088010a90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:08.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.739+0000 7f309759e700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3098104820 0x7f309810c350 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f30880106f0 tx=0x7f3088010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.739+0000 7f308ffff700 1 -- 172.21.15.80:0/3209799144 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f308800abb0 con 0x7f3098104820 2019-11-28T11:58:08.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.739+0000 7f309d1bf700 1 -- 172.21.15.80:0/3209799144 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3098109e10 con 0x7f3098104820 2019-11-28T11:58:08.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.739+0000 7f309759e700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3098104820 0x7f309810c350 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f30880106f0 tx=0x7f3088010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.739+0000 7f308ffff700 1 -- 172.21.15.80:0/3209799144 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308800abb0 con 0x7f3098104820 2019-11-28T11:58:08.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.739+0000 7f309759e700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3098104820 0x7f309810c350 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f30880106f0 tx=0x7f3088010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.739+0000 7f308ffff700 1 -- 172.21.15.80:0/3209799144 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3088009d00 con 0x7f3098104820 2019-11-28T11:58:08.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.739+0000 7f309d1bf700 1 -- 172.21.15.80:0/3209799144 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3098109a90 con 0x7f3098104820 2019-11-28T11:58:08.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.739+0000 7f309759e700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3098104820 0x7f309810c350 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f30880106f0 tx=0x7f3088010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.740+0000 7f308ffff700 1 -- 172.21.15.80:0/3209799144 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3088009b10 con 0x7f3098104820 2019-11-28T11:58:08.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.740+0000 7f309759e700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3098104820 0x7f309810c350 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f30880106f0 tx=0x7f3088010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.740+0000 7f308ffff700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f307c018750 0x7f307c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:08.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.740+0000 7f308ffff700 1 -- 172.21.15.80:0/3209799144 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3088031e50 con 0x7f3098104820 2019-11-28T11:58:08.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.740+0000 7f3096d9d700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f307c018750 0x7f307c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:08.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.740+0000 7f3096d9d700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f307c018750 0x7f307c01abe0 crc :-1 s=READY pgs=1164 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:08.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.749+0000 7f309d1bf700 1 -- 172.21.15.80:0/3209799144 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3098109e10 con 0x7f3098104820 2019-11-28T11:58:08.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.752+0000 7f309759e700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3098104820 0x7f309810c350 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f30880106f0 tx=0x7f3088010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.752+0000 7f308ffff700 1 -- 172.21.15.80:0/3209799144 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f30880175d0 con 0x7f3098104820 2019-11-28T11:58:08.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.930+0000 7f309d1bf700 1 -- 172.21.15.80:0/3209799144 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3098109a90 con 0x7f3098104820 2019-11-28T11:58:08.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.930+0000 7f309759e700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3098104820 0x7f309810c350 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f30880106f0 tx=0x7f3088010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:08.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.930+0000 7f308ffff700 1 -- 172.21.15.80:0/3209799144 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 176 v176) v1 ==== 95+0+2457 (secure 0 0 0) 0x7f308800a310 con 0x7f3098104820 2019-11-28T11:58:08.928 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 176 2019-11-28T11:58:08.929 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:08.929 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":176,"default_fscid":17,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":11371,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/4086131539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":4086131539},{"type":"v1","addr":"172.21.15.80:6835","nonce":4086131539}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":174},{"gid":12102,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2858222423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2858222423},{"type":"v1","addr":"172.21.15.80:6834","nonce":2858222423}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":174}],"filesystems":[{"mdsmap":{"epoch":176,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:57:55.569453+0000","modified":"2019-11-28T11:58:03.818681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7964":{"gid":7964,"name":"c","rank":0,"incarnation":175,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6835/4116799507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":4116799507},{"type":"v1","addr":"172.21.15.174:6835","nonce":4116799507}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[35],"metadata_pool":34,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":17}]} 2019-11-28T11:58:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.933+0000 7f309d1bf700 1 -- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f307c018750 msgr2=0x7f307c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.933+0000 7f309d1bf700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f307c018750 0x7f307c01abe0 crc :-1 s=READY pgs=1164 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.933+0000 7f309d1bf700 1 -- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3098104820 msgr2=0x7f309810c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.933+0000 7f309d1bf700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3098104820 0x7f309810c350 secure :-1 s=READY pgs=405 cs=0 l=1 rx=0x7f30880106f0 tx=0x7f3088010a90).stop 2019-11-28T11:58:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.933+0000 7f309d1bf700 1 -- 172.21.15.80:0/3209799144 shutdown_connections 2019-11-28T11:58:08.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.933+0000 7f309d1bf700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f307c018750 0x7f307c01abe0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:08.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.933+0000 7f309d1bf700 1 --2- 172.21.15.80:0/3209799144 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3098104820 0x7f309810c350 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:08.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.933+0000 7f309d1bf700 1 -- 172.21.15.80:0/3209799144 shutdown_connections 2019-11-28T11:58:08.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.933+0000 7f309d1bf700 1 -- 172.21.15.80:0/3209799144 wait complete. 2019-11-28T11:58:08.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:08.933+0000 7f309d1bf700 1 -- 172.21.15.80:0/3209799144 >> 172.21.15.80:0/3209799144 conn(0x7f309813d620 msgr2=0x7f309813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:09.256 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7964}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 34, u'failed': [], u'epoch': 176, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [35], u'info': {u'gid_7964': {u'export_targets': [], u'name': u'c', u'incarnation': 175, u'state_seq': 3, u'state': u'up:active', u'gid': 7964, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 4116799507, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 4116799507, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/4116799507'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:57:55.569453+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:58:03.818681+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:58:09.257 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:58:09.257 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T11:58:09.390 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:58:09.390 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:58:09.391 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T11:58:09.391 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 7964, 2019-11-28T11:58:09.391 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T11:58:09.391 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T11:58:09.392 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 6.5754471289999996, 2019-11-28T11:58:09.392 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 176, 2019-11-28T11:58:09.392 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 213, 2019-11-28T11:58:09.392 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 213, 2019-11-28T11:58:09.392 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 11.391380948 2019-11-28T11:58:09.393 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:58:09.396 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 7964, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.5754471289999996, "mdsmap_epoch": 176, "osdmap_epoch": 213, "osdmap_epoch_barrier": 213, "uptime": 11.391380948 } 2019-11-28T11:58:09.396 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:58:09.396 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:58:09.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:58:09.397 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:58:09.466 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:58:09.467 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:58:09.603 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:58:09.604 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:58:09.604 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:58:09.604 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:58:09.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:58:09.605 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:58:09.681 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:58:09.804 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:58:09.805 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:58:09.805 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:58:09.811 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:58:09.811 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:58:09.936 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:58:09.937 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:58:09.937 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:58:09.944 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:58:09.944 INFO:tasks.cephfs_test_runner:test_stale_renew (tasks.cephfs.test_client_recovery.TestClientRecovery) ... skipped 'Require FUSE client to handle signal STOP/CONT' 2019-11-28T11:58:09.944 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_renew' 2019-11-28T11:58:10.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.068+0000 7fda08bd8700 1 Processor -- start 2019-11-28T11:58:10.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.068+0000 7fda08bd8700 1 -- start start 2019-11-28T11:58:10.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.069+0000 7fda08bd8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda0406c0a0 0x7fda04072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:10.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.069+0000 7fda08bd8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fda04072620 0x7fda04164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:10.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.069+0000 7fda08bd8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0406db00 con 0x7fda040734e0 2019-11-28T11:58:10.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.069+0000 7fda08bd8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0406f330 con 0x7fda04072620 2019-11-28T11:58:10.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.069+0000 7fda08bd8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda040706c0 con 0x7fda0406c0a0 2019-11-28T11:58:10.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.069+0000 7fda0259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fda040734e0 0x7fda04071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45912/0 (socket says 172.21.15.80:45912) 2019-11-28T11:58:10.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.069+0000 7fda0259c700 1 -- 172.21.15.80:0/1689867645 learned_addr learned my addr 172.21.15.80:0/1689867645 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:10.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda0359e700 1 --2- 172.21.15.80:0/1689867645 >> v2:172.21.15.174:3300/0 conn(0x7fda04072620 0x7fda04164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:10.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda02d9d700 1 --2- 172.21.15.80:0/1689867645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda0406c0a0 0x7fda04072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:10.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda01d9b700 1 -- 172.21.15.80:0/1689867645 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583506330 0 0) 0x7fd9ec0013f0 con 0x7fda040734e0 2019-11-28T11:58:10.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda01d9b700 1 -- 172.21.15.80:0/1689867645 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9e4002e80 con 0x7fda040734e0 2019-11-28T11:58:10.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda0359e700 1 -- 172.21.15.80:0/1689867645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda0406c0a0 msgr2=0x7fda04072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:10.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda0359e700 1 --2- 172.21.15.80:0/1689867645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda0406c0a0 0x7fda04072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:10.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda0359e700 1 -- 172.21.15.80:0/1689867645 >> v1:172.21.15.80:6789/0 conn(0x7fda040734e0 legacy=0x7fda04071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:10.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda0359e700 1 -- 172.21.15.80:0/1689867645 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda04070a40 con 0x7fda04072620 2019-11-28T11:58:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda02d9d700 1 --2- 172.21.15.80:0/1689867645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda0406c0a0 0x7fda04072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda0359e700 1 --2- 172.21.15.80:0/1689867645 >> v2:172.21.15.174:3300/0 conn(0x7fda04072620 0x7fda04164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd9fc00af80 tx=0x7fd9fc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda0359e700 1 --2- 172.21.15.80:0/1689867645 >> v2:172.21.15.174:3300/0 conn(0x7fda04072620 0x7fda04164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd9fc00af80 tx=0x7fd9fc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda0359e700 1 --2- 172.21.15.80:0/1689867645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda04072620 0x7fda04164d70 secure :-1 s=READY pgs=1704 cs=0 l=1 rx=0x7fd9fc00af80 tx=0x7fd9fc00b790).ready entity=mon.1 client_cookie=2538d0d7d54b4e45 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda0359e700 1 --2- 172.21.15.80:0/1689867645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda04072620 0x7fda04164d70 secure :-1 s=THROTTLE_DONE pgs=1704 cs=0 l=1 rx=0x7fd9fc00af80 tx=0x7fd9fc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:10.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda01d9b700 1 -- 172.21.15.80:0/1689867645 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9fc000bc0 con 0x7fda04072620 2019-11-28T11:58:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda0359e700 1 --2- 172.21.15.80:0/1689867645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda04072620 0x7fda04164d70 secure :-1 s=THROTTLE_DONE pgs=1704 cs=0 l=1 rx=0x7fd9fc00af80 tx=0x7fd9fc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda0359e700 1 --2- 172.21.15.80:0/1689867645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda04072620 0x7fda04164d70 secure :-1 s=THROTTLE_DONE pgs=1704 cs=0 l=1 rx=0x7fd9fc00af80 tx=0x7fd9fc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda01d9b700 1 -- 172.21.15.80:0/1689867645 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc0097f0 con 0x7fda04072620 2019-11-28T11:58:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda01d9b700 1 -- 172.21.15.80:0/1689867645 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9fc000bc0 con 0x7fda04072620 2019-11-28T11:58:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda08bd8700 1 -- 172.21.15.80:0/1689867645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda04072620 msgr2=0x7fda04164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:10.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.070+0000 7fda08bd8700 1 --2- 172.21.15.80:0/1689867645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda04072620 0x7fda04164d70 secure :-1 s=READY pgs=1704 cs=0 l=1 rx=0x7fd9fc00af80 tx=0x7fd9fc00b790).stop 2019-11-28T11:58:10.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.071+0000 7fda08bd8700 1 -- 172.21.15.80:0/1689867645 shutdown_connections 2019-11-28T11:58:10.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.071+0000 7fda08bd8700 1 --2- 172.21.15.80:0/1689867645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda04072620 0x7fda04164d70 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:10.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.071+0000 7fda08bd8700 1 --2- 172.21.15.80:0/1689867645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda0406c0a0 0x7fda04072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:10.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.071+0000 7fda08bd8700 1 -- 172.21.15.80:0/1689867645 shutdown_connections 2019-11-28T11:58:10.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.071+0000 7fda08bd8700 1 -- 172.21.15.80:0/1689867645 wait complete. 2019-11-28T11:58:10.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.071+0000 7fda08bd8700 1 -- 172.21.15.80:0/1689867645 >> 172.21.15.80:0/1689867645 conn(0x7fda04061cf0 msgr2=0x7fda04064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:10.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.074+0000 7fda08bd8700 1 Processor -- start 2019-11-28T11:58:10.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.074+0000 7fda08bd8700 1 -- start start 2019-11-28T11:58:10.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.074+0000 7fda08bd8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda04104c10 0x7fda041050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:10.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.074+0000 7fda08bd8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda04105a30 con 0x7fda04104820 2019-11-28T11:58:10.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fda08bd8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0413bcd0 con 0x7fda041055e0 2019-11-28T11:58:10.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fda08bd8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda04109130 con 0x7fda04104c10 2019-11-28T11:58:10.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fda02d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fda04104820 0x7fda0410c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45914/0 (socket says 172.21.15.80:45914) 2019-11-28T11:58:10.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fda02d9d700 1 -- 172.21.15.80:0/1790045942 learned_addr learned my addr 172.21.15.80:0/1790045942 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:10.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875504332 0 0) 0x7fd9f400dd90 con 0x7fda04104820 2019-11-28T11:58:10.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fda0259c700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda04104c10 0x7fda041050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:10.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9dc002e80 con 0x7fda04104820 2019-11-28T11:58:10.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2322006547 0 0) 0x7fd9f40010a0 con 0x7fda04104820 2019-11-28T11:58:10.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd9dc0032e0 con 0x7fda04104820 2019-11-28T11:58:10.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd9f4001670 con 0x7fda04104820 2019-11-28T11:58:10.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda04104c10 msgr2=0x7fda041050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:10.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fd9fb7fe700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda04104c10 0x7fda041050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:10.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 >> v1:172.21.15.174:6789/0 conn(0x7fda041055e0 legacy=0x7fda04167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:10.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 >> v1:172.21.15.80:6789/0 conn(0x7fda04104820 legacy=0x7fda0410c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:10.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fd9fb7fe700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9dc003310 0x7fd9dc003720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:10.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fd9fb7fe700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9dc003c60 0x7fd9dc004100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:10.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fd9fb7fe700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9dc004900 0x7fd9dc004dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:10.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc00bbf0 con 0x7fd9dc004900 2019-11-28T11:58:10.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc00bde0 con 0x7fd9dc003c60 2019-11-28T11:58:10.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc00c010 con 0x7fd9dc003310 2019-11-28T11:58:10.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fda0359e700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9dc004900 0x7fd9dc004dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:10.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fda02d9d700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9dc003310 0x7fd9dc003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:10.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fda0259c700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9dc003c60 0x7fd9dc004100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:10.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fda0359e700 1 -- 172.21.15.80:0/1790045942 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9dc003310 msgr2=0x7fd9dc003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:10.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fda0359e700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd9dc003310 0x7fd9dc003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:10.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fda0359e700 1 -- 172.21.15.80:0/1790045942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9dc003c60 msgr2=0x7fd9dc004100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:10.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fda0359e700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9dc003c60 0x7fd9dc004100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:10.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fda0359e700 1 -- 172.21.15.80:0/1790045942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc00c2c0 con 0x7fd9dc004900 2019-11-28T11:58:10.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.075+0000 7fda08bd8700 1 -- 172.21.15.80:0/1790045942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda04109e10 con 0x7fd9dc004900 2019-11-28T11:58:10.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.076+0000 7fda0359e700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9dc004900 0x7fd9dc004dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd9fc0543f0 tx=0x7fd9fc054270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:10.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.076+0000 7fda08bd8700 1 -- 172.21.15.80:0/1790045942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda04109a90 con 0x7fd9dc004900 2019-11-28T11:58:10.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.076+0000 7fda0359e700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9dc004900 0x7fd9dc004dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd9fc0543f0 tx=0x7fd9fc054270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:10.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.076+0000 7fda0359e700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9dc004900 0x7fd9dc004dc0 secure :-1 s=READY pgs=2809 cs=0 l=1 rx=0x7fd9fc0543f0 tx=0x7fd9fc054270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:10.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.076+0000 7fda0359e700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9dc004900 0x7fd9dc004dc0 secure :-1 s=THROTTLE_DONE pgs=2809 cs=0 l=1 rx=0x7fd9fc0543f0 tx=0x7fd9fc054270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:10.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.076+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9fc00ac80 con 0x7fd9dc004900 2019-11-28T11:58:10.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.076+0000 7fda0359e700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9dc004900 0x7fd9dc004dc0 secure :-1 s=THROTTLE_DONE pgs=2809 cs=0 l=1 rx=0x7fd9fc0543f0 tx=0x7fd9fc054270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:10.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.076+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc00aec0 con 0x7fd9dc004900 2019-11-28T11:58:10.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.076+0000 7fda0359e700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9dc004900 0x7fd9dc004dc0 secure :-1 s=THROTTLE_DONE pgs=2809 cs=0 l=1 rx=0x7fd9fc0543f0 tx=0x7fd9fc054270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:10.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.076+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9fc00ac80 con 0x7fd9dc004900 2019-11-28T11:58:10.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.076+0000 7fda0359e700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9dc004900 0x7fd9dc004dc0 secure :-1 s=THROTTLE_DONE pgs=2809 cs=0 l=1 rx=0x7fd9fc0543f0 tx=0x7fd9fc054270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:10.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.076+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd9fc0097c0 con 0x7fd9dc004900 2019-11-28T11:58:10.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.076+0000 7fda0359e700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9dc004900 0x7fd9dc004dc0 secure :-1 s=THROTTLE_DONE pgs=2809 cs=0 l=1 rx=0x7fd9fc0543f0 tx=0x7fd9fc054270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:10.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.076+0000 7fd9fb7fe700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd9dc020be0 0x7fd9dc023010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:10.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.076+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd9fc075bf0 con 0x7fd9dc004900 2019-11-28T11:58:10.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.077+0000 7fda02d9d700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd9dc020be0 0x7fd9dc023010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:10.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.077+0000 7fda02d9d700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd9dc020be0 0x7fd9dc023010 crc :-1 s=READY pgs=1165 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:10.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.084+0000 7fda08bd8700 1 -- 172.21.15.80:0/1790045942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e0002e60 con 0x7fd9dc004900 2019-11-28T11:58:10.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.088+0000 7fda0359e700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9dc004900 0x7fd9dc004dc0 secure :-1 s=THROTTLE_DONE pgs=2809 cs=0 l=1 rx=0x7fd9fc0543f0 tx=0x7fd9fc054270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:10.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.088+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd9fc00aea0 con 0x7fd9dc004900 2019-11-28T11:58:10.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.259+0000 7fda08bd8700 1 -- 172.21.15.80:0/1790045942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_renew"]} v 0) v1 -- 0x7fd9e0001d60 con 0x7fd9dc004900 2019-11-28T11:58:10.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.845+0000 7fda0359e700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9dc004900 0x7fd9dc004dc0 secure :-1 s=THROTTLE_DONE pgs=2809 cs=0 l=1 rx=0x7fd9fc0543f0 tx=0x7fd9fc054270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:10.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.845+0000 7fd9fb7fe700 1 -- 172.21.15.80:0/1790045942 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_renew"]}]=0 v784) v1 ==== 148+0+0 (secure 0 0 0) 0x7fd9fc00aea0 con 0x7fd9dc004900 2019-11-28T11:58:10.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.877+0000 7fda08bd8700 1 -- 172.21.15.80:0/1790045942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd9dc020be0 msgr2=0x7fd9dc023010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:10.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.877+0000 7fda08bd8700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd9dc020be0 0x7fd9dc023010 crc :-1 s=READY pgs=1165 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:10.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.877+0000 7fda08bd8700 1 -- 172.21.15.80:0/1790045942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9dc004900 msgr2=0x7fd9dc004dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:10.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.877+0000 7fda08bd8700 1 --2- 172.21.15.80:0/1790045942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9dc004900 0x7fd9dc004dc0 secure :-1 s=READY pgs=2809 cs=0 l=1 rx=0x7fd9fc0543f0 tx=0x7fd9fc054270).stop 2019-11-28T11:58:10.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.877+0000 7fda0359e700 1 -- 172.21.15.80:0/1790045942 reap_dead start 2019-11-28T11:58:10.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.877+0000 7fda0359e700 1 -- 172.21.15.80:0/1790045942 reap_dead start 2019-11-28T11:58:10.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.877+0000 7fda08bd8700 1 -- 172.21.15.80:0/1790045942 shutdown_connections 2019-11-28T11:58:10.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.877+0000 7fda08bd8700 1 -- 172.21.15.80:0/1790045942 shutdown_connections 2019-11-28T11:58:10.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.877+0000 7fda08bd8700 1 -- 172.21.15.80:0/1790045942 wait complete. 2019-11-28T11:58:10.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:10.877+0000 7fda08bd8700 1 -- 172.21.15.80:0/1790045942 >> 172.21.15.80:0/1790045942 conn(0x7fda0413d620 msgr2=0x7fda0413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:10.883 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:58:10.883 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:58:10.950 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:58:11.010 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:58:11.070 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:58:11.127 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:58:11.187 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:58:11.250 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:58:11.251 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T11:58:11.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:58:11.251 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T11:58:11.323 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:58:11.327 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:58:11.366 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T11:58:11.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T11:58:11.367 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T11:58:11.489 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:58:11.497 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:58:11.538 INFO:tasks.cephfs_test_runner:Starting test: test_stale_write_caps (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T11:58:11.538 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_write_caps' 2019-11-28T11:58:11.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.662+0000 7f6732193700 1 Processor -- start 2019-11-28T11:58:11.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.662+0000 7f6732193700 1 -- start start 2019-11-28T11:58:11.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.663+0000 7f6732193700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f672c06c0a0 0x7f672c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:11.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.663+0000 7f6732193700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f672c072620 0x7f672c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:11.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.663+0000 7f6732193700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c06db00 con 0x7f672c0734e0 2019-11-28T11:58:11.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.663+0000 7f6732193700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c06f330 con 0x7f672c072620 2019-11-28T11:58:11.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.663+0000 7f6732193700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0706c0 con 0x7f672c06c0a0 2019-11-28T11:58:11.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.663+0000 7f6730f31700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f672c072620 0x7f672c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:11.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.663+0000 7f6723fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f672c0734e0 0x7f672c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45928/0 (socket says 172.21.15.80:45928) 2019-11-28T11:58:11.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.663+0000 7f6723fff700 1 -- 172.21.15.80:0/3437749616 learned_addr learned my addr 172.21.15.80:0/3437749616 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:11.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.663+0000 7f672bfff700 1 --2- 172.21.15.80:0/3437749616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f672c06c0a0 0x7f672c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:11.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.663+0000 7f6730f31700 1 -- 172.21.15.80:0/3437749616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f672c06c0a0 msgr2=0x7f672c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:11.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.663+0000 7f6730f31700 1 --2- 172.21.15.80:0/3437749616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f672c06c0a0 0x7f672c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:11.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.663+0000 7f6730f31700 1 -- 172.21.15.80:0/3437749616 >> v1:172.21.15.80:6789/0 conn(0x7f672c0734e0 legacy=0x7f672c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:11.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.663+0000 7f672b7fe700 1 -- 172.21.15.80:0/3437749616 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160216799 0 0) 0x7f6714001170 con 0x7f672c0734e0 2019-11-28T11:58:11.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.663+0000 7f6730f31700 1 -- 172.21.15.80:0/3437749616 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c070a40 con 0x7f672c072620 2019-11-28T11:58:11.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.663+0000 7f6730f31700 1 --2- 172.21.15.80:0/3437749616 >> v2:172.21.15.80:3300/0 conn(0x7f672c072620 0x7f672c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f672400b2d0 tx=0x7f672400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:11.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.664+0000 7f6730f31700 1 --2- 172.21.15.80:0/3437749616 >> v2:172.21.15.80:3300/0 conn(0x7f672c072620 0x7f672c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f672400b2d0 tx=0x7f672400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.664+0000 7f6730f31700 1 --2- 172.21.15.80:0/3437749616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c072620 0x7f672c164d70 secure :-1 s=READY pgs=2811 cs=0 l=1 rx=0x7f672400b2d0 tx=0x7f672400b5d0).ready entity=mon.0 client_cookie=21083809c10db46d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.664+0000 7f6730f31700 1 --2- 172.21.15.80:0/3437749616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c072620 0x7f672c164d70 secure :-1 s=THROTTLE_DONE pgs=2811 cs=0 l=1 rx=0x7f672400b2d0 tx=0x7f672400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.664+0000 7f672b7fe700 1 -- 172.21.15.80:0/3437749616 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6724009f20 con 0x7f672c072620 2019-11-28T11:58:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.664+0000 7f6730f31700 1 --2- 172.21.15.80:0/3437749616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c072620 0x7f672c164d70 secure :-1 s=THROTTLE_DONE pgs=2811 cs=0 l=1 rx=0x7f672400b2d0 tx=0x7f672400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.664+0000 7f6730f31700 1 --2- 172.21.15.80:0/3437749616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c072620 0x7f672c164d70 secure :-1 s=THROTTLE_DONE pgs=2811 cs=0 l=1 rx=0x7f672400b2d0 tx=0x7f672400b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.664+0000 7f672b7fe700 1 -- 172.21.15.80:0/3437749616 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6724009b40 con 0x7f672c072620 2019-11-28T11:58:11.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.664+0000 7f672b7fe700 1 -- 172.21.15.80:0/3437749616 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f672400a500 con 0x7f672c072620 2019-11-28T11:58:11.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.664+0000 7f6732193700 1 -- 172.21.15.80:0/3437749616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c072620 msgr2=0x7f672c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:11.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.664+0000 7f6732193700 1 --2- 172.21.15.80:0/3437749616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c072620 0x7f672c164d70 secure :-1 s=READY pgs=2811 cs=0 l=1 rx=0x7f672400b2d0 tx=0x7f672400b5d0).stop 2019-11-28T11:58:11.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.664+0000 7f6732193700 1 -- 172.21.15.80:0/3437749616 shutdown_connections 2019-11-28T11:58:11.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.664+0000 7f6732193700 1 --2- 172.21.15.80:0/3437749616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c072620 0x7f672c164d70 unknown :-1 s=CLOSED pgs=2811 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:11.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.664+0000 7f6732193700 1 --2- 172.21.15.80:0/3437749616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f672c06c0a0 0x7f672c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:11.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.664+0000 7f6732193700 1 -- 172.21.15.80:0/3437749616 shutdown_connections 2019-11-28T11:58:11.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.664+0000 7f6732193700 1 -- 172.21.15.80:0/3437749616 wait complete. 2019-11-28T11:58:11.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.664+0000 7f6732193700 1 -- 172.21.15.80:0/3437749616 >> 172.21.15.80:0/3437749616 conn(0x7f672c061cf0 msgr2=0x7f672c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:11.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.667+0000 7f6732193700 1 Processor -- start 2019-11-28T11:58:11.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.667+0000 7f6732193700 1 -- start start 2019-11-28T11:58:11.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f6732193700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f672c104820 0x7f672c10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:11.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f6732193700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f672c10b9d0 0x7f672c167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:11.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f6732193700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c13bcd0 con 0x7f672c10c890 2019-11-28T11:58:11.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f6732193700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c109130 con 0x7f672c104820 2019-11-28T11:58:11.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f6732193700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c109400 con 0x7f672c10b9d0 2019-11-28T11:58:11.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f672bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f672c104820 0x7f672c10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:11.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f672bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f672c104820 0x7f672c10c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46618/0 (socket says 172.21.15.80:46618) 2019-11-28T11:58:11.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f6723fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f672c10c890 0x7f672c10b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45936/0 (socket says 172.21.15.80:45936) 2019-11-28T11:58:11.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f672bfff700 1 -- 172.21.15.80:0/4105716468 learned_addr learned my addr 172.21.15.80:0/4105716468 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:11.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f6730f31700 1 --2- 172.21.15.80:0/4105716468 >> v2:172.21.15.174:3300/0 conn(0x7f672c10b9d0 0x7f672c167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:11.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f672bfff700 1 -- 172.21.15.80:0/4105716468 >> v2:172.21.15.174:3300/0 conn(0x7f672c10b9d0 msgr2=0x7f672c167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:11.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f672bfff700 1 --2- 172.21.15.80:0/4105716468 >> v2:172.21.15.174:3300/0 conn(0x7f672c10b9d0 0x7f672c167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:11.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f672bfff700 1 -- 172.21.15.80:0/4105716468 >> v1:172.21.15.80:6789/0 conn(0x7f672c10c890 legacy=0x7f672c10b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:11.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f672bfff700 1 -- 172.21.15.80:0/4105716468 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c109a90 con 0x7f672c104820 2019-11-28T11:58:11.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f67297fa700 1 -- 172.21.15.80:0/4105716468 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816091274 0 0) 0x7f6714000d70 con 0x7f672c10c890 2019-11-28T11:58:11.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f6730f31700 1 --2- 172.21.15.80:0/4105716468 >> v2:172.21.15.174:3300/0 conn(0x7f672c10b9d0 0x7f672c167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:58:11.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f672bfff700 1 --2- 172.21.15.80:0/4105716468 >> v2:172.21.15.80:3300/0 conn(0x7f672c104820 0x7f672c10c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f671c010400 tx=0x7f671c0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:11.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f672bfff700 1 --2- 172.21.15.80:0/4105716468 >> v2:172.21.15.80:3300/0 conn(0x7f672c104820 0x7f672c10c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f671c010400 tx=0x7f671c0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:11.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f672bfff700 1 --2- 172.21.15.80:0/4105716468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c104820 0x7f672c10c350 secure :-1 s=READY pgs=2813 cs=0 l=1 rx=0x7f671c010400 tx=0x7f671c0107a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:11.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f672bfff700 1 --2- 172.21.15.80:0/4105716468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c104820 0x7f672c10c350 secure :-1 s=THROTTLE_DONE pgs=2813 cs=0 l=1 rx=0x7f671c010400 tx=0x7f671c0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:11.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f67297fa700 1 -- 172.21.15.80:0/4105716468 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671c000940 con 0x7f672c104820 2019-11-28T11:58:11.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f672bfff700 1 --2- 172.21.15.80:0/4105716468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c104820 0x7f672c10c350 secure :-1 s=THROTTLE_DONE pgs=2813 cs=0 l=1 rx=0x7f671c010400 tx=0x7f671c0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:11.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f672bfff700 1 --2- 172.21.15.80:0/4105716468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c104820 0x7f672c10c350 secure :-1 s=THROTTLE_DONE pgs=2813 cs=0 l=1 rx=0x7f671c010400 tx=0x7f671c0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:11.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f67297fa700 1 -- 172.21.15.80:0/4105716468 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c000ea0 con 0x7f672c104820 2019-11-28T11:58:11.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f67297fa700 1 -- 172.21.15.80:0/4105716468 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671c001470 con 0x7f672c104820 2019-11-28T11:58:11.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f6732193700 1 -- 172.21.15.80:0/4105716468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672c109e10 con 0x7f672c104820 2019-11-28T11:58:11.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.668+0000 7f6732193700 1 -- 172.21.15.80:0/4105716468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672c109a90 con 0x7f672c104820 2019-11-28T11:58:11.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.669+0000 7f672bfff700 1 --2- 172.21.15.80:0/4105716468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c104820 0x7f672c10c350 secure :-1 s=THROTTLE_DONE pgs=2813 cs=0 l=1 rx=0x7f671c010400 tx=0x7f671c0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:11.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.669+0000 7f67297fa700 1 -- 172.21.15.80:0/4105716468 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f671c001090 con 0x7f672c104820 2019-11-28T11:58:11.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.669+0000 7f672bfff700 1 --2- 172.21.15.80:0/4105716468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c104820 0x7f672c10c350 secure :-1 s=THROTTLE_DONE pgs=2813 cs=0 l=1 rx=0x7f671c010400 tx=0x7f671c0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:11.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.669+0000 7f67297fa700 1 --2- 172.21.15.80:0/4105716468 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6710018730 0x7f671001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:11.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.669+0000 7f67297fa700 1 -- 172.21.15.80:0/4105716468 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f671c031ad0 con 0x7f672c104820 2019-11-28T11:58:11.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.669+0000 7f6723fff700 1 --2- 172.21.15.80:0/4105716468 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6710018730 0x7f671001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:11.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.670+0000 7f6723fff700 1 --2- 172.21.15.80:0/4105716468 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6710018730 0x7f671001abc0 crc :-1 s=READY pgs=1166 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:11.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.677+0000 7f6732193700 1 -- 172.21.15.80:0/4105716468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672c109e10 con 0x7f672c104820 2019-11-28T11:58:11.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.680+0000 7f672bfff700 1 --2- 172.21.15.80:0/4105716468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c104820 0x7f672c10c350 secure :-1 s=THROTTLE_DONE pgs=2813 cs=0 l=1 rx=0x7f671c010400 tx=0x7f671c0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:11.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.680+0000 7f67297fa700 1 -- 172.21.15.80:0/4105716468 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f671c000c90 con 0x7f672c104820 2019-11-28T11:58:11.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:11.854+0000 7f6732193700 1 -- 172.21.15.80:0/4105716468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_write_caps"]} v 0) v1 -- 0x7f672c109a90 con 0x7f672c104820 2019-11-28T11:58:12.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:12.852+0000 7f672bfff700 1 --2- 172.21.15.80:0/4105716468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c104820 0x7f672c10c350 secure :-1 s=THROTTLE_DONE pgs=2813 cs=0 l=1 rx=0x7f671c010400 tx=0x7f671c0107a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:12.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:12.852+0000 7f67297fa700 1 -- 172.21.15.80:0/4105716468 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_write_caps"]}]=0 v786) v1 ==== 156+0+0 (secure 0 0 0) 0x7f671c0013f0 con 0x7f672c104820 2019-11-28T11:58:12.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:12.872+0000 7f6732193700 1 -- 172.21.15.80:0/4105716468 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6710018730 msgr2=0x7f671001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:12.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:12.872+0000 7f6732193700 1 --2- 172.21.15.80:0/4105716468 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6710018730 0x7f671001abc0 crc :-1 s=READY pgs=1166 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:12.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:12.872+0000 7f6732193700 1 -- 172.21.15.80:0/4105716468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c104820 msgr2=0x7f672c10c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:12.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:12.872+0000 7f6732193700 1 --2- 172.21.15.80:0/4105716468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c104820 0x7f672c10c350 secure :-1 s=READY pgs=2813 cs=0 l=1 rx=0x7f671c010400 tx=0x7f671c0107a0).stop 2019-11-28T11:58:12.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:12.872+0000 7f6732193700 1 -- 172.21.15.80:0/4105716468 shutdown_connections 2019-11-28T11:58:12.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:12.872+0000 7f6732193700 1 --2- 172.21.15.80:0/4105716468 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6710018730 0x7f671001abc0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:12.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:12.872+0000 7f6732193700 1 --2- 172.21.15.80:0/4105716468 >> v2:172.21.15.174:3300/0 conn(0x7f672c10b9d0 0x7f672c167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:12.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:12.872+0000 7f6732193700 1 --2- 172.21.15.80:0/4105716468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f672c104820 0x7f672c10c350 unknown :-1 s=CLOSED pgs=2813 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:12.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:12.872+0000 7f6732193700 1 -- 172.21.15.80:0/4105716468 shutdown_connections 2019-11-28T11:58:12.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:12.872+0000 7f6732193700 1 -- 172.21.15.80:0/4105716468 wait complete. 2019-11-28T11:58:12.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:12.872+0000 7f6732193700 1 -- 172.21.15.80:0/4105716468 >> 172.21.15.80:0/4105716468 conn(0x7f672c13d620 msgr2=0x7f672c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:12.879 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T11:58:12.879 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:58:12.945 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:58:13.009 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:58:13.068 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:58:13.123 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:58:13.186 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T11:58:13.255 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T11:58:13.256 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T11:58:13.256 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:58:13.256 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T11:58:13.256 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:58:13.257 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T11:58:13.257 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T11:58:13.262 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T11:58:13.262 DEBUG:teuthology.parallel:result is None 2019-11-28T11:58:13.264 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T11:58:13.265 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T11:58:13.265 DEBUG:teuthology.parallel:result is None 2019-11-28T11:58:13.265 DEBUG:teuthology.parallel:result is None 2019-11-28T11:58:13.266 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T11:58:13.266 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T11:58:13.267 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T11:58:13.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.474+0000 7f386e178700 1 Processor -- start 2019-11-28T11:58:13.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.474+0000 7f386e178700 1 -- start start 2019-11-28T11:58:13.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.475+0000 7f386e178700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f386806c490 0x7f386806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:13.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.475+0000 7f386e178700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f386806ce60 0x7f3868164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:13.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.475+0000 7f386e178700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386806db00 con 0x7f386806c0a0 2019-11-28T11:58:13.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.475+0000 7f386e178700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386806fd60 con 0x7f386806c490 2019-11-28T11:58:13.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.475+0000 7f386e178700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3868070030 con 0x7f386806ce60 2019-11-28T11:58:13.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.475+0000 7f385ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f386806c490 0x7f386806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:13.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.475+0000 7f385ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f386806c490 0x7f386806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46628/0 (socket says 172.21.15.80:46628) 2019-11-28T11:58:13.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.475+0000 7f385ffff700 1 -- 172.21.15.80:0/3495937146 learned_addr learned my addr 172.21.15.80:0/3495937146 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:13.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.475+0000 7f386cf16700 1 --2- 172.21.15.80:0/3495937146 >> v2:172.21.15.174:3300/0 conn(0x7f386806ce60 0x7f3868164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:13.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.475+0000 7f385ffff700 1 -- 172.21.15.80:0/3495937146 >> v2:172.21.15.174:3300/0 conn(0x7f386806ce60 msgr2=0x7f3868164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:13.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.475+0000 7f385ffff700 1 --2- 172.21.15.80:0/3495937146 >> v2:172.21.15.174:3300/0 conn(0x7f386806ce60 0x7f3868164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:13.477 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.475+0000 7f385ffff700 1 -- 172.21.15.80:0/3495937146 >> v1:172.21.15.174:6789/0 conn(0x7f386806c0a0 legacy=0x7f3868072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:13.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.475+0000 7f385ffff700 1 -- 172.21.15.80:0/3495937146 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38680706c0 con 0x7f386806c490 2019-11-28T11:58:13.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.476+0000 7f385ffff700 1 --2- 172.21.15.80:0/3495937146 >> v2:172.21.15.80:3300/0 conn(0x7f386806c490 0x7f386806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f385000f6c0 tx=0x7f385000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.476+0000 7f385ffff700 1 --2- 172.21.15.80:0/3495937146 >> v2:172.21.15.80:3300/0 conn(0x7f386806c490 0x7f386806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f385000f6c0 tx=0x7f385000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.476+0000 7f385ffff700 1 --2- 172.21.15.80:0/3495937146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386806c490 0x7f386806c920 secure :-1 s=READY pgs=2814 cs=0 l=1 rx=0x7f385000f6c0 tx=0x7f385000fa60).ready entity=mon.0 client_cookie=f524960d956015fe server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:13.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.476+0000 7f385ffff700 1 --2- 172.21.15.80:0/3495937146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386806c490 0x7f386806c920 secure :-1 s=THROTTLE_DONE pgs=2814 cs=0 l=1 rx=0x7f385000f6c0 tx=0x7f385000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.478 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.476+0000 7f38677fe700 1 -- 172.21.15.80:0/3495937146 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3850000960 con 0x7f386806c490 2019-11-28T11:58:13.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.476+0000 7f385ffff700 1 --2- 172.21.15.80:0/3495937146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386806c490 0x7f386806c920 secure :-1 s=THROTTLE_DONE pgs=2814 cs=0 l=1 rx=0x7f385000f6c0 tx=0x7f385000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.476+0000 7f385ffff700 1 --2- 172.21.15.80:0/3495937146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386806c490 0x7f386806c920 secure :-1 s=THROTTLE_DONE pgs=2814 cs=0 l=1 rx=0x7f385000f6c0 tx=0x7f385000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.476+0000 7f38677fe700 1 -- 172.21.15.80:0/3495937146 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3850000c90 con 0x7f386806c490 2019-11-28T11:58:13.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.476+0000 7f38677fe700 1 -- 172.21.15.80:0/3495937146 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38500013a0 con 0x7f386806c490 2019-11-28T11:58:13.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.476+0000 7f386e178700 1 -- 172.21.15.80:0/3495937146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386806c490 msgr2=0x7f386806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:13.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.476+0000 7f386e178700 1 --2- 172.21.15.80:0/3495937146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386806c490 0x7f386806c920 secure :-1 s=READY pgs=2814 cs=0 l=1 rx=0x7f385000f6c0 tx=0x7f385000fa60).stop 2019-11-28T11:58:13.479 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.477+0000 7f386e178700 1 -- 172.21.15.80:0/3495937146 shutdown_connections 2019-11-28T11:58:13.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.477+0000 7f386e178700 1 --2- 172.21.15.80:0/3495937146 >> v2:172.21.15.174:3300/0 conn(0x7f386806ce60 0x7f3868164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:13.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.477+0000 7f386e178700 1 --2- 172.21.15.80:0/3495937146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386806c490 0x7f386806c920 unknown :-1 s=CLOSED pgs=2814 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:13.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.477+0000 7f386e178700 1 -- 172.21.15.80:0/3495937146 shutdown_connections 2019-11-28T11:58:13.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.477+0000 7f386e178700 1 -- 172.21.15.80:0/3495937146 wait complete. 2019-11-28T11:58:13.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.477+0000 7f386e178700 1 -- 172.21.15.80:0/3495937146 >> 172.21.15.80:0/3495937146 conn(0x7f3868061cf0 msgr2=0x7f3868064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:13.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.479+0000 7f386e178700 1 Processor -- start 2019-11-28T11:58:13.480 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.479+0000 7f386e178700 1 -- start start 2019-11-28T11:58:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f386e178700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f386813a780 0x7f386812d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f386e178700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f386812d9c0 0x7f386812c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f386e178700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f386812c840 0x7f386812cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:13.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f386e178700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386812a260 con 0x7f386813a780 2019-11-28T11:58:13.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f386e178700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386812a530 con 0x7f386812d9c0 2019-11-28T11:58:13.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f386e178700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3868129830 con 0x7f386812c840 2019-11-28T11:58:13.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f3867fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f386813a780 0x7f386812d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:13.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f3867fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f386813a780 0x7f386812d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46632/0 (socket says 172.21.15.80:46632) 2019-11-28T11:58:13.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f3867fff700 1 -- 172.21.15.80:0/665932424 learned_addr learned my addr 172.21.15.80:0/665932424 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:13.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f385ffff700 1 --2- 172.21.15.80:0/665932424 >> v2:172.21.15.174:3300/0 conn(0x7f386812d9c0 0x7f386812c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:13.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f386cf16700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f386812c840 0x7f386812cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:13.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f3867fff700 1 -- 172.21.15.80:0/665932424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f386812c840 msgr2=0x7f386812cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:13.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f3867fff700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f386812c840 0x7f386812cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:13.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f3867fff700 1 -- 172.21.15.80:0/665932424 >> v2:172.21.15.174:3300/0 conn(0x7f386812d9c0 msgr2=0x7f386812c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:13.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f3867fff700 1 --2- 172.21.15.80:0/665932424 >> v2:172.21.15.174:3300/0 conn(0x7f386812d9c0 0x7f386812c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:13.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f3867fff700 1 -- 172.21.15.80:0/665932424 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386812abc0 con 0x7f386813a780 2019-11-28T11:58:13.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f386cf16700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f386812c840 0x7f386812cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:58:13.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f3867fff700 1 --2- 172.21.15.80:0/665932424 >> v2:172.21.15.80:3300/0 conn(0x7f386813a780 0x7f386812d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3858010410 tx=0x7f38580102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f3867fff700 1 --2- 172.21.15.80:0/665932424 >> v2:172.21.15.80:3300/0 conn(0x7f386813a780 0x7f386812d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3858010410 tx=0x7f38580102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.480+0000 7f3867fff700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386813a780 0x7f386812d480 secure :-1 s=READY pgs=2815 cs=0 l=1 rx=0x7f3858010410 tx=0x7f38580102f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:13.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.481+0000 7f3867fff700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386813a780 0x7f386812d480 secure :-1 s=THROTTLE_DONE pgs=2815 cs=0 l=1 rx=0x7f3858010410 tx=0x7f38580102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.481+0000 7f3867fff700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386813a780 0x7f386812d480 secure :-1 s=THROTTLE_DONE pgs=2815 cs=0 l=1 rx=0x7f3858010410 tx=0x7f38580102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.481+0000 7f3867fff700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386813a780 0x7f386812d480 secure :-1 s=THROTTLE_DONE pgs=2815 cs=0 l=1 rx=0x7f3858010410 tx=0x7f38580102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.481+0000 7f38657fa700 1 -- 172.21.15.80:0/665932424 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38580010a0 con 0x7f386813a780 2019-11-28T11:58:13.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.481+0000 7f38657fa700 1 -- 172.21.15.80:0/665932424 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3858000960 con 0x7f386813a780 2019-11-28T11:58:13.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.481+0000 7f386e178700 1 -- 172.21.15.80:0/665932424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386812af40 con 0x7f386813a780 2019-11-28T11:58:13.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.481+0000 7f38657fa700 1 -- 172.21.15.80:0/665932424 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3858001680 con 0x7f386813a780 2019-11-28T11:58:13.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.481+0000 7f386e178700 1 -- 172.21.15.80:0/665932424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386812abc0 con 0x7f386813a780 2019-11-28T11:58:13.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.481+0000 7f3867fff700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386813a780 0x7f386812d480 secure :-1 s=THROTTLE_DONE pgs=2815 cs=0 l=1 rx=0x7f3858010410 tx=0x7f38580102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.481+0000 7f38657fa700 1 -- 172.21.15.80:0/665932424 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3858000eb0 con 0x7f386813a780 2019-11-28T11:58:13.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.482+0000 7f3867fff700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386813a780 0x7f386812d480 secure :-1 s=THROTTLE_DONE pgs=2815 cs=0 l=1 rx=0x7f3858010410 tx=0x7f38580102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.482+0000 7f38657fa700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f384c018730 0x7f384c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:13.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.482+0000 7f38657fa700 1 -- 172.21.15.80:0/665932424 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3858031a40 con 0x7f386813a780 2019-11-28T11:58:13.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.482+0000 7f385ffff700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f384c018730 0x7f384c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:13.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.482+0000 7f385ffff700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f384c018730 0x7f384c01abc0 crc :-1 s=READY pgs=1167 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:13.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.482+0000 7f19b96bb700 1 Processor -- start 2019-11-28T11:58:13.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.482+0000 7f19b96bb700 1 -- start start 2019-11-28T11:58:13.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f19b96bb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19b406c490 0x7f19b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:13.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f19b96bb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b406db00 con 0x7f19b406ce60 2019-11-28T11:58:13.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f19b96bb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b405daa0 con 0x7f19b406c0a0 2019-11-28T11:58:13.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f19b96bb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b406fd60 con 0x7f19b406c490 2019-11-28T11:58:13.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f19b3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f19b406ce60 0x7f19b4164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45960/0 (socket says 172.21.15.80:45960) 2019-11-28T11:58:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f19b3fff700 1 -- 172.21.15.80:0/3818968801 learned_addr learned my addr 172.21.15.80:0/3818968801 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f19b2ffd700 1 --2- 172.21.15.80:0/3818968801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19b406c490 0x7f19b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f19b27fc700 1 -- 172.21.15.80:0/3818968801 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516178030 0 0) 0x7f19ac0014d0 con 0x7f19b406ce60 2019-11-28T11:58:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f19b27fc700 1 -- 172.21.15.80:0/3818968801 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f199c002e80 con 0x7f19b406ce60 2019-11-28T11:58:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f19b27fc700 1 -- 172.21.15.80:0/3818968801 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793959421 0 0) 0x7f19a4000fb0 con 0x7f19b406c0a0 2019-11-28T11:58:13.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f19b27fc700 1 -- 172.21.15.80:0/3818968801 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f199c0030b0 con 0x7f19b406c0a0 2019-11-28T11:58:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f19b2ffd700 1 -- 172.21.15.80:0/3818968801 >> v1:172.21.15.174:6789/0 conn(0x7f19b406c0a0 legacy=0x7f19b4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f19b2ffd700 1 -- 172.21.15.80:0/3818968801 >> v1:172.21.15.80:6789/0 conn(0x7f19b406ce60 legacy=0x7f19b4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f19b2ffd700 1 -- 172.21.15.80:0/3818968801 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b40706c0 con 0x7f19b406c490 2019-11-28T11:58:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f19b2ffd700 1 --2- 172.21.15.80:0/3818968801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19b406c490 0x7f19b406c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f19a800af50 tx=0x7f19a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f19b2ffd700 1 --2- 172.21.15.80:0/3818968801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19b406c490 0x7f19b406c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f19a800af50 tx=0x7f19a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f19b2ffd700 1 --2- 172.21.15.80:0/3818968801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19b406c490 0x7f19b406c920 secure :-1 s=READY pgs=407 cs=0 l=1 rx=0x7f19a800af50 tx=0x7f19a800b760).ready entity=mon.2 client_cookie=21ed249728467ebf server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:13.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f19b2ffd700 1 --2- 172.21.15.80:0/3818968801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19b406c490 0x7f19b406c920 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7f19a800af50 tx=0x7f19a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f19b27fc700 1 -- 172.21.15.80:0/3818968801 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19a8000960 con 0x7f19b406c490 2019-11-28T11:58:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f19b2ffd700 1 --2- 172.21.15.80:0/3818968801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19b406c490 0x7f19b406c920 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7f19a800af50 tx=0x7f19a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f19b2ffd700 1 --2- 172.21.15.80:0/3818968801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19b406c490 0x7f19b406c920 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7f19a800af50 tx=0x7f19a800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f19b27fc700 1 -- 172.21.15.80:0/3818968801 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a8000940 con 0x7f19b406c490 2019-11-28T11:58:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f19b27fc700 1 -- 172.21.15.80:0/3818968801 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19a8009ba0 con 0x7f19b406c490 2019-11-28T11:58:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f19b96bb700 1 -- 172.21.15.80:0/3818968801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19b406c490 msgr2=0x7f19b406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:13.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f19b96bb700 1 --2- 172.21.15.80:0/3818968801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19b406c490 0x7f19b406c920 secure :-1 s=READY pgs=407 cs=0 l=1 rx=0x7f19a800af50 tx=0x7f19a800b760).stop 2019-11-28T11:58:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.485+0000 7f19b96bb700 1 -- 172.21.15.80:0/3818968801 shutdown_connections 2019-11-28T11:58:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.485+0000 7f19b96bb700 1 --2- 172.21.15.80:0/3818968801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19b406c490 0x7f19b406c920 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.485+0000 7f19b96bb700 1 -- 172.21.15.80:0/3818968801 shutdown_connections 2019-11-28T11:58:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.485+0000 7f19b96bb700 1 -- 172.21.15.80:0/3818968801 wait complete. 2019-11-28T11:58:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.485+0000 7f19b96bb700 1 -- 172.21.15.80:0/3818968801 >> 172.21.15.80:0/3818968801 conn(0x7f19b4061cf0 msgr2=0x7f19b4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.487+0000 7f19b96bb700 1 Processor -- start 2019-11-28T11:58:13.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.487+0000 7f19b96bb700 1 -- start start 2019-11-28T11:58:13.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.482+0000 7f389e7a8700 1 Processor -- start 2019-11-28T11:58:13.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.482+0000 7f389e7a8700 1 -- start start 2019-11-28T11:58:13.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f389e7a8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f389806c0a0 0x7f3898072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:13.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f389e7a8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f389806db00 con 0x7f38980734e0 2019-11-28T11:58:13.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f389e7a8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f389806e000 con 0x7f3898072620 2019-11-28T11:58:13.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f389e7a8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389806f330 con 0x7f389806c0a0 2019-11-28T11:58:13.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f3897fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f38980734e0 0x7f3898071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45962/0 (socket says 172.21.15.80:45962) 2019-11-28T11:58:13.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f3897fff700 1 -- 172.21.15.80:0/611975444 learned_addr learned my addr 172.21.15.80:0/611975444 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:13.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f389cd45700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f389806c0a0 0x7f3898072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:13.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f38977fe700 1 -- 172.21.15.80:0/611975444 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000880344 0 0) 0x7f388c001100 con 0x7f38980734e0 2019-11-28T11:58:13.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f38977fe700 1 -- 172.21.15.80:0/611975444 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3880002e80 con 0x7f38980734e0 2019-11-28T11:58:13.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f38977fe700 1 -- 172.21.15.80:0/611975444 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765733413 0 0) 0x7f3890001400 con 0x7f3898072620 2019-11-28T11:58:13.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.483+0000 7f38977fe700 1 -- 172.21.15.80:0/611975444 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38800030b0 con 0x7f3898072620 2019-11-28T11:58:13.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f38977fe700 1 -- 172.21.15.80:0/611975444 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2062908724 0 0) 0x7f388c0010e0 con 0x7f38980734e0 2019-11-28T11:58:13.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f38977fe700 1 -- 172.21.15.80:0/611975444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f389806c0a0 msgr2=0x7f3898072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:13.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f38977fe700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f389806c0a0 0x7f3898072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:13.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f38977fe700 1 -- 172.21.15.80:0/611975444 >> v1:172.21.15.174:6789/0 conn(0x7f3898072620 legacy=0x7f3898164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:13.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f38977fe700 1 -- 172.21.15.80:0/611975444 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38980706c0 con 0x7f38980734e0 2019-11-28T11:58:13.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f38977fe700 1 -- 172.21.15.80:0/611975444 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f388c001610 con 0x7f38980734e0 2019-11-28T11:58:13.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f38977fe700 1 -- 172.21.15.80:0/611975444 >> v1:172.21.15.80:6789/0 conn(0x7f38980734e0 legacy=0x7f3898071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:13.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f38977fe700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3880003b80 0x7f3880005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:13.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f38977fe700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3880006690 0x7f3880008b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:13.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f38977fe700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f388004d310 0x7f388004f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:13.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f38977fe700 1 -- 172.21.15.80:0/611975444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388004fff0 con 0x7f3880006690 2019-11-28T11:58:13.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f38977fe700 1 -- 172.21.15.80:0/611975444 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38800501e0 con 0x7f388004d310 2019-11-28T11:58:13.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f38977fe700 1 -- 172.21.15.80:0/611975444 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3880050410 con 0x7f3880003b80 2019-11-28T11:58:13.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f3897fff700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3880006690 0x7f3880008b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:13.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f389cd45700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3880003b80 0x7f3880005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:13.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f389d546700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f388004d310 0x7f388004f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:13.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f3897fff700 1 -- 172.21.15.80:0/611975444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3880003b80 msgr2=0x7f3880005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:13.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f3897fff700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3880003b80 0x7f3880005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:13.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f3897fff700 1 -- 172.21.15.80:0/611975444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f388004d310 msgr2=0x7f388004f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:13.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f3897fff700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f388004d310 0x7f388004f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:13.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f3897fff700 1 -- 172.21.15.80:0/611975444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38800506c0 con 0x7f3880006690 2019-11-28T11:58:13.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f3897fff700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3880006690 0x7f3880008b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f388c00f890 tx=0x7f388c001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f3897fff700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3880006690 0x7f3880008b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f388c00f890 tx=0x7f388c001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f3897fff700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3880006690 0x7f3880008b00 secure :-1 s=READY pgs=2818 cs=0 l=1 rx=0x7f388c00f890 tx=0x7f388c001dd0).ready entity=mon.0 client_cookie=85cd62cdc6f00cb1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:13.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f3897fff700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3880006690 0x7f3880008b00 secure :-1 s=THROTTLE_DONE pgs=2818 cs=0 l=1 rx=0x7f388c00f890 tx=0x7f388c001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f3897fff700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3880006690 0x7f3880008b00 secure :-1 s=THROTTLE_DONE pgs=2818 cs=0 l=1 rx=0x7f388c00f890 tx=0x7f388c001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f38977fe700 1 -- 172.21.15.80:0/611975444 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f388c0010e0 con 0x7f3880006690 2019-11-28T11:58:13.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f3897fff700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3880006690 0x7f3880008b00 secure :-1 s=THROTTLE_DONE pgs=2818 cs=0 l=1 rx=0x7f388c00f890 tx=0x7f388c001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f38977fe700 1 -- 172.21.15.80:0/611975444 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c004240 con 0x7f3880006690 2019-11-28T11:58:13.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f38977fe700 1 -- 172.21.15.80:0/611975444 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f388c0048d0 con 0x7f3880006690 2019-11-28T11:58:13.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f389e7a8700 1 -- 172.21.15.80:0/611975444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3880006690 msgr2=0x7f3880008b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:13.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f389e7a8700 1 --2- 172.21.15.80:0/611975444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3880006690 0x7f3880008b00 secure :-1 s=READY pgs=2818 cs=0 l=1 rx=0x7f388c00f890 tx=0x7f388c001dd0).stop 2019-11-28T11:58:13.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.484+0000 7f389d546700 1 -- 172.21.15.80:0/611975444 reap_dead start 2019-11-28T11:58:13.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.485+0000 7f389e7a8700 1 -- 172.21.15.80:0/611975444 shutdown_connections 2019-11-28T11:58:13.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.485+0000 7f389e7a8700 1 -- 172.21.15.80:0/611975444 shutdown_connections 2019-11-28T11:58:13.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.485+0000 7f389e7a8700 1 -- 172.21.15.80:0/611975444 wait complete. 2019-11-28T11:58:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.485+0000 7f389e7a8700 1 -- 172.21.15.80:0/611975444 >> 172.21.15.80:0/611975444 conn(0x7f3898061cf0 msgr2=0x7f3898064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.487+0000 7f389e7a8700 1 Processor -- start 2019-11-28T11:58:13.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.488+0000 7f389e7a8700 1 -- start start 2019-11-28T11:58:13.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.488+0000 7f19b96bb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19b4106140 0x7f19b41065d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:13.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.488+0000 7f19b96bb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f19b4106b10 0x7f19b41330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:13.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.488+0000 7f19b96bb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b4136480 con 0x7f19b4135760 2019-11-28T11:58:13.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.488+0000 7f19b96bb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b4104370 con 0x7f19b4106b10 2019-11-28T11:58:13.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.488+0000 7f19b96bb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b41346a0 con 0x7f19b4106140 2019-11-28T11:58:13.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.488+0000 7f19b3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f19b4106b10 0x7f19b41330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:13.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.488+0000 7f19b37fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f19b4135760 0x7f19b4137480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45974/0 (socket says 172.21.15.80:45974) 2019-11-28T11:58:13.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f19b37fe700 1 -- 172.21.15.80:0/2668677021 learned_addr learned my addr 172.21.15.80:0/2668677021 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:13.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f19b2ffd700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19b4106140 0x7f19b41065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:13.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f19b3fff700 1 -- 172.21.15.80:0/2668677021 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19b4106140 msgr2=0x7f19b41065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:13.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f19b3fff700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19b4106140 0x7f19b41065d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:13.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f19b3fff700 1 -- 172.21.15.80:0/2668677021 >> v1:172.21.15.80:6789/0 conn(0x7f19b4135760 legacy=0x7f19b4137480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:13.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f19b3fff700 1 -- 172.21.15.80:0/2668677021 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4104a00 con 0x7f19b4106b10 2019-11-28T11:58:13.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f19b3fff700 1 --2- 172.21.15.80:0/2668677021 >> v2:172.21.15.80:3300/0 conn(0x7f19b4106b10 0x7f19b41330b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f19ac0106f0 tx=0x7f19ac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f19b3fff700 1 --2- 172.21.15.80:0/2668677021 >> v2:172.21.15.80:3300/0 conn(0x7f19b4106b10 0x7f19b41330b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f19ac0106f0 tx=0x7f19ac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f19b3fff700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b4106b10 0x7f19b41330b0 secure :-1 s=READY pgs=2821 cs=0 l=1 rx=0x7f19ac0106f0 tx=0x7f19ac010a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:13.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f19b3fff700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b4106b10 0x7f19b41330b0 secure :-1 s=THROTTLE_DONE pgs=2821 cs=0 l=1 rx=0x7f19ac0106f0 tx=0x7f19ac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f199bfff700 1 -- 172.21.15.80:0/2668677021 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19ac001270 con 0x7f19b4106b10 2019-11-28T11:58:13.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f19b3fff700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b4106b10 0x7f19b41330b0 secure :-1 s=THROTTLE_DONE pgs=2821 cs=0 l=1 rx=0x7f19ac0106f0 tx=0x7f19ac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f199bfff700 1 -- 172.21.15.80:0/2668677021 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac0045c0 con 0x7f19b4106b10 2019-11-28T11:58:13.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f19b3fff700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b4106b10 0x7f19b41330b0 secure :-1 s=THROTTLE_DONE pgs=2821 cs=0 l=1 rx=0x7f19ac0106f0 tx=0x7f19ac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f199bfff700 1 -- 172.21.15.80:0/2668677021 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19ac001580 con 0x7f19b4106b10 2019-11-28T11:58:13.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f19b96bb700 1 -- 172.21.15.80:0/2668677021 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b4104d80 con 0x7f19b4106b10 2019-11-28T11:58:13.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f19b96bb700 1 -- 172.21.15.80:0/2668677021 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b4106f80 con 0x7f19b4106b10 2019-11-28T11:58:13.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.493+0000 7f19b3fff700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b4106b10 0x7f19b41330b0 secure :-1 s=THROTTLE_DONE pgs=2821 cs=0 l=1 rx=0x7f19ac0106f0 tx=0x7f19ac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.493+0000 7f19b3fff700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b4106b10 0x7f19b41330b0 secure :-1 s=THROTTLE_DONE pgs=2821 cs=0 l=1 rx=0x7f19ac0106f0 tx=0x7f19ac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.493+0000 7f199bfff700 1 -- 172.21.15.80:0/2668677021 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f19ac0049c0 con 0x7f19b4106b10 2019-11-28T11:58:13.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.493+0000 7f199bfff700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1994018730 0x7f199401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:13.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.494+0000 7f199bfff700 1 -- 172.21.15.80:0/2668677021 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f19ac031d50 con 0x7f19b4106b10 2019-11-28T11:58:13.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.494+0000 7f19b37fe700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1994018730 0x7f199401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:13.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.494+0000 7f19b37fe700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1994018730 0x7f199401abc0 crc :-1 s=READY pgs=1169 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:13.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.497+0000 7f19b96bb700 1 -- 172.21.15.80:0/2668677021 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b4104a00 con 0x7f19b4106b10 2019-11-28T11:58:13.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.500+0000 7f19b3fff700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b4106b10 0x7f19b41330b0 secure :-1 s=THROTTLE_DONE pgs=2821 cs=0 l=1 rx=0x7f19ac0106f0 tx=0x7f19ac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.500+0000 7f199bfff700 1 -- 172.21.15.80:0/2668677021 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f19ac031aa0 con 0x7f19b4106b10 2019-11-28T11:58:13.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f389e7a8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f38980750f0 0x7f3898151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:13.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f389e7a8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3898151f90 0x7f3898152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:13.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f389e7a8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3898079230 con 0x7f3898074d00 2019-11-28T11:58:13.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f389e7a8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389807ab30 con 0x7f3898151f90 2019-11-28T11:58:13.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f389e7a8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389807ae00 con 0x7f38980750f0 2019-11-28T11:58:13.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f389cd45700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3898074d00 0x7f3898152bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45980/0 (socket says 172.21.15.80:45980) 2019-11-28T11:58:13.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f389cd45700 1 -- 172.21.15.80:0/4013776942 learned_addr learned my addr 172.21.15.80:0/4013776942 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:13.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f3897fff700 1 --2- 172.21.15.80:0/4013776942 >> v2:172.21.15.174:3300/0 conn(0x7f38980750f0 0x7f3898151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:13.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f3897fff700 1 -- 172.21.15.80:0/4013776942 >> v2:172.21.15.80:3300/0 conn(0x7f3898151f90 msgr2=0x7f3898152400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2019-11-28T11:58:13.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f3897fff700 1 --2- 172.21.15.80:0/4013776942 >> v2:172.21.15.80:3300/0 conn(0x7f3898151f90 0x7f3898152400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:13.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f3897fff700 1 -- 172.21.15.80:0/4013776942 >> v1:172.21.15.80:6789/0 conn(0x7f3898074d00 legacy=0x7f3898152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:13.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f3897fff700 1 -- 172.21.15.80:0/4013776942 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389807b490 con 0x7f38980750f0 2019-11-28T11:58:13.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f3897fff700 1 --2- 172.21.15.80:0/4013776942 >> v2:172.21.15.174:3300/0 conn(0x7f38980750f0 0x7f3898151a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f388c010360 tx=0x7f388c010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f3897fff700 1 --2- 172.21.15.80:0/4013776942 >> v2:172.21.15.174:3300/0 conn(0x7f38980750f0 0x7f3898151a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f388c010360 tx=0x7f388c010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f3897fff700 1 --2- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38980750f0 0x7f3898151a50 secure :-1 s=READY pgs=1709 cs=0 l=1 rx=0x7f388c010360 tx=0x7f388c010700).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:13.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f3897fff700 1 --2- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38980750f0 0x7f3898151a50 secure :-1 s=THROTTLE_DONE pgs=1709 cs=0 l=1 rx=0x7f388c010360 tx=0x7f388c010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f3897fff700 1 --2- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38980750f0 0x7f3898151a50 secure :-1 s=THROTTLE_DONE pgs=1709 cs=0 l=1 rx=0x7f388c010360 tx=0x7f388c010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.490+0000 7f3897fff700 1 --2- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38980750f0 0x7f3898151a50 secure :-1 s=THROTTLE_DONE pgs=1709 cs=0 l=1 rx=0x7f388c010360 tx=0x7f388c010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f38957fa700 1 -- 172.21.15.80:0/4013776942 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f388c000c90 con 0x7f38980750f0 2019-11-28T11:58:13.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.490+0000 7f38957fa700 1 -- 172.21.15.80:0/4013776942 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c004240 con 0x7f38980750f0 2019-11-28T11:58:13.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.490+0000 7f38957fa700 1 -- 172.21.15.80:0/4013776942 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f388c0048d0 con 0x7f38980750f0 2019-11-28T11:58:13.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.490+0000 7f389e7a8700 1 -- 172.21.15.80:0/4013776942 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389807b810 con 0x7f38980750f0 2019-11-28T11:58:13.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.490+0000 7f389e7a8700 1 -- 172.21.15.80:0/4013776942 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389807b490 con 0x7f38980750f0 2019-11-28T11:58:13.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.490+0000 7f3897fff700 1 --2- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38980750f0 0x7f3898151a50 secure :-1 s=THROTTLE_DONE pgs=1709 cs=0 l=1 rx=0x7f388c010360 tx=0x7f388c010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.490+0000 7f38957fa700 1 -- 172.21.15.80:0/4013776942 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f388c004430 con 0x7f38980750f0 2019-11-28T11:58:13.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.490+0000 7f3897fff700 1 --2- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38980750f0 0x7f3898151a50 secure :-1 s=THROTTLE_DONE pgs=1709 cs=0 l=1 rx=0x7f388c010360 tx=0x7f388c010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.491+0000 7f38957fa700 1 --2- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3878018730 0x7f387801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:13.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.491+0000 7f38957fa700 1 -- 172.21.15.80:0/4013776942 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f388c031a00 con 0x7f38980750f0 2019-11-28T11:58:13.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.491+0000 7f389cd45700 1 --2- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3878018730 0x7f387801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:13.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.491+0000 7f389cd45700 1 --2- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3878018730 0x7f387801abc0 crc :-1 s=READY pgs=1168 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:13.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.497+0000 7f389e7a8700 1 -- 172.21.15.80:0/4013776942 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389807b810 con 0x7f38980750f0 2019-11-28T11:58:13.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.501+0000 7f3897fff700 1 --2- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38980750f0 0x7f3898151a50 secure :-1 s=THROTTLE_DONE pgs=1709 cs=0 l=1 rx=0x7f388c010360 tx=0x7f388c010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.501+0000 7f38957fa700 1 -- 172.21.15.80:0/4013776942 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f388c000c90 con 0x7f38980750f0 2019-11-28T11:58:13.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.489+0000 7f386e178700 1 -- 172.21.15.80:0/665932424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386812af40 con 0x7f386813a780 2019-11-28T11:58:13.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.493+0000 7f3867fff700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386813a780 0x7f386812d480 secure :-1 s=THROTTLE_DONE pgs=2815 cs=0 l=1 rx=0x7f3858010410 tx=0x7f38580102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.493+0000 7f38657fa700 1 -- 172.21.15.80:0/665932424 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f38580075b0 con 0x7f386813a780 2019-11-28T11:58:13.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.676+0000 7f386e178700 1 -- 172.21.15.80:0/665932424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f386812abc0 con 0x7f386813a780 2019-11-28T11:58:13.847 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:58:13.851+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:58:13.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.854+0000 7f3867fff700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386813a780 0x7f386812d480 secure :-1 s=THROTTLE_DONE pgs=2815 cs=0 l=1 rx=0x7f3858010410 tx=0x7f38580102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:13.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.854+0000 7f38657fa700 1 -- 172.21.15.80:0/665932424 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7964 v177) v1 ==== 95+0+0 (secure 0 0 0) 0x7f3858017400 con 0x7f386813a780 2019-11-28T11:58:13.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.859+0000 7f389e7a8700 1 -- 172.21.15.80:0/4013776942 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f389807b490 con 0x7f38980750f0 2019-11-28T11:58:13.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.859+0000 7f19b96bb700 1 -- 172.21.15.80:0/2668677021 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f19b4104d80 con 0x7f19b4106b10 2019-11-28T11:58:13.886 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 7964 2019-11-28T11:58:13.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.892+0000 7f386e178700 1 -- 172.21.15.80:0/665932424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f384c018730 msgr2=0x7f384c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:13.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.892+0000 7f386e178700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f384c018730 0x7f384c01abc0 crc :-1 s=READY pgs=1167 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:13.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.892+0000 7f386e178700 1 -- 172.21.15.80:0/665932424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386813a780 msgr2=0x7f386812d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:13.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.892+0000 7f386e178700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386813a780 0x7f386812d480 secure :-1 s=READY pgs=2815 cs=0 l=1 rx=0x7f3858010410 tx=0x7f38580102f0).stop 2019-11-28T11:58:13.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.892+0000 7f386e178700 1 -- 172.21.15.80:0/665932424 shutdown_connections 2019-11-28T11:58:13.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.892+0000 7f386e178700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f384c018730 0x7f384c01abc0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:13.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.892+0000 7f386e178700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f386812c840 0x7f386812cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:13.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.892+0000 7f386e178700 1 --2- 172.21.15.80:0/665932424 >> v2:172.21.15.174:3300/0 conn(0x7f386812d9c0 0x7f386812c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:13.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.892+0000 7f386e178700 1 --2- 172.21.15.80:0/665932424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f386813a780 0x7f386812d480 unknown :-1 s=CLOSED pgs=2815 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:13.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.892+0000 7f386e178700 1 -- 172.21.15.80:0/665932424 shutdown_connections 2019-11-28T11:58:13.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.892+0000 7f386e178700 1 -- 172.21.15.80:0/665932424 wait complete. 2019-11-28T11:58:13.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:13.892+0000 7f386e178700 1 -- 172.21.15.80:0/665932424 >> 172.21.15.80:0/665932424 conn(0x7f3868127dc0 msgr2=0x7f3868141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:13.898 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:58:14.854 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:58:14.858+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:58:14.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.860+0000 7f19b3fff700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b4106b10 0x7f19b41330b0 secure :-1 s=THROTTLE_DONE pgs=2821 cs=0 l=1 rx=0x7f19ac0106f0 tx=0x7f19ac010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:14.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.860+0000 7f199bfff700 1 -- 172.21.15.80:0/2668677021 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 12102 v179) v1 ==== 96+0+0 (secure 0 0 0) 0x7f19ac0047b0 con 0x7f19b4106b10 2019-11-28T11:58:14.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.861+0000 7f3897fff700 1 --2- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38980750f0 0x7f3898151a50 secure :-1 s=THROTTLE_DONE pgs=1709 cs=0 l=1 rx=0x7f388c010360 tx=0x7f388c010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:14.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.861+0000 7f38957fa700 1 -- 172.21.15.80:0/4013776942 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 11371 v179) v1 ==== 96+0+0 (secure 0 0 0) 0x7f388c004430 con 0x7f38980750f0 2019-11-28T11:58:14.871 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 12102 2019-11-28T11:58:14.872 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 11371 2019-11-28T11:58:14.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f19b96bb700 1 -- 172.21.15.80:0/2668677021 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1994018730 msgr2=0x7f199401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:14.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f19b96bb700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1994018730 0x7f199401abc0 crc :-1 s=READY pgs=1169 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:14.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f19b96bb700 1 -- 172.21.15.80:0/2668677021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b4106b10 msgr2=0x7f19b41330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:14.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f19b96bb700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b4106b10 0x7f19b41330b0 secure :-1 s=READY pgs=2821 cs=0 l=1 rx=0x7f19ac0106f0 tx=0x7f19ac010a90).stop 2019-11-28T11:58:14.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f19b96bb700 1 -- 172.21.15.80:0/2668677021 shutdown_connections 2019-11-28T11:58:14.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f19b96bb700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1994018730 0x7f199401abc0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:14.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f19b96bb700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b4106b10 0x7f19b41330b0 unknown :-1 s=CLOSED pgs=2821 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:14.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f19b96bb700 1 --2- 172.21.15.80:0/2668677021 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19b4106140 0x7f19b41065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:14.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f19b96bb700 1 -- 172.21.15.80:0/2668677021 shutdown_connections 2019-11-28T11:58:14.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f19b96bb700 1 -- 172.21.15.80:0/2668677021 wait complete. 2019-11-28T11:58:14.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f19b96bb700 1 -- 172.21.15.80:0/2668677021 >> 172.21.15.80:0/2668677021 conn(0x7f19b413d930 msgr2=0x7f19b4102360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:14.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f389e7a8700 1 -- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3878018730 msgr2=0x7f387801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:14.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f389e7a8700 1 --2- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3878018730 0x7f387801abc0 crc :-1 s=READY pgs=1168 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:14.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f389e7a8700 1 -- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38980750f0 msgr2=0x7f3898151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:14.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f389e7a8700 1 --2- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38980750f0 0x7f3898151a50 secure :-1 s=READY pgs=1709 cs=0 l=1 rx=0x7f388c010360 tx=0x7f388c010700).stop 2019-11-28T11:58:14.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f389e7a8700 1 -- 172.21.15.80:0/4013776942 shutdown_connections 2019-11-28T11:58:14.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f389e7a8700 1 --2- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3878018730 0x7f387801abc0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:14.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f389e7a8700 1 --2- 172.21.15.80:0/4013776942 >> v2:172.21.15.80:3300/0 conn(0x7f3898151f90 0x7f3898152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:14.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f389e7a8700 1 --2- 172.21.15.80:0/4013776942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38980750f0 0x7f3898151a50 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:14.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f389e7a8700 1 -- 172.21.15.80:0/4013776942 shutdown_connections 2019-11-28T11:58:14.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f389e7a8700 1 -- 172.21.15.80:0/4013776942 wait complete. 2019-11-28T11:58:14.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:14.878+0000 7f389e7a8700 1 -- 172.21.15.80:0/4013776942 >> 172.21.15.80:0/4013776942 conn(0x7f389813fa50 msgr2=0x7f389807c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:14.888 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:58:14.888 DEBUG:teuthology.parallel:result is '' 2019-11-28T11:58:14.889 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T11:58:15.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.011+0000 7f0855236700 1 Processor -- start 2019-11-28T11:58:15.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.011+0000 7f0855236700 1 -- start start 2019-11-28T11:58:15.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.012+0000 7f0855236700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f085006c0a0 0x7f0850072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:15.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.012+0000 7f0855236700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0850072620 0x7f0850164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:15.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.012+0000 7f0855236700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085006db00 con 0x7f08500734e0 2019-11-28T11:58:15.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.012+0000 7f0855236700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085006fd60 con 0x7f085006c0a0 2019-11-28T11:58:15.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.012+0000 7f0855236700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0850070030 con 0x7f0850072620 2019-11-28T11:58:15.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.013+0000 7f084f59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f085006c0a0 0x7f0850072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:15.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.013+0000 7f0854a35700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0850072620 0x7f0850164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:15.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.013+0000 7f084f59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f085006c0a0 0x7f0850072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:33326/0 (socket says 172.21.15.80:33326) 2019-11-28T11:58:15.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.013+0000 7f0854a35700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0850072620 0x7f0850164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:48934/0 (socket says 172.21.15.80:48934) 2019-11-28T11:58:15.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.013+0000 7f084f59e700 1 -- 172.21.15.80:0/3635552851 learned_addr learned my addr 172.21.15.80:0/3635552851 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:15.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.013+0000 7f0854a35700 1 -- 172.21.15.80:0/3635552851 >> v2:172.21.15.174:3300/0 conn(0x7f085006c0a0 msgr2=0x7f0850072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:15.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.013+0000 7f0854a35700 1 --2- 172.21.15.80:0/3635552851 >> v2:172.21.15.174:3300/0 conn(0x7f085006c0a0 0x7f0850072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.013+0000 7f0854a35700 1 -- 172.21.15.80:0/3635552851 >> v1:172.21.15.174:6789/0 conn(0x7f08500734e0 legacy=0x7f0850071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.013+0000 7f0854a35700 1 -- 172.21.15.80:0/3635552851 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08500706c0 con 0x7f0850072620 2019-11-28T11:58:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.013+0000 7f0854a35700 1 --2- 172.21.15.80:0/3635552851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0850072620 0x7f0850164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f084800af80 tx=0x7f084800b280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.013+0000 7f0854a35700 1 --2- 172.21.15.80:0/3635552851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0850072620 0x7f0850164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f084800af80 tx=0x7f084800b280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.013+0000 7f0854a35700 1 --2- 172.21.15.80:0/3635552851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0850072620 0x7f0850164d70 secure :-1 s=READY pgs=408 cs=0 l=1 rx=0x7f084800af80 tx=0x7f084800b280).ready entity=mon.2 client_cookie=5ebbdb52838a051e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.013+0000 7f0854a35700 1 --2- 172.21.15.80:0/3635552851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0850072620 0x7f0850164d70 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7f084800af80 tx=0x7f084800b280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.013+0000 7f0854a35700 1 --2- 172.21.15.80:0/3635552851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0850072620 0x7f0850164d70 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7f084800af80 tx=0x7f084800b280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.013+0000 7f084e59c700 1 -- 172.21.15.80:0/3635552851 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0848007240 con 0x7f0850072620 2019-11-28T11:58:15.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.014+0000 7f0854a35700 1 --2- 172.21.15.80:0/3635552851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0850072620 0x7f0850164d70 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7f084800af80 tx=0x7f084800b280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.014+0000 7f084e59c700 1 -- 172.21.15.80:0/3635552851 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0848000b10 con 0x7f0850072620 2019-11-28T11:58:15.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.014+0000 7f084e59c700 1 -- 172.21.15.80:0/3635552851 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0848009ea0 con 0x7f0850072620 2019-11-28T11:58:15.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.014+0000 7f0855236700 1 -- 172.21.15.80:0/3635552851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0850072620 msgr2=0x7f0850164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:15.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.014+0000 7f0855236700 1 --2- 172.21.15.80:0/3635552851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0850072620 0x7f0850164d70 secure :-1 s=READY pgs=408 cs=0 l=1 rx=0x7f084800af80 tx=0x7f084800b280).stop 2019-11-28T11:58:15.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.014+0000 7f0855236700 1 -- 172.21.15.80:0/3635552851 shutdown_connections 2019-11-28T11:58:15.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.014+0000 7f0855236700 1 --2- 172.21.15.80:0/3635552851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0850072620 0x7f0850164d70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:15.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.014+0000 7f0855236700 1 --2- 172.21.15.80:0/3635552851 >> v2:172.21.15.174:3300/0 conn(0x7f085006c0a0 0x7f0850072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:15.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.014+0000 7f0855236700 1 -- 172.21.15.80:0/3635552851 shutdown_connections 2019-11-28T11:58:15.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.014+0000 7f0855236700 1 -- 172.21.15.80:0/3635552851 wait complete. 2019-11-28T11:58:15.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.014+0000 7f0855236700 1 -- 172.21.15.80:0/3635552851 >> 172.21.15.80:0/3635552851 conn(0x7f0850061cf0 msgr2=0x7f0850064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:15.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.017+0000 7f0855236700 1 Processor -- start 2019-11-28T11:58:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.017+0000 7f0855236700 1 -- start start 2019-11-28T11:58:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f0855236700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f085015d050 0x7f0850135d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:15.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f0855236700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08501ad2e0 0x7f08501af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:15.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f0855236700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0850142ad0 con 0x7f0850140590 2019-11-28T11:58:15.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f0855236700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08501126c0 con 0x7f085015d050 2019-11-28T11:58:15.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f0855236700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085013e850 con 0x7f08501ad2e0 2019-11-28T11:58:15.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f084ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0850140590 0x7f0850140a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45996/0 (socket says 172.21.15.80:45996) 2019-11-28T11:58:15.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f084ed9d700 1 -- 172.21.15.80:0/102412156 learned_addr learned my addr 172.21.15.80:0/102412156 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:15.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f084f59e700 1 --2- 172.21.15.80:0/102412156 >> v2:172.21.15.174:3300/0 conn(0x7f085015d050 0x7f0850135d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:15.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f0854a35700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08501ad2e0 0x7f08501af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:15.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f0847fff700 1 -- 172.21.15.80:0/102412156 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257168417 0 0) 0x7f0840000d30 con 0x7f0850140590 2019-11-28T11:58:15.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f0847fff700 1 -- 172.21.15.80:0/102412156 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0828002e80 con 0x7f0850140590 2019-11-28T11:58:15.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f0854a35700 1 -- 172.21.15.80:0/102412156 >> v2:172.21.15.174:3300/0 conn(0x7f085015d050 msgr2=0x7f0850135d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:15.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f0854a35700 1 --2- 172.21.15.80:0/102412156 >> v2:172.21.15.174:3300/0 conn(0x7f085015d050 0x7f0850135d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:15.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f0854a35700 1 -- 172.21.15.80:0/102412156 >> v1:172.21.15.80:6789/0 conn(0x7f0850140590 legacy=0x7f0850140a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:15.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f0854a35700 1 -- 172.21.15.80:0/102412156 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085013eee0 con 0x7f08501ad2e0 2019-11-28T11:58:15.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f084f59e700 1 --2- 172.21.15.80:0/102412156 >> v2:172.21.15.174:3300/0 conn(0x7f085015d050 0x7f0850135d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:15.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f0854a35700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08501ad2e0 0x7f08501af6e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f08480103a0 tx=0x7f0848010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f0854a35700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08501ad2e0 0x7f08501af6e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f08480103a0 tx=0x7f0848010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.018+0000 7f0854a35700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08501ad2e0 0x7f08501af6e0 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7f08480103a0 tx=0x7f0848010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:15.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.019+0000 7f0854a35700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08501ad2e0 0x7f08501af6e0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7f08480103a0 tx=0x7f0848010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.019+0000 7f0847fff700 1 -- 172.21.15.80:0/102412156 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f084800afe0 con 0x7f08501ad2e0 2019-11-28T11:58:15.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.019+0000 7f0854a35700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08501ad2e0 0x7f08501af6e0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7f08480103a0 tx=0x7f0848010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.019+0000 7f0847fff700 1 -- 172.21.15.80:0/102412156 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0848009aa0 con 0x7f08501ad2e0 2019-11-28T11:58:15.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.019+0000 7f0854a35700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08501ad2e0 0x7f08501af6e0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7f08480103a0 tx=0x7f0848010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.019+0000 7f0847fff700 1 -- 172.21.15.80:0/102412156 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0848009c90 con 0x7f08501ad2e0 2019-11-28T11:58:15.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.019+0000 7f0855236700 1 -- 172.21.15.80:0/102412156 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085013f260 con 0x7f08501ad2e0 2019-11-28T11:58:15.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.019+0000 7f0855236700 1 -- 172.21.15.80:0/102412156 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085013eee0 con 0x7f08501ad2e0 2019-11-28T11:58:15.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.019+0000 7f0854a35700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08501ad2e0 0x7f08501af6e0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7f08480103a0 tx=0x7f0848010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.019+0000 7f0847fff700 1 -- 172.21.15.80:0/102412156 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f08480095b0 con 0x7f08501ad2e0 2019-11-28T11:58:15.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.019+0000 7f0854a35700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08501ad2e0 0x7f08501af6e0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7f08480103a0 tx=0x7f0848010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.019+0000 7f0847fff700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0828018770 0x7f082801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:15.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.019+0000 7f0847fff700 1 -- 172.21.15.80:0/102412156 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f0848031a40 con 0x7f08501ad2e0 2019-11-28T11:58:15.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.020+0000 7f084f59e700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0828018770 0x7f082801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:15.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.020+0000 7f084f59e700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0828018770 0x7f082801abe0 crc :-1 s=READY pgs=1170 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:15.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.027+0000 7f0855236700 1 -- 172.21.15.80:0/102412156 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085013f260 con 0x7f08501ad2e0 2019-11-28T11:58:15.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.031+0000 7f0854a35700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08501ad2e0 0x7f08501af6e0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7f08480103a0 tx=0x7f0848010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.031+0000 7f0847fff700 1 -- 172.21.15.80:0/102412156 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f084800e6b0 con 0x7f08501ad2e0 2019-11-28T11:58:15.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.205+0000 7f0855236700 1 -- 172.21.15.80:0/102412156 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f085013eee0 con 0x7f08501ad2e0 2019-11-28T11:58:15.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.207+0000 7f0854a35700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08501ad2e0 0x7f08501af6e0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7f08480103a0 tx=0x7f0848010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.207+0000 7f0847fff700 1 -- 172.21.15.80:0/102412156 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v216) v1 ==== 81+0+31927 (secure 0 0 0) 0x7f084800e6b0 con 0x7f08501ad2e0 2019-11-28T11:58:15.204 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:15.205 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:58:15.205 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 216, 2019-11-28T11:58:15.205 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:58:15.205 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T11:58:15.206 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T11:58:13.870168+0000", 2019-11-28T11:58:15.206 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:58:15.206 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T11:58:15.206 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T11:58:15.206 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T11:58:15.207 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T11:58:15.207 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T11:58:15.207 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T11:58:15.207 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T11:58:15.208 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T11:58:15.208 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:58:15.208 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T11:58:15.208 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T11:58:15.209 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T11:58:15.209 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T11:58:15.209 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T11:58:15.209 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 35, 2019-11-28T11:58:15.210 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T11:58:15.210 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T11:58:15.210 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T11:58:15.210 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T11:58:15.211 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T11:58:15.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.211 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T11:58:15.212 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T11:58:15.213 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T11:58:15.213 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:58:15.213 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:58:15.213 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:58:15.213 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:58:15.214 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:58:15.214 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:58:15.214 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:58:15.214 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:58:15.215 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:58:15.215 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:58:15.215 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:58:15.215 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:58:15.216 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:58:15.216 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:58:15.216 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:58:15.217 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:58:15.217 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:58:15.217 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:58:15.217 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:58:15.218 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:58:15.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.218 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T11:58:15.219 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:58:15.219 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:58:15.219 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:58:15.220 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:58:15.220 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:58:15.220 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:58:15.220 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:58:15.221 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:58:15.221 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:58:15.221 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:58:15.221 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:58:15.222 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:58:15.222 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:58:15.222 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:58:15.222 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:58:15.223 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:58:15.223 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:58:15.224 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:58:15.224 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:58:15.224 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:58:15.224 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:58:15.225 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:58:15.225 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:58:15.225 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:58:15.225 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:58:15.226 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:58:15.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.226 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:58:15.227 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:58:15.227 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:58:15.227 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:58:15.228 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:58:15.228 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:58:15.228 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:58:15.228 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:58:15.229 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:58:15.229 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:58:15.229 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:58:15.229 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:58:15.229 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:58:15.230 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T11:58:15.230 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.231 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 34, 2019-11-28T11:58:15.231 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T11:58:15.231 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:57:53.888806+0000", 2019-11-28T11:58:15.231 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:58:15.231 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:58:15.232 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:58:15.232 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:58:15.232 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:58:15.232 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:58:15.233 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:58:15.233 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:58:15.233 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:58:15.234 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:58:15.234 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:58:15.235 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:58:15.235 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:58:15.235 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:58:15.236 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:58:15.236 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:58:15.236 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:58:15.236 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:58:15.237 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:58:15.237 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:58:15.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.238 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "212", 2019-11-28T11:58:15.238 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:58:15.238 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:58:15.238 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:58:15.238 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:58:15.239 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:58:15.239 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:58:15.239 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:58:15.240 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:58:15.240 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:58:15.240 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:58:15.241 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:58:15.241 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:58:15.241 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:58:15.241 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:58:15.241 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:58:15.241 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:58:15.241 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:58:15.242 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:58:15.242 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:58:15.242 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:58:15.242 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:58:15.242 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:58:15.243 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:58:15.243 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:58:15.243 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:58:15.243 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:58:15.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.243 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:58:15.243 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:58:15.244 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:58:15.244 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:58:15.245 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:58:15.245 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:58:15.245 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:58:15.245 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:58:15.245 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:58:15.246 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:58:15.246 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:58:15.246 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T11:58:15.246 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T11:58:15.246 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T11:58:15.246 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T11:58:15.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.247 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:58:15.247 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:58:15.247 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T11:58:15.247 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.247 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.248 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 35, 2019-11-28T11:58:15.248 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T11:58:15.248 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:57:54.582023+0000", 2019-11-28T11:58:15.248 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T11:58:15.249 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T11:58:15.249 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T11:58:15.249 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T11:58:15.249 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T11:58:15.249 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T11:58:15.249 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T11:58:15.249 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T11:58:15.250 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T11:58:15.250 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T11:58:15.250 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T11:58:15.250 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T11:58:15.250 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T11:58:15.250 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T11:58:15.250 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T11:58:15.251 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T11:58:15.251 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T11:58:15.251 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T11:58:15.251 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T11:58:15.251 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T11:58:15.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.251 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "213", 2019-11-28T11:58:15.252 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T11:58:15.252 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T11:58:15.252 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T11:58:15.252 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T11:58:15.252 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T11:58:15.252 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T11:58:15.252 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T11:58:15.253 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T11:58:15.253 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T11:58:15.253 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T11:58:15.253 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T11:58:15.253 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T11:58:15.254 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T11:58:15.254 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T11:58:15.254 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T11:58:15.254 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T11:58:15.254 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T11:58:15.254 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T11:58:15.254 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T11:58:15.255 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T11:58:15.255 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T11:58:15.255 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T11:58:15.256 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T11:58:15.256 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T11:58:15.256 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T11:58:15.256 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T11:58:15.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.257 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T11:58:15.257 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T11:58:15.257 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T11:58:15.257 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T11:58:15.257 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T11:58:15.257 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T11:58:15.257 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T11:58:15.258 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T11:58:15.258 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T11:58:15.258 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T11:58:15.258 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T11:58:15.258 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T11:58:15.258 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T11:58:15.258 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T11:58:15.259 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T11:58:15.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.259 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:58:15.259 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T11:58:15.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.260 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:58:15.260 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T11:58:15.260 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:58:15.260 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:58:15.260 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:58:15.261 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:58:15.261 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:58:15.261 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:58:15.261 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:58:15.261 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 210, 2019-11-28T11:58:15.261 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:58:15.261 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:58:15.262 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:58:15.262 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.262 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.262 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T11:58:15.263 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:58:15.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.263 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.263 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T11:58:15.263 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:58:15.264 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.264 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.264 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:58:15.264 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.264 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.265 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T11:58:15.265 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:58:15.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.266 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.266 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T11:58:15.266 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:58:15.266 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.266 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.267 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:58:15.267 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.267 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.267 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T11:58:15.267 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:58:15.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.268 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.268 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T11:58:15.268 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:58:15.268 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.268 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.269 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:58:15.269 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.269 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.269 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T11:58:15.269 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:58:15.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.270 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.270 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T11:58:15.270 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T11:58:15.270 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.270 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.271 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T11:58:15.271 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T11:58:15.271 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T11:58:15.271 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T11:58:15.271 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:58:15.271 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:58:15.272 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:58:15.272 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.272 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:58:15.272 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T11:58:15.272 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:58:15.273 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:58:15.273 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:58:15.273 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:58:15.273 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:58:15.273 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:58:15.273 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:58:15.273 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 188, 2019-11-28T11:58:15.274 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:58:15.274 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:58:15.274 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:58:15.274 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.274 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.275 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T11:58:15.275 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:58:15.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.275 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.275 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T11:58:15.275 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:58:15.276 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.276 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.277 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:58:15.277 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.277 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.277 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T11:58:15.277 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:58:15.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.278 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.278 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T11:58:15.278 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:58:15.278 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.278 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.279 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:58:15.279 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.279 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.279 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T11:58:15.279 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:58:15.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.280 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.280 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T11:58:15.280 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:58:15.280 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.281 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.281 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:58:15.281 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.282 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.282 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T11:58:15.282 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:58:15.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.283 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.283 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T11:58:15.283 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T11:58:15.283 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.284 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.284 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T11:58:15.284 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T11:58:15.284 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T11:58:15.285 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T11:58:15.285 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:58:15.285 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:58:15.285 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:58:15.286 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.287 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:58:15.287 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T11:58:15.287 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:58:15.288 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:58:15.288 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:58:15.288 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:58:15.288 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:58:15.288 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:58:15.288 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:58:15.289 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 211, 2019-11-28T11:58:15.289 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:58:15.289 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:58:15.289 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:58:15.289 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.290 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.290 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T11:58:15.290 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:58:15.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.291 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.291 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T11:58:15.291 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:58:15.291 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.291 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.291 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:58:15.292 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.292 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.292 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T11:58:15.292 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:58:15.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.293 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.293 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T11:58:15.293 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:58:15.293 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.293 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.294 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:58:15.294 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.294 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.294 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T11:58:15.294 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:58:15.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.295 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.295 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T11:58:15.295 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:58:15.295 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.296 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.296 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:58:15.296 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.296 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.297 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T11:58:15.298 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:58:15.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.299 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.299 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T11:58:15.299 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T11:58:15.299 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.300 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.300 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T11:58:15.300 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T11:58:15.300 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T11:58:15.300 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T11:58:15.301 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:58:15.301 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:58:15.301 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:58:15.301 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.302 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:58:15.302 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T11:58:15.302 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:58:15.302 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:58:15.302 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:58:15.302 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:58:15.303 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:58:15.303 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:58:15.303 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T11:58:15.303 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 211, 2019-11-28T11:58:15.303 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:58:15.303 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:58:15.303 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:58:15.304 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.306 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.307 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T11:58:15.307 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:58:15.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.307 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.308 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T11:58:15.308 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:58:15.310 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.310 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.310 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:58:15.311 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.311 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.311 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T11:58:15.311 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:58:15.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.312 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.312 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T11:58:15.312 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:58:15.312 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.312 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.312 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:58:15.313 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.313 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.313 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T11:58:15.313 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:58:15.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.314 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.314 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T11:58:15.314 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:58:15.314 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.314 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.315 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:58:15.315 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.315 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.315 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T11:58:15.315 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:58:15.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.316 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.316 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T11:58:15.316 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T11:58:15.316 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.316 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.317 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T11:58:15.317 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T11:58:15.317 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T11:58:15.317 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T11:58:15.317 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:58:15.317 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:58:15.318 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:58:15.318 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.318 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:58:15.318 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T11:58:15.318 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:58:15.319 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:58:15.319 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:58:15.319 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:58:15.319 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:58:15.319 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:58:15.320 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:58:15.320 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 211, 2019-11-28T11:58:15.320 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:58:15.320 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:58:15.320 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:58:15.320 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.321 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.321 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T11:58:15.321 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:58:15.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.321 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.322 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T11:58:15.322 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:58:15.322 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.322 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.322 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:58:15.323 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.323 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.323 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T11:58:15.323 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:58:15.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.324 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.324 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T11:58:15.324 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:58:15.324 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.324 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.325 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:58:15.325 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.325 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.325 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T11:58:15.325 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:58:15.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.326 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.326 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T11:58:15.326 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:58:15.326 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.326 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.327 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:58:15.327 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.327 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.327 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T11:58:15.328 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:58:15.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.328 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.328 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T11:58:15.328 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T11:58:15.328 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.329 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.329 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T11:58:15.329 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T11:58:15.329 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T11:58:15.329 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T11:58:15.330 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:58:15.330 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:58:15.330 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:58:15.330 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.331 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:58:15.331 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T11:58:15.331 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:58:15.331 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:58:15.331 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:58:15.331 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:58:15.332 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:58:15.332 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:58:15.332 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:58:15.332 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 211, 2019-11-28T11:58:15.332 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:58:15.332 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:58:15.332 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:58:15.333 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.333 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.333 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T11:58:15.333 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:58:15.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.334 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.334 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T11:58:15.334 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:58:15.334 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.334 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.335 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:58:15.335 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.335 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.335 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T11:58:15.335 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:58:15.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.336 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.336 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T11:58:15.336 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:58:15.336 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.336 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.337 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:58:15.337 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.337 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.337 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T11:58:15.337 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:58:15.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.338 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.338 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T11:58:15.338 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:58:15.339 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.339 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.339 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:58:15.339 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.339 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.339 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T11:58:15.340 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:58:15.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.340 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.340 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T11:58:15.340 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T11:58:15.341 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.341 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.341 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T11:58:15.341 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T11:58:15.341 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T11:58:15.341 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T11:58:15.342 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:58:15.342 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:58:15.342 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:58:15.342 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.343 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:58:15.343 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T11:58:15.343 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:58:15.343 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:58:15.343 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:58:15.344 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:58:15.344 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:58:15.344 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:58:15.344 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:58:15.344 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 211, 2019-11-28T11:58:15.344 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:58:15.344 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:58:15.345 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:58:15.345 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.345 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.345 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T11:58:15.345 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:58:15.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.347 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.348 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T11:58:15.348 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:58:15.348 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.348 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.348 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:58:15.349 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.349 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.349 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T11:58:15.349 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:58:15.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.350 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.350 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T11:58:15.350 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:58:15.350 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.350 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.351 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:58:15.351 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.351 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.351 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T11:58:15.352 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:58:15.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.352 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.352 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T11:58:15.353 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:58:15.353 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.353 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.353 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:58:15.354 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.354 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.354 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T11:58:15.354 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:58:15.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.355 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.355 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T11:58:15.355 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T11:58:15.355 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.355 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.355 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T11:58:15.356 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T11:58:15.356 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T11:58:15.356 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T11:58:15.356 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:58:15.356 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:58:15.357 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:58:15.357 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.357 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:58:15.358 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T11:58:15.358 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T11:58:15.358 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T11:58:15.360 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T11:58:15.360 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T11:58:15.360 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T11:58:15.361 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T11:58:15.361 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T11:58:15.361 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 210, 2019-11-28T11:58:15.361 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T11:58:15.361 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T11:58:15.362 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T11:58:15.362 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.362 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.362 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T11:58:15.362 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:58:15.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.363 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.363 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T11:58:15.363 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:58:15.363 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.363 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.364 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T11:58:15.364 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.364 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.364 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T11:58:15.364 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:58:15.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.365 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.365 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T11:58:15.365 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:58:15.365 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.365 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.366 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T11:58:15.366 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.366 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.366 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T11:58:15.366 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:58:15.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.367 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.367 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T11:58:15.367 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:58:15.367 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.367 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.368 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T11:58:15.368 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T11:58:15.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.368 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T11:58:15.368 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T11:58:15.368 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:58:15.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.369 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:15.369 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T11:58:15.369 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T11:58:15.369 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.369 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.370 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T11:58:15.370 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T11:58:15.370 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T11:58:15.370 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T11:58:15.370 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T11:58:15.370 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T11:58:15.371 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T11:58:15.371 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:15.371 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.371 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:58:15.371 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T11:58:15.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.371 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T11:58:15.372 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:58:15.372 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:58:15.372 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:58:15.372 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:58:15.372 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:58:15.372 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T11:58:15.372 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:58:15.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.373 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T11:58:15.373 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:58:15.373 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:58:15.374 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:58:15.374 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:58:15.374 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:58:15.374 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T11:58:15.374 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:58:15.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.375 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T11:58:15.375 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:58:15.375 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:58:15.375 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:58:15.376 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:58:15.376 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:58:15.376 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T11:58:15.376 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:58:15.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.377 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T11:58:15.377 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:58:15.377 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:58:15.377 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:58:15.377 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:58:15.377 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:58:15.377 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T11:58:15.378 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:58:15.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.378 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T11:58:15.378 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:58:15.378 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:58:15.378 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:58:15.378 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:58:15.379 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:58:15.379 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T11:58:15.379 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:58:15.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.379 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T11:58:15.379 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:58:15.380 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:58:15.380 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:58:15.380 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:58:15.380 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:58:15.380 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T11:58:15.380 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:58:15.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.381 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T11:58:15.381 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:58:15.381 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:58:15.381 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:58:15.381 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:58:15.381 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:58:15.382 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T11:58:15.382 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:58:15.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:15.382 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T11:58:15.382 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T11:58:15.382 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T11:58:15.383 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T11:58:15.383 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T11:58:15.383 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T11:58:15.383 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T11:58:15.383 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T11:58:15.384 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.384 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:58:15.384 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T11:58:15.384 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T11:58:15.384 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T11:58:15.384 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T11:58:15.385 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T11:58:15.385 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6835/4086131539": "2019-11-29T11:58:13.870150+0000", 2019-11-28T11:58:15.385 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6833/4086131539": "2019-11-29T11:58:13.870150+0000", 2019-11-28T11:58:15.385 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/4116799507": "2019-11-29T11:58:13.677877+0000", 2019-11-28T11:58:15.385 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/4116799507": "2019-11-29T11:58:13.677877+0000" 2019-11-28T11:58:15.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.386 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T11:58:15.386 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T11:58:15.386 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T11:58:15.386 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:58:15.386 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T11:58:15.386 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T11:58:15.387 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:58:15.387 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T11:58:15.387 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:58:15.387 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:58:15.387 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T11:58:15.387 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T11:58:15.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.388 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T11:58:15.388 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T11:58:15.388 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T11:58:15.388 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T11:58:15.388 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T11:58:15.388 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T11:58:15.388 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T11:58:15.389 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:15.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:15.389 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T11:58:15.389 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T11:58:15.389 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T11:58:15.389 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T11:58:15.390 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T11:58:15.390 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:58:15.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.209+0000 7f0855236700 1 -- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0828018770 msgr2=0x7f082801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:15.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.209+0000 7f0855236700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0828018770 0x7f082801abe0 crc :-1 s=READY pgs=1170 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:15.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.209+0000 7f0855236700 1 -- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08501ad2e0 msgr2=0x7f08501af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:15.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.209+0000 7f0855236700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08501ad2e0 0x7f08501af6e0 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7f08480103a0 tx=0x7f0848010740).stop 2019-11-28T11:58:15.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.210+0000 7f0855236700 1 -- 172.21.15.80:0/102412156 shutdown_connections 2019-11-28T11:58:15.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.210+0000 7f0855236700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0828018770 0x7f082801abe0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:15.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.210+0000 7f0855236700 1 --2- 172.21.15.80:0/102412156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08501ad2e0 0x7f08501af6e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:15.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.210+0000 7f0855236700 1 --2- 172.21.15.80:0/102412156 >> v2:172.21.15.174:3300/0 conn(0x7f085015d050 0x7f0850135d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:15.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.210+0000 7f0855236700 1 -- 172.21.15.80:0/102412156 shutdown_connections 2019-11-28T11:58:15.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.210+0000 7f0855236700 1 -- 172.21.15.80:0/102412156 wait complete. 2019-11-28T11:58:15.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.210+0000 7f0855236700 1 -- 172.21.15.80:0/102412156 >> 172.21.15.80:0/102412156 conn(0x7f085013b860 msgr2=0x7f08501050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:15.393 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:58:15.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.516+0000 7f963c4b8700 1 Processor -- start 2019-11-28T11:58:15.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.516+0000 7f963c4b8700 1 -- start start 2019-11-28T11:58:15.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.517+0000 7f963c4b8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f963406c0a0 0x7f9634072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:15.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.517+0000 7f963c4b8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634072620 0x7f9634164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:15.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.517+0000 7f963c4b8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963406db00 con 0x7f96340734e0 2019-11-28T11:58:15.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.517+0000 7f963c4b8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f963406fd60 con 0x7f963406c0a0 2019-11-28T11:58:15.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.517+0000 7f963c4b8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9634070030 con 0x7f9634072620 2019-11-28T11:58:15.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.517+0000 7f963aa55700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f963406c0a0 0x7f9634072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:15.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.517+0000 7f963aa55700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f963406c0a0 0x7f9634072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46686/0 (socket says 172.21.15.80:46686) 2019-11-28T11:58:15.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.517+0000 7f963aa55700 1 -- 172.21.15.80:0/1770050231 learned_addr learned my addr 172.21.15.80:0/1770050231 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:15.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.517+0000 7f963b256700 1 --2- 172.21.15.80:0/1770050231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634072620 0x7f9634164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:15.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.518+0000 7f963aa55700 1 -- 172.21.15.80:0/1770050231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634072620 msgr2=0x7f9634164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:15.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.518+0000 7f963aa55700 1 --2- 172.21.15.80:0/1770050231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634072620 0x7f9634164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:15.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.518+0000 7f963aa55700 1 -- 172.21.15.80:0/1770050231 >> v1:172.21.15.80:6789/0 conn(0x7f96340734e0 legacy=0x7f9634071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:15.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.518+0000 7f963aa55700 1 -- 172.21.15.80:0/1770050231 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96340706c0 con 0x7f963406c0a0 2019-11-28T11:58:15.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.518+0000 7f9639a53700 1 -- 172.21.15.80:0/1770050231 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889017068 0 0) 0x7f9630001480 con 0x7f96340734e0 2019-11-28T11:58:15.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.518+0000 7f963aa55700 1 --2- 172.21.15.80:0/1770050231 >> v2:172.21.15.80:3300/0 conn(0x7f963406c0a0 0x7f9634072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f962400f6c0 tx=0x7f962400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.518+0000 7f963aa55700 1 --2- 172.21.15.80:0/1770050231 >> v2:172.21.15.80:3300/0 conn(0x7f963406c0a0 0x7f9634072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f962400f6c0 tx=0x7f962400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.518+0000 7f963aa55700 1 --2- 172.21.15.80:0/1770050231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f963406c0a0 0x7f9634072fa0 secure :-1 s=READY pgs=2824 cs=0 l=1 rx=0x7f962400f6c0 tx=0x7f962400fa60).ready entity=mon.0 client_cookie=6748c6521886fbe4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:15.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.518+0000 7f963aa55700 1 --2- 172.21.15.80:0/1770050231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f963406c0a0 0x7f9634072fa0 secure :-1 s=THROTTLE_DONE pgs=2824 cs=0 l=1 rx=0x7f962400f6c0 tx=0x7f962400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.518+0000 7f9639a53700 1 -- 172.21.15.80:0/1770050231 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9624000960 con 0x7f963406c0a0 2019-11-28T11:58:15.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.518+0000 7f963aa55700 1 --2- 172.21.15.80:0/1770050231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f963406c0a0 0x7f9634072fa0 secure :-1 s=THROTTLE_DONE pgs=2824 cs=0 l=1 rx=0x7f962400f6c0 tx=0x7f962400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.518+0000 7f963aa55700 1 --2- 172.21.15.80:0/1770050231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f963406c0a0 0x7f9634072fa0 secure :-1 s=THROTTLE_DONE pgs=2824 cs=0 l=1 rx=0x7f962400f6c0 tx=0x7f962400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.518+0000 7f9639a53700 1 -- 172.21.15.80:0/1770050231 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9624000c90 con 0x7f963406c0a0 2019-11-28T11:58:15.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.518+0000 7f9639a53700 1 -- 172.21.15.80:0/1770050231 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9624000960 con 0x7f963406c0a0 2019-11-28T11:58:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.518+0000 7f963c4b8700 1 -- 172.21.15.80:0/1770050231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f963406c0a0 msgr2=0x7f9634072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.518+0000 7f963c4b8700 1 --2- 172.21.15.80:0/1770050231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f963406c0a0 0x7f9634072fa0 secure :-1 s=READY pgs=2824 cs=0 l=1 rx=0x7f962400f6c0 tx=0x7f962400fa60).stop 2019-11-28T11:58:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.519+0000 7f963c4b8700 1 -- 172.21.15.80:0/1770050231 shutdown_connections 2019-11-28T11:58:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.519+0000 7f963c4b8700 1 --2- 172.21.15.80:0/1770050231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634072620 0x7f9634164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.519+0000 7f963c4b8700 1 --2- 172.21.15.80:0/1770050231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f963406c0a0 0x7f9634072fa0 unknown :-1 s=CLOSED pgs=2824 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.519+0000 7f963c4b8700 1 -- 172.21.15.80:0/1770050231 shutdown_connections 2019-11-28T11:58:15.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.519+0000 7f963c4b8700 1 -- 172.21.15.80:0/1770050231 wait complete. 2019-11-28T11:58:15.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.519+0000 7f963c4b8700 1 -- 172.21.15.80:0/1770050231 >> 172.21.15.80:0/1770050231 conn(0x7f9634061cf0 msgr2=0x7f9634064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.521+0000 7f963c4b8700 1 Processor -- start 2019-11-28T11:58:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.521+0000 7f963c4b8700 1 -- start start 2019-11-28T11:58:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.522+0000 7f963c4b8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634159970 0x7f9634158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.522+0000 7f963c4b8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9634159e00 0x7f9634158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.522+0000 7f963c4b8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9634112260 con 0x7f963415d7c0 2019-11-28T11:58:15.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.522+0000 7f963c4b8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9634140ff0 con 0x7f9634159e00 2019-11-28T11:58:15.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.522+0000 7f963c4b8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96341412c0 con 0x7f9634159970 2019-11-28T11:58:15.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.522+0000 7f963a254700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634159970 0x7f9634158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:15.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.522+0000 7f963a254700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634159970 0x7f9634158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:48954/0 (socket says 172.21.15.80:48954) 2019-11-28T11:58:15.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.522+0000 7f963a254700 1 -- 172.21.15.80:0/975040361 learned_addr learned my addr 172.21.15.80:0/975040361 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:15.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.522+0000 7f963b256700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9634159e00 0x7f9634158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:15.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.523+0000 7f963a254700 1 -- 172.21.15.80:0/975040361 >> v2:172.21.15.174:3300/0 conn(0x7f9634159e00 msgr2=0x7f9634158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:15.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.523+0000 7f963a254700 1 --2- 172.21.15.80:0/975040361 >> v2:172.21.15.174:3300/0 conn(0x7f9634159e00 0x7f9634158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:15.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.523+0000 7f963a254700 1 -- 172.21.15.80:0/975040361 >> v1:172.21.15.174:6789/0 conn(0x7f963415d7c0 legacy=0x7f963412e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:15.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.523+0000 7f963a254700 1 -- 172.21.15.80:0/975040361 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9634141950 con 0x7f9634159970 2019-11-28T11:58:15.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.523+0000 7f963a254700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634159970 0x7f9634158950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9630010770 tx=0x7f96300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.523+0000 7f963a254700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634159970 0x7f9634158950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9630010770 tx=0x7f96300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.523+0000 7f963a254700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634159970 0x7f9634158950 secure :-1 s=READY pgs=410 cs=0 l=1 rx=0x7f9630010770 tx=0x7f96300105f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:15.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.523+0000 7f963a254700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634159970 0x7f9634158950 secure :-1 s=THROTTLE_DONE pgs=410 cs=0 l=1 rx=0x7f9630010770 tx=0x7f96300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.523+0000 7f962b7fe700 1 -- 172.21.15.80:0/975040361 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9630007960 con 0x7f9634159970 2019-11-28T11:58:15.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.523+0000 7f963a254700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634159970 0x7f9634158950 secure :-1 s=THROTTLE_DONE pgs=410 cs=0 l=1 rx=0x7f9630010770 tx=0x7f96300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.523+0000 7f963a254700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634159970 0x7f9634158950 secure :-1 s=THROTTLE_DONE pgs=410 cs=0 l=1 rx=0x7f9630010770 tx=0x7f96300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.523+0000 7f962b7fe700 1 -- 172.21.15.80:0/975040361 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96300014d0 con 0x7f9634159970 2019-11-28T11:58:15.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.523+0000 7f962b7fe700 1 -- 172.21.15.80:0/975040361 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9630001be0 con 0x7f9634159970 2019-11-28T11:58:15.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.523+0000 7f963c4b8700 1 -- 172.21.15.80:0/975040361 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9634141cd0 con 0x7f9634159970 2019-11-28T11:58:15.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.523+0000 7f963c4b8700 1 -- 172.21.15.80:0/975040361 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9634141950 con 0x7f9634159970 2019-11-28T11:58:15.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.524+0000 7f963a254700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634159970 0x7f9634158950 secure :-1 s=THROTTLE_DONE pgs=410 cs=0 l=1 rx=0x7f9630010770 tx=0x7f96300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.524+0000 7f962b7fe700 1 -- 172.21.15.80:0/975040361 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f96300016c0 con 0x7f9634159970 2019-11-28T11:58:15.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.524+0000 7f963a254700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634159970 0x7f9634158950 secure :-1 s=THROTTLE_DONE pgs=410 cs=0 l=1 rx=0x7f9630010770 tx=0x7f96300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.524+0000 7f962b7fe700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f961c018730 0x7f961c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:15.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.524+0000 7f962b7fe700 1 -- 172.21.15.80:0/975040361 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f9630031e50 con 0x7f9634159970 2019-11-28T11:58:15.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.524+0000 7f963aa55700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f961c018730 0x7f961c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:15.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.524+0000 7f963aa55700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f961c018730 0x7f961c01abc0 crc :-1 s=READY pgs=1171 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:15.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.531+0000 7f963c4b8700 1 -- 172.21.15.80:0/975040361 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9634141cd0 con 0x7f9634159970 2019-11-28T11:58:15.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.535+0000 7f963a254700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634159970 0x7f9634158950 secure :-1 s=THROTTLE_DONE pgs=410 cs=0 l=1 rx=0x7f9630010770 tx=0x7f96300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.535+0000 7f962b7fe700 1 -- 172.21.15.80:0/975040361 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9630002d60 con 0x7f9634159970 2019-11-28T11:58:15.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.707+0000 7f963c4b8700 1 -- 172.21.15.80:0/975040361 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9634141950 con 0x7f9634159970 2019-11-28T11:58:15.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.708+0000 7f963a254700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634159970 0x7f9634158950 secure :-1 s=THROTTLE_DONE pgs=410 cs=0 l=1 rx=0x7f9630010770 tx=0x7f96300105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.708+0000 7f962b7fe700 1 -- 172.21.15.80:0/975040361 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 179 v179) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f9630002d60 con 0x7f9634159970 2019-11-28T11:58:15.705 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 179 2019-11-28T11:58:15.705 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:15.705 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":179,"default_fscid":17,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":179,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:57:55.569453+0000","modified":"2019-11-28T11:58:14.859093+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":216,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[35],"metadata_pool":34,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":17}]} 2019-11-28T11:58:15.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.710+0000 7f963c4b8700 1 -- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f961c018730 msgr2=0x7f961c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:15.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.710+0000 7f963c4b8700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f961c018730 0x7f961c01abc0 crc :-1 s=READY pgs=1171 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:15.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.710+0000 7f963c4b8700 1 -- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634159970 msgr2=0x7f9634158950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:15.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.710+0000 7f963c4b8700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634159970 0x7f9634158950 secure :-1 s=READY pgs=410 cs=0 l=1 rx=0x7f9630010770 tx=0x7f96300105f0).stop 2019-11-28T11:58:15.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.710+0000 7f963c4b8700 1 -- 172.21.15.80:0/975040361 shutdown_connections 2019-11-28T11:58:15.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.710+0000 7f963c4b8700 1 --2- 172.21.15.80:0/975040361 >> v2:172.21.15.174:3300/0 conn(0x7f9634159e00 0x7f9634158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.710+0000 7f963c4b8700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9634159970 0x7f9634158950 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.710+0000 7f963c4b8700 1 --2- 172.21.15.80:0/975040361 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f961c018730 0x7f961c01abc0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.711+0000 7f963c4b8700 1 -- 172.21.15.80:0/975040361 shutdown_connections 2019-11-28T11:58:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.711+0000 7f963c4b8700 1 -- 172.21.15.80:0/975040361 wait complete. 2019-11-28T11:58:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.711+0000 7f963c4b8700 1 -- 172.21.15.80:0/975040361 >> 172.21.15.80:0/975040361 conn(0x7f963413b860 msgr2=0x7f96341050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:15.717 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T11:58:15.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.843+0000 7f5440b0c700 1 Processor -- start 2019-11-28T11:58:15.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.843+0000 7f5440b0c700 1 -- start start 2019-11-28T11:58:15.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.844+0000 7f5440b0c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f543c06c490 0x7f543c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:15.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.844+0000 7f5440b0c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f543c06ce60 0x7f543c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:15.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.844+0000 7f5440b0c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543c06db00 con 0x7f543c06c0a0 2019-11-28T11:58:15.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.844+0000 7f5440b0c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c06fd60 con 0x7f543c06ce60 2019-11-28T11:58:15.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.844+0000 7f5440b0c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c070030 con 0x7f543c06c490 2019-11-28T11:58:15.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.844+0000 7f543b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f543c06ce60 0x7f543c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:15.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.844+0000 7f543b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f543c06ce60 0x7f543c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46702/0 (socket says 172.21.15.80:46702) 2019-11-28T11:58:15.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.844+0000 7f543b59e700 1 -- 172.21.15.80:0/539747461 learned_addr learned my addr 172.21.15.80:0/539747461 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:15.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.845+0000 7f543a59c700 1 --2- 172.21.15.80:0/539747461 >> v2:172.21.15.174:3300/0 conn(0x7f543c06c490 0x7f543c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.845+0000 7f543b59e700 1 -- 172.21.15.80:0/539747461 >> v2:172.21.15.174:3300/0 conn(0x7f543c06c490 msgr2=0x7f543c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.845+0000 7f543b59e700 1 --2- 172.21.15.80:0/539747461 >> v2:172.21.15.174:3300/0 conn(0x7f543c06c490 0x7f543c06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.845+0000 7f543b59e700 1 -- 172.21.15.80:0/539747461 >> v1:172.21.15.174:6789/0 conn(0x7f543c06c0a0 legacy=0x7f543c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.845+0000 7f543b59e700 1 -- 172.21.15.80:0/539747461 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c0706c0 con 0x7f543c06ce60 2019-11-28T11:58:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.845+0000 7f543b59e700 1 --2- 172.21.15.80:0/539747461 >> v2:172.21.15.80:3300/0 conn(0x7f543c06ce60 0x7f543c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f543400f6b0 tx=0x7f543400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.845+0000 7f543b59e700 1 --2- 172.21.15.80:0/539747461 >> v2:172.21.15.80:3300/0 conn(0x7f543c06ce60 0x7f543c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f543400f6b0 tx=0x7f543400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.845+0000 7f543b59e700 1 --2- 172.21.15.80:0/539747461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f543c06ce60 0x7f543c164d70 secure :-1 s=READY pgs=2825 cs=0 l=1 rx=0x7f543400f6b0 tx=0x7f543400fa50).ready entity=mon.0 client_cookie=9be3023939c47c91 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:15.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.845+0000 7f543b59e700 1 --2- 172.21.15.80:0/539747461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f543c06ce60 0x7f543c164d70 secure :-1 s=THROTTLE_DONE pgs=2825 cs=0 l=1 rx=0x7f543400f6b0 tx=0x7f543400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.845+0000 7f543b59e700 1 --2- 172.21.15.80:0/539747461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f543c06ce60 0x7f543c164d70 secure :-1 s=THROTTLE_DONE pgs=2825 cs=0 l=1 rx=0x7f543400f6b0 tx=0x7f543400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.845+0000 7f5439d9b700 1 -- 172.21.15.80:0/539747461 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5434000a70 con 0x7f543c06ce60 2019-11-28T11:58:15.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.845+0000 7f543b59e700 1 --2- 172.21.15.80:0/539747461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f543c06ce60 0x7f543c164d70 secure :-1 s=THROTTLE_DONE pgs=2825 cs=0 l=1 rx=0x7f543400f6b0 tx=0x7f543400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.845+0000 7f5439d9b700 1 -- 172.21.15.80:0/539747461 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54340010e0 con 0x7f543c06ce60 2019-11-28T11:58:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.845+0000 7f5439d9b700 1 -- 172.21.15.80:0/539747461 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54340017b0 con 0x7f543c06ce60 2019-11-28T11:58:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.845+0000 7f5440b0c700 1 -- 172.21.15.80:0/539747461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f543c06ce60 msgr2=0x7f543c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.845+0000 7f5440b0c700 1 --2- 172.21.15.80:0/539747461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f543c06ce60 0x7f543c164d70 secure :-1 s=READY pgs=2825 cs=0 l=1 rx=0x7f543400f6b0 tx=0x7f543400fa50).stop 2019-11-28T11:58:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.846+0000 7f5440b0c700 1 -- 172.21.15.80:0/539747461 shutdown_connections 2019-11-28T11:58:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.846+0000 7f5440b0c700 1 --2- 172.21.15.80:0/539747461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f543c06ce60 0x7f543c164d70 unknown :-1 s=CLOSED pgs=2825 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.846+0000 7f5440b0c700 1 --2- 172.21.15.80:0/539747461 >> v2:172.21.15.174:3300/0 conn(0x7f543c06c490 0x7f543c06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:15.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.846+0000 7f5440b0c700 1 -- 172.21.15.80:0/539747461 shutdown_connections 2019-11-28T11:58:15.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.846+0000 7f5440b0c700 1 -- 172.21.15.80:0/539747461 wait complete. 2019-11-28T11:58:15.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.846+0000 7f5440b0c700 1 -- 172.21.15.80:0/539747461 >> 172.21.15.80:0/539747461 conn(0x7f543c061cf0 msgr2=0x7f543c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.848+0000 7f5440b0c700 1 Processor -- start 2019-11-28T11:58:15.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.849+0000 7f5440b0c700 1 -- start start 2019-11-28T11:58:15.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.849+0000 7f5440b0c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f543c13dc00 0x7f543c109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:15.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.849+0000 7f5440b0c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543c1312c0 con 0x7f543c1094e0 2019-11-28T11:58:15.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.849+0000 7f5440b0c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543c104010 con 0x7f543c10a3a0 2019-11-28T11:58:15.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.849+0000 7f5440b0c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c105830 con 0x7f543c13dc00 2019-11-28T11:58:15.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f543b59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f543c1094e0 0x7f543c167a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46026/0 (socket says 172.21.15.80:46026) 2019-11-28T11:58:15.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f543b59e700 1 -- 172.21.15.80:0/71653726 learned_addr learned my addr 172.21.15.80:0/71653726 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f543ad9d700 1 --2- 172.21.15.80:0/71653726 >> v2:172.21.15.174:3300/0 conn(0x7f543c13dc00 0x7f543c109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f54337fe700 1 -- 172.21.15.80:0/71653726 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781674477 0 0) 0x7f5434000940 con 0x7f543c1094e0 2019-11-28T11:58:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f54337fe700 1 -- 172.21.15.80:0/71653726 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5414002e80 con 0x7f543c1094e0 2019-11-28T11:58:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f54337fe700 1 -- 172.21.15.80:0/71653726 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3717098439 0 0) 0x7f5434000b60 con 0x7f543c1094e0 2019-11-28T11:58:15.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f54337fe700 1 -- 172.21.15.80:0/71653726 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f54140032e0 con 0x7f543c1094e0 2019-11-28T11:58:15.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f54337fe700 1 -- 172.21.15.80:0/71653726 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f5434007580 con 0x7f543c1094e0 2019-11-28T11:58:15.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f543ad9d700 1 -- 172.21.15.80:0/71653726 >> v1:172.21.15.174:6789/0 conn(0x7f543c10a3a0 legacy=0x7f543c108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:15.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f543ad9d700 1 -- 172.21.15.80:0/71653726 >> v1:172.21.15.80:6789/0 conn(0x7f543c1094e0 legacy=0x7f543c167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:15.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f543ad9d700 1 -- 172.21.15.80:0/71653726 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c106190 con 0x7f543c13dc00 2019-11-28T11:58:15.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f543ad9d700 1 --2- 172.21.15.80:0/71653726 >> v2:172.21.15.174:3300/0 conn(0x7f543c13dc00 0x7f543c109e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f542c0103a0 tx=0x7f542c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f543ad9d700 1 --2- 172.21.15.80:0/71653726 >> v2:172.21.15.174:3300/0 conn(0x7f543c13dc00 0x7f543c109e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f542c0103a0 tx=0x7f542c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f543ad9d700 1 --2- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f543c13dc00 0x7f543c109e60 secure :-1 s=READY pgs=1714 cs=0 l=1 rx=0x7f542c0103a0 tx=0x7f542c010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:15.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f543ad9d700 1 --2- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f543c13dc00 0x7f543c109e60 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f542c0103a0 tx=0x7f542c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f54337fe700 1 -- 172.21.15.80:0/71653726 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542c000960 con 0x7f543c13dc00 2019-11-28T11:58:15.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f543ad9d700 1 --2- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f543c13dc00 0x7f543c109e60 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f542c0103a0 tx=0x7f542c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f54337fe700 1 -- 172.21.15.80:0/71653726 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c00eef0 con 0x7f543c13dc00 2019-11-28T11:58:15.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f543ad9d700 1 --2- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f543c13dc00 0x7f543c109e60 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f542c0103a0 tx=0x7f542c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f54337fe700 1 -- 172.21.15.80:0/71653726 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542c00f0e0 con 0x7f543c13dc00 2019-11-28T11:58:15.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.850+0000 7f5440b0c700 1 -- 172.21.15.80:0/71653726 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543c106510 con 0x7f543c13dc00 2019-11-28T11:58:15.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.851+0000 7f5440b0c700 1 -- 172.21.15.80:0/71653726 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c106190 con 0x7f543c13dc00 2019-11-28T11:58:15.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.851+0000 7f543ad9d700 1 --2- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f543c13dc00 0x7f543c109e60 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f542c0103a0 tx=0x7f542c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.851+0000 7f54337fe700 1 -- 172.21.15.80:0/71653726 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f542c00f2f0 con 0x7f543c13dc00 2019-11-28T11:58:15.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.851+0000 7f543ad9d700 1 --2- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f543c13dc00 0x7f543c109e60 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f542c0103a0 tx=0x7f542c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.851+0000 7f54337fe700 1 --2- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5414018770 0x7f541401ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:15.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.851+0000 7f54337fe700 1 -- 172.21.15.80:0/71653726 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f542c031a70 con 0x7f543c13dc00 2019-11-28T11:58:15.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.852+0000 7f543a59c700 1 --2- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5414018770 0x7f541401ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:15.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.852+0000 7f543a59c700 1 --2- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5414018770 0x7f541401ac00 crc :-1 s=READY pgs=1172 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:15.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.858+0000 7f5440b0c700 1 -- 172.21.15.80:0/71653726 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543c106510 con 0x7f543c13dc00 2019-11-28T11:58:15.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.863+0000 7f543ad9d700 1 --2- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f543c13dc00 0x7f543c109e60 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f542c0103a0 tx=0x7f542c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:15.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:15.863+0000 7f54337fe700 1 -- 172.21.15.80:0/71653726 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f542c00f0e0 con 0x7f543c13dc00 2019-11-28T11:58:16.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:16.029+0000 7f5440b0c700 1 -- 172.21.15.80:0/71653726 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f543c106190 con 0x7f543c13dc00 2019-11-28T11:58:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:16.873+0000 7f543ad9d700 1 --2- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f543c13dc00 0x7f543c109e60 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f542c0103a0 tx=0x7f542c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:16.873+0000 7f54337fe700 1 -- 172.21.15.80:0/71653726 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v180) v1 ==== 161+0+0 (secure 0 0 0) 0x7f542c009580 con 0x7f543c13dc00 2019-11-28T11:58:16.890 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T11:58:16.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:16.897+0000 7f5440b0c700 1 -- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5414018770 msgr2=0x7f541401ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:16.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:16.897+0000 7f5440b0c700 1 --2- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5414018770 0x7f541401ac00 crc :-1 s=READY pgs=1172 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:16.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:16.897+0000 7f5440b0c700 1 -- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f543c13dc00 msgr2=0x7f543c109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:16.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:16.897+0000 7f5440b0c700 1 --2- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f543c13dc00 0x7f543c109e60 secure :-1 s=READY pgs=1714 cs=0 l=1 rx=0x7f542c0103a0 tx=0x7f542c010740).stop 2019-11-28T11:58:16.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:16.897+0000 7f5440b0c700 1 -- 172.21.15.80:0/71653726 shutdown_connections 2019-11-28T11:58:16.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:16.897+0000 7f5440b0c700 1 --2- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5414018770 0x7f541401ac00 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:16.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:16.897+0000 7f5440b0c700 1 --2- 172.21.15.80:0/71653726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f543c13dc00 0x7f543c109e60 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:16.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:16.897+0000 7f5440b0c700 1 -- 172.21.15.80:0/71653726 shutdown_connections 2019-11-28T11:58:16.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:16.897+0000 7f5440b0c700 1 -- 172.21.15.80:0/71653726 wait complete. 2019-11-28T11:58:16.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:16.897+0000 7f5440b0c700 1 -- 172.21.15.80:0/71653726 >> 172.21.15.80:0/71653726 conn(0x7f543c11bfc0 msgr2=0x7f543c141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:16.904 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:58:17.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.030+0000 7f1f6a875700 1 Processor -- start 2019-11-28T11:58:17.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.030+0000 7f1f6a875700 1 -- start start 2019-11-28T11:58:17.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.031+0000 7f1f6a875700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1f6406c490 0x7f1f6406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:17.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.031+0000 7f1f6a875700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1f6406ce60 0x7f1f64164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:17.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.031+0000 7f1f6a875700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6406db00 con 0x7f1f6406c0a0 2019-11-28T11:58:17.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.031+0000 7f1f6a875700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6406fd60 con 0x7f1f6406ce60 2019-11-28T11:58:17.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.031+0000 7f1f6a875700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f64070030 con 0x7f1f6406c490 2019-11-28T11:58:17.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.031+0000 7f1f69613700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1f6406ce60 0x7f1f64164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:17.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.031+0000 7f1f69613700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1f6406ce60 0x7f1f64164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46718/0 (socket says 172.21.15.80:46718) 2019-11-28T11:58:17.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.031+0000 7f1f69613700 1 -- 172.21.15.80:0/3562360289 learned_addr learned my addr 172.21.15.80:0/3562360289 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:17.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f63fff700 1 --2- 172.21.15.80:0/3562360289 >> v2:172.21.15.174:3300/0 conn(0x7f1f6406c490 0x7f1f6406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:17.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f69613700 1 -- 172.21.15.80:0/3562360289 >> v2:172.21.15.174:3300/0 conn(0x7f1f6406c490 msgr2=0x7f1f6406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:17.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f69613700 1 --2- 172.21.15.80:0/3562360289 >> v2:172.21.15.174:3300/0 conn(0x7f1f6406c490 0x7f1f6406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:17.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f69613700 1 -- 172.21.15.80:0/3562360289 >> v1:172.21.15.174:6789/0 conn(0x7f1f6406c0a0 legacy=0x7f1f64072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:17.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f69613700 1 -- 172.21.15.80:0/3562360289 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f640706c0 con 0x7f1f6406ce60 2019-11-28T11:58:17.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f63fff700 1 --2- 172.21.15.80:0/3562360289 >> v2:172.21.15.174:3300/0 conn(0x7f1f6406c490 0x7f1f6406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:58:17.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f69613700 1 --2- 172.21.15.80:0/3562360289 >> v2:172.21.15.80:3300/0 conn(0x7f1f6406ce60 0x7f1f64164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1f5c00f730 tx=0x7f1f5c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f69613700 1 --2- 172.21.15.80:0/3562360289 >> v2:172.21.15.80:3300/0 conn(0x7f1f6406ce60 0x7f1f64164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1f5c00f730 tx=0x7f1f5c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f69613700 1 --2- 172.21.15.80:0/3562360289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f6406ce60 0x7f1f64164d70 secure :-1 s=READY pgs=2827 cs=0 l=1 rx=0x7f1f5c00f730 tx=0x7f1f5c00fad0).ready entity=mon.0 client_cookie=bf96df2995d1d1db server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:17.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f69613700 1 --2- 172.21.15.80:0/3562360289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f6406ce60 0x7f1f64164d70 secure :-1 s=THROTTLE_DONE pgs=2827 cs=0 l=1 rx=0x7f1f5c00f730 tx=0x7f1f5c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f637fe700 1 -- 172.21.15.80:0/3562360289 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f5c000b90 con 0x7f1f6406ce60 2019-11-28T11:58:17.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f69613700 1 --2- 172.21.15.80:0/3562360289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f6406ce60 0x7f1f64164d70 secure :-1 s=THROTTLE_DONE pgs=2827 cs=0 l=1 rx=0x7f1f5c00f730 tx=0x7f1f5c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f69613700 1 --2- 172.21.15.80:0/3562360289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f6406ce60 0x7f1f64164d70 secure :-1 s=THROTTLE_DONE pgs=2827 cs=0 l=1 rx=0x7f1f5c00f730 tx=0x7f1f5c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f637fe700 1 -- 172.21.15.80:0/3562360289 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c0010e0 con 0x7f1f6406ce60 2019-11-28T11:58:17.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f637fe700 1 -- 172.21.15.80:0/3562360289 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f5c001830 con 0x7f1f6406ce60 2019-11-28T11:58:17.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f6a875700 1 -- 172.21.15.80:0/3562360289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f6406ce60 msgr2=0x7f1f64164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:17.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.032+0000 7f1f6a875700 1 --2- 172.21.15.80:0/3562360289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f6406ce60 0x7f1f64164d70 secure :-1 s=READY pgs=2827 cs=0 l=1 rx=0x7f1f5c00f730 tx=0x7f1f5c00fad0).stop 2019-11-28T11:58:17.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.033+0000 7f1f6a875700 1 -- 172.21.15.80:0/3562360289 shutdown_connections 2019-11-28T11:58:17.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.033+0000 7f1f6a875700 1 --2- 172.21.15.80:0/3562360289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f6406ce60 0x7f1f64164d70 unknown :-1 s=CLOSED pgs=2827 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:17.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.033+0000 7f1f6a875700 1 --2- 172.21.15.80:0/3562360289 >> v2:172.21.15.174:3300/0 conn(0x7f1f6406c490 0x7f1f6406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:17.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.033+0000 7f1f6a875700 1 -- 172.21.15.80:0/3562360289 shutdown_connections 2019-11-28T11:58:17.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.033+0000 7f1f6a875700 1 -- 172.21.15.80:0/3562360289 wait complete. 2019-11-28T11:58:17.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.033+0000 7f1f6a875700 1 -- 172.21.15.80:0/3562360289 >> 172.21.15.80:0/3562360289 conn(0x7f1f64061cf0 msgr2=0x7f1f64064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:17.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.035+0000 7f1f6a875700 1 Processor -- start 2019-11-28T11:58:17.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.035+0000 7f1f6a875700 1 -- start start 2019-11-28T11:58:17.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.036+0000 7f1f6a875700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f64109e40 0x7f1f6410a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:17.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.036+0000 7f1f6a875700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1f6410a810 0x7f1f64105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:17.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.036+0000 7f1f6a875700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6413f1e0 con 0x7f1f6413eb40 2019-11-28T11:58:17.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.036+0000 7f1f6a875700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f641234c0 con 0x7f1f6410a810 2019-11-28T11:58:17.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.036+0000 7f1f6a875700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6413e0d0 con 0x7f1f64109e40 2019-11-28T11:58:17.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.036+0000 7f1f68e12700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1f6413eb40 0x7f1f6410afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46036/0 (socket says 172.21.15.80:46036) 2019-11-28T11:58:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.036+0000 7f1f68e12700 1 -- 172.21.15.80:0/1455608916 learned_addr learned my addr 172.21.15.80:0/1455608916 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.036+0000 7f1f69613700 1 --2- 172.21.15.80:0/1455608916 >> v2:172.21.15.174:3300/0 conn(0x7f1f6410a810 0x7f1f64105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.036+0000 7f1f63fff700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f64109e40 0x7f1f6410a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.036+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064213196 0 0) 0x7f1f4c001150 con 0x7f1f6413eb40 2019-11-28T11:58:17.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f48002e80 con 0x7f1f6413eb40 2019-11-28T11:58:17.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3017477863 0 0) 0x7f1f4c0012c0 con 0x7f1f6413eb40 2019-11-28T11:58:17.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1f480032e0 con 0x7f1f6413eb40 2019-11-28T11:58:17.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f1f4c001890 con 0x7f1f6413eb40 2019-11-28T11:58:17.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f64109e40 msgr2=0x7f1f6410a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:17.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f617fa700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f64109e40 0x7f1f6410a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 >> v2:172.21.15.174:3300/0 conn(0x7f1f6410a810 msgr2=0x7f1f64105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f617fa700 1 --2- 172.21.15.80:0/1455608916 >> v2:172.21.15.174:3300/0 conn(0x7f1f6410a810 0x7f1f64105210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 >> v1:172.21.15.80:6789/0 conn(0x7f1f6413eb40 legacy=0x7f1f6410afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f617fa700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f480033f0 0x7f1f48003840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f617fa700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f48003d80 0x7f1f48004240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f617fa700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f48004940 0x7f1f48004e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4800bc50 con 0x7f1f48003d80 2019-11-28T11:58:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4800be80 con 0x7f1f48004940 2019-11-28T11:58:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4800c0b0 con 0x7f1f480033f0 2019-11-28T11:58:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f63fff700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f64109e40 0x7f1f6410a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f69613700 1 --2- 172.21.15.80:0/1455608916 >> v2:172.21.15.174:3300/0 conn(0x7f1f6410a810 0x7f1f64105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f63fff700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f48003d80 0x7f1f48004240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f68e12700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f480033f0 0x7f1f48003840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f69613700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f48004940 0x7f1f48004e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f63fff700 1 -- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f480033f0 msgr2=0x7f1f48003840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f63fff700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f480033f0 0x7f1f48003840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f63fff700 1 -- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f48004940 msgr2=0x7f1f48004e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f63fff700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f48004940 0x7f1f48004e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f63fff700 1 -- 172.21.15.80:0/1455608916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4800c360 con 0x7f1f48003d80 2019-11-28T11:58:17.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f6a875700 1 -- 172.21.15.80:0/1455608916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f64108a80 con 0x7f1f48003d80 2019-11-28T11:58:17.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f63fff700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f48003d80 0x7f1f48004240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f540106f0 tx=0x7f1f540105a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f6a875700 1 -- 172.21.15.80:0/1455608916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f64108700 con 0x7f1f48003d80 2019-11-28T11:58:17.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f63fff700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f48003d80 0x7f1f48004240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f540106f0 tx=0x7f1f540105a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.037+0000 7f1f63fff700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f48003d80 0x7f1f48004240 secure :-1 s=READY pgs=2829 cs=0 l=1 rx=0x7f1f540106f0 tx=0x7f1f540105a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:17.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.038+0000 7f1f63fff700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f48003d80 0x7f1f48004240 secure :-1 s=THROTTLE_DONE pgs=2829 cs=0 l=1 rx=0x7f1f540106f0 tx=0x7f1f540105a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.038+0000 7f1f63fff700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f48003d80 0x7f1f48004240 secure :-1 s=THROTTLE_DONE pgs=2829 cs=0 l=1 rx=0x7f1f540106f0 tx=0x7f1f540105a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.038+0000 7f1f63fff700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f48003d80 0x7f1f48004240 secure :-1 s=THROTTLE_DONE pgs=2829 cs=0 l=1 rx=0x7f1f540106f0 tx=0x7f1f540105a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.038+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f54001600 con 0x7f1f48003d80 2019-11-28T11:58:17.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.038+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f54001220 con 0x7f1f48003d80 2019-11-28T11:58:17.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.038+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f54001be0 con 0x7f1f48003d80 2019-11-28T11:58:17.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.038+0000 7f1f63fff700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f48003d80 0x7f1f48004240 secure :-1 s=THROTTLE_DONE pgs=2829 cs=0 l=1 rx=0x7f1f540106f0 tx=0x7f1f540105a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.038+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1f54001410 con 0x7f1f48003d80 2019-11-28T11:58:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.038+0000 7f1f63fff700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f48003d80 0x7f1f48004240 secure :-1 s=THROTTLE_DONE pgs=2829 cs=0 l=1 rx=0x7f1f540106f0 tx=0x7f1f540105a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.038+0000 7f1f617fa700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f48020ad0 0x7f1f48022f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.038+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f1f54031f40 con 0x7f1f48003d80 2019-11-28T11:58:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.038+0000 7f1f68e12700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f48020ad0 0x7f1f48022f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.039+0000 7f1f68e12700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f48020ad0 0x7f1f48022f20 crc :-1 s=READY pgs=1173 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:17.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.045+0000 7f1f6a875700 1 -- 172.21.15.80:0/1455608916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3c002e60 con 0x7f1f48003d80 2019-11-28T11:58:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.049+0000 7f1f63fff700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f48003d80 0x7f1f48004240 secure :-1 s=THROTTLE_DONE pgs=2829 cs=0 l=1 rx=0x7f1f540106f0 tx=0x7f1f540105a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.049+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1f54001010 con 0x7f1f48003d80 2019-11-28T11:58:17.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.219+0000 7f1f6a875700 1 -- 172.21.15.80:0/1455608916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f3c001d10 con 0x7f1f48003d80 2019-11-28T11:58:17.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.220+0000 7f1f63fff700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f48003d80 0x7f1f48004240 secure :-1 s=THROTTLE_DONE pgs=2829 cs=0 l=1 rx=0x7f1f540106f0 tx=0x7f1f540105a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.220+0000 7f1f617fa700 1 -- 172.21.15.80:0/1455608916 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 180 v180) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f1f54001de0 con 0x7f1f48003d80 2019-11-28T11:58:17.217 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 180 2019-11-28T11:58:17.217 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:17.217 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":180,"default_fscid":17,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":180,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:57:55.569453+0000","modified":"2019-11-28T11:58:16.868447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":216,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[35],"metadata_pool":34,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":17}]} 2019-11-28T11:58:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.222+0000 7f1f6a875700 1 -- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f48020ad0 msgr2=0x7f1f48022f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.222+0000 7f1f6a875700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1f48020ad0 0x7f1f48022f20 crc :-1 s=READY pgs=1173 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.222+0000 7f1f6a875700 1 -- 172.21.15.80:0/1455608916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f48003d80 msgr2=0x7f1f48004240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.222+0000 7f1f6a875700 1 --2- 172.21.15.80:0/1455608916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f48003d80 0x7f1f48004240 secure :-1 s=READY pgs=2829 cs=0 l=1 rx=0x7f1f540106f0 tx=0x7f1f540105a0).stop 2019-11-28T11:58:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.222+0000 7f1f69613700 1 -- 172.21.15.80:0/1455608916 reap_dead start 2019-11-28T11:58:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.222+0000 7f1f69613700 1 -- 172.21.15.80:0/1455608916 reap_dead start 2019-11-28T11:58:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.223+0000 7f1f6a875700 1 -- 172.21.15.80:0/1455608916 shutdown_connections 2019-11-28T11:58:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.223+0000 7f1f6a875700 1 -- 172.21.15.80:0/1455608916 shutdown_connections 2019-11-28T11:58:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.223+0000 7f1f6a875700 1 -- 172.21.15.80:0/1455608916 wait complete. 2019-11-28T11:58:17.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.223+0000 7f1f6a875700 1 -- 172.21.15.80:0/1455608916 >> 172.21.15.80:0/1455608916 conn(0x7f1f6411bfc0 msgr2=0x7f1f64141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:17.229 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T11:58:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.360+0000 7efca4785700 1 Processor -- start 2019-11-28T11:58:17.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.360+0000 7efca4785700 1 -- start start 2019-11-28T11:58:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca4785700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc9c06c490 0x7efc9c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca4785700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc9c06ce60 0x7efc9c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca4785700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9c06db00 con 0x7efc9c06c0a0 2019-11-28T11:58:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca4785700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9c06fd60 con 0x7efc9c06ce60 2019-11-28T11:58:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca4785700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c070030 con 0x7efc9c06c490 2019-11-28T11:58:17.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca3523700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc9c06ce60 0x7efc9c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca2d22700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efc9c06c0a0 0x7efc9c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46050/0 (socket says 172.21.15.80:46050) 2019-11-28T11:58:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca3523700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc9c06ce60 0x7efc9c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46736/0 (socket says 172.21.15.80:46736) 2019-11-28T11:58:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca3523700 1 -- 172.21.15.80:0/1789967367 learned_addr learned my addr 172.21.15.80:0/1789967367 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca2521700 1 --2- 172.21.15.80:0/1789967367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc9c06c490 0x7efc9c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca3523700 1 -- 172.21.15.80:0/1789967367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc9c06c490 msgr2=0x7efc9c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:17.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca3523700 1 --2- 172.21.15.80:0/1789967367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc9c06c490 0x7efc9c06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca3523700 1 -- 172.21.15.80:0/1789967367 >> v1:172.21.15.80:6789/0 conn(0x7efc9c06c0a0 legacy=0x7efc9c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:17.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca3523700 1 -- 172.21.15.80:0/1789967367 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c0706c0 con 0x7efc9c06ce60 2019-11-28T11:58:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca1d20700 1 -- 172.21.15.80:0/1789967367 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634503485 0 0) 0x7efc8c001100 con 0x7efc9c06c0a0 2019-11-28T11:58:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca3523700 1 --2- 172.21.15.80:0/1789967367 >> v2:172.21.15.80:3300/0 conn(0x7efc9c06ce60 0x7efc9c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efc9400f6b0 tx=0x7efc9400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca3523700 1 --2- 172.21.15.80:0/1789967367 >> v2:172.21.15.80:3300/0 conn(0x7efc9c06ce60 0x7efc9c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efc9400f6b0 tx=0x7efc9400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.361+0000 7efca3523700 1 --2- 172.21.15.80:0/1789967367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c06ce60 0x7efc9c164d70 secure :-1 s=READY pgs=2831 cs=0 l=1 rx=0x7efc9400f6b0 tx=0x7efc9400fa50).ready entity=mon.0 client_cookie=b803f431b71cf666 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:17.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.362+0000 7efca3523700 1 --2- 172.21.15.80:0/1789967367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c06ce60 0x7efc9c164d70 secure :-1 s=THROTTLE_DONE pgs=2831 cs=0 l=1 rx=0x7efc9400f6b0 tx=0x7efc9400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.362+0000 7efca1d20700 1 -- 172.21.15.80:0/1789967367 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc94000a70 con 0x7efc9c06ce60 2019-11-28T11:58:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.362+0000 7efca3523700 1 --2- 172.21.15.80:0/1789967367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c06ce60 0x7efc9c164d70 secure :-1 s=THROTTLE_DONE pgs=2831 cs=0 l=1 rx=0x7efc9400f6b0 tx=0x7efc9400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.362+0000 7efca1d20700 1 -- 172.21.15.80:0/1789967367 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc94000960 con 0x7efc9c06ce60 2019-11-28T11:58:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.362+0000 7efca3523700 1 --2- 172.21.15.80:0/1789967367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c06ce60 0x7efc9c164d70 secure :-1 s=THROTTLE_DONE pgs=2831 cs=0 l=1 rx=0x7efc9400f6b0 tx=0x7efc9400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.362+0000 7efca1d20700 1 -- 172.21.15.80:0/1789967367 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc94000b50 con 0x7efc9c06ce60 2019-11-28T11:58:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.362+0000 7efca4785700 1 -- 172.21.15.80:0/1789967367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c06ce60 msgr2=0x7efc9c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:17.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.362+0000 7efca4785700 1 --2- 172.21.15.80:0/1789967367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c06ce60 0x7efc9c164d70 secure :-1 s=READY pgs=2831 cs=0 l=1 rx=0x7efc9400f6b0 tx=0x7efc9400fa50).stop 2019-11-28T11:58:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.362+0000 7efca4785700 1 -- 172.21.15.80:0/1789967367 shutdown_connections 2019-11-28T11:58:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.362+0000 7efca4785700 1 --2- 172.21.15.80:0/1789967367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c06ce60 0x7efc9c164d70 unknown :-1 s=CLOSED pgs=2831 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.362+0000 7efca4785700 1 --2- 172.21.15.80:0/1789967367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc9c06c490 0x7efc9c06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.362+0000 7efca4785700 1 -- 172.21.15.80:0/1789967367 shutdown_connections 2019-11-28T11:58:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.362+0000 7efca4785700 1 -- 172.21.15.80:0/1789967367 wait complete. 2019-11-28T11:58:17.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.362+0000 7efca4785700 1 -- 172.21.15.80:0/1789967367 >> 172.21.15.80:0/1789967367 conn(0x7efc9c061cf0 msgr2=0x7efc9c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.365+0000 7efca4785700 1 Processor -- start 2019-11-28T11:58:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.365+0000 7efca4785700 1 -- start start 2019-11-28T11:58:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca4785700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc9c13e320 0x7efc9c13e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:17.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca4785700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc9c12a3c0 0x7efc9c12a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca4785700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9c139e00 con 0x7efc9c15fdf0 2019-11-28T11:58:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca4785700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9c108820 con 0x7efc9c13e320 2019-11-28T11:58:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca4785700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c108af0 con 0x7efc9c12a3c0 2019-11-28T11:58:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca2521700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc9c13e320 0x7efc9c13e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:17.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca2521700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efc9c13e320 0x7efc9c13e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46742/0 (socket says 172.21.15.80:46742) 2019-11-28T11:58:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca2521700 1 -- 172.21.15.80:0/1608404582 learned_addr learned my addr 172.21.15.80:0/1608404582 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:17.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca3523700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc9c12a3c0 0x7efc9c12a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca2521700 1 -- 172.21.15.80:0/1608404582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc9c12a3c0 msgr2=0x7efc9c12a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca2521700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc9c12a3c0 0x7efc9c12a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca2521700 1 -- 172.21.15.80:0/1608404582 >> v1:172.21.15.80:6789/0 conn(0x7efc9c15fdf0 legacy=0x7efc9c12b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:17.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca2521700 1 -- 172.21.15.80:0/1608404582 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c10a8c0 con 0x7efc9c13e320 2019-11-28T11:58:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca2521700 1 --2- 172.21.15.80:0/1608404582 >> v2:172.21.15.80:3300/0 conn(0x7efc9c13e320 0x7efc9c13e7b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc840107d0 tx=0x7efc84010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca2521700 1 --2- 172.21.15.80:0/1608404582 >> v2:172.21.15.80:3300/0 conn(0x7efc9c13e320 0x7efc9c13e7b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc840107d0 tx=0x7efc84010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca2521700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c13e320 0x7efc9c13e7b0 secure :-1 s=READY pgs=2833 cs=0 l=1 rx=0x7efc840107d0 tx=0x7efc84010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca2521700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c13e320 0x7efc9c13e7b0 secure :-1 s=THROTTLE_DONE pgs=2833 cs=0 l=1 rx=0x7efc840107d0 tx=0x7efc84010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efc9b7fe700 1 -- 172.21.15.80:0/1608404582 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc84000cc0 con 0x7efc9c13e320 2019-11-28T11:58:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca2521700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c13e320 0x7efc9c13e7b0 secure :-1 s=THROTTLE_DONE pgs=2833 cs=0 l=1 rx=0x7efc840107d0 tx=0x7efc84010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efc9b7fe700 1 -- 172.21.15.80:0/1608404582 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc84001200 con 0x7efc9c13e320 2019-11-28T11:58:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca2521700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c13e320 0x7efc9c13e7b0 secure :-1 s=THROTTLE_DONE pgs=2833 cs=0 l=1 rx=0x7efc840107d0 tx=0x7efc84010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efc9b7fe700 1 -- 172.21.15.80:0/1608404582 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc840013f0 con 0x7efc9c13e320 2019-11-28T11:58:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca4785700 1 -- 172.21.15.80:0/1608404582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9c10a8c0 con 0x7efc9c13e320 2019-11-28T11:58:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.366+0000 7efca4785700 1 -- 172.21.15.80:0/1608404582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9c10a8c0 con 0x7efc9c13e320 2019-11-28T11:58:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.367+0000 7efca2521700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c13e320 0x7efc9c13e7b0 secure :-1 s=THROTTLE_DONE pgs=2833 cs=0 l=1 rx=0x7efc840107d0 tx=0x7efc84010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.367+0000 7efc9b7fe700 1 -- 172.21.15.80:0/1608404582 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efc840013f0 con 0x7efc9c13e320 2019-11-28T11:58:17.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.367+0000 7efca2521700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c13e320 0x7efc9c13e7b0 secure :-1 s=THROTTLE_DONE pgs=2833 cs=0 l=1 rx=0x7efc840107d0 tx=0x7efc84010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.367+0000 7efc9b7fe700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc80018730 0x7efc8001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.367+0000 7efc9b7fe700 1 -- 172.21.15.80:0/1608404582 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6192+0+0 (secure 0 0 0) 0x7efc84031e30 con 0x7efc9c13e320 2019-11-28T11:58:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.367+0000 7efca2d22700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc80018730 0x7efc8001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:17.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.368+0000 7efca2d22700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc80018730 0x7efc8001abc0 crc :-1 s=READY pgs=1174 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.375+0000 7efca4785700 1 -- 172.21.15.80:0/1608404582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9c109180 con 0x7efc9c13e320 2019-11-28T11:58:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.379+0000 7efca2521700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c13e320 0x7efc9c13e7b0 secure :-1 s=THROTTLE_DONE pgs=2833 cs=0 l=1 rx=0x7efc840107d0 tx=0x7efc84010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.379+0000 7efc9b7fe700 1 -- 172.21.15.80:0/1608404582 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efc840095d0 con 0x7efc9c13e320 2019-11-28T11:58:17.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.554+0000 7efca4785700 1 -- 172.21.15.80:0/1608404582 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efc9c109500 con 0x7efc9c13e320 2019-11-28T11:58:17.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.874+0000 7efca2521700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c13e320 0x7efc9c13e7b0 secure :-1 s=THROTTLE_DONE pgs=2833 cs=0 l=1 rx=0x7efc840107d0 tx=0x7efc84010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:17.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.874+0000 7efc9b7fe700 1 -- 172.21.15.80:0/1608404582 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v181) v1 ==== 104+0+0 (secure 0 0 0) 0x7efc840013f0 con 0x7efc9c13e320 2019-11-28T11:58:17.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.921+0000 7efca4785700 1 -- 172.21.15.80:0/1608404582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc80018730 msgr2=0x7efc8001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:17.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.921+0000 7efca4785700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc80018730 0x7efc8001abc0 crc :-1 s=READY pgs=1174 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:17.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.921+0000 7efca4785700 1 -- 172.21.15.80:0/1608404582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c13e320 msgr2=0x7efc9c13e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:17.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.921+0000 7efca4785700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c13e320 0x7efc9c13e7b0 secure :-1 s=READY pgs=2833 cs=0 l=1 rx=0x7efc840107d0 tx=0x7efc84010600).stop 2019-11-28T11:58:17.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.921+0000 7efca4785700 1 -- 172.21.15.80:0/1608404582 shutdown_connections 2019-11-28T11:58:17.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.921+0000 7efca4785700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efc80018730 0x7efc8001abc0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:17.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.921+0000 7efca4785700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efc9c12a3c0 0x7efc9c12a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:17.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.921+0000 7efca4785700 1 --2- 172.21.15.80:0/1608404582 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc9c13e320 0x7efc9c13e7b0 unknown :-1 s=CLOSED pgs=2833 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:17.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.921+0000 7efca4785700 1 -- 172.21.15.80:0/1608404582 shutdown_connections 2019-11-28T11:58:17.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.921+0000 7efca4785700 1 -- 172.21.15.80:0/1608404582 wait complete. 2019-11-28T11:58:17.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:17.921+0000 7efca4785700 1 -- 172.21.15.80:0/1608404582 >> 172.21.15.80:0/1608404582 conn(0x7efc9c127dc0 msgr2=0x7efc9c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:17.927 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T11:58:18.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.061+0000 7fea30786700 1 Processor -- start 2019-11-28T11:58:18.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.061+0000 7fea30786700 1 -- start start 2019-11-28T11:58:18.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea30786700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fea2815ed10 0x7fea2815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:18.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea30786700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea28073020 0x7fea28071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:18.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea30786700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2806db60 con 0x7fea280734b0 2019-11-28T11:58:18.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea30786700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea2806fe00 con 0x7fea2815ed10 2019-11-28T11:58:18.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea30786700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea280700d0 con 0x7fea28073020 2019-11-28T11:58:18.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2f524700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fea280734b0 0x7fea280723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46066/0 (socket says 172.21.15.80:46066) 2019-11-28T11:58:18.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2f524700 1 -- 172.21.15.80:0/3646659012 learned_addr learned my addr 172.21.15.80:0/3646659012 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:18.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2e522700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea28073020 0x7fea28071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:18.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2ed23700 1 --2- 172.21.15.80:0/3646659012 >> v2:172.21.15.174:3300/0 conn(0x7fea2815ed10 0x7fea2815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:18.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2dd21700 1 -- 172.21.15.80:0/3646659012 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194107589 0 0) 0x7fea20001150 con 0x7fea280734b0 2019-11-28T11:58:18.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2dd21700 1 -- 172.21.15.80:0/3646659012 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea14002e80 con 0x7fea280734b0 2019-11-28T11:58:18.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2dd21700 1 -- 172.21.15.80:0/3646659012 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 60367281 0 0) 0x7fea20001130 con 0x7fea280734b0 2019-11-28T11:58:18.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2dd21700 1 -- 172.21.15.80:0/3646659012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea28073020 msgr2=0x7fea28071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:18.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2dd21700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea28073020 0x7fea28071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:18.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2dd21700 1 -- 172.21.15.80:0/3646659012 >> v2:172.21.15.174:3300/0 conn(0x7fea2815ed10 msgr2=0x7fea2815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:18.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2dd21700 1 --2- 172.21.15.80:0/3646659012 >> v2:172.21.15.174:3300/0 conn(0x7fea2815ed10 0x7fea2815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:18.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2dd21700 1 -- 172.21.15.80:0/3646659012 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea28070760 con 0x7fea280734b0 2019-11-28T11:58:18.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2dd21700 1 -- 172.21.15.80:0/3646659012 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fea20001660 con 0x7fea280734b0 2019-11-28T11:58:18.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2ed23700 1 --2- 172.21.15.80:0/3646659012 >> v2:172.21.15.174:3300/0 conn(0x7fea2815ed10 0x7fea2815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:18.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2dd21700 1 -- 172.21.15.80:0/3646659012 >> v1:172.21.15.80:6789/0 conn(0x7fea280734b0 legacy=0x7fea280723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:18.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2dd21700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea140479e0 0x7fea14049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:18.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2dd21700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea1404a5c0 0x7fea1404ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:18.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2dd21700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea1404d2f0 0x7fea1404f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:18.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2dd21700 1 -- 172.21.15.80:0/3646659012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1404ff40 con 0x7fea1404a5c0 2019-11-28T11:58:18.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.063+0000 7fea2dd21700 1 -- 172.21.15.80:0/3646659012 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea14050130 con 0x7fea140479e0 2019-11-28T11:58:18.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2dd21700 1 -- 172.21.15.80:0/3646659012 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea14050360 con 0x7fea1404d2f0 2019-11-28T11:58:18.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2e522700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea1404a5c0 0x7fea1404ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:18.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2ed23700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea140479e0 0x7fea14049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:18.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2f524700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea1404d2f0 0x7fea1404f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:18.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2e522700 1 -- 172.21.15.80:0/3646659012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea1404d2f0 msgr2=0x7fea1404f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:18.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2e522700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea1404d2f0 0x7fea1404f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:18.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2e522700 1 -- 172.21.15.80:0/3646659012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea140479e0 msgr2=0x7fea14049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:18.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2e522700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea140479e0 0x7fea14049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:18.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2e522700 1 -- 172.21.15.80:0/3646659012 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea14050610 con 0x7fea1404a5c0 2019-11-28T11:58:18.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2e522700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea1404a5c0 0x7fea1404ca90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fea1800f630 tx=0x7fea18002bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:18.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2e522700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea1404a5c0 0x7fea1404ca90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fea1800f630 tx=0x7fea18002bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:18.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2e522700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea1404a5c0 0x7fea1404ca90 secure :-1 s=READY pgs=2835 cs=0 l=1 rx=0x7fea1800f630 tx=0x7fea18002bf0).ready entity=mon.0 client_cookie=cd5d9c7e44271990 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:18.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2e522700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea1404a5c0 0x7fea1404ca90 secure :-1 s=THROTTLE_DONE pgs=2835 cs=0 l=1 rx=0x7fea1800f630 tx=0x7fea18002bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:18.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2e522700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea1404a5c0 0x7fea1404ca90 secure :-1 s=THROTTLE_DONE pgs=2835 cs=0 l=1 rx=0x7fea1800f630 tx=0x7fea18002bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:18.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2dd21700 1 -- 172.21.15.80:0/3646659012 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea18000960 con 0x7fea1404a5c0 2019-11-28T11:58:18.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2e522700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea1404a5c0 0x7fea1404ca90 secure :-1 s=THROTTLE_DONE pgs=2835 cs=0 l=1 rx=0x7fea1800f630 tx=0x7fea18002bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:18.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2dd21700 1 -- 172.21.15.80:0/3646659012 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea18000e80 con 0x7fea1404a5c0 2019-11-28T11:58:18.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2dd21700 1 -- 172.21.15.80:0/3646659012 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea18001510 con 0x7fea1404a5c0 2019-11-28T11:58:18.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea30786700 1 -- 172.21.15.80:0/3646659012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea1404a5c0 msgr2=0x7fea1404ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:18.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea30786700 1 --2- 172.21.15.80:0/3646659012 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea1404a5c0 0x7fea1404ca90 secure :-1 s=READY pgs=2835 cs=0 l=1 rx=0x7fea1800f630 tx=0x7fea18002bf0).stop 2019-11-28T11:58:18.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.064+0000 7fea2f524700 1 -- 172.21.15.80:0/3646659012 reap_dead start 2019-11-28T11:58:18.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.065+0000 7fea30786700 1 -- 172.21.15.80:0/3646659012 shutdown_connections 2019-11-28T11:58:18.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.065+0000 7fea30786700 1 -- 172.21.15.80:0/3646659012 shutdown_connections 2019-11-28T11:58:18.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.065+0000 7fea30786700 1 -- 172.21.15.80:0/3646659012 wait complete. 2019-11-28T11:58:18.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.065+0000 7fea30786700 1 -- 172.21.15.80:0/3646659012 >> 172.21.15.80:0/3646659012 conn(0x7fea28061d20 msgr2=0x7fea280641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:18.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.067+0000 7fea30786700 1 Processor -- start 2019-11-28T11:58:18.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.067+0000 7fea30786700 1 -- start start 2019-11-28T11:58:18.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.068+0000 7fea30786700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fea28167d80 0x7fea2816a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:18.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.068+0000 7fea30786700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2810a310 con 0x7fea2812c2a0 2019-11-28T11:58:18.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.068+0000 7fea30786700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea28109e50 con 0x7fea28108630 2019-11-28T11:58:18.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.068+0000 7fea30786700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea2812ee80 con 0x7fea28167d80 2019-11-28T11:58:18.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.068+0000 7fea2e522700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fea2812c2a0 0x7fea2812c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46078/0 (socket says 172.21.15.80:46078) 2019-11-28T11:58:18.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.068+0000 7fea2e522700 1 -- 172.21.15.80:0/780828729 learned_addr learned my addr 172.21.15.80:0/780828729 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:18.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.068+0000 7fea2f524700 1 --2- 172.21.15.80:0/780828729 >> v2:172.21.15.174:3300/0 conn(0x7fea28167d80 0x7fea2816a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:18.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea277fe700 1 -- 172.21.15.80:0/780828729 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229440185 0 0) 0x7fea18000940 con 0x7fea2812c2a0 2019-11-28T11:58:18.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea277fe700 1 -- 172.21.15.80:0/780828729 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea0c002e80 con 0x7fea2812c2a0 2019-11-28T11:58:18.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea277fe700 1 -- 172.21.15.80:0/780828729 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661647333 0 0) 0x7fea10001010 con 0x7fea28108630 2019-11-28T11:58:18.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea2f524700 1 -- 172.21.15.80:0/780828729 >> v1:172.21.15.174:6789/0 conn(0x7fea28108630 legacy=0x7fea28152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:18.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea2f524700 1 -- 172.21.15.80:0/780828729 >> v1:172.21.15.80:6789/0 conn(0x7fea2812c2a0 legacy=0x7fea2812c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:18.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea2f524700 1 -- 172.21.15.80:0/780828729 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea28133350 con 0x7fea28167d80 2019-11-28T11:58:18.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea2f524700 1 --2- 172.21.15.80:0/780828729 >> v2:172.21.15.174:3300/0 conn(0x7fea28167d80 0x7fea2816a180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fea20010370 tx=0x7fea20010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:18.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea2f524700 1 --2- 172.21.15.80:0/780828729 >> v2:172.21.15.174:3300/0 conn(0x7fea28167d80 0x7fea2816a180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fea20010370 tx=0x7fea20010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:18.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea2f524700 1 --2- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea28167d80 0x7fea2816a180 secure :-1 s=READY pgs=1717 cs=0 l=1 rx=0x7fea20010370 tx=0x7fea20010710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:18.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea2f524700 1 --2- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea28167d80 0x7fea2816a180 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7fea20010370 tx=0x7fea20010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:18.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea277fe700 1 -- 172.21.15.80:0/780828729 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea20000af0 con 0x7fea28167d80 2019-11-28T11:58:18.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea2f524700 1 --2- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea28167d80 0x7fea2816a180 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7fea20010370 tx=0x7fea20010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:18.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea2f524700 1 --2- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea28167d80 0x7fea2816a180 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7fea20010370 tx=0x7fea20010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:18.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea277fe700 1 -- 172.21.15.80:0/780828729 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea20004240 con 0x7fea28167d80 2019-11-28T11:58:18.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea277fe700 1 -- 172.21.15.80:0/780828729 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea20004910 con 0x7fea28167d80 2019-11-28T11:58:18.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea30786700 1 -- 172.21.15.80:0/780828729 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea281336d0 con 0x7fea28167d80 2019-11-28T11:58:18.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.069+0000 7fea30786700 1 -- 172.21.15.80:0/780828729 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea28133350 con 0x7fea28167d80 2019-11-28T11:58:18.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.070+0000 7fea2f524700 1 --2- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea28167d80 0x7fea2816a180 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7fea20010370 tx=0x7fea20010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:18.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.070+0000 7fea277fe700 1 -- 172.21.15.80:0/780828729 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fea200012c0 con 0x7fea28167d80 2019-11-28T11:58:18.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.070+0000 7fea2f524700 1 --2- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea28167d80 0x7fea2816a180 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7fea20010370 tx=0x7fea20010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:18.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.070+0000 7fea277fe700 1 --2- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fea0c018780 0x7fea0c01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:18.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.070+0000 7fea277fe700 1 -- 172.21.15.80:0/780828729 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fea20031a90 con 0x7fea28167d80 2019-11-28T11:58:18.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.070+0000 7fea2ed23700 1 --2- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fea0c018780 0x7fea0c01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:18.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.070+0000 7fea2ed23700 1 --2- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fea0c018780 0x7fea0c01abf0 crc :-1 s=READY pgs=1175 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:18.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.077+0000 7fea30786700 1 -- 172.21.15.80:0/780828729 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea281336d0 con 0x7fea28167d80 2019-11-28T11:58:18.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.080+0000 7fea2f524700 1 --2- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea28167d80 0x7fea2816a180 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7fea20010370 tx=0x7fea20010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:18.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.080+0000 7fea277fe700 1 -- 172.21.15.80:0/780828729 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fea20000fb0 con 0x7fea28167d80 2019-11-28T11:58:18.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.248+0000 7fea30786700 1 -- 172.21.15.80:0/780828729 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fea28133350 con 0x7fea28167d80 2019-11-28T11:58:18.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.882+0000 7fea2f524700 1 --2- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea28167d80 0x7fea2816a180 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7fea20010370 tx=0x7fea20010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:18.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.882+0000 7fea277fe700 1 -- 172.21.15.80:0/780828729 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v217) v1 ==== 185+0+0 (secure 0 0 0) 0x7fea2001f8a0 con 0x7fea28167d80 2019-11-28T11:58:18.908 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T11:58:18.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.915+0000 7fea30786700 1 -- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fea0c018780 msgr2=0x7fea0c01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:18.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.915+0000 7fea30786700 1 --2- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fea0c018780 0x7fea0c01abf0 crc :-1 s=READY pgs=1175 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:18.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.915+0000 7fea30786700 1 -- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea28167d80 msgr2=0x7fea2816a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:18.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.915+0000 7fea30786700 1 --2- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea28167d80 0x7fea2816a180 secure :-1 s=READY pgs=1717 cs=0 l=1 rx=0x7fea20010370 tx=0x7fea20010710).stop 2019-11-28T11:58:18.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.915+0000 7fea30786700 1 -- 172.21.15.80:0/780828729 shutdown_connections 2019-11-28T11:58:18.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.915+0000 7fea30786700 1 --2- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea28167d80 0x7fea2816a180 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:18.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.915+0000 7fea30786700 1 --2- 172.21.15.80:0/780828729 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fea0c018780 0x7fea0c01abf0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:18.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.915+0000 7fea30786700 1 -- 172.21.15.80:0/780828729 shutdown_connections 2019-11-28T11:58:18.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.915+0000 7fea30786700 1 -- 172.21.15.80:0/780828729 wait complete. 2019-11-28T11:58:18.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:18.915+0000 7fea30786700 1 -- 172.21.15.80:0/780828729 >> 172.21.15.80:0/780828729 conn(0x7fea2814dbb0 msgr2=0x7fea28142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:18.921 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T11:58:19.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.056+0000 7f0bc4bc9700 1 Processor -- start 2019-11-28T11:58:19.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.056+0000 7f0bc4bc9700 1 -- start start 2019-11-28T11:58:19.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.057+0000 7f0bc4bc9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0bc015ed10 0x7f0bc015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:19.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.057+0000 7f0bc4bc9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bc0073020 0x7f0bc0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:19.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.057+0000 7f0bc4bc9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc006db60 con 0x7f0bc00734b0 2019-11-28T11:58:19.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.057+0000 7f0bc4bc9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc006fe00 con 0x7f0bc015ed10 2019-11-28T11:58:19.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.057+0000 7f0bc4bc9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00700d0 con 0x7f0bc0073020 2019-11-28T11:58:19.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.057+0000 7f0bbed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0bc015ed10 0x7f0bc015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:19.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.057+0000 7f0bbed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0bc015ed10 0x7f0bc015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46768/0 (socket says 172.21.15.80:46768) 2019-11-28T11:58:19.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.057+0000 7f0bbed9d700 1 -- 172.21.15.80:0/2457109352 learned_addr learned my addr 172.21.15.80:0/2457109352 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:19.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.057+0000 7f0bbe59c700 1 --2- 172.21.15.80:0/2457109352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bc0073020 0x7f0bc0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:19.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.058+0000 7f0bbed9d700 1 -- 172.21.15.80:0/2457109352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bc0073020 msgr2=0x7f0bc0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:19.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.058+0000 7f0bbed9d700 1 --2- 172.21.15.80:0/2457109352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bc0073020 0x7f0bc0071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:19.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.058+0000 7f0bbed9d700 1 -- 172.21.15.80:0/2457109352 >> v1:172.21.15.174:6789/0 conn(0x7f0bc00734b0 legacy=0x7f0bc00723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:19.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.058+0000 7f0bbed9d700 1 -- 172.21.15.80:0/2457109352 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc0070760 con 0x7f0bc015ed10 2019-11-28T11:58:19.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.058+0000 7f0bbed9d700 1 --2- 172.21.15.80:0/2457109352 >> v2:172.21.15.80:3300/0 conn(0x7f0bc015ed10 0x7f0bc015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0bb000fa40 tx=0x7f0bb000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:19.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.058+0000 7f0bbed9d700 1 --2- 172.21.15.80:0/2457109352 >> v2:172.21.15.80:3300/0 conn(0x7f0bc015ed10 0x7f0bc015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0bb000fa40 tx=0x7f0bb000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:19.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.058+0000 7f0bbed9d700 1 --2- 172.21.15.80:0/2457109352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc015ed10 0x7f0bc015f100 secure :-1 s=READY pgs=2837 cs=0 l=1 rx=0x7f0bb000fa40 tx=0x7f0bb000fde0).ready entity=mon.0 client_cookie=261b458af87af2d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:19.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.058+0000 7f0bbed9d700 1 --2- 172.21.15.80:0/2457109352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc015ed10 0x7f0bc015f100 secure :-1 s=THROTTLE_DONE pgs=2837 cs=0 l=1 rx=0x7f0bb000fa40 tx=0x7f0bb000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:19.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.058+0000 7f0bbdd9b700 1 -- 172.21.15.80:0/2457109352 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb0000ce0 con 0x7f0bc015ed10 2019-11-28T11:58:19.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.058+0000 7f0bbed9d700 1 --2- 172.21.15.80:0/2457109352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc015ed10 0x7f0bc015f100 secure :-1 s=THROTTLE_DONE pgs=2837 cs=0 l=1 rx=0x7f0bb000fa40 tx=0x7f0bb000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:19.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.058+0000 7f0bbed9d700 1 --2- 172.21.15.80:0/2457109352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc015ed10 0x7f0bc015f100 secure :-1 s=THROTTLE_DONE pgs=2837 cs=0 l=1 rx=0x7f0bb000fa40 tx=0x7f0bb000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:19.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.058+0000 7f0bbdd9b700 1 -- 172.21.15.80:0/2457109352 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb0001010 con 0x7f0bc015ed10 2019-11-28T11:58:19.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.058+0000 7f0bbdd9b700 1 -- 172.21.15.80:0/2457109352 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb0001720 con 0x7f0bc015ed10 2019-11-28T11:58:19.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.058+0000 7f0bc4bc9700 1 -- 172.21.15.80:0/2457109352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc015ed10 msgr2=0x7f0bc015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:19.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.058+0000 7f0bc4bc9700 1 --2- 172.21.15.80:0/2457109352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc015ed10 0x7f0bc015f100 secure :-1 s=READY pgs=2837 cs=0 l=1 rx=0x7f0bb000fa40 tx=0x7f0bb000fde0).stop 2019-11-28T11:58:19.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.059+0000 7f0bc4bc9700 1 -- 172.21.15.80:0/2457109352 shutdown_connections 2019-11-28T11:58:19.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.059+0000 7f0bc4bc9700 1 --2- 172.21.15.80:0/2457109352 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bc0073020 0x7f0bc0071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:19.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.059+0000 7f0bc4bc9700 1 --2- 172.21.15.80:0/2457109352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc015ed10 0x7f0bc015f100 unknown :-1 s=CLOSED pgs=2837 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:19.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.059+0000 7f0bc4bc9700 1 -- 172.21.15.80:0/2457109352 shutdown_connections 2019-11-28T11:58:19.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.059+0000 7f0bc4bc9700 1 -- 172.21.15.80:0/2457109352 wait complete. 2019-11-28T11:58:19.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.059+0000 7f0bc4bc9700 1 -- 172.21.15.80:0/2457109352 >> 172.21.15.80:0/2457109352 conn(0x7f0bc0061d20 msgr2=0x7f0bc00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:19.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.061+0000 7f0bc4bc9700 1 Processor -- start 2019-11-28T11:58:19.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.061+0000 7f0bc4bc9700 1 -- start start 2019-11-28T11:58:19.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.062+0000 7f0bc4bc9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0bc010ed60 0x7f0bc010f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:19.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.062+0000 7f0bc4bc9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bc010f730 0x7f0bc0167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:19.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.062+0000 7f0bc4bc9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc010c250 con 0x7f0bc010e970 2019-11-28T11:58:19.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.062+0000 7f0bc4bc9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc010e430 con 0x7f0bc010ed60 2019-11-28T11:58:19.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.062+0000 7f0bc4bc9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc0105860 con 0x7f0bc010f730 2019-11-28T11:58:19.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.062+0000 7f0bbe59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0bc010ed60 0x7f0bc010f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:19.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.062+0000 7f0bbed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0bc010e970 0x7f0bc01087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46090/0 (socket says 172.21.15.80:46090) 2019-11-28T11:58:19.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.062+0000 7f0bbed9d700 1 -- 172.21.15.80:0/65146263 learned_addr learned my addr 172.21.15.80:0/65146263 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.062+0000 7f0bbf59e700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bc010f730 0x7f0bc0167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bbe59c700 1 -- 172.21.15.80:0/65146263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bc010f730 msgr2=0x7f0bc0167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bbe59c700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bc010f730 0x7f0bc0167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bbe59c700 1 -- 172.21.15.80:0/65146263 >> v1:172.21.15.80:6789/0 conn(0x7f0bc010e970 legacy=0x7f0bc01087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:19.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bbe59c700 1 -- 172.21.15.80:0/65146263 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc0105ef0 con 0x7f0bc010ed60 2019-11-28T11:58:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bb77fe700 1 -- 172.21.15.80:0/65146263 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230582777 0 0) 0x7f0bb0008120 con 0x7f0bc010e970 2019-11-28T11:58:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bbe59c700 1 --2- 172.21.15.80:0/65146263 >> v2:172.21.15.80:3300/0 conn(0x7f0bc010ed60 0x7f0bc010f1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ba8010360 tx=0x7f0ba80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bbe59c700 1 --2- 172.21.15.80:0/65146263 >> v2:172.21.15.80:3300/0 conn(0x7f0bc010ed60 0x7f0bc010f1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ba8010360 tx=0x7f0ba80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bbe59c700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc010ed60 0x7f0bc010f1f0 secure :-1 s=READY pgs=2839 cs=0 l=1 rx=0x7f0ba8010360 tx=0x7f0ba80101c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bbe59c700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc010ed60 0x7f0bc010f1f0 secure :-1 s=THROTTLE_DONE pgs=2839 cs=0 l=1 rx=0x7f0ba8010360 tx=0x7f0ba80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bb77fe700 1 -- 172.21.15.80:0/65146263 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ba8000940 con 0x7f0bc010ed60 2019-11-28T11:58:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bbe59c700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc010ed60 0x7f0bc010f1f0 secure :-1 s=THROTTLE_DONE pgs=2839 cs=0 l=1 rx=0x7f0ba8010360 tx=0x7f0ba80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:19.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bbe59c700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc010ed60 0x7f0bc010f1f0 secure :-1 s=THROTTLE_DONE pgs=2839 cs=0 l=1 rx=0x7f0ba8010360 tx=0x7f0ba80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bb77fe700 1 -- 172.21.15.80:0/65146263 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba8000c90 con 0x7f0bc010ed60 2019-11-28T11:58:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bb77fe700 1 -- 172.21.15.80:0/65146263 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ba8001360 con 0x7f0bc010ed60 2019-11-28T11:58:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bc4bc9700 1 -- 172.21.15.80:0/65146263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc0106270 con 0x7f0bc010ed60 2019-11-28T11:58:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bc4bc9700 1 -- 172.21.15.80:0/65146263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc0105ef0 con 0x7f0bc010ed60 2019-11-28T11:58:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bbe59c700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc010ed60 0x7f0bc010f1f0 secure :-1 s=THROTTLE_DONE pgs=2839 cs=0 l=1 rx=0x7f0ba8010360 tx=0x7f0ba80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.063+0000 7f0bb77fe700 1 -- 172.21.15.80:0/65146263 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0ba8000e80 con 0x7f0bc010ed60 2019-11-28T11:58:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.064+0000 7f0bbe59c700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc010ed60 0x7f0bc010f1f0 secure :-1 s=THROTTLE_DONE pgs=2839 cs=0 l=1 rx=0x7f0ba8010360 tx=0x7f0ba80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.064+0000 7f0bb77fe700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0ba4018730 0x7f0ba401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.064+0000 7f0bb77fe700 1 -- 172.21.15.80:0/65146263 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 5754+0+0 (secure 0 0 0) 0x7f0ba8031a00 con 0x7f0bc010ed60 2019-11-28T11:58:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.064+0000 7f0bbed9d700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0ba4018730 0x7f0ba401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.064+0000 7f0bbed9d700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0ba4018730 0x7f0ba401abc0 crc :-1 s=READY pgs=1176 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:19.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.071+0000 7f0bc4bc9700 1 -- 172.21.15.80:0/65146263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc0106270 con 0x7f0bc010ed60 2019-11-28T11:58:19.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.075+0000 7f0bbe59c700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc010ed60 0x7f0bc010f1f0 secure :-1 s=THROTTLE_DONE pgs=2839 cs=0 l=1 rx=0x7f0ba8010360 tx=0x7f0ba80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:19.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.075+0000 7f0bb77fe700 1 -- 172.21.15.80:0/65146263 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0ba8009250 con 0x7f0bc010ed60 2019-11-28T11:58:19.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.242+0000 7f0bc4bc9700 1 -- 172.21.15.80:0/65146263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0bc0105ef0 con 0x7f0bc010ed60 2019-11-28T11:58:19.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.886+0000 7f0bbe59c700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc010ed60 0x7f0bc010f1f0 secure :-1 s=THROTTLE_DONE pgs=2839 cs=0 l=1 rx=0x7f0ba8010360 tx=0x7f0ba80101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:19.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.886+0000 7f0bb77fe700 1 -- 172.21.15.80:0/65146263 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v218) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0ba8001190 con 0x7f0bc010ed60 2019-11-28T11:58:19.902 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T11:58:19.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.909+0000 7f0bc4bc9700 1 -- 172.21.15.80:0/65146263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0ba4018730 msgr2=0x7f0ba401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:19.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.909+0000 7f0bc4bc9700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0ba4018730 0x7f0ba401abc0 crc :-1 s=READY pgs=1176 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:19.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.909+0000 7f0bc4bc9700 1 -- 172.21.15.80:0/65146263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc010ed60 msgr2=0x7f0bc010f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:19.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.909+0000 7f0bc4bc9700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc010ed60 0x7f0bc010f1f0 secure :-1 s=READY pgs=2839 cs=0 l=1 rx=0x7f0ba8010360 tx=0x7f0ba80101c0).stop 2019-11-28T11:58:19.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.909+0000 7f0bc4bc9700 1 -- 172.21.15.80:0/65146263 shutdown_connections 2019-11-28T11:58:19.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.909+0000 7f0bc4bc9700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0ba4018730 0x7f0ba401abc0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:19.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.909+0000 7f0bc4bc9700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bc010f730 0x7f0bc0167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:19.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.909+0000 7f0bc4bc9700 1 --2- 172.21.15.80:0/65146263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bc010ed60 0x7f0bc010f1f0 unknown :-1 s=CLOSED pgs=2839 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:19.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.909+0000 7f0bc4bc9700 1 -- 172.21.15.80:0/65146263 shutdown_connections 2019-11-28T11:58:19.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.909+0000 7f0bc4bc9700 1 -- 172.21.15.80:0/65146263 wait complete. 2019-11-28T11:58:19.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:19.909+0000 7f0bc4bc9700 1 -- 172.21.15.80:0/65146263 >> 172.21.15.80:0/65146263 conn(0x7f0bc015e2d0 msgr2=0x7f0bc0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:19.915 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T11:58:20.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.041+0000 7f5a8005f700 1 Processor -- start 2019-11-28T11:58:20.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.041+0000 7f5a8005f700 1 -- start start 2019-11-28T11:58:20.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.042+0000 7f5a8005f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5a7806d120 0x7f5a78165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:20.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.042+0000 7f5a8005f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7806d5a0 con 0x7f5a7806c0a0 2019-11-28T11:58:20.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.042+0000 7f5a8005f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7806db00 con 0x7f5a7806c490 2019-11-28T11:58:20.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.042+0000 7f5a8005f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7806fd60 con 0x7f5a7806d120 2019-11-28T11:58:20.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.042+0000 7f5a7e5fc700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5a7806c0a0 0x7f5a78072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46098/0 (socket says 172.21.15.80:46098) 2019-11-28T11:58:20.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.042+0000 7f5a7e5fc700 1 -- 172.21.15.80:0/2585940061 learned_addr learned my addr 172.21.15.80:0/2585940061 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:20.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7edfd700 1 --2- 172.21.15.80:0/2585940061 >> v2:172.21.15.174:3300/0 conn(0x7f5a7806d120 0x7f5a78165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:20.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7d5fa700 1 -- 172.21.15.80:0/2585940061 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164016387 0 0) 0x7f5a600014d0 con 0x7f5a7806c0a0 2019-11-28T11:58:20.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7d5fa700 1 -- 172.21.15.80:0/2585940061 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a64002e80 con 0x7f5a7806c0a0 2019-11-28T11:58:20.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7d5fa700 1 -- 172.21.15.80:0/2585940061 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2304183708 0 0) 0x7f5a600014b0 con 0x7f5a7806c0a0 2019-11-28T11:58:20.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7d5fa700 1 -- 172.21.15.80:0/2585940061 >> v2:172.21.15.174:3300/0 conn(0x7f5a7806d120 msgr2=0x7f5a78165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:20.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7d5fa700 1 --2- 172.21.15.80:0/2585940061 >> v2:172.21.15.174:3300/0 conn(0x7f5a7806d120 0x7f5a78165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:20.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7d5fa700 1 -- 172.21.15.80:0/2585940061 >> v1:172.21.15.174:6789/0 conn(0x7f5a7806c490 legacy=0x7f5a7806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:20.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7d5fa700 1 -- 172.21.15.80:0/2585940061 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a780706c0 con 0x7f5a7806c0a0 2019-11-28T11:58:20.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7d5fa700 1 -- 172.21.15.80:0/2585940061 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f5a600019e0 con 0x7f5a7806c0a0 2019-11-28T11:58:20.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7d5fa700 1 -- 172.21.15.80:0/2585940061 >> v1:172.21.15.80:6789/0 conn(0x7f5a7806c0a0 legacy=0x7f5a78072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:20.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7d5fa700 1 --2- 172.21.15.80:0/2585940061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a64003ab0 0x7f5a64005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:20.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7d5fa700 1 --2- 172.21.15.80:0/2585940061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a64006690 0x7f5a64008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:20.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7d5fa700 1 --2- 172.21.15.80:0/2585940061 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a64009380 0x7f5a6400b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:20.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7d5fa700 1 -- 172.21.15.80:0/2585940061 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6400c000 con 0x7f5a64006690 2019-11-28T11:58:20.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7d5fa700 1 -- 172.21.15.80:0/2585940061 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a64050200 con 0x7f5a64003ab0 2019-11-28T11:58:20.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7d5fa700 1 -- 172.21.15.80:0/2585940061 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a64050430 con 0x7f5a64009380 2019-11-28T11:58:20.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7ddfb700 1 --2- 172.21.15.80:0/2585940061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a64006690 0x7f5a64008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:20.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7edfd700 1 --2- 172.21.15.80:0/2585940061 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a64009380 0x7f5a6400b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:20.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7e5fc700 1 --2- 172.21.15.80:0/2585940061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a64003ab0 0x7f5a64005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:20.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7ddfb700 1 -- 172.21.15.80:0/2585940061 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a64009380 msgr2=0x7f5a6400b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:20.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7ddfb700 1 --2- 172.21.15.80:0/2585940061 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a64009380 0x7f5a6400b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:20.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7ddfb700 1 -- 172.21.15.80:0/2585940061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a64003ab0 msgr2=0x7f5a64005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:20.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7ddfb700 1 --2- 172.21.15.80:0/2585940061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a64003ab0 0x7f5a64005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:20.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7edfd700 1 -- 172.21.15.80:0/2585940061 reap_dead start 2019-11-28T11:58:20.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.043+0000 7f5a7ddfb700 1 -- 172.21.15.80:0/2585940061 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a640506e0 con 0x7f5a64006690 2019-11-28T11:58:20.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.044+0000 7f5a7ddfb700 1 --2- 172.21.15.80:0/2585940061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a64006690 0x7f5a64008b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a6800af50 tx=0x7f5a6800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:20.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.044+0000 7f5a7ddfb700 1 --2- 172.21.15.80:0/2585940061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a64006690 0x7f5a64008b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a6800af50 tx=0x7f5a6800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:20.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.044+0000 7f5a7ddfb700 1 --2- 172.21.15.80:0/2585940061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a64006690 0x7f5a64008b20 secure :-1 s=READY pgs=2841 cs=0 l=1 rx=0x7f5a6800af50 tx=0x7f5a6800b250).ready entity=mon.0 client_cookie=d91b6daecb11b0c6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:20.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.044+0000 7f5a7ddfb700 1 --2- 172.21.15.80:0/2585940061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a64006690 0x7f5a64008b20 secure :-1 s=THROTTLE_DONE pgs=2841 cs=0 l=1 rx=0x7f5a6800af50 tx=0x7f5a6800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:20.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.044+0000 7f5a7ddfb700 1 --2- 172.21.15.80:0/2585940061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a64006690 0x7f5a64008b20 secure :-1 s=THROTTLE_DONE pgs=2841 cs=0 l=1 rx=0x7f5a6800af50 tx=0x7f5a6800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:20.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.044+0000 7f5a7d5fa700 1 -- 172.21.15.80:0/2585940061 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a68000960 con 0x7f5a64006690 2019-11-28T11:58:20.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.044+0000 7f5a7ddfb700 1 --2- 172.21.15.80:0/2585940061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a64006690 0x7f5a64008b20 secure :-1 s=THROTTLE_DONE pgs=2841 cs=0 l=1 rx=0x7f5a6800af50 tx=0x7f5a6800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:20.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.044+0000 7f5a7d5fa700 1 -- 172.21.15.80:0/2585940061 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a68009980 con 0x7f5a64006690 2019-11-28T11:58:20.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.044+0000 7f5a7d5fa700 1 -- 172.21.15.80:0/2585940061 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a6800a050 con 0x7f5a64006690 2019-11-28T11:58:20.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.044+0000 7f5a8005f700 1 -- 172.21.15.80:0/2585940061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a64006690 msgr2=0x7f5a64008b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:20.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.044+0000 7f5a8005f700 1 --2- 172.21.15.80:0/2585940061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a64006690 0x7f5a64008b20 secure :-1 s=READY pgs=2841 cs=0 l=1 rx=0x7f5a6800af50 tx=0x7f5a6800b250).stop 2019-11-28T11:58:20.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.045+0000 7f5a8005f700 1 -- 172.21.15.80:0/2585940061 shutdown_connections 2019-11-28T11:58:20.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.045+0000 7f5a8005f700 1 --2- 172.21.15.80:0/2585940061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a64006690 0x7f5a64008b20 unknown :-1 s=CLOSED pgs=2841 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:20.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.045+0000 7f5a8005f700 1 -- 172.21.15.80:0/2585940061 shutdown_connections 2019-11-28T11:58:20.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.045+0000 7f5a8005f700 1 -- 172.21.15.80:0/2585940061 wait complete. 2019-11-28T11:58:20.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.045+0000 7f5a8005f700 1 -- 172.21.15.80:0/2585940061 >> 172.21.15.80:0/2585940061 conn(0x7f5a78061cf0 msgr2=0x7f5a78064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:20.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.047+0000 7f5a8005f700 1 Processor -- start 2019-11-28T11:58:20.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.047+0000 7f5a8005f700 1 -- start start 2019-11-28T11:58:20.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.048+0000 7f5a8005f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5a780750f0 0x7f5a78151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:20.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.048+0000 7f5a8005f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a78079230 con 0x7f5a78151f90 2019-11-28T11:58:20.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.048+0000 7f5a8005f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a78079890 con 0x7f5a78074d00 2019-11-28T11:58:20.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.048+0000 7f5a8005f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7807ab30 con 0x7f5a780750f0 2019-11-28T11:58:20.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.048+0000 7f5a7edfd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5a78151f90 0x7f5a78168d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46114/0 (socket says 172.21.15.80:46114) 2019-11-28T11:58:20.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.048+0000 7f5a7edfd700 1 -- 172.21.15.80:0/982985385 learned_addr learned my addr 172.21.15.80:0/982985385 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:20.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.048+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729951817 0 0) 0x7f5a70001190 con 0x7f5a78151f90 2019-11-28T11:58:20.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.048+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a5c002e80 con 0x7f5a78151f90 2019-11-28T11:58:20.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.048+0000 7f5a7ddfb700 1 --2- 172.21.15.80:0/982985385 >> v2:172.21.15.174:3300/0 conn(0x7f5a780750f0 0x7f5a78151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:20.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1079421149 0 0) 0x7f5a70001320 con 0x7f5a78151f90 2019-11-28T11:58:20.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5a5c0032e0 con 0x7f5a78151f90 2019-11-28T11:58:20.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f5a70001830 con 0x7f5a78151f90 2019-11-28T11:58:20.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 >> v2:172.21.15.174:3300/0 conn(0x7f5a780750f0 msgr2=0x7f5a78151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:20.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a76ffd700 1 --2- 172.21.15.80:0/982985385 >> v2:172.21.15.174:3300/0 conn(0x7f5a780750f0 0x7f5a78151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:20.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 >> v1:172.21.15.174:6789/0 conn(0x7f5a78074d00 legacy=0x7f5a78152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:20.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 >> v1:172.21.15.80:6789/0 conn(0x7f5a78151f90 legacy=0x7f5a78168d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:20.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a76ffd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a5c003610 0x7f5a5c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:20.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a76ffd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a5c003f60 0x7f5a5c004420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:20.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a76ffd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c004b80 0x7f5a5c00b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:20.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c0052b0 con 0x7f5a5c004b80 2019-11-28T11:58:20.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c00be60 con 0x7f5a5c003610 2019-11-28T11:58:20.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c00c050 con 0x7f5a5c003f60 2019-11-28T11:58:20.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a7ddfb700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a5c003f60 0x7f5a5c004420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:20.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a7edfd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c004b80 0x7f5a5c00b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:20.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a7e5fc700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a5c003610 0x7f5a5c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:20.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a7edfd700 1 -- 172.21.15.80:0/982985385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a5c003f60 msgr2=0x7f5a5c004420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:20.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a7edfd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a5c003f60 0x7f5a5c004420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:20.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a7edfd700 1 -- 172.21.15.80:0/982985385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a5c003610 msgr2=0x7f5a5c003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:20.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a7edfd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a5c003610 0x7f5a5c003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:20.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a7edfd700 1 -- 172.21.15.80:0/982985385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c00c300 con 0x7f5a5c004b80 2019-11-28T11:58:20.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a7e5fc700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a5c003610 0x7f5a5c003a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:20.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a8005f700 1 -- 172.21.15.80:0/982985385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7807b810 con 0x7f5a5c004b80 2019-11-28T11:58:20.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a7edfd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c004b80 0x7f5a5c00b920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a70010430 tx=0x7f5a700102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:20.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a8005f700 1 -- 172.21.15.80:0/982985385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7807b490 con 0x7f5a5c004b80 2019-11-28T11:58:20.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a7edfd700 1 -- 172.21.15.80:0/982985385 reap_dead start 2019-11-28T11:58:20.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a7edfd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c004b80 0x7f5a5c00b920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a70010430 tx=0x7f5a700102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:20.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a7edfd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c004b80 0x7f5a5c00b920 secure :-1 s=READY pgs=2843 cs=0 l=1 rx=0x7f5a70010430 tx=0x7f5a700102b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:20.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a7edfd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c004b80 0x7f5a5c00b920 secure :-1 s=THROTTLE_DONE pgs=2843 cs=0 l=1 rx=0x7f5a70010430 tx=0x7f5a700102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:20.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a70000e70 con 0x7f5a5c004b80 2019-11-28T11:58:20.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a7edfd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c004b80 0x7f5a5c00b920 secure :-1 s=THROTTLE_DONE pgs=2843 cs=0 l=1 rx=0x7f5a70010430 tx=0x7f5a700102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:20.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a7edfd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c004b80 0x7f5a5c00b920 secure :-1 s=THROTTLE_DONE pgs=2843 cs=0 l=1 rx=0x7f5a70010430 tx=0x7f5a700102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:20.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a70000e70 con 0x7f5a5c004b80 2019-11-28T11:58:20.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.049+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a70001660 con 0x7f5a5c004b80 2019-11-28T11:58:20.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.050+0000 7f5a7edfd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c004b80 0x7f5a5c00b920 secure :-1 s=THROTTLE_DONE pgs=2843 cs=0 l=1 rx=0x7f5a70010430 tx=0x7f5a700102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:20.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.050+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5a70001280 con 0x7f5a5c004b80 2019-11-28T11:58:20.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.050+0000 7f5a7edfd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c004b80 0x7f5a5c00b920 secure :-1 s=THROTTLE_DONE pgs=2843 cs=0 l=1 rx=0x7f5a70010430 tx=0x7f5a700102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:20.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.050+0000 7f5a76ffd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a5c01b520 0x7f5a5c01d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:20.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.050+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 5372+0+0 (secure 0 0 0) 0x7f5a70031bc0 con 0x7f5a5c004b80 2019-11-28T11:58:20.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.050+0000 7f5a7e5fc700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a5c01b520 0x7f5a5c01d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:20.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.050+0000 7f5a7e5fc700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a5c01b520 0x7f5a5c01d950 crc :-1 s=READY pgs=1177 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:20.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.057+0000 7f5a8005f700 1 -- 172.21.15.80:0/982985385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a50002e60 con 0x7f5a5c004b80 2019-11-28T11:58:20.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.060+0000 7f5a7edfd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c004b80 0x7f5a5c00b920 secure :-1 s=THROTTLE_DONE pgs=2843 cs=0 l=1 rx=0x7f5a70010430 tx=0x7f5a700102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:20.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.060+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5a70000ab0 con 0x7f5a5c004b80 2019-11-28T11:58:20.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.248+0000 7f5a8005f700 1 -- 172.21.15.80:0/982985385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f5a50001d10 con 0x7f5a5c004b80 2019-11-28T11:58:20.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.894+0000 7f5a7edfd700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c004b80 0x7f5a5c00b920 secure :-1 s=THROTTLE_DONE pgs=2843 cs=0 l=1 rx=0x7f5a70010430 tx=0x7f5a700102b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:20.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.894+0000 7f5a76ffd700 1 -- 172.21.15.80:0/982985385 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v219) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5a70001280 con 0x7f5a5c004b80 2019-11-28T11:58:20.909 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T11:58:20.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.915+0000 7f5a8005f700 1 -- 172.21.15.80:0/982985385 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a5c01b520 msgr2=0x7f5a5c01d950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:20.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.915+0000 7f5a8005f700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a5c01b520 0x7f5a5c01d950 crc :-1 s=READY pgs=1177 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:20.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.915+0000 7f5a8005f700 1 -- 172.21.15.80:0/982985385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c004b80 msgr2=0x7f5a5c00b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:20.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.915+0000 7f5a8005f700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c004b80 0x7f5a5c00b920 secure :-1 s=READY pgs=2843 cs=0 l=1 rx=0x7f5a70010430 tx=0x7f5a700102b0).stop 2019-11-28T11:58:20.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.915+0000 7f5a8005f700 1 -- 172.21.15.80:0/982985385 shutdown_connections 2019-11-28T11:58:20.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.915+0000 7f5a8005f700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5a5c01b520 0x7f5a5c01d950 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:20.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.915+0000 7f5a8005f700 1 --2- 172.21.15.80:0/982985385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a5c004b80 0x7f5a5c00b920 unknown :-1 s=CLOSED pgs=2843 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:20.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.915+0000 7f5a8005f700 1 -- 172.21.15.80:0/982985385 shutdown_connections 2019-11-28T11:58:20.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.915+0000 7f5a8005f700 1 -- 172.21.15.80:0/982985385 wait complete. 2019-11-28T11:58:20.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:20.915+0000 7f5a8005f700 1 -- 172.21.15.80:0/982985385 >> 172.21.15.80:0/982985385 conn(0x7f5a7813fa50 msgr2=0x7f5a7807c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:20.921 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T11:58:20.921 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T11:58:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.047+0000 7f26830b4700 1 Processor -- start 2019-11-28T11:58:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.047+0000 7f26830b4700 1 -- start start 2019-11-28T11:58:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.048+0000 7f26830b4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c06c0a0 0x7f267c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:21.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.048+0000 7f26830b4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f267c0734e0 0x7f267c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.048+0000 7f26830b4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f267c072360 0x7f267c0727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.048+0000 7f26830b4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267c06f330 con 0x7f267c0734e0 2019-11-28T11:58:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.048+0000 7f26830b4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267c0706c0 con 0x7f267c072360 2019-11-28T11:58:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.048+0000 7f26830b4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c070a40 con 0x7f267c06c0a0 2019-11-28T11:58:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.048+0000 7f2680e50700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f267c0734e0 0x7f267c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.048+0000 7f2680e50700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f267c0734e0 0x7f267c071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46812/0 (socket says 172.21.15.80:46812) 2019-11-28T11:58:21.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.048+0000 7f2680e50700 1 -- 172.21.15.80:0/2187999855 learned_addr learned my addr 172.21.15.80:0/2187999855 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:21.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.048+0000 7f2681e52700 1 --2- 172.21.15.80:0/2187999855 >> v2:172.21.15.174:3300/0 conn(0x7f267c072360 0x7f267c0727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:21.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.048+0000 7f2681651700 1 --2- 172.21.15.80:0/2187999855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c06c0a0 0x7f267c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:21.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.049+0000 7f2680e50700 1 -- 172.21.15.80:0/2187999855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c06c0a0 msgr2=0x7f267c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:21.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.049+0000 7f2680e50700 1 --2- 172.21.15.80:0/2187999855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c06c0a0 0x7f267c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:21.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.049+0000 7f2680e50700 1 -- 172.21.15.80:0/2187999855 >> v2:172.21.15.174:3300/0 conn(0x7f267c072360 msgr2=0x7f267c0727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:21.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.049+0000 7f2680e50700 1 --2- 172.21.15.80:0/2187999855 >> v2:172.21.15.174:3300/0 conn(0x7f267c072360 0x7f267c0727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:21.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.049+0000 7f2680e50700 1 -- 172.21.15.80:0/2187999855 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c06db00 con 0x7f267c0734e0 2019-11-28T11:58:21.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.049+0000 7f2680e50700 1 --2- 172.21.15.80:0/2187999855 >> v2:172.21.15.80:3300/0 conn(0x7f267c0734e0 0x7f267c071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f266400f6c0 tx=0x7f266400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.049+0000 7f2680e50700 1 --2- 172.21.15.80:0/2187999855 >> v2:172.21.15.80:3300/0 conn(0x7f267c0734e0 0x7f267c071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f266400f6c0 tx=0x7f266400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.049+0000 7f2680e50700 1 --2- 172.21.15.80:0/2187999855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f267c0734e0 0x7f267c071e20 secure :-1 s=READY pgs=2844 cs=0 l=1 rx=0x7f266400f6c0 tx=0x7f266400f570).ready entity=mon.0 client_cookie=f34fefe03cdf041c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:21.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.049+0000 7f2680e50700 1 --2- 172.21.15.80:0/2187999855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f267c0734e0 0x7f267c071e20 secure :-1 s=THROTTLE_DONE pgs=2844 cs=0 l=1 rx=0x7f266400f6c0 tx=0x7f266400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.049+0000 7f267bfff700 1 -- 172.21.15.80:0/2187999855 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2664000960 con 0x7f267c0734e0 2019-11-28T11:58:21.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.049+0000 7f2680e50700 1 --2- 172.21.15.80:0/2187999855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f267c0734e0 0x7f267c071e20 secure :-1 s=THROTTLE_DONE pgs=2844 cs=0 l=1 rx=0x7f266400f6c0 tx=0x7f266400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.049+0000 7f2680e50700 1 --2- 172.21.15.80:0/2187999855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f267c0734e0 0x7f267c071e20 secure :-1 s=THROTTLE_DONE pgs=2844 cs=0 l=1 rx=0x7f266400f6c0 tx=0x7f266400f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.049+0000 7f267bfff700 1 -- 172.21.15.80:0/2187999855 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2664000c90 con 0x7f267c0734e0 2019-11-28T11:58:21.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.049+0000 7f267bfff700 1 -- 172.21.15.80:0/2187999855 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26640013a0 con 0x7f267c0734e0 2019-11-28T11:58:21.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.049+0000 7f26830b4700 1 -- 172.21.15.80:0/2187999855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f267c0734e0 msgr2=0x7f267c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.049+0000 7f26830b4700 1 --2- 172.21.15.80:0/2187999855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f267c0734e0 0x7f267c071e20 secure :-1 s=READY pgs=2844 cs=0 l=1 rx=0x7f266400f6c0 tx=0x7f266400f570).stop 2019-11-28T11:58:21.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.050+0000 7f26830b4700 1 -- 172.21.15.80:0/2187999855 shutdown_connections 2019-11-28T11:58:21.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.050+0000 7f26830b4700 1 --2- 172.21.15.80:0/2187999855 >> v2:172.21.15.174:3300/0 conn(0x7f267c072360 0x7f267c0727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:21.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.050+0000 7f26830b4700 1 --2- 172.21.15.80:0/2187999855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f267c0734e0 0x7f267c071e20 unknown :-1 s=CLOSED pgs=2844 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:21.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.050+0000 7f26830b4700 1 --2- 172.21.15.80:0/2187999855 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c06c0a0 0x7f267c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:21.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.050+0000 7f26830b4700 1 -- 172.21.15.80:0/2187999855 shutdown_connections 2019-11-28T11:58:21.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.050+0000 7f26830b4700 1 -- 172.21.15.80:0/2187999855 wait complete. 2019-11-28T11:58:21.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.050+0000 7f26830b4700 1 -- 172.21.15.80:0/2187999855 >> 172.21.15.80:0/2187999855 conn(0x7f267c061cf0 msgr2=0x7f267c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:21.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.052+0000 7f26830b4700 1 Processor -- start 2019-11-28T11:58:21.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.052+0000 7f26830b4700 1 -- start start 2019-11-28T11:58:21.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.053+0000 7f26830b4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c13a780 0x7f267c12d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:21.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.053+0000 7f26830b4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267c139a60 con 0x7f267c12d9c0 2019-11-28T11:58:21.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.053+0000 7f26830b4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267c13b060 con 0x7f267c12cb00 2019-11-28T11:58:21.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.053+0000 7f26830b4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c129830 con 0x7f267c13a780 2019-11-28T11:58:21.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.053+0000 7f2680e50700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f267c12d9c0 0x7f267c12c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46132/0 (socket says 172.21.15.80:46132) 2019-11-28T11:58:21.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.053+0000 7f2680e50700 1 -- 172.21.15.80:0/4034916609 learned_addr learned my addr 172.21.15.80:0/4034916609 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:21.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.053+0000 7f2681651700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c13a780 0x7f267c12d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:21.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f2679ffb700 1 -- 172.21.15.80:0/4034916609 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975400988 0 0) 0x7f2664007da0 con 0x7f267c12d9c0 2019-11-28T11:58:21.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f2679ffb700 1 -- 172.21.15.80:0/4034916609 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2660002e80 con 0x7f267c12d9c0 2019-11-28T11:58:21.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f2679ffb700 1 -- 172.21.15.80:0/4034916609 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647508279 0 0) 0x7f2674001400 con 0x7f267c12cb00 2019-11-28T11:58:21.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f2681651700 1 -- 172.21.15.80:0/4034916609 >> v1:172.21.15.174:6789/0 conn(0x7f267c12cb00 legacy=0x7f267c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f2681651700 1 -- 172.21.15.80:0/4034916609 >> v1:172.21.15.80:6789/0 conn(0x7f267c12d9c0 legacy=0x7f267c12c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f2681651700 1 -- 172.21.15.80:0/4034916609 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c12abc0 con 0x7f267c13a780 2019-11-28T11:58:21.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f2681651700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c13a780 0x7f267c12d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f266c0103b0 tx=0x7f266c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f2681651700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c13a780 0x7f267c12d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f266c0103b0 tx=0x7f266c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f2681651700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c13a780 0x7f267c12d480 secure :-1 s=READY pgs=411 cs=0 l=1 rx=0x7f266c0103b0 tx=0x7f266c010750).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:21.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f2681651700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c13a780 0x7f267c12d480 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f266c0103b0 tx=0x7f266c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f2679ffb700 1 -- 172.21.15.80:0/4034916609 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f266c000940 con 0x7f267c13a780 2019-11-28T11:58:21.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f2681651700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c13a780 0x7f267c12d480 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f266c0103b0 tx=0x7f266c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f2679ffb700 1 -- 172.21.15.80:0/4034916609 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c005580 con 0x7f267c13a780 2019-11-28T11:58:21.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f2681651700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c13a780 0x7f267c12d480 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f266c0103b0 tx=0x7f266c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f26830b4700 1 -- 172.21.15.80:0/4034916609 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267c12af40 con 0x7f267c13a780 2019-11-28T11:58:21.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f2679ffb700 1 -- 172.21.15.80:0/4034916609 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f266c005770 con 0x7f267c13a780 2019-11-28T11:58:21.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.054+0000 7f26830b4700 1 -- 172.21.15.80:0/4034916609 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267c12abc0 con 0x7f267c13a780 2019-11-28T11:58:21.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.055+0000 7f2681651700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c13a780 0x7f267c12d480 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f266c0103b0 tx=0x7f266c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.055+0000 7f2681651700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c13a780 0x7f267c12d480 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f266c0103b0 tx=0x7f266c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.055+0000 7f2679ffb700 1 -- 172.21.15.80:0/4034916609 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f266c005770 con 0x7f267c13a780 2019-11-28T11:58:21.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.055+0000 7f2679ffb700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2660018780 0x7f266001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:21.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.055+0000 7f2679ffb700 1 -- 172.21.15.80:0/4034916609 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f266c031a50 con 0x7f267c13a780 2019-11-28T11:58:21.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.055+0000 7f2680e50700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2660018780 0x7f266001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:21.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.055+0000 7f2680e50700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2660018780 0x7f266001abf0 crc :-1 s=READY pgs=1178 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:21.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.063+0000 7f26830b4700 1 -- 172.21.15.80:0/4034916609 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267c12af40 con 0x7f267c13a780 2019-11-28T11:58:21.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.066+0000 7f2681651700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c13a780 0x7f267c12d480 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f266c0103b0 tx=0x7f266c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.066+0000 7f2679ffb700 1 -- 172.21.15.80:0/4034916609 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f266c005180 con 0x7f267c13a780 2019-11-28T11:58:21.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.236+0000 7f26830b4700 1 -- 172.21.15.80:0/4034916609 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f267c12abc0 con 0x7f267c13a780 2019-11-28T11:58:21.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.238+0000 7f2681651700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c13a780 0x7f267c12d480 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f266c0103b0 tx=0x7f266c010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.238+0000 7f2679ffb700 1 -- 172.21.15.80:0/4034916609 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v75) v1 ==== 80+0+4797 (secure 0 0 0) 0x7f266c005650 con 0x7f267c13a780 2019-11-28T11:58:21.234 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:21.234 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:58:21.234 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T11:58:21.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.234 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T11:58:21.234 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T11:58:21.235 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.235 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:58:21.235 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:58:21.235 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:58:21.235 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:58:21.235 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.236 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T11:58:21.236 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T11:58:21.236 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.236 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:58:21.243 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:58:21.244 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:58:21.244 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:58:21.244 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.244 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T11:58:21.244 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T11:58:21.245 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.245 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:58:21.245 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:58:21.245 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:58:21.245 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:58:21.245 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.246 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T11:58:21.246 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T11:58:21.246 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.246 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:58:21.246 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:58:21.246 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:58:21.247 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.247 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T11:58:21.247 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T11:58:21.247 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.248 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:58:21.248 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:58:21.248 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:58:21.248 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.249 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T11:58:21.249 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T11:58:21.249 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.249 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:58:21.250 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:58:21.250 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:58:21.250 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.250 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T11:58:21.251 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T11:58:21.251 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.251 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:58:21.251 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:58:21.251 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:58:21.251 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.252 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T11:58:21.252 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T11:58:21.252 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.252 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:58:21.252 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:58:21.252 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:58:21.253 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.253 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T11:58:21.253 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T11:58:21.253 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.253 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:58:21.254 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:58:21.254 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:58:21.254 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.254 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T11:58:21.254 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T11:58:21.254 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.255 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:58:21.255 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:58:21.255 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:58:21.255 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.255 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T11:58:21.256 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T11:58:21.256 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.256 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:58:21.256 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:58:21.256 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:58:21.256 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.257 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T11:58:21.257 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T11:58:21.257 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.257 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:58:21.257 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:58:21.257 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:58:21.257 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.258 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T11:58:21.258 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T11:58:21.258 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.258 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:58:21.258 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:58:21.259 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:58:21.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.259 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T11:58:21.259 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T11:58:21.260 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.260 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:58:21.260 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:58:21.260 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:58:21.260 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.261 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T11:58:21.261 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T11:58:21.261 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.261 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T11:58:21.261 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T11:58:21.261 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T11:58:21.262 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.262 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T11:58:21.262 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T11:58:21.262 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.262 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:58:21.263 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T11:58:21.263 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T11:58:21.263 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:58:21.263 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.263 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T11:58:21.263 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T11:58:21.264 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.264 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:58:21.264 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:58:21.264 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:58:21.264 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:21.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:21.265 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T11:58:21.265 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T11:58:21.265 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T11:58:21.265 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T11:58:21.265 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T11:58:21.265 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T11:58:21.265 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.266 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:21.266 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T11:58:21.266 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:58:21.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.239+0000 7f26830b4700 1 -- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2660018780 msgr2=0x7f266001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.239+0000 7f26830b4700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2660018780 0x7f266001abf0 crc :-1 s=READY pgs=1178 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:21.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.239+0000 7f26830b4700 1 -- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c13a780 msgr2=0x7f267c12d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.239+0000 7f26830b4700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c13a780 0x7f267c12d480 secure :-1 s=READY pgs=411 cs=0 l=1 rx=0x7f266c0103b0 tx=0x7f266c010750).stop 2019-11-28T11:58:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.239+0000 7f26830b4700 1 -- 172.21.15.80:0/4034916609 shutdown_connections 2019-11-28T11:58:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.239+0000 7f26830b4700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2660018780 0x7f266001abf0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.239+0000 7f26830b4700 1 --2- 172.21.15.80:0/4034916609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f267c13a780 0x7f267c12d480 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.239+0000 7f26830b4700 1 -- 172.21.15.80:0/4034916609 shutdown_connections 2019-11-28T11:58:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.239+0000 7f26830b4700 1 -- 172.21.15.80:0/4034916609 wait complete. 2019-11-28T11:58:21.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.239+0000 7f26830b4700 1 -- 172.21.15.80:0/4034916609 >> 172.21.15.80:0/4034916609 conn(0x7f267c127dc0 msgr2=0x7f267c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:21.270 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:58:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.394+0000 7f74da7b0700 1 Processor -- start 2019-11-28T11:58:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.394+0000 7f74da7b0700 1 -- start start 2019-11-28T11:58:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74da7b0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d406c0a0 0x7f74d4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74da7b0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f74d4072620 0x7f74d4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74da7b0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d406db00 con 0x7f74d40734e0 2019-11-28T11:58:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74da7b0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d406f330 con 0x7f74d4072620 2019-11-28T11:58:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74da7b0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d40706c0 con 0x7f74d406c0a0 2019-11-28T11:58:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74d8d4d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d406c0a0 0x7f74d4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74d954e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f74d4072620 0x7f74d4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74d8d4d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d406c0a0 0x7f74d4072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:49082/0 (socket says 172.21.15.80:49082) 2019-11-28T11:58:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74d954e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f74d4072620 0x7f74d4164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:33476/0 (socket says 172.21.15.80:33476) 2019-11-28T11:58:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74d3fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f74d40734e0 0x7f74d4071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:33450/0 (socket says 172.21.15.80:33450) 2019-11-28T11:58:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74d8d4d700 1 -- 172.21.15.80:0/35711767 learned_addr learned my addr 172.21.15.80:0/35711767 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74d8d4d700 1 -- 172.21.15.80:0/35711767 >> v2:172.21.15.174:3300/0 conn(0x7f74d4072620 msgr2=0x7f74d4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:21.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74d8d4d700 1 --2- 172.21.15.80:0/35711767 >> v2:172.21.15.174:3300/0 conn(0x7f74d4072620 0x7f74d4164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:21.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74d8d4d700 1 -- 172.21.15.80:0/35711767 >> v1:172.21.15.174:6789/0 conn(0x7f74d40734e0 legacy=0x7f74d4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74d8d4d700 1 -- 172.21.15.80:0/35711767 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d4070a40 con 0x7f74d406c0a0 2019-11-28T11:58:21.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74d37fe700 1 -- 172.21.15.80:0/35711767 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568295986 0 0) 0x7f74c40010c0 con 0x7f74d40734e0 2019-11-28T11:58:21.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.395+0000 7f74d954e700 1 --2- 172.21.15.80:0/35711767 >> v2:172.21.15.174:3300/0 conn(0x7f74d4072620 0x7f74d4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:21.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.396+0000 7f74d8d4d700 1 --2- 172.21.15.80:0/35711767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d406c0a0 0x7f74d4072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f74bc00f740 tx=0x7f74bc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.396+0000 7f74d8d4d700 1 --2- 172.21.15.80:0/35711767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d406c0a0 0x7f74d4072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f74bc00f740 tx=0x7f74bc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.396+0000 7f74d8d4d700 1 --2- 172.21.15.80:0/35711767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d406c0a0 0x7f74d4072fa0 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7f74bc00f740 tx=0x7f74bc00fae0).ready entity=mon.2 client_cookie=80fc01103d65ce79 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:21.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.396+0000 7f74d8d4d700 1 --2- 172.21.15.80:0/35711767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d406c0a0 0x7f74d4072fa0 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f74bc00f740 tx=0x7f74bc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.396+0000 7f74d37fe700 1 -- 172.21.15.80:0/35711767 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74bc000960 con 0x7f74d406c0a0 2019-11-28T11:58:21.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.396+0000 7f74d8d4d700 1 --2- 172.21.15.80:0/35711767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d406c0a0 0x7f74d4072fa0 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f74bc00f740 tx=0x7f74bc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.396+0000 7f74d8d4d700 1 --2- 172.21.15.80:0/35711767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d406c0a0 0x7f74d4072fa0 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f74bc00f740 tx=0x7f74bc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.396+0000 7f74d37fe700 1 -- 172.21.15.80:0/35711767 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74bc000c90 con 0x7f74d406c0a0 2019-11-28T11:58:21.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.396+0000 7f74d37fe700 1 -- 172.21.15.80:0/35711767 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74bc0013a0 con 0x7f74d406c0a0 2019-11-28T11:58:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.396+0000 7f74da7b0700 1 -- 172.21.15.80:0/35711767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d406c0a0 msgr2=0x7f74d4072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.396+0000 7f74da7b0700 1 --2- 172.21.15.80:0/35711767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d406c0a0 0x7f74d4072fa0 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7f74bc00f740 tx=0x7f74bc00fae0).stop 2019-11-28T11:58:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.396+0000 7f74da7b0700 1 -- 172.21.15.80:0/35711767 shutdown_connections 2019-11-28T11:58:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.396+0000 7f74da7b0700 1 --2- 172.21.15.80:0/35711767 >> v2:172.21.15.174:3300/0 conn(0x7f74d4072620 0x7f74d4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.396+0000 7f74da7b0700 1 --2- 172.21.15.80:0/35711767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d406c0a0 0x7f74d4072fa0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.397+0000 7f74da7b0700 1 -- 172.21.15.80:0/35711767 shutdown_connections 2019-11-28T11:58:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.397+0000 7f74da7b0700 1 -- 172.21.15.80:0/35711767 wait complete. 2019-11-28T11:58:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.397+0000 7f74da7b0700 1 -- 172.21.15.80:0/35711767 >> 172.21.15.80:0/35711767 conn(0x7f74d4061cf0 msgr2=0x7f74d4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.399+0000 7f74da7b0700 1 Processor -- start 2019-11-28T11:58:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.399+0000 7f74da7b0700 1 -- start start 2019-11-28T11:58:21.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.400+0000 7f74da7b0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d413e5f0 0x7f74d413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:21.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.400+0000 7f74da7b0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74d410a070 0x7f74d410bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:21.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.400+0000 7f74da7b0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d41066e0 con 0x7f74d410a4e0 2019-11-28T11:58:21.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.400+0000 7f74da7b0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d410d630 con 0x7f74d410a070 2019-11-28T11:58:21.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.400+0000 7f74da7b0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d410e060 con 0x7f74d413e5f0 2019-11-28T11:58:21.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.400+0000 7f74d3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74d410a070 0x7f74d410bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:21.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.400+0000 7f74d3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74d410a070 0x7f74d410bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46828/0 (socket says 172.21.15.80:46828) 2019-11-28T11:58:21.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.400+0000 7f74d3fff700 1 -- 172.21.15.80:0/3123694579 learned_addr learned my addr 172.21.15.80:0/3123694579 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:21.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.400+0000 7f74d8d4d700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d413e5f0 0x7f74d413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:21.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.400+0000 7f74d17fa700 1 -- 172.21.15.80:0/3123694579 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051945479 0 0) 0x7f74cc009b40 con 0x7f74d410a4e0 2019-11-28T11:58:21.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.400+0000 7f74d3fff700 1 -- 172.21.15.80:0/3123694579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d413e5f0 msgr2=0x7f74d413e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.400+0000 7f74d3fff700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d413e5f0 0x7f74d413e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:21.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.400+0000 7f74d3fff700 1 -- 172.21.15.80:0/3123694579 >> v1:172.21.15.174:6789/0 conn(0x7f74d410a4e0 legacy=0x7f74d410c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.400+0000 7f74d3fff700 1 -- 172.21.15.80:0/3123694579 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d410e9c0 con 0x7f74d410a070 2019-11-28T11:58:21.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.400+0000 7f74d8d4d700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d413e5f0 0x7f74d413e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:21.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.400+0000 7f74d3fff700 1 --2- 172.21.15.80:0/3123694579 >> v2:172.21.15.80:3300/0 conn(0x7f74d410a070 0x7f74d410bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f74c4010440 tx=0x7f74c40107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.401+0000 7f74d3fff700 1 --2- 172.21.15.80:0/3123694579 >> v2:172.21.15.80:3300/0 conn(0x7f74d410a070 0x7f74d410bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f74c4010440 tx=0x7f74c40107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.401+0000 7f74d3fff700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74d410a070 0x7f74d410bdb0 secure :-1 s=READY pgs=2846 cs=0 l=1 rx=0x7f74c4010440 tx=0x7f74c40107e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:21.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.401+0000 7f74d3fff700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74d410a070 0x7f74d410bdb0 secure :-1 s=THROTTLE_DONE pgs=2846 cs=0 l=1 rx=0x7f74c4010440 tx=0x7f74c40107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.401+0000 7f74d17fa700 1 -- 172.21.15.80:0/3123694579 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74c40041c0 con 0x7f74d410a070 2019-11-28T11:58:21.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.401+0000 7f74d3fff700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74d410a070 0x7f74d410bdb0 secure :-1 s=THROTTLE_DONE pgs=2846 cs=0 l=1 rx=0x7f74c4010440 tx=0x7f74c40107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.401+0000 7f74d3fff700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74d410a070 0x7f74d410bdb0 secure :-1 s=THROTTLE_DONE pgs=2846 cs=0 l=1 rx=0x7f74c4010440 tx=0x7f74c40107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.401+0000 7f74d17fa700 1 -- 172.21.15.80:0/3123694579 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c4000c30 con 0x7f74d410a070 2019-11-28T11:58:21.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.401+0000 7f74d17fa700 1 -- 172.21.15.80:0/3123694579 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74c40047a0 con 0x7f74d410a070 2019-11-28T11:58:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.401+0000 7f74da7b0700 1 -- 172.21.15.80:0/3123694579 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d410ed40 con 0x7f74d410a070 2019-11-28T11:58:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.401+0000 7f74da7b0700 1 -- 172.21.15.80:0/3123694579 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d410e9c0 con 0x7f74d410a070 2019-11-28T11:58:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.401+0000 7f74d3fff700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74d410a070 0x7f74d410bdb0 secure :-1 s=THROTTLE_DONE pgs=2846 cs=0 l=1 rx=0x7f74c4010440 tx=0x7f74c40107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.401+0000 7f74d17fa700 1 -- 172.21.15.80:0/3123694579 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f74c40041c0 con 0x7f74d410a070 2019-11-28T11:58:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.401+0000 7f74d3fff700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74d410a070 0x7f74d410bdb0 secure :-1 s=THROTTLE_DONE pgs=2846 cs=0 l=1 rx=0x7f74c4010440 tx=0x7f74c40107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.402+0000 7f74d17fa700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f74b8018730 0x7f74b801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:21.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.402+0000 7f74d17fa700 1 -- 172.21.15.80:0/3123694579 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f74c4031aa0 con 0x7f74d410a070 2019-11-28T11:58:21.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.402+0000 7f74d8d4d700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f74b8018730 0x7f74b801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:21.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.402+0000 7f74d8d4d700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f74b8018730 0x7f74b801abc0 crc :-1 s=READY pgs=1179 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:21.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.409+0000 7f74da7b0700 1 -- 172.21.15.80:0/3123694579 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d410ed40 con 0x7f74d410a070 2019-11-28T11:58:21.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.412+0000 7f74d3fff700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74d410a070 0x7f74d410bdb0 secure :-1 s=THROTTLE_DONE pgs=2846 cs=0 l=1 rx=0x7f74c4010440 tx=0x7f74c40107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.412+0000 7f74d17fa700 1 -- 172.21.15.80:0/3123694579 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f74c4001300 con 0x7f74d410a070 2019-11-28T11:58:21.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.587+0000 7f74da7b0700 1 -- 172.21.15.80:0/3123694579 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74d410e9c0 con 0x7f74d410a070 2019-11-28T11:58:21.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.588+0000 7f74d3fff700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74d410a070 0x7f74d410bdb0 secure :-1 s=THROTTLE_DONE pgs=2846 cs=0 l=1 rx=0x7f74c4010440 tx=0x7f74c40107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.588+0000 7f74d17fa700 1 -- 172.21.15.80:0/3123694579 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v219) v1 ==== 74+0+12010 (secure 0 0 0) 0x7f74c40041c0 con 0x7f74d410a070 2019-11-28T11:58:21.585 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:21.586 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":219,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:58:20.886728+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":35,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:58:21.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.590+0000 7f74da7b0700 1 -- 172.21.15.80:0/3123694579 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f74b8018730 msgr2=0x7f74b801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.590+0000 7f74da7b0700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f74b8018730 0x7f74b801abc0 crc :-1 s=READY pgs=1179 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:21.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.590+0000 7f74da7b0700 1 -- 172.21.15.80:0/3123694579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74d410a070 msgr2=0x7f74d410bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.590+0000 7f74da7b0700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74d410a070 0x7f74d410bdb0 secure :-1 s=READY pgs=2846 cs=0 l=1 rx=0x7f74c4010440 tx=0x7f74c40107e0).stop 2019-11-28T11:58:21.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.590+0000 7f74da7b0700 1 -- 172.21.15.80:0/3123694579 shutdown_connections 2019-11-28T11:58:21.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.590+0000 7f74da7b0700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f74b8018730 0x7f74b801abc0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:21.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.590+0000 7f74da7b0700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74d410a070 0x7f74d410bdb0 unknown :-1 s=CLOSED pgs=2846 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:21.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.590+0000 7f74da7b0700 1 --2- 172.21.15.80:0/3123694579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74d413e5f0 0x7f74d413e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:21.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.590+0000 7f74da7b0700 1 -- 172.21.15.80:0/3123694579 shutdown_connections 2019-11-28T11:58:21.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.590+0000 7f74da7b0700 1 -- 172.21.15.80:0/3123694579 wait complete. 2019-11-28T11:58:21.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.590+0000 7f74da7b0700 1 -- 172.21.15.80:0/3123694579 >> 172.21.15.80:0/3123694579 conn(0x7f74d413d620 msgr2=0x7f74d413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:21.597 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:58:21.597 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:58:21.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.725+0000 7f59ee874700 1 Processor -- start 2019-11-28T11:58:21.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.725+0000 7f59ee874700 1 -- start start 2019-11-28T11:58:21.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.726+0000 7f59ee874700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f59e815f100 0x7f59e806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:21.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.726+0000 7f59ee874700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e806db60 con 0x7f59e806c2f0 2019-11-28T11:58:21.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.726+0000 7f59ee874700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e806e060 con 0x7f59e815ed10 2019-11-28T11:58:21.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.726+0000 7f59ee874700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e806fe00 con 0x7f59e815f100 2019-11-28T11:58:21.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.726+0000 7f59ed612700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f59e806c2f0 0x7f59e806c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46154/0 (socket says 172.21.15.80:46154) 2019-11-28T11:58:21.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.726+0000 7f59ed612700 1 -- 172.21.15.80:0/4279194285 learned_addr learned my addr 172.21.15.80:0/4279194285 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:21.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.726+0000 7f59e7fff700 1 --2- 172.21.15.80:0/4279194285 >> v2:172.21.15.174:3300/0 conn(0x7f59e815f100 0x7f59e806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:21.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.726+0000 7f59e77fe700 1 -- 172.21.15.80:0/4279194285 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715814628 0 0) 0x7f59e00014d0 con 0x7f59e806c2f0 2019-11-28T11:58:21.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.726+0000 7f59e77fe700 1 -- 172.21.15.80:0/4279194285 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d4002e80 con 0x7f59e806c2f0 2019-11-28T11:58:21.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.726+0000 7f59e77fe700 1 -- 172.21.15.80:0/4279194285 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2163739953 0 0) 0x7f59e00014b0 con 0x7f59e806c2f0 2019-11-28T11:58:21.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.726+0000 7f59e7fff700 1 -- 172.21.15.80:0/4279194285 >> v1:172.21.15.174:6789/0 conn(0x7f59e815ed10 legacy=0x7f59e8073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.726+0000 7f59e7fff700 1 -- 172.21.15.80:0/4279194285 >> v1:172.21.15.80:6789/0 conn(0x7f59e806c2f0 legacy=0x7f59e806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.726+0000 7f59e7fff700 1 -- 172.21.15.80:0/4279194285 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e8070760 con 0x7f59e815f100 2019-11-28T11:58:21.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.726+0000 7f59e7fff700 1 --2- 172.21.15.80:0/4279194285 >> v2:172.21.15.174:3300/0 conn(0x7f59e815f100 0x7f59e806bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f59d800af50 tx=0x7f59d800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.727+0000 7f59e7fff700 1 --2- 172.21.15.80:0/4279194285 >> v2:172.21.15.174:3300/0 conn(0x7f59e815f100 0x7f59e806bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f59d800af50 tx=0x7f59d800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.727+0000 7f59e7fff700 1 --2- 172.21.15.80:0/4279194285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59e815f100 0x7f59e806bdb0 secure :-1 s=READY pgs=1725 cs=0 l=1 rx=0x7f59d800af50 tx=0x7f59d800b760).ready entity=mon.1 client_cookie=5fe9bbbbd4a2e153 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:21.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.727+0000 7f59e7fff700 1 --2- 172.21.15.80:0/4279194285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59e815f100 0x7f59e806bdb0 secure :-1 s=THROTTLE_DONE pgs=1725 cs=0 l=1 rx=0x7f59d800af50 tx=0x7f59d800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.727+0000 7f59e77fe700 1 -- 172.21.15.80:0/4279194285 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59d8000960 con 0x7f59e815f100 2019-11-28T11:58:21.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.727+0000 7f59e7fff700 1 --2- 172.21.15.80:0/4279194285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59e815f100 0x7f59e806bdb0 secure :-1 s=THROTTLE_DONE pgs=1725 cs=0 l=1 rx=0x7f59d800af50 tx=0x7f59d800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.727+0000 7f59e7fff700 1 --2- 172.21.15.80:0/4279194285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59e815f100 0x7f59e806bdb0 secure :-1 s=THROTTLE_DONE pgs=1725 cs=0 l=1 rx=0x7f59d800af50 tx=0x7f59d800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.727+0000 7f59e77fe700 1 -- 172.21.15.80:0/4279194285 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d8009860 con 0x7f59e815f100 2019-11-28T11:58:21.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.727+0000 7f59e77fe700 1 -- 172.21.15.80:0/4279194285 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59d8000960 con 0x7f59e815f100 2019-11-28T11:58:21.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.727+0000 7f59ee874700 1 -- 172.21.15.80:0/4279194285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59e815f100 msgr2=0x7f59e806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.727+0000 7f59ee874700 1 --2- 172.21.15.80:0/4279194285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59e815f100 0x7f59e806bdb0 secure :-1 s=READY pgs=1725 cs=0 l=1 rx=0x7f59d800af50 tx=0x7f59d800b760).stop 2019-11-28T11:58:21.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.727+0000 7f59ee874700 1 -- 172.21.15.80:0/4279194285 shutdown_connections 2019-11-28T11:58:21.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.727+0000 7f59ee874700 1 --2- 172.21.15.80:0/4279194285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59e815f100 0x7f59e806bdb0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:21.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.727+0000 7f59ee874700 1 -- 172.21.15.80:0/4279194285 shutdown_connections 2019-11-28T11:58:21.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.727+0000 7f59ee874700 1 -- 172.21.15.80:0/4279194285 wait complete. 2019-11-28T11:58:21.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.727+0000 7f59ee874700 1 -- 172.21.15.80:0/4279194285 >> 172.21.15.80:0/4279194285 conn(0x7f59e8061d20 msgr2=0x7f59e80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:21.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.730+0000 7f59ee874700 1 Processor -- start 2019-11-28T11:58:21.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.730+0000 7f59ee874700 1 -- start start 2019-11-28T11:58:21.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.731+0000 7f59ee874700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f59e812e610 0x7f59e812ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:21.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.731+0000 7f59ee874700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e8165da0 con 0x7f59e807ba20 2019-11-28T11:58:21.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.731+0000 7f59ee874700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e8079370 con 0x7f59e8165480 2019-11-28T11:58:21.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.731+0000 7f59ee874700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e8079980 con 0x7f59e812e610 2019-11-28T11:58:21.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.731+0000 7f59ed612700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f59e812e610 0x7f59e812ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:21.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.731+0000 7f59ed612700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f59e812e610 0x7f59e812ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46844/0 (socket says 172.21.15.80:46844) 2019-11-28T11:58:21.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.731+0000 7f59ed612700 1 -- 172.21.15.80:0/2401939005 learned_addr learned my addr 172.21.15.80:0/2401939005 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:21.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.731+0000 7f59ed612700 1 -- 172.21.15.80:0/2401939005 >> v1:172.21.15.174:6789/0 conn(0x7f59e8165480 legacy=0x7f59e814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.731+0000 7f59e57fa700 1 -- 172.21.15.80:0/2401939005 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500106837 0 0) 0x7f59d0000ff0 con 0x7f59e8165480 2019-11-28T11:58:21.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.731+0000 7f59ed612700 1 -- 172.21.15.80:0/2401939005 >> v1:172.21.15.80:6789/0 conn(0x7f59e807ba20 legacy=0x7f59e807beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.731+0000 7f59ed612700 1 -- 172.21.15.80:0/2401939005 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e807a2e0 con 0x7f59e812e610 2019-11-28T11:58:21.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.731+0000 7f59ed612700 1 --2- 172.21.15.80:0/2401939005 >> v2:172.21.15.80:3300/0 conn(0x7f59e812e610 0x7f59e812ea90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59e00107b0 tx=0x7f59e0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.731+0000 7f59ed612700 1 --2- 172.21.15.80:0/2401939005 >> v2:172.21.15.80:3300/0 conn(0x7f59e812e610 0x7f59e812ea90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59e00107b0 tx=0x7f59e0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.731+0000 7f59ed612700 1 --2- 172.21.15.80:0/2401939005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59e812e610 0x7f59e812ea90 secure :-1 s=READY pgs=2849 cs=0 l=1 rx=0x7f59e00107b0 tx=0x7f59e0010b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:21.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.731+0000 7f59ed612700 1 --2- 172.21.15.80:0/2401939005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59e812e610 0x7f59e812ea90 secure :-1 s=THROTTLE_DONE pgs=2849 cs=0 l=1 rx=0x7f59e00107b0 tx=0x7f59e0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.731+0000 7f59e57fa700 1 -- 172.21.15.80:0/2401939005 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59e0000cc0 con 0x7f59e812e610 2019-11-28T11:58:21.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.732+0000 7f59ed612700 1 --2- 172.21.15.80:0/2401939005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59e812e610 0x7f59e812ea90 secure :-1 s=THROTTLE_DONE pgs=2849 cs=0 l=1 rx=0x7f59e00107b0 tx=0x7f59e0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.732+0000 7f59ed612700 1 --2- 172.21.15.80:0/2401939005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59e812e610 0x7f59e812ea90 secure :-1 s=THROTTLE_DONE pgs=2849 cs=0 l=1 rx=0x7f59e00107b0 tx=0x7f59e0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.732+0000 7f59e57fa700 1 -- 172.21.15.80:0/2401939005 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e0000cc0 con 0x7f59e812e610 2019-11-28T11:58:21.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.732+0000 7f59ee874700 1 -- 172.21.15.80:0/2401939005 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e807a660 con 0x7f59e812e610 2019-11-28T11:58:21.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.732+0000 7f59e57fa700 1 -- 172.21.15.80:0/2401939005 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59e00047b0 con 0x7f59e812e610 2019-11-28T11:58:21.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.732+0000 7f59ee874700 1 -- 172.21.15.80:0/2401939005 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e807a2e0 con 0x7f59e812e610 2019-11-28T11:58:21.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.732+0000 7f59ed612700 1 --2- 172.21.15.80:0/2401939005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59e812e610 0x7f59e812ea90 secure :-1 s=THROTTLE_DONE pgs=2849 cs=0 l=1 rx=0x7f59e00107b0 tx=0x7f59e0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.732+0000 7f59e57fa700 1 -- 172.21.15.80:0/2401939005 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f59e00045c0 con 0x7f59e812e610 2019-11-28T11:58:21.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.732+0000 7f59ed612700 1 --2- 172.21.15.80:0/2401939005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59e812e610 0x7f59e812ea90 secure :-1 s=THROTTLE_DONE pgs=2849 cs=0 l=1 rx=0x7f59e00107b0 tx=0x7f59e0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.732+0000 7f59e57fa700 1 --2- 172.21.15.80:0/2401939005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f59cc018730 0x7f59cc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:21.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.732+0000 7f59e57fa700 1 -- 172.21.15.80:0/2401939005 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f59e0031ea0 con 0x7f59e812e610 2019-11-28T11:58:21.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.733+0000 7f59ece11700 1 --2- 172.21.15.80:0/2401939005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f59cc018730 0x7f59cc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:21.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.733+0000 7f59ece11700 1 --2- 172.21.15.80:0/2401939005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f59cc018730 0x7f59cc01abc0 crc :-1 s=READY pgs=1180 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:21.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.740+0000 7f59ee874700 1 -- 172.21.15.80:0/2401939005 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e807a660 con 0x7f59e812e610 2019-11-28T11:58:21.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.743+0000 7f59ed612700 1 --2- 172.21.15.80:0/2401939005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59e812e610 0x7f59e812ea90 secure :-1 s=THROTTLE_DONE pgs=2849 cs=0 l=1 rx=0x7f59e00107b0 tx=0x7f59e0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.743+0000 7f59e57fa700 1 -- 172.21.15.80:0/2401939005 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f59e0001660 con 0x7f59e812e610 2019-11-28T11:58:21.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.913+0000 7f59ee874700 1 -- 172.21.15.80:0/2401939005 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f59e807a2e0 con 0x7f59e812e610 2019-11-28T11:58:21.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.914+0000 7f59ed612700 1 --2- 172.21.15.80:0/2401939005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59e812e610 0x7f59e812ea90 secure :-1 s=THROTTLE_DONE pgs=2849 cs=0 l=1 rx=0x7f59e00107b0 tx=0x7f59e0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:21.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.914+0000 7f59e57fa700 1 -- 172.21.15.80:0/2401939005 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v219) v1 ==== 92+0+10 (secure 0 0 0) 0x7f59e00045c0 con 0x7f59e812e610 2019-11-28T11:58:21.911 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:58:21.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.916+0000 7f59ee874700 1 -- 172.21.15.80:0/2401939005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f59cc018730 msgr2=0x7f59cc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.916+0000 7f59ee874700 1 --2- 172.21.15.80:0/2401939005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f59cc018730 0x7f59cc01abc0 crc :-1 s=READY pgs=1180 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:21.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.916+0000 7f59ee874700 1 -- 172.21.15.80:0/2401939005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59e812e610 msgr2=0x7f59e812ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:21.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.916+0000 7f59ee874700 1 --2- 172.21.15.80:0/2401939005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59e812e610 0x7f59e812ea90 secure :-1 s=READY pgs=2849 cs=0 l=1 rx=0x7f59e00107b0 tx=0x7f59e0010b50).stop 2019-11-28T11:58:21.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.917+0000 7f59ee874700 1 -- 172.21.15.80:0/2401939005 shutdown_connections 2019-11-28T11:58:21.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.917+0000 7f59ee874700 1 --2- 172.21.15.80:0/2401939005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59e812e610 0x7f59e812ea90 unknown :-1 s=CLOSED pgs=2849 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:21.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.917+0000 7f59ee874700 1 --2- 172.21.15.80:0/2401939005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f59cc018730 0x7f59cc01abc0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:21.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.917+0000 7f59ee874700 1 -- 172.21.15.80:0/2401939005 shutdown_connections 2019-11-28T11:58:21.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.917+0000 7f59ee874700 1 -- 172.21.15.80:0/2401939005 wait complete. 2019-11-28T11:58:21.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:21.917+0000 7f59ee874700 1 -- 172.21.15.80:0/2401939005 >> 172.21.15.80:0/2401939005 conn(0x7f59e8166440 msgr2=0x7f59e81494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:21.923 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T11:58:22.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.046+0000 7fe49d055700 1 Processor -- start 2019-11-28T11:58:22.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.046+0000 7fe49d055700 1 -- start start 2019-11-28T11:58:22.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.047+0000 7fe49d055700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe49806c490 0x7fe49806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:22.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.047+0000 7fe49d055700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe49806ce60 0x7fe498164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:22.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.047+0000 7fe49d055700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49806db00 con 0x7fe49806c0a0 2019-11-28T11:58:22.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.047+0000 7fe49d055700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49806fd60 con 0x7fe49806ce60 2019-11-28T11:58:22.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.047+0000 7fe49d055700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe498070030 con 0x7fe49806c490 2019-11-28T11:58:22.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.047+0000 7fe49759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe49806c0a0 0x7fe498072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46164/0 (socket says 172.21.15.80:46164) 2019-11-28T11:58:22.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.047+0000 7fe49759e700 1 -- 172.21.15.80:0/4263341560 learned_addr learned my addr 172.21.15.80:0/4263341560 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:22.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.047+0000 7fe49c854700 1 --2- 172.21.15.80:0/4263341560 >> v2:172.21.15.174:3300/0 conn(0x7fe49806ce60 0x7fe498164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:22.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.047+0000 7fe496d9d700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe49806c490 0x7fe49806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:22.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.047+0000 7fe49659c700 1 -- 172.21.15.80:0/4263341560 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345804867 0 0) 0x7fe488001150 con 0x7fe49806c0a0 2019-11-28T11:58:22.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.047+0000 7fe49659c700 1 -- 172.21.15.80:0/4263341560 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe478002e80 con 0x7fe49806c0a0 2019-11-28T11:58:22.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 -- 172.21.15.80:0/4263341560 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 769130175 0 0) 0x7fe488001130 con 0x7fe49806c0a0 2019-11-28T11:58:22.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 -- 172.21.15.80:0/4263341560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe49806c490 msgr2=0x7fe49806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:22.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe49806c490 0x7fe49806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:22.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 -- 172.21.15.80:0/4263341560 >> v2:172.21.15.174:3300/0 conn(0x7fe49806ce60 msgr2=0x7fe498164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:22.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 --2- 172.21.15.80:0/4263341560 >> v2:172.21.15.174:3300/0 conn(0x7fe49806ce60 0x7fe498164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:22.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 -- 172.21.15.80:0/4263341560 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4980706c0 con 0x7fe49806c0a0 2019-11-28T11:58:22.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 -- 172.21.15.80:0/4263341560 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fe488001660 con 0x7fe49806c0a0 2019-11-28T11:58:22.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 -- 172.21.15.80:0/4263341560 >> v1:172.21.15.80:6789/0 conn(0x7fe49806c0a0 legacy=0x7fe498072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:22.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe478047a90 0x7fe478049ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:22.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe47804a670 0x7fe47804cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:22.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe47804d310 0x7fe47804f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:22.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 -- 172.21.15.80:0/4263341560 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47804fff0 con 0x7fe478047a90 2019-11-28T11:58:22.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 -- 172.21.15.80:0/4263341560 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780501e0 con 0x7fe47804d310 2019-11-28T11:58:22.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 -- 172.21.15.80:0/4263341560 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe478050410 con 0x7fe47804a670 2019-11-28T11:58:22.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49c854700 1 --2- 172.21.15.80:0/4263341560 >> v2:172.21.15.174:3300/0 conn(0x7fe49806ce60 0x7fe498164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:22.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49759e700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe478047a90 0x7fe478049ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:22.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe496d9d700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe47804a670 0x7fe47804cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:22.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49c854700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe47804d310 0x7fe47804f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:22.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49759e700 1 -- 172.21.15.80:0/4263341560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe47804a670 msgr2=0x7fe47804cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:22.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49759e700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe47804a670 0x7fe47804cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:22.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49759e700 1 -- 172.21.15.80:0/4263341560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe47804d310 msgr2=0x7fe47804f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:22.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49759e700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe47804d310 0x7fe47804f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:22.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49759e700 1 -- 172.21.15.80:0/4263341560 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4780506c0 con 0x7fe478047a90 2019-11-28T11:58:22.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49759e700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe478047a90 0x7fe478049ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe48800f890 tx=0x7fe488001500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49759e700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe478047a90 0x7fe478049ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe48800f890 tx=0x7fe488001500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49759e700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe478047a90 0x7fe478049ef0 secure :-1 s=READY pgs=2851 cs=0 l=1 rx=0x7fe48800f890 tx=0x7fe488001500).ready entity=mon.0 client_cookie=850248959dcfcfb1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:22.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49759e700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe478047a90 0x7fe478049ef0 secure :-1 s=THROTTLE_DONE pgs=2851 cs=0 l=1 rx=0x7fe48800f890 tx=0x7fe488001500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 -- 172.21.15.80:0/4263341560 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe488001880 con 0x7fe478047a90 2019-11-28T11:58:22.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49759e700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe478047a90 0x7fe478049ef0 secure :-1 s=THROTTLE_DONE pgs=2851 cs=0 l=1 rx=0x7fe48800f890 tx=0x7fe488001500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49759e700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe478047a90 0x7fe478049ef0 secure :-1 s=THROTTLE_DONE pgs=2851 cs=0 l=1 rx=0x7fe48800f890 tx=0x7fe488001500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 -- 172.21.15.80:0/4263341560 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe488004430 con 0x7fe478047a90 2019-11-28T11:58:22.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49659c700 1 -- 172.21.15.80:0/4263341560 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe488004b40 con 0x7fe478047a90 2019-11-28T11:58:22.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49d055700 1 -- 172.21.15.80:0/4263341560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe478047a90 msgr2=0x7fe478049ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49d055700 1 --2- 172.21.15.80:0/4263341560 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe478047a90 0x7fe478049ef0 secure :-1 s=READY pgs=2851 cs=0 l=1 rx=0x7fe48800f890 tx=0x7fe488001500).stop 2019-11-28T11:58:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.048+0000 7fe49c854700 1 -- 172.21.15.80:0/4263341560 reap_dead start 2019-11-28T11:58:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.049+0000 7fe49d055700 1 -- 172.21.15.80:0/4263341560 shutdown_connections 2019-11-28T11:58:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.049+0000 7fe49d055700 1 -- 172.21.15.80:0/4263341560 shutdown_connections 2019-11-28T11:58:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.049+0000 7fe49d055700 1 -- 172.21.15.80:0/4263341560 wait complete. 2019-11-28T11:58:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.049+0000 7fe49d055700 1 -- 172.21.15.80:0/4263341560 >> 172.21.15.80:0/4263341560 conn(0x7fe498061cf0 msgr2=0x7fe498064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:22.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.052+0000 7fe49d055700 1 Processor -- start 2019-11-28T11:58:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.052+0000 7fe49d055700 1 -- start start 2019-11-28T11:58:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49d055700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe498166d80 0x7fe498169180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49d055700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe498107940 con 0x7fe4981061f0 2019-11-28T11:58:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49d055700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe498106a80 con 0x7fe49810f520 2019-11-28T11:58:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49d055700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49810c300 con 0x7fe498166d80 2019-11-28T11:58:22.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe4981061f0 0x7fe49813a350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46176/0 (socket says 172.21.15.80:46176) 2019-11-28T11:58:22.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49759e700 1 -- 172.21.15.80:0/2107949406 learned_addr learned my addr 172.21.15.80:0/2107949406 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:22.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49c854700 1 --2- 172.21.15.80:0/2107949406 >> v2:172.21.15.80:3300/0 conn(0x7fe498166d80 0x7fe498169180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:22.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe48ffff700 1 -- 172.21.15.80:0/2107949406 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534906232 0 0) 0x7fe488001020 con 0x7fe4981061f0 2019-11-28T11:58:22.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe48ffff700 1 -- 172.21.15.80:0/2107949406 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe470002e80 con 0x7fe4981061f0 2019-11-28T11:58:22.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49c854700 1 -- 172.21.15.80:0/2107949406 >> v1:172.21.15.174:6789/0 conn(0x7fe49810f520 legacy=0x7fe49813ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe48ffff700 1 -- 172.21.15.80:0/2107949406 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226796236 0 0) 0x7fe4800012b0 con 0x7fe49810f520 2019-11-28T11:58:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49c854700 1 -- 172.21.15.80:0/2107949406 >> v1:172.21.15.80:6789/0 conn(0x7fe4981061f0 legacy=0x7fe49813a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49c854700 1 -- 172.21.15.80:0/2107949406 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49810cc60 con 0x7fe498166d80 2019-11-28T11:58:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49c854700 1 --2- 172.21.15.80:0/2107949406 >> v2:172.21.15.80:3300/0 conn(0x7fe498166d80 0x7fe498169180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe4900103b0 tx=0x7fe490010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49c854700 1 --2- 172.21.15.80:0/2107949406 >> v2:172.21.15.80:3300/0 conn(0x7fe498166d80 0x7fe498169180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe4900103b0 tx=0x7fe490010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49c854700 1 --2- 172.21.15.80:0/2107949406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe498166d80 0x7fe498169180 secure :-1 s=READY pgs=2853 cs=0 l=1 rx=0x7fe4900103b0 tx=0x7fe490010750).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49c854700 1 --2- 172.21.15.80:0/2107949406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe498166d80 0x7fe498169180 secure :-1 s=THROTTLE_DONE pgs=2853 cs=0 l=1 rx=0x7fe4900103b0 tx=0x7fe490010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe48ffff700 1 -- 172.21.15.80:0/2107949406 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe49000a740 con 0x7fe498166d80 2019-11-28T11:58:22.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49c854700 1 --2- 172.21.15.80:0/2107949406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe498166d80 0x7fe498169180 secure :-1 s=THROTTLE_DONE pgs=2853 cs=0 l=1 rx=0x7fe4900103b0 tx=0x7fe490010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49c854700 1 --2- 172.21.15.80:0/2107949406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe498166d80 0x7fe498169180 secure :-1 s=THROTTLE_DONE pgs=2853 cs=0 l=1 rx=0x7fe4900103b0 tx=0x7fe490010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe48ffff700 1 -- 172.21.15.80:0/2107949406 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4900095b0 con 0x7fe498166d80 2019-11-28T11:58:22.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe48ffff700 1 -- 172.21.15.80:0/2107949406 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe490009d70 con 0x7fe498166d80 2019-11-28T11:58:22.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49d055700 1 -- 172.21.15.80:0/2107949406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49810cfe0 con 0x7fe498166d80 2019-11-28T11:58:22.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.053+0000 7fe49d055700 1 -- 172.21.15.80:0/2107949406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49810cc60 con 0x7fe498166d80 2019-11-28T11:58:22.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.054+0000 7fe49c854700 1 --2- 172.21.15.80:0/2107949406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe498166d80 0x7fe498169180 secure :-1 s=THROTTLE_DONE pgs=2853 cs=0 l=1 rx=0x7fe4900103b0 tx=0x7fe490010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.054+0000 7fe48ffff700 1 -- 172.21.15.80:0/2107949406 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe4900097a0 con 0x7fe498166d80 2019-11-28T11:58:22.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.054+0000 7fe49c854700 1 --2- 172.21.15.80:0/2107949406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe498166d80 0x7fe498169180 secure :-1 s=THROTTLE_DONE pgs=2853 cs=0 l=1 rx=0x7fe4900103b0 tx=0x7fe490010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.054+0000 7fe48ffff700 1 --2- 172.21.15.80:0/2107949406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe470018780 0x7fe47001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:22.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.054+0000 7fe48ffff700 1 -- 172.21.15.80:0/2107949406 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fe490031b00 con 0x7fe498166d80 2019-11-28T11:58:22.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.054+0000 7fe49759e700 1 --2- 172.21.15.80:0/2107949406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe470018780 0x7fe47001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.055+0000 7fe49759e700 1 --2- 172.21.15.80:0/2107949406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe470018780 0x7fe47001abf0 crc :-1 s=READY pgs=1181 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.061+0000 7fe49d055700 1 -- 172.21.15.80:0/2107949406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49810cfe0 con 0x7fe498166d80 2019-11-28T11:58:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.065+0000 7fe49c854700 1 --2- 172.21.15.80:0/2107949406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe498166d80 0x7fe498169180 secure :-1 s=THROTTLE_DONE pgs=2853 cs=0 l=1 rx=0x7fe4900103b0 tx=0x7fe490010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.065+0000 7fe48ffff700 1 -- 172.21.15.80:0/2107949406 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe490000a70 con 0x7fe498166d80 2019-11-28T11:58:22.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.227+0000 7fe49d055700 1 -- 172.21.15.80:0/2107949406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe49810cc60 con 0x7fe498166d80 2019-11-28T11:58:22.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.227+0000 7fe49c854700 1 --2- 172.21.15.80:0/2107949406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe498166d80 0x7fe498169180 secure :-1 s=THROTTLE_DONE pgs=2853 cs=0 l=1 rx=0x7fe4900103b0 tx=0x7fe490010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.227+0000 7fe48ffff700 1 -- 172.21.15.80:0/2107949406 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v219) v1 ==== 84+0+64 (secure 0 0 0) 0x7fe4900097a0 con 0x7fe498166d80 2019-11-28T11:58:22.224 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:22.225 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:58:22.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:22.225 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T11:58:22.225 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T11:58:22.225 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:22.225 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:58:22.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.230+0000 7fe49d055700 1 -- 172.21.15.80:0/2107949406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe470018780 msgr2=0x7fe47001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:22.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.230+0000 7fe49d055700 1 --2- 172.21.15.80:0/2107949406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe470018780 0x7fe47001abf0 crc :-1 s=READY pgs=1181 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:22.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.230+0000 7fe49d055700 1 -- 172.21.15.80:0/2107949406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe498166d80 msgr2=0x7fe498169180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:22.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.230+0000 7fe49d055700 1 --2- 172.21.15.80:0/2107949406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe498166d80 0x7fe498169180 secure :-1 s=READY pgs=2853 cs=0 l=1 rx=0x7fe4900103b0 tx=0x7fe490010750).stop 2019-11-28T11:58:22.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.230+0000 7fe49d055700 1 -- 172.21.15.80:0/2107949406 shutdown_connections 2019-11-28T11:58:22.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.230+0000 7fe49d055700 1 --2- 172.21.15.80:0/2107949406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe498166d80 0x7fe498169180 unknown :-1 s=CLOSED pgs=2853 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:22.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.230+0000 7fe49d055700 1 --2- 172.21.15.80:0/2107949406 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe470018780 0x7fe47001abf0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:22.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.230+0000 7fe49d055700 1 -- 172.21.15.80:0/2107949406 shutdown_connections 2019-11-28T11:58:22.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.230+0000 7fe49d055700 1 -- 172.21.15.80:0/2107949406 wait complete. 2019-11-28T11:58:22.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.230+0000 7fe49d055700 1 -- 172.21.15.80:0/2107949406 >> 172.21.15.80:0/2107949406 conn(0x7fe498142090 msgr2=0x7fe49810ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:22.236 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T11:58:22.237 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T11:58:22.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.365+0000 7fa215dd1700 1 Processor -- start 2019-11-28T11:58:22.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.365+0000 7fa215dd1700 1 -- start start 2019-11-28T11:58:22.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.366+0000 7fa215dd1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa21015ed10 0x7fa21015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:22.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.366+0000 7fa215dd1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa210073020 0x7fa210071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:22.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.366+0000 7fa215dd1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa21006db60 con 0x7fa2100734b0 2019-11-28T11:58:22.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.366+0000 7fa215dd1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21006f3d0 con 0x7fa210073020 2019-11-28T11:58:22.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.366+0000 7fa215dd1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21006fe00 con 0x7fa21015ed10 2019-11-28T11:58:22.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.366+0000 7fa207fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa210073020 0x7fa210071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:22.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.366+0000 7fa207fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa210073020 0x7fa210071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46868/0 (socket says 172.21.15.80:46868) 2019-11-28T11:58:22.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.366+0000 7fa207fff700 1 -- 172.21.15.80:0/3833620108 learned_addr learned my addr 172.21.15.80:0/3833620108 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:22.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa20ffff700 1 --2- 172.21.15.80:0/3833620108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa21015ed10 0x7fa21015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:22.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa207fff700 1 -- 172.21.15.80:0/3833620108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa21015ed10 msgr2=0x7fa21015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:22.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa207fff700 1 --2- 172.21.15.80:0/3833620108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa21015ed10 0x7fa21015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:22.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa207fff700 1 -- 172.21.15.80:0/3833620108 >> v1:172.21.15.80:6789/0 conn(0x7fa2100734b0 legacy=0x7fa2100723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:22.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa20f7fe700 1 -- 172.21.15.80:0/3833620108 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306288928 0 0) 0x7fa208001480 con 0x7fa2100734b0 2019-11-28T11:58:22.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa207fff700 1 -- 172.21.15.80:0/3833620108 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa210070760 con 0x7fa210073020 2019-11-28T11:58:22.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa207fff700 1 --2- 172.21.15.80:0/3833620108 >> v2:172.21.15.80:3300/0 conn(0x7fa210073020 0x7fa210071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa1f800f6c0 tx=0x7fa1f800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa207fff700 1 --2- 172.21.15.80:0/3833620108 >> v2:172.21.15.80:3300/0 conn(0x7fa210073020 0x7fa210071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa1f800f6c0 tx=0x7fa1f800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa207fff700 1 --2- 172.21.15.80:0/3833620108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa210073020 0x7fa210071ea0 secure :-1 s=READY pgs=2855 cs=0 l=1 rx=0x7fa1f800f6c0 tx=0x7fa1f800fa60).ready entity=mon.0 client_cookie=2388f7405c1de03f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:22.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa207fff700 1 --2- 172.21.15.80:0/3833620108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa210073020 0x7fa210071ea0 secure :-1 s=THROTTLE_DONE pgs=2855 cs=0 l=1 rx=0x7fa1f800f6c0 tx=0x7fa1f800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa20f7fe700 1 -- 172.21.15.80:0/3833620108 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1f8000960 con 0x7fa210073020 2019-11-28T11:58:22.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa207fff700 1 --2- 172.21.15.80:0/3833620108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa210073020 0x7fa210071ea0 secure :-1 s=THROTTLE_DONE pgs=2855 cs=0 l=1 rx=0x7fa1f800f6c0 tx=0x7fa1f800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa207fff700 1 --2- 172.21.15.80:0/3833620108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa210073020 0x7fa210071ea0 secure :-1 s=THROTTLE_DONE pgs=2855 cs=0 l=1 rx=0x7fa1f800f6c0 tx=0x7fa1f800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa20f7fe700 1 -- 172.21.15.80:0/3833620108 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f8000c90 con 0x7fa210073020 2019-11-28T11:58:22.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa20f7fe700 1 -- 172.21.15.80:0/3833620108 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1f80013a0 con 0x7fa210073020 2019-11-28T11:58:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa215dd1700 1 -- 172.21.15.80:0/3833620108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa210073020 msgr2=0x7fa210071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.367+0000 7fa215dd1700 1 --2- 172.21.15.80:0/3833620108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa210073020 0x7fa210071ea0 secure :-1 s=READY pgs=2855 cs=0 l=1 rx=0x7fa1f800f6c0 tx=0x7fa1f800fa60).stop 2019-11-28T11:58:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.368+0000 7fa215dd1700 1 -- 172.21.15.80:0/3833620108 shutdown_connections 2019-11-28T11:58:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.368+0000 7fa215dd1700 1 --2- 172.21.15.80:0/3833620108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa210073020 0x7fa210071ea0 unknown :-1 s=CLOSED pgs=2855 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.368+0000 7fa215dd1700 1 --2- 172.21.15.80:0/3833620108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa21015ed10 0x7fa21015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:22.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.368+0000 7fa215dd1700 1 -- 172.21.15.80:0/3833620108 shutdown_connections 2019-11-28T11:58:22.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.368+0000 7fa215dd1700 1 -- 172.21.15.80:0/3833620108 wait complete. 2019-11-28T11:58:22.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.368+0000 7fa215dd1700 1 -- 172.21.15.80:0/3833620108 >> 172.21.15.80:0/3833620108 conn(0x7fa210061d20 msgr2=0x7fa2100641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:22.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.370+0000 7fa215dd1700 1 Processor -- start 2019-11-28T11:58:22.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.370+0000 7fa215dd1700 1 -- start start 2019-11-28T11:58:22.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.371+0000 7fa215dd1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2101079b0 0x7fa210107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:22.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.371+0000 7fa215dd1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa210108380 0x7fa210168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:22.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.371+0000 7fa215dd1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2101087d0 con 0x7fa210148320 2019-11-28T11:58:22.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.371+0000 7fa215dd1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21013aa20 con 0x7fa210108380 2019-11-28T11:58:22.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.371+0000 7fa215dd1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21013acf0 con 0x7fa2101079b0 2019-11-28T11:58:22.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.371+0000 7fa20ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa210148320 0x7fa21010ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46190/0 (socket says 172.21.15.80:46190) 2019-11-28T11:58:22.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.371+0000 7fa20ffff700 1 -- 172.21.15.80:0/4166726012 learned_addr learned my addr 172.21.15.80:0/4166726012 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:22.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.371+0000 7fa207fff700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2101079b0 0x7fa210107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:22.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.371+0000 7fa214b6f700 1 --2- 172.21.15.80:0/4166726012 >> v2:172.21.15.174:3300/0 conn(0x7fa210108380 0x7fa210168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:22.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.371+0000 7fa20d7fa700 1 -- 172.21.15.80:0/4166726012 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322389574 0 0) 0x7fa2000010b0 con 0x7fa210148320 2019-11-28T11:58:22.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.371+0000 7fa20d7fa700 1 -- 172.21.15.80:0/4166726012 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1f4002e80 con 0x7fa210148320 2019-11-28T11:58:22.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa20d7fa700 1 -- 172.21.15.80:0/4166726012 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 407317438 0 0) 0x7fa2000012b0 con 0x7fa210148320 2019-11-28T11:58:22.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa207fff700 1 -- 172.21.15.80:0/4166726012 >> v2:172.21.15.174:3300/0 conn(0x7fa210108380 msgr2=0x7fa210168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:22.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa207fff700 1 --2- 172.21.15.80:0/4166726012 >> v2:172.21.15.174:3300/0 conn(0x7fa210108380 0x7fa210168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:22.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa207fff700 1 -- 172.21.15.80:0/4166726012 >> v1:172.21.15.80:6789/0 conn(0x7fa210148320 legacy=0x7fa21010ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:22.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa207fff700 1 -- 172.21.15.80:0/4166726012 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21010c490 con 0x7fa2101079b0 2019-11-28T11:58:22.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa207fff700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2101079b0 0x7fa210107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1f8010370 tx=0x7fa1f80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa207fff700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2101079b0 0x7fa210107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1f8010370 tx=0x7fa1f80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa207fff700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2101079b0 0x7fa210107e40 secure :-1 s=READY pgs=413 cs=0 l=1 rx=0x7fa1f8010370 tx=0x7fa1f80101f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:22.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa207fff700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2101079b0 0x7fa210107e40 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7fa1f8010370 tx=0x7fa1f80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa20d7fa700 1 -- 172.21.15.80:0/4166726012 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1f8007a90 con 0x7fa2101079b0 2019-11-28T11:58:22.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa207fff700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2101079b0 0x7fa210107e40 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7fa1f8010370 tx=0x7fa1f80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa20d7fa700 1 -- 172.21.15.80:0/4166726012 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f8007250 con 0x7fa2101079b0 2019-11-28T11:58:22.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa207fff700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2101079b0 0x7fa210107e40 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7fa1f8010370 tx=0x7fa1f80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa215dd1700 1 -- 172.21.15.80:0/4166726012 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21010c810 con 0x7fa2101079b0 2019-11-28T11:58:22.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa20d7fa700 1 -- 172.21.15.80:0/4166726012 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1f8000940 con 0x7fa2101079b0 2019-11-28T11:58:22.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa215dd1700 1 -- 172.21.15.80:0/4166726012 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21010c490 con 0x7fa2101079b0 2019-11-28T11:58:22.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.372+0000 7fa207fff700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2101079b0 0x7fa210107e40 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7fa1f8010370 tx=0x7fa1f80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.373+0000 7fa20d7fa700 1 -- 172.21.15.80:0/4166726012 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa1f8005390 con 0x7fa2101079b0 2019-11-28T11:58:22.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.373+0000 7fa207fff700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2101079b0 0x7fa210107e40 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7fa1f8010370 tx=0x7fa1f80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.373+0000 7fa20d7fa700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa1f4018780 0x7fa1f401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:22.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.373+0000 7fa20d7fa700 1 -- 172.21.15.80:0/4166726012 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fa1f80319f0 con 0x7fa2101079b0 2019-11-28T11:58:22.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.373+0000 7fa20ffff700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa1f4018780 0x7fa1f401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:22.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.373+0000 7fa20ffff700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa1f4018780 0x7fa1f401abf0 crc :-1 s=READY pgs=1182 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:22.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.380+0000 7fa215dd1700 1 -- 172.21.15.80:0/4166726012 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21010c810 con 0x7fa2101079b0 2019-11-28T11:58:22.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.384+0000 7fa207fff700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2101079b0 0x7fa210107e40 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7fa1f8010370 tx=0x7fa1f80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.384+0000 7fa20d7fa700 1 -- 172.21.15.80:0/4166726012 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa1f8005180 con 0x7fa2101079b0 2019-11-28T11:58:22.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.553+0000 7fa215dd1700 1 -- 172.21.15.80:0/4166726012 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7fa21010c490 con 0x7fa2101079b0 2019-11-28T11:58:22.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.906+0000 7fa207fff700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2101079b0 0x7fa210107e40 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7fa1f8010370 tx=0x7fa1f80101f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:22.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.906+0000 7fa20d7fa700 1 -- 172.21.15.80:0/4166726012 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v220) v1 ==== 133+0+0 (secure 0 0 0) 0x7fa1f8017360 con 0x7fa2101079b0 2019-11-28T11:58:22.913 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T11:58:22.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.919+0000 7fa215dd1700 1 -- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa1f4018780 msgr2=0x7fa1f401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:22.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.919+0000 7fa215dd1700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa1f4018780 0x7fa1f401abf0 crc :-1 s=READY pgs=1182 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:22.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.919+0000 7fa215dd1700 1 -- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2101079b0 msgr2=0x7fa210107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:22.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.919+0000 7fa215dd1700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2101079b0 0x7fa210107e40 secure :-1 s=READY pgs=413 cs=0 l=1 rx=0x7fa1f8010370 tx=0x7fa1f80101f0).stop 2019-11-28T11:58:22.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.920+0000 7fa215dd1700 1 -- 172.21.15.80:0/4166726012 shutdown_connections 2019-11-28T11:58:22.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.920+0000 7fa215dd1700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa1f4018780 0x7fa1f401abf0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:22.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.920+0000 7fa215dd1700 1 --2- 172.21.15.80:0/4166726012 >> v2:172.21.15.174:3300/0 conn(0x7fa210108380 0x7fa210168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:22.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.920+0000 7fa215dd1700 1 --2- 172.21.15.80:0/4166726012 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2101079b0 0x7fa210107e40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:22.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.920+0000 7fa215dd1700 1 -- 172.21.15.80:0/4166726012 shutdown_connections 2019-11-28T11:58:22.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.920+0000 7fa215dd1700 1 -- 172.21.15.80:0/4166726012 wait complete. 2019-11-28T11:58:22.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:22.920+0000 7fa215dd1700 1 -- 172.21.15.80:0/4166726012 >> 172.21.15.80:0/4166726012 conn(0x7fa21015e2d0 msgr2=0x7fa210147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:22.927 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T11:58:23.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.058+0000 7f585276a700 1 Processor -- start 2019-11-28T11:58:23.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.058+0000 7f585276a700 1 -- start start 2019-11-28T11:58:23.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.059+0000 7f585276a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f584c15f100 0x7f584c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:23.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.059+0000 7f585276a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c06db60 con 0x7f584c15ed10 2019-11-28T11:58:23.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.059+0000 7f585276a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c06e060 con 0x7f584c06c2f0 2019-11-28T11:58:23.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.059+0000 7f585276a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584c06fe00 con 0x7f584c15f100 2019-11-28T11:58:23.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f5850d07700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f584c15ed10 0x7f584c073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46198/0 (socket says 172.21.15.80:46198) 2019-11-28T11:58:23.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f5850d07700 1 -- 172.21.15.80:0/616191775 learned_addr learned my addr 172.21.15.80:0/616191775 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:23.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584bfff700 1 --2- 172.21.15.80:0/616191775 >> v2:172.21.15.174:3300/0 conn(0x7f584c15f100 0x7f584c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:23.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584b7fe700 1 -- 172.21.15.80:0/616191775 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692459957 0 0) 0x7f5834001150 con 0x7f584c15ed10 2019-11-28T11:58:23.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584b7fe700 1 -- 172.21.15.80:0/616191775 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5838002e80 con 0x7f584c15ed10 2019-11-28T11:58:23.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584b7fe700 1 -- 172.21.15.80:0/616191775 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570551113 0 0) 0x7f58440009b0 con 0x7f584c06c2f0 2019-11-28T11:58:23.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584b7fe700 1 -- 172.21.15.80:0/616191775 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5838004170 con 0x7f584c06c2f0 2019-11-28T11:58:23.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584bfff700 1 -- 172.21.15.80:0/616191775 >> v1:172.21.15.174:6789/0 conn(0x7f584c06c2f0 legacy=0x7f584c06c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:23.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584bfff700 1 -- 172.21.15.80:0/616191775 >> v1:172.21.15.80:6789/0 conn(0x7f584c15ed10 legacy=0x7f584c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:23.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584bfff700 1 -- 172.21.15.80:0/616191775 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c070760 con 0x7f584c15f100 2019-11-28T11:58:23.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584bfff700 1 --2- 172.21.15.80:0/616191775 >> v2:172.21.15.174:3300/0 conn(0x7f584c15f100 0x7f584c06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f583c00b2d0 tx=0x7f583c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:23.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584bfff700 1 --2- 172.21.15.80:0/616191775 >> v2:172.21.15.174:3300/0 conn(0x7f584c15f100 0x7f584c06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f583c00b2d0 tx=0x7f583c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:23.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584bfff700 1 --2- 172.21.15.80:0/616191775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f584c15f100 0x7f584c06bdb0 secure :-1 s=READY pgs=1729 cs=0 l=1 rx=0x7f583c00b2d0 tx=0x7f583c00bae0).ready entity=mon.1 client_cookie=c72a54b0bb96294d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:23.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584bfff700 1 --2- 172.21.15.80:0/616191775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f584c15f100 0x7f584c06bdb0 secure :-1 s=THROTTLE_DONE pgs=1729 cs=0 l=1 rx=0x7f583c00b2d0 tx=0x7f583c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:23.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584b7fe700 1 -- 172.21.15.80:0/616191775 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f583c000ce0 con 0x7f584c15f100 2019-11-28T11:58:23.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584bfff700 1 --2- 172.21.15.80:0/616191775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f584c15f100 0x7f584c06bdb0 secure :-1 s=THROTTLE_DONE pgs=1729 cs=0 l=1 rx=0x7f583c00b2d0 tx=0x7f583c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:23.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584bfff700 1 --2- 172.21.15.80:0/616191775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f584c15f100 0x7f584c06bdb0 secure :-1 s=THROTTLE_DONE pgs=1729 cs=0 l=1 rx=0x7f583c00b2d0 tx=0x7f583c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:23.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584b7fe700 1 -- 172.21.15.80:0/616191775 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c009be0 con 0x7f584c15f100 2019-11-28T11:58:23.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f584b7fe700 1 -- 172.21.15.80:0/616191775 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f583c00a2b0 con 0x7f584c15f100 2019-11-28T11:58:23.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f585276a700 1 -- 172.21.15.80:0/616191775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f584c15f100 msgr2=0x7f584c06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:23.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.060+0000 7f585276a700 1 --2- 172.21.15.80:0/616191775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f584c15f100 0x7f584c06bdb0 secure :-1 s=READY pgs=1729 cs=0 l=1 rx=0x7f583c00b2d0 tx=0x7f583c00bae0).stop 2019-11-28T11:58:23.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.061+0000 7f585276a700 1 -- 172.21.15.80:0/616191775 shutdown_connections 2019-11-28T11:58:23.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.061+0000 7f585276a700 1 --2- 172.21.15.80:0/616191775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f584c15f100 0x7f584c06bdb0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:23.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.061+0000 7f585276a700 1 -- 172.21.15.80:0/616191775 shutdown_connections 2019-11-28T11:58:23.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.061+0000 7f585276a700 1 -- 172.21.15.80:0/616191775 wait complete. 2019-11-28T11:58:23.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.061+0000 7f585276a700 1 -- 172.21.15.80:0/616191775 >> 172.21.15.80:0/616191775 conn(0x7f584c061d20 msgr2=0x7f584c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:23.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.063+0000 7f585276a700 1 Processor -- start 2019-11-28T11:58:23.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.063+0000 7f585276a700 1 -- start start 2019-11-28T11:58:23.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.064+0000 7f585276a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f584c10e970 0x7f584c1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:23.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.064+0000 7f585276a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c10c250 con 0x7f584c107e30 2019-11-28T11:58:23.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.064+0000 7f585276a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c10c6d0 con 0x7f584c108cf0 2019-11-28T11:58:23.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.064+0000 7f585276a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c10da00 con 0x7f584c10e970 2019-11-28T11:58:23.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f5851508700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f584c107e30 0x7f584c167d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46208/0 (socket says 172.21.15.80:46208) 2019-11-28T11:58:23.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f5851508700 1 -- 172.21.15.80:0/3913598581 learned_addr learned my addr 172.21.15.80:0/3913598581 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:23.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f5850d07700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f584c10e970 0x7f584c1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:23.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f58497fa700 1 -- 172.21.15.80:0/3913598581 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673128153 0 0) 0x7f58440010b0 con 0x7f584c107e30 2019-11-28T11:58:23.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f58497fa700 1 -- 172.21.15.80:0/3913598581 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5830002e80 con 0x7f584c107e30 2019-11-28T11:58:23.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f58497fa700 1 -- 172.21.15.80:0/3913598581 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057670041 0 0) 0x7f583c000cc0 con 0x7f584c108cf0 2019-11-28T11:58:23.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f58497fa700 1 -- 172.21.15.80:0/3913598581 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58300030b0 con 0x7f584c108cf0 2019-11-28T11:58:23.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f5850d07700 1 -- 172.21.15.80:0/3913598581 >> v1:172.21.15.174:6789/0 conn(0x7f584c108cf0 legacy=0x7f584c107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:23.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f5850d07700 1 -- 172.21.15.80:0/3913598581 >> v1:172.21.15.80:6789/0 conn(0x7f584c107e30 legacy=0x7f584c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:23.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f58497fa700 1 -- 172.21.15.80:0/3913598581 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2478601558 0 0) 0x7f58440011a0 con 0x7f584c107e30 2019-11-28T11:58:23.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f5850d07700 1 -- 172.21.15.80:0/3913598581 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c105ef0 con 0x7f584c10e970 2019-11-28T11:58:23.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f5850d07700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f584c10e970 0x7f584c1087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5834010380 tx=0x7f5834010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:23.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f5850d07700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f584c10e970 0x7f584c1087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5834010380 tx=0x7f5834010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:23.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f5850d07700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f584c10e970 0x7f584c1087b0 secure :-1 s=READY pgs=414 cs=0 l=1 rx=0x7f5834010380 tx=0x7f5834010720).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:23.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f5850d07700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f584c10e970 0x7f584c1087b0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f5834010380 tx=0x7f5834010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:23.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f58497fa700 1 -- 172.21.15.80:0/3913598581 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5834000d80 con 0x7f584c10e970 2019-11-28T11:58:23.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f5850d07700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f584c10e970 0x7f584c1087b0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f5834010380 tx=0x7f5834010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:23.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f5850d07700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f584c10e970 0x7f584c1087b0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f5834010380 tx=0x7f5834010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:23.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f58497fa700 1 -- 172.21.15.80:0/3913598581 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5834001380 con 0x7f584c10e970 2019-11-28T11:58:23.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f585276a700 1 -- 172.21.15.80:0/3913598581 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584c106270 con 0x7f584c10e970 2019-11-28T11:58:23.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f58497fa700 1 -- 172.21.15.80:0/3913598581 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5834000c90 con 0x7f584c10e970 2019-11-28T11:58:23.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.065+0000 7f585276a700 1 -- 172.21.15.80:0/3913598581 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584c105ef0 con 0x7f584c10e970 2019-11-28T11:58:23.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.066+0000 7f5850d07700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f584c10e970 0x7f584c1087b0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f5834010380 tx=0x7f5834010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:23.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.066+0000 7f58497fa700 1 -- 172.21.15.80:0/3913598581 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5834000f40 con 0x7f584c10e970 2019-11-28T11:58:23.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.066+0000 7f5850d07700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f584c10e970 0x7f584c1087b0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f5834010380 tx=0x7f5834010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:23.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.066+0000 7f58497fa700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5830018750 0x7f583001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:23.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.066+0000 7f58497fa700 1 -- 172.21.15.80:0/3913598581 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f5834031a90 con 0x7f584c10e970 2019-11-28T11:58:23.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.066+0000 7f584bfff700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5830018750 0x7f583001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:23.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.067+0000 7f584bfff700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5830018750 0x7f583001abe0 crc :-1 s=READY pgs=1183 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:23.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.074+0000 7f585276a700 1 -- 172.21.15.80:0/3913598581 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584c106270 con 0x7f584c10e970 2019-11-28T11:58:23.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.078+0000 7f5850d07700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f584c10e970 0x7f584c1087b0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f5834010380 tx=0x7f5834010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:23.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.078+0000 7f58497fa700 1 -- 172.21.15.80:0/3913598581 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5834000c90 con 0x7f584c10e970 2019-11-28T11:58:23.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.245+0000 7f585276a700 1 -- 172.21.15.80:0/3913598581 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f584c105ef0 con 0x7f584c10e970 2019-11-28T11:58:23.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.910+0000 7f5850d07700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f584c10e970 0x7f584c1087b0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f5834010380 tx=0x7f5834010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:23.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.910+0000 7f58497fa700 1 -- 172.21.15.80:0/3913598581 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v221) v1 ==== 125+0+0 (secure 0 0 0) 0x7f5834025b90 con 0x7f584c10e970 2019-11-28T11:58:23.956 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T11:58:23.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.963+0000 7f585276a700 1 -- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5830018750 msgr2=0x7f583001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:23.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.963+0000 7f585276a700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5830018750 0x7f583001abe0 crc :-1 s=READY pgs=1183 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:23.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.963+0000 7f585276a700 1 -- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f584c10e970 msgr2=0x7f584c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:23.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.963+0000 7f585276a700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f584c10e970 0x7f584c1087b0 secure :-1 s=READY pgs=414 cs=0 l=1 rx=0x7f5834010380 tx=0x7f5834010720).stop 2019-11-28T11:58:23.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.963+0000 7f585276a700 1 -- 172.21.15.80:0/3913598581 shutdown_connections 2019-11-28T11:58:23.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.963+0000 7f585276a700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5830018750 0x7f583001abe0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:23.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.963+0000 7f585276a700 1 --2- 172.21.15.80:0/3913598581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f584c10e970 0x7f584c1087b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:23.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.963+0000 7f585276a700 1 -- 172.21.15.80:0/3913598581 shutdown_connections 2019-11-28T11:58:23.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.963+0000 7f585276a700 1 -- 172.21.15.80:0/3913598581 wait complete. 2019-11-28T11:58:23.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:23.963+0000 7f585276a700 1 -- 172.21.15.80:0/3913598581 >> 172.21.15.80:0/3913598581 conn(0x7f584c15e2d0 msgr2=0x7f584c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:23.970 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T11:58:24.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.099+0000 7f189022f700 1 Processor -- start 2019-11-28T11:58:24.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.099+0000 7f189022f700 1 -- start start 2019-11-28T11:58:24.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.100+0000 7f189022f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f188815ed10 0x7f188815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:24.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.100+0000 7f189022f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1888073020 0x7f1888071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:24.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.100+0000 7f189022f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f18880734b0 0x7f18880723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:24.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.100+0000 7f189022f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188806fe00 con 0x7f188815ed10 2019-11-28T11:58:24.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.100+0000 7f189022f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18880700d0 con 0x7f18880734b0 2019-11-28T11:58:24.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.100+0000 7f189022f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188806f3d0 con 0x7f1888073020 2019-11-28T11:58:24.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.100+0000 7f188e7cc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f188815ed10 0x7f188815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:24.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.100+0000 7f188e7cc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f188815ed10 0x7f188815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46896/0 (socket says 172.21.15.80:46896) 2019-11-28T11:58:24.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.100+0000 7f188e7cc700 1 -- 172.21.15.80:0/4138572176 learned_addr learned my addr 172.21.15.80:0/4138572176 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:24.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.100+0000 7f188dfcb700 1 --2- 172.21.15.80:0/4138572176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1888073020 0x7f1888071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:24.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.100+0000 7f188efcd700 1 --2- 172.21.15.80:0/4138572176 >> v2:172.21.15.174:3300/0 conn(0x7f18880734b0 0x7f18880723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:24.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.100+0000 7f188e7cc700 1 -- 172.21.15.80:0/4138572176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1888073020 msgr2=0x7f1888071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:24.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f188e7cc700 1 --2- 172.21.15.80:0/4138572176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1888073020 0x7f1888071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:24.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f188e7cc700 1 -- 172.21.15.80:0/4138572176 >> v2:172.21.15.174:3300/0 conn(0x7f18880734b0 msgr2=0x7f18880723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:24.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f188e7cc700 1 --2- 172.21.15.80:0/4138572176 >> v2:172.21.15.174:3300/0 conn(0x7f18880734b0 0x7f18880723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:24.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f188e7cc700 1 -- 172.21.15.80:0/4138572176 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1888070760 con 0x7f188815ed10 2019-11-28T11:58:24.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f188dfcb700 1 --2- 172.21.15.80:0/4138572176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1888073020 0x7f1888071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:24.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f188efcd700 1 --2- 172.21.15.80:0/4138572176 >> v2:172.21.15.174:3300/0 conn(0x7f18880734b0 0x7f18880723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:24.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f188e7cc700 1 --2- 172.21.15.80:0/4138572176 >> v2:172.21.15.80:3300/0 conn(0x7f188815ed10 0x7f188815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f187c00fac0 tx=0x7f187c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f188e7cc700 1 --2- 172.21.15.80:0/4138572176 >> v2:172.21.15.80:3300/0 conn(0x7f188815ed10 0x7f188815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f187c00fac0 tx=0x7f187c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f188e7cc700 1 --2- 172.21.15.80:0/4138572176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188815ed10 0x7f188815f100 secure :-1 s=READY pgs=2859 cs=0 l=1 rx=0x7f187c00fac0 tx=0x7f187c00fe60).ready entity=mon.0 client_cookie=76642e487ca63c24 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:24.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f188e7cc700 1 --2- 172.21.15.80:0/4138572176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188815ed10 0x7f188815f100 secure :-1 s=THROTTLE_DONE pgs=2859 cs=0 l=1 rx=0x7f187c00fac0 tx=0x7f187c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f188e7cc700 1 --2- 172.21.15.80:0/4138572176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188815ed10 0x7f188815f100 secure :-1 s=THROTTLE_DONE pgs=2859 cs=0 l=1 rx=0x7f187c00fac0 tx=0x7f187c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f188e7cc700 1 --2- 172.21.15.80:0/4138572176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188815ed10 0x7f188815f100 secure :-1 s=THROTTLE_DONE pgs=2859 cs=0 l=1 rx=0x7f187c00fac0 tx=0x7f187c00fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f188d7ca700 1 -- 172.21.15.80:0/4138572176 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f187c000ce0 con 0x7f188815ed10 2019-11-28T11:58:24.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f188d7ca700 1 -- 172.21.15.80:0/4138572176 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c001200 con 0x7f188815ed10 2019-11-28T11:58:24.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f188d7ca700 1 -- 172.21.15.80:0/4138572176 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f187c001950 con 0x7f188815ed10 2019-11-28T11:58:24.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f189022f700 1 -- 172.21.15.80:0/4138572176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188815ed10 msgr2=0x7f188815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.101+0000 7f189022f700 1 --2- 172.21.15.80:0/4138572176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188815ed10 0x7f188815f100 secure :-1 s=READY pgs=2859 cs=0 l=1 rx=0x7f187c00fac0 tx=0x7f187c00fe60).stop 2019-11-28T11:58:24.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.102+0000 7f189022f700 1 -- 172.21.15.80:0/4138572176 shutdown_connections 2019-11-28T11:58:24.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.102+0000 7f189022f700 1 --2- 172.21.15.80:0/4138572176 >> v2:172.21.15.174:3300/0 conn(0x7f18880734b0 0x7f18880723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:24.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.102+0000 7f189022f700 1 --2- 172.21.15.80:0/4138572176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1888073020 0x7f1888071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:24.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.102+0000 7f189022f700 1 --2- 172.21.15.80:0/4138572176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f188815ed10 0x7f188815f100 unknown :-1 s=CLOSED pgs=2859 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:24.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.102+0000 7f189022f700 1 -- 172.21.15.80:0/4138572176 shutdown_connections 2019-11-28T11:58:24.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.102+0000 7f189022f700 1 -- 172.21.15.80:0/4138572176 wait complete. 2019-11-28T11:58:24.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.102+0000 7f189022f700 1 -- 172.21.15.80:0/4138572176 >> 172.21.15.80:0/4138572176 conn(0x7f1888061d20 msgr2=0x7f18880641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:24.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.104+0000 7f189022f700 1 Processor -- start 2019-11-28T11:58:24.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.104+0000 7f189022f700 1 -- start start 2019-11-28T11:58:24.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.105+0000 7f189022f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1888153740 0x7f188813a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:24.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.105+0000 7f189022f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1888136040 con 0x7f188812e9c0 2019-11-28T11:58:24.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.105+0000 7f189022f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18881540a0 con 0x7f188813a8d0 2019-11-28T11:58:24.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.105+0000 7f189022f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1888137170 con 0x7f1888153740 2019-11-28T11:58:24.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.105+0000 7f188efcd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f188812e9c0 0x7f1888139210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46222/0 (socket says 172.21.15.80:46222) 2019-11-28T11:58:24.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.105+0000 7f188efcd700 1 -- 172.21.15.80:0/2495851057 learned_addr learned my addr 172.21.15.80:0/2495851057 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:24.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.105+0000 7f188e7cc700 1 --2- 172.21.15.80:0/2495851057 >> v2:172.21.15.174:3300/0 conn(0x7f1888153740 0x7f188813a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:24.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.105+0000 7f187affd700 1 -- 172.21.15.80:0/2495851057 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684807674 0 0) 0x7f1880009890 con 0x7f188812e9c0 2019-11-28T11:58:24.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.105+0000 7f187affd700 1 -- 172.21.15.80:0/2495851057 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1870002e80 con 0x7f188812e9c0 2019-11-28T11:58:24.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.106+0000 7f187affd700 1 -- 172.21.15.80:0/2495851057 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325524820 0 0) 0x7f1884000f30 con 0x7f188813a8d0 2019-11-28T11:58:24.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.106+0000 7f188e7cc700 1 -- 172.21.15.80:0/2495851057 >> v1:172.21.15.174:6789/0 conn(0x7f188813a8d0 legacy=0x7f188812e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.106+0000 7f188e7cc700 1 -- 172.21.15.80:0/2495851057 >> v1:172.21.15.80:6789/0 conn(0x7f188812e9c0 legacy=0x7f1888139210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.106+0000 7f188e7cc700 1 -- 172.21.15.80:0/2495851057 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1888137ad0 con 0x7f1888153740 2019-11-28T11:58:24.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.106+0000 7f188e7cc700 1 --2- 172.21.15.80:0/2495851057 >> v2:172.21.15.174:3300/0 conn(0x7f1888153740 0x7f188813a390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f187c054740 tx=0x7f187c054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.106+0000 7f188e7cc700 1 --2- 172.21.15.80:0/2495851057 >> v2:172.21.15.174:3300/0 conn(0x7f1888153740 0x7f188813a390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f187c054740 tx=0x7f187c054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.106+0000 7f188e7cc700 1 --2- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1888153740 0x7f188813a390 secure :-1 s=READY pgs=1732 cs=0 l=1 rx=0x7f187c054740 tx=0x7f187c054ae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:24.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.106+0000 7f188e7cc700 1 --2- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1888153740 0x7f188813a390 secure :-1 s=THROTTLE_DONE pgs=1732 cs=0 l=1 rx=0x7f187c054740 tx=0x7f187c054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.106+0000 7f187affd700 1 -- 172.21.15.80:0/2495851057 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f187c0084e0 con 0x7f1888153740 2019-11-28T11:58:24.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.106+0000 7f188e7cc700 1 --2- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1888153740 0x7f188813a390 secure :-1 s=THROTTLE_DONE pgs=1732 cs=0 l=1 rx=0x7f187c054740 tx=0x7f187c054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.106+0000 7f188e7cc700 1 --2- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1888153740 0x7f188813a390 secure :-1 s=THROTTLE_DONE pgs=1732 cs=0 l=1 rx=0x7f187c054740 tx=0x7f187c054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.106+0000 7f187affd700 1 -- 172.21.15.80:0/2495851057 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c0010c0 con 0x7f1888153740 2019-11-28T11:58:24.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.106+0000 7f189022f700 1 -- 172.21.15.80:0/2495851057 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1888137e50 con 0x7f1888153740 2019-11-28T11:58:24.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.106+0000 7f187affd700 1 -- 172.21.15.80:0/2495851057 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f187c0012b0 con 0x7f1888153740 2019-11-28T11:58:24.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.106+0000 7f189022f700 1 -- 172.21.15.80:0/2495851057 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1888137ad0 con 0x7f1888153740 2019-11-28T11:58:24.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.106+0000 7f188e7cc700 1 --2- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1888153740 0x7f188813a390 secure :-1 s=THROTTLE_DONE pgs=1732 cs=0 l=1 rx=0x7f187c054740 tx=0x7f187c054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.107+0000 7f187affd700 1 -- 172.21.15.80:0/2495851057 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f187c000cc0 con 0x7f1888153740 2019-11-28T11:58:24.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.107+0000 7f188e7cc700 1 --2- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1888153740 0x7f188813a390 secure :-1 s=THROTTLE_DONE pgs=1732 cs=0 l=1 rx=0x7f187c054740 tx=0x7f187c054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.107+0000 7f187affd700 1 --2- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1870018780 0x7f187001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:24.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.107+0000 7f187affd700 1 -- 172.21.15.80:0/2495851057 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5904+0+0 (secure 0 0 0) 0x7f187c075df0 con 0x7f1888153740 2019-11-28T11:58:24.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.107+0000 7f188dfcb700 1 --2- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1870018780 0x7f187001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:24.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.107+0000 7f188dfcb700 1 --2- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1870018780 0x7f187001abf0 crc :-1 s=READY pgs=1184 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:24.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.114+0000 7f189022f700 1 -- 172.21.15.80:0/2495851057 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1888137e50 con 0x7f1888153740 2019-11-28T11:58:24.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.118+0000 7f188e7cc700 1 --2- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1888153740 0x7f188813a390 secure :-1 s=THROTTLE_DONE pgs=1732 cs=0 l=1 rx=0x7f187c054740 tx=0x7f187c054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.118+0000 7f187affd700 1 -- 172.21.15.80:0/2495851057 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f187c0084e0 con 0x7f1888153740 2019-11-28T11:58:24.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.284+0000 7f189022f700 1 -- 172.21.15.80:0/2495851057 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f1888137ad0 con 0x7f1888153740 2019-11-28T11:58:24.281 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T11:58:24.286+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T11:58:24.285 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.290+0000 7f188e7cc700 1 --2- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1888153740 0x7f188813a390 secure :-1 s=THROTTLE_DONE pgs=1732 cs=0 l=1 rx=0x7f187c054740 tx=0x7f187c054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.286 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.290+0000 7f187affd700 1 -- 172.21.15.80:0/2495851057 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 36 and data pool 37 v182) v1 ==== 174+0+0 (secure 0 0 0) 0x7f187c001290 con 0x7f1888153740 2019-11-28T11:58:24.288 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 36 and data pool 37 2019-11-28T11:58:24.290 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.294+0000 7f189022f700 1 -- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1870018780 msgr2=0x7f187001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.294+0000 7f189022f700 1 --2- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1870018780 0x7f187001abf0 crc :-1 s=READY pgs=1184 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:24.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.294+0000 7f189022f700 1 -- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1888153740 msgr2=0x7f188813a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.294+0000 7f189022f700 1 --2- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1888153740 0x7f188813a390 secure :-1 s=READY pgs=1732 cs=0 l=1 rx=0x7f187c054740 tx=0x7f187c054ae0).stop 2019-11-28T11:58:24.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.294+0000 7f189022f700 1 -- 172.21.15.80:0/2495851057 shutdown_connections 2019-11-28T11:58:24.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.294+0000 7f189022f700 1 --2- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1870018780 0x7f187001abf0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:24.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.294+0000 7f189022f700 1 --2- 172.21.15.80:0/2495851057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1888153740 0x7f188813a390 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:24.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.295+0000 7f189022f700 1 -- 172.21.15.80:0/2495851057 shutdown_connections 2019-11-28T11:58:24.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.295+0000 7f189022f700 1 -- 172.21.15.80:0/2495851057 wait complete. 2019-11-28T11:58:24.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.295+0000 7f189022f700 1 -- 172.21.15.80:0/2495851057 >> 172.21.15.80:0/2495851057 conn(0x7f188814c410 msgr2=0x7f1888147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:24.300 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:58:24.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.423+0000 7fbb37e86700 1 Processor -- start 2019-11-28T11:58:24.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.423+0000 7fbb37e86700 1 -- start start 2019-11-28T11:58:24.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.424+0000 7fbb37e86700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb3006c0a0 0x7fbb30072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:24.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.424+0000 7fbb37e86700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb30072620 0x7fbb30164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:24.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.424+0000 7fbb37e86700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3006db00 con 0x7fbb300734e0 2019-11-28T11:58:24.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.424+0000 7fbb37e86700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3006fd60 con 0x7fbb3006c0a0 2019-11-28T11:58:24.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.424+0000 7fbb37e86700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb30070030 con 0x7fbb30072620 2019-11-28T11:58:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.424+0000 7fbb36423700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb3006c0a0 0x7fbb30072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.424+0000 7fbb36423700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb3006c0a0 0x7fbb30072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46910/0 (socket says 172.21.15.80:46910) 2019-11-28T11:58:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.424+0000 7fbb36423700 1 -- 172.21.15.80:0/617314431 learned_addr learned my addr 172.21.15.80:0/617314431 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.424+0000 7fbb35c22700 1 --1- 172.21.15.80:0/617314431 >> v1:172.21.15.80:6789/0 conn(0x7fbb300734e0 0x7fbb30071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46230/0 (socket says 172.21.15.80:46230) 2019-11-28T11:58:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.424+0000 7fbb36c24700 1 --2- 172.21.15.80:0/617314431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb30072620 0x7fbb30164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.425+0000 7fbb36423700 1 -- 172.21.15.80:0/617314431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb30072620 msgr2=0x7fbb30164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:24.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.425+0000 7fbb36423700 1 --2- 172.21.15.80:0/617314431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb30072620 0x7fbb30164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:24.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.425+0000 7fbb36423700 1 -- 172.21.15.80:0/617314431 >> v1:172.21.15.80:6789/0 conn(0x7fbb300734e0 legacy=0x7fbb30071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.425+0000 7fbb36423700 1 -- 172.21.15.80:0/617314431 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb300706c0 con 0x7fbb3006c0a0 2019-11-28T11:58:24.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.425+0000 7fbb35421700 1 -- 172.21.15.80:0/617314431 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274738840 0 0) 0x7fbb240013f0 con 0x7fbb300734e0 2019-11-28T11:58:24.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.425+0000 7fbb36423700 1 --2- 172.21.15.80:0/617314431 >> v2:172.21.15.80:3300/0 conn(0x7fbb3006c0a0 0x7fbb30072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbb2000f6c0 tx=0x7fbb2000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.425+0000 7fbb36423700 1 --2- 172.21.15.80:0/617314431 >> v2:172.21.15.80:3300/0 conn(0x7fbb3006c0a0 0x7fbb30072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbb2000f6c0 tx=0x7fbb2000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.425+0000 7fbb36423700 1 --2- 172.21.15.80:0/617314431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3006c0a0 0x7fbb30072fa0 secure :-1 s=READY pgs=2862 cs=0 l=1 rx=0x7fbb2000f6c0 tx=0x7fbb2000fa60).ready entity=mon.0 client_cookie=50df76b5ba588a84 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:24.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.425+0000 7fbb36423700 1 --2- 172.21.15.80:0/617314431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3006c0a0 0x7fbb30072fa0 secure :-1 s=THROTTLE_DONE pgs=2862 cs=0 l=1 rx=0x7fbb2000f6c0 tx=0x7fbb2000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.425+0000 7fbb35421700 1 -- 172.21.15.80:0/617314431 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb20000960 con 0x7fbb3006c0a0 2019-11-28T11:58:24.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.425+0000 7fbb36423700 1 --2- 172.21.15.80:0/617314431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3006c0a0 0x7fbb30072fa0 secure :-1 s=THROTTLE_DONE pgs=2862 cs=0 l=1 rx=0x7fbb2000f6c0 tx=0x7fbb2000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.425+0000 7fbb36423700 1 --2- 172.21.15.80:0/617314431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3006c0a0 0x7fbb30072fa0 secure :-1 s=THROTTLE_DONE pgs=2862 cs=0 l=1 rx=0x7fbb2000f6c0 tx=0x7fbb2000fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.425+0000 7fbb35421700 1 -- 172.21.15.80:0/617314431 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb20000c90 con 0x7fbb3006c0a0 2019-11-28T11:58:24.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.425+0000 7fbb35421700 1 -- 172.21.15.80:0/617314431 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb20007210 con 0x7fbb3006c0a0 2019-11-28T11:58:24.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.425+0000 7fbb37e86700 1 -- 172.21.15.80:0/617314431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3006c0a0 msgr2=0x7fbb30072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.425+0000 7fbb37e86700 1 --2- 172.21.15.80:0/617314431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3006c0a0 0x7fbb30072fa0 secure :-1 s=READY pgs=2862 cs=0 l=1 rx=0x7fbb2000f6c0 tx=0x7fbb2000fa60).stop 2019-11-28T11:58:24.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.426+0000 7fbb37e86700 1 -- 172.21.15.80:0/617314431 shutdown_connections 2019-11-28T11:58:24.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.426+0000 7fbb37e86700 1 --2- 172.21.15.80:0/617314431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb30072620 0x7fbb30164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:24.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.426+0000 7fbb37e86700 1 --2- 172.21.15.80:0/617314431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3006c0a0 0x7fbb30072fa0 unknown :-1 s=CLOSED pgs=2862 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:24.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.426+0000 7fbb37e86700 1 -- 172.21.15.80:0/617314431 shutdown_connections 2019-11-28T11:58:24.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.426+0000 7fbb37e86700 1 -- 172.21.15.80:0/617314431 wait complete. 2019-11-28T11:58:24.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.426+0000 7fbb37e86700 1 -- 172.21.15.80:0/617314431 >> 172.21.15.80:0/617314431 conn(0x7fbb30061cf0 msgr2=0x7fbb30064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:24.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.428+0000 7fbb37e86700 1 Processor -- start 2019-11-28T11:58:24.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.428+0000 7fbb37e86700 1 -- start start 2019-11-28T11:58:24.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.429+0000 7fbb37e86700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb3013e5f0 0x7fbb3013e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:24.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.429+0000 7fbb37e86700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb3010a070 0x7fbb3010bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:24.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.429+0000 7fbb37e86700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb301066e0 con 0x7fbb3010a4e0 2019-11-28T11:58:24.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.429+0000 7fbb37e86700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3010e060 con 0x7fbb3013e5f0 2019-11-28T11:58:24.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.429+0000 7fbb37e86700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3010e330 con 0x7fbb3010a070 2019-11-28T11:58:24.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.429+0000 7fbb36423700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb3013e5f0 0x7fbb3013e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:24.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.429+0000 7fbb36423700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb3013e5f0 0x7fbb3013e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46916/0 (socket says 172.21.15.80:46916) 2019-11-28T11:58:24.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.429+0000 7fbb36423700 1 -- 172.21.15.80:0/2190836974 learned_addr learned my addr 172.21.15.80:0/2190836974 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:24.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.429+0000 7fbb35c22700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb3010a070 0x7fbb3010bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:24.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb36423700 1 -- 172.21.15.80:0/2190836974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb3010a070 msgr2=0x7fbb3010bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb36423700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb3010a070 0x7fbb3010bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:24.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb36423700 1 -- 172.21.15.80:0/2190836974 >> v1:172.21.15.174:6789/0 conn(0x7fbb3010a4e0 legacy=0x7fbb3010c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb36423700 1 -- 172.21.15.80:0/2190836974 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3010e9c0 con 0x7fbb3013e5f0 2019-11-28T11:58:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb2effd700 1 -- 172.21.15.80:0/2190836974 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549705914 0 0) 0x7fbb28001080 con 0x7fbb3010a4e0 2019-11-28T11:58:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb36423700 1 --2- 172.21.15.80:0/2190836974 >> v2:172.21.15.80:3300/0 conn(0x7fbb3013e5f0 0x7fbb3013e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb20010390 tx=0x7fbb20010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb36423700 1 --2- 172.21.15.80:0/2190836974 >> v2:172.21.15.80:3300/0 conn(0x7fbb3013e5f0 0x7fbb3013e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb20010390 tx=0x7fbb20010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb36423700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3013e5f0 0x7fbb3013e9e0 secure :-1 s=READY pgs=2863 cs=0 l=1 rx=0x7fbb20010390 tx=0x7fbb20010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb36423700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3013e5f0 0x7fbb3013e9e0 secure :-1 s=THROTTLE_DONE pgs=2863 cs=0 l=1 rx=0x7fbb20010390 tx=0x7fbb20010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb36423700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3013e5f0 0x7fbb3013e9e0 secure :-1 s=THROTTLE_DONE pgs=2863 cs=0 l=1 rx=0x7fbb20010390 tx=0x7fbb20010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb2effd700 1 -- 172.21.15.80:0/2190836974 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb20005770 con 0x7fbb3013e5f0 2019-11-28T11:58:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb36423700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3013e5f0 0x7fbb3013e9e0 secure :-1 s=THROTTLE_DONE pgs=2863 cs=0 l=1 rx=0x7fbb20010390 tx=0x7fbb20010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb2effd700 1 -- 172.21.15.80:0/2190836974 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb20005390 con 0x7fbb3013e5f0 2019-11-28T11:58:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb2effd700 1 -- 172.21.15.80:0/2190836974 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb20005d50 con 0x7fbb3013e5f0 2019-11-28T11:58:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb37e86700 1 -- 172.21.15.80:0/2190836974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3010ed40 con 0x7fbb3013e5f0 2019-11-28T11:58:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb37e86700 1 -- 172.21.15.80:0/2190836974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3010e9c0 con 0x7fbb3013e5f0 2019-11-28T11:58:24.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.430+0000 7fbb36423700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3013e5f0 0x7fbb3013e9e0 secure :-1 s=THROTTLE_DONE pgs=2863 cs=0 l=1 rx=0x7fbb20010390 tx=0x7fbb20010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.431+0000 7fbb2effd700 1 -- 172.21.15.80:0/2190836974 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbb20005580 con 0x7fbb3013e5f0 2019-11-28T11:58:24.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.431+0000 7fbb36423700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3013e5f0 0x7fbb3013e9e0 secure :-1 s=THROTTLE_DONE pgs=2863 cs=0 l=1 rx=0x7fbb20010390 tx=0x7fbb20010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.431+0000 7fbb2effd700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb10018730 0x7fbb1001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:24.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.431+0000 7fbb2effd700 1 -- 172.21.15.80:0/2190836974 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(222..222 src has 1..222) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fbb20031af0 con 0x7fbb3013e5f0 2019-11-28T11:58:24.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.431+0000 7fbb35c22700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb10018730 0x7fbb1001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:24.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.431+0000 7fbb35c22700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb10018730 0x7fbb1001abc0 crc :-1 s=READY pgs=1185 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:24.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.439+0000 7fbb37e86700 1 -- 172.21.15.80:0/2190836974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3010ed40 con 0x7fbb3013e5f0 2019-11-28T11:58:24.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.442+0000 7fbb36423700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3013e5f0 0x7fbb3013e9e0 secure :-1 s=THROTTLE_DONE pgs=2863 cs=0 l=1 rx=0x7fbb20010390 tx=0x7fbb20010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.442+0000 7fbb2effd700 1 -- 172.21.15.80:0/2190836974 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbb20005180 con 0x7fbb3013e5f0 2019-11-28T11:58:24.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.620+0000 7fbb37e86700 1 -- 172.21.15.80:0/2190836974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb3010e9c0 con 0x7fbb3013e5f0 2019-11-28T11:58:24.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.621+0000 7fbb36423700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3013e5f0 0x7fbb3013e9e0 secure :-1 s=THROTTLE_DONE pgs=2863 cs=0 l=1 rx=0x7fbb20010390 tx=0x7fbb20010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.622 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.621+0000 7fbb2effd700 1 -- 172.21.15.80:0/2190836974 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v222) v1 ==== 74+0+14884 (secure 0 0 0) 0x7fbb20005580 con 0x7fbb3013e5f0 2019-11-28T11:58:24.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.623+0000 7fbb37e86700 1 -- 172.21.15.80:0/2190836974 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb10018730 msgr2=0x7fbb1001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.623+0000 7fbb37e86700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb10018730 0x7fbb1001abc0 crc :-1 s=READY pgs=1185 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:24.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.623+0000 7fbb37e86700 1 -- 172.21.15.80:0/2190836974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3013e5f0 msgr2=0x7fbb3013e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.623+0000 7fbb37e86700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3013e5f0 0x7fbb3013e9e0 secure :-1 s=READY pgs=2863 cs=0 l=1 rx=0x7fbb20010390 tx=0x7fbb20010730).stop 2019-11-28T11:58:24.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.623+0000 7fbb37e86700 1 -- 172.21.15.80:0/2190836974 shutdown_connections 2019-11-28T11:58:24.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.623+0000 7fbb37e86700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbb10018730 0x7fbb1001abc0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:24.623 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.623+0000 7fbb37e86700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbb3010a070 0x7fbb3010bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:24.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.623+0000 7fbb37e86700 1 --2- 172.21.15.80:0/2190836974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb3013e5f0 0x7fbb3013e9e0 unknown :-1 s=CLOSED pgs=2863 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:24.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.623+0000 7fbb37e86700 1 -- 172.21.15.80:0/2190836974 shutdown_connections 2019-11-28T11:58:24.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.623+0000 7fbb37e86700 1 -- 172.21.15.80:0/2190836974 wait complete. 2019-11-28T11:58:24.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.623+0000 7fbb37e86700 1 -- 172.21.15.80:0/2190836974 >> 172.21.15.80:0/2190836974 conn(0x7fbb3013d620 msgr2=0x7fbb3013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:24.624 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:24.625 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":222,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:58:24.286678+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":37,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":36,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:58:22.567726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"222","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":37,"pool_name":"cephfs_data","create_time":"2019-11-28T11:58:23.259981+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"222","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":220,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:58:24.630 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:58:24.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.754+0000 7fbaf36a3700 1 Processor -- start 2019-11-28T11:58:24.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.754+0000 7fbaf36a3700 1 -- start start 2019-11-28T11:58:24.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.755+0000 7fbaf36a3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec06c490 0x7fbaec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:24.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.755+0000 7fbaf36a3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbaec06ce60 0x7fbaec164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:24.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.755+0000 7fbaf36a3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaec06db00 con 0x7fbaec06c0a0 2019-11-28T11:58:24.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.755+0000 7fbaf36a3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaec06fd60 con 0x7fbaec06ce60 2019-11-28T11:58:24.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.755+0000 7fbaf36a3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec070030 con 0x7fbaec06c490 2019-11-28T11:58:24.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.755+0000 7fbaf2441700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbaec06ce60 0x7fbaec164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:24.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.755+0000 7fbaf143f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec06c490 0x7fbaec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:24.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.755+0000 7fbaf143f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec06c490 0x7fbaec06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:49188/0 (socket says 172.21.15.80:49188) 2019-11-28T11:58:24.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.755+0000 7fbaf2441700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbaec06ce60 0x7fbaec164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:33580/0 (socket says 172.21.15.80:33580) 2019-11-28T11:58:24.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.755+0000 7fbaf143f700 1 -- 172.21.15.80:0/114088765 learned_addr learned my addr 172.21.15.80:0/114088765 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:24.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.755+0000 7fbaf1c40700 1 --1- 172.21.15.80:0/114088765 >> v1:172.21.15.174:6789/0 conn(0x7fbaec06c0a0 0x7fbaec072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:33552/0 (socket says 172.21.15.80:33552) 2019-11-28T11:58:24.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf143f700 1 -- 172.21.15.80:0/114088765 >> v2:172.21.15.174:3300/0 conn(0x7fbaec06ce60 msgr2=0x7fbaec164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:24.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf143f700 1 --2- 172.21.15.80:0/114088765 >> v2:172.21.15.174:3300/0 conn(0x7fbaec06ce60 0x7fbaec164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:24.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf143f700 1 -- 172.21.15.80:0/114088765 >> v1:172.21.15.174:6789/0 conn(0x7fbaec06c0a0 legacy=0x7fbaec072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf0c3e700 1 -- 172.21.15.80:0/114088765 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534794343 0 0) 0x7fbae8001080 con 0x7fbaec06c0a0 2019-11-28T11:58:24.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf143f700 1 -- 172.21.15.80:0/114088765 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec0706c0 con 0x7fbaec06c490 2019-11-28T11:58:24.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf2441700 1 --2- 172.21.15.80:0/114088765 >> v2:172.21.15.174:3300/0 conn(0x7fbaec06ce60 0x7fbaec164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:24.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf143f700 1 --2- 172.21.15.80:0/114088765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec06c490 0x7fbaec06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbadc00f740 tx=0x7fbadc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf143f700 1 --2- 172.21.15.80:0/114088765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec06c490 0x7fbaec06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbadc00f740 tx=0x7fbadc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf143f700 1 --2- 172.21.15.80:0/114088765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec06c490 0x7fbaec06c920 secure :-1 s=READY pgs=415 cs=0 l=1 rx=0x7fbadc00f740 tx=0x7fbadc00fae0).ready entity=mon.2 client_cookie=905162a35d028d57 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:24.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf143f700 1 --2- 172.21.15.80:0/114088765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec06c490 0x7fbaec06c920 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7fbadc00f740 tx=0x7fbadc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf0c3e700 1 -- 172.21.15.80:0/114088765 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbadc000960 con 0x7fbaec06c490 2019-11-28T11:58:24.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf143f700 1 --2- 172.21.15.80:0/114088765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec06c490 0x7fbaec06c920 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7fbadc00f740 tx=0x7fbadc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf143f700 1 --2- 172.21.15.80:0/114088765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec06c490 0x7fbaec06c920 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7fbadc00f740 tx=0x7fbadc00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf0c3e700 1 -- 172.21.15.80:0/114088765 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc000c90 con 0x7fbaec06c490 2019-11-28T11:58:24.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf0c3e700 1 -- 172.21.15.80:0/114088765 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbadc007210 con 0x7fbaec06c490 2019-11-28T11:58:24.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf36a3700 1 -- 172.21.15.80:0/114088765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec06c490 msgr2=0x7fbaec06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.756+0000 7fbaf36a3700 1 --2- 172.21.15.80:0/114088765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec06c490 0x7fbaec06c920 secure :-1 s=READY pgs=415 cs=0 l=1 rx=0x7fbadc00f740 tx=0x7fbadc00fae0).stop 2019-11-28T11:58:24.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.757+0000 7fbaf36a3700 1 -- 172.21.15.80:0/114088765 shutdown_connections 2019-11-28T11:58:24.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.757+0000 7fbaf36a3700 1 --2- 172.21.15.80:0/114088765 >> v2:172.21.15.174:3300/0 conn(0x7fbaec06ce60 0x7fbaec164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:24.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.757+0000 7fbaf36a3700 1 --2- 172.21.15.80:0/114088765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec06c490 0x7fbaec06c920 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:24.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.757+0000 7fbaf36a3700 1 -- 172.21.15.80:0/114088765 shutdown_connections 2019-11-28T11:58:24.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.757+0000 7fbaf36a3700 1 -- 172.21.15.80:0/114088765 wait complete. 2019-11-28T11:58:24.760 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.757+0000 7fbaf36a3700 1 -- 172.21.15.80:0/114088765 >> 172.21.15.80:0/114088765 conn(0x7fbaec061cf0 msgr2=0x7fbaec064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:24.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.759+0000 7fbaf36a3700 1 Processor -- start 2019-11-28T11:58:24.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.759+0000 7fbaf36a3700 1 -- start start 2019-11-28T11:58:24.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.760+0000 7fbaf36a3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec13dc00 0x7fbaec109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:24.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.760+0000 7fbaf36a3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbaec1094e0 0x7fbaec167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:24.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.760+0000 7fbaf36a3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaec1312c0 con 0x7fbaec10a3a0 2019-11-28T11:58:24.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.760+0000 7fbaf36a3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaec104e00 con 0x7fbaec1094e0 2019-11-28T11:58:24.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.760+0000 7fbaf36a3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec105830 con 0x7fbaec13dc00 2019-11-28T11:58:24.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.760+0000 7fbaf143f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbaec10a3a0 0x7fbaec108ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46248/0 (socket says 172.21.15.80:46248) 2019-11-28T11:58:24.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.760+0000 7fbaf143f700 1 -- 172.21.15.80:0/2702891252 learned_addr learned my addr 172.21.15.80:0/2702891252 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:24.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.760+0000 7fbaf1c40700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec13dc00 0x7fbaec109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:24.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.760+0000 7fbaf2441700 1 --2- 172.21.15.80:0/2702891252 >> v2:172.21.15.80:3300/0 conn(0x7fbaec1094e0 0x7fbaec167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:24.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.760+0000 7fbae27fc700 1 -- 172.21.15.80:0/2702891252 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389945507 0 0) 0x7fbadc007da0 con 0x7fbaec10a3a0 2019-11-28T11:58:24.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.760+0000 7fbae27fc700 1 -- 172.21.15.80:0/2702891252 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbad4002e80 con 0x7fbaec10a3a0 2019-11-28T11:58:24.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbaf2441700 1 -- 172.21.15.80:0/2702891252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec13dc00 msgr2=0x7fbaec109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbaf2441700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec13dc00 0x7fbaec109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:24.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbaf2441700 1 -- 172.21.15.80:0/2702891252 >> v1:172.21.15.80:6789/0 conn(0x7fbaec10a3a0 legacy=0x7fbaec108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbaf2441700 1 -- 172.21.15.80:0/2702891252 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec106190 con 0x7fbaec1094e0 2019-11-28T11:58:24.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbaf1c40700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec13dc00 0x7fbaec109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:24.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbaf2441700 1 --2- 172.21.15.80:0/2702891252 >> v2:172.21.15.80:3300/0 conn(0x7fbaec1094e0 0x7fbaec167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbae4010700 tx=0x7fbae4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbaf2441700 1 --2- 172.21.15.80:0/2702891252 >> v2:172.21.15.80:3300/0 conn(0x7fbaec1094e0 0x7fbaec167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbae4010700 tx=0x7fbae4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbaf2441700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaec1094e0 0x7fbaec167a10 secure :-1 s=READY pgs=2865 cs=0 l=1 rx=0x7fbae4010700 tx=0x7fbae4010aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:24.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbaf2441700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaec1094e0 0x7fbaec167a10 secure :-1 s=THROTTLE_DONE pgs=2865 cs=0 l=1 rx=0x7fbae4010700 tx=0x7fbae4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbae27fc700 1 -- 172.21.15.80:0/2702891252 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbae400ae70 con 0x7fbaec1094e0 2019-11-28T11:58:24.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbaf2441700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaec1094e0 0x7fbaec167a10 secure :-1 s=THROTTLE_DONE pgs=2865 cs=0 l=1 rx=0x7fbae4010700 tx=0x7fbae4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbae27fc700 1 -- 172.21.15.80:0/2702891252 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae400ae70 con 0x7fbaec1094e0 2019-11-28T11:58:24.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbaf36a3700 1 -- 172.21.15.80:0/2702891252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaec106510 con 0x7fbaec1094e0 2019-11-28T11:58:24.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbaf2441700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaec1094e0 0x7fbaec167a10 secure :-1 s=THROTTLE_DONE pgs=2865 cs=0 l=1 rx=0x7fbae4010700 tx=0x7fbae4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbae27fc700 1 -- 172.21.15.80:0/2702891252 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbae4009d10 con 0x7fbaec1094e0 2019-11-28T11:58:24.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbaf36a3700 1 -- 172.21.15.80:0/2702891252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaec106190 con 0x7fbaec1094e0 2019-11-28T11:58:24.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbaf2441700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaec1094e0 0x7fbaec167a10 secure :-1 s=THROTTLE_DONE pgs=2865 cs=0 l=1 rx=0x7fbae4010700 tx=0x7fbae4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbae27fc700 1 -- 172.21.15.80:0/2702891252 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbae4009930 con 0x7fbaec1094e0 2019-11-28T11:58:24.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.761+0000 7fbaf2441700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaec1094e0 0x7fbaec167a10 secure :-1 s=THROTTLE_DONE pgs=2865 cs=0 l=1 rx=0x7fbae4010700 tx=0x7fbae4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.762+0000 7fbae27fc700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbad4018770 0x7fbad401ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:24.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.762+0000 7fbae27fc700 1 -- 172.21.15.80:0/2702891252 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(222..222 src has 1..222) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fbae4031fa0 con 0x7fbaec1094e0 2019-11-28T11:58:24.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.762+0000 7fbaf1c40700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbad4018770 0x7fbad401ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:24.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.762+0000 7fbaf1c40700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbad4018770 0x7fbad401ac00 crc :-1 s=READY pgs=1186 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:24.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.769+0000 7fbaf36a3700 1 -- 172.21.15.80:0/2702891252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaec106510 con 0x7fbaec1094e0 2019-11-28T11:58:24.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.773+0000 7fbaf2441700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaec1094e0 0x7fbaec167a10 secure :-1 s=THROTTLE_DONE pgs=2865 cs=0 l=1 rx=0x7fbae4010700 tx=0x7fbae4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.773+0000 7fbae27fc700 1 -- 172.21.15.80:0/2702891252 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbae4000df0 con 0x7fbaec1094e0 2019-11-28T11:58:24.945 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.949+0000 7fbaf36a3700 1 -- 172.21.15.80:0/2702891252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbaec106190 con 0x7fbaec1094e0 2019-11-28T11:58:24.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.950+0000 7fbaf2441700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaec1094e0 0x7fbaec167a10 secure :-1 s=THROTTLE_DONE pgs=2865 cs=0 l=1 rx=0x7fbae4010700 tx=0x7fbae4010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:24.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.950+0000 7fbae27fc700 1 -- 172.21.15.80:0/2702891252 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v222) v1 ==== 74+0+14884 (secure 0 0 0) 0x7fbae4021480 con 0x7fbaec1094e0 2019-11-28T11:58:24.947 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:24.947 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":222,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:58:24.286678+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":37,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":36,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:58:22.567726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"222","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":37,"pool_name":"cephfs_data","create_time":"2019-11-28T11:58:23.259981+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"222","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":220,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:58:24.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.952+0000 7fbaf36a3700 1 -- 172.21.15.80:0/2702891252 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbad4018770 msgr2=0x7fbad401ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.953+0000 7fbaf36a3700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbad4018770 0x7fbad401ac00 crc :-1 s=READY pgs=1186 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:24.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.953+0000 7fbaf36a3700 1 -- 172.21.15.80:0/2702891252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaec1094e0 msgr2=0x7fbaec167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:24.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.953+0000 7fbaf36a3700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaec1094e0 0x7fbaec167a10 secure :-1 s=READY pgs=2865 cs=0 l=1 rx=0x7fbae4010700 tx=0x7fbae4010aa0).stop 2019-11-28T11:58:24.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.953+0000 7fbaf36a3700 1 -- 172.21.15.80:0/2702891252 shutdown_connections 2019-11-28T11:58:24.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.953+0000 7fbaf36a3700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbad4018770 0x7fbad401ac00 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:24.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.953+0000 7fbaf36a3700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaec1094e0 0x7fbaec167a10 unknown :-1 s=CLOSED pgs=2865 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:24.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.953+0000 7fbaf36a3700 1 --2- 172.21.15.80:0/2702891252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbaec13dc00 0x7fbaec109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:24.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.953+0000 7fbaf36a3700 1 -- 172.21.15.80:0/2702891252 shutdown_connections 2019-11-28T11:58:24.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.953+0000 7fbaf36a3700 1 -- 172.21.15.80:0/2702891252 wait complete. 2019-11-28T11:58:24.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:24.953+0000 7fbaf36a3700 1 -- 172.21.15.80:0/2702891252 >> 172.21.15.80:0/2702891252 conn(0x7fbaec11bfc0 msgr2=0x7fbaec141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:24.959 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T11:58:25.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.087+0000 7f4c94b6e700 1 Processor -- start 2019-11-28T11:58:25.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.087+0000 7f4c94b6e700 1 -- start start 2019-11-28T11:58:25.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.088+0000 7f4c94b6e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4c9015ed10 0x7f4c9015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:25.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.088+0000 7f4c94b6e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4c90073020 0x7f4c90071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:25.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.088+0000 7f4c94b6e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c9006db60 con 0x7f4c900734b0 2019-11-28T11:58:25.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.088+0000 7f4c94b6e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c9006fe00 con 0x7f4c9015ed10 2019-11-28T11:58:25.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.088+0000 7f4c94b6e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c900700d0 con 0x7f4c90073020 2019-11-28T11:58:25.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.088+0000 7f4c8ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4c9015ed10 0x7f4c9015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:25.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.088+0000 7f4c8ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4c9015ed10 0x7f4c9015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46938/0 (socket says 172.21.15.80:46938) 2019-11-28T11:58:25.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.088+0000 7f4c8ed9d700 1 -- 172.21.15.80:0/958715587 learned_addr learned my addr 172.21.15.80:0/958715587 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:25.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.088+0000 7f4c8e59c700 1 --2- 172.21.15.80:0/958715587 >> v2:172.21.15.174:3300/0 conn(0x7f4c90073020 0x7f4c90071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:25.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.089+0000 7f4c8ed9d700 1 -- 172.21.15.80:0/958715587 >> v2:172.21.15.174:3300/0 conn(0x7f4c90073020 msgr2=0x7f4c90071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:25.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.089+0000 7f4c8ed9d700 1 --2- 172.21.15.80:0/958715587 >> v2:172.21.15.174:3300/0 conn(0x7f4c90073020 0x7f4c90071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:25.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.089+0000 7f4c8ed9d700 1 -- 172.21.15.80:0/958715587 >> v1:172.21.15.174:6789/0 conn(0x7f4c900734b0 legacy=0x7f4c900723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:25.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.089+0000 7f4c8ed9d700 1 -- 172.21.15.80:0/958715587 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c90070760 con 0x7f4c9015ed10 2019-11-28T11:58:25.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.089+0000 7f4c8e59c700 1 --2- 172.21.15.80:0/958715587 >> v2:172.21.15.174:3300/0 conn(0x7f4c90073020 0x7f4c90071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:58:25.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.089+0000 7f4c8ed9d700 1 --2- 172.21.15.80:0/958715587 >> v2:172.21.15.80:3300/0 conn(0x7f4c9015ed10 0x7f4c9015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4c8000fac0 tx=0x7f4c8000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:25.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.089+0000 7f4c8ed9d700 1 --2- 172.21.15.80:0/958715587 >> v2:172.21.15.80:3300/0 conn(0x7f4c9015ed10 0x7f4c9015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4c8000fac0 tx=0x7f4c8000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:25.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.089+0000 7f4c8ed9d700 1 --2- 172.21.15.80:0/958715587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9015ed10 0x7f4c9015f100 secure :-1 s=READY pgs=2866 cs=0 l=1 rx=0x7f4c8000fac0 tx=0x7f4c8000fe60).ready entity=mon.0 client_cookie=716f0eaa1e9cf7bd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:25.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.089+0000 7f4c8ed9d700 1 --2- 172.21.15.80:0/958715587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9015ed10 0x7f4c9015f100 secure :-1 s=THROTTLE_DONE pgs=2866 cs=0 l=1 rx=0x7f4c8000fac0 tx=0x7f4c8000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:25.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.089+0000 7f4c8ed9d700 1 --2- 172.21.15.80:0/958715587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9015ed10 0x7f4c9015f100 secure :-1 s=THROTTLE_DONE pgs=2866 cs=0 l=1 rx=0x7f4c8000fac0 tx=0x7f4c8000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:25.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.089+0000 7f4c8dd9b700 1 -- 172.21.15.80:0/958715587 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c80000ce0 con 0x7f4c9015ed10 2019-11-28T11:58:25.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.089+0000 7f4c8ed9d700 1 --2- 172.21.15.80:0/958715587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9015ed10 0x7f4c9015f100 secure :-1 s=THROTTLE_DONE pgs=2866 cs=0 l=1 rx=0x7f4c8000fac0 tx=0x7f4c8000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:25.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.089+0000 7f4c8dd9b700 1 -- 172.21.15.80:0/958715587 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c80001010 con 0x7f4c9015ed10 2019-11-28T11:58:25.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.089+0000 7f4c8dd9b700 1 -- 172.21.15.80:0/958715587 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c80001720 con 0x7f4c9015ed10 2019-11-28T11:58:25.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.089+0000 7f4c94b6e700 1 -- 172.21.15.80:0/958715587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9015ed10 msgr2=0x7f4c9015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:25.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.089+0000 7f4c94b6e700 1 --2- 172.21.15.80:0/958715587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9015ed10 0x7f4c9015f100 secure :-1 s=READY pgs=2866 cs=0 l=1 rx=0x7f4c8000fac0 tx=0x7f4c8000fe60).stop 2019-11-28T11:58:25.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.090+0000 7f4c94b6e700 1 -- 172.21.15.80:0/958715587 shutdown_connections 2019-11-28T11:58:25.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.090+0000 7f4c94b6e700 1 --2- 172.21.15.80:0/958715587 >> v2:172.21.15.174:3300/0 conn(0x7f4c90073020 0x7f4c90071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:25.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.090+0000 7f4c94b6e700 1 --2- 172.21.15.80:0/958715587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4c9015ed10 0x7f4c9015f100 unknown :-1 s=CLOSED pgs=2866 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:25.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.090+0000 7f4c94b6e700 1 -- 172.21.15.80:0/958715587 shutdown_connections 2019-11-28T11:58:25.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.090+0000 7f4c94b6e700 1 -- 172.21.15.80:0/958715587 wait complete. 2019-11-28T11:58:25.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.090+0000 7f4c94b6e700 1 -- 172.21.15.80:0/958715587 >> 172.21.15.80:0/958715587 conn(0x7f4c90061d20 msgr2=0x7f4c900641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:25.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.092+0000 7f4c94b6e700 1 Processor -- start 2019-11-28T11:58:25.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.092+0000 7f4c94b6e700 1 -- start start 2019-11-28T11:58:25.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.093+0000 7f4c94b6e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c90167d80 0x7f4c9016a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:25.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.093+0000 7f4c94b6e700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c90148e00 con 0x7f4c901079b0 2019-11-28T11:58:25.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.093+0000 7f4c94b6e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c90108b10 con 0x7f4c90148320 2019-11-28T11:58:25.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.093+0000 7f4c94b6e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9013aa20 con 0x7f4c90167d80 2019-11-28T11:58:25.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.093+0000 7f4c8e59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4c901079b0 0x7f4c90107e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46264/0 (socket says 172.21.15.80:46264) 2019-11-28T11:58:25.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.093+0000 7f4c8e59c700 1 -- 172.21.15.80:0/1067996804 learned_addr learned my addr 172.21.15.80:0/1067996804 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:25.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.093+0000 7f4c8f59e700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c90167d80 0x7f4c9016a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:25.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.093+0000 7f4c877fe700 1 -- 172.21.15.80:0/1067996804 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844125780 0 0) 0x7f4c78002a80 con 0x7f4c901079b0 2019-11-28T11:58:25.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.093+0000 7f4c877fe700 1 -- 172.21.15.80:0/1067996804 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c74002e80 con 0x7f4c901079b0 2019-11-28T11:58:25.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c877fe700 1 -- 172.21.15.80:0/1067996804 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723698234 0 0) 0x7f4c80007c80 con 0x7f4c90148320 2019-11-28T11:58:25.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c877fe700 1 -- 172.21.15.80:0/1067996804 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c740030b0 con 0x7f4c90148320 2019-11-28T11:58:25.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c8f59e700 1 -- 172.21.15.80:0/1067996804 >> v1:172.21.15.174:6789/0 conn(0x7f4c90148320 legacy=0x7f4c9010ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:25.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c8f59e700 1 -- 172.21.15.80:0/1067996804 >> v1:172.21.15.80:6789/0 conn(0x7f4c901079b0 legacy=0x7f4c90107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:25.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c877fe700 1 -- 172.21.15.80:0/1067996804 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3846383747 0 0) 0x7f4c78000dc0 con 0x7f4c901079b0 2019-11-28T11:58:25.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c8f59e700 1 -- 172.21.15.80:0/1067996804 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9010c490 con 0x7f4c90167d80 2019-11-28T11:58:25.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c8f59e700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c90167d80 0x7f4c9016a180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4c880103b0 tx=0x7f4c88010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:25.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c8f59e700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c90167d80 0x7f4c9016a180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4c880103b0 tx=0x7f4c88010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:25.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c8f59e700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c90167d80 0x7f4c9016a180 secure :-1 s=READY pgs=416 cs=0 l=1 rx=0x7f4c880103b0 tx=0x7f4c88010750).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:25.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c8f59e700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c90167d80 0x7f4c9016a180 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7f4c880103b0 tx=0x7f4c88010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:25.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c877fe700 1 -- 172.21.15.80:0/1067996804 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c88000960 con 0x7f4c90167d80 2019-11-28T11:58:25.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c8f59e700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c90167d80 0x7f4c9016a180 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7f4c880103b0 tx=0x7f4c88010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:25.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c8f59e700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c90167d80 0x7f4c9016a180 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7f4c880103b0 tx=0x7f4c88010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:25.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c877fe700 1 -- 172.21.15.80:0/1067996804 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c88009990 con 0x7f4c90167d80 2019-11-28T11:58:25.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c94b6e700 1 -- 172.21.15.80:0/1067996804 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9010c810 con 0x7f4c90167d80 2019-11-28T11:58:25.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c877fe700 1 -- 172.21.15.80:0/1067996804 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c88000960 con 0x7f4c90167d80 2019-11-28T11:58:25.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c94b6e700 1 -- 172.21.15.80:0/1067996804 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9010c490 con 0x7f4c90167d80 2019-11-28T11:58:25.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.094+0000 7f4c8f59e700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c90167d80 0x7f4c9016a180 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7f4c880103b0 tx=0x7f4c88010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:25.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.095+0000 7f4c877fe700 1 -- 172.21.15.80:0/1067996804 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4c88009b80 con 0x7f4c90167d80 2019-11-28T11:58:25.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.095+0000 7f4c8f59e700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c90167d80 0x7f4c9016a180 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7f4c880103b0 tx=0x7f4c88010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:25.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.095+0000 7f4c877fe700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4c74018750 0x7f4c7401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:25.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.095+0000 7f4c877fe700 1 -- 172.21.15.80:0/1067996804 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(222..222 src has 1..222) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4c88031a90 con 0x7f4c90167d80 2019-11-28T11:58:25.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.095+0000 7f4c8ed9d700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4c74018750 0x7f4c7401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:25.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.095+0000 7f4c8ed9d700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4c74018750 0x7f4c7401abe0 crc :-1 s=READY pgs=1187 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:25.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.102+0000 7f4c94b6e700 1 -- 172.21.15.80:0/1067996804 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9010c810 con 0x7f4c90167d80 2019-11-28T11:58:25.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.106+0000 7f4c8f59e700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c90167d80 0x7f4c9016a180 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7f4c880103b0 tx=0x7f4c88010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:25.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.106+0000 7f4c877fe700 1 -- 172.21.15.80:0/1067996804 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4c88028ed0 con 0x7f4c90167d80 2019-11-28T11:58:25.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.278+0000 7f4c94b6e700 1 -- 172.21.15.80:0/1067996804 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f4c9010c490 con 0x7f4c90167d80 2019-11-28T11:58:25.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.921+0000 7f4c8f59e700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c90167d80 0x7f4c9016a180 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7f4c880103b0 tx=0x7f4c88010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:25.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.921+0000 7f4c877fe700 1 -- 172.21.15.80:0/1067996804 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v183) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4c88009590 con 0x7f4c90167d80 2019-11-28T11:58:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.945+0000 7f4c94b6e700 1 -- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4c74018750 msgr2=0x7f4c7401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.945+0000 7f4c94b6e700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4c74018750 0x7f4c7401abe0 crc :-1 s=READY pgs=1187 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.945+0000 7f4c94b6e700 1 -- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c90167d80 msgr2=0x7f4c9016a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.945+0000 7f4c94b6e700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c90167d80 0x7f4c9016a180 secure :-1 s=READY pgs=416 cs=0 l=1 rx=0x7f4c880103b0 tx=0x7f4c88010750).stop 2019-11-28T11:58:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.945+0000 7f4c94b6e700 1 -- 172.21.15.80:0/1067996804 shutdown_connections 2019-11-28T11:58:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.945+0000 7f4c94b6e700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c90167d80 0x7f4c9016a180 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.945+0000 7f4c94b6e700 1 --2- 172.21.15.80:0/1067996804 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4c74018750 0x7f4c7401abe0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.945+0000 7f4c94b6e700 1 -- 172.21.15.80:0/1067996804 shutdown_connections 2019-11-28T11:58:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.945+0000 7f4c94b6e700 1 -- 172.21.15.80:0/1067996804 wait complete. 2019-11-28T11:58:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:25.945+0000 7f4c94b6e700 1 -- 172.21.15.80:0/1067996804 >> 172.21.15.80:0/1067996804 conn(0x7f4c9015e2d0 msgr2=0x7f4c90147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:25.951 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:58:26.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.074+0000 7f0c043f2700 1 Processor -- start 2019-11-28T11:58:26.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.074+0000 7f0c043f2700 1 -- start start 2019-11-28T11:58:26.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c043f2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bfc06c490 0x7f0bfc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:26.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c043f2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0bfc06ce60 0x7f0bfc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:26.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c043f2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bfc06db00 con 0x7f0bfc06c0a0 2019-11-28T11:58:26.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c043f2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bfc06fd60 con 0x7f0bfc06ce60 2019-11-28T11:58:26.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c043f2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc070030 con 0x7f0bfc06c490 2019-11-28T11:58:26.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c0298f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0bfc06c0a0 0x7f0bfc072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46268/0 (socket says 172.21.15.80:46268) 2019-11-28T11:58:26.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c03190700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0bfc06ce60 0x7f0bfc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:26.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c0298f700 1 -- 172.21.15.80:0/2771119222 learned_addr learned my addr 172.21.15.80:0/2771119222 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:26.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c0218e700 1 --2- 172.21.15.80:0/2771119222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bfc06c490 0x7f0bfc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:26.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c03190700 1 -- 172.21.15.80:0/2771119222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bfc06c490 msgr2=0x7f0bfc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:26.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c03190700 1 --2- 172.21.15.80:0/2771119222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bfc06c490 0x7f0bfc06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:26.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c03190700 1 -- 172.21.15.80:0/2771119222 >> v1:172.21.15.80:6789/0 conn(0x7f0bfc06c0a0 legacy=0x7f0bfc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c03190700 1 -- 172.21.15.80:0/2771119222 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc0706c0 con 0x7f0bfc06ce60 2019-11-28T11:58:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c0198d700 1 -- 172.21.15.80:0/2771119222 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346068637 0 0) 0x7f0bf00014d0 con 0x7f0bfc06c0a0 2019-11-28T11:58:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c03190700 1 --2- 172.21.15.80:0/2771119222 >> v2:172.21.15.80:3300/0 conn(0x7f0bfc06ce60 0x7f0bfc164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0bf400af50 tx=0x7f0bf400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c03190700 1 --2- 172.21.15.80:0/2771119222 >> v2:172.21.15.80:3300/0 conn(0x7f0bfc06ce60 0x7f0bfc164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0bf400af50 tx=0x7f0bf400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.075+0000 7f0c03190700 1 --2- 172.21.15.80:0/2771119222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc06ce60 0x7f0bfc164d70 secure :-1 s=READY pgs=2869 cs=0 l=1 rx=0x7f0bf400af50 tx=0x7f0bf400b6e0).ready entity=mon.0 client_cookie=838bf54ba4fcdccd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.076+0000 7f0c03190700 1 --2- 172.21.15.80:0/2771119222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc06ce60 0x7f0bfc164d70 secure :-1 s=THROTTLE_DONE pgs=2869 cs=0 l=1 rx=0x7f0bf400af50 tx=0x7f0bf400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.076+0000 7f0c0198d700 1 -- 172.21.15.80:0/2771119222 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bf4009ba0 con 0x7f0bfc06ce60 2019-11-28T11:58:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.076+0000 7f0c03190700 1 --2- 172.21.15.80:0/2771119222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc06ce60 0x7f0bfc164d70 secure :-1 s=THROTTLE_DONE pgs=2869 cs=0 l=1 rx=0x7f0bf400af50 tx=0x7f0bf400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.076+0000 7f0c03190700 1 --2- 172.21.15.80:0/2771119222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc06ce60 0x7f0bfc164d70 secure :-1 s=THROTTLE_DONE pgs=2869 cs=0 l=1 rx=0x7f0bf400af50 tx=0x7f0bf400b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.076+0000 7f0c0198d700 1 -- 172.21.15.80:0/2771119222 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf40097c0 con 0x7f0bfc06ce60 2019-11-28T11:58:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.076+0000 7f0c0198d700 1 -- 172.21.15.80:0/2771119222 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bf400a180 con 0x7f0bfc06ce60 2019-11-28T11:58:26.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.076+0000 7f0c043f2700 1 -- 172.21.15.80:0/2771119222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc06ce60 msgr2=0x7f0bfc164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.076+0000 7f0c043f2700 1 --2- 172.21.15.80:0/2771119222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc06ce60 0x7f0bfc164d70 secure :-1 s=READY pgs=2869 cs=0 l=1 rx=0x7f0bf400af50 tx=0x7f0bf400b6e0).stop 2019-11-28T11:58:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.076+0000 7f0c043f2700 1 -- 172.21.15.80:0/2771119222 shutdown_connections 2019-11-28T11:58:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.076+0000 7f0c043f2700 1 --2- 172.21.15.80:0/2771119222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc06ce60 0x7f0bfc164d70 unknown :-1 s=CLOSED pgs=2869 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.076+0000 7f0c043f2700 1 --2- 172.21.15.80:0/2771119222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bfc06c490 0x7f0bfc06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.076+0000 7f0c043f2700 1 -- 172.21.15.80:0/2771119222 shutdown_connections 2019-11-28T11:58:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.076+0000 7f0c043f2700 1 -- 172.21.15.80:0/2771119222 wait complete. 2019-11-28T11:58:26.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.076+0000 7f0c043f2700 1 -- 172.21.15.80:0/2771119222 >> 172.21.15.80:0/2771119222 conn(0x7f0bfc061cf0 msgr2=0x7f0bfc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:26.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.079+0000 7f0c043f2700 1 Processor -- start 2019-11-28T11:58:26.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.079+0000 7f0c043f2700 1 -- start start 2019-11-28T11:58:26.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c043f2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0bfc1281b0 0x7f0bfc128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:26.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c043f2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0bfc128b80 0x7f0bfc167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:26.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c043f2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bfc139a60 con 0x7f0bfc13a780 2019-11-28T11:58:26.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c043f2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bfc12a260 con 0x7f0bfc128b80 2019-11-28T11:58:26.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c043f2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bfc12a530 con 0x7f0bfc1281b0 2019-11-28T11:58:26.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c03190700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0bfc128b80 0x7f0bfc167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:26.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c03190700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0bfc128b80 0x7f0bfc167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46962/0 (socket says 172.21.15.80:46962) 2019-11-28T11:58:26.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c03190700 1 -- 172.21.15.80:0/528452733 learned_addr learned my addr 172.21.15.80:0/528452733 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:26.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c0218e700 1 --2- 172.21.15.80:0/528452733 >> v2:172.21.15.174:3300/0 conn(0x7f0bfc1281b0 0x7f0bfc128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:26.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c03190700 1 -- 172.21.15.80:0/528452733 >> v2:172.21.15.174:3300/0 conn(0x7f0bfc1281b0 msgr2=0x7f0bfc128640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c03190700 1 --2- 172.21.15.80:0/528452733 >> v2:172.21.15.174:3300/0 conn(0x7f0bfc1281b0 0x7f0bfc128640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c03190700 1 -- 172.21.15.80:0/528452733 >> v1:172.21.15.174:6789/0 conn(0x7f0bfc13a780 legacy=0x7f0bfc12d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c03190700 1 -- 172.21.15.80:0/528452733 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc12abc0 con 0x7f0bfc128b80 2019-11-28T11:58:26.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c03190700 1 --2- 172.21.15.80:0/528452733 >> v2:172.21.15.80:3300/0 conn(0x7f0bfc128b80 0x7f0bfc167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0bf4010420 tx=0x7f0bf40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c03190700 1 --2- 172.21.15.80:0/528452733 >> v2:172.21.15.80:3300/0 conn(0x7f0bfc128b80 0x7f0bfc167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0bf4010420 tx=0x7f0bf40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c03190700 1 --2- 172.21.15.80:0/528452733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc128b80 0x7f0bfc167d70 secure :-1 s=READY pgs=2870 cs=0 l=1 rx=0x7f0bf4010420 tx=0x7f0bf40102d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:26.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c03190700 1 --2- 172.21.15.80:0/528452733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc128b80 0x7f0bfc167d70 secure :-1 s=THROTTLE_DONE pgs=2870 cs=0 l=1 rx=0x7f0bf4010420 tx=0x7f0bf40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0bfb7fe700 1 -- 172.21.15.80:0/528452733 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bf400ad00 con 0x7f0bfc128b80 2019-11-28T11:58:26.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c03190700 1 --2- 172.21.15.80:0/528452733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc128b80 0x7f0bfc167d70 secure :-1 s=THROTTLE_DONE pgs=2870 cs=0 l=1 rx=0x7f0bf4010420 tx=0x7f0bf40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c03190700 1 --2- 172.21.15.80:0/528452733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc128b80 0x7f0bfc167d70 secure :-1 s=THROTTLE_DONE pgs=2870 cs=0 l=1 rx=0x7f0bf4010420 tx=0x7f0bf40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0bfb7fe700 1 -- 172.21.15.80:0/528452733 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf4009770 con 0x7f0bfc128b80 2019-11-28T11:58:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c043f2700 1 -- 172.21.15.80:0/528452733 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bfc12af40 con 0x7f0bfc128b80 2019-11-28T11:58:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0bfb7fe700 1 -- 172.21.15.80:0/528452733 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bf4009e40 con 0x7f0bfc128b80 2019-11-28T11:58:26.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.080+0000 7f0c043f2700 1 -- 172.21.15.80:0/528452733 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bfc12abc0 con 0x7f0bfc128b80 2019-11-28T11:58:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.081+0000 7f0c03190700 1 --2- 172.21.15.80:0/528452733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc128b80 0x7f0bfc167d70 secure :-1 s=THROTTLE_DONE pgs=2870 cs=0 l=1 rx=0x7f0bf4010420 tx=0x7f0bf40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.081+0000 7f0bfb7fe700 1 -- 172.21.15.80:0/528452733 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0bf400ac20 con 0x7f0bfc128b80 2019-11-28T11:58:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.081+0000 7f0c03190700 1 --2- 172.21.15.80:0/528452733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc128b80 0x7f0bfc167d70 secure :-1 s=THROTTLE_DONE pgs=2870 cs=0 l=1 rx=0x7f0bf4010420 tx=0x7f0bf40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.081+0000 7f0bfb7fe700 1 --2- 172.21.15.80:0/528452733 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0be4018730 0x7f0be401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.081+0000 7f0bfb7fe700 1 -- 172.21.15.80:0/528452733 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0bf4031ac0 con 0x7f0bfc128b80 2019-11-28T11:58:26.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.081+0000 7f0c0298f700 1 --2- 172.21.15.80:0/528452733 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0be4018730 0x7f0be401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.081+0000 7f0c0298f700 1 --2- 172.21.15.80:0/528452733 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0be4018730 0x7f0be401abc0 crc :-1 s=READY pgs=1188 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:26.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.089+0000 7f0c043f2700 1 -- 172.21.15.80:0/528452733 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bfc12af40 con 0x7f0bfc128b80 2019-11-28T11:58:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.092+0000 7f0c03190700 1 --2- 172.21.15.80:0/528452733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc128b80 0x7f0bfc167d70 secure :-1 s=THROTTLE_DONE pgs=2870 cs=0 l=1 rx=0x7f0bf4010420 tx=0x7f0bf40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.093+0000 7f0bfb7fe700 1 -- 172.21.15.80:0/528452733 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0bf4000b20 con 0x7f0bfc128b80 2019-11-28T11:58:26.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.265+0000 7f0c043f2700 1 -- 172.21.15.80:0/528452733 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bfc12abc0 con 0x7f0bfc128b80 2019-11-28T11:58:26.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.266+0000 7f0c03190700 1 --2- 172.21.15.80:0/528452733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc128b80 0x7f0bfc167d70 secure :-1 s=THROTTLE_DONE pgs=2870 cs=0 l=1 rx=0x7f0bf4010420 tx=0x7f0bf40102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.266+0000 7f0bfb7fe700 1 -- 172.21.15.80:0/528452733 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 183 v183) v1 ==== 95+0+1428 (secure 0 0 0) 0x7f0bf4017a50 con 0x7f0bfc128b80 2019-11-28T11:58:26.263 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 183 2019-11-28T11:58:26.263 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:26.263 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":183,"default_fscid":18,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":183,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:58:24.286894+0000","modified":"2019-11-28T11:58:25.914617+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[37],"metadata_pool":36,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":18}]} 2019-11-28T11:58:26.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.268+0000 7f0c043f2700 1 -- 172.21.15.80:0/528452733 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0be4018730 msgr2=0x7f0be401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.268+0000 7f0c043f2700 1 --2- 172.21.15.80:0/528452733 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0be4018730 0x7f0be401abc0 crc :-1 s=READY pgs=1188 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.268+0000 7f0c043f2700 1 -- 172.21.15.80:0/528452733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc128b80 msgr2=0x7f0bfc167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.268+0000 7f0c043f2700 1 --2- 172.21.15.80:0/528452733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc128b80 0x7f0bfc167d70 secure :-1 s=READY pgs=2870 cs=0 l=1 rx=0x7f0bf4010420 tx=0x7f0bf40102d0).stop 2019-11-28T11:58:26.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.268+0000 7f0c043f2700 1 -- 172.21.15.80:0/528452733 shutdown_connections 2019-11-28T11:58:26.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.268+0000 7f0c043f2700 1 --2- 172.21.15.80:0/528452733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bfc128b80 0x7f0bfc167d70 unknown :-1 s=CLOSED pgs=2870 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.268+0000 7f0c043f2700 1 --2- 172.21.15.80:0/528452733 >> v2:172.21.15.174:3300/0 conn(0x7f0bfc1281b0 0x7f0bfc128640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.268+0000 7f0c043f2700 1 --2- 172.21.15.80:0/528452733 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0be4018730 0x7f0be401abc0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.268+0000 7f0c043f2700 1 -- 172.21.15.80:0/528452733 shutdown_connections 2019-11-28T11:58:26.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.268+0000 7f0c043f2700 1 -- 172.21.15.80:0/528452733 wait complete. 2019-11-28T11:58:26.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.268+0000 7f0c043f2700 1 -- 172.21.15.80:0/528452733 >> 172.21.15.80:0/528452733 conn(0x7f0bfc127dc0 msgr2=0x7f0bfc141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:26.274 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:58:26.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.398+0000 7f8e61551700 1 Processor -- start 2019-11-28T11:58:26.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.398+0000 7f8e61551700 1 -- start start 2019-11-28T11:58:26.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.399+0000 7f8e61551700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8e5c06c490 0x7f8e5c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:26.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.399+0000 7f8e61551700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e5c06ce60 0x7f8e5c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:26.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.399+0000 7f8e61551700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5c06db00 con 0x7f8e5c06c0a0 2019-11-28T11:58:26.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.399+0000 7f8e61551700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c06fd60 con 0x7f8e5c06c490 2019-11-28T11:58:26.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.399+0000 7f8e61551700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c070030 con 0x7f8e5c06ce60 2019-11-28T11:58:26.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.399+0000 7f8e5b7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8e5c06c0a0 0x7f8e5c072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46282/0 (socket says 172.21.15.80:46282) 2019-11-28T11:58:26.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.399+0000 7f8e5b7fe700 1 -- 172.21.15.80:0/829177621 learned_addr learned my addr 172.21.15.80:0/829177621 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:26.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.399+0000 7f8e5bfff700 1 --2- 172.21.15.80:0/829177621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e5c06ce60 0x7f8e5c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:26.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.399+0000 7f8e5affd700 1 --2- 172.21.15.80:0/829177621 >> v2:172.21.15.174:3300/0 conn(0x7f8e5c06c490 0x7f8e5c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:26.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.399+0000 7f8e5a7fc700 1 -- 172.21.15.80:0/829177621 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294183995 0 0) 0x7f8e44001150 con 0x7f8e5c06c0a0 2019-11-28T11:58:26.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.399+0000 7f8e5a7fc700 1 -- 172.21.15.80:0/829177621 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e3c002e80 con 0x7f8e5c06c0a0 2019-11-28T11:58:26.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e5a7fc700 1 -- 172.21.15.80:0/829177621 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2766616674 0 0) 0x7f8e44001130 con 0x7f8e5c06c0a0 2019-11-28T11:58:26.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e5affd700 1 -- 172.21.15.80:0/829177621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e5c06ce60 msgr2=0x7f8e5c164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:26.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e5affd700 1 --2- 172.21.15.80:0/829177621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e5c06ce60 0x7f8e5c164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:26.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e5affd700 1 -- 172.21.15.80:0/829177621 >> v1:172.21.15.80:6789/0 conn(0x7f8e5c06c0a0 legacy=0x7f8e5c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e5affd700 1 -- 172.21.15.80:0/829177621 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c0706c0 con 0x7f8e5c06c490 2019-11-28T11:58:26.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e5bfff700 1 --2- 172.21.15.80:0/829177621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e5c06ce60 0x7f8e5c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:26.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e5affd700 1 --2- 172.21.15.80:0/829177621 >> v2:172.21.15.174:3300/0 conn(0x7f8e5c06c490 0x7f8e5c06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8e4c00b2d0 tx=0x7f8e4c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e5affd700 1 --2- 172.21.15.80:0/829177621 >> v2:172.21.15.174:3300/0 conn(0x7f8e5c06c490 0x7f8e5c06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8e4c00b2d0 tx=0x7f8e4c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e5affd700 1 --2- 172.21.15.80:0/829177621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e5c06c490 0x7f8e5c06c920 secure :-1 s=READY pgs=1738 cs=0 l=1 rx=0x7f8e4c00b2d0 tx=0x7f8e4c00bae0).ready entity=mon.1 client_cookie=91a4d1de710be6c1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:26.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e5affd700 1 --2- 172.21.15.80:0/829177621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e5c06c490 0x7f8e5c06c920 secure :-1 s=THROTTLE_DONE pgs=1738 cs=0 l=1 rx=0x7f8e4c00b2d0 tx=0x7f8e4c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e5a7fc700 1 -- 172.21.15.80:0/829177621 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e4c007590 con 0x7f8e5c06c490 2019-11-28T11:58:26.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e5affd700 1 --2- 172.21.15.80:0/829177621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e5c06c490 0x7f8e5c06c920 secure :-1 s=THROTTLE_DONE pgs=1738 cs=0 l=1 rx=0x7f8e4c00b2d0 tx=0x7f8e4c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e5affd700 1 --2- 172.21.15.80:0/829177621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e5c06c490 0x7f8e5c06c920 secure :-1 s=THROTTLE_DONE pgs=1738 cs=0 l=1 rx=0x7f8e4c00b2d0 tx=0x7f8e4c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e5a7fc700 1 -- 172.21.15.80:0/829177621 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c009d30 con 0x7f8e5c06c490 2019-11-28T11:58:26.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e5a7fc700 1 -- 172.21.15.80:0/829177621 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e4c00a400 con 0x7f8e5c06c490 2019-11-28T11:58:26.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e61551700 1 -- 172.21.15.80:0/829177621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e5c06c490 msgr2=0x7f8e5c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.400+0000 7f8e61551700 1 --2- 172.21.15.80:0/829177621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e5c06c490 0x7f8e5c06c920 secure :-1 s=READY pgs=1738 cs=0 l=1 rx=0x7f8e4c00b2d0 tx=0x7f8e4c00bae0).stop 2019-11-28T11:58:26.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.401+0000 7f8e61551700 1 -- 172.21.15.80:0/829177621 shutdown_connections 2019-11-28T11:58:26.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.401+0000 7f8e61551700 1 --2- 172.21.15.80:0/829177621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e5c06ce60 0x7f8e5c164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:26.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.401+0000 7f8e61551700 1 --2- 172.21.15.80:0/829177621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e5c06c490 0x7f8e5c06c920 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.401+0000 7f8e61551700 1 -- 172.21.15.80:0/829177621 shutdown_connections 2019-11-28T11:58:26.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.401+0000 7f8e61551700 1 -- 172.21.15.80:0/829177621 wait complete. 2019-11-28T11:58:26.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.401+0000 7f8e61551700 1 -- 172.21.15.80:0/829177621 >> 172.21.15.80:0/829177621 conn(0x7f8e5c061cf0 msgr2=0x7f8e5c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:26.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.403+0000 7f8e61551700 1 Processor -- start 2019-11-28T11:58:26.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.403+0000 7f8e61551700 1 -- start start 2019-11-28T11:58:26.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.404+0000 7f8e61551700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e5c13a780 0x7f8e5c12d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:26.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.404+0000 7f8e61551700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e5c12d9c0 0x7f8e5c12c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:26.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.404+0000 7f8e61551700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8e5c12c840 0x7f8e5c12ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:26.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.404+0000 7f8e61551700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c12a260 con 0x7f8e5c13a780 2019-11-28T11:58:26.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.404+0000 7f8e61551700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c12a530 con 0x7f8e5c12c840 2019-11-28T11:58:26.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.404+0000 7f8e61551700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c129830 con 0x7f8e5c12d9c0 2019-11-28T11:58:26.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.404+0000 7f8e5b7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e5c13a780 0x7f8e5c12d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:26.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.404+0000 7f8e5b7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e5c13a780 0x7f8e5c12d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46972/0 (socket says 172.21.15.80:46972) 2019-11-28T11:58:26.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.404+0000 7f8e5b7fe700 1 -- 172.21.15.80:0/2016453264 learned_addr learned my addr 172.21.15.80:0/2016453264 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:26.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.404+0000 7f8e5affd700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e5c12d9c0 0x7f8e5c12c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:26.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.404+0000 7f8e5bfff700 1 --2- 172.21.15.80:0/2016453264 >> v2:172.21.15.174:3300/0 conn(0x7f8e5c12c840 0x7f8e5c12ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:26.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e5b7fe700 1 -- 172.21.15.80:0/2016453264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e5c12d9c0 msgr2=0x7f8e5c12c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e5b7fe700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e5c12d9c0 0x7f8e5c12c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e5b7fe700 1 -- 172.21.15.80:0/2016453264 >> v2:172.21.15.174:3300/0 conn(0x7f8e5c12c840 msgr2=0x7f8e5c12ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e5b7fe700 1 --2- 172.21.15.80:0/2016453264 >> v2:172.21.15.174:3300/0 conn(0x7f8e5c12c840 0x7f8e5c12ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e5b7fe700 1 -- 172.21.15.80:0/2016453264 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c12abc0 con 0x7f8e5c13a780 2019-11-28T11:58:26.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e5b7fe700 1 --2- 172.21.15.80:0/2016453264 >> v2:172.21.15.80:3300/0 conn(0x7f8e5c13a780 0x7f8e5c12d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8e44010410 tx=0x7f8e440102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e5b7fe700 1 --2- 172.21.15.80:0/2016453264 >> v2:172.21.15.80:3300/0 conn(0x7f8e5c13a780 0x7f8e5c12d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8e44010410 tx=0x7f8e440102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e5b7fe700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c13a780 0x7f8e5c12d480 secure :-1 s=READY pgs=2872 cs=0 l=1 rx=0x7f8e44010410 tx=0x7f8e440102f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:26.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e5b7fe700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c13a780 0x7f8e5c12d480 secure :-1 s=THROTTLE_DONE pgs=2872 cs=0 l=1 rx=0x7f8e44010410 tx=0x7f8e440102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e53fff700 1 -- 172.21.15.80:0/2016453264 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e44000c90 con 0x7f8e5c13a780 2019-11-28T11:58:26.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e5b7fe700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c13a780 0x7f8e5c12d480 secure :-1 s=THROTTLE_DONE pgs=2872 cs=0 l=1 rx=0x7f8e44010410 tx=0x7f8e440102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e5b7fe700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c13a780 0x7f8e5c12d480 secure :-1 s=THROTTLE_DONE pgs=2872 cs=0 l=1 rx=0x7f8e44010410 tx=0x7f8e440102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e53fff700 1 -- 172.21.15.80:0/2016453264 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e440010c0 con 0x7f8e5c13a780 2019-11-28T11:58:26.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e61551700 1 -- 172.21.15.80:0/2016453264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5c12af40 con 0x7f8e5c13a780 2019-11-28T11:58:26.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e53fff700 1 -- 172.21.15.80:0/2016453264 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e44001710 con 0x7f8e5c13a780 2019-11-28T11:58:26.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e61551700 1 -- 172.21.15.80:0/2016453264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c12abc0 con 0x7f8e5c13a780 2019-11-28T11:58:26.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.405+0000 7f8e5b7fe700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c13a780 0x7f8e5c12d480 secure :-1 s=THROTTLE_DONE pgs=2872 cs=0 l=1 rx=0x7f8e44010410 tx=0x7f8e440102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.406+0000 7f8e53fff700 1 -- 172.21.15.80:0/2016453264 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8e44000c90 con 0x7f8e5c13a780 2019-11-28T11:58:26.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.406+0000 7f8e5b7fe700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c13a780 0x7f8e5c12d480 secure :-1 s=THROTTLE_DONE pgs=2872 cs=0 l=1 rx=0x7f8e44010410 tx=0x7f8e440102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.406+0000 7f8e53fff700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8e34018730 0x7f8e3401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:26.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.406+0000 7f8e53fff700 1 -- 172.21.15.80:0/2016453264 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8e440319c0 con 0x7f8e5c13a780 2019-11-28T11:58:26.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.406+0000 7f8e5affd700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8e34018730 0x7f8e3401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:26.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.406+0000 7f8e5affd700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8e34018730 0x7f8e3401abc0 crc :-1 s=READY pgs=1189 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:26.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.413+0000 7f8e61551700 1 -- 172.21.15.80:0/2016453264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5c12af40 con 0x7f8e5c13a780 2019-11-28T11:58:26.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.417+0000 7f8e5b7fe700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c13a780 0x7f8e5c12d480 secure :-1 s=THROTTLE_DONE pgs=2872 cs=0 l=1 rx=0x7f8e44010410 tx=0x7f8e440102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.417+0000 7f8e53fff700 1 -- 172.21.15.80:0/2016453264 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8e4402cf40 con 0x7f8e5c13a780 2019-11-28T11:58:26.591 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.594+0000 7f8e61551700 1 -- 172.21.15.80:0/2016453264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e5c12abc0 con 0x7f8e5c13a780 2019-11-28T11:58:26.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.595+0000 7f8e5b7fe700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c13a780 0x7f8e5c12d480 secure :-1 s=THROTTLE_DONE pgs=2872 cs=0 l=1 rx=0x7f8e44010410 tx=0x7f8e440102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.595+0000 7f8e53fff700 1 -- 172.21.15.80:0/2016453264 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v223) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f8e4402cf40 con 0x7f8e5c13a780 2019-11-28T11:58:26.592 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:26.592 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":223,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:58:25.288240+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":37,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":36,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:58:22.567726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"222","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":37,"pool_name":"cephfs_data","create_time":"2019-11-28T11:58:23.259981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"223","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":220,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:58:26.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.597+0000 7f8e61551700 1 -- 172.21.15.80:0/2016453264 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8e34018730 msgr2=0x7f8e3401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.597+0000 7f8e61551700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8e34018730 0x7f8e3401abc0 crc :-1 s=READY pgs=1189 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.597+0000 7f8e61551700 1 -- 172.21.15.80:0/2016453264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c13a780 msgr2=0x7f8e5c12d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.597+0000 7f8e61551700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c13a780 0x7f8e5c12d480 secure :-1 s=READY pgs=2872 cs=0 l=1 rx=0x7f8e44010410 tx=0x7f8e440102f0).stop 2019-11-28T11:58:26.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.598+0000 7f8e61551700 1 -- 172.21.15.80:0/2016453264 shutdown_connections 2019-11-28T11:58:26.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.598+0000 7f8e61551700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8e34018730 0x7f8e3401abc0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.598+0000 7f8e61551700 1 --2- 172.21.15.80:0/2016453264 >> v2:172.21.15.174:3300/0 conn(0x7f8e5c12c840 0x7f8e5c12ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.598+0000 7f8e61551700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e5c12d9c0 0x7f8e5c12c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.598+0000 7f8e61551700 1 --2- 172.21.15.80:0/2016453264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c13a780 0x7f8e5c12d480 unknown :-1 s=CLOSED pgs=2872 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.598+0000 7f8e61551700 1 -- 172.21.15.80:0/2016453264 shutdown_connections 2019-11-28T11:58:26.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.598+0000 7f8e61551700 1 -- 172.21.15.80:0/2016453264 wait complete. 2019-11-28T11:58:26.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.598+0000 7f8e61551700 1 -- 172.21.15.80:0/2016453264 >> 172.21.15.80:0/2016453264 conn(0x7f8e5c127dc0 msgr2=0x7f8e5c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:26.605 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T11:58:26.605 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T11:58:26.606 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T11:58:26.606 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T11:58:26.606 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T11:58:26.607 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T11:58:26.610 INFO:tasks.ceph.mds.a:Started 2019-11-28T11:58:26.611 DEBUG:teuthology.parallel:result is None 2019-11-28T11:58:26.612 INFO:tasks.ceph.mds.b:Started 2019-11-28T11:58:26.612 DEBUG:teuthology.parallel:result is None 2019-11-28T11:58:26.613 INFO:tasks.ceph.mds.c:Started 2019-11-28T11:58:26.613 DEBUG:teuthology.parallel:result is None 2019-11-28T11:58:26.613 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:58:26.695 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T11:58:26.701 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T11:58:26.701 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T11:58:26.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.753+0000 7f1dd4e05700 1 Processor -- start 2019-11-28T11:58:26.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.753+0000 7f1dd4e05700 1 -- start start 2019-11-28T11:58:26.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.754+0000 7f1dd4e05700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1dd015f100 0x7f1dd006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:26.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.754+0000 7f1dd4e05700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1dd006c2f0 0x7f1dd006c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:26.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dd4e05700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd006db60 con 0x7f1dd015ed10 2019-11-28T11:58:26.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dd4e05700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd006fe00 con 0x7f1dd015f100 2019-11-28T11:58:26.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dd4e05700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00700d0 con 0x7f1dd006c2f0 2019-11-28T11:58:26.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dce59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1dd015f100 0x7f1dd006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:26.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dce59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1dd015f100 0x7f1dd006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47008/0 (socket says 172.21.15.80:47008) 2019-11-28T11:58:26.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dce59c700 1 -- 172.21.15.80:0/658021421 learned_addr learned my addr 172.21.15.80:0/658021421 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:26.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dced9d700 1 --1- 172.21.15.80:0/658021421 >> v1:172.21.15.80:6789/0 conn(0x7f1dd015ed10 0x7f1dd0073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46320/0 (socket says 172.21.15.80:46320) 2019-11-28T11:58:26.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dcf59e700 1 --2- 172.21.15.80:0/658021421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1dd006c2f0 0x7f1dd006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:26.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dce59c700 1 -- 172.21.15.80:0/658021421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1dd006c2f0 msgr2=0x7f1dd006c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:26.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dce59c700 1 --2- 172.21.15.80:0/658021421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1dd006c2f0 0x7f1dd006c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:26.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dce59c700 1 -- 172.21.15.80:0/658021421 >> v1:172.21.15.80:6789/0 conn(0x7f1dd015ed10 legacy=0x7f1dd0073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dce59c700 1 -- 172.21.15.80:0/658021421 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd0070760 con 0x7f1dd015f100 2019-11-28T11:58:26.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dcdd9b700 1 -- 172.21.15.80:0/658021421 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803350991 0 0) 0x7f1db8001100 con 0x7f1dd015ed10 2019-11-28T11:58:26.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dce59c700 1 --2- 172.21.15.80:0/658021421 >> v2:172.21.15.80:3300/0 conn(0x7f1dd015f100 0x7f1dd006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1dc000fa40 tx=0x7f1dc000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dce59c700 1 --2- 172.21.15.80:0/658021421 >> v2:172.21.15.80:3300/0 conn(0x7f1dd015f100 0x7f1dd006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1dc000fa40 tx=0x7f1dc000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dce59c700 1 --2- 172.21.15.80:0/658021421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd015f100 0x7f1dd006bdb0 secure :-1 s=READY pgs=2879 cs=0 l=1 rx=0x7f1dc000fa40 tx=0x7f1dc000fde0).ready entity=mon.0 client_cookie=a9e9ec01d165b869 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:26.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dce59c700 1 --2- 172.21.15.80:0/658021421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd015f100 0x7f1dd006bdb0 secure :-1 s=THROTTLE_DONE pgs=2879 cs=0 l=1 rx=0x7f1dc000fa40 tx=0x7f1dc000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dcdd9b700 1 -- 172.21.15.80:0/658021421 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc0000ce0 con 0x7f1dd015f100 2019-11-28T11:58:26.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dce59c700 1 --2- 172.21.15.80:0/658021421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd015f100 0x7f1dd006bdb0 secure :-1 s=THROTTLE_DONE pgs=2879 cs=0 l=1 rx=0x7f1dc000fa40 tx=0x7f1dc000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dcdd9b700 1 -- 172.21.15.80:0/658021421 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc0000ce0 con 0x7f1dd015f100 2019-11-28T11:58:26.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dce59c700 1 --2- 172.21.15.80:0/658021421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd015f100 0x7f1dd006bdb0 secure :-1 s=THROTTLE_DONE pgs=2879 cs=0 l=1 rx=0x7f1dc000fa40 tx=0x7f1dc000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dcdd9b700 1 -- 172.21.15.80:0/658021421 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc00013f0 con 0x7f1dd015f100 2019-11-28T11:58:26.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dd4e05700 1 -- 172.21.15.80:0/658021421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd015f100 msgr2=0x7f1dd006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.755+0000 7f1dd4e05700 1 --2- 172.21.15.80:0/658021421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd015f100 0x7f1dd006bdb0 secure :-1 s=READY pgs=2879 cs=0 l=1 rx=0x7f1dc000fa40 tx=0x7f1dc000fde0).stop 2019-11-28T11:58:26.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.756+0000 7f1dd4e05700 1 -- 172.21.15.80:0/658021421 shutdown_connections 2019-11-28T11:58:26.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.756+0000 7f1dd4e05700 1 --2- 172.21.15.80:0/658021421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1dd006c2f0 0x7f1dd006c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:26.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.756+0000 7f1dd4e05700 1 --2- 172.21.15.80:0/658021421 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd015f100 0x7f1dd006bdb0 unknown :-1 s=CLOSED pgs=2879 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.756+0000 7f1dd4e05700 1 -- 172.21.15.80:0/658021421 shutdown_connections 2019-11-28T11:58:26.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.756+0000 7f1dd4e05700 1 -- 172.21.15.80:0/658021421 wait complete. 2019-11-28T11:58:26.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.756+0000 7f1dd4e05700 1 -- 172.21.15.80:0/658021421 >> 172.21.15.80:0/658021421 conn(0x7f1dd0061d40 msgr2=0x7f1dd00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:26.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.759+0000 7f1dd4e05700 1 Processor -- start 2019-11-28T11:58:26.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.759+0000 7f1dd4e05700 1 -- start start 2019-11-28T11:58:26.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.759+0000 7f1dd4e05700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1dd012e1a0 0x7f1dd012e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:26.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.759+0000 7f1dd4e05700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1dd012eb70 0x7f1dd0105a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:26.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.759+0000 7f1dd4e05700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd0130b20 con 0x7f1dd0114f60 2019-11-28T11:58:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.759+0000 7f1dd4e05700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd0148b60 con 0x7f1dd012eb70 2019-11-28T11:58:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.759+0000 7f1dd4e05700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd0148e30 con 0x7f1dd012e1a0 2019-11-28T11:58:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.759+0000 7f1dced9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1dd0114f60 0x7f1dd0106b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46326/0 (socket says 172.21.15.80:46326) 2019-11-28T11:58:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.759+0000 7f1dced9d700 1 -- 172.21.15.80:0/1200706725 learned_addr learned my addr 172.21.15.80:0/1200706725 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dcf59e700 1 --2- 172.21.15.80:0/1200706725 >> v2:172.21.15.80:3300/0 conn(0x7f1dd012eb70 0x7f1dd0105a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dce59c700 1 --2- 172.21.15.80:0/1200706725 >> v2:172.21.15.174:3300/0 conn(0x7f1dd012e1a0 0x7f1dd012e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:26.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dcf59e700 1 -- 172.21.15.80:0/1200706725 >> v2:172.21.15.174:3300/0 conn(0x7f1dd012e1a0 msgr2=0x7f1dd012e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dcf59e700 1 --2- 172.21.15.80:0/1200706725 >> v2:172.21.15.174:3300/0 conn(0x7f1dd012e1a0 0x7f1dd012e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dcf59e700 1 -- 172.21.15.80:0/1200706725 >> v1:172.21.15.80:6789/0 conn(0x7f1dd0114f60 legacy=0x7f1dd0106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dcf59e700 1 -- 172.21.15.80:0/1200706725 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd0104390 con 0x7f1dd012eb70 2019-11-28T11:58:26.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dc77fe700 1 -- 172.21.15.80:0/1200706725 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151361831 0 0) 0x7f1db8001150 con 0x7f1dd0114f60 2019-11-28T11:58:26.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dcf59e700 1 --2- 172.21.15.80:0/1200706725 >> v2:172.21.15.80:3300/0 conn(0x7f1dd012eb70 0x7f1dd0105a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1dc8010390 tx=0x7f1dc800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dcf59e700 1 --2- 172.21.15.80:0/1200706725 >> v2:172.21.15.80:3300/0 conn(0x7f1dd012eb70 0x7f1dd0105a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1dc8010390 tx=0x7f1dc800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dcf59e700 1 --2- 172.21.15.80:0/1200706725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd012eb70 0x7f1dd0105a10 secure :-1 s=READY pgs=2881 cs=0 l=1 rx=0x7f1dc8010390 tx=0x7f1dc800ada0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dcf59e700 1 --2- 172.21.15.80:0/1200706725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd012eb70 0x7f1dd0105a10 secure :-1 s=THROTTLE_DONE pgs=2881 cs=0 l=1 rx=0x7f1dc8010390 tx=0x7f1dc800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dc77fe700 1 -- 172.21.15.80:0/1200706725 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc8000a70 con 0x7f1dd012eb70 2019-11-28T11:58:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dcf59e700 1 --2- 172.21.15.80:0/1200706725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd012eb70 0x7f1dd0105a10 secure :-1 s=THROTTLE_DONE pgs=2881 cs=0 l=1 rx=0x7f1dc8010390 tx=0x7f1dc800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dcf59e700 1 --2- 172.21.15.80:0/1200706725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd012eb70 0x7f1dd0105a10 secure :-1 s=THROTTLE_DONE pgs=2881 cs=0 l=1 rx=0x7f1dc8010390 tx=0x7f1dc800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dc77fe700 1 -- 172.21.15.80:0/1200706725 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc800ef80 con 0x7f1dd012eb70 2019-11-28T11:58:26.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dc77fe700 1 -- 172.21.15.80:0/1200706725 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc800f170 con 0x7f1dd012eb70 2019-11-28T11:58:26.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dd4e05700 1 -- 172.21.15.80:0/1200706725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd0104710 con 0x7f1dd012eb70 2019-11-28T11:58:26.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.760+0000 7f1dd4e05700 1 -- 172.21.15.80:0/1200706725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd0104390 con 0x7f1dd012eb70 2019-11-28T11:58:26.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.761+0000 7f1dcf59e700 1 --2- 172.21.15.80:0/1200706725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd012eb70 0x7f1dd0105a10 secure :-1 s=THROTTLE_DONE pgs=2881 cs=0 l=1 rx=0x7f1dc8010390 tx=0x7f1dc800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.761+0000 7f1dc77fe700 1 -- 172.21.15.80:0/1200706725 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1dc8000a70 con 0x7f1dd012eb70 2019-11-28T11:58:26.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.761+0000 7f1dcf59e700 1 --2- 172.21.15.80:0/1200706725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd012eb70 0x7f1dd0105a10 secure :-1 s=THROTTLE_DONE pgs=2881 cs=0 l=1 rx=0x7f1dc8010390 tx=0x7f1dc800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.761+0000 7f1dc77fe700 1 --2- 172.21.15.80:0/1200706725 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1da8018730 0x7f1da801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:26.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.761+0000 7f1dc77fe700 1 -- 172.21.15.80:0/1200706725 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1dc8031a20 con 0x7f1dd012eb70 2019-11-28T11:58:26.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.761+0000 7f1dced9d700 1 --2- 172.21.15.80:0/1200706725 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1da8018730 0x7f1da801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:26.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.761+0000 7f1dced9d700 1 --2- 172.21.15.80:0/1200706725 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1da8018730 0x7f1da801abc0 crc :-1 s=READY pgs=1190 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:26.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.769+0000 7f1dd4e05700 1 -- 172.21.15.80:0/1200706725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd0104710 con 0x7f1dd012eb70 2019-11-28T11:58:26.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.772+0000 7f1dcf59e700 1 --2- 172.21.15.80:0/1200706725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd012eb70 0x7f1dd0105a10 secure :-1 s=THROTTLE_DONE pgs=2881 cs=0 l=1 rx=0x7f1dc8010390 tx=0x7f1dc800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.772+0000 7f1dc77fe700 1 -- 172.21.15.80:0/1200706725 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1dc800eb30 con 0x7f1dd012eb70 2019-11-28T11:58:26.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.945+0000 7f1dd4e05700 1 -- 172.21.15.80:0/1200706725 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1dd0104390 con 0x7f1dd012eb70 2019-11-28T11:58:26.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.950+0000 7f1dcf59e700 1 --2- 172.21.15.80:0/1200706725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd012eb70 0x7f1dd0105a10 secure :-1 s=THROTTLE_DONE pgs=2881 cs=0 l=1 rx=0x7f1dc8010390 tx=0x7f1dc800ada0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:26.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.950+0000 7f1dc77fe700 1 -- 172.21.15.80:0/1200706725 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v76) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1dc800f150 con 0x7f1dd012eb70 2019-11-28T11:58:26.948 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T11:58:26.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.955+0000 7f1dd4e05700 1 -- 172.21.15.80:0/1200706725 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1da8018730 msgr2=0x7f1da801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.955+0000 7f1dd4e05700 1 --2- 172.21.15.80:0/1200706725 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1da8018730 0x7f1da801abc0 crc :-1 s=READY pgs=1190 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.955+0000 7f1dd4e05700 1 -- 172.21.15.80:0/1200706725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd012eb70 msgr2=0x7f1dd0105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:26.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.955+0000 7f1dd4e05700 1 --2- 172.21.15.80:0/1200706725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd012eb70 0x7f1dd0105a10 secure :-1 s=READY pgs=2881 cs=0 l=1 rx=0x7f1dc8010390 tx=0x7f1dc800ada0).stop 2019-11-28T11:58:26.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.955+0000 7f1dd4e05700 1 -- 172.21.15.80:0/1200706725 shutdown_connections 2019-11-28T11:58:26.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.955+0000 7f1dd4e05700 1 --2- 172.21.15.80:0/1200706725 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1da8018730 0x7f1da801abc0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.955+0000 7f1dd4e05700 1 --2- 172.21.15.80:0/1200706725 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1dd012eb70 0x7f1dd0105a10 unknown :-1 s=CLOSED pgs=2881 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.955+0000 7f1dd4e05700 1 --2- 172.21.15.80:0/1200706725 >> v2:172.21.15.174:3300/0 conn(0x7f1dd012e1a0 0x7f1dd012e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:26.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.955+0000 7f1dd4e05700 1 -- 172.21.15.80:0/1200706725 shutdown_connections 2019-11-28T11:58:26.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.955+0000 7f1dd4e05700 1 -- 172.21.15.80:0/1200706725 wait complete. 2019-11-28T11:58:26.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:26.955+0000 7f1dd4e05700 1 -- 172.21.15.80:0/1200706725 >> 172.21.15.80:0/1200706725 conn(0x7f1dd01476e0 msgr2=0x7f1dd012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:26.960 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:58:27.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.095+0000 7f6f070f5700 1 Processor -- start 2019-11-28T11:58:27.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.095+0000 7f6f070f5700 1 -- start start 2019-11-28T11:58:27.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.096+0000 7f6f070f5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6f0015ed10 0x7f6f0015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:27.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.096+0000 7f6f070f5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f000734b0 0x7f6f000726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:27.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.096+0000 7f6f070f5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0006db60 con 0x7f6f00073020 2019-11-28T11:58:27.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.096+0000 7f6f070f5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f0006fe00 con 0x7f6f000734b0 2019-11-28T11:58:27.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.096+0000 7f6f070f5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f000700d0 con 0x7f6f0015ed10 2019-11-28T11:58:27.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.096+0000 7f6f05e93700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f000734b0 0x7f6f000726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.096+0000 7f6f04e91700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6f00073020 0x7f6f00071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46338/0 (socket says 172.21.15.80:46338) 2019-11-28T11:58:27.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.096+0000 7f6f04e91700 1 -- 172.21.15.80:0/622516705 learned_addr learned my addr 172.21.15.80:0/622516705 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:27.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.096+0000 7f6f05692700 1 --2- 172.21.15.80:0/622516705 >> v2:172.21.15.174:3300/0 conn(0x7f6f0015ed10 0x7f6f0015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.097+0000 7f6f05e93700 1 -- 172.21.15.80:0/622516705 >> v2:172.21.15.174:3300/0 conn(0x7f6f0015ed10 msgr2=0x7f6f0015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:27.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.097+0000 7f6f05e93700 1 --2- 172.21.15.80:0/622516705 >> v2:172.21.15.174:3300/0 conn(0x7f6f0015ed10 0x7f6f0015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:27.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.097+0000 7f6f05e93700 1 -- 172.21.15.80:0/622516705 >> v1:172.21.15.80:6789/0 conn(0x7f6f00073020 legacy=0x7f6f00071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.097+0000 7f6efffff700 1 -- 172.21.15.80:0/622516705 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393006782 0 0) 0x7f6ef0001070 con 0x7f6f00073020 2019-11-28T11:58:27.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.097+0000 7f6f05e93700 1 -- 172.21.15.80:0/622516705 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f00070760 con 0x7f6f000734b0 2019-11-28T11:58:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.097+0000 7f6f05e93700 1 --2- 172.21.15.80:0/622516705 >> v2:172.21.15.80:3300/0 conn(0x7f6f000734b0 0x7f6f000726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ef800af50 tx=0x7f6ef800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.097+0000 7f6f05e93700 1 --2- 172.21.15.80:0/622516705 >> v2:172.21.15.80:3300/0 conn(0x7f6f000734b0 0x7f6f000726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ef800af50 tx=0x7f6ef800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.097+0000 7f6f05e93700 1 --2- 172.21.15.80:0/622516705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f000734b0 0x7f6f000726a0 secure :-1 s=READY pgs=2883 cs=0 l=1 rx=0x7f6ef800af50 tx=0x7f6ef800b6e0).ready entity=mon.0 client_cookie=1def8bf63bddf91d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.097+0000 7f6f05e93700 1 --2- 172.21.15.80:0/622516705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f000734b0 0x7f6f000726a0 secure :-1 s=THROTTLE_DONE pgs=2883 cs=0 l=1 rx=0x7f6ef800af50 tx=0x7f6ef800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.097+0000 7f6efffff700 1 -- 172.21.15.80:0/622516705 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ef8009ba0 con 0x7f6f000734b0 2019-11-28T11:58:27.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.097+0000 7f6f05e93700 1 --2- 172.21.15.80:0/622516705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f000734b0 0x7f6f000726a0 secure :-1 s=THROTTLE_DONE pgs=2883 cs=0 l=1 rx=0x7f6ef800af50 tx=0x7f6ef800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.097+0000 7f6f05e93700 1 --2- 172.21.15.80:0/622516705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f000734b0 0x7f6f000726a0 secure :-1 s=THROTTLE_DONE pgs=2883 cs=0 l=1 rx=0x7f6ef800af50 tx=0x7f6ef800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.097+0000 7f6efffff700 1 -- 172.21.15.80:0/622516705 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef80097c0 con 0x7f6f000734b0 2019-11-28T11:58:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.097+0000 7f6efffff700 1 -- 172.21.15.80:0/622516705 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ef800a180 con 0x7f6f000734b0 2019-11-28T11:58:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.097+0000 7f6f070f5700 1 -- 172.21.15.80:0/622516705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f000734b0 msgr2=0x7f6f000726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.097+0000 7f6f070f5700 1 --2- 172.21.15.80:0/622516705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f000734b0 0x7f6f000726a0 secure :-1 s=READY pgs=2883 cs=0 l=1 rx=0x7f6ef800af50 tx=0x7f6ef800b6e0).stop 2019-11-28T11:58:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.098+0000 7f6f070f5700 1 -- 172.21.15.80:0/622516705 shutdown_connections 2019-11-28T11:58:27.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.098+0000 7f6f070f5700 1 --2- 172.21.15.80:0/622516705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f000734b0 0x7f6f000726a0 unknown :-1 s=CLOSED pgs=2883 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.098+0000 7f6f070f5700 1 --2- 172.21.15.80:0/622516705 >> v2:172.21.15.174:3300/0 conn(0x7f6f0015ed10 0x7f6f0015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.098+0000 7f6f070f5700 1 -- 172.21.15.80:0/622516705 shutdown_connections 2019-11-28T11:58:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.098+0000 7f6f070f5700 1 -- 172.21.15.80:0/622516705 wait complete. 2019-11-28T11:58:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.098+0000 7f6f070f5700 1 -- 172.21.15.80:0/622516705 >> 172.21.15.80:0/622516705 conn(0x7f6f00061d40 msgr2=0x7f6f000641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.100+0000 7f6f070f5700 1 Processor -- start 2019-11-28T11:58:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.100+0000 7f6f070f5700 1 -- start start 2019-11-28T11:58:27.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.101+0000 7f6f070f5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f00152750 0x7f6f00135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.101+0000 7f6f070f5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f00165d60 0x7f6f00168160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.101+0000 7f6f070f5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f00109d70 con 0x7f6f00130dc0 2019-11-28T11:58:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.101+0000 7f6f070f5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f0010a460 con 0x7f6f00165d60 2019-11-28T11:58:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.101+0000 7f6f070f5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00132570 con 0x7f6f00152750 2019-11-28T11:58:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.101+0000 7f6f05e93700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f00165d60 0x7f6f00168160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.101+0000 7f6f05e93700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6f00165d60 0x7f6f00168160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47028/0 (socket says 172.21.15.80:47028) 2019-11-28T11:58:27.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.101+0000 7f6f05e93700 1 -- 172.21.15.80:0/3549506042 learned_addr learned my addr 172.21.15.80:0/3549506042 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:27.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6f05692700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f00152750 0x7f6f00135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6f05e93700 1 -- 172.21.15.80:0/3549506042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f00152750 msgr2=0x7f6f00135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6f05e93700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f00152750 0x7f6f00135790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6f05e93700 1 -- 172.21.15.80:0/3549506042 >> v1:172.21.15.174:6789/0 conn(0x7f6f00130dc0 legacy=0x7f6f00131250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6f05e93700 1 -- 172.21.15.80:0/3549506042 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f00132ed0 con 0x7f6f00165d60 2019-11-28T11:58:27.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6f05692700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f00152750 0x7f6f00135790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:58:27.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6f05e93700 1 --2- 172.21.15.80:0/3549506042 >> v2:172.21.15.80:3300/0 conn(0x7f6f00165d60 0x7f6f00168160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ef8010470 tx=0x7f6ef8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6f05e93700 1 --2- 172.21.15.80:0/3549506042 >> v2:172.21.15.80:3300/0 conn(0x7f6f00165d60 0x7f6f00168160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ef8010470 tx=0x7f6ef8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6f05e93700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f00165d60 0x7f6f00168160 secure :-1 s=READY pgs=2884 cs=0 l=1 rx=0x7f6ef8010470 tx=0x7f6ef8010810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:27.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6f05e93700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f00165d60 0x7f6f00168160 secure :-1 s=THROTTLE_DONE pgs=2884 cs=0 l=1 rx=0x7f6ef8010470 tx=0x7f6ef8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6f05e93700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f00165d60 0x7f6f00168160 secure :-1 s=THROTTLE_DONE pgs=2884 cs=0 l=1 rx=0x7f6ef8010470 tx=0x7f6ef8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6efdffb700 1 -- 172.21.15.80:0/3549506042 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ef8009960 con 0x7f6f00165d60 2019-11-28T11:58:27.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6f05e93700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f00165d60 0x7f6f00168160 secure :-1 s=THROTTLE_DONE pgs=2884 cs=0 l=1 rx=0x7f6ef8010470 tx=0x7f6ef8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6efdffb700 1 -- 172.21.15.80:0/3549506042 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef8009580 con 0x7f6f00165d60 2019-11-28T11:58:27.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6f070f5700 1 -- 172.21.15.80:0/3549506042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f00133250 con 0x7f6f00165d60 2019-11-28T11:58:27.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6efdffb700 1 -- 172.21.15.80:0/3549506042 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ef8009f60 con 0x7f6f00165d60 2019-11-28T11:58:27.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6f070f5700 1 -- 172.21.15.80:0/3549506042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f00132ed0 con 0x7f6f00165d60 2019-11-28T11:58:27.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.102+0000 7f6f05e93700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f00165d60 0x7f6f00168160 secure :-1 s=THROTTLE_DONE pgs=2884 cs=0 l=1 rx=0x7f6ef8010470 tx=0x7f6ef8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.103+0000 7f6efdffb700 1 -- 172.21.15.80:0/3549506042 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6ef8009770 con 0x7f6f00165d60 2019-11-28T11:58:27.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.103+0000 7f6f05e93700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f00165d60 0x7f6f00168160 secure :-1 s=THROTTLE_DONE pgs=2884 cs=0 l=1 rx=0x7f6ef8010470 tx=0x7f6ef8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.103+0000 7f6efdffb700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ee4018730 0x7f6ee401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:27.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.103+0000 7f6efdffb700 1 -- 172.21.15.80:0/3549506042 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6ef8031b00 con 0x7f6f00165d60 2019-11-28T11:58:27.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.103+0000 7f6f05692700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ee4018730 0x7f6ee401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.103+0000 7f6f05692700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ee4018730 0x7f6ee401abc0 crc :-1 s=READY pgs=1191 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:27.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.111+0000 7f6f070f5700 1 -- 172.21.15.80:0/3549506042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f00133250 con 0x7f6f00165d60 2019-11-28T11:58:27.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.114+0000 7f6f05e93700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f00165d60 0x7f6f00168160 secure :-1 s=THROTTLE_DONE pgs=2884 cs=0 l=1 rx=0x7f6ef8010470 tx=0x7f6ef8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.114+0000 7f6efdffb700 1 -- 172.21.15.80:0/3549506042 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6ef8000be0 con 0x7f6f00165d60 2019-11-28T11:58:27.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.283+0000 7f6f070f5700 1 -- 172.21.15.80:0/3549506042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6f00132ed0 con 0x7f6f00165d60 2019-11-28T11:58:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.288+0000 7f6f05e93700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f00165d60 0x7f6f00168160 secure :-1 s=THROTTLE_DONE pgs=2884 cs=0 l=1 rx=0x7f6ef8010470 tx=0x7f6ef8010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.288+0000 7f6efdffb700 1 -- 172.21.15.80:0/3549506042 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v77) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6ef80098c0 con 0x7f6f00165d60 2019-11-28T11:58:27.291 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T11:58:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.292+0000 7f6f070f5700 1 -- 172.21.15.80:0/3549506042 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ee4018730 msgr2=0x7f6ee401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.292+0000 7f6f070f5700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ee4018730 0x7f6ee401abc0 crc :-1 s=READY pgs=1191 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.292+0000 7f6f070f5700 1 -- 172.21.15.80:0/3549506042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f00165d60 msgr2=0x7f6f00168160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.292 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.292+0000 7f6f070f5700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f00165d60 0x7f6f00168160 secure :-1 s=READY pgs=2884 cs=0 l=1 rx=0x7f6ef8010470 tx=0x7f6ef8010810).stop 2019-11-28T11:58:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.292+0000 7f6f070f5700 1 -- 172.21.15.80:0/3549506042 shutdown_connections 2019-11-28T11:58:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.292+0000 7f6f070f5700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f00165d60 0x7f6f00168160 unknown :-1 s=CLOSED pgs=2884 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.292+0000 7f6f070f5700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ee4018730 0x7f6ee401abc0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.293 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.292+0000 7f6f070f5700 1 --2- 172.21.15.80:0/3549506042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f00152750 0x7f6f00135790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.292+0000 7f6f070f5700 1 -- 172.21.15.80:0/3549506042 shutdown_connections 2019-11-28T11:58:27.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.293+0000 7f6f070f5700 1 -- 172.21.15.80:0/3549506042 wait complete. 2019-11-28T11:58:27.295 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.293+0000 7f6f070f5700 1 -- 172.21.15.80:0/3549506042 >> 172.21.15.80:0/3549506042 conn(0x7f6f001476e0 msgr2=0x7f6f0012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:27.298 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:58:27.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.435+0000 7f077f857700 1 Processor -- start 2019-11-28T11:58:27.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.435+0000 7f077f857700 1 -- start start 2019-11-28T11:58:27.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.436+0000 7f077f857700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f077815f100 0x7f077806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:27.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.436+0000 7f077f857700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f077806c2f0 0x7f077806c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:27.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.436+0000 7f077f857700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077806db60 con 0x7f077815ed10 2019-11-28T11:58:27.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.436+0000 7f077f857700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077806fe00 con 0x7f077815f100 2019-11-28T11:58:27.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.436+0000 7f077f857700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780700d0 con 0x7f077806c2f0 2019-11-28T11:58:27.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.436+0000 7f077ddf4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f077815ed10 0x7f0778073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46348/0 (socket says 172.21.15.80:46348) 2019-11-28T11:58:27.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.436+0000 7f077ddf4700 1 -- 172.21.15.80:0/3127832872 learned_addr learned my addr 172.21.15.80:0/3127832872 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:27.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.436+0000 7f077d5f3700 1 --2- 172.21.15.80:0/3127832872 >> v2:172.21.15.174:3300/0 conn(0x7f077815f100 0x7f077806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.438 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.436+0000 7f077e5f5700 1 --2- 172.21.15.80:0/3127832872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f077806c2f0 0x7f077806c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.436+0000 7f077cdf2700 1 -- 172.21.15.80:0/3127832872 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987797197 0 0) 0x7f07680014d0 con 0x7f077815ed10 2019-11-28T11:58:27.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.436+0000 7f077cdf2700 1 -- 172.21.15.80:0/3127832872 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0760002e80 con 0x7f077815ed10 2019-11-28T11:58:27.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.437+0000 7f077d5f3700 1 -- 172.21.15.80:0/3127832872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f077806c2f0 msgr2=0x7f077806c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:27.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.437+0000 7f077d5f3700 1 --2- 172.21.15.80:0/3127832872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f077806c2f0 0x7f077806c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:27.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.437+0000 7f077d5f3700 1 -- 172.21.15.80:0/3127832872 >> v1:172.21.15.80:6789/0 conn(0x7f077815ed10 legacy=0x7f0778073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.437+0000 7f077d5f3700 1 -- 172.21.15.80:0/3127832872 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0778070760 con 0x7f077815f100 2019-11-28T11:58:27.439 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.437+0000 7f077e5f5700 1 --2- 172.21.15.80:0/3127832872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f077806c2f0 0x7f077806c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:27.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.437+0000 7f077d5f3700 1 --2- 172.21.15.80:0/3127832872 >> v2:172.21.15.174:3300/0 conn(0x7f077815f100 0x7f077806bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f076c00af50 tx=0x7f076c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.437+0000 7f077d5f3700 1 --2- 172.21.15.80:0/3127832872 >> v2:172.21.15.174:3300/0 conn(0x7f077815f100 0x7f077806bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f076c00af50 tx=0x7f076c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.437+0000 7f077d5f3700 1 --2- 172.21.15.80:0/3127832872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f077815f100 0x7f077806bdb0 secure :-1 s=READY pgs=1744 cs=0 l=1 rx=0x7f076c00af50 tx=0x7f076c00b760).ready entity=mon.1 client_cookie=31eadaa29bc510f9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:27.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.437+0000 7f077d5f3700 1 --2- 172.21.15.80:0/3127832872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f077815f100 0x7f077806bdb0 secure :-1 s=THROTTLE_DONE pgs=1744 cs=0 l=1 rx=0x7f076c00af50 tx=0x7f076c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.437+0000 7f077cdf2700 1 -- 172.21.15.80:0/3127832872 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f076c007210 con 0x7f077815f100 2019-11-28T11:58:27.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.437+0000 7f077d5f3700 1 --2- 172.21.15.80:0/3127832872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f077815f100 0x7f077806bdb0 secure :-1 s=THROTTLE_DONE pgs=1744 cs=0 l=1 rx=0x7f076c00af50 tx=0x7f076c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.437+0000 7f077d5f3700 1 --2- 172.21.15.80:0/3127832872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f077815f100 0x7f077806bdb0 secure :-1 s=THROTTLE_DONE pgs=1744 cs=0 l=1 rx=0x7f076c00af50 tx=0x7f076c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.437+0000 7f077cdf2700 1 -- 172.21.15.80:0/3127832872 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c0099b0 con 0x7f077815f100 2019-11-28T11:58:27.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.437+0000 7f077cdf2700 1 -- 172.21.15.80:0/3127832872 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f076c00a080 con 0x7f077815f100 2019-11-28T11:58:27.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.437+0000 7f077f857700 1 -- 172.21.15.80:0/3127832872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f077815f100 msgr2=0x7f077806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.437+0000 7f077f857700 1 --2- 172.21.15.80:0/3127832872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f077815f100 0x7f077806bdb0 secure :-1 s=READY pgs=1744 cs=0 l=1 rx=0x7f076c00af50 tx=0x7f076c00b760).stop 2019-11-28T11:58:27.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.438+0000 7f077f857700 1 -- 172.21.15.80:0/3127832872 shutdown_connections 2019-11-28T11:58:27.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.438+0000 7f077f857700 1 --2- 172.21.15.80:0/3127832872 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f077806c2f0 0x7f077806c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:27.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.438+0000 7f077f857700 1 --2- 172.21.15.80:0/3127832872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f077815f100 0x7f077806bdb0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.438+0000 7f077f857700 1 -- 172.21.15.80:0/3127832872 shutdown_connections 2019-11-28T11:58:27.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.438+0000 7f077f857700 1 -- 172.21.15.80:0/3127832872 wait complete. 2019-11-28T11:58:27.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.438+0000 7f077f857700 1 -- 172.21.15.80:0/3127832872 >> 172.21.15.80:0/3127832872 conn(0x7f0778061d40 msgr2=0x7f07780641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:27.445 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.440+0000 7f077f857700 1 Processor -- start 2019-11-28T11:58:27.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.440+0000 7f077f857700 1 -- start start 2019-11-28T11:58:27.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.441+0000 7f077f857700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0778114f60 0x7f0778106b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:27.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.441+0000 7f077f857700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07781070d0 0x7f077812e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:27.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.441+0000 7f077f857700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f077812e6e0 0x7f0778152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:27.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.441+0000 7f077f857700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077810a4b0 con 0x7f07781070d0 2019-11-28T11:58:27.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.441+0000 7f077f857700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0778148130 con 0x7f077812e6e0 2019-11-28T11:58:27.446 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.441+0000 7f077f857700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0778104390 con 0x7f0778114f60 2019-11-28T11:58:27.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.441+0000 7f077d5f3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07781070d0 0x7f077812e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.441+0000 7f077d5f3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07781070d0 0x7f077812e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47040/0 (socket says 172.21.15.80:47040) 2019-11-28T11:58:27.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.441+0000 7f077d5f3700 1 -- 172.21.15.80:0/2093653857 learned_addr learned my addr 172.21.15.80:0/2093653857 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:27.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.441+0000 7f077e5f5700 1 --2- 172.21.15.80:0/2093653857 >> v2:172.21.15.174:3300/0 conn(0x7f077812e6e0 0x7f0778152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.441+0000 7f077ddf4700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0778114f60 0x7f0778106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f077d5f3700 1 -- 172.21.15.80:0/2093653857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0778114f60 msgr2=0x7f0778106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.447 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f077d5f3700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0778114f60 0x7f0778106b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f077d5f3700 1 -- 172.21.15.80:0/2093653857 >> v2:172.21.15.174:3300/0 conn(0x7f077812e6e0 msgr2=0x7f0778152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f077d5f3700 1 --2- 172.21.15.80:0/2093653857 >> v2:172.21.15.174:3300/0 conn(0x7f077812e6e0 0x7f0778152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f077d5f3700 1 -- 172.21.15.80:0/2093653857 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0778104710 con 0x7f07781070d0 2019-11-28T11:58:27.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f077d5f3700 1 --2- 172.21.15.80:0/2093653857 >> v2:172.21.15.80:3300/0 conn(0x7f07781070d0 0x7f077812e1a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f076c010470 tx=0x7f076c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.448 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f077d5f3700 1 --2- 172.21.15.80:0/2093653857 >> v2:172.21.15.80:3300/0 conn(0x7f07781070d0 0x7f077812e1a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f076c010470 tx=0x7f076c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f077d5f3700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07781070d0 0x7f077812e1a0 secure :-1 s=READY pgs=2886 cs=0 l=1 rx=0x7f076c010470 tx=0x7f076c0102f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f077d5f3700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07781070d0 0x7f077812e1a0 secure :-1 s=THROTTLE_DONE pgs=2886 cs=0 l=1 rx=0x7f076c010470 tx=0x7f076c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f077d5f3700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07781070d0 0x7f077812e1a0 secure :-1 s=THROTTLE_DONE pgs=2886 cs=0 l=1 rx=0x7f076c010470 tx=0x7f076c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f07767fc700 1 -- 172.21.15.80:0/2093653857 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f076c000940 con 0x7f07781070d0 2019-11-28T11:58:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f077d5f3700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07781070d0 0x7f077812e1a0 secure :-1 s=THROTTLE_DONE pgs=2886 cs=0 l=1 rx=0x7f076c010470 tx=0x7f076c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f07767fc700 1 -- 172.21.15.80:0/2093653857 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c00b380 con 0x7f07781070d0 2019-11-28T11:58:27.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f077f857700 1 -- 172.21.15.80:0/2093653857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0778104710 con 0x7f07781070d0 2019-11-28T11:58:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f07767fc700 1 -- 172.21.15.80:0/2093653857 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f076c009d60 con 0x7f07781070d0 2019-11-28T11:58:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f077f857700 1 -- 172.21.15.80:0/2093653857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0778104710 con 0x7f07781070d0 2019-11-28T11:58:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.442+0000 7f077d5f3700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07781070d0 0x7f077812e1a0 secure :-1 s=THROTTLE_DONE pgs=2886 cs=0 l=1 rx=0x7f076c010470 tx=0x7f076c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.443+0000 7f07767fc700 1 -- 172.21.15.80:0/2093653857 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f076c009790 con 0x7f07781070d0 2019-11-28T11:58:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.443+0000 7f077d5f3700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07781070d0 0x7f077812e1a0 secure :-1 s=THROTTLE_DONE pgs=2886 cs=0 l=1 rx=0x7f076c010470 tx=0x7f076c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.443+0000 7f07767fc700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0758018730 0x7f075801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:27.451 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.443+0000 7f07767fc700 1 -- 172.21.15.80:0/2093653857 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f076c031cf0 con 0x7f07781070d0 2019-11-28T11:58:27.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.443+0000 7f077ddf4700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0758018730 0x7f075801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.452 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.443+0000 7f077ddf4700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0758018730 0x7f075801abe0 crc :-1 s=READY pgs=1192 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.450+0000 7f077f857700 1 -- 172.21.15.80:0/2093653857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0778104710 con 0x7f07781070d0 2019-11-28T11:58:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.454+0000 7f077d5f3700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07781070d0 0x7f077812e1a0 secure :-1 s=THROTTLE_DONE pgs=2886 cs=0 l=1 rx=0x7f076c010470 tx=0x7f076c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.453 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.454+0000 7f07767fc700 1 -- 172.21.15.80:0/2093653857 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f076c009580 con 0x7f07781070d0 2019-11-28T11:58:27.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.623+0000 7f077f857700 1 -- 172.21.15.80:0/2093653857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0778104710 con 0x7f07781070d0 2019-11-28T11:58:27.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.628+0000 7f077d5f3700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07781070d0 0x7f077812e1a0 secure :-1 s=THROTTLE_DONE pgs=2886 cs=0 l=1 rx=0x7f076c010470 tx=0x7f076c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.624 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.628+0000 7f07767fc700 1 -- 172.21.15.80:0/2093653857 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v78) v1 ==== 184+0+0 (secure 0 0 0) 0x7f076c017780 con 0x7f07781070d0 2019-11-28T11:58:27.626 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T11:58:27.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.633+0000 7f077f857700 1 -- 172.21.15.80:0/2093653857 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0758018730 msgr2=0x7f075801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.629 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.633+0000 7f077f857700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0758018730 0x7f075801abe0 crc :-1 s=READY pgs=1192 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.633+0000 7f077f857700 1 -- 172.21.15.80:0/2093653857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07781070d0 msgr2=0x7f077812e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.633+0000 7f077f857700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07781070d0 0x7f077812e1a0 secure :-1 s=READY pgs=2886 cs=0 l=1 rx=0x7f076c010470 tx=0x7f076c0102f0).stop 2019-11-28T11:58:27.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.633+0000 7f077f857700 1 -- 172.21.15.80:0/2093653857 shutdown_connections 2019-11-28T11:58:27.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.633+0000 7f077f857700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0758018730 0x7f075801abe0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.633+0000 7f077f857700 1 --2- 172.21.15.80:0/2093653857 >> v2:172.21.15.174:3300/0 conn(0x7f077812e6e0 0x7f0778152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.630 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.633+0000 7f077f857700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07781070d0 0x7f077812e1a0 unknown :-1 s=CLOSED pgs=2886 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.633+0000 7f077f857700 1 --2- 172.21.15.80:0/2093653857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0778114f60 0x7f0778106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.633+0000 7f077f857700 1 -- 172.21.15.80:0/2093653857 shutdown_connections 2019-11-28T11:58:27.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.633+0000 7f077f857700 1 -- 172.21.15.80:0/2093653857 wait complete. 2019-11-28T11:58:27.631 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.633+0000 7f077f857700 1 -- 172.21.15.80:0/2093653857 >> 172.21.15.80:0/2093653857 conn(0x7f07781476e0 msgr2=0x7f077812fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:27.638 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T11:58:27.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.774+0000 7f8064ea7700 1 Processor -- start 2019-11-28T11:58:27.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.774+0000 7f8064ea7700 1 -- start start 2019-11-28T11:58:27.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.775+0000 7f8064ea7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f806015ed10 0x7f806015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:27.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.775+0000 7f8064ea7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8060073020 0x7f8060071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:27.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.775+0000 7f8064ea7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f80600734b0 0x7f80600723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:27.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.775+0000 7f8064ea7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806006f3d0 con 0x7f8060073020 2019-11-28T11:58:27.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.775+0000 7f8064ea7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806006fe00 con 0x7f80600734b0 2019-11-28T11:58:27.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.775+0000 7f8064ea7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8060070760 con 0x7f806015ed10 2019-11-28T11:58:27.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8060073020 0x7f8060071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8060073020 0x7f8060071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47050/0 (socket says 172.21.15.80:47050) 2019-11-28T11:58:27.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805e59c700 1 -- 172.21.15.80:0/1447025729 learned_addr learned my addr 172.21.15.80:0/1447025729 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:27.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805f59e700 1 --2- 172.21.15.80:0/1447025729 >> v2:172.21.15.174:3300/0 conn(0x7f80600734b0 0x7f80600723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805ed9d700 1 --2- 172.21.15.80:0/1447025729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f806015ed10 0x7f806015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805e59c700 1 -- 172.21.15.80:0/1447025729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f806015ed10 msgr2=0x7f806015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:27.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805e59c700 1 --2- 172.21.15.80:0/1447025729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f806015ed10 0x7f806015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:27.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805e59c700 1 -- 172.21.15.80:0/1447025729 >> v2:172.21.15.174:3300/0 conn(0x7f80600734b0 msgr2=0x7f80600723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:27.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805e59c700 1 --2- 172.21.15.80:0/1447025729 >> v2:172.21.15.174:3300/0 conn(0x7f80600734b0 0x7f80600723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:27.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805e59c700 1 -- 172.21.15.80:0/1447025729 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8060070ae0 con 0x7f8060073020 2019-11-28T11:58:27.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805ed9d700 1 --2- 172.21.15.80:0/1447025729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f806015ed10 0x7f806015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:58:27.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805e59c700 1 --2- 172.21.15.80:0/1447025729 >> v2:172.21.15.80:3300/0 conn(0x7f8060073020 0x7f8060071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f804800fac0 tx=0x7f804800f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805e59c700 1 --2- 172.21.15.80:0/1447025729 >> v2:172.21.15.80:3300/0 conn(0x7f8060073020 0x7f8060071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f804800fac0 tx=0x7f804800f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805e59c700 1 --2- 172.21.15.80:0/1447025729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8060073020 0x7f8060071ea0 secure :-1 s=READY pgs=2887 cs=0 l=1 rx=0x7f804800fac0 tx=0x7f804800f970).ready entity=mon.0 client_cookie=bc818031c20b7301 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:27.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805e59c700 1 --2- 172.21.15.80:0/1447025729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8060073020 0x7f8060071ea0 secure :-1 s=THROTTLE_DONE pgs=2887 cs=0 l=1 rx=0x7f804800fac0 tx=0x7f804800f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805e59c700 1 --2- 172.21.15.80:0/1447025729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8060073020 0x7f8060071ea0 secure :-1 s=THROTTLE_DONE pgs=2887 cs=0 l=1 rx=0x7f804800fac0 tx=0x7f804800f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805dd9b700 1 -- 172.21.15.80:0/1447025729 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8048000ce0 con 0x7f8060073020 2019-11-28T11:58:27.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805e59c700 1 --2- 172.21.15.80:0/1447025729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8060073020 0x7f8060071ea0 secure :-1 s=THROTTLE_DONE pgs=2887 cs=0 l=1 rx=0x7f804800fac0 tx=0x7f804800f970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805dd9b700 1 -- 172.21.15.80:0/1447025729 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8048001010 con 0x7f8060073020 2019-11-28T11:58:27.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f805dd9b700 1 -- 172.21.15.80:0/1447025729 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8048001720 con 0x7f8060073020 2019-11-28T11:58:27.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f8064ea7700 1 -- 172.21.15.80:0/1447025729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8060073020 msgr2=0x7f8060071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.776+0000 7f8064ea7700 1 --2- 172.21.15.80:0/1447025729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8060073020 0x7f8060071ea0 secure :-1 s=READY pgs=2887 cs=0 l=1 rx=0x7f804800fac0 tx=0x7f804800f970).stop 2019-11-28T11:58:27.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.777+0000 7f8064ea7700 1 -- 172.21.15.80:0/1447025729 shutdown_connections 2019-11-28T11:58:27.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.777+0000 7f8064ea7700 1 --2- 172.21.15.80:0/1447025729 >> v2:172.21.15.174:3300/0 conn(0x7f80600734b0 0x7f80600723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:27.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.777+0000 7f8064ea7700 1 --2- 172.21.15.80:0/1447025729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8060073020 0x7f8060071ea0 unknown :-1 s=CLOSED pgs=2887 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.777+0000 7f8064ea7700 1 --2- 172.21.15.80:0/1447025729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f806015ed10 0x7f806015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:27.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.777+0000 7f8064ea7700 1 -- 172.21.15.80:0/1447025729 shutdown_connections 2019-11-28T11:58:27.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.777+0000 7f8064ea7700 1 -- 172.21.15.80:0/1447025729 wait complete. 2019-11-28T11:58:27.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.777+0000 7f8064ea7700 1 -- 172.21.15.80:0/1447025729 >> 172.21.15.80:0/1447025729 conn(0x7f8060061d40 msgr2=0x7f80600641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:27.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.780+0000 7f8064ea7700 1 Processor -- start 2019-11-28T11:58:27.784 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.780+0000 7f8064ea7700 1 -- start start 2019-11-28T11:58:27.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.780+0000 7f8064ea7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8060114f60 0x7f8060106b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:27.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.780+0000 7f8064ea7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80601070d0 0x7f806012e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:27.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.780+0000 7f8064ea7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f806012e6e0 0x7f8060152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:27.788 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.780+0000 7f8064ea7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806010a4b0 con 0x7f80601070d0 2019-11-28T11:58:27.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.780+0000 7f8064ea7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8060148130 con 0x7f806012e6e0 2019-11-28T11:58:27.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.780+0000 7f8064ea7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8060104390 con 0x7f8060114f60 2019-11-28T11:58:27.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f805e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80601070d0 0x7f806012e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f805e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80601070d0 0x7f806012e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47052/0 (socket says 172.21.15.80:47052) 2019-11-28T11:58:27.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f805e59c700 1 -- 172.21.15.80:0/3595611742 learned_addr learned my addr 172.21.15.80:0/3595611742 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:27.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f805f59e700 1 --2- 172.21.15.80:0/3595611742 >> v2:172.21.15.174:3300/0 conn(0x7f806012e6e0 0x7f8060152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.789 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f805ed9d700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8060114f60 0x7f8060106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f805e59c700 1 -- 172.21.15.80:0/3595611742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8060114f60 msgr2=0x7f8060106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f805e59c700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8060114f60 0x7f8060106b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f805e59c700 1 -- 172.21.15.80:0/3595611742 >> v2:172.21.15.174:3300/0 conn(0x7f806012e6e0 msgr2=0x7f8060152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f805e59c700 1 --2- 172.21.15.80:0/3595611742 >> v2:172.21.15.174:3300/0 conn(0x7f806012e6e0 0x7f8060152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.790 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f805e59c700 1 -- 172.21.15.80:0/3595611742 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8060104710 con 0x7f80601070d0 2019-11-28T11:58:27.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f805e59c700 1 --2- 172.21.15.80:0/3595611742 >> v2:172.21.15.80:3300/0 conn(0x7f80601070d0 0x7f806012e1a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80480107d0 tx=0x7f8048010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f805e59c700 1 --2- 172.21.15.80:0/3595611742 >> v2:172.21.15.80:3300/0 conn(0x7f80601070d0 0x7f806012e1a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80480107d0 tx=0x7f8048010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f805e59c700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80601070d0 0x7f806012e1a0 secure :-1 s=READY pgs=2888 cs=0 l=1 rx=0x7f80480107d0 tx=0x7f8048010650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:27.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f805e59c700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80601070d0 0x7f806012e1a0 secure :-1 s=THROTTLE_DONE pgs=2888 cs=0 l=1 rx=0x7f80480107d0 tx=0x7f8048010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.791 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f805e59c700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80601070d0 0x7f806012e1a0 secure :-1 s=THROTTLE_DONE pgs=2888 cs=0 l=1 rx=0x7f80480107d0 tx=0x7f8048010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f80577fe700 1 -- 172.21.15.80:0/3595611742 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80480013d0 con 0x7f80601070d0 2019-11-28T11:58:27.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f805e59c700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80601070d0 0x7f806012e1a0 secure :-1 s=THROTTLE_DONE pgs=2888 cs=0 l=1 rx=0x7f80480107d0 tx=0x7f8048010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f80577fe700 1 -- 172.21.15.80:0/3595611742 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8048007de0 con 0x7f80601070d0 2019-11-28T11:58:27.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f8064ea7700 1 -- 172.21.15.80:0/3595611742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8060104710 con 0x7f80601070d0 2019-11-28T11:58:27.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f80577fe700 1 -- 172.21.15.80:0/3595611742 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80480019b0 con 0x7f80601070d0 2019-11-28T11:58:27.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.781+0000 7f8064ea7700 1 -- 172.21.15.80:0/3595611742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8060104710 con 0x7f80601070d0 2019-11-28T11:58:27.792 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.782+0000 7f805e59c700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80601070d0 0x7f806012e1a0 secure :-1 s=THROTTLE_DONE pgs=2888 cs=0 l=1 rx=0x7f80480107d0 tx=0x7f8048010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.782+0000 7f80577fe700 1 -- 172.21.15.80:0/3595611742 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8048007de0 con 0x7f80601070d0 2019-11-28T11:58:27.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.782+0000 7f805e59c700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80601070d0 0x7f806012e1a0 secure :-1 s=THROTTLE_DONE pgs=2888 cs=0 l=1 rx=0x7f80480107d0 tx=0x7f8048010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.782+0000 7f80577fe700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8038018730 0x7f803801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:27.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.782+0000 7f80577fe700 1 -- 172.21.15.80:0/3595611742 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8048031e00 con 0x7f80601070d0 2019-11-28T11:58:27.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.782+0000 7f805ed9d700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8038018730 0x7f803801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:27.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.783+0000 7f805ed9d700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8038018730 0x7f803801abc0 crc :-1 s=READY pgs=1193 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:27.793 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.790+0000 7f8064ea7700 1 -- 172.21.15.80:0/3595611742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8060104710 con 0x7f80601070d0 2019-11-28T11:58:27.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.793+0000 7f805e59c700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80601070d0 0x7f806012e1a0 secure :-1 s=THROTTLE_DONE pgs=2888 cs=0 l=1 rx=0x7f80480107d0 tx=0x7f8048010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.793+0000 7f80577fe700 1 -- 172.21.15.80:0/3595611742 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8048017600 con 0x7f80601070d0 2019-11-28T11:58:27.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.963+0000 7f8064ea7700 1 -- 172.21.15.80:0/3595611742 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8060104710 con 0x7f80601070d0 2019-11-28T11:58:27.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.965+0000 7f805e59c700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80601070d0 0x7f806012e1a0 secure :-1 s=THROTTLE_DONE pgs=2888 cs=0 l=1 rx=0x7f80480107d0 tx=0x7f8048010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:27.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.965+0000 7f80577fe700 1 -- 172.21.15.80:0/3595611742 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v79) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8048017810 con 0x7f80601070d0 2019-11-28T11:58:27.962 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T11:58:27.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.968+0000 7f8064ea7700 1 -- 172.21.15.80:0/3595611742 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8038018730 msgr2=0x7f803801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.968+0000 7f8064ea7700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8038018730 0x7f803801abc0 crc :-1 s=READY pgs=1193 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.968+0000 7f8064ea7700 1 -- 172.21.15.80:0/3595611742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80601070d0 msgr2=0x7f806012e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.968+0000 7f8064ea7700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80601070d0 0x7f806012e1a0 secure :-1 s=READY pgs=2888 cs=0 l=1 rx=0x7f80480107d0 tx=0x7f8048010650).stop 2019-11-28T11:58:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.968+0000 7f8064ea7700 1 -- 172.21.15.80:0/3595611742 shutdown_connections 2019-11-28T11:58:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.968+0000 7f8064ea7700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8038018730 0x7f803801abc0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.968+0000 7f8064ea7700 1 --2- 172.21.15.80:0/3595611742 >> v2:172.21.15.174:3300/0 conn(0x7f806012e6e0 0x7f8060152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.968+0000 7f8064ea7700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80601070d0 0x7f806012e1a0 unknown :-1 s=CLOSED pgs=2888 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.968+0000 7f8064ea7700 1 --2- 172.21.15.80:0/3595611742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8060114f60 0x7f8060106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:27.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.968+0000 7f8064ea7700 1 -- 172.21.15.80:0/3595611742 shutdown_connections 2019-11-28T11:58:27.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.968+0000 7f8064ea7700 1 -- 172.21.15.80:0/3595611742 wait complete. 2019-11-28T11:58:27.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:27.968+0000 7f8064ea7700 1 -- 172.21.15.80:0/3595611742 >> 172.21.15.80:0/3595611742 conn(0x7f80601476e0 msgr2=0x7f806012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:27.974 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:58:28.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.097+0000 7ff5eeacf700 1 Processor -- start 2019-11-28T11:58:28.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.097+0000 7ff5eeacf700 1 -- start start 2019-11-28T11:58:28.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5eeacf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5e806c0a0 0x7ff5e8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:28.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5eeacf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5e8072620 0x7ff5e8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5eeacf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e806db00 con 0x7ff5e80734e0 2019-11-28T11:58:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5eeacf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e806fd60 con 0x7ff5e806c0a0 2019-11-28T11:58:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5eeacf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8070030 con 0x7ff5e8072620 2019-11-28T11:58:28.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5ed06c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5e806c0a0 0x7ff5e8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:28.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5ed06c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff5e806c0a0 0x7ff5e8072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47060/0 (socket says 172.21.15.80:47060) 2019-11-28T11:58:28.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5ed06c700 1 -- 172.21.15.80:0/1547981243 learned_addr learned my addr 172.21.15.80:0/1547981243 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:28.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5ed86d700 1 --2- 172.21.15.80:0/1547981243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5e8072620 0x7ff5e8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:28.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5ed06c700 1 -- 172.21.15.80:0/1547981243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5e8072620 msgr2=0x7ff5e8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5ed06c700 1 --2- 172.21.15.80:0/1547981243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5e8072620 0x7ff5e8164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5ed06c700 1 -- 172.21.15.80:0/1547981243 >> v1:172.21.15.174:6789/0 conn(0x7ff5e80734e0 legacy=0x7ff5e8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:28.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5ed06c700 1 -- 172.21.15.80:0/1547981243 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e80706c0 con 0x7ff5e806c0a0 2019-11-28T11:58:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5ed06c700 1 --2- 172.21.15.80:0/1547981243 >> v2:172.21.15.80:3300/0 conn(0x7ff5e806c0a0 0x7ff5e8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff5d800fac0 tx=0x7ff5d800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5ed06c700 1 --2- 172.21.15.80:0/1547981243 >> v2:172.21.15.80:3300/0 conn(0x7ff5e806c0a0 0x7ff5e8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff5d800fac0 tx=0x7ff5d800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:28.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5ed06c700 1 --2- 172.21.15.80:0/1547981243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e806c0a0 0x7ff5e8072fa0 secure :-1 s=READY pgs=2889 cs=0 l=1 rx=0x7ff5d800fac0 tx=0x7ff5d800f8f0).ready entity=mon.0 client_cookie=ae1f5f42e2d3922a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:28.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5ed06c700 1 --2- 172.21.15.80:0/1547981243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e806c0a0 0x7ff5e8072fa0 secure :-1 s=THROTTLE_DONE pgs=2889 cs=0 l=1 rx=0x7ff5d800fac0 tx=0x7ff5d800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:28.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.099+0000 7ff5ed06c700 1 --2- 172.21.15.80:0/1547981243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e806c0a0 0x7ff5e8072fa0 secure :-1 s=THROTTLE_DONE pgs=2889 cs=0 l=1 rx=0x7ff5d800fac0 tx=0x7ff5d800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:28.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.098+0000 7ff5e7fff700 1 -- 172.21.15.80:0/1547981243 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5d8000ce0 con 0x7ff5e806c0a0 2019-11-28T11:58:28.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.099+0000 7ff5ed06c700 1 --2- 172.21.15.80:0/1547981243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e806c0a0 0x7ff5e8072fa0 secure :-1 s=THROTTLE_DONE pgs=2889 cs=0 l=1 rx=0x7ff5d800fac0 tx=0x7ff5d800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:28.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.099+0000 7ff5e7fff700 1 -- 172.21.15.80:0/1547981243 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d8001010 con 0x7ff5e806c0a0 2019-11-28T11:58:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.099+0000 7ff5e7fff700 1 -- 172.21.15.80:0/1547981243 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5d8001720 con 0x7ff5e806c0a0 2019-11-28T11:58:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.099+0000 7ff5eeacf700 1 -- 172.21.15.80:0/1547981243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e806c0a0 msgr2=0x7ff5e8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.099+0000 7ff5eeacf700 1 --2- 172.21.15.80:0/1547981243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e806c0a0 0x7ff5e8072fa0 secure :-1 s=READY pgs=2889 cs=0 l=1 rx=0x7ff5d800fac0 tx=0x7ff5d800f8f0).stop 2019-11-28T11:58:28.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.099+0000 7ff5eeacf700 1 -- 172.21.15.80:0/1547981243 shutdown_connections 2019-11-28T11:58:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.099+0000 7ff5eeacf700 1 --2- 172.21.15.80:0/1547981243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5e8072620 0x7ff5e8164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.099+0000 7ff5eeacf700 1 --2- 172.21.15.80:0/1547981243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5e806c0a0 0x7ff5e8072fa0 unknown :-1 s=CLOSED pgs=2889 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.099+0000 7ff5eeacf700 1 -- 172.21.15.80:0/1547981243 shutdown_connections 2019-11-28T11:58:28.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.099+0000 7ff5eeacf700 1 -- 172.21.15.80:0/1547981243 wait complete. 2019-11-28T11:58:28.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.099+0000 7ff5eeacf700 1 -- 172.21.15.80:0/1547981243 >> 172.21.15.80:0/1547981243 conn(0x7ff5e8061cf0 msgr2=0x7ff5e8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:28.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.102+0000 7ff5eeacf700 1 Processor -- start 2019-11-28T11:58:28.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.102+0000 7ff5eeacf700 1 -- start start 2019-11-28T11:58:28.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5eeacf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff5e8159970 0x7ff5e8158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:28.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5eeacf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e8112260 con 0x7ff5e815d7c0 2019-11-28T11:58:28.124 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5eeacf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e813f740 con 0x7ff5e8159e00 2019-11-28T11:58:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5eeacf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e8140ff0 con 0x7ff5e8159970 2019-11-28T11:58:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5ed06c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff5e815d7c0 0x7ff5e812e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46382/0 (socket says 172.21.15.80:46382) 2019-11-28T11:58:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5ed06c700 1 -- 172.21.15.80:0/2771131194 learned_addr learned my addr 172.21.15.80:0/2771131194 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5ec86b700 1 --2- 172.21.15.80:0/2771131194 >> v2:172.21.15.174:3300/0 conn(0x7ff5e8159970 0x7ff5e8158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920336850 0 0) 0x7ff5d8007d20 con 0x7ff5e815d7c0 2019-11-28T11:58:28.125 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5c8002e80 con 0x7ff5e815d7c0 2019-11-28T11:58:28.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1794669938 0 0) 0x7ff5d80080d0 con 0x7ff5e815d7c0 2019-11-28T11:58:28.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff5c80032e0 con 0x7ff5e815d7c0 2019-11-28T11:58:28.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff5d8000eb0 con 0x7ff5e815d7c0 2019-11-28T11:58:28.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 >> v2:172.21.15.174:3300/0 conn(0x7ff5e8159970 msgr2=0x7ff5e8158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:28.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5e5ffb700 1 --2- 172.21.15.80:0/2771131194 >> v2:172.21.15.174:3300/0 conn(0x7ff5e8159970 0x7ff5e8158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:28.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 >> v1:172.21.15.174:6789/0 conn(0x7ff5e8159e00 legacy=0x7ff5e8158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:28.126 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 >> v1:172.21.15.80:6789/0 conn(0x7ff5e815d7c0 legacy=0x7ff5e812e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:28.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5e5ffb700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5c80033b0 0x7ff5c80037c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:28.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5e5ffb700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5c8003d00 0x7ff5c80041a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:28.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5e5ffb700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c8004930 0x7ff5c8004df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:28.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c800bbf0 con 0x7ff5c8004930 2019-11-28T11:58:28.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c800be20 con 0x7ff5c80033b0 2019-11-28T11:58:28.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.103+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c800c050 con 0x7ff5c8003d00 2019-11-28T11:58:28.127 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5ed86d700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c8004930 0x7ff5c8004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5ed06c700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5c80033b0 0x7ff5c80037c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5ec86b700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5c8003d00 0x7ff5c80041a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5ed86d700 1 -- 172.21.15.80:0/2771131194 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5c8003d00 msgr2=0x7ff5c80041a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5ed86d700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5c8003d00 0x7ff5c80041a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5ed86d700 1 -- 172.21.15.80:0/2771131194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5c80033b0 msgr2=0x7ff5c80037c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:28.128 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5ed86d700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5c80033b0 0x7ff5c80037c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:28.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5ed86d700 1 -- 172.21.15.80:0/2771131194 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c800c300 con 0x7ff5c8004930 2019-11-28T11:58:28.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5eeacf700 1 -- 172.21.15.80:0/2771131194 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e8141cd0 con 0x7ff5c8004930 2019-11-28T11:58:28.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5ed86d700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c8004930 0x7ff5c8004df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5e0010340 tx=0x7ff5e00101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:28.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5eeacf700 1 -- 172.21.15.80:0/2771131194 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e8141950 con 0x7ff5c8004930 2019-11-28T11:58:28.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5ed86d700 1 -- 172.21.15.80:0/2771131194 reap_dead start 2019-11-28T11:58:28.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5ed86d700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c8004930 0x7ff5c8004df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5e0010340 tx=0x7ff5e00101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:28.129 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5ed86d700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c8004930 0x7ff5c8004df0 secure :-1 s=READY pgs=2891 cs=0 l=1 rx=0x7ff5e0010340 tx=0x7ff5e00101c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:28.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5ed86d700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c8004930 0x7ff5c8004df0 secure :-1 s=THROTTLE_DONE pgs=2891 cs=0 l=1 rx=0x7ff5e0010340 tx=0x7ff5e00101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:28.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5e0000a90 con 0x7ff5c8004930 2019-11-28T11:58:28.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5ed86d700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c8004930 0x7ff5c8004df0 secure :-1 s=THROTTLE_DONE pgs=2891 cs=0 l=1 rx=0x7ff5e0010340 tx=0x7ff5e00101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:28.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5ed86d700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c8004930 0x7ff5c8004df0 secure :-1 s=THROTTLE_DONE pgs=2891 cs=0 l=1 rx=0x7ff5e0010340 tx=0x7ff5e00101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:28.130 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e0001360 con 0x7ff5c8004930 2019-11-28T11:58:28.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5e0001ab0 con 0x7ff5c8004930 2019-11-28T11:58:28.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.104+0000 7ff5ed86d700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c8004930 0x7ff5c8004df0 secure :-1 s=THROTTLE_DONE pgs=2891 cs=0 l=1 rx=0x7ff5e0010340 tx=0x7ff5e00101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:28.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.105+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff5e0000a70 con 0x7ff5c8004930 2019-11-28T11:58:28.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.105+0000 7ff5ed86d700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c8004930 0x7ff5c8004df0 secure :-1 s=THROTTLE_DONE pgs=2891 cs=0 l=1 rx=0x7ff5e0010340 tx=0x7ff5e00101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:28.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.105+0000 7ff5e5ffb700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5c801b470 0x7ff5c801d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:28.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.105+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff5e0031910 con 0x7ff5c8004930 2019-11-28T11:58:28.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.105+0000 7ff5ed06c700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5c801b470 0x7ff5c801d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:28.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.105+0000 7ff5ed06c700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5c801b470 0x7ff5c801d8a0 crc :-1 s=READY pgs=1194 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:28.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.112+0000 7ff5eeacf700 1 -- 172.21.15.80:0/2771131194 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c0002e60 con 0x7ff5c8004930 2019-11-28T11:58:28.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.115+0000 7ff5ed86d700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c8004930 0x7ff5c8004df0 secure :-1 s=THROTTLE_DONE pgs=2891 cs=0 l=1 rx=0x7ff5e0010340 tx=0x7ff5e00101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:28.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.115+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff5e0000a70 con 0x7ff5c8004930 2019-11-28T11:58:28.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.288+0000 7ff5eeacf700 1 -- 172.21.15.80:0/2771131194 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5c0001d10 con 0x7ff5c8004930 2019-11-28T11:58:28.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.288+0000 7ff5ed86d700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c8004930 0x7ff5c8004df0 secure :-1 s=THROTTLE_DONE pgs=2891 cs=0 l=1 rx=0x7ff5e0010340 tx=0x7ff5e00101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:28.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.288+0000 7ff5e5ffb700 1 -- 172.21.15.80:0/2771131194 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 183 v183) v1 ==== 95+0+1428 (secure 0 0 0) 0x7ff5e00057e0 con 0x7ff5c8004930 2019-11-28T11:58:28.285 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 183 2019-11-28T11:58:28.285 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:28.285 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":183,"default_fscid":18,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":183,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:58:24.286894+0000","modified":"2019-11-28T11:58:25.914617+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[37],"metadata_pool":36,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":18}]} 2019-11-28T11:58:28.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.291+0000 7ff5eeacf700 1 -- 172.21.15.80:0/2771131194 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5c801b470 msgr2=0x7ff5c801d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:28.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.291+0000 7ff5eeacf700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5c801b470 0x7ff5c801d8a0 crc :-1 s=READY pgs=1194 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:28.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.291+0000 7ff5eeacf700 1 -- 172.21.15.80:0/2771131194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c8004930 msgr2=0x7ff5c8004df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:28.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.291+0000 7ff5eeacf700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c8004930 0x7ff5c8004df0 secure :-1 s=READY pgs=2891 cs=0 l=1 rx=0x7ff5e0010340 tx=0x7ff5e00101c0).stop 2019-11-28T11:58:28.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.291+0000 7ff5eeacf700 1 -- 172.21.15.80:0/2771131194 shutdown_connections 2019-11-28T11:58:28.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.291+0000 7ff5eeacf700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff5c801b470 0x7ff5c801d8a0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:28.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.291+0000 7ff5eeacf700 1 --2- 172.21.15.80:0/2771131194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5c8004930 0x7ff5c8004df0 unknown :-1 s=CLOSED pgs=2891 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:28.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.291+0000 7ff5eeacf700 1 -- 172.21.15.80:0/2771131194 shutdown_connections 2019-11-28T11:58:28.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.291+0000 7ff5eeacf700 1 -- 172.21.15.80:0/2771131194 wait complete. 2019-11-28T11:58:28.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:28.291+0000 7ff5eeacf700 1 -- 172.21.15.80:0/2771131194 >> 172.21.15.80:0/2771131194 conn(0x7ff5e813b860 msgr2=0x7ff5e81050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:28.604 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 36, u'failed': [], u'epoch': 183, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [37], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:58:24.286894+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:58:25.914617+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:58:28.604 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:58:29.604 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:58:29.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.730+0000 7f2534dd4700 1 Processor -- start 2019-11-28T11:58:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.730+0000 7f2534dd4700 1 -- start start 2019-11-28T11:58:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.731+0000 7f2534dd4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253006c0a0 0x7f2530072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.731+0000 7f2534dd4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253006db00 con 0x7f2530072620 2019-11-28T11:58:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.731+0000 7f2534dd4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253006e000 con 0x7f25300734e0 2019-11-28T11:58:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.731+0000 7f2534dd4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253006f330 con 0x7f253006c0a0 2019-11-28T11:58:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.731+0000 7f252f59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2530072620 0x7f2530164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46398/0 (socket says 172.21.15.80:46398) 2019-11-28T11:58:29.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.731+0000 7f252f59e700 1 -- 172.21.15.80:0/3510161357 learned_addr learned my addr 172.21.15.80:0/3510161357 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:29.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.731+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3510161357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253006c0a0 0x7f2530072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:29.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.731+0000 7f252dd9b700 1 -- 172.21.15.80:0/3510161357 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210944923 0 0) 0x7f2528001150 con 0x7f2530072620 2019-11-28T11:58:29.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.731+0000 7f252dd9b700 1 -- 172.21.15.80:0/3510161357 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f251c002e80 con 0x7f2530072620 2019-11-28T11:58:29.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.731+0000 7f252dd9b700 1 -- 172.21.15.80:0/3510161357 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114203555 0 0) 0x7f2518001080 con 0x7f25300734e0 2019-11-28T11:58:29.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.731+0000 7f252dd9b700 1 -- 172.21.15.80:0/3510161357 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f251c0030b0 con 0x7f25300734e0 2019-11-28T11:58:29.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.732+0000 7f252dd9b700 1 -- 172.21.15.80:0/3510161357 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1062490364 0 0) 0x7f2528001130 con 0x7f2530072620 2019-11-28T11:58:29.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.732+0000 7f252ed9d700 1 -- 172.21.15.80:0/3510161357 >> v1:172.21.15.174:6789/0 conn(0x7f25300734e0 legacy=0x7f2530071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:29.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.732+0000 7f252ed9d700 1 -- 172.21.15.80:0/3510161357 >> v1:172.21.15.80:6789/0 conn(0x7f2530072620 legacy=0x7f2530164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:29.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.732+0000 7f252ed9d700 1 -- 172.21.15.80:0/3510161357 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25300706c0 con 0x7f253006c0a0 2019-11-28T11:58:29.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.732+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3510161357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253006c0a0 0x7f2530072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f252000b2d0 tx=0x7f252000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:29.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.732+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3510161357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253006c0a0 0x7f2530072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f252000b2d0 tx=0x7f252000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:29.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.732+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3510161357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253006c0a0 0x7f2530072fa0 secure :-1 s=READY pgs=420 cs=0 l=1 rx=0x7f252000b2d0 tx=0x7f252000bae0).ready entity=mon.2 client_cookie=cb2072e5522fc60a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:29.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.732+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3510161357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253006c0a0 0x7f2530072fa0 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f252000b2d0 tx=0x7f252000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:29.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.732+0000 7f252dd9b700 1 -- 172.21.15.80:0/3510161357 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2520000ce0 con 0x7f253006c0a0 2019-11-28T11:58:29.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.732+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3510161357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253006c0a0 0x7f2530072fa0 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f252000b2d0 tx=0x7f252000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:29.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.732+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3510161357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253006c0a0 0x7f2530072fa0 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f252000b2d0 tx=0x7f252000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:29.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.732+0000 7f252dd9b700 1 -- 172.21.15.80:0/3510161357 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2520009be0 con 0x7f253006c0a0 2019-11-28T11:58:29.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.732+0000 7f252dd9b700 1 -- 172.21.15.80:0/3510161357 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2520000ce0 con 0x7f253006c0a0 2019-11-28T11:58:29.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.732+0000 7f2534dd4700 1 -- 172.21.15.80:0/3510161357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253006c0a0 msgr2=0x7f2530072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:29.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.732+0000 7f2534dd4700 1 --2- 172.21.15.80:0/3510161357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253006c0a0 0x7f2530072fa0 secure :-1 s=READY pgs=420 cs=0 l=1 rx=0x7f252000b2d0 tx=0x7f252000bae0).stop 2019-11-28T11:58:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.733+0000 7f2534dd4700 1 -- 172.21.15.80:0/3510161357 shutdown_connections 2019-11-28T11:58:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.733+0000 7f2534dd4700 1 --2- 172.21.15.80:0/3510161357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f253006c0a0 0x7f2530072fa0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.733+0000 7f2534dd4700 1 -- 172.21.15.80:0/3510161357 shutdown_connections 2019-11-28T11:58:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.733+0000 7f2534dd4700 1 -- 172.21.15.80:0/3510161357 wait complete. 2019-11-28T11:58:29.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.733+0000 7f2534dd4700 1 -- 172.21.15.80:0/3510161357 >> 172.21.15.80:0/3510161357 conn(0x7f2530061cf0 msgr2=0x7f2530064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:29.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.735+0000 7f2534dd4700 1 Processor -- start 2019-11-28T11:58:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.735+0000 7f2534dd4700 1 -- start start 2019-11-28T11:58:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.736+0000 7f2534dd4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f253012a8e0 0x7f2530140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.736+0000 7f2534dd4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253015d4a0 con 0x7f253013ff20 2019-11-28T11:58:29.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.736+0000 7f2534dd4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253013f510 con 0x7f25301414f0 2019-11-28T11:58:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.736+0000 7f2534dd4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2530163ae0 con 0x7f253012a8e0 2019-11-28T11:58:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.736+0000 7f252f59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f253013ff20 0x7f25301403a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46406/0 (socket says 172.21.15.80:46406) 2019-11-28T11:58:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.736+0000 7f252f59e700 1 -- 172.21.15.80:0/3963662300 learned_addr learned my addr 172.21.15.80:0/3963662300 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:29.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.736+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3963662300 >> v2:172.21.15.174:3300/0 conn(0x7f253012a8e0 0x7f2530140fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:29.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.736+0000 7f25277fe700 1 -- 172.21.15.80:0/3963662300 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3624943576 0 0) 0x7f25280009b0 con 0x7f253013ff20 2019-11-28T11:58:29.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.736+0000 7f25277fe700 1 -- 172.21.15.80:0/3963662300 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2514002e80 con 0x7f253013ff20 2019-11-28T11:58:29.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.737+0000 7f25277fe700 1 -- 172.21.15.80:0/3963662300 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3019707218 0 0) 0x7f2528001300 con 0x7f253013ff20 2019-11-28T11:58:29.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.737+0000 7f252ed9d700 1 -- 172.21.15.80:0/3963662300 >> v1:172.21.15.174:6789/0 conn(0x7f25301414f0 legacy=0x7f253015c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:29.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.737+0000 7f252ed9d700 1 -- 172.21.15.80:0/3963662300 >> v1:172.21.15.80:6789/0 conn(0x7f253013ff20 legacy=0x7f25301403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:29.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.737+0000 7f252ed9d700 1 -- 172.21.15.80:0/3963662300 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2530164440 con 0x7f253012a8e0 2019-11-28T11:58:29.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.737+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3963662300 >> v2:172.21.15.174:3300/0 conn(0x7f253012a8e0 0x7f2530140fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2520010740 tx=0x7f2520010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.737+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3963662300 >> v2:172.21.15.174:3300/0 conn(0x7f253012a8e0 0x7f2530140fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2520010740 tx=0x7f2520010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.737+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f253012a8e0 0x7f2530140fb0 secure :-1 s=READY pgs=1749 cs=0 l=1 rx=0x7f2520010740 tx=0x7f2520010ae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.737+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f253012a8e0 0x7f2530140fb0 secure :-1 s=THROTTLE_DONE pgs=1749 cs=0 l=1 rx=0x7f2520010740 tx=0x7f2520010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.737+0000 7f25277fe700 1 -- 172.21.15.80:0/3963662300 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f252000af30 con 0x7f253012a8e0 2019-11-28T11:58:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.737+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f253012a8e0 0x7f2530140fb0 secure :-1 s=THROTTLE_DONE pgs=1749 cs=0 l=1 rx=0x7f2520010740 tx=0x7f2520010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:29.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.737+0000 7f25277fe700 1 -- 172.21.15.80:0/3963662300 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2520000cc0 con 0x7f253012a8e0 2019-11-28T11:58:29.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.737+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f253012a8e0 0x7f2530140fb0 secure :-1 s=THROTTLE_DONE pgs=1749 cs=0 l=1 rx=0x7f2520010740 tx=0x7f2520010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:29.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.737+0000 7f25277fe700 1 -- 172.21.15.80:0/3963662300 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f252000af30 con 0x7f253012a8e0 2019-11-28T11:58:29.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.737+0000 7f2534dd4700 1 -- 172.21.15.80:0/3963662300 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25301647c0 con 0x7f253012a8e0 2019-11-28T11:58:29.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.737+0000 7f2534dd4700 1 -- 172.21.15.80:0/3963662300 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2530163380 con 0x7f253012a8e0 2019-11-28T11:58:29.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.737+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f253012a8e0 0x7f2530140fb0 secure :-1 s=THROTTLE_DONE pgs=1749 cs=0 l=1 rx=0x7f2520010740 tx=0x7f2520010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:29.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.738+0000 7f25277fe700 1 -- 172.21.15.80:0/3963662300 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2520009b10 con 0x7f253012a8e0 2019-11-28T11:58:29.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.738+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f253012a8e0 0x7f2530140fb0 secure :-1 s=THROTTLE_DONE pgs=1749 cs=0 l=1 rx=0x7f2520010740 tx=0x7f2520010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:29.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.738+0000 7f25277fe700 1 --2- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2514018780 0x7f251401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:29.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.738+0000 7f25277fe700 1 -- 172.21.15.80:0/3963662300 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2520031e50 con 0x7f253012a8e0 2019-11-28T11:58:29.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.738+0000 7f252e59c700 1 --2- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2514018780 0x7f251401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:29.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.738+0000 7f252e59c700 1 --2- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2514018780 0x7f251401abf0 crc :-1 s=READY pgs=1195 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:29.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.745+0000 7f2534dd4700 1 -- 172.21.15.80:0/3963662300 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2530164440 con 0x7f253012a8e0 2019-11-28T11:58:29.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.750+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f253012a8e0 0x7f2530140fb0 secure :-1 s=THROTTLE_DONE pgs=1749 cs=0 l=1 rx=0x7f2520010740 tx=0x7f2520010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:29.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.750+0000 7f25277fe700 1 -- 172.21.15.80:0/3963662300 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2520009900 con 0x7f253012a8e0 2019-11-28T11:58:29.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.920+0000 7f2534dd4700 1 -- 172.21.15.80:0/3963662300 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25301647c0 con 0x7f253012a8e0 2019-11-28T11:58:29.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.921+0000 7f252ed9d700 1 --2- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f253012a8e0 0x7f2530140fb0 secure :-1 s=THROTTLE_DONE pgs=1749 cs=0 l=1 rx=0x7f2520010740 tx=0x7f2520010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:29.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.921+0000 7f25277fe700 1 -- 172.21.15.80:0/3963662300 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 183 v183) v1 ==== 95+0+1428 (secure 0 0 0) 0x7f2520009b10 con 0x7f253012a8e0 2019-11-28T11:58:29.917 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 183 2019-11-28T11:58:29.918 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:29.918 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":183,"default_fscid":18,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":183,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:58:24.286894+0000","modified":"2019-11-28T11:58:25.914617+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[37],"metadata_pool":36,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":18}]} 2019-11-28T11:58:29.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.923+0000 7f2534dd4700 1 -- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2514018780 msgr2=0x7f251401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:29.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.923+0000 7f2534dd4700 1 --2- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2514018780 0x7f251401abf0 crc :-1 s=READY pgs=1195 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:29.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.923+0000 7f2534dd4700 1 -- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f253012a8e0 msgr2=0x7f2530140fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:29.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.923+0000 7f2534dd4700 1 --2- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f253012a8e0 0x7f2530140fb0 secure :-1 s=READY pgs=1749 cs=0 l=1 rx=0x7f2520010740 tx=0x7f2520010ae0).stop 2019-11-28T11:58:29.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.923+0000 7f2534dd4700 1 -- 172.21.15.80:0/3963662300 shutdown_connections 2019-11-28T11:58:29.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.923+0000 7f2534dd4700 1 --2- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2514018780 0x7f251401abf0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:29.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.923+0000 7f2534dd4700 1 --2- 172.21.15.80:0/3963662300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f253012a8e0 0x7f2530140fb0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:29.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.923+0000 7f2534dd4700 1 -- 172.21.15.80:0/3963662300 shutdown_connections 2019-11-28T11:58:29.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.923+0000 7f2534dd4700 1 -- 172.21.15.80:0/3963662300 wait complete. 2019-11-28T11:58:29.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:29.923+0000 7f2534dd4700 1 -- 172.21.15.80:0/3963662300 >> 172.21.15.80:0/3963662300 conn(0x7f2530159ae0 msgr2=0x7f253013d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:30.231 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {}, u'last_failure_osd_epoch': 0, u'in': [], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 36, u'failed': [], u'epoch': 183, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [37], u'info': {}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:58:24.286894+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:58:25.914617+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:58:30.231 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2019-11-28T11:58:31.232 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:58:31.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.355+0000 7f0c3dd11700 1 Processor -- start 2019-11-28T11:58:31.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.355+0000 7f0c3dd11700 1 -- start start 2019-11-28T11:58:31.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.356+0000 7f0c3dd11700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c3806c490 0x7f0c3806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:31.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.356+0000 7f0c3dd11700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3806db00 con 0x7f0c3806ce60 2019-11-28T11:58:31.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.356+0000 7f0c3dd11700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3806e000 con 0x7f0c3806c0a0 2019-11-28T11:58:31.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.356+0000 7f0c3dd11700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3806fd60 con 0x7f0c3806c490 2019-11-28T11:58:31.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c3caaf700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0c3806ce60 0x7f0c38164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46424/0 (socket says 172.21.15.80:46424) 2019-11-28T11:58:31.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c3caaf700 1 -- 172.21.15.80:0/510745322 learned_addr learned my addr 172.21.15.80:0/510745322 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:31.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c2ffff700 1 --2- 172.21.15.80:0/510745322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c3806c490 0x7f0c3806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:31.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c377fe700 1 -- 172.21.15.80:0/510745322 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285759085 0 0) 0x7f0c300014d0 con 0x7f0c3806ce60 2019-11-28T11:58:31.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c377fe700 1 -- 172.21.15.80:0/510745322 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c24002e80 con 0x7f0c3806ce60 2019-11-28T11:58:31.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c377fe700 1 -- 172.21.15.80:0/510745322 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028196046 0 0) 0x7f0c28001080 con 0x7f0c3806c0a0 2019-11-28T11:58:31.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c377fe700 1 -- 172.21.15.80:0/510745322 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c24004170 con 0x7f0c3806c0a0 2019-11-28T11:58:31.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c2ffff700 1 -- 172.21.15.80:0/510745322 >> v1:172.21.15.174:6789/0 conn(0x7f0c3806c0a0 legacy=0x7f0c38072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:31.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c2ffff700 1 -- 172.21.15.80:0/510745322 >> v1:172.21.15.80:6789/0 conn(0x7f0c3806ce60 legacy=0x7f0c38164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:31.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c2ffff700 1 -- 172.21.15.80:0/510745322 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c380706c0 con 0x7f0c3806c490 2019-11-28T11:58:31.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c2ffff700 1 --2- 172.21.15.80:0/510745322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c3806c490 0x7f0c3806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0c2000af50 tx=0x7f0c2000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:31.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c2ffff700 1 --2- 172.21.15.80:0/510745322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c3806c490 0x7f0c3806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0c2000af50 tx=0x7f0c2000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:31.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c2ffff700 1 --2- 172.21.15.80:0/510745322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c3806c490 0x7f0c3806c920 secure :-1 s=READY pgs=421 cs=0 l=1 rx=0x7f0c2000af50 tx=0x7f0c2000b760).ready entity=mon.2 client_cookie=418ebddcfe6c42ba server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:31.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c2ffff700 1 --2- 172.21.15.80:0/510745322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c3806c490 0x7f0c3806c920 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f0c2000af50 tx=0x7f0c2000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:31.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c377fe700 1 -- 172.21.15.80:0/510745322 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c20000960 con 0x7f0c3806c490 2019-11-28T11:58:31.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c2ffff700 1 --2- 172.21.15.80:0/510745322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c3806c490 0x7f0c3806c920 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f0c2000af50 tx=0x7f0c2000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:31.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c2ffff700 1 --2- 172.21.15.80:0/510745322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c3806c490 0x7f0c3806c920 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f0c2000af50 tx=0x7f0c2000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:31.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c377fe700 1 -- 172.21.15.80:0/510745322 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c20009860 con 0x7f0c3806c490 2019-11-28T11:58:31.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.357+0000 7f0c377fe700 1 -- 172.21.15.80:0/510745322 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c20009f30 con 0x7f0c3806c490 2019-11-28T11:58:31.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.358+0000 7f0c3dd11700 1 -- 172.21.15.80:0/510745322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c3806c490 msgr2=0x7f0c3806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:31.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.358+0000 7f0c3dd11700 1 --2- 172.21.15.80:0/510745322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c3806c490 0x7f0c3806c920 secure :-1 s=READY pgs=421 cs=0 l=1 rx=0x7f0c2000af50 tx=0x7f0c2000b760).stop 2019-11-28T11:58:31.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.358+0000 7f0c3dd11700 1 -- 172.21.15.80:0/510745322 shutdown_connections 2019-11-28T11:58:31.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.358+0000 7f0c3dd11700 1 --2- 172.21.15.80:0/510745322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c3806c490 0x7f0c3806c920 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:31.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.358+0000 7f0c3dd11700 1 -- 172.21.15.80:0/510745322 shutdown_connections 2019-11-28T11:58:31.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.358+0000 7f0c3dd11700 1 -- 172.21.15.80:0/510745322 wait complete. 2019-11-28T11:58:31.360 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.358+0000 7f0c3dd11700 1 -- 172.21.15.80:0/510745322 >> 172.21.15.80:0/510745322 conn(0x7f0c38061cf0 msgr2=0x7f0c38064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:31.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.361+0000 7f0c3dd11700 1 Processor -- start 2019-11-28T11:58:31.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.361+0000 7f0c3dd11700 1 -- start start 2019-11-28T11:58:31.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.361+0000 7f0c3dd11700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0c381068c0 0x7f0c38137480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:31.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.361+0000 7f0c3dd11700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c381379c0 0x7f0c38128210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:31.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.361+0000 7f0c3dd11700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c38106fc0 con 0x7f0c38128750 2019-11-28T11:58:31.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.361+0000 7f0c3dd11700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c38133770 con 0x7f0c381068c0 2019-11-28T11:58:31.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.361+0000 7f0c3dd11700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c38073ac0 con 0x7f0c381379c0 2019-11-28T11:58:31.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c37fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0c381068c0 0x7f0c38137480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:31.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c37fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0c381068c0 0x7f0c38137480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47110/0 (socket says 172.21.15.80:47110) 2019-11-28T11:58:31.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c37fff700 1 -- 172.21.15.80:0/119795356 learned_addr learned my addr 172.21.15.80:0/119795356 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:31.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c2ffff700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c381379c0 0x7f0c38128210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:31.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c37fff700 1 -- 172.21.15.80:0/119795356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c381379c0 msgr2=0x7f0c38128210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:31.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c37fff700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c381379c0 0x7f0c38128210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:31.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c37fff700 1 -- 172.21.15.80:0/119795356 >> v1:172.21.15.80:6789/0 conn(0x7f0c38128750 legacy=0x7f0c3812e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:31.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c37fff700 1 -- 172.21.15.80:0/119795356 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c38133e00 con 0x7f0c381068c0 2019-11-28T11:58:31.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c37fff700 1 --2- 172.21.15.80:0/119795356 >> v2:172.21.15.80:3300/0 conn(0x7f0c381068c0 0x7f0c38137480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c28010410 tx=0x7f0c280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:31.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c37fff700 1 --2- 172.21.15.80:0/119795356 >> v2:172.21.15.80:3300/0 conn(0x7f0c381068c0 0x7f0c38137480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c28010410 tx=0x7f0c280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:31.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c37fff700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c381068c0 0x7f0c38137480 secure :-1 s=READY pgs=2896 cs=0 l=1 rx=0x7f0c28010410 tx=0x7f0c280107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:31.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c37fff700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c381068c0 0x7f0c38137480 secure :-1 s=THROTTLE_DONE pgs=2896 cs=0 l=1 rx=0x7f0c28010410 tx=0x7f0c280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:31.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c37fff700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c381068c0 0x7f0c38137480 secure :-1 s=THROTTLE_DONE pgs=2896 cs=0 l=1 rx=0x7f0c28010410 tx=0x7f0c280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:31.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c37fff700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c381068c0 0x7f0c38137480 secure :-1 s=THROTTLE_DONE pgs=2896 cs=0 l=1 rx=0x7f0c28010410 tx=0x7f0c280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:31.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c357fa700 1 -- 172.21.15.80:0/119795356 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c28005770 con 0x7f0c381068c0 2019-11-28T11:58:31.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c357fa700 1 -- 172.21.15.80:0/119795356 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c28005390 con 0x7f0c381068c0 2019-11-28T11:58:31.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c3dd11700 1 -- 172.21.15.80:0/119795356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c38134180 con 0x7f0c381068c0 2019-11-28T11:58:31.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c357fa700 1 -- 172.21.15.80:0/119795356 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c28005d50 con 0x7f0c381068c0 2019-11-28T11:58:31.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.362+0000 7f0c3dd11700 1 -- 172.21.15.80:0/119795356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c381330b0 con 0x7f0c381068c0 2019-11-28T11:58:31.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.363+0000 7f0c37fff700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c381068c0 0x7f0c38137480 secure :-1 s=THROTTLE_DONE pgs=2896 cs=0 l=1 rx=0x7f0c28010410 tx=0x7f0c280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:31.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.363+0000 7f0c357fa700 1 -- 172.21.15.80:0/119795356 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0c28005580 con 0x7f0c381068c0 2019-11-28T11:58:31.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.363+0000 7f0c37fff700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c381068c0 0x7f0c38137480 secure :-1 s=THROTTLE_DONE pgs=2896 cs=0 l=1 rx=0x7f0c28010410 tx=0x7f0c280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:31.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.363+0000 7f0c357fa700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0c1c018730 0x7f0c1c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:31.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.363+0000 7f0c357fa700 1 -- 172.21.15.80:0/119795356 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0c28031a10 con 0x7f0c381068c0 2019-11-28T11:58:31.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.363+0000 7f0c2ffff700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0c1c018730 0x7f0c1c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:31.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.363+0000 7f0c2ffff700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0c1c018730 0x7f0c1c01abc0 crc :-1 s=READY pgs=1199 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:31.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.371+0000 7f0c3dd11700 1 -- 172.21.15.80:0/119795356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c38133e00 con 0x7f0c381068c0 2019-11-28T11:58:31.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.374+0000 7f0c37fff700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c381068c0 0x7f0c38137480 secure :-1 s=THROTTLE_DONE pgs=2896 cs=0 l=1 rx=0x7f0c28010410 tx=0x7f0c280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:31.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.374+0000 7f0c357fa700 1 -- 172.21.15.80:0/119795356 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0c28026ed0 con 0x7f0c381068c0 2019-11-28T11:58:31.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.546+0000 7f0c3dd11700 1 -- 172.21.15.80:0/119795356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c38134180 con 0x7f0c381068c0 2019-11-28T11:58:31.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.547+0000 7f0c37fff700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c381068c0 0x7f0c38137480 secure :-1 s=THROTTLE_DONE pgs=2896 cs=0 l=1 rx=0x7f0c28010410 tx=0x7f0c280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:31.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.547+0000 7f0c357fa700 1 -- 172.21.15.80:0/119795356 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 185 v185) v1 ==== 95+0+2459 (secure 0 0 0) 0x7f0c28026ed0 con 0x7f0c381068c0 2019-11-28T11:58:31.543 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 185 2019-11-28T11:58:31.543 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:31.544 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":185,"default_fscid":18,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":11665,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/3051174059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3051174059},{"type":"v1","addr":"172.21.15.174:6835","nonce":3051174059}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":184},{"gid":12435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2096320481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2096320481},{"type":"v1","addr":"172.21.15.80:6834","nonce":2096320481}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":184}],"filesystems":[{"mdsmap":{"epoch":185,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:58:24.286894+0000","modified":"2019-11-28T11:58:30.974049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8138":{"gid":8138,"name":"a","rank":0,"incarnation":185,"state":"up:creating","state_seq":2,"addr":"172.21.15.80:6835/4148152245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":4148152245},{"type":"v1","addr":"172.21.15.80:6835","nonce":4148152245}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[37],"metadata_pool":36,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":18}]} 2019-11-28T11:58:31.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.549+0000 7f0c3dd11700 1 -- 172.21.15.80:0/119795356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0c1c018730 msgr2=0x7f0c1c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:31.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.549+0000 7f0c3dd11700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0c1c018730 0x7f0c1c01abc0 crc :-1 s=READY pgs=1199 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:31.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.549+0000 7f0c3dd11700 1 -- 172.21.15.80:0/119795356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c381068c0 msgr2=0x7f0c38137480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:31.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.549+0000 7f0c3dd11700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c381068c0 0x7f0c38137480 secure :-1 s=READY pgs=2896 cs=0 l=1 rx=0x7f0c28010410 tx=0x7f0c280107b0).stop 2019-11-28T11:58:31.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.549+0000 7f0c3dd11700 1 -- 172.21.15.80:0/119795356 shutdown_connections 2019-11-28T11:58:31.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.549+0000 7f0c3dd11700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0c1c018730 0x7f0c1c01abc0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:31.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.549+0000 7f0c3dd11700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c381379c0 0x7f0c38128210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:31.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.549+0000 7f0c3dd11700 1 --2- 172.21.15.80:0/119795356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c381068c0 0x7f0c38137480 unknown :-1 s=CLOSED pgs=2896 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:31.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.549+0000 7f0c3dd11700 1 -- 172.21.15.80:0/119795356 shutdown_connections 2019-11-28T11:58:31.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.549+0000 7f0c3dd11700 1 -- 172.21.15.80:0/119795356 wait complete. 2019-11-28T11:58:31.555 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:31.549+0000 7f0c3dd11700 1 -- 172.21.15.80:0/119795356 >> 172.21.15.80:0/119795356 conn(0x7f0c3813d930 msgr2=0x7f0c38102360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:31.859 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8138}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 36, u'failed': [], u'epoch': 185, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [37], u'info': {u'gid_8138': {u'export_targets': [], u'name': u'a', u'incarnation': 185, u'state_seq': 2, u'state': u'up:creating', u'gid': 8138, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 4148152245, u'type': u'v2', u'addr': u'172.21.15.80:6833'}, {u'nonce': 4148152245, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/4148152245'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:58:24.286894+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:58:30.974049+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:58:31.860 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8138:up:creating 2019-11-28T11:58:32.861 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:58:32.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.989+0000 7f47ef70d700 1 Processor -- start 2019-11-28T11:58:32.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.989+0000 7f47ef70d700 1 -- start start 2019-11-28T11:58:32.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.990+0000 7f47ef70d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f47e806d120 0x7f47e8165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:32.990 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.990+0000 7f47ef70d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e806d5a0 con 0x7f47e806c0a0 2019-11-28T11:58:32.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.990+0000 7f47ef70d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e806db00 con 0x7f47e806c490 2019-11-28T11:58:32.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.990+0000 7f47ef70d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e806fd60 con 0x7f47e806d120 2019-11-28T11:58:32.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.990+0000 7f47edcaa700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f47e806c0a0 0x7f47e8072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46436/0 (socket says 172.21.15.80:46436) 2019-11-28T11:58:32.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.990+0000 7f47edcaa700 1 -- 172.21.15.80:0/3141744991 learned_addr learned my addr 172.21.15.80:0/3141744991 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:32.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.990+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/3141744991 >> v2:172.21.15.174:3300/0 conn(0x7f47e806d120 0x7f47e8165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:32.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.990+0000 7f47ecca8700 1 -- 172.21.15.80:0/3141744991 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250271920 0 0) 0x7f47e0001150 con 0x7f47e806c0a0 2019-11-28T11:58:32.991 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.990+0000 7f47ecca8700 1 -- 172.21.15.80:0/3141744991 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47d0002e80 con 0x7f47e806c0a0 2019-11-28T11:58:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.990+0000 7f47ee4ab700 1 -- 172.21.15.80:0/3141744991 >> v1:172.21.15.174:6789/0 conn(0x7f47e806c490 legacy=0x7f47e806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.990+0000 7f47ecca8700 1 -- 172.21.15.80:0/3141744991 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2700387197 0 0) 0x7f47e0001130 con 0x7f47e806c0a0 2019-11-28T11:58:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.990+0000 7f47ee4ab700 1 -- 172.21.15.80:0/3141744991 >> v1:172.21.15.80:6789/0 conn(0x7f47e806c0a0 legacy=0x7f47e8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.990+0000 7f47ee4ab700 1 -- 172.21.15.80:0/3141744991 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e80706c0 con 0x7f47e806d120 2019-11-28T11:58:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.990+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/3141744991 >> v2:172.21.15.174:3300/0 conn(0x7f47e806d120 0x7f47e8165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f47d800b300 tx=0x7f47d800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:32.992 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.991+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/3141744991 >> v2:172.21.15.174:3300/0 conn(0x7f47e806d120 0x7f47e8165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f47d800b300 tx=0x7f47d800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.991+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/3141744991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47e806d120 0x7f47e8165d80 secure :-1 s=READY pgs=1752 cs=0 l=1 rx=0x7f47d800b300 tx=0x7f47d800bb10).ready entity=mon.1 client_cookie=b465d2253ffab593 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.991+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/3141744991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47e806d120 0x7f47e8165d80 secure :-1 s=THROTTLE_DONE pgs=1752 cs=0 l=1 rx=0x7f47d800b300 tx=0x7f47d800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.991+0000 7f47ecca8700 1 -- 172.21.15.80:0/3141744991 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47d80075c0 con 0x7f47e806d120 2019-11-28T11:58:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.991+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/3141744991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47e806d120 0x7f47e8165d80 secure :-1 s=THROTTLE_DONE pgs=1752 cs=0 l=1 rx=0x7f47d800b300 tx=0x7f47d800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.991+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/3141744991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47e806d120 0x7f47e8165d80 secure :-1 s=THROTTLE_DONE pgs=1752 cs=0 l=1 rx=0x7f47d800b300 tx=0x7f47d800bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.991+0000 7f47ecca8700 1 -- 172.21.15.80:0/3141744991 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d8000f30 con 0x7f47e806d120 2019-11-28T11:58:32.993 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.991+0000 7f47ecca8700 1 -- 172.21.15.80:0/3141744991 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47d800a1e0 con 0x7f47e806d120 2019-11-28T11:58:32.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.991+0000 7f47ef70d700 1 -- 172.21.15.80:0/3141744991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47e806d120 msgr2=0x7f47e8165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:32.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.991+0000 7f47ef70d700 1 --2- 172.21.15.80:0/3141744991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47e806d120 0x7f47e8165d80 secure :-1 s=READY pgs=1752 cs=0 l=1 rx=0x7f47d800b300 tx=0x7f47d800bb10).stop 2019-11-28T11:58:32.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.991+0000 7f47ef70d700 1 -- 172.21.15.80:0/3141744991 shutdown_connections 2019-11-28T11:58:32.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.991+0000 7f47ef70d700 1 --2- 172.21.15.80:0/3141744991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47e806d120 0x7f47e8165d80 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:32.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.992+0000 7f47ef70d700 1 -- 172.21.15.80:0/3141744991 shutdown_connections 2019-11-28T11:58:32.994 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.992+0000 7f47ef70d700 1 -- 172.21.15.80:0/3141744991 wait complete. 2019-11-28T11:58:32.996 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.992+0000 7f47ef70d700 1 -- 172.21.15.80:0/3141744991 >> 172.21.15.80:0/3141744991 conn(0x7f47e8061cf0 msgr2=0x7f47e8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.994+0000 7f47ef70d700 1 Processor -- start 2019-11-28T11:58:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.994+0000 7f47ef70d700 1 -- start start 2019-11-28T11:58:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ef70d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47e8167a20 0x7f47e8169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ef70d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e813fc50 con 0x7f47e81145b0 2019-11-28T11:58:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ef70d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e8122ef0 con 0x7f47e813f580 2019-11-28T11:58:32.997 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ef70d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e8112550 con 0x7f47e8167a20 2019-11-28T11:58:33.002 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ee4ab700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47e8167a20 0x7f47e8169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:33.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ed4a9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f47e81145b0 0x7f47e8114a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46444/0 (socket says 172.21.15.80:46444) 2019-11-28T11:58:33.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ed4a9700 1 -- 172.21.15.80:0/4106785027 learned_addr learned my addr 172.21.15.80:0/4106785027 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:33.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ee4ab700 1 -- 172.21.15.80:0/4106785027 >> v1:172.21.15.174:6789/0 conn(0x7f47e813f580 legacy=0x7f47e8115730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:33.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ee4ab700 1 -- 172.21.15.80:0/4106785027 >> v1:172.21.15.80:6789/0 conn(0x7f47e81145b0 legacy=0x7f47e8114a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:33.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ee4ab700 1 -- 172.21.15.80:0/4106785027 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e8112eb0 con 0x7f47e8167a20 2019-11-28T11:58:33.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47e67fc700 1 -- 172.21.15.80:0/4106785027 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308281392 0 0) 0x7f47dc000bd0 con 0x7f47e81145b0 2019-11-28T11:58:33.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/4106785027 >> v2:172.21.15.80:3300/0 conn(0x7f47e8167a20 0x7f47e8169e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47d8010730 tx=0x7f47d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/4106785027 >> v2:172.21.15.80:3300/0 conn(0x7f47e8167a20 0x7f47e8169e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47d8010730 tx=0x7f47d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/4106785027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47e8167a20 0x7f47e8169e20 secure :-1 s=READY pgs=2899 cs=0 l=1 rx=0x7f47d8010730 tx=0x7f47d8010ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:33.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/4106785027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47e8167a20 0x7f47e8169e20 secure :-1 s=THROTTLE_DONE pgs=2899 cs=0 l=1 rx=0x7f47d8010730 tx=0x7f47d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47e67fc700 1 -- 172.21.15.80:0/4106785027 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47d800b120 con 0x7f47e8167a20 2019-11-28T11:58:33.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/4106785027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47e8167a20 0x7f47e8169e20 secure :-1 s=THROTTLE_DONE pgs=2899 cs=0 l=1 rx=0x7f47d8010730 tx=0x7f47d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/4106785027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47e8167a20 0x7f47e8169e20 secure :-1 s=THROTTLE_DONE pgs=2899 cs=0 l=1 rx=0x7f47d8010730 tx=0x7f47d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47e67fc700 1 -- 172.21.15.80:0/4106785027 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d8009b40 con 0x7f47e8167a20 2019-11-28T11:58:33.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ef70d700 1 -- 172.21.15.80:0/4106785027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e8113230 con 0x7f47e8167a20 2019-11-28T11:58:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47e67fc700 1 -- 172.21.15.80:0/4106785027 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47d800a210 con 0x7f47e8167a20 2019-11-28T11:58:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ef70d700 1 -- 172.21.15.80:0/4106785027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e8112eb0 con 0x7f47e8167a20 2019-11-28T11:58:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/4106785027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47e8167a20 0x7f47e8169e20 secure :-1 s=THROTTLE_DONE pgs=2899 cs=0 l=1 rx=0x7f47d8010730 tx=0x7f47d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47e67fc700 1 -- 172.21.15.80:0/4106785027 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f47d8009d30 con 0x7f47e8167a20 2019-11-28T11:58:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/4106785027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47e8167a20 0x7f47e8169e20 secure :-1 s=THROTTLE_DONE pgs=2899 cs=0 l=1 rx=0x7f47d8010730 tx=0x7f47d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47e67fc700 1 --2- 172.21.15.80:0/4106785027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47c8018730 0x7f47c801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:33.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.996+0000 7f47e67fc700 1 -- 172.21.15.80:0/4106785027 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f47d8031ef0 con 0x7f47e8167a20 2019-11-28T11:58:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.997+0000 7f47edcaa700 1 --2- 172.21.15.80:0/4106785027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47c8018730 0x7f47c801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:32.997+0000 7f47edcaa700 1 --2- 172.21.15.80:0/4106785027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47c8018730 0x7f47c801abe0 crc :-1 s=READY pgs=1202 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:33.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.005+0000 7f47ef70d700 1 -- 172.21.15.80:0/4106785027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e8113230 con 0x7f47e8167a20 2019-11-28T11:58:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.009+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/4106785027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47e8167a20 0x7f47e8169e20 secure :-1 s=THROTTLE_DONE pgs=2899 cs=0 l=1 rx=0x7f47d8010730 tx=0x7f47d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.009+0000 7f47e67fc700 1 -- 172.21.15.80:0/4106785027 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f47d8009930 con 0x7f47e8167a20 2019-11-28T11:58:33.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.182+0000 7f47ef70d700 1 -- 172.21.15.80:0/4106785027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47e8112eb0 con 0x7f47e8167a20 2019-11-28T11:58:33.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.182+0000 7f47ee4ab700 1 --2- 172.21.15.80:0/4106785027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47e8167a20 0x7f47e8169e20 secure :-1 s=THROTTLE_DONE pgs=2899 cs=0 l=1 rx=0x7f47d8010730 tx=0x7f47d8010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.182+0000 7f47e67fc700 1 -- 172.21.15.80:0/4106785027 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 186 v186) v1 ==== 95+0+2457 (secure 0 0 0) 0x7f47d800a550 con 0x7f47e8167a20 2019-11-28T11:58:33.179 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 186 2019-11-28T11:58:33.179 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:33.179 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":186,"default_fscid":18,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":11665,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/3051174059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3051174059},{"type":"v1","addr":"172.21.15.174:6835","nonce":3051174059}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":184},{"gid":12435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2096320481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2096320481},{"type":"v1","addr":"172.21.15.80:6834","nonce":2096320481}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":184}],"filesystems":[{"mdsmap":{"epoch":186,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:58:24.286894+0000","modified":"2019-11-28T11:58:31.978284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8138":{"gid":8138,"name":"a","rank":0,"incarnation":185,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6835/4148152245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":4148152245},{"type":"v1","addr":"172.21.15.80:6835","nonce":4148152245}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[37],"metadata_pool":36,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":18}]} 2019-11-28T11:58:33.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.185+0000 7f47ef70d700 1 -- 172.21.15.80:0/4106785027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47c8018730 msgr2=0x7f47c801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:33.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.185+0000 7f47ef70d700 1 --2- 172.21.15.80:0/4106785027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47c8018730 0x7f47c801abe0 crc :-1 s=READY pgs=1202 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:33.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.185+0000 7f47ef70d700 1 -- 172.21.15.80:0/4106785027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47e8167a20 msgr2=0x7f47e8169e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:33.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.185+0000 7f47ef70d700 1 --2- 172.21.15.80:0/4106785027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47e8167a20 0x7f47e8169e20 secure :-1 s=READY pgs=2899 cs=0 l=1 rx=0x7f47d8010730 tx=0x7f47d8010ad0).stop 2019-11-28T11:58:33.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.185+0000 7f47ef70d700 1 -- 172.21.15.80:0/4106785027 shutdown_connections 2019-11-28T11:58:33.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.185+0000 7f47ef70d700 1 --2- 172.21.15.80:0/4106785027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47e8167a20 0x7f47e8169e20 unknown :-1 s=CLOSED pgs=2899 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:33.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.185+0000 7f47ef70d700 1 --2- 172.21.15.80:0/4106785027 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f47c8018730 0x7f47c801abe0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:33.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.185+0000 7f47ef70d700 1 -- 172.21.15.80:0/4106785027 shutdown_connections 2019-11-28T11:58:33.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.185+0000 7f47ef70d700 1 -- 172.21.15.80:0/4106785027 wait complete. 2019-11-28T11:58:33.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.185+0000 7f47ef70d700 1 -- 172.21.15.80:0/4106785027 >> 172.21.15.80:0/4106785027 conn(0x7f47e81426c0 msgr2=0x7f47e8110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:33.493 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8138}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 36, u'failed': [], u'epoch': 186, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [37], u'info': {u'gid_8138': {u'export_targets': [], u'name': u'a', u'incarnation': 185, u'state_seq': 3, u'state': u'up:active', u'gid': 8138, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 4148152245, u'type': u'v2', u'addr': u'172.21.15.80:6833'}, {u'nonce': 4148152245, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/4148152245'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:58:24.286894+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:58:31.978284+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:58:33.493 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:58:33.493 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2019-11-28T11:58:33.619 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:58:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:58:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T11:58:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 8138, 2019-11-28T11:58:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2019-11-28T11:58:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2019-11-28T11:58:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 2.6428359370000001, 2019-11-28T11:58:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 186, 2019-11-28T11:58:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 223, 2019-11-28T11:58:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 223, 2019-11-28T11:58:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 6.9161383250000004 2019-11-28T11:58:33.621 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:58:33.624 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8138, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.6428359370000001, "mdsmap_epoch": 186, "osdmap_epoch": 223, "osdmap_epoch_barrier": 223, "uptime": 6.9161383250000004 } 2019-11-28T11:58:33.625 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:58:33.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.748+0000 7f68b2000700 1 Processor -- start 2019-11-28T11:58:33.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.748+0000 7f68b2000700 1 -- start start 2019-11-28T11:58:33.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.749+0000 7f68b2000700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68ac06c0a0 0x7f68ac072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:33.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.749+0000 7f68b2000700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68ac0734e0 0x7f68ac071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:33.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.749+0000 7f68b2000700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ac06db00 con 0x7f68ac072360 2019-11-28T11:58:33.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.749+0000 7f68b2000700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ac06f330 con 0x7f68ac0734e0 2019-11-28T11:58:33.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.749+0000 7f68b2000700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac0706c0 con 0x7f68ac06c0a0 2019-11-28T11:58:33.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.749+0000 7f68a3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68ac0734e0 0x7f68ac071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:33.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.749+0000 7f68a3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68ac0734e0 0x7f68ac071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47134/0 (socket says 172.21.15.80:47134) 2019-11-28T11:58:33.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.749+0000 7f68a3fff700 1 -- 172.21.15.80:0/3272977833 learned_addr learned my addr 172.21.15.80:0/3272977833 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:33.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68abfff700 1 --2- 172.21.15.80:0/3272977833 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68ac06c0a0 0x7f68ac072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:33.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68a3fff700 1 -- 172.21.15.80:0/3272977833 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68ac06c0a0 msgr2=0x7f68ac072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:33.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68a3fff700 1 --2- 172.21.15.80:0/3272977833 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68ac06c0a0 0x7f68ac072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:33.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68a3fff700 1 -- 172.21.15.80:0/3272977833 >> v1:172.21.15.80:6789/0 conn(0x7f68ac072360 legacy=0x7f68ac06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:33.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68a3fff700 1 -- 172.21.15.80:0/3272977833 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac070a40 con 0x7f68ac0734e0 2019-11-28T11:58:33.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68ab7fe700 1 -- 172.21.15.80:0/3272977833 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822619999 0 0) 0x7f68a4001480 con 0x7f68ac072360 2019-11-28T11:58:33.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68a3fff700 1 --2- 172.21.15.80:0/3272977833 >> v2:172.21.15.80:3300/0 conn(0x7f68ac0734e0 0x7f68ac071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f689400f6c0 tx=0x7f689400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68a3fff700 1 --2- 172.21.15.80:0/3272977833 >> v2:172.21.15.80:3300/0 conn(0x7f68ac0734e0 0x7f68ac071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f689400f6c0 tx=0x7f689400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68a3fff700 1 --2- 172.21.15.80:0/3272977833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68ac0734e0 0x7f68ac071e20 secure :-1 s=READY pgs=2901 cs=0 l=1 rx=0x7f689400f6c0 tx=0x7f689400fa60).ready entity=mon.0 client_cookie=56ac5dd5c1d9015d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:33.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68a3fff700 1 --2- 172.21.15.80:0/3272977833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68ac0734e0 0x7f68ac071e20 secure :-1 s=THROTTLE_DONE pgs=2901 cs=0 l=1 rx=0x7f689400f6c0 tx=0x7f689400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68ab7fe700 1 -- 172.21.15.80:0/3272977833 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6894000960 con 0x7f68ac0734e0 2019-11-28T11:58:33.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68a3fff700 1 --2- 172.21.15.80:0/3272977833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68ac0734e0 0x7f68ac071e20 secure :-1 s=THROTTLE_DONE pgs=2901 cs=0 l=1 rx=0x7f689400f6c0 tx=0x7f689400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68ab7fe700 1 -- 172.21.15.80:0/3272977833 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6894007210 con 0x7f68ac0734e0 2019-11-28T11:58:33.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68a3fff700 1 --2- 172.21.15.80:0/3272977833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68ac0734e0 0x7f68ac071e20 secure :-1 s=THROTTLE_DONE pgs=2901 cs=0 l=1 rx=0x7f689400f6c0 tx=0x7f689400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68ab7fe700 1 -- 172.21.15.80:0/3272977833 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6894000960 con 0x7f68ac0734e0 2019-11-28T11:58:33.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68b2000700 1 -- 172.21.15.80:0/3272977833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68ac0734e0 msgr2=0x7f68ac071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:33.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.750+0000 7f68b2000700 1 --2- 172.21.15.80:0/3272977833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68ac0734e0 0x7f68ac071e20 secure :-1 s=READY pgs=2901 cs=0 l=1 rx=0x7f689400f6c0 tx=0x7f689400fa60).stop 2019-11-28T11:58:33.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.751+0000 7f68b2000700 1 -- 172.21.15.80:0/3272977833 shutdown_connections 2019-11-28T11:58:33.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.751+0000 7f68b2000700 1 --2- 172.21.15.80:0/3272977833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68ac0734e0 0x7f68ac071e20 unknown :-1 s=CLOSED pgs=2901 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:33.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.751+0000 7f68b2000700 1 --2- 172.21.15.80:0/3272977833 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68ac06c0a0 0x7f68ac072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:33.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.751+0000 7f68b2000700 1 -- 172.21.15.80:0/3272977833 shutdown_connections 2019-11-28T11:58:33.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.751+0000 7f68b2000700 1 -- 172.21.15.80:0/3272977833 wait complete. 2019-11-28T11:58:33.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.751+0000 7f68b2000700 1 -- 172.21.15.80:0/3272977833 >> 172.21.15.80:0/3272977833 conn(0x7f68ac061cf0 msgr2=0x7f68ac064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:33.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.753+0000 7f68b2000700 1 Processor -- start 2019-11-28T11:58:33.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.753+0000 7f68b2000700 1 -- start start 2019-11-28T11:58:33.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.754+0000 7f68b2000700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f68ac13e320 0x7f68ac13e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:33.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.754+0000 7f68b2000700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68ac12a3c0 0x7f68ac12a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:33.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.754+0000 7f68b2000700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ac139e00 con 0x7f68ac15fdf0 2019-11-28T11:58:33.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.754+0000 7f68b2000700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ac108820 con 0x7f68ac13e320 2019-11-28T11:58:33.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.754+0000 7f68b2000700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac108af0 con 0x7f68ac12a3c0 2019-11-28T11:58:33.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.754+0000 7f68b0d9e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68ac12a3c0 0x7f68ac12a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:33.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68a3fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f68ac13e320 0x7f68ac13e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:33.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68b0d9e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68ac12a3c0 0x7f68ac12a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:49404/0 (socket says 172.21.15.80:49404) 2019-11-28T11:58:33.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68b0d9e700 1 -- 172.21.15.80:0/285923861 learned_addr learned my addr 172.21.15.80:0/285923861 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:33.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68a3fff700 1 -- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68ac12a3c0 msgr2=0x7f68ac12a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:33.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68a3fff700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68ac12a3c0 0x7f68ac12a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:33.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68a3fff700 1 -- 172.21.15.80:0/285923861 >> v1:172.21.15.174:6789/0 conn(0x7f68ac15fdf0 legacy=0x7f68ac12b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:33.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68a97fa700 1 -- 172.21.15.80:0/285923861 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844806533 0 0) 0x7f689c005720 con 0x7f68ac15fdf0 2019-11-28T11:58:33.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68a3fff700 1 -- 172.21.15.80:0/285923861 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac10a8c0 con 0x7f68ac13e320 2019-11-28T11:58:33.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68b0d9e700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68ac12a3c0 0x7f68ac12a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:33.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68a3fff700 1 --2- 172.21.15.80:0/285923861 >> v2:172.21.15.174:3300/0 conn(0x7f68ac13e320 0x7f68ac13e7b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6894054390 tx=0x7f6894054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68a3fff700 1 --2- 172.21.15.80:0/285923861 >> v2:172.21.15.174:3300/0 conn(0x7f68ac13e320 0x7f68ac13e7b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6894054390 tx=0x7f6894054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68a3fff700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68ac13e320 0x7f68ac13e7b0 secure :-1 s=READY pgs=1755 cs=0 l=1 rx=0x7f6894054390 tx=0x7f6894054730).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:33.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68a3fff700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68ac13e320 0x7f68ac13e7b0 secure :-1 s=THROTTLE_DONE pgs=1755 cs=0 l=1 rx=0x7f6894054390 tx=0x7f6894054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68a97fa700 1 -- 172.21.15.80:0/285923861 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6894007c90 con 0x7f68ac13e320 2019-11-28T11:58:33.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68a3fff700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68ac13e320 0x7f68ac13e7b0 secure :-1 s=THROTTLE_DONE pgs=1755 cs=0 l=1 rx=0x7f6894054390 tx=0x7f6894054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68a97fa700 1 -- 172.21.15.80:0/285923861 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6894007c90 con 0x7f68ac13e320 2019-11-28T11:58:33.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68a3fff700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68ac13e320 0x7f68ac13e7b0 secure :-1 s=THROTTLE_DONE pgs=1755 cs=0 l=1 rx=0x7f6894054390 tx=0x7f6894054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68b2000700 1 -- 172.21.15.80:0/285923861 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ac10a8c0 con 0x7f68ac13e320 2019-11-28T11:58:33.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68a97fa700 1 -- 172.21.15.80:0/285923861 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6894005580 con 0x7f68ac13e320 2019-11-28T11:58:33.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.755+0000 7f68b2000700 1 -- 172.21.15.80:0/285923861 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ac10a8c0 con 0x7f68ac13e320 2019-11-28T11:58:33.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.756+0000 7f68a3fff700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68ac13e320 0x7f68ac13e7b0 secure :-1 s=THROTTLE_DONE pgs=1755 cs=0 l=1 rx=0x7f6894054390 tx=0x7f6894054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.756+0000 7f68a97fa700 1 -- 172.21.15.80:0/285923861 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6894007e80 con 0x7f68ac13e320 2019-11-28T11:58:33.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.756+0000 7f68a3fff700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68ac13e320 0x7f68ac13e7b0 secure :-1 s=THROTTLE_DONE pgs=1755 cs=0 l=1 rx=0x7f6894054390 tx=0x7f6894054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.756+0000 7f68a97fa700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6890018730 0x7f689001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:33.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.756+0000 7f68a97fa700 1 -- 172.21.15.80:0/285923861 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f68940759f0 con 0x7f68ac13e320 2019-11-28T11:58:33.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.756+0000 7f68abfff700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6890018730 0x7f689001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:33.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.757+0000 7f68abfff700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6890018730 0x7f689001abc0 crc :-1 s=READY pgs=1203 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:33.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.763+0000 7f68b2000700 1 -- 172.21.15.80:0/285923861 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ac109180 con 0x7f68ac13e320 2019-11-28T11:58:33.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.767+0000 7f68a3fff700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68ac13e320 0x7f68ac13e7b0 secure :-1 s=THROTTLE_DONE pgs=1755 cs=0 l=1 rx=0x7f6894054390 tx=0x7f6894054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.767+0000 7f68a97fa700 1 -- 172.21.15.80:0/285923861 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f689405b170 con 0x7f68ac13e320 2019-11-28T11:58:33.938 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.942+0000 7f68b2000700 1 -- 172.21.15.80:0/285923861 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68ac109500 con 0x7f68ac13e320 2019-11-28T11:58:33.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.943+0000 7f68a3fff700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68ac13e320 0x7f68ac13e7b0 secure :-1 s=THROTTLE_DONE pgs=1755 cs=0 l=1 rx=0x7f6894054390 tx=0x7f6894054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:33.939 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.943+0000 7f68a97fa700 1 -- 172.21.15.80:0/285923861 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v223) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f6894007e80 con 0x7f68ac13e320 2019-11-28T11:58:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:33.941 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":223,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:58:25.288240+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":37,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":36,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:58:22.567726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"222","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":37,"pool_name":"cephfs_data","create_time":"2019-11-28T11:58:23.259981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"223","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":220,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:58:33.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.947+0000 7f68b2000700 1 -- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6890018730 msgr2=0x7f689001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:33.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.947+0000 7f68b2000700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6890018730 0x7f689001abc0 crc :-1 s=READY pgs=1203 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:33.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.947+0000 7f68b2000700 1 -- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68ac13e320 msgr2=0x7f68ac13e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:33.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.947+0000 7f68b2000700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68ac13e320 0x7f68ac13e7b0 secure :-1 s=READY pgs=1755 cs=0 l=1 rx=0x7f6894054390 tx=0x7f6894054730).stop 2019-11-28T11:58:33.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.947+0000 7f68b2000700 1 -- 172.21.15.80:0/285923861 shutdown_connections 2019-11-28T11:58:33.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.947+0000 7f68b2000700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68ac12a3c0 0x7f68ac12a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:33.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.947+0000 7f68b2000700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68ac13e320 0x7f68ac13e7b0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:33.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.947+0000 7f68b2000700 1 --2- 172.21.15.80:0/285923861 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6890018730 0x7f689001abc0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:33.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.947+0000 7f68b2000700 1 -- 172.21.15.80:0/285923861 shutdown_connections 2019-11-28T11:58:33.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.947+0000 7f68b2000700 1 -- 172.21.15.80:0/285923861 wait complete. 2019-11-28T11:58:33.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:33.947+0000 7f68b2000700 1 -- 172.21.15.80:0/285923861 >> 172.21.15.80:0/285923861 conn(0x7f68ac127dc0 msgr2=0x7f68ac141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:33.953 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:58:22.567726+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 36, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'222', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:58:23.259981+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 37, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'223', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:58:33.954 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:58:34.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.081+0000 7fd01cecf700 1 Processor -- start 2019-11-28T11:58:34.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.081+0000 7fd01cecf700 1 -- start start 2019-11-28T11:58:34.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.082+0000 7fd01cecf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd01815f100 0x7fd01806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:34.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.082+0000 7fd01cecf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd01806c2f0 0x7fd01806c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:34.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.082+0000 7fd01cecf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01806db60 con 0x7fd01815ed10 2019-11-28T11:58:34.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.082+0000 7fd01cecf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01806fe00 con 0x7fd01806c2f0 2019-11-28T11:58:34.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.082+0000 7fd01cecf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0180700d0 con 0x7fd01815f100 2019-11-28T11:58:34.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.082+0000 7fd016d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd01815ed10 0x7fd018073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46464/0 (socket says 172.21.15.80:46464) 2019-11-28T11:58:34.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.082+0000 7fd016d9d700 1 -- 172.21.15.80:0/2669008108 learned_addr learned my addr 172.21.15.80:0/2669008108 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:34.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd01759e700 1 --2- 172.21.15.80:0/2669008108 >> v2:172.21.15.174:3300/0 conn(0x7fd01806c2f0 0x7fd01806c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd01659c700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd01815f100 0x7fd01806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd015d9b700 1 -- 172.21.15.80:0/2669008108 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256482254 0 0) 0x7fd008001150 con 0x7fd01815ed10 2019-11-28T11:58:34.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd015d9b700 1 -- 172.21.15.80:0/2669008108 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcff8002e80 con 0x7fd01815ed10 2019-11-28T11:58:34.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd015d9b700 1 -- 172.21.15.80:0/2669008108 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 696797929 0 0) 0x7fd008001130 con 0x7fd01815ed10 2019-11-28T11:58:34.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd015d9b700 1 -- 172.21.15.80:0/2669008108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd01815f100 msgr2=0x7fd01806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:34.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd015d9b700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd01815f100 0x7fd01806bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:34.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd015d9b700 1 -- 172.21.15.80:0/2669008108 >> v2:172.21.15.174:3300/0 conn(0x7fd01806c2f0 msgr2=0x7fd01806c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:34.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd015d9b700 1 --2- 172.21.15.80:0/2669008108 >> v2:172.21.15.174:3300/0 conn(0x7fd01806c2f0 0x7fd01806c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:34.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd015d9b700 1 -- 172.21.15.80:0/2669008108 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd018070760 con 0x7fd01815ed10 2019-11-28T11:58:34.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd015d9b700 1 -- 172.21.15.80:0/2669008108 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd008001660 con 0x7fd01815ed10 2019-11-28T11:58:34.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd01759e700 1 --2- 172.21.15.80:0/2669008108 >> v2:172.21.15.174:3300/0 conn(0x7fd01806c2f0 0x7fd01806c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:34.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd015d9b700 1 -- 172.21.15.80:0/2669008108 >> v1:172.21.15.80:6789/0 conn(0x7fd01815ed10 legacy=0x7fd018073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd015d9b700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcff80479e0 0x7fcff8049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:34.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd015d9b700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcff804a5c0 0x7fcff804ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:34.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd015d9b700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcff804d2f0 0x7fcff804f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:34.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd015d9b700 1 -- 172.21.15.80:0/2669008108 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff804ff40 con 0x7fcff80479e0 2019-11-28T11:58:34.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd015d9b700 1 -- 172.21.15.80:0/2669008108 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff8050130 con 0x7fcff804a5c0 2019-11-28T11:58:34.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd015d9b700 1 -- 172.21.15.80:0/2669008108 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff8050360 con 0x7fcff804d2f0 2019-11-28T11:58:34.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd016d9d700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcff80479e0 0x7fcff8049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd01759e700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcff804d2f0 0x7fcff804f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd01659c700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcff804a5c0 0x7fcff804ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd016d9d700 1 -- 172.21.15.80:0/2669008108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcff804d2f0 msgr2=0x7fcff804f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd016d9d700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcff804d2f0 0x7fcff804f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd016d9d700 1 -- 172.21.15.80:0/2669008108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcff804a5c0 msgr2=0x7fcff804ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd016d9d700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcff804a5c0 0x7fcff804ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd016d9d700 1 -- 172.21.15.80:0/2669008108 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff8050610 con 0x7fcff80479e0 2019-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.083+0000 7fd016d9d700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcff80479e0 0x7fcff8049e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd00800f910 tx=0x7fd00800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.084+0000 7fd016d9d700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcff80479e0 0x7fcff8049e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd00800f910 tx=0x7fd00800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.084+0000 7fd016d9d700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcff80479e0 0x7fcff8049e40 secure :-1 s=READY pgs=2903 cs=0 l=1 rx=0x7fd00800f910 tx=0x7fd00800f790).ready entity=mon.0 client_cookie=8cce158fa89d05f4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:34.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.084+0000 7fd016d9d700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcff80479e0 0x7fcff8049e40 secure :-1 s=THROTTLE_DONE pgs=2903 cs=0 l=1 rx=0x7fd00800f910 tx=0x7fd00800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.084+0000 7fd015d9b700 1 -- 172.21.15.80:0/2669008108 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd008004430 con 0x7fcff80479e0 2019-11-28T11:58:34.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.084+0000 7fd016d9d700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcff80479e0 0x7fcff8049e40 secure :-1 s=THROTTLE_DONE pgs=2903 cs=0 l=1 rx=0x7fd00800f910 tx=0x7fd00800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.084+0000 7fd016d9d700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcff80479e0 0x7fcff8049e40 secure :-1 s=THROTTLE_DONE pgs=2903 cs=0 l=1 rx=0x7fd00800f910 tx=0x7fd00800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.084+0000 7fd015d9b700 1 -- 172.21.15.80:0/2669008108 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd008001880 con 0x7fcff80479e0 2019-11-28T11:58:34.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.084+0000 7fd015d9b700 1 -- 172.21.15.80:0/2669008108 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd008004240 con 0x7fcff80479e0 2019-11-28T11:58:34.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.084+0000 7fd01cecf700 1 -- 172.21.15.80:0/2669008108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcff80479e0 msgr2=0x7fcff8049e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.084+0000 7fd01cecf700 1 --2- 172.21.15.80:0/2669008108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcff80479e0 0x7fcff8049e40 secure :-1 s=READY pgs=2903 cs=0 l=1 rx=0x7fd00800f910 tx=0x7fd00800f790).stop 2019-11-28T11:58:34.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.084+0000 7fd01759e700 1 -- 172.21.15.80:0/2669008108 reap_dead start 2019-11-28T11:58:34.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.084+0000 7fd01cecf700 1 -- 172.21.15.80:0/2669008108 shutdown_connections 2019-11-28T11:58:34.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.084+0000 7fd01cecf700 1 -- 172.21.15.80:0/2669008108 shutdown_connections 2019-11-28T11:58:34.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.084+0000 7fd01cecf700 1 -- 172.21.15.80:0/2669008108 wait complete. 2019-11-28T11:58:34.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.084+0000 7fd01cecf700 1 -- 172.21.15.80:0/2669008108 >> 172.21.15.80:0/2669008108 conn(0x7fd018061d20 msgr2=0x7fd0180641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:34.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.087+0000 7fd01cecf700 1 Processor -- start 2019-11-28T11:58:34.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.087+0000 7fd01cecf700 1 -- start start 2019-11-28T11:58:34.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd01cecf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd01812c2a0 0x7fd01812c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:34.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd01cecf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01810a310 con 0x7fd018108630 2019-11-28T11:58:34.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd01cecf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd018109e50 con 0x7fd0181510e0 2019-11-28T11:58:34.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd01cecf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01812ee80 con 0x7fd01812c2a0 2019-11-28T11:58:34.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd016d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd018108630 0x7fd018152260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46476/0 (socket says 172.21.15.80:46476) 2019-11-28T11:58:34.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd016d9d700 1 -- 172.21.15.80:0/2089668864 learned_addr learned my addr 172.21.15.80:0/2089668864 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:34.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd01659c700 1 --2- 172.21.15.80:0/2089668864 >> v2:172.21.15.174:3300/0 conn(0x7fd01812c2a0 0x7fd01812c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd00f7fe700 1 -- 172.21.15.80:0/2089668864 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028490283 0 0) 0x7fd008001060 con 0x7fd018108630 2019-11-28T11:58:34.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd00f7fe700 1 -- 172.21.15.80:0/2089668864 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcff0002e80 con 0x7fd018108630 2019-11-28T11:58:34.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd00f7fe700 1 -- 172.21.15.80:0/2089668864 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2466037599 0 0) 0x7fd008001190 con 0x7fd018108630 2019-11-28T11:58:34.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd00f7fe700 1 -- 172.21.15.80:0/2089668864 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcff00032e0 con 0x7fd018108630 2019-11-28T11:58:34.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd00f7fe700 1 -- 172.21.15.80:0/2089668864 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd008001780 con 0x7fd018108630 2019-11-28T11:58:34.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd01659c700 1 -- 172.21.15.80:0/2089668864 >> v1:172.21.15.174:6789/0 conn(0x7fd0181510e0 legacy=0x7fd018151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd01659c700 1 -- 172.21.15.80:0/2089668864 >> v1:172.21.15.80:6789/0 conn(0x7fd018108630 legacy=0x7fd018152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd01659c700 1 -- 172.21.15.80:0/2089668864 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd018133350 con 0x7fd01812c2a0 2019-11-28T11:58:34.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd01659c700 1 --2- 172.21.15.80:0/2089668864 >> v2:172.21.15.174:3300/0 conn(0x7fd01812c2a0 0x7fd01812c730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd000010390 tx=0x7fd000010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.088+0000 7fd01659c700 1 --2- 172.21.15.80:0/2089668864 >> v2:172.21.15.174:3300/0 conn(0x7fd01812c2a0 0x7fd01812c730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd000010390 tx=0x7fd000010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.089+0000 7fd01659c700 1 --2- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01812c2a0 0x7fd01812c730 secure :-1 s=READY pgs=1757 cs=0 l=1 rx=0x7fd000010390 tx=0x7fd000010730).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:34.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.089+0000 7fd01659c700 1 --2- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01812c2a0 0x7fd01812c730 secure :-1 s=THROTTLE_DONE pgs=1757 cs=0 l=1 rx=0x7fd000010390 tx=0x7fd000010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.089+0000 7fd00f7fe700 1 -- 172.21.15.80:0/2089668864 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd000009640 con 0x7fd01812c2a0 2019-11-28T11:58:34.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.089+0000 7fd01659c700 1 --2- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01812c2a0 0x7fd01812c730 secure :-1 s=THROTTLE_DONE pgs=1757 cs=0 l=1 rx=0x7fd000010390 tx=0x7fd000010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.089+0000 7fd01cecf700 1 -- 172.21.15.80:0/2089668864 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0181336d0 con 0x7fd01812c2a0 2019-11-28T11:58:34.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.089+0000 7fd00f7fe700 1 -- 172.21.15.80:0/2089668864 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd000000940 con 0x7fd01812c2a0 2019-11-28T11:58:34.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.089+0000 7fd01659c700 1 --2- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01812c2a0 0x7fd01812c730 secure :-1 s=THROTTLE_DONE pgs=1757 cs=0 l=1 rx=0x7fd000010390 tx=0x7fd000010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.089+0000 7fd00f7fe700 1 -- 172.21.15.80:0/2089668864 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd000009e50 con 0x7fd01812c2a0 2019-11-28T11:58:34.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.089+0000 7fd01cecf700 1 -- 172.21.15.80:0/2089668864 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd018133350 con 0x7fd01812c2a0 2019-11-28T11:58:34.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.089+0000 7fd01659c700 1 --2- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01812c2a0 0x7fd01812c730 secure :-1 s=THROTTLE_DONE pgs=1757 cs=0 l=1 rx=0x7fd000010390 tx=0x7fd000010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.089+0000 7fd00f7fe700 1 -- 172.21.15.80:0/2089668864 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd000009a70 con 0x7fd01812c2a0 2019-11-28T11:58:34.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.089+0000 7fd01659c700 1 --2- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01812c2a0 0x7fd01812c730 secure :-1 s=THROTTLE_DONE pgs=1757 cs=0 l=1 rx=0x7fd000010390 tx=0x7fd000010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.090+0000 7fd00f7fe700 1 --2- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcff0018770 0x7fcff001ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:34.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.090+0000 7fd00f7fe700 1 -- 172.21.15.80:0/2089668864 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd000031ac0 con 0x7fd01812c2a0 2019-11-28T11:58:34.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.090+0000 7fd016d9d700 1 --2- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcff0018770 0x7fcff001ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.090+0000 7fd016d9d700 1 --2- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcff0018770 0x7fcff001ac00 crc :-1 s=READY pgs=1204 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:34.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.097+0000 7fd01cecf700 1 -- 172.21.15.80:0/2089668864 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0181336d0 con 0x7fd01812c2a0 2019-11-28T11:58:34.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.101+0000 7fd01659c700 1 --2- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01812c2a0 0x7fd01812c730 secure :-1 s=THROTTLE_DONE pgs=1757 cs=0 l=1 rx=0x7fd000010390 tx=0x7fd000010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.101+0000 7fd00f7fe700 1 -- 172.21.15.80:0/2089668864 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd000009860 con 0x7fd01812c2a0 2019-11-28T11:58:34.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.266+0000 7fd01cecf700 1 -- 172.21.15.80:0/2089668864 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fd018133350 con 0x7fd01812c2a0 2019-11-28T11:58:34.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.267+0000 7fd01659c700 1 --2- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01812c2a0 0x7fd01812c730 secure :-1 s=THROTTLE_DONE pgs=1757 cs=0 l=1 rx=0x7fd000010390 tx=0x7fd000010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.267+0000 7fd00f7fe700 1 -- 172.21.15.80:0/2089668864 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v223) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd000009a70 con 0x7fd01812c2a0 2019-11-28T11:58:34.263 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:58:34.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.269+0000 7fd01cecf700 1 -- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcff0018770 msgr2=0x7fcff001ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.269+0000 7fd01cecf700 1 --2- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcff0018770 0x7fcff001ac00 crc :-1 s=READY pgs=1204 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:34.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.269+0000 7fd01cecf700 1 -- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01812c2a0 msgr2=0x7fd01812c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.269+0000 7fd01cecf700 1 --2- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01812c2a0 0x7fd01812c730 secure :-1 s=READY pgs=1757 cs=0 l=1 rx=0x7fd000010390 tx=0x7fd000010730).stop 2019-11-28T11:58:34.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.269+0000 7fd01cecf700 1 -- 172.21.15.80:0/2089668864 shutdown_connections 2019-11-28T11:58:34.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.269+0000 7fd01cecf700 1 --2- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcff0018770 0x7fcff001ac00 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:34.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.269+0000 7fd01cecf700 1 --2- 172.21.15.80:0/2089668864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd01812c2a0 0x7fd01812c730 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:34.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.269+0000 7fd01cecf700 1 -- 172.21.15.80:0/2089668864 shutdown_connections 2019-11-28T11:58:34.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.269+0000 7fd01cecf700 1 -- 172.21.15.80:0/2089668864 wait complete. 2019-11-28T11:58:34.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.269+0000 7fd01cecf700 1 -- 172.21.15.80:0/2089668864 >> 172.21.15.80:0/2089668864 conn(0x7fd01814dbb0 msgr2=0x7fd018142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:34.275 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:58:34.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.402+0000 7f6943247700 1 Processor -- start 2019-11-28T11:58:34.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.402+0000 7f6943247700 1 -- start start 2019-11-28T11:58:34.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.403+0000 7f6943247700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f693c15f100 0x7f693c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:34.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.403+0000 7f6943247700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f693c06c2f0 0x7f693c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:34.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.403+0000 7f6943247700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693c06db60 con 0x7f693c15ed10 2019-11-28T11:58:34.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.403+0000 7f6943247700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c06fe00 con 0x7f693c06c2f0 2019-11-28T11:58:34.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.403+0000 7f6943247700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c0700d0 con 0x7f693c15f100 2019-11-28T11:58:34.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.403+0000 7f6941fe5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f693c06c2f0 0x7f693c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.403+0000 7f6941fe5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f693c06c2f0 0x7f693c06c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47170/0 (socket says 172.21.15.80:47170) 2019-11-28T11:58:34.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.403+0000 7f6941fe5700 1 -- 172.21.15.80:0/533787721 learned_addr learned my addr 172.21.15.80:0/533787721 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:34.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.403+0000 7f6940fe3700 1 --2- 172.21.15.80:0/533787721 >> v2:172.21.15.174:3300/0 conn(0x7f693c15f100 0x7f693c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.403+0000 7f6941fe5700 1 -- 172.21.15.80:0/533787721 >> v2:172.21.15.174:3300/0 conn(0x7f693c15f100 msgr2=0x7f693c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:34.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.403+0000 7f6941fe5700 1 --2- 172.21.15.80:0/533787721 >> v2:172.21.15.174:3300/0 conn(0x7f693c15f100 0x7f693c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:34.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.403+0000 7f6941fe5700 1 -- 172.21.15.80:0/533787721 >> v1:172.21.15.174:6789/0 conn(0x7f693c15ed10 legacy=0x7f693c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.403+0000 7f6941fe5700 1 -- 172.21.15.80:0/533787721 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c070760 con 0x7f693c06c2f0 2019-11-28T11:58:34.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.403+0000 7f6941fe5700 1 --2- 172.21.15.80:0/533787721 >> v2:172.21.15.80:3300/0 conn(0x7f693c06c2f0 0x7f693c06c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f693400f6b0 tx=0x7f693400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.404+0000 7f6941fe5700 1 --2- 172.21.15.80:0/533787721 >> v2:172.21.15.80:3300/0 conn(0x7f693c06c2f0 0x7f693c06c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f693400f6b0 tx=0x7f693400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.404+0000 7f6941fe5700 1 --2- 172.21.15.80:0/533787721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c06c2f0 0x7f693c06c770 secure :-1 s=READY pgs=2905 cs=0 l=1 rx=0x7f693400f6b0 tx=0x7f693400fa50).ready entity=mon.0 client_cookie=434334c2d56e1350 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:34.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.404+0000 7f6941fe5700 1 --2- 172.21.15.80:0/533787721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c06c2f0 0x7f693c06c770 secure :-1 s=THROTTLE_DONE pgs=2905 cs=0 l=1 rx=0x7f693400f6b0 tx=0x7f693400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.404+0000 7f6941fe5700 1 --2- 172.21.15.80:0/533787721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c06c2f0 0x7f693c06c770 secure :-1 s=THROTTLE_DONE pgs=2905 cs=0 l=1 rx=0x7f693400f6b0 tx=0x7f693400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.404+0000 7f693bfff700 1 -- 172.21.15.80:0/533787721 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6934000a70 con 0x7f693c06c2f0 2019-11-28T11:58:34.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.404+0000 7f6941fe5700 1 --2- 172.21.15.80:0/533787721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c06c2f0 0x7f693c06c770 secure :-1 s=THROTTLE_DONE pgs=2905 cs=0 l=1 rx=0x7f693400f6b0 tx=0x7f693400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.404+0000 7f693bfff700 1 -- 172.21.15.80:0/533787721 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69340010e0 con 0x7f693c06c2f0 2019-11-28T11:58:34.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.404+0000 7f693bfff700 1 -- 172.21.15.80:0/533787721 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69340017b0 con 0x7f693c06c2f0 2019-11-28T11:58:34.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.404+0000 7f6943247700 1 -- 172.21.15.80:0/533787721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c06c2f0 msgr2=0x7f693c06c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.404+0000 7f6943247700 1 --2- 172.21.15.80:0/533787721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c06c2f0 0x7f693c06c770 secure :-1 s=READY pgs=2905 cs=0 l=1 rx=0x7f693400f6b0 tx=0x7f693400fa50).stop 2019-11-28T11:58:34.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.404+0000 7f6943247700 1 -- 172.21.15.80:0/533787721 shutdown_connections 2019-11-28T11:58:34.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.404+0000 7f6943247700 1 --2- 172.21.15.80:0/533787721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c06c2f0 0x7f693c06c770 unknown :-1 s=CLOSED pgs=2905 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:34.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.404+0000 7f6943247700 1 --2- 172.21.15.80:0/533787721 >> v2:172.21.15.174:3300/0 conn(0x7f693c15f100 0x7f693c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:34.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.405+0000 7f6943247700 1 -- 172.21.15.80:0/533787721 shutdown_connections 2019-11-28T11:58:34.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.405+0000 7f6943247700 1 -- 172.21.15.80:0/533787721 wait complete. 2019-11-28T11:58:34.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.405+0000 7f6943247700 1 -- 172.21.15.80:0/533787721 >> 172.21.15.80:0/533787721 conn(0x7f693c061d20 msgr2=0x7f693c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:34.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.407+0000 7f6943247700 1 Processor -- start 2019-11-28T11:58:34.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.407+0000 7f6943247700 1 -- start start 2019-11-28T11:58:34.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.408+0000 7f6943247700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f693c148320 0x7f693c10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:34.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.408+0000 7f6943247700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f693c10f290 0x7f693c10dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:34.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.408+0000 7f6943247700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f693c10e110 0x7f693c10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:34.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.408+0000 7f6943247700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c13aa20 con 0x7f693c10f290 2019-11-28T11:58:34.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.408+0000 7f6943247700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c13acf0 con 0x7f693c148320 2019-11-28T11:58:34.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.408+0000 7f6943247700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693c139ff0 con 0x7f693c10e110 2019-11-28T11:58:34.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.408+0000 7f6940fe3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f693c10f290 0x7f693c10dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.408+0000 7f6940fe3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f693c10f290 0x7f693c10dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47176/0 (socket says 172.21.15.80:47176) 2019-11-28T11:58:34.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.408+0000 7f6940fe3700 1 -- 172.21.15.80:0/711854321 learned_addr learned my addr 172.21.15.80:0/711854321 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:34.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.408+0000 7f69417e4700 1 --2- 172.21.15.80:0/711854321 >> v2:172.21.15.174:3300/0 conn(0x7f693c148320 0x7f693c10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.408+0000 7f6941fe5700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f693c10e110 0x7f693c10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.408+0000 7f6940fe3700 1 -- 172.21.15.80:0/711854321 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f693c10e110 msgr2=0x7f693c10e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6940fe3700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f693c10e110 0x7f693c10e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:34.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6940fe3700 1 -- 172.21.15.80:0/711854321 >> v2:172.21.15.174:3300/0 conn(0x7f693c148320 msgr2=0x7f693c10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6940fe3700 1 --2- 172.21.15.80:0/711854321 >> v2:172.21.15.174:3300/0 conn(0x7f693c148320 0x7f693c10ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:34.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6940fe3700 1 -- 172.21.15.80:0/711854321 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c10c490 con 0x7f693c10f290 2019-11-28T11:58:34.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6940fe3700 1 --2- 172.21.15.80:0/711854321 >> v2:172.21.15.80:3300/0 conn(0x7f693c10f290 0x7f693c10dbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f692c010490 tx=0x7f692c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6940fe3700 1 --2- 172.21.15.80:0/711854321 >> v2:172.21.15.80:3300/0 conn(0x7f693c10f290 0x7f693c10dbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f692c010490 tx=0x7f692c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6940fe3700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c10f290 0x7f693c10dbd0 secure :-1 s=READY pgs=2906 cs=0 l=1 rx=0x7f692c010490 tx=0x7f692c010310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:34.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6940fe3700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c10f290 0x7f693c10dbd0 secure :-1 s=THROTTLE_DONE pgs=2906 cs=0 l=1 rx=0x7f692c010490 tx=0x7f692c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6940fe3700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c10f290 0x7f693c10dbd0 secure :-1 s=THROTTLE_DONE pgs=2906 cs=0 l=1 rx=0x7f692c010490 tx=0x7f692c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6940fe3700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c10f290 0x7f693c10dbd0 secure :-1 s=THROTTLE_DONE pgs=2906 cs=0 l=1 rx=0x7f692c010490 tx=0x7f692c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6939ffb700 1 -- 172.21.15.80:0/711854321 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f692c009790 con 0x7f693c10f290 2019-11-28T11:58:34.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6939ffb700 1 -- 172.21.15.80:0/711854321 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692c000980 con 0x7f693c10f290 2019-11-28T11:58:34.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6943247700 1 -- 172.21.15.80:0/711854321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693c10c810 con 0x7f693c10f290 2019-11-28T11:58:34.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6939ffb700 1 -- 172.21.15.80:0/711854321 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f692c009d70 con 0x7f693c10f290 2019-11-28T11:58:34.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6943247700 1 -- 172.21.15.80:0/711854321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693c10c490 con 0x7f693c10f290 2019-11-28T11:58:34.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6940fe3700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c10f290 0x7f693c10dbd0 secure :-1 s=THROTTLE_DONE pgs=2906 cs=0 l=1 rx=0x7f692c010490 tx=0x7f692c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6939ffb700 1 -- 172.21.15.80:0/711854321 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f692c00a2e0 con 0x7f693c10f290 2019-11-28T11:58:34.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.409+0000 7f6940fe3700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c10f290 0x7f693c10dbd0 secure :-1 s=THROTTLE_DONE pgs=2906 cs=0 l=1 rx=0x7f692c010490 tx=0x7f692c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.410+0000 7f6939ffb700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6920018730 0x7f692001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:34.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.410+0000 7f6939ffb700 1 -- 172.21.15.80:0/711854321 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f692c031c50 con 0x7f693c10f290 2019-11-28T11:58:34.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.410+0000 7f69417e4700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6920018730 0x7f692001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.410+0000 7f69417e4700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6920018730 0x7f692001abc0 crc :-1 s=READY pgs=1205 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:34.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.417+0000 7f6943247700 1 -- 172.21.15.80:0/711854321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693c10c810 con 0x7f693c10f290 2019-11-28T11:58:34.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.421+0000 7f6940fe3700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c10f290 0x7f693c10dbd0 secure :-1 s=THROTTLE_DONE pgs=2906 cs=0 l=1 rx=0x7f692c010490 tx=0x7f692c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.421+0000 7f6939ffb700 1 -- 172.21.15.80:0/711854321 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f692c009f20 con 0x7f693c10f290 2019-11-28T11:58:34.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.586+0000 7f6943247700 1 -- 172.21.15.80:0/711854321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f693c10c490 con 0x7f693c10f290 2019-11-28T11:58:34.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.586+0000 7f6940fe3700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c10f290 0x7f693c10dbd0 secure :-1 s=THROTTLE_DONE pgs=2906 cs=0 l=1 rx=0x7f692c010490 tx=0x7f692c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.586+0000 7f6939ffb700 1 -- 172.21.15.80:0/711854321 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v223) v1 ==== 104+0+10 (secure 0 0 0) 0x7f692c00a130 con 0x7f693c10f290 2019-11-28T11:58:34.583 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:58:34.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.588+0000 7f6943247700 1 -- 172.21.15.80:0/711854321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6920018730 msgr2=0x7f692001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.588+0000 7f6943247700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6920018730 0x7f692001abc0 crc :-1 s=READY pgs=1205 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:34.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.588+0000 7f6943247700 1 -- 172.21.15.80:0/711854321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c10f290 msgr2=0x7f693c10dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.588+0000 7f6943247700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c10f290 0x7f693c10dbd0 secure :-1 s=READY pgs=2906 cs=0 l=1 rx=0x7f692c010490 tx=0x7f692c010310).stop 2019-11-28T11:58:34.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.589+0000 7f6943247700 1 -- 172.21.15.80:0/711854321 shutdown_connections 2019-11-28T11:58:34.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.589+0000 7f6943247700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6920018730 0x7f692001abc0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:34.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.589+0000 7f6943247700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f693c10e110 0x7f693c10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:34.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.589+0000 7f6943247700 1 --2- 172.21.15.80:0/711854321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f693c10f290 0x7f693c10dbd0 unknown :-1 s=CLOSED pgs=2906 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:34.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.589+0000 7f6943247700 1 --2- 172.21.15.80:0/711854321 >> v2:172.21.15.174:3300/0 conn(0x7f693c148320 0x7f693c10ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:34.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.589+0000 7f6943247700 1 -- 172.21.15.80:0/711854321 shutdown_connections 2019-11-28T11:58:34.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.589+0000 7f6943247700 1 -- 172.21.15.80:0/711854321 wait complete. 2019-11-28T11:58:34.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.589+0000 7f6943247700 1 -- 172.21.15.80:0/711854321 >> 172.21.15.80:0/711854321 conn(0x7f693c15e2d0 msgr2=0x7f693c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:34.594 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:58:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.721+0000 7fca093d4700 1 Processor -- start 2019-11-28T11:58:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.721+0000 7fca093d4700 1 -- start start 2019-11-28T11:58:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.722+0000 7fca093d4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0415f100 0x7fca0406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.722+0000 7fca093d4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fca0406c2f0 0x7fca0406c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:34.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.722+0000 7fca093d4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0406db60 con 0x7fca0415ed10 2019-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.722+0000 7fca093d4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0406fe00 con 0x7fca0406c2f0 2019-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.722+0000 7fca093d4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca040700d0 con 0x7fca0415f100 2019-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.722+0000 7fca037fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fca0415ed10 0x7fca04073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46498/0 (socket says 172.21.15.80:46498) 2019-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.722+0000 7fca037fe700 1 -- 172.21.15.80:0/607212974 learned_addr learned my addr 172.21.15.80:0/607212974 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.722+0000 7fca027fc700 1 -- 172.21.15.80:0/607212974 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995821178 0 0) 0x7fc9f4001150 con 0x7fca0415ed10 2019-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.722+0000 7fca02ffd700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0415f100 0x7fca0406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.722+0000 7fca027fc700 1 -- 172.21.15.80:0/607212974 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9e4002e80 con 0x7fca0415ed10 2019-11-28T11:58:34.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.722+0000 7fca03fff700 1 --2- 172.21.15.80:0/607212974 >> v2:172.21.15.174:3300/0 conn(0x7fca0406c2f0 0x7fca0406c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 -- 172.21.15.80:0/607212974 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 66178694 0 0) 0x7fc9f4001130 con 0x7fca0415ed10 2019-11-28T11:58:34.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 -- 172.21.15.80:0/607212974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0415f100 msgr2=0x7fca0406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:34.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0415f100 0x7fca0406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:34.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 -- 172.21.15.80:0/607212974 >> v2:172.21.15.174:3300/0 conn(0x7fca0406c2f0 msgr2=0x7fca0406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:34.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 --2- 172.21.15.80:0/607212974 >> v2:172.21.15.174:3300/0 conn(0x7fca0406c2f0 0x7fca0406c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:34.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 -- 172.21.15.80:0/607212974 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca04070760 con 0x7fca0415ed10 2019-11-28T11:58:34.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 -- 172.21.15.80:0/607212974 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc9f40016c0 con 0x7fca0415ed10 2019-11-28T11:58:34.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 -- 172.21.15.80:0/607212974 >> v1:172.21.15.80:6789/0 conn(0x7fca0415ed10 legacy=0x7fca04073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e40479e0 0x7fc9e4049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:34.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9e404a5f0 0x7fc9e404ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:34.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9e404d270 0x7fc9e404f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:34.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 -- 172.21.15.80:0/607212974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e404ff50 con 0x7fc9e40479e0 2019-11-28T11:58:34.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 -- 172.21.15.80:0/607212974 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e4050140 con 0x7fc9e404d270 2019-11-28T11:58:34.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 -- 172.21.15.80:0/607212974 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e4050370 con 0x7fc9e404a5f0 2019-11-28T11:58:34.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca037fe700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e40479e0 0x7fc9e4049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca03fff700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9e404d270 0x7fc9e404f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca02ffd700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9e404a5f0 0x7fc9e404ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca037fe700 1 -- 172.21.15.80:0/607212974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9e404a5f0 msgr2=0x7fc9e404ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:34.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca037fe700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9e404a5f0 0x7fc9e404ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca037fe700 1 -- 172.21.15.80:0/607212974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9e404d270 msgr2=0x7fc9e404f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca037fe700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9e404d270 0x7fc9e404f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca037fe700 1 -- 172.21.15.80:0/607212974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e4050620 con 0x7fc9e40479e0 2019-11-28T11:58:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca03fff700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9e404d270 0x7fc9e404f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:58:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca037fe700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e40479e0 0x7fc9e4049e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc9f400f890 tx=0x7fc9f400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca037fe700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e40479e0 0x7fc9e4049e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc9f400f890 tx=0x7fc9f400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca037fe700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e40479e0 0x7fc9e4049e40 secure :-1 s=READY pgs=2908 cs=0 l=1 rx=0x7fc9f400f890 tx=0x7fc9f400f790).ready entity=mon.0 client_cookie=c6ae7da338be1667 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca037fe700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e40479e0 0x7fc9e4049e40 secure :-1 s=THROTTLE_DONE pgs=2908 cs=0 l=1 rx=0x7fc9f400f890 tx=0x7fc9f400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 -- 172.21.15.80:0/607212974 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9f4001500 con 0x7fc9e40479e0 2019-11-28T11:58:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca037fe700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e40479e0 0x7fc9e4049e40 secure :-1 s=THROTTLE_DONE pgs=2908 cs=0 l=1 rx=0x7fc9f400f890 tx=0x7fc9f400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca037fe700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e40479e0 0x7fc9e4049e40 secure :-1 s=THROTTLE_DONE pgs=2908 cs=0 l=1 rx=0x7fc9f400f890 tx=0x7fc9f400f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 -- 172.21.15.80:0/607212974 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f4004240 con 0x7fc9e40479e0 2019-11-28T11:58:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca027fc700 1 -- 172.21.15.80:0/607212974 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9f4004950 con 0x7fc9e40479e0 2019-11-28T11:58:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca093d4700 1 -- 172.21.15.80:0/607212974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e40479e0 msgr2=0x7fc9e4049e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca093d4700 1 --2- 172.21.15.80:0/607212974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9e40479e0 0x7fc9e4049e40 secure :-1 s=READY pgs=2908 cs=0 l=1 rx=0x7fc9f400f890 tx=0x7fc9f400f790).stop 2019-11-28T11:58:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.723+0000 7fca03fff700 1 -- 172.21.15.80:0/607212974 reap_dead start 2019-11-28T11:58:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.724+0000 7fca093d4700 1 -- 172.21.15.80:0/607212974 shutdown_connections 2019-11-28T11:58:34.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.724+0000 7fca093d4700 1 -- 172.21.15.80:0/607212974 shutdown_connections 2019-11-28T11:58:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.724+0000 7fca093d4700 1 -- 172.21.15.80:0/607212974 wait complete. 2019-11-28T11:58:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.724+0000 7fca093d4700 1 -- 172.21.15.80:0/607212974 >> 172.21.15.80:0/607212974 conn(0x7fca04061d20 msgr2=0x7fca040641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.726+0000 7fca093d4700 1 Processor -- start 2019-11-28T11:58:34.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.727+0000 7fca093d4700 1 -- start start 2019-11-28T11:58:34.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.727+0000 7fca093d4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca041502e0 0x7fca04150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:34.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fca093d4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca04133a20 con 0x7fca04150cb0 2019-11-28T11:58:34.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fca093d4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca04109fc0 con 0x7fca04108630 2019-11-28T11:58:34.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fca093d4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca04131980 con 0x7fca041502e0 2019-11-28T11:58:34.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fca03fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fca04150cb0 0x7fca04167d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46514/0 (socket says 172.21.15.80:46514) 2019-11-28T11:58:34.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fca03fff700 1 -- 172.21.15.80:0/176625653 learned_addr learned my addr 172.21.15.80:0/176625653 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:34.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fca02ffd700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca041502e0 0x7fca04150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fc9fbfff700 1 -- 172.21.15.80:0/176625653 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460418374 0 0) 0x7fc9fc0095b0 con 0x7fca04150cb0 2019-11-28T11:58:34.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fc9fbfff700 1 -- 172.21.15.80:0/176625653 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9dc002e80 con 0x7fca04150cb0 2019-11-28T11:58:34.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fc9fbfff700 1 -- 172.21.15.80:0/176625653 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008925225 0 0) 0x7fc9f40014d0 con 0x7fca04108630 2019-11-28T11:58:34.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fc9fbfff700 1 -- 172.21.15.80:0/176625653 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9dc0030b0 con 0x7fca04108630 2019-11-28T11:58:34.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fca02ffd700 1 -- 172.21.15.80:0/176625653 >> v1:172.21.15.174:6789/0 conn(0x7fca04108630 legacy=0x7fca04151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fca02ffd700 1 -- 172.21.15.80:0/176625653 >> v1:172.21.15.80:6789/0 conn(0x7fca04150cb0 legacy=0x7fca04167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fc9fbfff700 1 -- 172.21.15.80:0/176625653 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2804136343 0 0) 0x7fc9fc000a70 con 0x7fca04150cb0 2019-11-28T11:58:34.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fca02ffd700 1 -- 172.21.15.80:0/176625653 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca041322e0 con 0x7fca041502e0 2019-11-28T11:58:34.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fca02ffd700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca041502e0 0x7fca04150770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9ec010710 tx=0x7fc9ec010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fca02ffd700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca041502e0 0x7fca04150770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9ec010710 tx=0x7fc9ec010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fca02ffd700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca041502e0 0x7fca04150770 secure :-1 s=READY pgs=422 cs=0 l=1 rx=0x7fc9ec010710 tx=0x7fc9ec010ab0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:34.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fca02ffd700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca041502e0 0x7fca04150770 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc9ec010710 tx=0x7fc9ec010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fc9fbfff700 1 -- 172.21.15.80:0/176625653 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9ec000ce0 con 0x7fca041502e0 2019-11-28T11:58:34.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fca02ffd700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca041502e0 0x7fca04150770 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc9ec010710 tx=0x7fc9ec010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fc9fbfff700 1 -- 172.21.15.80:0/176625653 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec009d70 con 0x7fca041502e0 2019-11-28T11:58:34.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.728+0000 7fca02ffd700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca041502e0 0x7fca04150770 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc9ec010710 tx=0x7fc9ec010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.729+0000 7fc9fbfff700 1 -- 172.21.15.80:0/176625653 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9ec009f60 con 0x7fca041502e0 2019-11-28T11:58:34.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.729+0000 7fca093d4700 1 -- 172.21.15.80:0/176625653 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca04132660 con 0x7fca041502e0 2019-11-28T11:58:34.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.729+0000 7fca093d4700 1 -- 172.21.15.80:0/176625653 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca041322e0 con 0x7fca041502e0 2019-11-28T11:58:34.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.729+0000 7fca02ffd700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca041502e0 0x7fca04150770 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc9ec010710 tx=0x7fc9ec010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.729+0000 7fc9fbfff700 1 -- 172.21.15.80:0/176625653 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc9ec009970 con 0x7fca041502e0 2019-11-28T11:58:34.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.729+0000 7fca02ffd700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca041502e0 0x7fca04150770 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc9ec010710 tx=0x7fc9ec010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.729+0000 7fc9fbfff700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9dc018750 0x7fc9dc01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:34.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.729+0000 7fc9fbfff700 1 -- 172.21.15.80:0/176625653 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fc9ec031de0 con 0x7fca041502e0 2019-11-28T11:58:34.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.730+0000 7fca037fe700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9dc018750 0x7fc9dc01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:34.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.730+0000 7fca037fe700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9dc018750 0x7fc9dc01abe0 crc :-1 s=READY pgs=1206 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:34.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.736+0000 7fca093d4700 1 -- 172.21.15.80:0/176625653 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca04132660 con 0x7fca041502e0 2019-11-28T11:58:34.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.740+0000 7fca02ffd700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca041502e0 0x7fca04150770 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc9ec010710 tx=0x7fc9ec010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.740+0000 7fc9fbfff700 1 -- 172.21.15.80:0/176625653 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc9ec009970 con 0x7fca041502e0 2019-11-28T11:58:34.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.906+0000 7fca093d4700 1 -- 172.21.15.80:0/176625653 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fca041322e0 con 0x7fca041502e0 2019-11-28T11:58:34.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.906+0000 7fca02ffd700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca041502e0 0x7fca04150770 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7fc9ec010710 tx=0x7fc9ec010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:34.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.906+0000 7fc9fbfff700 1 -- 172.21.15.80:0/176625653 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v223) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc9ec009b80 con 0x7fca041502e0 2019-11-28T11:58:34.903 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:58:34.905 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.908+0000 7fca093d4700 1 -- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9dc018750 msgr2=0x7fc9dc01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.908+0000 7fca093d4700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9dc018750 0x7fc9dc01abe0 crc :-1 s=READY pgs=1206 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:34.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.908+0000 7fca093d4700 1 -- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca041502e0 msgr2=0x7fca04150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:34.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.908+0000 7fca093d4700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca041502e0 0x7fca04150770 secure :-1 s=READY pgs=422 cs=0 l=1 rx=0x7fc9ec010710 tx=0x7fc9ec010ab0).stop 2019-11-28T11:58:34.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.908+0000 7fca093d4700 1 -- 172.21.15.80:0/176625653 shutdown_connections 2019-11-28T11:58:34.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.908+0000 7fca093d4700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca041502e0 0x7fca04150770 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:34.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.908+0000 7fca093d4700 1 --2- 172.21.15.80:0/176625653 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc9dc018750 0x7fc9dc01abe0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:34.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.909+0000 7fca093d4700 1 -- 172.21.15.80:0/176625653 shutdown_connections 2019-11-28T11:58:34.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.909+0000 7fca093d4700 1 -- 172.21.15.80:0/176625653 wait complete. 2019-11-28T11:58:34.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:34.909+0000 7fca093d4700 1 -- 172.21.15.80:0/176625653 >> 172.21.15.80:0/176625653 conn(0x7fca0414dbb0 msgr2=0x7fca04142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:34.915 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:58:34.915 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:58:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.038+0000 7f80aa813700 1 Processor -- start 2019-11-28T11:58:35.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.038+0000 7f80aa813700 1 -- start start 2019-11-28T11:58:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.039+0000 7f80aa813700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f80a406c0a0 0x7f80a4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.039+0000 7f80aa813700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a406db00 con 0x7f80a40734e0 2019-11-28T11:58:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.039+0000 7f80aa813700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a406e000 con 0x7f80a4072620 2019-11-28T11:58:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.039+0000 7f80aa813700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a406fd60 con 0x7f80a406c0a0 2019-11-28T11:58:35.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.039+0000 7f80a3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f80a40734e0 0x7f80a4071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46518/0 (socket says 172.21.15.80:46518) 2019-11-28T11:58:35.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.039+0000 7f80a3fff700 1 -- 172.21.15.80:0/4080902122 learned_addr learned my addr 172.21.15.80:0/4080902122 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:35.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a8db0700 1 --2- 172.21.15.80:0/4080902122 >> v2:172.21.15.174:3300/0 conn(0x7f80a406c0a0 0x7f80a4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:35.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a37fe700 1 -- 172.21.15.80:0/4080902122 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68318676 0 0) 0x7f8094001150 con 0x7f80a40734e0 2019-11-28T11:58:35.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a37fe700 1 -- 172.21.15.80:0/4080902122 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8090002e80 con 0x7f80a40734e0 2019-11-28T11:58:35.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a37fe700 1 -- 172.21.15.80:0/4080902122 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 167443547 0 0) 0x7f8094001130 con 0x7f80a40734e0 2019-11-28T11:58:35.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a37fe700 1 -- 172.21.15.80:0/4080902122 >> v2:172.21.15.174:3300/0 conn(0x7f80a406c0a0 msgr2=0x7f80a4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:35.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a37fe700 1 --2- 172.21.15.80:0/4080902122 >> v2:172.21.15.174:3300/0 conn(0x7f80a406c0a0 0x7f80a4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:35.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a37fe700 1 -- 172.21.15.80:0/4080902122 >> v1:172.21.15.174:6789/0 conn(0x7f80a4072620 legacy=0x7f80a4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:35.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a37fe700 1 -- 172.21.15.80:0/4080902122 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a40706c0 con 0x7f80a40734e0 2019-11-28T11:58:35.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a37fe700 1 -- 172.21.15.80:0/4080902122 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f8094001660 con 0x7f80a40734e0 2019-11-28T11:58:35.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a37fe700 1 -- 172.21.15.80:0/4080902122 >> v1:172.21.15.80:6789/0 conn(0x7f80a40734e0 legacy=0x7f80a4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:35.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a37fe700 1 --2- 172.21.15.80:0/4080902122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8090003ab0 0x7f8090005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:35.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a37fe700 1 --2- 172.21.15.80:0/4080902122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8090006690 0x7f8090008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:35.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a37fe700 1 --2- 172.21.15.80:0/4080902122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090009380 0x7f809000b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:35.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a37fe700 1 -- 172.21.15.80:0/4080902122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809000c000 con 0x7f8090009380 2019-11-28T11:58:35.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a37fe700 1 -- 172.21.15.80:0/4080902122 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8090050200 con 0x7f8090003ab0 2019-11-28T11:58:35.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a37fe700 1 -- 172.21.15.80:0/4080902122 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8090050430 con 0x7f8090006690 2019-11-28T11:58:35.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a95b1700 1 --2- 172.21.15.80:0/4080902122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090009380 0x7f809000b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:35.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a3fff700 1 --2- 172.21.15.80:0/4080902122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8090006690 0x7f8090008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:35.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a8db0700 1 --2- 172.21.15.80:0/4080902122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8090003ab0 0x7f8090005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:35.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a95b1700 1 -- 172.21.15.80:0/4080902122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8090006690 msgr2=0x7f8090008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:35.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a95b1700 1 --2- 172.21.15.80:0/4080902122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8090006690 0x7f8090008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:35.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a95b1700 1 -- 172.21.15.80:0/4080902122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8090003ab0 msgr2=0x7f8090005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:35.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a95b1700 1 --2- 172.21.15.80:0/4080902122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8090003ab0 0x7f8090005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:35.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.040+0000 7f80a95b1700 1 -- 172.21.15.80:0/4080902122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80900506e0 con 0x7f8090009380 2019-11-28T11:58:35.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80a95b1700 1 --2- 172.21.15.80:0/4080902122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090009380 0x7f809000b850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f809c00b2d0 tx=0x7f809c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:35.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80a95b1700 1 -- 172.21.15.80:0/4080902122 reap_dead start 2019-11-28T11:58:35.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80a95b1700 1 --2- 172.21.15.80:0/4080902122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090009380 0x7f809000b850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f809c00b2d0 tx=0x7f809c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:35.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80a95b1700 1 --2- 172.21.15.80:0/4080902122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090009380 0x7f809000b850 secure :-1 s=READY pgs=2911 cs=0 l=1 rx=0x7f809c00b2d0 tx=0x7f809c00b5d0).ready entity=mon.0 client_cookie=754bf117445477db server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:35.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80a95b1700 1 --2- 172.21.15.80:0/4080902122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090009380 0x7f809000b850 secure :-1 s=THROTTLE_DONE pgs=2911 cs=0 l=1 rx=0x7f809c00b2d0 tx=0x7f809c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:35.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80a95b1700 1 --2- 172.21.15.80:0/4080902122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090009380 0x7f809000b850 secure :-1 s=THROTTLE_DONE pgs=2911 cs=0 l=1 rx=0x7f809c00b2d0 tx=0x7f809c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:35.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80a37fe700 1 -- 172.21.15.80:0/4080902122 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f809c009ef0 con 0x7f8090009380 2019-11-28T11:58:35.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80a95b1700 1 --2- 172.21.15.80:0/4080902122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090009380 0x7f809000b850 secure :-1 s=THROTTLE_DONE pgs=2911 cs=0 l=1 rx=0x7f809c00b2d0 tx=0x7f809c00b5d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:35.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80a37fe700 1 -- 172.21.15.80:0/4080902122 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c000d30 con 0x7f8090009380 2019-11-28T11:58:35.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80a37fe700 1 -- 172.21.15.80:0/4080902122 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f809c00a4d0 con 0x7f8090009380 2019-11-28T11:58:35.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80aa813700 1 -- 172.21.15.80:0/4080902122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090009380 msgr2=0x7f809000b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:35.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80aa813700 1 --2- 172.21.15.80:0/4080902122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090009380 0x7f809000b850 secure :-1 s=READY pgs=2911 cs=0 l=1 rx=0x7f809c00b2d0 tx=0x7f809c00b5d0).stop 2019-11-28T11:58:35.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80aa813700 1 -- 172.21.15.80:0/4080902122 shutdown_connections 2019-11-28T11:58:35.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80aa813700 1 --2- 172.21.15.80:0/4080902122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8090009380 0x7f809000b850 unknown :-1 s=CLOSED pgs=2911 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:35.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80aa813700 1 -- 172.21.15.80:0/4080902122 shutdown_connections 2019-11-28T11:58:35.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80aa813700 1 -- 172.21.15.80:0/4080902122 wait complete. 2019-11-28T11:58:35.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.041+0000 7f80aa813700 1 -- 172.21.15.80:0/4080902122 >> 172.21.15.80:0/4080902122 conn(0x7f80a4061cf0 msgr2=0x7f80a4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:35.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.044+0000 7f80aa813700 1 Processor -- start 2019-11-28T11:58:35.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.044+0000 7f80aa813700 1 -- start start 2019-11-28T11:58:35.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80aa813700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80a4074d00 0x7f80a40750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80aa813700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f80a4152bd0 0x7f80a4140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80aa813700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a4079230 con 0x7f80a4153040 2019-11-28T11:58:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80aa813700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a407ab30 con 0x7f80a4074d00 2019-11-28T11:58:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80aa813700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a407ae00 con 0x7f80a4152bd0 2019-11-28T11:58:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80a8db0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80a4074d00 0x7f80a40750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:35.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80a8db0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80a4074d00 0x7f80a40750f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47214/0 (socket says 172.21.15.80:47214) 2019-11-28T11:58:35.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80a8db0700 1 -- 172.21.15.80:0/1636415000 learned_addr learned my addr 172.21.15.80:0/1636415000 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:35.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80a3fff700 1 --2- 172.21.15.80:0/1636415000 >> v2:172.21.15.174:3300/0 conn(0x7f80a4152bd0 0x7f80a4140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:35.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80a8db0700 1 -- 172.21.15.80:0/1636415000 >> v2:172.21.15.174:3300/0 conn(0x7f80a4152bd0 msgr2=0x7f80a4140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:35.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80a8db0700 1 --2- 172.21.15.80:0/1636415000 >> v2:172.21.15.174:3300/0 conn(0x7f80a4152bd0 0x7f80a4140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:35.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80a8db0700 1 -- 172.21.15.80:0/1636415000 >> v1:172.21.15.174:6789/0 conn(0x7f80a4153040 legacy=0x7f80a4140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:35.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80a8db0700 1 -- 172.21.15.80:0/1636415000 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a407b490 con 0x7f80a4074d00 2019-11-28T11:58:35.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80a3fff700 1 --2- 172.21.15.80:0/1636415000 >> v2:172.21.15.174:3300/0 conn(0x7f80a4152bd0 0x7f80a4140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:58:35.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80a8db0700 1 --2- 172.21.15.80:0/1636415000 >> v2:172.21.15.80:3300/0 conn(0x7f80a4074d00 0x7f80a40750f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f808c010450 tx=0x7f808c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:35.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80a8db0700 1 --2- 172.21.15.80:0/1636415000 >> v2:172.21.15.80:3300/0 conn(0x7f80a4074d00 0x7f80a40750f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f808c010450 tx=0x7f808c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:35.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80a8db0700 1 --2- 172.21.15.80:0/1636415000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a4074d00 0x7f80a40750f0 secure :-1 s=READY pgs=2912 cs=0 l=1 rx=0x7f808c010450 tx=0x7f808c0107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:35.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80a8db0700 1 --2- 172.21.15.80:0/1636415000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a4074d00 0x7f80a40750f0 secure :-1 s=THROTTLE_DONE pgs=2912 cs=0 l=1 rx=0x7f808c010450 tx=0x7f808c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:35.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.045+0000 7f80a17fa700 1 -- 172.21.15.80:0/1636415000 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f808c000940 con 0x7f80a4074d00 2019-11-28T11:58:35.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.046+0000 7f80a8db0700 1 --2- 172.21.15.80:0/1636415000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a4074d00 0x7f80a40750f0 secure :-1 s=THROTTLE_DONE pgs=2912 cs=0 l=1 rx=0x7f808c010450 tx=0x7f808c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:35.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.046+0000 7f80a8db0700 1 --2- 172.21.15.80:0/1636415000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a4074d00 0x7f80a40750f0 secure :-1 s=THROTTLE_DONE pgs=2912 cs=0 l=1 rx=0x7f808c010450 tx=0x7f808c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:35.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.046+0000 7f80a17fa700 1 -- 172.21.15.80:0/1636415000 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c005580 con 0x7f80a4074d00 2019-11-28T11:58:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.046+0000 7f80a17fa700 1 -- 172.21.15.80:0/1636415000 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f808c005770 con 0x7f80a4074d00 2019-11-28T11:58:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.046+0000 7f80aa813700 1 -- 172.21.15.80:0/1636415000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a407b810 con 0x7f80a4074d00 2019-11-28T11:58:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.046+0000 7f80aa813700 1 -- 172.21.15.80:0/1636415000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a407b490 con 0x7f80a4074d00 2019-11-28T11:58:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.046+0000 7f80a8db0700 1 --2- 172.21.15.80:0/1636415000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a4074d00 0x7f80a40750f0 secure :-1 s=THROTTLE_DONE pgs=2912 cs=0 l=1 rx=0x7f808c010450 tx=0x7f808c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:35.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.046+0000 7f80a17fa700 1 -- 172.21.15.80:0/1636415000 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f808c005770 con 0x7f80a4074d00 2019-11-28T11:58:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.046+0000 7f80a8db0700 1 --2- 172.21.15.80:0/1636415000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a4074d00 0x7f80a40750f0 secure :-1 s=THROTTLE_DONE pgs=2912 cs=0 l=1 rx=0x7f808c010450 tx=0x7f808c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.046+0000 7f80a17fa700 1 --2- 172.21.15.80:0/1636415000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8088018730 0x7f808801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.046+0000 7f80a17fa700 1 -- 172.21.15.80:0/1636415000 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f808c031d60 con 0x7f80a4074d00 2019-11-28T11:58:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.046+0000 7f80a3fff700 1 --2- 172.21.15.80:0/1636415000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8088018730 0x7f808801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:35.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.047+0000 7f80a3fff700 1 --2- 172.21.15.80:0/1636415000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8088018730 0x7f808801abc0 crc :-1 s=READY pgs=1207 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.054+0000 7f80aa813700 1 -- 172.21.15.80:0/1636415000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a407b810 con 0x7f80a4074d00 2019-11-28T11:58:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.057+0000 7f80a8db0700 1 --2- 172.21.15.80:0/1636415000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a4074d00 0x7f80a40750f0 secure :-1 s=THROTTLE_DONE pgs=2912 cs=0 l=1 rx=0x7f808c010450 tx=0x7f808c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:35.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.057+0000 7f80a17fa700 1 -- 172.21.15.80:0/1636415000 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f808c005180 con 0x7f80a4074d00 2019-11-28T11:58:35.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.229+0000 7f80aa813700 1 -- 172.21.15.80:0/1636415000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80a407b490 con 0x7f80a4074d00 2019-11-28T11:58:35.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.230+0000 7f80a8db0700 1 --2- 172.21.15.80:0/1636415000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a4074d00 0x7f80a40750f0 secure :-1 s=THROTTLE_DONE pgs=2912 cs=0 l=1 rx=0x7f808c010450 tx=0x7f808c0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:35.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.230+0000 7f80a17fa700 1 -- 172.21.15.80:0/1636415000 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 186 v186) v1 ==== 95+0+2457 (secure 0 0 0) 0x7f808c005460 con 0x7f80a4074d00 2019-11-28T11:58:35.227 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 186 2019-11-28T11:58:35.227 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:35.228 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":186,"default_fscid":18,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":11665,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/3051174059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3051174059},{"type":"v1","addr":"172.21.15.174:6835","nonce":3051174059}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":184},{"gid":12435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2096320481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2096320481},{"type":"v1","addr":"172.21.15.80:6834","nonce":2096320481}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":184}],"filesystems":[{"mdsmap":{"epoch":186,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:58:24.286894+0000","modified":"2019-11-28T11:58:31.978284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8138":{"gid":8138,"name":"a","rank":0,"incarnation":185,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6835/4148152245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":4148152245},{"type":"v1","addr":"172.21.15.80:6835","nonce":4148152245}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[37],"metadata_pool":36,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":18}]} 2019-11-28T11:58:35.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.232+0000 7f80aa813700 1 -- 172.21.15.80:0/1636415000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8088018730 msgr2=0x7f808801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:35.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.232+0000 7f80aa813700 1 --2- 172.21.15.80:0/1636415000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8088018730 0x7f808801abc0 crc :-1 s=READY pgs=1207 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:35.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.232+0000 7f80aa813700 1 -- 172.21.15.80:0/1636415000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a4074d00 msgr2=0x7f80a40750f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:35.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.232+0000 7f80aa813700 1 --2- 172.21.15.80:0/1636415000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a4074d00 0x7f80a40750f0 secure :-1 s=READY pgs=2912 cs=0 l=1 rx=0x7f808c010450 tx=0x7f808c0107f0).stop 2019-11-28T11:58:35.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.232+0000 7f80aa813700 1 -- 172.21.15.80:0/1636415000 shutdown_connections 2019-11-28T11:58:35.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.232+0000 7f80aa813700 1 --2- 172.21.15.80:0/1636415000 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8088018730 0x7f808801abc0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:35.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.232+0000 7f80aa813700 1 --2- 172.21.15.80:0/1636415000 >> v2:172.21.15.174:3300/0 conn(0x7f80a4152bd0 0x7f80a4140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:35.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.232+0000 7f80aa813700 1 --2- 172.21.15.80:0/1636415000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a4074d00 0x7f80a40750f0 unknown :-1 s=CLOSED pgs=2912 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:35.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.232+0000 7f80aa813700 1 -- 172.21.15.80:0/1636415000 shutdown_connections 2019-11-28T11:58:35.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.232+0000 7f80aa813700 1 -- 172.21.15.80:0/1636415000 wait complete. 2019-11-28T11:58:35.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:35.232+0000 7f80aa813700 1 -- 172.21.15.80:0/1636415000 >> 172.21.15.80:0/1636415000 conn(0x7f80a413fa50 msgr2=0x7f80a407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:35.545 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8138}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 36, u'failed': [], u'epoch': 186, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [37], u'info': {u'gid_8138': {u'export_targets': [], u'name': u'a', u'incarnation': 185, u'state_seq': 3, u'state': u'up:active', u'gid': 8138, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 4148152245, u'type': u'v2', u'addr': u'172.21.15.80:6833'}, {u'nonce': 4148152245, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/4148152245'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:58:24.286894+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:58:31.978284+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:58:35.545 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:58:35.545 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2019-11-28T11:58:35.673 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:58:35.673 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:58:35.673 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T11:58:35.673 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 8138, 2019-11-28T11:58:35.674 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2019-11-28T11:58:35.674 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2019-11-28T11:58:35.674 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 4.6961948339999999, 2019-11-28T11:58:35.674 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 186, 2019-11-28T11:58:35.675 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 223, 2019-11-28T11:58:35.675 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 223, 2019-11-28T11:58:35.675 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 8.969493301 2019-11-28T11:58:35.675 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:58:35.678 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8138, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.6961948339999999, "mdsmap_epoch": 186, "osdmap_epoch": 223, "osdmap_epoch_barrier": 223, "uptime": 8.969493301 } 2019-11-28T11:58:35.679 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:58:35.679 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T11:58:35.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:58:35.679 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T11:58:35.749 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:58:35.750 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:58:35.872 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:58:35.873 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:58:35.873 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:58:35.873 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:58:35.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:58:35.874 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T11:58:35.947 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T11:58:36.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.070+0000 7f15ef6d2700 1 Processor -- start 2019-11-28T11:58:36.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.070+0000 7f15ef6d2700 1 -- start start 2019-11-28T11:58:36.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.071+0000 7f15ef6d2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15e806c0a0 0x7f15e8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:36.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.071+0000 7f15ef6d2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f15e80734e0 0x7f15e8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:36.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.071+0000 7f15ef6d2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e806db00 con 0x7f15e8072360 2019-11-28T11:58:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.071+0000 7f15ef6d2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e806fd60 con 0x7f15e806c0a0 2019-11-28T11:58:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.071+0000 7f15ef6d2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e8070030 con 0x7f15e80734e0 2019-11-28T11:58:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.071+0000 7f15edc6f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15e806c0a0 0x7f15e8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:36.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.071+0000 7f15edc6f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15e806c0a0 0x7f15e8072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47220/0 (socket says 172.21.15.80:47220) 2019-11-28T11:58:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.071+0000 7f15edc6f700 1 -- 172.21.15.80:0/843972449 learned_addr learned my addr 172.21.15.80:0/843972449 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.072+0000 7f15ed46e700 1 --2- 172.21.15.80:0/843972449 >> v2:172.21.15.174:3300/0 conn(0x7f15e80734e0 0x7f15e8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.072+0000 7f15edc6f700 1 -- 172.21.15.80:0/843972449 >> v2:172.21.15.174:3300/0 conn(0x7f15e80734e0 msgr2=0x7f15e8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:36.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.072+0000 7f15edc6f700 1 --2- 172.21.15.80:0/843972449 >> v2:172.21.15.174:3300/0 conn(0x7f15e80734e0 0x7f15e8071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.072+0000 7f15edc6f700 1 -- 172.21.15.80:0/843972449 >> v1:172.21.15.174:6789/0 conn(0x7f15e8072360 legacy=0x7f15e806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.072+0000 7f15edc6f700 1 -- 172.21.15.80:0/843972449 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e80706c0 con 0x7f15e806c0a0 2019-11-28T11:58:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.072+0000 7f15edc6f700 1 --2- 172.21.15.80:0/843972449 >> v2:172.21.15.80:3300/0 conn(0x7f15e806c0a0 0x7f15e8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f15d000fac0 tx=0x7f15d000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.072+0000 7f15edc6f700 1 --2- 172.21.15.80:0/843972449 >> v2:172.21.15.80:3300/0 conn(0x7f15e806c0a0 0x7f15e8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f15d000fac0 tx=0x7f15d000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.072+0000 7f15edc6f700 1 --2- 172.21.15.80:0/843972449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e806c0a0 0x7f15e8072fa0 secure :-1 s=READY pgs=2913 cs=0 l=1 rx=0x7f15d000fac0 tx=0x7f15d000f8f0).ready entity=mon.0 client_cookie=a7d784684d10376a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.072+0000 7f15edc6f700 1 --2- 172.21.15.80:0/843972449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e806c0a0 0x7f15e8072fa0 secure :-1 s=THROTTLE_DONE pgs=2913 cs=0 l=1 rx=0x7f15d000fac0 tx=0x7f15d000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.072+0000 7f15edc6f700 1 --2- 172.21.15.80:0/843972449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e806c0a0 0x7f15e8072fa0 secure :-1 s=THROTTLE_DONE pgs=2913 cs=0 l=1 rx=0x7f15d000fac0 tx=0x7f15d000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.072+0000 7f15ecc6d700 1 -- 172.21.15.80:0/843972449 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d0000ce0 con 0x7f15e806c0a0 2019-11-28T11:58:36.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.072+0000 7f15edc6f700 1 --2- 172.21.15.80:0/843972449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e806c0a0 0x7f15e8072fa0 secure :-1 s=THROTTLE_DONE pgs=2913 cs=0 l=1 rx=0x7f15d000fac0 tx=0x7f15d000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.072+0000 7f15ecc6d700 1 -- 172.21.15.80:0/843972449 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d0001010 con 0x7f15e806c0a0 2019-11-28T11:58:36.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.072+0000 7f15ecc6d700 1 -- 172.21.15.80:0/843972449 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d0001720 con 0x7f15e806c0a0 2019-11-28T11:58:36.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.072+0000 7f15ef6d2700 1 -- 172.21.15.80:0/843972449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e806c0a0 msgr2=0x7f15e8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.072+0000 7f15ef6d2700 1 --2- 172.21.15.80:0/843972449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e806c0a0 0x7f15e8072fa0 secure :-1 s=READY pgs=2913 cs=0 l=1 rx=0x7f15d000fac0 tx=0x7f15d000f8f0).stop 2019-11-28T11:58:36.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.073+0000 7f15ef6d2700 1 -- 172.21.15.80:0/843972449 shutdown_connections 2019-11-28T11:58:36.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.073+0000 7f15ef6d2700 1 --2- 172.21.15.80:0/843972449 >> v2:172.21.15.174:3300/0 conn(0x7f15e80734e0 0x7f15e8071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:36.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.073+0000 7f15ef6d2700 1 --2- 172.21.15.80:0/843972449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e806c0a0 0x7f15e8072fa0 unknown :-1 s=CLOSED pgs=2913 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:36.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.073+0000 7f15ef6d2700 1 -- 172.21.15.80:0/843972449 shutdown_connections 2019-11-28T11:58:36.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.073+0000 7f15ef6d2700 1 -- 172.21.15.80:0/843972449 wait complete. 2019-11-28T11:58:36.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.073+0000 7f15ef6d2700 1 -- 172.21.15.80:0/843972449 >> 172.21.15.80:0/843972449 conn(0x7f15e8061cf0 msgr2=0x7f15e8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:36.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.075+0000 7f15ef6d2700 1 Processor -- start 2019-11-28T11:58:36.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.075+0000 7f15ef6d2700 1 -- start start 2019-11-28T11:58:36.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.076+0000 7f15ef6d2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15e8104820 0x7f15e810c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:36.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.076+0000 7f15ef6d2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e813bcd0 con 0x7f15e810c890 2019-11-28T11:58:36.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.076+0000 7f15ef6d2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e8105ea0 con 0x7f15e810b9d0 2019-11-28T11:58:36.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.076+0000 7f15ef6d2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e8109130 con 0x7f15e8104820 2019-11-28T11:58:36.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.076+0000 7f15edc6f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15e8104820 0x7f15e810c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:36.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.076+0000 7f15edc6f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15e8104820 0x7f15e810c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47226/0 (socket says 172.21.15.80:47226) 2019-11-28T11:58:36.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.076+0000 7f15edc6f700 1 -- 172.21.15.80:0/3734829696 learned_addr learned my addr 172.21.15.80:0/3734829696 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:36.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.077+0000 7f15edc6f700 1 -- 172.21.15.80:0/3734829696 >> v1:172.21.15.174:6789/0 conn(0x7f15e810b9d0 legacy=0x7f15e8167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.077+0000 7f15edc6f700 1 -- 172.21.15.80:0/3734829696 >> v1:172.21.15.80:6789/0 conn(0x7f15e810c890 legacy=0x7f15e810b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.077+0000 7f15e67fc700 1 -- 172.21.15.80:0/3734829696 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025545779 0 0) 0x7f15d8000c90 con 0x7f15e810c890 2019-11-28T11:58:36.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.077+0000 7f15edc6f700 1 -- 172.21.15.80:0/3734829696 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8109a90 con 0x7f15e8104820 2019-11-28T11:58:36.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.077+0000 7f15edc6f700 1 --2- 172.21.15.80:0/3734829696 >> v2:172.21.15.80:3300/0 conn(0x7f15e8104820 0x7f15e810c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15d00107e0 tx=0x7f15d0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.077+0000 7f15edc6f700 1 --2- 172.21.15.80:0/3734829696 >> v2:172.21.15.80:3300/0 conn(0x7f15e8104820 0x7f15e810c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15d00107e0 tx=0x7f15d0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.077+0000 7f15edc6f700 1 --2- 172.21.15.80:0/3734829696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e8104820 0x7f15e810c350 secure :-1 s=READY pgs=2915 cs=0 l=1 rx=0x7f15d00107e0 tx=0x7f15d0010b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:36.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.077+0000 7f15edc6f700 1 --2- 172.21.15.80:0/3734829696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e8104820 0x7f15e810c350 secure :-1 s=THROTTLE_DONE pgs=2915 cs=0 l=1 rx=0x7f15d00107e0 tx=0x7f15d0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.077+0000 7f15e67fc700 1 -- 172.21.15.80:0/3734829696 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d0008190 con 0x7f15e8104820 2019-11-28T11:58:36.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.077+0000 7f15edc6f700 1 --2- 172.21.15.80:0/3734829696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e8104820 0x7f15e810c350 secure :-1 s=THROTTLE_DONE pgs=2915 cs=0 l=1 rx=0x7f15d00107e0 tx=0x7f15d0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.077+0000 7f15ef6d2700 1 -- 172.21.15.80:0/3734829696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e8109e10 con 0x7f15e8104820 2019-11-28T11:58:36.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.077+0000 7f15e67fc700 1 -- 172.21.15.80:0/3734829696 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d0008190 con 0x7f15e8104820 2019-11-28T11:58:36.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.077+0000 7f15edc6f700 1 --2- 172.21.15.80:0/3734829696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e8104820 0x7f15e810c350 secure :-1 s=THROTTLE_DONE pgs=2915 cs=0 l=1 rx=0x7f15d00107e0 tx=0x7f15d0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.077+0000 7f15e67fc700 1 -- 172.21.15.80:0/3734829696 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d0005900 con 0x7f15e8104820 2019-11-28T11:58:36.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.077+0000 7f15ef6d2700 1 -- 172.21.15.80:0/3734829696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e8109a90 con 0x7f15e8104820 2019-11-28T11:58:36.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.077+0000 7f15edc6f700 1 --2- 172.21.15.80:0/3734829696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e8104820 0x7f15e810c350 secure :-1 s=THROTTLE_DONE pgs=2915 cs=0 l=1 rx=0x7f15d00107e0 tx=0x7f15d0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.078+0000 7f15e67fc700 1 -- 172.21.15.80:0/3734829696 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f15d0005710 con 0x7f15e8104820 2019-11-28T11:58:36.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.078+0000 7f15e67fc700 1 --2- 172.21.15.80:0/3734829696 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15cc018730 0x7f15cc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:36.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.078+0000 7f15edc6f700 1 --2- 172.21.15.80:0/3734829696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e8104820 0x7f15e810c350 secure :-1 s=THROTTLE_DONE pgs=2915 cs=0 l=1 rx=0x7f15d00107e0 tx=0x7f15d0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.078+0000 7f15e67fc700 1 -- 172.21.15.80:0/3734829696 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f15d0005710 con 0x7f15e8104820 2019-11-28T11:58:36.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.078+0000 7f15ed46e700 1 --2- 172.21.15.80:0/3734829696 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15cc018730 0x7f15cc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:36.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.078+0000 7f15ed46e700 1 --2- 172.21.15.80:0/3734829696 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15cc018730 0x7f15cc01abc0 crc :-1 s=READY pgs=1208 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:36.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.086+0000 7f15ef6d2700 1 -- 172.21.15.80:0/3734829696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e8109e10 con 0x7f15e8104820 2019-11-28T11:58:36.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.089+0000 7f15edc6f700 1 --2- 172.21.15.80:0/3734829696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e8104820 0x7f15e810c350 secure :-1 s=THROTTLE_DONE pgs=2915 cs=0 l=1 rx=0x7f15d00107e0 tx=0x7f15d0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.089+0000 7f15e67fc700 1 -- 172.21.15.80:0/3734829696 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f15d0005500 con 0x7f15e8104820 2019-11-28T11:58:36.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.264+0000 7f15ef6d2700 1 -- 172.21.15.80:0/3734829696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15e8109a90 con 0x7f15e8104820 2019-11-28T11:58:36.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.265+0000 7f15edc6f700 1 --2- 172.21.15.80:0/3734829696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e8104820 0x7f15e810c350 secure :-1 s=THROTTLE_DONE pgs=2915 cs=0 l=1 rx=0x7f15d00107e0 tx=0x7f15d0010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.265+0000 7f15e67fc700 1 -- 172.21.15.80:0/3734829696 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v223) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f15d0008170 con 0x7f15e8104820 2019-11-28T11:58:36.261 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:36.261 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":223,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:58:25.288240+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":37,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":36,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:58:22.567726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"222","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":37,"pool_name":"cephfs_data","create_time":"2019-11-28T11:58:23.259981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"223","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":220,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T11:58:36.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.267+0000 7f15ef6d2700 1 -- 172.21.15.80:0/3734829696 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15cc018730 msgr2=0x7f15cc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.267+0000 7f15ef6d2700 1 --2- 172.21.15.80:0/3734829696 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15cc018730 0x7f15cc01abc0 crc :-1 s=READY pgs=1208 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:36.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.267+0000 7f15ef6d2700 1 -- 172.21.15.80:0/3734829696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e8104820 msgr2=0x7f15e810c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.267+0000 7f15ef6d2700 1 --2- 172.21.15.80:0/3734829696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e8104820 0x7f15e810c350 secure :-1 s=READY pgs=2915 cs=0 l=1 rx=0x7f15d00107e0 tx=0x7f15d0010b80).stop 2019-11-28T11:58:36.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.267+0000 7f15ef6d2700 1 -- 172.21.15.80:0/3734829696 shutdown_connections 2019-11-28T11:58:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.267+0000 7f15ef6d2700 1 --2- 172.21.15.80:0/3734829696 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15cc018730 0x7f15cc01abc0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.267+0000 7f15ef6d2700 1 --2- 172.21.15.80:0/3734829696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15e8104820 0x7f15e810c350 unknown :-1 s=CLOSED pgs=2915 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.267+0000 7f15ef6d2700 1 -- 172.21.15.80:0/3734829696 shutdown_connections 2019-11-28T11:58:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.267+0000 7f15ef6d2700 1 -- 172.21.15.80:0/3734829696 wait complete. 2019-11-28T11:58:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.267+0000 7f15ef6d2700 1 -- 172.21.15.80:0/3734829696 >> 172.21.15.80:0/3734829696 conn(0x7f15e813d620 msgr2=0x7f15e813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:36.274 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:58:22.567726+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 36, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'222', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:58:23.259981+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 37, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'223', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T11:58:36.275 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T11:58:36.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.402+0000 7f165374d700 1 Processor -- start 2019-11-28T11:58:36.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.402+0000 7f165374d700 1 -- start start 2019-11-28T11:58:36.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.403+0000 7f165374d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f164c15f100 0x7f164c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:36.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.403+0000 7f165374d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f164c06c2f0 0x7f164c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:36.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.403+0000 7f165374d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c06db60 con 0x7f164c15ed10 2019-11-28T11:58:36.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.403+0000 7f165374d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c06fe00 con 0x7f164c06c2f0 2019-11-28T11:58:36.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.403+0000 7f165374d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0700d0 con 0x7f164c15f100 2019-11-28T11:58:36.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.403+0000 7f16524eb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f164c06c2f0 0x7f164c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:36.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.403+0000 7f16524eb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f164c06c2f0 0x7f164c06c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47234/0 (socket says 172.21.15.80:47234) 2019-11-28T11:58:36.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.403+0000 7f16524eb700 1 -- 172.21.15.80:0/957549036 learned_addr learned my addr 172.21.15.80:0/957549036 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:36.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.403+0000 7f16514e9700 1 --2- 172.21.15.80:0/957549036 >> v2:172.21.15.174:3300/0 conn(0x7f164c15f100 0x7f164c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:36.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.404+0000 7f16524eb700 1 -- 172.21.15.80:0/957549036 >> v2:172.21.15.174:3300/0 conn(0x7f164c15f100 msgr2=0x7f164c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:36.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.404+0000 7f16524eb700 1 --2- 172.21.15.80:0/957549036 >> v2:172.21.15.174:3300/0 conn(0x7f164c15f100 0x7f164c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:36.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.404+0000 7f16524eb700 1 -- 172.21.15.80:0/957549036 >> v1:172.21.15.174:6789/0 conn(0x7f164c15ed10 legacy=0x7f164c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:36.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.404+0000 7f16524eb700 1 -- 172.21.15.80:0/957549036 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c070760 con 0x7f164c06c2f0 2019-11-28T11:58:36.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.404+0000 7f16514e9700 1 --2- 172.21.15.80:0/957549036 >> v2:172.21.15.174:3300/0 conn(0x7f164c15f100 0x7f164c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T11:58:36.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.404+0000 7f16524eb700 1 --2- 172.21.15.80:0/957549036 >> v2:172.21.15.80:3300/0 conn(0x7f164c06c2f0 0x7f164c06c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f164400f730 tx=0x7f164400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.404+0000 7f16524eb700 1 --2- 172.21.15.80:0/957549036 >> v2:172.21.15.80:3300/0 conn(0x7f164c06c2f0 0x7f164c06c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f164400f730 tx=0x7f164400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.404+0000 7f16524eb700 1 --2- 172.21.15.80:0/957549036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f164c06c2f0 0x7f164c06c770 secure :-1 s=READY pgs=2916 cs=0 l=1 rx=0x7f164400f730 tx=0x7f164400fad0).ready entity=mon.0 client_cookie=72db7f34058c1f17 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:36.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.404+0000 7f16524eb700 1 --2- 172.21.15.80:0/957549036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f164c06c2f0 0x7f164c06c770 secure :-1 s=THROTTLE_DONE pgs=2916 cs=0 l=1 rx=0x7f164400f730 tx=0x7f164400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.404+0000 7f16524eb700 1 --2- 172.21.15.80:0/957549036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f164c06c2f0 0x7f164c06c770 secure :-1 s=THROTTLE_DONE pgs=2916 cs=0 l=1 rx=0x7f164400f730 tx=0x7f164400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.404+0000 7f1650ce8700 1 -- 172.21.15.80:0/957549036 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1644000b90 con 0x7f164c06c2f0 2019-11-28T11:58:36.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.404+0000 7f16524eb700 1 --2- 172.21.15.80:0/957549036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f164c06c2f0 0x7f164c06c770 secure :-1 s=THROTTLE_DONE pgs=2916 cs=0 l=1 rx=0x7f164400f730 tx=0x7f164400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.404+0000 7f1650ce8700 1 -- 172.21.15.80:0/957549036 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16440010e0 con 0x7f164c06c2f0 2019-11-28T11:58:36.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.404+0000 7f1650ce8700 1 -- 172.21.15.80:0/957549036 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1644001830 con 0x7f164c06c2f0 2019-11-28T11:58:36.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.404+0000 7f165374d700 1 -- 172.21.15.80:0/957549036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f164c06c2f0 msgr2=0x7f164c06c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.404+0000 7f165374d700 1 --2- 172.21.15.80:0/957549036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f164c06c2f0 0x7f164c06c770 secure :-1 s=READY pgs=2916 cs=0 l=1 rx=0x7f164400f730 tx=0x7f164400fad0).stop 2019-11-28T11:58:36.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.405+0000 7f165374d700 1 -- 172.21.15.80:0/957549036 shutdown_connections 2019-11-28T11:58:36.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.405+0000 7f165374d700 1 --2- 172.21.15.80:0/957549036 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f164c06c2f0 0x7f164c06c770 unknown :-1 s=CLOSED pgs=2916 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:36.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.405+0000 7f165374d700 1 --2- 172.21.15.80:0/957549036 >> v2:172.21.15.174:3300/0 conn(0x7f164c15f100 0x7f164c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:36.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.405+0000 7f165374d700 1 -- 172.21.15.80:0/957549036 shutdown_connections 2019-11-28T11:58:36.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.405+0000 7f165374d700 1 -- 172.21.15.80:0/957549036 wait complete. 2019-11-28T11:58:36.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.405+0000 7f165374d700 1 -- 172.21.15.80:0/957549036 >> 172.21.15.80:0/957549036 conn(0x7f164c061d20 msgr2=0x7f164c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:36.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.407+0000 7f165374d700 1 Processor -- start 2019-11-28T11:58:36.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.407+0000 7f165374d700 1 -- start start 2019-11-28T11:58:36.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.408+0000 7f165374d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f164c10ed60 0x7f164c10f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:36.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.408+0000 7f165374d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f164c10f730 0x7f164c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:36.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.408+0000 7f165374d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c10c250 con 0x7f164c10e970 2019-11-28T11:58:36.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.408+0000 7f165374d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c10e430 con 0x7f164c10ed60 2019-11-28T11:58:36.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.408+0000 7f165374d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c105860 con 0x7f164c10f730 2019-11-28T11:58:36.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.408+0000 7f1651cea700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f164c10e970 0x7f164c1087b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46554/0 (socket says 172.21.15.80:46554) 2019-11-28T11:58:36.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.408+0000 7f1651cea700 1 -- 172.21.15.80:0/1138689551 learned_addr learned my addr 172.21.15.80:0/1138689551 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:36.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.408+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534055138 0 0) 0x7f163c001150 con 0x7f164c10e970 2019-11-28T11:58:36.415 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.408+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1630002e80 con 0x7f164c10e970 2019-11-28T11:58:36.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.408+0000 7f16514e9700 1 --2- 172.21.15.80:0/1138689551 >> v2:172.21.15.174:3300/0 conn(0x7f164c10ed60 0x7f164c10f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:36.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.408+0000 7f16524eb700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f164c10f730 0x7f164c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:36.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2630756247 0 0) 0x7f163c0012c0 con 0x7f164c10e970 2019-11-28T11:58:36.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f16300032e0 con 0x7f164c10e970 2019-11-28T11:58:36.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f163c001870 con 0x7f164c10e970 2019-11-28T11:58:36.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f164c10f730 msgr2=0x7f164c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f164c10f730 0x7f164c167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:36.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 >> v2:172.21.15.174:3300/0 conn(0x7f164c10ed60 msgr2=0x7f164c10f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 --2- 172.21.15.80:0/1138689551 >> v2:172.21.15.174:3300/0 conn(0x7f164c10ed60 0x7f164c10f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:36.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 >> v1:172.21.15.80:6789/0 conn(0x7f164c10e970 legacy=0x7f164c1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1630003330 0x7f1630003760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:36.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1630003ca0 0x7f1630004140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:36.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16300048d0 0x7f1630004d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:36.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163000bb60 con 0x7f1630003330 2019-11-28T11:58:36.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163000bd90 con 0x7f1630003ca0 2019-11-28T11:58:36.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163000bfc0 con 0x7f16300048d0 2019-11-28T11:58:36.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f1651cea700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1630003330 0x7f1630003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:36.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f16524eb700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16300048d0 0x7f1630004d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f16514e9700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1630003ca0 0x7f1630004140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f1651cea700 1 -- 172.21.15.80:0/1138689551 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16300048d0 msgr2=0x7f1630004d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f1651cea700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16300048d0 0x7f1630004d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f1651cea700 1 -- 172.21.15.80:0/1138689551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1630003ca0 msgr2=0x7f1630004140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f1651cea700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1630003ca0 0x7f1630004140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:36.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f1651cea700 1 -- 172.21.15.80:0/1138689551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163000c270 con 0x7f1630003330 2019-11-28T11:58:36.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f165374d700 1 -- 172.21.15.80:0/1138689551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c106270 con 0x7f1630003330 2019-11-28T11:58:36.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f1651cea700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1630003330 0x7f1630003760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f163c010410 tx=0x7f163c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f1651cea700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1630003330 0x7f1630003760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f163c010410 tx=0x7f163c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f1651cea700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1630003330 0x7f1630003760 secure :-1 s=READY pgs=2918 cs=0 l=1 rx=0x7f163c010410 tx=0x7f163c010310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:36.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f1651cea700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1630003330 0x7f1630003760 secure :-1 s=THROTTLE_DONE pgs=2918 cs=0 l=1 rx=0x7f163c010410 tx=0x7f163c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f163c001a90 con 0x7f1630003330 2019-11-28T11:58:36.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f165374d700 1 -- 172.21.15.80:0/1138689551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c105ef0 con 0x7f1630003330 2019-11-28T11:58:36.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f1651cea700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1630003330 0x7f1630003760 secure :-1 s=THROTTLE_DONE pgs=2918 cs=0 l=1 rx=0x7f163c010410 tx=0x7f163c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163c000940 con 0x7f1630003330 2019-11-28T11:58:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f1651cea700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1630003330 0x7f1630003760 secure :-1 s=THROTTLE_DONE pgs=2918 cs=0 l=1 rx=0x7f163c010410 tx=0x7f163c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.409+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f163c004600 con 0x7f1630003330 2019-11-28T11:58:36.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.410+0000 7f1651cea700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1630003330 0x7f1630003760 secure :-1 s=THROTTLE_DONE pgs=2918 cs=0 l=1 rx=0x7f163c010410 tx=0x7f163c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.410+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f163c004600 con 0x7f1630003330 2019-11-28T11:58:36.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.410+0000 7f1651cea700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1630003330 0x7f1630003760 secure :-1 s=THROTTLE_DONE pgs=2918 cs=0 l=1 rx=0x7f163c010410 tx=0x7f163c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.410+0000 7f164a7fc700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1630020af0 0x7f1630022f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:36.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.410+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f163c031ca0 con 0x7f1630003330 2019-11-28T11:58:36.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.410+0000 7f16514e9700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1630020af0 0x7f1630022f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:36.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.410+0000 7f16514e9700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1630020af0 0x7f1630022f40 crc :-1 s=READY pgs=1209 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:36.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.417+0000 7f165374d700 1 -- 172.21.15.80:0/1138689551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c106270 con 0x7f1630003330 2019-11-28T11:58:36.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.421+0000 7f1651cea700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1630003330 0x7f1630003760 secure :-1 s=THROTTLE_DONE pgs=2918 cs=0 l=1 rx=0x7f163c010410 tx=0x7f163c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.421+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f163c0043f0 con 0x7f1630003330 2019-11-28T11:58:36.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.593+0000 7f165374d700 1 -- 172.21.15.80:0/1138689551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f164c105ef0 con 0x7f1630003330 2019-11-28T11:58:36.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.593+0000 7f1651cea700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1630003330 0x7f1630003760 secure :-1 s=THROTTLE_DONE pgs=2918 cs=0 l=1 rx=0x7f163c010410 tx=0x7f163c010310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.593+0000 7f164a7fc700 1 -- 172.21.15.80:0/1138689551 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v223) v1 ==== 92+0+10 (secure 0 0 0) 0x7f163c004600 con 0x7f1630003330 2019-11-28T11:58:36.590 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:58:36.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.596+0000 7f165374d700 1 -- 172.21.15.80:0/1138689551 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1630020af0 msgr2=0x7f1630022f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.596+0000 7f165374d700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1630020af0 0x7f1630022f40 crc :-1 s=READY pgs=1209 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.596+0000 7f165374d700 1 -- 172.21.15.80:0/1138689551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1630003330 msgr2=0x7f1630003760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.596+0000 7f165374d700 1 --2- 172.21.15.80:0/1138689551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1630003330 0x7f1630003760 secure :-1 s=READY pgs=2918 cs=0 l=1 rx=0x7f163c010410 tx=0x7f163c010310).stop 2019-11-28T11:58:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.596+0000 7f16524eb700 1 -- 172.21.15.80:0/1138689551 reap_dead start 2019-11-28T11:58:36.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.596+0000 7f16524eb700 1 -- 172.21.15.80:0/1138689551 reap_dead start 2019-11-28T11:58:36.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.596+0000 7f165374d700 1 -- 172.21.15.80:0/1138689551 shutdown_connections 2019-11-28T11:58:36.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.596+0000 7f165374d700 1 -- 172.21.15.80:0/1138689551 shutdown_connections 2019-11-28T11:58:36.594 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.596+0000 7f165374d700 1 -- 172.21.15.80:0/1138689551 wait complete. 2019-11-28T11:58:36.595 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.596+0000 7f165374d700 1 -- 172.21.15.80:0/1138689551 >> 172.21.15.80:0/1138689551 conn(0x7f164c15e2d0 msgr2=0x7f164c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:36.602 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T11:58:36.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.730+0000 7f2269250700 1 Processor -- start 2019-11-28T11:58:36.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.730+0000 7f2269250700 1 -- start start 2019-11-28T11:58:36.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.730+0000 7f2269250700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f226415ed10 0x7f226415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:36.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2269250700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f22640734b0 0x7f22640726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:36.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2269250700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226406db60 con 0x7f2264073020 2019-11-28T11:58:36.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2269250700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226406f3d0 con 0x7f22640734b0 2019-11-28T11:58:36.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2269250700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226406fe00 con 0x7f226415ed10 2019-11-28T11:58:36.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2268a4f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f22640734b0 0x7f22640726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:36.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2262d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2264073020 0x7f2264071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46572/0 (socket says 172.21.15.80:46572) 2019-11-28T11:58:36.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2262d9d700 1 -- 172.21.15.80:0/2305249321 learned_addr learned my addr 172.21.15.80:0/2305249321 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:36.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f226359e700 1 --2- 172.21.15.80:0/2305249321 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f226415ed10 0x7f226415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:36.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2268a4f700 1 -- 172.21.15.80:0/2305249321 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f226415ed10 msgr2=0x7f226415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:36.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2268a4f700 1 --2- 172.21.15.80:0/2305249321 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f226415ed10 0x7f226415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:36.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2268a4f700 1 -- 172.21.15.80:0/2305249321 >> v1:172.21.15.80:6789/0 conn(0x7f2264073020 legacy=0x7f2264071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2268a4f700 1 -- 172.21.15.80:0/2305249321 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2264070760 con 0x7f22640734b0 2019-11-28T11:58:36.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f226259c700 1 -- 172.21.15.80:0/2305249321 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863115594 0 0) 0x7f224c001070 con 0x7f2264073020 2019-11-28T11:58:36.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2268a4f700 1 --2- 172.21.15.80:0/2305249321 >> v2:172.21.15.80:3300/0 conn(0x7f22640734b0 0x7f22640726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f225400b2d0 tx=0x7f225400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2268a4f700 1 --2- 172.21.15.80:0/2305249321 >> v2:172.21.15.80:3300/0 conn(0x7f22640734b0 0x7f22640726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f225400b2d0 tx=0x7f225400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2268a4f700 1 --2- 172.21.15.80:0/2305249321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22640734b0 0x7f22640726a0 secure :-1 s=READY pgs=2920 cs=0 l=1 rx=0x7f225400b2d0 tx=0x7f225400ba60).ready entity=mon.0 client_cookie=d5c96a53dda52410 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:36.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2268a4f700 1 --2- 172.21.15.80:0/2305249321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22640734b0 0x7f22640726a0 secure :-1 s=THROTTLE_DONE pgs=2920 cs=0 l=1 rx=0x7f225400b2d0 tx=0x7f225400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f226259c700 1 -- 172.21.15.80:0/2305249321 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2254009f20 con 0x7f22640734b0 2019-11-28T11:58:36.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2268a4f700 1 --2- 172.21.15.80:0/2305249321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22640734b0 0x7f22640726a0 secure :-1 s=THROTTLE_DONE pgs=2920 cs=0 l=1 rx=0x7f225400b2d0 tx=0x7f225400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2268a4f700 1 --2- 172.21.15.80:0/2305249321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22640734b0 0x7f22640726a0 secure :-1 s=THROTTLE_DONE pgs=2920 cs=0 l=1 rx=0x7f225400b2d0 tx=0x7f225400ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f226259c700 1 -- 172.21.15.80:0/2305249321 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2254009b40 con 0x7f22640734b0 2019-11-28T11:58:36.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f226259c700 1 -- 172.21.15.80:0/2305249321 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f225400a500 con 0x7f22640734b0 2019-11-28T11:58:36.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2269250700 1 -- 172.21.15.80:0/2305249321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22640734b0 msgr2=0x7f22640726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.731+0000 7f2269250700 1 --2- 172.21.15.80:0/2305249321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22640734b0 0x7f22640726a0 secure :-1 s=READY pgs=2920 cs=0 l=1 rx=0x7f225400b2d0 tx=0x7f225400ba60).stop 2019-11-28T11:58:36.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.732+0000 7f2269250700 1 -- 172.21.15.80:0/2305249321 shutdown_connections 2019-11-28T11:58:36.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.732+0000 7f2269250700 1 --2- 172.21.15.80:0/2305249321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f22640734b0 0x7f22640726a0 unknown :-1 s=CLOSED pgs=2920 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:36.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.732+0000 7f2269250700 1 --2- 172.21.15.80:0/2305249321 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f226415ed10 0x7f226415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:36.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.732+0000 7f2269250700 1 -- 172.21.15.80:0/2305249321 shutdown_connections 2019-11-28T11:58:36.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.732+0000 7f2269250700 1 -- 172.21.15.80:0/2305249321 wait complete. 2019-11-28T11:58:36.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.732+0000 7f2269250700 1 -- 172.21.15.80:0/2305249321 >> 172.21.15.80:0/2305249321 conn(0x7f2264061d20 msgr2=0x7f22640641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:36.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.734+0000 7f2269250700 1 Processor -- start 2019-11-28T11:58:36.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.735+0000 7f2269250700 1 -- start start 2019-11-28T11:58:36.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f2269250700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2264148320 0x7f226410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:36.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f2269250700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2264148e00 con 0x7f226410e3d0 2019-11-28T11:58:36.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f2269250700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2264108b10 con 0x7f226410f290 2019-11-28T11:58:36.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f2269250700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2264139ff0 con 0x7f2264148320 2019-11-28T11:58:36.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f2268a4f700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f226410e3d0 0x7f2264168d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46578/0 (socket says 172.21.15.80:46578) 2019-11-28T11:58:36.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f2268a4f700 1 -- 172.21.15.80:0/3202028047 learned_addr learned my addr 172.21.15.80:0/3202028047 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:36.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f226359e700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2264148320 0x7f226410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:36.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f225bfff700 1 -- 172.21.15.80:0/3202028047 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671002735 0 0) 0x7f2254009900 con 0x7f226410e3d0 2019-11-28T11:58:36.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f225bfff700 1 -- 172.21.15.80:0/3202028047 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2248002e80 con 0x7f226410e3d0 2019-11-28T11:58:36.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f225bfff700 1 -- 172.21.15.80:0/3202028047 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853397269 0 0) 0x7f224c001280 con 0x7f226410f290 2019-11-28T11:58:36.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f225bfff700 1 -- 172.21.15.80:0/3202028047 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22480030b0 con 0x7f226410f290 2019-11-28T11:58:36.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f226359e700 1 -- 172.21.15.80:0/3202028047 >> v1:172.21.15.174:6789/0 conn(0x7f226410f290 legacy=0x7f226410dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f226359e700 1 -- 172.21.15.80:0/3202028047 >> v1:172.21.15.80:6789/0 conn(0x7f226410e3d0 legacy=0x7f2264168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f225bfff700 1 -- 172.21.15.80:0/3202028047 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3591294110 0 0) 0x7f2254009b20 con 0x7f226410e3d0 2019-11-28T11:58:36.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f226359e700 1 -- 172.21.15.80:0/3202028047 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226410c490 con 0x7f2264148320 2019-11-28T11:58:36.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f226359e700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2264148320 0x7f226410ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f225c0103a0 tx=0x7f225c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f226359e700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2264148320 0x7f226410ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f225c0103a0 tx=0x7f225c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f226359e700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2264148320 0x7f226410ed50 secure :-1 s=READY pgs=423 cs=0 l=1 rx=0x7f225c0103a0 tx=0x7f225c010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:36.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f226359e700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2264148320 0x7f226410ed50 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f225c0103a0 tx=0x7f225c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.745 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f225bfff700 1 -- 172.21.15.80:0/3202028047 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f225c000940 con 0x7f2264148320 2019-11-28T11:58:36.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f226359e700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2264148320 0x7f226410ed50 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f225c0103a0 tx=0x7f225c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f226359e700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2264148320 0x7f226410ed50 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f225c0103a0 tx=0x7f225c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f225bfff700 1 -- 172.21.15.80:0/3202028047 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c009c40 con 0x7f2264148320 2019-11-28T11:58:36.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f225bfff700 1 -- 172.21.15.80:0/3202028047 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f225c00a250 con 0x7f2264148320 2019-11-28T11:58:36.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.736+0000 7f2269250700 1 -- 172.21.15.80:0/3202028047 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226410c810 con 0x7f2264148320 2019-11-28T11:58:36.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.737+0000 7f2269250700 1 -- 172.21.15.80:0/3202028047 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226410c490 con 0x7f2264148320 2019-11-28T11:58:36.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.737+0000 7f226359e700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2264148320 0x7f226410ed50 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f225c0103a0 tx=0x7f225c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.737+0000 7f225bfff700 1 -- 172.21.15.80:0/3202028047 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f225c009750 con 0x7f2264148320 2019-11-28T11:58:36.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.737+0000 7f226359e700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2264148320 0x7f226410ed50 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f225c0103a0 tx=0x7f225c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.737+0000 7f225bfff700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2248018750 0x7f224801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:36.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.737+0000 7f225bfff700 1 -- 172.21.15.80:0/3202028047 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f225c031ad0 con 0x7f2264148320 2019-11-28T11:58:36.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.737+0000 7f2262d9d700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2248018750 0x7f224801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:36.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.738+0000 7f2262d9d700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2248018750 0x7f224801abe0 crc :-1 s=READY pgs=1210 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:36.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.745+0000 7f2269250700 1 -- 172.21.15.80:0/3202028047 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226410c810 con 0x7f2264148320 2019-11-28T11:58:36.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.749+0000 7f226359e700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2264148320 0x7f226410ed50 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f225c0103a0 tx=0x7f225c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.749+0000 7f225bfff700 1 -- 172.21.15.80:0/3202028047 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f225c00c4a0 con 0x7f2264148320 2019-11-28T11:58:36.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.916+0000 7f2269250700 1 -- 172.21.15.80:0/3202028047 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f226410c490 con 0x7f2264148320 2019-11-28T11:58:36.920 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.917+0000 7f226359e700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2264148320 0x7f226410ed50 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f225c0103a0 tx=0x7f225c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:36.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.917+0000 7f225bfff700 1 -- 172.21.15.80:0/3202028047 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v223) v1 ==== 104+0+10 (secure 0 0 0) 0x7f225c00c4a0 con 0x7f2264148320 2019-11-28T11:58:36.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.919+0000 7f2269250700 1 -- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2248018750 msgr2=0x7f224801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.919+0000 7f2269250700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2248018750 0x7f224801abe0 crc :-1 s=READY pgs=1210 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:36.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.919+0000 7f2269250700 1 -- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2264148320 msgr2=0x7f226410ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:36.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.919+0000 7f2269250700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2264148320 0x7f226410ed50 secure :-1 s=READY pgs=423 cs=0 l=1 rx=0x7f225c0103a0 tx=0x7f225c010740).stop 2019-11-28T11:58:36.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.920+0000 7f2269250700 1 -- 172.21.15.80:0/3202028047 shutdown_connections 2019-11-28T11:58:36.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.920+0000 7f2269250700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2248018750 0x7f224801abe0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:36.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.920+0000 7f2269250700 1 --2- 172.21.15.80:0/3202028047 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2264148320 0x7f226410ed50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:36.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.920+0000 7f2269250700 1 -- 172.21.15.80:0/3202028047 shutdown_connections 2019-11-28T11:58:36.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.920+0000 7f2269250700 1 -- 172.21.15.80:0/3202028047 wait complete. 2019-11-28T11:58:36.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:36.920+0000 7f2269250700 1 -- 172.21.15.80:0/3202028047 >> 172.21.15.80:0/3202028047 conn(0x7f226415e2d0 msgr2=0x7f2264147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:36.925 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:58:36.927 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T11:58:37.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.056+0000 7f10d93a6700 1 Processor -- start 2019-11-28T11:58:37.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.056+0000 7f10d93a6700 1 -- start start 2019-11-28T11:58:37.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d93a6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10d415f100 0x7f10d406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:37.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d93a6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10d406c2f0 0x7f10d406c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:37.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d93a6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d406db60 con 0x7f10d415ed10 2019-11-28T11:58:37.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d93a6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d406fe00 con 0x7f10d415f100 2019-11-28T11:58:37.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d93a6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d40700d0 con 0x7f10d406c2f0 2019-11-28T11:58:37.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d37fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f10d415ed10 0x7f10d4073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46582/0 (socket says 172.21.15.80:46582) 2019-11-28T11:58:37.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d37fe700 1 -- 172.21.15.80:0/3031749324 learned_addr learned my addr 172.21.15.80:0/3031749324 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:37.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d2ffd700 1 --2- 172.21.15.80:0/3031749324 >> v2:172.21.15.80:3300/0 conn(0x7f10d415f100 0x7f10d406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:37.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d3fff700 1 --2- 172.21.15.80:0/3031749324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10d406c2f0 0x7f10d406c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:37.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d27fc700 1 -- 172.21.15.80:0/3031749324 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333768432 0 0) 0x7f10c0001170 con 0x7f10d415ed10 2019-11-28T11:58:37.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d27fc700 1 -- 172.21.15.80:0/3031749324 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10b8002e80 con 0x7f10d415ed10 2019-11-28T11:58:37.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d2ffd700 1 -- 172.21.15.80:0/3031749324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10d406c2f0 msgr2=0x7f10d406c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:37.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d2ffd700 1 --2- 172.21.15.80:0/3031749324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10d406c2f0 0x7f10d406c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:37.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d2ffd700 1 -- 172.21.15.80:0/3031749324 >> v1:172.21.15.80:6789/0 conn(0x7f10d415ed10 legacy=0x7f10d4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:37.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d2ffd700 1 -- 172.21.15.80:0/3031749324 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d4070760 con 0x7f10d415f100 2019-11-28T11:58:37.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d2ffd700 1 --2- 172.21.15.80:0/3031749324 >> v2:172.21.15.80:3300/0 conn(0x7f10d415f100 0x7f10d406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f10c400af50 tx=0x7f10c400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d2ffd700 1 --2- 172.21.15.80:0/3031749324 >> v2:172.21.15.80:3300/0 conn(0x7f10d415f100 0x7f10d406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f10c400af50 tx=0x7f10c400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.057+0000 7f10d2ffd700 1 --2- 172.21.15.80:0/3031749324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d415f100 0x7f10d406bdb0 secure :-1 s=READY pgs=2923 cs=0 l=1 rx=0x7f10c400af50 tx=0x7f10c400b250).ready entity=mon.0 client_cookie=f383b185c7ecaea8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:37.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.058+0000 7f10d2ffd700 1 --2- 172.21.15.80:0/3031749324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d415f100 0x7f10d406bdb0 secure :-1 s=THROTTLE_DONE pgs=2923 cs=0 l=1 rx=0x7f10c400af50 tx=0x7f10c400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.058+0000 7f10d27fc700 1 -- 172.21.15.80:0/3031749324 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10c4007210 con 0x7f10d415f100 2019-11-28T11:58:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.058+0000 7f10d2ffd700 1 --2- 172.21.15.80:0/3031749324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d415f100 0x7f10d406bdb0 secure :-1 s=THROTTLE_DONE pgs=2923 cs=0 l=1 rx=0x7f10c400af50 tx=0x7f10c400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.058+0000 7f10d2ffd700 1 --2- 172.21.15.80:0/3031749324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d415f100 0x7f10d406bdb0 secure :-1 s=THROTTLE_DONE pgs=2923 cs=0 l=1 rx=0x7f10c400af50 tx=0x7f10c400b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.058+0000 7f10d27fc700 1 -- 172.21.15.80:0/3031749324 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c40099b0 con 0x7f10d415f100 2019-11-28T11:58:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.058+0000 7f10d27fc700 1 -- 172.21.15.80:0/3031749324 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10c400a080 con 0x7f10d415f100 2019-11-28T11:58:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.058+0000 7f10d93a6700 1 -- 172.21.15.80:0/3031749324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d415f100 msgr2=0x7f10d406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.058+0000 7f10d93a6700 1 --2- 172.21.15.80:0/3031749324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d415f100 0x7f10d406bdb0 secure :-1 s=READY pgs=2923 cs=0 l=1 rx=0x7f10c400af50 tx=0x7f10c400b250).stop 2019-11-28T11:58:37.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.058+0000 7f10d93a6700 1 -- 172.21.15.80:0/3031749324 shutdown_connections 2019-11-28T11:58:37.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.058+0000 7f10d93a6700 1 --2- 172.21.15.80:0/3031749324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10d406c2f0 0x7f10d406c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:37.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.058+0000 7f10d93a6700 1 --2- 172.21.15.80:0/3031749324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d415f100 0x7f10d406bdb0 unknown :-1 s=CLOSED pgs=2923 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:37.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.058+0000 7f10d93a6700 1 -- 172.21.15.80:0/3031749324 shutdown_connections 2019-11-28T11:58:37.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.058+0000 7f10d93a6700 1 -- 172.21.15.80:0/3031749324 wait complete. 2019-11-28T11:58:37.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.058+0000 7f10d93a6700 1 -- 172.21.15.80:0/3031749324 >> 172.21.15.80:0/3031749324 conn(0x7f10d4061d20 msgr2=0x7f10d40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:37.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.061+0000 7f10d93a6700 1 Processor -- start 2019-11-28T11:58:37.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.061+0000 7f10d93a6700 1 -- start start 2019-11-28T11:58:37.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d93a6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10d410e970 0x7f10d41087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:37.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d93a6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10d4108cf0 0x7f10d4107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:37.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d93a6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f10d4107b70 0x7f10d4107fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:37.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d93a6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d410e430 con 0x7f10d410e970 2019-11-28T11:58:37.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d93a6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d4105860 con 0x7f10d4107b70 2019-11-28T11:58:37.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d93a6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d410da00 con 0x7f10d4108cf0 2019-11-28T11:58:37.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d37fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10d410e970 0x7f10d41087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:37.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d37fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10d410e970 0x7f10d41087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47272/0 (socket says 172.21.15.80:47272) 2019-11-28T11:58:37.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d37fe700 1 -- 172.21.15.80:0/3095628503 learned_addr learned my addr 172.21.15.80:0/3095628503 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:37.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d2ffd700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10d4108cf0 0x7f10d4107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:37.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d3fff700 1 --2- 172.21.15.80:0/3095628503 >> v2:172.21.15.174:3300/0 conn(0x7f10d4107b70 0x7f10d4107fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:37.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d37fe700 1 -- 172.21.15.80:0/3095628503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10d4108cf0 msgr2=0x7f10d4107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:37.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d37fe700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10d4108cf0 0x7f10d4107630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:37.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d37fe700 1 -- 172.21.15.80:0/3095628503 >> v2:172.21.15.174:3300/0 conn(0x7f10d4107b70 msgr2=0x7f10d4107fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:37.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d37fe700 1 --2- 172.21.15.80:0/3095628503 >> v2:172.21.15.174:3300/0 conn(0x7f10d4107b70 0x7f10d4107fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:37.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d37fe700 1 -- 172.21.15.80:0/3095628503 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d4105ef0 con 0x7f10d410e970 2019-11-28T11:58:37.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d37fe700 1 --2- 172.21.15.80:0/3095628503 >> v2:172.21.15.80:3300/0 conn(0x7f10d410e970 0x7f10d41087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10c00103e0 tx=0x7f10c00102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d37fe700 1 --2- 172.21.15.80:0/3095628503 >> v2:172.21.15.80:3300/0 conn(0x7f10d410e970 0x7f10d41087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10c00103e0 tx=0x7f10c00102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d37fe700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d410e970 0x7f10d41087b0 secure :-1 s=READY pgs=2924 cs=0 l=1 rx=0x7f10c00103e0 tx=0x7f10c00102e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:37.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d37fe700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d410e970 0x7f10d41087b0 secure :-1 s=THROTTLE_DONE pgs=2924 cs=0 l=1 rx=0x7f10c00103e0 tx=0x7f10c00102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d37fe700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d410e970 0x7f10d41087b0 secure :-1 s=THROTTLE_DONE pgs=2924 cs=0 l=1 rx=0x7f10c00103e0 tx=0x7f10c00102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10d37fe700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d410e970 0x7f10d41087b0 secure :-1 s=THROTTLE_DONE pgs=2924 cs=0 l=1 rx=0x7f10c00103e0 tx=0x7f10c00102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.062+0000 7f10cbfff700 1 -- 172.21.15.80:0/3095628503 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10c0000c90 con 0x7f10d410e970 2019-11-28T11:58:37.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.063+0000 7f10cbfff700 1 -- 172.21.15.80:0/3095628503 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c00010c0 con 0x7f10d410e970 2019-11-28T11:58:37.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.063+0000 7f10d93a6700 1 -- 172.21.15.80:0/3095628503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d4106270 con 0x7f10d410e970 2019-11-28T11:58:37.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.063+0000 7f10cbfff700 1 -- 172.21.15.80:0/3095628503 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10c00016d0 con 0x7f10d410e970 2019-11-28T11:58:37.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.063+0000 7f10d93a6700 1 -- 172.21.15.80:0/3095628503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d4105ef0 con 0x7f10d410e970 2019-11-28T11:58:37.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.063+0000 7f10d37fe700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d410e970 0x7f10d41087b0 secure :-1 s=THROTTLE_DONE pgs=2924 cs=0 l=1 rx=0x7f10c00103e0 tx=0x7f10c00102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.063+0000 7f10cbfff700 1 -- 172.21.15.80:0/3095628503 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f10c0000c90 con 0x7f10d410e970 2019-11-28T11:58:37.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.063+0000 7f10d37fe700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d410e970 0x7f10d41087b0 secure :-1 s=THROTTLE_DONE pgs=2924 cs=0 l=1 rx=0x7f10c00103e0 tx=0x7f10c00102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.063+0000 7f10cbfff700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10b0018730 0x7f10b001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:37.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.063+0000 7f10cbfff700 1 -- 172.21.15.80:0/3095628503 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f10c00319f0 con 0x7f10d410e970 2019-11-28T11:58:37.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.063+0000 7f10d2ffd700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10b0018730 0x7f10b001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:37.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.064+0000 7f10d2ffd700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10b0018730 0x7f10b001abc0 crc :-1 s=READY pgs=1211 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:37.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.071+0000 7f10d93a6700 1 -- 172.21.15.80:0/3095628503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d4106270 con 0x7f10d410e970 2019-11-28T11:58:37.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.074+0000 7f10d37fe700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d410e970 0x7f10d41087b0 secure :-1 s=THROTTLE_DONE pgs=2924 cs=0 l=1 rx=0x7f10c00103e0 tx=0x7f10c00102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.074+0000 7f10cbfff700 1 -- 172.21.15.80:0/3095628503 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f10c00075d0 con 0x7f10d410e970 2019-11-28T11:58:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.242+0000 7f10d93a6700 1 -- 172.21.15.80:0/3095628503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f10d4105ef0 con 0x7f10d410e970 2019-11-28T11:58:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.242+0000 7f10d37fe700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d410e970 0x7f10d41087b0 secure :-1 s=THROTTLE_DONE pgs=2924 cs=0 l=1 rx=0x7f10c00103e0 tx=0x7f10c00102e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.242+0000 7f10cbfff700 1 -- 172.21.15.80:0/3095628503 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v223) v1 ==== 100+0+10 (secure 0 0 0) 0x7f10c0000c90 con 0x7f10d410e970 2019-11-28T11:58:37.239 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T11:58:37.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.245+0000 7f10d93a6700 1 -- 172.21.15.80:0/3095628503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10b0018730 msgr2=0x7f10b001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:37.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.245+0000 7f10d93a6700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10b0018730 0x7f10b001abc0 crc :-1 s=READY pgs=1211 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.245+0000 7f10d93a6700 1 -- 172.21.15.80:0/3095628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d410e970 msgr2=0x7f10d41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.245+0000 7f10d93a6700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d410e970 0x7f10d41087b0 secure :-1 s=READY pgs=2924 cs=0 l=1 rx=0x7f10c00103e0 tx=0x7f10c00102e0).stop 2019-11-28T11:58:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.245+0000 7f10d93a6700 1 -- 172.21.15.80:0/3095628503 shutdown_connections 2019-11-28T11:58:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.245+0000 7f10d93a6700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10b0018730 0x7f10b001abc0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.245+0000 7f10d93a6700 1 --2- 172.21.15.80:0/3095628503 >> v2:172.21.15.174:3300/0 conn(0x7f10d4107b70 0x7f10d4107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.245+0000 7f10d93a6700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10d4108cf0 0x7f10d4107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.245+0000 7f10d93a6700 1 --2- 172.21.15.80:0/3095628503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10d410e970 0x7f10d41087b0 unknown :-1 s=CLOSED pgs=2924 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:37.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.245+0000 7f10d93a6700 1 -- 172.21.15.80:0/3095628503 shutdown_connections 2019-11-28T11:58:37.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.245+0000 7f10d93a6700 1 -- 172.21.15.80:0/3095628503 wait complete. 2019-11-28T11:58:37.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.245+0000 7f10d93a6700 1 -- 172.21.15.80:0/3095628503 >> 172.21.15.80:0/3095628503 conn(0x7f10d415e2d0 msgr2=0x7f10d4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:37.250 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T11:58:37.252 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:58:37.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.375+0000 7fe951902700 1 Processor -- start 2019-11-28T11:58:37.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.375+0000 7fe951902700 1 -- start start 2019-11-28T11:58:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.376+0000 7fe951902700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe94c06c0a0 0x7fe94c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.376+0000 7fe951902700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c072620 0x7fe94c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.376+0000 7fe951902700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c06db00 con 0x7fe94c0734e0 2019-11-28T11:58:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.376+0000 7fe951902700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe94c06fd60 con 0x7fe94c06c0a0 2019-11-28T11:58:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.376+0000 7fe951902700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c070030 con 0x7fe94c072620 2019-11-28T11:58:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.376+0000 7fe94bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c072620 0x7fe94c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.376+0000 7fe94b7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe94c06c0a0 0x7fe94c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.376+0000 7fe94bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c072620 0x7fe94c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:49542/0 (socket says 172.21.15.80:49542) 2019-11-28T11:58:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.376+0000 7fe94b7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe94c06c0a0 0x7fe94c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:33934/0 (socket says 172.21.15.80:33934) 2019-11-28T11:58:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.376+0000 7fe94affd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe94c0734e0 0x7fe94c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:33912/0 (socket says 172.21.15.80:33912) 2019-11-28T11:58:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.376+0000 7fe94bfff700 1 -- 172.21.15.80:0/2679934114 learned_addr learned my addr 172.21.15.80:0/2679934114 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.377+0000 7fe94bfff700 1 -- 172.21.15.80:0/2679934114 >> v2:172.21.15.174:3300/0 conn(0x7fe94c06c0a0 msgr2=0x7fe94c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.377+0000 7fe94bfff700 1 --2- 172.21.15.80:0/2679934114 >> v2:172.21.15.174:3300/0 conn(0x7fe94c06c0a0 0x7fe94c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.377+0000 7fe94bfff700 1 -- 172.21.15.80:0/2679934114 >> v1:172.21.15.174:6789/0 conn(0x7fe94c0734e0 legacy=0x7fe94c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.377+0000 7fe94bfff700 1 -- 172.21.15.80:0/2679934114 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c0706c0 con 0x7fe94c072620 2019-11-28T11:58:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.377+0000 7fe94b7fe700 1 --2- 172.21.15.80:0/2679934114 >> v2:172.21.15.174:3300/0 conn(0x7fe94c06c0a0 0x7fe94c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.377+0000 7fe94bfff700 1 --2- 172.21.15.80:0/2679934114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c072620 0x7fe94c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe94400f760 tx=0x7fe94400f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.377+0000 7fe94bfff700 1 --2- 172.21.15.80:0/2679934114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c072620 0x7fe94c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe94400f760 tx=0x7fe94400f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.377+0000 7fe94bfff700 1 --2- 172.21.15.80:0/2679934114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c072620 0x7fe94c164d70 secure :-1 s=READY pgs=424 cs=0 l=1 rx=0x7fe94400f760 tx=0x7fe94400f590).ready entity=mon.2 client_cookie=f5c350917cb38cc9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.377+0000 7fe94bfff700 1 --2- 172.21.15.80:0/2679934114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c072620 0x7fe94c164d70 secure :-1 s=THROTTLE_DONE pgs=424 cs=0 l=1 rx=0x7fe94400f760 tx=0x7fe94400f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.377+0000 7fe94bfff700 1 --2- 172.21.15.80:0/2679934114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c072620 0x7fe94c164d70 secure :-1 s=THROTTLE_DONE pgs=424 cs=0 l=1 rx=0x7fe94400f760 tx=0x7fe94400f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.377+0000 7fe94bfff700 1 --2- 172.21.15.80:0/2679934114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c072620 0x7fe94c164d70 secure :-1 s=THROTTLE_DONE pgs=424 cs=0 l=1 rx=0x7fe94400f760 tx=0x7fe94400f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.377+0000 7fe94a7fc700 1 -- 172.21.15.80:0/2679934114 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe944000a70 con 0x7fe94c072620 2019-11-28T11:58:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.377+0000 7fe94a7fc700 1 -- 172.21.15.80:0/2679934114 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe944000e70 con 0x7fe94c072620 2019-11-28T11:58:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.377+0000 7fe94a7fc700 1 -- 172.21.15.80:0/2679934114 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe944001500 con 0x7fe94c072620 2019-11-28T11:58:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.377+0000 7fe951902700 1 -- 172.21.15.80:0/2679934114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c072620 msgr2=0x7fe94c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.377+0000 7fe951902700 1 --2- 172.21.15.80:0/2679934114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c072620 0x7fe94c164d70 secure :-1 s=READY pgs=424 cs=0 l=1 rx=0x7fe94400f760 tx=0x7fe94400f590).stop 2019-11-28T11:58:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.378+0000 7fe951902700 1 -- 172.21.15.80:0/2679934114 shutdown_connections 2019-11-28T11:58:37.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.378+0000 7fe951902700 1 --2- 172.21.15.80:0/2679934114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c072620 0x7fe94c164d70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:37.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.378+0000 7fe951902700 1 --2- 172.21.15.80:0/2679934114 >> v2:172.21.15.174:3300/0 conn(0x7fe94c06c0a0 0x7fe94c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:37.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.378+0000 7fe951902700 1 -- 172.21.15.80:0/2679934114 shutdown_connections 2019-11-28T11:58:37.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.378+0000 7fe951902700 1 -- 172.21.15.80:0/2679934114 wait complete. 2019-11-28T11:58:37.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.378+0000 7fe951902700 1 -- 172.21.15.80:0/2679934114 >> 172.21.15.80:0/2679934114 conn(0x7fe94c061cf0 msgr2=0x7fe94c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:37.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.380+0000 7fe951902700 1 Processor -- start 2019-11-28T11:58:37.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.380+0000 7fe951902700 1 -- start start 2019-11-28T11:58:37.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.381+0000 7fe951902700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe94c13e9e0 0x7fe94c108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:37.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.381+0000 7fe951902700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c109430 0x7fe94c1098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:37.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.381+0000 7fe951902700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c1066e0 con 0x7fe94c13e5f0 2019-11-28T11:58:37.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.381+0000 7fe951902700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe94c10e060 con 0x7fe94c13e9e0 2019-11-28T11:58:37.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.381+0000 7fe951902700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c10e330 con 0x7fe94c109430 2019-11-28T11:58:37.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.381+0000 7fe94affd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe94c13e9e0 0x7fe94c108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:37.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.381+0000 7fe94b7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe94c13e5f0 0x7fe94c10a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46602/0 (socket says 172.21.15.80:46602) 2019-11-28T11:58:37.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.381+0000 7fe94b7fe700 1 -- 172.21.15.80:0/3539073712 learned_addr learned my addr 172.21.15.80:0/3539073712 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:37.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.381+0000 7fe94affd700 1 --2- 172.21.15.80:0/3539073712 >> v2:172.21.15.80:3300/0 conn(0x7fe94c13e9e0 0x7fe94c108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47288/0 (socket says 172.21.15.80:47288) 2019-11-28T11:58:37.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.381+0000 7fe94bfff700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c109430 0x7fe94c1098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:37.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe943fff700 1 -- 172.21.15.80:0/3539073712 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554593430 0 0) 0x7fe93c00dd90 con 0x7fe94c13e5f0 2019-11-28T11:58:37.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe943fff700 1 -- 172.21.15.80:0/3539073712 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe924002e80 con 0x7fe94c13e5f0 2019-11-28T11:58:37.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe94affd700 1 -- 172.21.15.80:0/3539073712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c109430 msgr2=0x7fe94c1098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:37.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe94affd700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c109430 0x7fe94c1098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:37.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe94affd700 1 -- 172.21.15.80:0/3539073712 >> v1:172.21.15.80:6789/0 conn(0x7fe94c13e5f0 legacy=0x7fe94c10a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:37.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe94affd700 1 -- 172.21.15.80:0/3539073712 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c10e9c0 con 0x7fe94c13e9e0 2019-11-28T11:58:37.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe94bfff700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c109430 0x7fe94c1098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T11:58:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe94affd700 1 --2- 172.21.15.80:0/3539073712 >> v2:172.21.15.80:3300/0 conn(0x7fe94c13e9e0 0x7fe94c108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe934010720 tx=0x7fe934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe94affd700 1 --2- 172.21.15.80:0/3539073712 >> v2:172.21.15.80:3300/0 conn(0x7fe94c13e9e0 0x7fe94c108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe934010720 tx=0x7fe934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe94affd700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe94c13e9e0 0x7fe94c108ef0 secure :-1 s=READY pgs=2926 cs=0 l=1 rx=0x7fe934010720 tx=0x7fe934010ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe94affd700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe94c13e9e0 0x7fe94c108ef0 secure :-1 s=THROTTLE_DONE pgs=2926 cs=0 l=1 rx=0x7fe934010720 tx=0x7fe934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe943fff700 1 -- 172.21.15.80:0/3539073712 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9340010c0 con 0x7fe94c13e9e0 2019-11-28T11:58:37.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe94affd700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe94c13e9e0 0x7fe94c108ef0 secure :-1 s=THROTTLE_DONE pgs=2926 cs=0 l=1 rx=0x7fe934010720 tx=0x7fe934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe94affd700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe94c13e9e0 0x7fe94c108ef0 secure :-1 s=THROTTLE_DONE pgs=2926 cs=0 l=1 rx=0x7fe934010720 tx=0x7fe934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe943fff700 1 -- 172.21.15.80:0/3539073712 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe934004360 con 0x7fe94c13e9e0 2019-11-28T11:58:37.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe951902700 1 -- 172.21.15.80:0/3539073712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe94c10ed40 con 0x7fe94c13e9e0 2019-11-28T11:58:37.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe943fff700 1 -- 172.21.15.80:0/3539073712 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe934004840 con 0x7fe94c13e9e0 2019-11-28T11:58:37.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe951902700 1 -- 172.21.15.80:0/3539073712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94c10e9c0 con 0x7fe94c13e9e0 2019-11-28T11:58:37.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.382+0000 7fe94affd700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe94c13e9e0 0x7fe94c108ef0 secure :-1 s=THROTTLE_DONE pgs=2926 cs=0 l=1 rx=0x7fe934010720 tx=0x7fe934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.383+0000 7fe943fff700 1 -- 172.21.15.80:0/3539073712 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe934001060 con 0x7fe94c13e9e0 2019-11-28T11:58:37.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.383+0000 7fe94affd700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe94c13e9e0 0x7fe94c108ef0 secure :-1 s=THROTTLE_DONE pgs=2926 cs=0 l=1 rx=0x7fe934010720 tx=0x7fe934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.383+0000 7fe943fff700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe924018770 0x7fe92401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:37.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.383+0000 7fe943fff700 1 -- 172.21.15.80:0/3539073712 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe934031da0 con 0x7fe94c13e9e0 2019-11-28T11:58:37.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.383+0000 7fe94b7fe700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe924018770 0x7fe92401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:37.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.383+0000 7fe94b7fe700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe924018770 0x7fe92401abe0 crc :-1 s=READY pgs=1212 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:37.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.390+0000 7fe951902700 1 -- 172.21.15.80:0/3539073712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94c10ed40 con 0x7fe94c13e9e0 2019-11-28T11:58:37.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.394+0000 7fe94affd700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe94c13e9e0 0x7fe94c108ef0 secure :-1 s=THROTTLE_DONE pgs=2926 cs=0 l=1 rx=0x7fe934010720 tx=0x7fe934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.394+0000 7fe943fff700 1 -- 172.21.15.80:0/3539073712 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe9340015b0 con 0x7fe94c13e9e0 2019-11-28T11:58:37.561 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.565+0000 7fe951902700 1 -- 172.21.15.80:0/3539073712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe94c10e9c0 con 0x7fe94c13e9e0 2019-11-28T11:58:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.566+0000 7fe94affd700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe94c13e9e0 0x7fe94c108ef0 secure :-1 s=THROTTLE_DONE pgs=2926 cs=0 l=1 rx=0x7fe934010720 tx=0x7fe934010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:37.562 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.566+0000 7fe943fff700 1 -- 172.21.15.80:0/3539073712 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 186 v186) v1 ==== 95+0+2457 (secure 0 0 0) 0x7fe934000cc0 con 0x7fe94c13e9e0 2019-11-28T11:58:37.563 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 186 2019-11-28T11:58:37.563 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:37.563 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":186,"default_fscid":18,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":11665,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/3051174059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3051174059},{"type":"v1","addr":"172.21.15.174:6835","nonce":3051174059}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":184},{"gid":12435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2096320481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2096320481},{"type":"v1","addr":"172.21.15.80:6834","nonce":2096320481}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":184}],"filesystems":[{"mdsmap":{"epoch":186,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:58:24.286894+0000","modified":"2019-11-28T11:58:31.978284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8138":{"gid":8138,"name":"a","rank":0,"incarnation":185,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6835/4148152245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":4148152245},{"type":"v1","addr":"172.21.15.80:6835","nonce":4148152245}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[37],"metadata_pool":36,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":18}]} 2019-11-28T11:58:37.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.568+0000 7fe951902700 1 -- 172.21.15.80:0/3539073712 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe924018770 msgr2=0x7fe92401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:37.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.568+0000 7fe951902700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe924018770 0x7fe92401abe0 crc :-1 s=READY pgs=1212 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:37.565 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.568+0000 7fe951902700 1 -- 172.21.15.80:0/3539073712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe94c13e9e0 msgr2=0x7fe94c108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:37.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.568+0000 7fe951902700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe94c13e9e0 0x7fe94c108ef0 secure :-1 s=READY pgs=2926 cs=0 l=1 rx=0x7fe934010720 tx=0x7fe934010ac0).stop 2019-11-28T11:58:37.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.568+0000 7fe951902700 1 -- 172.21.15.80:0/3539073712 shutdown_connections 2019-11-28T11:58:37.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.568+0000 7fe951902700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe924018770 0x7fe92401abe0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:37.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.568+0000 7fe951902700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe94c109430 0x7fe94c1098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:37.566 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.568+0000 7fe951902700 1 --2- 172.21.15.80:0/3539073712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe94c13e9e0 0x7fe94c108ef0 unknown :-1 s=CLOSED pgs=2926 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:37.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.568+0000 7fe951902700 1 -- 172.21.15.80:0/3539073712 shutdown_connections 2019-11-28T11:58:37.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.568+0000 7fe951902700 1 -- 172.21.15.80:0/3539073712 wait complete. 2019-11-28T11:58:37.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:37.568+0000 7fe951902700 1 -- 172.21.15.80:0/3539073712 >> 172.21.15.80:0/3539073712 conn(0x7fe94c13d620 msgr2=0x7fe94c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:37.876 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8138}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 36, u'failed': [], u'epoch': 186, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [37], u'info': {u'gid_8138': {u'export_targets': [], u'name': u'a', u'incarnation': 185, u'state_seq': 3, u'state': u'up:active', u'gid': 8138, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 4148152245, u'type': u'v2', u'addr': u'172.21.15.80:6833'}, {u'nonce': 4148152245, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/4148152245'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:58:24.286894+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:58:31.978284+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T11:58:37.876 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T11:58:37.876 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2019-11-28T11:58:38.002 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T11:58:38.002 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T11:58:38.002 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T11:58:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 8138, 2019-11-28T11:58:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2019-11-28T11:58:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2019-11-28T11:58:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 7.0262855899999996, 2019-11-28T11:58:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 186, 2019-11-28T11:58:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 223, 2019-11-28T11:58:38.003 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 223, 2019-11-28T11:58:38.004 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 11.299583973000001 2019-11-28T11:58:38.004 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T11:58:38.008 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8138, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.0262855899999996, "mdsmap_epoch": 186, "osdmap_epoch": 223, "osdmap_epoch_barrier": 223, "uptime": 11.299583973000001 } 2019-11-28T11:58:38.009 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T11:58:38.009 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T11:58:38.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:58:38.009 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T11:58:38.079 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T11:58:38.079 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:58:38.199 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:58:38.200 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:58:38.200 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T11:58:38.200 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T11:58:38.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:58:38.201 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T11:58:38.282 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T11:58:38.413 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:58:38.413 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T11:58:38.413 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:58:38.419 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T11:58:38.419 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T11:58:38.541 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T11:58:38.542 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T11:58:38.542 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T11:58:38.547 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T11:58:38.548 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:58:38.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.671+0000 7fd2cfeed700 1 Processor -- start 2019-11-28T11:58:38.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.671+0000 7fd2cfeed700 1 -- start start 2019-11-28T11:58:38.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.672+0000 7fd2cfeed700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2c806c0a0 0x7fd2c8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:38.671 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.672+0000 7fd2cfeed700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2c8072620 0x7fd2c8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:38.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.672+0000 7fd2cfeed700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c806db00 con 0x7fd2c80734e0 2019-11-28T11:58:38.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.672+0000 7fd2cfeed700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c806f330 con 0x7fd2c8072620 2019-11-28T11:58:38.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.672+0000 7fd2cfeed700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c80706c0 con 0x7fd2c806c0a0 2019-11-28T11:58:38.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.672+0000 7fd2cec8b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2c8072620 0x7fd2c8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:38.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.672+0000 7fd2cec8b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2c8072620 0x7fd2c8164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47296/0 (socket says 172.21.15.80:47296) 2019-11-28T11:58:38.672 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.672+0000 7fd2cec8b700 1 -- 172.21.15.80:0/482377477 learned_addr learned my addr 172.21.15.80:0/482377477 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:38.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.672+0000 7fd2ce48a700 1 --2- 172.21.15.80:0/482377477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2c806c0a0 0x7fd2c8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:38.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.672+0000 7fd2cec8b700 1 -- 172.21.15.80:0/482377477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2c806c0a0 msgr2=0x7fd2c8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:38.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.672+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/482377477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2c806c0a0 0x7fd2c8072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:38.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.672+0000 7fd2cec8b700 1 -- 172.21.15.80:0/482377477 >> v1:172.21.15.174:6789/0 conn(0x7fd2c80734e0 legacy=0x7fd2c8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:58:38.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.672+0000 7fd2cec8b700 1 -- 172.21.15.80:0/482377477 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c8070a40 con 0x7fd2c8072620 2019-11-28T11:58:38.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.672+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/482377477 >> v2:172.21.15.80:3300/0 conn(0x7fd2c8072620 0x7fd2c8164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2c000fa30 tx=0x7fd2c000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:38.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.672+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/482377477 >> v2:172.21.15.80:3300/0 conn(0x7fd2c8072620 0x7fd2c8164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2c000fa30 tx=0x7fd2c000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:38.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.673+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/482377477 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2c8072620 0x7fd2c8164d70 secure :-1 s=READY pgs=2927 cs=0 l=1 rx=0x7fd2c000fa30 tx=0x7fd2c000fdd0).ready entity=mon.0 client_cookie=73f816397919a59 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:38.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.673+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/482377477 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2c8072620 0x7fd2c8164d70 secure :-1 s=THROTTLE_DONE pgs=2927 cs=0 l=1 rx=0x7fd2c000fa30 tx=0x7fd2c000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:38.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.673+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/482377477 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2c8072620 0x7fd2c8164d70 secure :-1 s=THROTTLE_DONE pgs=2927 cs=0 l=1 rx=0x7fd2c000fa30 tx=0x7fd2c000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:38.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.673+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/482377477 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2c8072620 0x7fd2c8164d70 secure :-1 s=THROTTLE_DONE pgs=2927 cs=0 l=1 rx=0x7fd2c000fa30 tx=0x7fd2c000fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:38.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.673+0000 7fd2cd488700 1 -- 172.21.15.80:0/482377477 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c0000df0 con 0x7fd2c8072620 2019-11-28T11:58:38.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.673+0000 7fd2cd488700 1 -- 172.21.15.80:0/482377477 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c0001460 con 0x7fd2c8072620 2019-11-28T11:58:38.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.673+0000 7fd2cd488700 1 -- 172.21.15.80:0/482377477 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c0001b30 con 0x7fd2c8072620 2019-11-28T11:58:38.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.673+0000 7fd2cfeed700 1 -- 172.21.15.80:0/482377477 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2c8072620 msgr2=0x7fd2c8164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:38.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.673+0000 7fd2cfeed700 1 --2- 172.21.15.80:0/482377477 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2c8072620 0x7fd2c8164d70 secure :-1 s=READY pgs=2927 cs=0 l=1 rx=0x7fd2c000fa30 tx=0x7fd2c000fdd0).stop 2019-11-28T11:58:38.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.673+0000 7fd2cfeed700 1 -- 172.21.15.80:0/482377477 shutdown_connections 2019-11-28T11:58:38.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.673+0000 7fd2cfeed700 1 --2- 172.21.15.80:0/482377477 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2c8072620 0x7fd2c8164d70 unknown :-1 s=CLOSED pgs=2927 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:38.675 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.673+0000 7fd2cfeed700 1 --2- 172.21.15.80:0/482377477 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2c806c0a0 0x7fd2c8072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:58:38.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.674+0000 7fd2cfeed700 1 -- 172.21.15.80:0/482377477 shutdown_connections 2019-11-28T11:58:38.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.674+0000 7fd2cfeed700 1 -- 172.21.15.80:0/482377477 wait complete. 2019-11-28T11:58:38.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.674+0000 7fd2cfeed700 1 -- 172.21.15.80:0/482377477 >> 172.21.15.80:0/482377477 conn(0x7fd2c8061cf0 msgr2=0x7fd2c8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:38.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.676+0000 7fd2cfeed700 1 Processor -- start 2019-11-28T11:58:38.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.676+0000 7fd2cfeed700 1 -- start start 2019-11-28T11:58:38.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.677+0000 7fd2cfeed700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd2c8166a10 0x7fd2c8168e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:38.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.677+0000 7fd2cfeed700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c813bcd0 con 0x7fd2c8104820 2019-11-28T11:58:38.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.677+0000 7fd2cfeed700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c8105ea0 con 0x7fd2c8104c10 2019-11-28T11:58:38.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.677+0000 7fd2cfeed700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c8109130 con 0x7fd2c8166a10 2019-11-28T11:58:38.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.677+0000 7fd2ce48a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd2c8104820 0x7fd2c810c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46616/0 (socket says 172.21.15.80:46616) 2019-11-28T11:58:38.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.677+0000 7fd2ce48a700 1 -- 172.21.15.80:0/2421855464 learned_addr learned my addr 172.21.15.80:0/2421855464 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:38.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.677+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/2421855464 >> v2:172.21.15.174:3300/0 conn(0x7fd2c8166a10 0x7fd2c8168e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:38.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.677+0000 7fd2c6ffd700 1 -- 172.21.15.80:0/2421855464 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509056005 0 0) 0x7fd2bc000fb0 con 0x7fd2c8104820 2019-11-28T11:58:38.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.677+0000 7fd2c6ffd700 1 -- 172.21.15.80:0/2421855464 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2b0002e80 con 0x7fd2c8104820 2019-11-28T11:58:38.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.677+0000 7fd2c6ffd700 1 -- 172.21.15.80:0/2421855464 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 329304389 0 0) 0x7fd2bc001140 con 0x7fd2c8104820 2019-11-28T11:58:38.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.677+0000 7fd2c6ffd700 1 -- 172.21.15.80:0/2421855464 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd2b00032e0 con 0x7fd2c8104820 2019-11-28T11:58:38.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.677+0000 7fd2c6ffd700 1 -- 172.21.15.80:0/2421855464 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fd2bc001670 con 0x7fd2c8104820 2019-11-28T11:58:38.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.677+0000 7fd2cec8b700 1 -- 172.21.15.80:0/2421855464 >> v1:172.21.15.174:6789/0 conn(0x7fd2c8104c10 legacy=0x7fd2c81050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:38.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.677+0000 7fd2cec8b700 1 -- 172.21.15.80:0/2421855464 >> v1:172.21.15.80:6789/0 conn(0x7fd2c8104820 legacy=0x7fd2c810c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:38.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.677+0000 7fd2cec8b700 1 -- 172.21.15.80:0/2421855464 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c8109a90 con 0x7fd2c8166a10 2019-11-28T11:58:38.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.677+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/2421855464 >> v2:172.21.15.174:3300/0 conn(0x7fd2c8166a10 0x7fd2c8168e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2c0007f80 tx=0x7fd2c0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:38.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.678+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/2421855464 >> v2:172.21.15.174:3300/0 conn(0x7fd2c8166a10 0x7fd2c8168e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2c0007f80 tx=0x7fd2c0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:38.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.678+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c8166a10 0x7fd2c8168e10 secure :-1 s=READY pgs=1770 cs=0 l=1 rx=0x7fd2c0007f80 tx=0x7fd2c0010aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:38.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.678+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c8166a10 0x7fd2c8168e10 secure :-1 s=THROTTLE_DONE pgs=1770 cs=0 l=1 rx=0x7fd2c0007f80 tx=0x7fd2c0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:38.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.678+0000 7fd2c6ffd700 1 -- 172.21.15.80:0/2421855464 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c0008500 con 0x7fd2c8166a10 2019-11-28T11:58:38.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.678+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c8166a10 0x7fd2c8168e10 secure :-1 s=THROTTLE_DONE pgs=1770 cs=0 l=1 rx=0x7fd2c0007f80 tx=0x7fd2c0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:38.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.678+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c8166a10 0x7fd2c8168e10 secure :-1 s=THROTTLE_DONE pgs=1770 cs=0 l=1 rx=0x7fd2c0007f80 tx=0x7fd2c0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:38.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.678+0000 7fd2c6ffd700 1 -- 172.21.15.80:0/2421855464 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c00082c0 con 0x7fd2c8166a10 2019-11-28T11:58:38.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.678+0000 7fd2cfeed700 1 -- 172.21.15.80:0/2421855464 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c8109e10 con 0x7fd2c8166a10 2019-11-28T11:58:38.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.678+0000 7fd2c6ffd700 1 -- 172.21.15.80:0/2421855464 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c0001a10 con 0x7fd2c8166a10 2019-11-28T11:58:38.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.678+0000 7fd2cfeed700 1 -- 172.21.15.80:0/2421855464 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c8109a90 con 0x7fd2c8166a10 2019-11-28T11:58:38.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.678+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c8166a10 0x7fd2c8168e10 secure :-1 s=THROTTLE_DONE pgs=1770 cs=0 l=1 rx=0x7fd2c0007f80 tx=0x7fd2c0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:38.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.678+0000 7fd2c6ffd700 1 -- 172.21.15.80:0/2421855464 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd2c0001580 con 0x7fd2c8166a10 2019-11-28T11:58:38.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.678+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c8166a10 0x7fd2c8168e10 secure :-1 s=THROTTLE_DONE pgs=1770 cs=0 l=1 rx=0x7fd2c0007f80 tx=0x7fd2c0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:38.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.679+0000 7fd2c6ffd700 1 --2- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd2b0018770 0x7fd2b001ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:38.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.679+0000 7fd2c6ffd700 1 -- 172.21.15.80:0/2421855464 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd2c0031de0 con 0x7fd2c8166a10 2019-11-28T11:58:38.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.679+0000 7fd2ce48a700 1 --2- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd2b0018770 0x7fd2b001ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:38.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.679+0000 7fd2ce48a700 1 --2- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd2b0018770 0x7fd2b001ac00 crc :-1 s=READY pgs=1213 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:38.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.686+0000 7fd2cfeed700 1 -- 172.21.15.80:0/2421855464 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c8109e10 con 0x7fd2c8166a10 2019-11-28T11:58:38.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.690+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c8166a10 0x7fd2c8168e10 secure :-1 s=THROTTLE_DONE pgs=1770 cs=0 l=1 rx=0x7fd2c0007f80 tx=0x7fd2c0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:38.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.690+0000 7fd2c6ffd700 1 -- 172.21.15.80:0/2421855464 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd2c0001230 con 0x7fd2c8166a10 2019-11-28T11:58:38.815 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:58:38.820 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:58:38.825 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:58:38.837 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:58:38.848 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:58:38.855 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:58:38.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.864+0000 7fd2cfeed700 1 -- 172.21.15.80:0/2421855464 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2c8109a90 con 0x7fd2c8166a10 2019-11-28T11:58:38.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.865+0000 7fd2cec8b700 1 --2- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c8166a10 0x7fd2c8168e10 secure :-1 s=THROTTLE_DONE pgs=1770 cs=0 l=1 rx=0x7fd2c0007f80 tx=0x7fd2c0010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:38.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.865+0000 7fd2c6ffd700 1 -- 172.21.15.80:0/2421855464 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 186 v186) v1 ==== 95+0+2457 (secure 0 0 0) 0x7fd2c00014e0 con 0x7fd2c8166a10 2019-11-28T11:58:38.862 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 186 2019-11-28T11:58:38.862 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:38.863 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":186,"default_fscid":18,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":11665,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/3051174059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3051174059},{"type":"v1","addr":"172.21.15.174:6835","nonce":3051174059}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":184},{"gid":12435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2096320481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2096320481},{"type":"v1","addr":"172.21.15.80:6834","nonce":2096320481}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":184}],"filesystems":[{"mdsmap":{"epoch":186,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:58:24.286894+0000","modified":"2019-11-28T11:58:31.978284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8138":{"gid":8138,"name":"a","rank":0,"incarnation":185,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6835/4148152245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":4148152245},{"type":"v1","addr":"172.21.15.80:6835","nonce":4148152245}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[37],"metadata_pool":36,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":18}]} 2019-11-28T11:58:38.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.868+0000 7fd2cfeed700 1 -- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd2b0018770 msgr2=0x7fd2b001ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:38.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.868+0000 7fd2cfeed700 1 --2- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd2b0018770 0x7fd2b001ac00 crc :-1 s=READY pgs=1213 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:38.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.868+0000 7fd2cfeed700 1 -- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c8166a10 msgr2=0x7fd2c8168e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:38.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.868+0000 7fd2cfeed700 1 --2- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c8166a10 0x7fd2c8168e10 secure :-1 s=READY pgs=1770 cs=0 l=1 rx=0x7fd2c0007f80 tx=0x7fd2c0010aa0).stop 2019-11-28T11:58:38.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.868+0000 7fd2cfeed700 1 -- 172.21.15.80:0/2421855464 shutdown_connections 2019-11-28T11:58:38.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.868+0000 7fd2cfeed700 1 --2- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c8166a10 0x7fd2c8168e10 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:38.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.868+0000 7fd2cfeed700 1 --2- 172.21.15.80:0/2421855464 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd2b0018770 0x7fd2b001ac00 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:38.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.868+0000 7fd2cfeed700 1 -- 172.21.15.80:0/2421855464 shutdown_connections 2019-11-28T11:58:38.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.868+0000 7fd2cfeed700 1 -- 172.21.15.80:0/2421855464 wait complete. 2019-11-28T11:58:38.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:38.868+0000 7fd2cfeed700 1 -- 172.21.15.80:0/2421855464 >> 172.21.15.80:0/2421855464 conn(0x7fd2c813d620 msgr2=0x7fd2c813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:38.874 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits daemon-helper kill python -c ' 2019-11-28T11:58:38.875 INFO:teuthology.orchestra.run.smithi076:> import time 2019-11-28T11:58:38.875 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:58:38.875 INFO:teuthology.orchestra.run.smithi076:> f = open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') 2019-11-28T11:58:38.876 INFO:teuthology.orchestra.run.smithi076:> f.write('"'"'content'"'"') 2019-11-28T11:58:38.876 INFO:teuthology.orchestra.run.smithi076:> f.flush() 2019-11-28T11:58:38.877 INFO:teuthology.orchestra.run.smithi076:> f.write('"'"'content2'"'"') 2019-11-28T11:58:38.877 INFO:teuthology.orchestra.run.smithi076:> while True: 2019-11-28T11:58:38.877 INFO:teuthology.orchestra.run.smithi076:> time.sleep(1) 2019-11-28T11:58:38.877 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:58:38.882 INFO:teuthology.orchestra.run.smithi076:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2019-11-28T11:58:38.940 INFO:teuthology.orchestra.run.smithi076.stderr:ls: cannot access /home/ubuntu/cephtest/mnt.0/background_file: No such file or directory 2019-11-28T11:58:38.940 DEBUG:teuthology.orchestra.run:got remote process result: 2 2019-11-28T11:58:39.941 INFO:teuthology.orchestra.run.smithi076:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2019-11-28T11:58:40.010 INFO:teuthology.orchestra.run.smithi076.stdout:/home/ubuntu/cephtest/mnt.0/background_file 2019-11-28T11:58:40.015 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 1s 2019-11-28T11:58:40.015 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:58:40.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.145+0000 7f2230725700 1 Processor -- start 2019-11-28T11:58:40.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.145+0000 7f2230725700 1 -- start start 2019-11-28T11:58:40.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.146+0000 7f2230725700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f222806d120 0x7f2228165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:58:40.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.146+0000 7f2230725700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222806d5a0 con 0x7f222806c0a0 2019-11-28T11:58:40.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.146+0000 7f2230725700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222806db00 con 0x7f222806c490 2019-11-28T11:58:40.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.146+0000 7f2230725700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222806fd60 con 0x7f222806d120 2019-11-28T11:58:40.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.146+0000 7f222ecc2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f222806c0a0 0x7f2228072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46624/0 (socket says 172.21.15.80:46624) 2019-11-28T11:58:40.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.146+0000 7f222ecc2700 1 -- 172.21.15.80:0/657872418 learned_addr learned my addr 172.21.15.80:0/657872418 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:58:40.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.146+0000 7f222f4c3700 1 --2- 172.21.15.80:0/657872418 >> v2:172.21.15.174:3300/0 conn(0x7f222806d120 0x7f2228165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:40.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.146+0000 7f222dcc0700 1 -- 172.21.15.80:0/657872418 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908772991 0 0) 0x7f22100014d0 con 0x7f222806c0a0 2019-11-28T11:58:40.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f222dcc0700 1 -- 172.21.15.80:0/657872418 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2214002e80 con 0x7f222806c0a0 2019-11-28T11:58:40.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f222dcc0700 1 -- 172.21.15.80:0/657872418 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216363408 0 0) 0x7f2218001080 con 0x7f222806c490 2019-11-28T11:58:40.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f222dcc0700 1 -- 172.21.15.80:0/657872418 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22140030b0 con 0x7f222806c490 2019-11-28T11:58:40.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f222dcc0700 1 -- 172.21.15.80:0/657872418 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1581452058 0 0) 0x7f22100014b0 con 0x7f222806c0a0 2019-11-28T11:58:40.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f222f4c3700 1 -- 172.21.15.80:0/657872418 >> v1:172.21.15.174:6789/0 conn(0x7f222806c490 legacy=0x7f222806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:40.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f222f4c3700 1 -- 172.21.15.80:0/657872418 >> v1:172.21.15.80:6789/0 conn(0x7f222806c0a0 legacy=0x7f2228072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:40.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f222f4c3700 1 -- 172.21.15.80:0/657872418 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22280706c0 con 0x7f222806d120 2019-11-28T11:58:40.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f222f4c3700 1 --2- 172.21.15.80:0/657872418 >> v2:172.21.15.174:3300/0 conn(0x7f222806d120 0x7f2228165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f222000af80 tx=0x7f222000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:40.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f222f4c3700 1 --2- 172.21.15.80:0/657872418 >> v2:172.21.15.174:3300/0 conn(0x7f222806d120 0x7f2228165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f222000af80 tx=0x7f222000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:40.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f222f4c3700 1 --2- 172.21.15.80:0/657872418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222806d120 0x7f2228165d80 secure :-1 s=READY pgs=1772 cs=0 l=1 rx=0x7f222000af80 tx=0x7f222000b790).ready entity=mon.1 client_cookie=49dcfb156e5de714 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:40.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f222f4c3700 1 --2- 172.21.15.80:0/657872418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222806d120 0x7f2228165d80 secure :-1 s=THROTTLE_DONE pgs=1772 cs=0 l=1 rx=0x7f222000af80 tx=0x7f222000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:40.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f222dcc0700 1 -- 172.21.15.80:0/657872418 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2220007240 con 0x7f222806d120 2019-11-28T11:58:40.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f222f4c3700 1 --2- 172.21.15.80:0/657872418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222806d120 0x7f2228165d80 secure :-1 s=THROTTLE_DONE pgs=1772 cs=0 l=1 rx=0x7f222000af80 tx=0x7f222000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:40.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f222f4c3700 1 --2- 172.21.15.80:0/657872418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222806d120 0x7f2228165d80 secure :-1 s=THROTTLE_DONE pgs=1772 cs=0 l=1 rx=0x7f222000af80 tx=0x7f222000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:40.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f222dcc0700 1 -- 172.21.15.80:0/657872418 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2220000bb0 con 0x7f222806d120 2019-11-28T11:58:40.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f222dcc0700 1 -- 172.21.15.80:0/657872418 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2220009e60 con 0x7f222806d120 2019-11-28T11:58:40.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f2230725700 1 -- 172.21.15.80:0/657872418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222806d120 msgr2=0x7f2228165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:40.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.147+0000 7f2230725700 1 --2- 172.21.15.80:0/657872418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222806d120 0x7f2228165d80 secure :-1 s=READY pgs=1772 cs=0 l=1 rx=0x7f222000af80 tx=0x7f222000b790).stop 2019-11-28T11:58:40.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.148+0000 7f2230725700 1 -- 172.21.15.80:0/657872418 shutdown_connections 2019-11-28T11:58:40.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.148+0000 7f2230725700 1 --2- 172.21.15.80:0/657872418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222806d120 0x7f2228165d80 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:40.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.148+0000 7f2230725700 1 -- 172.21.15.80:0/657872418 shutdown_connections 2019-11-28T11:58:40.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.148+0000 7f2230725700 1 -- 172.21.15.80:0/657872418 wait complete. 2019-11-28T11:58:40.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.148+0000 7f2230725700 1 -- 172.21.15.80:0/657872418 >> 172.21.15.80:0/657872418 conn(0x7f2228061cf0 msgr2=0x7f2228064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.150+0000 7f2230725700 1 Processor -- start 2019-11-28T11:58:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.150+0000 7f2230725700 1 -- start start 2019-11-28T11:58:40.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.151+0000 7f2230725700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2228111db0 0x7f22281238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.151+0000 7f2230725700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2228124260 con 0x7f2228165a00 2019-11-28T11:58:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.151+0000 7f2230725700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222812e5d0 con 0x7f222812cea0 2019-11-28T11:58:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.151+0000 7f2230725700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2228121040 con 0x7f2228111db0 2019-11-28T11:58:40.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.151+0000 7f222e4c1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2228111db0 0x7f22281238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:40.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.151+0000 7f222e4c1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2228111db0 0x7f22281238e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47316/0 (socket says 172.21.15.80:47316) 2019-11-28T11:58:40.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.151+0000 7f222f4c3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2228165a00 0x7f2228167e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46634/0 (socket says 172.21.15.80:46634) 2019-11-28T11:58:40.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.151+0000 7f222e4c1700 1 -- 172.21.15.80:0/1537631081 learned_addr learned my addr 172.21.15.80:0/1537631081 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T11:58:40.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.152+0000 7f22277fe700 1 -- 172.21.15.80:0/1537631081 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385121000 0 0) 0x7f2210001480 con 0x7f222812cea0 2019-11-28T11:58:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.152+0000 7f222e4c1700 1 -- 172.21.15.80:0/1537631081 >> v1:172.21.15.174:6789/0 conn(0x7f222812cea0 legacy=0x7f22281230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.152+0000 7f222e4c1700 1 -- 172.21.15.80:0/1537631081 >> v1:172.21.15.80:6789/0 conn(0x7f2228165a00 legacy=0x7f2228167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.152+0000 7f222e4c1700 1 -- 172.21.15.80:0/1537631081 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22281219a0 con 0x7f2228111db0 2019-11-28T11:58:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.152+0000 7f222e4c1700 1 --2- 172.21.15.80:0/1537631081 >> v2:172.21.15.80:3300/0 conn(0x7f2228111db0 0x7f22281238e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2218012620 tx=0x7f22180129c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:40.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.152+0000 7f222e4c1700 1 --2- 172.21.15.80:0/1537631081 >> v2:172.21.15.80:3300/0 conn(0x7f2228111db0 0x7f22281238e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2218012620 tx=0x7f22180129c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:40.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.152+0000 7f222e4c1700 1 --2- 172.21.15.80:0/1537631081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2228111db0 0x7f22281238e0 secure :-1 s=READY pgs=2931 cs=0 l=1 rx=0x7f2218012620 tx=0x7f22180129c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:40.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.152+0000 7f222e4c1700 1 --2- 172.21.15.80:0/1537631081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2228111db0 0x7f22281238e0 secure :-1 s=THROTTLE_DONE pgs=2931 cs=0 l=1 rx=0x7f2218012620 tx=0x7f22180129c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:40.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.152+0000 7f22277fe700 1 -- 172.21.15.80:0/1537631081 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2218005770 con 0x7f2228111db0 2019-11-28T11:58:40.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.152+0000 7f222e4c1700 1 --2- 172.21.15.80:0/1537631081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2228111db0 0x7f22281238e0 secure :-1 s=THROTTLE_DONE pgs=2931 cs=0 l=1 rx=0x7f2218012620 tx=0x7f22180129c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.152+0000 7f22277fe700 1 -- 172.21.15.80:0/1537631081 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2218000b90 con 0x7f2228111db0 2019-11-28T11:58:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.152+0000 7f222e4c1700 1 --2- 172.21.15.80:0/1537631081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2228111db0 0x7f22281238e0 secure :-1 s=THROTTLE_DONE pgs=2931 cs=0 l=1 rx=0x7f2218012620 tx=0x7f22180129c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.152+0000 7f2230725700 1 -- 172.21.15.80:0/1537631081 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2228121d20 con 0x7f2228111db0 2019-11-28T11:58:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.152+0000 7f22277fe700 1 -- 172.21.15.80:0/1537631081 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2218005810 con 0x7f2228111db0 2019-11-28T11:58:40.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.152+0000 7f2230725700 1 -- 172.21.15.80:0/1537631081 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22281219a0 con 0x7f2228111db0 2019-11-28T11:58:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.153+0000 7f222e4c1700 1 --2- 172.21.15.80:0/1537631081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2228111db0 0x7f22281238e0 secure :-1 s=THROTTLE_DONE pgs=2931 cs=0 l=1 rx=0x7f2218012620 tx=0x7f22180129c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.153+0000 7f22277fe700 1 -- 172.21.15.80:0/1537631081 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2218005390 con 0x7f2228111db0 2019-11-28T11:58:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.153+0000 7f222e4c1700 1 --2- 172.21.15.80:0/1537631081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2228111db0 0x7f22281238e0 secure :-1 s=THROTTLE_DONE pgs=2931 cs=0 l=1 rx=0x7f2218012620 tx=0x7f22180129c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.153+0000 7f22277fe700 1 --2- 172.21.15.80:0/1537631081 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f220c018730 0x7f220c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:58:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.153+0000 7f22277fe700 1 -- 172.21.15.80:0/1537631081 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(223..223 src has 1..223) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2218033d30 con 0x7f2228111db0 2019-11-28T11:58:40.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.154+0000 7f222ecc2700 1 --2- 172.21.15.80:0/1537631081 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f220c018730 0x7f220c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:58:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.154+0000 7f222ecc2700 1 --2- 172.21.15.80:0/1537631081 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f220c018730 0x7f220c01abc0 crc :-1 s=READY pgs=1214 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:58:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.160+0000 7f2230725700 1 -- 172.21.15.80:0/1537631081 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2228121d20 con 0x7f2228111db0 2019-11-28T11:58:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.164+0000 7f222e4c1700 1 --2- 172.21.15.80:0/1537631081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2228111db0 0x7f22281238e0 secure :-1 s=THROTTLE_DONE pgs=2931 cs=0 l=1 rx=0x7f2218012620 tx=0x7f22180129c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:40.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.164+0000 7f22277fe700 1 -- 172.21.15.80:0/1537631081 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f22180075a0 con 0x7f2228111db0 2019-11-28T11:58:40.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.338+0000 7f2230725700 1 -- 172.21.15.80:0/1537631081 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22281219a0 con 0x7f2228111db0 2019-11-28T11:58:40.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.338+0000 7f222e4c1700 1 --2- 172.21.15.80:0/1537631081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2228111db0 0x7f22281238e0 secure :-1 s=THROTTLE_DONE pgs=2931 cs=0 l=1 rx=0x7f2218012620 tx=0x7f22180129c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:58:40.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.338+0000 7f22277fe700 1 -- 172.21.15.80:0/1537631081 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 186 v186) v1 ==== 95+0+2457 (secure 0 0 0) 0x7f22180194d0 con 0x7f2228111db0 2019-11-28T11:58:40.336 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 186 2019-11-28T11:58:40.337 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:58:40.337 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":186,"default_fscid":18,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":11665,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/3051174059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3051174059},{"type":"v1","addr":"172.21.15.174:6835","nonce":3051174059}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":184},{"gid":12435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2096320481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2096320481},{"type":"v1","addr":"172.21.15.80:6834","nonce":2096320481}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":184}],"filesystems":[{"mdsmap":{"epoch":186,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:58:24.286894+0000","modified":"2019-11-28T11:58:31.978284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8138":{"gid":8138,"name":"a","rank":0,"incarnation":185,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6835/4148152245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":4148152245},{"type":"v1","addr":"172.21.15.80:6835","nonce":4148152245}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[37],"metadata_pool":36,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":18}]} 2019-11-28T11:58:40.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.341+0000 7f2230725700 1 -- 172.21.15.80:0/1537631081 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f220c018730 msgr2=0x7f220c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:40.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.341+0000 7f2230725700 1 --2- 172.21.15.80:0/1537631081 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f220c018730 0x7f220c01abc0 crc :-1 s=READY pgs=1214 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:40.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.341+0000 7f2230725700 1 -- 172.21.15.80:0/1537631081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2228111db0 msgr2=0x7f22281238e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:58:40.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.341+0000 7f2230725700 1 --2- 172.21.15.80:0/1537631081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2228111db0 0x7f22281238e0 secure :-1 s=READY pgs=2931 cs=0 l=1 rx=0x7f2218012620 tx=0x7f22180129c0).stop 2019-11-28T11:58:40.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.341+0000 7f2230725700 1 -- 172.21.15.80:0/1537631081 shutdown_connections 2019-11-28T11:58:40.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.341+0000 7f2230725700 1 --2- 172.21.15.80:0/1537631081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2228111db0 0x7f22281238e0 unknown :-1 s=CLOSED pgs=2931 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:40.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.341+0000 7f2230725700 1 --2- 172.21.15.80:0/1537631081 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f220c018730 0x7f220c01abc0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:58:40.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.341+0000 7f2230725700 1 -- 172.21.15.80:0/1537631081 shutdown_connections 2019-11-28T11:58:40.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.341+0000 7f2230725700 1 -- 172.21.15.80:0/1537631081 wait complete. 2019-11-28T11:58:40.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:58:40.341+0000 7f2230725700 1 -- 172.21.15.80:0/1537631081 >> 172.21.15.80:0/1537631081 conn(0x7f22281426c0 msgr2=0x7f2228110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:58:40.347 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session ls 2019-11-28T11:58:40.471 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:58:40.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:40.472 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 11800, 2019-11-28T11:58:40.472 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": { 2019-11-28T11:58:40.472 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2019-11-28T11:58:40.472 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2019-11-28T11:58:40.472 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 11800 2019-11-28T11:58:40.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:40.473 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2019-11-28T11:58:40.473 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:40.473 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.16:0", 2019-11-28T11:58:40.473 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3925037966 2019-11-28T11:58:40.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:40.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:40.473 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "open", 2019-11-28T11:58:40.474 INFO:teuthology.orchestra.run.smithi080.stdout: "num_leases": 0, 2019-11-28T11:58:40.474 INFO:teuthology.orchestra.run.smithi080.stdout: "num_caps": 1, 2019-11-28T11:58:40.474 INFO:teuthology.orchestra.run.smithi080.stdout: "request_load_avg": 0, 2019-11-28T11:58:40.474 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 2.2949537449999999, 2019-11-28T11:58:40.474 INFO:teuthology.orchestra.run.smithi080.stdout: "requests_in_flight": 0, 2019-11-28T11:58:40.474 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": 0, 2019-11-28T11:58:40.474 INFO:teuthology.orchestra.run.smithi080.stdout: "reconnecting": false, 2019-11-28T11:58:40.475 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps": { 2019-11-28T11:58:40.475 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:58:40.475 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:58:40.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:40.475 INFO:teuthology.orchestra.run.smithi080.stdout: "release_caps": { 2019-11-28T11:58:40.475 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:58:40.475 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:58:40.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:40.476 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle": { 2019-11-28T11:58:40.476 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:58:40.476 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 2.5 2019-11-28T11:58:40.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:40.477 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle2o": { 2019-11-28T11:58:40.477 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:58:40.477 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 0.5 2019-11-28T11:58:40.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:40.477 INFO:teuthology.orchestra.run.smithi080.stdout: "session_cache_liveness": { 2019-11-28T11:58:40.477 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 2.9888078574421297, 2019-11-28T11:58:40.477 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 300 2019-11-28T11:58:40.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:40.478 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": "client.11800 v1:172.21.15.16:0/3925037966", 2019-11-28T11:58:40.478 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": [], 2019-11-28T11:58:40.478 INFO:teuthology.orchestra.run.smithi080.stdout: "prealloc_inos": [], 2019-11-28T11:58:40.478 INFO:teuthology.orchestra.run.smithi080.stdout: "used_inos": [], 2019-11-28T11:58:40.478 INFO:teuthology.orchestra.run.smithi080.stdout: "client_metadata": { 2019-11-28T11:58:40.478 INFO:teuthology.orchestra.run.smithi080.stdout: "features": "00000000000000ff", 2019-11-28T11:58:40.478 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "1", 2019-11-28T11:58:40.479 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi016", 2019-11-28T11:58:40.479 INFO:teuthology.orchestra.run.smithi080.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:58:40.479 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2019-11-28T11:58:40.479 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:40.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:40.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:40.479 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 11770, 2019-11-28T11:58:40.480 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": { 2019-11-28T11:58:40.480 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2019-11-28T11:58:40.480 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2019-11-28T11:58:40.480 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 11770 2019-11-28T11:58:40.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:40.480 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2019-11-28T11:58:40.480 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:58:40.481 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.76:0", 2019-11-28T11:58:40.481 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2000608864 2019-11-28T11:58:40.481 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:40.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:40.481 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "open", 2019-11-28T11:58:40.481 INFO:teuthology.orchestra.run.smithi080.stdout: "num_leases": 1, 2019-11-28T11:58:40.481 INFO:teuthology.orchestra.run.smithi080.stdout: "num_caps": 2, 2019-11-28T11:58:40.482 INFO:teuthology.orchestra.run.smithi080.stdout: "request_load_avg": 3, 2019-11-28T11:58:40.482 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 4.6289061609999997, 2019-11-28T11:58:40.482 INFO:teuthology.orchestra.run.smithi080.stdout: "requests_in_flight": 0, 2019-11-28T11:58:40.482 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": 1, 2019-11-28T11:58:40.482 INFO:teuthology.orchestra.run.smithi080.stdout: "reconnecting": false, 2019-11-28T11:58:40.482 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps": { 2019-11-28T11:58:40.482 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:58:40.482 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:58:40.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:40.483 INFO:teuthology.orchestra.run.smithi080.stdout: "release_caps": { 2019-11-28T11:58:40.483 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:58:40.483 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:58:40.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:40.483 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle": { 2019-11-28T11:58:40.483 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:58:40.484 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 2.5 2019-11-28T11:58:40.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:40.484 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle2o": { 2019-11-28T11:58:40.484 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:58:40.484 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 0.5 2019-11-28T11:58:40.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:40.484 INFO:teuthology.orchestra.run.smithi080.stdout: "session_cache_liveness": { 2019-11-28T11:58:40.484 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 3.9805144099033778, 2019-11-28T11:58:40.485 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 300 2019-11-28T11:58:40.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:58:40.485 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": "client.11770 v1:172.21.15.76:0/2000608864", 2019-11-28T11:58:40.485 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": [ 2019-11-28T11:58:40.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:40.485 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 4, 2019-11-28T11:58:40.485 INFO:teuthology.orchestra.run.smithi080.stdout: "created_ino": "0x10000000000" 2019-11-28T11:58:40.486 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:40.486 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:58:40.486 INFO:teuthology.orchestra.run.smithi080.stdout: "prealloc_inos": [ 2019-11-28T11:58:40.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:58:40.486 INFO:teuthology.orchestra.run.smithi080.stdout: "start": 1099511627777, 2019-11-28T11:58:40.486 INFO:teuthology.orchestra.run.smithi080.stdout: "length": 1000 2019-11-28T11:58:40.486 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:40.487 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T11:58:40.487 INFO:teuthology.orchestra.run.smithi080.stdout: "used_inos": [], 2019-11-28T11:58:40.487 INFO:teuthology.orchestra.run.smithi080.stdout: "client_metadata": { 2019-11-28T11:58:40.487 INFO:teuthology.orchestra.run.smithi080.stdout: "features": "00000000000000ff", 2019-11-28T11:58:40.487 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "0", 2019-11-28T11:58:40.487 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi076.front.sepia.ceph.com", 2019-11-28T11:58:40.487 INFO:teuthology.orchestra.run.smithi080.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:58:40.488 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2019-11-28T11:58:40.488 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:40.488 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:58:40.488 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:58:40.489 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 11800, "entity": { "name": { "type": "client", "num": 11800 }, "addr": { "type": "v1", "addr": "172.21.15.16:0", "nonce": 3925037966 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 2.2949537449999999, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 2.9888078574421297, "halflife": 300 }, "inst": "client.11800 v1:172.21.15.16:0/3925037966", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "1", "hostname": "smithi016", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } }, { "id": 11770, "entity": { "name": { "type": "client", "num": 11770 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 2000608864 } }, "state": "open", "num_leases": 1, "num_caps": 2, "request_load_avg": 3, "uptime": 4.6289061609999997, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 3.9805144099033778, "halflife": 300 }, "inst": "client.11770 v1:172.21.15.76:0/2000608864", "completed_requests": [ { "tid": 4, "created_ino": "0x10000000000" } ], "prealloc_inos": [ { "start": 1099511627777, "length": 1000 } ], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076.front.sepia.ceph.com", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:58:40.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:58:40.490 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:58:40.490 INFO:teuthology.orchestra.run.smithi076:> import glob 2019-11-28T11:58:40.490 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:58:40.490 INFO:teuthology.orchestra.run.smithi076:> import json 2019-11-28T11:58:40.490 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:58:40.490 INFO:teuthology.orchestra.run.smithi076:> def get_id_to_dir(): 2019-11-28T11:58:40.490 INFO:teuthology.orchestra.run.smithi076:> result = {} 2019-11-28T11:58:40.491 INFO:teuthology.orchestra.run.smithi076:> for dir in glob.glob("/sys/kernel/debug/ceph/*"): 2019-11-28T11:58:40.491 INFO:teuthology.orchestra.run.smithi076:> mds_sessions_lines = open(os.path.join(dir, "mds_sessions")).readlines() 2019-11-28T11:58:40.491 INFO:teuthology.orchestra.run.smithi076:> client_id = mds_sessions_lines[1].split()[1].strip('"'"'"'"'"') 2019-11-28T11:58:40.491 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:58:40.491 INFO:teuthology.orchestra.run.smithi076:> result[client_id] = dir 2019-11-28T11:58:40.491 INFO:teuthology.orchestra.run.smithi076:> return result 2019-11-28T11:58:40.491 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:58:40.492 INFO:teuthology.orchestra.run.smithi076:> print(json.dumps(get_id_to_dir())) 2019-11-28T11:58:40.492 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:58:40.561 INFO:teuthology.orchestra.run.smithi076.stdout:{"0": "/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client11770"} 2019-11-28T11:58:40.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T11:58:40.561 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T11:58:40.562 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T11:58:40.562 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T11:58:40.562 INFO:teuthology.orchestra.run.smithi076:> print(open(os.path.join("/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client11770", "mds_sessions")).read()) 2019-11-28T11:58:40.562 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T11:58:40.633 INFO:teuthology.orchestra.run.smithi076.stdout:global_id 11770 2019-11-28T11:58:40.633 INFO:teuthology.orchestra.run.smithi076.stdout:name "0" 2019-11-28T11:58:40.634 INFO:teuthology.orchestra.run.smithi076.stdout:mds.0 open 2019-11-28T11:58:40.634 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T11:58:40.634 INFO:teuthology.orchestra.run.smithi016:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file 2019-11-28T11:58:40.705 INFO:teuthology.orchestra.run.smithi016.stdout:/home/ubuntu/cephtest/mnt.1/background_file 2019-11-28T11:58:40.707 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2019-11-28T11:58:40.749 INFO:teuthology.orchestra.console:Performing hard reset of smithi076 2019-11-28T11:58:40.750 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power reset 2019-11-28T11:58:40.792 INFO:teuthology.orchestra.console:Hard reset for smithi076 completed 2019-11-28T11:58:45.901 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits daemon-helper kill python -c ' 2019-11-28T11:58:45.901 INFO:teuthology.orchestra.run.smithi016:> import os 2019-11-28T11:58:45.901 INFO:teuthology.orchestra.run.smithi016:> import time 2019-11-28T11:58:45.901 INFO:teuthology.orchestra.run.smithi016:> 2019-11-28T11:58:45.901 INFO:teuthology.orchestra.run.smithi016:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0644) 2019-11-28T11:58:45.902 INFO:teuthology.orchestra.run.smithi016:> try: 2019-11-28T11:58:45.902 INFO:teuthology.orchestra.run.smithi016:> while True: 2019-11-28T11:58:45.902 INFO:teuthology.orchestra.run.smithi016:> os.write(fd, '"'"'content'"'"') 2019-11-28T11:58:45.902 INFO:teuthology.orchestra.run.smithi016:> time.sleep(1) 2019-11-28T11:58:45.902 INFO:teuthology.orchestra.run.smithi016:> if not False: 2019-11-28T11:58:45.902 INFO:teuthology.orchestra.run.smithi016:> break 2019-11-28T11:58:45.903 INFO:teuthology.orchestra.run.smithi016:> except IOError, e: 2019-11-28T11:58:45.903 INFO:teuthology.orchestra.run.smithi016:> pass 2019-11-28T11:58:45.903 INFO:teuthology.orchestra.run.smithi016:> os.close(fd) 2019-11-28T11:58:45.903 INFO:teuthology.orchestra.run.smithi016:> ' 2019-11-28T11:59:09.189 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:59:09.202 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:59:09.210 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T11:59:42.881 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T11:59:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.007+0000 7fb803db6700 1 Processor -- start 2019-11-28T11:59:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.007+0000 7fb803db6700 1 -- start start 2019-11-28T11:59:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.008+0000 7fb803db6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb7fc06c490 0x7fb7fc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:59:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.008+0000 7fb803db6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc06ce60 0x7fb7fc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:59:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.008+0000 7fb803db6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7fc06db00 con 0x7fb7fc06c0a0 2019-11-28T11:59:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.008+0000 7fb803db6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7fc06fd60 con 0x7fb7fc06c490 2019-11-28T11:59:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.008+0000 7fb803db6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc070030 con 0x7fb7fc06ce60 2019-11-28T11:59:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.008+0000 7fb802353700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb7fc06c0a0 0x7fb7fc072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46638/0 (socket says 172.21.15.80:46638) 2019-11-28T11:59:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.008+0000 7fb802353700 1 -- 172.21.15.80:0/3924984723 learned_addr learned my addr 172.21.15.80:0/3924984723 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:59:43.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.008+0000 7fb801b52700 1 --2- 172.21.15.80:0/3924984723 >> v2:172.21.15.174:3300/0 conn(0x7fb7fc06c490 0x7fb7fc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:59:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.008+0000 7fb802b54700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc06ce60 0x7fb7fc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:59:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.008+0000 7fb801351700 1 -- 172.21.15.80:0/3924984723 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157545553 0 0) 0x7fb7ec001150 con 0x7fb7fc06c0a0 2019-11-28T11:59:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.008+0000 7fb801351700 1 -- 172.21.15.80:0/3924984723 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e8002e80 con 0x7fb7fc06c0a0 2019-11-28T11:59:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 -- 172.21.15.80:0/3924984723 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 232690422 0 0) 0x7fb7ec001130 con 0x7fb7fc06c0a0 2019-11-28T11:59:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 -- 172.21.15.80:0/3924984723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc06ce60 msgr2=0x7fb7fc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:59:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc06ce60 0x7fb7fc164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:59:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 -- 172.21.15.80:0/3924984723 >> v2:172.21.15.174:3300/0 conn(0x7fb7fc06c490 msgr2=0x7fb7fc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:59:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 --2- 172.21.15.80:0/3924984723 >> v2:172.21.15.174:3300/0 conn(0x7fb7fc06c490 0x7fb7fc06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:59:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 -- 172.21.15.80:0/3924984723 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc0706c0 con 0x7fb7fc06c0a0 2019-11-28T11:59:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 -- 172.21.15.80:0/3924984723 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fb7ec001660 con 0x7fb7fc06c0a0 2019-11-28T11:59:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 -- 172.21.15.80:0/3924984723 >> v1:172.21.15.80:6789/0 conn(0x7fb7fc06c0a0 legacy=0x7fb7fc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:59:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7e80479e0 0x7fb7e8049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:59:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7e804a5c0 0x7fb7e804ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:59:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e804d270 0x7fb7e804f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T11:59:43.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 -- 172.21.15.80:0/3924984723 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e804ff50 con 0x7fb7e804d270 2019-11-28T11:59:43.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 -- 172.21.15.80:0/3924984723 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e8050140 con 0x7fb7e804a5c0 2019-11-28T11:59:43.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 -- 172.21.15.80:0/3924984723 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e8050370 con 0x7fb7e80479e0 2019-11-28T11:59:43.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb802b54700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e804d270 0x7fb7e804f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:59:43.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb802353700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7e80479e0 0x7fb7e8049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:59:43.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801b52700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7e804a5c0 0x7fb7e804ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:59:43.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb802b54700 1 -- 172.21.15.80:0/3924984723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7e80479e0 msgr2=0x7fb7e8049e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:59:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb802b54700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7e80479e0 0x7fb7e8049e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:59:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb802b54700 1 -- 172.21.15.80:0/3924984723 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7e804a5c0 msgr2=0x7fb7e804ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T11:59:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb802b54700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7e804a5c0 0x7fb7e804ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T11:59:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb802b54700 1 -- 172.21.15.80:0/3924984723 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e8050620 con 0x7fb7e804d270 2019-11-28T11:59:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801b52700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7e804a5c0 0x7fb7e804ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T11:59:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb802b54700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e804d270 0x7fb7e804f740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb7f400b080 tx=0x7fb7f400b380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:59:43.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb802b54700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e804d270 0x7fb7e804f740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb7f400b080 tx=0x7fb7f400b380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:59:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb802b54700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e804d270 0x7fb7e804f740 secure :-1 s=READY pgs=2933 cs=0 l=1 rx=0x7fb7f400b080 tx=0x7fb7f400b380).ready entity=mon.0 client_cookie=3647088e89ea1faa server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:59:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb802b54700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e804d270 0x7fb7e804f740 secure :-1 s=THROTTLE_DONE pgs=2933 cs=0 l=1 rx=0x7fb7f400b080 tx=0x7fb7f400b380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:59:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 -- 172.21.15.80:0/3924984723 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7f400a710 con 0x7fb7e804d270 2019-11-28T11:59:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb802b54700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e804d270 0x7fb7e804f740 secure :-1 s=THROTTLE_DONE pgs=2933 cs=0 l=1 rx=0x7fb7f400b080 tx=0x7fb7f400b380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:59:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb802b54700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e804d270 0x7fb7e804f740 secure :-1 s=THROTTLE_DONE pgs=2933 cs=0 l=1 rx=0x7fb7f400b080 tx=0x7fb7f400b380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:59:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 -- 172.21.15.80:0/3924984723 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f400eaa0 con 0x7fb7e804d270 2019-11-28T11:59:43.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb801351700 1 -- 172.21.15.80:0/3924984723 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7f4000bc0 con 0x7fb7e804d270 2019-11-28T11:59:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb803db6700 1 -- 172.21.15.80:0/3924984723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e804d270 msgr2=0x7fb7e804f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:59:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb803db6700 1 --2- 172.21.15.80:0/3924984723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7e804d270 0x7fb7e804f740 secure :-1 s=READY pgs=2933 cs=0 l=1 rx=0x7fb7f400b080 tx=0x7fb7f400b380).stop 2019-11-28T11:59:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.009+0000 7fb802b54700 1 -- 172.21.15.80:0/3924984723 reap_dead start 2019-11-28T11:59:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.010+0000 7fb803db6700 1 -- 172.21.15.80:0/3924984723 shutdown_connections 2019-11-28T11:59:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.010+0000 7fb803db6700 1 -- 172.21.15.80:0/3924984723 shutdown_connections 2019-11-28T11:59:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.010+0000 7fb803db6700 1 -- 172.21.15.80:0/3924984723 wait complete. 2019-11-28T11:59:43.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.010+0000 7fb803db6700 1 -- 172.21.15.80:0/3924984723 >> 172.21.15.80:0/3924984723 conn(0x7fb7fc061cf0 msgr2=0x7fb7fc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:59:43.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.013+0000 7fb803db6700 1 Processor -- start 2019-11-28T11:59:43.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.013+0000 7fb803db6700 1 -- start start 2019-11-28T11:59:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.013+0000 7fb803db6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc167c30 0x7fb7fc16a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:59:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.013+0000 7fb803db6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7fc107110 con 0x7fb7fc13fb20 2019-11-28T11:59:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.013+0000 7fb803db6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7fc140370 con 0x7fb7fc107940 2019-11-28T11:59:43.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.013+0000 7fb803db6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc13b5e0 con 0x7fb7fc167c30 2019-11-28T11:59:43.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb802353700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb7fc13fb20 0x7fb7fc1080b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46650/0 (socket says 172.21.15.80:46650) 2019-11-28T11:59:43.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb802353700 1 -- 172.21.15.80:0/1978561943 learned_addr learned my addr 172.21.15.80:0/1978561943 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T11:59:43.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb802b54700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc167c30 0x7fb7fc16a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:59:43.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb7f2ffd700 1 -- 172.21.15.80:0/1978561943 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105184486 0 0) 0x7fb7ec001940 con 0x7fb7fc13fb20 2019-11-28T11:59:43.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb7f2ffd700 1 -- 172.21.15.80:0/1978561943 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e4002e80 con 0x7fb7fc13fb20 2019-11-28T11:59:43.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb7f2ffd700 1 -- 172.21.15.80:0/1978561943 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708255143 0 0) 0x7fb7f8001360 con 0x7fb7fc107940 2019-11-28T11:59:43.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb7f2ffd700 1 -- 172.21.15.80:0/1978561943 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e40030b0 con 0x7fb7fc107940 2019-11-28T11:59:43.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb7f2ffd700 1 -- 172.21.15.80:0/1978561943 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1207485993 0 0) 0x7fb7ec001940 con 0x7fb7fc13fb20 2019-11-28T11:59:43.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb802b54700 1 -- 172.21.15.80:0/1978561943 >> v1:172.21.15.174:6789/0 conn(0x7fb7fc107940 legacy=0x7fb7fc10f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:59:43.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb802b54700 1 -- 172.21.15.80:0/1978561943 >> v1:172.21.15.80:6789/0 conn(0x7fb7fc13fb20 legacy=0x7fb7fc1080b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:59:43.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb802b54700 1 -- 172.21.15.80:0/1978561943 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc13bf40 con 0x7fb7fc167c30 2019-11-28T11:59:43.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb802b54700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc167c30 0x7fb7fc16a030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb7f4010390 tx=0x7fb7f4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:59:43.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb802b54700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc167c30 0x7fb7fc16a030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb7f4010390 tx=0x7fb7f4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:59:43.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb802b54700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc167c30 0x7fb7fc16a030 secure :-1 s=READY pgs=425 cs=0 l=1 rx=0x7fb7f4010390 tx=0x7fb7f4010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:59:43.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb802b54700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc167c30 0x7fb7fc16a030 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7fb7f4010390 tx=0x7fb7f4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:59:43.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb7f2ffd700 1 -- 172.21.15.80:0/1978561943 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7f4002b40 con 0x7fb7fc167c30 2019-11-28T11:59:43.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb802b54700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc167c30 0x7fb7fc16a030 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7fb7f4010390 tx=0x7fb7f4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:59:43.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb802b54700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc167c30 0x7fb7fc16a030 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7fb7f4010390 tx=0x7fb7f4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:59:43.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb7f2ffd700 1 -- 172.21.15.80:0/1978561943 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f4009e20 con 0x7fb7fc167c30 2019-11-28T11:59:43.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb7f2ffd700 1 -- 172.21.15.80:0/1978561943 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7f4002b40 con 0x7fb7fc167c30 2019-11-28T11:59:43.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb803db6700 1 -- 172.21.15.80:0/1978561943 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc10dea0 con 0x7fb7fc167c30 2019-11-28T11:59:43.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.014+0000 7fb803db6700 1 -- 172.21.15.80:0/1978561943 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7fc13bf40 con 0x7fb7fc167c30 2019-11-28T11:59:43.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.015+0000 7fb802b54700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc167c30 0x7fb7fc16a030 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7fb7f4010390 tx=0x7fb7f4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:59:43.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.015+0000 7fb7f2ffd700 1 -- 172.21.15.80:0/1978561943 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb7f400a010 con 0x7fb7fc167c30 2019-11-28T11:59:43.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.015+0000 7fb802b54700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc167c30 0x7fb7fc16a030 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7fb7f4010390 tx=0x7fb7f4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:59:43.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.015+0000 7fb7f2ffd700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb7e4018750 0x7fb7e401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T11:59:43.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.015+0000 7fb7f2ffd700 1 -- 172.21.15.80:0/1978561943 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(224..224 src has 1..224) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fb7f4031aa0 con 0x7fb7fc167c30 2019-11-28T11:59:43.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.015+0000 7fb802353700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb7e4018750 0x7fb7e401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T11:59:43.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.016+0000 7fb802353700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb7e4018750 0x7fb7e401abe0 crc :-1 s=READY pgs=1215 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T11:59:43.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.022+0000 7fb803db6700 1 -- 172.21.15.80:0/1978561943 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7fc10dea0 con 0x7fb7fc167c30 2019-11-28T11:59:43.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.026+0000 7fb802b54700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc167c30 0x7fb7fc16a030 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7fb7f4010390 tx=0x7fb7f4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:59:43.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.026+0000 7fb7f2ffd700 1 -- 172.21.15.80:0/1978561943 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb7f4009a20 con 0x7fb7fc167c30 2019-11-28T11:59:43.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.198+0000 7fb803db6700 1 -- 172.21.15.80:0/1978561943 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7fc13bf40 con 0x7fb7fc167c30 2019-11-28T11:59:43.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.199+0000 7fb802b54700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc167c30 0x7fb7fc16a030 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7fb7f4010390 tx=0x7fb7f4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T11:59:43.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.199+0000 7fb7f2ffd700 1 -- 172.21.15.80:0/1978561943 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 186 v186) v1 ==== 95+0+2457 (secure 0 0 0) 0x7fb7f400a010 con 0x7fb7fc167c30 2019-11-28T11:59:43.201 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 186 2019-11-28T11:59:43.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.201+0000 7fb803db6700 1 -- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb7e4018750 msgr2=0x7fb7e401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:59:43.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.201+0000 7fb803db6700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb7e4018750 0x7fb7e401abe0 crc :-1 s=READY pgs=1215 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:59:43.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.201+0000 7fb803db6700 1 -- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc167c30 msgr2=0x7fb7fc16a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T11:59:43.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.201+0000 7fb803db6700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc167c30 0x7fb7fc16a030 secure :-1 s=READY pgs=425 cs=0 l=1 rx=0x7fb7f4010390 tx=0x7fb7f4010730).stop 2019-11-28T11:59:43.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.201+0000 7fb803db6700 1 -- 172.21.15.80:0/1978561943 shutdown_connections 2019-11-28T11:59:43.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.201+0000 7fb803db6700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb7fc167c30 0x7fb7fc16a030 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:59:43.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.201+0000 7fb803db6700 1 --2- 172.21.15.80:0/1978561943 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb7e4018750 0x7fb7e401abe0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T11:59:43.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.201+0000 7fb803db6700 1 -- 172.21.15.80:0/1978561943 shutdown_connections 2019-11-28T11:59:43.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.201+0000 7fb803db6700 1 -- 172.21.15.80:0/1978561943 wait complete. 2019-11-28T11:59:43.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T11:59:43.201+0000 7fb803db6700 1 -- 172.21.15.80:0/1978561943 >> 172.21.15.80:0/1978561943 conn(0x7fb7fc142090 msgr2=0x7fb7fc10ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T11:59:43.203 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T11:59:43.203 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":186,"default_fscid":18,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":11665,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/3051174059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3051174059},{"type":"v1","addr":"172.21.15.174:6835","nonce":3051174059}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":184},{"gid":12435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2096320481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2096320481},{"type":"v1","addr":"172.21.15.80:6834","nonce":2096320481}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":184}],"filesystems":[{"mdsmap":{"epoch":186,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:58:24.286894+0000","modified":"2019-11-28T11:58:31.978284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8138":{"gid":8138,"name":"a","rank":0,"incarnation":185,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6835/4148152245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":4148152245},{"type":"v1","addr":"172.21.15.80:6835","nonce":4148152245}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[37],"metadata_pool":36,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":18}]} 2019-11-28T11:59:43.207 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session ls 2019-11-28T11:59:43.332 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T11:59:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T11:59:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 11800, 2019-11-28T11:59:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": { 2019-11-28T11:59:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2019-11-28T11:59:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2019-11-28T11:59:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 11800 2019-11-28T11:59:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:59:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2019-11-28T11:59:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T11:59:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.16:0", 2019-11-28T11:59:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3925037966 2019-11-28T11:59:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:59:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:59:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "open", 2019-11-28T11:59:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: "num_leases": 0, 2019-11-28T11:59:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: "num_caps": 2, 2019-11-28T11:59:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: "request_load_avg": 2, 2019-11-28T11:59:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 65.155873720000002, 2019-11-28T11:59:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: "requests_in_flight": 0, 2019-11-28T11:59:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": 0, 2019-11-28T11:59:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: "reconnecting": false, 2019-11-28T11:59:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps": { 2019-11-28T11:59:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:59:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:59:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:59:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: "release_caps": { 2019-11-28T11:59:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:59:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 60 2019-11-28T11:59:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:59:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle": { 2019-11-28T11:59:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:59:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 2.5 2019-11-28T11:59:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:59:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: "recall_caps_throttle2o": { 2019-11-28T11:59:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 0, 2019-11-28T11:59:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 0.5 2019-11-28T11:59:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:59:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: "session_cache_liveness": { 2019-11-28T11:59:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: "value": 10.503378994021819, 2019-11-28T11:59:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: "halflife": 300 2019-11-28T11:59:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T11:59:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": "client.11800 v1:172.21.15.16:0/3925037966", 2019-11-28T11:59:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: "completed_requests": [], 2019-11-28T11:59:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: "prealloc_inos": [], 2019-11-28T11:59:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: "used_inos": [], 2019-11-28T11:59:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: "client_metadata": { 2019-11-28T11:59:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: "features": "00000000000000ff", 2019-11-28T11:59:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "1", 2019-11-28T11:59:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi016", 2019-11-28T11:59:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T11:59:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2019-11-28T11:59:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:59:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T11:59:43.341 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T11:59:43.342 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 11800, "entity": { "name": { "type": "client", "num": 11800 }, "addr": { "type": "v1", "addr": "172.21.15.16:0", "nonce": 3925037966 } }, "state": "open", "num_leases": 0, "num_caps": 2, "request_load_avg": 2, "uptime": 65.155873720000002, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 10.503378994021819, "halflife": 300 }, "inst": "client.11800 v1:172.21.15.16:0/3925037966", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "1", "hostname": "smithi016", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T11:59:43.343 INFO:tasks.cephfs.test_client_recovery:cap_waiter waited 56.9669759274s 2019-11-28T12:00:53.433 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2019-11-28T12:00:53.433 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T12:00:53.447 DEBUG:tasks.ceph:Missed logrotate, host unreachable 2019-11-28T12:01:23.434 INFO:teuthology.misc:Re-opening connections... 2019-11-28T12:01:23.434 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2019-11-28T12:01:23.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T12:01:23.435 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T12:01:23.448 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:01:23.454 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:01:23.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T12:01:23.460 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T12:01:23.597 INFO:teuthology.orchestra.run.smithi076:> true 2019-11-28T12:01:23.603 INFO:teuthology.orchestra.run.smithi076:> true 2019-11-28T12:01:24.120 DEBUG:teuthology.misc:waited 0.685264110565 2019-11-28T12:01:24.120 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:01:24.124 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:01:24.129 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:01:24.134 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:01:25.121 INFO:teuthology.orchestra.run:Running command with timeout 10 2019-11-28T12:01:25.121 INFO:teuthology.orchestra.run.smithi076:> uptime 2019-11-28T12:01:25.191 INFO:teuthology.orchestra.run.smithi076.stdout: 12:01:25 up 0 min, 0 users, load average: 0.62, 0.23, 0.08 2019-11-28T12:01:25.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T12:01:25.191 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T12:01:25.260 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T12:01:25.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.392+0000 7feefd9ea700 1 Processor -- start 2019-11-28T12:01:25.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.392+0000 7feefd9ea700 1 -- start start 2019-11-28T12:01:25.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.393+0000 7feefd9ea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feef806c0a0 0x7feef8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:25.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.393+0000 7feefd9ea700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7feef8072620 0x7feef8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:25.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.393+0000 7feefd9ea700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef806db00 con 0x7feef80734e0 2019-11-28T12:01:25.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.393+0000 7feefd9ea700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef806fd60 con 0x7feef806c0a0 2019-11-28T12:01:25.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.393+0000 7feefd9ea700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef8070030 con 0x7feef8072620 2019-11-28T12:01:25.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.393+0000 7feef77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feef806c0a0 0x7feef8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:25.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.393+0000 7feef77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feef806c0a0 0x7feef8072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47342/0 (socket says 172.21.15.80:47342) 2019-11-28T12:01:25.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.393+0000 7feef77fe700 1 -- 172.21.15.80:0/2076537112 learned_addr learned my addr 172.21.15.80:0/2076537112 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:25.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.393+0000 7feef6ffd700 1 --1- 172.21.15.80:0/2076537112 >> v1:172.21.15.80:6789/0 conn(0x7feef80734e0 0x7feef8071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46662/0 (socket says 172.21.15.80:46662) 2019-11-28T12:01:25.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.393+0000 7feef7fff700 1 --2- 172.21.15.80:0/2076537112 >> v2:172.21.15.174:3300/0 conn(0x7feef8072620 0x7feef8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:25.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.393+0000 7feef77fe700 1 -- 172.21.15.80:0/2076537112 >> v2:172.21.15.174:3300/0 conn(0x7feef8072620 msgr2=0x7feef8164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:25.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.393+0000 7feef77fe700 1 --2- 172.21.15.80:0/2076537112 >> v2:172.21.15.174:3300/0 conn(0x7feef8072620 0x7feef8164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:25.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.393+0000 7feef77fe700 1 -- 172.21.15.80:0/2076537112 >> v1:172.21.15.80:6789/0 conn(0x7feef80734e0 legacy=0x7feef8071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:25.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.393+0000 7feef77fe700 1 -- 172.21.15.80:0/2076537112 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef80706c0 con 0x7feef806c0a0 2019-11-28T12:01:25.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.393+0000 7feef67fc700 1 -- 172.21.15.80:0/2076537112 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751101348 0 0) 0x7feee00013f0 con 0x7feef80734e0 2019-11-28T12:01:25.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.393+0000 7feef77fe700 1 --2- 172.21.15.80:0/2076537112 >> v2:172.21.15.80:3300/0 conn(0x7feef806c0a0 0x7feef8072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feee800f740 tx=0x7feee800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.394+0000 7feef77fe700 1 --2- 172.21.15.80:0/2076537112 >> v2:172.21.15.80:3300/0 conn(0x7feef806c0a0 0x7feef8072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feee800f740 tx=0x7feee800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.394+0000 7feef77fe700 1 --2- 172.21.15.80:0/2076537112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef806c0a0 0x7feef8072fa0 secure :-1 s=READY pgs=2936 cs=0 l=1 rx=0x7feee800f740 tx=0x7feee800f570).ready entity=mon.0 client_cookie=a855cd6390ea031f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:25.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.394+0000 7feef77fe700 1 --2- 172.21.15.80:0/2076537112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef806c0a0 0x7feef8072fa0 secure :-1 s=THROTTLE_DONE pgs=2936 cs=0 l=1 rx=0x7feee800f740 tx=0x7feee800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.394+0000 7feef67fc700 1 -- 172.21.15.80:0/2076537112 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee8000960 con 0x7feef806c0a0 2019-11-28T12:01:25.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.394+0000 7feef77fe700 1 --2- 172.21.15.80:0/2076537112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef806c0a0 0x7feef8072fa0 secure :-1 s=THROTTLE_DONE pgs=2936 cs=0 l=1 rx=0x7feee800f740 tx=0x7feee800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.394+0000 7feef77fe700 1 --2- 172.21.15.80:0/2076537112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef806c0a0 0x7feef8072fa0 secure :-1 s=THROTTLE_DONE pgs=2936 cs=0 l=1 rx=0x7feee800f740 tx=0x7feee800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.394+0000 7feef67fc700 1 -- 172.21.15.80:0/2076537112 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee8000c90 con 0x7feef806c0a0 2019-11-28T12:01:25.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.394+0000 7feef67fc700 1 -- 172.21.15.80:0/2076537112 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee8007210 con 0x7feef806c0a0 2019-11-28T12:01:25.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.394+0000 7feefd9ea700 1 -- 172.21.15.80:0/2076537112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef806c0a0 msgr2=0x7feef8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:25.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.394+0000 7feefd9ea700 1 --2- 172.21.15.80:0/2076537112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef806c0a0 0x7feef8072fa0 secure :-1 s=READY pgs=2936 cs=0 l=1 rx=0x7feee800f740 tx=0x7feee800f570).stop 2019-11-28T12:01:25.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.394+0000 7feefd9ea700 1 -- 172.21.15.80:0/2076537112 shutdown_connections 2019-11-28T12:01:25.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.394+0000 7feefd9ea700 1 --2- 172.21.15.80:0/2076537112 >> v2:172.21.15.174:3300/0 conn(0x7feef8072620 0x7feef8164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:25.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.394+0000 7feefd9ea700 1 --2- 172.21.15.80:0/2076537112 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef806c0a0 0x7feef8072fa0 unknown :-1 s=CLOSED pgs=2936 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:25.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.394+0000 7feefd9ea700 1 -- 172.21.15.80:0/2076537112 shutdown_connections 2019-11-28T12:01:25.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.394+0000 7feefd9ea700 1 -- 172.21.15.80:0/2076537112 wait complete. 2019-11-28T12:01:25.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.394+0000 7feefd9ea700 1 -- 172.21.15.80:0/2076537112 >> 172.21.15.80:0/2076537112 conn(0x7feef8061cf0 msgr2=0x7feef8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:25.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.397+0000 7feefd9ea700 1 Processor -- start 2019-11-28T12:01:25.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.397+0000 7feefd9ea700 1 -- start start 2019-11-28T12:01:25.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feefd9ea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feef8104c10 0x7feef81050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:25.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feefd9ea700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7feef81055e0 0x7feef8167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:25.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feefd9ea700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef813bcd0 con 0x7feef8104820 2019-11-28T12:01:25.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feefd9ea700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef8109130 con 0x7feef8104c10 2019-11-28T12:01:25.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feefd9ea700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef8109400 con 0x7feef81055e0 2019-11-28T12:01:25.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feef6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feef8104c10 0x7feef81050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:25.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feef6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feef8104c10 0x7feef81050a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47348/0 (socket says 172.21.15.80:47348) 2019-11-28T12:01:25.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feef6ffd700 1 -- 172.21.15.80:0/2113616307 learned_addr learned my addr 172.21.15.80:0/2113616307 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:25.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feef7fff700 1 --2- 172.21.15.80:0/2113616307 >> v2:172.21.15.174:3300/0 conn(0x7feef81055e0 0x7feef8167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:25.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feef6ffd700 1 -- 172.21.15.80:0/2113616307 >> v2:172.21.15.174:3300/0 conn(0x7feef81055e0 msgr2=0x7feef8167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:25.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feef6ffd700 1 --2- 172.21.15.80:0/2113616307 >> v2:172.21.15.174:3300/0 conn(0x7feef81055e0 0x7feef8167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:25.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feef6ffd700 1 -- 172.21.15.80:0/2113616307 >> v1:172.21.15.174:6789/0 conn(0x7feef8104820 legacy=0x7feef810c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:25.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feef6ffd700 1 -- 172.21.15.80:0/2113616307 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef8109a90 con 0x7feef8104c10 2019-11-28T12:01:25.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feef7fff700 1 --2- 172.21.15.80:0/2113616307 >> v2:172.21.15.174:3300/0 conn(0x7feef81055e0 0x7feef8167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T12:01:25.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feef6ffd700 1 --2- 172.21.15.80:0/2113616307 >> v2:172.21.15.80:3300/0 conn(0x7feef8104c10 0x7feef81050a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feee00107c0 tx=0x7feee0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feef6ffd700 1 --2- 172.21.15.80:0/2113616307 >> v2:172.21.15.80:3300/0 conn(0x7feef8104c10 0x7feef81050a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feee00107c0 tx=0x7feee0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.398+0000 7feef6ffd700 1 --2- 172.21.15.80:0/2113616307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef8104c10 0x7feef81050a0 secure :-1 s=READY pgs=2937 cs=0 l=1 rx=0x7feee00107c0 tx=0x7feee0010b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:25.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.399+0000 7feef6ffd700 1 --2- 172.21.15.80:0/2113616307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef8104c10 0x7feef81050a0 secure :-1 s=THROTTLE_DONE pgs=2937 cs=0 l=1 rx=0x7feee00107c0 tx=0x7feee0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.399+0000 7feef6ffd700 1 --2- 172.21.15.80:0/2113616307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef8104c10 0x7feef81050a0 secure :-1 s=THROTTLE_DONE pgs=2937 cs=0 l=1 rx=0x7feee00107c0 tx=0x7feee0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.399+0000 7feef6ffd700 1 --2- 172.21.15.80:0/2113616307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef8104c10 0x7feef81050a0 secure :-1 s=THROTTLE_DONE pgs=2937 cs=0 l=1 rx=0x7feee00107c0 tx=0x7feee0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.399+0000 7feeeffff700 1 -- 172.21.15.80:0/2113616307 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee0001670 con 0x7feef8104c10 2019-11-28T12:01:25.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.399+0000 7feeeffff700 1 -- 172.21.15.80:0/2113616307 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee0004360 con 0x7feef8104c10 2019-11-28T12:01:25.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.399+0000 7feefd9ea700 1 -- 172.21.15.80:0/2113616307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef8109e10 con 0x7feef8104c10 2019-11-28T12:01:25.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.399+0000 7feeeffff700 1 -- 172.21.15.80:0/2113616307 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee0004930 con 0x7feef8104c10 2019-11-28T12:01:25.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.399+0000 7feefd9ea700 1 -- 172.21.15.80:0/2113616307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef8109a90 con 0x7feef8104c10 2019-11-28T12:01:25.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.399+0000 7feef6ffd700 1 --2- 172.21.15.80:0/2113616307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef8104c10 0x7feef81050a0 secure :-1 s=THROTTLE_DONE pgs=2937 cs=0 l=1 rx=0x7feee00107c0 tx=0x7feee0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.399+0000 7feeeffff700 1 -- 172.21.15.80:0/2113616307 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7feee00010d0 con 0x7feef8104c10 2019-11-28T12:01:25.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.399+0000 7feef6ffd700 1 --2- 172.21.15.80:0/2113616307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef8104c10 0x7feef81050a0 secure :-1 s=THROTTLE_DONE pgs=2937 cs=0 l=1 rx=0x7feee00107c0 tx=0x7feee0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.399+0000 7feeeffff700 1 --2- 172.21.15.80:0/2113616307 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feed0018730 0x7feed001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:25.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.399+0000 7feeeffff700 1 -- 172.21.15.80:0/2113616307 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(224..224 src has 1..224) v4 ==== 6063+0+0 (secure 0 0 0) 0x7feee0031e10 con 0x7feef8104c10 2019-11-28T12:01:25.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.400+0000 7feef77fe700 1 --2- 172.21.15.80:0/2113616307 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feed0018730 0x7feed001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:25.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.400+0000 7feef77fe700 1 --2- 172.21.15.80:0/2113616307 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feed0018730 0x7feed001abc0 crc :-1 s=READY pgs=1216 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:25.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.407+0000 7feefd9ea700 1 -- 172.21.15.80:0/2113616307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef8109e10 con 0x7feef8104c10 2019-11-28T12:01:25.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.410+0000 7feef6ffd700 1 --2- 172.21.15.80:0/2113616307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef8104c10 0x7feef81050a0 secure :-1 s=THROTTLE_DONE pgs=2937 cs=0 l=1 rx=0x7feee00107c0 tx=0x7feee0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.413 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.411+0000 7feeeffff700 1 -- 172.21.15.80:0/2113616307 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7feee0000cc0 con 0x7feef8104c10 2019-11-28T12:01:25.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.585+0000 7feefd9ea700 1 -- 172.21.15.80:0/2113616307 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feef8109a90 con 0x7feef8104c10 2019-11-28T12:01:25.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.586+0000 7feef6ffd700 1 --2- 172.21.15.80:0/2113616307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef8104c10 0x7feef81050a0 secure :-1 s=THROTTLE_DONE pgs=2937 cs=0 l=1 rx=0x7feee00107c0 tx=0x7feee0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.586+0000 7feeeffff700 1 -- 172.21.15.80:0/2113616307 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v224) v1 ==== 74+0+14932 (secure 0 0 0) 0x7feee00010d0 con 0x7feef8104c10 2019-11-28T12:01:25.581 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:25.581 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":224,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T11:59:41.762835+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":37,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":36,"pool_name":"cephfs_metadata","create_time":"2019-11-28T11:58:22.567726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"222","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":37,"pool_name":"cephfs_data","create_time":"2019-11-28T11:58:23.259981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"223","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":220,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.76:0/2000608864":"2019-11-28T12:59:41.712744+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T12:01:25.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.588+0000 7feefd9ea700 1 -- 172.21.15.80:0/2113616307 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feed0018730 msgr2=0x7feed001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:25.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.588+0000 7feefd9ea700 1 --2- 172.21.15.80:0/2113616307 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feed0018730 0x7feed001abc0 crc :-1 s=READY pgs=1216 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:25.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.588+0000 7feefd9ea700 1 -- 172.21.15.80:0/2113616307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef8104c10 msgr2=0x7feef81050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:25.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.588+0000 7feefd9ea700 1 --2- 172.21.15.80:0/2113616307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef8104c10 0x7feef81050a0 secure :-1 s=READY pgs=2937 cs=0 l=1 rx=0x7feee00107c0 tx=0x7feee0010b60).stop 2019-11-28T12:01:25.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.588+0000 7feefd9ea700 1 -- 172.21.15.80:0/2113616307 shutdown_connections 2019-11-28T12:01:25.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.588+0000 7feefd9ea700 1 --2- 172.21.15.80:0/2113616307 >> v2:172.21.15.174:3300/0 conn(0x7feef81055e0 0x7feef8167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:25.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.588+0000 7feefd9ea700 1 --2- 172.21.15.80:0/2113616307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feef8104c10 0x7feef81050a0 unknown :-1 s=CLOSED pgs=2937 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:25.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.588+0000 7feefd9ea700 1 --2- 172.21.15.80:0/2113616307 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feed0018730 0x7feed001abc0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:25.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.588+0000 7feefd9ea700 1 -- 172.21.15.80:0/2113616307 shutdown_connections 2019-11-28T12:01:25.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.588+0000 7feefd9ea700 1 -- 172.21.15.80:0/2113616307 wait complete. 2019-11-28T12:01:25.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.588+0000 7feefd9ea700 1 -- 172.21.15.80:0/2113616307 >> 172.21.15.80:0/2113616307 conn(0x7feef813d620 msgr2=0x7feef813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:25.593 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:58:22.567726+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 36, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'222', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:58:23.259981+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 37, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'223', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T12:01:25.594 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T12:01:25.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.723+0000 7fc244bcc700 1 Processor -- start 2019-11-28T12:01:25.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.723+0000 7fc244bcc700 1 -- start start 2019-11-28T12:01:25.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.724+0000 7fc244bcc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc24015f100 0x7fc24006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:25.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.724+0000 7fc244bcc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc24006c2f0 0x7fc24006c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:25.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.724+0000 7fc244bcc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24006db60 con 0x7fc24015ed10 2019-11-28T12:01:25.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.724+0000 7fc244bcc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24006fe00 con 0x7fc24015f100 2019-11-28T12:01:25.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.724+0000 7fc244bcc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400700d0 con 0x7fc24006c2f0 2019-11-28T12:01:25.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.724+0000 7fc23e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc24015f100 0x7fc24006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:25.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.724+0000 7fc23e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc24015f100 0x7fc24006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47360/0 (socket says 172.21.15.80:47360) 2019-11-28T12:01:25.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.724+0000 7fc23e59c700 1 -- 172.21.15.80:0/213624815 learned_addr learned my addr 172.21.15.80:0/213624815 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:25.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.724+0000 7fc23f59e700 1 --2- 172.21.15.80:0/213624815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc24006c2f0 0x7fc24006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:25.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc23e59c700 1 -- 172.21.15.80:0/213624815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc24006c2f0 msgr2=0x7fc24006c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:25.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc23e59c700 1 --2- 172.21.15.80:0/213624815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc24006c2f0 0x7fc24006c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:25.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc23e59c700 1 -- 172.21.15.80:0/213624815 >> v1:172.21.15.80:6789/0 conn(0x7fc24015ed10 legacy=0x7fc240073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:25.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc23e59c700 1 -- 172.21.15.80:0/213624815 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc240070760 con 0x7fc24015f100 2019-11-28T12:01:25.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc23dd9b700 1 -- 172.21.15.80:0/213624815 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666367061 0 0) 0x7fc230001480 con 0x7fc24015ed10 2019-11-28T12:01:25.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc23f59e700 1 --2- 172.21.15.80:0/213624815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc24006c2f0 0x7fc24006c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:25.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc23e59c700 1 --2- 172.21.15.80:0/213624815 >> v2:172.21.15.80:3300/0 conn(0x7fc24015f100 0x7fc24006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc22800f740 tx=0x7fc22800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc23e59c700 1 --2- 172.21.15.80:0/213624815 >> v2:172.21.15.80:3300/0 conn(0x7fc24015f100 0x7fc24006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc22800f740 tx=0x7fc22800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc23e59c700 1 --2- 172.21.15.80:0/213624815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24015f100 0x7fc24006bdb0 secure :-1 s=READY pgs=2939 cs=0 l=1 rx=0x7fc22800f740 tx=0x7fc22800fae0).ready entity=mon.0 client_cookie=3c9bd2a1c1d48a4c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:25.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc23e59c700 1 --2- 172.21.15.80:0/213624815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24015f100 0x7fc24006bdb0 secure :-1 s=THROTTLE_DONE pgs=2939 cs=0 l=1 rx=0x7fc22800f740 tx=0x7fc22800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc23dd9b700 1 -- 172.21.15.80:0/213624815 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc228000960 con 0x7fc24015f100 2019-11-28T12:01:25.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc23e59c700 1 --2- 172.21.15.80:0/213624815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24015f100 0x7fc24006bdb0 secure :-1 s=THROTTLE_DONE pgs=2939 cs=0 l=1 rx=0x7fc22800f740 tx=0x7fc22800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc23e59c700 1 --2- 172.21.15.80:0/213624815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24015f100 0x7fc24006bdb0 secure :-1 s=THROTTLE_DONE pgs=2939 cs=0 l=1 rx=0x7fc22800f740 tx=0x7fc22800fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc23dd9b700 1 -- 172.21.15.80:0/213624815 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc228000c90 con 0x7fc24015f100 2019-11-28T12:01:25.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc23dd9b700 1 -- 172.21.15.80:0/213624815 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc228007210 con 0x7fc24015f100 2019-11-28T12:01:25.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc244bcc700 1 -- 172.21.15.80:0/213624815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24015f100 msgr2=0x7fc24006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:25.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.725+0000 7fc244bcc700 1 --2- 172.21.15.80:0/213624815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24015f100 0x7fc24006bdb0 secure :-1 s=READY pgs=2939 cs=0 l=1 rx=0x7fc22800f740 tx=0x7fc22800fae0).stop 2019-11-28T12:01:25.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.726+0000 7fc244bcc700 1 -- 172.21.15.80:0/213624815 shutdown_connections 2019-11-28T12:01:25.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.726+0000 7fc244bcc700 1 --2- 172.21.15.80:0/213624815 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc24006c2f0 0x7fc24006c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:25.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.726+0000 7fc244bcc700 1 --2- 172.21.15.80:0/213624815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24015f100 0x7fc24006bdb0 unknown :-1 s=CLOSED pgs=2939 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:25.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.726+0000 7fc244bcc700 1 -- 172.21.15.80:0/213624815 shutdown_connections 2019-11-28T12:01:25.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.726+0000 7fc244bcc700 1 -- 172.21.15.80:0/213624815 wait complete. 2019-11-28T12:01:25.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.726+0000 7fc244bcc700 1 -- 172.21.15.80:0/213624815 >> 172.21.15.80:0/213624815 conn(0x7fc240061d20 msgr2=0x7fc2400641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:25.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.728+0000 7fc244bcc700 1 Processor -- start 2019-11-28T12:01:25.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.728+0000 7fc244bcc700 1 -- start start 2019-11-28T12:01:25.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.729+0000 7fc244bcc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc240148320 0x7fc24010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:25.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.729+0000 7fc244bcc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc24010f290 0x7fc24010dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:25.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.729+0000 7fc244bcc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc24010e110 0x7fc24010e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:25.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.729+0000 7fc244bcc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc240139ff0 con 0x7fc24010e110 2019-11-28T12:01:25.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.729+0000 7fc244bcc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24013aa20 con 0x7fc24010f290 2019-11-28T12:01:25.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.729+0000 7fc244bcc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24010c490 con 0x7fc240148320 2019-11-28T12:01:25.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.729+0000 7fc23f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc24010e110 0x7fc24010e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:25.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.729+0000 7fc23f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc24010e110 0x7fc24010e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47364/0 (socket says 172.21.15.80:47364) 2019-11-28T12:01:25.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.729+0000 7fc23f59e700 1 -- 172.21.15.80:0/1297642005 learned_addr learned my addr 172.21.15.80:0/1297642005 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:25.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.729+0000 7fc23ed9d700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc240148320 0x7fc24010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:25.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.729+0000 7fc23e59c700 1 --2- 172.21.15.80:0/1297642005 >> v2:172.21.15.174:3300/0 conn(0x7fc24010f290 0x7fc24010dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:25.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc23f59e700 1 -- 172.21.15.80:0/1297642005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc240148320 msgr2=0x7fc24010ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:25.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc23f59e700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc240148320 0x7fc24010ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:25.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc23f59e700 1 -- 172.21.15.80:0/1297642005 >> v2:172.21.15.174:3300/0 conn(0x7fc24010f290 msgr2=0x7fc24010dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:25.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc23f59e700 1 --2- 172.21.15.80:0/1297642005 >> v2:172.21.15.174:3300/0 conn(0x7fc24010f290 0x7fc24010dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:25.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc23f59e700 1 -- 172.21.15.80:0/1297642005 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24010c810 con 0x7fc24010e110 2019-11-28T12:01:25.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc23f59e700 1 --2- 172.21.15.80:0/1297642005 >> v2:172.21.15.80:3300/0 conn(0x7fc24010e110 0x7fc24010e560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc238010430 tx=0x7fc238010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc23f59e700 1 --2- 172.21.15.80:0/1297642005 >> v2:172.21.15.80:3300/0 conn(0x7fc24010e110 0x7fc24010e560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc238010430 tx=0x7fc238010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc23f59e700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24010e110 0x7fc24010e560 secure :-1 s=READY pgs=2940 cs=0 l=1 rx=0x7fc238010430 tx=0x7fc238010330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:25.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc23f59e700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24010e110 0x7fc24010e560 secure :-1 s=THROTTLE_DONE pgs=2940 cs=0 l=1 rx=0x7fc238010430 tx=0x7fc238010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc23f59e700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24010e110 0x7fc24010e560 secure :-1 s=THROTTLE_DONE pgs=2940 cs=0 l=1 rx=0x7fc238010430 tx=0x7fc238010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc23f59e700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24010e110 0x7fc24010e560 secure :-1 s=THROTTLE_DONE pgs=2940 cs=0 l=1 rx=0x7fc238010430 tx=0x7fc238010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc2377fe700 1 -- 172.21.15.80:0/1297642005 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc23800aa60 con 0x7fc24010e110 2019-11-28T12:01:25.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc2377fe700 1 -- 172.21.15.80:0/1297642005 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23800a750 con 0x7fc24010e110 2019-11-28T12:01:25.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc244bcc700 1 -- 172.21.15.80:0/1297642005 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24010c810 con 0x7fc24010e110 2019-11-28T12:01:25.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc2377fe700 1 -- 172.21.15.80:0/1297642005 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc238009b80 con 0x7fc24010e110 2019-11-28T12:01:25.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc244bcc700 1 -- 172.21.15.80:0/1297642005 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24010c810 con 0x7fc24010e110 2019-11-28T12:01:25.743 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc23f59e700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24010e110 0x7fc24010e560 secure :-1 s=THROTTLE_DONE pgs=2940 cs=0 l=1 rx=0x7fc238010430 tx=0x7fc238010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.730+0000 7fc2377fe700 1 -- 172.21.15.80:0/1297642005 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc238009650 con 0x7fc24010e110 2019-11-28T12:01:25.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.731+0000 7fc23f59e700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24010e110 0x7fc24010e560 secure :-1 s=THROTTLE_DONE pgs=2940 cs=0 l=1 rx=0x7fc238010430 tx=0x7fc238010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.731+0000 7fc2377fe700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc218018730 0x7fc21801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:25.744 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.731+0000 7fc2377fe700 1 -- 172.21.15.80:0/1297642005 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(224..224 src has 1..224) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fc238031a00 con 0x7fc24010e110 2019-11-28T12:01:25.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.731+0000 7fc23ed9d700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc218018730 0x7fc21801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:25.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.731+0000 7fc23ed9d700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc218018730 0x7fc21801abc0 crc :-1 s=READY pgs=1217 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:25.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.738+0000 7fc244bcc700 1 -- 172.21.15.80:0/1297642005 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc24010c810 con 0x7fc24010e110 2019-11-28T12:01:25.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.742+0000 7fc23f59e700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24010e110 0x7fc24010e560 secure :-1 s=THROTTLE_DONE pgs=2940 cs=0 l=1 rx=0x7fc238010430 tx=0x7fc238010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.742+0000 7fc2377fe700 1 -- 172.21.15.80:0/1297642005 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc238000a70 con 0x7fc24010e110 2019-11-28T12:01:25.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.909+0000 7fc244bcc700 1 -- 172.21.15.80:0/1297642005 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fc24010c810 con 0x7fc24010e110 2019-11-28T12:01:25.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.909+0000 7fc23f59e700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24010e110 0x7fc24010e560 secure :-1 s=THROTTLE_DONE pgs=2940 cs=0 l=1 rx=0x7fc238010430 tx=0x7fc238010330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:25.904 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.909+0000 7fc2377fe700 1 -- 172.21.15.80:0/1297642005 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v224) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc2380095b0 con 0x7fc24010e110 2019-11-28T12:01:25.905 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:01:25.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.911+0000 7fc244bcc700 1 -- 172.21.15.80:0/1297642005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc218018730 msgr2=0x7fc21801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:25.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.911+0000 7fc244bcc700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc218018730 0x7fc21801abc0 crc :-1 s=READY pgs=1217 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:25.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.911+0000 7fc244bcc700 1 -- 172.21.15.80:0/1297642005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24010e110 msgr2=0x7fc24010e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:25.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.911+0000 7fc244bcc700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24010e110 0x7fc24010e560 secure :-1 s=READY pgs=2940 cs=0 l=1 rx=0x7fc238010430 tx=0x7fc238010330).stop 2019-11-28T12:01:25.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.912+0000 7fc244bcc700 1 -- 172.21.15.80:0/1297642005 shutdown_connections 2019-11-28T12:01:25.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.912+0000 7fc244bcc700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc218018730 0x7fc21801abc0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:25.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.912+0000 7fc244bcc700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc24010e110 0x7fc24010e560 unknown :-1 s=CLOSED pgs=2940 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:25.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.912+0000 7fc244bcc700 1 --2- 172.21.15.80:0/1297642005 >> v2:172.21.15.174:3300/0 conn(0x7fc24010f290 0x7fc24010dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:25.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.912+0000 7fc244bcc700 1 --2- 172.21.15.80:0/1297642005 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc240148320 0x7fc24010ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:25.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.912+0000 7fc244bcc700 1 -- 172.21.15.80:0/1297642005 shutdown_connections 2019-11-28T12:01:25.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.912+0000 7fc244bcc700 1 -- 172.21.15.80:0/1297642005 wait complete. 2019-11-28T12:01:25.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:25.912+0000 7fc244bcc700 1 -- 172.21.15.80:0/1297642005 >> 172.21.15.80:0/1297642005 conn(0x7fc24015e2d0 msgr2=0x7fc240147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:25.917 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T12:01:26.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.050+0000 7f98c04b2700 1 Processor -- start 2019-11-28T12:01:26.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.050+0000 7f98c04b2700 1 -- start start 2019-11-28T12:01:26.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98c04b2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b815ed10 0x7f98b815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:26.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98c04b2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f98b8073020 0x7f98b8071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:26.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98c04b2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b806db60 con 0x7f98b80734b0 2019-11-28T12:01:26.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98c04b2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b806f3d0 con 0x7f98b8073020 2019-11-28T12:01:26.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98c04b2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b806fe00 con 0x7f98b815ed10 2019-11-28T12:01:26.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98bf250700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f98b80734b0 0x7f98b80723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46688/0 (socket says 172.21.15.80:46688) 2019-11-28T12:01:26.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98bf250700 1 -- 172.21.15.80:0/2652035776 learned_addr learned my addr 172.21.15.80:0/2652035776 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:26.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98be24e700 1 --2- 172.21.15.80:0/2652035776 >> v2:172.21.15.174:3300/0 conn(0x7f98b8073020 0x7f98b8071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:26.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98bea4f700 1 --2- 172.21.15.80:0/2652035776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b815ed10 0x7f98b815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:26.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98bda4d700 1 -- 172.21.15.80:0/2652035776 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896139154 0 0) 0x7f98b0001150 con 0x7f98b80734b0 2019-11-28T12:01:26.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98bda4d700 1 -- 172.21.15.80:0/2652035776 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98a0002e80 con 0x7f98b80734b0 2019-11-28T12:01:26.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98be24e700 1 -- 172.21.15.80:0/2652035776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b815ed10 msgr2=0x7f98b815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:26.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98be24e700 1 --2- 172.21.15.80:0/2652035776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b815ed10 0x7f98b815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:26.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98be24e700 1 -- 172.21.15.80:0/2652035776 >> v1:172.21.15.80:6789/0 conn(0x7f98b80734b0 legacy=0x7f98b80723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98be24e700 1 -- 172.21.15.80:0/2652035776 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b8070760 con 0x7f98b8073020 2019-11-28T12:01:26.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98bea4f700 1 --2- 172.21.15.80:0/2652035776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b815ed10 0x7f98b815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:26.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98be24e700 1 --2- 172.21.15.80:0/2652035776 >> v2:172.21.15.174:3300/0 conn(0x7f98b8073020 0x7f98b8071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f98ac00af50 tx=0x7f98ac00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98be24e700 1 --2- 172.21.15.80:0/2652035776 >> v2:172.21.15.174:3300/0 conn(0x7f98b8073020 0x7f98b8071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f98ac00af50 tx=0x7f98ac00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.051+0000 7f98be24e700 1 --2- 172.21.15.80:0/2652035776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b8073020 0x7f98b8071ea0 secure :-1 s=READY pgs=1776 cs=0 l=1 rx=0x7f98ac00af50 tx=0x7f98ac00b760).ready entity=mon.1 client_cookie=fbf38832f31b4c51 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.052+0000 7f98be24e700 1 --2- 172.21.15.80:0/2652035776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b8073020 0x7f98b8071ea0 secure :-1 s=THROTTLE_DONE pgs=1776 cs=0 l=1 rx=0x7f98ac00af50 tx=0x7f98ac00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.052+0000 7f98bda4d700 1 -- 172.21.15.80:0/2652035776 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98ac007210 con 0x7f98b8073020 2019-11-28T12:01:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.052+0000 7f98be24e700 1 --2- 172.21.15.80:0/2652035776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b8073020 0x7f98b8071ea0 secure :-1 s=THROTTLE_DONE pgs=1776 cs=0 l=1 rx=0x7f98ac00af50 tx=0x7f98ac00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.052+0000 7f98be24e700 1 --2- 172.21.15.80:0/2652035776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b8073020 0x7f98b8071ea0 secure :-1 s=THROTTLE_DONE pgs=1776 cs=0 l=1 rx=0x7f98ac00af50 tx=0x7f98ac00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.052+0000 7f98bda4d700 1 -- 172.21.15.80:0/2652035776 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac0099b0 con 0x7f98b8073020 2019-11-28T12:01:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.052+0000 7f98bda4d700 1 -- 172.21.15.80:0/2652035776 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98ac00a080 con 0x7f98b8073020 2019-11-28T12:01:26.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.052+0000 7f98c04b2700 1 -- 172.21.15.80:0/2652035776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b8073020 msgr2=0x7f98b8071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.052+0000 7f98c04b2700 1 --2- 172.21.15.80:0/2652035776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b8073020 0x7f98b8071ea0 secure :-1 s=READY pgs=1776 cs=0 l=1 rx=0x7f98ac00af50 tx=0x7f98ac00b760).stop 2019-11-28T12:01:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.052+0000 7f98c04b2700 1 -- 172.21.15.80:0/2652035776 shutdown_connections 2019-11-28T12:01:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.052+0000 7f98c04b2700 1 --2- 172.21.15.80:0/2652035776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98b8073020 0x7f98b8071ea0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.052+0000 7f98c04b2700 1 --2- 172.21.15.80:0/2652035776 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f98b815ed10 0x7f98b815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.053+0000 7f98c04b2700 1 -- 172.21.15.80:0/2652035776 shutdown_connections 2019-11-28T12:01:26.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.053+0000 7f98c04b2700 1 -- 172.21.15.80:0/2652035776 wait complete. 2019-11-28T12:01:26.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.053+0000 7f98c04b2700 1 -- 172.21.15.80:0/2652035776 >> 172.21.15.80:0/2652035776 conn(0x7f98b8061d20 msgr2=0x7f98b80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:26.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.055+0000 7f98c04b2700 1 Processor -- start 2019-11-28T12:01:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.055+0000 7f98c04b2700 1 -- start start 2019-11-28T12:01:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98c04b2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98b81079b0 0x7f98b8107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98c04b2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b8148e00 con 0x7f98b8108380 2019-11-28T12:01:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98c04b2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b8108b10 con 0x7f98b8148320 2019-11-28T12:01:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98c04b2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b813aa20 con 0x7f98b81079b0 2019-11-28T12:01:26.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98be24e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98b81079b0 0x7f98b8107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:26.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98be24e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f98b81079b0 0x7f98b8107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47378/0 (socket says 172.21.15.80:47378) 2019-11-28T12:01:26.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98be24e700 1 -- 172.21.15.80:0/1472264162 learned_addr learned my addr 172.21.15.80:0/1472264162 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:26.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98be24e700 1 -- 172.21.15.80:0/1472264162 >> v1:172.21.15.174:6789/0 conn(0x7f98b8148320 legacy=0x7f98b810ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98be24e700 1 -- 172.21.15.80:0/1472264162 >> v1:172.21.15.80:6789/0 conn(0x7f98b8108380 legacy=0x7f98b8168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98be24e700 1 -- 172.21.15.80:0/1472264162 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b810c490 con 0x7f98b81079b0 2019-11-28T12:01:26.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98be24e700 1 --2- 172.21.15.80:0/1472264162 >> v2:172.21.15.80:3300/0 conn(0x7f98b81079b0 0x7f98b8107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f98ac010440 tx=0x7f98ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98be24e700 1 --2- 172.21.15.80:0/1472264162 >> v2:172.21.15.80:3300/0 conn(0x7f98b81079b0 0x7f98b8107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f98ac010440 tx=0x7f98ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98be24e700 1 --2- 172.21.15.80:0/1472264162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b81079b0 0x7f98b8107e40 secure :-1 s=READY pgs=2943 cs=0 l=1 rx=0x7f98ac010440 tx=0x7f98ac0107e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:26.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98be24e700 1 --2- 172.21.15.80:0/1472264162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b81079b0 0x7f98b8107e40 secure :-1 s=THROTTLE_DONE pgs=2943 cs=0 l=1 rx=0x7f98ac010440 tx=0x7f98ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98b77fe700 1 -- 172.21.15.80:0/1472264162 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98ac00b380 con 0x7f98b81079b0 2019-11-28T12:01:26.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98be24e700 1 --2- 172.21.15.80:0/1472264162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b81079b0 0x7f98b8107e40 secure :-1 s=THROTTLE_DONE pgs=2943 cs=0 l=1 rx=0x7f98ac010440 tx=0x7f98ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98c04b2700 1 -- 172.21.15.80:0/1472264162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b810c810 con 0x7f98b81079b0 2019-11-28T12:01:26.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98b77fe700 1 -- 172.21.15.80:0/1472264162 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac000940 con 0x7f98b81079b0 2019-11-28T12:01:26.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98be24e700 1 --2- 172.21.15.80:0/1472264162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b81079b0 0x7f98b8107e40 secure :-1 s=THROTTLE_DONE pgs=2943 cs=0 l=1 rx=0x7f98ac010440 tx=0x7f98ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98b77fe700 1 -- 172.21.15.80:0/1472264162 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98ac00b380 con 0x7f98b81079b0 2019-11-28T12:01:26.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.056+0000 7f98c04b2700 1 -- 172.21.15.80:0/1472264162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b8108820 con 0x7f98b81079b0 2019-11-28T12:01:26.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.057+0000 7f98be24e700 1 --2- 172.21.15.80:0/1472264162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b81079b0 0x7f98b8107e40 secure :-1 s=THROTTLE_DONE pgs=2943 cs=0 l=1 rx=0x7f98ac010440 tx=0x7f98ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.057+0000 7f98b77fe700 1 -- 172.21.15.80:0/1472264162 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f98ac009790 con 0x7f98b81079b0 2019-11-28T12:01:26.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.057+0000 7f98be24e700 1 --2- 172.21.15.80:0/1472264162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b81079b0 0x7f98b8107e40 secure :-1 s=THROTTLE_DONE pgs=2943 cs=0 l=1 rx=0x7f98ac010440 tx=0x7f98ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.057+0000 7f98b77fe700 1 --2- 172.21.15.80:0/1472264162 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9898018730 0x7f989801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:26.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.057+0000 7f98b77fe700 1 -- 172.21.15.80:0/1472264162 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(224..224 src has 1..224) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f98ac031ba0 con 0x7f98b81079b0 2019-11-28T12:01:26.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.057+0000 7f98bea4f700 1 --2- 172.21.15.80:0/1472264162 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9898018730 0x7f989801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:26.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.058+0000 7f98bea4f700 1 --2- 172.21.15.80:0/1472264162 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9898018730 0x7f989801abc0 crc :-1 s=READY pgs=1218 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:26.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.065+0000 7f98c04b2700 1 -- 172.21.15.80:0/1472264162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b810c490 con 0x7f98b81079b0 2019-11-28T12:01:26.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.069+0000 7f98be24e700 1 --2- 172.21.15.80:0/1472264162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b81079b0 0x7f98b8107e40 secure :-1 s=THROTTLE_DONE pgs=2943 cs=0 l=1 rx=0x7f98ac010440 tx=0x7f98ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.069+0000 7f98b77fe700 1 -- 172.21.15.80:0/1472264162 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f98ac009580 con 0x7f98b81079b0 2019-11-28T12:01:26.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.234+0000 7f98c04b2700 1 -- 172.21.15.80:0/1472264162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f98b810c810 con 0x7f98b81079b0 2019-11-28T12:01:26.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.235+0000 7f98be24e700 1 --2- 172.21.15.80:0/1472264162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b81079b0 0x7f98b8107e40 secure :-1 s=THROTTLE_DONE pgs=2943 cs=0 l=1 rx=0x7f98ac010440 tx=0x7f98ac0107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.235+0000 7f98b77fe700 1 -- 172.21.15.80:0/1472264162 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v224) v1 ==== 104+0+10 (secure 0 0 0) 0x7f98ac009790 con 0x7f98b81079b0 2019-11-28T12:01:26.230 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:01:26.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.237+0000 7f98c04b2700 1 -- 172.21.15.80:0/1472264162 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9898018730 msgr2=0x7f989801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.237+0000 7f98c04b2700 1 --2- 172.21.15.80:0/1472264162 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9898018730 0x7f989801abc0 crc :-1 s=READY pgs=1218 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:26.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.237+0000 7f98c04b2700 1 -- 172.21.15.80:0/1472264162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b81079b0 msgr2=0x7f98b8107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.237+0000 7f98c04b2700 1 --2- 172.21.15.80:0/1472264162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b81079b0 0x7f98b8107e40 secure :-1 s=READY pgs=2943 cs=0 l=1 rx=0x7f98ac010440 tx=0x7f98ac0107e0).stop 2019-11-28T12:01:26.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.237+0000 7f98c04b2700 1 -- 172.21.15.80:0/1472264162 shutdown_connections 2019-11-28T12:01:26.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.237+0000 7f98c04b2700 1 --2- 172.21.15.80:0/1472264162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f98b81079b0 0x7f98b8107e40 unknown :-1 s=CLOSED pgs=2943 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:26.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.237+0000 7f98c04b2700 1 --2- 172.21.15.80:0/1472264162 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9898018730 0x7f989801abc0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:26.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.237+0000 7f98c04b2700 1 -- 172.21.15.80:0/1472264162 shutdown_connections 2019-11-28T12:01:26.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.237+0000 7f98c04b2700 1 -- 172.21.15.80:0/1472264162 wait complete. 2019-11-28T12:01:26.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.237+0000 7f98c04b2700 1 -- 172.21.15.80:0/1472264162 >> 172.21.15.80:0/1472264162 conn(0x7f98b815e2d0 msgr2=0x7f98b8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:26.241 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T12:01:26.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.371+0000 7fc10a418700 1 Processor -- start 2019-11-28T12:01:26.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.371+0000 7fc10a418700 1 -- start start 2019-11-28T12:01:26.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.372+0000 7fc10a418700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc10415f100 0x7fc10406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:26.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.372+0000 7fc10a418700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10406db60 con 0x7fc10415ed10 2019-11-28T12:01:26.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.372+0000 7fc10a418700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10406e060 con 0x7fc10406c2f0 2019-11-28T12:01:26.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.372+0000 7fc10a418700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10406fe00 con 0x7fc10415f100 2019-11-28T12:01:26.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.372+0000 7fc1089b5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc10415ed10 0x7fc104073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46700/0 (socket says 172.21.15.80:46700) 2019-11-28T12:01:26.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.372+0000 7fc1089b5700 1 -- 172.21.15.80:0/1917760616 learned_addr learned my addr 172.21.15.80:0/1917760616 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:26.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc103fff700 1 --2- 172.21.15.80:0/1917760616 >> v2:172.21.15.174:3300/0 conn(0x7fc10415f100 0x7fc10406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:26.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1037fe700 1 -- 172.21.15.80:0/1917760616 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049425987 0 0) 0x7fc0ec001150 con 0x7fc10415ed10 2019-11-28T12:01:26.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1037fe700 1 -- 172.21.15.80:0/1917760616 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0f0002e80 con 0x7fc10415ed10 2019-11-28T12:01:26.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1037fe700 1 -- 172.21.15.80:0/1917760616 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 551395867 0 0) 0x7fc0ec001130 con 0x7fc10415ed10 2019-11-28T12:01:26.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1037fe700 1 -- 172.21.15.80:0/1917760616 >> v2:172.21.15.174:3300/0 conn(0x7fc10415f100 msgr2=0x7fc10406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:26.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1037fe700 1 --2- 172.21.15.80:0/1917760616 >> v2:172.21.15.174:3300/0 conn(0x7fc10415f100 0x7fc10406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:26.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1037fe700 1 -- 172.21.15.80:0/1917760616 >> v1:172.21.15.174:6789/0 conn(0x7fc10406c2f0 legacy=0x7fc10406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1037fe700 1 -- 172.21.15.80:0/1917760616 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc104070760 con 0x7fc10415ed10 2019-11-28T12:01:26.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1037fe700 1 -- 172.21.15.80:0/1917760616 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc0ec001660 con 0x7fc10415ed10 2019-11-28T12:01:26.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1037fe700 1 -- 172.21.15.80:0/1917760616 >> v1:172.21.15.80:6789/0 conn(0x7fc10415ed10 legacy=0x7fc104073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1037fe700 1 --2- 172.21.15.80:0/1917760616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f0003ab0 0x7fc0f0005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:26.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1037fe700 1 --2- 172.21.15.80:0/1917760616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f0006670 0x7fc0f0008b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:26.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1037fe700 1 --2- 172.21.15.80:0/1917760616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0f00093a0 0x7fc0f000b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:26.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1037fe700 1 -- 172.21.15.80:0/1917760616 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f000c020 con 0x7fc0f0003ab0 2019-11-28T12:01:26.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1037fe700 1 -- 172.21.15.80:0/1917760616 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f0050220 con 0x7fc0f00093a0 2019-11-28T12:01:26.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1037fe700 1 -- 172.21.15.80:0/1917760616 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f0050450 con 0x7fc0f0006670 2019-11-28T12:01:26.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1917760616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f0003ab0 0x7fc0f0005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:26.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc103fff700 1 --2- 172.21.15.80:0/1917760616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f0006670 0x7fc0f0008b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:26.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1091b6700 1 --2- 172.21.15.80:0/1917760616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0f00093a0 0x7fc0f000b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:26.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1089b5700 1 -- 172.21.15.80:0/1917760616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f0006670 msgr2=0x7fc0f0008b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:26.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1917760616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f0006670 0x7fc0f0008b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:26.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1089b5700 1 -- 172.21.15.80:0/1917760616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0f00093a0 msgr2=0x7fc0f000b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:26.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1917760616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0f00093a0 0x7fc0f000b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:26.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1091b6700 1 -- 172.21.15.80:0/1917760616 reap_dead start 2019-11-28T12:01:26.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1089b5700 1 -- 172.21.15.80:0/1917760616 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f0050700 con 0x7fc0f0003ab0 2019-11-28T12:01:26.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.373+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1917760616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f0003ab0 0x7fc0f0005f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc0ec00f860 tx=0x7fc0ec001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.374+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1917760616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f0003ab0 0x7fc0f0005f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc0ec00f860 tx=0x7fc0ec001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.374+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1917760616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f0003ab0 0x7fc0f0005f10 secure :-1 s=READY pgs=2945 cs=0 l=1 rx=0x7fc0ec00f860 tx=0x7fc0ec001dd0).ready entity=mon.0 client_cookie=f860e84062dff50e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:26.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.374+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1917760616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f0003ab0 0x7fc0f0005f10 secure :-1 s=THROTTLE_DONE pgs=2945 cs=0 l=1 rx=0x7fc0ec00f860 tx=0x7fc0ec001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.374+0000 7fc1037fe700 1 -- 172.21.15.80:0/1917760616 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0ec001130 con 0x7fc0f0003ab0 2019-11-28T12:01:26.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.374+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1917760616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f0003ab0 0x7fc0f0005f10 secure :-1 s=THROTTLE_DONE pgs=2945 cs=0 l=1 rx=0x7fc0ec00f860 tx=0x7fc0ec001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.374+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1917760616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f0003ab0 0x7fc0f0005f10 secure :-1 s=THROTTLE_DONE pgs=2945 cs=0 l=1 rx=0x7fc0ec00f860 tx=0x7fc0ec001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.374+0000 7fc1037fe700 1 -- 172.21.15.80:0/1917760616 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ec004240 con 0x7fc0f0003ab0 2019-11-28T12:01:26.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.374+0000 7fc1037fe700 1 -- 172.21.15.80:0/1917760616 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0ec004890 con 0x7fc0f0003ab0 2019-11-28T12:01:26.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.374+0000 7fc10a418700 1 -- 172.21.15.80:0/1917760616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f0003ab0 msgr2=0x7fc0f0005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.374+0000 7fc10a418700 1 --2- 172.21.15.80:0/1917760616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f0003ab0 0x7fc0f0005f10 secure :-1 s=READY pgs=2945 cs=0 l=1 rx=0x7fc0ec00f860 tx=0x7fc0ec001dd0).stop 2019-11-28T12:01:26.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.374+0000 7fc10a418700 1 -- 172.21.15.80:0/1917760616 shutdown_connections 2019-11-28T12:01:26.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.374+0000 7fc10a418700 1 --2- 172.21.15.80:0/1917760616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc0f0003ab0 0x7fc0f0005f10 unknown :-1 s=CLOSED pgs=2945 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:26.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.374+0000 7fc10a418700 1 -- 172.21.15.80:0/1917760616 shutdown_connections 2019-11-28T12:01:26.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.374+0000 7fc10a418700 1 -- 172.21.15.80:0/1917760616 wait complete. 2019-11-28T12:01:26.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.374+0000 7fc10a418700 1 -- 172.21.15.80:0/1917760616 >> 172.21.15.80:0/1917760616 conn(0x7fc104061d20 msgr2=0x7fc1040641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:26.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.377+0000 7fc10a418700 1 Processor -- start 2019-11-28T12:01:26.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.377+0000 7fc10a418700 1 -- start start 2019-11-28T12:01:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc10a418700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc104108920 0x7fc104132610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc10a418700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc104132b50 0x7fc10414b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc10a418700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10415ddb0 con 0x7fc10414b620 2019-11-28T12:01:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc10a418700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10411ec40 con 0x7fc104108920 2019-11-28T12:01:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc10a418700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1041197e0 con 0x7fc104132b50 2019-11-28T12:01:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1089b5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc104108920 0x7fc104132610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:26.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1089b5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc104108920 0x7fc104132610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47396/0 (socket says 172.21.15.80:47396) 2019-11-28T12:01:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1089b5700 1 -- 172.21.15.80:0/1266096600 learned_addr learned my addr 172.21.15.80:0/1266096600 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc103fff700 1 --2- 172.21.15.80:0/1266096600 >> v2:172.21.15.174:3300/0 conn(0x7fc104132b50 0x7fc10414b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1089b5700 1 -- 172.21.15.80:0/1266096600 >> v2:172.21.15.174:3300/0 conn(0x7fc104132b50 msgr2=0x7fc10414b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1266096600 >> v2:172.21.15.174:3300/0 conn(0x7fc104132b50 0x7fc10414b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1089b5700 1 -- 172.21.15.80:0/1266096600 >> v1:172.21.15.80:6789/0 conn(0x7fc10414b620 legacy=0x7fc104131490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.384 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1017fa700 1 -- 172.21.15.80:0/1266096600 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321966498 0 0) 0x7fc0fc0097b0 con 0x7fc10414b620 2019-11-28T12:01:26.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1089b5700 1 -- 172.21.15.80:0/1266096600 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1041300d0 con 0x7fc104108920 2019-11-28T12:01:26.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1266096600 >> v2:172.21.15.80:3300/0 conn(0x7fc104108920 0x7fc104132610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc0ec010410 tx=0x7fc0ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1266096600 >> v2:172.21.15.80:3300/0 conn(0x7fc104108920 0x7fc104132610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc0ec010410 tx=0x7fc0ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1266096600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc104108920 0x7fc104132610 secure :-1 s=READY pgs=2947 cs=0 l=1 rx=0x7fc0ec010410 tx=0x7fc0ec010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:26.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1266096600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc104108920 0x7fc104132610 secure :-1 s=THROTTLE_DONE pgs=2947 cs=0 l=1 rx=0x7fc0ec010410 tx=0x7fc0ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1017fa700 1 -- 172.21.15.80:0/1266096600 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0ec000f00 con 0x7fc104108920 2019-11-28T12:01:26.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1266096600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc104108920 0x7fc104132610 secure :-1 s=THROTTLE_DONE pgs=2947 cs=0 l=1 rx=0x7fc0ec010410 tx=0x7fc0ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1266096600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc104108920 0x7fc104132610 secure :-1 s=THROTTLE_DONE pgs=2947 cs=0 l=1 rx=0x7fc0ec010410 tx=0x7fc0ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1017fa700 1 -- 172.21.15.80:0/1266096600 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ec001100 con 0x7fc104108920 2019-11-28T12:01:26.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc1017fa700 1 -- 172.21.15.80:0/1266096600 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0ec000f00 con 0x7fc104108920 2019-11-28T12:01:26.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc10a418700 1 -- 172.21.15.80:0/1266096600 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10411e510 con 0x7fc104108920 2019-11-28T12:01:26.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.378+0000 7fc10a418700 1 -- 172.21.15.80:0/1266096600 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1041300d0 con 0x7fc104108920 2019-11-28T12:01:26.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.379+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1266096600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc104108920 0x7fc104132610 secure :-1 s=THROTTLE_DONE pgs=2947 cs=0 l=1 rx=0x7fc0ec010410 tx=0x7fc0ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.379+0000 7fc1017fa700 1 -- 172.21.15.80:0/1266096600 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc0ec004240 con 0x7fc104108920 2019-11-28T12:01:26.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.379+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1266096600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc104108920 0x7fc104132610 secure :-1 s=THROTTLE_DONE pgs=2947 cs=0 l=1 rx=0x7fc0ec010410 tx=0x7fc0ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.379+0000 7fc1017fa700 1 --2- 172.21.15.80:0/1266096600 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0e8018730 0x7fc0e801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.379+0000 7fc1017fa700 1 -- 172.21.15.80:0/1266096600 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(224..224 src has 1..224) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fc0ec031a60 con 0x7fc104108920 2019-11-28T12:01:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.379+0000 7fc103fff700 1 --2- 172.21.15.80:0/1266096600 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0e8018730 0x7fc0e801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.380+0000 7fc103fff700 1 --2- 172.21.15.80:0/1266096600 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0e8018730 0x7fc0e801abc0 crc :-1 s=READY pgs=1219 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:26.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.387+0000 7fc10a418700 1 -- 172.21.15.80:0/1266096600 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10411e510 con 0x7fc104108920 2019-11-28T12:01:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.390+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1266096600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc104108920 0x7fc104132610 secure :-1 s=THROTTLE_DONE pgs=2947 cs=0 l=1 rx=0x7fc0ec010410 tx=0x7fc0ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.390+0000 7fc1017fa700 1 -- 172.21.15.80:0/1266096600 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc0ec000990 con 0x7fc104108920 2019-11-28T12:01:26.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.557+0000 7fc10a418700 1 -- 172.21.15.80:0/1266096600 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fc1041300d0 con 0x7fc104108920 2019-11-28T12:01:26.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.557+0000 7fc1089b5700 1 --2- 172.21.15.80:0/1266096600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc104108920 0x7fc104132610 secure :-1 s=THROTTLE_DONE pgs=2947 cs=0 l=1 rx=0x7fc0ec010410 tx=0x7fc0ec010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.557+0000 7fc1017fa700 1 -- 172.21.15.80:0/1266096600 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v224) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc0ec004240 con 0x7fc104108920 2019-11-28T12:01:26.552 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:01:26.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.560+0000 7fc10a418700 1 -- 172.21.15.80:0/1266096600 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0e8018730 msgr2=0x7fc0e801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.560+0000 7fc10a418700 1 --2- 172.21.15.80:0/1266096600 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0e8018730 0x7fc0e801abc0 crc :-1 s=READY pgs=1219 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:26.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.560+0000 7fc10a418700 1 -- 172.21.15.80:0/1266096600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc104108920 msgr2=0x7fc104132610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.560+0000 7fc10a418700 1 --2- 172.21.15.80:0/1266096600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc104108920 0x7fc104132610 secure :-1 s=READY pgs=2947 cs=0 l=1 rx=0x7fc0ec010410 tx=0x7fc0ec010290).stop 2019-11-28T12:01:26.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.560+0000 7fc10a418700 1 -- 172.21.15.80:0/1266096600 shutdown_connections 2019-11-28T12:01:26.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.560+0000 7fc10a418700 1 --2- 172.21.15.80:0/1266096600 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc0e8018730 0x7fc0e801abc0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:26.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.560+0000 7fc10a418700 1 --2- 172.21.15.80:0/1266096600 >> v2:172.21.15.174:3300/0 conn(0x7fc104132b50 0x7fc10414b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:26.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.560+0000 7fc10a418700 1 --2- 172.21.15.80:0/1266096600 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc104108920 0x7fc104132610 unknown :-1 s=CLOSED pgs=2947 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:26.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.560+0000 7fc10a418700 1 -- 172.21.15.80:0/1266096600 shutdown_connections 2019-11-28T12:01:26.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.560+0000 7fc10a418700 1 -- 172.21.15.80:0/1266096600 wait complete. 2019-11-28T12:01:26.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.560+0000 7fc10a418700 1 -- 172.21.15.80:0/1266096600 >> 172.21.15.80:0/1266096600 conn(0x7fc10414dbb0 msgr2=0x7fc104142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:26.564 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T12:01:26.565 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:01:26.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.694+0000 7fcba5fe2700 1 Processor -- start 2019-11-28T12:01:26.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.694+0000 7fcba5fe2700 1 -- start start 2019-11-28T12:01:26.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.695+0000 7fcba5fe2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcba006c0a0 0x7fcba0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:26.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.695+0000 7fcba5fe2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcba00734e0 0x7fcba0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:26.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.695+0000 7fcba5fe2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba006db00 con 0x7fcba0072360 2019-11-28T12:01:26.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.695+0000 7fcba5fe2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba006fd60 con 0x7fcba006c0a0 2019-11-28T12:01:26.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.695+0000 7fcba5fe2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba0070030 con 0x7fcba00734e0 2019-11-28T12:01:26.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.695+0000 7fcba4d80700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcba0072360 0x7fcba006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46724/0 (socket says 172.21.15.80:46724) 2019-11-28T12:01:26.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.695+0000 7fcba4d80700 1 -- 172.21.15.80:0/1868752063 learned_addr learned my addr 172.21.15.80:0/1868752063 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:26.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.695+0000 7fcb97fff700 1 --2- 172.21.15.80:0/1868752063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcba00734e0 0x7fcba0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:26.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.695+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/1868752063 >> v2:172.21.15.174:3300/0 conn(0x7fcba006c0a0 0x7fcba0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:26.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcb9f7fe700 1 -- 172.21.15.80:0/1868752063 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175771673 0 0) 0x7fcb980014f0 con 0x7fcba0072360 2019-11-28T12:01:26.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcb9f7fe700 1 -- 172.21.15.80:0/1868752063 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb8c002e80 con 0x7fcba0072360 2019-11-28T12:01:26.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcb9ffff700 1 -- 172.21.15.80:0/1868752063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcba00734e0 msgr2=0x7fcba0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:26.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/1868752063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcba00734e0 0x7fcba0071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:26.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcb9ffff700 1 -- 172.21.15.80:0/1868752063 >> v1:172.21.15.80:6789/0 conn(0x7fcba0072360 legacy=0x7fcba006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcb9ffff700 1 -- 172.21.15.80:0/1868752063 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba00706c0 con 0x7fcba006c0a0 2019-11-28T12:01:26.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcb97fff700 1 --2- 172.21.15.80:0/1868752063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcba00734e0 0x7fcba0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:26.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/1868752063 >> v2:172.21.15.174:3300/0 conn(0x7fcba006c0a0 0x7fcba0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcb9000af50 tx=0x7fcb9000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/1868752063 >> v2:172.21.15.174:3300/0 conn(0x7fcba006c0a0 0x7fcba0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcb9000af50 tx=0x7fcb9000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/1868752063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcba006c0a0 0x7fcba0072fa0 secure :-1 s=READY pgs=1779 cs=0 l=1 rx=0x7fcb9000af50 tx=0x7fcb9000b760).ready entity=mon.1 client_cookie=43b81eaacaeb68d8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:26.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/1868752063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcba006c0a0 0x7fcba0072fa0 secure :-1 s=THROTTLE_DONE pgs=1779 cs=0 l=1 rx=0x7fcb9000af50 tx=0x7fcb9000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/1868752063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcba006c0a0 0x7fcba0072fa0 secure :-1 s=THROTTLE_DONE pgs=1779 cs=0 l=1 rx=0x7fcb9000af50 tx=0x7fcb9000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcb9f7fe700 1 -- 172.21.15.80:0/1868752063 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb90007210 con 0x7fcba006c0a0 2019-11-28T12:01:26.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/1868752063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcba006c0a0 0x7fcba0072fa0 secure :-1 s=THROTTLE_DONE pgs=1779 cs=0 l=1 rx=0x7fcb9000af50 tx=0x7fcb9000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcb9f7fe700 1 -- 172.21.15.80:0/1868752063 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb900099b0 con 0x7fcba006c0a0 2019-11-28T12:01:26.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcb9f7fe700 1 -- 172.21.15.80:0/1868752063 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb9000a080 con 0x7fcba006c0a0 2019-11-28T12:01:26.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcba5fe2700 1 -- 172.21.15.80:0/1868752063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcba006c0a0 msgr2=0x7fcba0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.696+0000 7fcba5fe2700 1 --2- 172.21.15.80:0/1868752063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcba006c0a0 0x7fcba0072fa0 secure :-1 s=READY pgs=1779 cs=0 l=1 rx=0x7fcb9000af50 tx=0x7fcb9000b760).stop 2019-11-28T12:01:26.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.697+0000 7fcba5fe2700 1 -- 172.21.15.80:0/1868752063 shutdown_connections 2019-11-28T12:01:26.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.697+0000 7fcba5fe2700 1 --2- 172.21.15.80:0/1868752063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcba00734e0 0x7fcba0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:26.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.697+0000 7fcba5fe2700 1 --2- 172.21.15.80:0/1868752063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcba006c0a0 0x7fcba0072fa0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:26.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.697+0000 7fcba5fe2700 1 -- 172.21.15.80:0/1868752063 shutdown_connections 2019-11-28T12:01:26.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.697+0000 7fcba5fe2700 1 -- 172.21.15.80:0/1868752063 wait complete. 2019-11-28T12:01:26.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.697+0000 7fcba5fe2700 1 -- 172.21.15.80:0/1868752063 >> 172.21.15.80:0/1868752063 conn(0x7fcba0061cf0 msgr2=0x7fcba0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:26.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.699+0000 7fcba5fe2700 1 Processor -- start 2019-11-28T12:01:26.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.699+0000 7fcba5fe2700 1 -- start start 2019-11-28T12:01:26.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.700+0000 7fcba5fe2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcba013eb40 0x7fcba010afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:26.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.700+0000 7fcba5fe2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcba010b500 0x7fcba01629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:26.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.700+0000 7fcba5fe2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba013f1e0 con 0x7fcba0162f30 2019-11-28T12:01:26.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.700+0000 7fcba5fe2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba01234c0 con 0x7fcba013eb40 2019-11-28T12:01:26.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.700+0000 7fcba5fe2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba013e0d0 con 0x7fcba010b500 2019-11-28T12:01:26.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.700+0000 7fcb9ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcba013eb40 0x7fcba010afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:26.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.700+0000 7fcb9ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcba013eb40 0x7fcba010afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47410/0 (socket says 172.21.15.80:47410) 2019-11-28T12:01:26.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.700+0000 7fcb9ffff700 1 -- 172.21.15.80:0/760401397 learned_addr learned my addr 172.21.15.80:0/760401397 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:26.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.700+0000 7fcb97fff700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcba010b500 0x7fcba01629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:26.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.701+0000 7fcb9ffff700 1 -- 172.21.15.80:0/760401397 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcba010b500 msgr2=0x7fcba01629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.701+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcba010b500 0x7fcba01629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:26.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.701+0000 7fcb9ffff700 1 -- 172.21.15.80:0/760401397 >> v1:172.21.15.174:6789/0 conn(0x7fcba0162f30 legacy=0x7fcba0109e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.701+0000 7fcb9ffff700 1 -- 172.21.15.80:0/760401397 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba0108700 con 0x7fcba013eb40 2019-11-28T12:01:26.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.701+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/760401397 >> v2:172.21.15.80:3300/0 conn(0x7fcba013eb40 0x7fcba010afc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcb900544c0 tx=0x7fcb9000fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.701+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/760401397 >> v2:172.21.15.80:3300/0 conn(0x7fcba013eb40 0x7fcba010afc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcb900544c0 tx=0x7fcb9000fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.701+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba013eb40 0x7fcba010afc0 secure :-1 s=READY pgs=2949 cs=0 l=1 rx=0x7fcb900544c0 tx=0x7fcb9000fd40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:26.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.701+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba013eb40 0x7fcba010afc0 secure :-1 s=THROTTLE_DONE pgs=2949 cs=0 l=1 rx=0x7fcb900544c0 tx=0x7fcb9000fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.701+0000 7fcb9d7fa700 1 -- 172.21.15.80:0/760401397 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb9000abb0 con 0x7fcba013eb40 2019-11-28T12:01:26.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.701+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba013eb40 0x7fcba010afc0 secure :-1 s=THROTTLE_DONE pgs=2949 cs=0 l=1 rx=0x7fcb900544c0 tx=0x7fcb9000fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.701+0000 7fcba5fe2700 1 -- 172.21.15.80:0/760401397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba0108a80 con 0x7fcba013eb40 2019-11-28T12:01:26.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.701+0000 7fcb9d7fa700 1 -- 172.21.15.80:0/760401397 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9000abb0 con 0x7fcba013eb40 2019-11-28T12:01:26.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.701+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba013eb40 0x7fcba010afc0 secure :-1 s=THROTTLE_DONE pgs=2949 cs=0 l=1 rx=0x7fcb900544c0 tx=0x7fcb9000fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.701+0000 7fcb9d7fa700 1 -- 172.21.15.80:0/760401397 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb90009960 con 0x7fcba013eb40 2019-11-28T12:01:26.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.701+0000 7fcba5fe2700 1 -- 172.21.15.80:0/760401397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba0108700 con 0x7fcba013eb40 2019-11-28T12:01:26.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.701+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba013eb40 0x7fcba010afc0 secure :-1 s=THROTTLE_DONE pgs=2949 cs=0 l=1 rx=0x7fcb900544c0 tx=0x7fcb9000fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.702+0000 7fcb9d7fa700 1 -- 172.21.15.80:0/760401397 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcb90009580 con 0x7fcba013eb40 2019-11-28T12:01:26.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.702+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba013eb40 0x7fcba010afc0 secure :-1 s=THROTTLE_DONE pgs=2949 cs=0 l=1 rx=0x7fcb900544c0 tx=0x7fcb9000fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.702+0000 7fcb9d7fa700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb84018730 0x7fcb8401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:26.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.702+0000 7fcb9d7fa700 1 -- 172.21.15.80:0/760401397 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(224..224 src has 1..224) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fcb90075b30 con 0x7fcba013eb40 2019-11-28T12:01:26.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.702+0000 7fcb97fff700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb84018730 0x7fcb8401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:26.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.702+0000 7fcb97fff700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb84018730 0x7fcb8401abc0 crc :-1 s=READY pgs=1220 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:26.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.709+0000 7fcba5fe2700 1 -- 172.21.15.80:0/760401397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba0108a80 con 0x7fcba013eb40 2019-11-28T12:01:26.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.713+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba013eb40 0x7fcba010afc0 secure :-1 s=THROTTLE_DONE pgs=2949 cs=0 l=1 rx=0x7fcb900544c0 tx=0x7fcb9000fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.713+0000 7fcb9d7fa700 1 -- 172.21.15.80:0/760401397 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcb9000ada0 con 0x7fcba013eb40 2019-11-28T12:01:26.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.884+0000 7fcba5fe2700 1 -- 172.21.15.80:0/760401397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcba0108700 con 0x7fcba013eb40 2019-11-28T12:01:26.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.884+0000 7fcb9ffff700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba013eb40 0x7fcba010afc0 secure :-1 s=THROTTLE_DONE pgs=2949 cs=0 l=1 rx=0x7fcb900544c0 tx=0x7fcb9000fd40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:26.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.884+0000 7fcb9d7fa700 1 -- 172.21.15.80:0/760401397 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 186 v186) v1 ==== 95+0+2457 (secure 0 0 0) 0x7fcb90009580 con 0x7fcba013eb40 2019-11-28T12:01:26.879 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:26.880 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":186,"default_fscid":18,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":11665,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/3051174059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3051174059},{"type":"v1","addr":"172.21.15.174:6835","nonce":3051174059}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":184},{"gid":12435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/2096320481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2096320481},{"type":"v1","addr":"172.21.15.80:6834","nonce":2096320481}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":184}],"filesystems":[{"mdsmap":{"epoch":186,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:58:24.286894+0000","modified":"2019-11-28T11:58:31.978284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8138":{"gid":8138,"name":"a","rank":0,"incarnation":185,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6835/4148152245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":4148152245},{"type":"v1","addr":"172.21.15.80:6835","nonce":4148152245}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[37],"metadata_pool":36,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":18}]} 2019-11-28T12:01:26.880 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 186 2019-11-28T12:01:26.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.887+0000 7fcba5fe2700 1 -- 172.21.15.80:0/760401397 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb84018730 msgr2=0x7fcb8401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.887+0000 7fcba5fe2700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb84018730 0x7fcb8401abc0 crc :-1 s=READY pgs=1220 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:26.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.887+0000 7fcba5fe2700 1 -- 172.21.15.80:0/760401397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba013eb40 msgr2=0x7fcba010afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:26.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.887+0000 7fcba5fe2700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba013eb40 0x7fcba010afc0 secure :-1 s=READY pgs=2949 cs=0 l=1 rx=0x7fcb900544c0 tx=0x7fcb9000fd40).stop 2019-11-28T12:01:26.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.887+0000 7fcba5fe2700 1 -- 172.21.15.80:0/760401397 shutdown_connections 2019-11-28T12:01:26.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.887+0000 7fcba5fe2700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb84018730 0x7fcb8401abc0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:26.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.887+0000 7fcba5fe2700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcba010b500 0x7fcba01629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:26.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.887+0000 7fcba5fe2700 1 --2- 172.21.15.80:0/760401397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcba013eb40 0x7fcba010afc0 unknown :-1 s=CLOSED pgs=2949 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:26.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.887+0000 7fcba5fe2700 1 -- 172.21.15.80:0/760401397 shutdown_connections 2019-11-28T12:01:26.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.887+0000 7fcba5fe2700 1 -- 172.21.15.80:0/760401397 wait complete. 2019-11-28T12:01:26.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:26.887+0000 7fcba5fe2700 1 -- 172.21.15.80:0/760401397 >> 172.21.15.80:0/760401397 conn(0x7fcba011bfc0 msgr2=0x7fcba0141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:27.194 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8138}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 36, u'failed': [], u'epoch': 186, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [37], u'info': {u'gid_8138': {u'export_targets': [], u'name': u'a', u'incarnation': 185, u'state_seq': 3, u'state': u'up:active', u'gid': 8138, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 4148152245, u'type': u'v2', u'addr': u'172.21.15.80:6833'}, {u'nonce': 4148152245, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/4148152245'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T11:58:24.286894+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T11:58:31.978284+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T12:01:27.195 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T12:01:27.195 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2019-11-28T12:01:27.332 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T12:01:27.332 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T12:01:27.332 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T12:01:27.333 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 8138, 2019-11-28T12:01:27.333 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2019-11-28T12:01:27.333 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2019-11-28T12:01:27.333 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 176.35773057099999, 2019-11-28T12:01:27.333 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 186, 2019-11-28T12:01:27.333 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 224, 2019-11-28T12:01:27.334 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 224, 2019-11-28T12:01:27.334 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 180.631032895 2019-11-28T12:01:27.334 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T12:01:27.338 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8138, "want_state": "up:active", "state": "up:active", "rank_uptime": 176.35773057099999, "mdsmap_epoch": 186, "osdmap_epoch": 224, "osdmap_epoch_barrier": 224, "uptime": 180.631032895 } 2019-11-28T12:01:27.338 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T12:01:27.338 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T12:01:27.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T12:01:27.339 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T12:01:27.421 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T12:01:27.421 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T12:01:27.707 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T12:01:27.707 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T12:01:27.824 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T12:01:27.824 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T12:01:27.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T12:01:27.824 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T12:01:27.910 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_write_caps' 2019-11-28T12:01:28.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.034+0000 7fb546cfb700 1 Processor -- start 2019-11-28T12:01:28.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.035+0000 7fb546cfb700 1 -- start start 2019-11-28T12:01:28.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.035+0000 7fb546cfb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb54006c0a0 0x7fb540072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:28.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.035+0000 7fb546cfb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb5400734e0 0x7fb540071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:28.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.035+0000 7fb546cfb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54006db00 con 0x7fb540072360 2019-11-28T12:01:28.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb546cfb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54006fd60 con 0x7fb54006c0a0 2019-11-28T12:01:28.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb546cfb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb540070030 con 0x7fb5400734e0 2019-11-28T12:01:28.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb545298700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb54006c0a0 0x7fb540072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:28.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb545298700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb54006c0a0 0x7fb540072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47418/0 (socket says 172.21.15.80:47418) 2019-11-28T12:01:28.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb545298700 1 -- 172.21.15.80:0/1620231248 learned_addr learned my addr 172.21.15.80:0/1620231248 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:28.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb544a97700 1 --2- 172.21.15.80:0/1620231248 >> v2:172.21.15.174:3300/0 conn(0x7fb5400734e0 0x7fb540071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:28.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb545298700 1 -- 172.21.15.80:0/1620231248 >> v2:172.21.15.174:3300/0 conn(0x7fb5400734e0 msgr2=0x7fb540071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:28.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb545298700 1 --2- 172.21.15.80:0/1620231248 >> v2:172.21.15.174:3300/0 conn(0x7fb5400734e0 0x7fb540071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:28.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb545298700 1 -- 172.21.15.80:0/1620231248 >> v1:172.21.15.174:6789/0 conn(0x7fb540072360 legacy=0x7fb54006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:28.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb545298700 1 -- 172.21.15.80:0/1620231248 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5400706c0 con 0x7fb54006c0a0 2019-11-28T12:01:28.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb545298700 1 --2- 172.21.15.80:0/1620231248 >> v2:172.21.15.80:3300/0 conn(0x7fb54006c0a0 0x7fb540072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb52800fa40 tx=0x7fb52800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:28.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb545298700 1 --2- 172.21.15.80:0/1620231248 >> v2:172.21.15.80:3300/0 conn(0x7fb54006c0a0 0x7fb540072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb52800fa40 tx=0x7fb52800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:28.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb545298700 1 --2- 172.21.15.80:0/1620231248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54006c0a0 0x7fb540072fa0 secure :-1 s=READY pgs=2950 cs=0 l=1 rx=0x7fb52800fa40 tx=0x7fb52800fde0).ready entity=mon.0 client_cookie=80a412b4a502152c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:28.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb545298700 1 --2- 172.21.15.80:0/1620231248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54006c0a0 0x7fb540072fa0 secure :-1 s=THROTTLE_DONE pgs=2950 cs=0 l=1 rx=0x7fb52800fa40 tx=0x7fb52800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:28.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb53ffff700 1 -- 172.21.15.80:0/1620231248 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb528000ce0 con 0x7fb54006c0a0 2019-11-28T12:01:28.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb545298700 1 --2- 172.21.15.80:0/1620231248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54006c0a0 0x7fb540072fa0 secure :-1 s=THROTTLE_DONE pgs=2950 cs=0 l=1 rx=0x7fb52800fa40 tx=0x7fb52800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:28.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb545298700 1 --2- 172.21.15.80:0/1620231248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54006c0a0 0x7fb540072fa0 secure :-1 s=THROTTLE_DONE pgs=2950 cs=0 l=1 rx=0x7fb52800fa40 tx=0x7fb52800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:28.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb53ffff700 1 -- 172.21.15.80:0/1620231248 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb528001010 con 0x7fb54006c0a0 2019-11-28T12:01:28.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb53ffff700 1 -- 172.21.15.80:0/1620231248 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb528001720 con 0x7fb54006c0a0 2019-11-28T12:01:28.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb546cfb700 1 -- 172.21.15.80:0/1620231248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54006c0a0 msgr2=0x7fb540072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:28.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.036+0000 7fb546cfb700 1 --2- 172.21.15.80:0/1620231248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54006c0a0 0x7fb540072fa0 secure :-1 s=READY pgs=2950 cs=0 l=1 rx=0x7fb52800fa40 tx=0x7fb52800fde0).stop 2019-11-28T12:01:28.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.037+0000 7fb546cfb700 1 -- 172.21.15.80:0/1620231248 shutdown_connections 2019-11-28T12:01:28.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.037+0000 7fb546cfb700 1 --2- 172.21.15.80:0/1620231248 >> v2:172.21.15.174:3300/0 conn(0x7fb5400734e0 0x7fb540071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:28.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.037+0000 7fb546cfb700 1 --2- 172.21.15.80:0/1620231248 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54006c0a0 0x7fb540072fa0 unknown :-1 s=CLOSED pgs=2950 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:28.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.037+0000 7fb546cfb700 1 -- 172.21.15.80:0/1620231248 shutdown_connections 2019-11-28T12:01:28.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.037+0000 7fb546cfb700 1 -- 172.21.15.80:0/1620231248 wait complete. 2019-11-28T12:01:28.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.037+0000 7fb546cfb700 1 -- 172.21.15.80:0/1620231248 >> 172.21.15.80:0/1620231248 conn(0x7fb540061cf0 msgr2=0x7fb540064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:28.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.040+0000 7fb546cfb700 1 Processor -- start 2019-11-28T12:01:28.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.040+0000 7fb546cfb700 1 -- start start 2019-11-28T12:01:28.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb546cfb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb54013e8e0 0x7fb54014fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:28.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb546cfb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5401500d0 0x7fb540105fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:28.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb546cfb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54013bd00 con 0x7fb5401064e0 2019-11-28T12:01:28.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb546cfb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54010df40 con 0x7fb54013e8e0 2019-11-28T12:01:28.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb546cfb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb540104240 con 0x7fb5401500d0 2019-11-28T12:01:28.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb545298700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb54013e8e0 0x7fb54014fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:28.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb545298700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb54013e8e0 0x7fb54014fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47424/0 (socket says 172.21.15.80:47424) 2019-11-28T12:01:28.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb545298700 1 -- 172.21.15.80:0/1378402866 learned_addr learned my addr 172.21.15.80:0/1378402866 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:28.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb544a97700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5401500d0 0x7fb540105fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:28.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb545298700 1 -- 172.21.15.80:0/1378402866 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5401500d0 msgr2=0x7fb540105fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:28.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb545298700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5401500d0 0x7fb540105fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:28.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb545298700 1 -- 172.21.15.80:0/1378402866 >> v1:172.21.15.174:6789/0 conn(0x7fb5401064e0 legacy=0x7fb54010e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:28.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb545298700 1 -- 172.21.15.80:0/1378402866 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5401048d0 con 0x7fb54013e8e0 2019-11-28T12:01:28.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb544a97700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5401500d0 0x7fb540105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T12:01:28.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb545298700 1 --2- 172.21.15.80:0/1378402866 >> v2:172.21.15.80:3300/0 conn(0x7fb54013e8e0 0x7fb54014fb90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb528010790 tx=0x7fb528010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:28.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb545298700 1 --2- 172.21.15.80:0/1378402866 >> v2:172.21.15.80:3300/0 conn(0x7fb54013e8e0 0x7fb54014fb90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb528010790 tx=0x7fb528010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:28.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb545298700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54013e8e0 0x7fb54014fb90 secure :-1 s=READY pgs=2951 cs=0 l=1 rx=0x7fb528010790 tx=0x7fb528010b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:28.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb545298700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54013e8e0 0x7fb54014fb90 secure :-1 s=THROTTLE_DONE pgs=2951 cs=0 l=1 rx=0x7fb528010790 tx=0x7fb528010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:28.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb545298700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54013e8e0 0x7fb54014fb90 secure :-1 s=THROTTLE_DONE pgs=2951 cs=0 l=1 rx=0x7fb528010790 tx=0x7fb528010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:28.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb53dffb700 1 -- 172.21.15.80:0/1378402866 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb528005af0 con 0x7fb54013e8e0 2019-11-28T12:01:28.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb545298700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54013e8e0 0x7fb54014fb90 secure :-1 s=THROTTLE_DONE pgs=2951 cs=0 l=1 rx=0x7fb528010790 tx=0x7fb528010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:28.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb53dffb700 1 -- 172.21.15.80:0/1378402866 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb528005710 con 0x7fb54013e8e0 2019-11-28T12:01:28.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb546cfb700 1 -- 172.21.15.80:0/1378402866 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb540104c50 con 0x7fb54013e8e0 2019-11-28T12:01:28.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb53dffb700 1 -- 172.21.15.80:0/1378402866 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5280060d0 con 0x7fb54013e8e0 2019-11-28T12:01:28.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.041+0000 7fb546cfb700 1 -- 172.21.15.80:0/1378402866 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5401048d0 con 0x7fb54013e8e0 2019-11-28T12:01:28.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.042+0000 7fb545298700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54013e8e0 0x7fb54014fb90 secure :-1 s=THROTTLE_DONE pgs=2951 cs=0 l=1 rx=0x7fb528010790 tx=0x7fb528010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:28.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.042+0000 7fb53dffb700 1 -- 172.21.15.80:0/1378402866 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb528005900 con 0x7fb54013e8e0 2019-11-28T12:01:28.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.042+0000 7fb545298700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54013e8e0 0x7fb54014fb90 secure :-1 s=THROTTLE_DONE pgs=2951 cs=0 l=1 rx=0x7fb528010790 tx=0x7fb528010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:28.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.042+0000 7fb53dffb700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb524018730 0x7fb52401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:28.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.042+0000 7fb53dffb700 1 -- 172.21.15.80:0/1378402866 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(224..224 src has 1..224) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fb528031e60 con 0x7fb54013e8e0 2019-11-28T12:01:28.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.042+0000 7fb544a97700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb524018730 0x7fb52401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:28.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.042+0000 7fb544a97700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb524018730 0x7fb52401abc0 crc :-1 s=READY pgs=1221 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:28.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.050+0000 7fb546cfb700 1 -- 172.21.15.80:0/1378402866 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb540104c50 con 0x7fb54013e8e0 2019-11-28T12:01:28.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.053+0000 7fb545298700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54013e8e0 0x7fb54014fb90 secure :-1 s=THROTTLE_DONE pgs=2951 cs=0 l=1 rx=0x7fb528010790 tx=0x7fb528010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:28.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.053+0000 7fb53dffb700 1 -- 172.21.15.80:0/1378402866 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb528005500 con 0x7fb54013e8e0 2019-11-28T12:01:28.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.226+0000 7fb546cfb700 1 -- 172.21.15.80:0/1378402866 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_write_caps"]} v 0) v1 -- 0x7fb5401048d0 con 0x7fb54013e8e0 2019-11-28T12:01:28.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.609+0000 7fb545298700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54013e8e0 0x7fb54014fb90 secure :-1 s=THROTTLE_DONE pgs=2951 cs=0 l=1 rx=0x7fb528010790 tx=0x7fb528010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:28.605 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.609+0000 7fb53dffb700 1 -- 172.21.15.80:0/1378402866 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_stale_write_caps"]}]=0 v836) v1 ==== 153+0+0 (secure 0 0 0) 0x7fb528005a10 con 0x7fb54013e8e0 2019-11-28T12:01:28.637 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.643+0000 7fb546cfb700 1 -- 172.21.15.80:0/1378402866 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb524018730 msgr2=0x7fb52401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:28.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.643+0000 7fb546cfb700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb524018730 0x7fb52401abc0 crc :-1 s=READY pgs=1221 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:28.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.643+0000 7fb546cfb700 1 -- 172.21.15.80:0/1378402866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54013e8e0 msgr2=0x7fb54014fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:28.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.643+0000 7fb546cfb700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54013e8e0 0x7fb54014fb90 secure :-1 s=READY pgs=2951 cs=0 l=1 rx=0x7fb528010790 tx=0x7fb528010b30).stop 2019-11-28T12:01:28.638 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.643+0000 7fb546cfb700 1 -- 172.21.15.80:0/1378402866 shutdown_connections 2019-11-28T12:01:28.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.643+0000 7fb546cfb700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb524018730 0x7fb52401abc0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:28.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.643+0000 7fb546cfb700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5401500d0 0x7fb540105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:28.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.643+0000 7fb546cfb700 1 --2- 172.21.15.80:0/1378402866 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb54013e8e0 0x7fb54014fb90 unknown :-1 s=CLOSED pgs=2951 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:28.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.643+0000 7fb546cfb700 1 -- 172.21.15.80:0/1378402866 shutdown_connections 2019-11-28T12:01:28.639 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.643+0000 7fb546cfb700 1 -- 172.21.15.80:0/1378402866 wait complete. 2019-11-28T12:01:28.640 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:28.643+0000 7fb546cfb700 1 -- 172.21.15.80:0/1378402866 >> 172.21.15.80:0/1378402866 conn(0x7fb54013d620 msgr2=0x7fb54013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:28.648 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T12:01:28.648 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:01:28.716 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:01:28.777 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:01:28.864 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:01:28.921 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:01:28.985 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:01:29.047 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T12:01:29.048 INFO:tasks.cephfs.mount:Terminating background process 2019-11-28T12:01:29.049 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T12:01:29.050 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T12:01:29.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T12:01:29.051 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T12:01:29.180 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T12:01:29.185 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T12:01:29.223 INFO:tasks.cephfs.mount:Terminating background process 2019-11-28T12:01:29.223 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T12:01:29.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T12:01:29.224 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T12:01:29.315 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T12:01:29.319 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T12:01:29.361 INFO:tasks.cephfs_test_runner:test_stale_write_caps (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2019-11-28T12:01:29.361 INFO:tasks.cephfs_test_runner:Starting test: test_trim_caps (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T12:01:29.361 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_trim_caps' 2019-11-28T12:01:29.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.486+0000 7f538f18a700 1 Processor -- start 2019-11-28T12:01:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.486+0000 7f538f18a700 1 -- start start 2019-11-28T12:01:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.487+0000 7f538f18a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538806c0a0 0x7f5388072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.487+0000 7f538f18a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5388072620 0x7f5388164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.487+0000 7f538f18a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538806db00 con 0x7f53880734e0 2019-11-28T12:01:29.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.487+0000 7f538f18a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538806f330 con 0x7f5388072620 2019-11-28T12:01:29.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.487+0000 7f538f18a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53880706c0 con 0x7f538806c0a0 2019-11-28T12:01:29.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.487+0000 7f538df28700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5388072620 0x7f5388164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:29.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.487+0000 7f538df28700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5388072620 0x7f5388164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47434/0 (socket says 172.21.15.80:47434) 2019-11-28T12:01:29.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.487+0000 7f538df28700 1 -- 172.21.15.80:0/387766040 learned_addr learned my addr 172.21.15.80:0/387766040 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:29.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.487+0000 7f538cf26700 1 --1- 172.21.15.80:0/387766040 >> v1:172.21.15.80:6789/0 conn(0x7f53880734e0 0x7f5388071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46752/0 (socket says 172.21.15.80:46752) 2019-11-28T12:01:29.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.487+0000 7f538d727700 1 --2- 172.21.15.80:0/387766040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538806c0a0 0x7f5388072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:29.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.487+0000 7f538df28700 1 -- 172.21.15.80:0/387766040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538806c0a0 msgr2=0x7f5388072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:29.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.487+0000 7f538df28700 1 --2- 172.21.15.80:0/387766040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538806c0a0 0x7f5388072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:29.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.487+0000 7f538df28700 1 -- 172.21.15.80:0/387766040 >> v1:172.21.15.80:6789/0 conn(0x7f53880734e0 legacy=0x7f5388071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:29.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.487+0000 7f5387fff700 1 -- 172.21.15.80:0/387766040 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769091160 0 0) 0x7f53780013f0 con 0x7f53880734e0 2019-11-28T12:01:29.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.487+0000 7f538df28700 1 -- 172.21.15.80:0/387766040 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5388070a40 con 0x7f5388072620 2019-11-28T12:01:29.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.487+0000 7f538df28700 1 --2- 172.21.15.80:0/387766040 >> v2:172.21.15.80:3300/0 conn(0x7f5388072620 0x7f5388164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f538000f6b0 tx=0x7f538000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:29.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.488+0000 7f538df28700 1 --2- 172.21.15.80:0/387766040 >> v2:172.21.15.80:3300/0 conn(0x7f5388072620 0x7f5388164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f538000f6b0 tx=0x7f538000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:29.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.488+0000 7f538df28700 1 --2- 172.21.15.80:0/387766040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388072620 0x7f5388164d70 secure :-1 s=READY pgs=2953 cs=0 l=1 rx=0x7f538000f6b0 tx=0x7f538000fa50).ready entity=mon.0 client_cookie=21895a8f7b0c41ae server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:29.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.488+0000 7f538df28700 1 --2- 172.21.15.80:0/387766040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388072620 0x7f5388164d70 secure :-1 s=THROTTLE_DONE pgs=2953 cs=0 l=1 rx=0x7f538000f6b0 tx=0x7f538000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:29.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.488+0000 7f5387fff700 1 -- 172.21.15.80:0/387766040 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5380000a70 con 0x7f5388072620 2019-11-28T12:01:29.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.488+0000 7f538df28700 1 --2- 172.21.15.80:0/387766040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388072620 0x7f5388164d70 secure :-1 s=THROTTLE_DONE pgs=2953 cs=0 l=1 rx=0x7f538000f6b0 tx=0x7f538000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:29.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.488+0000 7f538df28700 1 --2- 172.21.15.80:0/387766040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388072620 0x7f5388164d70 secure :-1 s=THROTTLE_DONE pgs=2953 cs=0 l=1 rx=0x7f538000f6b0 tx=0x7f538000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:29.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.488+0000 7f5387fff700 1 -- 172.21.15.80:0/387766040 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53800010e0 con 0x7f5388072620 2019-11-28T12:01:29.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.488+0000 7f5387fff700 1 -- 172.21.15.80:0/387766040 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53800017d0 con 0x7f5388072620 2019-11-28T12:01:29.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.488+0000 7f538f18a700 1 -- 172.21.15.80:0/387766040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388072620 msgr2=0x7f5388164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:29.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.488+0000 7f538f18a700 1 --2- 172.21.15.80:0/387766040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388072620 0x7f5388164d70 secure :-1 s=READY pgs=2953 cs=0 l=1 rx=0x7f538000f6b0 tx=0x7f538000fa50).stop 2019-11-28T12:01:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.488+0000 7f538f18a700 1 -- 172.21.15.80:0/387766040 shutdown_connections 2019-11-28T12:01:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.488+0000 7f538f18a700 1 --2- 172.21.15.80:0/387766040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388072620 0x7f5388164d70 unknown :-1 s=CLOSED pgs=2953 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.488+0000 7f538f18a700 1 --2- 172.21.15.80:0/387766040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538806c0a0 0x7f5388072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.489+0000 7f538f18a700 1 -- 172.21.15.80:0/387766040 shutdown_connections 2019-11-28T12:01:29.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.489+0000 7f538f18a700 1 -- 172.21.15.80:0/387766040 wait complete. 2019-11-28T12:01:29.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.489+0000 7f538f18a700 1 -- 172.21.15.80:0/387766040 >> 172.21.15.80:0/387766040 conn(0x7f5388061cf0 msgr2=0x7f5388064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:29.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.491+0000 7f538f18a700 1 Processor -- start 2019-11-28T12:01:29.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.491+0000 7f538f18a700 1 -- start start 2019-11-28T12:01:29.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538f18a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5388104820 0x7f538810c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:29.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538f18a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538810c890 0x7f538810b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:29.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538f18a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f538810b710 0x7f538810bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:29.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538f18a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5388109130 con 0x7f5388104820 2019-11-28T12:01:29.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538f18a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5388109400 con 0x7f538810b710 2019-11-28T12:01:29.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538f18a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5388108700 con 0x7f538810c890 2019-11-28T12:01:29.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538d727700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5388104820 0x7f538810c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:29.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538d727700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5388104820 0x7f538810c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47442/0 (socket says 172.21.15.80:47442) 2019-11-28T12:01:29.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538d727700 1 -- 172.21.15.80:0/73957024 learned_addr learned my addr 172.21.15.80:0/73957024 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:29.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538cf26700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538810c890 0x7f538810b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:29.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538df28700 1 --2- 172.21.15.80:0/73957024 >> v2:172.21.15.174:3300/0 conn(0x7f538810b710 0x7f538810bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:29.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538d727700 1 -- 172.21.15.80:0/73957024 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538810c890 msgr2=0x7f538810b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:29.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538d727700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538810c890 0x7f538810b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:29.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538d727700 1 -- 172.21.15.80:0/73957024 >> v2:172.21.15.174:3300/0 conn(0x7f538810b710 msgr2=0x7f538810bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:29.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538d727700 1 --2- 172.21.15.80:0/73957024 >> v2:172.21.15.174:3300/0 conn(0x7f538810b710 0x7f538810bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:29.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538d727700 1 -- 172.21.15.80:0/73957024 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5388109a90 con 0x7f5388104820 2019-11-28T12:01:29.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538d727700 1 --2- 172.21.15.80:0/73957024 >> v2:172.21.15.80:3300/0 conn(0x7f5388104820 0x7f538810c350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5370010450 tx=0x7f5370010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:29.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.492+0000 7f538d727700 1 --2- 172.21.15.80:0/73957024 >> v2:172.21.15.80:3300/0 conn(0x7f5388104820 0x7f538810c350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5370010450 tx=0x7f5370010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:29.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.493+0000 7f538d727700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388104820 0x7f538810c350 secure :-1 s=READY pgs=2954 cs=0 l=1 rx=0x7f5370010450 tx=0x7f5370010300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:29.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.493+0000 7f538d727700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388104820 0x7f538810c350 secure :-1 s=THROTTLE_DONE pgs=2954 cs=0 l=1 rx=0x7f5370010450 tx=0x7f5370010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:29.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.493+0000 7f538d727700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388104820 0x7f538810c350 secure :-1 s=THROTTLE_DONE pgs=2954 cs=0 l=1 rx=0x7f5370010450 tx=0x7f5370010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:29.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.493+0000 7f538d727700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388104820 0x7f538810c350 secure :-1 s=THROTTLE_DONE pgs=2954 cs=0 l=1 rx=0x7f5370010450 tx=0x7f5370010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:29.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.493+0000 7f5385ffb700 1 -- 172.21.15.80:0/73957024 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5370000940 con 0x7f5388104820 2019-11-28T12:01:29.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.493+0000 7f5385ffb700 1 -- 172.21.15.80:0/73957024 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5370005370 con 0x7f5388104820 2019-11-28T12:01:29.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.493+0000 7f5385ffb700 1 -- 172.21.15.80:0/73957024 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5370005a00 con 0x7f5388104820 2019-11-28T12:01:29.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.493+0000 7f538f18a700 1 -- 172.21.15.80:0/73957024 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5388109e10 con 0x7f5388104820 2019-11-28T12:01:29.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.493+0000 7f538f18a700 1 -- 172.21.15.80:0/73957024 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5388109a90 con 0x7f5388104820 2019-11-28T12:01:29.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.493+0000 7f538d727700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388104820 0x7f538810c350 secure :-1 s=THROTTLE_DONE pgs=2954 cs=0 l=1 rx=0x7f5370010450 tx=0x7f5370010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:29.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.493+0000 7f5385ffb700 1 -- 172.21.15.80:0/73957024 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5370005560 con 0x7f5388104820 2019-11-28T12:01:29.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.493+0000 7f538d727700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388104820 0x7f538810c350 secure :-1 s=THROTTLE_DONE pgs=2954 cs=0 l=1 rx=0x7f5370010450 tx=0x7f5370010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:29.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.493+0000 7f5385ffb700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f536c018730 0x7f536c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:29.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.493+0000 7f5385ffb700 1 -- 172.21.15.80:0/73957024 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(224..224 src has 1..224) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f5370031ad0 con 0x7f5388104820 2019-11-28T12:01:29.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.494+0000 7f538cf26700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f536c018730 0x7f536c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:29.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.494+0000 7f538cf26700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f536c018730 0x7f536c01abc0 crc :-1 s=READY pgs=1222 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:29.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.501+0000 7f538f18a700 1 -- 172.21.15.80:0/73957024 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5388109e10 con 0x7f5388104820 2019-11-28T12:01:29.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.504+0000 7f538d727700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388104820 0x7f538810c350 secure :-1 s=THROTTLE_DONE pgs=2954 cs=0 l=1 rx=0x7f5370010450 tx=0x7f5370010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:29.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.504+0000 7f5385ffb700 1 -- 172.21.15.80:0/73957024 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f53700064f0 con 0x7f5388104820 2019-11-28T12:01:29.673 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:29.679+0000 7f538f18a700 1 -- 172.21.15.80:0/73957024 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_trim_caps"]} v 0) v1 -- 0x7f5388109a90 con 0x7f5388104820 2019-11-28T12:01:30.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:30.615+0000 7f538d727700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388104820 0x7f538810c350 secure :-1 s=THROTTLE_DONE pgs=2954 cs=0 l=1 rx=0x7f5370010450 tx=0x7f5370010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:30.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:30.615+0000 7f5385ffb700 1 -- 172.21.15.80:0/73957024 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_trim_caps"]}]=0 v838) v1 ==== 149+0+0 (secure 0 0 0) 0x7f5370005870 con 0x7f5388104820 2019-11-28T12:01:30.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:30.647+0000 7f538f18a700 1 -- 172.21.15.80:0/73957024 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f536c018730 msgr2=0x7f536c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:30.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:30.647+0000 7f538f18a700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f536c018730 0x7f536c01abc0 crc :-1 s=READY pgs=1222 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:30.642 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:30.647+0000 7f538f18a700 1 -- 172.21.15.80:0/73957024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388104820 msgr2=0x7f538810c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:30.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:30.647+0000 7f538f18a700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388104820 0x7f538810c350 secure :-1 s=READY pgs=2954 cs=0 l=1 rx=0x7f5370010450 tx=0x7f5370010300).stop 2019-11-28T12:01:30.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:30.647+0000 7f538f18a700 1 -- 172.21.15.80:0/73957024 shutdown_connections 2019-11-28T12:01:30.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:30.648+0000 7f538f18a700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f536c018730 0x7f536c01abc0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:30.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:30.648+0000 7f538f18a700 1 --2- 172.21.15.80:0/73957024 >> v2:172.21.15.174:3300/0 conn(0x7f538810b710 0x7f538810bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:30.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:30.648+0000 7f538f18a700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f538810c890 0x7f538810b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:30.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:30.648+0000 7f538f18a700 1 --2- 172.21.15.80:0/73957024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5388104820 0x7f538810c350 unknown :-1 s=CLOSED pgs=2954 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:30.643 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:30.648+0000 7f538f18a700 1 -- 172.21.15.80:0/73957024 shutdown_connections 2019-11-28T12:01:30.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:30.648+0000 7f538f18a700 1 -- 172.21.15.80:0/73957024 wait complete. 2019-11-28T12:01:30.644 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:30.648+0000 7f538f18a700 1 -- 172.21.15.80:0/73957024 >> 172.21.15.80:0/73957024 conn(0x7f538813d620 msgr2=0x7f538813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:30.652 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T12:01:30.653 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:01:30.721 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:01:30.788 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:01:30.849 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:01:30.911 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:01:30.971 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:01:31.036 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T12:01:31.038 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T12:01:31.038 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T12:01:31.038 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T12:01:31.038 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T12:01:31.039 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T12:01:31.039 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T12:01:31.044 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T12:01:31.044 DEBUG:teuthology.parallel:result is None 2019-11-28T12:01:31.046 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T12:01:31.046 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T12:01:31.047 DEBUG:teuthology.parallel:result is None 2019-11-28T12:01:31.047 DEBUG:teuthology.parallel:result is None 2019-11-28T12:01:31.047 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T12:01:31.054 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T12:01:31.055 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T12:01:31.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.240+0000 7f90100c0700 1 Processor -- start 2019-11-28T12:01:31.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.240+0000 7f90100c0700 1 -- start start 2019-11-28T12:01:31.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.241+0000 7f90100c0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f900806c0a0 0x7f9008072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:31.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7f90100c0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f90080734e0 0x7f9008071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:31.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7f90100c0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900806db00 con 0x7f9008072360 2019-11-28T12:01:31.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7f90100c0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f900806fd60 con 0x7f900806c0a0 2019-11-28T12:01:31.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7f90100c0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9008070030 con 0x7f90080734e0 2019-11-28T12:01:31.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7f900ee5e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9008072360 0x7f900806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46770/0 (socket says 172.21.15.80:46770) 2019-11-28T12:01:31.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7f900ee5e700 1 -- 172.21.15.80:0/4248858929 learned_addr learned my addr 172.21.15.80:0/4248858929 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:31.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7f900e65d700 1 --2- 172.21.15.80:0/4248858929 >> v2:172.21.15.80:3300/0 conn(0x7f900806c0a0 0x7f9008072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7f900de5c700 1 --2- 172.21.15.80:0/4248858929 >> v2:172.21.15.174:3300/0 conn(0x7f90080734e0 0x7f9008071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7f900e65d700 1 -- 172.21.15.80:0/4248858929 >> v2:172.21.15.174:3300/0 conn(0x7f90080734e0 msgr2=0x7f9008071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:31.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7f900e65d700 1 --2- 172.21.15.80:0/4248858929 >> v2:172.21.15.174:3300/0 conn(0x7f90080734e0 0x7f9008071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:31.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7f900e65d700 1 -- 172.21.15.80:0/4248858929 >> v1:172.21.15.80:6789/0 conn(0x7f9008072360 legacy=0x7f900806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7f900e65d700 1 -- 172.21.15.80:0/4248858929 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90080706c0 con 0x7f900806c0a0 2019-11-28T12:01:31.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7f900d65b700 1 -- 172.21.15.80:0/4248858929 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106271679 0 0) 0x7f90000014f0 con 0x7f9008072360 2019-11-28T12:01:31.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7f900e65d700 1 --2- 172.21.15.80:0/4248858929 >> v2:172.21.15.80:3300/0 conn(0x7f900806c0a0 0x7f9008072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8ff800af50 tx=0x7f8ff800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7f900e65d700 1 --2- 172.21.15.80:0/4248858929 >> v2:172.21.15.80:3300/0 conn(0x7f900806c0a0 0x7f9008072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8ff800af50 tx=0x7f8ff800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7f900e65d700 1 --2- 172.21.15.80:0/4248858929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f900806c0a0 0x7f9008072fa0 secure :-1 s=READY pgs=2958 cs=0 l=1 rx=0x7f8ff800af50 tx=0x7f8ff800b6e0).ready entity=mon.0 client_cookie=eaf8cf593e0b02e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:31.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7f900e65d700 1 --2- 172.21.15.80:0/4248858929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f900806c0a0 0x7f9008072fa0 secure :-1 s=THROTTLE_DONE pgs=2958 cs=0 l=1 rx=0x7f8ff800af50 tx=0x7f8ff800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7f900d65b700 1 -- 172.21.15.80:0/4248858929 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ff8007210 con 0x7f900806c0a0 2019-11-28T12:01:31.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7f900e65d700 1 --2- 172.21.15.80:0/4248858929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f900806c0a0 0x7f9008072fa0 secure :-1 s=THROTTLE_DONE pgs=2958 cs=0 l=1 rx=0x7f8ff800af50 tx=0x7f8ff800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7f900e65d700 1 --2- 172.21.15.80:0/4248858929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f900806c0a0 0x7f9008072fa0 secure :-1 s=THROTTLE_DONE pgs=2958 cs=0 l=1 rx=0x7f8ff800af50 tx=0x7f8ff800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7f900d65b700 1 -- 172.21.15.80:0/4248858929 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff80099b0 con 0x7f900806c0a0 2019-11-28T12:01:31.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7f900d65b700 1 -- 172.21.15.80:0/4248858929 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ff800a080 con 0x7f900806c0a0 2019-11-28T12:01:31.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7f90100c0700 1 -- 172.21.15.80:0/4248858929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f900806c0a0 msgr2=0x7f9008072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7f90100c0700 1 --2- 172.21.15.80:0/4248858929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f900806c0a0 0x7f9008072fa0 secure :-1 s=READY pgs=2958 cs=0 l=1 rx=0x7f8ff800af50 tx=0x7f8ff800b6e0).stop 2019-11-28T12:01:31.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.244+0000 7f90100c0700 1 -- 172.21.15.80:0/4248858929 shutdown_connections 2019-11-28T12:01:31.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.244+0000 7f90100c0700 1 --2- 172.21.15.80:0/4248858929 >> v2:172.21.15.174:3300/0 conn(0x7f90080734e0 0x7f9008071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:31.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.244+0000 7f90100c0700 1 --2- 172.21.15.80:0/4248858929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f900806c0a0 0x7f9008072fa0 unknown :-1 s=CLOSED pgs=2958 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.244+0000 7f90100c0700 1 -- 172.21.15.80:0/4248858929 shutdown_connections 2019-11-28T12:01:31.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.244+0000 7f90100c0700 1 -- 172.21.15.80:0/4248858929 wait complete. 2019-11-28T12:01:31.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.244+0000 7f90100c0700 1 -- 172.21.15.80:0/4248858929 >> 172.21.15.80:0/4248858929 conn(0x7f9008061cf0 msgr2=0x7f9008064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:31.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.246+0000 7f90100c0700 1 Processor -- start 2019-11-28T12:01:31.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.246+0000 7f90100c0700 1 -- start start 2019-11-28T12:01:31.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7f90100c0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f900813e5f0 0x7f900813e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:31.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7f90100c0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f900810a070 0x7f900810bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:31.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7f90100c0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90081066e0 con 0x7f900810a4e0 2019-11-28T12:01:31.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7f90100c0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f900810e060 con 0x7f900813e5f0 2019-11-28T12:01:31.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7f90100c0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900810e330 con 0x7f900810a070 2019-11-28T12:01:31.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7f900de5c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f900810a070 0x7f900810bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7f900e65d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f900813e5f0 0x7f900813e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7f900ee5e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f900810a4e0 0x7f900810c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46784/0 (socket says 172.21.15.80:46784) 2019-11-28T12:01:31.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7f900ee5e700 1 -- 172.21.15.80:0/3492429254 learned_addr learned my addr 172.21.15.80:0/3492429254 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:31.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f8ffeffd700 1 -- 172.21.15.80:0/3492429254 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398315152 0 0) 0x7f90000014f0 con 0x7f900810a4e0 2019-11-28T12:01:31.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f900e65d700 1 -- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f900810a070 msgr2=0x7f900810bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f900e65d700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f900810a070 0x7f900810bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f900e65d700 1 -- 172.21.15.80:0/3492429254 >> v1:172.21.15.80:6789/0 conn(0x7f900810a4e0 legacy=0x7f900810c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f900e65d700 1 -- 172.21.15.80:0/3492429254 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900810e9c0 con 0x7f900813e5f0 2019-11-28T12:01:31.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f900de5c700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f900810a070 0x7f900810bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:31.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f900e65d700 1 --2- 172.21.15.80:0/3492429254 >> v2:172.21.15.174:3300/0 conn(0x7f900813e5f0 0x7f900813e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ff8010390 tx=0x7f8ff8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.256 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f900e65d700 1 --2- 172.21.15.80:0/3492429254 >> v2:172.21.15.174:3300/0 conn(0x7f900813e5f0 0x7f900813e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ff8010390 tx=0x7f8ff8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f900e65d700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900813e5f0 0x7f900813e9e0 secure :-1 s=READY pgs=1788 cs=0 l=1 rx=0x7f8ff8010390 tx=0x7f8ff8010730).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:31.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f900e65d700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900813e5f0 0x7f900813e9e0 secure :-1 s=THROTTLE_DONE pgs=1788 cs=0 l=1 rx=0x7f8ff8010390 tx=0x7f8ff8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f8ffeffd700 1 -- 172.21.15.80:0/3492429254 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ff8000940 con 0x7f900813e5f0 2019-11-28T12:01:31.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f900e65d700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900813e5f0 0x7f900813e9e0 secure :-1 s=THROTTLE_DONE pgs=1788 cs=0 l=1 rx=0x7f8ff8010390 tx=0x7f8ff8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f900e65d700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900813e5f0 0x7f900813e9e0 secure :-1 s=THROTTLE_DONE pgs=1788 cs=0 l=1 rx=0x7f8ff8010390 tx=0x7f8ff8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f8ffeffd700 1 -- 172.21.15.80:0/3492429254 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff8009770 con 0x7f900813e5f0 2019-11-28T12:01:31.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f90100c0700 1 -- 172.21.15.80:0/3492429254 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900810ed40 con 0x7f900813e5f0 2019-11-28T12:01:31.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f8ffeffd700 1 -- 172.21.15.80:0/3492429254 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ff8009e40 con 0x7f900813e5f0 2019-11-28T12:01:31.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7f90100c0700 1 -- 172.21.15.80:0/3492429254 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900810e9c0 con 0x7f900813e5f0 2019-11-28T12:01:31.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7f900e65d700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900813e5f0 0x7f900813e9e0 secure :-1 s=THROTTLE_DONE pgs=1788 cs=0 l=1 rx=0x7f8ff8010390 tx=0x7f8ff8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7f8ffeffd700 1 -- 172.21.15.80:0/3492429254 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8ff8009960 con 0x7f900813e5f0 2019-11-28T12:01:31.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7f900e65d700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900813e5f0 0x7f900813e9e0 secure :-1 s=THROTTLE_DONE pgs=1788 cs=0 l=1 rx=0x7f8ff8010390 tx=0x7f8ff8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7f8ffeffd700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8fe8018730 0x7f8fe801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:31.258 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7f8ffeffd700 1 -- 172.21.15.80:0/3492429254 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(224..224 src has 1..224) v4 ==== 6063+0+0 (secure 0 0 0) 0x7f8ff8031c70 con 0x7f900813e5f0 2019-11-28T12:01:31.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7f900de5c700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8fe8018730 0x7f8fe801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.250+0000 7f900de5c700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8fe8018730 0x7f8fe801abc0 crc :-1 s=READY pgs=1223 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:31.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.240+0000 7fcc8e1ad700 1 Processor -- start 2019-11-28T12:01:31.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.241+0000 7fcc8e1ad700 1 -- start start 2019-11-28T12:01:31.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.241+0000 7fcc8e1ad700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcc8806d120 0x7fcc88165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:31.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fcc8e1ad700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8806d5a0 con 0x7fcc8806c0a0 2019-11-28T12:01:31.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fcc8e1ad700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8806db00 con 0x7fcc8806c490 2019-11-28T12:01:31.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fcc8e1ad700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8806fd60 con 0x7fcc8806d120 2019-11-28T12:01:31.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fcc87fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcc8806c0a0 0x7fcc88072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46762/0 (socket says 172.21.15.80:46762) 2019-11-28T12:01:31.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fcc87fff700 1 -- 172.21.15.80:0/871624381 learned_addr learned my addr 172.21.15.80:0/871624381 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:31.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/871624381 >> v2:172.21.15.174:3300/0 conn(0x7fcc8806d120 0x7fcc88165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fcc8cf4b700 1 -- 172.21.15.80:0/871624381 >> v1:172.21.15.174:6789/0 conn(0x7fcc8806c490 legacy=0x7fcc8806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fcc8cf4b700 1 -- 172.21.15.80:0/871624381 >> v1:172.21.15.80:6789/0 conn(0x7fcc8806c0a0 legacy=0x7fcc88072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fcc8cf4b700 1 -- 172.21.15.80:0/871624381 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc880706c0 con 0x7fcc8806d120 2019-11-28T12:01:31.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/871624381 >> v2:172.21.15.174:3300/0 conn(0x7fcc8806d120 0x7fcc88165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcc8000b300 tx=0x7fcc8000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/871624381 >> v2:172.21.15.174:3300/0 conn(0x7fcc8806d120 0x7fcc88165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcc8000b300 tx=0x7fcc8000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/871624381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8806d120 0x7fcc88165d80 secure :-1 s=READY pgs=1786 cs=0 l=1 rx=0x7fcc8000b300 tx=0x7fcc8000bb10).ready entity=mon.1 client_cookie=240f7e26da08d2ea server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:31.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/871624381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8806d120 0x7fcc88165d80 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7fcc8000b300 tx=0x7fcc8000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.261 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/871624381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8806d120 0x7fcc88165d80 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7fcc8000b300 tx=0x7fcc8000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fcc86ffd700 1 -- 172.21.15.80:0/871624381 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc800075c0 con 0x7fcc8806d120 2019-11-28T12:01:31.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/871624381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8806d120 0x7fcc88165d80 secure :-1 s=THROTTLE_DONE pgs=1786 cs=0 l=1 rx=0x7fcc8000b300 tx=0x7fcc8000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fcc86ffd700 1 -- 172.21.15.80:0/871624381 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc80000f30 con 0x7fcc8806d120 2019-11-28T12:01:31.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fcc86ffd700 1 -- 172.21.15.80:0/871624381 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc8000a1e0 con 0x7fcc8806d120 2019-11-28T12:01:31.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fcc8e1ad700 1 -- 172.21.15.80:0/871624381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8806d120 msgr2=0x7fcc88165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fcc8e1ad700 1 --2- 172.21.15.80:0/871624381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8806d120 0x7fcc88165d80 secure :-1 s=READY pgs=1786 cs=0 l=1 rx=0x7fcc8000b300 tx=0x7fcc8000bb10).stop 2019-11-28T12:01:31.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.244+0000 7fcc8e1ad700 1 -- 172.21.15.80:0/871624381 shutdown_connections 2019-11-28T12:01:31.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.244+0000 7fcc8e1ad700 1 --2- 172.21.15.80:0/871624381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8806d120 0x7fcc88165d80 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.244+0000 7fcc8e1ad700 1 -- 172.21.15.80:0/871624381 shutdown_connections 2019-11-28T12:01:31.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.244+0000 7fcc8e1ad700 1 -- 172.21.15.80:0/871624381 wait complete. 2019-11-28T12:01:31.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.244+0000 7fcc8e1ad700 1 -- 172.21.15.80:0/871624381 >> 172.21.15.80:0/871624381 conn(0x7fcc88061cf0 msgr2=0x7fcc88064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:31.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.246+0000 7fcc8e1ad700 1 Processor -- start 2019-11-28T12:01:31.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.246+0000 7fcc8e1ad700 1 -- start start 2019-11-28T12:01:31.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7fcc8e1ad700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc8815a890 0x7fcc8815ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7fcc8e1ad700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcc8812dca0 0x7fcc8812e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7fcc8e1ad700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc88125780 con 0x7fcc88142d00 2019-11-28T12:01:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7fcc8e1ad700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8813b3b0 con 0x7fcc8812dca0 2019-11-28T12:01:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7fcc8e1ad700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc88111b70 con 0x7fcc8815a890 2019-11-28T12:01:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fcc87fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fcc88142d00 0x7fcc8815b640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:34098/0 (socket says 172.21.15.80:34098) 2019-11-28T12:01:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fcc87fff700 1 -- 172.21.15.80:0/940820100 learned_addr learned my addr 172.21.15.80:0/940820100 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:31.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/940820100 >> v2:172.21.15.174:3300/0 conn(0x7fcc8812dca0 0x7fcc8812e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fcc877fe700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc8815a890 0x7fcc8815ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fcc8cf4b700 1 -- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc8815a890 msgr2=0x7fcc8815ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc8815a890 0x7fcc8815ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fcc8cf4b700 1 -- 172.21.15.80:0/940820100 >> v1:172.21.15.174:6789/0 conn(0x7fcc88142d00 legacy=0x7fcc8815b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fcc8cf4b700 1 -- 172.21.15.80:0/940820100 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc88158d10 con 0x7fcc8812dca0 2019-11-28T12:01:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/940820100 >> v2:172.21.15.174:3300/0 conn(0x7fcc8812dca0 0x7fcc8812e110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc80010730 tx=0x7fcc80010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.265 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/940820100 >> v2:172.21.15.174:3300/0 conn(0x7fcc8812dca0 0x7fcc8812e110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc80010730 tx=0x7fcc80010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8812dca0 0x7fcc8812e110 secure :-1 s=READY pgs=1789 cs=0 l=1 rx=0x7fcc80010730 tx=0x7fcc80010560).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8812dca0 0x7fcc8812e110 secure :-1 s=THROTTLE_DONE pgs=1789 cs=0 l=1 rx=0x7fcc80010730 tx=0x7fcc80010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8812dca0 0x7fcc8812e110 secure :-1 s=THROTTLE_DONE pgs=1789 cs=0 l=1 rx=0x7fcc80010730 tx=0x7fcc80010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8812dca0 0x7fcc8812e110 secure :-1 s=THROTTLE_DONE pgs=1789 cs=0 l=1 rx=0x7fcc80010730 tx=0x7fcc80010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fcc84ff9700 1 -- 172.21.15.80:0/940820100 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc8000b230 con 0x7fcc8812dca0 2019-11-28T12:01:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fcc84ff9700 1 -- 172.21.15.80:0/940820100 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc80009d30 con 0x7fcc8812dca0 2019-11-28T12:01:31.266 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fcc84ff9700 1 -- 172.21.15.80:0/940820100 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc8000a3c0 con 0x7fcc8812dca0 2019-11-28T12:01:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fcc8e1ad700 1 -- 172.21.15.80:0/940820100 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc88159090 con 0x7fcc8812dca0 2019-11-28T12:01:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.250+0000 7fcc8e1ad700 1 -- 172.21.15.80:0/940820100 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc88158d10 con 0x7fcc8812dca0 2019-11-28T12:01:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.250+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8812dca0 0x7fcc8812e110 secure :-1 s=THROTTLE_DONE pgs=1789 cs=0 l=1 rx=0x7fcc80010730 tx=0x7fcc80010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.250+0000 7fcc84ff9700 1 -- 172.21.15.80:0/940820100 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcc80009f20 con 0x7fcc8812dca0 2019-11-28T12:01:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.250+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8812dca0 0x7fcc8812e110 secure :-1 s=THROTTLE_DONE pgs=1789 cs=0 l=1 rx=0x7fcc80010730 tx=0x7fcc80010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.250+0000 7fcc84ff9700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcc68018730 0x7fcc6801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:31.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.250+0000 7fcc84ff9700 1 -- 172.21.15.80:0/940820100 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(224..224 src has 1..224) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fcc80031fc0 con 0x7fcc8812dca0 2019-11-28T12:01:31.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.251+0000 7fcc87fff700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcc68018730 0x7fcc6801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.251+0000 7fcc87fff700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcc68018730 0x7fcc6801abc0 crc :-1 s=READY pgs=1225 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:31.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.240+0000 7fbdeeb2b700 1 Processor -- start 2019-11-28T12:01:31.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.241+0000 7fbdeeb2b700 1 -- start start 2019-11-28T12:01:31.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fbdeeb2b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbde806d120 0x7fbde8165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:31.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fbdeeb2b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde806d5a0 con 0x7fbde806c490 2019-11-28T12:01:31.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fbdeeb2b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde805daa0 con 0x7fbde806c0a0 2019-11-28T12:01:31.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fbdeeb2b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde806fd60 con 0x7fbde806d120 2019-11-28T12:01:31.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fbdec8c7700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbde806c490 0x7fbde806c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46776/0 (socket says 172.21.15.80:46776) 2019-11-28T12:01:31.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fbdec8c7700 1 -- 172.21.15.80:0/1671038893 learned_addr learned my addr 172.21.15.80:0/1671038893 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:31.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fbded8c9700 1 --2- 172.21.15.80:0/1671038893 >> v2:172.21.15.80:3300/0 conn(0x7fbde806d120 0x7fbde8165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fbddffff700 1 -- 172.21.15.80:0/1671038893 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105254387 0 0) 0x7fbde4000e20 con 0x7fbde806c0a0 2019-11-28T12:01:31.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fbddffff700 1 -- 172.21.15.80:0/1671038893 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdd4002e80 con 0x7fbde806c0a0 2019-11-28T12:01:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fbddffff700 1 -- 172.21.15.80:0/1671038893 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578876501 0 0) 0x7fbdd8001150 con 0x7fbde806c490 2019-11-28T12:01:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fbddffff700 1 -- 172.21.15.80:0/1671038893 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdd4004170 con 0x7fbde806c490 2019-11-28T12:01:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fbded8c9700 1 -- 172.21.15.80:0/1671038893 >> v1:172.21.15.174:6789/0 conn(0x7fbde806c0a0 legacy=0x7fbde8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fbded8c9700 1 -- 172.21.15.80:0/1671038893 >> v1:172.21.15.80:6789/0 conn(0x7fbde806c490 legacy=0x7fbde806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fbded8c9700 1 -- 172.21.15.80:0/1671038893 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde80706c0 con 0x7fbde806d120 2019-11-28T12:01:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.242+0000 7fbded8c9700 1 --2- 172.21.15.80:0/1671038893 >> v2:172.21.15.80:3300/0 conn(0x7fbde806d120 0x7fbde8165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbde000b2d0 tx=0x7fbde000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.270 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fbded8c9700 1 --2- 172.21.15.80:0/1671038893 >> v2:172.21.15.80:3300/0 conn(0x7fbde806d120 0x7fbde8165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbde000b2d0 tx=0x7fbde000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fbded8c9700 1 --2- 172.21.15.80:0/1671038893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde806d120 0x7fbde8165d80 secure :-1 s=READY pgs=2959 cs=0 l=1 rx=0x7fbde000b2d0 tx=0x7fbde000bae0).ready entity=mon.0 client_cookie=5d1a186fc40dc679 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:31.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fbded8c9700 1 --2- 172.21.15.80:0/1671038893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde806d120 0x7fbde8165d80 secure :-1 s=THROTTLE_DONE pgs=2959 cs=0 l=1 rx=0x7fbde000b2d0 tx=0x7fbde000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fbddffff700 1 -- 172.21.15.80:0/1671038893 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbde0009f20 con 0x7fbde806d120 2019-11-28T12:01:31.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fbded8c9700 1 --2- 172.21.15.80:0/1671038893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde806d120 0x7fbde8165d80 secure :-1 s=THROTTLE_DONE pgs=2959 cs=0 l=1 rx=0x7fbde000b2d0 tx=0x7fbde000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fbddffff700 1 -- 172.21.15.80:0/1671038893 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde0000df0 con 0x7fbde806d120 2019-11-28T12:01:31.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fbded8c9700 1 --2- 172.21.15.80:0/1671038893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde806d120 0x7fbde8165d80 secure :-1 s=THROTTLE_DONE pgs=2959 cs=0 l=1 rx=0x7fbde000b2d0 tx=0x7fbde000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.271 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fbddffff700 1 -- 172.21.15.80:0/1671038893 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbde0009f20 con 0x7fbde806d120 2019-11-28T12:01:31.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fbdeeb2b700 1 -- 172.21.15.80:0/1671038893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde806d120 msgr2=0x7fbde8165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.243+0000 7fbdeeb2b700 1 --2- 172.21.15.80:0/1671038893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde806d120 0x7fbde8165d80 secure :-1 s=READY pgs=2959 cs=0 l=1 rx=0x7fbde000b2d0 tx=0x7fbde000bae0).stop 2019-11-28T12:01:31.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.244+0000 7fbdeeb2b700 1 -- 172.21.15.80:0/1671038893 shutdown_connections 2019-11-28T12:01:31.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.244+0000 7fbdeeb2b700 1 --2- 172.21.15.80:0/1671038893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde806d120 0x7fbde8165d80 unknown :-1 s=CLOSED pgs=2959 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.244+0000 7fbdeeb2b700 1 -- 172.21.15.80:0/1671038893 shutdown_connections 2019-11-28T12:01:31.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.244+0000 7fbdeeb2b700 1 -- 172.21.15.80:0/1671038893 wait complete. 2019-11-28T12:01:31.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.244+0000 7fbdeeb2b700 1 -- 172.21.15.80:0/1671038893 >> 172.21.15.80:0/1671038893 conn(0x7fbde8061cf0 msgr2=0x7fbde8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:31.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.246+0000 7fbdeeb2b700 1 Processor -- start 2019-11-28T12:01:31.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.246+0000 7fbdeeb2b700 1 -- start start 2019-11-28T12:01:31.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7fbdeeb2b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbde8112fb0 0x7fbde8113440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:31.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7fbdeeb2b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbde8113980 0x7fbde8168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:31.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7fbdeeb2b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde813fc20 con 0x7fbde813f580 2019-11-28T12:01:31.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7fbdeeb2b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde81236b0 con 0x7fbde8113980 2019-11-28T12:01:31.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.247+0000 7fbdeeb2b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde8123980 con 0x7fbde8112fb0 2019-11-28T12:01:31.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbded0c8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbde813f580 0x7fbde8114130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46792/0 (socket says 172.21.15.80:46792) 2019-11-28T12:01:31.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbded0c8700 1 -- 172.21.15.80:0/3461882637 learned_addr learned my addr 172.21.15.80:0/3461882637 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:31.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbdec8c7700 1 --2- 172.21.15.80:0/3461882637 >> v2:172.21.15.174:3300/0 conn(0x7fbde8112fb0 0x7fbde8113440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbded8c9700 1 --2- 172.21.15.80:0/3461882637 >> v2:172.21.15.80:3300/0 conn(0x7fbde8113980 0x7fbde8168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbdddffb700 1 -- 172.21.15.80:0/3461882637 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552176955 0 0) 0x7fbde40011b0 con 0x7fbde813f580 2019-11-28T12:01:31.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbdddffb700 1 -- 172.21.15.80:0/3461882637 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdc8002e80 con 0x7fbde813f580 2019-11-28T12:01:31.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbdddffb700 1 -- 172.21.15.80:0/3461882637 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2525479805 0 0) 0x7fbde4001340 con 0x7fbde813f580 2019-11-28T12:01:31.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbded8c9700 1 -- 172.21.15.80:0/3461882637 >> v2:172.21.15.174:3300/0 conn(0x7fbde8112fb0 msgr2=0x7fbde8113440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbded8c9700 1 --2- 172.21.15.80:0/3461882637 >> v2:172.21.15.174:3300/0 conn(0x7fbde8112fb0 0x7fbde8113440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbded8c9700 1 -- 172.21.15.80:0/3461882637 >> v1:172.21.15.80:6789/0 conn(0x7fbde813f580 legacy=0x7fbde8114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbded8c9700 1 -- 172.21.15.80:0/3461882637 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde8124010 con 0x7fbde8113980 2019-11-28T12:01:31.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbded8c9700 1 --2- 172.21.15.80:0/3461882637 >> v2:172.21.15.80:3300/0 conn(0x7fbde8113980 0x7fbde8168a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbde0010700 tx=0x7fbde0010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.275 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbded8c9700 1 --2- 172.21.15.80:0/3461882637 >> v2:172.21.15.80:3300/0 conn(0x7fbde8113980 0x7fbde8168a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbde0010700 tx=0x7fbde0010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbded8c9700 1 --2- 172.21.15.80:0/3461882637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8113980 0x7fbde8168a20 secure :-1 s=READY pgs=2962 cs=0 l=1 rx=0x7fbde0010700 tx=0x7fbde0010580).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:31.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbded8c9700 1 --2- 172.21.15.80:0/3461882637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8113980 0x7fbde8168a20 secure :-1 s=THROTTLE_DONE pgs=2962 cs=0 l=1 rx=0x7fbde0010700 tx=0x7fbde0010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbdddffb700 1 -- 172.21.15.80:0/3461882637 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbde000b240 con 0x7fbde8113980 2019-11-28T12:01:31.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbded8c9700 1 --2- 172.21.15.80:0/3461882637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8113980 0x7fbde8168a20 secure :-1 s=THROTTLE_DONE pgs=2962 cs=0 l=1 rx=0x7fbde0010700 tx=0x7fbde0010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbded8c9700 1 --2- 172.21.15.80:0/3461882637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8113980 0x7fbde8168a20 secure :-1 s=THROTTLE_DONE pgs=2962 cs=0 l=1 rx=0x7fbde0010700 tx=0x7fbde0010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.248+0000 7fbdddffb700 1 -- 172.21.15.80:0/3461882637 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde0009af0 con 0x7fbde8113980 2019-11-28T12:01:31.276 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fbdeeb2b700 1 -- 172.21.15.80:0/3461882637 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde8124010 con 0x7fbde8113980 2019-11-28T12:01:31.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fbdddffb700 1 -- 172.21.15.80:0/3461882637 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbde000a140 con 0x7fbde8113980 2019-11-28T12:01:31.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fbdeeb2b700 1 -- 172.21.15.80:0/3461882637 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde8124010 con 0x7fbde8113980 2019-11-28T12:01:31.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fbded8c9700 1 --2- 172.21.15.80:0/3461882637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8113980 0x7fbde8168a20 secure :-1 s=THROTTLE_DONE pgs=2962 cs=0 l=1 rx=0x7fbde0010700 tx=0x7fbde0010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fbdddffb700 1 -- 172.21.15.80:0/3461882637 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbde000b030 con 0x7fbde8113980 2019-11-28T12:01:31.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fbded8c9700 1 --2- 172.21.15.80:0/3461882637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8113980 0x7fbde8168a20 secure :-1 s=THROTTLE_DONE pgs=2962 cs=0 l=1 rx=0x7fbde0010700 tx=0x7fbde0010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fbdddffb700 1 --2- 172.21.15.80:0/3461882637 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdc8018780 0x7fbdc801ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:31.277 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.249+0000 7fbdddffb700 1 -- 172.21.15.80:0/3461882637 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(224..224 src has 1..224) v4 ==== 6063+0+0 (secure 0 0 0) 0x7fbde0031ff0 con 0x7fbde8113980 2019-11-28T12:01:31.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.250+0000 7fbded0c8700 1 --2- 172.21.15.80:0/3461882637 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdc8018780 0x7fbdc801ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.250+0000 7fbded0c8700 1 --2- 172.21.15.80:0/3461882637 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdc8018780 0x7fbdc801ac10 crc :-1 s=READY pgs=1224 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:31.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.256+0000 7f90100c0700 1 -- 172.21.15.80:0/3492429254 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900810ed40 con 0x7f900813e5f0 2019-11-28T12:01:31.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.259+0000 7f900e65d700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900813e5f0 0x7f900813e9e0 secure :-1 s=THROTTLE_DONE pgs=1788 cs=0 l=1 rx=0x7f8ff8010390 tx=0x7f8ff8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.259+0000 7f8ffeffd700 1 -- 172.21.15.80:0/3492429254 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8ff800a860 con 0x7f900813e5f0 2019-11-28T12:01:31.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.256+0000 7fcc8e1ad700 1 -- 172.21.15.80:0/940820100 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc88159090 con 0x7fcc8812dca0 2019-11-28T12:01:31.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.263+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8812dca0 0x7fcc8812e110 secure :-1 s=THROTTLE_DONE pgs=1789 cs=0 l=1 rx=0x7fcc80010730 tx=0x7fcc80010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.263+0000 7fcc84ff9700 1 -- 172.21.15.80:0/940820100 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcc80009930 con 0x7fcc8812dca0 2019-11-28T12:01:31.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.256+0000 7fbdeeb2b700 1 -- 172.21.15.80:0/3461882637 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde8124010 con 0x7fbde8113980 2019-11-28T12:01:31.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.259+0000 7fbded8c9700 1 --2- 172.21.15.80:0/3461882637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8113980 0x7fbde8168a20 secure :-1 s=THROTTLE_DONE pgs=2962 cs=0 l=1 rx=0x7fbde0010700 tx=0x7fbde0010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.280 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.259+0000 7fbdddffb700 1 -- 172.21.15.80:0/3461882637 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbde000a610 con 0x7fbde8113980 2019-11-28T12:01:31.440 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.446+0000 7fcc8e1ad700 1 -- 172.21.15.80:0/940820100 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7fcc88158d10 con 0x7fcc8812dca0 2019-11-28T12:01:31.441 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.447+0000 7f90100c0700 1 -- 172.21.15.80:0/3492429254 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f900810e9c0 con 0x7f900813e5f0 2019-11-28T12:01:31.442 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.448+0000 7fbdeeb2b700 1 -- 172.21.15.80:0/3461882637 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7fbde8124010 con 0x7fbde8113980 2019-11-28T12:01:31.609 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T12:01:31.614+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T12:01:31.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.619+0000 7fbded8c9700 1 --2- 172.21.15.80:0/3461882637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8113980 0x7fbde8168a20 secure :-1 s=THROTTLE_DONE pgs=2962 cs=0 l=1 rx=0x7fbde0010700 tx=0x7fbde0010580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.619+0000 7fbdddffb700 1 -- 172.21.15.80:0/3461882637 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 8138 v187) v1 ==== 95+0+0 (secure 0 0 0) 0x7fbde000af30 con 0x7fbde8113980 2019-11-28T12:01:31.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.620+0000 7fcc8cf4b700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8812dca0 0x7fcc8812e110 secure :-1 s=THROTTLE_DONE pgs=1789 cs=0 l=1 rx=0x7fcc80010730 tx=0x7fcc80010560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.620+0000 7fcc84ff9700 1 -- 172.21.15.80:0/940820100 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 11665 v187) v1 ==== 96+0+0 (secure 0 0 0) 0x7fcc80009c30 con 0x7fcc8812dca0 2019-11-28T12:01:31.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.620+0000 7f900e65d700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900813e5f0 0x7f900813e9e0 secure :-1 s=THROTTLE_DONE pgs=1788 cs=0 l=1 rx=0x7f8ff8010390 tx=0x7f8ff8010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.620+0000 7f8ffeffd700 1 -- 172.21.15.80:0/3492429254 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 12435 v187) v1 ==== 96+0+0 (secure 0 0 0) 0x7f8ff8009770 con 0x7f900813e5f0 2019-11-28T12:01:31.654 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 11665 2019-11-28T12:01:31.720 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 12435 2019-11-28T12:01:31.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7f90100c0700 1 -- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8fe8018730 msgr2=0x7f8fe801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7f90100c0700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8fe8018730 0x7f8fe801abc0 crc :-1 s=READY pgs=1223 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7f90100c0700 1 -- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900813e5f0 msgr2=0x7f900813e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7f90100c0700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900813e5f0 0x7f900813e9e0 secure :-1 s=READY pgs=1788 cs=0 l=1 rx=0x7f8ff8010390 tx=0x7f8ff8010730).stop 2019-11-28T12:01:31.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7f90100c0700 1 -- 172.21.15.80:0/3492429254 shutdown_connections 2019-11-28T12:01:31.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7f90100c0700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8fe8018730 0x7f8fe801abc0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7f90100c0700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f900810a070 0x7f900810bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7f90100c0700 1 --2- 172.21.15.80:0/3492429254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900813e5f0 0x7f900813e9e0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7f90100c0700 1 -- 172.21.15.80:0/3492429254 shutdown_connections 2019-11-28T12:01:31.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7f90100c0700 1 -- 172.21.15.80:0/3492429254 wait complete. 2019-11-28T12:01:31.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7f90100c0700 1 -- 172.21.15.80:0/3492429254 >> 172.21.15.80:0/3492429254 conn(0x7f900813d620 msgr2=0x7f900813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:31.723 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 8138 2019-11-28T12:01:31.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7fbdeeb2b700 1 -- 172.21.15.80:0/3461882637 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdc8018780 msgr2=0x7fbdc801ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7fbdeeb2b700 1 --2- 172.21.15.80:0/3461882637 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdc8018780 0x7fbdc801ac10 crc :-1 s=READY pgs=1224 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7fbdeeb2b700 1 -- 172.21.15.80:0/3461882637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8113980 msgr2=0x7fbde8168a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7fbdeeb2b700 1 --2- 172.21.15.80:0/3461882637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8113980 0x7fbde8168a20 secure :-1 s=READY pgs=2962 cs=0 l=1 rx=0x7fbde0010700 tx=0x7fbde0010580).stop 2019-11-28T12:01:31.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7fbdeeb2b700 1 -- 172.21.15.80:0/3461882637 shutdown_connections 2019-11-28T12:01:31.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7fbdeeb2b700 1 --2- 172.21.15.80:0/3461882637 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbdc8018780 0x7fbdc801ac10 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7fbdeeb2b700 1 --2- 172.21.15.80:0/3461882637 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbde8113980 0x7fbde8168a20 unknown :-1 s=CLOSED pgs=2962 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7fbdeeb2b700 1 --2- 172.21.15.80:0/3461882637 >> v2:172.21.15.174:3300/0 conn(0x7fbde8112fb0 0x7fbde8113440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7fbdeeb2b700 1 -- 172.21.15.80:0/3461882637 shutdown_connections 2019-11-28T12:01:31.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7fbdeeb2b700 1 -- 172.21.15.80:0/3461882637 wait complete. 2019-11-28T12:01:31.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.664+0000 7fbdeeb2b700 1 -- 172.21.15.80:0/3461882637 >> 172.21.15.80:0/3461882637 conn(0x7fbde81426c0 msgr2=0x7fbde8110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:31.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.662+0000 7fcc8e1ad700 1 -- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcc68018730 msgr2=0x7fcc6801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.662+0000 7fcc8e1ad700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcc68018730 0x7fcc6801abc0 crc :-1 s=READY pgs=1225 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.662+0000 7fcc8e1ad700 1 -- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8812dca0 msgr2=0x7fcc8812e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.662+0000 7fcc8e1ad700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8812dca0 0x7fcc8812e110 secure :-1 s=READY pgs=1789 cs=0 l=1 rx=0x7fcc80010730 tx=0x7fcc80010560).stop 2019-11-28T12:01:31.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.662+0000 7fcc8e1ad700 1 -- 172.21.15.80:0/940820100 shutdown_connections 2019-11-28T12:01:31.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.662+0000 7fcc8e1ad700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc8812dca0 0x7fcc8812e110 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.662+0000 7fcc8e1ad700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc8815a890 0x7fcc8815ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.662+0000 7fcc8e1ad700 1 --2- 172.21.15.80:0/940820100 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcc68018730 0x7fcc6801abc0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.663+0000 7fcc8e1ad700 1 -- 172.21.15.80:0/940820100 shutdown_connections 2019-11-28T12:01:31.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.663+0000 7fcc8e1ad700 1 -- 172.21.15.80:0/940820100 wait complete. 2019-11-28T12:01:31.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.663+0000 7fcc8e1ad700 1 -- 172.21.15.80:0/940820100 >> 172.21.15.80:0/940820100 conn(0x7fcc8807c680 msgr2=0x7fcc88112150 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:31.727 DEBUG:teuthology.parallel:result is '' 2019-11-28T12:01:31.727 DEBUG:teuthology.parallel:result is '' 2019-11-28T12:01:31.727 DEBUG:teuthology.parallel:result is '' 2019-11-28T12:01:31.728 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T12:01:31.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.853+0000 7fb052ee0700 1 Processor -- start 2019-11-28T12:01:31.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.853+0000 7fb052ee0700 1 -- start start 2019-11-28T12:01:31.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.854+0000 7fb052ee0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c06d120 0x7fb04c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:31.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.854+0000 7fb052ee0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c06d580 con 0x7fb04c06c490 2019-11-28T12:01:31.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.854+0000 7fb052ee0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c06db00 con 0x7fb04c06c0a0 2019-11-28T12:01:31.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.854+0000 7fb052ee0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c06fd60 con 0x7fb04c06d120 2019-11-28T12:01:31.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.854+0000 7fb050c7c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb04c06c490 0x7fb04c06c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46806/0 (socket says 172.21.15.80:46806) 2019-11-28T12:01:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.854+0000 7fb050c7c700 1 -- 172.21.15.80:0/2038935056 learned_addr learned my addr 172.21.15.80:0/2038935056 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.854+0000 7fb051c7e700 1 --2- 172.21.15.80:0/2038935056 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c06d120 0x7fb04c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb04bfff700 1 -- 172.21.15.80:0/2038935056 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487592350 0 0) 0x7fb034001150 con 0x7fb04c06c490 2019-11-28T12:01:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb04bfff700 1 -- 172.21.15.80:0/2038935056 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb038002e80 con 0x7fb04c06c490 2019-11-28T12:01:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb04bfff700 1 -- 172.21.15.80:0/2038935056 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348212510 0 0) 0x7fb03c001080 con 0x7fb04c06c0a0 2019-11-28T12:01:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb04bfff700 1 -- 172.21.15.80:0/2038935056 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb038004170 con 0x7fb04c06c0a0 2019-11-28T12:01:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb051c7e700 1 -- 172.21.15.80:0/2038935056 >> v1:172.21.15.174:6789/0 conn(0x7fb04c06c0a0 legacy=0x7fb04c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb051c7e700 1 -- 172.21.15.80:0/2038935056 >> v1:172.21.15.80:6789/0 conn(0x7fb04c06c490 legacy=0x7fb04c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb04bfff700 1 -- 172.21.15.80:0/2038935056 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1134504336 0 0) 0x7fb034001130 con 0x7fb04c06c490 2019-11-28T12:01:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb051c7e700 1 -- 172.21.15.80:0/2038935056 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c0706c0 con 0x7fb04c06d120 2019-11-28T12:01:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb051c7e700 1 --2- 172.21.15.80:0/2038935056 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c06d120 0x7fb04c165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb04400b300 tx=0x7fb04400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb051c7e700 1 --2- 172.21.15.80:0/2038935056 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c06d120 0x7fb04c165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb04400b300 tx=0x7fb04400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb051c7e700 1 --2- 172.21.15.80:0/2038935056 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c06d120 0x7fb04c165d80 secure :-1 s=READY pgs=426 cs=0 l=1 rx=0x7fb04400b300 tx=0x7fb04400bb10).ready entity=mon.2 client_cookie=573b1f34f8108465 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:31.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb051c7e700 1 --2- 172.21.15.80:0/2038935056 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c06d120 0x7fb04c165d80 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7fb04400b300 tx=0x7fb04400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb04bfff700 1 -- 172.21.15.80:0/2038935056 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0440075c0 con 0x7fb04c06d120 2019-11-28T12:01:31.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb051c7e700 1 --2- 172.21.15.80:0/2038935056 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c06d120 0x7fb04c165d80 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7fb04400b300 tx=0x7fb04400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb051c7e700 1 --2- 172.21.15.80:0/2038935056 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c06d120 0x7fb04c165d80 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7fb04400b300 tx=0x7fb04400bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb04bfff700 1 -- 172.21.15.80:0/2038935056 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb044000f30 con 0x7fb04c06d120 2019-11-28T12:01:31.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb04bfff700 1 -- 172.21.15.80:0/2038935056 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0440075c0 con 0x7fb04c06d120 2019-11-28T12:01:31.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb052ee0700 1 -- 172.21.15.80:0/2038935056 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c06d120 msgr2=0x7fb04c165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.855+0000 7fb052ee0700 1 --2- 172.21.15.80:0/2038935056 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c06d120 0x7fb04c165d80 secure :-1 s=READY pgs=426 cs=0 l=1 rx=0x7fb04400b300 tx=0x7fb04400bb10).stop 2019-11-28T12:01:31.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.856+0000 7fb052ee0700 1 -- 172.21.15.80:0/2038935056 shutdown_connections 2019-11-28T12:01:31.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.856+0000 7fb052ee0700 1 --2- 172.21.15.80:0/2038935056 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c06d120 0x7fb04c165d80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.856+0000 7fb052ee0700 1 -- 172.21.15.80:0/2038935056 shutdown_connections 2019-11-28T12:01:31.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.856+0000 7fb052ee0700 1 -- 172.21.15.80:0/2038935056 wait complete. 2019-11-28T12:01:31.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.856+0000 7fb052ee0700 1 -- 172.21.15.80:0/2038935056 >> 172.21.15.80:0/2038935056 conn(0x7fb04c061cf0 msgr2=0x7fb04c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:31.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.858+0000 7fb052ee0700 1 Processor -- start 2019-11-28T12:01:31.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.859+0000 7fb052ee0700 1 -- start start 2019-11-28T12:01:31.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.859+0000 7fb052ee0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c12cea0 0x7fb04c111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:31.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.859+0000 7fb052ee0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb04c1230e0 0x7fb04c123570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:31.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.859+0000 7fb052ee0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c124260 con 0x7fb04c123ab0 2019-11-28T12:01:31.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.859+0000 7fb052ee0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04c120610 con 0x7fb04c1230e0 2019-11-28T12:01:31.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.859+0000 7fb052ee0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c121040 con 0x7fb04c12cea0 2019-11-28T12:01:31.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb051c7e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb04c123ab0 0x7fb04c12d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46814/0 (socket says 172.21.15.80:46814) 2019-11-28T12:01:31.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb051c7e700 1 -- 172.21.15.80:0/2888695376 learned_addr learned my addr 172.21.15.80:0/2888695376 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:31.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb05147d700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c12cea0 0x7fb04c111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb050c7c700 1 --2- 172.21.15.80:0/2888695376 >> v2:172.21.15.174:3300/0 conn(0x7fb04c1230e0 0x7fb04c123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb049ffb700 1 -- 172.21.15.80:0/2888695376 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866637022 0 0) 0x7fb044009930 con 0x7fb04c123ab0 2019-11-28T12:01:31.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb049ffb700 1 -- 172.21.15.80:0/2888695376 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb030002e80 con 0x7fb04c123ab0 2019-11-28T12:01:31.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb05147d700 1 -- 172.21.15.80:0/2888695376 >> v2:172.21.15.174:3300/0 conn(0x7fb04c1230e0 msgr2=0x7fb04c123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb05147d700 1 --2- 172.21.15.80:0/2888695376 >> v2:172.21.15.174:3300/0 conn(0x7fb04c1230e0 0x7fb04c123570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:31.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb05147d700 1 -- 172.21.15.80:0/2888695376 >> v1:172.21.15.80:6789/0 conn(0x7fb04c123ab0 legacy=0x7fb04c12d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:31.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb05147d700 1 -- 172.21.15.80:0/2888695376 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c1219a0 con 0x7fb04c12cea0 2019-11-28T12:01:31.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb050c7c700 1 --2- 172.21.15.80:0/2888695376 >> v2:172.21.15.174:3300/0 conn(0x7fb04c1230e0 0x7fb04c123570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:31.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb05147d700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c12cea0 0x7fb04c111db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb03c0103a0 tx=0x7fb03c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb05147d700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c12cea0 0x7fb04c111db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb03c0103a0 tx=0x7fb03c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb05147d700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c12cea0 0x7fb04c111db0 secure :-1 s=READY pgs=427 cs=0 l=1 rx=0x7fb03c0103a0 tx=0x7fb03c010740).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:31.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb05147d700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c12cea0 0x7fb04c111db0 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7fb03c0103a0 tx=0x7fb03c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb049ffb700 1 -- 172.21.15.80:0/2888695376 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb03c000aa0 con 0x7fb04c12cea0 2019-11-28T12:01:31.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb05147d700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c12cea0 0x7fb04c111db0 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7fb03c0103a0 tx=0x7fb03c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb05147d700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c12cea0 0x7fb04c111db0 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7fb03c0103a0 tx=0x7fb03c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb049ffb700 1 -- 172.21.15.80:0/2888695376 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c009980 con 0x7fb04c12cea0 2019-11-28T12:01:31.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb052ee0700 1 -- 172.21.15.80:0/2888695376 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04c121d20 con 0x7fb04c12cea0 2019-11-28T12:01:31.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb049ffb700 1 -- 172.21.15.80:0/2888695376 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb03c00a090 con 0x7fb04c12cea0 2019-11-28T12:01:31.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.860+0000 7fb052ee0700 1 -- 172.21.15.80:0/2888695376 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04c1122f0 con 0x7fb04c12cea0 2019-11-28T12:01:31.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.861+0000 7fb05147d700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c12cea0 0x7fb04c111db0 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7fb03c0103a0 tx=0x7fb03c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.861+0000 7fb049ffb700 1 -- 172.21.15.80:0/2888695376 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb03c000aa0 con 0x7fb04c12cea0 2019-11-28T12:01:31.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.861+0000 7fb05147d700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c12cea0 0x7fb04c111db0 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7fb03c0103a0 tx=0x7fb03c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.861+0000 7fb049ffb700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb030018770 0x7fb03001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:31.891 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.861+0000 7fb049ffb700 1 -- 172.21.15.80:0/2888695376 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(227..227 src has 1..227) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fb03c031a30 con 0x7fb04c12cea0 2019-11-28T12:01:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.861+0000 7fb050c7c700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb030018770 0x7fb03001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.861+0000 7fb050c7c700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb030018770 0x7fb03001abe0 crc :-1 s=READY pgs=1226 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.868+0000 7fb052ee0700 1 -- 172.21.15.80:0/2888695376 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04c1219a0 con 0x7fb04c12cea0 2019-11-28T12:01:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.872+0000 7fb05147d700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c12cea0 0x7fb04c111db0 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7fb03c0103a0 tx=0x7fb03c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:31.892 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:31.872+0000 7fb049ffb700 1 -- 172.21.15.80:0/2888695376 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb03c009580 con 0x7fb04c12cea0 2019-11-28T12:01:32.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.046+0000 7fb052ee0700 1 -- 172.21.15.80:0/2888695376 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb04c121d20 con 0x7fb04c12cea0 2019-11-28T12:01:32.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.048+0000 7fb05147d700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c12cea0 0x7fb04c111db0 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7fb03c0103a0 tx=0x7fb03c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.048+0000 7fb049ffb700 1 -- 172.21.15.80:0/2888695376 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v227) v1 ==== 81+0+31847 (secure 0 0 0) 0x7fb03c000aa0 con 0x7fb04c12cea0 2019-11-28T12:01:32.044 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:32.045 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T12:01:32.045 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 227, 2019-11-28T12:01:32.045 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T12:01:32.046 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T12:01:32.046 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T12:01:31.453955+0000", 2019-11-28T12:01:32.047 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T12:01:32.047 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T12:01:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T12:01:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T12:01:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T12:01:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T12:01:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T12:01:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T12:01:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T12:01:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T12:01:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T12:01:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T12:01:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T12:01:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T12:01:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T12:01:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 37, 2019-11-28T12:01:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T12:01:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T12:01:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T12:01:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T12:01:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T12:01:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T12:01:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T12:01:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T12:01:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T12:01:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T12:01:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T12:01:32.055 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T12:01:32.055 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T12:01:32.055 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T12:01:32.055 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T12:01:32.055 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T12:01:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T12:01:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T12:01:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T12:01:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T12:01:32.057 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T12:01:32.057 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T12:01:32.057 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T12:01:32.058 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T12:01:32.058 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T12:01:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T12:01:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T12:01:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T12:01:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T12:01:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T12:01:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T12:01:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T12:01:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T12:01:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T12:01:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T12:01:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T12:01:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T12:01:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T12:01:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T12:01:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T12:01:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T12:01:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T12:01:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T12:01:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T12:01:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T12:01:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T12:01:32.065 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T12:01:32.065 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T12:01:32.065 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T12:01:32.065 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T12:01:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T12:01:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T12:01:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T12:01:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T12:01:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T12:01:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T12:01:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T12:01:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T12:01:32.068 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T12:01:32.068 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T12:01:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T12:01:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T12:01:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T12:01:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T12:01:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T12:01:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T12:01:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T12:01:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T12:01:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T12:01:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.072 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 36, 2019-11-28T12:01:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T12:01:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:58:22.567726+0000", 2019-11-28T12:01:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T12:01:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T12:01:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T12:01:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T12:01:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T12:01:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T12:01:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T12:01:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T12:01:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T12:01:32.076 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T12:01:32.076 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T12:01:32.076 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T12:01:32.076 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T12:01:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T12:01:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T12:01:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T12:01:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T12:01:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T12:01:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T12:01:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T12:01:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "222", 2019-11-28T12:01:32.079 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T12:01:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T12:01:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T12:01:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T12:01:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T12:01:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T12:01:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T12:01:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T12:01:32.082 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T12:01:32.082 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T12:01:32.082 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T12:01:32.082 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T12:01:32.083 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T12:01:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T12:01:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T12:01:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T12:01:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T12:01:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T12:01:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T12:01:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T12:01:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T12:01:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T12:01:32.086 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T12:01:32.086 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T12:01:32.086 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T12:01:32.086 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T12:01:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T12:01:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T12:01:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T12:01:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T12:01:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T12:01:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T12:01:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T12:01:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T12:01:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T12:01:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T12:01:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T12:01:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T12:01:32.090 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T12:01:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T12:01:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T12:01:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T12:01:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T12:01:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T12:01:32.092 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.092 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.092 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 37, 2019-11-28T12:01:32.093 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T12:01:32.093 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:58:23.259981+0000", 2019-11-28T12:01:32.093 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T12:01:32.093 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T12:01:32.093 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T12:01:32.093 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T12:01:32.093 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T12:01:32.094 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T12:01:32.094 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T12:01:32.094 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T12:01:32.094 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T12:01:32.094 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T12:01:32.094 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T12:01:32.094 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T12:01:32.095 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T12:01:32.095 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T12:01:32.095 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T12:01:32.095 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T12:01:32.095 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T12:01:32.095 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T12:01:32.096 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T12:01:32.096 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T12:01:32.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.096 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "223", 2019-11-28T12:01:32.096 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T12:01:32.096 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T12:01:32.097 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T12:01:32.097 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T12:01:32.097 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T12:01:32.097 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T12:01:32.097 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T12:01:32.097 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T12:01:32.098 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T12:01:32.098 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T12:01:32.098 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T12:01:32.098 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T12:01:32.098 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T12:01:32.098 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T12:01:32.099 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T12:01:32.099 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T12:01:32.099 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T12:01:32.099 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T12:01:32.099 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T12:01:32.099 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T12:01:32.099 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T12:01:32.100 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T12:01:32.100 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T12:01:32.100 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T12:01:32.100 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T12:01:32.100 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T12:01:32.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.101 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T12:01:32.101 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T12:01:32.101 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T12:01:32.101 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T12:01:32.101 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T12:01:32.101 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T12:01:32.101 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T12:01:32.102 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T12:01:32.102 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T12:01:32.102 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T12:01:32.102 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T12:01:32.102 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T12:01:32.102 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T12:01:32.103 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T12:01:32.103 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T12:01:32.103 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.103 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.103 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.103 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T12:01:32.103 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T12:01:32.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.104 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T12:01:32.104 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T12:01:32.104 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T12:01:32.104 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T12:01:32.104 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T12:01:32.105 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T12:01:32.105 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T12:01:32.105 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T12:01:32.105 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T12:01:32.106 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 221, 2019-11-28T12:01:32.106 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T12:01:32.106 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T12:01:32.106 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T12:01:32.106 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.107 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.107 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T12:01:32.107 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T12:01:32.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.108 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.108 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T12:01:32.108 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T12:01:32.108 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.108 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.108 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T12:01:32.109 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.109 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.109 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T12:01:32.109 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T12:01:32.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.110 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.110 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T12:01:32.110 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T12:01:32.110 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.110 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.111 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T12:01:32.111 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.111 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.111 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T12:01:32.111 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T12:01:32.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.112 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.112 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T12:01:32.112 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T12:01:32.112 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.113 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.113 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T12:01:32.113 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.113 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.114 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T12:01:32.114 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T12:01:32.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.114 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.114 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T12:01:32.114 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T12:01:32.115 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.115 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.115 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T12:01:32.115 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T12:01:32.115 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T12:01:32.115 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T12:01:32.116 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T12:01:32.116 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T12:01:32.116 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T12:01:32.116 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.117 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T12:01:32.117 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T12:01:32.117 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T12:01:32.117 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T12:01:32.117 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T12:01:32.117 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T12:01:32.117 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T12:01:32.118 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T12:01:32.118 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T12:01:32.118 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 221, 2019-11-28T12:01:32.118 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T12:01:32.118 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T12:01:32.118 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T12:01:32.118 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.119 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.119 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T12:01:32.119 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T12:01:32.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.120 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.120 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T12:01:32.120 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T12:01:32.120 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.120 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.121 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T12:01:32.121 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.121 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.121 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T12:01:32.121 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T12:01:32.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.122 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.122 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T12:01:32.122 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T12:01:32.122 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.122 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.123 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T12:01:32.123 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.123 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.123 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T12:01:32.124 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T12:01:32.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.124 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.124 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T12:01:32.124 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T12:01:32.124 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.125 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.125 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T12:01:32.125 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.125 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.126 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T12:01:32.126 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T12:01:32.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.126 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.126 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T12:01:32.126 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T12:01:32.127 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.127 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.127 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T12:01:32.127 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T12:01:32.127 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T12:01:32.127 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T12:01:32.128 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T12:01:32.128 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T12:01:32.128 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T12:01:32.128 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.128 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T12:01:32.129 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T12:01:32.129 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T12:01:32.129 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T12:01:32.129 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T12:01:32.129 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T12:01:32.130 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T12:01:32.130 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T12:01:32.131 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T12:01:32.132 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 221, 2019-11-28T12:01:32.132 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T12:01:32.132 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T12:01:32.133 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T12:01:32.133 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.134 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.134 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T12:01:32.135 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T12:01:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T12:01:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T12:01:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T12:01:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T12:01:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T12:01:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T12:01:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T12:01:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T12:01:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T12:01:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T12:01:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T12:01:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T12:01:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T12:01:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.143 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T12:01:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T12:01:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T12:01:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T12:01:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T12:01:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T12:01:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T12:01:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T12:01:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T12:01:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T12:01:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T12:01:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T12:01:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T12:01:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T12:01:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T12:01:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T12:01:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T12:01:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T12:01:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T12:01:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T12:01:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 221, 2019-11-28T12:01:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T12:01:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T12:01:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T12:01:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T12:01:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T12:01:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T12:01:32.150 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T12:01:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T12:01:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T12:01:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T12:01:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T12:01:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T12:01:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T12:01:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T12:01:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T12:01:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T12:01:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T12:01:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T12:01:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T12:01:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T12:01:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T12:01:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T12:01:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T12:01:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T12:01:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T12:01:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T12:01:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T12:01:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T12:01:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T12:01:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T12:01:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T12:01:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T12:01:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T12:01:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T12:01:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T12:01:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T12:01:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T12:01:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T12:01:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 221, 2019-11-28T12:01:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T12:01:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T12:01:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T12:01:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T12:01:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T12:01:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T12:01:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T12:01:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T12:01:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T12:01:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T12:01:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T12:01:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T12:01:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T12:01:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T12:01:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T12:01:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T12:01:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T12:01:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T12:01:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T12:01:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T12:01:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T12:01:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T12:01:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T12:01:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T12:01:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T12:01:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T12:01:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T12:01:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T12:01:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T12:01:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T12:01:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T12:01:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T12:01:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T12:01:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T12:01:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T12:01:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T12:01:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T12:01:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T12:01:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 221, 2019-11-28T12:01:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T12:01:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T12:01:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T12:01:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T12:01:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T12:01:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T12:01:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T12:01:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T12:01:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T12:01:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T12:01:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T12:01:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T12:01:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T12:01:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T12:01:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T12:01:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T12:01:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T12:01:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T12:01:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T12:01:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T12:01:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T12:01:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T12:01:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T12:01:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T12:01:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T12:01:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T12:01:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T12:01:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T12:01:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T12:01:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T12:01:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T12:01:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T12:01:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T12:01:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T12:01:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T12:01:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T12:01:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T12:01:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T12:01:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 221, 2019-11-28T12:01:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T12:01:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T12:01:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T12:01:32.187 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T12:01:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T12:01:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T12:01:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T12:01:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T12:01:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T12:01:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T12:01:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T12:01:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T12:01:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T12:01:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T12:01:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T12:01:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T12:01:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T12:01:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T12:01:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T12:01:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T12:01:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T12:01:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T12:01:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T12:01:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T12:01:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T12:01:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T12:01:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T12:01:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T12:01:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T12:01:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T12:01:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T12:01:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T12:01:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T12:01:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T12:01:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T12:01:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T12:01:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T12:01:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T12:01:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 220, 2019-11-28T12:01:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T12:01:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T12:01:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T12:01:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T12:01:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T12:01:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T12:01:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T12:01:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T12:01:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T12:01:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T12:01:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T12:01:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T12:01:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T12:01:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T12:01:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T12:01:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T12:01:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T12:01:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T12:01:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:01:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:01:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T12:01:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T12:01:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:01:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T12:01:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T12:01:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T12:01:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T12:01:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T12:01:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T12:01:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T12:01:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T12:01:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T12:01:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T12:01:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T12:01:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T12:01:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T12:01:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T12:01:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T12:01:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T12:01:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T12:01:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T12:01:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T12:01:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T12:01:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T12:01:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T12:01:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T12:01:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T12:01:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T12:01:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T12:01:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T12:01:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T12:01:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T12:01:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T12:01:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T12:01:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T12:01:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T12:01:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T12:01:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T12:01:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T12:01:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T12:01:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T12:01:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T12:01:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T12:01:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T12:01:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T12:01:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T12:01:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T12:01:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T12:01:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T12:01:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T12:01:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T12:01:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T12:01:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T12:01:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T12:01:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T12:01:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T12:01:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T12:01:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T12:01:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T12:01:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T12:01:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T12:01:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T12:01:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T12:01:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T12:01:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T12:01:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T12:01:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T12:01:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T12:01:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T12:01:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T12:01:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T12:01:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T12:01:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T12:01:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T12:01:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T12:01:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T12:01:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T12:01:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T12:01:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T12:01:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T12:01:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T12:01:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T12:01:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T12:01:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T12:01:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6835/4148152245": "2019-11-29T12:01:31.451183+0000", 2019-11-28T12:01:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.80:6833/4148152245": "2019-11-29T12:01:31.451183+0000", 2019-11-28T12:01:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.76:0/2000608864": "2019-11-28T12:59:41.712744+0000" 2019-11-28T12:01:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T12:01:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T12:01:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T12:01:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T12:01:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T12:01:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T12:01:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T12:01:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T12:01:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T12:01:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T12:01:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T12:01:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T12:01:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T12:01:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T12:01:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T12:01:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T12:01:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T12:01:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T12:01:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T12:01:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T12:01:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T12:01:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T12:01:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T12:01:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T12:01:32.231 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T12:01:32.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.051+0000 7fb052ee0700 1 -- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb030018770 msgr2=0x7fb03001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:32.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.051+0000 7fb052ee0700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb030018770 0x7fb03001abe0 crc :-1 s=READY pgs=1226 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:32.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.051+0000 7fb052ee0700 1 -- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c12cea0 msgr2=0x7fb04c111db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:32.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.051+0000 7fb052ee0700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c12cea0 0x7fb04c111db0 secure :-1 s=READY pgs=427 cs=0 l=1 rx=0x7fb03c0103a0 tx=0x7fb03c010740).stop 2019-11-28T12:01:32.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.052+0000 7fb052ee0700 1 -- 172.21.15.80:0/2888695376 shutdown_connections 2019-11-28T12:01:32.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.052+0000 7fb052ee0700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb030018770 0x7fb03001abe0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:32.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.052+0000 7fb052ee0700 1 --2- 172.21.15.80:0/2888695376 >> v2:172.21.15.174:3300/0 conn(0x7fb04c1230e0 0x7fb04c123570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:32.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.052+0000 7fb052ee0700 1 --2- 172.21.15.80:0/2888695376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb04c12cea0 0x7fb04c111db0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:32.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.052+0000 7fb052ee0700 1 -- 172.21.15.80:0/2888695376 shutdown_connections 2019-11-28T12:01:32.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.052+0000 7fb052ee0700 1 -- 172.21.15.80:0/2888695376 wait complete. 2019-11-28T12:01:32.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.052+0000 7fb052ee0700 1 -- 172.21.15.80:0/2888695376 >> 172.21.15.80:0/2888695376 conn(0x7fb04c1426c0 msgr2=0x7fb04c110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:32.236 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:01:32.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.361+0000 7f514b84d700 1 Processor -- start 2019-11-28T12:01:32.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.361+0000 7f514b84d700 1 -- start start 2019-11-28T12:01:32.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.362+0000 7f514b84d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f514406c0a0 0x7f5144072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:32.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.362+0000 7f514b84d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f51440734e0 0x7f5144071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:32.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.362+0000 7f514b84d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514406db00 con 0x7f5144072360 2019-11-28T12:01:32.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.362+0000 7f514b84d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514406f330 con 0x7f51440734e0 2019-11-28T12:01:32.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.362+0000 7f514b84d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51440706c0 con 0x7f514406c0a0 2019-11-28T12:01:32.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f51495e9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f51440734e0 0x7f5144071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:32.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f51495e9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f51440734e0 0x7f5144071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47506/0 (socket says 172.21.15.80:47506) 2019-11-28T12:01:32.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f51495e9700 1 -- 172.21.15.80:0/546374264 learned_addr learned my addr 172.21.15.80:0/546374264 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:32.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f514a5eb700 1 --1- 172.21.15.80:0/546374264 >> v1:172.21.15.80:6789/0 conn(0x7f5144072360 0x7f514406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46820/0 (socket says 172.21.15.80:46820) 2019-11-28T12:01:32.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f5149dea700 1 --2- 172.21.15.80:0/546374264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f514406c0a0 0x7f5144072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:32.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f51495e9700 1 -- 172.21.15.80:0/546374264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f514406c0a0 msgr2=0x7f5144072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:32.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f51495e9700 1 --2- 172.21.15.80:0/546374264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f514406c0a0 0x7f5144072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:32.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f51495e9700 1 -- 172.21.15.80:0/546374264 >> v1:172.21.15.80:6789/0 conn(0x7f5144072360 legacy=0x7f514406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:32.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f5148de8700 1 -- 172.21.15.80:0/546374264 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603727907 0 0) 0x7f513c0009b0 con 0x7f5144072360 2019-11-28T12:01:32.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f51495e9700 1 -- 172.21.15.80:0/546374264 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5144070a40 con 0x7f51440734e0 2019-11-28T12:01:32.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f51495e9700 1 --2- 172.21.15.80:0/546374264 >> v2:172.21.15.80:3300/0 conn(0x7f51440734e0 0x7f5144071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f513400fa40 tx=0x7f513400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f51495e9700 1 --2- 172.21.15.80:0/546374264 >> v2:172.21.15.80:3300/0 conn(0x7f51440734e0 0x7f5144071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f513400fa40 tx=0x7f513400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f51495e9700 1 --2- 172.21.15.80:0/546374264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51440734e0 0x7f5144071e20 secure :-1 s=READY pgs=2966 cs=0 l=1 rx=0x7f513400fa40 tx=0x7f513400fde0).ready entity=mon.0 client_cookie=125da16a38aa7cc7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f51495e9700 1 --2- 172.21.15.80:0/546374264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51440734e0 0x7f5144071e20 secure :-1 s=THROTTLE_DONE pgs=2966 cs=0 l=1 rx=0x7f513400fa40 tx=0x7f513400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f5148de8700 1 -- 172.21.15.80:0/546374264 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5134000ce0 con 0x7f51440734e0 2019-11-28T12:01:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f51495e9700 1 --2- 172.21.15.80:0/546374264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51440734e0 0x7f5144071e20 secure :-1 s=THROTTLE_DONE pgs=2966 cs=0 l=1 rx=0x7f513400fa40 tx=0x7f513400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f5148de8700 1 -- 172.21.15.80:0/546374264 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5134001010 con 0x7f51440734e0 2019-11-28T12:01:32.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f51495e9700 1 --2- 172.21.15.80:0/546374264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51440734e0 0x7f5144071e20 secure :-1 s=THROTTLE_DONE pgs=2966 cs=0 l=1 rx=0x7f513400fa40 tx=0x7f513400fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f5148de8700 1 -- 172.21.15.80:0/546374264 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5134007590 con 0x7f51440734e0 2019-11-28T12:01:32.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f514b84d700 1 -- 172.21.15.80:0/546374264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51440734e0 msgr2=0x7f5144071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:32.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.363+0000 7f514b84d700 1 --2- 172.21.15.80:0/546374264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51440734e0 0x7f5144071e20 secure :-1 s=READY pgs=2966 cs=0 l=1 rx=0x7f513400fa40 tx=0x7f513400fde0).stop 2019-11-28T12:01:32.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.364+0000 7f514b84d700 1 -- 172.21.15.80:0/546374264 shutdown_connections 2019-11-28T12:01:32.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.364+0000 7f514b84d700 1 --2- 172.21.15.80:0/546374264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51440734e0 0x7f5144071e20 unknown :-1 s=CLOSED pgs=2966 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:32.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.364+0000 7f514b84d700 1 --2- 172.21.15.80:0/546374264 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f514406c0a0 0x7f5144072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:32.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.364+0000 7f514b84d700 1 -- 172.21.15.80:0/546374264 shutdown_connections 2019-11-28T12:01:32.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.364+0000 7f514b84d700 1 -- 172.21.15.80:0/546374264 wait complete. 2019-11-28T12:01:32.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.364+0000 7f514b84d700 1 -- 172.21.15.80:0/546374264 >> 172.21.15.80:0/546374264 conn(0x7f5144061cf0 msgr2=0x7f5144064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.367+0000 7f514b84d700 1 Processor -- start 2019-11-28T12:01:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.367+0000 7f514b84d700 1 -- start start 2019-11-28T12:01:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f514b84d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f514413a780 0x7f514412d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f514b84d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5144139a60 con 0x7f514412d9c0 2019-11-28T12:01:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f514b84d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514413b060 con 0x7f514412cb00 2019-11-28T12:01:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f514b84d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514412a260 con 0x7f514413a780 2019-11-28T12:01:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f5149dea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f514413a780 0x7f514412d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f51495e9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f514412d9c0 0x7f514412c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46824/0 (socket says 172.21.15.80:46824) 2019-11-28T12:01:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f51495e9700 1 -- 172.21.15.80:0/23123106 learned_addr learned my addr 172.21.15.80:0/23123106 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f5149dea700 1 -- 172.21.15.80:0/23123106 >> v1:172.21.15.174:6789/0 conn(0x7f514412cb00 legacy=0x7f5144167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f5149dea700 1 -- 172.21.15.80:0/23123106 >> v1:172.21.15.80:6789/0 conn(0x7f514412d9c0 legacy=0x7f514412c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f5149dea700 1 -- 172.21.15.80:0/23123106 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514412abc0 con 0x7f514413a780 2019-11-28T12:01:32.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f51427fc700 1 -- 172.21.15.80:0/23123106 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190382032 0 0) 0x7f5134007c60 con 0x7f514412d9c0 2019-11-28T12:01:32.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f5149dea700 1 --2- 172.21.15.80:0/23123106 >> v2:172.21.15.80:3300/0 conn(0x7f514413a780 0x7f514412d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f512c0103a0 tx=0x7f512c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f5149dea700 1 --2- 172.21.15.80:0/23123106 >> v2:172.21.15.80:3300/0 conn(0x7f514413a780 0x7f514412d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f512c0103a0 tx=0x7f512c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f5149dea700 1 --2- 172.21.15.80:0/23123106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514413a780 0x7f514412d480 secure :-1 s=READY pgs=2968 cs=0 l=1 rx=0x7f512c0103a0 tx=0x7f512c010740).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:32.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f5149dea700 1 --2- 172.21.15.80:0/23123106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514413a780 0x7f514412d480 secure :-1 s=THROTTLE_DONE pgs=2968 cs=0 l=1 rx=0x7f512c0103a0 tx=0x7f512c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f51427fc700 1 -- 172.21.15.80:0/23123106 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f512c000940 con 0x7f514413a780 2019-11-28T12:01:32.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f5149dea700 1 --2- 172.21.15.80:0/23123106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514413a780 0x7f514412d480 secure :-1 s=THROTTLE_DONE pgs=2968 cs=0 l=1 rx=0x7f512c0103a0 tx=0x7f512c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f5149dea700 1 --2- 172.21.15.80:0/23123106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514413a780 0x7f514412d480 secure :-1 s=THROTTLE_DONE pgs=2968 cs=0 l=1 rx=0x7f512c0103a0 tx=0x7f512c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f51427fc700 1 -- 172.21.15.80:0/23123106 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c009c40 con 0x7f514413a780 2019-11-28T12:01:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f514b84d700 1 -- 172.21.15.80:0/23123106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514412af40 con 0x7f514413a780 2019-11-28T12:01:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.368+0000 7f51427fc700 1 -- 172.21.15.80:0/23123106 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f512c00a250 con 0x7f514413a780 2019-11-28T12:01:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.369+0000 7f514b84d700 1 -- 172.21.15.80:0/23123106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514412abc0 con 0x7f514413a780 2019-11-28T12:01:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.369+0000 7f5149dea700 1 --2- 172.21.15.80:0/23123106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514413a780 0x7f514412d480 secure :-1 s=THROTTLE_DONE pgs=2968 cs=0 l=1 rx=0x7f512c0103a0 tx=0x7f512c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.369+0000 7f51427fc700 1 -- 172.21.15.80:0/23123106 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f512c0098c0 con 0x7f514413a780 2019-11-28T12:01:32.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.369+0000 7f5149dea700 1 --2- 172.21.15.80:0/23123106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514413a780 0x7f514412d480 secure :-1 s=THROTTLE_DONE pgs=2968 cs=0 l=1 rx=0x7f512c0103a0 tx=0x7f512c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.369+0000 7f51427fc700 1 --2- 172.21.15.80:0/23123106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5128018730 0x7f512801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:32.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.369+0000 7f51427fc700 1 -- 172.21.15.80:0/23123106 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(227..227 src has 1..227) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f512c031d40 con 0x7f514413a780 2019-11-28T12:01:32.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.369+0000 7f51495e9700 1 --2- 172.21.15.80:0/23123106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5128018730 0x7f512801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:32.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.370+0000 7f51495e9700 1 --2- 172.21.15.80:0/23123106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5128018730 0x7f512801abe0 crc :-1 s=READY pgs=1227 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:32.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.377+0000 7f514b84d700 1 -- 172.21.15.80:0/23123106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514412af40 con 0x7f514413a780 2019-11-28T12:01:32.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.380+0000 7f5149dea700 1 --2- 172.21.15.80:0/23123106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514413a780 0x7f514412d480 secure :-1 s=THROTTLE_DONE pgs=2968 cs=0 l=1 rx=0x7f512c0103a0 tx=0x7f512c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.380+0000 7f51427fc700 1 -- 172.21.15.80:0/23123106 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f512c009660 con 0x7f514413a780 2019-11-28T12:01:32.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.553+0000 7f514b84d700 1 -- 172.21.15.80:0/23123106 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f514412abc0 con 0x7f514413a780 2019-11-28T12:01:32.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.553+0000 7f5149dea700 1 --2- 172.21.15.80:0/23123106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514413a780 0x7f514412d480 secure :-1 s=THROTTLE_DONE pgs=2968 cs=0 l=1 rx=0x7f512c0103a0 tx=0x7f512c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.553+0000 7f51427fc700 1 -- 172.21.15.80:0/23123106 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 187 v187) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f512c017a80 con 0x7f514413a780 2019-11-28T12:01:32.548 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 187 2019-11-28T12:01:32.548 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:32.549 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":187,"default_fscid":18,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":187,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:58:24.286894+0000","modified":"2019-11-28T12:01:31.615457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":226,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[37],"metadata_pool":36,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":18}]} 2019-11-28T12:01:32.550 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.556+0000 7f514b84d700 1 -- 172.21.15.80:0/23123106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5128018730 msgr2=0x7f512801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:32.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.556+0000 7f514b84d700 1 --2- 172.21.15.80:0/23123106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5128018730 0x7f512801abe0 crc :-1 s=READY pgs=1227 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:32.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.556+0000 7f514b84d700 1 -- 172.21.15.80:0/23123106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514413a780 msgr2=0x7f514412d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:32.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.556+0000 7f514b84d700 1 --2- 172.21.15.80:0/23123106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514413a780 0x7f514412d480 secure :-1 s=READY pgs=2968 cs=0 l=1 rx=0x7f512c0103a0 tx=0x7f512c010740).stop 2019-11-28T12:01:32.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.556+0000 7f514b84d700 1 -- 172.21.15.80:0/23123106 shutdown_connections 2019-11-28T12:01:32.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.556+0000 7f514b84d700 1 --2- 172.21.15.80:0/23123106 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5128018730 0x7f512801abe0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:32.551 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.556+0000 7f514b84d700 1 --2- 172.21.15.80:0/23123106 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f514413a780 0x7f514412d480 unknown :-1 s=CLOSED pgs=2968 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:32.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.556+0000 7f514b84d700 1 -- 172.21.15.80:0/23123106 shutdown_connections 2019-11-28T12:01:32.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.556+0000 7f514b84d700 1 -- 172.21.15.80:0/23123106 wait complete. 2019-11-28T12:01:32.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.556+0000 7f514b84d700 1 -- 172.21.15.80:0/23123106 >> 172.21.15.80:0/23123106 conn(0x7f5144127dc0 msgr2=0x7f5144141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:32.561 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T12:01:32.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.690+0000 7f4768a19700 1 Processor -- start 2019-11-28T12:01:32.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.690+0000 7f4768a19700 1 -- start start 2019-11-28T12:01:32.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.691+0000 7f4768a19700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f476406d120 0x7f4764165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:32.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.691+0000 7f4768a19700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476406d5a0 con 0x7f476406c490 2019-11-28T12:01:32.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.691+0000 7f4768a19700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476406db00 con 0x7f476406c0a0 2019-11-28T12:01:32.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.691+0000 7f4768a19700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f476406fd60 con 0x7f476406d120 2019-11-28T12:01:32.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.691+0000 7f476359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f476406d120 0x7f4764165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:32.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.691+0000 7f476259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f476406c490 0x7f476406c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46834/0 (socket says 172.21.15.80:46834) 2019-11-28T12:01:32.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.691+0000 7f476259c700 1 -- 172.21.15.80:0/4250639824 learned_addr learned my addr 172.21.15.80:0/4250639824 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:32.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.692+0000 7f476359e700 1 -- 172.21.15.80:0/4250639824 >> v1:172.21.15.174:6789/0 conn(0x7f476406c0a0 legacy=0x7f4764072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:32.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.692+0000 7f476359e700 1 -- 172.21.15.80:0/4250639824 >> v1:172.21.15.80:6789/0 conn(0x7f476406c490 legacy=0x7f476406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:32.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.692+0000 7f4761d9b700 1 -- 172.21.15.80:0/4250639824 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972091037 0 0) 0x7f4754001080 con 0x7f476406c0a0 2019-11-28T12:01:32.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.692+0000 7f476359e700 1 -- 172.21.15.80:0/4250639824 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47640706c0 con 0x7f476406d120 2019-11-28T12:01:32.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.692+0000 7f476359e700 1 --2- 172.21.15.80:0/4250639824 >> v2:172.21.15.80:3300/0 conn(0x7f476406d120 0x7f4764165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f475c00af50 tx=0x7f475c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.692+0000 7f476359e700 1 --2- 172.21.15.80:0/4250639824 >> v2:172.21.15.80:3300/0 conn(0x7f476406d120 0x7f4764165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f475c00af50 tx=0x7f475c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.692+0000 7f476359e700 1 --2- 172.21.15.80:0/4250639824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f476406d120 0x7f4764165d80 secure :-1 s=READY pgs=2970 cs=0 l=1 rx=0x7f475c00af50 tx=0x7f475c00b760).ready entity=mon.0 client_cookie=b03cf7342421d2ff server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:32.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.692+0000 7f476359e700 1 --2- 172.21.15.80:0/4250639824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f476406d120 0x7f4764165d80 secure :-1 s=THROTTLE_DONE pgs=2970 cs=0 l=1 rx=0x7f475c00af50 tx=0x7f475c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.692+0000 7f4761d9b700 1 -- 172.21.15.80:0/4250639824 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f475c009ba0 con 0x7f476406d120 2019-11-28T12:01:32.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.692+0000 7f476359e700 1 --2- 172.21.15.80:0/4250639824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f476406d120 0x7f4764165d80 secure :-1 s=THROTTLE_DONE pgs=2970 cs=0 l=1 rx=0x7f475c00af50 tx=0x7f475c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.692+0000 7f476359e700 1 --2- 172.21.15.80:0/4250639824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f476406d120 0x7f4764165d80 secure :-1 s=THROTTLE_DONE pgs=2970 cs=0 l=1 rx=0x7f475c00af50 tx=0x7f475c00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.692+0000 7f4761d9b700 1 -- 172.21.15.80:0/4250639824 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c000a70 con 0x7f476406d120 2019-11-28T12:01:32.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.692+0000 7f4761d9b700 1 -- 172.21.15.80:0/4250639824 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f475c00a180 con 0x7f476406d120 2019-11-28T12:01:32.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.692+0000 7f4768a19700 1 -- 172.21.15.80:0/4250639824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f476406d120 msgr2=0x7f4764165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:32.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.692+0000 7f4768a19700 1 --2- 172.21.15.80:0/4250639824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f476406d120 0x7f4764165d80 secure :-1 s=READY pgs=2970 cs=0 l=1 rx=0x7f475c00af50 tx=0x7f475c00b760).stop 2019-11-28T12:01:32.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.693+0000 7f4768a19700 1 -- 172.21.15.80:0/4250639824 shutdown_connections 2019-11-28T12:01:32.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.693+0000 7f4768a19700 1 --2- 172.21.15.80:0/4250639824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f476406d120 0x7f4764165d80 unknown :-1 s=CLOSED pgs=2970 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:32.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.693+0000 7f4768a19700 1 -- 172.21.15.80:0/4250639824 shutdown_connections 2019-11-28T12:01:32.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.693+0000 7f4768a19700 1 -- 172.21.15.80:0/4250639824 wait complete. 2019-11-28T12:01:32.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.693+0000 7f4768a19700 1 -- 172.21.15.80:0/4250639824 >> 172.21.15.80:0/4250639824 conn(0x7f4764061cf0 msgr2=0x7f4764064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:32.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.695+0000 7f4768a19700 1 Processor -- start 2019-11-28T12:01:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.695+0000 7f4768a19700 1 -- start start 2019-11-28T12:01:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.696+0000 7f4768a19700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4764112fb0 0x7f4764113440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.696+0000 7f4768a19700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4764113980 0x7f4764168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.696+0000 7f4768a19700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4764113db0 con 0x7f476413f580 2019-11-28T12:01:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.696+0000 7f4768a19700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47641236b0 con 0x7f4764112fb0 2019-11-28T12:01:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.696+0000 7f4768a19700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4764123980 con 0x7f4764113980 2019-11-28T12:01:32.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.696+0000 7f4762d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f476413f580 0x7f4764114130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46836/0 (socket says 172.21.15.80:46836) 2019-11-28T12:01:32.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.696+0000 7f4762d9d700 1 -- 172.21.15.80:0/2244028092 learned_addr learned my addr 172.21.15.80:0/2244028092 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:32.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.696+0000 7f476259c700 1 --2- 172.21.15.80:0/2244028092 >> v2:172.21.15.174:3300/0 conn(0x7f4764112fb0 0x7f4764113440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.696+0000 7f476359e700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4764113980 0x7f4764168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f475b7fe700 1 -- 172.21.15.80:0/2244028092 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780654790 0 0) 0x7f47540012c0 con 0x7f476413f580 2019-11-28T12:01:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f475b7fe700 1 -- 172.21.15.80:0/2244028092 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f473c002e80 con 0x7f476413f580 2019-11-28T12:01:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f476259c700 1 -- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4764113980 msgr2=0x7f4764168a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:32.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f476259c700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4764113980 0x7f4764168a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:32.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f476259c700 1 -- 172.21.15.80:0/2244028092 >> v1:172.21.15.80:6789/0 conn(0x7f476413f580 legacy=0x7f4764114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:32.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f475b7fe700 1 -- 172.21.15.80:0/2244028092 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1692515948 0 0) 0x7f4754000aa0 con 0x7f476413f580 2019-11-28T12:01:32.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f476259c700 1 -- 172.21.15.80:0/2244028092 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4764124010 con 0x7f4764112fb0 2019-11-28T12:01:32.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f476359e700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4764113980 0x7f4764168a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:32.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f476259c700 1 --2- 172.21.15.80:0/2244028092 >> v2:172.21.15.174:3300/0 conn(0x7f4764112fb0 0x7f4764113440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f474c0106f0 tx=0x7f474c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f476259c700 1 --2- 172.21.15.80:0/2244028092 >> v2:172.21.15.174:3300/0 conn(0x7f4764112fb0 0x7f4764113440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f474c0106f0 tx=0x7f474c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f476259c700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4764112fb0 0x7f4764113440 secure :-1 s=READY pgs=1792 cs=0 l=1 rx=0x7f474c0106f0 tx=0x7f474c010a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:32.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f476259c700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4764112fb0 0x7f4764113440 secure :-1 s=THROTTLE_DONE pgs=1792 cs=0 l=1 rx=0x7f474c0106f0 tx=0x7f474c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f475b7fe700 1 -- 172.21.15.80:0/2244028092 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f474c001270 con 0x7f4764112fb0 2019-11-28T12:01:32.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f476259c700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4764112fb0 0x7f4764113440 secure :-1 s=THROTTLE_DONE pgs=1792 cs=0 l=1 rx=0x7f474c0106f0 tx=0x7f474c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f475b7fe700 1 -- 172.21.15.80:0/2244028092 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c001580 con 0x7f4764112fb0 2019-11-28T12:01:32.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f4768a19700 1 -- 172.21.15.80:0/2244028092 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4764124010 con 0x7f4764112fb0 2019-11-28T12:01:32.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f476259c700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4764112fb0 0x7f4764113440 secure :-1 s=THROTTLE_DONE pgs=1792 cs=0 l=1 rx=0x7f474c0106f0 tx=0x7f474c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f475b7fe700 1 -- 172.21.15.80:0/2244028092 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f474c001250 con 0x7f4764112fb0 2019-11-28T12:01:32.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.697+0000 7f4768a19700 1 -- 172.21.15.80:0/2244028092 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4764124010 con 0x7f4764112fb0 2019-11-28T12:01:32.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.698+0000 7f476259c700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4764112fb0 0x7f4764113440 secure :-1 s=THROTTLE_DONE pgs=1792 cs=0 l=1 rx=0x7f474c0106f0 tx=0x7f474c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.698+0000 7f475b7fe700 1 -- 172.21.15.80:0/2244028092 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f474c0045c0 con 0x7f4764112fb0 2019-11-28T12:01:32.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.698+0000 7f476259c700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4764112fb0 0x7f4764113440 secure :-1 s=THROTTLE_DONE pgs=1792 cs=0 l=1 rx=0x7f474c0106f0 tx=0x7f474c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.698+0000 7f475b7fe700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f473c018780 0x7f473c01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:32.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.698+0000 7f475b7fe700 1 -- 172.21.15.80:0/2244028092 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(227..227 src has 1..227) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f474c031d30 con 0x7f4764112fb0 2019-11-28T12:01:32.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.698+0000 7f4762d9d700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f473c018780 0x7f473c01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:32.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.698+0000 7f4762d9d700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f473c018780 0x7f473c01abf0 crc :-1 s=READY pgs=1228 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:32.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.706+0000 7f4768a19700 1 -- 172.21.15.80:0/2244028092 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4764124010 con 0x7f4764112fb0 2019-11-28T12:01:32.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.709+0000 7f476259c700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4764112fb0 0x7f4764113440 secure :-1 s=THROTTLE_DONE pgs=1792 cs=0 l=1 rx=0x7f474c0106f0 tx=0x7f474c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:32.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.709+0000 7f475b7fe700 1 -- 172.21.15.80:0/2244028092 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f474c001010 con 0x7f4764112fb0 2019-11-28T12:01:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:32.874+0000 7f4768a19700 1 -- 172.21.15.80:0/2244028092 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4764124010 con 0x7f4764112fb0 2019-11-28T12:01:33.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:33.850+0000 7f476259c700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4764112fb0 0x7f4764113440 secure :-1 s=THROTTLE_DONE pgs=1792 cs=0 l=1 rx=0x7f474c0106f0 tx=0x7f474c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:33.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:33.850+0000 7f475b7fe700 1 -- 172.21.15.80:0/2244028092 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v188) v1 ==== 161+0+0 (secure 0 0 0) 0x7f474c0046e0 con 0x7f4764112fb0 2019-11-28T12:01:33.884 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T12:01:33.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:33.892+0000 7f4768a19700 1 -- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f473c018780 msgr2=0x7f473c01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:33.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:33.892+0000 7f4768a19700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f473c018780 0x7f473c01abf0 crc :-1 s=READY pgs=1228 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:33.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:33.892+0000 7f4768a19700 1 -- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4764112fb0 msgr2=0x7f4764113440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:33.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:33.892+0000 7f4768a19700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4764112fb0 0x7f4764113440 secure :-1 s=READY pgs=1792 cs=0 l=1 rx=0x7f474c0106f0 tx=0x7f474c010a90).stop 2019-11-28T12:01:33.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:33.892+0000 7f4768a19700 1 -- 172.21.15.80:0/2244028092 shutdown_connections 2019-11-28T12:01:33.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:33.892+0000 7f4768a19700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f473c018780 0x7f473c01abf0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:33.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:33.892+0000 7f4768a19700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4764113980 0x7f4764168a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:33.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:33.892+0000 7f4768a19700 1 --2- 172.21.15.80:0/2244028092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4764112fb0 0x7f4764113440 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:33.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:33.892+0000 7f4768a19700 1 -- 172.21.15.80:0/2244028092 shutdown_connections 2019-11-28T12:01:33.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:33.892+0000 7f4768a19700 1 -- 172.21.15.80:0/2244028092 wait complete. 2019-11-28T12:01:33.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:33.892+0000 7f4768a19700 1 -- 172.21.15.80:0/2244028092 >> 172.21.15.80:0/2244028092 conn(0x7f47641426c0 msgr2=0x7f4764110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:33.897 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:01:34.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.024+0000 7f15c7a31700 1 Processor -- start 2019-11-28T12:01:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.024+0000 7f15c7a31700 1 -- start start 2019-11-28T12:01:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.025+0000 7f15c7a31700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f15c006c490 0x7f15c006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.025+0000 7f15c7a31700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c006db00 con 0x7f15c006ce60 2019-11-28T12:01:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.025+0000 7f15c7a31700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c006e000 con 0x7f15c006c0a0 2019-11-28T12:01:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.025+0000 7f15c7a31700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c006fd60 con 0x7f15c006c490 2019-11-28T12:01:34.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.025+0000 7f15c67cf700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f15c006ce60 0x7f15c0164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46846/0 (socket says 172.21.15.80:46846) 2019-11-28T12:01:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.025+0000 7f15c67cf700 1 -- 172.21.15.80:0/308152033 learned_addr learned my addr 172.21.15.80:0/308152033 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.025+0000 7f15c57cd700 1 --2- 172.21.15.80:0/308152033 >> v2:172.21.15.174:3300/0 conn(0x7f15c006c490 0x7f15c006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c4fcc700 1 -- 172.21.15.80:0/308152033 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002804088 0 0) 0x7f15b8001150 con 0x7f15c006ce60 2019-11-28T12:01:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c4fcc700 1 -- 172.21.15.80:0/308152033 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15ac002e80 con 0x7f15c006ce60 2019-11-28T12:01:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c4fcc700 1 -- 172.21.15.80:0/308152033 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1181271760 0 0) 0x7f15b8001130 con 0x7f15c006ce60 2019-11-28T12:01:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c4fcc700 1 -- 172.21.15.80:0/308152033 >> v2:172.21.15.174:3300/0 conn(0x7f15c006c490 msgr2=0x7f15c006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:34.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c4fcc700 1 --2- 172.21.15.80:0/308152033 >> v2:172.21.15.174:3300/0 conn(0x7f15c006c490 0x7f15c006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c4fcc700 1 -- 172.21.15.80:0/308152033 >> v1:172.21.15.174:6789/0 conn(0x7f15c006c0a0 legacy=0x7f15c0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c4fcc700 1 -- 172.21.15.80:0/308152033 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c00706c0 con 0x7f15c006ce60 2019-11-28T12:01:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c4fcc700 1 -- 172.21.15.80:0/308152033 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f15b80016c0 con 0x7f15c006ce60 2019-11-28T12:01:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c4fcc700 1 -- 172.21.15.80:0/308152033 >> v1:172.21.15.80:6789/0 conn(0x7f15c006ce60 legacy=0x7f15c0164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c4fcc700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15ac003b20 0x7f15ac005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:34.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c4fcc700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15ac006700 0x7f15ac008bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:34.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c4fcc700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ac009430 0x7f15ac00b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:34.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c4fcc700 1 -- 172.21.15.80:0/308152033 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac00c0b0 con 0x7f15ac009430 2019-11-28T12:01:34.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c4fcc700 1 -- 172.21.15.80:0/308152033 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0502b0 con 0x7f15ac003b20 2019-11-28T12:01:34.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c4fcc700 1 -- 172.21.15.80:0/308152033 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0504e0 con 0x7f15ac006700 2019-11-28T12:01:34.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c57cd700 1 --2- 172.21.15.80:0/308152033 >> v2:172.21.15.174:3300/0 conn(0x7f15c006c490 0x7f15c006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:34.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c67cf700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ac009430 0x7f15ac00b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:34.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c5fce700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15ac003b20 0x7f15ac005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:34.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c67cf700 1 -- 172.21.15.80:0/308152033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15ac006700 msgr2=0x7f15ac008bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:34.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c57cd700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15ac006700 0x7f15ac008bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:34.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c67cf700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15ac006700 0x7f15ac008bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:34.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c67cf700 1 -- 172.21.15.80:0/308152033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15ac003b20 msgr2=0x7f15ac005f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:34.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c67cf700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15ac003b20 0x7f15ac005f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:34.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c67cf700 1 -- 172.21.15.80:0/308152033 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac050790 con 0x7f15ac009430 2019-11-28T12:01:34.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c5fce700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15ac003b20 0x7f15ac005f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T12:01:34.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c57cd700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15ac006700 0x7f15ac008bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T12:01:34.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c67cf700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ac009430 0x7f15ac00b900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f15b800f900 tx=0x7f15b800fca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c67cf700 1 -- 172.21.15.80:0/308152033 reap_dead start 2019-11-28T12:01:34.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c67cf700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ac009430 0x7f15ac00b900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f15b800f900 tx=0x7f15b800fca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.026+0000 7f15c67cf700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ac009430 0x7f15ac00b900 secure :-1 s=READY pgs=2973 cs=0 l=1 rx=0x7f15b800f900 tx=0x7f15b800fca0).ready entity=mon.0 client_cookie=d1883c1e482863bc server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:34.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.027+0000 7f15c67cf700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ac009430 0x7f15ac00b900 secure :-1 s=THROTTLE_DONE pgs=2973 cs=0 l=1 rx=0x7f15b800f900 tx=0x7f15b800fca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.027+0000 7f15c4fcc700 1 -- 172.21.15.80:0/308152033 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b80017f0 con 0x7f15ac009430 2019-11-28T12:01:34.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.027+0000 7f15c67cf700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ac009430 0x7f15ac00b900 secure :-1 s=THROTTLE_DONE pgs=2973 cs=0 l=1 rx=0x7f15b800f900 tx=0x7f15b800fca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.027+0000 7f15c67cf700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ac009430 0x7f15ac00b900 secure :-1 s=THROTTLE_DONE pgs=2973 cs=0 l=1 rx=0x7f15b800f900 tx=0x7f15b800fca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.027+0000 7f15c4fcc700 1 -- 172.21.15.80:0/308152033 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b8000940 con 0x7f15ac009430 2019-11-28T12:01:34.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.027+0000 7f15c4fcc700 1 -- 172.21.15.80:0/308152033 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b80017f0 con 0x7f15ac009430 2019-11-28T12:01:34.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.027+0000 7f15c7a31700 1 -- 172.21.15.80:0/308152033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ac009430 msgr2=0x7f15ac00b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:34.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.027+0000 7f15c7a31700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ac009430 0x7f15ac00b900 secure :-1 s=READY pgs=2973 cs=0 l=1 rx=0x7f15b800f900 tx=0x7f15b800fca0).stop 2019-11-28T12:01:34.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.027+0000 7f15c7a31700 1 -- 172.21.15.80:0/308152033 shutdown_connections 2019-11-28T12:01:34.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.027+0000 7f15c7a31700 1 --2- 172.21.15.80:0/308152033 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15ac009430 0x7f15ac00b900 unknown :-1 s=CLOSED pgs=2973 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:34.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.027+0000 7f15c7a31700 1 -- 172.21.15.80:0/308152033 shutdown_connections 2019-11-28T12:01:34.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.027+0000 7f15c7a31700 1 -- 172.21.15.80:0/308152033 wait complete. 2019-11-28T12:01:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.027+0000 7f15c7a31700 1 -- 172.21.15.80:0/308152033 >> 172.21.15.80:0/308152033 conn(0x7f15c0061cf0 msgr2=0x7f15c0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.030+0000 7f15c7a31700 1 Processor -- start 2019-11-28T12:01:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.030+0000 7f15c7a31700 1 -- start start 2019-11-28T12:01:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c7a31700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f15c0074d00 0x7f15c00750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c7a31700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15c0152bd0 0x7f15c0140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c7a31700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15c0153040 0x7f15c0140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:34.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c7a31700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c007ab30 con 0x7f15c0152bd0 2019-11-28T12:01:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c7a31700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c007ae00 con 0x7f15c0074d00 2019-11-28T12:01:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c7a31700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c0079e30 con 0x7f15c0153040 2019-11-28T12:01:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c57cd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15c0152bd0 0x7f15c0140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c57cd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f15c0152bd0 0x7f15c0140440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47540/0 (socket says 172.21.15.80:47540) 2019-11-28T12:01:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c57cd700 1 -- 172.21.15.80:0/2914458135 learned_addr learned my addr 172.21.15.80:0/2914458135 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c5fce700 1 --2- 172.21.15.80:0/2914458135 >> v2:172.21.15.174:3300/0 conn(0x7f15c0074d00 0x7f15c00750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:34.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c57cd700 1 -- 172.21.15.80:0/2914458135 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15c0153040 msgr2=0x7f15c0140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c67cf700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15c0153040 0x7f15c0140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c57cd700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15c0153040 0x7f15c0140980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c57cd700 1 -- 172.21.15.80:0/2914458135 >> v2:172.21.15.174:3300/0 conn(0x7f15c0074d00 msgr2=0x7f15c00750f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c57cd700 1 --2- 172.21.15.80:0/2914458135 >> v2:172.21.15.174:3300/0 conn(0x7f15c0074d00 0x7f15c00750f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c57cd700 1 -- 172.21.15.80:0/2914458135 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c007b490 con 0x7f15c0152bd0 2019-11-28T12:01:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c57cd700 1 --2- 172.21.15.80:0/2914458135 >> v2:172.21.15.80:3300/0 conn(0x7f15c0152bd0 0x7f15c0140440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15b00103a0 tx=0x7f15b00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c57cd700 1 --2- 172.21.15.80:0/2914458135 >> v2:172.21.15.80:3300/0 conn(0x7f15c0152bd0 0x7f15c0140440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15b00103a0 tx=0x7f15b00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.031+0000 7f15c57cd700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15c0152bd0 0x7f15c0140440 secure :-1 s=READY pgs=2974 cs=0 l=1 rx=0x7f15b00103a0 tx=0x7f15b00102a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.032+0000 7f15c57cd700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15c0152bd0 0x7f15c0140440 secure :-1 s=THROTTLE_DONE pgs=2974 cs=0 l=1 rx=0x7f15b00103a0 tx=0x7f15b00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.032+0000 7f15c57cd700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15c0152bd0 0x7f15c0140440 secure :-1 s=THROTTLE_DONE pgs=2974 cs=0 l=1 rx=0x7f15b00103a0 tx=0x7f15b00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.032+0000 7f15c57cd700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15c0152bd0 0x7f15c0140440 secure :-1 s=THROTTLE_DONE pgs=2974 cs=0 l=1 rx=0x7f15b00103a0 tx=0x7f15b00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.032+0000 7f15be7fc700 1 -- 172.21.15.80:0/2914458135 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b0009960 con 0x7f15c0152bd0 2019-11-28T12:01:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.032+0000 7f15be7fc700 1 -- 172.21.15.80:0/2914458135 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b0000940 con 0x7f15c0152bd0 2019-11-28T12:01:34.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.032+0000 7f15c7a31700 1 -- 172.21.15.80:0/2914458135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c007b810 con 0x7f15c0152bd0 2019-11-28T12:01:34.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.032+0000 7f15be7fc700 1 -- 172.21.15.80:0/2914458135 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b0009f40 con 0x7f15c0152bd0 2019-11-28T12:01:34.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.032+0000 7f15c7a31700 1 -- 172.21.15.80:0/2914458135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c007b490 con 0x7f15c0152bd0 2019-11-28T12:01:34.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.032+0000 7f15c57cd700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15c0152bd0 0x7f15c0140440 secure :-1 s=THROTTLE_DONE pgs=2974 cs=0 l=1 rx=0x7f15b00103a0 tx=0x7f15b00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.032+0000 7f15be7fc700 1 -- 172.21.15.80:0/2914458135 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f15b0009580 con 0x7f15c0152bd0 2019-11-28T12:01:34.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.032+0000 7f15c57cd700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15c0152bd0 0x7f15c0140440 secure :-1 s=THROTTLE_DONE pgs=2974 cs=0 l=1 rx=0x7f15b00103a0 tx=0x7f15b00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.032+0000 7f15be7fc700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15a4018730 0x7f15a401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:34.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.032+0000 7f15be7fc700 1 -- 172.21.15.80:0/2914458135 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(227..227 src has 1..227) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f15b0031ca0 con 0x7f15c0152bd0 2019-11-28T12:01:34.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.033+0000 7f15c5fce700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15a4018730 0x7f15a401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:34.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.033+0000 7f15c5fce700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15a4018730 0x7f15a401abe0 crc :-1 s=READY pgs=1229 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:34.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.039+0000 7f15c7a31700 1 -- 172.21.15.80:0/2914458135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c007b810 con 0x7f15c0152bd0 2019-11-28T12:01:34.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.043+0000 7f15c57cd700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15c0152bd0 0x7f15c0140440 secure :-1 s=THROTTLE_DONE pgs=2974 cs=0 l=1 rx=0x7f15b00103a0 tx=0x7f15b00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.043+0000 7f15be7fc700 1 -- 172.21.15.80:0/2914458135 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f15b0000940 con 0x7f15c0152bd0 2019-11-28T12:01:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.215+0000 7f15c7a31700 1 -- 172.21.15.80:0/2914458135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15c007b490 con 0x7f15c0152bd0 2019-11-28T12:01:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.215+0000 7f15c57cd700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15c0152bd0 0x7f15c0140440 secure :-1 s=THROTTLE_DONE pgs=2974 cs=0 l=1 rx=0x7f15b00103a0 tx=0x7f15b00102a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.215+0000 7f15be7fc700 1 -- 172.21.15.80:0/2914458135 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 188 v188) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f15b0000940 con 0x7f15c0152bd0 2019-11-28T12:01:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 188 2019-11-28T12:01:34.212 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:34.212 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":188,"default_fscid":18,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":188,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T11:58:24.286894+0000","modified":"2019-11-28T12:01:33.844161+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":226,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[37],"metadata_pool":36,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":18}]} 2019-11-28T12:01:34.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.218+0000 7f15c7a31700 1 -- 172.21.15.80:0/2914458135 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15a4018730 msgr2=0x7f15a401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:34.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.218+0000 7f15c7a31700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15a4018730 0x7f15a401abe0 crc :-1 s=READY pgs=1229 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:34.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.218+0000 7f15c7a31700 1 -- 172.21.15.80:0/2914458135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15c0152bd0 msgr2=0x7f15c0140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:34.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.218+0000 7f15c7a31700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15c0152bd0 0x7f15c0140440 secure :-1 s=READY pgs=2974 cs=0 l=1 rx=0x7f15b00103a0 tx=0x7f15b00102a0).stop 2019-11-28T12:01:34.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.218+0000 7f15c7a31700 1 -- 172.21.15.80:0/2914458135 shutdown_connections 2019-11-28T12:01:34.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.218+0000 7f15c7a31700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f15a4018730 0x7f15a401abe0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:34.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.218+0000 7f15c7a31700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15c0153040 0x7f15c0140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:34.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.218+0000 7f15c7a31700 1 --2- 172.21.15.80:0/2914458135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f15c0152bd0 0x7f15c0140440 unknown :-1 s=CLOSED pgs=2974 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:34.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.218+0000 7f15c7a31700 1 --2- 172.21.15.80:0/2914458135 >> v2:172.21.15.174:3300/0 conn(0x7f15c0074d00 0x7f15c00750f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:34.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.218+0000 7f15c7a31700 1 -- 172.21.15.80:0/2914458135 shutdown_connections 2019-11-28T12:01:34.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.218+0000 7f15c7a31700 1 -- 172.21.15.80:0/2914458135 wait complete. 2019-11-28T12:01:34.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.218+0000 7f15c7a31700 1 -- 172.21.15.80:0/2914458135 >> 172.21.15.80:0/2914458135 conn(0x7f15c013fa50 msgr2=0x7f15c007c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:34.223 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T12:01:34.352 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.353+0000 7f53b5d27700 1 Processor -- start 2019-11-28T12:01:34.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.353+0000 7f53b5d27700 1 -- start start 2019-11-28T12:01:34.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.354+0000 7f53b5d27700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f53b006c0a0 0x7f53b0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:34.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.354+0000 7f53b5d27700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53b00734e0 0x7f53b0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:34.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.354+0000 7f53b5d27700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b0072360 0x7f53b0072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:34.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.354+0000 7f53b5d27700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b006fd60 con 0x7f53b00734e0 2019-11-28T12:01:34.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.354+0000 7f53b5d27700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b0070030 con 0x7f53b006c0a0 2019-11-28T12:01:34.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.354+0000 7f53b5d27700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b006f330 con 0x7f53b0072360 2019-11-28T12:01:34.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.354+0000 7f53a7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53b00734e0 0x7f53b0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:34.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.354+0000 7f53a7fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f53b00734e0 0x7f53b0071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47552/0 (socket says 172.21.15.80:47552) 2019-11-28T12:01:34.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.354+0000 7f53a7fff700 1 -- 172.21.15.80:0/890881581 learned_addr learned my addr 172.21.15.80:0/890881581 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:34.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.354+0000 7f53affff700 1 --2- 172.21.15.80:0/890881581 >> v2:172.21.15.174:3300/0 conn(0x7f53b006c0a0 0x7f53b0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:34.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.354+0000 7f53b4ac5700 1 --2- 172.21.15.80:0/890881581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b0072360 0x7f53b0072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:34.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.355+0000 7f53a7fff700 1 -- 172.21.15.80:0/890881581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b0072360 msgr2=0x7f53b0072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:34.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.355+0000 7f53a7fff700 1 --2- 172.21.15.80:0/890881581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b0072360 0x7f53b0072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:34.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.355+0000 7f53a7fff700 1 -- 172.21.15.80:0/890881581 >> v2:172.21.15.174:3300/0 conn(0x7f53b006c0a0 msgr2=0x7f53b0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:34.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.355+0000 7f53a7fff700 1 --2- 172.21.15.80:0/890881581 >> v2:172.21.15.174:3300/0 conn(0x7f53b006c0a0 0x7f53b0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:34.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.355+0000 7f53a7fff700 1 -- 172.21.15.80:0/890881581 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b00706c0 con 0x7f53b00734e0 2019-11-28T12:01:34.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.355+0000 7f53a7fff700 1 --2- 172.21.15.80:0/890881581 >> v2:172.21.15.80:3300/0 conn(0x7f53b00734e0 0x7f53b0071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f539800f6c0 tx=0x7f539800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.355+0000 7f53a7fff700 1 --2- 172.21.15.80:0/890881581 >> v2:172.21.15.80:3300/0 conn(0x7f53b00734e0 0x7f53b0071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f539800f6c0 tx=0x7f539800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.355+0000 7f53a7fff700 1 --2- 172.21.15.80:0/890881581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53b00734e0 0x7f53b0071e20 secure :-1 s=READY pgs=2975 cs=0 l=1 rx=0x7f539800f6c0 tx=0x7f539800f570).ready entity=mon.0 client_cookie=62d99a59ece6254 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:34.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.355+0000 7f53a7fff700 1 --2- 172.21.15.80:0/890881581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53b00734e0 0x7f53b0071e20 secure :-1 s=THROTTLE_DONE pgs=2975 cs=0 l=1 rx=0x7f539800f6c0 tx=0x7f539800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.355+0000 7f53a7fff700 1 --2- 172.21.15.80:0/890881581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53b00734e0 0x7f53b0071e20 secure :-1 s=THROTTLE_DONE pgs=2975 cs=0 l=1 rx=0x7f539800f6c0 tx=0x7f539800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.355+0000 7f53af7fe700 1 -- 172.21.15.80:0/890881581 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5398000960 con 0x7f53b00734e0 2019-11-28T12:01:34.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.355+0000 7f53a7fff700 1 --2- 172.21.15.80:0/890881581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53b00734e0 0x7f53b0071e20 secure :-1 s=THROTTLE_DONE pgs=2975 cs=0 l=1 rx=0x7f539800f6c0 tx=0x7f539800f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.355+0000 7f53af7fe700 1 -- 172.21.15.80:0/890881581 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5398000c90 con 0x7f53b00734e0 2019-11-28T12:01:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.355+0000 7f53af7fe700 1 -- 172.21.15.80:0/890881581 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53980013a0 con 0x7f53b00734e0 2019-11-28T12:01:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.355+0000 7f53b5d27700 1 -- 172.21.15.80:0/890881581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53b00734e0 msgr2=0x7f53b0071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.355+0000 7f53b5d27700 1 --2- 172.21.15.80:0/890881581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53b00734e0 0x7f53b0071e20 secure :-1 s=READY pgs=2975 cs=0 l=1 rx=0x7f539800f6c0 tx=0x7f539800f570).stop 2019-11-28T12:01:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.356+0000 7f53b5d27700 1 -- 172.21.15.80:0/890881581 shutdown_connections 2019-11-28T12:01:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.356+0000 7f53b5d27700 1 --2- 172.21.15.80:0/890881581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b0072360 0x7f53b0072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.356+0000 7f53b5d27700 1 --2- 172.21.15.80:0/890881581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53b00734e0 0x7f53b0071e20 unknown :-1 s=CLOSED pgs=2975 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:34.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.356+0000 7f53b5d27700 1 --2- 172.21.15.80:0/890881581 >> v2:172.21.15.174:3300/0 conn(0x7f53b006c0a0 0x7f53b0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:34.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.356+0000 7f53b5d27700 1 -- 172.21.15.80:0/890881581 shutdown_connections 2019-11-28T12:01:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.356+0000 7f53b5d27700 1 -- 172.21.15.80:0/890881581 wait complete. 2019-11-28T12:01:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.356+0000 7f53b5d27700 1 -- 172.21.15.80:0/890881581 >> 172.21.15.80:0/890881581 conn(0x7f53b0061cf0 msgr2=0x7f53b0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.358+0000 7f53b5d27700 1 Processor -- start 2019-11-28T12:01:34.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.358+0000 7f53b5d27700 1 -- start start 2019-11-28T12:01:34.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.359+0000 7f53b5d27700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b01098d0 0x7f53b0109d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:34.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.359+0000 7f53b5d27700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f53b010a2a0 0x7f53b0168ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:34.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.359+0000 7f53b5d27700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b0139e00 con 0x7f53b012a6b0 2019-11-28T12:01:34.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.359+0000 7f53b5d27700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b0107b00 con 0x7f53b010a2a0 2019-11-28T12:01:34.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.359+0000 7f53b5d27700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b013b350 con 0x7f53b01098d0 2019-11-28T12:01:34.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.359+0000 7f53b4ac5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f53b010a2a0 0x7f53b0168ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:34.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.359+0000 7f53a7fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b01098d0 0x7f53b0109d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.359+0000 7f53b4ac5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f53b010a2a0 0x7f53b0168ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:34212/0 (socket says 172.21.15.80:34212) 2019-11-28T12:01:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.359+0000 7f53b4ac5700 1 -- 172.21.15.80:0/1058864856 learned_addr learned my addr 172.21.15.80:0/1058864856 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53a7fff700 1 -- 172.21.15.80:0/1058864856 >> v2:172.21.15.174:3300/0 conn(0x7f53b010a2a0 msgr2=0x7f53b0168ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53a7fff700 1 --2- 172.21.15.80:0/1058864856 >> v2:172.21.15.174:3300/0 conn(0x7f53b010a2a0 0x7f53b0168ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53a7fff700 1 -- 172.21.15.80:0/1058864856 >> v1:172.21.15.174:6789/0 conn(0x7f53b012a6b0 legacy=0x7f53b012b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:34.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53a7fff700 1 -- 172.21.15.80:0/1058864856 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b0108190 con 0x7f53b01098d0 2019-11-28T12:01:34.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53ad7fa700 1 -- 172.21.15.80:0/1058864856 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448898469 0 0) 0x7f53a0000ea0 con 0x7f53b012a6b0 2019-11-28T12:01:34.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53b4ac5700 1 --2- 172.21.15.80:0/1058864856 >> v2:172.21.15.174:3300/0 conn(0x7f53b010a2a0 0x7f53b0168ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:34.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53a7fff700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b01098d0 0x7f53b0109d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5398010380 tx=0x7f5398010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53a7fff700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b01098d0 0x7f53b0109d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5398010380 tx=0x7f5398010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53a7fff700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b01098d0 0x7f53b0109d60 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7f5398010380 tx=0x7f5398010720).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:34.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53a7fff700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b01098d0 0x7f53b0109d60 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7f5398010380 tx=0x7f5398010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53ad7fa700 1 -- 172.21.15.80:0/1058864856 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5398007a60 con 0x7f53b01098d0 2019-11-28T12:01:34.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53a7fff700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b01098d0 0x7f53b0109d60 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7f5398010380 tx=0x7f5398010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53b5d27700 1 -- 172.21.15.80:0/1058864856 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b0108510 con 0x7f53b01098d0 2019-11-28T12:01:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53a7fff700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b01098d0 0x7f53b0109d60 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7f5398010380 tx=0x7f5398010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53ad7fa700 1 -- 172.21.15.80:0/1058864856 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5398007a60 con 0x7f53b01098d0 2019-11-28T12:01:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53ad7fa700 1 -- 172.21.15.80:0/1058864856 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5398001030 con 0x7f53b01098d0 2019-11-28T12:01:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53b5d27700 1 -- 172.21.15.80:0/1058864856 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b010a710 con 0x7f53b01098d0 2019-11-28T12:01:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.360+0000 7f53a7fff700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b01098d0 0x7f53b0109d60 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7f5398010380 tx=0x7f5398010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.361+0000 7f53ad7fa700 1 -- 172.21.15.80:0/1058864856 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5398000c50 con 0x7f53b01098d0 2019-11-28T12:01:34.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.361+0000 7f53a7fff700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b01098d0 0x7f53b0109d60 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7f5398010380 tx=0x7f5398010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.361+0000 7f53ad7fa700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5394018730 0x7f539401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:34.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.361+0000 7f53ad7fa700 1 -- 172.21.15.80:0/1058864856 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(227..227 src has 1..227) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f5398031a00 con 0x7f53b01098d0 2019-11-28T12:01:34.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.361+0000 7f53affff700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5394018730 0x7f539401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:34.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.361+0000 7f53affff700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5394018730 0x7f539401abc0 crc :-1 s=READY pgs=1230 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:34.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.368+0000 7f53b5d27700 1 -- 172.21.15.80:0/1058864856 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b0108190 con 0x7f53b01098d0 2019-11-28T12:01:34.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.372+0000 7f53a7fff700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b01098d0 0x7f53b0109d60 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7f5398010380 tx=0x7f5398010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.372+0000 7f53ad7fa700 1 -- 172.21.15.80:0/1058864856 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f53980009f0 con 0x7f53b01098d0 2019-11-28T12:01:34.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.544+0000 7f53b5d27700 1 -- 172.21.15.80:0/1058864856 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f53b0108510 con 0x7f53b01098d0 2019-11-28T12:01:34.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.856+0000 7f53a7fff700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b01098d0 0x7f53b0109d60 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7f5398010380 tx=0x7f5398010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:34.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.856+0000 7f53ad7fa700 1 -- 172.21.15.80:0/1058864856 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v189) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5398000c50 con 0x7f53b01098d0 2019-11-28T12:01:34.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.861+0000 7f53b5d27700 1 -- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5394018730 msgr2=0x7f539401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:34.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.861+0000 7f53b5d27700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5394018730 0x7f539401abc0 crc :-1 s=READY pgs=1230 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:34.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.861+0000 7f53b5d27700 1 -- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b01098d0 msgr2=0x7f53b0109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:34.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.861+0000 7f53b5d27700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b01098d0 0x7f53b0109d60 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7f5398010380 tx=0x7f5398010720).stop 2019-11-28T12:01:34.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.861+0000 7f53b5d27700 1 -- 172.21.15.80:0/1058864856 shutdown_connections 2019-11-28T12:01:34.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.861+0000 7f53b5d27700 1 --2- 172.21.15.80:0/1058864856 >> v2:172.21.15.174:3300/0 conn(0x7f53b010a2a0 0x7f53b0168ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:34.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.861+0000 7f53b5d27700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53b01098d0 0x7f53b0109d60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:34.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.861+0000 7f53b5d27700 1 --2- 172.21.15.80:0/1058864856 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5394018730 0x7f539401abc0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:34.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.861+0000 7f53b5d27700 1 -- 172.21.15.80:0/1058864856 shutdown_connections 2019-11-28T12:01:34.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.861+0000 7f53b5d27700 1 -- 172.21.15.80:0/1058864856 wait complete. 2019-11-28T12:01:34.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.861+0000 7f53b5d27700 1 -- 172.21.15.80:0/1058864856 >> 172.21.15.80:0/1058864856 conn(0x7f53b0127dc0 msgr2=0x7f53b0141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:34.866 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T12:01:34.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.995+0000 7f6bdf686700 1 Processor -- start 2019-11-28T12:01:34.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.995+0000 7f6bdf686700 1 -- start start 2019-11-28T12:01:34.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.996+0000 7f6bdf686700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6bd815ed10 0x7f6bd815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:34.999 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.996+0000 7f6bdf686700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8073020 0x7f6bd8071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:35.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.996+0000 7f6bdf686700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd806db60 con 0x7f6bd80734b0 2019-11-28T12:01:35.000 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.996+0000 7f6bdf686700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd806fe00 con 0x7f6bd815ed10 2019-11-28T12:01:35.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.996+0000 7f6bdf686700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd80700d0 con 0x7f6bd8073020 2019-11-28T12:01:35.003 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.996+0000 7f6bddc23700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6bd815ed10 0x7f6bd815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:35.004 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bddc23700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6bd815ed10 0x7f6bd815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47562/0 (socket says 172.21.15.80:47562) 2019-11-28T12:01:35.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bddc23700 1 -- 172.21.15.80:0/3422169483 learned_addr learned my addr 172.21.15.80:0/3422169483 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:35.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bdd422700 1 --2- 172.21.15.80:0/3422169483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8073020 0x7f6bd8071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:35.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bddc23700 1 -- 172.21.15.80:0/3422169483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8073020 msgr2=0x7f6bd8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:35.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bddc23700 1 --2- 172.21.15.80:0/3422169483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8073020 0x7f6bd8071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:35.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bddc23700 1 -- 172.21.15.80:0/3422169483 >> v1:172.21.15.174:6789/0 conn(0x7f6bd80734b0 legacy=0x7f6bd80723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:35.005 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bddc23700 1 -- 172.21.15.80:0/3422169483 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd8070760 con 0x7f6bd815ed10 2019-11-28T12:01:35.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bdd422700 1 --2- 172.21.15.80:0/3422169483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8073020 0x7f6bd8071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T12:01:35.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bddc23700 1 --2- 172.21.15.80:0/3422169483 >> v2:172.21.15.80:3300/0 conn(0x7f6bd815ed10 0x7f6bd815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6bc000fac0 tx=0x7f6bc000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:35.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bddc23700 1 --2- 172.21.15.80:0/3422169483 >> v2:172.21.15.80:3300/0 conn(0x7f6bd815ed10 0x7f6bd815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6bc000fac0 tx=0x7f6bc000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:35.006 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bddc23700 1 --2- 172.21.15.80:0/3422169483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd815ed10 0x7f6bd815f100 secure :-1 s=READY pgs=2976 cs=0 l=1 rx=0x7f6bc000fac0 tx=0x7f6bc000fe60).ready entity=mon.0 client_cookie=b5ff4f7441785d0d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:35.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bddc23700 1 --2- 172.21.15.80:0/3422169483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd815ed10 0x7f6bd815f100 secure :-1 s=THROTTLE_DONE pgs=2976 cs=0 l=1 rx=0x7f6bc000fac0 tx=0x7f6bc000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:35.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bddc23700 1 --2- 172.21.15.80:0/3422169483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd815ed10 0x7f6bd815f100 secure :-1 s=THROTTLE_DONE pgs=2976 cs=0 l=1 rx=0x7f6bc000fac0 tx=0x7f6bc000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:35.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bdcc21700 1 -- 172.21.15.80:0/3422169483 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bc0000ce0 con 0x7f6bd815ed10 2019-11-28T12:01:35.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bddc23700 1 --2- 172.21.15.80:0/3422169483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd815ed10 0x7f6bd815f100 secure :-1 s=THROTTLE_DONE pgs=2976 cs=0 l=1 rx=0x7f6bc000fac0 tx=0x7f6bc000fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:35.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bdcc21700 1 -- 172.21.15.80:0/3422169483 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc0001010 con 0x7f6bd815ed10 2019-11-28T12:01:35.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bdcc21700 1 -- 172.21.15.80:0/3422169483 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bc0001720 con 0x7f6bd815ed10 2019-11-28T12:01:35.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bdf686700 1 -- 172.21.15.80:0/3422169483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd815ed10 msgr2=0x7f6bd815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:35.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.997+0000 7f6bdf686700 1 --2- 172.21.15.80:0/3422169483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd815ed10 0x7f6bd815f100 secure :-1 s=READY pgs=2976 cs=0 l=1 rx=0x7f6bc000fac0 tx=0x7f6bc000fe60).stop 2019-11-28T12:01:35.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.998+0000 7f6bdf686700 1 -- 172.21.15.80:0/3422169483 shutdown_connections 2019-11-28T12:01:35.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.998+0000 7f6bdf686700 1 --2- 172.21.15.80:0/3422169483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8073020 0x7f6bd8071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:35.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.998+0000 7f6bdf686700 1 --2- 172.21.15.80:0/3422169483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd815ed10 0x7f6bd815f100 unknown :-1 s=CLOSED pgs=2976 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:35.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.998+0000 7f6bdf686700 1 -- 172.21.15.80:0/3422169483 shutdown_connections 2019-11-28T12:01:35.008 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.998+0000 7f6bdf686700 1 -- 172.21.15.80:0/3422169483 wait complete. 2019-11-28T12:01:35.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:34.998+0000 7f6bdf686700 1 -- 172.21.15.80:0/3422169483 >> 172.21.15.80:0/3422169483 conn(0x7f6bd8061d20 msgr2=0x7f6bd80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:35.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.000+0000 7f6bdf686700 1 Processor -- start 2019-11-28T12:01:35.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.000+0000 7f6bdf686700 1 -- start start 2019-11-28T12:01:35.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.001+0000 7f6bdf686700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8148320 0x7f6bd810ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:35.009 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.001+0000 7f6bdf686700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6bd810e3d0 0x7f6bd8168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:35.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.001+0000 7f6bdf686700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd8148e00 con 0x7f6bd810f290 2019-11-28T12:01:35.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.001+0000 7f6bdf686700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd8139ff0 con 0x7f6bd810e3d0 2019-11-28T12:01:35.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.001+0000 7f6bdf686700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd813aa20 con 0x7f6bd8148320 2019-11-28T12:01:35.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.001+0000 7f6bdd422700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6bd810f290 0x7f6bd810dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46886/0 (socket says 172.21.15.80:46886) 2019-11-28T12:01:35.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.001+0000 7f6bdd422700 1 -- 172.21.15.80:0/521821698 learned_addr learned my addr 172.21.15.80:0/521821698 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:35.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bddc23700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8148320 0x7f6bd810ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:35.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bde424700 1 --2- 172.21.15.80:0/521821698 >> v2:172.21.15.174:3300/0 conn(0x7f6bd810e3d0 0x7f6bd8168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:35.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bd67fc700 1 -- 172.21.15.80:0/521821698 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560719055 0 0) 0x7f6bc8000ea0 con 0x7f6bd810f290 2019-11-28T12:01:35.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bd67fc700 1 -- 172.21.15.80:0/521821698 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bbc002e80 con 0x7f6bd810f290 2019-11-28T12:01:35.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bd67fc700 1 -- 172.21.15.80:0/521821698 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3452610051 0 0) 0x7f6bc8000940 con 0x7f6bd810f290 2019-11-28T12:01:35.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bddc23700 1 -- 172.21.15.80:0/521821698 >> v2:172.21.15.174:3300/0 conn(0x7f6bd810e3d0 msgr2=0x7f6bd8168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:35.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bddc23700 1 --2- 172.21.15.80:0/521821698 >> v2:172.21.15.174:3300/0 conn(0x7f6bd810e3d0 0x7f6bd8168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:35.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bddc23700 1 -- 172.21.15.80:0/521821698 >> v1:172.21.15.80:6789/0 conn(0x7f6bd810f290 legacy=0x7f6bd810dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:35.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bddc23700 1 -- 172.21.15.80:0/521821698 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd810c490 con 0x7f6bd8148320 2019-11-28T12:01:35.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bde424700 1 --2- 172.21.15.80:0/521821698 >> v2:172.21.15.174:3300/0 conn(0x7f6bd810e3d0 0x7f6bd8168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:35.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bddc23700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8148320 0x7f6bd810ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6bc0010720 tx=0x7f6bc0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:35.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bddc23700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8148320 0x7f6bd810ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6bc0010720 tx=0x7f6bc0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:35.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bddc23700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8148320 0x7f6bd810ed50 secure :-1 s=READY pgs=429 cs=0 l=1 rx=0x7f6bc0010720 tx=0x7f6bc0010ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:35.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bddc23700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8148320 0x7f6bd810ed50 secure :-1 s=THROTTLE_DONE pgs=429 cs=0 l=1 rx=0x7f6bc0010720 tx=0x7f6bc0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:35.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bd67fc700 1 -- 172.21.15.80:0/521821698 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bc0000cc0 con 0x7f6bd8148320 2019-11-28T12:01:35.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bddc23700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8148320 0x7f6bd810ed50 secure :-1 s=THROTTLE_DONE pgs=429 cs=0 l=1 rx=0x7f6bc0010720 tx=0x7f6bc0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:35.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bd67fc700 1 -- 172.21.15.80:0/521821698 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc00012d0 con 0x7f6bd8148320 2019-11-28T12:01:35.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bddc23700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8148320 0x7f6bd810ed50 secure :-1 s=THROTTLE_DONE pgs=429 cs=0 l=1 rx=0x7f6bc0010720 tx=0x7f6bc0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:35.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bdf686700 1 -- 172.21.15.80:0/521821698 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd810c810 con 0x7f6bd8148320 2019-11-28T12:01:35.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bd67fc700 1 -- 172.21.15.80:0/521821698 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bc00014c0 con 0x7f6bd8148320 2019-11-28T12:01:35.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.002+0000 7f6bdf686700 1 -- 172.21.15.80:0/521821698 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd810c490 con 0x7f6bd8148320 2019-11-28T12:01:35.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.003+0000 7f6bddc23700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8148320 0x7f6bd810ed50 secure :-1 s=THROTTLE_DONE pgs=429 cs=0 l=1 rx=0x7f6bc0010720 tx=0x7f6bc0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:35.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.003+0000 7f6bd67fc700 1 -- 172.21.15.80:0/521821698 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6bc0000cc0 con 0x7f6bd8148320 2019-11-28T12:01:35.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.003+0000 7f6bddc23700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8148320 0x7f6bd810ed50 secure :-1 s=THROTTLE_DONE pgs=429 cs=0 l=1 rx=0x7f6bc0010720 tx=0x7f6bc0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:35.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.003+0000 7f6bd67fc700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bbc018780 0x7f6bbc01ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:35.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.003+0000 7f6bd67fc700 1 -- 172.21.15.80:0/521821698 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(227..227 src has 1..227) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f6bc0031ee0 con 0x7f6bd8148320 2019-11-28T12:01:35.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.003+0000 7f6bdd422700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bbc018780 0x7f6bbc01ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:35.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.003+0000 7f6bdd422700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bbc018780 0x7f6bbc01ac10 crc :-1 s=READY pgs=1231 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:35.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.011+0000 7f6bdf686700 1 -- 172.21.15.80:0/521821698 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd810c810 con 0x7f6bd8148320 2019-11-28T12:01:35.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.015+0000 7f6bddc23700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8148320 0x7f6bd810ed50 secure :-1 s=THROTTLE_DONE pgs=429 cs=0 l=1 rx=0x7f6bc0010720 tx=0x7f6bc0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:35.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.015+0000 7f6bd67fc700 1 -- 172.21.15.80:0/521821698 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6bc0000cc0 con 0x7f6bd8148320 2019-11-28T12:01:35.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.183+0000 7f6bdf686700 1 -- 172.21.15.80:0/521821698 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6bd810c490 con 0x7f6bd8148320 2019-11-28T12:01:35.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.860+0000 7f6bddc23700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8148320 0x7f6bd810ed50 secure :-1 s=THROTTLE_DONE pgs=429 cs=0 l=1 rx=0x7f6bc0010720 tx=0x7f6bc0010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:35.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.860+0000 7f6bd67fc700 1 -- 172.21.15.80:0/521821698 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v228) v1 ==== 185+0+0 (secure 0 0 0) 0x7f6bc0017a50 con 0x7f6bd8148320 2019-11-28T12:01:35.892 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T12:01:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.900+0000 7f6bdf686700 1 -- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bbc018780 msgr2=0x7f6bbc01ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.900+0000 7f6bdf686700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bbc018780 0x7f6bbc01ac10 crc :-1 s=READY pgs=1231 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.900+0000 7f6bdf686700 1 -- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8148320 msgr2=0x7f6bd810ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.900+0000 7f6bdf686700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8148320 0x7f6bd810ed50 secure :-1 s=READY pgs=429 cs=0 l=1 rx=0x7f6bc0010720 tx=0x7f6bc0010ac0).stop 2019-11-28T12:01:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.901+0000 7f6bdf686700 1 -- 172.21.15.80:0/521821698 shutdown_connections 2019-11-28T12:01:35.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.901+0000 7f6bdf686700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6bbc018780 0x7f6bbc01ac10 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:35.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.901+0000 7f6bdf686700 1 --2- 172.21.15.80:0/521821698 >> v2:172.21.15.174:3300/0 conn(0x7f6bd810e3d0 0x7f6bd8168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:35.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.901+0000 7f6bdf686700 1 --2- 172.21.15.80:0/521821698 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8148320 0x7f6bd810ed50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:35.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.901+0000 7f6bdf686700 1 -- 172.21.15.80:0/521821698 shutdown_connections 2019-11-28T12:01:35.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.901+0000 7f6bdf686700 1 -- 172.21.15.80:0/521821698 wait complete. 2019-11-28T12:01:35.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:35.901+0000 7f6bdf686700 1 -- 172.21.15.80:0/521821698 >> 172.21.15.80:0/521821698 conn(0x7f6bd815e2d0 msgr2=0x7f6bd8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:35.906 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T12:01:36.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.036+0000 7f6e70bda700 1 Processor -- start 2019-11-28T12:01:36.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.036+0000 7f6e70bda700 1 -- start start 2019-11-28T12:01:36.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.037+0000 7f6e70bda700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e6c15f100 0x7f6e6c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:36.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.037+0000 7f6e70bda700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6e6c06c2f0 0x7f6e6c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:36.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.037+0000 7f6e70bda700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e6c06db60 con 0x7f6e6c15ed10 2019-11-28T12:01:36.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.037+0000 7f6e70bda700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e6c06fe00 con 0x7f6e6c15f100 2019-11-28T12:01:36.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.037+0000 7f6e70bda700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e6c0700d0 con 0x7f6e6c06c2f0 2019-11-28T12:01:36.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.037+0000 7f6e6a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e6c15f100 0x7f6e6c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:36.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.037+0000 7f6e6a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e6c15f100 0x7f6e6c06bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47580/0 (socket says 172.21.15.80:47580) 2019-11-28T12:01:36.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.037+0000 7f6e6a59c700 1 -- 172.21.15.80:0/1059416350 learned_addr learned my addr 172.21.15.80:0/1059416350 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:36.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.037+0000 7f6e6b59e700 1 --2- 172.21.15.80:0/1059416350 >> v2:172.21.15.174:3300/0 conn(0x7f6e6c06c2f0 0x7f6e6c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:36.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.038+0000 7f6e6a59c700 1 -- 172.21.15.80:0/1059416350 >> v2:172.21.15.174:3300/0 conn(0x7f6e6c06c2f0 msgr2=0x7f6e6c06c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:36.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.038+0000 7f6e6a59c700 1 --2- 172.21.15.80:0/1059416350 >> v2:172.21.15.174:3300/0 conn(0x7f6e6c06c2f0 0x7f6e6c06c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:36.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.038+0000 7f6e6a59c700 1 -- 172.21.15.80:0/1059416350 >> v1:172.21.15.174:6789/0 conn(0x7f6e6c15ed10 legacy=0x7f6e6c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:36.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.038+0000 7f6e6a59c700 1 -- 172.21.15.80:0/1059416350 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c070760 con 0x7f6e6c15f100 2019-11-28T12:01:36.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.038+0000 7f6e6b59e700 1 --2- 172.21.15.80:0/1059416350 >> v2:172.21.15.174:3300/0 conn(0x7f6e6c06c2f0 0x7f6e6c06c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T12:01:36.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.038+0000 7f6e6a59c700 1 --2- 172.21.15.80:0/1059416350 >> v2:172.21.15.80:3300/0 conn(0x7f6e6c15f100 0x7f6e6c06bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6e5400f740 tx=0x7f6e5400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:36.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.038+0000 7f6e6a59c700 1 --2- 172.21.15.80:0/1059416350 >> v2:172.21.15.80:3300/0 conn(0x7f6e6c15f100 0x7f6e6c06bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6e5400f740 tx=0x7f6e5400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:36.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.038+0000 7f6e6a59c700 1 --2- 172.21.15.80:0/1059416350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c15f100 0x7f6e6c06bdb0 secure :-1 s=READY pgs=2978 cs=0 l=1 rx=0x7f6e5400f740 tx=0x7f6e5400fae0).ready entity=mon.0 client_cookie=abd4f198a3319d07 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:36.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.038+0000 7f6e6a59c700 1 --2- 172.21.15.80:0/1059416350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c15f100 0x7f6e6c06bdb0 secure :-1 s=THROTTLE_DONE pgs=2978 cs=0 l=1 rx=0x7f6e5400f740 tx=0x7f6e5400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:36.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.038+0000 7f6e6a59c700 1 --2- 172.21.15.80:0/1059416350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c15f100 0x7f6e6c06bdb0 secure :-1 s=THROTTLE_DONE pgs=2978 cs=0 l=1 rx=0x7f6e5400f740 tx=0x7f6e5400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:36.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.038+0000 7f6e6a59c700 1 --2- 172.21.15.80:0/1059416350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c15f100 0x7f6e6c06bdb0 secure :-1 s=THROTTLE_DONE pgs=2978 cs=0 l=1 rx=0x7f6e5400f740 tx=0x7f6e5400fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:36.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.038+0000 7f6e69d9b700 1 -- 172.21.15.80:0/1059416350 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e54000960 con 0x7f6e6c15f100 2019-11-28T12:01:36.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.038+0000 7f6e69d9b700 1 -- 172.21.15.80:0/1059416350 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e54000c90 con 0x7f6e6c15f100 2019-11-28T12:01:36.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.038+0000 7f6e69d9b700 1 -- 172.21.15.80:0/1059416350 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e540013a0 con 0x7f6e6c15f100 2019-11-28T12:01:36.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.038+0000 7f6e70bda700 1 -- 172.21.15.80:0/1059416350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c15f100 msgr2=0x7f6e6c06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:36.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.038+0000 7f6e70bda700 1 --2- 172.21.15.80:0/1059416350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c15f100 0x7f6e6c06bdb0 secure :-1 s=READY pgs=2978 cs=0 l=1 rx=0x7f6e5400f740 tx=0x7f6e5400fae0).stop 2019-11-28T12:01:36.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.039+0000 7f6e70bda700 1 -- 172.21.15.80:0/1059416350 shutdown_connections 2019-11-28T12:01:36.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.039+0000 7f6e70bda700 1 --2- 172.21.15.80:0/1059416350 >> v2:172.21.15.174:3300/0 conn(0x7f6e6c06c2f0 0x7f6e6c06c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:36.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.039+0000 7f6e70bda700 1 --2- 172.21.15.80:0/1059416350 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c15f100 0x7f6e6c06bdb0 unknown :-1 s=CLOSED pgs=2978 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:36.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.039+0000 7f6e70bda700 1 -- 172.21.15.80:0/1059416350 shutdown_connections 2019-11-28T12:01:36.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.039+0000 7f6e70bda700 1 -- 172.21.15.80:0/1059416350 wait complete. 2019-11-28T12:01:36.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.039+0000 7f6e70bda700 1 -- 172.21.15.80:0/1059416350 >> 172.21.15.80:0/1059416350 conn(0x7f6e6c061d20 msgr2=0x7f6e6c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:36.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.041+0000 7f6e70bda700 1 Processor -- start 2019-11-28T12:01:36.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.041+0000 7f6e70bda700 1 -- start start 2019-11-28T12:01:36.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.042+0000 7f6e70bda700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6e6c10e970 0x7f6e6c1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:36.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.042+0000 7f6e70bda700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e6c107e30 0x7f6e6c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:36.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.042+0000 7f6e70bda700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e6c10c250 con 0x7f6e6c108cf0 2019-11-28T12:01:36.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.042+0000 7f6e70bda700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e6c10e430 con 0x7f6e6c107e30 2019-11-28T12:01:36.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.042+0000 7f6e70bda700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e6c105860 con 0x7f6e6c10e970 2019-11-28T12:01:36.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.042+0000 7f6e6b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e6c107e30 0x7f6e6c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:36.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.042+0000 7f6e6b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e6c107e30 0x7f6e6c167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47584/0 (socket says 172.21.15.80:47584) 2019-11-28T12:01:36.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.042+0000 7f6e6b59e700 1 -- 172.21.15.80:0/362447020 learned_addr learned my addr 172.21.15.80:0/362447020 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:36.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.042+0000 7f6e6ad9d700 1 --2- 172.21.15.80:0/362447020 >> v2:172.21.15.174:3300/0 conn(0x7f6e6c10e970 0x7f6e6c1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:36.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.042+0000 7f6e6b59e700 1 -- 172.21.15.80:0/362447020 >> v2:172.21.15.174:3300/0 conn(0x7f6e6c10e970 msgr2=0x7f6e6c1087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:36.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.042+0000 7f6e6b59e700 1 --2- 172.21.15.80:0/362447020 >> v2:172.21.15.174:3300/0 conn(0x7f6e6c10e970 0x7f6e6c1087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:36.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.042+0000 7f6e6b59e700 1 -- 172.21.15.80:0/362447020 >> v1:172.21.15.174:6789/0 conn(0x7f6e6c108cf0 legacy=0x7f6e6c107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:36.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.042+0000 7f6e6b59e700 1 -- 172.21.15.80:0/362447020 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c105ef0 con 0x7f6e6c107e30 2019-11-28T12:01:36.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.042+0000 7f6e6b59e700 1 --2- 172.21.15.80:0/362447020 >> v2:172.21.15.80:3300/0 conn(0x7f6e6c107e30 0x7f6e6c167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6e64010470 tx=0x7f6e6400b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:36.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.042+0000 7f6e6b59e700 1 --2- 172.21.15.80:0/362447020 >> v2:172.21.15.80:3300/0 conn(0x7f6e6c107e30 0x7f6e6c167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6e64010470 tx=0x7f6e6400b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:36.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.042+0000 7f6e6b59e700 1 --2- 172.21.15.80:0/362447020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c107e30 0x7f6e6c167d70 secure :-1 s=READY pgs=2979 cs=0 l=1 rx=0x7f6e64010470 tx=0x7f6e6400b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:36.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.043+0000 7f6e6b59e700 1 --2- 172.21.15.80:0/362447020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c107e30 0x7f6e6c167d70 secure :-1 s=THROTTLE_DONE pgs=2979 cs=0 l=1 rx=0x7f6e64010470 tx=0x7f6e6400b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:36.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.043+0000 7f6e6b59e700 1 --2- 172.21.15.80:0/362447020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c107e30 0x7f6e6c167d70 secure :-1 s=THROTTLE_DONE pgs=2979 cs=0 l=1 rx=0x7f6e64010470 tx=0x7f6e6400b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:36.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.043+0000 7f6e6b59e700 1 --2- 172.21.15.80:0/362447020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c107e30 0x7f6e6c167d70 secure :-1 s=THROTTLE_DONE pgs=2979 cs=0 l=1 rx=0x7f6e64010470 tx=0x7f6e6400b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:36.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.043+0000 7f6e637fe700 1 -- 172.21.15.80:0/362447020 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e64001460 con 0x7f6e6c107e30 2019-11-28T12:01:36.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.043+0000 7f6e637fe700 1 -- 172.21.15.80:0/362447020 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e64001080 con 0x7f6e6c107e30 2019-11-28T12:01:36.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.043+0000 7f6e70bda700 1 -- 172.21.15.80:0/362447020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6c106270 con 0x7f6e6c107e30 2019-11-28T12:01:36.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.043+0000 7f6e637fe700 1 -- 172.21.15.80:0/362447020 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e64001a40 con 0x7f6e6c107e30 2019-11-28T12:01:36.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.043+0000 7f6e70bda700 1 -- 172.21.15.80:0/362447020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6c105ef0 con 0x7f6e6c107e30 2019-11-28T12:01:36.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.043+0000 7f6e6b59e700 1 --2- 172.21.15.80:0/362447020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c107e30 0x7f6e6c167d70 secure :-1 s=THROTTLE_DONE pgs=2979 cs=0 l=1 rx=0x7f6e64010470 tx=0x7f6e6400b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:36.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.043+0000 7f6e637fe700 1 -- 172.21.15.80:0/362447020 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6e64001270 con 0x7f6e6c107e30 2019-11-28T12:01:36.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.043+0000 7f6e6b59e700 1 --2- 172.21.15.80:0/362447020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c107e30 0x7f6e6c167d70 secure :-1 s=THROTTLE_DONE pgs=2979 cs=0 l=1 rx=0x7f6e64010470 tx=0x7f6e6400b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:36.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.043+0000 7f6e637fe700 1 --2- 172.21.15.80:0/362447020 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e50018730 0x7f6e5001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:36.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.043+0000 7f6e637fe700 1 -- 172.21.15.80:0/362447020 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(228..228 src has 1..228) v4 ==== 5711+0+0 (secure 0 0 0) 0x7f6e64031b10 con 0x7f6e6c107e30 2019-11-28T12:01:36.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.044+0000 7f6e6ad9d700 1 --2- 172.21.15.80:0/362447020 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e50018730 0x7f6e5001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:36.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.044+0000 7f6e6ad9d700 1 --2- 172.21.15.80:0/362447020 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e50018730 0x7f6e5001abc0 crc :-1 s=READY pgs=1232 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:36.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.052+0000 7f6e70bda700 1 -- 172.21.15.80:0/362447020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6c106270 con 0x7f6e6c107e30 2019-11-28T12:01:36.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.055+0000 7f6e6b59e700 1 --2- 172.21.15.80:0/362447020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c107e30 0x7f6e6c167d70 secure :-1 s=THROTTLE_DONE pgs=2979 cs=0 l=1 rx=0x7f6e64010470 tx=0x7f6e6400b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:36.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.055+0000 7f6e637fe700 1 -- 172.21.15.80:0/362447020 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6e64000e70 con 0x7f6e6c107e30 2019-11-28T12:01:36.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.221+0000 7f6e70bda700 1 -- 172.21.15.80:0/362447020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6e6c105ef0 con 0x7f6e6c107e30 2019-11-28T12:01:36.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.868+0000 7f6e6b59e700 1 --2- 172.21.15.80:0/362447020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c107e30 0x7f6e6c167d70 secure :-1 s=THROTTLE_DONE pgs=2979 cs=0 l=1 rx=0x7f6e64010470 tx=0x7f6e6400b3b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:36.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.868+0000 7f6e637fe700 1 -- 172.21.15.80:0/362447020 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v229) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6e640174c0 con 0x7f6e6c107e30 2019-11-28T12:01:36.880 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T12:01:36.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.888+0000 7f6e70bda700 1 -- 172.21.15.80:0/362447020 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e50018730 msgr2=0x7f6e5001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:36.882 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.888+0000 7f6e70bda700 1 --2- 172.21.15.80:0/362447020 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e50018730 0x7f6e5001abc0 crc :-1 s=READY pgs=1232 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:36.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.888+0000 7f6e70bda700 1 -- 172.21.15.80:0/362447020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c107e30 msgr2=0x7f6e6c167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:36.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.888+0000 7f6e70bda700 1 --2- 172.21.15.80:0/362447020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c107e30 0x7f6e6c167d70 secure :-1 s=READY pgs=2979 cs=0 l=1 rx=0x7f6e64010470 tx=0x7f6e6400b3b0).stop 2019-11-28T12:01:36.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.888+0000 7f6e70bda700 1 -- 172.21.15.80:0/362447020 shutdown_connections 2019-11-28T12:01:36.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.888+0000 7f6e70bda700 1 --2- 172.21.15.80:0/362447020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e6c107e30 0x7f6e6c167d70 unknown :-1 s=CLOSED pgs=2979 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:36.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.888+0000 7f6e70bda700 1 --2- 172.21.15.80:0/362447020 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e50018730 0x7f6e5001abc0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:36.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.888+0000 7f6e70bda700 1 --2- 172.21.15.80:0/362447020 >> v2:172.21.15.174:3300/0 conn(0x7f6e6c10e970 0x7f6e6c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:36.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.888+0000 7f6e70bda700 1 -- 172.21.15.80:0/362447020 shutdown_connections 2019-11-28T12:01:36.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.888+0000 7f6e70bda700 1 -- 172.21.15.80:0/362447020 wait complete. 2019-11-28T12:01:36.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:36.888+0000 7f6e70bda700 1 -- 172.21.15.80:0/362447020 >> 172.21.15.80:0/362447020 conn(0x7f6e6c15e2d0 msgr2=0x7f6e6c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:36.892 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T12:01:37.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.023+0000 7f362d4d2700 1 Processor -- start 2019-11-28T12:01:37.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.023+0000 7f362d4d2700 1 -- start start 2019-11-28T12:01:37.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f362d4d2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362806c0a0 0x7f3628072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:37.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f362d4d2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f36280734e0 0x7f3628071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:37.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f362d4d2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362806db00 con 0x7f3628072360 2019-11-28T12:01:37.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f362d4d2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362806f330 con 0x7f36280734e0 2019-11-28T12:01:37.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f362d4d2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36280706c0 con 0x7f362806c0a0 2019-11-28T12:01:37.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f3626ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f36280734e0 0x7f3628071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:37.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f3627fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3628072360 0x7f362806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46908/0 (socket says 172.21.15.80:46908) 2019-11-28T12:01:37.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f3627fff700 1 -- 172.21.15.80:0/1960373446 learned_addr learned my addr 172.21.15.80:0/1960373446 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:37.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f36277fe700 1 --2- 172.21.15.80:0/1960373446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362806c0a0 0x7f3628072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:37.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f3626ffd700 1 -- 172.21.15.80:0/1960373446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362806c0a0 msgr2=0x7f3628072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:37.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f3626ffd700 1 --2- 172.21.15.80:0/1960373446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362806c0a0 0x7f3628072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:37.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f3626ffd700 1 -- 172.21.15.80:0/1960373446 >> v1:172.21.15.80:6789/0 conn(0x7f3628072360 legacy=0x7f362806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:37.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f3626ffd700 1 -- 172.21.15.80:0/1960373446 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3628070a40 con 0x7f36280734e0 2019-11-28T12:01:37.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f36267fc700 1 -- 172.21.15.80:0/1960373446 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366992345 0 0) 0x7f36200014d0 con 0x7f3628072360 2019-11-28T12:01:37.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f36277fe700 1 --2- 172.21.15.80:0/1960373446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362806c0a0 0x7f3628072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T12:01:37.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f3626ffd700 1 --2- 172.21.15.80:0/1960373446 >> v2:172.21.15.80:3300/0 conn(0x7f36280734e0 0x7f3628071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f361000af50 tx=0x7f361000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:37.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f3626ffd700 1 --2- 172.21.15.80:0/1960373446 >> v2:172.21.15.80:3300/0 conn(0x7f36280734e0 0x7f3628071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f361000af50 tx=0x7f361000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:37.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f3626ffd700 1 --2- 172.21.15.80:0/1960373446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280734e0 0x7f3628071e20 secure :-1 s=READY pgs=2981 cs=0 l=1 rx=0x7f361000af50 tx=0x7f361000b760).ready entity=mon.0 client_cookie=3308f322d501e8c4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:37.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f3626ffd700 1 --2- 172.21.15.80:0/1960373446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280734e0 0x7f3628071e20 secure :-1 s=THROTTLE_DONE pgs=2981 cs=0 l=1 rx=0x7f361000af50 tx=0x7f361000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:37.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f36267fc700 1 -- 172.21.15.80:0/1960373446 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3610007210 con 0x7f36280734e0 2019-11-28T12:01:37.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f3626ffd700 1 --2- 172.21.15.80:0/1960373446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280734e0 0x7f3628071e20 secure :-1 s=THROTTLE_DONE pgs=2981 cs=0 l=1 rx=0x7f361000af50 tx=0x7f361000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:37.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f3626ffd700 1 --2- 172.21.15.80:0/1960373446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280734e0 0x7f3628071e20 secure :-1 s=THROTTLE_DONE pgs=2981 cs=0 l=1 rx=0x7f361000af50 tx=0x7f361000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:37.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f36267fc700 1 -- 172.21.15.80:0/1960373446 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36100099b0 con 0x7f36280734e0 2019-11-28T12:01:37.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.024+0000 7f36267fc700 1 -- 172.21.15.80:0/1960373446 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f361000a080 con 0x7f36280734e0 2019-11-28T12:01:37.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.025+0000 7f362d4d2700 1 -- 172.21.15.80:0/1960373446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280734e0 msgr2=0x7f3628071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:37.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.025+0000 7f362d4d2700 1 --2- 172.21.15.80:0/1960373446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280734e0 0x7f3628071e20 secure :-1 s=READY pgs=2981 cs=0 l=1 rx=0x7f361000af50 tx=0x7f361000b760).stop 2019-11-28T12:01:37.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.025+0000 7f362d4d2700 1 -- 172.21.15.80:0/1960373446 shutdown_connections 2019-11-28T12:01:37.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.025+0000 7f362d4d2700 1 --2- 172.21.15.80:0/1960373446 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36280734e0 0x7f3628071e20 unknown :-1 s=CLOSED pgs=2981 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:37.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.025+0000 7f362d4d2700 1 --2- 172.21.15.80:0/1960373446 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362806c0a0 0x7f3628072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:37.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.025+0000 7f362d4d2700 1 -- 172.21.15.80:0/1960373446 shutdown_connections 2019-11-28T12:01:37.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.025+0000 7f362d4d2700 1 -- 172.21.15.80:0/1960373446 wait complete. 2019-11-28T12:01:37.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.025+0000 7f362d4d2700 1 -- 172.21.15.80:0/1960373446 >> 172.21.15.80:0/1960373446 conn(0x7f3628061cf0 msgr2=0x7f3628064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:37.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.027+0000 7f362d4d2700 1 Processor -- start 2019-11-28T12:01:37.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.028+0000 7f362d4d2700 1 -- start start 2019-11-28T12:01:37.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f362d4d2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362813a780 0x7f362812d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:37.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f362d4d2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f362812cb00 0x7f3628167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:37.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f362d4d2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3628139a60 con 0x7f362812d9c0 2019-11-28T12:01:37.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f362d4d2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3628129830 con 0x7f362812cb00 2019-11-28T12:01:37.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f362d4d2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362812a260 con 0x7f362813a780 2019-11-28T12:01:37.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f3627fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f362812cb00 0x7f3628167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:37.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f3626ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f362812d9c0 0x7f362812c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46914/0 (socket says 172.21.15.80:46914) 2019-11-28T12:01:37.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f3627fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f362812cb00 0x7f3628167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47600/0 (socket says 172.21.15.80:47600) 2019-11-28T12:01:37.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f3626ffd700 1 -- 172.21.15.80:0/3766225994 learned_addr learned my addr 172.21.15.80:0/3766225994 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:37.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f36277fe700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362813a780 0x7f362812d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:37.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f3627fff700 1 -- 172.21.15.80:0/3766225994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362813a780 msgr2=0x7f362812d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:37.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f3627fff700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362813a780 0x7f362812d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:37.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f361ffff700 1 -- 172.21.15.80:0/3766225994 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482985067 0 0) 0x7f361000abb0 con 0x7f362812d9c0 2019-11-28T12:01:37.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f3627fff700 1 -- 172.21.15.80:0/3766225994 >> v1:172.21.15.80:6789/0 conn(0x7f362812d9c0 legacy=0x7f362812c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:37.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f3627fff700 1 -- 172.21.15.80:0/3766225994 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362812abc0 con 0x7f362812cb00 2019-11-28T12:01:37.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f36277fe700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362813a780 0x7f362812d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T12:01:37.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f3627fff700 1 --2- 172.21.15.80:0/3766225994 >> v2:172.21.15.80:3300/0 conn(0x7f362812cb00 0x7f3628167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3620010720 tx=0x7f3620010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:37.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f3627fff700 1 --2- 172.21.15.80:0/3766225994 >> v2:172.21.15.80:3300/0 conn(0x7f362812cb00 0x7f3628167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3620010720 tx=0x7f3620010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:37.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f3627fff700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f362812cb00 0x7f3628167d70 secure :-1 s=READY pgs=2983 cs=0 l=1 rx=0x7f3620010720 tx=0x7f3620010ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:37.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f3627fff700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f362812cb00 0x7f3628167d70 secure :-1 s=THROTTLE_DONE pgs=2983 cs=0 l=1 rx=0x7f3620010720 tx=0x7f3620010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:37.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f3627fff700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f362812cb00 0x7f3628167d70 secure :-1 s=THROTTLE_DONE pgs=2983 cs=0 l=1 rx=0x7f3620010720 tx=0x7f3620010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:37.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f361ffff700 1 -- 172.21.15.80:0/3766225994 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3620000dd0 con 0x7f362812cb00 2019-11-28T12:01:37.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f3627fff700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f362812cb00 0x7f3628167d70 secure :-1 s=THROTTLE_DONE pgs=2983 cs=0 l=1 rx=0x7f3620010720 tx=0x7f3620010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:37.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f361ffff700 1 -- 172.21.15.80:0/3766225994 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3620001700 con 0x7f362812cb00 2019-11-28T12:01:37.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f362d4d2700 1 -- 172.21.15.80:0/3766225994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362812af40 con 0x7f362812cb00 2019-11-28T12:01:37.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f361ffff700 1 -- 172.21.15.80:0/3766225994 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3620001dd0 con 0x7f362812cb00 2019-11-28T12:01:37.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.029+0000 7f362d4d2700 1 -- 172.21.15.80:0/3766225994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362812abc0 con 0x7f362812cb00 2019-11-28T12:01:37.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.030+0000 7f3627fff700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f362812cb00 0x7f3628167d70 secure :-1 s=THROTTLE_DONE pgs=2983 cs=0 l=1 rx=0x7f3620010720 tx=0x7f3620010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:37.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.030+0000 7f361ffff700 1 -- 172.21.15.80:0/3766225994 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f36200018f0 con 0x7f362812cb00 2019-11-28T12:01:37.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.030+0000 7f3627fff700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f362812cb00 0x7f3628167d70 secure :-1 s=THROTTLE_DONE pgs=2983 cs=0 l=1 rx=0x7f3620010720 tx=0x7f3620010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:37.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.030+0000 7f361ffff700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f360c018730 0x7f360c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:37.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.030+0000 7f361ffff700 1 -- 172.21.15.80:0/3766225994 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(229..229 src has 1..229) v4 ==== 5329+0+0 (secure 0 0 0) 0x7f3620031ff0 con 0x7f362812cb00 2019-11-28T12:01:37.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.030+0000 7f36277fe700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f360c018730 0x7f360c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:37.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.030+0000 7f36277fe700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f360c018730 0x7f360c01abc0 crc :-1 s=READY pgs=1233 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:37.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.038+0000 7f362d4d2700 1 -- 172.21.15.80:0/3766225994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362812af40 con 0x7f362812cb00 2019-11-28T12:01:37.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.041+0000 7f3627fff700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f362812cb00 0x7f3628167d70 secure :-1 s=THROTTLE_DONE pgs=2983 cs=0 l=1 rx=0x7f3620010720 tx=0x7f3620010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:37.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.041+0000 7f361ffff700 1 -- 172.21.15.80:0/3766225994 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3620001300 con 0x7f362812cb00 2019-11-28T12:01:37.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.227+0000 7f362d4d2700 1 -- 172.21.15.80:0/3766225994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f362812abc0 con 0x7f362812cb00 2019-11-28T12:01:37.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.870+0000 7f3627fff700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f362812cb00 0x7f3628167d70 secure :-1 s=THROTTLE_DONE pgs=2983 cs=0 l=1 rx=0x7f3620010720 tx=0x7f3620010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:37.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.870+0000 7f361ffff700 1 -- 172.21.15.80:0/3766225994 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v230) v1 ==== 97+0+0 (secure 0 0 0) 0x7f36200016e0 con 0x7f362812cb00 2019-11-28T12:01:37.886 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T12:01:37.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.894+0000 7f362d4d2700 1 -- 172.21.15.80:0/3766225994 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f360c018730 msgr2=0x7f360c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:37.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.894+0000 7f362d4d2700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f360c018730 0x7f360c01abc0 crc :-1 s=READY pgs=1233 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:37.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.894+0000 7f362d4d2700 1 -- 172.21.15.80:0/3766225994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f362812cb00 msgr2=0x7f3628167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:37.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.894+0000 7f362d4d2700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f362812cb00 0x7f3628167d70 secure :-1 s=READY pgs=2983 cs=0 l=1 rx=0x7f3620010720 tx=0x7f3620010ac0).stop 2019-11-28T12:01:37.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.895+0000 7f362d4d2700 1 -- 172.21.15.80:0/3766225994 shutdown_connections 2019-11-28T12:01:37.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.895+0000 7f362d4d2700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f360c018730 0x7f360c01abc0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:37.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.895+0000 7f362d4d2700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f362812cb00 0x7f3628167d70 unknown :-1 s=CLOSED pgs=2983 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:37.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.895+0000 7f362d4d2700 1 --2- 172.21.15.80:0/3766225994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f362813a780 0x7f362812d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:37.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.895+0000 7f362d4d2700 1 -- 172.21.15.80:0/3766225994 shutdown_connections 2019-11-28T12:01:37.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.895+0000 7f362d4d2700 1 -- 172.21.15.80:0/3766225994 wait complete. 2019-11-28T12:01:37.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:37.895+0000 7f362d4d2700 1 -- 172.21.15.80:0/3766225994 >> 172.21.15.80:0/3766225994 conn(0x7f3628127dc0 msgr2=0x7f3628141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:37.899 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T12:01:37.899 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T12:01:38.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.025+0000 7fef1d3c0700 1 Processor -- start 2019-11-28T12:01:38.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.025+0000 7fef1d3c0700 1 -- start start 2019-11-28T12:01:38.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.026+0000 7fef1d3c0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fef1806c490 0x7fef1806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:38.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.026+0000 7fef1d3c0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef1806ce60 0x7fef18164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:38.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.026+0000 7fef1d3c0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1806db00 con 0x7fef1806c0a0 2019-11-28T12:01:38.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.026+0000 7fef1d3c0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1806fd60 con 0x7fef1806c490 2019-11-28T12:01:38.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.026+0000 7fef1d3c0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef18070030 con 0x7fef1806ce60 2019-11-28T12:01:38.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.026+0000 7fef177fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fef1806c0a0 0x7fef18072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46920/0 (socket says 172.21.15.80:46920) 2019-11-28T12:01:38.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.026+0000 7fef177fe700 1 -- 172.21.15.80:0/1115341768 learned_addr learned my addr 172.21.15.80:0/1115341768 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:38.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.026+0000 7fef16ffd700 1 --2- 172.21.15.80:0/1115341768 >> v2:172.21.15.174:3300/0 conn(0x7fef1806c490 0x7fef1806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:38.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.026+0000 7fef17fff700 1 --2- 172.21.15.80:0/1115341768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef1806ce60 0x7fef18164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:38.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.026+0000 7fef167fc700 1 -- 172.21.15.80:0/1115341768 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631881170 0 0) 0x7fef00001150 con 0x7fef1806c0a0 2019-11-28T12:01:38.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.026+0000 7fef167fc700 1 -- 172.21.15.80:0/1115341768 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef04002e80 con 0x7fef1806c0a0 2019-11-28T12:01:38.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.026+0000 7fef17fff700 1 -- 172.21.15.80:0/1115341768 >> v2:172.21.15.174:3300/0 conn(0x7fef1806c490 msgr2=0x7fef1806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:38.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.026+0000 7fef17fff700 1 --2- 172.21.15.80:0/1115341768 >> v2:172.21.15.174:3300/0 conn(0x7fef1806c490 0x7fef1806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:38.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.026+0000 7fef17fff700 1 -- 172.21.15.80:0/1115341768 >> v1:172.21.15.80:6789/0 conn(0x7fef1806c0a0 legacy=0x7fef18072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.026+0000 7fef17fff700 1 -- 172.21.15.80:0/1115341768 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef180706c0 con 0x7fef1806ce60 2019-11-28T12:01:38.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.026+0000 7fef16ffd700 1 --2- 172.21.15.80:0/1115341768 >> v2:172.21.15.174:3300/0 conn(0x7fef1806c490 0x7fef1806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:38.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.027+0000 7fef17fff700 1 --2- 172.21.15.80:0/1115341768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef1806ce60 0x7fef18164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fef1000b300 tx=0x7fef1000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.027+0000 7fef17fff700 1 --2- 172.21.15.80:0/1115341768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef1806ce60 0x7fef18164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fef1000b300 tx=0x7fef1000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.027+0000 7fef17fff700 1 --2- 172.21.15.80:0/1115341768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef1806ce60 0x7fef18164d70 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7fef1000b300 tx=0x7fef1000bb10).ready entity=mon.2 client_cookie=d66026592b6e4ec2 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:38.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.027+0000 7fef17fff700 1 --2- 172.21.15.80:0/1115341768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef1806ce60 0x7fef18164d70 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7fef1000b300 tx=0x7fef1000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.027+0000 7fef167fc700 1 -- 172.21.15.80:0/1115341768 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef10000f40 con 0x7fef1806ce60 2019-11-28T12:01:38.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.027+0000 7fef17fff700 1 --2- 172.21.15.80:0/1115341768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef1806ce60 0x7fef18164d70 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7fef1000b300 tx=0x7fef1000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.027+0000 7fef17fff700 1 --2- 172.21.15.80:0/1115341768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef1806ce60 0x7fef18164d70 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7fef1000b300 tx=0x7fef1000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.027+0000 7fef167fc700 1 -- 172.21.15.80:0/1115341768 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef10009b70 con 0x7fef1806ce60 2019-11-28T12:01:38.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.027+0000 7fef167fc700 1 -- 172.21.15.80:0/1115341768 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef1000a240 con 0x7fef1806ce60 2019-11-28T12:01:38.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.027+0000 7fef1d3c0700 1 -- 172.21.15.80:0/1115341768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef1806ce60 msgr2=0x7fef18164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.027+0000 7fef1d3c0700 1 --2- 172.21.15.80:0/1115341768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef1806ce60 0x7fef18164d70 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7fef1000b300 tx=0x7fef1000bb10).stop 2019-11-28T12:01:38.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.027+0000 7fef1d3c0700 1 -- 172.21.15.80:0/1115341768 shutdown_connections 2019-11-28T12:01:38.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.027+0000 7fef1d3c0700 1 --2- 172.21.15.80:0/1115341768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef1806ce60 0x7fef18164d70 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.027+0000 7fef1d3c0700 1 --2- 172.21.15.80:0/1115341768 >> v2:172.21.15.174:3300/0 conn(0x7fef1806c490 0x7fef1806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:38.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.028+0000 7fef1d3c0700 1 -- 172.21.15.80:0/1115341768 shutdown_connections 2019-11-28T12:01:38.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.028+0000 7fef1d3c0700 1 -- 172.21.15.80:0/1115341768 wait complete. 2019-11-28T12:01:38.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.028+0000 7fef1d3c0700 1 -- 172.21.15.80:0/1115341768 >> 172.21.15.80:0/1115341768 conn(0x7fef18061cf0 msgr2=0x7fef18064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:38.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.030+0000 7fef1d3c0700 1 Processor -- start 2019-11-28T12:01:38.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.030+0000 7fef1d3c0700 1 -- start start 2019-11-28T12:01:38.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.031+0000 7fef1d3c0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fef18103000 0x7fef18103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:38.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.031+0000 7fef1d3c0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef181312c0 con 0x7fef181039d0 2019-11-28T12:01:38.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.031+0000 7fef1d3c0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef18131730 con 0x7fef1813dc00 2019-11-28T12:01:38.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.031+0000 7fef1d3c0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef18105830 con 0x7fef18103000 2019-11-28T12:01:38.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.031+0000 7fef17fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fef181039d0 0x7fef18167a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46930/0 (socket says 172.21.15.80:46930) 2019-11-28T12:01:38.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.031+0000 7fef17fff700 1 -- 172.21.15.80:0/3507137516 learned_addr learned my addr 172.21.15.80:0/3507137516 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:38.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.031+0000 7fef16ffd700 1 --2- 172.21.15.80:0/3507137516 >> v2:172.21.15.174:3300/0 conn(0x7fef18103000 0x7fef18103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:38.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.031+0000 7fef0ffff700 1 -- 172.21.15.80:0/3507137516 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224494873 0 0) 0x7fef1000b370 con 0x7fef181039d0 2019-11-28T12:01:38.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.031+0000 7fef0ffff700 1 -- 172.21.15.80:0/3507137516 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feefc002e80 con 0x7fef181039d0 2019-11-28T12:01:38.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.031+0000 7fef0ffff700 1 -- 172.21.15.80:0/3507137516 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628887113 0 0) 0x7fef00001100 con 0x7fef1813dc00 2019-11-28T12:01:38.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.031+0000 7fef16ffd700 1 -- 172.21.15.80:0/3507137516 >> v1:172.21.15.174:6789/0 conn(0x7fef1813dc00 legacy=0x7fef18109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.032+0000 7fef16ffd700 1 -- 172.21.15.80:0/3507137516 >> v1:172.21.15.80:6789/0 conn(0x7fef181039d0 legacy=0x7fef18167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.032+0000 7fef16ffd700 1 -- 172.21.15.80:0/3507137516 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef18106190 con 0x7fef18103000 2019-11-28T12:01:38.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.032+0000 7fef16ffd700 1 --2- 172.21.15.80:0/3507137516 >> v2:172.21.15.174:3300/0 conn(0x7fef18103000 0x7fef18103490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fef080103a0 tx=0x7fef08010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.032+0000 7fef16ffd700 1 --2- 172.21.15.80:0/3507137516 >> v2:172.21.15.174:3300/0 conn(0x7fef18103000 0x7fef18103490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fef080103a0 tx=0x7fef08010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.032+0000 7fef16ffd700 1 --2- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef18103000 0x7fef18103490 secure :-1 s=READY pgs=1798 cs=0 l=1 rx=0x7fef080103a0 tx=0x7fef08010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:38.034 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.032+0000 7fef16ffd700 1 --2- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef18103000 0x7fef18103490 secure :-1 s=THROTTLE_DONE pgs=1798 cs=0 l=1 rx=0x7fef080103a0 tx=0x7fef08010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.032+0000 7fef0ffff700 1 -- 172.21.15.80:0/3507137516 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef08000940 con 0x7fef18103000 2019-11-28T12:01:38.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.032+0000 7fef16ffd700 1 --2- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef18103000 0x7fef18103490 secure :-1 s=THROTTLE_DONE pgs=1798 cs=0 l=1 rx=0x7fef080103a0 tx=0x7fef08010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.032+0000 7fef16ffd700 1 --2- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef18103000 0x7fef18103490 secure :-1 s=THROTTLE_DONE pgs=1798 cs=0 l=1 rx=0x7fef080103a0 tx=0x7fef08010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.032+0000 7fef0ffff700 1 -- 172.21.15.80:0/3507137516 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0800dff0 con 0x7fef18103000 2019-11-28T12:01:38.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.032+0000 7fef1d3c0700 1 -- 172.21.15.80:0/3507137516 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef18106510 con 0x7fef18103000 2019-11-28T12:01:38.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.032+0000 7fef0ffff700 1 -- 172.21.15.80:0/3507137516 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef0800e6c0 con 0x7fef18103000 2019-11-28T12:01:38.035 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.032+0000 7fef1d3c0700 1 -- 172.21.15.80:0/3507137516 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef18106190 con 0x7fef18103000 2019-11-28T12:01:38.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.032+0000 7fef16ffd700 1 --2- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef18103000 0x7fef18103490 secure :-1 s=THROTTLE_DONE pgs=1798 cs=0 l=1 rx=0x7fef080103a0 tx=0x7fef08010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.032+0000 7fef0ffff700 1 -- 172.21.15.80:0/3507137516 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fef0800db00 con 0x7fef18103000 2019-11-28T12:01:38.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.033+0000 7fef16ffd700 1 --2- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef18103000 0x7fef18103490 secure :-1 s=THROTTLE_DONE pgs=1798 cs=0 l=1 rx=0x7fef080103a0 tx=0x7fef08010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.033+0000 7fef0ffff700 1 --2- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feefc018780 0x7feefc01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:38.036 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.033+0000 7fef0ffff700 1 -- 172.21.15.80:0/3507137516 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(230..230 src has 1..230) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fef08031a50 con 0x7fef18103000 2019-11-28T12:01:38.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.033+0000 7fef177fe700 1 --2- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feefc018780 0x7feefc01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:38.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.033+0000 7fef177fe700 1 --2- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feefc018780 0x7feefc01abf0 crc :-1 s=READY pgs=1234 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:38.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.040+0000 7fef1d3c0700 1 -- 172.21.15.80:0/3507137516 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef18106510 con 0x7fef18103000 2019-11-28T12:01:38.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.044+0000 7fef16ffd700 1 --2- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef18103000 0x7fef18103490 secure :-1 s=THROTTLE_DONE pgs=1798 cs=0 l=1 rx=0x7fef080103a0 tx=0x7fef08010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.044+0000 7fef0ffff700 1 -- 172.21.15.80:0/3507137516 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fef080262d0 con 0x7fef18103000 2019-11-28T12:01:38.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.213+0000 7fef1d3c0700 1 -- 172.21.15.80:0/3507137516 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fef18106190 con 0x7fef18103000 2019-11-28T12:01:38.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.214+0000 7fef16ffd700 1 --2- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef18103000 0x7fef18103490 secure :-1 s=THROTTLE_DONE pgs=1798 cs=0 l=1 rx=0x7fef080103a0 tx=0x7fef08010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.214+0000 7fef0ffff700 1 -- 172.21.15.80:0/3507137516 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v79) v1 ==== 80+0+4797 (secure 0 0 0) 0x7fef080262d0 con 0x7fef18103000 2019-11-28T12:01:38.208 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:38.209 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T12:01:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T12:01:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T12:01:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T12:01:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.209 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T12:01:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:01:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:01:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:01:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T12:01:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T12:01:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T12:01:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:01:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:01:38.211 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:01:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T12:01:38.212 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T12:01:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T12:01:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:01:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:01:38.214 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:01:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T12:01:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T12:01:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.215 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:01:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:01:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:01:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T12:01:38.216 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T12:01:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:01:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:01:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:01:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T12:01:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T12:01:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:01:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:01:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:01:38.218 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T12:01:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T12:01:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:01:38.219 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:01:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:01:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T12:01:38.221 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T12:01:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:01:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:01:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:01:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T12:01:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T12:01:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:01:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:01:38.223 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:01:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T12:01:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T12:01:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:01:38.224 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:01:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:01:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T12:01:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T12:01:38.225 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:01:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:01:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:01:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.226 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T12:01:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T12:01:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T12:01:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T12:01:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T12:01:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T12:01:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T12:01:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T12:01:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T12:01:38.228 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T12:01:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T12:01:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T12:01:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.229 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T12:01:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T12:01:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T12:01:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T12:01:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T12:01:38.230 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T12:01:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T12:01:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T12:01:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.231 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T12:01:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T12:01:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T12:01:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:01:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:01:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:01:38.232 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T12:01:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T12:01:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T12:01:38.233 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T12:01:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:01:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:01:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T12:01:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T12:01:38.234 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:01:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T12:01:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T12:01:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:01:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:38.235 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:01:38.235 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T12:01:38.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.216+0000 7fef1d3c0700 1 -- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feefc018780 msgr2=0x7feefc01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.216+0000 7fef1d3c0700 1 --2- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feefc018780 0x7feefc01abf0 crc :-1 s=READY pgs=1234 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.216+0000 7fef1d3c0700 1 -- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef18103000 msgr2=0x7fef18103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.216+0000 7fef1d3c0700 1 --2- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef18103000 0x7fef18103490 secure :-1 s=READY pgs=1798 cs=0 l=1 rx=0x7fef080103a0 tx=0x7fef08010740).stop 2019-11-28T12:01:38.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.216+0000 7fef1d3c0700 1 -- 172.21.15.80:0/3507137516 shutdown_connections 2019-11-28T12:01:38.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.216+0000 7fef1d3c0700 1 --2- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef18103000 0x7fef18103490 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.216+0000 7fef1d3c0700 1 --2- 172.21.15.80:0/3507137516 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7feefc018780 0x7feefc01abf0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.216+0000 7fef1d3c0700 1 -- 172.21.15.80:0/3507137516 shutdown_connections 2019-11-28T12:01:38.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.216+0000 7fef1d3c0700 1 -- 172.21.15.80:0/3507137516 wait complete. 2019-11-28T12:01:38.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.216+0000 7fef1d3c0700 1 -- 172.21.15.80:0/3507137516 >> 172.21.15.80:0/3507137516 conn(0x7fef1811bfc0 msgr2=0x7fef18141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:38.241 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T12:01:38.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.365+0000 7fd67d789700 1 Processor -- start 2019-11-28T12:01:38.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.365+0000 7fd67d789700 1 -- start start 2019-11-28T12:01:38.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.366+0000 7fd67d789700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd67806c490 0x7fd67806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:38.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.366+0000 7fd67d789700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd67806ce60 0x7fd678164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:38.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.366+0000 7fd67d789700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67806db00 con 0x7fd67806c0a0 2019-11-28T12:01:38.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.366+0000 7fd67d789700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67806fd60 con 0x7fd67806ce60 2019-11-28T12:01:38.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.366+0000 7fd67d789700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd678070030 con 0x7fd67806c490 2019-11-28T12:01:38.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.366+0000 7fd677fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd67806ce60 0x7fd678164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:38.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.366+0000 7fd677fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd67806ce60 0x7fd678164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47620/0 (socket says 172.21.15.80:47620) 2019-11-28T12:01:38.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.366+0000 7fd677fff700 1 -- 172.21.15.80:0/875640663 learned_addr learned my addr 172.21.15.80:0/875640663 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:38.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.366+0000 7fd676ffd700 1 --2- 172.21.15.80:0/875640663 >> v2:172.21.15.174:3300/0 conn(0x7fd67806c490 0x7fd67806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:38.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.366+0000 7fd677fff700 1 -- 172.21.15.80:0/875640663 >> v2:172.21.15.174:3300/0 conn(0x7fd67806c490 msgr2=0x7fd67806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:38.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.366+0000 7fd677fff700 1 --2- 172.21.15.80:0/875640663 >> v2:172.21.15.174:3300/0 conn(0x7fd67806c490 0x7fd67806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.366+0000 7fd677fff700 1 -- 172.21.15.80:0/875640663 >> v1:172.21.15.174:6789/0 conn(0x7fd67806c0a0 legacy=0x7fd678072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.366+0000 7fd677fff700 1 -- 172.21.15.80:0/875640663 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6780706c0 con 0x7fd67806ce60 2019-11-28T12:01:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd677fff700 1 --2- 172.21.15.80:0/875640663 >> v2:172.21.15.80:3300/0 conn(0x7fd67806ce60 0x7fd678164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd67000f6b0 tx=0x7fd67000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd677fff700 1 --2- 172.21.15.80:0/875640663 >> v2:172.21.15.80:3300/0 conn(0x7fd67806ce60 0x7fd678164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd67000f6b0 tx=0x7fd67000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd677fff700 1 --2- 172.21.15.80:0/875640663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67806ce60 0x7fd678164d70 secure :-1 s=READY pgs=2986 cs=0 l=1 rx=0x7fd67000f6b0 tx=0x7fd67000fa50).ready entity=mon.0 client_cookie=cbdf28bea05ea42d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd677fff700 1 --2- 172.21.15.80:0/875640663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67806ce60 0x7fd678164d70 secure :-1 s=THROTTLE_DONE pgs=2986 cs=0 l=1 rx=0x7fd67000f6b0 tx=0x7fd67000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd677fff700 1 --2- 172.21.15.80:0/875640663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67806ce60 0x7fd678164d70 secure :-1 s=THROTTLE_DONE pgs=2986 cs=0 l=1 rx=0x7fd67000f6b0 tx=0x7fd67000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd677fff700 1 --2- 172.21.15.80:0/875640663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67806ce60 0x7fd678164d70 secure :-1 s=THROTTLE_DONE pgs=2986 cs=0 l=1 rx=0x7fd67000f6b0 tx=0x7fd67000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd6767fc700 1 -- 172.21.15.80:0/875640663 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd670000a70 con 0x7fd67806ce60 2019-11-28T12:01:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd6767fc700 1 -- 172.21.15.80:0/875640663 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6700010e0 con 0x7fd67806ce60 2019-11-28T12:01:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd6767fc700 1 -- 172.21.15.80:0/875640663 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6700017b0 con 0x7fd67806ce60 2019-11-28T12:01:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd67d789700 1 -- 172.21.15.80:0/875640663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67806ce60 msgr2=0x7fd678164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd67d789700 1 --2- 172.21.15.80:0/875640663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67806ce60 0x7fd678164d70 secure :-1 s=READY pgs=2986 cs=0 l=1 rx=0x7fd67000f6b0 tx=0x7fd67000fa50).stop 2019-11-28T12:01:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd67d789700 1 -- 172.21.15.80:0/875640663 shutdown_connections 2019-11-28T12:01:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd67d789700 1 --2- 172.21.15.80:0/875640663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67806ce60 0x7fd678164d70 unknown :-1 s=CLOSED pgs=2986 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd67d789700 1 --2- 172.21.15.80:0/875640663 >> v2:172.21.15.174:3300/0 conn(0x7fd67806c490 0x7fd67806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd67d789700 1 -- 172.21.15.80:0/875640663 shutdown_connections 2019-11-28T12:01:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd67d789700 1 -- 172.21.15.80:0/875640663 wait complete. 2019-11-28T12:01:38.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.367+0000 7fd67d789700 1 -- 172.21.15.80:0/875640663 >> 172.21.15.80:0/875640663 conn(0x7fd678061cf0 msgr2=0x7fd678064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:38.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.370+0000 7fd67d789700 1 Processor -- start 2019-11-28T12:01:38.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.370+0000 7fd67d789700 1 -- start start 2019-11-28T12:01:38.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd67d789700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd67813dc00 0x7fd678109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:38.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd67d789700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd67810a3a0 0x7fd678108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:38.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd67d789700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd678109220 0x7fd678109680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:38.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd67d789700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd678104e00 con 0x7fd67810a3a0 2019-11-28T12:01:38.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd67d789700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd678105830 con 0x7fd678109220 2019-11-28T12:01:38.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd67d789700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd678106190 con 0x7fd67813dc00 2019-11-28T12:01:38.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd676ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd67810a3a0 0x7fd678108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:38.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd676ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd67810a3a0 0x7fd678108ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47624/0 (socket says 172.21.15.80:47624) 2019-11-28T12:01:38.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd676ffd700 1 -- 172.21.15.80:0/2155966765 learned_addr learned my addr 172.21.15.80:0/2155966765 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:38.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd677fff700 1 --2- 172.21.15.80:0/2155966765 >> v2:172.21.15.174:3300/0 conn(0x7fd678109220 0x7fd678109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:38.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd6777fe700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd67813dc00 0x7fd678109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:38.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd676ffd700 1 -- 172.21.15.80:0/2155966765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd67813dc00 msgr2=0x7fd678109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd676ffd700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd67813dc00 0x7fd678109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd676ffd700 1 -- 172.21.15.80:0/2155966765 >> v2:172.21.15.174:3300/0 conn(0x7fd678109220 msgr2=0x7fd678109680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd676ffd700 1 --2- 172.21.15.80:0/2155966765 >> v2:172.21.15.174:3300/0 conn(0x7fd678109220 0x7fd678109680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd676ffd700 1 -- 172.21.15.80:0/2155966765 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd678106510 con 0x7fd67810a3a0 2019-11-28T12:01:38.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd676ffd700 1 --2- 172.21.15.80:0/2155966765 >> v2:172.21.15.80:3300/0 conn(0x7fd67810a3a0 0x7fd678108ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6600107d0 tx=0x7fd660010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd676ffd700 1 --2- 172.21.15.80:0/2155966765 >> v2:172.21.15.80:3300/0 conn(0x7fd67810a3a0 0x7fd678108ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6600107d0 tx=0x7fd660010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.371+0000 7fd676ffd700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67810a3a0 0x7fd678108ce0 secure :-1 s=READY pgs=2987 cs=0 l=1 rx=0x7fd6600107d0 tx=0x7fd660010650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:38.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.372+0000 7fd676ffd700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67810a3a0 0x7fd678108ce0 secure :-1 s=THROTTLE_DONE pgs=2987 cs=0 l=1 rx=0x7fd6600107d0 tx=0x7fd660010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.372+0000 7fd676ffd700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67810a3a0 0x7fd678108ce0 secure :-1 s=THROTTLE_DONE pgs=2987 cs=0 l=1 rx=0x7fd6600107d0 tx=0x7fd660010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.372+0000 7fd66ffff700 1 -- 172.21.15.80:0/2155966765 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd660005af0 con 0x7fd67810a3a0 2019-11-28T12:01:38.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.372+0000 7fd676ffd700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67810a3a0 0x7fd678108ce0 secure :-1 s=THROTTLE_DONE pgs=2987 cs=0 l=1 rx=0x7fd6600107d0 tx=0x7fd660010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.372+0000 7fd66ffff700 1 -- 172.21.15.80:0/2155966765 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd660005710 con 0x7fd67810a3a0 2019-11-28T12:01:38.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.372+0000 7fd67d789700 1 -- 172.21.15.80:0/2155966765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd678106510 con 0x7fd67810a3a0 2019-11-28T12:01:38.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.372+0000 7fd66ffff700 1 -- 172.21.15.80:0/2155966765 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6600060d0 con 0x7fd67810a3a0 2019-11-28T12:01:38.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.372+0000 7fd67d789700 1 -- 172.21.15.80:0/2155966765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd678106510 con 0x7fd67810a3a0 2019-11-28T12:01:38.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.372+0000 7fd676ffd700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67810a3a0 0x7fd678108ce0 secure :-1 s=THROTTLE_DONE pgs=2987 cs=0 l=1 rx=0x7fd6600107d0 tx=0x7fd660010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.372+0000 7fd66ffff700 1 -- 172.21.15.80:0/2155966765 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd660005900 con 0x7fd67810a3a0 2019-11-28T12:01:38.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.372+0000 7fd676ffd700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67810a3a0 0x7fd678108ce0 secure :-1 s=THROTTLE_DONE pgs=2987 cs=0 l=1 rx=0x7fd6600107d0 tx=0x7fd660010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.372+0000 7fd66ffff700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd650018730 0x7fd65001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:38.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.372+0000 7fd66ffff700 1 -- 172.21.15.80:0/2155966765 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(230..230 src has 1..230) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fd660031d50 con 0x7fd67810a3a0 2019-11-28T12:01:38.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.372+0000 7fd6777fe700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd650018730 0x7fd65001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:38.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.373+0000 7fd6777fe700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd650018730 0x7fd65001abc0 crc :-1 s=READY pgs=1235 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:38.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.380+0000 7fd67d789700 1 -- 172.21.15.80:0/2155966765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd678106510 con 0x7fd67810a3a0 2019-11-28T12:01:38.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.384+0000 7fd676ffd700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67810a3a0 0x7fd678108ce0 secure :-1 s=THROTTLE_DONE pgs=2987 cs=0 l=1 rx=0x7fd6600107d0 tx=0x7fd660010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.384+0000 7fd66ffff700 1 -- 172.21.15.80:0/2155966765 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd660005500 con 0x7fd67810a3a0 2019-11-28T12:01:38.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.559+0000 7fd67d789700 1 -- 172.21.15.80:0/2155966765 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd678106510 con 0x7fd67810a3a0 2019-11-28T12:01:38.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.559+0000 7fd676ffd700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67810a3a0 0x7fd678108ce0 secure :-1 s=THROTTLE_DONE pgs=2987 cs=0 l=1 rx=0x7fd6600107d0 tx=0x7fd660010650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.559+0000 7fd66ffff700 1 -- 172.21.15.80:0/2155966765 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v230) v1 ==== 74+0+12010 (secure 0 0 0) 0x7fd660017920 con 0x7fd67810a3a0 2019-11-28T12:01:38.554 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:38.555 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":230,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T12:01:37.865607+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":37,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":220,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T12:01:38.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.562+0000 7fd67d789700 1 -- 172.21.15.80:0/2155966765 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd650018730 msgr2=0x7fd65001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.562+0000 7fd67d789700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd650018730 0x7fd65001abc0 crc :-1 s=READY pgs=1235 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.562+0000 7fd67d789700 1 -- 172.21.15.80:0/2155966765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67810a3a0 msgr2=0x7fd678108ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.562+0000 7fd67d789700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67810a3a0 0x7fd678108ce0 secure :-1 s=READY pgs=2987 cs=0 l=1 rx=0x7fd6600107d0 tx=0x7fd660010650).stop 2019-11-28T12:01:38.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.562+0000 7fd67d789700 1 -- 172.21.15.80:0/2155966765 shutdown_connections 2019-11-28T12:01:38.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.562+0000 7fd67d789700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd650018730 0x7fd65001abc0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.562+0000 7fd67d789700 1 --2- 172.21.15.80:0/2155966765 >> v2:172.21.15.174:3300/0 conn(0x7fd678109220 0x7fd678109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.562+0000 7fd67d789700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd67810a3a0 0x7fd678108ce0 unknown :-1 s=CLOSED pgs=2987 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.562+0000 7fd67d789700 1 --2- 172.21.15.80:0/2155966765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd67813dc00 0x7fd678109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.562+0000 7fd67d789700 1 -- 172.21.15.80:0/2155966765 shutdown_connections 2019-11-28T12:01:38.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.562+0000 7fd67d789700 1 -- 172.21.15.80:0/2155966765 wait complete. 2019-11-28T12:01:38.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.562+0000 7fd67d789700 1 -- 172.21.15.80:0/2155966765 >> 172.21.15.80:0/2155966765 conn(0x7fd67811bfc0 msgr2=0x7fd678141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:38.566 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T12:01:38.567 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T12:01:38.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.696+0000 7f7564a4a700 1 Processor -- start 2019-11-28T12:01:38.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.696+0000 7f7564a4a700 1 -- start start 2019-11-28T12:01:38.694 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f7564a4a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f756015ed10 0x7f756015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f7564a4a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7560073020 0x7f7560071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f7564a4a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f756006db60 con 0x7f75600734b0 2019-11-28T12:01:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f7564a4a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f756006f3d0 con 0x7f7560073020 2019-11-28T12:01:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f7564a4a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756006fe00 con 0x7f756015ed10 2019-11-28T12:01:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f755e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7560073020 0x7f7560071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:38.695 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f755e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7560073020 0x7f7560071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47636/0 (socket says 172.21.15.80:47636) 2019-11-28T12:01:38.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f755e59c700 1 -- 172.21.15.80:0/1922675153 learned_addr learned my addr 172.21.15.80:0/1922675153 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:38.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f755ed9d700 1 --2- 172.21.15.80:0/1922675153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f756015ed10 0x7f756015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:38.696 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f755e59c700 1 -- 172.21.15.80:0/1922675153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f756015ed10 msgr2=0x7f756015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:38.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f755e59c700 1 --2- 172.21.15.80:0/1922675153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f756015ed10 0x7f756015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:38.697 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f755e59c700 1 -- 172.21.15.80:0/1922675153 >> v1:172.21.15.174:6789/0 conn(0x7f75600734b0 legacy=0x7f75600723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f755e59c700 1 -- 172.21.15.80:0/1922675153 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7560070760 con 0x7f7560073020 2019-11-28T12:01:38.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f755e59c700 1 --2- 172.21.15.80:0/1922675153 >> v2:172.21.15.80:3300/0 conn(0x7f7560073020 0x7f7560071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f754800fac0 tx=0x7f754800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f755e59c700 1 --2- 172.21.15.80:0/1922675153 >> v2:172.21.15.80:3300/0 conn(0x7f7560073020 0x7f7560071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f754800fac0 tx=0x7f754800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f755e59c700 1 --2- 172.21.15.80:0/1922675153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560073020 0x7f7560071ea0 secure :-1 s=READY pgs=2988 cs=0 l=1 rx=0x7f754800fac0 tx=0x7f754800f8f0).ready entity=mon.0 client_cookie=f43922c15550dd15 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:38.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f755e59c700 1 --2- 172.21.15.80:0/1922675153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560073020 0x7f7560071ea0 secure :-1 s=THROTTLE_DONE pgs=2988 cs=0 l=1 rx=0x7f754800fac0 tx=0x7f754800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.700 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f755e59c700 1 --2- 172.21.15.80:0/1922675153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560073020 0x7f7560071ea0 secure :-1 s=THROTTLE_DONE pgs=2988 cs=0 l=1 rx=0x7f754800fac0 tx=0x7f754800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.698+0000 7f755e59c700 1 --2- 172.21.15.80:0/1922675153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560073020 0x7f7560071ea0 secure :-1 s=THROTTLE_DONE pgs=2988 cs=0 l=1 rx=0x7f754800fac0 tx=0x7f754800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.697+0000 7f755dd9b700 1 -- 172.21.15.80:0/1922675153 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7548000ce0 con 0x7f7560073020 2019-11-28T12:01:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.698+0000 7f755dd9b700 1 -- 172.21.15.80:0/1922675153 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7548001010 con 0x7f7560073020 2019-11-28T12:01:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.698+0000 7f755dd9b700 1 -- 172.21.15.80:0/1922675153 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7548001720 con 0x7f7560073020 2019-11-28T12:01:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.698+0000 7f7564a4a700 1 -- 172.21.15.80:0/1922675153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560073020 msgr2=0x7f7560071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.698+0000 7f7564a4a700 1 --2- 172.21.15.80:0/1922675153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560073020 0x7f7560071ea0 secure :-1 s=READY pgs=2988 cs=0 l=1 rx=0x7f754800fac0 tx=0x7f754800f8f0).stop 2019-11-28T12:01:38.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.698+0000 7f7564a4a700 1 -- 172.21.15.80:0/1922675153 shutdown_connections 2019-11-28T12:01:38.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.698+0000 7f7564a4a700 1 --2- 172.21.15.80:0/1922675153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560073020 0x7f7560071ea0 unknown :-1 s=CLOSED pgs=2988 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.698+0000 7f7564a4a700 1 --2- 172.21.15.80:0/1922675153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f756015ed10 0x7f756015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:38.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.698+0000 7f7564a4a700 1 -- 172.21.15.80:0/1922675153 shutdown_connections 2019-11-28T12:01:38.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.698+0000 7f7564a4a700 1 -- 172.21.15.80:0/1922675153 wait complete. 2019-11-28T12:01:38.704 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.698+0000 7f7564a4a700 1 -- 172.21.15.80:0/1922675153 >> 172.21.15.80:0/1922675153 conn(0x7f7560061d20 msgr2=0x7f75600641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:38.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.701+0000 7f7564a4a700 1 Processor -- start 2019-11-28T12:01:38.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.701+0000 7f7564a4a700 1 -- start start 2019-11-28T12:01:38.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f7564a4a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7560148320 0x7f756010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:38.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f7564a4a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f756010f290 0x7f756010dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:38.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f7564a4a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7560148e00 con 0x7f756010e110 2019-11-28T12:01:38.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f7564a4a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f756013aa20 con 0x7f7560148320 2019-11-28T12:01:38.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f7564a4a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f756013acf0 con 0x7f756010f290 2019-11-28T12:01:38.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f755ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7560148320 0x7f756010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:38.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f755ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7560148320 0x7f756010ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47638/0 (socket says 172.21.15.80:47638) 2019-11-28T12:01:38.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f755ed9d700 1 -- 172.21.15.80:0/2675954598 learned_addr learned my addr 172.21.15.80:0/2675954598 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:38.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f755e59c700 1 --2- 172.21.15.80:0/2675954598 >> v2:172.21.15.174:3300/0 conn(0x7f756010f290 0x7f756010dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:38.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f755ed9d700 1 -- 172.21.15.80:0/2675954598 >> v2:172.21.15.174:3300/0 conn(0x7f756010f290 msgr2=0x7f756010dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.709 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f755ed9d700 1 --2- 172.21.15.80:0/2675954598 >> v2:172.21.15.174:3300/0 conn(0x7f756010f290 0x7f756010dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f755ed9d700 1 -- 172.21.15.80:0/2675954598 >> v1:172.21.15.174:6789/0 conn(0x7f756010e110 legacy=0x7f75601079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f755ed9d700 1 -- 172.21.15.80:0/2675954598 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756010c490 con 0x7f7560148320 2019-11-28T12:01:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f755ed9d700 1 --2- 172.21.15.80:0/2675954598 >> v2:172.21.15.80:3300/0 conn(0x7f7560148320 0x7f756010ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7558010400 tx=0x7f7558010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f755ed9d700 1 --2- 172.21.15.80:0/2675954598 >> v2:172.21.15.80:3300/0 conn(0x7f7560148320 0x7f756010ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7558010400 tx=0x7f7558010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f755ed9d700 1 --2- 172.21.15.80:0/2675954598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560148320 0x7f756010ed50 secure :-1 s=READY pgs=2989 cs=0 l=1 rx=0x7f7558010400 tx=0x7f7558010280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f755ed9d700 1 --2- 172.21.15.80:0/2675954598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560148320 0x7f756010ed50 secure :-1 s=THROTTLE_DONE pgs=2989 cs=0 l=1 rx=0x7f7558010400 tx=0x7f7558010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f755ed9d700 1 --2- 172.21.15.80:0/2675954598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560148320 0x7f756010ed50 secure :-1 s=THROTTLE_DONE pgs=2989 cs=0 l=1 rx=0x7f7558010400 tx=0x7f7558010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f755ed9d700 1 --2- 172.21.15.80:0/2675954598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560148320 0x7f756010ed50 secure :-1 s=THROTTLE_DONE pgs=2989 cs=0 l=1 rx=0x7f7558010400 tx=0x7f7558010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f75577fe700 1 -- 172.21.15.80:0/2675954598 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7558000940 con 0x7f7560148320 2019-11-28T12:01:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f75577fe700 1 -- 172.21.15.80:0/2675954598 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7558001090 con 0x7f7560148320 2019-11-28T12:01:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f75577fe700 1 -- 172.21.15.80:0/2675954598 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75580075f0 con 0x7f7560148320 2019-11-28T12:01:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f7564a4a700 1 -- 172.21.15.80:0/2675954598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756010c810 con 0x7f7560148320 2019-11-28T12:01:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.702+0000 7f7564a4a700 1 -- 172.21.15.80:0/2675954598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756010c490 con 0x7f7560148320 2019-11-28T12:01:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.703+0000 7f755ed9d700 1 --2- 172.21.15.80:0/2675954598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560148320 0x7f756010ed50 secure :-1 s=THROTTLE_DONE pgs=2989 cs=0 l=1 rx=0x7f7558010400 tx=0x7f7558010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.703+0000 7f75577fe700 1 -- 172.21.15.80:0/2675954598 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7558000c90 con 0x7f7560148320 2019-11-28T12:01:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.703+0000 7f755ed9d700 1 --2- 172.21.15.80:0/2675954598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560148320 0x7f756010ed50 secure :-1 s=THROTTLE_DONE pgs=2989 cs=0 l=1 rx=0x7f7558010400 tx=0x7f7558010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.703+0000 7f75577fe700 1 --2- 172.21.15.80:0/2675954598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7538018730 0x7f753801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.703+0000 7f75577fe700 1 -- 172.21.15.80:0/2675954598 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(230..230 src has 1..230) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f7558031a60 con 0x7f7560148320 2019-11-28T12:01:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.703+0000 7f755e59c700 1 --2- 172.21.15.80:0/2675954598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7538018730 0x7f753801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.704+0000 7f755e59c700 1 --2- 172.21.15.80:0/2675954598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7538018730 0x7f753801abc0 crc :-1 s=READY pgs=1236 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.711+0000 7f7564a4a700 1 -- 172.21.15.80:0/2675954598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f756010c810 con 0x7f7560148320 2019-11-28T12:01:38.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.714+0000 7f755ed9d700 1 --2- 172.21.15.80:0/2675954598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560148320 0x7f756010ed50 secure :-1 s=THROTTLE_DONE pgs=2989 cs=0 l=1 rx=0x7f7558010400 tx=0x7f7558010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.714+0000 7f75577fe700 1 -- 172.21.15.80:0/2675954598 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7558000940 con 0x7f7560148320 2019-11-28T12:01:38.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.881+0000 7f7564a4a700 1 -- 172.21.15.80:0/2675954598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f756010c490 con 0x7f7560148320 2019-11-28T12:01:38.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.881+0000 7f755ed9d700 1 --2- 172.21.15.80:0/2675954598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560148320 0x7f756010ed50 secure :-1 s=THROTTLE_DONE pgs=2989 cs=0 l=1 rx=0x7f7558010400 tx=0x7f7558010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:38.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.881+0000 7f75577fe700 1 -- 172.21.15.80:0/2675954598 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v230) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7558000c90 con 0x7f7560148320 2019-11-28T12:01:38.876 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:01:38.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.884+0000 7f7564a4a700 1 -- 172.21.15.80:0/2675954598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7538018730 msgr2=0x7f753801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.884+0000 7f7564a4a700 1 --2- 172.21.15.80:0/2675954598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7538018730 0x7f753801abc0 crc :-1 s=READY pgs=1236 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.884+0000 7f7564a4a700 1 -- 172.21.15.80:0/2675954598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560148320 msgr2=0x7f756010ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:38.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.884+0000 7f7564a4a700 1 --2- 172.21.15.80:0/2675954598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560148320 0x7f756010ed50 secure :-1 s=READY pgs=2989 cs=0 l=1 rx=0x7f7558010400 tx=0x7f7558010280).stop 2019-11-28T12:01:38.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.884+0000 7f7564a4a700 1 -- 172.21.15.80:0/2675954598 shutdown_connections 2019-11-28T12:01:38.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.884+0000 7f7564a4a700 1 --2- 172.21.15.80:0/2675954598 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7538018730 0x7f753801abc0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.884+0000 7f7564a4a700 1 --2- 172.21.15.80:0/2675954598 >> v2:172.21.15.174:3300/0 conn(0x7f756010f290 0x7f756010dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.884+0000 7f7564a4a700 1 --2- 172.21.15.80:0/2675954598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7560148320 0x7f756010ed50 unknown :-1 s=CLOSED pgs=2989 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:38.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.884+0000 7f7564a4a700 1 -- 172.21.15.80:0/2675954598 shutdown_connections 2019-11-28T12:01:38.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.884+0000 7f7564a4a700 1 -- 172.21.15.80:0/2675954598 wait complete. 2019-11-28T12:01:38.881 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:38.884+0000 7f7564a4a700 1 -- 172.21.15.80:0/2675954598 >> 172.21.15.80:0/2675954598 conn(0x7f756015e2d0 msgr2=0x7f7560147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:38.888 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T12:01:39.012 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.014+0000 7fd4e942c700 1 Processor -- start 2019-11-28T12:01:39.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.014+0000 7fd4e942c700 1 -- start start 2019-11-28T12:01:39.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.015+0000 7fd4e942c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd4e406d120 0x7fd4e4165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:39.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.015+0000 7fd4e942c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e406d5a0 con 0x7fd4e406c0a0 2019-11-28T12:01:39.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.015+0000 7fd4e942c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e406db00 con 0x7fd4e406c490 2019-11-28T12:01:39.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.015+0000 7fd4e942c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e406fd60 con 0x7fd4e406d120 2019-11-28T12:01:39.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.015+0000 7fd4e37fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd4e406c0a0 0x7fd4e4072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46962/0 (socket says 172.21.15.80:46962) 2019-11-28T12:01:39.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.015+0000 7fd4e37fe700 1 -- 172.21.15.80:0/944839724 learned_addr learned my addr 172.21.15.80:0/944839724 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:39.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.015+0000 7fd4e3fff700 1 --2- 172.21.15.80:0/944839724 >> v2:172.21.15.174:3300/0 conn(0x7fd4e406d120 0x7fd4e4165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:39.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e27fc700 1 -- 172.21.15.80:0/944839724 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710156399 0 0) 0x7fd4d40014d0 con 0x7fd4e406c0a0 2019-11-28T12:01:39.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e27fc700 1 -- 172.21.15.80:0/944839724 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4d0002e80 con 0x7fd4e406c0a0 2019-11-28T12:01:39.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e27fc700 1 -- 172.21.15.80:0/944839724 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559048624 0 0) 0x7fd4cc001080 con 0x7fd4e406c490 2019-11-28T12:01:39.014 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e27fc700 1 -- 172.21.15.80:0/944839724 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4d00030b0 con 0x7fd4e406c490 2019-11-28T12:01:39.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e27fc700 1 -- 172.21.15.80:0/944839724 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1944936762 0 0) 0x7fd4d40014b0 con 0x7fd4e406c0a0 2019-11-28T12:01:39.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e3fff700 1 -- 172.21.15.80:0/944839724 >> v1:172.21.15.174:6789/0 conn(0x7fd4e406c490 legacy=0x7fd4e406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:39.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e3fff700 1 -- 172.21.15.80:0/944839724 >> v1:172.21.15.80:6789/0 conn(0x7fd4e406c0a0 legacy=0x7fd4e4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:39.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e3fff700 1 -- 172.21.15.80:0/944839724 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e40706c0 con 0x7fd4e406d120 2019-11-28T12:01:39.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e3fff700 1 --2- 172.21.15.80:0/944839724 >> v2:172.21.15.174:3300/0 conn(0x7fd4e406d120 0x7fd4e4165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd4dc00af80 tx=0x7fd4dc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e3fff700 1 --2- 172.21.15.80:0/944839724 >> v2:172.21.15.174:3300/0 conn(0x7fd4e406d120 0x7fd4e4165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd4dc00af80 tx=0x7fd4dc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e3fff700 1 --2- 172.21.15.80:0/944839724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e406d120 0x7fd4e4165d80 secure :-1 s=READY pgs=1803 cs=0 l=1 rx=0x7fd4dc00af80 tx=0x7fd4dc00b790).ready entity=mon.1 client_cookie=742e052721f231b0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:39.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e3fff700 1 --2- 172.21.15.80:0/944839724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e406d120 0x7fd4e4165d80 secure :-1 s=THROTTLE_DONE pgs=1803 cs=0 l=1 rx=0x7fd4dc00af80 tx=0x7fd4dc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e27fc700 1 -- 172.21.15.80:0/944839724 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4dc007240 con 0x7fd4e406d120 2019-11-28T12:01:39.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e3fff700 1 --2- 172.21.15.80:0/944839724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e406d120 0x7fd4e4165d80 secure :-1 s=THROTTLE_DONE pgs=1803 cs=0 l=1 rx=0x7fd4dc00af80 tx=0x7fd4dc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e3fff700 1 --2- 172.21.15.80:0/944839724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e406d120 0x7fd4e4165d80 secure :-1 s=THROTTLE_DONE pgs=1803 cs=0 l=1 rx=0x7fd4dc00af80 tx=0x7fd4dc00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e27fc700 1 -- 172.21.15.80:0/944839724 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc000bb0 con 0x7fd4e406d120 2019-11-28T12:01:39.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e27fc700 1 -- 172.21.15.80:0/944839724 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4dc009e60 con 0x7fd4e406d120 2019-11-28T12:01:39.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e942c700 1 -- 172.21.15.80:0/944839724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e406d120 msgr2=0x7fd4e4165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:39.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.016+0000 7fd4e942c700 1 --2- 172.21.15.80:0/944839724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e406d120 0x7fd4e4165d80 secure :-1 s=READY pgs=1803 cs=0 l=1 rx=0x7fd4dc00af80 tx=0x7fd4dc00b790).stop 2019-11-28T12:01:39.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.017+0000 7fd4e942c700 1 -- 172.21.15.80:0/944839724 shutdown_connections 2019-11-28T12:01:39.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.017+0000 7fd4e942c700 1 --2- 172.21.15.80:0/944839724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4e406d120 0x7fd4e4165d80 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:39.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.017+0000 7fd4e942c700 1 -- 172.21.15.80:0/944839724 shutdown_connections 2019-11-28T12:01:39.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.017+0000 7fd4e942c700 1 -- 172.21.15.80:0/944839724 wait complete. 2019-11-28T12:01:39.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.017+0000 7fd4e942c700 1 -- 172.21.15.80:0/944839724 >> 172.21.15.80:0/944839724 conn(0x7fd4e4061cf0 msgr2=0x7fd4e4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:39.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.019+0000 7fd4e942c700 1 Processor -- start 2019-11-28T12:01:39.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.019+0000 7fd4e942c700 1 -- start start 2019-11-28T12:01:39.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.020+0000 7fd4e942c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4142d00 0x7fd4e415b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:39.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.020+0000 7fd4e942c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd4e415bb80 0x7fd4e415a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:39.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.020+0000 7fd4e942c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e4125780 con 0x7fd4e415add0 2019-11-28T12:01:39.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.020+0000 7fd4e942c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e413b3b0 con 0x7fd4e415bb80 2019-11-28T12:01:39.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.020+0000 7fd4e942c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e4111140 con 0x7fd4e4142d00 2019-11-28T12:01:39.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4e37fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4142d00 0x7fd4e415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:39.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4e2ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd4e415bb80 0x7fd4e415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:39.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4e37fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4142d00 0x7fd4e415b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:49912/0 (socket says 172.21.15.80:49912) 2019-11-28T12:01:39.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4e37fe700 1 -- 172.21.15.80:0/2786702906 learned_addr learned my addr 172.21.15.80:0/2786702906 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:39.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4e37fe700 1 -- 172.21.15.80:0/2786702906 >> v2:172.21.15.174:3300/0 conn(0x7fd4e415bb80 msgr2=0x7fd4e415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:39.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4e37fe700 1 --2- 172.21.15.80:0/2786702906 >> v2:172.21.15.174:3300/0 conn(0x7fd4e415bb80 0x7fd4e415a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:39.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4e37fe700 1 -- 172.21.15.80:0/2786702906 >> v1:172.21.15.174:6789/0 conn(0x7fd4e415add0 legacy=0x7fd4e413e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:39.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4e37fe700 1 -- 172.21.15.80:0/2786702906 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e4158d10 con 0x7fd4e4142d00 2019-11-28T12:01:39.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4e37fe700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4142d00 0x7fd4e415b640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4d4010790 tx=0x7fd4d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4e37fe700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4142d00 0x7fd4e415b640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4d4010790 tx=0x7fd4d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4e37fe700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4142d00 0x7fd4e415b640 secure :-1 s=READY pgs=431 cs=0 l=1 rx=0x7fd4d4010790 tx=0x7fd4d40105f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:39.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4e37fe700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4142d00 0x7fd4e415b640 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7fd4d4010790 tx=0x7fd4d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4e37fe700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4142d00 0x7fd4e415b640 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7fd4d4010790 tx=0x7fd4d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4e37fe700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4142d00 0x7fd4e415b640 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7fd4d4010790 tx=0x7fd4d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4dbfff700 1 -- 172.21.15.80:0/2786702906 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d4001010 con 0x7fd4e4142d00 2019-11-28T12:01:39.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4dbfff700 1 -- 172.21.15.80:0/2786702906 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d4001440 con 0x7fd4e4142d00 2019-11-28T12:01:39.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4e942c700 1 -- 172.21.15.80:0/2786702906 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e4159090 con 0x7fd4e4142d00 2019-11-28T12:01:39.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4dbfff700 1 -- 172.21.15.80:0/2786702906 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d4001ad0 con 0x7fd4e4142d00 2019-11-28T12:01:39.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.021+0000 7fd4e942c700 1 -- 172.21.15.80:0/2786702906 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e4158d10 con 0x7fd4e4142d00 2019-11-28T12:01:39.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.022+0000 7fd4e37fe700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4142d00 0x7fd4e415b640 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7fd4d4010790 tx=0x7fd4d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.022+0000 7fd4dbfff700 1 -- 172.21.15.80:0/2786702906 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd4d4001010 con 0x7fd4e4142d00 2019-11-28T12:01:39.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.022+0000 7fd4e37fe700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4142d00 0x7fd4e415b640 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7fd4d4010790 tx=0x7fd4d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.022+0000 7fd4dbfff700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4c8018730 0x7fd4c801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:39.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.022+0000 7fd4dbfff700 1 -- 172.21.15.80:0/2786702906 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(230..230 src has 1..230) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fd4d4031df0 con 0x7fd4e4142d00 2019-11-28T12:01:39.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.022+0000 7fd4e2ffd700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4c8018730 0x7fd4c801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:39.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.022+0000 7fd4e2ffd700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4c8018730 0x7fd4c801abc0 crc :-1 s=READY pgs=1237 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:39.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.029+0000 7fd4e942c700 1 -- 172.21.15.80:0/2786702906 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e4159090 con 0x7fd4e4142d00 2019-11-28T12:01:39.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.033+0000 7fd4e37fe700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4142d00 0x7fd4e415b640 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7fd4d4010790 tx=0x7fd4d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.033+0000 7fd4dbfff700 1 -- 172.21.15.80:0/2786702906 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd4d4029f20 con 0x7fd4e4142d00 2019-11-28T12:01:39.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.194+0000 7fd4e942c700 1 -- 172.21.15.80:0/2786702906 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd4e4158d10 con 0x7fd4e4142d00 2019-11-28T12:01:39.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.195+0000 7fd4e37fe700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4142d00 0x7fd4e415b640 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7fd4d4010790 tx=0x7fd4d40105f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.195+0000 7fd4dbfff700 1 -- 172.21.15.80:0/2786702906 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v230) v1 ==== 84+0+64 (secure 0 0 0) 0x7fd4d4001320 con 0x7fd4e4142d00 2019-11-28T12:01:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:39.190 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T12:01:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:01:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T12:01:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T12:01:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:01:39.191 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T12:01:39.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.197+0000 7fd4e942c700 1 -- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4c8018730 msgr2=0x7fd4c801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:39.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.197+0000 7fd4e942c700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4c8018730 0x7fd4c801abc0 crc :-1 s=READY pgs=1237 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:39.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.197+0000 7fd4e942c700 1 -- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4142d00 msgr2=0x7fd4e415b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:39.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.197+0000 7fd4e942c700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4142d00 0x7fd4e415b640 secure :-1 s=READY pgs=431 cs=0 l=1 rx=0x7fd4d4010790 tx=0x7fd4d40105f0).stop 2019-11-28T12:01:39.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.197+0000 7fd4e942c700 1 -- 172.21.15.80:0/2786702906 shutdown_connections 2019-11-28T12:01:39.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.197+0000 7fd4e942c700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd4c8018730 0x7fd4c801abc0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:39.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.197+0000 7fd4e942c700 1 --2- 172.21.15.80:0/2786702906 >> v2:172.21.15.174:3300/0 conn(0x7fd4e415bb80 0x7fd4e415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:39.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.197+0000 7fd4e942c700 1 --2- 172.21.15.80:0/2786702906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4e4142d00 0x7fd4e415b640 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:39.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.198+0000 7fd4e942c700 1 -- 172.21.15.80:0/2786702906 shutdown_connections 2019-11-28T12:01:39.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.198+0000 7fd4e942c700 1 -- 172.21.15.80:0/2786702906 wait complete. 2019-11-28T12:01:39.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.198+0000 7fd4e942c700 1 -- 172.21.15.80:0/2786702906 >> 172.21.15.80:0/2786702906 conn(0x7fd4e407c680 msgr2=0x7fd4e4112150 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:39.201 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T12:01:39.202 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T12:01:39.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.331+0000 7efe097d9700 1 Processor -- start 2019-11-28T12:01:39.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.331+0000 7efe097d9700 1 -- start start 2019-11-28T12:01:39.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.332+0000 7efe097d9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0415f100 0x7efe0406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:39.330 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.332+0000 7efe097d9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe0406c2f0 0x7efe0406c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.332+0000 7efe097d9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0406db60 con 0x7efe0415ed10 2019-11-28T12:01:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.332+0000 7efe097d9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0406fe00 con 0x7efe0406c2f0 2019-11-28T12:01:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.332+0000 7efe097d9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe040700d0 con 0x7efe0415f100 2019-11-28T12:01:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe03fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe0406c2f0 0x7efe0406c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe03fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efe0406c2f0 0x7efe0406c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47662/0 (socket says 172.21.15.80:47662) 2019-11-28T12:01:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe03fff700 1 -- 172.21.15.80:0/928464028 learned_addr learned my addr 172.21.15.80:0/928464028 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:39.331 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe02ffd700 1 --2- 172.21.15.80:0/928464028 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0415f100 0x7efe0406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:39.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe03fff700 1 -- 172.21.15.80:0/928464028 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0415f100 msgr2=0x7efe0406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:39.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe03fff700 1 --2- 172.21.15.80:0/928464028 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0415f100 0x7efe0406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:39.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe03fff700 1 -- 172.21.15.80:0/928464028 >> v1:172.21.15.174:6789/0 conn(0x7efe0415ed10 legacy=0x7efe04073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:39.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe027fc700 1 -- 172.21.15.80:0/928464028 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2394845554 0 0) 0x7efdf4001080 con 0x7efe0415ed10 2019-11-28T12:01:39.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe03fff700 1 -- 172.21.15.80:0/928464028 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe04070760 con 0x7efe0406c2f0 2019-11-28T12:01:39.332 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe03fff700 1 --2- 172.21.15.80:0/928464028 >> v2:172.21.15.80:3300/0 conn(0x7efe0406c2f0 0x7efe0406c790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efdfc00f730 tx=0x7efdfc007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe03fff700 1 --2- 172.21.15.80:0/928464028 >> v2:172.21.15.80:3300/0 conn(0x7efe0406c2f0 0x7efe0406c790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efdfc00f730 tx=0x7efdfc007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe03fff700 1 --2- 172.21.15.80:0/928464028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe0406c2f0 0x7efe0406c790 secure :-1 s=READY pgs=2991 cs=0 l=1 rx=0x7efdfc00f730 tx=0x7efdfc007d50).ready entity=mon.0 client_cookie=92a5d4f6bfec565e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:39.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe03fff700 1 --2- 172.21.15.80:0/928464028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe0406c2f0 0x7efe0406c790 secure :-1 s=THROTTLE_DONE pgs=2991 cs=0 l=1 rx=0x7efdfc00f730 tx=0x7efdfc007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe027fc700 1 -- 172.21.15.80:0/928464028 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdfc000a70 con 0x7efe0406c2f0 2019-11-28T12:01:39.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe03fff700 1 --2- 172.21.15.80:0/928464028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe0406c2f0 0x7efe0406c790 secure :-1 s=THROTTLE_DONE pgs=2991 cs=0 l=1 rx=0x7efdfc00f730 tx=0x7efdfc007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe03fff700 1 --2- 172.21.15.80:0/928464028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe0406c2f0 0x7efe0406c790 secure :-1 s=THROTTLE_DONE pgs=2991 cs=0 l=1 rx=0x7efdfc00f730 tx=0x7efdfc007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.333 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe027fc700 1 -- 172.21.15.80:0/928464028 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc0010e0 con 0x7efe0406c2f0 2019-11-28T12:01:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe027fc700 1 -- 172.21.15.80:0/928464028 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdfc0017b0 con 0x7efe0406c2f0 2019-11-28T12:01:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe097d9700 1 -- 172.21.15.80:0/928464028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe0406c2f0 msgr2=0x7efe0406c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.333+0000 7efe097d9700 1 --2- 172.21.15.80:0/928464028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe0406c2f0 0x7efe0406c790 secure :-1 s=READY pgs=2991 cs=0 l=1 rx=0x7efdfc00f730 tx=0x7efdfc007d50).stop 2019-11-28T12:01:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.334+0000 7efe097d9700 1 -- 172.21.15.80:0/928464028 shutdown_connections 2019-11-28T12:01:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.334+0000 7efe097d9700 1 --2- 172.21.15.80:0/928464028 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe0406c2f0 0x7efe0406c790 unknown :-1 s=CLOSED pgs=2991 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:39.334 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.334+0000 7efe097d9700 1 --2- 172.21.15.80:0/928464028 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0415f100 0x7efe0406bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:39.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.334+0000 7efe097d9700 1 -- 172.21.15.80:0/928464028 shutdown_connections 2019-11-28T12:01:39.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.334+0000 7efe097d9700 1 -- 172.21.15.80:0/928464028 wait complete. 2019-11-28T12:01:39.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.334+0000 7efe097d9700 1 -- 172.21.15.80:0/928464028 >> 172.21.15.80:0/928464028 conn(0x7efe04061d20 msgr2=0x7efe040641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.336+0000 7efe097d9700 1 Processor -- start 2019-11-28T12:01:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.337+0000 7efe097d9700 1 -- start start 2019-11-28T12:01:39.338 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.337+0000 7efe097d9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0412e130 0x7efe0412e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.337+0000 7efe097d9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe0412eb00 0x7efe0410e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.337+0000 7efe097d9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe041542b0 con 0x7efe04153890 2019-11-28T12:01:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.337+0000 7efe097d9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe04110bb0 con 0x7efe0412eb00 2019-11-28T12:01:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.337+0000 7efe097d9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe04110e80 con 0x7efe0412e130 2019-11-28T12:01:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe02ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0412e130 0x7efe0412e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe03fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe0412eb00 0x7efe0410e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:39.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe02ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0412e130 0x7efe0412e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:49926/0 (socket says 172.21.15.80:49926) 2019-11-28T12:01:39.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe02ffd700 1 -- 172.21.15.80:0/1003701933 learned_addr learned my addr 172.21.15.80:0/1003701933 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:39.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe03fff700 1 -- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0412e130 msgr2=0x7efe0412e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:39.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe03fff700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0412e130 0x7efe0412e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:39.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe03fff700 1 -- 172.21.15.80:0/1003701933 >> v1:172.21.15.174:6789/0 conn(0x7efe04153890 legacy=0x7efe04115020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:39.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe03fff700 1 -- 172.21.15.80:0/1003701933 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe04112760 con 0x7efe0412eb00 2019-11-28T12:01:39.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe02ffd700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0412e130 0x7efe0412e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe03fff700 1 --2- 172.21.15.80:0/1003701933 >> v2:172.21.15.174:3300/0 conn(0x7efe0412eb00 0x7efe0410e2f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efdfc0103a0 tx=0x7efdfc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe03fff700 1 --2- 172.21.15.80:0/1003701933 >> v2:172.21.15.174:3300/0 conn(0x7efe0412eb00 0x7efe0410e2f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efdfc0103a0 tx=0x7efdfc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe03fff700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe0412eb00 0x7efe0410e2f0 secure :-1 s=READY pgs=1807 cs=0 l=1 rx=0x7efdfc0103a0 tx=0x7efdfc010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe03fff700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe0412eb00 0x7efe0410e2f0 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7efdfc0103a0 tx=0x7efdfc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe03fff700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe0412eb00 0x7efe0410e2f0 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7efdfc0103a0 tx=0x7efdfc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe03fff700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe0412eb00 0x7efe0410e2f0 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7efdfc0103a0 tx=0x7efdfc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.342 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efdfbfff700 1 -- 172.21.15.80:0/1003701933 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdfc008180 con 0x7efe0412eb00 2019-11-28T12:01:39.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efdfbfff700 1 -- 172.21.15.80:0/1003701933 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc007f10 con 0x7efe0412eb00 2019-11-28T12:01:39.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe097d9700 1 -- 172.21.15.80:0/1003701933 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe04112ae0 con 0x7efe0412eb00 2019-11-28T12:01:39.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efdfbfff700 1 -- 172.21.15.80:0/1003701933 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdfc001690 con 0x7efe0412eb00 2019-11-28T12:01:39.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.338+0000 7efe097d9700 1 -- 172.21.15.80:0/1003701933 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe04112760 con 0x7efe0412eb00 2019-11-28T12:01:39.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.339+0000 7efe03fff700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe0412eb00 0x7efe0410e2f0 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7efdfc0103a0 tx=0x7efdfc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.343 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.339+0000 7efdfbfff700 1 -- 172.21.15.80:0/1003701933 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efdfc001200 con 0x7efe0412eb00 2019-11-28T12:01:39.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.339+0000 7efe03fff700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe0412eb00 0x7efe0410e2f0 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7efdfc0103a0 tx=0x7efdfc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.339+0000 7efdfbfff700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efddc018730 0x7efddc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:39.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.339+0000 7efdfbfff700 1 -- 172.21.15.80:0/1003701933 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(230..230 src has 1..230) v4 ==== 5200+0+0 (secure 0 0 0) 0x7efdfc0319d0 con 0x7efe0412eb00 2019-11-28T12:01:39.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.339+0000 7efe037fe700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efddc018730 0x7efddc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:39.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.340+0000 7efe037fe700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efddc018730 0x7efddc01abc0 crc :-1 s=READY pgs=1238 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:39.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.347+0000 7efe097d9700 1 -- 172.21.15.80:0/1003701933 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe04112ae0 con 0x7efe0412eb00 2019-11-28T12:01:39.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.351+0000 7efe03fff700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe0412eb00 0x7efe0410e2f0 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7efdfc0103a0 tx=0x7efdfc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.351+0000 7efdfbfff700 1 -- 172.21.15.80:0/1003701933 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efdfc000eb0 con 0x7efe0412eb00 2019-11-28T12:01:39.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.517+0000 7efe097d9700 1 -- 172.21.15.80:0/1003701933 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7efe04112760 con 0x7efe0412eb00 2019-11-28T12:01:39.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.877+0000 7efe03fff700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe0412eb00 0x7efe0410e2f0 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7efdfc0103a0 tx=0x7efdfc010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:39.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.877+0000 7efdfbfff700 1 -- 172.21.15.80:0/1003701933 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v231) v1 ==== 133+0+0 (secure 0 0 0) 0x7efdfc001160 con 0x7efe0412eb00 2019-11-28T12:01:39.875 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T12:01:39.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.884+0000 7efe097d9700 1 -- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efddc018730 msgr2=0x7efddc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:39.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.884+0000 7efe097d9700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efddc018730 0x7efddc01abc0 crc :-1 s=READY pgs=1238 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:39.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.884+0000 7efe097d9700 1 -- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe0412eb00 msgr2=0x7efe0410e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:39.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.884+0000 7efe097d9700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe0412eb00 0x7efe0410e2f0 secure :-1 s=READY pgs=1807 cs=0 l=1 rx=0x7efdfc0103a0 tx=0x7efdfc010740).stop 2019-11-28T12:01:39.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.884+0000 7efe097d9700 1 -- 172.21.15.80:0/1003701933 shutdown_connections 2019-11-28T12:01:39.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.884+0000 7efe097d9700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe0412eb00 0x7efe0410e2f0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:39.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.884+0000 7efe097d9700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0412e130 0x7efe0412e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:39.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.884+0000 7efe097d9700 1 --2- 172.21.15.80:0/1003701933 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efddc018730 0x7efddc01abc0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:39.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.884+0000 7efe097d9700 1 -- 172.21.15.80:0/1003701933 shutdown_connections 2019-11-28T12:01:39.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.884+0000 7efe097d9700 1 -- 172.21.15.80:0/1003701933 wait complete. 2019-11-28T12:01:39.880 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:39.884+0000 7efe097d9700 1 -- 172.21.15.80:0/1003701933 >> 172.21.15.80:0/1003701933 conn(0x7efe0414f9f0 msgr2=0x7efe04111c60 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:39.888 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T12:01:40.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.018+0000 7f1107355700 1 Processor -- start 2019-11-28T12:01:40.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.018+0000 7f1107355700 1 -- start start 2019-11-28T12:01:40.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.019+0000 7f1107355700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f110015ed10 0x7f110015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:40.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.019+0000 7f1107355700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f11000734b0 0x7f11000726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:40.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.019+0000 7f1107355700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110006db60 con 0x7f1100073020 2019-11-28T12:01:40.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.019+0000 7f1107355700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110006fe00 con 0x7f110015ed10 2019-11-28T12:01:40.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.019+0000 7f1107355700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11000700d0 con 0x7f11000734b0 2019-11-28T12:01:40.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.019+0000 7f11058f2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f110015ed10 0x7f110015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:40.022 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.019+0000 7f11058f2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f110015ed10 0x7f110015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47674/0 (socket says 172.21.15.80:47674) 2019-11-28T12:01:40.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.019+0000 7f11058f2700 1 -- 172.21.15.80:0/2024667558 learned_addr learned my addr 172.21.15.80:0/2024667558 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:40.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.019+0000 7f11060f3700 1 --2- 172.21.15.80:0/2024667558 >> v2:172.21.15.174:3300/0 conn(0x7f11000734b0 0x7f11000726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:40.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.019+0000 7f11058f2700 1 -- 172.21.15.80:0/2024667558 >> v2:172.21.15.174:3300/0 conn(0x7f11000734b0 msgr2=0x7f11000726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:40.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.019+0000 7f11058f2700 1 --2- 172.21.15.80:0/2024667558 >> v2:172.21.15.174:3300/0 conn(0x7f11000734b0 0x7f11000726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:40.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.019+0000 7f11058f2700 1 -- 172.21.15.80:0/2024667558 >> v1:172.21.15.174:6789/0 conn(0x7f1100073020 legacy=0x7f1100071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:40.023 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.019+0000 7f11058f2700 1 -- 172.21.15.80:0/2024667558 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1100070760 con 0x7f110015ed10 2019-11-28T12:01:40.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.019+0000 7f11058f2700 1 --2- 172.21.15.80:0/2024667558 >> v2:172.21.15.80:3300/0 conn(0x7f110015ed10 0x7f110015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f10f000fa40 tx=0x7f10f000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:40.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.020+0000 7f11058f2700 1 --2- 172.21.15.80:0/2024667558 >> v2:172.21.15.80:3300/0 conn(0x7f110015ed10 0x7f110015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f10f000fa40 tx=0x7f10f000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:40.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.020+0000 7f11058f2700 1 --2- 172.21.15.80:0/2024667558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015ed10 0x7f110015f100 secure :-1 s=READY pgs=2992 cs=0 l=1 rx=0x7f10f000fa40 tx=0x7f10f000fde0).ready entity=mon.0 client_cookie=846895dc4aed38f4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:40.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.020+0000 7f11058f2700 1 --2- 172.21.15.80:0/2024667558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015ed10 0x7f110015f100 secure :-1 s=THROTTLE_DONE pgs=2992 cs=0 l=1 rx=0x7f10f000fa40 tx=0x7f10f000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:40.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.020+0000 7f11048f0700 1 -- 172.21.15.80:0/2024667558 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10f0000ce0 con 0x7f110015ed10 2019-11-28T12:01:40.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.020+0000 7f11058f2700 1 --2- 172.21.15.80:0/2024667558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015ed10 0x7f110015f100 secure :-1 s=THROTTLE_DONE pgs=2992 cs=0 l=1 rx=0x7f10f000fa40 tx=0x7f10f000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:40.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.020+0000 7f11058f2700 1 --2- 172.21.15.80:0/2024667558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015ed10 0x7f110015f100 secure :-1 s=THROTTLE_DONE pgs=2992 cs=0 l=1 rx=0x7f10f000fa40 tx=0x7f10f000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:40.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.020+0000 7f11048f0700 1 -- 172.21.15.80:0/2024667558 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f0001010 con 0x7f110015ed10 2019-11-28T12:01:40.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.020+0000 7f11048f0700 1 -- 172.21.15.80:0/2024667558 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10f0001720 con 0x7f110015ed10 2019-11-28T12:01:40.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.020+0000 7f1107355700 1 -- 172.21.15.80:0/2024667558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015ed10 msgr2=0x7f110015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:40.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.020+0000 7f1107355700 1 --2- 172.21.15.80:0/2024667558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015ed10 0x7f110015f100 secure :-1 s=READY pgs=2992 cs=0 l=1 rx=0x7f10f000fa40 tx=0x7f10f000fde0).stop 2019-11-28T12:01:40.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.020+0000 7f1107355700 1 -- 172.21.15.80:0/2024667558 shutdown_connections 2019-11-28T12:01:40.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.020+0000 7f1107355700 1 --2- 172.21.15.80:0/2024667558 >> v2:172.21.15.174:3300/0 conn(0x7f11000734b0 0x7f11000726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:40.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.020+0000 7f1107355700 1 --2- 172.21.15.80:0/2024667558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015ed10 0x7f110015f100 unknown :-1 s=CLOSED pgs=2992 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:40.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.021+0000 7f1107355700 1 -- 172.21.15.80:0/2024667558 shutdown_connections 2019-11-28T12:01:40.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.021+0000 7f1107355700 1 -- 172.21.15.80:0/2024667558 wait complete. 2019-11-28T12:01:40.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.021+0000 7f1107355700 1 -- 172.21.15.80:0/2024667558 >> 172.21.15.80:0/2024667558 conn(0x7f1100061d20 msgr2=0x7f11000641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:40.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.023+0000 7f1107355700 1 Processor -- start 2019-11-28T12:01:40.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.023+0000 7f1107355700 1 -- start start 2019-11-28T12:01:40.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f1107355700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f110015f800 0x7f1100156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:40.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f1107355700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f11001566b0 0x7f1100155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f1107355700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110015cb50 con 0x7f11001555a0 2019-11-28T12:01:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f1107355700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1100102e00 con 0x7f110015f800 2019-11-28T12:01:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f1107355700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11001030d0 con 0x7f11001566b0 2019-11-28T12:01:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f11058f2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f110015f800 0x7f1100156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f11058f2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f110015f800 0x7f1100156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47682/0 (socket says 172.21.15.80:47682) 2019-11-28T12:01:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f11058f2700 1 -- 172.21.15.80:0/4223647640 learned_addr learned my addr 172.21.15.80:0/4223647640 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f11058f2700 1 -- 172.21.15.80:0/4223647640 >> v2:172.21.15.174:3300/0 conn(0x7f11001566b0 msgr2=0x7f1100155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f11050f1700 1 --2- 172.21.15.80:0/4223647640 >> v2:172.21.15.174:3300/0 conn(0x7f11001566b0 0x7f1100155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f11058f2700 1 --2- 172.21.15.80:0/4223647640 >> v2:172.21.15.174:3300/0 conn(0x7f11001566b0 0x7f1100155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f11058f2700 1 -- 172.21.15.80:0/4223647640 >> v1:172.21.15.174:6789/0 conn(0x7f11001555a0 legacy=0x7f1100110bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f11058f2700 1 -- 172.21.15.80:0/4223647640 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1100103760 con 0x7f110015f800 2019-11-28T12:01:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f11050f1700 1 --2- 172.21.15.80:0/4223647640 >> v2:172.21.15.174:3300/0 conn(0x7f11001566b0 0x7f1100155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T12:01:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f11058f2700 1 --2- 172.21.15.80:0/4223647640 >> v2:172.21.15.80:3300/0 conn(0x7f110015f800 0x7f1100156170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10f00107c0 tx=0x7f10f0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:40.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f11058f2700 1 --2- 172.21.15.80:0/4223647640 >> v2:172.21.15.80:3300/0 conn(0x7f110015f800 0x7f1100156170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10f00107c0 tx=0x7f10f0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:40.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.024+0000 7f11058f2700 1 --2- 172.21.15.80:0/4223647640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015f800 0x7f1100156170 secure :-1 s=READY pgs=2993 cs=0 l=1 rx=0x7f10f00107c0 tx=0x7f10f0010b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:40.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.025+0000 7f11058f2700 1 --2- 172.21.15.80:0/4223647640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015f800 0x7f1100156170 secure :-1 s=THROTTLE_DONE pgs=2993 cs=0 l=1 rx=0x7f10f00107c0 tx=0x7f10f0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:40.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.025+0000 7f11058f2700 1 --2- 172.21.15.80:0/4223647640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015f800 0x7f1100156170 secure :-1 s=THROTTLE_DONE pgs=2993 cs=0 l=1 rx=0x7f10f00107c0 tx=0x7f10f0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:40.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.025+0000 7f11058f2700 1 --2- 172.21.15.80:0/4223647640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015f800 0x7f1100156170 secure :-1 s=THROTTLE_DONE pgs=2993 cs=0 l=1 rx=0x7f10f00107c0 tx=0x7f10f0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:40.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.025+0000 7f10fe7fc700 1 -- 172.21.15.80:0/4223647640 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10f0000cc0 con 0x7f110015f800 2019-11-28T12:01:40.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.025+0000 7f10fe7fc700 1 -- 172.21.15.80:0/4223647640 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f00012d0 con 0x7f110015f800 2019-11-28T12:01:40.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.025+0000 7f1107355700 1 -- 172.21.15.80:0/4223647640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1100103ae0 con 0x7f110015f800 2019-11-28T12:01:40.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.025+0000 7f10fe7fc700 1 -- 172.21.15.80:0/4223647640 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10f0001920 con 0x7f110015f800 2019-11-28T12:01:40.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.025+0000 7f1107355700 1 -- 172.21.15.80:0/4223647640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1100104bc0 con 0x7f110015f800 2019-11-28T12:01:40.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.025+0000 7f11058f2700 1 --2- 172.21.15.80:0/4223647640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015f800 0x7f1100156170 secure :-1 s=THROTTLE_DONE pgs=2993 cs=0 l=1 rx=0x7f10f00107c0 tx=0x7f10f0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:40.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.025+0000 7f10fe7fc700 1 -- 172.21.15.80:0/4223647640 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f10f00014c0 con 0x7f110015f800 2019-11-28T12:01:40.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.025+0000 7f11058f2700 1 --2- 172.21.15.80:0/4223647640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015f800 0x7f1100156170 secure :-1 s=THROTTLE_DONE pgs=2993 cs=0 l=1 rx=0x7f10f00107c0 tx=0x7f10f0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:40.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.025+0000 7f10fe7fc700 1 --2- 172.21.15.80:0/4223647640 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10e0018730 0x7f10e001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:40.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.025+0000 7f10fe7fc700 1 -- 172.21.15.80:0/4223647640 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(231..231 src has 1..231) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f10f0034250 con 0x7f110015f800 2019-11-28T12:01:40.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.026+0000 7f11050f1700 1 --2- 172.21.15.80:0/4223647640 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10e0018730 0x7f10e001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:40.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.026+0000 7f11050f1700 1 --2- 172.21.15.80:0/4223647640 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10e0018730 0x7f10e001abe0 crc :-1 s=READY pgs=1239 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:40.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.033+0000 7f1107355700 1 -- 172.21.15.80:0/4223647640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1100103760 con 0x7f110015f800 2019-11-28T12:01:40.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.037+0000 7f11058f2700 1 --2- 172.21.15.80:0/4223647640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015f800 0x7f1100156170 secure :-1 s=THROTTLE_DONE pgs=2993 cs=0 l=1 rx=0x7f10f00107c0 tx=0x7f10f0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:40.033 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.037+0000 7f10fe7fc700 1 -- 172.21.15.80:0/4223647640 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f10f0000ed0 con 0x7f110015f800 2019-11-28T12:01:40.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.205+0000 7f1107355700 1 -- 172.21.15.80:0/4223647640 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f1100103ae0 con 0x7f110015f800 2019-11-28T12:01:40.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.881+0000 7f11058f2700 1 --2- 172.21.15.80:0/4223647640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015f800 0x7f1100156170 secure :-1 s=THROTTLE_DONE pgs=2993 cs=0 l=1 rx=0x7f10f00107c0 tx=0x7f10f0010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:40.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.881+0000 7f10fe7fc700 1 -- 172.21.15.80:0/4223647640 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v232) v1 ==== 125+0+0 (secure 0 0 0) 0x7f10f0021e10 con 0x7f110015f800 2019-11-28T12:01:40.914 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T12:01:40.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.922+0000 7f1107355700 1 -- 172.21.15.80:0/4223647640 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10e0018730 msgr2=0x7f10e001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:40.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.922+0000 7f1107355700 1 --2- 172.21.15.80:0/4223647640 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10e0018730 0x7f10e001abe0 crc :-1 s=READY pgs=1239 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:40.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.922+0000 7f1107355700 1 -- 172.21.15.80:0/4223647640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015f800 msgr2=0x7f1100156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:40.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.922+0000 7f1107355700 1 --2- 172.21.15.80:0/4223647640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015f800 0x7f1100156170 secure :-1 s=READY pgs=2993 cs=0 l=1 rx=0x7f10f00107c0 tx=0x7f10f0010b60).stop 2019-11-28T12:01:40.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.922+0000 7f1107355700 1 -- 172.21.15.80:0/4223647640 shutdown_connections 2019-11-28T12:01:40.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.922+0000 7f1107355700 1 --2- 172.21.15.80:0/4223647640 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10e0018730 0x7f10e001abe0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:40.918 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.922+0000 7f1107355700 1 --2- 172.21.15.80:0/4223647640 >> v2:172.21.15.174:3300/0 conn(0x7f11001566b0 0x7f1100155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:40.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.922+0000 7f1107355700 1 --2- 172.21.15.80:0/4223647640 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f110015f800 0x7f1100156170 unknown :-1 s=CLOSED pgs=2993 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:40.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.922+0000 7f1107355700 1 -- 172.21.15.80:0/4223647640 shutdown_connections 2019-11-28T12:01:40.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.922+0000 7f1107355700 1 -- 172.21.15.80:0/4223647640 wait complete. 2019-11-28T12:01:40.919 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:40.922+0000 7f1107355700 1 -- 172.21.15.80:0/4223647640 >> 172.21.15.80:0/4223647640 conn(0x7f110007c4f0 msgr2=0x7f110015ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:40.927 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T12:01:41.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.056+0000 7f9fed219700 1 Processor -- start 2019-11-28T12:01:41.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.056+0000 7f9fed219700 1 -- start start 2019-11-28T12:01:41.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.057+0000 7f9fed219700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fe81639f0 0x7f9fe8165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:41.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.057+0000 7f9fed219700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe806db60 con 0x7f9fe815ed10 2019-11-28T12:01:41.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.057+0000 7f9fed219700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe806e060 con 0x7f9fe815f100 2019-11-28T12:01:41.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.057+0000 7f9fed219700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe806fe00 con 0x7f9fe81639f0 2019-11-28T12:01:41.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.057+0000 7f9fe759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9fe815ed10 0x7f9fe8073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47004/0 (socket says 172.21.15.80:47004) 2019-11-28T12:01:41.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.057+0000 7f9fe759e700 1 -- 172.21.15.80:0/4278254483 learned_addr learned my addr 172.21.15.80:0/4278254483 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:41.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9feca18700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fe81639f0 0x7f9fe8165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe659c700 1 -- 172.21.15.80:0/4278254483 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168034412 0 0) 0x7f9fd80014d0 con 0x7f9fe815ed10 2019-11-28T12:01:41.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe659c700 1 -- 172.21.15.80:0/4278254483 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fc8002e80 con 0x7f9fe815ed10 2019-11-28T12:01:41.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe659c700 1 -- 172.21.15.80:0/4278254483 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1841539854 0 0) 0x7f9fd80014b0 con 0x7f9fe815ed10 2019-11-28T12:01:41.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe659c700 1 -- 172.21.15.80:0/4278254483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fe81639f0 msgr2=0x7f9fe8165df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:41.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe659c700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fe81639f0 0x7f9fe8165df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:41.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe659c700 1 -- 172.21.15.80:0/4278254483 >> v1:172.21.15.174:6789/0 conn(0x7f9fe815f100 legacy=0x7f9fe806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe659c700 1 -- 172.21.15.80:0/4278254483 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe8070760 con 0x7f9fe815ed10 2019-11-28T12:01:41.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe659c700 1 -- 172.21.15.80:0/4278254483 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f9fd80019e0 con 0x7f9fe815ed10 2019-11-28T12:01:41.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe659c700 1 -- 172.21.15.80:0/4278254483 >> v1:172.21.15.80:6789/0 conn(0x7f9fe815ed10 legacy=0x7f9fe8073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe659c700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc8003ab0 0x7f9fc8005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:41.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe659c700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fc8006690 0x7f9fc8008af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:41.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe659c700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fc80092f0 0x7f9fc800b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:41.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe659c700 1 -- 172.21.15.80:0/4278254483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc800bfd0 con 0x7f9fc80092f0 2019-11-28T12:01:41.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe659c700 1 -- 172.21.15.80:0/4278254483 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc80501d0 con 0x7f9fc8003ab0 2019-11-28T12:01:41.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe659c700 1 -- 172.21.15.80:0/4278254483 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc8050400 con 0x7f9fc8006690 2019-11-28T12:01:41.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9feca18700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fc80092f0 0x7f9fc800b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe759e700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc8003ab0 0x7f9fc8005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe6d9d700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fc8006690 0x7f9fc8008af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9feca18700 1 -- 172.21.15.80:0/4278254483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fc8006690 msgr2=0x7f9fc8008af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9feca18700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fc8006690 0x7f9fc8008af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9feca18700 1 -- 172.21.15.80:0/4278254483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc8003ab0 msgr2=0x7f9fc8005f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9feca18700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc8003ab0 0x7f9fc8005f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:41.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9feca18700 1 -- 172.21.15.80:0/4278254483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc80506b0 con 0x7f9fc80092f0 2019-11-28T12:01:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9fe6d9d700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fc8006690 0x7f9fc8008af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T12:01:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9feca18700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fc80092f0 0x7f9fc800b7c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9fe000af90 tx=0x7f9fe000b310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.058+0000 7f9feca18700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fc80092f0 0x7f9fc800b7c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9fe000af90 tx=0x7f9fe000b310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.059+0000 7f9feca18700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fc80092f0 0x7f9fc800b7c0 secure :-1 s=READY pgs=2995 cs=0 l=1 rx=0x7f9fe000af90 tx=0x7f9fe000b310).ready entity=mon.0 client_cookie=b3597d3722f41c0e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:41.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.059+0000 7f9feca18700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fc80092f0 0x7f9fc800b7c0 secure :-1 s=THROTTLE_DONE pgs=2995 cs=0 l=1 rx=0x7f9fe000af90 tx=0x7f9fe000b310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.059+0000 7f9feca18700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fc80092f0 0x7f9fc800b7c0 secure :-1 s=THROTTLE_DONE pgs=2995 cs=0 l=1 rx=0x7f9fe000af90 tx=0x7f9fe000b310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.059+0000 7f9fe659c700 1 -- 172.21.15.80:0/4278254483 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe0000b50 con 0x7f9fc80092f0 2019-11-28T12:01:41.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.059+0000 7f9feca18700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fc80092f0 0x7f9fc800b7c0 secure :-1 s=THROTTLE_DONE pgs=2995 cs=0 l=1 rx=0x7f9fe000af90 tx=0x7f9fe000b310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.059+0000 7f9fe659c700 1 -- 172.21.15.80:0/4278254483 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe000eea0 con 0x7f9fc80092f0 2019-11-28T12:01:41.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.059+0000 7f9fe659c700 1 -- 172.21.15.80:0/4278254483 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe000f570 con 0x7f9fc80092f0 2019-11-28T12:01:41.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.059+0000 7f9fed219700 1 -- 172.21.15.80:0/4278254483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fc80092f0 msgr2=0x7f9fc800b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.059+0000 7f9fed219700 1 --2- 172.21.15.80:0/4278254483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fc80092f0 0x7f9fc800b7c0 secure :-1 s=READY pgs=2995 cs=0 l=1 rx=0x7f9fe000af90 tx=0x7f9fe000b310).stop 2019-11-28T12:01:41.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.059+0000 7f9feca18700 1 -- 172.21.15.80:0/4278254483 reap_dead start 2019-11-28T12:01:41.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.059+0000 7f9fed219700 1 -- 172.21.15.80:0/4278254483 shutdown_connections 2019-11-28T12:01:41.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.059+0000 7f9fed219700 1 -- 172.21.15.80:0/4278254483 shutdown_connections 2019-11-28T12:01:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.059+0000 7f9fed219700 1 -- 172.21.15.80:0/4278254483 wait complete. 2019-11-28T12:01:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.059+0000 7f9fed219700 1 -- 172.21.15.80:0/4278254483 >> 172.21.15.80:0/4278254483 conn(0x7f9fe8061d20 msgr2=0x7f9fe80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.062+0000 7f9fed219700 1 Processor -- start 2019-11-28T12:01:41.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.062+0000 7f9fed219700 1 -- start start 2019-11-28T12:01:41.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fed219700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9fe8108630 0x7f9fe8152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:41.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fed219700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9fe812caa0 0x7f9fe81510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:41.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fed219700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe810a310 con 0x7f9fe81527a0 2019-11-28T12:01:41.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fed219700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe812ee80 con 0x7f9fe8108630 2019-11-28T12:01:41.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fed219700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe81329f0 con 0x7f9fe812caa0 2019-11-28T12:01:41.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fe759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9fe8108630 0x7f9fe8152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fe6d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9fe81527a0 0x7f9fe812c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47018/0 (socket says 172.21.15.80:47018) 2019-11-28T12:01:41.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fe6d9d700 1 -- 172.21.15.80:0/1702405509 learned_addr learned my addr 172.21.15.80:0/1702405509 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:41.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9feca18700 1 --2- 172.21.15.80:0/1702405509 >> v2:172.21.15.174:3300/0 conn(0x7f9fe812caa0 0x7f9fe81510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fe759e700 1 -- 172.21.15.80:0/1702405509 >> v2:172.21.15.174:3300/0 conn(0x7f9fe812caa0 msgr2=0x7f9fe81510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fe759e700 1 --2- 172.21.15.80:0/1702405509 >> v2:172.21.15.174:3300/0 conn(0x7f9fe812caa0 0x7f9fe81510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fe759e700 1 -- 172.21.15.80:0/1702405509 >> v1:172.21.15.80:6789/0 conn(0x7f9fe81527a0 legacy=0x7f9fe812c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fdffff700 1 -- 172.21.15.80:0/1702405509 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655404317 0 0) 0x7f9fd00099b0 con 0x7f9fe81527a0 2019-11-28T12:01:41.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fe759e700 1 -- 172.21.15.80:0/1702405509 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe8133350 con 0x7f9fe8108630 2019-11-28T12:01:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fe759e700 1 --2- 172.21.15.80:0/1702405509 >> v2:172.21.15.80:3300/0 conn(0x7f9fe8108630 0x7f9fe8152260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9fd8010710 tx=0x7f9fd8010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fe759e700 1 --2- 172.21.15.80:0/1702405509 >> v2:172.21.15.80:3300/0 conn(0x7f9fe8108630 0x7f9fe8152260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9fd8010710 tx=0x7f9fd8010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fe759e700 1 --2- 172.21.15.80:0/1702405509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fe8108630 0x7f9fe8152260 secure :-1 s=READY pgs=2997 cs=0 l=1 rx=0x7f9fd8010710 tx=0x7f9fd8010540).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:41.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fe759e700 1 --2- 172.21.15.80:0/1702405509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fe8108630 0x7f9fe8152260 secure :-1 s=THROTTLE_DONE pgs=2997 cs=0 l=1 rx=0x7f9fd8010710 tx=0x7f9fd8010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fdffff700 1 -- 172.21.15.80:0/1702405509 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fd8001fe0 con 0x7f9fe8108630 2019-11-28T12:01:41.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fe759e700 1 --2- 172.21.15.80:0/1702405509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fe8108630 0x7f9fe8152260 secure :-1 s=THROTTLE_DONE pgs=2997 cs=0 l=1 rx=0x7f9fd8010710 tx=0x7f9fd8010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fe759e700 1 --2- 172.21.15.80:0/1702405509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fe8108630 0x7f9fe8152260 secure :-1 s=THROTTLE_DONE pgs=2997 cs=0 l=1 rx=0x7f9fd8010710 tx=0x7f9fd8010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fdffff700 1 -- 172.21.15.80:0/1702405509 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd80047b0 con 0x7f9fe8108630 2019-11-28T12:01:41.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fed219700 1 -- 172.21.15.80:0/1702405509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe81336d0 con 0x7f9fe8108630 2019-11-28T12:01:41.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fdffff700 1 -- 172.21.15.80:0/1702405509 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fd8004e00 con 0x7f9fe8108630 2019-11-28T12:01:41.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.063+0000 7f9fed219700 1 -- 172.21.15.80:0/1702405509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe8133350 con 0x7f9fe8108630 2019-11-28T12:01:41.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.064+0000 7f9fe759e700 1 --2- 172.21.15.80:0/1702405509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fe8108630 0x7f9fe8152260 secure :-1 s=THROTTLE_DONE pgs=2997 cs=0 l=1 rx=0x7f9fd8010710 tx=0x7f9fd8010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.064+0000 7f9fdffff700 1 -- 172.21.15.80:0/1702405509 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9fd80049a0 con 0x7f9fe8108630 2019-11-28T12:01:41.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.064+0000 7f9fe759e700 1 --2- 172.21.15.80:0/1702405509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fe8108630 0x7f9fe8152260 secure :-1 s=THROTTLE_DONE pgs=2997 cs=0 l=1 rx=0x7f9fd8010710 tx=0x7f9fd8010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.064+0000 7f9fdffff700 1 --2- 172.21.15.80:0/1702405509 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9fc0018730 0x7f9fc001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:41.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.064+0000 7f9fdffff700 1 -- 172.21.15.80:0/1702405509 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(232..232 src has 1..232) v4 ==== 5904+0+0 (secure 0 0 0) 0x7f9fd8031dc0 con 0x7f9fe8108630 2019-11-28T12:01:41.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.064+0000 7f9fe6d9d700 1 --2- 172.21.15.80:0/1702405509 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9fc0018730 0x7f9fc001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.065+0000 7f9fe6d9d700 1 --2- 172.21.15.80:0/1702405509 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9fc0018730 0x7f9fc001abc0 crc :-1 s=READY pgs=1240 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:41.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.072+0000 7f9fed219700 1 -- 172.21.15.80:0/1702405509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe81336d0 con 0x7f9fe8108630 2019-11-28T12:01:41.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.075+0000 7f9fe759e700 1 --2- 172.21.15.80:0/1702405509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fe8108630 0x7f9fe8152260 secure :-1 s=THROTTLE_DONE pgs=2997 cs=0 l=1 rx=0x7f9fd8010710 tx=0x7f9fd8010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.075+0000 7f9fdffff700 1 -- 172.21.15.80:0/1702405509 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f9fd8001330 con 0x7f9fe8108630 2019-11-28T12:01:41.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.240+0000 7f9fed219700 1 -- 172.21.15.80:0/1702405509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f9fe8133350 con 0x7f9fe8108630 2019-11-28T12:01:41.234 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T12:01:41.240+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T12:01:41.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.244+0000 7f9fe759e700 1 --2- 172.21.15.80:0/1702405509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fe8108630 0x7f9fe8152260 secure :-1 s=THROTTLE_DONE pgs=2997 cs=0 l=1 rx=0x7f9fd8010710 tx=0x7f9fd8010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.244+0000 7f9fdffff700 1 -- 172.21.15.80:0/1702405509 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 38 and data pool 39 v190) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9fd801fbf0 con 0x7f9fe8108630 2019-11-28T12:01:41.241 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 38 and data pool 39 2019-11-28T12:01:41.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.249+0000 7f9fed219700 1 -- 172.21.15.80:0/1702405509 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9fc0018730 msgr2=0x7f9fc001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.249+0000 7f9fed219700 1 --2- 172.21.15.80:0/1702405509 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9fc0018730 0x7f9fc001abc0 crc :-1 s=READY pgs=1240 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.249+0000 7f9fed219700 1 -- 172.21.15.80:0/1702405509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fe8108630 msgr2=0x7f9fe8152260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.249+0000 7f9fed219700 1 --2- 172.21.15.80:0/1702405509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fe8108630 0x7f9fe8152260 secure :-1 s=READY pgs=2997 cs=0 l=1 rx=0x7f9fd8010710 tx=0x7f9fd8010540).stop 2019-11-28T12:01:41.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.250+0000 7f9fed219700 1 -- 172.21.15.80:0/1702405509 shutdown_connections 2019-11-28T12:01:41.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.250+0000 7f9fed219700 1 --2- 172.21.15.80:0/1702405509 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9fc0018730 0x7f9fc001abc0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.250+0000 7f9fed219700 1 --2- 172.21.15.80:0/1702405509 >> v2:172.21.15.174:3300/0 conn(0x7f9fe812caa0 0x7f9fe81510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.250+0000 7f9fed219700 1 --2- 172.21.15.80:0/1702405509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9fe8108630 0x7f9fe8152260 unknown :-1 s=CLOSED pgs=2997 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.250+0000 7f9fed219700 1 -- 172.21.15.80:0/1702405509 shutdown_connections 2019-11-28T12:01:41.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.250+0000 7f9fed219700 1 -- 172.21.15.80:0/1702405509 wait complete. 2019-11-28T12:01:41.246 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.250+0000 7f9fed219700 1 -- 172.21.15.80:0/1702405509 >> 172.21.15.80:0/1702405509 conn(0x7f9fe814dbb0 msgr2=0x7f9fe8142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:41.254 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T12:01:41.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.379+0000 7f5635154700 1 Processor -- start 2019-11-28T12:01:41.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.379+0000 7f5635154700 1 -- start start 2019-11-28T12:01:41.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.380+0000 7f5635154700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f563006d120 0x7f5630165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:41.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.380+0000 7f5635154700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563006d5a0 con 0x7f563006c490 2019-11-28T12:01:41.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.380+0000 7f5635154700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563006db00 con 0x7f563006c0a0 2019-11-28T12:01:41.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.380+0000 7f5635154700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563006fd60 con 0x7f563006d120 2019-11-28T12:01:41.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.380+0000 7f5634953700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f563006d120 0x7f5630165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.380+0000 7f562ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f563006c490 0x7f563006c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47028/0 (socket says 172.21.15.80:47028) 2019-11-28T12:01:41.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.380+0000 7f562ed9d700 1 -- 172.21.15.80:0/4083015417 learned_addr learned my addr 172.21.15.80:0/4083015417 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:41.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.381+0000 7f5634953700 1 -- 172.21.15.80:0/4083015417 >> v1:172.21.15.174:6789/0 conn(0x7f563006c0a0 legacy=0x7f5630072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.381+0000 7f5634953700 1 -- 172.21.15.80:0/4083015417 >> v1:172.21.15.80:6789/0 conn(0x7f563006c490 legacy=0x7f563006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.381+0000 7f5634953700 1 -- 172.21.15.80:0/4083015417 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56300706c0 con 0x7f563006d120 2019-11-28T12:01:41.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.381+0000 7f562e59c700 1 -- 172.21.15.80:0/4083015417 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070399173 0 0) 0x7f56180014d0 con 0x7f563006c490 2019-11-28T12:01:41.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.381+0000 7f5634953700 1 --2- 172.21.15.80:0/4083015417 >> v2:172.21.15.80:3300/0 conn(0x7f563006d120 0x7f5630165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f562800af50 tx=0x7f562800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.381+0000 7f5634953700 1 --2- 172.21.15.80:0/4083015417 >> v2:172.21.15.80:3300/0 conn(0x7f563006d120 0x7f5630165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f562800af50 tx=0x7f562800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.381+0000 7f5634953700 1 --2- 172.21.15.80:0/4083015417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563006d120 0x7f5630165d80 secure :-1 s=READY pgs=2999 cs=0 l=1 rx=0x7f562800af50 tx=0x7f562800b760).ready entity=mon.0 client_cookie=dc8a5f2a8eb5f624 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:41.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.381+0000 7f5634953700 1 --2- 172.21.15.80:0/4083015417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563006d120 0x7f5630165d80 secure :-1 s=THROTTLE_DONE pgs=2999 cs=0 l=1 rx=0x7f562800af50 tx=0x7f562800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.381+0000 7f562e59c700 1 -- 172.21.15.80:0/4083015417 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5628009ba0 con 0x7f563006d120 2019-11-28T12:01:41.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.381+0000 7f5634953700 1 --2- 172.21.15.80:0/4083015417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563006d120 0x7f5630165d80 secure :-1 s=THROTTLE_DONE pgs=2999 cs=0 l=1 rx=0x7f562800af50 tx=0x7f562800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.382 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.381+0000 7f5634953700 1 --2- 172.21.15.80:0/4083015417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563006d120 0x7f5630165d80 secure :-1 s=THROTTLE_DONE pgs=2999 cs=0 l=1 rx=0x7f562800af50 tx=0x7f562800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.381+0000 7f562e59c700 1 -- 172.21.15.80:0/4083015417 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5628000a70 con 0x7f563006d120 2019-11-28T12:01:41.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.381+0000 7f562e59c700 1 -- 172.21.15.80:0/4083015417 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f562800a180 con 0x7f563006d120 2019-11-28T12:01:41.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.381+0000 7f5635154700 1 -- 172.21.15.80:0/4083015417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563006d120 msgr2=0x7f5630165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.383 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.381+0000 7f5635154700 1 --2- 172.21.15.80:0/4083015417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563006d120 0x7f5630165d80 secure :-1 s=READY pgs=2999 cs=0 l=1 rx=0x7f562800af50 tx=0x7f562800b760).stop 2019-11-28T12:01:41.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.382+0000 7f5635154700 1 -- 172.21.15.80:0/4083015417 shutdown_connections 2019-11-28T12:01:41.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.382+0000 7f5635154700 1 --2- 172.21.15.80:0/4083015417 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563006d120 0x7f5630165d80 unknown :-1 s=CLOSED pgs=2999 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.382+0000 7f5635154700 1 -- 172.21.15.80:0/4083015417 shutdown_connections 2019-11-28T12:01:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.382+0000 7f5635154700 1 -- 172.21.15.80:0/4083015417 wait complete. 2019-11-28T12:01:41.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.382+0000 7f5635154700 1 -- 172.21.15.80:0/4083015417 >> 172.21.15.80:0/4083015417 conn(0x7f5630061cf0 msgr2=0x7f5630064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.384+0000 7f5635154700 1 Processor -- start 2019-11-28T12:01:41.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.384+0000 7f5635154700 1 -- start start 2019-11-28T12:01:41.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.385+0000 7f5635154700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f563013b5c0 0x7f563012cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:41.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.385+0000 7f5635154700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f563012c3a0 0x7f5630168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:41.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.385+0000 7f5635154700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5630107930 con 0x7f563012d260 2019-11-28T12:01:41.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.385+0000 7f5635154700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5630129b90 con 0x7f563012c3a0 2019-11-28T12:01:41.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.385+0000 7f5635154700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5630129e60 con 0x7f563013b5c0 2019-11-28T12:01:41.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.385+0000 7f5634953700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f563012c3a0 0x7f5630168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.385+0000 7f5634953700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f563012c3a0 0x7f5630168a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47718/0 (socket says 172.21.15.80:47718) 2019-11-28T12:01:41.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.385+0000 7f5634953700 1 -- 172.21.15.80:0/2959048654 learned_addr learned my addr 172.21.15.80:0/2959048654 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:41.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.385+0000 7f562f59e700 1 --2- 172.21.15.80:0/2959048654 >> v2:172.21.15.174:3300/0 conn(0x7f563013b5c0 0x7f563012cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.385+0000 7f5634953700 1 -- 172.21.15.80:0/2959048654 >> v2:172.21.15.174:3300/0 conn(0x7f563013b5c0 msgr2=0x7f563012cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.385+0000 7f5634953700 1 --2- 172.21.15.80:0/2959048654 >> v2:172.21.15.174:3300/0 conn(0x7f563013b5c0 0x7f563012cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.385+0000 7f5634953700 1 -- 172.21.15.80:0/2959048654 >> v1:172.21.15.174:6789/0 conn(0x7f563012d260 legacy=0x7f563012bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.385+0000 7f5634953700 1 -- 172.21.15.80:0/2959048654 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563012a4f0 con 0x7f563012c3a0 2019-11-28T12:01:41.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.385+0000 7f5634953700 1 --2- 172.21.15.80:0/2959048654 >> v2:172.21.15.80:3300/0 conn(0x7f563012c3a0 0x7f5630168a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f56280103d0 tx=0x7f5628010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.386+0000 7f5634953700 1 --2- 172.21.15.80:0/2959048654 >> v2:172.21.15.80:3300/0 conn(0x7f563012c3a0 0x7f5630168a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f56280103d0 tx=0x7f5628010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.386+0000 7f5634953700 1 --2- 172.21.15.80:0/2959048654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563012c3a0 0x7f5630168a20 secure :-1 s=READY pgs=3000 cs=0 l=1 rx=0x7f56280103d0 tx=0x7f5628010770).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:41.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.386+0000 7f5634953700 1 --2- 172.21.15.80:0/2959048654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563012c3a0 0x7f5630168a20 secure :-1 s=THROTTLE_DONE pgs=3000 cs=0 l=1 rx=0x7f56280103d0 tx=0x7f5628010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.386+0000 7f5627fff700 1 -- 172.21.15.80:0/2959048654 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f562800aec0 con 0x7f563012c3a0 2019-11-28T12:01:41.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.386+0000 7f5634953700 1 --2- 172.21.15.80:0/2959048654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563012c3a0 0x7f5630168a20 secure :-1 s=THROTTLE_DONE pgs=3000 cs=0 l=1 rx=0x7f56280103d0 tx=0x7f5628010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.401 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.386+0000 7f5634953700 1 --2- 172.21.15.80:0/2959048654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563012c3a0 0x7f5630168a20 secure :-1 s=THROTTLE_DONE pgs=3000 cs=0 l=1 rx=0x7f56280103d0 tx=0x7f5628010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.386+0000 7f5627fff700 1 -- 172.21.15.80:0/2959048654 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5628009770 con 0x7f563012c3a0 2019-11-28T12:01:41.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.386+0000 7f5627fff700 1 -- 172.21.15.80:0/2959048654 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5628009e40 con 0x7f563012c3a0 2019-11-28T12:01:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.386+0000 7f5635154700 1 -- 172.21.15.80:0/2959048654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563012a870 con 0x7f563012c3a0 2019-11-28T12:01:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.386+0000 7f5635154700 1 -- 172.21.15.80:0/2959048654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563012a4f0 con 0x7f563012c3a0 2019-11-28T12:01:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.386+0000 7f5634953700 1 --2- 172.21.15.80:0/2959048654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563012c3a0 0x7f5630168a20 secure :-1 s=THROTTLE_DONE pgs=3000 cs=0 l=1 rx=0x7f56280103d0 tx=0x7f5628010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.386+0000 7f5627fff700 1 -- 172.21.15.80:0/2959048654 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5628009960 con 0x7f563012c3a0 2019-11-28T12:01:41.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.386+0000 7f5634953700 1 --2- 172.21.15.80:0/2959048654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563012c3a0 0x7f5630168a20 secure :-1 s=THROTTLE_DONE pgs=3000 cs=0 l=1 rx=0x7f56280103d0 tx=0x7f5628010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.386+0000 7f5627fff700 1 --2- 172.21.15.80:0/2959048654 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5608018730 0x7f560801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:41.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.386+0000 7f5627fff700 1 -- 172.21.15.80:0/2959048654 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(233..233 src has 1..233) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5628031ac0 con 0x7f563012c3a0 2019-11-28T12:01:41.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.387+0000 7f562f59e700 1 --2- 172.21.15.80:0/2959048654 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5608018730 0x7f560801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.387+0000 7f562f59e700 1 --2- 172.21.15.80:0/2959048654 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5608018730 0x7f560801abc0 crc :-1 s=READY pgs=1241 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:41.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.395+0000 7f5635154700 1 -- 172.21.15.80:0/2959048654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563012a870 con 0x7f563012c3a0 2019-11-28T12:01:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.398+0000 7f5634953700 1 --2- 172.21.15.80:0/2959048654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563012c3a0 0x7f5630168a20 secure :-1 s=THROTTLE_DONE pgs=3000 cs=0 l=1 rx=0x7f56280103d0 tx=0x7f5628010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.398+0000 7f5627fff700 1 -- 172.21.15.80:0/2959048654 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f562800acb0 con 0x7f563012c3a0 2019-11-28T12:01:41.567 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.573+0000 7f5635154700 1 -- 172.21.15.80:0/2959048654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f563012a4f0 con 0x7f563012c3a0 2019-11-28T12:01:41.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.574+0000 7f5634953700 1 --2- 172.21.15.80:0/2959048654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563012c3a0 0x7f5630168a20 secure :-1 s=THROTTLE_DONE pgs=3000 cs=0 l=1 rx=0x7f56280103d0 tx=0x7f5628010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.568 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.574+0000 7f5627fff700 1 -- 172.21.15.80:0/2959048654 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v233) v1 ==== 74+0+14884 (secure 0 0 0) 0x7f5628017470 con 0x7f563012c3a0 2019-11-28T12:01:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:41.569 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":233,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T12:01:41.241551+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":39,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":38,"pool_name":"cephfs_metadata","create_time":"2019-11-28T12:01:39.532697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"233","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":39,"pool_name":"cephfs_data","create_time":"2019-11-28T12:01:40.218947+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"233","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T12:01:41.570 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.576+0000 7f5635154700 1 -- 172.21.15.80:0/2959048654 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5608018730 msgr2=0x7f560801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.576+0000 7f5635154700 1 --2- 172.21.15.80:0/2959048654 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5608018730 0x7f560801abc0 crc :-1 s=READY pgs=1241 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.576+0000 7f5635154700 1 -- 172.21.15.80:0/2959048654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563012c3a0 msgr2=0x7f5630168a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.576+0000 7f5635154700 1 --2- 172.21.15.80:0/2959048654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563012c3a0 0x7f5630168a20 secure :-1 s=READY pgs=3000 cs=0 l=1 rx=0x7f56280103d0 tx=0x7f5628010770).stop 2019-11-28T12:01:41.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.576+0000 7f5635154700 1 -- 172.21.15.80:0/2959048654 shutdown_connections 2019-11-28T12:01:41.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.576+0000 7f5635154700 1 --2- 172.21.15.80:0/2959048654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f563012c3a0 0x7f5630168a20 unknown :-1 s=CLOSED pgs=3000 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.571 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.576+0000 7f5635154700 1 --2- 172.21.15.80:0/2959048654 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f5608018730 0x7f560801abc0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.576+0000 7f5635154700 1 --2- 172.21.15.80:0/2959048654 >> v2:172.21.15.174:3300/0 conn(0x7f563013b5c0 0x7f563012cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.576+0000 7f5635154700 1 -- 172.21.15.80:0/2959048654 shutdown_connections 2019-11-28T12:01:41.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.576+0000 7f5635154700 1 -- 172.21.15.80:0/2959048654 wait complete. 2019-11-28T12:01:41.572 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.576+0000 7f5635154700 1 -- 172.21.15.80:0/2959048654 >> 172.21.15.80:0/2959048654 conn(0x7f56301425d0 msgr2=0x7f5630101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:41.581 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T12:01:41.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.705+0000 7eff0bd1c700 1 Processor -- start 2019-11-28T12:01:41.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.705+0000 7eff0bd1c700 1 -- start start 2019-11-28T12:01:41.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.706+0000 7eff0bd1c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7eff0406c0a0 0x7eff04072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:41.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.706+0000 7eff0bd1c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0406db00 con 0x7eff04072620 2019-11-28T12:01:41.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.706+0000 7eff0bd1c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0406e000 con 0x7eff040734e0 2019-11-28T12:01:41.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.706+0000 7eff0bd1c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0406fd60 con 0x7eff0406c0a0 2019-11-28T12:01:41.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.706+0000 7eff0aaba700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7eff04072620 0x7eff04164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47040/0 (socket says 172.21.15.80:47040) 2019-11-28T12:01:41.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.706+0000 7eff0aaba700 1 -- 172.21.15.80:0/2168658074 learned_addr learned my addr 172.21.15.80:0/2168658074 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:41.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff0a2b9700 1 --2- 172.21.15.80:0/2168658074 >> v2:172.21.15.174:3300/0 conn(0x7eff0406c0a0 0x7eff04072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff092b7700 1 -- 172.21.15.80:0/2168658074 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019259711 0 0) 0x7efefc0014d0 con 0x7eff04072620 2019-11-28T12:01:41.712 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff092b7700 1 -- 172.21.15.80:0/2168658074 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeec002e80 con 0x7eff04072620 2019-11-28T12:01:41.713 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff092b7700 1 -- 172.21.15.80:0/2168658074 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2217929510 0 0) 0x7efefc0014b0 con 0x7eff04072620 2019-11-28T12:01:41.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff092b7700 1 -- 172.21.15.80:0/2168658074 >> v2:172.21.15.174:3300/0 conn(0x7eff0406c0a0 msgr2=0x7eff04072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:41.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff092b7700 1 --2- 172.21.15.80:0/2168658074 >> v2:172.21.15.174:3300/0 conn(0x7eff0406c0a0 0x7eff04072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:41.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff092b7700 1 -- 172.21.15.80:0/2168658074 >> v1:172.21.15.174:6789/0 conn(0x7eff040734e0 legacy=0x7eff04071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff092b7700 1 -- 172.21.15.80:0/2168658074 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff040706c0 con 0x7eff04072620 2019-11-28T12:01:41.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff092b7700 1 -- 172.21.15.80:0/2168658074 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7efefc0019e0 con 0x7eff04072620 2019-11-28T12:01:41.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff092b7700 1 -- 172.21.15.80:0/2168658074 >> v1:172.21.15.80:6789/0 conn(0x7eff04072620 legacy=0x7eff04164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff092b7700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec003a70 0x7efeec005ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:41.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff092b7700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efeec006650 0x7efeec008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:41.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff092b7700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efeec009380 0x7efeec00b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:41.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff092b7700 1 -- 172.21.15.80:0/2168658074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec00c000 con 0x7efeec003a70 2019-11-28T12:01:41.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff092b7700 1 -- 172.21.15.80:0/2168658074 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec050200 con 0x7efeec009380 2019-11-28T12:01:41.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff092b7700 1 -- 172.21.15.80:0/2168658074 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec050430 con 0x7efeec006650 2019-11-28T12:01:41.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff0a2b9700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec003a70 0x7efeec005ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff0aaba700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efeec009380 0x7efeec00b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff09ab8700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efeec006650 0x7efeec008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff0a2b9700 1 -- 172.21.15.80:0/2168658074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efeec006650 msgr2=0x7efeec008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:41.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff0a2b9700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efeec006650 0x7efeec008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:41.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff0a2b9700 1 -- 172.21.15.80:0/2168658074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efeec009380 msgr2=0x7efeec00b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:41.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff0a2b9700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efeec009380 0x7efeec00b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:41.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff0a2b9700 1 -- 172.21.15.80:0/2168658074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec0506e0 con 0x7efeec003a70 2019-11-28T12:01:41.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff0aaba700 1 -- 172.21.15.80:0/2168658074 reap_dead start 2019-11-28T12:01:41.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff09ab8700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efeec006650 0x7efeec008b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T12:01:41.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.707+0000 7eff0a2b9700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec003a70 0x7efeec005ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efef400b7c0 tx=0x7efef4007470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.708+0000 7eff0a2b9700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec003a70 0x7efeec005ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efef400b7c0 tx=0x7efef4007470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.708+0000 7eff0a2b9700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec003a70 0x7efeec005ed0 secure :-1 s=READY pgs=3002 cs=0 l=1 rx=0x7efef400b7c0 tx=0x7efef4007470).ready entity=mon.0 client_cookie=774f27217de936cf server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:41.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.708+0000 7eff0a2b9700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec003a70 0x7efeec005ed0 secure :-1 s=THROTTLE_DONE pgs=3002 cs=0 l=1 rx=0x7efef400b7c0 tx=0x7efef4007470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.708+0000 7eff092b7700 1 -- 172.21.15.80:0/2168658074 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efef4000960 con 0x7efeec003a70 2019-11-28T12:01:41.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.708+0000 7eff0a2b9700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec003a70 0x7efeec005ed0 secure :-1 s=THROTTLE_DONE pgs=3002 cs=0 l=1 rx=0x7efef400b7c0 tx=0x7efef4007470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.708+0000 7eff0a2b9700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec003a70 0x7efeec005ed0 secure :-1 s=THROTTLE_DONE pgs=3002 cs=0 l=1 rx=0x7efef400b7c0 tx=0x7efef4007470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.708+0000 7eff092b7700 1 -- 172.21.15.80:0/2168658074 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef4009770 con 0x7efeec003a70 2019-11-28T12:01:41.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.708+0000 7eff092b7700 1 -- 172.21.15.80:0/2168658074 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efef4009960 con 0x7efeec003a70 2019-11-28T12:01:41.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.708+0000 7eff0bd1c700 1 -- 172.21.15.80:0/2168658074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec003a70 msgr2=0x7efeec005ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.708+0000 7eff0bd1c700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec003a70 0x7efeec005ed0 secure :-1 s=READY pgs=3002 cs=0 l=1 rx=0x7efef400b7c0 tx=0x7efef4007470).stop 2019-11-28T12:01:41.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.708+0000 7eff0bd1c700 1 -- 172.21.15.80:0/2168658074 shutdown_connections 2019-11-28T12:01:41.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.708+0000 7eff0bd1c700 1 --2- 172.21.15.80:0/2168658074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec003a70 0x7efeec005ed0 unknown :-1 s=CLOSED pgs=3002 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.708+0000 7eff0bd1c700 1 -- 172.21.15.80:0/2168658074 shutdown_connections 2019-11-28T12:01:41.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.708+0000 7eff0bd1c700 1 -- 172.21.15.80:0/2168658074 wait complete. 2019-11-28T12:01:41.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.708+0000 7eff0bd1c700 1 -- 172.21.15.80:0/2168658074 >> 172.21.15.80:0/2168658074 conn(0x7eff04061cf0 msgr2=0x7eff04064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:41.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.711+0000 7eff0bd1c700 1 Processor -- start 2019-11-28T12:01:41.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.711+0000 7eff0bd1c700 1 -- start start 2019-11-28T12:01:41.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff0bd1c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7eff0407bba0 0x7eff04168c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:41.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff0bd1c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff040754d0 con 0x7eff04150f50 2019-11-28T12:01:41.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff0bd1c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0412eb20 con 0x7eff04074d00 2019-11-28T12:01:41.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff0bd1c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff04078980 con 0x7eff0407bba0 2019-11-28T12:01:41.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff09ab8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7eff04150f50 0x7eff0407b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47052/0 (socket says 172.21.15.80:47052) 2019-11-28T12:01:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff09ab8700 1 -- 172.21.15.80:0/3679088159 learned_addr learned my addr 172.21.15.80:0/3679088159 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff0aaba700 1 --2- 172.21.15.80:0/3679088159 >> v2:172.21.15.174:3300/0 conn(0x7eff0407bba0 0x7eff04168c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 948797485 0 0) 0x7efef8005770 con 0x7eff04150f50 2019-11-28T12:01:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efee4002e80 con 0x7eff04150f50 2019-11-28T12:01:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2668902380 0 0) 0x7efef8005800 con 0x7eff04150f50 2019-11-28T12:01:41.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efee40032e0 con 0x7eff04150f50 2019-11-28T12:01:41.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7efef8005d70 con 0x7eff04150f50 2019-11-28T12:01:41.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 >> v2:172.21.15.174:3300/0 conn(0x7eff0407bba0 msgr2=0x7eff04168c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff02ffd700 1 --2- 172.21.15.80:0/3679088159 >> v2:172.21.15.174:3300/0 conn(0x7eff0407bba0 0x7eff04168c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 >> v1:172.21.15.174:6789/0 conn(0x7eff04074d00 legacy=0x7eff0407aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 >> v1:172.21.15.80:6789/0 conn(0x7eff04150f50 legacy=0x7eff0407b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff02ffd700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efee40033b0 0x7efee4003810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:41.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff02ffd700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efee4003d50 0x7efee40041f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:41.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff02ffd700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efee4004930 0x7efee4004df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:41.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee4010170 con 0x7efee4004930 2019-11-28T12:01:41.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee4010330 con 0x7efee4003d50 2019-11-28T12:01:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.712+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee40104f0 con 0x7efee40033b0 2019-11-28T12:01:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0aaba700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efee4004930 0x7efee4004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff09ab8700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efee4003d50 0x7efee40041f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0a2b9700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efee40033b0 0x7efee4003810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0aaba700 1 -- 172.21.15.80:0/3679088159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efee40033b0 msgr2=0x7efee4003810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0aaba700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efee40033b0 0x7efee4003810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0aaba700 1 -- 172.21.15.80:0/3679088159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efee4003d50 msgr2=0x7efee40041f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0aaba700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efee4003d50 0x7efee40041f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0aaba700 1 -- 172.21.15.80:0/3679088159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee400bda0 con 0x7efee4004930 2019-11-28T12:01:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0bd1c700 1 -- 172.21.15.80:0/3679088159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff04079660 con 0x7efee4004930 2019-11-28T12:01:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0aaba700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efee4004930 0x7efee4004df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efefc0108f0 tx=0x7efefc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0aaba700 1 -- 172.21.15.80:0/3679088159 reap_dead start 2019-11-28T12:01:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0bd1c700 1 -- 172.21.15.80:0/3679088159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff040792e0 con 0x7efee4004930 2019-11-28T12:01:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0aaba700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efee4004930 0x7efee4004df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efefc0108f0 tx=0x7efefc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0aaba700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efee4004930 0x7efee4004df0 secure :-1 s=READY pgs=3004 cs=0 l=1 rx=0x7efefc0108f0 tx=0x7efefc0107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0aaba700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efee4004930 0x7efee4004df0 secure :-1 s=THROTTLE_DONE pgs=3004 cs=0 l=1 rx=0x7efefc0108f0 tx=0x7efefc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efefc001b30 con 0x7efee4004930 2019-11-28T12:01:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0aaba700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efee4004930 0x7efee4004df0 secure :-1 s=THROTTLE_DONE pgs=3004 cs=0 l=1 rx=0x7efefc0108f0 tx=0x7efefc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc001570 con 0x7efee4004930 2019-11-28T12:01:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0aaba700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efee4004930 0x7efee4004df0 secure :-1 s=THROTTLE_DONE pgs=3004 cs=0 l=1 rx=0x7efefc0108f0 tx=0x7efefc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efefc0045c0 con 0x7efee4004930 2019-11-28T12:01:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.713+0000 7eff0aaba700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efee4004930 0x7efee4004df0 secure :-1 s=THROTTLE_DONE pgs=3004 cs=0 l=1 rx=0x7efefc0108f0 tx=0x7efefc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.714+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efefc001940 con 0x7efee4004930 2019-11-28T12:01:41.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.714+0000 7eff0aaba700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efee4004930 0x7efee4004df0 secure :-1 s=THROTTLE_DONE pgs=3004 cs=0 l=1 rx=0x7efefc0108f0 tx=0x7efefc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.714+0000 7eff02ffd700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efee4023cc0 0x7efee40260f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:41.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.714+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(233..233 src has 1..233) v4 ==== 6020+0+0 (secure 0 0 0) 0x7efefc031e50 con 0x7efee4004930 2019-11-28T12:01:41.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.714+0000 7eff0a2b9700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efee4023cc0 0x7efee40260f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:41.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.714+0000 7eff0a2b9700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efee4023cc0 0x7efee40260f0 crc :-1 s=READY pgs=1242 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:41.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.721+0000 7eff0bd1c700 1 -- 172.21.15.80:0/3679088159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff04079660 con 0x7efee4004930 2019-11-28T12:01:41.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.724+0000 7eff0aaba700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efee4004930 0x7efee4004df0 secure :-1 s=THROTTLE_DONE pgs=3004 cs=0 l=1 rx=0x7efefc0108f0 tx=0x7efefc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.734 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.724+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efefc001360 con 0x7efee4004930 2019-11-28T12:01:41.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.902+0000 7eff0bd1c700 1 -- 172.21.15.80:0/3679088159 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff040792e0 con 0x7efee4004930 2019-11-28T12:01:41.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.902+0000 7eff0aaba700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efee4004930 0x7efee4004df0 secure :-1 s=THROTTLE_DONE pgs=3004 cs=0 l=1 rx=0x7efefc0108f0 tx=0x7efefc0107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:41.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.902+0000 7eff02ffd700 1 -- 172.21.15.80:0/3679088159 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v233) v1 ==== 74+0+14884 (secure 0 0 0) 0x7efefc001570 con 0x7efee4004930 2019-11-28T12:01:41.897 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:41.897 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":233,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T12:01:41.241551+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":39,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":38,"pool_name":"cephfs_metadata","create_time":"2019-11-28T12:01:39.532697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"233","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":39,"pool_name":"cephfs_data","create_time":"2019-11-28T12:01:40.218947+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"233","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T12:01:41.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.905+0000 7eff0bd1c700 1 -- 172.21.15.80:0/3679088159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efee4023cc0 msgr2=0x7efee40260f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.905+0000 7eff0bd1c700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efee4023cc0 0x7efee40260f0 crc :-1 s=READY pgs=1242 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.899 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.905+0000 7eff0bd1c700 1 -- 172.21.15.80:0/3679088159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efee4004930 msgr2=0x7efee4004df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:41.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.905+0000 7eff0bd1c700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efee4004930 0x7efee4004df0 secure :-1 s=READY pgs=3004 cs=0 l=1 rx=0x7efefc0108f0 tx=0x7efefc0107f0).stop 2019-11-28T12:01:41.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.905+0000 7eff0bd1c700 1 -- 172.21.15.80:0/3679088159 shutdown_connections 2019-11-28T12:01:41.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.905+0000 7eff0bd1c700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efee4023cc0 0x7efee40260f0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.905+0000 7eff0bd1c700 1 --2- 172.21.15.80:0/3679088159 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efee4004930 0x7efee4004df0 unknown :-1 s=CLOSED pgs=3004 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:41.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.905+0000 7eff0bd1c700 1 -- 172.21.15.80:0/3679088159 shutdown_connections 2019-11-28T12:01:41.900 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.905+0000 7eff0bd1c700 1 -- 172.21.15.80:0/3679088159 wait complete. 2019-11-28T12:01:41.901 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:41.905+0000 7eff0bd1c700 1 -- 172.21.15.80:0/3679088159 >> 172.21.15.80:0/3679088159 conn(0x7eff0413fa50 msgr2=0x7eff0407c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:41.910 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T12:01:42.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.038+0000 7f1d4b970700 1 Processor -- start 2019-11-28T12:01:42.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.039+0000 7f1d4b970700 1 -- start start 2019-11-28T12:01:42.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.039+0000 7f1d4b970700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1d4415f100 0x7f1d4406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:42.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4b970700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4406db60 con 0x7f1d4406c2f0 2019-11-28T12:01:42.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4b970700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4406e060 con 0x7f1d4415ed10 2019-11-28T12:01:42.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4b970700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4406fe00 con 0x7f1d4415f100 2019-11-28T12:01:42.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4970c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1d4415f100 0x7f1d4406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:42.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4970c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1d4415f100 0x7f1d4406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47752/0 (socket says 172.21.15.80:47752) 2019-11-28T12:01:42.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4a70e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1d4406c2f0 0x7f1d4406c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47066/0 (socket says 172.21.15.80:47066) 2019-11-28T12:01:42.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4970c700 1 -- 172.21.15.80:0/2394673888 learned_addr learned my addr 172.21.15.80:0/2394673888 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:42.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4970c700 1 -- 172.21.15.80:0/2394673888 >> v1:172.21.15.174:6789/0 conn(0x7f1d4415ed10 legacy=0x7f1d44073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:42.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4970c700 1 -- 172.21.15.80:0/2394673888 >> v1:172.21.15.80:6789/0 conn(0x7f1d4406c2f0 legacy=0x7f1d4406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:42.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4970c700 1 -- 172.21.15.80:0/2394673888 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d44070760 con 0x7f1d4415f100 2019-11-28T12:01:42.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d48f0b700 1 -- 172.21.15.80:0/2394673888 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441375396 0 0) 0x7f1d3c0009b0 con 0x7f1d4406c2f0 2019-11-28T12:01:42.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4970c700 1 --2- 172.21.15.80:0/2394673888 >> v2:172.21.15.80:3300/0 conn(0x7f1d4415f100 0x7f1d4406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1d3400fac0 tx=0x7f1d3400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:42.039 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4970c700 1 --2- 172.21.15.80:0/2394673888 >> v2:172.21.15.80:3300/0 conn(0x7f1d4415f100 0x7f1d4406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1d3400fac0 tx=0x7f1d3400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:42.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4970c700 1 --2- 172.21.15.80:0/2394673888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4415f100 0x7f1d4406bdb0 secure :-1 s=READY pgs=3006 cs=0 l=1 rx=0x7f1d3400fac0 tx=0x7f1d3400fe60).ready entity=mon.0 client_cookie=adadf00bb620052a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:42.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4970c700 1 --2- 172.21.15.80:0/2394673888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4415f100 0x7f1d4406bdb0 secure :-1 s=THROTTLE_DONE pgs=3006 cs=0 l=1 rx=0x7f1d3400fac0 tx=0x7f1d3400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:42.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d48f0b700 1 -- 172.21.15.80:0/2394673888 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d34000ce0 con 0x7f1d4415f100 2019-11-28T12:01:42.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4970c700 1 --2- 172.21.15.80:0/2394673888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4415f100 0x7f1d4406bdb0 secure :-1 s=THROTTLE_DONE pgs=3006 cs=0 l=1 rx=0x7f1d3400fac0 tx=0x7f1d3400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:42.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4970c700 1 --2- 172.21.15.80:0/2394673888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4415f100 0x7f1d4406bdb0 secure :-1 s=THROTTLE_DONE pgs=3006 cs=0 l=1 rx=0x7f1d3400fac0 tx=0x7f1d3400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:42.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d48f0b700 1 -- 172.21.15.80:0/2394673888 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d34001010 con 0x7f1d4415f100 2019-11-28T12:01:42.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d48f0b700 1 -- 172.21.15.80:0/2394673888 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d340016e0 con 0x7f1d4415f100 2019-11-28T12:01:42.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4b970700 1 -- 172.21.15.80:0/2394673888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4415f100 msgr2=0x7f1d4406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:42.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.040+0000 7f1d4b970700 1 --2- 172.21.15.80:0/2394673888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4415f100 0x7f1d4406bdb0 secure :-1 s=READY pgs=3006 cs=0 l=1 rx=0x7f1d3400fac0 tx=0x7f1d3400fe60).stop 2019-11-28T12:01:42.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.041+0000 7f1d4b970700 1 -- 172.21.15.80:0/2394673888 shutdown_connections 2019-11-28T12:01:42.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.041+0000 7f1d4b970700 1 --2- 172.21.15.80:0/2394673888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4415f100 0x7f1d4406bdb0 unknown :-1 s=CLOSED pgs=3006 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:42.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.041+0000 7f1d4b970700 1 -- 172.21.15.80:0/2394673888 shutdown_connections 2019-11-28T12:01:42.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.041+0000 7f1d4b970700 1 -- 172.21.15.80:0/2394673888 wait complete. 2019-11-28T12:01:42.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.041+0000 7f1d4b970700 1 -- 172.21.15.80:0/2394673888 >> 172.21.15.80:0/2394673888 conn(0x7f1d44061d20 msgr2=0x7f1d440641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:42.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.044+0000 7f1d4b970700 1 Processor -- start 2019-11-28T12:01:42.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.044+0000 7f1d4b970700 1 -- start start 2019-11-28T12:01:42.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.044+0000 7f1d4b970700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1d44148320 0x7f1d4410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:42.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.044+0000 7f1d4b970700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1d4410e3d0 0x7f1d44168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:42.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.044+0000 7f1d4b970700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d44148e00 con 0x7f1d4410f290 2019-11-28T12:01:42.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.044+0000 7f1d4b970700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4413aa20 con 0x7f1d4410e3d0 2019-11-28T12:01:42.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.044+0000 7f1d4b970700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4413acf0 con 0x7f1d44148320 2019-11-28T12:01:42.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d4970c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1d4410f290 0x7f1d4410dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47072/0 (socket says 172.21.15.80:47072) 2019-11-28T12:01:42.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d4970c700 1 -- 172.21.15.80:0/2396158835 learned_addr learned my addr 172.21.15.80:0/2396158835 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:42.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d4a70e700 1 --2- 172.21.15.80:0/2396158835 >> v2:172.21.15.80:3300/0 conn(0x7f1d4410e3d0 0x7f1d44168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:42.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d49f0d700 1 --2- 172.21.15.80:0/2396158835 >> v2:172.21.15.174:3300/0 conn(0x7f1d44148320 0x7f1d4410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:42.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d427fc700 1 -- 172.21.15.80:0/2396158835 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948126303 0 0) 0x7f1d34007da0 con 0x7f1d4410f290 2019-11-28T12:01:42.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d427fc700 1 -- 172.21.15.80:0/2396158835 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d28002e80 con 0x7f1d4410f290 2019-11-28T12:01:42.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d4a70e700 1 -- 172.21.15.80:0/2396158835 >> v2:172.21.15.174:3300/0 conn(0x7f1d44148320 msgr2=0x7f1d4410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:42.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d4a70e700 1 --2- 172.21.15.80:0/2396158835 >> v2:172.21.15.174:3300/0 conn(0x7f1d44148320 0x7f1d4410ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:42.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d4a70e700 1 -- 172.21.15.80:0/2396158835 >> v1:172.21.15.80:6789/0 conn(0x7f1d4410f290 legacy=0x7f1d4410dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:42.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d4a70e700 1 -- 172.21.15.80:0/2396158835 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4410c490 con 0x7f1d4410e3d0 2019-11-28T12:01:42.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d4a70e700 1 --2- 172.21.15.80:0/2396158835 >> v2:172.21.15.80:3300/0 conn(0x7f1d4410e3d0 0x7f1d44168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d3c010380 tx=0x7f1d3c0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:42.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d4a70e700 1 --2- 172.21.15.80:0/2396158835 >> v2:172.21.15.80:3300/0 conn(0x7f1d4410e3d0 0x7f1d44168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d3c010380 tx=0x7f1d3c0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:42.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d4a70e700 1 --2- 172.21.15.80:0/2396158835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4410e3d0 0x7f1d44168d80 secure :-1 s=READY pgs=3008 cs=0 l=1 rx=0x7f1d3c010380 tx=0x7f1d3c0101b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:42.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d4a70e700 1 --2- 172.21.15.80:0/2396158835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4410e3d0 0x7f1d44168d80 secure :-1 s=THROTTLE_DONE pgs=3008 cs=0 l=1 rx=0x7f1d3c010380 tx=0x7f1d3c0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:42.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d427fc700 1 -- 172.21.15.80:0/2396158835 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d3c000940 con 0x7f1d4410e3d0 2019-11-28T12:01:42.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d4a70e700 1 --2- 172.21.15.80:0/2396158835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4410e3d0 0x7f1d44168d80 secure :-1 s=THROTTLE_DONE pgs=3008 cs=0 l=1 rx=0x7f1d3c010380 tx=0x7f1d3c0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:42.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d427fc700 1 -- 172.21.15.80:0/2396158835 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c001380 con 0x7f1d4410e3d0 2019-11-28T12:01:42.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d4a70e700 1 --2- 172.21.15.80:0/2396158835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4410e3d0 0x7f1d44168d80 secure :-1 s=THROTTLE_DONE pgs=3008 cs=0 l=1 rx=0x7f1d3c010380 tx=0x7f1d3c0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:42.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d4b970700 1 -- 172.21.15.80:0/2396158835 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4410c810 con 0x7f1d4410e3d0 2019-11-28T12:01:42.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d427fc700 1 -- 172.21.15.80:0/2396158835 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d3c000940 con 0x7f1d4410e3d0 2019-11-28T12:01:42.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.045+0000 7f1d4b970700 1 -- 172.21.15.80:0/2396158835 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4410c490 con 0x7f1d4410e3d0 2019-11-28T12:01:42.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.046+0000 7f1d4a70e700 1 --2- 172.21.15.80:0/2396158835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4410e3d0 0x7f1d44168d80 secure :-1 s=THROTTLE_DONE pgs=3008 cs=0 l=1 rx=0x7f1d3c010380 tx=0x7f1d3c0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:42.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.046+0000 7f1d427fc700 1 -- 172.21.15.80:0/2396158835 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1d3c000940 con 0x7f1d4410e3d0 2019-11-28T12:01:42.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.046+0000 7f1d4a70e700 1 --2- 172.21.15.80:0/2396158835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4410e3d0 0x7f1d44168d80 secure :-1 s=THROTTLE_DONE pgs=3008 cs=0 l=1 rx=0x7f1d3c010380 tx=0x7f1d3c0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:42.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.046+0000 7f1d427fc700 1 --2- 172.21.15.80:0/2396158835 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d28018770 0x7f1d2801ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:42.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.046+0000 7f1d427fc700 1 -- 172.21.15.80:0/2396158835 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(233..233 src has 1..233) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1d3c031c10 con 0x7f1d4410e3d0 2019-11-28T12:01:42.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.046+0000 7f1d49f0d700 1 --2- 172.21.15.80:0/2396158835 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d28018770 0x7f1d2801ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:42.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.046+0000 7f1d49f0d700 1 --2- 172.21.15.80:0/2396158835 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d28018770 0x7f1d2801ac00 crc :-1 s=READY pgs=1243 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:42.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.054+0000 7f1d4b970700 1 -- 172.21.15.80:0/2396158835 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4410c810 con 0x7f1d4410e3d0 2019-11-28T12:01:42.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.057+0000 7f1d4a70e700 1 --2- 172.21.15.80:0/2396158835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4410e3d0 0x7f1d44168d80 secure :-1 s=THROTTLE_DONE pgs=3008 cs=0 l=1 rx=0x7f1d3c010380 tx=0x7f1d3c0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:42.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.057+0000 7f1d427fc700 1 -- 172.21.15.80:0/2396158835 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1d3c000f80 con 0x7f1d4410e3d0 2019-11-28T12:01:42.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.231+0000 7f1d4b970700 1 -- 172.21.15.80:0/2396158835 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f1d4410c490 con 0x7f1d4410e3d0 2019-11-28T12:01:42.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.885+0000 7f1d4a70e700 1 --2- 172.21.15.80:0/2396158835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4410e3d0 0x7f1d44168d80 secure :-1 s=THROTTLE_DONE pgs=3008 cs=0 l=1 rx=0x7f1d3c010380 tx=0x7f1d3c0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:42.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.885+0000 7f1d427fc700 1 -- 172.21.15.80:0/2396158835 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v191) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1d3c000940 con 0x7f1d4410e3d0 2019-11-28T12:01:42.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.898+0000 7f1d4b970700 1 -- 172.21.15.80:0/2396158835 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d28018770 msgr2=0x7f1d2801ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:42.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.898+0000 7f1d4b970700 1 --2- 172.21.15.80:0/2396158835 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d28018770 0x7f1d2801ac00 crc :-1 s=READY pgs=1243 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:42.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.898+0000 7f1d4b970700 1 -- 172.21.15.80:0/2396158835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4410e3d0 msgr2=0x7f1d44168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:42.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.898+0000 7f1d4b970700 1 --2- 172.21.15.80:0/2396158835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4410e3d0 0x7f1d44168d80 secure :-1 s=READY pgs=3008 cs=0 l=1 rx=0x7f1d3c010380 tx=0x7f1d3c0101b0).stop 2019-11-28T12:01:42.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.898+0000 7f1d4b970700 1 -- 172.21.15.80:0/2396158835 shutdown_connections 2019-11-28T12:01:42.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.898+0000 7f1d4b970700 1 --2- 172.21.15.80:0/2396158835 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1d28018770 0x7f1d2801ac00 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:42.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.898+0000 7f1d4b970700 1 --2- 172.21.15.80:0/2396158835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d4410e3d0 0x7f1d44168d80 unknown :-1 s=CLOSED pgs=3008 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:42.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.898+0000 7f1d4b970700 1 --2- 172.21.15.80:0/2396158835 >> v2:172.21.15.174:3300/0 conn(0x7f1d44148320 0x7f1d4410ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:42.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.898+0000 7f1d4b970700 1 -- 172.21.15.80:0/2396158835 shutdown_connections 2019-11-28T12:01:42.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.898+0000 7f1d4b970700 1 -- 172.21.15.80:0/2396158835 wait complete. 2019-11-28T12:01:42.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:42.898+0000 7f1d4b970700 1 -- 172.21.15.80:0/2396158835 >> 172.21.15.80:0/2396158835 conn(0x7f1d4415e2d0 msgr2=0x7f1d44147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:42.902 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:01:43.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.027+0000 7f68d826a700 1 Processor -- start 2019-11-28T12:01:43.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.027+0000 7f68d826a700 1 -- start start 2019-11-28T12:01:43.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d826a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68d006c0a0 0x7f68d0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:43.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d826a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f68d00734e0 0x7f68d0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:43.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d826a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68d0072360 0x7f68d0072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:43.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d826a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d006fd60 con 0x7f68d006c0a0 2019-11-28T12:01:43.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d826a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d0070030 con 0x7f68d00734e0 2019-11-28T12:01:43.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d826a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d006f330 con 0x7f68d0072360 2019-11-28T12:01:43.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d6807700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68d006c0a0 0x7f68d0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:43.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d6807700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68d006c0a0 0x7f68d0072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47762/0 (socket says 172.21.15.80:47762) 2019-11-28T12:01:43.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d6807700 1 -- 172.21.15.80:0/1548339964 learned_addr learned my addr 172.21.15.80:0/1548339964 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:43.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d6006700 1 --2- 172.21.15.80:0/1548339964 >> v2:172.21.15.174:3300/0 conn(0x7f68d00734e0 0x7f68d0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:43.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d7008700 1 --2- 172.21.15.80:0/1548339964 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68d0072360 0x7f68d0072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:43.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d6807700 1 -- 172.21.15.80:0/1548339964 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68d0072360 msgr2=0x7f68d0072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:43.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d6807700 1 --2- 172.21.15.80:0/1548339964 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68d0072360 0x7f68d0072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:43.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d6807700 1 -- 172.21.15.80:0/1548339964 >> v2:172.21.15.174:3300/0 conn(0x7f68d00734e0 msgr2=0x7f68d0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:43.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d6807700 1 --2- 172.21.15.80:0/1548339964 >> v2:172.21.15.174:3300/0 conn(0x7f68d00734e0 0x7f68d0071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:43.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d6807700 1 -- 172.21.15.80:0/1548339964 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d00706c0 con 0x7f68d006c0a0 2019-11-28T12:01:43.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d6807700 1 --2- 172.21.15.80:0/1548339964 >> v2:172.21.15.80:3300/0 conn(0x7f68d006c0a0 0x7f68d0072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f68c000fa40 tx=0x7f68c000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d6807700 1 --2- 172.21.15.80:0/1548339964 >> v2:172.21.15.80:3300/0 conn(0x7f68d006c0a0 0x7f68d0072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f68c000fa40 tx=0x7f68c000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.028+0000 7f68d6807700 1 --2- 172.21.15.80:0/1548339964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d006c0a0 0x7f68d0072fa0 secure :-1 s=READY pgs=3009 cs=0 l=1 rx=0x7f68c000fa40 tx=0x7f68c000f8f0).ready entity=mon.0 client_cookie=472296c5c327f527 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:43.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.029+0000 7f68d6807700 1 --2- 172.21.15.80:0/1548339964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d006c0a0 0x7f68d0072fa0 secure :-1 s=THROTTLE_DONE pgs=3009 cs=0 l=1 rx=0x7f68c000fa40 tx=0x7f68c000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.029+0000 7f68d6807700 1 --2- 172.21.15.80:0/1548339964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d006c0a0 0x7f68d0072fa0 secure :-1 s=THROTTLE_DONE pgs=3009 cs=0 l=1 rx=0x7f68c000fa40 tx=0x7f68c000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.029+0000 7f68d5805700 1 -- 172.21.15.80:0/1548339964 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c0000ce0 con 0x7f68d006c0a0 2019-11-28T12:01:43.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.029+0000 7f68d6807700 1 --2- 172.21.15.80:0/1548339964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d006c0a0 0x7f68d0072fa0 secure :-1 s=THROTTLE_DONE pgs=3009 cs=0 l=1 rx=0x7f68c000fa40 tx=0x7f68c000f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.029+0000 7f68d5805700 1 -- 172.21.15.80:0/1548339964 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c0001010 con 0x7f68d006c0a0 2019-11-28T12:01:43.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.029+0000 7f68d5805700 1 -- 172.21.15.80:0/1548339964 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c0001720 con 0x7f68d006c0a0 2019-11-28T12:01:43.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.029+0000 7f68d826a700 1 -- 172.21.15.80:0/1548339964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d006c0a0 msgr2=0x7f68d0072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.029+0000 7f68d826a700 1 --2- 172.21.15.80:0/1548339964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d006c0a0 0x7f68d0072fa0 secure :-1 s=READY pgs=3009 cs=0 l=1 rx=0x7f68c000fa40 tx=0x7f68c000f8f0).stop 2019-11-28T12:01:43.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.029+0000 7f68d826a700 1 -- 172.21.15.80:0/1548339964 shutdown_connections 2019-11-28T12:01:43.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.029+0000 7f68d826a700 1 --2- 172.21.15.80:0/1548339964 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68d0072360 0x7f68d0072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:43.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.029+0000 7f68d826a700 1 --2- 172.21.15.80:0/1548339964 >> v2:172.21.15.174:3300/0 conn(0x7f68d00734e0 0x7f68d0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:43.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.029+0000 7f68d826a700 1 --2- 172.21.15.80:0/1548339964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d006c0a0 0x7f68d0072fa0 unknown :-1 s=CLOSED pgs=3009 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:43.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.029+0000 7f68d826a700 1 -- 172.21.15.80:0/1548339964 shutdown_connections 2019-11-28T12:01:43.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.030+0000 7f68d826a700 1 -- 172.21.15.80:0/1548339964 wait complete. 2019-11-28T12:01:43.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.030+0000 7f68d826a700 1 -- 172.21.15.80:0/1548339964 >> 172.21.15.80:0/1548339964 conn(0x7f68d0061cf0 msgr2=0x7f68d0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:43.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.032+0000 7f68d826a700 1 Processor -- start 2019-11-28T12:01:43.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.032+0000 7f68d826a700 1 -- start start 2019-11-28T12:01:43.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d826a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68d013e9e0 0x7f68d0108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:43.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d826a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d01066e0 con 0x7f68d0109430 2019-11-28T12:01:43.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d826a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d010ce40 con 0x7f68d013e5f0 2019-11-28T12:01:43.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d826a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d010e060 con 0x7f68d013e9e0 2019-11-28T12:01:43.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d6006700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68d013e9e0 0x7f68d0108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:43.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d6006700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68d013e9e0 0x7f68d0108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47768/0 (socket says 172.21.15.80:47768) 2019-11-28T12:01:43.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d7008700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f68d0109430 0x7f68d0168ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47084/0 (socket says 172.21.15.80:47084) 2019-11-28T12:01:43.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d6006700 1 -- 172.21.15.80:0/3982412883 learned_addr learned my addr 172.21.15.80:0/3982412883 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:43.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d6006700 1 -- 172.21.15.80:0/3982412883 >> v1:172.21.15.174:6789/0 conn(0x7f68d013e5f0 legacy=0x7f68d010a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d6006700 1 -- 172.21.15.80:0/3982412883 >> v1:172.21.15.80:6789/0 conn(0x7f68d0109430 legacy=0x7f68d0168ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d6006700 1 -- 172.21.15.80:0/3982412883 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d010e9c0 con 0x7f68d013e9e0 2019-11-28T12:01:43.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68cf7fe700 1 -- 172.21.15.80:0/3982412883 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772830017 0 0) 0x7f68c0007900 con 0x7f68d013e5f0 2019-11-28T12:01:43.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d6006700 1 --2- 172.21.15.80:0/3982412883 >> v2:172.21.15.80:3300/0 conn(0x7f68d013e9e0 0x7f68d0108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68c4010450 tx=0x7f68c40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d6006700 1 --2- 172.21.15.80:0/3982412883 >> v2:172.21.15.80:3300/0 conn(0x7f68d013e9e0 0x7f68d0108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68c4010450 tx=0x7f68c40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d6006700 1 --2- 172.21.15.80:0/3982412883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d013e9e0 0x7f68d0108ef0 secure :-1 s=READY pgs=3011 cs=0 l=1 rx=0x7f68c4010450 tx=0x7f68c40107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:43.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d6006700 1 --2- 172.21.15.80:0/3982412883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d013e9e0 0x7f68d0108ef0 secure :-1 s=THROTTLE_DONE pgs=3011 cs=0 l=1 rx=0x7f68c4010450 tx=0x7f68c40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68cf7fe700 1 -- 172.21.15.80:0/3982412883 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c4000940 con 0x7f68d013e9e0 2019-11-28T12:01:43.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d6006700 1 --2- 172.21.15.80:0/3982412883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d013e9e0 0x7f68d0108ef0 secure :-1 s=THROTTLE_DONE pgs=3011 cs=0 l=1 rx=0x7f68c4010450 tx=0x7f68c40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68cf7fe700 1 -- 172.21.15.80:0/3982412883 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c4000e80 con 0x7f68d013e9e0 2019-11-28T12:01:43.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d6006700 1 --2- 172.21.15.80:0/3982412883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d013e9e0 0x7f68d0108ef0 secure :-1 s=THROTTLE_DONE pgs=3011 cs=0 l=1 rx=0x7f68c4010450 tx=0x7f68c40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68d826a700 1 -- 172.21.15.80:0/3982412883 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d010ed40 con 0x7f68d013e9e0 2019-11-28T12:01:43.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.033+0000 7f68cf7fe700 1 -- 172.21.15.80:0/3982412883 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c4001070 con 0x7f68d013e9e0 2019-11-28T12:01:43.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.034+0000 7f68d826a700 1 -- 172.21.15.80:0/3982412883 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d010e9c0 con 0x7f68d013e9e0 2019-11-28T12:01:43.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.034+0000 7f68d6006700 1 --2- 172.21.15.80:0/3982412883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d013e9e0 0x7f68d0108ef0 secure :-1 s=THROTTLE_DONE pgs=3011 cs=0 l=1 rx=0x7f68c4010450 tx=0x7f68c40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.034+0000 7f68cf7fe700 1 -- 172.21.15.80:0/3982412883 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f68c4001070 con 0x7f68d013e9e0 2019-11-28T12:01:43.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.034+0000 7f68d6006700 1 --2- 172.21.15.80:0/3982412883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d013e9e0 0x7f68d0108ef0 secure :-1 s=THROTTLE_DONE pgs=3011 cs=0 l=1 rx=0x7f68c4010450 tx=0x7f68c40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.034+0000 7f68cf7fe700 1 --2- 172.21.15.80:0/3982412883 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f68b0018730 0x7f68b001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:43.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.034+0000 7f68cf7fe700 1 -- 172.21.15.80:0/3982412883 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f68c4031b70 con 0x7f68d013e9e0 2019-11-28T12:01:43.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.034+0000 7f68d6807700 1 --2- 172.21.15.80:0/3982412883 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f68b0018730 0x7f68b001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:43.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.035+0000 7f68d6807700 1 --2- 172.21.15.80:0/3982412883 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f68b0018730 0x7f68b001abc0 crc :-1 s=READY pgs=1244 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:43.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.042+0000 7f68d826a700 1 -- 172.21.15.80:0/3982412883 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d010ed40 con 0x7f68d013e9e0 2019-11-28T12:01:43.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.046+0000 7f68d6006700 1 --2- 172.21.15.80:0/3982412883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d013e9e0 0x7f68d0108ef0 secure :-1 s=THROTTLE_DONE pgs=3011 cs=0 l=1 rx=0x7f68c4010450 tx=0x7f68c40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.046+0000 7f68cf7fe700 1 -- 172.21.15.80:0/3982412883 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f68c4009250 con 0x7f68d013e9e0 2019-11-28T12:01:43.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.216+0000 7f68d826a700 1 -- 172.21.15.80:0/3982412883 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68d010e9c0 con 0x7f68d013e9e0 2019-11-28T12:01:43.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.216+0000 7f68d6006700 1 --2- 172.21.15.80:0/3982412883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d013e9e0 0x7f68d0108ef0 secure :-1 s=THROTTLE_DONE pgs=3011 cs=0 l=1 rx=0x7f68c4010450 tx=0x7f68c40107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.216+0000 7f68cf7fe700 1 -- 172.21.15.80:0/3982412883 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 191 v191) v1 ==== 95+0+1428 (secure 0 0 0) 0x7f68c4001a40 con 0x7f68d013e9e0 2019-11-28T12:01:43.212 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 191 2019-11-28T12:01:43.212 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:43.212 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":191,"default_fscid":19,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":191,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:01:41.241732+0000","modified":"2019-11-28T12:01:42.882269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[39],"metadata_pool":38,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":19}]} 2019-11-28T12:01:43.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.218+0000 7f68d826a700 1 -- 172.21.15.80:0/3982412883 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f68b0018730 msgr2=0x7f68b001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.218+0000 7f68d826a700 1 --2- 172.21.15.80:0/3982412883 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f68b0018730 0x7f68b001abc0 crc :-1 s=READY pgs=1244 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:43.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.218+0000 7f68d826a700 1 -- 172.21.15.80:0/3982412883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d013e9e0 msgr2=0x7f68d0108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.218+0000 7f68d826a700 1 --2- 172.21.15.80:0/3982412883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d013e9e0 0x7f68d0108ef0 secure :-1 s=READY pgs=3011 cs=0 l=1 rx=0x7f68c4010450 tx=0x7f68c40107f0).stop 2019-11-28T12:01:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.219+0000 7f68d826a700 1 -- 172.21.15.80:0/3982412883 shutdown_connections 2019-11-28T12:01:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.219+0000 7f68d826a700 1 --2- 172.21.15.80:0/3982412883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68d013e9e0 0x7f68d0108ef0 unknown :-1 s=CLOSED pgs=3011 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.219+0000 7f68d826a700 1 --2- 172.21.15.80:0/3982412883 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f68b0018730 0x7f68b001abc0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.219+0000 7f68d826a700 1 -- 172.21.15.80:0/3982412883 shutdown_connections 2019-11-28T12:01:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.219+0000 7f68d826a700 1 -- 172.21.15.80:0/3982412883 wait complete. 2019-11-28T12:01:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.219+0000 7f68d826a700 1 -- 172.21.15.80:0/3982412883 >> 172.21.15.80:0/3982412883 conn(0x7f68d013d620 msgr2=0x7f68d013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:43.238 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T12:01:43.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.363+0000 7fabdff64700 1 Processor -- start 2019-11-28T12:01:43.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.363+0000 7fabdff64700 1 -- start start 2019-11-28T12:01:43.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.364+0000 7fabdff64700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabd806c490 0x7fabd806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:43.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.364+0000 7fabdff64700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fabd806ce60 0x7fabd8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:43.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.364+0000 7fabdff64700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd806db00 con 0x7fabd806c0a0 2019-11-28T12:01:43.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.364+0000 7fabdff64700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd806fd60 con 0x7fabd806ce60 2019-11-28T12:01:43.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.364+0000 7fabdff64700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8070030 con 0x7fabd806c490 2019-11-28T12:01:43.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.364+0000 7fabde501700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fabd806c0a0 0x7fabd8072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47090/0 (socket says 172.21.15.80:47090) 2019-11-28T12:01:43.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.364+0000 7fabde501700 1 -- 172.21.15.80:0/2747743618 learned_addr learned my addr 172.21.15.80:0/2747743618 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:43.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.364+0000 7fabded02700 1 --2- 172.21.15.80:0/2747743618 >> v2:172.21.15.174:3300/0 conn(0x7fabd806ce60 0x7fabd8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:43.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.364+0000 7fabddd00700 1 --2- 172.21.15.80:0/2747743618 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabd806c490 0x7fabd806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:43.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabdd4ff700 1 -- 172.21.15.80:0/2747743618 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422261961 0 0) 0x7fabc8001150 con 0x7fabd806c0a0 2019-11-28T12:01:43.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabdd4ff700 1 -- 172.21.15.80:0/2747743618 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabc4002e80 con 0x7fabd806c0a0 2019-11-28T12:01:43.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabded02700 1 -- 172.21.15.80:0/2747743618 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabd806c490 msgr2=0x7fabd806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:43.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabded02700 1 --2- 172.21.15.80:0/2747743618 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabd806c490 0x7fabd806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:43.364 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabded02700 1 -- 172.21.15.80:0/2747743618 >> v1:172.21.15.80:6789/0 conn(0x7fabd806c0a0 legacy=0x7fabd8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabded02700 1 -- 172.21.15.80:0/2747743618 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd80706c0 con 0x7fabd806ce60 2019-11-28T12:01:43.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabddd00700 1 --2- 172.21.15.80:0/2747743618 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabd806c490 0x7fabd806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:43.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabded02700 1 --2- 172.21.15.80:0/2747743618 >> v2:172.21.15.174:3300/0 conn(0x7fabd806ce60 0x7fabd8164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fabd000af80 tx=0x7fabd000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabded02700 1 --2- 172.21.15.80:0/2747743618 >> v2:172.21.15.174:3300/0 conn(0x7fabd806ce60 0x7fabd8164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fabd000af80 tx=0x7fabd000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabded02700 1 --2- 172.21.15.80:0/2747743618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabd806ce60 0x7fabd8164d70 secure :-1 s=READY pgs=1816 cs=0 l=1 rx=0x7fabd000af80 tx=0x7fabd000b790).ready entity=mon.1 client_cookie=c607aec02ca81f1e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:43.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabded02700 1 --2- 172.21.15.80:0/2747743618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabd806ce60 0x7fabd8164d70 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7fabd000af80 tx=0x7fabd000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabdd4ff700 1 -- 172.21.15.80:0/2747743618 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabd0000bc0 con 0x7fabd806ce60 2019-11-28T12:01:43.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabded02700 1 --2- 172.21.15.80:0/2747743618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabd806ce60 0x7fabd8164d70 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7fabd000af80 tx=0x7fabd000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabded02700 1 --2- 172.21.15.80:0/2747743618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabd806ce60 0x7fabd8164d70 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7fabd000af80 tx=0x7fabd000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabdd4ff700 1 -- 172.21.15.80:0/2747743618 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd00097f0 con 0x7fabd806ce60 2019-11-28T12:01:43.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabdd4ff700 1 -- 172.21.15.80:0/2747743618 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabd0009ec0 con 0x7fabd806ce60 2019-11-28T12:01:43.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabdff64700 1 -- 172.21.15.80:0/2747743618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabd806ce60 msgr2=0x7fabd8164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.365+0000 7fabdff64700 1 --2- 172.21.15.80:0/2747743618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabd806ce60 0x7fabd8164d70 secure :-1 s=READY pgs=1816 cs=0 l=1 rx=0x7fabd000af80 tx=0x7fabd000b790).stop 2019-11-28T12:01:43.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.366+0000 7fabdff64700 1 -- 172.21.15.80:0/2747743618 shutdown_connections 2019-11-28T12:01:43.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.366+0000 7fabdff64700 1 --2- 172.21.15.80:0/2747743618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabd806ce60 0x7fabd8164d70 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:43.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.366+0000 7fabdff64700 1 --2- 172.21.15.80:0/2747743618 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabd806c490 0x7fabd806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:43.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.366+0000 7fabdff64700 1 -- 172.21.15.80:0/2747743618 shutdown_connections 2019-11-28T12:01:43.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.366+0000 7fabdff64700 1 -- 172.21.15.80:0/2747743618 wait complete. 2019-11-28T12:01:43.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.366+0000 7fabdff64700 1 -- 172.21.15.80:0/2747743618 >> 172.21.15.80:0/2747743618 conn(0x7fabd8061cf0 msgr2=0x7fabd8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:43.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.368+0000 7fabdff64700 1 Processor -- start 2019-11-28T12:01:43.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.368+0000 7fabdff64700 1 -- start start 2019-11-28T12:01:43.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.369+0000 7fabdff64700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fabd815fdf0 0x7fabd812b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:43.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.369+0000 7fabdff64700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabd812b8a0 0x7fabd813e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:43.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.369+0000 7fabdff64700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd8139e00 con 0x7fabd813e860 2019-11-28T12:01:43.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.369+0000 7fabdff64700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd8108820 con 0x7fabd815fdf0 2019-11-28T12:01:43.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.369+0000 7fabdff64700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8108af0 con 0x7fabd812b8a0 2019-11-28T12:01:43.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.369+0000 7fabde501700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fabd815fdf0 0x7fabd812b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:43.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.369+0000 7fabde501700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fabd815fdf0 0x7fabd812b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47780/0 (socket says 172.21.15.80:47780) 2019-11-28T12:01:43.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.369+0000 7fabde501700 1 -- 172.21.15.80:0/2694242374 learned_addr learned my addr 172.21.15.80:0/2694242374 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:43.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabddd00700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabd812b8a0 0x7fabd813e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:43.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabde501700 1 -- 172.21.15.80:0/2694242374 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabd812b8a0 msgr2=0x7fabd813e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabde501700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabd812b8a0 0x7fabd813e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:43.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabde501700 1 -- 172.21.15.80:0/2694242374 >> v1:172.21.15.174:6789/0 conn(0x7fabd813e860 legacy=0x7fabd812a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabde501700 1 -- 172.21.15.80:0/2694242374 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd810a8c0 con 0x7fabd815fdf0 2019-11-28T12:01:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabde501700 1 --2- 172.21.15.80:0/2694242374 >> v2:172.21.15.80:3300/0 conn(0x7fabd815fdf0 0x7fabd812b360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fabc8010360 tx=0x7fabc8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabde501700 1 --2- 172.21.15.80:0/2694242374 >> v2:172.21.15.80:3300/0 conn(0x7fabd815fdf0 0x7fabd812b360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fabc8010360 tx=0x7fabc8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabde501700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabd815fdf0 0x7fabd812b360 secure :-1 s=READY pgs=3013 cs=0 l=1 rx=0x7fabc8010360 tx=0x7fabc8010700).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabde501700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabd815fdf0 0x7fabd812b360 secure :-1 s=THROTTLE_DONE pgs=3013 cs=0 l=1 rx=0x7fabc8010360 tx=0x7fabc8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabd6ffd700 1 -- 172.21.15.80:0/2694242374 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabc8000c90 con 0x7fabd815fdf0 2019-11-28T12:01:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabde501700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabd815fdf0 0x7fabd812b360 secure :-1 s=THROTTLE_DONE pgs=3013 cs=0 l=1 rx=0x7fabc8010360 tx=0x7fabc8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabde501700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabd815fdf0 0x7fabd812b360 secure :-1 s=THROTTLE_DONE pgs=3013 cs=0 l=1 rx=0x7fabc8010360 tx=0x7fabc8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabd6ffd700 1 -- 172.21.15.80:0/2694242374 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc80010c0 con 0x7fabd815fdf0 2019-11-28T12:01:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabdff64700 1 -- 172.21.15.80:0/2694242374 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd810a8c0 con 0x7fabd815fdf0 2019-11-28T12:01:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabd6ffd700 1 -- 172.21.15.80:0/2694242374 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabc8001790 con 0x7fabd815fdf0 2019-11-28T12:01:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabdff64700 1 -- 172.21.15.80:0/2694242374 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd810a8c0 con 0x7fabd815fdf0 2019-11-28T12:01:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.370+0000 7fabde501700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabd815fdf0 0x7fabd812b360 secure :-1 s=THROTTLE_DONE pgs=3013 cs=0 l=1 rx=0x7fabc8010360 tx=0x7fabc8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.371+0000 7fabd6ffd700 1 -- 172.21.15.80:0/2694242374 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fabc8000c90 con 0x7fabd815fdf0 2019-11-28T12:01:43.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.371+0000 7fabde501700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabd815fdf0 0x7fabd812b360 secure :-1 s=THROTTLE_DONE pgs=3013 cs=0 l=1 rx=0x7fabc8010360 tx=0x7fabc8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.371+0000 7fabd6ffd700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fabbc018730 0x7fabbc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:43.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.371+0000 7fabd6ffd700 1 -- 172.21.15.80:0/2694242374 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fabc8031aa0 con 0x7fabd815fdf0 2019-11-28T12:01:43.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.371+0000 7fabddd00700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fabbc018730 0x7fabbc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:43.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.371+0000 7fabddd00700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fabbc018730 0x7fabbc01abc0 crc :-1 s=READY pgs=1245 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:43.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.378+0000 7fabdff64700 1 -- 172.21.15.80:0/2694242374 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd8109180 con 0x7fabd815fdf0 2019-11-28T12:01:43.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.382+0000 7fabde501700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabd815fdf0 0x7fabd812b360 secure :-1 s=THROTTLE_DONE pgs=3013 cs=0 l=1 rx=0x7fabc8010360 tx=0x7fabc8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.382+0000 7fabd6ffd700 1 -- 172.21.15.80:0/2694242374 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fabc80075a0 con 0x7fabd815fdf0 2019-11-28T12:01:43.552 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.558+0000 7fabdff64700 1 -- 172.21.15.80:0/2694242374 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabd8109500 con 0x7fabd815fdf0 2019-11-28T12:01:43.553 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.559+0000 7fabde501700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabd815fdf0 0x7fabd812b360 secure :-1 s=THROTTLE_DONE pgs=3013 cs=0 l=1 rx=0x7fabc8010360 tx=0x7fabc8010700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.554 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.559+0000 7fabd6ffd700 1 -- 172.21.15.80:0/2694242374 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v234) v1 ==== 74+0+14871 (secure 0 0 0) 0x7fabc8000c90 con 0x7fabd815fdf0 2019-11-28T12:01:43.554 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:43.554 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":234,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T12:01:42.242911+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":39,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":38,"pool_name":"cephfs_metadata","create_time":"2019-11-28T12:01:39.532697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"233","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":39,"pool_name":"cephfs_data","create_time":"2019-11-28T12:01:40.218947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"234","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T12:01:43.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.561+0000 7fabdff64700 1 -- 172.21.15.80:0/2694242374 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fabbc018730 msgr2=0x7fabbc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.561+0000 7fabdff64700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fabbc018730 0x7fabbc01abc0 crc :-1 s=READY pgs=1245 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:43.556 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.561+0000 7fabdff64700 1 -- 172.21.15.80:0/2694242374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabd815fdf0 msgr2=0x7fabd812b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.561+0000 7fabdff64700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabd815fdf0 0x7fabd812b360 secure :-1 s=READY pgs=3013 cs=0 l=1 rx=0x7fabc8010360 tx=0x7fabc8010700).stop 2019-11-28T12:01:43.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.561+0000 7fabdff64700 1 -- 172.21.15.80:0/2694242374 shutdown_connections 2019-11-28T12:01:43.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.561+0000 7fabdff64700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fabbc018730 0x7fabbc01abc0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:43.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.561+0000 7fabdff64700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fabd812b8a0 0x7fabd813e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:43.557 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.561+0000 7fabdff64700 1 --2- 172.21.15.80:0/2694242374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fabd815fdf0 0x7fabd812b360 unknown :-1 s=CLOSED pgs=3013 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:43.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.561+0000 7fabdff64700 1 -- 172.21.15.80:0/2694242374 shutdown_connections 2019-11-28T12:01:43.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.561+0000 7fabdff64700 1 -- 172.21.15.80:0/2694242374 wait complete. 2019-11-28T12:01:43.559 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.561+0000 7fabdff64700 1 -- 172.21.15.80:0/2694242374 >> 172.21.15.80:0/2694242374 conn(0x7fabd8127dc0 msgr2=0x7fabd8141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:43.566 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T12:01:43.567 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T12:01:43.568 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T12:01:43.568 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T12:01:43.569 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T12:01:43.569 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T12:01:43.577 INFO:tasks.ceph.mds.b:Started 2019-11-28T12:01:43.577 INFO:tasks.ceph.mds.c:Started 2019-11-28T12:01:43.578 DEBUG:teuthology.parallel:result is None 2019-11-28T12:01:43.578 DEBUG:teuthology.parallel:result is None 2019-11-28T12:01:43.578 INFO:tasks.ceph.mds.a:Started 2019-11-28T12:01:43.579 DEBUG:teuthology.parallel:result is None 2019-11-28T12:01:43.579 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T12:01:43.662 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T12:01:43.669 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T12:01:43.670 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T12:01:43.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.736+0000 7fe4a654b700 1 Processor -- start 2019-11-28T12:01:43.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.736+0000 7fe4a654b700 1 -- start start 2019-11-28T12:01:43.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.737+0000 7fe4a654b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe4a015f100 0x7fe4a006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:43.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.737+0000 7fe4a654b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe4a006c2f0 0x7fe4a006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:43.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.737+0000 7fe4a654b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a006db60 con 0x7fe4a015ed10 2019-11-28T12:01:43.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.737+0000 7fe4a654b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a006fe00 con 0x7fe4a015f100 2019-11-28T12:01:43.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.737+0000 7fe4a654b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a00700d0 con 0x7fe4a006c2f0 2019-11-28T12:01:43.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.737+0000 7fe49ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe4a015f100 0x7fe4a006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:43.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe49ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe4a015f100 0x7fe4a006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47810/0 (socket says 172.21.15.80:47810) 2019-11-28T12:01:43.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe49ffff700 1 -- 172.21.15.80:0/3079844007 learned_addr learned my addr 172.21.15.80:0/3079844007 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:43.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe4a4ae8700 1 --1- 172.21.15.80:0/3079844007 >> v1:172.21.15.80:6789/0 conn(0x7fe4a015ed10 0x7fe4a0073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47126/0 (socket says 172.21.15.80:47126) 2019-11-28T12:01:43.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe4a52e9700 1 --2- 172.21.15.80:0/3079844007 >> v2:172.21.15.174:3300/0 conn(0x7fe4a006c2f0 0x7fe4a006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:43.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe49ffff700 1 -- 172.21.15.80:0/3079844007 >> v2:172.21.15.174:3300/0 conn(0x7fe4a006c2f0 msgr2=0x7fe4a006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:43.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe49ffff700 1 --2- 172.21.15.80:0/3079844007 >> v2:172.21.15.174:3300/0 conn(0x7fe4a006c2f0 0x7fe4a006c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:43.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe49ffff700 1 -- 172.21.15.80:0/3079844007 >> v1:172.21.15.80:6789/0 conn(0x7fe4a015ed10 legacy=0x7fe4a0073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe49ffff700 1 -- 172.21.15.80:0/3079844007 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a0070760 con 0x7fe4a015f100 2019-11-28T12:01:43.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe4a52e9700 1 --2- 172.21.15.80:0/3079844007 >> v2:172.21.15.174:3300/0 conn(0x7fe4a006c2f0 0x7fe4a006c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T12:01:43.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe49ffff700 1 --2- 172.21.15.80:0/3079844007 >> v2:172.21.15.80:3300/0 conn(0x7fe4a015f100 0x7fe4a006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe49000f740 tx=0x7fe49000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.739 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe49ffff700 1 --2- 172.21.15.80:0/3079844007 >> v2:172.21.15.80:3300/0 conn(0x7fe4a015f100 0x7fe4a006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe49000f740 tx=0x7fe49000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe49ffff700 1 --2- 172.21.15.80:0/3079844007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a015f100 0x7fe4a006bdb0 secure :-1 s=READY pgs=3021 cs=0 l=1 rx=0x7fe49000f740 tx=0x7fe49000fae0).ready entity=mon.0 client_cookie=b171917c684986b1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:43.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe49ffff700 1 --2- 172.21.15.80:0/3079844007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a015f100 0x7fe4a006bdb0 secure :-1 s=THROTTLE_DONE pgs=3021 cs=0 l=1 rx=0x7fe49000f740 tx=0x7fe49000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe49ffff700 1 --2- 172.21.15.80:0/3079844007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a015f100 0x7fe4a006bdb0 secure :-1 s=THROTTLE_DONE pgs=3021 cs=0 l=1 rx=0x7fe49000f740 tx=0x7fe49000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe49f7fe700 1 -- 172.21.15.80:0/3079844007 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe490000960 con 0x7fe4a015f100 2019-11-28T12:01:43.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe49ffff700 1 --2- 172.21.15.80:0/3079844007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a015f100 0x7fe4a006bdb0 secure :-1 s=THROTTLE_DONE pgs=3021 cs=0 l=1 rx=0x7fe49000f740 tx=0x7fe49000fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe49f7fe700 1 -- 172.21.15.80:0/3079844007 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe490000c90 con 0x7fe4a015f100 2019-11-28T12:01:43.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe49f7fe700 1 -- 172.21.15.80:0/3079844007 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4900013a0 con 0x7fe4a015f100 2019-11-28T12:01:43.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe4a654b700 1 -- 172.21.15.80:0/3079844007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a015f100 msgr2=0x7fe4a006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.738+0000 7fe4a654b700 1 --2- 172.21.15.80:0/3079844007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a015f100 0x7fe4a006bdb0 secure :-1 s=READY pgs=3021 cs=0 l=1 rx=0x7fe49000f740 tx=0x7fe49000fae0).stop 2019-11-28T12:01:43.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.739+0000 7fe4a654b700 1 -- 172.21.15.80:0/3079844007 shutdown_connections 2019-11-28T12:01:43.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.739+0000 7fe4a654b700 1 --2- 172.21.15.80:0/3079844007 >> v2:172.21.15.174:3300/0 conn(0x7fe4a006c2f0 0x7fe4a006c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:43.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.739+0000 7fe4a654b700 1 --2- 172.21.15.80:0/3079844007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a015f100 0x7fe4a006bdb0 unknown :-1 s=CLOSED pgs=3021 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:43.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.739+0000 7fe4a654b700 1 -- 172.21.15.80:0/3079844007 shutdown_connections 2019-11-28T12:01:43.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.739+0000 7fe4a654b700 1 -- 172.21.15.80:0/3079844007 wait complete. 2019-11-28T12:01:43.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.739+0000 7fe4a654b700 1 -- 172.21.15.80:0/3079844007 >> 172.21.15.80:0/3079844007 conn(0x7fe4a0061d40 msgr2=0x7fe4a00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:43.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.741+0000 7fe4a654b700 1 Processor -- start 2019-11-28T12:01:43.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.741+0000 7fe4a654b700 1 -- start start 2019-11-28T12:01:43.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.742+0000 7fe4a654b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe4a012e1a0 0x7fe4a012e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:43.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.742+0000 7fe4a654b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4a012eb70 0x7fe4a0105a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:43.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.742+0000 7fe4a654b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a0130b20 con 0x7fe4a0114f60 2019-11-28T12:01:43.746 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.742+0000 7fe4a654b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a0148b60 con 0x7fe4a012e1a0 2019-11-28T12:01:43.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.742+0000 7fe4a654b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a0148e30 con 0x7fe4a012eb70 2019-11-28T12:01:43.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.742+0000 7fe49ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe4a012e1a0 0x7fe4a012e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:43.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.742+0000 7fe49ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe4a012e1a0 0x7fe4a012e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47814/0 (socket says 172.21.15.80:47814) 2019-11-28T12:01:43.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.742+0000 7fe49ffff700 1 -- 172.21.15.80:0/4170720753 learned_addr learned my addr 172.21.15.80:0/4170720753 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:43.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe4a52e9700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4a012eb70 0x7fe4a0105a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:43.747 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe49ffff700 1 -- 172.21.15.80:0/4170720753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4a012eb70 msgr2=0x7fe4a0105a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe49ffff700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4a012eb70 0x7fe4a0105a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:43.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe49ffff700 1 -- 172.21.15.80:0/4170720753 >> v1:172.21.15.174:6789/0 conn(0x7fe4a0114f60 legacy=0x7fe4a0106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe49ffff700 1 -- 172.21.15.80:0/4170720753 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a0104390 con 0x7fe4a012e1a0 2019-11-28T12:01:43.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe49ffff700 1 --2- 172.21.15.80:0/4170720753 >> v2:172.21.15.80:3300/0 conn(0x7fe4a012e1a0 0x7fe4a012e630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe490010440 tx=0x7fe4900102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe49ffff700 1 --2- 172.21.15.80:0/4170720753 >> v2:172.21.15.80:3300/0 conn(0x7fe4a012e1a0 0x7fe4a012e630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe490010440 tx=0x7fe4900102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.748 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe49ffff700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a012e1a0 0x7fe4a012e630 secure :-1 s=READY pgs=3022 cs=0 l=1 rx=0x7fe490010440 tx=0x7fe4900102f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe49ffff700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a012e1a0 0x7fe4a012e630 secure :-1 s=THROTTLE_DONE pgs=3022 cs=0 l=1 rx=0x7fe490010440 tx=0x7fe4900102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe49d7fa700 1 -- 172.21.15.80:0/4170720753 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe490000940 con 0x7fe4a012e1a0 2019-11-28T12:01:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe49ffff700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a012e1a0 0x7fe4a012e630 secure :-1 s=THROTTLE_DONE pgs=3022 cs=0 l=1 rx=0x7fe490010440 tx=0x7fe4900102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe49ffff700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a012e1a0 0x7fe4a012e630 secure :-1 s=THROTTLE_DONE pgs=3022 cs=0 l=1 rx=0x7fe490010440 tx=0x7fe4900102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe49d7fa700 1 -- 172.21.15.80:0/4170720753 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe490000f50 con 0x7fe4a012e1a0 2019-11-28T12:01:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe4a654b700 1 -- 172.21.15.80:0/4170720753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a0104710 con 0x7fe4a012e1a0 2019-11-28T12:01:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe49d7fa700 1 -- 172.21.15.80:0/4170720753 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4900015a0 con 0x7fe4a012e1a0 2019-11-28T12:01:43.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe4a654b700 1 -- 172.21.15.80:0/4170720753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a0104390 con 0x7fe4a012e1a0 2019-11-28T12:01:43.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.743+0000 7fe49ffff700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a012e1a0 0x7fe4a012e630 secure :-1 s=THROTTLE_DONE pgs=3022 cs=0 l=1 rx=0x7fe490010440 tx=0x7fe4900102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.744+0000 7fe49d7fa700 1 -- 172.21.15.80:0/4170720753 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe490001140 con 0x7fe4a012e1a0 2019-11-28T12:01:43.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.744+0000 7fe49ffff700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a012e1a0 0x7fe4a012e630 secure :-1 s=THROTTLE_DONE pgs=3022 cs=0 l=1 rx=0x7fe490010440 tx=0x7fe4900102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.744+0000 7fe49d7fa700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe484018730 0x7fe48401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:43.750 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.744+0000 7fe49d7fa700 1 -- 172.21.15.80:0/4170720753 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fe490031a80 con 0x7fe4a012e1a0 2019-11-28T12:01:43.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.744+0000 7fe4a4ae8700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe484018730 0x7fe48401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:43.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.744+0000 7fe4a4ae8700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe484018730 0x7fe48401abc0 crc :-1 s=READY pgs=1246 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:43.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.752+0000 7fe4a654b700 1 -- 172.21.15.80:0/4170720753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a0104710 con 0x7fe4a012e1a0 2019-11-28T12:01:43.751 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.755+0000 7fe49ffff700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a012e1a0 0x7fe4a012e630 secure :-1 s=THROTTLE_DONE pgs=3022 cs=0 l=1 rx=0x7fe490010440 tx=0x7fe4900102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.752 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.755+0000 7fe49d7fa700 1 -- 172.21.15.80:0/4170720753 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe490000b30 con 0x7fe4a012e1a0 2019-11-28T12:01:43.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.928+0000 7fe4a654b700 1 -- 172.21.15.80:0/4170720753 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fe4a0104390 con 0x7fe4a012e1a0 2019-11-28T12:01:43.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.932+0000 7fe49ffff700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a012e1a0 0x7fe4a012e630 secure :-1 s=THROTTLE_DONE pgs=3022 cs=0 l=1 rx=0x7fe490010440 tx=0x7fe4900102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:43.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.932+0000 7fe49d7fa700 1 -- 172.21.15.80:0/4170720753 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v80) v1 ==== 184+0+0 (secure 0 0 0) 0x7fe490017430 con 0x7fe4a012e1a0 2019-11-28T12:01:43.928 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T12:01:43.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.937+0000 7fe4a654b700 1 -- 172.21.15.80:0/4170720753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe484018730 msgr2=0x7fe48401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.937+0000 7fe4a654b700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe484018730 0x7fe48401abc0 crc :-1 s=READY pgs=1246 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:43.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.937+0000 7fe4a654b700 1 -- 172.21.15.80:0/4170720753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a012e1a0 msgr2=0x7fe4a012e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:43.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.937+0000 7fe4a654b700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a012e1a0 0x7fe4a012e630 secure :-1 s=READY pgs=3022 cs=0 l=1 rx=0x7fe490010440 tx=0x7fe4900102f0).stop 2019-11-28T12:01:43.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.937+0000 7fe4a654b700 1 -- 172.21.15.80:0/4170720753 shutdown_connections 2019-11-28T12:01:43.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.937+0000 7fe4a654b700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4a012eb70 0x7fe4a0105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:43.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.937+0000 7fe4a654b700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4a012e1a0 0x7fe4a012e630 unknown :-1 s=CLOSED pgs=3022 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:43.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.937+0000 7fe4a654b700 1 --2- 172.21.15.80:0/4170720753 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe484018730 0x7fe48401abc0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:43.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.937+0000 7fe4a654b700 1 -- 172.21.15.80:0/4170720753 shutdown_connections 2019-11-28T12:01:43.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.937+0000 7fe4a654b700 1 -- 172.21.15.80:0/4170720753 wait complete. 2019-11-28T12:01:43.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:43.937+0000 7fe4a654b700 1 -- 172.21.15.80:0/4170720753 >> 172.21.15.80:0/4170720753 conn(0x7fe4a01476e0 msgr2=0x7fe4a012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:43.944 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T12:01:44.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.081+0000 7efcdac1a700 1 Processor -- start 2019-11-28T12:01:44.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.081+0000 7efcdac1a700 1 -- start start 2019-11-28T12:01:44.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.082+0000 7efcdac1a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efcd415ed10 0x7efcd415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:44.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.082+0000 7efcdac1a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcd40734b0 0x7efcd40726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:44.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.082+0000 7efcdac1a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd406db60 con 0x7efcd4073020 2019-11-28T12:01:44.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.082+0000 7efcdac1a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd406fe00 con 0x7efcd415ed10 2019-11-28T12:01:44.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.082+0000 7efcdac1a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd40700d0 con 0x7efcd40734b0 2019-11-28T12:01:44.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.082+0000 7efcd99b8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcd40734b0 0x7efcd40726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:44.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.082+0000 7efcd91b7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efcd415ed10 0x7efcd415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:44.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.082+0000 7efcd91b7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efcd415ed10 0x7efcd415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:34476/0 (socket says 172.21.15.80:34476) 2019-11-28T12:01:44.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.082+0000 7efcd99b8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcd40734b0 0x7efcd40726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:50084/0 (socket says 172.21.15.80:50084) 2019-11-28T12:01:44.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.082+0000 7efcd99b8700 1 -- 172.21.15.80:0/3141281934 learned_addr learned my addr 172.21.15.80:0/3141281934 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:44.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.082+0000 7efcd89b6700 1 --1- 172.21.15.80:0/3141281934 >> v1:172.21.15.174:6789/0 conn(0x7efcd4073020 0x7efcd4071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:34454/0 (socket says 172.21.15.80:34454) 2019-11-28T12:01:44.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.083+0000 7efcd99b8700 1 -- 172.21.15.80:0/3141281934 >> v2:172.21.15.174:3300/0 conn(0x7efcd415ed10 msgr2=0x7efcd415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:44.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.083+0000 7efcd99b8700 1 --2- 172.21.15.80:0/3141281934 >> v2:172.21.15.174:3300/0 conn(0x7efcd415ed10 0x7efcd415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:44.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.083+0000 7efcd99b8700 1 -- 172.21.15.80:0/3141281934 >> v1:172.21.15.174:6789/0 conn(0x7efcd4073020 legacy=0x7efcd4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.083+0000 7efcd99b8700 1 -- 172.21.15.80:0/3141281934 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd4070760 con 0x7efcd40734b0 2019-11-28T12:01:44.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.083+0000 7efcd91b7700 1 --2- 172.21.15.80:0/3141281934 >> v2:172.21.15.174:3300/0 conn(0x7efcd415ed10 0x7efcd415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:44.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.083+0000 7efcd99b8700 1 --2- 172.21.15.80:0/3141281934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcd40734b0 0x7efcd40726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efccc00fae0 tx=0x7efccc00fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.083+0000 7efcd99b8700 1 --2- 172.21.15.80:0/3141281934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcd40734b0 0x7efcd40726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efccc00fae0 tx=0x7efccc00fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.083+0000 7efcd99b8700 1 --2- 172.21.15.80:0/3141281934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcd40734b0 0x7efcd40726a0 secure :-1 s=READY pgs=434 cs=0 l=1 rx=0x7efccc00fae0 tx=0x7efccc00fe80).ready entity=mon.2 client_cookie=d171514e075fd1df server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:44.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.083+0000 7efcd99b8700 1 --2- 172.21.15.80:0/3141281934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcd40734b0 0x7efcd40726a0 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7efccc00fae0 tx=0x7efccc00fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.083+0000 7efcd99b8700 1 --2- 172.21.15.80:0/3141281934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcd40734b0 0x7efcd40726a0 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7efccc00fae0 tx=0x7efccc00fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.083+0000 7efcd99b8700 1 --2- 172.21.15.80:0/3141281934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcd40734b0 0x7efcd40726a0 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7efccc00fae0 tx=0x7efccc00fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.083+0000 7efcd3fff700 1 -- 172.21.15.80:0/3141281934 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efccc000df0 con 0x7efcd40734b0 2019-11-28T12:01:44.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.083+0000 7efcd3fff700 1 -- 172.21.15.80:0/3141281934 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc0011f0 con 0x7efcd40734b0 2019-11-28T12:01:44.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.083+0000 7efcd3fff700 1 -- 172.21.15.80:0/3141281934 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efccc001880 con 0x7efcd40734b0 2019-11-28T12:01:44.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.083+0000 7efcdac1a700 1 -- 172.21.15.80:0/3141281934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcd40734b0 msgr2=0x7efcd40726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.083+0000 7efcdac1a700 1 --2- 172.21.15.80:0/3141281934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcd40734b0 0x7efcd40726a0 secure :-1 s=READY pgs=434 cs=0 l=1 rx=0x7efccc00fae0 tx=0x7efccc00fe80).stop 2019-11-28T12:01:44.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.084+0000 7efcdac1a700 1 -- 172.21.15.80:0/3141281934 shutdown_connections 2019-11-28T12:01:44.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.084+0000 7efcdac1a700 1 --2- 172.21.15.80:0/3141281934 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcd40734b0 0x7efcd40726a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:44.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.084+0000 7efcdac1a700 1 --2- 172.21.15.80:0/3141281934 >> v2:172.21.15.174:3300/0 conn(0x7efcd415ed10 0x7efcd415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:44.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.084+0000 7efcdac1a700 1 -- 172.21.15.80:0/3141281934 shutdown_connections 2019-11-28T12:01:44.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.084+0000 7efcdac1a700 1 -- 172.21.15.80:0/3141281934 wait complete. 2019-11-28T12:01:44.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.084+0000 7efcdac1a700 1 -- 172.21.15.80:0/3141281934 >> 172.21.15.80:0/3141281934 conn(0x7efcd4061d40 msgr2=0x7efcd40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:44.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.086+0000 7efcdac1a700 1 Processor -- start 2019-11-28T12:01:44.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.086+0000 7efcdac1a700 1 -- start start 2019-11-28T12:01:44.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.087+0000 7efcdac1a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efcd4114f60 0x7efcd4106b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:44.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.087+0000 7efcdac1a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efcd41070d0 0x7efcd412e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:44.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.087+0000 7efcdac1a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd4130b20 con 0x7efcd412e6e0 2019-11-28T12:01:44.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.087+0000 7efcdac1a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd4148b60 con 0x7efcd4114f60 2019-11-28T12:01:44.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.087+0000 7efcdac1a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd4148e30 con 0x7efcd41070d0 2019-11-28T12:01:44.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd91b7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efcd4114f60 0x7efcd4106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:44.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd91b7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efcd4114f60 0x7efcd4106b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47828/0 (socket says 172.21.15.80:47828) 2019-11-28T12:01:44.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd99b8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efcd412e6e0 0x7efcd4152460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47148/0 (socket says 172.21.15.80:47148) 2019-11-28T12:01:44.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd91b7700 1 -- 172.21.15.80:0/3915046972 learned_addr learned my addr 172.21.15.80:0/3915046972 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:44.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd89b6700 1 --2- 172.21.15.80:0/3915046972 >> v2:172.21.15.174:3300/0 conn(0x7efcd41070d0 0x7efcd412e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:44.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd91b7700 1 -- 172.21.15.80:0/3915046972 >> v2:172.21.15.174:3300/0 conn(0x7efcd41070d0 msgr2=0x7efcd412e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd91b7700 1 --2- 172.21.15.80:0/3915046972 >> v2:172.21.15.174:3300/0 conn(0x7efcd41070d0 0x7efcd412e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:44.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd91b7700 1 -- 172.21.15.80:0/3915046972 >> v1:172.21.15.80:6789/0 conn(0x7efcd412e6e0 legacy=0x7efcd4152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd91b7700 1 -- 172.21.15.80:0/3915046972 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd4104390 con 0x7efcd4114f60 2019-11-28T12:01:44.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd1ffb700 1 -- 172.21.15.80:0/3915046972 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944119952 0 0) 0x7efccc008380 con 0x7efcd412e6e0 2019-11-28T12:01:44.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd91b7700 1 --2- 172.21.15.80:0/3915046972 >> v2:172.21.15.80:3300/0 conn(0x7efcd4114f60 0x7efcd4106b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efcc4010410 tx=0x7efcc4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd91b7700 1 --2- 172.21.15.80:0/3915046972 >> v2:172.21.15.80:3300/0 conn(0x7efcd4114f60 0x7efcd4106b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efcc4010410 tx=0x7efcc4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd91b7700 1 --2- 172.21.15.80:0/3915046972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcd4114f60 0x7efcd4106b90 secure :-1 s=READY pgs=3024 cs=0 l=1 rx=0x7efcc4010410 tx=0x7efcc4010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:44.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd91b7700 1 --2- 172.21.15.80:0/3915046972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcd4114f60 0x7efcd4106b90 secure :-1 s=THROTTLE_DONE pgs=3024 cs=0 l=1 rx=0x7efcc4010410 tx=0x7efcc4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd1ffb700 1 -- 172.21.15.80:0/3915046972 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcc4000960 con 0x7efcd4114f60 2019-11-28T12:01:44.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd91b7700 1 --2- 172.21.15.80:0/3915046972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcd4114f60 0x7efcd4106b90 secure :-1 s=THROTTLE_DONE pgs=3024 cs=0 l=1 rx=0x7efcc4010410 tx=0x7efcc4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd91b7700 1 --2- 172.21.15.80:0/3915046972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcd4114f60 0x7efcd4106b90 secure :-1 s=THROTTLE_DONE pgs=3024 cs=0 l=1 rx=0x7efcc4010410 tx=0x7efcc4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd1ffb700 1 -- 172.21.15.80:0/3915046972 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc4009770 con 0x7efcd4114f60 2019-11-28T12:01:44.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcd1ffb700 1 -- 172.21.15.80:0/3915046972 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcc4000960 con 0x7efcd4114f60 2019-11-28T12:01:44.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcdac1a700 1 -- 172.21.15.80:0/3915046972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd4104710 con 0x7efcd4114f60 2019-11-28T12:01:44.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.088+0000 7efcdac1a700 1 -- 172.21.15.80:0/3915046972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd4104390 con 0x7efcd4114f60 2019-11-28T12:01:44.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.089+0000 7efcd91b7700 1 --2- 172.21.15.80:0/3915046972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcd4114f60 0x7efcd4106b90 secure :-1 s=THROTTLE_DONE pgs=3024 cs=0 l=1 rx=0x7efcc4010410 tx=0x7efcc4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.089+0000 7efcd1ffb700 1 -- 172.21.15.80:0/3915046972 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7efcc4009d80 con 0x7efcd4114f60 2019-11-28T12:01:44.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.089+0000 7efcd91b7700 1 --2- 172.21.15.80:0/3915046972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcd4114f60 0x7efcd4106b90 secure :-1 s=THROTTLE_DONE pgs=3024 cs=0 l=1 rx=0x7efcc4010410 tx=0x7efcc4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.089+0000 7efcd1ffb700 1 --2- 172.21.15.80:0/3915046972 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efcb8018730 0x7efcb801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:44.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.089+0000 7efcd1ffb700 1 -- 172.21.15.80:0/3915046972 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7efcc4031d60 con 0x7efcd4114f60 2019-11-28T12:01:44.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.089+0000 7efcd89b6700 1 --2- 172.21.15.80:0/3915046972 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efcb8018730 0x7efcb801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:44.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.089+0000 7efcd89b6700 1 --2- 172.21.15.80:0/3915046972 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efcb8018730 0x7efcb801abe0 crc :-1 s=READY pgs=1247 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:44.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.096+0000 7efcdac1a700 1 -- 172.21.15.80:0/3915046972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd4104710 con 0x7efcd4114f60 2019-11-28T12:01:44.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.100+0000 7efcd91b7700 1 --2- 172.21.15.80:0/3915046972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcd4114f60 0x7efcd4106b90 secure :-1 s=THROTTLE_DONE pgs=3024 cs=0 l=1 rx=0x7efcc4010410 tx=0x7efcc4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.100+0000 7efcd1ffb700 1 -- 172.21.15.80:0/3915046972 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7efcc400a8c0 con 0x7efcd4114f60 2019-11-28T12:01:44.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.273+0000 7efcdac1a700 1 -- 172.21.15.80:0/3915046972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7efcd4104390 con 0x7efcd4114f60 2019-11-28T12:01:44.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.275+0000 7efcd91b7700 1 --2- 172.21.15.80:0/3915046972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcd4114f60 0x7efcd4106b90 secure :-1 s=THROTTLE_DONE pgs=3024 cs=0 l=1 rx=0x7efcc4010410 tx=0x7efcc4010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.275+0000 7efcd1ffb700 1 -- 172.21.15.80:0/3915046972 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v81) v1 ==== 184+0+0 (secure 0 0 0) 0x7efcc4009670 con 0x7efcd4114f60 2019-11-28T12:01:44.270 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T12:01:44.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.278+0000 7efcdac1a700 1 -- 172.21.15.80:0/3915046972 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efcb8018730 msgr2=0x7efcb801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.272 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.278+0000 7efcdac1a700 1 --2- 172.21.15.80:0/3915046972 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efcb8018730 0x7efcb801abe0 crc :-1 s=READY pgs=1247 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:44.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.278+0000 7efcdac1a700 1 -- 172.21.15.80:0/3915046972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcd4114f60 msgr2=0x7efcd4106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.278+0000 7efcdac1a700 1 --2- 172.21.15.80:0/3915046972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcd4114f60 0x7efcd4106b90 secure :-1 s=READY pgs=3024 cs=0 l=1 rx=0x7efcc4010410 tx=0x7efcc4010290).stop 2019-11-28T12:01:44.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.278+0000 7efcdac1a700 1 -- 172.21.15.80:0/3915046972 shutdown_connections 2019-11-28T12:01:44.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.278+0000 7efcdac1a700 1 --2- 172.21.15.80:0/3915046972 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7efcb8018730 0x7efcb801abe0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:44.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.278+0000 7efcdac1a700 1 --2- 172.21.15.80:0/3915046972 >> v2:172.21.15.174:3300/0 conn(0x7efcd41070d0 0x7efcd412e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:44.273 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.278+0000 7efcdac1a700 1 --2- 172.21.15.80:0/3915046972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcd4114f60 0x7efcd4106b90 unknown :-1 s=CLOSED pgs=3024 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:44.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.278+0000 7efcdac1a700 1 -- 172.21.15.80:0/3915046972 shutdown_connections 2019-11-28T12:01:44.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.278+0000 7efcdac1a700 1 -- 172.21.15.80:0/3915046972 wait complete. 2019-11-28T12:01:44.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.278+0000 7efcdac1a700 1 -- 172.21.15.80:0/3915046972 >> 172.21.15.80:0/3915046972 conn(0x7efcd41476e0 msgr2=0x7efcd412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:44.284 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T12:01:44.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.422+0000 7f0916336700 1 Processor -- start 2019-11-28T12:01:44.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.422+0000 7f0916336700 1 -- start start 2019-11-28T12:01:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.423+0000 7f0916336700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f091015f100 0x7f091006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.423+0000 7f0916336700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091006db60 con 0x7f091015ed10 2019-11-28T12:01:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.423+0000 7f0916336700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091006e060 con 0x7f091006c2f0 2019-11-28T12:01:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.423+0000 7f0916336700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091006fe00 con 0x7f091015f100 2019-11-28T12:01:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.423+0000 7f09148d3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f091015ed10 0x7f0910073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47152/0 (socket says 172.21.15.80:47152) 2019-11-28T12:01:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.423+0000 7f09148d3700 1 -- 172.21.15.80:0/3093222009 learned_addr learned my addr 172.21.15.80:0/3093222009 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:44.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.423+0000 7f090ffff700 1 --2- 172.21.15.80:0/3093222009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f091015f100 0x7f091006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:44.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.423+0000 7f090f7fe700 1 -- 172.21.15.80:0/3093222009 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277008903 0 0) 0x7f0900001150 con 0x7f091015ed10 2019-11-28T12:01:44.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.423+0000 7f090f7fe700 1 -- 172.21.15.80:0/3093222009 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08fc002e80 con 0x7f091015ed10 2019-11-28T12:01:44.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.423+0000 7f090f7fe700 1 -- 172.21.15.80:0/3093222009 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270561907 0 0) 0x7f0908000d30 con 0x7f091006c2f0 2019-11-28T12:01:44.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.423+0000 7f090f7fe700 1 -- 172.21.15.80:0/3093222009 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08fc004170 con 0x7f091006c2f0 2019-11-28T12:01:44.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.424+0000 7f090ffff700 1 -- 172.21.15.80:0/3093222009 >> v1:172.21.15.174:6789/0 conn(0x7f091006c2f0 legacy=0x7f091006c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.424+0000 7f090ffff700 1 -- 172.21.15.80:0/3093222009 >> v1:172.21.15.80:6789/0 conn(0x7f091015ed10 legacy=0x7f0910073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.424+0000 7f090ffff700 1 -- 172.21.15.80:0/3093222009 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0910070760 con 0x7f091015f100 2019-11-28T12:01:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.424+0000 7f090ffff700 1 --2- 172.21.15.80:0/3093222009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f091015f100 0x7f091006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f08f800af50 tx=0x7f08f800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.424+0000 7f090ffff700 1 --2- 172.21.15.80:0/3093222009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f091015f100 0x7f091006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f08f800af50 tx=0x7f08f800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.424+0000 7f090ffff700 1 --2- 172.21.15.80:0/3093222009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f091015f100 0x7f091006bdb0 secure :-1 s=READY pgs=435 cs=0 l=1 rx=0x7f08f800af50 tx=0x7f08f800b760).ready entity=mon.2 client_cookie=f8e808fb2faf1ca7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.424+0000 7f090ffff700 1 --2- 172.21.15.80:0/3093222009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f091015f100 0x7f091006bdb0 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7f08f800af50 tx=0x7f08f800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.424+0000 7f090f7fe700 1 -- 172.21.15.80:0/3093222009 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08f8000960 con 0x7f091015f100 2019-11-28T12:01:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.424+0000 7f090ffff700 1 --2- 172.21.15.80:0/3093222009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f091015f100 0x7f091006bdb0 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7f08f800af50 tx=0x7f08f800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.424+0000 7f090ffff700 1 --2- 172.21.15.80:0/3093222009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f091015f100 0x7f091006bdb0 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7f08f800af50 tx=0x7f08f800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.424+0000 7f090f7fe700 1 -- 172.21.15.80:0/3093222009 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f8009860 con 0x7f091015f100 2019-11-28T12:01:44.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.424+0000 7f090f7fe700 1 -- 172.21.15.80:0/3093222009 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08f8009f30 con 0x7f091015f100 2019-11-28T12:01:44.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.424+0000 7f0916336700 1 -- 172.21.15.80:0/3093222009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f091015f100 msgr2=0x7f091006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.424+0000 7f0916336700 1 --2- 172.21.15.80:0/3093222009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f091015f100 0x7f091006bdb0 secure :-1 s=READY pgs=435 cs=0 l=1 rx=0x7f08f800af50 tx=0x7f08f800b760).stop 2019-11-28T12:01:44.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.425+0000 7f0916336700 1 -- 172.21.15.80:0/3093222009 shutdown_connections 2019-11-28T12:01:44.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.425+0000 7f0916336700 1 --2- 172.21.15.80:0/3093222009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f091015f100 0x7f091006bdb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:44.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.425+0000 7f0916336700 1 -- 172.21.15.80:0/3093222009 shutdown_connections 2019-11-28T12:01:44.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.425+0000 7f0916336700 1 -- 172.21.15.80:0/3093222009 wait complete. 2019-11-28T12:01:44.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.425+0000 7f0916336700 1 -- 172.21.15.80:0/3093222009 >> 172.21.15.80:0/3093222009 conn(0x7f0910061d40 msgr2=0x7f09100641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:44.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.427+0000 7f0916336700 1 Processor -- start 2019-11-28T12:01:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.427+0000 7f0916336700 1 -- start start 2019-11-28T12:01:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.428+0000 7f0916336700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0910101e80 0x7f091012ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.428+0000 7f0916336700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0910115830 con 0x7f09101273e0 2019-11-28T12:01:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.428+0000 7f0916336700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09101140d0 con 0x7f0910139d60 2019-11-28T12:01:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.428+0000 7f0916336700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0910137f90 con 0x7f0910101e80 2019-11-28T12:01:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.428+0000 7f09148d3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f09101273e0 0x7f0910114970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47158/0 (socket says 172.21.15.80:47158) 2019-11-28T12:01:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.428+0000 7f09148d3700 1 -- 172.21.15.80:0/472451403 learned_addr learned my addr 172.21.15.80:0/472451403 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.428+0000 7f090ffff700 1 --2- 172.21.15.80:0/472451403 >> v2:172.21.15.174:3300/0 conn(0x7f0910101e80 0x7f091012ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.428+0000 7f090d7fa700 1 -- 172.21.15.80:0/472451403 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106981229 0 0) 0x7f0900000940 con 0x7f09101273e0 2019-11-28T12:01:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.428+0000 7f090d7fa700 1 -- 172.21.15.80:0/472451403 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08f4002e80 con 0x7f09101273e0 2019-11-28T12:01:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.429+0000 7f090d7fa700 1 -- 172.21.15.80:0/472451403 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 328787898 0 0) 0x7f09000012b0 con 0x7f09101273e0 2019-11-28T12:01:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.429+0000 7f090ffff700 1 -- 172.21.15.80:0/472451403 >> v1:172.21.15.174:6789/0 conn(0x7f0910139d60 legacy=0x7f091013a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.429+0000 7f090ffff700 1 -- 172.21.15.80:0/472451403 >> v1:172.21.15.80:6789/0 conn(0x7f09101273e0 legacy=0x7f0910114970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.429+0000 7f090ffff700 1 -- 172.21.15.80:0/472451403 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0910138620 con 0x7f0910101e80 2019-11-28T12:01:44.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.429+0000 7f090ffff700 1 --2- 172.21.15.80:0/472451403 >> v2:172.21.15.174:3300/0 conn(0x7f0910101e80 0x7f091012ea60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f08f80103d0 tx=0x7f08f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.429+0000 7f090ffff700 1 --2- 172.21.15.80:0/472451403 >> v2:172.21.15.174:3300/0 conn(0x7f0910101e80 0x7f091012ea60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f08f80103d0 tx=0x7f08f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.429+0000 7f090ffff700 1 --2- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0910101e80 0x7f091012ea60 secure :-1 s=READY pgs=1826 cs=0 l=1 rx=0x7f08f80103d0 tx=0x7f08f8010770).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.429+0000 7f090ffff700 1 --2- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0910101e80 0x7f091012ea60 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f08f80103d0 tx=0x7f08f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.429+0000 7f090d7fa700 1 -- 172.21.15.80:0/472451403 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08f8000940 con 0x7f0910101e80 2019-11-28T12:01:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.429+0000 7f090ffff700 1 --2- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0910101e80 0x7f091012ea60 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f08f80103d0 tx=0x7f08f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.429+0000 7f090ffff700 1 --2- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0910101e80 0x7f091012ea60 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f08f80103d0 tx=0x7f08f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.429+0000 7f090d7fa700 1 -- 172.21.15.80:0/472451403 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f8009980 con 0x7f0910101e80 2019-11-28T12:01:44.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.429+0000 7f0916336700 1 -- 172.21.15.80:0/472451403 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09101389a0 con 0x7f0910101e80 2019-11-28T12:01:44.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.429+0000 7f090d7fa700 1 -- 172.21.15.80:0/472451403 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08f800a050 con 0x7f0910101e80 2019-11-28T12:01:44.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.429+0000 7f0916336700 1 -- 172.21.15.80:0/472451403 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0910138620 con 0x7f0910101e80 2019-11-28T12:01:44.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.429+0000 7f090ffff700 1 --2- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0910101e80 0x7f091012ea60 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f08f80103d0 tx=0x7f08f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.430+0000 7f090d7fa700 1 -- 172.21.15.80:0/472451403 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f08f8009580 con 0x7f0910101e80 2019-11-28T12:01:44.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.430+0000 7f090ffff700 1 --2- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0910101e80 0x7f091012ea60 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f08f80103d0 tx=0x7f08f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.430+0000 7f090d7fa700 1 --2- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f08f4018780 0x7f08f401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:44.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.430+0000 7f090d7fa700 1 -- 172.21.15.80:0/472451403 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f08f8031ac0 con 0x7f0910101e80 2019-11-28T12:01:44.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.430+0000 7f09148d3700 1 --2- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f08f4018780 0x7f08f401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:44.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.430+0000 7f09148d3700 1 --2- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f08f4018780 0x7f08f401abf0 crc :-1 s=READY pgs=1249 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:44.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.437+0000 7f0916336700 1 -- 172.21.15.80:0/472451403 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09101389a0 con 0x7f0910101e80 2019-11-28T12:01:44.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.441+0000 7f090ffff700 1 --2- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0910101e80 0x7f091012ea60 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f08f80103d0 tx=0x7f08f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.441+0000 7f090d7fa700 1 -- 172.21.15.80:0/472451403 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f08f8024a00 con 0x7f0910101e80 2019-11-28T12:01:44.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.610+0000 7f0916336700 1 -- 172.21.15.80:0/472451403 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0910138620 con 0x7f0910101e80 2019-11-28T12:01:44.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.616+0000 7f090ffff700 1 --2- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0910101e80 0x7f091012ea60 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f08f80103d0 tx=0x7f08f8010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.610 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.616+0000 7f090d7fa700 1 -- 172.21.15.80:0/472451403 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v82) v1 ==== 184+0+0 (secure 0 0 0) 0x7f08f8024a00 con 0x7f0910101e80 2019-11-28T12:01:44.611 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T12:01:44.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.619+0000 7f0916336700 1 -- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f08f4018780 msgr2=0x7f08f401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.619+0000 7f0916336700 1 --2- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f08f4018780 0x7f08f401abf0 crc :-1 s=READY pgs=1249 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:44.614 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.619+0000 7f0916336700 1 -- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0910101e80 msgr2=0x7f091012ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.619+0000 7f0916336700 1 --2- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0910101e80 0x7f091012ea60 secure :-1 s=READY pgs=1826 cs=0 l=1 rx=0x7f08f80103d0 tx=0x7f08f8010770).stop 2019-11-28T12:01:44.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.620+0000 7f0916336700 1 -- 172.21.15.80:0/472451403 shutdown_connections 2019-11-28T12:01:44.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.620+0000 7f0916336700 1 --2- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f08f4018780 0x7f08f401abf0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:44.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.620+0000 7f0916336700 1 --2- 172.21.15.80:0/472451403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0910101e80 0x7f091012ea60 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:44.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.620+0000 7f0916336700 1 -- 172.21.15.80:0/472451403 shutdown_connections 2019-11-28T12:01:44.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.620+0000 7f0916336700 1 -- 172.21.15.80:0/472451403 wait complete. 2019-11-28T12:01:44.615 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.620+0000 7f0916336700 1 -- 172.21.15.80:0/472451403 >> 172.21.15.80:0/472451403 conn(0x7f0910166610 msgr2=0x7f09101473d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:44.624 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T12:01:44.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.762+0000 7ff29a1bc700 1 Processor -- start 2019-11-28T12:01:44.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.762+0000 7ff29a1bc700 1 -- start start 2019-11-28T12:01:44.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.763+0000 7ff29a1bc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2941639f0 0x7ff294165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:44.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.763+0000 7ff29a1bc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29406db60 con 0x7ff29415ed10 2019-11-28T12:01:44.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.763+0000 7ff29a1bc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29406e060 con 0x7ff29415f100 2019-11-28T12:01:44.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.763+0000 7ff29a1bc700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29406fe00 con 0x7ff2941639f0 2019-11-28T12:01:44.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff293fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff29415ed10 0x7ff294073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47166/0 (socket says 172.21.15.80:47166) 2019-11-28T12:01:44.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff293fff700 1 -- 172.21.15.80:0/1772031346 learned_addr learned my addr 172.21.15.80:0/1772031346 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:44.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff298f5a700 1 --2- 172.21.15.80:0/1772031346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2941639f0 0x7ff294165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:44.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff2937fe700 1 -- 172.21.15.80:0/1772031346 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180912955 0 0) 0x7ff284001150 con 0x7ff29415ed10 2019-11-28T12:01:44.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff2937fe700 1 -- 172.21.15.80:0/1772031346 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff280002e80 con 0x7ff29415ed10 2019-11-28T12:01:44.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff2937fe700 1 -- 172.21.15.80:0/1772031346 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429527216 0 0) 0x7ff27c001080 con 0x7ff29415f100 2019-11-28T12:01:44.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff2937fe700 1 -- 172.21.15.80:0/1772031346 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2800030b0 con 0x7ff29415f100 2019-11-28T12:01:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff298f5a700 1 -- 172.21.15.80:0/1772031346 >> v1:172.21.15.174:6789/0 conn(0x7ff29415f100 legacy=0x7ff29406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff298f5a700 1 -- 172.21.15.80:0/1772031346 >> v1:172.21.15.80:6789/0 conn(0x7ff29415ed10 legacy=0x7ff294073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff298f5a700 1 -- 172.21.15.80:0/1772031346 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff294070760 con 0x7ff2941639f0 2019-11-28T12:01:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff298f5a700 1 --2- 172.21.15.80:0/1772031346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2941639f0 0x7ff294165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff28c00b300 tx=0x7ff28c00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff298f5a700 1 --2- 172.21.15.80:0/1772031346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2941639f0 0x7ff294165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff28c00b300 tx=0x7ff28c00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff298f5a700 1 --2- 172.21.15.80:0/1772031346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2941639f0 0x7ff294165df0 secure :-1 s=READY pgs=436 cs=0 l=1 rx=0x7ff28c00b300 tx=0x7ff28c00bb10).ready entity=mon.2 client_cookie=cb7bc32326a4b254 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff298f5a700 1 --2- 172.21.15.80:0/1772031346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2941639f0 0x7ff294165df0 secure :-1 s=THROTTLE_DONE pgs=436 cs=0 l=1 rx=0x7ff28c00b300 tx=0x7ff28c00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff2937fe700 1 -- 172.21.15.80:0/1772031346 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff28c0075c0 con 0x7ff2941639f0 2019-11-28T12:01:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff298f5a700 1 --2- 172.21.15.80:0/1772031346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2941639f0 0x7ff294165df0 secure :-1 s=THROTTLE_DONE pgs=436 cs=0 l=1 rx=0x7ff28c00b300 tx=0x7ff28c00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff298f5a700 1 --2- 172.21.15.80:0/1772031346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2941639f0 0x7ff294165df0 secure :-1 s=THROTTLE_DONE pgs=436 cs=0 l=1 rx=0x7ff28c00b300 tx=0x7ff28c00bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff2937fe700 1 -- 172.21.15.80:0/1772031346 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c000f30 con 0x7ff2941639f0 2019-11-28T12:01:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff2937fe700 1 -- 172.21.15.80:0/1772031346 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff28c009f50 con 0x7ff2941639f0 2019-11-28T12:01:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff29a1bc700 1 -- 172.21.15.80:0/1772031346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2941639f0 msgr2=0x7ff294165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.764+0000 7ff29a1bc700 1 --2- 172.21.15.80:0/1772031346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2941639f0 0x7ff294165df0 secure :-1 s=READY pgs=436 cs=0 l=1 rx=0x7ff28c00b300 tx=0x7ff28c00bb10).stop 2019-11-28T12:01:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.765+0000 7ff29a1bc700 1 -- 172.21.15.80:0/1772031346 shutdown_connections 2019-11-28T12:01:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.765+0000 7ff29a1bc700 1 --2- 172.21.15.80:0/1772031346 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2941639f0 0x7ff294165df0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.765+0000 7ff29a1bc700 1 -- 172.21.15.80:0/1772031346 shutdown_connections 2019-11-28T12:01:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.765+0000 7ff29a1bc700 1 -- 172.21.15.80:0/1772031346 wait complete. 2019-11-28T12:01:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.765+0000 7ff29a1bc700 1 -- 172.21.15.80:0/1772031346 >> 172.21.15.80:0/1772031346 conn(0x7ff294061d40 msgr2=0x7ff2940641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.767+0000 7ff29a1bc700 1 Processor -- start 2019-11-28T12:01:44.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.768+0000 7ff29a1bc700 1 -- start start 2019-11-28T12:01:44.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.768+0000 7ff29a1bc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff294139160 0x7ff2941382f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:44.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.768+0000 7ff29a1bc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2941619e0 con 0x7ff294161500 2019-11-28T12:01:44.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.768+0000 7ff29a1bc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff294165df0 con 0x7ff2941395f0 2019-11-28T12:01:44.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.768+0000 7ff29a1bc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2941639b0 con 0x7ff294139160 2019-11-28T12:01:44.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff293fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff294161500 0x7ff29412e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47172/0 (socket says 172.21.15.80:47172) 2019-11-28T12:01:44.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff293fff700 1 -- 172.21.15.80:0/764508038 learned_addr learned my addr 172.21.15.80:0/764508038 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:44.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff28bfff700 1 --2- 172.21.15.80:0/764508038 >> v2:172.21.15.174:3300/0 conn(0x7ff294139160 0x7ff2941382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:44.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff2917fa700 1 -- 172.21.15.80:0/764508038 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579031429 0 0) 0x7ff284001150 con 0x7ff294161500 2019-11-28T12:01:44.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff2917fa700 1 -- 172.21.15.80:0/764508038 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff278002e80 con 0x7ff294161500 2019-11-28T12:01:44.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff2917fa700 1 -- 172.21.15.80:0/764508038 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2286419974 0 0) 0x7ff284001350 con 0x7ff294161500 2019-11-28T12:01:44.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff2917fa700 1 -- 172.21.15.80:0/764508038 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff2780032e0 con 0x7ff294161500 2019-11-28T12:01:44.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff2917fa700 1 -- 172.21.15.80:0/764508038 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7ff284001860 con 0x7ff294161500 2019-11-28T12:01:44.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff28bfff700 1 -- 172.21.15.80:0/764508038 >> v1:172.21.15.174:6789/0 conn(0x7ff2941395f0 legacy=0x7ff2941473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff28bfff700 1 -- 172.21.15.80:0/764508038 >> v1:172.21.15.80:6789/0 conn(0x7ff294161500 legacy=0x7ff29412e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff28bfff700 1 -- 172.21.15.80:0/764508038 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff294164310 con 0x7ff294139160 2019-11-28T12:01:44.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff28bfff700 1 --2- 172.21.15.80:0/764508038 >> v2:172.21.15.174:3300/0 conn(0x7ff294139160 0x7ff2941382f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff27c0103a0 tx=0x7ff27c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff28bfff700 1 --2- 172.21.15.80:0/764508038 >> v2:172.21.15.174:3300/0 conn(0x7ff294139160 0x7ff2941382f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff27c0103a0 tx=0x7ff27c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff28bfff700 1 --2- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff294139160 0x7ff2941382f0 secure :-1 s=READY pgs=1829 cs=0 l=1 rx=0x7ff27c0103a0 tx=0x7ff27c010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:44.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff28bfff700 1 --2- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff294139160 0x7ff2941382f0 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7ff27c0103a0 tx=0x7ff27c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff2917fa700 1 -- 172.21.15.80:0/764508038 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff27c000aa0 con 0x7ff294139160 2019-11-28T12:01:44.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff28bfff700 1 --2- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff294139160 0x7ff2941382f0 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7ff27c0103a0 tx=0x7ff27c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff28bfff700 1 --2- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff294139160 0x7ff2941382f0 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7ff27c0103a0 tx=0x7ff27c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff2917fa700 1 -- 172.21.15.80:0/764508038 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c0098b0 con 0x7ff294139160 2019-11-28T12:01:44.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff29a1bc700 1 -- 172.21.15.80:0/764508038 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff294164690 con 0x7ff294139160 2019-11-28T12:01:44.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff2917fa700 1 -- 172.21.15.80:0/764508038 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff27c000aa0 con 0x7ff294139160 2019-11-28T12:01:44.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.769+0000 7ff29a1bc700 1 -- 172.21.15.80:0/764508038 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff294164310 con 0x7ff294139160 2019-11-28T12:01:44.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.770+0000 7ff28bfff700 1 --2- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff294139160 0x7ff2941382f0 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7ff27c0103a0 tx=0x7ff27c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.770+0000 7ff2917fa700 1 -- 172.21.15.80:0/764508038 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff27c000aa0 con 0x7ff294139160 2019-11-28T12:01:44.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.770+0000 7ff28bfff700 1 --2- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff294139160 0x7ff2941382f0 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7ff27c0103a0 tx=0x7ff27c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.770+0000 7ff2917fa700 1 --2- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff278018770 0x7ff27801ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:44.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.770+0000 7ff2917fa700 1 -- 172.21.15.80:0/764508038 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff27c031ab0 con 0x7ff294139160 2019-11-28T12:01:44.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.770+0000 7ff293fff700 1 --2- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff278018770 0x7ff27801ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:44.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.770+0000 7ff293fff700 1 --2- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff278018770 0x7ff27801ac00 crc :-1 s=READY pgs=1250 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:44.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.777+0000 7ff29a1bc700 1 -- 172.21.15.80:0/764508038 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff294164690 con 0x7ff294139160 2019-11-28T12:01:44.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.781+0000 7ff28bfff700 1 --2- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff294139160 0x7ff2941382f0 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7ff27c0103a0 tx=0x7ff27c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.781+0000 7ff2917fa700 1 -- 172.21.15.80:0/764508038 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff27c017440 con 0x7ff294139160 2019-11-28T12:01:44.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.954+0000 7ff29a1bc700 1 -- 172.21.15.80:0/764508038 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff294164310 con 0x7ff294139160 2019-11-28T12:01:44.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.959+0000 7ff28bfff700 1 --2- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff294139160 0x7ff2941382f0 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7ff27c0103a0 tx=0x7ff27c010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:44.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.959+0000 7ff2917fa700 1 -- 172.21.15.80:0/764508038 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v83) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff27c017650 con 0x7ff294139160 2019-11-28T12:01:44.955 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T12:01:44.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.963+0000 7ff29a1bc700 1 -- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff278018770 msgr2=0x7ff27801ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.963+0000 7ff29a1bc700 1 --2- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff278018770 0x7ff27801ac00 crc :-1 s=READY pgs=1250 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:44.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.963+0000 7ff29a1bc700 1 -- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff294139160 msgr2=0x7ff2941382f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:44.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.963+0000 7ff29a1bc700 1 --2- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff294139160 0x7ff2941382f0 secure :-1 s=READY pgs=1829 cs=0 l=1 rx=0x7ff27c0103a0 tx=0x7ff27c010740).stop 2019-11-28T12:01:44.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.963+0000 7ff29a1bc700 1 -- 172.21.15.80:0/764508038 shutdown_connections 2019-11-28T12:01:44.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.963+0000 7ff29a1bc700 1 --2- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff278018770 0x7ff27801ac00 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:44.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.963+0000 7ff29a1bc700 1 --2- 172.21.15.80:0/764508038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff294139160 0x7ff2941382f0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:44.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.963+0000 7ff29a1bc700 1 -- 172.21.15.80:0/764508038 shutdown_connections 2019-11-28T12:01:44.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.963+0000 7ff29a1bc700 1 -- 172.21.15.80:0/764508038 wait complete. 2019-11-28T12:01:44.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:44.963+0000 7ff29a1bc700 1 -- 172.21.15.80:0/764508038 >> 172.21.15.80:0/764508038 conn(0x7ff29407c750 msgr2=0x7ff29413b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:44.967 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:01:45.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.091+0000 7f7167e4f700 1 Processor -- start 2019-11-28T12:01:45.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.091+0000 7f7167e4f700 1 -- start start 2019-11-28T12:01:45.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.092+0000 7f7167e4f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f716006c0a0 0x7f7160072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:45.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7167e4f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7160072620 0x7f7160164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:45.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7167e4f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f716006db00 con 0x7f71600734e0 2019-11-28T12:01:45.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7167e4f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716006f330 con 0x7f7160072620 2019-11-28T12:01:45.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7167e4f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71600706c0 con 0x7f716006c0a0 2019-11-28T12:01:45.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7166bed700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7160072620 0x7f7160164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:45.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7166bed700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7160072620 0x7f7160164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47866/0 (socket says 172.21.15.80:47866) 2019-11-28T12:01:45.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7166bed700 1 -- 172.21.15.80:0/3801228938 learned_addr learned my addr 172.21.15.80:0/3801228938 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f71663ec700 1 --2- 172.21.15.80:0/3801228938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f716006c0a0 0x7f7160072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7166bed700 1 -- 172.21.15.80:0/3801228938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f716006c0a0 msgr2=0x7f7160072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7166bed700 1 --2- 172.21.15.80:0/3801228938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f716006c0a0 0x7f7160072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7166bed700 1 -- 172.21.15.80:0/3801228938 >> v1:172.21.15.174:6789/0 conn(0x7f71600734e0 legacy=0x7f7160071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7166bed700 1 -- 172.21.15.80:0/3801228938 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7160070a40 con 0x7f7160072620 2019-11-28T12:01:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f71663ec700 1 --2- 172.21.15.80:0/3801228938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f716006c0a0 0x7f7160072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T12:01:45.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7166bed700 1 --2- 172.21.15.80:0/3801228938 >> v2:172.21.15.80:3300/0 conn(0x7f7160072620 0x7f7160164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f715800f730 tx=0x7f715800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7166bed700 1 --2- 172.21.15.80:0/3801228938 >> v2:172.21.15.80:3300/0 conn(0x7f7160072620 0x7f7160164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f715800f730 tx=0x7f715800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7166bed700 1 --2- 172.21.15.80:0/3801228938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160072620 0x7f7160164d70 secure :-1 s=READY pgs=3029 cs=0 l=1 rx=0x7f715800f730 tx=0x7f715800fad0).ready entity=mon.0 client_cookie=e6cd71fa58b99f25 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:45.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7166bed700 1 --2- 172.21.15.80:0/3801228938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160072620 0x7f7160164d70 secure :-1 s=THROTTLE_DONE pgs=3029 cs=0 l=1 rx=0x7f715800f730 tx=0x7f715800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7166bed700 1 --2- 172.21.15.80:0/3801228938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160072620 0x7f7160164d70 secure :-1 s=THROTTLE_DONE pgs=3029 cs=0 l=1 rx=0x7f715800f730 tx=0x7f715800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f71653ea700 1 -- 172.21.15.80:0/3801228938 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7158000b90 con 0x7f7160072620 2019-11-28T12:01:45.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7166bed700 1 --2- 172.21.15.80:0/3801228938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160072620 0x7f7160164d70 secure :-1 s=THROTTLE_DONE pgs=3029 cs=0 l=1 rx=0x7f715800f730 tx=0x7f715800fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f71653ea700 1 -- 172.21.15.80:0/3801228938 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71580010e0 con 0x7f7160072620 2019-11-28T12:01:45.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f71653ea700 1 -- 172.21.15.80:0/3801228938 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7158001830 con 0x7f7160072620 2019-11-28T12:01:45.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7167e4f700 1 -- 172.21.15.80:0/3801228938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160072620 msgr2=0x7f7160164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:45.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.093+0000 7f7167e4f700 1 --2- 172.21.15.80:0/3801228938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160072620 0x7f7160164d70 secure :-1 s=READY pgs=3029 cs=0 l=1 rx=0x7f715800f730 tx=0x7f715800fad0).stop 2019-11-28T12:01:45.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.094+0000 7f7167e4f700 1 -- 172.21.15.80:0/3801228938 shutdown_connections 2019-11-28T12:01:45.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.094+0000 7f7167e4f700 1 --2- 172.21.15.80:0/3801228938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160072620 0x7f7160164d70 unknown :-1 s=CLOSED pgs=3029 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:45.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.094+0000 7f7167e4f700 1 --2- 172.21.15.80:0/3801228938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f716006c0a0 0x7f7160072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:45.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.094+0000 7f7167e4f700 1 -- 172.21.15.80:0/3801228938 shutdown_connections 2019-11-28T12:01:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.094+0000 7f7167e4f700 1 -- 172.21.15.80:0/3801228938 wait complete. 2019-11-28T12:01:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.094+0000 7f7167e4f700 1 -- 172.21.15.80:0/3801228938 >> 172.21.15.80:0/3801228938 conn(0x7f7160061cf0 msgr2=0x7f7160064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:45.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.097+0000 7f7167e4f700 1 Processor -- start 2019-11-28T12:01:45.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.097+0000 7f7167e4f700 1 -- start start 2019-11-28T12:01:45.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7167e4f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f716015d7c0 0x7f716012e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:45.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7167e4f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7160159970 0x7f7160158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:45.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7167e4f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7160112260 con 0x7f7160159e00 2019-11-28T12:01:45.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7167e4f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71601405c0 con 0x7f7160159970 2019-11-28T12:01:45.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7167e4f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7160140ff0 con 0x7f716015d7c0 2019-11-28T12:01:45.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7165beb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7160159970 0x7f7160158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:45.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7165beb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7160159970 0x7f7160158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47872/0 (socket says 172.21.15.80:47872) 2019-11-28T12:01:45.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7165beb700 1 -- 172.21.15.80:0/2984425473 learned_addr learned my addr 172.21.15.80:0/2984425473 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:45.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f71663ec700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f716015d7c0 0x7f716012e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:45.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7165beb700 1 -- 172.21.15.80:0/2984425473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f716015d7c0 msgr2=0x7f716012e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:45.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7165beb700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f716015d7c0 0x7f716012e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:45.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7165beb700 1 -- 172.21.15.80:0/2984425473 >> v1:172.21.15.174:6789/0 conn(0x7f7160159e00 legacy=0x7f7160158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:45.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7165beb700 1 -- 172.21.15.80:0/2984425473 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7160141950 con 0x7f7160159970 2019-11-28T12:01:45.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7165beb700 1 --2- 172.21.15.80:0/2984425473 >> v2:172.21.15.80:3300/0 conn(0x7f7160159970 0x7f7160158950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f71480107a0 tx=0x7f7148010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7165beb700 1 --2- 172.21.15.80:0/2984425473 >> v2:172.21.15.80:3300/0 conn(0x7f7160159970 0x7f7160158950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f71480107a0 tx=0x7f7148010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7165beb700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160159970 0x7f7160158950 secure :-1 s=READY pgs=3030 cs=0 l=1 rx=0x7f71480107a0 tx=0x7f7148010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:45.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7165beb700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160159970 0x7f7160158950 secure :-1 s=THROTTLE_DONE pgs=3030 cs=0 l=1 rx=0x7f71480107a0 tx=0x7f7148010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7165beb700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160159970 0x7f7160158950 secure :-1 s=THROTTLE_DONE pgs=3030 cs=0 l=1 rx=0x7f71480107a0 tx=0x7f7148010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7165beb700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160159970 0x7f7160158950 secure :-1 s=THROTTLE_DONE pgs=3030 cs=0 l=1 rx=0x7f71480107a0 tx=0x7f7148010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f715effd700 1 -- 172.21.15.80:0/2984425473 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7148000df0 con 0x7f7160159970 2019-11-28T12:01:45.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f715effd700 1 -- 172.21.15.80:0/2984425473 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7148001410 con 0x7f7160159970 2019-11-28T12:01:45.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7167e4f700 1 -- 172.21.15.80:0/2984425473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7160141cd0 con 0x7f7160159970 2019-11-28T12:01:45.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f715effd700 1 -- 172.21.15.80:0/2984425473 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7148001b60 con 0x7f7160159970 2019-11-28T12:01:45.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.098+0000 7f7167e4f700 1 -- 172.21.15.80:0/2984425473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7160141950 con 0x7f7160159970 2019-11-28T12:01:45.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.099+0000 7f7165beb700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160159970 0x7f7160158950 secure :-1 s=THROTTLE_DONE pgs=3030 cs=0 l=1 rx=0x7f71480107a0 tx=0x7f7148010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.099+0000 7f715effd700 1 -- 172.21.15.80:0/2984425473 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7148000cc0 con 0x7f7160159970 2019-11-28T12:01:45.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.099+0000 7f7165beb700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160159970 0x7f7160158950 secure :-1 s=THROTTLE_DONE pgs=3030 cs=0 l=1 rx=0x7f71480107a0 tx=0x7f7148010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.099+0000 7f715effd700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7144018730 0x7f714401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:45.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.099+0000 7f715effd700 1 -- 172.21.15.80:0/2984425473 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f7148031df0 con 0x7f7160159970 2019-11-28T12:01:45.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.099+0000 7f71663ec700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7144018730 0x7f714401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:45.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.099+0000 7f71663ec700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7144018730 0x7f714401abc0 crc :-1 s=READY pgs=1251 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:45.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.107+0000 7f7167e4f700 1 -- 172.21.15.80:0/2984425473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7160141cd0 con 0x7f7160159970 2019-11-28T12:01:45.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.110+0000 7f7165beb700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160159970 0x7f7160158950 secure :-1 s=THROTTLE_DONE pgs=3030 cs=0 l=1 rx=0x7f71480107a0 tx=0x7f7148010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.110+0000 7f715effd700 1 -- 172.21.15.80:0/2984425473 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f714802cf80 con 0x7f7160159970 2019-11-28T12:01:45.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.284+0000 7f7167e4f700 1 -- 172.21.15.80:0/2984425473 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7160141950 con 0x7f7160159970 2019-11-28T12:01:45.278 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.284+0000 7f7165beb700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160159970 0x7f7160158950 secure :-1 s=THROTTLE_DONE pgs=3030 cs=0 l=1 rx=0x7f71480107a0 tx=0x7f7148010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.279 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.284+0000 7f715effd700 1 -- 172.21.15.80:0/2984425473 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 194 v194) v1 ==== 95+0+1780 (secure 0 0 0) 0x7f714802df00 con 0x7f7160159970 2019-11-28T12:01:45.279 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 194 2019-11-28T12:01:45.280 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:45.280 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":194,"default_fscid":19,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":194,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:01:41.241732+0000","modified":"2019-11-28T12:01:45.253838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8303":{"gid":8303,"name":"c","rank":0,"incarnation":193,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/1019990404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1019990404},{"type":"v1","addr":"172.21.15.174:6835","nonce":1019990404}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[39],"metadata_pool":38,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":19}]} 2019-11-28T12:01:45.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.287+0000 7f7167e4f700 1 -- 172.21.15.80:0/2984425473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7144018730 msgr2=0x7f714401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:45.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.287+0000 7f7167e4f700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7144018730 0x7f714401abc0 crc :-1 s=READY pgs=1251 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:45.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.287+0000 7f7167e4f700 1 -- 172.21.15.80:0/2984425473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160159970 msgr2=0x7f7160158950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:45.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.287+0000 7f7167e4f700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160159970 0x7f7160158950 secure :-1 s=READY pgs=3030 cs=0 l=1 rx=0x7f71480107a0 tx=0x7f7148010600).stop 2019-11-28T12:01:45.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.287+0000 7f7167e4f700 1 -- 172.21.15.80:0/2984425473 shutdown_connections 2019-11-28T12:01:45.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.287+0000 7f7167e4f700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7144018730 0x7f714401abc0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:45.282 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.287+0000 7f7167e4f700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160159970 0x7f7160158950 unknown :-1 s=CLOSED pgs=3030 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:45.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.287+0000 7f7167e4f700 1 --2- 172.21.15.80:0/2984425473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f716015d7c0 0x7f716012e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:45.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.287+0000 7f7167e4f700 1 -- 172.21.15.80:0/2984425473 shutdown_connections 2019-11-28T12:01:45.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.287+0000 7f7167e4f700 1 -- 172.21.15.80:0/2984425473 wait complete. 2019-11-28T12:01:45.283 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.287+0000 7f7167e4f700 1 -- 172.21.15.80:0/2984425473 >> 172.21.15.80:0/2984425473 conn(0x7f716013b860 msgr2=0x7f71601050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:45.594 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8303}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 38, u'failed': [], u'epoch': 194, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [39], u'info': {u'gid_8303': {u'export_targets': [], u'name': u'c', u'incarnation': 193, u'state_seq': 2, u'state': u'up:active', u'gid': 8303, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1019990404, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 1019990404, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/1019990404'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T12:01:41.241732+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T12:01:45.253838+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T12:01:45.595 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T12:01:45.595 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T12:01:45.724 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T12:01:45.724 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T12:01:45.725 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T12:01:45.725 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 8303, 2019-11-28T12:01:45.725 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T12:01:45.725 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T12:01:45.725 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 1.4771348099999999, 2019-11-28T12:01:45.725 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 194, 2019-11-28T12:01:45.726 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 234, 2019-11-28T12:01:45.726 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 234, 2019-11-28T12:01:45.726 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 2.0615900329999999 2019-11-28T12:01:45.726 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T12:01:45.730 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8303, "want_state": "up:active", "state": "up:active", "rank_uptime": 1.4771348099999999, "mdsmap_epoch": 194, "osdmap_epoch": 234, "osdmap_epoch_barrier": 234, "uptime": 2.0615900329999999 } 2019-11-28T12:01:45.730 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T12:01:45.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.855+0000 7f6630553700 1 Processor -- start 2019-11-28T12:01:45.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.855+0000 7f6630553700 1 -- start start 2019-11-28T12:01:45.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.856+0000 7f6630553700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f662806c0a0 0x7f6628072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:45.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.856+0000 7f6630553700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66280734e0 0x7f6628071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.856+0000 7f6630553700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f662806db00 con 0x7f6628072360 2019-11-28T12:01:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.856+0000 7f6630553700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662806f330 con 0x7f66280734e0 2019-11-28T12:01:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.856+0000 7f6630553700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66280706c0 con 0x7f662806c0a0 2019-11-28T12:01:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662e2ef700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66280734e0 0x7f6628071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662e2ef700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f66280734e0 0x7f6628071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47882/0 (socket says 172.21.15.80:47882) 2019-11-28T12:01:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662e2ef700 1 -- 172.21.15.80:0/2127673709 learned_addr learned my addr 172.21.15.80:0/2127673709 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662eaf0700 1 --2- 172.21.15.80:0/2127673709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f662806c0a0 0x7f6628072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662e2ef700 1 -- 172.21.15.80:0/2127673709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f662806c0a0 msgr2=0x7f6628072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662e2ef700 1 --2- 172.21.15.80:0/2127673709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f662806c0a0 0x7f6628072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662e2ef700 1 -- 172.21.15.80:0/2127673709 >> v1:172.21.15.174:6789/0 conn(0x7f6628072360 legacy=0x7f662806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662e2ef700 1 -- 172.21.15.80:0/2127673709 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6628070a40 con 0x7f66280734e0 2019-11-28T12:01:45.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662e2ef700 1 --2- 172.21.15.80:0/2127673709 >> v2:172.21.15.80:3300/0 conn(0x7f66280734e0 0x7f6628071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f661800f6c0 tx=0x7f661800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662e2ef700 1 --2- 172.21.15.80:0/2127673709 >> v2:172.21.15.80:3300/0 conn(0x7f66280734e0 0x7f6628071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f661800f6c0 tx=0x7f661800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662e2ef700 1 --2- 172.21.15.80:0/2127673709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66280734e0 0x7f6628071e20 secure :-1 s=READY pgs=3031 cs=0 l=1 rx=0x7f661800f6c0 tx=0x7f661800fa60).ready entity=mon.0 client_cookie=3abb10b933a281aa server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:45.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662e2ef700 1 --2- 172.21.15.80:0/2127673709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66280734e0 0x7f6628071e20 secure :-1 s=THROTTLE_DONE pgs=3031 cs=0 l=1 rx=0x7f661800f6c0 tx=0x7f661800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662e2ef700 1 --2- 172.21.15.80:0/2127673709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66280734e0 0x7f6628071e20 secure :-1 s=THROTTLE_DONE pgs=3031 cs=0 l=1 rx=0x7f661800f6c0 tx=0x7f661800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662daee700 1 -- 172.21.15.80:0/2127673709 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6618000960 con 0x7f66280734e0 2019-11-28T12:01:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662e2ef700 1 --2- 172.21.15.80:0/2127673709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66280734e0 0x7f6628071e20 secure :-1 s=THROTTLE_DONE pgs=3031 cs=0 l=1 rx=0x7f661800f6c0 tx=0x7f661800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662daee700 1 -- 172.21.15.80:0/2127673709 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6618000c90 con 0x7f66280734e0 2019-11-28T12:01:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f662daee700 1 -- 172.21.15.80:0/2127673709 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66180013a0 con 0x7f66280734e0 2019-11-28T12:01:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f6630553700 1 -- 172.21.15.80:0/2127673709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66280734e0 msgr2=0x7f6628071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:45.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.857+0000 7f6630553700 1 --2- 172.21.15.80:0/2127673709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66280734e0 0x7f6628071e20 secure :-1 s=READY pgs=3031 cs=0 l=1 rx=0x7f661800f6c0 tx=0x7f661800fa60).stop 2019-11-28T12:01:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.858+0000 7f6630553700 1 -- 172.21.15.80:0/2127673709 shutdown_connections 2019-11-28T12:01:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.858+0000 7f6630553700 1 --2- 172.21.15.80:0/2127673709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66280734e0 0x7f6628071e20 unknown :-1 s=CLOSED pgs=3031 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.858+0000 7f6630553700 1 --2- 172.21.15.80:0/2127673709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f662806c0a0 0x7f6628072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.858+0000 7f6630553700 1 -- 172.21.15.80:0/2127673709 shutdown_connections 2019-11-28T12:01:45.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.858+0000 7f6630553700 1 -- 172.21.15.80:0/2127673709 wait complete. 2019-11-28T12:01:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.858+0000 7f6630553700 1 -- 172.21.15.80:0/2127673709 >> 172.21.15.80:0/2127673709 conn(0x7f6628061cf0 msgr2=0x7f6628064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:45.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.861+0000 7f6630553700 1 Processor -- start 2019-11-28T12:01:45.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.861+0000 7f6630553700 1 -- start start 2019-11-28T12:01:45.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.861+0000 7f6630553700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f662813e900 0x7f6628121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:45.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.861+0000 7f6630553700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6628121c90 0x7f66281209a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:45.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.861+0000 7f6630553700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6628139df0 con 0x7f6628120ee0 2019-11-28T12:01:45.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.861+0000 7f6630553700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6628128920 con 0x7f662813e900 2019-11-28T12:01:45.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.861+0000 7f6630553700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662813b850 con 0x7f6628121c90 2019-11-28T12:01:45.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f662eaf0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f662813e900 0x7f6628121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:45.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f662eaf0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f662813e900 0x7f6628121750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47888/0 (socket says 172.21.15.80:47888) 2019-11-28T12:01:45.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f662eaf0700 1 -- 172.21.15.80:0/2369077813 learned_addr learned my addr 172.21.15.80:0/2369077813 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:45.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f662e2ef700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6628121c90 0x7f66281209a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:45.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f662eaf0700 1 -- 172.21.15.80:0/2369077813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6628121c90 msgr2=0x7f66281209a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:45.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f662eaf0700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6628121c90 0x7f66281209a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:45.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f662eaf0700 1 -- 172.21.15.80:0/2369077813 >> v1:172.21.15.174:6789/0 conn(0x7f6628120ee0 legacy=0x7f6628164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:45.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f662eaf0700 1 -- 172.21.15.80:0/2369077813 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6628128fb0 con 0x7f662813e900 2019-11-28T12:01:45.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f662eaf0700 1 --2- 172.21.15.80:0/2369077813 >> v2:172.21.15.80:3300/0 conn(0x7f662813e900 0x7f6628121750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f66100107d0 tx=0x7f66100105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f662eaf0700 1 --2- 172.21.15.80:0/2369077813 >> v2:172.21.15.80:3300/0 conn(0x7f662813e900 0x7f6628121750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f66100107d0 tx=0x7f66100105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f662eaf0700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f662813e900 0x7f6628121750 secure :-1 s=READY pgs=3032 cs=0 l=1 rx=0x7f66100107d0 tx=0x7f66100105d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:45.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f662eaf0700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f662813e900 0x7f6628121750 secure :-1 s=THROTTLE_DONE pgs=3032 cs=0 l=1 rx=0x7f66100107d0 tx=0x7f66100105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f662eaf0700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f662813e900 0x7f6628121750 secure :-1 s=THROTTLE_DONE pgs=3032 cs=0 l=1 rx=0x7f66100107d0 tx=0x7f66100105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f66277fe700 1 -- 172.21.15.80:0/2369077813 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6610005af0 con 0x7f662813e900 2019-11-28T12:01:45.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f662eaf0700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f662813e900 0x7f6628121750 secure :-1 s=THROTTLE_DONE pgs=3032 cs=0 l=1 rx=0x7f66100107d0 tx=0x7f66100105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f66277fe700 1 -- 172.21.15.80:0/2369077813 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6610005710 con 0x7f662813e900 2019-11-28T12:01:45.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f66277fe700 1 -- 172.21.15.80:0/2369077813 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66100060d0 con 0x7f662813e900 2019-11-28T12:01:45.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f6630553700 1 -- 172.21.15.80:0/2369077813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6628129330 con 0x7f662813e900 2019-11-28T12:01:45.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f6630553700 1 -- 172.21.15.80:0/2369077813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66281281b0 con 0x7f662813e900 2019-11-28T12:01:45.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.862+0000 7f662eaf0700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f662813e900 0x7f6628121750 secure :-1 s=THROTTLE_DONE pgs=3032 cs=0 l=1 rx=0x7f66100107d0 tx=0x7f66100105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.863+0000 7f66277fe700 1 -- 172.21.15.80:0/2369077813 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6610005900 con 0x7f662813e900 2019-11-28T12:01:45.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.863+0000 7f662eaf0700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f662813e900 0x7f6628121750 secure :-1 s=THROTTLE_DONE pgs=3032 cs=0 l=1 rx=0x7f66100107d0 tx=0x7f66100105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.863+0000 7f66277fe700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f660c018730 0x7f660c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:45.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.863+0000 7f66277fe700 1 -- 172.21.15.80:0/2369077813 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6610031dd0 con 0x7f662813e900 2019-11-28T12:01:45.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.863+0000 7f662e2ef700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f660c018730 0x7f660c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:45.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.863+0000 7f662e2ef700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f660c018730 0x7f660c01abc0 crc :-1 s=READY pgs=1252 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:45.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.871+0000 7f6630553700 1 -- 172.21.15.80:0/2369077813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6628128fb0 con 0x7f662813e900 2019-11-28T12:01:45.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.874+0000 7f662eaf0700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f662813e900 0x7f6628121750 secure :-1 s=THROTTLE_DONE pgs=3032 cs=0 l=1 rx=0x7f66100107d0 tx=0x7f66100105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:45.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:45.874+0000 7f66277fe700 1 -- 172.21.15.80:0/2369077813 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6610022700 con 0x7f662813e900 2019-11-28T12:01:46.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.052+0000 7f6630553700 1 -- 172.21.15.80:0/2369077813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6628129330 con 0x7f662813e900 2019-11-28T12:01:46.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.053+0000 7f662eaf0700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f662813e900 0x7f6628121750 secure :-1 s=THROTTLE_DONE pgs=3032 cs=0 l=1 rx=0x7f66100107d0 tx=0x7f66100105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.053+0000 7f66277fe700 1 -- 172.21.15.80:0/2369077813 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v234) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f6610022700 con 0x7f662813e900 2019-11-28T12:01:46.048 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:46.048 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":234,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T12:01:42.242911+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":39,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":38,"pool_name":"cephfs_metadata","create_time":"2019-11-28T12:01:39.532697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"233","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":39,"pool_name":"cephfs_data","create_time":"2019-11-28T12:01:40.218947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"234","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T12:01:46.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.055+0000 7f6630553700 1 -- 172.21.15.80:0/2369077813 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f660c018730 msgr2=0x7f660c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.055+0000 7f6630553700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f660c018730 0x7f660c01abc0 crc :-1 s=READY pgs=1252 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:46.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.055+0000 7f6630553700 1 -- 172.21.15.80:0/2369077813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f662813e900 msgr2=0x7f6628121750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.055+0000 7f6630553700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f662813e900 0x7f6628121750 secure :-1 s=READY pgs=3032 cs=0 l=1 rx=0x7f66100107d0 tx=0x7f66100105d0).stop 2019-11-28T12:01:46.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.055+0000 7f6630553700 1 -- 172.21.15.80:0/2369077813 shutdown_connections 2019-11-28T12:01:46.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.055+0000 7f6630553700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f660c018730 0x7f660c01abc0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:46.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.055+0000 7f6630553700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6628121c90 0x7f66281209a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:46.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.055+0000 7f6630553700 1 --2- 172.21.15.80:0/2369077813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f662813e900 0x7f6628121750 unknown :-1 s=CLOSED pgs=3032 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:46.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.055+0000 7f6630553700 1 -- 172.21.15.80:0/2369077813 shutdown_connections 2019-11-28T12:01:46.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.055+0000 7f6630553700 1 -- 172.21.15.80:0/2369077813 wait complete. 2019-11-28T12:01:46.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.055+0000 7f6630553700 1 -- 172.21.15.80:0/2369077813 >> 172.21.15.80:0/2369077813 conn(0x7f6628127dc0 msgr2=0x7f6628141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:46.059 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T12:01:39.532697+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 38, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'233', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T12:01:40.218947+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 39, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'234', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T12:01:46.060 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T12:01:46.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.189+0000 7f087415d700 1 Processor -- start 2019-11-28T12:01:46.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.189+0000 7f087415d700 1 -- start start 2019-11-28T12:01:46.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.190+0000 7f087415d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f086c15f100 0x7f086c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.190+0000 7f087415d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f086c06c2f0 0x7f086c06c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.190+0000 7f087415d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c06db60 con 0x7f086c15ed10 2019-11-28T12:01:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.190+0000 7f087415d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c06fe00 con 0x7f086c06c2f0 2019-11-28T12:01:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.190+0000 7f087415d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0700d0 con 0x7f086c15f100 2019-11-28T12:01:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f0872efb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f086c06c2f0 0x7f086c06c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:46.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f0872efb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f086c06c2f0 0x7f086c06c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47894/0 (socket says 172.21.15.80:47894) 2019-11-28T12:01:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f0872efb700 1 -- 172.21.15.80:0/52956543 learned_addr learned my addr 172.21.15.80:0/52956543 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f0871ef9700 1 --2- 172.21.15.80:0/52956543 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f086c15f100 0x7f086c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f0872efb700 1 -- 172.21.15.80:0/52956543 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f086c15f100 msgr2=0x7f086c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f0872efb700 1 --2- 172.21.15.80:0/52956543 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f086c15f100 0x7f086c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f0872efb700 1 -- 172.21.15.80:0/52956543 >> v1:172.21.15.174:6789/0 conn(0x7f086c15ed10 legacy=0x7f086c073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f0872efb700 1 -- 172.21.15.80:0/52956543 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c070760 con 0x7f086c06c2f0 2019-11-28T12:01:46.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f08716f8700 1 -- 172.21.15.80:0/52956543 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697301316 0 0) 0x7f085c001080 con 0x7f086c15ed10 2019-11-28T12:01:46.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f0872efb700 1 --2- 172.21.15.80:0/52956543 >> v2:172.21.15.80:3300/0 conn(0x7f086c06c2f0 0x7f086c06c790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f086400f6b0 tx=0x7f086400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f0872efb700 1 --2- 172.21.15.80:0/52956543 >> v2:172.21.15.80:3300/0 conn(0x7f086c06c2f0 0x7f086c06c790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f086400f6b0 tx=0x7f086400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f0872efb700 1 --2- 172.21.15.80:0/52956543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f086c06c2f0 0x7f086c06c790 secure :-1 s=READY pgs=3033 cs=0 l=1 rx=0x7f086400f6b0 tx=0x7f086400fa50).ready entity=mon.0 client_cookie=bb8d1a256b2d8ce9 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:46.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f0872efb700 1 --2- 172.21.15.80:0/52956543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f086c06c2f0 0x7f086c06c790 secure :-1 s=THROTTLE_DONE pgs=3033 cs=0 l=1 rx=0x7f086400f6b0 tx=0x7f086400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f08716f8700 1 -- 172.21.15.80:0/52956543 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0864000a70 con 0x7f086c06c2f0 2019-11-28T12:01:46.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f0872efb700 1 --2- 172.21.15.80:0/52956543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f086c06c2f0 0x7f086c06c790 secure :-1 s=THROTTLE_DONE pgs=3033 cs=0 l=1 rx=0x7f086400f6b0 tx=0x7f086400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f0872efb700 1 --2- 172.21.15.80:0/52956543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f086c06c2f0 0x7f086c06c790 secure :-1 s=THROTTLE_DONE pgs=3033 cs=0 l=1 rx=0x7f086400f6b0 tx=0x7f086400fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f08716f8700 1 -- 172.21.15.80:0/52956543 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0864000a70 con 0x7f086c06c2f0 2019-11-28T12:01:46.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f08716f8700 1 -- 172.21.15.80:0/52956543 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08640012d0 con 0x7f086c06c2f0 2019-11-28T12:01:46.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f087415d700 1 -- 172.21.15.80:0/52956543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f086c06c2f0 msgr2=0x7f086c06c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.191+0000 7f087415d700 1 --2- 172.21.15.80:0/52956543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f086c06c2f0 0x7f086c06c790 secure :-1 s=READY pgs=3033 cs=0 l=1 rx=0x7f086400f6b0 tx=0x7f086400fa50).stop 2019-11-28T12:01:46.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.192+0000 7f087415d700 1 -- 172.21.15.80:0/52956543 shutdown_connections 2019-11-28T12:01:46.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.192+0000 7f087415d700 1 --2- 172.21.15.80:0/52956543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f086c06c2f0 0x7f086c06c790 unknown :-1 s=CLOSED pgs=3033 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:46.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.192+0000 7f087415d700 1 --2- 172.21.15.80:0/52956543 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f086c15f100 0x7f086c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:46.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.192+0000 7f087415d700 1 -- 172.21.15.80:0/52956543 shutdown_connections 2019-11-28T12:01:46.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.192+0000 7f087415d700 1 -- 172.21.15.80:0/52956543 wait complete. 2019-11-28T12:01:46.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.192+0000 7f087415d700 1 -- 172.21.15.80:0/52956543 >> 172.21.15.80:0/52956543 conn(0x7f086c061d20 msgr2=0x7f086c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:46.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.195+0000 7f087415d700 1 Processor -- start 2019-11-28T12:01:46.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.195+0000 7f087415d700 1 -- start start 2019-11-28T12:01:46.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.195+0000 7f087415d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f086c12d0c0 0x7f086c12d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:46.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.195+0000 7f087415d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c104420 con 0x7f086c12bde0 2019-11-28T12:01:46.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.195+0000 7f087415d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c104a80 con 0x7f086c15faf0 2019-11-28T12:01:46.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.195+0000 7f087415d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c111980 con 0x7f086c12d0c0 2019-11-28T12:01:46.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.195+0000 7f0871ef9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f086c12bde0 0x7f086c12c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47216/0 (socket says 172.21.15.80:47216) 2019-11-28T12:01:46.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.195+0000 7f0871ef9700 1 -- 172.21.15.80:0/4204394009 learned_addr learned my addr 172.21.15.80:0/4204394009 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:46.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f0872efb700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f086c12d0c0 0x7f086c12d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:46.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080148438 0 0) 0x7f0854001430 con 0x7f086c12bde0 2019-11-28T12:01:46.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0850002e80 con 0x7f086c12bde0 2019-11-28T12:01:46.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959508578 0 0) 0x7f085c001240 con 0x7f086c15faf0 2019-11-28T12:01:46.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08500030b0 con 0x7f086c15faf0 2019-11-28T12:01:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2282201106 0 0) 0x7f0854000cc0 con 0x7f086c12bde0 2019-11-28T12:01:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f08500033c0 con 0x7f086c12bde0 2019-11-28T12:01:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f08540018c0 con 0x7f086c12bde0 2019-11-28T12:01:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f086c12d0c0 msgr2=0x7f086c12d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f086c12d0c0 0x7f086c12d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 >> v1:172.21.15.174:6789/0 conn(0x7f086c15faf0 legacy=0x7f086c1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 >> v1:172.21.15.80:6789/0 conn(0x7f086c12bde0 legacy=0x7f086c12c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0850005d50 0x7f0850006140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08500046f0 0x7f0850004b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08500051e0 0x7f08500032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08500039f0 con 0x7f0850005d50 2019-11-28T12:01:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0850003c20 con 0x7f08500046f0 2019-11-28T12:01:46.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0850003e50 con 0x7f08500051e0 2019-11-28T12:01:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f0872efb700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f086c12d0c0 0x7f086c12d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f08726fa700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0850005d50 0x7f0850006140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f0872efb700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08500051e0 0x7f08500032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f0871ef9700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08500046f0 0x7f0850004b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f08726fa700 1 -- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08500051e0 msgr2=0x7f08500032e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f08726fa700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08500051e0 0x7f08500032e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:46.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f08726fa700 1 -- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08500046f0 msgr2=0x7f0850004b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f08726fa700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08500046f0 0x7f0850004b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:46.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.196+0000 7f08726fa700 1 -- 172.21.15.80:0/4204394009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0850004100 con 0x7f0850005d50 2019-11-28T12:01:46.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.197+0000 7f087415d700 1 -- 172.21.15.80:0/4204394009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c112660 con 0x7f0850005d50 2019-11-28T12:01:46.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.197+0000 7f08726fa700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0850005d50 0x7f0850006140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f085c0103a0 tx=0x7f085c010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.197+0000 7f087415d700 1 -- 172.21.15.80:0/4204394009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c1122e0 con 0x7f0850005d50 2019-11-28T12:01:46.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.197+0000 7f08726fa700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0850005d50 0x7f0850006140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f085c0103a0 tx=0x7f085c010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.197+0000 7f08726fa700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0850005d50 0x7f0850006140 secure :-1 s=READY pgs=3035 cs=0 l=1 rx=0x7f085c0103a0 tx=0x7f085c010220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:46.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.197+0000 7f08726fa700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0850005d50 0x7f0850006140 secure :-1 s=THROTTLE_DONE pgs=3035 cs=0 l=1 rx=0x7f085c0103a0 tx=0x7f085c010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.197+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f085c000e20 con 0x7f0850005d50 2019-11-28T12:01:46.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.197+0000 7f08726fa700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0850005d50 0x7f0850006140 secure :-1 s=THROTTLE_DONE pgs=3035 cs=0 l=1 rx=0x7f085c0103a0 tx=0x7f085c010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.197+0000 7f08726fa700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0850005d50 0x7f0850006140 secure :-1 s=THROTTLE_DONE pgs=3035 cs=0 l=1 rx=0x7f085c0103a0 tx=0x7f085c010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.197+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c00bd30 con 0x7f0850005d50 2019-11-28T12:01:46.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.197+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f085c00c400 con 0x7f0850005d50 2019-11-28T12:01:46.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.197+0000 7f08726fa700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0850005d50 0x7f0850006140 secure :-1 s=THROTTLE_DONE pgs=3035 cs=0 l=1 rx=0x7f085c0103a0 tx=0x7f085c010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.197+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f085c000e20 con 0x7f0850005d50 2019-11-28T12:01:46.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.197+0000 7f08726fa700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0850005d50 0x7f0850006140 secure :-1 s=THROTTLE_DONE pgs=3035 cs=0 l=1 rx=0x7f085c0103a0 tx=0x7f085c010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.197+0000 7f086affd700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0850020b70 0x7f0850022fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:46.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.197+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f085c031bc0 con 0x7f0850005d50 2019-11-28T12:01:46.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.198+0000 7f0871ef9700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0850020b70 0x7f0850022fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:46.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.198+0000 7f0871ef9700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0850020b70 0x7f0850022fa0 crc :-1 s=READY pgs=1253 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:46.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.205+0000 7f087415d700 1 -- 172.21.15.80:0/4204394009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c112660 con 0x7f0850005d50 2019-11-28T12:01:46.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.208+0000 7f08726fa700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0850005d50 0x7f0850006140 secure :-1 s=THROTTLE_DONE pgs=3035 cs=0 l=1 rx=0x7f085c0103a0 tx=0x7f085c010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.208+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f085c00b930 con 0x7f0850005d50 2019-11-28T12:01:46.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.374+0000 7f087415d700 1 -- 172.21.15.80:0/4204394009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f086c1122e0 con 0x7f0850005d50 2019-11-28T12:01:46.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.374+0000 7f08726fa700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0850005d50 0x7f0850006140 secure :-1 s=THROTTLE_DONE pgs=3035 cs=0 l=1 rx=0x7f085c0103a0 tx=0x7f085c010220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.375+0000 7f086affd700 1 -- 172.21.15.80:0/4204394009 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v234) v1 ==== 92+0+10 (secure 0 0 0) 0x7f085c000e20 con 0x7f0850005d50 2019-11-28T12:01:46.369 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:01:46.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.377+0000 7f087415d700 1 -- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0850020b70 msgr2=0x7f0850022fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.377+0000 7f087415d700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0850020b70 0x7f0850022fa0 crc :-1 s=READY pgs=1253 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:46.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.377+0000 7f087415d700 1 -- 172.21.15.80:0/4204394009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0850005d50 msgr2=0x7f0850006140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.377+0000 7f087415d700 1 --2- 172.21.15.80:0/4204394009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0850005d50 0x7f0850006140 secure :-1 s=READY pgs=3035 cs=0 l=1 rx=0x7f085c0103a0 tx=0x7f085c010220).stop 2019-11-28T12:01:46.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.377+0000 7f0872efb700 1 -- 172.21.15.80:0/4204394009 reap_dead start 2019-11-28T12:01:46.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.377+0000 7f0872efb700 1 -- 172.21.15.80:0/4204394009 reap_dead start 2019-11-28T12:01:46.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.377+0000 7f087415d700 1 -- 172.21.15.80:0/4204394009 shutdown_connections 2019-11-28T12:01:46.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.377+0000 7f087415d700 1 -- 172.21.15.80:0/4204394009 shutdown_connections 2019-11-28T12:01:46.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.377+0000 7f087415d700 1 -- 172.21.15.80:0/4204394009 wait complete. 2019-11-28T12:01:46.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.377+0000 7f087415d700 1 -- 172.21.15.80:0/4204394009 >> 172.21.15.80:0/4204394009 conn(0x7f086c07c4f0 msgr2=0x7f086c15ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:46.387 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T12:01:46.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.519+0000 7f84943bd700 1 Processor -- start 2019-11-28T12:01:46.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.519+0000 7f84943bd700 1 -- start start 2019-11-28T12:01:46.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.520+0000 7f84943bd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f848c15ed10 0x7f848c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:46.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.520+0000 7f84943bd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c0734b0 0x7f848c0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:46.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.520+0000 7f84943bd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848c06db60 con 0x7f848c073020 2019-11-28T12:01:46.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.520+0000 7f84943bd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c06fe00 con 0x7f848c15ed10 2019-11-28T12:01:46.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.520+0000 7f84943bd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c0700d0 con 0x7f848c0734b0 2019-11-28T12:01:46.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f849315b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c0734b0 0x7f848c0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:46.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f849295a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f848c15ed10 0x7f848c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:46.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f8492159700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f848c073020 0x7f848c071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:34544/0 (socket says 172.21.15.80:34544) 2019-11-28T12:01:46.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f849315b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c0734b0 0x7f848c0726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:50174/0 (socket says 172.21.15.80:50174) 2019-11-28T12:01:46.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f8492159700 1 -- 172.21.15.80:0/1132010366 learned_addr learned my addr 172.21.15.80:0/1132010366 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:46.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f849295a700 1 -- 172.21.15.80:0/1132010366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c0734b0 msgr2=0x7f848c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:46.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f849295a700 1 --2- 172.21.15.80:0/1132010366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c0734b0 0x7f848c0726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:46.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f849295a700 1 -- 172.21.15.80:0/1132010366 >> v1:172.21.15.174:6789/0 conn(0x7f848c073020 legacy=0x7f848c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f8491958700 1 -- 172.21.15.80:0/1132010366 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712331312 0 0) 0x7f84740013f0 con 0x7f848c073020 2019-11-28T12:01:46.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f849295a700 1 -- 172.21.15.80:0/1132010366 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c070760 con 0x7f848c15ed10 2019-11-28T12:01:46.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f849295a700 1 --2- 172.21.15.80:0/1132010366 >> v2:172.21.15.174:3300/0 conn(0x7f848c15ed10 0x7f848c15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f847c00af50 tx=0x7f847c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f849295a700 1 --2- 172.21.15.80:0/1132010366 >> v2:172.21.15.174:3300/0 conn(0x7f848c15ed10 0x7f848c15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f847c00af50 tx=0x7f847c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f849295a700 1 --2- 172.21.15.80:0/1132010366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f848c15ed10 0x7f848c15f100 secure :-1 s=READY pgs=1837 cs=0 l=1 rx=0x7f847c00af50 tx=0x7f847c00b6e0).ready entity=mon.1 client_cookie=f14ec9e01217c468 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:46.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f849295a700 1 --2- 172.21.15.80:0/1132010366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f848c15ed10 0x7f848c15f100 secure :-1 s=THROTTLE_DONE pgs=1837 cs=0 l=1 rx=0x7f847c00af50 tx=0x7f847c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f8491958700 1 -- 172.21.15.80:0/1132010366 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f847c007210 con 0x7f848c15ed10 2019-11-28T12:01:46.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f849295a700 1 --2- 172.21.15.80:0/1132010366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f848c15ed10 0x7f848c15f100 secure :-1 s=THROTTLE_DONE pgs=1837 cs=0 l=1 rx=0x7f847c00af50 tx=0x7f847c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.521+0000 7f849295a700 1 --2- 172.21.15.80:0/1132010366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f848c15ed10 0x7f848c15f100 secure :-1 s=THROTTLE_DONE pgs=1837 cs=0 l=1 rx=0x7f847c00af50 tx=0x7f847c00b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.522+0000 7f8491958700 1 -- 172.21.15.80:0/1132010366 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847c0099b0 con 0x7f848c15ed10 2019-11-28T12:01:46.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.522+0000 7f8491958700 1 -- 172.21.15.80:0/1132010366 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f847c009c20 con 0x7f848c15ed10 2019-11-28T12:01:46.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.522+0000 7f84943bd700 1 -- 172.21.15.80:0/1132010366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f848c15ed10 msgr2=0x7f848c15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.522+0000 7f84943bd700 1 --2- 172.21.15.80:0/1132010366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f848c15ed10 0x7f848c15f100 secure :-1 s=READY pgs=1837 cs=0 l=1 rx=0x7f847c00af50 tx=0x7f847c00b6e0).stop 2019-11-28T12:01:46.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.522+0000 7f84943bd700 1 -- 172.21.15.80:0/1132010366 shutdown_connections 2019-11-28T12:01:46.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.522+0000 7f84943bd700 1 --2- 172.21.15.80:0/1132010366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c0734b0 0x7f848c0726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:46.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.522+0000 7f84943bd700 1 --2- 172.21.15.80:0/1132010366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f848c15ed10 0x7f848c15f100 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:46.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.522+0000 7f84943bd700 1 -- 172.21.15.80:0/1132010366 shutdown_connections 2019-11-28T12:01:46.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.522+0000 7f84943bd700 1 -- 172.21.15.80:0/1132010366 wait complete. 2019-11-28T12:01:46.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.522+0000 7f84943bd700 1 -- 172.21.15.80:0/1132010366 >> 172.21.15.80:0/1132010366 conn(0x7f848c061d20 msgr2=0x7f848c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:46.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.525+0000 7f84943bd700 1 Processor -- start 2019-11-28T12:01:46.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.525+0000 7f84943bd700 1 -- start start 2019-11-28T12:01:46.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f84943bd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c167d80 0x7f848c16a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:46.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f84943bd700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848c148e00 con 0x7f848c1079b0 2019-11-28T12:01:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f84943bd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848c108b10 con 0x7f848c148320 2019-11-28T12:01:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f84943bd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c13aa20 con 0x7f848c167d80 2019-11-28T12:01:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f8492159700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f848c1079b0 0x7f848c107e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47236/0 (socket says 172.21.15.80:47236) 2019-11-28T12:01:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f8492159700 1 -- 172.21.15.80:0/1709215647 learned_addr learned my addr 172.21.15.80:0/1709215647 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:46.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f849315b700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c167d80 0x7f848c16a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:46.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f848b7fe700 1 -- 172.21.15.80:0/1709215647 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127068495 0 0) 0x7f84740014e0 con 0x7f848c1079b0 2019-11-28T12:01:46.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f848b7fe700 1 -- 172.21.15.80:0/1709215647 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8470002e80 con 0x7f848c1079b0 2019-11-28T12:01:46.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f848b7fe700 1 -- 172.21.15.80:0/1709215647 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298487592 0 0) 0x7f847c0097e0 con 0x7f848c148320 2019-11-28T12:01:46.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f848b7fe700 1 -- 172.21.15.80:0/1709215647 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8470004170 con 0x7f848c148320 2019-11-28T12:01:46.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f849315b700 1 -- 172.21.15.80:0/1709215647 >> v1:172.21.15.174:6789/0 conn(0x7f848c148320 legacy=0x7f848c10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f849315b700 1 -- 172.21.15.80:0/1709215647 >> v1:172.21.15.80:6789/0 conn(0x7f848c1079b0 legacy=0x7f848c107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f849315b700 1 -- 172.21.15.80:0/1709215647 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c10c490 con 0x7f848c167d80 2019-11-28T12:01:46.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f849315b700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c167d80 0x7f848c16a180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8484010390 tx=0x7f8484010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f849315b700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c167d80 0x7f848c16a180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8484010390 tx=0x7f8484010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f849315b700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c167d80 0x7f848c16a180 secure :-1 s=READY pgs=437 cs=0 l=1 rx=0x7f8484010390 tx=0x7f8484010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:46.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f849315b700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c167d80 0x7f848c16a180 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f8484010390 tx=0x7f8484010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f848b7fe700 1 -- 172.21.15.80:0/1709215647 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8484009990 con 0x7f848c167d80 2019-11-28T12:01:46.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f849315b700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c167d80 0x7f848c16a180 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f8484010390 tx=0x7f8484010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f848b7fe700 1 -- 172.21.15.80:0/1709215647 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84840095b0 con 0x7f848c167d80 2019-11-28T12:01:46.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f849315b700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c167d80 0x7f848c16a180 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f8484010390 tx=0x7f8484010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.526+0000 7f84943bd700 1 -- 172.21.15.80:0/1709215647 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848c10c810 con 0x7f848c167d80 2019-11-28T12:01:46.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.527+0000 7f848b7fe700 1 -- 172.21.15.80:0/1709215647 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8484009c20 con 0x7f848c167d80 2019-11-28T12:01:46.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.527+0000 7f84943bd700 1 -- 172.21.15.80:0/1709215647 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848c10c490 con 0x7f848c167d80 2019-11-28T12:01:46.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.527+0000 7f849315b700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c167d80 0x7f848c16a180 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f8484010390 tx=0x7f8484010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.527+0000 7f848b7fe700 1 -- 172.21.15.80:0/1709215647 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f848400ea80 con 0x7f848c167d80 2019-11-28T12:01:46.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.527+0000 7f849315b700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c167d80 0x7f848c16a180 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f8484010390 tx=0x7f8484010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.527+0000 7f848b7fe700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8470018740 0x7f847001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:46.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.527+0000 7f848b7fe700 1 -- 172.21.15.80:0/1709215647 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8484031a70 con 0x7f848c167d80 2019-11-28T12:01:46.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.527+0000 7f849295a700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8470018740 0x7f847001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:46.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.528+0000 7f849295a700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8470018740 0x7f847001abf0 crc :-1 s=READY pgs=1254 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:46.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.535+0000 7f84943bd700 1 -- 172.21.15.80:0/1709215647 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848c10c810 con 0x7f848c167d80 2019-11-28T12:01:46.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.538+0000 7f849315b700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c167d80 0x7f848c16a180 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f8484010390 tx=0x7f8484010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.538+0000 7f848b7fe700 1 -- 172.21.15.80:0/1709215647 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8484009a10 con 0x7f848c167d80 2019-11-28T12:01:46.698 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.705+0000 7f84943bd700 1 -- 172.21.15.80:0/1709215647 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f848c10c490 con 0x7f848c167d80 2019-11-28T12:01:46.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.705+0000 7f849315b700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c167d80 0x7f848c16a180 secure :-1 s=THROTTLE_DONE pgs=437 cs=0 l=1 rx=0x7f8484010390 tx=0x7f8484010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.699 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.705+0000 7f848b7fe700 1 -- 172.21.15.80:0/1709215647 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v234) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8484009a10 con 0x7f848c167d80 2019-11-28T12:01:46.700 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:01:46.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.708+0000 7f84943bd700 1 -- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8470018740 msgr2=0x7f847001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.708+0000 7f84943bd700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8470018740 0x7f847001abf0 crc :-1 s=READY pgs=1254 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:46.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.708+0000 7f84943bd700 1 -- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c167d80 msgr2=0x7f848c16a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.708+0000 7f84943bd700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c167d80 0x7f848c16a180 secure :-1 s=READY pgs=437 cs=0 l=1 rx=0x7f8484010390 tx=0x7f8484010730).stop 2019-11-28T12:01:46.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.708+0000 7f84943bd700 1 -- 172.21.15.80:0/1709215647 shutdown_connections 2019-11-28T12:01:46.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.708+0000 7f84943bd700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f848c167d80 0x7f848c16a180 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:46.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.708+0000 7f84943bd700 1 --2- 172.21.15.80:0/1709215647 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8470018740 0x7f847001abf0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:46.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.708+0000 7f84943bd700 1 -- 172.21.15.80:0/1709215647 shutdown_connections 2019-11-28T12:01:46.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.708+0000 7f84943bd700 1 -- 172.21.15.80:0/1709215647 wait complete. 2019-11-28T12:01:46.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.708+0000 7f84943bd700 1 -- 172.21.15.80:0/1709215647 >> 172.21.15.80:0/1709215647 conn(0x7f848c15e2d0 msgr2=0x7f848c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:46.712 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T12:01:46.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.841+0000 7f4300341700 1 Processor -- start 2019-11-28T12:01:46.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.841+0000 7f4300341700 1 -- start start 2019-11-28T12:01:46.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.842+0000 7f4300341700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42f815f100 0x7f42f806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:46.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.842+0000 7f4300341700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f806db60 con 0x7f42f815ed10 2019-11-28T12:01:46.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.842+0000 7f4300341700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f806e060 con 0x7f42f806c2f0 2019-11-28T12:01:46.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.842+0000 7f4300341700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f806fe00 con 0x7f42f815f100 2019-11-28T12:01:46.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.842+0000 7f42fe0dd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42f815f100 0x7f42f806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:46.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.842+0000 7f42fe8de700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f42f815ed10 0x7f42f8073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47242/0 (socket says 172.21.15.80:47242) 2019-11-28T12:01:46.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.842+0000 7f42fe8de700 1 -- 172.21.15.80:0/1672267728 learned_addr learned my addr 172.21.15.80:0/1672267728 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:46.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.842+0000 7f42fe0dd700 1 -- 172.21.15.80:0/1672267728 >> v1:172.21.15.174:6789/0 conn(0x7f42f806c2f0 legacy=0x7f42f806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.842+0000 7f42fe0dd700 1 -- 172.21.15.80:0/1672267728 >> v1:172.21.15.80:6789/0 conn(0x7f42f815ed10 legacy=0x7f42f8073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.843+0000 7f42fd8dc700 1 -- 172.21.15.80:0/1672267728 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958085586 0 0) 0x7f42e00014d0 con 0x7f42f815ed10 2019-11-28T12:01:46.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.843+0000 7f42fe0dd700 1 -- 172.21.15.80:0/1672267728 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f8070760 con 0x7f42f815f100 2019-11-28T12:01:46.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.843+0000 7f42fe0dd700 1 --2- 172.21.15.80:0/1672267728 >> v2:172.21.15.80:3300/0 conn(0x7f42f815f100 0x7f42f806bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f42e800af50 tx=0x7f42e800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.843+0000 7f42fe0dd700 1 --2- 172.21.15.80:0/1672267728 >> v2:172.21.15.80:3300/0 conn(0x7f42f815f100 0x7f42f806bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f42e800af50 tx=0x7f42e800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.843+0000 7f42fe0dd700 1 --2- 172.21.15.80:0/1672267728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f815f100 0x7f42f806bdb0 secure :-1 s=READY pgs=3038 cs=0 l=1 rx=0x7f42e800af50 tx=0x7f42e800b760).ready entity=mon.0 client_cookie=e3226291c064adad server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:46.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.844+0000 7f42fe0dd700 1 --2- 172.21.15.80:0/1672267728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f815f100 0x7f42f806bdb0 secure :-1 s=THROTTLE_DONE pgs=3038 cs=0 l=1 rx=0x7f42e800af50 tx=0x7f42e800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.844+0000 7f42fe0dd700 1 --2- 172.21.15.80:0/1672267728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f815f100 0x7f42f806bdb0 secure :-1 s=THROTTLE_DONE pgs=3038 cs=0 l=1 rx=0x7f42e800af50 tx=0x7f42e800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.844+0000 7f42fd8dc700 1 -- 172.21.15.80:0/1672267728 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42e8000960 con 0x7f42f815f100 2019-11-28T12:01:46.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.844+0000 7f42fe0dd700 1 --2- 172.21.15.80:0/1672267728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f815f100 0x7f42f806bdb0 secure :-1 s=THROTTLE_DONE pgs=3038 cs=0 l=1 rx=0x7f42e800af50 tx=0x7f42e800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.844+0000 7f42fd8dc700 1 -- 172.21.15.80:0/1672267728 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e8009860 con 0x7f42f815f100 2019-11-28T12:01:46.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.844+0000 7f42fd8dc700 1 -- 172.21.15.80:0/1672267728 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42e8009f30 con 0x7f42f815f100 2019-11-28T12:01:46.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.844+0000 7f4300341700 1 -- 172.21.15.80:0/1672267728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f815f100 msgr2=0x7f42f806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.844+0000 7f4300341700 1 --2- 172.21.15.80:0/1672267728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f815f100 0x7f42f806bdb0 secure :-1 s=READY pgs=3038 cs=0 l=1 rx=0x7f42e800af50 tx=0x7f42e800b760).stop 2019-11-28T12:01:46.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.845+0000 7f4300341700 1 -- 172.21.15.80:0/1672267728 shutdown_connections 2019-11-28T12:01:46.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.845+0000 7f4300341700 1 --2- 172.21.15.80:0/1672267728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f815f100 0x7f42f806bdb0 unknown :-1 s=CLOSED pgs=3038 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:46.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.845+0000 7f4300341700 1 -- 172.21.15.80:0/1672267728 shutdown_connections 2019-11-28T12:01:46.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.845+0000 7f4300341700 1 -- 172.21.15.80:0/1672267728 wait complete. 2019-11-28T12:01:46.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.845+0000 7f4300341700 1 -- 172.21.15.80:0/1672267728 >> 172.21.15.80:0/1672267728 conn(0x7f42f8061d20 msgr2=0x7f42f80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:46.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.847+0000 7f4300341700 1 Processor -- start 2019-11-28T12:01:46.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.847+0000 7f4300341700 1 -- start start 2019-11-28T12:01:46.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.848+0000 7f4300341700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f42f8127280 0x7f42f8079840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:46.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.848+0000 7f4300341700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42f8079d80 0x7f42f812e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:46.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.848+0000 7f4300341700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42f8165190 0x7f42f8165630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:46.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.848+0000 7f4300341700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f8075800 con 0x7f42f8165190 2019-11-28T12:01:46.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.848+0000 7f4300341700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f8075ad0 con 0x7f42f8127280 2019-11-28T12:01:46.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.848+0000 7f4300341700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f814ce70 con 0x7f42f8079d80 2019-11-28T12:01:46.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.848+0000 7f42ff0df700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42f8165190 0x7f42f8165630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:46.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.848+0000 7f42ff0df700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42f8165190 0x7f42f8165630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47936/0 (socket says 172.21.15.80:47936) 2019-11-28T12:01:46.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.848+0000 7f42ff0df700 1 -- 172.21.15.80:0/2410676965 learned_addr learned my addr 172.21.15.80:0/2410676965 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:46.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.848+0000 7f42fe8de700 1 --2- 172.21.15.80:0/2410676965 >> v2:172.21.15.174:3300/0 conn(0x7f42f8127280 0x7f42f8079840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:46.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.848+0000 7f42fe0dd700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42f8079d80 0x7f42f812e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:46.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.849+0000 7f42ff0df700 1 -- 172.21.15.80:0/2410676965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42f8079d80 msgr2=0x7f42f812e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.849+0000 7f42ff0df700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42f8079d80 0x7f42f812e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:46.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.849+0000 7f42ff0df700 1 -- 172.21.15.80:0/2410676965 >> v2:172.21.15.174:3300/0 conn(0x7f42f8127280 msgr2=0x7f42f8079840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:46.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.849+0000 7f42ff0df700 1 --2- 172.21.15.80:0/2410676965 >> v2:172.21.15.174:3300/0 conn(0x7f42f8127280 0x7f42f8079840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:46.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.849+0000 7f42ff0df700 1 -- 172.21.15.80:0/2410676965 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f8076160 con 0x7f42f8165190 2019-11-28T12:01:46.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.849+0000 7f42ff0df700 1 --2- 172.21.15.80:0/2410676965 >> v2:172.21.15.80:3300/0 conn(0x7f42f8165190 0x7f42f8165630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42f00125b0 tx=0x7f42f0012490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.849+0000 7f42ff0df700 1 --2- 172.21.15.80:0/2410676965 >> v2:172.21.15.80:3300/0 conn(0x7f42f8165190 0x7f42f8165630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42f00125b0 tx=0x7f42f0012490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.849+0000 7f42ff0df700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f8165190 0x7f42f8165630 secure :-1 s=READY pgs=3039 cs=0 l=1 rx=0x7f42f00125b0 tx=0x7f42f0012490).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:46.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.849+0000 7f42ff0df700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f8165190 0x7f42f8165630 secure :-1 s=THROTTLE_DONE pgs=3039 cs=0 l=1 rx=0x7f42f00125b0 tx=0x7f42f0012490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.849+0000 7f42ff0df700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f8165190 0x7f42f8165630 secure :-1 s=THROTTLE_DONE pgs=3039 cs=0 l=1 rx=0x7f42f00125b0 tx=0x7f42f0012490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.849+0000 7f42f77fe700 1 -- 172.21.15.80:0/2410676965 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42f0000960 con 0x7f42f8165190 2019-11-28T12:01:46.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.849+0000 7f42ff0df700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f8165190 0x7f42f8165630 secure :-1 s=THROTTLE_DONE pgs=3039 cs=0 l=1 rx=0x7f42f00125b0 tx=0x7f42f0012490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.849+0000 7f42f77fe700 1 -- 172.21.15.80:0/2410676965 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f0001090 con 0x7f42f8165190 2019-11-28T12:01:46.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.849+0000 7f42f77fe700 1 -- 172.21.15.80:0/2410676965 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42f0001720 con 0x7f42f8165190 2019-11-28T12:01:46.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.849+0000 7f4300341700 1 -- 172.21.15.80:0/2410676965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f80764e0 con 0x7f42f8165190 2019-11-28T12:01:46.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.849+0000 7f4300341700 1 -- 172.21.15.80:0/2410676965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f8076160 con 0x7f42f8165190 2019-11-28T12:01:46.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.850+0000 7f42ff0df700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f8165190 0x7f42f8165630 secure :-1 s=THROTTLE_DONE pgs=3039 cs=0 l=1 rx=0x7f42f00125b0 tx=0x7f42f0012490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.850+0000 7f42f77fe700 1 -- 172.21.15.80:0/2410676965 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f42f0000ea0 con 0x7f42f8165190 2019-11-28T12:01:46.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.850+0000 7f42ff0df700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f8165190 0x7f42f8165630 secure :-1 s=THROTTLE_DONE pgs=3039 cs=0 l=1 rx=0x7f42f00125b0 tx=0x7f42f0012490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.850+0000 7f42f77fe700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42dc018730 0x7f42dc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:46.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.850+0000 7f42f77fe700 1 -- 172.21.15.80:0/2410676965 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f42f0033c10 con 0x7f42f8165190 2019-11-28T12:01:46.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.850+0000 7f42fe8de700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42dc018730 0x7f42dc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:46.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.851+0000 7f42fe8de700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42dc018730 0x7f42dc01abc0 crc :-1 s=READY pgs=1255 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:46.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.856+0000 7f4300341700 1 -- 172.21.15.80:0/2410676965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f80764e0 con 0x7f42f8165190 2019-11-28T12:01:46.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.860+0000 7f42ff0df700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f8165190 0x7f42f8165630 secure :-1 s=THROTTLE_DONE pgs=3039 cs=0 l=1 rx=0x7f42f00125b0 tx=0x7f42f0012490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:46.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:46.860+0000 7f42f77fe700 1 -- 172.21.15.80:0/2410676965 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f42f0007590 con 0x7f42f8165190 2019-11-28T12:01:47.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.030+0000 7f4300341700 1 -- 172.21.15.80:0/2410676965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f42f8076160 con 0x7f42f8165190 2019-11-28T12:01:47.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.030+0000 7f42ff0df700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f8165190 0x7f42f8165630 secure :-1 s=THROTTLE_DONE pgs=3039 cs=0 l=1 rx=0x7f42f00125b0 tx=0x7f42f0012490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:47.024 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.030+0000 7f42f77fe700 1 -- 172.21.15.80:0/2410676965 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v234) v1 ==== 100+0+10 (secure 0 0 0) 0x7f42f00193e0 con 0x7f42f8165190 2019-11-28T12:01:47.025 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:01:47.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.032+0000 7f4300341700 1 -- 172.21.15.80:0/2410676965 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42dc018730 msgr2=0x7f42dc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:47.027 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.032+0000 7f4300341700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42dc018730 0x7f42dc01abc0 crc :-1 s=READY pgs=1255 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:47.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.032+0000 7f4300341700 1 -- 172.21.15.80:0/2410676965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f8165190 msgr2=0x7f42f8165630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:47.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.032+0000 7f4300341700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f8165190 0x7f42f8165630 secure :-1 s=READY pgs=3039 cs=0 l=1 rx=0x7f42f00125b0 tx=0x7f42f0012490).stop 2019-11-28T12:01:47.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.033+0000 7f4300341700 1 -- 172.21.15.80:0/2410676965 shutdown_connections 2019-11-28T12:01:47.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.033+0000 7f4300341700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42dc018730 0x7f42dc01abc0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:47.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.033+0000 7f4300341700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f8165190 0x7f42f8165630 unknown :-1 s=CLOSED pgs=3039 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:47.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.033+0000 7f4300341700 1 --2- 172.21.15.80:0/2410676965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42f8079d80 0x7f42f812e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:47.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.033+0000 7f4300341700 1 --2- 172.21.15.80:0/2410676965 >> v2:172.21.15.174:3300/0 conn(0x7f42f8127280 0x7f42f8079840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:47.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.033+0000 7f4300341700 1 -- 172.21.15.80:0/2410676965 shutdown_connections 2019-11-28T12:01:47.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.033+0000 7f4300341700 1 -- 172.21.15.80:0/2410676965 wait complete. 2019-11-28T12:01:47.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.033+0000 7f4300341700 1 -- 172.21.15.80:0/2410676965 >> 172.21.15.80:0/2410676965 conn(0x7f42f8166440 msgr2=0x7f42f81494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:47.036 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T12:01:47.037 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:01:47.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.161+0000 7f67ca504700 1 Processor -- start 2019-11-28T12:01:47.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.161+0000 7f67ca504700 1 -- start start 2019-11-28T12:01:47.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.162+0000 7f67ca504700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f67c406c0a0 0x7f67c4072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:47.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.162+0000 7f67ca504700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f67c40734e0 0x7f67c4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:47.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.162+0000 7f67ca504700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c406db00 con 0x7f67c4072360 2019-11-28T12:01:47.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.162+0000 7f67ca504700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c406fd60 con 0x7f67c40734e0 2019-11-28T12:01:47.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.162+0000 7f67ca504700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c4070030 con 0x7f67c406c0a0 2019-11-28T12:01:47.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.162+0000 7f67c3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f67c40734e0 0x7f67c4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:47.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f67c40734e0 0x7f67c4071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47940/0 (socket says 172.21.15.80:47940) 2019-11-28T12:01:47.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c3fff700 1 -- 172.21.15.80:0/3270341675 learned_addr learned my addr 172.21.15.80:0/3270341675 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:47.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c8aa1700 1 --2- 172.21.15.80:0/3270341675 >> v2:172.21.15.174:3300/0 conn(0x7f67c406c0a0 0x7f67c4072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:47.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c3fff700 1 -- 172.21.15.80:0/3270341675 >> v2:172.21.15.174:3300/0 conn(0x7f67c406c0a0 msgr2=0x7f67c4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:47.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c3fff700 1 --2- 172.21.15.80:0/3270341675 >> v2:172.21.15.174:3300/0 conn(0x7f67c406c0a0 0x7f67c4072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:47.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c3fff700 1 -- 172.21.15.80:0/3270341675 >> v1:172.21.15.174:6789/0 conn(0x7f67c4072360 legacy=0x7f67c406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:47.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c3fff700 1 -- 172.21.15.80:0/3270341675 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c40706c0 con 0x7f67c40734e0 2019-11-28T12:01:47.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c8aa1700 1 --2- 172.21.15.80:0/3270341675 >> v2:172.21.15.174:3300/0 conn(0x7f67c406c0a0 0x7f67c4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T12:01:47.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c3fff700 1 --2- 172.21.15.80:0/3270341675 >> v2:172.21.15.80:3300/0 conn(0x7f67c40734e0 0x7f67c4071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f67b400fac0 tx=0x7f67b400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:47.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c3fff700 1 --2- 172.21.15.80:0/3270341675 >> v2:172.21.15.80:3300/0 conn(0x7f67c40734e0 0x7f67c4071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f67b400fac0 tx=0x7f67b400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:47.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c3fff700 1 --2- 172.21.15.80:0/3270341675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c40734e0 0x7f67c4071e20 secure :-1 s=READY pgs=3040 cs=0 l=1 rx=0x7f67b400fac0 tx=0x7f67b400fe60).ready entity=mon.0 client_cookie=6130962c74e598a7 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:47.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c3fff700 1 --2- 172.21.15.80:0/3270341675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c40734e0 0x7f67c4071e20 secure :-1 s=THROTTLE_DONE pgs=3040 cs=0 l=1 rx=0x7f67b400fac0 tx=0x7f67b400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:47.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c3fff700 1 --2- 172.21.15.80:0/3270341675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c40734e0 0x7f67c4071e20 secure :-1 s=THROTTLE_DONE pgs=3040 cs=0 l=1 rx=0x7f67b400fac0 tx=0x7f67b400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:47.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c37fe700 1 -- 172.21.15.80:0/3270341675 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67b4000ce0 con 0x7f67c40734e0 2019-11-28T12:01:47.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c3fff700 1 --2- 172.21.15.80:0/3270341675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c40734e0 0x7f67c4071e20 secure :-1 s=THROTTLE_DONE pgs=3040 cs=0 l=1 rx=0x7f67b400fac0 tx=0x7f67b400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:47.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c37fe700 1 -- 172.21.15.80:0/3270341675 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b4001010 con 0x7f67c40734e0 2019-11-28T12:01:47.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67c37fe700 1 -- 172.21.15.80:0/3270341675 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67b4001720 con 0x7f67c40734e0 2019-11-28T12:01:47.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67ca504700 1 -- 172.21.15.80:0/3270341675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c40734e0 msgr2=0x7f67c4071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:47.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.163+0000 7f67ca504700 1 --2- 172.21.15.80:0/3270341675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c40734e0 0x7f67c4071e20 secure :-1 s=READY pgs=3040 cs=0 l=1 rx=0x7f67b400fac0 tx=0x7f67b400fe60).stop 2019-11-28T12:01:47.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.164+0000 7f67ca504700 1 -- 172.21.15.80:0/3270341675 shutdown_connections 2019-11-28T12:01:47.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.164+0000 7f67ca504700 1 --2- 172.21.15.80:0/3270341675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c40734e0 0x7f67c4071e20 unknown :-1 s=CLOSED pgs=3040 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:47.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.164+0000 7f67ca504700 1 --2- 172.21.15.80:0/3270341675 >> v2:172.21.15.174:3300/0 conn(0x7f67c406c0a0 0x7f67c4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:47.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.164+0000 7f67ca504700 1 -- 172.21.15.80:0/3270341675 shutdown_connections 2019-11-28T12:01:47.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.164+0000 7f67ca504700 1 -- 172.21.15.80:0/3270341675 wait complete. 2019-11-28T12:01:47.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.164+0000 7f67ca504700 1 -- 172.21.15.80:0/3270341675 >> 172.21.15.80:0/3270341675 conn(0x7f67c4061cf0 msgr2=0x7f67c4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:47.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.166+0000 7f67ca504700 1 Processor -- start 2019-11-28T12:01:47.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.166+0000 7f67ca504700 1 -- start start 2019-11-28T12:01:47.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.167+0000 7f67ca504700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f67c413a780 0x7f67c412d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:47.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.167+0000 7f67ca504700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67c412d9c0 0x7f67c412c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:47.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.167+0000 7f67ca504700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c4139a60 con 0x7f67c412c840 2019-11-28T12:01:47.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.167+0000 7f67ca504700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c412a260 con 0x7f67c413a780 2019-11-28T12:01:47.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.167+0000 7f67ca504700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c412a530 con 0x7f67c412d9c0 2019-11-28T12:01:47.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.167+0000 7f67c8aa1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f67c413a780 0x7f67c412d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:47.172 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.167+0000 7f67c8aa1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f67c413a780 0x7f67c412d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47944/0 (socket says 172.21.15.80:47944) 2019-11-28T12:01:47.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c8aa1700 1 -- 172.21.15.80:0/3681991920 learned_addr learned my addr 172.21.15.80:0/3681991920 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:47.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.167+0000 7f67c92a2700 1 --1- 172.21.15.80:0/3681991920 >> v1:172.21.15.80:6789/0 conn(0x7f67c412c840 0x7f67c41281b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47262/0 (socket says 172.21.15.80:47262) 2019-11-28T12:01:47.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c3fff700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67c412d9c0 0x7f67c412c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:47.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c8aa1700 1 -- 172.21.15.80:0/3681991920 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67c412d9c0 msgr2=0x7f67c412c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:47.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c8aa1700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67c412d9c0 0x7f67c412c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:47.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c8aa1700 1 -- 172.21.15.80:0/3681991920 >> v1:172.21.15.80:6789/0 conn(0x7f67c412c840 legacy=0x7f67c41281b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:47.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c8aa1700 1 -- 172.21.15.80:0/3681991920 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c412abc0 con 0x7f67c413a780 2019-11-28T12:01:47.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c17fa700 1 -- 172.21.15.80:0/3681991920 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032227649 0 0) 0x7f67bc0010b0 con 0x7f67c412c840 2019-11-28T12:01:47.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c8aa1700 1 --2- 172.21.15.80:0/3681991920 >> v2:172.21.15.80:3300/0 conn(0x7f67c413a780 0x7f67c412d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f67ac0103e0 tx=0x7f67ac010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:47.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c8aa1700 1 --2- 172.21.15.80:0/3681991920 >> v2:172.21.15.80:3300/0 conn(0x7f67c413a780 0x7f67c412d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f67ac0103e0 tx=0x7f67ac010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:47.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c8aa1700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c413a780 0x7f67c412d480 secure :-1 s=READY pgs=3042 cs=0 l=1 rx=0x7f67ac0103e0 tx=0x7f67ac010780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:47.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c8aa1700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c413a780 0x7f67c412d480 secure :-1 s=THROTTLE_DONE pgs=3042 cs=0 l=1 rx=0x7f67ac0103e0 tx=0x7f67ac010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:47.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c17fa700 1 -- 172.21.15.80:0/3681991920 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67ac000940 con 0x7f67c413a780 2019-11-28T12:01:47.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c8aa1700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c413a780 0x7f67c412d480 secure :-1 s=THROTTLE_DONE pgs=3042 cs=0 l=1 rx=0x7f67ac0103e0 tx=0x7f67ac010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:47.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c17fa700 1 -- 172.21.15.80:0/3681991920 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac000940 con 0x7f67c413a780 2019-11-28T12:01:47.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c8aa1700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c413a780 0x7f67c412d480 secure :-1 s=THROTTLE_DONE pgs=3042 cs=0 l=1 rx=0x7f67ac0103e0 tx=0x7f67ac010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:47.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67ca504700 1 -- 172.21.15.80:0/3681991920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c412af40 con 0x7f67c413a780 2019-11-28T12:01:47.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c17fa700 1 -- 172.21.15.80:0/3681991920 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67ac001280 con 0x7f67c413a780 2019-11-28T12:01:47.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67ca504700 1 -- 172.21.15.80:0/3681991920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c412abc0 con 0x7f67c413a780 2019-11-28T12:01:47.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.168+0000 7f67c8aa1700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c413a780 0x7f67c412d480 secure :-1 s=THROTTLE_DONE pgs=3042 cs=0 l=1 rx=0x7f67ac0103e0 tx=0x7f67ac010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:47.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.169+0000 7f67c17fa700 1 -- 172.21.15.80:0/3681991920 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f67ac000f40 con 0x7f67c413a780 2019-11-28T12:01:47.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.169+0000 7f67c8aa1700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c413a780 0x7f67c412d480 secure :-1 s=THROTTLE_DONE pgs=3042 cs=0 l=1 rx=0x7f67ac0103e0 tx=0x7f67ac010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:47.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.169+0000 7f67c17fa700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67a8018730 0x7f67a801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:47.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.169+0000 7f67c17fa700 1 -- 172.21.15.80:0/3681991920 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f67ac031d20 con 0x7f67c413a780 2019-11-28T12:01:47.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.169+0000 7f67c3fff700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67a8018730 0x7f67a801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:47.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.169+0000 7f67c3fff700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67a8018730 0x7f67a801abc0 crc :-1 s=READY pgs=1256 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:47.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.177+0000 7f67ca504700 1 -- 172.21.15.80:0/3681991920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c412af40 con 0x7f67c413a780 2019-11-28T12:01:47.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.180+0000 7f67c8aa1700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c413a780 0x7f67c412d480 secure :-1 s=THROTTLE_DONE pgs=3042 cs=0 l=1 rx=0x7f67ac0103e0 tx=0x7f67ac010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:47.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.180+0000 7f67c17fa700 1 -- 172.21.15.80:0/3681991920 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f67ac000c90 con 0x7f67c413a780 2019-11-28T12:01:47.344 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.351+0000 7f67ca504700 1 -- 172.21.15.80:0/3681991920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67c412abc0 con 0x7f67c413a780 2019-11-28T12:01:47.345 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.351+0000 7f67c8aa1700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c413a780 0x7f67c412d480 secure :-1 s=THROTTLE_DONE pgs=3042 cs=0 l=1 rx=0x7f67ac0103e0 tx=0x7f67ac010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:47.346 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.351+0000 7f67c17fa700 1 -- 172.21.15.80:0/3681991920 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 194 v194) v1 ==== 95+0+1780 (secure 0 0 0) 0x7f67ac000ea0 con 0x7f67c413a780 2019-11-28T12:01:47.346 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 194 2019-11-28T12:01:47.346 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:47.346 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":194,"default_fscid":19,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":194,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:01:41.241732+0000","modified":"2019-11-28T12:01:45.253838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8303":{"gid":8303,"name":"c","rank":0,"incarnation":193,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/1019990404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1019990404},{"type":"v1","addr":"172.21.15.174:6835","nonce":1019990404}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[39],"metadata_pool":38,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":19}]} 2019-11-28T12:01:47.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.353+0000 7f67ca504700 1 -- 172.21.15.80:0/3681991920 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67a8018730 msgr2=0x7f67a801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:47.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.353+0000 7f67ca504700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67a8018730 0x7f67a801abc0 crc :-1 s=READY pgs=1256 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:47.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.353+0000 7f67ca504700 1 -- 172.21.15.80:0/3681991920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c413a780 msgr2=0x7f67c412d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:47.347 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.353+0000 7f67ca504700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c413a780 0x7f67c412d480 secure :-1 s=READY pgs=3042 cs=0 l=1 rx=0x7f67ac0103e0 tx=0x7f67ac010780).stop 2019-11-28T12:01:47.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.354+0000 7f67ca504700 1 -- 172.21.15.80:0/3681991920 shutdown_connections 2019-11-28T12:01:47.348 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.354+0000 7f67ca504700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f67a8018730 0x7f67a801abc0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:47.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.354+0000 7f67ca504700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67c412d9c0 0x7f67c412c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:47.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.354+0000 7f67ca504700 1 --2- 172.21.15.80:0/3681991920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67c413a780 0x7f67c412d480 unknown :-1 s=CLOSED pgs=3042 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:47.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.354+0000 7f67ca504700 1 -- 172.21.15.80:0/3681991920 shutdown_connections 2019-11-28T12:01:47.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.354+0000 7f67ca504700 1 -- 172.21.15.80:0/3681991920 wait complete. 2019-11-28T12:01:47.349 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:47.354+0000 7f67ca504700 1 -- 172.21.15.80:0/3681991920 >> 172.21.15.80:0/3681991920 conn(0x7f67c4127dc0 msgr2=0x7f67c4141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:47.661 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8303}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 38, u'failed': [], u'epoch': 194, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [39], u'info': {u'gid_8303': {u'export_targets': [], u'name': u'c', u'incarnation': 193, u'state_seq': 2, u'state': u'up:active', u'gid': 8303, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1019990404, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 1019990404, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/1019990404'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T12:01:41.241732+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T12:01:45.253838+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T12:01:47.661 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T12:01:47.661 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T12:01:47.792 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T12:01:47.792 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T12:01:47.792 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T12:01:47.792 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 8303, 2019-11-28T12:01:47.792 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T12:01:47.793 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T12:01:47.793 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 3.5445823679999999, 2019-11-28T12:01:47.793 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 194, 2019-11-28T12:01:47.793 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 234, 2019-11-28T12:01:47.793 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 234, 2019-11-28T12:01:47.793 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 4.129038371 2019-11-28T12:01:47.794 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T12:01:47.797 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8303, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.5445823679999999, "mdsmap_epoch": 194, "osdmap_epoch": 234, "osdmap_epoch_barrier": 234, "uptime": 4.129038371 } 2019-11-28T12:01:47.797 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T12:01:47.798 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T12:01:47.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T12:01:47.798 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T12:01:47.869 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T12:01:47.869 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T12:01:47.989 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T12:01:47.989 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T12:01:47.989 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T12:01:47.990 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T12:01:47.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T12:01:47.990 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T12:01:48.060 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T12:01:48.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.187+0000 7f04021ca700 1 Processor -- start 2019-11-28T12:01:48.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.187+0000 7f04021ca700 1 -- start start 2019-11-28T12:01:48.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f04021ca700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc06c490 0x7f03fc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:48.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f04021ca700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f03fc06ce60 0x7f03fc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:48.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f04021ca700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc06db00 con 0x7f03fc06c0a0 2019-11-28T12:01:48.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f04021ca700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03fc06fd60 con 0x7f03fc06ce60 2019-11-28T12:01:48.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f04021ca700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc070030 con 0x7f03fc06c490 2019-11-28T12:01:48.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f0400f68700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f03fc06ce60 0x7f03fc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:48.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f0400f68700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f03fc06ce60 0x7f03fc164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47960/0 (socket says 172.21.15.80:47960) 2019-11-28T12:01:48.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f03fbfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f03fc06c0a0 0x7f03fc072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47272/0 (socket says 172.21.15.80:47272) 2019-11-28T12:01:48.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f0400f68700 1 -- 172.21.15.80:0/1282875378 learned_addr learned my addr 172.21.15.80:0/1282875378 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:48.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f03f3fff700 1 --2- 172.21.15.80:0/1282875378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc06c490 0x7f03fc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:48.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f0400f68700 1 -- 172.21.15.80:0/1282875378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc06c490 msgr2=0x7f03fc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:48.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f0400f68700 1 --2- 172.21.15.80:0/1282875378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc06c490 0x7f03fc06c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:48.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f0400f68700 1 -- 172.21.15.80:0/1282875378 >> v1:172.21.15.80:6789/0 conn(0x7f03fc06c0a0 legacy=0x7f03fc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:48.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f0400f68700 1 -- 172.21.15.80:0/1282875378 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc0706c0 con 0x7f03fc06ce60 2019-11-28T12:01:48.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f03fb7fe700 1 -- 172.21.15.80:0/1282875378 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991939091 0 0) 0x7f03ec001100 con 0x7f03fc06c0a0 2019-11-28T12:01:48.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f03f3fff700 1 --2- 172.21.15.80:0/1282875378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc06c490 0x7f03fc06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T12:01:48.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.188+0000 7f0400f68700 1 --2- 172.21.15.80:0/1282875378 >> v2:172.21.15.80:3300/0 conn(0x7f03fc06ce60 0x7f03fc164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f03f400fab0 tx=0x7f03f400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.189+0000 7f0400f68700 1 --2- 172.21.15.80:0/1282875378 >> v2:172.21.15.80:3300/0 conn(0x7f03fc06ce60 0x7f03fc164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f03f400fab0 tx=0x7f03f400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.189+0000 7f0400f68700 1 --2- 172.21.15.80:0/1282875378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03fc06ce60 0x7f03fc164d70 secure :-1 s=READY pgs=3044 cs=0 l=1 rx=0x7f03f400fab0 tx=0x7f03f400fe50).ready entity=mon.0 client_cookie=bb6d6fc3add6681a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:48.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.189+0000 7f0400f68700 1 --2- 172.21.15.80:0/1282875378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03fc06ce60 0x7f03fc164d70 secure :-1 s=THROTTLE_DONE pgs=3044 cs=0 l=1 rx=0x7f03f400fab0 tx=0x7f03f400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.189+0000 7f03fb7fe700 1 -- 172.21.15.80:0/1282875378 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f4000f10 con 0x7f03fc06ce60 2019-11-28T12:01:48.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.189+0000 7f0400f68700 1 --2- 172.21.15.80:0/1282875378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03fc06ce60 0x7f03fc164d70 secure :-1 s=THROTTLE_DONE pgs=3044 cs=0 l=1 rx=0x7f03f400fab0 tx=0x7f03f400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.189+0000 7f0400f68700 1 --2- 172.21.15.80:0/1282875378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03fc06ce60 0x7f03fc164d70 secure :-1 s=THROTTLE_DONE pgs=3044 cs=0 l=1 rx=0x7f03f400fab0 tx=0x7f03f400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.189+0000 7f03fb7fe700 1 -- 172.21.15.80:0/1282875378 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f4001460 con 0x7f03fc06ce60 2019-11-28T12:01:48.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.189+0000 7f03fb7fe700 1 -- 172.21.15.80:0/1282875378 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f4001bb0 con 0x7f03fc06ce60 2019-11-28T12:01:48.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.189+0000 7f04021ca700 1 -- 172.21.15.80:0/1282875378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03fc06ce60 msgr2=0x7f03fc164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:48.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.189+0000 7f04021ca700 1 --2- 172.21.15.80:0/1282875378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03fc06ce60 0x7f03fc164d70 secure :-1 s=READY pgs=3044 cs=0 l=1 rx=0x7f03f400fab0 tx=0x7f03f400fe50).stop 2019-11-28T12:01:48.191 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.189+0000 7f04021ca700 1 -- 172.21.15.80:0/1282875378 shutdown_connections 2019-11-28T12:01:48.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.189+0000 7f04021ca700 1 --2- 172.21.15.80:0/1282875378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f03fc06ce60 0x7f03fc164d70 unknown :-1 s=CLOSED pgs=3044 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:48.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.189+0000 7f04021ca700 1 --2- 172.21.15.80:0/1282875378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc06c490 0x7f03fc06c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:48.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.189+0000 7f04021ca700 1 -- 172.21.15.80:0/1282875378 shutdown_connections 2019-11-28T12:01:48.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.189+0000 7f04021ca700 1 -- 172.21.15.80:0/1282875378 wait complete. 2019-11-28T12:01:48.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.189+0000 7f04021ca700 1 -- 172.21.15.80:0/1282875378 >> 172.21.15.80:0/1282875378 conn(0x7f03fc061cf0 msgr2=0x7f03fc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:48.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.192+0000 7f04021ca700 1 Processor -- start 2019-11-28T12:01:48.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.192+0000 7f04021ca700 1 -- start start 2019-11-28T12:01:48.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f04021ca700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc15fdf0 0x7f03fc12b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:48.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f04021ca700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f03fc12b8a0 0x7f03fc13e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:48.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f04021ca700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc139e00 con 0x7f03fc13e860 2019-11-28T12:01:48.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f04021ca700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03fc107df0 con 0x7f03fc12b8a0 2019-11-28T12:01:48.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f04021ca700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc107890 con 0x7f03fc15fdf0 2019-11-28T12:01:48.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f03fbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc15fdf0 0x7f03fc12b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:48.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f03f3fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f03fc12b8a0 0x7f03fc13e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:48.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f03fbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc15fdf0 0x7f03fc12b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:50222/0 (socket says 172.21.15.80:50222) 2019-11-28T12:01:48.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f03fbfff700 1 -- 172.21.15.80:0/626062440 learned_addr learned my addr 172.21.15.80:0/626062440 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:48.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f03fbfff700 1 -- 172.21.15.80:0/626062440 >> v2:172.21.15.174:3300/0 conn(0x7f03fc12b8a0 msgr2=0x7f03fc13e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:48.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f03fbfff700 1 --2- 172.21.15.80:0/626062440 >> v2:172.21.15.174:3300/0 conn(0x7f03fc12b8a0 0x7f03fc13e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:48.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f03fbfff700 1 -- 172.21.15.80:0/626062440 >> v1:172.21.15.174:6789/0 conn(0x7f03fc13e860 legacy=0x7f03fc12a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:48.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f03fbfff700 1 -- 172.21.15.80:0/626062440 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc10a8c0 con 0x7f03fc15fdf0 2019-11-28T12:01:48.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f03f3fff700 1 --2- 172.21.15.80:0/626062440 >> v2:172.21.15.174:3300/0 conn(0x7f03fc12b8a0 0x7f03fc13e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:48.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f03fbfff700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc15fdf0 0x7f03fc12b360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f03ec010430 tx=0x7f03ec0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f03fbfff700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc15fdf0 0x7f03fc12b360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f03ec010430 tx=0x7f03ec0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.193+0000 7f03fbfff700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc15fdf0 0x7f03fc12b360 secure :-1 s=READY pgs=438 cs=0 l=1 rx=0x7f03ec010430 tx=0x7f03ec0107d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:48.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.194+0000 7f03fbfff700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc15fdf0 0x7f03fc12b360 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f03ec010430 tx=0x7f03ec0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.194+0000 7f03fbfff700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc15fdf0 0x7f03fc12b360 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f03ec010430 tx=0x7f03ec0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.194+0000 7f03f97fa700 1 -- 172.21.15.80:0/626062440 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03ec000c90 con 0x7f03fc15fdf0 2019-11-28T12:01:48.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.194+0000 7f03fbfff700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc15fdf0 0x7f03fc12b360 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f03ec010430 tx=0x7f03ec0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.194+0000 7f03f97fa700 1 -- 172.21.15.80:0/626062440 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec004240 con 0x7f03fc15fdf0 2019-11-28T12:01:48.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.194+0000 7f04021ca700 1 -- 172.21.15.80:0/626062440 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03fc10a8c0 con 0x7f03fc15fdf0 2019-11-28T12:01:48.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.194+0000 7f03f97fa700 1 -- 172.21.15.80:0/626062440 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03ec004810 con 0x7f03fc15fdf0 2019-11-28T12:01:48.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.194+0000 7f04021ca700 1 -- 172.21.15.80:0/626062440 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03fc10a8c0 con 0x7f03fc15fdf0 2019-11-28T12:01:48.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.194+0000 7f03fbfff700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc15fdf0 0x7f03fc12b360 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f03ec010430 tx=0x7f03ec0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.194+0000 7f03f97fa700 1 -- 172.21.15.80:0/626062440 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f03ec004430 con 0x7f03fc15fdf0 2019-11-28T12:01:48.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.194+0000 7f03fbfff700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc15fdf0 0x7f03fc12b360 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f03ec010430 tx=0x7f03ec0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.194+0000 7f03f97fa700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f03d4018730 0x7f03d401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:48.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.194+0000 7f03f97fa700 1 -- 172.21.15.80:0/626062440 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f03ec031aa0 con 0x7f03fc15fdf0 2019-11-28T12:01:48.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.195+0000 7f03f3fff700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f03d4018730 0x7f03d401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:48.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.195+0000 7f03f3fff700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f03d4018730 0x7f03d401abc0 crc :-1 s=READY pgs=1259 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:48.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.202+0000 7f04021ca700 1 -- 172.21.15.80:0/626062440 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03fc109180 con 0x7f03fc15fdf0 2019-11-28T12:01:48.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.206+0000 7f03fbfff700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc15fdf0 0x7f03fc12b360 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f03ec010430 tx=0x7f03ec0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.206+0000 7f03f97fa700 1 -- 172.21.15.80:0/626062440 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f03ec000ef0 con 0x7f03fc15fdf0 2019-11-28T12:01:48.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.380+0000 7f04021ca700 1 -- 172.21.15.80:0/626062440 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03fc109500 con 0x7f03fc15fdf0 2019-11-28T12:01:48.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.381+0000 7f03fbfff700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc15fdf0 0x7f03fc12b360 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f03ec010430 tx=0x7f03ec0107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.381+0000 7f03f97fa700 1 -- 172.21.15.80:0/626062440 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v234) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f03ec004430 con 0x7f03fc15fdf0 2019-11-28T12:01:48.377 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:48.377 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":234,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T12:01:42.242911+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":39,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":38,"pool_name":"cephfs_metadata","create_time":"2019-11-28T12:01:39.532697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"233","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":39,"pool_name":"cephfs_data","create_time":"2019-11-28T12:01:40.218947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"234","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T12:01:48.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.385+0000 7f04021ca700 1 -- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f03d4018730 msgr2=0x7f03d401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:48.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.385+0000 7f04021ca700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f03d4018730 0x7f03d401abc0 crc :-1 s=READY pgs=1259 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:48.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.385+0000 7f04021ca700 1 -- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc15fdf0 msgr2=0x7f03fc12b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:48.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.385+0000 7f04021ca700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc15fdf0 0x7f03fc12b360 secure :-1 s=READY pgs=438 cs=0 l=1 rx=0x7f03ec010430 tx=0x7f03ec0107d0).stop 2019-11-28T12:01:48.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.385+0000 7f04021ca700 1 -- 172.21.15.80:0/626062440 shutdown_connections 2019-11-28T12:01:48.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.385+0000 7f04021ca700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f03d4018730 0x7f03d401abc0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:48.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.385+0000 7f04021ca700 1 --2- 172.21.15.80:0/626062440 >> v2:172.21.15.174:3300/0 conn(0x7f03fc12b8a0 0x7f03fc13e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:48.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.385+0000 7f04021ca700 1 --2- 172.21.15.80:0/626062440 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03fc15fdf0 0x7f03fc12b360 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:48.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.385+0000 7f04021ca700 1 -- 172.21.15.80:0/626062440 shutdown_connections 2019-11-28T12:01:48.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.385+0000 7f04021ca700 1 -- 172.21.15.80:0/626062440 wait complete. 2019-11-28T12:01:48.381 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.385+0000 7f04021ca700 1 -- 172.21.15.80:0/626062440 >> 172.21.15.80:0/626062440 conn(0x7f03fc127dc0 msgr2=0x7f03fc141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:48.390 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T12:01:39.532697+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 38, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'233', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T12:01:40.218947+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 39, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'234', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T12:01:48.390 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T12:01:48.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.520+0000 7f2222d70700 1 Processor -- start 2019-11-28T12:01:48.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.520+0000 7f2222d70700 1 -- start start 2019-11-28T12:01:48.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2222d70700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c15ed10 0x7f221c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:48.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2222d70700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f221c0734b0 0x7f221c0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:48.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2222d70700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221c06db60 con 0x7f221c073020 2019-11-28T12:01:48.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2222d70700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221c06f3d0 con 0x7f221c0734b0 2019-11-28T12:01:48.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2222d70700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221c06fe00 con 0x7f221c15ed10 2019-11-28T12:01:48.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2221b0e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f221c0734b0 0x7f221c0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:48.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2221b0e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f221c0734b0 0x7f221c0726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47970/0 (socket says 172.21.15.80:47970) 2019-11-28T12:01:48.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2221b0e700 1 -- 172.21.15.80:0/1971580062 learned_addr learned my addr 172.21.15.80:0/1971580062 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:48.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f222130d700 1 --2- 172.21.15.80:0/1971580062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c15ed10 0x7f221c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:48.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2221b0e700 1 -- 172.21.15.80:0/1971580062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c15ed10 msgr2=0x7f221c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:48.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1971580062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c15ed10 0x7f221c15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:48.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2221b0e700 1 -- 172.21.15.80:0/1971580062 >> v1:172.21.15.80:6789/0 conn(0x7f221c073020 legacy=0x7f221c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:48.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f221bfff700 1 -- 172.21.15.80:0/1971580062 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747126491 0 0) 0x7f220c001030 con 0x7f221c073020 2019-11-28T12:01:48.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2221b0e700 1 -- 172.21.15.80:0/1971580062 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c070760 con 0x7f221c0734b0 2019-11-28T12:01:48.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1971580062 >> v2:172.21.15.80:3300/0 conn(0x7f221c0734b0 0x7f221c0726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f221400fa30 tx=0x7f221400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1971580062 >> v2:172.21.15.80:3300/0 conn(0x7f221c0734b0 0x7f221c0726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f221400fa30 tx=0x7f221400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1971580062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f221c0734b0 0x7f221c0726a0 secure :-1 s=READY pgs=3046 cs=0 l=1 rx=0x7f221400fa30 tx=0x7f221400fdd0).ready entity=mon.0 client_cookie=458fe8e4bfc8528 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:48.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1971580062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f221c0734b0 0x7f221c0726a0 secure :-1 s=THROTTLE_DONE pgs=3046 cs=0 l=1 rx=0x7f221400fa30 tx=0x7f221400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f221bfff700 1 -- 172.21.15.80:0/1971580062 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2214000df0 con 0x7f221c0734b0 2019-11-28T12:01:48.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1971580062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f221c0734b0 0x7f221c0726a0 secure :-1 s=THROTTLE_DONE pgs=3046 cs=0 l=1 rx=0x7f221400fa30 tx=0x7f221400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.521+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1971580062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f221c0734b0 0x7f221c0726a0 secure :-1 s=THROTTLE_DONE pgs=3046 cs=0 l=1 rx=0x7f221400fa30 tx=0x7f221400fdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.522+0000 7f221bfff700 1 -- 172.21.15.80:0/1971580062 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2214001460 con 0x7f221c0734b0 2019-11-28T12:01:48.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.522+0000 7f221bfff700 1 -- 172.21.15.80:0/1971580062 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2214001b50 con 0x7f221c0734b0 2019-11-28T12:01:48.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.522+0000 7f2222d70700 1 -- 172.21.15.80:0/1971580062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f221c0734b0 msgr2=0x7f221c0726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:48.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.522+0000 7f2222d70700 1 --2- 172.21.15.80:0/1971580062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f221c0734b0 0x7f221c0726a0 secure :-1 s=READY pgs=3046 cs=0 l=1 rx=0x7f221400fa30 tx=0x7f221400fdd0).stop 2019-11-28T12:01:48.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.522+0000 7f2222d70700 1 -- 172.21.15.80:0/1971580062 shutdown_connections 2019-11-28T12:01:48.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.522+0000 7f2222d70700 1 --2- 172.21.15.80:0/1971580062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f221c0734b0 0x7f221c0726a0 unknown :-1 s=CLOSED pgs=3046 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:48.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.522+0000 7f2222d70700 1 --2- 172.21.15.80:0/1971580062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c15ed10 0x7f221c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:48.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.522+0000 7f2222d70700 1 -- 172.21.15.80:0/1971580062 shutdown_connections 2019-11-28T12:01:48.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.522+0000 7f2222d70700 1 -- 172.21.15.80:0/1971580062 wait complete. 2019-11-28T12:01:48.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.522+0000 7f2222d70700 1 -- 172.21.15.80:0/1971580062 >> 172.21.15.80:0/1971580062 conn(0x7f221c061d20 msgr2=0x7f221c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:48.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.525+0000 7f2222d70700 1 Processor -- start 2019-11-28T12:01:48.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.525+0000 7f2222d70700 1 -- start start 2019-11-28T12:01:48.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f2222d70700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c167d80 0x7f221c16a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:48.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f2222d70700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221c148e00 con 0x7f221c148320 2019-11-28T12:01:48.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f2222d70700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221c108b10 con 0x7f221c1079b0 2019-11-28T12:01:48.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f2222d70700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221c13aa20 con 0x7f221c167d80 2019-11-28T12:01:48.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f222130d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f221c148320 0x7f221c10ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47292/0 (socket says 172.21.15.80:47292) 2019-11-28T12:01:48.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f222130d700 1 -- 172.21.15.80:0/1533298226 learned_addr learned my addr 172.21.15.80:0/1533298226 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:48.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c167d80 0x7f221c16a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:48.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f2219ffb700 1 -- 172.21.15.80:0/1533298226 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841673762 0 0) 0x7f22040010b0 con 0x7f221c148320 2019-11-28T12:01:48.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f2219ffb700 1 -- 172.21.15.80:0/1533298226 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2200002e80 con 0x7f221c148320 2019-11-28T12:01:48.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f2219ffb700 1 -- 172.21.15.80:0/1533298226 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449774945 0 0) 0x7f220c001070 con 0x7f221c1079b0 2019-11-28T12:01:48.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f2219ffb700 1 -- 172.21.15.80:0/1533298226 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22000030b0 con 0x7f221c1079b0 2019-11-28T12:01:48.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f2219ffb700 1 -- 172.21.15.80:0/1533298226 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3693839059 0 0) 0x7f22040012b0 con 0x7f221c148320 2019-11-28T12:01:48.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f2219ffb700 1 -- 172.21.15.80:0/1533298226 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f22000033c0 con 0x7f221c148320 2019-11-28T12:01:48.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f2219ffb700 1 -- 172.21.15.80:0/1533298226 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f2204001880 con 0x7f221c148320 2019-11-28T12:01:48.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f2221b0e700 1 -- 172.21.15.80:0/1533298226 >> v1:172.21.15.174:6789/0 conn(0x7f221c1079b0 legacy=0x7f221c107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:48.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f2221b0e700 1 -- 172.21.15.80:0/1533298226 >> v1:172.21.15.80:6789/0 conn(0x7f221c148320 legacy=0x7f221c10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:48.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f2221b0e700 1 -- 172.21.15.80:0/1533298226 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c10c490 con 0x7f221c167d80 2019-11-28T12:01:48.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.526+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c167d80 0x7f221c16a180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2214010700 tx=0x7f2214010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.527+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c167d80 0x7f221c16a180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2214010700 tx=0x7f2214010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.527+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c167d80 0x7f221c16a180 secure :-1 s=READY pgs=439 cs=0 l=1 rx=0x7f2214010700 tx=0x7f2214010aa0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:48.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.527+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c167d80 0x7f221c16a180 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f2214010700 tx=0x7f2214010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.527+0000 7f2219ffb700 1 -- 172.21.15.80:0/1533298226 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2214001610 con 0x7f221c167d80 2019-11-28T12:01:48.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.527+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c167d80 0x7f221c16a180 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f2214010700 tx=0x7f2214010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.527+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c167d80 0x7f221c16a180 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f2214010700 tx=0x7f2214010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.527+0000 7f2219ffb700 1 -- 172.21.15.80:0/1533298226 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2214001230 con 0x7f221c167d80 2019-11-28T12:01:48.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.527+0000 7f2222d70700 1 -- 172.21.15.80:0/1533298226 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c10c810 con 0x7f221c167d80 2019-11-28T12:01:48.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.527+0000 7f2219ffb700 1 -- 172.21.15.80:0/1533298226 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2214001c90 con 0x7f221c167d80 2019-11-28T12:01:48.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.527+0000 7f2222d70700 1 -- 172.21.15.80:0/1533298226 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c10c490 con 0x7f221c167d80 2019-11-28T12:01:48.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.527+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c167d80 0x7f221c16a180 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f2214010700 tx=0x7f2214010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.527+0000 7f2219ffb700 1 -- 172.21.15.80:0/1533298226 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2214001420 con 0x7f221c167d80 2019-11-28T12:01:48.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.527+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c167d80 0x7f221c16a180 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f2214010700 tx=0x7f2214010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.527+0000 7f2219ffb700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2200018780 0x7f220001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:48.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.528+0000 7f2219ffb700 1 -- 172.21.15.80:0/1533298226 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2214031e10 con 0x7f221c167d80 2019-11-28T12:01:48.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.528+0000 7f222130d700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2200018780 0x7f220001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:48.548 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.528+0000 7f222130d700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2200018780 0x7f220001abf0 crc :-1 s=READY pgs=1260 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:48.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.535+0000 7f2222d70700 1 -- 172.21.15.80:0/1533298226 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221c10c810 con 0x7f221c167d80 2019-11-28T12:01:48.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.539+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c167d80 0x7f221c16a180 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f2214010700 tx=0x7f2214010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.549 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.539+0000 7f2219ffb700 1 -- 172.21.15.80:0/1533298226 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2214007990 con 0x7f221c167d80 2019-11-28T12:01:48.701 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.707+0000 7f2222d70700 1 -- 172.21.15.80:0/1533298226 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f221c10c490 con 0x7f221c167d80 2019-11-28T12:01:48.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.708+0000 7f2221b0e700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c167d80 0x7f221c16a180 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f2214010700 tx=0x7f2214010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.708+0000 7f2219ffb700 1 -- 172.21.15.80:0/1533298226 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v234) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2214001400 con 0x7f221c167d80 2019-11-28T12:01:48.703 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:01:48.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.710+0000 7f2222d70700 1 -- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2200018780 msgr2=0x7f220001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:48.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.710+0000 7f2222d70700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2200018780 0x7f220001abf0 crc :-1 s=READY pgs=1260 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:48.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.710+0000 7f2222d70700 1 -- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c167d80 msgr2=0x7f221c16a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:48.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.710+0000 7f2222d70700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c167d80 0x7f221c16a180 secure :-1 s=READY pgs=439 cs=0 l=1 rx=0x7f2214010700 tx=0x7f2214010aa0).stop 2019-11-28T12:01:48.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.710+0000 7f2222d70700 1 -- 172.21.15.80:0/1533298226 shutdown_connections 2019-11-28T12:01:48.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.710+0000 7f2222d70700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f221c167d80 0x7f221c16a180 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:48.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.710+0000 7f2222d70700 1 --2- 172.21.15.80:0/1533298226 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2200018780 0x7f220001abf0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:48.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.711+0000 7f2222d70700 1 -- 172.21.15.80:0/1533298226 shutdown_connections 2019-11-28T12:01:48.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.711+0000 7f2222d70700 1 -- 172.21.15.80:0/1533298226 wait complete. 2019-11-28T12:01:48.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.711+0000 7f2222d70700 1 -- 172.21.15.80:0/1533298226 >> 172.21.15.80:0/1533298226 conn(0x7f221c15e2d0 msgr2=0x7f221c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:48.714 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T12:01:48.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.844+0000 7f8ed152f700 1 Processor -- start 2019-11-28T12:01:48.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.844+0000 7f8ed152f700 1 -- start start 2019-11-28T12:01:48.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.845+0000 7f8ed152f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8ecc15f100 0x7f8ecc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:48.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.845+0000 7f8ed152f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06c2f0 0x7f8ecc06c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:48.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.845+0000 7f8ed152f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ecc06db60 con 0x7f8ecc15ed10 2019-11-28T12:01:48.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.845+0000 7f8ed152f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ecc06fe00 con 0x7f8ecc15f100 2019-11-28T12:01:48.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.845+0000 7f8ed152f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0700d0 con 0x7f8ecc06c2f0 2019-11-28T12:01:48.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.845+0000 7f8ecaffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8ecc15f100 0x7f8ecc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:48.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.845+0000 7f8ecbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06c2f0 0x7f8ecc06c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:48.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.845+0000 7f8ecbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06c2f0 0x7f8ecc06c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:50246/0 (socket says 172.21.15.80:50246) 2019-11-28T12:01:48.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.845+0000 7f8ecaffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8ecc15f100 0x7f8ecc06bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:34642/0 (socket says 172.21.15.80:34642) 2019-11-28T12:01:48.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.845+0000 7f8ecbfff700 1 -- 172.21.15.80:0/907678765 learned_addr learned my addr 172.21.15.80:0/907678765 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:48.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.845+0000 7f8ecbfff700 1 -- 172.21.15.80:0/907678765 >> v2:172.21.15.174:3300/0 conn(0x7f8ecc15f100 msgr2=0x7f8ecc06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:48.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.845+0000 7f8ecbfff700 1 --2- 172.21.15.80:0/907678765 >> v2:172.21.15.174:3300/0 conn(0x7f8ecc15f100 0x7f8ecc06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:48.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.845+0000 7f8ecbfff700 1 -- 172.21.15.80:0/907678765 >> v1:172.21.15.174:6789/0 conn(0x7f8ecc15ed10 legacy=0x7f8ecc073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:48.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.845+0000 7f8ecbfff700 1 -- 172.21.15.80:0/907678765 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc070760 con 0x7f8ecc06c2f0 2019-11-28T12:01:48.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.845+0000 7f8ecaffd700 1 --2- 172.21.15.80:0/907678765 >> v2:172.21.15.174:3300/0 conn(0x7f8ecc15f100 0x7f8ecc06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:48.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.846+0000 7f8ecbfff700 1 --2- 172.21.15.80:0/907678765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06c2f0 0x7f8ecc06c740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8ec400fae0 tx=0x7f8ec400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.846+0000 7f8ecbfff700 1 --2- 172.21.15.80:0/907678765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06c2f0 0x7f8ecc06c740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8ec400fae0 tx=0x7f8ec400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.846+0000 7f8ecbfff700 1 --2- 172.21.15.80:0/907678765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06c2f0 0x7f8ecc06c740 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7f8ec400fae0 tx=0x7f8ec400fe80).ready entity=mon.2 client_cookie=7c938309feb3c6eb server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:48.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.846+0000 7f8ecbfff700 1 --2- 172.21.15.80:0/907678765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06c2f0 0x7f8ecc06c740 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f8ec400fae0 tx=0x7f8ec400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.846+0000 7f8eca7fc700 1 -- 172.21.15.80:0/907678765 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ec4000df0 con 0x7f8ecc06c2f0 2019-11-28T12:01:48.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.846+0000 7f8ecbfff700 1 --2- 172.21.15.80:0/907678765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06c2f0 0x7f8ecc06c740 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f8ec400fae0 tx=0x7f8ec400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.846+0000 7f8ecbfff700 1 --2- 172.21.15.80:0/907678765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06c2f0 0x7f8ecc06c740 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f8ec400fae0 tx=0x7f8ec400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.846+0000 7f8eca7fc700 1 -- 172.21.15.80:0/907678765 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec40011f0 con 0x7f8ecc06c2f0 2019-11-28T12:01:48.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.846+0000 7f8eca7fc700 1 -- 172.21.15.80:0/907678765 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ec4001880 con 0x7f8ecc06c2f0 2019-11-28T12:01:48.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.846+0000 7f8ed152f700 1 -- 172.21.15.80:0/907678765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06c2f0 msgr2=0x7f8ecc06c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:48.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.846+0000 7f8ed152f700 1 --2- 172.21.15.80:0/907678765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06c2f0 0x7f8ecc06c740 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7f8ec400fae0 tx=0x7f8ec400fe80).stop 2019-11-28T12:01:48.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.847+0000 7f8ed152f700 1 -- 172.21.15.80:0/907678765 shutdown_connections 2019-11-28T12:01:48.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.847+0000 7f8ed152f700 1 --2- 172.21.15.80:0/907678765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc06c2f0 0x7f8ecc06c740 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:48.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.847+0000 7f8ed152f700 1 --2- 172.21.15.80:0/907678765 >> v2:172.21.15.174:3300/0 conn(0x7f8ecc15f100 0x7f8ecc06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:48.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.847+0000 7f8ed152f700 1 -- 172.21.15.80:0/907678765 shutdown_connections 2019-11-28T12:01:48.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.847+0000 7f8ed152f700 1 -- 172.21.15.80:0/907678765 wait complete. 2019-11-28T12:01:48.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.847+0000 7f8ed152f700 1 -- 172.21.15.80:0/907678765 >> 172.21.15.80:0/907678765 conn(0x7f8ecc061d20 msgr2=0x7f8ecc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:48.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.849+0000 7f8ed152f700 1 Processor -- start 2019-11-28T12:01:48.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.849+0000 7f8ed152f700 1 -- start start 2019-11-28T12:01:48.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.850+0000 7f8ed152f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc148320 0x7f8ecc10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:48.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.850+0000 7f8ed152f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ecc10f290 0x7f8ecc10dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:48.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.850+0000 7f8ed152f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ecc148e00 con 0x7f8ecc10e110 2019-11-28T12:01:48.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.850+0000 7f8ed152f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ecc139ff0 con 0x7f8ecc10f290 2019-11-28T12:01:48.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.850+0000 7f8ed152f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc13aa20 con 0x7f8ecc148320 2019-11-28T12:01:48.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.850+0000 7f8ecaffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ecc10f290 0x7f8ecc10dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:48.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.850+0000 7f8ecaffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ecc10f290 0x7f8ecc10dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47992/0 (socket says 172.21.15.80:47992) 2019-11-28T12:01:48.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.850+0000 7f8ecaffd700 1 -- 172.21.15.80:0/356920824 learned_addr learned my addr 172.21.15.80:0/356920824 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:01:48.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.850+0000 7f8ecb7fe700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc148320 0x7f8ecc10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:48.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ecaffd700 1 -- 172.21.15.80:0/356920824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc148320 msgr2=0x7f8ecc10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:48.855 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ecaffd700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc148320 0x7f8ecc10ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:48.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ecaffd700 1 -- 172.21.15.80:0/356920824 >> v1:172.21.15.174:6789/0 conn(0x7f8ecc10e110 legacy=0x7f8ecc1079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:48.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ec3fff700 1 -- 172.21.15.80:0/356920824 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622446088 0 0) 0x7f8ec40084c0 con 0x7f8ecc10e110 2019-11-28T12:01:48.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ecaffd700 1 -- 172.21.15.80:0/356920824 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc10c490 con 0x7f8ecc10f290 2019-11-28T12:01:48.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ecaffd700 1 --2- 172.21.15.80:0/356920824 >> v2:172.21.15.80:3300/0 conn(0x7f8ecc10f290 0x7f8ecc10dbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8eb4010390 tx=0x7f8eb4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ecaffd700 1 --2- 172.21.15.80:0/356920824 >> v2:172.21.15.80:3300/0 conn(0x7f8ecc10f290 0x7f8ecc10dbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8eb4010390 tx=0x7f8eb4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ecaffd700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc10f290 0x7f8ecc10dbd0 secure :-1 s=READY pgs=3048 cs=0 l=1 rx=0x7f8eb4010390 tx=0x7f8eb4010730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:48.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ecaffd700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc10f290 0x7f8ecc10dbd0 secure :-1 s=THROTTLE_DONE pgs=3048 cs=0 l=1 rx=0x7f8eb4010390 tx=0x7f8eb4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ec3fff700 1 -- 172.21.15.80:0/356920824 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eb400a8c0 con 0x7f8ecc10f290 2019-11-28T12:01:48.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ecaffd700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc10f290 0x7f8ecc10dbd0 secure :-1 s=THROTTLE_DONE pgs=3048 cs=0 l=1 rx=0x7f8eb4010390 tx=0x7f8eb4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ec3fff700 1 -- 172.21.15.80:0/356920824 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb400a8c0 con 0x7f8ecc10f290 2019-11-28T12:01:48.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ecaffd700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc10f290 0x7f8ecc10dbd0 secure :-1 s=THROTTLE_DONE pgs=3048 cs=0 l=1 rx=0x7f8eb4010390 tx=0x7f8eb4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ed152f700 1 -- 172.21.15.80:0/356920824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ecc10c810 con 0x7f8ecc10f290 2019-11-28T12:01:48.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ec3fff700 1 -- 172.21.15.80:0/356920824 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eb400edb0 con 0x7f8ecc10f290 2019-11-28T12:01:48.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ed152f700 1 -- 172.21.15.80:0/356920824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc10c490 con 0x7f8ecc10f290 2019-11-28T12:01:48.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.851+0000 7f8ecaffd700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc10f290 0x7f8ecc10dbd0 secure :-1 s=THROTTLE_DONE pgs=3048 cs=0 l=1 rx=0x7f8eb4010390 tx=0x7f8eb4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.852+0000 7f8ec3fff700 1 -- 172.21.15.80:0/356920824 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8eb4009580 con 0x7f8ecc10f290 2019-11-28T12:01:48.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.852+0000 7f8ecaffd700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc10f290 0x7f8ecc10dbd0 secure :-1 s=THROTTLE_DONE pgs=3048 cs=0 l=1 rx=0x7f8eb4010390 tx=0x7f8eb4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.852+0000 7f8ec3fff700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8eb0018730 0x7f8eb001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:48.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.852+0000 7f8ec3fff700 1 -- 172.21.15.80:0/356920824 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8eb4031a40 con 0x7f8ecc10f290 2019-11-28T12:01:48.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.852+0000 7f8ecb7fe700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8eb0018730 0x7f8eb001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:48.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.852+0000 7f8ecb7fe700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8eb0018730 0x7f8eb001abc0 crc :-1 s=READY pgs=1261 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:48.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.859+0000 7f8ed152f700 1 -- 172.21.15.80:0/356920824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ecc10c810 con 0x7f8ecc10f290 2019-11-28T12:01:48.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.863+0000 7f8ecaffd700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc10f290 0x7f8ecc10dbd0 secure :-1 s=THROTTLE_DONE pgs=3048 cs=0 l=1 rx=0x7f8eb4010390 tx=0x7f8eb4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:48.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:48.863+0000 7f8ec3fff700 1 -- 172.21.15.80:0/356920824 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8eb400a590 con 0x7f8ecc10f290 2019-11-28T12:01:49.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.032+0000 7f8ed152f700 1 -- 172.21.15.80:0/356920824 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f8ecc10c490 con 0x7f8ecc10f290 2019-11-28T12:01:49.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.032+0000 7f8ecaffd700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc10f290 0x7f8ecc10dbd0 secure :-1 s=THROTTLE_DONE pgs=3048 cs=0 l=1 rx=0x7f8eb4010390 tx=0x7f8eb4010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.032+0000 7f8ec3fff700 1 -- 172.21.15.80:0/356920824 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v234) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8eb4009580 con 0x7f8ecc10f290 2019-11-28T12:01:49.027 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:01:49.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.034+0000 7f8ed152f700 1 -- 172.21.15.80:0/356920824 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8eb0018730 msgr2=0x7f8eb001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.034+0000 7f8ed152f700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8eb0018730 0x7f8eb001abc0 crc :-1 s=READY pgs=1261 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:49.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.034+0000 7f8ed152f700 1 -- 172.21.15.80:0/356920824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc10f290 msgr2=0x7f8ecc10dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.034+0000 7f8ed152f700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc10f290 0x7f8ecc10dbd0 secure :-1 s=READY pgs=3048 cs=0 l=1 rx=0x7f8eb4010390 tx=0x7f8eb4010730).stop 2019-11-28T12:01:49.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.035+0000 7f8ed152f700 1 -- 172.21.15.80:0/356920824 shutdown_connections 2019-11-28T12:01:49.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.035+0000 7f8ed152f700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8eb0018730 0x7f8eb001abc0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:49.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.035+0000 7f8ed152f700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ecc10f290 0x7f8ecc10dbd0 unknown :-1 s=CLOSED pgs=3048 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:49.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.035+0000 7f8ed152f700 1 --2- 172.21.15.80:0/356920824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ecc148320 0x7f8ecc10ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:49.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.035+0000 7f8ed152f700 1 -- 172.21.15.80:0/356920824 shutdown_connections 2019-11-28T12:01:49.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.035+0000 7f8ed152f700 1 -- 172.21.15.80:0/356920824 wait complete. 2019-11-28T12:01:49.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.035+0000 7f8ed152f700 1 -- 172.21.15.80:0/356920824 >> 172.21.15.80:0/356920824 conn(0x7f8ecc15e2d0 msgr2=0x7f8ecc147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:49.039 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T12:01:49.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.171+0000 7f65ab60a700 1 Processor -- start 2019-11-28T12:01:49.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.171+0000 7f65ab60a700 1 -- start start 2019-11-28T12:01:49.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.172+0000 7f65ab60a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f65a415f100 0x7f65a406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:49.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.172+0000 7f65ab60a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a406db60 con 0x7f65a406c2f0 2019-11-28T12:01:49.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.172+0000 7f65ab60a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a406e060 con 0x7f65a415ed10 2019-11-28T12:01:49.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.172+0000 7f65ab60a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a406fe00 con 0x7f65a415f100 2019-11-28T12:01:49.227 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.172+0000 7f65a93a6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f65a415f100 0x7f65a406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:49.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.172+0000 7f65aa3a8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f65a406c2f0 0x7f65a406c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47320/0 (socket says 172.21.15.80:47320) 2019-11-28T12:01:49.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.172+0000 7f65aa3a8700 1 -- 172.21.15.80:0/2823372692 learned_addr learned my addr 172.21.15.80:0/2823372692 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:49.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.172+0000 7f65a93a6700 1 -- 172.21.15.80:0/2823372692 >> v1:172.21.15.174:6789/0 conn(0x7f65a415ed10 legacy=0x7f65a4073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.172+0000 7f65a93a6700 1 -- 172.21.15.80:0/2823372692 >> v1:172.21.15.80:6789/0 conn(0x7f65a406c2f0 legacy=0x7f65a406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.172+0000 7f65a8ba5700 1 -- 172.21.15.80:0/2823372692 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807724130 0 0) 0x7f6594001150 con 0x7f65a406c2f0 2019-11-28T12:01:49.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.172+0000 7f65a93a6700 1 -- 172.21.15.80:0/2823372692 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a4070760 con 0x7f65a415f100 2019-11-28T12:01:49.231 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.173+0000 7f65a93a6700 1 --2- 172.21.15.80:0/2823372692 >> v2:172.21.15.80:3300/0 conn(0x7f65a415f100 0x7f65a406bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f659800af50 tx=0x7f659800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.173+0000 7f65a93a6700 1 --2- 172.21.15.80:0/2823372692 >> v2:172.21.15.80:3300/0 conn(0x7f65a415f100 0x7f65a406bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f659800af50 tx=0x7f659800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.232 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.173+0000 7f65a93a6700 1 --2- 172.21.15.80:0/2823372692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65a415f100 0x7f65a406bdb0 secure :-1 s=READY pgs=3050 cs=0 l=1 rx=0x7f659800af50 tx=0x7f659800b760).ready entity=mon.0 client_cookie=34a056e0c2cef952 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:49.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.173+0000 7f65a93a6700 1 --2- 172.21.15.80:0/2823372692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65a415f100 0x7f65a406bdb0 secure :-1 s=THROTTLE_DONE pgs=3050 cs=0 l=1 rx=0x7f659800af50 tx=0x7f659800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.173+0000 7f65a8ba5700 1 -- 172.21.15.80:0/2823372692 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6598000960 con 0x7f65a415f100 2019-11-28T12:01:49.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.173+0000 7f65a93a6700 1 --2- 172.21.15.80:0/2823372692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65a415f100 0x7f65a406bdb0 secure :-1 s=THROTTLE_DONE pgs=3050 cs=0 l=1 rx=0x7f659800af50 tx=0x7f659800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.173+0000 7f65a93a6700 1 --2- 172.21.15.80:0/2823372692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65a415f100 0x7f65a406bdb0 secure :-1 s=THROTTLE_DONE pgs=3050 cs=0 l=1 rx=0x7f659800af50 tx=0x7f659800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.173+0000 7f65a8ba5700 1 -- 172.21.15.80:0/2823372692 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6598009860 con 0x7f65a415f100 2019-11-28T12:01:49.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.173+0000 7f65a8ba5700 1 -- 172.21.15.80:0/2823372692 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6598000960 con 0x7f65a415f100 2019-11-28T12:01:49.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.173+0000 7f65ab60a700 1 -- 172.21.15.80:0/2823372692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65a415f100 msgr2=0x7f65a406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.173+0000 7f65ab60a700 1 --2- 172.21.15.80:0/2823372692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65a415f100 0x7f65a406bdb0 secure :-1 s=READY pgs=3050 cs=0 l=1 rx=0x7f659800af50 tx=0x7f659800b760).stop 2019-11-28T12:01:49.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.173+0000 7f65ab60a700 1 -- 172.21.15.80:0/2823372692 shutdown_connections 2019-11-28T12:01:49.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.173+0000 7f65ab60a700 1 --2- 172.21.15.80:0/2823372692 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65a415f100 0x7f65a406bdb0 unknown :-1 s=CLOSED pgs=3050 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:49.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.174+0000 7f65ab60a700 1 -- 172.21.15.80:0/2823372692 shutdown_connections 2019-11-28T12:01:49.238 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.174+0000 7f65ab60a700 1 -- 172.21.15.80:0/2823372692 wait complete. 2019-11-28T12:01:49.239 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.174+0000 7f65ab60a700 1 -- 172.21.15.80:0/2823372692 >> 172.21.15.80:0/2823372692 conn(0x7f65a4061d20 msgr2=0x7f65a40641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:49.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.176+0000 7f65ab60a700 1 Processor -- start 2019-11-28T12:01:49.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.176+0000 7f65ab60a700 1 -- start start 2019-11-28T12:01:49.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65ab60a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f65a410e970 0x7f65a41087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:49.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65ab60a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a4107e30 0x7f65a4167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:49.242 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65ab60a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a410c250 con 0x7f65a4108cf0 2019-11-28T12:01:49.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65ab60a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a410e430 con 0x7f65a410e970 2019-11-28T12:01:49.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65ab60a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a4105860 con 0x7f65a4107e30 2019-11-28T12:01:49.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a93a6700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f65a4108cf0 0x7f65a4107630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47326/0 (socket says 172.21.15.80:47326) 2019-11-28T12:01:49.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a93a6700 1 -- 172.21.15.80:0/2371053174 learned_addr learned my addr 172.21.15.80:0/2371053174 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:49.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65aa3a8700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a4107e30 0x7f65a4167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:49.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a9ba7700 1 --2- 172.21.15.80:0/2371053174 >> v2:172.21.15.174:3300/0 conn(0x7f65a410e970 0x7f65a41087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:49.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871017822 0 0) 0x7f659800b3d0 con 0x7f65a4108cf0 2019-11-28T12:01:49.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6584002e80 con 0x7f65a4108cf0 2019-11-28T12:01:49.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1468430127 0 0) 0x7f6598000940 con 0x7f65a4108cf0 2019-11-28T12:01:49.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f65840032e0 con 0x7f65a4108cf0 2019-11-28T12:01:49.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f6598009580 con 0x7f65a4108cf0 2019-11-28T12:01:49.247 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a4107e30 msgr2=0x7f65a4167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a27fc700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a4107e30 0x7f65a4167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:49.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 >> v2:172.21.15.174:3300/0 conn(0x7f65a410e970 msgr2=0x7f65a41087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a27fc700 1 --2- 172.21.15.80:0/2371053174 >> v2:172.21.15.174:3300/0 conn(0x7f65a410e970 0x7f65a41087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:49.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 >> v1:172.21.15.80:6789/0 conn(0x7f65a4108cf0 legacy=0x7f65a4107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a27fc700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65840033f0 0x7f6584003840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:49.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a27fc700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6584003d80 0x7f6584004220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:49.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a27fc700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6584004950 0x7f6584004e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:49.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658400bc50 con 0x7f6584004950 2019-11-28T12:01:49.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658400be80 con 0x7f6584003d80 2019-11-28T12:01:49.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.177+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658400c0b0 con 0x7f65840033f0 2019-11-28T12:01:49.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65aa3a8700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65a4107e30 0x7f65a4167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:49.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65a9ba7700 1 --2- 172.21.15.80:0/2371053174 >> v2:172.21.15.174:3300/0 conn(0x7f65a410e970 0x7f65a41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:49.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65aa3a8700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6584004950 0x7f6584004e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:49.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65a93a6700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6584003d80 0x7f6584004220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:49.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65a9ba7700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65840033f0 0x7f6584003840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:49.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65aa3a8700 1 -- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65840033f0 msgr2=0x7f6584003840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65aa3a8700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65840033f0 0x7f6584003840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:49.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65aa3a8700 1 -- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6584003d80 msgr2=0x7f6584004220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65aa3a8700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6584003d80 0x7f6584004220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:49.250 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65aa3a8700 1 -- 172.21.15.80:0/2371053174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658400c360 con 0x7f6584004950 2019-11-28T12:01:49.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65ab60a700 1 -- 172.21.15.80:0/2371053174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a4106270 con 0x7f6584004950 2019-11-28T12:01:49.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65a9ba7700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f65840033f0 0x7f6584003840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T12:01:49.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65aa3a8700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6584004950 0x7f6584004e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f659400bee0 tx=0x7f659400be30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65aa3a8700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6584004950 0x7f6584004e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f659400bee0 tx=0x7f659400be30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65aa3a8700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6584004950 0x7f6584004e10 secure :-1 s=READY pgs=3052 cs=0 l=1 rx=0x7f659400bee0 tx=0x7f659400be30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:49.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65ab60a700 1 -- 172.21.15.80:0/2371053174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a4105ef0 con 0x7f6584004950 2019-11-28T12:01:49.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65aa3a8700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6584004950 0x7f6584004e10 secure :-1 s=THROTTLE_DONE pgs=3052 cs=0 l=1 rx=0x7f659400bee0 tx=0x7f659400be30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f659400ad00 con 0x7f6584004950 2019-11-28T12:01:49.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65aa3a8700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6584004950 0x7f6584004e10 secure :-1 s=THROTTLE_DONE pgs=3052 cs=0 l=1 rx=0x7f659400bee0 tx=0x7f659400be30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6594009770 con 0x7f6584004950 2019-11-28T12:01:49.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65aa3a8700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6584004950 0x7f6584004e10 secure :-1 s=THROTTLE_DONE pgs=3052 cs=0 l=1 rx=0x7f659400bee0 tx=0x7f659400be30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f659400ad00 con 0x7f6584004950 2019-11-28T12:01:49.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.178+0000 7f65aa3a8700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6584004950 0x7f6584004e10 secure :-1 s=THROTTLE_DONE pgs=3052 cs=0 l=1 rx=0x7f659400bee0 tx=0x7f659400be30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.179+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6594000940 con 0x7f6584004950 2019-11-28T12:01:49.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.179+0000 7f65aa3a8700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6584004950 0x7f6584004e10 secure :-1 s=THROTTLE_DONE pgs=3052 cs=0 l=1 rx=0x7f659400bee0 tx=0x7f659400be30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.179+0000 7f65a27fc700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6584020ad0 0x7f6584022f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:49.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.179+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6594031bf0 con 0x7f6584004950 2019-11-28T12:01:49.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.179+0000 7f65a9ba7700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6584020ad0 0x7f6584022f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:49.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.179+0000 7f65a9ba7700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6584020ad0 0x7f6584022f00 crc :-1 s=READY pgs=1264 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:49.254 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.186+0000 7f65ab60a700 1 -- 172.21.15.80:0/2371053174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6580002e60 con 0x7f6584004950 2019-11-28T12:01:49.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.190+0000 7f65aa3a8700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6584004950 0x7f6584004e10 secure :-1 s=THROTTLE_DONE pgs=3052 cs=0 l=1 rx=0x7f659400bee0 tx=0x7f659400be30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.190+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6594017330 con 0x7f6584004950 2019-11-28T12:01:49.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.359+0000 7f65ab60a700 1 -- 172.21.15.80:0/2371053174 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f6580001d30 con 0x7f6584004950 2019-11-28T12:01:49.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.359+0000 7f65aa3a8700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6584004950 0x7f6584004e10 secure :-1 s=THROTTLE_DONE pgs=3052 cs=0 l=1 rx=0x7f659400bee0 tx=0x7f659400be30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.353 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.359+0000 7f65a27fc700 1 -- 172.21.15.80:0/2371053174 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v234) v1 ==== 100+0+10 (secure 0 0 0) 0x7f6594000940 con 0x7f6584004950 2019-11-28T12:01:49.354 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:01:49.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.362+0000 7f65ab60a700 1 -- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6584020ad0 msgr2=0x7f6584022f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.362+0000 7f65ab60a700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6584020ad0 0x7f6584022f00 crc :-1 s=READY pgs=1264 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:49.357 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.362+0000 7f65ab60a700 1 -- 172.21.15.80:0/2371053174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6584004950 msgr2=0x7f6584004e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.362+0000 7f65ab60a700 1 --2- 172.21.15.80:0/2371053174 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6584004950 0x7f6584004e10 secure :-1 s=READY pgs=3052 cs=0 l=1 rx=0x7f659400bee0 tx=0x7f659400be30).stop 2019-11-28T12:01:49.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.362+0000 7f65aa3a8700 1 -- 172.21.15.80:0/2371053174 reap_dead start 2019-11-28T12:01:49.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.362+0000 7f65aa3a8700 1 -- 172.21.15.80:0/2371053174 reap_dead start 2019-11-28T12:01:49.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.362+0000 7f65ab60a700 1 -- 172.21.15.80:0/2371053174 shutdown_connections 2019-11-28T12:01:49.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.362+0000 7f65ab60a700 1 -- 172.21.15.80:0/2371053174 shutdown_connections 2019-11-28T12:01:49.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.362+0000 7f65ab60a700 1 -- 172.21.15.80:0/2371053174 wait complete. 2019-11-28T12:01:49.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.362+0000 7f65ab60a700 1 -- 172.21.15.80:0/2371053174 >> 172.21.15.80:0/2371053174 conn(0x7f65a415e2d0 msgr2=0x7f65a4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:49.365 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T12:01:49.366 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:01:49.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.490+0000 7f0b6811c700 1 Processor -- start 2019-11-28T12:01:49.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.490+0000 7f0b6811c700 1 -- start start 2019-11-28T12:01:49.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.491+0000 7f0b6811c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0b6006c0a0 0x7f0b60072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.491+0000 7f0b6811c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b600734e0 0x7f0b60071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:01:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.491+0000 7f0b6811c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6006db00 con 0x7f0b60072360 2019-11-28T12:01:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.491+0000 7f0b6811c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6006fd60 con 0x7f0b6006c0a0 2019-11-28T12:01:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.492+0000 7f0b6811c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b60070030 con 0x7f0b600734e0 2019-11-28T12:01:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.492+0000 7f0b66eba700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0b60072360 0x7f0b6006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47340/0 (socket says 172.21.15.80:47340) 2019-11-28T12:01:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.492+0000 7f0b66eba700 1 -- 172.21.15.80:0/477813176 learned_addr learned my addr 172.21.15.80:0/477813176 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.492+0000 7f0b666b9700 1 --2- 172.21.15.80:0/477813176 >> v2:172.21.15.174:3300/0 conn(0x7f0b6006c0a0 0x7f0b60072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.492+0000 7f0b65eb8700 1 --2- 172.21.15.80:0/477813176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b600734e0 0x7f0b60071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.492+0000 7f0b656b7700 1 -- 172.21.15.80:0/477813176 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342731290 0 0) 0x7f0b58001150 con 0x7f0b60072360 2019-11-28T12:01:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.492+0000 7f0b656b7700 1 -- 172.21.15.80:0/477813176 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b4c002e80 con 0x7f0b60072360 2019-11-28T12:01:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.492+0000 7f0b656b7700 1 -- 172.21.15.80:0/477813176 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2364291954 0 0) 0x7f0b58001130 con 0x7f0b60072360 2019-11-28T12:01:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.492+0000 7f0b666b9700 1 -- 172.21.15.80:0/477813176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b600734e0 msgr2=0x7f0b60071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:01:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.492+0000 7f0b666b9700 1 --2- 172.21.15.80:0/477813176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b600734e0 0x7f0b60071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.492+0000 7f0b666b9700 1 -- 172.21.15.80:0/477813176 >> v1:172.21.15.80:6789/0 conn(0x7f0b60072360 legacy=0x7f0b6006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.492+0000 7f0b666b9700 1 -- 172.21.15.80:0/477813176 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b600706c0 con 0x7f0b6006c0a0 2019-11-28T12:01:49.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.492+0000 7f0b65eb8700 1 --2- 172.21.15.80:0/477813176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b600734e0 0x7f0b60071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:49.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.492+0000 7f0b666b9700 1 --2- 172.21.15.80:0/477813176 >> v2:172.21.15.174:3300/0 conn(0x7f0b6006c0a0 0x7f0b60072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0b5000af50 tx=0x7f0b5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.492+0000 7f0b666b9700 1 --2- 172.21.15.80:0/477813176 >> v2:172.21.15.174:3300/0 conn(0x7f0b6006c0a0 0x7f0b60072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0b5000af50 tx=0x7f0b5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.492+0000 7f0b666b9700 1 --2- 172.21.15.80:0/477813176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6006c0a0 0x7f0b60072fa0 secure :-1 s=READY pgs=1847 cs=0 l=1 rx=0x7f0b5000af50 tx=0x7f0b5000b760).ready entity=mon.1 client_cookie=5154e4adf3907e52 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:49.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.493+0000 7f0b666b9700 1 --2- 172.21.15.80:0/477813176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6006c0a0 0x7f0b60072fa0 secure :-1 s=THROTTLE_DONE pgs=1847 cs=0 l=1 rx=0x7f0b5000af50 tx=0x7f0b5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.493+0000 7f0b656b7700 1 -- 172.21.15.80:0/477813176 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b50007210 con 0x7f0b6006c0a0 2019-11-28T12:01:49.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.493+0000 7f0b666b9700 1 --2- 172.21.15.80:0/477813176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6006c0a0 0x7f0b60072fa0 secure :-1 s=THROTTLE_DONE pgs=1847 cs=0 l=1 rx=0x7f0b5000af50 tx=0x7f0b5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.493+0000 7f0b666b9700 1 --2- 172.21.15.80:0/477813176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6006c0a0 0x7f0b60072fa0 secure :-1 s=THROTTLE_DONE pgs=1847 cs=0 l=1 rx=0x7f0b5000af50 tx=0x7f0b5000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.493+0000 7f0b656b7700 1 -- 172.21.15.80:0/477813176 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b500099b0 con 0x7f0b6006c0a0 2019-11-28T12:01:49.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.493+0000 7f0b656b7700 1 -- 172.21.15.80:0/477813176 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b5000a080 con 0x7f0b6006c0a0 2019-11-28T12:01:49.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.493+0000 7f0b6811c700 1 -- 172.21.15.80:0/477813176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6006c0a0 msgr2=0x7f0b60072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.493+0000 7f0b6811c700 1 --2- 172.21.15.80:0/477813176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6006c0a0 0x7f0b60072fa0 secure :-1 s=READY pgs=1847 cs=0 l=1 rx=0x7f0b5000af50 tx=0x7f0b5000b760).stop 2019-11-28T12:01:49.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.493+0000 7f0b6811c700 1 -- 172.21.15.80:0/477813176 shutdown_connections 2019-11-28T12:01:49.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.493+0000 7f0b6811c700 1 --2- 172.21.15.80:0/477813176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b600734e0 0x7f0b60071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:01:49.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.493+0000 7f0b6811c700 1 --2- 172.21.15.80:0/477813176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6006c0a0 0x7f0b60072fa0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:49.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.493+0000 7f0b6811c700 1 -- 172.21.15.80:0/477813176 shutdown_connections 2019-11-28T12:01:49.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.493+0000 7f0b6811c700 1 -- 172.21.15.80:0/477813176 wait complete. 2019-11-28T12:01:49.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.493+0000 7f0b6811c700 1 -- 172.21.15.80:0/477813176 >> 172.21.15.80:0/477813176 conn(0x7f0b60061cf0 msgr2=0x7f0b60064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:49.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.496+0000 7f0b6811c700 1 Processor -- start 2019-11-28T12:01:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.496+0000 7f0b6811c700 1 -- start start 2019-11-28T12:01:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b6811c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b6013dc00 0x7f0b60109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b6811c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0b6010a3a0 0x7f0b60108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b6811c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b601312c0 con 0x7f0b60109220 2019-11-28T12:01:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b6811c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b60104e00 con 0x7f0b6010a3a0 2019-11-28T12:01:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b6811c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b60105830 con 0x7f0b6013dc00 2019-11-28T12:01:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b66eba700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0b60109220 0x7f0b60103000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47348/0 (socket says 172.21.15.80:47348) 2019-11-28T12:01:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b66eba700 1 -- 172.21.15.80:0/2243920263 learned_addr learned my addr 172.21.15.80:0/2243920263 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:01:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b666b9700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b6013dc00 0x7f0b60109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b65eb8700 1 --2- 172.21.15.80:0/2243920263 >> v2:172.21.15.174:3300/0 conn(0x7f0b6010a3a0 0x7f0b60108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b5effd700 1 -- 172.21.15.80:0/2243920263 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043144615 0 0) 0x7f0b580009b0 con 0x7f0b60109220 2019-11-28T12:01:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b5effd700 1 -- 172.21.15.80:0/2243920263 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b44002e80 con 0x7f0b60109220 2019-11-28T12:01:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b5effd700 1 -- 172.21.15.80:0/2243920263 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1276008946 0 0) 0x7f0b58001300 con 0x7f0b60109220 2019-11-28T12:01:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b65eb8700 1 -- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b6013dc00 msgr2=0x7f0b60109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b65eb8700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b6013dc00 0x7f0b60109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b65eb8700 1 -- 172.21.15.80:0/2243920263 >> v1:172.21.15.80:6789/0 conn(0x7f0b60109220 legacy=0x7f0b60103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b65eb8700 1 -- 172.21.15.80:0/2243920263 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60106190 con 0x7f0b6010a3a0 2019-11-28T12:01:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b666b9700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b6013dc00 0x7f0b60109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:01:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b65eb8700 1 --2- 172.21.15.80:0/2243920263 >> v2:172.21.15.174:3300/0 conn(0x7f0b6010a3a0 0x7f0b60108ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0b48010720 tx=0x7f0b48010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b65eb8700 1 --2- 172.21.15.80:0/2243920263 >> v2:172.21.15.174:3300/0 conn(0x7f0b6010a3a0 0x7f0b60108ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0b48010720 tx=0x7f0b48010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.497+0000 7f0b65eb8700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6010a3a0 0x7f0b60108ce0 secure :-1 s=READY pgs=1848 cs=0 l=1 rx=0x7f0b48010720 tx=0x7f0b48010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:49.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.498+0000 7f0b65eb8700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6010a3a0 0x7f0b60108ce0 secure :-1 s=THROTTLE_DONE pgs=1848 cs=0 l=1 rx=0x7f0b48010720 tx=0x7f0b48010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.498+0000 7f0b5effd700 1 -- 172.21.15.80:0/2243920263 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b48000cc0 con 0x7f0b6010a3a0 2019-11-28T12:01:49.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.498+0000 7f0b65eb8700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6010a3a0 0x7f0b60108ce0 secure :-1 s=THROTTLE_DONE pgs=1848 cs=0 l=1 rx=0x7f0b48010720 tx=0x7f0b48010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.498+0000 7f0b5effd700 1 -- 172.21.15.80:0/2243920263 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b48000cc0 con 0x7f0b6010a3a0 2019-11-28T12:01:49.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.498+0000 7f0b65eb8700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6010a3a0 0x7f0b60108ce0 secure :-1 s=THROTTLE_DONE pgs=1848 cs=0 l=1 rx=0x7f0b48010720 tx=0x7f0b48010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.498+0000 7f0b6811c700 1 -- 172.21.15.80:0/2243920263 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b60106510 con 0x7f0b6010a3a0 2019-11-28T12:01:49.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.498+0000 7f0b5effd700 1 -- 172.21.15.80:0/2243920263 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b4800e560 con 0x7f0b6010a3a0 2019-11-28T12:01:49.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.498+0000 7f0b6811c700 1 -- 172.21.15.80:0/2243920263 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b60106190 con 0x7f0b6010a3a0 2019-11-28T12:01:49.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.498+0000 7f0b65eb8700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6010a3a0 0x7f0b60108ce0 secure :-1 s=THROTTLE_DONE pgs=1848 cs=0 l=1 rx=0x7f0b48010720 tx=0x7f0b48010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.499+0000 7f0b5effd700 1 -- 172.21.15.80:0/2243920263 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0b4800de80 con 0x7f0b6010a3a0 2019-11-28T12:01:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.499+0000 7f0b65eb8700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6010a3a0 0x7f0b60108ce0 secure :-1 s=THROTTLE_DONE pgs=1848 cs=0 l=1 rx=0x7f0b48010720 tx=0x7f0b48010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.499+0000 7f0b5effd700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0b44018780 0x7f0b4401abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:01:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.499+0000 7f0b5effd700 1 -- 172.21.15.80:0/2243920263 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0b48031d80 con 0x7f0b6010a3a0 2019-11-28T12:01:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.499+0000 7f0b666b9700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0b44018780 0x7f0b4401abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:01:49.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.499+0000 7f0b666b9700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0b44018780 0x7f0b4401abf0 crc :-1 s=READY pgs=1265 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:01:49.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.506+0000 7f0b6811c700 1 -- 172.21.15.80:0/2243920263 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b60106510 con 0x7f0b6010a3a0 2019-11-28T12:01:49.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.509+0000 7f0b65eb8700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6010a3a0 0x7f0b60108ce0 secure :-1 s=THROTTLE_DONE pgs=1848 cs=0 l=1 rx=0x7f0b48010720 tx=0x7f0b48010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.509+0000 7f0b5effd700 1 -- 172.21.15.80:0/2243920263 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0b4800ea70 con 0x7f0b6010a3a0 2019-11-28T12:01:49.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.681+0000 7f0b6811c700 1 -- 172.21.15.80:0/2243920263 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b60106190 con 0x7f0b6010a3a0 2019-11-28T12:01:49.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.681+0000 7f0b65eb8700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6010a3a0 0x7f0b60108ce0 secure :-1 s=THROTTLE_DONE pgs=1848 cs=0 l=1 rx=0x7f0b48010720 tx=0x7f0b48010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:01:49.676 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.681+0000 7f0b5effd700 1 -- 172.21.15.80:0/2243920263 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 195 v195) v1 ==== 95+0+2457 (secure 0 0 0) 0x7f0b4800dd90 con 0x7f0b6010a3a0 2019-11-28T12:01:49.676 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 195 2019-11-28T12:01:49.676 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:01:49.676 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":195,"default_fscid":19,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":12028,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3134286726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3134286726},{"type":"v1","addr":"172.21.15.80:6835","nonce":3134286726}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":195},{"gid":12840,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3876746601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3876746601},{"type":"v1","addr":"172.21.15.80:6834","nonce":3876746601}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":195}],"filesystems":[{"mdsmap":{"epoch":194,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:01:41.241732+0000","modified":"2019-11-28T12:01:45.253838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8303":{"gid":8303,"name":"c","rank":0,"incarnation":193,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/1019990404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1019990404},{"type":"v1","addr":"172.21.15.174:6835","nonce":1019990404}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[39],"metadata_pool":38,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":19}]} 2019-11-28T12:01:49.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.684+0000 7f0b6811c700 1 -- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0b44018780 msgr2=0x7f0b4401abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.684+0000 7f0b6811c700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0b44018780 0x7f0b4401abf0 crc :-1 s=READY pgs=1265 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:49.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.684+0000 7f0b6811c700 1 -- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6010a3a0 msgr2=0x7f0b60108ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:01:49.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.684+0000 7f0b6811c700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6010a3a0 0x7f0b60108ce0 secure :-1 s=READY pgs=1848 cs=0 l=1 rx=0x7f0b48010720 tx=0x7f0b48010ac0).stop 2019-11-28T12:01:49.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.684+0000 7f0b6811c700 1 -- 172.21.15.80:0/2243920263 shutdown_connections 2019-11-28T12:01:49.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.684+0000 7f0b6811c700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0b44018780 0x7f0b4401abf0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:49.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.684+0000 7f0b6811c700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b6010a3a0 0x7f0b60108ce0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:49.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.684+0000 7f0b6811c700 1 --2- 172.21.15.80:0/2243920263 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b6013dc00 0x7f0b60109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:01:49.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.684+0000 7f0b6811c700 1 -- 172.21.15.80:0/2243920263 shutdown_connections 2019-11-28T12:01:49.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.684+0000 7f0b6811c700 1 -- 172.21.15.80:0/2243920263 wait complete. 2019-11-28T12:01:49.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:01:49.684+0000 7f0b6811c700 1 -- 172.21.15.80:0/2243920263 >> 172.21.15.80:0/2243920263 conn(0x7f0b6011bfc0 msgr2=0x7f0b60141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:01:49.990 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8303}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 38, u'failed': [], u'epoch': 194, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [39], u'info': {u'gid_8303': {u'export_targets': [], u'name': u'c', u'incarnation': 193, u'state_seq': 2, u'state': u'up:active', u'gid': 8303, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1019990404, u'type': u'v2', u'addr': u'172.21.15.174:6834'}, {u'nonce': 1019990404, u'type': u'v1', u'addr': u'172.21.15.174:6835'}]}, u'addr': u'172.21.15.174:6835/1019990404'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T12:01:41.241732+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T12:01:45.253838+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T12:01:49.990 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T12:01:49.991 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2019-11-28T12:01:50.116 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T12:01:50.117 INFO:teuthology.orchestra.run.smithi174.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T12:01:50.117 INFO:teuthology.orchestra.run.smithi174.stdout: "whoami": 0, 2019-11-28T12:01:50.117 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 8303, 2019-11-28T12:01:50.117 INFO:teuthology.orchestra.run.smithi174.stdout: "want_state": "up:active", 2019-11-28T12:01:50.117 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "up:active", 2019-11-28T12:01:50.117 INFO:teuthology.orchestra.run.smithi174.stdout: "rank_uptime": 5.869334899, 2019-11-28T12:01:50.118 INFO:teuthology.orchestra.run.smithi174.stdout: "mdsmap_epoch": 194, 2019-11-28T12:01:50.118 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch": 234, 2019-11-28T12:01:50.118 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_epoch_barrier": 234, 2019-11-28T12:01:50.118 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 6.453790068 2019-11-28T12:01:50.118 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T12:01:50.123 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8303, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.869334899, "mdsmap_epoch": 194, "osdmap_epoch": 234, "osdmap_epoch_barrier": 234, "uptime": 6.453790068 } 2019-11-28T12:01:50.123 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T12:01:50.123 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T12:01:50.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T12:01:50.124 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T12:01:50.193 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T12:01:50.194 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T12:01:50.314 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T12:01:50.314 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T12:01:50.314 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T12:01:50.314 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T12:01:50.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T12:01:50.315 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T12:01:50.384 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T12:01:50.506 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T12:01:50.507 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T12:01:50.507 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T12:01:50.512 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T12:01:50.513 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T12:01:50.634 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T12:01:50.634 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T12:01:50.634 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T12:01:50.640 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T12:01:50.641 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f0 2019-11-28T12:01:50.705 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f1 2019-11-28T12:01:50.761 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f2 2019-11-28T12:01:50.816 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f3 2019-11-28T12:01:50.872 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f4 2019-11-28T12:01:50.927 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f5 2019-11-28T12:01:50.983 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f6 2019-11-28T12:01:51.038 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f7 2019-11-28T12:01:51.093 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f8 2019-11-28T12:01:51.147 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f9 2019-11-28T12:01:51.203 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f10 2019-11-28T12:01:51.259 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f11 2019-11-28T12:01:51.314 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f12 2019-11-28T12:01:51.369 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f13 2019-11-28T12:01:51.423 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f14 2019-11-28T12:01:51.479 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f15 2019-11-28T12:01:51.535 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f16 2019-11-28T12:01:51.591 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f17 2019-11-28T12:01:51.646 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f18 2019-11-28T12:01:51.701 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f19 2019-11-28T12:01:51.757 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f20 2019-11-28T12:01:51.812 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f21 2019-11-28T12:01:51.868 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f22 2019-11-28T12:01:51.924 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f23 2019-11-28T12:01:51.980 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f24 2019-11-28T12:01:52.036 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f25 2019-11-28T12:01:52.090 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f26 2019-11-28T12:01:52.146 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f27 2019-11-28T12:01:52.200 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f28 2019-11-28T12:01:52.256 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f29 2019-11-28T12:01:52.311 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f30 2019-11-28T12:01:52.366 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f31 2019-11-28T12:01:52.421 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f32 2019-11-28T12:01:52.482 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f33 2019-11-28T12:01:52.537 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f34 2019-11-28T12:01:52.592 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f35 2019-11-28T12:01:52.647 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f36 2019-11-28T12:01:52.703 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f37 2019-11-28T12:01:52.757 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f38 2019-11-28T12:01:52.812 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f39 2019-11-28T12:01:52.866 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f40 2019-11-28T12:01:52.922 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f41 2019-11-28T12:01:52.979 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f42 2019-11-28T12:01:53.035 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f43 2019-11-28T12:01:53.091 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f44 2019-11-28T12:01:53.147 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f45 2019-11-28T12:01:53.204 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f46 2019-11-28T12:01:53.264 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f47 2019-11-28T12:01:53.322 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f48 2019-11-28T12:01:53.379 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f49 2019-11-28T12:01:53.442 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f50 2019-11-28T12:01:53.505 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f51 2019-11-28T12:01:53.559 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f52 2019-11-28T12:01:53.615 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f53 2019-11-28T12:01:53.670 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f54 2019-11-28T12:01:53.727 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f55 2019-11-28T12:01:53.783 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f56 2019-11-28T12:01:53.839 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f57 2019-11-28T12:01:53.895 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f58 2019-11-28T12:01:53.957 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f59 2019-11-28T12:01:54.012 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f60 2019-11-28T12:01:54.067 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f61 2019-11-28T12:01:54.123 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f62 2019-11-28T12:01:54.179 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f63 2019-11-28T12:01:54.235 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f64 2019-11-28T12:01:54.290 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f65 2019-11-28T12:01:54.345 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f66 2019-11-28T12:01:54.400 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f67 2019-11-28T12:01:54.457 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f68 2019-11-28T12:01:54.513 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f69 2019-11-28T12:01:54.553 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:01:54.557 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:01:54.563 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:01:54.568 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:01:54.570 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f70 2019-11-28T12:01:54.574 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:01:54.588 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:01:54.669 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f71 2019-11-28T12:01:54.790 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f72 2019-11-28T12:01:54.846 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f73 2019-11-28T12:01:54.901 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f74 2019-11-28T12:01:54.957 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f75 2019-11-28T12:01:55.013 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f76 2019-11-28T12:01:55.067 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f77 2019-11-28T12:01:55.123 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f78 2019-11-28T12:01:55.177 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f79 2019-11-28T12:01:55.233 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f80 2019-11-28T12:01:55.288 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f81 2019-11-28T12:01:55.343 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f82 2019-11-28T12:01:55.398 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f83 2019-11-28T12:01:55.454 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f84 2019-11-28T12:01:55.513 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f85 2019-11-28T12:01:55.569 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f86 2019-11-28T12:01:55.626 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f87 2019-11-28T12:01:55.682 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f88 2019-11-28T12:01:55.738 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f89 2019-11-28T12:01:55.793 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f90 2019-11-28T12:01:55.849 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f91 2019-11-28T12:01:55.904 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f92 2019-11-28T12:01:55.961 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f93 2019-11-28T12:01:56.015 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f94 2019-11-28T12:01:56.071 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f95 2019-11-28T12:01:56.126 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f96 2019-11-28T12:01:56.181 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f97 2019-11-28T12:01:56.237 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f98 2019-11-28T12:01:56.292 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f99 2019-11-28T12:01:56.347 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f100 2019-11-28T12:01:56.402 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f101 2019-11-28T12:01:56.458 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f102 2019-11-28T12:01:56.513 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f103 2019-11-28T12:01:56.568 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f104 2019-11-28T12:01:56.625 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f105 2019-11-28T12:01:56.681 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f106 2019-11-28T12:01:56.737 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f107 2019-11-28T12:01:56.792 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f108 2019-11-28T12:01:56.847 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f109 2019-11-28T12:01:56.902 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f110 2019-11-28T12:01:56.957 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f111 2019-11-28T12:01:57.012 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f112 2019-11-28T12:01:57.067 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f113 2019-11-28T12:01:57.123 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f114 2019-11-28T12:01:57.178 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f115 2019-11-28T12:01:57.236 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f116 2019-11-28T12:01:57.291 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f117 2019-11-28T12:01:57.346 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f118 2019-11-28T12:01:57.402 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f119 2019-11-28T12:01:57.457 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f120 2019-11-28T12:01:57.512 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f121 2019-11-28T12:01:57.568 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f122 2019-11-28T12:01:57.624 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f123 2019-11-28T12:01:57.679 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f124 2019-11-28T12:01:57.734 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f125 2019-11-28T12:01:57.790 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f126 2019-11-28T12:01:57.845 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f127 2019-11-28T12:01:57.901 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f128 2019-11-28T12:01:57.956 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f129 2019-11-28T12:01:58.012 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f130 2019-11-28T12:01:58.068 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f131 2019-11-28T12:01:58.123 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f132 2019-11-28T12:01:58.179 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f133 2019-11-28T12:01:58.236 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f134 2019-11-28T12:01:58.291 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f135 2019-11-28T12:01:58.348 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f136 2019-11-28T12:01:58.404 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f137 2019-11-28T12:01:58.462 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f138 2019-11-28T12:01:58.518 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f139 2019-11-28T12:01:58.573 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f140 2019-11-28T12:01:58.628 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f141 2019-11-28T12:01:58.682 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f142 2019-11-28T12:01:58.737 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f143 2019-11-28T12:01:58.792 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f144 2019-11-28T12:01:58.848 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f145 2019-11-28T12:01:58.903 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f146 2019-11-28T12:01:58.959 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f147 2019-11-28T12:01:59.015 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f148 2019-11-28T12:01:59.073 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f149 2019-11-28T12:01:59.129 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f150 2019-11-28T12:01:59.185 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f151 2019-11-28T12:01:59.241 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f152 2019-11-28T12:01:59.297 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f153 2019-11-28T12:01:59.353 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f154 2019-11-28T12:01:59.408 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f155 2019-11-28T12:01:59.464 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f156 2019-11-28T12:01:59.523 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f157 2019-11-28T12:01:59.579 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f158 2019-11-28T12:01:59.635 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f159 2019-11-28T12:01:59.691 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f160 2019-11-28T12:01:59.750 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f161 2019-11-28T12:01:59.807 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f162 2019-11-28T12:01:59.868 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f163 2019-11-28T12:01:59.923 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f164 2019-11-28T12:01:59.978 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f165 2019-11-28T12:02:00.033 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f166 2019-11-28T12:02:00.089 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f167 2019-11-28T12:02:00.144 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f168 2019-11-28T12:02:00.199 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f169 2019-11-28T12:02:00.254 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f170 2019-11-28T12:02:00.309 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f171 2019-11-28T12:02:00.365 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f172 2019-11-28T12:02:00.421 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f173 2019-11-28T12:02:00.476 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f174 2019-11-28T12:02:00.532 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f175 2019-11-28T12:02:00.587 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f176 2019-11-28T12:02:00.642 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f177 2019-11-28T12:02:00.697 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f178 2019-11-28T12:02:00.752 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f179 2019-11-28T12:02:00.807 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f180 2019-11-28T12:02:00.862 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f181 2019-11-28T12:02:00.918 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f182 2019-11-28T12:02:00.973 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f183 2019-11-28T12:02:01.028 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f184 2019-11-28T12:02:01.084 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f185 2019-11-28T12:02:01.138 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f186 2019-11-28T12:02:01.194 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f187 2019-11-28T12:02:01.249 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f188 2019-11-28T12:02:01.305 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f189 2019-11-28T12:02:01.360 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f190 2019-11-28T12:02:01.415 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f191 2019-11-28T12:02:01.470 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f192 2019-11-28T12:02:01.526 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f193 2019-11-28T12:02:01.581 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f194 2019-11-28T12:02:01.636 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f195 2019-11-28T12:02:01.692 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f196 2019-11-28T12:02:01.748 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f197 2019-11-28T12:02:01.803 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f198 2019-11-28T12:02:01.858 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f199 2019-11-28T12:02:01.912 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f200 2019-11-28T12:02:01.968 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f201 2019-11-28T12:02:02.023 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f202 2019-11-28T12:02:02.080 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f203 2019-11-28T12:02:02.136 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f204 2019-11-28T12:02:02.191 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f205 2019-11-28T12:02:02.246 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f206 2019-11-28T12:02:02.302 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f207 2019-11-28T12:02:02.420 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f208 2019-11-28T12:02:02.475 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f209 2019-11-28T12:02:02.530 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f210 2019-11-28T12:02:02.586 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f211 2019-11-28T12:02:02.642 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f212 2019-11-28T12:02:02.697 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f213 2019-11-28T12:02:02.753 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f214 2019-11-28T12:02:02.811 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f215 2019-11-28T12:02:02.866 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f216 2019-11-28T12:02:02.922 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f217 2019-11-28T12:02:02.978 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f218 2019-11-28T12:02:03.034 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f219 2019-11-28T12:02:03.089 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f220 2019-11-28T12:02:03.144 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f221 2019-11-28T12:02:03.199 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f222 2019-11-28T12:02:03.255 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f223 2019-11-28T12:02:03.310 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f224 2019-11-28T12:02:03.365 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f225 2019-11-28T12:02:03.420 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f226 2019-11-28T12:02:03.475 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f227 2019-11-28T12:02:03.531 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f228 2019-11-28T12:02:03.590 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f229 2019-11-28T12:02:03.645 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f230 2019-11-28T12:02:03.699 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f231 2019-11-28T12:02:03.754 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f232 2019-11-28T12:02:03.810 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f233 2019-11-28T12:02:03.865 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f234 2019-11-28T12:02:03.921 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f235 2019-11-28T12:02:03.976 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f236 2019-11-28T12:02:04.032 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f237 2019-11-28T12:02:04.087 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f238 2019-11-28T12:02:04.143 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f239 2019-11-28T12:02:04.199 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f240 2019-11-28T12:02:04.254 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f241 2019-11-28T12:02:04.309 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f242 2019-11-28T12:02:04.364 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f243 2019-11-28T12:02:04.420 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f244 2019-11-28T12:02:04.475 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f245 2019-11-28T12:02:04.529 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f246 2019-11-28T12:02:04.584 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f247 2019-11-28T12:02:04.639 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f248 2019-11-28T12:02:04.694 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f249 2019-11-28T12:02:04.750 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f250 2019-11-28T12:02:04.806 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f251 2019-11-28T12:02:04.861 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f252 2019-11-28T12:02:04.916 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f253 2019-11-28T12:02:04.971 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f254 2019-11-28T12:02:05.027 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f255 2019-11-28T12:02:05.082 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f256 2019-11-28T12:02:05.137 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f257 2019-11-28T12:02:05.193 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f258 2019-11-28T12:02:05.248 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f259 2019-11-28T12:02:05.303 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f260 2019-11-28T12:02:05.359 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f261 2019-11-28T12:02:05.414 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f262 2019-11-28T12:02:05.469 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f263 2019-11-28T12:02:05.524 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f264 2019-11-28T12:02:05.580 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f265 2019-11-28T12:02:05.635 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f266 2019-11-28T12:02:05.696 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f267 2019-11-28T12:02:05.751 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f268 2019-11-28T12:02:05.807 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f269 2019-11-28T12:02:05.863 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f270 2019-11-28T12:02:05.923 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f271 2019-11-28T12:02:05.980 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f272 2019-11-28T12:02:06.035 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f273 2019-11-28T12:02:06.091 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f274 2019-11-28T12:02:06.147 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f275 2019-11-28T12:02:06.203 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f276 2019-11-28T12:02:06.259 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f277 2019-11-28T12:02:06.315 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f278 2019-11-28T12:02:06.370 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f279 2019-11-28T12:02:06.429 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f280 2019-11-28T12:02:06.486 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f281 2019-11-28T12:02:06.543 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f282 2019-11-28T12:02:06.598 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f283 2019-11-28T12:02:06.654 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f284 2019-11-28T12:02:06.710 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f285 2019-11-28T12:02:06.766 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f286 2019-11-28T12:02:06.821 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f287 2019-11-28T12:02:06.877 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f288 2019-11-28T12:02:06.945 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f289 2019-11-28T12:02:07.001 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f290 2019-11-28T12:02:07.065 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f291 2019-11-28T12:02:07.121 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f292 2019-11-28T12:02:07.176 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f293 2019-11-28T12:02:07.243 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f294 2019-11-28T12:02:07.308 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f295 2019-11-28T12:02:07.364 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f296 2019-11-28T12:02:07.420 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f297 2019-11-28T12:02:07.476 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f298 2019-11-28T12:02:07.537 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f299 2019-11-28T12:02:07.604 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f300 2019-11-28T12:02:07.665 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f301 2019-11-28T12:02:07.722 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f302 2019-11-28T12:02:07.778 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f303 2019-11-28T12:02:07.835 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f304 2019-11-28T12:02:07.892 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f305 2019-11-28T12:02:07.951 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f306 2019-11-28T12:02:08.008 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f307 2019-11-28T12:02:08.064 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f308 2019-11-28T12:02:08.120 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f309 2019-11-28T12:02:08.178 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f310 2019-11-28T12:02:08.234 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f311 2019-11-28T12:02:08.291 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f312 2019-11-28T12:02:08.347 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f313 2019-11-28T12:02:08.407 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f314 2019-11-28T12:02:08.464 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f315 2019-11-28T12:02:08.521 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f316 2019-11-28T12:02:08.577 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f317 2019-11-28T12:02:08.633 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f318 2019-11-28T12:02:08.688 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f319 2019-11-28T12:02:08.745 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f320 2019-11-28T12:02:08.801 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f321 2019-11-28T12:02:08.857 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f322 2019-11-28T12:02:08.913 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f323 2019-11-28T12:02:08.970 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f324 2019-11-28T12:02:09.026 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f325 2019-11-28T12:02:09.083 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f326 2019-11-28T12:02:09.140 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f327 2019-11-28T12:02:09.197 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f328 2019-11-28T12:02:09.252 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f329 2019-11-28T12:02:09.308 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f330 2019-11-28T12:02:09.367 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f331 2019-11-28T12:02:09.425 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f332 2019-11-28T12:02:09.482 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f333 2019-11-28T12:02:09.538 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f334 2019-11-28T12:02:09.594 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f335 2019-11-28T12:02:09.650 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f336 2019-11-28T12:02:09.710 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f337 2019-11-28T12:02:09.766 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f338 2019-11-28T12:02:09.824 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f339 2019-11-28T12:02:09.891 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f340 2019-11-28T12:02:09.953 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f341 2019-11-28T12:02:10.009 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f342 2019-11-28T12:02:10.067 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f343 2019-11-28T12:02:10.124 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f344 2019-11-28T12:02:10.180 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f345 2019-11-28T12:02:10.236 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f346 2019-11-28T12:02:10.292 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f347 2019-11-28T12:02:10.350 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f348 2019-11-28T12:02:10.409 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f349 2019-11-28T12:02:10.466 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f350 2019-11-28T12:02:10.522 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f351 2019-11-28T12:02:10.581 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f352 2019-11-28T12:02:10.638 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f353 2019-11-28T12:02:10.693 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f354 2019-11-28T12:02:10.748 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f355 2019-11-28T12:02:10.805 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f356 2019-11-28T12:02:10.860 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f357 2019-11-28T12:02:10.982 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f358 2019-11-28T12:02:11.038 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f359 2019-11-28T12:02:11.095 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f360 2019-11-28T12:02:11.150 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f361 2019-11-28T12:02:11.205 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f362 2019-11-28T12:02:11.261 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f363 2019-11-28T12:02:11.317 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f364 2019-11-28T12:02:11.372 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f365 2019-11-28T12:02:11.428 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f366 2019-11-28T12:02:11.484 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f367 2019-11-28T12:02:11.539 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f368 2019-11-28T12:02:11.596 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f369 2019-11-28T12:02:11.652 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f370 2019-11-28T12:02:11.707 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f371 2019-11-28T12:02:11.762 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f372 2019-11-28T12:02:11.818 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f373 2019-11-28T12:02:11.878 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f374 2019-11-28T12:02:11.934 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f375 2019-11-28T12:02:11.990 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f376 2019-11-28T12:02:12.109 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f377 2019-11-28T12:02:12.165 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f378 2019-11-28T12:02:12.220 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f379 2019-11-28T12:02:12.276 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f380 2019-11-28T12:02:12.333 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f381 2019-11-28T12:02:12.388 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f382 2019-11-28T12:02:12.444 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f383 2019-11-28T12:02:12.499 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f384 2019-11-28T12:02:12.555 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f385 2019-11-28T12:02:12.611 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f386 2019-11-28T12:02:12.666 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f387 2019-11-28T12:02:12.722 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f388 2019-11-28T12:02:12.777 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f389 2019-11-28T12:02:12.832 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f390 2019-11-28T12:02:12.888 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f391 2019-11-28T12:02:12.947 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f392 2019-11-28T12:02:13.003 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f393 2019-11-28T12:02:13.059 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f394 2019-11-28T12:02:13.115 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f395 2019-11-28T12:02:13.171 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f396 2019-11-28T12:02:13.226 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f397 2019-11-28T12:02:13.282 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f398 2019-11-28T12:02:13.337 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f399 2019-11-28T12:02:13.393 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f400 2019-11-28T12:02:13.449 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f401 2019-11-28T12:02:13.505 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f402 2019-11-28T12:02:13.560 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f403 2019-11-28T12:02:13.616 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f404 2019-11-28T12:02:13.672 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f405 2019-11-28T12:02:13.727 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f406 2019-11-28T12:02:13.782 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f407 2019-11-28T12:02:13.837 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f408 2019-11-28T12:02:13.892 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f409 2019-11-28T12:02:13.947 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f410 2019-11-28T12:02:14.003 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f411 2019-11-28T12:02:14.059 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f412 2019-11-28T12:02:14.115 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f413 2019-11-28T12:02:14.170 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f414 2019-11-28T12:02:14.225 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f415 2019-11-28T12:02:14.281 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f416 2019-11-28T12:02:14.336 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f417 2019-11-28T12:02:14.392 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f418 2019-11-28T12:02:14.448 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f419 2019-11-28T12:02:14.504 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f420 2019-11-28T12:02:14.562 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f421 2019-11-28T12:02:14.617 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f422 2019-11-28T12:02:14.672 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f423 2019-11-28T12:02:14.727 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f424 2019-11-28T12:02:14.782 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f425 2019-11-28T12:02:14.901 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f426 2019-11-28T12:02:14.957 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f427 2019-11-28T12:02:15.014 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f428 2019-11-28T12:02:15.069 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f429 2019-11-28T12:02:15.124 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f430 2019-11-28T12:02:15.181 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f431 2019-11-28T12:02:15.236 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f432 2019-11-28T12:02:15.290 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f433 2019-11-28T12:02:15.345 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f434 2019-11-28T12:02:15.401 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f435 2019-11-28T12:02:15.455 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f436 2019-11-28T12:02:15.511 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f437 2019-11-28T12:02:15.567 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f438 2019-11-28T12:02:15.623 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f439 2019-11-28T12:02:15.678 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f440 2019-11-28T12:02:15.735 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f441 2019-11-28T12:02:15.790 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f442 2019-11-28T12:02:15.845 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f443 2019-11-28T12:02:15.901 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f444 2019-11-28T12:02:15.956 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f445 2019-11-28T12:02:16.012 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f446 2019-11-28T12:02:16.067 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f447 2019-11-28T12:02:16.137 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f448 2019-11-28T12:02:16.193 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f449 2019-11-28T12:02:16.248 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f450 2019-11-28T12:02:16.304 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f451 2019-11-28T12:02:16.373 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f452 2019-11-28T12:02:16.428 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f453 2019-11-28T12:02:16.483 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f454 2019-11-28T12:02:16.538 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f455 2019-11-28T12:02:16.593 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f456 2019-11-28T12:02:16.648 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f457 2019-11-28T12:02:16.702 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f458 2019-11-28T12:02:16.758 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f459 2019-11-28T12:02:16.813 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f460 2019-11-28T12:02:16.868 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f461 2019-11-28T12:02:16.923 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f462 2019-11-28T12:02:16.978 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f463 2019-11-28T12:02:17.033 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f464 2019-11-28T12:02:17.088 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f465 2019-11-28T12:02:17.143 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f466 2019-11-28T12:02:17.198 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f467 2019-11-28T12:02:17.253 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f468 2019-11-28T12:02:17.308 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f469 2019-11-28T12:02:17.363 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f470 2019-11-28T12:02:17.418 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f471 2019-11-28T12:02:17.473 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f472 2019-11-28T12:02:17.529 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f473 2019-11-28T12:02:17.583 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f474 2019-11-28T12:02:17.639 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f475 2019-11-28T12:02:17.694 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f476 2019-11-28T12:02:17.749 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f477 2019-11-28T12:02:17.803 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f478 2019-11-28T12:02:17.859 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f479 2019-11-28T12:02:17.914 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f480 2019-11-28T12:02:17.970 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f481 2019-11-28T12:02:18.025 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f482 2019-11-28T12:02:18.082 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f483 2019-11-28T12:02:18.138 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f484 2019-11-28T12:02:18.193 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f485 2019-11-28T12:02:18.248 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f486 2019-11-28T12:02:18.303 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f487 2019-11-28T12:02:18.358 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f488 2019-11-28T12:02:18.413 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f489 2019-11-28T12:02:18.468 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f490 2019-11-28T12:02:18.524 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f491 2019-11-28T12:02:18.579 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f492 2019-11-28T12:02:18.636 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f493 2019-11-28T12:02:18.697 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f494 2019-11-28T12:02:18.753 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f495 2019-11-28T12:02:18.809 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f496 2019-11-28T12:02:18.864 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f497 2019-11-28T12:02:18.920 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f498 2019-11-28T12:02:18.975 INFO:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch f499 2019-11-28T12:02:19.031 INFO:teuthology.orchestra.run.smithi016:> cd /home/ubuntu/cephtest/mnt.1 && sudo ls -l 2019-11-28T12:02:20.441 INFO:teuthology.orchestra.run.smithi016.stdout:total 0 2019-11-28T12:02:20.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f0 2019-11-28T12:02:20.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f1 2019-11-28T12:02:20.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f10 2019-11-28T12:02:20.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f100 2019-11-28T12:02:20.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f101 2019-11-28T12:02:20.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f102 2019-11-28T12:02:20.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f103 2019-11-28T12:02:20.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f104 2019-11-28T12:02:20.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f105 2019-11-28T12:02:20.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f106 2019-11-28T12:02:20.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f107 2019-11-28T12:02:20.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f108 2019-11-28T12:02:20.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f109 2019-11-28T12:02:20.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f11 2019-11-28T12:02:20.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f110 2019-11-28T12:02:20.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f111 2019-11-28T12:02:20.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f112 2019-11-28T12:02:20.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f113 2019-11-28T12:02:20.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f114 2019-11-28T12:02:20.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f115 2019-11-28T12:02:20.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f116 2019-11-28T12:02:20.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f117 2019-11-28T12:02:20.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f118 2019-11-28T12:02:20.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f119 2019-11-28T12:02:20.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f12 2019-11-28T12:02:20.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f120 2019-11-28T12:02:20.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f121 2019-11-28T12:02:20.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f122 2019-11-28T12:02:20.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f123 2019-11-28T12:02:20.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f124 2019-11-28T12:02:20.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f125 2019-11-28T12:02:20.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f126 2019-11-28T12:02:20.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f127 2019-11-28T12:02:20.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f128 2019-11-28T12:02:20.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f129 2019-11-28T12:02:20.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f13 2019-11-28T12:02:20.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f130 2019-11-28T12:02:20.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f131 2019-11-28T12:02:20.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f132 2019-11-28T12:02:20.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f133 2019-11-28T12:02:20.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f134 2019-11-28T12:02:20.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f135 2019-11-28T12:02:20.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f136 2019-11-28T12:02:20.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f137 2019-11-28T12:02:20.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f138 2019-11-28T12:02:20.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f139 2019-11-28T12:02:20.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f14 2019-11-28T12:02:20.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f140 2019-11-28T12:02:20.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f141 2019-11-28T12:02:20.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f142 2019-11-28T12:02:20.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f143 2019-11-28T12:02:20.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f144 2019-11-28T12:02:20.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f145 2019-11-28T12:02:20.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f146 2019-11-28T12:02:20.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f147 2019-11-28T12:02:20.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f148 2019-11-28T12:02:20.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f149 2019-11-28T12:02:20.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f15 2019-11-28T12:02:20.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f150 2019-11-28T12:02:20.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f151 2019-11-28T12:02:20.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f152 2019-11-28T12:02:20.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f153 2019-11-28T12:02:20.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f154 2019-11-28T12:02:20.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f155 2019-11-28T12:02:20.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f156 2019-11-28T12:02:20.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f157 2019-11-28T12:02:20.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f158 2019-11-28T12:02:20.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f159 2019-11-28T12:02:20.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f16 2019-11-28T12:02:20.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f160 2019-11-28T12:02:20.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f161 2019-11-28T12:02:20.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f162 2019-11-28T12:02:20.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f163 2019-11-28T12:02:20.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f164 2019-11-28T12:02:20.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f165 2019-11-28T12:02:20.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f166 2019-11-28T12:02:20.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f167 2019-11-28T12:02:20.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f168 2019-11-28T12:02:20.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f169 2019-11-28T12:02:20.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f17 2019-11-28T12:02:20.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f170 2019-11-28T12:02:20.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f171 2019-11-28T12:02:20.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f172 2019-11-28T12:02:20.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f173 2019-11-28T12:02:20.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f174 2019-11-28T12:02:20.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f175 2019-11-28T12:02:20.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f176 2019-11-28T12:02:20.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f177 2019-11-28T12:02:20.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f178 2019-11-28T12:02:20.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f179 2019-11-28T12:02:20.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f18 2019-11-28T12:02:20.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f180 2019-11-28T12:02:20.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f181 2019-11-28T12:02:20.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f182 2019-11-28T12:02:20.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f183 2019-11-28T12:02:20.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f184 2019-11-28T12:02:20.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f185 2019-11-28T12:02:20.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f186 2019-11-28T12:02:20.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f187 2019-11-28T12:02:20.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f188 2019-11-28T12:02:20.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f189 2019-11-28T12:02:20.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f19 2019-11-28T12:02:20.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f190 2019-11-28T12:02:20.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f191 2019-11-28T12:02:20.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f192 2019-11-28T12:02:20.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f193 2019-11-28T12:02:20.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f194 2019-11-28T12:02:20.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f195 2019-11-28T12:02:20.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f196 2019-11-28T12:02:20.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f197 2019-11-28T12:02:20.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f198 2019-11-28T12:02:20.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f199 2019-11-28T12:02:20.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f2 2019-11-28T12:02:20.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f20 2019-11-28T12:02:20.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f200 2019-11-28T12:02:20.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f201 2019-11-28T12:02:20.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f202 2019-11-28T12:02:20.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f203 2019-11-28T12:02:20.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f204 2019-11-28T12:02:20.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f205 2019-11-28T12:02:20.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f206 2019-11-28T12:02:20.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f207 2019-11-28T12:02:20.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f208 2019-11-28T12:02:20.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f209 2019-11-28T12:02:20.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f21 2019-11-28T12:02:20.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f210 2019-11-28T12:02:20.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f211 2019-11-28T12:02:20.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f212 2019-11-28T12:02:20.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f213 2019-11-28T12:02:20.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f214 2019-11-28T12:02:20.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f215 2019-11-28T12:02:20.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f216 2019-11-28T12:02:20.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f217 2019-11-28T12:02:20.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f218 2019-11-28T12:02:20.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f219 2019-11-28T12:02:20.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f22 2019-11-28T12:02:20.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f220 2019-11-28T12:02:20.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f221 2019-11-28T12:02:20.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f222 2019-11-28T12:02:20.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f223 2019-11-28T12:02:20.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f224 2019-11-28T12:02:20.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f225 2019-11-28T12:02:20.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f226 2019-11-28T12:02:20.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f227 2019-11-28T12:02:20.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f228 2019-11-28T12:02:20.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f229 2019-11-28T12:02:20.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f23 2019-11-28T12:02:20.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f230 2019-11-28T12:02:20.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f231 2019-11-28T12:02:20.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f232 2019-11-28T12:02:20.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f233 2019-11-28T12:02:20.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f234 2019-11-28T12:02:20.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f235 2019-11-28T12:02:20.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f236 2019-11-28T12:02:20.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f237 2019-11-28T12:02:20.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f238 2019-11-28T12:02:20.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f239 2019-11-28T12:02:20.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f24 2019-11-28T12:02:20.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f240 2019-11-28T12:02:20.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f241 2019-11-28T12:02:20.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f242 2019-11-28T12:02:20.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f243 2019-11-28T12:02:20.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f244 2019-11-28T12:02:20.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f245 2019-11-28T12:02:20.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f246 2019-11-28T12:02:20.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f247 2019-11-28T12:02:20.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f248 2019-11-28T12:02:20.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f249 2019-11-28T12:02:20.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f25 2019-11-28T12:02:20.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f250 2019-11-28T12:02:20.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f251 2019-11-28T12:02:20.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f252 2019-11-28T12:02:20.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f253 2019-11-28T12:02:20.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f254 2019-11-28T12:02:20.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f255 2019-11-28T12:02:20.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f256 2019-11-28T12:02:20.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f257 2019-11-28T12:02:20.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f258 2019-11-28T12:02:20.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f259 2019-11-28T12:02:20.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f26 2019-11-28T12:02:20.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f260 2019-11-28T12:02:20.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f261 2019-11-28T12:02:20.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f262 2019-11-28T12:02:20.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f263 2019-11-28T12:02:20.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f264 2019-11-28T12:02:20.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f265 2019-11-28T12:02:20.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f266 2019-11-28T12:02:20.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f267 2019-11-28T12:02:20.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f268 2019-11-28T12:02:20.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f269 2019-11-28T12:02:20.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f27 2019-11-28T12:02:20.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f270 2019-11-28T12:02:20.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f271 2019-11-28T12:02:20.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f272 2019-11-28T12:02:20.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f273 2019-11-28T12:02:20.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f274 2019-11-28T12:02:20.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f275 2019-11-28T12:02:20.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f276 2019-11-28T12:02:20.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f277 2019-11-28T12:02:20.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f278 2019-11-28T12:02:20.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f279 2019-11-28T12:02:20.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f28 2019-11-28T12:02:20.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f280 2019-11-28T12:02:20.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f281 2019-11-28T12:02:20.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f282 2019-11-28T12:02:20.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f283 2019-11-28T12:02:20.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f284 2019-11-28T12:02:20.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f285 2019-11-28T12:02:20.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f286 2019-11-28T12:02:20.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f287 2019-11-28T12:02:20.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f288 2019-11-28T12:02:20.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f289 2019-11-28T12:02:20.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f29 2019-11-28T12:02:20.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f290 2019-11-28T12:02:20.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f291 2019-11-28T12:02:20.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f292 2019-11-28T12:02:20.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f293 2019-11-28T12:02:20.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f294 2019-11-28T12:02:20.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f295 2019-11-28T12:02:20.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f296 2019-11-28T12:02:20.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f297 2019-11-28T12:02:20.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f298 2019-11-28T12:02:20.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f299 2019-11-28T12:02:20.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f3 2019-11-28T12:02:20.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f30 2019-11-28T12:02:20.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f300 2019-11-28T12:02:20.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f301 2019-11-28T12:02:20.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f302 2019-11-28T12:02:20.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f303 2019-11-28T12:02:20.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f304 2019-11-28T12:02:20.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f305 2019-11-28T12:02:20.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f306 2019-11-28T12:02:20.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f307 2019-11-28T12:02:20.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f308 2019-11-28T12:02:20.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f309 2019-11-28T12:02:20.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f31 2019-11-28T12:02:20.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f310 2019-11-28T12:02:20.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f311 2019-11-28T12:02:20.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f312 2019-11-28T12:02:20.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f313 2019-11-28T12:02:20.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f314 2019-11-28T12:02:20.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f315 2019-11-28T12:02:20.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f316 2019-11-28T12:02:20.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f317 2019-11-28T12:02:20.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f318 2019-11-28T12:02:20.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f319 2019-11-28T12:02:20.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f32 2019-11-28T12:02:20.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f320 2019-11-28T12:02:20.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f321 2019-11-28T12:02:20.481 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f322 2019-11-28T12:02:20.483 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f323 2019-11-28T12:02:20.484 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f324 2019-11-28T12:02:20.484 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f325 2019-11-28T12:02:20.484 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f326 2019-11-28T12:02:20.484 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f327 2019-11-28T12:02:20.484 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f328 2019-11-28T12:02:20.485 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f329 2019-11-28T12:02:20.485 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f33 2019-11-28T12:02:20.485 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f330 2019-11-28T12:02:20.485 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f331 2019-11-28T12:02:20.485 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f332 2019-11-28T12:02:20.486 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f333 2019-11-28T12:02:20.486 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f334 2019-11-28T12:02:20.486 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f335 2019-11-28T12:02:20.486 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f336 2019-11-28T12:02:20.486 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f337 2019-11-28T12:02:20.486 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f338 2019-11-28T12:02:20.486 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f339 2019-11-28T12:02:20.487 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f34 2019-11-28T12:02:20.487 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f340 2019-11-28T12:02:20.487 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f341 2019-11-28T12:02:20.487 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f342 2019-11-28T12:02:20.487 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f343 2019-11-28T12:02:20.487 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f344 2019-11-28T12:02:20.488 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f345 2019-11-28T12:02:20.488 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f346 2019-11-28T12:02:20.488 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f347 2019-11-28T12:02:20.489 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f348 2019-11-28T12:02:20.489 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f349 2019-11-28T12:02:20.489 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f35 2019-11-28T12:02:20.489 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f350 2019-11-28T12:02:20.489 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f351 2019-11-28T12:02:20.489 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f352 2019-11-28T12:02:20.489 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f353 2019-11-28T12:02:20.490 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f354 2019-11-28T12:02:20.490 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f355 2019-11-28T12:02:20.490 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f356 2019-11-28T12:02:20.490 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f357 2019-11-28T12:02:20.490 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f358 2019-11-28T12:02:20.490 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f359 2019-11-28T12:02:20.491 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f36 2019-11-28T12:02:20.491 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f360 2019-11-28T12:02:20.491 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f361 2019-11-28T12:02:20.491 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f362 2019-11-28T12:02:20.491 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f363 2019-11-28T12:02:20.491 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f364 2019-11-28T12:02:20.492 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f365 2019-11-28T12:02:20.492 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f366 2019-11-28T12:02:20.492 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f367 2019-11-28T12:02:20.492 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f368 2019-11-28T12:02:20.492 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f369 2019-11-28T12:02:20.492 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f37 2019-11-28T12:02:20.492 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f370 2019-11-28T12:02:20.493 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f371 2019-11-28T12:02:20.493 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f372 2019-11-28T12:02:20.493 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f373 2019-11-28T12:02:20.493 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f374 2019-11-28T12:02:20.493 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f375 2019-11-28T12:02:20.493 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f376 2019-11-28T12:02:20.493 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f377 2019-11-28T12:02:20.494 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f378 2019-11-28T12:02:20.494 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f379 2019-11-28T12:02:20.494 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f38 2019-11-28T12:02:20.494 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f380 2019-11-28T12:02:20.494 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f381 2019-11-28T12:02:20.494 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f382 2019-11-28T12:02:20.494 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f383 2019-11-28T12:02:20.495 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f384 2019-11-28T12:02:20.495 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f385 2019-11-28T12:02:20.495 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f386 2019-11-28T12:02:20.495 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f387 2019-11-28T12:02:20.495 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f388 2019-11-28T12:02:20.495 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f389 2019-11-28T12:02:20.495 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f39 2019-11-28T12:02:20.496 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f390 2019-11-28T12:02:20.496 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f391 2019-11-28T12:02:20.496 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f392 2019-11-28T12:02:20.496 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f393 2019-11-28T12:02:20.496 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f394 2019-11-28T12:02:20.496 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f395 2019-11-28T12:02:20.496 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f396 2019-11-28T12:02:20.497 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f397 2019-11-28T12:02:20.497 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f398 2019-11-28T12:02:20.497 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f399 2019-11-28T12:02:20.497 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f4 2019-11-28T12:02:20.497 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f40 2019-11-28T12:02:20.497 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f400 2019-11-28T12:02:20.497 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f401 2019-11-28T12:02:20.498 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f402 2019-11-28T12:02:20.498 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f403 2019-11-28T12:02:20.498 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f404 2019-11-28T12:02:20.498 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f405 2019-11-28T12:02:20.498 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f406 2019-11-28T12:02:20.498 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f407 2019-11-28T12:02:20.498 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f408 2019-11-28T12:02:20.499 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f409 2019-11-28T12:02:20.513 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f41 2019-11-28T12:02:20.513 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f410 2019-11-28T12:02:20.513 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f411 2019-11-28T12:02:20.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f412 2019-11-28T12:02:20.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f413 2019-11-28T12:02:20.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f414 2019-11-28T12:02:20.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f415 2019-11-28T12:02:20.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f416 2019-11-28T12:02:20.514 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f417 2019-11-28T12:02:20.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f418 2019-11-28T12:02:20.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f419 2019-11-28T12:02:20.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f42 2019-11-28T12:02:20.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f420 2019-11-28T12:02:20.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f421 2019-11-28T12:02:20.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f422 2019-11-28T12:02:20.515 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f423 2019-11-28T12:02:20.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f424 2019-11-28T12:02:20.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f425 2019-11-28T12:02:20.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f426 2019-11-28T12:02:20.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f427 2019-11-28T12:02:20.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f428 2019-11-28T12:02:20.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f429 2019-11-28T12:02:20.516 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f43 2019-11-28T12:02:20.517 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f430 2019-11-28T12:02:20.517 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f431 2019-11-28T12:02:20.517 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f432 2019-11-28T12:02:20.517 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f433 2019-11-28T12:02:20.517 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f434 2019-11-28T12:02:20.517 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f435 2019-11-28T12:02:20.517 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f436 2019-11-28T12:02:20.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f437 2019-11-28T12:02:20.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f438 2019-11-28T12:02:20.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f439 2019-11-28T12:02:20.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f44 2019-11-28T12:02:20.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f440 2019-11-28T12:02:20.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f441 2019-11-28T12:02:20.518 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f442 2019-11-28T12:02:20.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f443 2019-11-28T12:02:20.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f444 2019-11-28T12:02:20.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f445 2019-11-28T12:02:20.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f446 2019-11-28T12:02:20.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f447 2019-11-28T12:02:20.519 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f448 2019-11-28T12:02:20.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f449 2019-11-28T12:02:20.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f45 2019-11-28T12:02:20.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f450 2019-11-28T12:02:20.520 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f451 2019-11-28T12:02:20.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f452 2019-11-28T12:02:20.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f453 2019-11-28T12:02:20.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f454 2019-11-28T12:02:20.521 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f455 2019-11-28T12:02:20.522 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f456 2019-11-28T12:02:20.522 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f457 2019-11-28T12:02:20.522 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f458 2019-11-28T12:02:20.522 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f459 2019-11-28T12:02:20.522 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f46 2019-11-28T12:02:20.522 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f460 2019-11-28T12:02:20.522 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f461 2019-11-28T12:02:20.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f462 2019-11-28T12:02:20.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f463 2019-11-28T12:02:20.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f464 2019-11-28T12:02:20.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f465 2019-11-28T12:02:20.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f466 2019-11-28T12:02:20.523 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f467 2019-11-28T12:02:20.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f468 2019-11-28T12:02:20.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f469 2019-11-28T12:02:20.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f47 2019-11-28T12:02:20.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f470 2019-11-28T12:02:20.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f471 2019-11-28T12:02:20.524 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f472 2019-11-28T12:02:20.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f473 2019-11-28T12:02:20.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f474 2019-11-28T12:02:20.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f475 2019-11-28T12:02:20.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f476 2019-11-28T12:02:20.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f477 2019-11-28T12:02:20.525 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f478 2019-11-28T12:02:20.526 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f479 2019-11-28T12:02:20.526 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f48 2019-11-28T12:02:20.526 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f480 2019-11-28T12:02:20.526 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f481 2019-11-28T12:02:20.526 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f482 2019-11-28T12:02:20.526 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f483 2019-11-28T12:02:20.526 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f484 2019-11-28T12:02:20.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f485 2019-11-28T12:02:20.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f486 2019-11-28T12:02:20.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f487 2019-11-28T12:02:20.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f488 2019-11-28T12:02:20.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f489 2019-11-28T12:02:20.527 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f49 2019-11-28T12:02:20.528 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f490 2019-11-28T12:02:20.528 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f491 2019-11-28T12:02:20.528 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f492 2019-11-28T12:02:20.528 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f493 2019-11-28T12:02:20.528 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f494 2019-11-28T12:02:20.528 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f495 2019-11-28T12:02:20.529 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f496 2019-11-28T12:02:20.529 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f497 2019-11-28T12:02:20.529 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f498 2019-11-28T12:02:20.529 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:02 f499 2019-11-28T12:02:20.529 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f5 2019-11-28T12:02:20.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f50 2019-11-28T12:02:20.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f51 2019-11-28T12:02:20.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f52 2019-11-28T12:02:20.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f53 2019-11-28T12:02:20.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f54 2019-11-28T12:02:20.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f55 2019-11-28T12:02:20.530 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f56 2019-11-28T12:02:20.531 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f57 2019-11-28T12:02:20.531 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f58 2019-11-28T12:02:20.531 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f59 2019-11-28T12:02:20.531 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f6 2019-11-28T12:02:20.531 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f60 2019-11-28T12:02:20.531 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f61 2019-11-28T12:02:20.531 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f62 2019-11-28T12:02:20.532 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f63 2019-11-28T12:02:20.532 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f64 2019-11-28T12:02:20.532 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f65 2019-11-28T12:02:20.532 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f66 2019-11-28T12:02:20.532 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f67 2019-11-28T12:02:20.532 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f68 2019-11-28T12:02:20.533 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f69 2019-11-28T12:02:20.533 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f7 2019-11-28T12:02:20.533 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f70 2019-11-28T12:02:20.533 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f71 2019-11-28T12:02:20.533 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f72 2019-11-28T12:02:20.533 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f73 2019-11-28T12:02:20.533 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f74 2019-11-28T12:02:20.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f75 2019-11-28T12:02:20.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f76 2019-11-28T12:02:20.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f77 2019-11-28T12:02:20.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f78 2019-11-28T12:02:20.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f79 2019-11-28T12:02:20.534 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f8 2019-11-28T12:02:20.535 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f80 2019-11-28T12:02:20.535 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f81 2019-11-28T12:02:20.535 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f82 2019-11-28T12:02:20.535 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f83 2019-11-28T12:02:20.535 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f84 2019-11-28T12:02:20.535 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f85 2019-11-28T12:02:20.535 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f86 2019-11-28T12:02:20.536 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f87 2019-11-28T12:02:20.536 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f88 2019-11-28T12:02:20.536 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f89 2019-11-28T12:02:20.536 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f9 2019-11-28T12:02:20.536 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f90 2019-11-28T12:02:20.536 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f91 2019-11-28T12:02:20.537 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f92 2019-11-28T12:02:20.537 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f93 2019-11-28T12:02:20.537 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f94 2019-11-28T12:02:20.537 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f95 2019-11-28T12:02:20.538 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f96 2019-11-28T12:02:20.538 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f97 2019-11-28T12:02:20.538 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f98 2019-11-28T12:02:20.538 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- 1 root root 0 Nov 28 12:01 f99 2019-11-28T12:02:20.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T12:02:20.541 INFO:teuthology.orchestra.run.smithi016:> sudo python -c ' 2019-11-28T12:02:20.541 INFO:teuthology.orchestra.run.smithi016:> import glob 2019-11-28T12:02:20.541 INFO:teuthology.orchestra.run.smithi016:> import os 2019-11-28T12:02:20.541 INFO:teuthology.orchestra.run.smithi016:> import json 2019-11-28T12:02:20.541 INFO:teuthology.orchestra.run.smithi016:> 2019-11-28T12:02:20.541 INFO:teuthology.orchestra.run.smithi016:> def get_id_to_dir(): 2019-11-28T12:02:20.542 INFO:teuthology.orchestra.run.smithi016:> result = {} 2019-11-28T12:02:20.542 INFO:teuthology.orchestra.run.smithi016:> for dir in glob.glob("/sys/kernel/debug/ceph/*"): 2019-11-28T12:02:20.542 INFO:teuthology.orchestra.run.smithi016:> mds_sessions_lines = open(os.path.join(dir, "mds_sessions")).readlines() 2019-11-28T12:02:20.542 INFO:teuthology.orchestra.run.smithi016:> client_id = mds_sessions_lines[1].split()[1].strip('"'"'"'"'"') 2019-11-28T12:02:20.542 INFO:teuthology.orchestra.run.smithi016:> 2019-11-28T12:02:20.542 INFO:teuthology.orchestra.run.smithi016:> result[client_id] = dir 2019-11-28T12:02:20.543 INFO:teuthology.orchestra.run.smithi016:> return result 2019-11-28T12:02:20.543 INFO:teuthology.orchestra.run.smithi016:> 2019-11-28T12:02:20.543 INFO:teuthology.orchestra.run.smithi016:> print(json.dumps(get_id_to_dir())) 2019-11-28T12:02:20.543 INFO:teuthology.orchestra.run.smithi016:> ' 2019-11-28T12:02:20.662 INFO:teuthology.orchestra.run.smithi016.stdout:{"1": "/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client12957"} 2019-11-28T12:02:20.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T12:02:20.663 INFO:teuthology.orchestra.run.smithi016:> sudo python -c ' 2019-11-28T12:02:20.663 INFO:teuthology.orchestra.run.smithi016:> import os 2019-11-28T12:02:20.663 INFO:teuthology.orchestra.run.smithi016:> 2019-11-28T12:02:20.664 INFO:teuthology.orchestra.run.smithi016:> print(open(os.path.join("/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client12957", "mds_sessions")).read()) 2019-11-28T12:02:20.664 INFO:teuthology.orchestra.run.smithi016:> ' 2019-11-28T12:02:20.733 INFO:teuthology.orchestra.run.smithi016.stdout:global_id 12957 2019-11-28T12:02:20.733 INFO:teuthology.orchestra.run.smithi016.stdout:name "1" 2019-11-28T12:02:20.733 INFO:teuthology.orchestra.run.smithi016.stdout:mds.0 open 2019-11-28T12:02:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: 2019-11-28T12:02:20.784 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:20.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.924+0000 7f3399e70700 1 Processor -- start 2019-11-28T12:02:20.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.925+0000 7f3399e70700 1 -- start start 2019-11-28T12:02:20.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.925+0000 7f3399e70700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f339406c490 0x7f339406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:20.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.925+0000 7f3399e70700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f339406ce60 0x7f3394164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:20.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.925+0000 7f3399e70700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339406db00 con 0x7f339406c0a0 2019-11-28T12:02:20.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.925+0000 7f3399e70700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339406fd60 con 0x7f339406ce60 2019-11-28T12:02:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f3399e70700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3394070030 con 0x7f339406c490 2019-11-28T12:02:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f3398c0e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f339406ce60 0x7f3394164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f3398c0e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f339406ce60 0x7f3394164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48040/0 (socket says 172.21.15.80:48040) 2019-11-28T12:02:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f3398c0e700 1 -- 172.21.15.80:0/3500018143 learned_addr learned my addr 172.21.15.80:0/3500018143 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f338bfff700 1 --2- 172.21.15.80:0/3500018143 >> v2:172.21.15.174:3300/0 conn(0x7f339406c490 0x7f339406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f3398c0e700 1 -- 172.21.15.80:0/3500018143 >> v2:172.21.15.174:3300/0 conn(0x7f339406c490 msgr2=0x7f339406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:20.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f3398c0e700 1 --2- 172.21.15.80:0/3500018143 >> v2:172.21.15.174:3300/0 conn(0x7f339406c490 0x7f339406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:20.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f3398c0e700 1 -- 172.21.15.80:0/3500018143 >> v1:172.21.15.174:6789/0 conn(0x7f339406c0a0 legacy=0x7f3394072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:20.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f3398c0e700 1 -- 172.21.15.80:0/3500018143 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33940706c0 con 0x7f339406ce60 2019-11-28T12:02:20.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f3398c0e700 1 --2- 172.21.15.80:0/3500018143 >> v2:172.21.15.80:3300/0 conn(0x7f339406ce60 0x7f3394164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f338c00fab0 tx=0x7f338c0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:20.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f3398c0e700 1 --2- 172.21.15.80:0/3500018143 >> v2:172.21.15.80:3300/0 conn(0x7f339406ce60 0x7f3394164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f338c00fab0 tx=0x7f338c0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:20.927 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f3398c0e700 1 --2- 172.21.15.80:0/3500018143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f339406ce60 0x7f3394164d70 secure :-1 s=READY pgs=3056 cs=0 l=1 rx=0x7f338c00fab0 tx=0x7f338c0080d0).ready entity=mon.0 client_cookie=c2985142319f9b2c server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:20.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f3398c0e700 1 --2- 172.21.15.80:0/3500018143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f339406ce60 0x7f3394164d70 secure :-1 s=THROTTLE_DONE pgs=3056 cs=0 l=1 rx=0x7f338c00fab0 tx=0x7f338c0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:20.928 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f3398c0e700 1 --2- 172.21.15.80:0/3500018143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f339406ce60 0x7f3394164d70 secure :-1 s=THROTTLE_DONE pgs=3056 cs=0 l=1 rx=0x7f338c00fab0 tx=0x7f338c0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:20.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f33937fe700 1 -- 172.21.15.80:0/3500018143 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f338c001460 con 0x7f339406ce60 2019-11-28T12:02:20.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f3398c0e700 1 --2- 172.21.15.80:0/3500018143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f339406ce60 0x7f3394164d70 secure :-1 s=THROTTLE_DONE pgs=3056 cs=0 l=1 rx=0x7f338c00fab0 tx=0x7f338c0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:20.929 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f33937fe700 1 -- 172.21.15.80:0/3500018143 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c000df0 con 0x7f339406ce60 2019-11-28T12:02:20.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f33937fe700 1 -- 172.21.15.80:0/3500018143 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f338c001a40 con 0x7f339406ce60 2019-11-28T12:02:20.930 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f3399e70700 1 -- 172.21.15.80:0/3500018143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f339406ce60 msgr2=0x7f3394164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:20.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.926+0000 7f3399e70700 1 --2- 172.21.15.80:0/3500018143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f339406ce60 0x7f3394164d70 secure :-1 s=READY pgs=3056 cs=0 l=1 rx=0x7f338c00fab0 tx=0x7f338c0080d0).stop 2019-11-28T12:02:20.931 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.927+0000 7f3399e70700 1 -- 172.21.15.80:0/3500018143 shutdown_connections 2019-11-28T12:02:20.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.927+0000 7f3399e70700 1 --2- 172.21.15.80:0/3500018143 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f339406ce60 0x7f3394164d70 unknown :-1 s=CLOSED pgs=3056 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:20.932 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.927+0000 7f3399e70700 1 --2- 172.21.15.80:0/3500018143 >> v2:172.21.15.174:3300/0 conn(0x7f339406c490 0x7f339406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:20.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.927+0000 7f3399e70700 1 -- 172.21.15.80:0/3500018143 shutdown_connections 2019-11-28T12:02:20.933 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.927+0000 7f3399e70700 1 -- 172.21.15.80:0/3500018143 wait complete. 2019-11-28T12:02:20.934 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.927+0000 7f3399e70700 1 -- 172.21.15.80:0/3500018143 >> 172.21.15.80:0/3500018143 conn(0x7f3394061cf0 msgr2=0x7f3394064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:20.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.930+0000 7f3399e70700 1 Processor -- start 2019-11-28T12:02:20.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.930+0000 7f3399e70700 1 -- start start 2019-11-28T12:02:20.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3399e70700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f339413eb40 0x7f339410afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:20.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3399e70700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f33941631f0 0x7f3394105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:20.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3399e70700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339413f1e0 con 0x7f339410b500 2019-11-28T12:02:20.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3399e70700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33941234c0 con 0x7f33941631f0 2019-11-28T12:02:20.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3399e70700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339413e0d0 con 0x7f339413eb40 2019-11-28T12:02:20.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3398c0e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f33941631f0 0x7f3394105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:20.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3398c0e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f33941631f0 0x7f3394105210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48046/0 (socket says 172.21.15.80:48046) 2019-11-28T12:02:20.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3398c0e700 1 -- 172.21.15.80:0/683583434 learned_addr learned my addr 172.21.15.80:0/683583434 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:20.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3393fff700 1 --2- 172.21.15.80:0/683583434 >> v2:172.21.15.174:3300/0 conn(0x7f339413eb40 0x7f339410afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:20.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3398c0e700 1 -- 172.21.15.80:0/683583434 >> v2:172.21.15.174:3300/0 conn(0x7f339413eb40 msgr2=0x7f339410afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:20.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3398c0e700 1 --2- 172.21.15.80:0/683583434 >> v2:172.21.15.174:3300/0 conn(0x7f339413eb40 0x7f339410afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:20.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3398c0e700 1 -- 172.21.15.80:0/683583434 >> v1:172.21.15.80:6789/0 conn(0x7f339410b500 legacy=0x7f33941629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:20.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f33917fa700 1 -- 172.21.15.80:0/683583434 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646792619 0 0) 0x7f337c0010b0 con 0x7f339410b500 2019-11-28T12:02:20.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3398c0e700 1 -- 172.21.15.80:0/683583434 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3394108700 con 0x7f33941631f0 2019-11-28T12:02:20.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3398c0e700 1 --2- 172.21.15.80:0/683583434 >> v2:172.21.15.80:3300/0 conn(0x7f33941631f0 0x7f3394105210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f338c010770 tx=0x7f338c010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:20.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3398c0e700 1 --2- 172.21.15.80:0/683583434 >> v2:172.21.15.80:3300/0 conn(0x7f33941631f0 0x7f3394105210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f338c010770 tx=0x7f338c010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:20.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3398c0e700 1 --2- 172.21.15.80:0/683583434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33941631f0 0x7f3394105210 secure :-1 s=READY pgs=3058 cs=0 l=1 rx=0x7f338c010770 tx=0x7f338c010b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:20.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3398c0e700 1 --2- 172.21.15.80:0/683583434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33941631f0 0x7f3394105210 secure :-1 s=THROTTLE_DONE pgs=3058 cs=0 l=1 rx=0x7f338c010770 tx=0x7f338c010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:20.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f33917fa700 1 -- 172.21.15.80:0/683583434 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f338c001820 con 0x7f33941631f0 2019-11-28T12:02:20.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3398c0e700 1 --2- 172.21.15.80:0/683583434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33941631f0 0x7f3394105210 secure :-1 s=THROTTLE_DONE pgs=3058 cs=0 l=1 rx=0x7f338c010770 tx=0x7f338c010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:20.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3398c0e700 1 --2- 172.21.15.80:0/683583434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33941631f0 0x7f3394105210 secure :-1 s=THROTTLE_DONE pgs=3058 cs=0 l=1 rx=0x7f338c010770 tx=0x7f338c010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:20.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f33917fa700 1 -- 172.21.15.80:0/683583434 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c001440 con 0x7f33941631f0 2019-11-28T12:02:20.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f33917fa700 1 -- 172.21.15.80:0/683583434 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f338c001630 con 0x7f33941631f0 2019-11-28T12:02:20.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3399e70700 1 -- 172.21.15.80:0/683583434 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3394108a80 con 0x7f33941631f0 2019-11-28T12:02:20.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.931+0000 7f3399e70700 1 -- 172.21.15.80:0/683583434 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3394108700 con 0x7f33941631f0 2019-11-28T12:02:20.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.932+0000 7f3398c0e700 1 --2- 172.21.15.80:0/683583434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33941631f0 0x7f3394105210 secure :-1 s=THROTTLE_DONE pgs=3058 cs=0 l=1 rx=0x7f338c010770 tx=0x7f338c010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:20.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.932+0000 7f33917fa700 1 -- 172.21.15.80:0/683583434 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f338c001630 con 0x7f33941631f0 2019-11-28T12:02:20.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.932+0000 7f3398c0e700 1 --2- 172.21.15.80:0/683583434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33941631f0 0x7f3394105210 secure :-1 s=THROTTLE_DONE pgs=3058 cs=0 l=1 rx=0x7f338c010770 tx=0x7f338c010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:20.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.932+0000 7f33917fa700 1 --2- 172.21.15.80:0/683583434 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3378018730 0x7f337801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:20.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.932+0000 7f33917fa700 1 -- 172.21.15.80:0/683583434 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f338c031e10 con 0x7f33941631f0 2019-11-28T12:02:20.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.932+0000 7f3393fff700 1 --2- 172.21.15.80:0/683583434 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3378018730 0x7f337801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:20.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.932+0000 7f3393fff700 1 --2- 172.21.15.80:0/683583434 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3378018730 0x7f337801abc0 crc :-1 s=READY pgs=1266 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:20.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.940+0000 7f3399e70700 1 -- 172.21.15.80:0/683583434 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3394108a80 con 0x7f33941631f0 2019-11-28T12:02:20.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.943+0000 7f3398c0e700 1 --2- 172.21.15.80:0/683583434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33941631f0 0x7f3394105210 secure :-1 s=THROTTLE_DONE pgs=3058 cs=0 l=1 rx=0x7f338c010770 tx=0x7f338c010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:20.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:20.943+0000 7f33917fa700 1 -- 172.21.15.80:0/683583434 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f338c001230 con 0x7f33941631f0 2019-11-28T12:02:21.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.114+0000 7f3399e70700 1 -- 172.21.15.80:0/683583434 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3394108700 con 0x7f33941631f0 2019-11-28T12:02:21.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.115+0000 7f3398c0e700 1 --2- 172.21.15.80:0/683583434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33941631f0 0x7f3394105210 secure :-1 s=THROTTLE_DONE pgs=3058 cs=0 l=1 rx=0x7f338c010770 tx=0x7f338c010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.115+0000 7f33917fa700 1 -- 172.21.15.80:0/683583434 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 195 v195) v1 ==== 95+0+2457 (secure 0 0 0) 0x7f338c001610 con 0x7f33941631f0 2019-11-28T12:02:21.109 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 195 2019-11-28T12:02:21.109 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:21.109 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":195,"default_fscid":19,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":12028,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/3134286726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":3134286726},{"type":"v1","addr":"172.21.15.80:6835","nonce":3134286726}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":195},{"gid":12840,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/3876746601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3876746601},{"type":"v1","addr":"172.21.15.80:6834","nonce":3876746601}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":195}],"filesystems":[{"mdsmap":{"epoch":194,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:01:41.241732+0000","modified":"2019-11-28T12:01:45.253838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8303":{"gid":8303,"name":"c","rank":0,"incarnation":193,"state":"up:active","state_seq":2,"addr":"172.21.15.174:6835/1019990404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1019990404},{"type":"v1","addr":"172.21.15.174:6835","nonce":1019990404}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[39],"metadata_pool":38,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":19}]} 2019-11-28T12:02:21.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.117+0000 7f3399e70700 1 -- 172.21.15.80:0/683583434 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3378018730 msgr2=0x7f337801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:21.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.117+0000 7f3399e70700 1 --2- 172.21.15.80:0/683583434 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3378018730 0x7f337801abc0 crc :-1 s=READY pgs=1266 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:21.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.117+0000 7f3399e70700 1 -- 172.21.15.80:0/683583434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33941631f0 msgr2=0x7f3394105210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:21.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.117+0000 7f3399e70700 1 --2- 172.21.15.80:0/683583434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33941631f0 0x7f3394105210 secure :-1 s=READY pgs=3058 cs=0 l=1 rx=0x7f338c010770 tx=0x7f338c010b10).stop 2019-11-28T12:02:21.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.117+0000 7f3399e70700 1 -- 172.21.15.80:0/683583434 shutdown_connections 2019-11-28T12:02:21.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.117+0000 7f3399e70700 1 --2- 172.21.15.80:0/683583434 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3378018730 0x7f337801abc0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.117+0000 7f3399e70700 1 --2- 172.21.15.80:0/683583434 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f33941631f0 0x7f3394105210 unknown :-1 s=CLOSED pgs=3058 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.117+0000 7f3399e70700 1 --2- 172.21.15.80:0/683583434 >> v2:172.21.15.174:3300/0 conn(0x7f339413eb40 0x7f339410afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.117+0000 7f3399e70700 1 -- 172.21.15.80:0/683583434 shutdown_connections 2019-11-28T12:02:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.117+0000 7f3399e70700 1 -- 172.21.15.80:0/683583434 wait complete. 2019-11-28T12:02:21.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.117+0000 7f3399e70700 1 -- 172.21.15.80:0/683583434 >> 172.21.15.80:0/683583434 conn(0x7f339411bfc0 msgr2=0x7f3394141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:21.121 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session ls 2019-11-28T12:02:21.249 INFO:teuthology.orchestra.run.smithi174.stdout:[ 2019-11-28T12:02:21.249 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T12:02:21.249 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 12957, 2019-11-28T12:02:21.249 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T12:02:21.249 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T12:02:21.249 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T12:02:21.250 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 12957 2019-11-28T12:02:21.250 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:21.250 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T12:02:21.250 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T12:02:21.251 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.16:0", 2019-11-28T12:02:21.251 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 2235080438 2019-11-28T12:02:21.251 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T12:02:21.251 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:21.251 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T12:02:21.251 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T12:02:21.251 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 501, 2019-11-28T12:02:21.252 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 571, 2019-11-28T12:02:21.252 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 30.958265588, 2019-11-28T12:02:21.252 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T12:02:21.252 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 0, 2019-11-28T12:02:21.252 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T12:02:21.252 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T12:02:21.252 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T12:02:21.253 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T12:02:21.253 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:21.253 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T12:02:21.253 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 497.32120442265108, 2019-11-28T12:02:21.253 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T12:02:21.253 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:21.253 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T12:02:21.254 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T12:02:21.254 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T12:02:21.254 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:21.254 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T12:02:21.255 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T12:02:21.255 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T12:02:21.255 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:21.255 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T12:02:21.255 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 815.23925084646237, 2019-11-28T12:02:21.255 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T12:02:21.255 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:21.256 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.12957 v1:172.21.15.16:0/2235080438", 2019-11-28T12:02:21.256 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [], 2019-11-28T12:02:21.256 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T12:02:21.256 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T12:02:21.256 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T12:02:21.256 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T12:02:21.256 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "1", 2019-11-28T12:02:21.256 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi016", 2019-11-28T12:02:21.257 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T12:02:21.257 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T12:02:21.257 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T12:02:21.257 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:21.257 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T12:02:21.257 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 12097, 2019-11-28T12:02:21.257 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T12:02:21.258 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T12:02:21.258 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T12:02:21.258 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 12097 2019-11-28T12:02:21.258 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:21.258 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T12:02:21.258 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T12:02:21.258 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.76:0", 2019-11-28T12:02:21.259 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 50010668 2019-11-28T12:02:21.259 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T12:02:21.259 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:21.259 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T12:02:21.259 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 500, 2019-11-28T12:02:21.259 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 501, 2019-11-28T12:02:21.259 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 832, 2019-11-28T12:02:21.259 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 33.285210241999998, 2019-11-28T12:02:21.260 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T12:02:21.260 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 1, 2019-11-28T12:02:21.260 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T12:02:21.260 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T12:02:21.260 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T12:02:21.260 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T12:02:21.261 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:21.261 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T12:02:21.261 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T12:02:21.261 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T12:02:21.262 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:21.262 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T12:02:21.262 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T12:02:21.262 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T12:02:21.262 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:21.262 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T12:02:21.262 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T12:02:21.262 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T12:02:21.263 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:21.263 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T12:02:21.263 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 1864.9542431943253, 2019-11-28T12:02:21.263 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T12:02:21.263 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:21.263 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.12097 v1:172.21.15.76:0/50010668", 2019-11-28T12:02:21.263 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [ 2019-11-28T12:02:21.264 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T12:02:21.264 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 1002, 2019-11-28T12:02:21.264 INFO:teuthology.orchestra.run.smithi174.stdout: "created_ino": "0x100000001f3" 2019-11-28T12:02:21.264 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T12:02:21.264 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2019-11-28T12:02:21.264 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [ 2019-11-28T12:02:21.264 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T12:02:21.265 INFO:teuthology.orchestra.run.smithi174.stdout: "start": 1099511628276, 2019-11-28T12:02:21.265 INFO:teuthology.orchestra.run.smithi174.stdout: "length": 501 2019-11-28T12:02:21.265 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T12:02:21.265 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2019-11-28T12:02:21.265 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T12:02:21.265 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T12:02:21.265 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T12:02:21.266 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "0", 2019-11-28T12:02:21.266 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi076.front.sepia.ceph.com", 2019-11-28T12:02:21.266 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T12:02:21.266 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T12:02:21.266 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T12:02:21.266 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T12:02:21.266 INFO:teuthology.orchestra.run.smithi174.stdout:] 2019-11-28T12:02:21.268 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 12957, "entity": { "name": { "type": "client", "num": 12957 }, "addr": { "type": "v1", "addr": "172.21.15.16:0", "nonce": 2235080438 } }, "state": "open", "num_leases": 0, "num_caps": 501, "request_load_avg": 571, "uptime": 30.958265588, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 497.32120442265108, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 815.23925084646237, "halflife": 300 }, "inst": "client.12957 v1:172.21.15.16:0/2235080438", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "1", "hostname": "smithi016", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } }, { "id": 12097, "entity": { "name": { "type": "client", "num": 12097 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 50010668 } }, "state": "open", "num_leases": 500, "num_caps": 501, "request_load_avg": 832, "uptime": 33.285210241999998, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 1864.9542431943253, "halflife": 300 }, "inst": "client.12097 v1:172.21.15.76:0/50010668", "completed_requests": [ { "tid": 1002, "created_ino": "0x100000001f3" } ], "prealloc_inos": [ { "start": 1099511628276, "length": 501 } ], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076.front.sepia.ceph.com", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T12:02:21.269 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T12:02:21.269 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T12:02:21.269 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T12:02:21.269 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T12:02:21.270 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T12:02:21.270 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T12:02:21.276 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T12:02:21.276 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T12:02:21.276 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T12:02:21.277 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T12:02:21.277 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T12:02:21.277 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T12:02:21.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.487+0000 7f10fa4da700 1 Processor -- start 2019-11-28T12:02:21.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.487+0000 7f10fa4da700 1 -- start start 2019-11-28T12:02:21.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7f10fa4da700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f10f406c490 0x7f10f406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:21.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7f10fa4da700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10f406ce60 0x7f10f4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:21.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7f10fa4da700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f406db00 con 0x7f10f406c0a0 2019-11-28T12:02:21.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7f10fa4da700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f406fd60 con 0x7f10f406ce60 2019-11-28T12:02:21.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7f10fa4da700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f4070030 con 0x7f10f406c490 2019-11-28T12:02:21.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7f10f9278700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10f406ce60 0x7f10f4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:21.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7f10f9278700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10f406ce60 0x7f10f4164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48056/0 (socket says 172.21.15.80:48056) 2019-11-28T12:02:21.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7f10f9278700 1 -- 172.21.15.80:0/2274442953 learned_addr learned my addr 172.21.15.80:0/2274442953 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:21.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f10f3fff700 1 --2- 172.21.15.80:0/2274442953 >> v2:172.21.15.174:3300/0 conn(0x7f10f406c490 0x7f10f406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:21.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f10f9278700 1 -- 172.21.15.80:0/2274442953 >> v2:172.21.15.174:3300/0 conn(0x7f10f406c490 msgr2=0x7f10f406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:21.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f10f9278700 1 --2- 172.21.15.80:0/2274442953 >> v2:172.21.15.174:3300/0 conn(0x7f10f406c490 0x7f10f406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:21.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f10f9278700 1 -- 172.21.15.80:0/2274442953 >> v1:172.21.15.80:6789/0 conn(0x7f10f406c0a0 legacy=0x7f10f4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:21.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f10f9278700 1 -- 172.21.15.80:0/2274442953 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f40706c0 con 0x7f10f406ce60 2019-11-28T12:02:21.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f10f9278700 1 --2- 172.21.15.80:0/2274442953 >> v2:172.21.15.80:3300/0 conn(0x7f10f406ce60 0x7f10f4164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f10ec00fab0 tx=0x7f10ec0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f10f9278700 1 --2- 172.21.15.80:0/2274442953 >> v2:172.21.15.80:3300/0 conn(0x7f10f406ce60 0x7f10f4164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f10ec00fab0 tx=0x7f10ec0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f10f9278700 1 --2- 172.21.15.80:0/2274442953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10f406ce60 0x7f10f4164d70 secure :-1 s=READY pgs=3061 cs=0 l=1 rx=0x7f10ec00fab0 tx=0x7f10ec0080d0).ready entity=mon.0 client_cookie=77eccd80d7de09 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:21.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f10f9278700 1 --2- 172.21.15.80:0/2274442953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10f406ce60 0x7f10f4164d70 secure :-1 s=THROTTLE_DONE pgs=3061 cs=0 l=1 rx=0x7f10ec00fab0 tx=0x7f10ec0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f10f9278700 1 --2- 172.21.15.80:0/2274442953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10f406ce60 0x7f10f4164d70 secure :-1 s=THROTTLE_DONE pgs=3061 cs=0 l=1 rx=0x7f10ec00fab0 tx=0x7f10ec0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f10f37fe700 1 -- 172.21.15.80:0/2274442953 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10ec000df0 con 0x7f10f406ce60 2019-11-28T12:02:21.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f10f9278700 1 --2- 172.21.15.80:0/2274442953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10f406ce60 0x7f10f4164d70 secure :-1 s=THROTTLE_DONE pgs=3061 cs=0 l=1 rx=0x7f10ec00fab0 tx=0x7f10ec0080d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f10f37fe700 1 -- 172.21.15.80:0/2274442953 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec001460 con 0x7f10f406ce60 2019-11-28T12:02:21.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f10f37fe700 1 -- 172.21.15.80:0/2274442953 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10ec001b30 con 0x7f10f406ce60 2019-11-28T12:02:21.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f10fa4da700 1 -- 172.21.15.80:0/2274442953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10f406ce60 msgr2=0x7f10f4164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:21.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f10fa4da700 1 --2- 172.21.15.80:0/2274442953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10f406ce60 0x7f10f4164d70 secure :-1 s=READY pgs=3061 cs=0 l=1 rx=0x7f10ec00fab0 tx=0x7f10ec0080d0).stop 2019-11-28T12:02:21.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7f10fa4da700 1 -- 172.21.15.80:0/2274442953 shutdown_connections 2019-11-28T12:02:21.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7f10fa4da700 1 --2- 172.21.15.80:0/2274442953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10f406ce60 0x7f10f4164d70 unknown :-1 s=CLOSED pgs=3061 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:21.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7f10fa4da700 1 --2- 172.21.15.80:0/2274442953 >> v2:172.21.15.174:3300/0 conn(0x7f10f406c490 0x7f10f406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:21.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7f10fa4da700 1 -- 172.21.15.80:0/2274442953 shutdown_connections 2019-11-28T12:02:21.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7f10fa4da700 1 -- 172.21.15.80:0/2274442953 wait complete. 2019-11-28T12:02:21.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7f10fa4da700 1 -- 172.21.15.80:0/2274442953 >> 172.21.15.80:0/2274442953 conn(0x7f10f4061cf0 msgr2=0x7f10f4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:21.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.493+0000 7f10fa4da700 1 Processor -- start 2019-11-28T12:02:21.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.493+0000 7f10fa4da700 1 -- start start 2019-11-28T12:02:21.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f10fa4da700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10f413dc00 0x7f10f4109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:21.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f10fa4da700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10f410a3a0 0x7f10f4108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:21.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f10fa4da700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f41312c0 con 0x7f10f4109220 2019-11-28T12:02:21.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f10fa4da700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f4105830 con 0x7f10f413dc00 2019-11-28T12:02:21.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f10fa4da700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f4105b00 con 0x7f10f410a3a0 2019-11-28T12:02:21.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f10f8a77700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10f413dc00 0x7f10f4109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:21.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f10f8a77700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f10f413dc00 0x7f10f4109e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48072/0 (socket says 172.21.15.80:48072) 2019-11-28T12:02:21.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f10f8a77700 1 -- 172.21.15.80:0/3730851919 learned_addr learned my addr 172.21.15.80:0/3730851919 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:21.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f10f3fff700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10f410a3a0 0x7f10f4108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:21.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f10f3fff700 1 -- 172.21.15.80:0/3730851919 >> v2:172.21.15.80:3300/0 conn(0x7f10f413dc00 msgr2=0x7f10f4109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:21.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f10f3fff700 1 --2- 172.21.15.80:0/3730851919 >> v2:172.21.15.80:3300/0 conn(0x7f10f413dc00 0x7f10f4109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:21.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f10f3fff700 1 -- 172.21.15.80:0/3730851919 >> v1:172.21.15.80:6789/0 conn(0x7f10f4109220 legacy=0x7f10f4103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:21.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f10f3fff700 1 -- 172.21.15.80:0/3730851919 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f4106190 con 0x7f10f410a3a0 2019-11-28T12:02:21.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f10f3fff700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10f410a3a0 0x7f10f4108ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10dc010310 tx=0x7f10dc0106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f10f3fff700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10f410a3a0 0x7f10f4108ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10dc010310 tx=0x7f10dc0106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f10f3fff700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10f410a3a0 0x7f10f4108ce0 secure :-1 s=READY pgs=442 cs=0 l=1 rx=0x7f10dc010310 tx=0x7f10dc0106b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:21.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f10f3fff700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10f410a3a0 0x7f10f4108ce0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f10dc010310 tx=0x7f10dc0106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f10f3fff700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10f410a3a0 0x7f10f4108ce0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f10dc010310 tx=0x7f10dc0106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f10f3fff700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10f410a3a0 0x7f10f4108ce0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f10dc010310 tx=0x7f10dc0106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f10f17fa700 1 -- 172.21.15.80:0/3730851919 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10dc0095f0 con 0x7f10f410a3a0 2019-11-28T12:02:21.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f10f17fa700 1 -- 172.21.15.80:0/3730851919 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc009c60 con 0x7f10f410a3a0 2019-11-28T12:02:21.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f10fa4da700 1 -- 172.21.15.80:0/3730851919 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f4106510 con 0x7f10f410a3a0 2019-11-28T12:02:21.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f10fa4da700 1 -- 172.21.15.80:0/3730851919 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f4106190 con 0x7f10f410a3a0 2019-11-28T12:02:21.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f10f17fa700 1 -- 172.21.15.80:0/3730851919 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10dc00a2f0 con 0x7f10f410a3a0 2019-11-28T12:02:21.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f10f3fff700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10f410a3a0 0x7f10f4108ce0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f10dc010310 tx=0x7f10dc0106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.496+0000 7f10f17fa700 1 -- 172.21.15.80:0/3730851919 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f10dc009e50 con 0x7f10f410a3a0 2019-11-28T12:02:21.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.496+0000 7f10f3fff700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10f410a3a0 0x7f10f4108ce0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f10dc010310 tx=0x7f10dc0106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.504 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.496+0000 7f10f17fa700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10d8018730 0x7f10d801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:21.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.496+0000 7f10f17fa700 1 -- 172.21.15.80:0/3730851919 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f10dc033e00 con 0x7f10f410a3a0 2019-11-28T12:02:21.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.496+0000 7f10f8a77700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10d8018730 0x7f10d801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:21.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.496+0000 7f10f8a77700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10d8018730 0x7f10d801abe0 crc :-1 s=READY pgs=1267 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:21.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.487+0000 7f9478165700 1 Processor -- start 2019-11-28T12:02:21.505 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.487+0000 7f9478165700 1 -- start start 2019-11-28T12:02:21.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7f9478165700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f947006c0a0 0x7f9470072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:21.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7f9478165700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9470072620 0x7f9470164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:21.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7f9478165700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947006db00 con 0x7f94700734e0 2019-11-28T12:02:21.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7f9478165700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947006fd60 con 0x7f947006c0a0 2019-11-28T12:02:21.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7f9478165700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9470070030 con 0x7f9470072620 2019-11-28T12:02:21.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7f9475f01700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f94700734e0 0x7f9470071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47370/0 (socket says 172.21.15.80:47370) 2019-11-28T12:02:21.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7f9475f01700 1 -- 172.21.15.80:0/1667701075 learned_addr learned my addr 172.21.15.80:0/1667701075 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:21.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7f9476702700 1 --2- 172.21.15.80:0/1667701075 >> v2:172.21.15.80:3300/0 conn(0x7f947006c0a0 0x7f9470072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:21.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9476f03700 1 --2- 172.21.15.80:0/1667701075 >> v2:172.21.15.174:3300/0 conn(0x7f9470072620 0x7f9470164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:21.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9475700700 1 -- 172.21.15.80:0/1667701075 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925366934 0 0) 0x7f94640014d0 con 0x7f94700734e0 2019-11-28T12:02:21.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9476f03700 1 -- 172.21.15.80:0/1667701075 >> v2:172.21.15.80:3300/0 conn(0x7f947006c0a0 msgr2=0x7f9470072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:21.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9476f03700 1 --2- 172.21.15.80:0/1667701075 >> v2:172.21.15.80:3300/0 conn(0x7f947006c0a0 0x7f9470072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:21.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9476f03700 1 -- 172.21.15.80:0/1667701075 >> v1:172.21.15.80:6789/0 conn(0x7f94700734e0 legacy=0x7f9470071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:21.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9476f03700 1 -- 172.21.15.80:0/1667701075 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94700706c0 con 0x7f9470072620 2019-11-28T12:02:21.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9476702700 1 --2- 172.21.15.80:0/1667701075 >> v2:172.21.15.80:3300/0 conn(0x7f947006c0a0 0x7f9470072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:21.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9476f03700 1 --2- 172.21.15.80:0/1667701075 >> v2:172.21.15.174:3300/0 conn(0x7f9470072620 0x7f9470164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f946000af80 tx=0x7f946000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9476f03700 1 --2- 172.21.15.80:0/1667701075 >> v2:172.21.15.174:3300/0 conn(0x7f9470072620 0x7f9470164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f946000af80 tx=0x7f946000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9476f03700 1 --2- 172.21.15.80:0/1667701075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9470072620 0x7f9470164d70 secure :-1 s=READY pgs=1851 cs=0 l=1 rx=0x7f946000af80 tx=0x7f946000b790).ready entity=mon.1 client_cookie=2d71f3167255bba server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:21.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9476f03700 1 --2- 172.21.15.80:0/1667701075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9470072620 0x7f9470164d70 secure :-1 s=THROTTLE_DONE pgs=1851 cs=0 l=1 rx=0x7f946000af80 tx=0x7f946000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9475700700 1 -- 172.21.15.80:0/1667701075 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9460000bc0 con 0x7f9470072620 2019-11-28T12:02:21.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9476f03700 1 --2- 172.21.15.80:0/1667701075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9470072620 0x7f9470164d70 secure :-1 s=THROTTLE_DONE pgs=1851 cs=0 l=1 rx=0x7f946000af80 tx=0x7f946000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9476f03700 1 --2- 172.21.15.80:0/1667701075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9470072620 0x7f9470164d70 secure :-1 s=THROTTLE_DONE pgs=1851 cs=0 l=1 rx=0x7f946000af80 tx=0x7f946000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9475700700 1 -- 172.21.15.80:0/1667701075 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94600097f0 con 0x7f9470072620 2019-11-28T12:02:21.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9475700700 1 -- 172.21.15.80:0/1667701075 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9460009ec0 con 0x7f9470072620 2019-11-28T12:02:21.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9478165700 1 -- 172.21.15.80:0/1667701075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9470072620 msgr2=0x7f9470164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:21.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7f9478165700 1 --2- 172.21.15.80:0/1667701075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9470072620 0x7f9470164d70 secure :-1 s=READY pgs=1851 cs=0 l=1 rx=0x7f946000af80 tx=0x7f946000b790).stop 2019-11-28T12:02:21.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7f9478165700 1 -- 172.21.15.80:0/1667701075 shutdown_connections 2019-11-28T12:02:21.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7f9478165700 1 --2- 172.21.15.80:0/1667701075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9470072620 0x7f9470164d70 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:21.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7f9478165700 1 --2- 172.21.15.80:0/1667701075 >> v2:172.21.15.80:3300/0 conn(0x7f947006c0a0 0x7f9470072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:21.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7f9478165700 1 -- 172.21.15.80:0/1667701075 shutdown_connections 2019-11-28T12:02:21.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7f9478165700 1 -- 172.21.15.80:0/1667701075 wait complete. 2019-11-28T12:02:21.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7f9478165700 1 -- 172.21.15.80:0/1667701075 >> 172.21.15.80:0/1667701075 conn(0x7f9470061cf0 msgr2=0x7f9470064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:21.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.493+0000 7f9478165700 1 Processor -- start 2019-11-28T12:02:21.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.493+0000 7f9478165700 1 -- start start 2019-11-28T12:02:21.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f9478165700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f94701655f0 0x7f9470140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:21.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f9478165700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9470140960 0x7f9470152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:21.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f9478165700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947011a500 con 0x7f9470165200 2019-11-28T12:02:21.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f9478165700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9470118460 con 0x7f9470140960 2019-11-28T12:02:21.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f9478165700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9470118730 con 0x7f94701655f0 2019-11-28T12:02:21.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f9476f03700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9470140960 0x7f9470152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:21.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f9476702700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f9470165200 0x7f9470153e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:34696/0 (socket says 172.21.15.80:34696) 2019-11-28T12:02:21.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f9476702700 1 -- 172.21.15.80:0/1693762726 learned_addr learned my addr 172.21.15.80:0/1693762726 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:21.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f9475f01700 1 --2- 172.21.15.80:0/1693762726 >> v2:172.21.15.174:3300/0 conn(0x7f94701655f0 0x7f9470140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:21.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f946effd700 1 -- 172.21.15.80:0/1693762726 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003781744 0 0) 0x7f946800db80 con 0x7f9470165200 2019-11-28T12:02:21.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7f946effd700 1 -- 172.21.15.80:0/1693762726 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9450002e80 con 0x7f9470165200 2019-11-28T12:02:21.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f9476f03700 1 -- 172.21.15.80:0/1693762726 >> v2:172.21.15.174:3300/0 conn(0x7f94701655f0 msgr2=0x7f9470140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:21.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f9476f03700 1 --2- 172.21.15.80:0/1693762726 >> v2:172.21.15.174:3300/0 conn(0x7f94701655f0 0x7f9470140420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:21.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f9476f03700 1 -- 172.21.15.80:0/1693762726 >> v1:172.21.15.174:6789/0 conn(0x7f9470165200 legacy=0x7f9470153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:21.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f9476f03700 1 -- 172.21.15.80:0/1693762726 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9470118dc0 con 0x7f9470140960 2019-11-28T12:02:21.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f9476f03700 1 --2- 172.21.15.80:0/1693762726 >> v2:172.21.15.80:3300/0 conn(0x7f9470140960 0x7f9470152ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9460054390 tx=0x7f9460054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f9476f03700 1 --2- 172.21.15.80:0/1693762726 >> v2:172.21.15.80:3300/0 conn(0x7f9470140960 0x7f9470152ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9460054390 tx=0x7f9460054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f9476f03700 1 --2- 172.21.15.80:0/1693762726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9470140960 0x7f9470152ec0 secure :-1 s=READY pgs=3064 cs=0 l=1 rx=0x7f9460054390 tx=0x7f9460054730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:21.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f9476f03700 1 --2- 172.21.15.80:0/1693762726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9470140960 0x7f9470152ec0 secure :-1 s=THROTTLE_DONE pgs=3064 cs=0 l=1 rx=0x7f9460054390 tx=0x7f9460054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f946effd700 1 -- 172.21.15.80:0/1693762726 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9460009a30 con 0x7f9470140960 2019-11-28T12:02:21.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f9476f03700 1 --2- 172.21.15.80:0/1693762726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9470140960 0x7f9470152ec0 secure :-1 s=THROTTLE_DONE pgs=3064 cs=0 l=1 rx=0x7f9460054390 tx=0x7f9460054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f946effd700 1 -- 172.21.15.80:0/1693762726 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94600095b0 con 0x7f9470140960 2019-11-28T12:02:21.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f9476f03700 1 --2- 172.21.15.80:0/1693762726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9470140960 0x7f9470152ec0 secure :-1 s=THROTTLE_DONE pgs=3064 cs=0 l=1 rx=0x7f9460054390 tx=0x7f9460054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f946effd700 1 -- 172.21.15.80:0/1693762726 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94600097a0 con 0x7f9470140960 2019-11-28T12:02:21.514 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f9478165700 1 -- 172.21.15.80:0/1693762726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9470119140 con 0x7f9470140960 2019-11-28T12:02:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7f9478165700 1 -- 172.21.15.80:0/1693762726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9470118dc0 con 0x7f9470140960 2019-11-28T12:02:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.496+0000 7f9476f03700 1 --2- 172.21.15.80:0/1693762726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9470140960 0x7f9470152ec0 secure :-1 s=THROTTLE_DONE pgs=3064 cs=0 l=1 rx=0x7f9460054390 tx=0x7f9460054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.496+0000 7f946effd700 1 -- 172.21.15.80:0/1693762726 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f9460009840 con 0x7f9470140960 2019-11-28T12:02:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.496+0000 7f9476f03700 1 --2- 172.21.15.80:0/1693762726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9470140960 0x7f9470152ec0 secure :-1 s=THROTTLE_DONE pgs=3064 cs=0 l=1 rx=0x7f9460054390 tx=0x7f9460054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.496+0000 7f946effd700 1 --2- 172.21.15.80:0/1693762726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9450018770 0x7f945001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:21.515 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.496+0000 7f946effd700 1 -- 172.21.15.80:0/1693762726 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f9460075a10 con 0x7f9470140960 2019-11-28T12:02:21.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.496+0000 7f9476702700 1 --2- 172.21.15.80:0/1693762726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9450018770 0x7f945001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:21.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.497+0000 7f9476702700 1 --2- 172.21.15.80:0/1693762726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9450018770 0x7f945001abe0 crc :-1 s=READY pgs=1268 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:21.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.487+0000 7fcb8aa76700 1 Processor -- start 2019-11-28T12:02:21.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.487+0000 7fcb8aa76700 1 -- start start 2019-11-28T12:02:21.516 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7fcb8aa76700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb8406c0a0 0x7fcb84072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:21.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7fcb8aa76700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcb84072620 0x7fcb84164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:21.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7fcb8aa76700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8406db00 con 0x7fcb840734e0 2019-11-28T12:02:21.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7fcb8aa76700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8406f330 con 0x7fcb84072620 2019-11-28T12:02:21.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7fcb8aa76700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb840706c0 con 0x7fcb8406c0a0 2019-11-28T12:02:21.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.488+0000 7fcb89814700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcb84072620 0x7fcb84164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:21.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7fcb89814700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcb84072620 0x7fcb84164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48066/0 (socket says 172.21.15.80:48066) 2019-11-28T12:02:21.517 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7fcb89814700 1 -- 172.21.15.80:0/654849849 learned_addr learned my addr 172.21.15.80:0/654849849 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:21.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7fcb89013700 1 --2- 172.21.15.80:0/654849849 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb8406c0a0 0x7fcb84072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:21.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7fcb89013700 1 -- 172.21.15.80:0/654849849 >> v2:172.21.15.80:3300/0 conn(0x7fcb84072620 msgr2=0x7fcb84164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:21.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7fcb89013700 1 --2- 172.21.15.80:0/654849849 >> v2:172.21.15.80:3300/0 conn(0x7fcb84072620 0x7fcb84164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:21.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7fcb89013700 1 -- 172.21.15.80:0/654849849 >> v1:172.21.15.174:6789/0 conn(0x7fcb840734e0 legacy=0x7fcb84071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:21.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7fcb89013700 1 -- 172.21.15.80:0/654849849 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb84070a40 con 0x7fcb8406c0a0 2019-11-28T12:02:21.518 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7fcb89013700 1 --2- 172.21.15.80:0/654849849 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb8406c0a0 0x7fcb84072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcb7800af50 tx=0x7fcb7800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7fcb89013700 1 --2- 172.21.15.80:0/654849849 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb8406c0a0 0x7fcb84072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcb7800af50 tx=0x7fcb7800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7fcb89013700 1 --2- 172.21.15.80:0/654849849 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb8406c0a0 0x7fcb84072fa0 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7fcb7800af50 tx=0x7fcb7800b6e0).ready entity=mon.2 client_cookie=4417ed1ced416c2e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:21.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7fcb89013700 1 --2- 172.21.15.80:0/654849849 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb8406c0a0 0x7fcb84072fa0 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7fcb7800af50 tx=0x7fcb7800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7fcb89013700 1 --2- 172.21.15.80:0/654849849 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb8406c0a0 0x7fcb84072fa0 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7fcb7800af50 tx=0x7fcb7800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7fcb77fff700 1 -- 172.21.15.80:0/654849849 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb78007210 con 0x7fcb8406c0a0 2019-11-28T12:02:21.519 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7fcb89013700 1 --2- 172.21.15.80:0/654849849 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb8406c0a0 0x7fcb84072fa0 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7fcb7800af50 tx=0x7fcb7800b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.489+0000 7fcb77fff700 1 -- 172.21.15.80:0/654849849 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb780099b0 con 0x7fcb8406c0a0 2019-11-28T12:02:21.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7fcb77fff700 1 -- 172.21.15.80:0/654849849 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb7800a080 con 0x7fcb8406c0a0 2019-11-28T12:02:21.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7fcb8aa76700 1 -- 172.21.15.80:0/654849849 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb8406c0a0 msgr2=0x7fcb84072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:21.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7fcb8aa76700 1 --2- 172.21.15.80:0/654849849 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb8406c0a0 0x7fcb84072fa0 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7fcb7800af50 tx=0x7fcb7800b6e0).stop 2019-11-28T12:02:21.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7fcb8aa76700 1 -- 172.21.15.80:0/654849849 shutdown_connections 2019-11-28T12:02:21.520 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7fcb8aa76700 1 --2- 172.21.15.80:0/654849849 >> v2:172.21.15.80:3300/0 conn(0x7fcb84072620 0x7fcb84164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:21.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.490+0000 7fcb8aa76700 1 --2- 172.21.15.80:0/654849849 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb8406c0a0 0x7fcb84072fa0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:21.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.491+0000 7fcb8aa76700 1 -- 172.21.15.80:0/654849849 shutdown_connections 2019-11-28T12:02:21.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.491+0000 7fcb8aa76700 1 -- 172.21.15.80:0/654849849 wait complete. 2019-11-28T12:02:21.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.491+0000 7fcb8aa76700 1 -- 172.21.15.80:0/654849849 >> 172.21.15.80:0/654849849 conn(0x7fcb84061cf0 msgr2=0x7fcb84064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:21.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.493+0000 7fcb8aa76700 1 Processor -- start 2019-11-28T12:02:21.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.493+0000 7fcb8aa76700 1 -- start start 2019-11-28T12:02:21.521 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7fcb8aa76700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcb8413e9e0 0x7fcb84108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:21.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7fcb8aa76700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb841066e0 con 0x7fcb84109430 2019-11-28T12:02:21.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7fcb8aa76700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8410ce40 con 0x7fcb8413e5f0 2019-11-28T12:02:21.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7fcb8aa76700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8410e060 con 0x7fcb8413e9e0 2019-11-28T12:02:21.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7fcb88812700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcb8413e9e0 0x7fcb84108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:21.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7fcb88812700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcb8413e9e0 0x7fcb84108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:34732/0 (socket says 172.21.15.80:34732) 2019-11-28T12:02:21.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.494+0000 7fcb88812700 1 -- 172.21.15.80:0/3980954953 learned_addr learned my addr 172.21.15.80:0/3980954953 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:21.522 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7fcb88812700 1 -- 172.21.15.80:0/3980954953 >> v1:172.21.15.174:6789/0 conn(0x7fcb8413e5f0 legacy=0x7fcb8410a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:21.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7fcb88812700 1 -- 172.21.15.80:0/3980954953 >> v1:172.21.15.80:6789/0 conn(0x7fcb84109430 legacy=0x7fcb84168ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:21.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7fcb75ffb700 1 -- 172.21.15.80:0/3980954953 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480224452 0 0) 0x7fcb7800ae10 con 0x7fcb8413e5f0 2019-11-28T12:02:21.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7fcb88812700 1 -- 172.21.15.80:0/3980954953 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8410e9c0 con 0x7fcb8413e9e0 2019-11-28T12:02:21.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7fcb88812700 1 --2- 172.21.15.80:0/3980954953 >> v2:172.21.15.174:3300/0 conn(0x7fcb8413e9e0 0x7fcb84108ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcb80010410 tx=0x7fcb800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7fcb88812700 1 --2- 172.21.15.80:0/3980954953 >> v2:172.21.15.174:3300/0 conn(0x7fcb8413e9e0 0x7fcb84108ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcb80010410 tx=0x7fcb800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7fcb88812700 1 --2- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb8413e9e0 0x7fcb84108ef0 secure :-1 s=READY pgs=1854 cs=0 l=1 rx=0x7fcb80010410 tx=0x7fcb800107b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:21.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7fcb88812700 1 --2- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb8413e9e0 0x7fcb84108ef0 secure :-1 s=THROTTLE_DONE pgs=1854 cs=0 l=1 rx=0x7fcb80010410 tx=0x7fcb800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7fcb88812700 1 --2- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb8413e9e0 0x7fcb84108ef0 secure :-1 s=THROTTLE_DONE pgs=1854 cs=0 l=1 rx=0x7fcb80010410 tx=0x7fcb800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7fcb88812700 1 --2- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb8413e9e0 0x7fcb84108ef0 secure :-1 s=THROTTLE_DONE pgs=1854 cs=0 l=1 rx=0x7fcb80010410 tx=0x7fcb800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7fcb75ffb700 1 -- 172.21.15.80:0/3980954953 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb80005720 con 0x7fcb8413e9e0 2019-11-28T12:02:21.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7fcb75ffb700 1 -- 172.21.15.80:0/3980954953 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb80005340 con 0x7fcb8413e9e0 2019-11-28T12:02:21.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7fcb75ffb700 1 -- 172.21.15.80:0/3980954953 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb80005e80 con 0x7fcb8413e9e0 2019-11-28T12:02:21.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7fcb8aa76700 1 -- 172.21.15.80:0/3980954953 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8410ed40 con 0x7fcb8413e9e0 2019-11-28T12:02:21.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.495+0000 7fcb8aa76700 1 -- 172.21.15.80:0/3980954953 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8410e9c0 con 0x7fcb8413e9e0 2019-11-28T12:02:21.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.497+0000 7fcb88812700 1 --2- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb8413e9e0 0x7fcb84108ef0 secure :-1 s=THROTTLE_DONE pgs=1854 cs=0 l=1 rx=0x7fcb80010410 tx=0x7fcb800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.497+0000 7fcb75ffb700 1 -- 172.21.15.80:0/3980954953 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fcb80005550 con 0x7fcb8413e9e0 2019-11-28T12:02:21.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.497+0000 7fcb88812700 1 --2- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb8413e9e0 0x7fcb84108ef0 secure :-1 s=THROTTLE_DONE pgs=1854 cs=0 l=1 rx=0x7fcb80010410 tx=0x7fcb800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.497+0000 7fcb75ffb700 1 --2- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb64018730 0x7fcb6401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:21.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.497+0000 7fcb75ffb700 1 -- 172.21.15.80:0/3980954953 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fcb80031af0 con 0x7fcb8413e9e0 2019-11-28T12:02:21.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.497+0000 7fcb89013700 1 --2- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb64018730 0x7fcb6401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:21.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.497+0000 7fcb89013700 1 --2- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb64018730 0x7fcb6401abc0 crc :-1 s=READY pgs=1269 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:21.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.503+0000 7f9478165700 1 -- 172.21.15.80:0/1693762726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9470119140 con 0x7f9470140960 2019-11-28T12:02:21.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.506+0000 7f9476f03700 1 --2- 172.21.15.80:0/1693762726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9470140960 0x7f9470152ec0 secure :-1 s=THROTTLE_DONE pgs=3064 cs=0 l=1 rx=0x7f9460054390 tx=0x7f9460054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.506+0000 7f946effd700 1 -- 172.21.15.80:0/1693762726 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f946000abe0 con 0x7f9470140960 2019-11-28T12:02:21.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.503+0000 7fcb8aa76700 1 -- 172.21.15.80:0/3980954953 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8410ed40 con 0x7fcb8413e9e0 2019-11-28T12:02:21.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.507+0000 7fcb88812700 1 --2- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb8413e9e0 0x7fcb84108ef0 secure :-1 s=THROTTLE_DONE pgs=1854 cs=0 l=1 rx=0x7fcb80010410 tx=0x7fcb800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.507+0000 7fcb75ffb700 1 -- 172.21.15.80:0/3980954953 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fcb80005340 con 0x7fcb8413e9e0 2019-11-28T12:02:21.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.503+0000 7f10fa4da700 1 -- 172.21.15.80:0/3730851919 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc002e60 con 0x7f10f410a3a0 2019-11-28T12:02:21.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.507+0000 7f10f3fff700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10f410a3a0 0x7f10f4108ce0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f10dc010310 tx=0x7f10dc0106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:21.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.507+0000 7f10f17fa700 1 -- 172.21.15.80:0/3730851919 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f10dc009820 con 0x7f10f410a3a0 2019-11-28T12:02:21.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.694+0000 7f9478165700 1 -- 172.21.15.80:0/1693762726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f9470118dc0 con 0x7f9470140960 2019-11-28T12:02:21.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.697+0000 7fcb8aa76700 1 -- 172.21.15.80:0/3980954953 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fcb8410e9c0 con 0x7fcb8413e9e0 2019-11-28T12:02:21.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:21.697+0000 7f10fa4da700 1 -- 172.21.15.80:0/3730851919 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f10cc001d10 con 0x7f10f410a3a0 2019-11-28T12:02:22.603 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T12:02:22.610+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T12:02:22.608 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.615+0000 7f9476f03700 1 --2- 172.21.15.80:0/1693762726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9470140960 0x7f9470152ec0 secure :-1 s=THROTTLE_DONE pgs=3064 cs=0 l=1 rx=0x7f9460054390 tx=0x7f9460054730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:22.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.615+0000 7f946effd700 1 -- 172.21.15.80:0/1693762726 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 8303 v196) v1 ==== 95+0+0 (secure 0 0 0) 0x7f946005b140 con 0x7f9470140960 2019-11-28T12:02:22.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.615+0000 7fcb88812700 1 --2- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb8413e9e0 0x7fcb84108ef0 secure :-1 s=THROTTLE_DONE pgs=1854 cs=0 l=1 rx=0x7fcb80010410 tx=0x7fcb800107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:22.609 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.615+0000 7fcb75ffb700 1 -- 172.21.15.80:0/3980954953 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 12028 v196) v1 ==== 96+0+0 (secure 0 0 0) 0x7fcb80005550 con 0x7fcb8413e9e0 2019-11-28T12:02:22.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.618+0000 7f10f3fff700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10f410a3a0 0x7f10f4108ce0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f10dc010310 tx=0x7f10dc0106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:22.611 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.618+0000 7f10f17fa700 1 -- 172.21.15.80:0/3730851919 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 12840 v196) v1 ==== 96+0+0 (secure 0 0 0) 0x7f10dc009c60 con 0x7f10f410a3a0 2019-11-28T12:02:22.653 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 8303 2019-11-28T12:02:22.655 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 12028 2019-11-28T12:02:22.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.662+0000 7f9478165700 1 -- 172.21.15.80:0/1693762726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9450018770 msgr2=0x7f945001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:22.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.662+0000 7f9478165700 1 --2- 172.21.15.80:0/1693762726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9450018770 0x7f945001abe0 crc :-1 s=READY pgs=1268 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:22.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.662+0000 7f9478165700 1 -- 172.21.15.80:0/1693762726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9470140960 msgr2=0x7f9470152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:22.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.662+0000 7f9478165700 1 --2- 172.21.15.80:0/1693762726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9470140960 0x7f9470152ec0 secure :-1 s=READY pgs=3064 cs=0 l=1 rx=0x7f9460054390 tx=0x7f9460054730).stop 2019-11-28T12:02:22.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.662+0000 7f9478165700 1 -- 172.21.15.80:0/1693762726 shutdown_connections 2019-11-28T12:02:22.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.662+0000 7f9478165700 1 --2- 172.21.15.80:0/1693762726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9470140960 0x7f9470152ec0 unknown :-1 s=CLOSED pgs=3064 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:22.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.662+0000 7f9478165700 1 --2- 172.21.15.80:0/1693762726 >> v2:172.21.15.174:3300/0 conn(0x7f94701655f0 0x7f9470140420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:22.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.662+0000 7f9478165700 1 --2- 172.21.15.80:0/1693762726 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f9450018770 0x7f945001abe0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:22.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.662+0000 7f9478165700 1 -- 172.21.15.80:0/1693762726 shutdown_connections 2019-11-28T12:02:22.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.662+0000 7f9478165700 1 -- 172.21.15.80:0/1693762726 wait complete. 2019-11-28T12:02:22.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.662+0000 7f9478165700 1 -- 172.21.15.80:0/1693762726 >> 172.21.15.80:0/1693762726 conn(0x7f9470141f40 msgr2=0x7f947014fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:22.658 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 12840 2019-11-28T12:02:22.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.664+0000 7fcb8aa76700 1 -- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb64018730 msgr2=0x7fcb6401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:22.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.664+0000 7fcb8aa76700 1 --2- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb64018730 0x7fcb6401abc0 crc :-1 s=READY pgs=1269 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:22.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.664+0000 7fcb8aa76700 1 -- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb8413e9e0 msgr2=0x7fcb84108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:22.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.664+0000 7fcb8aa76700 1 --2- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb8413e9e0 0x7fcb84108ef0 secure :-1 s=READY pgs=1854 cs=0 l=1 rx=0x7fcb80010410 tx=0x7fcb800107b0).stop 2019-11-28T12:02:22.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.665+0000 7fcb8aa76700 1 -- 172.21.15.80:0/3980954953 shutdown_connections 2019-11-28T12:02:22.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.665+0000 7fcb8aa76700 1 --2- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb8413e9e0 0x7fcb84108ef0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:22.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.665+0000 7fcb8aa76700 1 --2- 172.21.15.80:0/3980954953 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fcb64018730 0x7fcb6401abc0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:22.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.665+0000 7fcb8aa76700 1 -- 172.21.15.80:0/3980954953 shutdown_connections 2019-11-28T12:02:22.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.665+0000 7fcb8aa76700 1 -- 172.21.15.80:0/3980954953 wait complete. 2019-11-28T12:02:22.661 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.665+0000 7fcb8aa76700 1 -- 172.21.15.80:0/3980954953 >> 172.21.15.80:0/3980954953 conn(0x7fcb8413d620 msgr2=0x7fcb8413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:22.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.665+0000 7f10fa4da700 1 -- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10d8018730 msgr2=0x7f10d801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:22.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.665+0000 7f10fa4da700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10d8018730 0x7f10d801abe0 crc :-1 s=READY pgs=1267 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:22.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.665+0000 7f10fa4da700 1 -- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10f410a3a0 msgr2=0x7f10f4108ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:22.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.665+0000 7f10fa4da700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10f410a3a0 0x7f10f4108ce0 secure :-1 s=READY pgs=442 cs=0 l=1 rx=0x7f10dc010310 tx=0x7f10dc0106b0).stop 2019-11-28T12:02:22.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.665+0000 7f10fa4da700 1 -- 172.21.15.80:0/3730851919 shutdown_connections 2019-11-28T12:02:22.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.665+0000 7f10fa4da700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f10d8018730 0x7f10d801abe0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:22.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.665+0000 7f10fa4da700 1 --2- 172.21.15.80:0/3730851919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f10f410a3a0 0x7f10f4108ce0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:22.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.665+0000 7f10fa4da700 1 --2- 172.21.15.80:0/3730851919 >> v2:172.21.15.80:3300/0 conn(0x7f10f413dc00 0x7f10f4109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:22.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.666+0000 7f10fa4da700 1 -- 172.21.15.80:0/3730851919 shutdown_connections 2019-11-28T12:02:22.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.666+0000 7f10fa4da700 1 -- 172.21.15.80:0/3730851919 wait complete. 2019-11-28T12:02:22.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.666+0000 7f10fa4da700 1 -- 172.21.15.80:0/3730851919 >> 172.21.15.80:0/3730851919 conn(0x7f10f411bfc0 msgr2=0x7f10f4141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:22.667 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T12:02:22.667 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T12:02:22.669 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T12:02:22.669 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T12:02:22.670 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T12:02:22.670 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T12:02:22.673 INFO:tasks.ceph.mds.c:Started 2019-11-28T12:02:22.673 DEBUG:teuthology.parallel:result is None 2019-11-28T12:02:22.738 INFO:tasks.ceph.mds.b:Started 2019-11-28T12:02:22.739 DEBUG:teuthology.parallel:result is None 2019-11-28T12:02:22.739 INFO:tasks.ceph.mds.a:Started 2019-11-28T12:02:22.739 DEBUG:teuthology.parallel:result is None 2019-11-28T12:02:22.740 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:22.757 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T12:02:22.834 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T12:02:22.835 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T12:02:22.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.874+0000 7fe8e0c4b700 1 Processor -- start 2019-11-28T12:02:22.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.875+0000 7fe8e0c4b700 1 -- start start 2019-11-28T12:02:22.884 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8e0c4b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe8dc06d120 0x7fe8dc165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:22.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8e0c4b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8dc06d5a0 con 0x7fe8dc06c490 2019-11-28T12:02:22.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8e0c4b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8dc06db00 con 0x7fe8dc06c0a0 2019-11-28T12:02:22.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8e0c4b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8dc06fd60 con 0x7fe8dc06d120 2019-11-28T12:02:22.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8db59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe8dc06d120 0x7fe8dc165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:22.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8db59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe8dc06d120 0x7fe8dc165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48118/0 (socket says 172.21.15.80:48118) 2019-11-28T12:02:22.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8db59e700 1 -- 172.21.15.80:0/1929717244 learned_addr learned my addr 172.21.15.80:0/1929717244 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:22.885 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8da59c700 1 --1- 172.21.15.80:0/1929717244 >> v1:172.21.15.80:6789/0 conn(0x7fe8dc06c490 0x7fe8dc06c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47436/0 (socket says 172.21.15.80:47436) 2019-11-28T12:02:22.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8db59e700 1 -- 172.21.15.80:0/1929717244 >> v1:172.21.15.174:6789/0 conn(0x7fe8dc06c0a0 legacy=0x7fe8dc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:22.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8db59e700 1 -- 172.21.15.80:0/1929717244 >> v1:172.21.15.80:6789/0 conn(0x7fe8dc06c490 legacy=0x7fe8dc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:22.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8d9d9b700 1 -- 172.21.15.80:0/1929717244 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868778267 0 0) 0x7fe8cc001080 con 0x7fe8dc06c0a0 2019-11-28T12:02:22.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8db59e700 1 -- 172.21.15.80:0/1929717244 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc0706c0 con 0x7fe8dc06d120 2019-11-28T12:02:22.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8db59e700 1 --2- 172.21.15.80:0/1929717244 >> v2:172.21.15.80:3300/0 conn(0x7fe8dc06d120 0x7fe8dc165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe8d400f730 tx=0x7fe8d400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:22.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8db59e700 1 --2- 172.21.15.80:0/1929717244 >> v2:172.21.15.80:3300/0 conn(0x7fe8dc06d120 0x7fe8dc165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe8d400f730 tx=0x7fe8d400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:22.886 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8db59e700 1 --2- 172.21.15.80:0/1929717244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc06d120 0x7fe8dc165d80 secure :-1 s=READY pgs=3070 cs=0 l=1 rx=0x7fe8d400f730 tx=0x7fe8d400fad0).ready entity=mon.0 client_cookie=9e8cea6ff0b7d17 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:22.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8db59e700 1 --2- 172.21.15.80:0/1929717244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc06d120 0x7fe8dc165d80 secure :-1 s=THROTTLE_DONE pgs=3070 cs=0 l=1 rx=0x7fe8d400f730 tx=0x7fe8d400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:22.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8d9d9b700 1 -- 172.21.15.80:0/1929717244 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8d40010e0 con 0x7fe8dc06d120 2019-11-28T12:02:22.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8db59e700 1 --2- 172.21.15.80:0/1929717244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc06d120 0x7fe8dc165d80 secure :-1 s=THROTTLE_DONE pgs=3070 cs=0 l=1 rx=0x7fe8d400f730 tx=0x7fe8d400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:22.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8db59e700 1 --2- 172.21.15.80:0/1929717244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc06d120 0x7fe8dc165d80 secure :-1 s=THROTTLE_DONE pgs=3070 cs=0 l=1 rx=0x7fe8d400f730 tx=0x7fe8d400fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:22.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8d9d9b700 1 -- 172.21.15.80:0/1929717244 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d4000a70 con 0x7fe8dc06d120 2019-11-28T12:02:22.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8d9d9b700 1 -- 172.21.15.80:0/1929717244 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8d40016c0 con 0x7fe8dc06d120 2019-11-28T12:02:22.887 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8e0c4b700 1 -- 172.21.15.80:0/1929717244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc06d120 msgr2=0x7fe8dc165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:22.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.876+0000 7fe8e0c4b700 1 --2- 172.21.15.80:0/1929717244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc06d120 0x7fe8dc165d80 secure :-1 s=READY pgs=3070 cs=0 l=1 rx=0x7fe8d400f730 tx=0x7fe8d400fad0).stop 2019-11-28T12:02:22.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.877+0000 7fe8e0c4b700 1 -- 172.21.15.80:0/1929717244 shutdown_connections 2019-11-28T12:02:22.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.877+0000 7fe8e0c4b700 1 --2- 172.21.15.80:0/1929717244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc06d120 0x7fe8dc165d80 unknown :-1 s=CLOSED pgs=3070 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:22.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.877+0000 7fe8e0c4b700 1 -- 172.21.15.80:0/1929717244 shutdown_connections 2019-11-28T12:02:22.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.877+0000 7fe8e0c4b700 1 -- 172.21.15.80:0/1929717244 wait complete. 2019-11-28T12:02:22.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.877+0000 7fe8e0c4b700 1 -- 172.21.15.80:0/1929717244 >> 172.21.15.80:0/1929717244 conn(0x7fe8dc061cf0 msgr2=0x7fe8dc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:22.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.880+0000 7fe8e0c4b700 1 Processor -- start 2019-11-28T12:02:22.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.880+0000 7fe8e0c4b700 1 -- start start 2019-11-28T12:02:22.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.880+0000 7fe8e0c4b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8dc13f580 0x7fe8dc114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:22.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.880+0000 7fe8e0c4b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe8dc114670 0x7fe8dc11e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:22.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.880+0000 7fe8e0c4b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8dc13fc20 con 0x7fe8dc11eaf0 2019-11-28T12:02:22.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.880+0000 7fe8e0c4b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8dc122c80 con 0x7fe8dc114670 2019-11-28T12:02:22.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.880+0000 7fe8e0c4b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc122140 con 0x7fe8dc13f580 2019-11-28T12:02:22.889 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8da59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe8dc114670 0x7fe8dc11e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:22.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8da59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe8dc114670 0x7fe8dc11e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48126/0 (socket says 172.21.15.80:48126) 2019-11-28T12:02:22.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8da59c700 1 -- 172.21.15.80:0/2929811119 learned_addr learned my addr 172.21.15.80:0/2929811119 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:22.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8dad9d700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8dc13f580 0x7fe8dc114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:22.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8d37fe700 1 -- 172.21.15.80:0/2929811119 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725087665 0 0) 0x7fe8d4000940 con 0x7fe8dc11eaf0 2019-11-28T12:02:22.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8da59c700 1 -- 172.21.15.80:0/2929811119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8dc13f580 msgr2=0x7fe8dc114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:22.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8da59c700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8dc13f580 0x7fe8dc114130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:22.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8da59c700 1 -- 172.21.15.80:0/2929811119 >> v1:172.21.15.174:6789/0 conn(0x7fe8dc11eaf0 legacy=0x7fe8dc112fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:22.893 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8da59c700 1 -- 172.21.15.80:0/2929811119 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc124010 con 0x7fe8dc114670 2019-11-28T12:02:22.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8da59c700 1 --2- 172.21.15.80:0/2929811119 >> v2:172.21.15.80:3300/0 conn(0x7fe8dc114670 0x7fe8dc11e5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe8c40107b0 tx=0x7fe8c40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:22.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8da59c700 1 --2- 172.21.15.80:0/2929811119 >> v2:172.21.15.80:3300/0 conn(0x7fe8dc114670 0x7fe8dc11e5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe8c40107b0 tx=0x7fe8c40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:22.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8da59c700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc114670 0x7fe8dc11e5b0 secure :-1 s=READY pgs=3071 cs=0 l=1 rx=0x7fe8c40107b0 tx=0x7fe8c40105e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:22.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8da59c700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc114670 0x7fe8dc11e5b0 secure :-1 s=THROTTLE_DONE pgs=3071 cs=0 l=1 rx=0x7fe8c40107b0 tx=0x7fe8c40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:22.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8d37fe700 1 -- 172.21.15.80:0/2929811119 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8c4001010 con 0x7fe8dc114670 2019-11-28T12:02:22.894 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8da59c700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc114670 0x7fe8dc11e5b0 secure :-1 s=THROTTLE_DONE pgs=3071 cs=0 l=1 rx=0x7fe8c40107b0 tx=0x7fe8c40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:22.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8da59c700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc114670 0x7fe8dc11e5b0 secure :-1 s=THROTTLE_DONE pgs=3071 cs=0 l=1 rx=0x7fe8c40107b0 tx=0x7fe8c40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:22.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8d37fe700 1 -- 172.21.15.80:0/2929811119 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c40045c0 con 0x7fe8dc114670 2019-11-28T12:02:22.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8e0c4b700 1 -- 172.21.15.80:0/2929811119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8dc124010 con 0x7fe8dc114670 2019-11-28T12:02:22.895 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8d37fe700 1 -- 172.21.15.80:0/2929811119 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8c4004bd0 con 0x7fe8dc114670 2019-11-28T12:02:22.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.881+0000 7fe8e0c4b700 1 -- 172.21.15.80:0/2929811119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8dc124010 con 0x7fe8dc114670 2019-11-28T12:02:22.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.882+0000 7fe8da59c700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc114670 0x7fe8dc11e5b0 secure :-1 s=THROTTLE_DONE pgs=3071 cs=0 l=1 rx=0x7fe8c40107b0 tx=0x7fe8c40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:22.896 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.882+0000 7fe8d37fe700 1 -- 172.21.15.80:0/2929811119 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe8c40047b0 con 0x7fe8dc114670 2019-11-28T12:02:22.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.882+0000 7fe8da59c700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc114670 0x7fe8dc11e5b0 secure :-1 s=THROTTLE_DONE pgs=3071 cs=0 l=1 rx=0x7fe8c40107b0 tx=0x7fe8c40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:22.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.882+0000 7fe8d37fe700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe8b4018730 0x7fe8b401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:22.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.882+0000 7fe8d37fe700 1 -- 172.21.15.80:0/2929811119 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(237..237 src has 1..237) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fe8c4031e10 con 0x7fe8dc114670 2019-11-28T12:02:22.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.882+0000 7fe8dad9d700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe8b4018730 0x7fe8b401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:22.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.882+0000 7fe8dad9d700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe8b4018730 0x7fe8b401abc0 crc :-1 s=READY pgs=1270 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:22.897 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.890+0000 7fe8e0c4b700 1 -- 172.21.15.80:0/2929811119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8dc124010 con 0x7fe8dc114670 2019-11-28T12:02:22.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.893+0000 7fe8da59c700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc114670 0x7fe8dc11e5b0 secure :-1 s=THROTTLE_DONE pgs=3071 cs=0 l=1 rx=0x7fe8c40107b0 tx=0x7fe8c40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:22.898 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:22.893+0000 7fe8d37fe700 1 -- 172.21.15.80:0/2929811119 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe8c4001270 con 0x7fe8dc114670 2019-11-28T12:02:23.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:23.066+0000 7fe8e0c4b700 1 -- 172.21.15.80:0/2929811119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8dc124010 con 0x7fe8dc114670 2019-11-28T12:02:23.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:23.066+0000 7fe8da59c700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc114670 0x7fe8dc11e5b0 secure :-1 s=THROTTLE_DONE pgs=3071 cs=0 l=1 rx=0x7fe8c40107b0 tx=0x7fe8c40105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:23.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:23.066+0000 7fe8d37fe700 1 -- 172.21.15.80:0/2929811119 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 196 v196) v1 ==== 95+0+1432 (secure 0 0 0) 0x7fe8c4020230 con 0x7fe8dc114670 2019-11-28T12:02:23.060 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 196 2019-11-28T12:02:23.060 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:23.061 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":196,"default_fscid":19,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":196,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:01:41.241732+0000","modified":"2019-11-28T12:02:22.611228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":235,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[39],"metadata_pool":38,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":19}]} 2019-11-28T12:02:23.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:23.068+0000 7fe8e0c4b700 1 -- 172.21.15.80:0/2929811119 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe8b4018730 msgr2=0x7fe8b401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:23.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:23.068+0000 7fe8e0c4b700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe8b4018730 0x7fe8b401abc0 crc :-1 s=READY pgs=1270 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:23.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:23.068+0000 7fe8e0c4b700 1 -- 172.21.15.80:0/2929811119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc114670 msgr2=0x7fe8dc11e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:23.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:23.068+0000 7fe8e0c4b700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc114670 0x7fe8dc11e5b0 secure :-1 s=READY pgs=3071 cs=0 l=1 rx=0x7fe8c40107b0 tx=0x7fe8c40105e0).stop 2019-11-28T12:02:23.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:23.069+0000 7fe8e0c4b700 1 -- 172.21.15.80:0/2929811119 shutdown_connections 2019-11-28T12:02:23.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:23.069+0000 7fe8e0c4b700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe8b4018730 0x7fe8b401abc0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:23.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:23.069+0000 7fe8e0c4b700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8dc114670 0x7fe8dc11e5b0 unknown :-1 s=CLOSED pgs=3071 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:23.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:23.069+0000 7fe8e0c4b700 1 --2- 172.21.15.80:0/2929811119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8dc13f580 0x7fe8dc114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:23.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:23.069+0000 7fe8e0c4b700 1 -- 172.21.15.80:0/2929811119 shutdown_connections 2019-11-28T12:02:23.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:23.069+0000 7fe8e0c4b700 1 -- 172.21.15.80:0/2929811119 wait complete. 2019-11-28T12:02:23.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:23.069+0000 7fe8e0c4b700 1 -- 172.21.15.80:0/2929811119 >> 172.21.15.80:0/2929811119 conn(0x7fe8dc1426c0 msgr2=0x7fe8dc110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:23.071 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T12:02:24.072 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:24.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.201+0000 7f1c8a908700 1 Processor -- start 2019-11-28T12:02:24.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.201+0000 7f1c8a908700 1 -- start start 2019-11-28T12:02:24.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.202+0000 7f1c8a908700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1c8406c0a0 0x7f1c84072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:24.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.202+0000 7f1c8a908700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1c84072620 0x7f1c84164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:24.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.202+0000 7f1c8a908700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8406db00 con 0x7f1c840734e0 2019-11-28T12:02:24.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.202+0000 7f1c8a908700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8406fd60 con 0x7f1c8406c0a0 2019-11-28T12:02:24.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.202+0000 7f1c8a908700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c84070030 con 0x7f1c84072620 2019-11-28T12:02:24.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.202+0000 7f1c88ea5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1c8406c0a0 0x7f1c84072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:24.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.202+0000 7f1c88ea5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1c8406c0a0 0x7f1c84072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48130/0 (socket says 172.21.15.80:48130) 2019-11-28T12:02:24.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.202+0000 7f1c88ea5700 1 -- 172.21.15.80:0/3194176827 learned_addr learned my addr 172.21.15.80:0/3194176827 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:24.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.202+0000 7f1c83fff700 1 --1- 172.21.15.80:0/3194176827 >> v1:172.21.15.80:6789/0 conn(0x7f1c840734e0 0x7f1c84071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47450/0 (socket says 172.21.15.80:47450) 2019-11-28T12:02:24.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c896a6700 1 --2- 172.21.15.80:0/3194176827 >> v2:172.21.15.174:3300/0 conn(0x7f1c84072620 0x7f1c84164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:24.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c88ea5700 1 -- 172.21.15.80:0/3194176827 >> v2:172.21.15.174:3300/0 conn(0x7f1c84072620 msgr2=0x7f1c84164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:24.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c88ea5700 1 --2- 172.21.15.80:0/3194176827 >> v2:172.21.15.174:3300/0 conn(0x7f1c84072620 0x7f1c84164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:24.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c88ea5700 1 -- 172.21.15.80:0/3194176827 >> v1:172.21.15.80:6789/0 conn(0x7f1c840734e0 legacy=0x7f1c84071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:24.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c88ea5700 1 -- 172.21.15.80:0/3194176827 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c840706c0 con 0x7f1c8406c0a0 2019-11-28T12:02:24.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c837fe700 1 -- 172.21.15.80:0/3194176827 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455110741 0 0) 0x7f1c780013f0 con 0x7f1c840734e0 2019-11-28T12:02:24.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c88ea5700 1 --2- 172.21.15.80:0/3194176827 >> v2:172.21.15.80:3300/0 conn(0x7f1c8406c0a0 0x7f1c84072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1c7400f6c0 tx=0x7f1c7400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:24.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c88ea5700 1 --2- 172.21.15.80:0/3194176827 >> v2:172.21.15.80:3300/0 conn(0x7f1c8406c0a0 0x7f1c84072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1c7400f6c0 tx=0x7f1c7400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:24.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c88ea5700 1 --2- 172.21.15.80:0/3194176827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c8406c0a0 0x7f1c84072fa0 secure :-1 s=READY pgs=3073 cs=0 l=1 rx=0x7f1c7400f6c0 tx=0x7f1c7400fa60).ready entity=mon.0 client_cookie=c6a87a9fa3766cde server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:24.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c88ea5700 1 --2- 172.21.15.80:0/3194176827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c8406c0a0 0x7f1c84072fa0 secure :-1 s=THROTTLE_DONE pgs=3073 cs=0 l=1 rx=0x7f1c7400f6c0 tx=0x7f1c7400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:24.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c837fe700 1 -- 172.21.15.80:0/3194176827 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c74000960 con 0x7f1c8406c0a0 2019-11-28T12:02:24.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c88ea5700 1 --2- 172.21.15.80:0/3194176827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c8406c0a0 0x7f1c84072fa0 secure :-1 s=THROTTLE_DONE pgs=3073 cs=0 l=1 rx=0x7f1c7400f6c0 tx=0x7f1c7400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:24.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c88ea5700 1 --2- 172.21.15.80:0/3194176827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c8406c0a0 0x7f1c84072fa0 secure :-1 s=THROTTLE_DONE pgs=3073 cs=0 l=1 rx=0x7f1c7400f6c0 tx=0x7f1c7400fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:24.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c837fe700 1 -- 172.21.15.80:0/3194176827 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c74000c90 con 0x7f1c8406c0a0 2019-11-28T12:02:24.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c837fe700 1 -- 172.21.15.80:0/3194176827 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c740013a0 con 0x7f1c8406c0a0 2019-11-28T12:02:24.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c8a908700 1 -- 172.21.15.80:0/3194176827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c8406c0a0 msgr2=0x7f1c84072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:24.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.203+0000 7f1c8a908700 1 --2- 172.21.15.80:0/3194176827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c8406c0a0 0x7f1c84072fa0 secure :-1 s=READY pgs=3073 cs=0 l=1 rx=0x7f1c7400f6c0 tx=0x7f1c7400fa60).stop 2019-11-28T12:02:24.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.204+0000 7f1c8a908700 1 -- 172.21.15.80:0/3194176827 shutdown_connections 2019-11-28T12:02:24.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.204+0000 7f1c8a908700 1 --2- 172.21.15.80:0/3194176827 >> v2:172.21.15.174:3300/0 conn(0x7f1c84072620 0x7f1c84164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:24.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.204+0000 7f1c8a908700 1 --2- 172.21.15.80:0/3194176827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c8406c0a0 0x7f1c84072fa0 unknown :-1 s=CLOSED pgs=3073 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:24.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.204+0000 7f1c8a908700 1 -- 172.21.15.80:0/3194176827 shutdown_connections 2019-11-28T12:02:24.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.204+0000 7f1c8a908700 1 -- 172.21.15.80:0/3194176827 wait complete. 2019-11-28T12:02:24.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.204+0000 7f1c8a908700 1 -- 172.21.15.80:0/3194176827 >> 172.21.15.80:0/3194176827 conn(0x7f1c84061cf0 msgr2=0x7f1c84064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:24.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.206+0000 7f1c8a908700 1 Processor -- start 2019-11-28T12:02:24.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.206+0000 7f1c8a908700 1 -- start start 2019-11-28T12:02:24.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.207+0000 7f1c8a908700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c8413e9e0 0x7f1c84108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:24.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.207+0000 7f1c8a908700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1c84109430 0x7f1c841098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:24.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.207+0000 7f1c8a908700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c841066e0 con 0x7f1c8413e5f0 2019-11-28T12:02:24.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.207+0000 7f1c8a908700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8410e060 con 0x7f1c84109430 2019-11-28T12:02:24.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.207+0000 7f1c8a908700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8410e330 con 0x7f1c8413e9e0 2019-11-28T12:02:24.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.207+0000 7f1c896a6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1c84109430 0x7f1c841098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:24.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.207+0000 7f1c896a6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1c84109430 0x7f1c841098a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48138/0 (socket says 172.21.15.80:48138) 2019-11-28T12:02:24.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.207+0000 7f1c896a6700 1 -- 172.21.15.80:0/384751928 learned_addr learned my addr 172.21.15.80:0/384751928 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:24.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.207+0000 7f1c83fff700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c8413e9e0 0x7f1c84108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:24.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.207+0000 7f1c896a6700 1 -- 172.21.15.80:0/384751928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c8413e9e0 msgr2=0x7f1c84108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:24.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.207+0000 7f1c896a6700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c8413e9e0 0x7f1c84108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:24.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.207+0000 7f1c896a6700 1 -- 172.21.15.80:0/384751928 >> v1:172.21.15.174:6789/0 conn(0x7f1c8413e5f0 legacy=0x7f1c8410a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:24.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.208+0000 7f1c896a6700 1 -- 172.21.15.80:0/384751928 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8410e9c0 con 0x7f1c84109430 2019-11-28T12:02:24.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.208+0000 7f1c83fff700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c8413e9e0 0x7f1c84108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T12:02:24.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.208+0000 7f1c896a6700 1 --2- 172.21.15.80:0/384751928 >> v2:172.21.15.80:3300/0 conn(0x7f1c84109430 0x7f1c841098a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c7c010460 tx=0x7f1c7c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:24.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.208+0000 7f1c896a6700 1 --2- 172.21.15.80:0/384751928 >> v2:172.21.15.80:3300/0 conn(0x7f1c84109430 0x7f1c841098a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c7c010460 tx=0x7f1c7c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:24.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.208+0000 7f1c896a6700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c84109430 0x7f1c841098a0 secure :-1 s=READY pgs=3074 cs=0 l=1 rx=0x7f1c7c010460 tx=0x7f1c7c010800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:24.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.208+0000 7f1c896a6700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c84109430 0x7f1c841098a0 secure :-1 s=THROTTLE_DONE pgs=3074 cs=0 l=1 rx=0x7f1c7c010460 tx=0x7f1c7c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:24.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.208+0000 7f1c896a6700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c84109430 0x7f1c841098a0 secure :-1 s=THROTTLE_DONE pgs=3074 cs=0 l=1 rx=0x7f1c7c010460 tx=0x7f1c7c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:24.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.208+0000 7f1c896a6700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c84109430 0x7f1c841098a0 secure :-1 s=THROTTLE_DONE pgs=3074 cs=0 l=1 rx=0x7f1c7c010460 tx=0x7f1c7c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:24.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.208+0000 7f1c817fa700 1 -- 172.21.15.80:0/384751928 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c7c007330 con 0x7f1c84109430 2019-11-28T12:02:24.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.208+0000 7f1c817fa700 1 -- 172.21.15.80:0/384751928 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c001360 con 0x7f1c84109430 2019-11-28T12:02:24.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.208+0000 7f1c8a908700 1 -- 172.21.15.80:0/384751928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8410ed40 con 0x7f1c84109430 2019-11-28T12:02:24.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.208+0000 7f1c817fa700 1 -- 172.21.15.80:0/384751928 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c7c0019b0 con 0x7f1c84109430 2019-11-28T12:02:24.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.208+0000 7f1c8a908700 1 -- 172.21.15.80:0/384751928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8410e9c0 con 0x7f1c84109430 2019-11-28T12:02:24.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.208+0000 7f1c896a6700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c84109430 0x7f1c841098a0 secure :-1 s=THROTTLE_DONE pgs=3074 cs=0 l=1 rx=0x7f1c7c010460 tx=0x7f1c7c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:24.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.208+0000 7f1c817fa700 1 -- 172.21.15.80:0/384751928 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1c7c001080 con 0x7f1c84109430 2019-11-28T12:02:24.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.208+0000 7f1c896a6700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c84109430 0x7f1c841098a0 secure :-1 s=THROTTLE_DONE pgs=3074 cs=0 l=1 rx=0x7f1c7c010460 tx=0x7f1c7c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:24.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.209+0000 7f1c817fa700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1c64018730 0x7f1c6401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:24.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.209+0000 7f1c817fa700 1 -- 172.21.15.80:0/384751928 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(237..237 src has 1..237) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f1c7c031d00 con 0x7f1c84109430 2019-11-28T12:02:24.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.209+0000 7f1c88ea5700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1c64018730 0x7f1c6401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:24.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.209+0000 7f1c88ea5700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1c64018730 0x7f1c6401abc0 crc :-1 s=READY pgs=1271 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:24.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.217+0000 7f1c8a908700 1 -- 172.21.15.80:0/384751928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8410ed40 con 0x7f1c84109430 2019-11-28T12:02:24.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.220+0000 7f1c896a6700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c84109430 0x7f1c841098a0 secure :-1 s=THROTTLE_DONE pgs=3074 cs=0 l=1 rx=0x7f1c7c010460 tx=0x7f1c7c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:24.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.220+0000 7f1c817fa700 1 -- 172.21.15.80:0/384751928 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1c7c017480 con 0x7f1c84109430 2019-11-28T12:02:24.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.393+0000 7f1c8a908700 1 -- 172.21.15.80:0/384751928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c8410e9c0 con 0x7f1c84109430 2019-11-28T12:02:24.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.393+0000 7f1c896a6700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c84109430 0x7f1c841098a0 secure :-1 s=THROTTLE_DONE pgs=3074 cs=0 l=1 rx=0x7f1c7c010460 tx=0x7f1c7c010800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:24.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.393+0000 7f1c817fa700 1 -- 172.21.15.80:0/384751928 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 196 v196) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f1c7c000e70 con 0x7f1c84109430 2019-11-28T12:02:24.388 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:24.388 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":196,"default_fscid":19,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":196,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:01:41.241732+0000","modified":"2019-11-28T12:02:22.611228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":235,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[39],"metadata_pool":38,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":19}]} 2019-11-28T12:02:24.388 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 196 2019-11-28T12:02:24.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.395+0000 7f1c8a908700 1 -- 172.21.15.80:0/384751928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1c64018730 msgr2=0x7f1c6401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:24.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.395+0000 7f1c8a908700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1c64018730 0x7f1c6401abc0 crc :-1 s=READY pgs=1271 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.395+0000 7f1c8a908700 1 -- 172.21.15.80:0/384751928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c84109430 msgr2=0x7f1c841098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.395+0000 7f1c8a908700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c84109430 0x7f1c841098a0 secure :-1 s=READY pgs=3074 cs=0 l=1 rx=0x7f1c7c010460 tx=0x7f1c7c010800).stop 2019-11-28T12:02:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.396+0000 7f1c8a908700 1 -- 172.21.15.80:0/384751928 shutdown_connections 2019-11-28T12:02:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.396+0000 7f1c8a908700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c84109430 0x7f1c841098a0 unknown :-1 s=CLOSED pgs=3074 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.396+0000 7f1c8a908700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c8413e9e0 0x7f1c84108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.396+0000 7f1c8a908700 1 --2- 172.21.15.80:0/384751928 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1c64018730 0x7f1c6401abc0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:24.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.396+0000 7f1c8a908700 1 -- 172.21.15.80:0/384751928 shutdown_connections 2019-11-28T12:02:24.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.396+0000 7f1c8a908700 1 -- 172.21.15.80:0/384751928 wait complete. 2019-11-28T12:02:24.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:24.396+0000 7f1c8a908700 1 -- 172.21.15.80:0/384751928 >> 172.21.15.80:0/384751928 conn(0x7f1c8413d620 msgr2=0x7f1c8413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:24.399 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T12:02:24.690 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:02:24.694 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:02:24.699 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:02:24.703 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:02:24.707 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:02:24.712 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:02:25.400 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:25.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.526+0000 7fc1388c6700 1 Processor -- start 2019-11-28T12:02:25.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.526+0000 7fc1388c6700 1 -- start start 2019-11-28T12:02:25.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.527+0000 7fc1388c6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc13406c0a0 0x7fc134072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:25.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.527+0000 7fc1388c6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc134072620 0x7fc134164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:25.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.527+0000 7fc1388c6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13406db00 con 0x7fc1340734e0 2019-11-28T12:02:25.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.527+0000 7fc1388c6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13406fd60 con 0x7fc134072620 2019-11-28T12:02:25.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.527+0000 7fc1388c6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc134070030 con 0x7fc13406c0a0 2019-11-28T12:02:25.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.527+0000 7fc13359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc134072620 0x7fc134164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:25.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.527+0000 7fc13359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc134072620 0x7fc134164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48148/0 (socket says 172.21.15.80:48148) 2019-11-28T12:02:25.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.527+0000 7fc13259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc1340734e0 0x7fc134071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47460/0 (socket says 172.21.15.80:47460) 2019-11-28T12:02:25.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.527+0000 7fc13259c700 1 -- 172.21.15.80:0/1948473242 learned_addr learned my addr 172.21.15.80:0/1948473242 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:25.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.527+0000 7fc132d9d700 1 --2- 172.21.15.80:0/1948473242 >> v2:172.21.15.174:3300/0 conn(0x7fc13406c0a0 0x7fc134072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:25.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.527+0000 7fc13359e700 1 -- 172.21.15.80:0/1948473242 >> v2:172.21.15.174:3300/0 conn(0x7fc13406c0a0 msgr2=0x7fc134072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:25.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.527+0000 7fc13359e700 1 --2- 172.21.15.80:0/1948473242 >> v2:172.21.15.174:3300/0 conn(0x7fc13406c0a0 0x7fc134072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:25.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.527+0000 7fc13359e700 1 -- 172.21.15.80:0/1948473242 >> v1:172.21.15.80:6789/0 conn(0x7fc1340734e0 legacy=0x7fc134071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:25.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.527+0000 7fc13359e700 1 -- 172.21.15.80:0/1948473242 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1340706c0 con 0x7fc134072620 2019-11-28T12:02:25.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.527+0000 7fc131d9b700 1 -- 172.21.15.80:0/1948473242 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107158753 0 0) 0x7fc11c001150 con 0x7fc1340734e0 2019-11-28T12:02:25.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.527+0000 7fc132d9d700 1 --2- 172.21.15.80:0/1948473242 >> v2:172.21.15.174:3300/0 conn(0x7fc13406c0a0 0x7fc134072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T12:02:25.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.528+0000 7fc13359e700 1 --2- 172.21.15.80:0/1948473242 >> v2:172.21.15.80:3300/0 conn(0x7fc134072620 0x7fc134164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc12c00b2d0 tx=0x7fc12c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:25.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.528+0000 7fc13359e700 1 --2- 172.21.15.80:0/1948473242 >> v2:172.21.15.80:3300/0 conn(0x7fc134072620 0x7fc134164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc12c00b2d0 tx=0x7fc12c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:25.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.528+0000 7fc13359e700 1 --2- 172.21.15.80:0/1948473242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc134072620 0x7fc134164d70 secure :-1 s=READY pgs=3076 cs=0 l=1 rx=0x7fc12c00b2d0 tx=0x7fc12c00bae0).ready entity=mon.0 client_cookie=45339f326b6429ae server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:25.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.528+0000 7fc13359e700 1 --2- 172.21.15.80:0/1948473242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc134072620 0x7fc134164d70 secure :-1 s=THROTTLE_DONE pgs=3076 cs=0 l=1 rx=0x7fc12c00b2d0 tx=0x7fc12c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:25.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.528+0000 7fc131d9b700 1 -- 172.21.15.80:0/1948473242 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc12c009f20 con 0x7fc134072620 2019-11-28T12:02:25.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.528+0000 7fc13359e700 1 --2- 172.21.15.80:0/1948473242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc134072620 0x7fc134164d70 secure :-1 s=THROTTLE_DONE pgs=3076 cs=0 l=1 rx=0x7fc12c00b2d0 tx=0x7fc12c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:25.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.528+0000 7fc13359e700 1 --2- 172.21.15.80:0/1948473242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc134072620 0x7fc134164d70 secure :-1 s=THROTTLE_DONE pgs=3076 cs=0 l=1 rx=0x7fc12c00b2d0 tx=0x7fc12c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:25.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.528+0000 7fc131d9b700 1 -- 172.21.15.80:0/1948473242 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12c009b40 con 0x7fc134072620 2019-11-28T12:02:25.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.528+0000 7fc131d9b700 1 -- 172.21.15.80:0/1948473242 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc12c000f40 con 0x7fc134072620 2019-11-28T12:02:25.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.528+0000 7fc1388c6700 1 -- 172.21.15.80:0/1948473242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc134072620 msgr2=0x7fc134164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:25.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.528+0000 7fc1388c6700 1 --2- 172.21.15.80:0/1948473242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc134072620 0x7fc134164d70 secure :-1 s=READY pgs=3076 cs=0 l=1 rx=0x7fc12c00b2d0 tx=0x7fc12c00bae0).stop 2019-11-28T12:02:25.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.529+0000 7fc1388c6700 1 -- 172.21.15.80:0/1948473242 shutdown_connections 2019-11-28T12:02:25.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.529+0000 7fc1388c6700 1 --2- 172.21.15.80:0/1948473242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc134072620 0x7fc134164d70 unknown :-1 s=CLOSED pgs=3076 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:25.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.529+0000 7fc1388c6700 1 --2- 172.21.15.80:0/1948473242 >> v2:172.21.15.174:3300/0 conn(0x7fc13406c0a0 0x7fc134072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:25.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.529+0000 7fc1388c6700 1 -- 172.21.15.80:0/1948473242 shutdown_connections 2019-11-28T12:02:25.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.529+0000 7fc1388c6700 1 -- 172.21.15.80:0/1948473242 wait complete. 2019-11-28T12:02:25.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.529+0000 7fc1388c6700 1 -- 172.21.15.80:0/1948473242 >> 172.21.15.80:0/1948473242 conn(0x7fc134061cf0 msgr2=0x7fc134064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:25.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.531+0000 7fc1388c6700 1 Processor -- start 2019-11-28T12:02:25.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.531+0000 7fc1388c6700 1 -- start start 2019-11-28T12:02:25.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.532+0000 7fc1388c6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc134104820 0x7fc13410c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:25.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.532+0000 7fc1388c6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13413bcd0 con 0x7fc13410c890 2019-11-28T12:02:25.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.532+0000 7fc1388c6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc134105ea0 con 0x7fc13410b9d0 2019-11-28T12:02:25.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.532+0000 7fc1388c6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc134108700 con 0x7fc134104820 2019-11-28T12:02:25.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.532+0000 7fc13259c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc13410c890 0x7fc13410b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47466/0 (socket says 172.21.15.80:47466) 2019-11-28T12:02:25.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.532+0000 7fc13259c700 1 -- 172.21.15.80:0/3313556494 learned_addr learned my addr 172.21.15.80:0/3313556494 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:25.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.532+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907036233 0 0) 0x7fc11c001150 con 0x7fc13410c890 2019-11-28T12:02:25.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.532+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc118002e80 con 0x7fc13410c890 2019-11-28T12:02:25.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.532+0000 7fc132d9d700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc134104820 0x7fc13410c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:25.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.532+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2406414328 0 0) 0x7fc11c001300 con 0x7fc13410c890 2019-11-28T12:02:25.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.532+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc1180032e0 con 0x7fc13410c890 2019-11-28T12:02:25.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.532+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fc11c001830 con 0x7fc13410c890 2019-11-28T12:02:25.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.532+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc134104820 msgr2=0x7fc13410c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:25.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.532+0000 7fc12b7fe700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc134104820 0x7fc13410c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:25.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.532+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 >> v1:172.21.15.174:6789/0 conn(0x7fc13410b9d0 legacy=0x7fc134167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:25.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.532+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 >> v1:172.21.15.80:6789/0 conn(0x7fc13410c890 legacy=0x7fc13410b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:25.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc12b7fe700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc118003330 0x7fc118003740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:25.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc12b7fe700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc118003c80 0x7fc118004140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:25.538 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc12b7fe700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1180049a0 0x7fc118004e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:25.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11800bbf0 con 0x7fc118003c80 2019-11-28T12:02:25.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11800bde0 con 0x7fc118003330 2019-11-28T12:02:25.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11800c010 con 0x7fc1180049a0 2019-11-28T12:02:25.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc13259c700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc118003c80 0x7fc118004140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:25.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc132d9d700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc118003330 0x7fc118003740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:25.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc13359e700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1180049a0 0x7fc118004e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:25.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc13259c700 1 -- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1180049a0 msgr2=0x7fc118004e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:25.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc13259c700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1180049a0 0x7fc118004e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:25.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc13259c700 1 -- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc118003330 msgr2=0x7fc118003740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:25.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc13259c700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc118003330 0x7fc118003740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:25.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc13259c700 1 -- 172.21.15.80:0/3313556494 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11800c2c0 con 0x7fc118003c80 2019-11-28T12:02:25.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc13359e700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1180049a0 0x7fc118004e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T12:02:25.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc1388c6700 1 -- 172.21.15.80:0/3313556494 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc134109e10 con 0x7fc118003c80 2019-11-28T12:02:25.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc13259c700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc118003c80 0x7fc118004140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc11c010440 tx=0x7fc11c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:25.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc1388c6700 1 -- 172.21.15.80:0/3313556494 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc134109a90 con 0x7fc118003c80 2019-11-28T12:02:25.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc13259c700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc118003c80 0x7fc118004140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc11c010440 tx=0x7fc11c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:25.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc13259c700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc118003c80 0x7fc118004140 secure :-1 s=READY pgs=3078 cs=0 l=1 rx=0x7fc11c010440 tx=0x7fc11c0102f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:25.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc13259c700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc118003c80 0x7fc118004140 secure :-1 s=THROTTLE_DONE pgs=3078 cs=0 l=1 rx=0x7fc11c010440 tx=0x7fc11c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:25.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc13259c700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc118003c80 0x7fc118004140 secure :-1 s=THROTTLE_DONE pgs=3078 cs=0 l=1 rx=0x7fc11c010440 tx=0x7fc11c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:25.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc13259c700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc118003c80 0x7fc118004140 secure :-1 s=THROTTLE_DONE pgs=3078 cs=0 l=1 rx=0x7fc11c010440 tx=0x7fc11c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:25.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc11c000d00 con 0x7fc118003c80 2019-11-28T12:02:25.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c004240 con 0x7fc118003c80 2019-11-28T12:02:25.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc11c0048d0 con 0x7fc118003c80 2019-11-28T12:02:25.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.533+0000 7fc13259c700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc118003c80 0x7fc118004140 secure :-1 s=THROTTLE_DONE pgs=3078 cs=0 l=1 rx=0x7fc11c010440 tx=0x7fc11c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:25.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.534+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc11c004430 con 0x7fc118003c80 2019-11-28T12:02:25.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.534+0000 7fc13259c700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc118003c80 0x7fc118004140 secure :-1 s=THROTTLE_DONE pgs=3078 cs=0 l=1 rx=0x7fc11c010440 tx=0x7fc11c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:25.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.534+0000 7fc12b7fe700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc118020bc0 0x7fc118022ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:25.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.534+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(237..237 src has 1..237) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fc11c031c90 con 0x7fc118003c80 2019-11-28T12:02:25.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.534+0000 7fc132d9d700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc118020bc0 0x7fc118022ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:25.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.534+0000 7fc132d9d700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc118020bc0 0x7fc118022ff0 crc :-1 s=READY pgs=1272 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:25.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.541+0000 7fc1388c6700 1 -- 172.21.15.80:0/3313556494 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10c002e60 con 0x7fc118003c80 2019-11-28T12:02:25.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.545+0000 7fc13259c700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc118003c80 0x7fc118004140 secure :-1 s=THROTTLE_DONE pgs=3078 cs=0 l=1 rx=0x7fc11c010440 tx=0x7fc11c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:25.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.545+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc11c001010 con 0x7fc118003c80 2019-11-28T12:02:25.710 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.717+0000 7fc1388c6700 1 -- 172.21.15.80:0/3313556494 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc10c001d10 con 0x7fc118003c80 2019-11-28T12:02:25.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.717+0000 7fc13259c700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc118003c80 0x7fc118004140 secure :-1 s=THROTTLE_DONE pgs=3078 cs=0 l=1 rx=0x7fc11c010440 tx=0x7fc11c0102f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:25.711 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.717+0000 7fc12b7fe700 1 -- 172.21.15.80:0/3313556494 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 196 v196) v1 ==== 95+0+1432 (secure 0 0 0) 0x7fc11c01fe60 con 0x7fc118003c80 2019-11-28T12:02:25.711 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 196 2019-11-28T12:02:25.712 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:25.712 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":196,"default_fscid":19,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":196,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:01:41.241732+0000","modified":"2019-11-28T12:02:22.611228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":235,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[39],"metadata_pool":38,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":19}]} 2019-11-28T12:02:25.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.720+0000 7fc1388c6700 1 -- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc118020bc0 msgr2=0x7fc118022ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:25.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.720+0000 7fc1388c6700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc118020bc0 0x7fc118022ff0 crc :-1 s=READY pgs=1272 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:25.714 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.720+0000 7fc1388c6700 1 -- 172.21.15.80:0/3313556494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc118003c80 msgr2=0x7fc118004140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:25.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.720+0000 7fc1388c6700 1 --2- 172.21.15.80:0/3313556494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc118003c80 0x7fc118004140 secure :-1 s=READY pgs=3078 cs=0 l=1 rx=0x7fc11c010440 tx=0x7fc11c0102f0).stop 2019-11-28T12:02:25.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.720+0000 7fc13359e700 1 -- 172.21.15.80:0/3313556494 reap_dead start 2019-11-28T12:02:25.715 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.720+0000 7fc13359e700 1 -- 172.21.15.80:0/3313556494 reap_dead start 2019-11-28T12:02:25.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.720+0000 7fc1388c6700 1 -- 172.21.15.80:0/3313556494 shutdown_connections 2019-11-28T12:02:25.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.720+0000 7fc1388c6700 1 -- 172.21.15.80:0/3313556494 shutdown_connections 2019-11-28T12:02:25.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.720+0000 7fc1388c6700 1 -- 172.21.15.80:0/3313556494 wait complete. 2019-11-28T12:02:25.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:25.720+0000 7fc1388c6700 1 -- 172.21.15.80:0/3313556494 >> 172.21.15.80:0/3313556494 conn(0x7fc13413d620 msgr2=0x7fc13413da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:25.724 INFO:tasks.cephfs.filesystem:mapped states [] to None 2019-11-28T12:02:26.725 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:26.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.866+0000 7f704547c700 1 Processor -- start 2019-11-28T12:02:26.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.866+0000 7f704547c700 1 -- start start 2019-11-28T12:02:26.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f704547c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f704006c0a0 0x7f7040072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:26.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f704547c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f70400734e0 0x7f7040071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:26.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f704547c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7040072360 0x7f70400727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:26.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f704547c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f704006f330 con 0x7f7040072360 2019-11-28T12:02:26.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f704547c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70400706c0 con 0x7f70400734e0 2019-11-28T12:02:26.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f704547c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7040070a40 con 0x7f704006c0a0 2019-11-28T12:02:26.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f703ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7040072360 0x7f70400727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:26.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f703ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7040072360 0x7f70400727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48166/0 (socket says 172.21.15.80:48166) 2019-11-28T12:02:26.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f703ffff700 1 -- 172.21.15.80:0/3979258048 learned_addr learned my addr 172.21.15.80:0/3979258048 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:26.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f703f7fe700 1 --2- 172.21.15.80:0/3979258048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f704006c0a0 0x7f7040072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:26.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f703effd700 1 --2- 172.21.15.80:0/3979258048 >> v2:172.21.15.174:3300/0 conn(0x7f70400734e0 0x7f7040071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:26.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f703ffff700 1 -- 172.21.15.80:0/3979258048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f704006c0a0 msgr2=0x7f7040072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:26.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f703ffff700 1 --2- 172.21.15.80:0/3979258048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f704006c0a0 0x7f7040072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:26.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f703ffff700 1 -- 172.21.15.80:0/3979258048 >> v2:172.21.15.174:3300/0 conn(0x7f70400734e0 msgr2=0x7f7040071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:26.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f703ffff700 1 --2- 172.21.15.80:0/3979258048 >> v2:172.21.15.174:3300/0 conn(0x7f70400734e0 0x7f7040071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:26.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f703ffff700 1 -- 172.21.15.80:0/3979258048 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704006db00 con 0x7f7040072360 2019-11-28T12:02:26.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f703ffff700 1 --2- 172.21.15.80:0/3979258048 >> v2:172.21.15.80:3300/0 conn(0x7f7040072360 0x7f70400727e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f703800f6b0 tx=0x7f7038007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:26.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f703ffff700 1 --2- 172.21.15.80:0/3979258048 >> v2:172.21.15.80:3300/0 conn(0x7f7040072360 0x7f70400727e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f703800f6b0 tx=0x7f7038007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:26.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.867+0000 7f703ffff700 1 --2- 172.21.15.80:0/3979258048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7040072360 0x7f70400727e0 secure :-1 s=READY pgs=3079 cs=0 l=1 rx=0x7f703800f6b0 tx=0x7f7038007d50).ready entity=mon.0 client_cookie=e656fc80985e7d0d server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:26.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.868+0000 7f703ffff700 1 --2- 172.21.15.80:0/3979258048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7040072360 0x7f70400727e0 secure :-1 s=THROTTLE_DONE pgs=3079 cs=0 l=1 rx=0x7f703800f6b0 tx=0x7f7038007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:26.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.868+0000 7f703ffff700 1 --2- 172.21.15.80:0/3979258048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7040072360 0x7f70400727e0 secure :-1 s=THROTTLE_DONE pgs=3079 cs=0 l=1 rx=0x7f703800f6b0 tx=0x7f7038007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:26.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.868+0000 7f703ffff700 1 --2- 172.21.15.80:0/3979258048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7040072360 0x7f70400727e0 secure :-1 s=THROTTLE_DONE pgs=3079 cs=0 l=1 rx=0x7f703800f6b0 tx=0x7f7038007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:26.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.868+0000 7f703e7fc700 1 -- 172.21.15.80:0/3979258048 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7038000a70 con 0x7f7040072360 2019-11-28T12:02:26.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.868+0000 7f703e7fc700 1 -- 172.21.15.80:0/3979258048 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70380010e0 con 0x7f7040072360 2019-11-28T12:02:26.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.868+0000 7f703e7fc700 1 -- 172.21.15.80:0/3979258048 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7038001830 con 0x7f7040072360 2019-11-28T12:02:26.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.868+0000 7f704547c700 1 -- 172.21.15.80:0/3979258048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7040072360 msgr2=0x7f70400727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:26.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.868+0000 7f704547c700 1 --2- 172.21.15.80:0/3979258048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7040072360 0x7f70400727e0 secure :-1 s=READY pgs=3079 cs=0 l=1 rx=0x7f703800f6b0 tx=0x7f7038007d50).stop 2019-11-28T12:02:26.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.868+0000 7f704547c700 1 -- 172.21.15.80:0/3979258048 shutdown_connections 2019-11-28T12:02:26.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.868+0000 7f704547c700 1 --2- 172.21.15.80:0/3979258048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7040072360 0x7f70400727e0 unknown :-1 s=CLOSED pgs=3079 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:26.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.868+0000 7f704547c700 1 --2- 172.21.15.80:0/3979258048 >> v2:172.21.15.174:3300/0 conn(0x7f70400734e0 0x7f7040071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:26.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.868+0000 7f704547c700 1 --2- 172.21.15.80:0/3979258048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f704006c0a0 0x7f7040072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:26.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.868+0000 7f704547c700 1 -- 172.21.15.80:0/3979258048 shutdown_connections 2019-11-28T12:02:26.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.868+0000 7f704547c700 1 -- 172.21.15.80:0/3979258048 wait complete. 2019-11-28T12:02:26.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.868+0000 7f704547c700 1 -- 172.21.15.80:0/3979258048 >> 172.21.15.80:0/3979258048 conn(0x7f7040061cf0 msgr2=0x7f7040064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:26.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.871+0000 7f704547c700 1 Processor -- start 2019-11-28T12:02:26.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.871+0000 7f704547c700 1 -- start start 2019-11-28T12:02:26.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f704547c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7040104c10 0x7f70401050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:26.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f704547c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f70401055e0 0x7f7040167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:26.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f704547c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7040105a30 con 0x7f7040104820 2019-11-28T12:02:26.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f704547c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7040109130 con 0x7f70401055e0 2019-11-28T12:02:26.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f704547c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7040109400 con 0x7f7040104c10 2019-11-28T12:02:26.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f703f7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7040104820 0x7f704010c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47486/0 (socket says 172.21.15.80:47486) 2019-11-28T12:02:26.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f703f7fe700 1 -- 172.21.15.80:0/931573490 learned_addr learned my addr 172.21.15.80:0/931573490 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:26.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f703effd700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7040104c10 0x7f70401050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:26.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f703ffff700 1 --2- 172.21.15.80:0/931573490 >> v2:172.21.15.174:3300/0 conn(0x7f70401055e0 0x7f7040167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:26.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f7027fff700 1 -- 172.21.15.80:0/931573490 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226086256 0 0) 0x7f7034001330 con 0x7f7040104820 2019-11-28T12:02:26.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f7027fff700 1 -- 172.21.15.80:0/931573490 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7020002e80 con 0x7f7040104820 2019-11-28T12:02:26.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f703ffff700 1 -- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7040104c10 msgr2=0x7f70401050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:26.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f703ffff700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7040104c10 0x7f70401050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:26.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f703ffff700 1 -- 172.21.15.80:0/931573490 >> v1:172.21.15.80:6789/0 conn(0x7f7040104820 legacy=0x7f704010c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:26.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f703ffff700 1 -- 172.21.15.80:0/931573490 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7040109a90 con 0x7f70401055e0 2019-11-28T12:02:26.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f703effd700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7040104c10 0x7f70401050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:26.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.872+0000 7f703ffff700 1 --2- 172.21.15.80:0/931573490 >> v2:172.21.15.174:3300/0 conn(0x7f70401055e0 0x7f7040167a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f70380543b0 tx=0x7f7038054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:26.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.873+0000 7f703ffff700 1 --2- 172.21.15.80:0/931573490 >> v2:172.21.15.174:3300/0 conn(0x7f70401055e0 0x7f7040167a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f70380543b0 tx=0x7f7038054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:26.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.873+0000 7f703ffff700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70401055e0 0x7f7040167a10 secure :-1 s=READY pgs=1866 cs=0 l=1 rx=0x7f70380543b0 tx=0x7f7038054750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:26.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.873+0000 7f703ffff700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70401055e0 0x7f7040167a10 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7f70380543b0 tx=0x7f7038054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:26.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.873+0000 7f7027fff700 1 -- 172.21.15.80:0/931573490 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70380010a0 con 0x7f70401055e0 2019-11-28T12:02:26.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.873+0000 7f703ffff700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70401055e0 0x7f7040167a10 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7f70380543b0 tx=0x7f7038054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:26.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.873+0000 7f703ffff700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70401055e0 0x7f7040167a10 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7f70380543b0 tx=0x7f7038054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:26.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.873+0000 7f7027fff700 1 -- 172.21.15.80:0/931573490 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7038008180 con 0x7f70401055e0 2019-11-28T12:02:26.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.873+0000 7f7027fff700 1 -- 172.21.15.80:0/931573490 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7038000eb0 con 0x7f70401055e0 2019-11-28T12:02:26.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.873+0000 7f704547c700 1 -- 172.21.15.80:0/931573490 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7040109e10 con 0x7f70401055e0 2019-11-28T12:02:26.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.873+0000 7f704547c700 1 -- 172.21.15.80:0/931573490 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7040109a90 con 0x7f70401055e0 2019-11-28T12:02:26.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.873+0000 7f703ffff700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70401055e0 0x7f7040167a10 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7f70380543b0 tx=0x7f7038054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:26.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.873+0000 7f7027fff700 1 -- 172.21.15.80:0/931573490 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7038000eb0 con 0x7f70401055e0 2019-11-28T12:02:26.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.873+0000 7f703ffff700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70401055e0 0x7f7040167a10 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7f70380543b0 tx=0x7f7038054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:26.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.874+0000 7f7027fff700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7020018770 0x7f702001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:26.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.874+0000 7f7027fff700 1 -- 172.21.15.80:0/931573490 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(237..237 src has 1..237) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f7038075a30 con 0x7f70401055e0 2019-11-28T12:02:26.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.874+0000 7f703f7fe700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7020018770 0x7f702001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:26.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.874+0000 7f703f7fe700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7020018770 0x7f702001abe0 crc :-1 s=READY pgs=1274 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:26.878 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.881+0000 7f704547c700 1 -- 172.21.15.80:0/931573490 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7040109e10 con 0x7f70401055e0 2019-11-28T12:02:26.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.885+0000 7f703ffff700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70401055e0 0x7f7040167a10 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7f70380543b0 tx=0x7f7038054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:26.879 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:26.885+0000 7f7027fff700 1 -- 172.21.15.80:0/931573490 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7038000c10 con 0x7f70401055e0 2019-11-28T12:02:27.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:27.060+0000 7f704547c700 1 -- 172.21.15.80:0/931573490 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7040109a90 con 0x7f70401055e0 2019-11-28T12:02:27.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:27.060+0000 7f703ffff700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70401055e0 0x7f7040167a10 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7f70380543b0 tx=0x7f7038054750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:27.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:27.060+0000 7f7027fff700 1 -- 172.21.15.80:0/931573490 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 198 v198) v1 ==== 95+0+1776 (secure 0 0 0) 0x7f7038000eb0 con 0x7f70401055e0 2019-11-28T12:02:27.056 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 198 2019-11-28T12:02:27.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:27.063+0000 7f704547c700 1 -- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7020018770 msgr2=0x7f702001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:27.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:27.063+0000 7f704547c700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7020018770 0x7f702001abe0 crc :-1 s=READY pgs=1274 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:27.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:27.063+0000 7f704547c700 1 -- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70401055e0 msgr2=0x7f7040167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:27.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:27.063+0000 7f704547c700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70401055e0 0x7f7040167a10 secure :-1 s=READY pgs=1866 cs=0 l=1 rx=0x7f70380543b0 tx=0x7f7038054750).stop 2019-11-28T12:02:27.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:27.063+0000 7f704547c700 1 -- 172.21.15.80:0/931573490 shutdown_connections 2019-11-28T12:02:27.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:27.063+0000 7f704547c700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7020018770 0x7f702001abe0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:27.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:27.063+0000 7f704547c700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70401055e0 0x7f7040167a10 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:27.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:27.063+0000 7f704547c700 1 --2- 172.21.15.80:0/931573490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7040104c10 0x7f70401050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:27.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:27.063+0000 7f704547c700 1 -- 172.21.15.80:0/931573490 shutdown_connections 2019-11-28T12:02:27.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:27.063+0000 7f704547c700 1 -- 172.21.15.80:0/931573490 wait complete. 2019-11-28T12:02:27.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:27.063+0000 7f704547c700 1 -- 172.21.15.80:0/931573490 >> 172.21.15.80:0/931573490 conn(0x7f704013d620 msgr2=0x7f704013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:27.059 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:27.059 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":198,"default_fscid":19,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":198,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:01:41.241732+0000","modified":"2019-11-28T12:02:26.781917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":235,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8393":{"gid":8393,"name":"c","rank":0,"incarnation":198,"state":"up:replay","state_seq":2,"addr":"172.21.15.174:6835/90324510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":90324510},{"type":"v1","addr":"172.21.15.174:6835","nonce":90324510}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[39],"metadata_pool":38,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":19}]} 2019-11-28T12:02:27.066 INFO:tasks.cephfs.filesystem:mapped states [u'up:replay'] to None 2019-11-28T12:02:28.067 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:28.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.201+0000 7f6ef77d2700 1 Processor -- start 2019-11-28T12:02:28.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.201+0000 7f6ef77d2700 1 -- start start 2019-11-28T12:02:28.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.202+0000 7f6ef77d2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ef006c0a0 0x7f6ef0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:28.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.202+0000 7f6ef77d2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ef00734e0 0x7f6ef0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:28.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.202+0000 7f6ef77d2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef006db00 con 0x7f6ef0072360 2019-11-28T12:02:28.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.202+0000 7f6ef77d2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef006f330 con 0x7f6ef00734e0 2019-11-28T12:02:28.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.202+0000 7f6ef77d2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef00706c0 con 0x7f6ef006c0a0 2019-11-28T12:02:28.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.202+0000 7f6ef556e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ef00734e0 0x7f6ef0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:28.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.202+0000 7f6ef556e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ef00734e0 0x7f6ef0071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48186/0 (socket says 172.21.15.80:48186) 2019-11-28T12:02:28.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.202+0000 7f6ef556e700 1 -- 172.21.15.80:0/887437567 learned_addr learned my addr 172.21.15.80:0/887437567 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:28.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.202+0000 7f6ef6570700 1 --1- 172.21.15.80:0/887437567 >> v1:172.21.15.80:6789/0 conn(0x7f6ef0072360 0x7f6ef006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47500/0 (socket says 172.21.15.80:47500) 2019-11-28T12:02:28.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.202+0000 7f6ef5d6f700 1 --2- 172.21.15.80:0/887437567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ef006c0a0 0x7f6ef0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:28.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.202+0000 7f6ef556e700 1 -- 172.21.15.80:0/887437567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ef006c0a0 msgr2=0x7f6ef0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:28.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.202+0000 7f6ef556e700 1 --2- 172.21.15.80:0/887437567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ef006c0a0 0x7f6ef0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:28.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.202+0000 7f6ef556e700 1 -- 172.21.15.80:0/887437567 >> v1:172.21.15.80:6789/0 conn(0x7f6ef0072360 legacy=0x7f6ef006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:28.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.202+0000 7f6ef556e700 1 -- 172.21.15.80:0/887437567 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef0070a40 con 0x7f6ef00734e0 2019-11-28T12:02:28.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.202+0000 7f6ef4d6d700 1 -- 172.21.15.80:0/887437567 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844472779 0 0) 0x7f6ee80009b0 con 0x7f6ef0072360 2019-11-28T12:02:28.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.202+0000 7f6ef556e700 1 --2- 172.21.15.80:0/887437567 >> v2:172.21.15.80:3300/0 conn(0x7f6ef00734e0 0x7f6ef0071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ee000fa40 tx=0x7f6ee000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:28.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.203+0000 7f6ef556e700 1 --2- 172.21.15.80:0/887437567 >> v2:172.21.15.80:3300/0 conn(0x7f6ef00734e0 0x7f6ef0071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ee000fa40 tx=0x7f6ee000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:28.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.203+0000 7f6ef556e700 1 --2- 172.21.15.80:0/887437567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef00734e0 0x7f6ef0071e20 secure :-1 s=READY pgs=3082 cs=0 l=1 rx=0x7f6ee000fa40 tx=0x7f6ee000fde0).ready entity=mon.0 client_cookie=1eecc25917e45bbf server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:28.202 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.203+0000 7f6ef556e700 1 --2- 172.21.15.80:0/887437567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef00734e0 0x7f6ef0071e20 secure :-1 s=THROTTLE_DONE pgs=3082 cs=0 l=1 rx=0x7f6ee000fa40 tx=0x7f6ee000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:28.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.203+0000 7f6ef556e700 1 --2- 172.21.15.80:0/887437567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef00734e0 0x7f6ef0071e20 secure :-1 s=THROTTLE_DONE pgs=3082 cs=0 l=1 rx=0x7f6ee000fa40 tx=0x7f6ee000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:28.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.203+0000 7f6ef4d6d700 1 -- 172.21.15.80:0/887437567 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ee0000ce0 con 0x7f6ef00734e0 2019-11-28T12:02:28.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.203+0000 7f6ef556e700 1 --2- 172.21.15.80:0/887437567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef00734e0 0x7f6ef0071e20 secure :-1 s=THROTTLE_DONE pgs=3082 cs=0 l=1 rx=0x7f6ee000fa40 tx=0x7f6ee000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:28.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.203+0000 7f6ef4d6d700 1 -- 172.21.15.80:0/887437567 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee0001010 con 0x7f6ef00734e0 2019-11-28T12:02:28.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.203+0000 7f6ef4d6d700 1 -- 172.21.15.80:0/887437567 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ee0001720 con 0x7f6ef00734e0 2019-11-28T12:02:28.203 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.203+0000 7f6ef77d2700 1 -- 172.21.15.80:0/887437567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef00734e0 msgr2=0x7f6ef0071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:28.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.203+0000 7f6ef77d2700 1 --2- 172.21.15.80:0/887437567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef00734e0 0x7f6ef0071e20 secure :-1 s=READY pgs=3082 cs=0 l=1 rx=0x7f6ee000fa40 tx=0x7f6ee000fde0).stop 2019-11-28T12:02:28.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.203+0000 7f6ef77d2700 1 -- 172.21.15.80:0/887437567 shutdown_connections 2019-11-28T12:02:28.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.203+0000 7f6ef77d2700 1 --2- 172.21.15.80:0/887437567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef00734e0 0x7f6ef0071e20 unknown :-1 s=CLOSED pgs=3082 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:28.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.203+0000 7f6ef77d2700 1 --2- 172.21.15.80:0/887437567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ef006c0a0 0x7f6ef0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:28.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.204+0000 7f6ef77d2700 1 -- 172.21.15.80:0/887437567 shutdown_connections 2019-11-28T12:02:28.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.204+0000 7f6ef77d2700 1 -- 172.21.15.80:0/887437567 wait complete. 2019-11-28T12:02:28.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.204+0000 7f6ef77d2700 1 -- 172.21.15.80:0/887437567 >> 172.21.15.80:0/887437567 conn(0x7f6ef0061cf0 msgr2=0x7f6ef0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:28.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.206+0000 7f6ef77d2700 1 Processor -- start 2019-11-28T12:02:28.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.206+0000 7f6ef77d2700 1 -- start start 2019-11-28T12:02:28.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef77d2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ef015fdf0 0x7f6ef012b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:28.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef77d2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ef012b8a0 0x7f6ef013e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:28.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef77d2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6ef013e860 0x7f6ef012a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:28.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef77d2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef0108820 con 0x7f6ef015fdf0 2019-11-28T12:02:28.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef77d2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef0108af0 con 0x7f6ef013e860 2019-11-28T12:02:28.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef77d2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef0107df0 con 0x7f6ef012b8a0 2019-11-28T12:02:28.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef5d6f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ef015fdf0 0x7f6ef012b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:28.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef5d6f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ef015fdf0 0x7f6ef012b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48188/0 (socket says 172.21.15.80:48188) 2019-11-28T12:02:28.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef5d6f700 1 -- 172.21.15.80:0/1047167810 learned_addr learned my addr 172.21.15.80:0/1047167810 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:28.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef556e700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ef012b8a0 0x7f6ef013e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:28.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef6570700 1 --2- 172.21.15.80:0/1047167810 >> v2:172.21.15.174:3300/0 conn(0x7f6ef013e860 0x7f6ef012a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:28.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef5d6f700 1 -- 172.21.15.80:0/1047167810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ef012b8a0 msgr2=0x7f6ef013e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:28.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef5d6f700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ef012b8a0 0x7f6ef013e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:28.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef5d6f700 1 -- 172.21.15.80:0/1047167810 >> v2:172.21.15.174:3300/0 conn(0x7f6ef013e860 msgr2=0x7f6ef012a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:28.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef5d6f700 1 --2- 172.21.15.80:0/1047167810 >> v2:172.21.15.174:3300/0 conn(0x7f6ef013e860 0x7f6ef012a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:28.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef5d6f700 1 -- 172.21.15.80:0/1047167810 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef010a8c0 con 0x7f6ef015fdf0 2019-11-28T12:02:28.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef6570700 1 --2- 172.21.15.80:0/1047167810 >> v2:172.21.15.174:3300/0 conn(0x7f6ef013e860 0x7f6ef012a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T12:02:28.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef5d6f700 1 --2- 172.21.15.80:0/1047167810 >> v2:172.21.15.80:3300/0 conn(0x7f6ef015fdf0 0x7f6ef012b360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ee40103d0 tx=0x7f6ee4010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:28.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef5d6f700 1 --2- 172.21.15.80:0/1047167810 >> v2:172.21.15.80:3300/0 conn(0x7f6ef015fdf0 0x7f6ef012b360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ee40103d0 tx=0x7f6ee4010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:28.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.207+0000 7f6ef5d6f700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef015fdf0 0x7f6ef012b360 secure :-1 s=READY pgs=3083 cs=0 l=1 rx=0x7f6ee40103d0 tx=0x7f6ee4010770).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:28.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.208+0000 7f6ef5d6f700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef015fdf0 0x7f6ef012b360 secure :-1 s=THROTTLE_DONE pgs=3083 cs=0 l=1 rx=0x7f6ee40103d0 tx=0x7f6ee4010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:28.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.208+0000 7f6ef5d6f700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef015fdf0 0x7f6ef012b360 secure :-1 s=THROTTLE_DONE pgs=3083 cs=0 l=1 rx=0x7f6ee40103d0 tx=0x7f6ee4010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:28.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.208+0000 7f6ef5d6f700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef015fdf0 0x7f6ef012b360 secure :-1 s=THROTTLE_DONE pgs=3083 cs=0 l=1 rx=0x7f6ee40103d0 tx=0x7f6ee4010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:28.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.208+0000 7f6eee7fc700 1 -- 172.21.15.80:0/1047167810 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ee4001070 con 0x7f6ef015fdf0 2019-11-28T12:02:28.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.208+0000 7f6eee7fc700 1 -- 172.21.15.80:0/1047167810 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee4000c90 con 0x7f6ef015fdf0 2019-11-28T12:02:28.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.208+0000 7f6eee7fc700 1 -- 172.21.15.80:0/1047167810 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ee4001650 con 0x7f6ef015fdf0 2019-11-28T12:02:28.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.208+0000 7f6ef77d2700 1 -- 172.21.15.80:0/1047167810 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef010a8c0 con 0x7f6ef015fdf0 2019-11-28T12:02:28.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.208+0000 7f6ef77d2700 1 -- 172.21.15.80:0/1047167810 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef010a8c0 con 0x7f6ef015fdf0 2019-11-28T12:02:28.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.208+0000 7f6ef5d6f700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef015fdf0 0x7f6ef012b360 secure :-1 s=THROTTLE_DONE pgs=3083 cs=0 l=1 rx=0x7f6ee40103d0 tx=0x7f6ee4010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:28.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.209+0000 7f6eee7fc700 1 -- 172.21.15.80:0/1047167810 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6ee4000c90 con 0x7f6ef015fdf0 2019-11-28T12:02:28.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.209+0000 7f6ef5d6f700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef015fdf0 0x7f6ef012b360 secure :-1 s=THROTTLE_DONE pgs=3083 cs=0 l=1 rx=0x7f6ee40103d0 tx=0x7f6ee4010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:28.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.209+0000 7f6eee7fc700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ed0018730 0x7f6ed001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:28.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.209+0000 7f6eee7fc700 1 -- 172.21.15.80:0/1047167810 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(237..237 src has 1..237) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f6ee4031a00 con 0x7f6ef015fdf0 2019-11-28T12:02:28.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.209+0000 7f6ef556e700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ed0018730 0x7f6ed001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:28.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.209+0000 7f6ef556e700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ed0018730 0x7f6ed001abc0 crc :-1 s=READY pgs=1278 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:28.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.216+0000 7f6ef77d2700 1 -- 172.21.15.80:0/1047167810 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef0109180 con 0x7f6ef015fdf0 2019-11-28T12:02:28.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.219+0000 7f6ef5d6f700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef015fdf0 0x7f6ef012b360 secure :-1 s=THROTTLE_DONE pgs=3083 cs=0 l=1 rx=0x7f6ee40103d0 tx=0x7f6ee4010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:28.219 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.220+0000 7f6eee7fc700 1 -- 172.21.15.80:0/1047167810 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6ee40092e0 con 0x7f6ef015fdf0 2019-11-28T12:02:28.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.398+0000 7f6ef77d2700 1 -- 172.21.15.80:0/1047167810 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ef0109500 con 0x7f6ef015fdf0 2019-11-28T12:02:28.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.398+0000 7f6ef5d6f700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef015fdf0 0x7f6ef012b360 secure :-1 s=THROTTLE_DONE pgs=3083 cs=0 l=1 rx=0x7f6ee40103d0 tx=0x7f6ee4010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:28.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.398+0000 7f6eee7fc700 1 -- 172.21.15.80:0/1047167810 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 199 v199) v1 ==== 95+0+2453 (secure 0 0 0) 0x7f6ee40172b0 con 0x7f6ef015fdf0 2019-11-28T12:02:28.393 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 199 2019-11-28T12:02:28.394 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:28.394 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":199,"default_fscid":19,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":12187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/174358448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":174358448},{"type":"v1","addr":"172.21.15.80:6835","nonce":174358448}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":199},{"gid":12996,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/2339800882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2339800882},{"type":"v1","addr":"172.21.15.80:6833","nonce":2339800882}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":199}],"filesystems":[{"mdsmap":{"epoch":199,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:01:41.241732+0000","modified":"2019-11-28T12:02:27.785840+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":235,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8393":{"gid":8393,"name":"c","rank":0,"incarnation":198,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.174:6835/90324510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":90324510},{"type":"v1","addr":"172.21.15.174:6835","nonce":90324510}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[39],"metadata_pool":38,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":19}]} 2019-11-28T12:02:28.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.401+0000 7f6ef77d2700 1 -- 172.21.15.80:0/1047167810 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ed0018730 msgr2=0x7f6ed001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:28.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.401+0000 7f6ef77d2700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ed0018730 0x7f6ed001abc0 crc :-1 s=READY pgs=1278 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:28.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.401+0000 7f6ef77d2700 1 -- 172.21.15.80:0/1047167810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef015fdf0 msgr2=0x7f6ef012b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:28.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.401+0000 7f6ef77d2700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef015fdf0 0x7f6ef012b360 secure :-1 s=READY pgs=3083 cs=0 l=1 rx=0x7f6ee40103d0 tx=0x7f6ee4010770).stop 2019-11-28T12:02:28.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.401+0000 7f6ef77d2700 1 -- 172.21.15.80:0/1047167810 shutdown_connections 2019-11-28T12:02:28.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.401+0000 7f6ef77d2700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6ed0018730 0x7f6ed001abc0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:28.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.401+0000 7f6ef77d2700 1 --2- 172.21.15.80:0/1047167810 >> v2:172.21.15.174:3300/0 conn(0x7f6ef013e860 0x7f6ef012a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:28.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.401+0000 7f6ef77d2700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ef012b8a0 0x7f6ef013e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:28.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.401+0000 7f6ef77d2700 1 --2- 172.21.15.80:0/1047167810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ef015fdf0 0x7f6ef012b360 unknown :-1 s=CLOSED pgs=3083 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:28.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.401+0000 7f6ef77d2700 1 -- 172.21.15.80:0/1047167810 shutdown_connections 2019-11-28T12:02:28.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.401+0000 7f6ef77d2700 1 -- 172.21.15.80:0/1047167810 wait complete. 2019-11-28T12:02:28.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:28.401+0000 7f6ef77d2700 1 -- 172.21.15.80:0/1047167810 >> 172.21.15.80:0/1047167810 conn(0x7f6ef0127dc0 msgr2=0x7f6ef0141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:28.404 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2019-11-28T12:02:29.407 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:29.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.533+0000 7fa5f1fb9700 1 Processor -- start 2019-11-28T12:02:29.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.533+0000 7fa5f1fb9700 1 -- start start 2019-11-28T12:02:29.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.534+0000 7fa5f1fb9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa5ec06c0a0 0x7fa5ec072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:29.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.534+0000 7fa5f1fb9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5ec0734e0 0x7fa5ec071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:29.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.534+0000 7fa5f1fb9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ec06db00 con 0x7fa5ec072360 2019-11-28T12:02:29.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.534+0000 7fa5f1fb9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ec06fd60 con 0x7fa5ec06c0a0 2019-11-28T12:02:29.532 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.534+0000 7fa5f1fb9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec070030 con 0x7fa5ec0734e0 2019-11-28T12:02:29.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.534+0000 7fa5e3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5ec0734e0 0x7fa5ec071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:29.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.534+0000 7fa5ebfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa5ec06c0a0 0x7fa5ec072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:29.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.534+0000 7fa5f0d57700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa5ec072360 0x7fa5ec06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:34828/0 (socket says 172.21.15.80:34828) 2019-11-28T12:02:29.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.534+0000 7fa5f0d57700 1 -- 172.21.15.80:0/1611970583 learned_addr learned my addr 172.21.15.80:0/1611970583 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:29.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5ebfff700 1 -- 172.21.15.80:0/1611970583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5ec0734e0 msgr2=0x7fa5ec071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:29.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5ebfff700 1 --2- 172.21.15.80:0/1611970583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5ec0734e0 0x7fa5ec071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:29.533 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5ebfff700 1 -- 172.21.15.80:0/1611970583 >> v1:172.21.15.174:6789/0 conn(0x7fa5ec072360 legacy=0x7fa5ec06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:29.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5eb7fe700 1 -- 172.21.15.80:0/1611970583 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212273038 0 0) 0x7fa5e40014d0 con 0x7fa5ec072360 2019-11-28T12:02:29.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5ebfff700 1 -- 172.21.15.80:0/1611970583 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec0706c0 con 0x7fa5ec06c0a0 2019-11-28T12:02:29.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5e3fff700 1 --2- 172.21.15.80:0/1611970583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5ec0734e0 0x7fa5ec071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:29.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5ebfff700 1 --2- 172.21.15.80:0/1611970583 >> v2:172.21.15.174:3300/0 conn(0x7fa5ec06c0a0 0x7fa5ec072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa5dc00af50 tx=0x7fa5dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:29.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5ebfff700 1 --2- 172.21.15.80:0/1611970583 >> v2:172.21.15.174:3300/0 conn(0x7fa5ec06c0a0 0x7fa5ec072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa5dc00af50 tx=0x7fa5dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:29.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5ebfff700 1 --2- 172.21.15.80:0/1611970583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5ec06c0a0 0x7fa5ec072fa0 secure :-1 s=READY pgs=1868 cs=0 l=1 rx=0x7fa5dc00af50 tx=0x7fa5dc00b760).ready entity=mon.1 client_cookie=3ef8a51170586f73 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:29.534 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5ebfff700 1 --2- 172.21.15.80:0/1611970583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5ec06c0a0 0x7fa5ec072fa0 secure :-1 s=THROTTLE_DONE pgs=1868 cs=0 l=1 rx=0x7fa5dc00af50 tx=0x7fa5dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:29.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5eb7fe700 1 -- 172.21.15.80:0/1611970583 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5dc007210 con 0x7fa5ec06c0a0 2019-11-28T12:02:29.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5ebfff700 1 --2- 172.21.15.80:0/1611970583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5ec06c0a0 0x7fa5ec072fa0 secure :-1 s=THROTTLE_DONE pgs=1868 cs=0 l=1 rx=0x7fa5dc00af50 tx=0x7fa5dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:29.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5ebfff700 1 --2- 172.21.15.80:0/1611970583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5ec06c0a0 0x7fa5ec072fa0 secure :-1 s=THROTTLE_DONE pgs=1868 cs=0 l=1 rx=0x7fa5dc00af50 tx=0x7fa5dc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:29.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5eb7fe700 1 -- 172.21.15.80:0/1611970583 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc0099b0 con 0x7fa5ec06c0a0 2019-11-28T12:02:29.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5eb7fe700 1 -- 172.21.15.80:0/1611970583 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5dc007210 con 0x7fa5ec06c0a0 2019-11-28T12:02:29.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5f1fb9700 1 -- 172.21.15.80:0/1611970583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5ec06c0a0 msgr2=0x7fa5ec072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:29.535 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.535+0000 7fa5f1fb9700 1 --2- 172.21.15.80:0/1611970583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5ec06c0a0 0x7fa5ec072fa0 secure :-1 s=READY pgs=1868 cs=0 l=1 rx=0x7fa5dc00af50 tx=0x7fa5dc00b760).stop 2019-11-28T12:02:29.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.536+0000 7fa5f1fb9700 1 -- 172.21.15.80:0/1611970583 shutdown_connections 2019-11-28T12:02:29.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.536+0000 7fa5f1fb9700 1 --2- 172.21.15.80:0/1611970583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5ec0734e0 0x7fa5ec071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:29.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.536+0000 7fa5f1fb9700 1 --2- 172.21.15.80:0/1611970583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5ec06c0a0 0x7fa5ec072fa0 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:29.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.536+0000 7fa5f1fb9700 1 -- 172.21.15.80:0/1611970583 shutdown_connections 2019-11-28T12:02:29.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.536+0000 7fa5f1fb9700 1 -- 172.21.15.80:0/1611970583 wait complete. 2019-11-28T12:02:29.536 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.536+0000 7fa5f1fb9700 1 -- 172.21.15.80:0/1611970583 >> 172.21.15.80:0/1611970583 conn(0x7fa5ec061cf0 msgr2=0x7fa5ec064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:29.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.538+0000 7fa5f1fb9700 1 Processor -- start 2019-11-28T12:02:29.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.538+0000 7fa5f1fb9700 1 -- start start 2019-11-28T12:02:29.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.539+0000 7fa5f1fb9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5ec1653e0 0x7fa5ec13d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:29.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.539+0000 7fa5f1fb9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa5ec13db60 0x7fa5ec13dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:29.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.539+0000 7fa5f1fb9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ec131680 con 0x7fa5ec164ff0 2019-11-28T12:02:29.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.539+0000 7fa5f1fb9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ec10dd90 con 0x7fa5ec13db60 2019-11-28T12:02:29.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.539+0000 7fa5f1fb9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec10e060 con 0x7fa5ec1653e0 2019-11-28T12:02:29.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.539+0000 7fa5ebfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa5ec164ff0 0x7fa5ec133820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47518/0 (socket says 172.21.15.80:47518) 2019-11-28T12:02:29.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.539+0000 7fa5ebfff700 1 -- 172.21.15.80:0/2535270522 learned_addr learned my addr 172.21.15.80:0/2535270522 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:29.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.539+0000 7fa5f0d57700 1 --2- 172.21.15.80:0/2535270522 >> v2:172.21.15.80:3300/0 conn(0x7fa5ec13db60 0x7fa5ec13dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:29.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5e3fff700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5ec1653e0 0x7fa5ec13d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:29.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5e97fa700 1 -- 172.21.15.80:0/2535270522 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133025761 0 0) 0x7fa5dc00b460 con 0x7fa5ec164ff0 2019-11-28T12:02:29.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5e97fa700 1 -- 172.21.15.80:0/2535270522 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5d0002e80 con 0x7fa5ec164ff0 2019-11-28T12:02:29.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5f0d57700 1 -- 172.21.15.80:0/2535270522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5ec1653e0 msgr2=0x7fa5ec13d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:29.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5f0d57700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5ec1653e0 0x7fa5ec13d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:29.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5f0d57700 1 -- 172.21.15.80:0/2535270522 >> v1:172.21.15.80:6789/0 conn(0x7fa5ec164ff0 legacy=0x7fa5ec133820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:29.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5e97fa700 1 -- 172.21.15.80:0/2535270522 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1919773171 0 0) 0x7fa5dc00afc0 con 0x7fa5ec164ff0 2019-11-28T12:02:29.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5f0d57700 1 -- 172.21.15.80:0/2535270522 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec10e6f0 con 0x7fa5ec13db60 2019-11-28T12:02:29.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5f0d57700 1 --2- 172.21.15.80:0/2535270522 >> v2:172.21.15.80:3300/0 conn(0x7fa5ec13db60 0x7fa5ec13dfb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa5e40106f0 tx=0x7fa5e4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:29.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5f0d57700 1 --2- 172.21.15.80:0/2535270522 >> v2:172.21.15.80:3300/0 conn(0x7fa5ec13db60 0x7fa5ec13dfb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa5e40106f0 tx=0x7fa5e4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:29.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5f0d57700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5ec13db60 0x7fa5ec13dfb0 secure :-1 s=READY pgs=3085 cs=0 l=1 rx=0x7fa5e40106f0 tx=0x7fa5e4010520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:29.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5f0d57700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5ec13db60 0x7fa5ec13dfb0 secure :-1 s=THROTTLE_DONE pgs=3085 cs=0 l=1 rx=0x7fa5e40106f0 tx=0x7fa5e4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:29.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5e97fa700 1 -- 172.21.15.80:0/2535270522 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5e4000f40 con 0x7fa5ec13db60 2019-11-28T12:02:29.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5f0d57700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5ec13db60 0x7fa5ec13dfb0 secure :-1 s=THROTTLE_DONE pgs=3085 cs=0 l=1 rx=0x7fa5e40106f0 tx=0x7fa5e4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:29.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5f0d57700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5ec13db60 0x7fa5ec13dfb0 secure :-1 s=THROTTLE_DONE pgs=3085 cs=0 l=1 rx=0x7fa5e40106f0 tx=0x7fa5e4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:29.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5e97fa700 1 -- 172.21.15.80:0/2535270522 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e4004730 con 0x7fa5ec13db60 2019-11-28T12:02:29.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5e97fa700 1 -- 172.21.15.80:0/2535270522 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5e4000f40 con 0x7fa5ec13db60 2019-11-28T12:02:29.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5f1fb9700 1 -- 172.21.15.80:0/2535270522 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ec10ea70 con 0x7fa5ec13db60 2019-11-28T12:02:29.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.540+0000 7fa5f1fb9700 1 -- 172.21.15.80:0/2535270522 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec10e6f0 con 0x7fa5ec13db60 2019-11-28T12:02:29.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.541+0000 7fa5f0d57700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5ec13db60 0x7fa5ec13dfb0 secure :-1 s=THROTTLE_DONE pgs=3085 cs=0 l=1 rx=0x7fa5e40106f0 tx=0x7fa5e4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:29.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.541+0000 7fa5e97fa700 1 -- 172.21.15.80:0/2535270522 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa5e4004540 con 0x7fa5ec13db60 2019-11-28T12:02:29.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.541+0000 7fa5f0d57700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5ec13db60 0x7fa5ec13dfb0 secure :-1 s=THROTTLE_DONE pgs=3085 cs=0 l=1 rx=0x7fa5e40106f0 tx=0x7fa5e4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:29.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.541+0000 7fa5e97fa700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa5d0018780 0x7fa5d001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:29.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.541+0000 7fa5e97fa700 1 -- 172.21.15.80:0/2535270522 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(237..237 src has 1..237) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fa5e4031d90 con 0x7fa5ec13db60 2019-11-28T12:02:29.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.542+0000 7fa5ebfff700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa5d0018780 0x7fa5d001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:29.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.542+0000 7fa5ebfff700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa5d0018780 0x7fa5d001abf0 crc :-1 s=READY pgs=1279 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:29.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.548+0000 7fa5f1fb9700 1 -- 172.21.15.80:0/2535270522 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ec10ea70 con 0x7fa5ec13db60 2019-11-28T12:02:29.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.552+0000 7fa5f0d57700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5ec13db60 0x7fa5ec13dfb0 secure :-1 s=THROTTLE_DONE pgs=3085 cs=0 l=1 rx=0x7fa5e40106f0 tx=0x7fa5e4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:29.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.552+0000 7fa5e97fa700 1 -- 172.21.15.80:0/2535270522 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa5e40015b0 con 0x7fa5ec13db60 2019-11-28T12:02:29.716 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.723+0000 7fa5f1fb9700 1 -- 172.21.15.80:0/2535270522 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5ec10e6f0 con 0x7fa5ec13db60 2019-11-28T12:02:29.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.723+0000 7fa5f0d57700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5ec13db60 0x7fa5ec13dfb0 secure :-1 s=THROTTLE_DONE pgs=3085 cs=0 l=1 rx=0x7fa5e40106f0 tx=0x7fa5e4010520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:29.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.724+0000 7fa5e97fa700 1 -- 172.21.15.80:0/2535270522 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 200 v200) v1 ==== 95+0+2450 (secure 0 0 0) 0x7fa5e4004540 con 0x7fa5ec13db60 2019-11-28T12:02:29.718 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 200 2019-11-28T12:02:29.718 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:29.718 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":200,"default_fscid":19,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":12187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/174358448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":174358448},{"type":"v1","addr":"172.21.15.80:6835","nonce":174358448}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":199},{"gid":12996,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/2339800882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2339800882},{"type":"v1","addr":"172.21.15.80:6833","nonce":2339800882}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":199}],"filesystems":[{"mdsmap":{"epoch":200,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:01:41.241732+0000","modified":"2019-11-28T12:02:28.786859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":235,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8393":{"gid":8393,"name":"c","rank":0,"incarnation":198,"state":"up:rejoin","state_seq":4,"addr":"172.21.15.174:6835/90324510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":90324510},{"type":"v1","addr":"172.21.15.174:6835","nonce":90324510}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[39],"metadata_pool":38,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":19}]} 2019-11-28T12:02:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.726+0000 7fa5f1fb9700 1 -- 172.21.15.80:0/2535270522 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa5d0018780 msgr2=0x7fa5d001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:29.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.726+0000 7fa5f1fb9700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa5d0018780 0x7fa5d001abf0 crc :-1 s=READY pgs=1279 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:29.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.726+0000 7fa5f1fb9700 1 -- 172.21.15.80:0/2535270522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5ec13db60 msgr2=0x7fa5ec13dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:29.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.726+0000 7fa5f1fb9700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5ec13db60 0x7fa5ec13dfb0 secure :-1 s=READY pgs=3085 cs=0 l=1 rx=0x7fa5e40106f0 tx=0x7fa5e4010520).stop 2019-11-28T12:02:29.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.726+0000 7fa5f1fb9700 1 -- 172.21.15.80:0/2535270522 shutdown_connections 2019-11-28T12:02:29.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.726+0000 7fa5f1fb9700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa5d0018780 0x7fa5d001abf0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:29.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.726+0000 7fa5f1fb9700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5ec13db60 0x7fa5ec13dfb0 unknown :-1 s=CLOSED pgs=3085 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:29.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.726+0000 7fa5f1fb9700 1 --2- 172.21.15.80:0/2535270522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5ec1653e0 0x7fa5ec13d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:29.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.726+0000 7fa5f1fb9700 1 -- 172.21.15.80:0/2535270522 shutdown_connections 2019-11-28T12:02:29.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.726+0000 7fa5f1fb9700 1 -- 172.21.15.80:0/2535270522 wait complete. 2019-11-28T12:02:29.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:29.726+0000 7fa5f1fb9700 1 -- 172.21.15.80:0/2535270522 >> 172.21.15.80:0/2535270522 conn(0x7fa5ec11bfc0 msgr2=0x7fa5ec141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:29.729 INFO:tasks.cephfs.filesystem:mapped states [u'up:rejoin'] to None 2019-11-28T12:02:30.730 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:30.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.858+0000 7f6e5ae38700 1 Processor -- start 2019-11-28T12:02:30.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.858+0000 7f6e5ae38700 1 -- start start 2019-11-28T12:02:30.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.859+0000 7f6e5ae38700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e5406d120 0x7f6e54165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:30.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.859+0000 7f6e5ae38700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5406d5a0 con 0x7f6e5406c490 2019-11-28T12:02:30.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.859+0000 7f6e5ae38700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5406db00 con 0x7f6e5406c0a0 2019-11-28T12:02:30.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.859+0000 7f6e5ae38700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5406fd60 con 0x7f6e5406d120 2019-11-28T12:02:30.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.859+0000 7f6e59bd6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e5406d120 0x7f6e54165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:30.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.859+0000 7f6e59bd6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e5406d120 0x7f6e54165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48212/0 (socket says 172.21.15.80:48212) 2019-11-28T12:02:30.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.859+0000 7f6e58bd4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6e5406c490 0x7f6e5406c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47530/0 (socket says 172.21.15.80:47530) 2019-11-28T12:02:30.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.859+0000 7f6e59bd6700 1 -- 172.21.15.80:0/3323118752 learned_addr learned my addr 172.21.15.80:0/3323118752 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:30.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.860+0000 7f6e59bd6700 1 -- 172.21.15.80:0/3323118752 >> v1:172.21.15.174:6789/0 conn(0x7f6e5406c0a0 legacy=0x7f6e54072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:30.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.860+0000 7f6e59bd6700 1 -- 172.21.15.80:0/3323118752 >> v1:172.21.15.80:6789/0 conn(0x7f6e5406c490 legacy=0x7f6e5406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:30.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.860+0000 7f6e59bd6700 1 -- 172.21.15.80:0/3323118752 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e540706c0 con 0x7f6e5406d120 2019-11-28T12:02:30.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.860+0000 7f6e53fff700 1 -- 172.21.15.80:0/3323118752 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554321792 0 0) 0x7f6e3c001480 con 0x7f6e5406c490 2019-11-28T12:02:30.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.860+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/3323118752 >> v2:172.21.15.80:3300/0 conn(0x7f6e5406d120 0x7f6e54165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6e4c00f730 tx=0x7f6e4c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:30.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.860+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/3323118752 >> v2:172.21.15.80:3300/0 conn(0x7f6e5406d120 0x7f6e54165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6e4c00f730 tx=0x7f6e4c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:30.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.860+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/3323118752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5406d120 0x7f6e54165d80 secure :-1 s=READY pgs=3087 cs=0 l=1 rx=0x7f6e4c00f730 tx=0x7f6e4c00fad0).ready entity=mon.0 client_cookie=4033791e65dca51f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:30.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.860+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/3323118752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5406d120 0x7f6e54165d80 secure :-1 s=THROTTLE_DONE pgs=3087 cs=0 l=1 rx=0x7f6e4c00f730 tx=0x7f6e4c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:30.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.860+0000 7f6e53fff700 1 -- 172.21.15.80:0/3323118752 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e4c0010e0 con 0x7f6e5406d120 2019-11-28T12:02:30.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.860+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/3323118752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5406d120 0x7f6e54165d80 secure :-1 s=THROTTLE_DONE pgs=3087 cs=0 l=1 rx=0x7f6e4c00f730 tx=0x7f6e4c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:30.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.860+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/3323118752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5406d120 0x7f6e54165d80 secure :-1 s=THROTTLE_DONE pgs=3087 cs=0 l=1 rx=0x7f6e4c00f730 tx=0x7f6e4c00fad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:30.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.860+0000 7f6e53fff700 1 -- 172.21.15.80:0/3323118752 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c000a70 con 0x7f6e5406d120 2019-11-28T12:02:30.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.860+0000 7f6e53fff700 1 -- 172.21.15.80:0/3323118752 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e4c0016c0 con 0x7f6e5406d120 2019-11-28T12:02:30.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.860+0000 7f6e5ae38700 1 -- 172.21.15.80:0/3323118752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5406d120 msgr2=0x7f6e54165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:30.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.860+0000 7f6e5ae38700 1 --2- 172.21.15.80:0/3323118752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5406d120 0x7f6e54165d80 secure :-1 s=READY pgs=3087 cs=0 l=1 rx=0x7f6e4c00f730 tx=0x7f6e4c00fad0).stop 2019-11-28T12:02:30.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.861+0000 7f6e5ae38700 1 -- 172.21.15.80:0/3323118752 shutdown_connections 2019-11-28T12:02:30.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.861+0000 7f6e5ae38700 1 --2- 172.21.15.80:0/3323118752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5406d120 0x7f6e54165d80 unknown :-1 s=CLOSED pgs=3087 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:30.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.861+0000 7f6e5ae38700 1 -- 172.21.15.80:0/3323118752 shutdown_connections 2019-11-28T12:02:30.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.861+0000 7f6e5ae38700 1 -- 172.21.15.80:0/3323118752 wait complete. 2019-11-28T12:02:30.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.861+0000 7f6e5ae38700 1 -- 172.21.15.80:0/3323118752 >> 172.21.15.80:0/3323118752 conn(0x7f6e54061cf0 msgr2=0x7f6e54064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:30.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.863+0000 7f6e5ae38700 1 Processor -- start 2019-11-28T12:02:30.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.863+0000 7f6e5ae38700 1 -- start start 2019-11-28T12:02:30.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.864+0000 7f6e5ae38700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6e54125700 0x7f6e54125b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:30.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.864+0000 7f6e5ae38700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e541260d0 0x7f6e54168b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:30.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.864+0000 7f6e5ae38700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e54126500 con 0x7f6e5412ae60 2019-11-28T12:02:30.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.864+0000 7f6e5ae38700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5412cf90 con 0x7f6e54125700 2019-11-28T12:02:30.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.864+0000 7f6e5ae38700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5412d260 con 0x7f6e541260d0 2019-11-28T12:02:30.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.864+0000 7f6e593d5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6e5412ae60 0x7f6e54126880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47532/0 (socket says 172.21.15.80:47532) 2019-11-28T12:02:30.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.864+0000 7f6e593d5700 1 -- 172.21.15.80:0/2641518399 learned_addr learned my addr 172.21.15.80:0/2641518399 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:30.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e541260d0 0x7f6e54168b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:30.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e58bd4700 1 --2- 172.21.15.80:0/2641518399 >> v2:172.21.15.174:3300/0 conn(0x7f6e54125700 0x7f6e54125b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:30.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e51ffb700 1 -- 172.21.15.80:0/2641518399 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170067196 0 0) 0x7f6e44001150 con 0x7f6e5412ae60 2019-11-28T12:02:30.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e51ffb700 1 -- 172.21.15.80:0/2641518399 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e38002e80 con 0x7f6e5412ae60 2019-11-28T12:02:30.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e59bd6700 1 -- 172.21.15.80:0/2641518399 >> v2:172.21.15.174:3300/0 conn(0x7f6e54125700 msgr2=0x7f6e54125b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:30.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/2641518399 >> v2:172.21.15.174:3300/0 conn(0x7f6e54125700 0x7f6e54125b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:30.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e59bd6700 1 -- 172.21.15.80:0/2641518399 >> v1:172.21.15.80:6789/0 conn(0x7f6e5412ae60 legacy=0x7f6e54126880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:30.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e51ffb700 1 -- 172.21.15.80:0/2641518399 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3710730607 0 0) 0x7f6e440012c0 con 0x7f6e5412ae60 2019-11-28T12:02:30.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e59bd6700 1 -- 172.21.15.80:0/2641518399 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5412b2f0 con 0x7f6e541260d0 2019-11-28T12:02:30.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e58bd4700 1 --2- 172.21.15.80:0/2641518399 >> v2:172.21.15.174:3300/0 conn(0x7f6e54125700 0x7f6e54125b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:30.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e541260d0 0x7f6e54168b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6e4c0009c0 tx=0x7f6e4c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:30.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e541260d0 0x7f6e54168b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6e4c0009c0 tx=0x7f6e4c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:30.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e541260d0 0x7f6e54168b50 secure :-1 s=READY pgs=446 cs=0 l=1 rx=0x7f6e4c0009c0 tx=0x7f6e4c010770).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:30.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e541260d0 0x7f6e54168b50 secure :-1 s=THROTTLE_DONE pgs=446 cs=0 l=1 rx=0x7f6e4c0009c0 tx=0x7f6e4c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:30.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e51ffb700 1 -- 172.21.15.80:0/2641518399 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e4c0014a0 con 0x7f6e541260d0 2019-11-28T12:02:30.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e541260d0 0x7f6e54168b50 secure :-1 s=THROTTLE_DONE pgs=446 cs=0 l=1 rx=0x7f6e4c0009c0 tx=0x7f6e4c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:30.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e51ffb700 1 -- 172.21.15.80:0/2641518399 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c007b00 con 0x7f6e541260d0 2019-11-28T12:02:30.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e5ae38700 1 -- 172.21.15.80:0/2641518399 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5412b2f0 con 0x7f6e541260d0 2019-11-28T12:02:30.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e541260d0 0x7f6e54168b50 secure :-1 s=THROTTLE_DONE pgs=446 cs=0 l=1 rx=0x7f6e4c0009c0 tx=0x7f6e4c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:30.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e51ffb700 1 -- 172.21.15.80:0/2641518399 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e4c0014a0 con 0x7f6e541260d0 2019-11-28T12:02:30.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.865+0000 7f6e5ae38700 1 -- 172.21.15.80:0/2641518399 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5412b2f0 con 0x7f6e541260d0 2019-11-28T12:02:30.871 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.866+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e541260d0 0x7f6e54168b50 secure :-1 s=THROTTLE_DONE pgs=446 cs=0 l=1 rx=0x7f6e4c0009c0 tx=0x7f6e4c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:30.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.866+0000 7f6e51ffb700 1 -- 172.21.15.80:0/2641518399 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6e4c0010c0 con 0x7f6e541260d0 2019-11-28T12:02:30.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.866+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e541260d0 0x7f6e54168b50 secure :-1 s=THROTTLE_DONE pgs=446 cs=0 l=1 rx=0x7f6e4c0009c0 tx=0x7f6e4c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:30.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.866+0000 7f6e51ffb700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e38018780 0x7f6e3801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:30.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.866+0000 7f6e51ffb700 1 -- 172.21.15.80:0/2641518399 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(237..237 src has 1..237) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f6e4c0319f0 con 0x7f6e541260d0 2019-11-28T12:02:30.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.866+0000 7f6e593d5700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e38018780 0x7f6e3801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:30.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.866+0000 7f6e593d5700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e38018780 0x7f6e3801abf0 crc :-1 s=READY pgs=1280 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:30.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.874+0000 7f6e5ae38700 1 -- 172.21.15.80:0/2641518399 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5412d8f0 con 0x7f6e541260d0 2019-11-28T12:02:30.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.878+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e541260d0 0x7f6e54168b50 secure :-1 s=THROTTLE_DONE pgs=446 cs=0 l=1 rx=0x7f6e4c0009c0 tx=0x7f6e4c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:30.874 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:30.878+0000 7f6e51ffb700 1 -- 172.21.15.80:0/2641518399 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6e4c007b00 con 0x7f6e541260d0 2019-11-28T12:02:31.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.052+0000 7f6e5ae38700 1 -- 172.21.15.80:0/2641518399 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e5412dc70 con 0x7f6e541260d0 2019-11-28T12:02:31.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.052+0000 7f6e59bd6700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e541260d0 0x7f6e54168b50 secure :-1 s=THROTTLE_DONE pgs=446 cs=0 l=1 rx=0x7f6e4c0009c0 tx=0x7f6e4c010770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.052+0000 7f6e51ffb700 1 -- 172.21.15.80:0/2641518399 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 201 v201) v1 ==== 95+0+2450 (secure 0 0 0) 0x7f6e4c000eb0 con 0x7f6e541260d0 2019-11-28T12:02:31.050 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 201 2019-11-28T12:02:31.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.055+0000 7f6e5ae38700 1 -- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e38018780 msgr2=0x7f6e3801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:31.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.055+0000 7f6e5ae38700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e38018780 0x7f6e3801abf0 crc :-1 s=READY pgs=1280 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:31.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.055+0000 7f6e5ae38700 1 -- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e541260d0 msgr2=0x7f6e54168b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:31.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.055+0000 7f6e5ae38700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e541260d0 0x7f6e54168b50 secure :-1 s=READY pgs=446 cs=0 l=1 rx=0x7f6e4c0009c0 tx=0x7f6e4c010770).stop 2019-11-28T12:02:31.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.055+0000 7f6e5ae38700 1 -- 172.21.15.80:0/2641518399 shutdown_connections 2019-11-28T12:02:31.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.055+0000 7f6e5ae38700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6e38018780 0x7f6e3801abf0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:31.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.055+0000 7f6e5ae38700 1 --2- 172.21.15.80:0/2641518399 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e541260d0 0x7f6e54168b50 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:31.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.055+0000 7f6e5ae38700 1 --2- 172.21.15.80:0/2641518399 >> v2:172.21.15.174:3300/0 conn(0x7f6e54125700 0x7f6e54125b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:31.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.055+0000 7f6e5ae38700 1 -- 172.21.15.80:0/2641518399 shutdown_connections 2019-11-28T12:02:31.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.055+0000 7f6e5ae38700 1 -- 172.21.15.80:0/2641518399 wait complete. 2019-11-28T12:02:31.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.055+0000 7f6e5ae38700 1 -- 172.21.15.80:0/2641518399 >> 172.21.15.80:0/2641518399 conn(0x7f6e541571f0 msgr2=0x7f6e54142ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:31.052 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:31.052 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":201,"default_fscid":19,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":12187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/174358448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":174358448},{"type":"v1","addr":"172.21.15.80:6835","nonce":174358448}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":199},{"gid":12996,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/2339800882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2339800882},{"type":"v1","addr":"172.21.15.80:6833","nonce":2339800882}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":199}],"filesystems":[{"mdsmap":{"epoch":201,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:01:41.241732+0000","modified":"2019-11-28T12:02:29.791213+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":235,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8393":{"gid":8393,"name":"c","rank":0,"incarnation":198,"state":"up:active","state_seq":5,"addr":"172.21.15.174:6835/90324510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":90324510},{"type":"v1","addr":"172.21.15.174:6835","nonce":90324510}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[39],"metadata_pool":38,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":19}]} 2019-11-28T12:02:31.058 INFO:tasks.cephfs.filesystem:mapped states [u'up:active'] to up:active 2019-11-28T12:02:31.058 INFO:tasks.cephfs.filesystem:reached state 'up:active' in 8.31860899925s 2019-11-28T12:02:31.058 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:31.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.184+0000 7fab3f9dd700 1 Processor -- start 2019-11-28T12:02:31.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.185+0000 7fab3f9dd700 1 -- start start 2019-11-28T12:02:31.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.185+0000 7fab3f9dd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab3806c490 0x7fab3806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:31.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.185+0000 7fab3f9dd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab3806ce60 0x7fab38164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:31.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.185+0000 7fab3f9dd700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3806db00 con 0x7fab3806c0a0 2019-11-28T12:02:31.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.185+0000 7fab3f9dd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab3806fd60 con 0x7fab3806ce60 2019-11-28T12:02:31.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3f9dd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab38070030 con 0x7fab3806c490 2019-11-28T12:02:31.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3e77b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab3806ce60 0x7fab38164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:31.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3e77b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fab3806ce60 0x7fab38164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48226/0 (socket says 172.21.15.80:48226) 2019-11-28T12:02:31.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3e77b700 1 -- 172.21.15.80:0/2841716133 learned_addr learned my addr 172.21.15.80:0/2841716133 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:31.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3df7a700 1 --1- 172.21.15.80:0/2841716133 >> v1:172.21.15.80:6789/0 conn(0x7fab3806c0a0 0x7fab38072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47540/0 (socket says 172.21.15.80:47540) 2019-11-28T12:02:31.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3d779700 1 --2- 172.21.15.80:0/2841716133 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab3806c490 0x7fab3806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:31.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3e77b700 1 -- 172.21.15.80:0/2841716133 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab3806c490 msgr2=0x7fab3806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:31.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3e77b700 1 --2- 172.21.15.80:0/2841716133 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab3806c490 0x7fab3806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:31.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3e77b700 1 -- 172.21.15.80:0/2841716133 >> v1:172.21.15.80:6789/0 conn(0x7fab3806c0a0 legacy=0x7fab38072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:31.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3e77b700 1 -- 172.21.15.80:0/2841716133 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab380706c0 con 0x7fab3806ce60 2019-11-28T12:02:31.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3e77b700 1 --2- 172.21.15.80:0/2841716133 >> v2:172.21.15.80:3300/0 conn(0x7fab3806ce60 0x7fab38164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fab3000f730 tx=0x7fab30007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3e77b700 1 --2- 172.21.15.80:0/2841716133 >> v2:172.21.15.80:3300/0 conn(0x7fab3806ce60 0x7fab38164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fab3000f730 tx=0x7fab30007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3e77b700 1 --2- 172.21.15.80:0/2841716133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab3806ce60 0x7fab38164d70 secure :-1 s=READY pgs=3090 cs=0 l=1 rx=0x7fab3000f730 tx=0x7fab30007d50).ready entity=mon.0 client_cookie=14fd15f1136301d8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:31.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3e77b700 1 --2- 172.21.15.80:0/2841716133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab3806ce60 0x7fab38164d70 secure :-1 s=THROTTLE_DONE pgs=3090 cs=0 l=1 rx=0x7fab3000f730 tx=0x7fab30007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3e77b700 1 --2- 172.21.15.80:0/2841716133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab3806ce60 0x7fab38164d70 secure :-1 s=THROTTLE_DONE pgs=3090 cs=0 l=1 rx=0x7fab3000f730 tx=0x7fab30007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3cf78700 1 -- 172.21.15.80:0/2841716133 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab30000a70 con 0x7fab3806ce60 2019-11-28T12:02:31.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3e77b700 1 --2- 172.21.15.80:0/2841716133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab3806ce60 0x7fab38164d70 secure :-1 s=THROTTLE_DONE pgs=3090 cs=0 l=1 rx=0x7fab3000f730 tx=0x7fab30007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3cf78700 1 -- 172.21.15.80:0/2841716133 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab300010e0 con 0x7fab3806ce60 2019-11-28T12:02:31.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3cf78700 1 -- 172.21.15.80:0/2841716133 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab300017b0 con 0x7fab3806ce60 2019-11-28T12:02:31.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3f9dd700 1 -- 172.21.15.80:0/2841716133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab3806ce60 msgr2=0x7fab38164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:31.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.186+0000 7fab3f9dd700 1 --2- 172.21.15.80:0/2841716133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab3806ce60 0x7fab38164d70 secure :-1 s=READY pgs=3090 cs=0 l=1 rx=0x7fab3000f730 tx=0x7fab30007d50).stop 2019-11-28T12:02:31.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.187+0000 7fab3f9dd700 1 -- 172.21.15.80:0/2841716133 shutdown_connections 2019-11-28T12:02:31.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.187+0000 7fab3f9dd700 1 --2- 172.21.15.80:0/2841716133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab3806ce60 0x7fab38164d70 unknown :-1 s=CLOSED pgs=3090 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:31.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.187+0000 7fab3f9dd700 1 --2- 172.21.15.80:0/2841716133 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab3806c490 0x7fab3806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:31.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.187+0000 7fab3f9dd700 1 -- 172.21.15.80:0/2841716133 shutdown_connections 2019-11-28T12:02:31.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.187+0000 7fab3f9dd700 1 -- 172.21.15.80:0/2841716133 wait complete. 2019-11-28T12:02:31.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.187+0000 7fab3f9dd700 1 -- 172.21.15.80:0/2841716133 >> 172.21.15.80:0/2841716133 conn(0x7fab38061cf0 msgr2=0x7fab38064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:31.204 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.190+0000 7fab3f9dd700 1 Processor -- start 2019-11-28T12:02:31.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.190+0000 7fab3f9dd700 1 -- start start 2019-11-28T12:02:31.205 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.190+0000 7fab3f9dd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab38104d10 0x7fab3810e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:31.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.190+0000 7fab3f9dd700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab38135c60 con 0x7fab3813eaf0 2019-11-28T12:02:31.206 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.190+0000 7fab3f9dd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab38101f00 con 0x7fab3810e670 2019-11-28T12:02:31.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.190+0000 7fab3f9dd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab38107cb0 con 0x7fab38104d10 2019-11-28T12:02:31.207 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab3e77b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fab3813eaf0 0x7fab3812c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47550/0 (socket says 172.21.15.80:47550) 2019-11-28T12:02:31.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab3e77b700 1 -- 172.21.15.80:0/2089612485 learned_addr learned my addr 172.21.15.80:0/2089612485 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:31.208 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab3df7a700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab38104d10 0x7fab3810e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:31.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab367fc700 1 -- 172.21.15.80:0/2089612485 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769440673 0 0) 0x7fab30000940 con 0x7fab3813eaf0 2019-11-28T12:02:31.209 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab367fc700 1 -- 172.21.15.80:0/2089612485 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab1c002e80 con 0x7fab3813eaf0 2019-11-28T12:02:31.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab367fc700 1 -- 172.21.15.80:0/2089612485 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967321587 0 0) 0x7fab200012b0 con 0x7fab3810e670 2019-11-28T12:02:31.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab367fc700 1 -- 172.21.15.80:0/2089612485 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab1c0030b0 con 0x7fab3810e670 2019-11-28T12:02:31.210 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab3df7a700 1 -- 172.21.15.80:0/2089612485 >> v1:172.21.15.174:6789/0 conn(0x7fab3810e670 legacy=0x7fab3813e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:31.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab367fc700 1 -- 172.21.15.80:0/2089612485 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3334825757 0 0) 0x7fab30000b60 con 0x7fab3813eaf0 2019-11-28T12:02:31.211 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab3df7a700 1 -- 172.21.15.80:0/2089612485 >> v1:172.21.15.80:6789/0 conn(0x7fab3813eaf0 legacy=0x7fab3812c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:31.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab3df7a700 1 -- 172.21.15.80:0/2089612485 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab381424f0 con 0x7fab38104d10 2019-11-28T12:02:31.212 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab3df7a700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab38104d10 0x7fab3810e130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab28010370 tx=0x7fab28010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.213 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab3df7a700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab38104d10 0x7fab3810e130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab28010370 tx=0x7fab28010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab3df7a700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab38104d10 0x7fab3810e130 secure :-1 s=READY pgs=447 cs=0 l=1 rx=0x7fab28010370 tx=0x7fab28010710).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:31.214 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab3df7a700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab38104d10 0x7fab3810e130 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7fab28010370 tx=0x7fab28010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab367fc700 1 -- 172.21.15.80:0/2089612485 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab28004240 con 0x7fab38104d10 2019-11-28T12:02:31.215 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab3df7a700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab38104d10 0x7fab3810e130 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7fab28010370 tx=0x7fab28010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab3df7a700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab38104d10 0x7fab3810e130 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7fab28010370 tx=0x7fab28010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.216 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab367fc700 1 -- 172.21.15.80:0/2089612485 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab28000c90 con 0x7fab38104d10 2019-11-28T12:02:31.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab367fc700 1 -- 172.21.15.80:0/2089612485 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab28004240 con 0x7fab38104d10 2019-11-28T12:02:31.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.191+0000 7fab3f9dd700 1 -- 172.21.15.80:0/2089612485 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab381424f0 con 0x7fab38104d10 2019-11-28T12:02:31.217 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.192+0000 7fab3f9dd700 1 -- 172.21.15.80:0/2089612485 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab381424f0 con 0x7fab38104d10 2019-11-28T12:02:31.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.192+0000 7fab3df7a700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab38104d10 0x7fab3810e130 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7fab28010370 tx=0x7fab28010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.192+0000 7fab367fc700 1 -- 172.21.15.80:0/2089612485 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fab28004240 con 0x7fab38104d10 2019-11-28T12:02:31.218 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.192+0000 7fab3df7a700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab38104d10 0x7fab3810e130 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7fab28010370 tx=0x7fab28010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.192+0000 7fab367fc700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab1c018750 0x7fab1c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:31.220 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.192+0000 7fab367fc700 1 -- 172.21.15.80:0/2089612485 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(237..237 src has 1..237) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fab28031a50 con 0x7fab38104d10 2019-11-28T12:02:31.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.192+0000 7fab3d779700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab1c018750 0x7fab1c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:31.221 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.193+0000 7fab3d779700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab1c018750 0x7fab1c01abe0 crc :-1 s=READY pgs=1281 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:31.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.200+0000 7fab3f9dd700 1 -- 172.21.15.80:0/2089612485 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab381424f0 con 0x7fab38104d10 2019-11-28T12:02:31.222 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.203+0000 7fab3df7a700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab38104d10 0x7fab3810e130 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7fab28010370 tx=0x7fab28010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.223 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.203+0000 7fab367fc700 1 -- 172.21.15.80:0/2089612485 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fab2801e960 con 0x7fab38104d10 2019-11-28T12:02:31.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.376+0000 7fab3f9dd700 1 -- 172.21.15.80:0/2089612485 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab381424f0 con 0x7fab38104d10 2019-11-28T12:02:31.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.376+0000 7fab3df7a700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab38104d10 0x7fab3810e130 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7fab28010370 tx=0x7fab28010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.376+0000 7fab367fc700 1 -- 172.21.15.80:0/2089612485 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 201 v201) v1 ==== 95+0+2450 (secure 0 0 0) 0x7fab2801e960 con 0x7fab38104d10 2019-11-28T12:02:31.370 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:31.371 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":201,"default_fscid":19,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":12187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6835/174358448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":174358448},{"type":"v1","addr":"172.21.15.80:6835","nonce":174358448}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":199},{"gid":12996,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6833/2339800882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":2339800882},{"type":"v1","addr":"172.21.15.80:6833","nonce":2339800882}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":199}],"filesystems":[{"mdsmap":{"epoch":201,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:01:41.241732+0000","modified":"2019-11-28T12:02:29.791213+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":235,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8393":{"gid":8393,"name":"c","rank":0,"incarnation":198,"state":"up:active","state_seq":5,"addr":"172.21.15.174:6835/90324510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":90324510},{"type":"v1","addr":"172.21.15.174:6835","nonce":90324510}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[39],"metadata_pool":38,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":19}]} 2019-11-28T12:02:31.371 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 201 2019-11-28T12:02:31.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.379+0000 7fab3f9dd700 1 -- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab1c018750 msgr2=0x7fab1c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:31.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.379+0000 7fab3f9dd700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab1c018750 0x7fab1c01abe0 crc :-1 s=READY pgs=1281 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:31.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.379+0000 7fab3f9dd700 1 -- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab38104d10 msgr2=0x7fab3810e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:31.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.379+0000 7fab3f9dd700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab38104d10 0x7fab3810e130 secure :-1 s=READY pgs=447 cs=0 l=1 rx=0x7fab28010370 tx=0x7fab28010710).stop 2019-11-28T12:02:31.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.379+0000 7fab3f9dd700 1 -- 172.21.15.80:0/2089612485 shutdown_connections 2019-11-28T12:02:31.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.379+0000 7fab3f9dd700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fab1c018750 0x7fab1c01abe0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:31.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.379+0000 7fab3f9dd700 1 --2- 172.21.15.80:0/2089612485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab38104d10 0x7fab3810e130 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:31.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.379+0000 7fab3f9dd700 1 -- 172.21.15.80:0/2089612485 shutdown_connections 2019-11-28T12:02:31.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.379+0000 7fab3f9dd700 1 -- 172.21.15.80:0/2089612485 wait complete. 2019-11-28T12:02:31.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.379+0000 7fab3f9dd700 1 -- 172.21.15.80:0/2089612485 >> 172.21.15.80:0/2089612485 conn(0x7fab3815e210 msgr2=0x7fab3810b140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:31.382 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok session ls 2019-11-28T12:02:31.510 INFO:teuthology.orchestra.run.smithi174.stdout:[ 2019-11-28T12:02:31.510 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T12:02:31.514 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 12957, 2019-11-28T12:02:31.514 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T12:02:31.514 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T12:02:31.515 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T12:02:31.515 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 12957 2019-11-28T12:02:31.515 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:31.516 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T12:02:31.516 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T12:02:31.516 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.16:0", 2019-11-28T12:02:31.516 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 2235080438 2019-11-28T12:02:31.517 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T12:02:31.517 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:31.518 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T12:02:31.518 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T12:02:31.518 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 1, 2019-11-28T12:02:31.518 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 0, 2019-11-28T12:02:31.518 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 4.7168884880000004, 2019-11-28T12:02:31.518 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T12:02:31.518 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 0, 2019-11-28T12:02:31.519 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T12:02:31.519 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T12:02:31.519 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T12:02:31.519 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T12:02:31.519 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:31.519 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T12:02:31.519 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T12:02:31.520 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T12:02:31.520 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:31.520 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T12:02:31.520 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T12:02:31.520 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T12:02:31.520 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:31.521 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T12:02:31.521 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T12:02:31.521 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T12:02:31.521 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:31.521 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T12:02:31.521 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0.9914351360632343, 2019-11-28T12:02:31.522 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T12:02:31.522 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:31.522 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.12957 v1:172.21.15.16:0/2235080438", 2019-11-28T12:02:31.522 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [], 2019-11-28T12:02:31.522 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [], 2019-11-28T12:02:31.523 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T12:02:31.523 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T12:02:31.523 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T12:02:31.523 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "1", 2019-11-28T12:02:31.523 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi016", 2019-11-28T12:02:31.523 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T12:02:31.524 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T12:02:31.524 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T12:02:31.524 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:31.524 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T12:02:31.525 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 12097, 2019-11-28T12:02:31.525 INFO:teuthology.orchestra.run.smithi174.stdout: "entity": { 2019-11-28T12:02:31.525 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2019-11-28T12:02:31.525 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2019-11-28T12:02:31.525 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 12097 2019-11-28T12:02:31.525 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:31.526 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2019-11-28T12:02:31.526 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2019-11-28T12:02:31.526 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.76:0", 2019-11-28T12:02:31.526 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 50010668 2019-11-28T12:02:31.526 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T12:02:31.527 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:31.527 INFO:teuthology.orchestra.run.smithi174.stdout: "state": "open", 2019-11-28T12:02:31.527 INFO:teuthology.orchestra.run.smithi174.stdout: "num_leases": 0, 2019-11-28T12:02:31.527 INFO:teuthology.orchestra.run.smithi174.stdout: "num_caps": 1, 2019-11-28T12:02:31.527 INFO:teuthology.orchestra.run.smithi174.stdout: "request_load_avg": 0, 2019-11-28T12:02:31.527 INFO:teuthology.orchestra.run.smithi174.stdout: "uptime": 4.7168884880000004, 2019-11-28T12:02:31.527 INFO:teuthology.orchestra.run.smithi174.stdout: "requests_in_flight": 0, 2019-11-28T12:02:31.528 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": 1, 2019-11-28T12:02:31.528 INFO:teuthology.orchestra.run.smithi174.stdout: "reconnecting": false, 2019-11-28T12:02:31.528 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps": { 2019-11-28T12:02:31.528 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T12:02:31.528 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T12:02:31.528 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:31.529 INFO:teuthology.orchestra.run.smithi174.stdout: "release_caps": { 2019-11-28T12:02:31.529 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T12:02:31.529 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 60 2019-11-28T12:02:31.529 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:31.529 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle": { 2019-11-28T12:02:31.529 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T12:02:31.530 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 2.5 2019-11-28T12:02:31.530 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:31.530 INFO:teuthology.orchestra.run.smithi174.stdout: "recall_caps_throttle2o": { 2019-11-28T12:02:31.530 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0, 2019-11-28T12:02:31.530 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 0.5 2019-11-28T12:02:31.530 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:31.530 INFO:teuthology.orchestra.run.smithi174.stdout: "session_cache_liveness": { 2019-11-28T12:02:31.531 INFO:teuthology.orchestra.run.smithi174.stdout: "value": 0.9914351360632343, 2019-11-28T12:02:31.531 INFO:teuthology.orchestra.run.smithi174.stdout: "halflife": 300 2019-11-28T12:02:31.531 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2019-11-28T12:02:31.531 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": "client.12097 v1:172.21.15.76:0/50010668", 2019-11-28T12:02:31.531 INFO:teuthology.orchestra.run.smithi174.stdout: "completed_requests": [ 2019-11-28T12:02:31.531 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T12:02:31.531 INFO:teuthology.orchestra.run.smithi174.stdout: "tid": 1002, 2019-11-28T12:02:31.532 INFO:teuthology.orchestra.run.smithi174.stdout: "created_ino": "0x100000001f3" 2019-11-28T12:02:31.532 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T12:02:31.532 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2019-11-28T12:02:31.532 INFO:teuthology.orchestra.run.smithi174.stdout: "prealloc_inos": [ 2019-11-28T12:02:31.532 INFO:teuthology.orchestra.run.smithi174.stdout: { 2019-11-28T12:02:31.532 INFO:teuthology.orchestra.run.smithi174.stdout: "start": 1099511628276, 2019-11-28T12:02:31.532 INFO:teuthology.orchestra.run.smithi174.stdout: "length": 501 2019-11-28T12:02:31.533 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T12:02:31.533 INFO:teuthology.orchestra.run.smithi174.stdout: ], 2019-11-28T12:02:31.533 INFO:teuthology.orchestra.run.smithi174.stdout: "used_inos": [], 2019-11-28T12:02:31.533 INFO:teuthology.orchestra.run.smithi174.stdout: "client_metadata": { 2019-11-28T12:02:31.533 INFO:teuthology.orchestra.run.smithi174.stdout: "features": "00000000000000ff", 2019-11-28T12:02:31.533 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "0", 2019-11-28T12:02:31.533 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi076.front.sepia.ceph.com", 2019-11-28T12:02:31.534 INFO:teuthology.orchestra.run.smithi174.stdout: "kernel_version": "3.10.0-1062.4.1.el7.x86_64", 2019-11-28T12:02:31.534 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2019-11-28T12:02:31.534 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T12:02:31.534 INFO:teuthology.orchestra.run.smithi174.stdout: } 2019-11-28T12:02:31.534 INFO:teuthology.orchestra.run.smithi174.stdout:] 2019-11-28T12:02:31.535 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 12957, "entity": { "name": { "type": "client", "num": 12957 }, "addr": { "type": "v1", "addr": "172.21.15.16:0", "nonce": 2235080438 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 4.7168884880000004, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.9914351360632343, "halflife": 300 }, "inst": "client.12957 v1:172.21.15.16:0/2235080438", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "1", "hostname": "smithi016", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } }, { "id": 12097, "entity": { "name": { "type": "client", "num": 12097 }, "addr": { "type": "v1", "addr": "172.21.15.76:0", "nonce": 50010668 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 4.7168884880000004, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.9914351360632343, "halflife": 300 }, "inst": "client.12097 v1:172.21.15.76:0/50010668", "completed_requests": [ { "tid": 1002, "created_ino": "0x100000001f3" } ], "prealloc_inos": [ { "start": 1099511628276, "length": 501 } ], "used_inos": [], "client_metadata": { "features": "00000000000000ff", "entity_id": "0", "hostname": "smithi076.front.sepia.ceph.com", "kernel_version": "3.10.0-1062.4.1.el7.x86_64", "root": "/" } } ] 2019-11-28T12:02:31.536 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_trim_caps' 2019-11-28T12:02:31.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.662+0000 7fbd7744b700 1 Processor -- start 2019-11-28T12:02:31.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.662+0000 7fbd7744b700 1 -- start start 2019-11-28T12:02:31.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.663+0000 7fbd7744b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbd7006c490 0x7fbd7006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:31.662 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.663+0000 7fbd7744b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd7006ce60 0x7fbd70164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:31.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.663+0000 7fbd7744b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7006db00 con 0x7fbd7006c0a0 2019-11-28T12:02:31.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.663+0000 7fbd7744b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7006fd60 con 0x7fbd7006c490 2019-11-28T12:02:31.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.663+0000 7fbd7744b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd70070030 con 0x7fbd7006ce60 2019-11-28T12:02:31.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd759e8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbd7006c0a0 0x7fbd70072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47554/0 (socket says 172.21.15.80:47554) 2019-11-28T12:02:31.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd759e8700 1 -- 172.21.15.80:0/40726326 learned_addr learned my addr 172.21.15.80:0/40726326 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:31.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd751e7700 1 --2- 172.21.15.80:0/40726326 >> v2:172.21.15.174:3300/0 conn(0x7fbd7006c490 0x7fbd7006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:31.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd761e9700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd7006ce60 0x7fbd70164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:31.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd749e6700 1 -- 172.21.15.80:0/40726326 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494336812 0 0) 0x7fbd58001150 con 0x7fbd7006c0a0 2019-11-28T12:02:31.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd749e6700 1 -- 172.21.15.80:0/40726326 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd5c002e80 con 0x7fbd7006c0a0 2019-11-28T12:02:31.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd749e6700 1 -- 172.21.15.80:0/40726326 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3785373165 0 0) 0x7fbd58001130 con 0x7fbd7006c0a0 2019-11-28T12:02:31.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd749e6700 1 -- 172.21.15.80:0/40726326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd7006ce60 msgr2=0x7fbd70164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:31.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd749e6700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd7006ce60 0x7fbd70164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:31.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd749e6700 1 -- 172.21.15.80:0/40726326 >> v2:172.21.15.174:3300/0 conn(0x7fbd7006c490 msgr2=0x7fbd7006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:31.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd749e6700 1 --2- 172.21.15.80:0/40726326 >> v2:172.21.15.174:3300/0 conn(0x7fbd7006c490 0x7fbd7006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:31.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd749e6700 1 -- 172.21.15.80:0/40726326 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd700706c0 con 0x7fbd7006c0a0 2019-11-28T12:02:31.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd749e6700 1 -- 172.21.15.80:0/40726326 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fbd58001660 con 0x7fbd7006c0a0 2019-11-28T12:02:31.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd749e6700 1 -- 172.21.15.80:0/40726326 >> v1:172.21.15.80:6789/0 conn(0x7fbd7006c0a0 legacy=0x7fbd70072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:31.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd749e6700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd5c047a80 0x7fbd5c049ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:31.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd749e6700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd5c04a640 0x7fbd5c04cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:31.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd749e6700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd5c04d310 0x7fbd5c04f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:31.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd749e6700 1 -- 172.21.15.80:0/40726326 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c04fff0 con 0x7fbd5c04a640 2019-11-28T12:02:31.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd749e6700 1 -- 172.21.15.80:0/40726326 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c0501e0 con 0x7fbd5c04d310 2019-11-28T12:02:31.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd749e6700 1 -- 172.21.15.80:0/40726326 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c050410 con 0x7fbd5c047a80 2019-11-28T12:02:31.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd751e7700 1 --2- 172.21.15.80:0/40726326 >> v2:172.21.15.174:3300/0 conn(0x7fbd7006c490 0x7fbd7006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:31.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.664+0000 7fbd759e8700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd5c047a80 0x7fbd5c049ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:31.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd751e7700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd5c04a640 0x7fbd5c04cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:31.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd761e9700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd5c04d310 0x7fbd5c04f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:31.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd751e7700 1 -- 172.21.15.80:0/40726326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd5c047a80 msgr2=0x7fbd5c049ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:31.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd751e7700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd5c047a80 0x7fbd5c049ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:31.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd751e7700 1 -- 172.21.15.80:0/40726326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd5c04d310 msgr2=0x7fbd5c04f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:31.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd751e7700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd5c04d310 0x7fbd5c04f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:31.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd751e7700 1 -- 172.21.15.80:0/40726326 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5c0506c0 con 0x7fbd5c04a640 2019-11-28T12:02:31.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd759e8700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd5c047a80 0x7fbd5c049ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:31.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd751e7700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd5c04a640 0x7fbd5c04cb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbd6000d4e0 tx=0x7fbd6000d840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd751e7700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd5c04a640 0x7fbd5c04cb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbd6000d4e0 tx=0x7fbd6000d840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd751e7700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd5c04a640 0x7fbd5c04cb10 secure :-1 s=READY pgs=3093 cs=0 l=1 rx=0x7fbd6000d4e0 tx=0x7fbd6000d840).ready entity=mon.0 client_cookie=360789a5f99e76b4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:31.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd751e7700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd5c04a640 0x7fbd5c04cb10 secure :-1 s=THROTTLE_DONE pgs=3093 cs=0 l=1 rx=0x7fbd6000d4e0 tx=0x7fbd6000d840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd751e7700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd5c04a640 0x7fbd5c04cb10 secure :-1 s=THROTTLE_DONE pgs=3093 cs=0 l=1 rx=0x7fbd6000d4e0 tx=0x7fbd6000d840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd749e6700 1 -- 172.21.15.80:0/40726326 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd6000ab60 con 0x7fbd5c04a640 2019-11-28T12:02:31.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd751e7700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd5c04a640 0x7fbd5c04cb10 secure :-1 s=THROTTLE_DONE pgs=3093 cs=0 l=1 rx=0x7fbd6000d4e0 tx=0x7fbd6000d840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd749e6700 1 -- 172.21.15.80:0/40726326 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd60009770 con 0x7fbd5c04a640 2019-11-28T12:02:31.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd749e6700 1 -- 172.21.15.80:0/40726326 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd60009e40 con 0x7fbd5c04a640 2019-11-28T12:02:31.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd7744b700 1 -- 172.21.15.80:0/40726326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd5c04a640 msgr2=0x7fbd5c04cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:31.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd7744b700 1 --2- 172.21.15.80:0/40726326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd5c04a640 0x7fbd5c04cb10 secure :-1 s=READY pgs=3093 cs=0 l=1 rx=0x7fbd6000d4e0 tx=0x7fbd6000d840).stop 2019-11-28T12:02:31.669 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.665+0000 7fbd761e9700 1 -- 172.21.15.80:0/40726326 reap_dead start 2019-11-28T12:02:31.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.666+0000 7fbd7744b700 1 -- 172.21.15.80:0/40726326 shutdown_connections 2019-11-28T12:02:31.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.666+0000 7fbd7744b700 1 -- 172.21.15.80:0/40726326 shutdown_connections 2019-11-28T12:02:31.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.666+0000 7fbd7744b700 1 -- 172.21.15.80:0/40726326 wait complete. 2019-11-28T12:02:31.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.666+0000 7fbd7744b700 1 -- 172.21.15.80:0/40726326 >> 172.21.15.80:0/40726326 conn(0x7fbd70061cf0 msgr2=0x7fbd70064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:31.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.669+0000 7fbd7744b700 1 Processor -- start 2019-11-28T12:02:31.670 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.669+0000 7fbd7744b700 1 -- start start 2019-11-28T12:02:31.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.669+0000 7fbd7744b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbd70139620 0x7fbd70139ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:31.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.669+0000 7fbd7744b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd70166ea0 0x7fbd701692a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:31.681 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.669+0000 7fbd7744b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd70137060 con 0x7fbd70106930 2019-11-28T12:02:31.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.669+0000 7fbd7744b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd70114e70 con 0x7fbd70139620 2019-11-28T12:02:31.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.669+0000 7fbd7744b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd70138890 con 0x7fbd70166ea0 2019-11-28T12:02:31.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd751e7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbd70139620 0x7fbd70139ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:31.682 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd759e8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbd70106930 0x7fbd7013a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47566/0 (socket says 172.21.15.80:47566) 2019-11-28T12:02:31.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd759e8700 1 -- 172.21.15.80:0/3986117858 learned_addr learned my addr 172.21.15.80:0/3986117858 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:31.683 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd761e9700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd70166ea0 0x7fbd701692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:31.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd751e7700 1 -- 172.21.15.80:0/3986117858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd70166ea0 msgr2=0x7fbd701692a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:31.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd751e7700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd70166ea0 0x7fbd701692a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:31.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd751e7700 1 -- 172.21.15.80:0/3986117858 >> v1:172.21.15.80:6789/0 conn(0x7fbd70106930 legacy=0x7fbd7013a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:31.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd751e7700 1 -- 172.21.15.80:0/3986117858 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd70115500 con 0x7fbd70139620 2019-11-28T12:02:31.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd6e7fc700 1 -- 172.21.15.80:0/3986117858 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173620628 0 0) 0x7fbd58001030 con 0x7fbd70106930 2019-11-28T12:02:31.686 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd751e7700 1 --2- 172.21.15.80:0/3986117858 >> v2:172.21.15.80:3300/0 conn(0x7fbd70139620 0x7fbd70139ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd600102e0 tx=0x7fbd60010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd751e7700 1 --2- 172.21.15.80:0/3986117858 >> v2:172.21.15.80:3300/0 conn(0x7fbd70139620 0x7fbd70139ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd600102e0 tx=0x7fbd60010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd751e7700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd70139620 0x7fbd70139ab0 secure :-1 s=READY pgs=3095 cs=0 l=1 rx=0x7fbd600102e0 tx=0x7fbd60010680).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:31.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd751e7700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd70139620 0x7fbd70139ab0 secure :-1 s=THROTTLE_DONE pgs=3095 cs=0 l=1 rx=0x7fbd600102e0 tx=0x7fbd60010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd751e7700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd70139620 0x7fbd70139ab0 secure :-1 s=THROTTLE_DONE pgs=3095 cs=0 l=1 rx=0x7fbd600102e0 tx=0x7fbd60010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd6e7fc700 1 -- 172.21.15.80:0/3986117858 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd6000ab60 con 0x7fbd70139620 2019-11-28T12:02:31.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd751e7700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd70139620 0x7fbd70139ab0 secure :-1 s=THROTTLE_DONE pgs=3095 cs=0 l=1 rx=0x7fbd600102e0 tx=0x7fbd60010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd6e7fc700 1 -- 172.21.15.80:0/3986117858 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd600097f0 con 0x7fbd70139620 2019-11-28T12:02:31.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd6e7fc700 1 -- 172.21.15.80:0/3986117858 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd60009f40 con 0x7fbd70139620 2019-11-28T12:02:31.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd7744b700 1 -- 172.21.15.80:0/3986117858 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd70115880 con 0x7fbd70139620 2019-11-28T12:02:31.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.670+0000 7fbd7744b700 1 -- 172.21.15.80:0/3986117858 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd701147b0 con 0x7fbd70139620 2019-11-28T12:02:31.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.671+0000 7fbd751e7700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd70139620 0x7fbd70139ab0 secure :-1 s=THROTTLE_DONE pgs=3095 cs=0 l=1 rx=0x7fbd600102e0 tx=0x7fbd60010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.690 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.671+0000 7fbd6e7fc700 1 -- 172.21.15.80:0/3986117858 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbd600099e0 con 0x7fbd70139620 2019-11-28T12:02:31.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.671+0000 7fbd751e7700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd70139620 0x7fbd70139ab0 secure :-1 s=THROTTLE_DONE pgs=3095 cs=0 l=1 rx=0x7fbd600102e0 tx=0x7fbd60010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.671+0000 7fbd6e7fc700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbd54018730 0x7fbd5401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:31.691 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.671+0000 7fbd6e7fc700 1 -- 172.21.15.80:0/3986117858 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(237..237 src has 1..237) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fbd60031a50 con 0x7fbd70139620 2019-11-28T12:02:31.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.671+0000 7fbd759e8700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbd54018730 0x7fbd5401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:31.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.672+0000 7fbd759e8700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbd54018730 0x7fbd5401abc0 crc :-1 s=READY pgs=1282 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:31.692 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.678+0000 7fbd7744b700 1 -- 172.21.15.80:0/3986117858 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd70115500 con 0x7fbd70139620 2019-11-28T12:02:31.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.681+0000 7fbd751e7700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd70139620 0x7fbd70139ab0 secure :-1 s=THROTTLE_DONE pgs=3095 cs=0 l=1 rx=0x7fbd600102e0 tx=0x7fbd60010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:31.693 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.681+0000 7fbd6e7fc700 1 -- 172.21.15.80:0/3986117858 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbd60000940 con 0x7fbd70139620 2019-11-28T12:02:31.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:31.857+0000 7fbd7744b700 1 -- 172.21.15.80:0/3986117858 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_trim_caps"]} v 0) v1 -- 0x7fbd70115880 con 0x7fbd70139620 2019-11-28T12:02:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:32.855+0000 7fbd751e7700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd70139620 0x7fbd70139ab0 secure :-1 s=THROTTLE_DONE pgs=3095 cs=0 l=1 rx=0x7fbd600102e0 tx=0x7fbd60010680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:32.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:32.855+0000 7fbd6e7fc700 1 -- 172.21.15.80:0/3986117858 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_trim_caps"]}]=0 v872) v1 ==== 146+0+0 (secure 0 0 0) 0x7fbd60009af0 con 0x7fbd70139620 2019-11-28T12:02:32.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:32.875+0000 7fbd7744b700 1 -- 172.21.15.80:0/3986117858 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbd54018730 msgr2=0x7fbd5401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:32.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:32.875+0000 7fbd7744b700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbd54018730 0x7fbd5401abc0 crc :-1 s=READY pgs=1282 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:32.875+0000 7fbd7744b700 1 -- 172.21.15.80:0/3986117858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd70139620 msgr2=0x7fbd70139ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:32.875+0000 7fbd7744b700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd70139620 0x7fbd70139ab0 secure :-1 s=READY pgs=3095 cs=0 l=1 rx=0x7fbd600102e0 tx=0x7fbd60010680).stop 2019-11-28T12:02:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:32.875+0000 7fbd7744b700 1 -- 172.21.15.80:0/3986117858 shutdown_connections 2019-11-28T12:02:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:32.875+0000 7fbd7744b700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbd54018730 0x7fbd5401abc0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:32.875+0000 7fbd7744b700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbd70166ea0 0x7fbd701692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:32.875+0000 7fbd7744b700 1 --2- 172.21.15.80:0/3986117858 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbd70139620 0x7fbd70139ab0 unknown :-1 s=CLOSED pgs=3095 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:32.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:32.875+0000 7fbd7744b700 1 -- 172.21.15.80:0/3986117858 shutdown_connections 2019-11-28T12:02:32.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:32.875+0000 7fbd7744b700 1 -- 172.21.15.80:0/3986117858 wait complete. 2019-11-28T12:02:32.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:32.875+0000 7fbd7744b700 1 -- 172.21.15.80:0/3986117858 >> 172.21.15.80:0/3986117858 conn(0x7fbd70141d10 msgr2=0x7fbd7013ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:32.879 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T12:02:32.879 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:02:32.946 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:02:33.006 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:02:33.065 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:02:33.121 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:02:33.181 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:02:33.247 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T12:02:33.247 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T12:02:33.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T12:02:33.247 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T12:02:33.316 INFO:teuthology.orchestra.run.smithi076:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T12:02:33.320 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T12:02:33.359 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T12:02:33.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T12:02:33.359 INFO:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.1 2019-11-28T12:02:33.480 INFO:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T12:02:33.484 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T12:02:33.525 INFO:tasks.cephfs_test_runner:test_trim_caps (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2019-11-28T12:02:33.525 INFO:tasks.cephfs_test_runner:Starting test: test_unmount_for_evicted_client (tasks.cephfs.test_client_recovery.TestClientRecovery) Test if client hangs on unmount after evicting the client. 2019-11-28T12:02:33.525 INFO:tasks.cephfs_test_runner:test_unmount_for_evicted_client (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T12:02:33.525 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_unmount_for_evicted_client' 2019-11-28T12:02:33.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.654+0000 7fa8b6662700 1 Processor -- start 2019-11-28T12:02:33.652 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.654+0000 7fa8b6662700 1 -- start start 2019-11-28T12:02:33.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.655+0000 7fa8b6662700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8b006c0a0 0x7fa8b0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:33.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.655+0000 7fa8b6662700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa8b00734e0 0x7fa8b0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:33.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.655+0000 7fa8b6662700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b006db00 con 0x7fa8b0072360 2019-11-28T12:02:33.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.655+0000 7fa8b6662700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b006f330 con 0x7fa8b00734e0 2019-11-28T12:02:33.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.655+0000 7fa8b6662700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00706c0 con 0x7fa8b006c0a0 2019-11-28T12:02:33.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8affff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa8b00734e0 0x7fa8b0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:33.653 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8b4bff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8b006c0a0 0x7fa8b0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:33.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8affff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa8b00734e0 0x7fa8b0071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:34912/0 (socket says 172.21.15.80:34912) 2019-11-28T12:02:33.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8b5400700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa8b0072360 0x7fa8b006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:34886/0 (socket says 172.21.15.80:34886) 2019-11-28T12:02:33.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8affff700 1 -- 172.21.15.80:0/1715031927 learned_addr learned my addr 172.21.15.80:0/1715031927 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:33.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8b4bff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8b006c0a0 0x7fa8b0072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:50518/0 (socket says 172.21.15.80:50518) 2019-11-28T12:02:33.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8affff700 1 -- 172.21.15.80:0/1715031927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8b006c0a0 msgr2=0x7fa8b0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:33.654 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8affff700 1 --2- 172.21.15.80:0/1715031927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8b006c0a0 0x7fa8b0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:33.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8affff700 1 -- 172.21.15.80:0/1715031927 >> v1:172.21.15.174:6789/0 conn(0x7fa8b0072360 legacy=0x7fa8b006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:33.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8affff700 1 -- 172.21.15.80:0/1715031927 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b0070a40 con 0x7fa8b00734e0 2019-11-28T12:02:33.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8af7fe700 1 -- 172.21.15.80:0/1715031927 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979094257 0 0) 0x7fa8a8001440 con 0x7fa8b0072360 2019-11-28T12:02:33.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8b4bff700 1 --2- 172.21.15.80:0/1715031927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8b006c0a0 0x7fa8b0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:33.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8affff700 1 --2- 172.21.15.80:0/1715031927 >> v2:172.21.15.174:3300/0 conn(0x7fa8b00734e0 0x7fa8b0071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa89c00f740 tx=0x7fa89c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:33.655 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8affff700 1 --2- 172.21.15.80:0/1715031927 >> v2:172.21.15.174:3300/0 conn(0x7fa8b00734e0 0x7fa8b0071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa89c00f740 tx=0x7fa89c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:33.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8affff700 1 --2- 172.21.15.80:0/1715031927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8b00734e0 0x7fa8b0071e20 secure :-1 s=READY pgs=1872 cs=0 l=1 rx=0x7fa89c00f740 tx=0x7fa89c00fae0).ready entity=mon.1 client_cookie=802ae4daff848751 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:33.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8affff700 1 --2- 172.21.15.80:0/1715031927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8b00734e0 0x7fa8b0071e20 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7fa89c00f740 tx=0x7fa89c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:33.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8af7fe700 1 -- 172.21.15.80:0/1715031927 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa89c000960 con 0x7fa8b00734e0 2019-11-28T12:02:33.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.656+0000 7fa8affff700 1 --2- 172.21.15.80:0/1715031927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8b00734e0 0x7fa8b0071e20 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7fa89c00f740 tx=0x7fa89c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:33.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.657+0000 7fa8affff700 1 --2- 172.21.15.80:0/1715031927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8b00734e0 0x7fa8b0071e20 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7fa89c00f740 tx=0x7fa89c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:33.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.657+0000 7fa8af7fe700 1 -- 172.21.15.80:0/1715031927 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c000c90 con 0x7fa8b00734e0 2019-11-28T12:02:33.656 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.657+0000 7fa8af7fe700 1 -- 172.21.15.80:0/1715031927 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa89c000960 con 0x7fa8b00734e0 2019-11-28T12:02:33.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.657+0000 7fa8b6662700 1 -- 172.21.15.80:0/1715031927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8b00734e0 msgr2=0x7fa8b0071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:33.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.657+0000 7fa8b6662700 1 --2- 172.21.15.80:0/1715031927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8b00734e0 0x7fa8b0071e20 secure :-1 s=READY pgs=1872 cs=0 l=1 rx=0x7fa89c00f740 tx=0x7fa89c00fae0).stop 2019-11-28T12:02:33.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.657+0000 7fa8b6662700 1 -- 172.21.15.80:0/1715031927 shutdown_connections 2019-11-28T12:02:33.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.657+0000 7fa8b6662700 1 --2- 172.21.15.80:0/1715031927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8b00734e0 0x7fa8b0071e20 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:33.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.657+0000 7fa8b6662700 1 --2- 172.21.15.80:0/1715031927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8b006c0a0 0x7fa8b0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:33.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.657+0000 7fa8b6662700 1 -- 172.21.15.80:0/1715031927 shutdown_connections 2019-11-28T12:02:33.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.657+0000 7fa8b6662700 1 -- 172.21.15.80:0/1715031927 wait complete. 2019-11-28T12:02:33.658 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.657+0000 7fa8b6662700 1 -- 172.21.15.80:0/1715031927 >> 172.21.15.80:0/1715031927 conn(0x7fa8b0061cf0 msgr2=0x7fa8b0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:33.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.660+0000 7fa8b6662700 1 Processor -- start 2019-11-28T12:02:33.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.660+0000 7fa8b6662700 1 -- start start 2019-11-28T12:02:33.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8b6662700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa8b015fdf0 0x7fa8b012b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:33.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8b6662700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8b012b8a0 0x7fa8b013e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:33.659 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8b6662700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8b013e860 0x7fa8b012a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:33.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8b6662700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b0108820 con 0x7fa8b012b8a0 2019-11-28T12:02:33.660 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8b6662700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b0108af0 con 0x7fa8b015fdf0 2019-11-28T12:02:33.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8b6662700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b0107df0 con 0x7fa8b013e860 2019-11-28T12:02:33.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8affff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8b012b8a0 0x7fa8b013e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:33.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8affff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8b012b8a0 0x7fa8b013e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48264/0 (socket says 172.21.15.80:48264) 2019-11-28T12:02:33.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8affff700 1 -- 172.21.15.80:0/2142280503 learned_addr learned my addr 172.21.15.80:0/2142280503 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:33.663 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8b4bff700 1 --2- 172.21.15.80:0/2142280503 >> v2:172.21.15.174:3300/0 conn(0x7fa8b015fdf0 0x7fa8b012b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8b5400700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8b013e860 0x7fa8b012a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8affff700 1 -- 172.21.15.80:0/2142280503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8b013e860 msgr2=0x7fa8b012a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8affff700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8b013e860 0x7fa8b012a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8affff700 1 -- 172.21.15.80:0/2142280503 >> v2:172.21.15.174:3300/0 conn(0x7fa8b015fdf0 msgr2=0x7fa8b012b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:33.664 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8affff700 1 --2- 172.21.15.80:0/2142280503 >> v2:172.21.15.174:3300/0 conn(0x7fa8b015fdf0 0x7fa8b012b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8affff700 1 -- 172.21.15.80:0/2142280503 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b010a8c0 con 0x7fa8b012b8a0 2019-11-28T12:02:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8affff700 1 --2- 172.21.15.80:0/2142280503 >> v2:172.21.15.80:3300/0 conn(0x7fa8b012b8a0 0x7fa8b013e320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa89c0544c0 tx=0x7fa89c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8affff700 1 --2- 172.21.15.80:0/2142280503 >> v2:172.21.15.80:3300/0 conn(0x7fa8b012b8a0 0x7fa8b013e320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa89c0544c0 tx=0x7fa89c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8affff700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8b012b8a0 0x7fa8b013e320 secure :-1 s=READY pgs=3096 cs=0 l=1 rx=0x7fa89c0544c0 tx=0x7fa89c054370).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8affff700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8b012b8a0 0x7fa8b013e320 secure :-1 s=THROTTLE_DONE pgs=3096 cs=0 l=1 rx=0x7fa89c0544c0 tx=0x7fa89c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8ad7fa700 1 -- 172.21.15.80:0/2142280503 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa89c007de0 con 0x7fa8b012b8a0 2019-11-28T12:02:33.665 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8affff700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8b012b8a0 0x7fa8b013e320 secure :-1 s=THROTTLE_DONE pgs=3096 cs=0 l=1 rx=0x7fa89c0544c0 tx=0x7fa89c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:33.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8affff700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8b012b8a0 0x7fa8b013e320 secure :-1 s=THROTTLE_DONE pgs=3096 cs=0 l=1 rx=0x7fa89c0544c0 tx=0x7fa89c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:33.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8ad7fa700 1 -- 172.21.15.80:0/2142280503 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c005370 con 0x7fa8b012b8a0 2019-11-28T12:02:33.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.661+0000 7fa8ad7fa700 1 -- 172.21.15.80:0/2142280503 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa89c005a40 con 0x7fa8b012b8a0 2019-11-28T12:02:33.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.662+0000 7fa8b6662700 1 -- 172.21.15.80:0/2142280503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b010a8c0 con 0x7fa8b012b8a0 2019-11-28T12:02:33.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.662+0000 7fa8b6662700 1 -- 172.21.15.80:0/2142280503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b010a8c0 con 0x7fa8b012b8a0 2019-11-28T12:02:33.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.662+0000 7fa8affff700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8b012b8a0 0x7fa8b013e320 secure :-1 s=THROTTLE_DONE pgs=3096 cs=0 l=1 rx=0x7fa89c0544c0 tx=0x7fa89c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:33.666 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.663+0000 7fa8ad7fa700 1 -- 172.21.15.80:0/2142280503 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa89c0029d0 con 0x7fa8b012b8a0 2019-11-28T12:02:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.663+0000 7fa8affff700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8b012b8a0 0x7fa8b013e320 secure :-1 s=THROTTLE_DONE pgs=3096 cs=0 l=1 rx=0x7fa89c0544c0 tx=0x7fa89c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.663+0000 7fa8ad7fa700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa890018730 0x7fa89001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.663+0000 7fa8ad7fa700 1 -- 172.21.15.80:0/2142280503 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(237..237 src has 1..237) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fa89c075a40 con 0x7fa8b012b8a0 2019-11-28T12:02:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.663+0000 7fa8b4bff700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa890018730 0x7fa89001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.663+0000 7fa8b4bff700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa890018730 0x7fa89001abc0 crc :-1 s=READY pgs=1283 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:33.667 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.669+0000 7fa8b6662700 1 -- 172.21.15.80:0/2142280503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b0109180 con 0x7fa8b012b8a0 2019-11-28T12:02:33.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.673+0000 7fa8affff700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8b012b8a0 0x7fa8b013e320 secure :-1 s=THROTTLE_DONE pgs=3096 cs=0 l=1 rx=0x7fa89c0544c0 tx=0x7fa89c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:33.668 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.673+0000 7fa8ad7fa700 1 -- 172.21.15.80:0/2142280503 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa89c007dc0 con 0x7fa8b012b8a0 2019-11-28T12:02:33.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.846+0000 7fa8b6662700 1 -- 172.21.15.80:0/2142280503 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_unmount_for_evicted_client"]} v 0) v1 -- 0x7fa8b0109500 con 0x7fa8b012b8a0 2019-11-28T12:02:33.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.856+0000 7fa8affff700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8b012b8a0 0x7fa8b013e320 secure :-1 s=THROTTLE_DONE pgs=3096 cs=0 l=1 rx=0x7fa89c0544c0 tx=0x7fa89c054370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:33.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.856+0000 7fa8ad7fa700 1 -- 172.21.15.80:0/2142280503 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_unmount_for_evicted_client"]}]=0 v873) v1 ==== 166+0+0 (secure 0 0 0) 0x7fa89c005180 con 0x7fa8b012b8a0 2019-11-28T12:02:33.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.863+0000 7fa8b6662700 1 -- 172.21.15.80:0/2142280503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa890018730 msgr2=0x7fa89001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:33.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.863+0000 7fa8b6662700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa890018730 0x7fa89001abc0 crc :-1 s=READY pgs=1283 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:33.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.863+0000 7fa8b6662700 1 -- 172.21.15.80:0/2142280503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8b012b8a0 msgr2=0x7fa8b013e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:33.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.863+0000 7fa8b6662700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8b012b8a0 0x7fa8b013e320 secure :-1 s=READY pgs=3096 cs=0 l=1 rx=0x7fa89c0544c0 tx=0x7fa89c054370).stop 2019-11-28T12:02:33.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.863+0000 7fa8b6662700 1 -- 172.21.15.80:0/2142280503 shutdown_connections 2019-11-28T12:02:33.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.863+0000 7fa8b6662700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa890018730 0x7fa89001abc0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:33.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.863+0000 7fa8b6662700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8b013e860 0x7fa8b012a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:33.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.863+0000 7fa8b6662700 1 --2- 172.21.15.80:0/2142280503 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8b012b8a0 0x7fa8b013e320 unknown :-1 s=CLOSED pgs=3096 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:33.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.863+0000 7fa8b6662700 1 --2- 172.21.15.80:0/2142280503 >> v2:172.21.15.174:3300/0 conn(0x7fa8b015fdf0 0x7fa8b012b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:33.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.863+0000 7fa8b6662700 1 -- 172.21.15.80:0/2142280503 shutdown_connections 2019-11-28T12:02:33.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.863+0000 7fa8b6662700 1 -- 172.21.15.80:0/2142280503 wait complete. 2019-11-28T12:02:33.858 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:33.863+0000 7fa8b6662700 1 -- 172.21.15.80:0/2142280503 >> 172.21.15.80:0/2142280503 conn(0x7fa8b0127dc0 msgr2=0x7fa8b0141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:33.874 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-11-28T12:02:33.874 INFO:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:02:33.944 INFO:teuthology.orchestra.run.smithi075:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:02:34.004 INFO:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:02:34.066 INFO:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:02:34.122 INFO:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:02:34.182 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-11-28T12:02:34.243 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-11-28T12:02:34.243 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T12:02:34.243 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T12:02:34.244 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T12:02:34.244 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T12:02:34.245 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T12:02:34.245 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T12:02:34.249 INFO:tasks.ceph.mds.c:Stopped 2019-11-28T12:02:34.250 DEBUG:teuthology.parallel:result is None 2019-11-28T12:02:34.251 INFO:tasks.ceph.mds.a:Stopped 2019-11-28T12:02:34.251 INFO:tasks.ceph.mds.b:Stopped 2019-11-28T12:02:34.252 DEBUG:teuthology.parallel:result is None 2019-11-28T12:02:34.252 DEBUG:teuthology.parallel:result is None 2019-11-28T12:02:34.252 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2019-11-28T12:02:34.253 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-11-28T12:02:34.254 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-11-28T12:02:34.460 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.461+0000 7f78036e1700 1 Processor -- start 2019-11-28T12:02:34.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.461+0000 7f78036e1700 1 -- start start 2019-11-28T12:02:34.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.462+0000 7f78036e1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f77fc06c0a0 0x7f77fc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:34.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.462+0000 7f78036e1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77fc06db00 con 0x7f77fc0734e0 2019-11-28T12:02:34.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.462+0000 7f78036e1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77fc06e000 con 0x7f77fc072620 2019-11-28T12:02:34.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.462+0000 7f78036e1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77fc06fd60 con 0x7f77fc06c0a0 2019-11-28T12:02:34.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.462+0000 7f780147d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f77fc0734e0 0x7f77fc071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47586/0 (socket says 172.21.15.80:47586) 2019-11-28T12:02:34.461 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.462+0000 7f780147d700 1 -- 172.21.15.80:0/992161186 learned_addr learned my addr 172.21.15.80:0/992161186 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:34.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.462+0000 7f7801c7e700 1 --2- 172.21.15.80:0/992161186 >> v2:172.21.15.174:3300/0 conn(0x7f77fc06c0a0 0x7f77fc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:34.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f7800c7c700 1 -- 172.21.15.80:0/992161186 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924030519 0 0) 0x7f77f00014d0 con 0x7f77fc0734e0 2019-11-28T12:02:34.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f7800c7c700 1 -- 172.21.15.80:0/992161186 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77e4002e80 con 0x7f77fc0734e0 2019-11-28T12:02:34.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f7801c7e700 1 -- 172.21.15.80:0/992161186 >> v1:172.21.15.174:6789/0 conn(0x7f77fc072620 legacy=0x7f77fc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f7801c7e700 1 -- 172.21.15.80:0/992161186 >> v1:172.21.15.80:6789/0 conn(0x7f77fc0734e0 legacy=0x7f77fc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.462 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f7801c7e700 1 -- 172.21.15.80:0/992161186 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc0706c0 con 0x7f77fc06c0a0 2019-11-28T12:02:34.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f7801c7e700 1 --2- 172.21.15.80:0/992161186 >> v2:172.21.15.174:3300/0 conn(0x7f77fc06c0a0 0x7f77fc072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f77ec00af50 tx=0x7f77ec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f7801c7e700 1 --2- 172.21.15.80:0/992161186 >> v2:172.21.15.174:3300/0 conn(0x7f77fc06c0a0 0x7f77fc072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f77ec00af50 tx=0x7f77ec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f7801c7e700 1 --2- 172.21.15.80:0/992161186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77fc06c0a0 0x7f77fc072fa0 secure :-1 s=READY pgs=1874 cs=0 l=1 rx=0x7f77ec00af50 tx=0x7f77ec00b760).ready entity=mon.1 client_cookie=5487f29c8073940b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:34.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f7801c7e700 1 --2- 172.21.15.80:0/992161186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77fc06c0a0 0x7f77fc072fa0 secure :-1 s=THROTTLE_DONE pgs=1874 cs=0 l=1 rx=0x7f77ec00af50 tx=0x7f77ec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f7800c7c700 1 -- 172.21.15.80:0/992161186 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77ec000960 con 0x7f77fc06c0a0 2019-11-28T12:02:34.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f7801c7e700 1 --2- 172.21.15.80:0/992161186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77fc06c0a0 0x7f77fc072fa0 secure :-1 s=THROTTLE_DONE pgs=1874 cs=0 l=1 rx=0x7f77ec00af50 tx=0x7f77ec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.463 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f7801c7e700 1 --2- 172.21.15.80:0/992161186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77fc06c0a0 0x7f77fc072fa0 secure :-1 s=THROTTLE_DONE pgs=1874 cs=0 l=1 rx=0x7f77ec00af50 tx=0x7f77ec00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f7800c7c700 1 -- 172.21.15.80:0/992161186 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec009860 con 0x7f77fc06c0a0 2019-11-28T12:02:34.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f7800c7c700 1 -- 172.21.15.80:0/992161186 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77ec007210 con 0x7f77fc06c0a0 2019-11-28T12:02:34.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f78036e1700 1 -- 172.21.15.80:0/992161186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77fc06c0a0 msgr2=0x7f77fc072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f78036e1700 1 --2- 172.21.15.80:0/992161186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77fc06c0a0 0x7f77fc072fa0 secure :-1 s=READY pgs=1874 cs=0 l=1 rx=0x7f77ec00af50 tx=0x7f77ec00b760).stop 2019-11-28T12:02:34.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.464+0000 7f78036e1700 1 -- 172.21.15.80:0/992161186 shutdown_connections 2019-11-28T12:02:34.464 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.464+0000 7f78036e1700 1 --2- 172.21.15.80:0/992161186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77fc06c0a0 0x7f77fc072fa0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:34.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.464+0000 7f78036e1700 1 -- 172.21.15.80:0/992161186 shutdown_connections 2019-11-28T12:02:34.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.464+0000 7f78036e1700 1 -- 172.21.15.80:0/992161186 wait complete. 2019-11-28T12:02:34.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.464+0000 7f78036e1700 1 -- 172.21.15.80:0/992161186 >> 172.21.15.80:0/992161186 conn(0x7f77fc061cf0 msgr2=0x7f77fc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:34.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.467+0000 7f78036e1700 1 Processor -- start 2019-11-28T12:02:34.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.467+0000 7f78036e1700 1 -- start start 2019-11-28T12:02:34.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.461+0000 7f462de84700 1 Processor -- start 2019-11-28T12:02:34.465 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.461+0000 7f462de84700 1 -- start start 2019-11-28T12:02:34.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.462+0000 7f462de84700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f462806c0a0 0x7f4628072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:34.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.462+0000 7f462de84700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4628072620 0x7f4628164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:34.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.462+0000 7f462de84700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462806db00 con 0x7f46280734e0 2019-11-28T12:02:34.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.462+0000 7f462de84700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462806f330 con 0x7f4628072620 2019-11-28T12:02:34.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.462+0000 7f462de84700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46280706c0 con 0x7f462806c0a0 2019-11-28T12:02:34.466 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.462+0000 7f461ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f46280734e0 0x7f4628071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47590/0 (socket says 172.21.15.80:47590) 2019-11-28T12:02:34.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.462+0000 7f461ffff700 1 -- 172.21.15.80:0/1511146062 learned_addr learned my addr 172.21.15.80:0/1511146062 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:34.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.462+0000 7f462cc22700 1 --2- 172.21.15.80:0/1511146062 >> v2:172.21.15.174:3300/0 conn(0x7f4628072620 0x7f4628164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:34.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.462+0000 7f4627fff700 1 --2- 172.21.15.80:0/1511146062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f462806c0a0 0x7f4628072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:34.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f46277fe700 1 -- 172.21.15.80:0/1511146062 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617410172 0 0) 0x7f4610001170 con 0x7f46280734e0 2019-11-28T12:02:34.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f46277fe700 1 -- 172.21.15.80:0/1511146062 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4614002e80 con 0x7f46280734e0 2019-11-28T12:02:34.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f462cc22700 1 -- 172.21.15.80:0/1511146062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f462806c0a0 msgr2=0x7f4628072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:34.467 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f462cc22700 1 --2- 172.21.15.80:0/1511146062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f462806c0a0 0x7f4628072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:34.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f462cc22700 1 -- 172.21.15.80:0/1511146062 >> v1:172.21.15.80:6789/0 conn(0x7f46280734e0 legacy=0x7f4628071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f462cc22700 1 -- 172.21.15.80:0/1511146062 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4628070a40 con 0x7f4628072620 2019-11-28T12:02:34.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f462cc22700 1 --2- 172.21.15.80:0/1511146062 >> v2:172.21.15.174:3300/0 conn(0x7f4628072620 0x7f4628164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f462000b300 tx=0x7f462000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f462cc22700 1 --2- 172.21.15.80:0/1511146062 >> v2:172.21.15.174:3300/0 conn(0x7f4628072620 0x7f4628164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f462000b300 tx=0x7f462000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f462cc22700 1 --2- 172.21.15.80:0/1511146062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4628072620 0x7f4628164d70 secure :-1 s=READY pgs=1875 cs=0 l=1 rx=0x7f462000b300 tx=0x7f462000bb10).ready entity=mon.1 client_cookie=2de7bc695a672562 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:34.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f462cc22700 1 --2- 172.21.15.80:0/1511146062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4628072620 0x7f4628164d70 secure :-1 s=THROTTLE_DONE pgs=1875 cs=0 l=1 rx=0x7f462000b300 tx=0x7f462000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.468 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f462cc22700 1 --2- 172.21.15.80:0/1511146062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4628072620 0x7f4628164d70 secure :-1 s=THROTTLE_DONE pgs=1875 cs=0 l=1 rx=0x7f462000b300 tx=0x7f462000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f46277fe700 1 -- 172.21.15.80:0/1511146062 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4620000f40 con 0x7f4628072620 2019-11-28T12:02:34.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f462cc22700 1 --2- 172.21.15.80:0/1511146062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4628072620 0x7f4628164d70 secure :-1 s=THROTTLE_DONE pgs=1875 cs=0 l=1 rx=0x7f462000b300 tx=0x7f462000bb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f46277fe700 1 -- 172.21.15.80:0/1511146062 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4620009b70 con 0x7f4628072620 2019-11-28T12:02:34.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f46277fe700 1 -- 172.21.15.80:0/1511146062 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f462000a240 con 0x7f4628072620 2019-11-28T12:02:34.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f462de84700 1 -- 172.21.15.80:0/1511146062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4628072620 msgr2=0x7f4628164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.469 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7f462de84700 1 --2- 172.21.15.80:0/1511146062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4628072620 0x7f4628164d70 secure :-1 s=READY pgs=1875 cs=0 l=1 rx=0x7f462000b300 tx=0x7f462000bb10).stop 2019-11-28T12:02:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.464+0000 7f462de84700 1 -- 172.21.15.80:0/1511146062 shutdown_connections 2019-11-28T12:02:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.464+0000 7f462de84700 1 --2- 172.21.15.80:0/1511146062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4628072620 0x7f4628164d70 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.464+0000 7f462de84700 1 --2- 172.21.15.80:0/1511146062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f462806c0a0 0x7f4628072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.464+0000 7f462de84700 1 -- 172.21.15.80:0/1511146062 shutdown_connections 2019-11-28T12:02:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.464+0000 7f462de84700 1 -- 172.21.15.80:0/1511146062 wait complete. 2019-11-28T12:02:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.464+0000 7f462de84700 1 -- 172.21.15.80:0/1511146062 >> 172.21.15.80:0/1511146062 conn(0x7f4628061cf0 msgr2=0x7f4628064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.467+0000 7f462de84700 1 Processor -- start 2019-11-28T12:02:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.467+0000 7f462de84700 1 -- start start 2019-11-28T12:02:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.461+0000 7fe448a92700 1 Processor -- start 2019-11-28T12:02:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.461+0000 7fe448a92700 1 -- start start 2019-11-28T12:02:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe448a92700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe44406c0a0 0x7fe444072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe448a92700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe4440734e0 0x7fe444071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe448a92700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44406db00 con 0x7fe444072360 2019-11-28T12:02:34.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe448a92700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44406fd60 con 0x7fe4440734e0 2019-11-28T12:02:34.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe448a92700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe444070030 con 0x7fe44406c0a0 2019-11-28T12:02:34.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe44259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe4440734e0 0x7fe444071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:34.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe44259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe4440734e0 0x7fe444071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48278/0 (socket says 172.21.15.80:48278) 2019-11-28T12:02:34.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe44259c700 1 -- 172.21.15.80:0/1551169340 learned_addr learned my addr 172.21.15.80:0/1551169340 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:34.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe442d9d700 1 --2- 172.21.15.80:0/1551169340 >> v2:172.21.15.174:3300/0 conn(0x7fe44406c0a0 0x7fe444072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:34.472 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe44259c700 1 -- 172.21.15.80:0/1551169340 >> v2:172.21.15.174:3300/0 conn(0x7fe44406c0a0 msgr2=0x7fe444072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:34.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe44259c700 1 --2- 172.21.15.80:0/1551169340 >> v2:172.21.15.174:3300/0 conn(0x7fe44406c0a0 0x7fe444072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:34.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe44259c700 1 -- 172.21.15.80:0/1551169340 >> v1:172.21.15.174:6789/0 conn(0x7fe444072360 legacy=0x7fe44406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:34.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe44259c700 1 -- 172.21.15.80:0/1551169340 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4440706c0 con 0x7fe4440734e0 2019-11-28T12:02:34.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe44259c700 1 --2- 172.21.15.80:0/1551169340 >> v2:172.21.15.80:3300/0 conn(0x7fe4440734e0 0x7fe444071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe42c00f6c0 tx=0x7fe42c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe44259c700 1 --2- 172.21.15.80:0/1551169340 >> v2:172.21.15.80:3300/0 conn(0x7fe4440734e0 0x7fe444071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe42c00f6c0 tx=0x7fe42c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.473 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe44259c700 1 --2- 172.21.15.80:0/1551169340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4440734e0 0x7fe444071e20 secure :-1 s=READY pgs=3099 cs=0 l=1 rx=0x7fe42c00f6c0 tx=0x7fe42c00fa60).ready entity=mon.0 client_cookie=64d4cac9094928c6 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:34.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe44259c700 1 --2- 172.21.15.80:0/1551169340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4440734e0 0x7fe444071e20 secure :-1 s=THROTTLE_DONE pgs=3099 cs=0 l=1 rx=0x7fe42c00f6c0 tx=0x7fe42c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe44259c700 1 --2- 172.21.15.80:0/1551169340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4440734e0 0x7fe444071e20 secure :-1 s=THROTTLE_DONE pgs=3099 cs=0 l=1 rx=0x7fe42c00f6c0 tx=0x7fe42c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe44259c700 1 --2- 172.21.15.80:0/1551169340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4440734e0 0x7fe444071e20 secure :-1 s=THROTTLE_DONE pgs=3099 cs=0 l=1 rx=0x7fe42c00f6c0 tx=0x7fe42c00fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.463+0000 7fe441d9b700 1 -- 172.21.15.80:0/1551169340 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42c000960 con 0x7fe4440734e0 2019-11-28T12:02:34.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.464+0000 7fe441d9b700 1 -- 172.21.15.80:0/1551169340 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c000c90 con 0x7fe4440734e0 2019-11-28T12:02:34.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.464+0000 7fe441d9b700 1 -- 172.21.15.80:0/1551169340 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42c0013e0 con 0x7fe4440734e0 2019-11-28T12:02:34.474 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.464+0000 7fe448a92700 1 -- 172.21.15.80:0/1551169340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4440734e0 msgr2=0x7fe444071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.464+0000 7fe448a92700 1 --2- 172.21.15.80:0/1551169340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4440734e0 0x7fe444071e20 secure :-1 s=READY pgs=3099 cs=0 l=1 rx=0x7fe42c00f6c0 tx=0x7fe42c00fa60).stop 2019-11-28T12:02:34.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.465+0000 7fe448a92700 1 -- 172.21.15.80:0/1551169340 shutdown_connections 2019-11-28T12:02:34.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.465+0000 7fe448a92700 1 --2- 172.21.15.80:0/1551169340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4440734e0 0x7fe444071e20 unknown :-1 s=CLOSED pgs=3099 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:34.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.465+0000 7fe448a92700 1 --2- 172.21.15.80:0/1551169340 >> v2:172.21.15.174:3300/0 conn(0x7fe44406c0a0 0x7fe444072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:34.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.465+0000 7fe448a92700 1 -- 172.21.15.80:0/1551169340 shutdown_connections 2019-11-28T12:02:34.475 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.465+0000 7fe448a92700 1 -- 172.21.15.80:0/1551169340 wait complete. 2019-11-28T12:02:34.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.465+0000 7fe448a92700 1 -- 172.21.15.80:0/1551169340 >> 172.21.15.80:0/1551169340 conn(0x7fe444061cf0 msgr2=0x7fe444064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:34.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.467+0000 7fe448a92700 1 Processor -- start 2019-11-28T12:02:34.476 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.467+0000 7fe448a92700 1 -- start start 2019-11-28T12:02:34.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7fe448a92700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe44413a780 0x7fe44412d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:34.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7fe448a92700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe444139a60 con 0x7fe44412cb00 2019-11-28T12:02:34.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7fe448a92700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44413b060 con 0x7fe44412d9c0 2019-11-28T12:02:34.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7fe448a92700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44412a260 con 0x7fe44413a780 2019-11-28T12:02:34.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7fe44259c700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe44412d9c0 0x7fe44412c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:34914/0 (socket says 172.21.15.80:34914) 2019-11-28T12:02:34.485 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7fe44259c700 1 -- 172.21.15.80:0/2998155844 learned_addr learned my addr 172.21.15.80:0/2998155844 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7fe442d9d700 1 --2- 172.21.15.80:0/2998155844 >> v2:172.21.15.80:3300/0 conn(0x7fe44413a780 0x7fe44412d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7fe43b7fe700 1 -- 172.21.15.80:0/2998155844 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182380341 0 0) 0x7fe42c007d20 con 0x7fe44412d9c0 2019-11-28T12:02:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7fe43b7fe700 1 -- 172.21.15.80:0/2998155844 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe428002e80 con 0x7fe44412d9c0 2019-11-28T12:02:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7fe43b7fe700 1 -- 172.21.15.80:0/2998155844 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010822641 0 0) 0x7fe43c001430 con 0x7fe44412cb00 2019-11-28T12:02:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7fe442d9d700 1 -- 172.21.15.80:0/2998155844 >> v1:172.21.15.174:6789/0 conn(0x7fe44412d9c0 legacy=0x7fe44412c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7fe442d9d700 1 -- 172.21.15.80:0/2998155844 >> v1:172.21.15.80:6789/0 conn(0x7fe44412cb00 legacy=0x7fe444167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7fe442d9d700 1 -- 172.21.15.80:0/2998155844 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44412abc0 con 0x7fe44413a780 2019-11-28T12:02:34.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7fe442d9d700 1 --2- 172.21.15.80:0/2998155844 >> v2:172.21.15.80:3300/0 conn(0x7fe44413a780 0x7fe44412d480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe4340103b0 tx=0x7fe434010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7fe442d9d700 1 --2- 172.21.15.80:0/2998155844 >> v2:172.21.15.80:3300/0 conn(0x7fe44413a780 0x7fe44412d480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe4340103b0 tx=0x7fe434010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7fe442d9d700 1 --2- 172.21.15.80:0/2998155844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe44413a780 0x7fe44412d480 secure :-1 s=READY pgs=3104 cs=0 l=1 rx=0x7fe4340103b0 tx=0x7fe434010750).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:34.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7fe442d9d700 1 --2- 172.21.15.80:0/2998155844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe44413a780 0x7fe44412d480 secure :-1 s=THROTTLE_DONE pgs=3104 cs=0 l=1 rx=0x7fe4340103b0 tx=0x7fe434010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7fe442d9d700 1 --2- 172.21.15.80:0/2998155844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe44413a780 0x7fe44412d480 secure :-1 s=THROTTLE_DONE pgs=3104 cs=0 l=1 rx=0x7fe4340103b0 tx=0x7fe434010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.487 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7fe442d9d700 1 --2- 172.21.15.80:0/2998155844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe44413a780 0x7fe44412d480 secure :-1 s=THROTTLE_DONE pgs=3104 cs=0 l=1 rx=0x7fe4340103b0 tx=0x7fe434010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7fe43b7fe700 1 -- 172.21.15.80:0/2998155844 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe434005180 con 0x7fe44413a780 2019-11-28T12:02:34.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7fe43b7fe700 1 -- 172.21.15.80:0/2998155844 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe434005880 con 0x7fe44413a780 2019-11-28T12:02:34.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7fe43b7fe700 1 -- 172.21.15.80:0/2998155844 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe434005f30 con 0x7fe44413a780 2019-11-28T12:02:34.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7fe448a92700 1 -- 172.21.15.80:0/2998155844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44412af40 con 0x7fe44413a780 2019-11-28T12:02:34.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7fe448a92700 1 -- 172.21.15.80:0/2998155844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44412abc0 con 0x7fe44413a780 2019-11-28T12:02:34.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.471+0000 7fe442d9d700 1 --2- 172.21.15.80:0/2998155844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe44413a780 0x7fe44412d480 secure :-1 s=THROTTLE_DONE pgs=3104 cs=0 l=1 rx=0x7fe4340103b0 tx=0x7fe434010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.488 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.471+0000 7fe43b7fe700 1 -- 172.21.15.80:0/2998155844 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fe434005390 con 0x7fe44413a780 2019-11-28T12:02:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.471+0000 7fe442d9d700 1 --2- 172.21.15.80:0/2998155844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe44413a780 0x7fe44412d480 secure :-1 s=THROTTLE_DONE pgs=3104 cs=0 l=1 rx=0x7fe4340103b0 tx=0x7fe434010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.471+0000 7fe43b7fe700 1 --2- 172.21.15.80:0/2998155844 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe42801cb60 0x7fe42801eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.471+0000 7fe43b7fe700 1 -- 172.21.15.80:0/2998155844 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(237..237 src has 1..237) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fe434031a80 con 0x7fe44413a780 2019-11-28T12:02:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.471+0000 7fe44259c700 1 --2- 172.21.15.80:0/2998155844 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe42801cb60 0x7fe42801eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.472+0000 7fe44259c700 1 --2- 172.21.15.80:0/2998155844 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe42801cb60 0x7fe42801eff0 crc :-1 s=READY pgs=1286 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.477+0000 7fe448a92700 1 -- 172.21.15.80:0/2998155844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe44412af40 con 0x7fe44413a780 2019-11-28T12:02:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.486+0000 7fe442d9d700 1 --2- 172.21.15.80:0/2998155844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe44413a780 0x7fe44412d480 secure :-1 s=THROTTLE_DONE pgs=3104 cs=0 l=1 rx=0x7fe4340103b0 tx=0x7fe434010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.486+0000 7fe43b7fe700 1 -- 172.21.15.80:0/2998155844 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fe434005180 con 0x7fe44413a780 2019-11-28T12:02:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f462de84700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4628104c10 0x7f46281050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f462de84700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462813bcd0 con 0x7f4628104820 2019-11-28T12:02:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f462de84700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4628105ea0 con 0x7f46281055e0 2019-11-28T12:02:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f462de84700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4628109130 con 0x7f4628104c10 2019-11-28T12:02:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f462cc22700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f46281055e0 0x7f4628167a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:34920/0 (socket says 172.21.15.80:34920) 2019-11-28T12:02:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f462cc22700 1 -- 172.21.15.80:0/3805402022 learned_addr learned my addr 172.21.15.80:0/3805402022 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f461ffff700 1 --2- 172.21.15.80:0/3805402022 >> v2:172.21.15.80:3300/0 conn(0x7f4628104c10 0x7f46281050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f46257fa700 1 -- 172.21.15.80:0/3805402022 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53814728 0 0) 0x7f4620009930 con 0x7f46281055e0 2019-11-28T12:02:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f46257fa700 1 -- 172.21.15.80:0/3805402022 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f460c002e80 con 0x7f46281055e0 2019-11-28T12:02:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f461ffff700 1 -- 172.21.15.80:0/3805402022 >> v1:172.21.15.174:6789/0 conn(0x7f46281055e0 legacy=0x7f4628167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f461ffff700 1 -- 172.21.15.80:0/3805402022 >> v1:172.21.15.80:6789/0 conn(0x7f4628104820 legacy=0x7f462810c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f46257fa700 1 -- 172.21.15.80:0/3805402022 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320205764 0 0) 0x7f46180010b0 con 0x7f4628104820 2019-11-28T12:02:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f461ffff700 1 -- 172.21.15.80:0/3805402022 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4628109a90 con 0x7f4628104c10 2019-11-28T12:02:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f461ffff700 1 --2- 172.21.15.80:0/3805402022 >> v2:172.21.15.80:3300/0 conn(0x7f4628104c10 0x7f46281050a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4610010380 tx=0x7f4610010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f461ffff700 1 --2- 172.21.15.80:0/3805402022 >> v2:172.21.15.80:3300/0 conn(0x7f4628104c10 0x7f46281050a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4610010380 tx=0x7f4610010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f461ffff700 1 --2- 172.21.15.80:0/3805402022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4628104c10 0x7f46281050a0 secure :-1 s=READY pgs=3105 cs=0 l=1 rx=0x7f4610010380 tx=0x7f4610010720).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f461ffff700 1 --2- 172.21.15.80:0/3805402022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4628104c10 0x7f46281050a0 secure :-1 s=THROTTLE_DONE pgs=3105 cs=0 l=1 rx=0x7f4610010380 tx=0x7f4610010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f461ffff700 1 --2- 172.21.15.80:0/3805402022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4628104c10 0x7f46281050a0 secure :-1 s=THROTTLE_DONE pgs=3105 cs=0 l=1 rx=0x7f4610010380 tx=0x7f4610010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f461ffff700 1 --2- 172.21.15.80:0/3805402022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4628104c10 0x7f46281050a0 secure :-1 s=THROTTLE_DONE pgs=3105 cs=0 l=1 rx=0x7f4610010380 tx=0x7f4610010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.470+0000 7f46257fa700 1 -- 172.21.15.80:0/3805402022 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4610000c90 con 0x7f4628104c10 2019-11-28T12:02:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.470+0000 7f46257fa700 1 -- 172.21.15.80:0/3805402022 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4610004240 con 0x7f4628104c10 2019-11-28T12:02:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.470+0000 7f462de84700 1 -- 172.21.15.80:0/3805402022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4628109e10 con 0x7f4628104c10 2019-11-28T12:02:34.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.470+0000 7f46257fa700 1 -- 172.21.15.80:0/3805402022 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46100048d0 con 0x7f4628104c10 2019-11-28T12:02:34.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.470+0000 7f462de84700 1 -- 172.21.15.80:0/3805402022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4628109a90 con 0x7f4628104c10 2019-11-28T12:02:34.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.471+0000 7f461ffff700 1 --2- 172.21.15.80:0/3805402022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4628104c10 0x7f46281050a0 secure :-1 s=THROTTLE_DONE pgs=3105 cs=0 l=1 rx=0x7f4610010380 tx=0x7f4610010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.471+0000 7f46257fa700 1 -- 172.21.15.80:0/3805402022 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4610000c90 con 0x7f4628104c10 2019-11-28T12:02:34.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.471+0000 7f461ffff700 1 --2- 172.21.15.80:0/3805402022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4628104c10 0x7f46281050a0 secure :-1 s=THROTTLE_DONE pgs=3105 cs=0 l=1 rx=0x7f4610010380 tx=0x7f4610010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.494 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.471+0000 7f46257fa700 1 --2- 172.21.15.80:0/3805402022 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f460c018750 0x7f460c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:34.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.471+0000 7f46257fa700 1 -- 172.21.15.80:0/3805402022 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(237..237 src has 1..237) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f4610031ac0 con 0x7f4628104c10 2019-11-28T12:02:34.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.471+0000 7f4627fff700 1 --2- 172.21.15.80:0/3805402022 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f460c018750 0x7f460c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:34.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.472+0000 7f4627fff700 1 --2- 172.21.15.80:0/3805402022 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f460c018750 0x7f460c01abe0 crc :-1 s=READY pgs=1285 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:34.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.476+0000 7f462de84700 1 -- 172.21.15.80:0/3805402022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4628109e10 con 0x7f4628104c10 2019-11-28T12:02:34.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.480+0000 7f461ffff700 1 --2- 172.21.15.80:0/3805402022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4628104c10 0x7f46281050a0 secure :-1 s=THROTTLE_DONE pgs=3105 cs=0 l=1 rx=0x7f4610010380 tx=0x7f4610010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.495 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.480+0000 7f46257fa700 1 -- 172.21.15.80:0/3805402022 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4610001220 con 0x7f4628104c10 2019-11-28T12:02:34.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f78036e1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77fc13e5f0 0x7f77fc161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:34.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f78036e1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f77fc161550 0x7f77fc15c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:34.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f78036e1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77fc13efe0 con 0x7f77fc15cee0 2019-11-28T12:02:34.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f78036e1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77fc142350 con 0x7f77fc161550 2019-11-28T12:02:34.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f78036e1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc15e750 con 0x7f77fc13e5f0 2019-11-28T12:02:34.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f780147d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f77fc161550 0x7f77fc15c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:34.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f7801c7e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77fc13e5f0 0x7f77fc161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:34.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f780147d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f77fc161550 0x7f77fc15c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48298/0 (socket says 172.21.15.80:48298) 2019-11-28T12:02:34.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f780147d700 1 -- 172.21.15.80:0/607429630 learned_addr learned my addr 172.21.15.80:0/607429630 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:34.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f780147d700 1 -- 172.21.15.80:0/607429630 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77fc13e5f0 msgr2=0x7f77fc161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f780147d700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77fc13e5f0 0x7f77fc161010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:34.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f780147d700 1 -- 172.21.15.80:0/607429630 >> v1:172.21.15.80:6789/0 conn(0x7f77fc15cee0 legacy=0x7f77fc15fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.468+0000 7f780147d700 1 -- 172.21.15.80:0/607429630 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc15ead0 con 0x7f77fc161550 2019-11-28T12:02:34.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f780147d700 1 --2- 172.21.15.80:0/607429630 >> v2:172.21.15.80:3300/0 conn(0x7f77fc161550 0x7f77fc15c9a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f77f0010760 tx=0x7f77f0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f780147d700 1 --2- 172.21.15.80:0/607429630 >> v2:172.21.15.80:3300/0 conn(0x7f77fc161550 0x7f77fc15c9a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f77f0010760 tx=0x7f77f0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f780147d700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77fc161550 0x7f77fc15c9a0 secure :-1 s=READY pgs=3103 cs=0 l=1 rx=0x7f77f0010760 tx=0x7f77f0010b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:34.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f780147d700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77fc161550 0x7f77fc15c9a0 secure :-1 s=THROTTLE_DONE pgs=3103 cs=0 l=1 rx=0x7f77f0010760 tx=0x7f77f0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f77fa7fc700 1 -- 172.21.15.80:0/607429630 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77f0001010 con 0x7f77fc161550 2019-11-28T12:02:34.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f78036e1700 1 -- 172.21.15.80:0/607429630 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77fc15ead0 con 0x7f77fc161550 2019-11-28T12:02:34.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f780147d700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77fc161550 0x7f77fc15c9a0 secure :-1 s=THROTTLE_DONE pgs=3103 cs=0 l=1 rx=0x7f77f0010760 tx=0x7f77f0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f780147d700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77fc161550 0x7f77fc15c9a0 secure :-1 s=THROTTLE_DONE pgs=3103 cs=0 l=1 rx=0x7f77f0010760 tx=0x7f77f0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f77fa7fc700 1 -- 172.21.15.80:0/607429630 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f0001010 con 0x7f77fc161550 2019-11-28T12:02:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f77fa7fc700 1 -- 172.21.15.80:0/607429630 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77f00016a0 con 0x7f77fc161550 2019-11-28T12:02:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.469+0000 7f78036e1700 1 -- 172.21.15.80:0/607429630 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77fc15ead0 con 0x7f77fc161550 2019-11-28T12:02:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.470+0000 7f780147d700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77fc161550 0x7f77fc15c9a0 secure :-1 s=THROTTLE_DONE pgs=3103 cs=0 l=1 rx=0x7f77f0010760 tx=0x7f77f0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.470+0000 7f77fa7fc700 1 -- 172.21.15.80:0/607429630 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f77f0001200 con 0x7f77fc161550 2019-11-28T12:02:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.470+0000 7f780147d700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77fc161550 0x7f77fc15c9a0 secure :-1 s=THROTTLE_DONE pgs=3103 cs=0 l=1 rx=0x7f77f0010760 tx=0x7f77f0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.470+0000 7f77fa7fc700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f77dc01cb40 0x7f77dc01eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:34.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.470+0000 7f77fa7fc700 1 -- 172.21.15.80:0/607429630 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(237..237 src has 1..237) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f77f0032070 con 0x7f77fc161550 2019-11-28T12:02:34.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.470+0000 7f7801c7e700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f77dc01cb40 0x7f77dc01eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:34.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.471+0000 7f7801c7e700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f77dc01cb40 0x7f77dc01eff0 crc :-1 s=READY pgs=1284 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:34.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.476+0000 7f78036e1700 1 -- 172.21.15.80:0/607429630 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77fc15ead0 con 0x7f77fc161550 2019-11-28T12:02:34.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.483+0000 7f780147d700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77fc161550 0x7f77fc15c9a0 secure :-1 s=THROTTLE_DONE pgs=3103 cs=0 l=1 rx=0x7f77f0010760 tx=0x7f77f0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.483+0000 7f77fa7fc700 1 -- 172.21.15.80:0/607429630 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f77f0007950 con 0x7f77fc161550 2019-11-28T12:02:34.657 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.664+0000 7f78036e1700 1 -- 172.21.15.80:0/607429630 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f77fc15ead0 con 0x7f77fc161550 2019-11-28T12:02:34.796 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.803+0000 7f462de84700 1 -- 172.21.15.80:0/3805402022 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f4628105a60 con 0x7f4628104c10 2019-11-28T12:02:34.805 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.812+0000 7fe448a92700 1 -- 172.21.15.80:0/2998155844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fe44412abc0 con 0x7fe44413a780 2019-11-28T12:02:34.848 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T12:02:34.855+0000 7fec89b76700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T12:02:34.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.859+0000 7f780147d700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77fc161550 0x7f77fc15c9a0 secure :-1 s=THROTTLE_DONE pgs=3103 cs=0 l=1 rx=0x7f77f0010760 tx=0x7f77f0010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.859+0000 7f77fa7fc700 1 -- 172.21.15.80:0/607429630 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 12996 v202) v1 ==== 96+0+0 (secure 0 0 0) 0x7f77f0001010 con 0x7f77fc161550 2019-11-28T12:02:34.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.859+0000 7f461ffff700 1 --2- 172.21.15.80:0/3805402022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4628104c10 0x7f46281050a0 secure :-1 s=THROTTLE_DONE pgs=3105 cs=0 l=1 rx=0x7f4610010380 tx=0x7f4610010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.859+0000 7f46257fa700 1 -- 172.21.15.80:0/3805402022 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 8393 v202) v1 ==== 95+0+0 (secure 0 0 0) 0x7f4610000c90 con 0x7f4628104c10 2019-11-28T12:02:34.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.859+0000 7fe442d9d700 1 --2- 172.21.15.80:0/2998155844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe44413a780 0x7fe44412d480 secure :-1 s=THROTTLE_DONE pgs=3104 cs=0 l=1 rx=0x7fe4340103b0 tx=0x7fe434010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:34.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.859+0000 7fe43b7fe700 1 -- 172.21.15.80:0/2998155844 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 12187 v202) v1 ==== 96+0+0 (secure 0 0 0) 0x7fe434005390 con 0x7fe44413a780 2019-11-28T12:02:34.859 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 8393 2019-11-28T12:02:34.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.868+0000 7f462de84700 1 -- 172.21.15.80:0/3805402022 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f460c018750 msgr2=0x7f460c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.868+0000 7f462de84700 1 --2- 172.21.15.80:0/3805402022 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f460c018750 0x7f460c01abe0 crc :-1 s=READY pgs=1285 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:34.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.868+0000 7f462de84700 1 -- 172.21.15.80:0/3805402022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4628104c10 msgr2=0x7f46281050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.868+0000 7f462de84700 1 --2- 172.21.15.80:0/3805402022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4628104c10 0x7f46281050a0 secure :-1 s=READY pgs=3105 cs=0 l=1 rx=0x7f4610010380 tx=0x7f4610010720).stop 2019-11-28T12:02:34.863 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.868+0000 7f462de84700 1 -- 172.21.15.80:0/3805402022 shutdown_connections 2019-11-28T12:02:34.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.868+0000 7f462de84700 1 --2- 172.21.15.80:0/3805402022 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f460c018750 0x7f460c01abe0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:34.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.868+0000 7f462de84700 1 --2- 172.21.15.80:0/3805402022 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4628104c10 0x7f46281050a0 unknown :-1 s=CLOSED pgs=3105 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:34.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.868+0000 7f462de84700 1 -- 172.21.15.80:0/3805402022 shutdown_connections 2019-11-28T12:02:34.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.868+0000 7f462de84700 1 -- 172.21.15.80:0/3805402022 wait complete. 2019-11-28T12:02:34.864 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.868+0000 7f462de84700 1 -- 172.21.15.80:0/3805402022 >> 172.21.15.80:0/3805402022 conn(0x7f462813d620 msgr2=0x7f462813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:34.868 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 12187 2019-11-28T12:02:34.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.878+0000 7fe448a92700 1 -- 172.21.15.80:0/2998155844 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe42801cb60 msgr2=0x7fe42801eff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.878+0000 7fe448a92700 1 --2- 172.21.15.80:0/2998155844 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe42801cb60 0x7fe42801eff0 crc :-1 s=READY pgs=1286 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:34.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.878+0000 7fe448a92700 1 -- 172.21.15.80:0/2998155844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe44413a780 msgr2=0x7fe44412d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.878+0000 7fe448a92700 1 --2- 172.21.15.80:0/2998155844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe44413a780 0x7fe44412d480 secure :-1 s=READY pgs=3104 cs=0 l=1 rx=0x7fe4340103b0 tx=0x7fe434010750).stop 2019-11-28T12:02:34.872 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.878+0000 7fe448a92700 1 -- 172.21.15.80:0/2998155844 shutdown_connections 2019-11-28T12:02:34.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.878+0000 7fe448a92700 1 --2- 172.21.15.80:0/2998155844 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fe42801cb60 0x7fe42801eff0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:34.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.878+0000 7fe448a92700 1 --2- 172.21.15.80:0/2998155844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe44413a780 0x7fe44412d480 unknown :-1 s=CLOSED pgs=3104 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:34.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.878+0000 7fe448a92700 1 -- 172.21.15.80:0/2998155844 shutdown_connections 2019-11-28T12:02:34.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.878+0000 7fe448a92700 1 -- 172.21.15.80:0/2998155844 wait complete. 2019-11-28T12:02:34.873 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.878+0000 7fe448a92700 1 -- 172.21.15.80:0/2998155844 >> 172.21.15.80:0/2998155844 conn(0x7fe444127dc0 msgr2=0x7fe444141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:34.873 INFO:teuthology.orchestra.run.smithi080.stderr:failed mds gid 12996 2019-11-28T12:02:34.874 DEBUG:teuthology.parallel:result is '' 2019-11-28T12:02:34.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.880+0000 7f78036e1700 1 -- 172.21.15.80:0/607429630 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f77dc01cb40 msgr2=0x7f77dc01eff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.880+0000 7f78036e1700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f77dc01cb40 0x7f77dc01eff0 crc :-1 s=READY pgs=1284 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:34.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.880+0000 7f78036e1700 1 -- 172.21.15.80:0/607429630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77fc161550 msgr2=0x7f77fc15c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:34.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.880+0000 7f78036e1700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77fc161550 0x7f77fc15c9a0 secure :-1 s=READY pgs=3103 cs=0 l=1 rx=0x7f77f0010760 tx=0x7f77f0010b00).stop 2019-11-28T12:02:34.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.880+0000 7f78036e1700 1 -- 172.21.15.80:0/607429630 shutdown_connections 2019-11-28T12:02:34.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.880+0000 7f78036e1700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f77dc01cb40 0x7f77dc01eff0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:34.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.880+0000 7f78036e1700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77fc161550 0x7f77fc15c9a0 unknown :-1 s=CLOSED pgs=3103 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:34.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.880+0000 7f78036e1700 1 --2- 172.21.15.80:0/607429630 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77fc13e5f0 0x7f77fc161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:34.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.880+0000 7f78036e1700 1 -- 172.21.15.80:0/607429630 shutdown_connections 2019-11-28T12:02:34.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.880+0000 7f78036e1700 1 -- 172.21.15.80:0/607429630 wait complete. 2019-11-28T12:02:34.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:34.880+0000 7f78036e1700 1 -- 172.21.15.80:0/607429630 >> 172.21.15.80:0/607429630 conn(0x7f77fc159ae0 msgr2=0x7f77fc13d620 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:34.881 DEBUG:teuthology.parallel:result is '' 2019-11-28T12:02:34.883 DEBUG:teuthology.parallel:result is '' 2019-11-28T12:02:34.883 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-11-28T12:02:35.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.075+0000 7f55906a7700 1 Processor -- start 2019-11-28T12:02:35.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.075+0000 7f55906a7700 1 -- start start 2019-11-28T12:02:35.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.076+0000 7f55906a7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f558806c0a0 0x7f5588072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:35.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.076+0000 7f55906a7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558806db00 con 0x7f55880734e0 2019-11-28T12:02:35.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.076+0000 7f55906a7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558806e000 con 0x7f5588072620 2019-11-28T12:02:35.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.076+0000 7f55906a7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558806fd60 con 0x7f558806c0a0 2019-11-28T12:02:35.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.076+0000 7f558e443700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f55880734e0 0x7f5588071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47628/0 (socket says 172.21.15.80:47628) 2019-11-28T12:02:35.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.076+0000 7f558e443700 1 -- 172.21.15.80:0/3837147121 learned_addr learned my addr 172.21.15.80:0/3837147121 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:35.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f558ec44700 1 --2- 172.21.15.80:0/3837147121 >> v2:172.21.15.174:3300/0 conn(0x7f558806c0a0 0x7f5588072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:35.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f558dc42700 1 -- 172.21.15.80:0/3837147121 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272667498 0 0) 0x7f5578001070 con 0x7f55880734e0 2019-11-28T12:02:35.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f558dc42700 1 -- 172.21.15.80:0/3837147121 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5574002e80 con 0x7f55880734e0 2019-11-28T12:02:35.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f558ec44700 1 -- 172.21.15.80:0/3837147121 >> v1:172.21.15.174:6789/0 conn(0x7f5588072620 legacy=0x7f5588164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f558dc42700 1 -- 172.21.15.80:0/3837147121 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100621630 0 0) 0x7f55800009b0 con 0x7f5588072620 2019-11-28T12:02:35.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f558ec44700 1 -- 172.21.15.80:0/3837147121 >> v1:172.21.15.80:6789/0 conn(0x7f55880734e0 legacy=0x7f5588071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f558ec44700 1 -- 172.21.15.80:0/3837147121 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55880706c0 con 0x7f558806c0a0 2019-11-28T12:02:35.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f558ec44700 1 --2- 172.21.15.80:0/3837147121 >> v2:172.21.15.174:3300/0 conn(0x7f558806c0a0 0x7f5588072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f557000b2d0 tx=0x7f557000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f558ec44700 1 --2- 172.21.15.80:0/3837147121 >> v2:172.21.15.174:3300/0 conn(0x7f558806c0a0 0x7f5588072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f557000b2d0 tx=0x7f557000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f558ec44700 1 --2- 172.21.15.80:0/3837147121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f558806c0a0 0x7f5588072fa0 secure :-1 s=READY pgs=1880 cs=0 l=1 rx=0x7f557000b2d0 tx=0x7f557000bae0).ready entity=mon.1 client_cookie=df5519b11ac2b762 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:35.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f558ec44700 1 --2- 172.21.15.80:0/3837147121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f558806c0a0 0x7f5588072fa0 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f557000b2d0 tx=0x7f557000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f558dc42700 1 -- 172.21.15.80:0/3837147121 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5570000ce0 con 0x7f558806c0a0 2019-11-28T12:02:35.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f558ec44700 1 --2- 172.21.15.80:0/3837147121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f558806c0a0 0x7f5588072fa0 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f557000b2d0 tx=0x7f557000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f558ec44700 1 --2- 172.21.15.80:0/3837147121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f558806c0a0 0x7f5588072fa0 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f557000b2d0 tx=0x7f557000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f558dc42700 1 -- 172.21.15.80:0/3837147121 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5570009be0 con 0x7f558806c0a0 2019-11-28T12:02:35.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f558dc42700 1 -- 172.21.15.80:0/3837147121 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f557000a2b0 con 0x7f558806c0a0 2019-11-28T12:02:35.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f55906a7700 1 -- 172.21.15.80:0/3837147121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f558806c0a0 msgr2=0x7f5588072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.077+0000 7f55906a7700 1 --2- 172.21.15.80:0/3837147121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f558806c0a0 0x7f5588072fa0 secure :-1 s=READY pgs=1880 cs=0 l=1 rx=0x7f557000b2d0 tx=0x7f557000bae0).stop 2019-11-28T12:02:35.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.078+0000 7f55906a7700 1 -- 172.21.15.80:0/3837147121 shutdown_connections 2019-11-28T12:02:35.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.078+0000 7f55906a7700 1 --2- 172.21.15.80:0/3837147121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f558806c0a0 0x7f5588072fa0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:35.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.078+0000 7f55906a7700 1 -- 172.21.15.80:0/3837147121 shutdown_connections 2019-11-28T12:02:35.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.078+0000 7f55906a7700 1 -- 172.21.15.80:0/3837147121 wait complete. 2019-11-28T12:02:35.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.078+0000 7f55906a7700 1 -- 172.21.15.80:0/3837147121 >> 172.21.15.80:0/3837147121 conn(0x7f5588061cf0 msgr2=0x7f5588064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:35.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.081+0000 7f55906a7700 1 Processor -- start 2019-11-28T12:02:35.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.081+0000 7f55906a7700 1 -- start start 2019-11-28T12:02:35.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.081+0000 7f55906a7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5588111db0 0x7f55881238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:35.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.081+0000 7f55906a7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5588124260 con 0x7f558812cea0 2019-11-28T12:02:35.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.081+0000 7f55906a7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558812e5d0 con 0x7f5588165a00 2019-11-28T12:02:35.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.081+0000 7f55906a7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5588121040 con 0x7f5588111db0 2019-11-28T12:02:35.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f558ec44700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f558812cea0 0x7f55881230e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47630/0 (socket says 172.21.15.80:47630) 2019-11-28T12:02:35.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f558ec44700 1 -- 172.21.15.80:0/3544481603 learned_addr learned my addr 172.21.15.80:0/3544481603 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:35.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f558e443700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5588111db0 0x7f55881238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:35.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936181216 0 0) 0x7f557000b780 con 0x7f558812cea0 2019-11-28T12:02:35.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f556c002e80 con 0x7f558812cea0 2019-11-28T12:02:35.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398803950 0 0) 0x7f5580001240 con 0x7f5588165a00 2019-11-28T12:02:35.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f556c0030b0 con 0x7f5588165a00 2019-11-28T12:02:35.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2339263092 0 0) 0x7f5570000cc0 con 0x7f558812cea0 2019-11-28T12:02:35.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 --> v1:172.21.15.80:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f556c0033c0 con 0x7f558812cea0 2019-11-28T12:02:35.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f5570009900 con 0x7f558812cea0 2019-11-28T12:02:35.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5588111db0 msgr2=0x7f55881238e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5588111db0 0x7f55881238e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:35.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 >> v1:172.21.15.174:6789/0 conn(0x7f5588165a00 legacy=0x7f5588167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 >> v1:172.21.15.80:6789/0 conn(0x7f558812cea0 legacy=0x7f55881230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f556c005d40 0x7f556c006130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:35.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f556c0046f0 0x7f556c004b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:35.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f556c005170 0x7f556c0032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:35.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c0039d0 con 0x7f556c005d40 2019-11-28T12:02:35.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c003c00 con 0x7f556c005170 2019-11-28T12:02:35.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c003e30 con 0x7f556c0046f0 2019-11-28T12:02:35.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f558e443700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5588111db0 0x7f55881238e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:35.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f558ec44700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f556c005d40 0x7f556c006130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:35.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f558f445700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f556c005170 0x7f556c0032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:35.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f558e443700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f556c0046f0 0x7f556c004b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:35.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f558ec44700 1 -- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f556c0046f0 msgr2=0x7f556c004b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f558ec44700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f556c0046f0 0x7f556c004b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:35.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f558ec44700 1 -- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f556c005170 msgr2=0x7f556c0032e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f558ec44700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f556c005170 0x7f556c0032e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:35.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f558ec44700 1 -- 172.21.15.80:0/3544481603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c0040e0 con 0x7f556c005d40 2019-11-28T12:02:35.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.082+0000 7f558f445700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f556c005170 0x7f556c0032e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T12:02:35.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f55906a7700 1 -- 172.21.15.80:0/3544481603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5588121d20 con 0x7f556c005d40 2019-11-28T12:02:35.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f558ec44700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f556c005d40 0x7f556c006130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f55700107e0 tx=0x7f5570010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f558e443700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f556c0046f0 0x7f556c004b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2019-11-28T12:02:35.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f55906a7700 1 -- 172.21.15.80:0/3544481603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55881219a0 con 0x7f556c005d40 2019-11-28T12:02:35.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f558ec44700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f556c005d40 0x7f556c006130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f55700107e0 tx=0x7f5570010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f558ec44700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f556c005d40 0x7f556c006130 secure :-1 s=READY pgs=3108 cs=0 l=1 rx=0x7f55700107e0 tx=0x7f5570010b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:35.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f558ec44700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f556c005d40 0x7f556c006130 secure :-1 s=THROTTLE_DONE pgs=3108 cs=0 l=1 rx=0x7f55700107e0 tx=0x7f5570010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5570000cc0 con 0x7f556c005d40 2019-11-28T12:02:35.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f558ec44700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f556c005d40 0x7f556c006130 secure :-1 s=THROTTLE_DONE pgs=3108 cs=0 l=1 rx=0x7f55700107e0 tx=0x7f5570010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5570009af0 con 0x7f556c005d40 2019-11-28T12:02:35.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f558ec44700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f556c005d40 0x7f556c006130 secure :-1 s=THROTTLE_DONE pgs=3108 cs=0 l=1 rx=0x7f55700107e0 tx=0x7f5570010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5570009ce0 con 0x7f556c005d40 2019-11-28T12:02:35.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f558ec44700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f556c005d40 0x7f556c006130 secure :-1 s=THROTTLE_DONE pgs=3108 cs=0 l=1 rx=0x7f55700107e0 tx=0x7f5570010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5570009ce0 con 0x7f556c005d40 2019-11-28T12:02:35.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f558ec44700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f556c005d40 0x7f556c006130 secure :-1 s=THROTTLE_DONE pgs=3108 cs=0 l=1 rx=0x7f55700107e0 tx=0x7f5570010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f55877fe700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f556c020c10 0x7f556c023040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:35.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.083+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(240..240 src has 1..240) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f5570031ff0 con 0x7f556c005d40 2019-11-28T12:02:35.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.084+0000 7f558e443700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f556c020c10 0x7f556c023040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:35.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.084+0000 7f558e443700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f556c020c10 0x7f556c023040 crc :-1 s=READY pgs=1287 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:35.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.091+0000 7f55906a7700 1 -- 172.21.15.80:0/3544481603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5588121d20 con 0x7f556c005d40 2019-11-28T12:02:35.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.094+0000 7f558ec44700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f556c005d40 0x7f556c006130 secure :-1 s=THROTTLE_DONE pgs=3108 cs=0 l=1 rx=0x7f55700107e0 tx=0x7f5570010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.094+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f557000b830 con 0x7f556c005d40 2019-11-28T12:02:35.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.268+0000 7f55906a7700 1 -- 172.21.15.80:0/3544481603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f55881219a0 con 0x7f556c005d40 2019-11-28T12:02:35.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.269+0000 7f558ec44700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f556c005d40 0x7f556c006130 secure :-1 s=THROTTLE_DONE pgs=3108 cs=0 l=1 rx=0x7f55700107e0 tx=0x7f5570010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.269+0000 7f55877fe700 1 -- 172.21.15.80:0/3544481603 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v240) v1 ==== 81+0+31925 (secure 0 0 0) 0x7f5570009af0 con 0x7f556c005d40 2019-11-28T12:02:35.265 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:35.265 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T12:02:35.265 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 240, 2019-11-28T12:02:35.265 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T12:02:35.265 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2019-11-28T11:24:56.548652+0000", 2019-11-28T12:02:35.266 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2019-11-28T12:02:34.813556+0000", 2019-11-28T12:02:35.266 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T12:02:35.266 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2019-11-28T11:25:08.546218+0000", 2019-11-28T12:02:35.266 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-11-28T12:02:35.266 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2019-11-28T12:02:35.266 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2019-11-28T12:02:35.267 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2019-11-28T12:02:35.267 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2019-11-28T12:02:35.267 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2019-11-28T12:02:35.267 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2019-11-28T12:02:35.267 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T12:02:35.267 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 6, 2019-11-28T12:02:35.267 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2019-11-28T12:02:35.268 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-11-28T12:02:35.268 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2019-11-28T12:02:35.268 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2019-11-28T12:02:35.268 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 39, 2019-11-28T12:02:35.268 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2019-11-28T12:02:35.269 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "jewel", 2019-11-28T12:02:35.269 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2019-11-28T12:02:35.269 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "octopus", 2019-11-28T12:02:35.269 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2019-11-28T12:02:35.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.269 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2019-11-28T12:02:35.270 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2019-11-28T12:02:35.270 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T11:25:12.488372+0000", 2019-11-28T12:02:35.270 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T12:02:35.270 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T12:02:35.270 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T12:02:35.270 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T12:02:35.270 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T12:02:35.271 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T12:02:35.271 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T12:02:35.271 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T12:02:35.271 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T12:02:35.271 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T12:02:35.271 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T12:02:35.271 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T12:02:35.272 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T12:02:35.272 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T12:02:35.272 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T12:02:35.272 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T12:02:35.272 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T12:02:35.272 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T12:02:35.272 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T12:02:35.273 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T12:02:35.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.273 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "18", 2019-11-28T12:02:35.273 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T12:02:35.273 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T12:02:35.273 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T12:02:35.274 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T12:02:35.274 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T12:02:35.274 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T12:02:35.274 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T12:02:35.274 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T12:02:35.275 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T12:02:35.275 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T12:02:35.275 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T12:02:35.275 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T12:02:35.275 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T12:02:35.275 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T12:02:35.275 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T12:02:35.276 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T12:02:35.276 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T12:02:35.276 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T12:02:35.276 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T12:02:35.276 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T12:02:35.276 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T12:02:35.276 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T12:02:35.277 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T12:02:35.277 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T12:02:35.277 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T12:02:35.277 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T12:02:35.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.277 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T12:02:35.278 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T12:02:35.278 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T12:02:35.278 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T12:02:35.278 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T12:02:35.278 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T12:02:35.278 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T12:02:35.278 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T12:02:35.279 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T12:02:35.279 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T12:02:35.279 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T12:02:35.279 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T12:02:35.279 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T12:02:35.279 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2019-11-28T12:02:35.279 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.280 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 38, 2019-11-28T12:02:35.280 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_metadata", 2019-11-28T12:02:35.280 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T12:01:39.532697+0000", 2019-11-28T12:02:35.280 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T12:02:35.281 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T12:02:35.281 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T12:02:35.281 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T12:02:35.281 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T12:02:35.281 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T12:02:35.282 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T12:02:35.283 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T12:02:35.283 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T12:02:35.283 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T12:02:35.284 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T12:02:35.284 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T12:02:35.284 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T12:02:35.284 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T12:02:35.285 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T12:02:35.285 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T12:02:35.285 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T12:02:35.285 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T12:02:35.285 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T12:02:35.285 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T12:02:35.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.286 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "233", 2019-11-28T12:02:35.286 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T12:02:35.286 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T12:02:35.286 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T12:02:35.286 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T12:02:35.287 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T12:02:35.287 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T12:02:35.287 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T12:02:35.288 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T12:02:35.289 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T12:02:35.290 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T12:02:35.291 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T12:02:35.291 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T12:02:35.291 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T12:02:35.291 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T12:02:35.292 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T12:02:35.292 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T12:02:35.292 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T12:02:35.292 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T12:02:35.292 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T12:02:35.293 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T12:02:35.293 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T12:02:35.293 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T12:02:35.293 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T12:02:35.294 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T12:02:35.294 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T12:02:35.294 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T12:02:35.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.294 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T12:02:35.295 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T12:02:35.295 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T12:02:35.295 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T12:02:35.295 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T12:02:35.296 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T12:02:35.296 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T12:02:35.296 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T12:02:35.297 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T12:02:35.297 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T12:02:35.297 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T12:02:35.298 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2019-11-28T12:02:35.298 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4, 2019-11-28T12:02:35.298 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 16, 2019-11-28T12:02:35.299 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_priority": 5 2019-11-28T12:02:35.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.299 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T12:02:35.299 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T12:02:35.300 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": "cephfs" 2019-11-28T12:02:35.300 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.301 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.302 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 39, 2019-11-28T12:02:35.302 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "cephfs_data", 2019-11-28T12:02:35.302 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2019-11-28T12:01:40.218947+0000", 2019-11-28T12:02:35.303 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2019-11-28T12:02:35.303 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2019-11-28T12:02:35.303 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2019-11-28T12:02:35.303 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2019-11-28T12:02:35.304 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2019-11-28T12:02:35.304 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2019-11-28T12:02:35.304 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2019-11-28T12:02:35.304 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2019-11-28T12:02:35.304 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2019-11-28T12:02:35.305 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2019-11-28T12:02:35.305 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2019-11-28T12:02:35.305 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2019-11-28T12:02:35.305 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2019-11-28T12:02:35.306 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2019-11-28T12:02:35.306 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2019-11-28T12:02:35.306 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2019-11-28T12:02:35.306 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2019-11-28T12:02:35.306 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2019-11-28T12:02:35.307 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2019-11-28T12:02:35.307 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2019-11-28T12:02:35.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.307 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "234", 2019-11-28T12:02:35.308 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2019-11-28T12:02:35.308 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2019-11-28T12:02:35.308 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2019-11-28T12:02:35.308 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2019-11-28T12:02:35.308 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2019-11-28T12:02:35.309 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2019-11-28T12:02:35.309 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2019-11-28T12:02:35.309 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2019-11-28T12:02:35.309 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2019-11-28T12:02:35.310 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2019-11-28T12:02:35.310 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2019-11-28T12:02:35.310 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2019-11-28T12:02:35.310 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2019-11-28T12:02:35.311 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2019-11-28T12:02:35.311 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2019-11-28T12:02:35.312 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2019-11-28T12:02:35.312 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2019-11-28T12:02:35.312 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2019-11-28T12:02:35.312 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-11-28T12:02:35.313 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-11-28T12:02:35.313 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2019-11-28T12:02:35.313 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2019-11-28T12:02:35.313 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2019-11-28T12:02:35.314 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2019-11-28T12:02:35.314 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2019-11-28T12:02:35.314 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2019-11-28T12:02:35.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.314 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2019-11-28T12:02:35.315 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2019-11-28T12:02:35.315 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2019-11-28T12:02:35.315 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2019-11-28T12:02:35.315 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2019-11-28T12:02:35.316 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2019-11-28T12:02:35.316 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2019-11-28T12:02:35.316 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2019-11-28T12:02:35.316 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2019-11-28T12:02:35.317 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2019-11-28T12:02:35.317 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2019-11-28T12:02:35.317 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2019-11-28T12:02:35.317 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2019-11-28T12:02:35.317 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs": { 2019-11-28T12:02:35.318 INFO:teuthology.orchestra.run.smithi080.stdout: "data": "cephfs" 2019-11-28T12:02:35.318 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.318 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.318 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.319 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T12:02:35.319 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2019-11-28T12:02:35.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.320 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T12:02:35.320 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "9a5b82f5-994b-42f6-82f9-82cf5ff644a5", 2019-11-28T12:02:35.320 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T12:02:35.320 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T12:02:35.321 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T12:02:35.321 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T12:02:35.321 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T12:02:35.321 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T12:02:35.322 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T12:02:35.323 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 232, 2019-11-28T12:02:35.323 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T12:02:35.323 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T12:02:35.323 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T12:02:35.323 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.324 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.324 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2019-11-28T12:02:35.324 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T12:02:35.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.325 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.325 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2019-11-28T12:02:35.326 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T12:02:35.326 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.326 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.327 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T12:02:35.327 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.328 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.328 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2019-11-28T12:02:35.328 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T12:02:35.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.329 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.329 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2019-11-28T12:02:35.329 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T12:02:35.329 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.330 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.330 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T12:02:35.330 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.331 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.331 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2019-11-28T12:02:35.331 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T12:02:35.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.332 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.332 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2019-11-28T12:02:35.333 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T12:02:35.333 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.333 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.334 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T12:02:35.334 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.334 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.334 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2019-11-28T12:02:35.334 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T12:02:35.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.335 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.335 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2019-11-28T12:02:35.335 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6092 2019-11-28T12:02:35.335 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.335 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.336 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/6092", 2019-11-28T12:02:35.336 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/6092", 2019-11-28T12:02:35.336 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/6092", 2019-11-28T12:02:35.336 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/6092", 2019-11-28T12:02:35.336 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T12:02:35.336 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T12:02:35.337 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T12:02:35.337 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.337 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T12:02:35.338 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "59f860a3-5032-4948-9d92-2b02d89ea495", 2019-11-28T12:02:35.338 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T12:02:35.338 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T12:02:35.338 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T12:02:35.339 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T12:02:35.339 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T12:02:35.339 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T12:02:35.339 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T12:02:35.339 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 232, 2019-11-28T12:02:35.339 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T12:02:35.340 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T12:02:35.340 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T12:02:35.340 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.340 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.340 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2019-11-28T12:02:35.341 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T12:02:35.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.341 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.341 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2019-11-28T12:02:35.342 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T12:02:35.342 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.342 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.342 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T12:02:35.342 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.343 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2019-11-28T12:02:35.343 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T12:02:35.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.344 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.344 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2019-11-28T12:02:35.344 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T12:02:35.345 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.345 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.346 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T12:02:35.346 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.347 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.347 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2019-11-28T12:02:35.347 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T12:02:35.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.348 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.348 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2019-11-28T12:02:35.348 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T12:02:35.349 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.349 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.349 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T12:02:35.350 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.350 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.350 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2019-11-28T12:02:35.351 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T12:02:35.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.352 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.352 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2019-11-28T12:02:35.352 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6094 2019-11-28T12:02:35.352 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.353 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.353 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6809/6094", 2019-11-28T12:02:35.353 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6811/6094", 2019-11-28T12:02:35.353 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6815/6094", 2019-11-28T12:02:35.354 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6813/6094", 2019-11-28T12:02:35.355 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T12:02:35.355 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T12:02:35.355 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T12:02:35.355 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.356 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T12:02:35.356 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "01501801-5512-4f8e-a689-d7a5220c8389", 2019-11-28T12:02:35.356 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T12:02:35.357 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T12:02:35.357 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T12:02:35.357 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T12:02:35.357 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T12:02:35.358 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T12:02:35.358 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T12:02:35.358 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 232, 2019-11-28T12:02:35.358 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T12:02:35.358 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T12:02:35.359 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T12:02:35.359 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.359 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.360 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2019-11-28T12:02:35.360 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T12:02:35.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.360 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.361 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2019-11-28T12:02:35.361 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T12:02:35.361 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.361 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.362 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T12:02:35.362 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.362 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.362 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2019-11-28T12:02:35.362 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T12:02:35.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.363 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.363 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2019-11-28T12:02:35.363 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T12:02:35.363 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.363 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.364 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T12:02:35.364 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.364 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.365 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2019-11-28T12:02:35.365 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T12:02:35.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.365 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.365 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2019-11-28T12:02:35.366 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T12:02:35.366 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.366 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.366 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T12:02:35.366 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.367 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.367 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2019-11-28T12:02:35.367 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T12:02:35.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.367 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.367 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2019-11-28T12:02:35.368 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6105 2019-11-28T12:02:35.368 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.368 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.368 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6817/6105", 2019-11-28T12:02:35.368 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6819/6105", 2019-11-28T12:02:35.368 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/6105", 2019-11-28T12:02:35.369 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/6105", 2019-11-28T12:02:35.369 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T12:02:35.369 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T12:02:35.369 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T12:02:35.369 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.370 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T12:02:35.370 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3a0ffd4c-5f68-42f0-b51a-69e873715619", 2019-11-28T12:02:35.370 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T12:02:35.370 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T12:02:35.370 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T12:02:35.370 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T12:02:35.370 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T12:02:35.371 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T12:02:35.371 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 14, 2019-11-28T12:02:35.371 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 232, 2019-11-28T12:02:35.371 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T12:02:35.371 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T12:02:35.371 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T12:02:35.371 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.372 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.372 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2019-11-28T12:02:35.372 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T12:02:35.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.372 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.373 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2019-11-28T12:02:35.373 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T12:02:35.373 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.373 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T12:02:35.374 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.374 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.374 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2019-11-28T12:02:35.374 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T12:02:35.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.375 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.375 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2019-11-28T12:02:35.375 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T12:02:35.375 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.376 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.376 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T12:02:35.376 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.376 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.377 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2019-11-28T12:02:35.377 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T12:02:35.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.377 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.377 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2019-11-28T12:02:35.378 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T12:02:35.378 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.378 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.378 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T12:02:35.378 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.379 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.379 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2019-11-28T12:02:35.379 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T12:02:35.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.379 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.380 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2019-11-28T12:02:35.380 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 6126 2019-11-28T12:02:35.380 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.380 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.380 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/6126", 2019-11-28T12:02:35.380 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/6126", 2019-11-28T12:02:35.381 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/6126", 2019-11-28T12:02:35.381 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/6126", 2019-11-28T12:02:35.381 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T12:02:35.381 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T12:02:35.381 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T12:02:35.381 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.382 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T12:02:35.382 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "fe40502b-24da-4e32-a3ae-709eddfaa03a", 2019-11-28T12:02:35.382 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T12:02:35.382 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T12:02:35.383 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T12:02:35.383 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T12:02:35.383 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T12:02:35.383 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T12:02:35.383 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T12:02:35.383 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 232, 2019-11-28T12:02:35.383 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T12:02:35.384 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T12:02:35.384 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T12:02:35.384 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.385 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.385 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6802", 2019-11-28T12:02:35.385 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T12:02:35.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.386 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.386 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6803", 2019-11-28T12:02:35.386 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T12:02:35.386 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.386 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.387 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T12:02:35.387 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.387 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.387 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6804", 2019-11-28T12:02:35.387 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T12:02:35.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.388 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.388 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6805", 2019-11-28T12:02:35.388 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T12:02:35.388 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.388 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.389 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T12:02:35.389 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.389 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.389 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6808", 2019-11-28T12:02:35.389 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T12:02:35.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.390 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.390 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6809", 2019-11-28T12:02:35.390 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T12:02:35.390 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.390 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.391 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T12:02:35.391 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.391 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.391 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6806", 2019-11-28T12:02:35.391 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T12:02:35.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.392 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.392 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6807", 2019-11-28T12:02:35.392 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36920 2019-11-28T12:02:35.392 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.392 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.393 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6803/36920", 2019-11-28T12:02:35.393 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6805/36920", 2019-11-28T12:02:35.393 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6809/36920", 2019-11-28T12:02:35.393 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6807/36920", 2019-11-28T12:02:35.393 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T12:02:35.393 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T12:02:35.394 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T12:02:35.394 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.394 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T12:02:35.394 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "4aba29c2-abad-41d2-97a9-cac1f5f7454a", 2019-11-28T12:02:35.395 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T12:02:35.395 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T12:02:35.395 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T12:02:35.395 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T12:02:35.395 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T12:02:35.395 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T12:02:35.395 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T12:02:35.395 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 232, 2019-11-28T12:02:35.396 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T12:02:35.396 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T12:02:35.397 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T12:02:35.397 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.397 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.397 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6810", 2019-11-28T12:02:35.398 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T12:02:35.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.398 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.398 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6811", 2019-11-28T12:02:35.399 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T12:02:35.399 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.399 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.399 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T12:02:35.399 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.400 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.400 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6812", 2019-11-28T12:02:35.400 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T12:02:35.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.401 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.401 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6813", 2019-11-28T12:02:35.401 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T12:02:35.401 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.401 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.401 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T12:02:35.402 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.402 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.402 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6816", 2019-11-28T12:02:35.402 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T12:02:35.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.403 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.403 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6817", 2019-11-28T12:02:35.403 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T12:02:35.403 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.403 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.403 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T12:02:35.404 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.404 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.404 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6814", 2019-11-28T12:02:35.404 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T12:02:35.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.405 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.405 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6815", 2019-11-28T12:02:35.405 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36928 2019-11-28T12:02:35.405 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.405 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.405 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6811/36928", 2019-11-28T12:02:35.406 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6813/36928", 2019-11-28T12:02:35.406 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6817/36928", 2019-11-28T12:02:35.406 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6815/36928", 2019-11-28T12:02:35.406 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T12:02:35.407 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T12:02:35.407 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T12:02:35.407 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.407 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T12:02:35.408 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "8cd8b938-4ac2-40f4-a7b0-b01afb88b878", 2019-11-28T12:02:35.408 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T12:02:35.408 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T12:02:35.409 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T12:02:35.409 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T12:02:35.409 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T12:02:35.409 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T12:02:35.409 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T12:02:35.410 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 231, 2019-11-28T12:02:35.410 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T12:02:35.410 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T12:02:35.410 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T12:02:35.410 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.410 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.411 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6818", 2019-11-28T12:02:35.411 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T12:02:35.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.411 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.411 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6819", 2019-11-28T12:02:35.411 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T12:02:35.412 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.412 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.412 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T12:02:35.412 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.412 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.413 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6820", 2019-11-28T12:02:35.413 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T12:02:35.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.413 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.413 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6821", 2019-11-28T12:02:35.413 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T12:02:35.414 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.414 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.414 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T12:02:35.414 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.414 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.414 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6824", 2019-11-28T12:02:35.415 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T12:02:35.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.415 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.415 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6825", 2019-11-28T12:02:35.415 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T12:02:35.416 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.416 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.416 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T12:02:35.416 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.416 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.417 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6822", 2019-11-28T12:02:35.417 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T12:02:35.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.417 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.417 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6823", 2019-11-28T12:02:35.417 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36962 2019-11-28T12:02:35.418 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.418 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.418 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6819/36962", 2019-11-28T12:02:35.418 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6821/36962", 2019-11-28T12:02:35.418 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6825/36962", 2019-11-28T12:02:35.418 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6823/36962", 2019-11-28T12:02:35.419 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T12:02:35.419 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T12:02:35.419 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T12:02:35.419 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.419 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T12:02:35.420 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "5aba17ce-f3d9-46c6-a034-a8657647719a", 2019-11-28T12:02:35.420 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2019-11-28T12:02:35.420 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2019-11-28T12:02:35.420 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2019-11-28T12:02:35.420 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2019-11-28T12:02:35.420 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2019-11-28T12:02:35.420 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2019-11-28T12:02:35.421 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2019-11-28T12:02:35.421 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 232, 2019-11-28T12:02:35.421 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2019-11-28T12:02:35.421 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2019-11-28T12:02:35.421 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2019-11-28T12:02:35.421 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.421 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.422 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6826", 2019-11-28T12:02:35.422 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T12:02:35.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.422 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.422 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6827", 2019-11-28T12:02:35.422 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T12:02:35.423 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.423 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.423 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2019-11-28T12:02:35.423 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.423 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.424 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6828", 2019-11-28T12:02:35.424 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T12:02:35.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.424 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.424 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6829", 2019-11-28T12:02:35.424 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T12:02:35.425 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.425 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.425 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2019-11-28T12:02:35.425 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.425 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.426 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6832", 2019-11-28T12:02:35.426 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T12:02:35.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.426 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.426 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6833", 2019-11-28T12:02:35.426 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T12:02:35.426 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.427 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.427 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2019-11-28T12:02:35.427 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2019-11-28T12:02:35.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.427 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2019-11-28T12:02:35.427 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6830", 2019-11-28T12:02:35.428 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T12:02:35.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.428 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2019-11-28T12:02:35.428 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.174:6831", 2019-11-28T12:02:35.428 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 36964 2019-11-28T12:02:35.428 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.429 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.429 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.174:6827/36964", 2019-11-28T12:02:35.429 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.174:6829/36964", 2019-11-28T12:02:35.429 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.174:6833/36964", 2019-11-28T12:02:35.429 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.174:6831/36964", 2019-11-28T12:02:35.429 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2019-11-28T12:02:35.430 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2019-11-28T12:02:35.430 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2019-11-28T12:02:35.430 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:35.430 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.430 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T12:02:35.430 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2019-11-28T12:02:35.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.431 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2019-11-28T12:02:35.431 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T12:02:35.431 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T12:02:35.431 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T12:02:35.431 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T12:02:35.431 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T12:02:35.431 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.483168+0000", 2019-11-28T12:02:35.431 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T12:02:35.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.432 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2019-11-28T12:02:35.432 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T12:02:35.432 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T12:02:35.432 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T12:02:35.432 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T12:02:35.433 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T12:02:35.433 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.542689+0000", 2019-11-28T12:02:35.433 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T12:02:35.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.433 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2019-11-28T12:02:35.433 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T12:02:35.434 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T12:02:35.434 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T12:02:35.434 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T12:02:35.434 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T12:02:35.434 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.531732+0000", 2019-11-28T12:02:35.434 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T12:02:35.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.435 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2019-11-28T12:02:35.435 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T12:02:35.435 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T12:02:35.435 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T12:02:35.435 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T12:02:35.435 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T12:02:35.436 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.532239+0000", 2019-11-28T12:02:35.436 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T12:02:35.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.436 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2019-11-28T12:02:35.436 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T12:02:35.436 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T12:02:35.437 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T12:02:35.437 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T12:02:35.437 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T12:02:35.437 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.457410+0000", 2019-11-28T12:02:35.437 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T12:02:35.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.437 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2019-11-28T12:02:35.438 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T12:02:35.438 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T12:02:35.438 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T12:02:35.438 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T12:02:35.438 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T12:02:35.438 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.529617+0000", 2019-11-28T12:02:35.438 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T12:02:35.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.439 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2019-11-28T12:02:35.439 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T12:02:35.439 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T12:02:35.439 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T12:02:35.439 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T12:02:35.440 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T12:02:35.440 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.540646+0000", 2019-11-28T12:02:35.440 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T12:02:35.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:35.440 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2019-11-28T12:02:35.441 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2019-11-28T12:02:35.441 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2019-11-28T12:02:35.441 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2019-11-28T12:02:35.441 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540138292836696063, 2019-11-28T12:02:35.441 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2019-11-28T12:02:35.441 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2019-11-28T11:25:06.523454+0000", 2019-11-28T12:02:35.441 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2019-11-28T12:02:35.442 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.442 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2019-11-28T12:02:35.442 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2019-11-28T12:02:35.442 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2019-11-28T12:02:35.442 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2019-11-28T12:02:35.442 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2019-11-28T12:02:35.442 INFO:teuthology.orchestra.run.smithi080.stdout: "blacklist": { 2019-11-28T12:02:35.443 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/90324510": "2019-11-29T12:02:34.804261+0000", 2019-11-28T12:02:35.443 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/90324510": "2019-11-29T12:02:34.804261+0000", 2019-11-28T12:02:35.443 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6835/1019990404": "2019-11-29T12:02:21.696226+0000", 2019-11-28T12:02:35.443 INFO:teuthology.orchestra.run.smithi080.stdout: "172.21.15.174:6834/1019990404": "2019-11-29T12:02:21.696226+0000" 2019-11-28T12:02:35.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.443 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2019-11-28T12:02:35.443 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_data": { 2019-11-28T12:02:35.444 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-device-class": "", 2019-11-28T12:02:35.444 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T12:02:35.444 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-root": "default", 2019-11-28T12:02:35.444 INFO:teuthology.orchestra.run.smithi080.stdout: "jerasure-per-chunk-alignment": "false", 2019-11-28T12:02:35.444 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T12:02:35.444 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "2", 2019-11-28T12:02:35.444 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T12:02:35.445 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T12:02:35.445 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van", 2019-11-28T12:02:35.445 INFO:teuthology.orchestra.run.smithi080.stdout: "w": "8" 2019-11-28T12:02:35.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.445 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2019-11-28T12:02:35.445 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2019-11-28T12:02:35.445 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2019-11-28T12:02:35.445 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2019-11-28T12:02:35.446 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2019-11-28T12:02:35.446 INFO:teuthology.orchestra.run.smithi080.stdout: "ruleset-failure-domain": "osd", 2019-11-28T12:02:35.446 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2019-11-28T12:02:35.446 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:35.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:35.446 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2019-11-28T12:02:35.446 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2019-11-28T12:02:35.447 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2019-11-28T12:02:35.447 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2019-11-28T12:02:35.447 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {} 2019-11-28T12:02:35.447 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T12:02:35.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.273+0000 7f55906a7700 1 -- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f556c020c10 msgr2=0x7f556c023040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.273+0000 7f55906a7700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f556c020c10 0x7f556c023040 crc :-1 s=READY pgs=1287 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:35.449 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.273+0000 7f55906a7700 1 -- 172.21.15.80:0/3544481603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f556c005d40 msgr2=0x7f556c006130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.273+0000 7f55906a7700 1 --2- 172.21.15.80:0/3544481603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f556c005d40 0x7f556c006130 secure :-1 s=READY pgs=3108 cs=0 l=1 rx=0x7f55700107e0 tx=0x7f5570010b80).stop 2019-11-28T12:02:35.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.273+0000 7f558f445700 1 -- 172.21.15.80:0/3544481603 reap_dead start 2019-11-28T12:02:35.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.273+0000 7f558f445700 1 -- 172.21.15.80:0/3544481603 reap_dead start 2019-11-28T12:02:35.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.273+0000 7f55906a7700 1 -- 172.21.15.80:0/3544481603 shutdown_connections 2019-11-28T12:02:35.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.273+0000 7f55906a7700 1 -- 172.21.15.80:0/3544481603 shutdown_connections 2019-11-28T12:02:35.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.273+0000 7f55906a7700 1 -- 172.21.15.80:0/3544481603 wait complete. 2019-11-28T12:02:35.450 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.274+0000 7f55906a7700 1 -- 172.21.15.80:0/3544481603 >> 172.21.15.80:0/3544481603 conn(0x7f55881426c0 msgr2=0x7f5588110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:35.452 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:35.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.578+0000 7f7b759f7700 1 Processor -- start 2019-11-28T12:02:35.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.578+0000 7f7b759f7700 1 -- start start 2019-11-28T12:02:35.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.579+0000 7f7b759f7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b7006c0a0 0x7f7b70072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:35.576 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.579+0000 7f7b759f7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7006db00 con 0x7f7b70072620 2019-11-28T12:02:35.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.579+0000 7f7b759f7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7006e000 con 0x7f7b700734e0 2019-11-28T12:02:35.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.579+0000 7f7b759f7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7006f330 con 0x7f7b7006c0a0 2019-11-28T12:02:35.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.579+0000 7f7b6ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7b70072620 0x7f7b70164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47646/0 (socket says 172.21.15.80:47646) 2019-11-28T12:02:35.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.579+0000 7f7b6ffff700 1 -- 172.21.15.80:0/2865182342 learned_addr learned my addr 172.21.15.80:0/2865182342 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:35.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.579+0000 7f7b6f7fe700 1 --2- 172.21.15.80:0/2865182342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b7006c0a0 0x7f7b70072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:35.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.579+0000 7f7b6e7fc700 1 -- 172.21.15.80:0/2865182342 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195102961 0 0) 0x7f7b68001150 con 0x7f7b70072620 2019-11-28T12:02:35.577 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b6e7fc700 1 -- 172.21.15.80:0/2865182342 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b50002e80 con 0x7f7b70072620 2019-11-28T12:02:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b6e7fc700 1 -- 172.21.15.80:0/2865182342 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201369830 0 0) 0x7f7b580013b0 con 0x7f7b700734e0 2019-11-28T12:02:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b6e7fc700 1 -- 172.21.15.80:0/2865182342 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b500030b0 con 0x7f7b700734e0 2019-11-28T12:02:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b6e7fc700 1 -- 172.21.15.80:0/2865182342 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 554819284 0 0) 0x7f7b68001130 con 0x7f7b70072620 2019-11-28T12:02:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b6f7fe700 1 -- 172.21.15.80:0/2865182342 >> v1:172.21.15.174:6789/0 conn(0x7f7b700734e0 legacy=0x7f7b70071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b6f7fe700 1 -- 172.21.15.80:0/2865182342 >> v1:172.21.15.80:6789/0 conn(0x7f7b70072620 legacy=0x7f7b70164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b6f7fe700 1 -- 172.21.15.80:0/2865182342 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b700706c0 con 0x7f7b7006c0a0 2019-11-28T12:02:35.578 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b6f7fe700 1 --2- 172.21.15.80:0/2865182342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b7006c0a0 0x7f7b70072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7b6000af50 tx=0x7f7b6000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b6f7fe700 1 --2- 172.21.15.80:0/2865182342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b7006c0a0 0x7f7b70072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7b6000af50 tx=0x7f7b6000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b6f7fe700 1 --2- 172.21.15.80:0/2865182342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b7006c0a0 0x7f7b70072fa0 secure :-1 s=READY pgs=448 cs=0 l=1 rx=0x7f7b6000af50 tx=0x7f7b6000b760).ready entity=mon.2 client_cookie=faca057e5f392573 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:35.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b6f7fe700 1 --2- 172.21.15.80:0/2865182342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b7006c0a0 0x7f7b70072fa0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7f7b6000af50 tx=0x7f7b6000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b6e7fc700 1 -- 172.21.15.80:0/2865182342 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b60000960 con 0x7f7b7006c0a0 2019-11-28T12:02:35.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b6f7fe700 1 --2- 172.21.15.80:0/2865182342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b7006c0a0 0x7f7b70072fa0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7f7b6000af50 tx=0x7f7b6000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b6f7fe700 1 --2- 172.21.15.80:0/2865182342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b7006c0a0 0x7f7b70072fa0 secure :-1 s=THROTTLE_DONE pgs=448 cs=0 l=1 rx=0x7f7b6000af50 tx=0x7f7b6000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.579 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b6e7fc700 1 -- 172.21.15.80:0/2865182342 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b60009860 con 0x7f7b7006c0a0 2019-11-28T12:02:35.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b6e7fc700 1 -- 172.21.15.80:0/2865182342 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b60000960 con 0x7f7b7006c0a0 2019-11-28T12:02:35.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b759f7700 1 -- 172.21.15.80:0/2865182342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b7006c0a0 msgr2=0x7f7b70072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.580+0000 7f7b759f7700 1 --2- 172.21.15.80:0/2865182342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b7006c0a0 0x7f7b70072fa0 secure :-1 s=READY pgs=448 cs=0 l=1 rx=0x7f7b6000af50 tx=0x7f7b6000b760).stop 2019-11-28T12:02:35.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.581+0000 7f7b759f7700 1 -- 172.21.15.80:0/2865182342 shutdown_connections 2019-11-28T12:02:35.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.581+0000 7f7b759f7700 1 --2- 172.21.15.80:0/2865182342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7b7006c0a0 0x7f7b70072fa0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:35.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.581+0000 7f7b759f7700 1 -- 172.21.15.80:0/2865182342 shutdown_connections 2019-11-28T12:02:35.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.581+0000 7f7b759f7700 1 -- 172.21.15.80:0/2865182342 wait complete. 2019-11-28T12:02:35.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.581+0000 7f7b759f7700 1 -- 172.21.15.80:0/2865182342 >> 172.21.15.80:0/2865182342 conn(0x7f7b70061cf0 msgr2=0x7f7b70064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:35.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.583+0000 7f7b759f7700 1 Processor -- start 2019-11-28T12:02:35.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.583+0000 7f7b759f7700 1 -- start start 2019-11-28T12:02:35.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.584+0000 7f7b759f7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7b70166a10 0x7f7b70168e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:35.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.584+0000 7f7b759f7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b70124260 con 0x7f7b70111db0 2019-11-28T12:02:35.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.584+0000 7f7b759f7700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7012e5d0 con 0x7f7b7012cea0 2019-11-28T12:02:35.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.584+0000 7f7b759f7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b70121040 con 0x7f7b70166a10 2019-11-28T12:02:35.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.584+0000 7f7b6effd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7b70111db0 0x7f7b701238e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47652/0 (socket says 172.21.15.80:47652) 2019-11-28T12:02:35.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.584+0000 7f7b6effd700 1 -- 172.21.15.80:0/2353546254 learned_addr learned my addr 172.21.15.80:0/2353546254 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:35.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b6ffff700 1 --2- 172.21.15.80:0/2353546254 >> v2:172.21.15.174:3300/0 conn(0x7f7b70166a10 0x7f7b70168e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:35.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b67fff700 1 -- 172.21.15.80:0/2353546254 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500397071 0 0) 0x7f7b580015c0 con 0x7f7b70111db0 2019-11-28T12:02:35.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b67fff700 1 -- 172.21.15.80:0/2353546254 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b48002e80 con 0x7f7b70111db0 2019-11-28T12:02:35.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b6ffff700 1 -- 172.21.15.80:0/2353546254 >> v1:172.21.15.174:6789/0 conn(0x7f7b7012cea0 legacy=0x7f7b701230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b6ffff700 1 -- 172.21.15.80:0/2353546254 >> v1:172.21.15.80:6789/0 conn(0x7f7b70111db0 legacy=0x7f7b701238e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b67fff700 1 -- 172.21.15.80:0/2353546254 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1492823864 0 0) 0x7f7b580017c0 con 0x7f7b70111db0 2019-11-28T12:02:35.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b6ffff700 1 -- 172.21.15.80:0/2353546254 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b701219a0 con 0x7f7b70166a10 2019-11-28T12:02:35.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b6ffff700 1 --2- 172.21.15.80:0/2353546254 >> v2:172.21.15.174:3300/0 conn(0x7f7b70166a10 0x7f7b70168e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b68010370 tx=0x7f7b68010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b6ffff700 1 --2- 172.21.15.80:0/2353546254 >> v2:172.21.15.174:3300/0 conn(0x7f7b70166a10 0x7f7b70168e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b68010370 tx=0x7f7b68010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b6ffff700 1 --2- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b70166a10 0x7f7b70168e10 secure :-1 s=READY pgs=1884 cs=0 l=1 rx=0x7f7b68010370 tx=0x7f7b68010710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:35.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b6ffff700 1 --2- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b70166a10 0x7f7b70168e10 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7f7b68010370 tx=0x7f7b68010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b67fff700 1 -- 172.21.15.80:0/2353546254 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b68000ef0 con 0x7f7b70166a10 2019-11-28T12:02:35.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b6ffff700 1 --2- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b70166a10 0x7f7b70168e10 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7f7b68010370 tx=0x7f7b68010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b6ffff700 1 --2- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b70166a10 0x7f7b70168e10 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7f7b68010370 tx=0x7f7b68010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b67fff700 1 -- 172.21.15.80:0/2353546254 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b68004430 con 0x7f7b70166a10 2019-11-28T12:02:35.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b67fff700 1 -- 172.21.15.80:0/2353546254 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b68004b00 con 0x7f7b70166a10 2019-11-28T12:02:35.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b759f7700 1 -- 172.21.15.80:0/2353546254 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b70121d20 con 0x7f7b70166a10 2019-11-28T12:02:35.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.585+0000 7f7b759f7700 1 -- 172.21.15.80:0/2353546254 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b701219a0 con 0x7f7b70166a10 2019-11-28T12:02:35.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.586+0000 7f7b6ffff700 1 --2- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b70166a10 0x7f7b70168e10 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7f7b68010370 tx=0x7f7b68010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.586+0000 7f7b6ffff700 1 --2- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b70166a10 0x7f7b70168e10 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7f7b68010370 tx=0x7f7b68010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.586+0000 7f7b67fff700 1 -- 172.21.15.80:0/2353546254 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7b68004620 con 0x7f7b70166a10 2019-11-28T12:02:35.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.586+0000 7f7b67fff700 1 --2- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b48018780 0x7f7b4801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:35.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.586+0000 7f7b67fff700 1 -- 172.21.15.80:0/2353546254 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(240..240 src has 1..240) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f7b68031aa0 con 0x7f7b70166a10 2019-11-28T12:02:35.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.586+0000 7f7b6f7fe700 1 --2- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b48018780 0x7f7b4801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:35.588 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.587+0000 7f7b6f7fe700 1 --2- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b48018780 0x7f7b4801abf0 crc :-1 s=READY pgs=1288 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:35.589 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.593+0000 7f7b759f7700 1 -- 172.21.15.80:0/2353546254 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b70121d20 con 0x7f7b70166a10 2019-11-28T12:02:35.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.597+0000 7f7b6ffff700 1 --2- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b70166a10 0x7f7b70168e10 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7f7b68010370 tx=0x7f7b68010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.590 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.597+0000 7f7b67fff700 1 -- 172.21.15.80:0/2353546254 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7b68000940 con 0x7f7b70166a10 2019-11-28T12:02:35.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.773+0000 7f7b759f7700 1 -- 172.21.15.80:0/2353546254 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b701219a0 con 0x7f7b70166a10 2019-11-28T12:02:35.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.774+0000 7f7b6ffff700 1 --2- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b70166a10 0x7f7b70168e10 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7f7b68010370 tx=0x7f7b68010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.767 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.774+0000 7f7b67fff700 1 -- 172.21.15.80:0/2353546254 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 202 v202) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f7b68005020 con 0x7f7b70166a10 2019-11-28T12:02:35.767 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 202 2019-11-28T12:02:35.768 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:35.768 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":202,"default_fscid":19,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":202,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:01:41.241732+0000","modified":"2019-11-28T12:02:34.856193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":239,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[39],"metadata_pool":38,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":19}]} 2019-11-28T12:02:35.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.776+0000 7f7b759f7700 1 -- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b48018780 msgr2=0x7f7b4801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.776+0000 7f7b759f7700 1 --2- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b48018780 0x7f7b4801abf0 crc :-1 s=READY pgs=1288 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:35.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.776+0000 7f7b759f7700 1 -- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b70166a10 msgr2=0x7f7b70168e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.776+0000 7f7b759f7700 1 --2- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b70166a10 0x7f7b70168e10 secure :-1 s=READY pgs=1884 cs=0 l=1 rx=0x7f7b68010370 tx=0x7f7b68010710).stop 2019-11-28T12:02:35.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.776+0000 7f7b759f7700 1 -- 172.21.15.80:0/2353546254 shutdown_connections 2019-11-28T12:02:35.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.776+0000 7f7b759f7700 1 --2- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b70166a10 0x7f7b70168e10 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:35.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.776+0000 7f7b759f7700 1 --2- 172.21.15.80:0/2353546254 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7b48018780 0x7f7b4801abf0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:35.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.776+0000 7f7b759f7700 1 -- 172.21.15.80:0/2353546254 shutdown_connections 2019-11-28T12:02:35.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.776+0000 7f7b759f7700 1 -- 172.21.15.80:0/2353546254 wait complete. 2019-11-28T12:02:35.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.776+0000 7f7b759f7700 1 -- 172.21.15.80:0/2353546254 >> 172.21.15.80:0/2353546254 conn(0x7f7b701426c0 msgr2=0x7f7b70110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:35.779 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-11-28T12:02:35.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.910+0000 7f1c4cfb4700 1 Processor -- start 2019-11-28T12:02:35.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.910+0000 7f1c4cfb4700 1 -- start start 2019-11-28T12:02:35.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.911+0000 7f1c4cfb4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c4806d120 0x7f1c48165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:35.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.911+0000 7f1c4cfb4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4806d580 con 0x7f1c4806c0a0 2019-11-28T12:02:35.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.911+0000 7f1c4cfb4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4806db00 con 0x7f1c4806c490 2019-11-28T12:02:35.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.911+0000 7f1c4cfb4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4806fd60 con 0x7f1c4806d120 2019-11-28T12:02:35.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.911+0000 7f1c46d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1c4806c0a0 0x7f1c48072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47658/0 (socket says 172.21.15.80:47658) 2019-11-28T12:02:35.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.911+0000 7f1c46d9d700 1 -- 172.21.15.80:0/3417914927 learned_addr learned my addr 172.21.15.80:0/3417914927 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:35.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c4759e700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c4806d120 0x7f1c48165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:35.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 -- 172.21.15.80:0/3417914927 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158140584 0 0) 0x7f1c300014d0 con 0x7f1c4806c0a0 2019-11-28T12:02:35.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 -- 172.21.15.80:0/3417914927 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c28002e80 con 0x7f1c4806c0a0 2019-11-28T12:02:35.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 -- 172.21.15.80:0/3417914927 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464166543 0 0) 0x7f1c38001080 con 0x7f1c4806c490 2019-11-28T12:02:35.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 -- 172.21.15.80:0/3417914927 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c280030b0 con 0x7f1c4806c490 2019-11-28T12:02:35.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 -- 172.21.15.80:0/3417914927 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 337506319 0 0) 0x7f1c300014b0 con 0x7f1c4806c0a0 2019-11-28T12:02:35.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 -- 172.21.15.80:0/3417914927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c4806d120 msgr2=0x7f1c48165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:35.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c4806d120 0x7f1c48165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:35.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 -- 172.21.15.80:0/3417914927 >> v1:172.21.15.174:6789/0 conn(0x7f1c4806c490 legacy=0x7f1c4806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 -- 172.21.15.80:0/3417914927 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c480706c0 con 0x7f1c4806c0a0 2019-11-28T12:02:35.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 -- 172.21.15.80:0/3417914927 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f1c300019e0 con 0x7f1c4806c0a0 2019-11-28T12:02:35.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 -- 172.21.15.80:0/3417914927 >> v1:172.21.15.80:6789/0 conn(0x7f1c4806c0a0 legacy=0x7f1c48072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c28003b80 0x7f1c28005fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:35.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c280066b0 0x7f1c28008b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:35.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c2804d3a0 0x7f1c2804f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:35.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 -- 172.21.15.80:0/3417914927 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2804fff0 con 0x7f1c28003b80 2019-11-28T12:02:35.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 -- 172.21.15.80:0/3417914927 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c280501e0 con 0x7f1c280066b0 2019-11-28T12:02:35.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c45d9b700 1 -- 172.21.15.80:0/3417914927 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c28050410 con 0x7f1c2804d3a0 2019-11-28T12:02:35.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c28003b80 0x7f1c28005fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:35.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c4759e700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c2804d3a0 0x7f1c2804f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:35.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c4659c700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c280066b0 0x7f1c28008b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:35.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c46d9d700 1 -- 172.21.15.80:0/3417914927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c2804d3a0 msgr2=0x7f1c2804f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:35.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1c2804d3a0 0x7f1c2804f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:35.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c46d9d700 1 -- 172.21.15.80:0/3417914927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c280066b0 msgr2=0x7f1c28008b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:35.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c280066b0 0x7f1c28008b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:35.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c46d9d700 1 -- 172.21.15.80:0/3417914927 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c280506c0 con 0x7f1c28003b80 2019-11-28T12:02:35.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.912+0000 7f1c4659c700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1c280066b0 0x7f1c28008b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T12:02:35.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.913+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c28003b80 0x7f1c28005fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1c3000fc10 tx=0x7f1c3000ffb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.913+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c28003b80 0x7f1c28005fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1c3000fc10 tx=0x7f1c3000ffb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.913+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c28003b80 0x7f1c28005fc0 secure :-1 s=READY pgs=3112 cs=0 l=1 rx=0x7f1c3000fc10 tx=0x7f1c3000ffb0).ready entity=mon.0 client_cookie=7dc98fb100cce56f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:35.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.913+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c28003b80 0x7f1c28005fc0 secure :-1 s=THROTTLE_DONE pgs=3112 cs=0 l=1 rx=0x7f1c3000fc10 tx=0x7f1c3000ffb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.913+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c28003b80 0x7f1c28005fc0 secure :-1 s=THROTTLE_DONE pgs=3112 cs=0 l=1 rx=0x7f1c3000fc10 tx=0x7f1c3000ffb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.913+0000 7f1c45d9b700 1 -- 172.21.15.80:0/3417914927 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c300014b0 con 0x7f1c28003b80 2019-11-28T12:02:35.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.913+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c28003b80 0x7f1c28005fc0 secure :-1 s=THROTTLE_DONE pgs=3112 cs=0 l=1 rx=0x7f1c3000fc10 tx=0x7f1c3000ffb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.913+0000 7f1c45d9b700 1 -- 172.21.15.80:0/3417914927 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c300045c0 con 0x7f1c28003b80 2019-11-28T12:02:35.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.913+0000 7f1c45d9b700 1 -- 172.21.15.80:0/3417914927 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c30004c10 con 0x7f1c28003b80 2019-11-28T12:02:35.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.913+0000 7f1c4cfb4700 1 -- 172.21.15.80:0/3417914927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c28003b80 msgr2=0x7f1c28005fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.913+0000 7f1c4cfb4700 1 --2- 172.21.15.80:0/3417914927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c28003b80 0x7f1c28005fc0 secure :-1 s=READY pgs=3112 cs=0 l=1 rx=0x7f1c3000fc10 tx=0x7f1c3000ffb0).stop 2019-11-28T12:02:35.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.913+0000 7f1c4759e700 1 -- 172.21.15.80:0/3417914927 reap_dead start 2019-11-28T12:02:35.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.913+0000 7f1c4cfb4700 1 -- 172.21.15.80:0/3417914927 shutdown_connections 2019-11-28T12:02:35.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.914+0000 7f1c4cfb4700 1 -- 172.21.15.80:0/3417914927 shutdown_connections 2019-11-28T12:02:35.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.914+0000 7f1c4cfb4700 1 -- 172.21.15.80:0/3417914927 wait complete. 2019-11-28T12:02:35.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.914+0000 7f1c4cfb4700 1 -- 172.21.15.80:0/3417914927 >> 172.21.15.80:0/3417914927 conn(0x7f1c48061cf0 msgr2=0x7f1c48064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:35.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.916+0000 7f1c4cfb4700 1 Processor -- start 2019-11-28T12:02:35.917 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.916+0000 7f1c4cfb4700 1 -- start start 2019-11-28T12:02:35.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c4cfb4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1c48077040 0x7f1c481574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:35.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c4cfb4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1c48157a00 0x7f1c48074a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:35.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c4cfb4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c48140820 con 0x7f1c48074f50 2019-11-28T12:02:35.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c4cfb4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c48137110 con 0x7f1c48077040 2019-11-28T12:02:35.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c4cfb4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c481373e0 con 0x7f1c48157a00 2019-11-28T12:02:35.921 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c46d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1c48077040 0x7f1c481574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:35.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c4759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1c48074f50 0x7f1c48156340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47674/0 (socket says 172.21.15.80:47674) 2019-11-28T12:02:35.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c4759e700 1 -- 172.21.15.80:0/2972616680 learned_addr learned my addr 172.21.15.80:0/2972616680 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:35.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c4659c700 1 --2- 172.21.15.80:0/2972616680 >> v2:172.21.15.174:3300/0 conn(0x7f1c48157a00 0x7f1c48074a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:35.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c46d9d700 1 -- 172.21.15.80:0/2972616680 >> v2:172.21.15.174:3300/0 conn(0x7f1c48157a00 msgr2=0x7f1c48074a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/2972616680 >> v2:172.21.15.174:3300/0 conn(0x7f1c48157a00 0x7f1c48074a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:35.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c46d9d700 1 -- 172.21.15.80:0/2972616680 >> v1:172.21.15.80:6789/0 conn(0x7f1c48074f50 legacy=0x7f1c48156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:35.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c46d9d700 1 -- 172.21.15.80:0/2972616680 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c48137a70 con 0x7f1c48077040 2019-11-28T12:02:35.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c3f7fe700 1 -- 172.21.15.80:0/2972616680 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241429928 0 0) 0x7f1c40001290 con 0x7f1c48074f50 2019-11-28T12:02:35.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/2972616680 >> v2:172.21.15.80:3300/0 conn(0x7f1c48077040 0x7f1c481574c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c30010710 tx=0x7f1c30010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/2972616680 >> v2:172.21.15.80:3300/0 conn(0x7f1c48077040 0x7f1c481574c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c30010710 tx=0x7f1c30010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/2972616680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c48077040 0x7f1c481574c0 secure :-1 s=READY pgs=3114 cs=0 l=1 rx=0x7f1c30010710 tx=0x7f1c30010540).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:35.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/2972616680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c48077040 0x7f1c481574c0 secure :-1 s=THROTTLE_DONE pgs=3114 cs=0 l=1 rx=0x7f1c30010710 tx=0x7f1c30010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c3f7fe700 1 -- 172.21.15.80:0/2972616680 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c30001010 con 0x7f1c48077040 2019-11-28T12:02:35.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/2972616680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c48077040 0x7f1c481574c0 secure :-1 s=THROTTLE_DONE pgs=3114 cs=0 l=1 rx=0x7f1c30010710 tx=0x7f1c30010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/2972616680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c48077040 0x7f1c481574c0 secure :-1 s=THROTTLE_DONE pgs=3114 cs=0 l=1 rx=0x7f1c30010710 tx=0x7f1c30010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c3f7fe700 1 -- 172.21.15.80:0/2972616680 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c300047b0 con 0x7f1c48077040 2019-11-28T12:02:35.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c3f7fe700 1 -- 172.21.15.80:0/2972616680 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c30004e80 con 0x7f1c48077040 2019-11-28T12:02:35.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c4cfb4700 1 -- 172.21.15.80:0/2972616680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c48137df0 con 0x7f1c48077040 2019-11-28T12:02:35.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.917+0000 7f1c4cfb4700 1 -- 172.21.15.80:0/2972616680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c48137a70 con 0x7f1c48077040 2019-11-28T12:02:35.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.918+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/2972616680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c48077040 0x7f1c481574c0 secure :-1 s=THROTTLE_DONE pgs=3114 cs=0 l=1 rx=0x7f1c30010710 tx=0x7f1c30010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.918+0000 7f1c3f7fe700 1 -- 172.21.15.80:0/2972616680 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1c300049a0 con 0x7f1c48077040 2019-11-28T12:02:35.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.918+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/2972616680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c48077040 0x7f1c481574c0 secure :-1 s=THROTTLE_DONE pgs=3114 cs=0 l=1 rx=0x7f1c30010710 tx=0x7f1c30010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.918+0000 7f1c3f7fe700 1 --2- 172.21.15.80:0/2972616680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1c20018730 0x7f1c2001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:35.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.918+0000 7f1c3f7fe700 1 -- 172.21.15.80:0/2972616680 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(240..240 src has 1..240) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f1c30031d70 con 0x7f1c48077040 2019-11-28T12:02:35.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.918+0000 7f1c4659c700 1 --2- 172.21.15.80:0/2972616680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1c20018730 0x7f1c2001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:35.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.919+0000 7f1c4659c700 1 --2- 172.21.15.80:0/2972616680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1c20018730 0x7f1c2001abc0 crc :-1 s=READY pgs=1289 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:35.925 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.926+0000 7f1c4cfb4700 1 -- 172.21.15.80:0/2972616680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c48137df0 con 0x7f1c48077040 2019-11-28T12:02:35.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.929+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/2972616680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c48077040 0x7f1c481574c0 secure :-1 s=THROTTLE_DONE pgs=3114 cs=0 l=1 rx=0x7f1c30010710 tx=0x7f1c30010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:35.926 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:35.929+0000 7f1c3f7fe700 1 -- 172.21.15.80:0/2972616680 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1c30022410 con 0x7f1c48077040 2019-11-28T12:02:36.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:36.094+0000 7f1c4cfb4700 1 -- 172.21.15.80:0/2972616680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1c48137a70 con 0x7f1c48077040 2019-11-28T12:02:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:36.864+0000 7f1c46d9d700 1 --2- 172.21.15.80:0/2972616680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c48077040 0x7f1c481574c0 secure :-1 s=THROTTLE_DONE pgs=3114 cs=0 l=1 rx=0x7f1c30010710 tx=0x7f1c30010540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:36.864+0000 7f1c3f7fe700 1 -- 172.21.15.80:0/2972616680 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v203) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1c300049a0 con 0x7f1c48077040 2019-11-28T12:02:36.904 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-11-28T12:02:36.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:36.912+0000 7f1c4cfb4700 1 -- 172.21.15.80:0/2972616680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1c20018730 msgr2=0x7f1c2001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:36.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:36.912+0000 7f1c4cfb4700 1 --2- 172.21.15.80:0/2972616680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1c20018730 0x7f1c2001abc0 crc :-1 s=READY pgs=1289 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:36.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:36.912+0000 7f1c4cfb4700 1 -- 172.21.15.80:0/2972616680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c48077040 msgr2=0x7f1c481574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:36.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:36.912+0000 7f1c4cfb4700 1 --2- 172.21.15.80:0/2972616680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c48077040 0x7f1c481574c0 secure :-1 s=READY pgs=3114 cs=0 l=1 rx=0x7f1c30010710 tx=0x7f1c30010540).stop 2019-11-28T12:02:36.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:36.912+0000 7f1c4cfb4700 1 -- 172.21.15.80:0/2972616680 shutdown_connections 2019-11-28T12:02:36.906 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:36.912+0000 7f1c4cfb4700 1 --2- 172.21.15.80:0/2972616680 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1c20018730 0x7f1c2001abc0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:36.912+0000 7f1c4cfb4700 1 --2- 172.21.15.80:0/2972616680 >> v2:172.21.15.174:3300/0 conn(0x7f1c48157a00 0x7f1c48074a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:36.912+0000 7f1c4cfb4700 1 --2- 172.21.15.80:0/2972616680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c48077040 0x7f1c481574c0 unknown :-1 s=CLOSED pgs=3114 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:36.912+0000 7f1c4cfb4700 1 -- 172.21.15.80:0/2972616680 shutdown_connections 2019-11-28T12:02:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:36.912+0000 7f1c4cfb4700 1 -- 172.21.15.80:0/2972616680 wait complete. 2019-11-28T12:02:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:36.912+0000 7f1c4cfb4700 1 -- 172.21.15.80:0/2972616680 >> 172.21.15.80:0/2972616680 conn(0x7f1c4813fa50 msgr2=0x7f1c4807c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:36.916 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:37.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.044+0000 7fc9b24b6700 1 Processor -- start 2019-11-28T12:02:37.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.044+0000 7fc9b24b6700 1 -- start start 2019-11-28T12:02:37.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9b24b6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9ac06c490 0x7fc9ac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:37.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9b24b6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ac06db00 con 0x7fc9ac06ce60 2019-11-28T12:02:37.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9b24b6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ac06e000 con 0x7fc9ac06c0a0 2019-11-28T12:02:37.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9b24b6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ac06fd60 con 0x7fc9ac06c490 2019-11-28T12:02:37.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9abfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9ac06c490 0x7fc9ac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:37.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9b1254700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc9ac06ce60 0x7fc9ac164d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47678/0 (socket says 172.21.15.80:47678) 2019-11-28T12:02:37.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9abfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9ac06c490 0x7fc9ac06c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48362/0 (socket says 172.21.15.80:48362) 2019-11-28T12:02:37.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9b1254700 1 -- 172.21.15.80:0/2403277952 learned_addr learned my addr 172.21.15.80:0/2403277952 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9abfff700 1 -- 172.21.15.80:0/2403277952 >> v1:172.21.15.174:6789/0 conn(0x7fc9ac06c0a0 legacy=0x7fc9ac072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9abfff700 1 -- 172.21.15.80:0/2403277952 >> v1:172.21.15.80:6789/0 conn(0x7fc9ac06ce60 legacy=0x7fc9ac164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9ab7fe700 1 -- 172.21.15.80:0/2403277952 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611407092 0 0) 0x7fc9a4001150 con 0x7fc9ac06ce60 2019-11-28T12:02:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9abfff700 1 -- 172.21.15.80:0/2403277952 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac0706c0 con 0x7fc9ac06c490 2019-11-28T12:02:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9abfff700 1 --2- 172.21.15.80:0/2403277952 >> v2:172.21.15.80:3300/0 conn(0x7fc9ac06c490 0x7fc9ac06c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc99c00b2d0 tx=0x7fc99c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9abfff700 1 --2- 172.21.15.80:0/2403277952 >> v2:172.21.15.80:3300/0 conn(0x7fc9ac06c490 0x7fc9ac06c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc99c00b2d0 tx=0x7fc99c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9abfff700 1 --2- 172.21.15.80:0/2403277952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac06c490 0x7fc9ac06c920 secure :-1 s=READY pgs=3116 cs=0 l=1 rx=0x7fc99c00b2d0 tx=0x7fc99c00bae0).ready entity=mon.0 client_cookie=6fa53ebc54e052c1 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:37.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9abfff700 1 --2- 172.21.15.80:0/2403277952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac06c490 0x7fc9ac06c920 secure :-1 s=THROTTLE_DONE pgs=3116 cs=0 l=1 rx=0x7fc99c00b2d0 tx=0x7fc99c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9ab7fe700 1 -- 172.21.15.80:0/2403277952 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc99c007590 con 0x7fc9ac06c490 2019-11-28T12:02:37.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9abfff700 1 --2- 172.21.15.80:0/2403277952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac06c490 0x7fc9ac06c920 secure :-1 s=THROTTLE_DONE pgs=3116 cs=0 l=1 rx=0x7fc99c00b2d0 tx=0x7fc99c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9abfff700 1 --2- 172.21.15.80:0/2403277952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac06c490 0x7fc9ac06c920 secure :-1 s=THROTTLE_DONE pgs=3116 cs=0 l=1 rx=0x7fc99c00b2d0 tx=0x7fc99c00bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9ab7fe700 1 -- 172.21.15.80:0/2403277952 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c009d30 con 0x7fc9ac06c490 2019-11-28T12:02:37.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9ab7fe700 1 -- 172.21.15.80:0/2403277952 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc99c00a400 con 0x7fc9ac06c490 2019-11-28T12:02:37.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9b24b6700 1 -- 172.21.15.80:0/2403277952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac06c490 msgr2=0x7fc9ac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:37.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.045+0000 7fc9b24b6700 1 --2- 172.21.15.80:0/2403277952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac06c490 0x7fc9ac06c920 secure :-1 s=READY pgs=3116 cs=0 l=1 rx=0x7fc99c00b2d0 tx=0x7fc99c00bae0).stop 2019-11-28T12:02:37.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.046+0000 7fc9b24b6700 1 -- 172.21.15.80:0/2403277952 shutdown_connections 2019-11-28T12:02:37.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.046+0000 7fc9b24b6700 1 --2- 172.21.15.80:0/2403277952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac06c490 0x7fc9ac06c920 unknown :-1 s=CLOSED pgs=3116 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:37.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.046+0000 7fc9b24b6700 1 -- 172.21.15.80:0/2403277952 shutdown_connections 2019-11-28T12:02:37.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.046+0000 7fc9b24b6700 1 -- 172.21.15.80:0/2403277952 wait complete. 2019-11-28T12:02:37.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.046+0000 7fc9b24b6700 1 -- 172.21.15.80:0/2403277952 >> 172.21.15.80:0/2403277952 conn(0x7fc9ac061cf0 msgr2=0x7fc9ac064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:37.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.048+0000 7fc9b24b6700 1 Processor -- start 2019-11-28T12:02:37.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.049+0000 7fc9b24b6700 1 -- start start 2019-11-28T12:02:37.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.049+0000 7fc9b24b6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc9ac13f580 0x7fc9ac115730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:37.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b24b6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9ac122660 0x7fc9ac168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:37.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b24b6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ac13fc50 con 0x7fc9ac115c70 2019-11-28T12:02:37.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b24b6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ac112550 con 0x7fc9ac122660 2019-11-28T12:02:37.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b24b6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ac112820 con 0x7fc9ac13f580 2019-11-28T12:02:37.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9abfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc9ac115c70 0x7fc9ac121e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47684/0 (socket says 172.21.15.80:47684) 2019-11-28T12:02:37.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b1254700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9ac122660 0x7fc9ac168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:37.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9abfff700 1 -- 172.21.15.80:0/3579221932 learned_addr learned my addr 172.21.15.80:0/3579221932 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:37.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b0a53700 1 --2- 172.21.15.80:0/3579221932 >> v2:172.21.15.174:3300/0 conn(0x7fc9ac13f580 0x7fc9ac115730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:37.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9a97fa700 1 -- 172.21.15.80:0/3579221932 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088186367 0 0) 0x7fc99c00b750 con 0x7fc9ac115c70 2019-11-28T12:02:37.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9a97fa700 1 -- 172.21.15.80:0/3579221932 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc990002e80 con 0x7fc9ac115c70 2019-11-28T12:02:37.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b1254700 1 -- 172.21.15.80:0/3579221932 >> v2:172.21.15.174:3300/0 conn(0x7fc9ac13f580 msgr2=0x7fc9ac115730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:37.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b1254700 1 --2- 172.21.15.80:0/3579221932 >> v2:172.21.15.174:3300/0 conn(0x7fc9ac13f580 0x7fc9ac115730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:37.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b1254700 1 -- 172.21.15.80:0/3579221932 >> v1:172.21.15.80:6789/0 conn(0x7fc9ac115c70 legacy=0x7fc9ac121e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:37.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b1254700 1 -- 172.21.15.80:0/3579221932 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac112eb0 con 0x7fc9ac122660 2019-11-28T12:02:37.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b1254700 1 --2- 172.21.15.80:0/3579221932 >> v2:172.21.15.80:3300/0 conn(0x7fc9ac122660 0x7fc9ac168a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9a40103a0 tx=0x7fc9a400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b1254700 1 --2- 172.21.15.80:0/3579221932 >> v2:172.21.15.80:3300/0 conn(0x7fc9ac122660 0x7fc9ac168a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9a40103a0 tx=0x7fc9a400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b1254700 1 --2- 172.21.15.80:0/3579221932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac122660 0x7fc9ac168a20 secure :-1 s=READY pgs=3118 cs=0 l=1 rx=0x7fc9a40103a0 tx=0x7fc9a400b2e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:37.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b1254700 1 --2- 172.21.15.80:0/3579221932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac122660 0x7fc9ac168a20 secure :-1 s=THROTTLE_DONE pgs=3118 cs=0 l=1 rx=0x7fc9a40103a0 tx=0x7fc9a400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9a97fa700 1 -- 172.21.15.80:0/3579221932 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9a4001570 con 0x7fc9ac122660 2019-11-28T12:02:37.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b1254700 1 --2- 172.21.15.80:0/3579221932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac122660 0x7fc9ac168a20 secure :-1 s=THROTTLE_DONE pgs=3118 cs=0 l=1 rx=0x7fc9a40103a0 tx=0x7fc9a400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b1254700 1 --2- 172.21.15.80:0/3579221932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac122660 0x7fc9ac168a20 secure :-1 s=THROTTLE_DONE pgs=3118 cs=0 l=1 rx=0x7fc9a40103a0 tx=0x7fc9a400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9a97fa700 1 -- 172.21.15.80:0/3579221932 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a4000940 con 0x7fc9ac122660 2019-11-28T12:02:37.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b24b6700 1 -- 172.21.15.80:0/3579221932 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ac113230 con 0x7fc9ac122660 2019-11-28T12:02:37.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9a97fa700 1 -- 172.21.15.80:0/3579221932 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9a4001b50 con 0x7fc9ac122660 2019-11-28T12:02:37.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.050+0000 7fc9b24b6700 1 -- 172.21.15.80:0/3579221932 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ac112eb0 con 0x7fc9ac122660 2019-11-28T12:02:37.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.051+0000 7fc9b1254700 1 --2- 172.21.15.80:0/3579221932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac122660 0x7fc9ac168a20 secure :-1 s=THROTTLE_DONE pgs=3118 cs=0 l=1 rx=0x7fc9a40103a0 tx=0x7fc9a400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.051+0000 7fc9a97fa700 1 -- 172.21.15.80:0/3579221932 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc9a4001190 con 0x7fc9ac122660 2019-11-28T12:02:37.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.051+0000 7fc9b1254700 1 --2- 172.21.15.80:0/3579221932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac122660 0x7fc9ac168a20 secure :-1 s=THROTTLE_DONE pgs=3118 cs=0 l=1 rx=0x7fc9a40103a0 tx=0x7fc9a400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.051+0000 7fc9a97fa700 1 --2- 172.21.15.80:0/3579221932 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc990018770 0x7fc99001abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:37.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.051+0000 7fc9a97fa700 1 -- 172.21.15.80:0/3579221932 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(240..240 src has 1..240) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fc9a4031a00 con 0x7fc9ac122660 2019-11-28T12:02:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.051+0000 7fc9b0a53700 1 --2- 172.21.15.80:0/3579221932 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc990018770 0x7fc99001abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.052+0000 7fc9b0a53700 1 --2- 172.21.15.80:0/3579221932 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc990018770 0x7fc99001abe0 crc :-1 s=READY pgs=1290 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:37.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.059+0000 7fc9b24b6700 1 -- 172.21.15.80:0/3579221932 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ac113230 con 0x7fc9ac122660 2019-11-28T12:02:37.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.062+0000 7fc9b1254700 1 --2- 172.21.15.80:0/3579221932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac122660 0x7fc9ac168a20 secure :-1 s=THROTTLE_DONE pgs=3118 cs=0 l=1 rx=0x7fc9a40103a0 tx=0x7fc9a400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.062+0000 7fc9a97fa700 1 -- 172.21.15.80:0/3579221932 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc9a4000f80 con 0x7fc9ac122660 2019-11-28T12:02:37.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.236+0000 7fc9b24b6700 1 -- 172.21.15.80:0/3579221932 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9ac112eb0 con 0x7fc9ac122660 2019-11-28T12:02:37.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.236+0000 7fc9b1254700 1 --2- 172.21.15.80:0/3579221932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac122660 0x7fc9ac168a20 secure :-1 s=THROTTLE_DONE pgs=3118 cs=0 l=1 rx=0x7fc9a40103a0 tx=0x7fc9a400b2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.236+0000 7fc9a97fa700 1 -- 172.21.15.80:0/3579221932 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 203 v203) v1 ==== 95+0+1432 (secure 0 0 0) 0x7fc9a40179a0 con 0x7fc9ac122660 2019-11-28T12:02:37.231 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:37.231 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":203,"default_fscid":19,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":203,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:01:41.241732+0000","modified":"2019-11-28T12:02:36.860405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":239,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[39],"metadata_pool":38,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":19}]} 2019-11-28T12:02:37.232 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 203 2019-11-28T12:02:37.233 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.239+0000 7fc9b24b6700 1 -- 172.21.15.80:0/3579221932 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc990018770 msgr2=0x7fc99001abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:37.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.239+0000 7fc9b24b6700 1 --2- 172.21.15.80:0/3579221932 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc990018770 0x7fc99001abe0 crc :-1 s=READY pgs=1290 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:37.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.239+0000 7fc9b24b6700 1 -- 172.21.15.80:0/3579221932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac122660 msgr2=0x7fc9ac168a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:37.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.239+0000 7fc9b24b6700 1 --2- 172.21.15.80:0/3579221932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac122660 0x7fc9ac168a20 secure :-1 s=READY pgs=3118 cs=0 l=1 rx=0x7fc9a40103a0 tx=0x7fc9a400b2e0).stop 2019-11-28T12:02:37.234 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.239+0000 7fc9b24b6700 1 -- 172.21.15.80:0/3579221932 shutdown_connections 2019-11-28T12:02:37.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.239+0000 7fc9b24b6700 1 --2- 172.21.15.80:0/3579221932 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc990018770 0x7fc99001abe0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:37.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.239+0000 7fc9b24b6700 1 --2- 172.21.15.80:0/3579221932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9ac122660 0x7fc9ac168a20 unknown :-1 s=CLOSED pgs=3118 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:37.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.239+0000 7fc9b24b6700 1 --2- 172.21.15.80:0/3579221932 >> v2:172.21.15.174:3300/0 conn(0x7fc9ac13f580 0x7fc9ac115730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:37.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.239+0000 7fc9b24b6700 1 -- 172.21.15.80:0/3579221932 shutdown_connections 2019-11-28T12:02:37.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.239+0000 7fc9b24b6700 1 -- 172.21.15.80:0/3579221932 wait complete. 2019-11-28T12:02:37.236 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.239+0000 7fc9b24b6700 1 -- 172.21.15.80:0/3579221932 >> 172.21.15.80:0/3579221932 conn(0x7fc9ac1426c0 msgr2=0x7fc9ac110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:37.243 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-11-28T12:02:37.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.373+0000 7fc4c1df0700 1 Processor -- start 2019-11-28T12:02:37.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.373+0000 7fc4c1df0700 1 -- start start 2019-11-28T12:02:37.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4c1df0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc4bc06c0a0 0x7fc4bc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:37.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4c1df0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc0734e0 0x7fc4bc071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:37.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4c1df0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc06db00 con 0x7fc4bc072360 2019-11-28T12:02:37.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4c1df0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4bc06fd60 con 0x7fc4bc06c0a0 2019-11-28T12:02:37.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4c1df0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc070030 con 0x7fc4bc0734e0 2019-11-28T12:02:37.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4bbfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc4bc06c0a0 0x7fc4bc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:37.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4b3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc0734e0 0x7fc4bc071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:37.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4c0b8e700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc4bc072360 0x7fc4bc06c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:35006/0 (socket says 172.21.15.80:35006) 2019-11-28T12:02:37.373 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4c0b8e700 1 -- 172.21.15.80:0/3837041507 learned_addr learned my addr 172.21.15.80:0/3837041507 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:37.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4bb7fe700 1 -- 172.21.15.80:0/3837041507 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236753084 0 0) 0x7fc4b40014d0 con 0x7fc4bc072360 2019-11-28T12:02:37.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4bb7fe700 1 -- 172.21.15.80:0/3837041507 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc49c002e80 con 0x7fc4bc072360 2019-11-28T12:02:37.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4b3fff700 1 -- 172.21.15.80:0/3837041507 >> v2:172.21.15.174:3300/0 conn(0x7fc4bc06c0a0 msgr2=0x7fc4bc072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:37.374 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4b3fff700 1 --2- 172.21.15.80:0/3837041507 >> v2:172.21.15.174:3300/0 conn(0x7fc4bc06c0a0 0x7fc4bc072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:37.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4b3fff700 1 -- 172.21.15.80:0/3837041507 >> v1:172.21.15.174:6789/0 conn(0x7fc4bc072360 legacy=0x7fc4bc06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:37.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4b3fff700 1 -- 172.21.15.80:0/3837041507 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc0706c0 con 0x7fc4bc0734e0 2019-11-28T12:02:37.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4bbfff700 1 --2- 172.21.15.80:0/3837041507 >> v2:172.21.15.174:3300/0 conn(0x7fc4bc06c0a0 0x7fc4bc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:37.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4b3fff700 1 --2- 172.21.15.80:0/3837041507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc0734e0 0x7fc4bc071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc4a400af50 tx=0x7fc4a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4b3fff700 1 --2- 172.21.15.80:0/3837041507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc0734e0 0x7fc4bc071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc4a400af50 tx=0x7fc4a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4b3fff700 1 --2- 172.21.15.80:0/3837041507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc0734e0 0x7fc4bc071e20 secure :-1 s=READY pgs=449 cs=0 l=1 rx=0x7fc4a400af50 tx=0x7fc4a400b760).ready entity=mon.2 client_cookie=9e3f9baecb0ffb74 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4b3fff700 1 --2- 172.21.15.80:0/3837041507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc0734e0 0x7fc4bc071e20 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7fc4a400af50 tx=0x7fc4a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4bb7fe700 1 -- 172.21.15.80:0/3837041507 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4a4007210 con 0x7fc4bc0734e0 2019-11-28T12:02:37.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.374+0000 7fc4b3fff700 1 --2- 172.21.15.80:0/3837041507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc0734e0 0x7fc4bc071e20 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7fc4a400af50 tx=0x7fc4a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.375+0000 7fc4b3fff700 1 --2- 172.21.15.80:0/3837041507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc0734e0 0x7fc4bc071e20 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7fc4a400af50 tx=0x7fc4a400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.375+0000 7fc4bb7fe700 1 -- 172.21.15.80:0/3837041507 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a40099b0 con 0x7fc4bc0734e0 2019-11-28T12:02:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.375+0000 7fc4bb7fe700 1 -- 172.21.15.80:0/3837041507 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4a400a080 con 0x7fc4bc0734e0 2019-11-28T12:02:37.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.375+0000 7fc4c1df0700 1 -- 172.21.15.80:0/3837041507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc0734e0 msgr2=0x7fc4bc071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.375+0000 7fc4c1df0700 1 --2- 172.21.15.80:0/3837041507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc0734e0 0x7fc4bc071e20 secure :-1 s=READY pgs=449 cs=0 l=1 rx=0x7fc4a400af50 tx=0x7fc4a400b760).stop 2019-11-28T12:02:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.375+0000 7fc4c1df0700 1 -- 172.21.15.80:0/3837041507 shutdown_connections 2019-11-28T12:02:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.375+0000 7fc4c1df0700 1 --2- 172.21.15.80:0/3837041507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc0734e0 0x7fc4bc071e20 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.375+0000 7fc4c1df0700 1 --2- 172.21.15.80:0/3837041507 >> v2:172.21.15.174:3300/0 conn(0x7fc4bc06c0a0 0x7fc4bc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:37.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.375+0000 7fc4c1df0700 1 -- 172.21.15.80:0/3837041507 shutdown_connections 2019-11-28T12:02:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.375+0000 7fc4c1df0700 1 -- 172.21.15.80:0/3837041507 wait complete. 2019-11-28T12:02:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.375+0000 7fc4c1df0700 1 -- 172.21.15.80:0/3837041507 >> 172.21.15.80:0/3837041507 conn(0x7fc4bc061cf0 msgr2=0x7fc4bc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.378+0000 7fc4c1df0700 1 Processor -- start 2019-11-28T12:02:37.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.378+0000 7fc4c1df0700 1 -- start start 2019-11-28T12:02:37.385 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4c1df0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc4bc13eb40 0x7fc4bc10afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:37.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4c1df0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc10b500 0x7fc4bc1629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:37.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4c1df0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc13f1e0 con 0x7fc4bc162f30 2019-11-28T12:02:37.386 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4c1df0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4bc1234c0 con 0x7fc4bc13eb40 2019-11-28T12:02:37.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4c1df0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc13e0d0 con 0x7fc4bc10b500 2019-11-28T12:02:37.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4c0b8e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc4bc162f30 0x7fc4bc109e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47700/0 (socket says 172.21.15.80:47700) 2019-11-28T12:02:37.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4c0b8e700 1 -- 172.21.15.80:0/1848537393 learned_addr learned my addr 172.21.15.80:0/1848537393 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:37.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4bbfff700 1 --2- 172.21.15.80:0/1848537393 >> v2:172.21.15.174:3300/0 conn(0x7fc4bc13eb40 0x7fc4bc10afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:37.387 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4b3fff700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc10b500 0x7fc4bc1629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:37.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4b97fa700 1 -- 172.21.15.80:0/1848537393 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107391403 0 0) 0x7fc4b4001480 con 0x7fc4bc162f30 2019-11-28T12:02:37.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4b97fa700 1 -- 172.21.15.80:0/1848537393 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc494002e80 con 0x7fc4bc162f30 2019-11-28T12:02:37.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4bbfff700 1 -- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc10b500 msgr2=0x7fc4bc1629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:37.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4bbfff700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc10b500 0x7fc4bc1629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4bbfff700 1 -- 172.21.15.80:0/1848537393 >> v1:172.21.15.80:6789/0 conn(0x7fc4bc162f30 legacy=0x7fc4bc109e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4bbfff700 1 -- 172.21.15.80:0/1848537393 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc108700 con 0x7fc4bc13eb40 2019-11-28T12:02:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4b3fff700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc10b500 0x7fc4bc1629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:37.389 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4bbfff700 1 --2- 172.21.15.80:0/1848537393 >> v2:172.21.15.174:3300/0 conn(0x7fc4bc13eb40 0x7fc4bc10afc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc4ac0103a0 tx=0x7fc4ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4bbfff700 1 --2- 172.21.15.80:0/1848537393 >> v2:172.21.15.174:3300/0 conn(0x7fc4bc13eb40 0x7fc4bc10afc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc4ac0103a0 tx=0x7fc4ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4bbfff700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4bc13eb40 0x7fc4bc10afc0 secure :-1 s=READY pgs=1888 cs=0 l=1 rx=0x7fc4ac0103a0 tx=0x7fc4ac010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:37.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4bbfff700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4bc13eb40 0x7fc4bc10afc0 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7fc4ac0103a0 tx=0x7fc4ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4b97fa700 1 -- 172.21.15.80:0/1848537393 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4ac000940 con 0x7fc4bc13eb40 2019-11-28T12:02:37.390 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4bbfff700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4bc13eb40 0x7fc4bc10afc0 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7fc4ac0103a0 tx=0x7fc4ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4b97fa700 1 -- 172.21.15.80:0/1848537393 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac00dff0 con 0x7fc4bc13eb40 2019-11-28T12:02:37.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4bbfff700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4bc13eb40 0x7fc4bc10afc0 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7fc4ac0103a0 tx=0x7fc4ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4b97fa700 1 -- 172.21.15.80:0/1848537393 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4ac000940 con 0x7fc4bc13eb40 2019-11-28T12:02:37.391 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4c1df0700 1 -- 172.21.15.80:0/1848537393 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc108a80 con 0x7fc4bc13eb40 2019-11-28T12:02:37.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.379+0000 7fc4c1df0700 1 -- 172.21.15.80:0/1848537393 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc108700 con 0x7fc4bc13eb40 2019-11-28T12:02:37.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.380+0000 7fc4bbfff700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4bc13eb40 0x7fc4bc10afc0 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7fc4ac0103a0 tx=0x7fc4ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.380+0000 7fc4b97fa700 1 -- 172.21.15.80:0/1848537393 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fc4ac00dba0 con 0x7fc4bc13eb40 2019-11-28T12:02:37.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.380+0000 7fc4bbfff700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4bc13eb40 0x7fc4bc10afc0 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7fc4ac0103a0 tx=0x7fc4ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.380+0000 7fc4b97fa700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc494018770 0x7fc49401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:37.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.380+0000 7fc4b97fa700 1 -- 172.21.15.80:0/1848537393 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(240..240 src has 1..240) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fc4ac031a60 con 0x7fc4bc13eb40 2019-11-28T12:02:37.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.380+0000 7fc4b3fff700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc494018770 0x7fc49401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:37.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.381+0000 7fc4b3fff700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc494018770 0x7fc49401abe0 crc :-1 s=READY pgs=1291 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:37.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.388+0000 7fc4c1df0700 1 -- 172.21.15.80:0/1848537393 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4bc108a80 con 0x7fc4bc13eb40 2019-11-28T12:02:37.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.391+0000 7fc4bbfff700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4bc13eb40 0x7fc4bc10afc0 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7fc4ac0103a0 tx=0x7fc4ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.391+0000 7fc4b97fa700 1 -- 172.21.15.80:0/1848537393 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fc4ac000940 con 0x7fc4bc13eb40 2019-11-28T12:02:37.558 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.565+0000 7fc4c1df0700 1 -- 172.21.15.80:0/1848537393 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc4bc108700 con 0x7fc4bc13eb40 2019-11-28T12:02:37.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.868+0000 7fc4bbfff700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4bc13eb40 0x7fc4bc10afc0 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7fc4ac0103a0 tx=0x7fc4ac010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:37.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.868+0000 7fc4b97fa700 1 -- 172.21.15.80:0/1848537393 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v204) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc4ac00db00 con 0x7fc4bc13eb40 2019-11-28T12:02:37.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.881+0000 7fc4c1df0700 1 -- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc494018770 msgr2=0x7fc49401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:37.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.881+0000 7fc4c1df0700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc494018770 0x7fc49401abe0 crc :-1 s=READY pgs=1291 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:37.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.881+0000 7fc4c1df0700 1 -- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4bc13eb40 msgr2=0x7fc4bc10afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:37.875 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.881+0000 7fc4c1df0700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4bc13eb40 0x7fc4bc10afc0 secure :-1 s=READY pgs=1888 cs=0 l=1 rx=0x7fc4ac0103a0 tx=0x7fc4ac010740).stop 2019-11-28T12:02:37.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.882+0000 7fc4c1df0700 1 -- 172.21.15.80:0/1848537393 shutdown_connections 2019-11-28T12:02:37.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.882+0000 7fc4c1df0700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fc494018770 0x7fc49401abe0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:37.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.882+0000 7fc4c1df0700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc4bc10b500 0x7fc4bc1629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:37.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.882+0000 7fc4c1df0700 1 --2- 172.21.15.80:0/1848537393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4bc13eb40 0x7fc4bc10afc0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:37.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.882+0000 7fc4c1df0700 1 -- 172.21.15.80:0/1848537393 shutdown_connections 2019-11-28T12:02:37.876 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.882+0000 7fc4c1df0700 1 -- 172.21.15.80:0/1848537393 wait complete. 2019-11-28T12:02:37.877 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:37.882+0000 7fc4c1df0700 1 -- 172.21.15.80:0/1848537393 >> 172.21.15.80:0/1848537393 conn(0x7fc4bc11bfc0 msgr2=0x7fc4bc141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:37.885 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-11-28T12:02:38.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.016+0000 7f8a07784700 1 Processor -- start 2019-11-28T12:02:38.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.016+0000 7f8a07784700 1 -- start start 2019-11-28T12:02:38.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.017+0000 7f8a07784700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a0015ed10 0x7f8a0015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:38.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.017+0000 7f8a07784700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a00073020 0x7f8a00071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:38.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.017+0000 7f8a07784700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8a000734b0 0x7f8a000723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:38.016 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.017+0000 7f8a07784700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0006fe00 con 0x7f8a0015ed10 2019-11-28T12:02:38.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.017+0000 7f8a07784700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a000700d0 con 0x7f8a000734b0 2019-11-28T12:02:38.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.017+0000 7f8a07784700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0006f3d0 con 0x7f8a00073020 2019-11-28T12:02:38.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.017+0000 7f8a05d21700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a0015ed10 0x7f8a0015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:38.017 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.017+0000 7f8a05d21700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a0015ed10 0x7f8a0015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48388/0 (socket says 172.21.15.80:48388) 2019-11-28T12:02:38.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.017+0000 7f8a05d21700 1 -- 172.21.15.80:0/2603542563 learned_addr learned my addr 172.21.15.80:0/2603542563 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:38.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a06522700 1 --2- 172.21.15.80:0/2603542563 >> v2:172.21.15.174:3300/0 conn(0x7f8a000734b0 0x7f8a000723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:38.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a05520700 1 --2- 172.21.15.80:0/2603542563 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a00073020 0x7f8a00071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:38.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a05d21700 1 -- 172.21.15.80:0/2603542563 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a00073020 msgr2=0x7f8a00071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:38.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2603542563 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a00073020 0x7f8a00071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:38.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a05d21700 1 -- 172.21.15.80:0/2603542563 >> v2:172.21.15.174:3300/0 conn(0x7f8a000734b0 msgr2=0x7f8a000723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:38.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2603542563 >> v2:172.21.15.174:3300/0 conn(0x7f8a000734b0 0x7f8a000723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:38.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a05d21700 1 -- 172.21.15.80:0/2603542563 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a00070760 con 0x7f8a0015ed10 2019-11-28T12:02:38.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2603542563 >> v2:172.21.15.80:3300/0 conn(0x7f8a0015ed10 0x7f8a0015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f89e800fa40 tx=0x7f89e800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:38.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2603542563 >> v2:172.21.15.80:3300/0 conn(0x7f8a0015ed10 0x7f8a0015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f89e800fa40 tx=0x7f89e800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:38.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2603542563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a0015ed10 0x7f8a0015f100 secure :-1 s=READY pgs=3120 cs=0 l=1 rx=0x7f89e800fa40 tx=0x7f89e800f8f0).ready entity=mon.0 client_cookie=5919394ca99e5940 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:38.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2603542563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a0015ed10 0x7f8a0015f100 secure :-1 s=THROTTLE_DONE pgs=3120 cs=0 l=1 rx=0x7f89e800fa40 tx=0x7f89e800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:38.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a04d1f700 1 -- 172.21.15.80:0/2603542563 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e8000ce0 con 0x7f8a0015ed10 2019-11-28T12:02:38.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2603542563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a0015ed10 0x7f8a0015f100 secure :-1 s=THROTTLE_DONE pgs=3120 cs=0 l=1 rx=0x7f89e800fa40 tx=0x7f89e800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:38.021 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2603542563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a0015ed10 0x7f8a0015f100 secure :-1 s=THROTTLE_DONE pgs=3120 cs=0 l=1 rx=0x7f89e800fa40 tx=0x7f89e800f8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:38.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a04d1f700 1 -- 172.21.15.80:0/2603542563 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8001010 con 0x7f8a0015ed10 2019-11-28T12:02:38.029 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a04d1f700 1 -- 172.21.15.80:0/2603542563 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e8001720 con 0x7f8a0015ed10 2019-11-28T12:02:38.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a07784700 1 -- 172.21.15.80:0/2603542563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a0015ed10 msgr2=0x7f8a0015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:38.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.018+0000 7f8a07784700 1 --2- 172.21.15.80:0/2603542563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a0015ed10 0x7f8a0015f100 secure :-1 s=READY pgs=3120 cs=0 l=1 rx=0x7f89e800fa40 tx=0x7f89e800f8f0).stop 2019-11-28T12:02:38.030 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.019+0000 7f8a07784700 1 -- 172.21.15.80:0/2603542563 shutdown_connections 2019-11-28T12:02:38.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.019+0000 7f8a07784700 1 --2- 172.21.15.80:0/2603542563 >> v2:172.21.15.174:3300/0 conn(0x7f8a000734b0 0x7f8a000723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:38.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.019+0000 7f8a07784700 1 --2- 172.21.15.80:0/2603542563 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a00073020 0x7f8a00071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:38.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.019+0000 7f8a07784700 1 --2- 172.21.15.80:0/2603542563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a0015ed10 0x7f8a0015f100 unknown :-1 s=CLOSED pgs=3120 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:38.031 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.019+0000 7f8a07784700 1 -- 172.21.15.80:0/2603542563 shutdown_connections 2019-11-28T12:02:38.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.019+0000 7f8a07784700 1 -- 172.21.15.80:0/2603542563 wait complete. 2019-11-28T12:02:38.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.019+0000 7f8a07784700 1 -- 172.21.15.80:0/2603542563 >> 172.21.15.80:0/2603542563 conn(0x7f8a00061d20 msgr2=0x7f8a000641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:38.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.021+0000 7f8a07784700 1 Processor -- start 2019-11-28T12:02:38.032 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.021+0000 7f8a07784700 1 -- start start 2019-11-28T12:02:38.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.022+0000 7f8a07784700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8a00148320 0x7f8a0010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:38.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.022+0000 7f8a07784700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a0010e3d0 0x7f8a00168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:38.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.022+0000 7f8a07784700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a00148e00 con 0x7f8a0010f290 2019-11-28T12:02:38.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.022+0000 7f8a07784700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0013aa20 con 0x7f8a00148320 2019-11-28T12:02:38.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.022+0000 7f8a07784700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0013acf0 con 0x7f8a0010e3d0 2019-11-28T12:02:38.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.022+0000 7f8a05520700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8a0010f290 0x7f8a0010dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47710/0 (socket says 172.21.15.80:47710) 2019-11-28T12:02:38.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.022+0000 7f8a05520700 1 -- 172.21.15.80:0/2451731207 learned_addr learned my addr 172.21.15.80:0/2451731207 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:38.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.022+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2451731207 >> v2:172.21.15.174:3300/0 conn(0x7f8a00148320 0x7f8a0010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:38.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.022+0000 7f8a06522700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a0010e3d0 0x7f8a00168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:38.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f89fe7fc700 1 -- 172.21.15.80:0/2451731207 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755047690 0 0) 0x7f89f0000f70 con 0x7f8a0010f290 2019-11-28T12:02:38.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f89fe7fc700 1 -- 172.21.15.80:0/2451731207 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89e4002e80 con 0x7f8a0010f290 2019-11-28T12:02:38.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f8a05d21700 1 -- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a0010e3d0 msgr2=0x7f8a00168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:38.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a0010e3d0 0x7f8a00168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:38.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f8a05d21700 1 -- 172.21.15.80:0/2451731207 >> v1:172.21.15.80:6789/0 conn(0x7f8a0010f290 legacy=0x7f8a0010dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:38.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f8a05d21700 1 -- 172.21.15.80:0/2451731207 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0010c490 con 0x7f8a00148320 2019-11-28T12:02:38.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2451731207 >> v2:172.21.15.174:3300/0 conn(0x7f8a00148320 0x7f8a0010ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f89e8054740 tx=0x7f89e8054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:38.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f8a06522700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a0010e3d0 0x7f8a00168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:38.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2451731207 >> v2:172.21.15.174:3300/0 conn(0x7f8a00148320 0x7f8a0010ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f89e8054740 tx=0x7f89e8054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:38.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a00148320 0x7f8a0010ed50 secure :-1 s=READY pgs=1889 cs=0 l=1 rx=0x7f89e8054740 tx=0x7f89e8054ae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:38.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a00148320 0x7f8a0010ed50 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7f89e8054740 tx=0x7f89e8054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:38.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f89fe7fc700 1 -- 172.21.15.80:0/2451731207 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e8008140 con 0x7f8a00148320 2019-11-28T12:02:38.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a00148320 0x7f8a0010ed50 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7f89e8054740 tx=0x7f89e8054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:38.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a00148320 0x7f8a0010ed50 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7f89e8054740 tx=0x7f89e8054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:38.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f89fe7fc700 1 -- 172.21.15.80:0/2451731207 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8008340 con 0x7f8a00148320 2019-11-28T12:02:38.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f8a07784700 1 -- 172.21.15.80:0/2451731207 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0010c810 con 0x7f8a00148320 2019-11-28T12:02:38.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f89fe7fc700 1 -- 172.21.15.80:0/2451731207 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e8005ad0 con 0x7f8a00148320 2019-11-28T12:02:38.046 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.023+0000 7f8a07784700 1 -- 172.21.15.80:0/2451731207 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0010c490 con 0x7f8a00148320 2019-11-28T12:02:38.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.024+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a00148320 0x7f8a0010ed50 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7f89e8054740 tx=0x7f89e8054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:38.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.024+0000 7f89fe7fc700 1 -- 172.21.15.80:0/2451731207 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f89e8008050 con 0x7f8a00148320 2019-11-28T12:02:38.047 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.024+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a00148320 0x7f8a0010ed50 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7f89e8054740 tx=0x7f89e8054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:38.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.024+0000 7f89fe7fc700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89e4018770 0x7f89e401abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:38.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.024+0000 7f89fe7fc700 1 -- 172.21.15.80:0/2451731207 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(240..240 src has 1..240) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f89e8075fe0 con 0x7f8a00148320 2019-11-28T12:02:38.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.024+0000 7f8a05520700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89e4018770 0x7f89e401abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:38.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.024+0000 7f8a05520700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89e4018770 0x7f89e401abe0 crc :-1 s=READY pgs=1292 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:38.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.031+0000 7f8a07784700 1 -- 172.21.15.80:0/2451731207 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0010c810 con 0x7f8a00148320 2019-11-28T12:02:38.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.035+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a00148320 0x7f8a0010ed50 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7f89e8054740 tx=0x7f89e8054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:38.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.035+0000 7f89fe7fc700 1 -- 172.21.15.80:0/2451731207 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f89e8007d60 con 0x7f8a00148320 2019-11-28T12:02:38.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.204+0000 7f8a07784700 1 -- 172.21.15.80:0/2451731207 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8a0010c490 con 0x7f8a00148320 2019-11-28T12:02:38.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.874+0000 7f8a05d21700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a00148320 0x7f8a0010ed50 secure :-1 s=THROTTLE_DONE pgs=1889 cs=0 l=1 rx=0x7f89e8054740 tx=0x7f89e8054ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:38.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.874+0000 7f89fe7fc700 1 -- 172.21.15.80:0/2451731207 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v241) v1 ==== 185+0+0 (secure 0 0 0) 0x7f89e80082b0 con 0x7f8a00148320 2019-11-28T12:02:38.912 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2019-11-28T12:02:38.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.921+0000 7f8a07784700 1 -- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89e4018770 msgr2=0x7f89e401abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:38.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.921+0000 7f8a07784700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89e4018770 0x7f89e401abe0 crc :-1 s=READY pgs=1292 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:38.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.921+0000 7f8a07784700 1 -- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a00148320 msgr2=0x7f8a0010ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:38.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.921+0000 7f8a07784700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a00148320 0x7f8a0010ed50 secure :-1 s=READY pgs=1889 cs=0 l=1 rx=0x7f89e8054740 tx=0x7f89e8054ae0).stop 2019-11-28T12:02:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.922+0000 7f8a07784700 1 -- 172.21.15.80:0/2451731207 shutdown_connections 2019-11-28T12:02:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.922+0000 7f8a07784700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f89e4018770 0x7f89e401abe0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.922+0000 7f8a07784700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a0010e3d0 0x7f8a00168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.922+0000 7f8a07784700 1 --2- 172.21.15.80:0/2451731207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a00148320 0x7f8a0010ed50 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.922+0000 7f8a07784700 1 -- 172.21.15.80:0/2451731207 shutdown_connections 2019-11-28T12:02:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.922+0000 7f8a07784700 1 -- 172.21.15.80:0/2451731207 wait complete. 2019-11-28T12:02:38.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:38.922+0000 7f8a07784700 1 -- 172.21.15.80:0/2451731207 >> 172.21.15.80:0/2451731207 conn(0x7f8a0015e2d0 msgr2=0x7f8a00147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:38.925 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-11-28T12:02:39.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.056+0000 7f2f6d2fe700 1 Processor -- start 2019-11-28T12:02:39.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.056+0000 7f2f6d2fe700 1 -- start start 2019-11-28T12:02:39.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.057+0000 7f2f6d2fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2f681639f0 0x7f2f68165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.057+0000 7f2f6d2fe700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6806db60 con 0x7f2f6815ed10 2019-11-28T12:02:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.057+0000 7f2f6d2fe700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6806e060 con 0x7f2f6815f100 2019-11-28T12:02:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.057+0000 7f2f6d2fe700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6806fe00 con 0x7f2f681639f0 2019-11-28T12:02:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.057+0000 7f2f677fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2f6815ed10 0x7f2f68073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47718/0 (socket says 172.21.15.80:47718) 2019-11-28T12:02:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.057+0000 7f2f677fe700 1 -- 172.21.15.80:0/1523328847 learned_addr learned my addr 172.21.15.80:0/1523328847 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.057+0000 7f2f67fff700 1 --2- 172.21.15.80:0/1523328847 >> v2:172.21.15.174:3300/0 conn(0x7f2f681639f0 0x7f2f68165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:39.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f667fc700 1 -- 172.21.15.80:0/1523328847 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89820091 0 0) 0x7f2f58001150 con 0x7f2f6815ed10 2019-11-28T12:02:39.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f667fc700 1 -- 172.21.15.80:0/1523328847 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f48002e80 con 0x7f2f6815ed10 2019-11-28T12:02:39.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f667fc700 1 -- 172.21.15.80:0/1523328847 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 17725079 0 0) 0x7f2f58001130 con 0x7f2f6815ed10 2019-11-28T12:02:39.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f667fc700 1 -- 172.21.15.80:0/1523328847 >> v2:172.21.15.174:3300/0 conn(0x7f2f681639f0 msgr2=0x7f2f68165df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:39.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f667fc700 1 --2- 172.21.15.80:0/1523328847 >> v2:172.21.15.174:3300/0 conn(0x7f2f681639f0 0x7f2f68165df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:39.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f667fc700 1 -- 172.21.15.80:0/1523328847 >> v1:172.21.15.174:6789/0 conn(0x7f2f6815f100 legacy=0x7f2f6806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:39.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f667fc700 1 -- 172.21.15.80:0/1523328847 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f68070760 con 0x7f2f6815ed10 2019-11-28T12:02:39.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f667fc700 1 -- 172.21.15.80:0/1523328847 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f2f580016c0 con 0x7f2f6815ed10 2019-11-28T12:02:39.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f667fc700 1 -- 172.21.15.80:0/1523328847 >> v1:172.21.15.80:6789/0 conn(0x7f2f6815ed10 legacy=0x7f2f68073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:39.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f667fc700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f48003b20 0x7f2f48005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:39.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f667fc700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f48006700 0x7f2f48008bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:39.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f667fc700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f48009430 0x7f2f4800b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:39.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f667fc700 1 -- 172.21.15.80:0/1523328847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4800c0b0 con 0x7f2f48003b20 2019-11-28T12:02:39.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f677fe700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f48003b20 0x7f2f48005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:39.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f667fc700 1 -- 172.21.15.80:0/1523328847 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480502b0 con 0x7f2f48009430 2019-11-28T12:02:39.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f667fc700 1 -- 172.21.15.80:0/1523328847 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480504e0 con 0x7f2f48006700 2019-11-28T12:02:39.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f67fff700 1 --2- 172.21.15.80:0/1523328847 >> v2:172.21.15.174:3300/0 conn(0x7f2f681639f0 0x7f2f68165df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:39.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f66ffd700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f48006700 0x7f2f48008bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:39.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f67fff700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f48009430 0x7f2f4800b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:39.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f677fe700 1 -- 172.21.15.80:0/1523328847 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f48006700 msgr2=0x7f2f48008bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:39.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f677fe700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f48006700 0x7f2f48008bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f677fe700 1 -- 172.21.15.80:0/1523328847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f48009430 msgr2=0x7f2f4800b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:39.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f677fe700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f48009430 0x7f2f4800b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:39.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f677fe700 1 -- 172.21.15.80:0/1523328847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f48050790 con 0x7f2f48003b20 2019-11-28T12:02:39.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f66ffd700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f48006700 0x7f2f48008bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T12:02:39.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f67fff700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f48009430 0x7f2f4800b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T12:02:39.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f67fff700 1 -- 172.21.15.80:0/1523328847 reap_dead start 2019-11-28T12:02:39.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f677fe700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f48003b20 0x7f2f48005f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2f5800f910 tx=0x7f2f5800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:39.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f677fe700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f48003b20 0x7f2f48005f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2f5800f910 tx=0x7f2f5800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:39.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f677fe700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f48003b20 0x7f2f48005f80 secure :-1 s=READY pgs=3123 cs=0 l=1 rx=0x7f2f5800f910 tx=0x7f2f5800fcb0).ready entity=mon.0 client_cookie=a1c2f6ea86b81267 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:39.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.058+0000 7f2f677fe700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f48003b20 0x7f2f48005f80 secure :-1 s=THROTTLE_DONE pgs=3123 cs=0 l=1 rx=0x7f2f5800f910 tx=0x7f2f5800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:39.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.059+0000 7f2f677fe700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f48003b20 0x7f2f48005f80 secure :-1 s=THROTTLE_DONE pgs=3123 cs=0 l=1 rx=0x7f2f5800f910 tx=0x7f2f5800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:39.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.059+0000 7f2f667fc700 1 -- 172.21.15.80:0/1523328847 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f58001130 con 0x7f2f48003b20 2019-11-28T12:02:39.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.059+0000 7f2f677fe700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f48003b20 0x7f2f48005f80 secure :-1 s=THROTTLE_DONE pgs=3123 cs=0 l=1 rx=0x7f2f5800f910 tx=0x7f2f5800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:39.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.059+0000 7f2f667fc700 1 -- 172.21.15.80:0/1523328847 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f58004430 con 0x7f2f48003b20 2019-11-28T12:02:39.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.059+0000 7f2f667fc700 1 -- 172.21.15.80:0/1523328847 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f58004b80 con 0x7f2f48003b20 2019-11-28T12:02:39.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.059+0000 7f2f6d2fe700 1 -- 172.21.15.80:0/1523328847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f48003b20 msgr2=0x7f2f48005f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:39.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.059+0000 7f2f6d2fe700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f48003b20 0x7f2f48005f80 secure :-1 s=READY pgs=3123 cs=0 l=1 rx=0x7f2f5800f910 tx=0x7f2f5800fcb0).stop 2019-11-28T12:02:39.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.059+0000 7f2f6d2fe700 1 -- 172.21.15.80:0/1523328847 shutdown_connections 2019-11-28T12:02:39.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.059+0000 7f2f6d2fe700 1 --2- 172.21.15.80:0/1523328847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f48003b20 0x7f2f48005f80 unknown :-1 s=CLOSED pgs=3123 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:39.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.059+0000 7f2f6d2fe700 1 -- 172.21.15.80:0/1523328847 shutdown_connections 2019-11-28T12:02:39.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.059+0000 7f2f6d2fe700 1 -- 172.21.15.80:0/1523328847 wait complete. 2019-11-28T12:02:39.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.059+0000 7f2f6d2fe700 1 -- 172.21.15.80:0/1523328847 >> 172.21.15.80:0/1523328847 conn(0x7f2f68061d20 msgr2=0x7f2f680641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:39.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.062+0000 7f2f6d2fe700 1 Processor -- start 2019-11-28T12:02:39.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.062+0000 7f2f6d2fe700 1 -- start start 2019-11-28T12:02:39.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f6d2fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2f68108630 0x7f2f68152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:39.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f6d2fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2f681527a0 0x7f2f6812c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:39.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f6d2fe700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6810a310 con 0x7f2f6812c7e0 2019-11-28T12:02:39.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f6d2fe700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6812ee80 con 0x7f2f681527a0 2019-11-28T12:02:39.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f6d2fe700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f681329f0 con 0x7f2f68108630 2019-11-28T12:02:39.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f66ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2f681527a0 0x7f2f6812c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:39.098 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f66ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2f681527a0 0x7f2f6812c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48416/0 (socket says 172.21.15.80:48416) 2019-11-28T12:02:39.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f66ffd700 1 -- 172.21.15.80:0/1530708183 learned_addr learned my addr 172.21.15.80:0/1530708183 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:39.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f677fe700 1 --2- 172.21.15.80:0/1530708183 >> v2:172.21.15.174:3300/0 conn(0x7f2f68108630 0x7f2f68152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:39.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f66ffd700 1 -- 172.21.15.80:0/1530708183 >> v2:172.21.15.174:3300/0 conn(0x7f2f68108630 msgr2=0x7f2f68152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:39.099 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f66ffd700 1 --2- 172.21.15.80:0/1530708183 >> v2:172.21.15.174:3300/0 conn(0x7f2f68108630 0x7f2f68152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:39.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f66ffd700 1 -- 172.21.15.80:0/1530708183 >> v1:172.21.15.174:6789/0 conn(0x7f2f6812c7e0 legacy=0x7f2f6814b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:39.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f66ffd700 1 -- 172.21.15.80:0/1530708183 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f68133350 con 0x7f2f681527a0 2019-11-28T12:02:39.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f66ffd700 1 --2- 172.21.15.80:0/1530708183 >> v2:172.21.15.80:3300/0 conn(0x7f2f681527a0 0x7f2f6812c2a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2f50010410 tx=0x7f2f50010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:39.100 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f66ffd700 1 --2- 172.21.15.80:0/1530708183 >> v2:172.21.15.80:3300/0 conn(0x7f2f681527a0 0x7f2f6812c2a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2f50010410 tx=0x7f2f50010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:39.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f66ffd700 1 --2- 172.21.15.80:0/1530708183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f681527a0 0x7f2f6812c2a0 secure :-1 s=READY pgs=3124 cs=0 l=1 rx=0x7f2f50010410 tx=0x7f2f50010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:39.101 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f66ffd700 1 --2- 172.21.15.80:0/1530708183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f681527a0 0x7f2f6812c2a0 secure :-1 s=THROTTLE_DONE pgs=3124 cs=0 l=1 rx=0x7f2f50010410 tx=0x7f2f50010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:39.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f66ffd700 1 --2- 172.21.15.80:0/1530708183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f681527a0 0x7f2f6812c2a0 secure :-1 s=THROTTLE_DONE pgs=3124 cs=0 l=1 rx=0x7f2f50010410 tx=0x7f2f50010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:39.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f5ffff700 1 -- 172.21.15.80:0/1530708183 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f50001220 con 0x7f2f681527a0 2019-11-28T12:02:39.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f66ffd700 1 --2- 172.21.15.80:0/1530708183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f681527a0 0x7f2f6812c2a0 secure :-1 s=THROTTLE_DONE pgs=3124 cs=0 l=1 rx=0x7f2f50010410 tx=0x7f2f50010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:39.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f5ffff700 1 -- 172.21.15.80:0/1530708183 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f50000dd0 con 0x7f2f681527a0 2019-11-28T12:02:39.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f5ffff700 1 -- 172.21.15.80:0/1530708183 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f50000b40 con 0x7f2f681527a0 2019-11-28T12:02:39.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f6d2fe700 1 -- 172.21.15.80:0/1530708183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f681336d0 con 0x7f2f681527a0 2019-11-28T12:02:39.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.063+0000 7f2f6d2fe700 1 -- 172.21.15.80:0/1530708183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f68133350 con 0x7f2f681527a0 2019-11-28T12:02:39.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.064+0000 7f2f66ffd700 1 --2- 172.21.15.80:0/1530708183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f681527a0 0x7f2f6812c2a0 secure :-1 s=THROTTLE_DONE pgs=3124 cs=0 l=1 rx=0x7f2f50010410 tx=0x7f2f50010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:39.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.064+0000 7f2f5ffff700 1 -- 172.21.15.80:0/1530708183 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2f50001030 con 0x7f2f681527a0 2019-11-28T12:02:39.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.064+0000 7f2f66ffd700 1 --2- 172.21.15.80:0/1530708183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f681527a0 0x7f2f6812c2a0 secure :-1 s=THROTTLE_DONE pgs=3124 cs=0 l=1 rx=0x7f2f50010410 tx=0x7f2f50010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:39.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.064+0000 7f2f5ffff700 1 --2- 172.21.15.80:0/1530708183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2f40018730 0x7f2f4001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:39.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.064+0000 7f2f5ffff700 1 -- 172.21.15.80:0/1530708183 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(241..241 src has 1..241) v4 ==== 5754+0+0 (secure 0 0 0) 0x7f2f50031a80 con 0x7f2f681527a0 2019-11-28T12:02:39.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.064+0000 7f2f677fe700 1 --2- 172.21.15.80:0/1530708183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2f40018730 0x7f2f4001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:39.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.065+0000 7f2f677fe700 1 --2- 172.21.15.80:0/1530708183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2f40018730 0x7f2f4001abc0 crc :-1 s=READY pgs=1293 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:39.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.072+0000 7f2f6d2fe700 1 -- 172.21.15.80:0/1530708183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f681336d0 con 0x7f2f681527a0 2019-11-28T12:02:39.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.075+0000 7f2f66ffd700 1 --2- 172.21.15.80:0/1530708183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f681527a0 0x7f2f6812c2a0 secure :-1 s=THROTTLE_DONE pgs=3124 cs=0 l=1 rx=0x7f2f50010410 tx=0x7f2f50010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:39.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.075+0000 7f2f5ffff700 1 -- 172.21.15.80:0/1530708183 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2f5002f460 con 0x7f2f681527a0 2019-11-28T12:02:39.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.242+0000 7f2f6d2fe700 1 -- 172.21.15.80:0/1530708183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2f68133350 con 0x7f2f681527a0 2019-11-28T12:02:39.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.874+0000 7f2f66ffd700 1 --2- 172.21.15.80:0/1530708183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f681527a0 0x7f2f6812c2a0 secure :-1 s=THROTTLE_DONE pgs=3124 cs=0 l=1 rx=0x7f2f50010410 tx=0x7f2f50010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:39.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.874+0000 7f2f5ffff700 1 -- 172.21.15.80:0/1530708183 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v242) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2f50001030 con 0x7f2f681527a0 2019-11-28T12:02:39.910 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2019-11-28T12:02:39.910 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.908+0000 7f2f6d2fe700 1 -- 172.21.15.80:0/1530708183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2f40018730 msgr2=0x7f2f4001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:39.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.908+0000 7f2f6d2fe700 1 --2- 172.21.15.80:0/1530708183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2f40018730 0x7f2f4001abc0 crc :-1 s=READY pgs=1293 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:39.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.908+0000 7f2f6d2fe700 1 -- 172.21.15.80:0/1530708183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f681527a0 msgr2=0x7f2f6812c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:39.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.908+0000 7f2f6d2fe700 1 --2- 172.21.15.80:0/1530708183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f681527a0 0x7f2f6812c2a0 secure :-1 s=READY pgs=3124 cs=0 l=1 rx=0x7f2f50010410 tx=0x7f2f50010290).stop 2019-11-28T12:02:39.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.908+0000 7f2f6d2fe700 1 -- 172.21.15.80:0/1530708183 shutdown_connections 2019-11-28T12:02:39.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.908+0000 7f2f6d2fe700 1 --2- 172.21.15.80:0/1530708183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2f40018730 0x7f2f4001abc0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:39.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.908+0000 7f2f6d2fe700 1 --2- 172.21.15.80:0/1530708183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f681527a0 0x7f2f6812c2a0 unknown :-1 s=CLOSED pgs=3124 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:39.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.909+0000 7f2f6d2fe700 1 --2- 172.21.15.80:0/1530708183 >> v2:172.21.15.174:3300/0 conn(0x7f2f68108630 0x7f2f68152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:39.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.909+0000 7f2f6d2fe700 1 -- 172.21.15.80:0/1530708183 shutdown_connections 2019-11-28T12:02:39.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.909+0000 7f2f6d2fe700 1 -- 172.21.15.80:0/1530708183 wait complete. 2019-11-28T12:02:39.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:39.909+0000 7f2f6d2fe700 1 -- 172.21.15.80:0/1530708183 >> 172.21.15.80:0/1530708183 conn(0x7f2f6814dbb0 msgr2=0x7f2f68142720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:39.916 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-11-28T12:02:40.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.056+0000 7f673e551700 1 Processor -- start 2019-11-28T12:02:40.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.056+0000 7f673e551700 1 -- start start 2019-11-28T12:02:40.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.057+0000 7f673e551700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f673806c490 0x7f673806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:40.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.057+0000 7f673e551700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f673806ce60 0x7f6738164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:40.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.057+0000 7f673e551700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673806db00 con 0x7f673806c0a0 2019-11-28T12:02:40.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.057+0000 7f673e551700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673806fd60 con 0x7f673806ce60 2019-11-28T12:02:40.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.057+0000 7f673e551700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6738070030 con 0x7f673806c490 2019-11-28T12:02:40.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.057+0000 7f673d2ef700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f673806ce60 0x7f6738164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:40.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.057+0000 7f673d2ef700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f673806ce60 0x7f6738164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48426/0 (socket says 172.21.15.80:48426) 2019-11-28T12:02:40.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.057+0000 7f673d2ef700 1 -- 172.21.15.80:0/3883547964 learned_addr learned my addr 172.21.15.80:0/3883547964 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:40.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.057+0000 7f6737fff700 1 --2- 172.21.15.80:0/3883547964 >> v2:172.21.15.174:3300/0 conn(0x7f673806c490 0x7f673806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:40.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.057+0000 7f673d2ef700 1 -- 172.21.15.80:0/3883547964 >> v2:172.21.15.174:3300/0 conn(0x7f673806c490 msgr2=0x7f673806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:40.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.057+0000 7f673d2ef700 1 --2- 172.21.15.80:0/3883547964 >> v2:172.21.15.174:3300/0 conn(0x7f673806c490 0x7f673806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:40.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.057+0000 7f673d2ef700 1 -- 172.21.15.80:0/3883547964 >> v1:172.21.15.174:6789/0 conn(0x7f673806c0a0 legacy=0x7f6738072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:40.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.057+0000 7f673d2ef700 1 -- 172.21.15.80:0/3883547964 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67380706c0 con 0x7f673806ce60 2019-11-28T12:02:40.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.057+0000 7f673d2ef700 1 --2- 172.21.15.80:0/3883547964 >> v2:172.21.15.80:3300/0 conn(0x7f673806ce60 0x7f6738164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f673000f6b0 tx=0x7f673000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:40.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.058+0000 7f673d2ef700 1 --2- 172.21.15.80:0/3883547964 >> v2:172.21.15.80:3300/0 conn(0x7f673806ce60 0x7f6738164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f673000f6b0 tx=0x7f673000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:40.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.058+0000 7f673d2ef700 1 --2- 172.21.15.80:0/3883547964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673806ce60 0x7f6738164d70 secure :-1 s=READY pgs=3125 cs=0 l=1 rx=0x7f673000f6b0 tx=0x7f673000fa50).ready entity=mon.0 client_cookie=438e4c6e583fadb0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:40.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.058+0000 7f673d2ef700 1 --2- 172.21.15.80:0/3883547964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673806ce60 0x7f6738164d70 secure :-1 s=THROTTLE_DONE pgs=3125 cs=0 l=1 rx=0x7f673000f6b0 tx=0x7f673000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:40.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.058+0000 7f673d2ef700 1 --2- 172.21.15.80:0/3883547964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673806ce60 0x7f6738164d70 secure :-1 s=THROTTLE_DONE pgs=3125 cs=0 l=1 rx=0x7f673000f6b0 tx=0x7f673000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:40.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.058+0000 7f67377fe700 1 -- 172.21.15.80:0/3883547964 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6730000a70 con 0x7f673806ce60 2019-11-28T12:02:40.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.058+0000 7f673d2ef700 1 --2- 172.21.15.80:0/3883547964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673806ce60 0x7f6738164d70 secure :-1 s=THROTTLE_DONE pgs=3125 cs=0 l=1 rx=0x7f673000f6b0 tx=0x7f673000fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:40.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.058+0000 7f67377fe700 1 -- 172.21.15.80:0/3883547964 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67300010e0 con 0x7f673806ce60 2019-11-28T12:02:40.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.058+0000 7f67377fe700 1 -- 172.21.15.80:0/3883547964 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67300017b0 con 0x7f673806ce60 2019-11-28T12:02:40.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.058+0000 7f673e551700 1 -- 172.21.15.80:0/3883547964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673806ce60 msgr2=0x7f6738164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:40.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.058+0000 7f673e551700 1 --2- 172.21.15.80:0/3883547964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673806ce60 0x7f6738164d70 secure :-1 s=READY pgs=3125 cs=0 l=1 rx=0x7f673000f6b0 tx=0x7f673000fa50).stop 2019-11-28T12:02:40.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.058+0000 7f673e551700 1 -- 172.21.15.80:0/3883547964 shutdown_connections 2019-11-28T12:02:40.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.058+0000 7f673e551700 1 --2- 172.21.15.80:0/3883547964 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f673806ce60 0x7f6738164d70 unknown :-1 s=CLOSED pgs=3125 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:40.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.058+0000 7f673e551700 1 --2- 172.21.15.80:0/3883547964 >> v2:172.21.15.174:3300/0 conn(0x7f673806c490 0x7f673806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:40.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.058+0000 7f673e551700 1 -- 172.21.15.80:0/3883547964 shutdown_connections 2019-11-28T12:02:40.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.058+0000 7f673e551700 1 -- 172.21.15.80:0/3883547964 wait complete. 2019-11-28T12:02:40.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.058+0000 7f673e551700 1 -- 172.21.15.80:0/3883547964 >> 172.21.15.80:0/3883547964 conn(0x7f6738061cf0 msgr2=0x7f6738064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:40.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.061+0000 7f673e551700 1 Processor -- start 2019-11-28T12:02:40.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.061+0000 7f673e551700 1 -- start start 2019-11-28T12:02:40.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.062+0000 7f673e551700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6738109e40 0x7f673810a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:40.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.062+0000 7f673e551700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673813f1e0 con 0x7f673813eb40 2019-11-28T12:02:40.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.062+0000 7f673e551700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6738131a30 con 0x7f673810a810 2019-11-28T12:02:40.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.062+0000 7f673e551700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67381234c0 con 0x7f6738109e40 2019-11-28T12:02:40.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.062+0000 7f673caee700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f673813eb40 0x7f673810afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47744/0 (socket says 172.21.15.80:47744) 2019-11-28T12:02:40.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.062+0000 7f673caee700 1 -- 172.21.15.80:0/3335563358 learned_addr learned my addr 172.21.15.80:0/3335563358 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:40.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.062+0000 7f6737fff700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6738109e40 0x7f673810a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:40.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.062+0000 7f67357fa700 1 -- 172.21.15.80:0/3335563358 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058444597 0 0) 0x7f67280014d0 con 0x7f673813eb40 2019-11-28T12:02:40.063 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.062+0000 7f67357fa700 1 -- 172.21.15.80:0/3335563358 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f671c002e80 con 0x7f673813eb40 2019-11-28T12:02:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.062+0000 7f67357fa700 1 -- 172.21.15.80:0/3335563358 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172938350 0 0) 0x7f6730000940 con 0x7f673810a810 2019-11-28T12:02:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.062+0000 7f67357fa700 1 -- 172.21.15.80:0/3335563358 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f671c0030b0 con 0x7f673810a810 2019-11-28T12:02:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.062+0000 7f6737fff700 1 -- 172.21.15.80:0/3335563358 >> v1:172.21.15.174:6789/0 conn(0x7f673810a810 legacy=0x7f6738105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.062+0000 7f67357fa700 1 -- 172.21.15.80:0/3335563358 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4198476625 0 0) 0x7f6728001640 con 0x7f673813eb40 2019-11-28T12:02:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.062+0000 7f6737fff700 1 -- 172.21.15.80:0/3335563358 >> v1:172.21.15.80:6789/0 conn(0x7f673813eb40 legacy=0x7f673810afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.062+0000 7f6737fff700 1 -- 172.21.15.80:0/3335563358 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6738108700 con 0x7f6738109e40 2019-11-28T12:02:40.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.063+0000 7f6737fff700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6738109e40 0x7f673810a2d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:40.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.063+0000 7f6737fff700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6738109e40 0x7f673810a2d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:40.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.063+0000 7f6737fff700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6738109e40 0x7f673810a2d0 secure :-1 s=READY pgs=450 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:40.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.063+0000 7f6737fff700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6738109e40 0x7f673810a2d0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:40.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.063+0000 7f67357fa700 1 -- 172.21.15.80:0/3335563358 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6720009640 con 0x7f6738109e40 2019-11-28T12:02:40.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.063+0000 7f6737fff700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6738109e40 0x7f673810a2d0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:40.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.063+0000 7f67357fa700 1 -- 172.21.15.80:0/3335563358 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6720009640 con 0x7f6738109e40 2019-11-28T12:02:40.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.063+0000 7f6737fff700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6738109e40 0x7f673810a2d0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:40.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.063+0000 7f673e551700 1 -- 172.21.15.80:0/3335563358 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6738108a80 con 0x7f6738109e40 2019-11-28T12:02:40.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.063+0000 7f67357fa700 1 -- 172.21.15.80:0/3335563358 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6720009e50 con 0x7f6738109e40 2019-11-28T12:02:40.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.063+0000 7f673e551700 1 -- 172.21.15.80:0/3335563358 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6738108700 con 0x7f6738109e40 2019-11-28T12:02:40.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.063+0000 7f6737fff700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6738109e40 0x7f673810a2d0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:40.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.064+0000 7f67357fa700 1 -- 172.21.15.80:0/3335563358 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6720009a70 con 0x7f6738109e40 2019-11-28T12:02:40.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.064+0000 7f6737fff700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6738109e40 0x7f673810a2d0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:40.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.064+0000 7f67357fa700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f671c018720 0x7f671c01abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:40.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.064+0000 7f67357fa700 1 -- 172.21.15.80:0/3335563358 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(242..242 src has 1..242) v4 ==== 5372+0+0 (secure 0 0 0) 0x7f6720031a30 con 0x7f6738109e40 2019-11-28T12:02:40.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.064+0000 7f673caee700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f671c018720 0x7f671c01abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:40.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.064+0000 7f673caee700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f671c018720 0x7f671c01abf0 crc :-1 s=READY pgs=1294 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:40.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.071+0000 7f673e551700 1 -- 172.21.15.80:0/3335563358 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6738108a80 con 0x7f6738109e40 2019-11-28T12:02:40.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.075+0000 7f6737fff700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6738109e40 0x7f673810a2d0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:40.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.075+0000 7f67357fa700 1 -- 172.21.15.80:0/3335563358 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6720009860 con 0x7f6738109e40 2019-11-28T12:02:40.255 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.262+0000 7f673e551700 1 -- 172.21.15.80:0/3335563358 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f6738108700 con 0x7f6738109e40 2019-11-28T12:02:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.890+0000 7f6737fff700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6738109e40 0x7f673810a2d0 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.890+0000 7f67357fa700 1 -- 172.21.15.80:0/3335563358 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v243) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6720009a70 con 0x7f6738109e40 2019-11-28T12:02:40.919 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blacklist entries 2019-11-28T12:02:40.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.929+0000 7f673e551700 1 -- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f671c018720 msgr2=0x7f671c01abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:40.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.929+0000 7f673e551700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f671c018720 0x7f671c01abf0 crc :-1 s=READY pgs=1294 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:40.922 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.929+0000 7f673e551700 1 -- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6738109e40 msgr2=0x7f673810a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.929+0000 7f673e551700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6738109e40 0x7f673810a2d0 secure :-1 s=READY pgs=450 cs=0 l=1 rx=0x7f6720010390 tx=0x7f6720010730).stop 2019-11-28T12:02:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.929+0000 7f673e551700 1 -- 172.21.15.80:0/3335563358 shutdown_connections 2019-11-28T12:02:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.929+0000 7f673e551700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f671c018720 0x7f671c01abf0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.929+0000 7f673e551700 1 --2- 172.21.15.80:0/3335563358 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6738109e40 0x7f673810a2d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.929+0000 7f673e551700 1 -- 172.21.15.80:0/3335563358 shutdown_connections 2019-11-28T12:02:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.929+0000 7f673e551700 1 -- 172.21.15.80:0/3335563358 wait complete. 2019-11-28T12:02:40.924 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:40.929+0000 7f673e551700 1 -- 172.21.15.80:0/3335563358 >> 172.21.15.80:0/3335563358 conn(0x7f673811bfc0 msgr2=0x7f6738141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:40.932 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-11-28T12:02:40.932 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-11-28T12:02:41.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.058+0000 7f3169e5b700 1 Processor -- start 2019-11-28T12:02:41.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.058+0000 7f3169e5b700 1 -- start start 2019-11-28T12:02:41.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.059+0000 7f3169e5b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f316406c0a0 0x7f3164072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:41.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.059+0000 7f3169e5b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31640734e0 0x7f3164071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:41.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.059+0000 7f3169e5b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316406db00 con 0x7f3164072360 2019-11-28T12:02:41.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.059+0000 7f3169e5b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316406fd60 con 0x7f316406c0a0 2019-11-28T12:02:41.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.059+0000 7f3169e5b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3164070030 con 0x7f31640734e0 2019-11-28T12:02:41.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f315bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31640734e0 0x7f3164071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:41.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f3163fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f316406c0a0 0x7f3164072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:41.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f315bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31640734e0 0x7f3164071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:50696/0 (socket says 172.21.15.80:50696) 2019-11-28T12:02:41.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f3163fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f316406c0a0 0x7f3164072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:35090/0 (socket says 172.21.15.80:35090) 2019-11-28T12:02:41.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f315bfff700 1 -- 172.21.15.80:0/2034412006 learned_addr learned my addr 172.21.15.80:0/2034412006 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:41.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f315bfff700 1 -- 172.21.15.80:0/2034412006 >> v2:172.21.15.174:3300/0 conn(0x7f316406c0a0 msgr2=0x7f3164072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:41.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f315bfff700 1 --2- 172.21.15.80:0/2034412006 >> v2:172.21.15.174:3300/0 conn(0x7f316406c0a0 0x7f3164072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:41.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f315bfff700 1 -- 172.21.15.80:0/2034412006 >> v1:172.21.15.174:6789/0 conn(0x7f3164072360 legacy=0x7f316406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f315bfff700 1 -- 172.21.15.80:0/2034412006 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31640706c0 con 0x7f31640734e0 2019-11-28T12:02:41.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f3163fff700 1 --2- 172.21.15.80:0/2034412006 >> v2:172.21.15.174:3300/0 conn(0x7f316406c0a0 0x7f3164072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:41.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f315bfff700 1 --2- 172.21.15.80:0/2034412006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31640734e0 0x7f3164071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f314c00f740 tx=0x7f314c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f315bfff700 1 --2- 172.21.15.80:0/2034412006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31640734e0 0x7f3164071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f314c00f740 tx=0x7f314c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f315bfff700 1 --2- 172.21.15.80:0/2034412006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31640734e0 0x7f3164071e20 secure :-1 s=READY pgs=451 cs=0 l=1 rx=0x7f314c00f740 tx=0x7f314c00fae0).ready entity=mon.2 client_cookie=e35fd573c3f1060 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:41.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f315bfff700 1 --2- 172.21.15.80:0/2034412006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31640734e0 0x7f3164071e20 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f314c00f740 tx=0x7f314c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f315bfff700 1 --2- 172.21.15.80:0/2034412006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31640734e0 0x7f3164071e20 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f314c00f740 tx=0x7f314c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f315bfff700 1 --2- 172.21.15.80:0/2034412006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31640734e0 0x7f3164071e20 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7f314c00f740 tx=0x7f314c00fae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.060+0000 7f31637fe700 1 -- 172.21.15.80:0/2034412006 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f314c000960 con 0x7f31640734e0 2019-11-28T12:02:41.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.061+0000 7f31637fe700 1 -- 172.21.15.80:0/2034412006 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c000c90 con 0x7f31640734e0 2019-11-28T12:02:41.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.061+0000 7f31637fe700 1 -- 172.21.15.80:0/2034412006 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f314c0013a0 con 0x7f31640734e0 2019-11-28T12:02:41.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.061+0000 7f3169e5b700 1 -- 172.21.15.80:0/2034412006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31640734e0 msgr2=0x7f3164071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.061+0000 7f3169e5b700 1 --2- 172.21.15.80:0/2034412006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31640734e0 0x7f3164071e20 secure :-1 s=READY pgs=451 cs=0 l=1 rx=0x7f314c00f740 tx=0x7f314c00fae0).stop 2019-11-28T12:02:41.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.061+0000 7f3169e5b700 1 -- 172.21.15.80:0/2034412006 shutdown_connections 2019-11-28T12:02:41.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.061+0000 7f3169e5b700 1 --2- 172.21.15.80:0/2034412006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31640734e0 0x7f3164071e20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:41.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.061+0000 7f3169e5b700 1 --2- 172.21.15.80:0/2034412006 >> v2:172.21.15.174:3300/0 conn(0x7f316406c0a0 0x7f3164072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:41.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.061+0000 7f3169e5b700 1 -- 172.21.15.80:0/2034412006 shutdown_connections 2019-11-28T12:02:41.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.061+0000 7f3169e5b700 1 -- 172.21.15.80:0/2034412006 wait complete. 2019-11-28T12:02:41.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.061+0000 7f3169e5b700 1 -- 172.21.15.80:0/2034412006 >> 172.21.15.80:0/2034412006 conn(0x7f3164061cf0 msgr2=0x7f3164064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:41.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.064+0000 7f3169e5b700 1 Processor -- start 2019-11-28T12:02:41.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.064+0000 7f3169e5b700 1 -- start start 2019-11-28T12:02:41.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3169e5b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3164164ff0 0x7f31641653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:41.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3169e5b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3164133820 0x7f31641326a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:41.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3169e5b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3164131680 con 0x7f3164133cb0 2019-11-28T12:02:41.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3169e5b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316410dd90 con 0x7f3164164ff0 2019-11-28T12:02:41.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3169e5b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316410e060 con 0x7f3164133820 2019-11-28T12:02:41.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3163fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3164164ff0 0x7f31641653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:41.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3163fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3164164ff0 0x7f31641653e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48442/0 (socket says 172.21.15.80:48442) 2019-11-28T12:02:41.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3163fff700 1 -- 172.21.15.80:0/828473893 learned_addr learned my addr 172.21.15.80:0/828473893 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:41.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f315bfff700 1 --2- 172.21.15.80:0/828473893 >> v2:172.21.15.174:3300/0 conn(0x7f3164133820 0x7f31641326a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:41.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3163fff700 1 -- 172.21.15.80:0/828473893 >> v2:172.21.15.174:3300/0 conn(0x7f3164133820 msgr2=0x7f31641326a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3163fff700 1 --2- 172.21.15.80:0/828473893 >> v2:172.21.15.174:3300/0 conn(0x7f3164133820 0x7f31641326a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:41.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3163fff700 1 -- 172.21.15.80:0/828473893 >> v1:172.21.15.174:6789/0 conn(0x7f3164133cb0 legacy=0x7f3164132be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3163fff700 1 -- 172.21.15.80:0/828473893 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316410e6f0 con 0x7f3164164ff0 2019-11-28T12:02:41.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3163fff700 1 --2- 172.21.15.80:0/828473893 >> v2:172.21.15.80:3300/0 conn(0x7f3164164ff0 0x7f31641653e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3154010410 tx=0x7f3154010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3163fff700 1 --2- 172.21.15.80:0/828473893 >> v2:172.21.15.80:3300/0 conn(0x7f3164164ff0 0x7f31641653e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3154010410 tx=0x7f3154010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3163fff700 1 --2- 172.21.15.80:0/828473893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164164ff0 0x7f31641653e0 secure :-1 s=READY pgs=3127 cs=0 l=1 rx=0x7f3154010410 tx=0x7f3154010290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:41.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3163fff700 1 --2- 172.21.15.80:0/828473893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164164ff0 0x7f31641653e0 secure :-1 s=THROTTLE_DONE pgs=3127 cs=0 l=1 rx=0x7f3154010410 tx=0x7f3154010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f31617fa700 1 -- 172.21.15.80:0/828473893 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3154000960 con 0x7f3164164ff0 2019-11-28T12:02:41.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3163fff700 1 --2- 172.21.15.80:0/828473893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164164ff0 0x7f31641653e0 secure :-1 s=THROTTLE_DONE pgs=3127 cs=0 l=1 rx=0x7f3154010410 tx=0x7f3154010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f31617fa700 1 -- 172.21.15.80:0/828473893 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3154009770 con 0x7f3164164ff0 2019-11-28T12:02:41.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3163fff700 1 --2- 172.21.15.80:0/828473893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164164ff0 0x7f31641653e0 secure :-1 s=THROTTLE_DONE pgs=3127 cs=0 l=1 rx=0x7f3154010410 tx=0x7f3154010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3169e5b700 1 -- 172.21.15.80:0/828473893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316410ea70 con 0x7f3164164ff0 2019-11-28T12:02:41.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f31617fa700 1 -- 172.21.15.80:0/828473893 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3154009960 con 0x7f3164164ff0 2019-11-28T12:02:41.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.065+0000 7f3169e5b700 1 -- 172.21.15.80:0/828473893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316410e6f0 con 0x7f3164164ff0 2019-11-28T12:02:41.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.066+0000 7f3163fff700 1 --2- 172.21.15.80:0/828473893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164164ff0 0x7f31641653e0 secure :-1 s=THROTTLE_DONE pgs=3127 cs=0 l=1 rx=0x7f3154010410 tx=0x7f3154010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.066+0000 7f31617fa700 1 -- 172.21.15.80:0/828473893 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3154009960 con 0x7f3164164ff0 2019-11-28T12:02:41.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.066+0000 7f3163fff700 1 --2- 172.21.15.80:0/828473893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164164ff0 0x7f31641653e0 secure :-1 s=THROTTLE_DONE pgs=3127 cs=0 l=1 rx=0x7f3154010410 tx=0x7f3154010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.066+0000 7f31617fa700 1 --2- 172.21.15.80:0/828473893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3148018730 0x7f314801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:41.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.066+0000 7f31617fa700 1 -- 172.21.15.80:0/828473893 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(243..243 src has 1..243) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f3154031aa0 con 0x7f3164164ff0 2019-11-28T12:02:41.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.066+0000 7f315bfff700 1 --2- 172.21.15.80:0/828473893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3148018730 0x7f314801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:41.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.067+0000 7f315bfff700 1 --2- 172.21.15.80:0/828473893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3148018730 0x7f314801abc0 crc :-1 s=READY pgs=1295 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:41.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.073+0000 7f3169e5b700 1 -- 172.21.15.80:0/828473893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316410ea70 con 0x7f3164164ff0 2019-11-28T12:02:41.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.077+0000 7f3163fff700 1 --2- 172.21.15.80:0/828473893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164164ff0 0x7f31641653e0 secure :-1 s=THROTTLE_DONE pgs=3127 cs=0 l=1 rx=0x7f3154010410 tx=0x7f3154010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.077+0000 7f31617fa700 1 -- 172.21.15.80:0/828473893 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3154017540 con 0x7f3164164ff0 2019-11-28T12:02:41.240 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.247+0000 7f3169e5b700 1 -- 172.21.15.80:0/828473893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f316410e6f0 con 0x7f3164164ff0 2019-11-28T12:02:41.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.248+0000 7f3163fff700 1 --2- 172.21.15.80:0/828473893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164164ff0 0x7f31641653e0 secure :-1 s=THROTTLE_DONE pgs=3127 cs=0 l=1 rx=0x7f3154010410 tx=0x7f3154010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.241 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.248+0000 7f31617fa700 1 -- 172.21.15.80:0/828473893 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v83) v1 ==== 80+0+4797 (secure 0 0 0) 0x7f3154017750 con 0x7f3164164ff0 2019-11-28T12:02:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:41.242 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T12:02:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2019-11-28T12:02:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2019-11-28T12:02:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dtqR6BhAADpLxyNdfAVmyRiYgXtg+2Q==", 2019-11-28T12:02:41.242 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T12:02:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:02:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:02:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:02:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2019-11-28T12:02:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d5CJwDhAAn7orzrZNVJBrZgLQBLegqw==", 2019-11-28T12:02:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T12:02:41.244 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:02:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:02:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:02:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2019-11-28T12:02:41.245 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dz1rqOhAAshrkfHjCzPmMSko4VlxDpg==", 2019-11-28T12:02:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T12:02:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:02:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:02:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:02:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2019-11-28T12:02:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB1rt9dnhaVLhAAEJ540TvFUToSRmmN+F538g==", 2019-11-28T12:02:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:02:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:02:41.247 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:02:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2019-11-28T12:02:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB4rt9dJ8lkDRAAM2s3nLxAzbkU/jZdF1S+Zw==", 2019-11-28T12:02:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.248 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:02:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:02:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:02:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2019-11-28T12:02:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB6rt9dHwsyJxAAsHqbUwUelq/ec7VVJ3UaQw==", 2019-11-28T12:02:41.249 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:02:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:02:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:02:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.250 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2019-11-28T12:02:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQB9rt9dFRpyFhAAvS7bbekA71sqZ/YfTDpkxA==", 2019-11-28T12:02:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:02:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:02:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:02:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2019-11-28T12:02:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBprt9dfoIcABAA+RwHxBGMVsxBtNK5JprHRg==", 2019-11-28T12:02:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:02:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:02:41.252 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:02:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2019-11-28T12:02:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBrrt9dypk2GhAAa/brtK9gZ7Wet3mZ1zUTig==", 2019-11-28T12:02:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:02:41.253 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:02:41.254 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:02:41.254 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.254 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2019-11-28T12:02:41.254 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBtrt9dYo42NBAAuP3hIrOjJFqGF7ziN3Jfhg==", 2019-11-28T12:02:41.254 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.255 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:02:41.255 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:02:41.255 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:02:41.255 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.255 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2019-11-28T12:02:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBwrt9dcsTTERAAIFaceT4AIm4oKeL2cqjtzw==", 2019-11-28T12:02:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:02:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:02:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:02:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2019-11-28T12:02:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d7n/2GBAAd0wCpxwo36BluIiKAiwolA==", 2019-11-28T12:02:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T12:02:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T12:02:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T12:02:41.257 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2019-11-28T12:02:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9dPv0cJxAAHDHH+nNYn335adCATgcvAg==", 2019-11-28T12:02:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T12:02:41.258 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T12:02:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T12:02:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2019-11-28T12:02:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d4SaCLhAA7g/YdWA9CeER5HJtM6JaOQ==", 2019-11-28T12:02:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.259 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T12:02:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T12:02:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T12:02:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2019-11-28T12:02:41.260 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBlrt9d1tjxHxAAcVymy3Ktz1tIDMECwE7zdA==", 2019-11-28T12:02:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2019-11-28T12:02:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow r", 2019-11-28T12:02:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rw pool=cephfs_data" 2019-11-28T12:02:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2019-11-28T12:02:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBjrt9dAuMICRAAF3VQPvQ0MCQlIoujkJlEfQ==", 2019-11-28T12:02:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T12:02:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2019-11-28T12:02:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2019-11-28T12:02:41.262 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:02:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2019-11-28T12:02:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dMLJwLhAAcQ5S5N0vhFGuehZzW11dOA==", 2019-11-28T12:02:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.263 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T12:02:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T12:02:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:02:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2019-11-28T12:02:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:41.264 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2019-11-28T12:02:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQBkrt9dBihFNBAAa/qN1Fh+G4/lTJKX9ODkPg==", 2019-11-28T12:02:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2019-11-28T12:02:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2019-11-28T12:02:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2019-11-28T12:02:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2019-11-28T12:02:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.265 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:41.266 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2019-11-28T12:02:41.266 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T12:02:41.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.250+0000 7f3169e5b700 1 -- 172.21.15.80:0/828473893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3148018730 msgr2=0x7f314801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.267 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.250+0000 7f3169e5b700 1 --2- 172.21.15.80:0/828473893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3148018730 0x7f314801abc0 crc :-1 s=READY pgs=1295 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:41.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.250+0000 7f3169e5b700 1 -- 172.21.15.80:0/828473893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164164ff0 msgr2=0x7f31641653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.250+0000 7f3169e5b700 1 --2- 172.21.15.80:0/828473893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164164ff0 0x7f31641653e0 secure :-1 s=READY pgs=3127 cs=0 l=1 rx=0x7f3154010410 tx=0x7f3154010290).stop 2019-11-28T12:02:41.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.250+0000 7f3169e5b700 1 -- 172.21.15.80:0/828473893 shutdown_connections 2019-11-28T12:02:41.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.250+0000 7f3169e5b700 1 --2- 172.21.15.80:0/828473893 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3148018730 0x7f314801abc0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:41.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.250+0000 7f3169e5b700 1 --2- 172.21.15.80:0/828473893 >> v2:172.21.15.174:3300/0 conn(0x7f3164133820 0x7f31641326a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:41.268 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.250+0000 7f3169e5b700 1 --2- 172.21.15.80:0/828473893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3164164ff0 0x7f31641653e0 unknown :-1 s=CLOSED pgs=3127 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:41.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.250+0000 7f3169e5b700 1 -- 172.21.15.80:0/828473893 shutdown_connections 2019-11-28T12:02:41.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.250+0000 7f3169e5b700 1 -- 172.21.15.80:0/828473893 wait complete. 2019-11-28T12:02:41.269 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.250+0000 7f3169e5b700 1 -- 172.21.15.80:0/828473893 >> 172.21.15.80:0/828473893 conn(0x7f316411bfc0 msgr2=0x7f3164141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:41.270 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T12:02:41.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.395+0000 7f6b1c51b700 1 Processor -- start 2019-11-28T12:02:41.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.395+0000 7f6b1c51b700 1 -- start start 2019-11-28T12:02:41.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.396+0000 7f6b1c51b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b1406c490 0x7f6b1406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.396+0000 7f6b1c51b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6b1406ce60 0x7f6b14164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.396+0000 7f6b1c51b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1406db00 con 0x7f6b1406c0a0 2019-11-28T12:02:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.396+0000 7f6b1c51b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1406fd60 con 0x7f6b1406ce60 2019-11-28T12:02:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.396+0000 7f6b1c51b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b14070030 con 0x7f6b1406c490 2019-11-28T12:02:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.396+0000 7f6b1b2b9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6b1406ce60 0x7f6b14164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.396+0000 7f6b1a2b7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b1406c490 0x7f6b1406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:41.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.396+0000 7f6b1a2b7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b1406c490 0x7f6b1406c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:50714/0 (socket says 172.21.15.80:50714) 2019-11-28T12:02:41.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.396+0000 7f6b1b2b9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6b1406ce60 0x7f6b14164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:35106/0 (socket says 172.21.15.80:35106) 2019-11-28T12:02:41.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.396+0000 7f6b1a2b7700 1 -- 172.21.15.80:0/4212325070 learned_addr learned my addr 172.21.15.80:0/4212325070 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:41.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.396+0000 7f6b1aab8700 1 --1- 172.21.15.80:0/4212325070 >> v1:172.21.15.174:6789/0 conn(0x7f6b1406c0a0 0x7f6b14072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:35078/0 (socket says 172.21.15.80:35078) 2019-11-28T12:02:41.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b1b2b9700 1 -- 172.21.15.80:0/4212325070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b1406c490 msgr2=0x7f6b1406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:41.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/4212325070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b1406c490 0x7f6b1406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:41.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b1b2b9700 1 -- 172.21.15.80:0/4212325070 >> v1:172.21.15.174:6789/0 conn(0x7f6b1406c0a0 legacy=0x7f6b14072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b19ab6700 1 -- 172.21.15.80:0/4212325070 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481768998 0 0) 0x7f6b04001080 con 0x7f6b1406c0a0 2019-11-28T12:02:41.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b1b2b9700 1 -- 172.21.15.80:0/4212325070 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b140706c0 con 0x7f6b1406ce60 2019-11-28T12:02:41.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b1a2b7700 1 --2- 172.21.15.80:0/4212325070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b1406c490 0x7f6b1406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:41.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/4212325070 >> v2:172.21.15.174:3300/0 conn(0x7f6b1406ce60 0x7f6b14164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6b0c00af80 tx=0x7f6b0c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/4212325070 >> v2:172.21.15.174:3300/0 conn(0x7f6b1406ce60 0x7f6b14164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6b0c00af80 tx=0x7f6b0c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/4212325070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1406ce60 0x7f6b14164d70 secure :-1 s=READY pgs=1897 cs=0 l=1 rx=0x7f6b0c00af80 tx=0x7f6b0c00b790).ready entity=mon.1 client_cookie=dda67b09c31922bd server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:41.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/4212325070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1406ce60 0x7f6b14164d70 secure :-1 s=THROTTLE_DONE pgs=1897 cs=0 l=1 rx=0x7f6b0c00af80 tx=0x7f6b0c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b19ab6700 1 -- 172.21.15.80:0/4212325070 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b0c000bc0 con 0x7f6b1406ce60 2019-11-28T12:02:41.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/4212325070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1406ce60 0x7f6b14164d70 secure :-1 s=THROTTLE_DONE pgs=1897 cs=0 l=1 rx=0x7f6b0c00af80 tx=0x7f6b0c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/4212325070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1406ce60 0x7f6b14164d70 secure :-1 s=THROTTLE_DONE pgs=1897 cs=0 l=1 rx=0x7f6b0c00af80 tx=0x7f6b0c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b19ab6700 1 -- 172.21.15.80:0/4212325070 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c0097f0 con 0x7f6b1406ce60 2019-11-28T12:02:41.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b19ab6700 1 -- 172.21.15.80:0/4212325070 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b0c009ec0 con 0x7f6b1406ce60 2019-11-28T12:02:41.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b1c51b700 1 -- 172.21.15.80:0/4212325070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1406ce60 msgr2=0x7f6b14164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.397+0000 7f6b1c51b700 1 --2- 172.21.15.80:0/4212325070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1406ce60 0x7f6b14164d70 secure :-1 s=READY pgs=1897 cs=0 l=1 rx=0x7f6b0c00af80 tx=0x7f6b0c00b790).stop 2019-11-28T12:02:41.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.398+0000 7f6b1c51b700 1 -- 172.21.15.80:0/4212325070 shutdown_connections 2019-11-28T12:02:41.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.398+0000 7f6b1c51b700 1 --2- 172.21.15.80:0/4212325070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1406ce60 0x7f6b14164d70 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:41.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.398+0000 7f6b1c51b700 1 --2- 172.21.15.80:0/4212325070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b1406c490 0x7f6b1406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:41.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.398+0000 7f6b1c51b700 1 -- 172.21.15.80:0/4212325070 shutdown_connections 2019-11-28T12:02:41.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.398+0000 7f6b1c51b700 1 -- 172.21.15.80:0/4212325070 wait complete. 2019-11-28T12:02:41.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.398+0000 7f6b1c51b700 1 -- 172.21.15.80:0/4212325070 >> 172.21.15.80:0/4212325070 conn(0x7f6b14061cf0 msgr2=0x7f6b14064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:41.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.400+0000 7f6b1c51b700 1 Processor -- start 2019-11-28T12:02:41.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.400+0000 7f6b1c51b700 1 -- start start 2019-11-28T12:02:41.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.401+0000 7f6b1c51b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6b1413e7b0 0x7f6b1412abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:41.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.401+0000 7f6b1c51b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b14139e00 con 0x7f6b1413e320 2019-11-28T12:02:41.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.401+0000 7f6b1c51b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1413b4e0 con 0x7f6b1415fdf0 2019-11-28T12:02:41.402 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.401+0000 7f6b1c51b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b14108820 con 0x7f6b1413e7b0 2019-11-28T12:02:41.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.401+0000 7f6b1a2b7700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6b1413e320 0x7f6b1412a3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47774/0 (socket says 172.21.15.80:47774) 2019-11-28T12:02:41.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.401+0000 7f6b1a2b7700 1 -- 172.21.15.80:0/1375038141 learned_addr learned my addr 172.21.15.80:0/1375038141 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:41.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/1375038141 >> v2:172.21.15.174:3300/0 conn(0x7f6b1413e7b0 0x7f6b1412abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:41.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b137fe700 1 -- 172.21.15.80:0/1375038141 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014604118 0 0) 0x7f6afc007d20 con 0x7f6b1413e320 2019-11-28T12:02:41.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b137fe700 1 -- 172.21.15.80:0/1375038141 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6af8002e80 con 0x7f6b1413e320 2019-11-28T12:02:41.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b137fe700 1 -- 172.21.15.80:0/1375038141 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631837199 0 0) 0x7f6b04000e70 con 0x7f6b1415fdf0 2019-11-28T12:02:41.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b137fe700 1 -- 172.21.15.80:0/1375038141 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6af80030b0 con 0x7f6b1415fdf0 2019-11-28T12:02:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b1b2b9700 1 -- 172.21.15.80:0/1375038141 >> v1:172.21.15.174:6789/0 conn(0x7f6b1415fdf0 legacy=0x7f6b1412b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b1b2b9700 1 -- 172.21.15.80:0/1375038141 >> v1:172.21.15.80:6789/0 conn(0x7f6b1413e320 legacy=0x7f6b1412a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b1b2b9700 1 -- 172.21.15.80:0/1375038141 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1410a8c0 con 0x7f6b1413e7b0 2019-11-28T12:02:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/1375038141 >> v2:172.21.15.174:3300/0 conn(0x7f6b1413e7b0 0x7f6b1412abc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b0c0103f0 tx=0x7f6b0c010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/1375038141 >> v2:172.21.15.174:3300/0 conn(0x7f6b1413e7b0 0x7f6b1412abc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b0c0103f0 tx=0x7f6b0c010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1413e7b0 0x7f6b1412abc0 secure :-1 s=READY pgs=1899 cs=0 l=1 rx=0x7f6b0c0103f0 tx=0x7f6b0c010790).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:41.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1413e7b0 0x7f6b1412abc0 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f6b0c0103f0 tx=0x7f6b0c010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b137fe700 1 -- 172.21.15.80:0/1375038141 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b0c009990 con 0x7f6b1413e7b0 2019-11-28T12:02:41.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1413e7b0 0x7f6b1412abc0 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f6b0c0103f0 tx=0x7f6b0c010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b137fe700 1 -- 172.21.15.80:0/1375038141 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c0095b0 con 0x7f6b1413e7b0 2019-11-28T12:02:41.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1413e7b0 0x7f6b1412abc0 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f6b0c0103f0 tx=0x7f6b0c010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b137fe700 1 -- 172.21.15.80:0/1375038141 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b0c0097a0 con 0x7f6b1413e7b0 2019-11-28T12:02:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b1c51b700 1 -- 172.21.15.80:0/1375038141 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1410a8c0 con 0x7f6b1413e7b0 2019-11-28T12:02:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.402+0000 7f6b1c51b700 1 -- 172.21.15.80:0/1375038141 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1410a8c0 con 0x7f6b1413e7b0 2019-11-28T12:02:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.403+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1413e7b0 0x7f6b1412abc0 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f6b0c0103f0 tx=0x7f6b0c010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.403+0000 7f6b137fe700 1 -- 172.21.15.80:0/1375038141 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f6b0c009840 con 0x7f6b1413e7b0 2019-11-28T12:02:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.403+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1413e7b0 0x7f6b1412abc0 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f6b0c0103f0 tx=0x7f6b0c010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.403+0000 7f6b137fe700 1 --2- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6af8018750 0x7f6af801abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:41.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.403+0000 7f6b137fe700 1 -- 172.21.15.80:0/1375038141 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(243..243 src has 1..243) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f6b0c031a90 con 0x7f6b1413e7b0 2019-11-28T12:02:41.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.403+0000 7f6b1aab8700 1 --2- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6af8018750 0x7f6af801abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:41.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.404+0000 7f6b1aab8700 1 --2- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6af8018750 0x7f6af801abe0 crc :-1 s=READY pgs=1296 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:41.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.410+0000 7f6b1c51b700 1 -- 172.21.15.80:0/1375038141 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b14109180 con 0x7f6b1413e7b0 2019-11-28T12:02:41.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.414+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1413e7b0 0x7f6b1412abc0 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f6b0c0103f0 tx=0x7f6b0c010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.414+0000 7f6b137fe700 1 -- 172.21.15.80:0/1375038141 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f6b0c002c30 con 0x7f6b1413e7b0 2019-11-28T12:02:41.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.589+0000 7f6b1c51b700 1 -- 172.21.15.80:0/1375038141 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b14109500 con 0x7f6b1413e7b0 2019-11-28T12:02:41.582 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.590+0000 7f6b1b2b9700 1 --2- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1413e7b0 0x7f6b1412abc0 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f6b0c0103f0 tx=0x7f6b0c010790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.590+0000 7f6b137fe700 1 -- 172.21.15.80:0/1375038141 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v243) v1 ==== 74+0+12010 (secure 0 0 0) 0x7f6b0c0097a0 con 0x7f6b1413e7b0 2019-11-28T12:02:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:41.584 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":243,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T12:02:40.880849+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":39,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":231,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T12:02:41.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.592+0000 7f6b1c51b700 1 -- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6af8018750 msgr2=0x7f6af801abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.592+0000 7f6b1c51b700 1 --2- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6af8018750 0x7f6af801abe0 crc :-1 s=READY pgs=1296 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:41.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.592+0000 7f6b1c51b700 1 -- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1413e7b0 msgr2=0x7f6b1412abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.592+0000 7f6b1c51b700 1 --2- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1413e7b0 0x7f6b1412abc0 secure :-1 s=READY pgs=1899 cs=0 l=1 rx=0x7f6b0c0103f0 tx=0x7f6b0c010790).stop 2019-11-28T12:02:41.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.592+0000 7f6b1c51b700 1 -- 172.21.15.80:0/1375038141 shutdown_connections 2019-11-28T12:02:41.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.592+0000 7f6b1c51b700 1 --2- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b1413e7b0 0x7f6b1412abc0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:41.586 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.592+0000 7f6b1c51b700 1 --2- 172.21.15.80:0/1375038141 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f6af8018750 0x7f6af801abe0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:41.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.592+0000 7f6b1c51b700 1 -- 172.21.15.80:0/1375038141 shutdown_connections 2019-11-28T12:02:41.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.592+0000 7f6b1c51b700 1 -- 172.21.15.80:0/1375038141 wait complete. 2019-11-28T12:02:41.587 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.592+0000 7f6b1c51b700 1 -- 172.21.15.80:0/1375038141 >> 172.21.15.80:0/1375038141 conn(0x7f6b14127dc0 msgr2=0x7f6b14141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:41.596 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T12:02:41.596 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T12:02:41.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.727+0000 7fbc0184b700 1 Processor -- start 2019-11-28T12:02:41.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.728+0000 7fbc0184b700 1 -- start start 2019-11-28T12:02:41.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.728+0000 7fbc0184b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbbfc15ed10 0x7fbbfc15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:41.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.728+0000 7fbc0184b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbbfc073020 0x7fbbfc071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:41.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbc0184b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbfc0734b0 0x7fbbfc0723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:41.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbc0184b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc06fe00 con 0x7fbbfc15ed10 2019-11-28T12:02:41.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbc0184b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc0700d0 con 0x7fbbfc073020 2019-11-28T12:02:41.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbc0184b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc06f3d0 con 0x7fbbfc0734b0 2019-11-28T12:02:41.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbbfc15ed10 0x7fbbfc15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:41.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbbfc15ed10 0x7fbbfc15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48464/0 (socket says 172.21.15.80:48464) 2019-11-28T12:02:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfb7fe700 1 -- 172.21.15.80:0/1192107289 learned_addr learned my addr 172.21.15.80:0/1192107289 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfbfff700 1 --2- 172.21.15.80:0/1192107289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbfc0734b0 0x7fbbfc0723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfaffd700 1 --2- 172.21.15.80:0/1192107289 >> v2:172.21.15.174:3300/0 conn(0x7fbbfc073020 0x7fbbfc071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfb7fe700 1 -- 172.21.15.80:0/1192107289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbfc0734b0 msgr2=0x7fbbfc0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1192107289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbfc0734b0 0x7fbbfc0723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfb7fe700 1 -- 172.21.15.80:0/1192107289 >> v2:172.21.15.174:3300/0 conn(0x7fbbfc073020 msgr2=0x7fbbfc071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1192107289 >> v2:172.21.15.174:3300/0 conn(0x7fbbfc073020 0x7fbbfc071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfb7fe700 1 -- 172.21.15.80:0/1192107289 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc070760 con 0x7fbbfc15ed10 2019-11-28T12:02:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1192107289 >> v2:172.21.15.80:3300/0 conn(0x7fbbfc15ed10 0x7fbbfc15f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbbec00f6c0 tx=0x7fbbec00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1192107289 >> v2:172.21.15.80:3300/0 conn(0x7fbbfc15ed10 0x7fbbfc15f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbbec00f6c0 tx=0x7fbbec00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1192107289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc15ed10 0x7fbbfc15f100 secure :-1 s=READY pgs=3129 cs=0 l=1 rx=0x7fbbec00f6c0 tx=0x7fbbec00f570).ready entity=mon.0 client_cookie=eabbfb7a0c0a23e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1192107289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc15ed10 0x7fbbfc15f100 secure :-1 s=THROTTLE_DONE pgs=3129 cs=0 l=1 rx=0x7fbbec00f6c0 tx=0x7fbbec00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1192107289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc15ed10 0x7fbbfc15f100 secure :-1 s=THROTTLE_DONE pgs=3129 cs=0 l=1 rx=0x7fbbec00f6c0 tx=0x7fbbec00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfa7fc700 1 -- 172.21.15.80:0/1192107289 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbec000960 con 0x7fbbfc15ed10 2019-11-28T12:02:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1192107289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc15ed10 0x7fbbfc15f100 secure :-1 s=THROTTLE_DONE pgs=3129 cs=0 l=1 rx=0x7fbbec00f6c0 tx=0x7fbbec00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfa7fc700 1 -- 172.21.15.80:0/1192107289 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec000c90 con 0x7fbbfc15ed10 2019-11-28T12:02:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbbfa7fc700 1 -- 172.21.15.80:0/1192107289 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbec0013a0 con 0x7fbbfc15ed10 2019-11-28T12:02:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbc0184b700 1 -- 172.21.15.80:0/1192107289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc15ed10 msgr2=0x7fbbfc15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.729+0000 7fbc0184b700 1 --2- 172.21.15.80:0/1192107289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc15ed10 0x7fbbfc15f100 secure :-1 s=READY pgs=3129 cs=0 l=1 rx=0x7fbbec00f6c0 tx=0x7fbbec00f570).stop 2019-11-28T12:02:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.730+0000 7fbc0184b700 1 -- 172.21.15.80:0/1192107289 shutdown_connections 2019-11-28T12:02:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.730+0000 7fbc0184b700 1 --2- 172.21.15.80:0/1192107289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbfc0734b0 0x7fbbfc0723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.730+0000 7fbc0184b700 1 --2- 172.21.15.80:0/1192107289 >> v2:172.21.15.174:3300/0 conn(0x7fbbfc073020 0x7fbbfc071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.730+0000 7fbc0184b700 1 --2- 172.21.15.80:0/1192107289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc15ed10 0x7fbbfc15f100 unknown :-1 s=CLOSED pgs=3129 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.730+0000 7fbc0184b700 1 -- 172.21.15.80:0/1192107289 shutdown_connections 2019-11-28T12:02:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.730+0000 7fbc0184b700 1 -- 172.21.15.80:0/1192107289 wait complete. 2019-11-28T12:02:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.730+0000 7fbc0184b700 1 -- 172.21.15.80:0/1192107289 >> 172.21.15.80:0/1192107289 conn(0x7fbbfc061d20 msgr2=0x7fbbfc0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:41.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.733+0000 7fbc0184b700 1 Processor -- start 2019-11-28T12:02:41.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.733+0000 7fbc0184b700 1 -- start start 2019-11-28T12:02:41.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbc0184b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbbfc148320 0x7fbbfc10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:41.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbc0184b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbfc10e3d0 0x7fbbfc168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:41.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbc0184b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbfc148e00 con 0x7fbbfc10f290 2019-11-28T12:02:41.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbc0184b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc13aa20 con 0x7fbbfc148320 2019-11-28T12:02:41.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbc0184b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc13acf0 con 0x7fbbfc10e3d0 2019-11-28T12:02:41.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbfb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbbfc148320 0x7fbbfc10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:41.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbfaffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbbfc10f290 0x7fbbfc10dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47788/0 (socket says 172.21.15.80:47788) 2019-11-28T12:02:41.735 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbfb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbbfc148320 0x7fbbfc10ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48470/0 (socket says 172.21.15.80:48470) 2019-11-28T12:02:41.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbfaffd700 1 -- 172.21.15.80:0/1852928363 learned_addr learned my addr 172.21.15.80:0/1852928363 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:41.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbfbfff700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbfc10e3d0 0x7fbbfc168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:41.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbfb7fe700 1 -- 172.21.15.80:0/1852928363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbfc10e3d0 msgr2=0x7fbbfc168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbfc10e3d0 0x7fbbfc168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:41.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbfb7fe700 1 -- 172.21.15.80:0/1852928363 >> v1:172.21.15.80:6789/0 conn(0x7fbbfc10f290 legacy=0x7fbbfc10dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.736 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbfb7fe700 1 -- 172.21.15.80:0/1852928363 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc10c490 con 0x7fbbfc148320 2019-11-28T12:02:41.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbf3fff700 1 -- 172.21.15.80:0/1852928363 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383233204 0 0) 0x7fbbe4001430 con 0x7fbbfc10f290 2019-11-28T12:02:41.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1852928363 >> v2:172.21.15.80:3300/0 conn(0x7fbbfc148320 0x7fbbfc10ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbbec0543f0 tx=0x7fbbec008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1852928363 >> v2:172.21.15.80:3300/0 conn(0x7fbbfc148320 0x7fbbfc10ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbbec0543f0 tx=0x7fbbec008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc148320 0x7fbbfc10ed50 secure :-1 s=READY pgs=3131 cs=0 l=1 rx=0x7fbbec0543f0 tx=0x7fbbec008290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:41.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc148320 0x7fbbfc10ed50 secure :-1 s=THROTTLE_DONE pgs=3131 cs=0 l=1 rx=0x7fbbec0543f0 tx=0x7fbbec008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbf3fff700 1 -- 172.21.15.80:0/1852928363 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbec007e10 con 0x7fbbfc148320 2019-11-28T12:02:41.737 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc148320 0x7fbbfc10ed50 secure :-1 s=THROTTLE_DONE pgs=3131 cs=0 l=1 rx=0x7fbbec0543f0 tx=0x7fbbec008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc148320 0x7fbbfc10ed50 secure :-1 s=THROTTLE_DONE pgs=3131 cs=0 l=1 rx=0x7fbbec0543f0 tx=0x7fbbec008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbf3fff700 1 -- 172.21.15.80:0/1852928363 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec005370 con 0x7fbbfc148320 2019-11-28T12:02:41.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbc0184b700 1 -- 172.21.15.80:0/1852928363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbfc10c810 con 0x7fbbfc148320 2019-11-28T12:02:41.738 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbbf3fff700 1 -- 172.21.15.80:0/1852928363 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbec005ac0 con 0x7fbbfc148320 2019-11-28T12:02:41.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.734+0000 7fbc0184b700 1 -- 172.21.15.80:0/1852928363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbfc10c490 con 0x7fbbfc148320 2019-11-28T12:02:41.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.735+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc148320 0x7fbbfc10ed50 secure :-1 s=THROTTLE_DONE pgs=3131 cs=0 l=1 rx=0x7fbbec0543f0 tx=0x7fbbec008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.735+0000 7fbbf3fff700 1 -- 172.21.15.80:0/1852928363 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbbec007cd0 con 0x7fbbfc148320 2019-11-28T12:02:41.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.735+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc148320 0x7fbbfc10ed50 secure :-1 s=THROTTLE_DONE pgs=3131 cs=0 l=1 rx=0x7fbbec0543f0 tx=0x7fbbec008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.740 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.735+0000 7fbbf3fff700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbbd4018730 0x7fbbd401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:41.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.735+0000 7fbbf3fff700 1 -- 172.21.15.80:0/1852928363 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(243..243 src has 1..243) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fbbec075c80 con 0x7fbbfc148320 2019-11-28T12:02:41.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.735+0000 7fbbfaffd700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbbd4018730 0x7fbbd401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:41.741 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.735+0000 7fbbfaffd700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbbd4018730 0x7fbbd401abc0 crc :-1 s=READY pgs=1297 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:41.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.743+0000 7fbc0184b700 1 -- 172.21.15.80:0/1852928363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbfc10c810 con 0x7fbbfc148320 2019-11-28T12:02:41.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.746+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc148320 0x7fbbfc10ed50 secure :-1 s=THROTTLE_DONE pgs=3131 cs=0 l=1 rx=0x7fbbec0543f0 tx=0x7fbbec008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.742 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.746+0000 7fbbf3fff700 1 -- 172.21.15.80:0/1852928363 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbbec007580 con 0x7fbbfc148320 2019-11-28T12:02:41.907 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.914+0000 7fbc0184b700 1 -- 172.21.15.80:0/1852928363 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fbbfc10c490 con 0x7fbbfc148320 2019-11-28T12:02:41.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.914+0000 7fbbfb7fe700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc148320 0x7fbbfc10ed50 secure :-1 s=THROTTLE_DONE pgs=3131 cs=0 l=1 rx=0x7fbbec0543f0 tx=0x7fbbec008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:41.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.914+0000 7fbbf3fff700 1 -- 172.21.15.80:0/1852928363 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v243) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbbec007cd0 con 0x7fbbfc148320 2019-11-28T12:02:41.908 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:02:41.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.917+0000 7fbc0184b700 1 -- 172.21.15.80:0/1852928363 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbbd4018730 msgr2=0x7fbbd401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.917+0000 7fbc0184b700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbbd4018730 0x7fbbd401abc0 crc :-1 s=READY pgs=1297 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:41.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.917+0000 7fbc0184b700 1 -- 172.21.15.80:0/1852928363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc148320 msgr2=0x7fbbfc10ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:41.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.917+0000 7fbc0184b700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc148320 0x7fbbfc10ed50 secure :-1 s=READY pgs=3131 cs=0 l=1 rx=0x7fbbec0543f0 tx=0x7fbbec008290).stop 2019-11-28T12:02:41.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.917+0000 7fbc0184b700 1 -- 172.21.15.80:0/1852928363 shutdown_connections 2019-11-28T12:02:41.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.917+0000 7fbc0184b700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbbd4018730 0x7fbbd401abc0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:41.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.917+0000 7fbc0184b700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbfc10e3d0 0x7fbbfc168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:41.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.917+0000 7fbc0184b700 1 --2- 172.21.15.80:0/1852928363 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbfc148320 0x7fbbfc10ed50 unknown :-1 s=CLOSED pgs=3131 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:41.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.917+0000 7fbc0184b700 1 -- 172.21.15.80:0/1852928363 shutdown_connections 2019-11-28T12:02:41.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.917+0000 7fbc0184b700 1 -- 172.21.15.80:0/1852928363 wait complete. 2019-11-28T12:02:41.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:41.917+0000 7fbc0184b700 1 -- 172.21.15.80:0/1852928363 >> 172.21.15.80:0/1852928363 conn(0x7fbbfc15e2d0 msgr2=0x7fbbfc147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:41.921 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-11-28T12:02:42.048 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.050+0000 7f3af44b0700 1 Processor -- start 2019-11-28T12:02:42.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.050+0000 7f3af44b0700 1 -- start start 2019-11-28T12:02:42.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.051+0000 7f3af44b0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3aec06d120 0x7f3aec165d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:42.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.051+0000 7f3af44b0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aec06d580 con 0x7f3aec06c0a0 2019-11-28T12:02:42.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.051+0000 7f3af44b0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aec06db00 con 0x7f3aec06c490 2019-11-28T12:02:42.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.051+0000 7f3af44b0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec06fd60 con 0x7f3aec06d120 2019-11-28T12:02:42.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.051+0000 7f3af2a4d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3aec06c0a0 0x7f3aec072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47794/0 (socket says 172.21.15.80:47794) 2019-11-28T12:02:42.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.051+0000 7f3af2a4d700 1 -- 172.21.15.80:0/3138599018 learned_addr learned my addr 172.21.15.80:0/3138599018 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:42.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.051+0000 7f3af324e700 1 --2- 172.21.15.80:0/3138599018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3aec06d120 0x7f3aec165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:42.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af1a4b700 1 -- 172.21.15.80:0/3138599018 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277875520 0 0) 0x7f3ad40014d0 con 0x7f3aec06c0a0 2019-11-28T12:02:42.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af1a4b700 1 -- 172.21.15.80:0/3138599018 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ad8002e80 con 0x7f3aec06c0a0 2019-11-28T12:02:42.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af324e700 1 -- 172.21.15.80:0/3138599018 >> v1:172.21.15.174:6789/0 conn(0x7f3aec06c490 legacy=0x7f3aec06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:42.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af1a4b700 1 -- 172.21.15.80:0/3138599018 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517427075 0 0) 0x7f3adc001080 con 0x7f3aec06c490 2019-11-28T12:02:42.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af324e700 1 -- 172.21.15.80:0/3138599018 >> v1:172.21.15.80:6789/0 conn(0x7f3aec06c0a0 legacy=0x7f3aec072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:42.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af324e700 1 -- 172.21.15.80:0/3138599018 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec0706c0 con 0x7f3aec06d120 2019-11-28T12:02:42.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af324e700 1 --2- 172.21.15.80:0/3138599018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3aec06d120 0x7f3aec165d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3ae400af80 tx=0x7f3ae400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af324e700 1 --2- 172.21.15.80:0/3138599018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3aec06d120 0x7f3aec165d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3ae400af80 tx=0x7f3ae400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af324e700 1 --2- 172.21.15.80:0/3138599018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3aec06d120 0x7f3aec165d80 secure :-1 s=READY pgs=452 cs=0 l=1 rx=0x7f3ae400af80 tx=0x7f3ae400b790).ready entity=mon.2 client_cookie=a2a95ab12e5f7e34 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:42.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af324e700 1 --2- 172.21.15.80:0/3138599018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3aec06d120 0x7f3aec165d80 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7f3ae400af80 tx=0x7f3ae400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af1a4b700 1 -- 172.21.15.80:0/3138599018 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ae4007240 con 0x7f3aec06d120 2019-11-28T12:02:42.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af324e700 1 --2- 172.21.15.80:0/3138599018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3aec06d120 0x7f3aec165d80 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7f3ae400af80 tx=0x7f3ae400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af324e700 1 --2- 172.21.15.80:0/3138599018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3aec06d120 0x7f3aec165d80 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7f3ae400af80 tx=0x7f3ae400b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af1a4b700 1 -- 172.21.15.80:0/3138599018 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae4000bb0 con 0x7f3aec06d120 2019-11-28T12:02:42.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af1a4b700 1 -- 172.21.15.80:0/3138599018 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ae4009e60 con 0x7f3aec06d120 2019-11-28T12:02:42.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af44b0700 1 -- 172.21.15.80:0/3138599018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3aec06d120 msgr2=0x7f3aec165d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:42.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.052+0000 7f3af44b0700 1 --2- 172.21.15.80:0/3138599018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3aec06d120 0x7f3aec165d80 secure :-1 s=READY pgs=452 cs=0 l=1 rx=0x7f3ae400af80 tx=0x7f3ae400b790).stop 2019-11-28T12:02:42.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.053+0000 7f3af44b0700 1 -- 172.21.15.80:0/3138599018 shutdown_connections 2019-11-28T12:02:42.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.053+0000 7f3af44b0700 1 --2- 172.21.15.80:0/3138599018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3aec06d120 0x7f3aec165d80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:42.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.053+0000 7f3af44b0700 1 -- 172.21.15.80:0/3138599018 shutdown_connections 2019-11-28T12:02:42.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.053+0000 7f3af44b0700 1 -- 172.21.15.80:0/3138599018 wait complete. 2019-11-28T12:02:42.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.053+0000 7f3af44b0700 1 -- 172.21.15.80:0/3138599018 >> 172.21.15.80:0/3138599018 conn(0x7f3aec061cf0 msgr2=0x7f3aec064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:42.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.055+0000 7f3af44b0700 1 Processor -- start 2019-11-28T12:02:42.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.055+0000 7f3af44b0700 1 -- start start 2019-11-28T12:02:42.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.056+0000 7f3af44b0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3aec12cea0 0x7f3aec111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:42.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.056+0000 7f3af44b0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3aec1230e0 0x7f3aec123570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:42.064 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.056+0000 7f3af44b0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3aec123ab0 0x7f3aec12d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:42.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.056+0000 7f3af44b0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aec120610 con 0x7f3aec123ab0 2019-11-28T12:02:42.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.056+0000 7f3af44b0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aec121040 con 0x7f3aec1230e0 2019-11-28T12:02:42.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.056+0000 7f3af44b0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec12c670 con 0x7f3aec12cea0 2019-11-28T12:02:42.065 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.056+0000 7f3af324e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3aec123ab0 0x7f3aec12d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:42.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.056+0000 7f3af324e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3aec123ab0 0x7f3aec12d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48488/0 (socket says 172.21.15.80:48488) 2019-11-28T12:02:42.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.056+0000 7f3af324e700 1 -- 172.21.15.80:0/1938802055 learned_addr learned my addr 172.21.15.80:0/1938802055 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:42.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.056+0000 7f3af2a4d700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3aec12cea0 0x7f3aec111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:42.066 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.056+0000 7f3af224c700 1 --2- 172.21.15.80:0/1938802055 >> v2:172.21.15.174:3300/0 conn(0x7f3aec1230e0 0x7f3aec123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:42.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.057+0000 7f3af324e700 1 -- 172.21.15.80:0/1938802055 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3aec12cea0 msgr2=0x7f3aec111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:42.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.057+0000 7f3af324e700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3aec12cea0 0x7f3aec111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:42.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.057+0000 7f3af324e700 1 -- 172.21.15.80:0/1938802055 >> v2:172.21.15.174:3300/0 conn(0x7f3aec1230e0 msgr2=0x7f3aec123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:42.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.057+0000 7f3af324e700 1 --2- 172.21.15.80:0/1938802055 >> v2:172.21.15.174:3300/0 conn(0x7f3aec1230e0 0x7f3aec123570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:42.067 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.057+0000 7f3af324e700 1 -- 172.21.15.80:0/1938802055 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec1219a0 con 0x7f3aec123ab0 2019-11-28T12:02:42.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.057+0000 7f3af324e700 1 --2- 172.21.15.80:0/1938802055 >> v2:172.21.15.80:3300/0 conn(0x7f3aec123ab0 0x7f3aec12d290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ae4010440 tx=0x7f3ae4010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.057+0000 7f3af324e700 1 --2- 172.21.15.80:0/1938802055 >> v2:172.21.15.80:3300/0 conn(0x7f3aec123ab0 0x7f3aec12d290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ae4010440 tx=0x7f3ae4010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.057+0000 7f3af324e700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3aec123ab0 0x7f3aec12d290 secure :-1 s=READY pgs=3133 cs=0 l=1 rx=0x7f3ae4010440 tx=0x7f3ae4010340).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:42.068 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.057+0000 7f3af324e700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3aec123ab0 0x7f3aec12d290 secure :-1 s=THROTTLE_DONE pgs=3133 cs=0 l=1 rx=0x7f3ae4010440 tx=0x7f3ae4010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.057+0000 7f3aeb7fe700 1 -- 172.21.15.80:0/1938802055 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ae40097c0 con 0x7f3aec123ab0 2019-11-28T12:02:42.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.057+0000 7f3af324e700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3aec123ab0 0x7f3aec12d290 secure :-1 s=THROTTLE_DONE pgs=3133 cs=0 l=1 rx=0x7f3ae4010440 tx=0x7f3ae4010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.057+0000 7f3af324e700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3aec123ab0 0x7f3aec12d290 secure :-1 s=THROTTLE_DONE pgs=3133 cs=0 l=1 rx=0x7f3ae4010440 tx=0x7f3ae4010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.069 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.057+0000 7f3aeb7fe700 1 -- 172.21.15.80:0/1938802055 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae400af00 con 0x7f3aec123ab0 2019-11-28T12:02:42.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.057+0000 7f3aeb7fe700 1 -- 172.21.15.80:0/1938802055 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ae4009e40 con 0x7f3aec123ab0 2019-11-28T12:02:42.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.057+0000 7f3af44b0700 1 -- 172.21.15.80:0/1938802055 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aec121d20 con 0x7f3aec123ab0 2019-11-28T12:02:42.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.057+0000 7f3af44b0700 1 -- 172.21.15.80:0/1938802055 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aec1122f0 con 0x7f3aec123ab0 2019-11-28T12:02:42.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.058+0000 7f3af324e700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3aec123ab0 0x7f3aec12d290 secure :-1 s=THROTTLE_DONE pgs=3133 cs=0 l=1 rx=0x7f3ae4010440 tx=0x7f3ae4010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.070 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.058+0000 7f3aeb7fe700 1 -- 172.21.15.80:0/1938802055 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3ae4009900 con 0x7f3aec123ab0 2019-11-28T12:02:42.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.058+0000 7f3af324e700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3aec123ab0 0x7f3aec12d290 secure :-1 s=THROTTLE_DONE pgs=3133 cs=0 l=1 rx=0x7f3ae4010440 tx=0x7f3ae4010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.058+0000 7f3aeb7fe700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ad0018730 0x7f3ad001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:42.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.058+0000 7f3aeb7fe700 1 -- 172.21.15.80:0/1938802055 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(243..243 src has 1..243) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f3ae40319f0 con 0x7f3aec123ab0 2019-11-28T12:02:42.071 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.058+0000 7f3af2a4d700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ad0018730 0x7f3ad001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:42.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.058+0000 7f3af2a4d700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ad0018730 0x7f3ad001abc0 crc :-1 s=READY pgs=1298 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:42.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.065+0000 7f3af44b0700 1 -- 172.21.15.80:0/1938802055 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aec1219a0 con 0x7f3aec123ab0 2019-11-28T12:02:42.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.069+0000 7f3af324e700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3aec123ab0 0x7f3aec12d290 secure :-1 s=THROTTLE_DONE pgs=3133 cs=0 l=1 rx=0x7f3ae4010440 tx=0x7f3ae4010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.069+0000 7f3aeb7fe700 1 -- 172.21.15.80:0/1938802055 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3ae40095b0 con 0x7f3aec123ab0 2019-11-28T12:02:42.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.232+0000 7f3af44b0700 1 -- 172.21.15.80:0/1938802055 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3aec121d20 con 0x7f3aec123ab0 2019-11-28T12:02:42.225 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.232+0000 7f3af324e700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3aec123ab0 0x7f3aec12d290 secure :-1 s=THROTTLE_DONE pgs=3133 cs=0 l=1 rx=0x7f3ae4010440 tx=0x7f3ae4010340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.226 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.232+0000 7f3aeb7fe700 1 -- 172.21.15.80:0/1938802055 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v243) v1 ==== 84+0+64 (secure 0 0 0) 0x7f3ae4009860 con 0x7f3aec123ab0 2019-11-28T12:02:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:42.226 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2019-11-28T12:02:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2019-11-28T12:02:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2019-11-28T12:02:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": "rbd" 2019-11-28T12:02:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: } 2019-11-28T12:02:42.227 INFO:teuthology.orchestra.run.smithi080.stdout:] 2019-11-28T12:02:42.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.235+0000 7f3af44b0700 1 -- 172.21.15.80:0/1938802055 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ad0018730 msgr2=0x7f3ad001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:42.228 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.235+0000 7f3af44b0700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ad0018730 0x7f3ad001abc0 crc :-1 s=READY pgs=1298 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:42.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.235+0000 7f3af44b0700 1 -- 172.21.15.80:0/1938802055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3aec123ab0 msgr2=0x7f3aec12d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:42.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.235+0000 7f3af44b0700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3aec123ab0 0x7f3aec12d290 secure :-1 s=READY pgs=3133 cs=0 l=1 rx=0x7f3ae4010440 tx=0x7f3ae4010340).stop 2019-11-28T12:02:42.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.235+0000 7f3af44b0700 1 -- 172.21.15.80:0/1938802055 shutdown_connections 2019-11-28T12:02:42.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.235+0000 7f3af44b0700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3ad0018730 0x7f3ad001abc0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:42.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.235+0000 7f3af44b0700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3aec123ab0 0x7f3aec12d290 unknown :-1 s=CLOSED pgs=3133 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:42.229 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.235+0000 7f3af44b0700 1 --2- 172.21.15.80:0/1938802055 >> v2:172.21.15.174:3300/0 conn(0x7f3aec1230e0 0x7f3aec123570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:42.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.235+0000 7f3af44b0700 1 --2- 172.21.15.80:0/1938802055 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3aec12cea0 0x7f3aec111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:42.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.235+0000 7f3af44b0700 1 -- 172.21.15.80:0/1938802055 shutdown_connections 2019-11-28T12:02:42.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.235+0000 7f3af44b0700 1 -- 172.21.15.80:0/1938802055 wait complete. 2019-11-28T12:02:42.230 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.235+0000 7f3af44b0700 1 -- 172.21.15.80:0/1938802055 >> 172.21.15.80:0/1938802055 conn(0x7f3aec1426c0 msgr2=0x7f3aec110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:42.238 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-11-28T12:02:42.238 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-11-28T12:02:42.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.369+0000 7f76b7f40700 1 Processor -- start 2019-11-28T12:02:42.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.369+0000 7f76b7f40700 1 -- start start 2019-11-28T12:02:42.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b7f40700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f76b015ed10 0x7f76b015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:42.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b7f40700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76b0073020 0x7f76b0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:42.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b7f40700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b006db60 con 0x7f76b00734b0 2019-11-28T12:02:42.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b7f40700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b006fe00 con 0x7f76b015ed10 2019-11-28T12:02:42.367 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b7f40700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b00700d0 con 0x7f76b0073020 2019-11-28T12:02:42.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b64dd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f76b015ed10 0x7f76b015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:42.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b5cdc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76b0073020 0x7f76b0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:42.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b6cde700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f76b00734b0 0x7f76b00723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:35120/0 (socket says 172.21.15.80:35120) 2019-11-28T12:02:42.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b64dd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f76b015ed10 0x7f76b015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:35146/0 (socket says 172.21.15.80:35146) 2019-11-28T12:02:42.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b6cde700 1 -- 172.21.15.80:0/3308509479 learned_addr learned my addr 172.21.15.80:0/3308509479 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:42.368 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b5cdc700 1 -- 172.21.15.80:0/3308509479 >> v2:172.21.15.174:3300/0 conn(0x7f76b015ed10 msgr2=0x7f76b015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:42.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b5cdc700 1 --2- 172.21.15.80:0/3308509479 >> v2:172.21.15.174:3300/0 conn(0x7f76b015ed10 0x7f76b015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:42.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b5cdc700 1 -- 172.21.15.80:0/3308509479 >> v1:172.21.15.174:6789/0 conn(0x7f76b00734b0 legacy=0x7f76b00723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:42.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b5cdc700 1 -- 172.21.15.80:0/3308509479 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b0070760 con 0x7f76b0073020 2019-11-28T12:02:42.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b54db700 1 -- 172.21.15.80:0/3308509479 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274623977 0 0) 0x7f76a4001100 con 0x7f76b00734b0 2019-11-28T12:02:42.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b64dd700 1 --2- 172.21.15.80:0/3308509479 >> v2:172.21.15.174:3300/0 conn(0x7f76b015ed10 0x7f76b015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:42.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.370+0000 7f76b5cdc700 1 --2- 172.21.15.80:0/3308509479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76b0073020 0x7f76b0071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f76a000b2d0 tx=0x7f76a000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.369 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.371+0000 7f76b5cdc700 1 --2- 172.21.15.80:0/3308509479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76b0073020 0x7f76b0071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f76a000b2d0 tx=0x7f76a000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.371+0000 7f76b5cdc700 1 --2- 172.21.15.80:0/3308509479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76b0073020 0x7f76b0071ea0 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7f76a000b2d0 tx=0x7f76a000bae0).ready entity=mon.2 client_cookie=7b0064d841b9b67f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:42.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.371+0000 7f76b5cdc700 1 --2- 172.21.15.80:0/3308509479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76b0073020 0x7f76b0071ea0 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f76a000b2d0 tx=0x7f76a000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.371+0000 7f76b54db700 1 -- 172.21.15.80:0/3308509479 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76a0007590 con 0x7f76b0073020 2019-11-28T12:02:42.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.371+0000 7f76b5cdc700 1 --2- 172.21.15.80:0/3308509479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76b0073020 0x7f76b0071ea0 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f76a000b2d0 tx=0x7f76a000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.371+0000 7f76b5cdc700 1 --2- 172.21.15.80:0/3308509479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76b0073020 0x7f76b0071ea0 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f76a000b2d0 tx=0x7f76a000bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.371+0000 7f76b54db700 1 -- 172.21.15.80:0/3308509479 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a0009d30 con 0x7f76b0073020 2019-11-28T12:02:42.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.371+0000 7f76b54db700 1 -- 172.21.15.80:0/3308509479 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76a000a400 con 0x7f76b0073020 2019-11-28T12:02:42.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.371+0000 7f76b7f40700 1 -- 172.21.15.80:0/3308509479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76b0073020 msgr2=0x7f76b0071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:42.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.371+0000 7f76b7f40700 1 --2- 172.21.15.80:0/3308509479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76b0073020 0x7f76b0071ea0 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7f76a000b2d0 tx=0x7f76a000bae0).stop 2019-11-28T12:02:42.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.372+0000 7f76b7f40700 1 -- 172.21.15.80:0/3308509479 shutdown_connections 2019-11-28T12:02:42.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.372+0000 7f76b7f40700 1 --2- 172.21.15.80:0/3308509479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76b0073020 0x7f76b0071ea0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:42.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.372+0000 7f76b7f40700 1 --2- 172.21.15.80:0/3308509479 >> v2:172.21.15.174:3300/0 conn(0x7f76b015ed10 0x7f76b015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:42.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.372+0000 7f76b7f40700 1 -- 172.21.15.80:0/3308509479 shutdown_connections 2019-11-28T12:02:42.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.372+0000 7f76b7f40700 1 -- 172.21.15.80:0/3308509479 wait complete. 2019-11-28T12:02:42.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.372+0000 7f76b7f40700 1 -- 172.21.15.80:0/3308509479 >> 172.21.15.80:0/3308509479 conn(0x7f76b0061d20 msgr2=0x7f76b00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:42.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.374+0000 7f76b7f40700 1 Processor -- start 2019-11-28T12:02:42.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.374+0000 7f76b7f40700 1 -- start start 2019-11-28T12:02:42.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76b7f40700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f76b01079b0 0x7f76b0107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:42.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76b7f40700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f76b0108380 0x7f76b0168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:42.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76b7f40700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b0148e00 con 0x7f76b0148320 2019-11-28T12:02:42.375 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76b7f40700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b013aa20 con 0x7f76b0108380 2019-11-28T12:02:42.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76b7f40700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b013acf0 con 0x7f76b01079b0 2019-11-28T12:02:42.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76b64dd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f76b0148320 0x7f76b010ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47812/0 (socket says 172.21.15.80:47812) 2019-11-28T12:02:42.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76b64dd700 1 -- 172.21.15.80:0/1188541963 learned_addr learned my addr 172.21.15.80:0/1188541963 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:42.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76b6cde700 1 --2- 172.21.15.80:0/1188541963 >> v2:172.21.15.80:3300/0 conn(0x7f76b0108380 0x7f76b0168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:42.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76b5cdc700 1 --2- 172.21.15.80:0/1188541963 >> v2:172.21.15.174:3300/0 conn(0x7f76b01079b0 0x7f76b0107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:42.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76b6cde700 1 -- 172.21.15.80:0/1188541963 >> v2:172.21.15.174:3300/0 conn(0x7f76b01079b0 msgr2=0x7f76b0107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:42.376 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76b6cde700 1 --2- 172.21.15.80:0/1188541963 >> v2:172.21.15.174:3300/0 conn(0x7f76b01079b0 0x7f76b0107e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:42.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76b6cde700 1 -- 172.21.15.80:0/1188541963 >> v1:172.21.15.80:6789/0 conn(0x7f76b0148320 legacy=0x7f76b010ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:42.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76aeffd700 1 -- 172.21.15.80:0/1188541963 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413038650 0 0) 0x7f76a800dd90 con 0x7f76b0148320 2019-11-28T12:02:42.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76b6cde700 1 -- 172.21.15.80:0/1188541963 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b010c490 con 0x7f76b0108380 2019-11-28T12:02:42.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76b5cdc700 1 --2- 172.21.15.80:0/1188541963 >> v2:172.21.15.174:3300/0 conn(0x7f76b01079b0 0x7f76b0107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:42.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76b6cde700 1 --2- 172.21.15.80:0/1188541963 >> v2:172.21.15.80:3300/0 conn(0x7f76b0108380 0x7f76b0168d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f76a40103b0 tx=0x7f76a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.375+0000 7f76b6cde700 1 --2- 172.21.15.80:0/1188541963 >> v2:172.21.15.80:3300/0 conn(0x7f76b0108380 0x7f76b0168d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f76a40103b0 tx=0x7f76a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.377 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.376+0000 7f76b6cde700 1 --2- 172.21.15.80:0/1188541963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76b0108380 0x7f76b0168d80 secure :-1 s=READY pgs=3135 cs=0 l=1 rx=0x7f76a40103b0 tx=0x7f76a4010750).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:42.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.376+0000 7f76b6cde700 1 --2- 172.21.15.80:0/1188541963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76b0108380 0x7f76b0168d80 secure :-1 s=THROTTLE_DONE pgs=3135 cs=0 l=1 rx=0x7f76a40103b0 tx=0x7f76a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.376+0000 7f76aeffd700 1 -- 172.21.15.80:0/1188541963 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76a4000940 con 0x7f76b0108380 2019-11-28T12:02:42.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.376+0000 7f76b6cde700 1 --2- 172.21.15.80:0/1188541963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76b0108380 0x7f76b0168d80 secure :-1 s=THROTTLE_DONE pgs=3135 cs=0 l=1 rx=0x7f76a40103b0 tx=0x7f76a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.376+0000 7f76b6cde700 1 --2- 172.21.15.80:0/1188541963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76b0108380 0x7f76b0168d80 secure :-1 s=THROTTLE_DONE pgs=3135 cs=0 l=1 rx=0x7f76a40103b0 tx=0x7f76a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.376+0000 7f76aeffd700 1 -- 172.21.15.80:0/1188541963 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a40041c0 con 0x7f76b0108380 2019-11-28T12:02:42.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.376+0000 7f76b7f40700 1 -- 172.21.15.80:0/1188541963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b010c810 con 0x7f76b0108380 2019-11-28T12:02:42.378 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.376+0000 7f76aeffd700 1 -- 172.21.15.80:0/1188541963 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76a4000ef0 con 0x7f76b0108380 2019-11-28T12:02:42.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.376+0000 7f76b7f40700 1 -- 172.21.15.80:0/1188541963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b0108820 con 0x7f76b0108380 2019-11-28T12:02:42.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.377+0000 7f76b6cde700 1 --2- 172.21.15.80:0/1188541963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76b0108380 0x7f76b0168d80 secure :-1 s=THROTTLE_DONE pgs=3135 cs=0 l=1 rx=0x7f76a40103b0 tx=0x7f76a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.377+0000 7f76b6cde700 1 --2- 172.21.15.80:0/1188541963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76b0108380 0x7f76b0168d80 secure :-1 s=THROTTLE_DONE pgs=3135 cs=0 l=1 rx=0x7f76a40103b0 tx=0x7f76a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.377+0000 7f76aeffd700 1 -- 172.21.15.80:0/1188541963 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f76a40041c0 con 0x7f76b0108380 2019-11-28T12:02:42.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.377+0000 7f76aeffd700 1 --2- 172.21.15.80:0/1188541963 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7690018730 0x7f769001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:42.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.377+0000 7f76aeffd700 1 -- 172.21.15.80:0/1188541963 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(243..243 src has 1..243) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f76a4031a10 con 0x7f76b0108380 2019-11-28T12:02:42.379 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.377+0000 7f76b64dd700 1 --2- 172.21.15.80:0/1188541963 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7690018730 0x7f769001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:42.380 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.377+0000 7f76b64dd700 1 --2- 172.21.15.80:0/1188541963 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7690018730 0x7f769001abc0 crc :-1 s=READY pgs=1299 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:42.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.384+0000 7f76b7f40700 1 -- 172.21.15.80:0/1188541963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b010c490 con 0x7f76b0108380 2019-11-28T12:02:42.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.387+0000 7f76b6cde700 1 --2- 172.21.15.80:0/1188541963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76b0108380 0x7f76b0168d80 secure :-1 s=THROTTLE_DONE pgs=3135 cs=0 l=1 rx=0x7f76a40103b0 tx=0x7f76a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.388 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.387+0000 7f76aeffd700 1 -- 172.21.15.80:0/1188541963 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f76a4001260 con 0x7f76b0108380 2019-11-28T12:02:42.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.554+0000 7f76b7f40700 1 -- 172.21.15.80:0/1188541963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f76b010c810 con 0x7f76b0108380 2019-11-28T12:02:42.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.895+0000 7f76b6cde700 1 --2- 172.21.15.80:0/1188541963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76b0108380 0x7f76b0168d80 secure :-1 s=THROTTLE_DONE pgs=3135 cs=0 l=1 rx=0x7f76a40103b0 tx=0x7f76a4010750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:42.888 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.895+0000 7f76aeffd700 1 -- 172.21.15.80:0/1188541963 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v244) v1 ==== 133+0+0 (secure 0 0 0) 0x7f76a40041c0 con 0x7f76b0108380 2019-11-28T12:02:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2019-11-28T12:02:42.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.920+0000 7f76b7f40700 1 -- 172.21.15.80:0/1188541963 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7690018730 msgr2=0x7f769001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:42.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.920+0000 7f76b7f40700 1 --2- 172.21.15.80:0/1188541963 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7690018730 0x7f769001abc0 crc :-1 s=READY pgs=1299 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:42.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.920+0000 7f76b7f40700 1 -- 172.21.15.80:0/1188541963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76b0108380 msgr2=0x7f76b0168d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:42.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.920+0000 7f76b7f40700 1 --2- 172.21.15.80:0/1188541963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76b0108380 0x7f76b0168d80 secure :-1 s=READY pgs=3135 cs=0 l=1 rx=0x7f76a40103b0 tx=0x7f76a4010750).stop 2019-11-28T12:02:42.914 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.921+0000 7f76b7f40700 1 -- 172.21.15.80:0/1188541963 shutdown_connections 2019-11-28T12:02:42.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.921+0000 7f76b7f40700 1 --2- 172.21.15.80:0/1188541963 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7690018730 0x7f769001abc0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:42.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.921+0000 7f76b7f40700 1 --2- 172.21.15.80:0/1188541963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f76b0108380 0x7f76b0168d80 unknown :-1 s=CLOSED pgs=3135 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:42.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.921+0000 7f76b7f40700 1 --2- 172.21.15.80:0/1188541963 >> v2:172.21.15.174:3300/0 conn(0x7f76b01079b0 0x7f76b0107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:42.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.921+0000 7f76b7f40700 1 -- 172.21.15.80:0/1188541963 shutdown_connections 2019-11-28T12:02:42.915 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.921+0000 7f76b7f40700 1 -- 172.21.15.80:0/1188541963 wait complete. 2019-11-28T12:02:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:42.921+0000 7f76b7f40700 1 -- 172.21.15.80:0/1188541963 >> 172.21.15.80:0/1188541963 conn(0x7f76b015e2d0 msgr2=0x7f76b0147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:42.924 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-11-28T12:02:43.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.055+0000 7f139ce8f700 1 Processor -- start 2019-11-28T12:02:43.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.055+0000 7f139ce8f700 1 -- start start 2019-11-28T12:02:43.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.056+0000 7f139ce8f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f139815ed10 0x7f139815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:43.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.056+0000 7f139ce8f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1398073020 0x7f1398071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:43.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.056+0000 7f139ce8f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139806db60 con 0x7f13980734b0 2019-11-28T12:02:43.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.056+0000 7f139ce8f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139806fe00 con 0x7f1398073020 2019-11-28T12:02:43.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.056+0000 7f139ce8f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13980700d0 con 0x7f139815ed10 2019-11-28T12:02:43.056 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.056+0000 7f139659c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1398073020 0x7f1398071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:43.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.056+0000 7f139659c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1398073020 0x7f1398071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48508/0 (socket says 172.21.15.80:48508) 2019-11-28T12:02:43.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f139659c700 1 -- 172.21.15.80:0/2692375059 learned_addr learned my addr 172.21.15.80:0/2692375059 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:43.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f1396d9d700 1 --2- 172.21.15.80:0/2692375059 >> v2:172.21.15.174:3300/0 conn(0x7f139815ed10 0x7f139815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:43.057 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f139659c700 1 -- 172.21.15.80:0/2692375059 >> v2:172.21.15.174:3300/0 conn(0x7f139815ed10 msgr2=0x7f139815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:43.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f139659c700 1 --2- 172.21.15.80:0/2692375059 >> v2:172.21.15.174:3300/0 conn(0x7f139815ed10 0x7f139815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:43.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f139659c700 1 -- 172.21.15.80:0/2692375059 >> v1:172.21.15.174:6789/0 conn(0x7f13980734b0 legacy=0x7f13980723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:43.058 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f139659c700 1 -- 172.21.15.80:0/2692375059 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1398070760 con 0x7f1398073020 2019-11-28T12:02:43.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f139659c700 1 --2- 172.21.15.80:0/2692375059 >> v2:172.21.15.80:3300/0 conn(0x7f1398073020 0x7f1398071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f138800f6c0 tx=0x7f138800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:43.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f139659c700 1 --2- 172.21.15.80:0/2692375059 >> v2:172.21.15.80:3300/0 conn(0x7f1398073020 0x7f1398071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f138800f6c0 tx=0x7f138800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:43.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f139659c700 1 --2- 172.21.15.80:0/2692375059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1398073020 0x7f1398071ea0 secure :-1 s=READY pgs=3136 cs=0 l=1 rx=0x7f138800f6c0 tx=0x7f138800fa60).ready entity=mon.0 client_cookie=5cf5415bdf585e8b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:43.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f139659c700 1 --2- 172.21.15.80:0/2692375059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1398073020 0x7f1398071ea0 secure :-1 s=THROTTLE_DONE pgs=3136 cs=0 l=1 rx=0x7f138800f6c0 tx=0x7f138800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:43.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f139659c700 1 --2- 172.21.15.80:0/2692375059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1398073020 0x7f1398071ea0 secure :-1 s=THROTTLE_DONE pgs=3136 cs=0 l=1 rx=0x7f138800f6c0 tx=0x7f138800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:43.059 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f1395d9b700 1 -- 172.21.15.80:0/2692375059 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1388000960 con 0x7f1398073020 2019-11-28T12:02:43.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f139659c700 1 --2- 172.21.15.80:0/2692375059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1398073020 0x7f1398071ea0 secure :-1 s=THROTTLE_DONE pgs=3136 cs=0 l=1 rx=0x7f138800f6c0 tx=0x7f138800fa60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:43.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f1395d9b700 1 -- 172.21.15.80:0/2692375059 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1388000c90 con 0x7f1398073020 2019-11-28T12:02:43.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f1395d9b700 1 -- 172.21.15.80:0/2692375059 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13880013a0 con 0x7f1398073020 2019-11-28T12:02:43.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f139ce8f700 1 -- 172.21.15.80:0/2692375059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1398073020 msgr2=0x7f1398071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:43.060 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.057+0000 7f139ce8f700 1 --2- 172.21.15.80:0/2692375059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1398073020 0x7f1398071ea0 secure :-1 s=READY pgs=3136 cs=0 l=1 rx=0x7f138800f6c0 tx=0x7f138800fa60).stop 2019-11-28T12:02:43.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.058+0000 7f139ce8f700 1 -- 172.21.15.80:0/2692375059 shutdown_connections 2019-11-28T12:02:43.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.058+0000 7f139ce8f700 1 --2- 172.21.15.80:0/2692375059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1398073020 0x7f1398071ea0 unknown :-1 s=CLOSED pgs=3136 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:43.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.058+0000 7f139ce8f700 1 --2- 172.21.15.80:0/2692375059 >> v2:172.21.15.174:3300/0 conn(0x7f139815ed10 0x7f139815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:43.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.058+0000 7f139ce8f700 1 -- 172.21.15.80:0/2692375059 shutdown_connections 2019-11-28T12:02:43.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.058+0000 7f139ce8f700 1 -- 172.21.15.80:0/2692375059 wait complete. 2019-11-28T12:02:43.061 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.058+0000 7f139ce8f700 1 -- 172.21.15.80:0/2692375059 >> 172.21.15.80:0/2692375059 conn(0x7f1398061d20 msgr2=0x7f13980641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:43.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.060+0000 7f139ce8f700 1 Processor -- start 2019-11-28T12:02:43.062 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.060+0000 7f139ce8f700 1 -- start start 2019-11-28T12:02:43.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.061+0000 7f139ce8f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f13981079b0 0x7f1398107e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:43.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.061+0000 7f139ce8f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1398148e00 con 0x7f1398148320 2019-11-28T12:02:43.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.061+0000 7f139ce8f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1398108b10 con 0x7f1398108380 2019-11-28T12:02:43.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.061+0000 7f139ce8f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139813aa20 con 0x7f13981079b0 2019-11-28T12:02:43.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.061+0000 7f1396d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1398148320 0x7f139810ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47826/0 (socket says 172.21.15.80:47826) 2019-11-28T12:02:43.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.061+0000 7f1396d9d700 1 -- 172.21.15.80:0/841673278 learned_addr learned my addr 172.21.15.80:0/841673278 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:43.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.061+0000 7f139659c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f13981079b0 0x7f1398107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:43.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.062+0000 7f139659c700 1 -- 172.21.15.80:0/841673278 >> v1:172.21.15.174:6789/0 conn(0x7f1398108380 legacy=0x7f1398168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:43.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.062+0000 7f139659c700 1 -- 172.21.15.80:0/841673278 >> v1:172.21.15.80:6789/0 conn(0x7f1398148320 legacy=0x7f139810ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:43.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.062+0000 7f139659c700 1 -- 172.21.15.80:0/841673278 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139810c490 con 0x7f13981079b0 2019-11-28T12:02:43.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.062+0000 7f138f7fe700 1 -- 172.21.15.80:0/841673278 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471829188 0 0) 0x7f1380001360 con 0x7f1398148320 2019-11-28T12:02:43.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.062+0000 7f139659c700 1 --2- 172.21.15.80:0/841673278 >> v2:172.21.15.80:3300/0 conn(0x7f13981079b0 0x7f1398107e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1388010370 tx=0x7f1388010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:43.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.062+0000 7f139659c700 1 --2- 172.21.15.80:0/841673278 >> v2:172.21.15.80:3300/0 conn(0x7f13981079b0 0x7f1398107e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1388010370 tx=0x7f1388010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:43.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.062+0000 7f139659c700 1 --2- 172.21.15.80:0/841673278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13981079b0 0x7f1398107e40 secure :-1 s=READY pgs=3138 cs=0 l=1 rx=0x7f1388010370 tx=0x7f1388010710).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:43.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.062+0000 7f139659c700 1 --2- 172.21.15.80:0/841673278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13981079b0 0x7f1398107e40 secure :-1 s=THROTTLE_DONE pgs=3138 cs=0 l=1 rx=0x7f1388010370 tx=0x7f1388010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:43.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.062+0000 7f138f7fe700 1 -- 172.21.15.80:0/841673278 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1388005560 con 0x7f13981079b0 2019-11-28T12:02:43.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.062+0000 7f139659c700 1 --2- 172.21.15.80:0/841673278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13981079b0 0x7f1398107e40 secure :-1 s=THROTTLE_DONE pgs=3138 cs=0 l=1 rx=0x7f1388010370 tx=0x7f1388010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:43.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.062+0000 7f139ce8f700 1 -- 172.21.15.80:0/841673278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139810c810 con 0x7f13981079b0 2019-11-28T12:02:43.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.062+0000 7f138f7fe700 1 -- 172.21.15.80:0/841673278 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1388005180 con 0x7f13981079b0 2019-11-28T12:02:43.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.062+0000 7f139659c700 1 --2- 172.21.15.80:0/841673278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13981079b0 0x7f1398107e40 secure :-1 s=THROTTLE_DONE pgs=3138 cs=0 l=1 rx=0x7f1388010370 tx=0x7f1388010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:43.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.062+0000 7f138f7fe700 1 -- 172.21.15.80:0/841673278 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1388005850 con 0x7f13981079b0 2019-11-28T12:02:43.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.062+0000 7f139ce8f700 1 -- 172.21.15.80:0/841673278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1398108820 con 0x7f13981079b0 2019-11-28T12:02:43.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.063+0000 7f139659c700 1 --2- 172.21.15.80:0/841673278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13981079b0 0x7f1398107e40 secure :-1 s=THROTTLE_DONE pgs=3138 cs=0 l=1 rx=0x7f1388010370 tx=0x7f1388010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:43.092 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.063+0000 7f138f7fe700 1 -- 172.21.15.80:0/841673278 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1388005180 con 0x7f13981079b0 2019-11-28T12:02:43.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.063+0000 7f139659c700 1 --2- 172.21.15.80:0/841673278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13981079b0 0x7f1398107e40 secure :-1 s=THROTTLE_DONE pgs=3138 cs=0 l=1 rx=0x7f1388010370 tx=0x7f1388010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:43.093 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.063+0000 7f138f7fe700 1 --2- 172.21.15.80:0/841673278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1370018730 0x7f137001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:43.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.063+0000 7f138f7fe700 1 -- 172.21.15.80:0/841673278 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(244..244 src has 1..244) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f1388031a20 con 0x7f13981079b0 2019-11-28T12:02:43.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.063+0000 7f1396d9d700 1 --2- 172.21.15.80:0/841673278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1370018730 0x7f137001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:43.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.064+0000 7f1396d9d700 1 --2- 172.21.15.80:0/841673278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1370018730 0x7f137001abc0 crc :-1 s=READY pgs=1300 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:43.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.071+0000 7f139ce8f700 1 -- 172.21.15.80:0/841673278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139810c490 con 0x7f13981079b0 2019-11-28T12:02:43.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.074+0000 7f139659c700 1 --2- 172.21.15.80:0/841673278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13981079b0 0x7f1398107e40 secure :-1 s=THROTTLE_DONE pgs=3138 cs=0 l=1 rx=0x7f1388010370 tx=0x7f1388010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:43.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.074+0000 7f138f7fe700 1 -- 172.21.15.80:0/841673278 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1388007310 con 0x7f13981079b0 2019-11-28T12:02:43.235 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.242+0000 7f139ce8f700 1 -- 172.21.15.80:0/841673278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f139810c810 con 0x7f13981079b0 2019-11-28T12:02:43.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.897+0000 7f139659c700 1 --2- 172.21.15.80:0/841673278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13981079b0 0x7f1398107e40 secure :-1 s=THROTTLE_DONE pgs=3138 cs=0 l=1 rx=0x7f1388010370 tx=0x7f1388010710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:43.890 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.897+0000 7f138f7fe700 1 -- 172.21.15.80:0/841673278 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v245) v1 ==== 125+0+0 (secure 0 0 0) 0x7f1388005180 con 0x7f13981079b0 2019-11-28T12:02:43.899 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2019-11-28T12:02:43.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.909+0000 7f139ce8f700 1 -- 172.21.15.80:0/841673278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1370018730 msgr2=0x7f137001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:43.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.909+0000 7f139ce8f700 1 --2- 172.21.15.80:0/841673278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1370018730 0x7f137001abc0 crc :-1 s=READY pgs=1300 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:43.902 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.909+0000 7f139ce8f700 1 -- 172.21.15.80:0/841673278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13981079b0 msgr2=0x7f1398107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:43.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.909+0000 7f139ce8f700 1 --2- 172.21.15.80:0/841673278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13981079b0 0x7f1398107e40 secure :-1 s=READY pgs=3138 cs=0 l=1 rx=0x7f1388010370 tx=0x7f1388010710).stop 2019-11-28T12:02:43.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.909+0000 7f139ce8f700 1 -- 172.21.15.80:0/841673278 shutdown_connections 2019-11-28T12:02:43.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.909+0000 7f139ce8f700 1 --2- 172.21.15.80:0/841673278 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f1370018730 0x7f137001abc0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:43.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.909+0000 7f139ce8f700 1 --2- 172.21.15.80:0/841673278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13981079b0 0x7f1398107e40 unknown :-1 s=CLOSED pgs=3138 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:43.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.909+0000 7f139ce8f700 1 -- 172.21.15.80:0/841673278 shutdown_connections 2019-11-28T12:02:43.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.909+0000 7f139ce8f700 1 -- 172.21.15.80:0/841673278 wait complete. 2019-11-28T12:02:43.903 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:43.909+0000 7f139ce8f700 1 -- 172.21.15.80:0/841673278 >> 172.21.15.80:0/841673278 conn(0x7f139815e2d0 msgr2=0x7f1398147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:43.912 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-11-28T12:02:44.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.042+0000 7f7d22860700 1 Processor -- start 2019-11-28T12:02:44.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.042+0000 7f7d22860700 1 -- start start 2019-11-28T12:02:44.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.043+0000 7f7d22860700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d1c15ed10 0x7f7d1c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:44.040 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.043+0000 7f7d22860700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7d1c0734b0 0x7f7d1c0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:44.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.043+0000 7f7d22860700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1c06db60 con 0x7f7d1c073020 2019-11-28T12:02:44.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.043+0000 7f7d22860700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1c06f3d0 con 0x7f7d1c0734b0 2019-11-28T12:02:44.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.043+0000 7f7d22860700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c06fe00 con 0x7f7d1c15ed10 2019-11-28T12:02:44.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.044+0000 7f7d215fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7d1c0734b0 0x7f7d1c0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.044+0000 7f7d20dfd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d1c15ed10 0x7f7d1c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.044+0000 7f7d215fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7d1c0734b0 0x7f7d1c0726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:35176/0 (socket says 172.21.15.80:35176) 2019-11-28T12:02:44.041 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.044+0000 7f7d20dfd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d1c15ed10 0x7f7d1c15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:50778/0 (socket says 172.21.15.80:50778) 2019-11-28T12:02:44.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.044+0000 7f7d215fe700 1 -- 172.21.15.80:0/1189005999 learned_addr learned my addr 172.21.15.80:0/1189005999 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:44.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.044+0000 7f7d215fe700 1 -- 172.21.15.80:0/1189005999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d1c15ed10 msgr2=0x7f7d1c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:44.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.044+0000 7f7d215fe700 1 --2- 172.21.15.80:0/1189005999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d1c15ed10 0x7f7d1c15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:44.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.044+0000 7f7d215fe700 1 -- 172.21.15.80:0/1189005999 >> v1:172.21.15.174:6789/0 conn(0x7f7d1c073020 legacy=0x7f7d1c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.044+0000 7f7d215fe700 1 -- 172.21.15.80:0/1189005999 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c070760 con 0x7f7d1c0734b0 2019-11-28T12:02:44.042 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.044+0000 7f7d20dfd700 1 --2- 172.21.15.80:0/1189005999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d1c15ed10 0x7f7d1c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:44.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.044+0000 7f7d215fe700 1 --2- 172.21.15.80:0/1189005999 >> v2:172.21.15.174:3300/0 conn(0x7f7d1c0734b0 0x7f7d1c0726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7d1400fae0 tx=0x7f7d1400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.044+0000 7f7d215fe700 1 --2- 172.21.15.80:0/1189005999 >> v2:172.21.15.174:3300/0 conn(0x7f7d1c0734b0 0x7f7d1c0726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7d1400fae0 tx=0x7f7d1400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.044+0000 7f7d215fe700 1 --2- 172.21.15.80:0/1189005999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c0734b0 0x7f7d1c0726a0 secure :-1 s=READY pgs=1905 cs=0 l=1 rx=0x7f7d1400fae0 tx=0x7f7d1400fe80).ready entity=mon.1 client_cookie=9894230ae8c32a3b server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:44.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.045+0000 7f7d215fe700 1 --2- 172.21.15.80:0/1189005999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c0734b0 0x7f7d1c0726a0 secure :-1 s=THROTTLE_DONE pgs=1905 cs=0 l=1 rx=0x7f7d1400fae0 tx=0x7f7d1400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.045+0000 7f7d215fe700 1 --2- 172.21.15.80:0/1189005999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c0734b0 0x7f7d1c0726a0 secure :-1 s=THROTTLE_DONE pgs=1905 cs=0 l=1 rx=0x7f7d1400fae0 tx=0x7f7d1400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.045+0000 7f7d215fe700 1 --2- 172.21.15.80:0/1189005999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c0734b0 0x7f7d1c0726a0 secure :-1 s=THROTTLE_DONE pgs=1905 cs=0 l=1 rx=0x7f7d1400fae0 tx=0x7f7d1400fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.043 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.045+0000 7f7d1b7fe700 1 -- 172.21.15.80:0/1189005999 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d14000df0 con 0x7f7d1c0734b0 2019-11-28T12:02:44.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.045+0000 7f7d1b7fe700 1 -- 172.21.15.80:0/1189005999 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d140011f0 con 0x7f7d1c0734b0 2019-11-28T12:02:44.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.045+0000 7f7d1b7fe700 1 -- 172.21.15.80:0/1189005999 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d14001880 con 0x7f7d1c0734b0 2019-11-28T12:02:44.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.045+0000 7f7d22860700 1 -- 172.21.15.80:0/1189005999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c0734b0 msgr2=0x7f7d1c0726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.045+0000 7f7d22860700 1 --2- 172.21.15.80:0/1189005999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c0734b0 0x7f7d1c0726a0 secure :-1 s=READY pgs=1905 cs=0 l=1 rx=0x7f7d1400fae0 tx=0x7f7d1400fe80).stop 2019-11-28T12:02:44.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.045+0000 7f7d22860700 1 -- 172.21.15.80:0/1189005999 shutdown_connections 2019-11-28T12:02:44.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.045+0000 7f7d22860700 1 --2- 172.21.15.80:0/1189005999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c0734b0 0x7f7d1c0726a0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:44.044 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.045+0000 7f7d22860700 1 --2- 172.21.15.80:0/1189005999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d1c15ed10 0x7f7d1c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:44.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.045+0000 7f7d22860700 1 -- 172.21.15.80:0/1189005999 shutdown_connections 2019-11-28T12:02:44.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.045+0000 7f7d22860700 1 -- 172.21.15.80:0/1189005999 wait complete. 2019-11-28T12:02:44.045 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.045+0000 7f7d22860700 1 -- 172.21.15.80:0/1189005999 >> 172.21.15.80:0/1189005999 conn(0x7f7d1c061d20 msgr2=0x7f7d1c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.048+0000 7f7d22860700 1 Processor -- start 2019-11-28T12:02:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.048+0000 7f7d22860700 1 -- start start 2019-11-28T12:02:44.049 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.049+0000 7f7d22860700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7d1c10e970 0x7f7d1c1087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:44.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.049+0000 7f7d22860700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1c10c250 con 0x7f7d1c107e30 2019-11-28T12:02:44.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.049+0000 7f7d22860700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1c10c6d0 con 0x7f7d1c108cf0 2019-11-28T12:02:44.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.049+0000 7f7d22860700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1c10e430 con 0x7f7d1c10e970 2019-11-28T12:02:44.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.049+0000 7f7d215fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7d1c107e30 0x7f7d1c167d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47844/0 (socket says 172.21.15.80:47844) 2019-11-28T12:02:44.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.049+0000 7f7d215fe700 1 -- 172.21.15.80:0/3601298086 learned_addr learned my addr 172.21.15.80:0/3601298086 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:44.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.049+0000 7f7d20dfd700 1 --2- 172.21.15.80:0/3601298086 >> v2:172.21.15.174:3300/0 conn(0x7f7d1c10e970 0x7f7d1c1087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.050 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.049+0000 7f7d197fa700 1 -- 172.21.15.80:0/3601298086 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989286249 0 0) 0x7f7d14008170 con 0x7f7d1c107e30 2019-11-28T12:02:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.049+0000 7f7d197fa700 1 -- 172.21.15.80:0/3601298086 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d00002e80 con 0x7f7d1c107e30 2019-11-28T12:02:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.050+0000 7f7d197fa700 1 -- 172.21.15.80:0/3601298086 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164992481 0 0) 0x7f7d0c000fb0 con 0x7f7d1c108cf0 2019-11-28T12:02:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.050+0000 7f7d20dfd700 1 -- 172.21.15.80:0/3601298086 >> v1:172.21.15.174:6789/0 conn(0x7f7d1c108cf0 legacy=0x7f7d1c107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.050+0000 7f7d20dfd700 1 -- 172.21.15.80:0/3601298086 >> v1:172.21.15.80:6789/0 conn(0x7f7d1c107e30 legacy=0x7f7d1c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.050+0000 7f7d20dfd700 1 -- 172.21.15.80:0/3601298086 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c105ef0 con 0x7f7d1c10e970 2019-11-28T12:02:44.051 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.050+0000 7f7d20dfd700 1 --2- 172.21.15.80:0/3601298086 >> v2:172.21.15.174:3300/0 conn(0x7f7d1c10e970 0x7f7d1c1087b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d040103a0 tx=0x7f7d04010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.050+0000 7f7d20dfd700 1 --2- 172.21.15.80:0/3601298086 >> v2:172.21.15.174:3300/0 conn(0x7f7d1c10e970 0x7f7d1c1087b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d040103a0 tx=0x7f7d04010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.050+0000 7f7d20dfd700 1 --2- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c10e970 0x7f7d1c1087b0 secure :-1 s=READY pgs=1907 cs=0 l=1 rx=0x7f7d040103a0 tx=0x7f7d04010740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:44.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.050+0000 7f7d20dfd700 1 --2- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c10e970 0x7f7d1c1087b0 secure :-1 s=THROTTLE_DONE pgs=1907 cs=0 l=1 rx=0x7f7d040103a0 tx=0x7f7d04010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.050+0000 7f7d197fa700 1 -- 172.21.15.80:0/3601298086 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d04000940 con 0x7f7d1c10e970 2019-11-28T12:02:44.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.050+0000 7f7d20dfd700 1 --2- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c10e970 0x7f7d1c1087b0 secure :-1 s=THROTTLE_DONE pgs=1907 cs=0 l=1 rx=0x7f7d040103a0 tx=0x7f7d04010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.052 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.050+0000 7f7d20dfd700 1 --2- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c10e970 0x7f7d1c1087b0 secure :-1 s=THROTTLE_DONE pgs=1907 cs=0 l=1 rx=0x7f7d040103a0 tx=0x7f7d04010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.050+0000 7f7d197fa700 1 -- 172.21.15.80:0/3601298086 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d040099d0 con 0x7f7d1c10e970 2019-11-28T12:02:44.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.050+0000 7f7d22860700 1 -- 172.21.15.80:0/3601298086 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1c106270 con 0x7f7d1c10e970 2019-11-28T12:02:44.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.050+0000 7f7d197fa700 1 -- 172.21.15.80:0/3601298086 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d04000940 con 0x7f7d1c10e970 2019-11-28T12:02:44.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.050+0000 7f7d22860700 1 -- 172.21.15.80:0/3601298086 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1c105ef0 con 0x7f7d1c10e970 2019-11-28T12:02:44.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.050+0000 7f7d20dfd700 1 --2- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c10e970 0x7f7d1c1087b0 secure :-1 s=THROTTLE_DONE pgs=1907 cs=0 l=1 rx=0x7f7d040103a0 tx=0x7f7d04010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.051+0000 7f7d197fa700 1 -- 172.21.15.80:0/3601298086 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f7d040095d0 con 0x7f7d1c10e970 2019-11-28T12:02:44.053 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.051+0000 7f7d20dfd700 1 --2- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c10e970 0x7f7d1c1087b0 secure :-1 s=THROTTLE_DONE pgs=1907 cs=0 l=1 rx=0x7f7d040103a0 tx=0x7f7d04010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.051+0000 7f7d197fa700 1 --2- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d00018780 0x7f7d0001abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:44.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.051+0000 7f7d197fa700 1 -- 172.21.15.80:0/3601298086 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(245..245 src has 1..245) v4 ==== 5904+0+0 (secure 0 0 0) 0x7f7d04031ab0 con 0x7f7d1c10e970 2019-11-28T12:02:44.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.051+0000 7f7d1bfff700 1 --2- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d00018780 0x7f7d0001abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.054 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.051+0000 7f7d1bfff700 1 --2- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d00018780 0x7f7d0001abf0 crc :-1 s=READY pgs=1301 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:44.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.058+0000 7f7d22860700 1 -- 172.21.15.80:0/3601298086 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1c106270 con 0x7f7d1c10e970 2019-11-28T12:02:44.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.062+0000 7f7d20dfd700 1 --2- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c10e970 0x7f7d1c1087b0 secure :-1 s=THROTTLE_DONE pgs=1907 cs=0 l=1 rx=0x7f7d040103a0 tx=0x7f7d04010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.055 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.062+0000 7f7d197fa700 1 -- 172.21.15.80:0/3601298086 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f7d04017250 con 0x7f7d1c10e970 2019-11-28T12:02:44.224 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.231+0000 7f7d22860700 1 -- 172.21.15.80:0/3601298086 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f7d1c105ef0 con 0x7f7d1c10e970 2019-11-28T12:02:44.247 INFO:tasks.ceph.mon.a.smithi080.stderr:2019-11-28T12:02:44.232+0000 7fec87371700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-11-28T12:02:44.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.238+0000 7f7d20dfd700 1 --2- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c10e970 0x7f7d1c1087b0 secure :-1 s=THROTTLE_DONE pgs=1907 cs=0 l=1 rx=0x7f7d040103a0 tx=0x7f7d04010740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.238+0000 7f7d197fa700 1 -- 172.21.15.80:0/3601298086 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 40 and data pool 41 v205) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7d04017460 con 0x7f7d1c10e970 2019-11-28T12:02:44.248 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 40 and data pool 41 2019-11-28T12:02:44.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.241+0000 7f7d22860700 1 -- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d00018780 msgr2=0x7f7d0001abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.241+0000 7f7d22860700 1 --2- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d00018780 0x7f7d0001abf0 crc :-1 s=READY pgs=1301 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:44.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.241+0000 7f7d22860700 1 -- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c10e970 msgr2=0x7f7d1c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.241+0000 7f7d22860700 1 --2- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c10e970 0x7f7d1c1087b0 secure :-1 s=READY pgs=1907 cs=0 l=1 rx=0x7f7d040103a0 tx=0x7f7d04010740).stop 2019-11-28T12:02:44.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.241+0000 7f7d22860700 1 -- 172.21.15.80:0/3601298086 shutdown_connections 2019-11-28T12:02:44.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.241+0000 7f7d22860700 1 --2- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f7d00018780 0x7f7d0001abf0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:44.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.241+0000 7f7d22860700 1 --2- 172.21.15.80:0/3601298086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d1c10e970 0x7f7d1c1087b0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:44.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.241+0000 7f7d22860700 1 -- 172.21.15.80:0/3601298086 shutdown_connections 2019-11-28T12:02:44.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.241+0000 7f7d22860700 1 -- 172.21.15.80:0/3601298086 wait complete. 2019-11-28T12:02:44.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.241+0000 7f7d22860700 1 -- 172.21.15.80:0/3601298086 >> 172.21.15.80:0/3601298086 conn(0x7f7d1c15e2d0 msgr2=0x7f7d1c147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:44.290 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T12:02:44.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.416+0000 7f28b0e83700 1 Processor -- start 2019-11-28T12:02:44.418 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.416+0000 7f28b0e83700 1 -- start start 2019-11-28T12:02:44.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.417+0000 7f28b0e83700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28ac06c0a0 0x7f28ac072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:44.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.417+0000 7f28b0e83700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f28ac072620 0x7f28ac164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:44.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.417+0000 7f28b0e83700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac06db00 con 0x7f28ac0734e0 2019-11-28T12:02:44.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.417+0000 7f28b0e83700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac06f330 con 0x7f28ac072620 2019-11-28T12:02:44.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.417+0000 7f28b0e83700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0706c0 con 0x7f28ac06c0a0 2019-11-28T12:02:44.419 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.417+0000 7f28aa59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f28ac0734e0 0x7f28ac071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47852/0 (socket says 172.21.15.80:47852) 2019-11-28T12:02:44.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.417+0000 7f28aa59c700 1 -- 172.21.15.80:0/1296220587 learned_addr learned my addr 172.21.15.80:0/1296220587 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:44.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.417+0000 7f28ab59e700 1 --2- 172.21.15.80:0/1296220587 >> v2:172.21.15.174:3300/0 conn(0x7f28ac072620 0x7f28ac164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.417+0000 7f28aad9d700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28ac06c0a0 0x7f28ac072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.417+0000 7f28a9d9b700 1 -- 172.21.15.80:0/1296220587 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294958886 0 0) 0x7f289c001070 con 0x7f28ac0734e0 2019-11-28T12:02:44.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.417+0000 7f28a9d9b700 1 -- 172.21.15.80:0/1296220587 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2894002e80 con 0x7f28ac0734e0 2019-11-28T12:02:44.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.417+0000 7f28a9d9b700 1 -- 172.21.15.80:0/1296220587 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 985084888 0 0) 0x7f289c001050 con 0x7f28ac0734e0 2019-11-28T12:02:44.420 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.417+0000 7f28a9d9b700 1 -- 172.21.15.80:0/1296220587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28ac06c0a0 msgr2=0x7f28ac072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.417+0000 7f28a9d9b700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28ac06c0a0 0x7f28ac072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28a9d9b700 1 -- 172.21.15.80:0/1296220587 >> v2:172.21.15.174:3300/0 conn(0x7f28ac072620 msgr2=0x7f28ac164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28a9d9b700 1 --2- 172.21.15.80:0/1296220587 >> v2:172.21.15.174:3300/0 conn(0x7f28ac072620 0x7f28ac164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28a9d9b700 1 -- 172.21.15.80:0/1296220587 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac070a40 con 0x7f28ac0734e0 2019-11-28T12:02:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28a9d9b700 1 -- 172.21.15.80:0/1296220587 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7f289c001580 con 0x7f28ac0734e0 2019-11-28T12:02:44.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28ab59e700 1 --2- 172.21.15.80:0/1296220587 >> v2:172.21.15.174:3300/0 conn(0x7f28ac072620 0x7f28ac164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:44.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28a9d9b700 1 -- 172.21.15.80:0/1296220587 >> v1:172.21.15.80:6789/0 conn(0x7f28ac0734e0 legacy=0x7f28ac071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28a9d9b700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28940479e0 0x7f2894049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:44.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28a9d9b700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f289404a5c0 0x7f289404ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:44.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28a9d9b700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f289404d260 0x7f289404f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:44.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28a9d9b700 1 -- 172.21.15.80:0/1296220587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289404ff40 con 0x7f28940479e0 2019-11-28T12:02:44.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28a9d9b700 1 -- 172.21.15.80:0/1296220587 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2894050130 con 0x7f289404d260 2019-11-28T12:02:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28a9d9b700 1 -- 172.21.15.80:0/1296220587 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2894050360 con 0x7f289404a5c0 2019-11-28T12:02:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28aad9d700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28940479e0 0x7f2894049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28ab59e700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f289404d260 0x7f289404f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28aa59c700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f289404a5c0 0x7f289404ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28aad9d700 1 -- 172.21.15.80:0/1296220587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f289404a5c0 msgr2=0x7f289404ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:44.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28aad9d700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f289404a5c0 0x7f289404ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:44.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28aad9d700 1 -- 172.21.15.80:0/1296220587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f289404d260 msgr2=0x7f289404f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:44.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28aad9d700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f289404d260 0x7f289404f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:44.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28aad9d700 1 -- 172.21.15.80:0/1296220587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2894050610 con 0x7f28940479e0 2019-11-28T12:02:44.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28aa59c700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f289404a5c0 0x7f289404ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T12:02:44.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28aad9d700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28940479e0 0x7f2894049e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f28a000f660 tx=0x7f28a0002c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28aad9d700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28940479e0 0x7f2894049e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f28a000f660 tx=0x7f28a0002c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28aad9d700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28940479e0 0x7f2894049e40 secure :-1 s=READY pgs=3141 cs=0 l=1 rx=0x7f28a000f660 tx=0x7f28a0002c10).ready entity=mon.0 client_cookie=3ef916622a75a3de server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:44.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28aad9d700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28940479e0 0x7f2894049e40 secure :-1 s=THROTTLE_DONE pgs=3141 cs=0 l=1 rx=0x7f28a000f660 tx=0x7f28a0002c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28a9d9b700 1 -- 172.21.15.80:0/1296220587 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28a0000940 con 0x7f28940479e0 2019-11-28T12:02:44.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28aad9d700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28940479e0 0x7f2894049e40 secure :-1 s=THROTTLE_DONE pgs=3141 cs=0 l=1 rx=0x7f28a000f660 tx=0x7f28a0002c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28aad9d700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28940479e0 0x7f2894049e40 secure :-1 s=THROTTLE_DONE pgs=3141 cs=0 l=1 rx=0x7f28a000f660 tx=0x7f28a0002c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28a9d9b700 1 -- 172.21.15.80:0/1296220587 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a0001090 con 0x7f28940479e0 2019-11-28T12:02:44.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28a9d9b700 1 -- 172.21.15.80:0/1296220587 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28a0001760 con 0x7f28940479e0 2019-11-28T12:02:44.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28b0e83700 1 -- 172.21.15.80:0/1296220587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28940479e0 msgr2=0x7f2894049e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28b0e83700 1 --2- 172.21.15.80:0/1296220587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28940479e0 0x7f2894049e40 secure :-1 s=READY pgs=3141 cs=0 l=1 rx=0x7f28a000f660 tx=0x7f28a0002c10).stop 2019-11-28T12:02:44.426 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.418+0000 7f28ab59e700 1 -- 172.21.15.80:0/1296220587 reap_dead start 2019-11-28T12:02:44.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.419+0000 7f28b0e83700 1 -- 172.21.15.80:0/1296220587 shutdown_connections 2019-11-28T12:02:44.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.419+0000 7f28b0e83700 1 -- 172.21.15.80:0/1296220587 shutdown_connections 2019-11-28T12:02:44.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.419+0000 7f28b0e83700 1 -- 172.21.15.80:0/1296220587 wait complete. 2019-11-28T12:02:44.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.419+0000 7f28b0e83700 1 -- 172.21.15.80:0/1296220587 >> 172.21.15.80:0/1296220587 conn(0x7f28ac061cf0 msgr2=0x7f28ac064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:44.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.422+0000 7f28b0e83700 1 Processor -- start 2019-11-28T12:02:44.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.422+0000 7f28b0e83700 1 -- start start 2019-11-28T12:02:44.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.422+0000 7f28b0e83700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f28ac106c20 0x7f28ac1155f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:44.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.422+0000 7f28b0e83700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28ac115b30 0x7f28ac11caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:44.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.422+0000 7f28b0e83700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac11dd50 con 0x7f28ac11cfe0 2019-11-28T12:02:44.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.422+0000 7f28b0e83700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac1126a0 con 0x7f28ac115b30 2019-11-28T12:02:44.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.422+0000 7f28b0e83700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac11f570 con 0x7f28ac106c20 2019-11-28T12:02:44.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28aa59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28ac115b30 0x7f28ac11caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28aa59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f28ac115b30 0x7f28ac11caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48546/0 (socket says 172.21.15.80:48546) 2019-11-28T12:02:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28ab59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f28ac11cfe0 0x7f28ac114470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47864/0 (socket says 172.21.15.80:47864) 2019-11-28T12:02:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28aa59c700 1 -- 172.21.15.80:0/4266476302 learned_addr learned my addr 172.21.15.80:0/4266476302 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28aad9d700 1 --2- 172.21.15.80:0/4266476302 >> v2:172.21.15.174:3300/0 conn(0x7f28ac106c20 0x7f28ac1155f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28aa59c700 1 -- 172.21.15.80:0/4266476302 >> v2:172.21.15.174:3300/0 conn(0x7f28ac106c20 msgr2=0x7f28ac1155f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28aa59c700 1 --2- 172.21.15.80:0/4266476302 >> v2:172.21.15.174:3300/0 conn(0x7f28ac106c20 0x7f28ac1155f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28aa59c700 1 -- 172.21.15.80:0/4266476302 >> v1:172.21.15.80:6789/0 conn(0x7f28ac11cfe0 legacy=0x7f28ac114470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28aa59c700 1 -- 172.21.15.80:0/4266476302 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac112d30 con 0x7f28ac115b30 2019-11-28T12:02:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f289b7fe700 1 -- 172.21.15.80:0/4266476302 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552617253 0 0) 0x7f28a4009930 con 0x7f28ac11cfe0 2019-11-28T12:02:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28aa59c700 1 --2- 172.21.15.80:0/4266476302 >> v2:172.21.15.80:3300/0 conn(0x7f28ac115b30 0x7f28ac11caa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f289c010440 tx=0x7f289c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28aa59c700 1 --2- 172.21.15.80:0/4266476302 >> v2:172.21.15.80:3300/0 conn(0x7f28ac115b30 0x7f28ac11caa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f289c010440 tx=0x7f289c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28aa59c700 1 --2- 172.21.15.80:0/4266476302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28ac115b30 0x7f28ac11caa0 secure :-1 s=READY pgs=3143 cs=0 l=1 rx=0x7f289c010440 tx=0x7f289c010270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28aa59c700 1 --2- 172.21.15.80:0/4266476302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28ac115b30 0x7f28ac11caa0 secure :-1 s=THROTTLE_DONE pgs=3143 cs=0 l=1 rx=0x7f289c010440 tx=0x7f289c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f289b7fe700 1 -- 172.21.15.80:0/4266476302 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f289c003fe0 con 0x7f28ac115b30 2019-11-28T12:02:44.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28b0e83700 1 -- 172.21.15.80:0/4266476302 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac1130b0 con 0x7f28ac115b30 2019-11-28T12:02:44.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28aa59c700 1 --2- 172.21.15.80:0/4266476302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28ac115b30 0x7f28ac11caa0 secure :-1 s=THROTTLE_DONE pgs=3143 cs=0 l=1 rx=0x7f289c010440 tx=0x7f289c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28aa59c700 1 --2- 172.21.15.80:0/4266476302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28ac115b30 0x7f28ac11caa0 secure :-1 s=THROTTLE_DONE pgs=3143 cs=0 l=1 rx=0x7f289c010440 tx=0x7f289c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f289b7fe700 1 -- 172.21.15.80:0/4266476302 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c000fc0 con 0x7f28ac115b30 2019-11-28T12:02:44.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f28b0e83700 1 -- 172.21.15.80:0/4266476302 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac112d30 con 0x7f28ac115b30 2019-11-28T12:02:44.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.423+0000 7f289b7fe700 1 -- 172.21.15.80:0/4266476302 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f289c0043c0 con 0x7f28ac115b30 2019-11-28T12:02:44.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.424+0000 7f28aa59c700 1 --2- 172.21.15.80:0/4266476302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28ac115b30 0x7f28ac11caa0 secure :-1 s=THROTTLE_DONE pgs=3143 cs=0 l=1 rx=0x7f289c010440 tx=0x7f289c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.424+0000 7f289b7fe700 1 -- 172.21.15.80:0/4266476302 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f289c001300 con 0x7f28ac115b30 2019-11-28T12:02:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.424+0000 7f28aa59c700 1 --2- 172.21.15.80:0/4266476302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28ac115b30 0x7f28ac11caa0 secure :-1 s=THROTTLE_DONE pgs=3143 cs=0 l=1 rx=0x7f289c010440 tx=0x7f289c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.424+0000 7f289b7fe700 1 --2- 172.21.15.80:0/4266476302 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2890018730 0x7f289001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.424+0000 7f289b7fe700 1 -- 172.21.15.80:0/4266476302 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(246..246 src has 1..246) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f289c031b20 con 0x7f28ac115b30 2019-11-28T12:02:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.424+0000 7f28aad9d700 1 --2- 172.21.15.80:0/4266476302 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2890018730 0x7f289001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.424+0000 7f28aad9d700 1 --2- 172.21.15.80:0/4266476302 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2890018730 0x7f289001abc0 crc :-1 s=READY pgs=1302 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:44.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.431+0000 7f28b0e83700 1 -- 172.21.15.80:0/4266476302 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac1130b0 con 0x7f28ac115b30 2019-11-28T12:02:44.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.435+0000 7f28aa59c700 1 --2- 172.21.15.80:0/4266476302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28ac115b30 0x7f28ac11caa0 secure :-1 s=THROTTLE_DONE pgs=3143 cs=0 l=1 rx=0x7f289c010440 tx=0x7f289c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.435+0000 7f289b7fe700 1 -- 172.21.15.80:0/4266476302 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f289c025d60 con 0x7f28ac115b30 2019-11-28T12:02:44.618 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.614+0000 7f28b0e83700 1 -- 172.21.15.80:0/4266476302 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28ac112d30 con 0x7f28ac115b30 2019-11-28T12:02:44.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.615+0000 7f28aa59c700 1 --2- 172.21.15.80:0/4266476302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28ac115b30 0x7f28ac11caa0 secure :-1 s=THROTTLE_DONE pgs=3143 cs=0 l=1 rx=0x7f289c010440 tx=0x7f289c010270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.615+0000 7f289b7fe700 1 -- 172.21.15.80:0/4266476302 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v246) v1 ==== 74+0+14884 (secure 0 0 0) 0x7f289c025d60 con 0x7f28ac115b30 2019-11-28T12:02:44.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.617+0000 7f28b0e83700 1 -- 172.21.15.80:0/4266476302 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2890018730 msgr2=0x7f289001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.617+0000 7f28b0e83700 1 --2- 172.21.15.80:0/4266476302 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2890018730 0x7f289001abc0 crc :-1 s=READY pgs=1302 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:44.619 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.617+0000 7f28b0e83700 1 -- 172.21.15.80:0/4266476302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28ac115b30 msgr2=0x7f28ac11caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.617+0000 7f28b0e83700 1 --2- 172.21.15.80:0/4266476302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28ac115b30 0x7f28ac11caa0 secure :-1 s=READY pgs=3143 cs=0 l=1 rx=0x7f289c010440 tx=0x7f289c010270).stop 2019-11-28T12:02:44.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.618+0000 7f28b0e83700 1 -- 172.21.15.80:0/4266476302 shutdown_connections 2019-11-28T12:02:44.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.618+0000 7f28b0e83700 1 --2- 172.21.15.80:0/4266476302 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2890018730 0x7f289001abc0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:44.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.618+0000 7f28b0e83700 1 --2- 172.21.15.80:0/4266476302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28ac115b30 0x7f28ac11caa0 unknown :-1 s=CLOSED pgs=3143 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:44.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.618+0000 7f28b0e83700 1 --2- 172.21.15.80:0/4266476302 >> v2:172.21.15.174:3300/0 conn(0x7f28ac106c20 0x7f28ac1155f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:44.620 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.618+0000 7f28b0e83700 1 -- 172.21.15.80:0/4266476302 shutdown_connections 2019-11-28T12:02:44.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.618+0000 7f28b0e83700 1 -- 172.21.15.80:0/4266476302 wait complete. 2019-11-28T12:02:44.621 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.618+0000 7f28b0e83700 1 -- 172.21.15.80:0/4266476302 >> 172.21.15.80:0/4266476302 conn(0x7f28ac141d10 msgr2=0x7f28ac13ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:44.621 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:44.622 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":246,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T12:02:44.233395+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":41,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":40,"pool_name":"cephfs_metadata","create_time":"2019-11-28T12:02:42.568808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"246","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":41,"pool_name":"cephfs_data","create_time":"2019-11-28T12:02:43.256218+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"246","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":244,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":244,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T12:02:44.628 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T12:02:44.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.754+0000 7f0e3e3b3700 1 Processor -- start 2019-11-28T12:02:44.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.754+0000 7f0e3e3b3700 1 -- start start 2019-11-28T12:02:44.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.755+0000 7f0e3e3b3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e3806c490 0x7f0e3806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:44.753 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.755+0000 7f0e3e3b3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0e3806ce60 0x7f0e38164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:44.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.755+0000 7f0e3e3b3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3806db00 con 0x7f0e3806c0a0 2019-11-28T12:02:44.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.755+0000 7f0e3e3b3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3806fd60 con 0x7f0e3806ce60 2019-11-28T12:02:44.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.755+0000 7f0e3e3b3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e38070030 con 0x7f0e3806c490 2019-11-28T12:02:44.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e3c950700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0e3806c0a0 0x7f0e38072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47868/0 (socket says 172.21.15.80:47868) 2019-11-28T12:02:44.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e3c950700 1 -- 172.21.15.80:0/1453401643 learned_addr learned my addr 172.21.15.80:0/1453401643 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:44.754 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1453401643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e3806c490 0x7f0e3806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e3d151700 1 --2- 172.21.15.80:0/1453401643 >> v2:172.21.15.174:3300/0 conn(0x7f0e3806ce60 0x7f0e38164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e377fe700 1 -- 172.21.15.80:0/1453401643 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043289987 0 0) 0x7f0e20001150 con 0x7f0e3806c0a0 2019-11-28T12:02:44.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e377fe700 1 -- 172.21.15.80:0/1453401643 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e24002e80 con 0x7f0e3806c0a0 2019-11-28T12:02:44.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e37fff700 1 -- 172.21.15.80:0/1453401643 >> v2:172.21.15.174:3300/0 conn(0x7f0e3806ce60 msgr2=0x7f0e38164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:44.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1453401643 >> v2:172.21.15.174:3300/0 conn(0x7f0e3806ce60 0x7f0e38164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:44.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e37fff700 1 -- 172.21.15.80:0/1453401643 >> v1:172.21.15.80:6789/0 conn(0x7f0e3806c0a0 legacy=0x7f0e38072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.755 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e37fff700 1 -- 172.21.15.80:0/1453401643 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e380706c0 con 0x7f0e3806c490 2019-11-28T12:02:44.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e3d151700 1 --2- 172.21.15.80:0/1453401643 >> v2:172.21.15.174:3300/0 conn(0x7f0e3806ce60 0x7f0e38164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:44.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1453401643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e3806c490 0x7f0e3806c920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0e2800b2d0 tx=0x7f0e2800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1453401643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e3806c490 0x7f0e3806c920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0e2800b2d0 tx=0x7f0e2800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1453401643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e3806c490 0x7f0e3806c920 secure :-1 s=READY pgs=454 cs=0 l=1 rx=0x7f0e2800b2d0 tx=0x7f0e2800bae0).ready entity=mon.2 client_cookie=fd59be052831941a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:44.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1453401643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e3806c490 0x7f0e3806c920 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7f0e2800b2d0 tx=0x7f0e2800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.756 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1453401643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e3806c490 0x7f0e3806c920 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7f0e2800b2d0 tx=0x7f0e2800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e377fe700 1 -- 172.21.15.80:0/1453401643 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e28007590 con 0x7f0e3806c490 2019-11-28T12:02:44.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e37fff700 1 --2- 172.21.15.80:0/1453401643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e3806c490 0x7f0e3806c920 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7f0e2800b2d0 tx=0x7f0e2800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e377fe700 1 -- 172.21.15.80:0/1453401643 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e28009d30 con 0x7f0e3806c490 2019-11-28T12:02:44.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e377fe700 1 -- 172.21.15.80:0/1453401643 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e2800a400 con 0x7f0e3806c490 2019-11-28T12:02:44.757 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e3e3b3700 1 -- 172.21.15.80:0/1453401643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e3806c490 msgr2=0x7f0e3806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.756+0000 7f0e3e3b3700 1 --2- 172.21.15.80:0/1453401643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e3806c490 0x7f0e3806c920 secure :-1 s=READY pgs=454 cs=0 l=1 rx=0x7f0e2800b2d0 tx=0x7f0e2800bae0).stop 2019-11-28T12:02:44.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.757+0000 7f0e3e3b3700 1 -- 172.21.15.80:0/1453401643 shutdown_connections 2019-11-28T12:02:44.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.757+0000 7f0e3e3b3700 1 --2- 172.21.15.80:0/1453401643 >> v2:172.21.15.174:3300/0 conn(0x7f0e3806ce60 0x7f0e38164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:44.758 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.757+0000 7f0e3e3b3700 1 --2- 172.21.15.80:0/1453401643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e3806c490 0x7f0e3806c920 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.757+0000 7f0e3e3b3700 1 -- 172.21.15.80:0/1453401643 shutdown_connections 2019-11-28T12:02:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.757+0000 7f0e3e3b3700 1 -- 172.21.15.80:0/1453401643 wait complete. 2019-11-28T12:02:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.757+0000 7f0e3e3b3700 1 -- 172.21.15.80:0/1453401643 >> 172.21.15.80:0/1453401643 conn(0x7f0e38061cf0 msgr2=0x7f0e38064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.760+0000 7f0e3e3b3700 1 Processor -- start 2019-11-28T12:02:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.760+0000 7f0e3e3b3700 1 -- start start 2019-11-28T12:02:44.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e3e3b3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e38109e40 0x7f0e3810a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:44.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e3e3b3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0e3810a810 0x7f0e38105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:44.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e3e3b3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3813f1e0 con 0x7f0e3813eb40 2019-11-28T12:02:44.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e3e3b3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e381234c0 con 0x7f0e38109e40 2019-11-28T12:02:44.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e3e3b3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3813e0d0 con 0x7f0e3810a810 2019-11-28T12:02:44.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e37fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e38109e40 0x7f0e3810a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e37fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e38109e40 0x7f0e3810a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48558/0 (socket says 172.21.15.80:48558) 2019-11-28T12:02:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e37fff700 1 -- 172.21.15.80:0/3158926323 learned_addr learned my addr 172.21.15.80:0/3158926323 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e3d151700 1 --2- 172.21.15.80:0/3158926323 >> v2:172.21.15.174:3300/0 conn(0x7f0e3810a810 0x7f0e38105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e37fff700 1 -- 172.21.15.80:0/3158926323 >> v2:172.21.15.174:3300/0 conn(0x7f0e3810a810 msgr2=0x7f0e38105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e37fff700 1 --2- 172.21.15.80:0/3158926323 >> v2:172.21.15.174:3300/0 conn(0x7f0e3810a810 0x7f0e38105210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e37fff700 1 -- 172.21.15.80:0/3158926323 >> v1:172.21.15.174:6789/0 conn(0x7f0e3813eb40 legacy=0x7f0e3810afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e37fff700 1 -- 172.21.15.80:0/3158926323 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e38108700 con 0x7f0e38109e40 2019-11-28T12:02:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e37fff700 1 --2- 172.21.15.80:0/3158926323 >> v2:172.21.15.80:3300/0 conn(0x7f0e38109e40 0x7f0e3810a2d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0e280547f0 tx=0x7f0e28054670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e37fff700 1 --2- 172.21.15.80:0/3158926323 >> v2:172.21.15.80:3300/0 conn(0x7f0e38109e40 0x7f0e3810a2d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0e280547f0 tx=0x7f0e28054670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e37fff700 1 --2- 172.21.15.80:0/3158926323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e38109e40 0x7f0e3810a2d0 secure :-1 s=READY pgs=3145 cs=0 l=1 rx=0x7f0e280547f0 tx=0x7f0e28054670).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e37fff700 1 --2- 172.21.15.80:0/3158926323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e38109e40 0x7f0e3810a2d0 secure :-1 s=THROTTLE_DONE pgs=3145 cs=0 l=1 rx=0x7f0e280547f0 tx=0x7f0e28054670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e357fa700 1 -- 172.21.15.80:0/3158926323 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e2800af10 con 0x7f0e38109e40 2019-11-28T12:02:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e37fff700 1 --2- 172.21.15.80:0/3158926323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e38109e40 0x7f0e3810a2d0 secure :-1 s=THROTTLE_DONE pgs=3145 cs=0 l=1 rx=0x7f0e280547f0 tx=0x7f0e28054670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e357fa700 1 -- 172.21.15.80:0/3158926323 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e28009d00 con 0x7f0e38109e40 2019-11-28T12:02:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e37fff700 1 --2- 172.21.15.80:0/3158926323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e38109e40 0x7f0e3810a2d0 secure :-1 s=THROTTLE_DONE pgs=3145 cs=0 l=1 rx=0x7f0e280547f0 tx=0x7f0e28054670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e3e3b3700 1 -- 172.21.15.80:0/3158926323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e38108a80 con 0x7f0e38109e40 2019-11-28T12:02:44.794 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e357fa700 1 -- 172.21.15.80:0/3158926323 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e28009ef0 con 0x7f0e38109e40 2019-11-28T12:02:44.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.761+0000 7f0e3e3b3700 1 -- 172.21.15.80:0/3158926323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e38108700 con 0x7f0e38109e40 2019-11-28T12:02:44.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.762+0000 7f0e37fff700 1 --2- 172.21.15.80:0/3158926323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e38109e40 0x7f0e3810a2d0 secure :-1 s=THROTTLE_DONE pgs=3145 cs=0 l=1 rx=0x7f0e280547f0 tx=0x7f0e28054670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.798 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.762+0000 7f0e357fa700 1 -- 172.21.15.80:0/3158926323 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f0e28009900 con 0x7f0e38109e40 2019-11-28T12:02:44.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.762+0000 7f0e37fff700 1 --2- 172.21.15.80:0/3158926323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e38109e40 0x7f0e3810a2d0 secure :-1 s=THROTTLE_DONE pgs=3145 cs=0 l=1 rx=0x7f0e280547f0 tx=0x7f0e28054670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.762+0000 7f0e357fa700 1 --2- 172.21.15.80:0/3158926323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0e1c018730 0x7f0e1c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:44.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.762+0000 7f0e357fa700 1 -- 172.21.15.80:0/3158926323 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(246..246 src has 1..246) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f0e28075ea0 con 0x7f0e38109e40 2019-11-28T12:02:44.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.762+0000 7f0e3c950700 1 --2- 172.21.15.80:0/3158926323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0e1c018730 0x7f0e1c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:44.799 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.762+0000 7f0e3c950700 1 --2- 172.21.15.80:0/3158926323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0e1c018730 0x7f0e1c01abc0 crc :-1 s=READY pgs=1303 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:44.801 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.770+0000 7f0e3e3b3700 1 -- 172.21.15.80:0/3158926323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e38108a80 con 0x7f0e38109e40 2019-11-28T12:02:44.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.773+0000 7f0e37fff700 1 --2- 172.21.15.80:0/3158926323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e38109e40 0x7f0e3810a2d0 secure :-1 s=THROTTLE_DONE pgs=3145 cs=0 l=1 rx=0x7f0e280547f0 tx=0x7f0e28054670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.802 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.773+0000 7f0e357fa700 1 -- 172.21.15.80:0/3158926323 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f0e2805b920 con 0x7f0e38109e40 2019-11-28T12:02:44.942 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.949+0000 7f0e3e3b3700 1 -- 172.21.15.80:0/3158926323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e38108700 con 0x7f0e38109e40 2019-11-28T12:02:44.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.950+0000 7f0e37fff700 1 --2- 172.21.15.80:0/3158926323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e38109e40 0x7f0e3810a2d0 secure :-1 s=THROTTLE_DONE pgs=3145 cs=0 l=1 rx=0x7f0e280547f0 tx=0x7f0e28054670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:44.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.950+0000 7f0e357fa700 1 -- 172.21.15.80:0/3158926323 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v246) v1 ==== 74+0+14884 (secure 0 0 0) 0x7f0e28009900 con 0x7f0e38109e40 2019-11-28T12:02:44.944 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:44.945 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":246,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T12:02:44.233395+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":41,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":40,"pool_name":"cephfs_metadata","create_time":"2019-11-28T12:02:42.568808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"246","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":41,"pool_name":"cephfs_data","create_time":"2019-11-28T12:02:43.256218+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"246","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":244,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":244,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T12:02:44.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.952+0000 7f0e3e3b3700 1 -- 172.21.15.80:0/3158926323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0e1c018730 msgr2=0x7f0e1c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.952+0000 7f0e3e3b3700 1 --2- 172.21.15.80:0/3158926323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0e1c018730 0x7f0e1c01abc0 crc :-1 s=READY pgs=1303 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:44.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.952+0000 7f0e3e3b3700 1 -- 172.21.15.80:0/3158926323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e38109e40 msgr2=0x7f0e3810a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:44.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.952+0000 7f0e3e3b3700 1 --2- 172.21.15.80:0/3158926323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e38109e40 0x7f0e3810a2d0 secure :-1 s=READY pgs=3145 cs=0 l=1 rx=0x7f0e280547f0 tx=0x7f0e28054670).stop 2019-11-28T12:02:44.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.952+0000 7f0e3e3b3700 1 -- 172.21.15.80:0/3158926323 shutdown_connections 2019-11-28T12:02:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.952+0000 7f0e3e3b3700 1 --2- 172.21.15.80:0/3158926323 >> v2:172.21.15.174:3300/0 conn(0x7f0e3810a810 0x7f0e38105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.952+0000 7f0e3e3b3700 1 --2- 172.21.15.80:0/3158926323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e38109e40 0x7f0e3810a2d0 unknown :-1 s=CLOSED pgs=3145 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.952+0000 7f0e3e3b3700 1 --2- 172.21.15.80:0/3158926323 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f0e1c018730 0x7f0e1c01abc0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.952+0000 7f0e3e3b3700 1 -- 172.21.15.80:0/3158926323 shutdown_connections 2019-11-28T12:02:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.952+0000 7f0e3e3b3700 1 -- 172.21.15.80:0/3158926323 wait complete. 2019-11-28T12:02:44.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:44.952+0000 7f0e3e3b3700 1 -- 172.21.15.80:0/3158926323 >> 172.21.15.80:0/3158926323 conn(0x7f0e3811bfc0 msgr2=0x7f0e38141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:44.956 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-11-28T12:02:45.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.087+0000 7f83348f8700 1 Processor -- start 2019-11-28T12:02:45.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.087+0000 7f83348f8700 1 -- start start 2019-11-28T12:02:45.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.088+0000 7f83348f8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f833015ed10 0x7f833015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:45.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.088+0000 7f83348f8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83300734b0 0x7f83300726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:45.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.088+0000 7f83348f8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833006db60 con 0x7f8330073020 2019-11-28T12:02:45.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.088+0000 7f83348f8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833006f3d0 con 0x7f83300734b0 2019-11-28T12:02:45.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.088+0000 7f83348f8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833006fe00 con 0x7f833015ed10 2019-11-28T12:02:45.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.088+0000 7f832f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83300734b0 0x7f83300726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:45.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.088+0000 7f832f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83300734b0 0x7f83300726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48566/0 (socket says 172.21.15.80:48566) 2019-11-28T12:02:45.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.088+0000 7f832ed9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f833015ed10 0x7f833015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:45.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.088+0000 7f832f59e700 1 -- 172.21.15.80:0/2650553877 learned_addr learned my addr 172.21.15.80:0/2650553877 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:45.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.088+0000 7f832e59c700 1 --1- 172.21.15.80:0/2650553877 >> v1:172.21.15.174:6789/0 conn(0x7f8330073020 0x7f8330071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:35196/0 (socket says 172.21.15.80:35196) 2019-11-28T12:02:45.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.089+0000 7f832f59e700 1 -- 172.21.15.80:0/2650553877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f833015ed10 msgr2=0x7f833015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:45.089 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.089+0000 7f832f59e700 1 --2- 172.21.15.80:0/2650553877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f833015ed10 0x7f833015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:45.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.089+0000 7f832f59e700 1 -- 172.21.15.80:0/2650553877 >> v1:172.21.15.174:6789/0 conn(0x7f8330073020 legacy=0x7f8330071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:45.090 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.089+0000 7f832dd9b700 1 -- 172.21.15.80:0/2650553877 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547227900 0 0) 0x7f8318001070 con 0x7f8330073020 2019-11-28T12:02:45.091 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.089+0000 7f832f59e700 1 -- 172.21.15.80:0/2650553877 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8330070760 con 0x7f83300734b0 2019-11-28T12:02:45.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.089+0000 7f832f59e700 1 --2- 172.21.15.80:0/2650553877 >> v2:172.21.15.80:3300/0 conn(0x7f83300734b0 0x7f83300726a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f832800f6b0 tx=0x7f832800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:45.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.089+0000 7f832f59e700 1 --2- 172.21.15.80:0/2650553877 >> v2:172.21.15.80:3300/0 conn(0x7f83300734b0 0x7f83300726a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f832800f6b0 tx=0x7f832800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:45.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.089+0000 7f832f59e700 1 --2- 172.21.15.80:0/2650553877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83300734b0 0x7f83300726a0 secure :-1 s=READY pgs=3146 cs=0 l=1 rx=0x7f832800f6b0 tx=0x7f832800fa50).ready entity=mon.0 client_cookie=580f18222db80266 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:45.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.089+0000 7f832f59e700 1 --2- 172.21.15.80:0/2650553877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83300734b0 0x7f83300726a0 secure :-1 s=THROTTLE_DONE pgs=3146 cs=0 l=1 rx=0x7f832800f6b0 tx=0x7f832800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:45.094 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.089+0000 7f832dd9b700 1 -- 172.21.15.80:0/2650553877 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8328000a70 con 0x7f83300734b0 2019-11-28T12:02:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.089+0000 7f832f59e700 1 --2- 172.21.15.80:0/2650553877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83300734b0 0x7f83300726a0 secure :-1 s=THROTTLE_DONE pgs=3146 cs=0 l=1 rx=0x7f832800f6b0 tx=0x7f832800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.089+0000 7f832f59e700 1 --2- 172.21.15.80:0/2650553877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83300734b0 0x7f83300726a0 secure :-1 s=THROTTLE_DONE pgs=3146 cs=0 l=1 rx=0x7f832800f6b0 tx=0x7f832800fa50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.089+0000 7f832dd9b700 1 -- 172.21.15.80:0/2650553877 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83280010e0 con 0x7f83300734b0 2019-11-28T12:02:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.089+0000 7f832dd9b700 1 -- 172.21.15.80:0/2650553877 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83280017b0 con 0x7f83300734b0 2019-11-28T12:02:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.089+0000 7f83348f8700 1 -- 172.21.15.80:0/2650553877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83300734b0 msgr2=0x7f83300726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.089+0000 7f83348f8700 1 --2- 172.21.15.80:0/2650553877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83300734b0 0x7f83300726a0 secure :-1 s=READY pgs=3146 cs=0 l=1 rx=0x7f832800f6b0 tx=0x7f832800fa50).stop 2019-11-28T12:02:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.090+0000 7f83348f8700 1 -- 172.21.15.80:0/2650553877 shutdown_connections 2019-11-28T12:02:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.090+0000 7f83348f8700 1 --2- 172.21.15.80:0/2650553877 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83300734b0 0x7f83300726a0 unknown :-1 s=CLOSED pgs=3146 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:45.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.090+0000 7f83348f8700 1 --2- 172.21.15.80:0/2650553877 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f833015ed10 0x7f833015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:45.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.090+0000 7f83348f8700 1 -- 172.21.15.80:0/2650553877 shutdown_connections 2019-11-28T12:02:45.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.090+0000 7f83348f8700 1 -- 172.21.15.80:0/2650553877 wait complete. 2019-11-28T12:02:45.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.090+0000 7f83348f8700 1 -- 172.21.15.80:0/2650553877 >> 172.21.15.80:0/2650553877 conn(0x7f8330061d20 msgr2=0x7f83300641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:45.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.092+0000 7f83348f8700 1 Processor -- start 2019-11-28T12:02:45.097 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.092+0000 7f83348f8700 1 -- start start 2019-11-28T12:02:45.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.093+0000 7f83348f8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f833010e970 0x7f83301087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:45.102 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.093+0000 7f83348f8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8330107e30 0x7f8330167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:45.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.093+0000 7f83348f8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833010c250 con 0x7f8330108cf0 2019-11-28T12:02:45.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.093+0000 7f83348f8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833010da00 con 0x7f8330107e30 2019-11-28T12:02:45.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.093+0000 7f83348f8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833010e430 con 0x7f833010e970 2019-11-28T12:02:45.103 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.093+0000 7f832f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8330107e30 0x7f8330167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:45.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.093+0000 7f832f59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8330107e30 0x7f8330167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48572/0 (socket says 172.21.15.80:48572) 2019-11-28T12:02:45.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.093+0000 7f832f59e700 1 -- 172.21.15.80:0/435216018 learned_addr learned my addr 172.21.15.80:0/435216018 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:45.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.093+0000 7f832ed9d700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f833010e970 0x7f83301087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:45.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.093+0000 7f832f59e700 1 -- 172.21.15.80:0/435216018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f833010e970 msgr2=0x7f83301087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:45.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.093+0000 7f832f59e700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f833010e970 0x7f83301087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:45.104 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.093+0000 7f832f59e700 1 -- 172.21.15.80:0/435216018 >> v1:172.21.15.174:6789/0 conn(0x7f8330108cf0 legacy=0x7f8330107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:45.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.093+0000 7f832f59e700 1 -- 172.21.15.80:0/435216018 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8330105ef0 con 0x7f8330107e30 2019-11-28T12:02:45.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.093+0000 7f832f59e700 1 --2- 172.21.15.80:0/435216018 >> v2:172.21.15.80:3300/0 conn(0x7f8330107e30 0x7f8330167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8328010450 tx=0x7f83280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:45.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.094+0000 7f832f59e700 1 --2- 172.21.15.80:0/435216018 >> v2:172.21.15.80:3300/0 conn(0x7f8330107e30 0x7f8330167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8328010450 tx=0x7f83280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:45.105 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.094+0000 7f832f59e700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8330107e30 0x7f8330167d70 secure :-1 s=READY pgs=3147 cs=0 l=1 rx=0x7f8328010450 tx=0x7f83280102d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:45.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.094+0000 7f832f59e700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8330107e30 0x7f8330167d70 secure :-1 s=THROTTLE_DONE pgs=3147 cs=0 l=1 rx=0x7f8328010450 tx=0x7f83280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:45.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.094+0000 7f832f59e700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8330107e30 0x7f8330167d70 secure :-1 s=THROTTLE_DONE pgs=3147 cs=0 l=1 rx=0x7f8328010450 tx=0x7f83280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:45.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.094+0000 7f832f59e700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8330107e30 0x7f8330167d70 secure :-1 s=THROTTLE_DONE pgs=3147 cs=0 l=1 rx=0x7f8328010450 tx=0x7f83280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:45.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.094+0000 7f83277fe700 1 -- 172.21.15.80:0/435216018 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8328001590 con 0x7f8330107e30 2019-11-28T12:02:45.106 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.094+0000 7f83277fe700 1 -- 172.21.15.80:0/435216018 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83280011b0 con 0x7f8330107e30 2019-11-28T12:02:45.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.094+0000 7f83348f8700 1 -- 172.21.15.80:0/435216018 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8330106270 con 0x7f8330107e30 2019-11-28T12:02:45.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.094+0000 7f83277fe700 1 -- 172.21.15.80:0/435216018 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8328001b70 con 0x7f8330107e30 2019-11-28T12:02:45.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.094+0000 7f83348f8700 1 -- 172.21.15.80:0/435216018 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8330105ef0 con 0x7f8330107e30 2019-11-28T12:02:45.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.094+0000 7f832f59e700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8330107e30 0x7f8330167d70 secure :-1 s=THROTTLE_DONE pgs=3147 cs=0 l=1 rx=0x7f8328010450 tx=0x7f83280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:45.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.094+0000 7f83277fe700 1 -- 172.21.15.80:0/435216018 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f83280013a0 con 0x7f8330107e30 2019-11-28T12:02:45.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.094+0000 7f832f59e700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8330107e30 0x7f8330167d70 secure :-1 s=THROTTLE_DONE pgs=3147 cs=0 l=1 rx=0x7f8328010450 tx=0x7f83280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:45.107 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.094+0000 7f83277fe700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8308018730 0x7f830801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:45.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.094+0000 7f83277fe700 1 -- 172.21.15.80:0/435216018 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(246..246 src has 1..246) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8328031a90 con 0x7f8330107e30 2019-11-28T12:02:45.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.095+0000 7f832ed9d700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8308018730 0x7f830801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:45.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.095+0000 7f832ed9d700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8308018730 0x7f830801abc0 crc :-1 s=READY pgs=1304 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:45.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.102+0000 7f83348f8700 1 -- 172.21.15.80:0/435216018 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8330106270 con 0x7f8330107e30 2019-11-28T12:02:45.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.106+0000 7f832f59e700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8330107e30 0x7f8330167d70 secure :-1 s=THROTTLE_DONE pgs=3147 cs=0 l=1 rx=0x7f8328010450 tx=0x7f83280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:45.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.106+0000 7f83277fe700 1 -- 172.21.15.80:0/435216018 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f832802dff0 con 0x7f8330107e30 2019-11-28T12:02:45.274 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:45.281+0000 7f83348f8700 1 -- 172.21.15.80:0/435216018 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f8330105ef0 con 0x7f8330107e30 2019-11-28T12:02:46.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.244+0000 7f832f59e700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8330107e30 0x7f8330167d70 secure :-1 s=THROTTLE_DONE pgs=3147 cs=0 l=1 rx=0x7f8328010450 tx=0x7f83280102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.237 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.244+0000 7f83277fe700 1 -- 172.21.15.80:0/435216018 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v206) v1 ==== 118+0+0 (secure 0 0 0) 0x7f832802dff0 con 0x7f8330107e30 2019-11-28T12:02:46.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.250+0000 7f83348f8700 1 -- 172.21.15.80:0/435216018 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8308018730 msgr2=0x7f830801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:46.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.250+0000 7f83348f8700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8308018730 0x7f830801abc0 crc :-1 s=READY pgs=1304 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.250+0000 7f83348f8700 1 -- 172.21.15.80:0/435216018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8330107e30 msgr2=0x7f8330167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:46.243 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.250+0000 7f83348f8700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8330107e30 0x7f8330167d70 secure :-1 s=READY pgs=3147 cs=0 l=1 rx=0x7f8328010450 tx=0x7f83280102d0).stop 2019-11-28T12:02:46.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.250+0000 7f83348f8700 1 -- 172.21.15.80:0/435216018 shutdown_connections 2019-11-28T12:02:46.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.250+0000 7f83348f8700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8330107e30 0x7f8330167d70 unknown :-1 s=CLOSED pgs=3147 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.250+0000 7f83348f8700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8308018730 0x7f830801abc0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.250+0000 7f83348f8700 1 --2- 172.21.15.80:0/435216018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f833010e970 0x7f83301087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.244 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.250+0000 7f83348f8700 1 -- 172.21.15.80:0/435216018 shutdown_connections 2019-11-28T12:02:46.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.250+0000 7f83348f8700 1 -- 172.21.15.80:0/435216018 wait complete. 2019-11-28T12:02:46.245 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.250+0000 7f83348f8700 1 -- 172.21.15.80:0/435216018 >> 172.21.15.80:0/435216018 conn(0x7f833015e2d0 msgr2=0x7f8330147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:46.254 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:46.392 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.394+0000 7f3a21026700 1 Processor -- start 2019-11-28T12:02:46.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.394+0000 7f3a21026700 1 -- start start 2019-11-28T12:02:46.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.395+0000 7f3a21026700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c06c0a0 0x7f3a1c072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:46.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.395+0000 7f3a21026700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3a1c072620 0x7f3a1c164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:46.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.395+0000 7f3a21026700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1c06db00 con 0x7f3a1c0734e0 2019-11-28T12:02:46.393 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.395+0000 7f3a21026700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1c06f330 con 0x7f3a1c072620 2019-11-28T12:02:46.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.395+0000 7f3a21026700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0706c0 con 0x7f3a1c06c0a0 2019-11-28T12:02:46.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.395+0000 7f3a20825700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3a1c072620 0x7f3a1c164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:46.394 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.395+0000 7f3a1b59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c06c0a0 0x7f3a1c072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:46.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.395+0000 7f3a20825700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3a1c072620 0x7f3a1c164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:35232/0 (socket says 172.21.15.80:35232) 2019-11-28T12:02:46.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.395+0000 7f3a1ad9d700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f3a1c0734e0 0x7f3a1c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:35208/0 (socket says 172.21.15.80:35208) 2019-11-28T12:02:46.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.395+0000 7f3a1b59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c06c0a0 0x7f3a1c072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:50838/0 (socket says 172.21.15.80:50838) 2019-11-28T12:02:46.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.395+0000 7f3a20825700 1 -- 172.21.15.80:0/3006515540 learned_addr learned my addr 172.21.15.80:0/3006515540 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:46.395 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.396+0000 7f3a20825700 1 -- 172.21.15.80:0/3006515540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c06c0a0 msgr2=0x7f3a1c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:46.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.396+0000 7f3a20825700 1 --2- 172.21.15.80:0/3006515540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c06c0a0 0x7f3a1c072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:46.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.396+0000 7f3a20825700 1 -- 172.21.15.80:0/3006515540 >> v1:172.21.15.174:6789/0 conn(0x7f3a1c0734e0 legacy=0x7f3a1c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:46.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.396+0000 7f3a20825700 1 -- 172.21.15.80:0/3006515540 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c070a40 con 0x7f3a1c072620 2019-11-28T12:02:46.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.396+0000 7f3a1b59e700 1 --2- 172.21.15.80:0/3006515540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c06c0a0 0x7f3a1c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:46.396 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.396+0000 7f3a20825700 1 --2- 172.21.15.80:0/3006515540 >> v2:172.21.15.174:3300/0 conn(0x7f3a1c072620 0x7f3a1c164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3a1400f760 tx=0x7f3a1400fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.396+0000 7f3a20825700 1 --2- 172.21.15.80:0/3006515540 >> v2:172.21.15.174:3300/0 conn(0x7f3a1c072620 0x7f3a1c164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3a1400f760 tx=0x7f3a1400fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.396+0000 7f3a20825700 1 --2- 172.21.15.80:0/3006515540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a1c072620 0x7f3a1c164d70 secure :-1 s=READY pgs=1912 cs=0 l=1 rx=0x7f3a1400f760 tx=0x7f3a1400fb00).ready entity=mon.1 client_cookie=a6ee83fcce7f14e8 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:46.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.396+0000 7f3a20825700 1 --2- 172.21.15.80:0/3006515540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a1c072620 0x7f3a1c164d70 secure :-1 s=THROTTLE_DONE pgs=1912 cs=0 l=1 rx=0x7f3a1400f760 tx=0x7f3a1400fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.396+0000 7f3a20825700 1 --2- 172.21.15.80:0/3006515540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a1c072620 0x7f3a1c164d70 secure :-1 s=THROTTLE_DONE pgs=1912 cs=0 l=1 rx=0x7f3a1400f760 tx=0x7f3a1400fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.397 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.396+0000 7f3a1a59c700 1 -- 172.21.15.80:0/3006515540 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a14000a70 con 0x7f3a1c072620 2019-11-28T12:02:46.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.396+0000 7f3a20825700 1 --2- 172.21.15.80:0/3006515540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a1c072620 0x7f3a1c164d70 secure :-1 s=THROTTLE_DONE pgs=1912 cs=0 l=1 rx=0x7f3a1400f760 tx=0x7f3a1400fb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.396+0000 7f3a1a59c700 1 -- 172.21.15.80:0/3006515540 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a14000e70 con 0x7f3a1c072620 2019-11-28T12:02:46.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.396+0000 7f3a1a59c700 1 -- 172.21.15.80:0/3006515540 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a14001500 con 0x7f3a1c072620 2019-11-28T12:02:46.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.396+0000 7f3a21026700 1 -- 172.21.15.80:0/3006515540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a1c072620 msgr2=0x7f3a1c164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:46.398 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.396+0000 7f3a21026700 1 --2- 172.21.15.80:0/3006515540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a1c072620 0x7f3a1c164d70 secure :-1 s=READY pgs=1912 cs=0 l=1 rx=0x7f3a1400f760 tx=0x7f3a1400fb00).stop 2019-11-28T12:02:46.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.397+0000 7f3a21026700 1 -- 172.21.15.80:0/3006515540 shutdown_connections 2019-11-28T12:02:46.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.397+0000 7f3a21026700 1 --2- 172.21.15.80:0/3006515540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a1c072620 0x7f3a1c164d70 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.397+0000 7f3a21026700 1 --2- 172.21.15.80:0/3006515540 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c06c0a0 0x7f3a1c072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:46.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.397+0000 7f3a21026700 1 -- 172.21.15.80:0/3006515540 shutdown_connections 2019-11-28T12:02:46.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.397+0000 7f3a21026700 1 -- 172.21.15.80:0/3006515540 wait complete. 2019-11-28T12:02:46.399 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.397+0000 7f3a21026700 1 -- 172.21.15.80:0/3006515540 >> 172.21.15.80:0/3006515540 conn(0x7f3a1c061cf0 msgr2=0x7f3a1c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:46.400 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.399+0000 7f3a21026700 1 Processor -- start 2019-11-28T12:02:46.403 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.400+0000 7f3a21026700 1 -- start start 2019-11-28T12:02:46.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a21026700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a1c104820 0x7f3a1c10c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:46.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a21026700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c10c890 0x7f3a1c10b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:46.404 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a21026700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1c13bcd0 con 0x7f3a1c10b710 2019-11-28T12:02:46.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a21026700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1c109130 con 0x7f3a1c104820 2019-11-28T12:02:46.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a21026700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c109400 con 0x7f3a1c10c890 2019-11-28T12:02:46.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a1b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a1c104820 0x7f3a1c10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:46.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a1b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a1c104820 0x7f3a1c10c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48582/0 (socket says 172.21.15.80:48582) 2019-11-28T12:02:46.405 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a1ad9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c10c890 0x7f3a1c10b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:46.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a1b59e700 1 -- 172.21.15.80:0/4240025578 learned_addr learned my addr 172.21.15.80:0/4240025578 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:46.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a1ad9d700 1 -- 172.21.15.80:0/4240025578 >> v2:172.21.15.80:3300/0 conn(0x7f3a1c104820 msgr2=0x7f3a1c10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:46.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a1ad9d700 1 --2- 172.21.15.80:0/4240025578 >> v2:172.21.15.80:3300/0 conn(0x7f3a1c104820 0x7f3a1c10c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a1ad9d700 1 -- 172.21.15.80:0/4240025578 >> v1:172.21.15.80:6789/0 conn(0x7f3a1c10b710 legacy=0x7f3a1c104c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:46.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a1ad9d700 1 -- 172.21.15.80:0/4240025578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c109a90 con 0x7f3a1c10c890 2019-11-28T12:02:46.406 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a1b59e700 1 --2- 172.21.15.80:0/4240025578 >> v2:172.21.15.80:3300/0 conn(0x7f3a1c104820 0x7f3a1c10c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:46.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a1ad9d700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c10c890 0x7f3a1c10b1d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a04010330 tx=0x7f3a040106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a1ad9d700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c10c890 0x7f3a1c10b1d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a04010330 tx=0x7f3a040106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a1ad9d700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c10c890 0x7f3a1c10b1d0 secure :-1 s=READY pgs=455 cs=0 l=1 rx=0x7f3a04010330 tx=0x7f3a040106d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:46.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a1ad9d700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c10c890 0x7f3a1c10b1d0 secure :-1 s=THROTTLE_DONE pgs=455 cs=0 l=1 rx=0x7f3a04010330 tx=0x7f3a040106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a1ad9d700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c10c890 0x7f3a1c10b1d0 secure :-1 s=THROTTLE_DONE pgs=455 cs=0 l=1 rx=0x7f3a04010330 tx=0x7f3a040106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.407 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a13fff700 1 -- 172.21.15.80:0/4240025578 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a04000960 con 0x7f3a1c10c890 2019-11-28T12:02:46.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a1ad9d700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c10c890 0x7f3a1c10b1d0 secure :-1 s=THROTTLE_DONE pgs=455 cs=0 l=1 rx=0x7f3a04010330 tx=0x7f3a040106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a13fff700 1 -- 172.21.15.80:0/4240025578 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a04003fe0 con 0x7f3a1c10c890 2019-11-28T12:02:46.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a21026700 1 -- 172.21.15.80:0/4240025578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c109e10 con 0x7f3a1c10c890 2019-11-28T12:02:46.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a13fff700 1 -- 172.21.15.80:0/4240025578 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a040046b0 con 0x7f3a1c10c890 2019-11-28T12:02:46.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.401+0000 7f3a21026700 1 -- 172.21.15.80:0/4240025578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c109a90 con 0x7f3a1c10c890 2019-11-28T12:02:46.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.402+0000 7f3a1ad9d700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c10c890 0x7f3a1c10b1d0 secure :-1 s=THROTTLE_DONE pgs=455 cs=0 l=1 rx=0x7f3a04010330 tx=0x7f3a040106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.402+0000 7f3a13fff700 1 -- 172.21.15.80:0/4240025578 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3a04000e10 con 0x7f3a1c10c890 2019-11-28T12:02:46.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.402+0000 7f3a1ad9d700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c10c890 0x7f3a1c10b1d0 secure :-1 s=THROTTLE_DONE pgs=455 cs=0 l=1 rx=0x7f3a04010330 tx=0x7f3a040106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.402+0000 7f3a13fff700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a00018730 0x7f3a0001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:46.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.402+0000 7f3a13fff700 1 -- 172.21.15.80:0/4240025578 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3a040319e0 con 0x7f3a1c10c890 2019-11-28T12:02:46.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.402+0000 7f3a1b59e700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a00018730 0x7f3a0001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:46.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.403+0000 7f3a1b59e700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a00018730 0x7f3a0001abc0 crc :-1 s=READY pgs=1305 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:46.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.410+0000 7f3a21026700 1 -- 172.21.15.80:0/4240025578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c109e10 con 0x7f3a1c10c890 2019-11-28T12:02:46.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.414+0000 7f3a1ad9d700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c10c890 0x7f3a1c10b1d0 secure :-1 s=THROTTLE_DONE pgs=455 cs=0 l=1 rx=0x7f3a04010330 tx=0x7f3a040106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.414+0000 7f3a13fff700 1 -- 172.21.15.80:0/4240025578 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3a04025f00 con 0x7f3a1c10c890 2019-11-28T12:02:46.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.586+0000 7f3a21026700 1 -- 172.21.15.80:0/4240025578 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a1c109a90 con 0x7f3a1c10c890 2019-11-28T12:02:46.580 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.587+0000 7f3a1ad9d700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c10c890 0x7f3a1c10b1d0 secure :-1 s=THROTTLE_DONE pgs=455 cs=0 l=1 rx=0x7f3a04010330 tx=0x7f3a040106d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.581 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.587+0000 7f3a13fff700 1 -- 172.21.15.80:0/4240025578 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 206 v206) v1 ==== 95+0+1428 (secure 0 0 0) 0x7f3a04025f00 con 0x7f3a1c10c890 2019-11-28T12:02:46.581 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 206 2019-11-28T12:02:46.581 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:46.581 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":206,"default_fscid":20,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":206,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:02:44.233571+0000","modified":"2019-11-28T12:02:46.243268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[41],"metadata_pool":40,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":20}]} 2019-11-28T12:02:46.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.589+0000 7f3a21026700 1 -- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a00018730 msgr2=0x7f3a0001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:46.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.589+0000 7f3a21026700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a00018730 0x7f3a0001abc0 crc :-1 s=READY pgs=1305 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.589+0000 7f3a21026700 1 -- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c10c890 msgr2=0x7f3a1c10b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:46.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.589+0000 7f3a21026700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c10c890 0x7f3a1c10b1d0 secure :-1 s=READY pgs=455 cs=0 l=1 rx=0x7f3a04010330 tx=0x7f3a040106d0).stop 2019-11-28T12:02:46.583 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.589+0000 7f3a21026700 1 -- 172.21.15.80:0/4240025578 shutdown_connections 2019-11-28T12:02:46.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.589+0000 7f3a21026700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3a00018730 0x7f3a0001abc0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.589+0000 7f3a21026700 1 --2- 172.21.15.80:0/4240025578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a1c10c890 0x7f3a1c10b1d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.589+0000 7f3a21026700 1 --2- 172.21.15.80:0/4240025578 >> v2:172.21.15.80:3300/0 conn(0x7f3a1c104820 0x7f3a1c10c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.589+0000 7f3a21026700 1 -- 172.21.15.80:0/4240025578 shutdown_connections 2019-11-28T12:02:46.584 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.589+0000 7f3a21026700 1 -- 172.21.15.80:0/4240025578 wait complete. 2019-11-28T12:02:46.585 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.590+0000 7f3a21026700 1 -- 172.21.15.80:0/4240025578 >> 172.21.15.80:0/4240025578 conn(0x7f3a1c13d620 msgr2=0x7f3a1c13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:46.593 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T12:02:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.719+0000 7f4f5fadd700 1 Processor -- start 2019-11-28T12:02:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.719+0000 7f4f5fadd700 1 -- start start 2019-11-28T12:02:46.717 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.720+0000 7f4f5fadd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5806c0a0 0x7f4f58072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.720+0000 7f4f5fadd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4f580734e0 0x7f4f58071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.721+0000 7f4f5fadd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5806db00 con 0x7f4f58072360 2019-11-28T12:02:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.721+0000 7f4f5fadd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5806f330 con 0x7f4f580734e0 2019-11-28T12:02:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.721+0000 7f4f5fadd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f580706c0 con 0x7f4f5806c0a0 2019-11-28T12:02:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.721+0000 7f4f5e07a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5806c0a0 0x7f4f58072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:46.718 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.721+0000 7f4f5d879700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4f580734e0 0x7f4f58071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.721+0000 7f4f5e87b700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f4f58072360 0x7f4f5806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:35220/0 (socket says 172.21.15.80:35220) 2019-11-28T12:02:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.721+0000 7f4f5e87b700 1 -- 172.21.15.80:0/3475644411 learned_addr learned my addr 172.21.15.80:0/3475644411 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.721+0000 7f4f5e07a700 1 -- 172.21.15.80:0/3475644411 >> v2:172.21.15.174:3300/0 conn(0x7f4f580734e0 msgr2=0x7f4f58071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.721+0000 7f4f5e07a700 1 --2- 172.21.15.80:0/3475644411 >> v2:172.21.15.174:3300/0 conn(0x7f4f580734e0 0x7f4f58071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.721+0000 7f4f5e07a700 1 -- 172.21.15.80:0/3475644411 >> v1:172.21.15.174:6789/0 conn(0x7f4f58072360 legacy=0x7f4f5806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.721+0000 7f4f5e07a700 1 -- 172.21.15.80:0/3475644411 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f58070a40 con 0x7f4f5806c0a0 2019-11-28T12:02:46.719 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.721+0000 7f4f5d879700 1 --2- 172.21.15.80:0/3475644411 >> v2:172.21.15.174:3300/0 conn(0x7f4f580734e0 0x7f4f58071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:46.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.721+0000 7f4f5e07a700 1 --2- 172.21.15.80:0/3475644411 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5806c0a0 0x7f4f58072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4f4800af50 tx=0x7f4f4800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.721+0000 7f4f5e07a700 1 --2- 172.21.15.80:0/3475644411 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5806c0a0 0x7f4f58072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4f4800af50 tx=0x7f4f4800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.721+0000 7f4f5e07a700 1 --2- 172.21.15.80:0/3475644411 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5806c0a0 0x7f4f58072fa0 secure :-1 s=READY pgs=456 cs=0 l=1 rx=0x7f4f4800af50 tx=0x7f4f4800b760).ready entity=mon.2 client_cookie=7c5b7170bd7d6578 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:46.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.722+0000 7f4f5e07a700 1 --2- 172.21.15.80:0/3475644411 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5806c0a0 0x7f4f58072fa0 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7f4f4800af50 tx=0x7f4f4800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.722+0000 7f4f5e07a700 1 --2- 172.21.15.80:0/3475644411 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5806c0a0 0x7f4f58072fa0 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7f4f4800af50 tx=0x7f4f4800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.722+0000 7f4f5d078700 1 -- 172.21.15.80:0/3475644411 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f48007210 con 0x7f4f5806c0a0 2019-11-28T12:02:46.720 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.722+0000 7f4f5e07a700 1 --2- 172.21.15.80:0/3475644411 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5806c0a0 0x7f4f58072fa0 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7f4f4800af50 tx=0x7f4f4800b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.722+0000 7f4f5d078700 1 -- 172.21.15.80:0/3475644411 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f480099b0 con 0x7f4f5806c0a0 2019-11-28T12:02:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.722+0000 7f4f5d078700 1 -- 172.21.15.80:0/3475644411 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f4800a080 con 0x7f4f5806c0a0 2019-11-28T12:02:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.722+0000 7f4f5fadd700 1 -- 172.21.15.80:0/3475644411 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5806c0a0 msgr2=0x7f4f58072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.722+0000 7f4f5fadd700 1 --2- 172.21.15.80:0/3475644411 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5806c0a0 0x7f4f58072fa0 secure :-1 s=READY pgs=456 cs=0 l=1 rx=0x7f4f4800af50 tx=0x7f4f4800b760).stop 2019-11-28T12:02:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.722+0000 7f4f5fadd700 1 -- 172.21.15.80:0/3475644411 shutdown_connections 2019-11-28T12:02:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.722+0000 7f4f5fadd700 1 --2- 172.21.15.80:0/3475644411 >> v2:172.21.15.174:3300/0 conn(0x7f4f580734e0 0x7f4f58071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:46.721 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.722+0000 7f4f5fadd700 1 --2- 172.21.15.80:0/3475644411 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5806c0a0 0x7f4f58072fa0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.722+0000 7f4f5fadd700 1 -- 172.21.15.80:0/3475644411 shutdown_connections 2019-11-28T12:02:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.722+0000 7f4f5fadd700 1 -- 172.21.15.80:0/3475644411 wait complete. 2019-11-28T12:02:46.722 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.722+0000 7f4f5fadd700 1 -- 172.21.15.80:0/3475644411 >> 172.21.15.80:0/3475644411 conn(0x7f4f58061cf0 msgr2=0x7f4f58064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:46.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.725+0000 7f4f5fadd700 1 Processor -- start 2019-11-28T12:02:46.725 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.725+0000 7f4f5fadd700 1 -- start start 2019-11-28T12:02:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5fadd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5810ab00 0x7f4f5810bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5fadd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4f5810c500 0x7f4f5812e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5fadd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4f5812e590 0x7f4f5812e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5fadd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5815a2f0 con 0x7f4f5810c500 2019-11-28T12:02:46.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5fadd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5815ad20 con 0x7f4f5812e590 2019-11-28T12:02:46.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5fadd700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f58115050 con 0x7f4f5810ab00 2019-11-28T12:02:46.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5d879700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4f5810c500 0x7f4f5812e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:46.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5e07a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5810ab00 0x7f4f5810bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:46.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5d879700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4f5810c500 0x7f4f5812e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48598/0 (socket says 172.21.15.80:48598) 2019-11-28T12:02:46.727 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5d879700 1 -- 172.21.15.80:0/79804259 learned_addr learned my addr 172.21.15.80:0/79804259 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:46.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5e87b700 1 --2- 172.21.15.80:0/79804259 >> v2:172.21.15.174:3300/0 conn(0x7f4f5812e590 0x7f4f5812e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:46.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5d879700 1 -- 172.21.15.80:0/79804259 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5810ab00 msgr2=0x7f4f5810bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:46.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5d879700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5810ab00 0x7f4f5810bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5d879700 1 -- 172.21.15.80:0/79804259 >> v2:172.21.15.174:3300/0 conn(0x7f4f5812e590 msgr2=0x7f4f5812e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:46.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5d879700 1 --2- 172.21.15.80:0/79804259 >> v2:172.21.15.174:3300/0 conn(0x7f4f5812e590 0x7f4f5812e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.728 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5d879700 1 -- 172.21.15.80:0/79804259 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5815b680 con 0x7f4f5810c500 2019-11-28T12:02:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5e07a700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5810ab00 0x7f4f5810bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5d879700 1 --2- 172.21.15.80:0/79804259 >> v2:172.21.15.80:3300/0 conn(0x7f4f5810c500 0x7f4f5812e050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f40010790 tx=0x7f4f40010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5d879700 1 --2- 172.21.15.80:0/79804259 >> v2:172.21.15.80:3300/0 conn(0x7f4f5810c500 0x7f4f5812e050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f40010790 tx=0x7f4f40010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5d879700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5810c500 0x7f4f5812e050 secure :-1 s=READY pgs=3149 cs=0 l=1 rx=0x7f4f40010790 tx=0x7f4f40010690).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5d879700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5810c500 0x7f4f5812e050 secure :-1 s=THROTTLE_DONE pgs=3149 cs=0 l=1 rx=0x7f4f40010790 tx=0x7f4f40010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5d879700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5810c500 0x7f4f5812e050 secure :-1 s=THROTTLE_DONE pgs=3149 cs=0 l=1 rx=0x7f4f40010790 tx=0x7f4f40010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f56ffd700 1 -- 172.21.15.80:0/79804259 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f4000ac40 con 0x7f4f5810c500 2019-11-28T12:02:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f5d879700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5810c500 0x7f4f5812e050 secure :-1 s=THROTTLE_DONE pgs=3149 cs=0 l=1 rx=0x7f4f40010790 tx=0x7f4f40010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.726+0000 7f4f56ffd700 1 -- 172.21.15.80:0/79804259 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4000dec0 con 0x7f4f5810c500 2019-11-28T12:02:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.727+0000 7f4f5fadd700 1 -- 172.21.15.80:0/79804259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5815ba00 con 0x7f4f5810c500 2019-11-28T12:02:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.727+0000 7f4f56ffd700 1 -- 172.21.15.80:0/79804259 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f4000e510 con 0x7f4f5810c500 2019-11-28T12:02:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.727+0000 7f4f5fadd700 1 -- 172.21.15.80:0/79804259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5815b680 con 0x7f4f5810c500 2019-11-28T12:02:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.727+0000 7f4f5d879700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5810c500 0x7f4f5812e050 secure :-1 s=THROTTLE_DONE pgs=3149 cs=0 l=1 rx=0x7f4f40010790 tx=0x7f4f40010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.727+0000 7f4f56ffd700 1 -- 172.21.15.80:0/79804259 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f4f40009900 con 0x7f4f5810c500 2019-11-28T12:02:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.727+0000 7f4f5d879700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5810c500 0x7f4f5812e050 secure :-1 s=THROTTLE_DONE pgs=3149 cs=0 l=1 rx=0x7f4f40010790 tx=0x7f4f40010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.727+0000 7f4f56ffd700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f3c018730 0x7f4f3c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:46.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.727+0000 7f4f56ffd700 1 -- 172.21.15.80:0/79804259 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4f40031d60 con 0x7f4f5810c500 2019-11-28T12:02:46.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.727+0000 7f4f5e07a700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f3c018730 0x7f4f3c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:46.731 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.728+0000 7f4f5e07a700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f3c018730 0x7f4f3c01abc0 crc :-1 s=READY pgs=1306 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:46.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.735+0000 7f4f5fadd700 1 -- 172.21.15.80:0/79804259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5815ba00 con 0x7f4f5810c500 2019-11-28T12:02:46.732 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.738+0000 7f4f5d879700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5810c500 0x7f4f5812e050 secure :-1 s=THROTTLE_DONE pgs=3149 cs=0 l=1 rx=0x7f4f40010790 tx=0x7f4f40010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.733 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.738+0000 7f4f56ffd700 1 -- 172.21.15.80:0/79804259 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f4f4000a930 con 0x7f4f5810c500 2019-11-28T12:02:46.908 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.915+0000 7f4f5fadd700 1 -- 172.21.15.80:0/79804259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f5815b680 con 0x7f4f5810c500 2019-11-28T12:02:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.916+0000 7f4f5d879700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5810c500 0x7f4f5812e050 secure :-1 s=THROTTLE_DONE pgs=3149 cs=0 l=1 rx=0x7f4f40010790 tx=0x7f4f40010690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:46.909 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.916+0000 7f4f56ffd700 1 -- 172.21.15.80:0/79804259 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v247) v1 ==== 74+0+14871 (secure 0 0 0) 0x7f4f40009900 con 0x7f4f5810c500 2019-11-28T12:02:46.910 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:46.910 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":247,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T12:02:45.235154+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":41,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":40,"pool_name":"cephfs_metadata","create_time":"2019-11-28T12:02:42.568808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"246","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":41,"pool_name":"cephfs_data","create_time":"2019-11-28T12:02:43.256218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"247","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":244,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":244,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T12:02:46.911 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.918+0000 7f4f5fadd700 1 -- 172.21.15.80:0/79804259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f3c018730 msgr2=0x7f4f3c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.918+0000 7f4f5fadd700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f3c018730 0x7f4f3c01abc0 crc :-1 s=READY pgs=1306 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.918+0000 7f4f5fadd700 1 -- 172.21.15.80:0/79804259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5810c500 msgr2=0x7f4f5812e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.918+0000 7f4f5fadd700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5810c500 0x7f4f5812e050 secure :-1 s=READY pgs=3149 cs=0 l=1 rx=0x7f4f40010790 tx=0x7f4f40010690).stop 2019-11-28T12:02:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.918+0000 7f4f5fadd700 1 -- 172.21.15.80:0/79804259 shutdown_connections 2019-11-28T12:02:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.918+0000 7f4f5fadd700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4f3c018730 0x7f4f3c01abc0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.912 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.918+0000 7f4f5fadd700 1 --2- 172.21.15.80:0/79804259 >> v2:172.21.15.174:3300/0 conn(0x7f4f5812e590 0x7f4f5812e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.918+0000 7f4f5fadd700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4f5810c500 0x7f4f5812e050 unknown :-1 s=CLOSED pgs=3149 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.918+0000 7f4f5fadd700 1 --2- 172.21.15.80:0/79804259 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f5810ab00 0x7f4f5810bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.918+0000 7f4f5fadd700 1 -- 172.21.15.80:0/79804259 shutdown_connections 2019-11-28T12:02:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.918+0000 7f4f5fadd700 1 -- 172.21.15.80:0/79804259 wait complete. 2019-11-28T12:02:46.913 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:46.919+0000 7f4f5fadd700 1 -- 172.21.15.80:0/79804259 >> 172.21.15.80:0/79804259 conn(0x7f4f5813d930 msgr2=0x7f4f58111550 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:46.922 INFO:tasks.ceph.mds.c:Restarting daemon 2019-11-28T12:02:46.923 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2019-11-28T12:02:46.923 INFO:tasks.ceph.mds.a:Restarting daemon 2019-11-28T12:02:46.923 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-11-28T12:02:46.924 INFO:tasks.ceph.mds.b:Restarting daemon 2019-11-28T12:02:46.924 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-11-28T12:02:46.928 INFO:tasks.ceph.mds.a:Started 2019-11-28T12:02:46.929 DEBUG:teuthology.parallel:result is None 2019-11-28T12:02:46.929 INFO:tasks.ceph.mds.b:Started 2019-11-28T12:02:46.930 DEBUG:teuthology.parallel:result is None 2019-11-28T12:02:46.930 INFO:tasks.ceph.mds.c:Started 2019-11-28T12:02:46.930 DEBUG:teuthology.parallel:result is None 2019-11-28T12:02:46.931 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T12:02:47.013 INFO:tasks.ceph.mds.c.smithi174.stdout:starting mds.c at 2019-11-28T12:02:47.020 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2019-11-28T12:02:47.020 INFO:tasks.ceph.mds.b.smithi080.stdout:starting mds.b at 2019-11-28T12:02:47.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.075+0000 7fbe07c1a700 1 Processor -- start 2019-11-28T12:02:47.072 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.075+0000 7fbe07c1a700 1 -- start start 2019-11-28T12:02:47.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe07c1a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbe001639f0 0x7fbe00165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:47.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe07c1a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0006db60 con 0x7fbe0015ed10 2019-11-28T12:02:47.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe07c1a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0006e060 con 0x7fbe0015f100 2019-11-28T12:02:47.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe07c1a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0006fe00 con 0x7fbe001639f0 2019-11-28T12:02:47.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe061b7700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbe0015ed10 0x7fbe00073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47944/0 (socket says 172.21.15.80:47944) 2019-11-28T12:02:47.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe061b7700 1 -- 172.21.15.80:0/1184728335 learned_addr learned my addr 172.21.15.80:0/1184728335 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:47.073 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe069b8700 1 --2- 172.21.15.80:0/1184728335 >> v2:172.21.15.174:3300/0 conn(0x7fbe001639f0 0x7fbe00165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:47.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe051b5700 1 -- 172.21.15.80:0/1184728335 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720387006 0 0) 0x7fbdf0001150 con 0x7fbe0015ed10 2019-11-28T12:02:47.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe051b5700 1 -- 172.21.15.80:0/1184728335 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdec002e80 con 0x7fbe0015ed10 2019-11-28T12:02:47.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe051b5700 1 -- 172.21.15.80:0/1184728335 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979641202 0 0) 0x7fbde8001400 con 0x7fbe0015f100 2019-11-28T12:02:47.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe051b5700 1 -- 172.21.15.80:0/1184728335 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdec0030b0 con 0x7fbe0015f100 2019-11-28T12:02:47.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe069b8700 1 -- 172.21.15.80:0/1184728335 >> v1:172.21.15.174:6789/0 conn(0x7fbe0015f100 legacy=0x7fbe0006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe069b8700 1 -- 172.21.15.80:0/1184728335 >> v1:172.21.15.80:6789/0 conn(0x7fbe0015ed10 legacy=0x7fbe00073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.074 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe069b8700 1 -- 172.21.15.80:0/1184728335 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe00070760 con 0x7fbe001639f0 2019-11-28T12:02:47.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe069b8700 1 --2- 172.21.15.80:0/1184728335 >> v2:172.21.15.174:3300/0 conn(0x7fbe001639f0 0x7fbe00165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbdf800af80 tx=0x7fbdf800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe069b8700 1 --2- 172.21.15.80:0/1184728335 >> v2:172.21.15.174:3300/0 conn(0x7fbe001639f0 0x7fbe00165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbdf800af80 tx=0x7fbdf800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.076+0000 7fbe069b8700 1 --2- 172.21.15.80:0/1184728335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe001639f0 0x7fbe00165df0 secure :-1 s=READY pgs=1921 cs=0 l=1 rx=0x7fbdf800af80 tx=0x7fbdf800b790).ready entity=mon.1 client_cookie=682af60298501751 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:47.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.077+0000 7fbe069b8700 1 --2- 172.21.15.80:0/1184728335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe001639f0 0x7fbe00165df0 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7fbdf800af80 tx=0x7fbdf800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.077+0000 7fbe051b5700 1 -- 172.21.15.80:0/1184728335 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf8007240 con 0x7fbe001639f0 2019-11-28T12:02:47.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.077+0000 7fbe069b8700 1 --2- 172.21.15.80:0/1184728335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe001639f0 0x7fbe00165df0 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7fbdf800af80 tx=0x7fbdf800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.077+0000 7fbe069b8700 1 --2- 172.21.15.80:0/1184728335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe001639f0 0x7fbe00165df0 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7fbdf800af80 tx=0x7fbdf800b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.077+0000 7fbe051b5700 1 -- 172.21.15.80:0/1184728335 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf8000bb0 con 0x7fbe001639f0 2019-11-28T12:02:47.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.077+0000 7fbe051b5700 1 -- 172.21.15.80:0/1184728335 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf8009e60 con 0x7fbe001639f0 2019-11-28T12:02:47.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.077+0000 7fbe07c1a700 1 -- 172.21.15.80:0/1184728335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe001639f0 msgr2=0x7fbe00165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.077+0000 7fbe07c1a700 1 --2- 172.21.15.80:0/1184728335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe001639f0 0x7fbe00165df0 secure :-1 s=READY pgs=1921 cs=0 l=1 rx=0x7fbdf800af80 tx=0x7fbdf800b790).stop 2019-11-28T12:02:47.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.077+0000 7fbe07c1a700 1 -- 172.21.15.80:0/1184728335 shutdown_connections 2019-11-28T12:02:47.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.077+0000 7fbe07c1a700 1 --2- 172.21.15.80:0/1184728335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe001639f0 0x7fbe00165df0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.077+0000 7fbe07c1a700 1 -- 172.21.15.80:0/1184728335 shutdown_connections 2019-11-28T12:02:47.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.077+0000 7fbe07c1a700 1 -- 172.21.15.80:0/1184728335 wait complete. 2019-11-28T12:02:47.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.077+0000 7fbe07c1a700 1 -- 172.21.15.80:0/1184728335 >> 172.21.15.80:0/1184728335 conn(0x7fbe00061d40 msgr2=0x7fbe000641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:47.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.080+0000 7fbe07c1a700 1 Processor -- start 2019-11-28T12:02:47.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.080+0000 7fbe07c1a700 1 -- start start 2019-11-28T12:02:47.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe07c1a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe00152750 0x7fbe001058b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:47.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe07c1a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe0012cb40 0x7fbe001047a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:47.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe07c1a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe00107c20 con 0x7fbe00105df0 2019-11-28T12:02:47.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe07c1a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe00109d70 con 0x7fbe0012cb40 2019-11-28T12:02:47.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe07c1a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0010a040 con 0x7fbe00152750 2019-11-28T12:02:47.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe069b8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe0012cb40 0x7fbe001047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:47.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe069b8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe0012cb40 0x7fbe001047a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48638/0 (socket says 172.21.15.80:48638) 2019-11-28T12:02:47.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe069b8700 1 -- 172.21.15.80:0/2034054493 learned_addr learned my addr 172.21.15.80:0/2034054493 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:47.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe061b7700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe00152750 0x7fbe001058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:47.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe069b8700 1 -- 172.21.15.80:0/2034054493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe00152750 msgr2=0x7fbe001058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe069b8700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe00152750 0x7fbe001058b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe069b8700 1 -- 172.21.15.80:0/2034054493 >> v1:172.21.15.80:6789/0 conn(0x7fbe00105df0 legacy=0x7fbe0012c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe069b8700 1 -- 172.21.15.80:0/2034054493 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe00106f10 con 0x7fbe0012cb40 2019-11-28T12:02:47.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe069b8700 1 --2- 172.21.15.80:0/2034054493 >> v2:172.21.15.80:3300/0 conn(0x7fbe0012cb40 0x7fbe001047a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbdf8010440 tx=0x7fbdf80102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe069b8700 1 --2- 172.21.15.80:0/2034054493 >> v2:172.21.15.80:3300/0 conn(0x7fbe0012cb40 0x7fbe001047a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbdf8010440 tx=0x7fbdf80102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe069b8700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe0012cb40 0x7fbe001047a0 secure :-1 s=READY pgs=3156 cs=0 l=1 rx=0x7fbdf8010440 tx=0x7fbdf80102c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:47.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe069b8700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe0012cb40 0x7fbe001047a0 secure :-1 s=THROTTLE_DONE pgs=3156 cs=0 l=1 rx=0x7fbdf8010440 tx=0x7fbdf80102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbdfeffd700 1 -- 172.21.15.80:0/2034054493 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf800afc0 con 0x7fbe0012cb40 2019-11-28T12:02:47.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe069b8700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe0012cb40 0x7fbe001047a0 secure :-1 s=THROTTLE_DONE pgs=3156 cs=0 l=1 rx=0x7fbdf8010440 tx=0x7fbdf80102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe069b8700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe0012cb40 0x7fbe001047a0 secure :-1 s=THROTTLE_DONE pgs=3156 cs=0 l=1 rx=0x7fbdf8010440 tx=0x7fbdf80102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbdfeffd700 1 -- 172.21.15.80:0/2034054493 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf80099b0 con 0x7fbe0012cb40 2019-11-28T12:02:47.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbdfeffd700 1 -- 172.21.15.80:0/2034054493 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf800afc0 con 0x7fbe0012cb40 2019-11-28T12:02:47.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe07c1a700 1 -- 172.21.15.80:0/2034054493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe00107290 con 0x7fbe0012cb40 2019-11-28T12:02:47.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.081+0000 7fbe07c1a700 1 -- 172.21.15.80:0/2034054493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe00106f10 con 0x7fbe0012cb40 2019-11-28T12:02:47.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.082+0000 7fbe069b8700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe0012cb40 0x7fbe001047a0 secure :-1 s=THROTTLE_DONE pgs=3156 cs=0 l=1 rx=0x7fbdf8010440 tx=0x7fbdf80102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.082+0000 7fbdfeffd700 1 -- 172.21.15.80:0/2034054493 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fbdf8009650 con 0x7fbe0012cb40 2019-11-28T12:02:47.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.082+0000 7fbe069b8700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe0012cb40 0x7fbe001047a0 secure :-1 s=THROTTLE_DONE pgs=3156 cs=0 l=1 rx=0x7fbdf8010440 tx=0x7fbdf80102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.082+0000 7fbdfeffd700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbde4018730 0x7fbde401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:47.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.082+0000 7fbdfeffd700 1 -- 172.21.15.80:0/2034054493 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fbdf8031a90 con 0x7fbe0012cb40 2019-11-28T12:02:47.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.082+0000 7fbe061b7700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbde4018730 0x7fbde401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:47.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.083+0000 7fbe061b7700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbde4018730 0x7fbde401abc0 crc :-1 s=READY pgs=1307 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:47.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.090+0000 7fbe07c1a700 1 -- 172.21.15.80:0/2034054493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe00107290 con 0x7fbe0012cb40 2019-11-28T12:02:47.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.094+0000 7fbe069b8700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe0012cb40 0x7fbe001047a0 secure :-1 s=THROTTLE_DONE pgs=3156 cs=0 l=1 rx=0x7fbdf8010440 tx=0x7fbdf80102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.094+0000 7fbdfeffd700 1 -- 172.21.15.80:0/2034054493 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fbdf802ffa0 con 0x7fbe0012cb40 2019-11-28T12:02:47.257 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.264+0000 7fbe07c1a700 1 -- 172.21.15.80:0/2034054493 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fbe00106f10 con 0x7fbe0012cb40 2019-11-28T12:02:47.259 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.266+0000 7fbe069b8700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe0012cb40 0x7fbe001047a0 secure :-1 s=THROTTLE_DONE pgs=3156 cs=0 l=1 rx=0x7fbdf8010440 tx=0x7fbdf80102c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.260 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.266+0000 7fbdfeffd700 1 -- 172.21.15.80:0/2034054493 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v84) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbdf802ffa0 con 0x7fbe0012cb40 2019-11-28T12:02:47.260 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2019-11-28T12:02:47.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.269+0000 7fbe07c1a700 1 -- 172.21.15.80:0/2034054493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbde4018730 msgr2=0x7fbde401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.262 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.269+0000 7fbe07c1a700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbde4018730 0x7fbde401abc0 crc :-1 s=READY pgs=1307 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.269+0000 7fbe07c1a700 1 -- 172.21.15.80:0/2034054493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe0012cb40 msgr2=0x7fbe001047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.269+0000 7fbe07c1a700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe0012cb40 0x7fbe001047a0 secure :-1 s=READY pgs=3156 cs=0 l=1 rx=0x7fbdf8010440 tx=0x7fbdf80102c0).stop 2019-11-28T12:02:47.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.269+0000 7fbe07c1a700 1 -- 172.21.15.80:0/2034054493 shutdown_connections 2019-11-28T12:02:47.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.269+0000 7fbe07c1a700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fbde4018730 0x7fbde401abc0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.269+0000 7fbe07c1a700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe0012cb40 0x7fbe001047a0 unknown :-1 s=CLOSED pgs=3156 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.269+0000 7fbe07c1a700 1 --2- 172.21.15.80:0/2034054493 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbe00152750 0x7fbe001058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.263 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.269+0000 7fbe07c1a700 1 -- 172.21.15.80:0/2034054493 shutdown_connections 2019-11-28T12:02:47.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.269+0000 7fbe07c1a700 1 -- 172.21.15.80:0/2034054493 wait complete. 2019-11-28T12:02:47.264 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.269+0000 7fbe07c1a700 1 -- 172.21.15.80:0/2034054493 >> 172.21.15.80:0/2034054493 conn(0x7fbe001476e0 msgr2=0x7fbe0012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:47.273 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T12:02:47.408 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.411+0000 7f8eefdd5700 1 Processor -- start 2019-11-28T12:02:47.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.411+0000 7f8eefdd5700 1 -- start start 2019-11-28T12:02:47.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.412+0000 7f8eefdd5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ee815f100 0x7f8ee806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:47.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.412+0000 7f8eefdd5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8ee806c2f0 0x7f8ee806c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:47.409 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.412+0000 7f8eefdd5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee806db60 con 0x7f8ee815ed10 2019-11-28T12:02:47.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.412+0000 7f8eefdd5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee806fe00 con 0x7f8ee815f100 2019-11-28T12:02:47.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.412+0000 7f8eefdd5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee80700d0 con 0x7f8ee806c2f0 2019-11-28T12:02:47.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.412+0000 7f8eedb71700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ee815f100 0x7f8ee806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:47.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.412+0000 7f8eee372700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8ee815ed10 0x7f8ee8073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47958/0 (socket says 172.21.15.80:47958) 2019-11-28T12:02:47.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.412+0000 7f8eee372700 1 -- 172.21.15.80:0/2356249735 learned_addr learned my addr 172.21.15.80:0/2356249735 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:47.410 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.412+0000 7f8eeeb73700 1 --2- 172.21.15.80:0/2356249735 >> v2:172.21.15.174:3300/0 conn(0x7f8ee806c2f0 0x7f8ee806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:47.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.413+0000 7f8eedb71700 1 -- 172.21.15.80:0/2356249735 >> v2:172.21.15.174:3300/0 conn(0x7f8ee806c2f0 msgr2=0x7f8ee806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:47.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.413+0000 7f8eedb71700 1 --2- 172.21.15.80:0/2356249735 >> v2:172.21.15.174:3300/0 conn(0x7f8ee806c2f0 0x7f8ee806c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:47.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.413+0000 7f8eedb71700 1 -- 172.21.15.80:0/2356249735 >> v1:172.21.15.80:6789/0 conn(0x7f8ee815ed10 legacy=0x7f8ee8073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.413+0000 7f8eed370700 1 -- 172.21.15.80:0/2356249735 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41563302 0 0) 0x7f8ed0001150 con 0x7f8ee815ed10 2019-11-28T12:02:47.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.413+0000 7f8eedb71700 1 -- 172.21.15.80:0/2356249735 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee8070760 con 0x7f8ee815f100 2019-11-28T12:02:47.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.413+0000 7f8eedb71700 1 --2- 172.21.15.80:0/2356249735 >> v2:172.21.15.80:3300/0 conn(0x7f8ee815f100 0x7f8ee806bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8ed800b2d0 tx=0x7f8ed800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.411 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.413+0000 7f8eedb71700 1 --2- 172.21.15.80:0/2356249735 >> v2:172.21.15.80:3300/0 conn(0x7f8ee815f100 0x7f8ee806bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8ed800b2d0 tx=0x7f8ed800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.413+0000 7f8eedb71700 1 --2- 172.21.15.80:0/2356249735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee815f100 0x7f8ee806bdb0 secure :-1 s=READY pgs=3158 cs=0 l=1 rx=0x7f8ed800b2d0 tx=0x7f8ed800ba60).ready entity=mon.0 client_cookie=dc468c62463e6e69 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:47.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.413+0000 7f8eedb71700 1 --2- 172.21.15.80:0/2356249735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee815f100 0x7f8ee806bdb0 secure :-1 s=THROTTLE_DONE pgs=3158 cs=0 l=1 rx=0x7f8ed800b2d0 tx=0x7f8ed800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.412 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.413+0000 7f8eedb71700 1 --2- 172.21.15.80:0/2356249735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee815f100 0x7f8ee806bdb0 secure :-1 s=THROTTLE_DONE pgs=3158 cs=0 l=1 rx=0x7f8ed800b2d0 tx=0x7f8ed800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.413+0000 7f8eed370700 1 -- 172.21.15.80:0/2356249735 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ed8007590 con 0x7f8ee815f100 2019-11-28T12:02:47.414 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.413+0000 7f8eedb71700 1 --2- 172.21.15.80:0/2356249735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee815f100 0x7f8ee806bdb0 secure :-1 s=THROTTLE_DONE pgs=3158 cs=0 l=1 rx=0x7f8ed800b2d0 tx=0x7f8ed800ba60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.413+0000 7f8eed370700 1 -- 172.21.15.80:0/2356249735 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed8009d30 con 0x7f8ee815f100 2019-11-28T12:02:47.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.413+0000 7f8eed370700 1 -- 172.21.15.80:0/2356249735 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ed800a340 con 0x7f8ee815f100 2019-11-28T12:02:47.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.413+0000 7f8eefdd5700 1 -- 172.21.15.80:0/2356249735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee815f100 msgr2=0x7f8ee806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.416 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.413+0000 7f8eefdd5700 1 --2- 172.21.15.80:0/2356249735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee815f100 0x7f8ee806bdb0 secure :-1 s=READY pgs=3158 cs=0 l=1 rx=0x7f8ed800b2d0 tx=0x7f8ed800ba60).stop 2019-11-28T12:02:47.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.414+0000 7f8eefdd5700 1 -- 172.21.15.80:0/2356249735 shutdown_connections 2019-11-28T12:02:47.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.414+0000 7f8eefdd5700 1 --2- 172.21.15.80:0/2356249735 >> v2:172.21.15.174:3300/0 conn(0x7f8ee806c2f0 0x7f8ee806c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:47.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.414+0000 7f8eefdd5700 1 --2- 172.21.15.80:0/2356249735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee815f100 0x7f8ee806bdb0 unknown :-1 s=CLOSED pgs=3158 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.414+0000 7f8eefdd5700 1 -- 172.21.15.80:0/2356249735 shutdown_connections 2019-11-28T12:02:47.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.414+0000 7f8eefdd5700 1 -- 172.21.15.80:0/2356249735 wait complete. 2019-11-28T12:02:47.417 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.414+0000 7f8eefdd5700 1 -- 172.21.15.80:0/2356249735 >> 172.21.15.80:0/2356249735 conn(0x7f8ee8061d40 msgr2=0x7f8ee80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.416+0000 7f8eefdd5700 1 Processor -- start 2019-11-28T12:02:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.416+0000 7f8eefdd5700 1 -- start start 2019-11-28T12:02:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.417+0000 7f8eefdd5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ee8152750 0x7f8ee8135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.417+0000 7f8eefdd5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8ee8130dc0 0x7f8ee8131250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:47.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.417+0000 7f8eefdd5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ee8131790 0x7f8ee8134610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.417+0000 7f8eefdd5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee8132570 con 0x7f8ee8152750 2019-11-28T12:02:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.417+0000 7f8eefdd5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee8132840 con 0x7f8ee8130dc0 2019-11-28T12:02:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.417+0000 7f8eefdd5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee810a460 con 0x7f8ee8131790 2019-11-28T12:02:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.417+0000 7f8eee372700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ee8152750 0x7f8ee8135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.417+0000 7f8eee372700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8ee8152750 0x7f8ee8135790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48648/0 (socket says 172.21.15.80:48648) 2019-11-28T12:02:47.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.417+0000 7f8eee372700 1 -- 172.21.15.80:0/1402316986 learned_addr learned my addr 172.21.15.80:0/1402316986 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.417+0000 7f8eedb71700 1 --2- 172.21.15.80:0/1402316986 >> v2:172.21.15.174:3300/0 conn(0x7f8ee8130dc0 0x7f8ee8131250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.417+0000 7f8eeeb73700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ee8131790 0x7f8ee8134610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8eee372700 1 -- 172.21.15.80:0/1402316986 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ee8131790 msgr2=0x7f8ee8134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8eee372700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ee8131790 0x7f8ee8134610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8eee372700 1 -- 172.21.15.80:0/1402316986 >> v2:172.21.15.174:3300/0 conn(0x7f8ee8130dc0 msgr2=0x7f8ee8131250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8eee372700 1 --2- 172.21.15.80:0/1402316986 >> v2:172.21.15.174:3300/0 conn(0x7f8ee8130dc0 0x7f8ee8131250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8eee372700 1 -- 172.21.15.80:0/1402316986 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee8132ed0 con 0x7f8ee8152750 2019-11-28T12:02:47.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8eee372700 1 --2- 172.21.15.80:0/1402316986 >> v2:172.21.15.80:3300/0 conn(0x7f8ee8152750 0x7f8ee8135790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ed0010430 tx=0x7f8ed0010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8eee372700 1 --2- 172.21.15.80:0/1402316986 >> v2:172.21.15.80:3300/0 conn(0x7f8ee8152750 0x7f8ee8135790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ed0010430 tx=0x7f8ed0010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8eee372700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee8152750 0x7f8ee8135790 secure :-1 s=READY pgs=3159 cs=0 l=1 rx=0x7f8ed0010430 tx=0x7f8ed0010260).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:47.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8eee372700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee8152750 0x7f8ee8135790 secure :-1 s=THROTTLE_DONE pgs=3159 cs=0 l=1 rx=0x7f8ed0010430 tx=0x7f8ed0010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8ee6ffd700 1 -- 172.21.15.80:0/1402316986 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ed0000ed0 con 0x7f8ee8152750 2019-11-28T12:02:47.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8eee372700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee8152750 0x7f8ee8135790 secure :-1 s=THROTTLE_DONE pgs=3159 cs=0 l=1 rx=0x7f8ed0010430 tx=0x7f8ed0010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8eee372700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee8152750 0x7f8ee8135790 secure :-1 s=THROTTLE_DONE pgs=3159 cs=0 l=1 rx=0x7f8ed0010430 tx=0x7f8ed0010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8ee6ffd700 1 -- 172.21.15.80:0/1402316986 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed0004430 con 0x7f8ee8152750 2019-11-28T12:02:47.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8ee6ffd700 1 -- 172.21.15.80:0/1402316986 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ed0004a40 con 0x7f8ee8152750 2019-11-28T12:02:47.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8eefdd5700 1 -- 172.21.15.80:0/1402316986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee8133250 con 0x7f8ee8152750 2019-11-28T12:02:47.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8eefdd5700 1 -- 172.21.15.80:0/1402316986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee8132ed0 con 0x7f8ee8152750 2019-11-28T12:02:47.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8eee372700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee8152750 0x7f8ee8135790 secure :-1 s=THROTTLE_DONE pgs=3159 cs=0 l=1 rx=0x7f8ed0010430 tx=0x7f8ed0010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.430 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.418+0000 7f8ee6ffd700 1 -- 172.21.15.80:0/1402316986 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f8ed0004620 con 0x7f8ee8152750 2019-11-28T12:02:47.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.419+0000 7f8eee372700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee8152750 0x7f8ee8135790 secure :-1 s=THROTTLE_DONE pgs=3159 cs=0 l=1 rx=0x7f8ed0010430 tx=0x7f8ed0010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.419+0000 7f8ee6ffd700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ecc018730 0x7f8ecc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:47.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.419+0000 7f8ee6ffd700 1 -- 172.21.15.80:0/1402316986 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f8ed0031a20 con 0x7f8ee8152750 2019-11-28T12:02:47.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.419+0000 7f8eedb71700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ecc018730 0x7f8ecc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:47.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.419+0000 7f8eedb71700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ecc018730 0x7f8ecc01abc0 crc :-1 s=READY pgs=1308 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:47.431 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.426+0000 7f8eefdd5700 1 -- 172.21.15.80:0/1402316986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee8133250 con 0x7f8ee8152750 2019-11-28T12:02:47.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.430+0000 7f8eee372700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee8152750 0x7f8ee8135790 secure :-1 s=THROTTLE_DONE pgs=3159 cs=0 l=1 rx=0x7f8ed0010430 tx=0x7f8ed0010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.430+0000 7f8ee6ffd700 1 -- 172.21.15.80:0/1402316986 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f8ed00012b0 con 0x7f8ee8152750 2019-11-28T12:02:47.592 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.599+0000 7f8eefdd5700 1 -- 172.21.15.80:0/1402316986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8ee8132ed0 con 0x7f8ee8152750 2019-11-28T12:02:47.596 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.603+0000 7f8eee372700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee8152750 0x7f8ee8135790 secure :-1 s=THROTTLE_DONE pgs=3159 cs=0 l=1 rx=0x7f8ed0010430 tx=0x7f8ed0010260).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.597 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.603+0000 7f8ee6ffd700 1 -- 172.21.15.80:0/1402316986 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v85) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8ed001f5e0 con 0x7f8ee8152750 2019-11-28T12:02:47.599 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.1 2019-11-28T12:02:47.602 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.608+0000 7f8eefdd5700 1 -- 172.21.15.80:0/1402316986 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ecc018730 msgr2=0x7f8ecc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.608+0000 7f8eefdd5700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ecc018730 0x7f8ecc01abc0 crc :-1 s=READY pgs=1308 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.608+0000 7f8eefdd5700 1 -- 172.21.15.80:0/1402316986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee8152750 msgr2=0x7f8ee8135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.609+0000 7f8eefdd5700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee8152750 0x7f8ee8135790 secure :-1 s=READY pgs=3159 cs=0 l=1 rx=0x7f8ed0010430 tx=0x7f8ed0010260).stop 2019-11-28T12:02:47.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.609+0000 7f8eefdd5700 1 -- 172.21.15.80:0/1402316986 shutdown_connections 2019-11-28T12:02:47.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.609+0000 7f8eefdd5700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f8ecc018730 0x7f8ecc01abc0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.609+0000 7f8eefdd5700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ee8131790 0x7f8ee8134610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.603 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.609+0000 7f8eefdd5700 1 --2- 172.21.15.80:0/1402316986 >> v2:172.21.15.174:3300/0 conn(0x7f8ee8130dc0 0x7f8ee8131250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.609+0000 7f8eefdd5700 1 --2- 172.21.15.80:0/1402316986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8ee8152750 0x7f8ee8135790 unknown :-1 s=CLOSED pgs=3159 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.609+0000 7f8eefdd5700 1 -- 172.21.15.80:0/1402316986 shutdown_connections 2019-11-28T12:02:47.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.609+0000 7f8eefdd5700 1 -- 172.21.15.80:0/1402316986 wait complete. 2019-11-28T12:02:47.604 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.609+0000 7f8eefdd5700 1 -- 172.21.15.80:0/1402316986 >> 172.21.15.80:0/1402316986 conn(0x7f8ee81476e0 msgr2=0x7f8ee812fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:47.612 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T12:02:47.761 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.751+0000 7f5025381700 1 Processor -- start 2019-11-28T12:02:47.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.751+0000 7f5025381700 1 -- start start 2019-11-28T12:02:47.762 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.751+0000 7f5025381700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f502015ed10 0x7f502015f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:47.763 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.751+0000 7f5025381700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5020073020 0x7f5020071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:47.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f5025381700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502006db60 con 0x7f50200734b0 2019-11-28T12:02:47.764 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f5025381700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502006fe00 con 0x7f502015ed10 2019-11-28T12:02:47.768 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f5025381700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50200700d0 con 0x7f5020073020 2019-11-28T12:02:47.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501f7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f502015ed10 0x7f502015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:47.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f50200734b0 0x7f50200723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:47972/0 (socket says 172.21.15.80:47972) 2019-11-28T12:02:47.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501ffff700 1 -- 172.21.15.80:0/2510157523 learned_addr learned my addr 172.21.15.80:0/2510157523 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:47.769 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501effd700 1 --2- 172.21.15.80:0/2510157523 >> v2:172.21.15.174:3300/0 conn(0x7f5020073020 0x7f5020071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:47.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501f7fe700 1 -- 172.21.15.80:0/2510157523 >> v2:172.21.15.174:3300/0 conn(0x7f5020073020 msgr2=0x7f5020071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:47.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501f7fe700 1 --2- 172.21.15.80:0/2510157523 >> v2:172.21.15.174:3300/0 conn(0x7f5020073020 0x7f5020071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:47.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501f7fe700 1 -- 172.21.15.80:0/2510157523 >> v1:172.21.15.80:6789/0 conn(0x7f50200734b0 legacy=0x7f50200723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.770 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501f7fe700 1 -- 172.21.15.80:0/2510157523 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5020070760 con 0x7f502015ed10 2019-11-28T12:02:47.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501e7fc700 1 -- 172.21.15.80:0/2510157523 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325097779 0 0) 0x7f5018001150 con 0x7f50200734b0 2019-11-28T12:02:47.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501effd700 1 --2- 172.21.15.80:0/2510157523 >> v2:172.21.15.174:3300/0 conn(0x7f5020073020 0x7f5020071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-11-28T12:02:47.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501f7fe700 1 --2- 172.21.15.80:0/2510157523 >> v2:172.21.15.80:3300/0 conn(0x7f502015ed10 0x7f502015f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f501000af50 tx=0x7f501000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.771 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501f7fe700 1 --2- 172.21.15.80:0/2510157523 >> v2:172.21.15.80:3300/0 conn(0x7f502015ed10 0x7f502015f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f501000af50 tx=0x7f501000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501f7fe700 1 --2- 172.21.15.80:0/2510157523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502015ed10 0x7f502015f100 secure :-1 s=READY pgs=3161 cs=0 l=1 rx=0x7f501000af50 tx=0x7f501000b760).ready entity=mon.0 client_cookie=2b8c49ede062d8c4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:47.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501f7fe700 1 --2- 172.21.15.80:0/2510157523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502015ed10 0x7f502015f100 secure :-1 s=THROTTLE_DONE pgs=3161 cs=0 l=1 rx=0x7f501000af50 tx=0x7f501000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501e7fc700 1 -- 172.21.15.80:0/2510157523 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5010007210 con 0x7f502015ed10 2019-11-28T12:02:47.772 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501f7fe700 1 --2- 172.21.15.80:0/2510157523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502015ed10 0x7f502015f100 secure :-1 s=THROTTLE_DONE pgs=3161 cs=0 l=1 rx=0x7f501000af50 tx=0x7f501000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501e7fc700 1 -- 172.21.15.80:0/2510157523 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50100099b0 con 0x7f502015ed10 2019-11-28T12:02:47.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501f7fe700 1 --2- 172.21.15.80:0/2510157523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502015ed10 0x7f502015f100 secure :-1 s=THROTTLE_DONE pgs=3161 cs=0 l=1 rx=0x7f501000af50 tx=0x7f501000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f501e7fc700 1 -- 172.21.15.80:0/2510157523 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5010009ba0 con 0x7f502015ed10 2019-11-28T12:02:47.773 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f5025381700 1 -- 172.21.15.80:0/2510157523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502015ed10 msgr2=0x7f502015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.752+0000 7f5025381700 1 --2- 172.21.15.80:0/2510157523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502015ed10 0x7f502015f100 secure :-1 s=READY pgs=3161 cs=0 l=1 rx=0x7f501000af50 tx=0x7f501000b760).stop 2019-11-28T12:02:47.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.753+0000 7f5025381700 1 -- 172.21.15.80:0/2510157523 shutdown_connections 2019-11-28T12:02:47.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.753+0000 7f5025381700 1 --2- 172.21.15.80:0/2510157523 >> v2:172.21.15.174:3300/0 conn(0x7f5020073020 0x7f5020071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:47.774 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.753+0000 7f5025381700 1 --2- 172.21.15.80:0/2510157523 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502015ed10 0x7f502015f100 unknown :-1 s=CLOSED pgs=3161 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.753+0000 7f5025381700 1 -- 172.21.15.80:0/2510157523 shutdown_connections 2019-11-28T12:02:47.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.753+0000 7f5025381700 1 -- 172.21.15.80:0/2510157523 wait complete. 2019-11-28T12:02:47.775 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.753+0000 7f5025381700 1 -- 172.21.15.80:0/2510157523 >> 172.21.15.80:0/2510157523 conn(0x7f5020061d40 msgr2=0x7f50200641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:47.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.756+0000 7f5025381700 1 Processor -- start 2019-11-28T12:02:47.776 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.756+0000 7f5025381700 1 -- start start 2019-11-28T12:02:47.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f5025381700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f502010f000 0x7f502015ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:47.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f5025381700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f502014cc70 0x7f502014d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:47.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f5025381700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f502014d640 0x7f502010c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:47.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f5025381700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502010dd90 con 0x7f502014cc70 2019-11-28T12:02:47.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f5025381700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502010e7c0 con 0x7f502014d640 2019-11-28T12:02:47.777 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f5025381700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502014dac0 con 0x7f502010f000 2019-11-28T12:02:47.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501effd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f502014cc70 0x7f502014d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:47.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501effd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f502014cc70 0x7f502014d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48664/0 (socket says 172.21.15.80:48664) 2019-11-28T12:02:47.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501effd700 1 -- 172.21.15.80:0/795961183 learned_addr learned my addr 172.21.15.80:0/795961183 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:47.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501ffff700 1 --2- 172.21.15.80:0/795961183 >> v2:172.21.15.174:3300/0 conn(0x7f502014d640 0x7f502010c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:47.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501f7fe700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f502010f000 0x7f502015ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:47.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501effd700 1 -- 172.21.15.80:0/795961183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f502010f000 msgr2=0x7f502015ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.778 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501effd700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f502010f000 0x7f502015ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501effd700 1 -- 172.21.15.80:0/795961183 >> v2:172.21.15.174:3300/0 conn(0x7f502014d640 msgr2=0x7f502010c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501effd700 1 --2- 172.21.15.80:0/795961183 >> v2:172.21.15.174:3300/0 conn(0x7f502014d640 0x7f502010c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501effd700 1 -- 172.21.15.80:0/795961183 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502014b530 con 0x7f502014cc70 2019-11-28T12:02:47.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501f7fe700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f502010f000 0x7f502015ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T12:02:47.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501ffff700 1 --2- 172.21.15.80:0/795961183 >> v2:172.21.15.174:3300/0 conn(0x7f502014d640 0x7f502010c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T12:02:47.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501effd700 1 --2- 172.21.15.80:0/795961183 >> v2:172.21.15.80:3300/0 conn(0x7f502014cc70 0x7f502014d100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f50080107e0 tx=0x7f5008010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.779 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501effd700 1 --2- 172.21.15.80:0/795961183 >> v2:172.21.15.80:3300/0 conn(0x7f502014cc70 0x7f502014d100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f50080107e0 tx=0x7f5008010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501effd700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502014cc70 0x7f502014d100 secure :-1 s=READY pgs=3162 cs=0 l=1 rx=0x7f50080107e0 tx=0x7f5008010b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:47.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501effd700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502014cc70 0x7f502014d100 secure :-1 s=THROTTLE_DONE pgs=3162 cs=0 l=1 rx=0x7f50080107e0 tx=0x7f5008010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501effd700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502014cc70 0x7f502014d100 secure :-1 s=THROTTLE_DONE pgs=3162 cs=0 l=1 rx=0x7f50080107e0 tx=0x7f5008010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f5017fff700 1 -- 172.21.15.80:0/795961183 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5008001410 con 0x7f502014cc70 2019-11-28T12:02:47.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f501effd700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502014cc70 0x7f502014d100 secure :-1 s=THROTTLE_DONE pgs=3162 cs=0 l=1 rx=0x7f50080107e0 tx=0x7f5008010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.780 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f5017fff700 1 -- 172.21.15.80:0/795961183 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5008000cc0 con 0x7f502014cc70 2019-11-28T12:02:47.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f5025381700 1 -- 172.21.15.80:0/795961183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502014b8b0 con 0x7f502014cc70 2019-11-28T12:02:47.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.757+0000 7f5017fff700 1 -- 172.21.15.80:0/795961183 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50080019f0 con 0x7f502014cc70 2019-11-28T12:02:47.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.758+0000 7f5025381700 1 -- 172.21.15.80:0/795961183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502014b530 con 0x7f502014cc70 2019-11-28T12:02:47.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.758+0000 7f501effd700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502014cc70 0x7f502014d100 secure :-1 s=THROTTLE_DONE pgs=3162 cs=0 l=1 rx=0x7f50080107e0 tx=0x7f5008010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.759+0000 7f5017fff700 1 -- 172.21.15.80:0/795961183 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f5008001220 con 0x7f502014cc70 2019-11-28T12:02:47.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.759+0000 7f501effd700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502014cc70 0x7f502014d100 secure :-1 s=THROTTLE_DONE pgs=3162 cs=0 l=1 rx=0x7f50080107e0 tx=0x7f5008010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.781 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.759+0000 7f5017fff700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ff8018730 0x7f4ff801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:47.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.759+0000 7f5017fff700 1 -- 172.21.15.80:0/795961183 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5008031d60 con 0x7f502014cc70 2019-11-28T12:02:47.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.759+0000 7f501f7fe700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ff8018730 0x7f4ff801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:47.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.759+0000 7f501f7fe700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ff8018730 0x7f4ff801abc0 crc :-1 s=READY pgs=1309 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:47.782 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.766+0000 7f5025381700 1 -- 172.21.15.80:0/795961183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502014b8b0 con 0x7f502014cc70 2019-11-28T12:02:47.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.769+0000 7f501effd700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502014cc70 0x7f502014d100 secure :-1 s=THROTTLE_DONE pgs=3162 cs=0 l=1 rx=0x7f50080107e0 tx=0x7f5008010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.783 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.769+0000 7f5017fff700 1 -- 172.21.15.80:0/795961183 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f5008001010 con 0x7f502014cc70 2019-11-28T12:02:47.941 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.948+0000 7f5025381700 1 -- 172.21.15.80:0/795961183 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f502014b530 con 0x7f502014cc70 2019-11-28T12:02:47.943 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.950+0000 7f501effd700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502014cc70 0x7f502014d100 secure :-1 s=THROTTLE_DONE pgs=3162 cs=0 l=1 rx=0x7f50080107e0 tx=0x7f5008010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:47.944 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.950+0000 7f5017fff700 1 -- 172.21.15.80:0/795961183 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v86) v1 ==== 184+0+0 (secure 0 0 0) 0x7f50080015b0 con 0x7f502014cc70 2019-11-28T12:02:47.944 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.2 2019-11-28T12:02:47.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.953+0000 7f5025381700 1 -- 172.21.15.80:0/795961183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ff8018730 msgr2=0x7f4ff801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.953+0000 7f5025381700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ff8018730 0x7f4ff801abc0 crc :-1 s=READY pgs=1309 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.946 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.953+0000 7f5025381700 1 -- 172.21.15.80:0/795961183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502014cc70 msgr2=0x7f502014d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:47.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.953+0000 7f5025381700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502014cc70 0x7f502014d100 secure :-1 s=READY pgs=3162 cs=0 l=1 rx=0x7f50080107e0 tx=0x7f5008010b80).stop 2019-11-28T12:02:47.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.953+0000 7f5025381700 1 -- 172.21.15.80:0/795961183 shutdown_connections 2019-11-28T12:02:47.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.953+0000 7f5025381700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f4ff8018730 0x7f4ff801abc0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.953+0000 7f5025381700 1 --2- 172.21.15.80:0/795961183 >> v2:172.21.15.174:3300/0 conn(0x7f502014d640 0x7f502010c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.953+0000 7f5025381700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f502014cc70 0x7f502014d100 unknown :-1 s=CLOSED pgs=3162 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.947 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.953+0000 7f5025381700 1 --2- 172.21.15.80:0/795961183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f502010f000 0x7f502015ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:47.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.953+0000 7f5025381700 1 -- 172.21.15.80:0/795961183 shutdown_connections 2019-11-28T12:02:47.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.953+0000 7f5025381700 1 -- 172.21.15.80:0/795961183 wait complete. 2019-11-28T12:02:47.948 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:47.953+0000 7f5025381700 1 -- 172.21.15.80:0/795961183 >> 172.21.15.80:0/795961183 conn(0x7f502014eee0 msgr2=0x7f5020149850 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:47.959 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-11-28T12:02:48.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.099+0000 7f3679d03700 1 Processor -- start 2019-11-28T12:02:48.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.099+0000 7f3679d03700 1 -- start start 2019-11-28T12:02:48.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.100+0000 7f3679d03700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f367415ed10 0x7f367415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:48.108 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.100+0000 7f3679d03700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3674073020 0x7f3674071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.100+0000 7f3679d03700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f36740734b0 0x7f36740723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.100+0000 7f3679d03700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367406f3d0 con 0x7f3674073020 2019-11-28T12:02:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.100+0000 7f3679d03700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367406fe00 con 0x7f36740734b0 2019-11-28T12:02:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.100+0000 7f3679d03700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3674070760 con 0x7f367415ed10 2019-11-28T12:02:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f366bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3674073020 0x7f3674071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:48.109 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f366bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3674073020 0x7f3674071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48682/0 (socket says 172.21.15.80:48682) 2019-11-28T12:02:48.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f366bfff700 1 -- 172.21.15.80:0/1052325238 learned_addr learned my addr 172.21.15.80:0/1052325238 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:48.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f3673fff700 1 --2- 172.21.15.80:0/1052325238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f367415ed10 0x7f367415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:48.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f3678aa1700 1 --2- 172.21.15.80:0/1052325238 >> v2:172.21.15.174:3300/0 conn(0x7f36740734b0 0x7f36740723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:48.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f366bfff700 1 -- 172.21.15.80:0/1052325238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f367415ed10 msgr2=0x7f367415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:48.110 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f366bfff700 1 --2- 172.21.15.80:0/1052325238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f367415ed10 0x7f367415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:48.111 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f366bfff700 1 -- 172.21.15.80:0/1052325238 >> v2:172.21.15.174:3300/0 conn(0x7f36740734b0 msgr2=0x7f36740723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:48.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f366bfff700 1 --2- 172.21.15.80:0/1052325238 >> v2:172.21.15.174:3300/0 conn(0x7f36740734b0 0x7f36740723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:48.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f366bfff700 1 -- 172.21.15.80:0/1052325238 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3674070ae0 con 0x7f3674073020 2019-11-28T12:02:48.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f366bfff700 1 --2- 172.21.15.80:0/1052325238 >> v2:172.21.15.80:3300/0 conn(0x7f3674073020 0x7f3674071ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f365c00f6c0 tx=0x7f365c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f366bfff700 1 --2- 172.21.15.80:0/1052325238 >> v2:172.21.15.80:3300/0 conn(0x7f3674073020 0x7f3674071ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f365c00f6c0 tx=0x7f365c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f366bfff700 1 --2- 172.21.15.80:0/1052325238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674073020 0x7f3674071ea0 secure :-1 s=READY pgs=3163 cs=0 l=1 rx=0x7f365c00f6c0 tx=0x7f365c00f570).ready entity=mon.0 client_cookie=cebb61e625466307 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:48.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f366bfff700 1 --2- 172.21.15.80:0/1052325238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674073020 0x7f3674071ea0 secure :-1 s=THROTTLE_DONE pgs=3163 cs=0 l=1 rx=0x7f365c00f6c0 tx=0x7f365c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.112 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f366bfff700 1 --2- 172.21.15.80:0/1052325238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674073020 0x7f3674071ea0 secure :-1 s=THROTTLE_DONE pgs=3163 cs=0 l=1 rx=0x7f365c00f6c0 tx=0x7f365c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f366bfff700 1 --2- 172.21.15.80:0/1052325238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674073020 0x7f3674071ea0 secure :-1 s=THROTTLE_DONE pgs=3163 cs=0 l=1 rx=0x7f365c00f6c0 tx=0x7f365c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f36737fe700 1 -- 172.21.15.80:0/1052325238 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f365c000960 con 0x7f3674073020 2019-11-28T12:02:48.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f36737fe700 1 -- 172.21.15.80:0/1052325238 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c000c90 con 0x7f3674073020 2019-11-28T12:02:48.113 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f36737fe700 1 -- 172.21.15.80:0/1052325238 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f365c0013a0 con 0x7f3674073020 2019-11-28T12:02:48.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f3679d03700 1 -- 172.21.15.80:0/1052325238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674073020 msgr2=0x7f3674071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:48.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.101+0000 7f3679d03700 1 --2- 172.21.15.80:0/1052325238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674073020 0x7f3674071ea0 secure :-1 s=READY pgs=3163 cs=0 l=1 rx=0x7f365c00f6c0 tx=0x7f365c00f570).stop 2019-11-28T12:02:48.114 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.102+0000 7f3679d03700 1 -- 172.21.15.80:0/1052325238 shutdown_connections 2019-11-28T12:02:48.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.102+0000 7f3679d03700 1 --2- 172.21.15.80:0/1052325238 >> v2:172.21.15.174:3300/0 conn(0x7f36740734b0 0x7f36740723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:48.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.102+0000 7f3679d03700 1 --2- 172.21.15.80:0/1052325238 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674073020 0x7f3674071ea0 unknown :-1 s=CLOSED pgs=3163 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:48.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.102+0000 7f3679d03700 1 --2- 172.21.15.80:0/1052325238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f367415ed10 0x7f367415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:48.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.102+0000 7f3679d03700 1 -- 172.21.15.80:0/1052325238 shutdown_connections 2019-11-28T12:02:48.115 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.102+0000 7f3679d03700 1 -- 172.21.15.80:0/1052325238 wait complete. 2019-11-28T12:02:48.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.102+0000 7f3679d03700 1 -- 172.21.15.80:0/1052325238 >> 172.21.15.80:0/1052325238 conn(0x7f3674061d40 msgr2=0x7f36740641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:48.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.105+0000 7f3679d03700 1 Processor -- start 2019-11-28T12:02:48.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.105+0000 7f3679d03700 1 -- start start 2019-11-28T12:02:48.116 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.105+0000 7f3679d03700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f36741594b0 0x7f3674159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:48.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.105+0000 7f3679d03700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3674159e80 0x7f367416ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:48.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.105+0000 7f3679d03700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367415a2b0 con 0x7f3674152a40 2019-11-28T12:02:48.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.105+0000 7f3679d03700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367410a4a0 con 0x7f3674159e80 2019-11-28T12:02:48.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.105+0000 7f3679d03700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3674113ca0 con 0x7f36741594b0 2019-11-28T12:02:48.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.105+0000 7f3678aa1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3674159e80 0x7f367416ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:48.117 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.105+0000 7f3673fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3674152a40 0x7f367415a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48004/0 (socket says 172.21.15.80:48004) 2019-11-28T12:02:48.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f3673fff700 1 -- 172.21.15.80:0/3746038 learned_addr learned my addr 172.21.15.80:0/3746038 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:48.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f366bfff700 1 --2- 172.21.15.80:0/3746038 >> v2:172.21.15.174:3300/0 conn(0x7f36741594b0 0x7f3674159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:48.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f3678aa1700 1 -- 172.21.15.80:0/3746038 >> v2:172.21.15.174:3300/0 conn(0x7f36741594b0 msgr2=0x7f3674159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:48.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f3678aa1700 1 --2- 172.21.15.80:0/3746038 >> v2:172.21.15.174:3300/0 conn(0x7f36741594b0 0x7f3674159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:48.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f3678aa1700 1 -- 172.21.15.80:0/3746038 >> v1:172.21.15.80:6789/0 conn(0x7f3674152a40 legacy=0x7f367415a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:48.118 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f36717fa700 1 -- 172.21.15.80:0/3746038 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200947366 0 0) 0x7f3664009580 con 0x7f3674152a40 2019-11-28T12:02:48.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f3678aa1700 1 -- 172.21.15.80:0/3746038 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3674114330 con 0x7f3674159e80 2019-11-28T12:02:48.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f3678aa1700 1 --2- 172.21.15.80:0/3746038 >> v2:172.21.15.80:3300/0 conn(0x7f3674159e80 0x7f367416ada0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f366c00edc0 tx=0x7f366c0105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f3678aa1700 1 --2- 172.21.15.80:0/3746038 >> v2:172.21.15.80:3300/0 conn(0x7f3674159e80 0x7f367416ada0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f366c00edc0 tx=0x7f366c0105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f3678aa1700 1 --2- 172.21.15.80:0/3746038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674159e80 0x7f367416ada0 secure :-1 s=READY pgs=3165 cs=0 l=1 rx=0x7f366c00edc0 tx=0x7f366c0105c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:48.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f3678aa1700 1 --2- 172.21.15.80:0/3746038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674159e80 0x7f367416ada0 secure :-1 s=THROTTLE_DONE pgs=3165 cs=0 l=1 rx=0x7f366c00edc0 tx=0x7f366c0105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f36717fa700 1 -- 172.21.15.80:0/3746038 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f366c00f200 con 0x7f3674159e80 2019-11-28T12:02:48.119 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f3678aa1700 1 --2- 172.21.15.80:0/3746038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674159e80 0x7f367416ada0 secure :-1 s=THROTTLE_DONE pgs=3165 cs=0 l=1 rx=0x7f366c00edc0 tx=0x7f366c0105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f3678aa1700 1 --2- 172.21.15.80:0/3746038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674159e80 0x7f367416ada0 secure :-1 s=THROTTLE_DONE pgs=3165 cs=0 l=1 rx=0x7f366c00edc0 tx=0x7f366c0105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f36717fa700 1 -- 172.21.15.80:0/3746038 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366c00f400 con 0x7f3674159e80 2019-11-28T12:02:48.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f36717fa700 1 -- 172.21.15.80:0/3746038 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f366c00fad0 con 0x7f3674159e80 2019-11-28T12:02:48.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f3679d03700 1 -- 172.21.15.80:0/3746038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36741146b0 con 0x7f3674159e80 2019-11-28T12:02:48.120 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f3679d03700 1 -- 172.21.15.80:0/3746038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3674115790 con 0x7f3674159e80 2019-11-28T12:02:48.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.106+0000 7f3678aa1700 1 --2- 172.21.15.80:0/3746038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674159e80 0x7f367416ada0 secure :-1 s=THROTTLE_DONE pgs=3165 cs=0 l=1 rx=0x7f366c00edc0 tx=0x7f366c0105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.107+0000 7f36717fa700 1 -- 172.21.15.80:0/3746038 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f366c00ef60 con 0x7f3674159e80 2019-11-28T12:02:48.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.107+0000 7f3678aa1700 1 --2- 172.21.15.80:0/3746038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674159e80 0x7f367416ada0 secure :-1 s=THROTTLE_DONE pgs=3165 cs=0 l=1 rx=0x7f366c00edc0 tx=0x7f366c0105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.107+0000 7f36717fa700 1 --2- 172.21.15.80:0/3746038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3658018730 0x7f365801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:48.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.107+0000 7f36717fa700 1 -- 172.21.15.80:0/3746038 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f366c031d90 con 0x7f3674159e80 2019-11-28T12:02:48.121 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.107+0000 7f3673fff700 1 --2- 172.21.15.80:0/3746038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3658018730 0x7f365801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:48.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.107+0000 7f3673fff700 1 --2- 172.21.15.80:0/3746038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3658018730 0x7f365801abc0 crc :-1 s=READY pgs=1311 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:48.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.114+0000 7f3679d03700 1 -- 172.21.15.80:0/3746038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3674114330 con 0x7f3674159e80 2019-11-28T12:02:48.122 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.118+0000 7f3678aa1700 1 --2- 172.21.15.80:0/3746038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674159e80 0x7f367416ada0 secure :-1 s=THROTTLE_DONE pgs=3165 cs=0 l=1 rx=0x7f366c00edc0 tx=0x7f366c0105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.123 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.118+0000 7f36717fa700 1 -- 172.21.15.80:0/3746038 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f366c000e80 con 0x7f3674159e80 2019-11-28T12:02:48.281 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.288+0000 7f3679d03700 1 -- 172.21.15.80:0/3746038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f36741146b0 con 0x7f3674159e80 2019-11-28T12:02:48.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.291+0000 7f3678aa1700 1 --2- 172.21.15.80:0/3746038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674159e80 0x7f367416ada0 secure :-1 s=THROTTLE_DONE pgs=3165 cs=0 l=1 rx=0x7f366c00edc0 tx=0x7f366c0105c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.284 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.291+0000 7f36717fa700 1 -- 172.21.15.80:0/3746038 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v87) v1 ==== 184+0+0 (secure 0 0 0) 0x7f366c00f5f0 con 0x7f3674159e80 2019-11-28T12:02:48.284 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.3 2019-11-28T12:02:48.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.293+0000 7f3679d03700 1 -- 172.21.15.80:0/3746038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3658018730 msgr2=0x7f365801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:48.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.293+0000 7f3679d03700 1 --2- 172.21.15.80:0/3746038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3658018730 0x7f365801abc0 crc :-1 s=READY pgs=1311 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:48.287 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.293+0000 7f3679d03700 1 -- 172.21.15.80:0/3746038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674159e80 msgr2=0x7f367416ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:48.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.293+0000 7f3679d03700 1 --2- 172.21.15.80:0/3746038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674159e80 0x7f367416ada0 secure :-1 s=READY pgs=3165 cs=0 l=1 rx=0x7f366c00edc0 tx=0x7f366c0105c0).stop 2019-11-28T12:02:48.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.293+0000 7f3679d03700 1 -- 172.21.15.80:0/3746038 shutdown_connections 2019-11-28T12:02:48.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.293+0000 7f3679d03700 1 --2- 172.21.15.80:0/3746038 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f3658018730 0x7f365801abc0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:48.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.293+0000 7f3679d03700 1 --2- 172.21.15.80:0/3746038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3674159e80 0x7f367416ada0 unknown :-1 s=CLOSED pgs=3165 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:48.288 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.293+0000 7f3679d03700 1 --2- 172.21.15.80:0/3746038 >> v2:172.21.15.174:3300/0 conn(0x7f36741594b0 0x7f3674159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:48.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.293+0000 7f3679d03700 1 -- 172.21.15.80:0/3746038 shutdown_connections 2019-11-28T12:02:48.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.293+0000 7f3679d03700 1 -- 172.21.15.80:0/3746038 wait complete. 2019-11-28T12:02:48.289 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.293+0000 7f3679d03700 1 -- 172.21.15.80:0/3746038 >> 172.21.15.80:0/3746038 conn(0x7f36741476e0 msgr2=0x7f367412fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:48.296 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:48.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.423+0000 7f376e09b700 1 Processor -- start 2019-11-28T12:02:48.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.423+0000 7f376e09b700 1 -- start start 2019-11-28T12:02:48.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.424+0000 7f376e09b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f376806c0a0 0x7f3768072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:48.421 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.424+0000 7f376e09b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f37680734e0 0x7f3768071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:48.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.424+0000 7f376e09b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376806db00 con 0x7f3768072360 2019-11-28T12:02:48.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.424+0000 7f376e09b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376806f330 con 0x7f37680734e0 2019-11-28T12:02:48.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.424+0000 7f376e09b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37680706c0 con 0x7f376806c0a0 2019-11-28T12:02:48.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.424+0000 7f376ce39700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3768072360 0x7f376806c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48014/0 (socket says 172.21.15.80:48014) 2019-11-28T12:02:48.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f376ce39700 1 -- 172.21.15.80:0/4014810128 learned_addr learned my addr 172.21.15.80:0/4014810128 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:48.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f375ffff700 1 --2- 172.21.15.80:0/4014810128 >> v2:172.21.15.174:3300/0 conn(0x7f37680734e0 0x7f3768071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:48.422 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f3767fff700 1 --2- 172.21.15.80:0/4014810128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f376806c0a0 0x7f3768072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f37677fe700 1 -- 172.21.15.80:0/4014810128 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648468134 0 0) 0x7f37600014d0 con 0x7f3768072360 2019-11-28T12:02:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f37677fe700 1 -- 172.21.15.80:0/4014810128 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3754002e80 con 0x7f3768072360 2019-11-28T12:02:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f375ffff700 1 -- 172.21.15.80:0/4014810128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f376806c0a0 msgr2=0x7f3768072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f375ffff700 1 --2- 172.21.15.80:0/4014810128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f376806c0a0 0x7f3768072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f375ffff700 1 -- 172.21.15.80:0/4014810128 >> v1:172.21.15.80:6789/0 conn(0x7f3768072360 legacy=0x7f376806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f375ffff700 1 -- 172.21.15.80:0/4014810128 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3768070a40 con 0x7f37680734e0 2019-11-28T12:02:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f3767fff700 1 --2- 172.21.15.80:0/4014810128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f376806c0a0 0x7f3768072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f375ffff700 1 --2- 172.21.15.80:0/4014810128 >> v2:172.21.15.174:3300/0 conn(0x7f37680734e0 0x7f3768071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f375000af50 tx=0x7f375000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f375ffff700 1 --2- 172.21.15.80:0/4014810128 >> v2:172.21.15.174:3300/0 conn(0x7f37680734e0 0x7f3768071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f375000af50 tx=0x7f375000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f375ffff700 1 --2- 172.21.15.80:0/4014810128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37680734e0 0x7f3768071e20 secure :-1 s=READY pgs=1922 cs=0 l=1 rx=0x7f375000af50 tx=0x7f375000b760).ready entity=mon.1 client_cookie=10d3e4d24b582f43 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f375ffff700 1 --2- 172.21.15.80:0/4014810128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37680734e0 0x7f3768071e20 secure :-1 s=THROTTLE_DONE pgs=1922 cs=0 l=1 rx=0x7f375000af50 tx=0x7f375000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f37677fe700 1 -- 172.21.15.80:0/4014810128 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3750007210 con 0x7f37680734e0 2019-11-28T12:02:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f375ffff700 1 --2- 172.21.15.80:0/4014810128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37680734e0 0x7f3768071e20 secure :-1 s=THROTTLE_DONE pgs=1922 cs=0 l=1 rx=0x7f375000af50 tx=0x7f375000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f375ffff700 1 --2- 172.21.15.80:0/4014810128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37680734e0 0x7f3768071e20 secure :-1 s=THROTTLE_DONE pgs=1922 cs=0 l=1 rx=0x7f375000af50 tx=0x7f375000b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f37677fe700 1 -- 172.21.15.80:0/4014810128 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37500099b0 con 0x7f37680734e0 2019-11-28T12:02:48.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f37677fe700 1 -- 172.21.15.80:0/4014810128 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f375000a080 con 0x7f37680734e0 2019-11-28T12:02:48.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f376e09b700 1 -- 172.21.15.80:0/4014810128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37680734e0 msgr2=0x7f3768071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:48.425 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.425+0000 7f376e09b700 1 --2- 172.21.15.80:0/4014810128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37680734e0 0x7f3768071e20 secure :-1 s=READY pgs=1922 cs=0 l=1 rx=0x7f375000af50 tx=0x7f375000b760).stop 2019-11-28T12:02:48.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.426+0000 7f376e09b700 1 -- 172.21.15.80:0/4014810128 shutdown_connections 2019-11-28T12:02:48.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.426+0000 7f376e09b700 1 --2- 172.21.15.80:0/4014810128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37680734e0 0x7f3768071e20 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:48.427 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.426+0000 7f376e09b700 1 --2- 172.21.15.80:0/4014810128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f376806c0a0 0x7f3768072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.426+0000 7f376e09b700 1 -- 172.21.15.80:0/4014810128 shutdown_connections 2019-11-28T12:02:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.426+0000 7f376e09b700 1 -- 172.21.15.80:0/4014810128 wait complete. 2019-11-28T12:02:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.426+0000 7f376e09b700 1 -- 172.21.15.80:0/4014810128 >> 172.21.15.80:0/4014810128 conn(0x7f3768061cf0 msgr2=0x7f3768064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:48.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.429+0000 7f376e09b700 1 Processor -- start 2019-11-28T12:02:48.429 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.429+0000 7f376e09b700 1 -- start start 2019-11-28T12:02:48.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.429+0000 7f376e09b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f376815fdf0 0x7f376812b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:48.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.429+0000 7f376e09b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f376812a3c0 0x7f376812a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:48.432 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.429+0000 7f376e09b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376813eb20 con 0x7f376812b8a0 2019-11-28T12:02:48.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.429+0000 7f376e09b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3768108820 con 0x7f376815fdf0 2019-11-28T12:02:48.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.429+0000 7f376e09b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3768108af0 con 0x7f376812a3c0 2019-11-28T12:02:48.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f375ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f376812b8a0 0x7f376813e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48018/0 (socket says 172.21.15.80:48018) 2019-11-28T12:02:48.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f3767fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f376815fdf0 0x7f376812b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:48.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f375ffff700 1 -- 172.21.15.80:0/2018898075 learned_addr learned my addr 172.21.15.80:0/2018898075 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:48.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f376ce39700 1 --2- 172.21.15.80:0/2018898075 >> v2:172.21.15.174:3300/0 conn(0x7f376812a3c0 0x7f376812a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:48.433 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f3767fff700 1 -- 172.21.15.80:0/2018898075 >> v2:172.21.15.174:3300/0 conn(0x7f376812a3c0 msgr2=0x7f376812a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:48.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f3767fff700 1 --2- 172.21.15.80:0/2018898075 >> v2:172.21.15.174:3300/0 conn(0x7f376812a3c0 0x7f376812a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:48.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f3767fff700 1 -- 172.21.15.80:0/2018898075 >> v1:172.21.15.80:6789/0 conn(0x7f376812b8a0 legacy=0x7f376813e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:48.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f37657fa700 1 -- 172.21.15.80:0/2018898075 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149801207 0 0) 0x7f375000abb0 con 0x7f376812b8a0 2019-11-28T12:02:48.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f3767fff700 1 -- 172.21.15.80:0/2018898075 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376810a8c0 con 0x7f376815fdf0 2019-11-28T12:02:48.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f3767fff700 1 --2- 172.21.15.80:0/2018898075 >> v2:172.21.15.80:3300/0 conn(0x7f376815fdf0 0x7f376812b360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3758010390 tx=0x7f3758005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f3767fff700 1 --2- 172.21.15.80:0/2018898075 >> v2:172.21.15.80:3300/0 conn(0x7f376815fdf0 0x7f376812b360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3758010390 tx=0x7f3758005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.434 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f3767fff700 1 --2- 172.21.15.80:0/2018898075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f376815fdf0 0x7f376812b360 secure :-1 s=READY pgs=3168 cs=0 l=1 rx=0x7f3758010390 tx=0x7f3758005ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:48.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f3767fff700 1 --2- 172.21.15.80:0/2018898075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f376815fdf0 0x7f376812b360 secure :-1 s=THROTTLE_DONE pgs=3168 cs=0 l=1 rx=0x7f3758010390 tx=0x7f3758005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f37657fa700 1 -- 172.21.15.80:0/2018898075 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3758000940 con 0x7f376815fdf0 2019-11-28T12:02:48.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f3767fff700 1 --2- 172.21.15.80:0/2018898075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f376815fdf0 0x7f376812b360 secure :-1 s=THROTTLE_DONE pgs=3168 cs=0 l=1 rx=0x7f3758010390 tx=0x7f3758005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f3767fff700 1 --2- 172.21.15.80:0/2018898075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f376815fdf0 0x7f376812b360 secure :-1 s=THROTTLE_DONE pgs=3168 cs=0 l=1 rx=0x7f3758010390 tx=0x7f3758005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f37657fa700 1 -- 172.21.15.80:0/2018898075 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3758008710 con 0x7f376815fdf0 2019-11-28T12:02:48.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f37657fa700 1 -- 172.21.15.80:0/2018898075 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3758008da0 con 0x7f376815fdf0 2019-11-28T12:02:48.435 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f376e09b700 1 -- 172.21.15.80:0/2018898075 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376810a8c0 con 0x7f376815fdf0 2019-11-28T12:02:48.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.430+0000 7f376e09b700 1 -- 172.21.15.80:0/2018898075 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376810a8c0 con 0x7f376815fdf0 2019-11-28T12:02:48.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.431+0000 7f3767fff700 1 --2- 172.21.15.80:0/2018898075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f376815fdf0 0x7f376812b360 secure :-1 s=THROTTLE_DONE pgs=3168 cs=0 l=1 rx=0x7f3758010390 tx=0x7f3758005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.431+0000 7f37657fa700 1 -- 172.21.15.80:0/2018898075 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3758008900 con 0x7f376815fdf0 2019-11-28T12:02:48.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.431+0000 7f3767fff700 1 --2- 172.21.15.80:0/2018898075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f376815fdf0 0x7f376812b360 secure :-1 s=THROTTLE_DONE pgs=3168 cs=0 l=1 rx=0x7f3758010390 tx=0x7f3758005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.431+0000 7f37657fa700 1 --2- 172.21.15.80:0/2018898075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f374c018730 0x7f374c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:48.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.431+0000 7f37657fa700 1 -- 172.21.15.80:0/2018898075 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f37580319c0 con 0x7f376815fdf0 2019-11-28T12:02:48.436 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.431+0000 7f375ffff700 1 --2- 172.21.15.80:0/2018898075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f374c018730 0x7f374c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:48.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.431+0000 7f375ffff700 1 --2- 172.21.15.80:0/2018898075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f374c018730 0x7f374c01abc0 crc :-1 s=READY pgs=1312 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:48.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.438+0000 7f376e09b700 1 -- 172.21.15.80:0/2018898075 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3768109180 con 0x7f376815fdf0 2019-11-28T12:02:48.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.442+0000 7f3767fff700 1 --2- 172.21.15.80:0/2018898075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f376815fdf0 0x7f376812b360 secure :-1 s=THROTTLE_DONE pgs=3168 cs=0 l=1 rx=0x7f3758010390 tx=0x7f3758005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.437 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.442+0000 7f37657fa700 1 -- 172.21.15.80:0/2018898075 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f3758005180 con 0x7f376815fdf0 2019-11-28T12:02:48.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.613+0000 7f376e09b700 1 -- 172.21.15.80:0/2018898075 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3768109500 con 0x7f376815fdf0 2019-11-28T12:02:48.625 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.613+0000 7f3767fff700 1 --2- 172.21.15.80:0/2018898075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f376815fdf0 0x7f376812b360 secure :-1 s=THROTTLE_DONE pgs=3168 cs=0 l=1 rx=0x7f3758010390 tx=0x7f3758005ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:48.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.614+0000 7f37657fa700 1 -- 172.21.15.80:0/2018898075 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 208 v208) v1 ==== 95+0+1779 (secure 0 0 0) 0x7f3758025f40 con 0x7f376815fdf0 2019-11-28T12:02:48.626 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 208 2019-11-28T12:02:48.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.616+0000 7f376e09b700 1 -- 172.21.15.80:0/2018898075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f374c018730 msgr2=0x7f374c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:48.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.616+0000 7f376e09b700 1 --2- 172.21.15.80:0/2018898075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f374c018730 0x7f374c01abc0 crc :-1 s=READY pgs=1312 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:48.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.616+0000 7f376e09b700 1 -- 172.21.15.80:0/2018898075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f376815fdf0 msgr2=0x7f376812b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:48.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.616+0000 7f376e09b700 1 --2- 172.21.15.80:0/2018898075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f376815fdf0 0x7f376812b360 secure :-1 s=READY pgs=3168 cs=0 l=1 rx=0x7f3758010390 tx=0x7f3758005ee0).stop 2019-11-28T12:02:48.626 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.616+0000 7f376e09b700 1 -- 172.21.15.80:0/2018898075 shutdown_connections 2019-11-28T12:02:48.627 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.616+0000 7f376e09b700 1 --2- 172.21.15.80:0/2018898075 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f374c018730 0x7f374c01abc0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:48.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.616+0000 7f376e09b700 1 --2- 172.21.15.80:0/2018898075 >> v2:172.21.15.174:3300/0 conn(0x7f376812a3c0 0x7f376812a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:48.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.616+0000 7f376e09b700 1 --2- 172.21.15.80:0/2018898075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f376815fdf0 0x7f376812b360 unknown :-1 s=CLOSED pgs=3168 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:48.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.616+0000 7f376e09b700 1 -- 172.21.15.80:0/2018898075 shutdown_connections 2019-11-28T12:02:48.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.616+0000 7f376e09b700 1 -- 172.21.15.80:0/2018898075 wait complete. 2019-11-28T12:02:48.628 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:48.616+0000 7f376e09b700 1 -- 172.21.15.80:0/2018898075 >> 172.21.15.80:0/2018898075 conn(0x7f3768127dc0 msgr2=0x7f3768141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:48.628 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:48.629 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":208,"default_fscid":20,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":208,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:02:44.233571+0000","modified":"2019-11-28T12:02:47.855920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8537":{"gid":8537,"name":"b","rank":0,"incarnation":208,"state":"up:creating","state_seq":1,"addr":"172.21.15.80:6835/1900497412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1900497412},{"type":"v1","addr":"172.21.15.80:6835","nonce":1900497412}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[41],"metadata_pool":40,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":20}]} 2019-11-28T12:02:48.930 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8537}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 40, u'failed': [], u'epoch': 208, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [41], u'info': {u'gid_8537': {u'export_targets': [], u'name': u'b', u'incarnation': 208, u'state_seq': 1, u'state': u'up:creating', u'gid': 8537, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1900497412, u'type': u'v2', u'addr': u'172.21.15.80:6833'}, {u'nonce': 1900497412, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/1900497412'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T12:02:44.233571+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T12:02:47.855920+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T12:02:48.931 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8537:up:creating 2019-11-28T12:02:49.932 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:50.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.066+0000 7f55db17f700 1 Processor -- start 2019-11-28T12:02:50.075 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.066+0000 7f55db17f700 1 -- start start 2019-11-28T12:02:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55db17f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f55d406c490 0x7f55d406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55db17f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d406ce60 0x7f55d4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55db17f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d406db00 con 0x7f55d406c0a0 2019-11-28T12:02:50.076 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55db17f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d406fd60 con 0x7f55d406c490 2019-11-28T12:02:50.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55db17f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d4070030 con 0x7f55d406ce60 2019-11-28T12:02:50.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55d971c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f55d406c0a0 0x7f55d4072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48024/0 (socket says 172.21.15.80:48024) 2019-11-28T12:02:50.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55d971c700 1 -- 172.21.15.80:0/1465727757 learned_addr learned my addr 172.21.15.80:0/1465727757 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:50.077 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55d9f1d700 1 --2- 172.21.15.80:0/1465727757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d406ce60 0x7f55d4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:50.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55d8f1b700 1 --2- 172.21.15.80:0/1465727757 >> v2:172.21.15.174:3300/0 conn(0x7f55d406c490 0x7f55d406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:50.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55d3fff700 1 -- 172.21.15.80:0/1465727757 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820161718 0 0) 0x7f55cc001150 con 0x7f55d406c0a0 2019-11-28T12:02:50.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55d3fff700 1 -- 172.21.15.80:0/1465727757 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c0002e80 con 0x7f55d406c0a0 2019-11-28T12:02:50.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55d9f1d700 1 -- 172.21.15.80:0/1465727757 >> v2:172.21.15.174:3300/0 conn(0x7f55d406c490 msgr2=0x7f55d406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:50.078 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55d9f1d700 1 --2- 172.21.15.80:0/1465727757 >> v2:172.21.15.174:3300/0 conn(0x7f55d406c490 0x7f55d406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:50.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55d3fff700 1 -- 172.21.15.80:0/1465727757 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 46637823 0 0) 0x7f55cc001130 con 0x7f55d406c0a0 2019-11-28T12:02:50.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55d9f1d700 1 -- 172.21.15.80:0/1465727757 >> v1:172.21.15.80:6789/0 conn(0x7f55d406c0a0 legacy=0x7f55d4072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:50.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55d9f1d700 1 -- 172.21.15.80:0/1465727757 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d40706c0 con 0x7f55d406ce60 2019-11-28T12:02:50.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.067+0000 7f55d9f1d700 1 --2- 172.21.15.80:0/1465727757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d406ce60 0x7f55d4164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f55c400af80 tx=0x7f55c400b710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.068+0000 7f55d9f1d700 1 --2- 172.21.15.80:0/1465727757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d406ce60 0x7f55d4164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f55c400af80 tx=0x7f55c400b710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.079 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.068+0000 7f55d9f1d700 1 --2- 172.21.15.80:0/1465727757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d406ce60 0x7f55d4164d70 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7f55c400af80 tx=0x7f55c400b710).ready entity=mon.2 client_cookie=70129f676cf5c59f server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:50.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.068+0000 7f55d9f1d700 1 --2- 172.21.15.80:0/1465727757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d406ce60 0x7f55d4164d70 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7f55c400af80 tx=0x7f55c400b710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.068+0000 7f55d3fff700 1 -- 172.21.15.80:0/1465727757 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55c4007240 con 0x7f55d406ce60 2019-11-28T12:02:50.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.068+0000 7f55d9f1d700 1 --2- 172.21.15.80:0/1465727757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d406ce60 0x7f55d4164d70 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7f55c400af80 tx=0x7f55c400b710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.068+0000 7f55d9f1d700 1 --2- 172.21.15.80:0/1465727757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d406ce60 0x7f55d4164d70 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7f55c400af80 tx=0x7f55c400b710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.068+0000 7f55d3fff700 1 -- 172.21.15.80:0/1465727757 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c4000b10 con 0x7f55d406ce60 2019-11-28T12:02:50.080 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.068+0000 7f55d3fff700 1 -- 172.21.15.80:0/1465727757 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55c40097f0 con 0x7f55d406ce60 2019-11-28T12:02:50.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.068+0000 7f55db17f700 1 -- 172.21.15.80:0/1465727757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d406ce60 msgr2=0x7f55d4164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:50.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.068+0000 7f55db17f700 1 --2- 172.21.15.80:0/1465727757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d406ce60 0x7f55d4164d70 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7f55c400af80 tx=0x7f55c400b710).stop 2019-11-28T12:02:50.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.068+0000 7f55db17f700 1 -- 172.21.15.80:0/1465727757 shutdown_connections 2019-11-28T12:02:50.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.068+0000 7f55db17f700 1 --2- 172.21.15.80:0/1465727757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d406ce60 0x7f55d4164d70 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:50.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.068+0000 7f55db17f700 1 --2- 172.21.15.80:0/1465727757 >> v2:172.21.15.174:3300/0 conn(0x7f55d406c490 0x7f55d406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:50.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.069+0000 7f55db17f700 1 -- 172.21.15.80:0/1465727757 shutdown_connections 2019-11-28T12:02:50.081 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.069+0000 7f55db17f700 1 -- 172.21.15.80:0/1465727757 wait complete. 2019-11-28T12:02:50.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.069+0000 7f55db17f700 1 -- 172.21.15.80:0/1465727757 >> 172.21.15.80:0/1465727757 conn(0x7f55d4061cf0 msgr2=0x7f55d4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:50.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.071+0000 7f55db17f700 1 Processor -- start 2019-11-28T12:02:50.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.071+0000 7f55db17f700 1 -- start start 2019-11-28T12:02:50.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.072+0000 7f55db17f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f55d4103000 0x7f55d4103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:50.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.072+0000 7f55db17f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d41039d0 0x7f55d4167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:50.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.072+0000 7f55db17f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d41312c0 con 0x7f55d413dc00 2019-11-28T12:02:50.082 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.072+0000 7f55db17f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d4105830 con 0x7f55d4103000 2019-11-28T12:02:50.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.072+0000 7f55db17f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d4105b00 con 0x7f55d41039d0 2019-11-28T12:02:50.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.072+0000 7f55d971c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f55d413dc00 0x7f55d4109e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48030/0 (socket says 172.21.15.80:48030) 2019-11-28T12:02:50.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.072+0000 7f55d971c700 1 -- 172.21.15.80:0/3365059040 learned_addr learned my addr 172.21.15.80:0/3365059040 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:50.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.072+0000 7f55d8f1b700 1 --2- 172.21.15.80:0/3365059040 >> v2:172.21.15.174:3300/0 conn(0x7f55d4103000 0x7f55d4103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:50.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.072+0000 7f55d9f1d700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d41039d0 0x7f55d4167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:50.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.072+0000 7f55d1ffb700 1 -- 172.21.15.80:0/3365059040 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268359979 0 0) 0x7f55cc000f40 con 0x7f55d413dc00 2019-11-28T12:02:50.083 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.072+0000 7f55d1ffb700 1 -- 172.21.15.80:0/3365059040 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55b8002e80 con 0x7f55d413dc00 2019-11-28T12:02:50.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55d1ffb700 1 -- 172.21.15.80:0/3365059040 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 245916136 0 0) 0x7f55cc000c90 con 0x7f55d413dc00 2019-11-28T12:02:50.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55d8f1b700 1 -- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d41039d0 msgr2=0x7f55d4167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:50.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55d8f1b700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d41039d0 0x7f55d4167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:50.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55d8f1b700 1 -- 172.21.15.80:0/3365059040 >> v1:172.21.15.80:6789/0 conn(0x7f55d413dc00 legacy=0x7f55d4109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:50.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55d8f1b700 1 -- 172.21.15.80:0/3365059040 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d4106190 con 0x7f55d4103000 2019-11-28T12:02:50.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55d9f1d700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d41039d0 0x7f55d4167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:50.084 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55d8f1b700 1 --2- 172.21.15.80:0/3365059040 >> v2:172.21.15.174:3300/0 conn(0x7f55d4103000 0x7f55d4103490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f55bc0106f0 tx=0x7f55bc010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55d8f1b700 1 --2- 172.21.15.80:0/3365059040 >> v2:172.21.15.174:3300/0 conn(0x7f55d4103000 0x7f55d4103490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f55bc0106f0 tx=0x7f55bc010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55d8f1b700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d4103000 0x7f55d4103490 secure :-1 s=READY pgs=1923 cs=0 l=1 rx=0x7f55bc0106f0 tx=0x7f55bc010a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:50.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55d8f1b700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d4103000 0x7f55d4103490 secure :-1 s=THROTTLE_DONE pgs=1923 cs=0 l=1 rx=0x7f55bc0106f0 tx=0x7f55bc010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55d1ffb700 1 -- 172.21.15.80:0/3365059040 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55bc002d80 con 0x7f55d4103000 2019-11-28T12:02:50.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55d8f1b700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d4103000 0x7f55d4103490 secure :-1 s=THROTTLE_DONE pgs=1923 cs=0 l=1 rx=0x7f55bc0106f0 tx=0x7f55bc010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.085 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55d8f1b700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d4103000 0x7f55d4103490 secure :-1 s=THROTTLE_DONE pgs=1923 cs=0 l=1 rx=0x7f55bc0106f0 tx=0x7f55bc010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55d1ffb700 1 -- 172.21.15.80:0/3365059040 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc00bee0 con 0x7f55d4103000 2019-11-28T12:02:50.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55d1ffb700 1 -- 172.21.15.80:0/3365059040 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55bc00c6a0 con 0x7f55d4103000 2019-11-28T12:02:50.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55db17f700 1 -- 172.21.15.80:0/3365059040 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d4106510 con 0x7f55d4103000 2019-11-28T12:02:50.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.073+0000 7f55db17f700 1 -- 172.21.15.80:0/3365059040 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d4106190 con 0x7f55d4103000 2019-11-28T12:02:50.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.074+0000 7f55d8f1b700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d4103000 0x7f55d4103490 secure :-1 s=THROTTLE_DONE pgs=1923 cs=0 l=1 rx=0x7f55bc0106f0 tx=0x7f55bc010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.074+0000 7f55d1ffb700 1 -- 172.21.15.80:0/3365059040 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f55bc00bee0 con 0x7f55d4103000 2019-11-28T12:02:50.086 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.074+0000 7f55d8f1b700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d4103000 0x7f55d4103490 secure :-1 s=THROTTLE_DONE pgs=1923 cs=0 l=1 rx=0x7f55bc0106f0 tx=0x7f55bc010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.074+0000 7f55d1ffb700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f55b8018780 0x7f55b801abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:50.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.074+0000 7f55d1ffb700 1 -- 172.21.15.80:0/3365059040 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f55bc031d20 con 0x7f55d4103000 2019-11-28T12:02:50.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.074+0000 7f55d971c700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f55b8018780 0x7f55b801abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:50.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.074+0000 7f55d971c700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f55b8018780 0x7f55b801abf0 crc :-1 s=READY pgs=1313 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:50.087 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.081+0000 7f55db17f700 1 -- 172.21.15.80:0/3365059040 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d4106510 con 0x7f55d4103000 2019-11-28T12:02:50.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.085+0000 7f55d8f1b700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d4103000 0x7f55d4103490 secure :-1 s=THROTTLE_DONE pgs=1923 cs=0 l=1 rx=0x7f55bc0106f0 tx=0x7f55bc010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.088 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.085+0000 7f55d1ffb700 1 -- 172.21.15.80:0/3365059040 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f55bc00bcd0 con 0x7f55d4103000 2019-11-28T12:02:50.248 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.255+0000 7f55db17f700 1 -- 172.21.15.80:0/3365059040 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55d4106190 con 0x7f55d4103000 2019-11-28T12:02:50.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.257+0000 7f55d8f1b700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d4103000 0x7f55d4103490 secure :-1 s=THROTTLE_DONE pgs=1923 cs=0 l=1 rx=0x7f55bc0106f0 tx=0x7f55bc010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.249 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.257+0000 7f55d1ffb700 1 -- 172.21.15.80:0/3365059040 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 209 v209) v1 ==== 95+0+1777 (secure 0 0 0) 0x7f55bc00bee0 con 0x7f55d4103000 2019-11-28T12:02:50.250 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 209 2019-11-28T12:02:50.250 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:50.250 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":209,"default_fscid":20,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":209,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:02:44.233571+0000","modified":"2019-11-28T12:02:48.857049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8537":{"gid":8537,"name":"b","rank":0,"incarnation":208,"state":"up:active","state_seq":2,"addr":"172.21.15.80:6835/1900497412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1900497412},{"type":"v1","addr":"172.21.15.80:6835","nonce":1900497412}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[41],"metadata_pool":40,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":20}]} 2019-11-28T12:02:50.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.258+0000 7f55db17f700 1 -- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f55b8018780 msgr2=0x7f55b801abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:50.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.258+0000 7f55db17f700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f55b8018780 0x7f55b801abf0 crc :-1 s=READY pgs=1313 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:50.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.258+0000 7f55db17f700 1 -- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d4103000 msgr2=0x7f55d4103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:50.251 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.258+0000 7f55db17f700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d4103000 0x7f55d4103490 secure :-1 s=READY pgs=1923 cs=0 l=1 rx=0x7f55bc0106f0 tx=0x7f55bc010a90).stop 2019-11-28T12:02:50.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.258+0000 7f55db17f700 1 -- 172.21.15.80:0/3365059040 shutdown_connections 2019-11-28T12:02:50.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.258+0000 7f55db17f700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f55b8018780 0x7f55b801abf0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:50.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.258+0000 7f55db17f700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d41039d0 0x7f55d4167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:50.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.258+0000 7f55db17f700 1 --2- 172.21.15.80:0/3365059040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d4103000 0x7f55d4103490 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:50.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.258+0000 7f55db17f700 1 -- 172.21.15.80:0/3365059040 shutdown_connections 2019-11-28T12:02:50.252 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.258+0000 7f55db17f700 1 -- 172.21.15.80:0/3365059040 wait complete. 2019-11-28T12:02:50.253 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.258+0000 7f55db17f700 1 -- 172.21.15.80:0/3365059040 >> 172.21.15.80:0/3365059040 conn(0x7f55d411bfc0 msgr2=0x7f55d4141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:50.563 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8537}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 40, u'failed': [], u'epoch': 209, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [41], u'info': {u'gid_8537': {u'export_targets': [], u'name': u'b', u'incarnation': 208, u'state_seq': 2, u'state': u'up:active', u'gid': 8537, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1900497412, u'type': u'v2', u'addr': u'172.21.15.80:6833'}, {u'nonce': 1900497412, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/1900497412'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T12:02:44.233571+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T12:02:48.857049+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T12:02:50.564 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T12:02:50.564 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-11-28T12:02:50.691 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T12:02:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T12:02:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T12:02:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 8537, 2019-11-28T12:02:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2019-11-28T12:02:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2019-11-28T12:02:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 2.8421651190000001, 2019-11-28T12:02:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 209, 2019-11-28T12:02:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 247, 2019-11-28T12:02:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 247, 2019-11-28T12:02:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 3.670068106 2019-11-28T12:02:50.694 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T12:02:50.698 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8537, "want_state": "up:active", "state": "up:active", "rank_uptime": 2.8421651190000001, "mdsmap_epoch": 209, "osdmap_epoch": 247, "osdmap_epoch_barrier": 247, "uptime": 3.670068106 } 2019-11-28T12:02:50.698 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T12:02:50.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.826+0000 7fa64887b700 1 Processor -- start 2019-11-28T12:02:50.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.826+0000 7fa64887b700 1 -- start start 2019-11-28T12:02:50.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.827+0000 7fa64887b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa64406c0a0 0x7fa644072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:50.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.827+0000 7fa64887b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa6440734e0 0x7fa644071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:50.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.827+0000 7fa64887b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa644072360 0x7fa644072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:50.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.827+0000 7fa64887b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa64406fd60 con 0x7fa6440734e0 2019-11-28T12:02:50.825 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.827+0000 7fa64887b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa644070030 con 0x7fa64406c0a0 2019-11-28T12:02:50.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.827+0000 7fa64887b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64406f330 con 0x7fa644072360 2019-11-28T12:02:50.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.827+0000 7fa64259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa6440734e0 0x7fa644071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:50.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.827+0000 7fa64259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa6440734e0 0x7fa644071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48724/0 (socket says 172.21.15.80:48724) 2019-11-28T12:02:50.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.827+0000 7fa64259c700 1 -- 172.21.15.80:0/2991974182 learned_addr learned my addr 172.21.15.80:0/2991974182 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:50.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.827+0000 7fa642d9d700 1 --2- 172.21.15.80:0/2991974182 >> v2:172.21.15.174:3300/0 conn(0x7fa64406c0a0 0x7fa644072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:50.826 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.827+0000 7fa64359e700 1 --2- 172.21.15.80:0/2991974182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa644072360 0x7fa644072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:50.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.828+0000 7fa64259c700 1 -- 172.21.15.80:0/2991974182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa644072360 msgr2=0x7fa644072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:50.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.828+0000 7fa64259c700 1 --2- 172.21.15.80:0/2991974182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa644072360 0x7fa644072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:50.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.828+0000 7fa64259c700 1 -- 172.21.15.80:0/2991974182 >> v2:172.21.15.174:3300/0 conn(0x7fa64406c0a0 msgr2=0x7fa644072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:50.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.828+0000 7fa64259c700 1 --2- 172.21.15.80:0/2991974182 >> v2:172.21.15.174:3300/0 conn(0x7fa64406c0a0 0x7fa644072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:50.827 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.828+0000 7fa64259c700 1 -- 172.21.15.80:0/2991974182 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6440706c0 con 0x7fa6440734e0 2019-11-28T12:02:50.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.828+0000 7fa64259c700 1 --2- 172.21.15.80:0/2991974182 >> v2:172.21.15.80:3300/0 conn(0x7fa6440734e0 0x7fa644071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa62c00f6c0 tx=0x7fa62c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.828+0000 7fa64259c700 1 --2- 172.21.15.80:0/2991974182 >> v2:172.21.15.80:3300/0 conn(0x7fa6440734e0 0x7fa644071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa62c00f6c0 tx=0x7fa62c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.828+0000 7fa64259c700 1 --2- 172.21.15.80:0/2991974182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6440734e0 0x7fa644071e20 secure :-1 s=READY pgs=3171 cs=0 l=1 rx=0x7fa62c00f6c0 tx=0x7fa62c00f570).ready entity=mon.0 client_cookie=bb7f41b9516db9a3 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:50.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.828+0000 7fa64259c700 1 --2- 172.21.15.80:0/2991974182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6440734e0 0x7fa644071e20 secure :-1 s=THROTTLE_DONE pgs=3171 cs=0 l=1 rx=0x7fa62c00f6c0 tx=0x7fa62c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.828+0000 7fa64259c700 1 --2- 172.21.15.80:0/2991974182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6440734e0 0x7fa644071e20 secure :-1 s=THROTTLE_DONE pgs=3171 cs=0 l=1 rx=0x7fa62c00f6c0 tx=0x7fa62c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.828+0000 7fa641d9b700 1 -- 172.21.15.80:0/2991974182 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa62c000960 con 0x7fa6440734e0 2019-11-28T12:02:50.828 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.828+0000 7fa64259c700 1 --2- 172.21.15.80:0/2991974182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6440734e0 0x7fa644071e20 secure :-1 s=THROTTLE_DONE pgs=3171 cs=0 l=1 rx=0x7fa62c00f6c0 tx=0x7fa62c00f570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.828+0000 7fa641d9b700 1 -- 172.21.15.80:0/2991974182 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c000c90 con 0x7fa6440734e0 2019-11-28T12:02:50.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.828+0000 7fa641d9b700 1 -- 172.21.15.80:0/2991974182 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa62c0013a0 con 0x7fa6440734e0 2019-11-28T12:02:50.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.828+0000 7fa64887b700 1 -- 172.21.15.80:0/2991974182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6440734e0 msgr2=0x7fa644071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:50.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.828+0000 7fa64887b700 1 --2- 172.21.15.80:0/2991974182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6440734e0 0x7fa644071e20 secure :-1 s=READY pgs=3171 cs=0 l=1 rx=0x7fa62c00f6c0 tx=0x7fa62c00f570).stop 2019-11-28T12:02:50.829 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.829+0000 7fa64887b700 1 -- 172.21.15.80:0/2991974182 shutdown_connections 2019-11-28T12:02:50.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.829+0000 7fa64887b700 1 --2- 172.21.15.80:0/2991974182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa644072360 0x7fa644072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:50.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.829+0000 7fa64887b700 1 --2- 172.21.15.80:0/2991974182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6440734e0 0x7fa644071e20 unknown :-1 s=CLOSED pgs=3171 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:50.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.829+0000 7fa64887b700 1 --2- 172.21.15.80:0/2991974182 >> v2:172.21.15.174:3300/0 conn(0x7fa64406c0a0 0x7fa644072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:50.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.829+0000 7fa64887b700 1 -- 172.21.15.80:0/2991974182 shutdown_connections 2019-11-28T12:02:50.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.829+0000 7fa64887b700 1 -- 172.21.15.80:0/2991974182 wait complete. 2019-11-28T12:02:50.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.829+0000 7fa64887b700 1 -- 172.21.15.80:0/2991974182 >> 172.21.15.80:0/2991974182 conn(0x7fa644061cf0 msgr2=0x7fa644064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:50.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.831+0000 7fa64887b700 1 Processor -- start 2019-11-28T12:02:50.831 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.831+0000 7fa64887b700 1 -- start start 2019-11-28T12:02:50.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.832+0000 7fa64887b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa64415fdf0 0x7fa64412b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:50.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.832+0000 7fa64887b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa64412a3c0 0x7fa64412a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:50.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.832+0000 7fa64887b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64413eb20 con 0x7fa64412b8a0 2019-11-28T12:02:50.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.832+0000 7fa64887b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa644108820 con 0x7fa64415fdf0 2019-11-28T12:02:50.832 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.832+0000 7fa64887b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa644108af0 con 0x7fa64412a3c0 2019-11-28T12:02:50.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.832+0000 7fa642d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa64415fdf0 0x7fa64412b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:50.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.832+0000 7fa642d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa64415fdf0 0x7fa64412b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48726/0 (socket says 172.21.15.80:48726) 2019-11-28T12:02:50.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.832+0000 7fa642d9d700 1 -- 172.21.15.80:0/2696593188 learned_addr learned my addr 172.21.15.80:0/2696593188 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:50.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.832+0000 7fa64359e700 1 --2- 172.21.15.80:0/2696593188 >> v2:172.21.15.174:3300/0 conn(0x7fa64412a3c0 0x7fa64412a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:50.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.832+0000 7fa642d9d700 1 -- 172.21.15.80:0/2696593188 >> v2:172.21.15.174:3300/0 conn(0x7fa64412a3c0 msgr2=0x7fa64412a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:50.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.832+0000 7fa642d9d700 1 --2- 172.21.15.80:0/2696593188 >> v2:172.21.15.174:3300/0 conn(0x7fa64412a3c0 0x7fa64412a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:50.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.832+0000 7fa642d9d700 1 -- 172.21.15.80:0/2696593188 >> v1:172.21.15.174:6789/0 conn(0x7fa64412b8a0 legacy=0x7fa64413e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:50.850 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.832+0000 7fa642d9d700 1 -- 172.21.15.80:0/2696593188 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64410a8c0 con 0x7fa64415fdf0 2019-11-28T12:02:50.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.832+0000 7fa642d9d700 1 --2- 172.21.15.80:0/2696593188 >> v2:172.21.15.80:3300/0 conn(0x7fa64415fdf0 0x7fa64412b360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa6340107d0 tx=0x7fa634010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.833+0000 7fa642d9d700 1 --2- 172.21.15.80:0/2696593188 >> v2:172.21.15.80:3300/0 conn(0x7fa64415fdf0 0x7fa64412b360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa6340107d0 tx=0x7fa634010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.833+0000 7fa642d9d700 1 --2- 172.21.15.80:0/2696593188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa64415fdf0 0x7fa64412b360 secure :-1 s=READY pgs=3172 cs=0 l=1 rx=0x7fa6340107d0 tx=0x7fa634010600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:50.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.833+0000 7fa642d9d700 1 --2- 172.21.15.80:0/2696593188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa64415fdf0 0x7fa64412b360 secure :-1 s=THROTTLE_DONE pgs=3172 cs=0 l=1 rx=0x7fa6340107d0 tx=0x7fa634010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.833+0000 7fa642d9d700 1 --2- 172.21.15.80:0/2696593188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa64415fdf0 0x7fa64412b360 secure :-1 s=THROTTLE_DONE pgs=3172 cs=0 l=1 rx=0x7fa6340107d0 tx=0x7fa634010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.851 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.833+0000 7fa642d9d700 1 --2- 172.21.15.80:0/2696593188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa64415fdf0 0x7fa64412b360 secure :-1 s=THROTTLE_DONE pgs=3172 cs=0 l=1 rx=0x7fa6340107d0 tx=0x7fa634010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.833+0000 7fa63b7fe700 1 -- 172.21.15.80:0/2696593188 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa634000cc0 con 0x7fa64415fdf0 2019-11-28T12:02:50.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.833+0000 7fa63b7fe700 1 -- 172.21.15.80:0/2696593188 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa634001200 con 0x7fa64415fdf0 2019-11-28T12:02:50.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.833+0000 7fa64887b700 1 -- 172.21.15.80:0/2696593188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64410a8c0 con 0x7fa64415fdf0 2019-11-28T12:02:50.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.833+0000 7fa63b7fe700 1 -- 172.21.15.80:0/2696593188 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa634001850 con 0x7fa64415fdf0 2019-11-28T12:02:50.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.833+0000 7fa64887b700 1 -- 172.21.15.80:0/2696593188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64410a8c0 con 0x7fa64415fdf0 2019-11-28T12:02:50.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.833+0000 7fa642d9d700 1 --2- 172.21.15.80:0/2696593188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa64415fdf0 0x7fa64412b360 secure :-1 s=THROTTLE_DONE pgs=3172 cs=0 l=1 rx=0x7fa6340107d0 tx=0x7fa634010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.833+0000 7fa63b7fe700 1 -- 172.21.15.80:0/2696593188 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fa6340013f0 con 0x7fa64415fdf0 2019-11-28T12:02:50.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.833+0000 7fa642d9d700 1 --2- 172.21.15.80:0/2696593188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa64415fdf0 0x7fa64412b360 secure :-1 s=THROTTLE_DONE pgs=3172 cs=0 l=1 rx=0x7fa6340107d0 tx=0x7fa634010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.834+0000 7fa63b7fe700 1 --2- 172.21.15.80:0/2696593188 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa61c018730 0x7fa61c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:50.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.834+0000 7fa63b7fe700 1 -- 172.21.15.80:0/2696593188 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa634031e60 con 0x7fa64415fdf0 2019-11-28T12:02:50.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.834+0000 7fa64259c700 1 --2- 172.21.15.80:0/2696593188 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa61c018730 0x7fa61c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:50.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.834+0000 7fa64259c700 1 --2- 172.21.15.80:0/2696593188 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa61c018730 0x7fa61c01abc0 crc :-1 s=READY pgs=1314 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:50.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.841+0000 7fa64887b700 1 -- 172.21.15.80:0/2696593188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa644109180 con 0x7fa64415fdf0 2019-11-28T12:02:50.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.845+0000 7fa642d9d700 1 --2- 172.21.15.80:0/2696593188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa64415fdf0 0x7fa64412b360 secure :-1 s=THROTTLE_DONE pgs=3172 cs=0 l=1 rx=0x7fa6340107d0 tx=0x7fa634010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:50.854 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:50.845+0000 7fa63b7fe700 1 -- 172.21.15.80:0/2696593188 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fa63402f1e0 con 0x7fa64415fdf0 2019-11-28T12:02:51.013 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.020+0000 7fa64887b700 1 -- 172.21.15.80:0/2696593188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa644109500 con 0x7fa64415fdf0 2019-11-28T12:02:51.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.021+0000 7fa642d9d700 1 --2- 172.21.15.80:0/2696593188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa64415fdf0 0x7fa64412b360 secure :-1 s=THROTTLE_DONE pgs=3172 cs=0 l=1 rx=0x7fa6340107d0 tx=0x7fa634010600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.015 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.021+0000 7fa63b7fe700 1 -- 172.21.15.80:0/2696593188 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v247) v1 ==== 74+0+14871 (secure 0 0 0) 0x7fa63402f1e0 con 0x7fa64415fdf0 2019-11-28T12:02:51.015 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:51.016 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":247,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T12:02:45.235154+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":41,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":40,"pool_name":"cephfs_metadata","create_time":"2019-11-28T12:02:42.568808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"246","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":41,"pool_name":"cephfs_data","create_time":"2019-11-28T12:02:43.256218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"247","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":244,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":244,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T12:02:51.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.023+0000 7fa64887b700 1 -- 172.21.15.80:0/2696593188 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa61c018730 msgr2=0x7fa61c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.023+0000 7fa64887b700 1 --2- 172.21.15.80:0/2696593188 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa61c018730 0x7fa61c01abc0 crc :-1 s=READY pgs=1314 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:51.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.023+0000 7fa64887b700 1 -- 172.21.15.80:0/2696593188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa64415fdf0 msgr2=0x7fa64412b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.018 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.023+0000 7fa64887b700 1 --2- 172.21.15.80:0/2696593188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa64415fdf0 0x7fa64412b360 secure :-1 s=READY pgs=3172 cs=0 l=1 rx=0x7fa6340107d0 tx=0x7fa634010600).stop 2019-11-28T12:02:51.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.023+0000 7fa64887b700 1 -- 172.21.15.80:0/2696593188 shutdown_connections 2019-11-28T12:02:51.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.023+0000 7fa64887b700 1 --2- 172.21.15.80:0/2696593188 >> v2:172.21.15.174:3300/0 conn(0x7fa64412a3c0 0x7fa64412a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:51.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.023+0000 7fa64887b700 1 --2- 172.21.15.80:0/2696593188 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fa61c018730 0x7fa61c01abc0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:51.019 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.023+0000 7fa64887b700 1 --2- 172.21.15.80:0/2696593188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa64415fdf0 0x7fa64412b360 unknown :-1 s=CLOSED pgs=3172 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:51.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.023+0000 7fa64887b700 1 -- 172.21.15.80:0/2696593188 shutdown_connections 2019-11-28T12:02:51.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.023+0000 7fa64887b700 1 -- 172.21.15.80:0/2696593188 wait complete. 2019-11-28T12:02:51.020 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.023+0000 7fa64887b700 1 -- 172.21.15.80:0/2696593188 >> 172.21.15.80:0/2696593188 conn(0x7fa644127dc0 msgr2=0x7fa644141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:51.033 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T12:02:42.568808+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 40, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'246', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T12:02:43.256218+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 41, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'247', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T12:02:51.035 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T12:02:51.164 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.167+0000 7fb65742b700 1 Processor -- start 2019-11-28T12:02:51.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.167+0000 7fb65742b700 1 -- start start 2019-11-28T12:02:51.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.168+0000 7fb65742b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb65015f100 0x7fb65006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:51.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.168+0000 7fb65742b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb65006db60 con 0x7fb65015ed10 2019-11-28T12:02:51.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.168+0000 7fb65742b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb65006e060 con 0x7fb65006c2f0 2019-11-28T12:02:51.165 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.168+0000 7fb65742b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65006fe00 con 0x7fb65015f100 2019-11-28T12:02:51.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.168+0000 7fb6559c8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb65015ed10 0x7fb650073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48050/0 (socket says 172.21.15.80:48050) 2019-11-28T12:02:51.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.168+0000 7fb6559c8700 1 -- 172.21.15.80:0/1931689555 learned_addr learned my addr 172.21.15.80:0/1931689555 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:51.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.168+0000 7fb6551c7700 1 --2- 172.21.15.80:0/1931689555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb65015f100 0x7fb65006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:51.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb6549c6700 1 -- 172.21.15.80:0/1931689555 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606814444 0 0) 0x7fb640001150 con 0x7fb65015ed10 2019-11-28T12:02:51.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb6549c6700 1 -- 172.21.15.80:0/1931689555 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb638002e80 con 0x7fb65015ed10 2019-11-28T12:02:51.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb6549c6700 1 -- 172.21.15.80:0/1931689555 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629151805 0 0) 0x7fb648000d30 con 0x7fb65006c2f0 2019-11-28T12:02:51.166 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb6549c6700 1 -- 172.21.15.80:0/1931689555 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb638004170 con 0x7fb65006c2f0 2019-11-28T12:02:51.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb6551c7700 1 -- 172.21.15.80:0/1931689555 >> v1:172.21.15.174:6789/0 conn(0x7fb65006c2f0 legacy=0x7fb65006c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb6551c7700 1 -- 172.21.15.80:0/1931689555 >> v1:172.21.15.80:6789/0 conn(0x7fb65015ed10 legacy=0x7fb650073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb6551c7700 1 -- 172.21.15.80:0/1931689555 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb650070760 con 0x7fb65015f100 2019-11-28T12:02:51.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb6551c7700 1 --2- 172.21.15.80:0/1931689555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb65015f100 0x7fb65006bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb64400af50 tx=0x7fb64400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb6551c7700 1 --2- 172.21.15.80:0/1931689555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb65015f100 0x7fb65006bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb64400af50 tx=0x7fb64400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb6551c7700 1 --2- 172.21.15.80:0/1931689555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb65015f100 0x7fb65006bdb0 secure :-1 s=READY pgs=461 cs=0 l=1 rx=0x7fb64400af50 tx=0x7fb64400b760).ready entity=mon.2 client_cookie=b7998f3226ad059e server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:51.167 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb6551c7700 1 --2- 172.21.15.80:0/1931689555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb65015f100 0x7fb65006bdb0 secure :-1 s=THROTTLE_DONE pgs=461 cs=0 l=1 rx=0x7fb64400af50 tx=0x7fb64400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb6549c6700 1 -- 172.21.15.80:0/1931689555 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb644000960 con 0x7fb65015f100 2019-11-28T12:02:51.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb6551c7700 1 --2- 172.21.15.80:0/1931689555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb65015f100 0x7fb65006bdb0 secure :-1 s=THROTTLE_DONE pgs=461 cs=0 l=1 rx=0x7fb64400af50 tx=0x7fb64400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb6551c7700 1 --2- 172.21.15.80:0/1931689555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb65015f100 0x7fb65006bdb0 secure :-1 s=THROTTLE_DONE pgs=461 cs=0 l=1 rx=0x7fb64400af50 tx=0x7fb64400b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb6549c6700 1 -- 172.21.15.80:0/1931689555 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb644009860 con 0x7fb65015f100 2019-11-28T12:02:51.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb6549c6700 1 -- 172.21.15.80:0/1931689555 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb644009f30 con 0x7fb65015f100 2019-11-28T12:02:51.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb65742b700 1 -- 172.21.15.80:0/1931689555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb65015f100 msgr2=0x7fb65006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.168 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.169+0000 7fb65742b700 1 --2- 172.21.15.80:0/1931689555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb65015f100 0x7fb65006bdb0 secure :-1 s=READY pgs=461 cs=0 l=1 rx=0x7fb64400af50 tx=0x7fb64400b760).stop 2019-11-28T12:02:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.170+0000 7fb65742b700 1 -- 172.21.15.80:0/1931689555 shutdown_connections 2019-11-28T12:02:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.170+0000 7fb65742b700 1 --2- 172.21.15.80:0/1931689555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb65015f100 0x7fb65006bdb0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.170+0000 7fb65742b700 1 -- 172.21.15.80:0/1931689555 shutdown_connections 2019-11-28T12:02:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.170+0000 7fb65742b700 1 -- 172.21.15.80:0/1931689555 wait complete. 2019-11-28T12:02:51.169 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.170+0000 7fb65742b700 1 -- 172.21.15.80:0/1931689555 >> 172.21.15.80:0/1931689555 conn(0x7fb650061d20 msgr2=0x7fb6500641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:51.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.172+0000 7fb65742b700 1 Processor -- start 2019-11-28T12:02:51.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.172+0000 7fb65742b700 1 -- start start 2019-11-28T12:02:51.170 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.173+0000 7fb65742b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb650127280 0x7fb650079840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:51.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.173+0000 7fb65742b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb650162a90 con 0x7fb65012e9a0 2019-11-28T12:02:51.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.173+0000 7fb65742b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb650165e70 con 0x7fb650079d80 2019-11-28T12:02:51.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.173+0000 7fb65742b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb650075800 con 0x7fb650127280 2019-11-28T12:02:51.173 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.173+0000 7fb6561c9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb65012e9a0 0x7fb650077830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48058/0 (socket says 172.21.15.80:48058) 2019-11-28T12:02:51.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.173+0000 7fb6561c9700 1 -- 172.21.15.80:0/161801546 learned_addr learned my addr 172.21.15.80:0/161801546 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:51.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.173+0000 7fb6559c8700 1 --2- 172.21.15.80:0/161801546 >> v2:172.21.15.174:3300/0 conn(0x7fb650127280 0x7fb650079840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:51.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb64e7fc700 1 -- 172.21.15.80:0/161801546 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705328728 0 0) 0x7fb648001430 con 0x7fb65012e9a0 2019-11-28T12:02:51.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb64e7fc700 1 -- 172.21.15.80:0/161801546 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb630002e80 con 0x7fb65012e9a0 2019-11-28T12:02:51.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb6559c8700 1 -- 172.21.15.80:0/161801546 >> v1:172.21.15.174:6789/0 conn(0x7fb650079d80 legacy=0x7fb650165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb64e7fc700 1 -- 172.21.15.80:0/161801546 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468875889 0 0) 0x7fb64400b3d0 con 0x7fb650079d80 2019-11-28T12:02:51.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb6559c8700 1 -- 172.21.15.80:0/161801546 >> v1:172.21.15.80:6789/0 conn(0x7fb65012e9a0 legacy=0x7fb650077830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb6559c8700 1 -- 172.21.15.80:0/161801546 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb650076160 con 0x7fb650127280 2019-11-28T12:02:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb6559c8700 1 --2- 172.21.15.80:0/161801546 >> v2:172.21.15.174:3300/0 conn(0x7fb650127280 0x7fb650079840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb640010380 tx=0x7fb640010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb6559c8700 1 --2- 172.21.15.80:0/161801546 >> v2:172.21.15.174:3300/0 conn(0x7fb650127280 0x7fb650079840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb640010380 tx=0x7fb640010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb6559c8700 1 --2- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb650127280 0x7fb650079840 secure :-1 s=READY pgs=1927 cs=0 l=1 rx=0x7fb640010380 tx=0x7fb640010720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb6559c8700 1 --2- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb650127280 0x7fb650079840 secure :-1 s=THROTTLE_DONE pgs=1927 cs=0 l=1 rx=0x7fb640010380 tx=0x7fb640010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb64e7fc700 1 -- 172.21.15.80:0/161801546 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb64000f130 con 0x7fb650127280 2019-11-28T12:02:51.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb6559c8700 1 --2- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb650127280 0x7fb650079840 secure :-1 s=THROTTLE_DONE pgs=1927 cs=0 l=1 rx=0x7fb640010380 tx=0x7fb640010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb65742b700 1 -- 172.21.15.80:0/161801546 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6500764e0 con 0x7fb650127280 2019-11-28T12:02:51.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb64e7fc700 1 -- 172.21.15.80:0/161801546 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64000ed50 con 0x7fb650127280 2019-11-28T12:02:51.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb6559c8700 1 --2- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb650127280 0x7fb650079840 secure :-1 s=THROTTLE_DONE pgs=1927 cs=0 l=1 rx=0x7fb640010380 tx=0x7fb640010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb64e7fc700 1 -- 172.21.15.80:0/161801546 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb64000ef40 con 0x7fb650127280 2019-11-28T12:02:51.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.174+0000 7fb65742b700 1 -- 172.21.15.80:0/161801546 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb650076160 con 0x7fb650127280 2019-11-28T12:02:51.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.175+0000 7fb6559c8700 1 --2- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb650127280 0x7fb650079840 secure :-1 s=THROTTLE_DONE pgs=1927 cs=0 l=1 rx=0x7fb640010380 tx=0x7fb640010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.175+0000 7fb64e7fc700 1 -- 172.21.15.80:0/161801546 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb64000ef40 con 0x7fb650127280 2019-11-28T12:02:51.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.175+0000 7fb6559c8700 1 --2- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb650127280 0x7fb650079840 secure :-1 s=THROTTLE_DONE pgs=1927 cs=0 l=1 rx=0x7fb640010380 tx=0x7fb640010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.175+0000 7fb64e7fc700 1 --2- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb630018780 0x7fb63001ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:51.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.175+0000 7fb64e7fc700 1 -- 172.21.15.80:0/161801546 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb640031cc0 con 0x7fb650127280 2019-11-28T12:02:51.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.175+0000 7fb6551c7700 1 --2- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb630018780 0x7fb63001ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:51.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.176+0000 7fb6551c7700 1 --2- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb630018780 0x7fb63001ac10 crc :-1 s=READY pgs=1315 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:51.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.182+0000 7fb65742b700 1 -- 172.21.15.80:0/161801546 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6500764e0 con 0x7fb650127280 2019-11-28T12:02:51.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.186+0000 7fb6559c8700 1 --2- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb650127280 0x7fb650079840 secure :-1 s=THROTTLE_DONE pgs=1927 cs=0 l=1 rx=0x7fb640010380 tx=0x7fb640010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.186+0000 7fb64e7fc700 1 -- 172.21.15.80:0/161801546 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb64000ea50 con 0x7fb650127280 2019-11-28T12:02:51.350 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.357+0000 7fb65742b700 1 -- 172.21.15.80:0/161801546 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fb650076160 con 0x7fb650127280 2019-11-28T12:02:51.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.358+0000 7fb6559c8700 1 --2- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb650127280 0x7fb650079840 secure :-1 s=THROTTLE_DONE pgs=1927 cs=0 l=1 rx=0x7fb640010380 tx=0x7fb640010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.351 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.358+0000 7fb64e7fc700 1 -- 172.21.15.80:0/161801546 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v247) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb64000ed50 con 0x7fb650127280 2019-11-28T12:02:51.351 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:02:51.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.360+0000 7fb65742b700 1 -- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb630018780 msgr2=0x7fb63001ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.360+0000 7fb65742b700 1 --2- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb630018780 0x7fb63001ac10 crc :-1 s=READY pgs=1315 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:51.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.360+0000 7fb65742b700 1 -- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb650127280 msgr2=0x7fb650079840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.354 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.360+0000 7fb65742b700 1 --2- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb650127280 0x7fb650079840 secure :-1 s=READY pgs=1927 cs=0 l=1 rx=0x7fb640010380 tx=0x7fb640010720).stop 2019-11-28T12:02:51.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.360+0000 7fb65742b700 1 -- 172.21.15.80:0/161801546 shutdown_connections 2019-11-28T12:02:51.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.360+0000 7fb65742b700 1 --2- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb630018780 0x7fb63001ac10 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:51.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.360+0000 7fb65742b700 1 --2- 172.21.15.80:0/161801546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb650127280 0x7fb650079840 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:51.355 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.360+0000 7fb65742b700 1 -- 172.21.15.80:0/161801546 shutdown_connections 2019-11-28T12:02:51.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.360+0000 7fb65742b700 1 -- 172.21.15.80:0/161801546 wait complete. 2019-11-28T12:02:51.356 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.360+0000 7fb65742b700 1 -- 172.21.15.80:0/161801546 >> 172.21.15.80:0/161801546 conn(0x7fb650166440 msgr2=0x7fb6501494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:51.363 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T12:02:51.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.496+0000 7fb32a693700 1 Processor -- start 2019-11-28T12:02:51.493 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.496+0000 7fb32a693700 1 -- start start 2019-11-28T12:02:51.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.497+0000 7fb32a693700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3241639f0 0x7fb324165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:51.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.497+0000 7fb32a693700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32406db60 con 0x7fb32415f100 2019-11-28T12:02:51.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.497+0000 7fb32a693700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32406e060 con 0x7fb32415ed10 2019-11-28T12:02:51.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.497+0000 7fb32a693700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32406fe00 con 0x7fb3241639f0 2019-11-28T12:02:51.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.497+0000 7fb323fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb32415f100 0x7fb32406bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48066/0 (socket says 172.21.15.80:48066) 2019-11-28T12:02:51.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.497+0000 7fb323fff700 1 -- 172.21.15.80:0/2855778037 learned_addr learned my addr 172.21.15.80:0/2855778037 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:51.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.497+0000 7fb329431700 1 --2- 172.21.15.80:0/2855778037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3241639f0 0x7fb324165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:51.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.497+0000 7fb3237fe700 1 -- 172.21.15.80:0/2855778037 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809318932 0 0) 0x7fb3140014d0 con 0x7fb32415f100 2019-11-28T12:02:51.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.497+0000 7fb3237fe700 1 -- 172.21.15.80:0/2855778037 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb310002e80 con 0x7fb32415f100 2019-11-28T12:02:51.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.497+0000 7fb3237fe700 1 -- 172.21.15.80:0/2855778037 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378351830 0 0) 0x7fb30c001080 con 0x7fb32415ed10 2019-11-28T12:02:51.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.497+0000 7fb3237fe700 1 -- 172.21.15.80:0/2855778037 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3100030b0 con 0x7fb32415ed10 2019-11-28T12:02:51.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.497+0000 7fb329431700 1 -- 172.21.15.80:0/2855778037 >> v1:172.21.15.174:6789/0 conn(0x7fb32415ed10 legacy=0x7fb324073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.497+0000 7fb329431700 1 -- 172.21.15.80:0/2855778037 >> v1:172.21.15.80:6789/0 conn(0x7fb32415f100 legacy=0x7fb32406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.497+0000 7fb3237fe700 1 -- 172.21.15.80:0/2855778037 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 160945791 0 0) 0x7fb3140014b0 con 0x7fb32415f100 2019-11-28T12:02:51.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.497+0000 7fb329431700 1 -- 172.21.15.80:0/2855778037 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb324070760 con 0x7fb3241639f0 2019-11-28T12:02:51.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.497+0000 7fb329431700 1 --2- 172.21.15.80:0/2855778037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3241639f0 0x7fb324165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb31c00af80 tx=0x7fb31c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.498+0000 7fb329431700 1 --2- 172.21.15.80:0/2855778037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3241639f0 0x7fb324165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb31c00af80 tx=0x7fb31c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.498+0000 7fb329431700 1 --2- 172.21.15.80:0/2855778037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3241639f0 0x7fb324165df0 secure :-1 s=READY pgs=462 cs=0 l=1 rx=0x7fb31c00af80 tx=0x7fb31c00b790).ready entity=mon.2 client_cookie=dccfa4671529ef68 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:51.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.498+0000 7fb329431700 1 --2- 172.21.15.80:0/2855778037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3241639f0 0x7fb324165df0 secure :-1 s=THROTTLE_DONE pgs=462 cs=0 l=1 rx=0x7fb31c00af80 tx=0x7fb31c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.498+0000 7fb3237fe700 1 -- 172.21.15.80:0/2855778037 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb31c007240 con 0x7fb3241639f0 2019-11-28T12:02:51.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.498+0000 7fb329431700 1 --2- 172.21.15.80:0/2855778037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3241639f0 0x7fb324165df0 secure :-1 s=THROTTLE_DONE pgs=462 cs=0 l=1 rx=0x7fb31c00af80 tx=0x7fb31c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.498+0000 7fb329431700 1 --2- 172.21.15.80:0/2855778037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3241639f0 0x7fb324165df0 secure :-1 s=THROTTLE_DONE pgs=462 cs=0 l=1 rx=0x7fb31c00af80 tx=0x7fb31c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.498+0000 7fb3237fe700 1 -- 172.21.15.80:0/2855778037 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c0097f0 con 0x7fb3241639f0 2019-11-28T12:02:51.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.498+0000 7fb3237fe700 1 -- 172.21.15.80:0/2855778037 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb31c0099e0 con 0x7fb3241639f0 2019-11-28T12:02:51.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.498+0000 7fb32a693700 1 -- 172.21.15.80:0/2855778037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3241639f0 msgr2=0x7fb324165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.498+0000 7fb32a693700 1 --2- 172.21.15.80:0/2855778037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3241639f0 0x7fb324165df0 secure :-1 s=READY pgs=462 cs=0 l=1 rx=0x7fb31c00af80 tx=0x7fb31c00b790).stop 2019-11-28T12:02:51.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.498+0000 7fb32a693700 1 -- 172.21.15.80:0/2855778037 shutdown_connections 2019-11-28T12:02:51.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.498+0000 7fb32a693700 1 --2- 172.21.15.80:0/2855778037 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb3241639f0 0x7fb324165df0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:51.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.498+0000 7fb32a693700 1 -- 172.21.15.80:0/2855778037 shutdown_connections 2019-11-28T12:02:51.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.499+0000 7fb32a693700 1 -- 172.21.15.80:0/2855778037 wait complete. 2019-11-28T12:02:51.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.499+0000 7fb32a693700 1 -- 172.21.15.80:0/2855778037 >> 172.21.15.80:0/2855778037 conn(0x7fb324061d20 msgr2=0x7fb3240641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:51.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.501+0000 7fb32a693700 1 Processor -- start 2019-11-28T12:02:51.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.501+0000 7fb32a693700 1 -- start start 2019-11-28T12:02:51.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.502+0000 7fb32a693700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb32410e970 0x7fb3241087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:51.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.502+0000 7fb32a693700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb324107e30 0x7fb324167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:51.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.502+0000 7fb32a693700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32410c250 con 0x7fb324108cf0 2019-11-28T12:02:51.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.502+0000 7fb32a693700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb32410e430 con 0x7fb324107e30 2019-11-28T12:02:51.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.502+0000 7fb32a693700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb324105860 con 0x7fb32410e970 2019-11-28T12:02:51.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.502+0000 7fb329431700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb324107e30 0x7fb324167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:51.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.502+0000 7fb329431700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb324107e30 0x7fb324167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48760/0 (socket says 172.21.15.80:48760) 2019-11-28T12:02:51.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.502+0000 7fb329431700 1 -- 172.21.15.80:0/3168928387 learned_addr learned my addr 172.21.15.80:0/3168928387 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:51.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.502+0000 7fb328c30700 1 --2- 172.21.15.80:0/3168928387 >> v2:172.21.15.174:3300/0 conn(0x7fb32410e970 0x7fb3241087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:51.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.502+0000 7fb329431700 1 -- 172.21.15.80:0/3168928387 >> v2:172.21.15.174:3300/0 conn(0x7fb32410e970 msgr2=0x7fb3241087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.502+0000 7fb329431700 1 --2- 172.21.15.80:0/3168928387 >> v2:172.21.15.174:3300/0 conn(0x7fb32410e970 0x7fb3241087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:51.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.502+0000 7fb329431700 1 -- 172.21.15.80:0/3168928387 >> v1:172.21.15.80:6789/0 conn(0x7fb324108cf0 legacy=0x7fb324107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.502+0000 7fb329431700 1 -- 172.21.15.80:0/3168928387 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb324105ef0 con 0x7fb324107e30 2019-11-28T12:02:51.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.502+0000 7fb329431700 1 --2- 172.21.15.80:0/3168928387 >> v2:172.21.15.80:3300/0 conn(0x7fb324107e30 0x7fb324167d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb31c010450 tx=0x7fb31c0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.502+0000 7fb329431700 1 --2- 172.21.15.80:0/3168928387 >> v2:172.21.15.80:3300/0 conn(0x7fb324107e30 0x7fb324167d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb31c010450 tx=0x7fb31c0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.502+0000 7fb329431700 1 --2- 172.21.15.80:0/3168928387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb324107e30 0x7fb324167d70 secure :-1 s=READY pgs=3177 cs=0 l=1 rx=0x7fb31c010450 tx=0x7fb31c0102d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:51.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.503+0000 7fb329431700 1 --2- 172.21.15.80:0/3168928387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb324107e30 0x7fb324167d70 secure :-1 s=THROTTLE_DONE pgs=3177 cs=0 l=1 rx=0x7fb31c010450 tx=0x7fb31c0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.503+0000 7fb3217fa700 1 -- 172.21.15.80:0/3168928387 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb31c00afe0 con 0x7fb324107e30 2019-11-28T12:02:51.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.503+0000 7fb329431700 1 --2- 172.21.15.80:0/3168928387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb324107e30 0x7fb324167d70 secure :-1 s=THROTTLE_DONE pgs=3177 cs=0 l=1 rx=0x7fb31c010450 tx=0x7fb31c0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.503+0000 7fb329431700 1 --2- 172.21.15.80:0/3168928387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb324107e30 0x7fb324167d70 secure :-1 s=THROTTLE_DONE pgs=3177 cs=0 l=1 rx=0x7fb31c010450 tx=0x7fb31c0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.503+0000 7fb3217fa700 1 -- 172.21.15.80:0/3168928387 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c0099b0 con 0x7fb324107e30 2019-11-28T12:02:51.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.503+0000 7fb32a693700 1 -- 172.21.15.80:0/3168928387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb324106270 con 0x7fb324107e30 2019-11-28T12:02:51.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.503+0000 7fb3217fa700 1 -- 172.21.15.80:0/3168928387 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb31c00a0c0 con 0x7fb324107e30 2019-11-28T12:02:51.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.503+0000 7fb32a693700 1 -- 172.21.15.80:0/3168928387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb324105ef0 con 0x7fb324107e30 2019-11-28T12:02:51.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.503+0000 7fb329431700 1 --2- 172.21.15.80:0/3168928387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb324107e30 0x7fb324167d70 secure :-1 s=THROTTLE_DONE pgs=3177 cs=0 l=1 rx=0x7fb31c010450 tx=0x7fb31c0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.503+0000 7fb3217fa700 1 -- 172.21.15.80:0/3168928387 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fb31c0095b0 con 0x7fb324107e30 2019-11-28T12:02:51.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.503+0000 7fb329431700 1 --2- 172.21.15.80:0/3168928387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb324107e30 0x7fb324167d70 secure :-1 s=THROTTLE_DONE pgs=3177 cs=0 l=1 rx=0x7fb31c010450 tx=0x7fb31c0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.503+0000 7fb3217fa700 1 --2- 172.21.15.80:0/3168928387 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb308018730 0x7fb30801abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:51.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.503+0000 7fb3217fa700 1 -- 172.21.15.80:0/3168928387 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fb31c031af0 con 0x7fb324107e30 2019-11-28T12:02:51.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.503+0000 7fb328c30700 1 --2- 172.21.15.80:0/3168928387 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb308018730 0x7fb30801abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:51.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.504+0000 7fb328c30700 1 --2- 172.21.15.80:0/3168928387 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb308018730 0x7fb30801abc0 crc :-1 s=READY pgs=1318 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:51.512 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.511+0000 7fb32a693700 1 -- 172.21.15.80:0/3168928387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb324106270 con 0x7fb324107e30 2019-11-28T12:02:51.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.514+0000 7fb329431700 1 --2- 172.21.15.80:0/3168928387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb324107e30 0x7fb324167d70 secure :-1 s=THROTTLE_DONE pgs=3177 cs=0 l=1 rx=0x7fb31c010450 tx=0x7fb31c0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.513 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.515+0000 7fb3217fa700 1 -- 172.21.15.80:0/3168928387 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fb31c00afe0 con 0x7fb324107e30 2019-11-28T12:02:51.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.680+0000 7fb32a693700 1 -- 172.21.15.80:0/3168928387 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fb324105ef0 con 0x7fb324107e30 2019-11-28T12:02:51.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.681+0000 7fb329431700 1 --2- 172.21.15.80:0/3168928387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb324107e30 0x7fb324167d70 secure :-1 s=THROTTLE_DONE pgs=3177 cs=0 l=1 rx=0x7fb31c010450 tx=0x7fb31c0102d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.674 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.681+0000 7fb3217fa700 1 -- 172.21.15.80:0/3168928387 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v247) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb31c017440 con 0x7fb324107e30 2019-11-28T12:02:51.675 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:02:51.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.683+0000 7fb32a693700 1 -- 172.21.15.80:0/3168928387 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb308018730 msgr2=0x7fb30801abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.683+0000 7fb32a693700 1 --2- 172.21.15.80:0/3168928387 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb308018730 0x7fb30801abc0 crc :-1 s=READY pgs=1318 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:51.677 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.683+0000 7fb32a693700 1 -- 172.21.15.80:0/3168928387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb324107e30 msgr2=0x7fb324167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.683+0000 7fb32a693700 1 --2- 172.21.15.80:0/3168928387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb324107e30 0x7fb324167d70 secure :-1 s=READY pgs=3177 cs=0 l=1 rx=0x7fb31c010450 tx=0x7fb31c0102d0).stop 2019-11-28T12:02:51.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.683+0000 7fb32a693700 1 -- 172.21.15.80:0/3168928387 shutdown_connections 2019-11-28T12:02:51.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.683+0000 7fb32a693700 1 --2- 172.21.15.80:0/3168928387 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fb308018730 0x7fb30801abc0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:51.678 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.683+0000 7fb32a693700 1 --2- 172.21.15.80:0/3168928387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb324107e30 0x7fb324167d70 unknown :-1 s=CLOSED pgs=3177 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:51.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.683+0000 7fb32a693700 1 --2- 172.21.15.80:0/3168928387 >> v2:172.21.15.174:3300/0 conn(0x7fb32410e970 0x7fb3241087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:51.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.683+0000 7fb32a693700 1 -- 172.21.15.80:0/3168928387 shutdown_connections 2019-11-28T12:02:51.679 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.684+0000 7fb32a693700 1 -- 172.21.15.80:0/3168928387 wait complete. 2019-11-28T12:02:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.684+0000 7fb32a693700 1 -- 172.21.15.80:0/3168928387 >> 172.21.15.80:0/3168928387 conn(0x7fb32415e2d0 msgr2=0x7fb324147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:51.687 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T12:02:51.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.818+0000 7f121cb81700 1 Processor -- start 2019-11-28T12:02:51.816 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.818+0000 7f121cb81700 1 -- start start 2019-11-28T12:02:51.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.819+0000 7f121cb81700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f121815f100 0x7f121806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:51.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.819+0000 7f121cb81700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121806db60 con 0x7f121806c2f0 2019-11-28T12:02:51.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.819+0000 7f121cb81700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121806e060 con 0x7f121815ed10 2019-11-28T12:02:51.817 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.819+0000 7f121cb81700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121806fe00 con 0x7f121815f100 2019-11-28T12:02:51.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.819+0000 7f121759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f121806c2f0 0x7f121806c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48082/0 (socket says 172.21.15.80:48082) 2019-11-28T12:02:51.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.819+0000 7f121759e700 1 -- 172.21.15.80:0/1573864422 learned_addr learned my addr 172.21.15.80:0/1573864422 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:51.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.819+0000 7f121659c700 1 --2- 172.21.15.80:0/1573864422 >> v2:172.21.15.174:3300/0 conn(0x7f121815f100 0x7f121806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:51.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.819+0000 7f1215d9b700 1 -- 172.21.15.80:0/1573864422 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381860992 0 0) 0x7f1210001150 con 0x7f121806c2f0 2019-11-28T12:02:51.818 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.819+0000 7f1215d9b700 1 -- 172.21.15.80:0/1573864422 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11f8002e80 con 0x7f121806c2f0 2019-11-28T12:02:51.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.820+0000 7f121659c700 1 -- 172.21.15.80:0/1573864422 >> v1:172.21.15.174:6789/0 conn(0x7f121815ed10 legacy=0x7f1218073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.820+0000 7f1215d9b700 1 -- 172.21.15.80:0/1573864422 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770588930 0 0) 0x7f1200001080 con 0x7f121815ed10 2019-11-28T12:02:51.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.820+0000 7f121659c700 1 -- 172.21.15.80:0/1573864422 >> v1:172.21.15.80:6789/0 conn(0x7f121806c2f0 legacy=0x7f121806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.819 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.820+0000 7f121659c700 1 -- 172.21.15.80:0/1573864422 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1218070760 con 0x7f121815f100 2019-11-28T12:02:51.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.820+0000 7f121659c700 1 --2- 172.21.15.80:0/1573864422 >> v2:172.21.15.174:3300/0 conn(0x7f121815f100 0x7f121806bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f120800b2d0 tx=0x7f120800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.820+0000 7f121659c700 1 --2- 172.21.15.80:0/1573864422 >> v2:172.21.15.174:3300/0 conn(0x7f121815f100 0x7f121806bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f120800b2d0 tx=0x7f120800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.820 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.820+0000 7f121659c700 1 --2- 172.21.15.80:0/1573864422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f121815f100 0x7f121806bdb0 secure :-1 s=READY pgs=1930 cs=0 l=1 rx=0x7f120800b2d0 tx=0x7f120800bae0).ready entity=mon.1 client_cookie=8c0edac3163f6093 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:51.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.820+0000 7f121659c700 1 --2- 172.21.15.80:0/1573864422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f121815f100 0x7f121806bdb0 secure :-1 s=THROTTLE_DONE pgs=1930 cs=0 l=1 rx=0x7f120800b2d0 tx=0x7f120800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.820+0000 7f1215d9b700 1 -- 172.21.15.80:0/1573864422 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1208000ce0 con 0x7f121815f100 2019-11-28T12:02:51.821 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.820+0000 7f121659c700 1 --2- 172.21.15.80:0/1573864422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f121815f100 0x7f121806bdb0 secure :-1 s=THROTTLE_DONE pgs=1930 cs=0 l=1 rx=0x7f120800b2d0 tx=0x7f120800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.820+0000 7f121659c700 1 --2- 172.21.15.80:0/1573864422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f121815f100 0x7f121806bdb0 secure :-1 s=THROTTLE_DONE pgs=1930 cs=0 l=1 rx=0x7f120800b2d0 tx=0x7f120800bae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.820+0000 7f1215d9b700 1 -- 172.21.15.80:0/1573864422 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1208009be0 con 0x7f121815f100 2019-11-28T12:02:51.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.820+0000 7f1215d9b700 1 -- 172.21.15.80:0/1573864422 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f120800a2b0 con 0x7f121815f100 2019-11-28T12:02:51.822 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.820+0000 7f121cb81700 1 -- 172.21.15.80:0/1573864422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f121815f100 msgr2=0x7f121806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.820+0000 7f121cb81700 1 --2- 172.21.15.80:0/1573864422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f121815f100 0x7f121806bdb0 secure :-1 s=READY pgs=1930 cs=0 l=1 rx=0x7f120800b2d0 tx=0x7f120800bae0).stop 2019-11-28T12:02:51.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.821+0000 7f121cb81700 1 -- 172.21.15.80:0/1573864422 shutdown_connections 2019-11-28T12:02:51.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.821+0000 7f121cb81700 1 --2- 172.21.15.80:0/1573864422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f121815f100 0x7f121806bdb0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:51.823 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.821+0000 7f121cb81700 1 -- 172.21.15.80:0/1573864422 shutdown_connections 2019-11-28T12:02:51.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.821+0000 7f121cb81700 1 -- 172.21.15.80:0/1573864422 wait complete. 2019-11-28T12:02:51.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.821+0000 7f121cb81700 1 -- 172.21.15.80:0/1573864422 >> 172.21.15.80:0/1573864422 conn(0x7f1218061d20 msgr2=0x7f12180641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:51.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.823+0000 7f121cb81700 1 Processor -- start 2019-11-28T12:02:51.824 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.823+0000 7f121cb81700 1 -- start start 2019-11-28T12:02:51.830 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.824+0000 7f121cb81700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1218148320 0x7f121810ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:51.835 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.824+0000 7f121cb81700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f121810f290 0x7f121810dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:51.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.824+0000 7f121cb81700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1218148e00 con 0x7f121810e110 2019-11-28T12:02:51.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.824+0000 7f121cb81700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121813aa20 con 0x7f121810f290 2019-11-28T12:02:51.836 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.824+0000 7f121cb81700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121813acf0 con 0x7f1218148320 2019-11-28T12:02:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.824+0000 7f121659c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f121810f290 0x7f121810dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.824+0000 7f121759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f121810e110 0x7f12181079b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48090/0 (socket says 172.21.15.80:48090) 2019-11-28T12:02:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.824+0000 7f121759e700 1 -- 172.21.15.80:0/307042518 learned_addr learned my addr 172.21.15.80:0/307042518 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:51.837 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.824+0000 7f1216d9d700 1 --2- 172.21.15.80:0/307042518 >> v2:172.21.15.174:3300/0 conn(0x7f1218148320 0x7f121810ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.824+0000 7f121659c700 1 -- 172.21.15.80:0/307042518 >> v2:172.21.15.174:3300/0 conn(0x7f1218148320 msgr2=0x7f121810ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.824+0000 7f121659c700 1 --2- 172.21.15.80:0/307042518 >> v2:172.21.15.174:3300/0 conn(0x7f1218148320 0x7f121810ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.824+0000 7f121659c700 1 -- 172.21.15.80:0/307042518 >> v1:172.21.15.80:6789/0 conn(0x7f121810e110 legacy=0x7f12181079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:51.838 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.824+0000 7f121659c700 1 -- 172.21.15.80:0/307042518 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121810c490 con 0x7f121810f290 2019-11-28T12:02:51.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.824+0000 7f120f7fe700 1 -- 172.21.15.80:0/307042518 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993274145 0 0) 0x7f1210001150 con 0x7f121810e110 2019-11-28T12:02:51.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.825+0000 7f121659c700 1 --2- 172.21.15.80:0/307042518 >> v2:172.21.15.80:3300/0 conn(0x7f121810f290 0x7f121810dbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1208010720 tx=0x7f12080105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.839 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.825+0000 7f121659c700 1 --2- 172.21.15.80:0/307042518 >> v2:172.21.15.80:3300/0 conn(0x7f121810f290 0x7f121810dbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1208010720 tx=0x7f12080105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.825+0000 7f121659c700 1 --2- 172.21.15.80:0/307042518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f121810f290 0x7f121810dbd0 secure :-1 s=READY pgs=3180 cs=0 l=1 rx=0x7f1208010720 tx=0x7f12080105d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:51.840 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.825+0000 7f121659c700 1 --2- 172.21.15.80:0/307042518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f121810f290 0x7f121810dbd0 secure :-1 s=THROTTLE_DONE pgs=3180 cs=0 l=1 rx=0x7f1208010720 tx=0x7f12080105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.825+0000 7f120f7fe700 1 -- 172.21.15.80:0/307042518 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1208000cc0 con 0x7f121810f290 2019-11-28T12:02:51.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.825+0000 7f121659c700 1 --2- 172.21.15.80:0/307042518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f121810f290 0x7f121810dbd0 secure :-1 s=THROTTLE_DONE pgs=3180 cs=0 l=1 rx=0x7f1208010720 tx=0x7f12080105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.841 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.825+0000 7f121659c700 1 --2- 172.21.15.80:0/307042518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f121810f290 0x7f121810dbd0 secure :-1 s=THROTTLE_DONE pgs=3180 cs=0 l=1 rx=0x7f1208010720 tx=0x7f12080105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.825+0000 7f120f7fe700 1 -- 172.21.15.80:0/307042518 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1208009d00 con 0x7f121810f290 2019-11-28T12:02:51.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.825+0000 7f120f7fe700 1 -- 172.21.15.80:0/307042518 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1208000cc0 con 0x7f121810f290 2019-11-28T12:02:51.842 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.825+0000 7f121cb81700 1 -- 172.21.15.80:0/307042518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f121810c810 con 0x7f121810f290 2019-11-28T12:02:51.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.825+0000 7f121cb81700 1 -- 172.21.15.80:0/307042518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121810c490 con 0x7f121810f290 2019-11-28T12:02:51.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.825+0000 7f121659c700 1 --2- 172.21.15.80:0/307042518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f121810f290 0x7f121810dbd0 secure :-1 s=THROTTLE_DONE pgs=3180 cs=0 l=1 rx=0x7f1208010720 tx=0x7f12080105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.826+0000 7f120f7fe700 1 -- 172.21.15.80:0/307042518 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f1208009ef0 con 0x7f121810f290 2019-11-28T12:02:51.857 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.826+0000 7f121659c700 1 --2- 172.21.15.80:0/307042518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f121810f290 0x7f121810dbd0 secure :-1 s=THROTTLE_DONE pgs=3180 cs=0 l=1 rx=0x7f1208010720 tx=0x7f12080105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.859 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.826+0000 7f120f7fe700 1 --2- 172.21.15.80:0/307042518 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f11f0018730 0x7f11f001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:51.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.826+0000 7f120f7fe700 1 -- 172.21.15.80:0/307042518 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f1208031d80 con 0x7f121810f290 2019-11-28T12:02:51.860 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.826+0000 7f1216d9d700 1 --2- 172.21.15.80:0/307042518 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f11f0018730 0x7f11f001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:51.861 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.826+0000 7f1216d9d700 1 --2- 172.21.15.80:0/307042518 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f11f0018730 0x7f11f001abc0 crc :-1 s=READY pgs=1319 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:51.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.833+0000 7f121cb81700 1 -- 172.21.15.80:0/307042518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121810c810 con 0x7f121810f290 2019-11-28T12:02:51.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.837+0000 7f121659c700 1 --2- 172.21.15.80:0/307042518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f121810f290 0x7f121810dbd0 secure :-1 s=THROTTLE_DONE pgs=3180 cs=0 l=1 rx=0x7f1208010720 tx=0x7f12080105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:51.862 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:51.837+0000 7f120f7fe700 1 -- 172.21.15.80:0/307042518 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f1208009900 con 0x7f121810f290 2019-11-28T12:02:52.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.014+0000 7f121cb81700 1 -- 172.21.15.80:0/307042518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f121810c490 con 0x7f121810f290 2019-11-28T12:02:52.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.014+0000 7f121659c700 1 --2- 172.21.15.80:0/307042518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f121810f290 0x7f121810dbd0 secure :-1 s=THROTTLE_DONE pgs=3180 cs=0 l=1 rx=0x7f1208010720 tx=0x7f12080105d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:52.007 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.014+0000 7f120f7fe700 1 -- 172.21.15.80:0/307042518 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v247) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1208009ed0 con 0x7f121810f290 2019-11-28T12:02:52.007 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:02:52.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.017+0000 7f121cb81700 1 -- 172.21.15.80:0/307042518 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f11f0018730 msgr2=0x7f11f001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:52.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.017+0000 7f121cb81700 1 --2- 172.21.15.80:0/307042518 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f11f0018730 0x7f11f001abc0 crc :-1 s=READY pgs=1319 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:52.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.017+0000 7f121cb81700 1 -- 172.21.15.80:0/307042518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f121810f290 msgr2=0x7f121810dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:52.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.017+0000 7f121cb81700 1 --2- 172.21.15.80:0/307042518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f121810f290 0x7f121810dbd0 secure :-1 s=READY pgs=3180 cs=0 l=1 rx=0x7f1208010720 tx=0x7f12080105d0).stop 2019-11-28T12:02:52.010 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.017+0000 7f121cb81700 1 -- 172.21.15.80:0/307042518 shutdown_connections 2019-11-28T12:02:52.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.017+0000 7f121cb81700 1 --2- 172.21.15.80:0/307042518 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f11f0018730 0x7f11f001abc0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:52.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.017+0000 7f121cb81700 1 --2- 172.21.15.80:0/307042518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f121810f290 0x7f121810dbd0 unknown :-1 s=CLOSED pgs=3180 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:52.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.017+0000 7f121cb81700 1 --2- 172.21.15.80:0/307042518 >> v2:172.21.15.174:3300/0 conn(0x7f1218148320 0x7f121810ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:52.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.017+0000 7f121cb81700 1 -- 172.21.15.80:0/307042518 shutdown_connections 2019-11-28T12:02:52.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.017+0000 7f121cb81700 1 -- 172.21.15.80:0/307042518 wait complete. 2019-11-28T12:02:52.011 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.017+0000 7f121cb81700 1 -- 172.21.15.80:0/307042518 >> 172.21.15.80:0/307042518 conn(0x7f121815e2d0 msgr2=0x7f1218147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:52.020 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T12:02:52.020 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:52.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.146+0000 7f323bb26700 1 Processor -- start 2019-11-28T12:02:52.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.146+0000 7f323bb26700 1 -- start start 2019-11-28T12:02:52.144 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.147+0000 7f323bb26700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f323406c490 0x7f323406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:52.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.147+0000 7f323bb26700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f323406ce60 0x7f3234164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:52.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.147+0000 7f323bb26700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323406db00 con 0x7f323406c0a0 2019-11-28T12:02:52.145 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.147+0000 7f323bb26700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323406fd60 con 0x7f323406ce60 2019-11-28T12:02:52.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.147+0000 7f323bb26700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3234070030 con 0x7f323406c490 2019-11-28T12:02:52.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.147+0000 7f323a0c3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f323406c0a0 0x7f3234072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48094/0 (socket says 172.21.15.80:48094) 2019-11-28T12:02:52.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.147+0000 7f323a0c3700 1 -- 172.21.15.80:0/2644540803 learned_addr learned my addr 172.21.15.80:0/2644540803 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:52.146 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.147+0000 7f32398c2700 1 --2- 172.21.15.80:0/2644540803 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f323406c490 0x7f323406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:52.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.147+0000 7f323a8c4700 1 --2- 172.21.15.80:0/2644540803 >> v2:172.21.15.174:3300/0 conn(0x7f323406ce60 0x7f3234164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:52.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.147+0000 7f32390c1700 1 -- 172.21.15.80:0/2644540803 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729358403 0 0) 0x7f3228001150 con 0x7f323406c0a0 2019-11-28T12:02:52.147 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f32390c1700 1 -- 172.21.15.80:0/2644540803 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3220002e80 con 0x7f323406c0a0 2019-11-28T12:02:52.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f323a8c4700 1 -- 172.21.15.80:0/2644540803 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f323406c490 msgr2=0x7f323406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:52.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f323a8c4700 1 --2- 172.21.15.80:0/2644540803 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f323406c490 0x7f323406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:52.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f323a8c4700 1 -- 172.21.15.80:0/2644540803 >> v1:172.21.15.80:6789/0 conn(0x7f323406c0a0 legacy=0x7f3234072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:52.148 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f32390c1700 1 -- 172.21.15.80:0/2644540803 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1777174440 0 0) 0x7f3228001130 con 0x7f323406c0a0 2019-11-28T12:02:52.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f323a8c4700 1 -- 172.21.15.80:0/2644540803 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32340706c0 con 0x7f323406ce60 2019-11-28T12:02:52.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f32398c2700 1 --2- 172.21.15.80:0/2644540803 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f323406c490 0x7f323406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:52.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f323a8c4700 1 --2- 172.21.15.80:0/2644540803 >> v2:172.21.15.174:3300/0 conn(0x7f323406ce60 0x7f3234164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f322c00af80 tx=0x7f322c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:52.149 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f323a8c4700 1 --2- 172.21.15.80:0/2644540803 >> v2:172.21.15.174:3300/0 conn(0x7f323406ce60 0x7f3234164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f322c00af80 tx=0x7f322c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:52.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f323a8c4700 1 --2- 172.21.15.80:0/2644540803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f323406ce60 0x7f3234164d70 secure :-1 s=READY pgs=1931 cs=0 l=1 rx=0x7f322c00af80 tx=0x7f322c00b790).ready entity=mon.1 client_cookie=278828f29a509972 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:52.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f323a8c4700 1 --2- 172.21.15.80:0/2644540803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f323406ce60 0x7f3234164d70 secure :-1 s=THROTTLE_DONE pgs=1931 cs=0 l=1 rx=0x7f322c00af80 tx=0x7f322c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:52.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f32390c1700 1 -- 172.21.15.80:0/2644540803 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f322c000bc0 con 0x7f323406ce60 2019-11-28T12:02:52.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f323a8c4700 1 --2- 172.21.15.80:0/2644540803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f323406ce60 0x7f3234164d70 secure :-1 s=THROTTLE_DONE pgs=1931 cs=0 l=1 rx=0x7f322c00af80 tx=0x7f322c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:52.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f323a8c4700 1 --2- 172.21.15.80:0/2644540803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f323406ce60 0x7f3234164d70 secure :-1 s=THROTTLE_DONE pgs=1931 cs=0 l=1 rx=0x7f322c00af80 tx=0x7f322c00b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:52.150 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f32390c1700 1 -- 172.21.15.80:0/2644540803 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c0097f0 con 0x7f323406ce60 2019-11-28T12:02:52.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f32390c1700 1 -- 172.21.15.80:0/2644540803 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f322c009ec0 con 0x7f323406ce60 2019-11-28T12:02:52.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f323bb26700 1 -- 172.21.15.80:0/2644540803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f323406ce60 msgr2=0x7f3234164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:52.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.148+0000 7f323bb26700 1 --2- 172.21.15.80:0/2644540803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f323406ce60 0x7f3234164d70 secure :-1 s=READY pgs=1931 cs=0 l=1 rx=0x7f322c00af80 tx=0x7f322c00b790).stop 2019-11-28T12:02:52.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.149+0000 7f323bb26700 1 -- 172.21.15.80:0/2644540803 shutdown_connections 2019-11-28T12:02:52.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.149+0000 7f323bb26700 1 --2- 172.21.15.80:0/2644540803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f323406ce60 0x7f3234164d70 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:52.151 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.149+0000 7f323bb26700 1 --2- 172.21.15.80:0/2644540803 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f323406c490 0x7f323406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:52.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.149+0000 7f323bb26700 1 -- 172.21.15.80:0/2644540803 shutdown_connections 2019-11-28T12:02:52.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.149+0000 7f323bb26700 1 -- 172.21.15.80:0/2644540803 wait complete. 2019-11-28T12:02:52.152 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.149+0000 7f323bb26700 1 -- 172.21.15.80:0/2644540803 >> 172.21.15.80:0/2644540803 conn(0x7f3234061cf0 msgr2=0x7f3234064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.151+0000 7f323bb26700 1 Processor -- start 2019-11-28T12:02:52.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.152+0000 7f323bb26700 1 -- start start 2019-11-28T12:02:52.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.152+0000 7f323bb26700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3234164ff0 0x7f32341653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:52.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.152+0000 7f323bb26700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3234114f40 con 0x7f3234118060 2019-11-28T12:02:52.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.152+0000 7f323bb26700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3234140c20 con 0x7f3234117bd0 2019-11-28T12:02:52.154 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.152+0000 7f323bb26700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3234112ea0 con 0x7f3234164ff0 2019-11-28T12:02:52.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.152+0000 7f323a0c3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3234164ff0 0x7f32341653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:52.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.152+0000 7f323a0c3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3234164ff0 0x7f32341653e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48782/0 (socket says 172.21.15.80:48782) 2019-11-28T12:02:52.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.152+0000 7f323a0c3700 1 -- 172.21.15.80:0/1997701793 learned_addr learned my addr 172.21.15.80:0/1997701793 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:52.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.153+0000 7f3226ffd700 1 -- 172.21.15.80:0/1997701793 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802276773 0 0) 0x7f322c00b050 con 0x7f3234118060 2019-11-28T12:02:52.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.153+0000 7f3226ffd700 1 -- 172.21.15.80:0/1997701793 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f321c002e80 con 0x7f3234118060 2019-11-28T12:02:52.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.153+0000 7f323a0c3700 1 -- 172.21.15.80:0/1997701793 >> v1:172.21.15.174:6789/0 conn(0x7f3234117bd0 legacy=0x7f3234116c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:52.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.153+0000 7f323a0c3700 1 -- 172.21.15.80:0/1997701793 >> v1:172.21.15.80:6789/0 conn(0x7f3234118060 legacy=0x7f3234140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:52.158 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.153+0000 7f323a0c3700 1 -- 172.21.15.80:0/1997701793 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3234113800 con 0x7f3234164ff0 2019-11-28T12:02:52.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.153+0000 7f323a0c3700 1 --2- 172.21.15.80:0/1997701793 >> v2:172.21.15.80:3300/0 conn(0x7f3234164ff0 0x7f32341653e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3228010410 tx=0x7f32280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:52.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.153+0000 7f323a0c3700 1 --2- 172.21.15.80:0/1997701793 >> v2:172.21.15.80:3300/0 conn(0x7f3234164ff0 0x7f32341653e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3228010410 tx=0x7f32280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:52.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.153+0000 7f323a0c3700 1 --2- 172.21.15.80:0/1997701793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3234164ff0 0x7f32341653e0 secure :-1 s=READY pgs=3183 cs=0 l=1 rx=0x7f3228010410 tx=0x7f32280107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:52.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.153+0000 7f323a0c3700 1 --2- 172.21.15.80:0/1997701793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3234164ff0 0x7f32341653e0 secure :-1 s=THROTTLE_DONE pgs=3183 cs=0 l=1 rx=0x7f3228010410 tx=0x7f32280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:52.159 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.153+0000 7f3226ffd700 1 -- 172.21.15.80:0/1997701793 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3228000c90 con 0x7f3234164ff0 2019-11-28T12:02:52.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.153+0000 7f323a0c3700 1 --2- 172.21.15.80:0/1997701793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3234164ff0 0x7f32341653e0 secure :-1 s=THROTTLE_DONE pgs=3183 cs=0 l=1 rx=0x7f3228010410 tx=0x7f32280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:52.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.153+0000 7f3226ffd700 1 -- 172.21.15.80:0/1997701793 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32280010c0 con 0x7f3234164ff0 2019-11-28T12:02:52.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.153+0000 7f323a0c3700 1 --2- 172.21.15.80:0/1997701793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3234164ff0 0x7f32341653e0 secure :-1 s=THROTTLE_DONE pgs=3183 cs=0 l=1 rx=0x7f3228010410 tx=0x7f32280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:52.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.153+0000 7f3226ffd700 1 -- 172.21.15.80:0/1997701793 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3228000e90 con 0x7f3234164ff0 2019-11-28T12:02:52.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.153+0000 7f323bb26700 1 -- 172.21.15.80:0/1997701793 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3234113b80 con 0x7f3234164ff0 2019-11-28T12:02:52.160 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.153+0000 7f323bb26700 1 -- 172.21.15.80:0/1997701793 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3234113800 con 0x7f3234164ff0 2019-11-28T12:02:52.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.154+0000 7f323a0c3700 1 --2- 172.21.15.80:0/1997701793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3234164ff0 0x7f32341653e0 secure :-1 s=THROTTLE_DONE pgs=3183 cs=0 l=1 rx=0x7f3228010410 tx=0x7f32280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:52.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.154+0000 7f3226ffd700 1 -- 172.21.15.80:0/1997701793 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f3228000c90 con 0x7f3234164ff0 2019-11-28T12:02:52.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.154+0000 7f323a0c3700 1 --2- 172.21.15.80:0/1997701793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3234164ff0 0x7f32341653e0 secure :-1 s=THROTTLE_DONE pgs=3183 cs=0 l=1 rx=0x7f3228010410 tx=0x7f32280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:52.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.154+0000 7f3226ffd700 1 --2- 172.21.15.80:0/1997701793 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f321c018770 0x7f321c01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:52.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.154+0000 7f3226ffd700 1 -- 172.21.15.80:0/1997701793 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3228031b20 con 0x7f3234164ff0 2019-11-28T12:02:52.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.154+0000 7f32398c2700 1 --2- 172.21.15.80:0/1997701793 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f321c018770 0x7f321c01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:52.161 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.154+0000 7f32398c2700 1 --2- 172.21.15.80:0/1997701793 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f321c018770 0x7f321c01abe0 crc :-1 s=READY pgs=1320 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:52.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.161+0000 7f323bb26700 1 -- 172.21.15.80:0/1997701793 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3234113b80 con 0x7f3234164ff0 2019-11-28T12:02:52.162 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.165+0000 7f323a0c3700 1 --2- 172.21.15.80:0/1997701793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3234164ff0 0x7f32341653e0 secure :-1 s=THROTTLE_DONE pgs=3183 cs=0 l=1 rx=0x7f3228010410 tx=0x7f32280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:52.163 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.165+0000 7f3226ffd700 1 -- 172.21.15.80:0/1997701793 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f32280075b0 con 0x7f3234164ff0 2019-11-28T12:02:52.335 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.342+0000 7f323bb26700 1 -- 172.21.15.80:0/1997701793 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3234113800 con 0x7f3234164ff0 2019-11-28T12:02:52.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.342+0000 7f323a0c3700 1 --2- 172.21.15.80:0/1997701793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3234164ff0 0x7f32341653e0 secure :-1 s=THROTTLE_DONE pgs=3183 cs=0 l=1 rx=0x7f3228010410 tx=0x7f32280107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:52.336 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.342+0000 7f3226ffd700 1 -- 172.21.15.80:0/1997701793 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 210 v210) v1 ==== 95+0+2454 (secure 0 0 0) 0x7f3228000c90 con 0x7f3234164ff0 2019-11-28T12:02:52.337 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 210 2019-11-28T12:02:52.337 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:52.337 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":210,"default_fscid":20,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":12424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2746945578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2746945578},{"type":"v1","addr":"172.21.15.174:6835","nonce":2746945578}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":210},{"gid":13251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/914520193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":914520193},{"type":"v1","addr":"172.21.15.80:6834","nonce":914520193}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":210}],"filesystems":[{"mdsmap":{"epoch":209,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:02:44.233571+0000","modified":"2019-11-28T12:02:48.857049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8537":{"gid":8537,"name":"b","rank":0,"incarnation":208,"state":"up:active","state_seq":2,"addr":"172.21.15.80:6835/1900497412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1900497412},{"type":"v1","addr":"172.21.15.80:6835","nonce":1900497412}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[41],"metadata_pool":40,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":20}]} 2019-11-28T12:02:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.345+0000 7f323bb26700 1 -- 172.21.15.80:0/1997701793 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f321c018770 msgr2=0x7f321c01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.345+0000 7f323bb26700 1 --2- 172.21.15.80:0/1997701793 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f321c018770 0x7f321c01abe0 crc :-1 s=READY pgs=1320 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.345+0000 7f323bb26700 1 -- 172.21.15.80:0/1997701793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3234164ff0 msgr2=0x7f32341653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.345+0000 7f323bb26700 1 --2- 172.21.15.80:0/1997701793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3234164ff0 0x7f32341653e0 secure :-1 s=READY pgs=3183 cs=0 l=1 rx=0x7f3228010410 tx=0x7f32280107b0).stop 2019-11-28T12:02:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.345+0000 7f323bb26700 1 -- 172.21.15.80:0/1997701793 shutdown_connections 2019-11-28T12:02:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.345+0000 7f323bb26700 1 --2- 172.21.15.80:0/1997701793 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f321c018770 0x7f321c01abe0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:52.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.345+0000 7f323bb26700 1 --2- 172.21.15.80:0/1997701793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3234164ff0 0x7f32341653e0 unknown :-1 s=CLOSED pgs=3183 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:52.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.345+0000 7f323bb26700 1 -- 172.21.15.80:0/1997701793 shutdown_connections 2019-11-28T12:02:52.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.345+0000 7f323bb26700 1 -- 172.21.15.80:0/1997701793 wait complete. 2019-11-28T12:02:52.340 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:52.345+0000 7f323bb26700 1 -- 172.21.15.80:0/1997701793 >> 172.21.15.80:0/1997701793 conn(0x7f32341427c0 msgr2=0x7f323414fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:52.649 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8537}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 40, u'failed': [], u'epoch': 209, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [41], u'info': {u'gid_8537': {u'export_targets': [], u'name': u'b', u'incarnation': 208, u'state_seq': 2, u'state': u'up:active', u'gid': 8537, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1900497412, u'type': u'v2', u'addr': u'172.21.15.80:6833'}, {u'nonce': 1900497412, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/1900497412'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T12:02:44.233571+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T12:02:48.857049+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T12:02:52.650 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T12:02:52.650 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-11-28T12:02:52.777 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T12:02:52.778 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T12:02:52.778 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T12:02:52.778 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 8537, 2019-11-28T12:02:52.778 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2019-11-28T12:02:52.778 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2019-11-28T12:02:52.779 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 4.9281516349999999, 2019-11-28T12:02:52.779 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 209, 2019-11-28T12:02:52.779 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 247, 2019-11-28T12:02:52.779 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 247, 2019-11-28T12:02:52.779 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 5.7560515570000002 2019-11-28T12:02:52.779 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T12:02:52.783 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8537, "want_state": "up:active", "state": "up:active", "rank_uptime": 4.9281516349999999, "mdsmap_epoch": 209, "osdmap_epoch": 247, "osdmap_epoch_barrier": 247, "uptime": 5.7560515570000002 } 2019-11-28T12:02:52.783 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T12:02:52.784 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-11-28T12:02:52.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T12:02:52.784 INFO:teuthology.orchestra.run.smithi076:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T12:02:52.855 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T12:02:52.855 INFO:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T12:02:52.978 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T12:02:52.978 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T12:02:52.979 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T12:02:52.979 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T12:02:52.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T12:02:52.980 INFO:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-11-28T12:02:53.050 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T12:02:53.174 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.177+0000 7ff0aee3b700 1 Processor -- start 2019-11-28T12:02:53.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.177+0000 7ff0aee3b700 1 -- start start 2019-11-28T12:02:53.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.178+0000 7ff0aee3b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff0a806c490 0x7ff0a806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:53.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.178+0000 7ff0aee3b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff0a806ce60 0x7ff0a8164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:53.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.178+0000 7ff0aee3b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a806db00 con 0x7ff0a806c0a0 2019-11-28T12:02:53.175 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.178+0000 7ff0aee3b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a806fd60 con 0x7ff0a806ce60 2019-11-28T12:02:53.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.178+0000 7ff0aee3b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a8070030 con 0x7ff0a806c490 2019-11-28T12:02:53.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.178+0000 7ff0adbd9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff0a806ce60 0x7ff0a8164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:53.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.178+0000 7ff0ad3d8700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff0a806c0a0 0x7ff0a8072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48106/0 (socket says 172.21.15.80:48106) 2019-11-28T12:02:53.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.178+0000 7ff0adbd9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff0a806ce60 0x7ff0a8164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48792/0 (socket says 172.21.15.80:48792) 2019-11-28T12:02:53.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.178+0000 7ff0ad3d8700 1 -- 172.21.15.80:0/621166605 learned_addr learned my addr 172.21.15.80:0/621166605 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:53.176 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.178+0000 7ff0acbd7700 1 --2- 172.21.15.80:0/621166605 >> v2:172.21.15.174:3300/0 conn(0x7ff0a806c490 0x7ff0a806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:53.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.178+0000 7ff0adbd9700 1 -- 172.21.15.80:0/621166605 >> v2:172.21.15.174:3300/0 conn(0x7ff0a806c490 msgr2=0x7ff0a806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:53.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.178+0000 7ff0adbd9700 1 --2- 172.21.15.80:0/621166605 >> v2:172.21.15.174:3300/0 conn(0x7ff0a806c490 0x7ff0a806c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:53.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.178+0000 7ff0adbd9700 1 -- 172.21.15.80:0/621166605 >> v1:172.21.15.80:6789/0 conn(0x7ff0a806c0a0 legacy=0x7ff0a8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.179+0000 7ff0adbd9700 1 -- 172.21.15.80:0/621166605 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a80706c0 con 0x7ff0a806ce60 2019-11-28T12:02:53.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.179+0000 7ff0a7fff700 1 -- 172.21.15.80:0/621166605 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132876507 0 0) 0x7ff0900014d0 con 0x7ff0a806c0a0 2019-11-28T12:02:53.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.179+0000 7ff0adbd9700 1 --2- 172.21.15.80:0/621166605 >> v2:172.21.15.80:3300/0 conn(0x7ff0a806ce60 0x7ff0a8164d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff0a000af50 tx=0x7ff0a000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.179+0000 7ff0adbd9700 1 --2- 172.21.15.80:0/621166605 >> v2:172.21.15.80:3300/0 conn(0x7ff0a806ce60 0x7ff0a8164d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff0a000af50 tx=0x7ff0a000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.179+0000 7ff0adbd9700 1 --2- 172.21.15.80:0/621166605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a806ce60 0x7ff0a8164d70 secure :-1 s=READY pgs=3185 cs=0 l=1 rx=0x7ff0a000af50 tx=0x7ff0a000b6e0).ready entity=mon.0 client_cookie=8b728db46da2ae42 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:53.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.179+0000 7ff0adbd9700 1 --2- 172.21.15.80:0/621166605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a806ce60 0x7ff0a8164d70 secure :-1 s=THROTTLE_DONE pgs=3185 cs=0 l=1 rx=0x7ff0a000af50 tx=0x7ff0a000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.179+0000 7ff0a7fff700 1 -- 172.21.15.80:0/621166605 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0a0009ba0 con 0x7ff0a806ce60 2019-11-28T12:02:53.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.179+0000 7ff0adbd9700 1 --2- 172.21.15.80:0/621166605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a806ce60 0x7ff0a8164d70 secure :-1 s=THROTTLE_DONE pgs=3185 cs=0 l=1 rx=0x7ff0a000af50 tx=0x7ff0a000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.179+0000 7ff0adbd9700 1 --2- 172.21.15.80:0/621166605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a806ce60 0x7ff0a8164d70 secure :-1 s=THROTTLE_DONE pgs=3185 cs=0 l=1 rx=0x7ff0a000af50 tx=0x7ff0a000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.179+0000 7ff0a7fff700 1 -- 172.21.15.80:0/621166605 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a00097c0 con 0x7ff0a806ce60 2019-11-28T12:02:53.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.179+0000 7ff0a7fff700 1 -- 172.21.15.80:0/621166605 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0a000a180 con 0x7ff0a806ce60 2019-11-28T12:02:53.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.179+0000 7ff0aee3b700 1 -- 172.21.15.80:0/621166605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a806ce60 msgr2=0x7ff0a8164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.179+0000 7ff0aee3b700 1 --2- 172.21.15.80:0/621166605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a806ce60 0x7ff0a8164d70 secure :-1 s=READY pgs=3185 cs=0 l=1 rx=0x7ff0a000af50 tx=0x7ff0a000b6e0).stop 2019-11-28T12:02:53.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.179+0000 7ff0aee3b700 1 -- 172.21.15.80:0/621166605 shutdown_connections 2019-11-28T12:02:53.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.180+0000 7ff0aee3b700 1 --2- 172.21.15.80:0/621166605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a806ce60 0x7ff0a8164d70 unknown :-1 s=CLOSED pgs=3185 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:53.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.180+0000 7ff0aee3b700 1 --2- 172.21.15.80:0/621166605 >> v2:172.21.15.174:3300/0 conn(0x7ff0a806c490 0x7ff0a806c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:53.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.180+0000 7ff0aee3b700 1 -- 172.21.15.80:0/621166605 shutdown_connections 2019-11-28T12:02:53.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.180+0000 7ff0aee3b700 1 -- 172.21.15.80:0/621166605 wait complete. 2019-11-28T12:02:53.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.180+0000 7ff0aee3b700 1 -- 172.21.15.80:0/621166605 >> 172.21.15.80:0/621166605 conn(0x7ff0a8061cf0 msgr2=0x7ff0a8064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:53.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.182+0000 7ff0aee3b700 1 Processor -- start 2019-11-28T12:02:53.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.182+0000 7ff0aee3b700 1 -- start start 2019-11-28T12:02:53.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.183+0000 7ff0aee3b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0a813dc00 0x7ff0a8109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:53.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.183+0000 7ff0aee3b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff0a810a3a0 0x7ff0a8108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:53.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.183+0000 7ff0aee3b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff0a8109220 0x7ff0a8109680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:53.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.183+0000 7ff0aee3b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a8104e00 con 0x7ff0a810a3a0 2019-11-28T12:02:53.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.183+0000 7ff0aee3b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a8105830 con 0x7ff0a8109220 2019-11-28T12:02:53.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.183+0000 7ff0aee3b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a8106190 con 0x7ff0a813dc00 2019-11-28T12:02:53.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.183+0000 7ff0acbd7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff0a810a3a0 0x7ff0a8108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:53.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.183+0000 7ff0acbd7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff0a810a3a0 0x7ff0a8108ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48798/0 (socket says 172.21.15.80:48798) 2019-11-28T12:02:53.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.183+0000 7ff0acbd7700 1 -- 172.21.15.80:0/277767194 learned_addr learned my addr 172.21.15.80:0/277767194 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:53.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.183+0000 7ff0adbd9700 1 --2- 172.21.15.80:0/277767194 >> v2:172.21.15.174:3300/0 conn(0x7ff0a8109220 0x7ff0a8109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.183+0000 7ff0ad3d8700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0a813dc00 0x7ff0a8109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0acbd7700 1 -- 172.21.15.80:0/277767194 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0a813dc00 msgr2=0x7ff0a8109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0acbd7700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0a813dc00 0x7ff0a8109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0acbd7700 1 -- 172.21.15.80:0/277767194 >> v2:172.21.15.174:3300/0 conn(0x7ff0a8109220 msgr2=0x7ff0a8109680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0acbd7700 1 --2- 172.21.15.80:0/277767194 >> v2:172.21.15.174:3300/0 conn(0x7ff0a8109220 0x7ff0a8109680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0acbd7700 1 -- 172.21.15.80:0/277767194 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a8106510 con 0x7ff0a810a3a0 2019-11-28T12:02:53.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0acbd7700 1 --2- 172.21.15.80:0/277767194 >> v2:172.21.15.80:3300/0 conn(0x7ff0a810a3a0 0x7ff0a8108ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff098010400 tx=0x7ff098010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0acbd7700 1 --2- 172.21.15.80:0/277767194 >> v2:172.21.15.80:3300/0 conn(0x7ff0a810a3a0 0x7ff0a8108ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff098010400 tx=0x7ff098010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0acbd7700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a810a3a0 0x7ff0a8108ce0 secure :-1 s=READY pgs=3186 cs=0 l=1 rx=0x7ff098010400 tx=0x7ff098010300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:53.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0acbd7700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a810a3a0 0x7ff0a8108ce0 secure :-1 s=THROTTLE_DONE pgs=3186 cs=0 l=1 rx=0x7ff098010400 tx=0x7ff098010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0a5ffb700 1 -- 172.21.15.80:0/277767194 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff098000940 con 0x7ff0a810a3a0 2019-11-28T12:02:53.187 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0acbd7700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a810a3a0 0x7ff0a8108ce0 secure :-1 s=THROTTLE_DONE pgs=3186 cs=0 l=1 rx=0x7ff098010400 tx=0x7ff098010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0acbd7700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a810a3a0 0x7ff0a8108ce0 secure :-1 s=THROTTLE_DONE pgs=3186 cs=0 l=1 rx=0x7ff098010400 tx=0x7ff098010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0a5ffb700 1 -- 172.21.15.80:0/277767194 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff098000ea0 con 0x7ff0a810a3a0 2019-11-28T12:02:53.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0aee3b700 1 -- 172.21.15.80:0/277767194 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a8106510 con 0x7ff0a810a3a0 2019-11-28T12:02:53.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0a5ffb700 1 -- 172.21.15.80:0/277767194 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff098001470 con 0x7ff0a810a3a0 2019-11-28T12:02:53.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0aee3b700 1 -- 172.21.15.80:0/277767194 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a8106510 con 0x7ff0a810a3a0 2019-11-28T12:02:53.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.184+0000 7ff0acbd7700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a810a3a0 0x7ff0a8108ce0 secure :-1 s=THROTTLE_DONE pgs=3186 cs=0 l=1 rx=0x7ff098010400 tx=0x7ff098010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.188 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.185+0000 7ff0a5ffb700 1 -- 172.21.15.80:0/277767194 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7ff098001090 con 0x7ff0a810a3a0 2019-11-28T12:02:53.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.185+0000 7ff0acbd7700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a810a3a0 0x7ff0a8108ce0 secure :-1 s=THROTTLE_DONE pgs=3186 cs=0 l=1 rx=0x7ff098010400 tx=0x7ff098010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.185+0000 7ff0a5ffb700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff08c018730 0x7ff08c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:53.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.185+0000 7ff0a5ffb700 1 -- 172.21.15.80:0/277767194 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7ff098031c50 con 0x7ff0a810a3a0 2019-11-28T12:02:53.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.185+0000 7ff0ad3d8700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff08c018730 0x7ff08c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:53.189 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.185+0000 7ff0ad3d8700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff08c018730 0x7ff08c01abc0 crc :-1 s=READY pgs=1321 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:53.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.192+0000 7ff0aee3b700 1 -- 172.21.15.80:0/277767194 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a8106510 con 0x7ff0a810a3a0 2019-11-28T12:02:53.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.196+0000 7ff0acbd7700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a810a3a0 0x7ff0a8108ce0 secure :-1 s=THROTTLE_DONE pgs=3186 cs=0 l=1 rx=0x7ff098010400 tx=0x7ff098010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.190 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.196+0000 7ff0a5ffb700 1 -- 172.21.15.80:0/277767194 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7ff098000c90 con 0x7ff0a810a3a0 2019-11-28T12:02:53.365 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.372+0000 7ff0aee3b700 1 -- 172.21.15.80:0/277767194 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0a8106510 con 0x7ff0a810a3a0 2019-11-28T12:02:53.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.373+0000 7ff0acbd7700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a810a3a0 0x7ff0a8108ce0 secure :-1 s=THROTTLE_DONE pgs=3186 cs=0 l=1 rx=0x7ff098010400 tx=0x7ff098010300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.366 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.373+0000 7ff0a5ffb700 1 -- 172.21.15.80:0/277767194 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v247) v1 ==== 74+0+14871 (secure 0 0 0) 0x7ff098000ea0 con 0x7ff0a810a3a0 2019-11-28T12:02:53.367 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:53.367 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":247,"fsid":"4d210428-f562-4c8d-978b-869be7a63ed0","created":"2019-11-28T11:24:56.548652+0000","modified":"2019-11-28T12:02:45.235154+0000","last_up_change":"2019-11-28T11:25:08.546218+0000","last_in_change":"2019-11-28T11:25:08.546218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":41,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T11:25:12.488372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":40,"pool_name":"cephfs_metadata","create_time":"2019-11-28T12:02:42.568808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"246","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":41,"pool_name":"cephfs_data","create_time":"2019-11-28T12:02:43.256218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"247","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9a5b82f5-994b-42f6-82f9-82cf5ff644a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":244,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":6092},{"type":"v1","addr":"172.21.15.80:6801","nonce":6092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":6092},{"type":"v1","addr":"172.21.15.80:6803","nonce":6092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":6092},{"type":"v1","addr":"172.21.15.80:6807","nonce":6092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":6092},{"type":"v1","addr":"172.21.15.80:6805","nonce":6092}]},"public_addr":"172.21.15.80:6801/6092","cluster_addr":"172.21.15.80:6803/6092","heartbeat_back_addr":"172.21.15.80:6807/6092","heartbeat_front_addr":"172.21.15.80:6805/6092","state":["exists","up"]},{"osd":1,"uuid":"59f860a3-5032-4948-9d92-2b02d89ea495","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":244,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":6094},{"type":"v1","addr":"172.21.15.80:6809","nonce":6094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":6094},{"type":"v1","addr":"172.21.15.80:6811","nonce":6094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":6094},{"type":"v1","addr":"172.21.15.80:6815","nonce":6094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":6094},{"type":"v1","addr":"172.21.15.80:6813","nonce":6094}]},"public_addr":"172.21.15.80:6809/6094","cluster_addr":"172.21.15.80:6811/6094","heartbeat_back_addr":"172.21.15.80:6815/6094","heartbeat_front_addr":"172.21.15.80:6813/6094","state":["exists","up"]},{"osd":2,"uuid":"01501801-5512-4f8e-a689-d7a5220c8389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":6105},{"type":"v1","addr":"172.21.15.80:6817","nonce":6105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":6105},{"type":"v1","addr":"172.21.15.80:6819","nonce":6105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":6105},{"type":"v1","addr":"172.21.15.80:6823","nonce":6105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":6105},{"type":"v1","addr":"172.21.15.80:6821","nonce":6105}]},"public_addr":"172.21.15.80:6817/6105","cluster_addr":"172.21.15.80:6819/6105","heartbeat_back_addr":"172.21.15.80:6823/6105","heartbeat_front_addr":"172.21.15.80:6821/6105","state":["exists","up"]},{"osd":3,"uuid":"3a0ffd4c-5f68-42f0-b51a-69e873715619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":6126},{"type":"v1","addr":"172.21.15.80:6825","nonce":6126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":6126},{"type":"v1","addr":"172.21.15.80:6827","nonce":6126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":6126},{"type":"v1","addr":"172.21.15.80:6831","nonce":6126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":6126},{"type":"v1","addr":"172.21.15.80:6829","nonce":6126}]},"public_addr":"172.21.15.80:6825/6126","cluster_addr":"172.21.15.80:6827/6126","heartbeat_back_addr":"172.21.15.80:6831/6126","heartbeat_front_addr":"172.21.15.80:6829/6126","state":["exists","up"]},{"osd":4,"uuid":"fe40502b-24da-4e32-a3ae-709eddfaa03a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":36920},{"type":"v1","addr":"172.21.15.174:6803","nonce":36920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":36920},{"type":"v1","addr":"172.21.15.174:6805","nonce":36920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":36920},{"type":"v1","addr":"172.21.15.174:6809","nonce":36920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":36920},{"type":"v1","addr":"172.21.15.174:6807","nonce":36920}]},"public_addr":"172.21.15.174:6803/36920","cluster_addr":"172.21.15.174:6805/36920","heartbeat_back_addr":"172.21.15.174:6809/36920","heartbeat_front_addr":"172.21.15.174:6807/36920","state":["exists","up"]},{"osd":5,"uuid":"4aba29c2-abad-41d2-97a9-cac1f5f7454a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":232,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":36928},{"type":"v1","addr":"172.21.15.174:6811","nonce":36928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":36928},{"type":"v1","addr":"172.21.15.174:6813","nonce":36928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":36928},{"type":"v1","addr":"172.21.15.174:6817","nonce":36928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":36928},{"type":"v1","addr":"172.21.15.174:6815","nonce":36928}]},"public_addr":"172.21.15.174:6811/36928","cluster_addr":"172.21.15.174:6813/36928","heartbeat_back_addr":"172.21.15.174:6817/36928","heartbeat_front_addr":"172.21.15.174:6815/36928","state":["exists","up"]},{"osd":6,"uuid":"8cd8b938-4ac2-40f4-a7b0-b01afb88b878","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":36962},{"type":"v1","addr":"172.21.15.174:6819","nonce":36962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":36962},{"type":"v1","addr":"172.21.15.174:6821","nonce":36962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":36962},{"type":"v1","addr":"172.21.15.174:6825","nonce":36962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":36962},{"type":"v1","addr":"172.21.15.174:6823","nonce":36962}]},"public_addr":"172.21.15.174:6819/36962","cluster_addr":"172.21.15.174:6821/36962","heartbeat_back_addr":"172.21.15.174:6825/36962","heartbeat_front_addr":"172.21.15.174:6823/36962","state":["exists","up"]},{"osd":7,"uuid":"5aba17ce-f3d9-46c6-a034-a8657647719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":36964},{"type":"v1","addr":"172.21.15.174:6827","nonce":36964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":36964},{"type":"v1","addr":"172.21.15.174:6829","nonce":36964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":36964},{"type":"v1","addr":"172.21.15.174:6833","nonce":36964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":36964},{"type":"v1","addr":"172.21.15.174:6831","nonce":36964}]},"public_addr":"172.21.15.174:6827/36964","cluster_addr":"172.21.15.174:6829/36964","heartbeat_back_addr":"172.21.15.174:6833/36964","heartbeat_front_addr":"172.21.15.174:6831/36964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.483168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.542689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.531732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.532239+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.457410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.529617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.540646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T11:25:06.523454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T12:02:53.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.375+0000 7ff0aee3b700 1 -- 172.21.15.80:0/277767194 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff08c018730 msgr2=0x7ff08c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.375+0000 7ff0aee3b700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff08c018730 0x7ff08c01abc0 crc :-1 s=READY pgs=1321 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:53.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.375+0000 7ff0aee3b700 1 -- 172.21.15.80:0/277767194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a810a3a0 msgr2=0x7ff0a8108ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.370 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.375+0000 7ff0aee3b700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a810a3a0 0x7ff0a8108ce0 secure :-1 s=READY pgs=3186 cs=0 l=1 rx=0x7ff098010400 tx=0x7ff098010300).stop 2019-11-28T12:02:53.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.375+0000 7ff0aee3b700 1 -- 172.21.15.80:0/277767194 shutdown_connections 2019-11-28T12:02:53.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.375+0000 7ff0aee3b700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7ff08c018730 0x7ff08c01abc0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:53.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.375+0000 7ff0aee3b700 1 --2- 172.21.15.80:0/277767194 >> v2:172.21.15.174:3300/0 conn(0x7ff0a8109220 0x7ff0a8109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:53.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.375+0000 7ff0aee3b700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a810a3a0 0x7ff0a8108ce0 unknown :-1 s=CLOSED pgs=3186 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:53.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.375+0000 7ff0aee3b700 1 --2- 172.21.15.80:0/277767194 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0a813dc00 0x7ff0a8109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:53.371 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.375+0000 7ff0aee3b700 1 -- 172.21.15.80:0/277767194 shutdown_connections 2019-11-28T12:02:53.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.376+0000 7ff0aee3b700 1 -- 172.21.15.80:0/277767194 wait complete. 2019-11-28T12:02:53.372 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.376+0000 7ff0aee3b700 1 -- 172.21.15.80:0/277767194 >> 172.21.15.80:0/277767194 conn(0x7ff0a811bfc0 msgr2=0x7ff0a8141050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:53.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T11:25:12.488372+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T12:02:42.568808+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 40, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'246', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T12:02:43.256218+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 41, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'247', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T12:02:53.386 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T12:02:53.523 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.525+0000 7f2beeb3a700 1 Processor -- start 2019-11-28T12:02:53.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.525+0000 7f2beeb3a700 1 -- start start 2019-11-28T12:02:53.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.526+0000 7f2beeb3a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2be81639f0 0x7f2be8165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:53.524 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.526+0000 7f2beeb3a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be806db60 con 0x7f2be815ed10 2019-11-28T12:02:53.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.526+0000 7f2beeb3a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be806e060 con 0x7f2be815f100 2019-11-28T12:02:53.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.526+0000 7f2beeb3a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be806fe00 con 0x7f2be81639f0 2019-11-28T12:02:53.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.526+0000 7f2bed0d7700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2be815ed10 0x7f2be8073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48120/0 (socket says 172.21.15.80:48120) 2019-11-28T12:02:53.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.526+0000 7f2bed0d7700 1 -- 172.21.15.80:0/1770677119 learned_addr learned my addr 172.21.15.80:0/1770677119 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:53.525 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.526+0000 7f2bed8d8700 1 --2- 172.21.15.80:0/1770677119 >> v2:172.21.15.174:3300/0 conn(0x7f2be81639f0 0x7f2be8165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.526+0000 7f2be7fff700 1 -- 172.21.15.80:0/1770677119 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258478689 0 0) 0x7f2bd00014d0 con 0x7f2be815ed10 2019-11-28T12:02:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.526+0000 7f2be7fff700 1 -- 172.21.15.80:0/1770677119 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bd4002e80 con 0x7f2be815ed10 2019-11-28T12:02:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.526+0000 7f2be7fff700 1 -- 172.21.15.80:0/1770677119 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372055925 0 0) 0x7f2bd8001080 con 0x7f2be815f100 2019-11-28T12:02:53.526 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.526+0000 7f2be7fff700 1 -- 172.21.15.80:0/1770677119 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bd40030b0 con 0x7f2be815f100 2019-11-28T12:02:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.527+0000 7f2bed8d8700 1 -- 172.21.15.80:0/1770677119 >> v1:172.21.15.174:6789/0 conn(0x7f2be815f100 legacy=0x7f2be806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.527+0000 7f2bed8d8700 1 -- 172.21.15.80:0/1770677119 >> v1:172.21.15.80:6789/0 conn(0x7f2be815ed10 legacy=0x7f2be8073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.527+0000 7f2bed8d8700 1 -- 172.21.15.80:0/1770677119 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be8070760 con 0x7f2be81639f0 2019-11-28T12:02:53.527 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.527+0000 7f2bed8d8700 1 --2- 172.21.15.80:0/1770677119 >> v2:172.21.15.174:3300/0 conn(0x7f2be81639f0 0x7f2be8165df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2be000af80 tx=0x7f2be000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.527+0000 7f2bed8d8700 1 --2- 172.21.15.80:0/1770677119 >> v2:172.21.15.174:3300/0 conn(0x7f2be81639f0 0x7f2be8165df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2be000af80 tx=0x7f2be000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.527+0000 7f2bed8d8700 1 --2- 172.21.15.80:0/1770677119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2be81639f0 0x7f2be8165df0 secure :-1 s=READY pgs=1935 cs=0 l=1 rx=0x7f2be000af80 tx=0x7f2be000b790).ready entity=mon.1 client_cookie=df336261d0360bc4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.527+0000 7f2bed8d8700 1 --2- 172.21.15.80:0/1770677119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2be81639f0 0x7f2be8165df0 secure :-1 s=THROTTLE_DONE pgs=1935 cs=0 l=1 rx=0x7f2be000af80 tx=0x7f2be000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.527+0000 7f2be7fff700 1 -- 172.21.15.80:0/1770677119 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2be0007240 con 0x7f2be81639f0 2019-11-28T12:02:53.528 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.527+0000 7f2bed8d8700 1 --2- 172.21.15.80:0/1770677119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2be81639f0 0x7f2be8165df0 secure :-1 s=THROTTLE_DONE pgs=1935 cs=0 l=1 rx=0x7f2be000af80 tx=0x7f2be000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.527+0000 7f2bed8d8700 1 --2- 172.21.15.80:0/1770677119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2be81639f0 0x7f2be8165df0 secure :-1 s=THROTTLE_DONE pgs=1935 cs=0 l=1 rx=0x7f2be000af80 tx=0x7f2be000b790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.527+0000 7f2be7fff700 1 -- 172.21.15.80:0/1770677119 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be0000bb0 con 0x7f2be81639f0 2019-11-28T12:02:53.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.527+0000 7f2be7fff700 1 -- 172.21.15.80:0/1770677119 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2be0009e60 con 0x7f2be81639f0 2019-11-28T12:02:53.529 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.527+0000 7f2beeb3a700 1 -- 172.21.15.80:0/1770677119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2be81639f0 msgr2=0x7f2be8165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.527+0000 7f2beeb3a700 1 --2- 172.21.15.80:0/1770677119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2be81639f0 0x7f2be8165df0 secure :-1 s=READY pgs=1935 cs=0 l=1 rx=0x7f2be000af80 tx=0x7f2be000b790).stop 2019-11-28T12:02:53.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.528+0000 7f2beeb3a700 1 -- 172.21.15.80:0/1770677119 shutdown_connections 2019-11-28T12:02:53.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.528+0000 7f2beeb3a700 1 --2- 172.21.15.80:0/1770677119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2be81639f0 0x7f2be8165df0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:53.530 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.528+0000 7f2beeb3a700 1 -- 172.21.15.80:0/1770677119 shutdown_connections 2019-11-28T12:02:53.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.528+0000 7f2beeb3a700 1 -- 172.21.15.80:0/1770677119 wait complete. 2019-11-28T12:02:53.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.528+0000 7f2beeb3a700 1 -- 172.21.15.80:0/1770677119 >> 172.21.15.80:0/1770677119 conn(0x7f2be8061d20 msgr2=0x7f2be80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:53.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.530+0000 7f2beeb3a700 1 Processor -- start 2019-11-28T12:02:53.531 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.530+0000 7f2beeb3a700 1 -- start start 2019-11-28T12:02:53.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.531+0000 7f2beeb3a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2be812aa90 0x7f2be812ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:53.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.531+0000 7f2beeb3a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2be80741e0 0x7f2be8073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:53.537 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.531+0000 7f2beeb3a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be807c080 con 0x7f2be8074670 2019-11-28T12:02:53.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.531+0000 7f2beeb3a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be807a2c0 con 0x7f2be812aa90 2019-11-28T12:02:53.539 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.531+0000 7f2beeb3a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be807a590 con 0x7f2be80741e0 2019-11-28T12:02:53.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.531+0000 7f2bed0d7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2be812aa90 0x7f2be812ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:53.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.531+0000 7f2bed0d7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2be812aa90 0x7f2be812ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48810/0 (socket says 172.21.15.80:48810) 2019-11-28T12:02:53.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.531+0000 7f2bed0d7700 1 -- 172.21.15.80:0/3208678905 learned_addr learned my addr 172.21.15.80:0/3208678905 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:53.540 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.531+0000 7f2bec8d6700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2be80741e0 0x7f2be8073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:53.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.532+0000 7f2bed0d7700 1 -- 172.21.15.80:0/3208678905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2be80741e0 msgr2=0x7f2be8073060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.532+0000 7f2bed0d7700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2be80741e0 0x7f2be8073060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:53.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.532+0000 7f2bed0d7700 1 -- 172.21.15.80:0/3208678905 >> v1:172.21.15.80:6789/0 conn(0x7f2be8074670 legacy=0x7f2be80735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.541 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.532+0000 7f2bed0d7700 1 -- 172.21.15.80:0/3208678905 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be807ac20 con 0x7f2be812aa90 2019-11-28T12:02:53.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.532+0000 7f2bed0d7700 1 --2- 172.21.15.80:0/3208678905 >> v2:172.21.15.80:3300/0 conn(0x7f2be812aa90 0x7f2be812ae80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2bd0010760 tx=0x7f2bd00105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.542 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.532+0000 7f2bed0d7700 1 --2- 172.21.15.80:0/3208678905 >> v2:172.21.15.80:3300/0 conn(0x7f2be812aa90 0x7f2be812ae80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2bd0010760 tx=0x7f2bd00105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.532+0000 7f2bed0d7700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2be812aa90 0x7f2be812ae80 secure :-1 s=READY pgs=3189 cs=0 l=1 rx=0x7f2bd0010760 tx=0x7f2bd00105e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:53.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.532+0000 7f2bed0d7700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2be812aa90 0x7f2be812ae80 secure :-1 s=THROTTLE_DONE pgs=3189 cs=0 l=1 rx=0x7f2bd0010760 tx=0x7f2bd00105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.532+0000 7f2bed0d7700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2be812aa90 0x7f2be812ae80 secure :-1 s=THROTTLE_DONE pgs=3189 cs=0 l=1 rx=0x7f2bd0010760 tx=0x7f2bd00105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.543 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.532+0000 7f2be5ffb700 1 -- 172.21.15.80:0/3208678905 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bd0001010 con 0x7f2be812aa90 2019-11-28T12:02:53.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.532+0000 7f2bed0d7700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2be812aa90 0x7f2be812ae80 secure :-1 s=THROTTLE_DONE pgs=3189 cs=0 l=1 rx=0x7f2bd0010760 tx=0x7f2bd00105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.532+0000 7f2be5ffb700 1 -- 172.21.15.80:0/3208678905 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd0001440 con 0x7f2be812aa90 2019-11-28T12:02:53.544 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.532+0000 7f2beeb3a700 1 -- 172.21.15.80:0/3208678905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be807afa0 con 0x7f2be812aa90 2019-11-28T12:02:53.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.532+0000 7f2be5ffb700 1 -- 172.21.15.80:0/3208678905 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bd0001ad0 con 0x7f2be812aa90 2019-11-28T12:02:53.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.532+0000 7f2beeb3a700 1 -- 172.21.15.80:0/3208678905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be807ac20 con 0x7f2be812aa90 2019-11-28T12:02:53.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.532+0000 7f2bed0d7700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2be812aa90 0x7f2be812ae80 secure :-1 s=THROTTLE_DONE pgs=3189 cs=0 l=1 rx=0x7f2bd0010760 tx=0x7f2bd00105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.533+0000 7f2be5ffb700 1 -- 172.21.15.80:0/3208678905 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f2bd0001010 con 0x7f2be812aa90 2019-11-28T12:02:53.545 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.533+0000 7f2bed0d7700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2be812aa90 0x7f2be812ae80 secure :-1 s=THROTTLE_DONE pgs=3189 cs=0 l=1 rx=0x7f2bd0010760 tx=0x7f2bd00105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.533+0000 7f2be5ffb700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2bcc018730 0x7f2bcc01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:53.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.533+0000 7f2be5ffb700 1 -- 172.21.15.80:0/3208678905 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f2bd0031e50 con 0x7f2be812aa90 2019-11-28T12:02:53.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.533+0000 7f2bec8d6700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2bcc018730 0x7f2bcc01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:53.546 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.533+0000 7f2bec8d6700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2bcc018730 0x7f2bcc01abc0 crc :-1 s=READY pgs=1322 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:53.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.540+0000 7f2beeb3a700 1 -- 172.21.15.80:0/3208678905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be807afa0 con 0x7f2be812aa90 2019-11-28T12:02:53.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.543+0000 7f2bed0d7700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2be812aa90 0x7f2be812ae80 secure :-1 s=THROTTLE_DONE pgs=3189 cs=0 l=1 rx=0x7f2bd0010760 tx=0x7f2bd00105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.547 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.543+0000 7f2be5ffb700 1 -- 172.21.15.80:0/3208678905 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f2bd0007950 con 0x7f2be812aa90 2019-11-28T12:02:53.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.709+0000 7f2beeb3a700 1 -- 172.21.15.80:0/3208678905 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f2be807ac20 con 0x7f2be812aa90 2019-11-28T12:02:53.702 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.709+0000 7f2bed0d7700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2be812aa90 0x7f2be812ae80 secure :-1 s=THROTTLE_DONE pgs=3189 cs=0 l=1 rx=0x7f2bd0010760 tx=0x7f2bd00105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.703 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.709+0000 7f2be5ffb700 1 -- 172.21.15.80:0/3208678905 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v247) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2bd0001010 con 0x7f2be812aa90 2019-11-28T12:02:53.704 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:02:53.705 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.711+0000 7f2beeb3a700 1 -- 172.21.15.80:0/3208678905 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2bcc018730 msgr2=0x7f2bcc01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.711+0000 7f2beeb3a700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2bcc018730 0x7f2bcc01abc0 crc :-1 s=READY pgs=1322 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:53.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.711+0000 7f2beeb3a700 1 -- 172.21.15.80:0/3208678905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2be812aa90 msgr2=0x7f2be812ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.711+0000 7f2beeb3a700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2be812aa90 0x7f2be812ae80 secure :-1 s=READY pgs=3189 cs=0 l=1 rx=0x7f2bd0010760 tx=0x7f2bd00105e0).stop 2019-11-28T12:02:53.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.712+0000 7f2beeb3a700 1 -- 172.21.15.80:0/3208678905 shutdown_connections 2019-11-28T12:02:53.706 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.712+0000 7f2beeb3a700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f2bcc018730 0x7f2bcc01abc0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:53.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.712+0000 7f2beeb3a700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2be80741e0 0x7f2be8073060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:53.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.712+0000 7f2beeb3a700 1 --2- 172.21.15.80:0/3208678905 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2be812aa90 0x7f2be812ae80 unknown :-1 s=CLOSED pgs=3189 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:53.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.712+0000 7f2beeb3a700 1 -- 172.21.15.80:0/3208678905 shutdown_connections 2019-11-28T12:02:53.707 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.712+0000 7f2beeb3a700 1 -- 172.21.15.80:0/3208678905 wait complete. 2019-11-28T12:02:53.708 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.712+0000 7f2beeb3a700 1 -- 172.21.15.80:0/3208678905 >> 172.21.15.80:0/3208678905 conn(0x7f2be8147670 msgr2=0x7f2be81641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:53.715 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-11-28T12:02:53.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.846+0000 7fd29dd0f700 1 Processor -- start 2019-11-28T12:02:53.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.846+0000 7fd29dd0f700 1 -- start start 2019-11-28T12:02:53.843 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.847+0000 7fd29dd0f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd29815ed10 0x7fd29815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:53.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.847+0000 7fd29dd0f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2980734b0 0x7fd2980726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:53.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.847+0000 7fd29dd0f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29806db60 con 0x7fd298073020 2019-11-28T12:02:53.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.847+0000 7fd29dd0f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29806fe00 con 0x7fd29815ed10 2019-11-28T12:02:53.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.847+0000 7fd29dd0f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2980700d0 con 0x7fd2980734b0 2019-11-28T12:02:53.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.847+0000 7fd28ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd298073020 0x7fd298071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48134/0 (socket says 172.21.15.80:48134) 2019-11-28T12:02:53.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.847+0000 7fd28ffff700 1 -- 172.21.15.80:0/2265929943 learned_addr learned my addr 172.21.15.80:0/2265929943 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:53.844 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.847+0000 7fd297fff700 1 --2- 172.21.15.80:0/2265929943 >> v2:172.21.15.174:3300/0 conn(0x7fd29815ed10 0x7fd29815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:53.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.847+0000 7fd29caad700 1 --2- 172.21.15.80:0/2265929943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2980734b0 0x7fd2980726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:53.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.847+0000 7fd2977fe700 1 -- 172.21.15.80:0/2265929943 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113355397 0 0) 0x7fd280001150 con 0x7fd298073020 2019-11-28T12:02:53.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.847+0000 7fd2977fe700 1 -- 172.21.15.80:0/2265929943 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd284002e80 con 0x7fd298073020 2019-11-28T12:02:53.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.847+0000 7fd297fff700 1 -- 172.21.15.80:0/2265929943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2980734b0 msgr2=0x7fd2980726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:53.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.847+0000 7fd297fff700 1 --2- 172.21.15.80:0/2265929943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2980734b0 0x7fd2980726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:53.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.847+0000 7fd297fff700 1 -- 172.21.15.80:0/2265929943 >> v1:172.21.15.80:6789/0 conn(0x7fd298073020 legacy=0x7fd298071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.845 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.847+0000 7fd297fff700 1 -- 172.21.15.80:0/2265929943 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd298070760 con 0x7fd29815ed10 2019-11-28T12:02:53.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.847+0000 7fd297fff700 1 --2- 172.21.15.80:0/2265929943 >> v2:172.21.15.174:3300/0 conn(0x7fd29815ed10 0x7fd29815f100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd28800af50 tx=0x7fd28800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.848+0000 7fd297fff700 1 --2- 172.21.15.80:0/2265929943 >> v2:172.21.15.174:3300/0 conn(0x7fd29815ed10 0x7fd29815f100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd28800af50 tx=0x7fd28800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.848+0000 7fd297fff700 1 --2- 172.21.15.80:0/2265929943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd29815ed10 0x7fd29815f100 secure :-1 s=READY pgs=1936 cs=0 l=1 rx=0x7fd28800af50 tx=0x7fd28800b250).ready entity=mon.1 client_cookie=b48caefb2e380d97 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:53.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.848+0000 7fd297fff700 1 --2- 172.21.15.80:0/2265929943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd29815ed10 0x7fd29815f100 secure :-1 s=THROTTLE_DONE pgs=1936 cs=0 l=1 rx=0x7fd28800af50 tx=0x7fd28800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.846 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.848+0000 7fd2977fe700 1 -- 172.21.15.80:0/2265929943 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd288007210 con 0x7fd29815ed10 2019-11-28T12:02:53.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.848+0000 7fd297fff700 1 --2- 172.21.15.80:0/2265929943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd29815ed10 0x7fd29815f100 secure :-1 s=THROTTLE_DONE pgs=1936 cs=0 l=1 rx=0x7fd28800af50 tx=0x7fd28800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.848+0000 7fd297fff700 1 --2- 172.21.15.80:0/2265929943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd29815ed10 0x7fd29815f100 secure :-1 s=THROTTLE_DONE pgs=1936 cs=0 l=1 rx=0x7fd28800af50 tx=0x7fd28800b250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.848+0000 7fd2977fe700 1 -- 172.21.15.80:0/2265929943 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2880099b0 con 0x7fd29815ed10 2019-11-28T12:02:53.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.848+0000 7fd2977fe700 1 -- 172.21.15.80:0/2265929943 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd28800a080 con 0x7fd29815ed10 2019-11-28T12:02:53.847 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.848+0000 7fd29dd0f700 1 -- 172.21.15.80:0/2265929943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd29815ed10 msgr2=0x7fd29815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.848+0000 7fd29dd0f700 1 --2- 172.21.15.80:0/2265929943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd29815ed10 0x7fd29815f100 secure :-1 s=READY pgs=1936 cs=0 l=1 rx=0x7fd28800af50 tx=0x7fd28800b250).stop 2019-11-28T12:02:53.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.848+0000 7fd29dd0f700 1 -- 172.21.15.80:0/2265929943 shutdown_connections 2019-11-28T12:02:53.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.848+0000 7fd29dd0f700 1 --2- 172.21.15.80:0/2265929943 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2980734b0 0x7fd2980726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:53.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.848+0000 7fd29dd0f700 1 --2- 172.21.15.80:0/2265929943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd29815ed10 0x7fd29815f100 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:53.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.848+0000 7fd29dd0f700 1 -- 172.21.15.80:0/2265929943 shutdown_connections 2019-11-28T12:02:53.848 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.848+0000 7fd29dd0f700 1 -- 172.21.15.80:0/2265929943 wait complete. 2019-11-28T12:02:53.849 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.848+0000 7fd29dd0f700 1 -- 172.21.15.80:0/2265929943 >> 172.21.15.80:0/2265929943 conn(0x7fd298061d20 msgr2=0x7fd2980641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:53.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.851+0000 7fd29dd0f700 1 Processor -- start 2019-11-28T12:02:53.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.851+0000 7fd29dd0f700 1 -- start start 2019-11-28T12:02:53.852 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29dd0f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd298167d80 0x7fd29816a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:53.853 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29dd0f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd298148e00 con 0x7fd298148320 2019-11-28T12:02:53.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29dd0f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd298108b10 con 0x7fd2981079b0 2019-11-28T12:02:53.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29dd0f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29813aa20 con 0x7fd298167d80 2019-11-28T12:02:53.856 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29caad700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd298167d80 0x7fd29816a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:53.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29caad700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd298167d80 0x7fd29816a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48828/0 (socket says 172.21.15.80:48828) 2019-11-28T12:02:53.865 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd297fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd298148320 0x7fd29810ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48140/0 (socket says 172.21.15.80:48140) 2019-11-28T12:02:53.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29caad700 1 -- 172.21.15.80:0/88442956 learned_addr learned my addr 172.21.15.80:0/88442956 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:53.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29caad700 1 -- 172.21.15.80:0/88442956 >> v1:172.21.15.174:6789/0 conn(0x7fd2981079b0 legacy=0x7fd298107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29caad700 1 -- 172.21.15.80:0/88442956 >> v1:172.21.15.80:6789/0 conn(0x7fd298148320 legacy=0x7fd29810ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:53.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd2957fa700 1 -- 172.21.15.80:0/88442956 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132094379 0 0) 0x7fd2880009d0 con 0x7fd298148320 2019-11-28T12:02:53.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29caad700 1 -- 172.21.15.80:0/88442956 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29810c490 con 0x7fd298167d80 2019-11-28T12:02:53.866 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29caad700 1 --2- 172.21.15.80:0/88442956 >> v2:172.21.15.80:3300/0 conn(0x7fd298167d80 0x7fd29816a180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2900107d0 tx=0x7fd290010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29caad700 1 --2- 172.21.15.80:0/88442956 >> v2:172.21.15.80:3300/0 conn(0x7fd298167d80 0x7fd29816a180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2900107d0 tx=0x7fd290010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29caad700 1 --2- 172.21.15.80:0/88442956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd298167d80 0x7fd29816a180 secure :-1 s=READY pgs=3192 cs=0 l=1 rx=0x7fd2900107d0 tx=0x7fd290010b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:53.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29caad700 1 --2- 172.21.15.80:0/88442956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd298167d80 0x7fd29816a180 secure :-1 s=THROTTLE_DONE pgs=3192 cs=0 l=1 rx=0x7fd2900107d0 tx=0x7fd290010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd2957fa700 1 -- 172.21.15.80:0/88442956 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29000f410 con 0x7fd298167d80 2019-11-28T12:02:53.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29caad700 1 --2- 172.21.15.80:0/88442956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd298167d80 0x7fd29816a180 secure :-1 s=THROTTLE_DONE pgs=3192 cs=0 l=1 rx=0x7fd2900107d0 tx=0x7fd290010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29caad700 1 --2- 172.21.15.80:0/88442956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd298167d80 0x7fd29816a180 secure :-1 s=THROTTLE_DONE pgs=3192 cs=0 l=1 rx=0x7fd2900107d0 tx=0x7fd290010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.867 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd2957fa700 1 -- 172.21.15.80:0/88442956 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd290000df0 con 0x7fd298167d80 2019-11-28T12:02:53.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29dd0f700 1 -- 172.21.15.80:0/88442956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29810c810 con 0x7fd298167d80 2019-11-28T12:02:53.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd2957fa700 1 -- 172.21.15.80:0/88442956 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd29000f550 con 0x7fd298167d80 2019-11-28T12:02:53.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.852+0000 7fd29dd0f700 1 -- 172.21.15.80:0/88442956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29810c490 con 0x7fd298167d80 2019-11-28T12:02:53.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.853+0000 7fd29caad700 1 --2- 172.21.15.80:0/88442956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd298167d80 0x7fd29816a180 secure :-1 s=THROTTLE_DONE pgs=3192 cs=0 l=1 rx=0x7fd2900107d0 tx=0x7fd290010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.853+0000 7fd2957fa700 1 -- 172.21.15.80:0/88442956 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fd29000f170 con 0x7fd298167d80 2019-11-28T12:02:53.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.853+0000 7fd29caad700 1 --2- 172.21.15.80:0/88442956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd298167d80 0x7fd29816a180 secure :-1 s=THROTTLE_DONE pgs=3192 cs=0 l=1 rx=0x7fd2900107d0 tx=0x7fd290010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.868 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.853+0000 7fd2957fa700 1 --2- 172.21.15.80:0/88442956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd27c018730 0x7fd27c01abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:53.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.853+0000 7fd2957fa700 1 -- 172.21.15.80:0/88442956 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd290031ef0 con 0x7fd298167d80 2019-11-28T12:02:53.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.853+0000 7fd297fff700 1 --2- 172.21.15.80:0/88442956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd27c018730 0x7fd27c01abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:53.869 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.854+0000 7fd297fff700 1 --2- 172.21.15.80:0/88442956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd27c018730 0x7fd27c01abc0 crc :-1 s=READY pgs=1323 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:53.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.861+0000 7fd29dd0f700 1 -- 172.21.15.80:0/88442956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29810c810 con 0x7fd298167d80 2019-11-28T12:02:53.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.865+0000 7fd29caad700 1 --2- 172.21.15.80:0/88442956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd298167d80 0x7fd29816a180 secure :-1 s=THROTTLE_DONE pgs=3192 cs=0 l=1 rx=0x7fd2900107d0 tx=0x7fd290010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:53.870 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:53.865+0000 7fd2957fa700 1 -- 172.21.15.80:0/88442956 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fd29000ee00 con 0x7fd298167d80 2019-11-28T12:02:54.025 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.030+0000 7fd29dd0f700 1 -- 172.21.15.80:0/88442956 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fd29810c490 con 0x7fd298167d80 2019-11-28T12:02:54.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.031+0000 7fd29caad700 1 --2- 172.21.15.80:0/88442956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd298167d80 0x7fd29816a180 secure :-1 s=THROTTLE_DONE pgs=3192 cs=0 l=1 rx=0x7fd2900107d0 tx=0x7fd290010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.026 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.031+0000 7fd2957fa700 1 -- 172.21.15.80:0/88442956 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v247) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd29000f0b0 con 0x7fd298167d80 2019-11-28T12:02:54.026 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:02:54.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.033+0000 7fd29dd0f700 1 -- 172.21.15.80:0/88442956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd27c018730 msgr2=0x7fd27c01abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:54.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.033+0000 7fd29dd0f700 1 --2- 172.21.15.80:0/88442956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd27c018730 0x7fd27c01abc0 crc :-1 s=READY pgs=1323 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:54.028 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.033+0000 7fd29dd0f700 1 -- 172.21.15.80:0/88442956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd298167d80 msgr2=0x7fd29816a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:54.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.033+0000 7fd29dd0f700 1 --2- 172.21.15.80:0/88442956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd298167d80 0x7fd29816a180 secure :-1 s=READY pgs=3192 cs=0 l=1 rx=0x7fd2900107d0 tx=0x7fd290010b70).stop 2019-11-28T12:02:54.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.033+0000 7fd29dd0f700 1 -- 172.21.15.80:0/88442956 shutdown_connections 2019-11-28T12:02:54.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.033+0000 7fd29dd0f700 1 --2- 172.21.15.80:0/88442956 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd298167d80 0x7fd29816a180 unknown :-1 s=CLOSED pgs=3192 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:54.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.033+0000 7fd29dd0f700 1 --2- 172.21.15.80:0/88442956 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fd27c018730 0x7fd27c01abc0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:54.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.033+0000 7fd29dd0f700 1 -- 172.21.15.80:0/88442956 shutdown_connections 2019-11-28T12:02:54.037 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.033+0000 7fd29dd0f700 1 -- 172.21.15.80:0/88442956 wait complete. 2019-11-28T12:02:54.038 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.033+0000 7fd29dd0f700 1 -- 172.21.15.80:0/88442956 >> 172.21.15.80:0/88442956 conn(0x7fd29815e2d0 msgr2=0x7fd298147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:54.039 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-11-28T12:02:54.177 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.180+0000 7fadcdece700 1 Processor -- start 2019-11-28T12:02:54.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.180+0000 7fadcdece700 1 -- start start 2019-11-28T12:02:54.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadcdece700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadc815f100 0x7fadc806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:54.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadcdece700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fadc806c2f0 0x7fadc806c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:54.178 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadcdece700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc806db60 con 0x7fadc815ed10 2019-11-28T12:02:54.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadcdece700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc806fe00 con 0x7fadc815f100 2019-11-28T12:02:54.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadcdece700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc80700d0 con 0x7fadc806c2f0 2019-11-28T12:02:54.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadbffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadc815f100 0x7fadc806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:54.179 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadc7fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fadc815ed10 0x7fadc8073020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48148/0 (socket says 172.21.15.80:48148) 2019-11-28T12:02:54.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadc7fff700 1 -- 172.21.15.80:0/1035609864 learned_addr learned my addr 172.21.15.80:0/1035609864 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:54.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadccc6c700 1 --2- 172.21.15.80:0/1035609864 >> v2:172.21.15.174:3300/0 conn(0x7fadc806c2f0 0x7fadc806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:54.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadc77fe700 1 -- 172.21.15.80:0/1035609864 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538553582 0 0) 0x7fadb8001150 con 0x7fadc815ed10 2019-11-28T12:02:54.180 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadc77fe700 1 -- 172.21.15.80:0/1035609864 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fada8002e80 con 0x7fadc815ed10 2019-11-28T12:02:54.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadbffff700 1 -- 172.21.15.80:0/1035609864 >> v2:172.21.15.174:3300/0 conn(0x7fadc806c2f0 msgr2=0x7fadc806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:54.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadbffff700 1 --2- 172.21.15.80:0/1035609864 >> v2:172.21.15.174:3300/0 conn(0x7fadc806c2f0 0x7fadc806c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:54.181 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadbffff700 1 -- 172.21.15.80:0/1035609864 >> v1:172.21.15.80:6789/0 conn(0x7fadc815ed10 legacy=0x7fadc8073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:54.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadbffff700 1 -- 172.21.15.80:0/1035609864 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc8070760 con 0x7fadc815f100 2019-11-28T12:02:54.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadbffff700 1 --2- 172.21.15.80:0/1035609864 >> v2:172.21.15.80:3300/0 conn(0x7fadc815f100 0x7fadc806bdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fadb000af50 tx=0x7fadb000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadbffff700 1 --2- 172.21.15.80:0/1035609864 >> v2:172.21.15.80:3300/0 conn(0x7fadc815f100 0x7fadc806bdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fadb000af50 tx=0x7fadb000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.182 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadbffff700 1 --2- 172.21.15.80:0/1035609864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadc815f100 0x7fadc806bdb0 secure :-1 s=READY pgs=3194 cs=0 l=1 rx=0x7fadb000af50 tx=0x7fadb000b6e0).ready entity=mon.0 client_cookie=3f559df69e95d2aa server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:54.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadbffff700 1 --2- 172.21.15.80:0/1035609864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadc815f100 0x7fadc806bdb0 secure :-1 s=THROTTLE_DONE pgs=3194 cs=0 l=1 rx=0x7fadb000af50 tx=0x7fadb000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadc77fe700 1 -- 172.21.15.80:0/1035609864 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadb0007210 con 0x7fadc815f100 2019-11-28T12:02:54.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadbffff700 1 --2- 172.21.15.80:0/1035609864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadc815f100 0x7fadc806bdb0 secure :-1 s=THROTTLE_DONE pgs=3194 cs=0 l=1 rx=0x7fadb000af50 tx=0x7fadb000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.183 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadbffff700 1 --2- 172.21.15.80:0/1035609864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadc815f100 0x7fadc806bdb0 secure :-1 s=THROTTLE_DONE pgs=3194 cs=0 l=1 rx=0x7fadb000af50 tx=0x7fadb000b6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadc77fe700 1 -- 172.21.15.80:0/1035609864 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb00099b0 con 0x7fadc815f100 2019-11-28T12:02:54.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.181+0000 7fadc77fe700 1 -- 172.21.15.80:0/1035609864 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadb0009ba0 con 0x7fadc815f100 2019-11-28T12:02:54.184 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.182+0000 7fadcdece700 1 -- 172.21.15.80:0/1035609864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadc815f100 msgr2=0x7fadc806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:54.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.182+0000 7fadcdece700 1 --2- 172.21.15.80:0/1035609864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadc815f100 0x7fadc806bdb0 secure :-1 s=READY pgs=3194 cs=0 l=1 rx=0x7fadb000af50 tx=0x7fadb000b6e0).stop 2019-11-28T12:02:54.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.182+0000 7fadcdece700 1 -- 172.21.15.80:0/1035609864 shutdown_connections 2019-11-28T12:02:54.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.182+0000 7fadcdece700 1 --2- 172.21.15.80:0/1035609864 >> v2:172.21.15.174:3300/0 conn(0x7fadc806c2f0 0x7fadc806c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:54.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.182+0000 7fadcdece700 1 --2- 172.21.15.80:0/1035609864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadc815f100 0x7fadc806bdb0 unknown :-1 s=CLOSED pgs=3194 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:54.185 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.182+0000 7fadcdece700 1 -- 172.21.15.80:0/1035609864 shutdown_connections 2019-11-28T12:02:54.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.182+0000 7fadcdece700 1 -- 172.21.15.80:0/1035609864 wait complete. 2019-11-28T12:02:54.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.182+0000 7fadcdece700 1 -- 172.21.15.80:0/1035609864 >> 172.21.15.80:0/1035609864 conn(0x7fadc8061d20 msgr2=0x7fadc80641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:54.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.185+0000 7fadcdece700 1 Processor -- start 2019-11-28T12:02:54.186 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.185+0000 7fadcdece700 1 -- start start 2019-11-28T12:02:54.192 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.185+0000 7fadcdece700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fadc8148320 0x7fadc810ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:54.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.185+0000 7fadcdece700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadc810e3d0 0x7fadc8168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:54.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.185+0000 7fadcdece700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc8148e00 con 0x7fadc810f290 2019-11-28T12:02:54.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.185+0000 7fadcdece700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc813aa20 con 0x7fadc8148320 2019-11-28T12:02:54.193 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.185+0000 7fadcdece700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc813acf0 con 0x7fadc810e3d0 2019-11-28T12:02:54.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc7fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fadc8148320 0x7fadc810ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:54.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadccc6c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadc810e3d0 0x7fadc8168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:54.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc7fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fadc8148320 0x7fadc810ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.80:35492/0 (socket says 172.21.15.80:35492) 2019-11-28T12:02:54.194 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadccc6c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadc810e3d0 0x7fadc8168d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.80:51102/0 (socket says 172.21.15.80:51102) 2019-11-28T12:02:54.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc7fff700 1 -- 172.21.15.80:0/760420078 learned_addr learned my addr 172.21.15.80:0/760420078 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:54.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadbffff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fadc810f290 0x7fadc810dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.80:35468/0 (socket says 172.21.15.80:35468) 2019-11-28T12:02:54.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc7fff700 1 -- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadc810e3d0 msgr2=0x7fadc8168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:54.195 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc7fff700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadc810e3d0 0x7fadc8168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:54.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc7fff700 1 -- 172.21.15.80:0/760420078 >> v1:172.21.15.174:6789/0 conn(0x7fadc810f290 legacy=0x7fadc810dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:54.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc57fa700 1 -- 172.21.15.80:0/760420078 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215941615 0 0) 0x7fadb000ac20 con 0x7fadc810f290 2019-11-28T12:02:54.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc7fff700 1 -- 172.21.15.80:0/760420078 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc810c490 con 0x7fadc8148320 2019-11-28T12:02:54.196 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadccc6c700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadc810e3d0 0x7fadc8168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-11-28T12:02:54.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc7fff700 1 --2- 172.21.15.80:0/760420078 >> v2:172.21.15.174:3300/0 conn(0x7fadc8148320 0x7fadc810ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fadb80103e0 tx=0x7fadb8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc7fff700 1 --2- 172.21.15.80:0/760420078 >> v2:172.21.15.174:3300/0 conn(0x7fadc8148320 0x7fadc810ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fadb80103e0 tx=0x7fadb8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc7fff700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadc8148320 0x7fadc810ed50 secure :-1 s=READY pgs=1939 cs=0 l=1 rx=0x7fadb80103e0 tx=0x7fadb8010780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:54.197 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc7fff700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadc8148320 0x7fadc810ed50 secure :-1 s=THROTTLE_DONE pgs=1939 cs=0 l=1 rx=0x7fadb80103e0 tx=0x7fadb8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc57fa700 1 -- 172.21.15.80:0/760420078 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadb8000c90 con 0x7fadc8148320 2019-11-28T12:02:54.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc7fff700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadc8148320 0x7fadc810ed50 secure :-1 s=THROTTLE_DONE pgs=1939 cs=0 l=1 rx=0x7fadb80103e0 tx=0x7fadb8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc7fff700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadc8148320 0x7fadc810ed50 secure :-1 s=THROTTLE_DONE pgs=1939 cs=0 l=1 rx=0x7fadb80103e0 tx=0x7fadb8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.198 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc57fa700 1 -- 172.21.15.80:0/760420078 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb80010c0 con 0x7fadc8148320 2019-11-28T12:02:54.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadcdece700 1 -- 172.21.15.80:0/760420078 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc810c810 con 0x7fadc8148320 2019-11-28T12:02:54.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadc57fa700 1 -- 172.21.15.80:0/760420078 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadb8001710 con 0x7fadc8148320 2019-11-28T12:02:54.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.186+0000 7fadcdece700 1 -- 172.21.15.80:0/760420078 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc810c490 con 0x7fadc8148320 2019-11-28T12:02:54.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.187+0000 7fadc7fff700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadc8148320 0x7fadc810ed50 secure :-1 s=THROTTLE_DONE pgs=1939 cs=0 l=1 rx=0x7fadb80103e0 tx=0x7fadb8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.199 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.187+0000 7fadc57fa700 1 -- 172.21.15.80:0/760420078 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7fadb8000c90 con 0x7fadc8148320 2019-11-28T12:02:54.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.187+0000 7fadc7fff700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadc8148320 0x7fadc810ed50 secure :-1 s=THROTTLE_DONE pgs=1939 cs=0 l=1 rx=0x7fadb80103e0 tx=0x7fadb8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.187+0000 7fadc57fa700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fada0018730 0x7fada001abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:54.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.187+0000 7fadc57fa700 1 -- 172.21.15.80:0/760420078 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fadb8031ab0 con 0x7fadc8148320 2019-11-28T12:02:54.200 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.187+0000 7fadbffff700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fada0018730 0x7fada001abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:54.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.187+0000 7fadbffff700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fada0018730 0x7fada001abc0 crc :-1 s=READY pgs=1324 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:54.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.195+0000 7fadcdece700 1 -- 172.21.15.80:0/760420078 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc810c810 con 0x7fadc8148320 2019-11-28T12:02:54.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.198+0000 7fadc7fff700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadc8148320 0x7fadc810ed50 secure :-1 s=THROTTLE_DONE pgs=1939 cs=0 l=1 rx=0x7fadb80103e0 tx=0x7fadb8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.201 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.198+0000 7fadc57fa700 1 -- 172.21.15.80:0/760420078 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7fadb80075d0 con 0x7fadc8148320 2019-11-28T12:02:54.358 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.365+0000 7fadcdece700 1 -- 172.21.15.80:0/760420078 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fadc810c490 con 0x7fadc8148320 2019-11-28T12:02:54.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.367+0000 7fadc7fff700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadc8148320 0x7fadc810ed50 secure :-1 s=THROTTLE_DONE pgs=1939 cs=0 l=1 rx=0x7fadb80103e0 tx=0x7fadb8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.359 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.367+0000 7fadc57fa700 1 -- 172.21.15.80:0/760420078 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v247) v1 ==== 100+0+10 (secure 0 0 0) 0x7fadb8000c90 con 0x7fadc8148320 2019-11-28T12:02:54.359 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 8 2019-11-28T12:02:54.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.368+0000 7fadcdece700 1 -- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fada0018730 msgr2=0x7fada001abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:54.361 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.368+0000 7fadcdece700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fada0018730 0x7fada001abc0 crc :-1 s=READY pgs=1324 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:54.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.368+0000 7fadcdece700 1 -- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadc8148320 msgr2=0x7fadc810ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:54.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.368+0000 7fadcdece700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadc8148320 0x7fadc810ed50 secure :-1 s=READY pgs=1939 cs=0 l=1 rx=0x7fadb80103e0 tx=0x7fadb8010780).stop 2019-11-28T12:02:54.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.368+0000 7fadcdece700 1 -- 172.21.15.80:0/760420078 shutdown_connections 2019-11-28T12:02:54.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.368+0000 7fadcdece700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadc810e3d0 0x7fadc8168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:54.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.368+0000 7fadcdece700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7fada0018730 0x7fada001abc0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:54.362 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.368+0000 7fadcdece700 1 --2- 172.21.15.80:0/760420078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadc8148320 0x7fadc810ed50 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:54.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.368+0000 7fadcdece700 1 -- 172.21.15.80:0/760420078 shutdown_connections 2019-11-28T12:02:54.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.368+0000 7fadcdece700 1 -- 172.21.15.80:0/760420078 wait complete. 2019-11-28T12:02:54.363 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.368+0000 7fadcdece700 1 -- 172.21.15.80:0/760420078 >> 172.21.15.80:0/760420078 conn(0x7fadc815e2d0 msgr2=0x7fadc8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:54.371 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-11-28T12:02:54.372 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:54.496 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.499+0000 7f42f6fb9700 1 Processor -- start 2019-11-28T12:02:54.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.499+0000 7f42f6fb9700 1 -- start start 2019-11-28T12:02:54.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.500+0000 7f42f6fb9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f42f006c0a0 0x7f42f0072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:54.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.500+0000 7f42f6fb9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42f00734e0 0x7f42f0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:54.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.500+0000 7f42f6fb9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f006db00 con 0x7f42f0072360 2019-11-28T12:02:54.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.500+0000 7f42f6fb9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f006fd60 con 0x7f42f00734e0 2019-11-28T12:02:54.497 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.500+0000 7f42f6fb9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f0070030 con 0x7f42f006c0a0 2019-11-28T12:02:54.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.500+0000 7f42f4d55700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42f00734e0 0x7f42f0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:54.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.500+0000 7f42f4d55700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42f00734e0 0x7f42f0071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48850/0 (socket says 172.21.15.80:48850) 2019-11-28T12:02:54.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.500+0000 7f42f5d57700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f42f0072360 0x7f42f006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48164/0 (socket says 172.21.15.80:48164) 2019-11-28T12:02:54.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.500+0000 7f42f4d55700 1 -- 172.21.15.80:0/429858013 learned_addr learned my addr 172.21.15.80:0/429858013 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:54.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.500+0000 7f42f5556700 1 --2- 172.21.15.80:0/429858013 >> v2:172.21.15.174:3300/0 conn(0x7f42f006c0a0 0x7f42f0072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:54.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.501+0000 7f42f4d55700 1 -- 172.21.15.80:0/429858013 >> v2:172.21.15.174:3300/0 conn(0x7f42f006c0a0 msgr2=0x7f42f0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:54.498 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.501+0000 7f42f4d55700 1 --2- 172.21.15.80:0/429858013 >> v2:172.21.15.174:3300/0 conn(0x7f42f006c0a0 0x7f42f0072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:54.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.501+0000 7f42f4d55700 1 -- 172.21.15.80:0/429858013 >> v1:172.21.15.80:6789/0 conn(0x7f42f0072360 legacy=0x7f42f006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:54.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.501+0000 7f42f4d55700 1 -- 172.21.15.80:0/429858013 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f00706c0 con 0x7f42f00734e0 2019-11-28T12:02:54.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.501+0000 7f42effff700 1 -- 172.21.15.80:0/429858013 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392822715 0 0) 0x7f42e80009b0 con 0x7f42f0072360 2019-11-28T12:02:54.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.501+0000 7f42f4d55700 1 --2- 172.21.15.80:0/429858013 >> v2:172.21.15.80:3300/0 conn(0x7f42f00734e0 0x7f42f0071e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f42d800fa40 tx=0x7f42d800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.501+0000 7f42f4d55700 1 --2- 172.21.15.80:0/429858013 >> v2:172.21.15.80:3300/0 conn(0x7f42f00734e0 0x7f42f0071e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f42d800fa40 tx=0x7f42d800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.499 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.501+0000 7f42f4d55700 1 --2- 172.21.15.80:0/429858013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f00734e0 0x7f42f0071e20 secure :-1 s=READY pgs=3196 cs=0 l=1 rx=0x7f42d800fa40 tx=0x7f42d800fde0).ready entity=mon.0 client_cookie=d8a9e40f10d30811 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:54.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.501+0000 7f42f4d55700 1 --2- 172.21.15.80:0/429858013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f00734e0 0x7f42f0071e20 secure :-1 s=THROTTLE_DONE pgs=3196 cs=0 l=1 rx=0x7f42d800fa40 tx=0x7f42d800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.501+0000 7f42f4d55700 1 --2- 172.21.15.80:0/429858013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f00734e0 0x7f42f0071e20 secure :-1 s=THROTTLE_DONE pgs=3196 cs=0 l=1 rx=0x7f42d800fa40 tx=0x7f42d800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.501+0000 7f42effff700 1 -- 172.21.15.80:0/429858013 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42d8000ce0 con 0x7f42f00734e0 2019-11-28T12:02:54.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.501+0000 7f42f4d55700 1 --2- 172.21.15.80:0/429858013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f00734e0 0x7f42f0071e20 secure :-1 s=THROTTLE_DONE pgs=3196 cs=0 l=1 rx=0x7f42d800fa40 tx=0x7f42d800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.500 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.501+0000 7f42effff700 1 -- 172.21.15.80:0/429858013 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d8001010 con 0x7f42f00734e0 2019-11-28T12:02:54.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.501+0000 7f42effff700 1 -- 172.21.15.80:0/429858013 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42d8001720 con 0x7f42f00734e0 2019-11-28T12:02:54.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.501+0000 7f42f6fb9700 1 -- 172.21.15.80:0/429858013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f00734e0 msgr2=0x7f42f0071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:54.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.501+0000 7f42f6fb9700 1 --2- 172.21.15.80:0/429858013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f00734e0 0x7f42f0071e20 secure :-1 s=READY pgs=3196 cs=0 l=1 rx=0x7f42d800fa40 tx=0x7f42d800fde0).stop 2019-11-28T12:02:54.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.502+0000 7f42f6fb9700 1 -- 172.21.15.80:0/429858013 shutdown_connections 2019-11-28T12:02:54.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.502+0000 7f42f6fb9700 1 --2- 172.21.15.80:0/429858013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f00734e0 0x7f42f0071e20 unknown :-1 s=CLOSED pgs=3196 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:54.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.502+0000 7f42f6fb9700 1 --2- 172.21.15.80:0/429858013 >> v2:172.21.15.174:3300/0 conn(0x7f42f006c0a0 0x7f42f0072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:54.501 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.502+0000 7f42f6fb9700 1 -- 172.21.15.80:0/429858013 shutdown_connections 2019-11-28T12:02:54.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.502+0000 7f42f6fb9700 1 -- 172.21.15.80:0/429858013 wait complete. 2019-11-28T12:02:54.502 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.502+0000 7f42f6fb9700 1 -- 172.21.15.80:0/429858013 >> 172.21.15.80:0/429858013 conn(0x7f42f0061cf0 msgr2=0x7f42f0064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:54.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.504+0000 7f42f6fb9700 1 Processor -- start 2019-11-28T12:02:54.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.504+0000 7f42f6fb9700 1 -- start start 2019-11-28T12:02:54.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.505+0000 7f42f6fb9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42f013e7b0 0x7f42f012abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:54.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.505+0000 7f42f6fb9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f0139e00 con 0x7f42f013e320 2019-11-28T12:02:54.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.505+0000 7f42f6fb9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f013b4e0 con 0x7f42f015fdf0 2019-11-28T12:02:54.503 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.505+0000 7f42f6fb9700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f0108820 con 0x7f42f013e7b0 2019-11-28T12:02:54.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.505+0000 7f42f5d57700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42f013e7b0 0x7f42f012abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:54.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.505+0000 7f42f5d57700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f42f013e7b0 0x7f42f012abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48856/0 (socket says 172.21.15.80:48856) 2019-11-28T12:02:54.506 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.505+0000 7f42f5d57700 1 -- 172.21.15.80:0/3010037941 learned_addr learned my addr 172.21.15.80:0/3010037941 (peer_addr_for_me v2:172.21.15.80:0/0) 2019-11-28T12:02:54.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.505+0000 7f42f4d55700 1 --1- 172.21.15.80:0/3010037941 >> v1:172.21.15.80:6789/0 conn(0x7f42f013e320 0x7f42f012a3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48170/0 (socket says 172.21.15.80:48170) 2019-11-28T12:02:54.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.506+0000 7f42edffb700 1 -- 172.21.15.80:0/3010037941 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105460350 0 0) 0x7f42e0000ef0 con 0x7f42f015fdf0 2019-11-28T12:02:54.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.506+0000 7f42f5d57700 1 -- 172.21.15.80:0/3010037941 >> v1:172.21.15.174:6789/0 conn(0x7f42f015fdf0 legacy=0x7f42f012b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:54.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.506+0000 7f42f5d57700 1 -- 172.21.15.80:0/3010037941 >> v1:172.21.15.80:6789/0 conn(0x7f42f013e320 legacy=0x7f42f012a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:54.507 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.506+0000 7f42f5d57700 1 -- 172.21.15.80:0/3010037941 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f010a8c0 con 0x7f42f013e7b0 2019-11-28T12:02:54.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.506+0000 7f42f5d57700 1 --2- 172.21.15.80:0/3010037941 >> v2:172.21.15.80:3300/0 conn(0x7f42f013e7b0 0x7f42f012abc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42e80103e0 tx=0x7f42e8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.506+0000 7f42f5d57700 1 --2- 172.21.15.80:0/3010037941 >> v2:172.21.15.80:3300/0 conn(0x7f42f013e7b0 0x7f42f012abc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42e80103e0 tx=0x7f42e8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.506+0000 7f42f5d57700 1 --2- 172.21.15.80:0/3010037941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f013e7b0 0x7f42f012abc0 secure :-1 s=READY pgs=3198 cs=0 l=1 rx=0x7f42e80103e0 tx=0x7f42e8010780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:54.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.506+0000 7f42f5d57700 1 --2- 172.21.15.80:0/3010037941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f013e7b0 0x7f42f012abc0 secure :-1 s=THROTTLE_DONE pgs=3198 cs=0 l=1 rx=0x7f42e80103e0 tx=0x7f42e8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.506+0000 7f42f5d57700 1 --2- 172.21.15.80:0/3010037941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f013e7b0 0x7f42f012abc0 secure :-1 s=THROTTLE_DONE pgs=3198 cs=0 l=1 rx=0x7f42e80103e0 tx=0x7f42e8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.508 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.506+0000 7f42f5d57700 1 --2- 172.21.15.80:0/3010037941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f013e7b0 0x7f42f012abc0 secure :-1 s=THROTTLE_DONE pgs=3198 cs=0 l=1 rx=0x7f42e80103e0 tx=0x7f42e8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.506+0000 7f42edffb700 1 -- 172.21.15.80:0/3010037941 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42e8000940 con 0x7f42f013e7b0 2019-11-28T12:02:54.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.506+0000 7f42edffb700 1 -- 172.21.15.80:0/3010037941 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e8001100 con 0x7f42f013e7b0 2019-11-28T12:02:54.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.506+0000 7f42f6fb9700 1 -- 172.21.15.80:0/3010037941 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f010a8c0 con 0x7f42f013e7b0 2019-11-28T12:02:54.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.506+0000 7f42edffb700 1 -- 172.21.15.80:0/3010037941 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42e8001790 con 0x7f42f013e7b0 2019-11-28T12:02:54.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.506+0000 7f42f6fb9700 1 -- 172.21.15.80:0/3010037941 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f010a8c0 con 0x7f42f013e7b0 2019-11-28T12:02:54.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.506+0000 7f42f5d57700 1 --2- 172.21.15.80:0/3010037941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f013e7b0 0x7f42f012abc0 secure :-1 s=THROTTLE_DONE pgs=3198 cs=0 l=1 rx=0x7f42e80103e0 tx=0x7f42e8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.509 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.507+0000 7f42edffb700 1 -- 172.21.15.80:0/3010037941 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f42e8000940 con 0x7f42f013e7b0 2019-11-28T12:02:54.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.507+0000 7f42f5d57700 1 --2- 172.21.15.80:0/3010037941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f013e7b0 0x7f42f012abc0 secure :-1 s=THROTTLE_DONE pgs=3198 cs=0 l=1 rx=0x7f42e80103e0 tx=0x7f42e8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.507+0000 7f42edffb700 1 --2- 172.21.15.80:0/3010037941 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42d4018730 0x7f42d401abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:54.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.507+0000 7f42edffb700 1 -- 172.21.15.80:0/3010037941 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f42e8031d20 con 0x7f42f013e7b0 2019-11-28T12:02:54.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.507+0000 7f42f5556700 1 --2- 172.21.15.80:0/3010037941 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42d4018730 0x7f42d401abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:54.510 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.507+0000 7f42f5556700 1 --2- 172.21.15.80:0/3010037941 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42d4018730 0x7f42d401abc0 crc :-1 s=READY pgs=1325 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:54.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.514+0000 7f42f6fb9700 1 -- 172.21.15.80:0/3010037941 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f0109180 con 0x7f42f013e7b0 2019-11-28T12:02:54.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.518+0000 7f42f5d57700 1 --2- 172.21.15.80:0/3010037941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f013e7b0 0x7f42f012abc0 secure :-1 s=THROTTLE_DONE pgs=3198 cs=0 l=1 rx=0x7f42e80103e0 tx=0x7f42e8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.511 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.518+0000 7f42edffb700 1 -- 172.21.15.80:0/3010037941 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f42e8017450 con 0x7f42f013e7b0 2019-11-28T12:02:54.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.691+0000 7f42f6fb9700 1 -- 172.21.15.80:0/3010037941 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42f0109500 con 0x7f42f013e7b0 2019-11-28T12:02:54.684 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.692+0000 7f42f5d57700 1 --2- 172.21.15.80:0/3010037941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f013e7b0 0x7f42f012abc0 secure :-1 s=THROTTLE_DONE pgs=3198 cs=0 l=1 rx=0x7f42e80103e0 tx=0x7f42e8010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:54.685 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.692+0000 7f42edffb700 1 -- 172.21.15.80:0/3010037941 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 210 v210) v1 ==== 95+0+2454 (secure 0 0 0) 0x7f42e8001900 con 0x7f42f013e7b0 2019-11-28T12:02:54.685 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 210 2019-11-28T12:02:54.686 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:54.686 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":210,"default_fscid":20,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":12424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2746945578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2746945578},{"type":"v1","addr":"172.21.15.174:6835","nonce":2746945578}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":210},{"gid":13251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/914520193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":914520193},{"type":"v1","addr":"172.21.15.80:6834","nonce":914520193}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":210}],"filesystems":[{"mdsmap":{"epoch":209,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:02:44.233571+0000","modified":"2019-11-28T12:02:48.857049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8537":{"gid":8537,"name":"b","rank":0,"incarnation":208,"state":"up:active","state_seq":2,"addr":"172.21.15.80:6835/1900497412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1900497412},{"type":"v1","addr":"172.21.15.80:6835","nonce":1900497412}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[41],"metadata_pool":40,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":20}]} 2019-11-28T12:02:54.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.694+0000 7f42f6fb9700 1 -- 172.21.15.80:0/3010037941 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42d4018730 msgr2=0x7f42d401abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:54.687 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.694+0000 7f42f6fb9700 1 --2- 172.21.15.80:0/3010037941 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42d4018730 0x7f42d401abc0 crc :-1 s=READY pgs=1325 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:54.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.694+0000 7f42f6fb9700 1 -- 172.21.15.80:0/3010037941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f013e7b0 msgr2=0x7f42f012abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:54.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.694+0000 7f42f6fb9700 1 --2- 172.21.15.80:0/3010037941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f013e7b0 0x7f42f012abc0 secure :-1 s=READY pgs=3198 cs=0 l=1 rx=0x7f42e80103e0 tx=0x7f42e8010780).stop 2019-11-28T12:02:54.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.694+0000 7f42f6fb9700 1 -- 172.21.15.80:0/3010037941 shutdown_connections 2019-11-28T12:02:54.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.694+0000 7f42f6fb9700 1 --2- 172.21.15.80:0/3010037941 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42f013e7b0 0x7f42f012abc0 unknown :-1 s=CLOSED pgs=3198 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:54.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.694+0000 7f42f6fb9700 1 --2- 172.21.15.80:0/3010037941 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f42d4018730 0x7f42d401abc0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:54.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.694+0000 7f42f6fb9700 1 -- 172.21.15.80:0/3010037941 shutdown_connections 2019-11-28T12:02:54.688 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.694+0000 7f42f6fb9700 1 -- 172.21.15.80:0/3010037941 wait complete. 2019-11-28T12:02:54.689 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:54.694+0000 7f42f6fb9700 1 -- 172.21.15.80:0/3010037941 >> 172.21.15.80:0/3010037941 conn(0x7f42f0127dc0 msgr2=0x7f42f0141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:54.999 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8537}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 40, u'failed': [], u'epoch': 209, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [41], u'info': {u'gid_8537': {u'export_targets': [], u'name': u'b', u'incarnation': 208, u'state_seq': 2, u'state': u'up:active', u'gid': 8537, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1900497412, u'type': u'v2', u'addr': u'172.21.15.80:6833'}, {u'nonce': 1900497412, u'type': u'v1', u'addr': u'172.21.15.80:6835'}]}, u'addr': u'172.21.15.80:6835/1900497412'}}, u'fs_name': u'cephfs', u'created': u'2019-11-28T12:02:44.233571+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-11-28T12:02:48.857049+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-11-28T12:02:54.999 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-11-28T12:02:55.000 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-11-28T12:02:55.054 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:02:55.059 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:02:55.063 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:02:55.068 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:02:55.071 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:02:55.076 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:02:55.128 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2019-11-28T12:02:55.128 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", 2019-11-28T12:02:55.128 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2019-11-28T12:02:55.128 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 8537, 2019-11-28T12:02:55.128 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2019-11-28T12:02:55.129 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2019-11-28T12:02:55.129 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 7.2785992100000003, 2019-11-28T12:02:55.129 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 209, 2019-11-28T12:02:55.129 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 247, 2019-11-28T12:02:55.129 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 247, 2019-11-28T12:02:55.130 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 8.1065011929999997 2019-11-28T12:02:55.130 INFO:teuthology.orchestra.run.smithi080.stdout:} 2019-11-28T12:02:55.134 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "4d210428-f562-4c8d-978b-869be7a63ed0", "whoami": 0, "id": 8537, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.2785992100000003, "mdsmap_epoch": 209, "osdmap_epoch": 247, "osdmap_epoch_barrier": 247, "uptime": 8.1065011929999997 } 2019-11-28T12:02:55.134 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2019-11-28T12:02:55.135 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-11-28T12:02:55.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T12:02:55.135 INFO:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-11-28T12:02:55.213 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-11-28T12:02:55.214 INFO:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T12:02:55.350 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T12:02:55.350 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T12:02:55.350 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2019-11-28T12:02:55.351 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2019-11-28T12:02:55.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T12:02:55.351 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-11-28T12:02:55.430 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get mds_reconnect_timeout 2019-11-28T12:02:55.552 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T12:02:55.553 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_reconnect_timeout": "45.000000" 2019-11-28T12:02:55.553 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T12:02:55.559 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2019-11-28T12:02:55.560 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok config get ms_max_backoff 2019-11-28T12:02:55.683 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2019-11-28T12:02:55.684 INFO:teuthology.orchestra.run.smithi174.stdout: "ms_max_backoff": "15.000000" 2019-11-28T12:02:55.684 INFO:teuthology.orchestra.run.smithi174.stdout:} 2019-11-28T12:02:55.688 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2019-11-28T12:02:55.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T12:02:55.689 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T12:02:55.689 INFO:teuthology.orchestra.run.smithi076:> import glob 2019-11-28T12:02:55.690 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T12:02:55.690 INFO:teuthology.orchestra.run.smithi076:> import json 2019-11-28T12:02:55.690 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T12:02:55.690 INFO:teuthology.orchestra.run.smithi076:> def get_id_to_dir(): 2019-11-28T12:02:55.690 INFO:teuthology.orchestra.run.smithi076:> result = {} 2019-11-28T12:02:55.690 INFO:teuthology.orchestra.run.smithi076:> for dir in glob.glob("/sys/kernel/debug/ceph/*"): 2019-11-28T12:02:55.690 INFO:teuthology.orchestra.run.smithi076:> mds_sessions_lines = open(os.path.join(dir, "mds_sessions")).readlines() 2019-11-28T12:02:55.691 INFO:teuthology.orchestra.run.smithi076:> client_id = mds_sessions_lines[1].split()[1].strip('"'"'"'"'"') 2019-11-28T12:02:55.691 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T12:02:55.691 INFO:teuthology.orchestra.run.smithi076:> result[client_id] = dir 2019-11-28T12:02:55.691 INFO:teuthology.orchestra.run.smithi076:> return result 2019-11-28T12:02:55.691 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T12:02:55.691 INFO:teuthology.orchestra.run.smithi076:> print(json.dumps(get_id_to_dir())) 2019-11-28T12:02:55.691 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T12:02:55.762 INFO:teuthology.orchestra.run.smithi076.stdout:{"0": "/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client12514"} 2019-11-28T12:02:55.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-11-28T12:02:55.763 INFO:teuthology.orchestra.run.smithi076:> sudo python -c ' 2019-11-28T12:02:55.764 INFO:teuthology.orchestra.run.smithi076:> import os 2019-11-28T12:02:55.764 INFO:teuthology.orchestra.run.smithi076:> 2019-11-28T12:02:55.764 INFO:teuthology.orchestra.run.smithi076:> print(open(os.path.join("/sys/kernel/debug/ceph/4d210428-f562-4c8d-978b-869be7a63ed0.client12514", "mds_sessions")).read()) 2019-11-28T12:02:55.764 INFO:teuthology.orchestra.run.smithi076:> ' 2019-11-28T12:02:55.836 INFO:teuthology.orchestra.run.smithi076.stdout:global_id 12514 2019-11-28T12:02:55.836 INFO:teuthology.orchestra.run.smithi076.stdout:name "0" 2019-11-28T12:02:55.836 INFO:teuthology.orchestra.run.smithi076.stdout:mds.0 open 2019-11-28T12:02:55.836 INFO:teuthology.orchestra.run.smithi076.stdout: 2019-11-28T12:02:55.837 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-11-28T12:02:55.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.964+0000 7f26e3d16700 1 Processor -- start 2019-11-28T12:02:55.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.964+0000 7f26e3d16700 1 -- start start 2019-11-28T12:02:55.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.965+0000 7f26e3d16700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f26dc06c0a0 0x7f26dc072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:55.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.965+0000 7f26e3d16700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f26dc072620 0x7f26dc164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T12:02:55.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.965+0000 7f26e3d16700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26dc06db00 con 0x7f26dc0734e0 2019-11-28T12:02:55.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.965+0000 7f26e3d16700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26dc06fd60 con 0x7f26dc06c0a0 2019-11-28T12:02:55.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.965+0000 7f26e3d16700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26dc070030 con 0x7f26dc072620 2019-11-28T12:02:55.963 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.965+0000 7f26e22b3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f26dc06c0a0 0x7f26dc072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:55.964 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.965+0000 7f26e1ab2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f26dc0734e0 0x7f26dc071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48180/0 (socket says 172.21.15.80:48180) 2019-11-28T12:02:55.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.965+0000 7f26e1ab2700 1 -- 172.21.15.80:0/1972891173 learned_addr learned my addr 172.21.15.80:0/1972891173 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:55.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e2ab4700 1 --2- 172.21.15.80:0/1972891173 >> v2:172.21.15.174:3300/0 conn(0x7f26dc072620 0x7f26dc164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:55.965 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e22b3700 1 -- 172.21.15.80:0/1972891173 >> v2:172.21.15.174:3300/0 conn(0x7f26dc072620 msgr2=0x7f26dc164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-11-28T12:02:55.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e22b3700 1 --2- 172.21.15.80:0/1972891173 >> v2:172.21.15.174:3300/0 conn(0x7f26dc072620 0x7f26dc164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:55.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e22b3700 1 -- 172.21.15.80:0/1972891173 >> v1:172.21.15.80:6789/0 conn(0x7f26dc0734e0 legacy=0x7f26dc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:55.966 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e12b1700 1 -- 172.21.15.80:0/1972891173 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846441039 0 0) 0x7f26d0001070 con 0x7f26dc0734e0 2019-11-28T12:02:55.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e22b3700 1 -- 172.21.15.80:0/1972891173 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc0706c0 con 0x7f26dc06c0a0 2019-11-28T12:02:55.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e2ab4700 1 --2- 172.21.15.80:0/1972891173 >> v2:172.21.15.174:3300/0 conn(0x7f26dc072620 0x7f26dc164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-11-28T12:02:55.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e22b3700 1 --2- 172.21.15.80:0/1972891173 >> v2:172.21.15.80:3300/0 conn(0x7f26dc06c0a0 0x7f26dc072fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f26cc00af50 tx=0x7f26cc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:55.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e22b3700 1 --2- 172.21.15.80:0/1972891173 >> v2:172.21.15.80:3300/0 conn(0x7f26dc06c0a0 0x7f26dc072fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f26cc00af50 tx=0x7f26cc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:55.967 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e22b3700 1 --2- 172.21.15.80:0/1972891173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26dc06c0a0 0x7f26dc072fa0 secure :-1 s=READY pgs=3200 cs=0 l=1 rx=0x7f26cc00af50 tx=0x7f26cc00b760).ready entity=mon.0 client_cookie=d5263c232dd6f7e4 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:55.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e22b3700 1 --2- 172.21.15.80:0/1972891173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26dc06c0a0 0x7f26dc072fa0 secure :-1 s=THROTTLE_DONE pgs=3200 cs=0 l=1 rx=0x7f26cc00af50 tx=0x7f26cc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:55.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e12b1700 1 -- 172.21.15.80:0/1972891173 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26cc007210 con 0x7f26dc06c0a0 2019-11-28T12:02:55.968 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e22b3700 1 --2- 172.21.15.80:0/1972891173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26dc06c0a0 0x7f26dc072fa0 secure :-1 s=THROTTLE_DONE pgs=3200 cs=0 l=1 rx=0x7f26cc00af50 tx=0x7f26cc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:55.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e22b3700 1 --2- 172.21.15.80:0/1972891173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26dc06c0a0 0x7f26dc072fa0 secure :-1 s=THROTTLE_DONE pgs=3200 cs=0 l=1 rx=0x7f26cc00af50 tx=0x7f26cc00b760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:55.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e12b1700 1 -- 172.21.15.80:0/1972891173 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc0099b0 con 0x7f26dc06c0a0 2019-11-28T12:02:55.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e12b1700 1 -- 172.21.15.80:0/1972891173 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26cc009ba0 con 0x7f26dc06c0a0 2019-11-28T12:02:55.969 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e3d16700 1 -- 172.21.15.80:0/1972891173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26dc06c0a0 msgr2=0x7f26dc072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:55.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.966+0000 7f26e3d16700 1 --2- 172.21.15.80:0/1972891173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26dc06c0a0 0x7f26dc072fa0 secure :-1 s=READY pgs=3200 cs=0 l=1 rx=0x7f26cc00af50 tx=0x7f26cc00b760).stop 2019-11-28T12:02:55.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.967+0000 7f26e3d16700 1 -- 172.21.15.80:0/1972891173 shutdown_connections 2019-11-28T12:02:55.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.967+0000 7f26e3d16700 1 --2- 172.21.15.80:0/1972891173 >> v2:172.21.15.174:3300/0 conn(0x7f26dc072620 0x7f26dc164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T12:02:55.970 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.967+0000 7f26e3d16700 1 --2- 172.21.15.80:0/1972891173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26dc06c0a0 0x7f26dc072fa0 unknown :-1 s=CLOSED pgs=3200 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:55.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.967+0000 7f26e3d16700 1 -- 172.21.15.80:0/1972891173 shutdown_connections 2019-11-28T12:02:55.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.967+0000 7f26e3d16700 1 -- 172.21.15.80:0/1972891173 wait complete. 2019-11-28T12:02:55.971 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.967+0000 7f26e3d16700 1 -- 172.21.15.80:0/1972891173 >> 172.21.15.80:0/1972891173 conn(0x7f26dc061cf0 msgr2=0x7f26dc064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:55.978 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.969+0000 7f26e3d16700 1 Processor -- start 2019-11-28T12:02:55.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.969+0000 7f26e3d16700 1 -- start start 2019-11-28T12:02:55.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.970+0000 7f26e3d16700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f26dc13e5f0 0x7f26dc13e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:55.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.970+0000 7f26e3d16700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f26dc10a070 0x7f26dc10bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:55.979 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.970+0000 7f26e3d16700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26dc1066e0 con 0x7f26dc10a4e0 2019-11-28T12:02:55.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.970+0000 7f26e3d16700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26dc10e060 con 0x7f26dc13e5f0 2019-11-28T12:02:55.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.970+0000 7f26e3d16700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc10e330 con 0x7f26dc10a070 2019-11-28T12:02:55.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.970+0000 7f26e2ab4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f26dc10a4e0 0x7f26dc10c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48182/0 (socket says 172.21.15.80:48182) 2019-11-28T12:02:55.980 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.970+0000 7f26e2ab4700 1 -- 172.21.15.80:0/351298415 learned_addr learned my addr 172.21.15.80:0/351298415 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T12:02:55.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.970+0000 7f26e22b3700 1 --2- 172.21.15.80:0/351298415 >> v2:172.21.15.174:3300/0 conn(0x7f26dc13e5f0 0x7f26dc13e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:55.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.970+0000 7f26e1ab2700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f26dc10a070 0x7f26dc10bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:55.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26daffd700 1 -- 172.21.15.80:0/351298415 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842752733 0 0) 0x7f26d4009e90 con 0x7f26dc10a4e0 2019-11-28T12:02:55.981 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26daffd700 1 -- 172.21.15.80:0/351298415 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26bc002e80 con 0x7f26dc10a4e0 2019-11-28T12:02:55.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26e22b3700 1 -- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f26dc10a070 msgr2=0x7f26dc10bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:55.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26e22b3700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f26dc10a070 0x7f26dc10bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:55.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26e22b3700 1 -- 172.21.15.80:0/351298415 >> v1:172.21.15.80:6789/0 conn(0x7f26dc10a4e0 legacy=0x7f26dc10c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:55.982 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26e22b3700 1 -- 172.21.15.80:0/351298415 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc10e9c0 con 0x7f26dc13e5f0 2019-11-28T12:02:55.983 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26e22b3700 1 --2- 172.21.15.80:0/351298415 >> v2:172.21.15.174:3300/0 conn(0x7f26dc13e5f0 0x7f26dc13e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26cc0103b0 tx=0x7f26cc0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:55.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26e22b3700 1 --2- 172.21.15.80:0/351298415 >> v2:172.21.15.174:3300/0 conn(0x7f26dc13e5f0 0x7f26dc13e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26cc0103b0 tx=0x7f26cc0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:55.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26e22b3700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26dc13e5f0 0x7f26dc13e9e0 secure :-1 s=READY pgs=1941 cs=0 l=1 rx=0x7f26cc0103b0 tx=0x7f26cc0101b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:55.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26e22b3700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26dc13e5f0 0x7f26dc13e9e0 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7f26cc0103b0 tx=0x7f26cc0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:55.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26daffd700 1 -- 172.21.15.80:0/351298415 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26cc000940 con 0x7f26dc13e5f0 2019-11-28T12:02:55.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26e22b3700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26dc13e5f0 0x7f26dc13e9e0 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7f26cc0103b0 tx=0x7f26cc0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:55.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26daffd700 1 -- 172.21.15.80:0/351298415 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc009770 con 0x7f26dc13e5f0 2019-11-28T12:02:55.984 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26e22b3700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26dc13e5f0 0x7f26dc13e9e0 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7f26cc0103b0 tx=0x7f26cc0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:55.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26e3d16700 1 -- 172.21.15.80:0/351298415 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26dc10ed40 con 0x7f26dc13e5f0 2019-11-28T12:02:55.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26daffd700 1 -- 172.21.15.80:0/351298415 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26cc000940 con 0x7f26dc13e5f0 2019-11-28T12:02:55.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.971+0000 7f26e3d16700 1 -- 172.21.15.80:0/351298415 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26dc10e9c0 con 0x7f26dc13e5f0 2019-11-28T12:02:55.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.972+0000 7f26e22b3700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26dc13e5f0 0x7f26dc13e9e0 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7f26cc0103b0 tx=0x7f26cc0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:55.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.972+0000 7f26daffd700 1 -- 172.21.15.80:0/351298415 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 33895+0+0 (secure 0 0 0) 0x7f26cc009960 con 0x7f26dc13e5f0 2019-11-28T12:02:55.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.972+0000 7f26e22b3700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26dc13e5f0 0x7f26dc13e9e0 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7f26cc0103b0 tx=0x7f26cc0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:55.985 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.972+0000 7f26daffd700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f26bc018770 0x7f26bc01abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T12:02:55.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.972+0000 7f26daffd700 1 -- 172.21.15.80:0/351298415 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f26cc031a90 con 0x7f26dc13e5f0 2019-11-28T12:02:55.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.972+0000 7f26e1ab2700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f26bc018770 0x7f26bc01abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T12:02:55.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.972+0000 7f26e1ab2700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f26bc018770 0x7f26bc01abe0 crc :-1 s=READY pgs=1326 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-11-28T12:02:55.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.979+0000 7f26e3d16700 1 -- 172.21.15.80:0/351298415 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26dc10ed40 con 0x7f26dc13e5f0 2019-11-28T12:02:55.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.983+0000 7f26e22b3700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26dc13e5f0 0x7f26dc13e9e0 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7f26cc0103b0 tx=0x7f26cc0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:55.986 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:55.983+0000 7f26daffd700 1 -- 172.21.15.80:0/351298415 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111439 (secure 0 0 0) 0x7f26cc000940 con 0x7f26dc13e5f0 2019-11-28T12:02:56.153 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:56.155+0000 7f26e3d16700 1 -- 172.21.15.80:0/351298415 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26dc10e9c0 con 0x7f26dc13e5f0 2019-11-28T12:02:56.155 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:56.155+0000 7f26e22b3700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26dc13e5f0 0x7f26dc13e9e0 secure :-1 s=THROTTLE_DONE pgs=1941 cs=0 l=1 rx=0x7f26cc0103b0 tx=0x7f26cc0101b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T12:02:56.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:56.156+0000 7f26daffd700 1 -- 172.21.15.80:0/351298415 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 210 v210) v1 ==== 95+0+2454 (secure 0 0 0) 0x7f26cc009960 con 0x7f26dc13e5f0 2019-11-28T12:02:56.156 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 210 2019-11-28T12:02:56.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:56.158+0000 7f26e3d16700 1 -- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f26bc018770 msgr2=0x7f26bc01abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:56.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:56.158+0000 7f26e3d16700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f26bc018770 0x7f26bc01abe0 crc :-1 s=READY pgs=1326 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:56.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:56.158+0000 7f26e3d16700 1 -- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26dc13e5f0 msgr2=0x7f26dc13e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T12:02:56.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:56.158+0000 7f26e3d16700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26dc13e5f0 0x7f26dc13e9e0 secure :-1 s=READY pgs=1941 cs=0 l=1 rx=0x7f26cc0103b0 tx=0x7f26cc0101b0).stop 2019-11-28T12:02:56.156 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:56.158+0000 7f26e3d16700 1 -- 172.21.15.80:0/351298415 shutdown_connections 2019-11-28T12:02:56.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:56.158+0000 7f26e3d16700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:6800/36016,v1:172.21.15.174:6801/36016] conn(0x7f26bc018770 0x7f26bc01abe0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:56.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:56.158+0000 7f26e3d16700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f26dc10a070 0x7f26dc10bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:56.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:56.158+0000 7f26e3d16700 1 --2- 172.21.15.80:0/351298415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26dc13e5f0 0x7f26dc13e9e0 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rx=0 tx=0).stop 2019-11-28T12:02:56.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:56.158+0000 7f26e3d16700 1 -- 172.21.15.80:0/351298415 shutdown_connections 2019-11-28T12:02:56.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:56.158+0000 7f26e3d16700 1 -- 172.21.15.80:0/351298415 wait complete. 2019-11-28T12:02:56.157 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T12:02:56.158+0000 7f26e3d16700 1 -- 172.21.15.80:0/351298415 >> 172.21.15.80:0/351298415 conn(0x7f26dc13d620 msgr2=0x7f26dc13da10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T12:02:56.158 INFO:teuthology.orchestra.run.smithi080.stdout: 2019-11-28T12:02:56.158 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":210,"default_fscid":20,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":12424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6835/2746945578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2746945578},{"type":"v1","addr":"172.21.15.174:6835","nonce":2746945578}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":210},{"gid":13251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.80:6834/914520193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":914520193},{"type":"v1","addr":"172.21.15.80:6834","nonce":914520193}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":210}],"filesystems":[{"mdsmap":{"epoch":209,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-11-28T12:02:44.233571+0000","modified":"2019-11-28T12:02:48.857049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8537":{"gid":8537,"name":"b","rank":0,"incarnation":208,"state":"up:active","state_seq":2,"addr":"172.21.15.80:6835/1900497412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6833","nonce":1900497412},{"type":"v1","addr":"172.21.15.80:6835","nonce":1900497412}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[41],"metadata_pool":40,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":20}]} 2019-11-28T12:02:56.161 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok session evict 12514 2019-11-28T12:02:56.314 INFO:tasks.cephfs.filesystem:_json_asok output: 2019-11-28T12:02:56.315 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2019-11-28T12:02:56.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T12:02:56.315 INFO:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2019-11-28T12:03:25.189 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:03:25.194 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:03:25.198 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:03:25.202 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:03:25.206 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:03:25.210 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:03:55.550 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:03:55.558 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:03:55.566 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:03:55.570 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:03:55.574 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:03:55.578 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:04:25.674 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:04:25.678 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:04:25.683 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:04:25.687 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:04:25.692 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:04:25.696 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:04:55.832 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:04:55.837 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:04:55.842 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:04:55.846 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:04:55.851 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:04:55.855 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:05:25.960 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:05:25.965 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:05:25.969 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:05:25.973 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:05:25.977 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:05:25.982 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:05:56.128 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:05:56.132 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:05:56.136 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:05:56.140 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:05:56.144 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:05:56.149 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:06:26.296 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:06:26.301 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:06:26.304 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:06:26.309 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:06:26.313 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:06:26.318 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:06:56.474 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:06:56.486 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:06:56.490 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:06:56.494 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:06:56.500 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:06:56.504 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:07:26.643 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:07:26.648 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:07:26.652 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:07:26.657 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:07:26.661 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:07:26.666 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:07:56.823 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:07:56.828 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:07:56.832 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:07:56.836 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:07:56.841 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:07:56.846 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:08:26.986 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:08:26.991 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:08:26.996 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:08:27.000 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:08:27.008 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:08:27.013 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:08:57.206 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:08:57.211 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:08:57.215 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:08:57.220 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:08:57.224 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:08:57.228 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:09:27.400 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:09:27.413 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:09:27.419 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:09:27.424 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:09:27.429 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:09:27.434 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:09:57.588 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:09:57.592 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:09:57.597 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:09:57.602 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:09:57.606 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:09:57.610 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:10:27.774 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:10:27.780 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:10:27.786 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:10:27.791 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:10:27.797 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:10:27.801 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:10:57.981 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:10:57.986 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:10:57.990 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:10:57.996 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:10:58.000 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:10:58.005 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:11:28.151 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:11:28.156 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:11:28.160 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:11:28.164 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:11:28.170 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:11:28.178 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:11:58.329 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:11:58.334 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:11:58.338 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:11:58.343 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:11:58.348 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:11:58.353 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:12:28.490 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:12:28.495 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:12:28.499 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:12:28.503 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:12:28.506 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:12:28.510 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:12:58.652 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:12:58.657 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:12:58.661 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:12:58.666 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:12:58.670 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:12:58.675 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:13:28.805 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:13:28.809 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:13:28.816 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:13:28.819 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:13:28.823 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:13:28.827 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:13:59.010 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:13:59.014 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:13:59.018 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:13:59.023 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:13:59.027 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:13:59.033 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:14:29.163 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:14:29.168 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:14:29.173 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:14:29.177 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:14:29.181 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:14:29.186 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:14:59.450 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:14:59.455 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:14:59.462 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:14:59.481 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:14:59.490 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:14:59.495 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:15:29.802 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:15:29.813 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:15:29.819 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:15:29.823 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:15:29.827 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:15:29.831 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:15:59.974 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:15:59.981 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:15:59.986 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:15:59.990 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:15:59.994 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:15:59.998 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:16:30.181 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:16:30.195 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:16:30.206 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:16:30.211 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:16:30.221 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:16:30.225 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:17:00.383 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:17:00.388 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:17:00.394 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:17:00.399 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:17:00.403 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:17:00.411 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:17:30.547 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:17:30.556 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:17:30.561 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:17:30.567 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:17:30.572 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:17:30.578 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:17:56.326 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/gevent/greenlet.py", line 536, in run result = self._run(*self.args, **self.kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 303, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 272, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 108, in next line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 1355, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() timeout 2019-11-28T12:17:56.348 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/gevent/greenlet.py", line 536, in run result = self._run(*self.args, **self.kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 303, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 272, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 108, in next line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 1343, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() timeout 2019-11-28T12:18:00.758 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:18:00.762 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:18:00.766 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:18:00.770 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:18:00.778 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:18:00.782 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:18:30.925 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:18:30.930 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:18:30.935 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:18:30.941 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:18:30.946 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:18:30.952 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:19:01.141 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:19:01.146 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:19:01.151 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:19:01.157 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:19:01.161 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:19:01.173 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:19:31.327 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:19:31.336 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:19:31.346 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:19:31.350 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:19:31.353 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:19:31.358 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:20:01.516 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:20:01.523 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:20:01.527 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:20:01.534 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:20:01.538 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:20:01.544 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:20:31.640 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:20:31.654 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:20:31.658 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:20:31.662 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:20:31.666 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:20:31.671 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:21:01.823 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:21:01.828 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:21:01.834 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:21:01.839 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:21:01.843 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:21:01.847 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:21:31.989 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:21:31.994 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:21:31.999 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:21:32.003 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:21:32.007 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:21:32.012 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:22:02.164 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:22:02.169 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:22:02.173 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:22:02.179 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:22:02.183 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:22:02.191 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:22:32.340 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:22:32.345 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:22:32.350 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:22:32.355 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:22:32.360 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:22:32.367 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:23:02.675 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:23:02.680 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:23:02.684 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:23:02.688 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:23:02.693 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:23:02.697 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:23:32.859 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:23:32.865 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:23:32.869 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:23:32.873 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:23:32.877 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:23:32.881 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:24:03.062 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:24:03.072 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:24:03.077 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:24:03.082 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:24:03.086 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:24:03.091 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:24:33.234 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:24:33.239 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:24:33.243 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:24:33.250 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:24:33.256 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:24:33.261 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:25:03.403 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:25:03.407 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:25:03.411 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:25:03.417 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:25:03.421 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:25:03.425 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:25:33.622 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:25:33.632 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:25:33.636 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:25:33.640 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:25:33.644 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:25:33.649 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:26:03.802 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:26:03.807 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:26:03.812 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:26:03.818 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:26:03.822 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:26:03.826 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:26:34.030 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:26:34.035 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:26:34.048 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:26:34.059 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:26:34.064 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:26:34.068 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:27:04.220 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:27:04.249 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:27:04.259 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:27:04.265 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:27:04.274 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:27:04.280 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:27:34.426 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:27:34.431 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:27:34.436 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:27:34.441 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:27:34.445 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:27:34.449 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:28:04.692 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:28:04.697 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:28:04.703 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:28:04.707 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:28:04.711 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:28:04.715 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:28:34.898 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:28:34.903 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:28:34.907 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:28:34.917 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:28:34.924 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:28:34.928 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:29:05.082 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:29:05.087 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:29:05.091 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:29:05.095 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:29:05.099 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:29:05.103 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:29:35.278 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:29:35.284 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:29:35.287 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:29:35.292 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:29:35.297 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:29:35.301 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:30:05.536 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:30:05.542 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:30:05.548 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:30:05.554 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:30:05.559 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:30:05.563 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:30:35.735 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:30:35.739 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:30:35.744 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:30:35.747 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:30:35.752 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:30:35.756 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:31:05.865 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:31:05.869 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:31:05.874 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:31:05.878 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:31:05.881 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:31:05.886 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:31:36.094 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:31:36.099 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:31:36.107 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:31:36.112 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:31:36.124 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:31:36.136 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:32:06.299 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:32:06.304 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:32:06.308 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:32:06.311 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:32:06.315 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:32:06.320 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:32:36.499 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:32:36.504 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:32:36.509 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:32:36.513 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:32:36.518 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:32:36.524 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:33:06.734 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:33:06.739 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:33:06.744 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:33:06.749 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:33:06.753 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:33:06.757 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:33:36.890 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:33:36.895 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:33:36.900 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:33:36.909 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:33:36.917 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:33:36.922 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:34:07.246 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:34:07.253 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:34:07.258 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:34:07.262 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:34:07.266 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:34:07.270 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:34:37.417 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:34:37.423 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:34:37.429 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:34:37.433 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:34:37.437 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:34:37.442 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:35:07.599 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:35:07.604 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:35:07.607 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:35:07.612 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:35:07.616 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:35:07.621 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:35:37.812 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:35:37.816 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:35:37.821 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:35:37.824 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:35:37.828 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:35:37.832 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:36:07.982 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:36:07.987 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:36:07.994 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:36:07.999 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:36:08.003 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:36:08.009 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:36:38.194 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:36:38.198 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:36:38.202 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:36:38.206 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:36:38.210 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:36:38.214 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:37:08.356 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:37:08.360 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:37:08.365 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:37:08.369 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:37:08.374 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:37:08.378 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:37:38.549 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:37:38.554 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:37:38.559 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:37:38.565 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:37:38.569 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:37:38.573 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:38:08.713 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:38:08.718 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:38:08.722 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:38:08.726 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:38:08.730 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:38:08.735 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:38:38.898 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:38:38.905 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:38:38.909 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:38:38.913 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:38:38.917 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:38:38.922 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:39:09.079 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:39:09.083 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:39:09.088 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:39:09.092 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:39:09.096 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:39:09.101 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:39:39.249 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:39:39.253 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:39:39.258 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:39:39.262 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:39:39.266 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:39:39.270 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:40:09.428 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:40:09.434 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:40:09.438 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:40:09.444 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:40:09.450 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:40:09.455 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:40:39.623 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:40:39.627 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:40:39.632 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:40:39.636 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:40:39.641 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:40:39.649 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:41:10.028 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:41:10.033 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:41:10.038 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:41:10.042 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:41:10.047 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:41:10.051 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:41:40.197 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:41:40.202 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:41:40.216 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:41:40.220 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:41:40.223 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:41:40.227 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:42:10.377 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:42:10.383 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:42:10.387 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:42:10.391 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:42:10.404 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:42:10.413 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:42:40.568 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:42:40.574 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:42:40.583 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:42:40.588 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:42:40.592 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:42:40.597 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:43:10.742 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:43:10.747 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:43:10.751 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:43:10.754 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:43:10.758 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:43:10.763 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:43:40.915 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:43:40.921 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:43:40.926 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:43:40.933 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:43:40.938 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:43:40.943 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:44:11.111 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:44:11.156 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:44:11.174 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:44:11.189 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:44:11.212 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:44:11.226 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:44:41.368 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:44:41.380 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:44:41.393 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:44:41.398 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:44:41.402 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:44:41.406 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:45:11.518 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:45:11.522 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:45:11.527 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:45:11.530 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:45:11.534 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:45:11.538 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:45:41.634 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:45:41.651 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:45:41.659 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:45:41.669 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:45:41.676 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:45:41.681 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:46:11.855 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:46:11.860 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:46:11.865 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:46:11.870 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:46:11.875 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:46:11.879 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:46:42.258 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:46:42.268 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:46:42.285 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:46:42.301 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:46:42.312 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:46:42.321 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:47:12.510 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:47:12.527 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:47:12.533 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:47:12.539 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:47:12.545 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:47:12.551 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:47:42.868 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:47:42.872 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:47:42.877 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:47:42.908 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:47:42.914 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:47:42.922 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:48:13.204 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:48:13.212 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:48:13.216 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:48:13.220 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:48:13.227 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:48:13.231 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:48:43.374 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:48:43.379 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:48:43.383 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:48:43.387 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:48:43.391 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:48:43.396 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:49:13.562 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:49:13.567 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:49:13.573 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:49:13.578 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:49:13.587 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:49:13.594 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:49:43.733 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:49:43.748 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:49:43.754 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:49:43.764 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:49:43.771 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:49:43.776 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:50:13.942 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:50:13.948 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:50:13.953 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:50:13.960 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:50:13.965 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:50:13.971 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:50:44.161 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:50:44.166 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:50:44.170 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:50:44.175 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:50:44.179 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:50:44.183 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:51:14.347 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:51:14.353 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:51:14.359 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:51:14.380 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:51:14.387 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:51:14.393 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:51:44.551 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:51:44.560 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:51:44.566 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:51:44.570 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:51:44.577 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:51:44.590 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:52:14.787 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:52:14.793 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:52:14.798 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:52:14.801 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:52:14.805 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:52:14.809 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:52:44.998 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:52:45.003 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:52:45.007 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:52:45.010 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:52:45.015 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:52:45.019 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:53:15.227 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:53:15.232 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:53:15.236 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:53:15.241 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:53:15.245 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:53:15.251 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:53:45.413 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:53:45.419 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:53:45.424 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:53:45.427 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:53:45.432 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:53:45.436 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:54:15.662 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:54:15.667 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:54:15.671 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:54:15.675 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:54:15.679 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:54:15.683 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:54:45.833 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:54:45.838 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:54:45.842 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:54:45.845 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:54:45.849 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:54:45.854 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:55:16.009 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:55:16.015 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:55:16.020 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:55:16.024 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:55:16.028 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:55:16.032 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:55:46.176 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:55:46.184 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:55:46.189 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:55:46.193 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:55:46.197 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:55:46.202 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:56:16.380 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:56:16.384 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:56:16.388 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:56:16.392 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:56:16.396 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:56:16.400 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:56:46.679 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:56:46.684 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:56:46.689 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:56:46.694 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:56:46.698 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:56:46.704 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:57:16.858 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:57:16.863 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:57:16.867 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:57:16.871 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:57:16.876 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:57:16.881 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:57:47.196 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:57:47.201 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:57:47.206 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:57:47.210 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:57:47.214 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:57:47.219 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:58:17.375 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:58:17.380 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:58:17.384 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:58:17.388 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:58:17.393 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:58:17.398 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:58:47.555 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:58:47.559 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:58:47.564 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:58:47.571 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:58:47.575 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:58:47.580 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:59:17.733 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:59:17.738 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:59:17.744 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:59:17.748 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:59:17.752 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:59:17.758 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:59:47.911 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:59:47.916 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:59:47.923 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:59:47.927 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:59:47.931 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T12:59:47.952 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:00:18.138 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:00:18.149 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:00:18.153 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:00:18.158 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:00:18.170 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:00:18.181 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:00:48.360 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:00:48.365 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:00:48.369 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:00:48.374 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:00:48.378 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:00:48.382 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:01:18.643 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:01:18.648 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:01:18.652 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:01:18.657 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:01:18.660 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:01:18.665 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:01:48.821 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:01:48.826 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:01:48.831 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:01:48.835 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:01:48.839 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:01:48.843 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:02:19.005 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:02:19.009 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:02:19.014 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:02:19.018 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:02:19.022 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:02:19.026 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:02:49.241 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:02:49.248 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:02:49.258 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:02:49.263 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:02:49.281 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:02:49.289 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:03:19.446 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:03:19.460 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:03:19.474 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:03:19.484 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:03:19.521 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:03:19.543 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:03:49.685 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:03:49.693 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:03:49.697 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:03:49.701 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:03:49.705 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:03:49.709 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:04:19.876 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:04:19.883 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:04:19.888 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:04:19.894 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:04:19.901 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:04:19.910 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:04:50.065 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:04:50.070 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:04:50.075 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:04:50.079 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:04:50.084 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:04:50.088 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:05:20.255 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:05:20.270 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:05:20.277 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:05:20.281 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:05:20.288 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:05:20.294 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:05:50.440 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:05:50.447 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:05:50.452 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:05:50.456 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:05:50.460 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:05:50.465 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:06:20.618 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:06:20.623 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:06:20.628 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:06:20.632 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:06:20.638 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:06:20.642 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:06:50.806 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:06:50.810 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:06:50.814 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:06:50.818 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:06:50.822 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:06:50.827 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:07:20.978 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:07:20.983 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:07:20.993 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:07:20.998 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:07:21.013 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:07:21.024 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:07:51.327 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:07:51.332 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:07:51.341 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:07:51.345 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:07:51.355 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:07:51.359 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:08:21.556 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:08:21.561 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:08:21.565 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:08:21.569 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:08:21.574 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:08:21.578 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:08:51.834 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:08:51.839 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:08:51.843 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:08:51.848 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:08:51.853 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:08:51.857 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:09:22.013 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:09:22.018 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:09:22.022 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:09:22.026 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:09:22.030 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:09:22.035 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:09:52.212 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:09:52.223 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:09:52.230 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:09:52.234 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:09:52.238 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:09:52.242 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:10:22.427 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:10:22.432 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:10:22.438 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:10:22.443 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:10:22.447 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:10:22.452 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:10:52.608 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:10:52.613 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:10:52.618 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:10:52.622 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:10:52.628 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:10:52.635 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:11:22.813 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:11:22.818 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:11:22.822 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:11:22.826 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:11:22.830 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:11:22.835 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:11:52.975 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:11:52.981 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:11:52.985 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:11:52.989 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:11:52.995 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:11:52.999 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:12:23.424 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:12:23.429 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:12:23.433 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:12:23.437 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:12:23.441 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:12:23.446 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:12:53.623 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:12:53.627 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:12:53.631 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:12:53.635 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:12:53.639 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:12:53.643 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:13:23.823 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:13:23.827 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:13:23.831 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:13:23.835 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:13:23.839 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:13:23.843 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:13:54.026 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:13:54.031 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:13:54.037 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:13:54.041 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:13:54.045 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:13:54.049 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:14:24.214 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:14:24.221 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:14:24.225 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:14:24.229 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:14:24.233 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:14:24.237 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:14:54.425 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:14:54.438 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:14:54.443 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:14:54.447 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:14:54.451 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:14:54.463 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:15:24.577 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:15:24.585 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:15:24.591 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:15:24.596 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:15:24.601 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:15:24.607 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:15:54.761 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:15:54.765 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:15:54.770 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:15:54.779 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:15:54.783 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:15:54.787 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:16:24.970 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:16:24.980 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:16:24.985 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:16:24.990 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:16:24.995 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:16:25.000 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:16:55.152 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:16:55.157 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:16:55.170 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:16:55.177 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:16:55.182 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:16:55.188 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:17:25.548 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:17:25.554 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:17:25.558 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:17:25.562 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:17:25.566 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:17:25.571 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:17:55.736 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:17:55.741 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:17:55.751 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:17:55.763 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:17:55.766 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:17:55.772 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:18:25.916 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:18:25.921 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:18:25.928 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:18:25.933 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:18:25.938 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:18:25.944 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:18:56.083 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:18:56.087 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:18:56.092 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:18:56.097 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:18:56.101 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:18:56.106 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:19:26.253 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:19:26.258 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:19:26.262 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:19:26.267 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:19:26.271 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:19:26.275 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:19:56.440 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:19:56.445 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:19:56.450 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:19:56.454 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:19:56.460 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:19:56.464 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:20:26.636 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:20:26.642 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:20:26.652 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:20:26.664 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:20:26.674 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:20:26.680 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:20:56.946 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:20:56.955 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:20:56.959 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:20:56.964 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:20:56.981 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:20:56.985 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:21:27.130 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:21:27.136 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:21:27.153 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:21:27.164 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:21:27.169 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:21:27.178 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:21:57.333 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:21:57.338 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:21:57.342 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:21:57.347 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:21:57.351 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:21:57.356 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:22:27.554 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:22:27.564 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:22:27.568 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:22:27.577 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:22:27.582 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:22:27.605 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:22:57.779 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:22:57.783 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:22:57.788 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:22:57.793 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:22:57.797 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:22:57.801 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:23:27.981 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:23:28.000 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:23:28.005 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:23:28.010 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:23:28.015 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:23:28.019 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:23:58.178 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:23:58.183 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:23:58.187 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:23:58.191 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:23:58.195 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:23:58.200 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:24:28.350 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:24:28.354 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:24:28.359 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:24:28.362 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:24:28.366 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:24:28.370 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:24:58.522 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:24:58.529 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:24:58.540 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:24:58.552 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:24:58.557 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:24:58.562 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:25:28.727 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:25:28.733 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:25:28.739 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:25:28.749 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:25:28.759 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:25:28.765 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:25:58.926 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:25:58.932 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:25:58.937 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:25:58.941 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:25:58.946 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:25:58.950 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:26:29.095 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:26:29.099 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:26:29.104 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:26:29.108 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:26:29.112 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:26:29.116 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:26:59.274 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:26:59.279 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:26:59.285 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:26:59.289 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:26:59.294 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:26:59.313 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:27:29.442 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:27:29.447 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:27:29.452 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:27:29.456 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:27:29.461 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:27:29.465 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:27:59.620 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:27:59.626 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:27:59.630 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:27:59.635 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:27:59.640 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:27:59.645 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:28:29.811 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:28:29.816 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:28:29.820 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:28:29.824 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:28:29.828 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:28:29.833 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:29:00.147 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:29:00.159 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:29:00.164 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:29:00.169 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:29:00.174 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:29:00.179 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:29:30.325 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:29:30.330 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:29:30.334 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:29:30.338 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:29:30.342 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:29:30.347 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:30:00.512 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:30:00.536 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:30:00.554 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:30:00.572 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:30:00.590 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:30:00.605 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:30:30.750 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:30:30.756 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:30:30.762 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:30:30.767 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:30:30.771 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:30:30.776 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:31:00.935 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:31:00.941 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:31:00.945 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:31:00.949 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:31:00.955 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:31:00.959 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:31:31.119 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:31:31.124 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:31:31.128 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:31:31.132 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:31:31.135 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:31:31.140 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:32:01.242 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:32:01.247 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:32:01.252 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:32:01.255 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:32:01.259 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:32:01.264 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:32:31.445 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:32:31.450 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:32:31.454 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:32:31.458 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:32:31.462 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:32:31.466 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:33:01.770 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:33:01.775 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:33:01.793 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:33:01.806 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:33:01.817 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:33:01.826 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:33:31.962 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:33:31.968 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:33:31.973 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:33:31.977 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:33:31.981 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:33:31.986 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:34:02.133 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:34:02.137 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:34:02.141 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:34:02.145 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:34:02.149 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:34:02.154 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:34:32.328 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:34:32.332 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:34:32.336 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:34:32.340 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:34:32.344 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:34:32.348 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:35:02.495 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:35:02.507 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:35:02.519 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:35:02.528 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:35:02.542 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:35:02.547 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:35:32.712 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:35:32.738 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:35:32.742 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:35:32.747 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:35:32.751 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:35:32.755 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:36:02.924 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:36:02.956 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:36:02.963 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:36:02.968 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:36:02.986 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:36:02.994 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:36:33.167 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:36:33.173 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:36:33.177 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:36:33.181 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:36:33.188 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:36:33.193 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:37:03.381 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:37:03.385 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:37:03.389 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:37:03.393 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:37:03.397 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:37:03.401 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:37:33.557 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:37:33.562 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:37:33.566 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:37:33.570 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:37:33.574 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:37:33.578 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:38:03.727 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:38:03.732 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:38:03.738 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:38:03.742 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:38:03.747 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:38:03.751 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:38:33.953 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:38:33.958 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:38:33.962 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:38:33.966 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:38:33.969 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:38:33.979 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:39:04.126 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:39:04.131 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:39:04.135 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:39:04.139 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:39:04.142 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:39:04.147 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:39:34.317 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:39:34.329 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:39:34.349 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:39:34.353 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:39:34.364 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:39:34.368 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:40:04.508 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:40:04.513 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:40:04.518 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:40:04.522 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:40:04.527 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:40:04.532 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:40:34.682 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:40:34.688 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:40:34.692 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:40:34.700 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:40:34.704 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:40:34.709 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:41:04.966 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:41:04.971 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:41:04.975 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:41:04.980 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:41:04.984 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:41:04.989 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:41:35.168 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:41:35.173 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:41:35.179 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:41:35.183 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:41:35.187 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:41:35.192 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:42:05.351 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:42:05.367 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:42:05.379 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:42:05.385 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:42:05.393 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:42:05.398 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:42:35.551 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:42:35.567 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:42:35.578 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:42:35.583 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:42:35.589 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:42:35.593 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:43:05.780 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:43:05.787 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:43:05.793 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:43:05.799 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:43:05.806 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:43:05.814 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:43:35.969 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:43:35.979 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:43:35.983 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:43:35.987 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:43:35.992 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:43:35.996 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:44:06.167 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:44:06.172 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:44:06.177 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:44:06.181 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:44:06.194 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:44:06.216 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:44:36.370 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:44:36.375 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:44:36.380 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:44:36.384 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:44:36.388 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:44:36.392 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:45:06.554 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:45:06.560 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:45:06.565 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:45:06.569 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:45:06.573 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:45:06.577 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:45:36.715 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:45:36.721 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:45:36.726 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:45:36.731 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:45:36.735 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:45:36.739 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:46:06.895 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:46:06.900 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:46:06.904 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:46:06.908 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:46:06.912 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:46:06.917 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:46:37.089 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:46:37.093 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:46:37.098 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:46:37.102 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:46:37.106 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:46:37.112 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:47:07.254 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:47:07.258 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:47:07.264 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:47:07.268 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:47:07.272 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:47:07.278 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:47:37.404 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:47:37.410 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:47:37.415 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:47:37.422 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:47:37.426 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:47:37.438 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:48:07.574 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:48:07.591 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:48:07.605 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:48:07.642 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:48:07.653 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:48:07.664 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:48:37.770 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:48:37.777 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:48:37.783 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:48:37.787 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:48:37.791 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:48:37.795 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:49:08.052 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:49:08.057 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:49:08.063 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:49:08.067 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:49:08.075 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:49:08.079 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:49:38.217 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:49:38.222 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:49:38.226 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:49:38.230 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:49:38.235 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:49:38.240 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:50:08.368 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:50:08.374 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:50:08.379 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:50:08.385 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:50:08.392 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:50:08.398 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:50:38.563 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:50:38.567 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:50:38.578 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:50:38.582 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:50:38.586 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:50:38.591 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:51:08.794 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:51:08.799 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:51:08.803 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:51:08.808 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:51:08.813 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:51:08.817 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:51:38.982 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:51:38.987 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:51:38.991 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:51:38.995 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:51:38.999 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:51:39.003 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:52:09.163 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:52:09.182 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:52:09.190 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:52:09.197 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:52:09.207 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:52:09.212 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:52:39.359 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:52:39.367 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:52:39.372 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:52:39.376 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:52:39.380 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:52:39.386 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:53:09.544 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:53:09.554 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:53:09.561 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:53:09.568 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:53:09.573 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:53:09.579 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:53:39.739 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:53:39.749 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:53:39.754 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:53:39.758 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:53:39.762 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:53:39.767 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:54:09.926 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:54:09.931 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:54:09.936 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:54:09.941 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:54:09.945 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:54:09.950 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:54:40.130 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:54:40.135 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:54:40.140 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:54:40.144 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:54:40.148 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:54:40.153 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:55:10.311 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:55:10.317 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:55:10.321 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:55:10.325 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:55:10.329 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:55:10.334 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:55:40.490 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:55:40.495 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:55:40.499 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:55:40.504 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:55:40.508 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:55:40.512 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:56:10.652 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:56:10.658 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:56:10.663 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:56:10.667 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:56:10.671 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:56:10.676 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:56:40.843 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:56:40.848 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:56:40.852 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:56:40.857 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:56:40.861 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:56:40.865 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:57:11.004 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:57:11.009 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:57:11.013 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:57:11.017 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:57:11.021 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:57:11.025 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:57:41.177 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:57:41.182 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:57:41.190 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:57:41.194 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:57:41.200 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:57:41.205 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:58:11.351 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:58:11.355 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:58:11.360 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:58:11.364 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:58:11.367 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:58:11.373 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:58:41.516 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:58:41.521 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:58:41.525 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:58:41.529 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:58:41.533 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:58:41.537 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:59:11.695 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:59:11.700 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:59:11.704 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:59:11.709 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:59:11.713 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:59:11.718 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:59:41.974 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:59:41.979 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:59:41.983 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:59:41.987 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:59:41.991 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T13:59:41.996 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:00:12.154 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:00:12.160 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:00:12.166 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:00:12.171 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:00:12.175 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:00:12.181 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:00:42.339 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:00:42.344 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:00:42.348 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:00:42.352 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:00:42.356 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:00:42.361 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:01:12.519 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:01:12.523 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:01:12.538 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:01:12.543 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:01:12.548 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:01:12.553 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:01:42.724 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:01:42.728 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:01:42.733 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:01:42.737 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:01:42.741 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:01:42.745 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:02:12.915 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:02:12.943 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:02:12.997 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:02:13.018 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:02:13.038 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:02:13.060 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:02:43.220 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:02:43.225 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:02:43.229 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:02:43.233 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:02:43.237 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:02:43.241 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:03:13.572 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:03:13.576 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:03:13.581 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:03:13.584 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:03:13.588 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:03:13.592 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:03:43.753 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:03:43.757 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:03:43.761 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:03:43.765 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:03:43.769 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:03:43.773 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:04:13.915 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:04:13.920 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:04:13.925 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:04:13.928 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:04:13.933 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:04:13.937 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:04:44.081 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:04:44.086 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:04:44.091 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:04:44.095 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:04:44.099 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:04:44.103 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:05:14.296 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:05:14.300 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:05:14.305 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:05:14.311 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:05:14.318 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:05:14.322 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:05:44.480 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:05:44.485 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:05:44.489 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:05:44.493 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:05:44.502 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:05:44.506 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:06:14.604 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:06:14.616 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:06:14.621 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:06:14.626 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:06:14.631 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:06:14.636 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:06:44.794 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:06:44.800 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:06:44.806 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:06:44.810 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:06:44.814 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:06:44.818 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:07:14.975 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:07:14.980 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:07:14.984 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:07:14.989 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:07:14.995 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:07:14.999 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:07:45.142 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:07:45.147 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:07:45.151 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:07:45.154 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:07:45.158 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:07:45.162 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:08:15.310 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:08:15.315 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:08:15.323 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:08:15.328 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:08:15.333 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:08:15.338 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:08:45.580 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:08:45.585 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:08:45.589 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:08:45.593 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:08:45.597 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:08:45.602 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:09:15.743 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:09:15.747 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:09:15.751 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:09:15.755 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:09:15.759 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:09:15.763 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:09:45.904 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:09:45.918 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:09:45.941 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:09:45.964 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:09:45.980 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:09:45.997 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:10:16.162 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:10:16.173 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:10:16.179 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:10:16.186 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:10:16.192 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:10:16.200 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:10:46.358 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:10:46.364 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:10:46.368 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:10:46.373 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:10:46.377 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:10:46.382 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:11:16.535 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:11:16.543 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:11:16.550 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:11:16.557 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:11:16.561 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:11:16.566 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:11:46.722 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:11:46.727 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:11:46.732 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:11:46.738 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:11:46.743 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:11:46.751 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:12:16.907 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:12:16.912 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:12:16.916 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:12:16.921 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:12:16.925 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:12:16.930 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:12:47.121 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:12:47.126 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:12:47.130 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:12:47.134 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:12:47.139 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:12:47.143 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:13:17.296 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:13:17.301 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:13:17.305 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:13:17.309 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:13:17.313 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:13:17.317 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:13:47.468 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:13:47.472 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:13:47.477 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:13:47.481 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:13:47.484 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:13:47.489 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:14:17.637 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:14:17.642 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:14:17.646 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:14:17.650 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:14:17.653 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:14:17.657 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:14:47.807 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:14:47.812 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:14:47.816 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:14:47.819 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:14:47.823 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:14:47.827 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:15:17.994 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:15:17.999 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:15:18.003 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:15:18.007 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:15:18.011 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:15:18.016 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:15:48.169 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:15:48.174 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:15:48.178 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:15:48.182 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:15:48.185 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:15:48.190 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:16:18.366 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:16:18.371 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:16:18.375 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:16:18.379 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:16:18.384 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:16:18.388 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:16:48.538 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:16:48.545 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:16:48.550 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:16:48.555 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:16:48.559 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:16:48.563 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:17:18.718 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:17:18.723 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:17:18.727 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:17:18.731 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:17:18.736 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:17:18.740 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:17:48.929 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:17:48.934 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:17:48.938 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:17:48.942 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:17:48.946 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:17:48.950 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:18:19.099 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:18:19.103 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:18:19.108 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:18:19.112 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:18:19.119 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:18:19.124 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:18:49.282 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:18:49.286 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:18:49.290 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:18:49.294 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:18:49.298 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:18:49.302 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:19:19.444 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:19:19.449 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:19:19.453 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:19:19.458 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:19:19.462 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:19:19.466 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:19:49.627 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:19:49.636 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:19:49.640 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:19:49.645 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:19:49.650 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:19:49.654 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:20:19.839 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:20:19.845 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:20:19.850 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:20:19.856 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:20:19.869 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:20:19.874 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:20:50.032 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:20:50.036 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:20:50.041 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:20:50.046 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:20:50.050 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:20:50.054 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:21:20.211 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:21:20.215 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:21:20.219 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:21:20.223 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:21:20.227 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:21:20.232 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:21:50.424 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:21:50.430 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:21:50.434 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:21:50.440 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:21:50.444 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:21:50.449 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:22:20.612 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:22:20.617 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:22:20.622 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:22:20.626 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:22:20.631 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:22:20.635 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:22:50.775 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:22:50.787 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:22:50.797 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:22:50.805 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:22:50.812 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:22:50.819 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:23:20.977 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:23:21.001 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:23:21.013 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:23:21.026 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:23:21.041 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:23:21.051 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:23:51.196 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:23:51.208 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:23:51.219 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:23:51.227 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:23:51.232 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:23:51.237 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:24:21.373 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:24:21.381 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:24:21.386 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:24:21.391 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:24:21.395 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:24:21.400 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:24:51.539 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:24:51.546 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:24:51.550 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:24:51.558 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:24:51.563 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:24:51.568 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:25:21.743 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:25:21.748 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:25:21.752 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:25:21.756 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:25:21.760 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:25:21.765 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:25:51.907 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:25:51.913 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:25:51.919 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:25:51.926 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:25:51.930 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:25:51.935 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:26:22.135 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:26:22.140 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:26:22.145 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:26:22.149 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:26:22.153 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:26:22.157 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:26:52.340 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:26:52.344 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:26:52.361 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:26:52.368 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:26:52.381 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:26:52.385 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:27:22.569 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:27:22.574 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:27:22.579 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:27:22.591 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:27:22.596 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:27:22.605 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:27:52.744 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:27:52.750 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:27:52.755 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:27:52.760 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:27:52.764 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:27:52.769 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:28:22.950 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:28:22.955 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:28:22.967 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:28:22.970 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:28:22.978 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:28:22.983 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:28:53.127 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:28:53.134 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:28:53.141 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:28:53.145 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:28:53.149 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:28:53.153 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:29:23.325 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:29:23.330 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:29:23.334 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:29:23.338 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:29:23.342 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:29:23.347 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:29:53.508 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:29:53.513 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:29:53.517 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:29:53.521 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:29:53.524 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:29:53.529 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:30:23.687 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:30:23.692 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:30:23.706 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:30:23.713 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:30:23.717 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:30:23.723 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:30:53.904 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:30:53.908 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:30:53.913 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:30:53.917 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:30:53.921 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:30:53.925 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:31:24.069 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:31:24.073 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:31:24.078 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:31:24.082 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:31:24.092 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:31:24.097 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:31:54.240 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:31:54.244 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:31:54.248 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:31:54.252 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:31:54.255 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:31:54.259 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:32:24.411 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:32:24.416 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:32:24.422 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:32:24.441 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:32:24.447 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:32:24.458 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:32:54.607 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:32:54.618 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:32:54.623 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:32:54.627 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:32:54.630 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:32:54.635 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:33:24.790 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:33:24.796 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:33:24.809 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:33:24.818 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:33:24.823 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:33:24.827 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:33:54.996 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:33:55.005 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:33:55.013 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:33:55.018 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:33:55.023 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:33:55.027 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:34:25.216 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:34:25.221 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:34:25.225 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:34:25.229 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:34:25.232 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:34:25.241 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:34:55.379 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:34:55.384 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:34:55.389 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:34:55.392 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:34:55.397 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:34:55.401 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:35:25.563 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:35:25.567 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:35:25.572 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:35:25.576 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:35:25.580 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:35:25.585 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:35:55.730 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:35:55.734 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:35:55.738 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:35:55.742 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:35:55.747 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:35:55.766 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:36:25.898 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:36:25.903 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:36:25.907 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:36:25.911 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:36:25.915 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:36:25.920 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:36:56.076 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:36:56.081 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:36:56.085 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:36:56.089 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:36:56.092 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:36:56.098 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:37:26.260 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:37:26.265 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:37:26.275 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:37:26.279 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:37:26.282 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:37:26.286 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:37:56.442 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:37:56.447 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:37:56.452 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:37:56.457 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:37:56.462 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:37:56.468 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:38:26.620 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:38:26.626 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:38:26.629 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:38:26.633 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:38:26.637 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:38:26.641 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:38:56.790 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:38:56.796 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:38:56.800 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:38:56.804 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:38:56.808 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:38:56.811 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:39:26.989 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:39:26.994 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:39:27.011 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:39:27.014 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:39:27.024 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:39:27.040 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:39:57.205 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:39:57.210 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:39:57.215 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:39:57.224 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:39:57.229 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:39:57.234 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:40:27.389 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:40:27.396 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:40:27.402 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:40:27.413 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:40:27.417 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:40:27.424 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:40:57.581 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:40:57.799 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:40:57.806 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:40:57.815 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:40:57.820 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:40:57.830 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:41:27.975 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:41:27.980 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:41:27.985 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:41:27.989 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:41:27.993 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:41:27.997 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:41:58.164 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:41:58.173 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:41:58.179 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:41:58.184 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:41:58.189 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:41:58.193 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:42:28.368 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:42:28.373 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:42:28.377 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:42:28.382 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:42:28.387 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:42:28.392 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:42:58.551 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:42:58.557 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:42:58.563 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:42:58.567 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:42:58.572 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:42:58.576 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:43:28.723 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:43:28.728 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:43:28.732 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:43:28.737 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:43:28.741 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:43:28.745 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:43:58.902 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:43:58.906 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:43:58.912 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:43:58.916 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:43:58.920 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:43:58.924 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:44:29.065 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:44:29.069 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:44:29.073 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:44:29.077 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:44:29.080 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:44:29.085 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:44:59.243 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:44:59.248 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:44:59.252 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:44:59.256 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:44:59.261 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:44:59.265 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:45:29.476 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:45:29.484 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:45:29.488 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:45:29.493 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:45:29.498 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:45:29.504 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:45:59.685 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:45:59.689 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:45:59.694 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:45:59.699 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:45:59.702 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:45:59.706 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:46:29.856 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:46:29.860 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:46:29.865 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:46:29.869 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:46:29.873 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:46:29.878 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:47:00.065 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:47:00.070 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:47:00.075 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:47:00.079 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:47:00.083 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:47:00.087 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:47:30.252 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:47:30.257 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:47:30.261 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:47:30.265 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:47:30.269 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:47:30.273 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:48:00.413 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:48:00.418 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:48:00.423 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:48:00.426 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:48:00.430 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:48:00.435 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:48:30.593 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:48:30.598 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:48:30.602 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:48:30.605 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:48:30.609 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:48:30.614 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:49:00.831 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:49:00.836 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:49:00.840 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:49:00.844 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:49:00.848 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:49:00.852 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:49:31.054 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:49:31.058 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:49:31.062 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:49:31.066 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:49:31.070 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:49:31.075 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:50:01.262 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:50:01.267 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:50:01.272 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:50:01.279 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:50:01.283 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:50:01.288 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:50:31.458 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:50:31.462 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:50:31.467 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:50:31.472 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:50:31.476 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:50:31.481 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:51:01.644 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:51:01.649 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:51:01.653 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:51:01.657 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:51:01.661 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:51:01.665 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:51:31.839 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:51:31.843 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:51:31.848 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:51:31.851 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:51:31.855 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:51:31.860 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:52:02.043 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:52:02.047 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:52:02.052 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:52:02.055 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:52:02.063 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:52:02.067 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:52:32.221 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:52:32.226 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:52:32.232 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:52:32.236 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:52:32.241 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:52:32.245 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:53:02.392 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:53:02.397 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:53:02.402 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:53:02.406 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:53:02.410 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:53:02.415 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:53:32.579 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:53:32.585 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:53:32.590 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:53:32.594 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:53:32.599 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:53:32.604 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:54:02.755 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:54:02.763 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:54:02.767 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:54:02.771 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:54:02.775 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:54:02.779 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:54:32.944 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:54:32.948 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:54:32.952 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:54:32.956 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:54:32.961 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:54:32.965 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:55:03.118 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:55:03.137 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:55:03.141 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:55:03.146 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:55:03.150 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:55:03.155 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:55:33.321 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:55:33.327 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:55:33.331 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:55:33.336 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:55:33.340 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:55:33.344 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:56:03.493 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:56:03.498 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:56:03.502 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:56:03.506 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:56:03.509 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:56:03.513 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:56:33.679 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:56:33.683 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:56:33.704 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:56:33.708 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:56:33.712 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:56:33.717 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:57:03.860 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:57:03.865 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:57:03.869 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:57:03.873 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:57:03.877 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:57:03.881 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:57:34.007 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:57:34.012 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:57:34.017 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:57:34.033 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:57:34.038 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:57:34.043 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:58:04.195 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:58:04.199 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:58:04.204 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:58:04.208 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:58:04.213 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:58:04.217 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:58:34.400 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:58:34.408 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:58:34.415 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:58:34.421 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:58:34.429 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:58:34.436 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:59:04.566 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:59:04.571 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:59:04.576 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:59:04.580 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:59:04.585 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:59:04.608 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:59:34.725 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:59:34.735 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:59:34.745 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:59:34.762 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:59:34.775 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T14:59:34.788 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:00:04.934 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:00:04.945 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:00:04.952 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:00:04.961 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:00:04.969 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:00:04.979 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:00:35.119 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:00:35.125 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:00:35.129 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:00:35.145 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:00:35.149 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:00:35.154 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:01:05.296 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:01:05.311 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:01:05.327 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:01:05.340 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:01:05.358 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:01:05.379 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:01:35.554 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:01:35.559 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:01:35.563 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:01:35.567 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:01:35.573 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:01:35.577 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:02:05.722 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:02:05.726 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:02:05.730 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:02:05.735 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:02:05.740 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:02:05.744 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:02:35.898 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:02:35.903 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:02:35.907 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:02:35.911 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:02:35.915 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:02:35.919 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:03:06.069 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:03:06.081 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:03:06.086 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:03:06.092 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:03:06.096 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:03:06.101 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:03:36.248 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:03:36.253 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:03:36.259 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:03:36.262 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:03:36.266 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:03:36.271 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:04:06.431 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:04:06.446 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:04:06.457 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:04:06.465 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:04:06.470 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:04:06.475 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:04:36.642 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:04:36.647 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:04:36.652 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:04:36.656 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:04:36.660 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:04:36.673 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:05:06.813 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:05:06.817 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:05:06.824 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:05:06.828 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:05:06.836 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:05:06.843 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:05:37.009 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:05:37.013 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:05:37.018 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:05:37.021 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:05:37.028 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:05:37.032 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:06:07.178 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:06:07.183 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:06:07.188 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:06:07.192 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:06:07.197 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:06:07.202 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:06:37.371 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:06:37.377 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:06:37.384 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:06:37.388 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:06:37.392 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:06:37.398 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:07:07.548 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:07:07.553 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:07:07.565 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:07:07.570 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:07:07.574 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:07:07.583 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:07:37.748 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:07:37.752 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:07:37.758 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:07:37.761 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:07:37.765 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:07:37.771 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:08:07.926 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:08:07.930 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:08:07.935 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:08:07.940 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:08:07.945 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:08:07.951 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:08:38.119 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:08:38.126 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:08:38.133 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:08:38.137 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:08:38.141 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:08:38.145 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:09:08.300 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:09:08.325 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:09:08.332 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:09:08.336 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:09:08.354 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:09:08.371 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:09:38.528 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:09:38.533 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:09:38.537 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:09:38.543 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:09:38.547 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:09:38.554 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:10:08.699 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:10:08.704 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:10:08.710 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:10:08.716 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:10:08.721 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:10:08.733 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:10:38.873 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:10:38.880 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:10:38.885 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:10:38.892 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:10:38.895 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:10:38.901 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:11:09.057 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:11:09.061 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:11:09.066 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:11:09.070 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:11:09.074 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:11:09.078 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:11:39.418 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:11:39.423 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:11:39.427 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:11:39.431 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:11:39.435 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:11:39.439 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:12:09.588 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:12:09.592 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:12:09.596 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:12:09.600 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:12:09.604 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:12:09.610 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:12:39.796 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:12:39.801 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:12:39.806 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:12:39.810 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:12:39.815 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:12:39.820 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:13:09.978 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:13:09.983 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:13:09.990 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:13:09.994 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:13:09.998 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:13:10.003 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:13:40.166 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:13:40.170 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:13:40.174 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:13:40.179 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:13:40.183 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:13:40.187 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:14:10.365 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:14:10.369 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:14:10.373 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:14:10.377 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:14:10.381 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:14:10.385 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:14:40.541 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:14:40.564 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:14:40.569 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:14:40.573 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:14:40.577 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:14:40.584 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:15:10.740 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:15:10.748 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:15:10.752 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:15:10.756 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:15:10.760 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:15:10.764 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:15:40.921 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:15:40.926 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:15:40.930 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:15:40.936 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:15:40.940 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:15:40.954 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:16:11.097 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:16:11.101 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:16:11.106 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:16:11.110 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:16:11.114 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:16:11.118 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:16:41.278 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:16:41.295 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:16:41.307 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:16:41.320 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:16:41.354 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:16:41.372 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:17:11.468 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:17:11.473 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:17:11.477 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:17:11.481 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:17:11.486 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:17:11.490 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:17:41.639 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:17:41.643 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:17:41.647 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:17:41.651 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:17:41.654 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:17:41.660 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:18:11.819 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:18:11.825 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:18:11.829 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:18:11.834 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:18:11.838 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:18:11.846 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:18:41.998 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:18:42.003 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:18:42.007 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:18:42.012 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:18:42.016 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:18:42.021 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:19:12.197 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:19:12.201 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:19:12.205 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:19:12.209 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:19:12.213 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:19:12.217 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:19:42.374 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:19:42.381 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:19:42.385 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:19:42.390 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:19:42.394 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:19:42.398 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:20:12.545 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:20:12.550 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:20:12.555 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:20:12.559 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:20:12.563 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:20:12.568 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:20:42.741 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:20:42.746 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:20:42.750 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:20:42.754 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:20:42.758 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:20:42.762 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:21:12.883 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:21:12.889 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:21:12.893 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:21:12.899 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:21:12.904 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:21:12.923 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:21:43.068 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:21:43.073 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:21:43.077 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:21:43.081 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:21:43.085 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:21:43.090 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:22:13.244 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:22:13.248 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:22:13.252 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:22:13.256 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:22:13.261 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:22:13.265 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:22:43.415 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:22:43.420 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:22:43.424 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:22:43.429 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:22:43.433 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:22:43.437 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:23:13.612 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:23:13.630 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:23:13.635 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:23:13.638 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:23:13.643 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:23:13.647 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:23:43.788 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:23:43.793 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:23:43.798 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:23:43.801 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:23:43.805 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:23:43.810 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:24:13.967 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:24:13.973 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:24:13.977 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:24:13.982 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:24:13.986 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:24:13.991 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:24:44.165 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:24:44.171 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:24:44.176 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:24:44.183 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:24:44.188 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:24:44.193 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:25:14.368 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:25:14.374 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:25:14.378 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:25:14.382 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:25:14.386 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:25:14.390 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:25:44.560 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:25:44.565 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:25:44.569 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:25:44.572 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:25:44.583 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:25:44.587 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:26:14.730 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:26:14.735 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:26:14.739 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:26:14.742 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:26:14.746 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:26:14.750 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:26:44.918 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:26:44.923 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:26:44.928 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:26:44.932 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:26:44.936 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:26:44.941 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:27:15.080 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:27:15.085 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:27:15.089 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:27:15.093 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:27:15.097 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:27:15.101 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:27:45.244 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:27:45.249 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:27:45.253 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:27:45.257 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:27:45.261 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:27:45.265 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:28:15.431 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:28:15.436 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:28:15.441 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:28:15.445 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:28:15.449 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:28:15.454 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:28:45.605 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:28:45.609 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:28:45.613 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:28:45.617 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:28:45.621 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:28:45.625 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:29:15.819 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:29:15.824 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:29:15.828 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:29:15.832 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:29:15.836 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:29:15.841 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:29:45.997 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:29:46.002 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:29:46.007 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:29:46.011 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:29:46.015 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:29:46.019 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:30:16.210 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:30:16.215 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:30:16.223 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:30:16.230 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:30:16.238 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:30:16.244 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:30:46.423 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:30:46.429 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:30:46.434 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:30:46.438 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:30:46.443 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:30:46.448 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:31:16.656 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:31:16.678 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:31:16.703 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:31:16.710 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:31:16.715 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:31:16.720 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:31:46.884 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:31:46.906 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:31:46.913 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:31:46.917 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:31:46.921 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:31:46.924 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:32:17.073 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:32:17.078 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:32:17.082 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:32:17.086 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:32:17.090 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:32:17.095 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:32:47.274 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:32:47.279 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:32:47.284 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:32:47.289 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:32:47.316 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:32:47.326 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:33:17.489 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:33:17.511 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:33:17.516 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:33:17.520 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:33:17.525 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:33:17.530 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:33:47.710 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:33:47.715 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:33:47.719 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:33:47.723 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:33:47.733 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:33:47.738 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:34:17.913 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:34:17.921 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:34:17.925 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:34:17.929 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:34:17.933 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:34:17.937 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:34:48.069 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:34:48.075 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:34:48.081 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:34:48.086 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:34:48.090 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:34:48.095 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:35:18.247 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:35:18.252 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:35:18.256 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:35:18.260 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:35:18.264 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:35:18.269 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:35:48.400 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:35:48.406 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:35:48.410 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:35:48.415 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:35:48.431 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:35:48.441 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:36:18.588 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:36:18.592 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:36:18.597 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:36:18.603 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:36:18.607 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:36:18.613 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:36:48.767 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:36:48.772 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:36:48.777 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:36:48.781 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:36:48.785 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:36:48.789 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:37:18.927 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:37:18.932 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:37:18.937 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:37:18.940 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:37:18.945 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:37:18.950 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:37:49.102 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:37:49.107 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:37:49.111 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:37:49.114 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:37:49.118 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:37:49.123 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:38:19.284 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:38:19.289 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:38:19.293 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:38:19.298 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:38:19.303 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:38:19.307 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:38:49.461 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:38:49.467 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:38:49.471 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:38:49.475 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:38:49.482 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:38:49.486 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:39:19.636 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:39:19.641 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:39:19.645 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:39:19.649 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:39:19.653 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:39:19.658 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:39:49.822 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:39:49.827 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:39:49.831 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:39:49.835 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:39:49.845 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:39:49.849 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:40:20.008 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:40:20.013 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:40:20.018 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:40:20.024 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:40:20.029 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:40:20.034 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:40:50.224 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:40:50.229 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:40:50.233 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:40:50.237 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:40:50.241 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:40:50.246 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:41:20.421 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:41:20.426 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:41:20.430 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:41:20.434 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:41:20.438 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:41:20.442 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:41:50.613 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:41:50.618 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:41:50.622 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:41:50.626 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:41:50.630 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:41:50.635 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:42:20.771 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:42:20.776 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:42:20.779 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:42:20.784 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:42:20.788 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:42:20.793 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:42:50.940 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:42:50.946 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:42:50.950 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:42:50.955 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:42:50.959 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:42:50.963 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:43:21.112 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:43:21.117 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:43:21.121 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:43:21.127 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:43:21.131 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:43:21.138 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:43:51.270 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:43:51.283 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:43:51.287 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:43:51.292 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:43:51.296 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:43:51.300 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:44:21.461 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:44:21.466 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:44:21.471 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:44:21.475 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:44:21.479 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:44:21.485 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:44:51.648 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:44:51.653 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:44:51.657 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:44:51.661 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:44:51.665 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:44:51.669 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:45:21.834 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:45:21.839 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:45:21.843 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:45:21.847 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:45:21.851 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:45:21.856 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:45:52.022 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:45:52.027 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:45:52.032 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:45:52.036 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:45:52.040 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:45:52.045 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:46:22.201 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:46:22.206 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:46:22.210 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:46:22.214 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:46:22.218 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:46:22.222 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:46:52.380 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:46:52.385 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:46:52.390 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:46:52.395 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:46:52.400 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:46:52.406 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:47:22.551 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:47:22.556 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:47:22.560 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:47:22.564 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:47:22.568 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:47:22.573 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:47:52.730 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:47:52.736 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:47:52.741 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:47:52.746 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:47:52.750 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:47:52.754 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:48:22.907 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:48:22.911 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:48:22.916 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:48:22.920 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:48:22.924 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:48:22.929 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:48:53.102 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:48:53.108 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:48:53.113 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:48:53.123 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:48:53.127 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:48:53.132 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:49:23.275 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:49:23.280 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:49:23.285 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:49:23.289 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:49:23.294 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:49:23.302 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:49:53.438 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:49:53.442 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:49:53.447 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:49:53.451 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:49:53.458 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:49:53.462 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:50:23.622 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:50:23.628 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:50:23.633 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:50:23.638 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:50:23.643 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:50:23.648 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:50:53.817 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:50:53.822 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:50:53.826 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:50:53.830 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:50:53.834 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:50:53.839 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:51:24.002 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:51:24.008 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:51:24.013 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:51:24.017 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:51:24.021 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:51:24.026 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:51:54.183 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:51:54.188 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:51:54.192 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:51:54.196 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:51:54.199 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:51:54.205 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:52:24.343 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:52:24.348 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:52:24.356 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:52:24.361 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:52:24.366 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:52:24.376 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:52:54.513 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:52:54.518 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:52:54.527 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:52:54.531 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:52:54.535 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:52:54.540 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:53:24.689 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:53:24.693 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:53:24.698 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:53:24.702 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:53:24.706 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:53:24.710 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:53:54.871 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:53:54.880 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:53:54.884 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:53:54.888 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:53:54.892 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:53:54.896 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:54:25.059 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:54:25.064 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:54:25.069 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:54:25.072 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:54:25.076 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:54:25.080 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:54:55.245 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:54:55.249 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:54:55.254 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:54:55.260 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:54:55.271 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:54:55.275 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:55:25.445 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:55:25.450 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:55:25.454 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:55:25.458 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:55:25.461 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:55:25.467 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:55:55.619 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:55:55.623 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:55:55.627 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:55:55.631 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:55:55.635 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:55:55.639 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:56:25.781 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:56:25.788 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:56:25.792 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:56:25.815 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:56:25.819 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:56:25.823 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:56:56.010 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:56:56.016 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:56:56.021 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:56:56.028 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:56:56.033 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:56:56.039 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:57:26.190 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:57:26.202 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:57:26.207 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:57:26.211 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:57:26.218 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:57:26.222 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:57:56.385 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:57:56.389 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:57:56.394 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:57:56.398 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:57:56.402 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:57:56.407 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:58:26.562 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:58:26.567 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:58:26.572 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:58:26.575 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:58:26.579 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:58:26.583 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:58:56.717 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:58:56.722 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:58:56.726 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:58:56.730 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:58:56.734 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:58:56.738 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:59:26.897 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:59:26.903 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:59:26.908 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:59:26.913 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:59:26.918 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:59:26.922 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:59:57.090 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:59:57.095 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:59:57.099 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:59:57.103 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:59:57.108 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T15:59:57.114 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:00:27.285 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:00:27.294 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:00:27.298 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:00:27.302 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:00:27.313 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:00:27.328 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:00:57.522 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:00:57.527 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:00:57.532 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:00:57.537 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:00:57.542 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:00:57.547 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:01:27.726 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:01:27.732 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:01:27.737 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:01:27.741 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:01:27.745 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:01:27.750 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:01:57.904 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:01:57.909 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:01:57.913 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:01:57.919 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:01:57.924 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:01:57.928 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:02:28.078 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:02:28.082 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:02:28.088 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:02:28.093 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:02:28.098 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:02:28.102 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:02:58.256 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:02:58.288 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:02:58.298 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:02:58.302 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:02:58.307 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:02:58.312 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:03:28.482 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:03:28.486 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:03:28.491 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:03:28.494 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:03:28.498 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:03:28.503 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:03:58.654 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:03:58.674 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:03:58.687 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:03:58.699 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:03:58.709 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:03:58.719 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:04:28.862 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:04:28.877 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:04:28.889 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:04:28.898 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:04:28.909 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:04:28.924 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:04:59.068 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:04:59.087 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:04:59.092 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:04:59.096 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:04:59.101 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:04:59.105 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:05:29.257 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:05:29.263 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:05:29.268 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:05:29.272 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:05:29.277 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:05:29.281 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:05:59.455 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:05:59.459 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:05:59.464 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:05:59.468 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:05:59.472 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:05:59.476 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:06:29.620 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:06:29.658 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:06:29.663 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:06:29.667 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:06:29.671 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:06:29.676 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:06:59.839 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:06:59.845 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:06:59.850 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:06:59.855 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:06:59.859 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:06:59.864 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:07:30.045 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:07:30.056 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:07:30.061 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:07:30.068 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:07:30.072 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:07:30.076 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:08:00.242 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:08:00.248 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:08:00.252 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:08:00.257 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:08:00.261 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:08:00.267 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:08:30.396 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:08:30.400 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:08:30.405 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:08:30.409 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:08:30.413 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:08:30.417 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:09:00.571 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:09:00.575 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:09:00.579 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:09:00.584 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:09:00.588 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:09:00.592 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:09:30.791 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:09:30.797 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:09:30.802 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:09:30.807 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:09:30.811 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:09:30.837 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:10:01.019 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:10:01.024 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:10:01.028 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:10:01.032 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:10:01.040 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:10:01.044 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:10:31.251 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:10:31.258 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:10:31.264 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:10:31.271 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:10:31.277 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:10:31.282 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:11:01.473 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:11:01.477 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:11:01.482 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:11:01.486 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:11:01.490 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:11:01.498 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:11:31.634 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:11:31.639 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:11:31.643 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:11:31.647 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:11:31.651 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:11:31.655 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:12:01.817 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:12:01.831 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:12:01.837 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:12:01.842 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:12:01.846 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:12:01.850 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:12:32.031 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:12:32.038 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:12:32.047 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:12:32.052 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:12:32.060 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:12:32.067 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:13:02.228 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:13:02.233 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:13:02.249 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:13:02.254 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:13:02.258 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:13:02.264 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:13:32.417 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:13:32.422 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:13:32.426 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:13:32.430 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:13:32.434 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:13:32.439 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:14:02.579 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:14:02.594 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:14:02.627 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:14:02.636 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:14:02.678 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:14:02.707 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:14:32.858 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:14:32.862 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:14:32.867 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:14:32.871 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:14:32.880 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:14:32.887 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:15:03.024 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:15:03.029 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:15:03.033 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:15:03.037 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:15:03.042 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:15:03.046 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:15:33.202 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:15:33.207 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:15:33.212 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:15:33.216 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:15:33.220 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:15:33.225 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:16:03.390 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:16:03.395 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:16:03.399 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:16:03.404 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:16:03.408 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:16:03.413 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:16:33.577 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:16:33.608 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:16:33.613 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:16:33.617 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:16:33.622 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:16:33.627 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:17:03.775 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:17:03.780 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:17:03.785 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:17:03.789 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:17:03.793 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:17:03.798 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:17:33.971 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:17:33.983 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:17:33.992 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:17:34.013 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:17:34.020 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:17:34.026 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:18:04.176 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:18:04.182 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:18:04.189 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:18:04.194 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:18:04.197 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:18:04.201 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:18:34.361 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:18:34.366 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:18:34.379 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:18:34.382 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:18:34.386 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:18:34.391 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:19:04.545 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:19:04.550 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:19:04.554 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:19:04.558 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:19:04.562 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:19:04.567 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:19:34.723 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:19:34.728 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:19:34.732 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:19:34.736 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:19:34.739 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:19:34.743 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:20:04.945 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:20:04.950 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:20:04.955 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:20:04.961 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:20:04.966 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:20:04.971 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:20:35.239 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:20:35.243 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:20:35.247 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:20:35.251 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:20:35.256 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:20:35.260 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:21:05.396 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:21:05.403 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:21:05.410 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:21:05.418 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:21:05.425 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:21:05.433 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:21:35.572 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:21:35.576 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:21:35.581 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:21:35.585 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:21:35.591 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:21:35.597 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:22:05.748 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:22:05.815 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:22:05.819 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:22:05.823 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:22:05.827 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:22:05.832 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:22:35.973 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:22:35.978 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:22:35.982 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:22:35.985 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:22:35.989 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:22:35.994 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:23:06.142 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:23:06.146 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:23:06.151 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:23:06.155 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:23:06.159 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:23:06.163 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:23:36.303 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:23:36.308 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:23:36.313 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:23:36.316 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:23:36.320 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:23:36.324 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:24:06.472 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:24:06.476 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:24:06.481 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:24:06.484 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:24:06.488 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:24:06.492 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:24:36.643 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:24:36.680 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:24:36.684 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:24:36.688 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:24:36.692 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:24:36.696 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:25:06.829 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:25:06.835 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:25:06.840 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:25:06.845 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:25:06.849 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:25:06.854 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:25:37.022 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:25:37.026 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:25:37.030 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:25:37.034 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:25:37.038 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:25:37.042 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:26:07.183 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:26:07.187 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:26:07.191 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:26:07.194 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:26:07.197 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:26:07.202 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:26:37.370 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:26:37.375 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:26:37.379 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:26:37.382 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:26:37.387 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:26:37.391 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:27:07.544 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:27:07.556 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:27:07.565 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:27:07.571 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:27:07.577 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:27:07.589 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:27:37.732 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:27:37.736 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:27:37.740 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:27:37.744 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:27:37.748 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:27:37.753 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:28:07.921 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:28:07.937 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:28:07.952 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:28:07.961 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:28:07.969 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:28:07.978 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:28:38.105 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:28:38.110 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:28:38.115 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:28:38.119 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:28:38.123 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:28:38.127 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:29:08.257 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:29:08.262 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:29:08.266 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:29:08.270 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:29:08.275 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:29:08.280 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:29:38.430 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:29:38.437 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:29:38.443 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:29:38.448 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:29:38.453 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:29:38.458 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:30:08.625 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:30:08.631 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:30:08.636 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:30:08.641 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:30:08.647 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:30:08.653 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:30:38.794 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:30:38.799 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:30:38.803 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:30:38.809 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:30:38.838 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:30:38.851 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:31:08.957 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:31:08.961 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:31:08.974 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:31:08.980 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:31:08.984 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:31:08.990 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:31:39.182 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:31:39.193 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:31:39.200 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:31:39.204 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:31:39.211 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:31:39.215 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:32:09.371 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:32:09.389 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:32:09.403 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:32:09.407 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:32:09.412 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:32:09.417 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:32:39.567 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:32:39.572 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:32:39.576 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:32:39.580 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:32:39.586 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:32:39.591 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:33:09.802 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:33:09.832 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:33:09.838 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:33:09.842 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:33:09.847 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:33:09.852 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:33:40.007 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:33:40.011 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:33:40.016 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:33:40.021 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:33:40.030 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:33:40.035 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:34:10.175 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:34:10.189 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:34:10.196 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:34:10.200 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:34:10.205 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:34:10.210 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:34:40.372 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:34:40.381 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:34:40.386 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:34:40.390 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:34:40.394 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:34:40.400 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:35:10.559 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:35:10.566 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:35:10.570 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:35:10.574 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:35:10.585 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:35:10.590 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:35:40.756 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:35:40.761 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:35:40.765 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:35:40.769 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:35:40.773 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:35:40.779 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:36:10.935 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:36:10.940 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:36:10.945 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:36:10.949 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:36:10.956 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:36:10.961 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:36:41.153 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:36:41.199 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:36:41.203 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:36:41.207 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:36:41.211 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:36:41.216 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:37:11.376 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:37:11.381 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:37:11.386 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:37:11.390 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:37:11.394 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:37:11.398 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:37:41.563 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:37:41.567 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:37:41.571 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:37:41.575 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:37:41.579 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:37:41.584 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:38:11.757 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:38:11.762 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:38:11.768 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:38:11.772 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:38:11.777 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:38:11.782 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:38:41.937 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:38:41.942 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:38:41.947 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:38:41.950 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:38:41.954 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:38:41.960 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:39:12.125 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:39:12.132 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:39:12.136 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:39:12.140 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:39:12.150 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:39:12.154 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:39:42.319 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:39:42.333 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:39:42.337 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:39:42.341 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:39:42.346 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:39:42.350 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:40:12.505 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:40:12.519 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:40:12.529 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:40:12.541 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:40:12.553 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:40:12.591 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:40:42.708 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:40:42.712 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:40:42.716 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:40:42.721 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:40:42.724 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:40:42.729 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:41:12.892 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:41:12.896 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:41:12.901 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:41:12.905 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:41:12.909 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:41:12.913 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:41:43.067 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:41:43.072 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:41:43.076 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:41:43.080 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:41:43.086 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:41:43.091 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:42:13.245 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:42:13.253 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:42:13.262 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:42:13.269 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:42:13.277 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:42:13.284 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:42:43.427 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:42:43.444 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:42:43.448 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:42:43.452 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:42:43.456 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:42:43.461 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:43:13.630 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:43:13.648 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:43:13.653 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:43:13.657 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:43:13.661 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:43:13.666 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:43:43.799 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:43:43.804 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:43:43.809 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:43:43.813 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:43:43.817 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:43:43.823 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:44:13.985 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:44:13.992 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:44:13.998 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:44:14.004 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:44:14.008 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:44:14.012 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:44:44.171 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:44:44.177 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:44:44.181 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:44:44.185 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:44:44.189 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:44:44.193 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:45:14.358 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:45:14.363 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:45:14.368 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:45:14.372 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:45:14.376 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:45:14.381 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:45:44.521 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:45:44.529 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:45:44.538 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:45:44.554 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:45:44.574 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:45:44.579 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:46:14.695 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:46:14.705 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:46:14.713 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:46:14.717 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:46:14.722 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:46:14.725 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:46:44.896 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:46:44.903 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:46:44.907 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:46:44.915 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:46:44.925 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:46:44.933 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:47:15.062 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:47:15.067 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:47:15.071 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:47:15.075 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:47:15.079 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:47:15.084 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:47:45.388 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:47:45.392 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:47:45.397 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:47:45.401 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:47:45.406 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:47:45.410 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:48:15.596 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:48:15.601 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:48:15.606 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:48:15.611 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:48:15.615 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:48:15.619 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:48:45.784 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:48:45.788 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:48:45.792 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:48:45.796 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:48:45.800 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:48:45.805 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:49:15.971 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:49:15.976 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:49:15.980 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:49:15.985 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:49:15.989 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:49:15.994 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:49:46.176 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:49:46.182 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:49:46.187 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:49:46.193 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:49:46.197 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:49:46.201 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:50:16.361 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:50:16.365 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:50:16.370 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:50:16.377 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:50:16.389 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:50:16.397 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:50:46.588 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:50:46.601 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:50:46.605 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:50:46.610 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:50:46.613 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:50:46.618 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:51:16.774 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:51:16.787 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:51:16.796 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:51:16.805 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:51:16.813 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:51:16.824 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:51:46.980 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:51:46.986 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:51:47.006 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:51:47.011 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:51:47.015 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:51:47.019 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:52:17.185 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:52:17.189 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:52:17.194 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:52:17.198 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:52:17.202 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:52:17.206 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:52:47.371 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:52:47.376 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:52:47.380 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:52:47.385 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:52:47.389 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:52:47.394 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:53:17.567 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:53:17.571 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:53:17.575 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:53:17.579 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:53:17.583 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:53:17.587 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:53:47.754 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:53:47.763 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:53:47.771 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:53:47.778 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:53:47.786 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:53:47.794 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:54:17.958 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:54:17.963 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:54:17.967 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:54:17.977 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:54:17.981 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:54:17.985 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:54:48.119 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:54:48.126 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:54:48.138 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:54:48.146 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:54:48.154 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:54:48.160 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:55:18.299 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:55:18.310 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:55:18.314 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:55:18.318 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:55:18.322 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:55:18.326 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:55:48.520 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:55:48.527 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:55:48.532 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:55:48.537 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:55:48.541 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:55:48.546 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:56:18.732 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:56:18.738 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:56:18.743 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:56:18.747 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:56:18.751 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:56:18.761 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:56:48.900 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:56:48.908 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:56:48.915 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:56:48.923 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:56:48.929 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:56:48.939 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:57:19.157 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:57:19.173 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:57:19.178 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:57:19.182 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:57:19.186 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:57:19.190 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:57:49.350 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:57:49.355 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:57:49.360 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:57:49.367 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:57:49.371 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:57:49.379 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:58:19.562 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:58:19.567 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:58:19.571 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:58:19.574 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:58:19.578 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:58:19.582 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:58:49.729 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:58:49.734 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:58:49.738 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:58:49.743 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:58:49.748 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:58:49.753 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:59:19.902 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:59:19.906 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:59:19.912 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:59:19.916 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:59:19.921 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:59:19.927 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:59:50.083 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:59:50.089 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:59:50.094 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:59:50.099 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:59:50.103 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T16:59:50.108 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:00:20.257 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:00:20.263 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:00:20.268 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:00:20.274 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:00:20.278 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:00:20.283 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:00:50.448 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:00:50.453 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:00:50.457 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:00:50.462 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:00:50.466 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:00:50.470 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:01:20.625 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:01:20.630 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:01:20.634 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:01:20.640 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:01:20.645 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:01:20.651 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:01:50.817 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:01:50.821 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:01:50.826 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:01:50.830 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:01:50.835 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:01:50.839 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:02:21.005 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:02:21.009 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:02:21.013 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:02:21.017 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:02:21.022 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:02:21.026 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:02:51.185 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:03:51.449 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:03:51.478 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:03:51.497 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:03:51.503 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:03:51.507 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:04:21.662 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:04:21.667 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:04:21.671 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:04:21.696 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:04:21.700 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:04:21.705 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:04:51.811 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:04:51.818 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:04:51.823 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:04:51.827 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:04:51.832 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:04:51.837 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:05:21.995 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:05:21.999 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:05:22.004 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:05:22.008 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:05:22.013 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:05:22.022 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:05:52.178 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:05:52.184 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:05:52.205 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:05:52.217 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:05:52.222 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:05:52.233 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:06:22.385 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:06:22.391 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:06:22.395 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:06:22.400 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:06:22.405 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:06:22.411 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:06:52.555 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:06:52.560 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:06:52.565 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:06:52.569 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:06:52.573 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:06:52.577 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:07:22.719 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:07:22.723 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:07:22.727 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:07:22.731 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:07:22.735 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:07:22.740 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:07:52.886 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:07:52.893 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:07:52.897 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:07:52.917 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:07:52.929 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:07:52.934 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:08:23.099 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:08:23.108 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:08:23.116 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:08:23.127 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:08:23.133 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:08:23.143 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:08:53.284 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:08:53.291 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:08:53.295 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:08:53.300 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:08:53.307 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:08:53.316 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:09:23.473 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:09:23.478 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:09:23.482 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:09:23.486 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:09:23.490 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:09:23.495 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:09:53.652 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:09:53.657 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:09:53.661 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:09:53.668 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:09:53.672 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:09:53.677 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:10:23.840 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:10:23.848 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:10:23.853 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:10:23.860 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:10:23.865 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:10:23.870 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:10:54.036 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:10:54.040 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:10:54.045 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:10:54.050 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:10:54.054 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:10:54.060 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:11:24.233 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:11:24.238 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:11:24.242 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:11:24.246 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:11:24.250 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:11:24.254 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:11:54.453 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:11:54.457 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:11:54.462 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:11:54.466 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:11:54.471 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:11:54.475 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:12:24.632 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:12:24.640 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:12:24.644 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:12:24.648 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:12:24.652 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:12:24.656 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:12:54.802 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:12:54.807 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:12:54.811 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:12:54.815 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:12:54.819 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:12:54.824 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:13:24.980 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:13:24.984 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:13:24.988 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:13:24.992 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:13:24.995 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:13:24.999 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:13:55.160 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:13:55.165 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:13:55.169 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:13:55.174 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:13:55.179 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:13:55.184 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:14:25.355 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:14:25.359 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:14:25.363 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:14:25.367 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:14:25.371 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:14:25.375 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:14:55.517 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:14:55.521 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:14:55.526 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:14:55.530 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:14:55.534 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:14:55.539 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:15:25.696 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:15:25.701 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:15:25.705 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:15:25.709 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:15:25.713 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:15:25.717 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:15:55.874 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:15:55.878 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:15:55.883 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:15:55.886 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:15:55.891 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:15:55.895 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:16:26.053 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:16:26.062 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:16:26.068 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:16:26.077 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:16:26.082 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:16:26.087 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:16:56.275 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:16:56.281 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:16:56.285 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:16:56.289 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:16:56.292 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:16:56.297 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:17:26.487 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:17:26.491 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:17:26.495 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:17:26.499 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:17:26.503 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:17:26.507 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:17:56.708 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:17:56.720 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:17:56.729 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:17:56.740 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:17:56.750 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:17:56.765 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:18:26.944 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:18:26.948 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:18:26.954 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:18:26.958 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:18:26.962 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:18:26.966 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:18:57.122 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:18:57.126 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:18:57.131 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:18:57.135 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:18:57.139 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:18:57.144 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:19:27.310 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:19:27.315 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:19:27.319 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:19:27.323 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:19:27.327 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:19:27.331 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:19:57.511 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:19:57.515 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:19:57.519 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:19:57.523 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:19:57.527 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:19:57.531 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:20:27.687 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:20:27.692 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:20:27.698 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:20:27.702 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:20:27.706 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:20:27.712 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:20:57.871 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:20:57.875 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:20:57.879 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:20:57.883 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:20:57.887 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:20:57.891 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:21:28.247 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:21:28.252 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:21:28.256 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:21:28.261 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:21:28.265 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:21:28.269 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:21:58.400 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:21:58.405 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:21:58.409 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:21:58.414 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:21:58.418 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:21:58.422 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:22:28.539 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:22:28.544 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:22:28.548 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:22:28.552 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:22:28.556 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:22:28.560 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:22:58.726 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:22:58.735 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:22:58.740 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:22:58.743 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:22:58.747 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:22:58.751 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:23:28.924 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:23:28.937 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:23:28.965 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:23:28.977 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:23:28.981 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:23:28.986 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:23:59.149 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:23:59.154 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:23:59.159 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:23:59.163 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:23:59.168 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:23:59.173 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:24:29.327 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:24:29.332 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:24:29.349 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:24:29.359 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:24:29.373 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:24:29.380 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:24:59.531 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:24:59.535 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:24:59.539 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:24:59.547 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:24:59.553 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:24:59.559 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:25:29.698 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:25:29.702 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:25:29.706 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:25:29.710 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:25:29.714 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:25:29.718 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:25:59.873 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:25:59.878 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:25:59.882 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:25:59.886 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:25:59.890 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:25:59.895 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:26:30.091 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:26:30.096 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:26:30.101 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:26:30.105 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:26:30.109 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:26:30.113 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:27:00.279 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:27:00.284 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:27:00.291 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:27:00.296 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:27:00.301 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:27:00.308 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:27:30.465 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:27:30.470 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:27:30.474 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:27:30.478 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:27:30.483 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:27:30.488 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:28:00.647 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:28:00.651 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:28:00.656 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:28:00.660 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:28:00.664 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:28:00.668 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:28:30.826 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:28:30.833 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:28:30.839 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:28:30.844 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:28:30.850 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:28:30.856 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:29:01.035 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:29:01.046 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:29:01.057 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:29:01.064 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:29:01.076 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:29:01.084 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:29:31.241 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:29:31.247 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:29:31.257 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:29:31.263 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:29:31.270 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:29:31.277 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:30:01.468 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:30:01.477 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:30:01.483 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:30:01.489 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:30:01.501 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:30:01.517 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:30:31.659 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:30:31.664 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:30:31.668 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:30:31.673 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:30:31.677 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:30:31.681 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:31:01.844 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:31:01.849 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:31:01.854 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:31:01.859 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:31:01.863 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:31:01.868 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:31:32.031 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:31:32.039 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:31:32.045 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:31:32.052 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:31:32.057 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:31:32.064 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:32:02.212 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:32:02.218 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:32:02.222 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:32:02.226 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:32:02.229 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:32:02.234 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:32:32.442 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:32:32.446 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:32:32.450 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:32:32.454 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:32:32.459 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:32:32.463 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:33:02.606 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:33:02.611 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:33:02.615 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:33:02.619 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:33:02.623 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:33:02.628 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:33:32.808 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:33:32.813 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:33:32.817 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:33:32.821 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:33:32.824 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:33:32.829 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:34:02.996 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:34:03.001 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:34:03.008 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:34:03.013 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:34:03.020 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:34:03.025 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:34:33.183 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:34:33.188 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:34:33.193 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:34:33.197 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:34:33.201 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:34:33.205 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:35:03.377 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:35:03.383 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:35:03.387 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:35:03.391 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:35:03.396 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:35:03.402 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:35:33.582 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:35:33.608 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:35:33.616 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:35:33.624 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:35:33.629 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:35:33.634 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:36:03.801 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:36:03.809 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:36:03.813 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:36:03.818 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:36:03.822 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:36:03.827 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:36:33.972 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:36:33.989 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:36:34.002 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:36:34.014 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:36:34.028 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:36:34.039 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:37:04.192 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:37:04.197 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:37:04.201 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:37:04.205 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:37:04.208 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:37:04.214 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:37:34.364 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:37:34.369 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:37:34.377 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:37:34.393 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:37:34.397 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:37:34.401 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:38:04.570 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:38:04.575 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:38:04.579 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:38:04.584 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:38:04.587 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:38:04.592 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:38:34.748 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:38:34.753 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:38:34.757 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:38:34.761 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:38:34.765 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:38:34.772 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:39:04.915 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:39:04.919 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:39:04.923 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:39:04.927 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:39:04.931 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:39:04.936 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:39:35.102 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:39:35.107 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:39:35.111 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:39:35.114 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:39:35.118 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:39:35.122 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:40:05.270 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:40:05.275 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:40:05.281 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:40:05.285 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:40:05.293 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:40:05.299 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:40:35.470 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:40:35.483 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:40:35.487 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:40:35.492 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:40:35.496 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:40:35.500 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:41:05.652 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:41:05.657 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:41:05.661 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:41:05.667 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:41:05.673 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:41:05.679 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:41:35.834 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:41:35.840 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:41:35.845 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:41:35.850 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:41:35.854 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:41:35.878 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:42:06.025 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:42:06.030 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:42:06.034 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:42:06.039 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:42:06.043 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:42:06.047 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:42:36.190 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:42:36.196 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:42:36.200 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:42:36.204 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:42:36.212 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:42:36.218 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:43:06.369 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:43:06.373 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:43:06.377 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:43:06.381 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:43:06.385 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:43:06.389 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:43:36.546 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:43:36.551 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:43:36.556 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:43:36.560 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:43:36.564 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:43:36.569 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:44:06.719 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:44:06.724 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:44:06.729 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:44:06.733 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:44:06.737 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:44:06.741 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:44:36.890 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:44:36.896 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:44:36.901 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:44:36.906 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:44:36.911 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:44:36.916 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:45:07.058 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:45:07.064 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:45:07.069 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:45:07.073 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:45:07.084 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:45:07.090 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:45:37.252 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:45:37.258 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:45:37.262 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:45:37.266 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:45:37.270 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:45:37.275 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:46:07.431 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:46:07.436 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:46:07.440 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:46:07.444 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:46:07.448 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:46:07.453 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:46:37.667 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:46:37.671 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:46:37.675 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:46:37.679 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:46:37.683 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:46:37.687 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:47:07.847 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:47:07.852 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:47:07.856 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:47:07.860 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:47:07.869 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:47:07.873 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:47:38.035 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:47:38.039 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:47:38.044 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:47:38.054 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:47:38.058 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:47:38.063 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:48:08.248 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:48:08.252 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:48:08.256 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:48:08.267 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:48:08.271 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:48:08.276 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:48:38.441 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:48:38.449 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:48:38.454 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:48:38.459 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:48:38.463 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:48:38.468 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:49:08.625 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:49:08.630 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:49:08.634 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:49:08.639 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:49:08.642 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:49:08.647 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:49:38.805 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:49:38.810 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:49:38.815 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:49:38.819 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:49:38.823 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:49:38.828 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:50:08.985 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:50:08.993 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:50:09.000 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:50:09.006 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:50:09.012 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:50:09.017 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:50:39.224 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:50:39.230 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:50:39.235 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:50:39.241 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:50:39.246 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:50:39.252 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:51:09.390 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:51:09.397 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:51:09.406 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:51:09.410 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:51:09.414 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:51:09.419 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:51:39.588 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:51:39.592 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:51:39.596 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:51:39.600 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:51:39.605 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:51:39.628 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:52:09.797 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:52:09.803 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:52:09.808 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:52:09.814 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:52:09.819 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:52:09.824 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:52:39.976 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:52:39.982 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:52:39.987 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:52:39.993 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:52:39.998 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:52:40.005 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:53:10.165 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:53:10.170 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:53:10.174 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:53:10.178 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:53:10.183 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:53:10.187 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:53:40.351 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:53:40.359 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:53:40.364 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:53:40.368 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:53:40.374 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:53:40.383 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:54:10.516 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:54:10.522 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:54:10.528 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:54:10.534 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:54:10.543 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:54:10.554 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:54:40.720 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:54:40.727 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:54:40.731 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:54:40.736 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:54:40.740 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:54:40.744 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:55:10.901 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:55:10.910 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:55:10.915 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:55:10.920 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:55:10.924 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:55:10.928 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:55:41.077 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:55:41.081 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:55:41.086 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:55:41.091 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:55:41.096 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:55:41.101 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:56:11.236 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:56:11.245 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:56:11.255 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:56:11.259 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:56:11.263 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:56:11.268 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:56:41.417 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:56:41.429 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:56:41.434 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:56:41.438 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:56:41.442 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:56:41.447 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:57:11.608 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:57:11.614 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:57:11.618 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:57:11.622 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:57:11.644 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:57:11.654 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:57:41.840 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:57:41.846 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:57:41.850 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:57:41.854 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:57:41.859 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:57:41.863 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:58:11.987 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:58:11.992 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:58:11.997 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:58:12.001 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:58:12.005 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:58:12.009 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:58:42.158 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:58:42.163 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:58:42.169 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:58:42.173 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:58:42.178 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:58:42.183 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:59:12.331 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:59:12.335 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:59:12.339 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:59:12.344 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:59:12.348 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:59:12.352 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:59:42.496 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:59:42.502 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:59:42.506 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:59:42.510 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:59:42.514 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T17:59:42.519 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:00:12.675 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:00:12.681 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:00:12.685 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:00:12.690 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:00:12.694 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:00:12.698 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:00:42.876 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:00:42.889 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:00:42.894 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:00:42.900 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:00:42.905 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:00:42.912 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:01:13.083 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:01:13.088 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:01:13.094 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:01:13.098 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:01:13.102 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:01:13.106 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:01:43.257 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:01:43.263 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:01:43.268 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:01:43.274 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:01:43.278 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:01:43.283 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:02:13.447 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:02:13.457 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:02:13.462 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:02:13.469 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:02:13.477 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:02:13.486 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:02:43.626 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:02:43.631 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:02:43.635 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:02:43.639 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:02:43.642 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:02:43.647 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:03:13.789 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:03:13.795 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:03:13.802 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:03:13.808 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:03:13.815 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:03:13.855 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:03:44.050 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:03:44.060 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:03:44.071 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:03:44.081 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:03:44.089 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:03:44.094 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:04:14.257 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:04:14.262 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:04:14.266 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:04:14.269 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:04:14.273 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:04:14.278 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:04:44.444 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:04:44.449 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:04:44.469 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:04:44.474 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:04:44.480 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:04:44.484 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:05:14.652 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:05:14.657 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:05:14.661 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:05:14.665 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:05:14.670 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:05:14.676 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:05:44.841 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:05:44.846 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:05:44.850 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:05:44.854 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:05:44.858 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:05:44.862 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:06:15.010 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:06:32.682 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:06:32.694 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:06:32.713 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:06:32.733 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:06:32.755 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:07:02.886 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:07:02.891 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:07:02.897 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:07:02.901 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:07:02.906 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:07:02.910 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:07:33.067 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:07:33.071 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:07:33.075 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:07:33.079 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:07:33.084 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:07:33.088 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:08:03.245 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:08:03.250 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:08:03.256 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:08:03.261 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:08:03.266 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:08:03.270 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:08:33.439 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:08:33.876 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:08:33.880 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:08:33.885 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:08:33.890 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:08:33.895 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:09:04.048 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:09:04.053 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:09:04.060 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:09:04.066 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:09:04.071 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:09:04.079 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:09:34.220 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:09:34.224 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:09:34.229 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:09:34.232 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:09:34.236 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:09:34.240 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:10:04.382 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:10:04.388 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:10:04.393 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:10:04.399 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:10:04.404 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:10:04.409 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:10:34.561 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:10:34.601 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:10:34.615 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:10:34.630 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:10:34.654 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:10:34.669 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:11:04.798 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:11:04.803 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:11:04.807 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:11:04.811 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:11:04.815 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:11:04.820 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:11:34.997 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:11:35.002 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:11:35.007 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:11:35.011 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:11:35.015 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:11:35.019 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:12:05.163 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:12:05.168 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:12:05.172 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:12:05.176 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:12:05.180 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:12:05.185 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:12:35.348 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:12:35.353 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:12:35.357 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:12:35.361 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:12:35.365 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:12:35.370 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:13:05.517 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:13:05.531 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:13:05.541 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:13:05.545 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:13:05.549 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:13:05.557 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:13:35.692 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:13:35.697 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:13:35.702 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:13:35.706 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:13:35.711 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:13:35.724 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:14:05.859 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:14:05.863 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:14:05.869 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:14:05.873 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:14:05.877 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:14:05.881 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:14:36.040 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:14:36.045 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:14:36.052 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:14:36.058 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:14:36.062 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:14:36.068 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:15:06.235 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:15:06.240 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:15:06.245 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:15:06.249 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:15:06.253 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:15:06.257 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:15:36.529 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:15:36.542 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:15:36.554 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:15:36.566 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:15:36.580 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:15:36.594 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:16:06.738 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:16:06.743 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:16:06.747 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:16:06.751 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:16:06.755 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:16:06.759 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:16:36.904 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:16:36.908 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:16:36.912 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:16:36.916 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:16:36.922 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:16:36.926 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:17:07.082 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:17:07.087 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:17:07.091 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:17:07.094 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:17:07.098 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:17:07.102 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:17:37.279 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:17:37.283 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:17:37.287 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:17:37.291 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:17:37.295 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:17:37.300 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:18:07.448 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:18:07.453 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:18:07.457 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:18:07.461 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:18:07.465 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:18:07.469 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:18:37.618 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:18:37.623 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:18:37.627 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:18:37.631 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:18:37.635 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:18:37.638 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:19:07.789 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:19:07.797 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:19:07.802 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:19:07.805 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:19:07.809 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:19:07.813 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:19:37.983 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:19:37.989 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:19:37.993 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:19:37.998 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:19:38.002 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:19:38.006 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:20:08.174 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:20:08.182 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:20:08.190 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:20:08.202 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:20:08.211 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:20:08.233 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:20:38.408 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:20:38.414 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:20:38.428 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:20:38.433 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:20:38.439 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:20:38.444 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:21:08.630 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:21:08.638 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:21:08.652 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:21:08.660 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:21:08.665 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:21:08.685 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:21:38.827 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:21:38.832 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:21:38.836 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:21:38.842 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:21:38.846 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:21:38.850 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:22:09.033 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:22:09.038 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:22:09.043 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:22:09.047 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:22:09.052 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:22:09.057 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:22:39.215 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:22:39.222 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:22:39.228 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:22:39.232 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:22:39.236 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:22:39.241 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:23:09.396 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:23:09.401 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:23:09.405 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:23:09.409 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:23:09.413 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:23:09.417 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:23:39.613 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:23:39.641 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:23:39.653 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:23:39.688 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:23:39.694 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:23:39.708 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:24:09.851 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:24:09.857 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:24:09.862 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:24:09.869 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:24:09.874 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:24:09.880 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:24:40.096 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:24:40.107 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:24:40.111 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:24:40.115 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:24:40.119 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:24:40.123 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:25:10.282 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:25:10.286 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:25:10.290 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:25:10.295 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:25:10.299 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:25:10.304 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:25:40.473 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:25:40.477 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:25:40.482 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:25:40.485 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:25:40.490 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:25:40.494 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:26:10.660 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:26:10.664 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:26:10.669 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:26:10.674 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:26:10.678 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:26:10.684 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:26:40.826 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:26:40.831 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:26:40.835 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:26:40.839 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:26:40.843 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:26:40.847 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:27:11.002 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:27:11.007 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:27:11.012 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:27:11.015 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:27:11.020 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:27:11.027 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:27:41.167 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:27:41.173 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:27:41.177 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:27:41.181 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:27:41.185 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:27:41.189 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:28:11.346 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:28:11.351 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:28:11.355 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:28:11.359 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:28:11.363 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:28:11.368 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:28:41.558 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:28:41.562 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:28:41.566 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:28:41.570 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:28:41.574 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:28:41.580 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:29:11.729 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:29:11.733 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:29:11.737 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:29:11.742 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:29:11.745 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:29:11.750 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:29:41.940 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:29:41.944 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:29:41.949 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:29:41.953 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:29:41.957 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:29:41.961 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:30:12.114 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:30:12.120 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:30:12.125 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:30:12.132 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:30:12.136 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:30:12.141 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:30:42.303 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:30:42.307 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:30:42.311 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:30:42.315 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:30:42.320 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:30:42.324 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:31:12.478 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:31:12.490 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:31:12.496 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:31:12.501 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:31:12.505 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:31:12.510 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:31:42.671 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:31:42.675 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:31:42.680 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:31:42.684 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:31:42.689 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:31:42.693 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:32:12.851 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:32:12.855 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:32:12.859 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:32:12.863 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:32:12.867 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:32:12.871 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:32:43.020 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:32:43.026 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:32:43.034 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:32:43.055 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:32:43.060 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:32:43.064 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:33:13.207 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:33:13.212 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:33:13.219 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:33:13.224 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:33:13.228 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:33:13.233 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:33:43.388 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:33:43.393 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:33:43.398 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:33:43.402 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:33:43.406 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:33:43.410 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:34:13.557 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:34:13.564 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:34:13.573 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:34:13.577 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:34:13.582 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:34:13.587 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:34:43.736 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:34:43.740 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:34:43.749 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:34:43.755 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:34:43.762 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:34:43.770 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:35:13.931 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:35:13.936 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:35:13.941 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:35:13.946 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:35:13.950 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:35:13.955 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:35:44.109 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:35:44.114 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:35:44.119 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:35:44.124 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:35:44.128 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:35:44.134 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:36:14.300 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:36:14.307 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:36:14.317 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:36:14.331 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:36:14.338 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:36:14.343 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:36:44.502 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:36:44.506 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:36:44.510 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:36:44.515 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:36:44.519 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:36:44.523 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:37:14.689 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:37:14.694 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:37:14.698 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:37:14.702 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:37:14.706 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:37:14.710 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:37:44.862 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:37:44.868 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:37:44.873 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:37:44.882 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:37:44.886 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:37:44.891 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:38:15.061 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:38:15.082 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:38:15.087 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:38:15.092 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:38:15.098 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:38:15.108 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:38:45.260 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:38:45.265 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:38:45.269 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:38:45.275 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:38:45.279 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:38:45.285 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:39:15.429 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:39:15.438 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:39:15.444 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:39:15.449 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:39:15.454 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:39:15.459 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:39:45.615 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:39:45.619 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:39:45.623 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:39:45.628 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:39:45.631 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:39:45.636 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:40:15.812 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:40:15.819 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:40:15.826 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:40:15.834 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:40:15.839 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:40:15.845 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:40:46.024 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:40:46.029 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:40:46.037 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:40:46.041 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:40:46.046 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:40:46.051 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:41:16.259 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:41:16.264 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:41:16.269 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:41:16.276 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:41:16.280 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:41:16.284 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:41:46.432 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:41:46.437 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:41:46.442 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:41:46.445 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:41:46.450 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:41:46.454 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:42:16.570 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:42:16.575 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:42:16.579 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:42:16.583 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:42:16.587 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:42:16.591 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:42:46.743 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:42:46.748 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:42:46.752 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:42:46.756 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:42:46.760 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:42:46.772 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:43:16.915 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:43:16.919 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:43:16.924 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:43:16.928 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:43:16.932 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:43:16.936 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:43:47.110 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:43:47.116 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:43:47.120 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:43:47.124 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:43:47.128 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:43:47.132 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:44:17.282 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:44:17.287 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:44:17.292 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:44:17.302 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:44:17.306 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:44:17.310 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:44:47.451 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:44:47.456 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:44:47.460 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:44:47.464 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:44:47.468 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:44:47.473 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:45:17.629 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:45:17.634 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:45:17.638 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:45:17.642 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:45:17.647 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:45:17.652 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:45:47.817 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:45:47.821 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:45:47.825 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:45:47.829 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:45:47.833 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:45:47.837 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:46:18.002 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:46:18.007 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:46:18.012 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:46:18.016 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:46:18.020 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:46:18.025 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:46:48.165 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:46:48.170 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:46:48.174 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:46:48.178 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:46:48.183 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:46:48.187 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:47:18.329 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:47:18.333 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:47:18.338 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:47:18.341 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:47:18.345 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:47:18.354 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:47:48.499 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:47:48.504 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:47:48.510 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:47:48.513 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:47:48.517 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:47:48.522 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:48:18.679 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:48:18.683 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:48:18.688 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:48:18.691 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:48:18.695 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:48:18.699 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:48:48.888 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:48:48.892 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:48:48.897 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:48:48.901 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:48:48.905 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:48:48.909 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:49:19.061 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:49:19.066 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:49:19.071 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:49:19.074 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:49:19.078 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:49:19.083 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:49:49.254 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:49:49.258 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:49:49.262 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:49:49.266 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:49:49.270 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:49:49.275 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:50:19.432 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:50:19.437 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:50:19.443 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:50:19.449 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:50:19.454 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:50:19.460 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:50:49.653 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:50:49.658 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:50:49.662 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:50:49.667 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:50:49.671 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:50:49.675 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:51:19.841 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:51:19.845 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:51:19.849 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:51:19.853 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:51:19.857 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:51:19.862 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:51:50.030 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:51:50.035 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:51:50.039 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:51:50.043 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:51:50.047 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:51:50.052 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:52:20.194 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:52:20.199 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:52:20.204 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:52:20.208 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:52:20.212 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:52:20.216 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:52:50.368 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:52:50.381 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:52:50.390 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:52:50.395 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:52:50.399 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:52:50.403 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:53:20.562 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:53:20.567 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:53:20.571 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:53:20.575 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:53:20.579 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:53:20.583 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:53:50.741 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:53:50.746 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:53:50.751 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:53:50.754 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:53:50.758 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:53:50.762 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:54:20.935 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:54:20.940 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:54:20.944 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:54:20.948 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:54:20.952 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:54:20.956 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:54:51.109 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:54:51.114 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:54:51.118 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:54:51.123 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:54:51.127 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:54:51.133 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:55:21.286 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:55:21.291 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:55:21.295 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:55:21.299 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:55:21.303 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:55:21.307 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:55:51.472 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:55:51.477 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:55:51.482 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:55:51.486 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:55:51.490 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:55:51.495 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:56:21.659 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:56:21.663 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:56:21.668 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:56:21.672 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:56:21.677 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:56:21.681 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:56:51.832 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:56:51.837 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:56:51.841 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:56:51.845 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:56:51.849 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:56:51.854 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:57:22.017 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:57:22.022 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:57:22.026 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:57:22.030 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:57:22.033 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:57:22.037 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:57:52.195 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:57:52.199 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:57:52.203 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:57:52.208 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:57:52.212 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:57:52.217 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:58:22.374 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:58:22.388 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:58:22.393 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:58:22.397 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:58:22.401 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:58:22.405 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:58:52.560 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:58:52.565 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:58:52.569 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:58:52.574 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:58:52.577 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:58:52.583 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:59:22.759 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:59:22.763 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:59:22.767 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:59:22.771 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:59:22.775 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:59:22.780 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:59:52.941 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:59:52.948 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:59:52.954 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:59:52.959 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:59:52.965 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T18:59:52.970 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:00:23.140 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:00:23.145 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:00:23.150 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:00:23.155 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:00:23.161 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:00:23.168 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:00:53.313 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:00:53.318 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:00:53.322 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:00:53.326 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:00:53.330 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:00:53.335 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:01:23.484 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:01:23.488 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:01:23.493 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:01:23.498 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:01:23.504 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:01:23.509 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:01:53.667 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:01:53.671 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:01:53.675 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:01:53.679 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:01:53.684 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:01:53.688 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:02:23.846 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:02:23.850 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:02:23.855 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:02:23.860 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:02:23.864 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:02:23.868 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:02:54.021 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:02:54.026 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:02:54.030 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:02:54.034 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:02:54.038 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:02:54.043 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:03:24.203 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:03:24.208 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:03:24.218 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:03:24.224 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:03:24.230 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:03:24.236 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:03:54.389 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:03:54.394 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:03:54.398 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:03:54.402 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:03:54.406 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:03:54.412 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:04:24.568 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:04:24.573 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:04:24.578 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:04:24.581 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:04:24.585 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:04:24.590 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:04:54.785 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:04:54.790 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:04:54.795 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:04:54.799 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:04:54.803 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:04:54.808 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:05:24.990 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:05:24.995 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:05:25.000 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:05:25.005 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:05:25.010 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:05:25.015 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:05:55.187 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:05:55.191 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:05:55.195 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:05:55.199 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:05:55.203 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:05:55.208 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:06:25.400 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:06:25.405 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:06:25.409 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:06:25.413 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:06:25.417 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:06:25.421 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:06:55.608 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:06:55.613 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:06:55.617 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:06:55.621 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:06:55.625 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:06:55.630 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:07:25.799 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:07:25.803 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:07:25.807 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:07:25.811 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:07:25.815 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:07:25.820 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:07:55.977 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:07:58.803 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:07:58.810 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:07:58.816 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:07:58.832 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:07:58.853 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:08:29.002 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:08:29.008 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:08:29.012 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:08:29.016 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:08:29.021 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:08:29.029 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:08:59.168 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:08:59.172 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:08:59.177 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:08:59.181 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:08:59.185 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:08:59.189 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:09:29.348 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:09:29.355 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:09:29.360 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:09:29.364 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:09:29.369 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:09:29.374 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:09:59.558 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:09:59.563 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:09:59.567 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:09:59.571 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:09:59.574 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:09:59.578 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:10:29.727 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:10:29.733 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:10:29.738 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:10:29.743 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:10:29.748 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:10:29.752 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:10:59.907 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:10:59.912 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:10:59.916 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:10:59.920 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:10:59.924 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:10:59.929 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:11:30.087 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:11:30.092 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:11:30.098 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:11:30.102 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:11:30.106 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:11:30.111 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:12:00.260 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:12:00.264 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:12:00.268 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:12:00.273 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:12:00.277 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:12:00.283 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:12:30.439 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:12:30.444 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:12:30.448 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:12:30.452 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:12:30.456 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:12:30.460 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:13:00.646 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:13:00.652 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:13:00.657 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:13:00.663 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:13:00.669 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:13:00.675 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:13:30.833 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:13:30.841 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:13:30.846 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:13:30.850 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:13:30.854 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:13:30.859 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:14:01.009 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:14:01.014 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:14:01.018 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:14:01.022 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:14:01.026 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:14:01.030 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:14:31.180 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:14:31.184 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:14:31.188 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:14:31.192 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:14:31.197 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:14:31.203 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:15:01.369 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:15:01.373 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:15:01.377 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:15:01.381 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:15:01.388 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:15:01.393 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:15:31.565 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:15:31.569 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:15:31.573 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:15:31.577 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:15:31.581 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:15:31.585 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:16:01.725 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:16:01.729 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:16:01.734 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:16:01.738 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:16:01.742 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:16:01.746 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:16:31.921 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:16:31.925 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:16:31.929 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:16:31.933 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:16:31.937 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:16:31.942 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:17:02.083 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:17:02.088 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:17:02.092 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:17:02.096 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:17:02.100 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:17:02.104 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:17:32.260 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:17:32.265 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:17:32.269 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:17:32.272 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:17:32.278 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:17:32.282 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:18:02.440 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:18:02.444 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:18:02.448 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:18:02.452 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:18:02.456 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:18:02.460 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:18:32.602 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:18:32.606 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:18:32.611 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:18:32.615 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:18:32.619 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:18:32.624 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:19:02.774 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:19:02.778 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:19:02.783 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:19:02.787 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:19:02.791 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:19:02.795 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:19:32.941 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:19:32.946 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:19:32.950 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:19:32.954 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:19:32.958 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:19:32.962 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:20:03.108 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:20:03.112 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:20:03.116 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:20:03.121 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:20:03.125 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:20:03.132 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:20:33.311 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:20:33.315 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:20:33.319 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:20:33.323 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:20:33.327 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:20:33.331 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:21:03.468 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:21:03.473 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:21:03.477 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:21:03.483 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:21:03.487 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:21:03.505 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:21:33.653 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:21:33.658 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:21:33.662 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:21:33.666 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:21:33.670 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:21:33.674 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:22:03.830 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:22:03.856 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:22:03.895 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:22:03.927 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:22:03.952 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:22:03.976 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:22:34.146 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:22:34.169 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:22:34.182 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:22:34.188 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:22:34.193 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:22:34.197 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:23:04.369 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:23:04.378 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:23:04.391 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:23:04.399 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:23:04.408 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:23:04.418 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:23:34.583 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:23:34.588 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:23:34.592 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:23:34.596 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:23:34.600 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:23:34.605 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:24:04.761 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:24:04.766 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:24:04.769 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:24:04.774 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:24:04.779 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:24:04.783 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:24:35.094 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:24:35.098 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:24:35.103 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:24:35.108 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:24:35.112 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:24:35.116 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:25:05.325 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:25:05.330 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:25:05.334 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:25:05.338 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:25:05.342 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:25:05.347 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:25:35.521 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:25:35.526 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:25:35.530 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:25:35.534 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:25:35.537 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:25:35.542 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:26:05.743 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:26:05.749 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:26:05.754 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:26:05.757 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:26:05.761 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:26:05.765 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:26:35.957 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:26:35.962 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:26:35.967 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:26:35.972 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:26:35.977 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:26:35.983 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:27:06.195 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:27:06.200 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:27:06.204 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:27:06.208 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:27:06.212 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:27:06.216 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:27:36.425 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:27:36.435 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:27:36.440 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:27:36.445 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:27:36.449 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:27:36.453 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:28:06.603 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:28:06.608 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:28:06.612 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:28:06.616 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:28:06.620 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:28:06.625 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:28:36.777 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:29:28.097 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:29:28.107 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:29:28.117 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:29:28.132 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:29:28.142 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:29:58.420 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:29:58.448 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:29:58.477 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:29:58.496 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:29:58.516 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:29:58.546 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:30:28.637 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:30:28.649 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:30:28.657 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:30:28.663 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:30:28.667 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:30:28.676 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:30:58.856 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:30:58.865 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:30:58.869 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:30:58.874 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:30:58.877 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:30:58.882 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:31:29.054 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:31:29.058 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:31:29.062 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:31:29.067 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:31:29.071 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:31:29.075 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:31:59.229 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:31:59.234 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:31:59.246 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:31:59.250 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:31:59.254 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:31:59.259 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:32:29.392 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:32:29.397 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:32:29.401 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:32:29.405 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:32:29.409 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:32:29.413 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:32:59.576 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:32:59.581 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:32:59.585 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:32:59.589 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:32:59.594 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:32:59.598 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:33:29.741 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:33:29.746 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:33:29.750 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:33:29.753 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:33:29.757 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:33:29.762 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:33:59.913 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:33:59.918 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:33:59.924 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:33:59.929 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:33:59.933 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:33:59.937 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:34:30.082 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:34:30.086 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:34:30.091 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:34:30.094 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:34:30.098 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:34:30.102 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:35:00.262 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:35:00.267 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:35:00.274 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:35:00.278 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:35:00.282 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:35:00.286 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:35:30.452 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:35:30.457 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:35:30.465 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:35:30.469 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:35:30.474 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:35:30.478 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:36:00.609 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:36:00.622 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:36:00.627 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:36:00.631 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:36:00.635 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:36:00.639 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:36:30.804 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:36:30.809 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:36:30.814 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:36:30.818 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:36:30.822 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:36:30.826 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:37:00.983 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:37:00.987 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:37:00.992 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:37:00.996 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:37:01.000 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:37:01.004 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:37:31.153 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:37:31.158 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:37:31.162 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:37:31.166 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:37:31.170 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:37:31.175 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:38:01.355 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:38:01.360 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:38:01.365 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:38:01.369 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:38:01.374 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:38:01.378 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:38:31.537 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:38:31.542 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:38:31.546 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:38:31.553 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:38:31.558 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:38:31.563 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:39:01.732 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:39:01.736 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:39:01.740 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:39:01.744 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:39:01.748 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:39:01.753 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:39:31.913 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:39:31.919 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:39:31.924 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:39:31.927 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:39:31.931 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:39:31.935 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:40:02.094 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:40:02.099 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:40:02.109 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:40:02.114 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:40:02.118 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:40:02.122 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:40:32.273 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:40:32.278 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:40:32.282 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:40:32.286 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:40:32.290 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:40:32.294 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:41:02.469 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:41:02.474 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:41:02.479 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:41:02.483 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:41:02.488 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:41:02.493 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:41:32.657 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:41:32.661 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:41:32.666 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:41:32.680 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:41:32.685 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:41:32.692 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:42:02.836 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:42:02.840 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:42:02.845 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:42:02.849 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:42:02.853 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:42:02.857 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:42:33.225 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:42:33.229 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:42:33.234 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:42:33.238 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:42:33.242 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:42:33.246 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:43:03.401 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:43:03.417 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:43:03.425 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:43:03.433 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:43:03.437 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:43:03.442 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:43:33.596 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:43:33.602 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:43:33.606 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:43:33.610 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:43:33.615 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:43:33.620 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:44:03.768 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:44:03.892 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:44:03.897 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:44:03.902 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:44:03.907 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:44:03.912 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:44:34.064 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:44:34.069 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:44:34.073 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:44:34.076 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:44:34.080 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:44:34.085 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:45:04.241 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:45:04.247 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:45:04.251 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:45:04.274 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:45:04.279 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:45:04.283 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:45:34.459 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:45:34.463 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:45:34.468 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:45:34.471 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:45:34.475 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:45:34.480 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:46:04.656 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:46:04.661 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:46:04.665 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:46:04.669 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:46:04.673 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:46:04.677 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:46:34.853 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:46:34.858 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:46:34.863 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:46:34.866 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:46:34.871 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:46:34.877 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:47:04.959 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:47:04.964 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:47:04.969 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:47:04.973 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:47:04.977 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:47:04.981 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:47:35.082 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:47:35.086 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:47:35.090 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:47:35.094 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:47:35.098 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:47:35.102 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:48:05.253 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:48:05.258 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:48:05.261 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:48:05.265 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:48:05.268 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:48:05.272 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:48:35.441 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:48:35.478 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:48:35.506 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:48:35.521 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:48:35.544 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:48:35.556 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:49:05.703 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:49:05.708 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:49:05.712 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:49:05.716 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:49:05.720 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:49:05.724 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:49:35.894 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:49:35.901 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:49:35.906 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:49:35.910 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:49:35.914 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:49:35.918 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:50:06.059 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:50:06.065 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:50:06.070 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:50:06.075 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:50:06.080 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:50:06.084 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:50:36.247 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:50:36.252 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:50:36.257 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:50:36.261 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:50:36.265 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:50:36.270 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:51:06.650 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:51:06.658 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:51:06.663 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:51:06.667 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:51:06.671 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:51:06.675 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:51:36.829 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:51:36.834 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:51:36.838 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:51:36.843 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:51:36.846 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:51:36.851 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:52:07.009 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:52:07.014 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:52:07.018 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:52:07.023 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:52:07.026 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:52:07.031 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:52:37.177 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:52:37.182 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:52:37.186 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:52:37.190 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:52:37.195 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:52:37.199 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:53:07.356 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:53:07.362 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:53:07.366 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:53:07.371 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:53:07.375 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:53:07.380 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:53:37.526 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:53:37.531 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:53:37.536 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:53:37.539 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:53:37.543 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:53:37.547 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:54:07.705 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:54:07.709 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:54:07.713 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:54:07.717 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:54:07.721 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:54:07.725 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:54:37.884 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:54:37.889 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:54:37.893 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:54:37.897 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:54:37.901 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:54:37.906 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:55:08.071 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:55:08.076 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:55:08.080 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:55:08.084 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:55:08.088 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:55:08.093 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:55:38.259 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:55:38.264 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:55:38.269 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:55:38.273 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:55:38.277 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:55:38.281 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:56:08.425 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:56:08.439 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:56:08.448 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:56:08.459 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:56:08.463 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:56:08.467 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:56:38.617 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:56:38.627 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:56:38.635 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:56:38.642 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:56:38.647 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:56:38.655 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:57:08.801 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:57:08.806 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:57:08.810 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:57:08.814 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:57:08.818 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:57:08.830 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:57:38.979 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:57:38.985 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:57:38.994 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:57:38.997 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:57:39.001 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:57:39.006 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:58:09.159 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:58:09.163 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:58:09.168 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:58:09.172 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:58:09.176 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:58:09.181 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:58:39.321 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:58:39.325 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:58:39.330 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:58:39.334 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:58:39.338 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:58:39.342 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:59:09.514 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:59:09.521 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:59:09.526 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:59:09.530 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:59:09.534 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:59:09.538 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:59:39.709 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:59:39.713 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:59:39.718 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:59:39.722 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:59:39.727 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T19:59:39.731 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:00:09.881 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:00:09.886 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:00:09.892 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:00:09.897 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:00:09.901 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:00:09.906 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:00:40.076 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:01:02.222 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:01:02.273 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:01:02.293 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:01:02.312 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:01:02.333 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:01:32.521 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:01:32.525 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:01:32.530 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:01:32.535 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:01:32.540 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:01:32.545 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:02:02.706 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:02:02.723 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:02:02.738 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:02:02.752 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:02:02.763 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:02:02.772 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:02:32.938 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:02:32.945 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:02:32.950 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:02:32.953 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:02:32.961 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:02:32.966 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:03:03.133 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:03:03.166 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:03:03.201 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:03:03.236 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:03:03.266 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:03:03.283 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:03:33.410 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:03:33.415 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:03:33.419 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:03:33.423 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:03:33.427 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:03:33.432 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:04:03.578 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:04:03.584 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:04:03.588 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:04:03.592 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:04:03.598 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:04:03.602 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:04:33.749 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:04:33.753 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:04:33.758 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:04:33.761 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:04:33.766 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:04:33.770 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:05:03.926 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:05:03.930 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:05:03.934 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:05:03.939 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:05:03.943 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:05:03.947 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:05:34.122 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:05:34.127 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:05:34.131 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:05:34.134 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:05:34.138 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:05:34.143 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:06:04.300 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:06:04.305 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:06:04.308 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:06:04.313 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:06:04.317 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:06:04.321 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:06:34.479 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:06:34.483 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:06:34.487 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:06:34.491 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:06:34.495 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:06:34.499 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:07:04.648 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:07:11.417 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:07:11.425 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:07:11.430 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:07:11.434 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:07:11.446 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:07:41.595 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:07:41.603 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:07:41.607 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:07:41.611 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:07:41.615 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:07:41.620 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:08:11.788 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:08:11.793 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:08:11.798 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:08:11.807 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:08:11.830 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:08:11.834 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:08:41.989 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:08:41.994 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:08:41.998 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:08:42.011 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:08:42.033 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:08:42.037 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:09:12.192 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:09:12.196 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:09:12.202 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:09:12.209 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:09:12.214 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:09:12.221 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:09:42.374 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:09:42.379 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:09:42.384 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:09:42.388 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:09:42.392 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:09:42.397 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:10:12.570 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:10:12.575 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:10:12.580 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:10:12.585 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:10:12.591 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:10:12.596 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:10:42.757 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:10:42.762 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:10:42.767 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:10:42.771 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:10:42.775 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:10:42.780 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:11:13.143 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:11:13.147 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:11:13.153 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:11:13.157 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:11:13.162 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:11:13.166 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:11:43.339 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:11:43.344 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:11:43.349 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:11:43.353 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:11:43.357 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:11:43.361 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:12:13.509 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:12:23.422 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:12:23.434 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:12:23.460 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:12:23.468 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:12:23.488 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:12:53.663 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:12:53.674 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:12:53.686 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:12:53.694 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:12:53.703 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:12:53.714 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:13:23.799 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:13:23.804 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:13:23.808 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:13:23.813 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:13:23.818 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:13:23.822 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:13:53.985 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:13:53.989 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:13:53.993 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:13:53.997 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:13:54.000 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:13:54.005 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:14:24.176 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:14:24.185 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:14:24.191 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:14:24.195 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:14:24.207 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:14:24.211 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:14:54.376 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:14:54.381 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:14:54.386 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:14:54.402 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:14:54.407 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:14:54.413 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:15:24.554 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:15:24.559 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:15:24.563 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:15:24.581 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:15:24.585 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:15:24.589 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:15:54.743 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:15:54.748 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:15:54.752 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:15:54.756 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:15:54.762 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:15:54.766 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:16:24.988 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:16:25.012 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:16:25.045 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:16:25.066 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:16:25.077 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:16:25.093 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:16:55.249 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:16:55.256 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:16:55.262 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:16:55.275 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:16:55.284 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:16:55.293 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:17:25.441 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:17:25.446 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:17:25.450 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:17:25.454 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:17:25.459 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:17:25.464 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:17:55.631 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:17:55.636 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:17:55.642 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:17:55.648 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:17:55.656 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:17:55.664 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:18:25.828 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:18:25.839 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:18:25.844 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:18:25.848 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:18:25.852 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:18:25.856 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:18:56.057 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:18:56.063 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:18:56.067 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:18:56.072 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:18:56.076 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:18:56.081 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:19:26.261 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:19:26.265 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:19:26.269 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:19:26.273 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:19:26.277 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:19:26.281 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:19:56.433 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:19:56.441 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:19:56.446 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:19:56.451 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:19:56.455 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:19:56.460 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:20:26.621 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:20:26.626 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:20:26.631 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:20:26.637 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:20:26.641 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:20:26.646 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:20:56.865 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:20:56.878 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:20:56.885 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:20:56.897 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:20:56.904 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:20:56.912 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:21:27.065 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:21:27.074 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:21:27.087 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:21:27.092 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:21:27.100 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:21:27.108 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:21:57.259 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:21:57.265 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:21:57.269 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:21:57.273 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:21:57.278 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:21:57.282 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:22:27.464 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:22:27.471 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:22:27.476 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:22:27.480 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:22:27.484 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:22:27.489 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:22:57.643 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:22:57.648 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:22:57.652 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:22:57.656 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:22:57.659 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:22:57.664 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:23:27.803 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:23:27.815 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:23:27.819 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:23:27.823 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:23:27.828 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:23:27.832 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:23:57.988 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:23:57.993 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:23:57.997 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:23:58.001 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:23:58.011 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:23:58.020 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:24:28.178 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:24:28.185 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:24:28.190 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:24:28.197 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:24:28.204 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:24:28.212 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:24:58.371 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:24:58.390 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:24:58.395 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:24:58.399 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:24:58.404 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:24:58.409 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:25:28.569 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:25:28.576 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:25:28.581 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:25:28.586 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:25:28.590 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:25:28.594 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:25:58.741 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:25:58.746 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:25:58.750 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:25:58.754 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:25:58.758 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:25:58.762 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:26:28.944 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:26:28.955 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:26:28.959 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:26:28.965 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:26:28.969 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:26:28.973 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:26:59.109 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:26:59.113 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:26:59.118 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:26:59.122 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:26:59.126 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:26:59.131 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:27:29.292 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:27:29.296 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:27:29.300 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:27:29.304 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:27:29.308 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:27:29.312 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:27:59.475 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:27:59.482 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:27:59.486 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:27:59.490 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:27:59.494 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:27:59.498 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:28:29.665 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:28:29.671 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:28:29.675 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:28:29.679 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:28:29.683 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:28:29.688 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:28:59.837 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:28:59.842 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:28:59.846 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:28:59.851 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:28:59.855 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:28:59.865 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:29:30.008 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:29:30.013 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:29:30.018 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:29:30.023 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:29:30.028 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:29:30.034 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:30:00.200 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:30:00.207 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:30:00.212 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:30:00.216 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:30:00.221 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:30:00.226 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:30:30.376 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:30:30.382 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:30:30.386 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:30:30.393 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:30:30.397 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:30:30.402 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:31:00.568 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:31:00.573 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:31:00.578 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:31:00.583 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:31:00.587 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:31:00.591 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:31:30.761 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:31:30.771 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:31:30.783 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:31:30.786 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:31:30.790 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:31:30.795 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:32:00.957 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:32:00.962 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:32:00.973 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:32:00.977 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:32:00.980 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:32:00.985 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:32:31.138 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:32:31.143 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:32:31.147 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:32:31.151 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:32:31.156 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:32:31.160 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:33:01.308 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:33:01.313 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:33:01.318 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:33:01.322 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:33:01.326 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:33:01.331 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:33:31.500 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:33:31.519 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:33:31.547 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:33:31.562 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:33:31.572 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:33:31.587 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:34:01.729 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:34:01.734 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:34:01.739 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:34:01.744 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:34:01.749 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:34:01.756 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:34:31.908 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:34:31.912 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:34:31.916 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:34:31.921 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:34:31.924 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:34:31.929 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:35:02.087 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:35:02.094 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:35:02.099 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:35:02.103 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:35:02.108 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:35:02.112 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:35:32.286 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:35:32.290 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:35:32.296 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:35:32.300 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:35:32.306 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:35:32.310 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:36:02.465 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:36:02.473 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:36:02.477 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:36:02.481 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:36:02.485 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:36:02.494 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:36:32.648 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:36:32.653 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:36:32.657 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:36:32.661 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:36:32.665 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:36:32.669 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:37:02.836 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:37:02.842 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:37:02.846 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:37:02.850 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:37:02.854 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:37:02.858 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:37:33.005 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:37:57.255 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:37:57.260 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:37:57.265 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:37:57.271 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:37:57.276 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:38:27.411 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:38:27.421 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:38:27.428 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:38:27.435 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:38:27.442 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:38:27.453 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:38:57.591 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:38:57.596 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:38:57.600 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:38:57.604 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:38:57.607 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:38:57.612 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:39:27.761 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:39:27.766 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:39:27.770 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:39:27.773 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:39:27.777 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:39:27.781 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:39:57.931 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:39:57.936 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:39:57.941 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:39:57.945 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:39:57.948 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:39:57.953 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:40:28.123 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:40:28.129 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:40:28.134 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:40:28.139 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:40:28.144 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:40:28.150 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:40:58.298 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:40:58.304 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:40:58.308 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:40:58.312 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:40:58.316 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:40:58.326 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:41:28.485 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:41:28.491 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:41:28.496 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:41:28.502 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:41:28.506 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:41:28.512 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:41:58.680 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:41:58.685 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:41:58.690 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:41:58.694 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:41:58.698 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:41:58.703 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:42:28.892 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:42:28.905 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:42:28.913 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:42:28.917 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:42:28.922 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:42:28.926 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:42:59.089 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:42:59.094 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:42:59.098 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:42:59.102 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:42:59.105 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:42:59.109 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:43:29.252 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:43:29.257 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:43:29.261 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:43:29.266 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:43:29.270 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:43:29.274 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:43:59.444 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:43:59.450 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:43:59.455 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:43:59.459 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:43:59.463 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:43:59.467 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:44:29.631 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:44:29.635 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:44:29.640 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:44:29.644 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:44:29.648 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:44:29.652 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:44:59.810 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:44:59.814 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:44:59.818 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:44:59.822 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:44:59.826 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:44:59.830 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:45:29.988 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:45:29.994 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:45:29.999 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:45:30.003 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:45:30.011 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:45:30.016 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:46:00.161 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:46:00.165 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:46:00.170 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:46:00.173 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:46:00.177 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:46:00.182 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:46:30.347 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:46:30.352 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:46:30.356 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:46:30.360 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:46:30.365 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:46:30.369 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:47:00.524 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:47:00.529 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:47:00.534 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:47:00.538 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:47:00.542 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:47:00.548 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:47:30.725 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:47:30.729 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:47:30.733 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:47:30.737 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:47:30.741 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:47:30.745 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:48:00.897 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:48:00.902 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:48:00.906 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:48:00.910 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:48:00.915 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:48:00.919 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:48:31.127 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:48:31.132 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:48:31.137 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:48:31.141 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:48:31.145 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:48:31.150 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:49:01.357 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:49:01.363 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:49:01.367 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:49:01.371 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:49:01.375 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:49:01.380 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:49:31.549 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:49:31.555 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:49:31.560 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:49:31.564 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:49:31.576 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:49:31.581 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:50:01.750 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:50:01.755 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:50:01.761 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:50:01.767 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:50:01.772 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:50:01.776 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:50:31.932 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:50:31.940 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:50:31.948 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:50:31.952 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:50:31.957 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:50:31.963 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:51:02.122 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:51:02.129 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:51:02.133 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:51:02.138 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:51:02.142 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:51:02.147 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:51:32.295 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:51:32.299 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:51:32.310 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:51:32.315 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:51:32.323 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:51:32.327 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:52:02.521 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:52:02.540 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:52:02.546 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:52:02.552 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:52:02.556 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:52:02.562 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:52:32.713 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:52:32.717 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:52:32.721 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:52:32.726 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:52:32.731 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:52:32.738 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:53:02.904 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:53:02.909 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:53:02.914 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:53:02.919 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:53:02.925 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:53:02.929 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:53:33.081 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:53:33.090 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:53:33.095 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:53:33.101 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:53:33.109 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:53:33.116 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:54:03.269 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:54:03.286 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:54:03.293 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:54:03.298 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:54:03.304 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:54:03.309 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:54:33.464 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:54:33.469 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:54:33.473 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:54:33.477 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:54:33.481 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:54:33.485 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:55:03.685 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:55:03.696 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:55:03.701 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:55:03.706 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:55:03.710 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:55:03.715 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:55:33.893 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:55:33.897 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:55:33.902 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:55:33.909 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:55:33.913 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:55:33.917 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:56:04.093 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:56:04.097 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:56:04.102 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:56:04.106 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:56:04.110 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:56:04.114 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:56:34.294 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:56:34.300 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:56:34.304 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:56:34.308 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:56:34.312 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:56:34.317 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:57:04.490 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:57:04.494 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:57:04.499 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:57:04.503 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:57:04.508 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:57:04.513 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:57:34.674 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:57:34.679 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:57:34.684 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:57:34.701 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:57:34.706 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:57:34.710 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:58:04.859 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:58:04.864 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:58:04.868 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:58:04.872 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:58:04.875 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:58:04.879 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:58:35.022 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:58:35.026 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:58:35.031 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:58:35.035 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:58:35.040 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:58:35.045 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:59:05.185 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:59:05.189 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:59:05.194 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:59:05.198 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:59:05.201 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:59:05.208 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:59:35.347 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:59:35.352 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:59:35.357 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:59:35.360 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:59:35.369 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T20:59:35.379 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:00:05.519 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:00:05.525 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:00:05.532 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:00:05.539 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:00:05.543 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:00:05.549 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:00:35.713 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:00:35.717 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:00:35.723 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:00:35.727 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:00:35.730 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:00:35.735 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:01:05.904 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:01:05.910 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:01:05.914 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:01:05.919 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:01:05.924 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:01:05.929 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:01:36.104 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:01:36.108 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:01:36.115 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:01:36.119 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:01:36.123 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:01:36.128 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:02:06.289 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:02:06.294 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:02:06.298 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:02:06.303 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:02:06.307 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:02:06.312 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:02:36.477 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:02:36.482 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:02:36.486 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:02:36.496 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:02:36.500 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:02:36.505 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:03:06.697 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:03:06.704 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:03:06.713 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:03:06.717 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:03:06.721 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:03:06.725 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:03:36.879 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:03:36.885 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:03:36.890 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:03:36.894 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:03:36.897 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:03:36.902 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:04:07.054 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:04:07.059 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:04:07.064 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:04:07.068 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:04:07.073 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:04:07.078 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:04:37.231 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:04:37.235 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:04:37.241 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:04:37.245 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:04:37.249 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:04:37.253 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:05:07.424 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:05:07.429 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:05:07.433 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:05:07.437 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:05:07.442 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:05:07.448 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:05:37.620 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:05:37.624 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:05:37.634 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:05:37.638 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:05:37.642 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:05:37.646 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:06:07.810 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:06:51.927 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:06:51.934 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:06:51.948 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:06:51.956 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:06:51.960 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:07:22.111 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:07:22.115 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:07:22.119 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:07:22.123 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:07:22.127 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:07:22.131 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:07:52.210 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:07:52.216 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:07:52.220 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:07:52.224 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:07:52.228 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:07:52.233 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:08:22.397 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:08:22.403 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:08:22.409 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:08:22.414 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:08:22.417 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:08:22.421 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:08:52.563 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:08:52.570 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:08:52.575 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:08:52.582 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:08:52.591 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:08:52.596 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:09:22.738 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:09:22.742 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:09:22.747 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:09:22.751 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:09:22.756 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:09:22.760 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:09:52.922 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:09:52.927 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:09:52.931 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:09:52.935 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:09:52.940 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:09:52.944 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:10:23.090 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:10:23.099 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:10:23.105 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:10:23.110 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:10:23.115 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:10:23.121 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:10:53.288 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:10:53.293 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:10:53.297 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:10:53.301 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:10:53.305 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:10:53.310 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:11:23.470 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:11:23.475 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:11:23.480 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:11:23.484 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:11:23.491 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:11:23.496 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:11:53.765 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:11:53.770 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:11:53.774 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:11:53.778 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:11:53.782 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:11:53.789 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:12:23.945 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:12:23.954 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:12:23.959 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:12:23.964 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:12:23.969 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:12:23.974 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:12:54.131 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:12:54.137 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:12:54.142 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:12:54.146 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:12:54.150 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:12:54.157 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:13:24.384 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:13:24.388 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:13:24.397 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:13:24.401 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:13:24.410 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:13:24.415 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:13:54.568 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:13:54.574 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:13:54.579 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:13:54.583 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:13:54.587 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:13:54.593 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:14:24.741 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:14:24.751 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:14:24.755 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:14:24.760 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:14:24.766 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:14:24.771 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:14:54.932 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:14:54.938 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:14:54.943 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:14:54.947 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:14:54.951 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:14:54.957 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:15:25.093 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:15:25.098 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:15:25.103 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:15:25.107 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:15:25.111 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:15:25.115 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:15:55.252 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:15:55.257 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:15:55.262 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:15:55.266 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:15:55.270 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:15:55.276 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:16:25.440 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:16:25.447 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:16:25.452 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:16:25.456 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:16:25.460 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:16:25.464 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:16:55.626 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:16:55.631 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:16:55.636 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:16:55.641 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:16:55.645 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:16:55.650 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:17:25.803 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:17:25.807 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:17:25.811 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:17:25.816 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:17:25.820 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:17:25.824 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:17:55.974 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:17:55.978 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:17:55.982 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:17:55.986 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:17:55.990 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:17:55.994 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:18:26.153 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:18:26.158 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:18:26.178 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:18:26.182 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:18:26.186 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:18:26.190 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:18:56.356 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:18:56.377 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:18:56.392 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:18:56.414 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:18:56.430 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:18:56.447 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:19:26.618 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:19:26.633 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:19:26.638 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:19:26.642 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:19:26.646 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:19:26.650 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:19:56.818 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:19:56.829 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:19:56.839 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:19:56.843 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:19:56.847 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:19:56.851 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:20:27.015 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:20:27.022 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:20:27.027 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:20:27.031 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:20:27.035 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:20:27.041 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:20:57.213 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:20:57.218 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:20:57.222 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:20:57.228 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:20:57.232 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:20:57.237 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:21:27.400 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:21:27.405 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:21:27.411 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:21:27.455 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:21:27.461 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:21:27.470 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:21:57.628 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:21:57.633 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:21:57.637 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:21:57.641 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:21:57.645 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:21:57.649 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:22:27.809 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:22:27.814 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:22:27.818 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:22:27.823 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:22:27.828 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:22:27.833 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:22:57.977 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:22:57.982 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:22:57.986 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:22:57.989 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:22:57.993 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:22:57.997 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:23:28.157 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:23:28.163 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:23:28.168 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:23:28.173 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:23:28.180 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:23:28.185 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:23:58.335 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:23:58.341 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:23:58.345 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:23:58.349 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:23:58.353 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:23:58.358 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:24:28.509 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:24:28.514 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:24:28.518 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:24:28.522 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:24:28.526 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:24:28.530 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:24:58.680 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:24:58.684 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:24:58.688 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:24:58.693 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:24:58.697 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:24:58.701 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:25:28.838 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:25:28.843 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:25:28.847 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:25:28.856 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:25:28.860 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:25:28.883 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:25:58.968 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:25:58.973 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:25:58.982 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:25:58.991 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:25:58.995 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:25:59.000 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:26:29.160 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:26:29.165 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:26:29.169 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:26:29.173 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:26:29.177 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:26:29.182 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:26:59.346 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:26:59.350 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:26:59.354 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:26:59.358 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:26:59.362 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:26:59.366 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:27:29.535 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:27:29.541 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:27:29.545 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:27:29.549 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:27:29.555 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:27:29.560 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:27:59.713 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:27:59.717 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:27:59.722 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:27:59.725 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:27:59.729 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:27:59.734 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:28:29.878 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:28:29.882 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:28:29.886 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:28:29.890 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:28:29.894 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:28:29.898 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:29:00.087 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:29:00.093 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:29:00.097 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:29:00.101 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:29:00.105 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:29:00.109 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:29:30.282 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:29:30.287 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:29:30.292 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:29:30.296 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:29:30.300 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:29:30.304 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:30:00.450 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:30:00.455 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:30:00.461 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:30:00.465 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:30:00.472 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:30:00.477 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:30:30.632 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:30:30.637 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:30:30.641 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:30:30.647 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:30:30.651 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:30:30.656 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:31:00.859 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:31:00.864 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:31:00.868 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:31:00.872 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:31:00.876 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:31:00.881 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:31:31.054 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:31:31.059 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:31:31.065 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:31:31.069 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:31:31.073 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:31:31.078 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:32:01.241 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:32:01.245 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:32:01.250 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:32:01.254 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:32:01.258 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:32:01.264 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:32:31.443 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:32:31.447 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:32:31.451 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:32:31.470 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:32:31.477 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:32:31.482 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:33:01.633 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:33:01.637 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:33:01.642 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:33:01.646 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:33:01.650 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:33:01.654 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:33:31.803 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:33:31.808 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:33:31.812 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:33:31.816 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:33:31.820 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:33:31.825 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:34:01.998 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:34:02.003 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:34:02.007 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:34:02.010 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:34:02.017 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:34:02.021 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:34:32.194 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:34:32.199 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:34:32.203 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:34:32.207 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:34:32.220 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:34:32.224 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:35:02.372 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:35:02.376 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:35:02.383 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:35:02.387 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:35:02.391 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:35:02.395 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:35:32.542 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:35:32.547 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:35:32.551 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:35:32.555 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:35:32.559 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:35:32.563 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:36:02.729 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:36:02.734 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:36:02.739 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:36:02.744 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:36:02.749 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:36:02.754 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:36:32.907 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:36:32.912 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:36:32.916 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:36:32.920 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:36:32.924 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:36:32.929 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:37:03.070 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:37:03.075 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:37:03.080 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:37:03.085 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:37:03.090 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:37:03.096 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:37:33.249 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:37:33.255 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:37:33.260 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:37:33.264 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:37:33.268 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:37:33.272 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:38:03.429 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:38:03.433 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:38:03.438 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:38:03.441 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:38:03.445 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:38:03.449 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:38:33.623 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:38:33.627 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:38:33.631 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:38:33.635 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:38:33.639 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:38:33.643 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:39:03.815 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:39:03.819 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:39:03.824 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:39:03.828 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:39:03.831 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:39:03.835 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:39:33.993 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:39:33.997 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:39:34.002 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:39:34.006 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:39:34.010 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:39:34.014 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:40:04.167 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:40:04.172 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:40:04.178 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:40:04.182 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:40:04.187 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:40:04.192 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:40:34.347 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:40:34.352 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:40:34.357 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:40:34.361 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:40:34.365 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:40:34.370 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:41:04.534 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:41:04.539 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:41:04.544 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:41:04.549 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:41:04.553 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:41:04.560 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:41:34.733 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:41:34.737 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:41:34.742 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:41:34.746 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:41:34.750 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:41:34.755 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:42:04.907 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:42:04.912 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:42:04.916 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:42:04.920 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:42:04.927 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:42:04.931 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:42:35.095 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:42:35.100 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:42:35.105 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:42:35.109 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:42:35.114 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:42:35.118 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:43:05.276 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:43:05.281 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:43:05.285 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:43:05.289 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:43:05.294 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:43:05.298 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:43:35.459 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:43:35.464 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:43:35.468 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:43:35.472 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:43:35.476 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:43:35.481 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:44:05.618 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:44:05.623 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:44:05.627 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:44:05.632 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:44:05.636 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:44:05.640 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:44:35.771 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:44:35.776 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:44:35.780 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:44:35.786 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:44:35.790 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:44:35.794 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:45:05.961 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:45:05.967 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:45:05.971 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:45:05.976 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:45:05.980 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:45:05.984 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:45:36.154 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:45:36.158 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:45:36.163 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:45:36.167 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:45:36.171 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:45:36.175 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:46:06.328 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:46:06.335 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:46:06.340 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:46:06.344 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:46:06.348 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:46:06.353 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:46:36.582 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:46:36.587 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:46:36.591 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:46:36.595 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:46:36.599 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:46:36.604 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:47:03.595 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-11-28T21:47:03.595 DEBUG:teuthology.task.console_log:Killing console logger for smithi080 2019-11-28T21:47:03.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-11-28T21:47:03.596 INFO:teuthology.orchestra.run.smithi076:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2019-11-28T21:47:06.770 INFO:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:47:06.775 INFO:teuthology.orchestra.run.smithi075:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:47:06.780 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:47:06.784 INFO:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:47:06.787 INFO:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:47:06.792 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-11-28T21:47:08.748 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:08.820 INFO:tasks.cephfs_test_runner:Test if client hangs on unmount after evicting the client. ... ERROR 2019-11-28T21:47:08.820 INFO:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_unmount_for_evicted_client' 2019-11-28T21:47:08.949 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.941+0000 7fae95284700 1 Processor -- start 2019-11-28T21:47:08.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.941+0000 7fae95284700 1 -- start start 2019-11-28T21:47:08.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.942+0000 7fae95284700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae9006c490 0x7fae9006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T21:47:08.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.942+0000 7fae95284700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae9006ce60 0x7fae90164d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T21:47:08.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.942+0000 7fae95284700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9006db00 con 0x7fae9006c0a0 2019-11-28T21:47:08.950 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.942+0000 7fae95284700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9006fd60 con 0x7fae9006ce60 2019-11-28T21:47:08.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.942+0000 7fae95284700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae90070030 con 0x7fae9006c490 2019-11-28T21:47:08.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.942+0000 7fae8ffff700 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fae9006ce60 msgr2=0x7fae90164d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2019-11-28T21:47:08.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.942+0000 7fae8effd700 1 -- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae9006c490 msgr2=0x7fae9006c920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3301/0 2019-11-28T21:47:08.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.942+0000 7fae8effd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae9006c490 0x7fae9006c920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2019-11-28T21:47:08.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.942+0000 7fae8ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae9006ce60 0x7fae90164d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2019-11-28T21:47:08.951 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8f7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fae9006c0a0 0x7fae90072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49354/0 (socket says 172.21.15.80:49354) 2019-11-28T21:47:08.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8f7fe700 1 -- 172.21.15.80:0/2786335660 learned_addr learned my addr 172.21.15.80:0/2786335660 (peer_addr_for_me v1:172.21.15.80:0/0) 2019-11-28T21:47:08.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8e7fc700 1 -- 172.21.15.80:0/2786335660 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357239017 0 0) 0x7fae78001150 con 0x7fae9006c0a0 2019-11-28T21:47:08.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8e7fc700 1 -- 172.21.15.80:0/2786335660 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae7c002e80 con 0x7fae9006c0a0 2019-11-28T21:47:08.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8e7fc700 1 -- 172.21.15.80:0/2786335660 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3892473278 0 0) 0x7fae78001130 con 0x7fae9006c0a0 2019-11-28T21:47:08.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8e7fc700 1 -- 172.21.15.80:0/2786335660 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae9006c490 msgr2=0x7fae9006c920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2019-11-28T21:47:08.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8e7fc700 1 --2- 172.21.15.80:0/2786335660 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae9006c490 0x7fae9006c920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T21:47:08.952 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8e7fc700 1 -- 172.21.15.80:0/2786335660 >> v2:172.21.15.174:3300/0 conn(0x7fae9006ce60 msgr2=0x7fae90164d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2019-11-28T21:47:08.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8e7fc700 1 --2- 172.21.15.80:0/2786335660 >> v2:172.21.15.174:3300/0 conn(0x7fae9006ce60 0x7fae90164d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T21:47:08.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8e7fc700 1 -- 172.21.15.80:0/2786335660 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae900706c0 con 0x7fae9006c0a0 2019-11-28T21:47:08.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8e7fc700 1 -- 172.21.15.80:0/2786335660 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1642990511 0 0) 0x7fae78001660 con 0x7fae9006c0a0 2019-11-28T21:47:08.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8e7fc700 1 -- 172.21.15.80:0/2786335660 >> v1:172.21.15.80:6789/0 conn(0x7fae9006c0a0 legacy=0x7fae90072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T21:47:08.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8e7fc700 1 --2- 172.21.15.80:0/2786335660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae7c0039d0 0x7fae7c005e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T21:47:08.953 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8e7fc700 1 --2- 172.21.15.80:0/2786335660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae7c0065e0 0x7fae7c008a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T21:47:08.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8e7fc700 1 --2- 172.21.15.80:0/2786335660 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae7c0092f0 0x7fae7c00b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-11-28T21:47:08.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8e7fc700 1 -- 172.21.15.80:0/2786335660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c00bf40 con 0x7fae7c0039d0 2019-11-28T21:47:08.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8e7fc700 1 -- 172.21.15.80:0/2786335660 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c050140 con 0x7fae7c0065e0 2019-11-28T21:47:08.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8e7fc700 1 -- 172.21.15.80:0/2786335660 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c050370 con 0x7fae7c0092f0 2019-11-28T21:47:08.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8f7fe700 1 --2- 172.21.15.80:0/2786335660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae7c0039d0 0x7fae7c005e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-11-28T21:47:08.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8effd700 1 -- 172.21.15.80:0/2786335660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae7c0065e0 msgr2=0x7fae7c008a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2019-11-28T21:47:08.954 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8ffff700 1 -- 172.21.15.80:0/2786335660 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae7c0092f0 msgr2=0x7fae7c00b790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3301/0 2019-11-28T21:47:08.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8effd700 1 --2- 172.21.15.80:0/2786335660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae7c0065e0 0x7fae7c008a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2019-11-28T21:47:08.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8ffff700 1 --2- 172.21.15.80:0/2786335660 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae7c0092f0 0x7fae7c00b790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2019-11-28T21:47:08.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8f7fe700 1 -- 172.21.15.80:0/2786335660 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae7c0092f0 msgr2=0x7fae7c00b790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2019-11-28T21:47:08.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8f7fe700 1 --2- 172.21.15.80:0/2786335660 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae7c0092f0 0x7fae7c00b790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T21:47:08.955 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8f7fe700 1 -- 172.21.15.80:0/2786335660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae7c0065e0 msgr2=0x7fae7c008a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2019-11-28T21:47:08.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8f7fe700 1 --2- 172.21.15.80:0/2786335660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae7c0065e0 0x7fae7c008a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-11-28T21:47:08.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8f7fe700 1 -- 172.21.15.80:0/2786335660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c050620 con 0x7fae7c0039d0 2019-11-28T21:47:08.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.943+0000 7fae8f7fe700 1 --2- 172.21.15.80:0/2786335660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae7c0039d0 0x7fae7c005e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae7800f910 tx=0x7fae7800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T21:47:08.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.944+0000 7fae8f7fe700 1 --2- 172.21.15.80:0/2786335660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae7c0039d0 0x7fae7c005e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae7800f910 tx=0x7fae7800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T21:47:08.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.944+0000 7fae8f7fe700 1 --2- 172.21.15.80:0/2786335660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae7c0039d0 0x7fae7c005e30 secure :-1 s=READY pgs=3211 cs=0 l=1 rx=0x7fae7800f910 tx=0x7fae7800f790).ready entity=mon.0 client_cookie=62ce82ed3cb2cd1a server_cookie=0 in_seq=0 out_seq=0 2019-11-28T21:47:08.956 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.944+0000 7fae8f7fe700 1 --2- 172.21.15.80:0/2786335660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae7c0039d0 0x7fae7c005e30 secure :-1 s=THROTTLE_DONE pgs=3211 cs=0 l=1 rx=0x7fae7800f910 tx=0x7fae7800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T21:47:08.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.944+0000 7fae8e7fc700 1 -- 172.21.15.80:0/2786335660 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae78001130 con 0x7fae7c0039d0 2019-11-28T21:47:08.957 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.944+0000 7fae8f7fe700 1 --2- 172.21.15.80:0/2786335660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae7c0039d0 0x7fae7c005e30 secure :-1 s=THROTTLE_DONE pgs=3211 cs=0 l=1 rx=0x7fae7800f910 tx=0x7fae7800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T21:47:08.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.944+0000 7fae8f7fe700 1 --2- 172.21.15.80:0/2786335660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae7c0039d0 0x7fae7c005e30 secure :-1 s=THROTTLE_DONE pgs=3211 cs=0 l=1 rx=0x7fae7800f910 tx=0x7fae7800f790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-11-28T21:47:08.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.944+0000 7fae8e7fc700 1 -- 172.21.15.80:0/2786335660 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae78004240 con 0x7fae7c0039d0 2019-11-28T21:47:08.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.944+0000 7fae8e7fc700 1 -- 172.21.15.80:0/2786335660 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae78004890 con 0x7fae7c0039d0 2019-11-28T21:47:08.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.944+0000 7fae95284700 1 -- 172.21.15.80:0/2786335660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae7c0039d0 msgr2=0x7fae7c005e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-11-28T21:47:08.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.944+0000 7fae95284700 1 --2- 172.21.15.80:0/2786335660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae7c0039d0 0x7fae7c005e30 secure :-1 s=READY pgs=3211 cs=0 l=1 rx=0x7fae7800f910 tx=0x7fae7800f790).stop 2019-11-28T21:47:08.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.944+0000 7fae8ffff700 1 -- 172.21.15.80:0/2786335660 reap_dead start 2019-11-28T21:47:08.958 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.944+0000 7fae95284700 1 -- 172.21.15.80:0/2786335660 shutdown_connections 2019-11-28T21:47:08.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.944+0000 7fae95284700 1 -- 172.21.15.80:0/2786335660 shutdown_connections 2019-11-28T21:47:08.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.944+0000 7fae95284700 1 -- 172.21.15.80:0/2786335660 wait complete. 2019-11-28T21:47:08.959 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.944+0000 7fae95284700 1 -- 172.21.15.80:0/2786335660 >> 172.21.15.80:0/2786335660 conn(0x7fae90061cf0 msgr2=0x7fae90064180 unknown :-1 s=STATE_NONE l=0).mark_down 2019-11-28T21:47:08.960 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.948+0000 7fae95284700 1 Processor -- start 2019-11-28T21:47:08.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.948+0000 7fae95284700 1 -- start start 2019-11-28T21:47:08.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.949+0000 7fae95284700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae9013fdf0 0x7fae90071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T21:47:08.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.949+0000 7fae95284700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae90103e90 0x7fae90104300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-11-28T21:47:08.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.949+0000 7fae95284700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae90105ce0 con 0x7fae90164c20 2019-11-28T21:47:08.961 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.949+0000 7fae95284700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae90111970 con 0x7fae90103e90 2019-11-28T21:47:08.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.949+0000 7fae95284700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae90111390 con 0x7fae9013fdf0 2019-11-28T21:47:08.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.949+0000 7fae8f7fe700 1 -- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae9013fdf0 msgr2=0x7fae90071cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3301/0 2019-11-28T21:47:08.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.949+0000 7fae8effd700 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fae90164c20 legacy=0x7fae901650b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.174:6789/0 2019-11-28T21:47:08.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.949+0000 7fae8ffff700 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fae90103e90 msgr2=0x7fae90104300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2019-11-28T21:47:08.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.949+0000 7fae8f7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae9013fdf0 0x7fae90071cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2019-11-28T21:47:08.962 INFO:teuthology.orchestra.run.smithi080.stderr:2019-11-28T21:47:08.949+0000 7fae8ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae90103e90 0x7fae90104300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2019-11-28T21:47:08.999 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2019-11-28T21:47:09.053 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.060 INFO:tasks.cephfs_test_runner:ERROR 2019-11-28T21:47:09.060 INFO:tasks.cephfs_test_runner: 2019-11-28T21:47:09.060 INFO:tasks.cephfs_test_runner:====================================================================== 2019-11-28T21:47:09.061 INFO:tasks.cephfs_test_runner:ERROR: test_unmount_for_evicted_client (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T21:47:09.064 INFO:tasks.cephfs_test_runner:Test if client hangs on unmount after evicting the client. 2019-11-28T21:47:09.064 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2019-11-28T21:47:09.064 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2019-11-28T21:47:09.065 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/cephfs/test_client_recovery.py", line 517, in test_unmount_for_evicted_client 2019-11-28T21:47:09.065 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(require_clean=True, timeout=30) 2019-11-28T21:47:09.065 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/cephfs/kernel_mount.py", line 121, in umount_wait 2019-11-28T21:47:09.065 INFO:tasks.cephfs_test_runner: self.umount(force) 2019-11-28T21:47:09.065 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/cephfs/kernel_mount.py", line 96, in umount 2019-11-28T21:47:09.065 INFO:tasks.cephfs_test_runner: ], timeout=(15*60)) 2019-11-28T21:47:09.065 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run 2019-11-28T21:47:09.065 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2019-11-28T21:47:09.066 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 433, in run 2019-11-28T21:47:09.066 INFO:tasks.cephfs_test_runner: r.wait() 2019-11-28T21:47:09.066 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait 2019-11-28T21:47:09.066 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2019-11-28T21:47:09.066 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status 2019-11-28T21:47:09.066 INFO:tasks.cephfs_test_runner: node=self.hostname) 2019-11-28T21:47:09.066 INFO:tasks.cephfs_test_runner:ConnectionLostError: SSH connection to smithi076 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' 2019-11-28T21:47:09.066 INFO:tasks.cephfs_test_runner: 2019-11-28T21:47:09.066 INFO:tasks.cephfs_test_runner:====================================================================== 2019-11-28T21:47:09.067 INFO:tasks.cephfs_test_runner:ERROR: test_unmount_for_evicted_client (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T21:47:09.067 INFO:tasks.cephfs_test_runner:Test if client hangs on unmount after evicting the client. 2019-11-28T21:47:09.067 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2019-11-28T21:47:09.067 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2019-11-28T21:47:09.067 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/cephfs/cephfs_test_case.py", line 174, in tearDown 2019-11-28T21:47:09.067 INFO:tasks.cephfs_test_runner: super(CephFSTestCase, self).tearDown() 2019-11-28T21:47:09.067 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/ceph_test_case.py", line 49, in tearDown 2019-11-28T21:47:09.068 INFO:tasks.cephfs_test_runner: "Ended test {0}".format(self.id())) 2019-11-28T21:47:09.068 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/ceph_manager.py", line 1272, in raw_cluster_cmd 2019-11-28T21:47:09.068 INFO:tasks.cephfs_test_runner: stdout=StringIO(), 2019-11-28T21:47:09.068 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run 2019-11-28T21:47:09.068 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2019-11-28T21:47:09.068 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 433, in run 2019-11-28T21:47:09.068 INFO:tasks.cephfs_test_runner: r.wait() 2019-11-28T21:47:09.068 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait 2019-11-28T21:47:09.069 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2019-11-28T21:47:09.069 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status 2019-11-28T21:47:09.069 INFO:tasks.cephfs_test_runner: node=self.hostname) 2019-11-28T21:47:09.069 INFO:tasks.cephfs_test_runner:ConnectionLostError: SSH connection to smithi080 was lost: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_unmount_for_evicted_client'" 2019-11-28T21:47:09.069 INFO:tasks.cephfs_test_runner: 2019-11-28T21:47:09.069 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2019-11-28T21:47:09.069 INFO:tasks.cephfs_test_runner:Ran 19 tests in 37279.518s 2019-11-28T21:47:09.069 INFO:tasks.cephfs_test_runner: 2019-11-28T21:47:09.070 INFO:tasks.cephfs_test_runner:FAILED (errors=2, skipped=4) 2019-11-28T21:47:09.070 INFO:tasks.cephfs_test_runner: 2019-11-28T21:47:09.070 INFO:tasks.cephfs_test_runner:====================================================================== 2019-11-28T21:47:09.070 INFO:tasks.cephfs_test_runner:ERROR: test_unmount_for_evicted_client (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T21:47:09.072 INFO:tasks.cephfs_test_runner:Test if client hangs on unmount after evicting the client. 2019-11-28T21:47:09.072 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2019-11-28T21:47:09.072 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2019-11-28T21:47:09.072 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/cephfs/test_client_recovery.py", line 517, in test_unmount_for_evicted_client 2019-11-28T21:47:09.072 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(require_clean=True, timeout=30) 2019-11-28T21:47:09.073 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/cephfs/kernel_mount.py", line 121, in umount_wait 2019-11-28T21:47:09.073 INFO:tasks.cephfs_test_runner: self.umount(force) 2019-11-28T21:47:09.073 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/cephfs/kernel_mount.py", line 96, in umount 2019-11-28T21:47:09.073 INFO:tasks.cephfs_test_runner: ], timeout=(15*60)) 2019-11-28T21:47:09.073 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run 2019-11-28T21:47:09.073 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2019-11-28T21:47:09.074 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 433, in run 2019-11-28T21:47:09.075 INFO:tasks.cephfs_test_runner: r.wait() 2019-11-28T21:47:09.075 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait 2019-11-28T21:47:09.075 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2019-11-28T21:47:09.075 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status 2019-11-28T21:47:09.075 INFO:tasks.cephfs_test_runner: node=self.hostname) 2019-11-28T21:47:09.075 INFO:tasks.cephfs_test_runner:ConnectionLostError: SSH connection to smithi076 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' 2019-11-28T21:47:09.075 INFO:tasks.cephfs_test_runner: 2019-11-28T21:47:09.075 INFO:tasks.cephfs_test_runner:====================================================================== 2019-11-28T21:47:09.076 INFO:tasks.cephfs_test_runner:ERROR: test_unmount_for_evicted_client (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T21:47:09.076 INFO:tasks.cephfs_test_runner:Test if client hangs on unmount after evicting the client. 2019-11-28T21:47:09.076 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2019-11-28T21:47:09.076 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2019-11-28T21:47:09.076 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/cephfs/cephfs_test_case.py", line 174, in tearDown 2019-11-28T21:47:09.076 INFO:tasks.cephfs_test_runner: super(CephFSTestCase, self).tearDown() 2019-11-28T21:47:09.077 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/ceph_test_case.py", line 49, in tearDown 2019-11-28T21:47:09.077 INFO:tasks.cephfs_test_runner: "Ended test {0}".format(self.id())) 2019-11-28T21:47:09.077 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/ceph_manager.py", line 1272, in raw_cluster_cmd 2019-11-28T21:47:09.077 INFO:tasks.cephfs_test_runner: stdout=StringIO(), 2019-11-28T21:47:09.077 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run 2019-11-28T21:47:09.078 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2019-11-28T21:47:09.078 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 433, in run 2019-11-28T21:47:09.078 INFO:tasks.cephfs_test_runner: r.wait() 2019-11-28T21:47:09.078 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait 2019-11-28T21:47:09.078 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2019-11-28T21:47:09.079 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status 2019-11-28T21:47:09.079 INFO:tasks.cephfs_test_runner: node=self.hostname) 2019-11-28T21:47:09.079 INFO:tasks.cephfs_test_runner:ConnectionLostError: SSH connection to smithi080 was lost: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_unmount_for_evicted_client'" 2019-11-28T21:47:09.079 INFO:tasks.cephfs_test_runner: 2019-11-28T21:47:09.079 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 89, in run_tasks manager.__enter__() File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/cephfs_test_runner.py", line 207, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_unmount_for_evicted_client (tasks.cephfs.test_client_recovery.TestClientRecovery), test_unmount_for_evicted_client (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T21:47:09.083 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2019-11-28T21:47:09.091 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2019-11-28T21:47:09.114 INFO:tasks.kclient:Unmounting kernel clients... 2019-11-28T21:47:09.114 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T21:47:09.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:47:09.115 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:47:09.117 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2019-11-28T21:47:09.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:47:09.117 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:47:09.118 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2019-11-28T21:47:09.118 INFO:tasks.kclient:Unmounting kernel clients... 2019-11-28T21:47:09.119 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2019-11-28T21:47:09.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:47:09.119 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:47:09.120 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2019-11-28T21:47:09.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:47:09.121 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:47:09.123 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2019-11-28T21:47:09.124 ERROR:teuthology.run_tasks:Manager failed: kclient Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 159, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/kclient.py", line 125, in task forced = umount_all() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/kclient.py", line 110, in umount_all mount.umount() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/cephfs/kernel_mount.py", line 96, in umount ], timeout=(15*60)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 416, in run raise ConnectionLostError(command=quote(args), node=name) ConnectionLostError: SSH connection to smithi016 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' 2019-11-28T21:47:09.125 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2019-11-28T21:47:09.138 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2019-11-28T21:47:09.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:47:09.139 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi080.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:47:09.140 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2019-11-28T21:47:09.140 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/ceph.py", line 1914, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/ceph_manager.py", line 1927, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/ceph_manager.py", line 2143, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/ceph_manager.py", line 1272, in raw_cluster_cmd stdout=StringIO(), File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 416, in run raise ConnectionLostError(command=quote(args), node=name) ConnectionLostError: SSH connection to smithi080 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2019-11-28T21:47:09.143 INFO:teuthology.misc:Shutting down mds daemons... 2019-11-28T21:47:09.143 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-11-28T21:47:09.143 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T21:47:09.144 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.144 ERROR:teuthology.misc:Saw exception from ceph.mds.a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1172, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 457, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi080 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2019-11-28T21:47:09.145 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2019-11-28T21:47:09.145 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T21:47:09.145 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.145 ERROR:teuthology.misc:Saw exception from ceph.mds.c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1172, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 457, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi174 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2019-11-28T21:47:09.145 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-11-28T21:47:09.146 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T21:47:09.146 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.146 ERROR:teuthology.misc:Saw exception from ceph.mds.b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1172, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 457, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi080 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2019-11-28T21:47:09.146 INFO:teuthology.misc:Shutting down osd daemons... 2019-11-28T21:47:09.147 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2019-11-28T21:47:09.147 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T21:47:09.147 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.148 ERROR:teuthology.misc:Saw exception from ceph.osd.1 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1172, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 457, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi080 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1' 2019-11-28T21:47:09.148 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2019-11-28T21:47:09.148 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T21:47:09.149 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.149 ERROR:teuthology.misc:Saw exception from ceph.osd.0 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1172, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 457, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi080 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' 2019-11-28T21:47:09.149 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2019-11-28T21:47:09.149 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T21:47:09.150 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.150 ERROR:teuthology.misc:Saw exception from ceph.osd.3 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1172, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 457, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi080 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3' 2019-11-28T21:47:09.150 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2019-11-28T21:47:09.151 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T21:47:09.151 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.151 ERROR:teuthology.misc:Saw exception from ceph.osd.2 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1172, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 457, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi080 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2' 2019-11-28T21:47:09.151 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2019-11-28T21:47:09.152 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T21:47:09.152 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.152 ERROR:teuthology.misc:Saw exception from ceph.osd.5 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1172, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 457, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi174 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5' 2019-11-28T21:47:09.152 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2019-11-28T21:47:09.153 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T21:47:09.153 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.153 ERROR:teuthology.misc:Saw exception from ceph.osd.4 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1172, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 457, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi174 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4' 2019-11-28T21:47:09.153 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2019-11-28T21:47:09.153 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T21:47:09.154 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.154 ERROR:teuthology.misc:Saw exception from ceph.osd.7 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1172, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 457, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi174 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' 2019-11-28T21:47:09.154 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2019-11-28T21:47:09.154 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T21:47:09.154 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.155 ERROR:teuthology.misc:Saw exception from ceph.osd.6 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1172, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 457, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi174 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6' 2019-11-28T21:47:09.155 INFO:teuthology.misc:Shutting down mgr daemons... 2019-11-28T21:47:09.155 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2019-11-28T21:47:09.155 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T21:47:09.155 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.156 ERROR:teuthology.misc:Saw exception from ceph.mgr.y Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1172, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 457, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi080 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2019-11-28T21:47:09.156 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2019-11-28T21:47:09.156 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T21:47:09.156 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.166 ERROR:teuthology.misc:Saw exception from ceph.mgr.x Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1172, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 457, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi174 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2019-11-28T21:47:09.167 INFO:teuthology.misc:Shutting down mon daemons... 2019-11-28T21:47:09.167 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2019-11-28T21:47:09.167 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T21:47:09.168 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.168 ERROR:teuthology.misc:Saw exception from ceph.mon.a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1172, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 457, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi080 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a' 2019-11-28T21:47:09.168 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2019-11-28T21:47:09.168 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T21:47:09.169 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.169 ERROR:teuthology.misc:Saw exception from ceph.mon.c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1172, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 457, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi174 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c' 2019-11-28T21:47:09.169 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2019-11-28T21:47:09.169 INFO:teuthology.orchestra.run:waiting for 300 2019-11-28T21:47:09.169 DEBUG:teuthology.orchestra.run:got remote process result: None 2019-11-28T21:47:09.170 ERROR:teuthology.misc:Saw exception from ceph.mon.b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1172, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 457, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 172, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi174 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b' 2019-11-28T21:47:09.170 INFO:tasks.ceph:Checking cluster log for badness... 2019-11-28T21:47:09.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:47:09.170 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi080.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:47:09.171 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2019-11-28T21:47:09.172 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2019-11-28T21:47:09.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:47:09.172 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:47:09.173 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T21:47:09.182 INFO:tasks.ceph:Archiving crash dumps... 2019-11-28T21:47:09.184 DEBUG:teuthology.misc:Transferring archived files from smithi076:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2019-11-27_23:36:14-kcephfs-wip-pdonnell-testing-20191127.175901-distro-basic-smithi/4548252/remote/smithi076/crash 2019-11-28T21:47:09.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:47:09.186 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:47:09.187 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T21:47:09.187 INFO:tasks.ceph:Shutting down logrotate 2019-11-28T21:47:09.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:47:09.188 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:47:09.189 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2019-11-28T21:47:09.189 DEBUG:tasks.ceph:Missed logrotate, node 'smithi016' is offline 2019-11-28T21:47:09.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:47:09.190 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:47:09.190 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2019-11-28T21:47:09.191 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 159, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/ceph.py", line 1934, in task '--no-mon-health-to-clog', File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 56, in nested reraise(*exc) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 48, in nested if exit(*exc): File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/ceph.py", line 240, in ceph_log args=['sudo', 'rm', '/etc/logrotate.d/ceph-test.conf' File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 416, in run raise ConnectionLostError(command=quote(args), node=name) ConnectionLostError: SSH connection to smithi016 was lost: 'sudo rm /etc/logrotate.d/ceph-test.conf' 2019-11-28T21:47:09.191 DEBUG:teuthology.run_tasks:Unwinding manager install 2019-11-28T21:47:09.206 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/install/__init__.py", line 598, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 89, in run_tasks manager.__enter__() File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191127.175901/qa/tasks/cephfs_test_runner.py", line 207, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_unmount_for_evicted_client (tasks.cephfs.test_client_recovery.TestClientRecovery), test_unmount_for_evicted_client (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T21:47:09.206 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2019-11-28T21:47:09.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:47:09.207 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:47:09.208 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2019-11-28T21:47:09.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:47:09.209 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:47:09.210 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T21:47:09.211 ERROR:teuthology.run_tasks:Manager failed: install Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 159, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/install/__init__.py", line 598, in task yield File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 56, in nested reraise(*exc) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 48, in nested if exit(*exc): File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/install/__init__.py", line 218, in install remove_packages(ctx, config, package_list) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/install/__init__.py", line 104, in remove_packages system_type = teuthology.get_system_type(remote) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 1190, in get_system_type system_value = remote.sh('sudo lsb_release -is').strip() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 242, in sh proc=self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 416, in run raise ConnectionLostError(command=quote(args), node=name) ConnectionLostError: SSH connection to smithi076 was lost: 'sudo lsb_release -is' 2019-11-28T21:47:09.211 DEBUG:teuthology.run_tasks:Unwinding manager clock 2019-11-28T21:47:09.423 INFO:teuthology.task.clock:Checking final clock skew... 2019-11-28T21:47:09.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:47:09.423 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:47:14.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2019-11-28T21:47:14.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2019-11-28T21:47:14.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2019-11-28T21:47:14.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2019-11-28T21:47:14.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2019-11-28T21:47:14.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2019-11-28T21:47:14.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2019-11-28T21:47:14.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2019-11-28T21:47:14.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2019-11-28T21:47:14.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2019-11-28T21:47:14.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2019-11-28T21:47:14.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2019-11-28T21:47:14.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2019-11-28T21:47:14.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2019-11-28T21:47:14.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2019-11-28T21:47:14.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~7s 2019-11-28T21:47:19.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~5s 2019-11-28T21:47:19.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~5s 2019-11-28T21:47:19.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~5s 2019-11-28T21:47:19.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~5s 2019-11-28T21:47:19.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~5s 2019-11-28T21:47:19.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~5s 2019-11-28T21:47:19.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~5s 2019-11-28T21:47:19.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~5s 2019-11-28T21:47:19.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~5s 2019-11-28T21:47:19.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~5s 2019-11-28T21:47:19.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~5s 2019-11-28T21:47:19.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~5s 2019-11-28T21:47:19.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~5s 2019-11-28T21:47:19.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~5s 2019-11-28T21:47:19.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~5s 2019-11-28T21:47:19.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~12s 2019-11-28T21:47:24.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~10s 2019-11-28T21:47:24.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~10s 2019-11-28T21:47:24.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~10s 2019-11-28T21:47:24.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~10s 2019-11-28T21:47:24.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~10s 2019-11-28T21:47:24.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~10s 2019-11-28T21:47:24.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~10s 2019-11-28T21:47:24.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~10s 2019-11-28T21:47:24.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~10s 2019-11-28T21:47:24.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~10s 2019-11-28T21:47:24.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~10s 2019-11-28T21:47:24.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~10s 2019-11-28T21:47:24.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~10s 2019-11-28T21:47:24.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~10s 2019-11-28T21:47:24.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~10s 2019-11-28T21:47:24.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~17s 2019-11-28T21:47:29.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~15s 2019-11-28T21:47:29.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~15s 2019-11-28T21:47:29.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~15s 2019-11-28T21:47:29.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~15s 2019-11-28T21:47:29.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~15s 2019-11-28T21:47:29.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~15s 2019-11-28T21:47:29.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~15s 2019-11-28T21:47:29.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~15s 2019-11-28T21:47:29.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~15s 2019-11-28T21:47:29.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~15s 2019-11-28T21:47:29.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~15s 2019-11-28T21:47:29.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~15s 2019-11-28T21:47:29.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~15s 2019-11-28T21:47:29.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~15s 2019-11-28T21:47:29.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~15s 2019-11-28T21:47:29.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~22s 2019-11-28T21:47:34.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~20s 2019-11-28T21:47:34.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~20s 2019-11-28T21:47:34.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~20s 2019-11-28T21:47:34.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~20s 2019-11-28T21:47:34.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2019-11-28T21:47:34.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~20s 2019-11-28T21:47:34.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~20s 2019-11-28T21:47:34.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~20s 2019-11-28T21:47:34.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~20s 2019-11-28T21:47:34.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~20s 2019-11-28T21:47:34.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~20s 2019-11-28T21:47:34.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2019-11-28T21:47:34.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2019-11-28T21:47:34.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~20s 2019-11-28T21:47:34.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~20s 2019-11-28T21:47:34.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~27s 2019-11-28T21:47:39.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~25s 2019-11-28T21:47:39.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~25s 2019-11-28T21:47:39.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~25s 2019-11-28T21:47:39.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~25s 2019-11-28T21:47:39.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~25s 2019-11-28T21:47:39.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~25s 2019-11-28T21:47:39.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~25s 2019-11-28T21:47:39.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~25s 2019-11-28T21:47:39.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~25s 2019-11-28T21:47:39.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~25s 2019-11-28T21:47:39.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~25s 2019-11-28T21:47:39.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~25s 2019-11-28T21:47:39.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~25s 2019-11-28T21:47:39.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~25s 2019-11-28T21:47:39.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~25s 2019-11-28T21:47:39.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~32s 2019-11-28T21:47:44.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~30s 2019-11-28T21:47:44.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~30s 2019-11-28T21:47:44.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~30s 2019-11-28T21:47:44.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~30s 2019-11-28T21:47:44.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~30s 2019-11-28T21:47:44.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~30s 2019-11-28T21:47:44.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~30s 2019-11-28T21:47:44.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~30s 2019-11-28T21:47:44.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~30s 2019-11-28T21:47:44.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~30s 2019-11-28T21:47:44.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~30s 2019-11-28T21:47:44.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~30s 2019-11-28T21:47:44.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~30s 2019-11-28T21:47:44.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~30s 2019-11-28T21:47:44.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~30s 2019-11-28T21:47:44.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~37s 2019-11-28T21:47:49.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2019-11-28T21:47:49.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2019-11-28T21:47:49.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~35s 2019-11-28T21:47:49.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2019-11-28T21:47:49.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~35s 2019-11-28T21:47:49.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~35s 2019-11-28T21:47:49.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~35s 2019-11-28T21:47:49.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~35s 2019-11-28T21:47:49.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~35s 2019-11-28T21:47:49.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~35s 2019-11-28T21:47:49.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~35s 2019-11-28T21:47:49.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~35s 2019-11-28T21:47:49.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~35s 2019-11-28T21:47:49.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~35s 2019-11-28T21:47:49.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~35s 2019-11-28T21:47:49.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~42s 2019-11-28T21:47:54.040 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~40s 2019-11-28T21:47:54.040 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~40s 2019-11-28T21:47:54.040 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~40s 2019-11-28T21:47:54.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~40s 2019-11-28T21:47:54.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2019-11-28T21:47:54.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~40s 2019-11-28T21:47:54.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~40s 2019-11-28T21:47:54.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~40s 2019-11-28T21:47:54.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~40s 2019-11-28T21:47:54.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~40s 2019-11-28T21:47:54.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~40s 2019-11-28T21:47:54.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~40s 2019-11-28T21:47:54.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~40s 2019-11-28T21:47:54.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~40s 2019-11-28T21:47:54.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~40s 2019-11-28T21:47:54.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~47s 2019-11-28T21:47:59.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~45s 2019-11-28T21:47:59.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~45s 2019-11-28T21:47:59.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~45s 2019-11-28T21:47:59.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~45s 2019-11-28T21:47:59.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~45s 2019-11-28T21:47:59.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~45s 2019-11-28T21:47:59.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~45s 2019-11-28T21:47:59.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~45s 2019-11-28T21:47:59.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~45s 2019-11-28T21:47:59.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~45s 2019-11-28T21:47:59.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~45s 2019-11-28T21:47:59.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~45s 2019-11-28T21:47:59.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~45s 2019-11-28T21:47:59.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~45s 2019-11-28T21:47:59.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~45s 2019-11-28T21:47:59.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~52s 2019-11-28T21:48:04.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~50s 2019-11-28T21:48:04.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~50s 2019-11-28T21:48:04.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~50s 2019-11-28T21:48:04.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~50s 2019-11-28T21:48:04.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~50s 2019-11-28T21:48:04.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~50s 2019-11-28T21:48:04.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~50s 2019-11-28T21:48:04.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~50s 2019-11-28T21:48:04.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~50s 2019-11-28T21:48:04.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~50s 2019-11-28T21:48:04.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~50s 2019-11-28T21:48:04.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~50s 2019-11-28T21:48:04.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~50s 2019-11-28T21:48:04.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~50s 2019-11-28T21:48:04.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~50s 2019-11-28T21:48:04.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~57s 2019-11-28T21:48:09.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~55s 2019-11-28T21:48:09.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~55s 2019-11-28T21:48:09.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~55s 2019-11-28T21:48:09.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~55s 2019-11-28T21:48:09.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~55s 2019-11-28T21:48:09.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~55s 2019-11-28T21:48:09.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~55s 2019-11-28T21:48:09.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~55s 2019-11-28T21:48:09.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~55s 2019-11-28T21:48:09.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~55s 2019-11-28T21:48:09.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~55s 2019-11-28T21:48:09.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~55s 2019-11-28T21:48:09.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~55s 2019-11-28T21:48:09.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~55s 2019-11-28T21:48:09.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~55s 2019-11-28T21:48:09.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~62s 2019-11-28T21:48:09.425 DEBUG:teuthology.orchestra.remote:timed out 2019-11-28T21:48:09.426 ERROR:teuthology.run_tasks:Manager failed: clock Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 159, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/clock.py", line 65, in task 'true' File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 416, in run raise ConnectionLostError(command=quote(args), node=name) ConnectionLostError: SSH connection to smithi076 was lost: 'PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true' 2019-11-28T21:48:09.426 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2019-11-28T21:48:10.241 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2019-11-28T21:48:10.241 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2019-11-28T21:48:10.488 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:48:10.489 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:48:14.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~60s 2019-11-28T21:48:14.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~60s 2019-11-28T21:48:14.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~60s 2019-11-28T21:48:14.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~60s 2019-11-28T21:48:14.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2019-11-28T21:48:14.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~60s 2019-11-28T21:48:14.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~60s 2019-11-28T21:48:14.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~60s 2019-11-28T21:48:14.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~60s 2019-11-28T21:48:14.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~60s 2019-11-28T21:48:14.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~60s 2019-11-28T21:48:14.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~60s 2019-11-28T21:48:14.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~60s 2019-11-28T21:48:14.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~60s 2019-11-28T21:48:14.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~60s 2019-11-28T21:48:14.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~67s 2019-11-28T21:48:19.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2019-11-28T21:48:19.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~65s 2019-11-28T21:48:19.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~65s 2019-11-28T21:48:19.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~65s 2019-11-28T21:48:19.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~65s 2019-11-28T21:48:19.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~65s 2019-11-28T21:48:19.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~65s 2019-11-28T21:48:19.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~65s 2019-11-28T21:48:19.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~65s 2019-11-28T21:48:19.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~65s 2019-11-28T21:48:19.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~65s 2019-11-28T21:48:19.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~65s 2019-11-28T21:48:19.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~65s 2019-11-28T21:48:19.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~65s 2019-11-28T21:48:19.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~65s 2019-11-28T21:48:19.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~72s 2019-11-28T21:48:24.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2019-11-28T21:48:24.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2019-11-28T21:48:24.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~70s 2019-11-28T21:48:24.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2019-11-28T21:48:24.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~70s 2019-11-28T21:48:24.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~70s 2019-11-28T21:48:24.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~70s 2019-11-28T21:48:24.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~70s 2019-11-28T21:48:24.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~70s 2019-11-28T21:48:24.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~70s 2019-11-28T21:48:24.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~70s 2019-11-28T21:48:24.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~70s 2019-11-28T21:48:24.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~70s 2019-11-28T21:48:24.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~70s 2019-11-28T21:48:24.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~70s 2019-11-28T21:48:24.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~77s 2019-11-28T21:48:28.984 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2019-11-28T21:48:28.985 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 159, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/selinux.py", line 149, in teardown self.archive_log() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/selinux.py", line 180, in archive_log args=full_cmd.format(audit_archive=audit_archive) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 416, in run raise ConnectionLostError(command=quote(args), node=name) ConnectionLostError: SSH connection to smithi016 was lost: 'mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log' 2019-11-28T21:48:28.985 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2019-11-28T21:49:16.428 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2019-11-28T21:49:16.447 INFO:teuthology.task.internal:Duration was 38638.448103 seconds 2019-11-28T21:49:16.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2019-11-28T21:49:16.465 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2019-11-28T21:49:16.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:49:16.466 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:49:16.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~122s 2019-11-28T21:49:16.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~122s 2019-11-28T21:49:16.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~122s 2019-11-28T21:49:16.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~122s 2019-11-28T21:49:16.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~122s 2019-11-28T21:49:16.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~122s 2019-11-28T21:49:16.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~122s 2019-11-28T21:49:16.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~122s 2019-11-28T21:49:16.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~122s 2019-11-28T21:49:16.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~122s 2019-11-28T21:49:16.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~122s 2019-11-28T21:49:16.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~122s 2019-11-28T21:49:16.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~122s 2019-11-28T21:49:16.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~122s 2019-11-28T21:49:16.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~122s 2019-11-28T21:49:16.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~129s 2019-11-28T21:49:18.220 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-11-28T21:49:18.220 DEBUG:teuthology.task.console_log:Killing console logger for smithi080 2019-11-28T21:49:18.220 DEBUG:teuthology.orchestra.remote:psutil.NoSuchProcess process no longer exists (pid=23481) 2019-11-28T21:49:18.221 ERROR:teuthology.run_tasks:Manager failed: internal.syslog Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 159, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/syslog.py", line 89, in syslog wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 416, in run raise ConnectionLostError(command=quote(args), node=name) ConnectionLostError: SSH connection to smithi016 was lost: 'sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart' 2019-11-28T21:49:18.221 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2019-11-28T21:49:18.234 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2019-11-28T21:49:18.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:49:18.235 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:49:19.544 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2019-11-28T21:49:19.545 ERROR:teuthology.run_tasks:Manager failed: internal.sudo Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 159, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/__init__.py", line 400, in sudo path=sudoers_file, ext=backup_ext File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 416, in run raise ConnectionLostError(command=quote(args), node=name) ConnectionLostError: SSH connection to smithi016 was lost: 'sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers' 2019-11-28T21:49:19.545 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2019-11-28T21:49:19.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:49:19.561 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:49:21.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~127s 2019-11-28T21:49:21.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~127s 2019-11-28T21:49:21.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~127s 2019-11-28T21:49:21.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~127s 2019-11-28T21:49:21.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~127s 2019-11-28T21:49:21.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~127s 2019-11-28T21:49:21.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~127s 2019-11-28T21:49:21.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~127s 2019-11-28T21:49:21.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~127s 2019-11-28T21:49:21.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~127s 2019-11-28T21:49:21.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~127s 2019-11-28T21:49:21.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~127s 2019-11-28T21:49:21.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~127s 2019-11-28T21:49:21.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~127s 2019-11-28T21:49:21.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~127s 2019-11-28T21:49:21.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~134s 2019-11-28T21:49:22.616 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2019-11-28T21:49:22.617 ERROR:teuthology.run_tasks:Manager failed: internal.coredump Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 159, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/__init__.py", line 438, in coredump wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 416, in run raise ConnectionLostError(command=quote(args), node=name) ConnectionLostError: SSH connection to smithi016 was lost: 'sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump' 2019-11-28T21:49:22.617 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2019-11-28T21:49:22.630 INFO:teuthology.task.internal:Transferring archived files... 2019-11-28T21:49:22.631 DEBUG:teuthology.misc:Transferring archived files from smithi076:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2019-11-27_23:36:14-kcephfs-wip-pdonnell-testing-20191127.175901-distro-basic-smithi/4548252/remote/smithi076 2019-11-28T21:49:22.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:49:22.631 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi076.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:49:25.692 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2019-11-28T21:49:25.693 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 159, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/__init__.py", line 361, in archive misc.pull_directory(rem, archive_dir, path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 766, in pull_directory r = remote.get_tar_stream(remotedir, sudo=True) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 439, in get_tar_stream return self.run(args=args, wait=False, stdout=run.PIPE) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 416, in run raise ConnectionLostError(command=quote(args), node=name) ConnectionLostError: SSH connection to smithi076 was lost: 'sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- .' 2019-11-28T21:49:25.693 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2019-11-28T21:49:25.710 INFO:teuthology.task.internal:Not uploading archives. 2019-11-28T21:49:25.710 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2019-11-28T21:49:25.728 INFO:teuthology.task.internal:Tidying up after the test... 2019-11-28T21:49:25.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:49:25.728 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi016.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:49:26.484 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~132s 2019-11-28T21:49:26.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~132s 2019-11-28T21:49:26.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~132s 2019-11-28T21:49:26.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~132s 2019-11-28T21:49:26.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~132s 2019-11-28T21:49:26.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~132s 2019-11-28T21:49:26.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~132s 2019-11-28T21:49:26.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~132s 2019-11-28T21:49:26.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~132s 2019-11-28T21:49:26.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~132s 2019-11-28T21:49:26.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~132s 2019-11-28T21:49:26.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~132s 2019-11-28T21:49:26.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~132s 2019-11-28T21:49:26.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~132s 2019-11-28T21:49:26.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~132s 2019-11-28T21:49:26.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~139s 2019-11-28T21:49:28.792 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2019-11-28T21:49:28.793 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 159, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/__init__.py", line 49, in base wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 416, in run raise ConnectionLostError(command=quote(args), node=name) ConnectionLostError: SSH connection to smithi016 was lost: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2019-11-28T21:49:28.793 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2019-11-28T21:49:28.811 DEBUG:teuthology.run_tasks:Unwinding manager internal.lock_machines 2019-11-28T21:49:28.826 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: Test failure: test_unmount_for_evicted_client (tasks.cephfs.test_client_recovery.TestClientRecovery), test_unmount_for_evicted_client (tasks.cephfs.test_client_recovery.TestClientRecovery) 2019-11-28T21:49:28.826 INFO:teuthology.nuke:Checking targets against current locks 2019-11-28T21:49:28.904 INFO:teuthology.nuke:Not nuking smithi133.front.sepia.ceph.com because description doesn't match 2019-11-28T21:49:28.904 INFO:teuthology.nuke:Not nuking smithi075.front.sepia.ceph.com because description doesn't match 2019-11-28T21:49:28.904 INFO:teuthology.nuke:Not nuking smithi174.front.sepia.ceph.com because description doesn't match 2019-11-28T21:49:28.904 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology", line 11, in load_entry_point('teuthology', 'console_scripts', 'teuthology')() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/scripts/run.py", line 34, in main teuthology.run.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run.py", line 392, in main report_outcome(config, archive, fake_ctx.summary, fake_ctx) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run.py", line 253, in report_outcome nuke(fake_ctx, fake_ctx.lock) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/nuke/__init__.py", line 250, in nuke if ctx.name not in lock['description']: TypeError: argument of type 'NoneType' is not iterable